2023-10-03T09:55:58.790 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-03T09:55:58.790 DEBUG:teuthology.run:Teuthology command: teuthology --name dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi --description fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/fsstress}}} --archive /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409562 --owner scheduled_dparmar@teuthology --verbose -- /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409562/orig.config.yaml 2023-10-03T09:55:58.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T09:55:58.931 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409562 branch: fix-nfs-apply-err-reporting description: fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/fsstress}}} email: null first_in_suite: false job_id: '7409562' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: fix-nfs-apply-err-reporting ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-62953 sha1: a6297898cc696a7db13e71aaa0b24c78a4c800c5 owner: scheduled_dparmar@teuthology priority: 55 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 seed: 6051 sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 sleep_before_teardown: 0 suite: fs:upgrade suite_branch: wip-62953 suite_path: /home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa suite_relpath: qa suite_repo: https://github.com/dparmar18/ceph suite_sha1: a6297898cc696a7db13e71aaa0b24c78a4c800c5 targets: smithi146.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB+K7n2yj67VdGuozLM5Nf2IsIMW4wEjE0ejV7WP7FpYH4Qrs3NXcYTQW9OnZrK0MUbEKGyWLCiWLaQCkbszNM0= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKVmzuFyAzqWBzOUbLkKp8CcK0w64CBZjXQHqXJcmpJakqAy5zNTfpGQQIDBFlaIU3ty3UIENvK6OkneelN+AGc= tasks: - install: branch: pacific exclude_packages: - cephadm - ceph-mgr-cephadm - ceph-immutable-object-cache - python3-rados - python3-rgw - python3-rbd - python3-cephfs - ceph-volume extra_packages: - python-rados - python-rgw - python-rbd - python-cephfs extra_system_packages: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - print: '**** done installing pacific' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client pacific - print: '**** done ceph' - ceph-fuse: null - mds_pre_upgrade: null - print: '**** done mds pre-upgrade sequence' - install.upgrade: mon.a: branch: reef - print: '**** done install.upgrade the host' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - ceph.stop: - mds.* - ceph.restart: daemons: - mds.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph osd dump -f json-pretty - ceph versions - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph osd require-osd-release reef - ceph.healthy: null - print: '**** done ceph.restart' - ceph-fuse: client.0: mounted: false - print: '**** done unmount client.0' - install.upgrade: client.0: null - print: '**** done install.upgrade on client.0' - ceph-fuse: client.0: null - print: '**** done remount client.0' - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: branch: pacific fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end - if not is_fuse() then reject() end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-03_09:48:43 tube: smithi user: dparmar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-03T09:55:58.932 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa; will attempt to use it 2023-10-03T09:55:58.932 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks 2023-10-03T09:55:58.933 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-03T09:55:58.934 INFO:teuthology.task.internal:Checking packages... 2023-10-03T09:55:58.957 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d6eb91756d99e822eeed7c6b783104a6ad86054' 2023-10-03T09:55:58.957 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T09:55:58.957 INFO:teuthology.packaging:ref: None 2023-10-03T09:55:58.957 INFO:teuthology.packaging:tag: None 2023-10-03T09:55:58.957 INFO:teuthology.packaging:branch: fix-nfs-apply-err-reporting 2023-10-03T09:55:58.957 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T09:55:58.957 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=fix-nfs-apply-err-reporting 2023-10-03T09:55:59.189 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5795.g3d6eb917 2023-10-03T09:55:59.189 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-03T09:55:59.197 INFO:teuthology.task.internal:no buildpackages task found 2023-10-03T09:55:59.197 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-03T09:55:59.204 INFO:teuthology.task.internal:Saving configuration 2023-10-03T09:55:59.222 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-03T09:55:59.228 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T09:55:59.252 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409562', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 09:49:44.150739', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB+K7n2yj67VdGuozLM5Nf2IsIMW4wEjE0ejV7WP7FpYH4Qrs3NXcYTQW9OnZrK0MUbEKGyWLCiWLaQCkbszNM0='} 2023-10-03T09:55:59.274 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409562', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 09:49:44.149074', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKVmzuFyAzqWBzOUbLkKp8CcK0w64CBZjXQHqXJcmpJakqAy5zNTfpGQQIDBFlaIU3ty3UIENvK6OkneelN+AGc='} 2023-10-03T09:55:59.274 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-03T09:55:59.281 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-10-03T09:55:59.281 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['client.0'] 2023-10-03T09:55:59.281 INFO:teuthology.run_tasks:Running task console_log... 2023-10-03T09:55:59.350 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efebf8bdf70>, signals=[15]) 2023-10-03T09:55:59.350 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-03T09:55:59.356 INFO:teuthology.task.internal:Opening connections... 2023-10-03T09:55:59.356 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T09:55:59.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:55:59.425 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2023-10-03T09:55:59.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:55:59.491 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-03T09:55:59.497 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2023-10-03T09:55:59.519 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2023-10-03T09:55:59.520 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-10-03T09:55:59.579 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2023-10-03T09:55:59.579 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8" 2023-10-03T09:55:59.579 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2023-10-03T09:55:59.580 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2023-10-03T09:55:59.580 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8" 2023-10-03T09:55:59.580 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2023-10-03T09:55:59.580 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-03T09:55:59.580 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2023-10-03T09:55:59.580 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-03T09:55:59.580 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2023-10-03T09:55:59.580 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-03T09:55:59.580 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-03T09:55:59.580 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-03T09:55:59.581 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-10-03T09:55:59.603 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2023-10-03T09:55:59.626 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2023-10-03T09:55:59.626 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-10-03T09:55:59.688 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2023-10-03T09:55:59.688 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8" 2023-10-03T09:55:59.688 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2023-10-03T09:55:59.688 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2023-10-03T09:55:59.688 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8" 2023-10-03T09:55:59.688 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8" 2023-10-03T09:55:59.689 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-03T09:55:59.689 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2023-10-03T09:55:59.689 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-03T09:55:59.689 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2023-10-03T09:55:59.689 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-03T09:55:59.689 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-03T09:55:59.689 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-03T09:55:59.689 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-10-03T09:55:59.711 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-03T09:55:59.721 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-03T09:55:59.728 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-03T09:55:59.729 DEBUG:teuthology.orchestra.run.smithi146:> test '!' -e /home/ubuntu/cephtest 2023-10-03T09:55:59.731 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2023-10-03T09:55:59.751 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-03T09:55:59.830 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-03T09:55:59.830 DEBUG:teuthology.orchestra.run.smithi146:> test -z $(ls -A /var/lib/ceph) 2023-10-03T09:55:59.832 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2023-10-03T09:55:59.863 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-03T09:55:59.920 INFO:teuthology.run_tasks:Running task kernel... 2023-10-03T09:55:59.935 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-03T09:55:59.935 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-03T09:55:59.935 DEBUG:teuthology.orchestra.run.smithi146:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-03T09:55:59.936 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-03T09:55:59.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T09:55:59.955 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2023-10-03T09:55:59.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T09:55:59.956 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2023-10-03T09:56:00.016 INFO:teuthology.orchestra.run.smithi146.stdout:4.18.0-489.el8.x86_64 2023-10-03T09:56:00.016 INFO:teuthology.task.kernel:Running kernel on smithi146: 4.18.0-489.el8.x86_64 2023-10-03T09:56:00.016 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum install -y kernel 2023-10-03T09:56:00.018 INFO:teuthology.orchestra.run.smithi153.stdout:4.18.0-489.el8.x86_64 2023-10-03T09:56:00.018 INFO:teuthology.task.kernel:Running kernel on smithi153: 4.18.0-489.el8.x86_64 2023-10-03T09:56:00.018 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum install -y kernel 2023-10-03T09:56:05.001 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - AppStream 13 MB/s | 33 MB 00:02 2023-10-03T09:56:05.021 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - AppStream 14 MB/s | 33 MB 00:02 2023-10-03T09:56:13.313 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - BaseOS 22 MB/s | 48 MB 00:02 2023-10-03T09:56:15.059 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - BaseOS 12 MB/s | 48 MB 00:03 2023-10-03T09:56:20.437 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - Extras 115 kB/s | 18 kB 00:00 2023-10-03T09:56:20.913 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - Extras common packages 23 kB/s | 6.9 kB 00:00 2023-10-03T09:56:21.214 INFO:teuthology.orchestra.run.smithi146.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-10-03T09:56:22.258 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - Extras 56 kB/s | 18 kB 00:00 2023-10-03T09:56:22.762 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - Extras common packages 21 kB/s | 6.9 kB 00:00 2023-10-03T09:56:22.942 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-10-03T09:56:23.202 INFO:teuthology.orchestra.run.smithi153.stdout:Copr repo for python3-asyncssh owned by ceph 12 kB/s | 3.5 kB 00:00 2023-10-03T09:56:24.311 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-10-03T09:56:26.732 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 408 kB/s | 24 kB 00:00 2023-10-03T09:56:28.220 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 294 kB/s | 24 kB 00:00 2023-10-03T09:56:30.218 INFO:teuthology.orchestra.run.smithi146.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-10-03T09:56:30.218 INFO:teuthology.orchestra.run.smithi146.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-10-03T09:56:30.458 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2023-10-03T09:56:30.459 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2023-10-03T09:56:30.459 INFO:teuthology.orchestra.run.smithi146.stdout: Package Architecture Version Repository Size 2023-10-03T09:56:30.459 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2023-10-03T09:56:30.459 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2023-10-03T09:56:30.459 INFO:teuthology.orchestra.run.smithi146.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-10-03T09:56:30.459 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2023-10-03T09:56:30.459 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-10-03T09:56:30.460 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-10-03T09:56:30.460 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T09:56:30.460 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2023-10-03T09:56:30.460 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2023-10-03T09:56:30.460 INFO:teuthology.orchestra.run.smithi146.stdout:Install 3 Packages 2023-10-03T09:56:30.460 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T09:56:30.460 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 88 M 2023-10-03T09:56:30.461 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 96 M 2023-10-03T09:56:30.461 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2023-10-03T09:56:31.719 INFO:teuthology.orchestra.run.smithi153.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-10-03T09:56:31.719 INFO:teuthology.orchestra.run.smithi153.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-10-03T09:56:31.768 INFO:teuthology.orchestra.run.smithi146.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 9.1 MB/s | 10 MB 00:01 2023-10-03T09:56:31.982 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-03T09:56:31.983 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-03T09:56:31.983 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2023-10-03T09:56:31.983 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-03T09:56:31.983 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-10-03T09:56:31.983 INFO:teuthology.orchestra.run.smithi153.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-10-03T09:56:31.983 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-10-03T09:56:31.984 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-10-03T09:56:31.984 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-10-03T09:56:31.984 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T09:56:31.984 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-10-03T09:56:31.984 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2023-10-03T09:56:31.984 INFO:teuthology.orchestra.run.smithi153.stdout:Install 3 Packages 2023-10-03T09:56:31.984 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T09:56:31.984 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 88 M 2023-10-03T09:56:31.985 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 96 M 2023-10-03T09:56:31.985 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-10-03T09:56:32.818 INFO:teuthology.orchestra.run.smithi146.stdout:(2/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 16 MB/s | 35 MB 00:02 2023-10-03T09:56:33.154 INFO:teuthology.orchestra.run.smithi153.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 8.9 MB/s | 10 MB 00:01 2023-10-03T09:56:33.402 INFO:teuthology.orchestra.run.smithi146.stdout:(3/3): kernel-core-4.18.0-514.el8.x86_64.rpm 16 MB/s | 43 MB 00:02 2023-10-03T09:56:33.402 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2023-10-03T09:56:33.402 INFO:teuthology.orchestra.run.smithi146.stdout:Total 30 MB/s | 88 MB 00:02 2023-10-03T09:56:34.076 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2023-10-03T09:56:34.146 INFO:teuthology.orchestra.run.smithi153.stdout:(2/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 17 MB/s | 35 MB 00:02 2023-10-03T09:56:34.489 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2023-10-03T09:56:34.489 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2023-10-03T09:56:34.829 INFO:teuthology.orchestra.run.smithi153.stdout:(3/3): kernel-core-4.18.0-514.el8.x86_64.rpm 15 MB/s | 43 MB 00:02 2023-10-03T09:56:34.830 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-10-03T09:56:34.830 INFO:teuthology.orchestra.run.smithi153.stdout:Total 31 MB/s | 88 MB 00:02 2023-10-03T09:56:35.503 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-10-03T09:56:35.720 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2023-10-03T09:56:35.754 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2023-10-03T09:56:35.925 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-10-03T09:56:35.926 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-10-03T09:56:37.143 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-10-03T09:56:37.168 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-10-03T09:56:38.517 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2023-10-03T09:56:39.124 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:56:39.908 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-10-03T09:56:40.452 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:56:42.712 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:56:43.324 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:56:44.040 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:56:44.418 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:56:46.706 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:56:46.986 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:56:47.802 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:56:48.081 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:08.956 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:08.980 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:09.323 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:09.323 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:57:09.323 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:57:09.816 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:09.840 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:10.529 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:10.529 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T09:57:10.530 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2023-10-03T09:57:10.530 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-10-03T09:57:10.530 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-10-03T09:57:10.530 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T09:57:10.530 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2023-10-03T09:57:10.546 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:10.547 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:57:10.547 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:57:10.671 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q kernel | sort -rV | head -n 1 2023-10-03T09:57:10.891 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-03T09:57:10.891 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-03T09:57:10.892 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-10-03T09:57:10.892 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-03T09:57:10.892 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-03T09:57:10.892 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-03T09:57:10.892 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi146.front.sepia.ceph.com, path=None, version=distro) 2023-10-03T09:57:10.893 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q kernel | sort -rV | head -n 1 2023-10-03T09:57:11.101 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-03T09:57:11.101 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-03T09:57:11.102 DEBUG:teuthology.orchestra.run.smithi146:> sudo rpm -qi grub2-tools 2023-10-03T09:57:11.135 INFO:teuthology.orchestra.run.smithi146.stdout:Name : grub2-tools 2023-10-03T09:57:11.135 INFO:teuthology.orchestra.run.smithi146.stdout:Epoch : 1 2023-10-03T09:57:11.135 INFO:teuthology.orchestra.run.smithi146.stdout:Version : 2.02 2023-10-03T09:57:11.135 INFO:teuthology.orchestra.run.smithi146.stdout:Release : 129.el8 2023-10-03T09:57:11.135 INFO:teuthology.orchestra.run.smithi146.stdout:Architecture: x86_64 2023-10-03T09:57:11.135 INFO:teuthology.orchestra.run.smithi146.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-03T09:57:11.135 INFO:teuthology.orchestra.run.smithi146.stdout:Group : System Environment/Base 2023-10-03T09:57:11.135 INFO:teuthology.orchestra.run.smithi146.stdout:Size : 9265586 2023-10-03T09:57:11.135 INFO:teuthology.orchestra.run.smithi146.stdout:License : GPLv3+ 2023-10-03T09:57:11.135 INFO:teuthology.orchestra.run.smithi146.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-03T09:57:11.135 INFO:teuthology.orchestra.run.smithi146.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-03T09:57:11.136 INFO:teuthology.orchestra.run.smithi146.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-03T09:57:11.136 INFO:teuthology.orchestra.run.smithi146.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-03T09:57:11.136 INFO:teuthology.orchestra.run.smithi146.stdout:Relocations : (not relocatable) 2023-10-03T09:57:11.136 INFO:teuthology.orchestra.run.smithi146.stdout:Packager : CentOS BuildSystem 2023-10-03T09:57:11.136 INFO:teuthology.orchestra.run.smithi146.stdout:Vendor : CentOS 2023-10-03T09:57:11.136 INFO:teuthology.orchestra.run.smithi146.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-03T09:57:11.136 INFO:teuthology.orchestra.run.smithi146.stdout:Summary : Support tools for GRUB. 2023-10-03T09:57:11.136 INFO:teuthology.orchestra.run.smithi146.stdout:Description : 2023-10-03T09:57:11.136 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T09:57:11.136 INFO:teuthology.orchestra.run.smithi146.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-03T09:57:11.136 INFO:teuthology.orchestra.run.smithi146.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-03T09:57:11.136 INFO:teuthology.orchestra.run.smithi146.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-03T09:57:11.136 INFO:teuthology.orchestra.run.smithi146.stdout:hardware devices. 2023-10-03T09:57:11.137 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T09:57:11.137 INFO:teuthology.orchestra.run.smithi146.stdout:This subpackage provides tools for support of all platforms. 2023-10-03T09:57:11.137 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-03T09:57:11.138 INFO:teuthology.task.kernel:Updating grub on smithi146 to boot 4.18.0-514.el8.x86_64 2023-10-03T09:57:11.138 DEBUG:teuthology.orchestra.run.smithi146:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-03T09:57:11.284 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:11.285 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T09:57:11.285 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-10-03T09:57:11.285 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-10-03T09:57:11.285 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-10-03T09:57:11.285 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T09:57:11.285 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-03T09:57:11.426 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q kernel | sort -rV | head -n 1 2023-10-03T09:57:11.681 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-03T09:57:11.681 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-03T09:57:11.681 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-10-03T09:57:11.681 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-03T09:57:11.682 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-03T09:57:11.682 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-03T09:57:11.682 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi153.front.sepia.ceph.com, path=None, version=distro) 2023-10-03T09:57:11.682 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q kernel | sort -rV | head -n 1 2023-10-03T09:57:11.889 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-03T09:57:11.889 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-03T09:57:11.890 DEBUG:teuthology.orchestra.run.smithi153:> sudo rpm -qi grub2-tools 2023-10-03T09:57:11.923 INFO:teuthology.orchestra.run.smithi153.stdout:Name : grub2-tools 2023-10-03T09:57:11.923 INFO:teuthology.orchestra.run.smithi153.stdout:Epoch : 1 2023-10-03T09:57:11.923 INFO:teuthology.orchestra.run.smithi153.stdout:Version : 2.02 2023-10-03T09:57:11.923 INFO:teuthology.orchestra.run.smithi153.stdout:Release : 129.el8 2023-10-03T09:57:11.923 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: x86_64 2023-10-03T09:57:11.923 INFO:teuthology.orchestra.run.smithi153.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-03T09:57:11.924 INFO:teuthology.orchestra.run.smithi153.stdout:Group : System Environment/Base 2023-10-03T09:57:11.924 INFO:teuthology.orchestra.run.smithi153.stdout:Size : 9265586 2023-10-03T09:57:11.924 INFO:teuthology.orchestra.run.smithi153.stdout:License : GPLv3+ 2023-10-03T09:57:11.924 INFO:teuthology.orchestra.run.smithi153.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-03T09:57:11.924 INFO:teuthology.orchestra.run.smithi153.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-03T09:57:11.924 INFO:teuthology.orchestra.run.smithi153.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-03T09:57:11.924 INFO:teuthology.orchestra.run.smithi153.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-03T09:57:11.924 INFO:teuthology.orchestra.run.smithi153.stdout:Relocations : (not relocatable) 2023-10-03T09:57:11.924 INFO:teuthology.orchestra.run.smithi153.stdout:Packager : CentOS BuildSystem 2023-10-03T09:57:11.924 INFO:teuthology.orchestra.run.smithi153.stdout:Vendor : CentOS 2023-10-03T09:57:11.924 INFO:teuthology.orchestra.run.smithi153.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-03T09:57:11.924 INFO:teuthology.orchestra.run.smithi153.stdout:Summary : Support tools for GRUB. 2023-10-03T09:57:11.924 INFO:teuthology.orchestra.run.smithi153.stdout:Description : 2023-10-03T09:57:11.925 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T09:57:11.925 INFO:teuthology.orchestra.run.smithi153.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-03T09:57:11.925 INFO:teuthology.orchestra.run.smithi153.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-03T09:57:11.925 INFO:teuthology.orchestra.run.smithi153.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-03T09:57:11.925 INFO:teuthology.orchestra.run.smithi153.stdout:hardware devices. 2023-10-03T09:57:11.925 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T09:57:11.925 INFO:teuthology.orchestra.run.smithi153.stdout:This subpackage provides tools for support of all platforms. 2023-10-03T09:57:11.926 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-03T09:57:11.926 INFO:teuthology.task.kernel:Updating grub on smithi153 to boot 4.18.0-514.el8.x86_64 2023-10-03T09:57:11.926 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-03T09:57:12.492 INFO:teuthology.orchestra.run.smithi146.stderr:Generating grub configuration file ... 2023-10-03T09:57:13.311 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2023-10-03T09:57:14.649 INFO:teuthology.orchestra.run.smithi146.stderr:done 2023-10-03T09:57:14.651 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2023-10-03T09:57:14.681 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.CkZaLo1GtB 2023-10-03T09:57:14.681 DEBUG:teuthology.orchestra.run.smithi146:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.CkZaLo1GtB 2023-10-03T09:57:14.755 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.CkZaLo1GtB 2023-10-03T09:57:14.919 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.CkZaLo1GtB is 6KB 2023-10-03T09:57:14.967 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.CkZaLo1GtB 2023-10-03T09:57:14.984 DEBUG:teuthology.orchestra.run.smithi146:> sudo /bin/ls /boot/loader/entries || true 2023-10-03T09:57:15.056 INFO:teuthology.orchestra.run.smithi146.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-03T09:57:15.056 INFO:teuthology.orchestra.run.smithi146.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-03T09:57:15.056 INFO:teuthology.orchestra.run.smithi146.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-03T09:57:15.056 INFO:teuthology.orchestra.run.smithi146.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-10-03T09:57:15.057 DEBUG:teuthology.orchestra.run.smithi146:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-10-03T09:57:15.219 DEBUG:teuthology.orchestra.run.smithi146:> sudo shutdown -r now 2023-10-03T09:57:15.331 INFO:teuthology.orchestra.run.smithi153.stderr:done 2023-10-03T09:57:15.332 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2023-10-03T09:57:15.362 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.32oGbG2Qs0 2023-10-03T09:57:15.362 DEBUG:teuthology.orchestra.run.smithi153:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.32oGbG2Qs0 2023-10-03T09:57:15.439 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.32oGbG2Qs0 2023-10-03T09:57:15.581 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.32oGbG2Qs0 is 6KB 2023-10-03T09:57:15.628 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.32oGbG2Qs0 2023-10-03T09:57:15.646 DEBUG:teuthology.orchestra.run.smithi153:> sudo /bin/ls /boot/loader/entries || true 2023-10-03T09:57:15.714 INFO:teuthology.orchestra.run.smithi153.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-03T09:57:15.714 INFO:teuthology.orchestra.run.smithi153.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-03T09:57:15.714 INFO:teuthology.orchestra.run.smithi153.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-03T09:57:15.715 INFO:teuthology.orchestra.run.smithi153.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-10-03T09:57:15.716 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-10-03T09:57:15.870 DEBUG:teuthology.orchestra.run.smithi153:> sudo shutdown -r now 2023-10-03T09:57:45.228 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-03T09:57:45.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-03T09:57:45.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:57:45.873 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-03T09:57:45.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-03T09:57:45.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:03.642 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-10-03T09:58:04.410 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-03T09:58:12.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-03T09:58:12.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:13.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-03T09:58:13.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:15.706 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-10-03T09:58:16.478 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-03T09:58:27.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-03T09:58:27.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:28.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-03T09:58:28.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:46.138 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-10-03T09:58:46.906 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-03T09:59:01.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-03T09:59:01.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:59:01.435 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-10-03T09:59:01.711 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-03T09:59:01.711 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-514.el8.x86_64"... 2023-10-03T09:59:01.711 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2023-10-03T09:59:01.728 INFO:teuthology.orchestra.run.smithi146.stdout:4.18.0-514.el8.x86_64 2023-10-03T09:59:01.729 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-10-03T09:59:01.729 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-03T09:59:01.729 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-03T09:59:01.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-03T09:59:01.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:59:02.196 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-10-03T09:59:02.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-03T09:59:02.465 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-514.el8.x86_64"... 2023-10-03T09:59:02.465 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2023-10-03T09:59:02.481 INFO:teuthology.orchestra.run.smithi153.stdout:4.18.0-514.el8.x86_64 2023-10-03T09:59:02.482 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-10-03T09:59:02.482 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-03T09:59:02.482 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-03T09:59:02.729 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-03T09:59:02.730 DEBUG:teuthology.orchestra.run.smithi146:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-03T09:59:02.810 INFO:teuthology.orchestra.run.smithi146.stdout:ttyS1 2023-10-03T09:59:02.828 DEBUG:teuthology.parallel:result is None 2023-10-03T09:59:03.483 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2023-10-03T09:59:03.483 DEBUG:teuthology.orchestra.run.smithi153:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-03T09:59:03.563 INFO:teuthology.orchestra.run.smithi153.stdout:ttyS1 2023-10-03T09:59:03.572 DEBUG:teuthology.parallel:result is None 2023-10-03T09:59:03.573 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-03T09:59:03.579 INFO:teuthology.task.internal:Creating test directory... 2023-10-03T09:59:03.579 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-03T09:59:03.581 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-03T09:59:03.599 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-03T09:59:03.605 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-03T09:59:03.614 INFO:teuthology.task.internal:Creating archive directory... 2023-10-03T09:59:03.614 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-03T09:59:03.643 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-03T09:59:03.675 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-03T09:59:03.684 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-03T09:59:03.685 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-03T09:59:03.713 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-03T09:59:03.741 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T09:59:03.741 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T09:59:03.754 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T09:59:03.755 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T09:59:03.755 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-03T09:59:03.763 INFO:teuthology.task.internal:Configuring sudo... 2023-10-03T09:59:03.763 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-03T09:59:03.800 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-03T09:59:03.828 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-03T09:59:03.837 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-03T09:59:03.837 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-03T09:59:03.873 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-03T09:59:03.893 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T09:59:03.980 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T09:59:04.025 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T09:59:04.114 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T09:59:04.158 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T09:59:04.158 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-03T09:59:04.229 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T09:59:04.274 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T09:59:04.347 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T09:59:04.393 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T09:59:04.450 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-03T09:59:04.450 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-03T09:59:04.509 DEBUG:teuthology.orchestra.run.smithi146:> sudo service rsyslog restart 2023-10-03T09:59:04.511 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2023-10-03T09:59:04.571 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-03T09:59:04.920 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-03T09:59:05.026 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-03T09:59:05.034 INFO:teuthology.task.internal:Starting timer... 2023-10-03T09:59:05.034 INFO:teuthology.run_tasks:Running task pcp... 2023-10-03T09:59:05.088 INFO:teuthology.run_tasks:Running task selinux... 2023-10-03T09:59:05.096 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-03T09:59:05.096 DEBUG:teuthology.orchestra.run.smithi146:> sudo service auditd rotate 2023-10-03T09:59:05.171 INFO:teuthology.orchestra.run.smithi146.stdout:Rotating logs: 2023-10-03T09:59:05.173 DEBUG:teuthology.orchestra.run.smithi153:> sudo service auditd rotate 2023-10-03T09:59:05.975 INFO:teuthology.orchestra.run.smithi153.stdout:Rotating logs: 2023-10-03T09:59:05.989 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-03T09:59:05.989 DEBUG:teuthology.orchestra.run.smithi146:> /usr/sbin/getenforce 2023-10-03T09:59:06.013 INFO:teuthology.orchestra.run.smithi146.stdout:Permissive 2023-10-03T09:59:06.014 DEBUG:teuthology.orchestra.run.smithi153:> /usr/sbin/getenforce 2023-10-03T09:59:06.253 INFO:teuthology.orchestra.run.smithi153.stdout:Permissive 2023-10-03T09:59:06.254 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi146.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi153.front.sepia.ceph.com': 'permissive'} 2023-10-03T09:59:06.254 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-03T09:59:06.282 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T09:59:06.282 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-03T09:59:06.309 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T09:59:06.309 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-03T09:59:06.310 DEBUG:teuthology.orchestra.run.smithi146:> sudo /usr/sbin/setenforce permissive 2023-10-03T09:59:06.354 DEBUG:teuthology.orchestra.run.smithi153:> sudo /usr/sbin/setenforce permissive 2023-10-03T09:59:06.380 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-03T09:59:06.391 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-03T09:59:06.391 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-03T09:59:06.407 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-03T09:59:06.408 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi146.front.sepia.ceph.com,smithi153.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-03T10:06:33.305 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi146.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com')] 2023-10-03T10:06:33.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-03T10:06:33.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T10:06:33.377 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-10-03T10:06:33.446 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-03T10:06:33.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-03T10:06:33.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T10:06:33.515 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-10-03T10:06:33.590 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-03T10:06:33.590 INFO:teuthology.run_tasks:Running task clock... 2023-10-03T10:06:33.601 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-03T10:06:33.601 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-03T10:06:33.602 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T10:06:33.604 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-03T10:06:33.605 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T10:06:33.637 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-03T10:06:33.654 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-03T10:06:33.663 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-03T10:06:33.678 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-03T10:06:33.715 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: ntpd: command not found 2023-10-03T10:06:33.726 INFO:teuthology.orchestra.run.smithi146.stdout:506 Cannot talk to daemon 2023-10-03T10:06:33.740 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-03T10:06:33.749 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: ntpd: command not found 2023-10-03T10:06:33.754 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-03T10:06:33.760 INFO:teuthology.orchestra.run.smithi153.stdout:506 Cannot talk to daemon 2023-10-03T10:06:33.775 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-03T10:06:33.788 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-03T10:06:33.821 INFO:teuthology.orchestra.run.smithi146.stderr:bash: ntpq: command not found 2023-10-03T10:06:33.825 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-03T10:06:33.825 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2023-10-03T10:06:33.825 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:33.825 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:33.825 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:33.825 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:33.848 INFO:teuthology.orchestra.run.smithi153.stderr:bash: ntpq: command not found 2023-10-03T10:06:33.852 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-03T10:06:33.852 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2023-10-03T10:06:33.852 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:33.852 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:33.852 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:33.852 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:33.853 INFO:teuthology.run_tasks:Running task install... 2023-10-03T10:06:33.863 DEBUG:teuthology.task.install:project ceph 2023-10-03T10:06:33.863 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}} 2023-10-03T10:06:33.863 DEBUG:teuthology.task.install:config {'branch': 'pacific', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'} 2023-10-03T10:06:33.864 INFO:teuthology.task.install:Using flavor: default 2023-10-03T10:06:33.873 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-03T10:06:33.873 INFO:teuthology.task.install:extra packages: ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'] 2023-10-03T10:06:33.873 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'tag': None, 'wait_for_package': False} 2023-10-03T10:06:33.874 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:06:33.874 INFO:teuthology.packaging:ref: None 2023-10-03T10:06:33.874 INFO:teuthology.packaging:tag: None 2023-10-03T10:06:33.874 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:06:33.874 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:06:33.874 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-03T10:06:33.876 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'tag': None, 'wait_for_package': False} 2023-10-03T10:06:33.876 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:06:33.876 INFO:teuthology.packaging:ref: None 2023-10-03T10:06:33.876 INFO:teuthology.packaging:tag: None 2023-10-03T10:06:33.876 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:06:33.876 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:06:33.877 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-03T10:06:34.119 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/ 2023-10-03T10:06:34.119 INFO:teuthology.task.install.rpm:Package version is 16.2.14-44.geeb13ac9 2023-10-03T10:06:34.183 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/ 2023-10-03T10:06:34.184 INFO:teuthology.task.install.rpm:Package version is 16.2.14-44.geeb13ac9 2023-10-03T10:06:34.249 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-03T10:06:34.250 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T10:06:34.250 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-03T10:06:34.278 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2023-10-03T10:06:34.278 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:06:34.279 INFO:teuthology.packaging:ref: None 2023-10-03T10:06:34.279 INFO:teuthology.packaging:tag: None 2023-10-03T10:06:34.279 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:06:34.279 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:06:34.279 DEBUG:teuthology.orchestra.run.smithi146:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-03T10:06:34.347 DEBUG:teuthology.orchestra.run.smithi146:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-03T10:06:34.362 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-03T10:06:34.362 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-03T10:06:34.362 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-03T10:06:34.393 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2023-10-03T10:06:34.393 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:06:34.393 INFO:teuthology.packaging:ref: None 2023-10-03T10:06:34.393 INFO:teuthology.packaging:tag: None 2023-10-03T10:06:34.393 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:06:34.393 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:06:34.394 DEBUG:teuthology.orchestra.run.smithi153:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-03T10:06:34.424 DEBUG:teuthology.orchestra.run.smithi146:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-03T10:06:34.462 DEBUG:teuthology.orchestra.run.smithi153:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-03T10:06:34.490 INFO:teuthology.orchestra.run.smithi146.stdout:check_obsoletes = 1 2023-10-03T10:06:34.491 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum clean all 2023-10-03T10:06:34.540 DEBUG:teuthology.orchestra.run.smithi153:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-03T10:06:34.608 INFO:teuthology.orchestra.run.smithi153.stdout:check_obsoletes = 1 2023-10-03T10:06:34.610 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum clean all 2023-10-03T10:06:34.764 INFO:teuthology.orchestra.run.smithi146.stdout:76 files removed 2023-10-03T10:06:34.792 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2023-10-03T10:06:34.888 INFO:teuthology.orchestra.run.smithi153.stdout:76 files removed 2023-10-03T10:06:34.919 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2023-10-03T10:06:35.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph packages for x86_64 226 kB/s | 76 kB 00:00 2023-10-03T10:06:35.661 INFO:teuthology.orchestra.run.smithi153.stdout:ceph packages for x86_64 231 kB/s | 76 kB 00:00 2023-10-03T10:06:35.874 INFO:teuthology.orchestra.run.smithi146.stdout:ceph noarch packages 52 kB/s | 15 kB 00:00 2023-10-03T10:06:36.008 INFO:teuthology.orchestra.run.smithi153.stdout:ceph noarch packages 50 kB/s | 15 kB 00:00 2023-10-03T10:06:36.175 INFO:teuthology.orchestra.run.smithi146.stdout:ceph source packages 5.3 kB/s | 1.4 kB 00:00 2023-10-03T10:06:36.295 INFO:teuthology.orchestra.run.smithi153.stdout:ceph source packages 5.5 kB/s | 1.4 kB 00:00 2023-10-03T10:06:38.735 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - AppStream 13 MB/s | 33 MB 00:02 2023-10-03T10:06:38.912 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - AppStream 13 MB/s | 33 MB 00:02 2023-10-03T10:06:47.376 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - BaseOS 18 MB/s | 48 MB 00:02 2023-10-03T10:06:47.912 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 48 MB 00:02 2023-10-03T10:06:54.553 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - Extras 54 kB/s | 18 kB 00:00 2023-10-03T10:06:55.018 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - Extras common packages 24 kB/s | 6.9 kB 00:00 2023-10-03T10:06:55.104 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - Extras 108 kB/s | 18 kB 00:00 2023-10-03T10:06:55.430 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - Extras common packages 45 kB/s | 6.9 kB 00:00 2023-10-03T10:06:55.819 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - PowerTools 10 MB/s | 6.5 MB 00:00 2023-10-03T10:06:56.228 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 8 - PowerTools 10 MB/s | 6.5 MB 00:00 2023-10-03T10:06:57.246 INFO:teuthology.orchestra.run.smithi146.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-03T10:06:57.708 INFO:teuthology.orchestra.run.smithi153.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2023-10-03T10:06:58.299 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2023-10-03T10:06:58.941 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-10-03T10:07:02.174 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 295 kB/s | 24 kB 00:00 2023-10-03T10:07:02.825 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 334 kB/s | 24 kB 00:00 2023-10-03T10:07:06.487 INFO:teuthology.orchestra.run.smithi146.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-03T10:07:06.488 INFO:teuthology.orchestra.run.smithi146.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-03T10:07:06.514 INFO:teuthology.orchestra.run.smithi146.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-10-03T10:07:06.514 INFO:teuthology.orchestra.run.smithi146.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-10-03T10:07:06.515 INFO:teuthology.orchestra.run.smithi146.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-10-03T10:07:06.516 INFO:teuthology.orchestra.run.smithi146.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-10-03T10:07:06.724 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2023-10-03T10:07:06.735 INFO:teuthology.orchestra.run.smithi146.stdout:==================================================================================================== 2023-10-03T10:07:06.735 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2023-10-03T10:07:06.735 INFO:teuthology.orchestra.run.smithi146.stdout:==================================================================================================== 2023-10-03T10:07:06.736 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2023-10-03T10:07:06.736 INFO:teuthology.orchestra.run.smithi146.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-10-03T10:07:06.736 INFO:teuthology.orchestra.run.smithi146.stdout: ceph x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.4 k 2023-10-03T10:07:06.736 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.1 M 2023-10-03T10:07:06.736 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 910 k 2023-10-03T10:07:06.736 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 1.6 M 2023-10-03T10:07:06.736 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 3.1 M 2023-10-03T10:07:06.736 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 8.6 M 2023-10-03T10:07:06.736 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 27 k 2023-10-03T10:07:06.736 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 12 M 2023-10-03T10:07:06.736 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 52 M 2023-10-03T10:07:06.737 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-10-03T10:07:06.737 INFO:teuthology.orchestra.run.smithi146.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-10-03T10:07:06.737 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 25 k 2023-10-03T10:07:06.737 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 824 k 2023-10-03T10:07:06.737 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 131 k 2023-10-03T10:07:06.737 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-10-03T10:07:06.737 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 215 k 2023-10-03T10:07:06.737 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 390 k 2023-10-03T10:07:06.737 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 369 k 2023-10-03T10:07:06.737 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 114 k 2023-10-03T10:07:06.737 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 88 k 2023-10-03T10:07:06.738 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-03T10:07:06.738 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 173 k 2023-10-03T10:07:06.738 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrading: 2023-10-03T10:07:06.738 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-10-03T10:07:06.738 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-10-03T10:07:06.738 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-10-03T10:07:06.738 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-10-03T10:07:06.738 INFO:teuthology.orchestra.run.smithi146.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2023-10-03T10:07:06.738 INFO:teuthology.orchestra.run.smithi146.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-10-03T10:07:06.738 INFO:teuthology.orchestra.run.smithi146.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-10-03T10:07:06.738 INFO:teuthology.orchestra.run.smithi146.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-10-03T10:07:06.739 INFO:teuthology.orchestra.run.smithi146.stdout: librados2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-03T10:07:06.739 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 4.2 M 2023-10-03T10:07:06.739 INFO:teuthology.orchestra.run.smithi146.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-10-03T10:07:06.739 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-10-03T10:07:06.739 INFO:teuthology.orchestra.run.smithi146.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-10-03T10:07:06.739 INFO:teuthology.orchestra.run.smithi146.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-10-03T10:07:06.739 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2023-10-03T10:07:06.739 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 24 M 2023-10-03T10:07:06.739 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 24 k 2023-10-03T10:07:06.739 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 2.4 M 2023-10-03T10:07:06.739 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 244 k 2023-10-03T10:07:06.739 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 5.0 M 2023-10-03T10:07:06.740 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 18 M 2023-10-03T10:07:06.740 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 15 k 2023-10-03T10:07:06.740 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 26 k 2023-10-03T10:07:06.740 INFO:teuthology.orchestra.run.smithi146.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-03T10:07:06.740 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-03T10:07:06.740 INFO:teuthology.orchestra.run.smithi146.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-03T10:07:06.740 INFO:teuthology.orchestra.run.smithi146.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-10-03T10:07:06.740 INFO:teuthology.orchestra.run.smithi146.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-10-03T10:07:06.740 INFO:teuthology.orchestra.run.smithi146.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-10-03T10:07:06.740 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 174 k 2023-10-03T10:07:06.740 INFO:teuthology.orchestra.run.smithi146.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-10-03T10:07:06.740 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-10-03T10:07:06.741 INFO:teuthology.orchestra.run.smithi146.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-03T10:07:06.741 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-10-03T10:07:06.741 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-03T10:07:06.741 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 493 k 2023-10-03T10:07:06.741 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-03T10:07:06.741 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.8 M 2023-10-03T10:07:06.741 INFO:teuthology.orchestra.run.smithi146.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-10-03T10:07:06.741 INFO:teuthology.orchestra.run.smithi146.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-10-03T10:07:06.741 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-03T10:07:06.741 INFO:teuthology.orchestra.run.smithi146.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-10-03T10:07:06.741 INFO:teuthology.orchestra.run.smithi146.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-10-03T10:07:06.741 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-03T10:07:06.742 INFO:teuthology.orchestra.run.smithi146.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-03T10:07:06.742 INFO:teuthology.orchestra.run.smithi146.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-03T10:07:06.742 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-03T10:07:06.742 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-10-03T10:07:06.742 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-10-03T10:07:06.742 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-10-03T10:07:06.742 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-03T10:07:06.742 INFO:teuthology.orchestra.run.smithi146.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-03T10:07:06.742 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-03T10:07:06.742 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 45 k 2023-10-03T10:07:06.742 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 99 k 2023-10-03T10:07:06.742 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-03T10:07:06.743 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-03T10:07:06.743 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-03T10:07:06.743 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-03T10:07:06.743 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-03T10:07:06.743 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-03T10:07:06.743 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-03T10:07:06.743 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-03T10:07:06.743 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-03T10:07:06.743 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-03T10:07:06.743 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-03T10:07:06.743 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-03T10:07:06.743 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-03T10:07:06.744 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-03T10:07:06.744 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-03T10:07:06.744 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-03T10:07:06.744 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-03T10:07:06.744 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-03T10:07:06.744 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-03T10:07:06.744 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-03T10:07:06.744 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-03T10:07:06.744 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-03T10:07:06.744 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-03T10:07:06.744 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-03T10:07:06.744 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-03T10:07:06.745 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-03T10:07:06.745 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-03T10:07:06.745 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-03T10:07:06.745 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-03T10:07:06.745 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-03T10:07:06.745 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-03T10:07:06.745 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-03T10:07:06.745 INFO:teuthology.orchestra.run.smithi146.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-03T10:07:06.745 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-03T10:07:06.745 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-03T10:07:06.745 INFO:teuthology.orchestra.run.smithi146.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-03T10:07:06.746 INFO:teuthology.orchestra.run.smithi146.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-03T10:07:06.746 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-03T10:07:06.746 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-03T10:07:06.746 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-03T10:07:06.746 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-03T10:07:06.746 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-03T10:07:06.746 INFO:teuthology.orchestra.run.smithi146.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-03T10:07:06.746 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-03T10:07:06.746 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-10-03T10:07:06.746 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:07:06.746 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2023-10-03T10:07:06.746 INFO:teuthology.orchestra.run.smithi146.stdout:==================================================================================================== 2023-10-03T10:07:06.747 INFO:teuthology.orchestra.run.smithi146.stdout:Install 108 Packages 2023-10-03T10:07:06.747 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrade 14 Packages 2023-10-03T10:07:06.747 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:07:06.747 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 200 M 2023-10-03T10:07:06.747 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2023-10-03T10:07:07.003 INFO:teuthology.orchestra.run.smithi153.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-03T10:07:07.004 INFO:teuthology.orchestra.run.smithi153.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-03T10:07:07.028 INFO:teuthology.orchestra.run.smithi153.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-10-03T10:07:07.028 INFO:teuthology.orchestra.run.smithi153.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-10-03T10:07:07.029 INFO:teuthology.orchestra.run.smithi153.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-10-03T10:07:07.030 INFO:teuthology.orchestra.run.smithi153.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-10-03T10:07:07.236 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2023-10-03T10:07:07.248 INFO:teuthology.orchestra.run.smithi153.stdout:==================================================================================================== 2023-10-03T10:07:07.248 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2023-10-03T10:07:07.248 INFO:teuthology.orchestra.run.smithi153.stdout:==================================================================================================== 2023-10-03T10:07:07.248 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2023-10-03T10:07:07.248 INFO:teuthology.orchestra.run.smithi153.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-10-03T10:07:07.248 INFO:teuthology.orchestra.run.smithi153.stdout: ceph x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.4 k 2023-10-03T10:07:07.248 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.1 M 2023-10-03T10:07:07.248 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 910 k 2023-10-03T10:07:07.248 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 1.6 M 2023-10-03T10:07:07.248 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 3.1 M 2023-10-03T10:07:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 8.6 M 2023-10-03T10:07:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 27 k 2023-10-03T10:07:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 12 M 2023-10-03T10:07:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 52 M 2023-10-03T10:07:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-10-03T10:07:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-10-03T10:07:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 25 k 2023-10-03T10:07:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 824 k 2023-10-03T10:07:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 131 k 2023-10-03T10:07:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-10-03T10:07:07.249 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 215 k 2023-10-03T10:07:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 390 k 2023-10-03T10:07:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 369 k 2023-10-03T10:07:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 114 k 2023-10-03T10:07:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 88 k 2023-10-03T10:07:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-03T10:07:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 173 k 2023-10-03T10:07:07.250 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2023-10-03T10:07:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-10-03T10:07:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-10-03T10:07:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-10-03T10:07:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-10-03T10:07:07.250 INFO:teuthology.orchestra.run.smithi153.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2023-10-03T10:07:07.251 INFO:teuthology.orchestra.run.smithi153.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-10-03T10:07:07.251 INFO:teuthology.orchestra.run.smithi153.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-10-03T10:07:07.251 INFO:teuthology.orchestra.run.smithi153.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-10-03T10:07:07.251 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-03T10:07:07.251 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 4.2 M 2023-10-03T10:07:07.251 INFO:teuthology.orchestra.run.smithi153.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-10-03T10:07:07.251 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-10-03T10:07:07.251 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-10-03T10:07:07.251 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-10-03T10:07:07.251 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2023-10-03T10:07:07.251 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 24 M 2023-10-03T10:07:07.251 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 24 k 2023-10-03T10:07:07.252 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 2.4 M 2023-10-03T10:07:07.252 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 244 k 2023-10-03T10:07:07.252 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 5.0 M 2023-10-03T10:07:07.252 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 18 M 2023-10-03T10:07:07.252 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 15 k 2023-10-03T10:07:07.252 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 26 k 2023-10-03T10:07:07.252 INFO:teuthology.orchestra.run.smithi153.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-03T10:07:07.252 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-03T10:07:07.252 INFO:teuthology.orchestra.run.smithi153.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-03T10:07:07.252 INFO:teuthology.orchestra.run.smithi153.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-10-03T10:07:07.252 INFO:teuthology.orchestra.run.smithi153.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-10-03T10:07:07.252 INFO:teuthology.orchestra.run.smithi153.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-10-03T10:07:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 174 k 2023-10-03T10:07:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-10-03T10:07:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-10-03T10:07:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-03T10:07:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-10-03T10:07:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-03T10:07:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 493 k 2023-10-03T10:07:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-03T10:07:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.8 M 2023-10-03T10:07:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-10-03T10:07:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-10-03T10:07:07.253 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-03T10:07:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-10-03T10:07:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-10-03T10:07:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-03T10:07:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-03T10:07:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-03T10:07:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-03T10:07:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-10-03T10:07:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-10-03T10:07:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-10-03T10:07:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-03T10:07:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-03T10:07:07.254 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-03T10:07:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 45 k 2023-10-03T10:07:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 99 k 2023-10-03T10:07:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-03T10:07:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-03T10:07:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-03T10:07:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-03T10:07:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-03T10:07:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-03T10:07:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-03T10:07:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-03T10:07:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-03T10:07:07.255 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-03T10:07:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-03T10:07:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-03T10:07:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-03T10:07:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-03T10:07:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-03T10:07:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-03T10:07:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-03T10:07:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-03T10:07:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-03T10:07:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-03T10:07:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-03T10:07:07.256 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-03T10:07:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-03T10:07:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-03T10:07:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-03T10:07:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-03T10:07:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-03T10:07:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-03T10:07:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-03T10:07:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-03T10:07:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-03T10:07:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-03T10:07:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-03T10:07:07.257 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-03T10:07:07.258 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-03T10:07:07.258 INFO:teuthology.orchestra.run.smithi153.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-03T10:07:07.258 INFO:teuthology.orchestra.run.smithi153.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-03T10:07:07.258 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-03T10:07:07.258 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-03T10:07:07.258 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-03T10:07:07.258 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-03T10:07:07.258 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-03T10:07:07.258 INFO:teuthology.orchestra.run.smithi153.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-03T10:07:07.258 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-03T10:07:07.258 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-10-03T10:07:07.259 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:07:07.259 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2023-10-03T10:07:07.259 INFO:teuthology.orchestra.run.smithi153.stdout:==================================================================================================== 2023-10-03T10:07:07.259 INFO:teuthology.orchestra.run.smithi153.stdout:Install 108 Packages 2023-10-03T10:07:07.259 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 14 Packages 2023-10-03T10:07:07.259 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:07:07.260 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 200 M 2023-10-03T10:07:07.260 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2023-10-03T10:07:07.381 INFO:teuthology.orchestra.run.smithi146.stdout:(1/122): ceph-16.2.14-44.geeb13ac9.el8.x86_64.r 33 kB/s | 6.4 kB 00:00 2023-10-03T10:07:08.151 INFO:teuthology.orchestra.run.smithi153.stdout:(1/122): ceph-16.2.14-44.geeb13ac9.el8.x86_64.r 20 kB/s | 6.4 kB 00:00 2023-10-03T10:07:08.172 INFO:teuthology.orchestra.run.smithi146.stdout:(2/122): ceph-fuse-16.2.14-44.geeb13ac9.el8.x86 1.1 MB/s | 910 kB 00:00 2023-10-03T10:07:09.331 INFO:teuthology.orchestra.run.smithi146.stdout:(3/122): ceph-mds-16.2.14-44.geeb13ac9.el8.x86_ 2.1 MB/s | 2.4 MB 00:01 2023-10-03T10:07:09.906 INFO:teuthology.orchestra.run.smithi146.stdout:(4/122): ceph-mgr-16.2.14-44.geeb13ac9.el8.x86_ 2.8 MB/s | 1.6 MB 00:00 2023-10-03T10:07:10.943 INFO:teuthology.orchestra.run.smithi153.stdout:(2/122): ceph-base-16.2.14-44.geeb13ac9.el8.x86 1.9 MB/s | 6.1 MB 00:03 2023-10-03T10:07:10.976 INFO:teuthology.orchestra.run.smithi153.stdout:(3/122): ceph-fuse-16.2.14-44.geeb13ac9.el8.x86 322 kB/s | 910 kB 00:02 2023-10-03T10:07:11.206 INFO:teuthology.orchestra.run.smithi146.stdout:(5/122): ceph-mon-16.2.14-44.geeb13ac9.el8.x86_ 3.9 MB/s | 5.0 MB 00:01 2023-10-03T10:07:11.417 INFO:teuthology.orchestra.run.smithi146.stdout:(6/122): ceph-base-16.2.14-44.geeb13ac9.el8.x86 1.4 MB/s | 6.1 MB 00:04 2023-10-03T10:07:11.718 INFO:teuthology.orchestra.run.smithi153.stdout:(4/122): ceph-mgr-16.2.14-44.geeb13ac9.el8.x86_ 2.2 MB/s | 1.6 MB 00:00 2023-10-03T10:07:15.110 INFO:teuthology.orchestra.run.smithi153.stdout:(5/122): ceph-mon-16.2.14-44.geeb13ac9.el8.x86_ 1.5 MB/s | 5.0 MB 00:03 2023-10-03T10:07:15.876 INFO:teuthology.orchestra.run.smithi153.stdout:(6/122): ceph-mds-16.2.14-44.geeb13ac9.el8.x86_ 507 kB/s | 2.4 MB 00:04 2023-10-03T10:07:17.784 INFO:teuthology.orchestra.run.smithi146.stdout:(7/122): ceph-osd-16.2.14-44.geeb13ac9.el8.x86_ 2.8 MB/s | 18 MB 00:06 2023-10-03T10:07:17.909 INFO:teuthology.orchestra.run.smithi146.stdout:(8/122): ceph-selinux-16.2.14-44.geeb13ac9.el8. 206 kB/s | 26 kB 00:00 2023-10-03T10:07:19.467 INFO:teuthology.orchestra.run.smithi146.stdout:(9/122): ceph-common-16.2.14-44.geeb13ac9.el8.x 2.0 MB/s | 24 MB 00:12 2023-10-03T10:07:19.559 INFO:teuthology.orchestra.run.smithi146.stdout:(10/122): libcephfs-devel-16.2.14-44.geeb13ac9. 280 kB/s | 25 kB 00:00 2023-10-03T10:07:20.034 INFO:teuthology.orchestra.run.smithi146.stdout:(11/122): libcephfs2-16.2.14-44.geeb13ac9.el8.x 1.7 MB/s | 824 kB 00:00 2023-10-03T10:07:20.210 INFO:teuthology.orchestra.run.smithi146.stdout:(12/122): libcephsqlite-16.2.14-44.geeb13ac9.el 994 kB/s | 174 kB 00:00 2023-10-03T10:07:20.301 INFO:teuthology.orchestra.run.smithi146.stdout:(13/122): librados-devel-16.2.14-44.geeb13ac9.e 1.4 MB/s | 131 kB 00:00 2023-10-03T10:07:20.627 INFO:teuthology.orchestra.run.smithi146.stdout:(14/122): libradosstriper1-16.2.14-44.geeb13ac9 1.5 MB/s | 493 kB 00:00 2023-10-03T10:07:22.736 INFO:teuthology.orchestra.run.smithi146.stdout:(15/122): librgw2-16.2.14-44.geeb13ac9.el8.x86_ 1.8 MB/s | 3.8 MB 00:02 2023-10-03T10:07:22.819 INFO:teuthology.orchestra.run.smithi146.stdout:(16/122): python3-ceph-argparse-16.2.14-44.geeb 542 kB/s | 45 kB 00:00 2023-10-03T10:07:22.910 INFO:teuthology.orchestra.run.smithi146.stdout:(17/122): python3-ceph-common-16.2.14-44.geeb13 1.1 MB/s | 99 kB 00:00 2023-10-03T10:07:23.086 INFO:teuthology.orchestra.run.smithi146.stdout:(18/122): python3-cephfs-16.2.14-44.geeb13ac9.e 1.2 MB/s | 215 kB 00:00 2023-10-03T10:07:23.236 INFO:teuthology.orchestra.run.smithi146.stdout:(19/122): python3-rados-16.2.14-44.geeb13ac9.el 2.5 MB/s | 390 kB 00:00 2023-10-03T10:07:23.395 INFO:teuthology.orchestra.run.smithi146.stdout:(20/122): python3-rbd-16.2.14-44.geeb13ac9.el8. 2.3 MB/s | 369 kB 00:00 2023-10-03T10:07:23.462 INFO:teuthology.orchestra.run.smithi146.stdout:(21/122): python3-rgw-16.2.14-44.geeb13ac9.el8. 1.7 MB/s | 114 kB 00:00 2023-10-03T10:07:23.537 INFO:teuthology.orchestra.run.smithi146.stdout:(22/122): rbd-fuse-16.2.14-44.geeb13ac9.el8.x86 1.2 MB/s | 88 kB 00:00 2023-10-03T10:07:23.726 INFO:teuthology.orchestra.run.smithi153.stdout:(7/122): ceph-osd-16.2.14-44.geeb13ac9.el8.x86_ 2.1 MB/s | 18 MB 00:08 2023-10-03T10:07:23.793 INFO:teuthology.orchestra.run.smithi153.stdout:(8/122): ceph-selinux-16.2.14-44.geeb13ac9.el8. 386 kB/s | 26 kB 00:00 2023-10-03T10:07:25.771 INFO:teuthology.orchestra.run.smithi146.stdout:(23/122): rbd-mirror-16.2.14-44.geeb13ac9.el8.x 1.6 MB/s | 3.7 MB 00:02 2023-10-03T10:07:26.050 INFO:teuthology.orchestra.run.smithi146.stdout:(24/122): rbd-nbd-16.2.14-44.geeb13ac9.el8.x86_ 620 kB/s | 173 kB 00:00 2023-10-03T10:07:26.146 INFO:teuthology.orchestra.run.smithi146.stdout:(25/122): ceph-grafana-dashboards-16.2.14-44.ge 256 kB/s | 24 kB 00:00 2023-10-03T10:07:29.288 INFO:teuthology.orchestra.run.smithi146.stdout:(26/122): ceph-mgr-dashboard-16.2.14-44.geeb13a 1.0 MB/s | 3.1 MB 00:03 2023-10-03T10:07:29.413 INFO:teuthology.orchestra.run.smithi146.stdout:(27/122): ceph-radosgw-16.2.14-44.geeb13ac9.el8 657 kB/s | 12 MB 00:17 2023-10-03T10:07:29.896 INFO:teuthology.orchestra.run.smithi146.stdout:(28/122): ceph-mgr-modules-core-16.2.14-44.geeb 506 kB/s | 244 kB 00:00 2023-10-03T10:07:30.022 INFO:teuthology.orchestra.run.smithi146.stdout:(29/122): ceph-mgr-rook-16.2.14-44.geeb13ac9.el 219 kB/s | 27 kB 00:00 2023-10-03T10:07:30.155 INFO:teuthology.orchestra.run.smithi146.stdout:(30/122): ceph-prometheus-alerts-16.2.14-44.gee 111 kB/s | 15 kB 00:00 2023-10-03T10:07:30.980 INFO:teuthology.orchestra.run.smithi146.stdout:(31/122): bison-3.0.4-10.el8.x86_64.rpm 835 kB/s | 688 kB 00:00 2023-10-03T10:07:31.172 INFO:teuthology.orchestra.run.smithi146.stdout:(32/122): flex-2.6.1-9.el8.x86_64.rpm 1.6 MB/s | 320 kB 00:00 2023-10-03T10:07:31.315 INFO:teuthology.orchestra.run.smithi146.stdout:(33/122): jq-1.6-7.el8.x86_64.rpm 1.4 MB/s | 202 kB 00:00 2023-10-03T10:07:31.482 INFO:teuthology.orchestra.run.smithi146.stdout:(34/122): librdkafka-0.11.4-3.el8.x86_64.rpm 2.1 MB/s | 354 kB 00:00 2023-10-03T10:07:31.624 INFO:teuthology.orchestra.run.smithi146.stdout:(35/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.8 MB/s | 259 kB 00:00 2023-10-03T10:07:31.774 INFO:teuthology.orchestra.run.smithi146.stdout:(36/122): oniguruma-6.8.2-2.el8.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2023-10-03T10:07:32.250 INFO:teuthology.orchestra.run.smithi146.stdout:(37/122): openblas-0.3.15-4.el8.x86_64.rpm 9.9 MB/s | 4.7 MB 00:00 2023-10-03T10:07:32.600 INFO:teuthology.orchestra.run.smithi146.stdout:(38/122): openblas-threads-0.3.15-4.el8.x86_64. 14 MB/s | 4.9 MB 00:00 2023-10-03T10:07:32.716 INFO:teuthology.orchestra.run.smithi146.stdout:(39/122): python3-jsonpatch-1.21-2.el8.noarch.r 228 kB/s | 27 kB 00:00 2023-10-03T10:07:32.833 INFO:teuthology.orchestra.run.smithi146.stdout:(40/122): python3-jsonpointer-1.10-11.el8.noarc 171 kB/s | 20 kB 00:00 2023-10-03T10:07:32.959 INFO:teuthology.orchestra.run.smithi146.stdout:(41/122): python3-mako-1.0.6-14.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-10-03T10:07:33.084 INFO:teuthology.orchestra.run.smithi146.stdout:(42/122): python3-markupsafe-0.23-19.el8.x86_64 311 kB/s | 39 kB 00:00 2023-10-03T10:07:33.443 INFO:teuthology.orchestra.run.smithi146.stdout:(43/122): python3-numpy-1.14.3-10.el8.x86_64.rp 10 MB/s | 3.7 MB 00:00 2023-10-03T10:07:33.568 INFO:teuthology.orchestra.run.smithi146.stdout:(44/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.8 MB/s | 225 kB 00:00 2023-10-03T10:07:33.694 INFO:teuthology.orchestra.run.smithi146.stdout:(45/122): python3-prettytable-0.7.2-14.el8.noar 351 kB/s | 44 kB 00:00 2023-10-03T10:07:33.819 INFO:teuthology.orchestra.run.smithi146.stdout:(46/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 829 kB/s | 103 kB 00:00 2023-10-03T10:07:33.936 INFO:teuthology.orchestra.run.smithi146.stdout:(47/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-10-03T10:07:34.061 INFO:teuthology.orchestra.run.smithi146.stdout:(48/122): python3-pyasn1-modules-0.3.7-6.el8.no 881 kB/s | 110 kB 00:00 2023-10-03T10:07:34.186 INFO:teuthology.orchestra.run.smithi146.stdout:(49/122): python3-pytz-2017.2-11.el8.noarch.rpm 457 kB/s | 57 kB 00:00 2023-10-03T10:07:34.259 INFO:teuthology.orchestra.run.smithi153.stdout:(9/122): ceph-radosgw-16.2.14-44.geeb13ac9.el8. 643 kB/s | 12 MB 00:18 2023-10-03T10:07:34.384 INFO:teuthology.orchestra.run.smithi153.stdout:(10/122): libcephfs-devel-16.2.14-44.geeb13ac9. 205 kB/s | 25 kB 00:00 2023-10-03T10:07:34.954 INFO:teuthology.orchestra.run.smithi146.stdout:(50/122): python3-scipy-1.0.0-21.module_el8.5.0 18 MB/s | 14 MB 00:00 2023-10-03T10:07:35.220 INFO:teuthology.orchestra.run.smithi146.stdout:(51/122): python3-werkzeug-0.12.2-4.el8.noarch. 1.7 MB/s | 457 kB 00:00 2023-10-03T10:07:35.337 INFO:teuthology.orchestra.run.smithi146.stdout:(52/122): ceph-mgr-diskprediction-local-16.2.14 1.4 MB/s | 8.6 MB 00:06 2023-10-03T10:07:35.363 INFO:teuthology.orchestra.run.smithi146.stdout:(53/122): socat-1.7.4.1-1.el8.x86_64.rpm 2.2 MB/s | 323 kB 00:00 2023-10-03T10:07:35.751 INFO:teuthology.orchestra.run.smithi153.stdout:(11/122): libcephfs2-16.2.14-44.geeb13ac9.el8.x 603 kB/s | 824 kB 00:01 2023-10-03T10:07:35.763 INFO:teuthology.orchestra.run.smithi146.stdout:(54/122): elfutils-libelf-devel-0.189-3.el8.x86 154 kB/s | 62 kB 00:00 2023-10-03T10:07:35.805 INFO:teuthology.orchestra.run.smithi146.stdout:(55/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 151 kB/s | 71 kB 00:00 2023-10-03T10:07:35.964 INFO:teuthology.orchestra.run.smithi146.stdout:(56/122): fuse-2.9.7-17.el8.x86_64.rpm 414 kB/s | 83 kB 00:00 2023-10-03T10:07:36.142 INFO:teuthology.orchestra.run.smithi153.stdout:(12/122): libcephsqlite-16.2.14-44.geeb13ac9.el 444 kB/s | 174 kB 00:00 2023-10-03T10:07:36.164 INFO:teuthology.orchestra.run.smithi146.stdout:(57/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 134 kB/s | 48 kB 00:00 2023-10-03T10:07:36.289 INFO:teuthology.orchestra.run.smithi146.stdout:(58/122): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.7 MB/s | 561 kB 00:00 2023-10-03T10:07:36.315 INFO:teuthology.orchestra.run.smithi146.stdout:(59/122): libcom_err-devel-1.45.6-5.el8.x86_64. 258 kB/s | 39 kB 00:00 2023-10-03T10:07:36.434 INFO:teuthology.orchestra.run.smithi153.stdout:(13/122): librados-devel-16.2.14-44.geeb13ac9.e 450 kB/s | 131 kB 00:00 2023-10-03T10:07:36.448 INFO:teuthology.orchestra.run.smithi146.stdout:(60/122): libgfortran-8.5.0-20.el8.x86_64.rpm 4.0 MB/s | 645 kB 00:00 2023-10-03T10:07:36.549 INFO:teuthology.orchestra.run.smithi146.stdout:(61/122): librabbitmq-0.9.0-4.el8.x86_64.rpm 470 kB/s | 47 kB 00:00 2023-10-03T10:07:36.573 INFO:teuthology.orchestra.run.smithi146.stdout:(62/122): libquadmath-8.5.0-20.el8.x86_64.rpm 666 kB/s | 172 kB 00:00 2023-10-03T10:07:36.696 INFO:teuthology.orchestra.run.smithi146.stdout:(63/122): libselinux-devel-2.9-8.el8.x86_64.rpm 1.3 MB/s | 200 kB 00:00 2023-10-03T10:07:36.724 INFO:teuthology.orchestra.run.smithi146.stdout:(64/122): libsepol-devel-2.9-3.el8.x86_64.rpm 579 kB/s | 87 kB 00:00 2023-10-03T10:07:36.799 INFO:teuthology.orchestra.run.smithi146.stdout:(65/122): libverto-devel-0.3.2-2.el8.x86_64.rpm 174 kB/s | 18 kB 00:00 2023-10-03T10:07:36.842 INFO:teuthology.orchestra.run.smithi146.stdout:(66/122): libzstd-devel-1.4.4-1.el8.x86_64.rpm 374 kB/s | 44 kB 00:00 2023-10-03T10:07:37.132 INFO:teuthology.orchestra.run.smithi146.stdout:(67/122): openssl-devel-1.1.1k-9.el8.x86_64.rpm 9.6 MB/s | 3.2 MB 00:00 2023-10-03T10:07:37.143 INFO:teuthology.orchestra.run.smithi153.stdout:(14/122): libradosstriper1-16.2.14-44.geeb13ac9 697 kB/s | 493 kB 00:00 2023-10-03T10:07:37.167 INFO:teuthology.orchestra.run.smithi146.stdout:(68/122): pcre2-devel-10.32-3.el8.x86_64.rpm 1.8 MB/s | 605 kB 00:00 2023-10-03T10:07:37.234 INFO:teuthology.orchestra.run.smithi146.stdout:(69/122): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.2 MB/s | 229 kB 00:00 2023-10-03T10:07:37.284 INFO:teuthology.orchestra.run.smithi146.stdout:(70/122): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-10-03T10:07:37.335 INFO:teuthology.orchestra.run.smithi146.stdout:(71/122): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.4 MB/s | 249 kB 00:00 2023-10-03T10:07:37.443 INFO:teuthology.orchestra.run.smithi146.stdout:(72/122): python3-jwt-1.6.1-2.el8.noarch.rpm 394 kB/s | 43 kB 00:00 2023-10-03T10:07:37.468 INFO:teuthology.orchestra.run.smithi146.stdout:(73/122): python3-cryptography-3.2.1-6.el8.x86_ 3.4 MB/s | 641 kB 00:00 2023-10-03T10:07:37.577 INFO:teuthology.orchestra.run.smithi146.stdout:(74/122): python3-oauthlib-2.1.0-1.el8.noarch.r 1.1 MB/s | 155 kB 00:00 2023-10-03T10:07:37.602 INFO:teuthology.orchestra.run.smithi146.stdout:(75/122): python3-pycparser-2.14-14.el8.noarch. 817 kB/s | 109 kB 00:00 2023-10-03T10:07:37.686 INFO:teuthology.orchestra.run.smithi146.stdout:(76/122): python3-requests-oauthlib-1.0.0-1.el8 393 kB/s | 43 kB 00:00 2023-10-03T10:07:37.711 INFO:teuthology.orchestra.run.smithi146.stdout:(77/122): zlib-devel-1.2.11-21.el8.x86_64.rpm 534 kB/s | 58 kB 00:00 2023-10-03T10:07:38.253 INFO:teuthology.orchestra.run.smithi146.stdout:(78/122): leveldb-1.22-1.el8.x86_64.rpm 334 kB/s | 181 kB 00:00 2023-10-03T10:07:38.312 INFO:teuthology.orchestra.run.smithi146.stdout:(79/122): gperftools-libs-2.7-9.el8.x86_64.rpm 489 kB/s | 306 kB 00:00 2023-10-03T10:07:38.370 INFO:teuthology.orchestra.run.smithi146.stdout:(80/122): liboath-2.6.2-3.el8.x86_64.rpm 504 kB/s | 59 kB 00:00 2023-10-03T10:07:38.437 INFO:teuthology.orchestra.run.smithi146.stdout:(81/122): libunwind-1.3.1-3.el8.x86_64.rpm 600 kB/s | 75 kB 00:00 2023-10-03T10:07:38.479 INFO:teuthology.orchestra.run.smithi146.stdout:(82/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 402 kB/s | 44 kB 00:00 2023-10-03T10:07:38.571 INFO:teuthology.orchestra.run.smithi146.stdout:(83/122): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2023-10-03T10:07:38.597 INFO:teuthology.orchestra.run.smithi146.stdout:(84/122): python3-cachetools-3.1.1-4.el8.noarch 282 kB/s | 33 kB 00:00 2023-10-03T10:07:38.680 INFO:teuthology.orchestra.run.smithi146.stdout:(85/122): python3-certifi-2018.10.15-7.el8.noar 150 kB/s | 16 kB 00:00 2023-10-03T10:07:38.756 INFO:teuthology.orchestra.run.smithi146.stdout:(86/122): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2023-10-03T10:07:38.881 INFO:teuthology.orchestra.run.smithi146.stdout:(87/122): python3-cherrypy-18.4.0-1.el8.noarch. 1.9 MB/s | 384 kB 00:00 2023-10-03T10:07:38.906 INFO:teuthology.orchestra.run.smithi146.stdout:(88/122): python3-google-auth-1.1.1-10.el8.noar 541 kB/s | 81 kB 00:00 2023-10-03T10:07:38.982 INFO:teuthology.orchestra.run.smithi146.stdout:(89/122): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2023-10-03T10:07:39.015 INFO:teuthology.orchestra.run.smithi146.stdout:(90/122): python3-jaraco-functools-2.0-4.el8.no 162 kB/s | 18 kB 00:00 2023-10-03T10:07:39.132 INFO:teuthology.orchestra.run.smithi146.stdout:(91/122): python3-logutils-0.3.5-11.el8.noarch. 418 kB/s | 49 kB 00:00 2023-10-03T10:07:39.224 INFO:teuthology.orchestra.run.smithi146.stdout:(92/122): python3-kubernetes-11.0.0-6.el8.noarc 4.8 MB/s | 1.2 MB 00:00 2023-10-03T10:07:39.274 INFO:teuthology.orchestra.run.smithi146.stdout:(93/122): python3-more-itertools-7.2.0-3.el8.no 414 kB/s | 59 kB 00:00 2023-10-03T10:07:39.341 INFO:teuthology.orchestra.run.smithi146.stdout:(94/122): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-10-03T10:07:39.383 INFO:teuthology.orchestra.run.smithi146.stdout:(95/122): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2023-10-03T10:07:39.441 INFO:teuthology.orchestra.run.smithi146.stdout:(96/122): python3-repoze-lru-0.7-6.el8.noarch.r 336 kB/s | 34 kB 00:00 2023-10-03T10:07:39.550 INFO:teuthology.orchestra.run.smithi146.stdout:(97/122): python3-rsa-4.9-2.el8.noarch.rpm 593 kB/s | 64 kB 00:00 2023-10-03T10:07:39.575 INFO:teuthology.orchestra.run.smithi146.stdout:(98/122): python3-routes-2.4.1-12.el8.noarch.rp 1.0 MB/s | 196 kB 00:00 2023-10-03T10:07:39.651 INFO:teuthology.orchestra.run.smithi146.stdout:(99/122): python3-simplegeneric-0.8.1-17.el8.no 187 kB/s | 19 kB 00:00 2023-10-03T10:07:39.701 INFO:teuthology.orchestra.run.smithi146.stdout:(100/122): python3-singledispatch-3.4.0.3-18.el 191 kB/s | 24 kB 00:00 2023-10-03T10:07:39.752 INFO:teuthology.orchestra.run.smithi146.stdout:(101/122): python3-tempora-1.14.1-5.el8.noarch. 291 kB/s | 29 kB 00:00 2023-10-03T10:07:39.784 INFO:teuthology.orchestra.run.smithi153.stdout:(15/122): ceph-common-16.2.14-44.geeb13ac9.el8. 774 kB/s | 24 MB 00:31 2023-10-03T10:07:39.810 INFO:teuthology.orchestra.run.smithi146.stdout:(102/122): python3-trustme-0.6.0-4.el8.noarch.r 253 kB/s | 27 kB 00:00 2023-10-03T10:07:39.868 INFO:teuthology.orchestra.run.smithi153.stdout:(16/122): python3-ceph-argparse-16.2.14-44.geeb 542 kB/s | 45 kB 00:00 2023-10-03T10:07:39.877 INFO:teuthology.orchestra.run.smithi146.stdout:(103/122): python3-waitress-1.4.3-1.el8.noarch. 2.0 MB/s | 255 kB 00:00 2023-10-03T10:07:39.952 INFO:teuthology.orchestra.run.smithi146.stdout:(104/122): python3-webob-1.8.5-1.el8.1.noarch.r 1.7 MB/s | 251 kB 00:00 2023-10-03T10:07:39.977 INFO:teuthology.orchestra.run.smithi146.stdout:(105/122): python3-websocket-client-0.56.0-5.el 610 kB/s | 61 kB 00:00 2023-10-03T10:07:40.069 INFO:teuthology.orchestra.run.smithi146.stdout:(106/122): python3-webtest-2.0.33-1.el8.noarch. 730 kB/s | 85 kB 00:00 2023-10-03T10:07:40.117 INFO:teuthology.orchestra.run.smithi146.stdout:(107/122): python3-zc-lockfile-2.0-2.el8.noarch 164 kB/s | 23 kB 00:00 2023-10-03T10:07:40.410 INFO:teuthology.orchestra.run.smithi153.stdout:(17/122): ceph-test-16.2.14-44.geeb13ac9.el8.x8 3.1 MB/s | 52 MB 00:16 2023-10-03T10:07:40.435 INFO:teuthology.orchestra.run.smithi153.stdout:(18/122): python3-ceph-common-16.2.14-44.geeb13 174 kB/s | 99 kB 00:00 2023-10-03T10:07:40.494 INFO:teuthology.orchestra.run.smithi153.stdout:(19/122): librgw2-16.2.14-44.geeb13ac9.el8.x86_ 1.1 MB/s | 3.8 MB 00:03 2023-10-03T10:07:40.519 INFO:teuthology.orchestra.run.smithi153.stdout:(20/122): python3-cephfs-16.2.14-44.geeb13ac9.e 1.9 MB/s | 215 kB 00:00 2023-10-03T10:07:40.578 INFO:teuthology.orchestra.run.smithi153.stdout:(21/122): python3-rgw-16.2.14-44.geeb13ac9.el8. 1.9 MB/s | 114 kB 00:00 2023-10-03T10:07:40.628 INFO:teuthology.orchestra.run.smithi153.stdout:(22/122): rbd-fuse-16.2.14-44.geeb13ac9.el8.x86 1.7 MB/s | 88 kB 00:00 2023-10-03T10:07:40.687 INFO:teuthology.orchestra.run.smithi153.stdout:(23/122): python3-rbd-16.2.14-44.geeb13ac9.el8. 1.9 MB/s | 369 kB 00:00 2023-10-03T10:07:40.712 INFO:teuthology.orchestra.run.smithi153.stdout:(24/122): python3-rados-16.2.14-44.geeb13ac9.el 1.4 MB/s | 390 kB 00:00 2023-10-03T10:07:40.804 INFO:teuthology.orchestra.run.smithi153.stdout:(25/122): ceph-grafana-dashboards-16.2.14-44.ge 266 kB/s | 24 kB 00:00 2023-10-03T10:07:40.846 INFO:teuthology.orchestra.run.smithi153.stdout:(26/122): rbd-nbd-16.2.14-44.geeb13ac9.el8.x86_ 1.1 MB/s | 173 kB 00:00 2023-10-03T10:07:41.020 INFO:teuthology.orchestra.run.smithi146.stdout:(108/122): ceph-test-16.2.14-44.geeb13ac9.el8.x 2.2 MB/s | 52 MB 00:23 2023-10-03T10:07:41.046 INFO:teuthology.orchestra.run.smithi153.stdout:(27/122): rbd-mirror-16.2.14-44.geeb13ac9.el8.x 8.8 MB/s | 3.7 MB 00:00 2023-10-03T10:07:41.105 INFO:teuthology.orchestra.run.smithi153.stdout:(28/122): ceph-mgr-modules-core-16.2.14-44.geeb 4.1 MB/s | 244 kB 00:00 2023-10-03T10:07:41.137 INFO:teuthology.orchestra.run.smithi146.stdout:(109/122): NetworkManager-initscripts-updown-1. 1.2 MB/s | 143 kB 00:00 2023-10-03T10:07:41.155 INFO:teuthology.orchestra.run.smithi153.stdout:(29/122): ceph-mgr-rook-16.2.14-44.geeb13ac9.el 548 kB/s | 27 kB 00:00 2023-10-03T10:07:41.206 INFO:teuthology.orchestra.run.smithi153.stdout:(30/122): ceph-prometheus-alerts-16.2.14-44.gee 297 kB/s | 15 kB 00:00 2023-10-03T10:07:41.237 INFO:teuthology.orchestra.run.smithi146.stdout:(110/122): elfutils-debuginfod-client-0.189-3.e 763 kB/s | 76 kB 00:00 2023-10-03T10:07:41.346 INFO:teuthology.orchestra.run.smithi146.stdout:(111/122): elfutils-libelf-0.189-3.el8.x86_64.r 2.1 MB/s | 232 kB 00:00 2023-10-03T10:07:41.454 INFO:teuthology.orchestra.run.smithi146.stdout:(112/122): elfutils-libs-0.189-3.el8.x86_64.rpm 2.7 MB/s | 303 kB 00:00 2023-10-03T10:07:41.513 INFO:teuthology.orchestra.run.smithi146.stdout:(113/122): librbd1-16.2.14-44.geeb13ac9.el8.x86 3.0 MB/s | 4.2 MB 00:01 2023-10-03T10:07:41.580 INFO:teuthology.orchestra.run.smithi146.stdout:(114/122): iproute-6.2.0-5.el8.x86_64.rpm 6.7 MB/s | 854 kB 00:00 2023-10-03T10:07:41.631 INFO:teuthology.orchestra.run.smithi146.stdout:(115/122): libblkid-2.32.1-43.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-10-03T10:07:41.689 INFO:teuthology.orchestra.run.smithi146.stdout:(116/122): libfdisk-2.32.1-43.el8.x86_64.rpm 2.3 MB/s | 254 kB 00:00 2023-10-03T10:07:41.739 INFO:teuthology.orchestra.run.smithi146.stdout:(117/122): libmount-2.32.1-43.el8.x86_64.rpm 2.1 MB/s | 236 kB 00:00 2023-10-03T10:07:41.856 INFO:teuthology.orchestra.run.smithi146.stdout:(118/122): libsmartcols-2.32.1-43.el8.x86_64.rp 1.1 MB/s | 179 kB 00:00 2023-10-03T10:07:41.873 INFO:teuthology.orchestra.run.smithi146.stdout:(119/122): libuuid-2.32.1-43.el8.x86_64.rpm 740 kB/s | 99 kB 00:00 2023-10-03T10:07:41.982 INFO:teuthology.orchestra.run.smithi146.stdout:(120/122): util-linux-user-2.32.1-43.el8.x86_64 948 kB/s | 103 kB 00:00 2023-10-03T10:07:42.031 INFO:teuthology.orchestra.run.smithi153.stdout:(31/122): bison-3.0.4-10.el8.x86_64.rpm 835 kB/s | 688 kB 00:00 2023-10-03T10:07:42.049 INFO:teuthology.orchestra.run.smithi146.stdout:(121/122): util-linux-2.32.1-43.el8.x86_64.rpm 13 MB/s | 2.5 MB 00:00 2023-10-03T10:07:42.081 INFO:teuthology.orchestra.run.smithi153.stdout:(32/122): ceph-mgr-dashboard-16.2.14-44.geeb13a 2.4 MB/s | 3.1 MB 00:01 2023-10-03T10:07:42.256 INFO:teuthology.orchestra.run.smithi153.stdout:(33/122): flex-2.6.1-9.el8.x86_64.rpm 1.4 MB/s | 320 kB 00:00 2023-10-03T10:07:42.423 INFO:teuthology.orchestra.run.smithi153.stdout:(34/122): librdkafka-0.11.4-3.el8.x86_64.rpm 2.1 MB/s | 354 kB 00:00 2023-10-03T10:07:42.573 INFO:teuthology.orchestra.run.smithi153.stdout:(35/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.7 MB/s | 259 kB 00:00 2023-10-03T10:07:42.632 INFO:teuthology.orchestra.run.smithi146.stdout:(122/122): librados2-16.2.14-44.geeb13ac9.el8.x 1.5 MB/s | 3.7 MB 00:02 2023-10-03T10:07:42.636 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2023-10-03T10:07:42.637 INFO:teuthology.orchestra.run.smithi146.stdout:Total 5.6 MB/s | 200 MB 00:35 2023-10-03T10:07:42.699 INFO:teuthology.orchestra.run.smithi153.stdout:(36/122): jq-1.6-7.el8.x86_64.rpm 328 kB/s | 202 kB 00:00 2023-10-03T10:07:42.724 INFO:teuthology.orchestra.run.smithi153.stdout:(37/122): oniguruma-6.8.2-2.el8.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2023-10-03T10:07:43.191 INFO:teuthology.orchestra.run.smithi153.stdout:(38/122): openblas-threads-0.3.15-4.el8.x86_64. 10 MB/s | 4.9 MB 00:00 2023-10-03T10:07:43.331 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2023-10-03T10:07:43.377 INFO:teuthology.orchestra.run.smithi153.stdout:(39/122): openblas-0.3.15-4.el8.x86_64.rpm 7.0 MB/s | 4.7 MB 00:00 2023-10-03T10:07:43.408 INFO:teuthology.orchestra.run.smithi153.stdout:(40/122): python3-jsonpatch-1.21-2.el8.noarch.r 122 kB/s | 27 kB 00:00 2023-10-03T10:07:43.492 INFO:teuthology.orchestra.run.smithi153.stdout:(41/122): python3-jsonpointer-1.10-11.el8.noarc 174 kB/s | 20 kB 00:00 2023-10-03T10:07:43.534 INFO:teuthology.orchestra.run.smithi153.stdout:(42/122): python3-mako-1.0.6-14.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-10-03T10:07:43.554 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2023-10-03T10:07:43.554 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2023-10-03T10:07:43.609 INFO:teuthology.orchestra.run.smithi153.stdout:(43/122): python3-markupsafe-0.23-19.el8.x86_64 331 kB/s | 39 kB 00:00 2023-10-03T10:07:43.734 INFO:teuthology.orchestra.run.smithi153.stdout:(44/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.8 MB/s | 225 kB 00:00 2023-10-03T10:07:43.851 INFO:teuthology.orchestra.run.smithi153.stdout:(45/122): python3-prettytable-0.7.2-14.el8.noar 377 kB/s | 44 kB 00:00 2023-10-03T10:07:43.935 INFO:teuthology.orchestra.run.smithi153.stdout:(46/122): python3-numpy-1.14.3-10.el8.x86_64.rp 9.3 MB/s | 3.7 MB 00:00 2023-10-03T10:07:43.977 INFO:teuthology.orchestra.run.smithi153.stdout:(47/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 827 kB/s | 103 kB 00:00 2023-10-03T10:07:44.111 INFO:teuthology.orchestra.run.smithi153.stdout:(48/122): ceph-mgr-diskprediction-local-16.2.14 2.6 MB/s | 8.6 MB 00:03 2023-10-03T10:07:44.136 INFO:teuthology.orchestra.run.smithi153.stdout:(49/122): python3-pyasn1-modules-0.3.7-6.el8.no 694 kB/s | 110 kB 00:00 2023-10-03T10:07:44.161 INFO:teuthology.orchestra.run.smithi153.stdout:(50/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 559 kB/s | 126 kB 00:00 2023-10-03T10:07:44.295 INFO:teuthology.orchestra.run.smithi153.stdout:(51/122): python3-werkzeug-0.12.2-4.el8.noarch. 3.4 MB/s | 457 kB 00:00 2023-10-03T10:07:44.429 INFO:teuthology.orchestra.run.smithi153.stdout:(52/122): socat-1.7.4.1-1.el8.x86_64.rpm 2.4 MB/s | 323 kB 00:00 2023-10-03T10:07:44.546 INFO:teuthology.orchestra.run.smithi153.stdout:(53/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 606 kB/s | 71 kB 00:00 2023-10-03T10:07:44.571 INFO:teuthology.orchestra.run.smithi153.stdout:(54/122): python3-pytz-2017.2-11.el8.noarch.rpm 124 kB/s | 57 kB 00:00 2023-10-03T10:07:44.855 INFO:teuthology.orchestra.run.smithi153.stdout:(55/122): python3-scipy-1.0.0-21.module_el8.5.0 19 MB/s | 14 MB 00:00 2023-10-03T10:07:44.903 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2023-10-03T10:07:44.906 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2023-10-03T10:07:44.963 INFO:teuthology.orchestra.run.smithi153.stdout:(56/122): elfutils-libelf-devel-0.189-3.el8.x86 148 kB/s | 62 kB 00:00 2023-10-03T10:07:44.988 INFO:teuthology.orchestra.run.smithi153.stdout:(57/122): fuse-2.9.7-17.el8.x86_64.rpm 199 kB/s | 83 kB 00:00 2023-10-03T10:07:45.130 INFO:teuthology.orchestra.run.smithi153.stdout:(58/122): libcom_err-devel-1.45.6-5.el8.x86_64. 274 kB/s | 39 kB 00:00 2023-10-03T10:07:45.230 INFO:teuthology.orchestra.run.smithi153.stdout:(59/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 128 kB/s | 48 kB 00:00 2023-10-03T10:07:45.364 INFO:teuthology.orchestra.run.smithi153.stdout:(60/122): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.4 MB/s | 561 kB 00:00 2023-10-03T10:07:45.473 INFO:teuthology.orchestra.run.smithi153.stdout:(61/122): librabbitmq-0.9.0-4.el8.x86_64.rpm 433 kB/s | 47 kB 00:00 2023-10-03T10:07:45.498 INFO:teuthology.orchestra.run.smithi153.stdout:(62/122): libquadmath-8.5.0-20.el8.x86_64.rpm 645 kB/s | 172 kB 00:00 2023-10-03T10:07:45.531 INFO:teuthology.orchestra.run.smithi153.stdout:(63/122): libgfortran-8.5.0-20.el8.x86_64.rpm 1.6 MB/s | 645 kB 00:00 2023-10-03T10:07:45.598 INFO:teuthology.orchestra.run.smithi153.stdout:(64/122): libselinux-devel-2.9-8.el8.x86_64.rpm 1.6 MB/s | 200 kB 00:00 2023-10-03T10:07:45.623 INFO:teuthology.orchestra.run.smithi153.stdout:(65/122): libsepol-devel-2.9-3.el8.x86_64.rpm 693 kB/s | 87 kB 00:00 2023-10-03T10:07:45.649 INFO:teuthology.orchestra.run.smithi153.stdout:(66/122): libverto-devel-0.3.2-2.el8.x86_64.rpm 154 kB/s | 18 kB 00:00 2023-10-03T10:07:45.707 INFO:teuthology.orchestra.run.smithi153.stdout:(67/122): libzstd-devel-1.4.4-1.el8.x86_64.rpm 403 kB/s | 44 kB 00:00 2023-10-03T10:07:45.816 INFO:teuthology.orchestra.run.smithi153.stdout:(68/122): pcre2-devel-10.32-3.el8.x86_64.rpm 3.5 MB/s | 605 kB 00:00 2023-10-03T10:07:45.841 INFO:teuthology.orchestra.run.smithi153.stdout:(69/122): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.7 MB/s | 229 kB 00:00 2023-10-03T10:07:45.933 INFO:teuthology.orchestra.run.smithi153.stdout:(70/122): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-10-03T10:07:45.975 INFO:teuthology.orchestra.run.smithi153.stdout:(71/122): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.8 MB/s | 249 kB 00:00 2023-10-03T10:07:46.109 INFO:teuthology.orchestra.run.smithi153.stdout:(72/122): openssl-devel-1.1.1k-9.el8.x86_64.rpm 6.6 MB/s | 3.2 MB 00:00 2023-10-03T10:07:46.126 INFO:teuthology.orchestra.run.smithi153.stdout:(73/122): python3-jwt-1.6.1-2.el8.noarch.rpm 283 kB/s | 43 kB 00:00 2023-10-03T10:07:46.159 INFO:teuthology.orchestra.run.smithi153.stdout:(74/122): python3-cryptography-3.2.1-6.el8.x86_ 2.8 MB/s | 641 kB 00:00 2023-10-03T10:07:46.210 INFO:teuthology.orchestra.run.smithi153.stdout:(75/122): python3-oauthlib-2.1.0-1.el8.noarch.r 1.5 MB/s | 155 kB 00:00 2023-10-03T10:07:46.235 INFO:teuthology.orchestra.run.smithi153.stdout:(76/122): python3-pycparser-2.14-14.el8.noarch. 1.0 MB/s | 109 kB 00:00 2023-10-03T10:07:46.260 INFO:teuthology.orchestra.run.smithi153.stdout:(77/122): python3-requests-oauthlib-1.0.0-1.el8 424 kB/s | 43 kB 00:00 2023-10-03T10:07:46.310 INFO:teuthology.orchestra.run.smithi153.stdout:(78/122): zlib-devel-1.2.11-21.el8.x86_64.rpm 579 kB/s | 58 kB 00:00 2023-10-03T10:07:46.377 INFO:teuthology.orchestra.run.smithi153.stdout:(79/122): gperftools-libs-2.7-9.el8.x86_64.rpm 2.1 MB/s | 306 kB 00:00 2023-10-03T10:07:46.427 INFO:teuthology.orchestra.run.smithi153.stdout:(80/122): leveldb-1.22-1.el8.x86_64.rpm 1.1 MB/s | 181 kB 00:00 2023-10-03T10:07:46.461 INFO:teuthology.orchestra.run.smithi153.stdout:(81/122): liboath-2.6.2-3.el8.x86_64.rpm 391 kB/s | 59 kB 00:00 2023-10-03T10:07:46.487 INFO:teuthology.orchestra.run.smithi153.stdout:(82/122): libunwind-1.3.1-3.el8.x86_64.rpm 688 kB/s | 75 kB 00:00 2023-10-03T10:07:46.512 INFO:teuthology.orchestra.run.smithi153.stdout:(83/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 520 kB/s | 44 kB 00:00 2023-10-03T10:07:46.554 INFO:teuthology.orchestra.run.smithi153.stdout:(84/122): python3-beautifulsoup4-4.6.3-2.el8.1. 2.0 MB/s | 185 kB 00:00 2023-10-03T10:07:46.579 INFO:teuthology.orchestra.run.smithi153.stdout:(85/122): python3-certifi-2018.10.15-7.el8.noar 245 kB/s | 16 kB 00:00 2023-10-03T10:07:46.604 INFO:teuthology.orchestra.run.smithi153.stdout:(86/122): python3-cachetools-3.1.1-4.el8.noarch 359 kB/s | 33 kB 00:00 2023-10-03T10:07:46.629 INFO:teuthology.orchestra.run.smithi153.stdout:(87/122): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2023-10-03T10:07:46.663 INFO:teuthology.orchestra.run.smithi153.stdout:(88/122): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2023-10-03T10:07:46.689 INFO:teuthology.orchestra.run.smithi153.stdout:(89/122): python3-jaraco-6.2-6.el8.noarch.rpm 190 kB/s | 11 kB 00:00 2023-10-03T10:07:46.713 INFO:teuthology.orchestra.run.smithi153.stdout:(90/122): python3-jaraco-functools-2.0-4.el8.no 351 kB/s | 18 kB 00:00 2023-10-03T10:07:46.739 INFO:teuthology.orchestra.run.smithi153.stdout:(91/122): python3-cherrypy-18.4.0-1.el8.noarch. 2.4 MB/s | 384 kB 00:00 2023-10-03T10:07:46.764 INFO:teuthology.orchestra.run.smithi153.stdout:(92/122): python3-logutils-0.3.5-11.el8.noarch. 970 kB/s | 49 kB 00:00 2023-10-03T10:07:46.789 INFO:teuthology.orchestra.run.smithi153.stdout:(93/122): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-10-03T10:07:46.831 INFO:teuthology.orchestra.run.smithi153.stdout:(94/122): python3-kubernetes-11.0.0-6.el8.noarc 8.2 MB/s | 1.2 MB 00:00 2023-10-03T10:07:46.856 INFO:teuthology.orchestra.run.smithi153.stdout:(95/122): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2023-10-03T10:07:46.882 INFO:teuthology.orchestra.run.smithi153.stdout:(96/122): python3-repoze-lru-0.7-6.el8.noarch.r 671 kB/s | 34 kB 00:00 2023-10-03T10:07:46.907 INFO:teuthology.orchestra.run.smithi153.stdout:(97/122): python3-pecan-1.3.2-9.el8.noarch.rpm 1.9 MB/s | 283 kB 00:00 2023-10-03T10:07:46.957 INFO:teuthology.orchestra.run.smithi153.stdout:(98/122): python3-rsa-4.9-2.el8.noarch.rpm 854 kB/s | 64 kB 00:00 2023-10-03T10:07:46.982 INFO:teuthology.orchestra.run.smithi153.stdout:(99/122): python3-simplegeneric-0.8.1-17.el8.no 249 kB/s | 19 kB 00:00 2023-10-03T10:07:47.007 INFO:teuthology.orchestra.run.smithi153.stdout:(100/122): python3-singledispatch-3.4.0.3-18.el 479 kB/s | 24 kB 00:00 2023-10-03T10:07:47.033 INFO:teuthology.orchestra.run.smithi153.stdout:(101/122): python3-routes-2.4.1-12.el8.noarch.r 1.1 MB/s | 196 kB 00:00 2023-10-03T10:07:47.058 INFO:teuthology.orchestra.run.smithi153.stdout:(102/122): python3-tempora-1.14.1-5.el8.noarch. 388 kB/s | 29 kB 00:00 2023-10-03T10:07:47.083 INFO:teuthology.orchestra.run.smithi153.stdout:(103/122): python3-trustme-0.6.0-4.el8.noarch.r 365 kB/s | 27 kB 00:00 2023-10-03T10:07:47.109 INFO:teuthology.orchestra.run.smithi153.stdout:(104/122): python3-waitress-1.4.3-1.el8.noarch. 5.0 MB/s | 255 kB 00:00 2023-10-03T10:07:47.134 INFO:teuthology.orchestra.run.smithi153.stdout:(105/122): python3-webob-1.8.5-1.el8.1.noarch.r 3.3 MB/s | 251 kB 00:00 2023-10-03T10:07:47.159 INFO:teuthology.orchestra.run.smithi153.stdout:(106/122): python3-websocket-client-0.56.0-5.el 812 kB/s | 61 kB 00:00 2023-10-03T10:07:47.184 INFO:teuthology.orchestra.run.smithi153.stdout:(107/122): python3-zc-lockfile-2.0-2.el8.noarch 458 kB/s | 23 kB 00:00 2023-10-03T10:07:47.209 INFO:teuthology.orchestra.run.smithi153.stdout:(108/122): python3-webtest-2.0.33-1.el8.noarch. 1.1 MB/s | 85 kB 00:00 2023-10-03T10:07:47.352 INFO:teuthology.orchestra.run.smithi153.stdout:(109/122): NetworkManager-initscripts-updown-1. 1.0 MB/s | 143 kB 00:00 2023-10-03T10:07:47.485 INFO:teuthology.orchestra.run.smithi153.stdout:(110/122): elfutils-debuginfod-client-0.189-3.e 572 kB/s | 76 kB 00:00 2023-10-03T10:07:47.627 INFO:teuthology.orchestra.run.smithi153.stdout:(111/122): librbd1-16.2.14-44.geeb13ac9.el8.x86 9.4 MB/s | 4.2 MB 00:00 2023-10-03T10:07:47.652 INFO:teuthology.orchestra.run.smithi153.stdout:(112/122): elfutils-libelf-0.189-3.el8.x86_64.r 1.4 MB/s | 232 kB 00:00 2023-10-03T10:07:47.753 INFO:teuthology.orchestra.run.smithi153.stdout:(113/122): elfutils-libs-0.189-3.el8.x86_64.rpm 2.4 MB/s | 303 kB 00:00 2023-10-03T10:07:47.870 INFO:teuthology.orchestra.run.smithi153.stdout:(114/122): libblkid-2.32.1-43.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-10-03T10:07:47.895 INFO:teuthology.orchestra.run.smithi153.stdout:(115/122): iproute-6.2.0-5.el8.x86_64.rpm 3.4 MB/s | 854 kB 00:00 2023-10-03T10:07:47.987 INFO:teuthology.orchestra.run.smithi153.stdout:(116/122): libfdisk-2.32.1-43.el8.x86_64.rpm 2.1 MB/s | 254 kB 00:00 2023-10-03T10:07:48.012 INFO:teuthology.orchestra.run.smithi153.stdout:(117/122): libmount-2.32.1-43.el8.x86_64.rpm 2.0 MB/s | 236 kB 00:00 2023-10-03T10:07:48.096 INFO:teuthology.orchestra.run.smithi153.stdout:(118/122): libsmartcols-2.32.1-43.el8.x86_64.rp 1.6 MB/s | 179 kB 00:00 2023-10-03T10:07:48.121 INFO:teuthology.orchestra.run.smithi153.stdout:(119/122): libuuid-2.32.1-43.el8.x86_64.rpm 911 kB/s | 99 kB 00:00 2023-10-03T10:07:48.230 INFO:teuthology.orchestra.run.smithi153.stdout:(120/122): util-linux-user-2.32.1-43.el8.x86_64 948 kB/s | 103 kB 00:00 2023-10-03T10:07:48.364 INFO:teuthology.orchestra.run.smithi153.stdout:(121/122): util-linux-2.32.1-43.el8.x86_64.rpm 9.3 MB/s | 2.5 MB 00:00 2023-10-03T10:07:48.414 INFO:teuthology.orchestra.run.smithi153.stdout:(122/122): librados2-16.2.14-44.geeb13ac9.el8.x 3.0 MB/s | 3.7 MB 00:01 2023-10-03T10:07:48.416 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2023-10-03T10:07:48.416 INFO:teuthology.orchestra.run.smithi153.stdout:Total 4.8 MB/s | 200 MB 00:41 2023-10-03T10:07:49.133 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2023-10-03T10:07:49.355 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2023-10-03T10:07:49.355 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2023-10-03T10:07:49.584 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2023-10-03T10:07:49.631 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2023-10-03T10:07:49.831 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/136 2023-10-03T10:07:50.076 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/136 2023-10-03T10:07:50.245 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-03T10:07:50.326 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-03T10:07:50.520 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-03T10:07:50.613 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-03T10:07:50.717 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2023-10-03T10:07:50.720 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2023-10-03T10:07:50.842 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/136 2023-10-03T10:07:51.191 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/136 2023-10-03T10:07:51.396 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-03T10:07:51.785 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-03T10:07:51.979 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:07:52.394 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:07:52.604 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:07:52.725 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:07:52.943 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:07:53.050 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:07:53.268 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-03T10:07:53.462 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-03T10:07:53.842 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-03T10:07:54.003 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:07:54.076 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:07:54.316 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/136 2023-10-03T10:07:54.510 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/136 2023-10-03T10:07:54.670 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-03T10:07:54.758 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-03T10:07:54.903 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-03T10:07:55.024 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-03T10:07:55.234 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/136 2023-10-03T10:07:55.383 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/136 2023-10-03T10:07:55.418 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2023-10-03T10:07:55.459 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2023-10-03T10:07:55.537 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-03T10:07:55.678 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-03T10:07:55.741 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/136 2023-10-03T10:07:55.819 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-03T10:07:55.929 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/136 2023-10-03T10:07:56.104 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-03T10:07:56.165 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-03T10:07:56.329 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-03T10:07:56.416 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-03T10:07:56.428 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-03T10:07:56.636 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/136 2023-10-03T10:07:56.643 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/136 2023-10-03T10:07:56.819 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/136 2023-10-03T10:07:57.004 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-03T10:07:57.252 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/136 2023-10-03T10:07:57.411 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-03T10:07:57.418 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-03T10:07:57.604 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:07:58.031 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:07:58.105 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-03T10:07:58.237 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:07:58.364 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:07:58.471 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/136 2023-10-03T10:07:58.529 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:07:58.668 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:07:58.732 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/136 2023-10-03T10:07:58.877 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-03T10:07:58.992 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 26/136 2023-10-03T10:07:59.045 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-03T10:07:59.159 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 27/136 2023-10-03T10:07:59.374 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 28/136 2023-10-03T10:07:59.443 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-03T10:07:59.569 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-03T10:07:59.637 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:07:59.690 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:07:59.899 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/136 2023-10-03T10:08:00.086 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/136 2023-10-03T10:08:00.229 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-03T10:08:00.331 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-03T10:08:00.454 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-03T10:08:00.571 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-03T10:08:00.768 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/136 2023-10-03T10:08:00.915 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/136 2023-10-03T10:08:01.028 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-03T10:08:01.148 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-03T10:08:01.295 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-03T10:08:01.347 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-03T10:08:01.657 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 30/136 2023-10-03T10:08:01.828 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/136 2023-10-03T10:08:01.897 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-03T10:08:02.055 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/136 2023-10-03T10:08:02.070 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/136 2023-10-03T10:08:02.282 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 33/136 2023-10-03T10:08:02.481 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 34/136 2023-10-03T10:08:02.685 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/136 2023-10-03T10:08:02.711 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 35/136 2023-10-03T10:08:02.862 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-03T10:08:02.910 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 36/136 2023-10-03T10:08:03.077 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 37/136 2023-10-03T10:08:03.302 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-03T10:08:03.380 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-03T10:08:03.531 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-03T10:08:03.552 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 39/136 2023-10-03T10:08:03.609 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 39/136 2023-10-03T10:08:03.802 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-03T10:08:03.878 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/136 2023-10-03T10:08:04.123 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/136 2023-10-03T10:08:04.271 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-03T10:08:04.375 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 26/136 2023-10-03T10:08:04.519 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-03T10:08:04.533 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-03T10:08:04.541 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 27/136 2023-10-03T10:08:04.738 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 42/136 2023-10-03T10:08:04.791 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 28/136 2023-10-03T10:08:04.976 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 43/136 2023-10-03T10:08:04.986 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-03T10:08:05.225 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 44/136 2023-10-03T10:08:05.431 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 45/136 2023-10-03T10:08:05.587 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 46/136 2023-10-03T10:08:05.776 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 47/136 2023-10-03T10:08:06.003 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 48/136 2023-10-03T10:08:06.171 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/136 2023-10-03T10:08:06.382 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/136 2023-10-03T10:08:06.560 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2023-10-03T10:08:06.752 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 52/136 2023-10-03T10:08:06.775 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-03T10:08:06.977 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 53/136 2023-10-03T10:08:07.056 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 30/136 2023-10-03T10:08:07.235 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 54/136 2023-10-03T10:08:07.245 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/136 2023-10-03T10:08:07.446 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 55/136 2023-10-03T10:08:07.473 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/136 2023-10-03T10:08:07.694 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 56/136 2023-10-03T10:08:07.753 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 33/136 2023-10-03T10:08:07.904 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 57/136 2023-10-03T10:08:07.932 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 34/136 2023-10-03T10:08:08.151 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 58/136 2023-10-03T10:08:08.152 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 35/136 2023-10-03T10:08:08.357 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 59/136 2023-10-03T10:08:08.382 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 36/136 2023-10-03T10:08:08.577 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 37/136 2023-10-03T10:08:08.738 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 60/136 2023-10-03T10:08:08.827 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-03T10:08:08.902 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-03T10:08:09.036 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 61/136 2023-10-03T10:08:09.111 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 39/136 2023-10-03T10:08:09.165 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 39/136 2023-10-03T10:08:09.244 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/136 2023-10-03T10:08:09.361 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-03T10:08:09.505 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 63/136 2023-10-03T10:08:09.722 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 64/136 2023-10-03T10:08:09.858 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-03T10:08:10.103 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-03T10:08:10.117 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-03T10:08:10.305 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 42/136 2023-10-03T10:08:10.554 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 43/136 2023-10-03T10:08:10.800 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 65/136 2023-10-03T10:08:10.842 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 44/136 2023-10-03T10:08:11.025 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 66/136 2023-10-03T10:08:11.048 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 45/136 2023-10-03T10:08:11.213 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 46/136 2023-10-03T10:08:11.251 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/136 2023-10-03T10:08:11.430 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 47/136 2023-10-03T10:08:11.443 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 68/136 2023-10-03T10:08:11.648 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 48/136 2023-10-03T10:08:11.711 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/136 2023-10-03T10:08:11.856 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/136 2023-10-03T10:08:11.895 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 70/136 2023-10-03T10:08:12.025 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/136 2023-10-03T10:08:12.189 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 71/136 2023-10-03T10:08:12.193 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2023-10-03T10:08:12.397 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 72/136 2023-10-03T10:08:12.402 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 52/136 2023-10-03T10:08:12.519 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 73/136 2023-10-03T10:08:12.620 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 53/136 2023-10-03T10:08:12.663 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 74/136 2023-10-03T10:08:12.877 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 54/136 2023-10-03T10:08:12.965 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 75/136 2023-10-03T10:08:13.096 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 55/136 2023-10-03T10:08:13.154 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 76/136 2023-10-03T10:08:13.304 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 77/136 2023-10-03T10:08:13.311 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 56/136 2023-10-03T10:08:13.506 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 78/136 2023-10-03T10:08:13.553 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 57/136 2023-10-03T10:08:13.718 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 79/136 2023-10-03T10:08:13.768 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 58/136 2023-10-03T10:08:13.918 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : fuse-2.9.7-17.el8.x86_64 80/136 2023-10-03T10:08:14.000 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 59/136 2023-10-03T10:08:14.191 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 81/136 2023-10-03T10:08:14.364 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 82/136 2023-10-03T10:08:14.384 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 60/136 2023-10-03T10:08:14.552 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 83/136 2023-10-03T10:08:14.678 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 61/136 2023-10-03T10:08:14.722 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/136 2023-10-03T10:08:14.937 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/136 2023-10-03T10:08:15.033 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/136 2023-10-03T10:08:15.165 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 63/136 2023-10-03T10:08:15.267 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/136 2023-10-03T10:08:15.406 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 64/136 2023-10-03T10:08:15.442 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 87/136 2023-10-03T10:08:16.452 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 65/136 2023-10-03T10:08:16.702 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 66/136 2023-10-03T10:08:16.959 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/136 2023-10-03T10:08:17.185 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 68/136 2023-10-03T10:08:17.445 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/136 2023-10-03T10:08:17.634 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 70/136 2023-10-03T10:08:17.902 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:08:17.928 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 71/136 2023-10-03T10:08:18.123 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 72/136 2023-10-03T10:08:18.150 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:08:18.253 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 73/136 2023-10-03T10:08:18.401 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 74/136 2023-10-03T10:08:18.693 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 75/136 2023-10-03T10:08:18.853 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:08:18.946 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 76/136 2023-10-03T10:08:19.080 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 77/136 2023-10-03T10:08:19.152 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-03T10:08:19.279 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-03T10:08:19.292 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 78/136 2023-10-03T10:08:19.449 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-03T10:08:19.510 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 79/136 2023-10-03T10:08:19.711 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fuse-2.9.7-17.el8.x86_64 80/136 2023-10-03T10:08:19.936 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 81/136 2023-10-03T10:08:20.141 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 82/136 2023-10-03T10:08:20.312 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 83/136 2023-10-03T10:08:20.531 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/136 2023-10-03T10:08:20.827 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/136 2023-10-03T10:08:21.118 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/136 2023-10-03T10:08:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 87/136 2023-10-03T10:08:23.805 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:08:24.050 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:08:24.747 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:08:25.074 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-03T10:08:25.181 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-03T10:08:25.333 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-03T10:08:37.619 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-03T10:08:37.619 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /sys 2023-10-03T10:08:37.619 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /proc 2023-10-03T10:08:37.619 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /dev 2023-10-03T10:08:37.619 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /run 2023-10-03T10:08:37.619 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /mnt 2023-10-03T10:08:37.619 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /var/tmp 2023-10-03T10:08:37.620 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /home 2023-10-03T10:08:37.620 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /tmp 2023-10-03T10:08:37.620 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /dev 2023-10-03T10:08:37.620 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:08:38.058 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-03T10:08:38.481 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-03T10:08:38.655 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-03T10:08:40.135 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-03T10:08:40.346 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-03T10:08:40.381 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-03T10:08:40.599 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 94/136 2023-10-03T10:08:40.934 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 95/136 2023-10-03T10:08:41.252 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/136 2023-10-03T10:08:41.511 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/136 2023-10-03T10:08:41.723 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/136 2023-10-03T10:08:41.904 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-03T10:08:41.987 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-03T10:08:42.174 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : jq-1.6-7.el8.x86_64 100/136 2023-10-03T10:08:42.336 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 101/136 2023-10-03T10:08:43.386 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 102/136 2023-10-03T10:08:43.645 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-03T10:08:43.645 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /sys 2023-10-03T10:08:43.645 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /proc 2023-10-03T10:08:43.645 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /dev 2023-10-03T10:08:43.645 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /run 2023-10-03T10:08:43.645 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /mnt 2023-10-03T10:08:43.645 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /var/tmp 2023-10-03T10:08:43.645 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /home 2023-10-03T10:08:43.646 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /tmp 2023-10-03T10:08:43.646 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /dev 2023-10-03T10:08:43.646 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:08:43.664 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-03T10:08:44.056 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-03T10:08:44.486 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-03T10:08:44.705 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-03T10:08:44.708 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-03T10:08:44.928 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-03T10:08:45.020 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-03T10:08:45.439 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 105/136 2023-10-03T10:08:45.656 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-03T10:08:45.682 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-03T10:08:45.853 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-03T10:08:45.864 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-03T10:08:46.185 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-03T10:08:46.413 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-03T10:08:46.447 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-03T10:08:46.665 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 94/136 2023-10-03T10:08:47.045 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 95/136 2023-10-03T10:08:47.336 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/136 2023-10-03T10:08:47.541 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/136 2023-10-03T10:08:47.799 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/136 2023-10-03T10:08:47.963 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-03T10:08:48.044 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-03T10:08:48.274 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : jq-1.6-7.el8.x86_64 100/136 2023-10-03T10:08:48.403 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 101/136 2023-10-03T10:08:49.463 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 102/136 2023-10-03T10:08:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-03T10:08:50.486 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 108/136 2023-10-03T10:08:50.821 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-03T10:08:51.037 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-03T10:08:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-03T10:08:51.561 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 105/136 2023-10-03T10:08:51.733 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-03T10:08:51.808 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-03T10:08:51.833 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-03T10:08:51.955 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-03T10:08:52.004 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-03T10:08:52.015 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-03T10:08:52.343 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-03T10:08:52.544 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:08:52.638 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:08:53.489 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 112/136 2023-10-03T10:08:53.781 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 113/136 2023-10-03T10:08:53.987 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 114/136 2023-10-03T10:08:54.164 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 115/136 2023-10-03T10:08:54.343 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 116/136 2023-10-03T10:08:54.526 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 117/136 2023-10-03T10:08:54.848 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 118/136 2023-10-03T10:08:55.154 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 119/136 2023-10-03T10:08:55.302 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-03T10:08:55.370 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-03T10:08:55.618 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/136 2023-10-03T10:08:55.703 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/136 2023-10-03T10:08:55.944 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/136 2023-10-03T10:08:55.955 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/136 2023-10-03T10:08:56.145 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/136 2023-10-03T10:08:56.372 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/136 2023-10-03T10:08:56.372 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-03T10:08:56.603 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-03T10:08:56.608 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-03T10:08:56.645 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 108/136 2023-10-03T10:08:56.730 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-03T10:08:56.730 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-03T10:08:57.049 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-03T10:08:57.254 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/136 2023-10-03T10:08:57.417 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/136 2023-10-03T10:08:57.620 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/136 2023-10-03T10:08:57.620 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-03T10:08:57.838 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-03T10:08:57.838 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:08:57.936 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-03T10:08:58.046 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:08:58.046 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-03T10:08:58.177 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-03T10:08:58.271 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-03T10:08:58.271 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:08:58.512 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:08:58.512 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-03T10:08:58.583 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-03T10:08:58.721 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-03T10:08:58.778 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:08:58.871 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:08:58.903 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-03T10:08:59.483 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-03T10:08:59.484 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 1/136 2023-10-03T10:08:59.484 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2/136 2023-10-03T10:08:59.484 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 3/136 2023-10-03T10:08:59.484 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 4/136 2023-10-03T10:08:59.484 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 5/136 2023-10-03T10:08:59.484 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 6/136 2023-10-03T10:08:59.484 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 7/136 2023-10-03T10:08:59.484 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:08:59.484 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:08:59.484 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:08:59.485 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-03T10:08:59.485 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 12/136 2023-10-03T10:08:59.485 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:08:59.485 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 14/136 2023-10-03T10:08:59.485 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 15/136 2023-10-03T10:08:59.485 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 16/136 2023-10-03T10:08:59.485 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 17/136 2023-10-03T10:08:59.485 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 18/136 2023-10-03T10:08:59.485 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 19/136 2023-10-03T10:08:59.485 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 20/136 2023-10-03T10:08:59.485 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 21/136 2023-10-03T10:08:59.485 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 22/136 2023-10-03T10:08:59.486 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 23/136 2023-10-03T10:08:59.486 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 24/136 2023-10-03T10:08:59.486 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 25/136 2023-10-03T10:08:59.486 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 26/136 2023-10-03T10:08:59.486 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 27/136 2023-10-03T10:08:59.486 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 28/136 2023-10-03T10:08:59.486 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 29/136 2023-10-03T10:08:59.486 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 30/136 2023-10-03T10:08:59.496 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 31/136 2023-10-03T10:08:59.496 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 32/136 2023-10-03T10:08:59.496 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : bison-3.0.4-10.el8.x86_64 33/136 2023-10-03T10:08:59.496 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flex-2.6.1-9.el8.x86_64 34/136 2023-10-03T10:08:59.496 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : jq-1.6-7.el8.x86_64 35/136 2023-10-03T10:08:59.496 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 36/136 2023-10-03T10:08:59.496 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 37/136 2023-10-03T10:08:59.497 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 38/136 2023-10-03T10:08:59.497 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 39/136 2023-10-03T10:08:59.497 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 40/136 2023-10-03T10:08:59.497 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/136 2023-10-03T10:08:59.497 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/136 2023-10-03T10:08:59.497 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 43/136 2023-10-03T10:08:59.497 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 44/136 2023-10-03T10:08:59.497 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 45/136 2023-10-03T10:08:59.497 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 46/136 2023-10-03T10:08:59.497 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 47/136 2023-10-03T10:08:59.497 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/136 2023-10-03T10:08:59.497 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 49/136 2023-10-03T10:08:59.498 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 50/136 2023-10-03T10:08:59.498 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 51/136 2023-10-03T10:08:59.498 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 52/136 2023-10-03T10:08:59.498 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 53/136 2023-10-03T10:08:59.498 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 54/136 2023-10-03T10:08:59.498 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 55/136 2023-10-03T10:08:59.498 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 56/136 2023-10-03T10:08:59.498 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 57/136 2023-10-03T10:08:59.498 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/136 2023-10-03T10:08:59.498 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 59/136 2023-10-03T10:08:59.498 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 60/136 2023-10-03T10:08:59.498 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 61/136 2023-10-03T10:08:59.499 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 62/136 2023-10-03T10:08:59.499 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 63/136 2023-10-03T10:08:59.499 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 64/136 2023-10-03T10:08:59.499 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 65/136 2023-10-03T10:08:59.499 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 66/136 2023-10-03T10:08:59.499 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 67/136 2023-10-03T10:08:59.499 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 68/136 2023-10-03T10:08:59.499 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 69/136 2023-10-03T10:08:59.499 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 70/136 2023-10-03T10:08:59.499 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 71/136 2023-10-03T10:08:59.499 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 72/136 2023-10-03T10:08:59.499 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 73/136 2023-10-03T10:08:59.500 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/136 2023-10-03T10:08:59.500 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/136 2023-10-03T10:08:59.500 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/136 2023-10-03T10:08:59.500 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/136 2023-10-03T10:08:59.500 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 78/136 2023-10-03T10:08:59.500 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 79/136 2023-10-03T10:08:59.500 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : leveldb-1.22-1.el8.x86_64 80/136 2023-10-03T10:08:59.500 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 81/136 2023-10-03T10:08:59.500 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 82/136 2023-10-03T10:08:59.500 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/136 2023-10-03T10:08:59.500 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/136 2023-10-03T10:08:59.501 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 85/136 2023-10-03T10:08:59.501 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 86/136 2023-10-03T10:08:59.501 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 87/136 2023-10-03T10:08:59.501 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 88/136 2023-10-03T10:08:59.501 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 89/136 2023-10-03T10:08:59.501 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 90/136 2023-10-03T10:08:59.501 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 91/136 2023-10-03T10:08:59.501 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 92/136 2023-10-03T10:08:59.501 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 93/136 2023-10-03T10:08:59.501 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 94/136 2023-10-03T10:08:59.501 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 95/136 2023-10-03T10:08:59.501 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-portend-2.6-1.el8.noarch 96/136 2023-10-03T10:08:59.502 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 97/136 2023-10-03T10:08:59.502 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 98/136 2023-10-03T10:08:59.502 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 99/136 2023-10-03T10:08:59.502 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 100/136 2023-10-03T10:08:59.502 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 101/136 2023-10-03T10:08:59.502 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 102/136 2023-10-03T10:08:59.502 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 103/136 2023-10-03T10:08:59.502 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 104/136 2023-10-03T10:08:59.502 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 105/136 2023-10-03T10:08:59.502 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 106/136 2023-10-03T10:08:59.502 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 107/136 2023-10-03T10:08:59.503 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 108/136 2023-10-03T10:08:59.503 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-03T10:08:59.503 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 110/136 2023-10-03T10:08:59.503 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:08:59.503 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 112/136 2023-10-03T10:08:59.503 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 113/136 2023-10-03T10:08:59.503 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 114/136 2023-10-03T10:08:59.503 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 115/136 2023-10-03T10:08:59.503 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/136 2023-10-03T10:08:59.503 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 117/136 2023-10-03T10:08:59.503 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/136 2023-10-03T10:08:59.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 119/136 2023-10-03T10:08:59.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/136 2023-10-03T10:08:59.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 121/136 2023-10-03T10:08:59.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/136 2023-10-03T10:08:59.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 123/136 2023-10-03T10:08:59.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/136 2023-10-03T10:08:59.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 125/136 2023-10-03T10:08:59.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/136 2023-10-03T10:08:59.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 127/136 2023-10-03T10:08:59.504 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/136 2023-10-03T10:08:59.505 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 129/136 2023-10-03T10:08:59.505 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/136 2023-10-03T10:08:59.505 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 131/136 2023-10-03T10:08:59.505 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:08:59.505 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 133/136 2023-10-03T10:08:59.505 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:08:59.505 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 135/136 2023-10-03T10:08:59.750 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 112/136 2023-10-03T10:09:00.023 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 113/136 2023-10-03T10:09:00.249 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 114/136 2023-10-03T10:09:00.456 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 115/136 2023-10-03T10:09:00.622 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 116/136 2023-10-03T10:09:00.826 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 117/136 2023-10-03T10:09:01.162 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 118/136 2023-10-03T10:09:01.429 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 119/136 2023-10-03T10:09:01.476 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 136/136 2023-10-03T10:09:01.476 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:01.476 INFO:teuthology.orchestra.run.smithi146.stdout:Upgraded: 2023-10-03T10:09:01.476 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-10-03T10:09:01.476 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-10-03T10:09:01.476 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-10-03T10:09:01.476 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-10-03T10:09:01.476 INFO:teuthology.orchestra.run.smithi146.stdout: iproute-6.2.0-5.el8.x86_64 2023-10-03T10:09:01.476 INFO:teuthology.orchestra.run.smithi146.stdout: libblkid-2.32.1-43.el8.x86_64 2023-10-03T10:09:01.476 INFO:teuthology.orchestra.run.smithi146.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-10-03T10:09:01.477 INFO:teuthology.orchestra.run.smithi146.stdout: libmount-2.32.1-43.el8.x86_64 2023-10-03T10:09:01.477 INFO:teuthology.orchestra.run.smithi146.stdout: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.477 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.477 INFO:teuthology.orchestra.run.smithi146.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-10-03T10:09:01.477 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-2.32.1-43.el8.x86_64 2023-10-03T10:09:01.477 INFO:teuthology.orchestra.run.smithi146.stdout: util-linux-2.32.1-43.el8.x86_64 2023-10-03T10:09:01.477 INFO:teuthology.orchestra.run.smithi146.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-10-03T10:09:01.477 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2023-10-03T10:09:01.477 INFO:teuthology.orchestra.run.smithi146.stdout: bison-3.0.4-10.el8.x86_64 2023-10-03T10:09:01.477 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.477 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.477 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.478 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.478 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:01.478 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.478 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.478 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:01.478 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:01.478 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:01.478 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:01.478 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.478 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.478 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:01.479 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.479 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.479 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.479 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-10-03T10:09:01.479 INFO:teuthology.orchestra.run.smithi146.stdout: flex-2.6.1-9.el8.x86_64 2023-10-03T10:09:01.479 INFO:teuthology.orchestra.run.smithi146.stdout: fuse-2.9.7-17.el8.x86_64 2023-10-03T10:09:01.479 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-03T10:09:01.479 INFO:teuthology.orchestra.run.smithi146.stdout: jq-1.6-7.el8.x86_64 2023-10-03T10:09:01.479 INFO:teuthology.orchestra.run.smithi146.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-03T10:09:01.479 INFO:teuthology.orchestra.run.smithi146.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-10-03T10:09:01.479 INFO:teuthology.orchestra.run.smithi146.stdout: leveldb-1.22-1.el8.x86_64 2023-10-03T10:09:01.479 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.479 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.480 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.480 INFO:teuthology.orchestra.run.smithi146.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-10-03T10:09:01.480 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-10-03T10:09:01.480 INFO:teuthology.orchestra.run.smithi146.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-03T10:09:01.480 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-10-03T10:09:01.480 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-03T10:09:01.480 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.480 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.480 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-03T10:09:01.480 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.480 INFO:teuthology.orchestra.run.smithi146.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-10-03T10:09:01.480 INFO:teuthology.orchestra.run.smithi146.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-03T10:09:01.480 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-03T10:09:01.481 INFO:teuthology.orchestra.run.smithi146.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-10-03T10:09:01.481 INFO:teuthology.orchestra.run.smithi146.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-10-03T10:09:01.481 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-03T10:09:01.481 INFO:teuthology.orchestra.run.smithi146.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-03T10:09:01.481 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-03T10:09:01.481 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-03T10:09:01.481 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-10-03T10:09:01.481 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-10-03T10:09:01.481 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-10-03T10:09:01.481 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-10-03T10:09:01.481 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-03T10:09:01.481 INFO:teuthology.orchestra.run.smithi146.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-03T10:09:01.481 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-03T10:09:01.482 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.482 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.482 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.482 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-03T10:09:01.482 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-03T10:09:01.482 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-03T10:09:01.482 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-03T10:09:01.482 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-03T10:09:01.482 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-03T10:09:01.482 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-03T10:09:01.482 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-03T10:09:01.482 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-03T10:09:01.483 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-03T10:09:01.483 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-03T10:09:01.483 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-03T10:09:01.483 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-03T10:09:01.483 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-03T10:09:01.483 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-03T10:09:01.483 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-03T10:09:01.483 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-03T10:09:01.483 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-03T10:09:01.483 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-03T10:09:01.483 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-03T10:09:01.483 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend-2.6-1.el8.noarch 2023-10-03T10:09:01.483 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-03T10:09:01.484 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-03T10:09:01.484 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-03T10:09:01.484 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-03T10:09:01.484 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-03T10:09:01.484 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-03T10:09:01.484 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.484 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.484 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-03T10:09:01.484 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-03T10:09:01.484 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.484 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-03T10:09:01.484 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-03T10:09:01.484 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-03T10:09:01.485 INFO:teuthology.orchestra.run.smithi146.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-03T10:09:01.485 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-03T10:09:01.485 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-03T10:09:01.485 INFO:teuthology.orchestra.run.smithi146.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-03T10:09:01.485 INFO:teuthology.orchestra.run.smithi146.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-03T10:09:01.485 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-03T10:09:01.485 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-03T10:09:01.485 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-03T10:09:01.485 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-03T10:09:01.485 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-03T10:09:01.485 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.485 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.485 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:01.486 INFO:teuthology.orchestra.run.smithi146.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-03T10:09:01.486 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-03T10:09:01.486 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-10-03T10:09:01.486 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:01.486 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2023-10-03T10:09:01.615 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-03T10:09:01.671 DEBUG:teuthology.parallel:result is None 2023-10-03T10:09:01.678 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-03T10:09:01.902 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/136 2023-10-03T10:09:01.994 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/136 2023-10-03T10:09:02.189 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/136 2023-10-03T10:09:02.202 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/136 2023-10-03T10:09:02.395 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/136 2023-10-03T10:09:02.586 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/136 2023-10-03T10:09:02.586 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-03T10:09:02.846 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-03T10:09:02.851 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-03T10:09:02.972 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-03T10:09:02.972 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-03T10:09:03.259 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-03T10:09:03.454 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/136 2023-10-03T10:09:03.651 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/136 2023-10-03T10:09:03.870 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/136 2023-10-03T10:09:03.870 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-03T10:09:04.129 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-03T10:09:04.158 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:09:04.346 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:09:04.346 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-03T10:09:04.571 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-03T10:09:04.571 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:09:04.787 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:09:04.787 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-03T10:09:04.987 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-03T10:09:05.202 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-03T10:09:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-03T10:09:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 1/136 2023-10-03T10:09:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2/136 2023-10-03T10:09:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 3/136 2023-10-03T10:09:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 4/136 2023-10-03T10:09:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 5/136 2023-10-03T10:09:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 6/136 2023-10-03T10:09:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 7/136 2023-10-03T10:09:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:09:05.768 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:09:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:09:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-03T10:09:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 12/136 2023-10-03T10:09:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:09:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 14/136 2023-10-03T10:09:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 15/136 2023-10-03T10:09:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 16/136 2023-10-03T10:09:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 17/136 2023-10-03T10:09:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 18/136 2023-10-03T10:09:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 19/136 2023-10-03T10:09:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 20/136 2023-10-03T10:09:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 21/136 2023-10-03T10:09:05.769 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 22/136 2023-10-03T10:09:05.770 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 23/136 2023-10-03T10:09:05.770 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 24/136 2023-10-03T10:09:05.770 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 25/136 2023-10-03T10:09:05.770 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 26/136 2023-10-03T10:09:05.770 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 27/136 2023-10-03T10:09:05.770 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 28/136 2023-10-03T10:09:05.770 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 29/136 2023-10-03T10:09:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 30/136 2023-10-03T10:09:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 31/136 2023-10-03T10:09:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 32/136 2023-10-03T10:09:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : bison-3.0.4-10.el8.x86_64 33/136 2023-10-03T10:09:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flex-2.6.1-9.el8.x86_64 34/136 2023-10-03T10:09:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : jq-1.6-7.el8.x86_64 35/136 2023-10-03T10:09:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 36/136 2023-10-03T10:09:05.779 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 37/136 2023-10-03T10:09:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 38/136 2023-10-03T10:09:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 39/136 2023-10-03T10:09:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 40/136 2023-10-03T10:09:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/136 2023-10-03T10:09:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/136 2023-10-03T10:09:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 43/136 2023-10-03T10:09:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 44/136 2023-10-03T10:09:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 45/136 2023-10-03T10:09:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 46/136 2023-10-03T10:09:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 47/136 2023-10-03T10:09:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/136 2023-10-03T10:09:05.780 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 49/136 2023-10-03T10:09:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 50/136 2023-10-03T10:09:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 51/136 2023-10-03T10:09:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 52/136 2023-10-03T10:09:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 53/136 2023-10-03T10:09:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 54/136 2023-10-03T10:09:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 55/136 2023-10-03T10:09:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 56/136 2023-10-03T10:09:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 57/136 2023-10-03T10:09:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/136 2023-10-03T10:09:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 59/136 2023-10-03T10:09:05.781 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 60/136 2023-10-03T10:09:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 61/136 2023-10-03T10:09:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 62/136 2023-10-03T10:09:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 63/136 2023-10-03T10:09:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 64/136 2023-10-03T10:09:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 65/136 2023-10-03T10:09:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 66/136 2023-10-03T10:09:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 67/136 2023-10-03T10:09:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 68/136 2023-10-03T10:09:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 69/136 2023-10-03T10:09:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 70/136 2023-10-03T10:09:05.782 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 71/136 2023-10-03T10:09:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 72/136 2023-10-03T10:09:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 73/136 2023-10-03T10:09:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/136 2023-10-03T10:09:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/136 2023-10-03T10:09:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/136 2023-10-03T10:09:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/136 2023-10-03T10:09:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 78/136 2023-10-03T10:09:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 79/136 2023-10-03T10:09:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : leveldb-1.22-1.el8.x86_64 80/136 2023-10-03T10:09:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 81/136 2023-10-03T10:09:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 82/136 2023-10-03T10:09:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/136 2023-10-03T10:09:05.783 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/136 2023-10-03T10:09:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 85/136 2023-10-03T10:09:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 86/136 2023-10-03T10:09:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 87/136 2023-10-03T10:09:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 88/136 2023-10-03T10:09:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 89/136 2023-10-03T10:09:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 90/136 2023-10-03T10:09:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 91/136 2023-10-03T10:09:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 92/136 2023-10-03T10:09:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 93/136 2023-10-03T10:09:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 94/136 2023-10-03T10:09:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 95/136 2023-10-03T10:09:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-portend-2.6-1.el8.noarch 96/136 2023-10-03T10:09:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 97/136 2023-10-03T10:09:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 98/136 2023-10-03T10:09:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 99/136 2023-10-03T10:09:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 100/136 2023-10-03T10:09:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 101/136 2023-10-03T10:09:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 102/136 2023-10-03T10:09:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 103/136 2023-10-03T10:09:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 104/136 2023-10-03T10:09:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 105/136 2023-10-03T10:09:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 106/136 2023-10-03T10:09:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 107/136 2023-10-03T10:09:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 108/136 2023-10-03T10:09:05.785 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-03T10:09:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 110/136 2023-10-03T10:09:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:09:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 112/136 2023-10-03T10:09:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 113/136 2023-10-03T10:09:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 114/136 2023-10-03T10:09:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 115/136 2023-10-03T10:09:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/136 2023-10-03T10:09:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 117/136 2023-10-03T10:09:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/136 2023-10-03T10:09:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 119/136 2023-10-03T10:09:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/136 2023-10-03T10:09:05.786 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 121/136 2023-10-03T10:09:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/136 2023-10-03T10:09:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 123/136 2023-10-03T10:09:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/136 2023-10-03T10:09:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 125/136 2023-10-03T10:09:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/136 2023-10-03T10:09:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 127/136 2023-10-03T10:09:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/136 2023-10-03T10:09:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 129/136 2023-10-03T10:09:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/136 2023-10-03T10:09:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 131/136 2023-10-03T10:09:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:09:05.787 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 133/136 2023-10-03T10:09:05.788 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:09:05.788 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 135/136 2023-10-03T10:09:07.736 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 136/136 2023-10-03T10:09:07.736 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:07.737 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2023-10-03T10:09:07.737 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-10-03T10:09:07.737 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-10-03T10:09:07.737 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-10-03T10:09:07.737 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-10-03T10:09:07.737 INFO:teuthology.orchestra.run.smithi153.stdout: iproute-6.2.0-5.el8.x86_64 2023-10-03T10:09:07.737 INFO:teuthology.orchestra.run.smithi153.stdout: libblkid-2.32.1-43.el8.x86_64 2023-10-03T10:09:07.737 INFO:teuthology.orchestra.run.smithi153.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-10-03T10:09:07.737 INFO:teuthology.orchestra.run.smithi153.stdout: libmount-2.32.1-43.el8.x86_64 2023-10-03T10:09:07.737 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi153.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-2.32.1-43.el8.x86_64 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-2.32.1-43.el8.x86_64 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi153.stdout: bison-3.0.4-10.el8.x86_64 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:07.739 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.739 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.739 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:07.739 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:07.739 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:07.739 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:07.739 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.739 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.739 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:07.739 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.739 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.740 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.740 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-10-03T10:09:07.740 INFO:teuthology.orchestra.run.smithi153.stdout: flex-2.6.1-9.el8.x86_64 2023-10-03T10:09:07.740 INFO:teuthology.orchestra.run.smithi153.stdout: fuse-2.9.7-17.el8.x86_64 2023-10-03T10:09:07.740 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-03T10:09:07.740 INFO:teuthology.orchestra.run.smithi153.stdout: jq-1.6-7.el8.x86_64 2023-10-03T10:09:07.740 INFO:teuthology.orchestra.run.smithi153.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-03T10:09:07.740 INFO:teuthology.orchestra.run.smithi153.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-10-03T10:09:07.741 INFO:teuthology.orchestra.run.smithi153.stdout: leveldb-1.22-1.el8.x86_64 2023-10-03T10:09:07.741 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.741 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.741 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.741 INFO:teuthology.orchestra.run.smithi153.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-10-03T10:09:07.741 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-10-03T10:09:07.741 INFO:teuthology.orchestra.run.smithi153.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-03T10:09:07.741 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-10-03T10:09:07.741 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-03T10:09:07.741 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.741 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.741 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-03T10:09:07.742 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.742 INFO:teuthology.orchestra.run.smithi153.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-10-03T10:09:07.742 INFO:teuthology.orchestra.run.smithi153.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-03T10:09:07.742 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-03T10:09:07.742 INFO:teuthology.orchestra.run.smithi153.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-10-03T10:09:07.742 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-10-03T10:09:07.742 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-03T10:09:07.742 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-03T10:09:07.742 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-03T10:09:07.742 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-03T10:09:07.742 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-10-03T10:09:07.742 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-10-03T10:09:07.743 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-10-03T10:09:07.743 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-10-03T10:09:07.743 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-03T10:09:07.743 INFO:teuthology.orchestra.run.smithi153.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-03T10:09:07.743 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-03T10:09:07.743 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.743 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.743 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.743 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-03T10:09:07.743 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-03T10:09:07.743 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-03T10:09:07.743 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-03T10:09:07.744 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-03T10:09:07.744 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-03T10:09:07.744 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-03T10:09:07.744 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-03T10:09:07.744 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-03T10:09:07.744 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-03T10:09:07.744 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-03T10:09:07.744 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-03T10:09:07.744 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-03T10:09:07.744 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-03T10:09:07.744 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-03T10:09:07.744 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-03T10:09:07.744 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-03T10:09:07.745 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-03T10:09:07.745 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-03T10:09:07.745 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-03T10:09:07.745 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend-2.6-1.el8.noarch 2023-10-03T10:09:07.745 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-03T10:09:07.745 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-03T10:09:07.745 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-03T10:09:07.745 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-03T10:09:07.745 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-03T10:09:07.745 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-03T10:09:07.745 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.745 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.746 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-03T10:09:07.746 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-03T10:09:07.746 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.746 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-03T10:09:07.746 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-03T10:09:07.746 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-03T10:09:07.746 INFO:teuthology.orchestra.run.smithi153.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-03T10:09:07.746 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-03T10:09:07.746 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-03T10:09:07.746 INFO:teuthology.orchestra.run.smithi153.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-03T10:09:07.746 INFO:teuthology.orchestra.run.smithi153.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-03T10:09:07.746 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-03T10:09:07.747 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-03T10:09:07.747 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-03T10:09:07.747 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-03T10:09:07.747 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-03T10:09:07.747 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.747 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.747 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.747 INFO:teuthology.orchestra.run.smithi153.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-03T10:09:07.747 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-03T10:09:07.748 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-10-03T10:09:07.748 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:07.748 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2023-10-03T10:09:07.929 DEBUG:teuthology.parallel:result is None 2023-10-03T10:09:07.930 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:09:07.930 INFO:teuthology.packaging:ref: None 2023-10-03T10:09:07.930 INFO:teuthology.packaging:tag: None 2023-10-03T10:09:07.930 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:09:07.930 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:09:07.930 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-03T10:09:08.252 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-03T10:09:08.281 INFO:teuthology.orchestra.run.smithi146.stdout:16.2.14-44.geeb13ac9.el8 2023-10-03T10:09:08.282 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-44.geeb13ac9.el8 2023-10-03T10:09:08.282 INFO:teuthology.task.install:The correct ceph version 16.2.14-44.geeb13ac9 is installed. 2023-10-03T10:09:08.282 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:09:08.282 INFO:teuthology.packaging:ref: None 2023-10-03T10:09:08.282 INFO:teuthology.packaging:tag: None 2023-10-03T10:09:08.282 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:09:08.282 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:09:08.283 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-03T10:09:08.512 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-03T10:09:08.535 INFO:teuthology.orchestra.run.smithi153.stdout:16.2.14-44.geeb13ac9.el8 2023-10-03T10:09:08.535 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-44.geeb13ac9.el8 2023-10-03T10:09:08.536 INFO:teuthology.task.install:The correct ceph version 16.2.14-44.geeb13ac9 is installed. 2023-10-03T10:09:08.536 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-03T10:09:08.536 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T10:09:08.536 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-03T10:09:08.574 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-03T10:09:08.574 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-03T10:09:08.609 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-03T10:09:08.609 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T10:09:08.609 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/daemon-helper 2023-10-03T10:09:08.645 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-03T10:09:08.714 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-03T10:09:08.714 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2023-10-03T10:09:08.742 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-03T10:09:08.810 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-03T10:09:08.811 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T10:09:08.811 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-03T10:09:08.839 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-03T10:09:08.907 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-03T10:09:08.907 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-03T10:09:08.934 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-03T10:09:09.001 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-03T10:09:09.001 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T10:09:09.002 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/stdin-killer 2023-10-03T10:09:09.030 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-03T10:09:09.097 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-03T10:09:09.097 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2023-10-03T10:09:09.125 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-03T10:09:09.191 INFO:teuthology.run_tasks:Running task print... 2023-10-03T10:09:09.203 INFO:teuthology.task.print:**** done installing pacific 2023-10-03T10:09:09.203 INFO:teuthology.run_tasks:Running task ceph... 2023-10-03T10:09:09.274 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-03T10:09:09.275 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 777 /var/log/ceph 2023-10-03T10:09:09.277 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /var/log/ceph 2023-10-03T10:09:09.304 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-03T10:09:09.304 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-03T10:09:09.344 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-03T10:09:09.371 INFO:tasks.ceph:Creating extra log directories... 2023-10-03T10:09:09.371 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-03T10:09:09.412 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-03T10:09:09.448 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-03T10:09:09.448 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-03T10:09:09.448 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409562', 'branch': 'fix-nfs-apply-err-reporting', 'description': 'fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/fsstress}}}', 'email': None, 'first_in_suite': False, 'job_id': '7409562', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'fix-nfs-apply-err-reporting'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-62953', 'sha1': 'a6297898cc696a7db13e71aaa0b24c78a4c800c5'}}, 'owner': 'scheduled_dparmar@teuthology', 'priority': 55, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0']], 'seed': 6051, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'sleep_before_teardown': 0, 'suite': 'fs:upgrade', 'suite_branch': 'wip-62953', 'suite_path': '/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/dparmar18/ceph', 'suite_sha1': 'a6297898cc696a7db13e71aaa0b24c78a4c800c5', 'targets': {'smithi146.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB+K7n2yj67VdGuozLM5Nf2IsIMW4wEjE0ejV7WP7FpYH4Qrs3NXcYTQW9OnZrK0MUbEKGyWLCiWLaQCkbszNM0=', 'smithi153.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKVmzuFyAzqWBzOUbLkKp8CcK0w64CBZjXQHqXJcmpJakqAy5zNTfpGQQIDBFlaIU3ty3UIENvK6OkneelN+AGc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'pacific', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}}, {'print': '**** done installing pacific'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'flavor': 'default', 'fs': 'xfs', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client pacific']}}, {'print': '**** done ceph'}, {'ceph-fuse': None}, {'mds_pre_upgrade': None}, {'print': '**** done mds pre-upgrade sequence'}, {'install.upgrade': {'mon.a': {'branch': 'reef'}}}, {'print': '**** done install.upgrade the host'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'ceph.stop': ['mds.*']}, {'ceph.restart': {'daemons': ['mds.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph osd dump -f json-pretty', 'ceph versions', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done', 'ceph osd require-osd-release reef']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}, {'ceph-fuse': {'client.0': {'mounted': False}}}, {'print': '**** done unmount client.0'}, {'install.upgrade': {'client.0': None}}, {'print': '**** done install.upgrade on client.0'}, {'ceph-fuse': {'client.0': None}}, {'print': '**** done remount client.0'}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'branch': 'pacific', 'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end", 'if not is_fuse() then reject() end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-03_09:48:43', 'tube': 'smithi', 'user': 'dparmar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-03T10:09:09.449 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-03T10:09:09.480 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-03T10:09:09.497 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/run/ceph 2023-10-03T10:09:09.538 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/run/ceph 2023-10-03T10:09:09.565 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T10:09:09.565 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/scratch_devs of=/dev/stdout 2023-10-03T10:09:09.620 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-03T10:09:09.620 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_1 2023-10-03T10:09:09.678 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-03T10:09:09.678 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T10:09:09.678 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 393303 Links: 1 2023-10-03T10:09:09.678 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T10:09:09.679 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2023-10-03T10:09:09.679 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-10-03 10:08:59.127843775 +0000 2023-10-03T10:09:09.679 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-10-03 10:05:51.118757028 +0000 2023-10-03T10:09:09.679 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-10-03 10:05:51.118757028 +0000 2023-10-03T10:09:09.679 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2023-10-03T10:09:09.679 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-03T10:09:09.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-03T10:09:09.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-03T10:09:09.744 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000231387 s, 2.2 MB/s 2023-10-03T10:09:09.745 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-03T10:09:09.804 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_2 2023-10-03T10:09:09.862 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-03T10:09:09.863 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T10:09:09.863 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 392799 Links: 1 2023-10-03T10:09:09.863 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T10:09:09.863 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2023-10-03T10:09:09.863 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-10-03 10:08:59.127843775 +0000 2023-10-03T10:09:09.863 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-10-03 10:05:51.619749087 +0000 2023-10-03T10:09:09.863 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-10-03 10:05:51.619749087 +0000 2023-10-03T10:09:09.863 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2023-10-03T10:09:09.863 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-03T10:09:09.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-03T10:09:09.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-03T10:09:09.928 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000211967 s, 2.4 MB/s 2023-10-03T10:09:09.929 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-03T10:09:09.988 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_3 2023-10-03T10:09:10.045 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-03T10:09:10.046 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T10:09:10.046 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 389996 Links: 1 2023-10-03T10:09:10.046 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T10:09:10.046 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2023-10-03T10:09:10.046 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-10-03 10:08:59.127843775 +0000 2023-10-03T10:09:10.046 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-10-03 10:05:52.113741257 +0000 2023-10-03T10:09:10.046 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-10-03 10:05:52.113741257 +0000 2023-10-03T10:09:10.046 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2023-10-03T10:09:10.046 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-03T10:09:10.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-03T10:09:10.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-03T10:09:10.111 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000193529 s, 2.6 MB/s 2023-10-03T10:09:10.112 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-03T10:09:10.171 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_4 2023-10-03T10:09:10.229 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-03T10:09:10.229 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T10:09:10.229 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 390123 Links: 1 2023-10-03T10:09:10.229 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T10:09:10.229 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2023-10-03T10:09:10.229 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-10-03 10:08:59.127843775 +0000 2023-10-03T10:09:10.229 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-10-03 10:05:52.628733095 +0000 2023-10-03T10:09:10.229 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-10-03 10:05:52.628733095 +0000 2023-10-03T10:09:10.229 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2023-10-03T10:09:10.229 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-03T10:09:10.293 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-03T10:09:10.294 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-03T10:09:10.294 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000231311 s, 2.2 MB/s 2023-10-03T10:09:10.294 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-03T10:09:10.353 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:09:10.353 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2023-10-03T10:09:10.353 INFO:tasks.ceph:Generating config... 2023-10-03T10:09:10.354 INFO:tasks.ceph:[global] mon warn on pool no app = False 2023-10-03T10:09:10.354 INFO:tasks.ceph:[global] ms bind msgr2 = False 2023-10-03T10:09:10.354 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2023-10-03T10:09:10.354 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2023-10-03T10:09:10.354 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-10-03T10:09:10.354 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-03T10:09:10.355 INFO:tasks.ceph:[client] debug client = 20 2023-10-03T10:09:10.355 INFO:tasks.ceph:[client] debug ms = 1 2023-10-03T10:09:10.355 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-03T10:09:10.355 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-03T10:09:10.355 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-03T10:09:10.355 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-03T10:09:10.355 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-03T10:09:10.355 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-03T10:09:10.355 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-03T10:09:10.355 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-03T10:09:10.355 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-03T10:09:10.355 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-03T10:09:10.355 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-03T10:09:10.356 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-03T10:09:10.356 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-03T10:09:10.356 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-03T10:09:10.356 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-03T10:09:10.356 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-03T10:09:10.356 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-03T10:09:10.356 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-03T10:09:10.356 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2023-10-03T10:09:10.356 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-03T10:09:10.356 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-03T10:09:10.356 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-03T10:09:10.356 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-03T10:09:10.356 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-03T10:09:10.356 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-03T10:09:10.357 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-03T10:09:10.357 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-03T10:09:10.357 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-03T10:09:10.357 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-03T10:09:10.357 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-03T10:09:10.357 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-03T10:09:10.357 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-03T10:09:10.357 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-03T10:09:10.357 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-03T10:09:10.357 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-03T10:09:10.357 INFO:tasks.ceph:Setting up mon.a... 2023-10-03T10:09:10.358 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-03T10:09:10.526 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.keyring 2023-10-03T10:09:10.528 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-03T10:09:10.568 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-03T10:09:10.635 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.146'), ('mon.b', '[v2:172.21.15.146:3301,v1:172.21.15.146:6790]'), ('mon.c', '[v2:172.21.15.146:3302,v1:172.21.15.146:6791]')] 2023-10-03T10:09:10.635 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.146,[v2:172.21.15.146:3301,v1:172.21.15.146:6790],[v2:172.21.15.146:3302,v1:172.21.15.146:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-03T10:09:10.636 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T10:09:10.636 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-03T10:09:10.693 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.146 --addv b '[v2:172.21.15.146:3301,v1:172.21.15.146:6790]' --addv c '[v2:172.21.15.146:3302,v1:172.21.15.146:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:10.777 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:10.777 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: generated fsid 5440411f-9bdd-4ef1-85ef-960d00aa215c 2023-10-03T10:09:10.777 INFO:teuthology.orchestra.run.smithi146.stdout:epoch 0 2023-10-03T10:09:10.777 INFO:teuthology.orchestra.run.smithi146.stdout:fsid 5440411f-9bdd-4ef1-85ef-960d00aa215c 2023-10-03T10:09:10.778 INFO:teuthology.orchestra.run.smithi146.stdout:last_changed 2023-10-03T10:09:10.778450+0000 2023-10-03T10:09:10.778 INFO:teuthology.orchestra.run.smithi146.stdout:created 2023-10-03T10:09:10.778450+0000 2023-10-03T10:09:10.778 INFO:teuthology.orchestra.run.smithi146.stdout:min_mon_release 0 (unknown) 2023-10-03T10:09:10.778 INFO:teuthology.orchestra.run.smithi146.stdout:election_strategy: 1 2023-10-03T10:09:10.778 INFO:teuthology.orchestra.run.smithi146.stdout:0: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.a 2023-10-03T10:09:10.778 INFO:teuthology.orchestra.run.smithi146.stdout:1: [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] mon.b 2023-10-03T10:09:10.778 INFO:teuthology.orchestra.run.smithi146.stdout:2: [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] mon.c 2023-10-03T10:09:10.778 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-03T10:09:10.779 DEBUG:teuthology.orchestra.run.smithi146:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-03T10:09:10.796 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5440411f-9bdd-4ef1-85ef-960d00aa215c... 2023-10-03T10:09:10.797 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-03T10:09:10.838 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-03T10:09:10.881 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2023-10-03T10:09:10.881 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2023-10-03T10:09:10.881 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-03T10:09:10.881 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2023-10-03T10:09:10.881 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.881 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2023-10-03T10:09:10.882 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.882 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2023-10-03T10:09:10.882 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.882 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2023-10-03T10:09:10.882 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2023-10-03T10:09:10.882 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.882 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2023-10-03T10:09:10.882 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2023-10-03T10:09:10.882 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.882 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-03T10:09:10.882 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2023-10-03T10:09:10.882 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.883 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2023-10-03T10:09:10.883 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-03T10:09:10.883 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.883 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2023-10-03T10:09:10.883 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.883 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2023-10-03T10:09:10.883 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2023-10-03T10:09:10.883 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2023-10-03T10:09:10.883 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2023-10-03T10:09:10.883 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2023-10-03T10:09:10.883 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2023-10-03T10:09:10.883 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2023-10-03T10:09:10.884 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-03T10:09:10.884 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-03T10:09:10.884 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2023-10-03T10:09:10.884 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.884 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-03T10:09:10.884 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.884 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2023-10-03T10:09:10.884 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.884 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2023-10-03T10:09:10.884 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.884 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2023-10-03T10:09:10.884 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2023-10-03T10:09:10.885 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2023-10-03T10:09:10.885 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.146,[v2:172.21.15.146:3301,v1:172.21.15.146:6790],[v2:172.21.15.146:3302,v1:172.21.15.146:6791]" 2023-10-03T10:09:10.885 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on pool no app = False 2023-10-03T10:09:10.885 INFO:teuthology.orchestra.run.smithi146.stdout: ms bind msgr2 = False 2023-10-03T10:09:10.885 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore warn on legacy statfs = False 2023-10-03T10:09:10.885 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore warn on no per pool omap = False 2023-10-03T10:09:10.885 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn min per osd = 0 2023-10-03T10:09:10.885 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = 5440411f-9bdd-4ef1-85ef-960d00aa215c 2023-10-03T10:09:10.885 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.885 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2023-10-03T10:09:10.885 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2023-10-03T10:09:10.885 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.885 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2023-10-03T10:09:10.886 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2023-10-03T10:09:10.886 INFO:teuthology.orchestra.run.smithi146.stdout: osd mclock profile = high_recovery_ops 2023-10-03T10:09:10.886 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.886 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2023-10-03T10:09:10.886 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2023-10-03T10:09:10.886 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.886 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2023-10-03T10:09:10.886 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2023-10-03T10:09:10.886 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2023-10-03T10:09:10.886 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.886 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2023-10-03T10:09:10.887 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2023-10-03T10:09:10.887 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.887 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2023-10-03T10:09:10.887 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.887 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2023-10-03T10:09:10.887 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.887 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2023-10-03T10:09:10.887 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.887 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2023-10-03T10:09:10.887 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2023-10-03T10:09:10.887 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.887 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2023-10-03T10:09:10.888 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2023-10-03T10:09:10.888 INFO:teuthology.orchestra.run.smithi146.stdout: bdev async discard = True 2023-10-03T10:09:10.888 INFO:teuthology.orchestra.run.smithi146.stdout: bdev enable discard = True 2023-10-03T10:09:10.888 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore allocator = bitmap 2023-10-03T10:09:10.888 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2023-10-03T10:09:10.888 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2023-10-03T10:09:10.888 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 1/20 2023-10-03T10:09:10.888 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 1/20 2023-10-03T10:09:10.888 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-03T10:09:10.888 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2023-10-03T10:09:10.888 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 4/10 2023-10-03T10:09:10.888 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2023-10-03T10:09:10.888 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2023-10-03T10:09:10.889 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2023-10-03T10:09:10.889 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2023-10-03T10:09:10.889 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2023-10-03T10:09:10.889 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2023-10-03T10:09:10.889 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.889 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2023-10-03T10:09:10.889 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-03T10:09:10.889 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2023-10-03T10:09:10.889 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-10-03T10:09:10.889 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-10-03T10:09:10.889 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-10-03T10:09:10.889 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-10-03T10:09:10.889 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2023-10-03T10:09:10.890 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.890 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2023-10-03T10:09:10.890 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-03T10:09:10.890 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-10-03T10:09:10.890 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2023-10-03T10:09:10.890 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-10-03T10:09:10.890 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2023-10-03T10:09:10.890 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2023-10-03T10:09:10.890 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-10-03T10:09:10.890 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2023-10-03T10:09:10.890 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2023-10-03T10:09:10.891 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-10-03T10:09:10.891 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.891 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-03T10:09:10.891 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2023-10-03T10:09:10.891 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2023-10-03T10:09:10.891 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.891 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2023-10-03T10:09:10.891 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-03T10:09:10.891 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-03T10:09:10.891 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.891 INFO:teuthology.orchestra.run.smithi146.stdout: # 1m isn't quite enough 2023-10-03T10:09:10.891 INFO:teuthology.orchestra.run.smithi146.stdout: mon_down_mkfs_grace = 2m 2023-10-03T10:09:10.892 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.892 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_filestore_osds = false 2023-10-03T10:09:10.892 INFO:teuthology.orchestra.run.smithi146.stdout: mon op complaint time = 120 2023-10-03T10:09:10.892 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = False 2023-10-03T10:09:10.892 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:10.892 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2023-10-03T10:09:10.892 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2023-10-03T10:09:10.892 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2023-10-03T10:09:10.892 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2023-10-03T10:09:10.892 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-03T10:09:10.892 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-03T10:09:10.892 INFO:teuthology.orchestra.run.smithi146.stdout: client mount timeout = 600 2023-10-03T10:09:10.892 INFO:teuthology.orchestra.run.smithi146.stdout: debug client = 20 2023-10-03T10:09:10.893 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-03T10:09:10.893 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2023-10-03T10:09:10.893 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2023-10-03T10:09:10.893 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2023-10-03T10:09:10.893 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2023-10-03T10:09:10.893 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2023-10-03T10:09:10.893 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2023-10-03T10:09:10.893 INFO:teuthology.orchestra.run.smithi146.stdout:[mds] 2023-10-03T10:09:10.893 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds = 20 2023-10-03T10:09:10.893 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds balancer = 20 2023-10-03T10:09:10.893 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-03T10:09:10.893 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug frag = True 2023-10-03T10:09:10.893 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug scatterstat = True 2023-10-03T10:09:10.894 INFO:teuthology.orchestra.run.smithi146.stdout: mds op complaint time = 180 2023-10-03T10:09:10.894 INFO:teuthology.orchestra.run.smithi146.stdout: mds verify scatter = True 2023-10-03T10:09:10.894 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2023-10-03T10:09:10.894 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2023-10-03T10:09:10.894 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2023-10-03T10:09:10.894 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2023-10-03T10:09:10.894 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2023-10-03T10:09:10.895 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-03T10:09:10.895 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2023-10-03T10:09:10.895 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.895 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2023-10-03T10:09:10.895 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.895 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2023-10-03T10:09:10.895 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.895 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2023-10-03T10:09:10.895 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2023-10-03T10:09:10.895 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.895 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2023-10-03T10:09:10.895 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2023-10-03T10:09:10.896 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.896 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-03T10:09:10.896 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2023-10-03T10:09:10.896 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.896 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2023-10-03T10:09:10.896 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-03T10:09:10.896 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.896 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2023-10-03T10:09:10.896 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.896 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2023-10-03T10:09:10.896 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2023-10-03T10:09:10.896 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2023-10-03T10:09:10.896 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2023-10-03T10:09:10.897 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2023-10-03T10:09:10.897 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2023-10-03T10:09:10.897 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2023-10-03T10:09:10.897 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-03T10:09:10.897 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-03T10:09:10.897 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2023-10-03T10:09:10.897 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.897 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-03T10:09:10.897 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.897 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2023-10-03T10:09:10.897 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.897 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2023-10-03T10:09:10.898 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.898 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2023-10-03T10:09:10.898 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2023-10-03T10:09:10.898 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2023-10-03T10:09:10.898 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.146,[v2:172.21.15.146:3301,v1:172.21.15.146:6790],[v2:172.21.15.146:3302,v1:172.21.15.146:6791]" 2023-10-03T10:09:10.898 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on pool no app = False 2023-10-03T10:09:10.898 INFO:teuthology.orchestra.run.smithi153.stdout: ms bind msgr2 = False 2023-10-03T10:09:10.898 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore warn on legacy statfs = False 2023-10-03T10:09:10.898 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore warn on no per pool omap = False 2023-10-03T10:09:10.898 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn min per osd = 0 2023-10-03T10:09:10.898 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = 5440411f-9bdd-4ef1-85ef-960d00aa215c 2023-10-03T10:09:10.899 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.899 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2023-10-03T10:09:10.899 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2023-10-03T10:09:10.899 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.899 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2023-10-03T10:09:10.899 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2023-10-03T10:09:10.899 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2023-10-03T10:09:10.899 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.899 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2023-10-03T10:09:10.899 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2023-10-03T10:09:10.899 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.899 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2023-10-03T10:09:10.899 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2023-10-03T10:09:10.900 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2023-10-03T10:09:10.900 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.900 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2023-10-03T10:09:10.900 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2023-10-03T10:09:10.900 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.900 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2023-10-03T10:09:10.900 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.900 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2023-10-03T10:09:10.900 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.900 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2023-10-03T10:09:10.900 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.900 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2023-10-03T10:09:10.900 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2023-10-03T10:09:10.901 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.901 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2023-10-03T10:09:10.901 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2023-10-03T10:09:10.901 INFO:teuthology.orchestra.run.smithi153.stdout: bdev async discard = True 2023-10-03T10:09:10.901 INFO:teuthology.orchestra.run.smithi153.stdout: bdev enable discard = True 2023-10-03T10:09:10.901 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore allocator = bitmap 2023-10-03T10:09:10.901 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2023-10-03T10:09:10.901 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2023-10-03T10:09:10.901 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 1/20 2023-10-03T10:09:10.901 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 1/20 2023-10-03T10:09:10.901 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-10-03T10:09:10.901 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2023-10-03T10:09:10.901 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 4/10 2023-10-03T10:09:10.902 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2023-10-03T10:09:10.902 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2023-10-03T10:09:10.902 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2023-10-03T10:09:10.902 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2023-10-03T10:09:10.902 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2023-10-03T10:09:10.902 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2023-10-03T10:09:10.902 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.902 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2023-10-03T10:09:10.902 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-10-03T10:09:10.902 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2023-10-03T10:09:10.902 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2023-10-03T10:09:10.903 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2023-10-03T10:09:10.903 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2023-10-03T10:09:10.903 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2023-10-03T10:09:10.903 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2023-10-03T10:09:10.903 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.903 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2023-10-03T10:09:10.903 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-10-03T10:09:10.903 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2023-10-03T10:09:10.903 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2023-10-03T10:09:10.903 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2023-10-03T10:09:10.903 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2023-10-03T10:09:10.903 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2023-10-03T10:09:10.904 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2023-10-03T10:09:10.904 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2023-10-03T10:09:10.904 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2023-10-03T10:09:10.904 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2023-10-03T10:09:10.904 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.904 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-03T10:09:10.904 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2023-10-03T10:09:10.904 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2023-10-03T10:09:10.904 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.904 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2023-10-03T10:09:10.904 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-03T10:09:10.904 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-03T10:09:10.905 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.905 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2023-10-03T10:09:10.905 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2023-10-03T10:09:10.905 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.905 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2023-10-03T10:09:10.905 INFO:teuthology.orchestra.run.smithi153.stdout: mon op complaint time = 120 2023-10-03T10:09:10.905 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = False 2023-10-03T10:09:10.905 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-10-03T10:09:10.905 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2023-10-03T10:09:10.905 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2023-10-03T10:09:10.905 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2023-10-03T10:09:10.905 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2023-10-03T10:09:10.905 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-03T10:09:10.906 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-03T10:09:10.906 INFO:teuthology.orchestra.run.smithi153.stdout: client mount timeout = 600 2023-10-03T10:09:10.906 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2023-10-03T10:09:10.906 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-10-03T10:09:10.906 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2023-10-03T10:09:10.906 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2023-10-03T10:09:10.906 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2023-10-03T10:09:10.906 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2023-10-03T10:09:10.906 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2023-10-03T10:09:10.906 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2023-10-03T10:09:10.906 INFO:teuthology.orchestra.run.smithi153.stdout:[mds] 2023-10-03T10:09:10.907 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds = 20 2023-10-03T10:09:10.907 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds balancer = 20 2023-10-03T10:09:10.907 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-10-03T10:09:10.907 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug frag = True 2023-10-03T10:09:10.907 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug scatterstat = True 2023-10-03T10:09:10.907 INFO:teuthology.orchestra.run.smithi153.stdout: mds op complaint time = 180 2023-10-03T10:09:10.907 INFO:teuthology.orchestra.run.smithi153.stdout: mds verify scatter = True 2023-10-03T10:09:10.907 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2023-10-03T10:09:10.907 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2023-10-03T10:09:10.907 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2023-10-03T10:09:10.908 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-03T10:09:10.909 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-03T10:09:11.001 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-03T10:09:11.001 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T10:09:11.002 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-03T10:09:11.019 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T10:09:11.019 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-03T10:09:11.077 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T10:09:11.077 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T10:09:11.077 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-03T10:09:11.078 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-03T10:09:11.154 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T10:09:11.154 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:11.212 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi153.front.sepia.ceph.com 2023-10-03T10:09:11.212 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-03T10:09:11.212 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-03T10:09:11.212 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-03T10:09:11.254 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-03T10:09:11.255 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:11.314 INFO:tasks.ceph:Setting up mon nodes... 2023-10-03T10:09:11.315 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-03T10:09:11.315 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-03T10:09:11.364 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-03T10:09:11.367 INFO:tasks.ceph:Setting up mds nodes... 2023-10-03T10:09:11.367 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T10:09:11.416 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T10:09:11.418 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-03T10:09:11.444 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-03T10:09:11.444 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-03T10:09:11.549 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-03T10:09:11.562 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-03T10:09:11.562 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2023-10-03T10:09:11.563 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-03T10:09:11.589 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:09:11.589 INFO:tasks.ceph:role: osd.0 2023-10-03T10:09:11.589 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T10:09:11.589 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-03T10:09:11.664 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T10:09:11.664 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T10:09:11.664 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T10:09:11.664 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T10:09:11.664 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T10:09:11.664 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-10-03T10:09:11.664 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T10:09:11.664 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T10:09:11.664 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T10:09:11.665 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T10:09:12.098 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-10-03T10:09:12.100 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-10-03T10:09:12.100 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-03T10:09:12.264 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-03T10:09:12.299 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-03T10:09:12.367 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:09:12.367 INFO:tasks.ceph:role: osd.1 2023-10-03T10:09:12.367 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T10:09:12.367 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-03T10:09:12.442 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T10:09:12.443 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T10:09:12.443 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T10:09:12.443 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T10:09:12.443 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T10:09:12.443 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-10-03T10:09:12.443 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T10:09:12.444 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T10:09:12.444 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T10:09:12.444 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T10:09:12.871 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-10-03T10:09:12.873 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-10-03T10:09:12.874 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-03T10:09:12.991 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-03T10:09:13.024 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-03T10:09:13.092 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:09:13.093 INFO:tasks.ceph:role: osd.2 2023-10-03T10:09:13.093 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T10:09:13.093 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-03T10:09:13.168 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T10:09:13.168 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T10:09:13.168 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T10:09:13.168 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T10:09:13.168 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T10:09:13.169 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-10-03T10:09:13.169 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T10:09:13.169 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T10:09:13.169 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T10:09:13.169 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T10:09:13.615 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-10-03T10:09:13.616 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-10-03T10:09:13.617 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-03T10:09:13.787 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-03T10:09:13.822 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-03T10:09:13.891 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:09:13.891 INFO:tasks.ceph:role: osd.3 2023-10-03T10:09:13.891 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T10:09:13.891 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-03T10:09:13.967 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T10:09:13.967 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T10:09:13.967 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T10:09:13.967 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T10:09:13.967 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T10:09:13.968 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-10-03T10:09:13.968 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T10:09:13.968 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T10:09:13.968 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T10:09:13.968 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T10:09:14.410 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-10-03T10:09:14.412 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-10-03T10:09:14.412 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-03T10:09:14.568 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-03T10:09:14.602 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:14.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:14.697+0000 7f3c4c529200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-03T10:09:14.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:14.697+0000 7f3c4c529200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-03T10:09:14.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:14.698+0000 7f3c4c529200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-03T10:09:14.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:14.698+0000 7f3c4c529200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-03T10:09:14.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:14.698+0000 7f3c4c529200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-03T10:09:14.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:14.698+0000 7f3c4c529200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-03T10:09:17.542 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-03T10:09:17.571 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:17.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:17.655+0000 7fb875740200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-03T10:09:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:17.655+0000 7fb875740200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-03T10:09:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:17.655+0000 7fb875740200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-03T10:09:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:17.655+0000 7fb875740200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-03T10:09:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:17.655+0000 7fb875740200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-03T10:09:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:17.655+0000 7fb875740200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-03T10:09:20.507 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-03T10:09:20.539 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:20.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:20.626+0000 7fcfde6b3200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-03T10:09:20.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:20.627+0000 7fcfde6b3200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-03T10:09:20.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:20.627+0000 7fcfde6b3200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-03T10:09:20.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:20.627+0000 7fcfde6b3200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-03T10:09:20.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:20.627+0000 7fcfde6b3200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-03T10:09:20.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:20.627+0000 7fcfde6b3200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-03T10:09:23.470 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-03T10:09:23.501 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:23.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:23.586+0000 7f806c1e6200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-03T10:09:23.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:23.587+0000 7f806c1e6200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-03T10:09:23.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:23.587+0000 7f806c1e6200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-03T10:09:23.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:23.587+0000 7f806c1e6200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-03T10:09:23.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:23.587+0000 7f806c1e6200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-03T10:09:23.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:23.587+0000 7f806c1e6200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-03T10:09:26.429 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-03T10:09:26.461 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-03T10:09:26.461 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T10:09:26.461 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-03T10:09:26.532 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T10:09:26.533 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-03T10:09:26.602 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T10:09:26.602 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-03T10:09:26.670 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T10:09:26.670 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-03T10:09:26.739 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T10:09:26.739 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-03T10:09:26.810 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T10:09:26.810 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-03T10:09:26.878 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-03T10:09:26.878 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-03T10:09:26.901 INFO:tasks.ceph:Adding keys to all mons... 2023-10-03T10:09:26.901 DEBUG:teuthology.orchestra.run.smithi146:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-03T10:09:26.945 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.x] 2023-10-03T10:09:26.945 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBH6BtlMMDMFRAALu/WuOh+6KIRaeLdCajK2w== 2023-10-03T10:09:26.945 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2023-10-03T10:09:26.945 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBH6BtldaLYGBAARbPtKLuRc7i44KWTsGXLBQ== 2023-10-03T10:09:26.945 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.0] 2023-10-03T10:09:26.945 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBK6Btlf0GsKRAAzCfZoMPmYU29sCaXQ4WkGg== 2023-10-03T10:09:26.946 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.1] 2023-10-03T10:09:26.946 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBN6BtlRNUiJxAAwO7xkct/BHngEVFTG5eMZQ== 2023-10-03T10:09:26.946 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.2] 2023-10-03T10:09:26.946 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBQ6Btl6GNxJRAAUSky1Lgo4dOa8auLD+yuEw== 2023-10-03T10:09:26.946 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.3] 2023-10-03T10:09:26.946 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBT6BtlF5QRIxAAvNR4a2cfw+HPEaLi1UZyGw== 2023-10-03T10:09:26.946 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2023-10-03T10:09:26.946 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBH6Btlfl/OIBAAGQwK8Y9144R+D1bC5SWwCw== 2023-10-03T10:09:26.947 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-03T10:09:27.036 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-03T10:09:27.087 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T10:09:27.136 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T10:09:27.185 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T10:09:27.234 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T10:09:27.282 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-03T10:09:27.333 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-03T10:09:27.333 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-03T10:09:27.359 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-03T10:09:27.452 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-03T10:09:27.479 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-03T10:09:27.547 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-03T10:09:27.639 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-03T10:09:27.667 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-03T10:09:27.733 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-03T10:09:27.827 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-03T10:09:27.854 DEBUG:teuthology.orchestra.run.smithi146:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:27.912 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-03T10:09:27.912 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-03T10:09:27.912 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-03T10:09:27.955 INFO:tasks.ceph.mon.a:Started 2023-10-03T10:09:27.955 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-03T10:09:27.955 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-03T10:09:27.957 INFO:tasks.ceph.mon.b:Started 2023-10-03T10:09:27.957 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-03T10:09:27.958 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-03T10:09:27.959 INFO:tasks.ceph.mon.c:Started 2023-10-03T10:09:27.959 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-03T10:09:27.960 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-03T10:09:27.960 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-03T10:09:27.962 INFO:tasks.ceph.mgr.x:Started 2023-10-03T10:09:27.962 INFO:tasks.ceph:Setting crush tunables to default 2023-10-03T10:09:27.962 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd crush tunables default 2023-10-03T10:09:28.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.100+0000 7f81ea243700 1 Processor -- start 2023-10-03T10:09:28.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.100+0000 7f81ea243700 1 -- start start 2023-10-03T10:09:28.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.101+0000 7f81ea243700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81e4095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:28.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.101+0000 7f81ea243700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 0x7f81e4096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:28.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.101+0000 7f81ea243700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e4094ba0 con 0x7f81e412c240 2023-10-03T10:09:28.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.101+0000 7f81ea243700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e4092e90 con 0x7f81e4095c50 2023-10-03T10:09:28.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.101+0000 7f81ea243700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81e4096b60 con 0x7f81e4093950 2023-10-03T10:09:28.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.101+0000 7f81e37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81e4095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.101+0000 7f81e3fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f81e412c240 0x7f81e412e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33708/0 (socket says 172.21.15.146:33708) 2023-10-03T10:09:28.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.101+0000 7f81e3fff700 1 -- 172.21.15.146:0/3271488764 learned_addr learned my addr 172.21.15.146:0/3271488764 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:09:28.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.101+0000 7f81e2ffd700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 0x7f81e4096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.101+0000 7f81e37fe700 1 -- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 msgr2=0x7f81e4095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:09:28.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.101+0000 7f81e37fe700 1 -- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 msgr2=0x7f81e4095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:28.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.101+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81e4095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:28.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.101+0000 7f81e2ffd700 1 -- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 msgr2=0x7f81e4096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:09:28.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.101+0000 7f81e2ffd700 1 -- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 msgr2=0x7f81e4096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:28.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.101+0000 7f81e2ffd700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 0x7f81e4096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:28.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.101+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81e4095760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:09:28.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.101+0000 7f81e2ffd700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 0x7f81e4096030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:09:28.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.303+0000 7f81e2ffd700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 0x7f81e4096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.303+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81e4095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.303+0000 7f81e2ffd700 1 -- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 msgr2=0x7f81e4096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:09:28.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.303+0000 7f81e2ffd700 1 -- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 msgr2=0x7f81e4096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:28.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.303+0000 7f81e2ffd700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 0x7f81e4096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:28.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.303+0000 7f81e37fe700 1 -- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 msgr2=0x7f81e4095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:09:28.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.303+0000 7f81e37fe700 1 -- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 msgr2=0x7f81e4095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:28.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.303+0000 7f81e2ffd700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 0x7f81e4096030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-10-03T10:09:28.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.303+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81e4095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:28.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.303+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81e4095760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-10-03T10:09:28.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.704+0000 7f81e2ffd700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 0x7f81e4096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.704+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81e4095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:28.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.704+0000 7f81e2ffd700 1 -- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 msgr2=0x7f81e4096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:09:28.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.704+0000 7f81e2ffd700 1 -- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 msgr2=0x7f81e4096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:28.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.704+0000 7f81e2ffd700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 0x7f81e4096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:28.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.704+0000 7f81e37fe700 1 -- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 msgr2=0x7f81e4095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:09:28.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.704+0000 7f81e37fe700 1 -- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 msgr2=0x7f81e4095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:28.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.704+0000 7f81e2ffd700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 0x7f81e4096030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-10-03T10:09:28.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.704+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81e4095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:28.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:28.704+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81e4095760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-10-03T10:09:29.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:29.505+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81e4095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:29.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:29.505+0000 7f81e2ffd700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 0x7f81e4096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:29.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:29.505+0000 7f81e37fe700 1 -- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 msgr2=0x7f81e4095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:09:29.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:29.505+0000 7f81e37fe700 1 -- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 msgr2=0x7f81e4095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:29.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:29.505+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81e4095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:29.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:29.505+0000 7f81e2ffd700 1 -- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 msgr2=0x7f81e4096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:09:29.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:29.505+0000 7f81e2ffd700 1 -- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 msgr2=0x7f81e4096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:29.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:29.505+0000 7f81e2ffd700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 0x7f81e4096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:29.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:29.505+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81e4095760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-10-03T10:09:29.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:29.505+0000 7f81e2ffd700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 0x7f81e4096030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-10-03T10:09:31.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:31.102+0000 7f81e17fa700 1 -- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 msgr2=0x7f81e4095760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:09:31.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:31.102+0000 7f81e17fa700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81e4095760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:31.102+0000 7f81e17fa700 1 -- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 msgr2=0x7f81e4096030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:09:31.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:31.102+0000 7f81e17fa700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 0x7f81e4096030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:31.102+0000 7f81e17fa700 1 -- 172.21.15.146:0/3271488764 >> v1:172.21.15.146:6789/0 conn(0x7f81e412c240 legacy=0x7f81e412e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:31.102+0000 7f81e17fa700 1 --2- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 0x7f81d0005a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:31.102+0000 7f81e17fa700 1 -- 172.21.15.146:0/3271488764 --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e4092e90 con 0x7f81d0003580 2023-10-03T10:09:31.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:31.102+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 0x7f81d0005a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:31.102+0000 7f81e37fe700 1 -- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 msgr2=0x7f81d0005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:09:31.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:31.102+0000 7f81e37fe700 1 -- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 msgr2=0x7f81d0005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:31.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:31.102+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 0x7f81d0005a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:31.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:31.102+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 0x7f81d0005a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:09:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:31.303+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 0x7f81d0005a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:31.303+0000 7f81e37fe700 1 -- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 msgr2=0x7f81d0005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:09:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:31.303+0000 7f81e37fe700 1 -- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 msgr2=0x7f81d0005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:31.303+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 0x7f81d0005a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:31.303+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 0x7f81d0005a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-10-03T10:09:31.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:31.704+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 0x7f81d0005a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:31.704+0000 7f81e37fe700 1 -- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 msgr2=0x7f81d0005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:09:31.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:31.704+0000 7f81e37fe700 1 -- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 msgr2=0x7f81d0005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:31.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:31.704+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 0x7f81d0005a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:31.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:31.704+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 0x7f81d0005a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-10-03T10:09:32.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:32.505+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 0x7f81d0005a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:32.505+0000 7f81e37fe700 1 -- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 msgr2=0x7f81d0005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:09:32.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:32.505+0000 7f81e37fe700 1 -- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 msgr2=0x7f81d0005a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:32.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:32.505+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 0x7f81d0005a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:32.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:32.505+0000 7f81e37fe700 1 --2- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 0x7f81d0005a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-10-03T10:09:34.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.102+0000 7f81e17fa700 1 -- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 msgr2=0x7f81d0005a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:09:34.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.102+0000 7f81e17fa700 1 --2- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 0x7f81d0005a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.102+0000 7f81e17fa700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81d000b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:34.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.102+0000 7f81e17fa700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 0x7f81d000df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:34.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.102+0000 7f81e17fa700 1 -- 172.21.15.146:0/3271488764 --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e4093150 con 0x7f81e412c240 2023-10-03T10:09:34.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.102+0000 7f81e17fa700 1 -- 172.21.15.146:0/3271488764 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e4092e90 con 0x7f81e4095c50 2023-10-03T10:09:34.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.102+0000 7f81e17fa700 1 -- 172.21.15.146:0/3271488764 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81e4096b60 con 0x7f81e4093950 2023-10-03T10:09:34.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.103+0000 7f81e3fff700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 0x7f81d000df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:34.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.103+0000 7f81e2ffd700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81d000b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:34.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.103+0000 7f81e3fff700 1 -- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 msgr2=0x7f81d000b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:34.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.103+0000 7f81e3fff700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81d000b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.103+0000 7f81e27fc700 1 -- 172.21.15.146:0/3271488764 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436825372 0 0) 0x7f81e4093150 con 0x7f81e412c240 2023-10-03T10:09:34.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.103+0000 7f81e3fff700 1 -- 172.21.15.146:0/3271488764 >> v1:172.21.15.146:6789/0 conn(0x7f81e412c240 legacy=0x7f81d0008240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:34.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.103+0000 7f81e3fff700 1 -- 172.21.15.146:0/3271488764 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d000f4a0 con 0x7f81e4095c50 2023-10-03T10:09:34.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.103+0000 7f81e2ffd700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81d000b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:34.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.103+0000 7f81e3fff700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 0x7f81d000df30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f81dc001c40 tx=0x7f81dc0016f0).ready entity=mon.1 client_cookie=f80c09315c32cd61 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:34.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.103+0000 7f81e27fc700 1 -- 172.21.15.146:0/3271488764 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc005d30 con 0x7f81e4095c50 2023-10-03T10:09:34.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.103+0000 7f81e27fc700 1 -- 172.21.15.146:0/3271488764 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81dc005e90 con 0x7f81e4095c50 2023-10-03T10:09:34.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.103+0000 7f81e27fc700 1 -- 172.21.15.146:0/3271488764 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc00c860 con 0x7f81e4095c50 2023-10-03T10:09:34.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.104+0000 7f81ea243700 1 -- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 msgr2=0x7f81d000df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:34.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.104+0000 7f81ea243700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 0x7f81d000df30 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f81dc001c40 tx=0x7f81dc0016f0).stop 2023-10-03T10:09:34.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.104+0000 7f81ea243700 1 -- 172.21.15.146:0/3271488764 shutdown_connections 2023-10-03T10:09:34.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.104+0000 7f81ea243700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e4095c50 0x7f81d000df30 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.104+0000 7f81ea243700 1 --2- 172.21.15.146:0/3271488764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81d000b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.104+0000 7f81ea243700 1 --2- 172.21.15.146:0/3271488764 >> v2:172.21.15.146:3300/0 conn(0x7f81d0003580 0x7f81d0005a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.104+0000 7f81ea243700 1 -- 172.21.15.146:0/3271488764 >> 172.21.15.146:0/3271488764 conn(0x7f81e409aa50 msgr2=0x7f81e409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:34.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.104+0000 7f81ea243700 1 -- 172.21.15.146:0/3271488764 shutdown_connections 2023-10-03T10:09:34.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.104+0000 7f81ea243700 1 -- 172.21.15.146:0/3271488764 wait complete. 2023-10-03T10:09:34.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.105+0000 7f81ea243700 1 Processor -- start 2023-10-03T10:09:34.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.106+0000 7f81ea243700 1 -- start start 2023-10-03T10:09:34.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.106+0000 7f81ea243700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81d0003580 0x7f81e4139f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:34.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.106+0000 7f81ea243700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81e413a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:34.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.106+0000 7f81ea243700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81e4095c50 0x7f81e41154c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:34.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.106+0000 7f81ea243700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e4118ab0 con 0x7f81e4095c50 2023-10-03T10:09:34.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.106+0000 7f81ea243700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e4130d60 con 0x7f81d0003580 2023-10-03T10:09:34.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.106+0000 7f81ea243700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81e412c040 con 0x7f81e4093950 2023-10-03T10:09:34.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.106+0000 7f81e37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81d0003580 0x7f81e4139f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:34.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.106+0000 7f81e2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81e413a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:34.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.106+0000 7f81e37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81d0003580 0x7f81e4139f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44380/0 (socket says 172.21.15.146:44380) 2023-10-03T10:09:34.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.106+0000 7f81e2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81e413a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43814/0 (socket says 172.21.15.146:43814) 2023-10-03T10:09:34.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.106+0000 7f81e37fe700 1 -- 172.21.15.146:0/671808175 learned_addr learned my addr 172.21.15.146:0/671808175 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:34.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.106+0000 7f81e3fff700 1 --2- 172.21.15.146:0/671808175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81e4095c50 0x7f81e41154c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:34.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.107+0000 7f81e37fe700 1 -- 172.21.15.146:0/671808175 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 msgr2=0x7f81e413a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:34.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.107+0000 7f81e37fe700 1 --2- 172.21.15.146:0/671808175 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81e413a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.107+0000 7f81e37fe700 1 -- 172.21.15.146:0/671808175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81e4095c50 msgr2=0x7f81e41154c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:34.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.107+0000 7f81e37fe700 1 --2- 172.21.15.146:0/671808175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81e4095c50 0x7f81e41154c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.107+0000 7f81e37fe700 1 -- 172.21.15.146:0/671808175 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d400e040 con 0x7f81d0003580 2023-10-03T10:09:34.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.107+0000 7f81e2ffd700 1 --2- 172.21.15.146:0/671808175 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81e413a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:34.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.107+0000 7f81e37fe700 1 --2- 172.21.15.146:0/671808175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81d0003580 0x7f81e4139f80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f81d80178c0 tx=0x7f81d8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:34.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.107+0000 7f81cb7fe700 1 -- 172.21.15.146:0/671808175 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d801d070 con 0x7f81d0003580 2023-10-03T10:09:34.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.107+0000 7f81cb7fe700 1 -- 172.21.15.146:0/671808175 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d80157e0 con 0x7f81d0003580 2023-10-03T10:09:34.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.107+0000 7f81ea243700 1 -- 172.21.15.146:0/671808175 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e4094ba0 con 0x7f81d0003580 2023-10-03T10:09:34.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.107+0000 7f81cb7fe700 1 -- 172.21.15.146:0/671808175 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d8015ba0 con 0x7f81d0003580 2023-10-03T10:09:34.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.107+0000 7f81ea243700 1 -- 172.21.15.146:0/671808175 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e4117680 con 0x7f81d0003580 2023-10-03T10:09:34.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.107+0000 7f81cb7fe700 1 -- 172.21.15.146:0/671808175 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f81d8005ae0 con 0x7f81d0003580 2023-10-03T10:09:34.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.107+0000 7f81cb7fe700 1 -- 172.21.15.146:0/671808175 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f81d802b440 con 0x7f81d0003580 2023-10-03T10:09:34.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.108+0000 7f81ea243700 1 -- 172.21.15.146:0/671808175 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e405a260 con 0x7f81d0003580 2023-10-03T10:09:34.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.110+0000 7f81cb7fe700 1 -- 172.21.15.146:0/671808175 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f81d8026070 con 0x7f81d0003580 2023-10-03T10:09:34.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.184+0000 7f81ea243700 1 -- 172.21.15.146:0/671808175 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f81e4118bf0 con 0x7f81d0003580 2023-10-03T10:09:34.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.189+0000 7f81cb7fe700 1 -- 172.21.15.146:0/671808175 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f81e4118bf0 con 0x7f81d0003580 2023-10-03T10:09:34.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.190+0000 7f81ea243700 1 -- 172.21.15.146:0/671808175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81d0003580 msgr2=0x7f81e4139f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:34.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.190+0000 7f81ea243700 1 --2- 172.21.15.146:0/671808175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81d0003580 0x7f81e4139f80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f81d80178c0 tx=0x7f81d8008040).stop 2023-10-03T10:09:34.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.190+0000 7f81ea243700 1 -- 172.21.15.146:0/671808175 shutdown_connections 2023-10-03T10:09:34.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.190+0000 7f81ea243700 1 --2- 172.21.15.146:0/671808175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81e4095c50 0x7f81e41154c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.190+0000 7f81ea243700 1 --2- 172.21.15.146:0/671808175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81d0003580 0x7f81e4139f80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.190+0000 7f81ea243700 1 --2- 172.21.15.146:0/671808175 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e4093950 0x7f81e413a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.190+0000 7f81ea243700 1 -- 172.21.15.146:0/671808175 >> 172.21.15.146:0/671808175 conn(0x7f81e409aa50 msgr2=0x7f81e412e630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:34.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.191+0000 7f81ea243700 1 -- 172.21.15.146:0/671808175 shutdown_connections 2023-10-03T10:09:34.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.191+0000 7f81ea243700 1 -- 172.21.15.146:0/671808175 wait complete. 2023-10-03T10:09:34.192 INFO:teuthology.orchestra.run.smithi146.stderr:adjusted tunables profile to default 2023-10-03T10:09:34.202 INFO:tasks.ceph:check_enable_crimson: False 2023-10-03T10:09:34.202 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-03T10:09:34.202 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T10:09:34.203 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-03T10:09:34.205 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:34.205+0000 7f170ecce680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-03T10:09:34.229 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T10:09:34.229 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-03T10:09:34.278 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:34.279+0000 7f170ecce680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-03T10:09:34.297 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T10:09:34.297 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-03T10:09:34.364 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T10:09:34.364 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-03T10:09:34.368 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:34.368+0000 7f170ecce680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-03T10:09:34.394 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new dc508d26-69b6-41de-a054-5e24038acb5f 0 2023-10-03T10:09:34.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.551+0000 7fe830ffa700 1 Processor -- start 2023-10-03T10:09:34.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.551+0000 7fe830ffa700 1 -- start start 2023-10-03T10:09:34.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.551+0000 7fe830ffa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe82c05f560 0x7fe82c128cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:34.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.551+0000 7fe830ffa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe82c092190 0x7fe82c1291a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:34.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.551+0000 7fe830ffa700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe82c129690 0x7fe82c066d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:34.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.551+0000 7fe830ffa700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe82c05f940 con 0x7fe82c129690 2023-10-03T10:09:34.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.551+0000 7fe830ffa700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c097c30 con 0x7fe82c092190 2023-10-03T10:09:34.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.551+0000 7fe830ffa700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c093340 con 0x7fe82c05f560 2023-10-03T10:09:34.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.551+0000 7fe82ad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe82c129690 0x7fe82c066d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:34.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.551+0000 7fe829d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe82c092190 0x7fe82c1291a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:34.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.551+0000 7fe82a59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe82c05f560 0x7fe82c128cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:34.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.552+0000 7fe82ad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe82c129690 0x7fe82c066d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53644/0 (socket says 172.21.15.146:53644) 2023-10-03T10:09:34.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.552+0000 7fe829d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe82c092190 0x7fe82c1291a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53762/0 (socket says 172.21.15.146:53762) 2023-10-03T10:09:34.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.552+0000 7fe82ad9d700 1 -- 172.21.15.146:0/2589828649 learned_addr learned my addr 172.21.15.146:0/2589828649 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:34.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.552+0000 7fe82a59c700 1 -- 172.21.15.146:0/2589828649 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe82c092190 msgr2=0x7fe82c1291a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:34.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.552+0000 7fe82a59c700 1 --2- 172.21.15.146:0/2589828649 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe82c092190 0x7fe82c1291a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.552+0000 7fe82a59c700 1 -- 172.21.15.146:0/2589828649 >> v2:172.21.15.146:3300/0 conn(0x7fe82c129690 msgr2=0x7fe82c066d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:34.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.552+0000 7fe82a59c700 1 --2- 172.21.15.146:0/2589828649 >> v2:172.21.15.146:3300/0 conn(0x7fe82c129690 0x7fe82c066d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.552+0000 7fe82a59c700 1 -- 172.21.15.146:0/2589828649 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c0941f0 con 0x7fe82c05f560 2023-10-03T10:09:34.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.552+0000 7fe82ad9d700 1 --2- 172.21.15.146:0/2589828649 >> v2:172.21.15.146:3300/0 conn(0x7fe82c129690 0x7fe82c066d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:34.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.552+0000 7fe82a59c700 1 --2- 172.21.15.146:0/2589828649 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe82c05f560 0x7fe82c128cb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fe81c009760 tx=0x7fe81c009060).ready entity=mon.2 client_cookie=62afeb250c2f952b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:34.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.552+0000 7fe82959a700 1 -- 172.21.15.146:0/2589828649 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c0090d0 con 0x7fe82c05f560 2023-10-03T10:09:34.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.552+0000 7fe82959a700 1 -- 172.21.15.146:0/2589828649 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81c00d4a0 con 0x7fe82c05f560 2023-10-03T10:09:34.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.552+0000 7fe82959a700 1 -- 172.21.15.146:0/2589828649 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c00d820 con 0x7fe82c05f560 2023-10-03T10:09:34.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.552+0000 7fe830ffa700 1 -- 172.21.15.146:0/2589828649 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe82c05f560 msgr2=0x7fe82c128cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:34.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.552+0000 7fe830ffa700 1 --2- 172.21.15.146:0/2589828649 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe82c05f560 0x7fe82c128cb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fe81c009760 tx=0x7fe81c009060).stop 2023-10-03T10:09:34.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.553+0000 7fe830ffa700 1 -- 172.21.15.146:0/2589828649 shutdown_connections 2023-10-03T10:09:34.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.553+0000 7fe830ffa700 1 --2- 172.21.15.146:0/2589828649 >> v2:172.21.15.146:3300/0 conn(0x7fe82c129690 0x7fe82c066d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.553+0000 7fe830ffa700 1 --2- 172.21.15.146:0/2589828649 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe82c05f560 0x7fe82c128cb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.553+0000 7fe830ffa700 1 --2- 172.21.15.146:0/2589828649 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe82c092190 0x7fe82c1291a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.553+0000 7fe830ffa700 1 -- 172.21.15.146:0/2589828649 >> 172.21.15.146:0/2589828649 conn(0x7fe82c09a1c0 msgr2=0x7fe82c09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:34.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.553+0000 7fe830ffa700 1 -- 172.21.15.146:0/2589828649 shutdown_connections 2023-10-03T10:09:34.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.553+0000 7fe830ffa700 1 -- 172.21.15.146:0/2589828649 wait complete. 2023-10-03T10:09:34.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.554+0000 7fe830ffa700 1 Processor -- start 2023-10-03T10:09:34.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.554+0000 7fe830ffa700 1 -- start start 2023-10-03T10:09:34.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.554+0000 7fe830ffa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe82c05f560 0x7fe82c138320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:34.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.554+0000 7fe830ffa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe82c092190 0x7fe82c138810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:34.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.554+0000 7fe830ffa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe82c129690 0x7fe82c138d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:34.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.554+0000 7fe830ffa700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c128330 con 0x7fe82c05f560 2023-10-03T10:09:34.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.554+0000 7fe830ffa700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c115640 con 0x7fe82c092190 2023-10-03T10:09:34.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.554+0000 7fe830ffa700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c116fb0 con 0x7fe82c129690 2023-10-03T10:09:34.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.555+0000 7fe82a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe82c05f560 0x7fe82c138320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:34.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.555+0000 7fe82a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe82c05f560 0x7fe82c138320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53652/0 (socket says 172.21.15.146:53652) 2023-10-03T10:09:34.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.555+0000 7fe82a59c700 1 -- 172.21.15.146:0/3726209107 learned_addr learned my addr 172.21.15.146:0/3726209107 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:34.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.555+0000 7fe829d9b700 1 --2- 172.21.15.146:0/3726209107 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe82c092190 0x7fe82c138810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:34.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.555+0000 7fe82ad9d700 1 --2- 172.21.15.146:0/3726209107 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe82c129690 0x7fe82c138d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:34.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.555+0000 7fe82a59c700 1 -- 172.21.15.146:0/3726209107 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe82c129690 msgr2=0x7fe82c138d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:34.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.555+0000 7fe82a59c700 1 --2- 172.21.15.146:0/3726209107 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe82c129690 0x7fe82c138d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.555+0000 7fe82a59c700 1 -- 172.21.15.146:0/3726209107 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe82c092190 msgr2=0x7fe82c138810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:34.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.555+0000 7fe82a59c700 1 --2- 172.21.15.146:0/3726209107 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe82c092190 0x7fe82c138810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.555+0000 7fe82a59c700 1 -- 172.21.15.146:0/3726209107 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe824009ae0 con 0x7fe82c05f560 2023-10-03T10:09:34.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.555+0000 7fe82ad9d700 1 --2- 172.21.15.146:0/3726209107 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe82c129690 0x7fe82c138d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:34.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.555+0000 7fe829d9b700 1 --2- 172.21.15.146:0/3726209107 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe82c092190 0x7fe82c138810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:34.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.555+0000 7fe82a59c700 1 --2- 172.21.15.146:0/3726209107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe82c05f560 0x7fe82c138320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fe81c00d940 tx=0x7fe81c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:34.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.555+0000 7fe81a7fc700 1 -- 172.21.15.146:0/3726209107 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c006990 con 0x7fe82c05f560 2023-10-03T10:09:34.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.555+0000 7fe81a7fc700 1 -- 172.21.15.146:0/3726209107 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81c0127f0 con 0x7fe82c05f560 2023-10-03T10:09:34.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.555+0000 7fe830ffa700 1 -- 172.21.15.146:0/3726209107 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81c0092a0 con 0x7fe82c05f560 2023-10-03T10:09:34.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.555+0000 7fe81a7fc700 1 -- 172.21.15.146:0/3726209107 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c012b70 con 0x7fe82c05f560 2023-10-03T10:09:34.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.555+0000 7fe830ffa700 1 -- 172.21.15.146:0/3726209107 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82c097d80 con 0x7fe82c05f560 2023-10-03T10:09:34.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.555+0000 7fe81a7fc700 1 -- 172.21.15.146:0/3726209107 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fe81c0266c0 con 0x7fe82c05f560 2023-10-03T10:09:34.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.555+0000 7fe81a7fc700 1 -- 172.21.15.146:0/3726209107 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe81c01c770 con 0x7fe82c05f560 2023-10-03T10:09:34.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.556+0000 7fe830ffa700 1 -- 172.21.15.146:0/3726209107 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe82c116cf0 con 0x7fe82c05f560 2023-10-03T10:09:34.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.558+0000 7fe81a7fc700 1 -- 172.21.15.146:0/3726209107 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fe81c016070 con 0x7fe82c05f560 2023-10-03T10:09:34.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.637+0000 7fe830ffa700 1 -- 172.21.15.146:0/3726209107 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dc508d26-69b6-41de-a054-5e24038acb5f", "id": 0} v 0) v1 -- 0x7fe82c05a260 con 0x7fe82c05f560 2023-10-03T10:09:34.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.642+0000 7fe81a7fc700 1 -- 172.21.15.146:0/3726209107 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dc508d26-69b6-41de-a054-5e24038acb5f", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe81c026b50 con 0x7fe82c05f560 2023-10-03T10:09:34.642 INFO:teuthology.orchestra.run.smithi146.stdout:0 2023-10-03T10:09:34.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.643+0000 7fe830ffa700 1 -- 172.21.15.146:0/3726209107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe82c05f560 msgr2=0x7fe82c138320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:34.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.643+0000 7fe830ffa700 1 --2- 172.21.15.146:0/3726209107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe82c05f560 0x7fe82c138320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fe81c00d940 tx=0x7fe81c016000).stop 2023-10-03T10:09:34.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.643+0000 7fe830ffa700 1 -- 172.21.15.146:0/3726209107 shutdown_connections 2023-10-03T10:09:34.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.643+0000 7fe830ffa700 1 --2- 172.21.15.146:0/3726209107 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe82c129690 0x7fe82c138d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.643+0000 7fe830ffa700 1 --2- 172.21.15.146:0/3726209107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe82c05f560 0x7fe82c138320 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.643+0000 7fe830ffa700 1 --2- 172.21.15.146:0/3726209107 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe82c092190 0x7fe82c138810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.643+0000 7fe830ffa700 1 -- 172.21.15.146:0/3726209107 >> 172.21.15.146:0/3726209107 conn(0x7fe82c09a1c0 msgr2=0x7fe82c0955d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:34.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.643+0000 7fe830ffa700 1 -- 172.21.15.146:0/3726209107 shutdown_connections 2023-10-03T10:09:34.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.643+0000 7fe830ffa700 1 -- 172.21.15.146:0/3726209107 wait complete. 2023-10-03T10:09:34.653 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 31a24ed3-888a-480f-a617-3ba1d9611021 1 2023-10-03T10:09:34.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.770+0000 7fb10ecbb700 1 Processor -- start 2023-10-03T10:09:34.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.770+0000 7fb10ecbb700 1 -- start start 2023-10-03T10:09:34.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.771+0000 7fb10ecbb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb108125330 0x7fb108125ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:34.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.771+0000 7fb10ecbb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb10812dc50 0x7fb108130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:34.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.771+0000 7fb10ecbb700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb108095950 con 0x7fb108062b00 2023-10-03T10:09:34.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.771+0000 7fb10ecbb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb108062ee0 con 0x7fb108125330 2023-10-03T10:09:34.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.771+0000 7fb10ecbb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080969c0 con 0x7fb10812dc50 2023-10-03T10:09:34.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.771+0000 7fb107fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb108125330 0x7fb108125ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:34.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.771+0000 7fb10ca57700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb108062b00 0x7fb1081257c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52032/0 (socket says 172.21.15.146:52032) 2023-10-03T10:09:34.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.771+0000 7fb10ca57700 1 -- 172.21.15.146:0/3534640426 learned_addr learned my addr 172.21.15.146:0/3534640426 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:09:34.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.771+0000 7fb10d258700 1 --2- 172.21.15.146:0/3534640426 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb10812dc50 0x7fb108130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:34.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.771+0000 7fb107fff700 1 -- 172.21.15.146:0/3534640426 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb10812dc50 msgr2=0x7fb108130040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:34.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.771+0000 7fb107fff700 1 --2- 172.21.15.146:0/3534640426 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb10812dc50 0x7fb108130040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.771+0000 7fb107fff700 1 -- 172.21.15.146:0/3534640426 >> v1:172.21.15.146:6789/0 conn(0x7fb108062b00 legacy=0x7fb1081257c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:34.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.771+0000 7fb1077fe700 1 -- 172.21.15.146:0/3534640426 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981697425 0 0) 0x7fb108095950 con 0x7fb108062b00 2023-10-03T10:09:34.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.771+0000 7fb107fff700 1 -- 172.21.15.146:0/3534640426 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1080635f0 con 0x7fb108125330 2023-10-03T10:09:34.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.771+0000 7fb107fff700 1 --2- 172.21.15.146:0/3534640426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb108125330 0x7fb108125ed0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb0f4009790 tx=0x7fb0f4009060).ready entity=mon.1 client_cookie=a2812fd114d2794b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:34.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.772+0000 7fb1077fe700 1 -- 172.21.15.146:0/3534640426 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f400b5a0 con 0x7fb108125330 2023-10-03T10:09:34.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.772+0000 7fb1077fe700 1 -- 172.21.15.146:0/3534640426 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f400b700 con 0x7fb108125330 2023-10-03T10:09:34.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.772+0000 7fb1077fe700 1 -- 172.21.15.146:0/3534640426 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f400ba80 con 0x7fb108125330 2023-10-03T10:09:34.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.772+0000 7fb10ecbb700 1 -- 172.21.15.146:0/3534640426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb108125330 msgr2=0x7fb108125ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:34.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.772+0000 7fb10ecbb700 1 --2- 172.21.15.146:0/3534640426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb108125330 0x7fb108125ed0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb0f4009790 tx=0x7fb0f4009060).stop 2023-10-03T10:09:34.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.772+0000 7fb10ecbb700 1 -- 172.21.15.146:0/3534640426 shutdown_connections 2023-10-03T10:09:34.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.772+0000 7fb10ecbb700 1 --2- 172.21.15.146:0/3534640426 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb10812dc50 0x7fb108130040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.772+0000 7fb10ecbb700 1 --2- 172.21.15.146:0/3534640426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb108125330 0x7fb108125ed0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.772+0000 7fb10ecbb700 1 -- 172.21.15.146:0/3534640426 >> 172.21.15.146:0/3534640426 conn(0x7fb10809aa50 msgr2=0x7fb10809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:34.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.772+0000 7fb10ecbb700 1 -- 172.21.15.146:0/3534640426 shutdown_connections 2023-10-03T10:09:34.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.772+0000 7fb10ecbb700 1 -- 172.21.15.146:0/3534640426 wait complete. 2023-10-03T10:09:34.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.773+0000 7fb10ecbb700 1 Processor -- start 2023-10-03T10:09:34.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.773+0000 7fb10ecbb700 1 -- start start 2023-10-03T10:09:34.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.774+0000 7fb10ecbb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb108062b00 0x7fb10812ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:34.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.774+0000 7fb10ecbb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb10812dc50 0x7fb10812c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:34.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.774+0000 7fb10ecbb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb10812c5e0 0x7fb10812ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:34.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.774+0000 7fb10ecbb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10809a410 con 0x7fb108062b00 2023-10-03T10:09:34.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.774+0000 7fb10ecbb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb108095b60 con 0x7fb10812dc50 2023-10-03T10:09:34.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.774+0000 7fb10ecbb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb10812af70 con 0x7fb10812c5e0 2023-10-03T10:09:34.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.774+0000 7fb10d258700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb10812c5e0 0x7fb10812ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:34.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.774+0000 7fb10ca57700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb108062b00 0x7fb10812ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:34.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.774+0000 7fb10d258700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb10812c5e0 0x7fb10812ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56246/0 (socket says 172.21.15.146:56246) 2023-10-03T10:09:34.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.774+0000 7fb10ca57700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb108062b00 0x7fb10812ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53658/0 (socket says 172.21.15.146:53658) 2023-10-03T10:09:34.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.774+0000 7fb10d258700 1 -- 172.21.15.146:0/4003029008 learned_addr learned my addr 172.21.15.146:0/4003029008 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:34.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.774+0000 7fb107fff700 1 --2- 172.21.15.146:0/4003029008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb10812dc50 0x7fb10812c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:34.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.774+0000 7fb10d258700 1 -- 172.21.15.146:0/4003029008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb10812dc50 msgr2=0x7fb10812c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:34.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.774+0000 7fb10d258700 1 --2- 172.21.15.146:0/4003029008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb10812dc50 0x7fb10812c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.774+0000 7fb10d258700 1 -- 172.21.15.146:0/4003029008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb108062b00 msgr2=0x7fb10812ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:34.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.774+0000 7fb10d258700 1 --2- 172.21.15.146:0/4003029008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb108062b00 0x7fb10812ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.774+0000 7fb10d258700 1 -- 172.21.15.146:0/4003029008 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f40092a0 con 0x7fb10812c5e0 2023-10-03T10:09:34.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.774+0000 7fb10ca57700 1 --2- 172.21.15.146:0/4003029008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb108062b00 0x7fb10812ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:34.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.774+0000 7fb10d258700 1 --2- 172.21.15.146:0/4003029008 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb10812c5e0 0x7fb10812ca60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fb100007f60 tx=0x7fb1000098e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:34.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.775+0000 7fb104ff9700 1 -- 172.21.15.146:0/4003029008 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10000eb90 con 0x7fb10812c5e0 2023-10-03T10:09:34.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.775+0000 7fb104ff9700 1 -- 172.21.15.146:0/4003029008 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10000ecf0 con 0x7fb10812c5e0 2023-10-03T10:09:34.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.775+0000 7fb10ecbb700 1 -- 172.21.15.146:0/4003029008 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb108129e90 con 0x7fb10812c5e0 2023-10-03T10:09:34.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.775+0000 7fb104ff9700 1 -- 172.21.15.146:0/4003029008 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100014610 con 0x7fb10812c5e0 2023-10-03T10:09:34.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.775+0000 7fb10ecbb700 1 -- 172.21.15.146:0/4003029008 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10812cf50 con 0x7fb10812c5e0 2023-10-03T10:09:34.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.776+0000 7fb104ff9700 1 -- 172.21.15.146:0/4003029008 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fb100014ca0 con 0x7fb10812c5e0 2023-10-03T10:09:34.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.776+0000 7fb104ff9700 1 -- 172.21.15.146:0/4003029008 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fb10001dcd0 con 0x7fb10812c5e0 2023-10-03T10:09:34.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.776+0000 7fb10ecbb700 1 -- 172.21.15.146:0/4003029008 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10812d170 con 0x7fb10812c5e0 2023-10-03T10:09:34.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.778+0000 7fb104ff9700 1 -- 172.21.15.146:0/4003029008 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fb100022060 con 0x7fb10812c5e0 2023-10-03T10:09:34.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.858+0000 7fb10ecbb700 1 -- 172.21.15.146:0/4003029008 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd new", "uuid": "31a24ed3-888a-480f-a617-3ba1d9611021", "id": 1} v 0) v1 -- 0x7fb10805a260 con 0x7fb10812c5e0 2023-10-03T10:09:34.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.866+0000 7fb104ff9700 1 -- 172.21.15.146:0/4003029008 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "31a24ed3-888a-480f-a617-3ba1d9611021", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb10002b0b0 con 0x7fb10812c5e0 2023-10-03T10:09:34.872 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:09:34.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.867+0000 7fb10ecbb700 1 -- 172.21.15.146:0/4003029008 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb10812c5e0 msgr2=0x7fb10812ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:34.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.867+0000 7fb10ecbb700 1 --2- 172.21.15.146:0/4003029008 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb10812c5e0 0x7fb10812ca60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fb100007f60 tx=0x7fb1000098e0).stop 2023-10-03T10:09:34.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.867+0000 7fb10ecbb700 1 -- 172.21.15.146:0/4003029008 shutdown_connections 2023-10-03T10:09:34.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.867+0000 7fb10ecbb700 1 --2- 172.21.15.146:0/4003029008 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb10812c5e0 0x7fb10812ca60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.867+0000 7fb10ecbb700 1 --2- 172.21.15.146:0/4003029008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb108062b00 0x7fb10812ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.867+0000 7fb10ecbb700 1 --2- 172.21.15.146:0/4003029008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb10812dc50 0x7fb10812c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.867+0000 7fb10ecbb700 1 -- 172.21.15.146:0/4003029008 >> 172.21.15.146:0/4003029008 conn(0x7fb10809aa50 msgr2=0x7fb1080943b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:34.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.867+0000 7fb10ecbb700 1 -- 172.21.15.146:0/4003029008 shutdown_connections 2023-10-03T10:09:34.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.867+0000 7fb10ecbb700 1 -- 172.21.15.146:0/4003029008 wait complete. 2023-10-03T10:09:34.878 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 8e8d366c-c801-4c1d-b8d7-6f27e5bc0689 2 2023-10-03T10:09:34.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.995+0000 7fc874645700 1 Processor -- start 2023-10-03T10:09:34.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.995+0000 7fc874645700 1 -- start start 2023-10-03T10:09:34.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.995+0000 7fc874645700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc86c093950 0x7fc86c095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:34.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.995+0000 7fc874645700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc86c095c50 0x7fc86c096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:34.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.995+0000 7fc874645700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc86c094ba0 con 0x7fc86c12c240 2023-10-03T10:09:34.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.995+0000 7fc874645700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc86c092e90 con 0x7fc86c095c50 2023-10-03T10:09:34.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.995+0000 7fc874645700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c096b60 con 0x7fc86c093950 2023-10-03T10:09:34.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.996+0000 7fc871be0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc86c095c50 0x7fc86c096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:34.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.996+0000 7fc871be0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc86c095c50 0x7fc86c096030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53668/0 (socket says 172.21.15.146:53668) 2023-10-03T10:09:34.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.996+0000 7fc8723e1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc86c093950 0x7fc86c095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:34.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.996+0000 7fc871be0700 1 -- 172.21.15.146:0/112729298 learned_addr learned my addr 172.21.15.146:0/112729298 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:34.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.996+0000 7fc872be2700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc86c12c240 0x7fc86c12e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52048/0 (socket says 172.21.15.146:52048) 2023-10-03T10:09:34.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.996+0000 7fc8723e1700 1 -- 172.21.15.146:0/112729298 >> v2:172.21.15.146:3300/0 conn(0x7fc86c095c50 msgr2=0x7fc86c096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:34.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.996+0000 7fc8723e1700 1 --2- 172.21.15.146:0/112729298 >> v2:172.21.15.146:3300/0 conn(0x7fc86c095c50 0x7fc86c096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:34.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.996+0000 7fc8723e1700 1 -- 172.21.15.146:0/112729298 >> v1:172.21.15.146:6789/0 conn(0x7fc86c12c240 legacy=0x7fc86c12e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:34.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.996+0000 7fc8723e1700 1 -- 172.21.15.146:0/112729298 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c093150 con 0x7fc86c093950 2023-10-03T10:09:34.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.996+0000 7fc8713df700 1 -- 172.21.15.146:0/112729298 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966831878 0 0) 0x7fc86c094ba0 con 0x7fc86c12c240 2023-10-03T10:09:34.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.996+0000 7fc871be0700 1 --2- 172.21.15.146:0/112729298 >> v2:172.21.15.146:3300/0 conn(0x7fc86c095c50 0x7fc86c096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:34.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.996+0000 7fc8723e1700 1 --2- 172.21.15.146:0/112729298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc86c093950 0x7fc86c095760 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fc8680097c0 tx=0x7fc868009060).ready entity=mon.1 client_cookie=5cbc7ed24363c612 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:34.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.996+0000 7fc8713df700 1 -- 172.21.15.146:0/112729298 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8680090d0 con 0x7fc86c093950 2023-10-03T10:09:34.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.996+0000 7fc8713df700 1 -- 172.21.15.146:0/112729298 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86800f6b0 con 0x7fc86c093950 2023-10-03T10:09:34.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.996+0000 7fc8713df700 1 -- 172.21.15.146:0/112729298 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86800fa70 con 0x7fc86c093950 2023-10-03T10:09:35.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.997+0000 7fc874645700 1 -- 172.21.15.146:0/112729298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc86c093950 msgr2=0x7fc86c095760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.997+0000 7fc874645700 1 --2- 172.21.15.146:0/112729298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc86c093950 0x7fc86c095760 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fc8680097c0 tx=0x7fc868009060).stop 2023-10-03T10:09:35.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.997+0000 7fc874645700 1 -- 172.21.15.146:0/112729298 shutdown_connections 2023-10-03T10:09:35.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.997+0000 7fc874645700 1 --2- 172.21.15.146:0/112729298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc86c093950 0x7fc86c095760 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.997+0000 7fc874645700 1 --2- 172.21.15.146:0/112729298 >> v2:172.21.15.146:3300/0 conn(0x7fc86c095c50 0x7fc86c096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.997+0000 7fc874645700 1 -- 172.21.15.146:0/112729298 >> 172.21.15.146:0/112729298 conn(0x7fc86c09aa50 msgr2=0x7fc86c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:35.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.997+0000 7fc874645700 1 -- 172.21.15.146:0/112729298 shutdown_connections 2023-10-03T10:09:35.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.997+0000 7fc874645700 1 -- 172.21.15.146:0/112729298 wait complete. 2023-10-03T10:09:35.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.998+0000 7fc874645700 1 Processor -- start 2023-10-03T10:09:35.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.998+0000 7fc874645700 1 -- start start 2023-10-03T10:09:35.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.998+0000 7fc874645700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc86c093950 0x7fc86c1199e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.998+0000 7fc874645700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc86c095c50 0x7fc86c115ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.998+0000 7fc874645700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc86c12c240 0x7fc86c115fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.998+0000 7fc874645700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c092410 con 0x7fc86c093950 2023-10-03T10:09:35.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.998+0000 7fc874645700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c12bb60 con 0x7fc86c12c240 2023-10-03T10:09:35.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.998+0000 7fc874645700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc86c1194e0 con 0x7fc86c095c50 2023-10-03T10:09:35.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.998+0000 7fc8723e1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc86c093950 0x7fc86c1199e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.998+0000 7fc8723e1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc86c093950 0x7fc86c1199e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53684/0 (socket says 172.21.15.146:53684) 2023-10-03T10:09:35.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.998+0000 7fc8723e1700 1 -- 172.21.15.146:0/2200954425 learned_addr learned my addr 172.21.15.146:0/2200954425 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:35.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.998+0000 7fc871be0700 1 --2- 172.21.15.146:0/2200954425 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc86c095c50 0x7fc86c115ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.998+0000 7fc872be2700 1 --2- 172.21.15.146:0/2200954425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc86c12c240 0x7fc86c115fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.999+0000 7fc8723e1700 1 -- 172.21.15.146:0/2200954425 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc86c095c50 msgr2=0x7fc86c115ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.999+0000 7fc8723e1700 1 --2- 172.21.15.146:0/2200954425 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc86c095c50 0x7fc86c115ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.999+0000 7fc8723e1700 1 -- 172.21.15.146:0/2200954425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc86c12c240 msgr2=0x7fc86c115fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.999+0000 7fc8723e1700 1 --2- 172.21.15.146:0/2200954425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc86c12c240 0x7fc86c115fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.999+0000 7fc8723e1700 1 -- 172.21.15.146:0/2200954425 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c009370 con 0x7fc86c093950 2023-10-03T10:09:35.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.999+0000 7fc8723e1700 1 --2- 172.21.15.146:0/2200954425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc86c093950 0x7fc86c1199e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fc868009e60 tx=0x7fc868017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:35.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.999+0000 7fc8627fc700 1 -- 172.21.15.146:0/2200954425 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86801e070 con 0x7fc86c093950 2023-10-03T10:09:35.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.999+0000 7fc8627fc700 1 -- 172.21.15.146:0/2200954425 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc868006950 con 0x7fc86c093950 2023-10-03T10:09:35.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.999+0000 7fc8627fc700 1 -- 172.21.15.146:0/2200954425 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc868009110 con 0x7fc86c093950 2023-10-03T10:09:35.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.999+0000 7fc874645700 1 -- 172.21.15.146:0/2200954425 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8680092a0 con 0x7fc86c093950 2023-10-03T10:09:35.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.999+0000 7fc874645700 1 -- 172.21.15.146:0/2200954425 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86c118f40 con 0x7fc86c093950 2023-10-03T10:09:35.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.999+0000 7fc8627fc700 1 -- 172.21.15.146:0/2200954425 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fc868019ad0 con 0x7fc86c093950 2023-10-03T10:09:35.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:34.999+0000 7fc8627fc700 1 -- 172.21.15.146:0/2200954425 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7fc86802cad0 con 0x7fc86c093950 2023-10-03T10:09:35.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.000+0000 7fc874645700 1 -- 172.21.15.146:0/2200954425 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc86c119300 con 0x7fc86c093950 2023-10-03T10:09:35.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.002+0000 7fc8627fc700 1 -- 172.21.15.146:0/2200954425 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fc868031060 con 0x7fc86c093950 2023-10-03T10:09:35.110 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:35.110+0000 7f170ecce680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-03T10:09:35.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.116+0000 7fc874645700 1 -- 172.21.15.146:0/2200954425 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8e8d366c-c801-4c1d-b8d7-6f27e5bc0689", "id": 2} v 0) v1 -- 0x7fc86c05a260 con 0x7fc86c093950 2023-10-03T10:09:35.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.124+0000 7fc8627fc700 1 -- 172.21.15.146:0/2200954425 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8e8d366c-c801-4c1d-b8d7-6f27e5bc0689", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc868027070 con 0x7fc86c093950 2023-10-03T10:09:35.124 INFO:teuthology.orchestra.run.smithi146.stdout:2 2023-10-03T10:09:35.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.125+0000 7fc874645700 1 -- 172.21.15.146:0/2200954425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc86c093950 msgr2=0x7fc86c1199e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.125+0000 7fc874645700 1 --2- 172.21.15.146:0/2200954425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc86c093950 0x7fc86c1199e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fc868009e60 tx=0x7fc868017000).stop 2023-10-03T10:09:35.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.125+0000 7fc874645700 1 -- 172.21.15.146:0/2200954425 shutdown_connections 2023-10-03T10:09:35.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.125+0000 7fc874645700 1 --2- 172.21.15.146:0/2200954425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc86c12c240 0x7fc86c115fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.125+0000 7fc874645700 1 --2- 172.21.15.146:0/2200954425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc86c093950 0x7fc86c1199e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.125+0000 7fc874645700 1 --2- 172.21.15.146:0/2200954425 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc86c095c50 0x7fc86c115ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.125+0000 7fc874645700 1 -- 172.21.15.146:0/2200954425 >> 172.21.15.146:0/2200954425 conn(0x7fc86c09aa50 msgr2=0x7fc86c0692d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:35.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.125+0000 7fc874645700 1 -- 172.21.15.146:0/2200954425 shutdown_connections 2023-10-03T10:09:35.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.125+0000 7fc874645700 1 -- 172.21.15.146:0/2200954425 wait complete. 2023-10-03T10:09:35.136 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new a581fc17-7f9e-41b1-b070-a1e8c17d6e7e 3 2023-10-03T10:09:35.225 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:35.226+0000 7f170ecce680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-03T10:09:35.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.256+0000 7fa86f890700 1 Processor -- start 2023-10-03T10:09:35.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.256+0000 7fa86f890700 1 -- start start 2023-10-03T10:09:35.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.257+0000 7fa86f890700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa868095e70 0x7fa868096250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.257+0000 7fa86f890700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa86812d250 0x7fa86812f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.257+0000 7fa86f890700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa868094ba0 con 0x7fa868093950 2023-10-03T10:09:35.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.257+0000 7fa86f890700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa868092e90 con 0x7fa868095e70 2023-10-03T10:09:35.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.257+0000 7fa86f890700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa868096b60 con 0x7fa86812d250 2023-10-03T10:09:35.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.257+0000 7fa86ce2b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa868095e70 0x7fa868096250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.257+0000 7fa86de2d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa86812d250 0x7fa86812f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.257+0000 7fa86de2d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa86812d250 0x7fa86812f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53820/0 (socket says 172.21.15.146:53820) 2023-10-03T10:09:35.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.257+0000 7fa86de2d700 1 -- 172.21.15.146:0/3855382074 learned_addr learned my addr 172.21.15.146:0/3855382074 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:35.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.257+0000 7fa86ce2b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa868095e70 0x7fa868096250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53700/0 (socket says 172.21.15.146:53700) 2023-10-03T10:09:35.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.257+0000 7fa86de2d700 1 -- 172.21.15.146:0/3855382074 >> v2:172.21.15.146:3300/0 conn(0x7fa868095e70 msgr2=0x7fa868096250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:35.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.257+0000 7fa86de2d700 1 --2- 172.21.15.146:0/3855382074 >> v2:172.21.15.146:3300/0 conn(0x7fa868095e70 0x7fa868096250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.257+0000 7fa86de2d700 1 -- 172.21.15.146:0/3855382074 >> v1:172.21.15.146:6789/0 conn(0x7fa868093950 legacy=0x7fa868095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.257+0000 7fa85ffff700 1 -- 172.21.15.146:0/3855382074 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4075315799 0 0) 0x7fa868094ba0 con 0x7fa868093950 2023-10-03T10:09:35.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.257+0000 7fa86de2d700 1 -- 172.21.15.146:0/3855382074 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa868093150 con 0x7fa86812d250 2023-10-03T10:09:35.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.257+0000 7fa86ce2b700 1 --2- 172.21.15.146:0/3855382074 >> v2:172.21.15.146:3300/0 conn(0x7fa868095e70 0x7fa868096250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:35.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.257+0000 7fa86de2d700 1 --2- 172.21.15.146:0/3855382074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa86812d250 0x7fa86812f640 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fa860009f20 tx=0x7fa860009840).ready entity=mon.1 client_cookie=c2124d3cf6d3a08b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:35.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.258+0000 7fa85ffff700 1 -- 172.21.15.146:0/3855382074 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86000e070 con 0x7fa86812d250 2023-10-03T10:09:35.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.258+0000 7fa85ffff700 1 -- 172.21.15.146:0/3855382074 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86000b9d0 con 0x7fa86812d250 2023-10-03T10:09:35.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.258+0000 7fa85ffff700 1 -- 172.21.15.146:0/3855382074 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86000bd50 con 0x7fa86812d250 2023-10-03T10:09:35.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.258+0000 7fa86f890700 1 -- 172.21.15.146:0/3855382074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa86812d250 msgr2=0x7fa86812f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.258+0000 7fa86f890700 1 --2- 172.21.15.146:0/3855382074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa86812d250 0x7fa86812f640 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fa860009f20 tx=0x7fa860009840).stop 2023-10-03T10:09:35.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.258+0000 7fa86f890700 1 -- 172.21.15.146:0/3855382074 shutdown_connections 2023-10-03T10:09:35.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.258+0000 7fa86f890700 1 --2- 172.21.15.146:0/3855382074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa86812d250 0x7fa86812f640 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.258+0000 7fa86f890700 1 --2- 172.21.15.146:0/3855382074 >> v2:172.21.15.146:3300/0 conn(0x7fa868095e70 0x7fa868096250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.258+0000 7fa86f890700 1 -- 172.21.15.146:0/3855382074 >> 172.21.15.146:0/3855382074 conn(0x7fa86809aa50 msgr2=0x7fa86809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:35.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.258+0000 7fa86f890700 1 -- 172.21.15.146:0/3855382074 shutdown_connections 2023-10-03T10:09:35.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.258+0000 7fa86f890700 1 -- 172.21.15.146:0/3855382074 wait complete. 2023-10-03T10:09:35.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.259+0000 7fa86f890700 1 Processor -- start 2023-10-03T10:09:35.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.259+0000 7fa86f890700 1 -- start start 2023-10-03T10:09:35.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa86f890700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa868093950 0x7fa868119fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa86f890700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa868095e70 0x7fa86811a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa86f890700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa86812d250 0x7fa86811a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa86f890700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86811ae90 con 0x7fa868093950 2023-10-03T10:09:35.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa86f890700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86811b430 con 0x7fa86812d250 2023-10-03T10:09:35.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa86f890700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa86811d4c0 con 0x7fa868095e70 2023-10-03T10:09:35.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa86de2d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa86812d250 0x7fa86811a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa86ce2b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa868095e70 0x7fa86811a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa86d62c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa868093950 0x7fa868119fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa86de2d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa86812d250 0x7fa86811a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53830/0 (socket says 172.21.15.146:53830) 2023-10-03T10:09:35.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa86de2d700 1 -- 172.21.15.146:0/2744307872 learned_addr learned my addr 172.21.15.146:0/2744307872 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:35.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa86de2d700 1 -- 172.21.15.146:0/2744307872 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa868095e70 msgr2=0x7fa86811a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa86de2d700 1 --2- 172.21.15.146:0/2744307872 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa868095e70 0x7fa86811a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa86de2d700 1 -- 172.21.15.146:0/2744307872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa868093950 msgr2=0x7fa868119fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa86de2d700 1 --2- 172.21.15.146:0/2744307872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa868093950 0x7fa868119fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa86de2d700 1 -- 172.21.15.146:0/2744307872 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8640092a0 con 0x7fa86812d250 2023-10-03T10:09:35.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa86ce2b700 1 --2- 172.21.15.146:0/2744307872 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa868095e70 0x7fa86811a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:35.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa86d62c700 1 --2- 172.21.15.146:0/2744307872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa868093950 0x7fa868119fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:35.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa86de2d700 1 --2- 172.21.15.146:0/2744307872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa86812d250 0x7fa86811a9a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fa86000b610 tx=0x7fa860009840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:35.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa85d7fa700 1 -- 172.21.15.146:0/2744307872 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa860007080 con 0x7fa86812d250 2023-10-03T10:09:35.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa85d7fa700 1 -- 172.21.15.146:0/2744307872 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8600092e0 con 0x7fa86812d250 2023-10-03T10:09:35.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa85d7fa700 1 -- 172.21.15.146:0/2744307872 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa860007840 con 0x7fa86812d250 2023-10-03T10:09:35.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.260+0000 7fa86f890700 1 -- 172.21.15.146:0/2744307872 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa860009ae0 con 0x7fa86812d250 2023-10-03T10:09:35.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.261+0000 7fa86f890700 1 -- 172.21.15.146:0/2744307872 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8680993f0 con 0x7fa86812d250 2023-10-03T10:09:35.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.261+0000 7fa85d7fa700 1 -- 172.21.15.146:0/2744307872 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fa860003040 con 0x7fa86812d250 2023-10-03T10:09:35.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.261+0000 7fa85d7fa700 1 -- 172.21.15.146:0/2744307872 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fa8600298e0 con 0x7fa86812d250 2023-10-03T10:09:35.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.261+0000 7fa86f890700 1 -- 172.21.15.146:0/2744307872 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa86811d970 con 0x7fa86812d250 2023-10-03T10:09:35.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.264+0000 7fa85d7fa700 1 -- 172.21.15.146:0/2744307872 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fa86002e060 con 0x7fa86812d250 2023-10-03T10:09:35.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.342+0000 7fa86f890700 1 -- 172.21.15.146:0/2744307872 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a581fc17-7f9e-41b1-b070-a1e8c17d6e7e", "id": 3} v 0) v1 -- 0x7fa86805a260 con 0x7fa86812d250 2023-10-03T10:09:35.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.353+0000 7fa85d7fa700 1 -- 172.21.15.146:0/2744307872 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a581fc17-7f9e-41b1-b070-a1e8c17d6e7e", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa860024070 con 0x7fa86812d250 2023-10-03T10:09:35.353 INFO:teuthology.orchestra.run.smithi146.stdout:3 2023-10-03T10:09:35.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.354+0000 7fa86f890700 1 -- 172.21.15.146:0/2744307872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa86812d250 msgr2=0x7fa86811a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.354+0000 7fa86f890700 1 --2- 172.21.15.146:0/2744307872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa86812d250 0x7fa86811a9a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fa86000b610 tx=0x7fa860009840).stop 2023-10-03T10:09:35.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.354+0000 7fa86f890700 1 -- 172.21.15.146:0/2744307872 shutdown_connections 2023-10-03T10:09:35.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.354+0000 7fa86f890700 1 --2- 172.21.15.146:0/2744307872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa86812d250 0x7fa86811a9a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.354+0000 7fa86f890700 1 --2- 172.21.15.146:0/2744307872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa868093950 0x7fa868119fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.354+0000 7fa86f890700 1 --2- 172.21.15.146:0/2744307872 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa868095e70 0x7fa86811a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.354+0000 7fa86f890700 1 -- 172.21.15.146:0/2744307872 >> 172.21.15.146:0/2744307872 conn(0x7fa86809aa50 msgr2=0x7fa868068fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:35.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.354+0000 7fa86f890700 1 -- 172.21.15.146:0/2744307872 shutdown_connections 2023-10-03T10:09:35.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.354+0000 7fa86f890700 1 -- 172.21.15.146:0/2744307872 wait complete. 2023-10-03T10:09:35.366 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-03T10:09:35.366 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-03T10:09:35.367 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:35.366+0000 7f170ecce680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-03T10:09:35.368 INFO:tasks.ceph.osd.0:Started 2023-10-03T10:09:35.369 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-03T10:09:35.369 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-03T10:09:35.370 INFO:tasks.ceph.osd.1:Started 2023-10-03T10:09:35.371 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-03T10:09:35.371 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-03T10:09:35.373 INFO:tasks.ceph.osd.2:Started 2023-10-03T10:09:35.373 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-03T10:09:35.373 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-03T10:09:35.375 INFO:tasks.ceph.osd.3:Started 2023-10-03T10:09:35.375 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:35.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.517+0000 7fb2b4463700 1 Processor -- start 2023-10-03T10:09:35.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.517+0000 7fb2b4463700 1 -- start start 2023-10-03T10:09:35.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.518+0000 7fb2b4463700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb2ac093980 0x7fb2ac094040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.518+0000 7fb2b4463700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2ac094c40 0x7fb2ac1303b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.518+0000 7fb2b4463700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ac093180 con 0x7fb2ac0972b0 2023-10-03T10:09:35.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.518+0000 7fb2b4463700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2ac093d60 con 0x7fb2ac093980 2023-10-03T10:09:35.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.518+0000 7fb2b4463700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac0977d0 con 0x7fb2ac094c40 2023-10-03T10:09:35.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.518+0000 7fb2b21ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb2ac093980 0x7fb2ac094040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.518+0000 7fb2b21ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb2ac093980 0x7fb2ac094040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53754/0 (socket says 172.21.15.146:53754) 2023-10-03T10:09:35.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.518+0000 7fb2b21ff700 1 -- 172.21.15.146:0/2996575190 learned_addr learned my addr 172.21.15.146:0/2996575190 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:35.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.518+0000 7fb2b2a00700 1 --2- 172.21.15.146:0/2996575190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2ac094c40 0x7fb2ac1303b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.518+0000 7fb2b2a00700 1 -- 172.21.15.146:0/2996575190 >> v2:172.21.15.146:3300/0 conn(0x7fb2ac093980 msgr2=0x7fb2ac094040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:35.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.519+0000 7fb2b2a00700 1 --2- 172.21.15.146:0/2996575190 >> v2:172.21.15.146:3300/0 conn(0x7fb2ac093980 0x7fb2ac094040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.519+0000 7fb2b2a00700 1 -- 172.21.15.146:0/2996575190 >> v1:172.21.15.146:6789/0 conn(0x7fb2ac0972b0 legacy=0x7fb2ac094530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.519+0000 7fb2b2a00700 1 -- 172.21.15.146:0/2996575190 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ac098430 con 0x7fb2ac094c40 2023-10-03T10:09:35.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.519+0000 7fb2b11fd700 1 -- 172.21.15.146:0/2996575190 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516411362 0 0) 0x7fb2ac093180 con 0x7fb2ac0972b0 2023-10-03T10:09:35.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.519+0000 7fb2b21ff700 1 --2- 172.21.15.146:0/2996575190 >> v2:172.21.15.146:3300/0 conn(0x7fb2ac093980 0x7fb2ac094040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:35.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.519+0000 7fb2b2a00700 1 --2- 172.21.15.146:0/2996575190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2ac094c40 0x7fb2ac1303b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fb2a400f300 tx=0x7fb2a400db90).ready entity=mon.1 client_cookie=650dba26bc3b3287 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:35.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.519+0000 7fb2b11fd700 1 -- 172.21.15.146:0/2996575190 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4012070 con 0x7fb2ac094c40 2023-10-03T10:09:35.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.519+0000 7fb2b11fd700 1 -- 172.21.15.146:0/2996575190 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a400d0d0 con 0x7fb2ac094c40 2023-10-03T10:09:35.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.519+0000 7fb2b11fd700 1 -- 172.21.15.146:0/2996575190 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a400d450 con 0x7fb2ac094c40 2023-10-03T10:09:35.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.519+0000 7fb2b4463700 1 -- 172.21.15.146:0/2996575190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2ac094c40 msgr2=0x7fb2ac1303b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.519+0000 7fb2b4463700 1 --2- 172.21.15.146:0/2996575190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2ac094c40 0x7fb2ac1303b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fb2a400f300 tx=0x7fb2a400db90).stop 2023-10-03T10:09:35.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.520+0000 7fb2b4463700 1 -- 172.21.15.146:0/2996575190 shutdown_connections 2023-10-03T10:09:35.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.520+0000 7fb2b4463700 1 --2- 172.21.15.146:0/2996575190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2ac094c40 0x7fb2ac1303b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.520+0000 7fb2b4463700 1 --2- 172.21.15.146:0/2996575190 >> v2:172.21.15.146:3300/0 conn(0x7fb2ac093980 0x7fb2ac094040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.520+0000 7fb2b4463700 1 -- 172.21.15.146:0/2996575190 >> 172.21.15.146:0/2996575190 conn(0x7fb2ac09bba0 msgr2=0x7fb2ac09bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:35.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.520+0000 7fb2b4463700 1 -- 172.21.15.146:0/2996575190 shutdown_connections 2023-10-03T10:09:35.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.520+0000 7fb2b4463700 1 -- 172.21.15.146:0/2996575190 wait complete. 2023-10-03T10:09:35.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.520+0000 7fb2b4463700 1 Processor -- start 2023-10-03T10:09:35.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.521+0000 7fb2b4463700 1 -- start start 2023-10-03T10:09:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.521+0000 7fb2b4463700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2ac093980 0x7fb2ac135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.521+0000 7fb2b4463700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb2ac094c40 0x7fb2ac1361c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.521+0000 7fb2b4463700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2ac0972b0 0x7fb2ac1366b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.521+0000 7fb2b4463700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac119a40 con 0x7fb2ac0972b0 2023-10-03T10:09:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.521+0000 7fb2b4463700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac06a710 con 0x7fb2ac093980 2023-10-03T10:09:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.521+0000 7fb2b4463700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac09b7a0 con 0x7fb2ac094c40 2023-10-03T10:09:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.521+0000 7fb2b21ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2ac093980 0x7fb2ac135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.521+0000 7fb2b21ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2ac093980 0x7fb2ac135cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53878/0 (socket says 172.21.15.146:53878) 2023-10-03T10:09:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.521+0000 7fb2b19fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb2ac094c40 0x7fb2ac1361c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.521+0000 7fb2b21ff700 1 -- 172.21.15.146:0/1882807011 learned_addr learned my addr 172.21.15.146:0/1882807011 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.521+0000 7fb2b2a00700 1 --2- 172.21.15.146:0/1882807011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2ac0972b0 0x7fb2ac1366b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.521+0000 7fb2b19fe700 1 -- 172.21.15.146:0/1882807011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2ac093980 msgr2=0x7fb2ac135cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.521+0000 7fb2b19fe700 1 --2- 172.21.15.146:0/1882807011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2ac093980 0x7fb2ac135cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.521+0000 7fb2b19fe700 1 -- 172.21.15.146:0/1882807011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2ac0972b0 msgr2=0x7fb2ac1366b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.521+0000 7fb2b19fe700 1 --2- 172.21.15.146:0/1882807011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2ac0972b0 0x7fb2ac1366b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.521+0000 7fb2b19fe700 1 -- 172.21.15.146:0/1882807011 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a8009370 con 0x7fb2ac094c40 2023-10-03T10:09:35.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.521+0000 7fb2b21ff700 1 --2- 172.21.15.146:0/1882807011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2ac093980 0x7fb2ac135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:35.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.521+0000 7fb2b2a00700 1 --2- 172.21.15.146:0/1882807011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2ac0972b0 0x7fb2ac1366b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:35.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.522+0000 7fb2b19fe700 1 --2- 172.21.15.146:0/1882807011 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb2ac094c40 0x7fb2ac1361c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fb29c00c470 tx=0x7fb29c007b60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:35.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.522+0000 7fb2a27fc700 1 -- 172.21.15.146:0/1882807011 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c012400 con 0x7fb2ac094c40 2023-10-03T10:09:35.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.522+0000 7fb2a27fc700 1 -- 172.21.15.146:0/1882807011 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29c012580 con 0x7fb2ac094c40 2023-10-03T10:09:35.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.522+0000 7fb2b4463700 1 -- 172.21.15.146:0/1882807011 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a400de30 con 0x7fb2ac094c40 2023-10-03T10:09:35.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.522+0000 7fb2a27fc700 1 -- 172.21.15.146:0/1882807011 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c012940 con 0x7fb2ac094c40 2023-10-03T10:09:35.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.522+0000 7fb2b4463700 1 -- 172.21.15.146:0/1882807011 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ac11a250 con 0x7fb2ac094c40 2023-10-03T10:09:35.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.522+0000 7fb2a27fc700 1 -- 172.21.15.146:0/1882807011 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fb29c01c440 con 0x7fb2ac094c40 2023-10-03T10:09:35.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.522+0000 7fb2a27fc700 1 -- 172.21.15.146:0/1882807011 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fb29c01b3b0 con 0x7fb2ac094c40 2023-10-03T10:09:35.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.523+0000 7fb2b4463700 1 -- 172.21.15.146:0/1882807011 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ac05a260 con 0x7fb2ac094c40 2023-10-03T10:09:35.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.526+0000 7fb2a27fc700 1 -- 172.21.15.146:0/1882807011 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fb2ac11a250 con 0x7fb2ac094c40 2023-10-03T10:09:35.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.593+0000 7fb2b4463700 1 -- 172.21.15.146:0/1882807011 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2ac119630 con 0x7fb2ac094c40 2023-10-03T10:09:35.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.593+0000 7fb2a27fc700 1 -- 172.21.15.146:0/1882807011 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7fb29c017070 con 0x7fb2ac094c40 2023-10-03T10:09:35.593 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:35.593 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":6,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:09:35.344070+0000","last_up_change":"0.000000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.594+0000 7fb2b4463700 1 -- 172.21.15.146:0/1882807011 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb2ac094c40 msgr2=0x7fb2ac1361c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.594+0000 7fb2b4463700 1 --2- 172.21.15.146:0/1882807011 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb2ac094c40 0x7fb2ac1361c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fb29c00c470 tx=0x7fb29c007b60).stop 2023-10-03T10:09:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.594+0000 7fb2b4463700 1 -- 172.21.15.146:0/1882807011 shutdown_connections 2023-10-03T10:09:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.594+0000 7fb2b4463700 1 --2- 172.21.15.146:0/1882807011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2ac0972b0 0x7fb2ac1366b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.594+0000 7fb2b4463700 1 --2- 172.21.15.146:0/1882807011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2ac093980 0x7fb2ac135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.594+0000 7fb2b4463700 1 --2- 172.21.15.146:0/1882807011 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb2ac094c40 0x7fb2ac1361c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:35.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.594+0000 7fb2b4463700 1 -- 172.21.15.146:0/1882807011 >> 172.21.15.146:0/1882807011 conn(0x7fb2ac09bba0 msgr2=0x7fb2ac098680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:35.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.594+0000 7fb2b4463700 1 -- 172.21.15.146:0/1882807011 shutdown_connections 2023-10-03T10:09:35.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:35.594+0000 7fb2b4463700 1 -- 172.21.15.146:0/1882807011 wait complete. 2023-10-03T10:09:35.606 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-03T10:09:35.606 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-03T10:09:35.840 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:35.841+0000 7f170ecce680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-03T10:09:35.975 INFO:tasks.ceph.osd.0.smithi146.stderr:2023-10-03T10:09:35.975+0000 7f2f9818e200 -1 Falling back to public interface 2023-10-03T10:09:35.992 INFO:tasks.ceph.osd.1.smithi146.stderr:2023-10-03T10:09:35.992+0000 7f68adc87200 -1 Falling back to public interface 2023-10-03T10:09:35.992 INFO:tasks.ceph.osd.2.smithi146.stderr:2023-10-03T10:09:35.992+0000 7f76e352f200 -1 Falling back to public interface 2023-10-03T10:09:36.000 INFO:tasks.ceph.osd.3.smithi146.stderr:2023-10-03T10:09:36.000+0000 7f79bd110200 -1 Falling back to public interface 2023-10-03T10:09:36.008 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:36.016 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:36.016+0000 7f170ecce680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-03T10:09:36.085 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:36.085+0000 7f170ecce680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-03T10:09:36.117 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.117+0000 7fa773cd0700 1 Processor -- start 2023-10-03T10:09:36.117 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.117+0000 7fa773cd0700 1 -- start start 2023-10-03T10:09:36.119 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.118+0000 7fa773cd0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa76c095310 0x7fa76c0956f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:36.119 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.118+0000 7fa773cd0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa76c091b10 0x7fa76c095be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:36.119 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.118+0000 7fa773cd0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa76c0960d0 0x7fa76c12e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:36.119 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.118+0000 7fa773cd0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76c096ed0 con 0x7fa76c091b10 2023-10-03T10:09:36.119 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.118+0000 7fa773cd0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0933e0 con 0x7fa76c095310 2023-10-03T10:09:36.119 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.118+0000 7fa773cd0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0938d0 con 0x7fa76c0960d0 2023-10-03T10:09:36.119 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.118+0000 7fa771a6c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa76c095310 0x7fa76c0956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.119 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.118+0000 7fa77126b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa76c091b10 0x7fa76c095be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.120 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.118+0000 7fa77226d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa76c0960d0 0x7fa76c12e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.120 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.118+0000 7fa77126b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa76c091b10 0x7fa76c095be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53768/0 (socket says 172.21.15.146:53768) 2023-10-03T10:09:36.120 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.118+0000 7fa771a6c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa76c095310 0x7fa76c0956f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53890/0 (socket says 172.21.15.146:53890) 2023-10-03T10:09:36.120 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.118+0000 7fa77126b700 1 -- 172.21.15.146:0/812911408 learned_addr learned my addr 172.21.15.146:0/812911408 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:36.120 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.119+0000 7fa77126b700 1 -- 172.21.15.146:0/812911408 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa76c0960d0 msgr2=0x7fa76c12e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:36.120 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.119+0000 7fa77126b700 1 --2- 172.21.15.146:0/812911408 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa76c0960d0 0x7fa76c12e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.120 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.119+0000 7fa77126b700 1 -- 172.21.15.146:0/812911408 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa76c095310 msgr2=0x7fa76c0956f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:36.120 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.119+0000 7fa77126b700 1 --2- 172.21.15.146:0/812911408 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa76c095310 0x7fa76c0956f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.120 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.119+0000 7fa77126b700 1 -- 172.21.15.146:0/812911408 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c092210 con 0x7fa76c091b10 2023-10-03T10:09:36.120 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.119+0000 7fa771a6c700 1 --2- 172.21.15.146:0/812911408 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa76c095310 0x7fa76c0956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:36.120 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.119+0000 7fa77126b700 1 --2- 172.21.15.146:0/812911408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa76c091b10 0x7fa76c095be0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fa75c006fd0 tx=0x7fa75c00b3b0).ready entity=mon.0 client_cookie=db26afafa5194a29 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:36.120 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.119+0000 7fa770a6a700 1 -- 172.21.15.146:0/812911408 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c00da10 con 0x7fa76c091b10 2023-10-03T10:09:36.121 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.119+0000 7fa770a6a700 1 -- 172.21.15.146:0/812911408 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c00db70 con 0x7fa76c091b10 2023-10-03T10:09:36.121 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.119+0000 7fa770a6a700 1 -- 172.21.15.146:0/812911408 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c010470 con 0x7fa76c091b10 2023-10-03T10:09:36.123 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.120+0000 7fa773cd0700 1 -- 172.21.15.146:0/812911408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa76c091b10 msgr2=0x7fa76c095be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:36.124 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.120+0000 7fa773cd0700 1 --2- 172.21.15.146:0/812911408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa76c091b10 0x7fa76c095be0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fa75c006fd0 tx=0x7fa75c00b3b0).stop 2023-10-03T10:09:36.124 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.120+0000 7fa773cd0700 1 -- 172.21.15.146:0/812911408 shutdown_connections 2023-10-03T10:09:36.124 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.120+0000 7fa773cd0700 1 --2- 172.21.15.146:0/812911408 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa76c095310 0x7fa76c0956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.124 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.120+0000 7fa773cd0700 1 --2- 172.21.15.146:0/812911408 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa76c0960d0 0x7fa76c12e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.124 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.120+0000 7fa773cd0700 1 --2- 172.21.15.146:0/812911408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa76c091b10 0x7fa76c095be0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.124 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.120+0000 7fa773cd0700 1 -- 172.21.15.146:0/812911408 >> 172.21.15.146:0/812911408 conn(0x7fa76c05ee70 msgr2=0x7fa76c097410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:36.124 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.120+0000 7fa773cd0700 1 -- 172.21.15.146:0/812911408 shutdown_connections 2023-10-03T10:09:36.124 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.120+0000 7fa773cd0700 1 -- 172.21.15.146:0/812911408 wait complete. 2023-10-03T10:09:36.124 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.121+0000 7fa773cd0700 1 Processor -- start 2023-10-03T10:09:36.124 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.121+0000 7fa773cd0700 1 -- start start 2023-10-03T10:09:36.124 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.122+0000 7fa773cd0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa76c095310 0x7fa76c11d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:36.124 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.122+0000 7fa773cd0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa76c0960d0 0x7fa76c119e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:36.125 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.122+0000 7fa773cd0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa76c119980 0x7fa76c11a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:36.125 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.122+0000 7fa773cd0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c11cde0 con 0x7fa76c119980 2023-10-03T10:09:36.125 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.122+0000 7fa773cd0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c092440 con 0x7fa76c0960d0 2023-10-03T10:09:36.125 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.122+0000 7fa773cd0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c11cb20 con 0x7fa76c095310 2023-10-03T10:09:36.125 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.122+0000 7fa77226d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa76c119980 0x7fa76c11a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.125 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.122+0000 7fa77226d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa76c119980 0x7fa76c11a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53774/0 (socket says 172.21.15.146:53774) 2023-10-03T10:09:36.125 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.122+0000 7fa77226d700 1 -- 172.21.15.146:0/1245178666 learned_addr learned my addr 172.21.15.146:0/1245178666 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:36.125 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.122+0000 7fa771a6c700 1 --2- 172.21.15.146:0/1245178666 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa76c095310 0x7fa76c11d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.125 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.122+0000 7fa77126b700 1 --2- 172.21.15.146:0/1245178666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa76c0960d0 0x7fa76c119e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:36.125 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.122+0000 7fa77226d700 1 -- 172.21.15.146:0/1245178666 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa76c095310 msgr2=0x7fa76c11d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:36.125 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.122+0000 7fa77226d700 1 --2- 172.21.15.146:0/1245178666 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa76c095310 0x7fa76c11d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.125 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.122+0000 7fa77226d700 1 -- 172.21.15.146:0/1245178666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa76c0960d0 msgr2=0x7fa76c119e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:36.125 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.122+0000 7fa77226d700 1 --2- 172.21.15.146:0/1245178666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa76c0960d0 0x7fa76c119e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.126 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.122+0000 7fa77226d700 1 -- 172.21.15.146:0/1245178666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7680092a0 con 0x7fa76c119980 2023-10-03T10:09:36.126 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.122+0000 7fa771a6c700 1 --2- 172.21.15.146:0/1245178666 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa76c095310 0x7fa76c11d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:36.126 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.123+0000 7fa77226d700 1 --2- 172.21.15.146:0/1245178666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa76c119980 0x7fa76c11a340 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fa764009e90 tx=0x7fa76400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:36.126 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.123+0000 7fa761ffb700 1 -- 172.21.15.146:0/1245178666 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76400caa0 con 0x7fa76c119980 2023-10-03T10:09:36.126 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.123+0000 7fa761ffb700 1 -- 172.21.15.146:0/1245178666 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76400f040 con 0x7fa76c119980 2023-10-03T10:09:36.126 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.123+0000 7fa773cd0700 1 -- 172.21.15.146:0/1245178666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa75c00b610 con 0x7fa76c119980 2023-10-03T10:09:36.126 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.123+0000 7fa761ffb700 1 -- 172.21.15.146:0/1245178666 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76400ce10 con 0x7fa76c119980 2023-10-03T10:09:36.126 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.123+0000 7fa761ffb700 1 -- 172.21.15.146:0/1245178666 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fa764013870 con 0x7fa76c119980 2023-10-03T10:09:36.126 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.123+0000 7fa773cd0700 1 -- 172.21.15.146:0/1245178666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76c11a9f0 con 0x7fa76c119980 2023-10-03T10:09:36.126 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.123+0000 7fa761ffb700 1 -- 172.21.15.146:0/1245178666 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fa764013d00 con 0x7fa76c119980 2023-10-03T10:09:36.126 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.124+0000 7fa773cd0700 1 -- 172.21.15.146:0/1245178666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76c063770 con 0x7fa76c119980 2023-10-03T10:09:36.127 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.128+0000 7fa761ffb700 1 -- 172.21.15.146:0/1245178666 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fa764027480 con 0x7fa76c119980 2023-10-03T10:09:36.168 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:36.168+0000 7f170ecce680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-03T10:09:36.194 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.195+0000 7fa773cd0700 1 -- 172.21.15.146:0/1245178666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa76c063370 con 0x7fa76c119980 2023-10-03T10:09:36.195 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.195+0000 7fa761ffb700 1 -- 172.21.15.146:0/1245178666 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7fa76401d5f0 con 0x7fa76c119980 2023-10-03T10:09:36.195 INFO:teuthology.misc.health.smithi146.stdout: 2023-10-03T10:09:36.195 INFO:teuthology.misc.health.smithi146.stdout:{"epoch":6,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:09:35.344070+0000","last_up_change":"0.000000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:36.196 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.196+0000 7fa773cd0700 1 -- 172.21.15.146:0/1245178666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa76c119980 msgr2=0x7fa76c11a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:36.196 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.196+0000 7fa773cd0700 1 --2- 172.21.15.146:0/1245178666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa76c119980 0x7fa76c11a340 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fa764009e90 tx=0x7fa76400b040).stop 2023-10-03T10:09:36.196 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.196+0000 7fa773cd0700 1 -- 172.21.15.146:0/1245178666 shutdown_connections 2023-10-03T10:09:36.196 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.196+0000 7fa773cd0700 1 --2- 172.21.15.146:0/1245178666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa76c119980 0x7fa76c11a340 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.196 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.196+0000 7fa773cd0700 1 --2- 172.21.15.146:0/1245178666 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa76c095310 0x7fa76c11d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.197 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.196+0000 7fa773cd0700 1 --2- 172.21.15.146:0/1245178666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa76c0960d0 0x7fa76c119e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:36.197 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.196+0000 7fa773cd0700 1 -- 172.21.15.146:0/1245178666 >> 172.21.15.146:0/1245178666 conn(0x7fa76c091b10 msgr2=0x7fa76c068fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:36.197 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.196+0000 7fa773cd0700 1 -- 172.21.15.146:0/1245178666 shutdown_connections 2023-10-03T10:09:36.197 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:36.196+0000 7fa773cd0700 1 -- 172.21.15.146:0/1245178666 wait complete. 2023-10-03T10:09:36.206 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-10-03T10:09:36.240 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:36.240+0000 7f170ecce680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-03T10:09:36.592 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:36.593+0000 7f170ecce680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-03T10:09:36.676 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:36.676+0000 7f170ecce680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-03T10:09:37.312 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:37.312+0000 7f170ecce680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-03T10:09:37.382 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:37.383+0000 7f170ecce680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-03T10:09:37.461 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:37.462+0000 7f170ecce680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-03T10:09:37.753 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:37.754+0000 7f170ecce680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-03T10:09:37.823 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:37.823+0000 7f170ecce680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-03T10:09:37.941 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:37.941+0000 7f170ecce680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-03T10:09:38.048 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:38.049+0000 7f170ecce680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-03T10:09:38.199 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:38.199+0000 7f170ecce680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-03T10:09:38.268 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:38.269+0000 7f170ecce680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-03T10:09:39.289 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:39.289+0000 7f16c570b700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-03T10:09:39.290 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:09:39.290+0000 7f16c570b700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-03T10:09:39.447 INFO:tasks.ceph.osd.0.smithi146.stderr:2023-10-03T10:09:39.447+0000 7f2f9818e200 -1 osd.0 0 log_to_monitors {default=true} 2023-10-03T10:09:39.489 INFO:tasks.ceph.osd.2.smithi146.stderr:2023-10-03T10:09:39.489+0000 7f76e352f200 -1 osd.2 0 log_to_monitors {default=true} 2023-10-03T10:09:39.489 INFO:tasks.ceph.osd.1.smithi146.stderr:2023-10-03T10:09:39.489+0000 7f68adc87200 -1 osd.1 0 log_to_monitors {default=true} 2023-10-03T10:09:39.509 INFO:tasks.ceph.osd.3.smithi146.stderr:2023-10-03T10:09:39.510+0000 7f79bd110200 -1 osd.3 0 log_to_monitors {default=true} 2023-10-03T10:09:41.293 INFO:tasks.ceph.osd.0.smithi146.stderr:2023-10-03T10:09:41.294+0000 7f2f8eb2f700 -1 osd.0 0 waiting for initial osdmap 2023-10-03T10:09:41.294 INFO:tasks.ceph.osd.1.smithi146.stderr:2023-10-03T10:09:41.295+0000 7f68a4628700 -1 osd.1 0 waiting for initial osdmap 2023-10-03T10:09:41.295 INFO:tasks.ceph.osd.2.smithi146.stderr:2023-10-03T10:09:41.295+0000 7f76d9ed0700 -1 osd.2 0 waiting for initial osdmap 2023-10-03T10:09:41.295 INFO:tasks.ceph.osd.3.smithi146.stderr:2023-10-03T10:09:41.295+0000 7f79b3ab1700 -1 osd.3 0 waiting for initial osdmap 2023-10-03T10:09:41.298 INFO:tasks.ceph.osd.0.smithi146.stderr:2023-10-03T10:09:41.299+0000 7f2f8b2ab700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:09:41.302 INFO:tasks.ceph.osd.2.smithi146.stderr:2023-10-03T10:09:41.302+0000 7f76d664c700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:09:41.302 INFO:tasks.ceph.osd.1.smithi146.stderr:2023-10-03T10:09:41.303+0000 7f68a0da4700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:09:41.305 INFO:tasks.ceph.osd.3.smithi146.stderr:2023-10-03T10:09:41.305+0000 7f79b022d700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:09:42.609 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:42.728 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.728+0000 7f0c5722b700 1 Processor -- start 2023-10-03T10:09:42.728 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.728+0000 7f0c5722b700 1 -- start start 2023-10-03T10:09:42.730 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.729+0000 7f0c5722b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c50062850 0x7f0c501275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.730 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.729+0000 7f0c5722b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c50128000 0x7f0c50095a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.730 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.729+0000 7f0c5722b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c50091b00 con 0x7f0c50127be0 2023-10-03T10:09:42.730 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.729+0000 7f0c5722b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c50062c30 con 0x7f0c50062850 2023-10-03T10:09:42.730 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.729+0000 7f0c5722b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c50128490 con 0x7f0c50128000 2023-10-03T10:09:42.730 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.729+0000 7f0c557c8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c50128000 0x7f0c50095a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.731 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.729+0000 7f0c54fc7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c50062850 0x7f0c501275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.731 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.729+0000 7f0c557c8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c50128000 0x7f0c50095a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56332/0 (socket says 172.21.15.146:56332) 2023-10-03T10:09:42.731 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.729+0000 7f0c54fc7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c50062850 0x7f0c501275c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53824/0 (socket says 172.21.15.146:53824) 2023-10-03T10:09:42.731 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.729+0000 7f0c557c8700 1 -- 172.21.15.146:0/3411380444 learned_addr learned my addr 172.21.15.146:0/3411380444 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:42.731 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.729+0000 7f0c4ffff700 1 --1- 172.21.15.146:0/3411380444 >> v1:172.21.15.146:6789/0 conn(0x7f0c50127be0 0x7f0c50095310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52110/0 (socket says 172.21.15.146:52110) 2023-10-03T10:09:42.731 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.729+0000 7f0c557c8700 1 -- 172.21.15.146:0/3411380444 >> v2:172.21.15.146:3300/0 conn(0x7f0c50062850 msgr2=0x7f0c501275c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:42.731 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.729+0000 7f0c557c8700 1 --2- 172.21.15.146:0/3411380444 >> v2:172.21.15.146:3300/0 conn(0x7f0c50062850 0x7f0c501275c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.731 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.729+0000 7f0c557c8700 1 -- 172.21.15.146:0/3411380444 >> v1:172.21.15.146:6789/0 conn(0x7f0c50127be0 legacy=0x7f0c50095310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.731 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.729+0000 7f0c557c8700 1 -- 172.21.15.146:0/3411380444 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c500929b0 con 0x7f0c50128000 2023-10-03T10:09:42.731 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.729+0000 7f0c54fc7700 1 --2- 172.21.15.146:0/3411380444 >> v2:172.21.15.146:3300/0 conn(0x7f0c50062850 0x7f0c501275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:42.731 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.730+0000 7f0c557c8700 1 --2- 172.21.15.146:0/3411380444 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c50128000 0x7f0c50095a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f0c48009f20 tx=0x7f0c48009840).ready entity=mon.2 client_cookie=7b486b52b1dc45b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:42.731 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.730+0000 7f0c4f7fe700 1 -- 172.21.15.146:0/3411380444 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4800e070 con 0x7f0c50128000 2023-10-03T10:09:42.732 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.730+0000 7f0c4f7fe700 1 -- 172.21.15.146:0/3411380444 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4800b9d0 con 0x7f0c50128000 2023-10-03T10:09:42.732 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.730+0000 7f0c4f7fe700 1 -- 172.21.15.146:0/3411380444 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4800bd50 con 0x7f0c50128000 2023-10-03T10:09:42.732 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.730+0000 7f0c5722b700 1 -- 172.21.15.146:0/3411380444 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c50128000 msgr2=0x7f0c50095a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.732 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.730+0000 7f0c5722b700 1 --2- 172.21.15.146:0/3411380444 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c50128000 0x7f0c50095a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f0c48009f20 tx=0x7f0c48009840).stop 2023-10-03T10:09:42.732 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.730+0000 7f0c5722b700 1 -- 172.21.15.146:0/3411380444 shutdown_connections 2023-10-03T10:09:42.732 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.730+0000 7f0c5722b700 1 --2- 172.21.15.146:0/3411380444 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c50128000 0x7f0c50095a20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.732 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.730+0000 7f0c5722b700 1 --2- 172.21.15.146:0/3411380444 >> v2:172.21.15.146:3300/0 conn(0x7f0c50062850 0x7f0c501275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.732 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.730+0000 7f0c5722b700 1 -- 172.21.15.146:0/3411380444 >> 172.21.15.146:0/3411380444 conn(0x7f0c5005ee70 msgr2=0x7f0c50097410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:42.732 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.730+0000 7f0c5722b700 1 -- 172.21.15.146:0/3411380444 shutdown_connections 2023-10-03T10:09:42.732 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.730+0000 7f0c5722b700 1 -- 172.21.15.146:0/3411380444 wait complete. 2023-10-03T10:09:42.734 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.731+0000 7f0c5722b700 1 Processor -- start 2023-10-03T10:09:42.734 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.731+0000 7f0c5722b700 1 -- start start 2023-10-03T10:09:42.734 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.732+0000 7f0c5722b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c50127be0 0x7f0c50068380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.734 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.732+0000 7f0c5722b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c50128000 0x7f0c50068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.734 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.732+0000 7f0c5722b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5013a350 0x7f0c5013a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.734 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.732+0000 7f0c5722b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c50091ec0 con 0x7f0c50128000 2023-10-03T10:09:42.734 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.732+0000 7f0c5722b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c501160a0 con 0x7f0c5013a350 2023-10-03T10:09:42.735 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.732+0000 7f0c5722b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c50127160 con 0x7f0c50127be0 2023-10-03T10:09:42.735 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.732+0000 7f0c4ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c50128000 0x7f0c50068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.735 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.732+0000 7f0c54fc7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c50127be0 0x7f0c50068380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.735 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.732+0000 7f0c557c8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5013a350 0x7f0c5013a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.735 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.732+0000 7f0c54fc7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c50127be0 0x7f0c50068380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56338/0 (socket says 172.21.15.146:56338) 2023-10-03T10:09:42.735 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.732+0000 7f0c54fc7700 1 -- 172.21.15.146:0/492242452 learned_addr learned my addr 172.21.15.146:0/492242452 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:42.735 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.732+0000 7f0c4ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c50128000 0x7f0c50068870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53832/0 (socket says 172.21.15.146:53832) 2023-10-03T10:09:42.735 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.732+0000 7f0c557c8700 1 -- 172.21.15.146:0/492242452 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c50127be0 msgr2=0x7f0c50068380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.735 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.732+0000 7f0c557c8700 1 --2- 172.21.15.146:0/492242452 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c50127be0 0x7f0c50068380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.735 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.732+0000 7f0c557c8700 1 -- 172.21.15.146:0/492242452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c50128000 msgr2=0x7f0c50068870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.735 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.732+0000 7f0c557c8700 1 --2- 172.21.15.146:0/492242452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c50128000 0x7f0c50068870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.735 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.732+0000 7f0c557c8700 1 -- 172.21.15.146:0/492242452 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c440092a0 con 0x7f0c5013a350 2023-10-03T10:09:42.736 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.732+0000 7f0c4ffff700 1 --2- 172.21.15.146:0/492242452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c50128000 0x7f0c50068870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:42.736 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.733+0000 7f0c557c8700 1 --2- 172.21.15.146:0/492242452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5013a350 0x7f0c5013a7b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f0c500636c0 tx=0x7f0c48009840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:42.736 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.733+0000 7f0c4cff9700 1 -- 172.21.15.146:0/492242452 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c480092e0 con 0x7f0c5013a350 2023-10-03T10:09:42.736 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.733+0000 7f0c4cff9700 1 -- 172.21.15.146:0/492242452 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c48007610 con 0x7f0c5013a350 2023-10-03T10:09:42.736 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.733+0000 7f0c4cff9700 1 -- 172.21.15.146:0/492242452 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c480079d0 con 0x7f0c5013a350 2023-10-03T10:09:42.736 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.733+0000 7f0c5722b700 1 -- 172.21.15.146:0/492242452 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c48009ae0 con 0x7f0c5013a350 2023-10-03T10:09:42.736 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.733+0000 7f0c5722b700 1 -- 172.21.15.146:0/492242452 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c500696e0 con 0x7f0c5013a350 2023-10-03T10:09:42.736 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.733+0000 7f0c4cff9700 1 -- 172.21.15.146:0/492242452 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f0c48003040 con 0x7f0c5013a350 2023-10-03T10:09:42.736 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.734+0000 7f0c4cff9700 1 -- 172.21.15.146:0/492242452 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2069+0+0 (secure 0 0 0) 0x7f0c4803c530 con 0x7f0c5013a350 2023-10-03T10:09:42.736 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.734+0000 7f0c5722b700 1 -- 172.21.15.146:0/492242452 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5005a260 con 0x7f0c5013a350 2023-10-03T10:09:42.738 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.739+0000 7f0c4cff9700 1 -- 172.21.15.146:0/492242452 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f0c480123c0 con 0x7f0c5013a350 2023-10-03T10:09:42.896 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.897+0000 7f0c5722b700 1 -- 172.21.15.146:0/492242452 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c50127890 con 0x7f0c5013a350 2023-10-03T10:09:42.897 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.897+0000 7f0c4cff9700 1 -- 172.21.15.146:0/492242452 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+4968 (secure 0 0 0) 0x7f0c48024030 con 0x7f0c5013a350 2023-10-03T10:09:42.897 INFO:teuthology.misc.health.smithi146.stdout: 2023-10-03T10:09:42.897 INFO:teuthology.misc.health.smithi146.stdout:{"epoch":9,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:09:42.301022+0000","last_up_change":"2023-10-03T10:09:42.301022+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":118758}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":118758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":118758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":118758}]},"public_addr":"172.21.15.146:6800/118758","cluster_addr":"172.21.15.146:6801/118758","heartbeat_back_addr":"172.21.15.146:6803/118758","heartbeat_front_addr":"172.21.15.146:6802/118758","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":118774}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":118774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":118774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":118774}]},"public_addr":"172.21.15.146:6804/118774","cluster_addr":"172.21.15.146:6806/118774","heartbeat_back_addr":"172.21.15.146:6810/118774","heartbeat_front_addr":"172.21.15.146:6808/118774","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":118775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":118775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":118775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":118775}]},"public_addr":"172.21.15.146:6805/118775","cluster_addr":"172.21.15.146:6807/118775","heartbeat_back_addr":"172.21.15.146:6811/118775","heartbeat_front_addr":"172.21.15.146:6809/118775","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":118776}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":118776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":118776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":118776}]},"public_addr":"172.21.15.146:6812/118776","cluster_addr":"172.21.15.146:6813/118776","heartbeat_back_addr":"172.21.15.146:6815/118776","heartbeat_front_addr":"172.21.15.146:6814/118776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:42.899 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.899+0000 7f0c5722b700 1 -- 172.21.15.146:0/492242452 >> v1:172.21.15.146:6816/118159 conn(0x7f0c3402bb60 legacy=0x7f0c3402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.899 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.899+0000 7f0c5722b700 1 -- 172.21.15.146:0/492242452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5013a350 msgr2=0x7f0c5013a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.899 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.899+0000 7f0c5722b700 1 --2- 172.21.15.146:0/492242452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5013a350 0x7f0c5013a7b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f0c500636c0 tx=0x7f0c48009840).stop 2023-10-03T10:09:42.899 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.899+0000 7f0c5722b700 1 -- 172.21.15.146:0/492242452 shutdown_connections 2023-10-03T10:09:42.899 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.899+0000 7f0c5722b700 1 --2- 172.21.15.146:0/492242452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5013a350 0x7f0c5013a7b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.899 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.899+0000 7f0c5722b700 1 --2- 172.21.15.146:0/492242452 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c50127be0 0x7f0c50068380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.899 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.899+0000 7f0c5722b700 1 --2- 172.21.15.146:0/492242452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c50128000 0x7f0c50068870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.899 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.899+0000 7f0c5722b700 1 -- 172.21.15.146:0/492242452 >> 172.21.15.146:0/492242452 conn(0x7f0c50062850 msgr2=0x7f0c5012de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:42.900 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.899+0000 7f0c5722b700 1 -- 172.21.15.146:0/492242452 shutdown_connections 2023-10-03T10:09:42.900 INFO:teuthology.misc.health.smithi146.stderr:2023-10-03T10:09:42.899+0000 7f0c5722b700 1 -- 172.21.15.146:0/492242452 wait complete. 2023-10-03T10:09:42.910 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-10-03T10:09:42.910 INFO:tasks.ceph:Creating RBD pool 2023-10-03T10:09:42.910 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-03T10:09:43.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.025+0000 7f941559f700 1 Processor -- start 2023-10-03T10:09:43.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.025+0000 7f941559f700 1 -- start start 2023-10-03T10:09:43.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.026+0000 7f941559f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f941005f560 0x7f9410128cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.026+0000 7f941559f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f941012dd40 0x7f9410130130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.026+0000 7f941559f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9410093340 con 0x7f9410092190 2023-10-03T10:09:43.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.026+0000 7f941559f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941005f940 con 0x7f941005f560 2023-10-03T10:09:43.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.026+0000 7f941559f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9410097c30 con 0x7f941012dd40 2023-10-03T10:09:43.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.026+0000 7f940effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f941005f560 0x7f9410128cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.026+0000 7f940f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f941012dd40 0x7f9410130130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.026+0000 7f940f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f941012dd40 0x7f9410130130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56354/0 (socket says 172.21.15.146:56354) 2023-10-03T10:09:43.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.026+0000 7f940e7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9410092190 0x7f94101291a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52114/0 (socket says 172.21.15.146:52114) 2023-10-03T10:09:43.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.026+0000 7f940effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f941005f560 0x7f9410128cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53846/0 (socket says 172.21.15.146:53846) 2023-10-03T10:09:43.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.026+0000 7f940f7fe700 1 -- 172.21.15.146:0/2512263076 learned_addr learned my addr 172.21.15.146:0/2512263076 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:43.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.026+0000 7f940f7fe700 1 -- 172.21.15.146:0/2512263076 >> v2:172.21.15.146:3300/0 conn(0x7f941005f560 msgr2=0x7f9410128cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:43.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.026+0000 7f940f7fe700 1 --2- 172.21.15.146:0/2512263076 >> v2:172.21.15.146:3300/0 conn(0x7f941005f560 0x7f9410128cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.026+0000 7f940f7fe700 1 -- 172.21.15.146:0/2512263076 >> v1:172.21.15.146:6789/0 conn(0x7f9410092190 legacy=0x7f94101291a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.026+0000 7f940f7fe700 1 -- 172.21.15.146:0/2512263076 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94100941f0 con 0x7f941012dd40 2023-10-03T10:09:43.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.026+0000 7f940effd700 1 --2- 172.21.15.146:0/2512263076 >> v2:172.21.15.146:3300/0 conn(0x7f941005f560 0x7f9410128cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:43.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.026+0000 7f940f7fe700 1 --2- 172.21.15.146:0/2512263076 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f941012dd40 0x7f9410130130 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f9408009f20 tx=0x7f9408009840).ready entity=mon.2 client_cookie=e31c1f4d8a296fff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:43.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.026+0000 7f940dffb700 1 -- 172.21.15.146:0/2512263076 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940800e070 con 0x7f941012dd40 2023-10-03T10:09:43.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.026+0000 7f940dffb700 1 -- 172.21.15.146:0/2512263076 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940800b9d0 con 0x7f941012dd40 2023-10-03T10:09:43.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.026+0000 7f940dffb700 1 -- 172.21.15.146:0/2512263076 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940800bd50 con 0x7f941012dd40 2023-10-03T10:09:43.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.027+0000 7f941559f700 1 -- 172.21.15.146:0/2512263076 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f941012dd40 msgr2=0x7f9410130130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.027+0000 7f941559f700 1 --2- 172.21.15.146:0/2512263076 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f941012dd40 0x7f9410130130 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f9408009f20 tx=0x7f9408009840).stop 2023-10-03T10:09:43.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.027+0000 7f941559f700 1 -- 172.21.15.146:0/2512263076 shutdown_connections 2023-10-03T10:09:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.027+0000 7f941559f700 1 --2- 172.21.15.146:0/2512263076 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f941012dd40 0x7f9410130130 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.027+0000 7f941559f700 1 --2- 172.21.15.146:0/2512263076 >> v2:172.21.15.146:3300/0 conn(0x7f941005f560 0x7f9410128cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.027+0000 7f941559f700 1 -- 172.21.15.146:0/2512263076 >> 172.21.15.146:0/2512263076 conn(0x7f941009a1c0 msgr2=0x7f941009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.027+0000 7f941559f700 1 -- 172.21.15.146:0/2512263076 shutdown_connections 2023-10-03T10:09:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.027+0000 7f941559f700 1 -- 172.21.15.146:0/2512263076 wait complete. 2023-10-03T10:09:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.028+0000 7f941559f700 1 Processor -- start 2023-10-03T10:09:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.028+0000 7f941559f700 1 -- start start 2023-10-03T10:09:43.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.028+0000 7f941559f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f941005f560 0x7f941012a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.028+0000 7f941559f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9410092190 0x7f941012aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.028+0000 7f941559f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f941012dd40 0x7f941012b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.028+0000 7f941559f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941012b8b0 con 0x7f9410092190 2023-10-03T10:09:43.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.028+0000 7f941559f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9410097d80 con 0x7f941005f560 2023-10-03T10:09:43.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.028+0000 7f941559f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f941012be40 con 0x7f941012dd40 2023-10-03T10:09:43.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.028+0000 7f940e7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9410092190 0x7f941012aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.028+0000 7f940f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f941012dd40 0x7f941012b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.028+0000 7f940effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f941005f560 0x7f941012a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.028+0000 7f940e7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9410092190 0x7f941012aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53856/0 (socket says 172.21.15.146:53856) 2023-10-03T10:09:43.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.028+0000 7f940e7fc700 1 -- 172.21.15.146:0/1121092935 learned_addr learned my addr 172.21.15.146:0/1121092935 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:43.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.028+0000 7f940f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f941012dd40 0x7f941012b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56356/0 (socket says 172.21.15.146:56356) 2023-10-03T10:09:43.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.029+0000 7f940effd700 1 -- 172.21.15.146:0/1121092935 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f941012dd40 msgr2=0x7f941012b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.029+0000 7f940effd700 1 --2- 172.21.15.146:0/1121092935 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f941012dd40 0x7f941012b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.029+0000 7f940effd700 1 -- 172.21.15.146:0/1121092935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9410092190 msgr2=0x7f941012aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.029+0000 7f940effd700 1 --2- 172.21.15.146:0/1121092935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9410092190 0x7f941012aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.029+0000 7f940effd700 1 -- 172.21.15.146:0/1121092935 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94040092a0 con 0x7f941005f560 2023-10-03T10:09:43.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.029+0000 7f940f7fe700 1 --2- 172.21.15.146:0/1121092935 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f941012dd40 0x7f941012b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:43.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.029+0000 7f940e7fc700 1 --2- 172.21.15.146:0/1121092935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9410092190 0x7f941012aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:43.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.029+0000 7f940effd700 1 --2- 172.21.15.146:0/1121092935 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f941005f560 0x7f941012a9e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f940400e980 tx=0x7f9404009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:43.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.029+0000 7f93f6ffd700 1 -- 172.21.15.146:0/1121092935 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404012600 con 0x7f941005f560 2023-10-03T10:09:43.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.029+0000 7f93f6ffd700 1 -- 172.21.15.146:0/1121092935 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9404012760 con 0x7f941005f560 2023-10-03T10:09:43.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.029+0000 7f941559f700 1 -- 172.21.15.146:0/1121092935 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9408009ae0 con 0x7f941005f560 2023-10-03T10:09:43.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.029+0000 7f93f6ffd700 1 -- 172.21.15.146:0/1121092935 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404012ae0 con 0x7f941005f560 2023-10-03T10:09:43.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.029+0000 7f941559f700 1 -- 172.21.15.146:0/1121092935 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941012d9b0 con 0x7f941005f560 2023-10-03T10:09:43.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.030+0000 7f93f6ffd700 1 -- 172.21.15.146:0/1121092935 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f940401b400 con 0x7f941005f560 2023-10-03T10:09:43.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.030+0000 7f93f6ffd700 1 -- 172.21.15.146:0/1121092935 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2069+0+0 (secure 0 0 0) 0x7f940403ade0 con 0x7f941005f560 2023-10-03T10:09:43.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.030+0000 7f941559f700 1 -- 172.21.15.146:0/1121092935 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9410093560 con 0x7f941005f560 2023-10-03T10:09:43.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.034+0000 7f93f6ffd700 1 -- 172.21.15.146:0/1121092935 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9404016070 con 0x7f941005f560 2023-10-03T10:09:43.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.192+0000 7f941559f700 1 -- 172.21.15.146:0/1121092935 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f94101153e0 con 0x7f941005f560 2023-10-03T10:09:43.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.322+0000 7f93f6ffd700 1 -- 172.21.15.146:0/1121092935 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v10) v1 ==== 109+0+0 (secure 0 0 0) 0x7f94040290a0 con 0x7f941005f560 2023-10-03T10:09:43.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.325+0000 7f941559f700 1 -- 172.21.15.146:0/1121092935 >> v1:172.21.15.146:6816/118159 conn(0x7f93fc02bb90 legacy=0x7f93fc02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.325+0000 7f941559f700 1 -- 172.21.15.146:0/1121092935 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f941005f560 msgr2=0x7f941012a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.325+0000 7f941559f700 1 --2- 172.21.15.146:0/1121092935 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f941005f560 0x7f941012a9e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f940400e980 tx=0x7f9404009060).stop 2023-10-03T10:09:43.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.325+0000 7f941559f700 1 -- 172.21.15.146:0/1121092935 shutdown_connections 2023-10-03T10:09:43.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.325+0000 7f941559f700 1 --2- 172.21.15.146:0/1121092935 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f941012dd40 0x7f941012b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.325+0000 7f941559f700 1 --2- 172.21.15.146:0/1121092935 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f941005f560 0x7f941012a9e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.325+0000 7f941559f700 1 --2- 172.21.15.146:0/1121092935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9410092190 0x7f941012aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.325+0000 7f941559f700 1 -- 172.21.15.146:0/1121092935 >> 172.21.15.146:0/1121092935 conn(0x7f941009a1c0 msgr2=0x7f9410128110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:43.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.325+0000 7f941559f700 1 -- 172.21.15.146:0/1121092935 shutdown_connections 2023-10-03T10:09:43.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.325+0000 7f941559f700 1 -- 172.21.15.146:0/1121092935 wait complete. 2023-10-03T10:09:43.326 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'rbd' created 2023-10-03T10:09:43.336 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-03T10:09:43.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.454+0000 7f4d7177c700 1 Processor -- start 2023-10-03T10:09:43.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.454+0000 7f4d7177c700 1 -- start start 2023-10-03T10:09:43.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.454+0000 7f4d7177c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d6c097bc0 0x7f4d6c098d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.454+0000 7f4d7177c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d6c099200 0x7f4d6c1324d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.454+0000 7f4d7177c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6c09a520 con 0x7f4d6c0653b0 2023-10-03T10:09:43.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.454+0000 7f4d7177c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c065790 con 0x7f4d6c099200 2023-10-03T10:09:43.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.454+0000 7f4d7177c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c096050 con 0x7f4d6c097bc0 2023-10-03T10:09:43.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.455+0000 7f4d6b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d6c099200 0x7f4d6c1324d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.455+0000 7f4d6a7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d6c097bc0 0x7f4d6c098d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.455+0000 7f4d6a7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d6c097bc0 0x7f4d6c098d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56360/0 (socket says 172.21.15.146:56360) 2023-10-03T10:09:43.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.455+0000 7f4d6a7fc700 1 -- 172.21.15.146:0/2643853197 learned_addr learned my addr 172.21.15.146:0/2643853197 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:43.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.455+0000 7f4d6b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d6c099200 0x7f4d6c1324d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53986/0 (socket says 172.21.15.146:53986) 2023-10-03T10:09:43.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.455+0000 7f4d6affd700 1 --1- 172.21.15.146:0/2643853197 >> v1:172.21.15.146:6789/0 conn(0x7f4d6c0653b0 0x7f4d6c098600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52120/0 (socket says 172.21.15.146:52120) 2023-10-03T10:09:43.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.455+0000 7f4d6b7fe700 1 -- 172.21.15.146:0/2643853197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d6c097bc0 msgr2=0x7f4d6c098d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:43.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.455+0000 7f4d6b7fe700 1 --2- 172.21.15.146:0/2643853197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d6c097bc0 0x7f4d6c098d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.455+0000 7f4d69ffb700 1 -- 172.21.15.146:0/2643853197 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132485259 0 0) 0x7f4d6c09a520 con 0x7f4d6c0653b0 2023-10-03T10:09:43.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.455+0000 7f4d6b7fe700 1 -- 172.21.15.146:0/2643853197 >> v1:172.21.15.146:6789/0 conn(0x7f4d6c0653b0 legacy=0x7f4d6c098600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.455+0000 7f4d6b7fe700 1 -- 172.21.15.146:0/2643853197 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c098050 con 0x7f4d6c099200 2023-10-03T10:09:43.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.455+0000 7f4d6a7fc700 1 --2- 172.21.15.146:0/2643853197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d6c097bc0 0x7f4d6c098d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:43.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.455+0000 7f4d6b7fe700 1 --2- 172.21.15.146:0/2643853197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d6c099200 0x7f4d6c1324d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f4d64009ec0 tx=0x7f4d64009780).ready entity=mon.1 client_cookie=6e8b65c1495f2812 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:43.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.455+0000 7f4d69ffb700 1 -- 172.21.15.146:0/2643853197 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6400e070 con 0x7f4d6c099200 2023-10-03T10:09:43.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.455+0000 7f4d69ffb700 1 -- 172.21.15.146:0/2643853197 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6400bbf0 con 0x7f4d6c099200 2023-10-03T10:09:43.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.455+0000 7f4d69ffb700 1 -- 172.21.15.146:0/2643853197 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64012410 con 0x7f4d6c099200 2023-10-03T10:09:43.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.456+0000 7f4d7177c700 1 -- 172.21.15.146:0/2643853197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d6c099200 msgr2=0x7f4d6c1324d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.456+0000 7f4d7177c700 1 --2- 172.21.15.146:0/2643853197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d6c099200 0x7f4d6c1324d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f4d64009ec0 tx=0x7f4d64009780).stop 2023-10-03T10:09:43.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.456+0000 7f4d7177c700 1 -- 172.21.15.146:0/2643853197 shutdown_connections 2023-10-03T10:09:43.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.456+0000 7f4d7177c700 1 --2- 172.21.15.146:0/2643853197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d6c099200 0x7f4d6c1324d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.456+0000 7f4d7177c700 1 --2- 172.21.15.146:0/2643853197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d6c097bc0 0x7f4d6c098d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.456+0000 7f4d7177c700 1 -- 172.21.15.146:0/2643853197 >> 172.21.15.146:0/2643853197 conn(0x7f4d6c09dc60 msgr2=0x7f4d6c09e070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:43.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.456+0000 7f4d7177c700 1 -- 172.21.15.146:0/2643853197 shutdown_connections 2023-10-03T10:09:43.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.456+0000 7f4d7177c700 1 -- 172.21.15.146:0/2643853197 wait complete. 2023-10-03T10:09:43.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.457+0000 7f4d7177c700 1 Processor -- start 2023-10-03T10:09:43.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.457+0000 7f4d7177c700 1 -- start start 2023-10-03T10:09:43.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.457+0000 7f4d7177c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d6c0653b0 0x7f4d6c11e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.457+0000 7f4d7177c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d6c099200 0x7f4d6c11a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.457+0000 7f4d7177c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d6c11aa80 0x7f4d6c11af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.457+0000 7f4d7177c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c11dcd0 con 0x7f4d6c0653b0 2023-10-03T10:09:43.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.457+0000 7f4d7177c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c1325b0 con 0x7f4d6c11aa80 2023-10-03T10:09:43.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.457+0000 7f4d7177c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c11d780 con 0x7f4d6c099200 2023-10-03T10:09:43.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.457+0000 7f4d6a7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d6c099200 0x7f4d6c11a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.457+0000 7f4d6b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d6c11aa80 0x7f4d6c11af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.457+0000 7f4d6affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d6c0653b0 0x7f4d6c11e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.457+0000 7f4d6b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d6c11aa80 0x7f4d6c11af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53988/0 (socket says 172.21.15.146:53988) 2023-10-03T10:09:43.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.457+0000 7f4d6a7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d6c099200 0x7f4d6c11a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56370/0 (socket says 172.21.15.146:56370) 2023-10-03T10:09:43.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.457+0000 7f4d6b7fe700 1 -- 172.21.15.146:0/2575907575 learned_addr learned my addr 172.21.15.146:0/2575907575 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:43.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.458+0000 7f4d6a7fc700 1 -- 172.21.15.146:0/2575907575 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d6c11aa80 msgr2=0x7f4d6c11af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.458+0000 7f4d6a7fc700 1 --2- 172.21.15.146:0/2575907575 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d6c11aa80 0x7f4d6c11af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.458+0000 7f4d6a7fc700 1 -- 172.21.15.146:0/2575907575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d6c0653b0 msgr2=0x7f4d6c11e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.458+0000 7f4d6a7fc700 1 --2- 172.21.15.146:0/2575907575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d6c0653b0 0x7f4d6c11e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.458+0000 7f4d6a7fc700 1 -- 172.21.15.146:0/2575907575 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c009370 con 0x7f4d6c099200 2023-10-03T10:09:43.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.458+0000 7f4d6affd700 1 --2- 172.21.15.146:0/2575907575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d6c0653b0 0x7f4d6c11e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:43.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.458+0000 7f4d6a7fc700 1 --2- 172.21.15.146:0/2575907575 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d6c099200 0x7f4d6c11a590 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f4d6c0659c0 tx=0x7f4d5c0090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:43.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.458+0000 7f4d52ffd700 1 -- 172.21.15.146:0/2575907575 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c009650 con 0x7f4d6c099200 2023-10-03T10:09:43.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.458+0000 7f4d52ffd700 1 -- 172.21.15.146:0/2575907575 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5c00c670 con 0x7f4d6c099200 2023-10-03T10:09:43.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.458+0000 7f4d7177c700 1 -- 172.21.15.146:0/2575907575 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d64009a20 con 0x7f4d6c099200 2023-10-03T10:09:43.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.458+0000 7f4d52ffd700 1 -- 172.21.15.146:0/2575907575 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c00c9f0 con 0x7f4d6c099200 2023-10-03T10:09:43.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.458+0000 7f4d7177c700 1 -- 172.21.15.146:0/2575907575 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6c11b970 con 0x7f4d6c099200 2023-10-03T10:09:43.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.458+0000 7f4d52ffd700 1 -- 172.21.15.146:0/2575907575 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4d5c01b400 con 0x7f4d6c099200 2023-10-03T10:09:43.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.459+0000 7f4d52ffd700 1 -- 172.21.15.146:0/2575907575 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2803+0+0 (secure 0 0 0) 0x7f4d5c03b120 con 0x7f4d6c099200 2023-10-03T10:09:43.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.459+0000 7f4d7177c700 1 -- 172.21.15.146:0/2575907575 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6c099a50 con 0x7f4d6c099200 2023-10-03T10:09:43.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.464+0000 7f4d52ffd700 1 -- 172.21.15.146:0/2575907575 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4d5c019310 con 0x7f4d6c099200 2023-10-03T10:09:43.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:43.626+0000 7f4d7177c700 1 -- 172.21.15.146:0/2575907575 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4d6c05a260 con 0x7f4d6c099200 2023-10-03T10:09:44.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.328+0000 7f4d52ffd700 1 -- 172.21.15.146:0/2575907575 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v11) v1 ==== 173+0+0 (secure 0 0 0) 0x7f4d5c023350 con 0x7f4d6c099200 2023-10-03T10:09:44.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.332+0000 7f4d7177c700 1 -- 172.21.15.146:0/2575907575 >> v1:172.21.15.146:6816/118159 conn(0x7f4d5802bb60 legacy=0x7f4d5802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.332+0000 7f4d7177c700 1 -- 172.21.15.146:0/2575907575 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d6c099200 msgr2=0x7f4d6c11a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.332+0000 7f4d7177c700 1 --2- 172.21.15.146:0/2575907575 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d6c099200 0x7f4d6c11a590 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f4d6c0659c0 tx=0x7f4d5c0090f0).stop 2023-10-03T10:09:44.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.332+0000 7f4d7177c700 1 -- 172.21.15.146:0/2575907575 shutdown_connections 2023-10-03T10:09:44.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.332+0000 7f4d7177c700 1 --2- 172.21.15.146:0/2575907575 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d6c11aa80 0x7f4d6c11af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.332+0000 7f4d7177c700 1 --2- 172.21.15.146:0/2575907575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d6c0653b0 0x7f4d6c11e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.332+0000 7f4d7177c700 1 --2- 172.21.15.146:0/2575907575 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d6c099200 0x7f4d6c11a590 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.332+0000 7f4d7177c700 1 -- 172.21.15.146:0/2575907575 >> 172.21.15.146:0/2575907575 conn(0x7f4d6c09dc60 msgr2=0x7f4d6c09a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:44.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.332+0000 7f4d7177c700 1 -- 172.21.15.146:0/2575907575 shutdown_connections 2023-10-03T10:09:44.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.333+0000 7f4d7177c700 1 -- 172.21.15.146:0/2575907575 wait complete. 2023-10-03T10:09:44.334 INFO:teuthology.orchestra.run.smithi146.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-03T10:09:44.348 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-03T10:09:44.348 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-03T10:09:44.348 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-03T10:09:44.351 INFO:tasks.ceph.mds.a:Started 2023-10-03T10:09:44.351 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-03T10:09:44.351 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:44.431 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2023-10-03T10:09:44.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.476+0000 7f8cd623d700 1 Processor -- start 2023-10-03T10:09:44.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.476+0000 7f8cd623d700 1 -- start start 2023-10-03T10:09:44.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.476+0000 7f8cd623d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8cd0092990 0x7f8cd0065a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.476+0000 7f8cd623d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cd012b220 0x7f8cd0132e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.476+0000 7f8cd623d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd0097730 con 0x7f8cd0066050 2023-10-03T10:09:44.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.476+0000 7f8cd623d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd0092d70 con 0x7f8cd0092990 2023-10-03T10:09:44.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.476+0000 7f8cd623d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd00974b0 con 0x7f8cd012b220 2023-10-03T10:09:44.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.476+0000 7f8ccffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cd012b220 0x7f8cd0132e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.476+0000 7f8ccf7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8cd0092990 0x7f8cd0065a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.476+0000 7f8ccffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cd012b220 0x7f8cd0132e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33170/0 (socket says 172.21.15.146:33170) 2023-10-03T10:09:44.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.476+0000 7f8ccf7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8cd0092990 0x7f8cd0065a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37914/0 (socket says 172.21.15.146:37914) 2023-10-03T10:09:44.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.476+0000 7f8ccffff700 1 -- 172.21.15.146:0/1087517757 learned_addr learned my addr 172.21.15.146:0/1087517757 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:44.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.477+0000 7f8ccffff700 1 -- 172.21.15.146:0/1087517757 >> v2:172.21.15.146:3300/0 conn(0x7f8cd0092990 msgr2=0x7f8cd0065a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:44.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.477+0000 7f8ccffff700 1 --2- 172.21.15.146:0/1087517757 >> v2:172.21.15.146:3300/0 conn(0x7f8cd0092990 0x7f8cd0065a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.477+0000 7f8ccffff700 1 -- 172.21.15.146:0/1087517757 >> v1:172.21.15.146:6789/0 conn(0x7f8cd0066050 legacy=0x7f8cd012ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.477+0000 7f8ccffff700 1 -- 172.21.15.146:0/1087517757 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd0064740 con 0x7f8cd012b220 2023-10-03T10:09:44.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.477+0000 7f8ccf7fe700 1 --2- 172.21.15.146:0/1087517757 >> v2:172.21.15.146:3300/0 conn(0x7f8cd0092990 0x7f8cd0065a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:44.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.477+0000 7f8ccffff700 1 --2- 172.21.15.146:0/1087517757 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cd012b220 0x7f8cd0132e80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f8cc8009f20 tx=0x7f8cc8009840).ready entity=mon.1 client_cookie=2b8359f24aff85e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:44.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.477+0000 7f8cce7fc700 1 -- 172.21.15.146:0/1087517757 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc800e070 con 0x7f8cd012b220 2023-10-03T10:09:44.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.477+0000 7f8cce7fc700 1 -- 172.21.15.146:0/1087517757 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc800b9d0 con 0x7f8cd012b220 2023-10-03T10:09:44.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.477+0000 7f8cce7fc700 1 -- 172.21.15.146:0/1087517757 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc800bd50 con 0x7f8cd012b220 2023-10-03T10:09:44.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.477+0000 7f8cd623d700 1 -- 172.21.15.146:0/1087517757 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cd012b220 msgr2=0x7f8cd0132e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.477+0000 7f8cd623d700 1 --2- 172.21.15.146:0/1087517757 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cd012b220 0x7f8cd0132e80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f8cc8009f20 tx=0x7f8cc8009840).stop 2023-10-03T10:09:44.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.478+0000 7f8cd623d700 1 -- 172.21.15.146:0/1087517757 shutdown_connections 2023-10-03T10:09:44.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.478+0000 7f8cd623d700 1 --2- 172.21.15.146:0/1087517757 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cd012b220 0x7f8cd0132e80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.478+0000 7f8cd623d700 1 --2- 172.21.15.146:0/1087517757 >> v2:172.21.15.146:3300/0 conn(0x7f8cd0092990 0x7f8cd0065a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.478+0000 7f8cd623d700 1 -- 172.21.15.146:0/1087517757 >> 172.21.15.146:0/1087517757 conn(0x7f8cd009bba0 msgr2=0x7f8cd009bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:44.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.478+0000 7f8cd623d700 1 -- 172.21.15.146:0/1087517757 shutdown_connections 2023-10-03T10:09:44.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.478+0000 7f8cd623d700 1 -- 172.21.15.146:0/1087517757 wait complete. 2023-10-03T10:09:44.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.479+0000 7f8cd623d700 1 Processor -- start 2023-10-03T10:09:44.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.479+0000 7f8cd623d700 1 -- start start 2023-10-03T10:09:44.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.479+0000 7f8cd623d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cd0066050 0x7f8cd0117a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.479+0000 7f8cd623d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cd0092990 0x7f8cd0117f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.479+0000 7f8cd623d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cd012b220 0x7f8cd0118440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.479+0000 7f8cd623d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd009b040 con 0x7f8cd0092990 2023-10-03T10:09:44.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.479+0000 7f8cd623d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd006a710 con 0x7f8cd012b220 2023-10-03T10:09:44.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.479+0000 7f8cd623d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd011b590 con 0x7f8cd0066050 2023-10-03T10:09:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.479+0000 7f8ccf7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cd0066050 0x7f8cd0117a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.479+0000 7f8ccffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cd012b220 0x7f8cd0118440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.479+0000 7f8cceffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cd0092990 0x7f8cd0117f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.479+0000 7f8ccf7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cd0066050 0x7f8cd0117a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:47494/0 (socket says 172.21.15.146:47494) 2023-10-03T10:09:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.479+0000 7f8ccffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cd012b220 0x7f8cd0118440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33184/0 (socket says 172.21.15.146:33184) 2023-10-03T10:09:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.479+0000 7f8ccf7fe700 1 -- 172.21.15.146:0/1797369363 learned_addr learned my addr 172.21.15.146:0/1797369363 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.479+0000 7f8ccf7fe700 1 -- 172.21.15.146:0/1797369363 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cd012b220 msgr2=0x7f8cd0118440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.479+0000 7f8ccf7fe700 1 --2- 172.21.15.146:0/1797369363 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cd012b220 0x7f8cd0118440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.479+0000 7f8ccf7fe700 1 -- 172.21.15.146:0/1797369363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cd0092990 msgr2=0x7f8cd0117f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.479+0000 7f8ccf7fe700 1 --2- 172.21.15.146:0/1797369363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cd0092990 0x7f8cd0117f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.479+0000 7f8ccf7fe700 1 -- 172.21.15.146:0/1797369363 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc00092a0 con 0x7f8cd0066050 2023-10-03T10:09:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.479+0000 7f8ccffff700 1 --2- 172.21.15.146:0/1797369363 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cd012b220 0x7f8cd0118440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.479+0000 7f8cceffd700 1 --2- 172.21.15.146:0/1797369363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cd0092990 0x7f8cd0117f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.480+0000 7f8ccf7fe700 1 --2- 172.21.15.146:0/1797369363 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cd0066050 0x7f8cd0117a60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f8cc000ea50 tx=0x7f8cc0009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.480+0000 7f8cb77fe700 1 -- 172.21.15.146:0/1797369363 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc000ee90 con 0x7f8cd0066050 2023-10-03T10:09:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.480+0000 7f8cb77fe700 1 -- 172.21.15.146:0/1797369363 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc000c850 con 0x7f8cd0066050 2023-10-03T10:09:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.480+0000 7f8cb77fe700 1 -- 172.21.15.146:0/1797369363 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc000cbd0 con 0x7f8cd0066050 2023-10-03T10:09:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.480+0000 7f8cd623d700 1 -- 172.21.15.146:0/1797369363 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc8009ae0 con 0x7f8cd0066050 2023-10-03T10:09:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.480+0000 7f8cd623d700 1 -- 172.21.15.146:0/1797369363 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd0119770 con 0x7f8cd0066050 2023-10-03T10:09:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.480+0000 7f8cb77fe700 1 -- 172.21.15.146:0/1797369363 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8cc001b400 con 0x7f8cd0066050 2023-10-03T10:09:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.481+0000 7f8cb77fe700 1 -- 172.21.15.146:0/1797369363 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f8cc003b140 con 0x7f8cd0066050 2023-10-03T10:09:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.481+0000 7f8cd623d700 1 -- 172.21.15.146:0/1797369363 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd011b210 con 0x7f8cd0066050 2023-10-03T10:09:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.485+0000 7f8cb77fe700 1 -- 172.21.15.146:0/1797369363 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8cd011b210 con 0x7f8cd0066050 2023-10-03T10:09:44.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.645+0000 7f8cd623d700 1 -- 172.21.15.146:0/1797369363 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cd011b210 con 0x7f8cd0066050 2023-10-03T10:09:44.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.645+0000 7f8cb77fe700 1 -- 172.21.15.146:0/1797369363 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+8182 (secure 0 0 0) 0x7f8cd011b210 con 0x7f8cd0066050 2023-10-03T10:09:44.645 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:44.645 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":11,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:09:44.317954+0000","last_up_change":"2023-10-03T10:09:42.301022+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:42.343363+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":118758}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":118758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":118758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":118758}]},"public_addr":"172.21.15.146:6800/118758","cluster_addr":"172.21.15.146:6801/118758","heartbeat_back_addr":"172.21.15.146:6803/118758","heartbeat_front_addr":"172.21.15.146:6802/118758","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":118774}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":118774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":118774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":118774}]},"public_addr":"172.21.15.146:6804/118774","cluster_addr":"172.21.15.146:6806/118774","heartbeat_back_addr":"172.21.15.146:6810/118774","heartbeat_front_addr":"172.21.15.146:6808/118774","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":118775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":118775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":118775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":118775}]},"public_addr":"172.21.15.146:6805/118775","cluster_addr":"172.21.15.146:6807/118775","heartbeat_back_addr":"172.21.15.146:6811/118775","heartbeat_front_addr":"172.21.15.146:6809/118775","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":118776}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":118776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":118776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":118776}]},"public_addr":"172.21.15.146:6812/118776","cluster_addr":"172.21.15.146:6813/118776","heartbeat_back_addr":"172.21.15.146:6815/118776","heartbeat_front_addr":"172.21.15.146:6814/118776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:44.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.647+0000 7f8cd623d700 1 -- 172.21.15.146:0/1797369363 >> v1:172.21.15.146:6816/118159 conn(0x7f8cbc02bb60 legacy=0x7f8cbc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.647+0000 7f8cd623d700 1 -- 172.21.15.146:0/1797369363 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cd0066050 msgr2=0x7f8cd0117a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.647+0000 7f8cd623d700 1 --2- 172.21.15.146:0/1797369363 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cd0066050 0x7f8cd0117a60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f8cc000ea50 tx=0x7f8cc0009060).stop 2023-10-03T10:09:44.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.647+0000 7f8cd623d700 1 -- 172.21.15.146:0/1797369363 shutdown_connections 2023-10-03T10:09:44.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.647+0000 7f8cd623d700 1 --2- 172.21.15.146:0/1797369363 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cd012b220 0x7f8cd0118440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.647+0000 7f8cd623d700 1 --2- 172.21.15.146:0/1797369363 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cd0066050 0x7f8cd0117a60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.647+0000 7f8cd623d700 1 --2- 172.21.15.146:0/1797369363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cd0092990 0x7f8cd0117f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.647+0000 7f8cd623d700 1 -- 172.21.15.146:0/1797369363 >> 172.21.15.146:0/1797369363 conn(0x7f8cd009bba0 msgr2=0x7f8cd0129a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:44.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.648+0000 7f8cd623d700 1 -- 172.21.15.146:0/1797369363 shutdown_connections 2023-10-03T10:09:44.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.648+0000 7f8cd623d700 1 -- 172.21.15.146:0/1797369363 wait complete. 2023-10-03T10:09:44.659 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:09:42.343363+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:43.224375+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-03T10:09:44.659 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:09:44.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.777+0000 7fe01fddf700 1 Processor -- start 2023-10-03T10:09:44.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.778+0000 7fe01fddf700 1 -- start start 2023-10-03T10:09:44.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.778+0000 7fe01fddf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01805f560 0x7fe018128d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.778+0000 7fe01fddf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe018129210 0x7fe018066d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.778+0000 7fe01fddf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe018129650 0x7fe018067270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.778+0000 7fe01fddf700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01805f940 con 0x7fe018129210 2023-10-03T10:09:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.778+0000 7fe01fddf700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe018093080 con 0x7fe018129650 2023-10-03T10:09:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.778+0000 7fe01fddf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe018093350 con 0x7fe01805f560 2023-10-03T10:09:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.778+0000 7fe01e37c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe018129650 0x7fe018067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.778+0000 7fe01db7b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01805f560 0x7fe018128d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.778+0000 7fe01d37a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe018129210 0x7fe018066d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.778+0000 7fe01e37c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe018129650 0x7fe018067270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33188/0 (socket says 172.21.15.146:33188) 2023-10-03T10:09:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.778+0000 7fe01db7b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01805f560 0x7fe018128d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:47504/0 (socket says 172.21.15.146:47504) 2023-10-03T10:09:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.778+0000 7fe01d37a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe018129210 0x7fe018066d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37936/0 (socket says 172.21.15.146:37936) 2023-10-03T10:09:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.778+0000 7fe01e37c700 1 -- 172.21.15.146:0/2622173995 learned_addr learned my addr 172.21.15.146:0/2622173995 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.779+0000 7fe01db7b700 1 -- 172.21.15.146:0/2622173995 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe018129650 msgr2=0x7fe018067270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.779+0000 7fe01db7b700 1 --2- 172.21.15.146:0/2622173995 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe018129650 0x7fe018067270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.779+0000 7fe01db7b700 1 -- 172.21.15.146:0/2622173995 >> v2:172.21.15.146:3300/0 conn(0x7fe018129210 msgr2=0x7fe018066d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.779+0000 7fe01db7b700 1 --2- 172.21.15.146:0/2622173995 >> v2:172.21.15.146:3300/0 conn(0x7fe018129210 0x7fe018066d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.779+0000 7fe01db7b700 1 -- 172.21.15.146:0/2622173995 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0180921b0 con 0x7fe01805f560 2023-10-03T10:09:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.779+0000 7fe01e37c700 1 --2- 172.21.15.146:0/2622173995 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe018129650 0x7fe018067270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.779+0000 7fe01d37a700 1 --2- 172.21.15.146:0/2622173995 >> v2:172.21.15.146:3300/0 conn(0x7fe018129210 0x7fe018066d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.779+0000 7fe01db7b700 1 --2- 172.21.15.146:0/2622173995 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01805f560 0x7fe018128d20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fe00c009790 tx=0x7fe00c009060).ready entity=mon.2 client_cookie=34db3026f10099ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.779+0000 7fe01cb79700 1 -- 172.21.15.146:0/2622173995 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0090d0 con 0x7fe01805f560 2023-10-03T10:09:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.779+0000 7fe01cb79700 1 -- 172.21.15.146:0/2622173995 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c00d4a0 con 0x7fe01805f560 2023-10-03T10:09:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.779+0000 7fe01cb79700 1 -- 172.21.15.146:0/2622173995 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c00d820 con 0x7fe01805f560 2023-10-03T10:09:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.779+0000 7fe01fddf700 1 -- 172.21.15.146:0/2622173995 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01805f560 msgr2=0x7fe018128d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.779+0000 7fe01fddf700 1 --2- 172.21.15.146:0/2622173995 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01805f560 0x7fe018128d20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fe00c009790 tx=0x7fe00c009060).stop 2023-10-03T10:09:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.779+0000 7fe01fddf700 1 -- 172.21.15.146:0/2622173995 shutdown_connections 2023-10-03T10:09:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.779+0000 7fe01fddf700 1 --2- 172.21.15.146:0/2622173995 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe018129650 0x7fe018067270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.779+0000 7fe01fddf700 1 --2- 172.21.15.146:0/2622173995 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01805f560 0x7fe018128d20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.779+0000 7fe01fddf700 1 --2- 172.21.15.146:0/2622173995 >> v2:172.21.15.146:3300/0 conn(0x7fe018129210 0x7fe018066d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.779+0000 7fe01fddf700 1 -- 172.21.15.146:0/2622173995 >> 172.21.15.146:0/2622173995 conn(0x7fe01809a1c0 msgr2=0x7fe01809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:44.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.779+0000 7fe01fddf700 1 -- 172.21.15.146:0/2622173995 shutdown_connections 2023-10-03T10:09:44.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.779+0000 7fe01fddf700 1 -- 172.21.15.146:0/2622173995 wait complete. 2023-10-03T10:09:44.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.780+0000 7fe01fddf700 1 Processor -- start 2023-10-03T10:09:44.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.780+0000 7fe01fddf700 1 -- start start 2023-10-03T10:09:44.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.781+0000 7fe01fddf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01805f560 0x7fe018138380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.781+0000 7fe01fddf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe018129210 0x7fe018138870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.781+0000 7fe01fddf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe018129650 0x7fe018113c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.781+0000 7fe01fddf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe018097e20 con 0x7fe018129210 2023-10-03T10:09:44.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.781+0000 7fe01fddf700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe018099c50 con 0x7fe01805f560 2023-10-03T10:09:44.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.781+0000 7fe01fddf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe01812d0f0 con 0x7fe018129650 2023-10-03T10:09:44.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.781+0000 7fe01db7b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01805f560 0x7fe018138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.781+0000 7fe01e37c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe018129650 0x7fe018113c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.781+0000 7fe01d37a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe018129210 0x7fe018138870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.781+0000 7fe01db7b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01805f560 0x7fe018138380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33204/0 (socket says 172.21.15.146:33204) 2023-10-03T10:09:44.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.781+0000 7fe01db7b700 1 -- 172.21.15.146:0/2167525285 learned_addr learned my addr 172.21.15.146:0/2167525285 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:44.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.781+0000 7fe01e37c700 1 -- 172.21.15.146:0/2167525285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01805f560 msgr2=0x7fe018138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.781+0000 7fe01e37c700 1 --2- 172.21.15.146:0/2167525285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01805f560 0x7fe018138380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.781+0000 7fe01e37c700 1 -- 172.21.15.146:0/2167525285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe018129210 msgr2=0x7fe018138870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.781+0000 7fe01e37c700 1 --2- 172.21.15.146:0/2167525285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe018129210 0x7fe018138870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.781+0000 7fe01e37c700 1 -- 172.21.15.146:0/2167525285 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0140092a0 con 0x7fe018129650 2023-10-03T10:09:44.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.781+0000 7fe01db7b700 1 --2- 172.21.15.146:0/2167525285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01805f560 0x7fe018138380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:44.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.781+0000 7fe01e37c700 1 --2- 172.21.15.146:0/2167525285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe018129650 0x7fe018113c20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fe010009f10 tx=0x7fe01000b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:44.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.781+0000 7fe009ffb700 1 -- 172.21.15.146:0/2167525285 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0100092e0 con 0x7fe018129650 2023-10-03T10:09:44.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.781+0000 7fe009ffb700 1 -- 172.21.15.146:0/2167525285 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01000f040 con 0x7fe018129650 2023-10-03T10:09:44.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.781+0000 7fe01fddf700 1 -- 172.21.15.146:0/2167525285 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe010009ae0 con 0x7fe018129650 2023-10-03T10:09:44.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.781+0000 7fe009ffb700 1 -- 172.21.15.146:0/2167525285 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01000cb70 con 0x7fe018129650 2023-10-03T10:09:44.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.782+0000 7fe01fddf700 1 -- 172.21.15.146:0/2167525285 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe00c0092a0 con 0x7fe018129650 2023-10-03T10:09:44.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.782+0000 7fe009ffb700 1 -- 172.21.15.146:0/2167525285 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe010014460 con 0x7fe018129650 2023-10-03T10:09:44.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.782+0000 7fe009ffb700 1 -- 172.21.15.146:0/2167525285 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fe01003ac00 con 0x7fe018129650 2023-10-03T10:09:44.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.783+0000 7fe01fddf700 1 -- 172.21.15.146:0/2167525285 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01805a260 con 0x7fe018129650 2023-10-03T10:09:44.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.787+0000 7fe009ffb700 1 -- 172.21.15.146:0/2167525285 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe010012770 con 0x7fe018129650 2023-10-03T10:09:44.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.943+0000 7fe01fddf700 1 -- 172.21.15.146:0/2167525285 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe018046c20 con 0x7fe018129650 2023-10-03T10:09:44.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.944+0000 7fe009ffb700 1 -- 172.21.15.146:0/2167525285 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v11) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe01001d3b0 con 0x7fe018129650 2023-10-03T10:09:44.943 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-03T10:09:44.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.945+0000 7fe01fddf700 1 -- 172.21.15.146:0/2167525285 >> v1:172.21.15.146:6816/118159 conn(0x7fdffc02bb60 legacy=0x7fdffc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.946+0000 7fe01fddf700 1 -- 172.21.15.146:0/2167525285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe018129650 msgr2=0x7fe018113c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.946+0000 7fe01fddf700 1 --2- 172.21.15.146:0/2167525285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe018129650 0x7fe018113c20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fe010009f10 tx=0x7fe01000b040).stop 2023-10-03T10:09:44.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.946+0000 7fe01fddf700 1 -- 172.21.15.146:0/2167525285 shutdown_connections 2023-10-03T10:09:44.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.946+0000 7fe01fddf700 1 --2- 172.21.15.146:0/2167525285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe018129650 0x7fe018113c20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.946+0000 7fe01fddf700 1 --2- 172.21.15.146:0/2167525285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01805f560 0x7fe018138380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.946+0000 7fe01fddf700 1 --2- 172.21.15.146:0/2167525285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe018129210 0x7fe018138870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.946+0000 7fe01fddf700 1 -- 172.21.15.146:0/2167525285 >> 172.21.15.146:0/2167525285 conn(0x7fe01809a1c0 msgr2=0x7fe018098030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:44.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.946+0000 7fe01fddf700 1 -- 172.21.15.146:0/2167525285 shutdown_connections 2023-10-03T10:09:44.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:44.946+0000 7fe01fddf700 1 -- 172.21.15.146:0/2167525285 wait complete. 2023-10-03T10:09:44.957 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:09:45.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.075+0000 7f1f31e1a700 1 Processor -- start 2023-10-03T10:09:45.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.075+0000 7f1f31e1a700 1 -- start start 2023-10-03T10:09:45.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.076+0000 7f1f31e1a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1f2c097790 0x7f1f2c12b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:45.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.076+0000 7f1f31e1a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f2c12b540 0x7f1f2c127560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:45.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.076+0000 7f1f31e1a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f2c12ae10 con 0x7f1f2c127a50 2023-10-03T10:09:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.076+0000 7f1f31e1a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f2c12b940 con 0x7f1f2c097790 2023-10-03T10:09:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.076+0000 7f1f31e1a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c064b30 con 0x7f1f2c12b540 2023-10-03T10:09:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.076+0000 7f1f2affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f2c12b540 0x7f1f2c127560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.076+0000 7f1f2b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1f2c097790 0x7f1f2c12b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.076+0000 7f1f2b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1f2c097790 0x7f1f2c12b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37948/0 (socket says 172.21.15.146:37948) 2023-10-03T10:09:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.076+0000 7f1f2affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f2c12b540 0x7f1f2c127560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:47528/0 (socket says 172.21.15.146:47528) 2023-10-03T10:09:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.076+0000 7f1f2b7fe700 1 -- 172.21.15.146:0/1956639174 learned_addr learned my addr 172.21.15.146:0/1956639174 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.076+0000 7f1f2bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1f2c127a50 0x7f1f2c127ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48230/0 (socket says 172.21.15.146:48230) 2023-10-03T10:09:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.076+0000 7f1f2b7fe700 1 -- 172.21.15.146:0/1956639174 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f2c12b540 msgr2=0x7f1f2c127560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.076+0000 7f1f2b7fe700 1 --2- 172.21.15.146:0/1956639174 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f2c12b540 0x7f1f2c127560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.076+0000 7f1f2b7fe700 1 -- 172.21.15.146:0/1956639174 >> v1:172.21.15.146:6789/0 conn(0x7f1f2c127a50 legacy=0x7f1f2c127ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.076+0000 7f1f2a7fc700 1 -- 172.21.15.146:0/1956639174 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108354898 0 0) 0x7f1f24001490 con 0x7f1f2c127a50 2023-10-03T10:09:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.076+0000 7f1f2b7fe700 1 -- 172.21.15.146:0/1956639174 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2c065750 con 0x7f1f2c097790 2023-10-03T10:09:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.076+0000 7f1f2affd700 1 --2- 172.21.15.146:0/1956639174 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f2c12b540 0x7f1f2c127560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.077+0000 7f1f2b7fe700 1 --2- 172.21.15.146:0/1956639174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f2c097790 0x7f1f2c12b050 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f1f14006fd0 tx=0x7f1f140090f0).ready entity=mon.0 client_cookie=20ab1c3e80eaca60 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.077+0000 7f1f2a7fc700 1 -- 172.21.15.146:0/1956639174 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1400b580 con 0x7f1f2c097790 2023-10-03T10:09:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.077+0000 7f1f2a7fc700 1 -- 172.21.15.146:0/1956639174 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1400b6e0 con 0x7f1f2c097790 2023-10-03T10:09:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.077+0000 7f1f2a7fc700 1 -- 172.21.15.146:0/1956639174 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1400ba60 con 0x7f1f2c097790 2023-10-03T10:09:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.077+0000 7f1f31e1a700 1 -- 172.21.15.146:0/1956639174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f2c097790 msgr2=0x7f1f2c12b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.077+0000 7f1f31e1a700 1 --2- 172.21.15.146:0/1956639174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f2c097790 0x7f1f2c12b050 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f1f14006fd0 tx=0x7f1f140090f0).stop 2023-10-03T10:09:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.077+0000 7f1f31e1a700 1 -- 172.21.15.146:0/1956639174 shutdown_connections 2023-10-03T10:09:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.077+0000 7f1f31e1a700 1 --2- 172.21.15.146:0/1956639174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f2c097790 0x7f1f2c12b050 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.077+0000 7f1f31e1a700 1 --2- 172.21.15.146:0/1956639174 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f2c12b540 0x7f1f2c127560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.077+0000 7f1f31e1a700 1 -- 172.21.15.146:0/1956639174 >> 172.21.15.146:0/1956639174 conn(0x7f1f2c09bad0 msgr2=0x7f1f2c09bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:45.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.077+0000 7f1f31e1a700 1 -- 172.21.15.146:0/1956639174 shutdown_connections 2023-10-03T10:09:45.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.077+0000 7f1f31e1a700 1 -- 172.21.15.146:0/1956639174 wait complete. 2023-10-03T10:09:45.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.078+0000 7f1f31e1a700 1 Processor -- start 2023-10-03T10:09:45.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.078+0000 7f1f31e1a700 1 -- start start 2023-10-03T10:09:45.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.079+0000 7f1f31e1a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f2c097790 0x7f1f2c13a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:45.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.079+0000 7f1f31e1a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f2c127a50 0x7f1f2c13a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:45.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.079+0000 7f1f31e1a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f2c12b540 0x7f1f2c12d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:45.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.079+0000 7f1f31e1a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c12f0f0 con 0x7f1f2c097790 2023-10-03T10:09:45.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.079+0000 7f1f31e1a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c12e560 con 0x7f1f2c12b540 2023-10-03T10:09:45.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.079+0000 7f1f31e1a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c113cf0 con 0x7f1f2c127a50 2023-10-03T10:09:45.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.079+0000 7f1f2affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f2c127a50 0x7f1f2c13a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:45.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.079+0000 7f1f2bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f2c12b540 0x7f1f2c12d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:45.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.079+0000 7f1f2affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f2c127a50 0x7f1f2c13a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:47532/0 (socket says 172.21.15.146:47532) 2023-10-03T10:09:45.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.079+0000 7f1f2affd700 1 -- 172.21.15.146:0/2626109905 learned_addr learned my addr 172.21.15.146:0/2626109905 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:45.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.079+0000 7f1f2b7fe700 1 --2- 172.21.15.146:0/2626109905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f2c097790 0x7f1f2c13a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:45.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.079+0000 7f1f2b7fe700 1 -- 172.21.15.146:0/2626109905 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f2c127a50 msgr2=0x7f1f2c13a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.079+0000 7f1f2b7fe700 1 --2- 172.21.15.146:0/2626109905 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f2c127a50 0x7f1f2c13a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.079+0000 7f1f2b7fe700 1 -- 172.21.15.146:0/2626109905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f2c12b540 msgr2=0x7f1f2c12d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.079+0000 7f1f2b7fe700 1 --2- 172.21.15.146:0/2626109905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f2c12b540 0x7f1f2c12d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.079+0000 7f1f2b7fe700 1 -- 172.21.15.146:0/2626109905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1c0092a0 con 0x7f1f2c097790 2023-10-03T10:09:45.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.079+0000 7f1f2affd700 1 --2- 172.21.15.146:0/2626109905 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f2c127a50 0x7f1f2c13a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:45.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.079+0000 7f1f2bfff700 1 --2- 172.21.15.146:0/2626109905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f2c12b540 0x7f1f2c12d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:45.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.079+0000 7f1f2b7fe700 1 --2- 172.21.15.146:0/2626109905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f2c097790 0x7f1f2c13a380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f1f14014000 tx=0x7f1f14017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:45.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.079+0000 7f1f237fe700 1 -- 172.21.15.146:0/2626109905 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f14000bc0 con 0x7f1f2c097790 2023-10-03T10:09:45.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.080+0000 7f1f237fe700 1 -- 172.21.15.146:0/2626109905 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1400b850 con 0x7f1f2c097790 2023-10-03T10:09:45.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.080+0000 7f1f237fe700 1 -- 172.21.15.146:0/2626109905 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f14000d20 con 0x7f1f2c097790 2023-10-03T10:09:45.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.080+0000 7f1f31e1a700 1 -- 172.21.15.146:0/2626109905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f14009370 con 0x7f1f2c097790 2023-10-03T10:09:45.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.080+0000 7f1f31e1a700 1 -- 172.21.15.146:0/2626109905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f2c112130 con 0x7f1f2c097790 2023-10-03T10:09:45.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.080+0000 7f1f237fe700 1 -- 172.21.15.146:0/2626109905 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f1f1401c940 con 0x7f1f2c097790 2023-10-03T10:09:45.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.080+0000 7f1f237fe700 1 -- 172.21.15.146:0/2626109905 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f1f1403cb70 con 0x7f1f2c097790 2023-10-03T10:09:45.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.081+0000 7f1f31e1a700 1 -- 172.21.15.146:0/2626109905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2c12a0b0 con 0x7f1f2c097790 2023-10-03T10:09:45.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.085+0000 7f1f237fe700 1 -- 172.21.15.146:0/2626109905 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1f1402a080 con 0x7f1f2c097790 2023-10-03T10:09:45.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.240+0000 7f1f31e1a700 1 -- 172.21.15.146:0/2626109905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1f2c113e30 con 0x7f1f2c097790 2023-10-03T10:09:45.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.240+0000 7f1f237fe700 1 -- 172.21.15.146:0/2626109905 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v11) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1f2c113e30 con 0x7f1f2c097790 2023-10-03T10:09:45.240 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-03T10:09:45.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.242+0000 7f1f31e1a700 1 -- 172.21.15.146:0/2626109905 >> v1:172.21.15.146:6816/118159 conn(0x7f1f0c02bb60 legacy=0x7f1f0c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.242+0000 7f1f31e1a700 1 -- 172.21.15.146:0/2626109905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f2c097790 msgr2=0x7f1f2c13a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.242+0000 7f1f31e1a700 1 --2- 172.21.15.146:0/2626109905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f2c097790 0x7f1f2c13a380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f1f14014000 tx=0x7f1f14017000).stop 2023-10-03T10:09:45.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.242+0000 7f1f31e1a700 1 -- 172.21.15.146:0/2626109905 shutdown_connections 2023-10-03T10:09:45.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.242+0000 7f1f31e1a700 1 --2- 172.21.15.146:0/2626109905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f2c12b540 0x7f1f2c12d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.242+0000 7f1f31e1a700 1 --2- 172.21.15.146:0/2626109905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f2c097790 0x7f1f2c13a380 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.242+0000 7f1f31e1a700 1 --2- 172.21.15.146:0/2626109905 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f2c127a50 0x7f1f2c13a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.242+0000 7f1f31e1a700 1 -- 172.21.15.146:0/2626109905 >> 172.21.15.146:0/2626109905 conn(0x7f1f2c09bad0 msgr2=0x7f1f2c128dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.242+0000 7f1f31e1a700 1 -- 172.21.15.146:0/2626109905 shutdown_connections 2023-10-03T10:09:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.242+0000 7f1f31e1a700 1 -- 172.21.15.146:0/2626109905 wait complete. 2023-10-03T10:09:45.253 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:09:45.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.374+0000 7f93e965e700 1 Processor -- start 2023-10-03T10:09:45.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.374+0000 7f93e965e700 1 -- start start 2023-10-03T10:09:45.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.374+0000 7f93e965e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f93e40985e0 0x7f93e40989c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:45.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.374+0000 7f93e965e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f93e4130bb0 0x7f93e4132fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:45.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.374+0000 7f93e965e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e40964f0 con 0x7f93e4098eb0 2023-10-03T10:09:45.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.374+0000 7f93e965e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e409a3f0 con 0x7f93e4130bb0 2023-10-03T10:09:45.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.374+0000 7f93e965e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93e4095100 con 0x7f93e40985e0 2023-10-03T10:09:45.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.374+0000 7f93e2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f93e40985e0 0x7f93e40989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:45.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.374+0000 7f93e27fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f93e4098eb0 0x7f93e412f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48240/0 (socket says 172.21.15.146:48240) 2023-10-03T10:09:45.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.374+0000 7f93e27fc700 1 -- 172.21.15.146:0/1347690956 learned_addr learned my addr 172.21.15.146:0/1347690956 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:09:45.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.374+0000 7f93e37fe700 1 --2- 172.21.15.146:0/1347690956 >> v2:172.21.15.146:3300/0 conn(0x7f93e4130bb0 0x7f93e4132fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:45.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.375+0000 7f93e2ffd700 1 -- 172.21.15.146:0/1347690956 >> v2:172.21.15.146:3300/0 conn(0x7f93e4130bb0 msgr2=0x7f93e4132fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:45.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.375+0000 7f93e2ffd700 1 --2- 172.21.15.146:0/1347690956 >> v2:172.21.15.146:3300/0 conn(0x7f93e4130bb0 0x7f93e4132fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.375+0000 7f93e2ffd700 1 -- 172.21.15.146:0/1347690956 >> v1:172.21.15.146:6789/0 conn(0x7f93e4098eb0 legacy=0x7f93e412f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.375+0000 7f93e2ffd700 1 -- 172.21.15.146:0/1347690956 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e4099e70 con 0x7f93e40985e0 2023-10-03T10:09:45.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.375+0000 7f93e1ffb700 1 -- 172.21.15.146:0/1347690956 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591790661 0 0) 0x7f93e40964f0 con 0x7f93e4098eb0 2023-10-03T10:09:45.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.375+0000 7f93e37fe700 1 --2- 172.21.15.146:0/1347690956 >> v2:172.21.15.146:3300/0 conn(0x7f93e4130bb0 0x7f93e4132fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:45.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.375+0000 7f93e2ffd700 1 --2- 172.21.15.146:0/1347690956 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f93e40985e0 0x7f93e40989c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f93d8009760 tx=0x7f93d8009060).ready entity=mon.2 client_cookie=8cc164c32679454a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:45.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.375+0000 7f93e1ffb700 1 -- 172.21.15.146:0/1347690956 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d80090d0 con 0x7f93e40985e0 2023-10-03T10:09:45.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.375+0000 7f93e1ffb700 1 -- 172.21.15.146:0/1347690956 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d800f510 con 0x7f93e40985e0 2023-10-03T10:09:45.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.375+0000 7f93e1ffb700 1 -- 172.21.15.146:0/1347690956 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d800f890 con 0x7f93e40985e0 2023-10-03T10:09:45.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.375+0000 7f93e965e700 1 -- 172.21.15.146:0/1347690956 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f93e40985e0 msgr2=0x7f93e40989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.375+0000 7f93e965e700 1 --2- 172.21.15.146:0/1347690956 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f93e40985e0 0x7f93e40989c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f93d8009760 tx=0x7f93d8009060).stop 2023-10-03T10:09:45.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.375+0000 7f93e965e700 1 -- 172.21.15.146:0/1347690956 shutdown_connections 2023-10-03T10:09:45.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.375+0000 7f93e965e700 1 --2- 172.21.15.146:0/1347690956 >> v2:172.21.15.146:3300/0 conn(0x7f93e4130bb0 0x7f93e4132fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.375+0000 7f93e965e700 1 --2- 172.21.15.146:0/1347690956 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f93e40985e0 0x7f93e40989c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.375+0000 7f93e965e700 1 -- 172.21.15.146:0/1347690956 >> 172.21.15.146:0/1347690956 conn(0x7f93e409dc40 msgr2=0x7f93e409e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:45.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.375+0000 7f93e965e700 1 -- 172.21.15.146:0/1347690956 shutdown_connections 2023-10-03T10:09:45.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.376+0000 7f93e965e700 1 -- 172.21.15.146:0/1347690956 wait complete. 2023-10-03T10:09:45.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.376+0000 7f93e965e700 1 Processor -- start 2023-10-03T10:09:45.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.377+0000 7f93e965e700 1 -- start start 2023-10-03T10:09:45.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.377+0000 7f93e965e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f93e40985e0 0x7f93e4130620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:45.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.377+0000 7f93e965e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93e4098eb0 0x7f93e411a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:45.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.377+0000 7f93e965e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93e4130bb0 0x7f93e411aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:45.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.377+0000 7f93e965e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e411e600 con 0x7f93e4130bb0 2023-10-03T10:09:45.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.377+0000 7f93e965e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e411cbd0 con 0x7f93e4098eb0 2023-10-03T10:09:45.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.377+0000 7f93e965e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93e409a0f0 con 0x7f93e40985e0 2023-10-03T10:09:45.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.377+0000 7f93e2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f93e40985e0 0x7f93e4130620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:45.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.377+0000 7f93e27fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93e4098eb0 0x7f93e411a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:45.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.377+0000 7f93e2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f93e40985e0 0x7f93e4130620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:47556/0 (socket says 172.21.15.146:47556) 2023-10-03T10:09:45.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.377+0000 7f93e2ffd700 1 -- 172.21.15.146:0/3208513273 learned_addr learned my addr 172.21.15.146:0/3208513273 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:45.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.377+0000 7f93e37fe700 1 --2- 172.21.15.146:0/3208513273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93e4130bb0 0x7f93e411aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:45.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.377+0000 7f93e2ffd700 1 -- 172.21.15.146:0/3208513273 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93e4098eb0 msgr2=0x7f93e411a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.377+0000 7f93e2ffd700 1 --2- 172.21.15.146:0/3208513273 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93e4098eb0 0x7f93e411a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.377+0000 7f93e2ffd700 1 -- 172.21.15.146:0/3208513273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93e4130bb0 msgr2=0x7f93e411aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.377+0000 7f93e2ffd700 1 --2- 172.21.15.146:0/3208513273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93e4130bb0 0x7f93e411aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.377+0000 7f93e2ffd700 1 -- 172.21.15.146:0/3208513273 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc009a20 con 0x7f93e40985e0 2023-10-03T10:09:45.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.377+0000 7f93e37fe700 1 --2- 172.21.15.146:0/3208513273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93e4130bb0 0x7f93e411aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:45.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.377+0000 7f93e2ffd700 1 --2- 172.21.15.146:0/3208513273 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f93e40985e0 0x7f93e4130620 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f93d8009e00 tx=0x7f93d8017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:45.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.378+0000 7f93caffd700 1 -- 172.21.15.146:0/3208513273 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d800f890 con 0x7f93e40985e0 2023-10-03T10:09:45.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.378+0000 7f93caffd700 1 -- 172.21.15.146:0/3208513273 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d8006910 con 0x7f93e40985e0 2023-10-03T10:09:45.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.378+0000 7f93e965e700 1 -- 172.21.15.146:0/3208513273 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d80092a0 con 0x7f93e40985e0 2023-10-03T10:09:45.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.378+0000 7f93caffd700 1 -- 172.21.15.146:0/3208513273 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d800fea0 con 0x7f93e40985e0 2023-10-03T10:09:45.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.378+0000 7f93e965e700 1 -- 172.21.15.146:0/3208513273 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e411b9b0 con 0x7f93e40985e0 2023-10-03T10:09:45.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.378+0000 7f93caffd700 1 -- 172.21.15.146:0/3208513273 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f93d801b620 con 0x7f93e40985e0 2023-10-03T10:09:45.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.378+0000 7f93caffd700 1 -- 172.21.15.146:0/3208513273 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f93d803c600 con 0x7f93e40985e0 2023-10-03T10:09:45.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.379+0000 7f93e965e700 1 -- 172.21.15.146:0/3208513273 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e405a260 con 0x7f93e40985e0 2023-10-03T10:09:45.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.383+0000 7f93caffd700 1 -- 172.21.15.146:0/3208513273 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f93d8028070 con 0x7f93e40985e0 2023-10-03T10:09:45.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.579+0000 7f93e965e700 1 -- 172.21.15.146:0/3208513273 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93e40661a0 con 0x7f93e40985e0 2023-10-03T10:09:45.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.580+0000 7f93caffd700 1 -- 172.21.15.146:0/3208513273 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1198 (secure 0 0 0) 0x7f93d8028020 con 0x7f93e40985e0 2023-10-03T10:09:45.580 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:45.580 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6817/4164614194","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6817","nonce":4164614194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-03T10:09:45.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.582+0000 7f93e965e700 1 -- 172.21.15.146:0/3208513273 >> v1:172.21.15.146:6816/118159 conn(0x7f93d002bb60 legacy=0x7f93d002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.582+0000 7f93e965e700 1 -- 172.21.15.146:0/3208513273 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f93e40985e0 msgr2=0x7f93e4130620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.582+0000 7f93e965e700 1 --2- 172.21.15.146:0/3208513273 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f93e40985e0 0x7f93e4130620 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f93d8009e00 tx=0x7f93d8017000).stop 2023-10-03T10:09:45.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.582+0000 7f93e965e700 1 -- 172.21.15.146:0/3208513273 shutdown_connections 2023-10-03T10:09:45.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.582+0000 7f93e965e700 1 --2- 172.21.15.146:0/3208513273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93e4130bb0 0x7f93e411aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.582+0000 7f93e965e700 1 --2- 172.21.15.146:0/3208513273 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f93e40985e0 0x7f93e4130620 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.582+0000 7f93e965e700 1 --2- 172.21.15.146:0/3208513273 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93e4098eb0 0x7f93e411a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.582+0000 7f93e965e700 1 -- 172.21.15.146:0/3208513273 >> 172.21.15.146:0/3208513273 conn(0x7f93e409dc40 msgr2=0x7f93e4114300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:45.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.582+0000 7f93e965e700 1 -- 172.21.15.146:0/3208513273 shutdown_connections 2023-10-03T10:09:45.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.582+0000 7f93e965e700 1 -- 172.21.15.146:0/3208513273 wait complete. 2023-10-03T10:09:45.583 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 2 2023-10-03T10:09:45.593 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:45.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.709+0000 7f89742ad700 1 Processor -- start 2023-10-03T10:09:45.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.709+0000 7f89742ad700 1 -- start start 2023-10-03T10:09:45.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.710+0000 7f89742ad700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f896c062b00 0x7f896c1257c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:45.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.710+0000 7f89742ad700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f896c125330 0x7f896c125cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:45.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.710+0000 7f89742ad700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896c095950 con 0x7f896c093b90 2023-10-03T10:09:45.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.710+0000 7f89742ad700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896c062ee0 con 0x7f896c062b00 2023-10-03T10:09:45.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.710+0000 7f89742ad700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f896c0969c0 con 0x7f896c125330 2023-10-03T10:09:45.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.710+0000 7f8971848700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f896c125330 0x7f896c125cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:45.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.710+0000 7f8972049700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f896c062b00 0x7f896c1257c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:45.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.710+0000 7f897284a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f896c093b90 0x7f896c094020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48250/0 (socket says 172.21.15.146:48250) 2023-10-03T10:09:45.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.710+0000 7f897284a700 1 -- 172.21.15.146:0/63251150 learned_addr learned my addr 172.21.15.146:0/63251150 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:09:45.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.710+0000 7f8971047700 1 -- 172.21.15.146:0/63251150 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86835964 0 0) 0x7f896c095950 con 0x7f896c093b90 2023-10-03T10:09:45.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.710+0000 7f8971047700 1 -- 172.21.15.146:0/63251150 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89580033f0 con 0x7f896c093b90 2023-10-03T10:09:45.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.710+0000 7f8971848700 1 -- 172.21.15.146:0/63251150 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f896c062b00 msgr2=0x7f896c1257c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:45.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.710+0000 7f8971848700 1 --2- 172.21.15.146:0/63251150 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f896c062b00 0x7f896c1257c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.710+0000 7f8971848700 1 -- 172.21.15.146:0/63251150 >> v1:172.21.15.146:6789/0 conn(0x7f896c093b90 legacy=0x7f896c094020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.710+0000 7f8971848700 1 -- 172.21.15.146:0/63251150 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c0635f0 con 0x7f896c125330 2023-10-03T10:09:45.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.710+0000 7f8972049700 1 --2- 172.21.15.146:0/63251150 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f896c062b00 0x7f896c1257c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:45.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.710+0000 7f8971848700 1 --2- 172.21.15.146:0/63251150 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f896c125330 0x7f896c125cb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f8968009790 tx=0x7f8968009060).ready entity=mon.2 client_cookie=3b298690d9ddd8e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:45.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.711+0000 7f8971047700 1 -- 172.21.15.146:0/63251150 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896800f510 con 0x7f896c125330 2023-10-03T10:09:45.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.711+0000 7f8971047700 1 -- 172.21.15.146:0/63251150 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896800f670 con 0x7f896c125330 2023-10-03T10:09:45.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.711+0000 7f8971047700 1 -- 172.21.15.146:0/63251150 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896800f9f0 con 0x7f896c125330 2023-10-03T10:09:45.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.711+0000 7f89742ad700 1 -- 172.21.15.146:0/63251150 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f896c125330 msgr2=0x7f896c125cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.711+0000 7f89742ad700 1 --2- 172.21.15.146:0/63251150 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f896c125330 0x7f896c125cb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f8968009790 tx=0x7f8968009060).stop 2023-10-03T10:09:45.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.711+0000 7f89742ad700 1 -- 172.21.15.146:0/63251150 shutdown_connections 2023-10-03T10:09:45.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.711+0000 7f89742ad700 1 --2- 172.21.15.146:0/63251150 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f896c062b00 0x7f896c1257c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.711+0000 7f89742ad700 1 --2- 172.21.15.146:0/63251150 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f896c125330 0x7f896c125cb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.711+0000 7f89742ad700 1 -- 172.21.15.146:0/63251150 >> 172.21.15.146:0/63251150 conn(0x7f896c09aa50 msgr2=0x7f896c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:45.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.711+0000 7f89742ad700 1 -- 172.21.15.146:0/63251150 shutdown_connections 2023-10-03T10:09:45.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.711+0000 7f89742ad700 1 -- 172.21.15.146:0/63251150 wait complete. 2023-10-03T10:09:45.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.712+0000 7f89742ad700 1 Processor -- start 2023-10-03T10:09:45.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.712+0000 7f89742ad700 1 -- start start 2023-10-03T10:09:45.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.712+0000 7f89742ad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f896c062b00 0x7f896c068620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:45.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.712+0000 7f89742ad700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f896c093b90 0x7f896c068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:45.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.712+0000 7f89742ad700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f896c069000 0x7f896c138190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:45.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.712+0000 7f89742ad700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896c123090 con 0x7f896c062b00 2023-10-03T10:09:45.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.713+0000 7f89742ad700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896c111bb0 con 0x7f896c093b90 2023-10-03T10:09:45.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.713+0000 7f89742ad700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f896c111e70 con 0x7f896c069000 2023-10-03T10:09:45.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.713+0000 7f8972049700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f896c062b00 0x7f896c068620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:45.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.713+0000 7f8972049700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f896c062b00 0x7f896c068620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37976/0 (socket says 172.21.15.146:37976) 2023-10-03T10:09:45.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.713+0000 7f8972049700 1 -- 172.21.15.146:0/1685359217 learned_addr learned my addr 172.21.15.146:0/1685359217 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:45.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.713+0000 7f8971848700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f896c093b90 0x7f896c068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:45.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.713+0000 7f897284a700 1 --2- 172.21.15.146:0/1685359217 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f896c069000 0x7f896c138190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:45.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.713+0000 7f8972049700 1 -- 172.21.15.146:0/1685359217 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f896c069000 msgr2=0x7f896c138190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.713+0000 7f8972049700 1 --2- 172.21.15.146:0/1685359217 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f896c069000 0x7f896c138190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.713+0000 7f8972049700 1 -- 172.21.15.146:0/1685359217 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f896c093b90 msgr2=0x7f896c068b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.713+0000 7f8972049700 1 --2- 172.21.15.146:0/1685359217 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f896c093b90 0x7f896c068b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.713+0000 7f8972049700 1 -- 172.21.15.146:0/1685359217 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c0092a0 con 0x7f896c062b00 2023-10-03T10:09:45.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.713+0000 7f8971848700 1 --2- 172.21.15.146:0/1685359217 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f896c093b90 0x7f896c068b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:45.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.713+0000 7f8972049700 1 --2- 172.21.15.146:0/1685359217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f896c062b00 0x7f896c068620 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f895c00ea20 tx=0x7f895c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:45.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.713+0000 7f89627fc700 1 -- 172.21.15.146:0/1685359217 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c00ee60 con 0x7f896c062b00 2023-10-03T10:09:45.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.713+0000 7f89627fc700 1 -- 172.21.15.146:0/1685359217 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895c00c850 con 0x7f896c062b00 2023-10-03T10:09:45.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.713+0000 7f89742ad700 1 -- 172.21.15.146:0/1685359217 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89680092a0 con 0x7f896c062b00 2023-10-03T10:09:45.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.713+0000 7f89627fc700 1 -- 172.21.15.146:0/1685359217 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c00cbd0 con 0x7f896c062b00 2023-10-03T10:09:45.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.713+0000 7f89742ad700 1 -- 172.21.15.146:0/1685359217 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896c112810 con 0x7f896c062b00 2023-10-03T10:09:45.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.714+0000 7f89627fc700 1 -- 172.21.15.146:0/1685359217 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f895c01b400 con 0x7f896c062b00 2023-10-03T10:09:45.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.714+0000 7f89627fc700 1 -- 172.21.15.146:0/1685359217 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f895c03b1a0 con 0x7f896c062b00 2023-10-03T10:09:45.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.714+0000 7f89742ad700 1 -- 172.21.15.146:0/1685359217 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f896c05a260 con 0x7f896c062b00 2023-10-03T10:09:45.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.719+0000 7f89627fc700 1 -- 172.21.15.146:0/1685359217 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f895c019900 con 0x7f896c062b00 2023-10-03T10:09:45.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.878+0000 7f89742ad700 1 -- 172.21.15.146:0/1685359217 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f896c099930 con 0x7f896c062b00 2023-10-03T10:09:45.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.879+0000 7f89627fc700 1 -- 172.21.15.146:0/1685359217 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+8156 (secure 0 0 0) 0x7f895c019310 con 0x7f896c062b00 2023-10-03T10:09:45.879 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:45.879 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":12,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:09:45.323431+0000","last_up_change":"2023-10-03T10:09:42.301022+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":118758}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":118758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":118758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":118758}]},"public_addr":"172.21.15.146:6800/118758","cluster_addr":"172.21.15.146:6801/118758","heartbeat_back_addr":"172.21.15.146:6803/118758","heartbeat_front_addr":"172.21.15.146:6802/118758","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":118774}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":118774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":118774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":118774}]},"public_addr":"172.21.15.146:6804/118774","cluster_addr":"172.21.15.146:6806/118774","heartbeat_back_addr":"172.21.15.146:6810/118774","heartbeat_front_addr":"172.21.15.146:6808/118774","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":118775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":118775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":118775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":118775}]},"public_addr":"172.21.15.146:6805/118775","cluster_addr":"172.21.15.146:6807/118775","heartbeat_back_addr":"172.21.15.146:6811/118775","heartbeat_front_addr":"172.21.15.146:6809/118775","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":118776}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":118776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":118776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":118776}]},"public_addr":"172.21.15.146:6812/118776","cluster_addr":"172.21.15.146:6813/118776","heartbeat_back_addr":"172.21.15.146:6815/118776","heartbeat_front_addr":"172.21.15.146:6814/118776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:45.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.881+0000 7f89742ad700 1 -- 172.21.15.146:0/1685359217 >> v1:172.21.15.146:6816/118159 conn(0x7f895002bb60 legacy=0x7f895002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.881+0000 7f89742ad700 1 -- 172.21.15.146:0/1685359217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f896c062b00 msgr2=0x7f896c068620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.881+0000 7f89742ad700 1 --2- 172.21.15.146:0/1685359217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f896c062b00 0x7f896c068620 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f895c00ea20 tx=0x7f895c009060).stop 2023-10-03T10:09:45.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.881+0000 7f89742ad700 1 -- 172.21.15.146:0/1685359217 shutdown_connections 2023-10-03T10:09:45.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.881+0000 7f89742ad700 1 --2- 172.21.15.146:0/1685359217 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f896c069000 0x7f896c138190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.881+0000 7f89742ad700 1 --2- 172.21.15.146:0/1685359217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f896c062b00 0x7f896c068620 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.881+0000 7f89742ad700 1 --2- 172.21.15.146:0/1685359217 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f896c093b90 0x7f896c068b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.881+0000 7f89742ad700 1 -- 172.21.15.146:0/1685359217 >> 172.21.15.146:0/1685359217 conn(0x7f896c09aa50 msgr2=0x7f896c1232a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:45.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.881+0000 7f89742ad700 1 -- 172.21.15.146:0/1685359217 shutdown_connections 2023-10-03T10:09:45.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:45.881+0000 7f89742ad700 1 -- 172.21.15.146:0/1685359217 wait complete. 2023-10-03T10:09:45.892 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:09:42.343363+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:43.224375+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-03T10:09:45.893 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:09:46.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.011+0000 7fe1e3661700 1 Processor -- start 2023-10-03T10:09:46.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.012+0000 7fe1e3661700 1 -- start start 2023-10-03T10:09:46.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.012+0000 7fe1e3661700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1dc12b590 0x7fe1dc12fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.012+0000 7fe1e3661700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe1dc1303d0 0x7fe1dc1327c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.012+0000 7fe1e3661700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1dc066f90 con 0x7fe1dc05f560 2023-10-03T10:09:46.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.012+0000 7fe1e3661700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1dc05f940 con 0x7fe1dc1303d0 2023-10-03T10:09:46.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.012+0000 7fe1e3661700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc067650 con 0x7fe1dc12b590 2023-10-03T10:09:46.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.012+0000 7fe1e0bfc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1dc12b590 0x7fe1dc12fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.012+0000 7fe1e0bfc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1dc12b590 0x7fe1dc12fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:47574/0 (socket says 172.21.15.146:47574) 2023-10-03T10:09:46.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.012+0000 7fe1e0bfc700 1 -- 172.21.15.146:0/1892458565 learned_addr learned my addr 172.21.15.146:0/1892458565 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:46.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.012+0000 7fe1e13fd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe1dc05f560 0x7fe1dc12ae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48254/0 (socket says 172.21.15.146:48254) 2023-10-03T10:09:46.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.012+0000 7fe1e1bfe700 1 --2- 172.21.15.146:0/1892458565 >> v2:172.21.15.146:3300/0 conn(0x7fe1dc1303d0 0x7fe1dc1327c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.012+0000 7fe1e0bfc700 1 -- 172.21.15.146:0/1892458565 >> v2:172.21.15.146:3300/0 conn(0x7fe1dc1303d0 msgr2=0x7fe1dc1327c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:46.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.012+0000 7fe1e0bfc700 1 --2- 172.21.15.146:0/1892458565 >> v2:172.21.15.146:3300/0 conn(0x7fe1dc1303d0 0x7fe1dc1327c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.012+0000 7fe1e0bfc700 1 -- 172.21.15.146:0/1892458565 >> v1:172.21.15.146:6789/0 conn(0x7fe1dc05f560 legacy=0x7fe1dc12ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.012+0000 7fe1e0bfc700 1 -- 172.21.15.146:0/1892458565 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1dc067910 con 0x7fe1dc12b590 2023-10-03T10:09:46.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.012+0000 7fe1d3fff700 1 -- 172.21.15.146:0/1892458565 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809879456 0 0) 0x7fe1dc066f90 con 0x7fe1dc05f560 2023-10-03T10:09:46.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.012+0000 7fe1e1bfe700 1 --2- 172.21.15.146:0/1892458565 >> v2:172.21.15.146:3300/0 conn(0x7fe1dc1303d0 0x7fe1dc1327c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:46.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.013+0000 7fe1e0bfc700 1 --2- 172.21.15.146:0/1892458565 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1dc12b590 0x7fe1dc12fee0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe1d8006fd0 tx=0x7fe1d80090f0).ready entity=mon.2 client_cookie=37d3de278ded2a7b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:46.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.013+0000 7fe1d3fff700 1 -- 172.21.15.146:0/1892458565 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d800b580 con 0x7fe1dc12b590 2023-10-03T10:09:46.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.013+0000 7fe1d3fff700 1 -- 172.21.15.146:0/1892458565 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d800b6e0 con 0x7fe1dc12b590 2023-10-03T10:09:46.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.013+0000 7fe1d3fff700 1 -- 172.21.15.146:0/1892458565 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d800ba60 con 0x7fe1dc12b590 2023-10-03T10:09:46.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.013+0000 7fe1e3661700 1 -- 172.21.15.146:0/1892458565 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1dc12b590 msgr2=0x7fe1dc12fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.013+0000 7fe1e3661700 1 --2- 172.21.15.146:0/1892458565 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1dc12b590 0x7fe1dc12fee0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe1d8006fd0 tx=0x7fe1d80090f0).stop 2023-10-03T10:09:46.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.013+0000 7fe1e3661700 1 -- 172.21.15.146:0/1892458565 shutdown_connections 2023-10-03T10:09:46.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.013+0000 7fe1e3661700 1 --2- 172.21.15.146:0/1892458565 >> v2:172.21.15.146:3300/0 conn(0x7fe1dc1303d0 0x7fe1dc1327c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.013+0000 7fe1e3661700 1 --2- 172.21.15.146:0/1892458565 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1dc12b590 0x7fe1dc12fee0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.013+0000 7fe1e3661700 1 -- 172.21.15.146:0/1892458565 >> 172.21.15.146:0/1892458565 conn(0x7fe1dc09a1c0 msgr2=0x7fe1dc09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:46.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.013+0000 7fe1e3661700 1 -- 172.21.15.146:0/1892458565 shutdown_connections 2023-10-03T10:09:46.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.013+0000 7fe1e3661700 1 -- 172.21.15.146:0/1892458565 wait complete. 2023-10-03T10:09:46.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.014+0000 7fe1e3661700 1 Processor -- start 2023-10-03T10:09:46.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.014+0000 7fe1e3661700 1 -- start start 2023-10-03T10:09:46.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1e3661700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1dc05f560 0x7fe1dc1129b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1e3661700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1dc12b590 0x7fe1dc112ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1e3661700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1dc1303d0 0x7fe1dc113390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1e3661700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc113880 con 0x7fe1dc1303d0 2023-10-03T10:09:46.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1e3661700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc117010 con 0x7fe1dc12b590 2023-10-03T10:09:46.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1e3661700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc113e20 con 0x7fe1dc05f560 2023-10-03T10:09:46.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1e13fd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1dc05f560 0x7fe1dc1129b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1e13fd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1dc05f560 0x7fe1dc1129b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:47580/0 (socket says 172.21.15.146:47580) 2023-10-03T10:09:46.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1e13fd700 1 -- 172.21.15.146:0/887974609 learned_addr learned my addr 172.21.15.146:0/887974609 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:46.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1e0bfc700 1 --2- 172.21.15.146:0/887974609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1dc12b590 0x7fe1dc112ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1e1bfe700 1 --2- 172.21.15.146:0/887974609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1dc1303d0 0x7fe1dc113390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1e13fd700 1 -- 172.21.15.146:0/887974609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1dc12b590 msgr2=0x7fe1dc112ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1e13fd700 1 --2- 172.21.15.146:0/887974609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1dc12b590 0x7fe1dc112ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1e13fd700 1 -- 172.21.15.146:0/887974609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1dc1303d0 msgr2=0x7fe1dc113390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1e13fd700 1 --2- 172.21.15.146:0/887974609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1dc1303d0 0x7fe1dc113390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1e13fd700 1 -- 172.21.15.146:0/887974609 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d4009a20 con 0x7fe1dc05f560 2023-10-03T10:09:46.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1e1bfe700 1 --2- 172.21.15.146:0/887974609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1dc1303d0 0x7fe1dc113390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:46.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1e13fd700 1 --2- 172.21.15.146:0/887974609 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1dc05f560 0x7fe1dc1129b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fe1cc00c4f0 tx=0x7fe1cc007c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:46.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1d17fa700 1 -- 172.21.15.146:0/887974609 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0072e0 con 0x7fe1dc05f560 2023-10-03T10:09:46.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1d17fa700 1 -- 172.21.15.146:0/887974609 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1cc007440 con 0x7fe1dc05f560 2023-10-03T10:09:46.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1e3661700 1 -- 172.21.15.146:0/887974609 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d8009370 con 0x7fe1dc05f560 2023-10-03T10:09:46.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1d17fa700 1 -- 172.21.15.146:0/887974609 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc005930 con 0x7fe1dc05f560 2023-10-03T10:09:46.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.015+0000 7fe1e3661700 1 -- 172.21.15.146:0/887974609 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1dc1161c0 con 0x7fe1dc05f560 2023-10-03T10:09:46.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.016+0000 7fe1d17fa700 1 -- 172.21.15.146:0/887974609 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe1cc005ce0 con 0x7fe1dc05f560 2023-10-03T10:09:46.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.016+0000 7fe1d17fa700 1 -- 172.21.15.146:0/887974609 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fe1cc03a4b0 con 0x7fe1dc05f560 2023-10-03T10:09:46.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.017+0000 7fe1e3661700 1 -- 172.21.15.146:0/887974609 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1dc09a8b0 con 0x7fe1dc05f560 2023-10-03T10:09:46.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.021+0000 7fe1d17fa700 1 -- 172.21.15.146:0/887974609 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe1cc018030 con 0x7fe1dc05f560 2023-10-03T10:09:46.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.177+0000 7fe1e3661700 1 -- 172.21.15.146:0/887974609 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe1dc05a260 con 0x7fe1dc05f560 2023-10-03T10:09:46.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.178+0000 7fe1d17fa700 1 -- 172.21.15.146:0/887974609 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v12) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe1cc01cb50 con 0x7fe1dc05f560 2023-10-03T10:09:46.177 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-03T10:09:46.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.179+0000 7fe1e3661700 1 -- 172.21.15.146:0/887974609 >> v1:172.21.15.146:6816/118159 conn(0x7fe1c002bb60 legacy=0x7fe1c002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.180+0000 7fe1e3661700 1 -- 172.21.15.146:0/887974609 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1dc05f560 msgr2=0x7fe1dc1129b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.180+0000 7fe1e3661700 1 --2- 172.21.15.146:0/887974609 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1dc05f560 0x7fe1dc1129b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fe1cc00c4f0 tx=0x7fe1cc007c10).stop 2023-10-03T10:09:46.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.180+0000 7fe1e3661700 1 -- 172.21.15.146:0/887974609 shutdown_connections 2023-10-03T10:09:46.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.180+0000 7fe1e3661700 1 --2- 172.21.15.146:0/887974609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1dc1303d0 0x7fe1dc113390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.180+0000 7fe1e3661700 1 --2- 172.21.15.146:0/887974609 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1dc05f560 0x7fe1dc1129b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.180+0000 7fe1e3661700 1 --2- 172.21.15.146:0/887974609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1dc12b590 0x7fe1dc112ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.180+0000 7fe1e3661700 1 -- 172.21.15.146:0/887974609 >> 172.21.15.146:0/887974609 conn(0x7fe1dc09a1c0 msgr2=0x7fe1dc065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:46.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.180+0000 7fe1e3661700 1 -- 172.21.15.146:0/887974609 shutdown_connections 2023-10-03T10:09:46.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.180+0000 7fe1e3661700 1 -- 172.21.15.146:0/887974609 wait complete. 2023-10-03T10:09:46.191 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:09:46.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.310+0000 7fbe744e9700 1 Processor -- start 2023-10-03T10:09:46.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.310+0000 7fbe744e9700 1 -- start start 2023-10-03T10:09:46.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.310+0000 7fbe744e9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbe6c095da0 0x7fbe6c0961c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.310+0000 7fbe744e9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe6c0966b0 0x7fbe6c132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.310+0000 7fbe744e9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c091980 con 0x7fbe6c062b00 2023-10-03T10:09:46.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.310+0000 7fbe744e9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe6c0973f0 con 0x7fbe6c095da0 2023-10-03T10:09:46.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.310+0000 7fbe744e9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c062ee0 con 0x7fbe6c0966b0 2023-10-03T10:09:46.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.311+0000 7fbe72a86700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe6c0966b0 0x7fbe6c132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.311+0000 7fbe71a84700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbe6c095da0 0x7fbe6c0961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.311+0000 7fbe72285700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbe6c062b00 0x7fbe6c095690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48262/0 (socket says 172.21.15.146:48262) 2023-10-03T10:09:46.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.311+0000 7fbe72285700 1 -- 172.21.15.146:0/251564286 learned_addr learned my addr 172.21.15.146:0/251564286 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:09:46.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.311+0000 7fbe71283700 1 -- 172.21.15.146:0/251564286 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137799004 0 0) 0x7fbe6c091980 con 0x7fbe6c062b00 2023-10-03T10:09:46.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.311+0000 7fbe71283700 1 -- 172.21.15.146:0/251564286 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe580033f0 con 0x7fbe6c062b00 2023-10-03T10:09:46.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.311+0000 7fbe71a84700 1 -- 172.21.15.146:0/251564286 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe6c0966b0 msgr2=0x7fbe6c132290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:46.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.311+0000 7fbe71a84700 1 --2- 172.21.15.146:0/251564286 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe6c0966b0 0x7fbe6c132290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.311+0000 7fbe71a84700 1 -- 172.21.15.146:0/251564286 >> v1:172.21.15.146:6789/0 conn(0x7fbe6c062b00 legacy=0x7fbe6c095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.311+0000 7fbe71a84700 1 -- 172.21.15.146:0/251564286 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c092310 con 0x7fbe6c095da0 2023-10-03T10:09:46.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.311+0000 7fbe72a86700 1 --2- 172.21.15.146:0/251564286 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe6c0966b0 0x7fbe6c132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:46.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.311+0000 7fbe71a84700 1 --2- 172.21.15.146:0/251564286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe6c095da0 0x7fbe6c0961c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fbe5c009790 tx=0x7fbe5c009060).ready entity=mon.0 client_cookie=8c069ef3dd4329b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:46.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.311+0000 7fbe71283700 1 -- 172.21.15.146:0/251564286 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c00d4a0 con 0x7fbe6c095da0 2023-10-03T10:09:46.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.311+0000 7fbe71283700 1 -- 172.21.15.146:0/251564286 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5c00d600 con 0x7fbe6c095da0 2023-10-03T10:09:46.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.311+0000 7fbe71283700 1 -- 172.21.15.146:0/251564286 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c00d980 con 0x7fbe6c095da0 2023-10-03T10:09:46.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.312+0000 7fbe744e9700 1 -- 172.21.15.146:0/251564286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe6c095da0 msgr2=0x7fbe6c0961c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.312+0000 7fbe744e9700 1 --2- 172.21.15.146:0/251564286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe6c095da0 0x7fbe6c0961c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fbe5c009790 tx=0x7fbe5c009060).stop 2023-10-03T10:09:46.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.312+0000 7fbe744e9700 1 -- 172.21.15.146:0/251564286 shutdown_connections 2023-10-03T10:09:46.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.312+0000 7fbe744e9700 1 --2- 172.21.15.146:0/251564286 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe6c0966b0 0x7fbe6c132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.312+0000 7fbe744e9700 1 --2- 172.21.15.146:0/251564286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe6c095da0 0x7fbe6c0961c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.312+0000 7fbe744e9700 1 -- 172.21.15.146:0/251564286 >> 172.21.15.146:0/251564286 conn(0x7fbe6c09aa50 msgr2=0x7fbe6c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:46.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.312+0000 7fbe744e9700 1 -- 172.21.15.146:0/251564286 shutdown_connections 2023-10-03T10:09:46.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.312+0000 7fbe744e9700 1 -- 172.21.15.146:0/251564286 wait complete. 2023-10-03T10:09:46.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.313+0000 7fbe744e9700 1 Processor -- start 2023-10-03T10:09:46.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.313+0000 7fbe744e9700 1 -- start start 2023-10-03T10:09:46.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.313+0000 7fbe744e9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe6c062b00 0x7fbe6c119370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.313+0000 7fbe744e9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe6c095da0 0x7fbe6c115340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.313+0000 7fbe744e9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe6c0966b0 0x7fbe6c115830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.313+0000 7fbe744e9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c12d510 con 0x7fbe6c062b00 2023-10-03T10:09:46.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.313+0000 7fbe744e9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c117a00 con 0x7fbe6c095da0 2023-10-03T10:09:46.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.313+0000 7fbe744e9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c096da0 con 0x7fbe6c0966b0 2023-10-03T10:09:46.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.313+0000 7fbe72285700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe6c062b00 0x7fbe6c119370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.313+0000 7fbe71a84700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe6c095da0 0x7fbe6c115340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.313+0000 7fbe72285700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe6c062b00 0x7fbe6c119370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38004/0 (socket says 172.21.15.146:38004) 2023-10-03T10:09:46.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.313+0000 7fbe72285700 1 -- 172.21.15.146:0/1283694592 learned_addr learned my addr 172.21.15.146:0/1283694592 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:46.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.313+0000 7fbe72a86700 1 --2- 172.21.15.146:0/1283694592 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe6c0966b0 0x7fbe6c115830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.313+0000 7fbe71a84700 1 -- 172.21.15.146:0/1283694592 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe6c0966b0 msgr2=0x7fbe6c115830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.313+0000 7fbe71a84700 1 --2- 172.21.15.146:0/1283694592 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe6c0966b0 0x7fbe6c115830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.313+0000 7fbe71a84700 1 -- 172.21.15.146:0/1283694592 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe6c062b00 msgr2=0x7fbe6c119370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.313+0000 7fbe71a84700 1 --2- 172.21.15.146:0/1283694592 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe6c062b00 0x7fbe6c119370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.313+0000 7fbe71a84700 1 -- 172.21.15.146:0/1283694592 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe64009a20 con 0x7fbe6c095da0 2023-10-03T10:09:46.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.313+0000 7fbe72a86700 1 --2- 172.21.15.146:0/1283694592 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe6c0966b0 0x7fbe6c115830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:46.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.313+0000 7fbe72285700 1 --2- 172.21.15.146:0/1283694592 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe6c062b00 0x7fbe6c119370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:46.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.314+0000 7fbe71a84700 1 --2- 172.21.15.146:0/1283694592 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe6c095da0 0x7fbe6c115340 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fbe5c013000 tx=0x7fbe5c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:46.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.314+0000 7fbe627fc700 1 -- 172.21.15.146:0/1283694592 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c000c90 con 0x7fbe6c095da0 2023-10-03T10:09:46.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.314+0000 7fbe627fc700 1 -- 172.21.15.146:0/1283694592 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5c00d770 con 0x7fbe6c095da0 2023-10-03T10:09:46.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.314+0000 7fbe744e9700 1 -- 172.21.15.146:0/1283694592 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5c0092a0 con 0x7fbe6c095da0 2023-10-03T10:09:46.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.314+0000 7fbe627fc700 1 -- 172.21.15.146:0/1283694592 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c01d430 con 0x7fbe6c095da0 2023-10-03T10:09:46.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.314+0000 7fbe744e9700 1 -- 172.21.15.146:0/1283694592 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6c12d9a0 con 0x7fbe6c095da0 2023-10-03T10:09:46.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.314+0000 7fbe627fc700 1 -- 172.21.15.146:0/1283694592 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fbe5c01d820 con 0x7fbe6c095da0 2023-10-03T10:09:46.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.315+0000 7fbe627fc700 1 -- 172.21.15.146:0/1283694592 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fbe5c03bb40 con 0x7fbe6c095da0 2023-10-03T10:09:46.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.315+0000 7fbe744e9700 1 -- 172.21.15.146:0/1283694592 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe6c0999e0 con 0x7fbe6c095da0 2023-10-03T10:09:46.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.319+0000 7fbe627fc700 1 -- 172.21.15.146:0/1283694592 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fbe5c022020 con 0x7fbe6c095da0 2023-10-03T10:09:46.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.476+0000 7fbe744e9700 1 -- 172.21.15.146:0/1283694592 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbe6c05a260 con 0x7fbe6c095da0 2023-10-03T10:09:46.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.476+0000 7fbe627fc700 1 -- 172.21.15.146:0/1283694592 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v12) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbe5c01b910 con 0x7fbe6c095da0 2023-10-03T10:09:46.476 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-03T10:09:46.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.478+0000 7fbe744e9700 1 -- 172.21.15.146:0/1283694592 >> v1:172.21.15.146:6816/118159 conn(0x7fbe5002bb60 legacy=0x7fbe5002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.478+0000 7fbe744e9700 1 -- 172.21.15.146:0/1283694592 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe6c095da0 msgr2=0x7fbe6c115340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.478+0000 7fbe744e9700 1 --2- 172.21.15.146:0/1283694592 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe6c095da0 0x7fbe6c115340 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fbe5c013000 tx=0x7fbe5c016000).stop 2023-10-03T10:09:46.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.478+0000 7fbe744e9700 1 -- 172.21.15.146:0/1283694592 shutdown_connections 2023-10-03T10:09:46.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.478+0000 7fbe744e9700 1 --2- 172.21.15.146:0/1283694592 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe6c0966b0 0x7fbe6c115830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.478+0000 7fbe744e9700 1 --2- 172.21.15.146:0/1283694592 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe6c062b00 0x7fbe6c119370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.478+0000 7fbe744e9700 1 --2- 172.21.15.146:0/1283694592 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe6c095da0 0x7fbe6c115340 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.478+0000 7fbe744e9700 1 -- 172.21.15.146:0/1283694592 >> 172.21.15.146:0/1283694592 conn(0x7fbe6c09aa50 msgr2=0x7fbe6c132010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:46.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.478+0000 7fbe744e9700 1 -- 172.21.15.146:0/1283694592 shutdown_connections 2023-10-03T10:09:46.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.478+0000 7fbe744e9700 1 -- 172.21.15.146:0/1283694592 wait complete. 2023-10-03T10:09:46.489 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-03T10:09:46.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.605+0000 7ff3e3826700 1 Processor -- start 2023-10-03T10:09:46.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.605+0000 7ff3e3826700 1 -- start start 2023-10-03T10:09:46.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.605+0000 7ff3e3826700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3dc092670 0x7ff3dc1275f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.605+0000 7ff3e3826700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3dc1280e0 0x7ff3dc12b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.605+0000 7ff3e3826700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3dc063700 con 0x7ff3dc127c80 2023-10-03T10:09:46.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.605+0000 7ff3e3826700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc128560 con 0x7ff3dc1280e0 2023-10-03T10:09:46.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.605+0000 7ff3e3826700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc096c20 con 0x7ff3dc092670 2023-10-03T10:09:46.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.606+0000 7ff3e15c2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3dc092670 0x7ff3dc1275f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.606+0000 7ff3e1dc3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3dc1280e0 0x7ff3dc12b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.606+0000 7ff3e0dc1700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff3dc127c80 0x7ff3dc12aac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48276/0 (socket says 172.21.15.146:48276) 2023-10-03T10:09:46.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.606+0000 7ff3e15c2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3dc092670 0x7ff3dc1275f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:47602/0 (socket says 172.21.15.146:47602) 2023-10-03T10:09:46.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.606+0000 7ff3e0dc1700 1 -- 172.21.15.146:0/3138272095 learned_addr learned my addr 172.21.15.146:0/3138272095 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:09:46.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.606+0000 7ff3e1dc3700 1 -- 172.21.15.146:0/3138272095 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3dc092670 msgr2=0x7ff3dc1275f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:46.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.606+0000 7ff3d3fff700 1 -- 172.21.15.146:0/3138272095 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304312508 0 0) 0x7ff3dc063700 con 0x7ff3dc127c80 2023-10-03T10:09:46.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.606+0000 7ff3e1dc3700 1 --2- 172.21.15.146:0/3138272095 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3dc092670 0x7ff3dc1275f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.606+0000 7ff3e1dc3700 1 -- 172.21.15.146:0/3138272095 >> v1:172.21.15.146:6789/0 conn(0x7ff3dc127c80 legacy=0x7ff3dc12aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.606+0000 7ff3e1dc3700 1 -- 172.21.15.146:0/3138272095 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3dc092a50 con 0x7ff3dc1280e0 2023-10-03T10:09:46.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.606+0000 7ff3e15c2700 1 --2- 172.21.15.146:0/3138272095 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3dc092670 0x7ff3dc1275f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:46.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.606+0000 7ff3e1dc3700 1 --2- 172.21.15.146:0/3138272095 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3dc1280e0 0x7ff3dc12b1d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff3d4009ec0 tx=0x7ff3d4009780).ready entity=mon.1 client_cookie=cc2423c000c0f763 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:46.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.606+0000 7ff3d3fff700 1 -- 172.21.15.146:0/3138272095 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d400e070 con 0x7ff3dc1280e0 2023-10-03T10:09:46.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.606+0000 7ff3d3fff700 1 -- 172.21.15.146:0/3138272095 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d400bb90 con 0x7ff3dc1280e0 2023-10-03T10:09:46.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.606+0000 7ff3d3fff700 1 -- 172.21.15.146:0/3138272095 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4012410 con 0x7ff3dc1280e0 2023-10-03T10:09:46.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.607+0000 7ff3e3826700 1 -- 172.21.15.146:0/3138272095 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3dc1280e0 msgr2=0x7ff3dc12b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.607+0000 7ff3e3826700 1 --2- 172.21.15.146:0/3138272095 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3dc1280e0 0x7ff3dc12b1d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff3d4009ec0 tx=0x7ff3d4009780).stop 2023-10-03T10:09:46.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.607+0000 7ff3e3826700 1 -- 172.21.15.146:0/3138272095 shutdown_connections 2023-10-03T10:09:46.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.607+0000 7ff3e3826700 1 --2- 172.21.15.146:0/3138272095 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3dc1280e0 0x7ff3dc12b1d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.607+0000 7ff3e3826700 1 --2- 172.21.15.146:0/3138272095 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3dc092670 0x7ff3dc1275f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.607+0000 7ff3e3826700 1 -- 172.21.15.146:0/3138272095 >> 172.21.15.146:0/3138272095 conn(0x7ff3dc0974f0 msgr2=0x7ff3dc097900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:46.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.607+0000 7ff3e3826700 1 -- 172.21.15.146:0/3138272095 shutdown_connections 2023-10-03T10:09:46.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.607+0000 7ff3e3826700 1 -- 172.21.15.146:0/3138272095 wait complete. 2023-10-03T10:09:46.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.608+0000 7ff3e3826700 1 Processor -- start 2023-10-03T10:09:46.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.608+0000 7ff3e3826700 1 -- start start 2023-10-03T10:09:46.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.608+0000 7ff3e3826700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3dc092670 0x7ff3dc13a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.608+0000 7ff3e3826700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3dc127c80 0x7ff3dc13a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.608+0000 7ff3e3826700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3dc1280e0 0x7ff3dc13ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.608+0000 7ff3e3826700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc068fd0 con 0x7ff3dc092670 2023-10-03T10:09:46.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.608+0000 7ff3e3826700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc1291d0 con 0x7ff3dc1280e0 2023-10-03T10:09:46.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.608+0000 7ff3e3826700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc096e50 con 0x7ff3dc127c80 2023-10-03T10:09:46.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.608+0000 7ff3e15c2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3dc092670 0x7ff3dc13a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.608+0000 7ff3e15c2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3dc092670 0x7ff3dc13a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38008/0 (socket says 172.21.15.146:38008) 2023-10-03T10:09:46.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.608+0000 7ff3e15c2700 1 -- 172.21.15.146:0/4237368153 learned_addr learned my addr 172.21.15.146:0/4237368153 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:46.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.608+0000 7ff3e1dc3700 1 --2- 172.21.15.146:0/4237368153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3dc1280e0 0x7ff3dc13ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.608+0000 7ff3e0dc1700 1 --2- 172.21.15.146:0/4237368153 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3dc127c80 0x7ff3dc13a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.609+0000 7ff3e15c2700 1 -- 172.21.15.146:0/4237368153 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3dc127c80 msgr2=0x7ff3dc13a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.609+0000 7ff3e15c2700 1 --2- 172.21.15.146:0/4237368153 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3dc127c80 0x7ff3dc13a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.609+0000 7ff3e15c2700 1 -- 172.21.15.146:0/4237368153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3dc1280e0 msgr2=0x7ff3dc13ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.609+0000 7ff3e15c2700 1 --2- 172.21.15.146:0/4237368153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3dc1280e0 0x7ff3dc13ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.609+0000 7ff3e15c2700 1 -- 172.21.15.146:0/4237368153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d80092a0 con 0x7ff3dc092670 2023-10-03T10:09:46.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.609+0000 7ff3e1dc3700 1 --2- 172.21.15.146:0/4237368153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3dc1280e0 0x7ff3dc13ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:46.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.609+0000 7ff3e15c2700 1 --2- 172.21.15.146:0/4237368153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3dc092670 0x7ff3dc13a120 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff3d800ea20 tx=0x7ff3d8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:46.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.609+0000 7ff3d17fa700 1 -- 172.21.15.146:0/4237368153 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d800ee60 con 0x7ff3dc092670 2023-10-03T10:09:46.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.609+0000 7ff3d17fa700 1 -- 172.21.15.146:0/4237368153 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d8009600 con 0x7ff3dc092670 2023-10-03T10:09:46.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.609+0000 7ff3e3826700 1 -- 172.21.15.146:0/4237368153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d4009a20 con 0x7ff3dc092670 2023-10-03T10:09:46.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.609+0000 7ff3d17fa700 1 -- 172.21.15.146:0/4237368153 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d800ca60 con 0x7ff3dc092670 2023-10-03T10:09:46.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.609+0000 7ff3e3826700 1 -- 172.21.15.146:0/4237368153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3dc0692b0 con 0x7ff3dc092670 2023-10-03T10:09:46.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.610+0000 7ff3d17fa700 1 -- 172.21.15.146:0/4237368153 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff3d801b400 con 0x7ff3dc092670 2023-10-03T10:09:46.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.610+0000 7ff3d17fa700 1 -- 172.21.15.146:0/4237368153 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7ff3d803b2e0 con 0x7ff3dc092670 2023-10-03T10:09:46.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.610+0000 7ff3e3826700 1 -- 172.21.15.146:0/4237368153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3dc05a260 con 0x7ff3dc092670 2023-10-03T10:09:46.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.614+0000 7ff3d17fa700 1 -- 172.21.15.146:0/4237368153 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ff3d8016030 con 0x7ff3dc092670 2023-10-03T10:09:46.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.773+0000 7ff3e3826700 1 -- 172.21.15.146:0/4237368153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff3dc062cc0 con 0x7ff3dc092670 2023-10-03T10:09:46.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.774+0000 7ff3d17fa700 1 -- 172.21.15.146:0/4237368153 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v12) v1 ==== 84+0+143 (secure 0 0 0) 0x7ff3d8019310 con 0x7ff3dc092670 2023-10-03T10:09:46.774 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:46.774 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2023-10-03T10:09:46.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:09:46.774 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2023-10-03T10:09:46.774 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": "device_health_metrics" 2023-10-03T10:09:46.774 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:09:46.774 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:09:46.774 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 2, 2023-10-03T10:09:46.775 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": "rbd" 2023-10-03T10:09:46.775 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:09:46.775 INFO:teuthology.orchestra.run.smithi146.stdout:] 2023-10-03T10:09:46.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.775+0000 7ff3e3826700 1 -- 172.21.15.146:0/4237368153 >> v1:172.21.15.146:6816/118159 conn(0x7ff3c002bb60 legacy=0x7ff3c002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.775+0000 7ff3e3826700 1 -- 172.21.15.146:0/4237368153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3dc092670 msgr2=0x7ff3dc13a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.775+0000 7ff3e3826700 1 --2- 172.21.15.146:0/4237368153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3dc092670 0x7ff3dc13a120 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff3d800ea20 tx=0x7ff3d8009060).stop 2023-10-03T10:09:46.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.775+0000 7ff3e3826700 1 -- 172.21.15.146:0/4237368153 shutdown_connections 2023-10-03T10:09:46.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.775+0000 7ff3e3826700 1 --2- 172.21.15.146:0/4237368153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3dc1280e0 0x7ff3dc13ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.775+0000 7ff3e3826700 1 --2- 172.21.15.146:0/4237368153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3dc092670 0x7ff3dc13a120 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.775+0000 7ff3e3826700 1 --2- 172.21.15.146:0/4237368153 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3dc127c80 0x7ff3dc13a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.775+0000 7ff3e3826700 1 -- 172.21.15.146:0/4237368153 >> 172.21.15.146:0/4237368153 conn(0x7ff3dc0974f0 msgr2=0x7ff3dc09a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:46.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.775+0000 7ff3e3826700 1 -- 172.21.15.146:0/4237368153 shutdown_connections 2023-10-03T10:09:46.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.775+0000 7ff3e3826700 1 -- 172.21.15.146:0/4237368153 wait complete. 2023-10-03T10:09:46.787 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-03T10:09:46.787 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-03T10:09:46.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.906+0000 7f9227525700 1 Processor -- start 2023-10-03T10:09:46.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.907+0000 7f9227525700 1 -- start start 2023-10-03T10:09:46.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.907+0000 7f9227525700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9220092840 0x7f922012af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.907+0000 7f9227525700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f922012b950 0x7f9220128070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.907+0000 7f9227525700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9220063440 con 0x7f922012b530 2023-10-03T10:09:46.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.907+0000 7f9227525700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9220096fc0 con 0x7f922012b950 2023-10-03T10:09:46.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.907+0000 7f9227525700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9220097250 con 0x7f9220092840 2023-10-03T10:09:46.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.907+0000 7f9225ac2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f922012b950 0x7f9220128070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.907+0000 7f92252c1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9220092840 0x7f922012af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.907+0000 7f9224ac0700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f922012b530 0x7f9220127960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48282/0 (socket says 172.21.15.146:48282) 2023-10-03T10:09:46.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.907+0000 7f9225ac2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f922012b950 0x7f9220128070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33292/0 (socket says 172.21.15.146:33292) 2023-10-03T10:09:46.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.907+0000 7f9224ac0700 1 -- 172.21.15.146:0/2195146709 learned_addr learned my addr 172.21.15.146:0/2195146709 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:09:46.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.907+0000 7f9225ac2700 1 -- 172.21.15.146:0/2195146709 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9220092840 msgr2=0x7f922012af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:46.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.907+0000 7f9217fff700 1 -- 172.21.15.146:0/2195146709 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420134366 0 0) 0x7f9220063440 con 0x7f922012b530 2023-10-03T10:09:46.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.907+0000 7f9225ac2700 1 --2- 172.21.15.146:0/2195146709 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9220092840 0x7f922012af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.907+0000 7f9225ac2700 1 -- 172.21.15.146:0/2195146709 >> v1:172.21.15.146:6789/0 conn(0x7f922012b530 legacy=0x7f9220127960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.907+0000 7f9225ac2700 1 -- 172.21.15.146:0/2195146709 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9220092c20 con 0x7f922012b950 2023-10-03T10:09:46.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.907+0000 7f92252c1700 1 --2- 172.21.15.146:0/2195146709 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9220092840 0x7f922012af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:46.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.908+0000 7f9225ac2700 1 --2- 172.21.15.146:0/2195146709 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f922012b950 0x7f9220128070 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f9218009e90 tx=0x7f9218009780).ready entity=mon.1 client_cookie=81306a251e51edc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:46.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.908+0000 7f9217fff700 1 -- 172.21.15.146:0/2195146709 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921800e070 con 0x7f922012b950 2023-10-03T10:09:46.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.908+0000 7f9217fff700 1 -- 172.21.15.146:0/2195146709 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921800bb60 con 0x7f922012b950 2023-10-03T10:09:46.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.908+0000 7f9217fff700 1 -- 172.21.15.146:0/2195146709 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9218012410 con 0x7f922012b950 2023-10-03T10:09:46.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.908+0000 7f9227525700 1 -- 172.21.15.146:0/2195146709 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f922012b950 msgr2=0x7f9220128070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.908+0000 7f9227525700 1 --2- 172.21.15.146:0/2195146709 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f922012b950 0x7f9220128070 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f9218009e90 tx=0x7f9218009780).stop 2023-10-03T10:09:46.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.908+0000 7f9227525700 1 -- 172.21.15.146:0/2195146709 shutdown_connections 2023-10-03T10:09:46.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.908+0000 7f9227525700 1 --2- 172.21.15.146:0/2195146709 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f922012b950 0x7f9220128070 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.908+0000 7f9227525700 1 --2- 172.21.15.146:0/2195146709 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9220092840 0x7f922012af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.908+0000 7f9227525700 1 -- 172.21.15.146:0/2195146709 >> 172.21.15.146:0/2195146709 conn(0x7f9220097640 msgr2=0x7f9220097a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:46.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.908+0000 7f9227525700 1 -- 172.21.15.146:0/2195146709 shutdown_connections 2023-10-03T10:09:46.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.908+0000 7f9227525700 1 -- 172.21.15.146:0/2195146709 wait complete. 2023-10-03T10:09:46.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.909+0000 7f9227525700 1 Processor -- start 2023-10-03T10:09:46.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.910+0000 7f9227525700 1 -- start start 2023-10-03T10:09:46.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.910+0000 7f9227525700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9220092840 0x7f92201171f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.910+0000 7f9227525700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f922012b530 0x7f92201176e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.910+0000 7f9227525700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f922012b950 0x7f922013a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.910+0000 7f9227525700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9220096bc0 con 0x7f922012b530 2023-10-03T10:09:46.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.910+0000 7f9227525700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922011a010 con 0x7f9220092840 2023-10-03T10:09:46.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.910+0000 7f9227525700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f922011a2d0 con 0x7f922012b950 2023-10-03T10:09:46.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.910+0000 7f92252c1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9220092840 0x7f92201171f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.910+0000 7f9225ac2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f922012b950 0x7f922013a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.910+0000 7f92252c1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9220092840 0x7f92201171f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33304/0 (socket says 172.21.15.146:33304) 2023-10-03T10:09:46.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.910+0000 7f92252c1700 1 -- 172.21.15.146:0/64584702 learned_addr learned my addr 172.21.15.146:0/64584702 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:46.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.910+0000 7f9224ac0700 1 --2- 172.21.15.146:0/64584702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f922012b530 0x7f92201176e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.911+0000 7f92252c1700 1 -- 172.21.15.146:0/64584702 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f922012b950 msgr2=0x7f922013a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.911+0000 7f92252c1700 1 --2- 172.21.15.146:0/64584702 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f922012b950 0x7f922013a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.911+0000 7f92252c1700 1 -- 172.21.15.146:0/64584702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f922012b530 msgr2=0x7f92201176e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.911+0000 7f92252c1700 1 --2- 172.21.15.146:0/64584702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f922012b530 0x7f92201176e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.911+0000 7f92252c1700 1 -- 172.21.15.146:0/64584702 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9210009250 con 0x7f9220092840 2023-10-03T10:09:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.911+0000 7f9225ac2700 1 --2- 172.21.15.146:0/64584702 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f922012b950 0x7f922013a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.911+0000 7f92252c1700 1 --2- 172.21.15.146:0/64584702 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9220092840 0x7f92201171f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f921000ec80 tx=0x7f9210006f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.911+0000 7f92157fa700 1 -- 172.21.15.146:0/64584702 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9210005880 con 0x7f9220092840 2023-10-03T10:09:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.911+0000 7f92157fa700 1 -- 172.21.15.146:0/64584702 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92100059e0 con 0x7f9220092840 2023-10-03T10:09:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.911+0000 7f9227525700 1 -- 172.21.15.146:0/64584702 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9218009a20 con 0x7f9220092840 2023-10-03T10:09:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.911+0000 7f92157fa700 1 -- 172.21.15.146:0/64584702 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9210005d60 con 0x7f9220092840 2023-10-03T10:09:46.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.911+0000 7f9227525700 1 -- 172.21.15.146:0/64584702 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922011ac90 con 0x7f9220092840 2023-10-03T10:09:46.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.912+0000 7f92157fa700 1 -- 172.21.15.146:0/64584702 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f921000ca60 con 0x7f9220092840 2023-10-03T10:09:46.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.912+0000 7f92157fa700 1 -- 172.21.15.146:0/64584702 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f921003ae70 con 0x7f9220092840 2023-10-03T10:09:46.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.912+0000 7f9227525700 1 -- 172.21.15.146:0/64584702 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922011a490 con 0x7f9220092840 2023-10-03T10:09:46.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:46.917+0000 7f92157fa700 1 -- 172.21.15.146:0/64584702 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9210016070 con 0x7f9220092840 2023-10-03T10:09:47.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.076+0000 7f9227525700 1 -- 172.21.15.146:0/64584702 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9220065620 con 0x7f9220092840 2023-10-03T10:09:47.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.345+0000 7f92157fa700 1 -- 172.21.15.146:0/64584702 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v13) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9210016030 con 0x7f9220092840 2023-10-03T10:09:47.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.350+0000 7f9227525700 1 -- 172.21.15.146:0/64584702 >> v1:172.21.15.146:6816/118159 conn(0x7f920402bb60 legacy=0x7f920402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:47.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.350+0000 7f9227525700 1 -- 172.21.15.146:0/64584702 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9220092840 msgr2=0x7f92201171f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:47.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.350+0000 7f9227525700 1 --2- 172.21.15.146:0/64584702 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9220092840 0x7f92201171f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f921000ec80 tx=0x7f9210006f40).stop 2023-10-03T10:09:47.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.351+0000 7f9227525700 1 -- 172.21.15.146:0/64584702 shutdown_connections 2023-10-03T10:09:47.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.351+0000 7f9227525700 1 --2- 172.21.15.146:0/64584702 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f922012b950 0x7f922013a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.351+0000 7f9227525700 1 --2- 172.21.15.146:0/64584702 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9220092840 0x7f92201171f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.351+0000 7f9227525700 1 --2- 172.21.15.146:0/64584702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f922012b530 0x7f92201176e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.351+0000 7f9227525700 1 -- 172.21.15.146:0/64584702 >> 172.21.15.146:0/64584702 conn(0x7f9220097640 msgr2=0x7f9220092f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:47.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.353+0000 7f9227525700 1 -- 172.21.15.146:0/64584702 shutdown_connections 2023-10-03T10:09:47.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.353+0000 7f9227525700 1 -- 172.21.15.146:0/64584702 wait complete. 2023-10-03T10:09:47.354 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2023-10-03T10:09:47.365 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-03T10:09:47.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.489+0000 7f8053dc2700 1 Processor -- start 2023-10-03T10:09:47.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.489+0000 7f8053dc2700 1 -- start start 2023-10-03T10:09:47.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.490+0000 7f8053dc2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f804c093950 0x7f804c095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:47.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.490+0000 7f8053dc2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f804c12d250 0x7f804c12f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:47.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.490+0000 7f8053dc2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f804c094ba0 con 0x7f804c095c50 2023-10-03T10:09:47.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.490+0000 7f8053dc2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804c092e90 con 0x7f804c093950 2023-10-03T10:09:47.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.490+0000 7f8053dc2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f804c096b60 con 0x7f804c12d250 2023-10-03T10:09:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.490+0000 7f8051b5e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f804c093950 0x7f804c095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.490+0000 7f805235f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f804c12d250 0x7f804c12f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.490+0000 7f805235f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f804c12d250 0x7f804c12f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:47654/0 (socket says 172.21.15.146:47654) 2023-10-03T10:09:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.490+0000 7f8051b5e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f804c093950 0x7f804c095760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33320/0 (socket says 172.21.15.146:33320) 2023-10-03T10:09:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.490+0000 7f805235f700 1 -- 172.21.15.146:0/3128937393 learned_addr learned my addr 172.21.15.146:0/3128937393 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.490+0000 7f805135d700 1 --1- 172.21.15.146:0/3128937393 >> v1:172.21.15.146:6789/0 conn(0x7f804c095c50 0x7f804c096030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48288/0 (socket says 172.21.15.146:48288) 2023-10-03T10:09:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.490+0000 7f805235f700 1 -- 172.21.15.146:0/3128937393 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f804c093950 msgr2=0x7f804c095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.490+0000 7f805235f700 1 --2- 172.21.15.146:0/3128937393 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f804c093950 0x7f804c095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.490+0000 7f805235f700 1 -- 172.21.15.146:0/3128937393 >> v1:172.21.15.146:6789/0 conn(0x7f804c095c50 legacy=0x7f804c096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.490+0000 7f805235f700 1 -- 172.21.15.146:0/3128937393 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c093150 con 0x7f804c12d250 2023-10-03T10:09:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.490+0000 7f8050b5c700 1 -- 172.21.15.146:0/3128937393 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1552115280 0 0) 0x7f804c094ba0 con 0x7f804c095c50 2023-10-03T10:09:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.490+0000 7f8051b5e700 1 --2- 172.21.15.146:0/3128937393 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f804c093950 0x7f804c095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.490+0000 7f805235f700 1 --2- 172.21.15.146:0/3128937393 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f804c12d250 0x7f804c12f640 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f804400d1d0 tx=0x7f804400ba50).ready entity=mon.2 client_cookie=8e6a2a6efe696eb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.490+0000 7f8050b5c700 1 -- 172.21.15.146:0/3128937393 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8044010070 con 0x7f804c12d250 2023-10-03T10:09:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.491+0000 7f8050b5c700 1 -- 172.21.15.146:0/3128937393 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804400de40 con 0x7f804c12d250 2023-10-03T10:09:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.491+0000 7f8050b5c700 1 -- 172.21.15.146:0/3128937393 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804400b2e0 con 0x7f804c12d250 2023-10-03T10:09:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.491+0000 7f8053dc2700 1 -- 172.21.15.146:0/3128937393 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f804c12d250 msgr2=0x7f804c12f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.491+0000 7f8053dc2700 1 --2- 172.21.15.146:0/3128937393 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f804c12d250 0x7f804c12f640 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f804400d1d0 tx=0x7f804400ba50).stop 2023-10-03T10:09:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.491+0000 7f8053dc2700 1 -- 172.21.15.146:0/3128937393 shutdown_connections 2023-10-03T10:09:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.491+0000 7f8053dc2700 1 --2- 172.21.15.146:0/3128937393 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f804c12d250 0x7f804c12f640 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.491+0000 7f8053dc2700 1 --2- 172.21.15.146:0/3128937393 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f804c093950 0x7f804c095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.491+0000 7f8053dc2700 1 -- 172.21.15.146:0/3128937393 >> 172.21.15.146:0/3128937393 conn(0x7f804c09aa50 msgr2=0x7f804c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.491+0000 7f8053dc2700 1 -- 172.21.15.146:0/3128937393 shutdown_connections 2023-10-03T10:09:47.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.491+0000 7f8053dc2700 1 -- 172.21.15.146:0/3128937393 wait complete. 2023-10-03T10:09:47.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.492+0000 7f8053dc2700 1 Processor -- start 2023-10-03T10:09:47.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.492+0000 7f8053dc2700 1 -- start start 2023-10-03T10:09:47.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.492+0000 7f8053dc2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f804c093950 0x7f804c12cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:47.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.492+0000 7f8053dc2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f804c095c50 0x7f804c115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:47.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.492+0000 7f8053dc2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f804c12d250 0x7f804c116270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:47.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.492+0000 7f8053dc2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c0993a0 con 0x7f804c12d250 2023-10-03T10:09:47.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.492+0000 7f8053dc2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804c092410 con 0x7f804c095c50 2023-10-03T10:09:47.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.492+0000 7f8053dc2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f804c119d40 con 0x7f804c093950 2023-10-03T10:09:47.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.492+0000 7f8051b5e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f804c093950 0x7f804c12cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:47.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.492+0000 7f8051b5e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f804c093950 0x7f804c12cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:47658/0 (socket says 172.21.15.146:47658) 2023-10-03T10:09:47.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.492+0000 7f8051b5e700 1 -- 172.21.15.146:0/831887489 learned_addr learned my addr 172.21.15.146:0/831887489 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:47.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.493+0000 7f805235f700 1 --2- 172.21.15.146:0/831887489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f804c12d250 0x7f804c116270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:47.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.493+0000 7f805135d700 1 --2- 172.21.15.146:0/831887489 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f804c095c50 0x7f804c115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:47.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.493+0000 7f8051b5e700 1 -- 172.21.15.146:0/831887489 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f804c095c50 msgr2=0x7f804c115d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:47.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.493+0000 7f8051b5e700 1 --2- 172.21.15.146:0/831887489 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f804c095c50 0x7f804c115d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.493+0000 7f8051b5e700 1 -- 172.21.15.146:0/831887489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f804c12d250 msgr2=0x7f804c116270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:47.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.493+0000 7f8051b5e700 1 --2- 172.21.15.146:0/831887489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f804c12d250 0x7f804c116270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.493+0000 7f8051b5e700 1 -- 172.21.15.146:0/831887489 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c0092a0 con 0x7f804c093950 2023-10-03T10:09:47.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.493+0000 7f805235f700 1 --2- 172.21.15.146:0/831887489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f804c12d250 0x7f804c116270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:09:47.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.493+0000 7f8051b5e700 1 --2- 172.21.15.146:0/831887489 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f804c093950 0x7f804c12cd00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f803c00ea20 tx=0x7f803c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:47.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.493+0000 7f8041ffb700 1 -- 172.21.15.146:0/831887489 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c00c850 con 0x7f804c093950 2023-10-03T10:09:47.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.493+0000 7f8041ffb700 1 -- 172.21.15.146:0/831887489 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c00c9b0 con 0x7f804c093950 2023-10-03T10:09:47.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.493+0000 7f8041ffb700 1 -- 172.21.15.146:0/831887489 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c00cd30 con 0x7f804c093950 2023-10-03T10:09:47.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.493+0000 7f8053dc2700 1 -- 172.21.15.146:0/831887489 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804400bcf0 con 0x7f804c093950 2023-10-03T10:09:47.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.493+0000 7f8053dc2700 1 -- 172.21.15.146:0/831887489 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804c117790 con 0x7f804c093950 2023-10-03T10:09:47.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.494+0000 7f8041ffb700 1 -- 172.21.15.146:0/831887489 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f803c012600 con 0x7f804c093950 2023-10-03T10:09:47.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.494+0000 7f8041ffb700 1 -- 172.21.15.146:0/831887489 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3208+0+0 (secure 0 0 0) 0x7f803c03b3f0 con 0x7f804c093950 2023-10-03T10:09:47.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.494+0000 7f8053dc2700 1 -- 172.21.15.146:0/831887489 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f804c098930 con 0x7f804c093950 2023-10-03T10:09:47.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.499+0000 7f8041ffb700 1 -- 172.21.15.146:0/831887489 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f803c01b400 con 0x7f804c093950 2023-10-03T10:09:47.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:47.655+0000 7f8053dc2700 1 -- 172.21.15.146:0/831887489 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f804c05a260 con 0x7f804c093950 2023-10-03T10:09:48.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.353+0000 7f8041ffb700 1 -- 172.21.15.146:0/831887489 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v14) v1 ==== 170+0+0 (secure 0 0 0) 0x7f803c02a0d0 con 0x7f804c093950 2023-10-03T10:09:48.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.364+0000 7f8053dc2700 1 -- 172.21.15.146:0/831887489 >> v1:172.21.15.146:6816/118159 conn(0x7f803002bb60 legacy=0x7f803002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.364+0000 7f8053dc2700 1 -- 172.21.15.146:0/831887489 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f804c093950 msgr2=0x7f804c12cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.364+0000 7f8053dc2700 1 --2- 172.21.15.146:0/831887489 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f804c093950 0x7f804c12cd00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f803c00ea20 tx=0x7f803c009060).stop 2023-10-03T10:09:48.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.364+0000 7f8053dc2700 1 -- 172.21.15.146:0/831887489 shutdown_connections 2023-10-03T10:09:48.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.364+0000 7f8053dc2700 1 --2- 172.21.15.146:0/831887489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f804c12d250 0x7f804c116270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.364+0000 7f8053dc2700 1 --2- 172.21.15.146:0/831887489 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f804c093950 0x7f804c12cd00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.364+0000 7f8053dc2700 1 --2- 172.21.15.146:0/831887489 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f804c095c50 0x7f804c115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.364+0000 7f8053dc2700 1 -- 172.21.15.146:0/831887489 >> 172.21.15.146:0/831887489 conn(0x7f804c09aa50 msgr2=0x7f804c062aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.365+0000 7f8053dc2700 1 -- 172.21.15.146:0/831887489 shutdown_connections 2023-10-03T10:09:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.366+0000 7f8053dc2700 1 -- 172.21.15.146:0/831887489 wait complete. 2023-10-03T10:09:48.373 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2023-10-03T10:09:48.390 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-03T10:09:48.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.511+0000 7f627bf33700 1 Processor -- start 2023-10-03T10:09:48.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.512+0000 7f627bf33700 1 -- start start 2023-10-03T10:09:48.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.512+0000 7f627bf33700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6274062b00 0x7f6274095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:48.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.512+0000 7f627bf33700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6274095b80 0x7f6274095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:48.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.512+0000 7f627bf33700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6274091980 con 0x7f6274096490 2023-10-03T10:09:48.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.512+0000 7f627bf33700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62740973f0 con 0x7f6274095b80 2023-10-03T10:09:48.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.512+0000 7f627bf33700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6274062ee0 con 0x7f6274062b00 2023-10-03T10:09:48.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.512+0000 7f6279ccf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6274062b00 0x7f6274095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:48.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.512+0000 7f62794ce700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6274095b80 0x7f6274095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:48.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.512+0000 7f6279ccf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6274062b00 0x7f6274095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33336/0 (socket says 172.21.15.146:33336) 2023-10-03T10:09:48.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.512+0000 7f6279ccf700 1 -- 172.21.15.146:0/572187585 learned_addr learned my addr 172.21.15.146:0/572187585 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:48.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.512+0000 7f62794ce700 1 --2- 172.21.15.146:0/572187585 >> v2:172.21.15.146:3300/0 conn(0x7f6274095b80 0x7f6274095fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38038/0 (socket says 172.21.15.146:38038) 2023-10-03T10:09:48.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.512+0000 7f627a4d0700 1 --1- 172.21.15.146:0/572187585 >> v1:172.21.15.146:6789/0 conn(0x7f6274096490 0x7f6274131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48304/0 (socket says 172.21.15.146:48304) 2023-10-03T10:09:48.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.513+0000 7f6279ccf700 1 -- 172.21.15.146:0/572187585 >> v2:172.21.15.146:3300/0 conn(0x7f6274095b80 msgr2=0x7f6274095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:48.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.513+0000 7f6279ccf700 1 --2- 172.21.15.146:0/572187585 >> v2:172.21.15.146:3300/0 conn(0x7f6274095b80 0x7f6274095fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.513+0000 7f6279ccf700 1 -- 172.21.15.146:0/572187585 >> v1:172.21.15.146:6789/0 conn(0x7f6274096490 legacy=0x7f6274131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.513+0000 7f6279ccf700 1 -- 172.21.15.146:0/572187585 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6274092310 con 0x7f6274062b00 2023-10-03T10:09:48.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.513+0000 7f62794ce700 1 --2- 172.21.15.146:0/572187585 >> v2:172.21.15.146:3300/0 conn(0x7f6274095b80 0x7f6274095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:48.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.513+0000 7f6279ccf700 1 --2- 172.21.15.146:0/572187585 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6274062b00 0x7f6274095690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f6270009830 tx=0x7f62700090f0).ready entity=mon.1 client_cookie=649824f3eee539f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:48.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.513+0000 7f6278ccd700 1 -- 172.21.15.146:0/572187585 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627000b580 con 0x7f6274062b00 2023-10-03T10:09:48.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.513+0000 7f6278ccd700 1 -- 172.21.15.146:0/572187585 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627000b6e0 con 0x7f6274062b00 2023-10-03T10:09:48.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.513+0000 7f6278ccd700 1 -- 172.21.15.146:0/572187585 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627000ba60 con 0x7f6274062b00 2023-10-03T10:09:48.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.513+0000 7f627bf33700 1 -- 172.21.15.146:0/572187585 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6274062b00 msgr2=0x7f6274095690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.513+0000 7f627bf33700 1 --2- 172.21.15.146:0/572187585 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6274062b00 0x7f6274095690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f6270009830 tx=0x7f62700090f0).stop 2023-10-03T10:09:48.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.513+0000 7f627bf33700 1 -- 172.21.15.146:0/572187585 shutdown_connections 2023-10-03T10:09:48.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.513+0000 7f627bf33700 1 --2- 172.21.15.146:0/572187585 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6274062b00 0x7f6274095690 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.513+0000 7f627bf33700 1 --2- 172.21.15.146:0/572187585 >> v2:172.21.15.146:3300/0 conn(0x7f6274095b80 0x7f6274095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.513+0000 7f627bf33700 1 -- 172.21.15.146:0/572187585 >> 172.21.15.146:0/572187585 conn(0x7f627409aa50 msgr2=0x7f627409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:48.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.513+0000 7f627bf33700 1 -- 172.21.15.146:0/572187585 shutdown_connections 2023-10-03T10:09:48.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.513+0000 7f627bf33700 1 -- 172.21.15.146:0/572187585 wait complete. 2023-10-03T10:09:48.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.515+0000 7f627bf33700 1 Processor -- start 2023-10-03T10:09:48.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.515+0000 7f627bf33700 1 -- start start 2023-10-03T10:09:48.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.515+0000 7f627bf33700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6274062b00 0x7f6274119a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:48.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.515+0000 7f627bf33700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6274095b80 0x7f6274115af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:48.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.515+0000 7f627bf33700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6274096490 0x7f6274115fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:48.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.515+0000 7f627bf33700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6274116fb0 con 0x7f6274062b00 2023-10-03T10:09:48.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.515+0000 7f627bf33700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627412dc60 con 0x7f6274095b80 2023-10-03T10:09:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.515+0000 7f627bf33700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6274096da0 con 0x7f6274096490 2023-10-03T10:09:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.515+0000 7f6279ccf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6274062b00 0x7f6274119a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.515+0000 7f62794ce700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6274095b80 0x7f6274115af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.515+0000 7f6279ccf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6274062b00 0x7f6274119a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38040/0 (socket says 172.21.15.146:38040) 2023-10-03T10:09:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.515+0000 7f6279ccf700 1 -- 172.21.15.146:0/3788843288 learned_addr learned my addr 172.21.15.146:0/3788843288 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.515+0000 7f627a4d0700 1 --2- 172.21.15.146:0/3788843288 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6274096490 0x7f6274115fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.516+0000 7f6279ccf700 1 -- 172.21.15.146:0/3788843288 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6274096490 msgr2=0x7f6274115fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.516+0000 7f6279ccf700 1 --2- 172.21.15.146:0/3788843288 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6274096490 0x7f6274115fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.516+0000 7f6279ccf700 1 -- 172.21.15.146:0/3788843288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6274095b80 msgr2=0x7f6274115af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.516+0000 7f6279ccf700 1 --2- 172.21.15.146:0/3788843288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6274095b80 0x7f6274115af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.516+0000 7f6279ccf700 1 -- 172.21.15.146:0/3788843288 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62640092a0 con 0x7f6274062b00 2023-10-03T10:09:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.516+0000 7f62794ce700 1 --2- 172.21.15.146:0/3788843288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6274095b80 0x7f6274115af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:48.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.516+0000 7f6279ccf700 1 --2- 172.21.15.146:0/3788843288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6274062b00 0x7f6274119a90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f6274092730 tx=0x7f6270017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:48.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.516+0000 7f6269ffb700 1 -- 172.21.15.146:0/3788843288 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6270000bc0 con 0x7f6274062b00 2023-10-03T10:09:48.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.516+0000 7f6269ffb700 1 -- 172.21.15.146:0/3788843288 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627000b850 con 0x7f6274062b00 2023-10-03T10:09:48.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.516+0000 7f6269ffb700 1 -- 172.21.15.146:0/3788843288 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6270000d20 con 0x7f6274062b00 2023-10-03T10:09:48.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.516+0000 7f627bf33700 1 -- 172.21.15.146:0/3788843288 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6270009370 con 0x7f6274062b00 2023-10-03T10:09:48.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.516+0000 7f627bf33700 1 -- 172.21.15.146:0/3788843288 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6274117680 con 0x7f6274062b00 2023-10-03T10:09:48.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.517+0000 7f6269ffb700 1 -- 172.21.15.146:0/3788843288 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f627001ca50 con 0x7f6274062b00 2023-10-03T10:09:48.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.517+0000 7f6269ffb700 1 -- 172.21.15.146:0/3788843288 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3590+0+0 (secure 0 0 0) 0x7f627003cdd0 con 0x7f6274062b00 2023-10-03T10:09:48.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.517+0000 7f627bf33700 1 -- 172.21.15.146:0/3788843288 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6274099e70 con 0x7f6274062b00 2023-10-03T10:09:48.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.522+0000 7f6269ffb700 1 -- 172.21.15.146:0/3788843288 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f627002a080 con 0x7f6274062b00 2023-10-03T10:09:48.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.717+0000 7f627bf33700 1 -- 172.21.15.146:0/3788843288 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f627405a260 con 0x7f6274062b00 2023-10-03T10:09:48.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.727+0000 7f6269ffb700 1 -- 172.21.15.146:0/3788843288 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v3) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6270020020 con 0x7f6274062b00 2023-10-03T10:09:48.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.731+0000 7f627bf33700 1 -- 172.21.15.146:0/3788843288 >> v1:172.21.15.146:6816/118159 conn(0x7f625802bb60 legacy=0x7f625802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.731+0000 7f627bf33700 1 -- 172.21.15.146:0/3788843288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6274062b00 msgr2=0x7f6274119a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.731+0000 7f627bf33700 1 --2- 172.21.15.146:0/3788843288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6274062b00 0x7f6274119a90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f6274092730 tx=0x7f6270017000).stop 2023-10-03T10:09:48.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.734+0000 7f627bf33700 1 -- 172.21.15.146:0/3788843288 shutdown_connections 2023-10-03T10:09:48.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.734+0000 7f627bf33700 1 --2- 172.21.15.146:0/3788843288 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6274096490 0x7f6274115fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.734+0000 7f627bf33700 1 --2- 172.21.15.146:0/3788843288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6274062b00 0x7f6274119a90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.734+0000 7f627bf33700 1 --2- 172.21.15.146:0/3788843288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6274095b80 0x7f6274115af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.734+0000 7f627bf33700 1 -- 172.21.15.146:0/3788843288 >> 172.21.15.146:0/3788843288 conn(0x7f627409aa50 msgr2=0x7f62741301f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:48.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.736+0000 7f627bf33700 1 -- 172.21.15.146:0/3788843288 shutdown_connections 2023-10-03T10:09:48.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.736+0000 7f627bf33700 1 -- 172.21.15.146:0/3788843288 wait complete. 2023-10-03T10:09:48.738 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 3 and data pool 4 2023-10-03T10:09:48.758 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:48.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.880+0000 7fb882c7b700 1 Processor -- start 2023-10-03T10:09:48.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.880+0000 7fb882c7b700 1 -- start start 2023-10-03T10:09:48.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.880+0000 7fb882c7b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb87c12afd0 0x7fb87c12b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.880+0000 7fb882c7b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87c0924b0 0x7fb87c132ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.880+0000 7fb882c7b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb87c066e30 con 0x7fb87c091980 2023-10-03T10:09:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.880+0000 7fb882c7b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87c12ab10 con 0x7fb87c12afd0 2023-10-03T10:09:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.880+0000 7fb882c7b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c067500 con 0x7fb87c0924b0 2023-10-03T10:09:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.880+0000 7fb880a17700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb87c12afd0 0x7fb87c12b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.880+0000 7fb881218700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87c0924b0 0x7fb87c132ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.880+0000 7fb87bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb87c091980 0x7fb87c091da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48310/0 (socket says 172.21.15.146:48310) 2023-10-03T10:09:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.880+0000 7fb880a17700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb87c12afd0 0x7fb87c12b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38054/0 (socket says 172.21.15.146:38054) 2023-10-03T10:09:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.880+0000 7fb881218700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87c0924b0 0x7fb87c132ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:47676/0 (socket says 172.21.15.146:47676) 2023-10-03T10:09:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.880+0000 7fb87bfff700 1 -- 172.21.15.146:0/2635506893 learned_addr learned my addr 172.21.15.146:0/2635506893 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:09:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.881+0000 7fb881218700 1 -- 172.21.15.146:0/2635506893 >> v2:172.21.15.146:3300/0 conn(0x7fb87c12afd0 msgr2=0x7fb87c12b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.881+0000 7fb881218700 1 --2- 172.21.15.146:0/2635506893 >> v2:172.21.15.146:3300/0 conn(0x7fb87c12afd0 0x7fb87c12b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.881+0000 7fb881218700 1 -- 172.21.15.146:0/2635506893 >> v1:172.21.15.146:6789/0 conn(0x7fb87c091980 legacy=0x7fb87c091da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.881+0000 7fb881218700 1 -- 172.21.15.146:0/2635506893 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87c12adb0 con 0x7fb87c0924b0 2023-10-03T10:09:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.881+0000 7fb880a17700 1 --2- 172.21.15.146:0/2635506893 >> v2:172.21.15.146:3300/0 conn(0x7fb87c12afd0 0x7fb87c12b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.881+0000 7fb881218700 1 --2- 172.21.15.146:0/2635506893 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87c0924b0 0x7fb87c132ec0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fb874009e60 tx=0x7fb874009780).ready entity=mon.2 client_cookie=527bdf433b0f6f38 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.881+0000 7fb87b7fe700 1 -- 172.21.15.146:0/2635506893 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87400e070 con 0x7fb87c0924b0 2023-10-03T10:09:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.881+0000 7fb87b7fe700 1 -- 172.21.15.146:0/2635506893 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87400bb60 con 0x7fb87c0924b0 2023-10-03T10:09:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.881+0000 7fb87b7fe700 1 -- 172.21.15.146:0/2635506893 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874012410 con 0x7fb87c0924b0 2023-10-03T10:09:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.881+0000 7fb882c7b700 1 -- 172.21.15.146:0/2635506893 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87c0924b0 msgr2=0x7fb87c132ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.881+0000 7fb882c7b700 1 --2- 172.21.15.146:0/2635506893 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87c0924b0 0x7fb87c132ec0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fb874009e60 tx=0x7fb874009780).stop 2023-10-03T10:09:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.882+0000 7fb882c7b700 1 -- 172.21.15.146:0/2635506893 shutdown_connections 2023-10-03T10:09:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.882+0000 7fb882c7b700 1 --2- 172.21.15.146:0/2635506893 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87c0924b0 0x7fb87c132ec0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.882+0000 7fb882c7b700 1 --2- 172.21.15.146:0/2635506893 >> v2:172.21.15.146:3300/0 conn(0x7fb87c12afd0 0x7fb87c12b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.882+0000 7fb882c7b700 1 -- 172.21.15.146:0/2635506893 >> 172.21.15.146:0/2635506893 conn(0x7fb87c09a230 msgr2=0x7fb87c09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.882+0000 7fb882c7b700 1 -- 172.21.15.146:0/2635506893 shutdown_connections 2023-10-03T10:09:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.882+0000 7fb882c7b700 1 -- 172.21.15.146:0/2635506893 wait complete. 2023-10-03T10:09:48.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.882+0000 7fb882c7b700 1 Processor -- start 2023-10-03T10:09:48.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.883+0000 7fb882c7b700 1 -- start start 2023-10-03T10:09:48.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.883+0000 7fb882c7b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb87c091980 0x7fb87c13a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:48.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.883+0000 7fb882c7b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87c0924b0 0x7fb87c13aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:48.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.883+0000 7fb882c7b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb87c12afd0 0x7fb87c115c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:48.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.883+0000 7fb882c7b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c12a450 con 0x7fb87c091980 2023-10-03T10:09:48.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.883+0000 7fb882c7b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c12f370 con 0x7fb87c12afd0 2023-10-03T10:09:48.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.883+0000 7fb882c7b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c118200 con 0x7fb87c0924b0 2023-10-03T10:09:48.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.883+0000 7fb880a17700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb87c091980 0x7fb87c13a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:48.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.883+0000 7fb87bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87c0924b0 0x7fb87c13aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:48.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.883+0000 7fb880a17700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb87c091980 0x7fb87c13a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38068/0 (socket says 172.21.15.146:38068) 2023-10-03T10:09:48.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.883+0000 7fb880a17700 1 -- 172.21.15.146:0/1071302354 learned_addr learned my addr 172.21.15.146:0/1071302354 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:48.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.883+0000 7fb881218700 1 --2- 172.21.15.146:0/1071302354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb87c12afd0 0x7fb87c115c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:48.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.883+0000 7fb880a17700 1 -- 172.21.15.146:0/1071302354 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87c0924b0 msgr2=0x7fb87c13aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.883+0000 7fb880a17700 1 --2- 172.21.15.146:0/1071302354 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87c0924b0 0x7fb87c13aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.883+0000 7fb880a17700 1 -- 172.21.15.146:0/1071302354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb87c12afd0 msgr2=0x7fb87c115c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.883+0000 7fb880a17700 1 --2- 172.21.15.146:0/1071302354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb87c12afd0 0x7fb87c115c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.883+0000 7fb880a17700 1 -- 172.21.15.146:0/1071302354 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8700092a0 con 0x7fb87c091980 2023-10-03T10:09:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.883+0000 7fb87bfff700 1 --2- 172.21.15.146:0/1071302354 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87c0924b0 0x7fb87c13aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.884+0000 7fb880a17700 1 --2- 172.21.15.146:0/1071302354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb87c091980 0x7fb87c13a5b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fb87000ea50 tx=0x7fb870009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.884+0000 7fb878ff9700 1 -- 172.21.15.146:0/1071302354 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87000ee90 con 0x7fb87c091980 2023-10-03T10:09:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.884+0000 7fb878ff9700 1 -- 172.21.15.146:0/1071302354 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb870009600 con 0x7fb87c091980 2023-10-03T10:09:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.884+0000 7fb878ff9700 1 -- 172.21.15.146:0/1071302354 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87000ca60 con 0x7fb87c091980 2023-10-03T10:09:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.884+0000 7fb882c7b700 1 -- 172.21.15.146:0/1071302354 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb874009a20 con 0x7fb87c091980 2023-10-03T10:09:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.884+0000 7fb882c7b700 1 -- 172.21.15.146:0/1071302354 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87c1190d0 con 0x7fb87c091980 2023-10-03T10:09:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.884+0000 7fb878ff9700 1 -- 172.21.15.146:0/1071302354 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb87001b400 con 0x7fb87c091980 2023-10-03T10:09:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.884+0000 7fb878ff9700 1 -- 172.21.15.146:0/1071302354 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb87003b390 con 0x7fb87c091980 2023-10-03T10:09:48.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.885+0000 7fb882c7b700 1 -- 172.21.15.146:0/1071302354 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87c098950 con 0x7fb87c091980 2023-10-03T10:09:48.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:48.889+0000 7fb878ff9700 1 -- 172.21.15.146:0/1071302354 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb870016020 con 0x7fb87c091980 2023-10-03T10:09:49.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.048+0000 7fb882c7b700 1 -- 172.21.15.146:0/1071302354 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb87c05a260 con 0x7fb87c091980 2023-10-03T10:09:49.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.049+0000 7fb878ff9700 1 -- 172.21.15.146:0/1071302354 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11386 (secure 0 0 0) 0x7fb87000ce10 con 0x7fb87c091980 2023-10-03T10:09:49.049 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:49.049 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":15,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:09:48.717930+0000","last_up_change":"2023-10-03T10:09:42.301022+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":118758}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":118758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":118758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":118758}]},"public_addr":"172.21.15.146:6800/118758","cluster_addr":"172.21.15.146:6801/118758","heartbeat_back_addr":"172.21.15.146:6803/118758","heartbeat_front_addr":"172.21.15.146:6802/118758","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":118774}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":118774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":118774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":118774}]},"public_addr":"172.21.15.146:6804/118774","cluster_addr":"172.21.15.146:6806/118774","heartbeat_back_addr":"172.21.15.146:6810/118774","heartbeat_front_addr":"172.21.15.146:6808/118774","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":118775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":118775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":118775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":118775}]},"public_addr":"172.21.15.146:6805/118775","cluster_addr":"172.21.15.146:6807/118775","heartbeat_back_addr":"172.21.15.146:6811/118775","heartbeat_front_addr":"172.21.15.146:6809/118775","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":118776}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":118776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":118776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":118776}]},"public_addr":"172.21.15.146:6812/118776","cluster_addr":"172.21.15.146:6813/118776","heartbeat_back_addr":"172.21.15.146:6815/118776","heartbeat_front_addr":"172.21.15.146:6814/118776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:49.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.051+0000 7fb882c7b700 1 -- 172.21.15.146:0/1071302354 >> v1:172.21.15.146:6816/118159 conn(0x7fb86002bb90 legacy=0x7fb86002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.051+0000 7fb882c7b700 1 -- 172.21.15.146:0/1071302354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb87c091980 msgr2=0x7fb87c13a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.051+0000 7fb882c7b700 1 --2- 172.21.15.146:0/1071302354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb87c091980 0x7fb87c13a5b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fb87000ea50 tx=0x7fb870009060).stop 2023-10-03T10:09:49.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.051+0000 7fb882c7b700 1 -- 172.21.15.146:0/1071302354 shutdown_connections 2023-10-03T10:09:49.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.051+0000 7fb882c7b700 1 --2- 172.21.15.146:0/1071302354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb87c12afd0 0x7fb87c115c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.051+0000 7fb882c7b700 1 --2- 172.21.15.146:0/1071302354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb87c091980 0x7fb87c13a5b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.051+0000 7fb882c7b700 1 --2- 172.21.15.146:0/1071302354 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87c0924b0 0x7fb87c13aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.051+0000 7fb882c7b700 1 -- 172.21.15.146:0/1071302354 >> 172.21.15.146:0/1071302354 conn(0x7fb87c09a230 msgr2=0x7fb87c12e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:49.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.051+0000 7fb882c7b700 1 -- 172.21.15.146:0/1071302354 shutdown_connections 2023-10-03T10:09:49.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.051+0000 7fb882c7b700 1 -- 172.21.15.146:0/1071302354 wait complete. 2023-10-03T10:09:49.062 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:49.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.179+0000 7f2569fab700 1 Processor -- start 2023-10-03T10:09:49.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.179+0000 7f2569fab700 1 -- start start 2023-10-03T10:09:49.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.179+0000 7f2569fab700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2564093950 0x7f2564095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.179+0000 7f2569fab700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2564095c50 0x7f2564096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.179+0000 7f2569fab700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2564094ba0 con 0x7f256412c240 2023-10-03T10:09:49.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.179+0000 7f2569fab700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2564092e90 con 0x7f2564095c50 2023-10-03T10:09:49.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.179+0000 7f2569fab700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2564096b60 con 0x7f2564093950 2023-10-03T10:09:49.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.179+0000 7f2562ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2564095c50 0x7f2564096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.179+0000 7f25637fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2564093950 0x7f2564095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.179+0000 7f25637fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2564093950 0x7f2564095760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:47702/0 (socket says 172.21.15.146:47702) 2023-10-03T10:09:49.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.179+0000 7f2562ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2564095c50 0x7f2564096030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38082/0 (socket says 172.21.15.146:38082) 2023-10-03T10:09:49.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.179+0000 7f25637fe700 1 -- 172.21.15.146:0/2461973622 learned_addr learned my addr 172.21.15.146:0/2461973622 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:49.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.179+0000 7f2563fff700 1 --1- 172.21.15.146:0/2461973622 >> v1:172.21.15.146:6789/0 conn(0x7f256412c240 0x7f256412e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48320/0 (socket says 172.21.15.146:48320) 2023-10-03T10:09:49.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.180+0000 7f25637fe700 1 -- 172.21.15.146:0/2461973622 >> v2:172.21.15.146:3300/0 conn(0x7f2564095c50 msgr2=0x7f2564096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:49.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.180+0000 7f25637fe700 1 --2- 172.21.15.146:0/2461973622 >> v2:172.21.15.146:3300/0 conn(0x7f2564095c50 0x7f2564096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.180+0000 7f25637fe700 1 -- 172.21.15.146:0/2461973622 >> v1:172.21.15.146:6789/0 conn(0x7f256412c240 legacy=0x7f256412e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.180+0000 7f25627fc700 1 -- 172.21.15.146:0/2461973622 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85547533 0 0) 0x7f2564094ba0 con 0x7f256412c240 2023-10-03T10:09:49.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.180+0000 7f25637fe700 1 -- 172.21.15.146:0/2461973622 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2564093150 con 0x7f2564093950 2023-10-03T10:09:49.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.180+0000 7f2562ffd700 1 --2- 172.21.15.146:0/2461973622 >> v2:172.21.15.146:3300/0 conn(0x7f2564095c50 0x7f2564096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:49.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.180+0000 7f25637fe700 1 --2- 172.21.15.146:0/2461973622 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2564093950 0x7f2564095760 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f2554006fd0 tx=0x7f25540090f0).ready entity=mon.2 client_cookie=70a24e521d00557b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:49.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.180+0000 7f25627fc700 1 -- 172.21.15.146:0/2461973622 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255400b580 con 0x7f2564093950 2023-10-03T10:09:49.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.180+0000 7f25627fc700 1 -- 172.21.15.146:0/2461973622 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255400b6e0 con 0x7f2564093950 2023-10-03T10:09:49.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.180+0000 7f25627fc700 1 -- 172.21.15.146:0/2461973622 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255400ba80 con 0x7f2564093950 2023-10-03T10:09:49.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.180+0000 7f2569fab700 1 -- 172.21.15.146:0/2461973622 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2564093950 msgr2=0x7f2564095760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.180+0000 7f2569fab700 1 --2- 172.21.15.146:0/2461973622 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2564093950 0x7f2564095760 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f2554006fd0 tx=0x7f25540090f0).stop 2023-10-03T10:09:49.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.181+0000 7f2569fab700 1 -- 172.21.15.146:0/2461973622 shutdown_connections 2023-10-03T10:09:49.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.181+0000 7f2569fab700 1 --2- 172.21.15.146:0/2461973622 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2564093950 0x7f2564095760 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.181+0000 7f2569fab700 1 --2- 172.21.15.146:0/2461973622 >> v2:172.21.15.146:3300/0 conn(0x7f2564095c50 0x7f2564096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.181+0000 7f2569fab700 1 -- 172.21.15.146:0/2461973622 >> 172.21.15.146:0/2461973622 conn(0x7f256409aa50 msgr2=0x7f256409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:49.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.181+0000 7f2569fab700 1 -- 172.21.15.146:0/2461973622 shutdown_connections 2023-10-03T10:09:49.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.181+0000 7f2569fab700 1 -- 172.21.15.146:0/2461973622 wait complete. 2023-10-03T10:09:49.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.182+0000 7f2569fab700 1 Processor -- start 2023-10-03T10:09:49.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.182+0000 7f2569fab700 1 -- start start 2023-10-03T10:09:49.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.182+0000 7f2569fab700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2564093950 0x7f256411aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.182+0000 7f2569fab700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2564095c50 0x7f2564116ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.182+0000 7f2569fab700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f256412c240 0x7f2564116fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.182+0000 7f2569fab700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256412bc90 con 0x7f256412c240 2023-10-03T10:09:49.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.182+0000 7f2569fab700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25641191b0 con 0x7f2564095c50 2023-10-03T10:09:49.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.182+0000 7f2569fab700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f256411a050 con 0x7f2564093950 2023-10-03T10:09:49.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.182+0000 7f25637fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2564093950 0x7f256411aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.182+0000 7f2562ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2564095c50 0x7f2564116ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.182+0000 7f25637fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2564093950 0x7f256411aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:47716/0 (socket says 172.21.15.146:47716) 2023-10-03T10:09:49.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.182+0000 7f2563fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f256412c240 0x7f2564116fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.182+0000 7f25637fe700 1 -- 172.21.15.146:0/3334834053 learned_addr learned my addr 172.21.15.146:0/3334834053 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:49.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.182+0000 7f2562ffd700 1 -- 172.21.15.146:0/3334834053 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2564093950 msgr2=0x7f256411aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.182+0000 7f2562ffd700 1 --2- 172.21.15.146:0/3334834053 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2564093950 0x7f256411aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.182+0000 7f2562ffd700 1 -- 172.21.15.146:0/3334834053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f256412c240 msgr2=0x7f2564116fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.182+0000 7f2562ffd700 1 --2- 172.21.15.146:0/3334834053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f256412c240 0x7f2564116fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.182+0000 7f2562ffd700 1 -- 172.21.15.146:0/3334834053 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25580092a0 con 0x7f2564095c50 2023-10-03T10:09:49.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.182+0000 7f25637fe700 1 --2- 172.21.15.146:0/3334834053 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2564093950 0x7f256411aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:49.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.182+0000 7f2563fff700 1 --2- 172.21.15.146:0/3334834053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f256412c240 0x7f2564116fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:49.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.183+0000 7f2562ffd700 1 --2- 172.21.15.146:0/3334834053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2564095c50 0x7f2564116ac0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f255800e950 tx=0x7f2558009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:49.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.183+0000 7f254b7fe700 1 -- 172.21.15.146:0/3334834053 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558009580 con 0x7f2564095c50 2023-10-03T10:09:49.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.183+0000 7f254b7fe700 1 -- 172.21.15.146:0/3334834053 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2558012600 con 0x7f2564095c50 2023-10-03T10:09:49.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.183+0000 7f2569fab700 1 -- 172.21.15.146:0/3334834053 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2554009370 con 0x7f2564095c50 2023-10-03T10:09:49.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.183+0000 7f254b7fe700 1 -- 172.21.15.146:0/3334834053 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25580129a0 con 0x7f2564095c50 2023-10-03T10:09:49.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.183+0000 7f2569fab700 1 -- 172.21.15.146:0/3334834053 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25641188a0 con 0x7f2564095c50 2023-10-03T10:09:49.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.183+0000 7f254b7fe700 1 -- 172.21.15.146:0/3334834053 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f2558012d10 con 0x7f2564095c50 2023-10-03T10:09:49.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.183+0000 7f254b7fe700 1 -- 172.21.15.146:0/3334834053 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f255803b460 con 0x7f2564095c50 2023-10-03T10:09:49.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.184+0000 7f2569fab700 1 -- 172.21.15.146:0/3334834053 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256405a260 con 0x7f2564095c50 2023-10-03T10:09:49.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.188+0000 7f254b7fe700 1 -- 172.21.15.146:0/3334834053 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f2558016070 con 0x7f2564095c50 2023-10-03T10:09:49.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.346+0000 7f2569fab700 1 -- 172.21.15.146:0/3334834053 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2564046c20 con 0x7f2564095c50 2023-10-03T10:09:49.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.349+0000 7f254b7fe700 1 -- 172.21.15.146:0/3334834053 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11386 (secure 0 0 0) 0x7f2558016020 con 0x7f2564095c50 2023-10-03T10:09:49.349 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:49.349 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":15,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:09:48.717930+0000","last_up_change":"2023-10-03T10:09:42.301022+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":118758}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":118758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":118758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":118758}]},"public_addr":"172.21.15.146:6800/118758","cluster_addr":"172.21.15.146:6801/118758","heartbeat_back_addr":"172.21.15.146:6803/118758","heartbeat_front_addr":"172.21.15.146:6802/118758","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":118774}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":118774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":118774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":118774}]},"public_addr":"172.21.15.146:6804/118774","cluster_addr":"172.21.15.146:6806/118774","heartbeat_back_addr":"172.21.15.146:6810/118774","heartbeat_front_addr":"172.21.15.146:6808/118774","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":118775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":118775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":118775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":118775}]},"public_addr":"172.21.15.146:6805/118775","cluster_addr":"172.21.15.146:6807/118775","heartbeat_back_addr":"172.21.15.146:6811/118775","heartbeat_front_addr":"172.21.15.146:6809/118775","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":118776}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":118776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":118776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":118776}]},"public_addr":"172.21.15.146:6812/118776","cluster_addr":"172.21.15.146:6813/118776","heartbeat_back_addr":"172.21.15.146:6815/118776","heartbeat_front_addr":"172.21.15.146:6814/118776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:49.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.351+0000 7f2569fab700 1 -- 172.21.15.146:0/3334834053 >> v1:172.21.15.146:6816/118159 conn(0x7f255002bb60 legacy=0x7f255002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.351+0000 7f2569fab700 1 -- 172.21.15.146:0/3334834053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2564095c50 msgr2=0x7f2564116ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.351+0000 7f2569fab700 1 --2- 172.21.15.146:0/3334834053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2564095c50 0x7f2564116ac0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f255800e950 tx=0x7f2558009060).stop 2023-10-03T10:09:49.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.351+0000 7f2569fab700 1 -- 172.21.15.146:0/3334834053 shutdown_connections 2023-10-03T10:09:49.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.351+0000 7f2569fab700 1 --2- 172.21.15.146:0/3334834053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f256412c240 0x7f2564116fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.351+0000 7f2569fab700 1 --2- 172.21.15.146:0/3334834053 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2564093950 0x7f256411aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.351+0000 7f2569fab700 1 --2- 172.21.15.146:0/3334834053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2564095c50 0x7f2564116ac0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.351+0000 7f2569fab700 1 -- 172.21.15.146:0/3334834053 >> 172.21.15.146:0/3334834053 conn(0x7f256409aa50 msgr2=0x7f2564069210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:49.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.351+0000 7f2569fab700 1 -- 172.21.15.146:0/3334834053 shutdown_connections 2023-10-03T10:09:49.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.351+0000 7f2569fab700 1 -- 172.21.15.146:0/3334834053 wait complete. 2023-10-03T10:09:49.363 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-03T10:09:49.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.481+0000 7f3c1731b700 1 Processor -- start 2023-10-03T10:09:49.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.481+0000 7f3c1731b700 1 -- start start 2023-10-03T10:09:49.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.482+0000 7f3c1731b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c100656a0 0x7f3c100986a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.482+0000 7f3c1731b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c10097d60 0x7f3c10098b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.482+0000 7f3c1731b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c10066680 con 0x7f3c10099080 2023-10-03T10:09:49.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.482+0000 7f3c1731b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c100952e0 con 0x7f3c100656a0 2023-10-03T10:09:49.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.482+0000 7f3c1731b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c10065a80 con 0x7f3c10097d60 2023-10-03T10:09:49.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.482+0000 7f3c150b7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c100656a0 0x7f3c100986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.482+0000 7f3c148b6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c10097d60 0x7f3c10098b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.482+0000 7f3c158b8700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3c10099080 0x7f3c10131500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48326/0 (socket says 172.21.15.146:48326) 2023-10-03T10:09:49.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.482+0000 7f3c158b8700 1 -- 172.21.15.146:0/724329646 learned_addr learned my addr 172.21.15.146:0/724329646 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:09:49.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.482+0000 7f3c148b6700 1 -- 172.21.15.146:0/724329646 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c100656a0 msgr2=0x7f3c100986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:49.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.482+0000 7f3c148b6700 1 --2- 172.21.15.146:0/724329646 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c100656a0 0x7f3c100986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.482+0000 7f3c148b6700 1 -- 172.21.15.146:0/724329646 >> v1:172.21.15.146:6789/0 conn(0x7f3c10099080 legacy=0x7f3c10131500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.482+0000 7f3c07fff700 1 -- 172.21.15.146:0/724329646 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783000545 0 0) 0x7f3c10066680 con 0x7f3c10099080 2023-10-03T10:09:49.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.482+0000 7f3c148b6700 1 -- 172.21.15.146:0/724329646 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c10066170 con 0x7f3c10097d60 2023-10-03T10:09:49.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.482+0000 7f3c148b6700 1 --2- 172.21.15.146:0/724329646 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c10097d60 0x7f3c10098b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f3c00009790 tx=0x7f3c00009060).ready entity=mon.2 client_cookie=f4cf6186e2de1346 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:49.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.482+0000 7f3c07fff700 1 -- 172.21.15.146:0/724329646 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0000f510 con 0x7f3c10097d60 2023-10-03T10:09:49.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.482+0000 7f3c07fff700 1 -- 172.21.15.146:0/724329646 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0000f670 con 0x7f3c10097d60 2023-10-03T10:09:49.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.483+0000 7f3c07fff700 1 -- 172.21.15.146:0/724329646 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0000f9f0 con 0x7f3c10097d60 2023-10-03T10:09:49.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.483+0000 7f3c1731b700 1 -- 172.21.15.146:0/724329646 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c10097d60 msgr2=0x7f3c10098b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.483+0000 7f3c1731b700 1 --2- 172.21.15.146:0/724329646 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c10097d60 0x7f3c10098b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f3c00009790 tx=0x7f3c00009060).stop 2023-10-03T10:09:49.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.483+0000 7f3c1731b700 1 -- 172.21.15.146:0/724329646 shutdown_connections 2023-10-03T10:09:49.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.483+0000 7f3c1731b700 1 --2- 172.21.15.146:0/724329646 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c100656a0 0x7f3c100986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.483+0000 7f3c1731b700 1 --2- 172.21.15.146:0/724329646 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c10097d60 0x7f3c10098b90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.483+0000 7f3c1731b700 1 -- 172.21.15.146:0/724329646 >> 172.21.15.146:0/724329646 conn(0x7f3c1009a7a0 msgr2=0x7f3c1009abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:49.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.483+0000 7f3c1731b700 1 -- 172.21.15.146:0/724329646 shutdown_connections 2023-10-03T10:09:49.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.483+0000 7f3c1731b700 1 -- 172.21.15.146:0/724329646 wait complete. 2023-10-03T10:09:49.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.484+0000 7f3c1731b700 1 Processor -- start 2023-10-03T10:09:49.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.484+0000 7f3c1731b700 1 -- start start 2023-10-03T10:09:49.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c1731b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c100656a0 0x7f3c1011a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c1731b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c10099080 0x7f3c1011ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c1731b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c1011b2f0 0x7f3c10140df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c1731b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1011bdc0 con 0x7f3c100656a0 2023-10-03T10:09:49.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c1731b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1011dea0 con 0x7f3c1011b2f0 2023-10-03T10:09:49.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c1731b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1011b750 con 0x7f3c10099080 2023-10-03T10:09:49.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c158b8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c1011b2f0 0x7f3c10140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c148b6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c10099080 0x7f3c1011ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c148b6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c10099080 0x7f3c1011ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:47744/0 (socket says 172.21.15.146:47744) 2023-10-03T10:09:49.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c150b7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c100656a0 0x7f3c1011a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c148b6700 1 -- 172.21.15.146:0/35247015 learned_addr learned my addr 172.21.15.146:0/35247015 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:49.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c158b8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c1011b2f0 0x7f3c10140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33380/0 (socket says 172.21.15.146:33380) 2023-10-03T10:09:49.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c148b6700 1 -- 172.21.15.146:0/35247015 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c1011b2f0 msgr2=0x7f3c10140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c148b6700 1 --2- 172.21.15.146:0/35247015 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c1011b2f0 0x7f3c10140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c148b6700 1 -- 172.21.15.146:0/35247015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c100656a0 msgr2=0x7f3c1011a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c148b6700 1 --2- 172.21.15.146:0/35247015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c100656a0 0x7f3c1011a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c148b6700 1 -- 172.21.15.146:0/35247015 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c000092a0 con 0x7f3c10099080 2023-10-03T10:09:49.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c158b8700 1 --2- 172.21.15.146:0/35247015 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c1011b2f0 0x7f3c10140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:49.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c148b6700 1 --2- 172.21.15.146:0/35247015 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c10099080 0x7f3c1011ae00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f3c00006d70 tx=0x7f3c00017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:49.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c057fa700 1 -- 172.21.15.146:0/35247015 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0000f7e0 con 0x7f3c10099080 2023-10-03T10:09:49.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c057fa700 1 -- 172.21.15.146:0/35247015 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0000f940 con 0x7f3c10099080 2023-10-03T10:09:49.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c057fa700 1 -- 172.21.15.146:0/35247015 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0001b620 con 0x7f3c10099080 2023-10-03T10:09:49.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c1731b700 1 -- 172.21.15.146:0/35247015 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c100981f0 con 0x7f3c10099080 2023-10-03T10:09:49.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.485+0000 7f3c1731b700 1 -- 172.21.15.146:0/35247015 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c1009cd90 con 0x7f3c10099080 2023-10-03T10:09:49.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.486+0000 7f3c057fa700 1 -- 172.21.15.146:0/35247015 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3c0001ba10 con 0x7f3c10099080 2023-10-03T10:09:49.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.486+0000 7f3c057fa700 1 -- 172.21.15.146:0/35247015 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f3c0003c9e0 con 0x7f3c10099080 2023-10-03T10:09:49.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.486+0000 7f3c1731b700 1 -- 172.21.15.146:0/35247015 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c1011e380 con 0x7f3c10099080 2023-10-03T10:09:49.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.491+0000 7f3c057fa700 1 -- 172.21.15.146:0/35247015 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3c1011e380 con 0x7f3c10099080 2023-10-03T10:09:49.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.685+0000 7f3c1731b700 1 -- 172.21.15.146:0/35247015 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3c1011e380 con 0x7f3c10099080 2023-10-03T10:09:49.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.724+0000 7f3c057fa700 1 -- 172.21.15.146:0/35247015 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v4) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3c1011e380 con 0x7f3c10099080 2023-10-03T10:09:49.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.727+0000 7f3c1731b700 1 -- 172.21.15.146:0/35247015 >> v1:172.21.15.146:6816/118159 conn(0x7f3bf402bb90 legacy=0x7f3bf402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.727+0000 7f3c1731b700 1 -- 172.21.15.146:0/35247015 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c10099080 msgr2=0x7f3c1011ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.727+0000 7f3c1731b700 1 --2- 172.21.15.146:0/35247015 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c10099080 0x7f3c1011ae00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f3c00006d70 tx=0x7f3c00017000).stop 2023-10-03T10:09:49.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.727+0000 7f3c1731b700 1 -- 172.21.15.146:0/35247015 shutdown_connections 2023-10-03T10:09:49.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.727+0000 7f3c1731b700 1 --2- 172.21.15.146:0/35247015 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c1011b2f0 0x7f3c10140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.727+0000 7f3c1731b700 1 --2- 172.21.15.146:0/35247015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c100656a0 0x7f3c1011a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.727+0000 7f3c1731b700 1 --2- 172.21.15.146:0/35247015 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c10099080 0x7f3c1011ae00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.727+0000 7f3c1731b700 1 -- 172.21.15.146:0/35247015 >> 172.21.15.146:0/35247015 conn(0x7f3c1009a7a0 msgr2=0x7f3c10114360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:49.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.729+0000 7f3c1731b700 1 -- 172.21.15.146:0/35247015 shutdown_connections 2023-10-03T10:09:49.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.729+0000 7f3c1731b700 1 -- 172.21.15.146:0/35247015 wait complete. 2023-10-03T10:09:49.742 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-03T10:09:49.743 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-03T10:09:49.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.861+0000 7f7c5eaee700 1 Processor -- start 2023-10-03T10:09:49.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.861+0000 7f7c5eaee700 1 -- start start 2023-10-03T10:09:49.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.862+0000 7f7c5eaee700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c5805f560 0x7f7c58096840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.862+0000 7f7c5eaee700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7c58069d90 0x7f7c58096d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.862+0000 7f7c5eaee700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c580933e0 con 0x7f7c58067e90 2023-10-03T10:09:49.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.862+0000 7f7c5eaee700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5805f940 con 0x7f7c58069d90 2023-10-03T10:09:49.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.862+0000 7f7c5eaee700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580921e0 con 0x7f7c5805f560 2023-10-03T10:09:49.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.862+0000 7f7c5c88a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c5805f560 0x7f7c58096840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.862+0000 7f7c57fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7c58069d90 0x7f7c58096d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.862+0000 7f7c57fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7c58069d90 0x7f7c58096d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38106/0 (socket says 172.21.15.146:38106) 2023-10-03T10:09:49.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.862+0000 7f7c5c88a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c5805f560 0x7f7c58096840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:47756/0 (socket says 172.21.15.146:47756) 2023-10-03T10:09:49.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.862+0000 7f7c5d08b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7c58067e90 0x7f7c58068300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48330/0 (socket says 172.21.15.146:48330) 2023-10-03T10:09:49.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.862+0000 7f7c57fff700 1 -- 172.21.15.146:0/2126044392 learned_addr learned my addr 172.21.15.146:0/2126044392 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:49.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.862+0000 7f7c57fff700 1 -- 172.21.15.146:0/2126044392 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c5805f560 msgr2=0x7f7c58096840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:49.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.862+0000 7f7c57fff700 1 --2- 172.21.15.146:0/2126044392 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c5805f560 0x7f7c58096840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.862+0000 7f7c57fff700 1 -- 172.21.15.146:0/2126044392 >> v1:172.21.15.146:6789/0 conn(0x7f7c58067e90 legacy=0x7f7c58068300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.862+0000 7f7c57fff700 1 -- 172.21.15.146:0/2126044392 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c58091b90 con 0x7f7c58069d90 2023-10-03T10:09:49.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.862+0000 7f7c577fe700 1 -- 172.21.15.146:0/2126044392 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046151591 0 0) 0x7f7c580933e0 con 0x7f7c58067e90 2023-10-03T10:09:49.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.862+0000 7f7c5c88a700 1 --2- 172.21.15.146:0/2126044392 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c5805f560 0x7f7c58096840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:49.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.863+0000 7f7c57fff700 1 --2- 172.21.15.146:0/2126044392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c58069d90 0x7f7c58096d30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f7c44006fd0 tx=0x7f7c440090f0).ready entity=mon.0 client_cookie=16bcf120c201ef84 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:49.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.863+0000 7f7c577fe700 1 -- 172.21.15.146:0/2126044392 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4400b580 con 0x7f7c58069d90 2023-10-03T10:09:49.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.863+0000 7f7c577fe700 1 -- 172.21.15.146:0/2126044392 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4400b6e0 con 0x7f7c58069d90 2023-10-03T10:09:49.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.863+0000 7f7c577fe700 1 -- 172.21.15.146:0/2126044392 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4400ba60 con 0x7f7c58069d90 2023-10-03T10:09:49.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.863+0000 7f7c5eaee700 1 -- 172.21.15.146:0/2126044392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c58069d90 msgr2=0x7f7c58096d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.863+0000 7f7c5eaee700 1 --2- 172.21.15.146:0/2126044392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c58069d90 0x7f7c58096d30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f7c44006fd0 tx=0x7f7c440090f0).stop 2023-10-03T10:09:49.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.863+0000 7f7c5eaee700 1 -- 172.21.15.146:0/2126044392 shutdown_connections 2023-10-03T10:09:49.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.863+0000 7f7c5eaee700 1 --2- 172.21.15.146:0/2126044392 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c5805f560 0x7f7c58096840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.863+0000 7f7c5eaee700 1 --2- 172.21.15.146:0/2126044392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c58069d90 0x7f7c58096d30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.863+0000 7f7c5eaee700 1 -- 172.21.15.146:0/2126044392 >> 172.21.15.146:0/2126044392 conn(0x7f7c5809a1c0 msgr2=0x7f7c5809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:49.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.863+0000 7f7c5eaee700 1 -- 172.21.15.146:0/2126044392 shutdown_connections 2023-10-03T10:09:49.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.863+0000 7f7c5eaee700 1 -- 172.21.15.146:0/2126044392 wait complete. 2023-10-03T10:09:49.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.864+0000 7f7c5eaee700 1 Processor -- start 2023-10-03T10:09:49.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.864+0000 7f7c5eaee700 1 -- start start 2023-10-03T10:09:49.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c5eaee700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c5805f560 0x7f7c58127700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c5eaee700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c58067e90 0x7f7c58127bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c5eaee700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c581280e0 0x7f7c58137f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c5eaee700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c58128540 con 0x7f7c581280e0 2023-10-03T10:09:49.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c5eaee700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c58091dc0 con 0x7f7c58067e90 2023-10-03T10:09:49.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c5eaee700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5812a570 con 0x7f7c5805f560 2023-10-03T10:09:49.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c5c88a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c5805f560 0x7f7c58127700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c5d08b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c581280e0 0x7f7c58137f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c5c88a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c5805f560 0x7f7c58127700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:47764/0 (socket says 172.21.15.146:47764) 2023-10-03T10:09:49.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c5c88a700 1 -- 172.21.15.146:0/3283215322 learned_addr learned my addr 172.21.15.146:0/3283215322 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:49.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c57fff700 1 --2- 172.21.15.146:0/3283215322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c58067e90 0x7f7c58127bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c5d08b700 1 -- 172.21.15.146:0/3283215322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c5805f560 msgr2=0x7f7c58127700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c5d08b700 1 --2- 172.21.15.146:0/3283215322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c5805f560 0x7f7c58127700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c5d08b700 1 -- 172.21.15.146:0/3283215322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c58067e90 msgr2=0x7f7c58127bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c5d08b700 1 --2- 172.21.15.146:0/3283215322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c58067e90 0x7f7c58127bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c5d08b700 1 -- 172.21.15.146:0/3283215322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c0092a0 con 0x7f7c581280e0 2023-10-03T10:09:49.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c5c88a700 1 --2- 172.21.15.146:0/3283215322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c5805f560 0x7f7c58127700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:49.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c5d08b700 1 --2- 172.21.15.146:0/3283215322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c581280e0 0x7f7c58137f40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f7c50002230 tx=0x7f7c50007eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:49.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c54ff9700 1 -- 172.21.15.146:0/3283215322 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c50005c70 con 0x7f7c581280e0 2023-10-03T10:09:49.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c54ff9700 1 -- 172.21.15.146:0/3283215322 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c50005df0 con 0x7f7c581280e0 2023-10-03T10:09:49.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c5eaee700 1 -- 172.21.15.146:0/3283215322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c44009370 con 0x7f7c581280e0 2023-10-03T10:09:49.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c54ff9700 1 -- 172.21.15.146:0/3283215322 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c50007360 con 0x7f7c581280e0 2023-10-03T10:09:49.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.865+0000 7f7c5eaee700 1 -- 172.21.15.146:0/3283215322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5812b1f0 con 0x7f7c581280e0 2023-10-03T10:09:49.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.866+0000 7f7c54ff9700 1 -- 172.21.15.146:0/3283215322 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7c50007710 con 0x7f7c581280e0 2023-10-03T10:09:49.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.866+0000 7f7c54ff9700 1 -- 172.21.15.146:0/3283215322 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f7c5003aef0 con 0x7f7c581280e0 2023-10-03T10:09:49.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.867+0000 7f7c5eaee700 1 -- 172.21.15.146:0/3283215322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c58098860 con 0x7f7c581280e0 2023-10-03T10:09:49.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:49.871+0000 7f7c54ff9700 1 -- 172.21.15.146:0/3283215322 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7c58098860 con 0x7f7c581280e0 2023-10-03T10:09:50.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.067+0000 7f7c5eaee700 1 -- 172.21.15.146:0/3283215322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7c58098860 con 0x7f7c581280e0 2023-10-03T10:09:50.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.730+0000 7f7c54ff9700 1 -- 172.21.15.146:0/3283215322 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v5) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7c58098860 con 0x7f7c581280e0 2023-10-03T10:09:50.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.732+0000 7f7c5eaee700 1 -- 172.21.15.146:0/3283215322 >> v1:172.21.15.146:6816/118159 conn(0x7f7c3c02bb60 legacy=0x7f7c3c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:50.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.732+0000 7f7c5eaee700 1 -- 172.21.15.146:0/3283215322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c581280e0 msgr2=0x7f7c58137f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:50.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.732+0000 7f7c5eaee700 1 --2- 172.21.15.146:0/3283215322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c581280e0 0x7f7c58137f40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f7c50002230 tx=0x7f7c50007eb0).stop 2023-10-03T10:09:50.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.732+0000 7f7c5eaee700 1 -- 172.21.15.146:0/3283215322 shutdown_connections 2023-10-03T10:09:50.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.732+0000 7f7c5eaee700 1 --2- 172.21.15.146:0/3283215322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c581280e0 0x7f7c58137f40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.732+0000 7f7c5eaee700 1 --2- 172.21.15.146:0/3283215322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c5805f560 0x7f7c58127700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.732+0000 7f7c5eaee700 1 --2- 172.21.15.146:0/3283215322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c58067e90 0x7f7c58127bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.732+0000 7f7c5eaee700 1 -- 172.21.15.146:0/3283215322 >> 172.21.15.146:0/3283215322 conn(0x7f7c5809a1c0 msgr2=0x7f7c58065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:50.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.732+0000 7f7c5eaee700 1 -- 172.21.15.146:0/3283215322 shutdown_connections 2023-10-03T10:09:50.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.732+0000 7f7c5eaee700 1 -- 172.21.15.146:0/3283215322 wait complete. 2023-10-03T10:09:50.745 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-03T10:09:50.745 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:09:50.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.864+0000 7f36aa322700 1 Processor -- start 2023-10-03T10:09:50.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.864+0000 7f36aa322700 1 -- start start 2023-10-03T10:09:50.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.864+0000 7f36aa322700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f36a4095e70 0x7f36a4096250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:50.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.865+0000 7f36aa322700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a412d250 0x7f36a412f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:50.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.865+0000 7f36aa322700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a4094ba0 con 0x7f36a4093950 2023-10-03T10:09:50.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.865+0000 7f36aa322700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a4092e90 con 0x7f36a4095e70 2023-10-03T10:09:50.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.865+0000 7f36aa322700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a4096b60 con 0x7f36a412d250 2023-10-03T10:09:50.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.865+0000 7f36a37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f36a4095e70 0x7f36a4096250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:50.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.865+0000 7f36a88bf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a412d250 0x7f36a412f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:50.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.865+0000 7f36a37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f36a4095e70 0x7f36a4096250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38136/0 (socket says 172.21.15.146:38136) 2023-10-03T10:09:50.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.865+0000 7f36a3fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f36a4093950 0x7f36a4095760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48336/0 (socket says 172.21.15.146:48336) 2023-10-03T10:09:50.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.865+0000 7f36a37fe700 1 -- 172.21.15.146:0/1519310490 learned_addr learned my addr 172.21.15.146:0/1519310490 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:50.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.865+0000 7f36a88bf700 1 -- 172.21.15.146:0/1519310490 >> v2:172.21.15.146:3300/0 conn(0x7f36a4095e70 msgr2=0x7f36a4096250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:50.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.865+0000 7f36a88bf700 1 --2- 172.21.15.146:0/1519310490 >> v2:172.21.15.146:3300/0 conn(0x7f36a4095e70 0x7f36a4096250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.865+0000 7f36a88bf700 1 -- 172.21.15.146:0/1519310490 >> v1:172.21.15.146:6789/0 conn(0x7f36a4093950 legacy=0x7f36a4095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:50.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.865+0000 7f36a88bf700 1 -- 172.21.15.146:0/1519310490 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a4093150 con 0x7f36a412d250 2023-10-03T10:09:50.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.865+0000 7f36a2ffd700 1 -- 172.21.15.146:0/1519310490 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925052171 0 0) 0x7f36a4094ba0 con 0x7f36a4093950 2023-10-03T10:09:50.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.865+0000 7f36a37fe700 1 --2- 172.21.15.146:0/1519310490 >> v2:172.21.15.146:3300/0 conn(0x7f36a4095e70 0x7f36a4096250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:50.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.865+0000 7f36a88bf700 1 --2- 172.21.15.146:0/1519310490 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a412d250 0x7f36a412f640 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f369c009e60 tx=0x7f369c009780).ready entity=mon.1 client_cookie=5d75e1d5d6a53053 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:50.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.865+0000 7f36a2ffd700 1 -- 172.21.15.146:0/1519310490 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c00e070 con 0x7f36a412d250 2023-10-03T10:09:50.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.865+0000 7f36a2ffd700 1 -- 172.21.15.146:0/1519310490 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c00bb60 con 0x7f36a412d250 2023-10-03T10:09:50.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.865+0000 7f36a2ffd700 1 -- 172.21.15.146:0/1519310490 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c012410 con 0x7f36a412d250 2023-10-03T10:09:50.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.866+0000 7f36aa322700 1 -- 172.21.15.146:0/1519310490 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a412d250 msgr2=0x7f36a412f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:50.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.866+0000 7f36aa322700 1 --2- 172.21.15.146:0/1519310490 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a412d250 0x7f36a412f640 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f369c009e60 tx=0x7f369c009780).stop 2023-10-03T10:09:50.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.866+0000 7f36aa322700 1 -- 172.21.15.146:0/1519310490 shutdown_connections 2023-10-03T10:09:50.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.866+0000 7f36aa322700 1 --2- 172.21.15.146:0/1519310490 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a412d250 0x7f36a412f640 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.866+0000 7f36aa322700 1 --2- 172.21.15.146:0/1519310490 >> v2:172.21.15.146:3300/0 conn(0x7f36a4095e70 0x7f36a4096250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.866+0000 7f36aa322700 1 -- 172.21.15.146:0/1519310490 >> 172.21.15.146:0/1519310490 conn(0x7f36a409aa50 msgr2=0x7f36a409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:50.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.866+0000 7f36aa322700 1 -- 172.21.15.146:0/1519310490 shutdown_connections 2023-10-03T10:09:50.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.866+0000 7f36aa322700 1 -- 172.21.15.146:0/1519310490 wait complete. 2023-10-03T10:09:50.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.867+0000 7f36aa322700 1 Processor -- start 2023-10-03T10:09:50.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.867+0000 7f36aa322700 1 -- start start 2023-10-03T10:09:50.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.868+0000 7f36aa322700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36a4093950 0x7f36a4116990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:50.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.868+0000 7f36aa322700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a4095e70 0x7f36a4116e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:50.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.868+0000 7f36aa322700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a412d250 0x7f36a4117370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:50.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.868+0000 7f36aa322700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a412cb40 con 0x7f36a412d250 2023-10-03T10:09:50.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.868+0000 7f36aa322700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a4119050 con 0x7f36a4095e70 2023-10-03T10:09:50.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.868+0000 7f36aa322700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36a4092410 con 0x7f36a4093950 2023-10-03T10:09:50.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.868+0000 7f36a37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a4095e70 0x7f36a4116e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:50.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.868+0000 7f36a3fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36a4093950 0x7f36a4116990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:50.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.868+0000 7f36a37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a4095e70 0x7f36a4116e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33402/0 (socket says 172.21.15.146:33402) 2023-10-03T10:09:50.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.868+0000 7f36a37fe700 1 -- 172.21.15.146:0/1620685698 learned_addr learned my addr 172.21.15.146:0/1620685698 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:50.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.868+0000 7f36a88bf700 1 --2- 172.21.15.146:0/1620685698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a412d250 0x7f36a4117370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:50.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.868+0000 7f36a37fe700 1 -- 172.21.15.146:0/1620685698 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36a4093950 msgr2=0x7f36a4116990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:50.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.868+0000 7f36a37fe700 1 --2- 172.21.15.146:0/1620685698 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36a4093950 0x7f36a4116990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.868+0000 7f36a37fe700 1 -- 172.21.15.146:0/1620685698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a412d250 msgr2=0x7f36a4117370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:50.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.868+0000 7f36a37fe700 1 --2- 172.21.15.146:0/1620685698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a412d250 0x7f36a4117370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.868+0000 7f36a37fe700 1 -- 172.21.15.146:0/1620685698 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3694009370 con 0x7f36a4095e70 2023-10-03T10:09:50.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.868+0000 7f36a37fe700 1 --2- 172.21.15.146:0/1620685698 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a4095e70 0x7f36a4116e80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f369400ea20 tx=0x7f36940090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:50.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.868+0000 7f368bfff700 1 -- 172.21.15.146:0/1620685698 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369400ee60 con 0x7f36a4095e70 2023-10-03T10:09:50.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.868+0000 7f368bfff700 1 -- 172.21.15.146:0/1620685698 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369400c7f0 con 0x7f36a4095e70 2023-10-03T10:09:50.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.868+0000 7f368bfff700 1 -- 172.21.15.146:0/1620685698 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369400cb70 con 0x7f36a4095e70 2023-10-03T10:09:50.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.868+0000 7f36aa322700 1 -- 172.21.15.146:0/1620685698 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369c009a20 con 0x7f36a4095e70 2023-10-03T10:09:50.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.869+0000 7f36aa322700 1 -- 172.21.15.146:0/1620685698 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a411aba0 con 0x7f36a4095e70 2023-10-03T10:09:50.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.869+0000 7f368bfff700 1 -- 172.21.15.146:0/1620685698 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f369401b400 con 0x7f36a4095e70 2023-10-03T10:09:50.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.869+0000 7f368bfff700 1 -- 172.21.15.146:0/1620685698 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f369403b500 con 0x7f36a4095e70 2023-10-03T10:09:50.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.870+0000 7f36aa322700 1 -- 172.21.15.146:0/1620685698 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a405a260 con 0x7f36a4095e70 2023-10-03T10:09:50.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:50.874+0000 7f368bfff700 1 -- 172.21.15.146:0/1620685698 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3694019900 con 0x7f36a4095e70 2023-10-03T10:09:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.071+0000 7f36aa322700 1 -- 172.21.15.146:0/1620685698 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36a4046c20 con 0x7f36a4095e70 2023-10-03T10:09:51.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.071+0000 7f368bfff700 1 -- 172.21.15.146:0/1620685698 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2158 (secure 0 0 0) 0x7f3694019310 con 0x7f36a4095e70 2023-10-03T10:09:51.071 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:51.071 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:48.718228+0000","modified":"2023-10-03T10:09:50.726096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4181":{"gid":4181,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6817/4164614194","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6817","nonce":4164614194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:09:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.073+0000 7f36aa322700 1 -- 172.21.15.146:0/1620685698 >> v1:172.21.15.146:6816/118159 conn(0x7f369002bb60 legacy=0x7f369002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.073+0000 7f36aa322700 1 -- 172.21.15.146:0/1620685698 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a4095e70 msgr2=0x7f36a4116e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.073+0000 7f36aa322700 1 --2- 172.21.15.146:0/1620685698 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a4095e70 0x7f36a4116e80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f369400ea20 tx=0x7f36940090f0).stop 2023-10-03T10:09:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.073+0000 7f36aa322700 1 -- 172.21.15.146:0/1620685698 shutdown_connections 2023-10-03T10:09:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.073+0000 7f36aa322700 1 --2- 172.21.15.146:0/1620685698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a412d250 0x7f36a4117370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.073+0000 7f36aa322700 1 --2- 172.21.15.146:0/1620685698 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36a4093950 0x7f36a4116990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.073+0000 7f36aa322700 1 --2- 172.21.15.146:0/1620685698 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a4095e70 0x7f36a4116e80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.073+0000 7f36aa322700 1 -- 172.21.15.146:0/1620685698 >> 172.21.15.146:0/1620685698 conn(0x7f36a409aa50 msgr2=0x7f36a4069090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.073+0000 7f36aa322700 1 -- 172.21.15.146:0/1620685698 shutdown_connections 2023-10-03T10:09:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.073+0000 7f36aa322700 1 -- 172.21.15.146:0/1620685698 wait complete. 2023-10-03T10:09:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 5 2023-10-03T10:09:51.084 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:51.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.200+0000 7fbc888b5700 1 Processor -- start 2023-10-03T10:09:51.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.200+0000 7fbc888b5700 1 -- start start 2023-10-03T10:09:51.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.200+0000 7fbc888b5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc84129350 0x7fbc8412dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.200+0000 7fbc888b5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbc8412e230 0x7fbc84130620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.200+0000 7fbc888b5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc84128a10 con 0x7fbc8405f560 2023-10-03T10:09:51.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.200+0000 7fbc888b5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc8405f940 con 0x7fbc8412e230 2023-10-03T10:09:51.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.200+0000 7fbc888b5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc84093a80 con 0x7fbc84129350 2023-10-03T10:09:51.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.201+0000 7fbc82d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbc8412e230 0x7fbc84130620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.201+0000 7fbc81d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc84129350 0x7fbc8412dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.201+0000 7fbc8259c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbc8405f560 0x7fbc84128c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48344/0 (socket says 172.21.15.146:48344) 2023-10-03T10:09:51.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.201+0000 7fbc82d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbc8412e230 0x7fbc84130620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38166/0 (socket says 172.21.15.146:38166) 2023-10-03T10:09:51.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.201+0000 7fbc8259c700 1 -- 172.21.15.146:0/1859732836 learned_addr learned my addr 172.21.15.146:0/1859732836 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:09:51.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.201+0000 7fbc81d9b700 1 -- 172.21.15.146:0/1859732836 >> v2:172.21.15.146:3300/0 conn(0x7fbc8412e230 msgr2=0x7fbc84130620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:51.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.201+0000 7fbc81d9b700 1 --2- 172.21.15.146:0/1859732836 >> v2:172.21.15.146:3300/0 conn(0x7fbc8412e230 0x7fbc84130620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.201+0000 7fbc81d9b700 1 -- 172.21.15.146:0/1859732836 >> v1:172.21.15.146:6789/0 conn(0x7fbc8405f560 legacy=0x7fbc84128c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.201+0000 7fbc81d9b700 1 -- 172.21.15.146:0/1859732836 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc840930e0 con 0x7fbc84129350 2023-10-03T10:09:51.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.201+0000 7fbc8159a700 1 -- 172.21.15.146:0/1859732836 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185999048 0 0) 0x7fbc84128a10 con 0x7fbc8405f560 2023-10-03T10:09:51.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.201+0000 7fbc82d9d700 1 --2- 172.21.15.146:0/1859732836 >> v2:172.21.15.146:3300/0 conn(0x7fbc8412e230 0x7fbc84130620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:51.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.201+0000 7fbc81d9b700 1 --2- 172.21.15.146:0/1859732836 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc84129350 0x7fbc8412dd40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fbc78009760 tx=0x7fbc78009060).ready entity=mon.2 client_cookie=26b1417ae3bf47e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:51.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.201+0000 7fbc8159a700 1 -- 172.21.15.146:0/1859732836 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc780090d0 con 0x7fbc84129350 2023-10-03T10:09:51.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.201+0000 7fbc8159a700 1 -- 172.21.15.146:0/1859732836 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7800f510 con 0x7fbc84129350 2023-10-03T10:09:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.201+0000 7fbc8159a700 1 -- 172.21.15.146:0/1859732836 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7800f890 con 0x7fbc84129350 2023-10-03T10:09:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.202+0000 7fbc888b5700 1 -- 172.21.15.146:0/1859732836 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc84129350 msgr2=0x7fbc8412dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.202+0000 7fbc888b5700 1 --2- 172.21.15.146:0/1859732836 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc84129350 0x7fbc8412dd40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fbc78009760 tx=0x7fbc78009060).stop 2023-10-03T10:09:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.202+0000 7fbc888b5700 1 -- 172.21.15.146:0/1859732836 shutdown_connections 2023-10-03T10:09:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.202+0000 7fbc888b5700 1 --2- 172.21.15.146:0/1859732836 >> v2:172.21.15.146:3300/0 conn(0x7fbc8412e230 0x7fbc84130620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.202+0000 7fbc888b5700 1 --2- 172.21.15.146:0/1859732836 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc84129350 0x7fbc8412dd40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.202+0000 7fbc888b5700 1 -- 172.21.15.146:0/1859732836 >> 172.21.15.146:0/1859732836 conn(0x7fbc8409a1c0 msgr2=0x7fbc8409a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.202+0000 7fbc888b5700 1 -- 172.21.15.146:0/1859732836 shutdown_connections 2023-10-03T10:09:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.202+0000 7fbc888b5700 1 -- 172.21.15.146:0/1859732836 wait complete. 2023-10-03T10:09:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.202+0000 7fbc888b5700 1 Processor -- start 2023-10-03T10:09:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.203+0000 7fbc888b5700 1 -- start start 2023-10-03T10:09:51.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.203+0000 7fbc888b5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8405f560 0x7fbc84115510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.203+0000 7fbc888b5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc84129350 0x7fbc84112670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.203+0000 7fbc888b5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc8412e230 0x7fbc84112b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.203+0000 7fbc888b5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc84097e30 con 0x7fbc8405f560 2023-10-03T10:09:51.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.203+0000 7fbc888b5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc84115ad0 con 0x7fbc8412e230 2023-10-03T10:09:51.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.203+0000 7fbc888b5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc84116570 con 0x7fbc84129350 2023-10-03T10:09:51.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.203+0000 7fbc8259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8405f560 0x7fbc84115510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.203+0000 7fbc81d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc84129350 0x7fbc84112670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.203+0000 7fbc8259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8405f560 0x7fbc84115510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38180/0 (socket says 172.21.15.146:38180) 2023-10-03T10:09:51.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.203+0000 7fbc81d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc84129350 0x7fbc84112670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:47778/0 (socket says 172.21.15.146:47778) 2023-10-03T10:09:51.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.203+0000 7fbc8259c700 1 -- 172.21.15.146:0/3024479595 learned_addr learned my addr 172.21.15.146:0/3024479595 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:51.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.203+0000 7fbc82d9d700 1 --2- 172.21.15.146:0/3024479595 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc8412e230 0x7fbc84112b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.203+0000 7fbc81d9b700 1 -- 172.21.15.146:0/3024479595 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc8412e230 msgr2=0x7fbc84112b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.203+0000 7fbc81d9b700 1 --2- 172.21.15.146:0/3024479595 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc8412e230 0x7fbc84112b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.203+0000 7fbc81d9b700 1 -- 172.21.15.146:0/3024479595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8405f560 msgr2=0x7fbc84115510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.203+0000 7fbc81d9b700 1 --2- 172.21.15.146:0/3024479595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8405f560 0x7fbc84115510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.203+0000 7fbc81d9b700 1 -- 172.21.15.146:0/3024479595 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c009a20 con 0x7fbc84129350 2023-10-03T10:09:51.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.203+0000 7fbc82d9d700 1 --2- 172.21.15.146:0/3024479595 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc8412e230 0x7fbc84112b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.203+0000 7fbc8259c700 1 --2- 172.21.15.146:0/3024479595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8405f560 0x7fbc84115510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.203+0000 7fbc81d9b700 1 --2- 172.21.15.146:0/3024479595 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc84129350 0x7fbc84112670 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fbc78014000 tx=0x7fbc78017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.204+0000 7fbc727fc700 1 -- 172.21.15.146:0/3024479595 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7800f890 con 0x7fbc84129350 2023-10-03T10:09:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.204+0000 7fbc727fc700 1 -- 172.21.15.146:0/3024479595 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc78006970 con 0x7fbc84129350 2023-10-03T10:09:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.204+0000 7fbc888b5700 1 -- 172.21.15.146:0/3024479595 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc780092a0 con 0x7fbc84129350 2023-10-03T10:09:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.204+0000 7fbc727fc700 1 -- 172.21.15.146:0/3024479595 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7800fea0 con 0x7fbc84129350 2023-10-03T10:09:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.204+0000 7fbc888b5700 1 -- 172.21.15.146:0/3024479595 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc84115d90 con 0x7fbc84129350 2023-10-03T10:09:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.204+0000 7fbc727fc700 1 -- 172.21.15.146:0/3024479595 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fbc7801b620 con 0x7fbc84129350 2023-10-03T10:09:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.205+0000 7fbc727fc700 1 -- 172.21.15.146:0/3024479595 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fbc7803c850 con 0x7fbc84129350 2023-10-03T10:09:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.205+0000 7fbc888b5700 1 -- 172.21.15.146:0/3024479595 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc8405a260 con 0x7fbc84129350 2023-10-03T10:09:51.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.209+0000 7fbc727fc700 1 -- 172.21.15.146:0/3024479595 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fbc78023400 con 0x7fbc84129350 2023-10-03T10:09:51.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.368+0000 7fbc888b5700 1 -- 172.21.15.146:0/3024479595 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc840921e0 con 0x7fbc84129350 2023-10-03T10:09:51.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.369+0000 7fbc727fc700 1 -- 172.21.15.146:0/3024479595 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11373 (secure 0 0 0) 0x7fbc78019b70 con 0x7fbc84129350 2023-10-03T10:09:51.368 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:51.369 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":16,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:09:49.722394+0000","last_up_change":"2023-10-03T10:09:42.301022+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":118758}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":118758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":118758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":118758}]},"public_addr":"172.21.15.146:6800/118758","cluster_addr":"172.21.15.146:6801/118758","heartbeat_back_addr":"172.21.15.146:6803/118758","heartbeat_front_addr":"172.21.15.146:6802/118758","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":118774}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":118774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":118774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":118774}]},"public_addr":"172.21.15.146:6804/118774","cluster_addr":"172.21.15.146:6806/118774","heartbeat_back_addr":"172.21.15.146:6810/118774","heartbeat_front_addr":"172.21.15.146:6808/118774","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":118775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":118775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":118775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":118775}]},"public_addr":"172.21.15.146:6805/118775","cluster_addr":"172.21.15.146:6807/118775","heartbeat_back_addr":"172.21.15.146:6811/118775","heartbeat_front_addr":"172.21.15.146:6809/118775","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":118776}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":118776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":118776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":118776}]},"public_addr":"172.21.15.146:6812/118776","cluster_addr":"172.21.15.146:6813/118776","heartbeat_back_addr":"172.21.15.146:6815/118776","heartbeat_front_addr":"172.21.15.146:6814/118776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:51.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.370+0000 7fbc888b5700 1 -- 172.21.15.146:0/3024479595 >> v1:172.21.15.146:6816/118159 conn(0x7fbc6402bb60 legacy=0x7fbc6402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.370+0000 7fbc888b5700 1 -- 172.21.15.146:0/3024479595 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc84129350 msgr2=0x7fbc84112670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.370+0000 7fbc888b5700 1 --2- 172.21.15.146:0/3024479595 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc84129350 0x7fbc84112670 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fbc78014000 tx=0x7fbc78017000).stop 2023-10-03T10:09:51.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.370+0000 7fbc888b5700 1 -- 172.21.15.146:0/3024479595 shutdown_connections 2023-10-03T10:09:51.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.370+0000 7fbc888b5700 1 --2- 172.21.15.146:0/3024479595 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc8412e230 0x7fbc84112b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.370+0000 7fbc888b5700 1 --2- 172.21.15.146:0/3024479595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8405f560 0x7fbc84115510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.370+0000 7fbc888b5700 1 --2- 172.21.15.146:0/3024479595 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc84129350 0x7fbc84112670 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.370+0000 7fbc888b5700 1 -- 172.21.15.146:0/3024479595 >> 172.21.15.146:0/3024479595 conn(0x7fbc8409a1c0 msgr2=0x7fbc84098040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:51.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.371+0000 7fbc888b5700 1 -- 172.21.15.146:0/3024479595 shutdown_connections 2023-10-03T10:09:51.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.371+0000 7fbc888b5700 1 -- 172.21.15.146:0/3024479595 wait complete. 2023-10-03T10:09:51.382 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-03T10:09:51.382 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:09:51.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.498+0000 7f4b0765d700 1 Processor -- start 2023-10-03T10:09:51.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.498+0000 7f4b0765d700 1 -- start start 2023-10-03T10:09:51.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.498+0000 7f4b0765d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b000985e0 0x7f4b000989c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.498+0000 7f4b0765d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4b00098eb0 0x7f4b0012f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.498+0000 7f4b0765d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0012f980 0x7f4b00131d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.498+0000 7f4b0765d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0009a3f0 con 0x7f4b00098eb0 2023-10-03T10:09:51.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.498+0000 7f4b0765d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b000964f0 con 0x7f4b0012f980 2023-10-03T10:09:51.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.498+0000 7f4b0765d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b00095100 con 0x7f4b000985e0 2023-10-03T10:09:51.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.498+0000 7f4b05bfa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0012f980 0x7f4b00131d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.498+0000 7f4b04bf8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4b00098eb0 0x7f4b0012f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.498+0000 7f4b05bfa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0012f980 0x7f4b00131d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33428/0 (socket says 172.21.15.146:33428) 2023-10-03T10:09:51.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.498+0000 7f4b04bf8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4b00098eb0 0x7f4b0012f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38184/0 (socket says 172.21.15.146:38184) 2023-10-03T10:09:51.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.498+0000 7f4b05bfa700 1 -- 172.21.15.146:0/1748550894 learned_addr learned my addr 172.21.15.146:0/1748550894 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:51.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.498+0000 7f4b053f9700 1 --2- 172.21.15.146:0/1748550894 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b000985e0 0x7f4b000989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.499+0000 7f4b05bfa700 1 -- 172.21.15.146:0/1748550894 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b000985e0 msgr2=0x7f4b000989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:51.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.499+0000 7f4b05bfa700 1 --2- 172.21.15.146:0/1748550894 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b000985e0 0x7f4b000989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.499+0000 7f4b05bfa700 1 -- 172.21.15.146:0/1748550894 >> v2:172.21.15.146:3300/0 conn(0x7f4b00098eb0 msgr2=0x7f4b0012f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:51.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.499+0000 7f4b05bfa700 1 --2- 172.21.15.146:0/1748550894 >> v2:172.21.15.146:3300/0 conn(0x7f4b00098eb0 0x7f4b0012f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.499+0000 7f4b05bfa700 1 -- 172.21.15.146:0/1748550894 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b00099e70 con 0x7f4b0012f980 2023-10-03T10:09:51.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.499+0000 7f4b04bf8700 1 --2- 172.21.15.146:0/1748550894 >> v2:172.21.15.146:3300/0 conn(0x7f4b00098eb0 0x7f4b0012f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:51.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.499+0000 7f4b053f9700 1 --2- 172.21.15.146:0/1748550894 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b000985e0 0x7f4b000989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:51.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.499+0000 7f4b05bfa700 1 --2- 172.21.15.146:0/1748550894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0012f980 0x7f4b00131d70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f4af8009f20 tx=0x7f4af8009840).ready entity=mon.1 client_cookie=d448e7a92ba1dc17 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:51.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.499+0000 7f4af7fff700 1 -- 172.21.15.146:0/1748550894 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af800e070 con 0x7f4b0012f980 2023-10-03T10:09:51.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.499+0000 7f4af7fff700 1 -- 172.21.15.146:0/1748550894 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af800b970 con 0x7f4b0012f980 2023-10-03T10:09:51.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.499+0000 7f4af7fff700 1 -- 172.21.15.146:0/1748550894 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af800bcf0 con 0x7f4b0012f980 2023-10-03T10:09:51.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.499+0000 7f4b0765d700 1 -- 172.21.15.146:0/1748550894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0012f980 msgr2=0x7f4b00131d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.499+0000 7f4b0765d700 1 --2- 172.21.15.146:0/1748550894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0012f980 0x7f4b00131d70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f4af8009f20 tx=0x7f4af8009840).stop 2023-10-03T10:09:51.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.500+0000 7f4b0765d700 1 -- 172.21.15.146:0/1748550894 shutdown_connections 2023-10-03T10:09:51.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.500+0000 7f4b0765d700 1 --2- 172.21.15.146:0/1748550894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0012f980 0x7f4b00131d70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.500+0000 7f4b0765d700 1 --2- 172.21.15.146:0/1748550894 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b000985e0 0x7f4b000989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.500+0000 7f4b0765d700 1 --2- 172.21.15.146:0/1748550894 >> v2:172.21.15.146:3300/0 conn(0x7f4b00098eb0 0x7f4b0012f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.500+0000 7f4b0765d700 1 -- 172.21.15.146:0/1748550894 >> 172.21.15.146:0/1748550894 conn(0x7f4b0009dc40 msgr2=0x7f4b0009e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:51.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.500+0000 7f4b0765d700 1 -- 172.21.15.146:0/1748550894 shutdown_connections 2023-10-03T10:09:51.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.500+0000 7f4b0765d700 1 -- 172.21.15.146:0/1748550894 wait complete. 2023-10-03T10:09:51.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.500+0000 7f4b0765d700 1 Processor -- start 2023-10-03T10:09:51.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.500+0000 7f4b0765d700 1 -- start start 2023-10-03T10:09:51.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.501+0000 7f4b0765d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b000985e0 0x7f4b0011e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.501+0000 7f4b0765d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b00098eb0 0x7f4b0011a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.501+0000 7f4b0765d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b0012f980 0x7f4b0011a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.501+0000 7f4b0765d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0012f560 con 0x7f4b0012f980 2023-10-03T10:09:51.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.501+0000 7f4b0765d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0011b880 con 0x7f4b00098eb0 2023-10-03T10:09:51.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.501+0000 7f4b0765d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0011def0 con 0x7f4b000985e0 2023-10-03T10:09:51.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.501+0000 7f4b05bfa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b0012f980 0x7f4b0011a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.501+0000 7f4b04bf8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b00098eb0 0x7f4b0011a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.501+0000 7f4b05bfa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b0012f980 0x7f4b0011a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38186/0 (socket says 172.21.15.146:38186) 2023-10-03T10:09:51.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.501+0000 7f4b05bfa700 1 -- 172.21.15.146:0/218294854 learned_addr learned my addr 172.21.15.146:0/218294854 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:51.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.501+0000 7f4b04bf8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b00098eb0 0x7f4b0011a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33442/0 (socket says 172.21.15.146:33442) 2023-10-03T10:09:51.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.501+0000 7f4b053f9700 1 --2- 172.21.15.146:0/218294854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b000985e0 0x7f4b0011e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.501+0000 7f4b04bf8700 1 -- 172.21.15.146:0/218294854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b000985e0 msgr2=0x7f4b0011e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.501+0000 7f4b04bf8700 1 --2- 172.21.15.146:0/218294854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b000985e0 0x7f4b0011e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.501+0000 7f4b04bf8700 1 -- 172.21.15.146:0/218294854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b0012f980 msgr2=0x7f4b0011a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.501+0000 7f4b04bf8700 1 --2- 172.21.15.146:0/218294854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b0012f980 0x7f4b0011a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.501+0000 7f4b04bf8700 1 -- 172.21.15.146:0/218294854 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4afc0092a0 con 0x7f4b00098eb0 2023-10-03T10:09:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.501+0000 7f4b05bfa700 1 --2- 172.21.15.146:0/218294854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b0012f980 0x7f4b0011a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.502+0000 7f4b04bf8700 1 --2- 172.21.15.146:0/218294854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b00098eb0 0x7f4b0011a480 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f4af000e980 tx=0x7f4af0009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.502+0000 7f4af57fa700 1 -- 172.21.15.146:0/218294854 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af0012600 con 0x7f4b00098eb0 2023-10-03T10:09:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.502+0000 7f4af57fa700 1 -- 172.21.15.146:0/218294854 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af0012760 con 0x7f4b00098eb0 2023-10-03T10:09:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.502+0000 7f4b0765d700 1 -- 172.21.15.146:0/218294854 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af00092a0 con 0x7f4b00098eb0 2023-10-03T10:09:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.502+0000 7f4af57fa700 1 -- 172.21.15.146:0/218294854 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af0012b00 con 0x7f4b00098eb0 2023-10-03T10:09:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.502+0000 7f4b0765d700 1 -- 172.21.15.146:0/218294854 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af8009ae0 con 0x7f4b00098eb0 2023-10-03T10:09:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.502+0000 7f4af57fa700 1 -- 172.21.15.146:0/218294854 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4af001b400 con 0x7f4b00098eb0 2023-10-03T10:09:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.503+0000 7f4af57fa700 1 -- 172.21.15.146:0/218294854 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4af003b410 con 0x7f4b00098eb0 2023-10-03T10:09:51.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.503+0000 7f4b0765d700 1 -- 172.21.15.146:0/218294854 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0005a260 con 0x7f4b00098eb0 2023-10-03T10:09:51.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.507+0000 7f4af57fa700 1 -- 172.21.15.146:0/218294854 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4af0019900 con 0x7f4b00098eb0 2023-10-03T10:09:51.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.660+0000 7f4b0765d700 1 -- 172.21.15.146:0/218294854 --> v1:172.21.15.146:6816/118159 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b000661a0 con 0x7f4ae402bb60 2023-10-03T10:09:51.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.667+0000 7f4af57fa700 1 -- 172.21.15.146:0/218294854 <== mgr.4103 v1:172.21.15.146:6816/118159 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243849 (unknown 2965378022 0 2545926101) 0x7f4b000661a0 con 0x7f4ae402bb60 2023-10-03T10:09:51.670 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:51.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.670+0000 7f4b0765d700 1 -- 172.21.15.146:0/218294854 >> v1:172.21.15.146:6816/118159 conn(0x7f4ae402bb60 legacy=0x7f4ae402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.670+0000 7f4b0765d700 1 -- 172.21.15.146:0/218294854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b00098eb0 msgr2=0x7f4b0011a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.670+0000 7f4b0765d700 1 --2- 172.21.15.146:0/218294854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b00098eb0 0x7f4b0011a480 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f4af000e980 tx=0x7f4af0009060).stop 2023-10-03T10:09:51.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.670+0000 7f4b0765d700 1 -- 172.21.15.146:0/218294854 shutdown_connections 2023-10-03T10:09:51.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.670+0000 7f4b0765d700 1 --2- 172.21.15.146:0/218294854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b0012f980 0x7f4b0011a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.670+0000 7f4b0765d700 1 --2- 172.21.15.146:0/218294854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b000985e0 0x7f4b0011e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.670+0000 7f4b0765d700 1 --2- 172.21.15.146:0/218294854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b00098eb0 0x7f4b0011a480 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.670+0000 7f4b0765d700 1 -- 172.21.15.146:0/218294854 >> 172.21.15.146:0/218294854 conn(0x7f4b0009dc40 msgr2=0x7f4b00114300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:51.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.670+0000 7f4b0765d700 1 -- 172.21.15.146:0/218294854 shutdown_connections 2023-10-03T10:09:51.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.670+0000 7f4b0765d700 1 -- 172.21.15.146:0/218294854 wait complete. 2023-10-03T10:09:51.673 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-03T10:09:51.681 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-10-03T10:09:50.289151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188832,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298528,"statfs":{"total":386547056640,"available":385329692672,"internally_reserved":0,"allocated":458752,"data_stored":125236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.352184+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.351167+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349114+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346934+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.348722+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346621+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349058+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349640+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346360+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.347072+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.352641+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346016+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.348366+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349346+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346973+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.348926+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349332+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346655+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346609+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:45.330926+0000","last_change":"2023-10-03T10:09:44.335057+0000","last_active":"2023-10-03T10:09:45.330926+0000","last_peered":"2023-10-03T10:09:45.330926+0000","last_clean":"2023-10-03T10:09:45.330926+0000","last_became_active":"2023-10-03T10:09:44.334848+0000","last_became_peered":"2023-10-03T10:09:44.334848+0000","last_unstale":"2023-10-03T10:09:45.330926+0000","last_undegraded":"2023-10-03T10:09:45.330926+0000","last_fullsized":"2023-10-03T10:09:45.330926+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349140+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-10-03T10:09:44.333168+0000","last_change":"2023-10-03T10:09:44.331820+0000","last_active":"2023-10-03T10:09:44.333168+0000","last_peered":"2023-10-03T10:09:44.333168+0000","last_clean":"2023-10-03T10:09:44.333168+0000","last_became_active":"2023-10-03T10:09:44.331226+0000","last_became_peered":"2023-10-03T10:09:44.331226+0000","last_unstale":"2023-10-03T10:09:44.333168+0000","last_undegraded":"2023-10-03T10:09:44.333168+0000","last_fullsized":"2023-10-03T10:09:44.333168+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346348+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:45.331666+0000","last_change":"2023-10-03T10:09:44.331573+0000","last_active":"2023-10-03T10:09:45.331666+0000","last_peered":"2023-10-03T10:09:45.331666+0000","last_clean":"2023-10-03T10:09:45.331666+0000","last_became_active":"2023-10-03T10:09:44.331265+0000","last_became_peered":"2023-10-03T10:09:44.331265+0000","last_unstale":"2023-10-03T10:09:45.331666+0000","last_undegraded":"2023-10-03T10:09:45.331666+0000","last_fullsized":"2023-10-03T10:09:45.331666+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.351436+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-10-03T10:09:44.332521+0000","last_change":"2023-10-03T10:09:44.331400+0000","last_active":"2023-10-03T10:09:44.332521+0000","last_peered":"2023-10-03T10:09:44.332521+0000","last_clean":"2023-10-03T10:09:44.332521+0000","last_became_active":"2023-10-03T10:09:44.331097+0000","last_became_peered":"2023-10-03T10:09:44.331097+0000","last_unstale":"2023-10-03T10:09:44.332521+0000","last_undegraded":"2023-10-03T10:09:44.332521+0000","last_fullsized":"2023-10-03T10:09:44.332521+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:45.330935+0000","last_change":"2023-10-03T10:09:44.334568+0000","last_active":"2023-10-03T10:09:45.330935+0000","last_peered":"2023-10-03T10:09:45.330935+0000","last_clean":"2023-10-03T10:09:45.330935+0000","last_became_active":"2023-10-03T10:09:44.333878+0000","last_became_peered":"2023-10-03T10:09:44.333878+0000","last_unstale":"2023-10-03T10:09:45.330935+0000","last_undegraded":"2023-10-03T10:09:45.330935+0000","last_fullsized":"2023-10-03T10:09:45.330935+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.347939+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-10-03T10:09:44.334847+0000","last_change":"2023-10-03T10:09:44.333732+0000","last_active":"2023-10-03T10:09:44.334847+0000","last_peered":"2023-10-03T10:09:44.334847+0000","last_clean":"2023-10-03T10:09:44.334847+0000","last_became_active":"2023-10-03T10:09:44.333408+0000","last_became_peered":"2023-10-03T10:09:44.333408+0000","last_unstale":"2023-10-03T10:09:44.334847+0000","last_undegraded":"2023-10-03T10:09:44.334847+0000","last_fullsized":"2023-10-03T10:09:44.334847+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346447+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-10-03T10:09:44.331898+0000","last_change":"2023-10-03T10:09:44.329886+0000","last_active":"2023-10-03T10:09:44.331898+0000","last_peered":"2023-10-03T10:09:44.331898+0000","last_clean":"2023-10-03T10:09:44.331898+0000","last_became_active":"2023-10-03T10:09:44.329607+0000","last_became_peered":"2023-10-03T10:09:44.329607+0000","last_unstale":"2023-10-03T10:09:44.331898+0000","last_undegraded":"2023-10-03T10:09:44.331898+0000","last_fullsized":"2023-10-03T10:09:44.331898+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.351154+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349089+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:45.330927+0000","last_change":"2023-10-03T10:09:44.334348+0000","last_active":"2023-10-03T10:09:45.330927+0000","last_peered":"2023-10-03T10:09:45.330927+0000","last_clean":"2023-10-03T10:09:45.330927+0000","last_became_active":"2023-10-03T10:09:44.333893+0000","last_became_peered":"2023-10-03T10:09:44.333893+0000","last_unstale":"2023-10-03T10:09:45.330927+0000","last_undegraded":"2023-10-03T10:09:45.330927+0000","last_fullsized":"2023-10-03T10:09:45.330927+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-10-03T10:09:44.334812+0000","last_change":"2023-10-03T10:09:44.333678+0000","last_active":"2023-10-03T10:09:44.334812+0000","last_peered":"2023-10-03T10:09:44.334812+0000","last_clean":"2023-10-03T10:09:44.334812+0000","last_became_active":"2023-10-03T10:09:44.333326+0000","last_became_peered":"2023-10-03T10:09:44.333326+0000","last_unstale":"2023-10-03T10:09:44.334812+0000","last_undegraded":"2023-10-03T10:09:44.334812+0000","last_fullsized":"2023-10-03T10:09:44.334812+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.347329+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.347841+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.352576+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.350332+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.350419+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.347286+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:09:51.688 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:09:51.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.837+0000 7f1c34ed8700 1 Processor -- start 2023-10-03T10:09:51.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.837+0000 7f1c34ed8700 1 -- start start 2023-10-03T10:09:51.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.837+0000 7f1c34ed8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c30095e70 0x7f1c30096250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.837+0000 7f1c34ed8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c3012d250 0x7f1c3012f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.837+0000 7f1c34ed8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c30094ba0 con 0x7f1c30093950 2023-10-03T10:09:51.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.837+0000 7f1c34ed8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c30092e90 con 0x7f1c30095e70 2023-10-03T10:09:51.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.837+0000 7f1c34ed8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c30096b60 con 0x7f1c3012d250 2023-10-03T10:09:51.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.838+0000 7f1c2ed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c3012d250 0x7f1c3012f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.838+0000 7f1c2dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c30095e70 0x7f1c30096250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.838+0000 7f1c2e59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1c30093950 0x7f1c30095760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48346/0 (socket says 172.21.15.146:48346) 2023-10-03T10:09:51.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.838+0000 7f1c2e59c700 1 -- 172.21.15.146:0/1174905354 learned_addr learned my addr 172.21.15.146:0/1174905354 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:09:51.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.838+0000 7f1c2dd9b700 1 -- 172.21.15.146:0/1174905354 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c3012d250 msgr2=0x7f1c3012f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:51.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.838+0000 7f1c2dd9b700 1 --2- 172.21.15.146:0/1174905354 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c3012d250 0x7f1c3012f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.838+0000 7f1c2dd9b700 1 -- 172.21.15.146:0/1174905354 >> v1:172.21.15.146:6789/0 conn(0x7f1c30093950 legacy=0x7f1c30095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.838+0000 7f1c2d59a700 1 -- 172.21.15.146:0/1174905354 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794048114 0 0) 0x7f1c30094ba0 con 0x7f1c30093950 2023-10-03T10:09:51.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.838+0000 7f1c2dd9b700 1 -- 172.21.15.146:0/1174905354 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c30093150 con 0x7f1c30095e70 2023-10-03T10:09:51.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.838+0000 7f1c2ed9d700 1 --2- 172.21.15.146:0/1174905354 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c3012d250 0x7f1c3012f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:51.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.838+0000 7f1c2dd9b700 1 --2- 172.21.15.146:0/1174905354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c30095e70 0x7f1c30096250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f1c24009790 tx=0x7f1c24009060).ready entity=mon.1 client_cookie=558dff0f64920756 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:51.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.838+0000 7f1c2d59a700 1 -- 172.21.15.146:0/1174905354 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c240090d0 con 0x7f1c30095e70 2023-10-03T10:09:51.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.838+0000 7f1c2d59a700 1 -- 172.21.15.146:0/1174905354 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2400f510 con 0x7f1c30095e70 2023-10-03T10:09:51.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.838+0000 7f1c2d59a700 1 -- 172.21.15.146:0/1174905354 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2400f890 con 0x7f1c30095e70 2023-10-03T10:09:51.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.839+0000 7f1c34ed8700 1 -- 172.21.15.146:0/1174905354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c30095e70 msgr2=0x7f1c30096250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.839+0000 7f1c34ed8700 1 --2- 172.21.15.146:0/1174905354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c30095e70 0x7f1c30096250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f1c24009790 tx=0x7f1c24009060).stop 2023-10-03T10:09:51.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.839+0000 7f1c34ed8700 1 -- 172.21.15.146:0/1174905354 shutdown_connections 2023-10-03T10:09:51.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.839+0000 7f1c34ed8700 1 --2- 172.21.15.146:0/1174905354 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c3012d250 0x7f1c3012f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.839+0000 7f1c34ed8700 1 --2- 172.21.15.146:0/1174905354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c30095e70 0x7f1c30096250 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.839+0000 7f1c34ed8700 1 -- 172.21.15.146:0/1174905354 >> 172.21.15.146:0/1174905354 conn(0x7f1c3009aa50 msgr2=0x7f1c3009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:51.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.839+0000 7f1c34ed8700 1 -- 172.21.15.146:0/1174905354 shutdown_connections 2023-10-03T10:09:51.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.839+0000 7f1c34ed8700 1 -- 172.21.15.146:0/1174905354 wait complete. 2023-10-03T10:09:51.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.840+0000 7f1c34ed8700 1 Processor -- start 2023-10-03T10:09:51.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.840+0000 7f1c34ed8700 1 -- start start 2023-10-03T10:09:51.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.840+0000 7f1c34ed8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c30093950 0x7f1c30062b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.840+0000 7f1c34ed8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c30095e70 0x7f1c30118f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.840+0000 7f1c34ed8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c3012d250 0x7f1c30119450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:51.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.840+0000 7f1c34ed8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3011b330 con 0x7f1c3012d250 2023-10-03T10:09:51.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.840+0000 7f1c34ed8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c30099cd0 con 0x7f1c30093950 2023-10-03T10:09:51.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.840+0000 7f1c34ed8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c30092410 con 0x7f1c30095e70 2023-10-03T10:09:51.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.840+0000 7f1c2dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c30095e70 0x7f1c30118f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.840+0000 7f1c2ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c3012d250 0x7f1c30119450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.840+0000 7f1c2dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c30095e70 0x7f1c30118f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:47812/0 (socket says 172.21.15.146:47812) 2023-10-03T10:09:51.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.840+0000 7f1c2dd9b700 1 -- 172.21.15.146:0/3870268588 learned_addr learned my addr 172.21.15.146:0/3870268588 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:51.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.840+0000 7f1c2ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c3012d250 0x7f1c30119450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38202/0 (socket says 172.21.15.146:38202) 2023-10-03T10:09:51.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.840+0000 7f1c2e59c700 1 --2- 172.21.15.146:0/3870268588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c30093950 0x7f1c30062b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:51.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.840+0000 7f1c2dd9b700 1 -- 172.21.15.146:0/3870268588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c30093950 msgr2=0x7f1c30062b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.840+0000 7f1c2dd9b700 1 --2- 172.21.15.146:0/3870268588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c30093950 0x7f1c30062b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.840+0000 7f1c2dd9b700 1 -- 172.21.15.146:0/3870268588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c3012d250 msgr2=0x7f1c30119450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:51.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.840+0000 7f1c2dd9b700 1 --2- 172.21.15.146:0/3870268588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c3012d250 0x7f1c30119450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:51.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.840+0000 7f1c2dd9b700 1 -- 172.21.15.146:0/3870268588 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c28009a20 con 0x7f1c30095e70 2023-10-03T10:09:51.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.840+0000 7f1c2ed9d700 1 --2- 172.21.15.146:0/3870268588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c3012d250 0x7f1c30119450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:51.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.841+0000 7f1c2dd9b700 1 --2- 172.21.15.146:0/3870268588 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c30095e70 0x7f1c30118f60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1c30091c70 tx=0x7f1c24017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:51.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.841+0000 7f1c1e7fc700 1 -- 172.21.15.146:0/3870268588 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2400f890 con 0x7f1c30095e70 2023-10-03T10:09:51.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.841+0000 7f1c1e7fc700 1 -- 172.21.15.146:0/3870268588 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2400fc50 con 0x7f1c30095e70 2023-10-03T10:09:51.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.841+0000 7f1c34ed8700 1 -- 172.21.15.146:0/3870268588 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c240092a0 con 0x7f1c30095e70 2023-10-03T10:09:51.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.841+0000 7f1c1e7fc700 1 -- 172.21.15.146:0/3870268588 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2401b410 con 0x7f1c30095e70 2023-10-03T10:09:51.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.841+0000 7f1c34ed8700 1 -- 172.21.15.146:0/3870268588 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c30063660 con 0x7f1c30095e70 2023-10-03T10:09:51.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.841+0000 7f1c1e7fc700 1 -- 172.21.15.146:0/3870268588 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f1c2401b780 con 0x7f1c30095e70 2023-10-03T10:09:51.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.842+0000 7f1c1e7fc700 1 -- 172.21.15.146:0/3870268588 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f1c2403ca10 con 0x7f1c30095e70 2023-10-03T10:09:51.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.842+0000 7f1c34ed8700 1 -- 172.21.15.146:0/3870268588 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3011b810 con 0x7f1c30095e70 2023-10-03T10:09:51.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:51.846+0000 7f1c1e7fc700 1 -- 172.21.15.146:0/3870268588 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1c3011b810 con 0x7f1c30095e70 2023-10-03T10:09:51.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.000+0000 7f1c34ed8700 1 -- 172.21.15.146:0/3870268588 --> v1:172.21.15.146:6816/118159 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c3011b810 con 0x7f1c1002bb60 2023-10-03T10:09:52.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.006+0000 7f1c1e7fc700 1 -- 172.21.15.146:0/3870268588 <== mgr.4103 v1:172.21.15.146:6816/118159 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243849 (unknown 2965378022 0 2545926101) 0x7f1c3011b810 con 0x7f1c1002bb60 2023-10-03T10:09:52.008 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:52.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.008+0000 7f1c34ed8700 1 -- 172.21.15.146:0/3870268588 >> v1:172.21.15.146:6816/118159 conn(0x7f1c1002bb60 legacy=0x7f1c1002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:52.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.008+0000 7f1c34ed8700 1 -- 172.21.15.146:0/3870268588 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c30095e70 msgr2=0x7f1c30118f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:52.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.008+0000 7f1c34ed8700 1 --2- 172.21.15.146:0/3870268588 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c30095e70 0x7f1c30118f60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1c30091c70 tx=0x7f1c24017000).stop 2023-10-03T10:09:52.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.009+0000 7f1c34ed8700 1 -- 172.21.15.146:0/3870268588 shutdown_connections 2023-10-03T10:09:52.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.009+0000 7f1c34ed8700 1 --2- 172.21.15.146:0/3870268588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c3012d250 0x7f1c30119450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.009+0000 7f1c34ed8700 1 --2- 172.21.15.146:0/3870268588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c30093950 0x7f1c30062b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.009+0000 7f1c34ed8700 1 --2- 172.21.15.146:0/3870268588 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c30095e70 0x7f1c30118f60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.009+0000 7f1c34ed8700 1 -- 172.21.15.146:0/3870268588 >> 172.21.15.146:0/3870268588 conn(0x7f1c3009aa50 msgr2=0x7f1c301110b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:52.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.009+0000 7f1c34ed8700 1 -- 172.21.15.146:0/3870268588 shutdown_connections 2023-10-03T10:09:52.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.009+0000 7f1c34ed8700 1 -- 172.21.15.146:0/3870268588 wait complete. 2023-10-03T10:09:52.011 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-03T10:09:52.020 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-10-03T10:09:50.289151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188832,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298528,"statfs":{"total":386547056640,"available":385329692672,"internally_reserved":0,"allocated":458752,"data_stored":125236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.352184+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.351167+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349114+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346934+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.348722+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346621+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349058+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349640+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346360+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.347072+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.352641+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346016+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.348366+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349346+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346973+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.348926+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349332+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346655+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346609+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:45.330926+0000","last_change":"2023-10-03T10:09:44.335057+0000","last_active":"2023-10-03T10:09:45.330926+0000","last_peered":"2023-10-03T10:09:45.330926+0000","last_clean":"2023-10-03T10:09:45.330926+0000","last_became_active":"2023-10-03T10:09:44.334848+0000","last_became_peered":"2023-10-03T10:09:44.334848+0000","last_unstale":"2023-10-03T10:09:45.330926+0000","last_undegraded":"2023-10-03T10:09:45.330926+0000","last_fullsized":"2023-10-03T10:09:45.330926+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349140+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-10-03T10:09:44.333168+0000","last_change":"2023-10-03T10:09:44.331820+0000","last_active":"2023-10-03T10:09:44.333168+0000","last_peered":"2023-10-03T10:09:44.333168+0000","last_clean":"2023-10-03T10:09:44.333168+0000","last_became_active":"2023-10-03T10:09:44.331226+0000","last_became_peered":"2023-10-03T10:09:44.331226+0000","last_unstale":"2023-10-03T10:09:44.333168+0000","last_undegraded":"2023-10-03T10:09:44.333168+0000","last_fullsized":"2023-10-03T10:09:44.333168+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346348+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:45.331666+0000","last_change":"2023-10-03T10:09:44.331573+0000","last_active":"2023-10-03T10:09:45.331666+0000","last_peered":"2023-10-03T10:09:45.331666+0000","last_clean":"2023-10-03T10:09:45.331666+0000","last_became_active":"2023-10-03T10:09:44.331265+0000","last_became_peered":"2023-10-03T10:09:44.331265+0000","last_unstale":"2023-10-03T10:09:45.331666+0000","last_undegraded":"2023-10-03T10:09:45.331666+0000","last_fullsized":"2023-10-03T10:09:45.331666+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.351436+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-10-03T10:09:44.332521+0000","last_change":"2023-10-03T10:09:44.331400+0000","last_active":"2023-10-03T10:09:44.332521+0000","last_peered":"2023-10-03T10:09:44.332521+0000","last_clean":"2023-10-03T10:09:44.332521+0000","last_became_active":"2023-10-03T10:09:44.331097+0000","last_became_peered":"2023-10-03T10:09:44.331097+0000","last_unstale":"2023-10-03T10:09:44.332521+0000","last_undegraded":"2023-10-03T10:09:44.332521+0000","last_fullsized":"2023-10-03T10:09:44.332521+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:45.330935+0000","last_change":"2023-10-03T10:09:44.334568+0000","last_active":"2023-10-03T10:09:45.330935+0000","last_peered":"2023-10-03T10:09:45.330935+0000","last_clean":"2023-10-03T10:09:45.330935+0000","last_became_active":"2023-10-03T10:09:44.333878+0000","last_became_peered":"2023-10-03T10:09:44.333878+0000","last_unstale":"2023-10-03T10:09:45.330935+0000","last_undegraded":"2023-10-03T10:09:45.330935+0000","last_fullsized":"2023-10-03T10:09:45.330935+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.347939+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-10-03T10:09:44.334847+0000","last_change":"2023-10-03T10:09:44.333732+0000","last_active":"2023-10-03T10:09:44.334847+0000","last_peered":"2023-10-03T10:09:44.334847+0000","last_clean":"2023-10-03T10:09:44.334847+0000","last_became_active":"2023-10-03T10:09:44.333408+0000","last_became_peered":"2023-10-03T10:09:44.333408+0000","last_unstale":"2023-10-03T10:09:44.334847+0000","last_undegraded":"2023-10-03T10:09:44.334847+0000","last_fullsized":"2023-10-03T10:09:44.334847+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346447+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-10-03T10:09:44.331898+0000","last_change":"2023-10-03T10:09:44.329886+0000","last_active":"2023-10-03T10:09:44.331898+0000","last_peered":"2023-10-03T10:09:44.331898+0000","last_clean":"2023-10-03T10:09:44.331898+0000","last_became_active":"2023-10-03T10:09:44.329607+0000","last_became_peered":"2023-10-03T10:09:44.329607+0000","last_unstale":"2023-10-03T10:09:44.331898+0000","last_undegraded":"2023-10-03T10:09:44.331898+0000","last_fullsized":"2023-10-03T10:09:44.331898+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.351154+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349089+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:45.330927+0000","last_change":"2023-10-03T10:09:44.334348+0000","last_active":"2023-10-03T10:09:45.330927+0000","last_peered":"2023-10-03T10:09:45.330927+0000","last_clean":"2023-10-03T10:09:45.330927+0000","last_became_active":"2023-10-03T10:09:44.333893+0000","last_became_peered":"2023-10-03T10:09:44.333893+0000","last_unstale":"2023-10-03T10:09:45.330927+0000","last_undegraded":"2023-10-03T10:09:45.330927+0000","last_fullsized":"2023-10-03T10:09:45.330927+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-10-03T10:09:44.334812+0000","last_change":"2023-10-03T10:09:44.333678+0000","last_active":"2023-10-03T10:09:44.334812+0000","last_peered":"2023-10-03T10:09:44.334812+0000","last_clean":"2023-10-03T10:09:44.334812+0000","last_became_active":"2023-10-03T10:09:44.333326+0000","last_became_peered":"2023-10-03T10:09:44.333326+0000","last_unstale":"2023-10-03T10:09:44.334812+0000","last_undegraded":"2023-10-03T10:09:44.334812+0000","last_fullsized":"2023-10-03T10:09:44.334812+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.347329+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.347841+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.352576+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.350332+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.350419+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.347286+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:09:52.024 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:09:52.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.176+0000 7f9a706e9700 1 Processor -- start 2023-10-03T10:09:52.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.176+0000 7f9a706e9700 1 -- start start 2023-10-03T10:09:52.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.176+0000 7f9a706e9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a68093950 0x7f9a68095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:52.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.176+0000 7f9a706e9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9a6812d250 0x7f9a6812f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:52.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.176+0000 7f9a706e9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a68094ba0 con 0x7f9a68095c50 2023-10-03T10:09:52.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.176+0000 7f9a706e9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a68092e90 con 0x7f9a6812d250 2023-10-03T10:09:52.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.176+0000 7f9a706e9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a68096b60 con 0x7f9a68093950 2023-10-03T10:09:52.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.176+0000 7f9a6ec86700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9a6812d250 0x7f9a6812f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:52.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.176+0000 7f9a6e485700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a68093950 0x7f9a68095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:52.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.176+0000 7f9a6dc84700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9a68095c50 0x7f9a68096030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48360/0 (socket says 172.21.15.146:48360) 2023-10-03T10:09:52.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.176+0000 7f9a6e485700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a68093950 0x7f9a68095760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33474/0 (socket says 172.21.15.146:33474) 2023-10-03T10:09:52.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.177+0000 7f9a6dc84700 1 -- 172.21.15.146:0/976793226 learned_addr learned my addr 172.21.15.146:0/976793226 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:09:52.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.177+0000 7f9a6ec86700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9a6812d250 0x7f9a6812f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38212/0 (socket says 172.21.15.146:38212) 2023-10-03T10:09:52.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.177+0000 7f9a6ec86700 1 -- 172.21.15.146:0/976793226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a68093950 msgr2=0x7f9a68095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:52.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.177+0000 7f9a6ec86700 1 --2- 172.21.15.146:0/976793226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a68093950 0x7f9a68095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.177+0000 7f9a6ec86700 1 -- 172.21.15.146:0/976793226 >> v1:172.21.15.146:6789/0 conn(0x7f9a68095c50 legacy=0x7f9a68096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:52.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.177+0000 7f9a6ec86700 1 -- 172.21.15.146:0/976793226 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a68093150 con 0x7f9a6812d250 2023-10-03T10:09:52.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.177+0000 7f9a6e485700 1 --2- 172.21.15.146:0/976793226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a68093950 0x7f9a68095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:52.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.177+0000 7f9a6ec86700 1 --2- 172.21.15.146:0/976793226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a6812d250 0x7f9a6812f640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f9a60009e60 tx=0x7f9a60009780).ready entity=mon.0 client_cookie=977d6f4ffa3a840f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:52.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.177+0000 7f9a6d483700 1 -- 172.21.15.146:0/976793226 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6000e070 con 0x7f9a6812d250 2023-10-03T10:09:52.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.177+0000 7f9a6d483700 1 -- 172.21.15.146:0/976793226 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6000bb60 con 0x7f9a6812d250 2023-10-03T10:09:52.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.177+0000 7f9a6d483700 1 -- 172.21.15.146:0/976793226 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60012410 con 0x7f9a6812d250 2023-10-03T10:09:52.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.177+0000 7f9a706e9700 1 -- 172.21.15.146:0/976793226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a6812d250 msgr2=0x7f9a6812f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:52.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.177+0000 7f9a706e9700 1 --2- 172.21.15.146:0/976793226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a6812d250 0x7f9a6812f640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f9a60009e60 tx=0x7f9a60009780).stop 2023-10-03T10:09:52.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.178+0000 7f9a706e9700 1 -- 172.21.15.146:0/976793226 shutdown_connections 2023-10-03T10:09:52.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.178+0000 7f9a706e9700 1 --2- 172.21.15.146:0/976793226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a6812d250 0x7f9a6812f640 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.178+0000 7f9a706e9700 1 --2- 172.21.15.146:0/976793226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a68093950 0x7f9a68095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.178+0000 7f9a706e9700 1 -- 172.21.15.146:0/976793226 >> 172.21.15.146:0/976793226 conn(0x7f9a6809aa50 msgr2=0x7f9a6809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:52.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.178+0000 7f9a706e9700 1 -- 172.21.15.146:0/976793226 shutdown_connections 2023-10-03T10:09:52.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.178+0000 7f9a706e9700 1 -- 172.21.15.146:0/976793226 wait complete. 2023-10-03T10:09:52.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.178+0000 7f9a706e9700 1 Processor -- start 2023-10-03T10:09:52.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.178+0000 7f9a706e9700 1 -- start start 2023-10-03T10:09:52.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.179+0000 7f9a706e9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a68093950 0x7f9a6812cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:52.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.179+0000 7f9a706e9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9a68095c50 0x7f9a68115bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:52.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.179+0000 7f9a706e9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a6812d250 0x7f9a681160e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:52.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.179+0000 7f9a706e9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6811a0e0 con 0x7f9a68093950 2023-10-03T10:09:52.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.179+0000 7f9a706e9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a680994e0 con 0x7f9a6812d250 2023-10-03T10:09:52.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.179+0000 7f9a706e9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a68092410 con 0x7f9a68095c50 2023-10-03T10:09:52.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.179+0000 7f9a6e485700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a68093950 0x7f9a6812cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:52.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.179+0000 7f9a6ec86700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a6812d250 0x7f9a681160e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:52.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.179+0000 7f9a6e485700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a68093950 0x7f9a6812cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38220/0 (socket says 172.21.15.146:38220) 2023-10-03T10:09:52.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.179+0000 7f9a6dc84700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9a68095c50 0x7f9a68115bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:52.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.179+0000 7f9a6e485700 1 -- 172.21.15.146:0/3112150512 learned_addr learned my addr 172.21.15.146:0/3112150512 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:52.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.179+0000 7f9a6e485700 1 -- 172.21.15.146:0/3112150512 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9a68095c50 msgr2=0x7f9a68115bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:52.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.179+0000 7f9a6e485700 1 --2- 172.21.15.146:0/3112150512 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9a68095c50 0x7f9a68115bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.179+0000 7f9a6e485700 1 -- 172.21.15.146:0/3112150512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a6812d250 msgr2=0x7f9a681160e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:52.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.179+0000 7f9a6e485700 1 --2- 172.21.15.146:0/3112150512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a6812d250 0x7f9a681160e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.179+0000 7f9a6e485700 1 -- 172.21.15.146:0/3112150512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6400b540 con 0x7f9a68093950 2023-10-03T10:09:52.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.179+0000 7f9a6ec86700 1 --2- 172.21.15.146:0/3112150512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a6812d250 0x7f9a681160e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:52.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.179+0000 7f9a6e485700 1 --2- 172.21.15.146:0/3112150512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a68093950 0x7f9a6812cd10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f9a6400d730 tx=0x7f9a6400b300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:52.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.179+0000 7f9a5e7fc700 1 -- 172.21.15.146:0/3112150512 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6400be50 con 0x7f9a68093950 2023-10-03T10:09:52.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.179+0000 7f9a5e7fc700 1 -- 172.21.15.146:0/3112150512 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6400c4f0 con 0x7f9a68093950 2023-10-03T10:09:52.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.180+0000 7f9a5e7fc700 1 -- 172.21.15.146:0/3112150512 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6400c870 con 0x7f9a68093950 2023-10-03T10:09:52.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.180+0000 7f9a706e9700 1 -- 172.21.15.146:0/3112150512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a60009a20 con 0x7f9a68093950 2023-10-03T10:09:52.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.180+0000 7f9a706e9700 1 -- 172.21.15.146:0/3112150512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a681191d0 con 0x7f9a68093950 2023-10-03T10:09:52.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.180+0000 7f9a5e7fc700 1 -- 172.21.15.146:0/3112150512 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9a6400cbe0 con 0x7f9a68093950 2023-10-03T10:09:52.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.180+0000 7f9a5e7fc700 1 -- 172.21.15.146:0/3112150512 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9a6403f4a0 con 0x7f9a68093950 2023-10-03T10:09:52.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.180+0000 7f9a706e9700 1 -- 172.21.15.146:0/3112150512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a68069960 con 0x7f9a68093950 2023-10-03T10:09:52.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.185+0000 7f9a5e7fc700 1 -- 172.21.15.146:0/3112150512 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9a64020020 con 0x7f9a68093950 2023-10-03T10:09:52.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.341+0000 7f9a706e9700 1 -- 172.21.15.146:0/3112150512 --> v1:172.21.15.146:6816/118159 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9a6805a260 con 0x7f9a4c02bb60 2023-10-03T10:09:52.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.347+0000 7f9a5e7fc700 1 -- 172.21.15.146:0/3112150512 <== mgr.4103 v1:172.21.15.146:6816/118159 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243849 (unknown 2965378022 0 2395079697) 0x7f9a6805a260 con 0x7f9a4c02bb60 2023-10-03T10:09:52.351 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:52.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.350+0000 7f9a706e9700 1 -- 172.21.15.146:0/3112150512 >> v1:172.21.15.146:6816/118159 conn(0x7f9a4c02bb60 legacy=0x7f9a4c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:52.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.350+0000 7f9a706e9700 1 -- 172.21.15.146:0/3112150512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a68093950 msgr2=0x7f9a6812cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:52.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.350+0000 7f9a706e9700 1 --2- 172.21.15.146:0/3112150512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a68093950 0x7f9a6812cd10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f9a6400d730 tx=0x7f9a6400b300).stop 2023-10-03T10:09:52.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.350+0000 7f9a706e9700 1 -- 172.21.15.146:0/3112150512 shutdown_connections 2023-10-03T10:09:52.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.350+0000 7f9a706e9700 1 --2- 172.21.15.146:0/3112150512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a6812d250 0x7f9a681160e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.350+0000 7f9a706e9700 1 --2- 172.21.15.146:0/3112150512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a68093950 0x7f9a6812cd10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.350+0000 7f9a706e9700 1 --2- 172.21.15.146:0/3112150512 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9a68095c50 0x7f9a68115bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.350+0000 7f9a706e9700 1 -- 172.21.15.146:0/3112150512 >> 172.21.15.146:0/3112150512 conn(0x7f9a6809aa50 msgr2=0x7f9a68069250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:52.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.350+0000 7f9a706e9700 1 -- 172.21.15.146:0/3112150512 shutdown_connections 2023-10-03T10:09:52.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.350+0000 7f9a706e9700 1 -- 172.21.15.146:0/3112150512 wait complete. 2023-10-03T10:09:52.353 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-03T10:09:52.363 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-03T10:09:52.289652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188832,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298528,"statfs":{"total":386547056640,"available":385329692672,"internally_reserved":0,"allocated":458752,"data_stored":125236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.352184+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.351167+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349114+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346934+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.348722+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346621+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349058+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349640+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346360+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.347072+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.352641+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346016+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.348366+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349346+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346973+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.348926+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349332+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346655+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346609+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:45.330926+0000","last_change":"2023-10-03T10:09:44.335057+0000","last_active":"2023-10-03T10:09:45.330926+0000","last_peered":"2023-10-03T10:09:45.330926+0000","last_clean":"2023-10-03T10:09:45.330926+0000","last_became_active":"2023-10-03T10:09:44.334848+0000","last_became_peered":"2023-10-03T10:09:44.334848+0000","last_unstale":"2023-10-03T10:09:45.330926+0000","last_undegraded":"2023-10-03T10:09:45.330926+0000","last_fullsized":"2023-10-03T10:09:45.330926+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349140+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-10-03T10:09:44.333168+0000","last_change":"2023-10-03T10:09:44.331820+0000","last_active":"2023-10-03T10:09:44.333168+0000","last_peered":"2023-10-03T10:09:44.333168+0000","last_clean":"2023-10-03T10:09:44.333168+0000","last_became_active":"2023-10-03T10:09:44.331226+0000","last_became_peered":"2023-10-03T10:09:44.331226+0000","last_unstale":"2023-10-03T10:09:44.333168+0000","last_undegraded":"2023-10-03T10:09:44.333168+0000","last_fullsized":"2023-10-03T10:09:44.333168+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346348+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:45.331666+0000","last_change":"2023-10-03T10:09:44.331573+0000","last_active":"2023-10-03T10:09:45.331666+0000","last_peered":"2023-10-03T10:09:45.331666+0000","last_clean":"2023-10-03T10:09:45.331666+0000","last_became_active":"2023-10-03T10:09:44.331265+0000","last_became_peered":"2023-10-03T10:09:44.331265+0000","last_unstale":"2023-10-03T10:09:45.331666+0000","last_undegraded":"2023-10-03T10:09:45.331666+0000","last_fullsized":"2023-10-03T10:09:45.331666+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.351436+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-10-03T10:09:44.332521+0000","last_change":"2023-10-03T10:09:44.331400+0000","last_active":"2023-10-03T10:09:44.332521+0000","last_peered":"2023-10-03T10:09:44.332521+0000","last_clean":"2023-10-03T10:09:44.332521+0000","last_became_active":"2023-10-03T10:09:44.331097+0000","last_became_peered":"2023-10-03T10:09:44.331097+0000","last_unstale":"2023-10-03T10:09:44.332521+0000","last_undegraded":"2023-10-03T10:09:44.332521+0000","last_fullsized":"2023-10-03T10:09:44.332521+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:45.330935+0000","last_change":"2023-10-03T10:09:44.334568+0000","last_active":"2023-10-03T10:09:45.330935+0000","last_peered":"2023-10-03T10:09:45.330935+0000","last_clean":"2023-10-03T10:09:45.330935+0000","last_became_active":"2023-10-03T10:09:44.333878+0000","last_became_peered":"2023-10-03T10:09:44.333878+0000","last_unstale":"2023-10-03T10:09:45.330935+0000","last_undegraded":"2023-10-03T10:09:45.330935+0000","last_fullsized":"2023-10-03T10:09:45.330935+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.347939+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-10-03T10:09:44.334847+0000","last_change":"2023-10-03T10:09:44.333732+0000","last_active":"2023-10-03T10:09:44.334847+0000","last_peered":"2023-10-03T10:09:44.334847+0000","last_clean":"2023-10-03T10:09:44.334847+0000","last_became_active":"2023-10-03T10:09:44.333408+0000","last_became_peered":"2023-10-03T10:09:44.333408+0000","last_unstale":"2023-10-03T10:09:44.334847+0000","last_undegraded":"2023-10-03T10:09:44.334847+0000","last_fullsized":"2023-10-03T10:09:44.334847+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346447+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-10-03T10:09:44.331898+0000","last_change":"2023-10-03T10:09:44.329886+0000","last_active":"2023-10-03T10:09:44.331898+0000","last_peered":"2023-10-03T10:09:44.331898+0000","last_clean":"2023-10-03T10:09:44.331898+0000","last_became_active":"2023-10-03T10:09:44.329607+0000","last_became_peered":"2023-10-03T10:09:44.329607+0000","last_unstale":"2023-10-03T10:09:44.331898+0000","last_undegraded":"2023-10-03T10:09:44.331898+0000","last_fullsized":"2023-10-03T10:09:44.331898+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.351154+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349089+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:45.330927+0000","last_change":"2023-10-03T10:09:44.334348+0000","last_active":"2023-10-03T10:09:45.330927+0000","last_peered":"2023-10-03T10:09:45.330927+0000","last_clean":"2023-10-03T10:09:45.330927+0000","last_became_active":"2023-10-03T10:09:44.333893+0000","last_became_peered":"2023-10-03T10:09:44.333893+0000","last_unstale":"2023-10-03T10:09:45.330927+0000","last_undegraded":"2023-10-03T10:09:45.330927+0000","last_fullsized":"2023-10-03T10:09:45.330927+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-10-03T10:09:44.334812+0000","last_change":"2023-10-03T10:09:44.333678+0000","last_active":"2023-10-03T10:09:44.334812+0000","last_peered":"2023-10-03T10:09:44.334812+0000","last_clean":"2023-10-03T10:09:44.334812+0000","last_became_active":"2023-10-03T10:09:44.333326+0000","last_became_peered":"2023-10-03T10:09:44.333326+0000","last_unstale":"2023-10-03T10:09:44.334812+0000","last_undegraded":"2023-10-03T10:09:44.334812+0000","last_fullsized":"2023-10-03T10:09:44.334812+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.347329+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.347841+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.352576+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.350332+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.350419+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.347286+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:09:52.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2023-10-03T10:09:52.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2023-10-03T10:09:52.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2023-10-03T10:09:52.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2023-10-03T10:09:52.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2023-10-03T10:09:52.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2023-10-03T10:09:52.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2023-10-03T10:09:52.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2023-10-03T10:09:52.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2023-10-03T10:09:52.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2023-10-03T10:09:52.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2023-10-03T10:09:52.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2023-10-03T10:09:52.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2023-10-03T10:09:52.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2023-10-03T10:09:52.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2023-10-03T10:09:52.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2023-10-03T10:09:52.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2023-10-03T10:09:52.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2023-10-03T10:09:52.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2023-10-03T10:09:52.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2023-10-03T10:09:52.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2023-10-03T10:09:52.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2023-10-03T10:09:52.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2023-10-03T10:09:52.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2023-10-03T10:09:52.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2023-10-03T10:09:52.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2023-10-03T10:09:52.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2023-10-03T10:09:52.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-10-03T10:09:52.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.352184+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-03T10:09:52.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-10-03T10:09:52.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-10-03T10:09:52.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.351167+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-03T10:09:52.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-10-03T10:09:52.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-10-03T10:09:52.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.349114+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T10:09:52.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-10-03T10:09:52.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-10-03T10:09:52.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.346934+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-03T10:09:52.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-10-03T10:09:52.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-10-03T10:09:52.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.348722+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-03T10:09:52.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-10-03T10:09:52.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-10-03T10:09:52.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.346621+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-03T10:09:52.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-10-03T10:09:52.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-10-03T10:09:52.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.349058+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T10:09:52.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-10-03T10:09:52.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-10-03T10:09:52.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.349640+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T10:09:52.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-10-03T10:09:52.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-10-03T10:09:52.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.346360+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-03T10:09:52.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-10-03T10:09:52.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-10-03T10:09:52.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.347072+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T10:09:52.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-10-03T10:09:52.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-10-03T10:09:52.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.352641+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-03T10:09:52.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-10-03T10:09:52.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-10-03T10:09:52.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.346016+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-03T10:09:52.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-10-03T10:09:52.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-10-03T10:09:52.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.348366+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-03T10:09:52.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-10-03T10:09:52.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-10-03T10:09:52.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.349346+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T10:09:52.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-10-03T10:09:52.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-10-03T10:09:52.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.346973+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-03T10:09:52.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-10-03T10:09:52.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-10-03T10:09:52.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.348926+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T10:09:52.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-10-03T10:09:52.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-10-03T10:09:52.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.349332+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T10:09:52.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-10-03T10:09:52.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-10-03T10:09:52.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.346655+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T10:09:52.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-10-03T10:09:52.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-10-03T10:09:52.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.346609+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T10:09:52.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-10-03T10:09:52.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-10-03T10:09:52.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.349140+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-03T10:09:52.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-10-03T10:09:52.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-10-03T10:09:52.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.346348+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-03T10:09:52.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-10-03T10:09:52.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-10-03T10:09:52.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.351436+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-03T10:09:52.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-10-03T10:09:52.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-10-03T10:09:52.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.347939+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T10:09:52.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-10-03T10:09:52.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-10-03T10:09:52.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.346447+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-03T10:09:52.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-10-03T10:09:52.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-10-03T10:09:52.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.351154+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-03T10:09:52.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-10-03T10:09:52.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-10-03T10:09:52.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.349089+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T10:09:52.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-10-03T10:09:52.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-10-03T10:09:52.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.347329+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-03T10:09:52.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-10-03T10:09:52.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-10-03T10:09:52.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.347841+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-03T10:09:52.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-10-03T10:09:52.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-10-03T10:09:52.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.352576+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-03T10:09:52.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-10-03T10:09:52.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-10-03T10:09:52.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.350332+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T10:09:52.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-10-03T10:09:52.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-10-03T10:09:52.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.350419+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-03T10:09:52.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-10-03T10:09:52.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-10-03T10:09:52.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-03T10:09:47.339242+0000', 'last_change': '2023-10-03T10:09:47.347286+0000', 'last_active': '2023-10-03T10:09:47.339242+0000', 'last_peered': '2023-10-03T10:09:47.339242+0000', 'last_clean': '2023-10-03T10:09:47.339242+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:47.339242+0000', 'last_undegraded': '2023-10-03T10:09:47.339242+0000', 'last_fullsized': '2023-10-03T10:09:47.339242+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:47.339242+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-03T10:09:52.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-10-03T10:09:52.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2023-10-03T10:09:52.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2023-10-03T10:09:52.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2023-10-03T10:09:52.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2023-10-03T10:09:52.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2023-10-03T10:09:52.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:48.343020+0000', 'last_change': '2023-10-03T10:09:48.343020+0000', 'last_active': '2023-10-03T10:09:48.343020+0000', 'last_peered': '2023-10-03T10:09:48.343020+0000', 'last_clean': '2023-10-03T10:09:48.343020+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:48.343020+0000', 'last_undegraded': '2023-10-03T10:09:48.343020+0000', 'last_fullsized': '2023-10-03T10:09:48.343020+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:48.343020+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:52.387 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-03T10:09:52.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.517+0000 7fc0359be700 1 Processor -- start 2023-10-03T10:09:52.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.517+0000 7fc0359be700 1 -- start start 2023-10-03T10:09:52.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.518+0000 7fc0359be700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc0300985e0 0x7fc0300989c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:52.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.518+0000 7fc0359be700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc030098eb0 0x7fc03012f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:52.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.518+0000 7fc0359be700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc03012f980 0x7fc030131d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:52.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.518+0000 7fc0359be700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc030095650 con 0x7fc0300985e0 2023-10-03T10:09:52.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.518+0000 7fc0359be700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03009a3f0 con 0x7fc03012f980 2023-10-03T10:09:52.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.518+0000 7fc0359be700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc030095100 con 0x7fc030098eb0 2023-10-03T10:09:52.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.518+0000 7fc02effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc0300985e0 0x7fc0300989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.518+0000 7fc02e7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc030098eb0 0x7fc03012f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.518+0000 7fc02f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc03012f980 0x7fc030131d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.518+0000 7fc02effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc0300985e0 0x7fc0300989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38228/0 (socket says 172.21.15.146:38228) 2023-10-03T10:09:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.518+0000 7fc02e7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc030098eb0 0x7fc03012f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:47834/0 (socket says 172.21.15.146:47834) 2023-10-03T10:09:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.518+0000 7fc02effd700 1 -- 172.21.15.146:0/507958743 learned_addr learned my addr 172.21.15.146:0/507958743 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.518+0000 7fc02f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc03012f980 0x7fc030131d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33492/0 (socket says 172.21.15.146:33492) 2023-10-03T10:09:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.519+0000 7fc02effd700 1 -- 172.21.15.146:0/507958743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc030098eb0 msgr2=0x7fc03012f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.519+0000 7fc02effd700 1 --2- 172.21.15.146:0/507958743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc030098eb0 0x7fc03012f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.519+0000 7fc02effd700 1 -- 172.21.15.146:0/507958743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc03012f980 msgr2=0x7fc030131d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.519+0000 7fc02effd700 1 --2- 172.21.15.146:0/507958743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc03012f980 0x7fc030131d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.519+0000 7fc02effd700 1 -- 172.21.15.146:0/507958743 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc030099e70 con 0x7fc0300985e0 2023-10-03T10:09:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.519+0000 7fc02e7fc700 1 --2- 172.21.15.146:0/507958743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc030098eb0 0x7fc03012f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:52.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.519+0000 7fc02f7fe700 1 --2- 172.21.15.146:0/507958743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc03012f980 0x7fc030131d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:52.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.519+0000 7fc02effd700 1 --2- 172.21.15.146:0/507958743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0300985e0 0x7fc0300989c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc018009830 tx=0x7fc0180090f0).ready entity=mon.0 client_cookie=bade04d620a9f660 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:52.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.519+0000 7fc02dffb700 1 -- 172.21.15.146:0/507958743 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01800f510 con 0x7fc0300985e0 2023-10-03T10:09:52.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.519+0000 7fc02dffb700 1 -- 172.21.15.146:0/507958743 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01800f670 con 0x7fc0300985e0 2023-10-03T10:09:52.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.519+0000 7fc02dffb700 1 -- 172.21.15.146:0/507958743 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01800f9f0 con 0x7fc0300985e0 2023-10-03T10:09:52.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.519+0000 7fc0359be700 1 -- 172.21.15.146:0/507958743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0300985e0 msgr2=0x7fc0300989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:52.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.519+0000 7fc0359be700 1 --2- 172.21.15.146:0/507958743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0300985e0 0x7fc0300989c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc018009830 tx=0x7fc0180090f0).stop 2023-10-03T10:09:52.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.519+0000 7fc0359be700 1 -- 172.21.15.146:0/507958743 shutdown_connections 2023-10-03T10:09:52.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.519+0000 7fc0359be700 1 --2- 172.21.15.146:0/507958743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc03012f980 0x7fc030131d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.519+0000 7fc0359be700 1 --2- 172.21.15.146:0/507958743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0300985e0 0x7fc0300989c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.519+0000 7fc0359be700 1 --2- 172.21.15.146:0/507958743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc030098eb0 0x7fc03012f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.520+0000 7fc0359be700 1 -- 172.21.15.146:0/507958743 >> 172.21.15.146:0/507958743 conn(0x7fc03009dc40 msgr2=0x7fc03009e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:52.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.520+0000 7fc0359be700 1 -- 172.21.15.146:0/507958743 shutdown_connections 2023-10-03T10:09:52.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.520+0000 7fc0359be700 1 -- 172.21.15.146:0/507958743 wait complete. 2023-10-03T10:09:52.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.521+0000 7fc0359be700 1 Processor -- start 2023-10-03T10:09:52.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.521+0000 7fc0359be700 1 -- start start 2023-10-03T10:09:52.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.521+0000 7fc0359be700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0300985e0 0x7fc03011a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:52.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.521+0000 7fc0359be700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc030098eb0 0x7fc03011a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:52.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.521+0000 7fc0359be700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc03012f980 0x7fc03011ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:52.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.522+0000 7fc0359be700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03011b180 con 0x7fc03012f980 2023-10-03T10:09:52.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.522+0000 7fc0359be700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03011dde0 con 0x7fc030098eb0 2023-10-03T10:09:52.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.522+0000 7fc0359be700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc03011e9c0 con 0x7fc0300985e0 2023-10-03T10:09:52.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.522+0000 7fc02e7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc030098eb0 0x7fc03011a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:52.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.522+0000 7fc02effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0300985e0 0x7fc03011a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:52.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.522+0000 7fc02f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc03012f980 0x7fc03011ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:52.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.522+0000 7fc02effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0300985e0 0x7fc03011a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:47848/0 (socket says 172.21.15.146:47848) 2023-10-03T10:09:52.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.522+0000 7fc02e7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc030098eb0 0x7fc03011a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33494/0 (socket says 172.21.15.146:33494) 2023-10-03T10:09:52.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.522+0000 7fc02effd700 1 -- 172.21.15.146:0/333049883 learned_addr learned my addr 172.21.15.146:0/333049883 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:52.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.522+0000 7fc02f7fe700 1 -- 172.21.15.146:0/333049883 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0300985e0 msgr2=0x7fc03011a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:52.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.522+0000 7fc02f7fe700 1 --2- 172.21.15.146:0/333049883 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0300985e0 0x7fc03011a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.522+0000 7fc02f7fe700 1 -- 172.21.15.146:0/333049883 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc030098eb0 msgr2=0x7fc03011a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:52.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.522+0000 7fc02f7fe700 1 --2- 172.21.15.146:0/333049883 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc030098eb0 0x7fc03011a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.522+0000 7fc02f7fe700 1 -- 172.21.15.146:0/333049883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0200092a0 con 0x7fc03012f980 2023-10-03T10:09:52.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.522+0000 7fc02e7fc700 1 --2- 172.21.15.146:0/333049883 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc030098eb0 0x7fc03011a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:52.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.522+0000 7fc02f7fe700 1 --2- 172.21.15.146:0/333049883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc03012f980 0x7fc03011ac90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fc028009f10 tx=0x7fc02800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:52.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.522+0000 7fc026ffd700 1 -- 172.21.15.146:0/333049883 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02800cb70 con 0x7fc03012f980 2023-10-03T10:09:52.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.522+0000 7fc026ffd700 1 -- 172.21.15.146:0/333049883 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02800f040 con 0x7fc03012f980 2023-10-03T10:09:52.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.522+0000 7fc0359be700 1 -- 172.21.15.146:0/333049883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc028009a20 con 0x7fc03012f980 2023-10-03T10:09:52.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.522+0000 7fc026ffd700 1 -- 172.21.15.146:0/333049883 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02800cee0 con 0x7fc03012f980 2023-10-03T10:09:52.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.522+0000 7fc0359be700 1 -- 172.21.15.146:0/333049883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc018009370 con 0x7fc03012f980 2023-10-03T10:09:52.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.523+0000 7fc026ffd700 1 -- 172.21.15.146:0/333049883 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc028013610 con 0x7fc03012f980 2023-10-03T10:09:52.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.523+0000 7fc026ffd700 1 -- 172.21.15.146:0/333049883 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc02803ba20 con 0x7fc03012f980 2023-10-03T10:09:52.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.524+0000 7fc0359be700 1 -- 172.21.15.146:0/333049883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc03005a260 con 0x7fc03012f980 2023-10-03T10:09:52.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.528+0000 7fc026ffd700 1 -- 172.21.15.146:0/333049883 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc02801d460 con 0x7fc03012f980 2023-10-03T10:09:52.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.748+0000 7fc0359be700 1 -- 172.21.15.146:0/333049883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc030099af0 con 0x7fc03012f980 2023-10-03T10:09:52.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.748+0000 7fc026ffd700 1 -- 172.21.15.146:0/333049883 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1106 (secure 0 0 0) 0x7fc02801c3c0 con 0x7fc03012f980 2023-10-03T10:09:52.749 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:52.749 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":19,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":16,"num_osds":4,"num_up_osds":4,"osd_up_since":1696327782,"num_in_osds":4,"osd_in_since":1696327775,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":1217363968,"bytes_avail":385329692672,"bytes_total":386547056640,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4181}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-03T10:09:33.332011+0000","services":{}},"progress_events":{}} 2023-10-03T10:09:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.750+0000 7fc0359be700 1 -- 172.21.15.146:0/333049883 >> v1:172.21.15.146:6816/118159 conn(0x7fc01002bb60 legacy=0x7fc01002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.750+0000 7fc0359be700 1 -- 172.21.15.146:0/333049883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc03012f980 msgr2=0x7fc03011ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:52.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.750+0000 7fc0359be700 1 --2- 172.21.15.146:0/333049883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc03012f980 0x7fc03011ac90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fc028009f10 tx=0x7fc02800b040).stop 2023-10-03T10:09:52.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.750+0000 7fc0359be700 1 -- 172.21.15.146:0/333049883 shutdown_connections 2023-10-03T10:09:52.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.750+0000 7fc0359be700 1 --2- 172.21.15.146:0/333049883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc03012f980 0x7fc03011ac90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.750+0000 7fc0359be700 1 --2- 172.21.15.146:0/333049883 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0300985e0 0x7fc03011a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.750+0000 7fc0359be700 1 --2- 172.21.15.146:0/333049883 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc030098eb0 0x7fc03011a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.750+0000 7fc0359be700 1 -- 172.21.15.146:0/333049883 >> 172.21.15.146:0/333049883 conn(0x7fc03009dc40 msgr2=0x7fc030114300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:52.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.751+0000 7fc0359be700 1 -- 172.21.15.146:0/333049883 shutdown_connections 2023-10-03T10:09:52.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.751+0000 7fc0359be700 1 -- 172.21.15.146:0/333049883 wait complete. 2023-10-03T10:09:52.763 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-03T10:09:52.763 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:09:52.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.878+0000 7f5b1b83c700 1 Processor -- start 2023-10-03T10:09:52.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.878+0000 7f5b1b83c700 1 -- start start 2023-10-03T10:09:52.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.878+0000 7f5b1b83c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b14066e30 0x7f5b14067210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:52.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.878+0000 7f5b1b83c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b14068680 0x7f5b14067700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:52.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.878+0000 7f5b1b83c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5b14128a10 0x7f5b14128ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:52.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.878+0000 7f5b1b83c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b14069090 con 0x7f5b14128a10 2023-10-03T10:09:52.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.878+0000 7f5b1b83c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b140694e0 con 0x7f5b14068680 2023-10-03T10:09:52.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.878+0000 7f5b1b83c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b14094130 con 0x7f5b14066e30 2023-10-03T10:09:52.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.879+0000 7f5b19dd9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5b14128a10 0x7f5b14128ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:52.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.879+0000 7f5b18dd7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b14068680 0x7f5b14067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:52.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.879+0000 7f5b195d8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b14066e30 0x7f5b14067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:52.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.879+0000 7f5b18dd7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b14068680 0x7f5b14067700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33510/0 (socket says 172.21.15.146:33510) 2023-10-03T10:09:52.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.879+0000 7f5b19dd9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5b14128a10 0x7f5b14128ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38246/0 (socket says 172.21.15.146:38246) 2023-10-03T10:09:52.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.879+0000 7f5b18dd7700 1 -- 172.21.15.146:0/1690785872 learned_addr learned my addr 172.21.15.146:0/1690785872 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:52.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.879+0000 7f5b18dd7700 1 -- 172.21.15.146:0/1690785872 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b14066e30 msgr2=0x7f5b14067210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:52.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.879+0000 7f5b18dd7700 1 --2- 172.21.15.146:0/1690785872 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b14066e30 0x7f5b14067210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.879+0000 7f5b18dd7700 1 -- 172.21.15.146:0/1690785872 >> v2:172.21.15.146:3300/0 conn(0x7f5b14128a10 msgr2=0x7f5b14128ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:52.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.879+0000 7f5b18dd7700 1 --2- 172.21.15.146:0/1690785872 >> v2:172.21.15.146:3300/0 conn(0x7f5b14128a10 0x7f5b14128ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.879+0000 7f5b18dd7700 1 -- 172.21.15.146:0/1690785872 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b14069a10 con 0x7f5b14068680 2023-10-03T10:09:52.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.879+0000 7f5b195d8700 1 --2- 172.21.15.146:0/1690785872 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b14066e30 0x7f5b14067210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:52.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.879+0000 7f5b19dd9700 1 --2- 172.21.15.146:0/1690785872 >> v2:172.21.15.146:3300/0 conn(0x7f5b14128a10 0x7f5b14128ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:52.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.879+0000 7f5b18dd7700 1 --2- 172.21.15.146:0/1690785872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b14068680 0x7f5b14067700 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f5b04006fd0 tx=0x7f5b040090f0).ready entity=mon.1 client_cookie=7057e723f4b1f7e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:52.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.879+0000 7f5b0bfff700 1 -- 172.21.15.146:0/1690785872 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0400f510 con 0x7f5b14068680 2023-10-03T10:09:52.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.879+0000 7f5b0bfff700 1 -- 172.21.15.146:0/1690785872 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0400f670 con 0x7f5b14068680 2023-10-03T10:09:52.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.879+0000 7f5b0bfff700 1 -- 172.21.15.146:0/1690785872 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0400fa10 con 0x7f5b14068680 2023-10-03T10:09:52.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.880+0000 7f5b1b83c700 1 -- 172.21.15.146:0/1690785872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b14068680 msgr2=0x7f5b14067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:52.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.880+0000 7f5b1b83c700 1 --2- 172.21.15.146:0/1690785872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b14068680 0x7f5b14067700 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f5b04006fd0 tx=0x7f5b040090f0).stop 2023-10-03T10:09:52.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.880+0000 7f5b1b83c700 1 -- 172.21.15.146:0/1690785872 shutdown_connections 2023-10-03T10:09:52.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.880+0000 7f5b1b83c700 1 --2- 172.21.15.146:0/1690785872 >> v2:172.21.15.146:3300/0 conn(0x7f5b14128a10 0x7f5b14128ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.880+0000 7f5b1b83c700 1 --2- 172.21.15.146:0/1690785872 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b14066e30 0x7f5b14067210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.880+0000 7f5b1b83c700 1 --2- 172.21.15.146:0/1690785872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b14068680 0x7f5b14067700 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.880+0000 7f5b1b83c700 1 -- 172.21.15.146:0/1690785872 >> 172.21.15.146:0/1690785872 conn(0x7f5b1409a230 msgr2=0x7f5b1409a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:52.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.880+0000 7f5b1b83c700 1 -- 172.21.15.146:0/1690785872 shutdown_connections 2023-10-03T10:09:52.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.880+0000 7f5b1b83c700 1 -- 172.21.15.146:0/1690785872 wait complete. 2023-10-03T10:09:52.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.881+0000 7f5b1b83c700 1 Processor -- start 2023-10-03T10:09:52.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.881+0000 7f5b1b83c700 1 -- start start 2023-10-03T10:09:52.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.881+0000 7f5b1b83c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b14066e30 0x7f5b14127970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:52.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.881+0000 7f5b1b83c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b14068680 0x7f5b14127e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:52.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.881+0000 7f5b1b83c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b14128a10 0x7f5b140919b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:52.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.881+0000 7f5b1b83c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b14092e20 con 0x7f5b14128a10 2023-10-03T10:09:52.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.881+0000 7f5b1b83c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b14099790 con 0x7f5b14068680 2023-10-03T10:09:52.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.881+0000 7f5b1b83c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b140691e0 con 0x7f5b14066e30 2023-10-03T10:09:52.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.881+0000 7f5b195d8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b14066e30 0x7f5b14127970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:52.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.881+0000 7f5b18dd7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b14068680 0x7f5b14127e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:52.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.881+0000 7f5b195d8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b14066e30 0x7f5b14127970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:47862/0 (socket says 172.21.15.146:47862) 2023-10-03T10:09:52.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.881+0000 7f5b195d8700 1 -- 172.21.15.146:0/2713800138 learned_addr learned my addr 172.21.15.146:0/2713800138 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:52.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.881+0000 7f5b19dd9700 1 --2- 172.21.15.146:0/2713800138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b14128a10 0x7f5b140919b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:52.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.882+0000 7f5b19dd9700 1 -- 172.21.15.146:0/2713800138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b14066e30 msgr2=0x7f5b14127970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:52.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.882+0000 7f5b19dd9700 1 --2- 172.21.15.146:0/2713800138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b14066e30 0x7f5b14127970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.882+0000 7f5b19dd9700 1 -- 172.21.15.146:0/2713800138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b14068680 msgr2=0x7f5b14127e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:52.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.882+0000 7f5b19dd9700 1 --2- 172.21.15.146:0/2713800138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b14068680 0x7f5b14127e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:52.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.882+0000 7f5b19dd9700 1 -- 172.21.15.146:0/2713800138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b100092a0 con 0x7f5b14128a10 2023-10-03T10:09:52.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.882+0000 7f5b195d8700 1 --2- 172.21.15.146:0/2713800138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b14066e30 0x7f5b14127970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:52.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.882+0000 7f5b18dd7700 1 --2- 172.21.15.146:0/2713800138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b14068680 0x7f5b14127e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:52.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.882+0000 7f5b19dd9700 1 --2- 172.21.15.146:0/2713800138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b14128a10 0x7f5b140919b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f5b0c009f10 tx=0x7f5b0c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:52.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.882+0000 7f5b097fa700 1 -- 172.21.15.146:0/2713800138 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c00cb70 con 0x7f5b14128a10 2023-10-03T10:09:52.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.882+0000 7f5b097fa700 1 -- 172.21.15.146:0/2713800138 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c00f040 con 0x7f5b14128a10 2023-10-03T10:09:52.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.882+0000 7f5b1b83c700 1 -- 172.21.15.146:0/2713800138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0c009a20 con 0x7f5b14128a10 2023-10-03T10:09:52.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.882+0000 7f5b097fa700 1 -- 172.21.15.146:0/2713800138 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c013400 con 0x7f5b14128a10 2023-10-03T10:09:52.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.882+0000 7f5b1b83c700 1 -- 172.21.15.146:0/2713800138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b04009370 con 0x7f5b14128a10 2023-10-03T10:09:52.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.883+0000 7f5b1b83c700 1 -- 172.21.15.146:0/2713800138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b1405a260 con 0x7f5b14128a10 2023-10-03T10:09:52.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.883+0000 7f5b097fa700 1 -- 172.21.15.146:0/2713800138 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5b0c0137f0 con 0x7f5b14128a10 2023-10-03T10:09:52.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.884+0000 7f5b097fa700 1 -- 172.21.15.146:0/2713800138 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f5b0c03c860 con 0x7f5b14128a10 2023-10-03T10:09:52.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:52.887+0000 7f5b097fa700 1 -- 172.21.15.146:0/2713800138 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5b0c013aa0 con 0x7f5b14128a10 2023-10-03T10:09:53.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:53.040+0000 7f5b1b83c700 1 -- 172.21.15.146:0/2713800138 --> v1:172.21.15.146:6816/118159 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b14046c20 con 0x7f5af802bb60 2023-10-03T10:09:53.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:53.046+0000 7f5b097fa700 1 -- 172.21.15.146:0/2713800138 <== mgr.4103 v1:172.21.15.146:6816/118159 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243849 (unknown 2965378022 0 2395079697) 0x7f5b14046c20 con 0x7f5af802bb60 2023-10-03T10:09:53.049 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:53.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:53.048+0000 7f5b1b83c700 1 -- 172.21.15.146:0/2713800138 >> v1:172.21.15.146:6816/118159 conn(0x7f5af802bb60 legacy=0x7f5af802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:53.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:53.048+0000 7f5b1b83c700 1 -- 172.21.15.146:0/2713800138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b14128a10 msgr2=0x7f5b140919b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:53.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:53.048+0000 7f5b1b83c700 1 --2- 172.21.15.146:0/2713800138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b14128a10 0x7f5b140919b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f5b0c009f10 tx=0x7f5b0c00b040).stop 2023-10-03T10:09:53.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:53.048+0000 7f5b1b83c700 1 -- 172.21.15.146:0/2713800138 shutdown_connections 2023-10-03T10:09:53.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:53.048+0000 7f5b1b83c700 1 --2- 172.21.15.146:0/2713800138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b14128a10 0x7f5b140919b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:53.048+0000 7f5b1b83c700 1 --2- 172.21.15.146:0/2713800138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b14066e30 0x7f5b14127970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:53.048+0000 7f5b1b83c700 1 --2- 172.21.15.146:0/2713800138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b14068680 0x7f5b14127e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:53.048+0000 7f5b1b83c700 1 -- 172.21.15.146:0/2713800138 >> 172.21.15.146:0/2713800138 conn(0x7f5b1409a230 msgr2=0x7f5b14129aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:53.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:53.048+0000 7f5b1b83c700 1 -- 172.21.15.146:0/2713800138 shutdown_connections 2023-10-03T10:09:53.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:53.048+0000 7f5b1b83c700 1 -- 172.21.15.146:0/2713800138 wait complete. 2023-10-03T10:09:53.052 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-03T10:09:53.060 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-03T10:09:52.289652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188832,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298528,"statfs":{"total":386547056640,"available":385329692672,"internally_reserved":0,"allocated":458752,"data_stored":125236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.352184+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.351167+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349114+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346934+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.348722+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346621+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349058+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349640+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346360+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.347072+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.352641+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346016+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.348366+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349346+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346973+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.348926+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349332+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346655+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346609+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:45.330926+0000","last_change":"2023-10-03T10:09:44.335057+0000","last_active":"2023-10-03T10:09:45.330926+0000","last_peered":"2023-10-03T10:09:45.330926+0000","last_clean":"2023-10-03T10:09:45.330926+0000","last_became_active":"2023-10-03T10:09:44.334848+0000","last_became_peered":"2023-10-03T10:09:44.334848+0000","last_unstale":"2023-10-03T10:09:45.330926+0000","last_undegraded":"2023-10-03T10:09:45.330926+0000","last_fullsized":"2023-10-03T10:09:45.330926+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349140+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-10-03T10:09:44.333168+0000","last_change":"2023-10-03T10:09:44.331820+0000","last_active":"2023-10-03T10:09:44.333168+0000","last_peered":"2023-10-03T10:09:44.333168+0000","last_clean":"2023-10-03T10:09:44.333168+0000","last_became_active":"2023-10-03T10:09:44.331226+0000","last_became_peered":"2023-10-03T10:09:44.331226+0000","last_unstale":"2023-10-03T10:09:44.333168+0000","last_undegraded":"2023-10-03T10:09:44.333168+0000","last_fullsized":"2023-10-03T10:09:44.333168+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346348+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:45.331666+0000","last_change":"2023-10-03T10:09:44.331573+0000","last_active":"2023-10-03T10:09:45.331666+0000","last_peered":"2023-10-03T10:09:45.331666+0000","last_clean":"2023-10-03T10:09:45.331666+0000","last_became_active":"2023-10-03T10:09:44.331265+0000","last_became_peered":"2023-10-03T10:09:44.331265+0000","last_unstale":"2023-10-03T10:09:45.331666+0000","last_undegraded":"2023-10-03T10:09:45.331666+0000","last_fullsized":"2023-10-03T10:09:45.331666+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.351436+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-10-03T10:09:44.332521+0000","last_change":"2023-10-03T10:09:44.331400+0000","last_active":"2023-10-03T10:09:44.332521+0000","last_peered":"2023-10-03T10:09:44.332521+0000","last_clean":"2023-10-03T10:09:44.332521+0000","last_became_active":"2023-10-03T10:09:44.331097+0000","last_became_peered":"2023-10-03T10:09:44.331097+0000","last_unstale":"2023-10-03T10:09:44.332521+0000","last_undegraded":"2023-10-03T10:09:44.332521+0000","last_fullsized":"2023-10-03T10:09:44.332521+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:45.330935+0000","last_change":"2023-10-03T10:09:44.334568+0000","last_active":"2023-10-03T10:09:45.330935+0000","last_peered":"2023-10-03T10:09:45.330935+0000","last_clean":"2023-10-03T10:09:45.330935+0000","last_became_active":"2023-10-03T10:09:44.333878+0000","last_became_peered":"2023-10-03T10:09:44.333878+0000","last_unstale":"2023-10-03T10:09:45.330935+0000","last_undegraded":"2023-10-03T10:09:45.330935+0000","last_fullsized":"2023-10-03T10:09:45.330935+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.347939+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-10-03T10:09:44.334847+0000","last_change":"2023-10-03T10:09:44.333732+0000","last_active":"2023-10-03T10:09:44.334847+0000","last_peered":"2023-10-03T10:09:44.334847+0000","last_clean":"2023-10-03T10:09:44.334847+0000","last_became_active":"2023-10-03T10:09:44.333408+0000","last_became_peered":"2023-10-03T10:09:44.333408+0000","last_unstale":"2023-10-03T10:09:44.334847+0000","last_undegraded":"2023-10-03T10:09:44.334847+0000","last_fullsized":"2023-10-03T10:09:44.334847+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.346447+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-10-03T10:09:44.331898+0000","last_change":"2023-10-03T10:09:44.329886+0000","last_active":"2023-10-03T10:09:44.331898+0000","last_peered":"2023-10-03T10:09:44.331898+0000","last_clean":"2023-10-03T10:09:44.331898+0000","last_became_active":"2023-10-03T10:09:44.329607+0000","last_became_peered":"2023-10-03T10:09:44.329607+0000","last_unstale":"2023-10-03T10:09:44.331898+0000","last_undegraded":"2023-10-03T10:09:44.331898+0000","last_fullsized":"2023-10-03T10:09:44.331898+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.351154+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.349089+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:45.330927+0000","last_change":"2023-10-03T10:09:44.334348+0000","last_active":"2023-10-03T10:09:45.330927+0000","last_peered":"2023-10-03T10:09:45.330927+0000","last_clean":"2023-10-03T10:09:45.330927+0000","last_became_active":"2023-10-03T10:09:44.333893+0000","last_became_peered":"2023-10-03T10:09:44.333893+0000","last_unstale":"2023-10-03T10:09:45.330927+0000","last_undegraded":"2023-10-03T10:09:45.330927+0000","last_fullsized":"2023-10-03T10:09:45.330927+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-10-03T10:09:44.334812+0000","last_change":"2023-10-03T10:09:44.333678+0000","last_active":"2023-10-03T10:09:44.334812+0000","last_peered":"2023-10-03T10:09:44.334812+0000","last_clean":"2023-10-03T10:09:44.334812+0000","last_became_active":"2023-10-03T10:09:44.333326+0000","last_became_peered":"2023-10-03T10:09:44.333326+0000","last_unstale":"2023-10-03T10:09:44.334812+0000","last_undegraded":"2023-10-03T10:09:44.334812+0000","last_fullsized":"2023-10-03T10:09:44.334812+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.347329+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.347841+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.352576+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.350332+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.350419+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-03T10:09:47.339242+0000","last_change":"2023-10-03T10:09:47.347286+0000","last_active":"2023-10-03T10:09:47.339242+0000","last_peered":"2023-10-03T10:09:47.339242+0000","last_clean":"2023-10-03T10:09:47.339242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:47.339242+0000","last_undegraded":"2023-10-03T10:09:47.339242+0000","last_fullsized":"2023-10-03T10:09:47.339242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:48.343020+0000","last_change":"2023-10-03T10:09:48.343020+0000","last_active":"2023-10-03T10:09:48.343020+0000","last_peered":"2023-10-03T10:09:48.343020+0000","last_clean":"2023-10-03T10:09:48.343020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:48.343020+0000","last_undegraded":"2023-10-03T10:09:48.343020+0000","last_fullsized":"2023-10-03T10:09:48.343020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":31309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:09:54.451 INFO:tasks.ceph.mds.a.smithi146.stderr:2023-10-03T10:09:54.451+0000 7fe32affd700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-03T10:09:56.066 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:09:56.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.196+0000 7fb181254700 1 Processor -- start 2023-10-03T10:09:56.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.196+0000 7fb181254700 1 -- start start 2023-10-03T10:09:56.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.196+0000 7fb181254700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb17c05f560 0x7fb17c12ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.196+0000 7fb181254700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb17c12b370 0x7fb17c095d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.196+0000 7fb181254700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb17c12b790 0x7fb17c096280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.196+0000 7fb181254700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17c05f940 con 0x7fb17c12b370 2023-10-03T10:09:56.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.196+0000 7fb181254700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c066f90 con 0x7fb17c12b790 2023-10-03T10:09:56.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.196+0000 7fb181254700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c067650 con 0x7fb17c05f560 2023-10-03T10:09:56.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.196+0000 7fb17ad9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb17c05f560 0x7fb17c12ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.196+0000 7fb17b59e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb17c12b790 0x7fb17c096280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.196+0000 7fb17b59e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb17c12b790 0x7fb17c096280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58474/0 (socket says 172.21.15.146:58474) 2023-10-03T10:09:56.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.196+0000 7fb17ad9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb17c05f560 0x7fb17c12ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36538/0 (socket says 172.21.15.146:36538) 2023-10-03T10:09:56.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.196+0000 7fb17b59e700 1 -- 172.21.15.146:0/1640765036 learned_addr learned my addr 172.21.15.146:0/1640765036 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:56.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.196+0000 7fb17a59c700 1 --2- 172.21.15.146:0/1640765036 >> v2:172.21.15.146:3300/0 conn(0x7fb17c12b370 0x7fb17c095d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.197+0000 7fb17ad9d700 1 -- 172.21.15.146:0/1640765036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb17c12b790 msgr2=0x7fb17c096280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:56.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.197+0000 7fb17ad9d700 1 --2- 172.21.15.146:0/1640765036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb17c12b790 0x7fb17c096280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.197+0000 7fb17ad9d700 1 -- 172.21.15.146:0/1640765036 >> v2:172.21.15.146:3300/0 conn(0x7fb17c12b370 msgr2=0x7fb17c095d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:56.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.197+0000 7fb17ad9d700 1 --2- 172.21.15.146:0/1640765036 >> v2:172.21.15.146:3300/0 conn(0x7fb17c12b370 0x7fb17c095d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.197+0000 7fb17ad9d700 1 -- 172.21.15.146:0/1640765036 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c067910 con 0x7fb17c05f560 2023-10-03T10:09:56.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.197+0000 7fb17b59e700 1 --2- 172.21.15.146:0/1640765036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb17c12b790 0x7fb17c096280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:56.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.197+0000 7fb17a59c700 1 --2- 172.21.15.146:0/1640765036 >> v2:172.21.15.146:3300/0 conn(0x7fb17c12b370 0x7fb17c095d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:56.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.197+0000 7fb17ad9d700 1 --2- 172.21.15.146:0/1640765036 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb17c05f560 0x7fb17c12ae80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb16c009790 tx=0x7fb16c009060).ready entity=mon.2 client_cookie=e0d3c4655abcff2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:56.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.197+0000 7fb179d9b700 1 -- 172.21.15.146:0/1640765036 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c00d4a0 con 0x7fb17c05f560 2023-10-03T10:09:56.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.197+0000 7fb179d9b700 1 -- 172.21.15.146:0/1640765036 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16c00d600 con 0x7fb17c05f560 2023-10-03T10:09:56.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.197+0000 7fb179d9b700 1 -- 172.21.15.146:0/1640765036 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c00d980 con 0x7fb17c05f560 2023-10-03T10:09:56.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.197+0000 7fb181254700 1 -- 172.21.15.146:0/1640765036 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb17c05f560 msgr2=0x7fb17c12ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.197+0000 7fb181254700 1 --2- 172.21.15.146:0/1640765036 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb17c05f560 0x7fb17c12ae80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb16c009790 tx=0x7fb16c009060).stop 2023-10-03T10:09:56.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.197+0000 7fb181254700 1 -- 172.21.15.146:0/1640765036 shutdown_connections 2023-10-03T10:09:56.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.197+0000 7fb181254700 1 --2- 172.21.15.146:0/1640765036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb17c12b790 0x7fb17c096280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.197+0000 7fb181254700 1 --2- 172.21.15.146:0/1640765036 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb17c05f560 0x7fb17c12ae80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.197+0000 7fb181254700 1 --2- 172.21.15.146:0/1640765036 >> v2:172.21.15.146:3300/0 conn(0x7fb17c12b370 0x7fb17c095d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.197+0000 7fb181254700 1 -- 172.21.15.146:0/1640765036 >> 172.21.15.146:0/1640765036 conn(0x7fb17c09a1c0 msgr2=0x7fb17c09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:56.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.197+0000 7fb181254700 1 -- 172.21.15.146:0/1640765036 shutdown_connections 2023-10-03T10:09:56.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.197+0000 7fb181254700 1 -- 172.21.15.146:0/1640765036 wait complete. 2023-10-03T10:09:56.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.198+0000 7fb181254700 1 Processor -- start 2023-10-03T10:09:56.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.198+0000 7fb181254700 1 -- start start 2023-10-03T10:09:56.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.199+0000 7fb181254700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb17c05f560 0x7fb17c128280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.199+0000 7fb181254700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb17c12b370 0x7fb17c1171b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.199+0000 7fb181254700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb17c12b790 0x7fb17c1176a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.199+0000 7fb181254700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c11acc0 con 0x7fb17c05f560 2023-10-03T10:09:56.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.199+0000 7fb181254700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c1185b0 con 0x7fb17c12b370 2023-10-03T10:09:56.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.199+0000 7fb181254700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0671f0 con 0x7fb17c12b790 2023-10-03T10:09:56.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.199+0000 7fb17a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb17c12b370 0x7fb17c1171b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.199+0000 7fb17ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb17c05f560 0x7fb17c128280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.199+0000 7fb17b59e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb17c12b790 0x7fb17c1176a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.199+0000 7fb17b59e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb17c12b790 0x7fb17c1176a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36550/0 (socket says 172.21.15.146:36550) 2023-10-03T10:09:56.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.199+0000 7fb17ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb17c05f560 0x7fb17c128280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46944/0 (socket says 172.21.15.146:46944) 2023-10-03T10:09:56.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.199+0000 7fb17b59e700 1 -- 172.21.15.146:0/1595210380 learned_addr learned my addr 172.21.15.146:0/1595210380 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:56.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.199+0000 7fb17a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb17c12b370 0x7fb17c1171b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58486/0 (socket says 172.21.15.146:58486) 2023-10-03T10:09:56.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.199+0000 7fb17b59e700 1 -- 172.21.15.146:0/1595210380 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb17c12b370 msgr2=0x7fb17c1171b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.199+0000 7fb17b59e700 1 --2- 172.21.15.146:0/1595210380 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb17c12b370 0x7fb17c1171b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.199+0000 7fb17b59e700 1 -- 172.21.15.146:0/1595210380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb17c05f560 msgr2=0x7fb17c128280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.199+0000 7fb17b59e700 1 --2- 172.21.15.146:0/1595210380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb17c05f560 0x7fb17c128280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.199+0000 7fb17b59e700 1 -- 172.21.15.146:0/1595210380 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1700092a0 con 0x7fb17c12b790 2023-10-03T10:09:56.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.199+0000 7fb17a59c700 1 --2- 172.21.15.146:0/1595210380 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb17c12b370 0x7fb17c1171b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:56.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.199+0000 7fb17ad9d700 1 --2- 172.21.15.146:0/1595210380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb17c05f560 0x7fb17c128280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:56.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.199+0000 7fb17b59e700 1 --2- 172.21.15.146:0/1595210380 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb17c12b790 0x7fb17c1176a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fb174009fc0 tx=0x7fb17400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:56.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.200+0000 7fb162ffd700 1 -- 172.21.15.146:0/1595210380 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174009d10 con 0x7fb17c12b790 2023-10-03T10:09:56.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.200+0000 7fb162ffd700 1 -- 172.21.15.146:0/1595210380 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17400f040 con 0x7fb17c12b790 2023-10-03T10:09:56.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.200+0000 7fb181254700 1 -- 172.21.15.146:0/1595210380 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb174009ae0 con 0x7fb17c12b790 2023-10-03T10:09:56.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.200+0000 7fb162ffd700 1 -- 172.21.15.146:0/1595210380 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17400cb70 con 0x7fb17c12b790 2023-10-03T10:09:56.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.200+0000 7fb181254700 1 -- 172.21.15.146:0/1595210380 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16c0092a0 con 0x7fb17c12b790 2023-10-03T10:09:56.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.200+0000 7fb162ffd700 1 -- 172.21.15.146:0/1595210380 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb174014460 con 0x7fb17c12b790 2023-10-03T10:09:56.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.201+0000 7fb162ffd700 1 -- 172.21.15.146:0/1595210380 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb17403afa0 con 0x7fb17c12b790 2023-10-03T10:09:56.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.201+0000 7fb181254700 1 -- 172.21.15.146:0/1595210380 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17c05a260 con 0x7fb17c12b790 2023-10-03T10:09:56.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.205+0000 7fb162ffd700 1 -- 172.21.15.146:0/1595210380 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb174019020 con 0x7fb17c12b790 2023-10-03T10:09:56.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.361+0000 7fb181254700 1 -- 172.21.15.146:0/1595210380 --> v1:172.21.15.146:6816/118159 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb17c12ab70 con 0x7fb16802bb90 2023-10-03T10:09:56.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.368+0000 7fb162ffd700 1 -- 172.21.15.146:0/1595210380 <== mgr.4103 v1:172.21.15.146:6816/118159 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250024 (unknown 2965378022 0 3050610146) 0x7fb17c12ab70 con 0x7fb16802bb90 2023-10-03T10:09:56.371 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:56.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.371+0000 7fb181254700 1 -- 172.21.15.146:0/1595210380 >> v1:172.21.15.146:6816/118159 conn(0x7fb16802bb90 legacy=0x7fb16802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.371+0000 7fb181254700 1 -- 172.21.15.146:0/1595210380 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb17c12b790 msgr2=0x7fb17c1176a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.371+0000 7fb181254700 1 --2- 172.21.15.146:0/1595210380 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb17c12b790 0x7fb17c1176a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fb174009fc0 tx=0x7fb17400b040).stop 2023-10-03T10:09:56.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.371+0000 7fb181254700 1 -- 172.21.15.146:0/1595210380 shutdown_connections 2023-10-03T10:09:56.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.371+0000 7fb181254700 1 --2- 172.21.15.146:0/1595210380 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb17c12b790 0x7fb17c1176a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.371+0000 7fb181254700 1 --2- 172.21.15.146:0/1595210380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb17c05f560 0x7fb17c128280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.371+0000 7fb181254700 1 --2- 172.21.15.146:0/1595210380 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb17c12b370 0x7fb17c1171b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.371+0000 7fb181254700 1 -- 172.21.15.146:0/1595210380 >> 172.21.15.146:0/1595210380 conn(0x7fb17c09a1c0 msgr2=0x7fb17c098780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:56.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.371+0000 7fb181254700 1 -- 172.21.15.146:0/1595210380 shutdown_connections 2023-10-03T10:09:56.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.371+0000 7fb181254700 1 -- 172.21.15.146:0/1595210380 wait complete. 2023-10-03T10:09:56.374 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-03T10:09:56.384 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-03T10:09:56.290502+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188992,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298368,"statfs":{"total":386547056640,"available":385329528832,"internally_reserved":0,"allocated":622592,"data_stored":182668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000540"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.760605+0000","last_change":"2023-10-03T10:09:48.757714+0000","last_active":"2023-10-03T10:09:48.760605+0000","last_peered":"2023-10-03T10:09:48.760605+0000","last_clean":"2023-10-03T10:09:48.760605+0000","last_became_active":"2023-10-03T10:09:48.757453+0000","last_became_peered":"2023-10-03T10:09:48.757453+0000","last_unstale":"2023-10-03T10:09:48.760605+0000","last_undegraded":"2023-10-03T10:09:48.760605+0000","last_fullsized":"2023-10-03T10:09:48.760605+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.747433+0000","last_change":"2023-10-03T10:09:48.741431+0000","last_active":"2023-10-03T10:09:48.747433+0000","last_peered":"2023-10-03T10:09:48.747433+0000","last_clean":"2023-10-03T10:09:48.747433+0000","last_became_active":"2023-10-03T10:09:48.741098+0000","last_became_peered":"2023-10-03T10:09:48.741098+0000","last_unstale":"2023-10-03T10:09:48.747433+0000","last_undegraded":"2023-10-03T10:09:48.747433+0000","last_fullsized":"2023-10-03T10:09:48.747433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750874+0000","last_change":"2023-10-03T10:09:48.743956+0000","last_active":"2023-10-03T10:09:48.750874+0000","last_peered":"2023-10-03T10:09:48.750874+0000","last_clean":"2023-10-03T10:09:48.750874+0000","last_became_active":"2023-10-03T10:09:48.743706+0000","last_became_peered":"2023-10-03T10:09:48.743706+0000","last_unstale":"2023-10-03T10:09:48.750874+0000","last_undegraded":"2023-10-03T10:09:48.750874+0000","last_fullsized":"2023-10-03T10:09:48.750874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750183+0000","last_change":"2023-10-03T10:09:48.744824+0000","last_active":"2023-10-03T10:09:48.750183+0000","last_peered":"2023-10-03T10:09:48.750183+0000","last_clean":"2023-10-03T10:09:48.750183+0000","last_became_active":"2023-10-03T10:09:48.744559+0000","last_became_peered":"2023-10-03T10:09:48.744559+0000","last_unstale":"2023-10-03T10:09:48.750183+0000","last_undegraded":"2023-10-03T10:09:48.750183+0000","last_fullsized":"2023-10-03T10:09:48.750183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.769044+0000","last_change":"2023-10-03T10:09:48.756529+0000","last_active":"2023-10-03T10:09:48.769044+0000","last_peered":"2023-10-03T10:09:48.769044+0000","last_clean":"2023-10-03T10:09:48.769044+0000","last_became_active":"2023-10-03T10:09:48.756233+0000","last_became_peered":"2023-10-03T10:09:48.756233+0000","last_unstale":"2023-10-03T10:09:48.769044+0000","last_undegraded":"2023-10-03T10:09:48.769044+0000","last_fullsized":"2023-10-03T10:09:48.769044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.770152+0000","last_change":"2023-10-03T10:09:48.766120+0000","last_active":"2023-10-03T10:09:48.770152+0000","last_peered":"2023-10-03T10:09:48.770152+0000","last_clean":"2023-10-03T10:09:48.770152+0000","last_became_active":"2023-10-03T10:09:48.765846+0000","last_became_peered":"2023-10-03T10:09:48.765846+0000","last_unstale":"2023-10-03T10:09:48.770152+0000","last_undegraded":"2023-10-03T10:09:48.770152+0000","last_fullsized":"2023-10-03T10:09:48.770152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.768039+0000","last_change":"2023-10-03T10:09:48.762070+0000","last_active":"2023-10-03T10:09:48.768039+0000","last_peered":"2023-10-03T10:09:48.768039+0000","last_clean":"2023-10-03T10:09:48.768039+0000","last_became_active":"2023-10-03T10:09:48.758238+0000","last_became_peered":"2023-10-03T10:09:48.758238+0000","last_unstale":"2023-10-03T10:09:48.768039+0000","last_undegraded":"2023-10-03T10:09:48.768039+0000","last_fullsized":"2023-10-03T10:09:48.768039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.761216+0000","last_change":"2023-10-03T10:09:48.746713+0000","last_active":"2023-10-03T10:09:48.761216+0000","last_peered":"2023-10-03T10:09:48.761216+0000","last_clean":"2023-10-03T10:09:48.761216+0000","last_became_active":"2023-10-03T10:09:48.746426+0000","last_became_peered":"2023-10-03T10:09:48.746426+0000","last_unstale":"2023-10-03T10:09:48.761216+0000","last_undegraded":"2023-10-03T10:09:48.761216+0000","last_fullsized":"2023-10-03T10:09:48.761216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.770029+0000","last_change":"2023-10-03T10:09:48.757336+0000","last_active":"2023-10-03T10:09:48.770029+0000","last_peered":"2023-10-03T10:09:48.770029+0000","last_clean":"2023-10-03T10:09:48.770029+0000","last_became_active":"2023-10-03T10:09:48.757059+0000","last_became_peered":"2023-10-03T10:09:48.757059+0000","last_unstale":"2023-10-03T10:09:48.770029+0000","last_undegraded":"2023-10-03T10:09:48.770029+0000","last_fullsized":"2023-10-03T10:09:48.770029+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.760187+0000","last_change":"2023-10-03T10:09:48.748969+0000","last_active":"2023-10-03T10:09:48.760187+0000","last_peered":"2023-10-03T10:09:48.760187+0000","last_clean":"2023-10-03T10:09:48.760187+0000","last_became_active":"2023-10-03T10:09:48.746842+0000","last_became_peered":"2023-10-03T10:09:48.746842+0000","last_unstale":"2023-10-03T10:09:48.760187+0000","last_undegraded":"2023-10-03T10:09:48.760187+0000","last_fullsized":"2023-10-03T10:09:48.760187+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.758966+0000","last_change":"2023-10-03T10:09:48.745732+0000","last_active":"2023-10-03T10:09:48.758966+0000","last_peered":"2023-10-03T10:09:48.758966+0000","last_clean":"2023-10-03T10:09:48.758966+0000","last_became_active":"2023-10-03T10:09:48.745451+0000","last_became_peered":"2023-10-03T10:09:48.745451+0000","last_unstale":"2023-10-03T10:09:48.758966+0000","last_undegraded":"2023-10-03T10:09:48.758966+0000","last_fullsized":"2023-10-03T10:09:48.758966+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.760556+0000","last_change":"2023-10-03T10:09:48.758809+0000","last_active":"2023-10-03T10:09:48.760556+0000","last_peered":"2023-10-03T10:09:48.760556+0000","last_clean":"2023-10-03T10:09:48.760556+0000","last_became_active":"2023-10-03T10:09:48.758533+0000","last_became_peered":"2023-10-03T10:09:48.758533+0000","last_unstale":"2023-10-03T10:09:48.760556+0000","last_undegraded":"2023-10-03T10:09:48.760556+0000","last_fullsized":"2023-10-03T10:09:48.760556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.761143+0000","last_change":"2023-10-03T10:09:48.759114+0000","last_active":"2023-10-03T10:09:48.761143+0000","last_peered":"2023-10-03T10:09:48.761143+0000","last_clean":"2023-10-03T10:09:48.761143+0000","last_became_active":"2023-10-03T10:09:48.758569+0000","last_became_peered":"2023-10-03T10:09:48.758569+0000","last_unstale":"2023-10-03T10:09:48.761143+0000","last_undegraded":"2023-10-03T10:09:48.761143+0000","last_fullsized":"2023-10-03T10:09:48.761143+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.744574+0000","last_change":"2023-10-03T10:09:48.740857+0000","last_active":"2023-10-03T10:09:48.744574+0000","last_peered":"2023-10-03T10:09:48.744574+0000","last_clean":"2023-10-03T10:09:48.744574+0000","last_became_active":"2023-10-03T10:09:48.740608+0000","last_became_peered":"2023-10-03T10:09:48.740608+0000","last_unstale":"2023-10-03T10:09:48.744574+0000","last_undegraded":"2023-10-03T10:09:48.744574+0000","last_fullsized":"2023-10-03T10:09:48.744574+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.744195+0000","last_change":"2023-10-03T10:09:48.740412+0000","last_active":"2023-10-03T10:09:48.744195+0000","last_peered":"2023-10-03T10:09:48.744195+0000","last_clean":"2023-10-03T10:09:48.744195+0000","last_became_active":"2023-10-03T10:09:48.740146+0000","last_became_peered":"2023-10-03T10:09:48.740146+0000","last_unstale":"2023-10-03T10:09:48.744195+0000","last_undegraded":"2023-10-03T10:09:48.744195+0000","last_fullsized":"2023-10-03T10:09:48.744195+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.768017+0000","last_change":"2023-10-03T10:09:48.758060+0000","last_active":"2023-10-03T10:09:48.768017+0000","last_peered":"2023-10-03T10:09:48.768017+0000","last_clean":"2023-10-03T10:09:48.768017+0000","last_became_active":"2023-10-03T10:09:48.757793+0000","last_became_peered":"2023-10-03T10:09:48.757793+0000","last_unstale":"2023-10-03T10:09:48.768017+0000","last_undegraded":"2023-10-03T10:09:48.768017+0000","last_fullsized":"2023-10-03T10:09:48.768017+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.770015+0000","last_change":"2023-10-03T10:09:48.757180+0000","last_active":"2023-10-03T10:09:48.770015+0000","last_peered":"2023-10-03T10:09:48.770015+0000","last_clean":"2023-10-03T10:09:48.770015+0000","last_became_active":"2023-10-03T10:09:48.756905+0000","last_became_peered":"2023-10-03T10:09:48.756905+0000","last_unstale":"2023-10-03T10:09:48.770015+0000","last_undegraded":"2023-10-03T10:09:48.770015+0000","last_fullsized":"2023-10-03T10:09:48.770015+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750451+0000","last_change":"2023-10-03T10:09:48.745373+0000","last_active":"2023-10-03T10:09:48.750451+0000","last_peered":"2023-10-03T10:09:48.750451+0000","last_clean":"2023-10-03T10:09:48.750451+0000","last_became_active":"2023-10-03T10:09:48.744351+0000","last_became_peered":"2023-10-03T10:09:48.744351+0000","last_unstale":"2023-10-03T10:09:48.750451+0000","last_undegraded":"2023-10-03T10:09:48.750451+0000","last_fullsized":"2023-10-03T10:09:48.750451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.761168+0000","last_change":"2023-10-03T10:09:48.759606+0000","last_active":"2023-10-03T10:09:48.761168+0000","last_peered":"2023-10-03T10:09:48.761168+0000","last_clean":"2023-10-03T10:09:48.761168+0000","last_became_active":"2023-10-03T10:09:48.759343+0000","last_became_peered":"2023-10-03T10:09:48.759343+0000","last_unstale":"2023-10-03T10:09:48.761168+0000","last_undegraded":"2023-10-03T10:09:48.761168+0000","last_fullsized":"2023-10-03T10:09:48.761168+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765193+0000","last_change":"2023-10-03T10:09:48.760055+0000","last_active":"2023-10-03T10:09:48.765193+0000","last_peered":"2023-10-03T10:09:48.765193+0000","last_clean":"2023-10-03T10:09:48.765193+0000","last_became_active":"2023-10-03T10:09:48.759787+0000","last_became_peered":"2023-10-03T10:09:48.759787+0000","last_unstale":"2023-10-03T10:09:48.765193+0000","last_undegraded":"2023-10-03T10:09:48.765193+0000","last_fullsized":"2023-10-03T10:09:48.765193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.763954+0000","last_change":"2023-10-03T10:09:48.753483+0000","last_active":"2023-10-03T10:09:48.763954+0000","last_peered":"2023-10-03T10:09:48.763954+0000","last_clean":"2023-10-03T10:09:48.763954+0000","last_became_active":"2023-10-03T10:09:48.752879+0000","last_became_peered":"2023-10-03T10:09:48.752879+0000","last_unstale":"2023-10-03T10:09:48.763954+0000","last_undegraded":"2023-10-03T10:09:48.763954+0000","last_fullsized":"2023-10-03T10:09:48.763954+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750515+0000","last_change":"2023-10-03T10:09:48.745699+0000","last_active":"2023-10-03T10:09:48.750515+0000","last_peered":"2023-10-03T10:09:48.750515+0000","last_clean":"2023-10-03T10:09:48.750515+0000","last_became_active":"2023-10-03T10:09:48.745433+0000","last_became_peered":"2023-10-03T10:09:48.745433+0000","last_unstale":"2023-10-03T10:09:48.750515+0000","last_undegraded":"2023-10-03T10:09:48.750515+0000","last_fullsized":"2023-10-03T10:09:48.750515+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.769929+0000","last_change":"2023-10-03T10:09:48.764152+0000","last_active":"2023-10-03T10:09:48.769929+0000","last_peered":"2023-10-03T10:09:48.769929+0000","last_clean":"2023-10-03T10:09:48.769929+0000","last_became_active":"2023-10-03T10:09:48.758589+0000","last_became_peered":"2023-10-03T10:09:48.758589+0000","last_unstale":"2023-10-03T10:09:48.769929+0000","last_undegraded":"2023-10-03T10:09:48.769929+0000","last_fullsized":"2023-10-03T10:09:48.769929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765097+0000","last_change":"2023-10-03T10:09:48.760358+0000","last_active":"2023-10-03T10:09:48.765097+0000","last_peered":"2023-10-03T10:09:48.765097+0000","last_clean":"2023-10-03T10:09:48.765097+0000","last_became_active":"2023-10-03T10:09:48.754451+0000","last_became_peered":"2023-10-03T10:09:48.754451+0000","last_unstale":"2023-10-03T10:09:48.765097+0000","last_undegraded":"2023-10-03T10:09:48.765097+0000","last_fullsized":"2023-10-03T10:09:48.765097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765283+0000","last_change":"2023-10-03T10:09:48.763060+0000","last_active":"2023-10-03T10:09:48.765283+0000","last_peered":"2023-10-03T10:09:48.765283+0000","last_clean":"2023-10-03T10:09:48.765283+0000","last_became_active":"2023-10-03T10:09:48.762772+0000","last_became_peered":"2023-10-03T10:09:48.762772+0000","last_unstale":"2023-10-03T10:09:48.765283+0000","last_undegraded":"2023-10-03T10:09:48.765283+0000","last_fullsized":"2023-10-03T10:09:48.765283+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.743835+0000","last_change":"2023-10-03T10:09:48.740694+0000","last_active":"2023-10-03T10:09:48.743835+0000","last_peered":"2023-10-03T10:09:48.743835+0000","last_clean":"2023-10-03T10:09:48.743835+0000","last_became_active":"2023-10-03T10:09:48.740403+0000","last_became_peered":"2023-10-03T10:09:48.740403+0000","last_unstale":"2023-10-03T10:09:48.743835+0000","last_undegraded":"2023-10-03T10:09:48.743835+0000","last_fullsized":"2023-10-03T10:09:48.743835+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.767981+0000","last_change":"2023-10-03T10:09:48.762261+0000","last_active":"2023-10-03T10:09:48.767981+0000","last_peered":"2023-10-03T10:09:48.767981+0000","last_clean":"2023-10-03T10:09:48.767981+0000","last_became_active":"2023-10-03T10:09:48.758917+0000","last_became_peered":"2023-10-03T10:09:48.758917+0000","last_unstale":"2023-10-03T10:09:48.767981+0000","last_undegraded":"2023-10-03T10:09:48.767981+0000","last_fullsized":"2023-10-03T10:09:48.767981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.743194+0000","last_change":"2023-10-03T10:09:48.371325+0000","last_active":"2023-10-03T10:09:48.743194+0000","last_peered":"2023-10-03T10:09:48.743194+0000","last_clean":"2023-10-03T10:09:48.743194+0000","last_became_active":"2023-10-03T10:09:48.371116+0000","last_became_peered":"2023-10-03T10:09:48.371116+0000","last_unstale":"2023-10-03T10:09:48.743194+0000","last_undegraded":"2023-10-03T10:09:48.743194+0000","last_fullsized":"2023-10-03T10:09:48.743194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.770196+0000","last_change":"2023-10-03T10:09:48.766155+0000","last_active":"2023-10-03T10:09:48.770196+0000","last_peered":"2023-10-03T10:09:48.770196+0000","last_clean":"2023-10-03T10:09:48.770196+0000","last_became_active":"2023-10-03T10:09:48.765746+0000","last_became_peered":"2023-10-03T10:09:48.765746+0000","last_unstale":"2023-10-03T10:09:48.770196+0000","last_undegraded":"2023-10-03T10:09:48.770196+0000","last_fullsized":"2023-10-03T10:09:48.770196+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.728334+0000","last_change":"2023-10-03T10:09:48.377430+0000","last_active":"2023-10-03T10:09:48.728334+0000","last_peered":"2023-10-03T10:09:48.728334+0000","last_clean":"2023-10-03T10:09:48.728334+0000","last_became_active":"2023-10-03T10:09:48.376947+0000","last_became_peered":"2023-10-03T10:09:48.376947+0000","last_unstale":"2023-10-03T10:09:48.728334+0000","last_undegraded":"2023-10-03T10:09:48.728334+0000","last_fullsized":"2023-10-03T10:09:48.728334+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750478+0000","last_change":"2023-10-03T10:09:48.745599+0000","last_active":"2023-10-03T10:09:48.750478+0000","last_peered":"2023-10-03T10:09:48.750478+0000","last_clean":"2023-10-03T10:09:48.750478+0000","last_became_active":"2023-10-03T10:09:48.744772+0000","last_became_peered":"2023-10-03T10:09:48.744772+0000","last_unstale":"2023-10-03T10:09:48.750478+0000","last_undegraded":"2023-10-03T10:09:48.750478+0000","last_fullsized":"2023-10-03T10:09:48.750478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.749249+0000","last_change":"2023-10-03T10:09:48.365550+0000","last_active":"2023-10-03T10:09:48.749249+0000","last_peered":"2023-10-03T10:09:48.749249+0000","last_clean":"2023-10-03T10:09:48.749249+0000","last_became_active":"2023-10-03T10:09:48.364969+0000","last_became_peered":"2023-10-03T10:09:48.364969+0000","last_unstale":"2023-10-03T10:09:48.749249+0000","last_undegraded":"2023-10-03T10:09:48.749249+0000","last_fullsized":"2023-10-03T10:09:48.749249+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.772400+0000","last_change":"2023-10-03T10:09:48.768231+0000","last_active":"2023-10-03T10:09:48.772400+0000","last_peered":"2023-10-03T10:09:48.772400+0000","last_clean":"2023-10-03T10:09:48.772400+0000","last_became_active":"2023-10-03T10:09:48.767982+0000","last_became_peered":"2023-10-03T10:09:48.767982+0000","last_unstale":"2023-10-03T10:09:48.772400+0000","last_undegraded":"2023-10-03T10:09:48.772400+0000","last_fullsized":"2023-10-03T10:09:48.772400+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.732659+0000","last_change":"2023-10-03T10:09:48.372222+0000","last_active":"2023-10-03T10:09:48.732659+0000","last_peered":"2023-10-03T10:09:48.732659+0000","last_clean":"2023-10-03T10:09:48.732659+0000","last_became_active":"2023-10-03T10:09:48.371919+0000","last_became_peered":"2023-10-03T10:09:48.371919+0000","last_unstale":"2023-10-03T10:09:48.732659+0000","last_undegraded":"2023-10-03T10:09:48.732659+0000","last_fullsized":"2023-10-03T10:09:48.732659+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.772230+0000","last_change":"2023-10-03T10:09:48.766829+0000","last_active":"2023-10-03T10:09:48.772230+0000","last_peered":"2023-10-03T10:09:48.772230+0000","last_clean":"2023-10-03T10:09:48.772230+0000","last_became_active":"2023-10-03T10:09:48.766356+0000","last_became_peered":"2023-10-03T10:09:48.766356+0000","last_unstale":"2023-10-03T10:09:48.772230+0000","last_undegraded":"2023-10-03T10:09:48.772230+0000","last_fullsized":"2023-10-03T10:09:48.772230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.730240+0000","last_change":"2023-10-03T10:09:48.375954+0000","last_active":"2023-10-03T10:09:48.730240+0000","last_peered":"2023-10-03T10:09:48.730240+0000","last_clean":"2023-10-03T10:09:48.730240+0000","last_became_active":"2023-10-03T10:09:48.375703+0000","last_became_peered":"2023-10-03T10:09:48.375703+0000","last_unstale":"2023-10-03T10:09:48.730240+0000","last_undegraded":"2023-10-03T10:09:48.730240+0000","last_fullsized":"2023-10-03T10:09:48.730240+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.768057+0000","last_change":"2023-10-03T10:09:48.762438+0000","last_active":"2023-10-03T10:09:48.768057+0000","last_peered":"2023-10-03T10:09:48.768057+0000","last_clean":"2023-10-03T10:09:48.768057+0000","last_became_active":"2023-10-03T10:09:48.758825+0000","last_became_peered":"2023-10-03T10:09:48.758825+0000","last_unstale":"2023-10-03T10:09:48.768057+0000","last_undegraded":"2023-10-03T10:09:48.768057+0000","last_fullsized":"2023-10-03T10:09:48.768057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.744267+0000","last_change":"2023-10-03T10:09:48.377186+0000","last_active":"2023-10-03T10:09:48.744267+0000","last_peered":"2023-10-03T10:09:48.744267+0000","last_clean":"2023-10-03T10:09:48.744267+0000","last_became_active":"2023-10-03T10:09:48.376584+0000","last_became_peered":"2023-10-03T10:09:48.376584+0000","last_unstale":"2023-10-03T10:09:48.744267+0000","last_undegraded":"2023-10-03T10:09:48.744267+0000","last_fullsized":"2023-10-03T10:09:48.744267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765361+0000","last_change":"2023-10-03T10:09:48.762792+0000","last_active":"2023-10-03T10:09:48.765361+0000","last_peered":"2023-10-03T10:09:48.765361+0000","last_clean":"2023-10-03T10:09:48.765361+0000","last_became_active":"2023-10-03T10:09:48.762334+0000","last_became_peered":"2023-10-03T10:09:48.762334+0000","last_unstale":"2023-10-03T10:09:48.765361+0000","last_undegraded":"2023-10-03T10:09:48.765361+0000","last_fullsized":"2023-10-03T10:09:48.765361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.774974+0000","last_change":"2023-10-03T10:09:48.370604+0000","last_active":"2023-10-03T10:09:48.774974+0000","last_peered":"2023-10-03T10:09:48.774974+0000","last_clean":"2023-10-03T10:09:48.774974+0000","last_became_active":"2023-10-03T10:09:48.370305+0000","last_became_peered":"2023-10-03T10:09:48.370305+0000","last_unstale":"2023-10-03T10:09:48.774974+0000","last_undegraded":"2023-10-03T10:09:48.774974+0000","last_fullsized":"2023-10-03T10:09:48.774974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.760581+0000","last_change":"2023-10-03T10:09:48.758807+0000","last_active":"2023-10-03T10:09:48.760581+0000","last_peered":"2023-10-03T10:09:48.760581+0000","last_clean":"2023-10-03T10:09:48.760581+0000","last_became_active":"2023-10-03T10:09:48.757966+0000","last_became_peered":"2023-10-03T10:09:48.757966+0000","last_unstale":"2023-10-03T10:09:48.760581+0000","last_undegraded":"2023-10-03T10:09:48.760581+0000","last_fullsized":"2023-10-03T10:09:48.760581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.769478+0000","last_change":"2023-10-03T10:09:48.367621+0000","last_active":"2023-10-03T10:09:48.769478+0000","last_peered":"2023-10-03T10:09:48.769478+0000","last_clean":"2023-10-03T10:09:48.769478+0000","last_became_active":"2023-10-03T10:09:48.367354+0000","last_became_peered":"2023-10-03T10:09:48.367354+0000","last_unstale":"2023-10-03T10:09:48.769478+0000","last_undegraded":"2023-10-03T10:09:48.769478+0000","last_fullsized":"2023-10-03T10:09:48.769478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.768658+0000","last_change":"2023-10-03T10:09:48.763072+0000","last_active":"2023-10-03T10:09:48.768658+0000","last_peered":"2023-10-03T10:09:48.768658+0000","last_clean":"2023-10-03T10:09:48.768658+0000","last_became_active":"2023-10-03T10:09:48.762225+0000","last_became_peered":"2023-10-03T10:09:48.762225+0000","last_unstale":"2023-10-03T10:09:48.768658+0000","last_undegraded":"2023-10-03T10:09:48.768658+0000","last_fullsized":"2023-10-03T10:09:48.768658+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.735600+0000","last_change":"2023-10-03T10:09:48.380634+0000","last_active":"2023-10-03T10:09:48.735600+0000","last_peered":"2023-10-03T10:09:48.735600+0000","last_clean":"2023-10-03T10:09:48.735600+0000","last_became_active":"2023-10-03T10:09:48.380317+0000","last_became_peered":"2023-10-03T10:09:48.380317+0000","last_unstale":"2023-10-03T10:09:48.735600+0000","last_undegraded":"2023-10-03T10:09:48.735600+0000","last_fullsized":"2023-10-03T10:09:48.735600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.774942+0000","last_change":"2023-10-03T10:09:48.769900+0000","last_active":"2023-10-03T10:09:48.774942+0000","last_peered":"2023-10-03T10:09:48.774942+0000","last_clean":"2023-10-03T10:09:48.774942+0000","last_became_active":"2023-10-03T10:09:48.769431+0000","last_became_peered":"2023-10-03T10:09:48.769431+0000","last_unstale":"2023-10-03T10:09:48.774942+0000","last_undegraded":"2023-10-03T10:09:48.774942+0000","last_fullsized":"2023-10-03T10:09:48.774942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.751633+0000","last_change":"2023-10-03T10:09:48.374660+0000","last_active":"2023-10-03T10:09:48.751633+0000","last_peered":"2023-10-03T10:09:48.751633+0000","last_clean":"2023-10-03T10:09:48.751633+0000","last_became_active":"2023-10-03T10:09:48.371590+0000","last_became_peered":"2023-10-03T10:09:48.371590+0000","last_unstale":"2023-10-03T10:09:48.751633+0000","last_undegraded":"2023-10-03T10:09:48.751633+0000","last_fullsized":"2023-10-03T10:09:48.751633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.769272+0000","last_change":"2023-10-03T10:09:48.758669+0000","last_active":"2023-10-03T10:09:48.769272+0000","last_peered":"2023-10-03T10:09:48.769272+0000","last_clean":"2023-10-03T10:09:48.769272+0000","last_became_active":"2023-10-03T10:09:48.758412+0000","last_became_peered":"2023-10-03T10:09:48.758412+0000","last_unstale":"2023-10-03T10:09:48.769272+0000","last_undegraded":"2023-10-03T10:09:48.769272+0000","last_fullsized":"2023-10-03T10:09:48.769272+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.761164+0000","last_change":"2023-10-03T10:09:48.369149+0000","last_active":"2023-10-03T10:09:48.761164+0000","last_peered":"2023-10-03T10:09:48.761164+0000","last_clean":"2023-10-03T10:09:48.761164+0000","last_became_active":"2023-10-03T10:09:48.368855+0000","last_became_peered":"2023-10-03T10:09:48.368855+0000","last_unstale":"2023-10-03T10:09:48.761164+0000","last_undegraded":"2023-10-03T10:09:48.761164+0000","last_fullsized":"2023-10-03T10:09:48.761164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.772373+0000","last_change":"2023-10-03T10:09:48.767773+0000","last_active":"2023-10-03T10:09:48.772373+0000","last_peered":"2023-10-03T10:09:48.772373+0000","last_clean":"2023-10-03T10:09:48.772373+0000","last_became_active":"2023-10-03T10:09:48.767519+0000","last_became_peered":"2023-10-03T10:09:48.767519+0000","last_unstale":"2023-10-03T10:09:48.772373+0000","last_undegraded":"2023-10-03T10:09:48.772373+0000","last_fullsized":"2023-10-03T10:09:48.772373+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.746162+0000","last_change":"2023-10-03T10:09:48.377423+0000","last_active":"2023-10-03T10:09:48.746162+0000","last_peered":"2023-10-03T10:09:48.746162+0000","last_clean":"2023-10-03T10:09:48.746162+0000","last_became_active":"2023-10-03T10:09:48.376337+0000","last_became_peered":"2023-10-03T10:09:48.376337+0000","last_unstale":"2023-10-03T10:09:48.746162+0000","last_undegraded":"2023-10-03T10:09:48.746162+0000","last_fullsized":"2023-10-03T10:09:48.746162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.772277+0000","last_change":"2023-10-03T10:09:48.767141+0000","last_active":"2023-10-03T10:09:48.772277+0000","last_peered":"2023-10-03T10:09:48.772277+0000","last_clean":"2023-10-03T10:09:48.772277+0000","last_became_active":"2023-10-03T10:09:48.766563+0000","last_became_peered":"2023-10-03T10:09:48.766563+0000","last_unstale":"2023-10-03T10:09:48.772277+0000","last_undegraded":"2023-10-03T10:09:48.772277+0000","last_fullsized":"2023-10-03T10:09:48.772277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.745126+0000","last_change":"2023-10-03T10:09:48.370781+0000","last_active":"2023-10-03T10:09:48.745126+0000","last_peered":"2023-10-03T10:09:48.745126+0000","last_clean":"2023-10-03T10:09:48.745126+0000","last_became_active":"2023-10-03T10:09:48.370500+0000","last_became_peered":"2023-10-03T10:09:48.370500+0000","last_unstale":"2023-10-03T10:09:48.745126+0000","last_undegraded":"2023-10-03T10:09:48.745126+0000","last_fullsized":"2023-10-03T10:09:48.745126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765032+0000","last_change":"2023-10-03T10:09:48.762174+0000","last_active":"2023-10-03T10:09:48.765032+0000","last_peered":"2023-10-03T10:09:48.765032+0000","last_clean":"2023-10-03T10:09:48.765032+0000","last_became_active":"2023-10-03T10:09:48.761912+0000","last_became_peered":"2023-10-03T10:09:48.761912+0000","last_unstale":"2023-10-03T10:09:48.765032+0000","last_undegraded":"2023-10-03T10:09:48.765032+0000","last_fullsized":"2023-10-03T10:09:48.765032+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765774+0000","last_change":"2023-10-03T10:09:48.375317+0000","last_active":"2023-10-03T10:09:48.765774+0000","last_peered":"2023-10-03T10:09:48.765774+0000","last_clean":"2023-10-03T10:09:48.765774+0000","last_became_active":"2023-10-03T10:09:48.375033+0000","last_became_peered":"2023-10-03T10:09:48.375033+0000","last_unstale":"2023-10-03T10:09:48.765774+0000","last_undegraded":"2023-10-03T10:09:48.765774+0000","last_fullsized":"2023-10-03T10:09:48.765774+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.760927+0000","last_change":"2023-10-03T10:09:48.758357+0000","last_active":"2023-10-03T10:09:48.760927+0000","last_peered":"2023-10-03T10:09:48.760927+0000","last_clean":"2023-10-03T10:09:48.760927+0000","last_became_active":"2023-10-03T10:09:48.757940+0000","last_became_peered":"2023-10-03T10:09:48.757940+0000","last_unstale":"2023-10-03T10:09:48.760927+0000","last_undegraded":"2023-10-03T10:09:48.760927+0000","last_fullsized":"2023-10-03T10:09:48.760927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.734316+0000","last_change":"2023-10-03T10:09:48.376891+0000","last_active":"2023-10-03T10:09:48.734316+0000","last_peered":"2023-10-03T10:09:48.734316+0000","last_clean":"2023-10-03T10:09:48.734316+0000","last_became_active":"2023-10-03T10:09:48.376350+0000","last_became_peered":"2023-10-03T10:09:48.376350+0000","last_unstale":"2023-10-03T10:09:48.734316+0000","last_undegraded":"2023-10-03T10:09:48.734316+0000","last_fullsized":"2023-10-03T10:09:48.734316+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750404+0000","last_change":"2023-10-03T10:09:48.745699+0000","last_active":"2023-10-03T10:09:48.750404+0000","last_peered":"2023-10-03T10:09:48.750404+0000","last_clean":"2023-10-03T10:09:48.750404+0000","last_became_active":"2023-10-03T10:09:48.745452+0000","last_became_peered":"2023-10-03T10:09:48.745452+0000","last_unstale":"2023-10-03T10:09:48.750404+0000","last_undegraded":"2023-10-03T10:09:48.750404+0000","last_fullsized":"2023-10-03T10:09:48.750404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.764288+0000","last_change":"2023-10-03T10:09:48.376011+0000","last_active":"2023-10-03T10:09:48.764288+0000","last_peered":"2023-10-03T10:09:48.764288+0000","last_clean":"2023-10-03T10:09:48.764288+0000","last_became_active":"2023-10-03T10:09:48.375731+0000","last_became_peered":"2023-10-03T10:09:48.375731+0000","last_unstale":"2023-10-03T10:09:48.764288+0000","last_undegraded":"2023-10-03T10:09:48.764288+0000","last_fullsized":"2023-10-03T10:09:48.764288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.764030+0000","last_change":"2023-10-03T10:09:48.755197+0000","last_active":"2023-10-03T10:09:48.764030+0000","last_peered":"2023-10-03T10:09:48.764030+0000","last_clean":"2023-10-03T10:09:48.764030+0000","last_became_active":"2023-10-03T10:09:48.754954+0000","last_became_peered":"2023-10-03T10:09:48.754954+0000","last_unstale":"2023-10-03T10:09:48.764030+0000","last_undegraded":"2023-10-03T10:09:48.764030+0000","last_fullsized":"2023-10-03T10:09:48.764030+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.752673+0000","last_change":"2023-10-03T10:09:48.371687+0000","last_active":"2023-10-03T10:09:48.752673+0000","last_peered":"2023-10-03T10:09:48.752673+0000","last_clean":"2023-10-03T10:09:48.752673+0000","last_became_active":"2023-10-03T10:09:48.371207+0000","last_became_peered":"2023-10-03T10:09:48.371207+0000","last_unstale":"2023-10-03T10:09:48.752673+0000","last_undegraded":"2023-10-03T10:09:48.752673+0000","last_fullsized":"2023-10-03T10:09:48.752673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.770216+0000","last_change":"2023-10-03T10:09:48.766338+0000","last_active":"2023-10-03T10:09:48.770216+0000","last_peered":"2023-10-03T10:09:48.770216+0000","last_clean":"2023-10-03T10:09:48.770216+0000","last_became_active":"2023-10-03T10:09:48.765944+0000","last_became_peered":"2023-10-03T10:09:48.765944+0000","last_unstale":"2023-10-03T10:09:48.770216+0000","last_undegraded":"2023-10-03T10:09:48.770216+0000","last_fullsized":"2023-10-03T10:09:48.770216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.751181+0000","last_change":"2023-10-03T10:09:48.374804+0000","last_active":"2023-10-03T10:09:48.751181+0000","last_peered":"2023-10-03T10:09:48.751181+0000","last_clean":"2023-10-03T10:09:48.751181+0000","last_became_active":"2023-10-03T10:09:48.374469+0000","last_became_peered":"2023-10-03T10:09:48.374469+0000","last_unstale":"2023-10-03T10:09:48.751181+0000","last_undegraded":"2023-10-03T10:09:48.751181+0000","last_fullsized":"2023-10-03T10:09:48.751181+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.761534+0000","last_change":"2023-10-03T10:09:48.759354+0000","last_active":"2023-10-03T10:09:48.761534+0000","last_peered":"2023-10-03T10:09:48.761534+0000","last_clean":"2023-10-03T10:09:48.761534+0000","last_became_active":"2023-10-03T10:09:48.759106+0000","last_became_peered":"2023-10-03T10:09:48.759106+0000","last_unstale":"2023-10-03T10:09:48.761534+0000","last_undegraded":"2023-10-03T10:09:48.761534+0000","last_fullsized":"2023-10-03T10:09:48.761534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.748782+0000","last_change":"2023-10-03T10:09:48.379214+0000","last_active":"2023-10-03T10:09:48.748782+0000","last_peered":"2023-10-03T10:09:48.748782+0000","last_clean":"2023-10-03T10:09:48.748782+0000","last_became_active":"2023-10-03T10:09:48.378808+0000","last_became_peered":"2023-10-03T10:09:48.378808+0000","last_unstale":"2023-10-03T10:09:48.748782+0000","last_undegraded":"2023-10-03T10:09:48.748782+0000","last_fullsized":"2023-10-03T10:09:48.748782+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765242+0000","last_change":"2023-10-03T10:09:48.762823+0000","last_active":"2023-10-03T10:09:48.765242+0000","last_peered":"2023-10-03T10:09:48.765242+0000","last_clean":"2023-10-03T10:09:48.765242+0000","last_became_active":"2023-10-03T10:09:48.762544+0000","last_became_peered":"2023-10-03T10:09:48.762544+0000","last_unstale":"2023-10-03T10:09:48.765242+0000","last_undegraded":"2023-10-03T10:09:48.765242+0000","last_fullsized":"2023-10-03T10:09:48.765242+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.728742+0000","last_change":"2023-10-03T10:09:44.335057+0000","last_active":"2023-10-03T10:09:48.728742+0000","last_peered":"2023-10-03T10:09:48.728742+0000","last_clean":"2023-10-03T10:09:48.728742+0000","last_became_active":"2023-10-03T10:09:44.334848+0000","last_became_peered":"2023-10-03T10:09:44.334848+0000","last_unstale":"2023-10-03T10:09:48.728742+0000","last_undegraded":"2023-10-03T10:09:48.728742+0000","last_fullsized":"2023-10-03T10:09:48.728742+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.730142+0000","last_change":"2023-10-03T10:09:48.379615+0000","last_active":"2023-10-03T10:09:48.730142+0000","last_peered":"2023-10-03T10:09:48.730142+0000","last_clean":"2023-10-03T10:09:48.730142+0000","last_became_active":"2023-10-03T10:09:48.379353+0000","last_became_peered":"2023-10-03T10:09:48.379353+0000","last_unstale":"2023-10-03T10:09:48.730142+0000","last_undegraded":"2023-10-03T10:09:48.730142+0000","last_fullsized":"2023-10-03T10:09:48.730142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765341+0000","last_change":"2023-10-03T10:09:48.762628+0000","last_active":"2023-10-03T10:09:48.765341+0000","last_peered":"2023-10-03T10:09:48.765341+0000","last_clean":"2023-10-03T10:09:48.765341+0000","last_became_active":"2023-10-03T10:09:48.762007+0000","last_became_peered":"2023-10-03T10:09:48.762007+0000","last_unstale":"2023-10-03T10:09:48.765341+0000","last_undegraded":"2023-10-03T10:09:48.765341+0000","last_fullsized":"2023-10-03T10:09:48.765341+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.752509+0000","last_change":"2023-10-03T10:09:44.331820+0000","last_active":"2023-10-03T10:09:48.752509+0000","last_peered":"2023-10-03T10:09:48.752509+0000","last_clean":"2023-10-03T10:09:48.752509+0000","last_became_active":"2023-10-03T10:09:44.331226+0000","last_became_peered":"2023-10-03T10:09:44.331226+0000","last_unstale":"2023-10-03T10:09:48.752509+0000","last_undegraded":"2023-10-03T10:09:48.752509+0000","last_fullsized":"2023-10-03T10:09:48.752509+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.736338+0000","last_change":"2023-10-03T10:09:48.373278+0000","last_active":"2023-10-03T10:09:48.736338+0000","last_peered":"2023-10-03T10:09:48.736338+0000","last_clean":"2023-10-03T10:09:48.736338+0000","last_became_active":"2023-10-03T10:09:48.372993+0000","last_became_peered":"2023-10-03T10:09:48.372993+0000","last_unstale":"2023-10-03T10:09:48.736338+0000","last_undegraded":"2023-10-03T10:09:48.736338+0000","last_fullsized":"2023-10-03T10:09:48.736338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.749679+0000","last_change":"2023-10-03T10:09:48.742549+0000","last_active":"2023-10-03T10:09:48.749679+0000","last_peered":"2023-10-03T10:09:48.749679+0000","last_clean":"2023-10-03T10:09:48.749679+0000","last_became_active":"2023-10-03T10:09:48.740207+0000","last_became_peered":"2023-10-03T10:09:48.740207+0000","last_unstale":"2023-10-03T10:09:48.749679+0000","last_undegraded":"2023-10-03T10:09:48.749679+0000","last_fullsized":"2023-10-03T10:09:48.749679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.730019+0000","last_change":"2023-10-03T10:09:44.331573+0000","last_active":"2023-10-03T10:09:48.730019+0000","last_peered":"2023-10-03T10:09:48.730019+0000","last_clean":"2023-10-03T10:09:48.730019+0000","last_became_active":"2023-10-03T10:09:44.331265+0000","last_became_peered":"2023-10-03T10:09:44.331265+0000","last_unstale":"2023-10-03T10:09:48.730019+0000","last_undegraded":"2023-10-03T10:09:48.730019+0000","last_fullsized":"2023-10-03T10:09:48.730019+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.733325+0000","last_change":"2023-10-03T10:09:48.372153+0000","last_active":"2023-10-03T10:09:48.733325+0000","last_peered":"2023-10-03T10:09:48.733325+0000","last_clean":"2023-10-03T10:09:48.733325+0000","last_became_active":"2023-10-03T10:09:48.371868+0000","last_became_peered":"2023-10-03T10:09:48.371868+0000","last_unstale":"2023-10-03T10:09:48.733325+0000","last_undegraded":"2023-10-03T10:09:48.733325+0000","last_fullsized":"2023-10-03T10:09:48.733325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.758919+0000","last_change":"2023-10-03T10:09:48.745855+0000","last_active":"2023-10-03T10:09:48.758919+0000","last_peered":"2023-10-03T10:09:48.758919+0000","last_clean":"2023-10-03T10:09:48.758919+0000","last_became_active":"2023-10-03T10:09:48.745606+0000","last_became_peered":"2023-10-03T10:09:48.745606+0000","last_unstale":"2023-10-03T10:09:48.758919+0000","last_undegraded":"2023-10-03T10:09:48.758919+0000","last_fullsized":"2023-10-03T10:09:48.758919+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.752337+0000","last_change":"2023-10-03T10:09:44.331400+0000","last_active":"2023-10-03T10:09:48.752337+0000","last_peered":"2023-10-03T10:09:48.752337+0000","last_clean":"2023-10-03T10:09:48.752337+0000","last_became_active":"2023-10-03T10:09:44.331097+0000","last_became_peered":"2023-10-03T10:09:44.331097+0000","last_unstale":"2023-10-03T10:09:48.752337+0000","last_undegraded":"2023-10-03T10:09:48.752337+0000","last_fullsized":"2023-10-03T10:09:48.752337+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.733220+0000","last_change":"2023-10-03T10:09:44.334568+0000","last_active":"2023-10-03T10:09:48.733220+0000","last_peered":"2023-10-03T10:09:48.733220+0000","last_clean":"2023-10-03T10:09:48.733220+0000","last_became_active":"2023-10-03T10:09:44.333878+0000","last_became_peered":"2023-10-03T10:09:44.333878+0000","last_unstale":"2023-10-03T10:09:48.733220+0000","last_undegraded":"2023-10-03T10:09:48.733220+0000","last_fullsized":"2023-10-03T10:09:48.733220+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.752342+0000","last_change":"2023-10-03T10:09:48.371394+0000","last_active":"2023-10-03T10:09:48.752342+0000","last_peered":"2023-10-03T10:09:48.752342+0000","last_clean":"2023-10-03T10:09:48.752342+0000","last_became_active":"2023-10-03T10:09:48.371089+0000","last_became_peered":"2023-10-03T10:09:48.371089+0000","last_unstale":"2023-10-03T10:09:48.752342+0000","last_undegraded":"2023-10-03T10:09:48.752342+0000","last_fullsized":"2023-10-03T10:09:48.752342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.772251+0000","last_change":"2023-10-03T10:09:48.766928+0000","last_active":"2023-10-03T10:09:48.772251+0000","last_peered":"2023-10-03T10:09:48.772251+0000","last_clean":"2023-10-03T10:09:48.772251+0000","last_became_active":"2023-10-03T10:09:48.766090+0000","last_became_peered":"2023-10-03T10:09:48.766090+0000","last_unstale":"2023-10-03T10:09:48.772251+0000","last_undegraded":"2023-10-03T10:09:48.772251+0000","last_fullsized":"2023-10-03T10:09:48.772251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.749182+0000","last_change":"2023-10-03T10:09:44.333732+0000","last_active":"2023-10-03T10:09:48.749182+0000","last_peered":"2023-10-03T10:09:48.749182+0000","last_clean":"2023-10-03T10:09:48.749182+0000","last_became_active":"2023-10-03T10:09:44.333408+0000","last_became_peered":"2023-10-03T10:09:44.333408+0000","last_unstale":"2023-10-03T10:09:48.749182+0000","last_undegraded":"2023-10-03T10:09:48.749182+0000","last_fullsized":"2023-10-03T10:09:48.749182+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.732685+0000","last_change":"2023-10-03T10:09:48.369173+0000","last_active":"2023-10-03T10:09:48.732685+0000","last_peered":"2023-10-03T10:09:48.732685+0000","last_clean":"2023-10-03T10:09:48.732685+0000","last_became_active":"2023-10-03T10:09:48.368843+0000","last_became_peered":"2023-10-03T10:09:48.368843+0000","last_unstale":"2023-10-03T10:09:48.732685+0000","last_undegraded":"2023-10-03T10:09:48.732685+0000","last_fullsized":"2023-10-03T10:09:48.732685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750496+0000","last_change":"2023-10-03T10:09:48.747157+0000","last_active":"2023-10-03T10:09:48.750496+0000","last_peered":"2023-10-03T10:09:48.750496+0000","last_clean":"2023-10-03T10:09:48.750496+0000","last_became_active":"2023-10-03T10:09:48.745029+0000","last_became_peered":"2023-10-03T10:09:48.745029+0000","last_unstale":"2023-10-03T10:09:48.750496+0000","last_undegraded":"2023-10-03T10:09:48.750496+0000","last_fullsized":"2023-10-03T10:09:48.750496+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.753191+0000","last_change":"2023-10-03T10:09:44.329886+0000","last_active":"2023-10-03T10:09:48.753191+0000","last_peered":"2023-10-03T10:09:48.753191+0000","last_clean":"2023-10-03T10:09:48.753191+0000","last_became_active":"2023-10-03T10:09:44.329607+0000","last_became_peered":"2023-10-03T10:09:44.329607+0000","last_unstale":"2023-10-03T10:09:48.753191+0000","last_undegraded":"2023-10-03T10:09:48.753191+0000","last_fullsized":"2023-10-03T10:09:48.753191+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.728946+0000","last_change":"2023-10-03T10:09:48.371183+0000","last_active":"2023-10-03T10:09:48.728946+0000","last_peered":"2023-10-03T10:09:48.728946+0000","last_clean":"2023-10-03T10:09:48.728946+0000","last_became_active":"2023-10-03T10:09:48.370930+0000","last_became_peered":"2023-10-03T10:09:48.370930+0000","last_unstale":"2023-10-03T10:09:48.728946+0000","last_undegraded":"2023-10-03T10:09:48.728946+0000","last_fullsized":"2023-10-03T10:09:48.728946+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.748550+0000","last_change":"2023-10-03T10:09:48.743221+0000","last_active":"2023-10-03T10:09:48.748550+0000","last_peered":"2023-10-03T10:09:48.748550+0000","last_clean":"2023-10-03T10:09:48.748550+0000","last_became_active":"2023-10-03T10:09:48.742967+0000","last_became_peered":"2023-10-03T10:09:48.742967+0000","last_unstale":"2023-10-03T10:09:48.748550+0000","last_undegraded":"2023-10-03T10:09:48.748550+0000","last_fullsized":"2023-10-03T10:09:48.748550+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.769845+0000","last_change":"2023-10-03T10:09:48.371421+0000","last_active":"2023-10-03T10:09:48.769845+0000","last_peered":"2023-10-03T10:09:48.769845+0000","last_clean":"2023-10-03T10:09:48.769845+0000","last_became_active":"2023-10-03T10:09:48.371121+0000","last_became_peered":"2023-10-03T10:09:48.371121+0000","last_unstale":"2023-10-03T10:09:48.769845+0000","last_undegraded":"2023-10-03T10:09:48.769845+0000","last_fullsized":"2023-10-03T10:09:48.769845+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.730242+0000","last_change":"2023-10-03T10:09:44.334348+0000","last_active":"2023-10-03T10:09:48.730242+0000","last_peered":"2023-10-03T10:09:48.730242+0000","last_clean":"2023-10-03T10:09:48.730242+0000","last_became_active":"2023-10-03T10:09:44.333893+0000","last_became_peered":"2023-10-03T10:09:44.333893+0000","last_unstale":"2023-10-03T10:09:48.730242+0000","last_undegraded":"2023-10-03T10:09:48.730242+0000","last_fullsized":"2023-10-03T10:09:48.730242+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.772207+0000","last_change":"2023-10-03T10:09:48.766676+0000","last_active":"2023-10-03T10:09:48.772207+0000","last_peered":"2023-10-03T10:09:48.772207+0000","last_clean":"2023-10-03T10:09:48.772207+0000","last_became_active":"2023-10-03T10:09:48.766218+0000","last_became_peered":"2023-10-03T10:09:48.766218+0000","last_unstale":"2023-10-03T10:09:48.772207+0000","last_undegraded":"2023-10-03T10:09:48.772207+0000","last_fullsized":"2023-10-03T10:09:48.772207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.755224+0000","last_change":"2023-10-03T10:09:44.333678+0000","last_active":"2023-10-03T10:09:48.755224+0000","last_peered":"2023-10-03T10:09:48.755224+0000","last_clean":"2023-10-03T10:09:48.755224+0000","last_became_active":"2023-10-03T10:09:44.333326+0000","last_became_peered":"2023-10-03T10:09:44.333326+0000","last_unstale":"2023-10-03T10:09:48.755224+0000","last_undegraded":"2023-10-03T10:09:48.755224+0000","last_fullsized":"2023-10-03T10:09:48.755224+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.734248+0000","last_change":"2023-10-03T10:09:48.380501+0000","last_active":"2023-10-03T10:09:48.734248+0000","last_peered":"2023-10-03T10:09:48.734248+0000","last_clean":"2023-10-03T10:09:48.734248+0000","last_became_active":"2023-10-03T10:09:48.380205+0000","last_became_peered":"2023-10-03T10:09:48.380205+0000","last_unstale":"2023-10-03T10:09:48.734248+0000","last_undegraded":"2023-10-03T10:09:48.734248+0000","last_fullsized":"2023-10-03T10:09:48.734248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.763696+0000","last_change":"2023-10-03T10:09:48.760491+0000","last_active":"2023-10-03T10:09:48.763696+0000","last_peered":"2023-10-03T10:09:48.763696+0000","last_clean":"2023-10-03T10:09:48.763696+0000","last_became_active":"2023-10-03T10:09:48.760201+0000","last_became_peered":"2023-10-03T10:09:48.760201+0000","last_unstale":"2023-10-03T10:09:48.763696+0000","last_undegraded":"2023-10-03T10:09:48.763696+0000","last_fullsized":"2023-10-03T10:09:48.763696+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750298+0000","last_change":"2023-10-03T10:09:48.381420+0000","last_active":"2023-10-03T10:09:48.750298+0000","last_peered":"2023-10-03T10:09:48.750298+0000","last_clean":"2023-10-03T10:09:48.750298+0000","last_became_active":"2023-10-03T10:09:48.380776+0000","last_became_peered":"2023-10-03T10:09:48.380776+0000","last_unstale":"2023-10-03T10:09:48.750298+0000","last_undegraded":"2023-10-03T10:09:48.750298+0000","last_fullsized":"2023-10-03T10:09:48.750298+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.751210+0000","last_change":"2023-10-03T10:09:48.747044+0000","last_active":"2023-10-03T10:09:48.751210+0000","last_peered":"2023-10-03T10:09:48.751210+0000","last_clean":"2023-10-03T10:09:48.751210+0000","last_became_active":"2023-10-03T10:09:48.746598+0000","last_became_peered":"2023-10-03T10:09:48.746598+0000","last_unstale":"2023-10-03T10:09:48.751210+0000","last_undegraded":"2023-10-03T10:09:48.751210+0000","last_fullsized":"2023-10-03T10:09:48.751210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.749786+0000","last_change":"2023-10-03T10:09:48.368132+0000","last_active":"2023-10-03T10:09:48.749786+0000","last_peered":"2023-10-03T10:09:48.749786+0000","last_clean":"2023-10-03T10:09:48.749786+0000","last_became_active":"2023-10-03T10:09:48.367533+0000","last_became_peered":"2023-10-03T10:09:48.367533+0000","last_unstale":"2023-10-03T10:09:48.749786+0000","last_undegraded":"2023-10-03T10:09:48.749786+0000","last_fullsized":"2023-10-03T10:09:48.749786+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.761124+0000","last_change":"2023-10-03T10:09:48.758955+0000","last_active":"2023-10-03T10:09:48.761124+0000","last_peered":"2023-10-03T10:09:48.761124+0000","last_clean":"2023-10-03T10:09:48.761124+0000","last_became_active":"2023-10-03T10:09:48.758267+0000","last_became_peered":"2023-10-03T10:09:48.758267+0000","last_unstale":"2023-10-03T10:09:48.761124+0000","last_undegraded":"2023-10-03T10:09:48.761124+0000","last_fullsized":"2023-10-03T10:09:48.761124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.769773+0000","last_change":"2023-10-03T10:09:48.375975+0000","last_active":"2023-10-03T10:09:48.769773+0000","last_peered":"2023-10-03T10:09:48.769773+0000","last_clean":"2023-10-03T10:09:48.769773+0000","last_became_active":"2023-10-03T10:09:48.375693+0000","last_became_peered":"2023-10-03T10:09:48.375693+0000","last_unstale":"2023-10-03T10:09:48.769773+0000","last_undegraded":"2023-10-03T10:09:48.769773+0000","last_fullsized":"2023-10-03T10:09:48.769773+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.760912+0000","last_change":"2023-10-03T10:09:48.758192+0000","last_active":"2023-10-03T10:09:48.760912+0000","last_peered":"2023-10-03T10:09:48.760912+0000","last_clean":"2023-10-03T10:09:48.760912+0000","last_became_active":"2023-10-03T10:09:48.757614+0000","last_became_peered":"2023-10-03T10:09:48.757614+0000","last_unstale":"2023-10-03T10:09:48.760912+0000","last_undegraded":"2023-10-03T10:09:48.760912+0000","last_fullsized":"2023-10-03T10:09:48.760912+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765624+0000","last_change":"2023-10-03T10:09:48.370797+0000","last_active":"2023-10-03T10:09:48.765624+0000","last_peered":"2023-10-03T10:09:48.765624+0000","last_clean":"2023-10-03T10:09:48.765624+0000","last_became_active":"2023-10-03T10:09:48.370506+0000","last_became_peered":"2023-10-03T10:09:48.370506+0000","last_unstale":"2023-10-03T10:09:48.765624+0000","last_undegraded":"2023-10-03T10:09:48.765624+0000","last_fullsized":"2023-10-03T10:09:48.765624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.772278+0000","last_change":"2023-10-03T10:09:48.766806+0000","last_active":"2023-10-03T10:09:48.772278+0000","last_peered":"2023-10-03T10:09:48.772278+0000","last_clean":"2023-10-03T10:09:48.772278+0000","last_became_active":"2023-10-03T10:09:48.765599+0000","last_became_peered":"2023-10-03T10:09:48.765599+0000","last_unstale":"2023-10-03T10:09:48.772278+0000","last_undegraded":"2023-10-03T10:09:48.772278+0000","last_fullsized":"2023-10-03T10:09:48.772278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.746041+0000","last_change":"2023-10-03T10:09:48.377631+0000","last_active":"2023-10-03T10:09:48.746041+0000","last_peered":"2023-10-03T10:09:48.746041+0000","last_clean":"2023-10-03T10:09:48.746041+0000","last_became_active":"2023-10-03T10:09:48.377136+0000","last_became_peered":"2023-10-03T10:09:48.377136+0000","last_unstale":"2023-10-03T10:09:48.746041+0000","last_undegraded":"2023-10-03T10:09:48.746041+0000","last_fullsized":"2023-10-03T10:09:48.746041+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.751275+0000","last_change":"2023-10-03T10:09:48.747220+0000","last_active":"2023-10-03T10:09:48.751275+0000","last_peered":"2023-10-03T10:09:48.751275+0000","last_clean":"2023-10-03T10:09:48.751275+0000","last_became_active":"2023-10-03T10:09:48.746293+0000","last_became_peered":"2023-10-03T10:09:48.746293+0000","last_unstale":"2023-10-03T10:09:48.751275+0000","last_undegraded":"2023-10-03T10:09:48.751275+0000","last_fullsized":"2023-10-03T10:09:48.751275+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.761109+0000","last_change":"2023-10-03T10:09:48.743844+0000","last_active":"2023-10-03T10:09:48.761109+0000","last_peered":"2023-10-03T10:09:48.761109+0000","last_clean":"2023-10-03T10:09:48.761109+0000","last_became_active":"2023-10-03T10:09:48.743532+0000","last_became_peered":"2023-10-03T10:09:48.743532+0000","last_unstale":"2023-10-03T10:09:48.761109+0000","last_undegraded":"2023-10-03T10:09:48.761109+0000","last_fullsized":"2023-10-03T10:09:48.761109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.770063+0000","last_change":"2023-10-03T10:09:48.764395+0000","last_active":"2023-10-03T10:09:48.770063+0000","last_peered":"2023-10-03T10:09:48.770063+0000","last_clean":"2023-10-03T10:09:48.770063+0000","last_became_active":"2023-10-03T10:09:48.762670+0000","last_became_peered":"2023-10-03T10:09:48.762670+0000","last_unstale":"2023-10-03T10:09:48.770063+0000","last_undegraded":"2023-10-03T10:09:48.770063+0000","last_fullsized":"2023-10-03T10:09:48.770063+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.769199+0000","last_change":"2023-10-03T10:09:48.757466+0000","last_active":"2023-10-03T10:09:48.769199+0000","last_peered":"2023-10-03T10:09:48.769199+0000","last_clean":"2023-10-03T10:09:48.769199+0000","last_became_active":"2023-10-03T10:09:48.757197+0000","last_became_peered":"2023-10-03T10:09:48.757197+0000","last_unstale":"2023-10-03T10:09:48.769199+0000","last_undegraded":"2023-10-03T10:09:48.769199+0000","last_fullsized":"2023-10-03T10:09:48.769199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.770145+0000","last_change":"2023-10-03T10:09:48.766105+0000","last_active":"2023-10-03T10:09:48.770145+0000","last_peered":"2023-10-03T10:09:48.770145+0000","last_clean":"2023-10-03T10:09:48.770145+0000","last_became_active":"2023-10-03T10:09:48.765834+0000","last_became_peered":"2023-10-03T10:09:48.765834+0000","last_unstale":"2023-10-03T10:09:48.770145+0000","last_undegraded":"2023-10-03T10:09:48.770145+0000","last_fullsized":"2023-10-03T10:09:48.770145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.751117+0000","last_change":"2023-10-03T10:09:48.743916+0000","last_active":"2023-10-03T10:09:48.751117+0000","last_peered":"2023-10-03T10:09:48.751117+0000","last_clean":"2023-10-03T10:09:48.751117+0000","last_became_active":"2023-10-03T10:09:48.743646+0000","last_became_peered":"2023-10-03T10:09:48.743646+0000","last_unstale":"2023-10-03T10:09:48.751117+0000","last_undegraded":"2023-10-03T10:09:48.751117+0000","last_fullsized":"2023-10-03T10:09:48.751117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":46244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":46050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297248,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074592,"statfs":{"total":96636764160,"available":96332382208,"internally_reserved":0,"allocated":155648,"data_stored":45214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":45160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:09:56.390 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-03T10:09:56.390 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-03T10:09:56.390 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-03T10:09:56.390 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-03T10:09:56.391 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-03T10:09:56.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.538+0000 7f9027a19700 1 Processor -- start 2023-10-03T10:09:56.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.539+0000 7f9027a19700 1 -- start start 2023-10-03T10:09:56.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.539+0000 7f9027a19700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9020095da0 0x7f90200961c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.539+0000 7f9027a19700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f90200966b0 0x7f9020132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.539+0000 7f9027a19700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9020091980 con 0x7f9020062b00 2023-10-03T10:09:56.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.539+0000 7f9027a19700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90200973f0 con 0x7f90200966b0 2023-10-03T10:09:56.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.539+0000 7f9027a19700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9020062ee0 con 0x7f9020095da0 2023-10-03T10:09:56.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.539+0000 7f9024fb4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9020095da0 0x7f90200961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.539+0000 7f9025fb6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f90200966b0 0x7f9020132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.539+0000 7f90257b5700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9020062b00 0x7f9020095690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33582/0 (socket says 172.21.15.146:33582) 2023-10-03T10:09:56.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.539+0000 7f90257b5700 1 -- 172.21.15.146:0/931146311 learned_addr learned my addr 172.21.15.146:0/931146311 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:09:56.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.539+0000 7f9024fb4700 1 -- 172.21.15.146:0/931146311 >> v2:172.21.15.146:3300/0 conn(0x7f90200966b0 msgr2=0x7f9020132290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:56.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.540+0000 7f9024fb4700 1 --2- 172.21.15.146:0/931146311 >> v2:172.21.15.146:3300/0 conn(0x7f90200966b0 0x7f9020132290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.540+0000 7f9024fb4700 1 -- 172.21.15.146:0/931146311 >> v1:172.21.15.146:6789/0 conn(0x7f9020062b00 legacy=0x7f9020095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.540+0000 7f9024fb4700 1 -- 172.21.15.146:0/931146311 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9020092310 con 0x7f9020095da0 2023-10-03T10:09:56.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.540+0000 7f9017fff700 1 -- 172.21.15.146:0/931146311 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117451346 0 0) 0x7f9020091980 con 0x7f9020062b00 2023-10-03T10:09:56.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.540+0000 7f9025fb6700 1 --2- 172.21.15.146:0/931146311 >> v2:172.21.15.146:3300/0 conn(0x7f90200966b0 0x7f9020132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:56.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.540+0000 7f9024fb4700 1 --2- 172.21.15.146:0/931146311 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9020095da0 0x7f90200961c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f901c009790 tx=0x7f901c009060).ready entity=mon.1 client_cookie=ee3c0ef4990736ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:56.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.540+0000 7f9017fff700 1 -- 172.21.15.146:0/931146311 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c00f510 con 0x7f9020095da0 2023-10-03T10:09:56.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.540+0000 7f9017fff700 1 -- 172.21.15.146:0/931146311 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901c00f670 con 0x7f9020095da0 2023-10-03T10:09:56.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.540+0000 7f9017fff700 1 -- 172.21.15.146:0/931146311 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c00f9f0 con 0x7f9020095da0 2023-10-03T10:09:56.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.540+0000 7f9027a19700 1 -- 172.21.15.146:0/931146311 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9020095da0 msgr2=0x7f90200961c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.540+0000 7f9027a19700 1 --2- 172.21.15.146:0/931146311 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9020095da0 0x7f90200961c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f901c009790 tx=0x7f901c009060).stop 2023-10-03T10:09:56.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.540+0000 7f9027a19700 1 -- 172.21.15.146:0/931146311 shutdown_connections 2023-10-03T10:09:56.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.540+0000 7f9027a19700 1 --2- 172.21.15.146:0/931146311 >> v2:172.21.15.146:3300/0 conn(0x7f90200966b0 0x7f9020132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.540+0000 7f9027a19700 1 --2- 172.21.15.146:0/931146311 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9020095da0 0x7f90200961c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.540+0000 7f9027a19700 1 -- 172.21.15.146:0/931146311 >> 172.21.15.146:0/931146311 conn(0x7f902009aa50 msgr2=0x7f902009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:56.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.540+0000 7f9027a19700 1 -- 172.21.15.146:0/931146311 shutdown_connections 2023-10-03T10:09:56.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.540+0000 7f9027a19700 1 -- 172.21.15.146:0/931146311 wait complete. 2023-10-03T10:09:56.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.541+0000 7f9027a19700 1 Processor -- start 2023-10-03T10:09:56.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.541+0000 7f9027a19700 1 -- start start 2023-10-03T10:09:56.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.542+0000 7f9027a19700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9020062b00 0x7f902012d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.542+0000 7f9027a19700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9020095da0 0x7f9020115720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.542+0000 7f9027a19700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90200966b0 0x7f9020115c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.542+0000 7f9027a19700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9020118c20 con 0x7f90200966b0 2023-10-03T10:09:56.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.542+0000 7f9027a19700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9020119860 con 0x7f9020095da0 2023-10-03T10:09:56.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.542+0000 7f9027a19700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9020099bf0 con 0x7f9020062b00 2023-10-03T10:09:56.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.542+0000 7f9024fb4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9020095da0 0x7f9020115720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.542+0000 7f90257b5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9020062b00 0x7f902012d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.542+0000 7f9025fb6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90200966b0 0x7f9020115c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.542+0000 7f9024fb4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9020095da0 0x7f9020115720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58506/0 (socket says 172.21.15.146:58506) 2023-10-03T10:09:56.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.542+0000 7f9024fb4700 1 -- 172.21.15.146:0/1670352279 learned_addr learned my addr 172.21.15.146:0/1670352279 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:56.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.542+0000 7f90257b5700 1 -- 172.21.15.146:0/1670352279 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9020095da0 msgr2=0x7f9020115720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.542+0000 7f90257b5700 1 --2- 172.21.15.146:0/1670352279 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9020095da0 0x7f9020115720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.542+0000 7f90257b5700 1 -- 172.21.15.146:0/1670352279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90200966b0 msgr2=0x7f9020115c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.542+0000 7f90257b5700 1 --2- 172.21.15.146:0/1670352279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90200966b0 0x7f9020115c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.542+0000 7f90257b5700 1 -- 172.21.15.146:0/1670352279 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9018009a20 con 0x7f9020062b00 2023-10-03T10:09:56.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.542+0000 7f9024fb4700 1 --2- 172.21.15.146:0/1670352279 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9020095da0 0x7f9020115720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.542+0000 7f9025fb6700 1 --2- 172.21.15.146:0/1670352279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90200966b0 0x7f9020115c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.542+0000 7f90257b5700 1 --2- 172.21.15.146:0/1670352279 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9020062b00 0x7f902012d7c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9010000c00 tx=0x7f9010007b90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.543+0000 7f90157fa700 1 -- 172.21.15.146:0/1670352279 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90100070d0 con 0x7f9020062b00 2023-10-03T10:09:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.543+0000 7f90157fa700 1 -- 172.21.15.146:0/1670352279 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9010007250 con 0x7f9020062b00 2023-10-03T10:09:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.543+0000 7f9027a19700 1 -- 172.21.15.146:0/1670352279 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901c0092a0 con 0x7f9020062b00 2023-10-03T10:09:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.543+0000 7f90157fa700 1 -- 172.21.15.146:0/1670352279 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9010007610 con 0x7f9020062b00 2023-10-03T10:09:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.543+0000 7f9027a19700 1 -- 172.21.15.146:0/1670352279 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9020116b20 con 0x7f9020062b00 2023-10-03T10:09:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.544+0000 7f90157fa700 1 -- 172.21.15.146:0/1670352279 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f90100059b0 con 0x7f9020062b00 2023-10-03T10:09:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.544+0000 7f90157fa700 1 -- 172.21.15.146:0/1670352279 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f901003a5f0 con 0x7f9020062b00 2023-10-03T10:09:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.544+0000 7f9027a19700 1 -- 172.21.15.146:0/1670352279 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902005a260 con 0x7f9020062b00 2023-10-03T10:09:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.548+0000 7f90157fa700 1 -- 172.21.15.146:0/1670352279 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9010018030 con 0x7f9020062b00 2023-10-03T10:09:56.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.749+0000 7f9027a19700 1 -- 172.21.15.146:0/1670352279 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f9020046c20 con 0x7f9020062b00 2023-10-03T10:09:56.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.751+0000 7f90157fa700 1 -- 172.21.15.146:0/1670352279 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+64132 (secure 0 0 0) 0x7f9010013970 con 0x7f9020062b00 2023-10-03T10:09:56.753 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:56.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.753+0000 7f9027a19700 1 -- 172.21.15.146:0/1670352279 >> v1:172.21.15.146:6816/118159 conn(0x7f900402bb90 legacy=0x7f900402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.753+0000 7f9027a19700 1 -- 172.21.15.146:0/1670352279 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9020062b00 msgr2=0x7f902012d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.753+0000 7f9027a19700 1 --2- 172.21.15.146:0/1670352279 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9020062b00 0x7f902012d7c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9010000c00 tx=0x7f9010007b90).stop 2023-10-03T10:09:56.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.753+0000 7f9027a19700 1 -- 172.21.15.146:0/1670352279 shutdown_connections 2023-10-03T10:09:56.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.753+0000 7f9027a19700 1 --2- 172.21.15.146:0/1670352279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90200966b0 0x7f9020115c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.753+0000 7f9027a19700 1 --2- 172.21.15.146:0/1670352279 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9020062b00 0x7f902012d7c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.753+0000 7f9027a19700 1 --2- 172.21.15.146:0/1670352279 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9020095da0 0x7f9020115720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.753+0000 7f9027a19700 1 -- 172.21.15.146:0/1670352279 >> 172.21.15.146:0/1670352279 conn(0x7f902009aa50 msgr2=0x7f902012ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:56.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.753+0000 7f9027a19700 1 -- 172.21.15.146:0/1670352279 shutdown_connections 2023-10-03T10:09:56.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.753+0000 7f9027a19700 1 -- 172.21.15.146:0/1670352279 wait complete. 2023-10-03T10:09:56.766 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":4,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6816","nonce":118159}]},"active_addr":"172.21.15.146:6816/118159","active_change":"2023-10-03T10:09:38.282856+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":45915595}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":1896339219}]}]} 2023-10-03T10:09:56.768 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-03T10:09:56.768 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:09:56.768 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:56.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.882+0000 7f2afe1b7700 1 Processor -- start 2023-10-03T10:09:56.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.882+0000 7f2afe1b7700 1 -- start start 2023-10-03T10:09:56.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.883+0000 7f2afe1b7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2af8095da0 0x7f2af80961c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.883+0000 7f2afe1b7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2af80966b0 0x7f2af8132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.883+0000 7f2afe1b7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af8091980 con 0x7f2af8062b00 2023-10-03T10:09:56.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.883+0000 7f2afe1b7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af80973f0 con 0x7f2af8095da0 2023-10-03T10:09:56.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.883+0000 7f2afe1b7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2af8062ee0 con 0x7f2af80966b0 2023-10-03T10:09:56.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.883+0000 7f2af6ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2af8095da0 0x7f2af80961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.883+0000 7f2af6ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2af8095da0 0x7f2af80961c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46964/0 (socket says 172.21.15.146:46964) 2023-10-03T10:09:56.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.883+0000 7f2af7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2af80966b0 0x7f2af8132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.883+0000 7f2af6ffd700 1 -- 172.21.15.146:0/588766885 learned_addr learned my addr 172.21.15.146:0/588766885 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:56.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.883+0000 7f2af77fe700 1 --1- 172.21.15.146:0/588766885 >> v1:172.21.15.146:6789/0 conn(0x7f2af8062b00 0x7f2af8095690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33596/0 (socket says 172.21.15.146:33596) 2023-10-03T10:09:56.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.883+0000 7f2af7fff700 1 -- 172.21.15.146:0/588766885 >> v2:172.21.15.146:3300/0 conn(0x7f2af8095da0 msgr2=0x7f2af80961c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:56.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.883+0000 7f2af7fff700 1 --2- 172.21.15.146:0/588766885 >> v2:172.21.15.146:3300/0 conn(0x7f2af8095da0 0x7f2af80961c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.883+0000 7f2af7fff700 1 -- 172.21.15.146:0/588766885 >> v1:172.21.15.146:6789/0 conn(0x7f2af8062b00 legacy=0x7f2af8095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.883+0000 7f2af7fff700 1 -- 172.21.15.146:0/588766885 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af8092310 con 0x7f2af80966b0 2023-10-03T10:09:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.883+0000 7f2af6ffd700 1 --2- 172.21.15.146:0/588766885 >> v2:172.21.15.146:3300/0 conn(0x7f2af8095da0 0x7f2af80961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.883+0000 7f2af7fff700 1 --2- 172.21.15.146:0/588766885 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2af80966b0 0x7f2af8132290 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f2af0009e60 tx=0x7f2af0009780).ready entity=mon.2 client_cookie=7bcc28b541da6c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.884+0000 7f2af67fc700 1 -- 172.21.15.146:0/588766885 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af000e070 con 0x7f2af80966b0 2023-10-03T10:09:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.884+0000 7f2af67fc700 1 -- 172.21.15.146:0/588766885 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af000bb60 con 0x7f2af80966b0 2023-10-03T10:09:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.884+0000 7f2af67fc700 1 -- 172.21.15.146:0/588766885 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0012410 con 0x7f2af80966b0 2023-10-03T10:09:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.884+0000 7f2afe1b7700 1 -- 172.21.15.146:0/588766885 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2af80966b0 msgr2=0x7f2af8132290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.884+0000 7f2afe1b7700 1 --2- 172.21.15.146:0/588766885 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2af80966b0 0x7f2af8132290 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f2af0009e60 tx=0x7f2af0009780).stop 2023-10-03T10:09:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.884+0000 7f2afe1b7700 1 -- 172.21.15.146:0/588766885 shutdown_connections 2023-10-03T10:09:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.884+0000 7f2afe1b7700 1 --2- 172.21.15.146:0/588766885 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2af80966b0 0x7f2af8132290 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.884+0000 7f2afe1b7700 1 --2- 172.21.15.146:0/588766885 >> v2:172.21.15.146:3300/0 conn(0x7f2af8095da0 0x7f2af80961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.884+0000 7f2afe1b7700 1 -- 172.21.15.146:0/588766885 >> 172.21.15.146:0/588766885 conn(0x7f2af809aa50 msgr2=0x7f2af809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:56.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.884+0000 7f2afe1b7700 1 -- 172.21.15.146:0/588766885 shutdown_connections 2023-10-03T10:09:56.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.884+0000 7f2afe1b7700 1 -- 172.21.15.146:0/588766885 wait complete. 2023-10-03T10:09:56.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.885+0000 7f2afe1b7700 1 Processor -- start 2023-10-03T10:09:56.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.885+0000 7f2afe1b7700 1 -- start start 2023-10-03T10:09:56.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2afe1b7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2af8062b00 0x7f2af81191f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2afe1b7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2af8095da0 0x7f2af81152a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2afe1b7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2af80966b0 0x7f2af8115790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2afe1b7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af8096da0 con 0x7f2af80966b0 2023-10-03T10:09:56.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2afe1b7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af812d390 con 0x7f2af8095da0 2023-10-03T10:09:56.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2afe1b7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2af8118cf0 con 0x7f2af8062b00 2023-10-03T10:09:56.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2af77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2af8062b00 0x7f2af81191f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2af7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2af80966b0 0x7f2af8115790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2af7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2af80966b0 0x7f2af8115790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46970/0 (socket says 172.21.15.146:46970) 2023-10-03T10:09:56.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2af77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2af8062b00 0x7f2af81191f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36562/0 (socket says 172.21.15.146:36562) 2023-10-03T10:09:56.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2af7fff700 1 -- 172.21.15.146:0/2801519440 learned_addr learned my addr 172.21.15.146:0/2801519440 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:56.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2af6ffd700 1 --2- 172.21.15.146:0/2801519440 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2af8095da0 0x7f2af81152a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2af7fff700 1 -- 172.21.15.146:0/2801519440 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2af8062b00 msgr2=0x7f2af81191f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2af7fff700 1 --2- 172.21.15.146:0/2801519440 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2af8062b00 0x7f2af81191f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2af7fff700 1 -- 172.21.15.146:0/2801519440 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2af8095da0 msgr2=0x7f2af81152a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2af7fff700 1 --2- 172.21.15.146:0/2801519440 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2af8095da0 0x7f2af81152a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2af7fff700 1 -- 172.21.15.146:0/2801519440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae0009370 con 0x7f2af80966b0 2023-10-03T10:09:56.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2af6ffd700 1 --2- 172.21.15.146:0/2801519440 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2af8095da0 0x7f2af81152a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:56.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2af77fe700 1 --2- 172.21.15.146:0/2801519440 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2af8062b00 0x7f2af81191f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:56.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2af7fff700 1 --2- 172.21.15.146:0/2801519440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2af80966b0 0x7f2af8115790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f2af000b6c0 tx=0x7f2af0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:56.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2aef7fe700 1 -- 172.21.15.146:0/2801519440 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0021070 con 0x7f2af80966b0 2023-10-03T10:09:56.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2aef7fe700 1 -- 172.21.15.146:0/2801519440 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af00094a0 con 0x7f2af80966b0 2023-10-03T10:09:56.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2afe1b7700 1 -- 172.21.15.146:0/2801519440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af0009a20 con 0x7f2af80966b0 2023-10-03T10:09:56.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2aef7fe700 1 -- 172.21.15.146:0/2801519440 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af001d880 con 0x7f2af80966b0 2023-10-03T10:09:56.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.886+0000 7f2afe1b7700 1 -- 172.21.15.146:0/2801519440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af8118750 con 0x7f2af80966b0 2023-10-03T10:09:56.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.887+0000 7f2aef7fe700 1 -- 172.21.15.146:0/2801519440 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f2af0003040 con 0x7f2af80966b0 2023-10-03T10:09:56.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.887+0000 7f2aef7fe700 1 -- 172.21.15.146:0/2801519440 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f2af003cf40 con 0x7f2af80966b0 2023-10-03T10:09:56.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.887+0000 7f2afe1b7700 1 -- 172.21.15.146:0/2801519440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af8118950 con 0x7f2af80966b0 2023-10-03T10:09:56.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:56.892+0000 7f2aef7fe700 1 -- 172.21.15.146:0/2801519440 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f2af8118950 con 0x7f2af80966b0 2023-10-03T10:09:57.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.051+0000 7f2afe1b7700 1 -- 172.21.15.146:0/2801519440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2af8118950 con 0x7f2af80966b0 2023-10-03T10:09:57.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.052+0000 7f2aef7fe700 1 -- 172.21.15.146:0/2801519440 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11373 (secure 0 0 0) 0x7f2af8118950 con 0x7f2af80966b0 2023-10-03T10:09:57.052 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:57.053 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":16,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:09:49.722394+0000","last_up_change":"2023-10-03T10:09:42.301022+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":118758}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":118758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":118758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":118758}]},"public_addr":"172.21.15.146:6800/118758","cluster_addr":"172.21.15.146:6801/118758","heartbeat_back_addr":"172.21.15.146:6803/118758","heartbeat_front_addr":"172.21.15.146:6802/118758","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":118774}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":118774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":118774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":118774}]},"public_addr":"172.21.15.146:6804/118774","cluster_addr":"172.21.15.146:6806/118774","heartbeat_back_addr":"172.21.15.146:6810/118774","heartbeat_front_addr":"172.21.15.146:6808/118774","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":118775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":118775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":118775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":118775}]},"public_addr":"172.21.15.146:6805/118775","cluster_addr":"172.21.15.146:6807/118775","heartbeat_back_addr":"172.21.15.146:6811/118775","heartbeat_front_addr":"172.21.15.146:6809/118775","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":118776}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":118776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":118776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":118776}]},"public_addr":"172.21.15.146:6812/118776","cluster_addr":"172.21.15.146:6813/118776","heartbeat_back_addr":"172.21.15.146:6815/118776","heartbeat_front_addr":"172.21.15.146:6814/118776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:57.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.053+0000 7f2afe1b7700 1 -- 172.21.15.146:0/2801519440 >> v1:172.21.15.146:6816/118159 conn(0x7f2ad802bb60 legacy=0x7f2ad802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.053+0000 7f2afe1b7700 1 -- 172.21.15.146:0/2801519440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2af80966b0 msgr2=0x7f2af8115790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.053+0000 7f2afe1b7700 1 --2- 172.21.15.146:0/2801519440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2af80966b0 0x7f2af8115790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f2af000b6c0 tx=0x7f2af0009780).stop 2023-10-03T10:09:57.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.053+0000 7f2afe1b7700 1 -- 172.21.15.146:0/2801519440 shutdown_connections 2023-10-03T10:09:57.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.053+0000 7f2afe1b7700 1 --2- 172.21.15.146:0/2801519440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2af80966b0 0x7f2af8115790 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.053+0000 7f2afe1b7700 1 --2- 172.21.15.146:0/2801519440 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2af8062b00 0x7f2af81191f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.053+0000 7f2afe1b7700 1 --2- 172.21.15.146:0/2801519440 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2af8095da0 0x7f2af81152a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.053+0000 7f2afe1b7700 1 -- 172.21.15.146:0/2801519440 >> 172.21.15.146:0/2801519440 conn(0x7f2af809aa50 msgr2=0x7f2af812fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.053+0000 7f2afe1b7700 1 -- 172.21.15.146:0/2801519440 shutdown_connections 2023-10-03T10:09:57.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.053+0000 7f2afe1b7700 1 -- 172.21.15.146:0/2801519440 wait complete. 2023-10-03T10:09:57.066 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:09:57.066 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:57.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.181+0000 7fa07b0a1700 1 Processor -- start 2023-10-03T10:09:57.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.181+0000 7fa07b0a1700 1 -- start start 2023-10-03T10:09:57.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.181+0000 7fa07b0a1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa074062b00 0x7fa074095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.181+0000 7fa07b0a1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa074095b80 0x7fa074095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.181+0000 7fa07b0a1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa074096490 0x7fa074131280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.181+0000 7fa07b0a1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0740973f0 con 0x7fa074095b80 2023-10-03T10:09:57.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.181+0000 7fa07b0a1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa074062ee0 con 0x7fa074062b00 2023-10-03T10:09:57.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.181+0000 7fa07b0a1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa074091980 con 0x7fa074096490 2023-10-03T10:09:57.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.181+0000 7fa073fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa074095b80 0x7fa074095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.181+0000 7fa078e3d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa074062b00 0x7fa074095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.181+0000 7fa07963e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa074096490 0x7fa074131280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.181+0000 7fa073fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa074095b80 0x7fa074095fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46978/0 (socket says 172.21.15.146:46978) 2023-10-03T10:09:57.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.181+0000 7fa078e3d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa074062b00 0x7fa074095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58528/0 (socket says 172.21.15.146:58528) 2023-10-03T10:09:57.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.181+0000 7fa073fff700 1 -- 172.21.15.146:0/295562447 learned_addr learned my addr 172.21.15.146:0/295562447 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:57.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.182+0000 7fa07963e700 1 -- 172.21.15.146:0/295562447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa074062b00 msgr2=0x7fa074095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:57.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.182+0000 7fa07963e700 1 --2- 172.21.15.146:0/295562447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa074062b00 0x7fa074095690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.182+0000 7fa07963e700 1 -- 172.21.15.146:0/295562447 >> v2:172.21.15.146:3300/0 conn(0x7fa074095b80 msgr2=0x7fa074095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:57.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.182+0000 7fa07963e700 1 --2- 172.21.15.146:0/295562447 >> v2:172.21.15.146:3300/0 conn(0x7fa074095b80 0x7fa074095fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.182+0000 7fa07963e700 1 -- 172.21.15.146:0/295562447 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa074092310 con 0x7fa074096490 2023-10-03T10:09:57.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.182+0000 7fa078e3d700 1 --2- 172.21.15.146:0/295562447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa074062b00 0x7fa074095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:57.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.182+0000 7fa073fff700 1 --2- 172.21.15.146:0/295562447 >> v2:172.21.15.146:3300/0 conn(0x7fa074095b80 0x7fa074095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:57.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.182+0000 7fa07963e700 1 --2- 172.21.15.146:0/295562447 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa074096490 0x7fa074131280 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fa06c009e90 tx=0x7fa06c009780).ready entity=mon.2 client_cookie=9754d1cfa5e47ce6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.182+0000 7fa0737fe700 1 -- 172.21.15.146:0/295562447 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c00e070 con 0x7fa074096490 2023-10-03T10:09:57.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.182+0000 7fa0737fe700 1 -- 172.21.15.146:0/295562447 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06c00ba70 con 0x7fa074096490 2023-10-03T10:09:57.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.182+0000 7fa0737fe700 1 -- 172.21.15.146:0/295562447 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c00bdf0 con 0x7fa074096490 2023-10-03T10:09:57.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.183+0000 7fa07b0a1700 1 -- 172.21.15.146:0/295562447 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa074096490 msgr2=0x7fa074131280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.183+0000 7fa07b0a1700 1 --2- 172.21.15.146:0/295562447 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa074096490 0x7fa074131280 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fa06c009e90 tx=0x7fa06c009780).stop 2023-10-03T10:09:57.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.183+0000 7fa07b0a1700 1 -- 172.21.15.146:0/295562447 shutdown_connections 2023-10-03T10:09:57.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.183+0000 7fa07b0a1700 1 --2- 172.21.15.146:0/295562447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa074062b00 0x7fa074095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.183+0000 7fa07b0a1700 1 --2- 172.21.15.146:0/295562447 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa074096490 0x7fa074131280 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.183+0000 7fa07b0a1700 1 --2- 172.21.15.146:0/295562447 >> v2:172.21.15.146:3300/0 conn(0x7fa074095b80 0x7fa074095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.183+0000 7fa07b0a1700 1 -- 172.21.15.146:0/295562447 >> 172.21.15.146:0/295562447 conn(0x7fa07409aa50 msgr2=0x7fa07409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.183+0000 7fa07b0a1700 1 -- 172.21.15.146:0/295562447 shutdown_connections 2023-10-03T10:09:57.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.183+0000 7fa07b0a1700 1 -- 172.21.15.146:0/295562447 wait complete. 2023-10-03T10:09:57.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.183+0000 7fa07b0a1700 1 Processor -- start 2023-10-03T10:09:57.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.184+0000 7fa07b0a1700 1 -- start start 2023-10-03T10:09:57.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.184+0000 7fa07b0a1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa074062b00 0x7fa07411a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.184+0000 7fa07b0a1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa074095b80 0x7fa0741166e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.184+0000 7fa07b0a1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa074096490 0x7fa074116bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.184+0000 7fa07b0a1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa074096da0 con 0x7fa074062b00 2023-10-03T10:09:57.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.184+0000 7fa07b0a1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07412d810 con 0x7fa074095b80 2023-10-03T10:09:57.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.184+0000 7fa07b0a1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa07411a180 con 0x7fa074096490 2023-10-03T10:09:57.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.184+0000 7fa073fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa074095b80 0x7fa0741166e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.184+0000 7fa078e3d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa074062b00 0x7fa07411a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.184+0000 7fa073fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa074095b80 0x7fa0741166e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58530/0 (socket says 172.21.15.146:58530) 2023-10-03T10:09:57.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.184+0000 7fa07963e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa074096490 0x7fa074116bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.184+0000 7fa073fff700 1 -- 172.21.15.146:0/3088369713 learned_addr learned my addr 172.21.15.146:0/3088369713 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:57.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.184+0000 7fa078e3d700 1 -- 172.21.15.146:0/3088369713 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa074096490 msgr2=0x7fa074116bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.184+0000 7fa078e3d700 1 --2- 172.21.15.146:0/3088369713 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa074096490 0x7fa074116bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.184+0000 7fa078e3d700 1 -- 172.21.15.146:0/3088369713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa074095b80 msgr2=0x7fa0741166e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.184+0000 7fa078e3d700 1 --2- 172.21.15.146:0/3088369713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa074095b80 0x7fa0741166e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.184+0000 7fa078e3d700 1 -- 172.21.15.146:0/3088369713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0680092a0 con 0x7fa074062b00 2023-10-03T10:09:57.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.185+0000 7fa078e3d700 1 --2- 172.21.15.146:0/3088369713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa074062b00 0x7fa07411a680 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fa06800e980 tx=0x7fa068009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.185+0000 7fa070ff9700 1 -- 172.21.15.146:0/3088369713 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa068012600 con 0x7fa074062b00 2023-10-03T10:09:57.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.185+0000 7fa070ff9700 1 -- 172.21.15.146:0/3088369713 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa068012760 con 0x7fa074062b00 2023-10-03T10:09:57.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.185+0000 7fa07b0a1700 1 -- 172.21.15.146:0/3088369713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa060009370 con 0x7fa074062b00 2023-10-03T10:09:57.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.185+0000 7fa070ff9700 1 -- 172.21.15.146:0/3088369713 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa068012ae0 con 0x7fa074062b00 2023-10-03T10:09:57.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.185+0000 7fa07b0a1700 1 -- 172.21.15.146:0/3088369713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa06c009a20 con 0x7fa074062b00 2023-10-03T10:09:57.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.185+0000 7fa070ff9700 1 -- 172.21.15.146:0/3088369713 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fa06801b400 con 0x7fa074062b00 2023-10-03T10:09:57.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.186+0000 7fa070ff9700 1 -- 172.21.15.146:0/3088369713 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa06803b100 con 0x7fa074062b00 2023-10-03T10:09:57.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.186+0000 7fa07b0a1700 1 -- 172.21.15.146:0/3088369713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa074119de0 con 0x7fa074062b00 2023-10-03T10:09:57.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.190+0000 7fa070ff9700 1 -- 172.21.15.146:0/3088369713 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fa074119de0 con 0x7fa074062b00 2023-10-03T10:09:57.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.347+0000 7fa07b0a1700 1 -- 172.21.15.146:0/3088369713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa074119de0 con 0x7fa074062b00 2023-10-03T10:09:57.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.348+0000 7fa070ff9700 1 -- 172.21.15.146:0/3088369713 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11373 (secure 0 0 0) 0x7fa074119de0 con 0x7fa074062b00 2023-10-03T10:09:57.349 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:57.349 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":16,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:09:49.722394+0000","last_up_change":"2023-10-03T10:09:42.301022+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":118758}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":118758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":118758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":118758}]},"public_addr":"172.21.15.146:6800/118758","cluster_addr":"172.21.15.146:6801/118758","heartbeat_back_addr":"172.21.15.146:6803/118758","heartbeat_front_addr":"172.21.15.146:6802/118758","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":118774}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":118774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":118774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":118774}]},"public_addr":"172.21.15.146:6804/118774","cluster_addr":"172.21.15.146:6806/118774","heartbeat_back_addr":"172.21.15.146:6810/118774","heartbeat_front_addr":"172.21.15.146:6808/118774","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":118775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":118775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":118775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":118775}]},"public_addr":"172.21.15.146:6805/118775","cluster_addr":"172.21.15.146:6807/118775","heartbeat_back_addr":"172.21.15.146:6811/118775","heartbeat_front_addr":"172.21.15.146:6809/118775","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":118776}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":118776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":118776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":118776}]},"public_addr":"172.21.15.146:6812/118776","cluster_addr":"172.21.15.146:6813/118776","heartbeat_back_addr":"172.21.15.146:6815/118776","heartbeat_front_addr":"172.21.15.146:6814/118776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:57.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.350+0000 7fa07b0a1700 1 -- 172.21.15.146:0/3088369713 >> v1:172.21.15.146:6816/118159 conn(0x7fa05802bb30 legacy=0x7fa05802dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.350+0000 7fa07b0a1700 1 -- 172.21.15.146:0/3088369713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa074062b00 msgr2=0x7fa07411a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.350+0000 7fa07b0a1700 1 --2- 172.21.15.146:0/3088369713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa074062b00 0x7fa07411a680 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fa06800e980 tx=0x7fa068009060).stop 2023-10-03T10:09:57.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.350+0000 7fa07b0a1700 1 -- 172.21.15.146:0/3088369713 shutdown_connections 2023-10-03T10:09:57.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.350+0000 7fa07b0a1700 1 --2- 172.21.15.146:0/3088369713 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa074096490 0x7fa074116bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.350+0000 7fa07b0a1700 1 --2- 172.21.15.146:0/3088369713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa074062b00 0x7fa07411a680 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.350+0000 7fa07b0a1700 1 --2- 172.21.15.146:0/3088369713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa074095b80 0x7fa0741166e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.350+0000 7fa07b0a1700 1 -- 172.21.15.146:0/3088369713 >> 172.21.15.146:0/3088369713 conn(0x7fa07409aa50 msgr2=0x7fa074097540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.350+0000 7fa07b0a1700 1 -- 172.21.15.146:0/3088369713 shutdown_connections 2023-10-03T10:09:57.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.350+0000 7fa07b0a1700 1 -- 172.21.15.146:0/3088369713 wait complete. 2023-10-03T10:09:57.363 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-03T10:09:57.364 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-03T10:09:57.364 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-03T10:09:57.364 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-03T10:09:57.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.489+0000 7fd31057f700 1 Processor -- start 2023-10-03T10:09:57.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.489+0000 7fb55d783700 1 Processor -- start 2023-10-03T10:09:57.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.489+0000 7fd31057f700 1 -- start start 2023-10-03T10:09:57.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.489+0000 7fb55d783700 1 -- start start 2023-10-03T10:09:57.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.490+0000 7fd31057f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd308092390 0x7fd308097aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.490+0000 7fb55d783700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb558062b00 0x7fb558125900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.490+0000 7fb55d783700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb558125400 0x7fb558125df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.490+0000 7fd31057f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd308123f10 0x7fd3081276f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.490+0000 7fd31057f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd308068c10 con 0x7fd308123a90 2023-10-03T10:09:57.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.490+0000 7fd31057f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd308092770 con 0x7fd308092390 2023-10-03T10:09:57.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.490+0000 7fd31057f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd308069550 con 0x7fd308123f10 2023-10-03T10:09:57.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.490+0000 7fd30e31b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd308092390 0x7fd308097aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.490+0000 7fb55d783700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5580963d0 con 0x7fb558093b90 2023-10-03T10:09:57.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.490+0000 7fb55d783700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb558062ee0 con 0x7fb558062b00 2023-10-03T10:09:57.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.490+0000 7fb55d783700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb558095a50 con 0x7fb558125400 2023-10-03T10:09:57.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.490+0000 7fb556ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb558062b00 0x7fb558125900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.490+0000 7fb556ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb558062b00 0x7fb558125900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47004/0 (socket says 172.21.15.146:47004) 2023-10-03T10:09:57.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.490+0000 7fb5577fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb558093b90 0x7fb558094040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33610/0 (socket says 172.21.15.146:33610) 2023-10-03T10:09:57.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.490+0000 7fb556ffd700 1 -- 172.21.15.146:0/3993755083 learned_addr learned my addr 172.21.15.146:0/3993755083 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:57.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.490+0000 7fb5567fc700 1 --2- 172.21.15.146:0/3993755083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb558125400 0x7fb558125df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.490+0000 7fd30e31b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd308092390 0x7fd308097aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47002/0 (socket says 172.21.15.146:47002) 2023-10-03T10:09:57.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.490+0000 7fd30e31b700 1 -- 172.21.15.146:0/4142051313 learned_addr learned my addr 172.21.15.146:0/4142051313 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:57.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.491+0000 7fd30e31b700 1 -- 172.21.15.146:0/4142051313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd308123f10 msgr2=0x7fd3081276f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:57.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.491+0000 7fd30e31b700 1 --2- 172.21.15.146:0/4142051313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd308123f10 0x7fd3081276f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:57.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.491+0000 7fd30e31b700 1 -- 172.21.15.146:0/4142051313 >> v1:172.21.15.146:6789/0 conn(0x7fd308123a90 legacy=0x7fd308126fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.491+0000 7fd30e31b700 1 -- 172.21.15.146:0/4142051313 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd308124550 con 0x7fd308092390 2023-10-03T10:09:57.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.491+0000 7fb555ffb700 1 -- 172.21.15.146:0/3993755083 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527631546 0 0) 0x7fb5580963d0 con 0x7fb558093b90 2023-10-03T10:09:57.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.491+0000 7fb555ffb700 1 -- 172.21.15.146:0/3993755083 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5440033f0 con 0x7fb558093b90 2023-10-03T10:09:57.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.491+0000 7fb5567fc700 1 -- 172.21.15.146:0/3993755083 >> v2:172.21.15.146:3300/0 conn(0x7fb558062b00 msgr2=0x7fb558125900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:57.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.491+0000 7fb5567fc700 1 --2- 172.21.15.146:0/3993755083 >> v2:172.21.15.146:3300/0 conn(0x7fb558062b00 0x7fb558125900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.491+0000 7fb5567fc700 1 -- 172.21.15.146:0/3993755083 >> v1:172.21.15.146:6789/0 conn(0x7fb558093b90 legacy=0x7fb558094040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.491+0000 7fb5567fc700 1 -- 172.21.15.146:0/3993755083 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5581262e0 con 0x7fb558125400 2023-10-03T10:09:57.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.491+0000 7fb5567fc700 1 --2- 172.21.15.146:0/3993755083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb558125400 0x7fb558125df0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb540009760 tx=0x7fb540009060).ready entity=mon.1 client_cookie=54d5a981dbc17d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.491+0000 7fd30e31b700 1 --2- 172.21.15.146:0/4142051313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd308092390 0x7fd308097aa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fd304006fd0 tx=0x7fd3040090f0).ready entity=mon.0 client_cookie=787a5bb97052413 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.491+0000 7fb555ffb700 1 -- 172.21.15.146:0/3993755083 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54000d4a0 con 0x7fb558125400 2023-10-03T10:09:57.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.491+0000 7fb555ffb700 1 -- 172.21.15.146:0/3993755083 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54000d600 con 0x7fb558125400 2023-10-03T10:09:57.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.491+0000 7fb555ffb700 1 -- 172.21.15.146:0/3993755083 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54000d980 con 0x7fb558125400 2023-10-03T10:09:57.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.491+0000 7fd30d319700 1 -- 172.21.15.146:0/4142051313 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30400b600 con 0x7fd308092390 2023-10-03T10:09:57.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.491+0000 7fd30d319700 1 -- 172.21.15.146:0/4142051313 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30400b760 con 0x7fd308092390 2023-10-03T10:09:57.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.491+0000 7fd30d319700 1 -- 172.21.15.146:0/4142051313 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30400bae0 con 0x7fd308092390 2023-10-03T10:09:57.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.492+0000 7fd31057f700 1 -- 172.21.15.146:0/4142051313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd308092390 msgr2=0x7fd308097aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.492+0000 7fd31057f700 1 --2- 172.21.15.146:0/4142051313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd308092390 0x7fd308097aa0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fd304006fd0 tx=0x7fd3040090f0).stop 2023-10-03T10:09:57.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.492+0000 7fb55d783700 1 -- 172.21.15.146:0/3993755083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb558125400 msgr2=0x7fb558125df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.492+0000 7fb55d783700 1 --2- 172.21.15.146:0/3993755083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb558125400 0x7fb558125df0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb540009760 tx=0x7fb540009060).stop 2023-10-03T10:09:57.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.492+0000 7fd31057f700 1 -- 172.21.15.146:0/4142051313 shutdown_connections 2023-10-03T10:09:57.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.492+0000 7fd31057f700 1 --2- 172.21.15.146:0/4142051313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd308123f10 0x7fd3081276f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:57.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.492+0000 7fd31057f700 1 --2- 172.21.15.146:0/4142051313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd308092390 0x7fd308097aa0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.492+0000 7fd31057f700 1 -- 172.21.15.146:0/4142051313 >> 172.21.15.146:0/4142051313 conn(0x7fd30809a230 msgr2=0x7fd30809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.492+0000 7fb55d783700 1 -- 172.21.15.146:0/3993755083 shutdown_connections 2023-10-03T10:09:57.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.492+0000 7fb55d783700 1 --2- 172.21.15.146:0/3993755083 >> v2:172.21.15.146:3300/0 conn(0x7fb558062b00 0x7fb558125900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.492+0000 7fb55d783700 1 --2- 172.21.15.146:0/3993755083 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb558125400 0x7fb558125df0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.492+0000 7fb55d783700 1 -- 172.21.15.146:0/3993755083 >> 172.21.15.146:0/3993755083 conn(0x7fb55809aa50 msgr2=0x7fb55809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.492+0000 7fd31057f700 1 -- 172.21.15.146:0/4142051313 shutdown_connections 2023-10-03T10:09:57.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.492+0000 7fd31057f700 1 -- 172.21.15.146:0/4142051313 wait complete. 2023-10-03T10:09:57.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.492+0000 7fb55d783700 1 -- 172.21.15.146:0/3993755083 shutdown_connections 2023-10-03T10:09:57.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.492+0000 7fb55d783700 1 -- 172.21.15.146:0/3993755083 wait complete. 2023-10-03T10:09:57.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.493+0000 7fd31057f700 1 Processor -- start 2023-10-03T10:09:57.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.493+0000 7fd31057f700 1 -- start start 2023-10-03T10:09:57.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.493+0000 7fb55d783700 1 Processor -- start 2023-10-03T10:09:57.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.493+0000 7fb55d783700 1 -- start start 2023-10-03T10:09:57.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.493+0000 7fd31057f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd308092390 0x7fd308096b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.493+0000 7fd31057f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd308123a90 0x7fd308128060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.493+0000 7fd31057f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd308123f10 0x7fd308128550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.493+0000 7fd31057f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30812a340 con 0x7fd308123a90 2023-10-03T10:09:57.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.493+0000 7fd31057f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd308067620 con 0x7fd308092390 2023-10-03T10:09:57.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.493+0000 7fd31057f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd308069780 con 0x7fd308123f10 2023-10-03T10:09:57.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fd30db1a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd308123a90 0x7fd308128060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fd30eb1c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd308123f10 0x7fd308128550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fd30db1a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd308123a90 0x7fd308128060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47014/0 (socket says 172.21.15.146:47014) 2023-10-03T10:09:57.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fd30e31b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd308092390 0x7fd308096b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fd30db1a700 1 -- 172.21.15.146:0/3379378181 learned_addr learned my addr 172.21.15.146:0/3379378181 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:57.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fd30eb1c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd308123f10 0x7fd308128550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36582/0 (socket says 172.21.15.146:36582) 2023-10-03T10:09:57.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fb55d783700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb558062b00 0x7fb558113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fb55d783700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb558093b90 0x7fb5580695b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fb55d783700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb558125400 0x7fb558069aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fb55d783700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb558112ca0 con 0x7fb558125400 2023-10-03T10:09:57.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fb55d783700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb558111270 con 0x7fb558093b90 2023-10-03T10:09:57.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fb55d783700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb558112ea0 con 0x7fb558062b00 2023-10-03T10:09:57.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fb5577fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb558125400 0x7fb558069aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fb5577fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb558125400 0x7fb558069aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47018/0 (socket says 172.21.15.146:47018) 2023-10-03T10:09:57.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fb5577fe700 1 -- 172.21.15.146:0/1984676118 learned_addr learned my addr 172.21.15.146:0/1984676118 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:57.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fd30db1a700 1 -- 172.21.15.146:0/3379378181 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd308123f10 msgr2=0x7fd308128550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fd30db1a700 1 --2- 172.21.15.146:0/3379378181 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd308123f10 0x7fd308128550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fd30db1a700 1 -- 172.21.15.146:0/3379378181 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd308092390 msgr2=0x7fd308096b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fd30db1a700 1 --2- 172.21.15.146:0/3379378181 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd308092390 0x7fd308096b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fd30db1a700 1 -- 172.21.15.146:0/3379378181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd304009370 con 0x7fd308123a90 2023-10-03T10:09:57.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fb556ffd700 1 --2- 172.21.15.146:0/1984676118 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb558062b00 0x7fb558113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fd30db1a700 1 --2- 172.21.15.146:0/3379378181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd308123a90 0x7fd308128060 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd2f800c4c0 tx=0x7fd2f8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fd30e31b700 1 --2- 172.21.15.146:0/3379378181 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd308092390 0x7fd308096b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:57.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.495+0000 7fd2fe7fc700 1 -- 172.21.15.146:0/3379378181 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f800ce70 con 0x7fd308123a90 2023-10-03T10:09:57.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.495+0000 7fd2fe7fc700 1 -- 172.21.15.146:0/3379378181 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f8001e90 con 0x7fd308123a90 2023-10-03T10:09:57.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.495+0000 7fd2fe7fc700 1 -- 172.21.15.146:0/3379378181 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8007250 con 0x7fd308123a90 2023-10-03T10:09:57.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.494+0000 7fb5567fc700 1 --2- 172.21.15.146:0/1984676118 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb558093b90 0x7fb5580695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.495+0000 7fb556ffd700 1 -- 172.21.15.146:0/1984676118 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb558093b90 msgr2=0x7fb5580695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.495+0000 7fb556ffd700 1 --2- 172.21.15.146:0/1984676118 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb558093b90 0x7fb5580695b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.495+0000 7fb556ffd700 1 -- 172.21.15.146:0/1984676118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb558125400 msgr2=0x7fb558069aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.495+0000 7fb556ffd700 1 --2- 172.21.15.146:0/1984676118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb558125400 0x7fb558069aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.495+0000 7fb556ffd700 1 -- 172.21.15.146:0/1984676118 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5400092a0 con 0x7fb558062b00 2023-10-03T10:09:57.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.495+0000 7fd31057f700 1 -- 172.21.15.146:0/3379378181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3081294a0 con 0x7fd308123a90 2023-10-03T10:09:57.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.495+0000 7fb556ffd700 1 --2- 172.21.15.146:0/1984676118 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb558062b00 0x7fb558113680 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fb54800e8d0 tx=0x7fb5480090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.495+0000 7fd31057f700 1 -- 172.21.15.146:0/3379378181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd308097940 con 0x7fd308123a90 2023-10-03T10:09:57.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.495+0000 7fb54effd700 1 -- 172.21.15.146:0/1984676118 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548009370 con 0x7fb558062b00 2023-10-03T10:09:57.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.495+0000 7fb54effd700 1 -- 172.21.15.146:0/1984676118 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb548012600 con 0x7fb558062b00 2023-10-03T10:09:57.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.495+0000 7fb54effd700 1 -- 172.21.15.146:0/1984676118 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548012980 con 0x7fb558062b00 2023-10-03T10:09:57.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.495+0000 7fb55d783700 1 -- 172.21.15.146:0/1984676118 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb558114e50 con 0x7fb558062b00 2023-10-03T10:09:57.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.495+0000 7fb55d783700 1 -- 172.21.15.146:0/1984676118 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb558069f90 con 0x7fb558062b00 2023-10-03T10:09:57.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.496+0000 7fb54effd700 1 -- 172.21.15.146:0/1984676118 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb548012d30 con 0x7fb558062b00 2023-10-03T10:09:57.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.496+0000 7fb55d783700 1 -- 172.21.15.146:0/1984676118 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb5580965f0 con 0x7fb558062b00 2023-10-03T10:09:57.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.496+0000 7fd31057f700 1 -- 172.21.15.146:0/3379378181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd30805a260 con 0x7fd308123a90 2023-10-03T10:09:57.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.496+0000 7fb54effd700 1 -- 172.21.15.146:0/1984676118 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb54803ab90 con 0x7fb558062b00 2023-10-03T10:09:57.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.497+0000 7fd2fe7fc700 1 -- 172.21.15.146:0/3379378181 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd2f80066a0 con 0x7fd308123a90 2023-10-03T10:09:57.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.496+0000 7fb54effd700 1 -- 172.21.15.146:0/1984676118 --> v1:172.21.15.146:6804/118774 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb538038460 con 0x7fb538034770 2023-10-03T10:09:57.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.497+0000 7fb54effd700 1 -- 172.21.15.146:0/1984676118 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb54801a3b0 con 0x7fb558062b00 2023-10-03T10:09:57.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.497+0000 7fd2fe7fc700 1 -- 172.21.15.146:0/3379378181 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd2f803b080 con 0x7fd308123a90 2023-10-03T10:09:57.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.497+0000 7fd2fe7fc700 1 -- 172.21.15.146:0/3379378181 --> v1:172.21.15.146:6800/118758 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2ec0384e0 con 0x7fd2ec0347f0 2023-10-03T10:09:57.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.497+0000 7fd2fe7fc700 1 -- 172.21.15.146:0/3379378181 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2f803b480 con 0x7fd308123a90 2023-10-03T10:09:57.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.497+0000 7fb54effd700 1 -- 172.21.15.146:0/1984676118 <== osd.1 v1:172.21.15.146:6804/118774 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7fb538038460 con 0x7fb538034770 2023-10-03T10:09:57.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.499+0000 7f9f9c46c700 1 Processor -- start 2023-10-03T10:09:57.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.499+0000 7fd2fe7fc700 1 -- 172.21.15.146:0/3379378181 <== osd.0 v1:172.21.15.146:6800/118758 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7fd2ec0384e0 con 0x7fd2ec0347f0 2023-10-03T10:09:57.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.499+0000 7f9f9c46c700 1 -- start start 2023-10-03T10:09:57.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.500+0000 7f9f9c46c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f94092aa0 0x7f9f94062b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.500+0000 7f9f9c46c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9f94095690 0x7f9f94095ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.500+0000 7f9f9c46c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f940636a0 con 0x7f9f94095fa0 2023-10-03T10:09:57.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.500+0000 7f9f9c46c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f94094a40 con 0x7f9f94095690 2023-10-03T10:09:57.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.500+0000 7f9f9c46c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940920e0 con 0x7f9f94092aa0 2023-10-03T10:09:57.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.500+0000 7f9f9aa09700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9f94095fa0 0x7f9f94135a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33620/0 (socket says 172.21.15.146:33620) 2023-10-03T10:09:57.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.500+0000 7f9f9aa09700 1 -- 172.21.15.146:0/2287102082 learned_addr learned my addr 172.21.15.146:0/2287102082 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:09:57.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.500+0000 7f9f99a07700 1 --2- 172.21.15.146:0/2287102082 >> v2:172.21.15.146:3300/0 conn(0x7f9f94095690 0x7f9f94095ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.500+0000 7f9f99206700 1 -- 172.21.15.146:0/2287102082 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629602510 0 0) 0x7f9f940636a0 con 0x7f9f94095fa0 2023-10-03T10:09:57.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.501+0000 7f9f99206700 1 -- 172.21.15.146:0/2287102082 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f800033f0 con 0x7f9f94095fa0 2023-10-03T10:09:57.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.501+0000 7f9f99a07700 1 -- 172.21.15.146:0/2287102082 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f94092aa0 msgr2=0x7f9f94062b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:57.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.501+0000 7f9f99a07700 1 --2- 172.21.15.146:0/2287102082 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f94092aa0 0x7f9f94062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:57.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.501+0000 7f9f99a07700 1 -- 172.21.15.146:0/2287102082 >> v1:172.21.15.146:6789/0 conn(0x7f9f94095fa0 legacy=0x7f9f94135a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.501+0000 7f9f99a07700 1 -- 172.21.15.146:0/2287102082 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f94091980 con 0x7f9f94095690 2023-10-03T10:09:57.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.501+0000 7f9f99a07700 1 --2- 172.21.15.146:0/2287102082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f94095690 0x7f9f94095ab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f9f84009760 tx=0x7f9f84009060).ready entity=mon.0 client_cookie=364c296eab388215 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.501+0000 7f9f99206700 1 -- 172.21.15.146:0/2287102082 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f840090d0 con 0x7f9f94095690 2023-10-03T10:09:57.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.501+0000 7f9f99206700 1 -- 172.21.15.146:0/2287102082 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8400f510 con 0x7f9f94095690 2023-10-03T10:09:57.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.501+0000 7f9f99206700 1 -- 172.21.15.146:0/2287102082 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8400f890 con 0x7f9f94095690 2023-10-03T10:09:57.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.501+0000 7f71f75ac700 1 Processor -- start 2023-10-03T10:09:57.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.502+0000 7f71f75ac700 1 -- start start 2023-10-03T10:09:57.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.502+0000 7f9f9c46c700 1 -- 172.21.15.146:0/2287102082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f94095690 msgr2=0x7f9f94095ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.502+0000 7f9f9c46c700 1 --2- 172.21.15.146:0/2287102082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f94095690 0x7f9f94095ab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f9f84009760 tx=0x7f9f84009060).stop 2023-10-03T10:09:57.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.502+0000 7f9f9c46c700 1 -- 172.21.15.146:0/2287102082 shutdown_connections 2023-10-03T10:09:57.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.502+0000 7f9f9c46c700 1 --2- 172.21.15.146:0/2287102082 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f94092aa0 0x7f9f94062b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:57.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.502+0000 7f9f9c46c700 1 --2- 172.21.15.146:0/2287102082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f94095690 0x7f9f94095ab0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.502+0000 7f9f9c46c700 1 -- 172.21.15.146:0/2287102082 >> 172.21.15.146:0/2287102082 conn(0x7f9f9409aa50 msgr2=0x7f9f9409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.502+0000 7f9f9c46c700 1 -- 172.21.15.146:0/2287102082 shutdown_connections 2023-10-03T10:09:57.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.502+0000 7f9f9c46c700 1 -- 172.21.15.146:0/2287102082 wait complete. 2023-10-03T10:09:57.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.502+0000 7f71f75ac700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f71f0093730 0x7f71f012c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.503+0000 7f9f9c46c700 1 Processor -- start 2023-10-03T10:09:57.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.502+0000 7f71f75ac700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71f012f520 0x7f71f0137190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.502+0000 7f71f75ac700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f0095fa0 con 0x7f71f012c4f0 2023-10-03T10:09:57.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.502+0000 7f71f75ac700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f012c8f0 con 0x7f71f0093730 2023-10-03T10:09:57.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.502+0000 7f71f75ac700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71f0093350 con 0x7f71f012f520 2023-10-03T10:09:57.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.503+0000 7f9f9c46c700 1 -- start start 2023-10-03T10:09:57.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.502+0000 7f71f5b49700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71f012f520 0x7f71f0137190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.503+0000 7f71f5b49700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71f012f520 0x7f71f0137190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36608/0 (socket says 172.21.15.146:36608) 2023-10-03T10:09:57.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.503+0000 7f71f5b49700 1 -- 172.21.15.146:0/3064015928 learned_addr learned my addr 172.21.15.146:0/3064015928 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:57.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.503+0000 7f71f5348700 1 --2- 172.21.15.146:0/3064015928 >> v2:172.21.15.146:3300/0 conn(0x7f71f0093730 0x7f71f012c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.503+0000 7f71e7fff700 1 -- 172.21.15.146:0/3064015928 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370062456 0 0) 0x7f71f0095fa0 con 0x7f71f012c4f0 2023-10-03T10:09:57.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.503+0000 7f71e7fff700 1 -- 172.21.15.146:0/3064015928 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71dc0033f0 con 0x7f71f012c4f0 2023-10-03T10:09:57.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.503+0000 7f71f5348700 1 -- 172.21.15.146:0/3064015928 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71f012f520 msgr2=0x7f71f0137190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:57.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.503+0000 7f71f5348700 1 --2- 172.21.15.146:0/3064015928 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71f012f520 0x7f71f0137190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.503+0000 7f71f5348700 1 -- 172.21.15.146:0/3064015928 >> v1:172.21.15.146:6789/0 conn(0x7f71f012c4f0 legacy=0x7f71f012ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.503+0000 7f71f5348700 1 -- 172.21.15.146:0/3064015928 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f0093b10 con 0x7f71f0093730 2023-10-03T10:09:57.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.503+0000 7f71f5348700 1 --2- 172.21.15.146:0/3064015928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71f0093730 0x7f71f012c000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f71ec009760 tx=0x7f71ec009060).ready entity=mon.0 client_cookie=e125b8e3628753b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.503+0000 7f9f9c46c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f94095690 0x7f9f94117080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.503+0000 7f9f9c46c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f94095fa0 0x7f9f94137830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.503+0000 7f9f9c46c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f94137d20 0x7f9f94135e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.503+0000 7f9f9c46c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f94119570 con 0x7f9f94095690 2023-10-03T10:09:57.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.503+0000 7f9f9c46c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9406a8c0 con 0x7f9f94095fa0 2023-10-03T10:09:57.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.503+0000 7f9f9c46c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f94091b90 con 0x7f9f94137d20 2023-10-03T10:09:57.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.504+0000 7f9f99a07700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f94095fa0 0x7f9f94137830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.504+0000 7f9f9aa09700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f94137d20 0x7f9f94135e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.504+0000 7f9f99a07700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f94095fa0 0x7f9f94137830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58580/0 (socket says 172.21.15.146:58580) 2023-10-03T10:09:57.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.504+0000 7f9f99a07700 1 -- 172.21.15.146:0/2209566063 learned_addr learned my addr 172.21.15.146:0/2209566063 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:57.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.504+0000 7f9f9a208700 1 --2- 172.21.15.146:0/2209566063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f94095690 0x7f9f94117080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.503+0000 7f71e7fff700 1 -- 172.21.15.146:0/3064015928 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec0090d0 con 0x7f71f0093730 2023-10-03T10:09:57.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.504+0000 7f71e7fff700 1 -- 172.21.15.146:0/3064015928 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ec00f510 con 0x7f71f0093730 2023-10-03T10:09:57.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.504+0000 7f71e7fff700 1 -- 172.21.15.146:0/3064015928 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec00f890 con 0x7f71f0093730 2023-10-03T10:09:57.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.504+0000 7f9f9aa09700 1 -- 172.21.15.146:0/2209566063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f94095fa0 msgr2=0x7f9f94137830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.504+0000 7f9f9aa09700 1 --2- 172.21.15.146:0/2209566063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f94095fa0 0x7f9f94137830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.504+0000 7f9f9aa09700 1 -- 172.21.15.146:0/2209566063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f94095690 msgr2=0x7f9f94117080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.504+0000 7f9f9aa09700 1 --2- 172.21.15.146:0/2209566063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f94095690 0x7f9f94117080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.504+0000 7f9f9aa09700 1 -- 172.21.15.146:0/2209566063 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f840092a0 con 0x7f9f94137d20 2023-10-03T10:09:57.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.504+0000 7f9f99a07700 1 --2- 172.21.15.146:0/2209566063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f94095fa0 0x7f9f94137830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:57.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.504+0000 7f9f9a208700 1 --2- 172.21.15.146:0/2209566063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f94095690 0x7f9f94117080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:57.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.504+0000 7f9f9aa09700 1 --2- 172.21.15.146:0/2209566063 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f94137d20 0x7f9f94135e30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9f8c00c790 tx=0x7f9f8c007f10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.504+0000 7f9f8a7fc700 1 -- 172.21.15.146:0/2209566063 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c005d30 con 0x7f9f94137d20 2023-10-03T10:09:57.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.504+0000 7f71f75ac700 1 -- 172.21.15.146:0/3064015928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71f0093730 msgr2=0x7f71f012c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.504+0000 7f71f75ac700 1 --2- 172.21.15.146:0/3064015928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71f0093730 0x7f71f012c000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f71ec009760 tx=0x7f71ec009060).stop 2023-10-03T10:09:57.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.504+0000 7f9f8a7fc700 1 -- 172.21.15.146:0/2209566063 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c005e90 con 0x7f9f94137d20 2023-10-03T10:09:57.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.504+0000 7f9f8a7fc700 1 -- 172.21.15.146:0/2209566063 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0072e0 con 0x7f9f94137d20 2023-10-03T10:09:57.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.505+0000 7f9f9c46c700 1 -- 172.21.15.146:0/2209566063 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f94137570 con 0x7f9f94137d20 2023-10-03T10:09:57.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.505+0000 7f9f9c46c700 1 -- 172.21.15.146:0/2209566063 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f94117c00 con 0x7f9f94137d20 2023-10-03T10:09:57.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.505+0000 7f9f9c46c700 1 -- 172.21.15.146:0/2209566063 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f9405a260 con 0x7f9f94137d20 2023-10-03T10:09:57.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.505+0000 7f71f75ac700 1 -- 172.21.15.146:0/3064015928 shutdown_connections 2023-10-03T10:09:57.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.505+0000 7f71f75ac700 1 --2- 172.21.15.146:0/3064015928 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71f012f520 0x7f71f0137190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.505+0000 7f71f75ac700 1 --2- 172.21.15.146:0/3064015928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71f0093730 0x7f71f012c000 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.505+0000 7f71f75ac700 1 -- 172.21.15.146:0/3064015928 >> 172.21.15.146:0/3064015928 conn(0x7f71f00999d0 msgr2=0x7f71f0099de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.506+0000 7f71f75ac700 1 -- 172.21.15.146:0/3064015928 shutdown_connections 2023-10-03T10:09:57.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.506+0000 7f71f75ac700 1 -- 172.21.15.146:0/3064015928 wait complete. 2023-10-03T10:09:57.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.506+0000 7f9f8a7fc700 1 -- 172.21.15.146:0/2209566063 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9f8c007710 con 0x7f9f94137d20 2023-10-03T10:09:57.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.506+0000 7f9f8a7fc700 1 -- 172.21.15.146:0/2209566063 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9f8c03aed0 con 0x7f9f94137d20 2023-10-03T10:09:57.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.506+0000 7f9f8a7fc700 1 -- 172.21.15.146:0/2209566063 --> v1:172.21.15.146:6805/118775 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f780384e0 con 0x7f9f780347f0 2023-10-03T10:09:57.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.506+0000 7f9f8a7fc700 1 -- 172.21.15.146:0/2209566063 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f8c03b2d0 con 0x7f9f94137d20 2023-10-03T10:09:57.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.507+0000 7f71f75ac700 1 Processor -- start 2023-10-03T10:09:57.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.507+0000 7f9f8a7fc700 1 -- 172.21.15.146:0/2209566063 <== osd.2 v1:172.21.15.146:6805/118775 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f9f780384e0 con 0x7f9f780347f0 2023-10-03T10:09:57.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.507+0000 7f71f75ac700 1 -- start start 2023-10-03T10:09:57.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.508+0000 7f71f75ac700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71f0093730 0x7f71f011a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.508+0000 7f71f75ac700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71f012c4f0 0x7f71f011ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.508+0000 7f71f75ac700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71f012f520 0x7f71f011b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.508+0000 7f71f75ac700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f011b6c0 con 0x7f71f0093730 2023-10-03T10:09:57.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.508+0000 7f71f75ac700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f011c380 con 0x7f71f012c4f0 2023-10-03T10:09:57.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.508+0000 7f71f75ac700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71f011bc50 con 0x7f71f012f520 2023-10-03T10:09:57.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.508+0000 7f71f5348700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71f0093730 0x7f71f011a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.508+0000 7f71f5b49700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71f012f520 0x7f71f011b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.508+0000 7f71f5348700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71f0093730 0x7f71f011a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47044/0 (socket says 172.21.15.146:47044) 2023-10-03T10:09:57.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.508+0000 7f71f5348700 1 -- 172.21.15.146:0/4195156117 learned_addr learned my addr 172.21.15.146:0/4195156117 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:57.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.508+0000 7f71f4b47700 1 --2- 172.21.15.146:0/4195156117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71f012c4f0 0x7f71f011ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.508+0000 7f71f5348700 1 -- 172.21.15.146:0/4195156117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71f012f520 msgr2=0x7f71f011b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.508+0000 7f71f5348700 1 --2- 172.21.15.146:0/4195156117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71f012f520 0x7f71f011b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.508+0000 7f71f5348700 1 -- 172.21.15.146:0/4195156117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71f012c4f0 msgr2=0x7f71f011ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.508+0000 7f71f5348700 1 --2- 172.21.15.146:0/4195156117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71f012c4f0 0x7f71f011ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.508+0000 7f71f5348700 1 -- 172.21.15.146:0/4195156117 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec0092a0 con 0x7f71f0093730 2023-10-03T10:09:57.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.508+0000 7f71f5b49700 1 --2- 172.21.15.146:0/4195156117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71f012f520 0x7f71f011b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:09:57.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.508+0000 7f71f5348700 1 --2- 172.21.15.146:0/4195156117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71f0093730 0x7f71f011a7f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f71ec009e00 tx=0x7f71ec017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.509+0000 7f71e57fa700 1 -- 172.21.15.146:0/4195156117 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec006930 con 0x7f71f0093730 2023-10-03T10:09:57.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.509+0000 7f71e57fa700 1 -- 172.21.15.146:0/4195156117 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ec00f680 con 0x7f71f0093730 2023-10-03T10:09:57.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.509+0000 7f71e57fa700 1 -- 172.21.15.146:0/4195156117 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec01b410 con 0x7f71f0093730 2023-10-03T10:09:57.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.513+0000 7f71f75ac700 1 -- 172.21.15.146:0/4195156117 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f011dcf0 con 0x7f71f0093730 2023-10-03T10:09:57.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.513+0000 7f71f75ac700 1 -- 172.21.15.146:0/4195156117 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f006a520 con 0x7f71f0093730 2023-10-03T10:09:57.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.513+0000 7f71e57fa700 1 -- 172.21.15.146:0/4195156117 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f71ec01b780 con 0x7f71f0093730 2023-10-03T10:09:57.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.514+0000 7f71e57fa700 1 -- 172.21.15.146:0/4195156117 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f71ec03c9b0 con 0x7f71f0093730 2023-10-03T10:09:57.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.514+0000 7f71f75ac700 1 -- 172.21.15.146:0/4195156117 --> v1:172.21.15.146:6812/118776 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71f005a080 con 0x7f71f013ea60 2023-10-03T10:09:57.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.515+0000 7f71e57fa700 1 -- 172.21.15.146:0/4195156117 <== osd.3 v1:172.21.15.146:6812/118776 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f71f005a080 con 0x7f71f013ea60 2023-10-03T10:09:57.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.521+0000 7fd31057f700 1 -- 172.21.15.146:0/3379378181 --> v1:172.21.15.146:6800/118758 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd308128d60 con 0x7fd2ec0347f0 2023-10-03T10:09:57.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.522+0000 7fd2fe7fc700 1 -- 172.21.15.146:0/3379378181 <== osd.0 v1:172.21.15.146:6800/118758 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7fd308128d60 con 0x7fd2ec0347f0 2023-10-03T10:09:57.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.522+0000 7fd31057f700 1 -- 172.21.15.146:0/3379378181 >> v1:172.21.15.146:6800/118758 conn(0x7fd2ec0347f0 legacy=0x7fd2ec036c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.522+0000 7fd31057f700 1 -- 172.21.15.146:0/3379378181 >> v1:172.21.15.146:6816/118159 conn(0x7fd2ec02bb60 legacy=0x7fd2ec02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.522+0000 7fd31057f700 1 -- 172.21.15.146:0/3379378181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd308123a90 msgr2=0x7fd308128060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.522+0000 7fd31057f700 1 --2- 172.21.15.146:0/3379378181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd308123a90 0x7fd308128060 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd2f800c4c0 tx=0x7fd2f8007e00).stop 2023-10-03T10:09:57.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.522+0000 7fd30eb1c700 1 -- 172.21.15.146:0/3379378181 reap_dead start 2023-10-03T10:09:57.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.522+0000 7fd31057f700 1 -- 172.21.15.146:0/3379378181 shutdown_connections 2023-10-03T10:09:57.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.522+0000 7fd31057f700 1 -- 172.21.15.146:0/3379378181 >> 172.21.15.146:0/3379378181 conn(0x7fd30809a230 msgr2=0x7fd308126e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.522+0000 7fd31057f700 1 -- 172.21.15.146:0/3379378181 shutdown_connections 2023-10-03T10:09:57.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.522+0000 7fd31057f700 1 -- 172.21.15.146:0/3379378181 wait complete. 2023-10-03T10:09:57.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.523+0000 7fb55d783700 1 -- 172.21.15.146:0/1984676118 --> v1:172.21.15.146:6804/118774 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb55806a990 con 0x7fb538034770 2023-10-03T10:09:57.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.524+0000 7fb54effd700 1 -- 172.21.15.146:0/1984676118 <== osd.1 v1:172.21.15.146:6804/118774 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3659784045) 0x7fb55806a990 con 0x7fb538034770 2023-10-03T10:09:57.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.524+0000 7fb55d783700 1 -- 172.21.15.146:0/1984676118 >> v1:172.21.15.146:6804/118774 conn(0x7fb538034770 legacy=0x7fb538036bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.524+0000 7fb55d783700 1 -- 172.21.15.146:0/1984676118 >> v1:172.21.15.146:6816/118159 conn(0x7fb53802bb60 legacy=0x7fb53802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.524+0000 7fb55d783700 1 -- 172.21.15.146:0/1984676118 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb558062b00 msgr2=0x7fb558113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.524+0000 7fb55d783700 1 --2- 172.21.15.146:0/1984676118 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb558062b00 0x7fb558113680 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fb54800e8d0 tx=0x7fb5480090f0).stop 2023-10-03T10:09:57.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.524+0000 7fb5577fe700 1 -- 172.21.15.146:0/1984676118 reap_dead start 2023-10-03T10:09:57.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.524+0000 7fb55d783700 1 -- 172.21.15.146:0/1984676118 shutdown_connections 2023-10-03T10:09:57.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.524+0000 7fb55d783700 1 -- 172.21.15.146:0/1984676118 >> 172.21.15.146:0/1984676118 conn(0x7fb55809aa50 msgr2=0x7fb5581231d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.525+0000 7fb55d783700 1 -- 172.21.15.146:0/1984676118 shutdown_connections 2023-10-03T10:09:57.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.525+0000 7fb55d783700 1 -- 172.21.15.146:0/1984676118 wait complete. 2023-10-03T10:09:57.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.531+0000 7f9f9c46c700 1 -- 172.21.15.146:0/2209566063 --> v1:172.21.15.146:6805/118775 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9f94046c20 con 0x7f9f780347f0 2023-10-03T10:09:57.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.531+0000 7f9f8a7fc700 1 -- 172.21.15.146:0/2209566063 <== osd.2 v1:172.21.15.146:6805/118775 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3659784045) 0x7f9f94046c20 con 0x7f9f780347f0 2023-10-03T10:09:57.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.532+0000 7f9f9c46c700 1 -- 172.21.15.146:0/2209566063 >> v1:172.21.15.146:6805/118775 conn(0x7f9f780347f0 legacy=0x7f9f78036c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.532+0000 7f9f9c46c700 1 -- 172.21.15.146:0/2209566063 >> v1:172.21.15.146:6816/118159 conn(0x7f9f7802bb60 legacy=0x7f9f7802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.532+0000 7f9f9c46c700 1 -- 172.21.15.146:0/2209566063 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f94137d20 msgr2=0x7f9f94135e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.532+0000 7f9f9c46c700 1 --2- 172.21.15.146:0/2209566063 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f94137d20 0x7f9f94135e30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9f8c00c790 tx=0x7f9f8c007f10).stop 2023-10-03T10:09:57.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.532+0000 7f9f9aa09700 1 -- 172.21.15.146:0/2209566063 reap_dead start 2023-10-03T10:09:57.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.532+0000 7f9f9c46c700 1 -- 172.21.15.146:0/2209566063 shutdown_connections 2023-10-03T10:09:57.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.532+0000 7f9f9c46c700 1 -- 172.21.15.146:0/2209566063 >> 172.21.15.146:0/2209566063 conn(0x7f9f9409aa50 msgr2=0x7f9f94098880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.532+0000 7f9f9c46c700 1 -- 172.21.15.146:0/2209566063 shutdown_connections 2023-10-03T10:09:57.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.532+0000 7f9f9c46c700 1 -- 172.21.15.146:0/2209566063 wait complete. 2023-10-03T10:09:57.540 INFO:teuthology.orchestra.run.smithi146.stdout:38654705668 2023-10-03T10:09:57.540 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:09:57.541 INFO:teuthology.orchestra.run.smithi146.stdout:38654705669 2023-10-03T10:09:57.541 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:09:57.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.541+0000 7f71f75ac700 1 -- 172.21.15.146:0/4195156117 --> v1:172.21.15.146:6812/118776 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f71f011e1d0 con 0x7f71f013ea60 2023-10-03T10:09:57.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.542+0000 7f71e57fa700 1 -- 172.21.15.146:0/4195156117 <== osd.3 v1:172.21.15.146:6812/118776 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3659784045) 0x7f71f011e1d0 con 0x7f71f013ea60 2023-10-03T10:09:57.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.542+0000 7f71f75ac700 1 -- 172.21.15.146:0/4195156117 >> v1:172.21.15.146:6812/118776 conn(0x7f71f013ea60 legacy=0x7f71f013ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.542+0000 7f71f75ac700 1 -- 172.21.15.146:0/4195156117 >> v1:172.21.15.146:6816/118159 conn(0x7f71d402bbe0 legacy=0x7f71d402e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.542+0000 7f71f75ac700 1 -- 172.21.15.146:0/4195156117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71f0093730 msgr2=0x7f71f011a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.542+0000 7f71f75ac700 1 --2- 172.21.15.146:0/4195156117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71f0093730 0x7f71f011a7f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f71ec009e00 tx=0x7f71ec017000).stop 2023-10-03T10:09:57.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.542+0000 7f71f5b49700 1 -- 172.21.15.146:0/4195156117 reap_dead start 2023-10-03T10:09:57.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.543+0000 7f71f75ac700 1 -- 172.21.15.146:0/4195156117 shutdown_connections 2023-10-03T10:09:57.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.543+0000 7f71f75ac700 1 -- 172.21.15.146:0/4195156117 >> 172.21.15.146:0/4195156117 conn(0x7f71f00999d0 msgr2=0x7f71f00978d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.543+0000 7f71f75ac700 1 -- 172.21.15.146:0/4195156117 shutdown_connections 2023-10-03T10:09:57.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.543+0000 7f71f75ac700 1 -- 172.21.15.146:0/4195156117 wait complete. 2023-10-03T10:09:57.546 INFO:teuthology.orchestra.run.smithi146.stdout:38654705668 2023-10-03T10:09:57.546 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:09:57.557 INFO:teuthology.orchestra.run.smithi146.stdout:38654705668 2023-10-03T10:09:57.558 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:09:57.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.668+0000 7f26d31da700 1 Processor -- start 2023-10-03T10:09:57.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.668+0000 7f26d31da700 1 -- start start 2023-10-03T10:09:57.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.668+0000 7f26d31da700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f26cc05f560 0x7f26cc12ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.668+0000 7f26d31da700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26cc12b370 0x7f26cc095d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.668+0000 7f26d31da700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f26cc12b790 0x7f26cc096280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.668+0000 7f26d31da700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc05f940 con 0x7f26cc05f560 2023-10-03T10:09:57.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.668+0000 7f26d31da700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc066f90 con 0x7f26cc12b370 2023-10-03T10:09:57.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.668+0000 7f26d31da700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc067650 con 0x7f26cc12b790 2023-10-03T10:09:57.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.668+0000 7f26d0f76700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f26cc05f560 0x7f26cc12ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.669+0000 7f26d0f76700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f26cc05f560 0x7f26cc12ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47052/0 (socket says 172.21.15.146:47052) 2023-10-03T10:09:57.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.669+0000 7f26d0f76700 1 -- 172.21.15.146:0/3417870732 learned_addr learned my addr 172.21.15.146:0/3417870732 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:57.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.669+0000 7f26d0f76700 1 -- 172.21.15.146:0/3417870732 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f26cc12b790 msgr2=0x7f26cc096280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:57.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.669+0000 7f26d0f76700 1 --2- 172.21.15.146:0/3417870732 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f26cc12b790 0x7f26cc096280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:57.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.669+0000 7f26d0f76700 1 -- 172.21.15.146:0/3417870732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26cc12b370 msgr2=0x7f26cc095d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:57.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.669+0000 7f26d0f76700 1 --2- 172.21.15.146:0/3417870732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26cc12b370 0x7f26cc095d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:57.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.669+0000 7f26d0f76700 1 -- 172.21.15.146:0/3417870732 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc067910 con 0x7f26cc05f560 2023-10-03T10:09:57.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.669+0000 7f26d0f76700 1 --2- 172.21.15.146:0/3417870732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26cc05f560 0x7f26cc12ae80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f26c0006fd0 tx=0x7f26c00090f0).ready entity=mon.0 client_cookie=68714307a60bea0b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.669+0000 7f26cb7fe700 1 -- 172.21.15.146:0/3417870732 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c000b600 con 0x7f26cc05f560 2023-10-03T10:09:57.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.669+0000 7f26cb7fe700 1 -- 172.21.15.146:0/3417870732 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c000b760 con 0x7f26cc05f560 2023-10-03T10:09:57.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.669+0000 7f26cb7fe700 1 -- 172.21.15.146:0/3417870732 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c000bae0 con 0x7f26cc05f560 2023-10-03T10:09:57.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.670+0000 7f26d31da700 1 -- 172.21.15.146:0/3417870732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26cc05f560 msgr2=0x7f26cc12ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.670+0000 7f26d31da700 1 --2- 172.21.15.146:0/3417870732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26cc05f560 0x7f26cc12ae80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f26c0006fd0 tx=0x7f26c00090f0).stop 2023-10-03T10:09:57.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.670+0000 7f26d31da700 1 -- 172.21.15.146:0/3417870732 shutdown_connections 2023-10-03T10:09:57.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.670+0000 7f26d31da700 1 --2- 172.21.15.146:0/3417870732 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f26cc12b790 0x7f26cc096280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:57.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.670+0000 7f26d31da700 1 --2- 172.21.15.146:0/3417870732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26cc05f560 0x7f26cc12ae80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.670+0000 7f26d31da700 1 --2- 172.21.15.146:0/3417870732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26cc12b370 0x7f26cc095d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:57.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.670+0000 7f26d31da700 1 -- 172.21.15.146:0/3417870732 >> 172.21.15.146:0/3417870732 conn(0x7f26cc09a1c0 msgr2=0x7f26cc09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.670+0000 7f26d31da700 1 -- 172.21.15.146:0/3417870732 shutdown_connections 2023-10-03T10:09:57.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.670+0000 7f26d31da700 1 -- 172.21.15.146:0/3417870732 wait complete. 2023-10-03T10:09:57.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.671+0000 7f26d31da700 1 Processor -- start 2023-10-03T10:09:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.671+0000 7f26d31da700 1 -- start start 2023-10-03T10:09:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.672+0000 7f26d31da700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26cc05f560 0x7f26cc11b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.672+0000 7f26d31da700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26cc12b370 0x7f26cc128370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.672+0000 7f26d31da700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f26cc12b790 0x7f26cc1172a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.672+0000 7f26d31da700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc129440 con 0x7f26cc12b370 2023-10-03T10:09:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.672+0000 7f26d31da700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0671c0 con 0x7f26cc05f560 2023-10-03T10:09:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.672+0000 7f26d31da700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc128860 con 0x7f26cc12b790 2023-10-03T10:09:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.672+0000 7f26d0f76700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26cc05f560 0x7f26cc11b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.672+0000 7f26d0f76700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26cc05f560 0x7f26cc11b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58602/0 (socket says 172.21.15.146:58602) 2023-10-03T10:09:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.672+0000 7f26cbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26cc12b370 0x7f26cc128370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.672+0000 7f26d0f76700 1 -- 172.21.15.146:0/2407859369 learned_addr learned my addr 172.21.15.146:0/2407859369 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.672+0000 7f26d1777700 1 --2- 172.21.15.146:0/2407859369 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f26cc12b790 0x7f26cc1172a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.672+0000 7f26d0f76700 1 -- 172.21.15.146:0/2407859369 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f26cc12b790 msgr2=0x7f26cc1172a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.672+0000 7f26d0f76700 1 --2- 172.21.15.146:0/2407859369 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f26cc12b790 0x7f26cc1172a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.672+0000 7f26d0f76700 1 -- 172.21.15.146:0/2407859369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26cc12b370 msgr2=0x7f26cc128370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.672+0000 7f26d0f76700 1 --2- 172.21.15.146:0/2407859369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26cc12b370 0x7f26cc128370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.672+0000 7f26d0f76700 1 -- 172.21.15.146:0/2407859369 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c0009370 con 0x7f26cc05f560 2023-10-03T10:09:57.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.672+0000 7f26d1777700 1 --2- 172.21.15.146:0/2407859369 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f26cc12b790 0x7f26cc1172a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:09:57.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.672+0000 7f26cbfff700 1 --2- 172.21.15.146:0/2407859369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26cc12b370 0x7f26cc128370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:57.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.673+0000 7f26d0f76700 1 --2- 172.21.15.146:0/2407859369 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26cc05f560 0x7f26cc11b240 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f26c0006db0 tx=0x7f26c0017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.673+0000 7f26c8ff9700 1 -- 172.21.15.146:0/2407859369 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c000b8d0 con 0x7f26cc05f560 2023-10-03T10:09:57.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.673+0000 7f26c8ff9700 1 -- 172.21.15.146:0/2407859369 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c000ba30 con 0x7f26cc05f560 2023-10-03T10:09:57.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.673+0000 7f26d31da700 1 -- 172.21.15.146:0/2407859369 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26cc11a7a0 con 0x7f26cc05f560 2023-10-03T10:09:57.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.673+0000 7f26c8ff9700 1 -- 172.21.15.146:0/2407859369 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c001c650 con 0x7f26cc05f560 2023-10-03T10:09:57.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.673+0000 7f26d31da700 1 -- 172.21.15.146:0/2407859369 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26cc118ff0 con 0x7f26cc05f560 2023-10-03T10:09:57.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.673+0000 7f26c8ff9700 1 -- 172.21.15.146:0/2407859369 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f26c001ca00 con 0x7f26cc05f560 2023-10-03T10:09:57.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.674+0000 7f26c8ff9700 1 -- 172.21.15.146:0/2407859369 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f26c003c930 con 0x7f26cc05f560 2023-10-03T10:09:57.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.674+0000 7f26d31da700 1 -- 172.21.15.146:0/2407859369 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26cc05a260 con 0x7f26cc05f560 2023-10-03T10:09:57.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.678+0000 7f26c8ff9700 1 -- 172.21.15.146:0/2407859369 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f26c0020070 con 0x7f26cc05f560 2023-10-03T10:09:57.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.679+0000 7f50eff7f700 1 Processor -- start 2023-10-03T10:09:57.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.679+0000 7f50eff7f700 1 -- start start 2023-10-03T10:09:57.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.680+0000 7f50eff7f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50e805f560 0x7f50e8096840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.680+0000 7f50eff7f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f50e812cbd0 0x7f50e812efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.680+0000 7f50eff7f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e80933e0 con 0x7f50e8069d90 2023-10-03T10:09:57.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.680+0000 7f50eff7f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e805f940 con 0x7f50e812cbd0 2023-10-03T10:09:57.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.680+0000 7f50eff7f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50e8097440 con 0x7f50e805f560 2023-10-03T10:09:57.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.680+0000 7f50edd1b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50e805f560 0x7f50e8096840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.680+0000 7f50edd1b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50e805f560 0x7f50e8096840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36660/0 (socket says 172.21.15.146:36660) 2023-10-03T10:09:57.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.680+0000 7f50edd1b700 1 -- 172.21.15.146:0/30279969 learned_addr learned my addr 172.21.15.146:0/30279969 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:57.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.680+0000 7f50edd1b700 1 -- 172.21.15.146:0/30279969 >> v2:172.21.15.146:3300/0 conn(0x7f50e812cbd0 msgr2=0x7f50e812efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:57.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.680+0000 7f50edd1b700 1 --2- 172.21.15.146:0/30279969 >> v2:172.21.15.146:3300/0 conn(0x7f50e812cbd0 0x7f50e812efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:57.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.680+0000 7f50edd1b700 1 -- 172.21.15.146:0/30279969 >> v1:172.21.15.146:6789/0 conn(0x7f50e8069d90 legacy=0x7f50e8096d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:57.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.680+0000 7f50edd1b700 1 -- 172.21.15.146:0/30279969 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e80921e0 con 0x7f50e805f560 2023-10-03T10:09:57.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.680+0000 7f50edd1b700 1 --2- 172.21.15.146:0/30279969 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50e805f560 0x7f50e8096840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f50e4006fd0 tx=0x7f50e40090f0).ready entity=mon.2 client_cookie=fa8a4e09b1ed8005 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.680+0000 7f50ecd19700 1 -- 172.21.15.146:0/30279969 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e400b600 con 0x7f50e805f560 2023-10-03T10:09:57.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.681+0000 7f50ecd19700 1 -- 172.21.15.146:0/30279969 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e400b760 con 0x7f50e805f560 2023-10-03T10:09:57.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.681+0000 7f50ecd19700 1 -- 172.21.15.146:0/30279969 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e400bae0 con 0x7f50e805f560 2023-10-03T10:09:57.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.682+0000 7f50eff7f700 1 -- 172.21.15.146:0/30279969 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50e805f560 msgr2=0x7f50e8096840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.682+0000 7f50eff7f700 1 --2- 172.21.15.146:0/30279969 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50e805f560 0x7f50e8096840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f50e4006fd0 tx=0x7f50e40090f0).stop 2023-10-03T10:09:57.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.682+0000 7f50eff7f700 1 -- 172.21.15.146:0/30279969 shutdown_connections 2023-10-03T10:09:57.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.682+0000 7f50eff7f700 1 --2- 172.21.15.146:0/30279969 >> v2:172.21.15.146:3300/0 conn(0x7f50e812cbd0 0x7f50e812efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:57.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.682+0000 7f50eff7f700 1 --2- 172.21.15.146:0/30279969 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50e805f560 0x7f50e8096840 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.682+0000 7f50eff7f700 1 -- 172.21.15.146:0/30279969 >> 172.21.15.146:0/30279969 conn(0x7f50e809a1c0 msgr2=0x7f50e809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.682+0000 7f50eff7f700 1 -- 172.21.15.146:0/30279969 shutdown_connections 2023-10-03T10:09:57.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.682+0000 7f50eff7f700 1 -- 172.21.15.146:0/30279969 wait complete. 2023-10-03T10:09:57.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.683+0000 7f50eff7f700 1 Processor -- start 2023-10-03T10:09:57.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.683+0000 7f50eff7f700 1 -- start start 2023-10-03T10:09:57.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.684+0000 7f50eff7f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50e805f560 0x7f50e8117710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.684+0000 7f50eff7f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50e812cbd0 0x7f50e8117c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.684+0000 7f50eff7f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50e81180f0 0x7f50e813a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.684+0000 7f50eff7f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e8091dc0 con 0x7f50e805f560 2023-10-03T10:09:57.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.684+0000 7f50eff7f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e811a790 con 0x7f50e81180f0 2023-10-03T10:09:57.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.684+0000 7f50eff7f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50e811a4d0 con 0x7f50e812cbd0 2023-10-03T10:09:57.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.684+0000 7f50edd1b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50e805f560 0x7f50e8117710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.684+0000 7f50edd1b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50e805f560 0x7f50e8117710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47072/0 (socket says 172.21.15.146:47072) 2023-10-03T10:09:57.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.684+0000 7f50edd1b700 1 -- 172.21.15.146:0/1088950387 learned_addr learned my addr 172.21.15.146:0/1088950387 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:57.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.684+0000 7f50ee51c700 1 --2- 172.21.15.146:0/1088950387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50e81180f0 0x7f50e813a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.684+0000 7f50ed51a700 1 --2- 172.21.15.146:0/1088950387 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50e812cbd0 0x7f50e8117c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.684+0000 7f50ed51a700 1 -- 172.21.15.146:0/1088950387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50e81180f0 msgr2=0x7f50e813a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.684+0000 7f50ed51a700 1 --2- 172.21.15.146:0/1088950387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50e81180f0 0x7f50e813a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.684+0000 7f50ed51a700 1 -- 172.21.15.146:0/1088950387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50e805f560 msgr2=0x7f50e8117710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.684+0000 7f50ed51a700 1 --2- 172.21.15.146:0/1088950387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50e805f560 0x7f50e8117710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.684+0000 7f50ed51a700 1 -- 172.21.15.146:0/1088950387 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e4009370 con 0x7f50e812cbd0 2023-10-03T10:09:57.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.685+0000 7f50ed51a700 1 --2- 172.21.15.146:0/1088950387 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50e812cbd0 0x7f50e8117c00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f50d800b460 tx=0x7f50d8006f00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.685+0000 7f50ddffb700 1 -- 172.21.15.146:0/1088950387 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d8012410 con 0x7f50e812cbd0 2023-10-03T10:09:57.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.685+0000 7f50ddffb700 1 -- 172.21.15.146:0/1088950387 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d8012590 con 0x7f50e812cbd0 2023-10-03T10:09:57.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.685+0000 7f50ddffb700 1 -- 172.21.15.146:0/1088950387 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d8012950 con 0x7f50e812cbd0 2023-10-03T10:09:57.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.685+0000 7f50eff7f700 1 -- 172.21.15.146:0/1088950387 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e8117360 con 0x7f50e812cbd0 2023-10-03T10:09:57.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.685+0000 7f50eff7f700 1 -- 172.21.15.146:0/1088950387 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e811b310 con 0x7f50e812cbd0 2023-10-03T10:09:57.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.686+0000 7f50eff7f700 1 -- 172.21.15.146:0/1088950387 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e805a260 con 0x7f50e812cbd0 2023-10-03T10:09:57.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.686+0000 7f50ddffb700 1 -- 172.21.15.146:0/1088950387 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f50d8012cc0 con 0x7f50e812cbd0 2023-10-03T10:09:57.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.687+0000 7f50ddffb700 1 -- 172.21.15.146:0/1088950387 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f50d803a980 con 0x7f50e812cbd0 2023-10-03T10:09:57.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.695+0000 7f50ddffb700 1 -- 172.21.15.146:0/1088950387 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f50d800f2c0 con 0x7f50e812cbd0 2023-10-03T10:09:57.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.731+0000 7f6c33252700 1 Processor -- start 2023-10-03T10:09:57.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.731+0000 7f6c33252700 1 -- start start 2023-10-03T10:09:57.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.732+0000 7f6c33252700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c2c062b00 0x7f6c2c095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.732+0000 7f6c33252700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6c2c0966b0 0x7f6c2c132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.732+0000 7f6c33252700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c2c091980 con 0x7f6c2c095b80 2023-10-03T10:09:57.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.732+0000 7f6c33252700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c2c0973f0 con 0x7f6c2c0966b0 2023-10-03T10:09:57.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.732+0000 7f6c33252700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c062ee0 con 0x7f6c2c062b00 2023-10-03T10:09:57.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.732+0000 7f6c30fee700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c2c062b00 0x7f6c2c095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.732+0000 7f6c30fee700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c2c062b00 0x7f6c2c095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36690/0 (socket says 172.21.15.146:36690) 2023-10-03T10:09:57.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.732+0000 7f6c30fee700 1 -- 172.21.15.146:0/3314875181 learned_addr learned my addr 172.21.15.146:0/3314875181 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:57.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.732+0000 7f6c317ef700 1 --2- 172.21.15.146:0/3314875181 >> v2:172.21.15.146:3300/0 conn(0x7f6c2c0966b0 0x7f6c2c132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.732+0000 7f6c30fee700 1 -- 172.21.15.146:0/3314875181 >> v2:172.21.15.146:3300/0 conn(0x7f6c2c0966b0 msgr2=0x7f6c2c132290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:57.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.732+0000 7f6c30fee700 1 --2- 172.21.15.146:0/3314875181 >> v2:172.21.15.146:3300/0 conn(0x7f6c2c0966b0 0x7f6c2c132290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.732+0000 7f6c30fee700 1 -- 172.21.15.146:0/3314875181 >> v1:172.21.15.146:6789/0 conn(0x7f6c2c095b80 legacy=0x7f6c2c095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.732+0000 7f6c30fee700 1 -- 172.21.15.146:0/3314875181 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c092310 con 0x7f6c2c062b00 2023-10-03T10:09:57.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.733+0000 7f6c30fee700 1 --2- 172.21.15.146:0/3314875181 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c2c062b00 0x7f6c2c095690 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f6c20009830 tx=0x7f6c200090f0).ready entity=mon.2 client_cookie=c94b4a5536d05a89 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.733+0000 7f6c2b7fe700 1 -- 172.21.15.146:0/3314875181 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2000b580 con 0x7f6c2c062b00 2023-10-03T10:09:57.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.733+0000 7f6c2b7fe700 1 -- 172.21.15.146:0/3314875181 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2000b6e0 con 0x7f6c2c062b00 2023-10-03T10:09:57.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.733+0000 7f6c2b7fe700 1 -- 172.21.15.146:0/3314875181 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2000ba60 con 0x7f6c2c062b00 2023-10-03T10:09:57.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.734+0000 7f6c33252700 1 -- 172.21.15.146:0/3314875181 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c2c062b00 msgr2=0x7f6c2c095690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.734+0000 7f6c33252700 1 --2- 172.21.15.146:0/3314875181 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c2c062b00 0x7f6c2c095690 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f6c20009830 tx=0x7f6c200090f0).stop 2023-10-03T10:09:57.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.734+0000 7f6c33252700 1 -- 172.21.15.146:0/3314875181 shutdown_connections 2023-10-03T10:09:57.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.734+0000 7f6c33252700 1 --2- 172.21.15.146:0/3314875181 >> v2:172.21.15.146:3300/0 conn(0x7f6c2c0966b0 0x7f6c2c132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.734+0000 7f6c33252700 1 --2- 172.21.15.146:0/3314875181 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c2c062b00 0x7f6c2c095690 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.734+0000 7f6c33252700 1 -- 172.21.15.146:0/3314875181 >> 172.21.15.146:0/3314875181 conn(0x7f6c2c09aa50 msgr2=0x7f6c2c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.734+0000 7f6c33252700 1 -- 172.21.15.146:0/3314875181 shutdown_connections 2023-10-03T10:09:57.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.734+0000 7f6c33252700 1 -- 172.21.15.146:0/3314875181 wait complete. 2023-10-03T10:09:57.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.735+0000 7f6c33252700 1 Processor -- start 2023-10-03T10:09:57.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.735+0000 7f6c33252700 1 -- start start 2023-10-03T10:09:57.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.736+0000 7f6c33252700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c2c062b00 0x7f6c2c118920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.736+0000 7f6c33252700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c2c095b80 0x7f6c2c115a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.736+0000 7f6c33252700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c2c0966b0 0x7f6c2c115f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.736+0000 7f6c33252700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c116f20 con 0x7f6c2c095b80 2023-10-03T10:09:57.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.736+0000 7f6c33252700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c096da0 con 0x7f6c2c062b00 2023-10-03T10:09:57.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.736+0000 7f6c33252700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c1191a0 con 0x7f6c2c0966b0 2023-10-03T10:09:57.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.736+0000 7f6c317ef700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c2c0966b0 0x7f6c2c115f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.736+0000 7f6c317ef700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c2c0966b0 0x7f6c2c115f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36694/0 (socket says 172.21.15.146:36694) 2023-10-03T10:09:57.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.736+0000 7f6c317ef700 1 -- 172.21.15.146:0/4099563722 learned_addr learned my addr 172.21.15.146:0/4099563722 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:57.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.736+0000 7f6c30fee700 1 --2- 172.21.15.146:0/4099563722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c2c062b00 0x7f6c2c118920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.736+0000 7f6c2bfff700 1 --2- 172.21.15.146:0/4099563722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c2c095b80 0x7f6c2c115a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.736+0000 7f6c317ef700 1 -- 172.21.15.146:0/4099563722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c2c062b00 msgr2=0x7f6c2c118920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.736+0000 7f6c317ef700 1 --2- 172.21.15.146:0/4099563722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c2c062b00 0x7f6c2c118920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.736+0000 7f6c317ef700 1 -- 172.21.15.146:0/4099563722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c2c095b80 msgr2=0x7f6c2c115a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.736+0000 7f6c317ef700 1 --2- 172.21.15.146:0/4099563722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c2c095b80 0x7f6c2c115a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.736+0000 7f6c317ef700 1 -- 172.21.15.146:0/4099563722 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c20009370 con 0x7f6c2c0966b0 2023-10-03T10:09:57.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.736+0000 7f6c317ef700 1 --2- 172.21.15.146:0/4099563722 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c2c0966b0 0x7f6c2c115f70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6c24009ef0 tx=0x7f6c2400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.737+0000 7f6c28ff9700 1 -- 172.21.15.146:0/4099563722 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24009c50 con 0x7f6c2c0966b0 2023-10-03T10:09:57.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.737+0000 7f6c28ff9700 1 -- 172.21.15.146:0/4099563722 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2400f040 con 0x7f6c2c0966b0 2023-10-03T10:09:57.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.737+0000 7f6c28ff9700 1 -- 172.21.15.146:0/4099563722 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2400ce70 con 0x7f6c2c0966b0 2023-10-03T10:09:57.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.737+0000 7f6c33252700 1 -- 172.21.15.146:0/4099563722 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c2c119b20 con 0x7f6c2c0966b0 2023-10-03T10:09:57.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.737+0000 7f6c33252700 1 -- 172.21.15.146:0/4099563722 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2c117570 con 0x7f6c2c0966b0 2023-10-03T10:09:57.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.738+0000 7f6c28ff9700 1 -- 172.21.15.146:0/4099563722 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6c24013610 con 0x7f6c2c0966b0 2023-10-03T10:09:57.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.738+0000 7f6c28ff9700 1 -- 172.21.15.146:0/4099563722 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f6c2403b800 con 0x7f6c2c0966b0 2023-10-03T10:09:57.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.738+0000 7f6c33252700 1 -- 172.21.15.146:0/4099563722 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c2c1193e0 con 0x7f6c2c0966b0 2023-10-03T10:09:57.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.742+0000 7f42cc6e7700 1 Processor -- start 2023-10-03T10:09:57.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.742+0000 7f42cc6e7700 1 -- start start 2023-10-03T10:09:57.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.743+0000 7f6c28ff9700 1 -- 172.21.15.146:0/4099563722 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6c2401d460 con 0x7f6c2c0966b0 2023-10-03T10:09:57.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.743+0000 7f42cc6e7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42c4062b00 0x7f42c4095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.743+0000 7f42cc6e7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42c4095b80 0x7f42c4095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.743+0000 7f42cc6e7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c4091980 con 0x7f42c4096490 2023-10-03T10:09:57.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.743+0000 7f42cc6e7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c40973f0 con 0x7f42c4095b80 2023-10-03T10:09:57.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.743+0000 7f42cc6e7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4062ee0 con 0x7f42c4062b00 2023-10-03T10:09:57.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.744+0000 7f42c9c82700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42c4095b80 0x7f42c4095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.744+0000 7f42c9c82700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42c4095b80 0x7f42c4095fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58628/0 (socket says 172.21.15.146:58628) 2023-10-03T10:09:57.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.744+0000 7f42c9c82700 1 -- 172.21.15.146:0/3191200271 learned_addr learned my addr 172.21.15.146:0/3191200271 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:57.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.744+0000 7f42c9c82700 1 -- 172.21.15.146:0/3191200271 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42c4062b00 msgr2=0x7f42c4095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:57.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.744+0000 7f42c9c82700 1 --2- 172.21.15.146:0/3191200271 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42c4062b00 0x7f42c4095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:57.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.744+0000 7f42c9c82700 1 -- 172.21.15.146:0/3191200271 >> v1:172.21.15.146:6789/0 conn(0x7f42c4096490 legacy=0x7f42c4131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:57.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.744+0000 7f42c9c82700 1 -- 172.21.15.146:0/3191200271 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c4092310 con 0x7f42c4095b80 2023-10-03T10:09:57.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.744+0000 7f42c9c82700 1 --2- 172.21.15.146:0/3191200271 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42c4095b80 0x7f42c4095fa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f42b4009830 tx=0x7f42b40090f0).ready entity=mon.1 client_cookie=1345e8ecd866f0ee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.746+0000 7f42c9481700 1 -- 172.21.15.146:0/3191200271 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b400b600 con 0x7f42c4095b80 2023-10-03T10:09:57.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.746+0000 7f42c9481700 1 -- 172.21.15.146:0/3191200271 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b400b760 con 0x7f42c4095b80 2023-10-03T10:09:57.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.746+0000 7f42c9481700 1 -- 172.21.15.146:0/3191200271 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b400bae0 con 0x7f42c4095b80 2023-10-03T10:09:57.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.747+0000 7f42cc6e7700 1 -- 172.21.15.146:0/3191200271 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42c4095b80 msgr2=0x7f42c4095fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.747+0000 7f42cc6e7700 1 --2- 172.21.15.146:0/3191200271 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42c4095b80 0x7f42c4095fa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f42b4009830 tx=0x7f42b40090f0).stop 2023-10-03T10:09:57.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.747+0000 7f42cc6e7700 1 -- 172.21.15.146:0/3191200271 shutdown_connections 2023-10-03T10:09:57.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.747+0000 7f42cc6e7700 1 --2- 172.21.15.146:0/3191200271 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42c4062b00 0x7f42c4095690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:57.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.747+0000 7f42cc6e7700 1 --2- 172.21.15.146:0/3191200271 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42c4095b80 0x7f42c4095fa0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.747+0000 7f42cc6e7700 1 -- 172.21.15.146:0/3191200271 >> 172.21.15.146:0/3191200271 conn(0x7f42c409aa50 msgr2=0x7f42c409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.748+0000 7f42cc6e7700 1 -- 172.21.15.146:0/3191200271 shutdown_connections 2023-10-03T10:09:57.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.748+0000 7f42cc6e7700 1 -- 172.21.15.146:0/3191200271 wait complete. 2023-10-03T10:09:57.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.749+0000 7f42cc6e7700 1 Processor -- start 2023-10-03T10:09:57.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.749+0000 7f42cc6e7700 1 -- start start 2023-10-03T10:09:57.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.749+0000 7f42cc6e7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42c4062b00 0x7f42c4119990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.749+0000 7f42cc6e7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42c4095b80 0x7f42c41159f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.749+0000 7f42cc6e7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42c4096490 0x7f42c4115ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.749+0000 7f42cc6e7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c412db60 con 0x7f42c4062b00 2023-10-03T10:09:57.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.749+0000 7f42cc6e7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4118050 con 0x7f42c4095b80 2023-10-03T10:09:57.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.749+0000 7f42cc6e7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4118ef0 con 0x7f42c4096490 2023-10-03T10:09:57.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.750+0000 7f42c9c82700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42c4095b80 0x7f42c41159f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.750+0000 7f42c9c82700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42c4095b80 0x7f42c41159f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58642/0 (socket says 172.21.15.146:58642) 2023-10-03T10:09:57.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.750+0000 7f42c9c82700 1 -- 172.21.15.146:0/3889810252 learned_addr learned my addr 172.21.15.146:0/3889810252 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:57.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.750+0000 7f42cac84700 1 --2- 172.21.15.146:0/3889810252 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42c4096490 0x7f42c4115ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.750+0000 7f42ca483700 1 --2- 172.21.15.146:0/3889810252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42c4062b00 0x7f42c4119990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.750+0000 7f42c9c82700 1 -- 172.21.15.146:0/3889810252 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42c4096490 msgr2=0x7f42c4115ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.750+0000 7f42c9c82700 1 --2- 172.21.15.146:0/3889810252 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42c4096490 0x7f42c4115ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.750+0000 7f42c9c82700 1 -- 172.21.15.146:0/3889810252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42c4062b00 msgr2=0x7f42c4119990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.750+0000 7f42c9c82700 1 --2- 172.21.15.146:0/3889810252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42c4062b00 0x7f42c4119990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.750+0000 7f42c9c82700 1 -- 172.21.15.146:0/3889810252 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b4009370 con 0x7f42c4095b80 2023-10-03T10:09:57.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.750+0000 7f42c9c82700 1 --2- 172.21.15.146:0/3889810252 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42c4095b80 0x7f42c41159f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f42b4009130 tx=0x7f42b4017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.751+0000 7f42ba7fc700 1 -- 172.21.15.146:0/3889810252 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b400b8d0 con 0x7f42c4095b80 2023-10-03T10:09:57.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.751+0000 7f42ba7fc700 1 -- 172.21.15.146:0/3889810252 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b400ba30 con 0x7f42c4095b80 2023-10-03T10:09:57.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.751+0000 7f42cc6e7700 1 -- 172.21.15.146:0/3889810252 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c4119490 con 0x7f42c4095b80 2023-10-03T10:09:57.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.751+0000 7f42ba7fc700 1 -- 172.21.15.146:0/3889810252 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b401a430 con 0x7f42c4095b80 2023-10-03T10:09:57.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.751+0000 7f42cc6e7700 1 -- 172.21.15.146:0/3889810252 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c4117580 con 0x7f42c4095b80 2023-10-03T10:09:57.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.752+0000 7f42ba7fc700 1 -- 172.21.15.146:0/3889810252 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f42b4021020 con 0x7f42c4095b80 2023-10-03T10:09:57.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.752+0000 7f42ba7fc700 1 -- 172.21.15.146:0/3889810252 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f42b403ca90 con 0x7f42c4095b80 2023-10-03T10:09:57.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.753+0000 7f42cc6e7700 1 -- 172.21.15.146:0/3889810252 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c4117710 con 0x7f42c4095b80 2023-10-03T10:09:57.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.764+0000 7f42ba7fc700 1 -- 172.21.15.146:0/3889810252 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f42b402c940 con 0x7f42c4095b80 2023-10-03T10:09:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.856+0000 7f26d31da700 1 -- 172.21.15.146:0/2407859369 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f26cc12ab70 con 0x7f26cc05f560 2023-10-03T10:09:57.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.856+0000 7f26c8ff9700 1 -- 172.21.15.146:0/2407859369 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f26c0020020 con 0x7f26cc05f560 2023-10-03T10:09:57.857 INFO:teuthology.orchestra.run.smithi146.stdout:38654705668 2023-10-03T10:09:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.858+0000 7f26d31da700 1 -- 172.21.15.146:0/2407859369 >> v1:172.21.15.146:6816/118159 conn(0x7f26b002bb60 legacy=0x7f26b002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.858+0000 7f26d31da700 1 -- 172.21.15.146:0/2407859369 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26cc05f560 msgr2=0x7f26cc11b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.858+0000 7f26d31da700 1 --2- 172.21.15.146:0/2407859369 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26cc05f560 0x7f26cc11b240 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f26c0006db0 tx=0x7f26c0017000).stop 2023-10-03T10:09:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.858+0000 7f26d31da700 1 -- 172.21.15.146:0/2407859369 shutdown_connections 2023-10-03T10:09:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.858+0000 7f26d31da700 1 --2- 172.21.15.146:0/2407859369 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f26cc12b790 0x7f26cc1172a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.858+0000 7f26d31da700 1 --2- 172.21.15.146:0/2407859369 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26cc05f560 0x7f26cc11b240 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.858+0000 7f26d31da700 1 --2- 172.21.15.146:0/2407859369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26cc12b370 0x7f26cc128370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.858+0000 7f26d31da700 1 -- 172.21.15.146:0/2407859369 >> 172.21.15.146:0/2407859369 conn(0x7f26cc09a1c0 msgr2=0x7f26cc0664c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.858+0000 7f26d31da700 1 -- 172.21.15.146:0/2407859369 shutdown_connections 2023-10-03T10:09:57.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.858+0000 7f26d31da700 1 -- 172.21.15.146:0/2407859369 wait complete. 2023-10-03T10:09:57.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2023-10-03T10:09:57.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.872+0000 7f50eff7f700 1 -- 172.21.15.146:0/1088950387 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f50e811b310 con 0x7f50e812cbd0 2023-10-03T10:09:57.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.873+0000 7f50ddffb700 1 -- 172.21.15.146:0/1088950387 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f50e811b310 con 0x7f50e812cbd0 2023-10-03T10:09:57.873 INFO:teuthology.orchestra.run.smithi146.stdout:38654705667 2023-10-03T10:09:57.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.875+0000 7f50eff7f700 1 -- 172.21.15.146:0/1088950387 >> v1:172.21.15.146:6816/118159 conn(0x7f50cc02bbe0 legacy=0x7f50cc02e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.875+0000 7f50eff7f700 1 -- 172.21.15.146:0/1088950387 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50e812cbd0 msgr2=0x7f50e8117c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.875+0000 7f50eff7f700 1 --2- 172.21.15.146:0/1088950387 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50e812cbd0 0x7f50e8117c00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f50d800b460 tx=0x7f50d8006f00).stop 2023-10-03T10:09:57.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.875+0000 7f50eff7f700 1 -- 172.21.15.146:0/1088950387 shutdown_connections 2023-10-03T10:09:57.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.875+0000 7f50eff7f700 1 --2- 172.21.15.146:0/1088950387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50e81180f0 0x7f50e813a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.875+0000 7f50eff7f700 1 --2- 172.21.15.146:0/1088950387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50e805f560 0x7f50e8117710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.875+0000 7f50eff7f700 1 --2- 172.21.15.146:0/1088950387 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50e812cbd0 0x7f50e8117c00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.875+0000 7f50eff7f700 1 -- 172.21.15.146:0/1088950387 >> 172.21.15.146:0/1088950387 conn(0x7f50e809a1c0 msgr2=0x7f50e8098ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.875+0000 7f50eff7f700 1 -- 172.21.15.146:0/1088950387 shutdown_connections 2023-10-03T10:09:57.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.875+0000 7f50eff7f700 1 -- 172.21.15.146:0/1088950387 wait complete. 2023-10-03T10:09:57.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.1 2023-10-03T10:09:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.914+0000 7f6c33252700 1 -- 172.21.15.146:0/4099563722 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6c2c05a260 con 0x7f6c2c0966b0 2023-10-03T10:09:57.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.914+0000 7f6c28ff9700 1 -- 172.21.15.146:0/4099563722 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6c24007340 con 0x7f6c2c0966b0 2023-10-03T10:09:57.915 INFO:teuthology.orchestra.run.smithi146.stdout:38654705667 2023-10-03T10:09:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.916+0000 7f6c33252700 1 -- 172.21.15.146:0/4099563722 >> v1:172.21.15.146:6816/118159 conn(0x7f6c1002bb60 legacy=0x7f6c1002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.916+0000 7f6c33252700 1 -- 172.21.15.146:0/4099563722 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c2c0966b0 msgr2=0x7f6c2c115f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.916+0000 7f6c33252700 1 --2- 172.21.15.146:0/4099563722 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c2c0966b0 0x7f6c2c115f70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6c24009ef0 tx=0x7f6c2400b040).stop 2023-10-03T10:09:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.916+0000 7f6c33252700 1 -- 172.21.15.146:0/4099563722 shutdown_connections 2023-10-03T10:09:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.916+0000 7f6c33252700 1 --2- 172.21.15.146:0/4099563722 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c2c0966b0 0x7f6c2c115f70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.916+0000 7f6c33252700 1 --2- 172.21.15.146:0/4099563722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c2c062b00 0x7f6c2c118920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.916+0000 7f6c33252700 1 --2- 172.21.15.146:0/4099563722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c2c095b80 0x7f6c2c115a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.916+0000 7f6c33252700 1 -- 172.21.15.146:0/4099563722 >> 172.21.15.146:0/4099563722 conn(0x7f6c2c09aa50 msgr2=0x7f6c2c130140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.916+0000 7f6c33252700 1 -- 172.21.15.146:0/4099563722 shutdown_connections 2023-10-03T10:09:57.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.916+0000 7f6c33252700 1 -- 172.21.15.146:0/4099563722 wait complete. 2023-10-03T10:09:57.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.3 2023-10-03T10:09:57.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.934+0000 7f42cc6e7700 1 -- 172.21.15.146:0/3889810252 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f42c405a260 con 0x7f42c4095b80 2023-10-03T10:09:57.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.934+0000 7f42ba7fc700 1 -- 172.21.15.146:0/3889810252 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42b4032070 con 0x7f42c4095b80 2023-10-03T10:09:57.935 INFO:teuthology.orchestra.run.smithi146.stdout:38654705667 2023-10-03T10:09:57.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.936+0000 7f42cc6e7700 1 -- 172.21.15.146:0/3889810252 >> v1:172.21.15.146:6816/118159 conn(0x7f42a802bb60 legacy=0x7f42a802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.936+0000 7f42cc6e7700 1 -- 172.21.15.146:0/3889810252 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42c4095b80 msgr2=0x7f42c41159f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.936+0000 7f42cc6e7700 1 --2- 172.21.15.146:0/3889810252 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42c4095b80 0x7f42c41159f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f42b4009130 tx=0x7f42b4017000).stop 2023-10-03T10:09:57.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.936+0000 7f42cc6e7700 1 -- 172.21.15.146:0/3889810252 shutdown_connections 2023-10-03T10:09:57.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.936+0000 7f42cc6e7700 1 --2- 172.21.15.146:0/3889810252 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42c4096490 0x7f42c4115ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.936+0000 7f42cc6e7700 1 --2- 172.21.15.146:0/3889810252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42c4062b00 0x7f42c4119990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.936+0000 7f42cc6e7700 1 --2- 172.21.15.146:0/3889810252 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42c4095b80 0x7f42c41159f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.936+0000 7f42cc6e7700 1 -- 172.21.15.146:0/3889810252 >> 172.21.15.146:0/3889810252 conn(0x7f42c409aa50 msgr2=0x7f42c4130150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.936+0000 7f42cc6e7700 1 -- 172.21.15.146:0/3889810252 shutdown_connections 2023-10-03T10:09:57.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:57.936+0000 7f42cc6e7700 1 -- 172.21.15.146:0/3889810252 wait complete. 2023-10-03T10:09:57.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.2 2023-10-03T10:09:58.871 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:09:58.888 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:09:58.929 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:09:58.949 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:09:59.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.011+0000 7f644f6e0700 1 Processor -- start 2023-10-03T10:09:59.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.011+0000 7f644f6e0700 1 -- start start 2023-10-03T10:09:59.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.011+0000 7f644f6e0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6448068680 0x7f6448067920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.011+0000 7f644f6e0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f644812dee0 0x7f64481302d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.011+0000 7f644f6e0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6448069a10 con 0x7f6448066e30 2023-10-03T10:09:59.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.011+0000 7f644f6e0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6448069090 con 0x7f6448068680 2023-10-03T10:09:59.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.011+0000 7f644f6e0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64480694e0 con 0x7f644812dee0 2023-10-03T10:09:59.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.012+0000 7f644cc7b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6448068680 0x7f6448067920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.012+0000 7f644d47c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6448066e30 0x7f6448067210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33680/0 (socket says 172.21.15.146:33680) 2023-10-03T10:09:59.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.012+0000 7f644d47c700 1 -- 172.21.15.146:0/1652303858 learned_addr learned my addr 172.21.15.146:0/1652303858 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:09:59.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.012+0000 7f644dc7d700 1 --2- 172.21.15.146:0/1652303858 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f644812dee0 0x7f64481302d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.012+0000 7f643ffff700 1 -- 172.21.15.146:0/1652303858 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568054327 0 0) 0x7f6448069a10 con 0x7f6448066e30 2023-10-03T10:09:59.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.012+0000 7f643ffff700 1 -- 172.21.15.146:0/1652303858 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64340033f0 con 0x7f6448066e30 2023-10-03T10:09:59.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.012+0000 7f644cc7b700 1 -- 172.21.15.146:0/1652303858 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f644812dee0 msgr2=0x7f64481302d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:59.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.012+0000 7f644cc7b700 1 --2- 172.21.15.146:0/1652303858 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f644812dee0 0x7f64481302d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.012+0000 7f644cc7b700 1 -- 172.21.15.146:0/1652303858 >> v1:172.21.15.146:6789/0 conn(0x7f6448066e30 legacy=0x7f6448067210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.012+0000 7f644cc7b700 1 -- 172.21.15.146:0/1652303858 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6448068b00 con 0x7f6448068680 2023-10-03T10:09:59.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.012+0000 7f644cc7b700 1 --2- 172.21.15.146:0/1652303858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6448068680 0x7f6448067920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6438009790 tx=0x7f6438009060).ready entity=mon.1 client_cookie=73fedab8f199a3b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.012+0000 7f643ffff700 1 -- 172.21.15.146:0/1652303858 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64380090d0 con 0x7f6448068680 2023-10-03T10:09:59.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.013+0000 7f643ffff700 1 -- 172.21.15.146:0/1652303858 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643800f510 con 0x7f6448068680 2023-10-03T10:09:59.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.013+0000 7f643ffff700 1 -- 172.21.15.146:0/1652303858 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643800f890 con 0x7f6448068680 2023-10-03T10:09:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.013+0000 7f644f6e0700 1 -- 172.21.15.146:0/1652303858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6448068680 msgr2=0x7f6448067920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.013+0000 7f644f6e0700 1 --2- 172.21.15.146:0/1652303858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6448068680 0x7f6448067920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6438009790 tx=0x7f6438009060).stop 2023-10-03T10:09:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.013+0000 7f644f6e0700 1 -- 172.21.15.146:0/1652303858 shutdown_connections 2023-10-03T10:09:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.013+0000 7f644f6e0700 1 --2- 172.21.15.146:0/1652303858 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f644812dee0 0x7f64481302d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.013+0000 7f644f6e0700 1 --2- 172.21.15.146:0/1652303858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6448068680 0x7f6448067920 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.014+0000 7f644f6e0700 1 -- 172.21.15.146:0/1652303858 >> 172.21.15.146:0/1652303858 conn(0x7f644809a230 msgr2=0x7f644809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.014+0000 7f644f6e0700 1 -- 172.21.15.146:0/1652303858 shutdown_connections 2023-10-03T10:09:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.014+0000 7f644f6e0700 1 -- 172.21.15.146:0/1652303858 wait complete. 2023-10-03T10:09:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.015+0000 7f644f6e0700 1 Processor -- start 2023-10-03T10:09:59.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.015+0000 7f644f6e0700 1 -- start start 2023-10-03T10:09:59.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.016+0000 7f644f6e0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6448066e30 0x7f6448115300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.016+0000 7f644f6e0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6448068680 0x7f6448111400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.016+0000 7f644f6e0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f644812dee0 0x7f64481118f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.016+0000 7f644f6e0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6448129930 con 0x7f6448068680 2023-10-03T10:09:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.016+0000 7f644f6e0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64481294a0 con 0x7f644812dee0 2023-10-03T10:09:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.016+0000 7f644f6e0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64480691e0 con 0x7f6448066e30 2023-10-03T10:09:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.016+0000 7f644cc7b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6448068680 0x7f6448111400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.016+0000 7f644cc7b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6448068680 0x7f6448111400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47106/0 (socket says 172.21.15.146:47106) 2023-10-03T10:09:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.016+0000 7f644cc7b700 1 -- 172.21.15.146:0/3696614923 learned_addr learned my addr 172.21.15.146:0/3696614923 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.016+0000 7f644d47c700 1 --2- 172.21.15.146:0/3696614923 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6448066e30 0x7f6448115300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.016+0000 7f644dc7d700 1 --2- 172.21.15.146:0/3696614923 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f644812dee0 0x7f64481118f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.017+0000 7f644cc7b700 1 -- 172.21.15.146:0/3696614923 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6448066e30 msgr2=0x7f6448115300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.017+0000 7f644cc7b700 1 --2- 172.21.15.146:0/3696614923 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6448066e30 0x7f6448115300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.017+0000 7f644cc7b700 1 -- 172.21.15.146:0/3696614923 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f644812dee0 msgr2=0x7f64481118f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.017+0000 7f644cc7b700 1 --2- 172.21.15.146:0/3696614923 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f644812dee0 0x7f64481118f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.017+0000 7f644cc7b700 1 -- 172.21.15.146:0/3696614923 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64380092a0 con 0x7f6448068680 2023-10-03T10:09:59.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.017+0000 7f644dc7d700 1 --2- 172.21.15.146:0/3696614923 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f644812dee0 0x7f64481118f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:09:59.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.017+0000 7f644cc7b700 1 --2- 172.21.15.146:0/3696614923 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6448068680 0x7f6448111400 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f6438009d80 tx=0x7f6438017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.017+0000 7f643d7fa700 1 -- 172.21.15.146:0/3696614923 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6438006930 con 0x7f6448068680 2023-10-03T10:09:59.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.017+0000 7f643d7fa700 1 -- 172.21.15.146:0/3696614923 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6438011ac0 con 0x7f6448068680 2023-10-03T10:09:59.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.017+0000 7f644f6e0700 1 -- 172.21.15.146:0/3696614923 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6448114e00 con 0x7f6448068680 2023-10-03T10:09:59.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.017+0000 7f643d7fa700 1 -- 172.21.15.146:0/3696614923 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6438011e60 con 0x7f6448068680 2023-10-03T10:09:59.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.017+0000 7f644f6e0700 1 -- 172.21.15.146:0/3696614923 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6448114860 con 0x7f6448068680 2023-10-03T10:09:59.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.018+0000 7f644f6e0700 1 -- 172.21.15.146:0/3696614923 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f644805a260 con 0x7f6448068680 2023-10-03T10:09:59.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.018+0000 7f643d7fa700 1 -- 172.21.15.146:0/3696614923 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f643801c630 con 0x7f6448068680 2023-10-03T10:09:59.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.018+0000 7f643d7fa700 1 -- 172.21.15.146:0/3696614923 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f643803c6d0 con 0x7f6448068680 2023-10-03T10:09:59.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.026+0000 7f643d7fa700 1 -- 172.21.15.146:0/3696614923 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6438018940 con 0x7f6448068680 2023-10-03T10:09:59.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.048+0000 7f817099b700 1 Processor -- start 2023-10-03T10:09:59.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.048+0000 7f817099b700 1 -- start start 2023-10-03T10:09:59.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.048+0000 7f817099b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f816c05f560 0x7f816c12ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.048+0000 7f817099b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f816c12b370 0x7f816c095d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.048+0000 7f817099b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f816c066f90 con 0x7f816c12b790 2023-10-03T10:09:59.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.048+0000 7f817099b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f816c05f940 con 0x7f816c05f560 2023-10-03T10:09:59.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.048+0000 7f817099b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f816c067650 con 0x7f816c12b370 2023-10-03T10:09:59.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.049+0000 7f816ad9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f816c12b790 0x7f816c096280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33688/0 (socket says 172.21.15.146:33688) 2023-10-03T10:09:59.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.049+0000 7f816ad9d700 1 -- 172.21.15.146:0/3291006580 learned_addr learned my addr 172.21.15.146:0/3291006580 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:09:59.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.049+0000 7f816a59c700 1 --2- 172.21.15.146:0/3291006580 >> v2:172.21.15.146:3300/0 conn(0x7f816c05f560 0x7f816c12ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.049+0000 7f8169d9b700 1 --2- 172.21.15.146:0/3291006580 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f816c12b370 0x7f816c095d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.049+0000 7f816a59c700 1 -- 172.21.15.146:0/3291006580 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f816c12b370 msgr2=0x7f816c095d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:59.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.049+0000 7f816a59c700 1 --2- 172.21.15.146:0/3291006580 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f816c12b370 0x7f816c095d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.049+0000 7f816a59c700 1 -- 172.21.15.146:0/3291006580 >> v1:172.21.15.146:6789/0 conn(0x7f816c12b790 legacy=0x7f816c096280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.049+0000 7f816a59c700 1 -- 172.21.15.146:0/3291006580 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816c067910 con 0x7f816c05f560 2023-10-03T10:09:59.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.049+0000 7f8169d9b700 1 --2- 172.21.15.146:0/3291006580 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f816c12b370 0x7f816c095d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:09:59.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.049+0000 7f816a59c700 1 --2- 172.21.15.146:0/3291006580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f816c05f560 0x7f816c12ae80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f815c009760 tx=0x7f815c009060).ready entity=mon.0 client_cookie=bb2d476146a053df server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.049+0000 7f816959a700 1 -- 172.21.15.146:0/3291006580 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c00b580 con 0x7f816c05f560 2023-10-03T10:09:59.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.049+0000 7f816959a700 1 -- 172.21.15.146:0/3291006580 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815c00b6e0 con 0x7f816c05f560 2023-10-03T10:09:59.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.049+0000 7f816959a700 1 -- 172.21.15.146:0/3291006580 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c00ba60 con 0x7f816c05f560 2023-10-03T10:09:59.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.050+0000 7f817099b700 1 -- 172.21.15.146:0/3291006580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f816c05f560 msgr2=0x7f816c12ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.050+0000 7f817099b700 1 --2- 172.21.15.146:0/3291006580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f816c05f560 0x7f816c12ae80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f815c009760 tx=0x7f815c009060).stop 2023-10-03T10:09:59.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.050+0000 7f817099b700 1 -- 172.21.15.146:0/3291006580 shutdown_connections 2023-10-03T10:09:59.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.050+0000 7f817099b700 1 --2- 172.21.15.146:0/3291006580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f816c05f560 0x7f816c12ae80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.050+0000 7f817099b700 1 --2- 172.21.15.146:0/3291006580 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f816c12b370 0x7f816c095d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.050+0000 7f817099b700 1 -- 172.21.15.146:0/3291006580 >> 172.21.15.146:0/3291006580 conn(0x7f816c09a1c0 msgr2=0x7f816c09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.051+0000 7f817099b700 1 -- 172.21.15.146:0/3291006580 shutdown_connections 2023-10-03T10:09:59.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.051+0000 7f817099b700 1 -- 172.21.15.146:0/3291006580 wait complete. 2023-10-03T10:09:59.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.051+0000 7f817099b700 1 Processor -- start 2023-10-03T10:09:59.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.052+0000 7f817099b700 1 -- start start 2023-10-03T10:09:59.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.052+0000 7f817099b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f816c05f560 0x7f816c117d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.052+0000 7f817099b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f816c12b370 0x7f816c114660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.052+0000 7f817099b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f816c12b790 0x7f816c114b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.052+0000 7f817099b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816c117560 con 0x7f816c05f560 2023-10-03T10:09:59.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.052+0000 7f817099b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f816c1172a0 con 0x7f816c12b790 2023-10-03T10:09:59.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.052+0000 7f817099b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f816c0671c0 con 0x7f816c12b370 2023-10-03T10:09:59.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.052+0000 7f816a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f816c05f560 0x7f816c117d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.052+0000 7f816a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f816c05f560 0x7f816c117d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47122/0 (socket says 172.21.15.146:47122) 2023-10-03T10:09:59.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.052+0000 7f816a59c700 1 -- 172.21.15.146:0/1536876201 learned_addr learned my addr 172.21.15.146:0/1536876201 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:59.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.052+0000 7f816ad9d700 1 --2- 172.21.15.146:0/1536876201 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f816c12b790 0x7f816c114b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.052+0000 7f8169d9b700 1 --2- 172.21.15.146:0/1536876201 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f816c12b370 0x7f816c114660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.052+0000 7f816a59c700 1 -- 172.21.15.146:0/1536876201 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f816c12b370 msgr2=0x7f816c114660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.052+0000 7f816a59c700 1 --2- 172.21.15.146:0/1536876201 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f816c12b370 0x7f816c114660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.053+0000 7f816a59c700 1 -- 172.21.15.146:0/1536876201 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f816c12b790 msgr2=0x7f816c114b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.053+0000 7f816a59c700 1 --2- 172.21.15.146:0/1536876201 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f816c12b790 0x7f816c114b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.053+0000 7f816a59c700 1 -- 172.21.15.146:0/1536876201 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815c0092a0 con 0x7f816c05f560 2023-10-03T10:09:59.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.053+0000 7f8169d9b700 1 --2- 172.21.15.146:0/1536876201 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f816c12b370 0x7f816c114660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:09:59.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.053+0000 7f816a59c700 1 --2- 172.21.15.146:0/1536876201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f816c05f560 0x7f816c117d40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f815c009eb0 tx=0x7f815c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.053+0000 7f815a7fc700 1 -- 172.21.15.146:0/1536876201 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c00b850 con 0x7f816c05f560 2023-10-03T10:09:59.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.053+0000 7f815a7fc700 1 -- 172.21.15.146:0/1536876201 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815c00b9b0 con 0x7f816c05f560 2023-10-03T10:09:59.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.053+0000 7f817099b700 1 -- 172.21.15.146:0/1536876201 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f816c1159c0 con 0x7f816c05f560 2023-10-03T10:09:59.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.053+0000 7f815a7fc700 1 -- 172.21.15.146:0/1536876201 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c01b640 con 0x7f816c05f560 2023-10-03T10:09:59.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.053+0000 7f817099b700 1 -- 172.21.15.146:0/1536876201 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f816c115040 con 0x7f816c05f560 2023-10-03T10:09:59.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.054+0000 7f815a7fc700 1 -- 172.21.15.146:0/1536876201 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f815c01ba70 con 0x7f816c05f560 2023-10-03T10:09:59.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.054+0000 7f815a7fc700 1 -- 172.21.15.146:0/1536876201 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f815c03cd00 con 0x7f816c05f560 2023-10-03T10:09:59.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.054+0000 7f817099b700 1 -- 172.21.15.146:0/1536876201 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f816c115260 con 0x7f816c05f560 2023-10-03T10:09:59.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.063+0000 7f815a7fc700 1 -- 172.21.15.146:0/1536876201 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f815c01bd20 con 0x7f816c05f560 2023-10-03T10:09:59.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.088+0000 7fecd722e700 1 Processor -- start 2023-10-03T10:09:59.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.088+0000 7fecd722e700 1 -- start start 2023-10-03T10:09:59.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.088+0000 7fecd722e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd0092390 0x7fecd0097aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.088+0000 7fecd722e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd0123a90 0x7fecd0123f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.088+0000 7fecd722e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fecd0126fe0 0x7fecd0127460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.088+0000 7fecd722e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd0092770 con 0x7fecd0126fe0 2023-10-03T10:09:59.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.088+0000 7fecd722e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd0069550 con 0x7fecd0123a90 2023-10-03T10:09:59.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.088+0000 7fecd722e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecd0068c10 con 0x7fecd0092390 2023-10-03T10:09:59.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.088+0000 7feccffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd0123a90 0x7fecd0123f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.088+0000 7fecd57cb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fecd0126fe0 0x7fecd0127460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.088+0000 7feccffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd0123a90 0x7fecd0123f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58668/0 (socket says 172.21.15.146:58668) 2023-10-03T10:09:59.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.088+0000 7feccffff700 1 -- 172.21.15.146:0/1473149638 learned_addr learned my addr 172.21.15.146:0/1473149638 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:59.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.089+0000 7feccffff700 1 -- 172.21.15.146:0/1473149638 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd0092390 msgr2=0x7fecd0097aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:59.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.089+0000 7feccffff700 1 --2- 172.21.15.146:0/1473149638 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd0092390 0x7fecd0097aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:59.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.089+0000 7feccffff700 1 -- 172.21.15.146:0/1473149638 >> v2:172.21.15.146:3300/0 conn(0x7fecd0126fe0 msgr2=0x7fecd0127460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:59.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.089+0000 7feccffff700 1 --2- 172.21.15.146:0/1473149638 >> v2:172.21.15.146:3300/0 conn(0x7fecd0126fe0 0x7fecd0127460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.089+0000 7feccffff700 1 -- 172.21.15.146:0/1473149638 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd0124550 con 0x7fecd0123a90 2023-10-03T10:09:59.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.089+0000 7fecd57cb700 1 --2- 172.21.15.146:0/1473149638 >> v2:172.21.15.146:3300/0 conn(0x7fecd0126fe0 0x7fecd0127460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:59.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.089+0000 7feccffff700 1 --2- 172.21.15.146:0/1473149638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd0123a90 0x7fecd0123f10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fecbc00c950 tx=0x7fecbc00a170).ready entity=mon.1 client_cookie=cac3838ea8d9532a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.089+0000 7feccf7fe700 1 -- 172.21.15.146:0/1473149638 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc009030 con 0x7fecd0123a90 2023-10-03T10:09:59.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.089+0000 7feccf7fe700 1 -- 172.21.15.146:0/1473149638 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc00b940 con 0x7fecd0123a90 2023-10-03T10:09:59.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.089+0000 7feccf7fe700 1 -- 172.21.15.146:0/1473149638 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc00bcc0 con 0x7fecd0123a90 2023-10-03T10:09:59.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.090+0000 7fecd722e700 1 -- 172.21.15.146:0/1473149638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd0123a90 msgr2=0x7fecd0123f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.090+0000 7fecd722e700 1 --2- 172.21.15.146:0/1473149638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd0123a90 0x7fecd0123f10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fecbc00c950 tx=0x7fecbc00a170).stop 2023-10-03T10:09:59.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.090+0000 7fecd722e700 1 -- 172.21.15.146:0/1473149638 shutdown_connections 2023-10-03T10:09:59.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.090+0000 7fecd722e700 1 --2- 172.21.15.146:0/1473149638 >> v2:172.21.15.146:3300/0 conn(0x7fecd0126fe0 0x7fecd0127460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.090+0000 7fecd722e700 1 --2- 172.21.15.146:0/1473149638 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd0092390 0x7fecd0097aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:59.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.090+0000 7fecd722e700 1 --2- 172.21.15.146:0/1473149638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd0123a90 0x7fecd0123f10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.090+0000 7fecd722e700 1 -- 172.21.15.146:0/1473149638 >> 172.21.15.146:0/1473149638 conn(0x7fecd009a230 msgr2=0x7fecd009a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.090+0000 7fecd722e700 1 -- 172.21.15.146:0/1473149638 shutdown_connections 2023-10-03T10:09:59.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.090+0000 7fecd722e700 1 -- 172.21.15.146:0/1473149638 wait complete. 2023-10-03T10:09:59.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.090+0000 7fecd722e700 1 Processor -- start 2023-10-03T10:09:59.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.091+0000 7fecd722e700 1 -- start start 2023-10-03T10:09:59.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.091+0000 7fecd722e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd0092390 0x7fecd0120820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.091+0000 7fecd722e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecd0123a90 0x7fecd0120d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.091+0000 7fecd722e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd0126fe0 0x7fecd0110890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.091+0000 7fecd722e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd0114000 con 0x7fecd0123a90 2023-10-03T10:09:59.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.091+0000 7fecd722e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd0114350 con 0x7fecd0126fe0 2023-10-03T10:09:59.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.091+0000 7fecd722e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecd0121870 con 0x7fecd0092390 2023-10-03T10:09:59.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.092+0000 7fecd4fca700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd0092390 0x7fecd0120820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.092+0000 7fecd4fca700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd0092390 0x7fecd0120820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36772/0 (socket says 172.21.15.146:36772) 2023-10-03T10:09:59.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.092+0000 7fecd57cb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd0126fe0 0x7fecd0110890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.092+0000 7fecd4fca700 1 -- 172.21.15.146:0/3378527166 learned_addr learned my addr 172.21.15.146:0/3378527166 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:59.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.092+0000 7feccffff700 1 --2- 172.21.15.146:0/3378527166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecd0123a90 0x7fecd0120d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.092+0000 7fecd57cb700 1 -- 172.21.15.146:0/3378527166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd0092390 msgr2=0x7fecd0120820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.092+0000 7fecd57cb700 1 --2- 172.21.15.146:0/3378527166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd0092390 0x7fecd0120820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.092+0000 7fecd57cb700 1 -- 172.21.15.146:0/3378527166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecd0123a90 msgr2=0x7fecd0120d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.092+0000 7fecd57cb700 1 --2- 172.21.15.146:0/3378527166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecd0123a90 0x7fecd0120d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.092+0000 7fecd57cb700 1 -- 172.21.15.146:0/3378527166 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc800de30 con 0x7fecd0126fe0 2023-10-03T10:09:59.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.092+0000 7fecd57cb700 1 --2- 172.21.15.146:0/3378527166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd0126fe0 0x7fecd0110890 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fecc8012290 tx=0x7fecc800db90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.092+0000 7fecccff9700 1 -- 172.21.15.146:0/3378527166 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc8012e80 con 0x7fecd0126fe0 2023-10-03T10:09:59.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.092+0000 7fecccff9700 1 -- 172.21.15.146:0/3378527166 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc8013040 con 0x7fecd0126fe0 2023-10-03T10:09:59.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.092+0000 7fecd722e700 1 -- 172.21.15.146:0/3378527166 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecbc00c530 con 0x7fecd0126fe0 2023-10-03T10:09:59.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.092+0000 7fecccff9700 1 -- 172.21.15.146:0/3378527166 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc8018670 con 0x7fecd0126fe0 2023-10-03T10:09:59.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.092+0000 7fecd722e700 1 -- 172.21.15.146:0/3378527166 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd01120d0 con 0x7fecd0126fe0 2023-10-03T10:09:59.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.093+0000 7fecd722e700 1 -- 172.21.15.146:0/3378527166 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd01229f0 con 0x7fecd0126fe0 2023-10-03T10:09:59.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.095+0000 7f83c4f2f700 1 Processor -- start 2023-10-03T10:09:59.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.095+0000 7f83c4f2f700 1 -- start start 2023-10-03T10:09:59.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.095+0000 7f83c4f2f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83c0092440 0x7f83c0127910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.095+0000 7f83c4f2f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f83c0126f70 0x7f83c0123a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.095+0000 7f83c4f2f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c0097eb0 con 0x7f83c0127390 2023-10-03T10:09:59.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.095+0000 7f83c4f2f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c0092820 con 0x7f83c0126f70 2023-10-03T10:09:59.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.095+0000 7f83c4f2f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c0069760 con 0x7f83c0092440 2023-10-03T10:09:59.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.095+0000 7fecccff9700 1 -- 172.21.15.146:0/3378527166 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fecc8018a60 con 0x7fecd0126fe0 2023-10-03T10:09:59.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.095+0000 7fecccff9700 1 -- 172.21.15.146:0/3378527166 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fecc8040910 con 0x7fecd0126fe0 2023-10-03T10:09:59.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.095+0000 7f83bdd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f83c0126f70 0x7f83c0123a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.096+0000 7f83bdd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f83c0126f70 0x7f83c0123a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47152/0 (socket says 172.21.15.146:47152) 2023-10-03T10:09:59.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.096+0000 7f83bdd9b700 1 -- 172.21.15.146:0/3990267822 learned_addr learned my addr 172.21.15.146:0/3990267822 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:59.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.096+0000 7f83bd59a700 1 -- 172.21.15.146:0/3990267822 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909684916 0 0) 0x7f83c0097eb0 con 0x7f83c0127390 2023-10-03T10:09:59.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.096+0000 7f83bd59a700 1 -- 172.21.15.146:0/3990267822 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83a80033f0 con 0x7f83c0127390 2023-10-03T10:09:59.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.096+0000 7f83bdd9b700 1 -- 172.21.15.146:0/3990267822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83c0092440 msgr2=0x7f83c0127910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:59.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.096+0000 7f83bdd9b700 1 --2- 172.21.15.146:0/3990267822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83c0092440 0x7f83c0127910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:59.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.096+0000 7f83bdd9b700 1 -- 172.21.15.146:0/3990267822 >> v1:172.21.15.146:6789/0 conn(0x7f83c0127390 legacy=0x7f83c0123f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.096+0000 7f83bdd9b700 1 -- 172.21.15.146:0/3990267822 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c0091980 con 0x7f83c0126f70 2023-10-03T10:09:59.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.096+0000 7f83bdd9b700 1 --2- 172.21.15.146:0/3990267822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83c0126f70 0x7f83c0123a90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f83b4006fd0 tx=0x7f83b40090f0).ready entity=mon.0 client_cookie=55307ebcf0e0b79d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.096+0000 7f83bd59a700 1 -- 172.21.15.146:0/3990267822 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b400f750 con 0x7f83c0126f70 2023-10-03T10:09:59.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.096+0000 7f83bd59a700 1 -- 172.21.15.146:0/3990267822 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b400f8b0 con 0x7f83c0126f70 2023-10-03T10:09:59.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.096+0000 7f83bd59a700 1 -- 172.21.15.146:0/3990267822 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b400fc50 con 0x7f83c0126f70 2023-10-03T10:09:59.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.097+0000 7f83c4f2f700 1 -- 172.21.15.146:0/3990267822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83c0126f70 msgr2=0x7f83c0123a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.097+0000 7f83c4f2f700 1 --2- 172.21.15.146:0/3990267822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83c0126f70 0x7f83c0123a90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f83b4006fd0 tx=0x7f83b40090f0).stop 2023-10-03T10:09:59.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.097+0000 7f83c4f2f700 1 -- 172.21.15.146:0/3990267822 shutdown_connections 2023-10-03T10:09:59.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.097+0000 7f83c4f2f700 1 --2- 172.21.15.146:0/3990267822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83c0092440 0x7f83c0127910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:59.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.097+0000 7f83c4f2f700 1 --2- 172.21.15.146:0/3990267822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83c0126f70 0x7f83c0123a90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.097+0000 7f83c4f2f700 1 -- 172.21.15.146:0/3990267822 >> 172.21.15.146:0/3990267822 conn(0x7f83c009a1c0 msgr2=0x7f83c009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.097+0000 7f83c4f2f700 1 -- 172.21.15.146:0/3990267822 shutdown_connections 2023-10-03T10:09:59.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.097+0000 7f83c4f2f700 1 -- 172.21.15.146:0/3990267822 wait complete. 2023-10-03T10:09:59.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.098+0000 7f83c4f2f700 1 Processor -- start 2023-10-03T10:09:59.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.098+0000 7f83c4f2f700 1 -- start start 2023-10-03T10:09:59.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.099+0000 7fecccff9700 1 -- 172.21.15.146:0/3378527166 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fecc8020770 con 0x7fecd0126fe0 2023-10-03T10:09:59.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.099+0000 7f83c4f2f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83c0092440 0x7f83c0128140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.099+0000 7f83c4f2f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83c0126f70 0x7f83c0128630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.099+0000 7f83c4f2f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f83c0127390 0x7f83c0128b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.099+0000 7f83c4f2f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c0129010 con 0x7f83c0126f70 2023-10-03T10:09:59.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.099+0000 7f83c4f2f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c012b6c0 con 0x7f83c0092440 2023-10-03T10:09:59.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.099+0000 7f83c4f2f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83c0097990 con 0x7f83c0127390 2023-10-03T10:09:59.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.099+0000 7f83bed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f83c0127390 0x7f83c0128b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.099+0000 7f83bed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f83c0127390 0x7f83c0128b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36784/0 (socket says 172.21.15.146:36784) 2023-10-03T10:09:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.099+0000 7f83bed9d700 1 -- 172.21.15.146:0/4193399188 learned_addr learned my addr 172.21.15.146:0/4193399188 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.099+0000 7f83bdd9b700 1 --2- 172.21.15.146:0/4193399188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83c0126f70 0x7f83c0128630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.100+0000 7f83bed9d700 1 -- 172.21.15.146:0/4193399188 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83c0092440 msgr2=0x7f83c0128140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:09:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.100+0000 7f83bed9d700 1 --2- 172.21.15.146:0/4193399188 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83c0092440 0x7f83c0128140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.100+0000 7f83bed9d700 1 -- 172.21.15.146:0/4193399188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83c0126f70 msgr2=0x7f83c0128630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.100+0000 7f83bed9d700 1 --2- 172.21.15.146:0/4193399188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83c0126f70 0x7f83c0128630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.100+0000 7f83bed9d700 1 -- 172.21.15.146:0/4193399188 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b4009370 con 0x7f83c0127390 2023-10-03T10:09:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.100+0000 7f83bed9d700 1 --2- 172.21.15.146:0/4193399188 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f83c0127390 0x7f83c0128b20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f83b800c710 tx=0x7f83b800cad0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.100+0000 7f83ae7fc700 1 -- 172.21.15.146:0/4193399188 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8002240 con 0x7f83c0127390 2023-10-03T10:09:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.100+0000 7f83ae7fc700 1 -- 172.21.15.146:0/4193399188 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b80023a0 con 0x7f83c0127390 2023-10-03T10:09:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.100+0000 7f83c4f2f700 1 -- 172.21.15.146:0/4193399188 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c0099df0 con 0x7f83c0127390 2023-10-03T10:09:59.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.100+0000 7f83ae7fc700 1 -- 172.21.15.146:0/4193399188 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8001650 con 0x7f83c0127390 2023-10-03T10:09:59.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.100+0000 7f83c4f2f700 1 -- 172.21.15.146:0/4193399188 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c012a3b0 con 0x7f83c0127390 2023-10-03T10:09:59.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.101+0000 7f83ae7fc700 1 -- 172.21.15.146:0/4193399188 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f83b8001a40 con 0x7f83c0127390 2023-10-03T10:09:59.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.102+0000 7f83ae7fc700 1 -- 172.21.15.146:0/4193399188 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f83b803a8f0 con 0x7f83c0127390 2023-10-03T10:09:59.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.102+0000 7f83c4f2f700 1 -- 172.21.15.146:0/4193399188 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c0091ba0 con 0x7f83c0127390 2023-10-03T10:09:59.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.111+0000 7f83ae7fc700 1 -- 172.21.15.146:0/4193399188 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f83b800ab50 con 0x7f83c0127390 2023-10-03T10:09:59.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.215+0000 7f644f6e0700 1 -- 172.21.15.146:0/3696614923 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f644805f720 con 0x7f6448068680 2023-10-03T10:09:59.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.215+0000 7f643d7fa700 1 -- 172.21.15.146:0/3696614923 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6438020070 con 0x7f6448068680 2023-10-03T10:09:59.216 INFO:teuthology.orchestra.run.smithi146.stdout:38654705669 2023-10-03T10:09:59.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.217+0000 7f644f6e0700 1 -- 172.21.15.146:0/3696614923 >> v1:172.21.15.146:6816/118159 conn(0x7f642c02bb30 legacy=0x7f642c02dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.217+0000 7f644f6e0700 1 -- 172.21.15.146:0/3696614923 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6448068680 msgr2=0x7f6448111400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.217+0000 7f644f6e0700 1 --2- 172.21.15.146:0/3696614923 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6448068680 0x7f6448111400 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f6438009d80 tx=0x7f6438017000).stop 2023-10-03T10:09:59.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.217+0000 7f644f6e0700 1 -- 172.21.15.146:0/3696614923 shutdown_connections 2023-10-03T10:09:59.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.217+0000 7f644f6e0700 1 --2- 172.21.15.146:0/3696614923 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f644812dee0 0x7f64481118f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.217+0000 7f644f6e0700 1 --2- 172.21.15.146:0/3696614923 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6448066e30 0x7f6448115300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.217+0000 7f644f6e0700 1 --2- 172.21.15.146:0/3696614923 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6448068680 0x7f6448111400 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.217+0000 7f644f6e0700 1 -- 172.21.15.146:0/3696614923 >> 172.21.15.146:0/3696614923 conn(0x7f644809a230 msgr2=0x7f6448096e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.217+0000 7f644f6e0700 1 -- 172.21.15.146:0/3696614923 shutdown_connections 2023-10-03T10:09:59.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.217+0000 7f644f6e0700 1 -- 172.21.15.146:0/3696614923 wait complete. 2023-10-03T10:09:59.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2023-10-03T10:09:59.229 DEBUG:teuthology.parallel:result is None 2023-10-03T10:09:59.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.240+0000 7f817099b700 1 -- 172.21.15.146:0/1536876201 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f816c05a260 con 0x7f816c05f560 2023-10-03T10:09:59.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.241+0000 7f815a7fc700 1 -- 172.21.15.146:0/1536876201 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f815c019380 con 0x7f816c05f560 2023-10-03T10:09:59.242 INFO:teuthology.orchestra.run.smithi146.stdout:38654705668 2023-10-03T10:09:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.242+0000 7f817099b700 1 -- 172.21.15.146:0/1536876201 >> v1:172.21.15.146:6816/118159 conn(0x7f814c02bb30 legacy=0x7f814c02dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.242+0000 7f817099b700 1 -- 172.21.15.146:0/1536876201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f816c05f560 msgr2=0x7f816c117d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.242+0000 7f817099b700 1 --2- 172.21.15.146:0/1536876201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f816c05f560 0x7f816c117d40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f815c009eb0 tx=0x7f815c017000).stop 2023-10-03T10:09:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.242+0000 7f817099b700 1 -- 172.21.15.146:0/1536876201 shutdown_connections 2023-10-03T10:09:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.243+0000 7f817099b700 1 --2- 172.21.15.146:0/1536876201 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f816c12b790 0x7f816c114b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.243+0000 7f817099b700 1 --2- 172.21.15.146:0/1536876201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f816c05f560 0x7f816c117d40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.243+0000 7f817099b700 1 --2- 172.21.15.146:0/1536876201 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f816c12b370 0x7f816c114660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.243+0000 7f817099b700 1 -- 172.21.15.146:0/1536876201 >> 172.21.15.146:0/1536876201 conn(0x7f816c09a1c0 msgr2=0x7f816c095d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.243+0000 7f817099b700 1 -- 172.21.15.146:0/1536876201 shutdown_connections 2023-10-03T10:09:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.243+0000 7f817099b700 1 -- 172.21.15.146:0/1536876201 wait complete. 2023-10-03T10:09:59.255 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.1 2023-10-03T10:09:59.255 DEBUG:teuthology.parallel:result is None 2023-10-03T10:09:59.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.267+0000 7fecd722e700 1 -- 172.21.15.146:0/3378527166 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fecd005a260 con 0x7fecd0126fe0 2023-10-03T10:09:59.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.268+0000 7fecccff9700 1 -- 172.21.15.146:0/3378527166 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fecc80173c0 con 0x7fecd0126fe0 2023-10-03T10:09:59.269 INFO:teuthology.orchestra.run.smithi146.stdout:38654705668 2023-10-03T10:09:59.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.270+0000 7fecd722e700 1 -- 172.21.15.146:0/3378527166 >> v1:172.21.15.146:6816/118159 conn(0x7fecb402bb90 legacy=0x7fecb402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.270+0000 7fecd722e700 1 -- 172.21.15.146:0/3378527166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd0126fe0 msgr2=0x7fecd0110890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.270+0000 7fecd722e700 1 --2- 172.21.15.146:0/3378527166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd0126fe0 0x7fecd0110890 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fecc8012290 tx=0x7fecc800db90).stop 2023-10-03T10:09:59.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.270+0000 7fecd722e700 1 -- 172.21.15.146:0/3378527166 shutdown_connections 2023-10-03T10:09:59.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.270+0000 7fecd722e700 1 --2- 172.21.15.146:0/3378527166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd0126fe0 0x7fecd0110890 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.270+0000 7fecd722e700 1 --2- 172.21.15.146:0/3378527166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd0092390 0x7fecd0120820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.270+0000 7fecd722e700 1 --2- 172.21.15.146:0/3378527166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecd0123a90 0x7fecd0120d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.270+0000 7fecd722e700 1 -- 172.21.15.146:0/3378527166 >> 172.21.15.146:0/3378527166 conn(0x7fecd009a230 msgr2=0x7fecd0066cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.270+0000 7fecd722e700 1 -- 172.21.15.146:0/3378527166 shutdown_connections 2023-10-03T10:09:59.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.270+0000 7fecd722e700 1 -- 172.21.15.146:0/3378527166 wait complete. 2023-10-03T10:09:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.279+0000 7f83c4f2f700 1 -- 172.21.15.146:0/4193399188 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f83c012a960 con 0x7f83c0127390 2023-10-03T10:09:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.280+0000 7f83ae7fc700 1 -- 172.21.15.146:0/4193399188 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f83b8011e40 con 0x7f83c0127390 2023-10-03T10:09:59.280 INFO:teuthology.orchestra.run.smithi146.stdout:38654705668 2023-10-03T10:09:59.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.2 2023-10-03T10:09:59.283 DEBUG:teuthology.parallel:result is None 2023-10-03T10:09:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.281+0000 7f83c4f2f700 1 -- 172.21.15.146:0/4193399188 >> v1:172.21.15.146:6816/118159 conn(0x7f83a002bb90 legacy=0x7f83a002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.281+0000 7f83c4f2f700 1 -- 172.21.15.146:0/4193399188 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f83c0127390 msgr2=0x7f83c0128b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.281+0000 7f83c4f2f700 1 --2- 172.21.15.146:0/4193399188 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f83c0127390 0x7f83c0128b20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f83b800c710 tx=0x7f83b800cad0).stop 2023-10-03T10:09:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.282+0000 7f83c4f2f700 1 -- 172.21.15.146:0/4193399188 shutdown_connections 2023-10-03T10:09:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.282+0000 7f83c4f2f700 1 --2- 172.21.15.146:0/4193399188 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f83c0127390 0x7f83c0128b20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.282+0000 7f83c4f2f700 1 --2- 172.21.15.146:0/4193399188 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83c0092440 0x7f83c0128140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.282+0000 7f83c4f2f700 1 --2- 172.21.15.146:0/4193399188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83c0126f70 0x7f83c0128630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.282+0000 7f83c4f2f700 1 -- 172.21.15.146:0/4193399188 >> 172.21.15.146:0/4193399188 conn(0x7f83c009a1c0 msgr2=0x7f83c0124e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.282+0000 7f83c4f2f700 1 -- 172.21.15.146:0/4193399188 shutdown_connections 2023-10-03T10:09:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.282+0000 7f83c4f2f700 1 -- 172.21.15.146:0/4193399188 wait complete. 2023-10-03T10:09:59.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.3 2023-10-03T10:09:59.294 DEBUG:teuthology.parallel:result is None 2023-10-03T10:09:59.294 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-03T10:09:59.294 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:09:59.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.450+0000 7fc0d7977700 1 Processor -- start 2023-10-03T10:09:59.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.450+0000 7fc0d7977700 1 -- start start 2023-10-03T10:09:59.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.450+0000 7fc0d7977700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc0d0095da0 0x7fc0d00961c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.450+0000 7fc0d7977700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d00966b0 0x7fc0d0132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.450+0000 7fc0d7977700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d0091980 con 0x7fc0d0062b00 2023-10-03T10:09:59.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.451+0000 7fc0d7977700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d00973f0 con 0x7fc0d0095da0 2023-10-03T10:09:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.451+0000 7fc0d7977700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d0062ee0 con 0x7fc0d00966b0 2023-10-03T10:09:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.451+0000 7fc0d5f14700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d00966b0 0x7fc0d0132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.451+0000 7fc0d4f12700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc0d0095da0 0x7fc0d00961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.451+0000 7fc0d5713700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc0d0062b00 0x7fc0d0095690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33698/0 (socket says 172.21.15.146:33698) 2023-10-03T10:09:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.451+0000 7fc0d4f12700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc0d0095da0 0x7fc0d00961c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47170/0 (socket says 172.21.15.146:47170) 2023-10-03T10:09:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.451+0000 7fc0d5f14700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d00966b0 0x7fc0d0132290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36796/0 (socket says 172.21.15.146:36796) 2023-10-03T10:09:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.451+0000 7fc0d5713700 1 -- 172.21.15.146:0/3086225297 learned_addr learned my addr 172.21.15.146:0/3086225297 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:09:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.451+0000 7fc0d5f14700 1 -- 172.21.15.146:0/3086225297 >> v2:172.21.15.146:3300/0 conn(0x7fc0d0095da0 msgr2=0x7fc0d00961c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.451+0000 7fc0d5f14700 1 --2- 172.21.15.146:0/3086225297 >> v2:172.21.15.146:3300/0 conn(0x7fc0d0095da0 0x7fc0d00961c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.451+0000 7fc0d5f14700 1 -- 172.21.15.146:0/3086225297 >> v1:172.21.15.146:6789/0 conn(0x7fc0d0062b00 legacy=0x7fc0d0095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.451+0000 7fc0d5f14700 1 -- 172.21.15.146:0/3086225297 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d0092310 con 0x7fc0d00966b0 2023-10-03T10:09:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.451+0000 7fc0c7fff700 1 -- 172.21.15.146:0/3086225297 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935496788 0 0) 0x7fc0d0091980 con 0x7fc0d0062b00 2023-10-03T10:09:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.451+0000 7fc0d4f12700 1 --2- 172.21.15.146:0/3086225297 >> v2:172.21.15.146:3300/0 conn(0x7fc0d0095da0 0x7fc0d00961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.451+0000 7fc0d5f14700 1 --2- 172.21.15.146:0/3086225297 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d00966b0 0x7fc0d0132290 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc0c8009e60 tx=0x7fc0c8009780).ready entity=mon.2 client_cookie=22f94f362f9a2ec8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.451+0000 7fc0c7fff700 1 -- 172.21.15.146:0/3086225297 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c800e070 con 0x7fc0d00966b0 2023-10-03T10:09:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.451+0000 7fc0c7fff700 1 -- 172.21.15.146:0/3086225297 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c800bb60 con 0x7fc0d00966b0 2023-10-03T10:09:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.451+0000 7fc0c7fff700 1 -- 172.21.15.146:0/3086225297 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c8012410 con 0x7fc0d00966b0 2023-10-03T10:09:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.452+0000 7fc0d7977700 1 -- 172.21.15.146:0/3086225297 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d00966b0 msgr2=0x7fc0d0132290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.452+0000 7fc0d7977700 1 --2- 172.21.15.146:0/3086225297 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d00966b0 0x7fc0d0132290 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc0c8009e60 tx=0x7fc0c8009780).stop 2023-10-03T10:09:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.452+0000 7fc0d7977700 1 -- 172.21.15.146:0/3086225297 shutdown_connections 2023-10-03T10:09:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.452+0000 7fc0d7977700 1 --2- 172.21.15.146:0/3086225297 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d00966b0 0x7fc0d0132290 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.452+0000 7fc0d7977700 1 --2- 172.21.15.146:0/3086225297 >> v2:172.21.15.146:3300/0 conn(0x7fc0d0095da0 0x7fc0d00961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.452+0000 7fc0d7977700 1 -- 172.21.15.146:0/3086225297 >> 172.21.15.146:0/3086225297 conn(0x7fc0d009aa50 msgr2=0x7fc0d009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.452+0000 7fc0d7977700 1 -- 172.21.15.146:0/3086225297 shutdown_connections 2023-10-03T10:09:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.452+0000 7fc0d7977700 1 -- 172.21.15.146:0/3086225297 wait complete. 2023-10-03T10:09:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.453+0000 7fc0d7977700 1 Processor -- start 2023-10-03T10:09:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.453+0000 7fc0d7977700 1 -- start start 2023-10-03T10:09:59.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.453+0000 7fc0d7977700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d0062b00 0x7fc0d0115120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.453+0000 7fc0d7977700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0d0095da0 0x7fc0d0115610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.453+0000 7fc0d7977700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0d00966b0 0x7fc0d0115b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.453+0000 7fc0d7977700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d012d260 con 0x7fc0d0095da0 2023-10-03T10:09:59.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.453+0000 7fc0d7977700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d0117750 con 0x7fc0d00966b0 2023-10-03T10:09:59.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.453+0000 7fc0d7977700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d0096da0 con 0x7fc0d0062b00 2023-10-03T10:09:59.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.453+0000 7fc0d4f12700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0d0095da0 0x7fc0d0115610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.453+0000 7fc0d5f14700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0d00966b0 0x7fc0d0115b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.453+0000 7fc0d5713700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d0062b00 0x7fc0d0115120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.453+0000 7fc0d4f12700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0d0095da0 0x7fc0d0115610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47180/0 (socket says 172.21.15.146:47180) 2023-10-03T10:09:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.453+0000 7fc0d4f12700 1 -- 172.21.15.146:0/1228505140 learned_addr learned my addr 172.21.15.146:0/1228505140 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.454+0000 7fc0d4f12700 1 -- 172.21.15.146:0/1228505140 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d0062b00 msgr2=0x7fc0d0115120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.454+0000 7fc0d4f12700 1 --2- 172.21.15.146:0/1228505140 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d0062b00 0x7fc0d0115120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.454+0000 7fc0d4f12700 1 -- 172.21.15.146:0/1228505140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0d00966b0 msgr2=0x7fc0d0115b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.454+0000 7fc0d4f12700 1 --2- 172.21.15.146:0/1228505140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0d00966b0 0x7fc0d0115b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.454+0000 7fc0d4f12700 1 -- 172.21.15.146:0/1228505140 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c00092a0 con 0x7fc0d0095da0 2023-10-03T10:09:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.454+0000 7fc0d4f12700 1 --2- 172.21.15.146:0/1228505140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0d0095da0 0x7fc0d0115610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fc0c000ea20 tx=0x7fc0c0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.454+0000 7fc0c57fa700 1 -- 172.21.15.146:0/1228505140 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c000ee60 con 0x7fc0d0095da0 2023-10-03T10:09:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.454+0000 7fc0c57fa700 1 -- 172.21.15.146:0/1228505140 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c000c850 con 0x7fc0d0095da0 2023-10-03T10:09:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.454+0000 7fc0d7977700 1 -- 172.21.15.146:0/1228505140 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c8009a20 con 0x7fc0d0095da0 2023-10-03T10:09:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.454+0000 7fc0c57fa700 1 -- 172.21.15.146:0/1228505140 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c000cbd0 con 0x7fc0d0095da0 2023-10-03T10:09:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.454+0000 7fc0d7977700 1 -- 172.21.15.146:0/1228505140 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d01192a0 con 0x7fc0d0095da0 2023-10-03T10:09:59.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.455+0000 7fc0c57fa700 1 -- 172.21.15.146:0/1228505140 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc0c001b400 con 0x7fc0d0095da0 2023-10-03T10:09:59.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.455+0000 7fc0c57fa700 1 -- 172.21.15.146:0/1228505140 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc0c003b510 con 0x7fc0d0095da0 2023-10-03T10:09:59.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.455+0000 7fc0d7977700 1 -- 172.21.15.146:0/1228505140 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d01326c0 con 0x7fc0d0095da0 2023-10-03T10:09:59.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.459+0000 7fc0c57fa700 1 -- 172.21.15.146:0/1228505140 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc0c0019900 con 0x7fc0d0095da0 2023-10-03T10:09:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.614+0000 7fc0d7977700 1 -- 172.21.15.146:0/1228505140 --> v1:172.21.15.146:6816/118159 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc0d005a260 con 0x7fc0b402bb30 2023-10-03T10:09:59.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.620+0000 7fc0c57fa700 1 -- 172.21.15.146:0/1228505140 <== mgr.4103 v1:172.21.15.146:6816/118159 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249946 (unknown 2965378022 0 4189245014) 0x7fc0d005a260 con 0x7fc0b402bb30 2023-10-03T10:09:59.624 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.623+0000 7fc0d7977700 1 -- 172.21.15.146:0/1228505140 >> v1:172.21.15.146:6816/118159 conn(0x7fc0b402bb30 legacy=0x7fc0b402dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.623+0000 7fc0d7977700 1 -- 172.21.15.146:0/1228505140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0d0095da0 msgr2=0x7fc0d0115610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.623+0000 7fc0d7977700 1 --2- 172.21.15.146:0/1228505140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0d0095da0 0x7fc0d0115610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fc0c000ea20 tx=0x7fc0c0009060).stop 2023-10-03T10:09:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.623+0000 7fc0d7977700 1 -- 172.21.15.146:0/1228505140 shutdown_connections 2023-10-03T10:09:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.623+0000 7fc0d7977700 1 --2- 172.21.15.146:0/1228505140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0d00966b0 0x7fc0d0115b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.623+0000 7fc0d7977700 1 --2- 172.21.15.146:0/1228505140 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d0062b00 0x7fc0d0115120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.623+0000 7fc0d7977700 1 --2- 172.21.15.146:0/1228505140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0d0095da0 0x7fc0d0115610 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.623+0000 7fc0d7977700 1 -- 172.21.15.146:0/1228505140 >> 172.21.15.146:0/1228505140 conn(0x7fc0d009aa50 msgr2=0x7fc0d0131fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.623+0000 7fc0d7977700 1 -- 172.21.15.146:0/1228505140 shutdown_connections 2023-10-03T10:09:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.623+0000 7fc0d7977700 1 -- 172.21.15.146:0/1228505140 wait complete. 2023-10-03T10:09:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-03T10:09:59.635 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-03T10:09:58.290868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188992,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298368,"statfs":{"total":386547056640,"available":385329528832,"internally_reserved":0,"allocated":622592,"data_stored":182668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000906"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.760605+0000","last_change":"2023-10-03T10:09:48.757714+0000","last_active":"2023-10-03T10:09:48.760605+0000","last_peered":"2023-10-03T10:09:48.760605+0000","last_clean":"2023-10-03T10:09:48.760605+0000","last_became_active":"2023-10-03T10:09:48.757453+0000","last_became_peered":"2023-10-03T10:09:48.757453+0000","last_unstale":"2023-10-03T10:09:48.760605+0000","last_undegraded":"2023-10-03T10:09:48.760605+0000","last_fullsized":"2023-10-03T10:09:48.760605+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.747433+0000","last_change":"2023-10-03T10:09:48.741431+0000","last_active":"2023-10-03T10:09:48.747433+0000","last_peered":"2023-10-03T10:09:48.747433+0000","last_clean":"2023-10-03T10:09:48.747433+0000","last_became_active":"2023-10-03T10:09:48.741098+0000","last_became_peered":"2023-10-03T10:09:48.741098+0000","last_unstale":"2023-10-03T10:09:48.747433+0000","last_undegraded":"2023-10-03T10:09:48.747433+0000","last_fullsized":"2023-10-03T10:09:48.747433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750874+0000","last_change":"2023-10-03T10:09:48.743956+0000","last_active":"2023-10-03T10:09:48.750874+0000","last_peered":"2023-10-03T10:09:48.750874+0000","last_clean":"2023-10-03T10:09:48.750874+0000","last_became_active":"2023-10-03T10:09:48.743706+0000","last_became_peered":"2023-10-03T10:09:48.743706+0000","last_unstale":"2023-10-03T10:09:48.750874+0000","last_undegraded":"2023-10-03T10:09:48.750874+0000","last_fullsized":"2023-10-03T10:09:48.750874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750183+0000","last_change":"2023-10-03T10:09:48.744824+0000","last_active":"2023-10-03T10:09:48.750183+0000","last_peered":"2023-10-03T10:09:48.750183+0000","last_clean":"2023-10-03T10:09:48.750183+0000","last_became_active":"2023-10-03T10:09:48.744559+0000","last_became_peered":"2023-10-03T10:09:48.744559+0000","last_unstale":"2023-10-03T10:09:48.750183+0000","last_undegraded":"2023-10-03T10:09:48.750183+0000","last_fullsized":"2023-10-03T10:09:48.750183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.769044+0000","last_change":"2023-10-03T10:09:48.756529+0000","last_active":"2023-10-03T10:09:48.769044+0000","last_peered":"2023-10-03T10:09:48.769044+0000","last_clean":"2023-10-03T10:09:48.769044+0000","last_became_active":"2023-10-03T10:09:48.756233+0000","last_became_peered":"2023-10-03T10:09:48.756233+0000","last_unstale":"2023-10-03T10:09:48.769044+0000","last_undegraded":"2023-10-03T10:09:48.769044+0000","last_fullsized":"2023-10-03T10:09:48.769044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.770152+0000","last_change":"2023-10-03T10:09:48.766120+0000","last_active":"2023-10-03T10:09:48.770152+0000","last_peered":"2023-10-03T10:09:48.770152+0000","last_clean":"2023-10-03T10:09:48.770152+0000","last_became_active":"2023-10-03T10:09:48.765846+0000","last_became_peered":"2023-10-03T10:09:48.765846+0000","last_unstale":"2023-10-03T10:09:48.770152+0000","last_undegraded":"2023-10-03T10:09:48.770152+0000","last_fullsized":"2023-10-03T10:09:48.770152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.768039+0000","last_change":"2023-10-03T10:09:48.762070+0000","last_active":"2023-10-03T10:09:48.768039+0000","last_peered":"2023-10-03T10:09:48.768039+0000","last_clean":"2023-10-03T10:09:48.768039+0000","last_became_active":"2023-10-03T10:09:48.758238+0000","last_became_peered":"2023-10-03T10:09:48.758238+0000","last_unstale":"2023-10-03T10:09:48.768039+0000","last_undegraded":"2023-10-03T10:09:48.768039+0000","last_fullsized":"2023-10-03T10:09:48.768039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.761216+0000","last_change":"2023-10-03T10:09:48.746713+0000","last_active":"2023-10-03T10:09:48.761216+0000","last_peered":"2023-10-03T10:09:48.761216+0000","last_clean":"2023-10-03T10:09:48.761216+0000","last_became_active":"2023-10-03T10:09:48.746426+0000","last_became_peered":"2023-10-03T10:09:48.746426+0000","last_unstale":"2023-10-03T10:09:48.761216+0000","last_undegraded":"2023-10-03T10:09:48.761216+0000","last_fullsized":"2023-10-03T10:09:48.761216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.770029+0000","last_change":"2023-10-03T10:09:48.757336+0000","last_active":"2023-10-03T10:09:48.770029+0000","last_peered":"2023-10-03T10:09:48.770029+0000","last_clean":"2023-10-03T10:09:48.770029+0000","last_became_active":"2023-10-03T10:09:48.757059+0000","last_became_peered":"2023-10-03T10:09:48.757059+0000","last_unstale":"2023-10-03T10:09:48.770029+0000","last_undegraded":"2023-10-03T10:09:48.770029+0000","last_fullsized":"2023-10-03T10:09:48.770029+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.760187+0000","last_change":"2023-10-03T10:09:48.748969+0000","last_active":"2023-10-03T10:09:48.760187+0000","last_peered":"2023-10-03T10:09:48.760187+0000","last_clean":"2023-10-03T10:09:48.760187+0000","last_became_active":"2023-10-03T10:09:48.746842+0000","last_became_peered":"2023-10-03T10:09:48.746842+0000","last_unstale":"2023-10-03T10:09:48.760187+0000","last_undegraded":"2023-10-03T10:09:48.760187+0000","last_fullsized":"2023-10-03T10:09:48.760187+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.758966+0000","last_change":"2023-10-03T10:09:48.745732+0000","last_active":"2023-10-03T10:09:48.758966+0000","last_peered":"2023-10-03T10:09:48.758966+0000","last_clean":"2023-10-03T10:09:48.758966+0000","last_became_active":"2023-10-03T10:09:48.745451+0000","last_became_peered":"2023-10-03T10:09:48.745451+0000","last_unstale":"2023-10-03T10:09:48.758966+0000","last_undegraded":"2023-10-03T10:09:48.758966+0000","last_fullsized":"2023-10-03T10:09:48.758966+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.760556+0000","last_change":"2023-10-03T10:09:48.758809+0000","last_active":"2023-10-03T10:09:48.760556+0000","last_peered":"2023-10-03T10:09:48.760556+0000","last_clean":"2023-10-03T10:09:48.760556+0000","last_became_active":"2023-10-03T10:09:48.758533+0000","last_became_peered":"2023-10-03T10:09:48.758533+0000","last_unstale":"2023-10-03T10:09:48.760556+0000","last_undegraded":"2023-10-03T10:09:48.760556+0000","last_fullsized":"2023-10-03T10:09:48.760556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.761143+0000","last_change":"2023-10-03T10:09:48.759114+0000","last_active":"2023-10-03T10:09:48.761143+0000","last_peered":"2023-10-03T10:09:48.761143+0000","last_clean":"2023-10-03T10:09:48.761143+0000","last_became_active":"2023-10-03T10:09:48.758569+0000","last_became_peered":"2023-10-03T10:09:48.758569+0000","last_unstale":"2023-10-03T10:09:48.761143+0000","last_undegraded":"2023-10-03T10:09:48.761143+0000","last_fullsized":"2023-10-03T10:09:48.761143+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.744574+0000","last_change":"2023-10-03T10:09:48.740857+0000","last_active":"2023-10-03T10:09:48.744574+0000","last_peered":"2023-10-03T10:09:48.744574+0000","last_clean":"2023-10-03T10:09:48.744574+0000","last_became_active":"2023-10-03T10:09:48.740608+0000","last_became_peered":"2023-10-03T10:09:48.740608+0000","last_unstale":"2023-10-03T10:09:48.744574+0000","last_undegraded":"2023-10-03T10:09:48.744574+0000","last_fullsized":"2023-10-03T10:09:48.744574+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.744195+0000","last_change":"2023-10-03T10:09:48.740412+0000","last_active":"2023-10-03T10:09:48.744195+0000","last_peered":"2023-10-03T10:09:48.744195+0000","last_clean":"2023-10-03T10:09:48.744195+0000","last_became_active":"2023-10-03T10:09:48.740146+0000","last_became_peered":"2023-10-03T10:09:48.740146+0000","last_unstale":"2023-10-03T10:09:48.744195+0000","last_undegraded":"2023-10-03T10:09:48.744195+0000","last_fullsized":"2023-10-03T10:09:48.744195+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.768017+0000","last_change":"2023-10-03T10:09:48.758060+0000","last_active":"2023-10-03T10:09:48.768017+0000","last_peered":"2023-10-03T10:09:48.768017+0000","last_clean":"2023-10-03T10:09:48.768017+0000","last_became_active":"2023-10-03T10:09:48.757793+0000","last_became_peered":"2023-10-03T10:09:48.757793+0000","last_unstale":"2023-10-03T10:09:48.768017+0000","last_undegraded":"2023-10-03T10:09:48.768017+0000","last_fullsized":"2023-10-03T10:09:48.768017+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.770015+0000","last_change":"2023-10-03T10:09:48.757180+0000","last_active":"2023-10-03T10:09:48.770015+0000","last_peered":"2023-10-03T10:09:48.770015+0000","last_clean":"2023-10-03T10:09:48.770015+0000","last_became_active":"2023-10-03T10:09:48.756905+0000","last_became_peered":"2023-10-03T10:09:48.756905+0000","last_unstale":"2023-10-03T10:09:48.770015+0000","last_undegraded":"2023-10-03T10:09:48.770015+0000","last_fullsized":"2023-10-03T10:09:48.770015+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750451+0000","last_change":"2023-10-03T10:09:48.745373+0000","last_active":"2023-10-03T10:09:48.750451+0000","last_peered":"2023-10-03T10:09:48.750451+0000","last_clean":"2023-10-03T10:09:48.750451+0000","last_became_active":"2023-10-03T10:09:48.744351+0000","last_became_peered":"2023-10-03T10:09:48.744351+0000","last_unstale":"2023-10-03T10:09:48.750451+0000","last_undegraded":"2023-10-03T10:09:48.750451+0000","last_fullsized":"2023-10-03T10:09:48.750451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.761168+0000","last_change":"2023-10-03T10:09:48.759606+0000","last_active":"2023-10-03T10:09:48.761168+0000","last_peered":"2023-10-03T10:09:48.761168+0000","last_clean":"2023-10-03T10:09:48.761168+0000","last_became_active":"2023-10-03T10:09:48.759343+0000","last_became_peered":"2023-10-03T10:09:48.759343+0000","last_unstale":"2023-10-03T10:09:48.761168+0000","last_undegraded":"2023-10-03T10:09:48.761168+0000","last_fullsized":"2023-10-03T10:09:48.761168+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765193+0000","last_change":"2023-10-03T10:09:48.760055+0000","last_active":"2023-10-03T10:09:48.765193+0000","last_peered":"2023-10-03T10:09:48.765193+0000","last_clean":"2023-10-03T10:09:48.765193+0000","last_became_active":"2023-10-03T10:09:48.759787+0000","last_became_peered":"2023-10-03T10:09:48.759787+0000","last_unstale":"2023-10-03T10:09:48.765193+0000","last_undegraded":"2023-10-03T10:09:48.765193+0000","last_fullsized":"2023-10-03T10:09:48.765193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.763954+0000","last_change":"2023-10-03T10:09:48.753483+0000","last_active":"2023-10-03T10:09:48.763954+0000","last_peered":"2023-10-03T10:09:48.763954+0000","last_clean":"2023-10-03T10:09:48.763954+0000","last_became_active":"2023-10-03T10:09:48.752879+0000","last_became_peered":"2023-10-03T10:09:48.752879+0000","last_unstale":"2023-10-03T10:09:48.763954+0000","last_undegraded":"2023-10-03T10:09:48.763954+0000","last_fullsized":"2023-10-03T10:09:48.763954+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750515+0000","last_change":"2023-10-03T10:09:48.745699+0000","last_active":"2023-10-03T10:09:48.750515+0000","last_peered":"2023-10-03T10:09:48.750515+0000","last_clean":"2023-10-03T10:09:48.750515+0000","last_became_active":"2023-10-03T10:09:48.745433+0000","last_became_peered":"2023-10-03T10:09:48.745433+0000","last_unstale":"2023-10-03T10:09:48.750515+0000","last_undegraded":"2023-10-03T10:09:48.750515+0000","last_fullsized":"2023-10-03T10:09:48.750515+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.769929+0000","last_change":"2023-10-03T10:09:48.764152+0000","last_active":"2023-10-03T10:09:48.769929+0000","last_peered":"2023-10-03T10:09:48.769929+0000","last_clean":"2023-10-03T10:09:48.769929+0000","last_became_active":"2023-10-03T10:09:48.758589+0000","last_became_peered":"2023-10-03T10:09:48.758589+0000","last_unstale":"2023-10-03T10:09:48.769929+0000","last_undegraded":"2023-10-03T10:09:48.769929+0000","last_fullsized":"2023-10-03T10:09:48.769929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765097+0000","last_change":"2023-10-03T10:09:48.760358+0000","last_active":"2023-10-03T10:09:48.765097+0000","last_peered":"2023-10-03T10:09:48.765097+0000","last_clean":"2023-10-03T10:09:48.765097+0000","last_became_active":"2023-10-03T10:09:48.754451+0000","last_became_peered":"2023-10-03T10:09:48.754451+0000","last_unstale":"2023-10-03T10:09:48.765097+0000","last_undegraded":"2023-10-03T10:09:48.765097+0000","last_fullsized":"2023-10-03T10:09:48.765097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765283+0000","last_change":"2023-10-03T10:09:48.763060+0000","last_active":"2023-10-03T10:09:48.765283+0000","last_peered":"2023-10-03T10:09:48.765283+0000","last_clean":"2023-10-03T10:09:48.765283+0000","last_became_active":"2023-10-03T10:09:48.762772+0000","last_became_peered":"2023-10-03T10:09:48.762772+0000","last_unstale":"2023-10-03T10:09:48.765283+0000","last_undegraded":"2023-10-03T10:09:48.765283+0000","last_fullsized":"2023-10-03T10:09:48.765283+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.743835+0000","last_change":"2023-10-03T10:09:48.740694+0000","last_active":"2023-10-03T10:09:48.743835+0000","last_peered":"2023-10-03T10:09:48.743835+0000","last_clean":"2023-10-03T10:09:48.743835+0000","last_became_active":"2023-10-03T10:09:48.740403+0000","last_became_peered":"2023-10-03T10:09:48.740403+0000","last_unstale":"2023-10-03T10:09:48.743835+0000","last_undegraded":"2023-10-03T10:09:48.743835+0000","last_fullsized":"2023-10-03T10:09:48.743835+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.767981+0000","last_change":"2023-10-03T10:09:48.762261+0000","last_active":"2023-10-03T10:09:48.767981+0000","last_peered":"2023-10-03T10:09:48.767981+0000","last_clean":"2023-10-03T10:09:48.767981+0000","last_became_active":"2023-10-03T10:09:48.758917+0000","last_became_peered":"2023-10-03T10:09:48.758917+0000","last_unstale":"2023-10-03T10:09:48.767981+0000","last_undegraded":"2023-10-03T10:09:48.767981+0000","last_fullsized":"2023-10-03T10:09:48.767981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.743194+0000","last_change":"2023-10-03T10:09:48.371325+0000","last_active":"2023-10-03T10:09:48.743194+0000","last_peered":"2023-10-03T10:09:48.743194+0000","last_clean":"2023-10-03T10:09:48.743194+0000","last_became_active":"2023-10-03T10:09:48.371116+0000","last_became_peered":"2023-10-03T10:09:48.371116+0000","last_unstale":"2023-10-03T10:09:48.743194+0000","last_undegraded":"2023-10-03T10:09:48.743194+0000","last_fullsized":"2023-10-03T10:09:48.743194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.770196+0000","last_change":"2023-10-03T10:09:48.766155+0000","last_active":"2023-10-03T10:09:48.770196+0000","last_peered":"2023-10-03T10:09:48.770196+0000","last_clean":"2023-10-03T10:09:48.770196+0000","last_became_active":"2023-10-03T10:09:48.765746+0000","last_became_peered":"2023-10-03T10:09:48.765746+0000","last_unstale":"2023-10-03T10:09:48.770196+0000","last_undegraded":"2023-10-03T10:09:48.770196+0000","last_fullsized":"2023-10-03T10:09:48.770196+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.728334+0000","last_change":"2023-10-03T10:09:48.377430+0000","last_active":"2023-10-03T10:09:48.728334+0000","last_peered":"2023-10-03T10:09:48.728334+0000","last_clean":"2023-10-03T10:09:48.728334+0000","last_became_active":"2023-10-03T10:09:48.376947+0000","last_became_peered":"2023-10-03T10:09:48.376947+0000","last_unstale":"2023-10-03T10:09:48.728334+0000","last_undegraded":"2023-10-03T10:09:48.728334+0000","last_fullsized":"2023-10-03T10:09:48.728334+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750478+0000","last_change":"2023-10-03T10:09:48.745599+0000","last_active":"2023-10-03T10:09:48.750478+0000","last_peered":"2023-10-03T10:09:48.750478+0000","last_clean":"2023-10-03T10:09:48.750478+0000","last_became_active":"2023-10-03T10:09:48.744772+0000","last_became_peered":"2023-10-03T10:09:48.744772+0000","last_unstale":"2023-10-03T10:09:48.750478+0000","last_undegraded":"2023-10-03T10:09:48.750478+0000","last_fullsized":"2023-10-03T10:09:48.750478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.749249+0000","last_change":"2023-10-03T10:09:48.365550+0000","last_active":"2023-10-03T10:09:48.749249+0000","last_peered":"2023-10-03T10:09:48.749249+0000","last_clean":"2023-10-03T10:09:48.749249+0000","last_became_active":"2023-10-03T10:09:48.364969+0000","last_became_peered":"2023-10-03T10:09:48.364969+0000","last_unstale":"2023-10-03T10:09:48.749249+0000","last_undegraded":"2023-10-03T10:09:48.749249+0000","last_fullsized":"2023-10-03T10:09:48.749249+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.772400+0000","last_change":"2023-10-03T10:09:48.768231+0000","last_active":"2023-10-03T10:09:48.772400+0000","last_peered":"2023-10-03T10:09:48.772400+0000","last_clean":"2023-10-03T10:09:48.772400+0000","last_became_active":"2023-10-03T10:09:48.767982+0000","last_became_peered":"2023-10-03T10:09:48.767982+0000","last_unstale":"2023-10-03T10:09:48.772400+0000","last_undegraded":"2023-10-03T10:09:48.772400+0000","last_fullsized":"2023-10-03T10:09:48.772400+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.732659+0000","last_change":"2023-10-03T10:09:48.372222+0000","last_active":"2023-10-03T10:09:48.732659+0000","last_peered":"2023-10-03T10:09:48.732659+0000","last_clean":"2023-10-03T10:09:48.732659+0000","last_became_active":"2023-10-03T10:09:48.371919+0000","last_became_peered":"2023-10-03T10:09:48.371919+0000","last_unstale":"2023-10-03T10:09:48.732659+0000","last_undegraded":"2023-10-03T10:09:48.732659+0000","last_fullsized":"2023-10-03T10:09:48.732659+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.772230+0000","last_change":"2023-10-03T10:09:48.766829+0000","last_active":"2023-10-03T10:09:48.772230+0000","last_peered":"2023-10-03T10:09:48.772230+0000","last_clean":"2023-10-03T10:09:48.772230+0000","last_became_active":"2023-10-03T10:09:48.766356+0000","last_became_peered":"2023-10-03T10:09:48.766356+0000","last_unstale":"2023-10-03T10:09:48.772230+0000","last_undegraded":"2023-10-03T10:09:48.772230+0000","last_fullsized":"2023-10-03T10:09:48.772230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.730240+0000","last_change":"2023-10-03T10:09:48.375954+0000","last_active":"2023-10-03T10:09:48.730240+0000","last_peered":"2023-10-03T10:09:48.730240+0000","last_clean":"2023-10-03T10:09:48.730240+0000","last_became_active":"2023-10-03T10:09:48.375703+0000","last_became_peered":"2023-10-03T10:09:48.375703+0000","last_unstale":"2023-10-03T10:09:48.730240+0000","last_undegraded":"2023-10-03T10:09:48.730240+0000","last_fullsized":"2023-10-03T10:09:48.730240+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.768057+0000","last_change":"2023-10-03T10:09:48.762438+0000","last_active":"2023-10-03T10:09:48.768057+0000","last_peered":"2023-10-03T10:09:48.768057+0000","last_clean":"2023-10-03T10:09:48.768057+0000","last_became_active":"2023-10-03T10:09:48.758825+0000","last_became_peered":"2023-10-03T10:09:48.758825+0000","last_unstale":"2023-10-03T10:09:48.768057+0000","last_undegraded":"2023-10-03T10:09:48.768057+0000","last_fullsized":"2023-10-03T10:09:48.768057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.744267+0000","last_change":"2023-10-03T10:09:48.377186+0000","last_active":"2023-10-03T10:09:48.744267+0000","last_peered":"2023-10-03T10:09:48.744267+0000","last_clean":"2023-10-03T10:09:48.744267+0000","last_became_active":"2023-10-03T10:09:48.376584+0000","last_became_peered":"2023-10-03T10:09:48.376584+0000","last_unstale":"2023-10-03T10:09:48.744267+0000","last_undegraded":"2023-10-03T10:09:48.744267+0000","last_fullsized":"2023-10-03T10:09:48.744267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765361+0000","last_change":"2023-10-03T10:09:48.762792+0000","last_active":"2023-10-03T10:09:48.765361+0000","last_peered":"2023-10-03T10:09:48.765361+0000","last_clean":"2023-10-03T10:09:48.765361+0000","last_became_active":"2023-10-03T10:09:48.762334+0000","last_became_peered":"2023-10-03T10:09:48.762334+0000","last_unstale":"2023-10-03T10:09:48.765361+0000","last_undegraded":"2023-10-03T10:09:48.765361+0000","last_fullsized":"2023-10-03T10:09:48.765361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.774974+0000","last_change":"2023-10-03T10:09:48.370604+0000","last_active":"2023-10-03T10:09:48.774974+0000","last_peered":"2023-10-03T10:09:48.774974+0000","last_clean":"2023-10-03T10:09:48.774974+0000","last_became_active":"2023-10-03T10:09:48.370305+0000","last_became_peered":"2023-10-03T10:09:48.370305+0000","last_unstale":"2023-10-03T10:09:48.774974+0000","last_undegraded":"2023-10-03T10:09:48.774974+0000","last_fullsized":"2023-10-03T10:09:48.774974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.760581+0000","last_change":"2023-10-03T10:09:48.758807+0000","last_active":"2023-10-03T10:09:48.760581+0000","last_peered":"2023-10-03T10:09:48.760581+0000","last_clean":"2023-10-03T10:09:48.760581+0000","last_became_active":"2023-10-03T10:09:48.757966+0000","last_became_peered":"2023-10-03T10:09:48.757966+0000","last_unstale":"2023-10-03T10:09:48.760581+0000","last_undegraded":"2023-10-03T10:09:48.760581+0000","last_fullsized":"2023-10-03T10:09:48.760581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.769478+0000","last_change":"2023-10-03T10:09:48.367621+0000","last_active":"2023-10-03T10:09:48.769478+0000","last_peered":"2023-10-03T10:09:48.769478+0000","last_clean":"2023-10-03T10:09:48.769478+0000","last_became_active":"2023-10-03T10:09:48.367354+0000","last_became_peered":"2023-10-03T10:09:48.367354+0000","last_unstale":"2023-10-03T10:09:48.769478+0000","last_undegraded":"2023-10-03T10:09:48.769478+0000","last_fullsized":"2023-10-03T10:09:48.769478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.768658+0000","last_change":"2023-10-03T10:09:48.763072+0000","last_active":"2023-10-03T10:09:48.768658+0000","last_peered":"2023-10-03T10:09:48.768658+0000","last_clean":"2023-10-03T10:09:48.768658+0000","last_became_active":"2023-10-03T10:09:48.762225+0000","last_became_peered":"2023-10-03T10:09:48.762225+0000","last_unstale":"2023-10-03T10:09:48.768658+0000","last_undegraded":"2023-10-03T10:09:48.768658+0000","last_fullsized":"2023-10-03T10:09:48.768658+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.735600+0000","last_change":"2023-10-03T10:09:48.380634+0000","last_active":"2023-10-03T10:09:48.735600+0000","last_peered":"2023-10-03T10:09:48.735600+0000","last_clean":"2023-10-03T10:09:48.735600+0000","last_became_active":"2023-10-03T10:09:48.380317+0000","last_became_peered":"2023-10-03T10:09:48.380317+0000","last_unstale":"2023-10-03T10:09:48.735600+0000","last_undegraded":"2023-10-03T10:09:48.735600+0000","last_fullsized":"2023-10-03T10:09:48.735600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.774942+0000","last_change":"2023-10-03T10:09:48.769900+0000","last_active":"2023-10-03T10:09:48.774942+0000","last_peered":"2023-10-03T10:09:48.774942+0000","last_clean":"2023-10-03T10:09:48.774942+0000","last_became_active":"2023-10-03T10:09:48.769431+0000","last_became_peered":"2023-10-03T10:09:48.769431+0000","last_unstale":"2023-10-03T10:09:48.774942+0000","last_undegraded":"2023-10-03T10:09:48.774942+0000","last_fullsized":"2023-10-03T10:09:48.774942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.751633+0000","last_change":"2023-10-03T10:09:48.374660+0000","last_active":"2023-10-03T10:09:48.751633+0000","last_peered":"2023-10-03T10:09:48.751633+0000","last_clean":"2023-10-03T10:09:48.751633+0000","last_became_active":"2023-10-03T10:09:48.371590+0000","last_became_peered":"2023-10-03T10:09:48.371590+0000","last_unstale":"2023-10-03T10:09:48.751633+0000","last_undegraded":"2023-10-03T10:09:48.751633+0000","last_fullsized":"2023-10-03T10:09:48.751633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.769272+0000","last_change":"2023-10-03T10:09:48.758669+0000","last_active":"2023-10-03T10:09:48.769272+0000","last_peered":"2023-10-03T10:09:48.769272+0000","last_clean":"2023-10-03T10:09:48.769272+0000","last_became_active":"2023-10-03T10:09:48.758412+0000","last_became_peered":"2023-10-03T10:09:48.758412+0000","last_unstale":"2023-10-03T10:09:48.769272+0000","last_undegraded":"2023-10-03T10:09:48.769272+0000","last_fullsized":"2023-10-03T10:09:48.769272+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.761164+0000","last_change":"2023-10-03T10:09:48.369149+0000","last_active":"2023-10-03T10:09:48.761164+0000","last_peered":"2023-10-03T10:09:48.761164+0000","last_clean":"2023-10-03T10:09:48.761164+0000","last_became_active":"2023-10-03T10:09:48.368855+0000","last_became_peered":"2023-10-03T10:09:48.368855+0000","last_unstale":"2023-10-03T10:09:48.761164+0000","last_undegraded":"2023-10-03T10:09:48.761164+0000","last_fullsized":"2023-10-03T10:09:48.761164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.772373+0000","last_change":"2023-10-03T10:09:48.767773+0000","last_active":"2023-10-03T10:09:48.772373+0000","last_peered":"2023-10-03T10:09:48.772373+0000","last_clean":"2023-10-03T10:09:48.772373+0000","last_became_active":"2023-10-03T10:09:48.767519+0000","last_became_peered":"2023-10-03T10:09:48.767519+0000","last_unstale":"2023-10-03T10:09:48.772373+0000","last_undegraded":"2023-10-03T10:09:48.772373+0000","last_fullsized":"2023-10-03T10:09:48.772373+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.746162+0000","last_change":"2023-10-03T10:09:48.377423+0000","last_active":"2023-10-03T10:09:48.746162+0000","last_peered":"2023-10-03T10:09:48.746162+0000","last_clean":"2023-10-03T10:09:48.746162+0000","last_became_active":"2023-10-03T10:09:48.376337+0000","last_became_peered":"2023-10-03T10:09:48.376337+0000","last_unstale":"2023-10-03T10:09:48.746162+0000","last_undegraded":"2023-10-03T10:09:48.746162+0000","last_fullsized":"2023-10-03T10:09:48.746162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.772277+0000","last_change":"2023-10-03T10:09:48.767141+0000","last_active":"2023-10-03T10:09:48.772277+0000","last_peered":"2023-10-03T10:09:48.772277+0000","last_clean":"2023-10-03T10:09:48.772277+0000","last_became_active":"2023-10-03T10:09:48.766563+0000","last_became_peered":"2023-10-03T10:09:48.766563+0000","last_unstale":"2023-10-03T10:09:48.772277+0000","last_undegraded":"2023-10-03T10:09:48.772277+0000","last_fullsized":"2023-10-03T10:09:48.772277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.745126+0000","last_change":"2023-10-03T10:09:48.370781+0000","last_active":"2023-10-03T10:09:48.745126+0000","last_peered":"2023-10-03T10:09:48.745126+0000","last_clean":"2023-10-03T10:09:48.745126+0000","last_became_active":"2023-10-03T10:09:48.370500+0000","last_became_peered":"2023-10-03T10:09:48.370500+0000","last_unstale":"2023-10-03T10:09:48.745126+0000","last_undegraded":"2023-10-03T10:09:48.745126+0000","last_fullsized":"2023-10-03T10:09:48.745126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765032+0000","last_change":"2023-10-03T10:09:48.762174+0000","last_active":"2023-10-03T10:09:48.765032+0000","last_peered":"2023-10-03T10:09:48.765032+0000","last_clean":"2023-10-03T10:09:48.765032+0000","last_became_active":"2023-10-03T10:09:48.761912+0000","last_became_peered":"2023-10-03T10:09:48.761912+0000","last_unstale":"2023-10-03T10:09:48.765032+0000","last_undegraded":"2023-10-03T10:09:48.765032+0000","last_fullsized":"2023-10-03T10:09:48.765032+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765774+0000","last_change":"2023-10-03T10:09:48.375317+0000","last_active":"2023-10-03T10:09:48.765774+0000","last_peered":"2023-10-03T10:09:48.765774+0000","last_clean":"2023-10-03T10:09:48.765774+0000","last_became_active":"2023-10-03T10:09:48.375033+0000","last_became_peered":"2023-10-03T10:09:48.375033+0000","last_unstale":"2023-10-03T10:09:48.765774+0000","last_undegraded":"2023-10-03T10:09:48.765774+0000","last_fullsized":"2023-10-03T10:09:48.765774+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.760927+0000","last_change":"2023-10-03T10:09:48.758357+0000","last_active":"2023-10-03T10:09:48.760927+0000","last_peered":"2023-10-03T10:09:48.760927+0000","last_clean":"2023-10-03T10:09:48.760927+0000","last_became_active":"2023-10-03T10:09:48.757940+0000","last_became_peered":"2023-10-03T10:09:48.757940+0000","last_unstale":"2023-10-03T10:09:48.760927+0000","last_undegraded":"2023-10-03T10:09:48.760927+0000","last_fullsized":"2023-10-03T10:09:48.760927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.734316+0000","last_change":"2023-10-03T10:09:48.376891+0000","last_active":"2023-10-03T10:09:48.734316+0000","last_peered":"2023-10-03T10:09:48.734316+0000","last_clean":"2023-10-03T10:09:48.734316+0000","last_became_active":"2023-10-03T10:09:48.376350+0000","last_became_peered":"2023-10-03T10:09:48.376350+0000","last_unstale":"2023-10-03T10:09:48.734316+0000","last_undegraded":"2023-10-03T10:09:48.734316+0000","last_fullsized":"2023-10-03T10:09:48.734316+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750404+0000","last_change":"2023-10-03T10:09:48.745699+0000","last_active":"2023-10-03T10:09:48.750404+0000","last_peered":"2023-10-03T10:09:48.750404+0000","last_clean":"2023-10-03T10:09:48.750404+0000","last_became_active":"2023-10-03T10:09:48.745452+0000","last_became_peered":"2023-10-03T10:09:48.745452+0000","last_unstale":"2023-10-03T10:09:48.750404+0000","last_undegraded":"2023-10-03T10:09:48.750404+0000","last_fullsized":"2023-10-03T10:09:48.750404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.764288+0000","last_change":"2023-10-03T10:09:48.376011+0000","last_active":"2023-10-03T10:09:48.764288+0000","last_peered":"2023-10-03T10:09:48.764288+0000","last_clean":"2023-10-03T10:09:48.764288+0000","last_became_active":"2023-10-03T10:09:48.375731+0000","last_became_peered":"2023-10-03T10:09:48.375731+0000","last_unstale":"2023-10-03T10:09:48.764288+0000","last_undegraded":"2023-10-03T10:09:48.764288+0000","last_fullsized":"2023-10-03T10:09:48.764288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.764030+0000","last_change":"2023-10-03T10:09:48.755197+0000","last_active":"2023-10-03T10:09:48.764030+0000","last_peered":"2023-10-03T10:09:48.764030+0000","last_clean":"2023-10-03T10:09:48.764030+0000","last_became_active":"2023-10-03T10:09:48.754954+0000","last_became_peered":"2023-10-03T10:09:48.754954+0000","last_unstale":"2023-10-03T10:09:48.764030+0000","last_undegraded":"2023-10-03T10:09:48.764030+0000","last_fullsized":"2023-10-03T10:09:48.764030+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.752673+0000","last_change":"2023-10-03T10:09:48.371687+0000","last_active":"2023-10-03T10:09:48.752673+0000","last_peered":"2023-10-03T10:09:48.752673+0000","last_clean":"2023-10-03T10:09:48.752673+0000","last_became_active":"2023-10-03T10:09:48.371207+0000","last_became_peered":"2023-10-03T10:09:48.371207+0000","last_unstale":"2023-10-03T10:09:48.752673+0000","last_undegraded":"2023-10-03T10:09:48.752673+0000","last_fullsized":"2023-10-03T10:09:48.752673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.770216+0000","last_change":"2023-10-03T10:09:48.766338+0000","last_active":"2023-10-03T10:09:48.770216+0000","last_peered":"2023-10-03T10:09:48.770216+0000","last_clean":"2023-10-03T10:09:48.770216+0000","last_became_active":"2023-10-03T10:09:48.765944+0000","last_became_peered":"2023-10-03T10:09:48.765944+0000","last_unstale":"2023-10-03T10:09:48.770216+0000","last_undegraded":"2023-10-03T10:09:48.770216+0000","last_fullsized":"2023-10-03T10:09:48.770216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.751181+0000","last_change":"2023-10-03T10:09:48.374804+0000","last_active":"2023-10-03T10:09:48.751181+0000","last_peered":"2023-10-03T10:09:48.751181+0000","last_clean":"2023-10-03T10:09:48.751181+0000","last_became_active":"2023-10-03T10:09:48.374469+0000","last_became_peered":"2023-10-03T10:09:48.374469+0000","last_unstale":"2023-10-03T10:09:48.751181+0000","last_undegraded":"2023-10-03T10:09:48.751181+0000","last_fullsized":"2023-10-03T10:09:48.751181+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.761534+0000","last_change":"2023-10-03T10:09:48.759354+0000","last_active":"2023-10-03T10:09:48.761534+0000","last_peered":"2023-10-03T10:09:48.761534+0000","last_clean":"2023-10-03T10:09:48.761534+0000","last_became_active":"2023-10-03T10:09:48.759106+0000","last_became_peered":"2023-10-03T10:09:48.759106+0000","last_unstale":"2023-10-03T10:09:48.761534+0000","last_undegraded":"2023-10-03T10:09:48.761534+0000","last_fullsized":"2023-10-03T10:09:48.761534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.748782+0000","last_change":"2023-10-03T10:09:48.379214+0000","last_active":"2023-10-03T10:09:48.748782+0000","last_peered":"2023-10-03T10:09:48.748782+0000","last_clean":"2023-10-03T10:09:48.748782+0000","last_became_active":"2023-10-03T10:09:48.378808+0000","last_became_peered":"2023-10-03T10:09:48.378808+0000","last_unstale":"2023-10-03T10:09:48.748782+0000","last_undegraded":"2023-10-03T10:09:48.748782+0000","last_fullsized":"2023-10-03T10:09:48.748782+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765242+0000","last_change":"2023-10-03T10:09:48.762823+0000","last_active":"2023-10-03T10:09:48.765242+0000","last_peered":"2023-10-03T10:09:48.765242+0000","last_clean":"2023-10-03T10:09:48.765242+0000","last_became_active":"2023-10-03T10:09:48.762544+0000","last_became_peered":"2023-10-03T10:09:48.762544+0000","last_unstale":"2023-10-03T10:09:48.765242+0000","last_undegraded":"2023-10-03T10:09:48.765242+0000","last_fullsized":"2023-10-03T10:09:48.765242+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.728742+0000","last_change":"2023-10-03T10:09:44.335057+0000","last_active":"2023-10-03T10:09:48.728742+0000","last_peered":"2023-10-03T10:09:48.728742+0000","last_clean":"2023-10-03T10:09:48.728742+0000","last_became_active":"2023-10-03T10:09:44.334848+0000","last_became_peered":"2023-10-03T10:09:44.334848+0000","last_unstale":"2023-10-03T10:09:48.728742+0000","last_undegraded":"2023-10-03T10:09:48.728742+0000","last_fullsized":"2023-10-03T10:09:48.728742+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.730142+0000","last_change":"2023-10-03T10:09:48.379615+0000","last_active":"2023-10-03T10:09:48.730142+0000","last_peered":"2023-10-03T10:09:48.730142+0000","last_clean":"2023-10-03T10:09:48.730142+0000","last_became_active":"2023-10-03T10:09:48.379353+0000","last_became_peered":"2023-10-03T10:09:48.379353+0000","last_unstale":"2023-10-03T10:09:48.730142+0000","last_undegraded":"2023-10-03T10:09:48.730142+0000","last_fullsized":"2023-10-03T10:09:48.730142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765341+0000","last_change":"2023-10-03T10:09:48.762628+0000","last_active":"2023-10-03T10:09:48.765341+0000","last_peered":"2023-10-03T10:09:48.765341+0000","last_clean":"2023-10-03T10:09:48.765341+0000","last_became_active":"2023-10-03T10:09:48.762007+0000","last_became_peered":"2023-10-03T10:09:48.762007+0000","last_unstale":"2023-10-03T10:09:48.765341+0000","last_undegraded":"2023-10-03T10:09:48.765341+0000","last_fullsized":"2023-10-03T10:09:48.765341+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.752509+0000","last_change":"2023-10-03T10:09:44.331820+0000","last_active":"2023-10-03T10:09:48.752509+0000","last_peered":"2023-10-03T10:09:48.752509+0000","last_clean":"2023-10-03T10:09:48.752509+0000","last_became_active":"2023-10-03T10:09:44.331226+0000","last_became_peered":"2023-10-03T10:09:44.331226+0000","last_unstale":"2023-10-03T10:09:48.752509+0000","last_undegraded":"2023-10-03T10:09:48.752509+0000","last_fullsized":"2023-10-03T10:09:48.752509+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.736338+0000","last_change":"2023-10-03T10:09:48.373278+0000","last_active":"2023-10-03T10:09:48.736338+0000","last_peered":"2023-10-03T10:09:48.736338+0000","last_clean":"2023-10-03T10:09:48.736338+0000","last_became_active":"2023-10-03T10:09:48.372993+0000","last_became_peered":"2023-10-03T10:09:48.372993+0000","last_unstale":"2023-10-03T10:09:48.736338+0000","last_undegraded":"2023-10-03T10:09:48.736338+0000","last_fullsized":"2023-10-03T10:09:48.736338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.749679+0000","last_change":"2023-10-03T10:09:48.742549+0000","last_active":"2023-10-03T10:09:48.749679+0000","last_peered":"2023-10-03T10:09:48.749679+0000","last_clean":"2023-10-03T10:09:48.749679+0000","last_became_active":"2023-10-03T10:09:48.740207+0000","last_became_peered":"2023-10-03T10:09:48.740207+0000","last_unstale":"2023-10-03T10:09:48.749679+0000","last_undegraded":"2023-10-03T10:09:48.749679+0000","last_fullsized":"2023-10-03T10:09:48.749679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.730019+0000","last_change":"2023-10-03T10:09:44.331573+0000","last_active":"2023-10-03T10:09:48.730019+0000","last_peered":"2023-10-03T10:09:48.730019+0000","last_clean":"2023-10-03T10:09:48.730019+0000","last_became_active":"2023-10-03T10:09:44.331265+0000","last_became_peered":"2023-10-03T10:09:44.331265+0000","last_unstale":"2023-10-03T10:09:48.730019+0000","last_undegraded":"2023-10-03T10:09:48.730019+0000","last_fullsized":"2023-10-03T10:09:48.730019+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.733325+0000","last_change":"2023-10-03T10:09:48.372153+0000","last_active":"2023-10-03T10:09:48.733325+0000","last_peered":"2023-10-03T10:09:48.733325+0000","last_clean":"2023-10-03T10:09:48.733325+0000","last_became_active":"2023-10-03T10:09:48.371868+0000","last_became_peered":"2023-10-03T10:09:48.371868+0000","last_unstale":"2023-10-03T10:09:48.733325+0000","last_undegraded":"2023-10-03T10:09:48.733325+0000","last_fullsized":"2023-10-03T10:09:48.733325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.758919+0000","last_change":"2023-10-03T10:09:48.745855+0000","last_active":"2023-10-03T10:09:48.758919+0000","last_peered":"2023-10-03T10:09:48.758919+0000","last_clean":"2023-10-03T10:09:48.758919+0000","last_became_active":"2023-10-03T10:09:48.745606+0000","last_became_peered":"2023-10-03T10:09:48.745606+0000","last_unstale":"2023-10-03T10:09:48.758919+0000","last_undegraded":"2023-10-03T10:09:48.758919+0000","last_fullsized":"2023-10-03T10:09:48.758919+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.752337+0000","last_change":"2023-10-03T10:09:44.331400+0000","last_active":"2023-10-03T10:09:48.752337+0000","last_peered":"2023-10-03T10:09:48.752337+0000","last_clean":"2023-10-03T10:09:48.752337+0000","last_became_active":"2023-10-03T10:09:44.331097+0000","last_became_peered":"2023-10-03T10:09:44.331097+0000","last_unstale":"2023-10-03T10:09:48.752337+0000","last_undegraded":"2023-10-03T10:09:48.752337+0000","last_fullsized":"2023-10-03T10:09:48.752337+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.733220+0000","last_change":"2023-10-03T10:09:44.334568+0000","last_active":"2023-10-03T10:09:48.733220+0000","last_peered":"2023-10-03T10:09:48.733220+0000","last_clean":"2023-10-03T10:09:48.733220+0000","last_became_active":"2023-10-03T10:09:44.333878+0000","last_became_peered":"2023-10-03T10:09:44.333878+0000","last_unstale":"2023-10-03T10:09:48.733220+0000","last_undegraded":"2023-10-03T10:09:48.733220+0000","last_fullsized":"2023-10-03T10:09:48.733220+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.752342+0000","last_change":"2023-10-03T10:09:48.371394+0000","last_active":"2023-10-03T10:09:48.752342+0000","last_peered":"2023-10-03T10:09:48.752342+0000","last_clean":"2023-10-03T10:09:48.752342+0000","last_became_active":"2023-10-03T10:09:48.371089+0000","last_became_peered":"2023-10-03T10:09:48.371089+0000","last_unstale":"2023-10-03T10:09:48.752342+0000","last_undegraded":"2023-10-03T10:09:48.752342+0000","last_fullsized":"2023-10-03T10:09:48.752342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.772251+0000","last_change":"2023-10-03T10:09:48.766928+0000","last_active":"2023-10-03T10:09:48.772251+0000","last_peered":"2023-10-03T10:09:48.772251+0000","last_clean":"2023-10-03T10:09:48.772251+0000","last_became_active":"2023-10-03T10:09:48.766090+0000","last_became_peered":"2023-10-03T10:09:48.766090+0000","last_unstale":"2023-10-03T10:09:48.772251+0000","last_undegraded":"2023-10-03T10:09:48.772251+0000","last_fullsized":"2023-10-03T10:09:48.772251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.749182+0000","last_change":"2023-10-03T10:09:44.333732+0000","last_active":"2023-10-03T10:09:48.749182+0000","last_peered":"2023-10-03T10:09:48.749182+0000","last_clean":"2023-10-03T10:09:48.749182+0000","last_became_active":"2023-10-03T10:09:44.333408+0000","last_became_peered":"2023-10-03T10:09:44.333408+0000","last_unstale":"2023-10-03T10:09:48.749182+0000","last_undegraded":"2023-10-03T10:09:48.749182+0000","last_fullsized":"2023-10-03T10:09:48.749182+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.732685+0000","last_change":"2023-10-03T10:09:48.369173+0000","last_active":"2023-10-03T10:09:48.732685+0000","last_peered":"2023-10-03T10:09:48.732685+0000","last_clean":"2023-10-03T10:09:48.732685+0000","last_became_active":"2023-10-03T10:09:48.368843+0000","last_became_peered":"2023-10-03T10:09:48.368843+0000","last_unstale":"2023-10-03T10:09:48.732685+0000","last_undegraded":"2023-10-03T10:09:48.732685+0000","last_fullsized":"2023-10-03T10:09:48.732685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750496+0000","last_change":"2023-10-03T10:09:48.747157+0000","last_active":"2023-10-03T10:09:48.750496+0000","last_peered":"2023-10-03T10:09:48.750496+0000","last_clean":"2023-10-03T10:09:48.750496+0000","last_became_active":"2023-10-03T10:09:48.745029+0000","last_became_peered":"2023-10-03T10:09:48.745029+0000","last_unstale":"2023-10-03T10:09:48.750496+0000","last_undegraded":"2023-10-03T10:09:48.750496+0000","last_fullsized":"2023-10-03T10:09:48.750496+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.753191+0000","last_change":"2023-10-03T10:09:44.329886+0000","last_active":"2023-10-03T10:09:48.753191+0000","last_peered":"2023-10-03T10:09:48.753191+0000","last_clean":"2023-10-03T10:09:48.753191+0000","last_became_active":"2023-10-03T10:09:44.329607+0000","last_became_peered":"2023-10-03T10:09:44.329607+0000","last_unstale":"2023-10-03T10:09:48.753191+0000","last_undegraded":"2023-10-03T10:09:48.753191+0000","last_fullsized":"2023-10-03T10:09:48.753191+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.728946+0000","last_change":"2023-10-03T10:09:48.371183+0000","last_active":"2023-10-03T10:09:48.728946+0000","last_peered":"2023-10-03T10:09:48.728946+0000","last_clean":"2023-10-03T10:09:48.728946+0000","last_became_active":"2023-10-03T10:09:48.370930+0000","last_became_peered":"2023-10-03T10:09:48.370930+0000","last_unstale":"2023-10-03T10:09:48.728946+0000","last_undegraded":"2023-10-03T10:09:48.728946+0000","last_fullsized":"2023-10-03T10:09:48.728946+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.748550+0000","last_change":"2023-10-03T10:09:48.743221+0000","last_active":"2023-10-03T10:09:48.748550+0000","last_peered":"2023-10-03T10:09:48.748550+0000","last_clean":"2023-10-03T10:09:48.748550+0000","last_became_active":"2023-10-03T10:09:48.742967+0000","last_became_peered":"2023-10-03T10:09:48.742967+0000","last_unstale":"2023-10-03T10:09:48.748550+0000","last_undegraded":"2023-10-03T10:09:48.748550+0000","last_fullsized":"2023-10-03T10:09:48.748550+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.769845+0000","last_change":"2023-10-03T10:09:48.371421+0000","last_active":"2023-10-03T10:09:48.769845+0000","last_peered":"2023-10-03T10:09:48.769845+0000","last_clean":"2023-10-03T10:09:48.769845+0000","last_became_active":"2023-10-03T10:09:48.371121+0000","last_became_peered":"2023-10-03T10:09:48.371121+0000","last_unstale":"2023-10-03T10:09:48.769845+0000","last_undegraded":"2023-10-03T10:09:48.769845+0000","last_fullsized":"2023-10-03T10:09:48.769845+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.730242+0000","last_change":"2023-10-03T10:09:44.334348+0000","last_active":"2023-10-03T10:09:48.730242+0000","last_peered":"2023-10-03T10:09:48.730242+0000","last_clean":"2023-10-03T10:09:48.730242+0000","last_became_active":"2023-10-03T10:09:44.333893+0000","last_became_peered":"2023-10-03T10:09:44.333893+0000","last_unstale":"2023-10-03T10:09:48.730242+0000","last_undegraded":"2023-10-03T10:09:48.730242+0000","last_fullsized":"2023-10-03T10:09:48.730242+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.772207+0000","last_change":"2023-10-03T10:09:48.766676+0000","last_active":"2023-10-03T10:09:48.772207+0000","last_peered":"2023-10-03T10:09:48.772207+0000","last_clean":"2023-10-03T10:09:48.772207+0000","last_became_active":"2023-10-03T10:09:48.766218+0000","last_became_peered":"2023-10-03T10:09:48.766218+0000","last_unstale":"2023-10-03T10:09:48.772207+0000","last_undegraded":"2023-10-03T10:09:48.772207+0000","last_fullsized":"2023-10-03T10:09:48.772207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.755224+0000","last_change":"2023-10-03T10:09:44.333678+0000","last_active":"2023-10-03T10:09:48.755224+0000","last_peered":"2023-10-03T10:09:48.755224+0000","last_clean":"2023-10-03T10:09:48.755224+0000","last_became_active":"2023-10-03T10:09:44.333326+0000","last_became_peered":"2023-10-03T10:09:44.333326+0000","last_unstale":"2023-10-03T10:09:48.755224+0000","last_undegraded":"2023-10-03T10:09:48.755224+0000","last_fullsized":"2023-10-03T10:09:48.755224+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:49.729578+0000","last_change":"2023-10-03T10:09:48.380501+0000","last_active":"2023-10-03T10:09:49.729578+0000","last_peered":"2023-10-03T10:09:49.729578+0000","last_clean":"2023-10-03T10:09:49.729578+0000","last_became_active":"2023-10-03T10:09:48.380205+0000","last_became_peered":"2023-10-03T10:09:48.380205+0000","last_unstale":"2023-10-03T10:09:49.729578+0000","last_undegraded":"2023-10-03T10:09:49.729578+0000","last_fullsized":"2023-10-03T10:09:49.729578+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.763696+0000","last_change":"2023-10-03T10:09:48.760491+0000","last_active":"2023-10-03T10:09:48.763696+0000","last_peered":"2023-10-03T10:09:48.763696+0000","last_clean":"2023-10-03T10:09:48.763696+0000","last_became_active":"2023-10-03T10:09:48.760201+0000","last_became_peered":"2023-10-03T10:09:48.760201+0000","last_unstale":"2023-10-03T10:09:48.763696+0000","last_undegraded":"2023-10-03T10:09:48.763696+0000","last_fullsized":"2023-10-03T10:09:48.763696+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750298+0000","last_change":"2023-10-03T10:09:48.381420+0000","last_active":"2023-10-03T10:09:48.750298+0000","last_peered":"2023-10-03T10:09:48.750298+0000","last_clean":"2023-10-03T10:09:48.750298+0000","last_became_active":"2023-10-03T10:09:48.380776+0000","last_became_peered":"2023-10-03T10:09:48.380776+0000","last_unstale":"2023-10-03T10:09:48.750298+0000","last_undegraded":"2023-10-03T10:09:48.750298+0000","last_fullsized":"2023-10-03T10:09:48.750298+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.751210+0000","last_change":"2023-10-03T10:09:48.747044+0000","last_active":"2023-10-03T10:09:48.751210+0000","last_peered":"2023-10-03T10:09:48.751210+0000","last_clean":"2023-10-03T10:09:48.751210+0000","last_became_active":"2023-10-03T10:09:48.746598+0000","last_became_peered":"2023-10-03T10:09:48.746598+0000","last_unstale":"2023-10-03T10:09:48.751210+0000","last_undegraded":"2023-10-03T10:09:48.751210+0000","last_fullsized":"2023-10-03T10:09:48.751210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.749786+0000","last_change":"2023-10-03T10:09:48.368132+0000","last_active":"2023-10-03T10:09:48.749786+0000","last_peered":"2023-10-03T10:09:48.749786+0000","last_clean":"2023-10-03T10:09:48.749786+0000","last_became_active":"2023-10-03T10:09:48.367533+0000","last_became_peered":"2023-10-03T10:09:48.367533+0000","last_unstale":"2023-10-03T10:09:48.749786+0000","last_undegraded":"2023-10-03T10:09:48.749786+0000","last_fullsized":"2023-10-03T10:09:48.749786+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.761124+0000","last_change":"2023-10-03T10:09:48.758955+0000","last_active":"2023-10-03T10:09:48.761124+0000","last_peered":"2023-10-03T10:09:48.761124+0000","last_clean":"2023-10-03T10:09:48.761124+0000","last_became_active":"2023-10-03T10:09:48.758267+0000","last_became_peered":"2023-10-03T10:09:48.758267+0000","last_unstale":"2023-10-03T10:09:48.761124+0000","last_undegraded":"2023-10-03T10:09:48.761124+0000","last_fullsized":"2023-10-03T10:09:48.761124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.769773+0000","last_change":"2023-10-03T10:09:48.375975+0000","last_active":"2023-10-03T10:09:48.769773+0000","last_peered":"2023-10-03T10:09:48.769773+0000","last_clean":"2023-10-03T10:09:48.769773+0000","last_became_active":"2023-10-03T10:09:48.375693+0000","last_became_peered":"2023-10-03T10:09:48.375693+0000","last_unstale":"2023-10-03T10:09:48.769773+0000","last_undegraded":"2023-10-03T10:09:48.769773+0000","last_fullsized":"2023-10-03T10:09:48.769773+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.760912+0000","last_change":"2023-10-03T10:09:48.758192+0000","last_active":"2023-10-03T10:09:48.760912+0000","last_peered":"2023-10-03T10:09:48.760912+0000","last_clean":"2023-10-03T10:09:48.760912+0000","last_became_active":"2023-10-03T10:09:48.757614+0000","last_became_peered":"2023-10-03T10:09:48.757614+0000","last_unstale":"2023-10-03T10:09:48.760912+0000","last_undegraded":"2023-10-03T10:09:48.760912+0000","last_fullsized":"2023-10-03T10:09:48.760912+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765624+0000","last_change":"2023-10-03T10:09:48.370797+0000","last_active":"2023-10-03T10:09:48.765624+0000","last_peered":"2023-10-03T10:09:48.765624+0000","last_clean":"2023-10-03T10:09:48.765624+0000","last_became_active":"2023-10-03T10:09:48.370506+0000","last_became_peered":"2023-10-03T10:09:48.370506+0000","last_unstale":"2023-10-03T10:09:48.765624+0000","last_undegraded":"2023-10-03T10:09:48.765624+0000","last_fullsized":"2023-10-03T10:09:48.765624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.772278+0000","last_change":"2023-10-03T10:09:48.766806+0000","last_active":"2023-10-03T10:09:48.772278+0000","last_peered":"2023-10-03T10:09:48.772278+0000","last_clean":"2023-10-03T10:09:48.772278+0000","last_became_active":"2023-10-03T10:09:48.765599+0000","last_became_peered":"2023-10-03T10:09:48.765599+0000","last_unstale":"2023-10-03T10:09:48.772278+0000","last_undegraded":"2023-10-03T10:09:48.772278+0000","last_fullsized":"2023-10-03T10:09:48.772278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.746041+0000","last_change":"2023-10-03T10:09:48.377631+0000","last_active":"2023-10-03T10:09:48.746041+0000","last_peered":"2023-10-03T10:09:48.746041+0000","last_clean":"2023-10-03T10:09:48.746041+0000","last_became_active":"2023-10-03T10:09:48.377136+0000","last_became_peered":"2023-10-03T10:09:48.377136+0000","last_unstale":"2023-10-03T10:09:48.746041+0000","last_undegraded":"2023-10-03T10:09:48.746041+0000","last_fullsized":"2023-10-03T10:09:48.746041+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.751275+0000","last_change":"2023-10-03T10:09:48.747220+0000","last_active":"2023-10-03T10:09:48.751275+0000","last_peered":"2023-10-03T10:09:48.751275+0000","last_clean":"2023-10-03T10:09:48.751275+0000","last_became_active":"2023-10-03T10:09:48.746293+0000","last_became_peered":"2023-10-03T10:09:48.746293+0000","last_unstale":"2023-10-03T10:09:48.751275+0000","last_undegraded":"2023-10-03T10:09:48.751275+0000","last_fullsized":"2023-10-03T10:09:48.751275+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.761109+0000","last_change":"2023-10-03T10:09:48.743844+0000","last_active":"2023-10-03T10:09:48.761109+0000","last_peered":"2023-10-03T10:09:48.761109+0000","last_clean":"2023-10-03T10:09:48.761109+0000","last_became_active":"2023-10-03T10:09:48.743532+0000","last_became_peered":"2023-10-03T10:09:48.743532+0000","last_unstale":"2023-10-03T10:09:48.761109+0000","last_undegraded":"2023-10-03T10:09:48.761109+0000","last_fullsized":"2023-10-03T10:09:48.761109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.770063+0000","last_change":"2023-10-03T10:09:48.764395+0000","last_active":"2023-10-03T10:09:48.770063+0000","last_peered":"2023-10-03T10:09:48.770063+0000","last_clean":"2023-10-03T10:09:48.770063+0000","last_became_active":"2023-10-03T10:09:48.762670+0000","last_became_peered":"2023-10-03T10:09:48.762670+0000","last_unstale":"2023-10-03T10:09:48.770063+0000","last_undegraded":"2023-10-03T10:09:48.770063+0000","last_fullsized":"2023-10-03T10:09:48.770063+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.769199+0000","last_change":"2023-10-03T10:09:48.757466+0000","last_active":"2023-10-03T10:09:48.769199+0000","last_peered":"2023-10-03T10:09:48.769199+0000","last_clean":"2023-10-03T10:09:48.769199+0000","last_became_active":"2023-10-03T10:09:48.757197+0000","last_became_peered":"2023-10-03T10:09:48.757197+0000","last_unstale":"2023-10-03T10:09:48.769199+0000","last_undegraded":"2023-10-03T10:09:48.769199+0000","last_fullsized":"2023-10-03T10:09:48.769199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.770145+0000","last_change":"2023-10-03T10:09:48.766105+0000","last_active":"2023-10-03T10:09:48.770145+0000","last_peered":"2023-10-03T10:09:48.770145+0000","last_clean":"2023-10-03T10:09:48.770145+0000","last_became_active":"2023-10-03T10:09:48.765834+0000","last_became_peered":"2023-10-03T10:09:48.765834+0000","last_unstale":"2023-10-03T10:09:48.770145+0000","last_undegraded":"2023-10-03T10:09:48.770145+0000","last_fullsized":"2023-10-03T10:09:48.770145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.751117+0000","last_change":"2023-10-03T10:09:48.743916+0000","last_active":"2023-10-03T10:09:48.751117+0000","last_peered":"2023-10-03T10:09:48.751117+0000","last_clean":"2023-10-03T10:09:48.751117+0000","last_became_active":"2023-10-03T10:09:48.743646+0000","last_became_peered":"2023-10-03T10:09:48.743646+0000","last_unstale":"2023-10-03T10:09:48.751117+0000","last_undegraded":"2023-10-03T10:09:48.751117+0000","last_fullsized":"2023-10-03T10:09:48.751117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":46244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":46050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297248,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074592,"statfs":{"total":96636764160,"available":96332382208,"internally_reserved":0,"allocated":155648,"data_stored":45214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":45160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:09:59.640 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:09:59.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.792+0000 7f7a76abf700 1 Processor -- start 2023-10-03T10:09:59.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.792+0000 7f7a76abf700 1 -- start start 2023-10-03T10:09:59.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.793+0000 7f7a76abf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7a70066e30 0x7f7a70067210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.793+0000 7f7a76abf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a70068680 0x7f7a70067700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.793+0000 7f7a76abf700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a70069a10 con 0x7f7a70128a10 2023-10-03T10:09:59.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.793+0000 7f7a76abf700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a70069090 con 0x7f7a70066e30 2023-10-03T10:09:59.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.793+0000 7f7a76abf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a700694e0 con 0x7f7a70068680 2023-10-03T10:09:59.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.793+0000 7f7a7485b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7a70066e30 0x7f7a70067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.793+0000 7f7a6ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a70068680 0x7f7a70067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.793+0000 7f7a7485b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7a70066e30 0x7f7a70067210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47186/0 (socket says 172.21.15.146:47186) 2023-10-03T10:09:59.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.793+0000 7f7a7505c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7a70128a10 0x7f7a70128e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33710/0 (socket says 172.21.15.146:33710) 2023-10-03T10:09:59.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.793+0000 7f7a7485b700 1 -- 172.21.15.146:0/1370331162 learned_addr learned my addr 172.21.15.146:0/1370331162 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:59.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.793+0000 7f7a7485b700 1 -- 172.21.15.146:0/1370331162 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a70068680 msgr2=0x7f7a70067700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:59.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.793+0000 7f7a7485b700 1 --2- 172.21.15.146:0/1370331162 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a70068680 0x7f7a70067700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.793+0000 7f7a7485b700 1 -- 172.21.15.146:0/1370331162 >> v1:172.21.15.146:6789/0 conn(0x7f7a70128a10 legacy=0x7f7a70128e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.793+0000 7f7a6f7fe700 1 -- 172.21.15.146:0/1370331162 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404510367 0 0) 0x7f7a70069a10 con 0x7f7a70128a10 2023-10-03T10:09:59.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.793+0000 7f7a7485b700 1 -- 172.21.15.146:0/1370331162 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a70068b00 con 0x7f7a70066e30 2023-10-03T10:09:59.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.793+0000 7f7a6ffff700 1 --2- 172.21.15.146:0/1370331162 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a70068680 0x7f7a70067700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:59.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.793+0000 7f7a7485b700 1 --2- 172.21.15.146:0/1370331162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a70066e30 0x7f7a70067210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f7a64006fd0 tx=0x7f7a640090f0).ready entity=mon.0 client_cookie=5deb3e99870a0bce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.793+0000 7f7a6f7fe700 1 -- 172.21.15.146:0/1370331162 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6400b580 con 0x7f7a70066e30 2023-10-03T10:09:59.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.793+0000 7f7a6f7fe700 1 -- 172.21.15.146:0/1370331162 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6400b6e0 con 0x7f7a70066e30 2023-10-03T10:09:59.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.793+0000 7f7a6f7fe700 1 -- 172.21.15.146:0/1370331162 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6400ba80 con 0x7f7a70066e30 2023-10-03T10:09:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.794+0000 7f7a76abf700 1 -- 172.21.15.146:0/1370331162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a70066e30 msgr2=0x7f7a70067210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.794+0000 7f7a76abf700 1 --2- 172.21.15.146:0/1370331162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a70066e30 0x7f7a70067210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f7a64006fd0 tx=0x7f7a640090f0).stop 2023-10-03T10:09:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.794+0000 7f7a76abf700 1 -- 172.21.15.146:0/1370331162 shutdown_connections 2023-10-03T10:09:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.794+0000 7f7a76abf700 1 --2- 172.21.15.146:0/1370331162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a70066e30 0x7f7a70067210 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.794+0000 7f7a76abf700 1 --2- 172.21.15.146:0/1370331162 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a70068680 0x7f7a70067700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.794+0000 7f7a76abf700 1 -- 172.21.15.146:0/1370331162 >> 172.21.15.146:0/1370331162 conn(0x7f7a7009a230 msgr2=0x7f7a7009a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.794+0000 7f7a76abf700 1 -- 172.21.15.146:0/1370331162 shutdown_connections 2023-10-03T10:09:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.794+0000 7f7a76abf700 1 -- 172.21.15.146:0/1370331162 wait complete. 2023-10-03T10:09:59.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.795+0000 7f7a76abf700 1 Processor -- start 2023-10-03T10:09:59.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.795+0000 7f7a76abf700 1 -- start start 2023-10-03T10:09:59.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.795+0000 7f7a76abf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a70066e30 0x7f7a70138400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.795+0000 7f7a76abf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a70068680 0x7f7a701388f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.795+0000 7f7a76abf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a70128a10 0x7f7a70113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.795+0000 7f7a76abf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a701161b0 con 0x7f7a70068680 2023-10-03T10:09:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.795+0000 7f7a76abf700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a700691e0 con 0x7f7a70066e30 2023-10-03T10:09:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.795+0000 7f7a76abf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a70117080 con 0x7f7a70128a10 2023-10-03T10:09:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.795+0000 7f7a6ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a70068680 0x7f7a701388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.795+0000 7f7a7485b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a70066e30 0x7f7a70138400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.795+0000 7f7a6ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a70068680 0x7f7a701388f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47194/0 (socket says 172.21.15.146:47194) 2023-10-03T10:09:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.795+0000 7f7a7505c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a70128a10 0x7f7a70113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.795+0000 7f7a6ffff700 1 -- 172.21.15.146:0/2907768204 learned_addr learned my addr 172.21.15.146:0/2907768204 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:09:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.796+0000 7f7a6ffff700 1 -- 172.21.15.146:0/2907768204 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a70128a10 msgr2=0x7f7a70113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.796+0000 7f7a6ffff700 1 --2- 172.21.15.146:0/2907768204 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a70128a10 0x7f7a70113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.796+0000 7f7a6ffff700 1 -- 172.21.15.146:0/2907768204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a70066e30 msgr2=0x7f7a70138400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.796+0000 7f7a6ffff700 1 --2- 172.21.15.146:0/2907768204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a70066e30 0x7f7a70138400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.796+0000 7f7a6ffff700 1 -- 172.21.15.146:0/2907768204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c0092a0 con 0x7f7a70068680 2023-10-03T10:09:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.796+0000 7f7a6ffff700 1 --2- 172.21.15.146:0/2907768204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a70068680 0x7f7a701388f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f7a5c00ea50 tx=0x7f7a5c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.796+0000 7f7a6cff9700 1 -- 172.21.15.146:0/2907768204 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c00c640 con 0x7f7a70068680 2023-10-03T10:09:59.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.796+0000 7f7a6cff9700 1 -- 172.21.15.146:0/2907768204 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5c00c7a0 con 0x7f7a70068680 2023-10-03T10:09:59.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.796+0000 7f7a76abf700 1 -- 172.21.15.146:0/2907768204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a64009370 con 0x7f7a70068680 2023-10-03T10:09:59.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.796+0000 7f7a6cff9700 1 -- 172.21.15.146:0/2907768204 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c00cb20 con 0x7f7a70068680 2023-10-03T10:09:59.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.796+0000 7f7a76abf700 1 -- 172.21.15.146:0/2907768204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a70117ce0 con 0x7f7a70068680 2023-10-03T10:09:59.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.797+0000 7f7a76abf700 1 -- 172.21.15.146:0/2907768204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a70117210 con 0x7f7a70068680 2023-10-03T10:09:59.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.797+0000 7f7a6cff9700 1 -- 172.21.15.146:0/2907768204 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7a5c024430 con 0x7f7a70068680 2023-10-03T10:09:59.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.798+0000 7f7a6cff9700 1 -- 172.21.15.146:0/2907768204 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f7a5c03b420 con 0x7f7a70068680 2023-10-03T10:09:59.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.802+0000 7f7a6cff9700 1 -- 172.21.15.146:0/2907768204 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7a5c0194f0 con 0x7f7a70068680 2023-10-03T10:09:59.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.956+0000 7f7a76abf700 1 -- 172.21.15.146:0/2907768204 --> v1:172.21.15.146:6816/118159 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7a70117670 con 0x7f7a5402bb90 2023-10-03T10:09:59.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.962+0000 7f7a6cff9700 1 -- 172.21.15.146:0/2907768204 <== mgr.4103 v1:172.21.15.146:6816/118159 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249946 (unknown 2965378022 0 4189245014) 0x7f7a70117670 con 0x7f7a5402bb90 2023-10-03T10:09:59.966 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:09:59.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.965+0000 7f7a76abf700 1 -- 172.21.15.146:0/2907768204 >> v1:172.21.15.146:6816/118159 conn(0x7f7a5402bb90 legacy=0x7f7a5402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.965+0000 7f7a76abf700 1 -- 172.21.15.146:0/2907768204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a70068680 msgr2=0x7f7a701388f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.965+0000 7f7a76abf700 1 --2- 172.21.15.146:0/2907768204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a70068680 0x7f7a701388f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f7a5c00ea50 tx=0x7f7a5c009060).stop 2023-10-03T10:09:59.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.965+0000 7f7a76abf700 1 -- 172.21.15.146:0/2907768204 shutdown_connections 2023-10-03T10:09:59.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.965+0000 7f7a76abf700 1 --2- 172.21.15.146:0/2907768204 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a70128a10 0x7f7a70113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.965+0000 7f7a76abf700 1 --2- 172.21.15.146:0/2907768204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a70066e30 0x7f7a70138400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.965+0000 7f7a76abf700 1 --2- 172.21.15.146:0/2907768204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a70068680 0x7f7a701388f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.965+0000 7f7a76abf700 1 -- 172.21.15.146:0/2907768204 >> 172.21.15.146:0/2907768204 conn(0x7f7a7009a230 msgr2=0x7f7a70129aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.965+0000 7f7a76abf700 1 -- 172.21.15.146:0/2907768204 shutdown_connections 2023-10-03T10:09:59.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:09:59.965+0000 7f7a76abf700 1 -- 172.21.15.146:0/2907768204 wait complete. 2023-10-03T10:09:59.969 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-03T10:09:59.978 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-03T10:09:58.290868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188992,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298368,"statfs":{"total":386547056640,"available":385329528832,"internally_reserved":0,"allocated":622592,"data_stored":182668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000906"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.760605+0000","last_change":"2023-10-03T10:09:48.757714+0000","last_active":"2023-10-03T10:09:48.760605+0000","last_peered":"2023-10-03T10:09:48.760605+0000","last_clean":"2023-10-03T10:09:48.760605+0000","last_became_active":"2023-10-03T10:09:48.757453+0000","last_became_peered":"2023-10-03T10:09:48.757453+0000","last_unstale":"2023-10-03T10:09:48.760605+0000","last_undegraded":"2023-10-03T10:09:48.760605+0000","last_fullsized":"2023-10-03T10:09:48.760605+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.747433+0000","last_change":"2023-10-03T10:09:48.741431+0000","last_active":"2023-10-03T10:09:48.747433+0000","last_peered":"2023-10-03T10:09:48.747433+0000","last_clean":"2023-10-03T10:09:48.747433+0000","last_became_active":"2023-10-03T10:09:48.741098+0000","last_became_peered":"2023-10-03T10:09:48.741098+0000","last_unstale":"2023-10-03T10:09:48.747433+0000","last_undegraded":"2023-10-03T10:09:48.747433+0000","last_fullsized":"2023-10-03T10:09:48.747433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750874+0000","last_change":"2023-10-03T10:09:48.743956+0000","last_active":"2023-10-03T10:09:48.750874+0000","last_peered":"2023-10-03T10:09:48.750874+0000","last_clean":"2023-10-03T10:09:48.750874+0000","last_became_active":"2023-10-03T10:09:48.743706+0000","last_became_peered":"2023-10-03T10:09:48.743706+0000","last_unstale":"2023-10-03T10:09:48.750874+0000","last_undegraded":"2023-10-03T10:09:48.750874+0000","last_fullsized":"2023-10-03T10:09:48.750874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750183+0000","last_change":"2023-10-03T10:09:48.744824+0000","last_active":"2023-10-03T10:09:48.750183+0000","last_peered":"2023-10-03T10:09:48.750183+0000","last_clean":"2023-10-03T10:09:48.750183+0000","last_became_active":"2023-10-03T10:09:48.744559+0000","last_became_peered":"2023-10-03T10:09:48.744559+0000","last_unstale":"2023-10-03T10:09:48.750183+0000","last_undegraded":"2023-10-03T10:09:48.750183+0000","last_fullsized":"2023-10-03T10:09:48.750183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.769044+0000","last_change":"2023-10-03T10:09:48.756529+0000","last_active":"2023-10-03T10:09:48.769044+0000","last_peered":"2023-10-03T10:09:48.769044+0000","last_clean":"2023-10-03T10:09:48.769044+0000","last_became_active":"2023-10-03T10:09:48.756233+0000","last_became_peered":"2023-10-03T10:09:48.756233+0000","last_unstale":"2023-10-03T10:09:48.769044+0000","last_undegraded":"2023-10-03T10:09:48.769044+0000","last_fullsized":"2023-10-03T10:09:48.769044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.770152+0000","last_change":"2023-10-03T10:09:48.766120+0000","last_active":"2023-10-03T10:09:48.770152+0000","last_peered":"2023-10-03T10:09:48.770152+0000","last_clean":"2023-10-03T10:09:48.770152+0000","last_became_active":"2023-10-03T10:09:48.765846+0000","last_became_peered":"2023-10-03T10:09:48.765846+0000","last_unstale":"2023-10-03T10:09:48.770152+0000","last_undegraded":"2023-10-03T10:09:48.770152+0000","last_fullsized":"2023-10-03T10:09:48.770152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.768039+0000","last_change":"2023-10-03T10:09:48.762070+0000","last_active":"2023-10-03T10:09:48.768039+0000","last_peered":"2023-10-03T10:09:48.768039+0000","last_clean":"2023-10-03T10:09:48.768039+0000","last_became_active":"2023-10-03T10:09:48.758238+0000","last_became_peered":"2023-10-03T10:09:48.758238+0000","last_unstale":"2023-10-03T10:09:48.768039+0000","last_undegraded":"2023-10-03T10:09:48.768039+0000","last_fullsized":"2023-10-03T10:09:48.768039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.761216+0000","last_change":"2023-10-03T10:09:48.746713+0000","last_active":"2023-10-03T10:09:48.761216+0000","last_peered":"2023-10-03T10:09:48.761216+0000","last_clean":"2023-10-03T10:09:48.761216+0000","last_became_active":"2023-10-03T10:09:48.746426+0000","last_became_peered":"2023-10-03T10:09:48.746426+0000","last_unstale":"2023-10-03T10:09:48.761216+0000","last_undegraded":"2023-10-03T10:09:48.761216+0000","last_fullsized":"2023-10-03T10:09:48.761216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.770029+0000","last_change":"2023-10-03T10:09:48.757336+0000","last_active":"2023-10-03T10:09:48.770029+0000","last_peered":"2023-10-03T10:09:48.770029+0000","last_clean":"2023-10-03T10:09:48.770029+0000","last_became_active":"2023-10-03T10:09:48.757059+0000","last_became_peered":"2023-10-03T10:09:48.757059+0000","last_unstale":"2023-10-03T10:09:48.770029+0000","last_undegraded":"2023-10-03T10:09:48.770029+0000","last_fullsized":"2023-10-03T10:09:48.770029+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.760187+0000","last_change":"2023-10-03T10:09:48.748969+0000","last_active":"2023-10-03T10:09:48.760187+0000","last_peered":"2023-10-03T10:09:48.760187+0000","last_clean":"2023-10-03T10:09:48.760187+0000","last_became_active":"2023-10-03T10:09:48.746842+0000","last_became_peered":"2023-10-03T10:09:48.746842+0000","last_unstale":"2023-10-03T10:09:48.760187+0000","last_undegraded":"2023-10-03T10:09:48.760187+0000","last_fullsized":"2023-10-03T10:09:48.760187+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.758966+0000","last_change":"2023-10-03T10:09:48.745732+0000","last_active":"2023-10-03T10:09:48.758966+0000","last_peered":"2023-10-03T10:09:48.758966+0000","last_clean":"2023-10-03T10:09:48.758966+0000","last_became_active":"2023-10-03T10:09:48.745451+0000","last_became_peered":"2023-10-03T10:09:48.745451+0000","last_unstale":"2023-10-03T10:09:48.758966+0000","last_undegraded":"2023-10-03T10:09:48.758966+0000","last_fullsized":"2023-10-03T10:09:48.758966+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.760556+0000","last_change":"2023-10-03T10:09:48.758809+0000","last_active":"2023-10-03T10:09:48.760556+0000","last_peered":"2023-10-03T10:09:48.760556+0000","last_clean":"2023-10-03T10:09:48.760556+0000","last_became_active":"2023-10-03T10:09:48.758533+0000","last_became_peered":"2023-10-03T10:09:48.758533+0000","last_unstale":"2023-10-03T10:09:48.760556+0000","last_undegraded":"2023-10-03T10:09:48.760556+0000","last_fullsized":"2023-10-03T10:09:48.760556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.761143+0000","last_change":"2023-10-03T10:09:48.759114+0000","last_active":"2023-10-03T10:09:48.761143+0000","last_peered":"2023-10-03T10:09:48.761143+0000","last_clean":"2023-10-03T10:09:48.761143+0000","last_became_active":"2023-10-03T10:09:48.758569+0000","last_became_peered":"2023-10-03T10:09:48.758569+0000","last_unstale":"2023-10-03T10:09:48.761143+0000","last_undegraded":"2023-10-03T10:09:48.761143+0000","last_fullsized":"2023-10-03T10:09:48.761143+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.744574+0000","last_change":"2023-10-03T10:09:48.740857+0000","last_active":"2023-10-03T10:09:48.744574+0000","last_peered":"2023-10-03T10:09:48.744574+0000","last_clean":"2023-10-03T10:09:48.744574+0000","last_became_active":"2023-10-03T10:09:48.740608+0000","last_became_peered":"2023-10-03T10:09:48.740608+0000","last_unstale":"2023-10-03T10:09:48.744574+0000","last_undegraded":"2023-10-03T10:09:48.744574+0000","last_fullsized":"2023-10-03T10:09:48.744574+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.744195+0000","last_change":"2023-10-03T10:09:48.740412+0000","last_active":"2023-10-03T10:09:48.744195+0000","last_peered":"2023-10-03T10:09:48.744195+0000","last_clean":"2023-10-03T10:09:48.744195+0000","last_became_active":"2023-10-03T10:09:48.740146+0000","last_became_peered":"2023-10-03T10:09:48.740146+0000","last_unstale":"2023-10-03T10:09:48.744195+0000","last_undegraded":"2023-10-03T10:09:48.744195+0000","last_fullsized":"2023-10-03T10:09:48.744195+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.768017+0000","last_change":"2023-10-03T10:09:48.758060+0000","last_active":"2023-10-03T10:09:48.768017+0000","last_peered":"2023-10-03T10:09:48.768017+0000","last_clean":"2023-10-03T10:09:48.768017+0000","last_became_active":"2023-10-03T10:09:48.757793+0000","last_became_peered":"2023-10-03T10:09:48.757793+0000","last_unstale":"2023-10-03T10:09:48.768017+0000","last_undegraded":"2023-10-03T10:09:48.768017+0000","last_fullsized":"2023-10-03T10:09:48.768017+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.770015+0000","last_change":"2023-10-03T10:09:48.757180+0000","last_active":"2023-10-03T10:09:48.770015+0000","last_peered":"2023-10-03T10:09:48.770015+0000","last_clean":"2023-10-03T10:09:48.770015+0000","last_became_active":"2023-10-03T10:09:48.756905+0000","last_became_peered":"2023-10-03T10:09:48.756905+0000","last_unstale":"2023-10-03T10:09:48.770015+0000","last_undegraded":"2023-10-03T10:09:48.770015+0000","last_fullsized":"2023-10-03T10:09:48.770015+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750451+0000","last_change":"2023-10-03T10:09:48.745373+0000","last_active":"2023-10-03T10:09:48.750451+0000","last_peered":"2023-10-03T10:09:48.750451+0000","last_clean":"2023-10-03T10:09:48.750451+0000","last_became_active":"2023-10-03T10:09:48.744351+0000","last_became_peered":"2023-10-03T10:09:48.744351+0000","last_unstale":"2023-10-03T10:09:48.750451+0000","last_undegraded":"2023-10-03T10:09:48.750451+0000","last_fullsized":"2023-10-03T10:09:48.750451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.761168+0000","last_change":"2023-10-03T10:09:48.759606+0000","last_active":"2023-10-03T10:09:48.761168+0000","last_peered":"2023-10-03T10:09:48.761168+0000","last_clean":"2023-10-03T10:09:48.761168+0000","last_became_active":"2023-10-03T10:09:48.759343+0000","last_became_peered":"2023-10-03T10:09:48.759343+0000","last_unstale":"2023-10-03T10:09:48.761168+0000","last_undegraded":"2023-10-03T10:09:48.761168+0000","last_fullsized":"2023-10-03T10:09:48.761168+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765193+0000","last_change":"2023-10-03T10:09:48.760055+0000","last_active":"2023-10-03T10:09:48.765193+0000","last_peered":"2023-10-03T10:09:48.765193+0000","last_clean":"2023-10-03T10:09:48.765193+0000","last_became_active":"2023-10-03T10:09:48.759787+0000","last_became_peered":"2023-10-03T10:09:48.759787+0000","last_unstale":"2023-10-03T10:09:48.765193+0000","last_undegraded":"2023-10-03T10:09:48.765193+0000","last_fullsized":"2023-10-03T10:09:48.765193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.763954+0000","last_change":"2023-10-03T10:09:48.753483+0000","last_active":"2023-10-03T10:09:48.763954+0000","last_peered":"2023-10-03T10:09:48.763954+0000","last_clean":"2023-10-03T10:09:48.763954+0000","last_became_active":"2023-10-03T10:09:48.752879+0000","last_became_peered":"2023-10-03T10:09:48.752879+0000","last_unstale":"2023-10-03T10:09:48.763954+0000","last_undegraded":"2023-10-03T10:09:48.763954+0000","last_fullsized":"2023-10-03T10:09:48.763954+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750515+0000","last_change":"2023-10-03T10:09:48.745699+0000","last_active":"2023-10-03T10:09:48.750515+0000","last_peered":"2023-10-03T10:09:48.750515+0000","last_clean":"2023-10-03T10:09:48.750515+0000","last_became_active":"2023-10-03T10:09:48.745433+0000","last_became_peered":"2023-10-03T10:09:48.745433+0000","last_unstale":"2023-10-03T10:09:48.750515+0000","last_undegraded":"2023-10-03T10:09:48.750515+0000","last_fullsized":"2023-10-03T10:09:48.750515+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.769929+0000","last_change":"2023-10-03T10:09:48.764152+0000","last_active":"2023-10-03T10:09:48.769929+0000","last_peered":"2023-10-03T10:09:48.769929+0000","last_clean":"2023-10-03T10:09:48.769929+0000","last_became_active":"2023-10-03T10:09:48.758589+0000","last_became_peered":"2023-10-03T10:09:48.758589+0000","last_unstale":"2023-10-03T10:09:48.769929+0000","last_undegraded":"2023-10-03T10:09:48.769929+0000","last_fullsized":"2023-10-03T10:09:48.769929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765097+0000","last_change":"2023-10-03T10:09:48.760358+0000","last_active":"2023-10-03T10:09:48.765097+0000","last_peered":"2023-10-03T10:09:48.765097+0000","last_clean":"2023-10-03T10:09:48.765097+0000","last_became_active":"2023-10-03T10:09:48.754451+0000","last_became_peered":"2023-10-03T10:09:48.754451+0000","last_unstale":"2023-10-03T10:09:48.765097+0000","last_undegraded":"2023-10-03T10:09:48.765097+0000","last_fullsized":"2023-10-03T10:09:48.765097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765283+0000","last_change":"2023-10-03T10:09:48.763060+0000","last_active":"2023-10-03T10:09:48.765283+0000","last_peered":"2023-10-03T10:09:48.765283+0000","last_clean":"2023-10-03T10:09:48.765283+0000","last_became_active":"2023-10-03T10:09:48.762772+0000","last_became_peered":"2023-10-03T10:09:48.762772+0000","last_unstale":"2023-10-03T10:09:48.765283+0000","last_undegraded":"2023-10-03T10:09:48.765283+0000","last_fullsized":"2023-10-03T10:09:48.765283+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.743835+0000","last_change":"2023-10-03T10:09:48.740694+0000","last_active":"2023-10-03T10:09:48.743835+0000","last_peered":"2023-10-03T10:09:48.743835+0000","last_clean":"2023-10-03T10:09:48.743835+0000","last_became_active":"2023-10-03T10:09:48.740403+0000","last_became_peered":"2023-10-03T10:09:48.740403+0000","last_unstale":"2023-10-03T10:09:48.743835+0000","last_undegraded":"2023-10-03T10:09:48.743835+0000","last_fullsized":"2023-10-03T10:09:48.743835+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.767981+0000","last_change":"2023-10-03T10:09:48.762261+0000","last_active":"2023-10-03T10:09:48.767981+0000","last_peered":"2023-10-03T10:09:48.767981+0000","last_clean":"2023-10-03T10:09:48.767981+0000","last_became_active":"2023-10-03T10:09:48.758917+0000","last_became_peered":"2023-10-03T10:09:48.758917+0000","last_unstale":"2023-10-03T10:09:48.767981+0000","last_undegraded":"2023-10-03T10:09:48.767981+0000","last_fullsized":"2023-10-03T10:09:48.767981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.743194+0000","last_change":"2023-10-03T10:09:48.371325+0000","last_active":"2023-10-03T10:09:48.743194+0000","last_peered":"2023-10-03T10:09:48.743194+0000","last_clean":"2023-10-03T10:09:48.743194+0000","last_became_active":"2023-10-03T10:09:48.371116+0000","last_became_peered":"2023-10-03T10:09:48.371116+0000","last_unstale":"2023-10-03T10:09:48.743194+0000","last_undegraded":"2023-10-03T10:09:48.743194+0000","last_fullsized":"2023-10-03T10:09:48.743194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.770196+0000","last_change":"2023-10-03T10:09:48.766155+0000","last_active":"2023-10-03T10:09:48.770196+0000","last_peered":"2023-10-03T10:09:48.770196+0000","last_clean":"2023-10-03T10:09:48.770196+0000","last_became_active":"2023-10-03T10:09:48.765746+0000","last_became_peered":"2023-10-03T10:09:48.765746+0000","last_unstale":"2023-10-03T10:09:48.770196+0000","last_undegraded":"2023-10-03T10:09:48.770196+0000","last_fullsized":"2023-10-03T10:09:48.770196+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.728334+0000","last_change":"2023-10-03T10:09:48.377430+0000","last_active":"2023-10-03T10:09:48.728334+0000","last_peered":"2023-10-03T10:09:48.728334+0000","last_clean":"2023-10-03T10:09:48.728334+0000","last_became_active":"2023-10-03T10:09:48.376947+0000","last_became_peered":"2023-10-03T10:09:48.376947+0000","last_unstale":"2023-10-03T10:09:48.728334+0000","last_undegraded":"2023-10-03T10:09:48.728334+0000","last_fullsized":"2023-10-03T10:09:48.728334+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750478+0000","last_change":"2023-10-03T10:09:48.745599+0000","last_active":"2023-10-03T10:09:48.750478+0000","last_peered":"2023-10-03T10:09:48.750478+0000","last_clean":"2023-10-03T10:09:48.750478+0000","last_became_active":"2023-10-03T10:09:48.744772+0000","last_became_peered":"2023-10-03T10:09:48.744772+0000","last_unstale":"2023-10-03T10:09:48.750478+0000","last_undegraded":"2023-10-03T10:09:48.750478+0000","last_fullsized":"2023-10-03T10:09:48.750478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.749249+0000","last_change":"2023-10-03T10:09:48.365550+0000","last_active":"2023-10-03T10:09:48.749249+0000","last_peered":"2023-10-03T10:09:48.749249+0000","last_clean":"2023-10-03T10:09:48.749249+0000","last_became_active":"2023-10-03T10:09:48.364969+0000","last_became_peered":"2023-10-03T10:09:48.364969+0000","last_unstale":"2023-10-03T10:09:48.749249+0000","last_undegraded":"2023-10-03T10:09:48.749249+0000","last_fullsized":"2023-10-03T10:09:48.749249+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.772400+0000","last_change":"2023-10-03T10:09:48.768231+0000","last_active":"2023-10-03T10:09:48.772400+0000","last_peered":"2023-10-03T10:09:48.772400+0000","last_clean":"2023-10-03T10:09:48.772400+0000","last_became_active":"2023-10-03T10:09:48.767982+0000","last_became_peered":"2023-10-03T10:09:48.767982+0000","last_unstale":"2023-10-03T10:09:48.772400+0000","last_undegraded":"2023-10-03T10:09:48.772400+0000","last_fullsized":"2023-10-03T10:09:48.772400+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.732659+0000","last_change":"2023-10-03T10:09:48.372222+0000","last_active":"2023-10-03T10:09:48.732659+0000","last_peered":"2023-10-03T10:09:48.732659+0000","last_clean":"2023-10-03T10:09:48.732659+0000","last_became_active":"2023-10-03T10:09:48.371919+0000","last_became_peered":"2023-10-03T10:09:48.371919+0000","last_unstale":"2023-10-03T10:09:48.732659+0000","last_undegraded":"2023-10-03T10:09:48.732659+0000","last_fullsized":"2023-10-03T10:09:48.732659+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.772230+0000","last_change":"2023-10-03T10:09:48.766829+0000","last_active":"2023-10-03T10:09:48.772230+0000","last_peered":"2023-10-03T10:09:48.772230+0000","last_clean":"2023-10-03T10:09:48.772230+0000","last_became_active":"2023-10-03T10:09:48.766356+0000","last_became_peered":"2023-10-03T10:09:48.766356+0000","last_unstale":"2023-10-03T10:09:48.772230+0000","last_undegraded":"2023-10-03T10:09:48.772230+0000","last_fullsized":"2023-10-03T10:09:48.772230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.730240+0000","last_change":"2023-10-03T10:09:48.375954+0000","last_active":"2023-10-03T10:09:48.730240+0000","last_peered":"2023-10-03T10:09:48.730240+0000","last_clean":"2023-10-03T10:09:48.730240+0000","last_became_active":"2023-10-03T10:09:48.375703+0000","last_became_peered":"2023-10-03T10:09:48.375703+0000","last_unstale":"2023-10-03T10:09:48.730240+0000","last_undegraded":"2023-10-03T10:09:48.730240+0000","last_fullsized":"2023-10-03T10:09:48.730240+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.768057+0000","last_change":"2023-10-03T10:09:48.762438+0000","last_active":"2023-10-03T10:09:48.768057+0000","last_peered":"2023-10-03T10:09:48.768057+0000","last_clean":"2023-10-03T10:09:48.768057+0000","last_became_active":"2023-10-03T10:09:48.758825+0000","last_became_peered":"2023-10-03T10:09:48.758825+0000","last_unstale":"2023-10-03T10:09:48.768057+0000","last_undegraded":"2023-10-03T10:09:48.768057+0000","last_fullsized":"2023-10-03T10:09:48.768057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.744267+0000","last_change":"2023-10-03T10:09:48.377186+0000","last_active":"2023-10-03T10:09:48.744267+0000","last_peered":"2023-10-03T10:09:48.744267+0000","last_clean":"2023-10-03T10:09:48.744267+0000","last_became_active":"2023-10-03T10:09:48.376584+0000","last_became_peered":"2023-10-03T10:09:48.376584+0000","last_unstale":"2023-10-03T10:09:48.744267+0000","last_undegraded":"2023-10-03T10:09:48.744267+0000","last_fullsized":"2023-10-03T10:09:48.744267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765361+0000","last_change":"2023-10-03T10:09:48.762792+0000","last_active":"2023-10-03T10:09:48.765361+0000","last_peered":"2023-10-03T10:09:48.765361+0000","last_clean":"2023-10-03T10:09:48.765361+0000","last_became_active":"2023-10-03T10:09:48.762334+0000","last_became_peered":"2023-10-03T10:09:48.762334+0000","last_unstale":"2023-10-03T10:09:48.765361+0000","last_undegraded":"2023-10-03T10:09:48.765361+0000","last_fullsized":"2023-10-03T10:09:48.765361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.774974+0000","last_change":"2023-10-03T10:09:48.370604+0000","last_active":"2023-10-03T10:09:48.774974+0000","last_peered":"2023-10-03T10:09:48.774974+0000","last_clean":"2023-10-03T10:09:48.774974+0000","last_became_active":"2023-10-03T10:09:48.370305+0000","last_became_peered":"2023-10-03T10:09:48.370305+0000","last_unstale":"2023-10-03T10:09:48.774974+0000","last_undegraded":"2023-10-03T10:09:48.774974+0000","last_fullsized":"2023-10-03T10:09:48.774974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.760581+0000","last_change":"2023-10-03T10:09:48.758807+0000","last_active":"2023-10-03T10:09:48.760581+0000","last_peered":"2023-10-03T10:09:48.760581+0000","last_clean":"2023-10-03T10:09:48.760581+0000","last_became_active":"2023-10-03T10:09:48.757966+0000","last_became_peered":"2023-10-03T10:09:48.757966+0000","last_unstale":"2023-10-03T10:09:48.760581+0000","last_undegraded":"2023-10-03T10:09:48.760581+0000","last_fullsized":"2023-10-03T10:09:48.760581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.769478+0000","last_change":"2023-10-03T10:09:48.367621+0000","last_active":"2023-10-03T10:09:48.769478+0000","last_peered":"2023-10-03T10:09:48.769478+0000","last_clean":"2023-10-03T10:09:48.769478+0000","last_became_active":"2023-10-03T10:09:48.367354+0000","last_became_peered":"2023-10-03T10:09:48.367354+0000","last_unstale":"2023-10-03T10:09:48.769478+0000","last_undegraded":"2023-10-03T10:09:48.769478+0000","last_fullsized":"2023-10-03T10:09:48.769478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.768658+0000","last_change":"2023-10-03T10:09:48.763072+0000","last_active":"2023-10-03T10:09:48.768658+0000","last_peered":"2023-10-03T10:09:48.768658+0000","last_clean":"2023-10-03T10:09:48.768658+0000","last_became_active":"2023-10-03T10:09:48.762225+0000","last_became_peered":"2023-10-03T10:09:48.762225+0000","last_unstale":"2023-10-03T10:09:48.768658+0000","last_undegraded":"2023-10-03T10:09:48.768658+0000","last_fullsized":"2023-10-03T10:09:48.768658+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.735600+0000","last_change":"2023-10-03T10:09:48.380634+0000","last_active":"2023-10-03T10:09:48.735600+0000","last_peered":"2023-10-03T10:09:48.735600+0000","last_clean":"2023-10-03T10:09:48.735600+0000","last_became_active":"2023-10-03T10:09:48.380317+0000","last_became_peered":"2023-10-03T10:09:48.380317+0000","last_unstale":"2023-10-03T10:09:48.735600+0000","last_undegraded":"2023-10-03T10:09:48.735600+0000","last_fullsized":"2023-10-03T10:09:48.735600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.774942+0000","last_change":"2023-10-03T10:09:48.769900+0000","last_active":"2023-10-03T10:09:48.774942+0000","last_peered":"2023-10-03T10:09:48.774942+0000","last_clean":"2023-10-03T10:09:48.774942+0000","last_became_active":"2023-10-03T10:09:48.769431+0000","last_became_peered":"2023-10-03T10:09:48.769431+0000","last_unstale":"2023-10-03T10:09:48.774942+0000","last_undegraded":"2023-10-03T10:09:48.774942+0000","last_fullsized":"2023-10-03T10:09:48.774942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.751633+0000","last_change":"2023-10-03T10:09:48.374660+0000","last_active":"2023-10-03T10:09:48.751633+0000","last_peered":"2023-10-03T10:09:48.751633+0000","last_clean":"2023-10-03T10:09:48.751633+0000","last_became_active":"2023-10-03T10:09:48.371590+0000","last_became_peered":"2023-10-03T10:09:48.371590+0000","last_unstale":"2023-10-03T10:09:48.751633+0000","last_undegraded":"2023-10-03T10:09:48.751633+0000","last_fullsized":"2023-10-03T10:09:48.751633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.769272+0000","last_change":"2023-10-03T10:09:48.758669+0000","last_active":"2023-10-03T10:09:48.769272+0000","last_peered":"2023-10-03T10:09:48.769272+0000","last_clean":"2023-10-03T10:09:48.769272+0000","last_became_active":"2023-10-03T10:09:48.758412+0000","last_became_peered":"2023-10-03T10:09:48.758412+0000","last_unstale":"2023-10-03T10:09:48.769272+0000","last_undegraded":"2023-10-03T10:09:48.769272+0000","last_fullsized":"2023-10-03T10:09:48.769272+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.761164+0000","last_change":"2023-10-03T10:09:48.369149+0000","last_active":"2023-10-03T10:09:48.761164+0000","last_peered":"2023-10-03T10:09:48.761164+0000","last_clean":"2023-10-03T10:09:48.761164+0000","last_became_active":"2023-10-03T10:09:48.368855+0000","last_became_peered":"2023-10-03T10:09:48.368855+0000","last_unstale":"2023-10-03T10:09:48.761164+0000","last_undegraded":"2023-10-03T10:09:48.761164+0000","last_fullsized":"2023-10-03T10:09:48.761164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.772373+0000","last_change":"2023-10-03T10:09:48.767773+0000","last_active":"2023-10-03T10:09:48.772373+0000","last_peered":"2023-10-03T10:09:48.772373+0000","last_clean":"2023-10-03T10:09:48.772373+0000","last_became_active":"2023-10-03T10:09:48.767519+0000","last_became_peered":"2023-10-03T10:09:48.767519+0000","last_unstale":"2023-10-03T10:09:48.772373+0000","last_undegraded":"2023-10-03T10:09:48.772373+0000","last_fullsized":"2023-10-03T10:09:48.772373+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.746162+0000","last_change":"2023-10-03T10:09:48.377423+0000","last_active":"2023-10-03T10:09:48.746162+0000","last_peered":"2023-10-03T10:09:48.746162+0000","last_clean":"2023-10-03T10:09:48.746162+0000","last_became_active":"2023-10-03T10:09:48.376337+0000","last_became_peered":"2023-10-03T10:09:48.376337+0000","last_unstale":"2023-10-03T10:09:48.746162+0000","last_undegraded":"2023-10-03T10:09:48.746162+0000","last_fullsized":"2023-10-03T10:09:48.746162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.772277+0000","last_change":"2023-10-03T10:09:48.767141+0000","last_active":"2023-10-03T10:09:48.772277+0000","last_peered":"2023-10-03T10:09:48.772277+0000","last_clean":"2023-10-03T10:09:48.772277+0000","last_became_active":"2023-10-03T10:09:48.766563+0000","last_became_peered":"2023-10-03T10:09:48.766563+0000","last_unstale":"2023-10-03T10:09:48.772277+0000","last_undegraded":"2023-10-03T10:09:48.772277+0000","last_fullsized":"2023-10-03T10:09:48.772277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.745126+0000","last_change":"2023-10-03T10:09:48.370781+0000","last_active":"2023-10-03T10:09:48.745126+0000","last_peered":"2023-10-03T10:09:48.745126+0000","last_clean":"2023-10-03T10:09:48.745126+0000","last_became_active":"2023-10-03T10:09:48.370500+0000","last_became_peered":"2023-10-03T10:09:48.370500+0000","last_unstale":"2023-10-03T10:09:48.745126+0000","last_undegraded":"2023-10-03T10:09:48.745126+0000","last_fullsized":"2023-10-03T10:09:48.745126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765032+0000","last_change":"2023-10-03T10:09:48.762174+0000","last_active":"2023-10-03T10:09:48.765032+0000","last_peered":"2023-10-03T10:09:48.765032+0000","last_clean":"2023-10-03T10:09:48.765032+0000","last_became_active":"2023-10-03T10:09:48.761912+0000","last_became_peered":"2023-10-03T10:09:48.761912+0000","last_unstale":"2023-10-03T10:09:48.765032+0000","last_undegraded":"2023-10-03T10:09:48.765032+0000","last_fullsized":"2023-10-03T10:09:48.765032+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765774+0000","last_change":"2023-10-03T10:09:48.375317+0000","last_active":"2023-10-03T10:09:48.765774+0000","last_peered":"2023-10-03T10:09:48.765774+0000","last_clean":"2023-10-03T10:09:48.765774+0000","last_became_active":"2023-10-03T10:09:48.375033+0000","last_became_peered":"2023-10-03T10:09:48.375033+0000","last_unstale":"2023-10-03T10:09:48.765774+0000","last_undegraded":"2023-10-03T10:09:48.765774+0000","last_fullsized":"2023-10-03T10:09:48.765774+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.760927+0000","last_change":"2023-10-03T10:09:48.758357+0000","last_active":"2023-10-03T10:09:48.760927+0000","last_peered":"2023-10-03T10:09:48.760927+0000","last_clean":"2023-10-03T10:09:48.760927+0000","last_became_active":"2023-10-03T10:09:48.757940+0000","last_became_peered":"2023-10-03T10:09:48.757940+0000","last_unstale":"2023-10-03T10:09:48.760927+0000","last_undegraded":"2023-10-03T10:09:48.760927+0000","last_fullsized":"2023-10-03T10:09:48.760927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.734316+0000","last_change":"2023-10-03T10:09:48.376891+0000","last_active":"2023-10-03T10:09:48.734316+0000","last_peered":"2023-10-03T10:09:48.734316+0000","last_clean":"2023-10-03T10:09:48.734316+0000","last_became_active":"2023-10-03T10:09:48.376350+0000","last_became_peered":"2023-10-03T10:09:48.376350+0000","last_unstale":"2023-10-03T10:09:48.734316+0000","last_undegraded":"2023-10-03T10:09:48.734316+0000","last_fullsized":"2023-10-03T10:09:48.734316+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750404+0000","last_change":"2023-10-03T10:09:48.745699+0000","last_active":"2023-10-03T10:09:48.750404+0000","last_peered":"2023-10-03T10:09:48.750404+0000","last_clean":"2023-10-03T10:09:48.750404+0000","last_became_active":"2023-10-03T10:09:48.745452+0000","last_became_peered":"2023-10-03T10:09:48.745452+0000","last_unstale":"2023-10-03T10:09:48.750404+0000","last_undegraded":"2023-10-03T10:09:48.750404+0000","last_fullsized":"2023-10-03T10:09:48.750404+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.764288+0000","last_change":"2023-10-03T10:09:48.376011+0000","last_active":"2023-10-03T10:09:48.764288+0000","last_peered":"2023-10-03T10:09:48.764288+0000","last_clean":"2023-10-03T10:09:48.764288+0000","last_became_active":"2023-10-03T10:09:48.375731+0000","last_became_peered":"2023-10-03T10:09:48.375731+0000","last_unstale":"2023-10-03T10:09:48.764288+0000","last_undegraded":"2023-10-03T10:09:48.764288+0000","last_fullsized":"2023-10-03T10:09:48.764288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.764030+0000","last_change":"2023-10-03T10:09:48.755197+0000","last_active":"2023-10-03T10:09:48.764030+0000","last_peered":"2023-10-03T10:09:48.764030+0000","last_clean":"2023-10-03T10:09:48.764030+0000","last_became_active":"2023-10-03T10:09:48.754954+0000","last_became_peered":"2023-10-03T10:09:48.754954+0000","last_unstale":"2023-10-03T10:09:48.764030+0000","last_undegraded":"2023-10-03T10:09:48.764030+0000","last_fullsized":"2023-10-03T10:09:48.764030+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.752673+0000","last_change":"2023-10-03T10:09:48.371687+0000","last_active":"2023-10-03T10:09:48.752673+0000","last_peered":"2023-10-03T10:09:48.752673+0000","last_clean":"2023-10-03T10:09:48.752673+0000","last_became_active":"2023-10-03T10:09:48.371207+0000","last_became_peered":"2023-10-03T10:09:48.371207+0000","last_unstale":"2023-10-03T10:09:48.752673+0000","last_undegraded":"2023-10-03T10:09:48.752673+0000","last_fullsized":"2023-10-03T10:09:48.752673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.770216+0000","last_change":"2023-10-03T10:09:48.766338+0000","last_active":"2023-10-03T10:09:48.770216+0000","last_peered":"2023-10-03T10:09:48.770216+0000","last_clean":"2023-10-03T10:09:48.770216+0000","last_became_active":"2023-10-03T10:09:48.765944+0000","last_became_peered":"2023-10-03T10:09:48.765944+0000","last_unstale":"2023-10-03T10:09:48.770216+0000","last_undegraded":"2023-10-03T10:09:48.770216+0000","last_fullsized":"2023-10-03T10:09:48.770216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.751181+0000","last_change":"2023-10-03T10:09:48.374804+0000","last_active":"2023-10-03T10:09:48.751181+0000","last_peered":"2023-10-03T10:09:48.751181+0000","last_clean":"2023-10-03T10:09:48.751181+0000","last_became_active":"2023-10-03T10:09:48.374469+0000","last_became_peered":"2023-10-03T10:09:48.374469+0000","last_unstale":"2023-10-03T10:09:48.751181+0000","last_undegraded":"2023-10-03T10:09:48.751181+0000","last_fullsized":"2023-10-03T10:09:48.751181+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.761534+0000","last_change":"2023-10-03T10:09:48.759354+0000","last_active":"2023-10-03T10:09:48.761534+0000","last_peered":"2023-10-03T10:09:48.761534+0000","last_clean":"2023-10-03T10:09:48.761534+0000","last_became_active":"2023-10-03T10:09:48.759106+0000","last_became_peered":"2023-10-03T10:09:48.759106+0000","last_unstale":"2023-10-03T10:09:48.761534+0000","last_undegraded":"2023-10-03T10:09:48.761534+0000","last_fullsized":"2023-10-03T10:09:48.761534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.748782+0000","last_change":"2023-10-03T10:09:48.379214+0000","last_active":"2023-10-03T10:09:48.748782+0000","last_peered":"2023-10-03T10:09:48.748782+0000","last_clean":"2023-10-03T10:09:48.748782+0000","last_became_active":"2023-10-03T10:09:48.378808+0000","last_became_peered":"2023-10-03T10:09:48.378808+0000","last_unstale":"2023-10-03T10:09:48.748782+0000","last_undegraded":"2023-10-03T10:09:48.748782+0000","last_fullsized":"2023-10-03T10:09:48.748782+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765242+0000","last_change":"2023-10-03T10:09:48.762823+0000","last_active":"2023-10-03T10:09:48.765242+0000","last_peered":"2023-10-03T10:09:48.765242+0000","last_clean":"2023-10-03T10:09:48.765242+0000","last_became_active":"2023-10-03T10:09:48.762544+0000","last_became_peered":"2023-10-03T10:09:48.762544+0000","last_unstale":"2023-10-03T10:09:48.765242+0000","last_undegraded":"2023-10-03T10:09:48.765242+0000","last_fullsized":"2023-10-03T10:09:48.765242+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.728742+0000","last_change":"2023-10-03T10:09:44.335057+0000","last_active":"2023-10-03T10:09:48.728742+0000","last_peered":"2023-10-03T10:09:48.728742+0000","last_clean":"2023-10-03T10:09:48.728742+0000","last_became_active":"2023-10-03T10:09:44.334848+0000","last_became_peered":"2023-10-03T10:09:44.334848+0000","last_unstale":"2023-10-03T10:09:48.728742+0000","last_undegraded":"2023-10-03T10:09:48.728742+0000","last_fullsized":"2023-10-03T10:09:48.728742+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.730142+0000","last_change":"2023-10-03T10:09:48.379615+0000","last_active":"2023-10-03T10:09:48.730142+0000","last_peered":"2023-10-03T10:09:48.730142+0000","last_clean":"2023-10-03T10:09:48.730142+0000","last_became_active":"2023-10-03T10:09:48.379353+0000","last_became_peered":"2023-10-03T10:09:48.379353+0000","last_unstale":"2023-10-03T10:09:48.730142+0000","last_undegraded":"2023-10-03T10:09:48.730142+0000","last_fullsized":"2023-10-03T10:09:48.730142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765341+0000","last_change":"2023-10-03T10:09:48.762628+0000","last_active":"2023-10-03T10:09:48.765341+0000","last_peered":"2023-10-03T10:09:48.765341+0000","last_clean":"2023-10-03T10:09:48.765341+0000","last_became_active":"2023-10-03T10:09:48.762007+0000","last_became_peered":"2023-10-03T10:09:48.762007+0000","last_unstale":"2023-10-03T10:09:48.765341+0000","last_undegraded":"2023-10-03T10:09:48.765341+0000","last_fullsized":"2023-10-03T10:09:48.765341+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.752509+0000","last_change":"2023-10-03T10:09:44.331820+0000","last_active":"2023-10-03T10:09:48.752509+0000","last_peered":"2023-10-03T10:09:48.752509+0000","last_clean":"2023-10-03T10:09:48.752509+0000","last_became_active":"2023-10-03T10:09:44.331226+0000","last_became_peered":"2023-10-03T10:09:44.331226+0000","last_unstale":"2023-10-03T10:09:48.752509+0000","last_undegraded":"2023-10-03T10:09:48.752509+0000","last_fullsized":"2023-10-03T10:09:48.752509+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.736338+0000","last_change":"2023-10-03T10:09:48.373278+0000","last_active":"2023-10-03T10:09:48.736338+0000","last_peered":"2023-10-03T10:09:48.736338+0000","last_clean":"2023-10-03T10:09:48.736338+0000","last_became_active":"2023-10-03T10:09:48.372993+0000","last_became_peered":"2023-10-03T10:09:48.372993+0000","last_unstale":"2023-10-03T10:09:48.736338+0000","last_undegraded":"2023-10-03T10:09:48.736338+0000","last_fullsized":"2023-10-03T10:09:48.736338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.749679+0000","last_change":"2023-10-03T10:09:48.742549+0000","last_active":"2023-10-03T10:09:48.749679+0000","last_peered":"2023-10-03T10:09:48.749679+0000","last_clean":"2023-10-03T10:09:48.749679+0000","last_became_active":"2023-10-03T10:09:48.740207+0000","last_became_peered":"2023-10-03T10:09:48.740207+0000","last_unstale":"2023-10-03T10:09:48.749679+0000","last_undegraded":"2023-10-03T10:09:48.749679+0000","last_fullsized":"2023-10-03T10:09:48.749679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.730019+0000","last_change":"2023-10-03T10:09:44.331573+0000","last_active":"2023-10-03T10:09:48.730019+0000","last_peered":"2023-10-03T10:09:48.730019+0000","last_clean":"2023-10-03T10:09:48.730019+0000","last_became_active":"2023-10-03T10:09:44.331265+0000","last_became_peered":"2023-10-03T10:09:44.331265+0000","last_unstale":"2023-10-03T10:09:48.730019+0000","last_undegraded":"2023-10-03T10:09:48.730019+0000","last_fullsized":"2023-10-03T10:09:48.730019+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.733325+0000","last_change":"2023-10-03T10:09:48.372153+0000","last_active":"2023-10-03T10:09:48.733325+0000","last_peered":"2023-10-03T10:09:48.733325+0000","last_clean":"2023-10-03T10:09:48.733325+0000","last_became_active":"2023-10-03T10:09:48.371868+0000","last_became_peered":"2023-10-03T10:09:48.371868+0000","last_unstale":"2023-10-03T10:09:48.733325+0000","last_undegraded":"2023-10-03T10:09:48.733325+0000","last_fullsized":"2023-10-03T10:09:48.733325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.758919+0000","last_change":"2023-10-03T10:09:48.745855+0000","last_active":"2023-10-03T10:09:48.758919+0000","last_peered":"2023-10-03T10:09:48.758919+0000","last_clean":"2023-10-03T10:09:48.758919+0000","last_became_active":"2023-10-03T10:09:48.745606+0000","last_became_peered":"2023-10-03T10:09:48.745606+0000","last_unstale":"2023-10-03T10:09:48.758919+0000","last_undegraded":"2023-10-03T10:09:48.758919+0000","last_fullsized":"2023-10-03T10:09:48.758919+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.752337+0000","last_change":"2023-10-03T10:09:44.331400+0000","last_active":"2023-10-03T10:09:48.752337+0000","last_peered":"2023-10-03T10:09:48.752337+0000","last_clean":"2023-10-03T10:09:48.752337+0000","last_became_active":"2023-10-03T10:09:44.331097+0000","last_became_peered":"2023-10-03T10:09:44.331097+0000","last_unstale":"2023-10-03T10:09:48.752337+0000","last_undegraded":"2023-10-03T10:09:48.752337+0000","last_fullsized":"2023-10-03T10:09:48.752337+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.733220+0000","last_change":"2023-10-03T10:09:44.334568+0000","last_active":"2023-10-03T10:09:48.733220+0000","last_peered":"2023-10-03T10:09:48.733220+0000","last_clean":"2023-10-03T10:09:48.733220+0000","last_became_active":"2023-10-03T10:09:44.333878+0000","last_became_peered":"2023-10-03T10:09:44.333878+0000","last_unstale":"2023-10-03T10:09:48.733220+0000","last_undegraded":"2023-10-03T10:09:48.733220+0000","last_fullsized":"2023-10-03T10:09:48.733220+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.752342+0000","last_change":"2023-10-03T10:09:48.371394+0000","last_active":"2023-10-03T10:09:48.752342+0000","last_peered":"2023-10-03T10:09:48.752342+0000","last_clean":"2023-10-03T10:09:48.752342+0000","last_became_active":"2023-10-03T10:09:48.371089+0000","last_became_peered":"2023-10-03T10:09:48.371089+0000","last_unstale":"2023-10-03T10:09:48.752342+0000","last_undegraded":"2023-10-03T10:09:48.752342+0000","last_fullsized":"2023-10-03T10:09:48.752342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.772251+0000","last_change":"2023-10-03T10:09:48.766928+0000","last_active":"2023-10-03T10:09:48.772251+0000","last_peered":"2023-10-03T10:09:48.772251+0000","last_clean":"2023-10-03T10:09:48.772251+0000","last_became_active":"2023-10-03T10:09:48.766090+0000","last_became_peered":"2023-10-03T10:09:48.766090+0000","last_unstale":"2023-10-03T10:09:48.772251+0000","last_undegraded":"2023-10-03T10:09:48.772251+0000","last_fullsized":"2023-10-03T10:09:48.772251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.749182+0000","last_change":"2023-10-03T10:09:44.333732+0000","last_active":"2023-10-03T10:09:48.749182+0000","last_peered":"2023-10-03T10:09:48.749182+0000","last_clean":"2023-10-03T10:09:48.749182+0000","last_became_active":"2023-10-03T10:09:44.333408+0000","last_became_peered":"2023-10-03T10:09:44.333408+0000","last_unstale":"2023-10-03T10:09:48.749182+0000","last_undegraded":"2023-10-03T10:09:48.749182+0000","last_fullsized":"2023-10-03T10:09:48.749182+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.732685+0000","last_change":"2023-10-03T10:09:48.369173+0000","last_active":"2023-10-03T10:09:48.732685+0000","last_peered":"2023-10-03T10:09:48.732685+0000","last_clean":"2023-10-03T10:09:48.732685+0000","last_became_active":"2023-10-03T10:09:48.368843+0000","last_became_peered":"2023-10-03T10:09:48.368843+0000","last_unstale":"2023-10-03T10:09:48.732685+0000","last_undegraded":"2023-10-03T10:09:48.732685+0000","last_fullsized":"2023-10-03T10:09:48.732685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750496+0000","last_change":"2023-10-03T10:09:48.747157+0000","last_active":"2023-10-03T10:09:48.750496+0000","last_peered":"2023-10-03T10:09:48.750496+0000","last_clean":"2023-10-03T10:09:48.750496+0000","last_became_active":"2023-10-03T10:09:48.745029+0000","last_became_peered":"2023-10-03T10:09:48.745029+0000","last_unstale":"2023-10-03T10:09:48.750496+0000","last_undegraded":"2023-10-03T10:09:48.750496+0000","last_fullsized":"2023-10-03T10:09:48.750496+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.753191+0000","last_change":"2023-10-03T10:09:44.329886+0000","last_active":"2023-10-03T10:09:48.753191+0000","last_peered":"2023-10-03T10:09:48.753191+0000","last_clean":"2023-10-03T10:09:48.753191+0000","last_became_active":"2023-10-03T10:09:44.329607+0000","last_became_peered":"2023-10-03T10:09:44.329607+0000","last_unstale":"2023-10-03T10:09:48.753191+0000","last_undegraded":"2023-10-03T10:09:48.753191+0000","last_fullsized":"2023-10-03T10:09:48.753191+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.728946+0000","last_change":"2023-10-03T10:09:48.371183+0000","last_active":"2023-10-03T10:09:48.728946+0000","last_peered":"2023-10-03T10:09:48.728946+0000","last_clean":"2023-10-03T10:09:48.728946+0000","last_became_active":"2023-10-03T10:09:48.370930+0000","last_became_peered":"2023-10-03T10:09:48.370930+0000","last_unstale":"2023-10-03T10:09:48.728946+0000","last_undegraded":"2023-10-03T10:09:48.728946+0000","last_fullsized":"2023-10-03T10:09:48.728946+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.748550+0000","last_change":"2023-10-03T10:09:48.743221+0000","last_active":"2023-10-03T10:09:48.748550+0000","last_peered":"2023-10-03T10:09:48.748550+0000","last_clean":"2023-10-03T10:09:48.748550+0000","last_became_active":"2023-10-03T10:09:48.742967+0000","last_became_peered":"2023-10-03T10:09:48.742967+0000","last_unstale":"2023-10-03T10:09:48.748550+0000","last_undegraded":"2023-10-03T10:09:48.748550+0000","last_fullsized":"2023-10-03T10:09:48.748550+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.769845+0000","last_change":"2023-10-03T10:09:48.371421+0000","last_active":"2023-10-03T10:09:48.769845+0000","last_peered":"2023-10-03T10:09:48.769845+0000","last_clean":"2023-10-03T10:09:48.769845+0000","last_became_active":"2023-10-03T10:09:48.371121+0000","last_became_peered":"2023-10-03T10:09:48.371121+0000","last_unstale":"2023-10-03T10:09:48.769845+0000","last_undegraded":"2023-10-03T10:09:48.769845+0000","last_fullsized":"2023-10-03T10:09:48.769845+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.730242+0000","last_change":"2023-10-03T10:09:44.334348+0000","last_active":"2023-10-03T10:09:48.730242+0000","last_peered":"2023-10-03T10:09:48.730242+0000","last_clean":"2023-10-03T10:09:48.730242+0000","last_became_active":"2023-10-03T10:09:44.333893+0000","last_became_peered":"2023-10-03T10:09:44.333893+0000","last_unstale":"2023-10-03T10:09:48.730242+0000","last_undegraded":"2023-10-03T10:09:48.730242+0000","last_fullsized":"2023-10-03T10:09:48.730242+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.772207+0000","last_change":"2023-10-03T10:09:48.766676+0000","last_active":"2023-10-03T10:09:48.772207+0000","last_peered":"2023-10-03T10:09:48.772207+0000","last_clean":"2023-10-03T10:09:48.772207+0000","last_became_active":"2023-10-03T10:09:48.766218+0000","last_became_peered":"2023-10-03T10:09:48.766218+0000","last_unstale":"2023-10-03T10:09:48.772207+0000","last_undegraded":"2023-10-03T10:09:48.772207+0000","last_fullsized":"2023-10-03T10:09:48.772207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.755224+0000","last_change":"2023-10-03T10:09:44.333678+0000","last_active":"2023-10-03T10:09:48.755224+0000","last_peered":"2023-10-03T10:09:48.755224+0000","last_clean":"2023-10-03T10:09:48.755224+0000","last_became_active":"2023-10-03T10:09:44.333326+0000","last_became_peered":"2023-10-03T10:09:44.333326+0000","last_unstale":"2023-10-03T10:09:48.755224+0000","last_undegraded":"2023-10-03T10:09:48.755224+0000","last_fullsized":"2023-10-03T10:09:48.755224+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:49.729578+0000","last_change":"2023-10-03T10:09:48.380501+0000","last_active":"2023-10-03T10:09:49.729578+0000","last_peered":"2023-10-03T10:09:49.729578+0000","last_clean":"2023-10-03T10:09:49.729578+0000","last_became_active":"2023-10-03T10:09:48.380205+0000","last_became_peered":"2023-10-03T10:09:48.380205+0000","last_unstale":"2023-10-03T10:09:49.729578+0000","last_undegraded":"2023-10-03T10:09:49.729578+0000","last_fullsized":"2023-10-03T10:09:49.729578+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.763696+0000","last_change":"2023-10-03T10:09:48.760491+0000","last_active":"2023-10-03T10:09:48.763696+0000","last_peered":"2023-10-03T10:09:48.763696+0000","last_clean":"2023-10-03T10:09:48.763696+0000","last_became_active":"2023-10-03T10:09:48.760201+0000","last_became_peered":"2023-10-03T10:09:48.760201+0000","last_unstale":"2023-10-03T10:09:48.763696+0000","last_undegraded":"2023-10-03T10:09:48.763696+0000","last_fullsized":"2023-10-03T10:09:48.763696+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.750298+0000","last_change":"2023-10-03T10:09:48.381420+0000","last_active":"2023-10-03T10:09:48.750298+0000","last_peered":"2023-10-03T10:09:48.750298+0000","last_clean":"2023-10-03T10:09:48.750298+0000","last_became_active":"2023-10-03T10:09:48.380776+0000","last_became_peered":"2023-10-03T10:09:48.380776+0000","last_unstale":"2023-10-03T10:09:48.750298+0000","last_undegraded":"2023-10-03T10:09:48.750298+0000","last_fullsized":"2023-10-03T10:09:48.750298+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.751210+0000","last_change":"2023-10-03T10:09:48.747044+0000","last_active":"2023-10-03T10:09:48.751210+0000","last_peered":"2023-10-03T10:09:48.751210+0000","last_clean":"2023-10-03T10:09:48.751210+0000","last_became_active":"2023-10-03T10:09:48.746598+0000","last_became_peered":"2023-10-03T10:09:48.746598+0000","last_unstale":"2023-10-03T10:09:48.751210+0000","last_undegraded":"2023-10-03T10:09:48.751210+0000","last_fullsized":"2023-10-03T10:09:48.751210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.749786+0000","last_change":"2023-10-03T10:09:48.368132+0000","last_active":"2023-10-03T10:09:48.749786+0000","last_peered":"2023-10-03T10:09:48.749786+0000","last_clean":"2023-10-03T10:09:48.749786+0000","last_became_active":"2023-10-03T10:09:48.367533+0000","last_became_peered":"2023-10-03T10:09:48.367533+0000","last_unstale":"2023-10-03T10:09:48.749786+0000","last_undegraded":"2023-10-03T10:09:48.749786+0000","last_fullsized":"2023-10-03T10:09:48.749786+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.761124+0000","last_change":"2023-10-03T10:09:48.758955+0000","last_active":"2023-10-03T10:09:48.761124+0000","last_peered":"2023-10-03T10:09:48.761124+0000","last_clean":"2023-10-03T10:09:48.761124+0000","last_became_active":"2023-10-03T10:09:48.758267+0000","last_became_peered":"2023-10-03T10:09:48.758267+0000","last_unstale":"2023-10-03T10:09:48.761124+0000","last_undegraded":"2023-10-03T10:09:48.761124+0000","last_fullsized":"2023-10-03T10:09:48.761124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.769773+0000","last_change":"2023-10-03T10:09:48.375975+0000","last_active":"2023-10-03T10:09:48.769773+0000","last_peered":"2023-10-03T10:09:48.769773+0000","last_clean":"2023-10-03T10:09:48.769773+0000","last_became_active":"2023-10-03T10:09:48.375693+0000","last_became_peered":"2023-10-03T10:09:48.375693+0000","last_unstale":"2023-10-03T10:09:48.769773+0000","last_undegraded":"2023-10-03T10:09:48.769773+0000","last_fullsized":"2023-10-03T10:09:48.769773+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.760912+0000","last_change":"2023-10-03T10:09:48.758192+0000","last_active":"2023-10-03T10:09:48.760912+0000","last_peered":"2023-10-03T10:09:48.760912+0000","last_clean":"2023-10-03T10:09:48.760912+0000","last_became_active":"2023-10-03T10:09:48.757614+0000","last_became_peered":"2023-10-03T10:09:48.757614+0000","last_unstale":"2023-10-03T10:09:48.760912+0000","last_undegraded":"2023-10-03T10:09:48.760912+0000","last_fullsized":"2023-10-03T10:09:48.760912+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.765624+0000","last_change":"2023-10-03T10:09:48.370797+0000","last_active":"2023-10-03T10:09:48.765624+0000","last_peered":"2023-10-03T10:09:48.765624+0000","last_clean":"2023-10-03T10:09:48.765624+0000","last_became_active":"2023-10-03T10:09:48.370506+0000","last_became_peered":"2023-10-03T10:09:48.370506+0000","last_unstale":"2023-10-03T10:09:48.765624+0000","last_undegraded":"2023-10-03T10:09:48.765624+0000","last_fullsized":"2023-10-03T10:09:48.765624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.772278+0000","last_change":"2023-10-03T10:09:48.766806+0000","last_active":"2023-10-03T10:09:48.772278+0000","last_peered":"2023-10-03T10:09:48.772278+0000","last_clean":"2023-10-03T10:09:48.772278+0000","last_became_active":"2023-10-03T10:09:48.765599+0000","last_became_peered":"2023-10-03T10:09:48.765599+0000","last_unstale":"2023-10-03T10:09:48.772278+0000","last_undegraded":"2023-10-03T10:09:48.772278+0000","last_fullsized":"2023-10-03T10:09:48.772278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.746041+0000","last_change":"2023-10-03T10:09:48.377631+0000","last_active":"2023-10-03T10:09:48.746041+0000","last_peered":"2023-10-03T10:09:48.746041+0000","last_clean":"2023-10-03T10:09:48.746041+0000","last_became_active":"2023-10-03T10:09:48.377136+0000","last_became_peered":"2023-10-03T10:09:48.377136+0000","last_unstale":"2023-10-03T10:09:48.746041+0000","last_undegraded":"2023-10-03T10:09:48.746041+0000","last_fullsized":"2023-10-03T10:09:48.746041+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.751275+0000","last_change":"2023-10-03T10:09:48.747220+0000","last_active":"2023-10-03T10:09:48.751275+0000","last_peered":"2023-10-03T10:09:48.751275+0000","last_clean":"2023-10-03T10:09:48.751275+0000","last_became_active":"2023-10-03T10:09:48.746293+0000","last_became_peered":"2023-10-03T10:09:48.746293+0000","last_unstale":"2023-10-03T10:09:48.751275+0000","last_undegraded":"2023-10-03T10:09:48.751275+0000","last_fullsized":"2023-10-03T10:09:48.751275+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.761109+0000","last_change":"2023-10-03T10:09:48.743844+0000","last_active":"2023-10-03T10:09:48.761109+0000","last_peered":"2023-10-03T10:09:48.761109+0000","last_clean":"2023-10-03T10:09:48.761109+0000","last_became_active":"2023-10-03T10:09:48.743532+0000","last_became_peered":"2023-10-03T10:09:48.743532+0000","last_unstale":"2023-10-03T10:09:48.761109+0000","last_undegraded":"2023-10-03T10:09:48.761109+0000","last_fullsized":"2023-10-03T10:09:48.761109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.770063+0000","last_change":"2023-10-03T10:09:48.764395+0000","last_active":"2023-10-03T10:09:48.770063+0000","last_peered":"2023-10-03T10:09:48.770063+0000","last_clean":"2023-10-03T10:09:48.770063+0000","last_became_active":"2023-10-03T10:09:48.762670+0000","last_became_peered":"2023-10-03T10:09:48.762670+0000","last_unstale":"2023-10-03T10:09:48.770063+0000","last_undegraded":"2023-10-03T10:09:48.770063+0000","last_fullsized":"2023-10-03T10:09:48.770063+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.769199+0000","last_change":"2023-10-03T10:09:48.757466+0000","last_active":"2023-10-03T10:09:48.769199+0000","last_peered":"2023-10-03T10:09:48.769199+0000","last_clean":"2023-10-03T10:09:48.769199+0000","last_became_active":"2023-10-03T10:09:48.757197+0000","last_became_peered":"2023-10-03T10:09:48.757197+0000","last_unstale":"2023-10-03T10:09:48.769199+0000","last_undegraded":"2023-10-03T10:09:48.769199+0000","last_fullsized":"2023-10-03T10:09:48.769199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.770145+0000","last_change":"2023-10-03T10:09:48.766105+0000","last_active":"2023-10-03T10:09:48.770145+0000","last_peered":"2023-10-03T10:09:48.770145+0000","last_clean":"2023-10-03T10:09:48.770145+0000","last_became_active":"2023-10-03T10:09:48.765834+0000","last_became_peered":"2023-10-03T10:09:48.765834+0000","last_unstale":"2023-10-03T10:09:48.770145+0000","last_undegraded":"2023-10-03T10:09:48.770145+0000","last_fullsized":"2023-10-03T10:09:48.770145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.751117+0000","last_change":"2023-10-03T10:09:48.743916+0000","last_active":"2023-10-03T10:09:48.751117+0000","last_peered":"2023-10-03T10:09:48.751117+0000","last_clean":"2023-10-03T10:09:48.751117+0000","last_became_active":"2023-10-03T10:09:48.743646+0000","last_became_peered":"2023-10-03T10:09:48.743646+0000","last_unstale":"2023-10-03T10:09:48.751117+0000","last_undegraded":"2023-10-03T10:09:48.751117+0000","last_fullsized":"2023-10-03T10:09:48.751117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":46244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":46050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297248,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074592,"statfs":{"total":96636764160,"available":96332382208,"internally_reserved":0,"allocated":155648,"data_stored":45214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297244,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074596,"statfs":{"total":96636764160,"available":96332386304,"internally_reserved":0,"allocated":151552,"data_stored":45160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:09:59.983 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-03T10:09:59.983 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-03T10:09:59.983 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-03T10:09:59.983 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-03T10:10:00.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.134+0000 7f8578e76700 1 Processor -- start 2023-10-03T10:10:00.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.134+0000 7f8578e76700 1 -- start start 2023-10-03T10:10:00.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.134+0000 7f8578e76700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8574127360 0x7f8574127740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.134+0000 7f8578e76700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f85740955b0 0x7f8574095a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.134+0000 7f8578e76700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8574092dd0 con 0x7f8574127c30 2023-10-03T10:10:00.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.134+0000 7f8578e76700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8574128010 con 0x7f85740955b0 2023-10-03T10:10:00.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.134+0000 7f8578e76700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8574092170 con 0x7f8574127360 2023-10-03T10:10:00.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.134+0000 7f857259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8574127360 0x7f8574127740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.134+0000 7f8572d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f85740955b0 0x7f8574095a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.134+0000 7f8572d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f85740955b0 0x7f8574095a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47198/0 (socket says 172.21.15.146:47198) 2023-10-03T10:10:00.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.134+0000 7f857259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8574127360 0x7f8574127740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36840/0 (socket says 172.21.15.146:36840) 2023-10-03T10:10:00.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.134+0000 7f8571d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8574127c30 0x7f8574094ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33726/0 (socket says 172.21.15.146:33726) 2023-10-03T10:10:00.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.134+0000 7f8572d9d700 1 -- 172.21.15.146:0/2038649874 learned_addr learned my addr 172.21.15.146:0/2038649874 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:00.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.135+0000 7f857259c700 1 -- 172.21.15.146:0/2038649874 >> v2:172.21.15.146:3300/0 conn(0x7f85740955b0 msgr2=0x7f8574095a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:00.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.135+0000 7f857259c700 1 --2- 172.21.15.146:0/2038649874 >> v2:172.21.15.146:3300/0 conn(0x7f85740955b0 0x7f8574095a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.135+0000 7f857259c700 1 -- 172.21.15.146:0/2038649874 >> v1:172.21.15.146:6789/0 conn(0x7f8574127c30 legacy=0x7f8574094ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.135+0000 7f857259c700 1 -- 172.21.15.146:0/2038649874 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8574093480 con 0x7f8574127360 2023-10-03T10:10:00.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.135+0000 7f857159a700 1 -- 172.21.15.146:0/2038649874 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193696625 0 0) 0x7f8574092dd0 con 0x7f8574127c30 2023-10-03T10:10:00.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.135+0000 7f8572d9d700 1 --2- 172.21.15.146:0/2038649874 >> v2:172.21.15.146:3300/0 conn(0x7f85740955b0 0x7f8574095a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:00.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.135+0000 7f857259c700 1 --2- 172.21.15.146:0/2038649874 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8574127360 0x7f8574127740 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8564009760 tx=0x7f8564009060).ready entity=mon.2 client_cookie=f80308ccbe6542cb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:00.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.135+0000 7f857159a700 1 -- 172.21.15.146:0/2038649874 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856400f510 con 0x7f8574127360 2023-10-03T10:10:00.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.135+0000 7f857159a700 1 -- 172.21.15.146:0/2038649874 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856400f670 con 0x7f8574127360 2023-10-03T10:10:00.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.135+0000 7f857159a700 1 -- 172.21.15.146:0/2038649874 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856400f9f0 con 0x7f8574127360 2023-10-03T10:10:00.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.135+0000 7f8578e76700 1 -- 172.21.15.146:0/2038649874 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8574127360 msgr2=0x7f8574127740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.135+0000 7f8578e76700 1 --2- 172.21.15.146:0/2038649874 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8574127360 0x7f8574127740 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8564009760 tx=0x7f8564009060).stop 2023-10-03T10:10:00.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.136+0000 7f8578e76700 1 -- 172.21.15.146:0/2038649874 shutdown_connections 2023-10-03T10:10:00.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.136+0000 7f8578e76700 1 --2- 172.21.15.146:0/2038649874 >> v2:172.21.15.146:3300/0 conn(0x7f85740955b0 0x7f8574095a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.136+0000 7f8578e76700 1 --2- 172.21.15.146:0/2038649874 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8574127360 0x7f8574127740 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.136+0000 7f8578e76700 1 -- 172.21.15.146:0/2038649874 >> 172.21.15.146:0/2038649874 conn(0x7f85740999d0 msgr2=0x7f8574099de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:00.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.136+0000 7f8578e76700 1 -- 172.21.15.146:0/2038649874 shutdown_connections 2023-10-03T10:10:00.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.136+0000 7f8578e76700 1 -- 172.21.15.146:0/2038649874 wait complete. 2023-10-03T10:10:00.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.137+0000 7f8578e76700 1 Processor -- start 2023-10-03T10:10:00.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.137+0000 7f8578e76700 1 -- start start 2023-10-03T10:10:00.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.137+0000 7f8578e76700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85740955b0 0x7f8574118db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.137+0000 7f8578e76700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8574127360 0x7f8574114e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.137+0000 7f8578e76700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8574127c30 0x7f8574115300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.138+0000 7f8578e76700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8574118310 con 0x7f8574127c30 2023-10-03T10:10:00.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.138+0000 7f8578e76700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8574117ed0 con 0x7f85740955b0 2023-10-03T10:10:00.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.138+0000 7f8578e76700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8574098890 con 0x7f8574127360 2023-10-03T10:10:00.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.138+0000 7f8571d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8574127360 0x7f8574114e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.138+0000 7f857259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85740955b0 0x7f8574118db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.138+0000 7f857259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85740955b0 0x7f8574118db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58698/0 (socket says 172.21.15.146:58698) 2023-10-03T10:10:00.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.138+0000 7f8572d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8574127c30 0x7f8574115300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.138+0000 7f857259c700 1 -- 172.21.15.146:0/2905549596 learned_addr learned my addr 172.21.15.146:0/2905549596 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:00.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.138+0000 7f8571d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8574127360 0x7f8574114e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36842/0 (socket says 172.21.15.146:36842) 2023-10-03T10:10:00.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.138+0000 7f857259c700 1 -- 172.21.15.146:0/2905549596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8574127360 msgr2=0x7f8574114e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.138+0000 7f857259c700 1 --2- 172.21.15.146:0/2905549596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8574127360 0x7f8574114e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.138+0000 7f857259c700 1 -- 172.21.15.146:0/2905549596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8574127c30 msgr2=0x7f8574115300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.138+0000 7f857259c700 1 --2- 172.21.15.146:0/2905549596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8574127c30 0x7f8574115300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.138+0000 7f857259c700 1 -- 172.21.15.146:0/2905549596 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c00bcf0 con 0x7f85740955b0 2023-10-03T10:10:00.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.138+0000 7f8572d9d700 1 --2- 172.21.15.146:0/2905549596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8574127c30 0x7f8574115300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:00.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.138+0000 7f8571d9b700 1 --2- 172.21.15.146:0/2905549596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8574127360 0x7f8574114e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:00.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.138+0000 7f857259c700 1 --2- 172.21.15.146:0/2905549596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85740955b0 0x7f8574118db0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8564009e00 tx=0x7f8564017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:00.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.138+0000 7f85627fc700 1 -- 172.21.15.146:0/2905549596 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856400f7e0 con 0x7f85740955b0 2023-10-03T10:10:00.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.138+0000 7f85627fc700 1 -- 172.21.15.146:0/2905549596 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856400f940 con 0x7f85740955b0 2023-10-03T10:10:00.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.138+0000 7f85627fc700 1 -- 172.21.15.146:0/2905549596 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856401b660 con 0x7f85740955b0 2023-10-03T10:10:00.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.138+0000 7f8578e76700 1 -- 172.21.15.146:0/2905549596 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85640092a0 con 0x7f85740955b0 2023-10-03T10:10:00.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.138+0000 7f8578e76700 1 -- 172.21.15.146:0/2905549596 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85741169a0 con 0x7f85740955b0 2023-10-03T10:10:00.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.139+0000 7f85627fc700 1 -- 172.21.15.146:0/2905549596 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f856401ba50 con 0x7f85740955b0 2023-10-03T10:10:00.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.139+0000 7f85627fc700 1 -- 172.21.15.146:0/2905549596 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f856403c840 con 0x7f85740955b0 2023-10-03T10:10:00.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.139+0000 7f8578e76700 1 -- 172.21.15.146:0/2905549596 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857405a260 con 0x7f85740955b0 2023-10-03T10:10:00.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.144+0000 7f85627fc700 1 -- 172.21.15.146:0/2905549596 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8564029080 con 0x7f85740955b0 2023-10-03T10:10:00.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.340+0000 7f8578e76700 1 -- 172.21.15.146:0/2905549596 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f85740923b0 con 0x7f85740955b0 2023-10-03T10:10:00.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.341+0000 7f85627fc700 1 -- 172.21.15.146:0/2905549596 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f856401f020 con 0x7f85740955b0 2023-10-03T10:10:00.342 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:10:00.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.343+0000 7f8578e76700 1 -- 172.21.15.146:0/2905549596 >> v1:172.21.15.146:6816/118159 conn(0x7f855402bb60 legacy=0x7f855402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.343+0000 7f8578e76700 1 -- 172.21.15.146:0/2905549596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85740955b0 msgr2=0x7f8574118db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.343+0000 7f8578e76700 1 --2- 172.21.15.146:0/2905549596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85740955b0 0x7f8574118db0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8564009e00 tx=0x7f8564017000).stop 2023-10-03T10:10:00.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.343+0000 7f8578e76700 1 -- 172.21.15.146:0/2905549596 shutdown_connections 2023-10-03T10:10:00.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.343+0000 7f8578e76700 1 --2- 172.21.15.146:0/2905549596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8574127c30 0x7f8574115300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.343+0000 7f8578e76700 1 --2- 172.21.15.146:0/2905549596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85740955b0 0x7f8574118db0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.343+0000 7f8578e76700 1 --2- 172.21.15.146:0/2905549596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8574127360 0x7f8574114e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.343+0000 7f8578e76700 1 -- 172.21.15.146:0/2905549596 >> 172.21.15.146:0/2905549596 conn(0x7f85740999d0 msgr2=0x7f8574068840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:00.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.343+0000 7f8578e76700 1 -- 172.21.15.146:0/2905549596 shutdown_connections 2023-10-03T10:10:00.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.343+0000 7f8578e76700 1 -- 172.21.15.146:0/2905549596 wait complete. 2023-10-03T10:10:00.355 INFO:teuthology.orchestra.run.smithi146.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-03T10:10:00.355 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-03T10:10:00.356 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:10:00.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.473+0000 7fbc6c266700 1 Processor -- start 2023-10-03T10:10:00.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.473+0000 7fbc6c266700 1 -- start start 2023-10-03T10:10:00.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.473+0000 7fbc6c266700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc64096810 0x7fbc64096bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.473+0000 7fbc6c266700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc640970e0 0x7fbc640974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.473+0000 7fbc6c266700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbc640979b0 0x7fbc6412f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.473+0000 7fbc6c266700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc640982f0 con 0x7fbc640979b0 2023-10-03T10:10:00.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.473+0000 7fbc6c266700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc64068550 con 0x7fbc640970e0 2023-10-03T10:10:00.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.473+0000 7fbc6c266700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc64069e20 con 0x7fbc64096810 2023-10-03T10:10:00.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.474+0000 7fbc6a803700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbc640979b0 0x7fbc6412f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.474+0000 7fbc6a803700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbc640979b0 0x7fbc6412f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47222/0 (socket says 172.21.15.146:47222) 2023-10-03T10:10:00.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.474+0000 7fbc6a803700 1 -- 172.21.15.146:0/1745411837 learned_addr learned my addr 172.21.15.146:0/1745411837 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:00.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.474+0000 7fbc6a002700 1 --2- 172.21.15.146:0/1745411837 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc64096810 0x7fbc64096bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.474+0000 7fbc69801700 1 --2- 172.21.15.146:0/1745411837 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc640970e0 0x7fbc640974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.474+0000 7fbc6a803700 1 -- 172.21.15.146:0/1745411837 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc64096810 msgr2=0x7fbc64096bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:00.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.474+0000 7fbc6a803700 1 --2- 172.21.15.146:0/1745411837 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc64096810 0x7fbc64096bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.474+0000 7fbc6a803700 1 -- 172.21.15.146:0/1745411837 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc640970e0 msgr2=0x7fbc640974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:00.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.474+0000 7fbc6a803700 1 --2- 172.21.15.146:0/1745411837 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc640970e0 0x7fbc640974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.474+0000 7fbc6a803700 1 -- 172.21.15.146:0/1745411837 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc64068f60 con 0x7fbc640979b0 2023-10-03T10:10:00.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.474+0000 7fbc6a803700 1 --2- 172.21.15.146:0/1745411837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc640979b0 0x7fbc6412f2d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fbc5c009f20 tx=0x7fbc5c009840).ready entity=mon.0 client_cookie=ee5979092ed05e39 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:00.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.474+0000 7fbc69000700 1 -- 172.21.15.146:0/1745411837 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c00e070 con 0x7fbc640979b0 2023-10-03T10:10:00.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.474+0000 7fbc69000700 1 -- 172.21.15.146:0/1745411837 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5c00b970 con 0x7fbc640979b0 2023-10-03T10:10:00.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.474+0000 7fbc69000700 1 -- 172.21.15.146:0/1745411837 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c00bcf0 con 0x7fbc640979b0 2023-10-03T10:10:00.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.475+0000 7fbc6c266700 1 -- 172.21.15.146:0/1745411837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc640979b0 msgr2=0x7fbc6412f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.475+0000 7fbc6c266700 1 --2- 172.21.15.146:0/1745411837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc640979b0 0x7fbc6412f2d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fbc5c009f20 tx=0x7fbc5c009840).stop 2023-10-03T10:10:00.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.475+0000 7fbc6c266700 1 -- 172.21.15.146:0/1745411837 shutdown_connections 2023-10-03T10:10:00.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.475+0000 7fbc6c266700 1 --2- 172.21.15.146:0/1745411837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc640979b0 0x7fbc6412f2d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.475+0000 7fbc6c266700 1 --2- 172.21.15.146:0/1745411837 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc64096810 0x7fbc64096bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.475+0000 7fbc6c266700 1 --2- 172.21.15.146:0/1745411837 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc640970e0 0x7fbc640974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.475+0000 7fbc6c266700 1 -- 172.21.15.146:0/1745411837 >> 172.21.15.146:0/1745411837 conn(0x7fbc6409bad0 msgr2=0x7fbc6409bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:00.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.475+0000 7fbc6c266700 1 -- 172.21.15.146:0/1745411837 shutdown_connections 2023-10-03T10:10:00.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.475+0000 7fbc6c266700 1 -- 172.21.15.146:0/1745411837 wait complete. 2023-10-03T10:10:00.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.476+0000 7fbc6c266700 1 Processor -- start 2023-10-03T10:10:00.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.476+0000 7fbc6c266700 1 -- start start 2023-10-03T10:10:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc6c266700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc64096810 0x7fbc64137b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc6c266700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc640970e0 0x7fbc64138060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc6c266700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc640979b0 0x7fbc64138550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc6c266700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6411b8e0 con 0x7fbc64096810 2023-10-03T10:10:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc6c266700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc64091c10 con 0x7fbc640979b0 2023-10-03T10:10:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc6c266700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6406a040 con 0x7fbc640970e0 2023-10-03T10:10:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc6a002700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc64096810 0x7fbc64137b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc6a803700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc640979b0 0x7fbc64138550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc6a002700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc64096810 0x7fbc64137b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47224/0 (socket says 172.21.15.146:47224) 2023-10-03T10:10:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc6a002700 1 -- 172.21.15.146:0/4135576518 learned_addr learned my addr 172.21.15.146:0/4135576518 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc69801700 1 --2- 172.21.15.146:0/4135576518 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc640970e0 0x7fbc64138060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc6a002700 1 -- 172.21.15.146:0/4135576518 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc640970e0 msgr2=0x7fbc64138060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc6a002700 1 --2- 172.21.15.146:0/4135576518 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc640970e0 0x7fbc64138060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc6a002700 1 -- 172.21.15.146:0/4135576518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc640979b0 msgr2=0x7fbc64138550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc6a002700 1 --2- 172.21.15.146:0/4135576518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc640979b0 0x7fbc64138550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc6a002700 1 -- 172.21.15.146:0/4135576518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5c009ae0 con 0x7fbc64096810 2023-10-03T10:10:00.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc6a803700 1 --2- 172.21.15.146:0/4135576518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc640979b0 0x7fbc64138550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:00.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc6a002700 1 --2- 172.21.15.146:0/4135576518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc64096810 0x7fbc64137b70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fbc6000e980 tx=0x7fbc60009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:00.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc59ffb700 1 -- 172.21.15.146:0/4135576518 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc60012600 con 0x7fbc64096810 2023-10-03T10:10:00.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc59ffb700 1 -- 172.21.15.146:0/4135576518 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc60012760 con 0x7fbc64096810 2023-10-03T10:10:00.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc6c266700 1 -- 172.21.15.146:0/4135576518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc6411a370 con 0x7fbc64096810 2023-10-03T10:10:00.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc59ffb700 1 -- 172.21.15.146:0/4135576518 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc60012ae0 con 0x7fbc64096810 2023-10-03T10:10:00.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.477+0000 7fbc6c266700 1 -- 172.21.15.146:0/4135576518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc64119980 con 0x7fbc64096810 2023-10-03T10:10:00.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.478+0000 7fbc59ffb700 1 -- 172.21.15.146:0/4135576518 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fbc6001b400 con 0x7fbc64096810 2023-10-03T10:10:00.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.478+0000 7fbc59ffb700 1 -- 172.21.15.146:0/4135576518 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fbc6003b480 con 0x7fbc64096810 2023-10-03T10:10:00.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.478+0000 7fbc6c266700 1 -- 172.21.15.146:0/4135576518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6411b720 con 0x7fbc64096810 2023-10-03T10:10:00.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.483+0000 7fbc59ffb700 1 -- 172.21.15.146:0/4135576518 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fbc60019310 con 0x7fbc64096810 2023-10-03T10:10:00.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.640+0000 7fbc6c266700 1 -- 172.21.15.146:0/4135576518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc6405a260 con 0x7fbc64096810 2023-10-03T10:10:00.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.641+0000 7fbc59ffb700 1 -- 172.21.15.146:0/4135576518 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11373 (secure 0 0 0) 0x7fbc60029030 con 0x7fbc64096810 2023-10-03T10:10:00.642 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:10:00.642 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":16,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:09:49.722394+0000","last_up_change":"2023-10-03T10:09:42.301022+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":118758}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":118758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":118758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":118758}]},"public_addr":"172.21.15.146:6800/118758","cluster_addr":"172.21.15.146:6801/118758","heartbeat_back_addr":"172.21.15.146:6803/118758","heartbeat_front_addr":"172.21.15.146:6802/118758","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":118774}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":118774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":118774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":118774}]},"public_addr":"172.21.15.146:6804/118774","cluster_addr":"172.21.15.146:6806/118774","heartbeat_back_addr":"172.21.15.146:6810/118774","heartbeat_front_addr":"172.21.15.146:6808/118774","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":118775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":118775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":118775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":118775}]},"public_addr":"172.21.15.146:6805/118775","cluster_addr":"172.21.15.146:6807/118775","heartbeat_back_addr":"172.21.15.146:6811/118775","heartbeat_front_addr":"172.21.15.146:6809/118775","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":118776}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":118776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":118776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":118776}]},"public_addr":"172.21.15.146:6812/118776","cluster_addr":"172.21.15.146:6813/118776","heartbeat_back_addr":"172.21.15.146:6815/118776","heartbeat_front_addr":"172.21.15.146:6814/118776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:10:00.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.643+0000 7fbc6c266700 1 -- 172.21.15.146:0/4135576518 >> v1:172.21.15.146:6816/118159 conn(0x7fbc4802bb60 legacy=0x7fbc4802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.643+0000 7fbc6c266700 1 -- 172.21.15.146:0/4135576518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc64096810 msgr2=0x7fbc64137b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.643+0000 7fbc6c266700 1 --2- 172.21.15.146:0/4135576518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc64096810 0x7fbc64137b70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fbc6000e980 tx=0x7fbc60009060).stop 2023-10-03T10:10:00.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.643+0000 7fbc6c266700 1 -- 172.21.15.146:0/4135576518 shutdown_connections 2023-10-03T10:10:00.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.643+0000 7fbc6c266700 1 --2- 172.21.15.146:0/4135576518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc640979b0 0x7fbc64138550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.643+0000 7fbc6c266700 1 --2- 172.21.15.146:0/4135576518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc64096810 0x7fbc64137b70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.643+0000 7fbc6c266700 1 --2- 172.21.15.146:0/4135576518 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc640970e0 0x7fbc64138060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.643+0000 7fbc6c266700 1 -- 172.21.15.146:0/4135576518 >> 172.21.15.146:0/4135576518 conn(0x7fbc6409bad0 msgr2=0x7fbc6409a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:00.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.643+0000 7fbc6c266700 1 -- 172.21.15.146:0/4135576518 shutdown_connections 2023-10-03T10:10:00.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.643+0000 7fbc6c266700 1 -- 172.21.15.146:0/4135576518 wait complete. 2023-10-03T10:10:00.656 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:09:42.343363+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:43.224375+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:47.108480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:47.686814+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-03T10:10:00.656 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:10:00.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.776+0000 7faac8a37700 1 Processor -- start 2023-10-03T10:10:00.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.776+0000 7faac8a37700 1 -- start start 2023-10-03T10:10:00.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.777+0000 7faac8a37700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faac405f560 0x7faac4096840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.777+0000 7faac8a37700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faac412cbd0 0x7faac412efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.777+0000 7faac8a37700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac40933e0 con 0x7faac4069d90 2023-10-03T10:10:00.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.777+0000 7faac8a37700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac405f940 con 0x7faac412cbd0 2023-10-03T10:10:00.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.777+0000 7faac8a37700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac4097440 con 0x7faac405f560 2023-10-03T10:10:00.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.777+0000 7faac2d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faac412cbd0 0x7faac412efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.777+0000 7faac259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faac405f560 0x7faac4096840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.777+0000 7faac2d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faac412cbd0 0x7faac412efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47234/0 (socket says 172.21.15.146:47234) 2023-10-03T10:10:00.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.777+0000 7faac259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faac405f560 0x7faac4096840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58716/0 (socket says 172.21.15.146:58716) 2023-10-03T10:10:00.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.777+0000 7faac1d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7faac4069d90 0x7faac4096d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33728/0 (socket says 172.21.15.146:33728) 2023-10-03T10:10:00.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.777+0000 7faac2d9d700 1 -- 172.21.15.146:0/183350049 learned_addr learned my addr 172.21.15.146:0/183350049 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:00.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.777+0000 7faac259c700 1 -- 172.21.15.146:0/183350049 >> v2:172.21.15.146:3300/0 conn(0x7faac412cbd0 msgr2=0x7faac412efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:00.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.777+0000 7faac259c700 1 --2- 172.21.15.146:0/183350049 >> v2:172.21.15.146:3300/0 conn(0x7faac412cbd0 0x7faac412efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.777+0000 7faac259c700 1 -- 172.21.15.146:0/183350049 >> v1:172.21.15.146:6789/0 conn(0x7faac4069d90 legacy=0x7faac4096d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.777+0000 7faac259c700 1 -- 172.21.15.146:0/183350049 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac40921e0 con 0x7faac405f560 2023-10-03T10:10:00.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.777+0000 7faac159a700 1 -- 172.21.15.146:0/183350049 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2529209402 0 0) 0x7faac40933e0 con 0x7faac4069d90 2023-10-03T10:10:00.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.777+0000 7faac2d9d700 1 --2- 172.21.15.146:0/183350049 >> v2:172.21.15.146:3300/0 conn(0x7faac412cbd0 0x7faac412efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:00.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.778+0000 7faac259c700 1 --2- 172.21.15.146:0/183350049 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faac405f560 0x7faac4096840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7faab8009760 tx=0x7faab8009060).ready entity=mon.1 client_cookie=b7af8b396cff74ba server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:00.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.778+0000 7faac159a700 1 -- 172.21.15.146:0/183350049 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab800f510 con 0x7faac405f560 2023-10-03T10:10:00.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.778+0000 7faac159a700 1 -- 172.21.15.146:0/183350049 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab800f670 con 0x7faac405f560 2023-10-03T10:10:00.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.778+0000 7faac159a700 1 -- 172.21.15.146:0/183350049 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab800f9f0 con 0x7faac405f560 2023-10-03T10:10:00.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.778+0000 7faac8a37700 1 -- 172.21.15.146:0/183350049 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faac405f560 msgr2=0x7faac4096840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.778+0000 7faac8a37700 1 --2- 172.21.15.146:0/183350049 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faac405f560 0x7faac4096840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7faab8009760 tx=0x7faab8009060).stop 2023-10-03T10:10:00.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.778+0000 7faac8a37700 1 -- 172.21.15.146:0/183350049 shutdown_connections 2023-10-03T10:10:00.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.778+0000 7faac8a37700 1 --2- 172.21.15.146:0/183350049 >> v2:172.21.15.146:3300/0 conn(0x7faac412cbd0 0x7faac412efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.778+0000 7faac8a37700 1 --2- 172.21.15.146:0/183350049 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faac405f560 0x7faac4096840 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.778+0000 7faac8a37700 1 -- 172.21.15.146:0/183350049 >> 172.21.15.146:0/183350049 conn(0x7faac409a1c0 msgr2=0x7faac409a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:00.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.778+0000 7faac8a37700 1 -- 172.21.15.146:0/183350049 shutdown_connections 2023-10-03T10:10:00.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.778+0000 7faac8a37700 1 -- 172.21.15.146:0/183350049 wait complete. 2023-10-03T10:10:00.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.779+0000 7faac8a37700 1 Processor -- start 2023-10-03T10:10:00.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.779+0000 7faac8a37700 1 -- start start 2023-10-03T10:10:00.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faac8a37700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faac405f560 0x7faac4066e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faac8a37700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac412cbd0 0x7faac41168b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faac8a37700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faac4116da0 0x7faac4117220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faac8a37700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac4091dc0 con 0x7faac412cbd0 2023-10-03T10:10:00.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faac8a37700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac4119c00 con 0x7faac4116da0 2023-10-03T10:10:00.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faac8a37700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faac4117710 con 0x7faac405f560 2023-10-03T10:10:00.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faac1d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac412cbd0 0x7faac41168b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faac2d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faac4116da0 0x7faac4117220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faac259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faac405f560 0x7faac4066e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faac1d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac412cbd0 0x7faac41168b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47242/0 (socket says 172.21.15.146:47242) 2023-10-03T10:10:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faac259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faac405f560 0x7faac4066e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36878/0 (socket says 172.21.15.146:36878) 2023-10-03T10:10:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faac2d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faac4116da0 0x7faac4117220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58724/0 (socket says 172.21.15.146:58724) 2023-10-03T10:10:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faac1d9b700 1 -- 172.21.15.146:0/56373480 learned_addr learned my addr 172.21.15.146:0/56373480 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faac1d9b700 1 -- 172.21.15.146:0/56373480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faac405f560 msgr2=0x7faac4066e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faac1d9b700 1 --2- 172.21.15.146:0/56373480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faac405f560 0x7faac4066e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faac1d9b700 1 -- 172.21.15.146:0/56373480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faac4116da0 msgr2=0x7faac4117220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faac1d9b700 1 --2- 172.21.15.146:0/56373480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faac4116da0 0x7faac4117220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faac1d9b700 1 -- 172.21.15.146:0/56373480 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc009ae0 con 0x7faac412cbd0 2023-10-03T10:10:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faac2d9d700 1 --2- 172.21.15.146:0/56373480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faac4116da0 0x7faac4117220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faac1d9b700 1 --2- 172.21.15.146:0/56373480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac412cbd0 0x7faac41168b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7faab400c4c0 tx=0x7faab4007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faab27fc700 1 -- 172.21.15.146:0/56373480 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab400ce10 con 0x7faac412cbd0 2023-10-03T10:10:00.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faab27fc700 1 -- 172.21.15.146:0/56373480 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab40072e0 con 0x7faac412cbd0 2023-10-03T10:10:00.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faac8a37700 1 -- 172.21.15.146:0/56373480 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab80092a0 con 0x7faac412cbd0 2023-10-03T10:10:00.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faab27fc700 1 -- 172.21.15.146:0/56373480 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab40056e0 con 0x7faac412cbd0 2023-10-03T10:10:00.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.780+0000 7faac8a37700 1 -- 172.21.15.146:0/56373480 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac4117ac0 con 0x7faac412cbd0 2023-10-03T10:10:00.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.781+0000 7faab27fc700 1 -- 172.21.15.146:0/56373480 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7faab4005a50 con 0x7faac412cbd0 2023-10-03T10:10:00.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.781+0000 7faab27fc700 1 -- 172.21.15.146:0/56373480 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7faab403a550 con 0x7faac412cbd0 2023-10-03T10:10:00.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.781+0000 7faac8a37700 1 -- 172.21.15.146:0/56373480 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac4118ed0 con 0x7faac412cbd0 2023-10-03T10:10:00.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.786+0000 7faab27fc700 1 -- 172.21.15.146:0/56373480 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7faac4118ed0 con 0x7faac412cbd0 2023-10-03T10:10:00.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.942+0000 7faac8a37700 1 -- 172.21.15.146:0/56373480 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7faac4118ed0 con 0x7faac412cbd0 2023-10-03T10:10:00.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.942+0000 7faab27fc700 1 -- 172.21.15.146:0/56373480 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v16) v1 ==== 110+0+10 (secure 0 0 0) 0x7faac4118ed0 con 0x7faac412cbd0 2023-10-03T10:10:00.943 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-03T10:10:00.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.944+0000 7faac8a37700 1 -- 172.21.15.146:0/56373480 >> v1:172.21.15.146:6816/118159 conn(0x7faaa402bb90 legacy=0x7faaa402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.944+0000 7faac8a37700 1 -- 172.21.15.146:0/56373480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac412cbd0 msgr2=0x7faac41168b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.944+0000 7faac8a37700 1 --2- 172.21.15.146:0/56373480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac412cbd0 0x7faac41168b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7faab400c4c0 tx=0x7faab4007be0).stop 2023-10-03T10:10:00.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.944+0000 7faac8a37700 1 -- 172.21.15.146:0/56373480 shutdown_connections 2023-10-03T10:10:00.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.944+0000 7faac8a37700 1 --2- 172.21.15.146:0/56373480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faac4116da0 0x7faac4117220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.944+0000 7faac8a37700 1 --2- 172.21.15.146:0/56373480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faac405f560 0x7faac4066e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.944+0000 7faac8a37700 1 --2- 172.21.15.146:0/56373480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac412cbd0 0x7faac41168b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.944+0000 7faac8a37700 1 -- 172.21.15.146:0/56373480 >> 172.21.15.146:0/56373480 conn(0x7faac409a1c0 msgr2=0x7faac4098060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:00.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.944+0000 7faac8a37700 1 -- 172.21.15.146:0/56373480 shutdown_connections 2023-10-03T10:10:00.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:00.944+0000 7faac8a37700 1 -- 172.21.15.146:0/56373480 wait complete. 2023-10-03T10:10:00.956 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:10:01.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.073+0000 7f80d163a700 1 Processor -- start 2023-10-03T10:10:01.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.074+0000 7f80d163a700 1 -- start start 2023-10-03T10:10:01.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.074+0000 7f80d163a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80cc0985e0 0x7f80cc0989c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.074+0000 7f80d163a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80cc130bb0 0x7f80cc132fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.074+0000 7f80d163a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80cc0964f0 con 0x7f80cc098eb0 2023-10-03T10:10:01.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.074+0000 7f80d163a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc09a3f0 con 0x7f80cc130bb0 2023-10-03T10:10:01.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.074+0000 7f80d163a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc095100 con 0x7f80cc0985e0 2023-10-03T10:10:01.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.074+0000 7f80ca7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f80cc098eb0 0x7f80cc12f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33732/0 (socket says 172.21.15.146:33732) 2023-10-03T10:10:01.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.074+0000 7f80cb7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80cc130bb0 0x7f80cc132fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.074+0000 7f80ca7fc700 1 -- 172.21.15.146:0/3088270893 learned_addr learned my addr 172.21.15.146:0/3088270893 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:10:01.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.074+0000 7f80caffd700 1 --2- 172.21.15.146:0/3088270893 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80cc0985e0 0x7f80cc0989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.074+0000 7f80c9ffb700 1 -- 172.21.15.146:0/3088270893 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246380211 0 0) 0x7f80cc0964f0 con 0x7f80cc098eb0 2023-10-03T10:10:01.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.074+0000 7f80c9ffb700 1 -- 172.21.15.146:0/3088270893 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80b40033f0 con 0x7f80cc098eb0 2023-10-03T10:10:01.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.074+0000 7f80cb7fe700 1 -- 172.21.15.146:0/3088270893 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80cc0985e0 msgr2=0x7f80cc0989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:01.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.074+0000 7f80cb7fe700 1 --2- 172.21.15.146:0/3088270893 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80cc0985e0 0x7f80cc0989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.074+0000 7f80cb7fe700 1 -- 172.21.15.146:0/3088270893 >> v1:172.21.15.146:6789/0 conn(0x7f80cc098eb0 legacy=0x7f80cc12f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.074+0000 7f80cb7fe700 1 -- 172.21.15.146:0/3088270893 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc099e70 con 0x7f80cc130bb0 2023-10-03T10:10:01.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.075+0000 7f80caffd700 1 --2- 172.21.15.146:0/3088270893 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80cc0985e0 0x7f80cc0989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:01.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.075+0000 7f80cb7fe700 1 --2- 172.21.15.146:0/3088270893 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80cc130bb0 0x7f80cc132fa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f80c4009e90 tx=0x7f80c4009780).ready entity=mon.1 client_cookie=d2514cc965ceb6f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:01.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.075+0000 7f80c9ffb700 1 -- 172.21.15.146:0/3088270893 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c400e070 con 0x7f80cc130bb0 2023-10-03T10:10:01.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.075+0000 7f80c9ffb700 1 -- 172.21.15.146:0/3088270893 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c400bab0 con 0x7f80cc130bb0 2023-10-03T10:10:01.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.075+0000 7f80c9ffb700 1 -- 172.21.15.146:0/3088270893 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c400be30 con 0x7f80cc130bb0 2023-10-03T10:10:01.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.075+0000 7f80d163a700 1 -- 172.21.15.146:0/3088270893 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80cc130bb0 msgr2=0x7f80cc132fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.075+0000 7f80d163a700 1 --2- 172.21.15.146:0/3088270893 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80cc130bb0 0x7f80cc132fa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f80c4009e90 tx=0x7f80c4009780).stop 2023-10-03T10:10:01.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.075+0000 7f80d163a700 1 -- 172.21.15.146:0/3088270893 shutdown_connections 2023-10-03T10:10:01.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.075+0000 7f80d163a700 1 --2- 172.21.15.146:0/3088270893 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80cc130bb0 0x7f80cc132fa0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.075+0000 7f80d163a700 1 --2- 172.21.15.146:0/3088270893 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80cc0985e0 0x7f80cc0989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.075+0000 7f80d163a700 1 -- 172.21.15.146:0/3088270893 >> 172.21.15.146:0/3088270893 conn(0x7f80cc09dc40 msgr2=0x7f80cc09e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:01.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.075+0000 7f80d163a700 1 -- 172.21.15.146:0/3088270893 shutdown_connections 2023-10-03T10:10:01.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.075+0000 7f80d163a700 1 -- 172.21.15.146:0/3088270893 wait complete. 2023-10-03T10:10:01.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.076+0000 7f80d163a700 1 Processor -- start 2023-10-03T10:10:01.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.076+0000 7f80d163a700 1 -- start start 2023-10-03T10:10:01.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.077+0000 7f80d163a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80cc0985e0 0x7f80cc11a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.077+0000 7f80d163a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80cc098eb0 0x7f80cc11a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.077+0000 7f80d163a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80cc130bb0 0x7f80cc11ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.077+0000 7f80d163a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc1304f0 con 0x7f80cc130bb0 2023-10-03T10:10:01.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.077+0000 7f80d163a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc11ca00 con 0x7f80cc098eb0 2023-10-03T10:10:01.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.077+0000 7f80d163a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc09a0f0 con 0x7f80cc0985e0 2023-10-03T10:10:01.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.077+0000 7f80caffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80cc0985e0 0x7f80cc11a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.077+0000 7f80cb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80cc130bb0 0x7f80cc11ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.077+0000 7f80caffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80cc0985e0 0x7f80cc11a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36900/0 (socket says 172.21.15.146:36900) 2023-10-03T10:10:01.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.077+0000 7f80caffd700 1 -- 172.21.15.146:0/1807259385 learned_addr learned my addr 172.21.15.146:0/1807259385 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:01.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.077+0000 7f80ca7fc700 1 --2- 172.21.15.146:0/1807259385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80cc098eb0 0x7f80cc11a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.077+0000 7f80cb7fe700 1 -- 172.21.15.146:0/1807259385 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80cc0985e0 msgr2=0x7f80cc11a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.077+0000 7f80cb7fe700 1 --2- 172.21.15.146:0/1807259385 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80cc0985e0 0x7f80cc11a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.077+0000 7f80cb7fe700 1 -- 172.21.15.146:0/1807259385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80cc098eb0 msgr2=0x7f80cc11a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.077+0000 7f80cb7fe700 1 --2- 172.21.15.146:0/1807259385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80cc098eb0 0x7f80cc11a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.077+0000 7f80cb7fe700 1 -- 172.21.15.146:0/1807259385 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c00092a0 con 0x7f80cc130bb0 2023-10-03T10:10:01.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.077+0000 7f80caffd700 1 --2- 172.21.15.146:0/1807259385 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80cc0985e0 0x7f80cc11a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:01.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.077+0000 7f80ca7fc700 1 --2- 172.21.15.146:0/1807259385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80cc098eb0 0x7f80cc11a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:01.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.077+0000 7f80cb7fe700 1 --2- 172.21.15.146:0/1807259385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80cc130bb0 0x7f80cc11ad20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f80c4014000 tx=0x7f80cc096680).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:01.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.078+0000 7f80b2ffd700 1 -- 172.21.15.146:0/1807259385 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4013e20 con 0x7f80cc130bb0 2023-10-03T10:10:01.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.078+0000 7f80b2ffd700 1 -- 172.21.15.146:0/1807259385 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c401d630 con 0x7f80cc130bb0 2023-10-03T10:10:01.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.078+0000 7f80b2ffd700 1 -- 172.21.15.146:0/1807259385 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c401d9f0 con 0x7f80cc130bb0 2023-10-03T10:10:01.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.078+0000 7f80d163a700 1 -- 172.21.15.146:0/1807259385 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c4009a20 con 0x7f80cc130bb0 2023-10-03T10:10:01.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.078+0000 7f80d163a700 1 -- 172.21.15.146:0/1807259385 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80cc11e550 con 0x7f80cc130bb0 2023-10-03T10:10:01.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.078+0000 7f80b2ffd700 1 -- 172.21.15.146:0/1807259385 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f80c4003040 con 0x7f80cc130bb0 2023-10-03T10:10:01.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.079+0000 7f80b2ffd700 1 -- 172.21.15.146:0/1807259385 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f80c403cc50 con 0x7f80cc130bb0 2023-10-03T10:10:01.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.079+0000 7f80d163a700 1 -- 172.21.15.146:0/1807259385 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80cc09cb50 con 0x7f80cc130bb0 2023-10-03T10:10:01.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.083+0000 7f80b2ffd700 1 -- 172.21.15.146:0/1807259385 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f80c401dda0 con 0x7f80cc130bb0 2023-10-03T10:10:01.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.240+0000 7f80d163a700 1 -- 172.21.15.146:0/1807259385 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f80cc05a260 con 0x7f80cc130bb0 2023-10-03T10:10:01.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.240+0000 7f80b2ffd700 1 -- 172.21.15.146:0/1807259385 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f80c4025360 con 0x7f80cc130bb0 2023-10-03T10:10:01.241 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-03T10:10:01.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.242+0000 7f80d163a700 1 -- 172.21.15.146:0/1807259385 >> v1:172.21.15.146:6816/118159 conn(0x7f80b802bb60 legacy=0x7f80b802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.242+0000 7f80d163a700 1 -- 172.21.15.146:0/1807259385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80cc130bb0 msgr2=0x7f80cc11ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.242+0000 7f80d163a700 1 --2- 172.21.15.146:0/1807259385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80cc130bb0 0x7f80cc11ad20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f80c4014000 tx=0x7f80cc096680).stop 2023-10-03T10:10:01.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.242+0000 7f80d163a700 1 -- 172.21.15.146:0/1807259385 shutdown_connections 2023-10-03T10:10:01.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.242+0000 7f80d163a700 1 --2- 172.21.15.146:0/1807259385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80cc130bb0 0x7f80cc11ad20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.242+0000 7f80d163a700 1 --2- 172.21.15.146:0/1807259385 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80cc0985e0 0x7f80cc11a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.242+0000 7f80d163a700 1 --2- 172.21.15.146:0/1807259385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80cc098eb0 0x7f80cc11a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.242+0000 7f80d163a700 1 -- 172.21.15.146:0/1807259385 >> 172.21.15.146:0/1807259385 conn(0x7f80cc09dc40 msgr2=0x7f80cc09bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:01.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.242+0000 7f80d163a700 1 -- 172.21.15.146:0/1807259385 shutdown_connections 2023-10-03T10:10:01.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.242+0000 7f80d163a700 1 -- 172.21.15.146:0/1807259385 wait complete. 2023-10-03T10:10:01.254 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:10:01.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.372+0000 7fe31cde8700 1 Processor -- start 2023-10-03T10:10:01.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.372+0000 7fe31cde8700 1 -- start start 2023-10-03T10:10:01.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.373+0000 7fe31cde8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe318062b00 0x7fe318095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.373+0000 7fe31cde8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe3180966b0 0x7fe318132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.373+0000 7fe31cde8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe318091980 con 0x7fe318095b80 2023-10-03T10:10:01.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.373+0000 7fe31cde8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3180973f0 con 0x7fe3180966b0 2023-10-03T10:10:01.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.373+0000 7fe31cde8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe318062ee0 con 0x7fe318062b00 2023-10-03T10:10:01.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.373+0000 7fe316d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe3180966b0 0x7fe318132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.373+0000 7fe31659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe318062b00 0x7fe318095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.373+0000 7fe31659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe318062b00 0x7fe318095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36912/0 (socket says 172.21.15.146:36912) 2023-10-03T10:10:01.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.373+0000 7fe315d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe318095b80 0x7fe318095fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33742/0 (socket says 172.21.15.146:33742) 2023-10-03T10:10:01.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.373+0000 7fe316d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe3180966b0 0x7fe318132290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47274/0 (socket says 172.21.15.146:47274) 2023-10-03T10:10:01.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.373+0000 7fe31659c700 1 -- 172.21.15.146:0/3823137232 learned_addr learned my addr 172.21.15.146:0/3823137232 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:01.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.373+0000 7fe31659c700 1 -- 172.21.15.146:0/3823137232 >> v2:172.21.15.146:3300/0 conn(0x7fe3180966b0 msgr2=0x7fe318132290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:01.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.373+0000 7fe31659c700 1 --2- 172.21.15.146:0/3823137232 >> v2:172.21.15.146:3300/0 conn(0x7fe3180966b0 0x7fe318132290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.373+0000 7fe31659c700 1 -- 172.21.15.146:0/3823137232 >> v1:172.21.15.146:6789/0 conn(0x7fe318095b80 legacy=0x7fe318095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.373+0000 7fe31559a700 1 -- 172.21.15.146:0/3823137232 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789728006 0 0) 0x7fe318091980 con 0x7fe318095b80 2023-10-03T10:10:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.373+0000 7fe31659c700 1 -- 172.21.15.146:0/3823137232 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe318092310 con 0x7fe318062b00 2023-10-03T10:10:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.373+0000 7fe316d9d700 1 --2- 172.21.15.146:0/3823137232 >> v2:172.21.15.146:3300/0 conn(0x7fe3180966b0 0x7fe318132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.373+0000 7fe31659c700 1 --2- 172.21.15.146:0/3823137232 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe318062b00 0x7fe318095690 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe30c009830 tx=0x7fe30c0090f0).ready entity=mon.2 client_cookie=a16b045eec2e5194 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.374+0000 7fe31559a700 1 -- 172.21.15.146:0/3823137232 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c00b580 con 0x7fe318062b00 2023-10-03T10:10:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.374+0000 7fe31559a700 1 -- 172.21.15.146:0/3823137232 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c00b6e0 con 0x7fe318062b00 2023-10-03T10:10:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.374+0000 7fe31559a700 1 -- 172.21.15.146:0/3823137232 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c00ba60 con 0x7fe318062b00 2023-10-03T10:10:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.374+0000 7fe31cde8700 1 -- 172.21.15.146:0/3823137232 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe318062b00 msgr2=0x7fe318095690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.374+0000 7fe31cde8700 1 --2- 172.21.15.146:0/3823137232 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe318062b00 0x7fe318095690 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe30c009830 tx=0x7fe30c0090f0).stop 2023-10-03T10:10:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.374+0000 7fe31cde8700 1 -- 172.21.15.146:0/3823137232 shutdown_connections 2023-10-03T10:10:01.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.374+0000 7fe31cde8700 1 --2- 172.21.15.146:0/3823137232 >> v2:172.21.15.146:3300/0 conn(0x7fe3180966b0 0x7fe318132290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.374+0000 7fe31cde8700 1 --2- 172.21.15.146:0/3823137232 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe318062b00 0x7fe318095690 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.374+0000 7fe31cde8700 1 -- 172.21.15.146:0/3823137232 >> 172.21.15.146:0/3823137232 conn(0x7fe31809aa50 msgr2=0x7fe31809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:01.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.374+0000 7fe31cde8700 1 -- 172.21.15.146:0/3823137232 shutdown_connections 2023-10-03T10:10:01.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.374+0000 7fe31cde8700 1 -- 172.21.15.146:0/3823137232 wait complete. 2023-10-03T10:10:01.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.375+0000 7fe31cde8700 1 Processor -- start 2023-10-03T10:10:01.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.375+0000 7fe31cde8700 1 -- start start 2023-10-03T10:10:01.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.375+0000 7fe31cde8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe318062b00 0x7fe31812d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.375+0000 7fe31cde8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe318095b80 0x7fe3181157c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.375+0000 7fe31cde8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe3180966b0 0x7fe318115cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.375+0000 7fe31cde8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3181178b0 con 0x7fe318095b80 2023-10-03T10:10:01.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.375+0000 7fe31cde8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe318096da0 con 0x7fe318062b00 2023-10-03T10:10:01.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.375+0000 7fe31cde8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe318118c30 con 0x7fe3180966b0 2023-10-03T10:10:01.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.376+0000 7fe31659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe318062b00 0x7fe31812d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.376+0000 7fe315d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe318095b80 0x7fe3181157c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.376+0000 7fe31659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe318062b00 0x7fe31812d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58740/0 (socket says 172.21.15.146:58740) 2023-10-03T10:10:01.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.376+0000 7fe31659c700 1 -- 172.21.15.146:0/3060452551 learned_addr learned my addr 172.21.15.146:0/3060452551 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:01.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.376+0000 7fe316d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe3180966b0 0x7fe318115cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.376+0000 7fe315d9b700 1 -- 172.21.15.146:0/3060452551 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe3180966b0 msgr2=0x7fe318115cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.376+0000 7fe315d9b700 1 --2- 172.21.15.146:0/3060452551 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe3180966b0 0x7fe318115cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.376+0000 7fe315d9b700 1 -- 172.21.15.146:0/3060452551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe318062b00 msgr2=0x7fe31812d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.376+0000 7fe315d9b700 1 --2- 172.21.15.146:0/3060452551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe318062b00 0x7fe31812d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.376+0000 7fe315d9b700 1 -- 172.21.15.146:0/3060452551 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe310009a20 con 0x7fe318095b80 2023-10-03T10:10:01.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.376+0000 7fe315d9b700 1 --2- 172.21.15.146:0/3060452551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe318095b80 0x7fe3181157c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fe308000c00 tx=0x7fe308007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:01.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.376+0000 7fe3067fc700 1 -- 172.21.15.146:0/3060452551 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3080070d0 con 0x7fe318095b80 2023-10-03T10:10:01.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.376+0000 7fe3067fc700 1 -- 172.21.15.146:0/3060452551 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe308007230 con 0x7fe318095b80 2023-10-03T10:10:01.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.376+0000 7fe31cde8700 1 -- 172.21.15.146:0/3060452551 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30c009370 con 0x7fe318095b80 2023-10-03T10:10:01.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.376+0000 7fe3067fc700 1 -- 172.21.15.146:0/3060452551 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3080056e0 con 0x7fe318095b80 2023-10-03T10:10:01.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.376+0000 7fe31cde8700 1 -- 172.21.15.146:0/3060452551 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe318119870 con 0x7fe318095b80 2023-10-03T10:10:01.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.377+0000 7fe3067fc700 1 -- 172.21.15.146:0/3060452551 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe308005a90 con 0x7fe318095b80 2023-10-03T10:10:01.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.377+0000 7fe3067fc700 1 -- 172.21.15.146:0/3060452551 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe30803a670 con 0x7fe318095b80 2023-10-03T10:10:01.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.377+0000 7fe31cde8700 1 -- 172.21.15.146:0/3060452551 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe31805a260 con 0x7fe318095b80 2023-10-03T10:10:01.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.381+0000 7fe3067fc700 1 -- 172.21.15.146:0/3060452551 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe308018030 con 0x7fe318095b80 2023-10-03T10:10:01.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.538+0000 7fe31cde8700 1 -- 172.21.15.146:0/3060452551 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe3181165c0 con 0x7fe318095b80 2023-10-03T10:10:01.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.538+0000 7fe3067fc700 1 -- 172.21.15.146:0/3060452551 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v16) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe308013970 con 0x7fe318095b80 2023-10-03T10:10:01.539 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-03T10:10:01.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.540+0000 7fe31cde8700 1 -- 172.21.15.146:0/3060452551 >> v1:172.21.15.146:6816/118159 conn(0x7fe2f802bb30 legacy=0x7fe2f802dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.540+0000 7fe31cde8700 1 -- 172.21.15.146:0/3060452551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe318095b80 msgr2=0x7fe3181157c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.540+0000 7fe31cde8700 1 --2- 172.21.15.146:0/3060452551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe318095b80 0x7fe3181157c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fe308000c00 tx=0x7fe308007bb0).stop 2023-10-03T10:10:01.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.540+0000 7fe31cde8700 1 -- 172.21.15.146:0/3060452551 shutdown_connections 2023-10-03T10:10:01.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.540+0000 7fe31cde8700 1 --2- 172.21.15.146:0/3060452551 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe3180966b0 0x7fe318115cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.540+0000 7fe31cde8700 1 --2- 172.21.15.146:0/3060452551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe318062b00 0x7fe31812d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.540+0000 7fe31cde8700 1 --2- 172.21.15.146:0/3060452551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe318095b80 0x7fe3181157c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.540+0000 7fe31cde8700 1 -- 172.21.15.146:0/3060452551 >> 172.21.15.146:0/3060452551 conn(0x7fe31809aa50 msgr2=0x7fe318098880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:01.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.540+0000 7fe31cde8700 1 -- 172.21.15.146:0/3060452551 shutdown_connections 2023-10-03T10:10:01.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.540+0000 7fe31cde8700 1 -- 172.21.15.146:0/3060452551 wait complete. 2023-10-03T10:10:01.553 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:10:01.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.671+0000 7fb0c8980700 1 Processor -- start 2023-10-03T10:10:01.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.671+0000 7fb0c8980700 1 -- start start 2023-10-03T10:10:01.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.671+0000 7fb0c8980700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c4095da0 0x7fb0c40961c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.671+0000 7fb0c8980700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0c40966b0 0x7fb0c4132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.671+0000 7fb0c8980700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c4091980 con 0x7fb0c4062b00 2023-10-03T10:10:01.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.671+0000 7fb0c8980700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c40973f0 con 0x7fb0c4095da0 2023-10-03T10:10:01.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.671+0000 7fb0c8980700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c4062ee0 con 0x7fb0c40966b0 2023-10-03T10:10:01.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.671+0000 7fb0c1d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c4095da0 0x7fb0c40961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.671+0000 7fb0c2d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0c40966b0 0x7fb0c4132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.671+0000 7fb0c259c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb0c4062b00 0x7fb0c4095690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33754/0 (socket says 172.21.15.146:33754) 2023-10-03T10:10:01.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.671+0000 7fb0c259c700 1 -- 172.21.15.146:0/923984246 learned_addr learned my addr 172.21.15.146:0/923984246 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:10:01.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.672+0000 7fb0c159a700 1 -- 172.21.15.146:0/923984246 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781233837 0 0) 0x7fb0c4091980 con 0x7fb0c4062b00 2023-10-03T10:10:01.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.672+0000 7fb0c2d9d700 1 -- 172.21.15.146:0/923984246 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c4095da0 msgr2=0x7fb0c40961c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:01.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.672+0000 7fb0c2d9d700 1 --2- 172.21.15.146:0/923984246 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c4095da0 0x7fb0c40961c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.672+0000 7fb0c2d9d700 1 -- 172.21.15.146:0/923984246 >> v1:172.21.15.146:6789/0 conn(0x7fb0c4062b00 legacy=0x7fb0c4095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.672+0000 7fb0c2d9d700 1 -- 172.21.15.146:0/923984246 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c4092310 con 0x7fb0c40966b0 2023-10-03T10:10:01.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.672+0000 7fb0c1d9b700 1 --2- 172.21.15.146:0/923984246 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c4095da0 0x7fb0c40961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:01.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.672+0000 7fb0c2d9d700 1 --2- 172.21.15.146:0/923984246 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0c40966b0 0x7fb0c4132290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fb0bc009e90 tx=0x7fb0bc009780).ready entity=mon.2 client_cookie=6abe343b2fb6ffca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:01.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.672+0000 7fb0c159a700 1 -- 172.21.15.146:0/923984246 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc00e070 con 0x7fb0c40966b0 2023-10-03T10:10:01.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.672+0000 7fb0c159a700 1 -- 172.21.15.146:0/923984246 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc00bb60 con 0x7fb0c40966b0 2023-10-03T10:10:01.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.672+0000 7fb0c159a700 1 -- 172.21.15.146:0/923984246 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc012410 con 0x7fb0c40966b0 2023-10-03T10:10:01.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.672+0000 7fb0c8980700 1 -- 172.21.15.146:0/923984246 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0c40966b0 msgr2=0x7fb0c4132290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.672+0000 7fb0c8980700 1 --2- 172.21.15.146:0/923984246 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0c40966b0 0x7fb0c4132290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fb0bc009e90 tx=0x7fb0bc009780).stop 2023-10-03T10:10:01.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.672+0000 7fb0c8980700 1 -- 172.21.15.146:0/923984246 shutdown_connections 2023-10-03T10:10:01.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.672+0000 7fb0c8980700 1 --2- 172.21.15.146:0/923984246 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0c40966b0 0x7fb0c4132290 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.672+0000 7fb0c8980700 1 --2- 172.21.15.146:0/923984246 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c4095da0 0x7fb0c40961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.672+0000 7fb0c8980700 1 -- 172.21.15.146:0/923984246 >> 172.21.15.146:0/923984246 conn(0x7fb0c409aa50 msgr2=0x7fb0c409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:01.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.673+0000 7fb0c8980700 1 -- 172.21.15.146:0/923984246 shutdown_connections 2023-10-03T10:10:01.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.673+0000 7fb0c8980700 1 -- 172.21.15.146:0/923984246 wait complete. 2023-10-03T10:10:01.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.673+0000 7fb0c8980700 1 Processor -- start 2023-10-03T10:10:01.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.673+0000 7fb0c8980700 1 -- start start 2023-10-03T10:10:01.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.674+0000 7fb0c8980700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0c4062b00 0x7fb0c4115170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.674+0000 7fb0c8980700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0c4095da0 0x7fb0c4115660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.674+0000 7fb0c8980700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c40966b0 0x7fb0c4115b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.674+0000 7fb0c8980700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c412d2b0 con 0x7fb0c4062b00 2023-10-03T10:10:01.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.674+0000 7fb0c8980700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c41177a0 con 0x7fb0c40966b0 2023-10-03T10:10:01.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.674+0000 7fb0c8980700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c4096da0 con 0x7fb0c4095da0 2023-10-03T10:10:01.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.674+0000 7fb0c259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0c4062b00 0x7fb0c4115170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.674+0000 7fb0c259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0c4062b00 0x7fb0c4115170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47288/0 (socket says 172.21.15.146:47288) 2023-10-03T10:10:01.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.674+0000 7fb0c259c700 1 -- 172.21.15.146:0/839138261 learned_addr learned my addr 172.21.15.146:0/839138261 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:01.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.674+0000 7fb0c2d9d700 1 --2- 172.21.15.146:0/839138261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c40966b0 0x7fb0c4115b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.674+0000 7fb0c1d9b700 1 --2- 172.21.15.146:0/839138261 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0c4095da0 0x7fb0c4115660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.674+0000 7fb0c2d9d700 1 -- 172.21.15.146:0/839138261 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0c4095da0 msgr2=0x7fb0c4115660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.674+0000 7fb0c2d9d700 1 --2- 172.21.15.146:0/839138261 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0c4095da0 0x7fb0c4115660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.674+0000 7fb0c2d9d700 1 -- 172.21.15.146:0/839138261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0c4062b00 msgr2=0x7fb0c4115170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.674+0000 7fb0c2d9d700 1 --2- 172.21.15.146:0/839138261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0c4062b00 0x7fb0c4115170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.674+0000 7fb0c2d9d700 1 -- 172.21.15.146:0/839138261 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b80092a0 con 0x7fb0c40966b0 2023-10-03T10:10:01.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.674+0000 7fb0c259c700 1 --2- 172.21.15.146:0/839138261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0c4062b00 0x7fb0c4115170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:01.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.674+0000 7fb0c2d9d700 1 --2- 172.21.15.146:0/839138261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c40966b0 0x7fb0c4115b50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb0bc014000 tx=0x7fb0bc009780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:01.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.674+0000 7fb0b27fc700 1 -- 172.21.15.146:0/839138261 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc01d630 con 0x7fb0c40966b0 2023-10-03T10:10:01.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.674+0000 7fb0b27fc700 1 -- 172.21.15.146:0/839138261 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc01d790 con 0x7fb0c40966b0 2023-10-03T10:10:01.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.674+0000 7fb0c8980700 1 -- 172.21.15.146:0/839138261 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0bc009a20 con 0x7fb0c40966b0 2023-10-03T10:10:01.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.674+0000 7fb0b27fc700 1 -- 172.21.15.146:0/839138261 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc01db50 con 0x7fb0c40966b0 2023-10-03T10:10:01.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.675+0000 7fb0c8980700 1 -- 172.21.15.146:0/839138261 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c41192f0 con 0x7fb0c40966b0 2023-10-03T10:10:01.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.675+0000 7fb0b27fc700 1 -- 172.21.15.146:0/839138261 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb0bc003040 con 0x7fb0c40966b0 2023-10-03T10:10:01.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.675+0000 7fb0b27fc700 1 -- 172.21.15.146:0/839138261 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb0bc03cce0 con 0x7fb0c40966b0 2023-10-03T10:10:01.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.676+0000 7fb0c8980700 1 -- 172.21.15.146:0/839138261 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c4099890 con 0x7fb0c40966b0 2023-10-03T10:10:01.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.680+0000 7fb0b27fc700 1 -- 172.21.15.146:0/839138261 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb0bc010310 con 0x7fb0c40966b0 2023-10-03T10:10:01.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.838+0000 7fb0c8980700 1 -- 172.21.15.146:0/839138261 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb0c405a260 con 0x7fb0c40966b0 2023-10-03T10:10:01.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.839+0000 7fb0b27fc700 1 -- 172.21.15.146:0/839138261 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v16) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb0bc011e60 con 0x7fb0c40966b0 2023-10-03T10:10:01.840 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-03T10:10:01.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.840+0000 7fb0c8980700 1 -- 172.21.15.146:0/839138261 >> v1:172.21.15.146:6816/118159 conn(0x7fb0a402bb90 legacy=0x7fb0a402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.840+0000 7fb0c8980700 1 -- 172.21.15.146:0/839138261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c40966b0 msgr2=0x7fb0c4115b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.840+0000 7fb0c8980700 1 --2- 172.21.15.146:0/839138261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c40966b0 0x7fb0c4115b50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb0bc014000 tx=0x7fb0bc009780).stop 2023-10-03T10:10:01.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.840+0000 7fb0c8980700 1 -- 172.21.15.146:0/839138261 shutdown_connections 2023-10-03T10:10:01.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.840+0000 7fb0c8980700 1 --2- 172.21.15.146:0/839138261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c40966b0 0x7fb0c4115b50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.840+0000 7fb0c8980700 1 --2- 172.21.15.146:0/839138261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0c4062b00 0x7fb0c4115170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.841+0000 7fb0c8980700 1 --2- 172.21.15.146:0/839138261 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0c4095da0 0x7fb0c4115660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.841+0000 7fb0c8980700 1 -- 172.21.15.146:0/839138261 >> 172.21.15.146:0/839138261 conn(0x7fb0c409aa50 msgr2=0x7fb0c412fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:01.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.841+0000 7fb0c8980700 1 -- 172.21.15.146:0/839138261 shutdown_connections 2023-10-03T10:10:01.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.841+0000 7fb0c8980700 1 -- 172.21.15.146:0/839138261 wait complete. 2023-10-03T10:10:01.853 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:10:01.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.969+0000 7f87153c2700 1 Processor -- start 2023-10-03T10:10:01.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.969+0000 7f87153c2700 1 -- start start 2023-10-03T10:10:01.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.969+0000 7f87153c2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87100985e0 0x7f87100989c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.969+0000 7f87153c2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8710098eb0 0x7f871012f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.969+0000 7f87153c2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f871012f980 0x7f8710131d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.969+0000 7f87153c2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8710095650 con 0x7f871012f980 2023-10-03T10:10:01.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.969+0000 7f87153c2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871009a3f0 con 0x7f8710098eb0 2023-10-03T10:10:01.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.969+0000 7f87153c2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8710095100 con 0x7f87100985e0 2023-10-03T10:10:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.969+0000 7f870f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f871012f980 0x7f8710131d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.969+0000 7f870effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87100985e0 0x7f87100989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.969+0000 7f870f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f871012f980 0x7f8710131d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47298/0 (socket says 172.21.15.146:47298) 2023-10-03T10:10:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.969+0000 7f870effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87100985e0 0x7f87100989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36942/0 (socket says 172.21.15.146:36942) 2023-10-03T10:10:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.969+0000 7f870f7fe700 1 -- 172.21.15.146:0/4103450235 learned_addr learned my addr 172.21.15.146:0/4103450235 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.969+0000 7f870e7fc700 1 --2- 172.21.15.146:0/4103450235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8710098eb0 0x7f871012f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.970+0000 7f870f7fe700 1 -- 172.21.15.146:0/4103450235 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87100985e0 msgr2=0x7f87100989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.970+0000 7f870f7fe700 1 --2- 172.21.15.146:0/4103450235 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87100985e0 0x7f87100989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.970+0000 7f870f7fe700 1 -- 172.21.15.146:0/4103450235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8710098eb0 msgr2=0x7f871012f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.970+0000 7f870f7fe700 1 --2- 172.21.15.146:0/4103450235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8710098eb0 0x7f871012f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.970+0000 7f870f7fe700 1 -- 172.21.15.146:0/4103450235 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8710099e70 con 0x7f871012f980 2023-10-03T10:10:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.970+0000 7f870effd700 1 --2- 172.21.15.146:0/4103450235 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87100985e0 0x7f87100989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.970+0000 7f870e7fc700 1 --2- 172.21.15.146:0/4103450235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8710098eb0 0x7f871012f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.970+0000 7f870f7fe700 1 --2- 172.21.15.146:0/4103450235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f871012f980 0x7f8710131d70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f8708009f50 tx=0x7f8708009840).ready entity=mon.0 client_cookie=5193ff59d074384b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.970+0000 7f870dffb700 1 -- 172.21.15.146:0/4103450235 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870800e070 con 0x7f871012f980 2023-10-03T10:10:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.970+0000 7f870dffb700 1 -- 172.21.15.146:0/4103450235 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870800b910 con 0x7f871012f980 2023-10-03T10:10:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.970+0000 7f870dffb700 1 -- 172.21.15.146:0/4103450235 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870800bc90 con 0x7f871012f980 2023-10-03T10:10:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.970+0000 7f87153c2700 1 -- 172.21.15.146:0/4103450235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f871012f980 msgr2=0x7f8710131d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.970+0000 7f87153c2700 1 --2- 172.21.15.146:0/4103450235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f871012f980 0x7f8710131d70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f8708009f50 tx=0x7f8708009840).stop 2023-10-03T10:10:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.970+0000 7f87153c2700 1 -- 172.21.15.146:0/4103450235 shutdown_connections 2023-10-03T10:10:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.970+0000 7f87153c2700 1 --2- 172.21.15.146:0/4103450235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f871012f980 0x7f8710131d70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.970+0000 7f87153c2700 1 --2- 172.21.15.146:0/4103450235 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87100985e0 0x7f87100989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.970+0000 7f87153c2700 1 --2- 172.21.15.146:0/4103450235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8710098eb0 0x7f871012f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.970+0000 7f87153c2700 1 -- 172.21.15.146:0/4103450235 >> 172.21.15.146:0/4103450235 conn(0x7f871009dc40 msgr2=0x7f871009e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:01.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.970+0000 7f87153c2700 1 -- 172.21.15.146:0/4103450235 shutdown_connections 2023-10-03T10:10:01.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.970+0000 7f87153c2700 1 -- 172.21.15.146:0/4103450235 wait complete. 2023-10-03T10:10:01.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.971+0000 7f87153c2700 1 Processor -- start 2023-10-03T10:10:01.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.971+0000 7f87153c2700 1 -- start start 2023-10-03T10:10:01.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.972+0000 7f87153c2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87100985e0 0x7f871011e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.972+0000 7f87153c2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8710098eb0 0x7f871011a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.972+0000 7f87153c2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f871012f980 0x7f871011a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.972+0000 7f87153c2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871011b8a0 con 0x7f8710098eb0 2023-10-03T10:10:01.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.972+0000 7f87153c2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871012f5b0 con 0x7f87100985e0 2023-10-03T10:10:01.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.972+0000 7f87153c2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f871011cad0 con 0x7f871012f980 2023-10-03T10:10:01.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.972+0000 7f870effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87100985e0 0x7f871011e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.972+0000 7f870e7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8710098eb0 0x7f871011a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.972+0000 7f870f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f871012f980 0x7f871011a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.972+0000 7f870effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87100985e0 0x7f871011e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58780/0 (socket says 172.21.15.146:58780) 2023-10-03T10:10:01.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.972+0000 7f870e7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8710098eb0 0x7f871011a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47310/0 (socket says 172.21.15.146:47310) 2023-10-03T10:10:01.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.972+0000 7f870effd700 1 -- 172.21.15.146:0/3568352988 learned_addr learned my addr 172.21.15.146:0/3568352988 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:01.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.972+0000 7f870e7fc700 1 -- 172.21.15.146:0/3568352988 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f871012f980 msgr2=0x7f871011a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.972+0000 7f870e7fc700 1 --2- 172.21.15.146:0/3568352988 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f871012f980 0x7f871011a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.972+0000 7f870e7fc700 1 -- 172.21.15.146:0/3568352988 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87100985e0 msgr2=0x7f871011e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.972+0000 7f870e7fc700 1 --2- 172.21.15.146:0/3568352988 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87100985e0 0x7f871011e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.972+0000 7f870e7fc700 1 -- 172.21.15.146:0/3568352988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87000092a0 con 0x7f8710098eb0 2023-10-03T10:10:01.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.972+0000 7f870effd700 1 --2- 172.21.15.146:0/3568352988 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87100985e0 0x7f871011e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:01.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.972+0000 7f870e7fc700 1 --2- 172.21.15.146:0/3568352988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8710098eb0 0x7f871011a410 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f870400e980 tx=0x7f8704009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:01.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.972+0000 7f86f6ffd700 1 -- 172.21.15.146:0/3568352988 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8704012600 con 0x7f8710098eb0 2023-10-03T10:10:01.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.972+0000 7f86f6ffd700 1 -- 172.21.15.146:0/3568352988 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8704012760 con 0x7f8710098eb0 2023-10-03T10:10:01.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.972+0000 7f87153c2700 1 -- 172.21.15.146:0/3568352988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87040092a0 con 0x7f8710098eb0 2023-10-03T10:10:01.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.973+0000 7f86f6ffd700 1 -- 172.21.15.146:0/3568352988 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8704012ae0 con 0x7f8710098eb0 2023-10-03T10:10:01.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.973+0000 7f87153c2700 1 -- 172.21.15.146:0/3568352988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8708009ae0 con 0x7f8710098eb0 2023-10-03T10:10:01.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.973+0000 7f86f6ffd700 1 -- 172.21.15.146:0/3568352988 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f870401b400 con 0x7f8710098eb0 2023-10-03T10:10:01.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.973+0000 7f86f6ffd700 1 -- 172.21.15.146:0/3568352988 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f870403b520 con 0x7f8710098eb0 2023-10-03T10:10:01.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.974+0000 7f87153c2700 1 -- 172.21.15.146:0/3568352988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871009ca80 con 0x7f8710098eb0 2023-10-03T10:10:01.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:01.978+0000 7f86f6ffd700 1 -- 172.21.15.146:0/3568352988 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8704019900 con 0x7f8710098eb0 2023-10-03T10:10:02.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.173+0000 7f87153c2700 1 -- 172.21.15.146:0/3568352988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f871005a260 con 0x7f8710098eb0 2023-10-03T10:10:02.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.174+0000 7f86f6ffd700 1 -- 172.21.15.146:0/3568352988 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2158 (secure 0 0 0) 0x7f8704019310 con 0x7f8710098eb0 2023-10-03T10:10:02.175 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:10:02.175 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:48.718228+0000","modified":"2023-10-03T10:09:50.726096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4181":{"gid":4181,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6817/4164614194","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6817","nonce":4164614194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:10:02.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.175+0000 7f87153c2700 1 -- 172.21.15.146:0/3568352988 >> v1:172.21.15.146:6816/118159 conn(0x7f86fc02bb60 legacy=0x7f86fc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.175+0000 7f87153c2700 1 -- 172.21.15.146:0/3568352988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8710098eb0 msgr2=0x7f871011a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.175+0000 7f87153c2700 1 --2- 172.21.15.146:0/3568352988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8710098eb0 0x7f871011a410 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f870400e980 tx=0x7f8704009060).stop 2023-10-03T10:10:02.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.175+0000 7f87153c2700 1 -- 172.21.15.146:0/3568352988 shutdown_connections 2023-10-03T10:10:02.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.175+0000 7f87153c2700 1 --2- 172.21.15.146:0/3568352988 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f871012f980 0x7f871011a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.175+0000 7f87153c2700 1 --2- 172.21.15.146:0/3568352988 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87100985e0 0x7f871011e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.175+0000 7f87153c2700 1 --2- 172.21.15.146:0/3568352988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8710098eb0 0x7f871011a410 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.175+0000 7f87153c2700 1 -- 172.21.15.146:0/3568352988 >> 172.21.15.146:0/3568352988 conn(0x7f871009dc40 msgr2=0x7f8710114300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:02.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.175+0000 7f87153c2700 1 -- 172.21.15.146:0/3568352988 shutdown_connections 2023-10-03T10:10:02.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.176+0000 7f87153c2700 1 -- 172.21.15.146:0/3568352988 wait complete. 2023-10-03T10:10:02.177 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 5 2023-10-03T10:10:02.188 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:10:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.303+0000 7f5e876f2700 1 Processor -- start 2023-10-03T10:10:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.303+0000 7f5e876f2700 1 -- start start 2023-10-03T10:10:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.304+0000 7f5e876f2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e8012b470 0x7f5e8012fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.304+0000 7f5e876f2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e80130390 0x7f5e80132780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.304+0000 7f5e876f2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e80097ac0 con 0x7f5e8005f560 2023-10-03T10:10:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.304+0000 7f5e876f2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8005f940 con 0x7f5e80130390 2023-10-03T10:10:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.304+0000 7f5e876f2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8012ab20 con 0x7f5e8012b470 2023-10-03T10:10:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.304+0000 7f5e85c8f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e80130390 0x7f5e80132780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.304+0000 7f5e8548e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5e8005f560 0x7f5e8012ad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33756/0 (socket says 172.21.15.146:33756) 2023-10-03T10:10:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.304+0000 7f5e8548e700 1 -- 172.21.15.146:0/4250904377 learned_addr learned my addr 172.21.15.146:0/4250904377 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:10:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.304+0000 7f5e84c8d700 1 --2- 172.21.15.146:0/4250904377 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e8012b470 0x7f5e8012fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.304+0000 7f5e77fff700 1 -- 172.21.15.146:0/4250904377 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1720866696 0 0) 0x7f5e80097ac0 con 0x7f5e8005f560 2023-10-03T10:10:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.304+0000 7f5e85c8f700 1 -- 172.21.15.146:0/4250904377 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e8012b470 msgr2=0x7f5e8012fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.304+0000 7f5e85c8f700 1 --2- 172.21.15.146:0/4250904377 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e8012b470 0x7f5e8012fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.304+0000 7f5e85c8f700 1 -- 172.21.15.146:0/4250904377 >> v1:172.21.15.146:6789/0 conn(0x7f5e8005f560 legacy=0x7f5e8012ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.304+0000 7f5e85c8f700 1 -- 172.21.15.146:0/4250904377 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e80066f90 con 0x7f5e80130390 2023-10-03T10:10:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.304+0000 7f5e84c8d700 1 --2- 172.21.15.146:0/4250904377 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e8012b470 0x7f5e8012fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.304+0000 7f5e85c8f700 1 --2- 172.21.15.146:0/4250904377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e80130390 0x7f5e80132780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f5e78009e90 tx=0x7f5e78009780).ready entity=mon.1 client_cookie=b1777fc5f2f00476 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.305+0000 7f5e77fff700 1 -- 172.21.15.146:0/4250904377 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7800e070 con 0x7f5e80130390 2023-10-03T10:10:02.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.305+0000 7f5e77fff700 1 -- 172.21.15.146:0/4250904377 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7800bb00 con 0x7f5e80130390 2023-10-03T10:10:02.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.305+0000 7f5e77fff700 1 -- 172.21.15.146:0/4250904377 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7800be80 con 0x7f5e80130390 2023-10-03T10:10:02.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.305+0000 7f5e876f2700 1 -- 172.21.15.146:0/4250904377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e80130390 msgr2=0x7f5e80132780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.305+0000 7f5e876f2700 1 --2- 172.21.15.146:0/4250904377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e80130390 0x7f5e80132780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f5e78009e90 tx=0x7f5e78009780).stop 2023-10-03T10:10:02.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.305+0000 7f5e876f2700 1 -- 172.21.15.146:0/4250904377 shutdown_connections 2023-10-03T10:10:02.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.305+0000 7f5e876f2700 1 --2- 172.21.15.146:0/4250904377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e80130390 0x7f5e80132780 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.305+0000 7f5e876f2700 1 --2- 172.21.15.146:0/4250904377 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e8012b470 0x7f5e8012fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.305+0000 7f5e876f2700 1 -- 172.21.15.146:0/4250904377 >> 172.21.15.146:0/4250904377 conn(0x7f5e8009a1c0 msgr2=0x7f5e8009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:02.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.305+0000 7f5e876f2700 1 -- 172.21.15.146:0/4250904377 shutdown_connections 2023-10-03T10:10:02.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.305+0000 7f5e876f2700 1 -- 172.21.15.146:0/4250904377 wait complete. 2023-10-03T10:10:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.306+0000 7f5e876f2700 1 Processor -- start 2023-10-03T10:10:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.306+0000 7f5e876f2700 1 -- start start 2023-10-03T10:10:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e876f2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e8005f560 0x7f5e80117570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e876f2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e8012b470 0x7f5e80113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e876f2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e80130390 0x7f5e80113a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e876f2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e80116ad0 con 0x7f5e8005f560 2023-10-03T10:10:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e876f2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e80116730 con 0x7f5e80130390 2023-10-03T10:10:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e876f2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8012a880 con 0x7f5e8012b470 2023-10-03T10:10:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e85c8f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e80130390 0x7f5e80113a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e84c8d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e8012b470 0x7f5e80113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e84c8d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e8012b470 0x7f5e80113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36952/0 (socket says 172.21.15.146:36952) 2023-10-03T10:10:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e8548e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e8005f560 0x7f5e80117570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e85c8f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e80130390 0x7f5e80113a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58800/0 (socket says 172.21.15.146:58800) 2023-10-03T10:10:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e84c8d700 1 -- 172.21.15.146:0/957948944 learned_addr learned my addr 172.21.15.146:0/957948944 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e85c8f700 1 -- 172.21.15.146:0/957948944 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e8012b470 msgr2=0x7f5e80113540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e85c8f700 1 --2- 172.21.15.146:0/957948944 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e8012b470 0x7f5e80113540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e85c8f700 1 -- 172.21.15.146:0/957948944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e8005f560 msgr2=0x7f5e80117570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e85c8f700 1 --2- 172.21.15.146:0/957948944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e8005f560 0x7f5e80117570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e85c8f700 1 -- 172.21.15.146:0/957948944 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c0092a0 con 0x7f5e80130390 2023-10-03T10:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e84c8d700 1 --2- 172.21.15.146:0/957948944 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e8012b470 0x7f5e80113540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e85c8f700 1 --2- 172.21.15.146:0/957948944 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e80130390 0x7f5e80113a30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f5e78014000 tx=0x7f5e80069e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e757fa700 1 -- 172.21.15.146:0/957948944 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e78013e60 con 0x7f5e80130390 2023-10-03T10:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e757fa700 1 -- 172.21.15.146:0/957948944 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7801d630 con 0x7f5e80130390 2023-10-03T10:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e757fa700 1 -- 172.21.15.146:0/957948944 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7801d9d0 con 0x7f5e80130390 2023-10-03T10:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e876f2700 1 -- 172.21.15.146:0/957948944 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e78009a20 con 0x7f5e80130390 2023-10-03T10:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.307+0000 7f5e876f2700 1 -- 172.21.15.146:0/957948944 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e80115160 con 0x7f5e80130390 2023-10-03T10:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.308+0000 7f5e757fa700 1 -- 172.21.15.146:0/957948944 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5e78003040 con 0x7f5e80130390 2023-10-03T10:10:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.308+0000 7f5e757fa700 1 -- 172.21.15.146:0/957948944 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f5e7803ce50 con 0x7f5e80130390 2023-10-03T10:10:02.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.308+0000 7f5e876f2700 1 -- 172.21.15.146:0/957948944 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e80115350 con 0x7f5e80130390 2023-10-03T10:10:02.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.313+0000 7f5e757fa700 1 -- 172.21.15.146:0/957948944 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5e78025dc0 con 0x7f5e80130390 2023-10-03T10:10:02.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.473+0000 7f5e876f2700 1 -- 172.21.15.146:0/957948944 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e8005a260 con 0x7f5e80130390 2023-10-03T10:10:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.474+0000 7f5e757fa700 1 -- 172.21.15.146:0/957948944 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11373 (secure 0 0 0) 0x7f5e78036090 con 0x7f5e80130390 2023-10-03T10:10:02.474 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:10:02.474 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":16,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:09:49.722394+0000","last_up_change":"2023-10-03T10:09:42.301022+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":118758}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":118758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":118758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":118758}]},"public_addr":"172.21.15.146:6800/118758","cluster_addr":"172.21.15.146:6801/118758","heartbeat_back_addr":"172.21.15.146:6803/118758","heartbeat_front_addr":"172.21.15.146:6802/118758","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":118774}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":118774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":118774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":118774}]},"public_addr":"172.21.15.146:6804/118774","cluster_addr":"172.21.15.146:6806/118774","heartbeat_back_addr":"172.21.15.146:6810/118774","heartbeat_front_addr":"172.21.15.146:6808/118774","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":118775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":118775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":118775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":118775}]},"public_addr":"172.21.15.146:6805/118775","cluster_addr":"172.21.15.146:6807/118775","heartbeat_back_addr":"172.21.15.146:6811/118775","heartbeat_front_addr":"172.21.15.146:6809/118775","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":118776}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":118776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":118776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":118776}]},"public_addr":"172.21.15.146:6812/118776","cluster_addr":"172.21.15.146:6813/118776","heartbeat_back_addr":"172.21.15.146:6815/118776","heartbeat_front_addr":"172.21.15.146:6814/118776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:10:02.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.475+0000 7f5e876f2700 1 -- 172.21.15.146:0/957948944 >> v1:172.21.15.146:6816/118159 conn(0x7f5e6402bb60 legacy=0x7f5e6402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.475+0000 7f5e876f2700 1 -- 172.21.15.146:0/957948944 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e80130390 msgr2=0x7f5e80113a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.475+0000 7f5e876f2700 1 --2- 172.21.15.146:0/957948944 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e80130390 0x7f5e80113a30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f5e78014000 tx=0x7f5e80069e20).stop 2023-10-03T10:10:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.476+0000 7f5e876f2700 1 -- 172.21.15.146:0/957948944 shutdown_connections 2023-10-03T10:10:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.476+0000 7f5e876f2700 1 --2- 172.21.15.146:0/957948944 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e80130390 0x7f5e80113a30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.476+0000 7f5e876f2700 1 --2- 172.21.15.146:0/957948944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e8005f560 0x7f5e80117570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.476+0000 7f5e876f2700 1 --2- 172.21.15.146:0/957948944 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e8012b470 0x7f5e80113540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.476+0000 7f5e876f2700 1 -- 172.21.15.146:0/957948944 >> 172.21.15.146:0/957948944 conn(0x7f5e8009a1c0 msgr2=0x7f5e800997c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.476+0000 7f5e876f2700 1 -- 172.21.15.146:0/957948944 shutdown_connections 2023-10-03T10:10:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.476+0000 7f5e876f2700 1 -- 172.21.15.146:0/957948944 wait complete. 2023-10-03T10:10:02.488 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:09:42.343363+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:43.224375+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:47.108480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:47.686814+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-03T10:10:02.488 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:10:02.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.607+0000 7f305937e700 1 Processor -- start 2023-10-03T10:10:02.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.607+0000 7f305937e700 1 -- start start 2023-10-03T10:10:02.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.607+0000 7f305937e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f30540985e0 0x7f30540989c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.607+0000 7f305937e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3054098eb0 0x7f305412f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.607+0000 7f305937e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30540964f0 con 0x7f305412f980 2023-10-03T10:10:02.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.607+0000 7f305937e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305409a3f0 con 0x7f30540985e0 2023-10-03T10:10:02.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.607+0000 7f305937e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3054095100 con 0x7f3054098eb0 2023-10-03T10:10:02.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.607+0000 7f3052ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f30540985e0 0x7f30540989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.607+0000 7f30527fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3054098eb0 0x7f305412f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.607+0000 7f30537fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f305412f980 0x7f3054131d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33770/0 (socket says 172.21.15.146:33770) 2023-10-03T10:10:02.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.607+0000 7f30537fe700 1 -- 172.21.15.146:0/1816861901 learned_addr learned my addr 172.21.15.146:0/1816861901 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:10:02.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.607+0000 7f30527fc700 1 -- 172.21.15.146:0/1816861901 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f30540985e0 msgr2=0x7f30540989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:02.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.607+0000 7f30527fc700 1 --2- 172.21.15.146:0/1816861901 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f30540985e0 0x7f30540989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.608+0000 7f30527fc700 1 -- 172.21.15.146:0/1816861901 >> v1:172.21.15.146:6789/0 conn(0x7f305412f980 legacy=0x7f3054131d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.608+0000 7f3051ffb700 1 -- 172.21.15.146:0/1816861901 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 395310920 0 0) 0x7f30540964f0 con 0x7f305412f980 2023-10-03T10:10:02.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.608+0000 7f30527fc700 1 -- 172.21.15.146:0/1816861901 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3054099e70 con 0x7f3054098eb0 2023-10-03T10:10:02.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.608+0000 7f3052ffd700 1 --2- 172.21.15.146:0/1816861901 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f30540985e0 0x7f30540989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:02.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.608+0000 7f30527fc700 1 --2- 172.21.15.146:0/1816861901 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3054098eb0 0x7f305412f490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f30440097c0 tx=0x7f3044009060).ready entity=mon.2 client_cookie=5e7e8af091aee431 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:02.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.608+0000 7f3051ffb700 1 -- 172.21.15.146:0/1816861901 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30440090d0 con 0x7f3054098eb0 2023-10-03T10:10:02.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.608+0000 7f3051ffb700 1 -- 172.21.15.146:0/1816861901 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304400f510 con 0x7f3054098eb0 2023-10-03T10:10:02.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.608+0000 7f3051ffb700 1 -- 172.21.15.146:0/1816861901 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304400f890 con 0x7f3054098eb0 2023-10-03T10:10:02.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.608+0000 7f305937e700 1 -- 172.21.15.146:0/1816861901 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3054098eb0 msgr2=0x7f305412f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.608+0000 7f305937e700 1 --2- 172.21.15.146:0/1816861901 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3054098eb0 0x7f305412f490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f30440097c0 tx=0x7f3044009060).stop 2023-10-03T10:10:02.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.608+0000 7f305937e700 1 -- 172.21.15.146:0/1816861901 shutdown_connections 2023-10-03T10:10:02.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.608+0000 7f305937e700 1 --2- 172.21.15.146:0/1816861901 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f30540985e0 0x7f30540989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.608+0000 7f305937e700 1 --2- 172.21.15.146:0/1816861901 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3054098eb0 0x7f305412f490 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.608+0000 7f305937e700 1 -- 172.21.15.146:0/1816861901 >> 172.21.15.146:0/1816861901 conn(0x7f305409dc40 msgr2=0x7f305409e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:02.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.608+0000 7f305937e700 1 -- 172.21.15.146:0/1816861901 shutdown_connections 2023-10-03T10:10:02.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.608+0000 7f305937e700 1 -- 172.21.15.146:0/1816861901 wait complete. 2023-10-03T10:10:02.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.610+0000 7f305937e700 1 Processor -- start 2023-10-03T10:10:02.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.610+0000 7f305937e700 1 -- start start 2023-10-03T10:10:02.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.610+0000 7f305937e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30540985e0 0x7f305411a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.610+0000 7f305937e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3054098eb0 0x7f305411aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.610+0000 7f305937e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f305412f980 0x7f305411aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.610+0000 7f305937e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305411b3e0 con 0x7f30540985e0 2023-10-03T10:10:02.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.610+0000 7f305937e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305411b9a0 con 0x7f3054098eb0 2023-10-03T10:10:02.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.610+0000 7f305937e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f305409a0f0 con 0x7f305412f980 2023-10-03T10:10:02.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.610+0000 7f30527fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3054098eb0 0x7f305411aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.610+0000 7f30527fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3054098eb0 0x7f305411aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58826/0 (socket says 172.21.15.146:58826) 2023-10-03T10:10:02.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.610+0000 7f30537fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f305412f980 0x7f305411aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.610+0000 7f30527fc700 1 -- 172.21.15.146:0/1765595771 learned_addr learned my addr 172.21.15.146:0/1765595771 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:02.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.610+0000 7f3052ffd700 1 --2- 172.21.15.146:0/1765595771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30540985e0 0x7f305411a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.611+0000 7f30527fc700 1 -- 172.21.15.146:0/1765595771 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f305412f980 msgr2=0x7f305411aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.611+0000 7f30527fc700 1 --2- 172.21.15.146:0/1765595771 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f305412f980 0x7f305411aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.611+0000 7f30527fc700 1 -- 172.21.15.146:0/1765595771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30540985e0 msgr2=0x7f305411a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.611+0000 7f30527fc700 1 --2- 172.21.15.146:0/1765595771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30540985e0 0x7f305411a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.611+0000 7f30527fc700 1 -- 172.21.15.146:0/1765595771 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30480092a0 con 0x7f3054098eb0 2023-10-03T10:10:02.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.611+0000 7f30537fe700 1 --2- 172.21.15.146:0/1765595771 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f305412f980 0x7f305411aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:02.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.611+0000 7f3052ffd700 1 --2- 172.21.15.146:0/1765595771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30540985e0 0x7f305411a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:02.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.611+0000 7f30527fc700 1 --2- 172.21.15.146:0/1765595771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3054098eb0 0x7f305411aa00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3054095290 tx=0x7f3044017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:02.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.611+0000 7f303affd700 1 -- 172.21.15.146:0/1765595771 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304400f890 con 0x7f3054098eb0 2023-10-03T10:10:02.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.611+0000 7f303affd700 1 -- 172.21.15.146:0/1765595771 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304400fc50 con 0x7f3054098eb0 2023-10-03T10:10:02.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.611+0000 7f303affd700 1 -- 172.21.15.146:0/1765595771 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304401b410 con 0x7f3054098eb0 2023-10-03T10:10:02.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.611+0000 7f305937e700 1 -- 172.21.15.146:0/1765595771 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30440092a0 con 0x7f3054098eb0 2023-10-03T10:10:02.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.611+0000 7f305937e700 1 -- 172.21.15.146:0/1765595771 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305411da00 con 0x7f3054098eb0 2023-10-03T10:10:02.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.612+0000 7f303affd700 1 -- 172.21.15.146:0/1765595771 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f304401b7c0 con 0x7f3054098eb0 2023-10-03T10:10:02.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.612+0000 7f303affd700 1 -- 172.21.15.146:0/1765595771 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f304403c870 con 0x7f3054098eb0 2023-10-03T10:10:02.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.612+0000 7f305937e700 1 -- 172.21.15.146:0/1765595771 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f305409cdf0 con 0x7f3054098eb0 2023-10-03T10:10:02.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.616+0000 7f303affd700 1 -- 172.21.15.146:0/1765595771 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3044029080 con 0x7f3054098eb0 2023-10-03T10:10:02.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.775+0000 7f305937e700 1 -- 172.21.15.146:0/1765595771 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f305411ddc0 con 0x7f3054098eb0 2023-10-03T10:10:02.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.776+0000 7f303affd700 1 -- 172.21.15.146:0/1765595771 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v16) v1 ==== 110+0+10 (secure 0 0 0) 0x7f304401f020 con 0x7f3054098eb0 2023-10-03T10:10:02.777 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-03T10:10:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.777+0000 7f305937e700 1 -- 172.21.15.146:0/1765595771 >> v1:172.21.15.146:6816/118159 conn(0x7f304002bb60 legacy=0x7f304002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.777+0000 7f305937e700 1 -- 172.21.15.146:0/1765595771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3054098eb0 msgr2=0x7f305411aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.777+0000 7f305937e700 1 --2- 172.21.15.146:0/1765595771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3054098eb0 0x7f305411aa00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3054095290 tx=0x7f3044017000).stop 2023-10-03T10:10:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.778+0000 7f305937e700 1 -- 172.21.15.146:0/1765595771 shutdown_connections 2023-10-03T10:10:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.778+0000 7f305937e700 1 --2- 172.21.15.146:0/1765595771 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f305412f980 0x7f305411aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.778+0000 7f305937e700 1 --2- 172.21.15.146:0/1765595771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30540985e0 0x7f305411a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.778+0000 7f305937e700 1 --2- 172.21.15.146:0/1765595771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3054098eb0 0x7f305411aa00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.778+0000 7f305937e700 1 -- 172.21.15.146:0/1765595771 >> 172.21.15.146:0/1765595771 conn(0x7f305409dc40 msgr2=0x7f3054114300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.778+0000 7f305937e700 1 -- 172.21.15.146:0/1765595771 shutdown_connections 2023-10-03T10:10:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.778+0000 7f305937e700 1 -- 172.21.15.146:0/1765595771 wait complete. 2023-10-03T10:10:02.790 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:10:02.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.908+0000 7fad07d04700 1 Processor -- start 2023-10-03T10:10:02.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.908+0000 7fad07d04700 1 -- start start 2023-10-03T10:10:02.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.908+0000 7fad07d04700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fad0005f560 0x7fad0012ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.908+0000 7fad07d04700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad0012b250 0x7fad0012b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.908+0000 7fad07d04700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad00095d90 0x7fad000961f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.908+0000 7fad07d04700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0005f940 con 0x7fad0005f560 2023-10-03T10:10:02.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.908+0000 7fad07d04700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad00097ac0 con 0x7fad00095d90 2023-10-03T10:10:02.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.908+0000 7fad07d04700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad00066f90 con 0x7fad0012b250 2023-10-03T10:10:02.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.908+0000 7fad062a1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad00095d90 0x7fad000961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.908+0000 7fad0529f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad0012b250 0x7fad0012b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.908+0000 7fad05aa0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fad0005f560 0x7fad0012ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.908+0000 7fad062a1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad00095d90 0x7fad000961f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58838/0 (socket says 172.21.15.146:58838) 2023-10-03T10:10:02.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.908+0000 7fad062a1700 1 -- 172.21.15.146:0/209583781 learned_addr learned my addr 172.21.15.146:0/209583781 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:02.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.909+0000 7fad0529f700 1 -- 172.21.15.146:0/209583781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad00095d90 msgr2=0x7fad000961f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:02.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.909+0000 7fad0529f700 1 --2- 172.21.15.146:0/209583781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad00095d90 0x7fad000961f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.909+0000 7fad0529f700 1 -- 172.21.15.146:0/209583781 >> v2:172.21.15.146:3300/0 conn(0x7fad0005f560 msgr2=0x7fad0012ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:02.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.909+0000 7fad0529f700 1 --2- 172.21.15.146:0/209583781 >> v2:172.21.15.146:3300/0 conn(0x7fad0005f560 0x7fad0012ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.909+0000 7fad0529f700 1 -- 172.21.15.146:0/209583781 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0012ab20 con 0x7fad0012b250 2023-10-03T10:10:02.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.909+0000 7fad05aa0700 1 --2- 172.21.15.146:0/209583781 >> v2:172.21.15.146:3300/0 conn(0x7fad0005f560 0x7fad0012ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:02.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.909+0000 7fad062a1700 1 --2- 172.21.15.146:0/209583781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad00095d90 0x7fad000961f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:02.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.909+0000 7fad0529f700 1 --2- 172.21.15.146:0/209583781 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad0012b250 0x7fad0012b650 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7facfc009790 tx=0x7facfc009060).ready entity=mon.2 client_cookie=c69af1e8b29742ea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:02.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.909+0000 7fad04a9e700 1 -- 172.21.15.146:0/209583781 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc00d4a0 con 0x7fad0012b250 2023-10-03T10:10:02.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.909+0000 7fad04a9e700 1 -- 172.21.15.146:0/209583781 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc00d600 con 0x7fad0012b250 2023-10-03T10:10:02.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.909+0000 7fad04a9e700 1 -- 172.21.15.146:0/209583781 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc00d980 con 0x7fad0012b250 2023-10-03T10:10:02.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.910+0000 7fad07d04700 1 -- 172.21.15.146:0/209583781 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad0012b250 msgr2=0x7fad0012b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.910+0000 7fad07d04700 1 --2- 172.21.15.146:0/209583781 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad0012b250 0x7fad0012b650 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7facfc009790 tx=0x7facfc009060).stop 2023-10-03T10:10:02.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.910+0000 7fad07d04700 1 -- 172.21.15.146:0/209583781 shutdown_connections 2023-10-03T10:10:02.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.910+0000 7fad07d04700 1 --2- 172.21.15.146:0/209583781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad00095d90 0x7fad000961f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.910+0000 7fad07d04700 1 --2- 172.21.15.146:0/209583781 >> v2:172.21.15.146:3300/0 conn(0x7fad0005f560 0x7fad0012ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.910+0000 7fad07d04700 1 --2- 172.21.15.146:0/209583781 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad0012b250 0x7fad0012b650 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.910+0000 7fad07d04700 1 -- 172.21.15.146:0/209583781 >> 172.21.15.146:0/209583781 conn(0x7fad0009a1c0 msgr2=0x7fad0009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:02.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.910+0000 7fad07d04700 1 -- 172.21.15.146:0/209583781 shutdown_connections 2023-10-03T10:10:02.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.910+0000 7fad07d04700 1 -- 172.21.15.146:0/209583781 wait complete. 2023-10-03T10:10:02.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.910+0000 7fad07d04700 1 Processor -- start 2023-10-03T10:10:02.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.911+0000 7fad07d04700 1 -- start start 2023-10-03T10:10:02.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.911+0000 7fad07d04700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad0005f560 0x7fad00128400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.911+0000 7fad07d04700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad00095d90 0x7fad00117390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.911+0000 7fad07d04700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad0012b250 0x7fad00117880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.911+0000 7fad07d04700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad00129510 con 0x7fad00095d90 2023-10-03T10:10:02.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.911+0000 7fad07d04700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad000671c0 con 0x7fad0005f560 2023-10-03T10:10:02.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.911+0000 7fad07d04700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad0011b430 con 0x7fad0012b250 2023-10-03T10:10:02.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.911+0000 7fad05aa0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad0005f560 0x7fad00128400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.911+0000 7fad05aa0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad0005f560 0x7fad00128400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58846/0 (socket says 172.21.15.146:58846) 2023-10-03T10:10:02.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.911+0000 7fad05aa0700 1 -- 172.21.15.146:0/1269875111 learned_addr learned my addr 172.21.15.146:0/1269875111 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:02.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.911+0000 7fad062a1700 1 --2- 172.21.15.146:0/1269875111 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad0012b250 0x7fad00117880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.911+0000 7fad0529f700 1 --2- 172.21.15.146:0/1269875111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad00095d90 0x7fad00117390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.911+0000 7fad05aa0700 1 -- 172.21.15.146:0/1269875111 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad0012b250 msgr2=0x7fad00117880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.911+0000 7fad05aa0700 1 --2- 172.21.15.146:0/1269875111 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad0012b250 0x7fad00117880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.911+0000 7fad05aa0700 1 -- 172.21.15.146:0/1269875111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad00095d90 msgr2=0x7fad00117390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.911+0000 7fad05aa0700 1 --2- 172.21.15.146:0/1269875111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad00095d90 0x7fad00117390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.911+0000 7fad05aa0700 1 -- 172.21.15.146:0/1269875111 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf40092a0 con 0x7fad0005f560 2023-10-03T10:10:02.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.911+0000 7fad05aa0700 1 --2- 172.21.15.146:0/1269875111 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad0005f560 0x7fad00128400 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7facf400ea50 tx=0x7facf4009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:02.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.912+0000 7facf1ffb700 1 -- 172.21.15.146:0/1269875111 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf400ee90 con 0x7fad0005f560 2023-10-03T10:10:02.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.912+0000 7facf1ffb700 1 -- 172.21.15.146:0/1269875111 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf400c850 con 0x7fad0005f560 2023-10-03T10:10:02.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.912+0000 7fad07d04700 1 -- 172.21.15.146:0/1269875111 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf8009ae0 con 0x7fad0005f560 2023-10-03T10:10:02.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.912+0000 7facf1ffb700 1 -- 172.21.15.146:0/1269875111 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf400cbd0 con 0x7fad0005f560 2023-10-03T10:10:02.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.912+0000 7fad07d04700 1 -- 172.21.15.146:0/1269875111 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facfc0092a0 con 0x7fad0005f560 2023-10-03T10:10:02.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.912+0000 7facf1ffb700 1 -- 172.21.15.146:0/1269875111 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7facf401b400 con 0x7fad0005f560 2023-10-03T10:10:02.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.913+0000 7facf1ffb700 1 -- 172.21.15.146:0/1269875111 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7facf403b540 con 0x7fad0005f560 2023-10-03T10:10:02.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.913+0000 7fad07d04700 1 -- 172.21.15.146:0/1269875111 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0005a260 con 0x7fad0005f560 2023-10-03T10:10:02.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:02.917+0000 7facf1ffb700 1 -- 172.21.15.146:0/1269875111 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7facf401be60 con 0x7fad0005f560 2023-10-03T10:10:03.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.074+0000 7fad07d04700 1 -- 172.21.15.146:0/1269875111 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fad001289a0 con 0x7fad0005f560 2023-10-03T10:10:03.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.074+0000 7facf1ffb700 1 -- 172.21.15.146:0/1269875111 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7facf401be60 con 0x7fad0005f560 2023-10-03T10:10:03.075 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-03T10:10:03.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.076+0000 7fad07d04700 1 -- 172.21.15.146:0/1269875111 >> v1:172.21.15.146:6816/118159 conn(0x7face402bb60 legacy=0x7face402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.076+0000 7fad07d04700 1 -- 172.21.15.146:0/1269875111 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad0005f560 msgr2=0x7fad00128400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.076+0000 7fad07d04700 1 --2- 172.21.15.146:0/1269875111 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad0005f560 0x7fad00128400 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7facf400ea50 tx=0x7facf4009060).stop 2023-10-03T10:10:03.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.076+0000 7fad07d04700 1 -- 172.21.15.146:0/1269875111 shutdown_connections 2023-10-03T10:10:03.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.076+0000 7fad07d04700 1 --2- 172.21.15.146:0/1269875111 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad0012b250 0x7fad00117880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.076+0000 7fad07d04700 1 --2- 172.21.15.146:0/1269875111 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad0005f560 0x7fad00128400 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.076+0000 7fad07d04700 1 --2- 172.21.15.146:0/1269875111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad00095d90 0x7fad00117390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.076+0000 7fad07d04700 1 -- 172.21.15.146:0/1269875111 >> 172.21.15.146:0/1269875111 conn(0x7fad0009a1c0 msgr2=0x7fad00098620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:03.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.077+0000 7fad07d04700 1 -- 172.21.15.146:0/1269875111 shutdown_connections 2023-10-03T10:10:03.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.077+0000 7fad07d04700 1 -- 172.21.15.146:0/1269875111 wait complete. 2023-10-03T10:10:03.089 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:10:03.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.206+0000 7fb32bd60700 1 Processor -- start 2023-10-03T10:10:03.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.206+0000 7fb32bd60700 1 -- start start 2023-10-03T10:10:03.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.207+0000 7fb32bd60700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb324097790 0x7fb32412b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.207+0000 7fb32bd60700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb324127c70 0x7fb3241280e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.207+0000 7fb32bd60700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb32412ae10 con 0x7fb32412b540 2023-10-03T10:10:03.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.207+0000 7fb32bd60700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb32412b940 con 0x7fb324127c70 2023-10-03T10:10:03.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.207+0000 7fb32bd60700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb324064b30 con 0x7fb324097790 2023-10-03T10:10:03.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.207+0000 7fb32a2fd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb324127c70 0x7fb3241280e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.207+0000 7fb329afc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb324097790 0x7fb32412b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.207+0000 7fb32a2fd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb324127c70 0x7fb3241280e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47380/0 (socket says 172.21.15.146:47380) 2023-10-03T10:10:03.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.207+0000 7fb329afc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb324097790 0x7fb32412b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37006/0 (socket says 172.21.15.146:37006) 2023-10-03T10:10:03.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.207+0000 7fb3292fb700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb32412b540 0x7fb324127560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33780/0 (socket says 172.21.15.146:33780) 2023-10-03T10:10:03.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.207+0000 7fb32a2fd700 1 -- 172.21.15.146:0/3322683680 learned_addr learned my addr 172.21.15.146:0/3322683680 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:03.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.207+0000 7fb329afc700 1 -- 172.21.15.146:0/3322683680 >> v2:172.21.15.146:3300/0 conn(0x7fb324127c70 msgr2=0x7fb3241280e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:03.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.207+0000 7fb329afc700 1 --2- 172.21.15.146:0/3322683680 >> v2:172.21.15.146:3300/0 conn(0x7fb324127c70 0x7fb3241280e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.207+0000 7fb329afc700 1 -- 172.21.15.146:0/3322683680 >> v1:172.21.15.146:6789/0 conn(0x7fb32412b540 legacy=0x7fb324127560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.207+0000 7fb329afc700 1 -- 172.21.15.146:0/3322683680 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb324065750 con 0x7fb324097790 2023-10-03T10:10:03.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.207+0000 7fb328afa700 1 -- 172.21.15.146:0/3322683680 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511610645 0 0) 0x7fb320001110 con 0x7fb32412b540 2023-10-03T10:10:03.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.207+0000 7fb32a2fd700 1 --2- 172.21.15.146:0/3322683680 >> v2:172.21.15.146:3300/0 conn(0x7fb324127c70 0x7fb3241280e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:03.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.207+0000 7fb329afc700 1 --2- 172.21.15.146:0/3322683680 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb324097790 0x7fb32412b050 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fb314009760 tx=0x7fb314009060).ready entity=mon.2 client_cookie=ad2310e5fdcb5345 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:03.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.208+0000 7fb328afa700 1 -- 172.21.15.146:0/3322683680 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31400f510 con 0x7fb324097790 2023-10-03T10:10:03.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.208+0000 7fb328afa700 1 -- 172.21.15.146:0/3322683680 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31400f670 con 0x7fb324097790 2023-10-03T10:10:03.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.208+0000 7fb328afa700 1 -- 172.21.15.146:0/3322683680 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31400f9f0 con 0x7fb324097790 2023-10-03T10:10:03.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.208+0000 7fb32bd60700 1 -- 172.21.15.146:0/3322683680 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb324097790 msgr2=0x7fb32412b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.208+0000 7fb32bd60700 1 --2- 172.21.15.146:0/3322683680 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb324097790 0x7fb32412b050 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fb314009760 tx=0x7fb314009060).stop 2023-10-03T10:10:03.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.208+0000 7fb32bd60700 1 -- 172.21.15.146:0/3322683680 shutdown_connections 2023-10-03T10:10:03.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.208+0000 7fb32bd60700 1 --2- 172.21.15.146:0/3322683680 >> v2:172.21.15.146:3300/0 conn(0x7fb324127c70 0x7fb3241280e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.208+0000 7fb32bd60700 1 --2- 172.21.15.146:0/3322683680 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb324097790 0x7fb32412b050 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.208+0000 7fb32bd60700 1 -- 172.21.15.146:0/3322683680 >> 172.21.15.146:0/3322683680 conn(0x7fb32409bad0 msgr2=0x7fb32409bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:03.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.208+0000 7fb32bd60700 1 -- 172.21.15.146:0/3322683680 shutdown_connections 2023-10-03T10:10:03.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.208+0000 7fb32bd60700 1 -- 172.21.15.146:0/3322683680 wait complete. 2023-10-03T10:10:03.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.209+0000 7fb32bd60700 1 Processor -- start 2023-10-03T10:10:03.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.209+0000 7fb32bd60700 1 -- start start 2023-10-03T10:10:03.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.210+0000 7fb32bd60700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb324097790 0x7fb324124cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.210+0000 7fb32bd60700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb324127c70 0x7fb324113e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.210+0000 7fb32bd60700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb32412b540 0x7fb324114300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.210+0000 7fb32bd60700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32412a2d0 con 0x7fb32412b540 2023-10-03T10:10:03.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.210+0000 7fb32bd60700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb324115210 con 0x7fb324097790 2023-10-03T10:10:03.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.210+0000 7fb32bd60700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3241171a0 con 0x7fb324127c70 2023-10-03T10:10:03.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.210+0000 7fb329afc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb324097790 0x7fb324124cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.210+0000 7fb3292fb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb324127c70 0x7fb324113e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.210+0000 7fb329afc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb324097790 0x7fb324124cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58858/0 (socket says 172.21.15.146:58858) 2023-10-03T10:10:03.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.210+0000 7fb3292fb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb324127c70 0x7fb324113e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37014/0 (socket says 172.21.15.146:37014) 2023-10-03T10:10:03.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.210+0000 7fb32a2fd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb32412b540 0x7fb324114300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.210+0000 7fb329afc700 1 -- 172.21.15.146:0/2672540939 learned_addr learned my addr 172.21.15.146:0/2672540939 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:03.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.210+0000 7fb329afc700 1 -- 172.21.15.146:0/2672540939 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb324127c70 msgr2=0x7fb324113e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.210+0000 7fb329afc700 1 --2- 172.21.15.146:0/2672540939 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb324127c70 0x7fb324113e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.210+0000 7fb329afc700 1 -- 172.21.15.146:0/2672540939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb32412b540 msgr2=0x7fb324114300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.210+0000 7fb329afc700 1 --2- 172.21.15.146:0/2672540939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb32412b540 0x7fb324114300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.210+0000 7fb329afc700 1 -- 172.21.15.146:0/2672540939 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c009ae0 con 0x7fb324097790 2023-10-03T10:10:03.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.211+0000 7fb3292fb700 1 --2- 172.21.15.146:0/2672540939 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb324127c70 0x7fb324113e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:03.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.211+0000 7fb32a2fd700 1 --2- 172.21.15.146:0/2672540939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb32412b540 0x7fb324114300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:03.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.211+0000 7fb329afc700 1 --2- 172.21.15.146:0/2672540939 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb324097790 0x7fb324124cd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb314009e00 tx=0x7fb314017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:03.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.211+0000 7fb319ffb700 1 -- 172.21.15.146:0/2672540939 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31400fe80 con 0x7fb324097790 2023-10-03T10:10:03.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.211+0000 7fb319ffb700 1 -- 172.21.15.146:0/2672540939 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31400f7e0 con 0x7fb324097790 2023-10-03T10:10:03.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.211+0000 7fb32bd60700 1 -- 172.21.15.146:0/2672540939 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3140092a0 con 0x7fb324097790 2023-10-03T10:10:03.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.211+0000 7fb319ffb700 1 -- 172.21.15.146:0/2672540939 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31401b640 con 0x7fb324097790 2023-10-03T10:10:03.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.211+0000 7fb32bd60700 1 -- 172.21.15.146:0/2672540939 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb324115fb0 con 0x7fb324097790 2023-10-03T10:10:03.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.212+0000 7fb319ffb700 1 -- 172.21.15.146:0/2672540939 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb31401ba70 con 0x7fb324097790 2023-10-03T10:10:03.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.212+0000 7fb319ffb700 1 -- 172.21.15.146:0/2672540939 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb31403c8b0 con 0x7fb324097790 2023-10-03T10:10:03.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.212+0000 7fb32bd60700 1 -- 172.21.15.146:0/2672540939 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32405a260 con 0x7fb324097790 2023-10-03T10:10:03.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.216+0000 7fb319ffb700 1 -- 172.21.15.146:0/2672540939 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb314029080 con 0x7fb324097790 2023-10-03T10:10:03.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.375+0000 7fb32bd60700 1 -- 172.21.15.146:0/2672540939 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb3241173a0 con 0x7fb324097790 2023-10-03T10:10:03.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.375+0000 7fb319ffb700 1 -- 172.21.15.146:0/2672540939 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v16) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb31401f020 con 0x7fb324097790 2023-10-03T10:10:03.376 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-03T10:10:03.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.377+0000 7fb32bd60700 1 -- 172.21.15.146:0/2672540939 >> v1:172.21.15.146:6816/118159 conn(0x7fb30802bb60 legacy=0x7fb30802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.377+0000 7fb32bd60700 1 -- 172.21.15.146:0/2672540939 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb324097790 msgr2=0x7fb324124cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.377+0000 7fb32bd60700 1 --2- 172.21.15.146:0/2672540939 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb324097790 0x7fb324124cd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb314009e00 tx=0x7fb314017000).stop 2023-10-03T10:10:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.377+0000 7fb32bd60700 1 -- 172.21.15.146:0/2672540939 shutdown_connections 2023-10-03T10:10:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.377+0000 7fb32bd60700 1 --2- 172.21.15.146:0/2672540939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb32412b540 0x7fb324114300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.377+0000 7fb32bd60700 1 --2- 172.21.15.146:0/2672540939 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb324097790 0x7fb324124cd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.377+0000 7fb32bd60700 1 --2- 172.21.15.146:0/2672540939 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb324127c70 0x7fb324113e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.377+0000 7fb32bd60700 1 -- 172.21.15.146:0/2672540939 >> 172.21.15.146:0/2672540939 conn(0x7fb32409bad0 msgr2=0x7fb3241298d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.377+0000 7fb32bd60700 1 -- 172.21.15.146:0/2672540939 shutdown_connections 2023-10-03T10:10:03.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.377+0000 7fb32bd60700 1 -- 172.21.15.146:0/2672540939 wait complete. 2023-10-03T10:10:03.389 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:10:03.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.507+0000 7f8715234700 1 Processor -- start 2023-10-03T10:10:03.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.507+0000 7f8715234700 1 -- start start 2023-10-03T10:10:03.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.508+0000 7f8715234700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8710093950 0x7f8710095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.508+0000 7f8715234700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f871012d250 0x7f871012f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.508+0000 7f8715234700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8710094ba0 con 0x7f8710095c50 2023-10-03T10:10:03.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.508+0000 7f8715234700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8710092e90 con 0x7f871012d250 2023-10-03T10:10:03.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.508+0000 7f8715234700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8710096b60 con 0x7f8710093950 2023-10-03T10:10:03.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.508+0000 7f870ed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8710093950 0x7f8710095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.508+0000 7f870f59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f871012d250 0x7f871012f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.508+0000 7f870f59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f871012d250 0x7f871012f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47394/0 (socket says 172.21.15.146:47394) 2023-10-03T10:10:03.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.508+0000 7f870ed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8710093950 0x7f8710095760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58872/0 (socket says 172.21.15.146:58872) 2023-10-03T10:10:03.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.508+0000 7f870f59e700 1 -- 172.21.15.146:0/3734910572 learned_addr learned my addr 172.21.15.146:0/3734910572 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:03.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.508+0000 7f870e59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8710095c50 0x7f8710096030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33788/0 (socket says 172.21.15.146:33788) 2023-10-03T10:10:03.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.508+0000 7f870f59e700 1 -- 172.21.15.146:0/3734910572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8710093950 msgr2=0x7f8710095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:03.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.508+0000 7f870f59e700 1 --2- 172.21.15.146:0/3734910572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8710093950 0x7f8710095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.508+0000 7f870f59e700 1 -- 172.21.15.146:0/3734910572 >> v1:172.21.15.146:6789/0 conn(0x7f8710095c50 legacy=0x7f8710096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.508+0000 7f870f59e700 1 -- 172.21.15.146:0/3734910572 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8710093150 con 0x7f871012d250 2023-10-03T10:10:03.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.508+0000 7f870ed9d700 1 --2- 172.21.15.146:0/3734910572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8710093950 0x7f8710095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:03.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.508+0000 7f870dd9b700 1 -- 172.21.15.146:0/3734910572 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953705308 0 0) 0x7f8710094ba0 con 0x7f8710095c50 2023-10-03T10:10:03.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.508+0000 7f870f59e700 1 --2- 172.21.15.146:0/3734910572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f871012d250 0x7f871012f640 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f870800d1a0 tx=0x7f870800ba50).ready entity=mon.0 client_cookie=abc7c93e63bde4f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:03.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.509+0000 7f870dd9b700 1 -- 172.21.15.146:0/3734910572 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708010070 con 0x7f871012d250 2023-10-03T10:10:03.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.509+0000 7f870dd9b700 1 -- 172.21.15.146:0/3734910572 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870800de10 con 0x7f871012d250 2023-10-03T10:10:03.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.509+0000 7f870dd9b700 1 -- 172.21.15.146:0/3734910572 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870800b2e0 con 0x7f871012d250 2023-10-03T10:10:03.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.509+0000 7f8715234700 1 -- 172.21.15.146:0/3734910572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f871012d250 msgr2=0x7f871012f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.509+0000 7f8715234700 1 --2- 172.21.15.146:0/3734910572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f871012d250 0x7f871012f640 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f870800d1a0 tx=0x7f870800ba50).stop 2023-10-03T10:10:03.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.509+0000 7f8715234700 1 -- 172.21.15.146:0/3734910572 shutdown_connections 2023-10-03T10:10:03.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.509+0000 7f8715234700 1 --2- 172.21.15.146:0/3734910572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f871012d250 0x7f871012f640 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.509+0000 7f8715234700 1 --2- 172.21.15.146:0/3734910572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8710093950 0x7f8710095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.509+0000 7f8715234700 1 -- 172.21.15.146:0/3734910572 >> 172.21.15.146:0/3734910572 conn(0x7f871009aa50 msgr2=0x7f871009ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:03.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.509+0000 7f8715234700 1 -- 172.21.15.146:0/3734910572 shutdown_connections 2023-10-03T10:10:03.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.509+0000 7f8715234700 1 -- 172.21.15.146:0/3734910572 wait complete. 2023-10-03T10:10:03.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.510+0000 7f8715234700 1 Processor -- start 2023-10-03T10:10:03.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.510+0000 7f8715234700 1 -- start start 2023-10-03T10:10:03.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.510+0000 7f8715234700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8710093950 0x7f871011dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.510+0000 7f8715234700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8710095c50 0x7f8710119d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.511+0000 7f8715234700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f871012d250 0x7f871011a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.511+0000 7f8715234700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871012ce60 con 0x7f8710095c50 2023-10-03T10:10:03.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.511+0000 7f8715234700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871011c3a0 con 0x7f871012d250 2023-10-03T10:10:03.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.511+0000 7f8715234700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f871011d240 con 0x7f8710093950 2023-10-03T10:10:03.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.511+0000 7f870ed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8710093950 0x7f871011dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.511+0000 7f870f59e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f871012d250 0x7f871011a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.511+0000 7f870e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8710095c50 0x7f8710119d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.511+0000 7f870ed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8710093950 0x7f871011dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37026/0 (socket says 172.21.15.146:37026) 2023-10-03T10:10:03.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.511+0000 7f870f59e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f871012d250 0x7f871011a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58880/0 (socket says 172.21.15.146:58880) 2023-10-03T10:10:03.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.511+0000 7f870ed9d700 1 -- 172.21.15.146:0/1748131801 learned_addr learned my addr 172.21.15.146:0/1748131801 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:03.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.511+0000 7f870ed9d700 1 -- 172.21.15.146:0/1748131801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f871012d250 msgr2=0x7f871011a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.511+0000 7f870ed9d700 1 --2- 172.21.15.146:0/1748131801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f871012d250 0x7f871011a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.511+0000 7f870ed9d700 1 -- 172.21.15.146:0/1748131801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8710095c50 msgr2=0x7f8710119d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.511+0000 7f870ed9d700 1 --2- 172.21.15.146:0/1748131801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8710095c50 0x7f8710119d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.511+0000 7f870ed9d700 1 -- 172.21.15.146:0/1748131801 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87040092a0 con 0x7f8710093950 2023-10-03T10:10:03.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.511+0000 7f870f59e700 1 --2- 172.21.15.146:0/1748131801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f871012d250 0x7f871011a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:03.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.511+0000 7f870ed9d700 1 --2- 172.21.15.146:0/1748131801 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8710093950 0x7f871011dce0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f870400ea20 tx=0x7f8704009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:03.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.511+0000 7f86f6ffd700 1 -- 172.21.15.146:0/1748131801 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870400ee60 con 0x7f8710093950 2023-10-03T10:10:03.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.511+0000 7f86f6ffd700 1 -- 172.21.15.146:0/1748131801 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870400c7f0 con 0x7f8710093950 2023-10-03T10:10:03.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.511+0000 7f86f6ffd700 1 -- 172.21.15.146:0/1748131801 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870400cb70 con 0x7f8710093950 2023-10-03T10:10:03.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.511+0000 7f8715234700 1 -- 172.21.15.146:0/1748131801 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870800bcf0 con 0x7f8710093950 2023-10-03T10:10:03.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.511+0000 7f8715234700 1 -- 172.21.15.146:0/1748131801 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871011b140 con 0x7f8710093950 2023-10-03T10:10:03.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.512+0000 7f86f6ffd700 1 -- 172.21.15.146:0/1748131801 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f870401b400 con 0x7f8710093950 2023-10-03T10:10:03.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.512+0000 7f86f6ffd700 1 -- 172.21.15.146:0/1748131801 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f870403b560 con 0x7f8710093950 2023-10-03T10:10:03.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.512+0000 7f8715234700 1 -- 172.21.15.146:0/1748131801 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871005a260 con 0x7f8710093950 2023-10-03T10:10:03.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.517+0000 7f86f6ffd700 1 -- 172.21.15.146:0/1748131801 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8704019900 con 0x7f8710093950 2023-10-03T10:10:03.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.674+0000 7f8715234700 1 -- 172.21.15.146:0/1748131801 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8710046c20 con 0x7f8710093950 2023-10-03T10:10:03.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.675+0000 7f86f6ffd700 1 -- 172.21.15.146:0/1748131801 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v16) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8704019310 con 0x7f8710093950 2023-10-03T10:10:03.676 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-03T10:10:03.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.676+0000 7f8715234700 1 -- 172.21.15.146:0/1748131801 >> v1:172.21.15.146:6816/118159 conn(0x7f86fc02bb60 legacy=0x7f86fc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.676+0000 7f8715234700 1 -- 172.21.15.146:0/1748131801 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8710093950 msgr2=0x7f871011dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.676+0000 7f8715234700 1 --2- 172.21.15.146:0/1748131801 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8710093950 0x7f871011dce0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f870400ea20 tx=0x7f8704009060).stop 2023-10-03T10:10:03.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.676+0000 7f8715234700 1 -- 172.21.15.146:0/1748131801 shutdown_connections 2023-10-03T10:10:03.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.676+0000 7f8715234700 1 --2- 172.21.15.146:0/1748131801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f871012d250 0x7f871011a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.676+0000 7f8715234700 1 --2- 172.21.15.146:0/1748131801 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8710093950 0x7f871011dce0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.676+0000 7f8715234700 1 --2- 172.21.15.146:0/1748131801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8710095c50 0x7f8710119d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.676+0000 7f8715234700 1 -- 172.21.15.146:0/1748131801 >> 172.21.15.146:0/1748131801 conn(0x7f871009aa50 msgr2=0x7f8710068fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:03.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.676+0000 7f8715234700 1 -- 172.21.15.146:0/1748131801 shutdown_connections 2023-10-03T10:10:03.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.676+0000 7f8715234700 1 -- 172.21.15.146:0/1748131801 wait complete. 2023-10-03T10:10:03.689 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:10:03.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.806+0000 7f3cf441c700 1 Processor -- start 2023-10-03T10:10:03.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.807+0000 7f3cf441c700 1 -- start start 2023-10-03T10:10:03.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.807+0000 7f3cf441c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cec093950 0x7f3cec095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.807+0000 7f3cf441c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cec095c50 0x7f3cec096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.807+0000 7f3cf441c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cec094ba0 con 0x7f3cec12c240 2023-10-03T10:10:03.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.807+0000 7f3cf441c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec092e90 con 0x7f3cec093950 2023-10-03T10:10:03.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.807+0000 7f3cf441c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec096b60 con 0x7f3cec095c50 2023-10-03T10:10:03.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.807+0000 7f3cf21b8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cec093950 0x7f3cec095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.807+0000 7f3cf29b9700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3cec12c240 0x7f3cec12e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33800/0 (socket says 172.21.15.146:33800) 2023-10-03T10:10:03.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.807+0000 7f3cf29b9700 1 -- 172.21.15.146:0/2050618586 learned_addr learned my addr 172.21.15.146:0/2050618586 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:10:03.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.807+0000 7f3cf19b7700 1 --2- 172.21.15.146:0/2050618586 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cec095c50 0x7f3cec096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.808+0000 7f3cf21b8700 1 -- 172.21.15.146:0/2050618586 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cec095c50 msgr2=0x7f3cec096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:03.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.808+0000 7f3cf11b6700 1 -- 172.21.15.146:0/2050618586 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471248918 0 0) 0x7f3cec094ba0 con 0x7f3cec12c240 2023-10-03T10:10:03.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.808+0000 7f3cf21b8700 1 --2- 172.21.15.146:0/2050618586 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cec095c50 0x7f3cec096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.808+0000 7f3cf21b8700 1 -- 172.21.15.146:0/2050618586 >> v1:172.21.15.146:6789/0 conn(0x7f3cec12c240 legacy=0x7f3cec12e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.808+0000 7f3cf21b8700 1 -- 172.21.15.146:0/2050618586 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cec093150 con 0x7f3cec093950 2023-10-03T10:10:03.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.808+0000 7f3cf19b7700 1 --2- 172.21.15.146:0/2050618586 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cec095c50 0x7f3cec096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:03.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.808+0000 7f3cf21b8700 1 --2- 172.21.15.146:0/2050618586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cec093950 0x7f3cec095760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f3cdc009790 tx=0x7f3cdc009060).ready entity=mon.1 client_cookie=dd9c07ea672abd17 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:03.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.808+0000 7f3cf11b6700 1 -- 172.21.15.146:0/2050618586 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc0090d0 con 0x7f3cec093950 2023-10-03T10:10:03.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.808+0000 7f3cf11b6700 1 -- 172.21.15.146:0/2050618586 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cdc00f510 con 0x7f3cec093950 2023-10-03T10:10:03.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.808+0000 7f3cf11b6700 1 -- 172.21.15.146:0/2050618586 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc00f890 con 0x7f3cec093950 2023-10-03T10:10:03.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.808+0000 7f3cf441c700 1 -- 172.21.15.146:0/2050618586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cec093950 msgr2=0x7f3cec095760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.808+0000 7f3cf441c700 1 --2- 172.21.15.146:0/2050618586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cec093950 0x7f3cec095760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f3cdc009790 tx=0x7f3cdc009060).stop 2023-10-03T10:10:03.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.808+0000 7f3cf441c700 1 -- 172.21.15.146:0/2050618586 shutdown_connections 2023-10-03T10:10:03.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.808+0000 7f3cf441c700 1 --2- 172.21.15.146:0/2050618586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cec093950 0x7f3cec095760 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.808+0000 7f3cf441c700 1 --2- 172.21.15.146:0/2050618586 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cec095c50 0x7f3cec096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.809+0000 7f3cf441c700 1 -- 172.21.15.146:0/2050618586 >> 172.21.15.146:0/2050618586 conn(0x7f3cec09aa50 msgr2=0x7f3cec09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:03.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.809+0000 7f3cf441c700 1 -- 172.21.15.146:0/2050618586 shutdown_connections 2023-10-03T10:10:03.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.809+0000 7f3cf441c700 1 -- 172.21.15.146:0/2050618586 wait complete. 2023-10-03T10:10:03.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.809+0000 7f3cf441c700 1 Processor -- start 2023-10-03T10:10:03.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.809+0000 7f3cf441c700 1 -- start start 2023-10-03T10:10:03.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3cf441c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cec093950 0x7f3cec12a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3cf441c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cec095c50 0x7f3cec12b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3cf441c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cec12c240 0x7f3cec12b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3cf441c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec099070 con 0x7f3cec093950 2023-10-03T10:10:03.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3cf441c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec092410 con 0x7f3cec12c240 2023-10-03T10:10:03.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3cf441c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec128ac0 con 0x7f3cec095c50 2023-10-03T10:10:03.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3cf21b8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cec093950 0x7f3cec12a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3cf29b9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cec12c240 0x7f3cec12b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3cf29b9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cec12c240 0x7f3cec12b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58896/0 (socket says 172.21.15.146:58896) 2023-10-03T10:10:03.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3cf21b8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cec093950 0x7f3cec12a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47402/0 (socket says 172.21.15.146:47402) 2023-10-03T10:10:03.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3cf29b9700 1 -- 172.21.15.146:0/84983707 learned_addr learned my addr 172.21.15.146:0/84983707 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:03.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3cf19b7700 1 --2- 172.21.15.146:0/84983707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cec095c50 0x7f3cec12b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3cf29b9700 1 -- 172.21.15.146:0/84983707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cec095c50 msgr2=0x7f3cec12b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3cf29b9700 1 --2- 172.21.15.146:0/84983707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cec095c50 0x7f3cec12b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3cf29b9700 1 -- 172.21.15.146:0/84983707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cec093950 msgr2=0x7f3cec12a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3cf29b9700 1 --2- 172.21.15.146:0/84983707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cec093950 0x7f3cec12a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3cf29b9700 1 -- 172.21.15.146:0/84983707 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce80092a0 con 0x7f3cec12c240 2023-10-03T10:10:03.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3cf21b8700 1 --2- 172.21.15.146:0/84983707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cec093950 0x7f3cec12a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:03.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3cf29b9700 1 --2- 172.21.15.146:0/84983707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cec12c240 0x7f3cec12b9b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3ce400c7e0 tx=0x7f3ce4007f90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:03.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3ce27fc700 1 -- 172.21.15.146:0/84983707 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4005d30 con 0x7f3cec12c240 2023-10-03T10:10:03.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3ce27fc700 1 -- 172.21.15.146:0/84983707 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce4005e90 con 0x7f3cec12c240 2023-10-03T10:10:03.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3cf441c700 1 -- 172.21.15.146:0/84983707 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cdc0092a0 con 0x7f3cec12c240 2023-10-03T10:10:03.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3ce27fc700 1 -- 172.21.15.146:0/84983707 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4007360 con 0x7f3cec12c240 2023-10-03T10:10:03.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.810+0000 7f3cf441c700 1 -- 172.21.15.146:0/84983707 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cec1282d0 con 0x7f3cec12c240 2023-10-03T10:10:03.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.811+0000 7f3ce27fc700 1 -- 172.21.15.146:0/84983707 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3ce4007750 con 0x7f3cec12c240 2023-10-03T10:10:03.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.811+0000 7f3ce27fc700 1 -- 172.21.15.146:0/84983707 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f3ce403af10 con 0x7f3cec12c240 2023-10-03T10:10:03.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.811+0000 7f3cf441c700 1 -- 172.21.15.146:0/84983707 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cec066670 con 0x7f3cec12c240 2023-10-03T10:10:03.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:03.816+0000 7f3ce27fc700 1 -- 172.21.15.146:0/84983707 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3ce401c3e0 con 0x7f3cec12c240 2023-10-03T10:10:04.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.011+0000 7f3cf441c700 1 -- 172.21.15.146:0/84983707 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3cec096570 con 0x7f3cec12c240 2023-10-03T10:10:04.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.011+0000 7f3ce27fc700 1 -- 172.21.15.146:0/84983707 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2158 (secure 0 0 0) 0x7f3ce4011360 con 0x7f3cec12c240 2023-10-03T10:10:04.012 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:10:04.013 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:48.718228+0000","modified":"2023-10-03T10:09:50.726096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4181":{"gid":4181,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6817/4164614194","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6817","nonce":4164614194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:10:04.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.013+0000 7f3cf441c700 1 -- 172.21.15.146:0/84983707 >> v1:172.21.15.146:6816/118159 conn(0x7f3cd002bb60 legacy=0x7f3cd002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.013+0000 7f3cf441c700 1 -- 172.21.15.146:0/84983707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cec12c240 msgr2=0x7f3cec12b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.013+0000 7f3cf441c700 1 --2- 172.21.15.146:0/84983707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cec12c240 0x7f3cec12b9b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3ce400c7e0 tx=0x7f3ce4007f90).stop 2023-10-03T10:10:04.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.013+0000 7f3cf441c700 1 -- 172.21.15.146:0/84983707 shutdown_connections 2023-10-03T10:10:04.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.013+0000 7f3cf441c700 1 --2- 172.21.15.146:0/84983707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cec12c240 0x7f3cec12b9b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.013+0000 7f3cf441c700 1 --2- 172.21.15.146:0/84983707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cec093950 0x7f3cec12a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.013+0000 7f3cf441c700 1 --2- 172.21.15.146:0/84983707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cec095c50 0x7f3cec12b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.013+0000 7f3cf441c700 1 -- 172.21.15.146:0/84983707 >> 172.21.15.146:0/84983707 conn(0x7f3cec09aa50 msgr2=0x7f3cec062aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.013+0000 7f3cf441c700 1 -- 172.21.15.146:0/84983707 shutdown_connections 2023-10-03T10:10:04.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.013+0000 7f3cf441c700 1 -- 172.21.15.146:0/84983707 wait complete. 2023-10-03T10:10:04.015 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 5 2023-10-03T10:10:04.025 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:10:04.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.141+0000 7f1aee62d700 1 Processor -- start 2023-10-03T10:10:04.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.141+0000 7f1aee62d700 1 -- start start 2023-10-03T10:10:04.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.141+0000 7f1aee62d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1ae8062b00 0x7f1ae8095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.141+0000 7f1aee62d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ae8095b80 0x7f1ae8095fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.141+0000 7f1aee62d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae8091980 con 0x7f1ae8096490 2023-10-03T10:10:04.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.141+0000 7f1aee62d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae80973f0 con 0x7f1ae8062b00 2023-10-03T10:10:04.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.141+0000 7f1aee62d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae8062ee0 con 0x7f1ae8095b80 2023-10-03T10:10:04.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.142+0000 7f1ae7fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1ae8062b00 0x7f1ae8095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.142+0000 7f1ae77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ae8095b80 0x7f1ae8095fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.142+0000 7f1ae7fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1ae8062b00 0x7f1ae8095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47406/0 (socket says 172.21.15.146:47406) 2023-10-03T10:10:04.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.142+0000 7f1ae7fff700 1 -- 172.21.15.146:0/2821732441 learned_addr learned my addr 172.21.15.146:0/2821732441 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:04.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.142+0000 7f1aecbca700 1 --1- 172.21.15.146:0/2821732441 >> v1:172.21.15.146:6789/0 conn(0x7f1ae8096490 0x7f1ae8131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33802/0 (socket says 172.21.15.146:33802) 2023-10-03T10:10:04.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.142+0000 7f1ae7fff700 1 -- 172.21.15.146:0/2821732441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ae8095b80 msgr2=0x7f1ae8095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.142+0000 7f1ae7fff700 1 --2- 172.21.15.146:0/2821732441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ae8095b80 0x7f1ae8095fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.142+0000 7f1ae7fff700 1 -- 172.21.15.146:0/2821732441 >> v1:172.21.15.146:6789/0 conn(0x7f1ae8096490 legacy=0x7f1ae8131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.142+0000 7f1ae6ffd700 1 -- 172.21.15.146:0/2821732441 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448015744 0 0) 0x7f1ae8091980 con 0x7f1ae8096490 2023-10-03T10:10:04.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.142+0000 7f1ae7fff700 1 -- 172.21.15.146:0/2821732441 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae8092310 con 0x7f1ae8062b00 2023-10-03T10:10:04.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.142+0000 7f1ae77fe700 1 --2- 172.21.15.146:0/2821732441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ae8095b80 0x7f1ae8095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:04.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.142+0000 7f1ae7fff700 1 --2- 172.21.15.146:0/2821732441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae8062b00 0x7f1ae8095690 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f1ad8009830 tx=0x7f1ad80090f0).ready entity=mon.0 client_cookie=1773f4949dad0a22 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.142+0000 7f1ae6ffd700 1 -- 172.21.15.146:0/2821732441 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad800b580 con 0x7f1ae8062b00 2023-10-03T10:10:04.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.142+0000 7f1ae6ffd700 1 -- 172.21.15.146:0/2821732441 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad800b6e0 con 0x7f1ae8062b00 2023-10-03T10:10:04.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.142+0000 7f1ae6ffd700 1 -- 172.21.15.146:0/2821732441 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad800ba60 con 0x7f1ae8062b00 2023-10-03T10:10:04.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.143+0000 7f1aee62d700 1 -- 172.21.15.146:0/2821732441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae8062b00 msgr2=0x7f1ae8095690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.143+0000 7f1aee62d700 1 --2- 172.21.15.146:0/2821732441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae8062b00 0x7f1ae8095690 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f1ad8009830 tx=0x7f1ad80090f0).stop 2023-10-03T10:10:04.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.143+0000 7f1aee62d700 1 -- 172.21.15.146:0/2821732441 shutdown_connections 2023-10-03T10:10:04.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.143+0000 7f1aee62d700 1 --2- 172.21.15.146:0/2821732441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae8062b00 0x7f1ae8095690 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.143+0000 7f1aee62d700 1 --2- 172.21.15.146:0/2821732441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ae8095b80 0x7f1ae8095fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.143+0000 7f1aee62d700 1 -- 172.21.15.146:0/2821732441 >> 172.21.15.146:0/2821732441 conn(0x7f1ae809aa50 msgr2=0x7f1ae809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.143+0000 7f1aee62d700 1 -- 172.21.15.146:0/2821732441 shutdown_connections 2023-10-03T10:10:04.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.143+0000 7f1aee62d700 1 -- 172.21.15.146:0/2821732441 wait complete. 2023-10-03T10:10:04.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.143+0000 7f1aee62d700 1 Processor -- start 2023-10-03T10:10:04.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.144+0000 7f1aee62d700 1 -- start start 2023-10-03T10:10:04.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.144+0000 7f1aee62d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ae8062b00 0x7f1ae812d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.144+0000 7f1aee62d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ae8095b80 0x7f1ae8115810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.144+0000 7f1aee62d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae8096490 0x7f1ae8115d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.144+0000 7f1aee62d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae8096da0 con 0x7f1ae8096490 2023-10-03T10:10:04.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.144+0000 7f1aee62d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae81197d0 con 0x7f1ae8095b80 2023-10-03T10:10:04.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.144+0000 7f1aee62d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae8119210 con 0x7f1ae8062b00 2023-10-03T10:10:04.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.144+0000 7f1aecbca700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae8096490 0x7f1ae8115d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.144+0000 7f1ae7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ae8062b00 0x7f1ae812d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.144+0000 7f1ae77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ae8095b80 0x7f1ae8115810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.144+0000 7f1aecbca700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae8096490 0x7f1ae8115d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47414/0 (socket says 172.21.15.146:47414) 2023-10-03T10:10:04.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.144+0000 7f1aecbca700 1 -- 172.21.15.146:0/1495401655 learned_addr learned my addr 172.21.15.146:0/1495401655 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:04.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.145+0000 7f1aecbca700 1 -- 172.21.15.146:0/1495401655 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ae8062b00 msgr2=0x7f1ae812d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.145+0000 7f1aecbca700 1 --2- 172.21.15.146:0/1495401655 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ae8062b00 0x7f1ae812d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.145+0000 7f1aecbca700 1 -- 172.21.15.146:0/1495401655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ae8095b80 msgr2=0x7f1ae8115810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.145+0000 7f1aecbca700 1 --2- 172.21.15.146:0/1495401655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ae8095b80 0x7f1ae8115810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.145+0000 7f1aecbca700 1 -- 172.21.15.146:0/1495401655 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1adc0092a0 con 0x7f1ae8096490 2023-10-03T10:10:04.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.145+0000 7f1ae77fe700 1 --2- 172.21.15.146:0/1495401655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ae8095b80 0x7f1ae8115810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:04.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.145+0000 7f1aecbca700 1 --2- 172.21.15.146:0/1495401655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae8096490 0x7f1ae8115d00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f1ae000c7e0 tx=0x7f1ae0007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.145+0000 7f1acffff700 1 -- 172.21.15.146:0/1495401655 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0005c70 con 0x7f1ae8096490 2023-10-03T10:10:04.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.145+0000 7f1acffff700 1 -- 172.21.15.146:0/1495401655 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae0005dd0 con 0x7f1ae8096490 2023-10-03T10:10:04.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.145+0000 7f1aee62d700 1 -- 172.21.15.146:0/1495401655 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad8009370 con 0x7f1ae8096490 2023-10-03T10:10:04.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.145+0000 7f1acffff700 1 -- 172.21.15.146:0/1495401655 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0007320 con 0x7f1ae8096490 2023-10-03T10:10:04.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.145+0000 7f1aee62d700 1 -- 172.21.15.146:0/1495401655 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae8116c10 con 0x7f1ae8096490 2023-10-03T10:10:04.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.146+0000 7f1acffff700 1 -- 172.21.15.146:0/1495401655 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f1ae00076d0 con 0x7f1ae8096490 2023-10-03T10:10:04.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.146+0000 7f1acffff700 1 -- 172.21.15.146:0/1495401655 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f1ae003b010 con 0x7f1ae8096490 2023-10-03T10:10:04.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.146+0000 7f1aee62d700 1 -- 172.21.15.146:0/1495401655 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae8118e30 con 0x7f1ae8096490 2023-10-03T10:10:04.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.150+0000 7f1acffff700 1 -- 172.21.15.146:0/1495401655 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1ae001c3e0 con 0x7f1ae8096490 2023-10-03T10:10:04.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.312+0000 7f1aee62d700 1 -- 172.21.15.146:0/1495401655 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ae805a260 con 0x7f1ae8096490 2023-10-03T10:10:04.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.313+0000 7f1acffff700 1 -- 172.21.15.146:0/1495401655 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11373 (secure 0 0 0) 0x7f1ae001a300 con 0x7f1ae8096490 2023-10-03T10:10:04.314 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:10:04.314 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":16,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:09:49.722394+0000","last_up_change":"2023-10-03T10:09:42.301022+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":118758}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":118758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":118758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":118758}]},"public_addr":"172.21.15.146:6800/118758","cluster_addr":"172.21.15.146:6801/118758","heartbeat_back_addr":"172.21.15.146:6803/118758","heartbeat_front_addr":"172.21.15.146:6802/118758","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":118774}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":118774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":118774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":118774}]},"public_addr":"172.21.15.146:6804/118774","cluster_addr":"172.21.15.146:6806/118774","heartbeat_back_addr":"172.21.15.146:6810/118774","heartbeat_front_addr":"172.21.15.146:6808/118774","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":118775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":118775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":118775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":118775}]},"public_addr":"172.21.15.146:6805/118775","cluster_addr":"172.21.15.146:6807/118775","heartbeat_back_addr":"172.21.15.146:6811/118775","heartbeat_front_addr":"172.21.15.146:6809/118775","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":118776}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":118776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":118776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":118776}]},"public_addr":"172.21.15.146:6812/118776","cluster_addr":"172.21.15.146:6813/118776","heartbeat_back_addr":"172.21.15.146:6815/118776","heartbeat_front_addr":"172.21.15.146:6814/118776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:10:04.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.315+0000 7f1aee62d700 1 -- 172.21.15.146:0/1495401655 >> v1:172.21.15.146:6816/118159 conn(0x7f1ad402bb60 legacy=0x7f1ad402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.315+0000 7f1aee62d700 1 -- 172.21.15.146:0/1495401655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae8096490 msgr2=0x7f1ae8115d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.315+0000 7f1aee62d700 1 --2- 172.21.15.146:0/1495401655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae8096490 0x7f1ae8115d00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f1ae000c7e0 tx=0x7f1ae0007f60).stop 2023-10-03T10:10:04.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.315+0000 7f1aee62d700 1 -- 172.21.15.146:0/1495401655 shutdown_connections 2023-10-03T10:10:04.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.315+0000 7f1aee62d700 1 --2- 172.21.15.146:0/1495401655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae8096490 0x7f1ae8115d00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.315+0000 7f1aee62d700 1 --2- 172.21.15.146:0/1495401655 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ae8062b00 0x7f1ae812d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.315+0000 7f1aee62d700 1 --2- 172.21.15.146:0/1495401655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ae8095b80 0x7f1ae8115810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.315+0000 7f1aee62d700 1 -- 172.21.15.146:0/1495401655 >> 172.21.15.146:0/1495401655 conn(0x7f1ae809aa50 msgr2=0x7f1ae812ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.315+0000 7f1aee62d700 1 -- 172.21.15.146:0/1495401655 shutdown_connections 2023-10-03T10:10:04.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.315+0000 7f1aee62d700 1 -- 172.21.15.146:0/1495401655 wait complete. 2023-10-03T10:10:04.328 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:10:04.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.445+0000 7f8cfea80700 1 Processor -- start 2023-10-03T10:10:04.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.445+0000 7f8cfea80700 1 -- start start 2023-10-03T10:10:04.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.445+0000 7f8cfea80700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8cf8092390 0x7f8cf8097aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.445+0000 7f8cfea80700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf8123a90 0x7f8cf8123f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.445+0000 7f8cfea80700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf8126fe0 0x7f8cf8127490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.445+0000 7f8cfea80700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf8092770 con 0x7f8cf8092390 2023-10-03T10:10:04.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.445+0000 7f8cfea80700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf8069550 con 0x7f8cf8126fe0 2023-10-03T10:10:04.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.445+0000 7f8cfea80700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf8068c10 con 0x7f8cf8123a90 2023-10-03T10:10:04.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.446+0000 7f8cf7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf8123a90 0x7f8cf8123f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.446+0000 7f8cfd01d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf8126fe0 0x7f8cf8127490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.446+0000 7f8cf7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf8123a90 0x7f8cf8123f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40118/0 (socket says 172.21.15.146:40118) 2023-10-03T10:10:04.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.446+0000 7f8cf7fff700 1 -- 172.21.15.146:0/3917246732 learned_addr learned my addr 172.21.15.146:0/3917246732 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:04.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.446+0000 7f8cfc81c700 1 --2- 172.21.15.146:0/3917246732 >> v2:172.21.15.146:3300/0 conn(0x7f8cf8092390 0x7f8cf8097aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.446+0000 7f8cf7fff700 1 -- 172.21.15.146:0/3917246732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf8126fe0 msgr2=0x7f8cf8127490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.446+0000 7f8cf7fff700 1 --2- 172.21.15.146:0/3917246732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf8126fe0 0x7f8cf8127490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.446+0000 7f8cf7fff700 1 -- 172.21.15.146:0/3917246732 >> v2:172.21.15.146:3300/0 conn(0x7f8cf8092390 msgr2=0x7f8cf8097aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.446+0000 7f8cf7fff700 1 --2- 172.21.15.146:0/3917246732 >> v2:172.21.15.146:3300/0 conn(0x7f8cf8092390 0x7f8cf8097aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.446+0000 7f8cf7fff700 1 -- 172.21.15.146:0/3917246732 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf8124550 con 0x7f8cf8123a90 2023-10-03T10:10:04.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.446+0000 7f8cfc81c700 1 --2- 172.21.15.146:0/3917246732 >> v2:172.21.15.146:3300/0 conn(0x7f8cf8092390 0x7f8cf8097aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:04.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.446+0000 7f8cf7fff700 1 --2- 172.21.15.146:0/3917246732 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf8123a90 0x7f8cf8123f10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f8ce4006fd0 tx=0x7f8ce40090f0).ready entity=mon.2 client_cookie=c003060b8cfaf745 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.446+0000 7f8cf77fe700 1 -- 172.21.15.146:0/3917246732 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce400f510 con 0x7f8cf8123a90 2023-10-03T10:10:04.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.446+0000 7f8cf77fe700 1 -- 172.21.15.146:0/3917246732 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce400f670 con 0x7f8cf8123a90 2023-10-03T10:10:04.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.446+0000 7f8cf77fe700 1 -- 172.21.15.146:0/3917246732 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce400f9f0 con 0x7f8cf8123a90 2023-10-03T10:10:04.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.447+0000 7f8cfea80700 1 -- 172.21.15.146:0/3917246732 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf8123a90 msgr2=0x7f8cf8123f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.447+0000 7f8cfea80700 1 --2- 172.21.15.146:0/3917246732 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf8123a90 0x7f8cf8123f10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f8ce4006fd0 tx=0x7f8ce40090f0).stop 2023-10-03T10:10:04.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.447+0000 7f8cfea80700 1 -- 172.21.15.146:0/3917246732 shutdown_connections 2023-10-03T10:10:04.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.447+0000 7f8cfea80700 1 --2- 172.21.15.146:0/3917246732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf8126fe0 0x7f8cf8127490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.447+0000 7f8cfea80700 1 --2- 172.21.15.146:0/3917246732 >> v2:172.21.15.146:3300/0 conn(0x7f8cf8092390 0x7f8cf8097aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.447+0000 7f8cfea80700 1 --2- 172.21.15.146:0/3917246732 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf8123a90 0x7f8cf8123f10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.447+0000 7f8cfea80700 1 -- 172.21.15.146:0/3917246732 >> 172.21.15.146:0/3917246732 conn(0x7f8cf809a230 msgr2=0x7f8cf809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.447+0000 7f8cfea80700 1 -- 172.21.15.146:0/3917246732 shutdown_connections 2023-10-03T10:10:04.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.447+0000 7f8cfea80700 1 -- 172.21.15.146:0/3917246732 wait complete. 2023-10-03T10:10:04.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.448+0000 7f8cfea80700 1 Processor -- start 2023-10-03T10:10:04.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.448+0000 7f8cfea80700 1 -- start start 2023-10-03T10:10:04.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.449+0000 7f8cfea80700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cf8092390 0x7f8cf8097080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.449+0000 7f8cfea80700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf8123a90 0x7f8cf8137790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.449+0000 7f8cfea80700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf8126fe0 0x7f8cf8137c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.449+0000 7f8cfea80700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf8097df0 con 0x7f8cf8092390 2023-10-03T10:10:04.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.449+0000 7f8cfea80700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf8137560 con 0x7f8cf8123a90 2023-10-03T10:10:04.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.449+0000 7f8cfea80700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf8069780 con 0x7f8cf8126fe0 2023-10-03T10:10:04.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.449+0000 7f8cfc81c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cf8092390 0x7f8cf8097080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.449+0000 7f8cf7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf8123a90 0x7f8cf8137790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.449+0000 7f8cfc81c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cf8092390 0x7f8cf8097080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59904/0 (socket says 172.21.15.146:59904) 2023-10-03T10:10:04.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.449+0000 7f8cfc81c700 1 -- 172.21.15.146:0/3781855544 learned_addr learned my addr 172.21.15.146:0/3781855544 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:04.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.449+0000 7f8cfd01d700 1 --2- 172.21.15.146:0/3781855544 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf8126fe0 0x7f8cf8137c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.449+0000 7f8cfc81c700 1 -- 172.21.15.146:0/3781855544 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf8126fe0 msgr2=0x7f8cf8137c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.449+0000 7f8cfc81c700 1 --2- 172.21.15.146:0/3781855544 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf8126fe0 0x7f8cf8137c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.449+0000 7f8cfc81c700 1 -- 172.21.15.146:0/3781855544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf8123a90 msgr2=0x7f8cf8137790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.449+0000 7f8cfc81c700 1 --2- 172.21.15.146:0/3781855544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf8123a90 0x7f8cf8137790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.449+0000 7f8cfc81c700 1 -- 172.21.15.146:0/3781855544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec0092a0 con 0x7f8cf8092390 2023-10-03T10:10:04.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.449+0000 7f8cfc81c700 1 --2- 172.21.15.146:0/3781855544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cf8092390 0x7f8cf8097080 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f8cec010c30 tx=0x7f8cec009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.449+0000 7f8cf4ff9700 1 -- 172.21.15.146:0/3781855544 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec00eb30 con 0x7f8cf8092390 2023-10-03T10:10:04.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.449+0000 7f8cfea80700 1 -- 172.21.15.146:0/3781855544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce4009370 con 0x7f8cf8092390 2023-10-03T10:10:04.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.449+0000 7f8cf4ff9700 1 -- 172.21.15.146:0/3781855544 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec00ec90 con 0x7f8cf8092390 2023-10-03T10:10:04.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.449+0000 7f8cf4ff9700 1 -- 172.21.15.146:0/3781855544 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec01a470 con 0x7f8cf8092390 2023-10-03T10:10:04.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.449+0000 7f8cfea80700 1 -- 172.21.15.146:0/3781855544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf81294c0 con 0x7f8cf8092390 2023-10-03T10:10:04.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.450+0000 7f8cf4ff9700 1 -- 172.21.15.146:0/3781855544 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8cec017070 con 0x7f8cf8092390 2023-10-03T10:10:04.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.450+0000 7f8cf4ff9700 1 -- 172.21.15.146:0/3781855544 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f8cec03d3e0 con 0x7f8cf8092390 2023-10-03T10:10:04.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.450+0000 7f8cfea80700 1 -- 172.21.15.146:0/3781855544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf812abd0 con 0x7f8cf8092390 2023-10-03T10:10:04.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.455+0000 7f8cf4ff9700 1 -- 172.21.15.146:0/3781855544 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8cec01f030 con 0x7f8cf8092390 2023-10-03T10:10:04.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.650+0000 7f8cfea80700 1 -- 172.21.15.146:0/3781855544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8cf8126e20 con 0x7f8cf8092390 2023-10-03T10:10:04.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.650+0000 7f8cf4ff9700 1 -- 172.21.15.146:0/3781855544 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2158 (secure 0 0 0) 0x7f8cec018960 con 0x7f8cf8092390 2023-10-03T10:10:04.651 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:10:04.651 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:48.718228+0000","modified":"2023-10-03T10:09:50.726096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4181":{"gid":4181,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6817/4164614194","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6817","nonce":4164614194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:10:04.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.652+0000 7f8cfea80700 1 -- 172.21.15.146:0/3781855544 >> v1:172.21.15.146:6816/118159 conn(0x7f8cdc02bb60 legacy=0x7f8cdc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.652+0000 7f8cfea80700 1 -- 172.21.15.146:0/3781855544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cf8092390 msgr2=0x7f8cf8097080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.652+0000 7f8cfea80700 1 --2- 172.21.15.146:0/3781855544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cf8092390 0x7f8cf8097080 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f8cec010c30 tx=0x7f8cec009060).stop 2023-10-03T10:10:04.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.652+0000 7f8cfea80700 1 -- 172.21.15.146:0/3781855544 shutdown_connections 2023-10-03T10:10:04.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.652+0000 7f8cfea80700 1 --2- 172.21.15.146:0/3781855544 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf8126fe0 0x7f8cf8137c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.652+0000 7f8cfea80700 1 --2- 172.21.15.146:0/3781855544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cf8092390 0x7f8cf8097080 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.652+0000 7f8cfea80700 1 --2- 172.21.15.146:0/3781855544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf8123a90 0x7f8cf8137790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.652+0000 7f8cfea80700 1 -- 172.21.15.146:0/3781855544 >> 172.21.15.146:0/3781855544 conn(0x7f8cf809a230 msgr2=0x7f8cf8066cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.652+0000 7f8cfea80700 1 -- 172.21.15.146:0/3781855544 shutdown_connections 2023-10-03T10:10:04.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.652+0000 7f8cfea80700 1 -- 172.21.15.146:0/3781855544 wait complete. 2023-10-03T10:10:04.654 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 5 2023-10-03T10:10:04.765 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T10:09:48.718228+0000', 'modified': '2023-10-03T10:09:50.726096+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4181}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4181': {'gid': 4181, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6817/4164614194', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.146:6817', 'nonce': 4164614194}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-03T10:10:04.765 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T10:10:04.765 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-03T10:10:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.881+0000 7fec2afb8700 1 Processor -- start 2023-10-03T10:10:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.881+0000 7fec2afb8700 1 -- start start 2023-10-03T10:10:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.882+0000 7fec2afb8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fec2412ddc0 0x7fec241301b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.882+0000 7fec2afb8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec241306a0 0x7fec24132a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.882+0000 7fec2afb8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec24097a40 con 0x7fec2412aca0 2023-10-03T10:10:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.882+0000 7fec2afb8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec240683d0 con 0x7fec2412ddc0 2023-10-03T10:10:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.882+0000 7fec2afb8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec24067450 con 0x7fec241306a0 2023-10-03T10:10:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.882+0000 7fec29555700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec241306a0 0x7fec24132a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.882+0000 7fec23fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fec2412ddc0 0x7fec241301b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.882+0000 7fec29555700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec241306a0 0x7fec24132a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42848/0 (socket says 172.21.15.146:42848) 2023-10-03T10:10:04.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.882+0000 7fec23fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fec2412ddc0 0x7fec241301b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59906/0 (socket says 172.21.15.146:59906) 2023-10-03T10:10:04.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.882+0000 7fec29555700 1 -- 172.21.15.146:0/1565138415 learned_addr learned my addr 172.21.15.146:0/1565138415 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:04.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.882+0000 7fec28d54700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fec2412aca0 0x7fec2412b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40222/0 (socket says 172.21.15.146:40222) 2023-10-03T10:10:04.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.882+0000 7fec29555700 1 -- 172.21.15.146:0/1565138415 >> v2:172.21.15.146:3300/0 conn(0x7fec2412ddc0 msgr2=0x7fec241301b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.882+0000 7fec29555700 1 --2- 172.21.15.146:0/1565138415 >> v2:172.21.15.146:3300/0 conn(0x7fec2412ddc0 0x7fec241301b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.882+0000 7fec29555700 1 -- 172.21.15.146:0/1565138415 >> v1:172.21.15.146:6789/0 conn(0x7fec2412aca0 legacy=0x7fec2412b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.882+0000 7fec237fe700 1 -- 172.21.15.146:0/1565138415 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499324219 0 0) 0x7fec24097a40 con 0x7fec2412aca0 2023-10-03T10:10:04.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.882+0000 7fec29555700 1 -- 172.21.15.146:0/1565138415 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2412aaa0 con 0x7fec241306a0 2023-10-03T10:10:04.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.882+0000 7fec23fff700 1 --2- 172.21.15.146:0/1565138415 >> v2:172.21.15.146:3300/0 conn(0x7fec2412ddc0 0x7fec241301b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:04.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.882+0000 7fec29555700 1 --2- 172.21.15.146:0/1565138415 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec241306a0 0x7fec24132a90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fec1c009f20 tx=0x7fec1c009840).ready entity=mon.1 client_cookie=9869c3a42db222ef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.882+0000 7fec237fe700 1 -- 172.21.15.146:0/1565138415 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c00e070 con 0x7fec241306a0 2023-10-03T10:10:04.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.882+0000 7fec237fe700 1 -- 172.21.15.146:0/1565138415 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1c00b9d0 con 0x7fec241306a0 2023-10-03T10:10:04.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.882+0000 7fec237fe700 1 -- 172.21.15.146:0/1565138415 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c00bd50 con 0x7fec241306a0 2023-10-03T10:10:04.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.883+0000 7fec2afb8700 1 -- 172.21.15.146:0/1565138415 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec241306a0 msgr2=0x7fec24132a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.883+0000 7fec2afb8700 1 --2- 172.21.15.146:0/1565138415 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec241306a0 0x7fec24132a90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fec1c009f20 tx=0x7fec1c009840).stop 2023-10-03T10:10:04.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.883+0000 7fec2afb8700 1 -- 172.21.15.146:0/1565138415 shutdown_connections 2023-10-03T10:10:04.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.883+0000 7fec2afb8700 1 --2- 172.21.15.146:0/1565138415 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec241306a0 0x7fec24132a90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.883+0000 7fec2afb8700 1 --2- 172.21.15.146:0/1565138415 >> v2:172.21.15.146:3300/0 conn(0x7fec2412ddc0 0x7fec241301b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.883+0000 7fec2afb8700 1 -- 172.21.15.146:0/1565138415 >> 172.21.15.146:0/1565138415 conn(0x7fec24062b00 msgr2=0x7fec24062f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.883+0000 7fec2afb8700 1 -- 172.21.15.146:0/1565138415 shutdown_connections 2023-10-03T10:10:04.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.883+0000 7fec2afb8700 1 -- 172.21.15.146:0/1565138415 wait complete. 2023-10-03T10:10:04.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.884+0000 7fec2afb8700 1 Processor -- start 2023-10-03T10:10:04.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.884+0000 7fec2afb8700 1 -- start start 2023-10-03T10:10:04.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.884+0000 7fec2afb8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2412aca0 0x7fec2412a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.884+0000 7fec2afb8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec2412ddc0 0x7fec24114060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.884+0000 7fec2afb8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec241306a0 0x7fec24114550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.884+0000 7fec2afb8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec24115520 con 0x7fec2412aca0 2023-10-03T10:10:04.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.884+0000 7fec2afb8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec24116720 con 0x7fec241306a0 2023-10-03T10:10:04.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.884+0000 7fec2afb8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec24097cf0 con 0x7fec2412ddc0 2023-10-03T10:10:04.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.884+0000 7fec28d54700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2412aca0 0x7fec2412a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.885+0000 7fec28d54700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2412aca0 0x7fec2412a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59908/0 (socket says 172.21.15.146:59908) 2023-10-03T10:10:04.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.885+0000 7fec28d54700 1 -- 172.21.15.146:0/2221013666 learned_addr learned my addr 172.21.15.146:0/2221013666 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:04.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.885+0000 7fec23fff700 1 --2- 172.21.15.146:0/2221013666 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec2412ddc0 0x7fec24114060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.885+0000 7fec29555700 1 --2- 172.21.15.146:0/2221013666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec241306a0 0x7fec24114550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.885+0000 7fec28d54700 1 -- 172.21.15.146:0/2221013666 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec2412ddc0 msgr2=0x7fec24114060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.885+0000 7fec28d54700 1 --2- 172.21.15.146:0/2221013666 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec2412ddc0 0x7fec24114060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.885+0000 7fec28d54700 1 -- 172.21.15.146:0/2221013666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec241306a0 msgr2=0x7fec24114550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.885+0000 7fec28d54700 1 --2- 172.21.15.146:0/2221013666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec241306a0 0x7fec24114550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.885+0000 7fec28d54700 1 -- 172.21.15.146:0/2221013666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec100092a0 con 0x7fec2412aca0 2023-10-03T10:10:04.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.885+0000 7fec29555700 1 --2- 172.21.15.146:0/2221013666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec241306a0 0x7fec24114550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:04.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.885+0000 7fec28d54700 1 --2- 172.21.15.146:0/2221013666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2412aca0 0x7fec2412a210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fec1800c4c0 tx=0x7fec18007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.885+0000 7fec20ff9700 1 -- 172.21.15.146:0/2221013666 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1800ce30 con 0x7fec2412aca0 2023-10-03T10:10:04.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.885+0000 7fec20ff9700 1 -- 172.21.15.146:0/2221013666 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec180072e0 con 0x7fec2412aca0 2023-10-03T10:10:04.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.885+0000 7fec2afb8700 1 -- 172.21.15.146:0/2221013666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1c009ae0 con 0x7fec2412aca0 2023-10-03T10:10:04.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.885+0000 7fec20ff9700 1 -- 172.21.15.146:0/2221013666 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec180056e0 con 0x7fec2412aca0 2023-10-03T10:10:04.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.885+0000 7fec2afb8700 1 -- 172.21.15.146:0/2221013666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec24118430 con 0x7fec2412aca0 2023-10-03T10:10:04.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.886+0000 7fec20ff9700 1 -- 172.21.15.146:0/2221013666 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fec18005a90 con 0x7fec2412aca0 2023-10-03T10:10:04.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.886+0000 7fec20ff9700 1 -- 172.21.15.146:0/2221013666 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fec1803a4d0 con 0x7fec2412aca0 2023-10-03T10:10:04.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.889+0000 7fec3c96bb80 1 Processor -- start 2023-10-03T10:10:04.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.889+0000 7fec3c96bb80 1 -- start start 2023-10-03T10:10:04.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.889+0000 7fec3c96bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3ccee170 0x556d3ccee550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.889+0000 7fec3c96bb80 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cceea40 0x556d3cd180c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.889+0000 7fec3c96bb80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3cd185b0 0x556d3cd1a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.889+0000 7fec3c96bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3ccb8610 con 0x556d3ccee170 2023-10-03T10:10:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.889+0000 7fec3c96bb80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d3cc2edb0 con 0x556d3cd185b0 2023-10-03T10:10:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.889+0000 7fec3c96bb80 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x556d3cc44030 con 0x556d3cceea40 2023-10-03T10:10:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.889+0000 7fec28d54700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3ccee170 0x556d3ccee550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.889+0000 7fec23fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cceea40 0x556d3cd180c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.889+0000 7fec29555700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3cd185b0 0x556d3cd1a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.889+0000 7fec28d54700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3ccee170 0x556d3ccee550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59920/0 (socket says 172.21.15.146:59920) 2023-10-03T10:10:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.889+0000 7fec28d54700 1 -- 172.21.15.146:0/2114641436 learned_addr learned my addr 172.21.15.146:0/2114641436 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.889+0000 7fec28d54700 1 -- 172.21.15.146:0/2114641436 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cceea40 msgr2=0x556d3cd180c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.889+0000 7fec28d54700 1 --2- 172.21.15.146:0/2114641436 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cceea40 0x556d3cd180c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.889+0000 7fec28d54700 1 -- 172.21.15.146:0/2114641436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3cd185b0 msgr2=0x556d3cd1a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.889+0000 7fec28d54700 1 --2- 172.21.15.146:0/2114641436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3cd185b0 0x556d3cd1a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.889+0000 7fec28d54700 1 -- 172.21.15.146:0/2114641436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d3cadf710 con 0x556d3ccee170 2023-10-03T10:10:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.889+0000 7fec23fff700 1 --2- 172.21.15.146:0/2114641436 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cceea40 0x556d3cd180c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.889+0000 7fec29555700 1 --2- 172.21.15.146:0/2114641436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3cd185b0 0x556d3cd1a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.890+0000 7fec28d54700 1 --2- 172.21.15.146:0/2114641436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3ccee170 0x556d3ccee550 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fec180394c0 tx=0x7fec18015000).ready entity=mon.0 client_cookie=3a8549e89f5a57ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.890+0000 7fec0dffb700 1 -- 172.21.15.146:0/2114641436 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec18010300 con 0x556d3ccee170 2023-10-03T10:10:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.890+0000 7fec0dffb700 1 -- 172.21.15.146:0/2114641436 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec18010b30 con 0x556d3ccee170 2023-10-03T10:10:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.890+0000 7fec0dffb700 1 -- 172.21.15.146:0/2114641436 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec18005d40 con 0x556d3ccee170 2023-10-03T10:10:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.890+0000 7fec3c96bb80 1 -- 172.21.15.146:0/2114641436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3ccee170 msgr2=0x556d3ccee550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.890+0000 7fec3c96bb80 1 --2- 172.21.15.146:0/2114641436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3ccee170 0x556d3ccee550 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fec180394c0 tx=0x7fec18015000).stop 2023-10-03T10:10:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.890+0000 7fec3c96bb80 1 -- 172.21.15.146:0/2114641436 shutdown_connections 2023-10-03T10:10:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.890+0000 7fec3c96bb80 1 --2- 172.21.15.146:0/2114641436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3cd185b0 0x556d3cd1a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.890+0000 7fec3c96bb80 1 --2- 172.21.15.146:0/2114641436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3ccee170 0x556d3ccee550 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.890+0000 7fec3c96bb80 1 --2- 172.21.15.146:0/2114641436 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cceea40 0x556d3cd180c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.890+0000 7fec3c96bb80 1 -- 172.21.15.146:0/2114641436 >> 172.21.15.146:0/2114641436 conn(0x556d3cb5c940 msgr2=0x556d3cd0ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.890+0000 7fec3c96bb80 1 -- 172.21.15.146:0/2114641436 shutdown_connections 2023-10-03T10:10:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.890+0000 7fec3c96bb80 1 -- 172.21.15.146:0/2114641436 wait complete. 2023-10-03T10:10:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.891+0000 7fec3c96bb80 1 -- start start 2023-10-03T10:10:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.891+0000 7fec3c96bb80 1 Processor -- start 2023-10-03T10:10:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.891+0000 7fec3c96bb80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3ccee170 0x556d3cd082a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.891+0000 7fec3c96bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3cceea40 0x556d3cd08790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.891+0000 7fec3c96bb80 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cd185b0 0x556d3cd13b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.891+0000 7fec3c96bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3cc44170 con 0x556d3cceea40 2023-10-03T10:10:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.891+0000 7fec3c96bb80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d3cc443f0 con 0x556d3ccee170 2023-10-03T10:10:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.891+0000 7fec3c96bb80 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x556d3cc0f920 con 0x556d3cd185b0 2023-10-03T10:10:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec3c96bb80 10 client.0 ll_register_callbacks cb 0x556d3cbe4ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:10:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec28d54700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3ccee170 0x556d3cd082a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec28d54700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3ccee170 0x556d3cd082a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42864/0 (socket says 172.21.15.146:42864) 2023-10-03T10:10:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec28d54700 1 -- 172.21.15.146:0/567127225 learned_addr learned my addr 172.21.15.146:0/567127225 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec23fff700 1 --2- 172.21.15.146:0/567127225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3cceea40 0x556d3cd08790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec29555700 1 --2- 172.21.15.146:0/567127225 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cd185b0 0x556d3cd13b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec23fff700 1 -- 172.21.15.146:0/567127225 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cd185b0 msgr2=0x556d3cd13b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec23fff700 1 --2- 172.21.15.146:0/567127225 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cd185b0 0x556d3cd13b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec23fff700 1 -- 172.21.15.146:0/567127225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3ccee170 msgr2=0x556d3cd082a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec23fff700 1 --2- 172.21.15.146:0/567127225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3ccee170 0x556d3cd082a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec23fff700 1 -- 172.21.15.146:0/567127225 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1c009ae0 con 0x556d3cceea40 2023-10-03T10:10:04.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec28d54700 1 --2- 172.21.15.146:0/567127225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3ccee170 0x556d3cd082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:04.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec23fff700 1 --2- 172.21.15.146:0/567127225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3cceea40 0x556d3cd08790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fec2412cf50 tx=0x7fec10009060).ready entity=mon.0 client_cookie=358d27f836427190 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec02ffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-03T10:10:04.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec02ffd700 1 -- 172.21.15.146:0/567127225 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10009c90 con 0x556d3cceea40 2023-10-03T10:10:04.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec02ffd700 1 -- 172.21.15.146:0/567127225 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fec10014d00 con 0x556d3cceea40 2023-10-03T10:10:04.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec3c96bb80 1 -- 172.21.15.146:0/567127225 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556d3cce6f20 con 0x556d3cceea40 2023-10-03T10:10:04.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec02ffd700 1 -- 172.21.15.146:0/567127225 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=5) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec10014ec0 con 0x556d3cceea40 2023-10-03T10:10:04.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec3c96bb80 10 client.4644 fetch_fsmap learned FSMap version 5 2023-10-03T10:10:04.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec3c96bb80 1 -- 172.21.15.146:0/567127225 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=5,monmap=2+}) v3 -- 0x556d3cc16b00 con 0x556d3cceea40 2023-10-03T10:10:04.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec02ffd700 1 -- 172.21.15.146:0/567127225 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556d3cce6f20 con 0x556d3cceea40 2023-10-03T10:10:04.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec02ffd700 1 -- 172.21.15.146:0/567127225 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 5) v1 ==== 1430+0+0 (secure 0 0 0) 0x7fec10011070 con 0x556d3cceea40 2023-10-03T10:10:04.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec3c96bb80 10 client.4644 fetch_fsmap finished waiting for FSMap version 5 2023-10-03T10:10:04.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec3c96bb80 10 client.4644 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:10:04.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.892+0000 7fec3c96bb80 20 client.4644 populate_metadata read hostname 'smithi146' 2023-10-03T10:10:04.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.893+0000 7fec3c96bb80 4 client.4644 mds_command: new command op to 4181 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T10:10:04.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.893+0000 7fec3c96bb80 1 -- 172.21.15.146:0/567127225 --> v1:172.21.15.146:6817/4164614194 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556d3ccbc250 con 0x556d3cd14730 2023-10-03T10:10:04.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.893+0000 7fec02ffd700 10 client.4644 ms_handle_connect on v1:172.21.15.146:6817/4164614194 2023-10-03T10:10:04.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.893+0000 7fec02ffd700 1 -- 172.21.15.146:0/567127225 <== mds.0 v1:172.21.15.146:6817/4164614194 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x556d3ccbc250 con 0x556d3cd14730 2023-10-03T10:10:04.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.893+0000 7fec02ffd700 10 client.4644 handle_command_reply: tid=0 2023-10-03T10:10:04.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.893+0000 7fec3c96bb80 1 client.4644 shutdown 2023-10-03T10:10:04.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.894+0000 7fec3c96bb80 1 -- 172.21.15.146:0/567127225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3cceea40 msgr2=0x556d3cd08790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.894+0000 7fec3c96bb80 1 --2- 172.21.15.146:0/567127225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3cceea40 0x556d3cd08790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fec2412cf50 tx=0x7fec10009060).stop 2023-10-03T10:10:04.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.894+0000 7fec3c96bb80 1 -- 172.21.15.146:0/567127225 shutdown_connections 2023-10-03T10:10:04.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.894+0000 7fec3c96bb80 1 --2- 172.21.15.146:0/567127225 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cd185b0 0x556d3cd13b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.894+0000 7fec3c96bb80 1 --2- 172.21.15.146:0/567127225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3ccee170 0x556d3cd082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.894+0000 7fec02ffd700 0 client.4644 ms_handle_reset on v1:172.21.15.146:6817/4164614194 2023-10-03T10:10:04.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.894+0000 7fec3c96bb80 1 --2- 172.21.15.146:0/567127225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3cceea40 0x556d3cd08790 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.894+0000 7fec3c96bb80 1 -- 172.21.15.146:0/567127225 >> 172.21.15.146:0/567127225 conn(0x556d3cb5c940 msgr2=0x556d3cd0ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.894+0000 7fec3c96bb80 1 -- 172.21.15.146:0/567127225 shutdown_connections 2023-10-03T10:10:04.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.894+0000 7fec3c96bb80 1 -- 172.21.15.146:0/567127225 wait complete. 2023-10-03T10:10:04.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.894+0000 7fec3c96bb80 20 client.4644 trim_cache size 0 max 16384 2023-10-03T10:10:04.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.910+0000 7fec3c96bb80 1 Processor -- start 2023-10-03T10:10:04.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.910+0000 7fec3c96bb80 1 -- start start 2023-10-03T10:10:04.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.911+0000 7fec3c96bb80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3ccee170 0x556d3cd13aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.911+0000 7fec3c96bb80 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cceea40 0x556d3ccf2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.911+0000 7fec3c96bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3cd185b0 0x556d3cd12d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.911+0000 7fec3c96bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3cd162d0 con 0x556d3cd185b0 2023-10-03T10:10:04.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.911+0000 7fec3c96bb80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d3ccf1880 con 0x556d3ccee170 2023-10-03T10:10:04.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.911+0000 7fec3c96bb80 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x556d3ccee660 con 0x556d3cceea40 2023-10-03T10:10:04.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.911+0000 7fec23fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cceea40 0x556d3ccf2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.911+0000 7fec28d54700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3ccee170 0x556d3cd13aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.911+0000 7fec23fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cceea40 0x556d3ccf2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40178/0 (socket says 172.21.15.146:40178) 2023-10-03T10:10:04.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.911+0000 7fec28d54700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3ccee170 0x556d3cd13aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42866/0 (socket says 172.21.15.146:42866) 2023-10-03T10:10:04.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.911+0000 7fec23fff700 1 -- 172.21.15.146:0/3851884507 learned_addr learned my addr 172.21.15.146:0/3851884507 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:04.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.911+0000 7fec29555700 1 --2- 172.21.15.146:0/3851884507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3cd185b0 0x556d3cd12d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.911+0000 7fec28d54700 1 -- 172.21.15.146:0/3851884507 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cceea40 msgr2=0x556d3ccf2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.911+0000 7fec28d54700 1 --2- 172.21.15.146:0/3851884507 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cceea40 0x556d3ccf2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.911+0000 7fec28d54700 1 -- 172.21.15.146:0/3851884507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3cd185b0 msgr2=0x556d3cd12d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.911+0000 7fec28d54700 1 --2- 172.21.15.146:0/3851884507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3cd185b0 0x556d3cd12d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.911+0000 7fec28d54700 1 -- 172.21.15.146:0/3851884507 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d3cc3cf70 con 0x556d3ccee170 2023-10-03T10:10:04.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.911+0000 7fec23fff700 1 --2- 172.21.15.146:0/3851884507 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cceea40 0x556d3ccf2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:04.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.911+0000 7fec28d54700 1 --2- 172.21.15.146:0/3851884507 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3ccee170 0x556d3cd13aa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fec1800cfd0 tx=0x7fec18013000).ready entity=mon.1 client_cookie=1f0f6334da372dd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.911+0000 7fec0e7fc700 1 -- 172.21.15.146:0/3851884507 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec18010950 con 0x556d3ccee170 2023-10-03T10:10:04.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.911+0000 7fec0e7fc700 1 -- 172.21.15.146:0/3851884507 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec18010300 con 0x556d3ccee170 2023-10-03T10:10:04.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.911+0000 7fec0e7fc700 1 -- 172.21.15.146:0/3851884507 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec18010d40 con 0x556d3ccee170 2023-10-03T10:10:04.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.912+0000 7fec3c96bb80 1 -- 172.21.15.146:0/3851884507 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3ccee170 msgr2=0x556d3cd13aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.912+0000 7fec3c96bb80 1 --2- 172.21.15.146:0/3851884507 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3ccee170 0x556d3cd13aa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fec1800cfd0 tx=0x7fec18013000).stop 2023-10-03T10:10:04.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.912+0000 7fec3c96bb80 1 -- 172.21.15.146:0/3851884507 shutdown_connections 2023-10-03T10:10:04.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.912+0000 7fec3c96bb80 1 --2- 172.21.15.146:0/3851884507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3cd185b0 0x556d3cd12d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.912+0000 7fec3c96bb80 1 --2- 172.21.15.146:0/3851884507 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3ccee170 0x556d3cd13aa0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.912+0000 7fec3c96bb80 1 --2- 172.21.15.146:0/3851884507 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cceea40 0x556d3ccf2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.912+0000 7fec3c96bb80 1 -- 172.21.15.146:0/3851884507 >> 172.21.15.146:0/3851884507 conn(0x556d3cb5c940 msgr2=0x556d3ccecf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.912+0000 7fec3c96bb80 1 -- 172.21.15.146:0/3851884507 shutdown_connections 2023-10-03T10:10:04.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.912+0000 7fec3c96bb80 1 -- 172.21.15.146:0/3851884507 wait complete. 2023-10-03T10:10:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.912+0000 7fec3c96bb80 1 -- start start 2023-10-03T10:10:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.913+0000 7fec3c96bb80 1 Processor -- start 2023-10-03T10:10:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.913+0000 7fec3c96bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3ccee170 0x556d3cd72e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.913+0000 7fec3c96bb80 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cceea40 0x556d3cd73340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.913+0000 7fec3c96bb80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3cd185b0 0x556d3cd73830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.913+0000 7fec3c96bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3cd73d20 con 0x556d3ccee170 2023-10-03T10:10:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.913+0000 7fec3c96bb80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d3cceda20 con 0x556d3cd185b0 2023-10-03T10:10:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.913+0000 7fec3c96bb80 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x556d3cd24610 con 0x556d3cceea40 2023-10-03T10:10:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.913+0000 7fec3c96bb80 10 client.0 ll_register_callbacks cb 0x556d3cbe4ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:10:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.913+0000 7fec23fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cceea40 0x556d3cd73340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.913+0000 7fec29555700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3cd185b0 0x556d3cd73830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.913+0000 7fec28d54700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3ccee170 0x556d3cd72e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.913+0000 7fec23fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cceea40 0x556d3cd73340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40192/0 (socket says 172.21.15.146:40192) 2023-10-03T10:10:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.913+0000 7fec23fff700 1 -- 172.21.15.146:0/1365180888 learned_addr learned my addr 172.21.15.146:0/1365180888 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.913+0000 7fec23fff700 1 -- 172.21.15.146:0/1365180888 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3cd185b0 msgr2=0x556d3cd73830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.913+0000 7fec23fff700 1 --2- 172.21.15.146:0/1365180888 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3cd185b0 0x556d3cd73830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.913+0000 7fec23fff700 1 -- 172.21.15.146:0/1365180888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3ccee170 msgr2=0x556d3cd72e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.913+0000 7fec23fff700 1 --2- 172.21.15.146:0/1365180888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3ccee170 0x556d3cd72e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.914+0000 7fec23fff700 1 -- 172.21.15.146:0/1365180888 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d3cc16b00 con 0x556d3cceea40 2023-10-03T10:10:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.914+0000 7fec29555700 1 --2- 172.21.15.146:0/1365180888 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3cd185b0 0x556d3cd73830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.914+0000 7fec28d54700 1 --2- 172.21.15.146:0/1365180888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3ccee170 0x556d3cd72e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.914+0000 7fec23fff700 1 --2- 172.21.15.146:0/1365180888 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cceea40 0x556d3cd73340 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fec10000c00 tx=0x7fec1001e000).ready entity=mon.2 client_cookie=557d59655afc2621 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.914+0000 7fec02ffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3302/0 2023-10-03T10:10:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.914+0000 7fec02ffd700 1 -- 172.21.15.146:0/1365180888 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10030070 con 0x556d3cceea40 2023-10-03T10:10:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.914+0000 7fec02ffd700 1 -- 172.21.15.146:0/1365180888 <== mon.2 v2:172.21.15.146:3302/0 2 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fec1001f600 con 0x556d3cceea40 2023-10-03T10:10:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.914+0000 7fec3c96bb80 1 -- 172.21.15.146:0/1365180888 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fec18010b30 con 0x556d3cceea40 2023-10-03T10:10:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.914+0000 7fec02ffd700 1 -- 172.21.15.146:0/1365180888 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_get_version_reply(handle=1 version=5) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec1001f9d0 con 0x556d3cceea40 2023-10-03T10:10:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.914+0000 7fec3c96bb80 10 client.4478 fetch_fsmap learned FSMap version 5 2023-10-03T10:10:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.914+0000 7fec3c96bb80 1 -- 172.21.15.146:0/1365180888 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,fsmap=5,monmap=2+}) v3 -- 0x556d3cadf710 con 0x556d3cceea40 2023-10-03T10:10:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.914+0000 7fec02ffd700 1 -- 172.21.15.146:0/1365180888 <== mon.2 v2:172.21.15.146:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec18010b30 con 0x556d3cceea40 2023-10-03T10:10:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.914+0000 7fec02ffd700 1 -- 172.21.15.146:0/1365180888 <== mon.2 v2:172.21.15.146:3302/0 5 ==== fsmap(e 5) v1 ==== 1430+0+0 (secure 0 0 0) 0x7fec1002aa50 con 0x556d3cceea40 2023-10-03T10:10:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.914+0000 7fec3c96bb80 10 client.4478 fetch_fsmap finished waiting for FSMap version 5 2023-10-03T10:10:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.914+0000 7fec3c96bb80 10 client.4478 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:10:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.914+0000 7fec3c96bb80 20 client.4478 populate_metadata read hostname 'smithi146' 2023-10-03T10:10:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.914+0000 7fec3c96bb80 4 client.4478 mds_command: new command op to 4181 tid=0[{"prefix": "status"}] 2023-10-03T10:10:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.914+0000 7fec3c96bb80 1 -- 172.21.15.146:0/1365180888 --> v1:172.21.15.146:6817/4164614194 -- command(tid 0: {"prefix": "status"}) v1 -- 0x556d3caacef0 con 0x556d3cd1b7f0 2023-10-03T10:10:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.914+0000 7fec02ffd700 10 client.4478 ms_handle_connect on v1:172.21.15.146:6817/4164614194 2023-10-03T10:10:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.915+0000 7fec02ffd700 1 -- 172.21.15.146:0/1365180888 <== mds.0 v1:172.21.15.146:6817/4164614194 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (unknown 0 0 34609817) 0x556d3caacef0 con 0x556d3cd1b7f0 2023-10-03T10:10:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.915+0000 7fec02ffd700 10 client.4478 handle_command_reply: tid=0 2023-10-03T10:10:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.915+0000 7fec3c96bb80 1 client.4478 shutdown 2023-10-03T10:10:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.915+0000 7fec3c96bb80 1 -- 172.21.15.146:0/1365180888 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cceea40 msgr2=0x556d3cd73340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.915+0000 7fec3c96bb80 1 --2- 172.21.15.146:0/1365180888 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cceea40 0x556d3cd73340 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fec10000c00 tx=0x7fec1001e000).stop 2023-10-03T10:10:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.915+0000 7fec3c96bb80 1 -- 172.21.15.146:0/1365180888 shutdown_connections 2023-10-03T10:10:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.915+0000 7fec3c96bb80 1 --2- 172.21.15.146:0/1365180888 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556d3cd185b0 0x556d3cd73830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.915+0000 7fec02ffd700 0 client.4478 ms_handle_reset on v1:172.21.15.146:6817/4164614194 2023-10-03T10:10:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.915+0000 7fec3c96bb80 1 --2- 172.21.15.146:0/1365180888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556d3ccee170 0x556d3cd72e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.915+0000 7fec3c96bb80 1 --2- 172.21.15.146:0/1365180888 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x556d3cceea40 0x556d3cd73340 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.915+0000 7fec3c96bb80 1 -- 172.21.15.146:0/1365180888 >> 172.21.15.146:0/1365180888 conn(0x556d3cb5c940 msgr2=0x556d3ccf2270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.915+0000 7fec3c96bb80 1 -- 172.21.15.146:0/1365180888 shutdown_connections 2023-10-03T10:10:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.915+0000 7fec3c96bb80 1 -- 172.21.15.146:0/1365180888 wait complete. 2023-10-03T10:10:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.915+0000 7fec3c96bb80 20 client.4478 trim_cache size 0 max 16384 2023-10-03T10:10:04.923 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-03T10:10:04.923 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "5440411f-9bdd-4ef1-85ef-960d00aa215c", 2023-10-03T10:10:04.923 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2023-10-03T10:10:04.923 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 4181, 2023-10-03T10:10:04.923 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2023-10-03T10:10:04.923 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2023-10-03T10:10:04.923 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2023-10-03T10:10:04.923 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 16.190671504000001, 2023-10-03T10:10:04.923 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 5, 2023-10-03T10:10:04.924 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 16, 2023-10-03T10:10:04.924 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 16, 2023-10-03T10:10:04.924 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 20.484026492999998 2023-10-03T10:10:04.924 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-03T10:10:04.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.916+0000 7fec2afb8700 1 -- 172.21.15.146:0/2221013666 >> v1:172.21.15.146:6816/118159 conn(0x7fec0802bb60 legacy=0x7fec0802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.916+0000 7fec2afb8700 1 -- 172.21.15.146:0/2221013666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2412aca0 msgr2=0x7fec2412a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:04.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.916+0000 7fec2afb8700 1 --2- 172.21.15.146:0/2221013666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2412aca0 0x7fec2412a210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fec1800c4c0 tx=0x7fec18007c10).stop 2023-10-03T10:10:04.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.916+0000 7fec2afb8700 1 -- 172.21.15.146:0/2221013666 shutdown_connections 2023-10-03T10:10:04.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.916+0000 7fec2afb8700 1 --2- 172.21.15.146:0/2221013666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec241306a0 0x7fec24114550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.916+0000 7fec2afb8700 1 --2- 172.21.15.146:0/2221013666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2412aca0 0x7fec2412a210 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.916+0000 7fec2afb8700 1 --2- 172.21.15.146:0/2221013666 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec2412ddc0 0x7fec24114060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:04.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.916+0000 7fec2afb8700 1 -- 172.21.15.146:0/2221013666 >> 172.21.15.146:0/2221013666 conn(0x7fec24062b00 msgr2=0x7fec2412d300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:04.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.916+0000 7fec2afb8700 1 -- 172.21.15.146:0/2221013666 shutdown_connections 2023-10-03T10:10:04.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:04.916+0000 7fec2afb8700 1 -- 172.21.15.146:0/2221013666 wait complete. 2023-10-03T10:10:04.928 INFO:teuthology.run_tasks:Running task exec... 2023-10-03T10:10:04.937 INFO:teuthology.task.exec:Executing custom commands... 2023-10-03T10:10:04.938 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T10:10:04.938 DEBUG:teuthology.orchestra.run.smithi146:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client pacific' 2023-10-03T10:10:05.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.052+0000 7fcb5b7a3700 1 Processor -- start 2023-10-03T10:10:05.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.052+0000 7fcb5b7a3700 1 -- start start 2023-10-03T10:10:05.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.052+0000 7fcb5b7a3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb54095740 0x7fcb54095b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:05.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.052+0000 7fcb5b7a3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb54091c60 0x7fcb54096010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:05.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.052+0000 7fcb5b7a3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcb54096500 0x7fcb5412e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:05.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.052+0000 7fcb5b7a3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb54093f60 con 0x7fcb54096500 2023-10-03T10:10:05.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.052+0000 7fcb5b7a3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb540949e0 con 0x7fcb54091c60 2023-10-03T10:10:05.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.052+0000 7fcb5b7a3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb54097180 con 0x7fcb54095740 2023-10-03T10:10:05.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.052+0000 7fcb58d3e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb54091c60 0x7fcb54096010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:05.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.052+0000 7fcb59d40700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcb54096500 0x7fcb5412e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.052+0000 7fcb5953f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb54095740 0x7fcb54095b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.052+0000 7fcb58d3e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb54091c60 0x7fcb54096010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42890/0 (socket says 172.21.15.146:42890) 2023-10-03T10:10:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.052+0000 7fcb59d40700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcb54096500 0x7fcb5412e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59948/0 (socket says 172.21.15.146:59948) 2023-10-03T10:10:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.052+0000 7fcb5953f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb54095740 0x7fcb54095b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40196/0 (socket says 172.21.15.146:40196) 2023-10-03T10:10:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.052+0000 7fcb58d3e700 1 -- 172.21.15.146:0/2090737339 learned_addr learned my addr 172.21.15.146:0/2090737339 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.053+0000 7fcb59d40700 1 -- 172.21.15.146:0/2090737339 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb54095740 msgr2=0x7fcb54095b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.053+0000 7fcb59d40700 1 --2- 172.21.15.146:0/2090737339 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb54095740 0x7fcb54095b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.053+0000 7fcb59d40700 1 -- 172.21.15.146:0/2090737339 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb54091c60 msgr2=0x7fcb54096010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.053+0000 7fcb59d40700 1 --2- 172.21.15.146:0/2090737339 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb54091c60 0x7fcb54096010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.053+0000 7fcb59d40700 1 -- 172.21.15.146:0/2090737339 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb540920e0 con 0x7fcb54096500 2023-10-03T10:10:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.053+0000 7fcb58d3e700 1 --2- 172.21.15.146:0/2090737339 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb54091c60 0x7fcb54096010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.053+0000 7fcb5953f700 1 --2- 172.21.15.146:0/2090737339 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb54095740 0x7fcb54095b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.053+0000 7fcb59d40700 1 --2- 172.21.15.146:0/2090737339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb54096500 0x7fcb5412e1b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fcb4c009e60 tx=0x7fcb4c009780).ready entity=mon.0 client_cookie=3222425905db6f73 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.053+0000 7fcb4bfff700 1 -- 172.21.15.146:0/2090737339 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c00e070 con 0x7fcb54096500 2023-10-03T10:10:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.053+0000 7fcb4bfff700 1 -- 172.21.15.146:0/2090737339 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c00bab0 con 0x7fcb54096500 2023-10-03T10:10:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.053+0000 7fcb4bfff700 1 -- 172.21.15.146:0/2090737339 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c00be30 con 0x7fcb54096500 2023-10-03T10:10:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.053+0000 7fcb5b7a3700 1 -- 172.21.15.146:0/2090737339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb54096500 msgr2=0x7fcb5412e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.053+0000 7fcb5b7a3700 1 --2- 172.21.15.146:0/2090737339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb54096500 0x7fcb5412e1b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fcb4c009e60 tx=0x7fcb4c009780).stop 2023-10-03T10:10:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.054+0000 7fcb5b7a3700 1 -- 172.21.15.146:0/2090737339 shutdown_connections 2023-10-03T10:10:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.054+0000 7fcb5b7a3700 1 --2- 172.21.15.146:0/2090737339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb54096500 0x7fcb5412e1b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.054+0000 7fcb5b7a3700 1 --2- 172.21.15.146:0/2090737339 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb54095740 0x7fcb54095b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.054+0000 7fcb5b7a3700 1 --2- 172.21.15.146:0/2090737339 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb54091c60 0x7fcb54096010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.054+0000 7fcb5b7a3700 1 -- 172.21.15.146:0/2090737339 >> 172.21.15.146:0/2090737339 conn(0x7fcb5409a9b0 msgr2=0x7fcb5409adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.054+0000 7fcb5b7a3700 1 -- 172.21.15.146:0/2090737339 shutdown_connections 2023-10-03T10:10:05.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.054+0000 7fcb5b7a3700 1 -- 172.21.15.146:0/2090737339 wait complete. 2023-10-03T10:10:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.055+0000 7fcb5b7a3700 1 Processor -- start 2023-10-03T10:10:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.055+0000 7fcb5b7a3700 1 -- start start 2023-10-03T10:10:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.056+0000 7fcb5b7a3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb54091c60 0x7fcb54136c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.056+0000 7fcb5b7a3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb54095740 0x7fcb54137110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.056+0000 7fcb5b7a3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb54096500 0x7fcb54137600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.056+0000 7fcb5b7a3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5411a990 con 0x7fcb54091c60 2023-10-03T10:10:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.056+0000 7fcb5b7a3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb54092360 con 0x7fcb54096500 2023-10-03T10:10:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.056+0000 7fcb5b7a3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5406a610 con 0x7fcb54095740 2023-10-03T10:10:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.056+0000 7fcb5953f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb54091c60 0x7fcb54136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.056+0000 7fcb5953f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb54091c60 0x7fcb54136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59950/0 (socket says 172.21.15.146:59950) 2023-10-03T10:10:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.056+0000 7fcb5953f700 1 -- 172.21.15.146:0/700512563 learned_addr learned my addr 172.21.15.146:0/700512563 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.056+0000 7fcb59d40700 1 --2- 172.21.15.146:0/700512563 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb54096500 0x7fcb54137600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.056+0000 7fcb58d3e700 1 --2- 172.21.15.146:0/700512563 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb54095740 0x7fcb54137110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.056+0000 7fcb5953f700 1 -- 172.21.15.146:0/700512563 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb54095740 msgr2=0x7fcb54137110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.056+0000 7fcb5953f700 1 --2- 172.21.15.146:0/700512563 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb54095740 0x7fcb54137110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.056+0000 7fcb5953f700 1 -- 172.21.15.146:0/700512563 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb54096500 msgr2=0x7fcb54137600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.056+0000 7fcb5953f700 1 --2- 172.21.15.146:0/700512563 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb54096500 0x7fcb54137600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.056+0000 7fcb5953f700 1 -- 172.21.15.146:0/700512563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb50009370 con 0x7fcb54091c60 2023-10-03T10:10:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.056+0000 7fcb5953f700 1 --2- 172.21.15.146:0/700512563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb54091c60 0x7fcb54136c20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fcb4400ea50 tx=0x7fcb44009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.056+0000 7fcb497fa700 1 -- 172.21.15.146:0/700512563 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4400ee90 con 0x7fcb54091c60 2023-10-03T10:10:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.056+0000 7fcb497fa700 1 -- 172.21.15.146:0/700512563 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4400c850 con 0x7fcb54091c60 2023-10-03T10:10:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.056+0000 7fcb5b7a3700 1 -- 172.21.15.146:0/700512563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb440092a0 con 0x7fcb54091c60 2023-10-03T10:10:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.056+0000 7fcb497fa700 1 -- 172.21.15.146:0/700512563 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4400cbd0 con 0x7fcb54091c60 2023-10-03T10:10:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.056+0000 7fcb5b7a3700 1 -- 172.21.15.146:0/700512563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4c009a20 con 0x7fcb54091c60 2023-10-03T10:10:05.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.057+0000 7fcb497fa700 1 -- 172.21.15.146:0/700512563 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fcb4401b400 con 0x7fcb54091c60 2023-10-03T10:10:05.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.057+0000 7fcb497fa700 1 -- 172.21.15.146:0/700512563 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fcb4403b510 con 0x7fcb54091c60 2023-10-03T10:10:05.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.057+0000 7fcb5b7a3700 1 -- 172.21.15.146:0/700512563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb5409a3e0 con 0x7fcb54091c60 2023-10-03T10:10:05.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.062+0000 7fcb497fa700 1 -- 172.21.15.146:0/700512563 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fcb440123f0 con 0x7fcb54091c60 2023-10-03T10:10:05.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.228+0000 7fcb5b7a3700 1 -- 172.21.15.146:0/700512563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "pacific"} v 0) v1 -- 0x7fcb5405a260 con 0x7fcb54091c60 2023-10-03T10:10:05.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.769+0000 7fcb497fa700 1 -- 172.21.15.146:0/700512563 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "pacific"}]=0 set require_min_compat_client to pacific v17) v1 ==== 143+0+0 (secure 0 0 0) 0x7fcb44011350 con 0x7fcb54091c60 2023-10-03T10:10:05.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.773+0000 7fcb5b7a3700 1 -- 172.21.15.146:0/700512563 >> v1:172.21.15.146:6816/118159 conn(0x7fcb3802bb60 legacy=0x7fcb3802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:05.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.773+0000 7fcb5b7a3700 1 -- 172.21.15.146:0/700512563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb54091c60 msgr2=0x7fcb54136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:05.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.773+0000 7fcb5b7a3700 1 --2- 172.21.15.146:0/700512563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb54091c60 0x7fcb54136c20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fcb4400ea50 tx=0x7fcb44009060).stop 2023-10-03T10:10:05.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.773+0000 7fcb5b7a3700 1 -- 172.21.15.146:0/700512563 shutdown_connections 2023-10-03T10:10:05.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.773+0000 7fcb5b7a3700 1 --2- 172.21.15.146:0/700512563 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb54096500 0x7fcb54137600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.773+0000 7fcb5b7a3700 1 --2- 172.21.15.146:0/700512563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb54091c60 0x7fcb54136c20 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0x7fcb4400ea50 tx=0x7fcb44009060).stop 2023-10-03T10:10:05.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.773+0000 7fcb5b7a3700 1 --2- 172.21.15.146:0/700512563 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb54095740 0x7fcb54137110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.773+0000 7fcb5b7a3700 1 -- 172.21.15.146:0/700512563 >> 172.21.15.146:0/700512563 conn(0x7fcb5409a9b0 msgr2=0x7fcb54098870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:05.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.774+0000 7fcb5b7a3700 1 -- 172.21.15.146:0/700512563 shutdown_connections 2023-10-03T10:10:05.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:05.774+0000 7fcb5b7a3700 1 -- 172.21.15.146:0/700512563 wait complete. 2023-10-03T10:10:05.775 INFO:teuthology.orchestra.run.smithi146.stderr:set require_min_compat_client to pacific 2023-10-03T10:10:05.789 INFO:teuthology.run_tasks:Running task print... 2023-10-03T10:10:05.799 INFO:teuthology.task.print:**** done ceph 2023-10-03T10:10:05.799 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-03T10:10:05.823 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-03T10:10:05.823 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-10-03T10:10:05.823 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-03T10:10:05.824 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-03T10:10:05.824 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-03T10:10:05.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:05.824 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-10-03T10:10:05.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:05.847 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2023-10-03T10:10:05.923 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2023-10-03T10:10:05.925 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:10:05.925 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-03T10:10:05.925 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-03T10:10:06.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.050+0000 7fe6c051e700 1 Processor -- start 2023-10-03T10:10:06.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.050+0000 7fe6c051e700 1 -- start start 2023-10-03T10:10:06.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.050+0000 7fe6c051e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe6b8092390 0x7fe6b8097aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.050+0000 7fe6c051e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6b8123a90 0x7fe6b8123f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.050+0000 7fe6c051e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b8126fe0 0x7fe6b8127490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.050+0000 7fe6c051e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b8092770 con 0x7fe6b8092390 2023-10-03T10:10:06.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.050+0000 7fe6c051e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b8069550 con 0x7fe6b8126fe0 2023-10-03T10:10:06.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.050+0000 7fe6c051e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b8068c10 con 0x7fe6b8123a90 2023-10-03T10:10:06.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.050+0000 7fe6be2ba700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe6b8092390 0x7fe6b8097aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.050+0000 7fe6beabb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b8126fe0 0x7fe6b8127490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.050+0000 7fe6bdab9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6b8123a90 0x7fe6b8123f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.050+0000 7fe6bdab9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6b8123a90 0x7fe6b8123f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40202/0 (socket says 172.21.15.146:40202) 2023-10-03T10:10:06.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.050+0000 7fe6be2ba700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe6b8092390 0x7fe6b8097aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59964/0 (socket says 172.21.15.146:59964) 2023-10-03T10:10:06.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.050+0000 7fe6beabb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b8126fe0 0x7fe6b8127490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42906/0 (socket says 172.21.15.146:42906) 2023-10-03T10:10:06.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.050+0000 7fe6bdab9700 1 -- 172.21.15.146:0/2403386037 learned_addr learned my addr 172.21.15.146:0/2403386037 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:06.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.051+0000 7fe6bdab9700 1 -- 172.21.15.146:0/2403386037 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b8126fe0 msgr2=0x7fe6b8127490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:06.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.051+0000 7fe6bdab9700 1 --2- 172.21.15.146:0/2403386037 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b8126fe0 0x7fe6b8127490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.051+0000 7fe6bdab9700 1 -- 172.21.15.146:0/2403386037 >> v2:172.21.15.146:3300/0 conn(0x7fe6b8092390 msgr2=0x7fe6b8097aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:06.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.051+0000 7fe6bdab9700 1 --2- 172.21.15.146:0/2403386037 >> v2:172.21.15.146:3300/0 conn(0x7fe6b8092390 0x7fe6b8097aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.051+0000 7fe6bdab9700 1 -- 172.21.15.146:0/2403386037 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b8124550 con 0x7fe6b8123a90 2023-10-03T10:10:06.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.051+0000 7fe6be2ba700 1 --2- 172.21.15.146:0/2403386037 >> v2:172.21.15.146:3300/0 conn(0x7fe6b8092390 0x7fe6b8097aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:06.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.051+0000 7fe6beabb700 1 --2- 172.21.15.146:0/2403386037 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b8126fe0 0x7fe6b8127490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:06.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.051+0000 7fe6bdab9700 1 --2- 172.21.15.146:0/2403386037 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6b8123a90 0x7fe6b8123f10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe6b4006fd0 tx=0x7fe6b400b3b0).ready entity=mon.2 client_cookie=3dbf742151c578d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:06.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.051+0000 7fe6bd2b8700 1 -- 172.21.15.146:0/2403386037 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400da70 con 0x7fe6b8123a90 2023-10-03T10:10:06.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.051+0000 7fe6bd2b8700 1 -- 172.21.15.146:0/2403386037 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b400dbd0 con 0x7fe6b8123a90 2023-10-03T10:10:06.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.051+0000 7fe6bd2b8700 1 -- 172.21.15.146:0/2403386037 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4010470 con 0x7fe6b8123a90 2023-10-03T10:10:06.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.052+0000 7fe6c051e700 1 -- 172.21.15.146:0/2403386037 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6b8123a90 msgr2=0x7fe6b8123f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.052+0000 7fe6c051e700 1 --2- 172.21.15.146:0/2403386037 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6b8123a90 0x7fe6b8123f10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe6b4006fd0 tx=0x7fe6b400b3b0).stop 2023-10-03T10:10:06.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.052+0000 7fe6c051e700 1 -- 172.21.15.146:0/2403386037 shutdown_connections 2023-10-03T10:10:06.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.052+0000 7fe6c051e700 1 --2- 172.21.15.146:0/2403386037 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b8126fe0 0x7fe6b8127490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.052+0000 7fe6c051e700 1 --2- 172.21.15.146:0/2403386037 >> v2:172.21.15.146:3300/0 conn(0x7fe6b8092390 0x7fe6b8097aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.052+0000 7fe6c051e700 1 --2- 172.21.15.146:0/2403386037 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6b8123a90 0x7fe6b8123f10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.052+0000 7fe6c051e700 1 -- 172.21.15.146:0/2403386037 >> 172.21.15.146:0/2403386037 conn(0x7fe6b809a230 msgr2=0x7fe6b809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:06.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.052+0000 7fe6c051e700 1 -- 172.21.15.146:0/2403386037 shutdown_connections 2023-10-03T10:10:06.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.052+0000 7fe6c051e700 1 -- 172.21.15.146:0/2403386037 wait complete. 2023-10-03T10:10:06.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.052+0000 7fe6c051e700 1 Processor -- start 2023-10-03T10:10:06.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.052+0000 7fe6c051e700 1 -- start start 2023-10-03T10:10:06.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.053+0000 7fe6c051e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b8092390 0x7fe6b81362f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.053+0000 7fe6c051e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6b8123a90 0x7fe6b81367e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.053+0000 7fe6c051e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6b8126fe0 0x7fe6b8136cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.053+0000 7fe6c051e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b81141b0 con 0x7fe6b8126fe0 2023-10-03T10:10:06.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.053+0000 7fe6c051e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b8112360 con 0x7fe6b8092390 2023-10-03T10:10:06.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.053+0000 7fe6c051e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b8069780 con 0x7fe6b8123a90 2023-10-03T10:10:06.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.053+0000 7fe6be2ba700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b8092390 0x7fe6b81362f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.053+0000 7fe6be2ba700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b8092390 0x7fe6b81362f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42914/0 (socket says 172.21.15.146:42914) 2023-10-03T10:10:06.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.053+0000 7fe6be2ba700 1 -- 172.21.15.146:0/2722911651 learned_addr learned my addr 172.21.15.146:0/2722911651 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:06.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.053+0000 7fe6beabb700 1 --2- 172.21.15.146:0/2722911651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6b8126fe0 0x7fe6b8136cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.053+0000 7fe6bdab9700 1 --2- 172.21.15.146:0/2722911651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6b8123a90 0x7fe6b81367e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.053+0000 7fe6beabb700 1 -- 172.21.15.146:0/2722911651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6b8123a90 msgr2=0x7fe6b81367e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.053+0000 7fe6beabb700 1 --2- 172.21.15.146:0/2722911651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6b8123a90 0x7fe6b81367e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.053+0000 7fe6beabb700 1 -- 172.21.15.146:0/2722911651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b8092390 msgr2=0x7fe6b81362f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.053+0000 7fe6beabb700 1 --2- 172.21.15.146:0/2722911651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b8092390 0x7fe6b81362f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.053+0000 7fe6beabb700 1 -- 172.21.15.146:0/2722911651 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a80092a0 con 0x7fe6b8126fe0 2023-10-03T10:10:06.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.053+0000 7fe6be2ba700 1 --2- 172.21.15.146:0/2722911651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b8092390 0x7fe6b81362f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:06.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.053+0000 7fe6bdab9700 1 --2- 172.21.15.146:0/2722911651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6b8123a90 0x7fe6b81367e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:06.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.053+0000 7fe6beabb700 1 --2- 172.21.15.146:0/2722911651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6b8126fe0 0x7fe6b8136cd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fe6b0009f10 tx=0x7fe6b000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:06.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.054+0000 7fe6ae7fc700 1 -- 172.21.15.146:0/2722911651 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b000cb70 con 0x7fe6b8126fe0 2023-10-03T10:10:06.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.054+0000 7fe6ae7fc700 1 -- 172.21.15.146:0/2722911651 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b000f040 con 0x7fe6b8126fe0 2023-10-03T10:10:06.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.054+0000 7fe6c051e700 1 -- 172.21.15.146:0/2722911651 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b0009a20 con 0x7fe6b8126fe0 2023-10-03T10:10:06.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.054+0000 7fe6ae7fc700 1 -- 172.21.15.146:0/2722911651 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0013400 con 0x7fe6b8126fe0 2023-10-03T10:10:06.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.054+0000 7fe6c051e700 1 -- 172.21.15.146:0/2722911651 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b400b610 con 0x7fe6b8126fe0 2023-10-03T10:10:06.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.054+0000 7fe6ae7fc700 1 -- 172.21.15.146:0/2722911651 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe6b00137f0 con 0x7fe6b8126fe0 2023-10-03T10:10:06.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.054+0000 7fe6ae7fc700 1 -- 172.21.15.146:0/2722911651 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe6b003b860 con 0x7fe6b8126fe0 2023-10-03T10:10:06.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.055+0000 7fe6c051e700 1 -- 172.21.15.146:0/2722911651 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b8126e20 con 0x7fe6b8126fe0 2023-10-03T10:10:06.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.059+0000 7fe6ae7fc700 1 -- 172.21.15.146:0/2722911651 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe6b0013aa0 con 0x7fe6b8126fe0 2023-10-03T10:10:06.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.255+0000 7fe6c051e700 1 -- 172.21.15.146:0/2722911651 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe6b805a260 con 0x7fe6b8126fe0 2023-10-03T10:10:06.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.256+0000 7fe6ae7fc700 1 -- 172.21.15.146:0/2722911651 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v5) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe6b001b7e0 con 0x7fe6b8126fe0 2023-10-03T10:10:06.257 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-03T10:10:06.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.258+0000 7fe6c051e700 1 -- 172.21.15.146:0/2722911651 >> v1:172.21.15.146:6816/118159 conn(0x7fe69c02bb60 legacy=0x7fe69c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.258+0000 7fe6c051e700 1 -- 172.21.15.146:0/2722911651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6b8126fe0 msgr2=0x7fe6b8136cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.258+0000 7fe6c051e700 1 --2- 172.21.15.146:0/2722911651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6b8126fe0 0x7fe6b8136cd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fe6b0009f10 tx=0x7fe6b000b040).stop 2023-10-03T10:10:06.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.258+0000 7fe6c051e700 1 -- 172.21.15.146:0/2722911651 shutdown_connections 2023-10-03T10:10:06.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.258+0000 7fe6c051e700 1 --2- 172.21.15.146:0/2722911651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6b8126fe0 0x7fe6b8136cd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.258+0000 7fe6c051e700 1 --2- 172.21.15.146:0/2722911651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b8092390 0x7fe6b81362f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.258+0000 7fe6c051e700 1 --2- 172.21.15.146:0/2722911651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6b8123a90 0x7fe6b81367e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.258+0000 7fe6c051e700 1 -- 172.21.15.146:0/2722911651 >> 172.21.15.146:0/2722911651 conn(0x7fe6b809a230 msgr2=0x7fe6b8066cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:06.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.258+0000 7fe6c051e700 1 -- 172.21.15.146:0/2722911651 shutdown_connections 2023-10-03T10:10:06.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:06.258+0000 7fe6c051e700 1 -- 172.21.15.146:0/2722911651 wait complete. 2023-10-03T10:10:06.270 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-03T10:10:06.270 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-03T10:10:06.270 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2023-10-03T10:10:06.270 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-03T10:10:06.270 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-03T10:10:06.270 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-03T10:10:06.270 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-03T10:10:06.271 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-03T10:10:06.271 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T10:10:06.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:06.271 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2023-10-03T10:10:06.294 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-03T10:10:06.294 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-03T10:10:06.294 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-10-03T10:10:06.294 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-10-03T10:10:06.294 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-10-03T10:10:06.294 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-10-03T10:10:06.294 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-03T10:10:06.294 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2023-10-03T10:10:06.294 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2023-10-03T10:10:06.294 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-03T10:10:06.294 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2023-10-03T10:10:06.295 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2023-10-03T10:10:06.295 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-03T10:10:06.295 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2023-10-03T10:10:06.295 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-03T10:10:06.295 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2023-10-03T10:10:06.295 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-03T10:10:06.295 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42531sec preferred_lft 42531sec 2023-10-03T10:10:06.295 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2023-10-03T10:10:06.295 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-10-03T10:10:06.296 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-03T10:10:06.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:06.296 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-10-03T10:10:06.296 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-10-03T10:10:06.296 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add name ceph-brx type bridge 2023-10-03T10:10:06.296 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr flush dev ceph-brx 2023-10-03T10:10:06.296 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set ceph-brx up 2023-10-03T10:10:06.296 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-03T10:10:06.296 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-10-03T10:10:06.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:06.465 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-03T10:10:06.496 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-10-03T10:10:06.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:06.498 DEBUG:teuthology.orchestra.run.smithi153:> route 2023-10-03T10:10:06.576 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2023-10-03T10:10:06.576 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-03T10:10:06.576 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-03T10:10:06.576 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-03T10:10:06.576 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-03T10:10:06.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:06.578 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-10-03T10:10:06.578 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-10-03T10:10:06.578 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-03T10:10:06.578 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-03T10:10:06.578 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-03T10:10:06.578 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-10-03T10:10:06.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:06.859 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-10-03T10:10:06.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:06.877 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2023-10-03T10:10:06.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:06.935 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-10-03T10:10:06.935 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-10-03T10:10:06.935 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:10:06.936 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-03T10:10:06.936 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-10-03T10:10:07.029 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-03T10:10:07.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:07.030 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-10-03T10:10:07.030 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-10-03T10:10:07.030 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-03T10:10:07.030 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-03T10:10:07.030 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-03T10:10:07.030 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-03T10:10:07.030 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-03T10:10:07.030 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-10-03T10:10:07.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:07.216 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-10-03T10:10:07.216 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-10-03T10:10:07.216 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2023-10-03T10:10:07.217 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.0 master ceph-brx 2023-10-03T10:10:07.217 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-10-03T10:10:07.314 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-03T10:10:07.314 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T10:10:07.314 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-03T10:10:07.331 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-03T10:10:07.331 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T10:10:07.332 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-03T10:10:07.389 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2023-10-03T10:10:07.455 DEBUG:teuthology.orchestra.run.smithi153:> cat /proc/self/mounts | awk '{print $2}' 2023-10-03T10:10:07.514 INFO:teuthology.orchestra.run.smithi153.stdout:/sys 2023-10-03T10:10:07.514 INFO:teuthology.orchestra.run.smithi153.stdout:/proc 2023-10-03T10:10:07.514 INFO:teuthology.orchestra.run.smithi153.stdout:/dev 2023-10-03T10:10:07.514 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/security 2023-10-03T10:10:07.514 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/shm 2023-10-03T10:10:07.515 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/pts 2023-10-03T10:10:07.515 INFO:teuthology.orchestra.run.smithi153.stdout:/run 2023-10-03T10:10:07.515 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup 2023-10-03T10:10:07.515 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/systemd 2023-10-03T10:10:07.515 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/pstore 2023-10-03T10:10:07.515 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/bpf 2023-10-03T10:10:07.515 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-03T10:10:07.515 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/hugetlb 2023-10-03T10:10:07.515 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/pids 2023-10-03T10:10:07.515 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/rdma 2023-10-03T10:10:07.515 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/devices 2023-10-03T10:10:07.515 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-03T10:10:07.515 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/blkio 2023-10-03T10:10:07.516 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/perf_event 2023-10-03T10:10:07.516 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/memory 2023-10-03T10:10:07.516 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/freezer 2023-10-03T10:10:07.516 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/cpuset 2023-10-03T10:10:07.516 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/tracing 2023-10-03T10:10:07.516 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/config 2023-10-03T10:10:07.516 INFO:teuthology.orchestra.run.smithi153.stdout:/ 2023-10-03T10:10:07.516 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/selinux 2023-10-03T10:10:07.516 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/sys/fs/binfmt_misc 2023-10-03T10:10:07.516 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/mqueue 2023-10-03T10:10:07.516 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/hugepages 2023-10-03T10:10:07.516 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/debug 2023-10-03T10:10:07.516 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/fuse/connections 2023-10-03T10:10:07.517 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/nfs/rpc_pipefs 2023-10-03T10:10:07.517 INFO:teuthology.orchestra.run.smithi153.stdout:/run/user/1000 2023-10-03T10:10:07.517 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph 2023-10-03T10:10:07.517 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns 2023-10-03T10:10:07.517 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:10:07.517 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:10:07.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:07.517 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2023-10-03T10:10:07.572 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-03T10:10:07.572 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-03T10:10:07.615 DEBUG:teuthology.orchestra.run.smithi153:> sudo modprobe fuse 2023-10-03T10:10:07.641 DEBUG:teuthology.orchestra.run.smithi153:> cat /proc/self/mounts | awk '{print $2}' 2023-10-03T10:10:07.699 INFO:teuthology.orchestra.run.smithi153.stdout:/sys 2023-10-03T10:10:07.699 INFO:teuthology.orchestra.run.smithi153.stdout:/proc 2023-10-03T10:10:07.699 INFO:teuthology.orchestra.run.smithi153.stdout:/dev 2023-10-03T10:10:07.699 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/security 2023-10-03T10:10:07.699 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/shm 2023-10-03T10:10:07.699 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/pts 2023-10-03T10:10:07.699 INFO:teuthology.orchestra.run.smithi153.stdout:/run 2023-10-03T10:10:07.699 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup 2023-10-03T10:10:07.699 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/systemd 2023-10-03T10:10:07.699 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/pstore 2023-10-03T10:10:07.700 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/bpf 2023-10-03T10:10:07.700 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-03T10:10:07.700 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/hugetlb 2023-10-03T10:10:07.700 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/pids 2023-10-03T10:10:07.700 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/rdma 2023-10-03T10:10:07.700 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/devices 2023-10-03T10:10:07.700 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-03T10:10:07.700 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/blkio 2023-10-03T10:10:07.700 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/perf_event 2023-10-03T10:10:07.700 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/memory 2023-10-03T10:10:07.700 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/freezer 2023-10-03T10:10:07.700 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/cgroup/cpuset 2023-10-03T10:10:07.701 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/tracing 2023-10-03T10:10:07.701 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/config 2023-10-03T10:10:07.701 INFO:teuthology.orchestra.run.smithi153.stdout:/ 2023-10-03T10:10:07.701 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/selinux 2023-10-03T10:10:07.701 INFO:teuthology.orchestra.run.smithi153.stdout:/proc/sys/fs/binfmt_misc 2023-10-03T10:10:07.701 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/mqueue 2023-10-03T10:10:07.701 INFO:teuthology.orchestra.run.smithi153.stdout:/dev/hugepages 2023-10-03T10:10:07.701 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/kernel/debug 2023-10-03T10:10:07.701 INFO:teuthology.orchestra.run.smithi153.stdout:/sys/fs/fuse/connections 2023-10-03T10:10:07.701 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/nfs/rpc_pipefs 2023-10-03T10:10:07.701 INFO:teuthology.orchestra.run.smithi153.stdout:/run/user/1000 2023-10-03T10:10:07.701 INFO:teuthology.orchestra.run.smithi153.stdout:/var/lib/ceph 2023-10-03T10:10:07.701 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns 2023-10-03T10:10:07.702 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:10:07.702 INFO:teuthology.orchestra.run.smithi153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:10:07.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:07.702 DEBUG:teuthology.orchestra.run.smithi153:> ls /sys/fs/fuse/connections 2023-10-03T10:10:07.709 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi153.stderr:2023-10-03T10:10:07.709+0000 7f6fdde8f3c0 -1 init, newargv = 0x5641af46e1c0 newargc=15 2023-10-03T10:10:07.709 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi153.stderr:ceph-fuse[112248]: starting ceph client 2023-10-03T10:10:07.714 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi153.stderr:ceph-fuse[112248]: starting fuse 2023-10-03T10:10:07.726 INFO:teuthology.orchestra.run.smithi153.stdout:46 2023-10-03T10:10:07.727 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-03T10:10:07.727 DEBUG:teuthology.orchestra.run.smithi153:> sudo stdin-killer -- python3 -c ' 2023-10-03T10:10:07.727 DEBUG:teuthology.orchestra.run.smithi153:> import glob 2023-10-03T10:10:07.727 DEBUG:teuthology.orchestra.run.smithi153:> import re 2023-10-03T10:10:07.727 DEBUG:teuthology.orchestra.run.smithi153:> import os 2023-10-03T10:10:07.727 DEBUG:teuthology.orchestra.run.smithi153:> import subprocess 2023-10-03T10:10:07.727 DEBUG:teuthology.orchestra.run.smithi153:> 2023-10-03T10:10:07.727 DEBUG:teuthology.orchestra.run.smithi153:> def _find_admin_socket(client_name): 2023-10-03T10:10:07.727 DEBUG:teuthology.orchestra.run.smithi153:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-03T10:10:07.728 DEBUG:teuthology.orchestra.run.smithi153:> files = glob.glob(asok_path) 2023-10-03T10:10:07.728 DEBUG:teuthology.orchestra.run.smithi153:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-03T10:10:07.728 DEBUG:teuthology.orchestra.run.smithi153:> 2023-10-03T10:10:07.728 DEBUG:teuthology.orchestra.run.smithi153:> # Given a non-glob path, it better be there 2023-10-03T10:10:07.728 DEBUG:teuthology.orchestra.run.smithi153:> if "*" not in asok_path: 2023-10-03T10:10:07.728 DEBUG:teuthology.orchestra.run.smithi153:> assert(len(files) == 1) 2023-10-03T10:10:07.728 DEBUG:teuthology.orchestra.run.smithi153:> return files[0] 2023-10-03T10:10:07.728 DEBUG:teuthology.orchestra.run.smithi153:> 2023-10-03T10:10:07.728 DEBUG:teuthology.orchestra.run.smithi153:> for f in files: 2023-10-03T10:10:07.728 DEBUG:teuthology.orchestra.run.smithi153:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-03T10:10:07.728 DEBUG:teuthology.orchestra.run.smithi153:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-03T10:10:07.728 DEBUG:teuthology.orchestra.run.smithi153:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-03T10:10:07.728 DEBUG:teuthology.orchestra.run.smithi153:> contents = proc_f.read() 2023-10-03T10:10:07.729 DEBUG:teuthology.orchestra.run.smithi153:> if mountpoint in contents: 2023-10-03T10:10:07.729 DEBUG:teuthology.orchestra.run.smithi153:> return f 2023-10-03T10:10:07.729 DEBUG:teuthology.orchestra.run.smithi153:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-03T10:10:07.729 DEBUG:teuthology.orchestra.run.smithi153:> 2023-10-03T10:10:07.729 DEBUG:teuthology.orchestra.run.smithi153:> print(_find_admin_socket("client.0")) 2023-10-03T10:10:07.729 DEBUG:teuthology.orchestra.run.smithi153:> ' 2023-10-03T10:10:07.851 INFO:teuthology.orchestra.run.smithi153.stdout:/var/run/ceph/ceph-client.0.112248.asok 2023-10-03T10:10:07.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-10-03T10:10:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-03T10:10:07.860 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.112248.asok 2023-10-03T10:10:07.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:07.861 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.112248.asok status 2023-10-03T10:10:08.012 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-10-03T10:10:08.012 INFO:teuthology.orchestra.run.smithi153.stdout: "metadata": { 2023-10-03T10:10:08.012 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_sha1": "eeb13ac974775bd0cce96a2c687e8bcc2faca43d", 2023-10-03T10:10:08.012 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 16.2.14-44-geeb13ac9 (eeb13ac974775bd0cce96a2c687e8bcc2faca43d) pacific (stable)", 2023-10-03T10:10:08.012 INFO:teuthology.orchestra.run.smithi153.stdout: "entity_id": "0", 2023-10-03T10:10:08.012 INFO:teuthology.orchestra.run.smithi153.stdout: "hostname": "smithi153", 2023-10-03T10:10:08.012 INFO:teuthology.orchestra.run.smithi153.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-03T10:10:08.013 INFO:teuthology.orchestra.run.smithi153.stdout: "pid": "112248", 2023-10-03T10:10:08.013 INFO:teuthology.orchestra.run.smithi153.stdout: "root": "/" 2023-10-03T10:10:08.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-03T10:10:08.013 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_count": 0, 2023-10-03T10:10:08.013 INFO:teuthology.orchestra.run.smithi153.stdout: "dentry_pinned_count": 0, 2023-10-03T10:10:08.013 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 4671, 2023-10-03T10:10:08.013 INFO:teuthology.orchestra.run.smithi153.stdout: "inst": { 2023-10-03T10:10:08.013 INFO:teuthology.orchestra.run.smithi153.stdout: "name": { 2023-10-03T10:10:08.013 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "client", 2023-10-03T10:10:08.013 INFO:teuthology.orchestra.run.smithi153.stdout: "num": 4671 2023-10-03T10:10:08.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-03T10:10:08.014 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2023-10-03T10:10:08.014 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2023-10-03T10:10:08.014 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "172.21.15.153:0", 2023-10-03T10:10:08.014 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 3522349513 2023-10-03T10:10:08.014 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-10-03T10:10:08.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-03T10:10:08.014 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": { 2023-10-03T10:10:08.014 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "v1", 2023-10-03T10:10:08.014 INFO:teuthology.orchestra.run.smithi153.stdout: "addr": "172.21.15.153:0", 2023-10-03T10:10:08.014 INFO:teuthology.orchestra.run.smithi153.stdout: "nonce": 3522349513 2023-10-03T10:10:08.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-10-03T10:10:08.015 INFO:teuthology.orchestra.run.smithi153.stdout: "inst_str": "client.4671 172.21.15.153:0/3522349513", 2023-10-03T10:10:08.015 INFO:teuthology.orchestra.run.smithi153.stdout: "addr_str": "172.21.15.153:0/3522349513", 2023-10-03T10:10:08.015 INFO:teuthology.orchestra.run.smithi153.stdout: "inode_count": 1, 2023-10-03T10:10:08.015 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_epoch": 5, 2023-10-03T10:10:08.015 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch": 17, 2023-10-03T10:10:08.015 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_epoch_barrier": 0, 2023-10-03T10:10:08.015 INFO:teuthology.orchestra.run.smithi153.stdout: "blocklisted": false, 2023-10-03T10:10:08.015 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs" 2023-10-03T10:10:08.015 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-10-03T10:10:08.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:08.022 DEBUG:teuthology.orchestra.run.smithi153:> stat --file-system '--printf=%T 2023-10-03T10:10:08.022 DEBUG:teuthology.orchestra.run.smithi153:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-03T10:10:08.040 INFO:teuthology.orchestra.run.smithi153.stdout:fuseblk 2023-10-03T10:10:08.041 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-03T10:10:08.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:08.041 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-03T10:10:08.109 INFO:teuthology.run_tasks:Running task mds_pre_upgrade... 2023-10-03T10:10:08.119 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:10:08.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.246+0000 7f6bd093d700 1 Processor -- start 2023-10-03T10:10:08.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.246+0000 7f6bd093d700 1 -- start start 2023-10-03T10:10:08.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.247+0000 7f6bd093d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bcc096810 0x7f6bcc096bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.247+0000 7f6bd093d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6bcc12e2d0 0x7f6bcc1306c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.247+0000 7f6bd093d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bcc0982f0 con 0x7f6bcc0970e0 2023-10-03T10:10:08.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.247+0000 7f6bd093d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc068550 con 0x7f6bcc096810 2023-10-03T10:10:08.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.247+0000 7f6bd093d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc069e20 con 0x7f6bcc12e2d0 2023-10-03T10:10:08.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.247+0000 7f6bca59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bcc096810 0x7f6bcc096bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.247+0000 7f6bcad9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6bcc12e2d0 0x7f6bcc1306c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.247+0000 7f6bc9d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6bcc0970e0 0x7f6bcc0974c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40228/0 (socket says 172.21.15.146:40228) 2023-10-03T10:10:08.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.247+0000 7f6bc9d9b700 1 -- 172.21.15.146:0/2093202050 learned_addr learned my addr 172.21.15.146:0/2093202050 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:10:08.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.247+0000 7f6bcad9d700 1 -- 172.21.15.146:0/2093202050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bcc096810 msgr2=0x7f6bcc096bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:08.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.247+0000 7f6bc959a700 1 -- 172.21.15.146:0/2093202050 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746772202 0 0) 0x7f6bcc0982f0 con 0x7f6bcc0970e0 2023-10-03T10:10:08.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.247+0000 7f6bcad9d700 1 --2- 172.21.15.146:0/2093202050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bcc096810 0x7f6bcc096bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.247+0000 7f6bcad9d700 1 -- 172.21.15.146:0/2093202050 >> v1:172.21.15.146:6789/0 conn(0x7f6bcc0970e0 legacy=0x7f6bcc0974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.247+0000 7f6bcad9d700 1 -- 172.21.15.146:0/2093202050 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc097bd0 con 0x7f6bcc12e2d0 2023-10-03T10:10:08.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.247+0000 7f6bca59c700 1 --2- 172.21.15.146:0/2093202050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bcc096810 0x7f6bcc096bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:08.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.248+0000 7f6bcad9d700 1 --2- 172.21.15.146:0/2093202050 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6bcc12e2d0 0x7f6bcc1306c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f6bc4009e90 tx=0x7f6bc4009780).ready entity=mon.2 client_cookie=bc5cb8dde569d893 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:08.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.248+0000 7f6bc959a700 1 -- 172.21.15.146:0/2093202050 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc400e070 con 0x7f6bcc12e2d0 2023-10-03T10:10:08.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.248+0000 7f6bc959a700 1 -- 172.21.15.146:0/2093202050 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc400bb60 con 0x7f6bcc12e2d0 2023-10-03T10:10:08.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.248+0000 7f6bc959a700 1 -- 172.21.15.146:0/2093202050 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4012410 con 0x7f6bcc12e2d0 2023-10-03T10:10:08.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.248+0000 7f6bd093d700 1 -- 172.21.15.146:0/2093202050 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6bcc12e2d0 msgr2=0x7f6bcc1306c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.248+0000 7f6bd093d700 1 --2- 172.21.15.146:0/2093202050 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6bcc12e2d0 0x7f6bcc1306c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f6bc4009e90 tx=0x7f6bc4009780).stop 2023-10-03T10:10:08.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.248+0000 7f6bd093d700 1 -- 172.21.15.146:0/2093202050 shutdown_connections 2023-10-03T10:10:08.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.248+0000 7f6bd093d700 1 --2- 172.21.15.146:0/2093202050 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6bcc12e2d0 0x7f6bcc1306c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.248+0000 7f6bd093d700 1 --2- 172.21.15.146:0/2093202050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bcc096810 0x7f6bcc096bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.248+0000 7f6bd093d700 1 -- 172.21.15.146:0/2093202050 >> 172.21.15.146:0/2093202050 conn(0x7f6bcc09bad0 msgr2=0x7f6bcc09bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:08.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.248+0000 7f6bd093d700 1 -- 172.21.15.146:0/2093202050 shutdown_connections 2023-10-03T10:10:08.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.248+0000 7f6bd093d700 1 -- 172.21.15.146:0/2093202050 wait complete. 2023-10-03T10:10:08.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.249+0000 7f6bd093d700 1 Processor -- start 2023-10-03T10:10:08.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.249+0000 7f6bd093d700 1 -- start start 2023-10-03T10:10:08.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bd093d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6bcc096810 0x7f6bcc128d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bd093d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bcc0970e0 0x7f6bcc0646d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bd093d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bcc12e2d0 0x7f6bcc064bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bd093d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc118810 con 0x7f6bcc12e2d0 2023-10-03T10:10:08.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bd093d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc098fe0 con 0x7f6bcc0970e0 2023-10-03T10:10:08.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bd093d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc06a040 con 0x7f6bcc096810 2023-10-03T10:10:08.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bca59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6bcc096810 0x7f6bcc128d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bc9d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bcc0970e0 0x7f6bcc0646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bca59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6bcc096810 0x7f6bcc128d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40226/0 (socket says 172.21.15.146:40226) 2023-10-03T10:10:08.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bc9d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bcc0970e0 0x7f6bcc0646d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42934/0 (socket says 172.21.15.146:42934) 2023-10-03T10:10:08.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bca59c700 1 -- 172.21.15.146:0/2287602627 learned_addr learned my addr 172.21.15.146:0/2287602627 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:08.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bcad9d700 1 --2- 172.21.15.146:0/2287602627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bcc12e2d0 0x7f6bcc064bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bca59c700 1 -- 172.21.15.146:0/2287602627 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bcc0970e0 msgr2=0x7f6bcc0646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bca59c700 1 --2- 172.21.15.146:0/2287602627 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bcc0970e0 0x7f6bcc0646d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bca59c700 1 -- 172.21.15.146:0/2287602627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bcc12e2d0 msgr2=0x7f6bcc064bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bca59c700 1 --2- 172.21.15.146:0/2287602627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bcc12e2d0 0x7f6bcc064bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bca59c700 1 -- 172.21.15.146:0/2287602627 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc0092a0 con 0x7f6bcc096810 2023-10-03T10:10:08.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bc9d9b700 1 --2- 172.21.15.146:0/2287602627 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bcc0970e0 0x7f6bcc0646d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:08.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bca59c700 1 --2- 172.21.15.146:0/2287602627 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6bcc096810 0x7f6bcc128d00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f6bbc00ea20 tx=0x7f6bbc009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:08.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bc27fc700 1 -- 172.21.15.146:0/2287602627 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc00ee60 con 0x7f6bcc096810 2023-10-03T10:10:08.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bc27fc700 1 -- 172.21.15.146:0/2287602627 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc00c850 con 0x7f6bcc096810 2023-10-03T10:10:08.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bd093d700 1 -- 172.21.15.146:0/2287602627 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc4009a20 con 0x7f6bcc096810 2023-10-03T10:10:08.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bc27fc700 1 -- 172.21.15.146:0/2287602627 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc00cbd0 con 0x7f6bcc096810 2023-10-03T10:10:08.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.250+0000 7f6bd093d700 1 -- 172.21.15.146:0/2287602627 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bcc066420 con 0x7f6bcc096810 2023-10-03T10:10:08.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.251+0000 7f6bc27fc700 1 -- 172.21.15.146:0/2287602627 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6bbc01b400 con 0x7f6bcc096810 2023-10-03T10:10:08.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.251+0000 7f6bc27fc700 1 -- 172.21.15.146:0/2287602627 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f6bbc03b510 con 0x7f6bcc096810 2023-10-03T10:10:08.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.251+0000 7f6bd093d700 1 -- 172.21.15.146:0/2287602627 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bcc118650 con 0x7f6bcc096810 2023-10-03T10:10:08.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.256+0000 7f6bc27fc700 1 -- 172.21.15.146:0/2287602627 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6bbc019900 con 0x7f6bcc096810 2023-10-03T10:10:08.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.416+0000 7f6bd093d700 1 -- 172.21.15.146:0/2287602627 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bcc05a260 con 0x7f6bcc096810 2023-10-03T10:10:08.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.417+0000 7f6bc27fc700 1 -- 172.21.15.146:0/2287602627 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11372 (secure 0 0 0) 0x7f6bbc02a090 con 0x7f6bcc096810 2023-10-03T10:10:08.418 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:10:08.418 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":17,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:10:05.765179+0000","last_up_change":"2023-10-03T10:09:42.301022+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":118758}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":118758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":118758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":118758}]},"public_addr":"172.21.15.146:6800/118758","cluster_addr":"172.21.15.146:6801/118758","heartbeat_back_addr":"172.21.15.146:6803/118758","heartbeat_front_addr":"172.21.15.146:6802/118758","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":118774}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":118774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":118774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":118774}]},"public_addr":"172.21.15.146:6804/118774","cluster_addr":"172.21.15.146:6806/118774","heartbeat_back_addr":"172.21.15.146:6810/118774","heartbeat_front_addr":"172.21.15.146:6808/118774","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":118775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":118775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":118775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":118775}]},"public_addr":"172.21.15.146:6805/118775","cluster_addr":"172.21.15.146:6807/118775","heartbeat_back_addr":"172.21.15.146:6811/118775","heartbeat_front_addr":"172.21.15.146:6809/118775","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":118776}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":118776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":118776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":118776}]},"public_addr":"172.21.15.146:6812/118776","cluster_addr":"172.21.15.146:6813/118776","heartbeat_back_addr":"172.21.15.146:6815/118776","heartbeat_front_addr":"172.21.15.146:6814/118776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:10:08.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.419+0000 7f6bd093d700 1 -- 172.21.15.146:0/2287602627 >> v1:172.21.15.146:6816/118159 conn(0x7f6bac02bb60 legacy=0x7f6bac02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.419+0000 7f6bd093d700 1 -- 172.21.15.146:0/2287602627 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6bcc096810 msgr2=0x7f6bcc128d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.419+0000 7f6bd093d700 1 --2- 172.21.15.146:0/2287602627 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6bcc096810 0x7f6bcc128d00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f6bbc00ea20 tx=0x7f6bbc009060).stop 2023-10-03T10:10:08.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.419+0000 7f6bd093d700 1 -- 172.21.15.146:0/2287602627 shutdown_connections 2023-10-03T10:10:08.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.419+0000 7f6bd093d700 1 --2- 172.21.15.146:0/2287602627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bcc12e2d0 0x7f6bcc064bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.419+0000 7f6bd093d700 1 --2- 172.21.15.146:0/2287602627 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6bcc096810 0x7f6bcc128d00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.419+0000 7f6bd093d700 1 --2- 172.21.15.146:0/2287602627 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bcc0970e0 0x7f6bcc0646d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.419+0000 7f6bd093d700 1 -- 172.21.15.146:0/2287602627 >> 172.21.15.146:0/2287602627 conn(0x7f6bcc09bad0 msgr2=0x7f6bcc09a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:08.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.419+0000 7f6bd093d700 1 -- 172.21.15.146:0/2287602627 shutdown_connections 2023-10-03T10:10:08.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.419+0000 7f6bd093d700 1 -- 172.21.15.146:0/2287602627 wait complete. 2023-10-03T10:10:08.431 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:09:42.343363+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:43.224375+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:47.108480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:47.686814+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-03T10:10:08.432 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:10:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.549+0000 7fc08f0a9700 1 Processor -- start 2023-10-03T10:10:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.549+0000 7fc08f0a9700 1 -- start start 2023-10-03T10:10:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc08f0a9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc088092440 0x7fc088127910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc08f0a9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc088126f70 0x7fc088123a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc08f0a9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc088127390 0x7fc088123f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc08f0a9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc088092820 con 0x7fc088126f70 2023-10-03T10:10:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc08f0a9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc088097eb0 con 0x7fc088127390 2023-10-03T10:10:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc08f0a9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc088069760 con 0x7fc088092440 2023-10-03T10:10:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc08d646700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc088127390 0x7fc088123f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc087fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc088126f70 0x7fc088123a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc08ce45700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc088092440 0x7fc088127910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc08d646700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc088127390 0x7fc088123f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42942/0 (socket says 172.21.15.146:42942) 2023-10-03T10:10:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc087fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc088126f70 0x7fc088123a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59986/0 (socket says 172.21.15.146:59986) 2023-10-03T10:10:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc08ce45700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc088092440 0x7fc088127910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40234/0 (socket says 172.21.15.146:40234) 2023-10-03T10:10:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc08d646700 1 -- 172.21.15.146:0/2041303279 learned_addr learned my addr 172.21.15.146:0/2041303279 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc08d646700 1 -- 172.21.15.146:0/2041303279 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc088092440 msgr2=0x7fc088127910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc08d646700 1 --2- 172.21.15.146:0/2041303279 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc088092440 0x7fc088127910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc08d646700 1 -- 172.21.15.146:0/2041303279 >> v2:172.21.15.146:3300/0 conn(0x7fc088126f70 msgr2=0x7fc088123a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:08.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc08d646700 1 --2- 172.21.15.146:0/2041303279 >> v2:172.21.15.146:3300/0 conn(0x7fc088126f70 0x7fc088123a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc08d646700 1 -- 172.21.15.146:0/2041303279 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc088091980 con 0x7fc088127390 2023-10-03T10:10:08.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc08ce45700 1 --2- 172.21.15.146:0/2041303279 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc088092440 0x7fc088127910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:08.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc087fff700 1 --2- 172.21.15.146:0/2041303279 >> v2:172.21.15.146:3300/0 conn(0x7fc088126f70 0x7fc088123a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:08.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc08d646700 1 --2- 172.21.15.146:0/2041303279 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc088127390 0x7fc088123f80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fc08000d1a0 tx=0x7fc08000ba50).ready entity=mon.1 client_cookie=4ed74d18f6b16bb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:08.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc0877fe700 1 -- 172.21.15.146:0/2041303279 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080010070 con 0x7fc088127390 2023-10-03T10:10:08.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.550+0000 7fc0877fe700 1 -- 172.21.15.146:0/2041303279 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08000dd60 con 0x7fc088127390 2023-10-03T10:10:08.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.551+0000 7fc0877fe700 1 -- 172.21.15.146:0/2041303279 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080015680 con 0x7fc088127390 2023-10-03T10:10:08.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.551+0000 7fc08f0a9700 1 -- 172.21.15.146:0/2041303279 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc088127390 msgr2=0x7fc088123f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.551+0000 7fc08f0a9700 1 --2- 172.21.15.146:0/2041303279 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc088127390 0x7fc088123f80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fc08000d1a0 tx=0x7fc08000ba50).stop 2023-10-03T10:10:08.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.551+0000 7fc08f0a9700 1 -- 172.21.15.146:0/2041303279 shutdown_connections 2023-10-03T10:10:08.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.551+0000 7fc08f0a9700 1 --2- 172.21.15.146:0/2041303279 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc088127390 0x7fc088123f80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.551+0000 7fc08f0a9700 1 --2- 172.21.15.146:0/2041303279 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc088092440 0x7fc088127910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.551+0000 7fc08f0a9700 1 --2- 172.21.15.146:0/2041303279 >> v2:172.21.15.146:3300/0 conn(0x7fc088126f70 0x7fc088123a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.551+0000 7fc08f0a9700 1 -- 172.21.15.146:0/2041303279 >> 172.21.15.146:0/2041303279 conn(0x7fc08809a1c0 msgr2=0x7fc08809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:08.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.551+0000 7fc08f0a9700 1 -- 172.21.15.146:0/2041303279 shutdown_connections 2023-10-03T10:10:08.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.551+0000 7fc08f0a9700 1 -- 172.21.15.146:0/2041303279 wait complete. 2023-10-03T10:10:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.552+0000 7fc08f0a9700 1 Processor -- start 2023-10-03T10:10:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.552+0000 7fc08f0a9700 1 -- start start 2023-10-03T10:10:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.553+0000 7fc08f0a9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc088092440 0x7fc088114c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.553+0000 7fc08f0a9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc088126f70 0x7fc088115120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.553+0000 7fc08f0a9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc088127390 0x7fc088115610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.553+0000 7fc08f0a9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc088115b00 con 0x7fc088126f70 2023-10-03T10:10:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.553+0000 7fc08f0a9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0881173e0 con 0x7fc088092440 2023-10-03T10:10:08.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.553+0000 7fc08f0a9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0881182a0 con 0x7fc088127390 2023-10-03T10:10:08.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.553+0000 7fc08ce45700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc088092440 0x7fc088114c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.553+0000 7fc08ce45700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc088092440 0x7fc088114c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42946/0 (socket says 172.21.15.146:42946) 2023-10-03T10:10:08.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.553+0000 7fc08ce45700 1 -- 172.21.15.146:0/2680270678 learned_addr learned my addr 172.21.15.146:0/2680270678 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:08.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.553+0000 7fc08d646700 1 --2- 172.21.15.146:0/2680270678 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc088127390 0x7fc088115610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.553+0000 7fc087fff700 1 --2- 172.21.15.146:0/2680270678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc088126f70 0x7fc088115120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.553+0000 7fc08ce45700 1 -- 172.21.15.146:0/2680270678 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc088127390 msgr2=0x7fc088115610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.553+0000 7fc08ce45700 1 --2- 172.21.15.146:0/2680270678 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc088127390 0x7fc088115610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.553+0000 7fc08ce45700 1 -- 172.21.15.146:0/2680270678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc088126f70 msgr2=0x7fc088115120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.553+0000 7fc08ce45700 1 --2- 172.21.15.146:0/2680270678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc088126f70 0x7fc088115120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.553+0000 7fc08ce45700 1 -- 172.21.15.146:0/2680270678 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c0092a0 con 0x7fc088092440 2023-10-03T10:10:08.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.553+0000 7fc08ce45700 1 --2- 172.21.15.146:0/2680270678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc088092440 0x7fc088114c30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc07c00ea20 tx=0x7fc07c009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:08.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.553+0000 7fc084ff9700 1 -- 172.21.15.146:0/2680270678 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c00ee60 con 0x7fc088092440 2023-10-03T10:10:08.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.553+0000 7fc084ff9700 1 -- 172.21.15.146:0/2680270678 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07c00c850 con 0x7fc088092440 2023-10-03T10:10:08.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.553+0000 7fc08f0a9700 1 -- 172.21.15.146:0/2680270678 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0740092a0 con 0x7fc088092440 2023-10-03T10:10:08.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.553+0000 7fc084ff9700 1 -- 172.21.15.146:0/2680270678 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c00cbd0 con 0x7fc088092440 2023-10-03T10:10:08.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.553+0000 7fc08f0a9700 1 -- 172.21.15.146:0/2680270678 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08000bcf0 con 0x7fc088092440 2023-10-03T10:10:08.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.554+0000 7fc084ff9700 1 -- 172.21.15.146:0/2680270678 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc07c01b400 con 0x7fc088092440 2023-10-03T10:10:08.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.554+0000 7fc084ff9700 1 -- 172.21.15.146:0/2680270678 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc07c03b510 con 0x7fc088092440 2023-10-03T10:10:08.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.554+0000 7fc08f0a9700 1 -- 172.21.15.146:0/2680270678 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc088117520 con 0x7fc088092440 2023-10-03T10:10:08.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.559+0000 7fc084ff9700 1 -- 172.21.15.146:0/2680270678 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc088117520 con 0x7fc088092440 2023-10-03T10:10:08.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.714+0000 7fc08f0a9700 1 -- 172.21.15.146:0/2680270678 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc088117520 con 0x7fc088092440 2023-10-03T10:10:08.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.715+0000 7fc084ff9700 1 -- 172.21.15.146:0/2680270678 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc088117520 con 0x7fc088092440 2023-10-03T10:10:08.715 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-03T10:10:08.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.716+0000 7fc08f0a9700 1 -- 172.21.15.146:0/2680270678 >> v1:172.21.15.146:6816/118159 conn(0x7fc06c02bb60 legacy=0x7fc06c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.716+0000 7fc08f0a9700 1 -- 172.21.15.146:0/2680270678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc088092440 msgr2=0x7fc088114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.716+0000 7fc08f0a9700 1 --2- 172.21.15.146:0/2680270678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc088092440 0x7fc088114c30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc07c00ea20 tx=0x7fc07c009060).stop 2023-10-03T10:10:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.717+0000 7fc08f0a9700 1 -- 172.21.15.146:0/2680270678 shutdown_connections 2023-10-03T10:10:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.717+0000 7fc08f0a9700 1 --2- 172.21.15.146:0/2680270678 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc088127390 0x7fc088115610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.717+0000 7fc08f0a9700 1 --2- 172.21.15.146:0/2680270678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc088092440 0x7fc088114c30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.717+0000 7fc08f0a9700 1 --2- 172.21.15.146:0/2680270678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc088126f70 0x7fc088115120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.717+0000 7fc08f0a9700 1 -- 172.21.15.146:0/2680270678 >> 172.21.15.146:0/2680270678 conn(0x7fc08809a1c0 msgr2=0x7fc088123a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.717+0000 7fc08f0a9700 1 -- 172.21.15.146:0/2680270678 shutdown_connections 2023-10-03T10:10:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.717+0000 7fc08f0a9700 1 -- 172.21.15.146:0/2680270678 wait complete. 2023-10-03T10:10:08.729 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:10:08.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.847+0000 7f1463ffa700 1 Processor -- start 2023-10-03T10:10:08.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.847+0000 7f1463ffa700 1 -- start start 2023-10-03T10:10:08.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.847+0000 7f1463ffa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f145c05f560 0x7f145c127db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.847+0000 7f1463ffa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f145c1282a0 0x7f145c067e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.847+0000 7f1463ffa700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f145c068380 0x7f145c068800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.847+0000 7f1463ffa700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f145c05f940 con 0x7f145c068380 2023-10-03T10:10:08.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.847+0000 7f1463ffa700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145c091b90 con 0x7f145c05f560 2023-10-03T10:10:08.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.847+0000 7f1463ffa700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f145c093160 con 0x7f145c1282a0 2023-10-03T10:10:08.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.847+0000 7f1462597700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f145c068380 0x7f145c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.847+0000 7f1461d96700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f145c05f560 0x7f145c127db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.847+0000 7f1461595700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f145c1282a0 0x7f145c067e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.847+0000 7f1462597700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f145c068380 0x7f145c068800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59998/0 (socket says 172.21.15.146:59998) 2023-10-03T10:10:08.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.847+0000 7f1461d96700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f145c05f560 0x7f145c127db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42962/0 (socket says 172.21.15.146:42962) 2023-10-03T10:10:08.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.847+0000 7f1462597700 1 -- 172.21.15.146:0/3720658583 learned_addr learned my addr 172.21.15.146:0/3720658583 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:08.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.848+0000 7f1461595700 1 -- 172.21.15.146:0/3720658583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f145c05f560 msgr2=0x7f145c127db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:08.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.848+0000 7f1461595700 1 --2- 172.21.15.146:0/3720658583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f145c05f560 0x7f145c127db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.848+0000 7f1461595700 1 -- 172.21.15.146:0/3720658583 >> v2:172.21.15.146:3300/0 conn(0x7f145c068380 msgr2=0x7f145c068800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:08.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.848+0000 7f1461595700 1 --2- 172.21.15.146:0/3720658583 >> v2:172.21.15.146:3300/0 conn(0x7f145c068380 0x7f145c068800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.848+0000 7f1461595700 1 -- 172.21.15.146:0/3720658583 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c068cf0 con 0x7f145c1282a0 2023-10-03T10:10:08.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.848+0000 7f1462597700 1 --2- 172.21.15.146:0/3720658583 >> v2:172.21.15.146:3300/0 conn(0x7f145c068380 0x7f145c068800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:08.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.848+0000 7f1461595700 1 --2- 172.21.15.146:0/3720658583 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f145c1282a0 0x7f145c067e90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f144c00ba00 tx=0x7f144c00b300).ready entity=mon.2 client_cookie=8dfa29070d50ce33 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:08.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.848+0000 7f1460d94700 1 -- 172.21.15.146:0/3720658583 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c00d8c0 con 0x7f145c1282a0 2023-10-03T10:10:08.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.848+0000 7f1460d94700 1 -- 172.21.15.146:0/3720658583 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144c00da20 con 0x7f145c1282a0 2023-10-03T10:10:08.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.848+0000 7f1460d94700 1 -- 172.21.15.146:0/3720658583 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c00dda0 con 0x7f145c1282a0 2023-10-03T10:10:08.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.849+0000 7f1463ffa700 1 -- 172.21.15.146:0/3720658583 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f145c1282a0 msgr2=0x7f145c067e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.849+0000 7f1463ffa700 1 --2- 172.21.15.146:0/3720658583 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f145c1282a0 0x7f145c067e90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f144c00ba00 tx=0x7f144c00b300).stop 2023-10-03T10:10:08.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.849+0000 7f1463ffa700 1 -- 172.21.15.146:0/3720658583 shutdown_connections 2023-10-03T10:10:08.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.849+0000 7f1463ffa700 1 --2- 172.21.15.146:0/3720658583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f145c05f560 0x7f145c127db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.849+0000 7f1463ffa700 1 --2- 172.21.15.146:0/3720658583 >> v2:172.21.15.146:3300/0 conn(0x7f145c068380 0x7f145c068800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.849+0000 7f1463ffa700 1 --2- 172.21.15.146:0/3720658583 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f145c1282a0 0x7f145c067e90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.849+0000 7f1463ffa700 1 -- 172.21.15.146:0/3720658583 >> 172.21.15.146:0/3720658583 conn(0x7f145c09a1c0 msgr2=0x7f145c09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:08.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.849+0000 7f1463ffa700 1 -- 172.21.15.146:0/3720658583 shutdown_connections 2023-10-03T10:10:08.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.849+0000 7f1463ffa700 1 -- 172.21.15.146:0/3720658583 wait complete. 2023-10-03T10:10:08.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.850+0000 7f1463ffa700 1 Processor -- start 2023-10-03T10:10:08.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.850+0000 7f1463ffa700 1 -- start start 2023-10-03T10:10:08.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.850+0000 7f1463ffa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f145c05f560 0x7f145c136220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.850+0000 7f1463ffa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f145c068380 0x7f145c136710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.850+0000 7f1463ffa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f145c1282a0 0x7f145c113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.851+0000 7f1463ffa700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c116130 con 0x7f145c05f560 2023-10-03T10:10:08.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.851+0000 7f1463ffa700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145c129fd0 con 0x7f145c068380 2023-10-03T10:10:08.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.851+0000 7f1463ffa700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f145c117560 con 0x7f145c1282a0 2023-10-03T10:10:08.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.851+0000 7f1461d96700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f145c05f560 0x7f145c136220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.851+0000 7f1462597700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f145c1282a0 0x7f145c113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.851+0000 7f1461d96700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f145c05f560 0x7f145c136220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60008/0 (socket says 172.21.15.146:60008) 2023-10-03T10:10:08.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.851+0000 7f1461d96700 1 -- 172.21.15.146:0/254723378 learned_addr learned my addr 172.21.15.146:0/254723378 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:08.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.851+0000 7f1461595700 1 --2- 172.21.15.146:0/254723378 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f145c068380 0x7f145c136710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.851+0000 7f1462597700 1 -- 172.21.15.146:0/254723378 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f145c068380 msgr2=0x7f145c136710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.851+0000 7f1462597700 1 --2- 172.21.15.146:0/254723378 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f145c068380 0x7f145c136710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.851+0000 7f1462597700 1 -- 172.21.15.146:0/254723378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f145c05f560 msgr2=0x7f145c136220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.851+0000 7f1462597700 1 --2- 172.21.15.146:0/254723378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f145c05f560 0x7f145c136220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.851+0000 7f1462597700 1 -- 172.21.15.146:0/254723378 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1454009ae0 con 0x7f145c1282a0 2023-10-03T10:10:08.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.851+0000 7f1461d96700 1 --2- 172.21.15.146:0/254723378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f145c05f560 0x7f145c136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:08.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.851+0000 7f1462597700 1 --2- 172.21.15.146:0/254723378 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f145c1282a0 0x7f145c113ab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f1454009f10 tx=0x7f145400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:08.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.851+0000 7f1451ffb700 1 -- 172.21.15.146:0/254723378 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14540092e0 con 0x7f145c1282a0 2023-10-03T10:10:08.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.851+0000 7f1451ffb700 1 -- 172.21.15.146:0/254723378 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145400f040 con 0x7f145c1282a0 2023-10-03T10:10:08.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.851+0000 7f1463ffa700 1 -- 172.21.15.146:0/254723378 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144c00b540 con 0x7f145c1282a0 2023-10-03T10:10:08.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.851+0000 7f1451ffb700 1 -- 172.21.15.146:0/254723378 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145400cb70 con 0x7f145c1282a0 2023-10-03T10:10:08.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.851+0000 7f1463ffa700 1 -- 172.21.15.146:0/254723378 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145c116fc0 con 0x7f145c1282a0 2023-10-03T10:10:08.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.852+0000 7f1451ffb700 1 -- 172.21.15.146:0/254723378 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f1454014460 con 0x7f145c1282a0 2023-10-03T10:10:08.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.852+0000 7f1451ffb700 1 -- 172.21.15.146:0/254723378 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f145403af90 con 0x7f145c1282a0 2023-10-03T10:10:08.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.852+0000 7f1463ffa700 1 -- 172.21.15.146:0/254723378 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f145c05a260 con 0x7f145c1282a0 2023-10-03T10:10:08.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:08.857+0000 7f1451ffb700 1 -- 172.21.15.146:0/254723378 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f145401cd30 con 0x7f145c1282a0 2023-10-03T10:10:09.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.013+0000 7f1463ffa700 1 -- 172.21.15.146:0/254723378 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f145c046c20 con 0x7f145c1282a0 2023-10-03T10:10:09.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.013+0000 7f1451ffb700 1 -- 172.21.15.146:0/254723378 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f145401cb50 con 0x7f145c1282a0 2023-10-03T10:10:09.014 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-03T10:10:09.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.015+0000 7f1463ffa700 1 -- 172.21.15.146:0/254723378 >> v1:172.21.15.146:6816/118159 conn(0x7f144002bb90 legacy=0x7f144002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.015+0000 7f1463ffa700 1 -- 172.21.15.146:0/254723378 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f145c1282a0 msgr2=0x7f145c113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.015+0000 7f1463ffa700 1 --2- 172.21.15.146:0/254723378 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f145c1282a0 0x7f145c113ab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f1454009f10 tx=0x7f145400b040).stop 2023-10-03T10:10:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.015+0000 7f1463ffa700 1 -- 172.21.15.146:0/254723378 shutdown_connections 2023-10-03T10:10:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.015+0000 7f1463ffa700 1 --2- 172.21.15.146:0/254723378 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f145c1282a0 0x7f145c113ab0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.015+0000 7f1463ffa700 1 --2- 172.21.15.146:0/254723378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f145c05f560 0x7f145c136220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.015+0000 7f1463ffa700 1 --2- 172.21.15.146:0/254723378 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f145c068380 0x7f145c136710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.015+0000 7f1463ffa700 1 -- 172.21.15.146:0/254723378 >> 172.21.15.146:0/254723378 conn(0x7f145c09a1c0 msgr2=0x7f145c065d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.015+0000 7f1463ffa700 1 -- 172.21.15.146:0/254723378 shutdown_connections 2023-10-03T10:10:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.015+0000 7f1463ffa700 1 -- 172.21.15.146:0/254723378 wait complete. 2023-10-03T10:10:09.027 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:10:09.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.146+0000 7fb9d49ea700 1 Processor -- start 2023-10-03T10:10:09.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.146+0000 7fb9d49ea700 1 -- start start 2023-10-03T10:10:09.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.147+0000 7fb9d49ea700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9d012b590 0x7fb9d012fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.147+0000 7fb9d49ea700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb9d01303d0 0x7fb9d01327c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.147+0000 7fb9d49ea700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d0066f90 con 0x7fb9d005f560 2023-10-03T10:10:09.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.147+0000 7fb9d49ea700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d005f940 con 0x7fb9d012b590 2023-10-03T10:10:09.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.147+0000 7fb9d49ea700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d0067650 con 0x7fb9d01303d0 2023-10-03T10:10:09.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.147+0000 7fb9cdd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9d012b590 0x7fb9d012fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.147+0000 7fb9ced9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb9d01303d0 0x7fb9d01327c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.147+0000 7fb9ce59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb9d005f560 0x7fb9d012ae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40240/0 (socket says 172.21.15.146:40240) 2023-10-03T10:10:09.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.147+0000 7fb9cdd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9d012b590 0x7fb9d012fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42970/0 (socket says 172.21.15.146:42970) 2023-10-03T10:10:09.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.147+0000 7fb9ced9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb9d01303d0 0x7fb9d01327c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40258/0 (socket says 172.21.15.146:40258) 2023-10-03T10:10:09.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.147+0000 7fb9ce59c700 1 -- 172.21.15.146:0/3436517376 learned_addr learned my addr 172.21.15.146:0/3436517376 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:10:09.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.147+0000 7fb9cd59a700 1 -- 172.21.15.146:0/3436517376 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731680859 0 0) 0x7fb9d0066f90 con 0x7fb9d005f560 2023-10-03T10:10:09.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.147+0000 7fb9ced9d700 1 -- 172.21.15.146:0/3436517376 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9d012b590 msgr2=0x7fb9d012fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:09.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.147+0000 7fb9ced9d700 1 --2- 172.21.15.146:0/3436517376 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9d012b590 0x7fb9d012fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.147+0000 7fb9ced9d700 1 -- 172.21.15.146:0/3436517376 >> v1:172.21.15.146:6789/0 conn(0x7fb9d005f560 legacy=0x7fb9d012ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.147+0000 7fb9ced9d700 1 -- 172.21.15.146:0/3436517376 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d0067910 con 0x7fb9d01303d0 2023-10-03T10:10:09.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.147+0000 7fb9cdd9b700 1 --2- 172.21.15.146:0/3436517376 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9d012b590 0x7fb9d012fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:09.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.148+0000 7fb9ced9d700 1 --2- 172.21.15.146:0/3436517376 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb9d01303d0 0x7fb9d01327c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb9c8009ec0 tx=0x7fb9c8009780).ready entity=mon.2 client_cookie=f9767da23e8e4a7f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:09.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.148+0000 7fb9cd59a700 1 -- 172.21.15.146:0/3436517376 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c800e070 con 0x7fb9d01303d0 2023-10-03T10:10:09.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.148+0000 7fb9cd59a700 1 -- 172.21.15.146:0/3436517376 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c800bbf0 con 0x7fb9d01303d0 2023-10-03T10:10:09.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.148+0000 7fb9cd59a700 1 -- 172.21.15.146:0/3436517376 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8012410 con 0x7fb9d01303d0 2023-10-03T10:10:09.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.148+0000 7fb9d49ea700 1 -- 172.21.15.146:0/3436517376 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb9d01303d0 msgr2=0x7fb9d01327c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.148+0000 7fb9d49ea700 1 --2- 172.21.15.146:0/3436517376 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb9d01303d0 0x7fb9d01327c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb9c8009ec0 tx=0x7fb9c8009780).stop 2023-10-03T10:10:09.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.148+0000 7fb9d49ea700 1 -- 172.21.15.146:0/3436517376 shutdown_connections 2023-10-03T10:10:09.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.148+0000 7fb9d49ea700 1 --2- 172.21.15.146:0/3436517376 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb9d01303d0 0x7fb9d01327c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.148+0000 7fb9d49ea700 1 --2- 172.21.15.146:0/3436517376 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9d012b590 0x7fb9d012fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.148+0000 7fb9d49ea700 1 -- 172.21.15.146:0/3436517376 >> 172.21.15.146:0/3436517376 conn(0x7fb9d009a1c0 msgr2=0x7fb9d009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:09.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.148+0000 7fb9d49ea700 1 -- 172.21.15.146:0/3436517376 shutdown_connections 2023-10-03T10:10:09.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.148+0000 7fb9d49ea700 1 -- 172.21.15.146:0/3436517376 wait complete. 2023-10-03T10:10:09.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.149+0000 7fb9d49ea700 1 Processor -- start 2023-10-03T10:10:09.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.149+0000 7fb9d49ea700 1 -- start start 2023-10-03T10:10:09.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9d49ea700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9d005f560 0x7fb9d0116510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9d49ea700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9d012b590 0x7fb9d0112570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9d49ea700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb9d01303d0 0x7fb9d0112a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9d49ea700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d0128690 con 0x7fb9d005f560 2023-10-03T10:10:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9d49ea700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d00671c0 con 0x7fb9d012b590 2023-10-03T10:10:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9d49ea700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d012fec0 con 0x7fb9d01303d0 2023-10-03T10:10:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9ce59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9d005f560 0x7fb9d0116510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9ced9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb9d01303d0 0x7fb9d0112a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9cdd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9d012b590 0x7fb9d0112570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9cdd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9d012b590 0x7fb9d0112570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42976/0 (socket says 172.21.15.146:42976) 2023-10-03T10:10:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9ce59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9d005f560 0x7fb9d0116510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60010/0 (socket says 172.21.15.146:60010) 2023-10-03T10:10:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9cdd9b700 1 -- 172.21.15.146:0/164212863 learned_addr learned my addr 172.21.15.146:0/164212863 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9ced9d700 1 --2- 172.21.15.146:0/164212863 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb9d01303d0 0x7fb9d0112a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40268/0 (socket says 172.21.15.146:40268) 2023-10-03T10:10:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9ced9d700 1 -- 172.21.15.146:0/164212863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9d012b590 msgr2=0x7fb9d0112570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9ced9d700 1 --2- 172.21.15.146:0/164212863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9d012b590 0x7fb9d0112570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9ced9d700 1 -- 172.21.15.146:0/164212863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9d005f560 msgr2=0x7fb9d0116510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9ced9d700 1 --2- 172.21.15.146:0/164212863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9d005f560 0x7fb9d0116510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9ced9d700 1 -- 172.21.15.146:0/164212863 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b80092a0 con 0x7fb9d01303d0 2023-10-03T10:10:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9ce59c700 1 --2- 172.21.15.146:0/164212863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9d005f560 0x7fb9d0116510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9cdd9b700 1 --2- 172.21.15.146:0/164212863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9d012b590 0x7fb9d0112570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9ced9d700 1 --2- 172.21.15.146:0/164212863 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb9d01303d0 0x7fb9d0112a60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fb9c8014000 tx=0x7fb9c8009780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9c67fc700 1 -- 172.21.15.146:0/164212863 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8021070 con 0x7fb9d01303d0 2023-10-03T10:10:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9c67fc700 1 -- 172.21.15.146:0/164212863 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c801d630 con 0x7fb9d01303d0 2023-10-03T10:10:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9d49ea700 1 -- 172.21.15.146:0/164212863 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c8009a20 con 0x7fb9d01303d0 2023-10-03T10:10:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9c67fc700 1 -- 172.21.15.146:0/164212863 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c801d9f0 con 0x7fb9d01303d0 2023-10-03T10:10:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.150+0000 7fb9d49ea700 1 -- 172.21.15.146:0/164212863 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d0115d30 con 0x7fb9d01303d0 2023-10-03T10:10:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.151+0000 7fb9c67fc700 1 -- 172.21.15.146:0/164212863 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb9c8003040 con 0x7fb9d01303d0 2023-10-03T10:10:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.151+0000 7fb9c67fc700 1 -- 172.21.15.146:0/164212863 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb9c803c630 con 0x7fb9d01303d0 2023-10-03T10:10:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.151+0000 7fb9d49ea700 1 -- 172.21.15.146:0/164212863 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d005a260 con 0x7fb9d01303d0 2023-10-03T10:10:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.155+0000 7fb9c67fc700 1 -- 172.21.15.146:0/164212863 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb9c80253c0 con 0x7fb9d01303d0 2023-10-03T10:10:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.311+0000 7fb9d49ea700 1 -- 172.21.15.146:0/164212863 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9d0113370 con 0x7fb9d01303d0 2023-10-03T10:10:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.312+0000 7fb9c67fc700 1 -- 172.21.15.146:0/164212863 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb9c80247e0 con 0x7fb9d01303d0 2023-10-03T10:10:09.313 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-03T10:10:09.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.313+0000 7fb9d49ea700 1 -- 172.21.15.146:0/164212863 >> v1:172.21.15.146:6816/118159 conn(0x7fb9b002bb60 legacy=0x7fb9b002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.313+0000 7fb9d49ea700 1 -- 172.21.15.146:0/164212863 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb9d01303d0 msgr2=0x7fb9d0112a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.313+0000 7fb9d49ea700 1 --2- 172.21.15.146:0/164212863 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb9d01303d0 0x7fb9d0112a60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fb9c8014000 tx=0x7fb9c8009780).stop 2023-10-03T10:10:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.313+0000 7fb9d49ea700 1 -- 172.21.15.146:0/164212863 shutdown_connections 2023-10-03T10:10:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.313+0000 7fb9d49ea700 1 --2- 172.21.15.146:0/164212863 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb9d01303d0 0x7fb9d0112a60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.313+0000 7fb9d49ea700 1 --2- 172.21.15.146:0/164212863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9d005f560 0x7fb9d0116510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.313+0000 7fb9d49ea700 1 --2- 172.21.15.146:0/164212863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9d012b590 0x7fb9d0112570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.313+0000 7fb9d49ea700 1 -- 172.21.15.146:0/164212863 >> 172.21.15.146:0/164212863 conn(0x7fb9d009a1c0 msgr2=0x7fb9d00996c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.314+0000 7fb9d49ea700 1 -- 172.21.15.146:0/164212863 shutdown_connections 2023-10-03T10:10:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.314+0000 7fb9d49ea700 1 -- 172.21.15.146:0/164212863 wait complete. 2023-10-03T10:10:09.326 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:10:09.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.444+0000 7fb65f047700 1 Processor -- start 2023-10-03T10:10:09.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.444+0000 7fb65f047700 1 -- start start 2023-10-03T10:10:09.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb65f047700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb658093950 0x7fb658095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb65f047700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb658095c50 0x7fb658096030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb65f047700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb65812c240 0x7fb65812e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb65f047700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb658094ba0 con 0x7fb658093950 2023-10-03T10:10:09.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb65f047700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb658092e90 con 0x7fb658095c50 2023-10-03T10:10:09.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb65f047700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb658096b60 con 0x7fb65812c240 2023-10-03T10:10:09.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb65cde3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb658093950 0x7fb658095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb657fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb658095c50 0x7fb658096030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb65d5e4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb65812c240 0x7fb65812e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb65d5e4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb65812c240 0x7fb65812e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40284/0 (socket says 172.21.15.146:40284) 2023-10-03T10:10:09.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb65cde3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb658093950 0x7fb658095760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60016/0 (socket says 172.21.15.146:60016) 2023-10-03T10:10:09.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb657fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb658095c50 0x7fb658096030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42980/0 (socket says 172.21.15.146:42980) 2023-10-03T10:10:09.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb65d5e4700 1 -- 172.21.15.146:0/1900878849 learned_addr learned my addr 172.21.15.146:0/1900878849 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:09.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb65cde3700 1 -- 172.21.15.146:0/1900878849 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb65812c240 msgr2=0x7fb65812e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:09.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb65cde3700 1 --2- 172.21.15.146:0/1900878849 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb65812c240 0x7fb65812e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb65cde3700 1 -- 172.21.15.146:0/1900878849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb658095c50 msgr2=0x7fb658096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:09.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb65cde3700 1 --2- 172.21.15.146:0/1900878849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb658095c50 0x7fb658096030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb65cde3700 1 -- 172.21.15.146:0/1900878849 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb658093150 con 0x7fb658093950 2023-10-03T10:10:09.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb657fff700 1 --2- 172.21.15.146:0/1900878849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb658095c50 0x7fb658096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:09.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb65d5e4700 1 --2- 172.21.15.146:0/1900878849 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb65812c240 0x7fb65812e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:09.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb65cde3700 1 --2- 172.21.15.146:0/1900878849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb658093950 0x7fb658095760 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fb64c009760 tx=0x7fb64c009060).ready entity=mon.0 client_cookie=5b51bf89baa66029 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:09.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb6577fe700 1 -- 172.21.15.146:0/1900878849 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c0090d0 con 0x7fb658093950 2023-10-03T10:10:09.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb6577fe700 1 -- 172.21.15.146:0/1900878849 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64c00d4a0 con 0x7fb658093950 2023-10-03T10:10:09.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.445+0000 7fb6577fe700 1 -- 172.21.15.146:0/1900878849 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c00d820 con 0x7fb658093950 2023-10-03T10:10:09.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.446+0000 7fb65f047700 1 -- 172.21.15.146:0/1900878849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb658093950 msgr2=0x7fb658095760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.446+0000 7fb65f047700 1 --2- 172.21.15.146:0/1900878849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb658093950 0x7fb658095760 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fb64c009760 tx=0x7fb64c009060).stop 2023-10-03T10:10:09.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.446+0000 7fb65f047700 1 -- 172.21.15.146:0/1900878849 shutdown_connections 2023-10-03T10:10:09.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.446+0000 7fb65f047700 1 --2- 172.21.15.146:0/1900878849 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb65812c240 0x7fb65812e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.446+0000 7fb65f047700 1 --2- 172.21.15.146:0/1900878849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb658093950 0x7fb658095760 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.446+0000 7fb65f047700 1 --2- 172.21.15.146:0/1900878849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb658095c50 0x7fb658096030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.446+0000 7fb65f047700 1 -- 172.21.15.146:0/1900878849 >> 172.21.15.146:0/1900878849 conn(0x7fb65809aa50 msgr2=0x7fb65809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:09.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.446+0000 7fb65f047700 1 -- 172.21.15.146:0/1900878849 shutdown_connections 2023-10-03T10:10:09.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.446+0000 7fb65f047700 1 -- 172.21.15.146:0/1900878849 wait complete. 2023-10-03T10:10:09.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.447+0000 7fb65f047700 1 Processor -- start 2023-10-03T10:10:09.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.447+0000 7fb65f047700 1 -- start start 2023-10-03T10:10:09.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.447+0000 7fb65f047700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb658093950 0x7fb658062b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.447+0000 7fb65f047700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb658095c50 0x7fb658118ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.447+0000 7fb65f047700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb65812c240 0x7fb6581193d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.447+0000 7fb65f047700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65811b340 con 0x7fb658095c50 2023-10-03T10:10:09.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.447+0000 7fb65f047700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65811af00 con 0x7fb658093950 2023-10-03T10:10:09.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.447+0000 7fb65f047700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb65809a350 con 0x7fb65812c240 2023-10-03T10:10:09.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.447+0000 7fb65cde3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb658093950 0x7fb658062b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.447+0000 7fb65d5e4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb65812c240 0x7fb6581193d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.447+0000 7fb657fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb658095c50 0x7fb658118ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.447+0000 7fb65cde3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb658093950 0x7fb658062b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42984/0 (socket says 172.21.15.146:42984) 2023-10-03T10:10:09.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.447+0000 7fb65cde3700 1 -- 172.21.15.146:0/1241702197 learned_addr learned my addr 172.21.15.146:0/1241702197 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:09.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.448+0000 7fb657fff700 1 -- 172.21.15.146:0/1241702197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb65812c240 msgr2=0x7fb6581193d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.448+0000 7fb657fff700 1 --2- 172.21.15.146:0/1241702197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb65812c240 0x7fb6581193d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.448+0000 7fb657fff700 1 -- 172.21.15.146:0/1241702197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb658093950 msgr2=0x7fb658062b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.448+0000 7fb657fff700 1 --2- 172.21.15.146:0/1241702197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb658093950 0x7fb658062b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.448+0000 7fb657fff700 1 -- 172.21.15.146:0/1241702197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6440092a0 con 0x7fb658095c50 2023-10-03T10:10:09.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.448+0000 7fb65d5e4700 1 --2- 172.21.15.146:0/1241702197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb65812c240 0x7fb6581193d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:09.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.448+0000 7fb65cde3700 1 --2- 172.21.15.146:0/1241702197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb658093950 0x7fb658062b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:09.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.448+0000 7fb657fff700 1 --2- 172.21.15.146:0/1241702197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb658095c50 0x7fb658118ee0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fb64400e950 tx=0x7fb644009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:09.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.448+0000 7fb654ff9700 1 -- 172.21.15.146:0/1241702197 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb644009580 con 0x7fb658095c50 2023-10-03T10:10:09.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.448+0000 7fb654ff9700 1 -- 172.21.15.146:0/1241702197 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb644012600 con 0x7fb658095c50 2023-10-03T10:10:09.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.448+0000 7fb65f047700 1 -- 172.21.15.146:0/1241702197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb650009ae0 con 0x7fb658095c50 2023-10-03T10:10:09.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.448+0000 7fb654ff9700 1 -- 172.21.15.146:0/1241702197 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6440129a0 con 0x7fb658095c50 2023-10-03T10:10:09.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.448+0000 7fb65f047700 1 -- 172.21.15.146:0/1241702197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb64c0092a0 con 0x7fb658095c50 2023-10-03T10:10:09.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.449+0000 7fb654ff9700 1 -- 172.21.15.146:0/1241702197 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb644012d10 con 0x7fb658095c50 2023-10-03T10:10:09.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.449+0000 7fb654ff9700 1 -- 172.21.15.146:0/1241702197 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb64403b440 con 0x7fb658095c50 2023-10-03T10:10:09.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.449+0000 7fb65f047700 1 -- 172.21.15.146:0/1241702197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb65811b820 con 0x7fb658095c50 2023-10-03T10:10:09.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.454+0000 7fb654ff9700 1 -- 172.21.15.146:0/1241702197 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb65811b820 con 0x7fb658095c50 2023-10-03T10:10:09.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.611+0000 7fb65f047700 1 -- 172.21.15.146:0/1241702197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb65811b820 con 0x7fb658095c50 2023-10-03T10:10:09.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.611+0000 7fb654ff9700 1 -- 172.21.15.146:0/1241702197 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb65811b820 con 0x7fb658095c50 2023-10-03T10:10:09.612 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-03T10:10:09.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.613+0000 7fb65f047700 1 -- 172.21.15.146:0/1241702197 >> v1:172.21.15.146:6816/118159 conn(0x7fb63c02bb60 legacy=0x7fb63c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.613+0000 7fb65f047700 1 -- 172.21.15.146:0/1241702197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb658095c50 msgr2=0x7fb658118ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.613+0000 7fb65f047700 1 --2- 172.21.15.146:0/1241702197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb658095c50 0x7fb658118ee0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fb64400e950 tx=0x7fb644009060).stop 2023-10-03T10:10:09.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.613+0000 7fb65f047700 1 -- 172.21.15.146:0/1241702197 shutdown_connections 2023-10-03T10:10:09.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.613+0000 7fb65f047700 1 --2- 172.21.15.146:0/1241702197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb65812c240 0x7fb6581193d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.613+0000 7fb65f047700 1 --2- 172.21.15.146:0/1241702197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb658093950 0x7fb658062b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.613+0000 7fb65f047700 1 --2- 172.21.15.146:0/1241702197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb658095c50 0x7fb658118ee0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.613+0000 7fb65f047700 1 -- 172.21.15.146:0/1241702197 >> 172.21.15.146:0/1241702197 conn(0x7fb65809aa50 msgr2=0x7fb6581110b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:09.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.614+0000 7fb65f047700 1 -- 172.21.15.146:0/1241702197 shutdown_connections 2023-10-03T10:10:09.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.614+0000 7fb65f047700 1 -- 172.21.15.146:0/1241702197 wait complete. 2023-10-03T10:10:09.626 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:10:09.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.741+0000 7f33c5856700 1 Processor -- start 2023-10-03T10:10:09.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.741+0000 7f33c5856700 1 -- start start 2023-10-03T10:10:09.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.741+0000 7f33c5856700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33c0097700 0x7f33c0127b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.741+0000 7f33c5856700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f33c012b150 0x7f33c0132d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.741+0000 7f33c5856700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c0065770 con 0x7f33c0128070 2023-10-03T10:10:09.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.741+0000 7f33c5856700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c0097ae0 con 0x7f33c012b150 2023-10-03T10:10:09.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.741+0000 7f33c5856700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33c0097e30 con 0x7f33c0097700 2023-10-03T10:10:09.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.742+0000 7f33beffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33c0097700 0x7f33c0127b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.742+0000 7f33bf7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f33c012b150 0x7f33c0132d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.742+0000 7f33be7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f33c0128070 0x7f33c012aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40246/0 (socket says 172.21.15.146:40246) 2023-10-03T10:10:09.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.742+0000 7f33beffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33c0097700 0x7f33c0127b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40298/0 (socket says 172.21.15.146:40298) 2023-10-03T10:10:09.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.742+0000 7f33be7fc700 1 -- 172.21.15.146:0/4102136733 learned_addr learned my addr 172.21.15.146:0/4102136733 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:10:09.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.742+0000 7f33bf7fe700 1 -- 172.21.15.146:0/4102136733 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33c0097700 msgr2=0x7f33c0127b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:09.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.742+0000 7f33bf7fe700 1 --2- 172.21.15.146:0/4102136733 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33c0097700 0x7f33c0127b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.742+0000 7f33bf7fe700 1 -- 172.21.15.146:0/4102136733 >> v1:172.21.15.146:6789/0 conn(0x7f33c0128070 legacy=0x7f33c012aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.742+0000 7f33bf7fe700 1 -- 172.21.15.146:0/4102136733 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c006a9b0 con 0x7f33c012b150 2023-10-03T10:10:09.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.742+0000 7f33beffd700 1 --2- 172.21.15.146:0/4102136733 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33c0097700 0x7f33c0127b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:09.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.742+0000 7f33bdffb700 1 -- 172.21.15.146:0/4102136733 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670731235 0 0) 0x7f33c0065770 con 0x7f33c0128070 2023-10-03T10:10:09.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.742+0000 7f33bf7fe700 1 --2- 172.21.15.146:0/4102136733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33c012b150 0x7f33c0132d90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f33b8009e60 tx=0x7f33b8009780).ready entity=mon.0 client_cookie=2ca647be7ec7e9aa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:09.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.742+0000 7f33bdffb700 1 -- 172.21.15.146:0/4102136733 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b800e070 con 0x7f33c012b150 2023-10-03T10:10:09.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.742+0000 7f33bdffb700 1 -- 172.21.15.146:0/4102136733 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b800bb60 con 0x7f33c012b150 2023-10-03T10:10:09.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.742+0000 7f33bdffb700 1 -- 172.21.15.146:0/4102136733 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b8012410 con 0x7f33c012b150 2023-10-03T10:10:09.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.743+0000 7f33c5856700 1 -- 172.21.15.146:0/4102136733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33c012b150 msgr2=0x7f33c0132d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.743+0000 7f33c5856700 1 --2- 172.21.15.146:0/4102136733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33c012b150 0x7f33c0132d90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f33b8009e60 tx=0x7f33b8009780).stop 2023-10-03T10:10:09.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.743+0000 7f33c5856700 1 -- 172.21.15.146:0/4102136733 shutdown_connections 2023-10-03T10:10:09.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.743+0000 7f33c5856700 1 --2- 172.21.15.146:0/4102136733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33c012b150 0x7f33c0132d90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.743+0000 7f33c5856700 1 --2- 172.21.15.146:0/4102136733 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33c0097700 0x7f33c0127b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.743+0000 7f33c5856700 1 -- 172.21.15.146:0/4102136733 >> 172.21.15.146:0/4102136733 conn(0x7f33c0098580 msgr2=0x7f33c0098990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:09.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.743+0000 7f33c5856700 1 -- 172.21.15.146:0/4102136733 shutdown_connections 2023-10-03T10:10:09.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.743+0000 7f33c5856700 1 -- 172.21.15.146:0/4102136733 wait complete. 2023-10-03T10:10:09.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.744+0000 7f33c5856700 1 Processor -- start 2023-10-03T10:10:09.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.744+0000 7f33c5856700 1 -- start start 2023-10-03T10:10:09.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.744+0000 7f33c5856700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33c0097700 0x7f33c0113fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.744+0000 7f33c5856700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33c0128070 0x7f33c01144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.744+0000 7f33c5856700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33c012b150 0x7f33c0139f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.744+0000 7f33c5856700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c0128bb0 con 0x7f33c0097700 2023-10-03T10:10:09.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.744+0000 7f33c5856700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c00650e0 con 0x7f33c012b150 2023-10-03T10:10:09.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.744+0000 7f33c5856700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33c0116d40 con 0x7f33c0128070 2023-10-03T10:10:09.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.744+0000 7f33beffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33c0097700 0x7f33c0113fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.744+0000 7f33beffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33c0097700 0x7f33c0113fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60054/0 (socket says 172.21.15.146:60054) 2023-10-03T10:10:09.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.744+0000 7f33beffd700 1 -- 172.21.15.146:0/3301345383 learned_addr learned my addr 172.21.15.146:0/3301345383 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:09.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.744+0000 7f33bf7fe700 1 --2- 172.21.15.146:0/3301345383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33c012b150 0x7f33c0139f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.744+0000 7f33be7fc700 1 --2- 172.21.15.146:0/3301345383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33c0128070 0x7f33c01144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.744+0000 7f33beffd700 1 -- 172.21.15.146:0/3301345383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33c0128070 msgr2=0x7f33c01144a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.744+0000 7f33beffd700 1 --2- 172.21.15.146:0/3301345383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33c0128070 0x7f33c01144a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.744+0000 7f33beffd700 1 -- 172.21.15.146:0/3301345383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33c012b150 msgr2=0x7f33c0139f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.744+0000 7f33beffd700 1 --2- 172.21.15.146:0/3301345383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33c012b150 0x7f33c0139f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.744+0000 7f33beffd700 1 -- 172.21.15.146:0/3301345383 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b40092a0 con 0x7f33c0097700 2023-10-03T10:10:09.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.745+0000 7f33beffd700 1 --2- 172.21.15.146:0/3301345383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33c0097700 0x7f33c0113fb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f33b400ea20 tx=0x7f33b4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:09.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.745+0000 7f33a6ffd700 1 -- 172.21.15.146:0/3301345383 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b400ee60 con 0x7f33c0097700 2023-10-03T10:10:09.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.745+0000 7f33a6ffd700 1 -- 172.21.15.146:0/3301345383 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b400c850 con 0x7f33c0097700 2023-10-03T10:10:09.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.745+0000 7f33c5856700 1 -- 172.21.15.146:0/3301345383 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b8009a20 con 0x7f33c0097700 2023-10-03T10:10:09.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.745+0000 7f33a6ffd700 1 -- 172.21.15.146:0/3301345383 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b400cbd0 con 0x7f33c0097700 2023-10-03T10:10:09.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.745+0000 7f33c5856700 1 -- 172.21.15.146:0/3301345383 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c01179c0 con 0x7f33c0097700 2023-10-03T10:10:09.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.745+0000 7f33a6ffd700 1 -- 172.21.15.146:0/3301345383 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f33b401b400 con 0x7f33c0097700 2023-10-03T10:10:09.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.746+0000 7f33a6ffd700 1 -- 172.21.15.146:0/3301345383 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f33b403b480 con 0x7f33c0097700 2023-10-03T10:10:09.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.746+0000 7f33c5856700 1 -- 172.21.15.146:0/3301345383 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c0065970 con 0x7f33c0097700 2023-10-03T10:10:09.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.750+0000 7f33a6ffd700 1 -- 172.21.15.146:0/3301345383 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f33b4019900 con 0x7f33c0097700 2023-10-03T10:10:09.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.945+0000 7f33c5856700 1 -- 172.21.15.146:0/3301345383 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33c005a260 con 0x7f33c0097700 2023-10-03T10:10:09.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.946+0000 7f33a6ffd700 1 -- 172.21.15.146:0/3301345383 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2158 (secure 0 0 0) 0x7f33b4019310 con 0x7f33c0097700 2023-10-03T10:10:09.947 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:10:09.947 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:48.718228+0000","modified":"2023-10-03T10:09:50.726096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4181":{"gid":4181,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6817/4164614194","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6817","nonce":4164614194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:10:09.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.947+0000 7f33c5856700 1 -- 172.21.15.146:0/3301345383 >> v1:172.21.15.146:6816/118159 conn(0x7f33ac02bb90 legacy=0x7f33ac02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.947+0000 7f33c5856700 1 -- 172.21.15.146:0/3301345383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33c0097700 msgr2=0x7f33c0113fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.947+0000 7f33c5856700 1 --2- 172.21.15.146:0/3301345383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33c0097700 0x7f33c0113fb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f33b400ea20 tx=0x7f33b4009060).stop 2023-10-03T10:10:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.947+0000 7f33c5856700 1 -- 172.21.15.146:0/3301345383 shutdown_connections 2023-10-03T10:10:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.947+0000 7f33c5856700 1 --2- 172.21.15.146:0/3301345383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33c012b150 0x7f33c0139f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.947+0000 7f33c5856700 1 --2- 172.21.15.146:0/3301345383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33c0097700 0x7f33c0113fb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.947+0000 7f33c5856700 1 --2- 172.21.15.146:0/3301345383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33c0128070 0x7f33c01144a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.947+0000 7f33c5856700 1 -- 172.21.15.146:0/3301345383 >> 172.21.15.146:0/3301345383 conn(0x7f33c0098580 msgr2=0x7f33c01262f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.948+0000 7f33c5856700 1 -- 172.21.15.146:0/3301345383 shutdown_connections 2023-10-03T10:10:09.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:09.948+0000 7f33c5856700 1 -- 172.21.15.146:0/3301345383 wait complete. 2023-10-03T10:10:09.950 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 5 2023-10-03T10:10:09.960 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:10:10.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.074+0000 7fcd640fd700 1 Processor -- start 2023-10-03T10:10:10.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.074+0000 7fcd640fd700 1 -- start start 2023-10-03T10:10:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.075+0000 7fcd640fd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd5c066310 0x7fcd5c0976f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.075+0000 7fcd640fd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcd5c127df0 0x7fcd5c12ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.075+0000 7fcd640fd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd5c0980b0 con 0x7fcd5c128230 2023-10-03T10:10:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.075+0000 7fcd640fd700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5c0666f0 con 0x7fcd5c127df0 2023-10-03T10:10:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.075+0000 7fcd640fd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c065530 con 0x7fcd5c066310 2023-10-03T10:10:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.075+0000 7fcd61e99700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd5c066310 0x7fcd5c0976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.075+0000 7fcd61698700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcd5c127df0 0x7fcd5c12ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.075+0000 7fcd6269a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcd5c128230 0x7fcd5c12b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40258/0 (socket says 172.21.15.146:40258) 2023-10-03T10:10:10.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.075+0000 7fcd6269a700 1 -- 172.21.15.146:0/4138890193 learned_addr learned my addr 172.21.15.146:0/4138890193 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:10:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.075+0000 7fcd61e99700 1 -- 172.21.15.146:0/4138890193 >> v2:172.21.15.146:3300/0 conn(0x7fcd5c127df0 msgr2=0x7fcd5c12ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.075+0000 7fcd61e99700 1 --2- 172.21.15.146:0/4138890193 >> v2:172.21.15.146:3300/0 conn(0x7fcd5c127df0 0x7fcd5c12ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.075+0000 7fcd61e99700 1 -- 172.21.15.146:0/4138890193 >> v1:172.21.15.146:6789/0 conn(0x7fcd5c128230 legacy=0x7fcd5c12b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.075+0000 7fcd61e99700 1 -- 172.21.15.146:0/4138890193 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5c065850 con 0x7fcd5c066310 2023-10-03T10:10:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.075+0000 7fcd60e97700 1 -- 172.21.15.146:0/4138890193 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2565520844 0 0) 0x7fcd5c0980b0 con 0x7fcd5c128230 2023-10-03T10:10:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.075+0000 7fcd61698700 1 --2- 172.21.15.146:0/4138890193 >> v2:172.21.15.146:3300/0 conn(0x7fcd5c127df0 0x7fcd5c12ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.075+0000 7fcd61e99700 1 --2- 172.21.15.146:0/4138890193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd5c066310 0x7fcd5c0976f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fcd4c009790 tx=0x7fcd4c009060).ready entity=mon.1 client_cookie=c2aed929bfae5aae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.076+0000 7fcd60e97700 1 -- 172.21.15.146:0/4138890193 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c0090d0 con 0x7fcd5c066310 2023-10-03T10:10:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.076+0000 7fcd60e97700 1 -- 172.21.15.146:0/4138890193 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c00f510 con 0x7fcd5c066310 2023-10-03T10:10:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.076+0000 7fcd60e97700 1 -- 172.21.15.146:0/4138890193 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c00f890 con 0x7fcd5c066310 2023-10-03T10:10:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.076+0000 7fcd640fd700 1 -- 172.21.15.146:0/4138890193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd5c066310 msgr2=0x7fcd5c0976f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.076+0000 7fcd640fd700 1 --2- 172.21.15.146:0/4138890193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd5c066310 0x7fcd5c0976f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fcd4c009790 tx=0x7fcd4c009060).stop 2023-10-03T10:10:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.076+0000 7fcd640fd700 1 -- 172.21.15.146:0/4138890193 shutdown_connections 2023-10-03T10:10:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.076+0000 7fcd640fd700 1 --2- 172.21.15.146:0/4138890193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd5c066310 0x7fcd5c0976f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.076+0000 7fcd640fd700 1 --2- 172.21.15.146:0/4138890193 >> v2:172.21.15.146:3300/0 conn(0x7fcd5c127df0 0x7fcd5c12ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.076+0000 7fcd640fd700 1 -- 172.21.15.146:0/4138890193 >> 172.21.15.146:0/4138890193 conn(0x7fcd5c09bad0 msgr2=0x7fcd5c09bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.076+0000 7fcd640fd700 1 -- 172.21.15.146:0/4138890193 shutdown_connections 2023-10-03T10:10:10.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.076+0000 7fcd640fd700 1 -- 172.21.15.146:0/4138890193 wait complete. 2023-10-03T10:10:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.077+0000 7fcd640fd700 1 Processor -- start 2023-10-03T10:10:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.077+0000 7fcd640fd700 1 -- start start 2023-10-03T10:10:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.078+0000 7fcd640fd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd5c066310 0x7fcd5c117950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.078+0000 7fcd640fd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd5c127df0 0x7fcd5c1139b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.078+0000 7fcd640fd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c128230 0x7fcd5c113ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.078+0000 7fcd640fd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c115e10 con 0x7fcd5c128230 2023-10-03T10:10:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.078+0000 7fcd640fd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c124a80 con 0x7fcd5c066310 2023-10-03T10:10:10.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.078+0000 7fcd640fd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c09a1d0 con 0x7fcd5c127df0 2023-10-03T10:10:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.078+0000 7fcd6269a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c128230 0x7fcd5c113ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.078+0000 7fcd6269a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c128230 0x7fcd5c113ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60068/0 (socket says 172.21.15.146:60068) 2023-10-03T10:10:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.078+0000 7fcd6269a700 1 -- 172.21.15.146:0/2612392986 learned_addr learned my addr 172.21.15.146:0/2612392986 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.078+0000 7fcd6269a700 1 -- 172.21.15.146:0/2612392986 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd5c127df0 msgr2=0x7fcd5c1139b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.078+0000 7fcd6269a700 1 --2- 172.21.15.146:0/2612392986 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd5c127df0 0x7fcd5c1139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.078+0000 7fcd6269a700 1 -- 172.21.15.146:0/2612392986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd5c066310 msgr2=0x7fcd5c117950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.078+0000 7fcd6269a700 1 --2- 172.21.15.146:0/2612392986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd5c066310 0x7fcd5c117950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.078+0000 7fcd6269a700 1 -- 172.21.15.146:0/2612392986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd580092a0 con 0x7fcd5c128230 2023-10-03T10:10:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.079+0000 7fcd6269a700 1 --2- 172.21.15.146:0/2612392986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c128230 0x7fcd5c113ea0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fcd5400c7e0 tx=0x7fcd54007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.079+0000 7fcd51ffb700 1 -- 172.21.15.146:0/2612392986 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd54005d30 con 0x7fcd5c128230 2023-10-03T10:10:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.079+0000 7fcd51ffb700 1 -- 172.21.15.146:0/2612392986 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd54005e90 con 0x7fcd5c128230 2023-10-03T10:10:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.079+0000 7fcd640fd700 1 -- 172.21.15.146:0/2612392986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4c0092a0 con 0x7fcd5c128230 2023-10-03T10:10:10.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.079+0000 7fcd51ffb700 1 -- 172.21.15.146:0/2612392986 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd54007320 con 0x7fcd5c128230 2023-10-03T10:10:10.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.079+0000 7fcd640fd700 1 -- 172.21.15.146:0/2612392986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5c115540 con 0x7fcd5c128230 2023-10-03T10:10:10.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.080+0000 7fcd51ffb700 1 -- 172.21.15.146:0/2612392986 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fcd540076d0 con 0x7fcd5c128230 2023-10-03T10:10:10.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.080+0000 7fcd51ffb700 1 -- 172.21.15.146:0/2612392986 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fcd5403b0d0 con 0x7fcd5c128230 2023-10-03T10:10:10.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.080+0000 7fcd640fd700 1 -- 172.21.15.146:0/2612392986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5c05a260 con 0x7fcd5c128230 2023-10-03T10:10:10.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.084+0000 7fcd51ffb700 1 -- 172.21.15.146:0/2612392986 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fcd54007980 con 0x7fcd5c128230 2023-10-03T10:10:10.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.243+0000 7fcd640fd700 1 -- 172.21.15.146:0/2612392986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd5c1173b0 con 0x7fcd5c128230 2023-10-03T10:10:10.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.244+0000 7fcd51ffb700 1 -- 172.21.15.146:0/2612392986 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11372 (secure 0 0 0) 0x7fcd54011360 con 0x7fcd5c128230 2023-10-03T10:10:10.245 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:10:10.245 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":17,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:10:05.765179+0000","last_up_change":"2023-10-03T10:09:42.301022+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":118758}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":118758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":118758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":118758}]},"public_addr":"172.21.15.146:6800/118758","cluster_addr":"172.21.15.146:6801/118758","heartbeat_back_addr":"172.21.15.146:6803/118758","heartbeat_front_addr":"172.21.15.146:6802/118758","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":118774}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":118774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":118774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":118774}]},"public_addr":"172.21.15.146:6804/118774","cluster_addr":"172.21.15.146:6806/118774","heartbeat_back_addr":"172.21.15.146:6810/118774","heartbeat_front_addr":"172.21.15.146:6808/118774","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":118775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":118775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":118775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":118775}]},"public_addr":"172.21.15.146:6805/118775","cluster_addr":"172.21.15.146:6807/118775","heartbeat_back_addr":"172.21.15.146:6811/118775","heartbeat_front_addr":"172.21.15.146:6809/118775","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":118776}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":118776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":118776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":118776}]},"public_addr":"172.21.15.146:6812/118776","cluster_addr":"172.21.15.146:6813/118776","heartbeat_back_addr":"172.21.15.146:6815/118776","heartbeat_front_addr":"172.21.15.146:6814/118776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:10:10.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.246+0000 7fcd640fd700 1 -- 172.21.15.146:0/2612392986 >> v1:172.21.15.146:6816/118159 conn(0x7fcd4002bb60 legacy=0x7fcd4002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.246+0000 7fcd640fd700 1 -- 172.21.15.146:0/2612392986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c128230 msgr2=0x7fcd5c113ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.246+0000 7fcd640fd700 1 --2- 172.21.15.146:0/2612392986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c128230 0x7fcd5c113ea0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fcd5400c7e0 tx=0x7fcd54007f90).stop 2023-10-03T10:10:10.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.246+0000 7fcd640fd700 1 -- 172.21.15.146:0/2612392986 shutdown_connections 2023-10-03T10:10:10.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.246+0000 7fcd640fd700 1 --2- 172.21.15.146:0/2612392986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c128230 0x7fcd5c113ea0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.246+0000 7fcd640fd700 1 --2- 172.21.15.146:0/2612392986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd5c066310 0x7fcd5c117950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:10.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.246+0000 7fcd640fd700 1 --2- 172.21.15.146:0/2612392986 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd5c127df0 0x7fcd5c1139b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:10:10.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.246+0000 7fcd640fd700 1 -- 172.21.15.146:0/2612392986 >> 172.21.15.146:0/2612392986 conn(0x7fcd5c09bad0 msgr2=0x7fcd5c128d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:10.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.246+0000 7fcd640fd700 1 -- 172.21.15.146:0/2612392986 shutdown_connections 2023-10-03T10:10:10.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.246+0000 7fcd640fd700 1 -- 172.21.15.146:0/2612392986 wait complete. 2023-10-03T10:10:10.259 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-03T10:10:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.378+0000 7f6322d91700 1 Processor -- start 2023-10-03T10:10:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.378+0000 7f6322d91700 1 -- start start 2023-10-03T10:10:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.378+0000 7f6322d91700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f631c095da0 0x7f631c0961c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.378+0000 7f6322d91700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f631c0966b0 0x7f631c132290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.378+0000 7f6322d91700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f631c091980 con 0x7f631c062b00 2023-10-03T10:10:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.378+0000 7f6322d91700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631c0973f0 con 0x7f631c095da0 2023-10-03T10:10:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.378+0000 7f6322d91700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f631c062ee0 con 0x7f631c0966b0 2023-10-03T10:10:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.378+0000 7f631bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f631c095da0 0x7f631c0961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.378+0000 7f632132e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f631c0966b0 0x7f631c132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.378+0000 7f6320b2d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f631c062b00 0x7f631c095690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40264/0 (socket says 172.21.15.146:40264) 2023-10-03T10:10:10.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.378+0000 7f6320b2d700 1 -- 172.21.15.146:0/708985274 learned_addr learned my addr 172.21.15.146:0/708985274 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:10:10.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.379+0000 7f632132e700 1 -- 172.21.15.146:0/708985274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f631c095da0 msgr2=0x7f631c0961c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:10.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.379+0000 7f632132e700 1 --2- 172.21.15.146:0/708985274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f631c095da0 0x7f631c0961c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.379+0000 7f632132e700 1 -- 172.21.15.146:0/708985274 >> v1:172.21.15.146:6789/0 conn(0x7f631c062b00 legacy=0x7f631c095690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.379+0000 7f631b7fe700 1 -- 172.21.15.146:0/708985274 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869524733 0 0) 0x7f631c091980 con 0x7f631c062b00 2023-10-03T10:10:10.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.379+0000 7f632132e700 1 -- 172.21.15.146:0/708985274 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c092310 con 0x7f631c0966b0 2023-10-03T10:10:10.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.379+0000 7f631bfff700 1 --2- 172.21.15.146:0/708985274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f631c095da0 0x7f631c0961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:10.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.379+0000 7f632132e700 1 --2- 172.21.15.146:0/708985274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f631c0966b0 0x7f631c132290 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f6314009e90 tx=0x7f6314009780).ready entity=mon.2 client_cookie=6f55af5b0781fbc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:10.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.379+0000 7f631b7fe700 1 -- 172.21.15.146:0/708985274 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631400e070 con 0x7f631c0966b0 2023-10-03T10:10:10.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.379+0000 7f631b7fe700 1 -- 172.21.15.146:0/708985274 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631400bb60 con 0x7f631c0966b0 2023-10-03T10:10:10.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.379+0000 7f631b7fe700 1 -- 172.21.15.146:0/708985274 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314012410 con 0x7f631c0966b0 2023-10-03T10:10:10.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.379+0000 7f6322d91700 1 -- 172.21.15.146:0/708985274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f631c0966b0 msgr2=0x7f631c132290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.379+0000 7f6322d91700 1 --2- 172.21.15.146:0/708985274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f631c0966b0 0x7f631c132290 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f6314009e90 tx=0x7f6314009780).stop 2023-10-03T10:10:10.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.380+0000 7f6322d91700 1 -- 172.21.15.146:0/708985274 shutdown_connections 2023-10-03T10:10:10.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.380+0000 7f6322d91700 1 --2- 172.21.15.146:0/708985274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f631c0966b0 0x7f631c132290 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.380+0000 7f6322d91700 1 --2- 172.21.15.146:0/708985274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f631c095da0 0x7f631c0961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.380+0000 7f6322d91700 1 -- 172.21.15.146:0/708985274 >> 172.21.15.146:0/708985274 conn(0x7f631c09aa50 msgr2=0x7f631c09ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.380+0000 7f6322d91700 1 -- 172.21.15.146:0/708985274 shutdown_connections 2023-10-03T10:10:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.380+0000 7f6322d91700 1 -- 172.21.15.146:0/708985274 wait complete. 2023-10-03T10:10:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.380+0000 7f6322d91700 1 Processor -- start 2023-10-03T10:10:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.381+0000 7f6322d91700 1 -- start start 2023-10-03T10:10:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.381+0000 7f6322d91700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f631c062b00 0x7f631c115170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.381+0000 7f6322d91700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f631c095da0 0x7f631c115660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.381+0000 7f6322d91700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f631c0966b0 0x7f631c115b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.381+0000 7f6322d91700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c12d2b0 con 0x7f631c062b00 2023-10-03T10:10:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.381+0000 7f6322d91700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631c1177a0 con 0x7f631c0966b0 2023-10-03T10:10:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.381+0000 7f6322d91700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f631c096da0 con 0x7f631c095da0 2023-10-03T10:10:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.381+0000 7f6320b2d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f631c062b00 0x7f631c115170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.381+0000 7f632132e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f631c0966b0 0x7f631c115b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.381+0000 7f6320b2d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f631c062b00 0x7f631c115170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60082/0 (socket says 172.21.15.146:60082) 2023-10-03T10:10:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.381+0000 7f6320b2d700 1 -- 172.21.15.146:0/125035268 learned_addr learned my addr 172.21.15.146:0/125035268 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.381+0000 7f631bfff700 1 --2- 172.21.15.146:0/125035268 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f631c095da0 0x7f631c115660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.381+0000 7f632132e700 1 -- 172.21.15.146:0/125035268 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f631c095da0 msgr2=0x7f631c115660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.381+0000 7f632132e700 1 --2- 172.21.15.146:0/125035268 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f631c095da0 0x7f631c115660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.381+0000 7f632132e700 1 -- 172.21.15.146:0/125035268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f631c062b00 msgr2=0x7f631c115170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.381+0000 7f632132e700 1 --2- 172.21.15.146:0/125035268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f631c062b00 0x7f631c115170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.381+0000 7f632132e700 1 -- 172.21.15.146:0/125035268 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63080092a0 con 0x7f631c0966b0 2023-10-03T10:10:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.381+0000 7f6320b2d700 1 --2- 172.21.15.146:0/125035268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f631c062b00 0x7f631c115170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.382+0000 7f632132e700 1 --2- 172.21.15.146:0/125035268 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f631c0966b0 0x7f631c115b50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f6314014000 tx=0x7f6314009780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.382+0000 7f6318ff9700 1 -- 172.21.15.146:0/125035268 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631401d630 con 0x7f631c0966b0 2023-10-03T10:10:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.382+0000 7f6318ff9700 1 -- 172.21.15.146:0/125035268 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631401d790 con 0x7f631c0966b0 2023-10-03T10:10:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.382+0000 7f6318ff9700 1 -- 172.21.15.146:0/125035268 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631401db50 con 0x7f631c0966b0 2023-10-03T10:10:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.382+0000 7f6322d91700 1 -- 172.21.15.146:0/125035268 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6314009a20 con 0x7f631c0966b0 2023-10-03T10:10:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.382+0000 7f6322d91700 1 -- 172.21.15.146:0/125035268 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631c1192f0 con 0x7f631c0966b0 2023-10-03T10:10:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.382+0000 7f6318ff9700 1 -- 172.21.15.146:0/125035268 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6314003040 con 0x7f631c0966b0 2023-10-03T10:10:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.382+0000 7f6318ff9700 1 -- 172.21.15.146:0/125035268 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f631403cce0 con 0x7f631c0966b0 2023-10-03T10:10:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.383+0000 7f6322d91700 1 -- 172.21.15.146:0/125035268 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631c099890 con 0x7f631c0966b0 2023-10-03T10:10:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.387+0000 7f6318ff9700 1 -- 172.21.15.146:0/125035268 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6314010310 con 0x7f631c0966b0 2023-10-03T10:10:10.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:10.584+0000 7f6322d91700 1 -- 172.21.15.146:0/125035268 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f631c05a260 con 0x7f631c0966b0 2023-10-03T10:10:11.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.083+0000 7f6318ff9700 1 -- 172.21.15.146:0/125035268 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6314011e60 con 0x7f631c0966b0 2023-10-03T10:10:11.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.085+0000 7f6322d91700 1 -- 172.21.15.146:0/125035268 >> v1:172.21.15.146:6816/118159 conn(0x7f630002bb90 legacy=0x7f630002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:11.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.085+0000 7f6322d91700 1 -- 172.21.15.146:0/125035268 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f631c0966b0 msgr2=0x7f631c115b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:11.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.085+0000 7f6322d91700 1 --2- 172.21.15.146:0/125035268 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f631c0966b0 0x7f631c115b50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f6314014000 tx=0x7f6314009780).stop 2023-10-03T10:10:11.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.085+0000 7f6322d91700 1 -- 172.21.15.146:0/125035268 shutdown_connections 2023-10-03T10:10:11.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.085+0000 7f6322d91700 1 --2- 172.21.15.146:0/125035268 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f631c0966b0 0x7f631c115b50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.085+0000 7f6322d91700 1 --2- 172.21.15.146:0/125035268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f631c062b00 0x7f631c115170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.085+0000 7f6322d91700 1 --2- 172.21.15.146:0/125035268 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f631c095da0 0x7f631c115660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.085+0000 7f6322d91700 1 -- 172.21.15.146:0/125035268 >> 172.21.15.146:0/125035268 conn(0x7f631c09aa50 msgr2=0x7f631c12fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:11.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.085+0000 7f6322d91700 1 -- 172.21.15.146:0/125035268 shutdown_connections 2023-10-03T10:10:11.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.085+0000 7f6322d91700 1 -- 172.21.15.146:0/125035268 wait complete. 2023-10-03T10:10:11.098 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2023-10-03T10:10:11.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.217+0000 7f7093245700 1 Processor -- start 2023-10-03T10:10:11.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.217+0000 7f7093245700 1 -- start start 2023-10-03T10:10:11.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.217+0000 7f7093245700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f708c097300 0x7f708c0976e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:11.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.217+0000 7f7093245700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f708c12e2d0 0x7f708c1306c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:11.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.217+0000 7f7093245700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f708c0982f0 con 0x7f708c096810 2023-10-03T10:10:11.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.217+0000 7f7093245700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f708c068550 con 0x7f708c097300 2023-10-03T10:10:11.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.217+0000 7f7093245700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f708c069e20 con 0x7f708c12e2d0 2023-10-03T10:10:11.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.217+0000 7f70917e2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f708c12e2d0 0x7f708c1306c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:11.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.217+0000 7f708bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f708c097300 0x7f708c0976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:11.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.217+0000 7f70917e2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f708c12e2d0 0x7f708c1306c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40324/0 (socket says 172.21.15.146:40324) 2023-10-03T10:10:11.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.217+0000 7f708bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f708c097300 0x7f708c0976e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60098/0 (socket says 172.21.15.146:60098) 2023-10-03T10:10:11.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.217+0000 7f70917e2700 1 -- 172.21.15.146:0/613811789 learned_addr learned my addr 172.21.15.146:0/613811789 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:11.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.218+0000 7f708bfff700 1 -- 172.21.15.146:0/613811789 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f708c12e2d0 msgr2=0x7f708c1306c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:11.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.218+0000 7f708bfff700 1 --2- 172.21.15.146:0/613811789 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f708c12e2d0 0x7f708c1306c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.218+0000 7f708bfff700 1 -- 172.21.15.146:0/613811789 >> v1:172.21.15.146:6789/0 conn(0x7f708c096810 legacy=0x7f708c096bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:11.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.218+0000 7f708bfff700 1 -- 172.21.15.146:0/613811789 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708c097bd0 con 0x7f708c097300 2023-10-03T10:10:11.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.218+0000 7f70917e2700 1 --2- 172.21.15.146:0/613811789 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f708c12e2d0 0x7f708c1306c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:11.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.218+0000 7f708bfff700 1 --2- 172.21.15.146:0/613811789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f708c097300 0x7f708c0976e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f7078009760 tx=0x7f7078009060).ready entity=mon.0 client_cookie=fa7ef96ae259ad03 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:11.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.218+0000 7f708b7fe700 1 -- 172.21.15.146:0/613811789 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70780090d0 con 0x7f708c097300 2023-10-03T10:10:11.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.218+0000 7f708b7fe700 1 -- 172.21.15.146:0/613811789 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707800f510 con 0x7f708c097300 2023-10-03T10:10:11.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.218+0000 7f708b7fe700 1 -- 172.21.15.146:0/613811789 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707800f890 con 0x7f708c097300 2023-10-03T10:10:11.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.219+0000 7f7093245700 1 -- 172.21.15.146:0/613811789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f708c097300 msgr2=0x7f708c0976e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:11.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.219+0000 7f7093245700 1 --2- 172.21.15.146:0/613811789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f708c097300 0x7f708c0976e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f7078009760 tx=0x7f7078009060).stop 2023-10-03T10:10:11.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.219+0000 7f7093245700 1 -- 172.21.15.146:0/613811789 shutdown_connections 2023-10-03T10:10:11.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.219+0000 7f7093245700 1 --2- 172.21.15.146:0/613811789 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f708c12e2d0 0x7f708c1306c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.219+0000 7f7093245700 1 --2- 172.21.15.146:0/613811789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f708c097300 0x7f708c0976e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.219+0000 7f7093245700 1 -- 172.21.15.146:0/613811789 >> 172.21.15.146:0/613811789 conn(0x7f708c09bad0 msgr2=0x7f708c09bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:11.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.219+0000 7f7093245700 1 -- 172.21.15.146:0/613811789 shutdown_connections 2023-10-03T10:10:11.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.219+0000 7f7093245700 1 -- 172.21.15.146:0/613811789 wait complete. 2023-10-03T10:10:11.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.219+0000 7f7093245700 1 Processor -- start 2023-10-03T10:10:11.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.220+0000 7f7093245700 1 -- start start 2023-10-03T10:10:11.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.220+0000 7f7093245700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f708c096810 0x7f708c0646d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:11.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.220+0000 7f7093245700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f708c097300 0x7f708c064bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.220+0000 7f7093245700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f708c12e2d0 0x7f708c0650b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.220+0000 7f7093245700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c11e8e0 con 0x7f708c097300 2023-10-03T10:10:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.220+0000 7f7093245700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708c11c7f0 con 0x7f708c096810 2023-10-03T10:10:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.220+0000 7f7093245700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f708c091bd0 con 0x7f708c12e2d0 2023-10-03T10:10:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.220+0000 7f708bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f708c097300 0x7f708c064bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.220+0000 7f7090fe1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f708c096810 0x7f708c0646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.220+0000 7f708bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f708c097300 0x7f708c064bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60106/0 (socket says 172.21.15.146:60106) 2023-10-03T10:10:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.220+0000 7f708bfff700 1 -- 172.21.15.146:0/178765373 learned_addr learned my addr 172.21.15.146:0/178765373 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.220+0000 7f7090fe1700 1 --2- 172.21.15.146:0/178765373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f708c096810 0x7f708c0646d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43036/0 (socket says 172.21.15.146:43036) 2023-10-03T10:10:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.220+0000 7f70917e2700 1 --2- 172.21.15.146:0/178765373 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f708c12e2d0 0x7f708c0650b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.220+0000 7f708bfff700 1 -- 172.21.15.146:0/178765373 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f708c12e2d0 msgr2=0x7f708c0650b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:11.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.220+0000 7f708bfff700 1 --2- 172.21.15.146:0/178765373 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f708c12e2d0 0x7f708c0650b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.220+0000 7f708bfff700 1 -- 172.21.15.146:0/178765373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f708c096810 msgr2=0x7f708c0646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:11.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.220+0000 7f708bfff700 1 --2- 172.21.15.146:0/178765373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f708c096810 0x7f708c0646d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:11.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.221+0000 7f708bfff700 1 -- 172.21.15.146:0/178765373 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7084009ae0 con 0x7f708c097300 2023-10-03T10:10:11.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.221+0000 7f7090fe1700 1 --2- 172.21.15.146:0/178765373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f708c096810 0x7f708c0646d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:11.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.221+0000 7f708bfff700 1 --2- 172.21.15.146:0/178765373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f708c097300 0x7f708c064bc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f7078009e00 tx=0x7f7078017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:11.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.221+0000 7f7088ff9700 1 -- 172.21.15.146:0/178765373 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707800fea0 con 0x7f708c097300 2023-10-03T10:10:11.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.221+0000 7f7088ff9700 1 -- 172.21.15.146:0/178765373 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7078006930 con 0x7f708c097300 2023-10-03T10:10:11.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.221+0000 7f7093245700 1 -- 172.21.15.146:0/178765373 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70780092a0 con 0x7f708c097300 2023-10-03T10:10:11.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.221+0000 7f7088ff9700 1 -- 172.21.15.146:0/178765373 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707800f8d0 con 0x7f708c097300 2023-10-03T10:10:11.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.221+0000 7f7093245700 1 -- 172.21.15.146:0/178765373 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f708c065b40 con 0x7f708c097300 2023-10-03T10:10:11.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.222+0000 7f7088ff9700 1 -- 172.21.15.146:0/178765373 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f707801b620 con 0x7f708c097300 2023-10-03T10:10:11.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.222+0000 7f7088ff9700 1 -- 172.21.15.146:0/178765373 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f707803c870 con 0x7f708c097300 2023-10-03T10:10:11.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.222+0000 7f7093245700 1 -- 172.21.15.146:0/178765373 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f708c05a260 con 0x7f708c097300 2023-10-03T10:10:11.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.226+0000 7f7088ff9700 1 -- 172.21.15.146:0/178765373 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7078029080 con 0x7f708c097300 2023-10-03T10:10:11.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:11.423+0000 7f7093245700 1 -- 172.21.15.146:0/178765373 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f708c095240 con 0x7f708c097300 2023-10-03T10:10:12.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.087+0000 7f7088ff9700 1 -- 172.21.15.146:0/178765373 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v7) v1 ==== 105+0+0 (secure 0 0 0) 0x7f707801f020 con 0x7f708c097300 2023-10-03T10:10:12.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.090+0000 7f7093245700 1 -- 172.21.15.146:0/178765373 >> v1:172.21.15.146:6816/118159 conn(0x7f707002bb60 legacy=0x7f707002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.090+0000 7f7093245700 1 -- 172.21.15.146:0/178765373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f708c097300 msgr2=0x7f708c064bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.090+0000 7f7093245700 1 --2- 172.21.15.146:0/178765373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f708c097300 0x7f708c064bc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f7078009e00 tx=0x7f7078017000).stop 2023-10-03T10:10:12.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.090+0000 7f7093245700 1 -- 172.21.15.146:0/178765373 shutdown_connections 2023-10-03T10:10:12.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.090+0000 7f7093245700 1 --2- 172.21.15.146:0/178765373 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f708c12e2d0 0x7f708c0650b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.090+0000 7f7093245700 1 --2- 172.21.15.146:0/178765373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f708c096810 0x7f708c0646d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.090+0000 7f7093245700 1 --2- 172.21.15.146:0/178765373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f708c097300 0x7f708c064bc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.090+0000 7f7093245700 1 -- 172.21.15.146:0/178765373 >> 172.21.15.146:0/178765373 conn(0x7f708c09bad0 msgr2=0x7f708c112130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:12.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.090+0000 7f7093245700 1 -- 172.21.15.146:0/178765373 shutdown_connections 2023-10-03T10:10:12.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.090+0000 7f7093245700 1 -- 172.21.15.146:0/178765373 wait complete. 2023-10-03T10:10:12.105 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:10:12.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.226+0000 7f9768774700 1 Processor -- start 2023-10-03T10:10:12.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.226+0000 7f9768774700 1 -- start start 2023-10-03T10:10:12.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.227+0000 7f9768774700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97600977b0 0x7f9760127c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.227+0000 7f9768774700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f976012b160 0x7f9760132dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.227+0000 7f9768774700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97601279b0 con 0x7f97601280f0 2023-10-03T10:10:12.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.227+0000 7f9768774700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9760097b90 con 0x7f976012b160 2023-10-03T10:10:12.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.227+0000 7f9768774700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9760065d80 con 0x7f97600977b0 2023-10-03T10:10:12.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.227+0000 7f9766d11700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f976012b160 0x7f9760132dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.227+0000 7f9766510700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97600977b0 0x7f9760127c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.227+0000 7f9765d0f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f97601280f0 0x7f976012aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40288/0 (socket says 172.21.15.146:40288) 2023-10-03T10:10:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.227+0000 7f9766d11700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f976012b160 0x7f9760132dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43048/0 (socket says 172.21.15.146:43048) 2023-10-03T10:10:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.227+0000 7f9765d0f700 1 -- 172.21.15.146:0/3915536138 learned_addr learned my addr 172.21.15.146:0/3915536138 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:10:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.227+0000 7f9766510700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97600977b0 0x7f9760127c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40346/0 (socket says 172.21.15.146:40346) 2023-10-03T10:10:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.227+0000 7f9766510700 1 -- 172.21.15.146:0/3915536138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f976012b160 msgr2=0x7f9760132dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.227+0000 7f976550e700 1 -- 172.21.15.146:0/3915536138 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296767955 0 0) 0x7f97601279b0 con 0x7f97601280f0 2023-10-03T10:10:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.227+0000 7f9766510700 1 --2- 172.21.15.146:0/3915536138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f976012b160 0x7f9760132dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.227+0000 7f9766510700 1 -- 172.21.15.146:0/3915536138 >> v1:172.21.15.146:6789/0 conn(0x7f97601280f0 legacy=0x7f976012aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.227+0000 7f9766510700 1 -- 172.21.15.146:0/3915536138 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976006aa60 con 0x7f97600977b0 2023-10-03T10:10:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.227+0000 7f9766d11700 1 --2- 172.21.15.146:0/3915536138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f976012b160 0x7f9760132dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.227+0000 7f9766510700 1 --2- 172.21.15.146:0/3915536138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97600977b0 0x7f9760127c00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f975c009790 tx=0x7f975c009060).ready entity=mon.2 client_cookie=5045b95a62023c99 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.227+0000 7f976550e700 1 -- 172.21.15.146:0/3915536138 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c00f510 con 0x7f97600977b0 2023-10-03T10:10:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.227+0000 7f976550e700 1 -- 172.21.15.146:0/3915536138 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c00f670 con 0x7f97600977b0 2023-10-03T10:10:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.228+0000 7f976550e700 1 -- 172.21.15.146:0/3915536138 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c00f9f0 con 0x7f97600977b0 2023-10-03T10:10:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.228+0000 7f9768774700 1 -- 172.21.15.146:0/3915536138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97600977b0 msgr2=0x7f9760127c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.228+0000 7f9768774700 1 --2- 172.21.15.146:0/3915536138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97600977b0 0x7f9760127c00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f975c009790 tx=0x7f975c009060).stop 2023-10-03T10:10:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.228+0000 7f9768774700 1 -- 172.21.15.146:0/3915536138 shutdown_connections 2023-10-03T10:10:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.228+0000 7f9768774700 1 --2- 172.21.15.146:0/3915536138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f976012b160 0x7f9760132dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.228+0000 7f9768774700 1 --2- 172.21.15.146:0/3915536138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97600977b0 0x7f9760127c00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.228+0000 7f9768774700 1 -- 172.21.15.146:0/3915536138 >> 172.21.15.146:0/3915536138 conn(0x7f976009bad0 msgr2=0x7f976009bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.228+0000 7f9768774700 1 -- 172.21.15.146:0/3915536138 shutdown_connections 2023-10-03T10:10:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.228+0000 7f9768774700 1 -- 172.21.15.146:0/3915536138 wait complete. 2023-10-03T10:10:12.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.229+0000 7f9768774700 1 Processor -- start 2023-10-03T10:10:12.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.229+0000 7f9768774700 1 -- start start 2023-10-03T10:10:12.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.229+0000 7f9768774700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97600977b0 0x7f9760119a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.229+0000 7f9768774700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97601280f0 0x7f9760115a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.229+0000 7f9768774700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f976012b160 0x7f9760115f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.229+0000 7f9768774700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9760065150 con 0x7f976012b160 2023-10-03T10:10:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.229+0000 7f9768774700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9760118f60 con 0x7f97601280f0 2023-10-03T10:10:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.229+0000 7f9768774700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9760119500 con 0x7f97600977b0 2023-10-03T10:10:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.229+0000 7f9765d0f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97601280f0 0x7f9760115a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.229+0000 7f9766d11700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f976012b160 0x7f9760115f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.229+0000 7f9766510700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97600977b0 0x7f9760119a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.229+0000 7f9766d11700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f976012b160 0x7f9760115f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60122/0 (socket says 172.21.15.146:60122) 2023-10-03T10:10:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.229+0000 7f9766510700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97600977b0 0x7f9760119a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40348/0 (socket says 172.21.15.146:40348) 2023-10-03T10:10:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.229+0000 7f9766d11700 1 -- 172.21.15.146:0/3882924334 learned_addr learned my addr 172.21.15.146:0/3882924334 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.229+0000 7f9765d0f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97601280f0 0x7f9760115a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43056/0 (socket says 172.21.15.146:43056) 2023-10-03T10:10:12.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.230+0000 7f9765d0f700 1 -- 172.21.15.146:0/3882924334 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97600977b0 msgr2=0x7f9760119a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.230+0000 7f9765d0f700 1 --2- 172.21.15.146:0/3882924334 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97600977b0 0x7f9760119a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.230+0000 7f9765d0f700 1 -- 172.21.15.146:0/3882924334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f976012b160 msgr2=0x7f9760115f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.230+0000 7f9765d0f700 1 --2- 172.21.15.146:0/3882924334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f976012b160 0x7f9760115f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.230+0000 7f9765d0f700 1 -- 172.21.15.146:0/3882924334 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9758009a20 con 0x7f97601280f0 2023-10-03T10:10:12.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.230+0000 7f9766510700 1 --2- 172.21.15.146:0/3882924334 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97600977b0 0x7f9760119a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:12.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.230+0000 7f9766d11700 1 --2- 172.21.15.146:0/3882924334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f976012b160 0x7f9760115f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:12.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.230+0000 7f9765d0f700 1 --2- 172.21.15.146:0/3882924334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97601280f0 0x7f9760115a20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f9750000c00 tx=0x7f9750007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:12.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.230+0000 7f97567fc700 1 -- 172.21.15.146:0/3882924334 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97500070d0 con 0x7f97601280f0 2023-10-03T10:10:12.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.230+0000 7f97567fc700 1 -- 172.21.15.146:0/3882924334 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9750007270 con 0x7f97601280f0 2023-10-03T10:10:12.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.230+0000 7f9768774700 1 -- 172.21.15.146:0/3882924334 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975c0092a0 con 0x7f97601280f0 2023-10-03T10:10:12.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.230+0000 7f97567fc700 1 -- 172.21.15.146:0/3882924334 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9750007630 con 0x7f97601280f0 2023-10-03T10:10:12.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.230+0000 7f9768774700 1 -- 172.21.15.146:0/3882924334 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97601175f0 con 0x7f97601280f0 2023-10-03T10:10:12.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.231+0000 7f97567fc700 1 -- 172.21.15.146:0/3882924334 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f97500059b0 con 0x7f97601280f0 2023-10-03T10:10:12.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.231+0000 7f97567fc700 1 -- 172.21.15.146:0/3882924334 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f975003a4a0 con 0x7f97601280f0 2023-10-03T10:10:12.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.231+0000 7f9768774700 1 -- 172.21.15.146:0/3882924334 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f976005a260 con 0x7f97601280f0 2023-10-03T10:10:12.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.235+0000 7f97567fc700 1 -- 172.21.15.146:0/3882924334 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9750013970 con 0x7f97601280f0 2023-10-03T10:10:12.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.437+0000 7f9768774700 1 -- 172.21.15.146:0/3882924334 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9760046c20 con 0x7f97601280f0 2023-10-03T10:10:12.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.438+0000 7f97567fc700 1 -- 172.21.15.146:0/3882924334 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2158 (secure 0 0 0) 0x7f9750012e40 con 0x7f97601280f0 2023-10-03T10:10:12.439 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:10:12.439 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:48.718228+0000","modified":"2023-10-03T10:10:12.083527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4181":{"gid":4181,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6817/4164614194","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6817","nonce":4164614194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:10:12.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.440+0000 7f9768774700 1 -- 172.21.15.146:0/3882924334 >> v1:172.21.15.146:6816/118159 conn(0x7f974402bb60 legacy=0x7f974402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.440+0000 7f9768774700 1 -- 172.21.15.146:0/3882924334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97601280f0 msgr2=0x7f9760115a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.440+0000 7f9768774700 1 --2- 172.21.15.146:0/3882924334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97601280f0 0x7f9760115a20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f9750000c00 tx=0x7f9750007b90).stop 2023-10-03T10:10:12.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.440+0000 7f9768774700 1 -- 172.21.15.146:0/3882924334 shutdown_connections 2023-10-03T10:10:12.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.440+0000 7f9768774700 1 --2- 172.21.15.146:0/3882924334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f976012b160 0x7f9760115f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.440+0000 7f9768774700 1 --2- 172.21.15.146:0/3882924334 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97600977b0 0x7f9760119a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.440+0000 7f9768774700 1 --2- 172.21.15.146:0/3882924334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97601280f0 0x7f9760115a20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.440+0000 7f9768774700 1 -- 172.21.15.146:0/3882924334 >> 172.21.15.146:0/3882924334 conn(0x7f976009bad0 msgr2=0x7f9760129df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:12.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.440+0000 7f9768774700 1 -- 172.21.15.146:0/3882924334 shutdown_connections 2023-10-03T10:10:12.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.440+0000 7f9768774700 1 -- 172.21.15.146:0/3882924334 wait complete. 2023-10-03T10:10:12.442 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 7 2023-10-03T10:10:12.552 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T10:09:48.718228+0000', 'modified': '2023-10-03T10:10:12.083527+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4181}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4181': {'gid': 4181, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6817/4164614194', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.146:6817', 'nonce': 4164614194}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-03T10:10:12.553 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T10:10:12.553 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-03T10:10:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.669+0000 7f8aee1f2700 1 Processor -- start 2023-10-03T10:10:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.669+0000 7f8aee1f2700 1 -- start start 2023-10-03T10:10:12.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.670+0000 7f8aee1f2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ae8093950 0x7f8ae8095760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.670+0000 7f8aee1f2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ae812d250 0x7f8ae812f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.670+0000 7f8aee1f2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae8094ba0 con 0x7f8ae8095c50 2023-10-03T10:10:12.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.670+0000 7f8aee1f2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae8092e90 con 0x7f8ae8093950 2023-10-03T10:10:12.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.670+0000 7f8aee1f2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae8096b60 con 0x7f8ae812d250 2023-10-03T10:10:12.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.670+0000 7f8ae7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ae812d250 0x7f8ae812f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.670+0000 7f8ae6ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8ae8095c50 0x7f8ae8096030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40290/0 (socket says 172.21.15.146:40290) 2023-10-03T10:10:12.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.670+0000 7f8ae6ffd700 1 -- 172.21.15.146:0/1782758694 learned_addr learned my addr 172.21.15.146:0/1782758694 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:10:12.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.670+0000 7f8ae77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ae8093950 0x7f8ae8095760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.670+0000 7f8ae7fff700 1 -- 172.21.15.146:0/1782758694 >> v2:172.21.15.146:3300/0 conn(0x7f8ae8093950 msgr2=0x7f8ae8095760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:12.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.670+0000 7f8ae7fff700 1 --2- 172.21.15.146:0/1782758694 >> v2:172.21.15.146:3300/0 conn(0x7f8ae8093950 0x7f8ae8095760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.670+0000 7f8ae67fc700 1 -- 172.21.15.146:0/1782758694 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257692530 0 0) 0x7f8ae8094ba0 con 0x7f8ae8095c50 2023-10-03T10:10:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.670+0000 7f8ae7fff700 1 -- 172.21.15.146:0/1782758694 >> v1:172.21.15.146:6789/0 conn(0x7f8ae8095c50 legacy=0x7f8ae8096030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.670+0000 7f8ae7fff700 1 -- 172.21.15.146:0/1782758694 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae8093150 con 0x7f8ae812d250 2023-10-03T10:10:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.670+0000 7f8ae7fff700 1 --2- 172.21.15.146:0/1782758694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ae812d250 0x7f8ae812f640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8ae0009e60 tx=0x7f8ae0009780).ready entity=mon.1 client_cookie=89c5d37c0e69eeb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.670+0000 7f8ae67fc700 1 -- 172.21.15.146:0/1782758694 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae000e070 con 0x7f8ae812d250 2023-10-03T10:10:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.670+0000 7f8ae67fc700 1 -- 172.21.15.146:0/1782758694 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae000bb60 con 0x7f8ae812d250 2023-10-03T10:10:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.670+0000 7f8ae67fc700 1 -- 172.21.15.146:0/1782758694 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0012410 con 0x7f8ae812d250 2023-10-03T10:10:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.671+0000 7f8aee1f2700 1 -- 172.21.15.146:0/1782758694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ae812d250 msgr2=0x7f8ae812f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.671+0000 7f8aee1f2700 1 --2- 172.21.15.146:0/1782758694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ae812d250 0x7f8ae812f640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8ae0009e60 tx=0x7f8ae0009780).stop 2023-10-03T10:10:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.671+0000 7f8aee1f2700 1 -- 172.21.15.146:0/1782758694 shutdown_connections 2023-10-03T10:10:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.671+0000 7f8aee1f2700 1 --2- 172.21.15.146:0/1782758694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ae812d250 0x7f8ae812f640 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.671+0000 7f8aee1f2700 1 --2- 172.21.15.146:0/1782758694 >> v2:172.21.15.146:3300/0 conn(0x7f8ae8093950 0x7f8ae8095760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.671+0000 7f8aee1f2700 1 -- 172.21.15.146:0/1782758694 >> 172.21.15.146:0/1782758694 conn(0x7f8ae809aa50 msgr2=0x7f8ae809ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.671+0000 7f8aee1f2700 1 -- 172.21.15.146:0/1782758694 shutdown_connections 2023-10-03T10:10:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.671+0000 7f8aee1f2700 1 -- 172.21.15.146:0/1782758694 wait complete. 2023-10-03T10:10:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.672+0000 7f8aee1f2700 1 Processor -- start 2023-10-03T10:10:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.672+0000 7f8aee1f2700 1 -- start start 2023-10-03T10:10:12.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.672+0000 7f8aee1f2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ae8093950 0x7f8ae8062b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.672+0000 7f8aee1f2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ae8095c50 0x7f8ae8118e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.672+0000 7f8aee1f2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8ae812d250 0x7f8ae8119310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.672+0000 7f8aee1f2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae8092410 con 0x7f8ae8095c50 2023-10-03T10:10:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.672+0000 7f8aee1f2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae809a3f0 con 0x7f8ae8093950 2023-10-03T10:10:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.672+0000 7f8aee1f2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae812ceb0 con 0x7f8ae812d250 2023-10-03T10:10:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.672+0000 7f8ae77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ae8093950 0x7f8ae8062b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.672+0000 7f8ae6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ae8095c50 0x7f8ae8118e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.672+0000 7f8ae77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ae8093950 0x7f8ae8062b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43072/0 (socket says 172.21.15.146:43072) 2023-10-03T10:10:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.672+0000 7f8ae77fe700 1 -- 172.21.15.146:0/3908019584 learned_addr learned my addr 172.21.15.146:0/3908019584 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:12.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.672+0000 7f8ae7fff700 1 --2- 172.21.15.146:0/3908019584 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8ae812d250 0x7f8ae8119310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.673+0000 7f8ae77fe700 1 -- 172.21.15.146:0/3908019584 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8ae812d250 msgr2=0x7f8ae8119310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.673+0000 7f8ae77fe700 1 --2- 172.21.15.146:0/3908019584 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8ae812d250 0x7f8ae8119310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.673+0000 7f8ae77fe700 1 -- 172.21.15.146:0/3908019584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ae8095c50 msgr2=0x7f8ae8118e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.673+0000 7f8ae77fe700 1 --2- 172.21.15.146:0/3908019584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ae8095c50 0x7f8ae8118e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.673+0000 7f8ae77fe700 1 -- 172.21.15.146:0/3908019584 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae0009a20 con 0x7f8ae8093950 2023-10-03T10:10:12.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.673+0000 7f8ae77fe700 1 --2- 172.21.15.146:0/3908019584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ae8093950 0x7f8ae8062b90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8ad800e960 tx=0x7f8ad8009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:12.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.673+0000 7f8adf7fe700 1 -- 172.21.15.146:0/3908019584 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8009510 con 0x7f8ae8093950 2023-10-03T10:10:12.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.673+0000 7f8adf7fe700 1 -- 172.21.15.146:0/3908019584 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad8012600 con 0x7f8ae8093950 2023-10-03T10:10:12.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.673+0000 7f8aee1f2700 1 -- 172.21.15.146:0/3908019584 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae811b2a0 con 0x7f8ae8093950 2023-10-03T10:10:12.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.673+0000 7f8adf7fe700 1 -- 172.21.15.146:0/3908019584 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8012980 con 0x7f8ae8093950 2023-10-03T10:10:12.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.673+0000 7f8aee1f2700 1 -- 172.21.15.146:0/3908019584 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae8063710 con 0x7f8ae8093950 2023-10-03T10:10:12.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.674+0000 7f8adf7fe700 1 -- 172.21.15.146:0/3908019584 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8ad8012d30 con 0x7f8ae8093950 2023-10-03T10:10:12.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.674+0000 7f8adf7fe700 1 -- 172.21.15.146:0/3908019584 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f8ad803b360 con 0x7f8ae8093950 2023-10-03T10:10:12.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.676+0000 7f8affba5b80 1 Processor -- start 2023-10-03T10:10:12.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.677+0000 7f8affba5b80 1 -- start start 2023-10-03T10:10:12.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.677+0000 7f8affba5b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be14170 0x55a80be14550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.677+0000 7f8affba5b80 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be14a40 0x55a80be3e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.677+0000 7f8affba5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a80be3e5b0 0x55a80be409a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.677+0000 7f8affba5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a80bdde610 con 0x55a80be3e5b0 2023-10-03T10:10:12.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.677+0000 7f8affba5b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a80bd54db0 con 0x55a80be14170 2023-10-03T10:10:12.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.677+0000 7f8affba5b80 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a80bd6a030 con 0x55a80be14a40 2023-10-03T10:10:12.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.677+0000 7f8ae77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be14170 0x55a80be14550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.677+0000 7f8ae6ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be14a40 0x55a80be3e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.677+0000 7f8ae77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be14170 0x55a80be14550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43078/0 (socket says 172.21.15.146:43078) 2023-10-03T10:10:12.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.677+0000 7f8ae77fe700 1 -- 172.21.15.146:0/3553524671 learned_addr learned my addr 172.21.15.146:0/3553524671 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.677+0000 7f8ae7fff700 1 --2- 172.21.15.146:0/3553524671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a80be3e5b0 0x55a80be409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.677+0000 7f8ae6ffd700 1 -- 172.21.15.146:0/3553524671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be14170 msgr2=0x55a80be14550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.677+0000 7f8ae6ffd700 1 --2- 172.21.15.146:0/3553524671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be14170 0x55a80be14550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.677+0000 7f8ae6ffd700 1 -- 172.21.15.146:0/3553524671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a80be3e5b0 msgr2=0x55a80be409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.677+0000 7f8ae6ffd700 1 --2- 172.21.15.146:0/3553524671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a80be3e5b0 0x55a80be409a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.677+0000 7f8ae6ffd700 1 -- 172.21.15.146:0/3553524671 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a80bc05710 con 0x55a80be14a40 2023-10-03T10:10:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.677+0000 7f8ae77fe700 1 --2- 172.21.15.146:0/3553524671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be14170 0x55a80be14550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.678+0000 7f8ae6ffd700 1 --2- 172.21.15.146:0/3553524671 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be14a40 0x55a80be3e0c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f8ae8063280 tx=0x7f8ad0007b90).ready entity=mon.2 client_cookie=1e84ef44d8ddd9e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.678+0000 7f8adcff9700 1 -- 172.21.15.146:0/3553524671 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0011b60 con 0x55a80be14a40 2023-10-03T10:10:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.678+0000 7f8adcff9700 1 -- 172.21.15.146:0/3553524671 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad0011cc0 con 0x55a80be14a40 2023-10-03T10:10:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.678+0000 7f8adcff9700 1 -- 172.21.15.146:0/3553524671 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0015620 con 0x55a80be14a40 2023-10-03T10:10:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.678+0000 7f8affba5b80 1 -- 172.21.15.146:0/3553524671 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be14a40 msgr2=0x55a80be3e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.678+0000 7f8affba5b80 1 --2- 172.21.15.146:0/3553524671 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be14a40 0x55a80be3e0c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f8ae8063280 tx=0x7f8ad0007b90).stop 2023-10-03T10:10:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.678+0000 7f8affba5b80 1 -- 172.21.15.146:0/3553524671 shutdown_connections 2023-10-03T10:10:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.678+0000 7f8affba5b80 1 --2- 172.21.15.146:0/3553524671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a80be3e5b0 0x55a80be409a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.678+0000 7f8affba5b80 1 --2- 172.21.15.146:0/3553524671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be14170 0x55a80be14550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.678+0000 7f8affba5b80 1 --2- 172.21.15.146:0/3553524671 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be14a40 0x55a80be3e0c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.678+0000 7f8affba5b80 1 -- 172.21.15.146:0/3553524671 >> 172.21.15.146:0/3553524671 conn(0x55a80bc82940 msgr2=0x55a80be34cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.678+0000 7f8affba5b80 1 -- 172.21.15.146:0/3553524671 shutdown_connections 2023-10-03T10:10:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.679+0000 7f8affba5b80 1 -- 172.21.15.146:0/3553524671 wait complete. 2023-10-03T10:10:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.679+0000 7f8affba5b80 1 -- start start 2023-10-03T10:10:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.679+0000 7f8affba5b80 1 Processor -- start 2023-10-03T10:10:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.679+0000 7f8affba5b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be14170 0x55a80be43cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.679+0000 7f8affba5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a80be14a40 0x55a80be441e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.679+0000 7f8affba5b80 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be3e5b0 0x55a80be39980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.679+0000 7f8affba5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a80bd6a170 con 0x55a80be14a40 2023-10-03T10:10:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.679+0000 7f8affba5b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a80bd6a3f0 con 0x55a80be14170 2023-10-03T10:10:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.679+0000 7f8affba5b80 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a80bd35920 con 0x55a80be3e5b0 2023-10-03T10:10:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8affba5b80 10 client.0 ll_register_callbacks cb 0x55a80bd0ace0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:10:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8ae77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be14170 0x55a80be43cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8ae77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be14170 0x55a80be43cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43086/0 (socket says 172.21.15.146:43086) 2023-10-03T10:10:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8ae77fe700 1 -- 172.21.15.146:0/3633839718 learned_addr learned my addr 172.21.15.146:0/3633839718 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8ae6ffd700 1 --2- 172.21.15.146:0/3633839718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a80be14a40 0x55a80be441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8ae7fff700 1 --2- 172.21.15.146:0/3633839718 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be3e5b0 0x55a80be39980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8ae77fe700 1 -- 172.21.15.146:0/3633839718 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be3e5b0 msgr2=0x55a80be39980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8ae77fe700 1 --2- 172.21.15.146:0/3633839718 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be3e5b0 0x55a80be39980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8ae77fe700 1 -- 172.21.15.146:0/3633839718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a80be14a40 msgr2=0x55a80be441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8ae77fe700 1 --2- 172.21.15.146:0/3633839718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a80be14a40 0x55a80be441e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8ae77fe700 1 -- 172.21.15.146:0/3633839718 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad0001840 con 0x55a80be14170 2023-10-03T10:10:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8ae77fe700 1 --2- 172.21.15.146:0/3633839718 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be14170 0x55a80be43cf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8ad8039b10 tx=0x7f8ad801a000).ready entity=mon.1 client_cookie=b03f13e8396e3b09 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8ac5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.146:3301/0 2023-10-03T10:10:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8ac5ffb700 1 -- 172.21.15.146:0/3633839718 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad802a070 con 0x55a80be14170 2023-10-03T10:10:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8ac5ffb700 1 -- 172.21.15.146:0/3633839718 <== mon.1 v2:172.21.15.146:3301/0 2 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f8ad8019310 con 0x55a80be14170 2023-10-03T10:10:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8affba5b80 1 -- 172.21.15.146:0/3633839718 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a80be0cf20 con 0x55a80be14170 2023-10-03T10:10:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8ac5ffb700 1 -- 172.21.15.146:0/3633839718 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ad8023350 con 0x55a80be14170 2023-10-03T10:10:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8affba5b80 10 client.4543 fetch_fsmap learned FSMap version 7 2023-10-03T10:10:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8affba5b80 1 -- 172.21.15.146:0/3633839718 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55a80bd3cb00 con 0x55a80be14170 2023-10-03T10:10:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8ac5ffb700 1 -- 172.21.15.146:0/3633839718 <== mon.1 v2:172.21.15.146:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a80be0cf20 con 0x55a80be14170 2023-10-03T10:10:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8ac5ffb700 1 -- 172.21.15.146:0/3633839718 <== mon.1 v2:172.21.15.146:3301/0 5 ==== fsmap(e 7) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f8ad8011560 con 0x55a80be14170 2023-10-03T10:10:12.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8affba5b80 10 client.4543 fetch_fsmap finished waiting for FSMap version 7 2023-10-03T10:10:12.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8affba5b80 10 client.4543 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:10:12.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.680+0000 7f8affba5b80 20 client.4543 populate_metadata read hostname 'smithi146' 2023-10-03T10:10:12.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.681+0000 7f8affba5b80 4 client.4543 mds_command: new command op to 4181 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T10:10:12.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.681+0000 7f8affba5b80 1 -- 172.21.15.146:0/3633839718 --> v1:172.21.15.146:6817/4164614194 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a80bde2250 con 0x55a80be3a430 2023-10-03T10:10:12.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.681+0000 7f8ac5ffb700 10 client.4543 ms_handle_connect on v1:172.21.15.146:6817/4164614194 2023-10-03T10:10:12.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.681+0000 7f8ac5ffb700 1 -- 172.21.15.146:0/3633839718 <== mds.0 v1:172.21.15.146:6817/4164614194 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x55a80bde2250 con 0x55a80be3a430 2023-10-03T10:10:12.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.681+0000 7f8ac5ffb700 10 client.4543 handle_command_reply: tid=0 2023-10-03T10:10:12.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.681+0000 7f8affba5b80 1 client.4543 shutdown 2023-10-03T10:10:12.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.682+0000 7f8affba5b80 1 -- 172.21.15.146:0/3633839718 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be14170 msgr2=0x55a80be43cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.682+0000 7f8affba5b80 1 --2- 172.21.15.146:0/3633839718 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be14170 0x55a80be43cf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8ad8039b10 tx=0x7f8ad801a000).stop 2023-10-03T10:10:12.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.682+0000 7f8affba5b80 1 -- 172.21.15.146:0/3633839718 shutdown_connections 2023-10-03T10:10:12.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.682+0000 7f8affba5b80 1 --2- 172.21.15.146:0/3633839718 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be3e5b0 0x55a80be39980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.682+0000 7f8affba5b80 1 --2- 172.21.15.146:0/3633839718 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be14170 0x55a80be43cf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.682+0000 7f8affba5b80 1 --2- 172.21.15.146:0/3633839718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a80be14a40 0x55a80be441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.682+0000 7f8ac5ffb700 0 client.4543 ms_handle_reset on v1:172.21.15.146:6817/4164614194 2023-10-03T10:10:12.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.682+0000 7f8affba5b80 1 -- 172.21.15.146:0/3633839718 >> 172.21.15.146:0/3633839718 conn(0x55a80bc82940 msgr2=0x55a80be34c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:12.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.682+0000 7f8affba5b80 1 -- 172.21.15.146:0/3633839718 shutdown_connections 2023-10-03T10:10:12.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.682+0000 7f8affba5b80 1 -- 172.21.15.146:0/3633839718 wait complete. 2023-10-03T10:10:12.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.682+0000 7f8affba5b80 20 client.4543 trim_cache size 0 max 16384 2023-10-03T10:10:12.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.698+0000 7f8affba5b80 1 Processor -- start 2023-10-03T10:10:12.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.698+0000 7f8affba5b80 1 -- start start 2023-10-03T10:10:12.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.699+0000 7f8affba5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a80be14170 0x55a80be13980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.699+0000 7f8affba5b80 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be14a40 0x55a80be34b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.699+0000 7f8affba5b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be3e5b0 0x55a80be4ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.699+0000 7f8affba5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a80be18180 con 0x55a80be14170 2023-10-03T10:10:12.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.699+0000 7f8affba5b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a80be3bb00 con 0x55a80be3e5b0 2023-10-03T10:10:12.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.699+0000 7f8affba5b80 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a80be3bcd0 con 0x55a80be14a40 2023-10-03T10:10:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.699+0000 7f8ae6ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be14a40 0x55a80be34b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.699+0000 7f8ae77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a80be14170 0x55a80be13980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.699+0000 7f8ae6ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be14a40 0x55a80be34b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40398/0 (socket says 172.21.15.146:40398) 2023-10-03T10:10:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.699+0000 7f8ae6ffd700 1 -- 172.21.15.146:0/4084680104 learned_addr learned my addr 172.21.15.146:0/4084680104 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.699+0000 7f8ae7fff700 1 --2- 172.21.15.146:0/4084680104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be3e5b0 0x55a80be4ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.699+0000 7f8ae6ffd700 1 -- 172.21.15.146:0/4084680104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be3e5b0 msgr2=0x55a80be4ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.699+0000 7f8ae6ffd700 1 --2- 172.21.15.146:0/4084680104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be3e5b0 0x55a80be4ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.699+0000 7f8ae6ffd700 1 -- 172.21.15.146:0/4084680104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a80be14170 msgr2=0x55a80be13980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.699+0000 7f8ae6ffd700 1 --2- 172.21.15.146:0/4084680104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a80be14170 0x55a80be13980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.699+0000 7f8ae6ffd700 1 -- 172.21.15.146:0/4084680104 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a80be18880 con 0x55a80be14a40 2023-10-03T10:10:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.699+0000 7f8ae77fe700 1 --2- 172.21.15.146:0/4084680104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a80be14170 0x55a80be13980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.699+0000 7f8ae7fff700 1 --2- 172.21.15.146:0/4084680104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be3e5b0 0x55a80be4ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.699+0000 7f8ae6ffd700 1 --2- 172.21.15.146:0/4084680104 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be14a40 0x55a80be34b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8ad00011e0 tx=0x7f8ad0018000).ready entity=mon.2 client_cookie=d62184230c518740 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:12.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.699+0000 7f8add7fa700 1 -- 172.21.15.146:0/4084680104 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00220e0 con 0x55a80be14a40 2023-10-03T10:10:12.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.699+0000 7f8add7fa700 1 -- 172.21.15.146:0/4084680104 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad0011e30 con 0x55a80be14a40 2023-10-03T10:10:12.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.699+0000 7f8add7fa700 1 -- 172.21.15.146:0/4084680104 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0001ce0 con 0x55a80be14a40 2023-10-03T10:10:12.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.700+0000 7f8affba5b80 1 -- 172.21.15.146:0/4084680104 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be14a40 msgr2=0x55a80be34b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.700+0000 7f8affba5b80 1 --2- 172.21.15.146:0/4084680104 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be14a40 0x55a80be34b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8ad00011e0 tx=0x7f8ad0018000).stop 2023-10-03T10:10:12.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.700+0000 7f8affba5b80 1 -- 172.21.15.146:0/4084680104 shutdown_connections 2023-10-03T10:10:12.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.700+0000 7f8affba5b80 1 --2- 172.21.15.146:0/4084680104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be3e5b0 0x55a80be4ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.700+0000 7f8affba5b80 1 --2- 172.21.15.146:0/4084680104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a80be14170 0x55a80be13980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.700+0000 7f8affba5b80 1 --2- 172.21.15.146:0/4084680104 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be14a40 0x55a80be34b30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.700+0000 7f8affba5b80 1 -- 172.21.15.146:0/4084680104 >> 172.21.15.146:0/4084680104 conn(0x55a80bc82940 msgr2=0x55a80be171f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:12.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.700+0000 7f8affba5b80 1 -- 172.21.15.146:0/4084680104 shutdown_connections 2023-10-03T10:10:12.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.700+0000 7f8affba5b80 1 -- 172.21.15.146:0/4084680104 wait complete. 2023-10-03T10:10:12.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.700+0000 7f8affba5b80 1 -- start start 2023-10-03T10:10:12.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.700+0000 7f8affba5b80 1 Processor -- start 2023-10-03T10:10:12.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.701+0000 7f8affba5b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be14170 0x55a80be795e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.701+0000 7f8affba5b80 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be14a40 0x55a80be79ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.701+0000 7f8affba5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a80be3e5b0 0x55a80be79fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:12.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.701+0000 7f8affba5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a80be7d250 con 0x55a80be3e5b0 2023-10-03T10:10:12.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.701+0000 7f8affba5b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a80be7c9e0 con 0x55a80be14170 2023-10-03T10:10:12.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.701+0000 7f8affba5b80 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a80be3d430 con 0x55a80be14a40 2023-10-03T10:10:12.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.701+0000 7f8affba5b80 10 client.0 ll_register_callbacks cb 0x55a80bd0ace0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:10:12.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.701+0000 7f8ae77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be14170 0x55a80be795e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.701+0000 7f8ae77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be14170 0x55a80be795e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43106/0 (socket says 172.21.15.146:43106) 2023-10-03T10:10:12.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.701+0000 7f8ae77fe700 1 -- 172.21.15.146:0/2199325069 learned_addr learned my addr 172.21.15.146:0/2199325069 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:10:12.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.701+0000 7f8ae7fff700 1 --2- 172.21.15.146:0/2199325069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a80be3e5b0 0x55a80be79fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.701+0000 7f8ae6ffd700 1 --2- 172.21.15.146:0/2199325069 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be14a40 0x55a80be79ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:12.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.701+0000 7f8ae77fe700 1 -- 172.21.15.146:0/2199325069 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be14a40 msgr2=0x55a80be79ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:12.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.701+0000 7f8ae77fe700 1 --2- 172.21.15.146:0/2199325069 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be14a40 0x55a80be79ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.701+0000 7f8ae77fe700 1 -- 172.21.15.146:0/2199325069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a80be3e5b0 msgr2=0x55a80be79fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:12.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.701+0000 7f8ae77fe700 1 --2- 172.21.15.146:0/2199325069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a80be3e5b0 0x55a80be79fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.701+0000 7f8ae77fe700 1 -- 172.21.15.146:0/2199325069 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae8093150 con 0x55a80be14170 2023-10-03T10:10:12.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.701+0000 7f8ae77fe700 1 --2- 172.21.15.146:0/2199325069 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be14170 0x55a80be795e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f8ad800e930 tx=0x7f8ad802a000).ready entity=mon.1 client_cookie=d915e0e7f26d2a3a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:12.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.701+0000 7f8ac5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.146:3301/0 2023-10-03T10:10:12.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.701+0000 7f8ac5ffb700 1 -- 172.21.15.146:0/2199325069 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8039f60 con 0x55a80be14170 2023-10-03T10:10:12.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.701+0000 7f8ac5ffb700 1 -- 172.21.15.146:0/2199325069 <== mon.1 v2:172.21.15.146:3301/0 2 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f8ad8019310 con 0x55a80be14170 2023-10-03T10:10:12.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.701+0000 7f8affba5b80 1 -- 172.21.15.146:0/2199325069 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8ad0011cc0 con 0x55a80be14170 2023-10-03T10:10:12.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.702+0000 7f8ac5ffb700 1 -- 172.21.15.146:0/2199325069 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ad800e040 con 0x55a80be14170 2023-10-03T10:10:12.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.702+0000 7f8affba5b80 10 client.4549 fetch_fsmap learned FSMap version 7 2023-10-03T10:10:12.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.702+0000 7f8affba5b80 1 -- 172.21.15.146:0/2199325069 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55a80bc05710 con 0x55a80be14170 2023-10-03T10:10:12.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.702+0000 7f8ac5ffb700 1 -- 172.21.15.146:0/2199325069 <== mon.1 v2:172.21.15.146:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad0011cc0 con 0x55a80be14170 2023-10-03T10:10:12.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.702+0000 7f8ac5ffb700 1 -- 172.21.15.146:0/2199325069 <== mon.1 v2:172.21.15.146:3301/0 5 ==== fsmap(e 7) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f8ad803bc80 con 0x55a80be14170 2023-10-03T10:10:12.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.702+0000 7f8affba5b80 10 client.4549 fetch_fsmap finished waiting for FSMap version 7 2023-10-03T10:10:12.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.702+0000 7f8affba5b80 10 client.4549 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:10:12.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.702+0000 7f8affba5b80 20 client.4549 populate_metadata read hostname 'smithi146' 2023-10-03T10:10:12.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.702+0000 7f8affba5b80 4 client.4549 mds_command: new command op to 4181 tid=0[{"prefix": "status"}] 2023-10-03T10:10:12.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.702+0000 7f8affba5b80 1 -- 172.21.15.146:0/2199325069 --> v1:172.21.15.146:6817/4164614194 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a80bbd2ef0 con 0x55a80be993f0 2023-10-03T10:10:12.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.702+0000 7f8ac5ffb700 10 client.4549 ms_handle_connect on v1:172.21.15.146:6817/4164614194 2023-10-03T10:10:12.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.702+0000 7f8ac5ffb700 1 -- 172.21.15.146:0/2199325069 <== mds.0 v1:172.21.15.146:6817/4164614194 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (unknown 0 0 786384490) 0x55a80bbd2ef0 con 0x55a80be993f0 2023-10-03T10:10:12.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.702+0000 7f8ac5ffb700 10 client.4549 handle_command_reply: tid=0 2023-10-03T10:10:12.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.702+0000 7f8affba5b80 1 client.4549 shutdown 2023-10-03T10:10:12.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.702+0000 7f8affba5b80 1 -- 172.21.15.146:0/2199325069 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be14170 msgr2=0x55a80be795e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.702+0000 7f8affba5b80 1 --2- 172.21.15.146:0/2199325069 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be14170 0x55a80be795e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f8ad800e930 tx=0x7f8ad802a000).stop 2023-10-03T10:10:12.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.702+0000 7f8affba5b80 1 -- 172.21.15.146:0/2199325069 shutdown_connections 2023-10-03T10:10:12.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.702+0000 7f8affba5b80 1 --2- 172.21.15.146:0/2199325069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a80be3e5b0 0x55a80be79fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.702+0000 7f8affba5b80 1 --2- 172.21.15.146:0/2199325069 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55a80be14170 0x55a80be795e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.702+0000 7f8ac5ffb700 0 client.4549 ms_handle_reset on v1:172.21.15.146:6817/4164614194 2023-10-03T10:10:12.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.702+0000 7f8affba5b80 1 --2- 172.21.15.146:0/2199325069 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x55a80be14a40 0x55a80be79ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.702+0000 7f8affba5b80 1 -- 172.21.15.146:0/2199325069 >> 172.21.15.146:0/2199325069 conn(0x55a80bc82940 msgr2=0x55a80be13980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:12.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.703+0000 7f8affba5b80 1 -- 172.21.15.146:0/2199325069 shutdown_connections 2023-10-03T10:10:12.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.703+0000 7f8affba5b80 1 -- 172.21.15.146:0/2199325069 wait complete. 2023-10-03T10:10:12.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.703+0000 7f8affba5b80 20 client.4549 trim_cache size 0 max 16384 2023-10-03T10:10:12.711 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-03T10:10:12.711 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "5440411f-9bdd-4ef1-85ef-960d00aa215c", 2023-10-03T10:10:12.711 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2023-10-03T10:10:12.711 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 4181, 2023-10-03T10:10:12.711 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2023-10-03T10:10:12.711 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2023-10-03T10:10:12.711 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2023-10-03T10:10:12.711 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 23.978172110999999, 2023-10-03T10:10:12.711 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 7, 2023-10-03T10:10:12.711 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 17, 2023-10-03T10:10:12.711 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 17, 2023-10-03T10:10:12.712 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 28.271526416 2023-10-03T10:10:12.712 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-03T10:10:12.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.703+0000 7f8aee1f2700 1 -- 172.21.15.146:0/3908019584 >> v1:172.21.15.146:6816/118159 conn(0x7f8ac802bb60 legacy=0x7f8ac802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.703+0000 7f8aee1f2700 1 -- 172.21.15.146:0/3908019584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ae8093950 msgr2=0x7f8ae8062b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:12.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.703+0000 7f8aee1f2700 1 --2- 172.21.15.146:0/3908019584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ae8093950 0x7f8ae8062b90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8ad800e960 tx=0x7f8ad8009060).stop 2023-10-03T10:10:12.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.703+0000 7f8aee1f2700 1 -- 172.21.15.146:0/3908019584 shutdown_connections 2023-10-03T10:10:12.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.703+0000 7f8aee1f2700 1 --2- 172.21.15.146:0/3908019584 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8ae812d250 0x7f8ae8119310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.703+0000 7f8aee1f2700 1 --2- 172.21.15.146:0/3908019584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ae8093950 0x7f8ae8062b90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.703+0000 7f8aee1f2700 1 --2- 172.21.15.146:0/3908019584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ae8095c50 0x7f8ae8118e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:12.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.703+0000 7f8aee1f2700 1 -- 172.21.15.146:0/3908019584 >> 172.21.15.146:0/3908019584 conn(0x7f8ae809aa50 msgr2=0x7f8ae80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:12.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.703+0000 7f8aee1f2700 1 -- 172.21.15.146:0/3908019584 shutdown_connections 2023-10-03T10:10:12.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:10:12.703+0000 7f8aee1f2700 1 -- 172.21.15.146:0/3908019584 wait complete. 2023-10-03T10:10:12.715 INFO:teuthology.run_tasks:Running task print... 2023-10-03T10:10:12.725 INFO:teuthology.task.print:**** done mds pre-upgrade sequence 2023-10-03T10:10:12.725 INFO:teuthology.run_tasks:Running task install.upgrade... 2023-10-03T10:10:12.743 INFO:teuthology.task.install:project ceph config {'mon.a': {'branch': 'reef'}} overrides {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'} 2023-10-03T10:10:12.743 INFO:teuthology.task.install:config contains sha1|tag|branch, removing those keys from override 2023-10-03T10:10:12.743 INFO:teuthology.task.install:remote ubuntu@smithi146.front.sepia.ceph.com config {'branch': 'reef', 'flavor': 'default'} 2023-10-03T10:10:12.744 INFO:teuthology.task.install:extra packages: [] 2023-10-03T10:10:12.749 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-03T10:10:12.749 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2023-10-03T10:10:12.749 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2023-10-03T10:10:12.772 INFO:teuthology.orchestra.run.smithi146.stdout:16.2.14-44.geeb13ac9.el8 2023-10-03T10:10:12.773 INFO:teuthology.packaging:The installed version of ceph-common is 16.2.14-44.geeb13ac9.el8 2023-10-03T10:10:12.773 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-10-03T10:10:13.168 INFO:teuthology.task.install:Ceph rpm upgrade from 16.2.14-44.geeb13ac9.el8 to 18.2.0-507.g7cd99ce4 2023-10-03T10:10:13.169 INFO:teuthology.task.install.rpm:Host smithi146 is: centos 8 x86_64 2023-10-03T10:10:13.169 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-10-03T10:10:13.524 INFO:teuthology.task.install.rpm:Repo base URL: https://2.chacra.ceph.com/r/ceph/reef/7cd99ce428fa36b28345615983ecfd3d24e90eba/centos/8/flavors/default/ 2023-10-03T10:10:13.524 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-10-03T10:10:13.791 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/7cd99ce428fa36b28345615983ecfd3d24e90eba/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/7cd99ce428fa36b28345615983ecfd3d24e90eba/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/7cd99ce428fa36b28345615983ecfd3d24e90eba/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-03T10:10:13.791 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-03T10:10:13.791 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-03T10:10:13.824 DEBUG:teuthology.orchestra.run.smithi146:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-03T10:10:13.897 DEBUG:teuthology.orchestra.run.smithi146:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-03T10:10:13.968 DEBUG:teuthology.orchestra.run.smithi146:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-03T10:10:14.027 INFO:teuthology.orchestra.run.smithi146.stdout:check_obsoletes = 1 2023-10-03T10:10:14.039 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum clean all 2023-10-03T10:10:14.312 INFO:teuthology.orchestra.run.smithi146.stdout:71 files removed 2023-10-03T10:10:14.341 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2023-10-03T10:10:15.134 INFO:teuthology.orchestra.run.smithi146.stdout:ceph packages for x86_64 215 kB/s | 80 kB 00:00 2023-10-03T10:10:15.435 INFO:teuthology.orchestra.run.smithi146.stdout:ceph noarch packages 36 kB/s | 9.4 kB 00:00 2023-10-03T10:10:15.827 INFO:teuthology.orchestra.run.smithi146.stdout:ceph source packages 4.1 kB/s | 1.5 kB 00:00 2023-10-03T10:10:16.661 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - AppStream 41 MB/s | 33 MB 00:00 2023-10-03T10:10:24.836 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - BaseOS 23 MB/s | 48 MB 00:02 2023-10-03T10:10:31.953 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - Extras 92 kB/s | 18 kB 00:00 2023-10-03T10:10:32.304 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - Extras common packages 40 kB/s | 6.9 kB 00:00 2023-10-03T10:10:33.047 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - PowerTools 11 MB/s | 6.5 MB 00:00 2023-10-03T10:10:34.449 INFO:teuthology.orchestra.run.smithi146.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-03T10:10:35.533 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-10-03T10:10:39.466 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 394 kB/s | 24 kB 00:00 2023-10-03T10:10:43.697 INFO:teuthology.orchestra.run.smithi146.stderr:Package cephadm available, but not installed. 2023-10-03T10:10:43.697 INFO:teuthology.orchestra.run.smithi146.stdout:No match for argument: cephadm 2023-10-03T10:10:43.698 INFO:teuthology.orchestra.run.smithi146.stderr:Package ceph-immutable-object-cache available, but not installed. 2023-10-03T10:10:43.698 INFO:teuthology.orchestra.run.smithi146.stdout:No match for argument: ceph-immutable-object-cache 2023-10-03T10:10:43.711 INFO:teuthology.orchestra.run.smithi146.stderr:Package ceph-mgr-cephadm available, but not installed. 2023-10-03T10:10:43.711 INFO:teuthology.orchestra.run.smithi146.stdout:No match for argument: ceph-mgr-cephadm 2023-10-03T10:10:43.714 INFO:teuthology.orchestra.run.smithi146.stderr:Package ceph-volume available, but not installed. 2023-10-03T10:10:43.714 INFO:teuthology.orchestra.run.smithi146.stdout:No match for argument: ceph-volume 2023-10-03T10:10:43.989 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2023-10-03T10:10:43.994 INFO:teuthology.orchestra.run.smithi146.stdout:====================================================================================== 2023-10-03T10:10:43.994 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2023-10-03T10:10:43.994 INFO:teuthology.orchestra.run.smithi146.stdout:====================================================================================== 2023-10-03T10:10:43.995 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrading: 2023-10-03T10:10:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: ceph x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 6.4 k 2023-10-03T10:10:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 5.4 M 2023-10-03T10:10:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 22 M 2023-10-03T10:10:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 847 k 2023-10-03T10:10:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 23 k 2023-10-03T10:10:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 2.3 M 2023-10-03T10:10:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 1.5 M 2023-10-03T10:10:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 1.7 M 2023-10-03T10:10:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 7.4 M 2023-10-03T10:10:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 241 k 2023-10-03T10:10:43.995 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 47 k 2023-10-03T10:10:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 4.6 M 2023-10-03T10:10:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 18 M 2023-10-03T10:10:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 15 k 2023-10-03T10:10:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 13 M 2023-10-03T10:10:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 24 k 2023-10-03T10:10:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 47 M 2023-10-03T10:10:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 30 k 2023-10-03T10:10:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 769 k 2023-10-03T10:10:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 137 k 2023-10-03T10:10:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 139 k 2023-10-03T10:10:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: librados2 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 3.7 M 2023-10-03T10:10:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 474 k 2023-10-03T10:10:43.996 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 3.6 M 2023-10-03T10:10:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 6.5 M 2023-10-03T10:10:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 45 k 2023-10-03T10:10:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 123 k 2023-10-03T10:10:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 190 k 2023-10-03T10:10:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 370 k 2023-10-03T10:10:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 364 k 2023-10-03T10:10:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 107 k 2023-10-03T10:10:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 94 k 2023-10-03T10:10:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 3.4 M 2023-10-03T10:10:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 179 k 2023-10-03T10:10:43.997 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2023-10-03T10:10:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-03T10:10:43.997 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:10:43.998 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2023-10-03T10:10:43.998 INFO:teuthology.orchestra.run.smithi146.stdout:====================================================================================== 2023-10-03T10:10:43.998 INFO:teuthology.orchestra.run.smithi146.stdout:Install 1 Package 2023-10-03T10:10:43.998 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrade 34 Packages 2023-10-03T10:10:43.998 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:10:43.998 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 145 M 2023-10-03T10:10:43.998 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2023-10-03T10:10:44.359 INFO:teuthology.orchestra.run.smithi146.stdout:(1/35): ceph-18.2.0-507.g7cd99ce4.el8.x86_64.rp 31 kB/s | 6.4 kB 00:00 2023-10-03T10:10:44.551 INFO:teuthology.orchestra.run.smithi146.stdout:(2/35): thrift-0.13.0-2.el8.x86_64.rpm 4.3 MB/s | 1.7 MB 00:00 2023-10-03T10:10:44.735 INFO:teuthology.orchestra.run.smithi146.stdout:(3/35): ceph-base-18.2.0-507.g7cd99ce4.el8.x86_ 9.2 MB/s | 5.4 MB 00:00 2023-10-03T10:10:44.910 INFO:teuthology.orchestra.run.smithi146.stdout:(4/35): ceph-fuse-18.2.0-507.g7cd99ce4.el8.x86_ 2.3 MB/s | 847 kB 00:00 2023-10-03T10:10:45.548 INFO:teuthology.orchestra.run.smithi146.stdout:(5/35): ceph-mds-18.2.0-507.g7cd99ce4.el8.x86_6 11 MB/s | 2.3 MB 00:00 2023-10-03T10:10:45.549 INFO:teuthology.orchestra.run.smithi146.stdout:(6/35): ceph-mgr-18.2.0-507.g7cd99ce4.el8.x86_6 5.2 MB/s | 1.5 MB 00:00 2023-10-03T10:10:45.549 INFO:teuthology.orchestra.run.smithi146.stdout:(7/35): ceph-mon-18.2.0-507.g7cd99ce4.el8.x86_6 11 MB/s | 4.6 MB 00:00 2023-10-03T10:10:46.795 INFO:teuthology.orchestra.run.smithi146.stdout:(8/35): ceph-radosgw-18.2.0-507.g7cd99ce4.el8.x 9.1 MB/s | 13 MB 00:01 2023-10-03T10:10:47.020 INFO:teuthology.orchestra.run.smithi146.stdout:(9/35): ceph-common-18.2.0-507.g7cd99ce4.el8.x8 8.1 MB/s | 22 MB 00:02 2023-10-03T10:10:47.045 INFO:teuthology.orchestra.run.smithi146.stdout:(10/35): ceph-selinux-18.2.0-507.g7cd99ce4.el8. 97 kB/s | 24 kB 00:00 2023-10-03T10:10:47.104 INFO:teuthology.orchestra.run.smithi146.stdout:(11/35): libcephfs-devel-18.2.0-507.g7cd99ce4.e 522 kB/s | 30 kB 00:00 2023-10-03T10:10:47.246 INFO:teuthology.orchestra.run.smithi146.stdout:(12/35): libcephfs2-18.2.0-507.g7cd99ce4.el8.x8 5.3 MB/s | 769 kB 00:00 2023-10-03T10:10:47.321 INFO:teuthology.orchestra.run.smithi146.stdout:(13/35): libcephsqlite-18.2.0-507.g7cd99ce4.el8 1.8 MB/s | 137 kB 00:00 2023-10-03T10:10:47.380 INFO:teuthology.orchestra.run.smithi146.stdout:(14/35): librados-devel-18.2.0-507.g7cd99ce4.el 2.3 MB/s | 139 kB 00:00 2023-10-03T10:10:47.888 INFO:teuthology.orchestra.run.smithi146.stdout:(15/35): librados2-18.2.0-507.g7cd99ce4.el8.x86 7.2 MB/s | 3.7 MB 00:00 2023-10-03T10:10:47.988 INFO:teuthology.orchestra.run.smithi146.stdout:(16/35): libradosstriper1-18.2.0-507.g7cd99ce4. 4.6 MB/s | 474 kB 00:00 2023-10-03T10:10:48.489 INFO:teuthology.orchestra.run.smithi146.stdout:(17/35): librbd1-18.2.0-507.g7cd99ce4.el8.x86_6 7.1 MB/s | 3.6 MB 00:00 2023-10-03T10:10:49.465 INFO:teuthology.orchestra.run.smithi146.stdout:(18/35): ceph-osd-18.2.0-507.g7cd99ce4.el8.x86_ 4.2 MB/s | 18 MB 00:04 2023-10-03T10:10:49.573 INFO:teuthology.orchestra.run.smithi146.stdout:(19/35): librgw2-18.2.0-507.g7cd99ce4.el8.x86_6 6.0 MB/s | 6.5 MB 00:01 2023-10-03T10:10:49.598 INFO:teuthology.orchestra.run.smithi146.stdout:(20/35): python3-ceph-argparse-18.2.0-507.g7cd9 334 kB/s | 45 kB 00:00 2023-10-03T10:10:49.657 INFO:teuthology.orchestra.run.smithi146.stdout:(21/35): python3-ceph-common-18.2.0-507.g7cd99c 1.4 MB/s | 123 kB 00:00 2023-10-03T10:10:49.682 INFO:teuthology.orchestra.run.smithi146.stdout:(22/35): python3-cephfs-18.2.0-507.g7cd99ce4.el 2.2 MB/s | 190 kB 00:00 2023-10-03T10:10:49.832 INFO:teuthology.orchestra.run.smithi146.stdout:(23/35): python3-rados-18.2.0-507.g7cd99ce4.el8 2.1 MB/s | 370 kB 00:00 2023-10-03T10:10:50.604 INFO:teuthology.orchestra.run.smithi146.stdout:(24/35): python3-rbd-18.2.0-507.g7cd99ce4.el8.x 2.0 MB/s | 364 kB 00:00 2023-10-03T10:10:50.604 INFO:teuthology.orchestra.run.smithi146.stdout:(25/35): python3-rgw-18.2.0-507.g7cd99ce4.el8.x 1.2 MB/s | 107 kB 00:00 2023-10-03T10:10:50.604 INFO:teuthology.orchestra.run.smithi146.stdout:(26/35): rbd-fuse-18.2.0-507.g7cd99ce4.el8.x86_ 720 kB/s | 94 kB 00:00 2023-10-03T10:10:50.604 INFO:teuthology.orchestra.run.smithi146.stdout:(27/35): rbd-nbd-18.2.0-507.g7cd99ce4.el8.x86_6 1.6 MB/s | 179 kB 00:00 2023-10-03T10:10:50.604 INFO:teuthology.orchestra.run.smithi146.stdout:(28/35): ceph-grafana-dashboards-18.2.0-507.g7c 230 kB/s | 23 kB 00:00 2023-10-03T10:10:50.751 INFO:teuthology.orchestra.run.smithi146.stdout:(29/35): ceph-mgr-dashboard-18.2.0-507.g7cd99ce 3.2 MB/s | 1.7 MB 00:00 2023-10-03T10:10:50.884 INFO:teuthology.orchestra.run.smithi146.stdout:(30/35): rbd-mirror-18.2.0-507.g7cd99ce4.el8.x8 3.6 MB/s | 3.4 MB 00:00 2023-10-03T10:10:51.219 INFO:teuthology.orchestra.run.smithi146.stdout:(31/35): ceph-mgr-modules-core-18.2.0-507.g7cd9 2.4 MB/s | 241 kB 00:00 2023-10-03T10:10:51.219 INFO:teuthology.orchestra.run.smithi146.stdout:(32/35): ceph-mgr-rook-18.2.0-507.g7cd99ce4.el8 517 kB/s | 47 kB 00:00 2023-10-03T10:10:51.219 INFO:teuthology.orchestra.run.smithi146.stdout:(33/35): ceph-prometheus-alerts-18.2.0-507.g7cd 158 kB/s | 15 kB 00:00 2023-10-03T10:10:51.886 INFO:teuthology.orchestra.run.smithi146.stdout:(34/35): ceph-test-18.2.0-507.g7cd99ce4.el8.x86 9.6 MB/s | 47 MB 00:04 2023-10-03T10:10:52.453 INFO:teuthology.orchestra.run.smithi146.stdout:(35/35): ceph-mgr-diskprediction-local-18.2.0-5 4.3 MB/s | 7.4 MB 00:01 2023-10-03T10:10:53.056 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2023-10-03T10:10:53.056 INFO:teuthology.orchestra.run.smithi146.stdout:Total 17 MB/s | 145 MB 00:08 2023-10-03T10:10:53.056 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2023-10-03T10:10:53.056 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2023-10-03T10:10:53.056 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2023-10-03T10:10:53.201 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2023-10-03T10:10:53.204 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2023-10-03T10:10:55.466 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2023-10-03T10:10:55.654 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-10-03T10:10:56.173 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/69 2023-10-03T10:10:56.391 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librados2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2/69 2023-10-03T10:10:56.819 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2/69 2023-10-03T10:10:57.041 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librbd1-2:18.2.0-507.g7cd99ce4.el8.x86_64 3/69 2023-10-03T10:10:57.173 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:18.2.0-507.g7cd99ce4.el8.x86_64 3/69 2023-10-03T10:10:57.399 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : libcephfs2-2:18.2.0-507.g7cd99ce4.el8.x86_64 4/69 2023-10-03T10:10:58.184 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephfs2-2:18.2.0-507.g7cd99ce4.el8.x86_64 4/69 2023-10-03T10:10:58.474 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librgw2-2:18.2.0-507.g7cd99ce4.el8.x86_64 5/69 2023-10-03T10:10:58.582 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librgw2-2:18.2.0-507.g7cd99ce4.el8.x86_64 5/69 2023-10-03T10:10:58.837 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : python3-rados-2:18.2.0-507.g7cd99ce4.el8.x86_64 6/69 2023-10-03T10:10:59.082 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : libcephsqlite-2:18.2.0-507.g7cd99ce4.el8.x86_64 7/69 2023-10-03T10:10:59.190 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephsqlite-2:18.2.0-507.g7cd99ce4.el8.x86_64 7/69 2023-10-03T10:10:59.391 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : libradosstriper1-2:18.2.0-507.g7cd99ce4.el8.x86_64 8/69 2023-10-03T10:10:59.463 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libradosstriper1-2:18.2.0-507.g7cd99ce4.el8.x86_64 8/69 2023-10-03T10:10:59.644 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : python3-ceph-argparse-2:18.2.0-507.g7cd99ce4.el8.x 9/69 2023-10-03T10:10:59.861 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : python3-cephfs-2:18.2.0-507.g7cd99ce4.el8.x86_64 10/69 2023-10-03T10:11:00.120 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : python3-rbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 11/69 2023-10-03T10:11:00.348 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : python3-rgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 12/69 2023-10-03T10:11:00.568 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librados-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 13/69 2023-10-03T10:11:00.670 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : ceph-prometheus-alerts-2:18.2.0-507.g7cd99ce4.el8. 14/69 2023-10-03T10:11:00.892 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : ceph-grafana-dashboards-2:18.2.0-507.g7cd99ce4.el8 15/69 2023-10-03T10:11:01.107 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : python3-ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86 16/69 2023-10-03T10:11:03.387 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 17/69 2023-10-03T10:11:03.891 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 17/69 2023-10-03T10:11:04.545 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 17/69 2023-10-03T10:11:04.825 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : ceph-base-2:18.2.0-507.g7cd99ce4.el8.x86_64 18/69 2023-10-03T10:11:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-base-2:18.2.0-507.g7cd99ce4.el8.x86_64 18/69 2023-10-03T10:11:05.048 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : ceph-selinux-2:18.2.0-507.g7cd99ce4.el8.x86_64 19/69 2023-10-03T10:11:22.167 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-selinux-2:18.2.0-507.g7cd99ce4.el8.x86_64 19/69 2023-10-03T10:11:22.422 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : ceph-mgr-dashboard-2:18.2.0-507.g7cd99ce4.el8.noar 20/69 2023-10-03T10:11:23.604 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-507.g7cd99ce4.el8.noar 20/69 2023-10-03T10:11:23.828 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : ceph-mgr-diskprediction-local-2:18.2.0-507.g7cd99c 21/69 2023-10-03T10:11:23.929 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-507.g7cd99c 21/69 2023-10-03T10:11:24.321 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : ceph-mgr-modules-core-2:18.2.0-507.g7cd99ce4.el8.n 22/69 2023-10-03T10:11:24.589 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : ceph-mgr-2:18.2.0-507.g7cd99ce4.el8.x86_64 23/69 2023-10-03T10:11:24.612 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-2:18.2.0-507.g7cd99ce4.el8.x86_64 23/69 2023-10-03T10:11:24.761 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : ceph-mgr-rook-2:18.2.0-507.g7cd99ce4.el8.noarch 24/69 2023-10-03T10:11:24.967 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-507.g7cd99ce4.el8.noarch 24/69 2023-10-03T10:11:25.212 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : ceph-mds-2:18.2.0-507.g7cd99ce4.el8.x86_64 25/69 2023-10-03T10:11:25.734 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mds-2:18.2.0-507.g7cd99ce4.el8.x86_64 25/69 2023-10-03T10:11:26.020 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : ceph-mon-2:18.2.0-507.g7cd99ce4.el8.x86_64 26/69 2023-10-03T10:11:27.827 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mon-2:18.2.0-507.g7cd99ce4.el8.x86_64 26/69 2023-10-03T10:11:28.063 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : ceph-osd-2:18.2.0-507.g7cd99ce4.el8.x86_64 27/69 2023-10-03T10:11:28.075 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-osd-2:18.2.0-507.g7cd99ce4.el8.x86_64 27/69 2023-10-03T10:11:29.530 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : ceph-2:18.2.0-507.g7cd99ce4.el8.x86_64 28/69 2023-10-03T10:11:29.813 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : ceph-radosgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 29/69 2023-10-03T10:11:30.238 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 29/69 2023-10-03T10:11:30.494 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : rbd-mirror-2:18.2.0-507.g7cd99ce4.el8.x86_64 30/69 2023-10-03T10:11:35.688 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: rbd-mirror-2:18.2.0-507.g7cd99ce4.el8.x86_64 30/69 2023-10-03T10:11:35.973 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : ceph-test-2:18.2.0-507.g7cd99ce4.el8.x86_64 31/69 2023-10-03T10:11:36.135 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : libcephfs-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 32/69 2023-10-03T10:11:36.378 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : rbd-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 33/69 2023-10-03T10:11:36.659 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : rbd-nbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 34/69 2023-10-03T10:11:36.886 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : ceph-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 35/69 2023-10-03T10:11:36.986 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 36/69 2023-10-03T10:11:37.261 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 37/69 2023-10-03T10:11:37.270 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-10-03T10:11:37.270 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-10-03T10:11:37.538 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-10-03T10:11:37.677 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 39/69 2023-10-03T10:11:37.677 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 40/69 2023-10-03T10:11:37.836 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 40/69 2023-10-03T10:11:37.843 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-10-03T10:11:37.844 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-10-03T10:11:38.076 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-10-03T10:11:38.262 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.n 42/69 2023-10-03T10:11:38.469 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 43/69 2023-10-03T10:11:38.476 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-10-03T10:11:38.477 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-10-03T10:11:38.644 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-10-03T10:11:38.802 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 45/69 2023-10-03T10:11:38.802 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 46/69 2023-10-03T10:11:39.028 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 46/69 2023-10-03T10:11:39.194 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 47/69 2023-10-03T10:11:39.202 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-10-03T10:11:39.203 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-10-03T10:11:39.575 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-10-03T10:11:39.575 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 49/69 2023-10-03T10:11:39.804 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 49/69 2023-10-03T10:11:39.810 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-10-03T10:11:39.810 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-10-03T10:11:39.969 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-10-03T10:11:39.975 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-03T10:11:39.975 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-03T10:11:40.160 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-03T10:11:40.160 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 52/69 2023-10-03T10:11:40.302 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 52/69 2023-10-03T10:11:40.326 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-03T10:11:40.327 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-03T10:11:40.673 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-03T10:11:40.674 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 54/69 2023-10-03T10:11:40.877 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 54/69 2023-10-03T10:11:40.877 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-10-03T10:11:41.135 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-10-03T10:11:41.301 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 56/69 2023-10-03T10:11:41.510 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 57/69 2023-10-03T10:11:41.510 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 58/69 2023-10-03T10:11:41.761 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 58/69 2023-10-03T10:11:41.960 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 59/69 2023-10-03T10:11:41.960 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 60/69 2023-10-03T10:11:42.177 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 60/69 2023-10-03T10:11:42.385 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 61/69 2023-10-03T10:11:42.385 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 62/69 2023-10-03T10:11:42.611 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 62/69 2023-10-03T10:11:42.793 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 63/69 2023-10-03T10:11:42.905 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x 64/69 2023-10-03T10:11:43.135 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86 65/69 2023-10-03T10:11:43.284 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8 66/69 2023-10-03T10:11:43.387 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8. 67/69 2023-10-03T10:11:43.387 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 68/69 2023-10-03T10:11:43.553 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 68/69 2023-10-03T10:11:43.553 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 69/69 2023-10-03T10:11:44.348 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 69/69 2023-10-03T10:11:44.348 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 1/69 2023-10-03T10:11:44.348 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-2:18.2.0-507.g7cd99ce4.el8.x86_64 2/69 2023-10-03T10:11:44.348 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 3/69 2023-10-03T10:11:44.348 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-base-2:18.2.0-507.g7cd99ce4.el8.x86_64 4/69 2023-10-03T10:11:44.348 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 5/69 2023-10-03T10:11:44.348 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 6/69 2023-10-03T10:11:44.349 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 7/69 2023-10-03T10:11:44.349 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 8/69 2023-10-03T10:11:44.349 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 9/69 2023-10-03T10:11:44.349 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mds-2:18.2.0-507.g7cd99ce4.el8.x86_64 10/69 2023-10-03T10:11:44.349 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 11/69 2023-10-03T10:11:44.349 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-2:18.2.0-507.g7cd99ce4.el8.x86_64 12/69 2023-10-03T10:11:44.349 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 13/69 2023-10-03T10:11:44.349 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mon-2:18.2.0-507.g7cd99ce4.el8.x86_64 14/69 2023-10-03T10:11:44.349 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 15/69 2023-10-03T10:11:44.349 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-osd-2:18.2.0-507.g7cd99ce4.el8.x86_64 16/69 2023-10-03T10:11:44.349 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 17/69 2023-10-03T10:11:44.349 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-radosgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 18/69 2023-10-03T10:11:44.349 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 19/69 2023-10-03T10:11:44.349 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-selinux-2:18.2.0-507.g7cd99ce4.el8.x86_64 20/69 2023-10-03T10:11:44.350 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 21/69 2023-10-03T10:11:44.350 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-test-2:18.2.0-507.g7cd99ce4.el8.x86_64 22/69 2023-10-03T10:11:44.350 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 23/69 2023-10-03T10:11:44.350 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 24/69 2023-10-03T10:11:44.350 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 25/69 2023-10-03T10:11:44.350 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs2-2:18.2.0-507.g7cd99ce4.el8.x86_64 26/69 2023-10-03T10:11:44.350 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 27/69 2023-10-03T10:11:44.350 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephsqlite-2:18.2.0-507.g7cd99ce4.el8.x86_64 28/69 2023-10-03T10:11:44.353 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 29/69 2023-10-03T10:11:44.353 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 30/69 2023-10-03T10:11:44.353 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 31/69 2023-10-03T10:11:44.354 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:18.2.0-507.g7cd99ce4.el8.x86_64 32/69 2023-10-03T10:11:44.354 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 33/69 2023-10-03T10:11:44.354 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libradosstriper1-2:18.2.0-507.g7cd99ce4.el8.x86_64 34/69 2023-10-03T10:11:44.354 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 35/69 2023-10-03T10:11:44.354 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:18.2.0-507.g7cd99ce4.el8.x86_64 36/69 2023-10-03T10:11:44.354 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 37/69 2023-10-03T10:11:44.354 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librgw2-2:18.2.0-507.g7cd99ce4.el8.x86_64 38/69 2023-10-03T10:11:44.354 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 39/69 2023-10-03T10:11:44.354 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-argparse-2:18.2.0-507.g7cd99ce4.el8.x 40/69 2023-10-03T10:11:44.354 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x 41/69 2023-10-03T10:11:44.354 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86 42/69 2023-10-03T10:11:44.354 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86 43/69 2023-10-03T10:11:44.354 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cephfs-2:18.2.0-507.g7cd99ce4.el8.x86_64 44/69 2023-10-03T10:11:44.355 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 45/69 2023-10-03T10:11:44.355 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rados-2:18.2.0-507.g7cd99ce4.el8.x86_64 46/69 2023-10-03T10:11:44.355 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 47/69 2023-10-03T10:11:44.355 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 48/69 2023-10-03T10:11:44.355 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 49/69 2023-10-03T10:11:44.355 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 50/69 2023-10-03T10:11:44.355 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-03T10:11:44.355 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 52/69 2023-10-03T10:11:44.355 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-03T10:11:44.355 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-mirror-2:18.2.0-507.g7cd99ce4.el8.x86_64 54/69 2023-10-03T10:11:44.355 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-10-03T10:11:44.355 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-nbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 56/69 2023-10-03T10:11:44.355 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 57/69 2023-10-03T10:11:44.355 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-507.g7cd99ce4.el8 58/69 2023-10-03T10:11:44.356 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8 59/69 2023-10-03T10:11:44.356 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-507.g7cd99ce4.el8.noar 60/69 2023-10-03T10:11:44.356 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 61/69 2023-10-03T10:11:44.356 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-507.g7cd99c 62/69 2023-10-03T10:11:44.356 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 63/69 2023-10-03T10:11:44.356 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-507.g7cd99ce4.el8.n 64/69 2023-10-03T10:11:44.356 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.n 65/69 2023-10-03T10:11:44.356 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-rook-2:18.2.0-507.g7cd99ce4.el8.noarch 66/69 2023-10-03T10:11:44.356 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 67/69 2023-10-03T10:11:44.356 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-507.g7cd99ce4.el8. 68/69 2023-10-03T10:11:46.261 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8. 69/69 2023-10-03T10:11:46.261 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:11:46.261 INFO:teuthology.orchestra.run.smithi146.stdout:Upgraded: 2023-10-03T10:11:46.261 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.261 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.261 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.261 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.261 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:11:46.262 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.262 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.262 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:11:46.262 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:11:46.262 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:11:46.262 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:11:46.262 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.262 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.262 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:11:46.262 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.262 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.262 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.262 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.263 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.263 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.263 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.263 INFO:teuthology.orchestra.run.smithi146.stdout: librados2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.263 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.263 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.263 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.263 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.263 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.263 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.263 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.263 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.263 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.264 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.264 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.264 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:46.264 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2023-10-03T10:11:46.264 INFO:teuthology.orchestra.run.smithi146.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-03T10:11:46.264 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:11:46.264 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2023-10-03T10:11:46.398 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-10-03T10:11:46.622 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-03T10:11:46.645 INFO:teuthology.orchestra.run.smithi146.stdout:18.2.0-507.g7cd99ce4.el8 2023-10-03T10:11:46.646 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-507.g7cd99ce4.el8 2023-10-03T10:11:46.646 INFO:teuthology.task.install:The correct ceph version 18.2.0-507.g7cd99ce4 is installed. 2023-10-03T10:11:46.646 INFO:teuthology.run_tasks:Running task print... 2023-10-03T10:11:46.655 INFO:teuthology.task.print:**** done install.upgrade the host 2023-10-03T10:11:46.656 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-10-03T10:11:46.667 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-03T10:11:46.667 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:11:46.697 INFO:tasks.ceph.mon.a:Stopped 2023-10-03T10:11:46.697 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-03T10:11:46.697 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-03T10:11:46.739 INFO:tasks.ceph.mon.a:Started 2023-10-03T10:11:46.740 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-03T10:11:46.740 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:11:46.751 INFO:tasks.ceph.mon.b:Stopped 2023-10-03T10:11:46.751 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-03T10:11:46.751 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-03T10:11:46.794 INFO:tasks.ceph.mon.b:Started 2023-10-03T10:11:46.794 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-03T10:11:46.794 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:11:46.805 INFO:tasks.ceph.mon.c:Stopped 2023-10-03T10:11:46.805 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-03T10:11:46.806 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-03T10:11:46.848 INFO:tasks.ceph.mon.c:Started 2023-10-03T10:11:46.849 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-03T10:11:46.849 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:11:46.875 INFO:tasks.ceph.mgr.x:Stopped 2023-10-03T10:11:46.875 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-03T10:11:46.875 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-03T10:11:46.917 INFO:tasks.ceph.mgr.x:Started 2023-10-03T10:11:46.917 INFO:teuthology.run_tasks:Running task ceph.healthy... 2023-10-03T10:11:46.927 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-03T10:11:46.928 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-03T10:11:46.928 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-03T10:11:47.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.061+0000 7fa4bed0a700 1 Processor -- start 2023-10-03T10:11:47.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.061+0000 7fa4bed0a700 1 -- start start 2023-10-03T10:11:47.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.061+0000 7fa4bed0a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa4b8133ad0 0x7fa4b8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:47.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.061+0000 7fa4bed0a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4b81300a0 0x7fa4b81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:47.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.061+0000 7fa4bed0a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4b81309f0 0x7fa4b813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:47.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.061+0000 7fa4bed0a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b806b2d0 con 0x7fa4b8133ad0 2023-10-03T10:11:47.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.061+0000 7fa4bed0a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b8133610 con 0x7fa4b81300a0 2023-10-03T10:11:47.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.061+0000 7fa4bed0a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b809a500 con 0x7fa4b81309f0 2023-10-03T10:11:47.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.061+0000 7fa4b7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4b81300a0 0x7fa4b81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:47.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.062+0000 7fa4bd2a7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4b81309f0 0x7fa4b813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:47.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.062+0000 7fa4bcaa6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa4b8133ad0 0x7fa4b8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:47.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.062+0000 7fa4b7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4b81300a0 0x7fa4b81304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58794/0 (socket says 172.21.15.146:58794) 2023-10-03T10:11:47.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.062+0000 7fa4b7fff700 1 -- 172.21.15.146:0/583912897 learned_addr learned my addr 172.21.15.146:0/583912897 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:47.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.062+0000 7fa4b7fff700 1 -- 172.21.15.146:0/583912897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4b81300a0 msgr2=0x7fa4b81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:11:47.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.062+0000 7fa4b7fff700 1 -- 172.21.15.146:0/583912897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4b81300a0 msgr2=0x7fa4b81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:11:47.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.062+0000 7fa4bd2a7700 1 -- 172.21.15.146:0/583912897 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4b81309f0 msgr2=0x7fa4b813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-03T10:11:47.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.062+0000 7fa4b7fff700 1 --2- 172.21.15.146:0/583912897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4b81300a0 0x7fa4b81304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T10:11:47.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.062+0000 7fa4bd2a7700 1 -- 172.21.15.146:0/583912897 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4b81309f0 msgr2=0x7fa4b813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:11:47.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.062+0000 7fa4bd2a7700 1 --2- 172.21.15.146:0/583912897 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4b81309f0 0x7fa4b813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T10:11:47.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.062+0000 7fa4bcaa6700 1 -- 172.21.15.146:0/583912897 >> v2:172.21.15.146:3300/0 conn(0x7fa4b8133ad0 msgr2=0x7fa4b8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:11:47.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.062+0000 7fa4bcaa6700 1 -- 172.21.15.146:0/583912897 >> v2:172.21.15.146:3300/0 conn(0x7fa4b8133ad0 msgr2=0x7fa4b8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:11:47.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.062+0000 7fa4bcaa6700 1 --2- 172.21.15.146:0/583912897 >> v2:172.21.15.146:3300/0 conn(0x7fa4b8133ad0 0x7fa4b8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T10:11:47.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.062+0000 7fa4b7fff700 1 --2- 172.21.15.146:0/583912897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4b81300a0 0x7fa4b81304b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:11:47.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.062+0000 7fa4bd2a7700 1 --2- 172.21.15.146:0/583912897 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4b81309f0 0x7fa4b813a980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:11:47.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.062+0000 7fa4bcaa6700 1 --2- 172.21.15.146:0/583912897 >> v2:172.21.15.146:3300/0 conn(0x7fa4b8133ad0 0x7fa4b8133ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:11:47.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.263+0000 7fa4bd2a7700 1 --2- 172.21.15.146:0/583912897 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4b81309f0 0x7fa4b813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:47.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.263+0000 7fa4bcaa6700 1 --2- 172.21.15.146:0/583912897 >> v2:172.21.15.146:3300/0 conn(0x7fa4b8133ad0 0x7fa4b8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:47.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.263+0000 7fa4b7fff700 1 --2- 172.21.15.146:0/583912897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4b81300a0 0x7fa4b81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:47.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.263+0000 7fa4bcaa6700 1 -- 172.21.15.146:0/583912897 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4b81309f0 msgr2=0x7fa4b813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:47.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.263+0000 7fa4bcaa6700 1 --2- 172.21.15.146:0/583912897 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4b81309f0 0x7fa4b813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.263+0000 7fa4bcaa6700 1 -- 172.21.15.146:0/583912897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4b81300a0 msgr2=0x7fa4b81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:47.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.263+0000 7fa4bcaa6700 1 --2- 172.21.15.146:0/583912897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4b81300a0 0x7fa4b81304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.263+0000 7fa4bcaa6700 1 -- 172.21.15.146:0/583912897 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b81338b0 con 0x7fa4b8133ad0 2023-10-03T10:11:47.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.263+0000 7fa4b7fff700 1 --2- 172.21.15.146:0/583912897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4b81300a0 0x7fa4b81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:47.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.263+0000 7fa4bcaa6700 1 --2- 172.21.15.146:0/583912897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4b8133ad0 0x7fa4b8133ea0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac0098a0 tx=0x7fa4ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd0232c162dc5d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:47.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.263+0000 7fa4b77fe700 1 -- 172.21.15.146:0/583912897 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac004230 con 0x7fa4b8133ad0 2023-10-03T10:11:47.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.263+0000 7fa4b77fe700 1 -- 172.21.15.146:0/583912897 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ac004390 con 0x7fa4b8133ad0 2023-10-03T10:11:47.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.263+0000 7fa4b77fe700 1 -- 172.21.15.146:0/583912897 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac0038e0 con 0x7fa4b8133ad0 2023-10-03T10:11:47.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.264+0000 7fa4bed0a700 1 -- 172.21.15.146:0/583912897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4b8133ad0 msgr2=0x7fa4b8133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:47.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.264+0000 7fa4bed0a700 1 --2- 172.21.15.146:0/583912897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4b8133ad0 0x7fa4b8133ea0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac0098a0 tx=0x7fa4ac009bb0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.264+0000 7fa4bed0a700 1 -- 172.21.15.146:0/583912897 shutdown_connections 2023-10-03T10:11:47.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.264+0000 7fa4bed0a700 1 --2- 172.21.15.146:0/583912897 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4b81309f0 0x7fa4b813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.264+0000 7fa4bed0a700 1 --2- 172.21.15.146:0/583912897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4b8133ad0 0x7fa4b8133ea0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.264+0000 7fa4bed0a700 1 --2- 172.21.15.146:0/583912897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4b81300a0 0x7fa4b81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.264+0000 7fa4bed0a700 1 -- 172.21.15.146:0/583912897 >> 172.21.15.146:0/583912897 conn(0x7fa4b8099c40 msgr2=0x7fa4b80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:47.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.264+0000 7fa4bed0a700 1 -- 172.21.15.146:0/583912897 shutdown_connections 2023-10-03T10:11:47.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.264+0000 7fa4bed0a700 1 -- 172.21.15.146:0/583912897 wait complete. 2023-10-03T10:11:47.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.265+0000 7fa4bed0a700 1 Processor -- start 2023-10-03T10:11:47.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.265+0000 7fa4bed0a700 1 -- start start 2023-10-03T10:11:47.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.266+0000 7fa4bed0a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4b81300a0 0x7fa4b81c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:47.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.266+0000 7fa4bed0a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4b81309f0 0x7fa4b81c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:47.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.266+0000 7fa4bed0a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4b8133ad0 0x7fa4b81c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:47.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.266+0000 7fa4bed0a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b811ffe0 con 0x7fa4b81309f0 2023-10-03T10:11:47.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.266+0000 7fa4bed0a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b8072260 con 0x7fa4b81300a0 2023-10-03T10:11:47.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.266+0000 7fa4bed0a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b81201e0 con 0x7fa4b8133ad0 2023-10-03T10:11:47.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.266+0000 7fa4bcaa6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4b81300a0 0x7fa4b81c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:47.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.266+0000 7fa4b7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4b81309f0 0x7fa4b81c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.266+0000 7fa4bcaa6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4b81300a0 0x7fa4b81c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58836/0 (socket says 172.21.15.146:58836) 2023-10-03T10:11:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.266+0000 7fa4bcaa6700 1 -- 172.21.15.146:0/344262272 learned_addr learned my addr 172.21.15.146:0/344262272 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.266+0000 7fa4bd2a7700 1 --2- 172.21.15.146:0/344262272 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4b8133ad0 0x7fa4b81c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.267+0000 7fa4b7fff700 1 -- 172.21.15.146:0/344262272 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4b8133ad0 msgr2=0x7fa4b81c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.267+0000 7fa4b7fff700 1 --2- 172.21.15.146:0/344262272 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4b8133ad0 0x7fa4b81c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.267+0000 7fa4b7fff700 1 -- 172.21.15.146:0/344262272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4b81300a0 msgr2=0x7fa4b81c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.267+0000 7fa4b7fff700 1 --2- 172.21.15.146:0/344262272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4b81300a0 0x7fa4b81c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.267+0000 7fa4b7fff700 1 -- 172.21.15.146:0/344262272 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a40095b0 con 0x7fa4b81309f0 2023-10-03T10:11:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.267+0000 7fa4bcaa6700 1 --2- 172.21.15.146:0/344262272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4b81300a0 0x7fa4b81c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.267+0000 7fa4b7fff700 1 --2- 172.21.15.146:0/344262272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4b81309f0 0x7fa4b81c8c90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40118d0 tx=0x7fa4a4011be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.267+0000 7fa4b57fa700 1 -- 172.21.15.146:0/344262272 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a400c070 con 0x7fa4b81309f0 2023-10-03T10:11:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.267+0000 7fa4b57fa700 1 -- 172.21.15.146:0/344262272 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a4004230 con 0x7fa4b81309f0 2023-10-03T10:11:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.267+0000 7fa4bed0a700 1 -- 172.21.15.146:0/344262272 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4ac009500 con 0x7fa4b81309f0 2023-10-03T10:11:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.267+0000 7fa4b57fa700 1 -- 172.21.15.146:0/344262272 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a40045a0 con 0x7fa4b81309f0 2023-10-03T10:11:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.267+0000 7fa4bed0a700 1 -- 172.21.15.146:0/344262272 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b811fc40 con 0x7fa4b81309f0 2023-10-03T10:11:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.268+0000 7fa4b57fa700 1 -- 172.21.15.146:0/344262272 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fa4a40036a0 con 0x7fa4b81309f0 2023-10-03T10:11:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.268+0000 7fa4b57fa700 1 -- 172.21.15.146:0/344262272 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fa4a403bab0 con 0x7fa4b81309f0 2023-10-03T10:11:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.268+0000 7fa4bcaa6700 1 -- 172.21.15.146:0/344262272 >> v1:172.21.15.146:6816/118159 conn(0x7fa49c02c1b0 legacy=0x7fa49c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.268+0000 7fa4bed0a700 1 -- 172.21.15.146:0/344262272 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b811fe30 con 0x7fa4b81309f0 2023-10-03T10:11:47.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.272+0000 7fa4b57fa700 1 -- 172.21.15.146:0/344262272 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fa4a4022020 con 0x7fa4b81309f0 2023-10-03T10:11:47.326 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:47.326+0000 7f2412ef3240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-03T10:11:47.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.469+0000 7fa4bcaa6700 1 -- 172.21.15.146:0/344262272 >> v1:172.21.15.146:6816/118159 conn(0x7fa49c02c1b0 legacy=0x7fa49c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:47.480 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:47.480+0000 7f2412ef3240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-03T10:11:47.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.522+0000 7fa4bed0a700 1 -- 172.21.15.146:0/344262272 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa4b806ae20 con 0x7fa4b81309f0 2023-10-03T10:11:47.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.523+0000 7fa4b57fa700 1 -- 172.21.15.146:0/344262272 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+64284 (secure 0 0 0) 0x7fa4a4012d90 con 0x7fa4b81309f0 2023-10-03T10:11:47.523 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:11:47.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.525+0000 7fa4bed0a700 1 -- 172.21.15.146:0/344262272 >> v1:172.21.15.146:6816/118159 conn(0x7fa49c02c1b0 legacy=0x7fa49c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:47.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.525+0000 7fa4bed0a700 1 -- 172.21.15.146:0/344262272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4b81309f0 msgr2=0x7fa4b81c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:47.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.525+0000 7fa4bed0a700 1 --2- 172.21.15.146:0/344262272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4b81309f0 0x7fa4b81c8c90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40118d0 tx=0x7fa4a4011be0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.525+0000 7fa4bed0a700 1 -- 172.21.15.146:0/344262272 shutdown_connections 2023-10-03T10:11:47.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.525+0000 7fa4bed0a700 1 --2- 172.21.15.146:0/344262272 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4b8133ad0 0x7fa4b81c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.525+0000 7fa4bed0a700 1 --2- 172.21.15.146:0/344262272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4b81300a0 0x7fa4b81c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.525+0000 7fa4bed0a700 1 --2- 172.21.15.146:0/344262272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4b81309f0 0x7fa4b81c8c90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.525+0000 7fa4bed0a700 1 -- 172.21.15.146:0/344262272 >> 172.21.15.146:0/344262272 conn(0x7fa4b8099c40 msgr2=0x7fa4b812f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:47.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.525+0000 7fa4bed0a700 1 -- 172.21.15.146:0/344262272 shutdown_connections 2023-10-03T10:11:47.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.525+0000 7fa4bed0a700 1 -- 172.21.15.146:0/344262272 wait complete. 2023-10-03T10:11:47.538 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":5,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6816","nonce":118159}]},"active_addr":"172.21.15.146:6816/118159","active_change":"2023-10-03T10:09:38.282856+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":45915595}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":1896339219}]}]} 2023-10-03T10:11:47.540 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-03T10:11:47.540 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:11:47.540 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:47.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.664+0000 7fbd4aebd700 1 Processor -- start 2023-10-03T10:11:47.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.664+0000 7fbd4aebd700 1 -- start start 2023-10-03T10:11:47.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.665+0000 7fbd4aebd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd4409a150 0x7fbd4409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:47.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.665+0000 7fbd4aebd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd4409f1a0 0x7fbd44134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:47.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.665+0000 7fbd4aebd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4409af80 con 0x7fbd4409edb0 2023-10-03T10:11:47.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.665+0000 7fbd4aebd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4409a520 con 0x7fbd4409f1a0 2023-10-03T10:11:47.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.665+0000 7fbd4aebd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4409fe00 con 0x7fbd4409a150 2023-10-03T10:11:47.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.665+0000 7fbd4945a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd4409f1a0 0x7fbd44134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:47.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.665+0000 7fbd43fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbd4409edb0 0x7fbd44133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59906/0 (socket says 172.21.15.146:59906) 2023-10-03T10:11:47.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.665+0000 7fbd43fff700 1 -- 172.21.15.146:0/4194284475 learned_addr learned my addr 172.21.15.146:0/4194284475 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:11:47.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.665+0000 7fbd48c59700 1 --2- 172.21.15.146:0/4194284475 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd4409a150 0x7fbd4409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:47.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.665+0000 7fbd4945a700 1 -- 172.21.15.146:0/4194284475 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd4409a150 msgr2=0x7fbd4409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:47.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.665+0000 7fbd4945a700 1 --2- 172.21.15.146:0/4194284475 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd4409a150 0x7fbd4409e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.665+0000 7fbd4945a700 1 -- 172.21.15.146:0/4194284475 >> v1:172.21.15.146:6789/0 conn(0x7fbd4409edb0 legacy=0x7fbd44133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:47.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.665+0000 7fbd437fe700 1 -- 172.21.15.146:0/4194284475 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571436836 0 0) 0x7fbd4409af80 con 0x7fbd4409edb0 2023-10-03T10:11:47.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.665+0000 7fbd4945a700 1 -- 172.21.15.146:0/4194284475 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4406bc20 con 0x7fbd4409f1a0 2023-10-03T10:11:47.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.665+0000 7fbd48c59700 1 --2- 172.21.15.146:0/4194284475 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd4409a150 0x7fbd4409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:47.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.665+0000 7fbd4945a700 1 --2- 172.21.15.146:0/4194284475 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd4409f1a0 0x7fbd44134330 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c009dc0 tx=0x7fbd3c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6866feb3621d2db9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:47.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.666+0000 7fbd437fe700 1 -- 172.21.15.146:0/4194284475 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c00e070 con 0x7fbd4409f1a0 2023-10-03T10:11:47.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.666+0000 7fbd437fe700 1 -- 172.21.15.146:0/4194284475 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c00bb20 con 0x7fbd4409f1a0 2023-10-03T10:11:47.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.666+0000 7fbd437fe700 1 -- 172.21.15.146:0/4194284475 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c012430 con 0x7fbd4409f1a0 2023-10-03T10:11:47.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.666+0000 7fbd4aebd700 1 -- 172.21.15.146:0/4194284475 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd4409f1a0 msgr2=0x7fbd44134330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:47.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.666+0000 7fbd4aebd700 1 --2- 172.21.15.146:0/4194284475 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd4409f1a0 0x7fbd44134330 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c009dc0 tx=0x7fbd3c00b330 comp rx=0 tx=0).stop 2023-10-03T10:11:47.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.666+0000 7fbd4aebd700 1 -- 172.21.15.146:0/4194284475 shutdown_connections 2023-10-03T10:11:47.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.666+0000 7fbd4aebd700 1 --2- 172.21.15.146:0/4194284475 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd4409f1a0 0x7fbd44134330 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.666+0000 7fbd4aebd700 1 --2- 172.21.15.146:0/4194284475 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd4409a150 0x7fbd4409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.666+0000 7fbd4aebd700 1 -- 172.21.15.146:0/4194284475 >> 172.21.15.146:0/4194284475 conn(0x7fbd440a4430 msgr2=0x7fbd440a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:47.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.666+0000 7fbd4aebd700 1 -- 172.21.15.146:0/4194284475 shutdown_connections 2023-10-03T10:11:47.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.666+0000 7fbd4aebd700 1 -- 172.21.15.146:0/4194284475 wait complete. 2023-10-03T10:11:47.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.667+0000 7fbd4aebd700 1 Processor -- start 2023-10-03T10:11:47.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.667+0000 7fbd4aebd700 1 -- start start 2023-10-03T10:11:47.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.668+0000 7fbd4aebd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd4409a150 0x7fbd44122670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:47.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.668+0000 7fbd4aebd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4409edb0 0x7fbd44122bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:47.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.668+0000 7fbd4aebd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd4409f1a0 0x7fbd441230f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:47.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.668+0000 7fbd4aebd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd440a0440 con 0x7fbd4409edb0 2023-10-03T10:11:47.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.668+0000 7fbd4aebd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd44125eb0 con 0x7fbd4409f1a0 2023-10-03T10:11:47.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.668+0000 7fbd4aebd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd44125190 con 0x7fbd4409a150 2023-10-03T10:11:47.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.668+0000 7fbd4945a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd4409f1a0 0x7fbd441230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:47.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.668+0000 7fbd43fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4409edb0 0x7fbd44122bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:47.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.668+0000 7fbd4945a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd4409f1a0 0x7fbd441230f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58846/0 (socket says 172.21.15.146:58846) 2023-10-03T10:11:47.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.668+0000 7fbd43fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4409edb0 0x7fbd44122bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34294/0 (socket says 172.21.15.146:34294) 2023-10-03T10:11:47.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.668+0000 7fbd4945a700 1 -- 172.21.15.146:0/1762576264 learned_addr learned my addr 172.21.15.146:0/1762576264 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:47.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.668+0000 7fbd48c59700 1 --2- 172.21.15.146:0/1762576264 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd4409a150 0x7fbd44122670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:47.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.668+0000 7fbd4945a700 1 -- 172.21.15.146:0/1762576264 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd4409a150 msgr2=0x7fbd44122670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:47.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.668+0000 7fbd4945a700 1 --2- 172.21.15.146:0/1762576264 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd4409a150 0x7fbd44122670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.668+0000 7fbd4945a700 1 -- 172.21.15.146:0/1762576264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4409edb0 msgr2=0x7fbd44122bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:47.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.668+0000 7fbd4945a700 1 --2- 172.21.15.146:0/1762576264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4409edb0 0x7fbd44122bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.668+0000 7fbd4945a700 1 -- 172.21.15.146:0/1762576264 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd380094a0 con 0x7fbd4409f1a0 2023-10-03T10:11:47.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.668+0000 7fbd48c59700 1 --2- 172.21.15.146:0/1762576264 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd4409a150 0x7fbd44122670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:47.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.669+0000 7fbd4945a700 1 --2- 172.21.15.146:0/1762576264 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd4409f1a0 0x7fbd441230f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00b680 tx=0x7fbd3c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:47.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.669+0000 7fbd417fa700 1 -- 172.21.15.146:0/1762576264 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c012430 con 0x7fbd4409f1a0 2023-10-03T10:11:47.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.669+0000 7fbd417fa700 1 -- 172.21.15.146:0/1762576264 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c020070 con 0x7fbd4409f1a0 2023-10-03T10:11:47.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.669+0000 7fbd4aebd700 1 -- 172.21.15.146:0/1762576264 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd3c009a70 con 0x7fbd4409f1a0 2023-10-03T10:11:47.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.669+0000 7fbd417fa700 1 -- 172.21.15.146:0/1762576264 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c004280 con 0x7fbd4409f1a0 2023-10-03T10:11:47.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.669+0000 7fbd4aebd700 1 -- 172.21.15.146:0/1762576264 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd44124a70 con 0x7fbd4409f1a0 2023-10-03T10:11:47.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.669+0000 7fbd417fa700 1 -- 172.21.15.146:0/1762576264 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fbd3c0043e0 con 0x7fbd4409f1a0 2023-10-03T10:11:47.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.670+0000 7fbd48c59700 1 -- 172.21.15.146:0/1762576264 >> v1:172.21.15.146:6816/118159 conn(0x7fbd2802c1b0 legacy=0x7fbd2802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:47.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.670+0000 7fbd417fa700 1 -- 172.21.15.146:0/1762576264 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fbd3c022070 con 0x7fbd4409f1a0 2023-10-03T10:11:47.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.670+0000 7fbd4aebd700 1 -- 172.21.15.146:0/1762576264 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4409fa30 con 0x7fbd4409f1a0 2023-10-03T10:11:47.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.674+0000 7fbd417fa700 1 -- 172.21.15.146:0/1762576264 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fbd3c01a380 con 0x7fbd4409f1a0 2023-10-03T10:11:47.746 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:47.746+0000 7f2412ef3240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-03T10:11:47.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.843+0000 7fbd4aebd700 1 -- 172.21.15.146:0/1762576264 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd4404f2a0 con 0x7fbd4409f1a0 2023-10-03T10:11:47.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.844+0000 7fbd417fa700 1 -- 172.21.15.146:0/1762576264 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12768 (secure 0 0 0) 0x7fbd3c025b70 con 0x7fbd4409f1a0 2023-10-03T10:11:47.844 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:11:47.844 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":19,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:10:40.075993+0000","last_up_change":"2023-10-03T10:09:42.301022+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":118758}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":118758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":118758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":118758}]},"public_addr":"172.21.15.146:6800/118758","cluster_addr":"172.21.15.146:6801/118758","heartbeat_back_addr":"172.21.15.146:6803/118758","heartbeat_front_addr":"172.21.15.146:6802/118758","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":118774}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":118774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":118774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":118774}]},"public_addr":"172.21.15.146:6804/118774","cluster_addr":"172.21.15.146:6806/118774","heartbeat_back_addr":"172.21.15.146:6810/118774","heartbeat_front_addr":"172.21.15.146:6808/118774","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":118775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":118775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":118775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":118775}]},"public_addr":"172.21.15.146:6805/118775","cluster_addr":"172.21.15.146:6807/118775","heartbeat_back_addr":"172.21.15.146:6811/118775","heartbeat_front_addr":"172.21.15.146:6809/118775","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":118776}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":118776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":118776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":118776}]},"public_addr":"172.21.15.146:6812/118776","cluster_addr":"172.21.15.146:6813/118776","heartbeat_back_addr":"172.21.15.146:6815/118776","heartbeat_front_addr":"172.21.15.146:6814/118776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:47.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.846+0000 7fbd4aebd700 1 -- 172.21.15.146:0/1762576264 >> v1:172.21.15.146:6816/118159 conn(0x7fbd2802c1b0 legacy=0x7fbd2802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:47.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.846+0000 7fbd4aebd700 1 -- 172.21.15.146:0/1762576264 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd4409f1a0 msgr2=0x7fbd441230f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:47.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.846+0000 7fbd4aebd700 1 --2- 172.21.15.146:0/1762576264 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd4409f1a0 0x7fbd441230f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00b680 tx=0x7fbd3c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.846+0000 7fbd4aebd700 1 -- 172.21.15.146:0/1762576264 shutdown_connections 2023-10-03T10:11:47.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.846+0000 7fbd4aebd700 1 --2- 172.21.15.146:0/1762576264 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd4409f1a0 0x7fbd441230f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.846+0000 7fbd4aebd700 1 --2- 172.21.15.146:0/1762576264 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd4409a150 0x7fbd44122670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.846+0000 7fbd4aebd700 1 --2- 172.21.15.146:0/1762576264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4409edb0 0x7fbd44122bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.846+0000 7fbd4aebd700 1 -- 172.21.15.146:0/1762576264 >> 172.21.15.146:0/1762576264 conn(0x7fbd440a4430 msgr2=0x7fbd4409c020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:47.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.847+0000 7fbd4aebd700 1 -- 172.21.15.146:0/1762576264 shutdown_connections 2023-10-03T10:11:47.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.847+0000 7fbd4aebd700 1 -- 172.21.15.146:0/1762576264 wait complete. 2023-10-03T10:11:47.859 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:11:47.859 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:47.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.982+0000 7fa22e8bd700 1 Processor -- start 2023-10-03T10:11:47.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.982+0000 7fa22e8bd700 1 -- start start 2023-10-03T10:11:47.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.983+0000 7fa22e8bd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa228136960 0x7fa228138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:47.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.983+0000 7fa22e8bd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa228139280 0x7fa22813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:47.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.983+0000 7fa22e8bd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22806b2d0 con 0x7fa228133ad0 2023-10-03T10:11:47.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.983+0000 7fa22e8bd700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2281345b0 con 0x7fa228139280 2023-10-03T10:11:47.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.983+0000 7fa22e8bd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa228133610 con 0x7fa228136960 2023-10-03T10:11:47.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.983+0000 7fa22ce5a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa228139280 0x7fa22813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:47.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.983+0000 7fa2277fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa228136960 0x7fa228138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:47.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.983+0000 7fa22ce5a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa228139280 0x7fa22813b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34310/0 (socket says 172.21.15.146:34310) 2023-10-03T10:11:47.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.983+0000 7fa22ce5a700 1 -- 172.21.15.146:0/2025064756 learned_addr learned my addr 172.21.15.146:0/2025064756 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:47.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.983+0000 7fa227fff700 1 --1- 172.21.15.146:0/2025064756 >> v1:172.21.15.146:6789/0 conn(0x7fa228133ad0 0x7fa228133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59910/0 (socket says 172.21.15.146:59910) 2023-10-03T10:11:47.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.983+0000 7fa2277fe700 1 -- 172.21.15.146:0/2025064756 >> v2:172.21.15.146:3300/0 conn(0x7fa228139280 msgr2=0x7fa22813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:47.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.983+0000 7fa2277fe700 1 --2- 172.21.15.146:0/2025064756 >> v2:172.21.15.146:3300/0 conn(0x7fa228139280 0x7fa22813b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.983+0000 7fa2277fe700 1 -- 172.21.15.146:0/2025064756 >> v1:172.21.15.146:6789/0 conn(0x7fa228133ad0 legacy=0x7fa228133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:47.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.983+0000 7fa2277fe700 1 -- 172.21.15.146:0/2025064756 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22809a500 con 0x7fa228136960 2023-10-03T10:11:47.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.983+0000 7fa226ffd700 1 -- 172.21.15.146:0/2025064756 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1093180535 0 0) 0x7fa22806b2d0 con 0x7fa228133ad0 2023-10-03T10:11:47.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.983+0000 7fa22ce5a700 1 --2- 172.21.15.146:0/2025064756 >> v2:172.21.15.146:3300/0 conn(0x7fa228139280 0x7fa22813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:47.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.984+0000 7fa2277fe700 1 --2- 172.21.15.146:0/2025064756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa228136960 0x7fa228138d40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa21c009870 tx=0x7fa21c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30c573b023473633 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:47.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.984+0000 7fa226ffd700 1 -- 172.21.15.146:0/2025064756 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c011830 con 0x7fa228136960 2023-10-03T10:11:47.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.984+0000 7fa226ffd700 1 -- 172.21.15.146:0/2025064756 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21c011990 con 0x7fa228136960 2023-10-03T10:11:47.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.984+0000 7fa226ffd700 1 -- 172.21.15.146:0/2025064756 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c011d20 con 0x7fa228136960 2023-10-03T10:11:47.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.984+0000 7fa22e8bd700 1 -- 172.21.15.146:0/2025064756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa228136960 msgr2=0x7fa228138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:47.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.984+0000 7fa22e8bd700 1 --2- 172.21.15.146:0/2025064756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa228136960 0x7fa228138d40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa21c009870 tx=0x7fa21c009b80 comp rx=0 tx=0).stop 2023-10-03T10:11:47.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.984+0000 7fa22e8bd700 1 -- 172.21.15.146:0/2025064756 shutdown_connections 2023-10-03T10:11:47.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.984+0000 7fa22e8bd700 1 --2- 172.21.15.146:0/2025064756 >> v2:172.21.15.146:3300/0 conn(0x7fa228139280 0x7fa22813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.984+0000 7fa22e8bd700 1 --2- 172.21.15.146:0/2025064756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa228136960 0x7fa228138d40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.984+0000 7fa22e8bd700 1 -- 172.21.15.146:0/2025064756 >> 172.21.15.146:0/2025064756 conn(0x7fa228099c40 msgr2=0x7fa2280a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:47.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.984+0000 7fa22e8bd700 1 -- 172.21.15.146:0/2025064756 shutdown_connections 2023-10-03T10:11:47.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.984+0000 7fa22e8bd700 1 -- 172.21.15.146:0/2025064756 wait complete. 2023-10-03T10:11:47.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.985+0000 7fa22e8bd700 1 Processor -- start 2023-10-03T10:11:47.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.985+0000 7fa22e8bd700 1 -- start start 2023-10-03T10:11:47.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.986+0000 7fa22e8bd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa228133ad0 0x7fa228071770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:47.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.986+0000 7fa22e8bd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa228136960 0x7fa228071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:47.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.986+0000 7fa22e8bd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa228139280 0x7fa2281c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:47.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.986+0000 7fa22e8bd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa228070040 con 0x7fa228136960 2023-10-03T10:11:47.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.986+0000 7fa22e8bd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa228130b10 con 0x7fa228133ad0 2023-10-03T10:11:47.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.986+0000 7fa22e8bd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa22809f390 con 0x7fa228139280 2023-10-03T10:11:47.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.986+0000 7fa2277fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa228136960 0x7fa228071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:47.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.986+0000 7fa2277fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa228136960 0x7fa228071cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34314/0 (socket says 172.21.15.146:34314) 2023-10-03T10:11:47.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.986+0000 7fa2277fe700 1 -- 172.21.15.146:0/1222635587 learned_addr learned my addr 172.21.15.146:0/1222635587 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:47.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.986+0000 7fa22ce5a700 1 --2- 172.21.15.146:0/1222635587 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa228139280 0x7fa2281c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:47.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.986+0000 7fa227fff700 1 --2- 172.21.15.146:0/1222635587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa228133ad0 0x7fa228071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:47.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.986+0000 7fa2277fe700 1 -- 172.21.15.146:0/1222635587 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa228139280 msgr2=0x7fa2281c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:47.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.986+0000 7fa2277fe700 1 --2- 172.21.15.146:0/1222635587 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa228139280 0x7fa2281c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.986+0000 7fa2277fe700 1 -- 172.21.15.146:0/1222635587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa228133ad0 msgr2=0x7fa228071770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:47.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.986+0000 7fa2277fe700 1 --2- 172.21.15.146:0/1222635587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa228133ad0 0x7fa228071770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:47.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.986+0000 7fa2277fe700 1 -- 172.21.15.146:0/1222635587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa220009b30 con 0x7fa228136960 2023-10-03T10:11:47.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.986+0000 7fa2277fe700 1 --2- 172.21.15.146:0/1222635587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa228136960 0x7fa228071cb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa21c014040 tx=0x7fa21c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:47.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.987+0000 7fa224ff9700 1 -- 172.21.15.146:0/1222635587 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c0036a0 con 0x7fa228136960 2023-10-03T10:11:47.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.987+0000 7fa224ff9700 1 -- 172.21.15.146:0/1222635587 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21c01e070 con 0x7fa228136960 2023-10-03T10:11:47.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.987+0000 7fa22e8bd700 1 -- 172.21.15.146:0/1222635587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa21c0094a0 con 0x7fa228136960 2023-10-03T10:11:47.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.987+0000 7fa224ff9700 1 -- 172.21.15.146:0/1222635587 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c003a20 con 0x7fa228136960 2023-10-03T10:11:47.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.987+0000 7fa22e8bd700 1 -- 172.21.15.146:0/1222635587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2280721f0 con 0x7fa228136960 2023-10-03T10:11:47.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.987+0000 7fa224ff9700 1 -- 172.21.15.146:0/1222635587 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fa21c003b80 con 0x7fa228136960 2023-10-03T10:11:47.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.987+0000 7fa224ff9700 1 -- 172.21.15.146:0/1222635587 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fa21c03c780 con 0x7fa228136960 2023-10-03T10:11:47.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.987+0000 7fa227fff700 1 -- 172.21.15.146:0/1222635587 >> v1:172.21.15.146:6816/118159 conn(0x7fa21402c1b0 legacy=0x7fa21402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:47.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.988+0000 7fa22e8bd700 1 -- 172.21.15.146:0/1222635587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2280701b0 con 0x7fa228136960 2023-10-03T10:11:47.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:47.992+0000 7fa224ff9700 1 -- 172.21.15.146:0/1222635587 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fa21c02d7d0 con 0x7fa228136960 2023-10-03T10:11:48.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.165+0000 7fa22e8bd700 1 -- 172.21.15.146:0/1222635587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa22804f2a0 con 0x7fa228136960 2023-10-03T10:11:48.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.166+0000 7fa224ff9700 1 -- 172.21.15.146:0/1222635587 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12768 (secure 0 0 0) 0x7fa21c0107f0 con 0x7fa228136960 2023-10-03T10:11:48.166 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:11:48.167 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":19,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:10:40.075993+0000","last_up_change":"2023-10-03T10:09:42.301022+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":118758}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":118758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":118758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":118758}]},"public_addr":"172.21.15.146:6800/118758","cluster_addr":"172.21.15.146:6801/118758","heartbeat_back_addr":"172.21.15.146:6803/118758","heartbeat_front_addr":"172.21.15.146:6802/118758","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":118774}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":118774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":118774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":118774}]},"public_addr":"172.21.15.146:6804/118774","cluster_addr":"172.21.15.146:6806/118774","heartbeat_back_addr":"172.21.15.146:6810/118774","heartbeat_front_addr":"172.21.15.146:6808/118774","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":118775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":118775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":118775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":118775}]},"public_addr":"172.21.15.146:6805/118775","cluster_addr":"172.21.15.146:6807/118775","heartbeat_back_addr":"172.21.15.146:6811/118775","heartbeat_front_addr":"172.21.15.146:6809/118775","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":118776}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":118776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":118776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":118776}]},"public_addr":"172.21.15.146:6812/118776","cluster_addr":"172.21.15.146:6813/118776","heartbeat_back_addr":"172.21.15.146:6815/118776","heartbeat_front_addr":"172.21.15.146:6814/118776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:48.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.168+0000 7fa22e8bd700 1 -- 172.21.15.146:0/1222635587 >> v1:172.21.15.146:6816/118159 conn(0x7fa21402c1b0 legacy=0x7fa21402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:48.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.168+0000 7fa22e8bd700 1 -- 172.21.15.146:0/1222635587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa228136960 msgr2=0x7fa228071cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.168+0000 7fa22e8bd700 1 --2- 172.21.15.146:0/1222635587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa228136960 0x7fa228071cb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa21c014040 tx=0x7fa21c004750 comp rx=0 tx=0).stop 2023-10-03T10:11:48.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.168+0000 7fa22e8bd700 1 -- 172.21.15.146:0/1222635587 shutdown_connections 2023-10-03T10:11:48.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.168+0000 7fa22e8bd700 1 --2- 172.21.15.146:0/1222635587 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa228139280 0x7fa2281c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.168+0000 7fa22e8bd700 1 --2- 172.21.15.146:0/1222635587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa228133ad0 0x7fa228071770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.168+0000 7fa22e8bd700 1 --2- 172.21.15.146:0/1222635587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa228136960 0x7fa228071cb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.168+0000 7fa22e8bd700 1 -- 172.21.15.146:0/1222635587 >> 172.21.15.146:0/1222635587 conn(0x7fa228099c40 msgr2=0x7fa2281371c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:48.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.169+0000 7fa22e8bd700 1 -- 172.21.15.146:0/1222635587 shutdown_connections 2023-10-03T10:11:48.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.169+0000 7fa22e8bd700 1 -- 172.21.15.146:0/1222635587 wait complete. 2023-10-03T10:11:48.181 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-03T10:11:48.181 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-03T10:11:48.182 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-03T10:11:48.182 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-03T10:11:48.260 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:48.261+0000 7f2412ef3240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-03T10:11:48.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.328+0000 7fe1ecb0e700 1 Processor -- start 2023-10-03T10:11:48.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.328+0000 7fe1ecb0e700 1 -- start start 2023-10-03T10:11:48.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.329+0000 7fe1ecb0e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1e8138040 0x7fe1e8138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.329+0000 7fe1ecb0e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e80a08e0 0x7fe1e80a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.329+0000 7fe1ecb0e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e81379e0 con 0x7fe1e80a1230 2023-10-03T10:11:48.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.329+0000 7fe1ecb0e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e80a2100 con 0x7fe1e80a08e0 2023-10-03T10:11:48.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.329+0000 7fe1ecb0e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e8138950 con 0x7fe1e8138040 2023-10-03T10:11:48.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.329+0000 7fe1e6d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe1e80a1230 0x7fe1e813ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59922/0 (socket says 172.21.15.146:59922) 2023-10-03T10:11:48.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.329+0000 7fe1e6d9d700 1 -- 172.21.15.146:0/4012545546 learned_addr learned my addr 172.21.15.146:0/4012545546 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:11:48.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.330+0000 7fe1e559a700 1 -- 172.21.15.146:0/4012545546 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1912384702 0 0) 0x7fe1e81379e0 con 0x7fe1e80a1230 2023-10-03T10:11:48.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.330+0000 7fe1e559a700 1 -- 172.21.15.146:0/4012545546 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1d00035b0 con 0x7fe1e80a1230 2023-10-03T10:11:48.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.330+0000 7fe1e5d9b700 1 --2- 172.21.15.146:0/4012545546 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e80a08e0 0x7fe1e80a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.330+0000 7fe1e659c700 1 --2- 172.21.15.146:0/4012545546 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1e8138040 0x7fe1e8138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.330+0000 7fe1e659c700 1 -- 172.21.15.146:0/4012545546 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e80a08e0 msgr2=0x7fe1e80a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:48.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.330+0000 7fe1e659c700 1 --2- 172.21.15.146:0/4012545546 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e80a08e0 0x7fe1e80a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.330+0000 7fe1e659c700 1 -- 172.21.15.146:0/4012545546 >> v1:172.21.15.146:6789/0 conn(0x7fe1e80a1230 legacy=0x7fe1e813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.330+0000 7fe1e659c700 1 -- 172.21.15.146:0/4012545546 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e809b9b0 con 0x7fe1e8138040 2023-10-03T10:11:48.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.330+0000 7fe1e659c700 1 --2- 172.21.15.146:0/4012545546 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1e8138040 0x7fe1e8138410 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009880 tx=0x7fe1d8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7b1900376083520 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:48.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.330+0000 7fe1e559a700 1 -- 172.21.15.146:0/4012545546 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8005e30 con 0x7fe1e8138040 2023-10-03T10:11:48.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.330+0000 7fe1e559a700 1 -- 172.21.15.146:0/4012545546 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d8006030 con 0x7fe1e8138040 2023-10-03T10:11:48.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.330+0000 7fe1e559a700 1 -- 172.21.15.146:0/4012545546 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d80063c0 con 0x7fe1e8138040 2023-10-03T10:11:48.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.331+0000 7fe1ecb0e700 1 -- 172.21.15.146:0/4012545546 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1e8138040 msgr2=0x7fe1e8138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.331+0000 7fe1ecb0e700 1 --2- 172.21.15.146:0/4012545546 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1e8138040 0x7fe1e8138410 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009880 tx=0x7fe1d8009b90 comp rx=0 tx=0).stop 2023-10-03T10:11:48.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.336+0000 7fe1ecb0e700 1 -- 172.21.15.146:0/4012545546 shutdown_connections 2023-10-03T10:11:48.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.336+0000 7fe1ecb0e700 1 --2- 172.21.15.146:0/4012545546 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1e8138040 0x7fe1e8138410 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.336+0000 7fe1ecb0e700 1 --2- 172.21.15.146:0/4012545546 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e80a08e0 0x7fe1e80a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.336+0000 7fe1ecb0e700 1 -- 172.21.15.146:0/4012545546 >> 172.21.15.146:0/4012545546 conn(0x7fe1e80a2980 msgr2=0x7fe1e80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:48.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.336+0000 7fe1ecb0e700 1 -- 172.21.15.146:0/4012545546 shutdown_connections 2023-10-03T10:11:48.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.336+0000 7fe1ecb0e700 1 -- 172.21.15.146:0/4012545546 wait complete. 2023-10-03T10:11:48.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.338+0000 7fe1ecb0e700 1 Processor -- start 2023-10-03T10:11:48.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.338+0000 7fe1ecb0e700 1 -- start start 2023-10-03T10:11:48.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.338+0000 7fe1ecb0e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1e80a08e0 0x7fe1e81370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.338+0000 7fe1ecb0e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e80a1230 0x7fe1e8137600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.338+0000 7fe1ecb0e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e8138040 0x7fe1e81358a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.338+0000 7fe1ecb0e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e813f4c0 con 0x7fe1e80a1230 2023-10-03T10:11:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.338+0000 7fe1ecb0e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e81404e0 con 0x7fe1e8138040 2023-10-03T10:11:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.338+0000 7fe1ecb0e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e8130000 con 0x7fe1e80a08e0 2023-10-03T10:11:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.338+0000 7fe1e5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e80a1230 0x7fe1e8137600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.338+0000 7fe1e5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e80a1230 0x7fe1e8137600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34328/0 (socket says 172.21.15.146:34328) 2023-10-03T10:11:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.338+0000 7fe1e5d9b700 1 -- 172.21.15.146:0/2290371247 learned_addr learned my addr 172.21.15.146:0/2290371247 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.338+0000 7fe1e6d9d700 1 --2- 172.21.15.146:0/2290371247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e8138040 0x7fe1e81358a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.338+0000 7fe1e659c700 1 --2- 172.21.15.146:0/2290371247 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1e80a08e0 0x7fe1e81370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.339+0000 7fe1e5d9b700 1 -- 172.21.15.146:0/2290371247 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1e80a08e0 msgr2=0x7fe1e81370c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.339+0000 7fe1e5d9b700 1 --2- 172.21.15.146:0/2290371247 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1e80a08e0 0x7fe1e81370c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.339+0000 7fe1e5d9b700 1 -- 172.21.15.146:0/2290371247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e8138040 msgr2=0x7fe1e81358a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.339+0000 7fe1e5d9b700 1 --2- 172.21.15.146:0/2290371247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e8138040 0x7fe1e81358a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.339+0000 7fe1e5d9b700 1 -- 172.21.15.146:0/2290371247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d8009430 con 0x7fe1e80a1230 2023-10-03T10:11:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.339+0000 7fe1e5d9b700 1 --2- 172.21.15.146:0/2290371247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e80a1230 0x7fe1e8137600 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00e870 tx=0x7fe1dc00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.339+0000 7fe1d6ffd700 1 -- 172.21.15.146:0/2290371247 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc009590 con 0x7fe1e80a1230 2023-10-03T10:11:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.339+0000 7f7098ef9700 1 Processor -- start 2023-10-03T10:11:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.339+0000 7f7098ef9700 1 -- start start 2023-10-03T10:11:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.339+0000 7fe1ecb0e700 1 -- 172.21.15.146:0/2290371247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e813f290 con 0x7fe1e80a1230 2023-10-03T10:11:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.339+0000 7fe1ecb0e700 1 -- 172.21.15.146:0/2290371247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e8140c00 con 0x7fe1e80a1230 2023-10-03T10:11:48.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.339+0000 7fe1d6ffd700 1 -- 172.21.15.146:0/2290371247 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc013680 con 0x7fe1e80a1230 2023-10-03T10:11:48.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.339+0000 7fe1d6ffd700 1 -- 172.21.15.146:0/2290371247 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc013a10 con 0x7fe1e80a1230 2023-10-03T10:11:48.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.340+0000 7fe1ecb0e700 1 -- 172.21.15.146:0/2290371247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe1cc000fb0 con 0x7fe1e80a1230 2023-10-03T10:11:48.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.340+0000 7f7098ef9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f709409dcb0 0x7f709409e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.340+0000 7f7098ef9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f709409e5c0 0x7f7094131420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.340+0000 7f7098ef9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70940741b0 con 0x7f7094131960 2023-10-03T10:11:48.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.340+0000 7f7098ef9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7094098a00 con 0x7f709409e5c0 2023-10-03T10:11:48.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.340+0000 7f7098ef9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f709409ac30 con 0x7f709409dcb0 2023-10-03T10:11:48.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.340+0000 7f7092d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7094131960 0x7f7094138960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59924/0 (socket says 172.21.15.146:59924) 2023-10-03T10:11:48.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.340+0000 7f7092d9d700 1 -- 172.21.15.146:0/533608743 learned_addr learned my addr 172.21.15.146:0/533608743 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:11:48.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.341+0000 7f709259c700 1 --2- 172.21.15.146:0/533608743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f709409dcb0 0x7f709409e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.340+0000 7fe1d6ffd700 1 -- 172.21.15.146:0/2290371247 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fe1dc013b70 con 0x7fe1e80a1230 2023-10-03T10:11:48.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.341+0000 7fe1d6ffd700 1 -- 172.21.15.146:0/2290371247 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fe1dc03b7d0 con 0x7fe1e80a1230 2023-10-03T10:11:48.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.341+0000 7fe1e659c700 1 -- 172.21.15.146:0/2290371247 >> v1:172.21.15.146:6816/118159 conn(0x7fe1c802c1b0 legacy=0x7fe1c802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:48.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.341+0000 7fe1d6ffd700 1 -- 172.21.15.146:0/2290371247 --> v1:172.21.15.146:6800/118758 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1c8038e10 con 0x7fe1c8035110 2023-10-03T10:11:48.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.341+0000 7fe1d6ffd700 1 -- 172.21.15.146:0/2290371247 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1dc01be10 con 0x7fe1e80a1230 2023-10-03T10:11:48.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.341+0000 7f7091d9b700 1 --2- 172.21.15.146:0/533608743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f709409e5c0 0x7f7094131420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.341+0000 7f709159a700 1 -- 172.21.15.146:0/533608743 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3559754168 0 0) 0x7f70940741b0 con 0x7f7094131960 2023-10-03T10:11:48.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.341+0000 7f709159a700 1 -- 172.21.15.146:0/533608743 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f707c0035b0 con 0x7f7094131960 2023-10-03T10:11:48.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.341+0000 7f709259c700 1 -- 172.21.15.146:0/533608743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f709409e5c0 msgr2=0x7f7094131420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:48.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.341+0000 7f709259c700 1 --2- 172.21.15.146:0/533608743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f709409e5c0 0x7f7094131420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.341+0000 7f709259c700 1 -- 172.21.15.146:0/533608743 >> v1:172.21.15.146:6789/0 conn(0x7f7094131960 legacy=0x7f7094138960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.341+0000 7f709259c700 1 -- 172.21.15.146:0/533608743 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709409a190 con 0x7f709409dcb0 2023-10-03T10:11:48.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.341+0000 7f709259c700 1 --2- 172.21.15.146:0/533608743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f709409dcb0 0x7f709409e080 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7084009870 tx=0x7f7084009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a85c1f3bceb6065 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:48.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.342+0000 7f709159a700 1 -- 172.21.15.146:0/533608743 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7084011830 con 0x7f709409dcb0 2023-10-03T10:11:48.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.342+0000 7f709159a700 1 -- 172.21.15.146:0/533608743 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7084011990 con 0x7f709409dcb0 2023-10-03T10:11:48.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.342+0000 7f709159a700 1 -- 172.21.15.146:0/533608743 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7084011d20 con 0x7f709409dcb0 2023-10-03T10:11:48.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.342+0000 7f7098ef9700 1 -- 172.21.15.146:0/533608743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f709409dcb0 msgr2=0x7f709409e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.342+0000 7f7098ef9700 1 --2- 172.21.15.146:0/533608743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f709409dcb0 0x7f709409e080 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7084009870 tx=0x7f7084009b80 comp rx=0 tx=0).stop 2023-10-03T10:11:48.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.342+0000 7f7098ef9700 1 -- 172.21.15.146:0/533608743 shutdown_connections 2023-10-03T10:11:48.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.342+0000 7f7098ef9700 1 --2- 172.21.15.146:0/533608743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f709409dcb0 0x7f709409e080 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.342+0000 7f7098ef9700 1 --2- 172.21.15.146:0/533608743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f709409e5c0 0x7f7094131420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.342+0000 7f7098ef9700 1 -- 172.21.15.146:0/533608743 >> 172.21.15.146:0/533608743 conn(0x7f70940a2eb0 msgr2=0x7f709409eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:48.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.343+0000 7f7098ef9700 1 -- 172.21.15.146:0/533608743 shutdown_connections 2023-10-03T10:11:48.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.343+0000 7f7098ef9700 1 -- 172.21.15.146:0/533608743 wait complete. 2023-10-03T10:11:48.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.343+0000 7fe1d6ffd700 1 -- 172.21.15.146:0/2290371247 <== osd.0 v1:172.21.15.146:6800/118758 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7fe1c8038e10 con 0x7fe1c8035110 2023-10-03T10:11:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.344+0000 7f7098ef9700 1 Processor -- start 2023-10-03T10:11:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.344+0000 7f7098ef9700 1 -- start start 2023-10-03T10:11:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.344+0000 7f7098ef9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f709409dcb0 0x7f70940962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.344+0000 7f7098ef9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f709409e5c0 0x7f70940967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.344+0000 7f7098ef9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7094131960 0x7f7094096d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.344+0000 7f7098ef9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7094094ce0 con 0x7f709409dcb0 2023-10-03T10:11:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.344+0000 7f7098ef9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709409bff0 con 0x7f7094131960 2023-10-03T10:11:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.344+0000 7f7098ef9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7094097bb0 con 0x7f709409e5c0 2023-10-03T10:11:48.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.344+0000 7f7092d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7094131960 0x7f7094096d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.344+0000 7f7092d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7094131960 0x7f7094096d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58890/0 (socket says 172.21.15.146:58890) 2023-10-03T10:11:48.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.344+0000 7f7092d9d700 1 -- 172.21.15.146:0/1341207609 learned_addr learned my addr 172.21.15.146:0/1341207609 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:48.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.344+0000 7f709259c700 1 --2- 172.21.15.146:0/1341207609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f709409dcb0 0x7f70940962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.345+0000 7f7091d9b700 1 --2- 172.21.15.146:0/1341207609 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f709409e5c0 0x7f70940967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.345+0000 7f7092d9d700 1 -- 172.21.15.146:0/1341207609 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f709409e5c0 msgr2=0x7f70940967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.345+0000 7f7092d9d700 1 --2- 172.21.15.146:0/1341207609 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f709409e5c0 0x7f70940967e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.345+0000 7f7092d9d700 1 -- 172.21.15.146:0/1341207609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f709409dcb0 msgr2=0x7f70940962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.345+0000 7f7092d9d700 1 --2- 172.21.15.146:0/1341207609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f709409dcb0 0x7f70940962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.345+0000 7f7092d9d700 1 -- 172.21.15.146:0/1341207609 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70840094a0 con 0x7f7094131960 2023-10-03T10:11:48.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.345+0000 7f7091d9b700 1 --2- 172.21.15.146:0/1341207609 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f709409e5c0 0x7f70940967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:11:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.345+0000 7f7092d9d700 1 --2- 172.21.15.146:0/1341207609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7094131960 0x7f7094096d20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f708c00cb40 tx=0x7f708c00cf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.348+0000 7f7082ffd700 1 -- 172.21.15.146:0/1341207609 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c00ab50 con 0x7f7094131960 2023-10-03T10:11:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.348+0000 7f7082ffd700 1 -- 172.21.15.146:0/1341207609 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c00acb0 con 0x7f7094131960 2023-10-03T10:11:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.348+0000 7f7082ffd700 1 -- 172.21.15.146:0/1341207609 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c012620 con 0x7f7094131960 2023-10-03T10:11:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.348+0000 7f7098ef9700 1 -- 172.21.15.146:0/1341207609 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709409b660 con 0x7f7094131960 2023-10-03T10:11:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.348+0000 7f7098ef9700 1 -- 172.21.15.146:0/1341207609 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70940953e0 con 0x7f7094131960 2023-10-03T10:11:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.349+0000 7f7098ef9700 1 -- 172.21.15.146:0/1341207609 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7094098720 con 0x7f7094131960 2023-10-03T10:11:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.350+0000 7f7082ffd700 1 -- 172.21.15.146:0/1341207609 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f708c01b3b0 con 0x7f7094131960 2023-10-03T10:11:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.350+0000 7f7082ffd700 1 -- 172.21.15.146:0/1341207609 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f708c03bd40 con 0x7f7094131960 2023-10-03T10:11:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.350+0000 7f709259c700 1 -- 172.21.15.146:0/1341207609 >> v1:172.21.15.146:6816/118159 conn(0x7f707402c200 legacy=0x7f707402e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.350+0000 7f7082ffd700 1 -- 172.21.15.146:0/1341207609 --> v1:172.21.15.146:6805/118775 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7074038f60 con 0x7f7074035260 2023-10-03T10:11:48.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.350+0000 7f7082ffd700 1 -- 172.21.15.146:0/1341207609 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f708c03c0c0 con 0x7f7094131960 2023-10-03T10:11:48.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.357+0000 7f7082ffd700 1 -- 172.21.15.146:0/1341207609 <== osd.2 v1:172.21.15.146:6805/118775 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f7074038f60 con 0x7f7074035260 2023-10-03T10:11:48.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.360+0000 7fe1ecb0e700 1 -- 172.21.15.146:0/2290371247 --> v1:172.21.15.146:6800/118758 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe1cc002d00 con 0x7fe1c8035110 2023-10-03T10:11:48.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.360+0000 7fe1d6ffd700 1 -- 172.21.15.146:0/2290371247 <== osd.0 v1:172.21.15.146:6800/118758 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1454964136) 0x7fe1cc002d00 con 0x7fe1c8035110 2023-10-03T10:11:48.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.360+0000 7fe1ecb0e700 1 -- 172.21.15.146:0/2290371247 >> v1:172.21.15.146:6800/118758 conn(0x7fe1c8035110 legacy=0x7fe1c80375a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.360+0000 7fe1ecb0e700 1 -- 172.21.15.146:0/2290371247 >> v1:172.21.15.146:6816/118159 conn(0x7fe1c802c1b0 legacy=0x7fe1c802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:48.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.360+0000 7fe1ecb0e700 1 -- 172.21.15.146:0/2290371247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e80a1230 msgr2=0x7fe1e8137600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.360+0000 7fe1ecb0e700 1 --2- 172.21.15.146:0/2290371247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e80a1230 0x7fe1e8137600 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00e870 tx=0x7fe1dc00eb80 comp rx=0 tx=0).stop 2023-10-03T10:11:48.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.360+0000 7fe1e6d9d700 1 -- 172.21.15.146:0/2290371247 reap_dead start 2023-10-03T10:11:48.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.363+0000 7fe1ecb0e700 1 -- 172.21.15.146:0/2290371247 shutdown_connections 2023-10-03T10:11:48.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.363+0000 7fe1ecb0e700 1 -- 172.21.15.146:0/2290371247 >> 172.21.15.146:0/2290371247 conn(0x7fe1e80a2980 msgr2=0x7fe1e8071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:48.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.363+0000 7fe1ecb0e700 1 -- 172.21.15.146:0/2290371247 shutdown_connections 2023-10-03T10:11:48.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.363+0000 7fe1ecb0e700 1 -- 172.21.15.146:0/2290371247 wait complete. 2023-10-03T10:11:48.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.374+0000 7f192c273700 1 Processor -- start 2023-10-03T10:11:48.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.375+0000 7f192c273700 1 -- start start 2023-10-03T10:11:48.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.375+0000 7f192c273700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f192406a770 0x7f19241349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.376+0000 7f192c273700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f192409e070 0x7f192413fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.376+0000 7f192c273700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192409eca0 con 0x7f1924134f00 2023-10-03T10:11:48.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.376+0000 7f192c273700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192409f720 con 0x7f192409e070 2023-10-03T10:11:48.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.376+0000 7f192c273700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192406b480 con 0x7f192406a770 2023-10-03T10:11:48.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.376+0000 7f192a00f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f192406a770 0x7f19241349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.376+0000 7f192a00f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f192406a770 0x7f19241349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58896/0 (socket says 172.21.15.146:58896) 2023-10-03T10:11:48.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.376+0000 7f192a00f700 1 -- 172.21.15.146:0/3810321807 learned_addr learned my addr 172.21.15.146:0/3810321807 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:48.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.375+0000 7f71342dd700 1 Processor -- start 2023-10-03T10:11:48.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.376+0000 7f71342dd700 1 -- start start 2023-10-03T10:11:48.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.376+0000 7f71342dd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f712c09b2d0 0x7f712c098a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.376+0000 7f192a00f700 1 -- 172.21.15.146:0/3810321807 >> v2:172.21.15.146:3300/0 conn(0x7f192409e070 msgr2=0x7f192413fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:48.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.376+0000 7f192a00f700 1 --2- 172.21.15.146:0/3810321807 >> v2:172.21.15.146:3300/0 conn(0x7f192409e070 0x7f192413fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.376+0000 7f192a00f700 1 -- 172.21.15.146:0/3810321807 >> v1:172.21.15.146:6789/0 conn(0x7f1924134f00 legacy=0x7f192409d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:48.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.376+0000 7f192a00f700 1 -- 172.21.15.146:0/3810321807 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19241352d0 con 0x7f192406a770 2023-10-03T10:11:48.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.377+0000 7f192a00f700 1 --2- 172.21.15.146:0/3810321807 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f192406a770 0x7f19241349c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f19200098f0 tx=0x7f1920009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c40eb0ea30d608 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:48.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.376+0000 7f71342dd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f712c090fb0 0x7f712c08d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.376+0000 7f71342dd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712c09a830 con 0x7f712c090470 2023-10-03T10:11:48.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.376+0000 7f71342dd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c09b6a0 con 0x7f712c090fb0 2023-10-03T10:11:48.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.376+0000 7f71342dd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f712c09bac0 con 0x7f712c09b2d0 2023-10-03T10:11:48.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.377+0000 7f713287a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f712c090fb0 0x7f712c08d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.377+0000 7f713287a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f712c090fb0 0x7f712c08d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58906/0 (socket says 172.21.15.146:58906) 2023-10-03T10:11:48.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.377+0000 7f713287a700 1 -- 172.21.15.146:0/2385712414 learned_addr learned my addr 172.21.15.146:0/2385712414 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:48.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.377+0000 7f7132079700 1 --2- 172.21.15.146:0/2385712414 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f712c09b2d0 0x7f712c098a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.378+0000 7f713287a700 1 -- 172.21.15.146:0/2385712414 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f712c09b2d0 msgr2=0x7f712c098a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:48.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.378+0000 7f713287a700 1 --2- 172.21.15.146:0/2385712414 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f712c09b2d0 0x7f712c098a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.378+0000 7f713287a700 1 -- 172.21.15.146:0/2385712414 >> v1:172.21.15.146:6789/0 conn(0x7f712c090470 legacy=0x7f712c0908a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:48.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.378+0000 7f713287a700 1 -- 172.21.15.146:0/2385712414 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c099db0 con 0x7f712c090fb0 2023-10-03T10:11:48.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.378+0000 7f192900d700 1 -- 172.21.15.146:0/3810321807 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920004230 con 0x7f192406a770 2023-10-03T10:11:48.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.378+0000 7f192900d700 1 -- 172.21.15.146:0/3810321807 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1920004390 con 0x7f192406a770 2023-10-03T10:11:48.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.378+0000 7f192900d700 1 -- 172.21.15.146:0/3810321807 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19200036a0 con 0x7f192406a770 2023-10-03T10:11:48.381 INFO:teuthology.orchestra.run.smithi146.stdout:38654705692 2023-10-03T10:11:48.382 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:11:48.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.379+0000 7f192c273700 1 -- 172.21.15.146:0/3810321807 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f192406a770 msgr2=0x7f19241349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.379+0000 7f192c273700 1 --2- 172.21.15.146:0/3810321807 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f192406a770 0x7f19241349c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f19200098f0 tx=0x7f1920009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:48.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.379+0000 7f192c273700 1 -- 172.21.15.146:0/3810321807 shutdown_connections 2023-10-03T10:11:48.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.379+0000 7f192c273700 1 --2- 172.21.15.146:0/3810321807 >> v2:172.21.15.146:3300/0 conn(0x7f192409e070 0x7f192413fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.379+0000 7f192c273700 1 --2- 172.21.15.146:0/3810321807 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f192406a770 0x7f19241349c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.379+0000 7f192c273700 1 -- 172.21.15.146:0/3810321807 >> 172.21.15.146:0/3810321807 conn(0x7f1924099c40 msgr2=0x7f19240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:48.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.379+0000 7f192c273700 1 -- 172.21.15.146:0/3810321807 shutdown_connections 2023-10-03T10:11:48.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.379+0000 7f192c273700 1 -- 172.21.15.146:0/3810321807 wait complete. 2023-10-03T10:11:48.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.378+0000 7f713287a700 1 --2- 172.21.15.146:0/2385712414 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f712c090fb0 0x7f712c08d3e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7124013de0 tx=0x7f7124009710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=719a2a5b3a3ecdb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:48.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.379+0000 7f7131077700 1 -- 172.21.15.146:0/2385712414 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7124004230 con 0x7f712c090fb0 2023-10-03T10:11:48.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.379+0000 7f7131077700 1 -- 172.21.15.146:0/2385712414 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7124004390 con 0x7f712c090fb0 2023-10-03T10:11:48.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.379+0000 7f7131077700 1 -- 172.21.15.146:0/2385712414 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71240128e0 con 0x7f712c090fb0 2023-10-03T10:11:48.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.380+0000 7f71342dd700 1 -- 172.21.15.146:0/2385712414 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f712c090fb0 msgr2=0x7f712c08d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.380+0000 7f71342dd700 1 --2- 172.21.15.146:0/2385712414 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f712c090fb0 0x7f712c08d3e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7124013de0 tx=0x7f7124009710 comp rx=0 tx=0).stop 2023-10-03T10:11:48.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.380+0000 7f192c273700 1 Processor -- start 2023-10-03T10:11:48.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.381+0000 7f192c273700 1 -- start start 2023-10-03T10:11:48.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.381+0000 7f192c273700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f192406a770 0x7f1924133fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.381+0000 7f192c273700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f192409e070 0x7f192411a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.381+0000 7f192c273700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1924134f00 0x7f192411aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.381+0000 7f192c273700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192411c390 con 0x7f1924134f00 2023-10-03T10:11:48.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.381+0000 7f192c273700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192411c1a0 con 0x7f192406a770 2023-10-03T10:11:48.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.381+0000 7f192c273700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f192409f220 con 0x7f192409e070 2023-10-03T10:11:48.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.382+0000 7f192a810700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1924134f00 0x7f192411aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.382+0000 7f192a810700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1924134f00 0x7f192411aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34358/0 (socket says 172.21.15.146:34358) 2023-10-03T10:11:48.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.382+0000 7f192a810700 1 -- 172.21.15.146:0/3388154415 learned_addr learned my addr 172.21.15.146:0/3388154415 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:48.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.382+0000 7f192a00f700 1 --2- 172.21.15.146:0/3388154415 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f192406a770 0x7f1924133fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.382+0000 7f192980e700 1 --2- 172.21.15.146:0/3388154415 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f192409e070 0x7f192411a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.383+0000 7f192a810700 1 -- 172.21.15.146:0/3388154415 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f192409e070 msgr2=0x7f192411a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.383+0000 7f192a810700 1 --2- 172.21.15.146:0/3388154415 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f192409e070 0x7f192411a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.383+0000 7f192a810700 1 -- 172.21.15.146:0/3388154415 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f192406a770 msgr2=0x7f1924133fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.383+0000 7f192a810700 1 --2- 172.21.15.146:0/3388154415 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f192406a770 0x7f1924133fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.383+0000 7f192a810700 1 -- 172.21.15.146:0/3388154415 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1920009550 con 0x7f1924134f00 2023-10-03T10:11:48.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.383+0000 7f192a810700 1 --2- 172.21.15.146:0/3388154415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1924134f00 0x7f192411aad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f191c00b9a0 tx=0x7f191c00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:48.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.384+0000 7f191affd700 1 -- 172.21.15.146:0/3388154415 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c00d850 con 0x7f1924134f00 2023-10-03T10:11:48.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.384+0000 7f191affd700 1 -- 172.21.15.146:0/3388154415 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c00d9d0 con 0x7f1924134f00 2023-10-03T10:11:48.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.384+0000 7f191affd700 1 -- 172.21.15.146:0/3388154415 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c00dd80 con 0x7f1924134f00 2023-10-03T10:11:48.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.384+0000 7f7098ef9700 1 -- 172.21.15.146:0/1341207609 --> v1:172.21.15.146:6805/118775 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f70940997a0 con 0x7f7074035260 2023-10-03T10:11:48.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.384+0000 7f192c273700 1 -- 172.21.15.146:0/3388154415 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1924138bc0 con 0x7f1924134f00 2023-10-03T10:11:48.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.385+0000 7f192c273700 1 -- 172.21.15.146:0/3388154415 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192411c990 con 0x7f1924134f00 2023-10-03T10:11:48.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.385+0000 7f7082ffd700 1 -- 172.21.15.146:0/1341207609 <== osd.2 v1:172.21.15.146:6805/118775 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1172835932) 0x7f70880093f0 con 0x7f7074035260 2023-10-03T10:11:48.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.385+0000 7f192c273700 1 -- 172.21.15.146:0/3388154415 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f192409ad00 con 0x7f1924134f00 2023-10-03T10:11:48.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.380+0000 7f71342dd700 1 -- 172.21.15.146:0/2385712414 shutdown_connections 2023-10-03T10:11:48.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.380+0000 7f71342dd700 1 --2- 172.21.15.146:0/2385712414 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f712c090fb0 0x7f712c08d3e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.380+0000 7f71342dd700 1 --2- 172.21.15.146:0/2385712414 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f712c09b2d0 0x7f712c098a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.380+0000 7f71342dd700 1 -- 172.21.15.146:0/2385712414 >> 172.21.15.146:0/2385712414 conn(0x7f712c0a1ee0 msgr2=0x7f712c0a22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:48.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.380+0000 7f71342dd700 1 -- 172.21.15.146:0/2385712414 shutdown_connections 2023-10-03T10:11:48.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.380+0000 7f71342dd700 1 -- 172.21.15.146:0/2385712414 wait complete. 2023-10-03T10:11:48.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.381+0000 7f71342dd700 1 Processor -- start 2023-10-03T10:11:48.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.381+0000 7f71342dd700 1 -- start start 2023-10-03T10:11:48.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.382+0000 7f71342dd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f712c090470 0x7f712c1de520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.382+0000 7f71342dd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f712c090fb0 0x7f712c1d5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.382+0000 7f71342dd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f712c09b2d0 0x7f712c1d56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.382+0000 7f71342dd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0719e0 con 0x7f712c09b2d0 2023-10-03T10:11:48.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.382+0000 7f71342dd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0722b0 con 0x7f712c090470 2023-10-03T10:11:48.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.382+0000 7f71342dd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0a0f00 con 0x7f712c090fb0 2023-10-03T10:11:48.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.382+0000 7f7131878700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f712c090fb0 0x7f712c1d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.382+0000 7f7131878700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f712c090fb0 0x7f712c1d5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57650/0 (socket says 172.21.15.146:57650) 2023-10-03T10:11:48.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.382+0000 7f7131878700 1 -- 172.21.15.146:0/2004680186 learned_addr learned my addr 172.21.15.146:0/2004680186 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:48.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.382+0000 7f713287a700 1 --2- 172.21.15.146:0/2004680186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f712c09b2d0 0x7f712c1d56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.382+0000 7f7132079700 1 --2- 172.21.15.146:0/2004680186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f712c090470 0x7f712c1de520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.383+0000 7f7131878700 1 -- 172.21.15.146:0/2004680186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f712c090470 msgr2=0x7f712c1de520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.383+0000 7f7131878700 1 --2- 172.21.15.146:0/2004680186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f712c090470 0x7f712c1de520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.383+0000 7f7131878700 1 -- 172.21.15.146:0/2004680186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f712c09b2d0 msgr2=0x7f712c1d56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.383+0000 7f7131878700 1 --2- 172.21.15.146:0/2004680186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f712c09b2d0 0x7f712c1d56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.383+0000 7f7131878700 1 -- 172.21.15.146:0/2004680186 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7124013a10 con 0x7f712c090fb0 2023-10-03T10:11:48.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.383+0000 7f7131878700 1 --2- 172.21.15.146:0/2004680186 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f712c090fb0 0x7f712c1d5160 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f712000c4a0 tx=0x7f712000c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:48.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.383+0000 7f712affd700 1 -- 172.21.15.146:0/2004680186 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71200054e0 con 0x7f712c090fb0 2023-10-03T10:11:48.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.384+0000 7f712affd700 1 -- 172.21.15.146:0/2004680186 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7120003680 con 0x7f712c090fb0 2023-10-03T10:11:48.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.384+0000 7f712affd700 1 -- 172.21.15.146:0/2004680186 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7120003a10 con 0x7f712c090fb0 2023-10-03T10:11:48.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.384+0000 7f71342dd700 1 -- 172.21.15.146:0/2004680186 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712c088130 con 0x7f712c090fb0 2023-10-03T10:11:48.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.386+0000 7f7098ef9700 1 -- 172.21.15.146:0/1341207609 >> v1:172.21.15.146:6805/118775 conn(0x7f7074035260 legacy=0x7f70740376f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.384+0000 7f71342dd700 1 -- 172.21.15.146:0/2004680186 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712c071ff0 con 0x7f712c090fb0 2023-10-03T10:11:48.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.384+0000 7f71342dd700 1 -- 172.21.15.146:0/2004680186 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f712c09add0 con 0x7f712c090fb0 2023-10-03T10:11:48.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.385+0000 7f712affd700 1 -- 172.21.15.146:0/2004680186 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f7120003b70 con 0x7f712c090fb0 2023-10-03T10:11:48.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.385+0000 7f712affd700 1 -- 172.21.15.146:0/2004680186 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f712003a630 con 0x7f712c090fb0 2023-10-03T10:11:48.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.385+0000 7f7132079700 1 -- 172.21.15.146:0/2004680186 >> v1:172.21.15.146:6816/118159 conn(0x7f71180701c0 legacy=0x7f7118072670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:48.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.385+0000 7f712affd700 1 -- 172.21.15.146:0/2004680186 --> v1:172.21.15.146:6804/118774 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f711807ce20 con 0x7f7118079120 2023-10-03T10:11:48.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.385+0000 7f712affd700 1 -- 172.21.15.146:0/2004680186 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7120003e20 con 0x7f712c090fb0 2023-10-03T10:11:48.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.386+0000 7f7098ef9700 1 -- 172.21.15.146:0/1341207609 >> v1:172.21.15.146:6816/118159 conn(0x7f707402c200 legacy=0x7f707402e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:48.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.386+0000 7f7098ef9700 1 -- 172.21.15.146:0/1341207609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7094131960 msgr2=0x7f7094096d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.386+0000 7f7098ef9700 1 --2- 172.21.15.146:0/1341207609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7094131960 0x7f7094096d20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f708c00cb40 tx=0x7f708c00cf00 comp rx=0 tx=0).stop 2023-10-03T10:11:48.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.386+0000 7f7092d9d700 1 -- 172.21.15.146:0/1341207609 reap_dead start 2023-10-03T10:11:48.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.386+0000 7f7098ef9700 1 -- 172.21.15.146:0/1341207609 shutdown_connections 2023-10-03T10:11:48.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.386+0000 7f7098ef9700 1 -- 172.21.15.146:0/1341207609 >> 172.21.15.146:0/1341207609 conn(0x7f70940a2eb0 msgr2=0x7f709406dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:48.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.386+0000 7f7098ef9700 1 -- 172.21.15.146:0/1341207609 shutdown_connections 2023-10-03T10:11:48.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.386+0000 7f7098ef9700 1 -- 172.21.15.146:0/1341207609 wait complete. 2023-10-03T10:11:48.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.386+0000 7f191affd700 1 -- 172.21.15.146:0/3388154415 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f191c00e420 con 0x7f1924134f00 2023-10-03T10:11:48.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.386+0000 7f191affd700 1 -- 172.21.15.146:0/3388154415 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f191c006e40 con 0x7f1924134f00 2023-10-03T10:11:48.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.386+0000 7f192a00f700 1 -- 172.21.15.146:0/3388154415 >> v1:172.21.15.146:6816/118159 conn(0x7f190802c230 legacy=0x7f190802e6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:48.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.386+0000 7f191affd700 1 -- 172.21.15.146:0/3388154415 --> v1:172.21.15.146:6812/118776 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1908038f10 con 0x7f1908035210 2023-10-03T10:11:48.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.386+0000 7f191affd700 1 -- 172.21.15.146:0/3388154415 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f191c00e8b0 con 0x7f1924134f00 2023-10-03T10:11:48.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.387+0000 7f712affd700 1 -- 172.21.15.146:0/2004680186 <== osd.1 v1:172.21.15.146:6804/118774 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f711807ce20 con 0x7f7118079120 2023-10-03T10:11:48.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.390+0000 7f191affd700 1 -- 172.21.15.146:0/3388154415 <== osd.3 v1:172.21.15.146:6812/118776 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f1908038f10 con 0x7f1908035210 2023-10-03T10:11:48.401 INFO:teuthology.orchestra.run.smithi146.stdout:38654705691 2023-10-03T10:11:48.401 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:11:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.405+0000 7f71342dd700 1 -- 172.21.15.146:0/2004680186 --> v1:172.21.15.146:6804/118774 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f712c071ff0 con 0x7f7118079120 2023-10-03T10:11:48.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.405+0000 7f712affd700 1 -- 172.21.15.146:0/2004680186 <== osd.1 v1:172.21.15.146:6804/118774 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1172835932) 0x7f712400c020 con 0x7f7118079120 2023-10-03T10:11:48.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.405+0000 7f71342dd700 1 -- 172.21.15.146:0/2004680186 >> v1:172.21.15.146:6804/118774 conn(0x7f7118079120 legacy=0x7f711807b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.405+0000 7f71342dd700 1 -- 172.21.15.146:0/2004680186 >> v1:172.21.15.146:6816/118159 conn(0x7f71180701c0 legacy=0x7f7118072670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:48.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.405+0000 7f71342dd700 1 -- 172.21.15.146:0/2004680186 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f712c090fb0 msgr2=0x7f712c1d5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.405+0000 7f71342dd700 1 --2- 172.21.15.146:0/2004680186 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f712c090fb0 0x7f712c1d5160 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f712000c4a0 tx=0x7f712000c7b0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.405+0000 7f713287a700 1 -- 172.21.15.146:0/2004680186 reap_dead start 2023-10-03T10:11:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.405+0000 7f71342dd700 1 -- 172.21.15.146:0/2004680186 shutdown_connections 2023-10-03T10:11:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.405+0000 7f71342dd700 1 -- 172.21.15.146:0/2004680186 >> 172.21.15.146:0/2004680186 conn(0x7f712c0a1ee0 msgr2=0x7f712c083280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.406+0000 7f71342dd700 1 -- 172.21.15.146:0/2004680186 shutdown_connections 2023-10-03T10:11:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.406+0000 7f71342dd700 1 -- 172.21.15.146:0/2004680186 wait complete. 2023-10-03T10:11:48.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.407+0000 7f192c273700 1 -- 172.21.15.146:0/3388154415 --> v1:172.21.15.146:6812/118776 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f192409b010 con 0x7f1908035210 2023-10-03T10:11:48.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.408+0000 7f191affd700 1 -- 172.21.15.146:0/3388154415 <== osd.3 v1:172.21.15.146:6812/118776 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1172835932) 0x7f19140012a0 con 0x7f1908035210 2023-10-03T10:11:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.410+0000 7f192c273700 1 -- 172.21.15.146:0/3388154415 >> v1:172.21.15.146:6812/118776 conn(0x7f1908035210 legacy=0x7f19080376a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.410+0000 7f192c273700 1 -- 172.21.15.146:0/3388154415 >> v1:172.21.15.146:6816/118159 conn(0x7f190802c230 legacy=0x7f190802e6e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.410+0000 7f192c273700 1 -- 172.21.15.146:0/3388154415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1924134f00 msgr2=0x7f192411aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.410+0000 7f192c273700 1 --2- 172.21.15.146:0/3388154415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1924134f00 0x7f192411aad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f191c00b9a0 tx=0x7f191c00bcb0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.410+0000 7f192a810700 1 -- 172.21.15.146:0/3388154415 reap_dead start 2023-10-03T10:11:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.410+0000 7f192c273700 1 -- 172.21.15.146:0/3388154415 shutdown_connections 2023-10-03T10:11:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.410+0000 7f192c273700 1 -- 172.21.15.146:0/3388154415 >> 172.21.15.146:0/3388154415 conn(0x7f1924099c40 msgr2=0x7f192409c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:48.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.413+0000 7f192c273700 1 -- 172.21.15.146:0/3388154415 shutdown_connections 2023-10-03T10:11:48.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.413+0000 7f192c273700 1 -- 172.21.15.146:0/3388154415 wait complete. 2023-10-03T10:11:48.420 INFO:teuthology.orchestra.run.smithi146.stdout:38654705691 2023-10-03T10:11:48.421 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:11:48.421 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:48.420+0000 7f2412ef3240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-03T10:11:48.429 INFO:teuthology.orchestra.run.smithi146.stdout:38654705691 2023-10-03T10:11:48.430 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:11:48.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.532+0000 7f2f10701700 1 Processor -- start 2023-10-03T10:11:48.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.532+0000 7f2f10701700 1 -- start start 2023-10-03T10:11:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.532+0000 7f2f10701700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2f0806a770 0x7f2f081349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.532+0000 7f2f10701700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f08134f00 0x7f2f0809d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.532+0000 7f2f10701700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0809eca0 con 0x7f2f0809dea0 2023-10-03T10:11:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.532+0000 7f2f10701700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0809f720 con 0x7f2f0806a770 2023-10-03T10:11:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.532+0000 7f2f10701700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0806b480 con 0x7f2f08134f00 2023-10-03T10:11:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.533+0000 7f2f0dc9c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f08134f00 0x7f2f0809d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.533+0000 7f2f0dc9c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f08134f00 0x7f2f0809d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58948/0 (socket says 172.21.15.146:58948) 2023-10-03T10:11:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.533+0000 7f2f0dc9c700 1 -- 172.21.15.146:0/2846979377 learned_addr learned my addr 172.21.15.146:0/2846979377 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.533+0000 7f2f0e49d700 1 --2- 172.21.15.146:0/2846979377 >> v2:172.21.15.146:3300/0 conn(0x7f2f0806a770 0x7f2f081349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.533+0000 7f2f0dc9c700 1 -- 172.21.15.146:0/2846979377 >> v2:172.21.15.146:3300/0 conn(0x7f2f0806a770 msgr2=0x7f2f081349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.533+0000 7f2f0dc9c700 1 --2- 172.21.15.146:0/2846979377 >> v2:172.21.15.146:3300/0 conn(0x7f2f0806a770 0x7f2f081349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.533+0000 7f2f0dc9c700 1 -- 172.21.15.146:0/2846979377 >> v1:172.21.15.146:6789/0 conn(0x7f2f0809dea0 legacy=0x7f2f0813ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:48.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.533+0000 7f2f0dc9c700 1 -- 172.21.15.146:0/2846979377 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f081352d0 con 0x7f2f08134f00 2023-10-03T10:11:48.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.533+0000 7f2f0dc9c700 1 --2- 172.21.15.146:0/2846979377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f08134f00 0x7f2f0809d960 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80098f0 tx=0x7f2ef8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bdd73a58032d53a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.534+0000 7f2f0d49b700 1 -- 172.21.15.146:0/2846979377 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8004230 con 0x7f2f08134f00 2023-10-03T10:11:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.534+0000 7f2f0d49b700 1 -- 172.21.15.146:0/2846979377 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef8004390 con 0x7f2f08134f00 2023-10-03T10:11:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.534+0000 7f2f0d49b700 1 -- 172.21.15.146:0/2846979377 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef80036a0 con 0x7f2f08134f00 2023-10-03T10:11:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.534+0000 7f2f10701700 1 -- 172.21.15.146:0/2846979377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f08134f00 msgr2=0x7f2f0809d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.534+0000 7f2f10701700 1 --2- 172.21.15.146:0/2846979377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f08134f00 0x7f2f0809d960 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80098f0 tx=0x7f2ef8009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.534+0000 7f2f10701700 1 -- 172.21.15.146:0/2846979377 shutdown_connections 2023-10-03T10:11:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.534+0000 7f2f10701700 1 --2- 172.21.15.146:0/2846979377 >> v2:172.21.15.146:3300/0 conn(0x7f2f0806a770 0x7f2f081349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.534+0000 7f2f10701700 1 --2- 172.21.15.146:0/2846979377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f08134f00 0x7f2f0809d960 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.534+0000 7f2f10701700 1 -- 172.21.15.146:0/2846979377 >> 172.21.15.146:0/2846979377 conn(0x7f2f08099c40 msgr2=0x7f2f080a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.534+0000 7f2f10701700 1 -- 172.21.15.146:0/2846979377 shutdown_connections 2023-10-03T10:11:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.534+0000 7f2f10701700 1 -- 172.21.15.146:0/2846979377 wait complete. 2023-10-03T10:11:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.536+0000 7f2f10701700 1 Processor -- start 2023-10-03T10:11:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.536+0000 7f2f10701700 1 -- start start 2023-10-03T10:11:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.537+0000 7f2f10701700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f0806a770 0x7f2f081cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.537+0000 7f2f10701700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f0809dea0 0x7f2f081cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.537+0000 7f2f10701700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f08134f00 0x7f2f081ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.537+0000 7f2f10701700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f081cc900 con 0x7f2f0809dea0 2023-10-03T10:11:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.537+0000 7f2f10701700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f08127080 con 0x7f2f0806a770 2023-10-03T10:11:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.537+0000 7f2f10701700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f08071840 con 0x7f2f08134f00 2023-10-03T10:11:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.537+0000 7f2f0dc9c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f0809dea0 0x7f2f081cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.537+0000 7f2f0dc9c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f0809dea0 0x7f2f081cc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34386/0 (socket says 172.21.15.146:34386) 2023-10-03T10:11:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.537+0000 7f2f0dc9c700 1 -- 172.21.15.146:0/1899764426 learned_addr learned my addr 172.21.15.146:0/1899764426 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.537+0000 7f2f0e49d700 1 --2- 172.21.15.146:0/1899764426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f0806a770 0x7f2f081cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.537+0000 7f2f0dc9c700 1 -- 172.21.15.146:0/1899764426 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f08134f00 msgr2=0x7f2f081ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.537+0000 7f2f0dc9c700 1 --2- 172.21.15.146:0/1899764426 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f08134f00 0x7f2f081ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.537+0000 7f2f0dc9c700 1 -- 172.21.15.146:0/1899764426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f0806a770 msgr2=0x7f2f081cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.537+0000 7f2f0dc9c700 1 --2- 172.21.15.146:0/1899764426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f0806a770 0x7f2f081cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.537+0000 7f2f0dc9c700 1 -- 172.21.15.146:0/1899764426 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef8009550 con 0x7f2f0809dea0 2023-10-03T10:11:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.538+0000 7f2f0dc9c700 1 --2- 172.21.15.146:0/1899764426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f0809dea0 0x7f2f081cc3c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2f0806b5c0 tx=0x7f2ef8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.538+0000 7f2efeffd700 1 -- 172.21.15.146:0/1899764426 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8003b50 con 0x7f2f0809dea0 2023-10-03T10:11:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.538+0000 7f2efeffd700 1 -- 172.21.15.146:0/1899764426 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef801f070 con 0x7f2f0809dea0 2023-10-03T10:11:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.538+0000 7f2f10701700 1 -- 172.21.15.146:0/1899764426 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f08126370 con 0x7f2f0809dea0 2023-10-03T10:11:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.538+0000 7f2efeffd700 1 -- 172.21.15.146:0/1899764426 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef800b660 con 0x7f2f0809dea0 2023-10-03T10:11:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.538+0000 7f2f10701700 1 -- 172.21.15.146:0/1899764426 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f080a01b0 con 0x7f2f0809dea0 2023-10-03T10:11:48.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.539+0000 7f2f10701700 1 -- 172.21.15.146:0/1899764426 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0804f2a0 con 0x7f2f0809dea0 2023-10-03T10:11:48.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.540+0000 7f2efeffd700 1 -- 172.21.15.146:0/1899764426 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f2ef8021030 con 0x7f2f0809dea0 2023-10-03T10:11:48.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.540+0000 7f2efeffd700 1 -- 172.21.15.146:0/1899764426 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f2ef803d110 con 0x7f2f0809dea0 2023-10-03T10:11:48.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.540+0000 7f2f0e49d700 1 -- 172.21.15.146:0/1899764426 >> v1:172.21.15.146:6816/118159 conn(0x7f2eec02c1b0 legacy=0x7f2eec02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:48.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.548+0000 7f2efeffd700 1 -- 172.21.15.146:0/1899764426 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f2ef800b7c0 con 0x7f2f0809dea0 2023-10-03T10:11:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.575+0000 7f59414df700 1 Processor -- start 2023-10-03T10:11:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.575+0000 7f59414df700 1 -- start start 2023-10-03T10:11:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.576+0000 7f59414df700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f593c09d860 0x7f593c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.576+0000 7f59414df700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f593c09e170 0x7f593c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.576+0000 7f59414df700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f593c130ce0 0x7f593c131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.576+0000 7f59414df700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593c131670 con 0x7f593c09d860 2023-10-03T10:11:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.576+0000 7f59414df700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c09aaa0 con 0x7f593c130ce0 2023-10-03T10:11:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.576+0000 7f59414df700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f593c09f870 con 0x7f593c09e170 2023-10-03T10:11:48.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.577+0000 7f593affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f593c09d860 0x7f593c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.577+0000 7f593affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f593c09d860 0x7f593c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34388/0 (socket says 172.21.15.146:34388) 2023-10-03T10:11:48.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.577+0000 7f593affd700 1 -- 172.21.15.146:0/573902794 learned_addr learned my addr 172.21.15.146:0/573902794 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:48.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.577+0000 7f593a7fc700 1 --2- 172.21.15.146:0/573902794 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f593c09e170 0x7f593c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.577+0000 7f593b7fe700 1 --2- 172.21.15.146:0/573902794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f593c130ce0 0x7f593c131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.577+0000 7f593a7fc700 1 -- 172.21.15.146:0/573902794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f593c130ce0 msgr2=0x7f593c131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:48.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.577+0000 7f593a7fc700 1 --2- 172.21.15.146:0/573902794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f593c130ce0 0x7f593c131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.577+0000 7f593a7fc700 1 -- 172.21.15.146:0/573902794 >> v2:172.21.15.146:3300/0 conn(0x7f593c09d860 msgr2=0x7f593c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:48.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.577+0000 7f593a7fc700 1 --2- 172.21.15.146:0/573902794 >> v2:172.21.15.146:3300/0 conn(0x7f593c09d860 0x7f593c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.577+0000 7f593a7fc700 1 -- 172.21.15.146:0/573902794 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c09b360 con 0x7f593c09e170 2023-10-03T10:11:48.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.577+0000 7f593a7fc700 1 --2- 172.21.15.146:0/573902794 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f593c09e170 0x7f593c1307a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5930009870 tx=0x7f5930009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b791a37296cbad9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:48.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.577+0000 7f5939ffb700 1 -- 172.21.15.146:0/573902794 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5930012b80 con 0x7f593c09e170 2023-10-03T10:11:48.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.577+0000 7f5939ffb700 1 -- 172.21.15.146:0/573902794 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5930012ce0 con 0x7f593c09e170 2023-10-03T10:11:48.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.577+0000 7f5939ffb700 1 -- 172.21.15.146:0/573902794 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593001b620 con 0x7f593c09e170 2023-10-03T10:11:48.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.578+0000 7f59414df700 1 -- 172.21.15.146:0/573902794 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f593c09e170 msgr2=0x7f593c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.578+0000 7f59414df700 1 --2- 172.21.15.146:0/573902794 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f593c09e170 0x7f593c1307a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5930009870 tx=0x7f5930009b80 comp rx=0 tx=0).stop 2023-10-03T10:11:48.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.579+0000 7f59414df700 1 -- 172.21.15.146:0/573902794 shutdown_connections 2023-10-03T10:11:48.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.579+0000 7f59414df700 1 --2- 172.21.15.146:0/573902794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f593c130ce0 0x7f593c131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.579+0000 7f59414df700 1 --2- 172.21.15.146:0/573902794 >> v2:172.21.15.146:3300/0 conn(0x7f593c09d860 0x7f593c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.579+0000 7f59414df700 1 --2- 172.21.15.146:0/573902794 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f593c09e170 0x7f593c1307a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.579+0000 7f59414df700 1 -- 172.21.15.146:0/573902794 >> 172.21.15.146:0/573902794 conn(0x7f593c099c40 msgr2=0x7f593c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:48.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.579+0000 7f59414df700 1 -- 172.21.15.146:0/573902794 shutdown_connections 2023-10-03T10:11:48.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.579+0000 7f59414df700 1 -- 172.21.15.146:0/573902794 wait complete. 2023-10-03T10:11:48.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.580+0000 7f59414df700 1 Processor -- start 2023-10-03T10:11:48.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.580+0000 7f59414df700 1 -- start start 2023-10-03T10:11:48.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.581+0000 7f59414df700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f593c09d860 0x7f593c1255d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.581+0000 7f59414df700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f593c09e170 0x7f593c125b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.581+0000 7f59414df700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f593c130ce0 0x7f593c126050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.581+0000 7f59414df700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c1290f0 con 0x7f593c09e170 2023-10-03T10:11:48.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.581+0000 7f59414df700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c1271e0 con 0x7f593c09d860 2023-10-03T10:11:48.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.581+0000 7f59414df700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f593c0a06d0 con 0x7f593c130ce0 2023-10-03T10:11:48.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.581+0000 7f593affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f593c09d860 0x7f593c1255d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.581+0000 7f593affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f593c09d860 0x7f593c1255d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58960/0 (socket says 172.21.15.146:58960) 2023-10-03T10:11:48.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.581+0000 7f593b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f593c130ce0 0x7f593c126050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.581+0000 7f593affd700 1 -- 172.21.15.146:0/660566209 learned_addr learned my addr 172.21.15.146:0/660566209 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:48.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.581+0000 7f593a7fc700 1 --2- 172.21.15.146:0/660566209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f593c09e170 0x7f593c125b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.582+0000 7f593affd700 1 -- 172.21.15.146:0/660566209 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f593c130ce0 msgr2=0x7f593c126050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.582+0000 7f593affd700 1 --2- 172.21.15.146:0/660566209 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f593c130ce0 0x7f593c126050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.582+0000 7f593affd700 1 -- 172.21.15.146:0/660566209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f593c09e170 msgr2=0x7f593c125b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.582+0000 7f593affd700 1 --2- 172.21.15.146:0/660566209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f593c09e170 0x7f593c125b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.582+0000 7f593affd700 1 -- 172.21.15.146:0/660566209 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59300094a0 con 0x7f593c09d860 2023-10-03T10:11:48.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.582+0000 7f593affd700 1 --2- 172.21.15.146:0/660566209 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f593c09d860 0x7f593c1255d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f592c00e960 tx=0x7f592c00ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:48.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.582+0000 7f59237fe700 1 -- 172.21.15.146:0/660566209 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c013680 con 0x7f593c09d860 2023-10-03T10:11:48.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.582+0000 7f59237fe700 1 -- 172.21.15.146:0/660566209 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592c0137e0 con 0x7f593c09d860 2023-10-03T10:11:48.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.582+0000 7f59414df700 1 -- 172.21.15.146:0/660566209 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593c09c8b0 con 0x7f593c09d860 2023-10-03T10:11:48.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.582+0000 7f59237fe700 1 -- 172.21.15.146:0/660566209 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c013b50 con 0x7f593c09d860 2023-10-03T10:11:48.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.582+0000 7f59414df700 1 -- 172.21.15.146:0/660566209 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593c1295f0 con 0x7f593c09d860 2023-10-03T10:11:48.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.584+0000 7f59414df700 1 -- 172.21.15.146:0/660566209 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593c128ab0 con 0x7f593c09d860 2023-10-03T10:11:48.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.584+0000 7f59237fe700 1 -- 172.21.15.146:0/660566209 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f592c013cb0 con 0x7f593c09d860 2023-10-03T10:11:48.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.584+0000 7f59237fe700 1 -- 172.21.15.146:0/660566209 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f592c03bca0 con 0x7f593c09d860 2023-10-03T10:11:48.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.584+0000 7f593a7fc700 1 -- 172.21.15.146:0/660566209 >> v1:172.21.15.146:6816/118159 conn(0x7f592802c200 legacy=0x7f592802e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:48.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.592+0000 7f59237fe700 1 -- 172.21.15.146:0/660566209 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f593c128ab0 con 0x7f593c09d860 2023-10-03T10:11:48.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.621+0000 7fbe78506700 1 Processor -- start 2023-10-03T10:11:48.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.621+0000 7fbe78506700 1 -- start start 2023-10-03T10:11:48.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.622+0000 7fbe78506700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbe70133660 0x7fbe70135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.622+0000 7fbe78506700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe70135f80 0x7fbe70138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.622+0000 7fbe78506700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe70099a60 con 0x7fbe70099e20 2023-10-03T10:11:48.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.622+0000 7fbe78506700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7009bf50 con 0x7fbe70133660 2023-10-03T10:11:48.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.622+0000 7fbe78506700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7009b230 con 0x7fbe70135f80 2023-10-03T10:11:48.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.622+0000 7fbe762a2700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbe70099e20 0x7fbe7009a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59940/0 (socket says 172.21.15.146:59940) 2023-10-03T10:11:48.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.622+0000 7fbe762a2700 1 -- 172.21.15.146:0/2529502668 learned_addr learned my addr 172.21.15.146:0/2529502668 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:11:48.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.622+0000 7fbe76aa3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe70135f80 0x7fbe70138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.622+0000 7fbe75aa1700 1 --2- 172.21.15.146:0/2529502668 >> v2:172.21.15.146:3300/0 conn(0x7fbe70133660 0x7fbe70135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.623+0000 7fbe76aa3700 1 -- 172.21.15.146:0/2529502668 >> v2:172.21.15.146:3300/0 conn(0x7fbe70133660 msgr2=0x7fbe70135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:48.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.623+0000 7fbe76aa3700 1 --2- 172.21.15.146:0/2529502668 >> v2:172.21.15.146:3300/0 conn(0x7fbe70133660 0x7fbe70135a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.623+0000 7fbe76aa3700 1 -- 172.21.15.146:0/2529502668 >> v1:172.21.15.146:6789/0 conn(0x7fbe70099e20 legacy=0x7fbe7009a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.623+0000 7fbe752a0700 1 -- 172.21.15.146:0/2529502668 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1668435838 0 0) 0x7fbe70099a60 con 0x7fbe70099e20 2023-10-03T10:11:48.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.623+0000 7fbe76aa3700 1 -- 172.21.15.146:0/2529502668 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7009bb90 con 0x7fbe70135f80 2023-10-03T10:11:48.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.623+0000 7fbe76aa3700 1 --2- 172.21.15.146:0/2529502668 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe70135f80 0x7fbe70138360 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbe68009d90 tx=0x7fbe6800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49e8128d9e9517cf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:48.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.623+0000 7fbe752a0700 1 -- 172.21.15.146:0/2529502668 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6800e070 con 0x7fbe70135f80 2023-10-03T10:11:48.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.623+0000 7fbe752a0700 1 -- 172.21.15.146:0/2529502668 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6800bbd0 con 0x7fbe70135f80 2023-10-03T10:11:48.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.623+0000 7fbe752a0700 1 -- 172.21.15.146:0/2529502668 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe68012430 con 0x7fbe70135f80 2023-10-03T10:11:48.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.624+0000 7fbe78506700 1 -- 172.21.15.146:0/2529502668 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe70135f80 msgr2=0x7fbe70138360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.624+0000 7fbe78506700 1 --2- 172.21.15.146:0/2529502668 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe70135f80 0x7fbe70138360 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbe68009d90 tx=0x7fbe6800b330 comp rx=0 tx=0).stop 2023-10-03T10:11:48.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.624+0000 7fbe78506700 1 -- 172.21.15.146:0/2529502668 shutdown_connections 2023-10-03T10:11:48.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.624+0000 7fbe78506700 1 --2- 172.21.15.146:0/2529502668 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe70135f80 0x7fbe70138360 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.624+0000 7fbe78506700 1 --2- 172.21.15.146:0/2529502668 >> v2:172.21.15.146:3300/0 conn(0x7fbe70133660 0x7fbe70135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.624+0000 7fbe78506700 1 -- 172.21.15.146:0/2529502668 >> 172.21.15.146:0/2529502668 conn(0x7fbe700a2980 msgr2=0x7fbe700a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:48.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.624+0000 7fbe78506700 1 -- 172.21.15.146:0/2529502668 shutdown_connections 2023-10-03T10:11:48.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.624+0000 7fbe78506700 1 -- 172.21.15.146:0/2529502668 wait complete. 2023-10-03T10:11:48.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.626+0000 7fbe78506700 1 Processor -- start 2023-10-03T10:11:48.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.626+0000 7fbe78506700 1 -- start start 2023-10-03T10:11:48.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.626+0000 7fbe78506700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe70099e20 0x7fbe701c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.627+0000 7fbe78506700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe70133660 0x7fbe701c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.627+0000 7fbe78506700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe70135f80 0x7fbe7012d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.627+0000 7fbe78506700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe701390c0 con 0x7fbe70135f80 2023-10-03T10:11:48.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.627+0000 7fbe78506700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7006ed00 con 0x7fbe70133660 2023-10-03T10:11:48.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.627+0000 7fbe78506700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7009b470 con 0x7fbe70099e20 2023-10-03T10:11:48.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.627+0000 7fbe762a2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe70099e20 0x7fbe701c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.627+0000 7fbe762a2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe70099e20 0x7fbe701c84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57690/0 (socket says 172.21.15.146:57690) 2023-10-03T10:11:48.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.627+0000 7fbe762a2700 1 -- 172.21.15.146:0/2438849121 learned_addr learned my addr 172.21.15.146:0/2438849121 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:48.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.627+0000 7fbe76aa3700 1 --2- 172.21.15.146:0/2438849121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe70135f80 0x7fbe7012d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.627+0000 7fbe75aa1700 1 --2- 172.21.15.146:0/2438849121 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe70133660 0x7fbe701c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.627+0000 7fbe762a2700 1 -- 172.21.15.146:0/2438849121 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe70133660 msgr2=0x7fbe701c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.627+0000 7fbe762a2700 1 --2- 172.21.15.146:0/2438849121 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe70133660 0x7fbe701c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.627+0000 7fbe762a2700 1 -- 172.21.15.146:0/2438849121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe70135f80 msgr2=0x7fbe7012d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.627+0000 7fbe762a2700 1 --2- 172.21.15.146:0/2438849121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe70135f80 0x7fbe7012d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.627+0000 7fbe762a2700 1 -- 172.21.15.146:0/2438849121 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe68009a70 con 0x7fbe70099e20 2023-10-03T10:11:48.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.628+0000 7fbe762a2700 1 --2- 172.21.15.146:0/2438849121 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe70099e20 0x7fbe701c84c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00c6d0 tx=0x7fbe6c00c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:48.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.628+0000 7fbe66ffd700 1 -- 172.21.15.146:0/2438849121 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c0074e0 con 0x7fbe70099e20 2023-10-03T10:11:48.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.628+0000 7fbe66ffd700 1 -- 172.21.15.146:0/2438849121 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c007640 con 0x7fbe70099e20 2023-10-03T10:11:48.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.628+0000 7fbe78506700 1 -- 172.21.15.146:0/2438849121 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7006e640 con 0x7fbe70099e20 2023-10-03T10:11:48.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.628+0000 7fbe66ffd700 1 -- 172.21.15.146:0/2438849121 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c005a70 con 0x7fbe70099e20 2023-10-03T10:11:48.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.628+0000 7fbe78506700 1 -- 172.21.15.146:0/2438849121 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7006f2a0 con 0x7fbe70099e20 2023-10-03T10:11:48.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.629+0000 7fbe66ffd700 1 -- 172.21.15.146:0/2438849121 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fbe6c005bd0 con 0x7fbe70099e20 2023-10-03T10:11:48.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.629+0000 7fbe78506700 1 -- 172.21.15.146:0/2438849121 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe70072480 con 0x7fbe70099e20 2023-10-03T10:11:48.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.629+0000 7fbe66ffd700 1 -- 172.21.15.146:0/2438849121 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fbe6c03f170 con 0x7fbe70099e20 2023-10-03T10:11:48.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.630+0000 7fbe75aa1700 1 -- 172.21.15.146:0/2438849121 >> v1:172.21.15.146:6816/118159 conn(0x7fbe5402c1b0 legacy=0x7fbe5402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:48.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.637+0000 7fbe66ffd700 1 -- 172.21.15.146:0/2438849121 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fbe70072480 con 0x7fbe70099e20 2023-10-03T10:11:48.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.652+0000 7fcfe7a75700 1 Processor -- start 2023-10-03T10:11:48.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.652+0000 7fcfe7a75700 1 -- start start 2023-10-03T10:11:48.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.653+0000 7fcfe7a75700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfe0133ad0 0x7fcfe0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.653+0000 7fcfe7a75700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfe0130bc0 0x7fcfe013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.653+0000 7fcfe7a75700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe006b2d0 con 0x7fcfe01300a0 2023-10-03T10:11:48.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.653+0000 7fcfe7a75700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe0133610 con 0x7fcfe0133ad0 2023-10-03T10:11:48.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.653+0000 7fcfe7a75700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe009a500 con 0x7fcfe0130bc0 2023-10-03T10:11:48.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.653+0000 7fcfe5010700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcfe01300a0 0x7fcfe01304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59942/0 (socket says 172.21.15.146:59942) 2023-10-03T10:11:48.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.653+0000 7fcfe5010700 1 -- 172.21.15.146:0/361473664 learned_addr learned my addr 172.21.15.146:0/361473664 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:11:48.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.653+0000 7fcfe5811700 1 --2- 172.21.15.146:0/361473664 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfe0133ad0 0x7fcfe0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.653+0000 7fcfe6012700 1 --2- 172.21.15.146:0/361473664 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfe0130bc0 0x7fcfe013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.653+0000 7fcfe480f700 1 -- 172.21.15.146:0/361473664 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98574076 0 0) 0x7fcfe006b2d0 con 0x7fcfe01300a0 2023-10-03T10:11:48.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.653+0000 7fcfe480f700 1 -- 172.21.15.146:0/361473664 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfcc0035b0 con 0x7fcfe01300a0 2023-10-03T10:11:48.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.654+0000 7fcfe5811700 1 -- 172.21.15.146:0/361473664 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfe0130bc0 msgr2=0x7fcfe013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:48.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.654+0000 7fcfe5811700 1 --2- 172.21.15.146:0/361473664 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfe0130bc0 0x7fcfe013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.654+0000 7fcfe5811700 1 -- 172.21.15.146:0/361473664 >> v1:172.21.15.146:6789/0 conn(0x7fcfe01300a0 legacy=0x7fcfe01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.654+0000 7fcfe5811700 1 -- 172.21.15.146:0/361473664 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe01338b0 con 0x7fcfe0133ad0 2023-10-03T10:11:48.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.654+0000 7fcfe5811700 1 --2- 172.21.15.146:0/361473664 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfe0133ad0 0x7fcfe0133ea0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc009870 tx=0x7fcfdc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a18e64799095ea87 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:48.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.654+0000 7fcfe480f700 1 -- 172.21.15.146:0/361473664 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc004230 con 0x7fcfe0133ad0 2023-10-03T10:11:48.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.654+0000 7fcfe480f700 1 -- 172.21.15.146:0/361473664 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfdc004390 con 0x7fcfe0133ad0 2023-10-03T10:11:48.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.654+0000 7fcfe480f700 1 -- 172.21.15.146:0/361473664 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc0036a0 con 0x7fcfe0133ad0 2023-10-03T10:11:48.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.655+0000 7fcfe7a75700 1 -- 172.21.15.146:0/361473664 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfe0133ad0 msgr2=0x7fcfe0133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.655+0000 7fcfe7a75700 1 --2- 172.21.15.146:0/361473664 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfe0133ad0 0x7fcfe0133ea0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc009870 tx=0x7fcfdc009b80 comp rx=0 tx=0).stop 2023-10-03T10:11:48.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.655+0000 7fcfe7a75700 1 -- 172.21.15.146:0/361473664 shutdown_connections 2023-10-03T10:11:48.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.655+0000 7fcfe7a75700 1 --2- 172.21.15.146:0/361473664 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfe0130bc0 0x7fcfe013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.655+0000 7fcfe7a75700 1 --2- 172.21.15.146:0/361473664 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfe0133ad0 0x7fcfe0133ea0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.655+0000 7fcfe7a75700 1 -- 172.21.15.146:0/361473664 >> 172.21.15.146:0/361473664 conn(0x7fcfe0099c40 msgr2=0x7fcfe00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:48.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.655+0000 7fcfe7a75700 1 -- 172.21.15.146:0/361473664 shutdown_connections 2023-10-03T10:11:48.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.655+0000 7fcfe7a75700 1 -- 172.21.15.146:0/361473664 wait complete. 2023-10-03T10:11:48.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.657+0000 7fcfe7a75700 1 Processor -- start 2023-10-03T10:11:48.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.657+0000 7fcfe7a75700 1 -- start start 2023-10-03T10:11:48.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.657+0000 7fcfe7a75700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfe01300a0 0x7fcfe011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.657+0000 7fcfe7a75700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfe0130bc0 0x7fcfe011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.657+0000 7fcfe7a75700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfe0133ad0 0x7fcfe011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:48.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.658+0000 7fcfe7a75700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe012dd00 con 0x7fcfe01300a0 2023-10-03T10:11:48.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.658+0000 7fcfe7a75700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe0120a30 con 0x7fcfe0130bc0 2023-10-03T10:11:48.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.658+0000 7fcfe7a75700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe00720e0 con 0x7fcfe0133ad0 2023-10-03T10:11:48.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.658+0000 7fcfe5010700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfe0130bc0 0x7fcfe011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.658+0000 7fcfe5010700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfe0130bc0 0x7fcfe011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58988/0 (socket says 172.21.15.146:58988) 2023-10-03T10:11:48.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.658+0000 7fcfe5010700 1 -- 172.21.15.146:0/2512408267 learned_addr learned my addr 172.21.15.146:0/2512408267 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:48.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.658+0000 7fcfe6012700 1 --2- 172.21.15.146:0/2512408267 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfe0133ad0 0x7fcfe011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.658+0000 7fcfe5811700 1 --2- 172.21.15.146:0/2512408267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfe01300a0 0x7fcfe011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:48.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.658+0000 7fcfe5010700 1 -- 172.21.15.146:0/2512408267 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfe0133ad0 msgr2=0x7fcfe011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.658+0000 7fcfe5010700 1 --2- 172.21.15.146:0/2512408267 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfe0133ad0 0x7fcfe011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.658+0000 7fcfe5010700 1 -- 172.21.15.146:0/2512408267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfe01300a0 msgr2=0x7fcfe011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.658+0000 7fcfe5010700 1 --2- 172.21.15.146:0/2512408267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfe01300a0 0x7fcfe011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.658+0000 7fcfe5010700 1 -- 172.21.15.146:0/2512408267 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc0094a0 con 0x7fcfe0130bc0 2023-10-03T10:11:48.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.658+0000 7fcfe5010700 1 --2- 172.21.15.146:0/2512408267 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfe0130bc0 0x7fcfe011df80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000c450 tx=0x7fcfd000c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:48.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.659+0000 7fcfd67fc700 1 -- 172.21.15.146:0/2512408267 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0004c80 con 0x7fcfe0130bc0 2023-10-03T10:11:48.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.659+0000 7fcfd67fc700 1 -- 172.21.15.146:0/2512408267 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd0004de0 con 0x7fcfe0130bc0 2023-10-03T10:11:48.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.659+0000 7fcfe7a75700 1 -- 172.21.15.146:0/2512408267 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe011fd70 con 0x7fcfe0130bc0 2023-10-03T10:11:48.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.659+0000 7fcfe7a75700 1 -- 172.21.15.146:0/2512408267 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe0071640 con 0x7fcfe0130bc0 2023-10-03T10:11:48.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.659+0000 7fcfd67fc700 1 -- 172.21.15.146:0/2512408267 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0007310 con 0x7fcfe0130bc0 2023-10-03T10:11:48.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.660+0000 7fcfd67fc700 1 -- 172.21.15.146:0/2512408267 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fcfd0007470 con 0x7fcfe0130bc0 2023-10-03T10:11:48.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.660+0000 7fcfe7a75700 1 -- 172.21.15.146:0/2512408267 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc80052e0 con 0x7fcfe0130bc0 2023-10-03T10:11:48.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.660+0000 7fcfd67fc700 1 -- 172.21.15.146:0/2512408267 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fcfd003b400 con 0x7fcfe0130bc0 2023-10-03T10:11:48.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.660+0000 7fcfe5811700 1 -- 172.21.15.146:0/2512408267 >> v1:172.21.15.146:6816/118159 conn(0x7fcfc402c1b0 legacy=0x7fcfc402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:48.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.668+0000 7fcfd67fc700 1 -- 172.21.15.146:0/2512408267 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fcfd0039020 con 0x7fcfe0130bc0 2023-10-03T10:11:48.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.741+0000 7f2f0e49d700 1 -- 172.21.15.146:0/1899764426 >> v1:172.21.15.146:6816/118159 conn(0x7f2eec02c1b0 legacy=0x7f2eec02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:48.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.785+0000 7f593a7fc700 1 -- 172.21.15.146:0/660566209 >> v1:172.21.15.146:6816/118159 conn(0x7f592802c200 legacy=0x7f592802e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:48.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.796+0000 7f2f10701700 1 -- 172.21.15.146:0/1899764426 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2f0804f2a0 con 0x7f2f0809dea0 2023-10-03T10:11:48.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.796+0000 7f2efeffd700 1 -- 172.21.15.146:0/1899764426 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2ef80233d0 con 0x7f2f0809dea0 2023-10-03T10:11:48.796 INFO:teuthology.orchestra.run.smithi146.stdout:38654705691 2023-10-03T10:11:48.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.799+0000 7f2f10701700 1 -- 172.21.15.146:0/1899764426 >> v1:172.21.15.146:6816/118159 conn(0x7f2eec02c1b0 legacy=0x7f2eec02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:48.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.799+0000 7f2f10701700 1 -- 172.21.15.146:0/1899764426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f0809dea0 msgr2=0x7f2f081cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.799+0000 7f2f10701700 1 --2- 172.21.15.146:0/1899764426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f0809dea0 0x7f2f081cc3c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2f0806b5c0 tx=0x7f2ef8004750 comp rx=0 tx=0).stop 2023-10-03T10:11:48.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.800+0000 7f2f10701700 1 -- 172.21.15.146:0/1899764426 shutdown_connections 2023-10-03T10:11:48.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.800+0000 7f2f10701700 1 --2- 172.21.15.146:0/1899764426 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f08134f00 0x7f2f081ccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.800+0000 7f2f10701700 1 --2- 172.21.15.146:0/1899764426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f0806a770 0x7f2f081cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.800+0000 7f2f10701700 1 --2- 172.21.15.146:0/1899764426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f0809dea0 0x7f2f081cc3c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.800+0000 7f2f10701700 1 -- 172.21.15.146:0/1899764426 >> 172.21.15.146:0/1899764426 conn(0x7f2f08099c40 msgr2=0x7f2f0809c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:48.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.800+0000 7f2f10701700 1 -- 172.21.15.146:0/1899764426 shutdown_connections 2023-10-03T10:11:48.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.800+0000 7f2f10701700 1 -- 172.21.15.146:0/1899764426 wait complete. 2023-10-03T10:11:48.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.815+0000 7f59414df700 1 -- 172.21.15.146:0/660566209 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f593c128ab0 con 0x7f593c09d860 2023-10-03T10:11:48.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.815+0000 7f59237fe700 1 -- 172.21.15.146:0/660566209 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f593c128ab0 con 0x7f593c09d860 2023-10-03T10:11:48.815 INFO:teuthology.orchestra.run.smithi146.stdout:38654705690 2023-10-03T10:11:48.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.0 2023-10-03T10:11:48.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.818+0000 7f59414df700 1 -- 172.21.15.146:0/660566209 >> v1:172.21.15.146:6816/118159 conn(0x7f592802c200 legacy=0x7f592802e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:48.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.818+0000 7f59414df700 1 -- 172.21.15.146:0/660566209 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f593c09d860 msgr2=0x7f593c1255d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.818+0000 7f59414df700 1 --2- 172.21.15.146:0/660566209 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f593c09d860 0x7f593c1255d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f592c00e960 tx=0x7f592c00ec70 comp rx=0 tx=0).stop 2023-10-03T10:11:48.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.818+0000 7f59414df700 1 -- 172.21.15.146:0/660566209 shutdown_connections 2023-10-03T10:11:48.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.818+0000 7f59414df700 1 --2- 172.21.15.146:0/660566209 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f593c130ce0 0x7f593c126050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.818+0000 7f59414df700 1 --2- 172.21.15.146:0/660566209 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f593c09d860 0x7f593c1255d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.818+0000 7f59414df700 1 --2- 172.21.15.146:0/660566209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f593c09e170 0x7f593c125b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.818+0000 7f59414df700 1 -- 172.21.15.146:0/660566209 >> 172.21.15.146:0/660566209 conn(0x7f593c099c40 msgr2=0x7f593c12fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:48.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.818+0000 7f59414df700 1 -- 172.21.15.146:0/660566209 shutdown_connections 2023-10-03T10:11:48.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.818+0000 7f59414df700 1 -- 172.21.15.146:0/660566209 wait complete. 2023-10-03T10:11:48.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.831+0000 7fbe75aa1700 1 -- 172.21.15.146:0/2438849121 >> v1:172.21.15.146:6816/118159 conn(0x7fbe5402c1b0 legacy=0x7fbe5402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:48.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.831+0000 7fbe78506700 1 -- 172.21.15.146:0/2438849121 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbe70072480 con 0x7fbe70099e20 2023-10-03T10:11:48.831 INFO:teuthology.orchestra.run.smithi146.stdout:38654705690 2023-10-03T10:11:48.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.831+0000 7fbe66ffd700 1 -- 172.21.15.146:0/2438849121 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbe70072480 con 0x7fbe70099e20 2023-10-03T10:11:48.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.834+0000 7fbe78506700 1 -- 172.21.15.146:0/2438849121 >> v1:172.21.15.146:6816/118159 conn(0x7fbe5402c1b0 legacy=0x7fbe5402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:48.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.834+0000 7fbe78506700 1 -- 172.21.15.146:0/2438849121 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe70099e20 msgr2=0x7fbe701c84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.834+0000 7fbe78506700 1 --2- 172.21.15.146:0/2438849121 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe70099e20 0x7fbe701c84c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00c6d0 tx=0x7fbe6c00c9e0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.834+0000 7fbe78506700 1 -- 172.21.15.146:0/2438849121 shutdown_connections 2023-10-03T10:11:48.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.834+0000 7fbe78506700 1 --2- 172.21.15.146:0/2438849121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe70135f80 0x7fbe7012d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.834+0000 7fbe78506700 1 --2- 172.21.15.146:0/2438849121 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe70099e20 0x7fbe701c84c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.834+0000 7fbe78506700 1 --2- 172.21.15.146:0/2438849121 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe70133660 0x7fbe701c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.834+0000 7fbe78506700 1 -- 172.21.15.146:0/2438849121 >> 172.21.15.146:0/2438849121 conn(0x7fbe700a2980 msgr2=0x7fbe7009f660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:48.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.834+0000 7fbe78506700 1 -- 172.21.15.146:0/2438849121 shutdown_connections 2023-10-03T10:11:48.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.834+0000 7fbe78506700 1 -- 172.21.15.146:0/2438849121 wait complete. 2023-10-03T10:11:48.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705690 for osd.2 2023-10-03T10:11:48.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705690 for osd.1 2023-10-03T10:11:48.846 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:48.846+0000 7f2412ef3240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-03T10:11:48.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.861+0000 7fcfe5811700 1 -- 172.21.15.146:0/2512408267 >> v1:172.21.15.146:6816/118159 conn(0x7fcfc402c1b0 legacy=0x7fcfc402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:48.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.871+0000 7fcfe7a75700 1 -- 172.21.15.146:0/2512408267 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcfc8005590 con 0x7fcfe0130bc0 2023-10-03T10:11:48.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.871+0000 7fcfd67fc700 1 -- 172.21.15.146:0/2512408267 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcfd00123b0 con 0x7fcfe0130bc0 2023-10-03T10:11:48.871 INFO:teuthology.orchestra.run.smithi146.stdout:38654705690 2023-10-03T10:11:48.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.873+0000 7fcfe7a75700 1 -- 172.21.15.146:0/2512408267 >> v1:172.21.15.146:6816/118159 conn(0x7fcfc402c1b0 legacy=0x7fcfc402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:48.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.873+0000 7fcfe7a75700 1 -- 172.21.15.146:0/2512408267 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfe0130bc0 msgr2=0x7fcfe011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:48.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.873+0000 7fcfe7a75700 1 --2- 172.21.15.146:0/2512408267 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfe0130bc0 0x7fcfe011df80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000c450 tx=0x7fcfd000c760 comp rx=0 tx=0).stop 2023-10-03T10:11:48.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.873+0000 7fcfe7a75700 1 -- 172.21.15.146:0/2512408267 shutdown_connections 2023-10-03T10:11:48.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.873+0000 7fcfe7a75700 1 --2- 172.21.15.146:0/2512408267 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfe0133ad0 0x7fcfe011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.873+0000 7fcfe7a75700 1 --2- 172.21.15.146:0/2512408267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfe01300a0 0x7fcfe011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.873+0000 7fcfe7a75700 1 --2- 172.21.15.146:0/2512408267 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfe0130bc0 0x7fcfe011df80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:48.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.873+0000 7fcfe7a75700 1 -- 172.21.15.146:0/2512408267 >> 172.21.15.146:0/2512408267 conn(0x7fcfe0099c40 msgr2=0x7fcfe0132040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:48.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.873+0000 7fcfe7a75700 1 -- 172.21.15.146:0/2512408267 shutdown_connections 2023-10-03T10:11:48.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:48.873+0000 7fcfe7a75700 1 -- 172.21.15.146:0/2512408267 wait complete. 2023-10-03T10:11:48.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705690 for osd.3 2023-10-03T10:11:48.989 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:48.989+0000 7f2412ef3240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-03T10:11:49.061 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:49.061+0000 7f2412ef3240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-03T10:11:49.197 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:49.198+0000 7f2412ef3240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-03T10:11:49.266 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:49.267+0000 7f2412ef3240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-03T10:11:49.424 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:49.425+0000 7f2412ef3240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-03T10:11:49.503 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:49.503+0000 7f2412ef3240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-03T10:11:49.580 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:49.581+0000 7f2412ef3240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-03T10:11:49.676 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:49.676+0000 7f2412ef3240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-03T10:11:49.817 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:11:49.836 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:11:49.847 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:11:49.886 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:11:49.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.964+0000 7f18bb91a700 1 Processor -- start 2023-10-03T10:11:49.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.965+0000 7f18bb91a700 1 -- start start 2023-10-03T10:11:49.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.966+0000 7f18bb91a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18b409a130 0x7f18b409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:49.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.966+0000 7f18bb91a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18b409edb0 0x7f18b409f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:49.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.966+0000 7f18bb91a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b4072b30 con 0x7f18b413c410 2023-10-03T10:11:49.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.966+0000 7f18bb91a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b409a500 con 0x7f18b409a130 2023-10-03T10:11:49.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.966+0000 7f18bb91a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18b409f720 con 0x7f18b409edb0 2023-10-03T10:11:49.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.966+0000 7f18b96b6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18b409a130 0x7f18b409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:49.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.966+0000 7f18b8eb5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18b409edb0 0x7f18b409f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:49.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.966+0000 7f18b96b6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18b409a130 0x7f18b409e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58998/0 (socket says 172.21.15.146:58998) 2023-10-03T10:11:49.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.966+0000 7f18b96b6700 1 -- 172.21.15.146:0/1108338858 learned_addr learned my addr 172.21.15.146:0/1108338858 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:49.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.966+0000 7f18b8eb5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18b409edb0 0x7f18b409f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57718/0 (socket says 172.21.15.146:57718) 2023-10-03T10:11:49.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.966+0000 7f18b8eb5700 1 -- 172.21.15.146:0/1108338858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18b409a130 msgr2=0x7f18b409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:49.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.966+0000 7f18b8eb5700 1 --2- 172.21.15.146:0/1108338858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18b409a130 0x7f18b409e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:49.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.966+0000 7f18b8eb5700 1 -- 172.21.15.146:0/1108338858 >> v1:172.21.15.146:6789/0 conn(0x7f18b413c410 legacy=0x7f18b413e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:49.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.966+0000 7f18b8eb5700 1 -- 172.21.15.146:0/1108338858 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b409fe00 con 0x7f18b409edb0 2023-10-03T10:11:49.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.966+0000 7f18b8eb5700 1 --2- 172.21.15.146:0/1108338858 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18b409edb0 0x7f18b409f1e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f18a4009870 tx=0x7f18a4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=276fba0c12809738 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:49.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.967+0000 7f18abfff700 1 -- 172.21.15.146:0/1108338858 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4011830 con 0x7f18b409edb0 2023-10-03T10:11:49.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.967+0000 7f18abfff700 1 -- 172.21.15.146:0/1108338858 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a4011990 con 0x7f18b409edb0 2023-10-03T10:11:49.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.967+0000 7f18abfff700 1 -- 172.21.15.146:0/1108338858 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4011d20 con 0x7f18b409edb0 2023-10-03T10:11:49.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.967+0000 7f18bb91a700 1 -- 172.21.15.146:0/1108338858 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18b409edb0 msgr2=0x7f18b409f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:49.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.967+0000 7f18bb91a700 1 --2- 172.21.15.146:0/1108338858 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18b409edb0 0x7f18b409f1e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f18a4009870 tx=0x7f18a4009b80 comp rx=0 tx=0).stop 2023-10-03T10:11:49.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.968+0000 7f18bb91a700 1 -- 172.21.15.146:0/1108338858 shutdown_connections 2023-10-03T10:11:49.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.968+0000 7f18bb91a700 1 --2- 172.21.15.146:0/1108338858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18b409a130 0x7f18b409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:49.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.968+0000 7f18bb91a700 1 --2- 172.21.15.146:0/1108338858 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18b409edb0 0x7f18b409f1e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:49.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.968+0000 7f18bb91a700 1 -- 172.21.15.146:0/1108338858 >> 172.21.15.146:0/1108338858 conn(0x7f18b40a4430 msgr2=0x7f18b40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:49.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.968+0000 7f18bb91a700 1 -- 172.21.15.146:0/1108338858 shutdown_connections 2023-10-03T10:11:49.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.968+0000 7f18bb91a700 1 -- 172.21.15.146:0/1108338858 wait complete. 2023-10-03T10:11:49.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.969+0000 7f18bb91a700 1 Processor -- start 2023-10-03T10:11:49.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.969+0000 7f18bb91a700 1 -- start start 2023-10-03T10:11:49.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.970+0000 7f18bb91a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18b409a130 0x7f18b411b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:49.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.970+0000 7f18bb91a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18b409edb0 0x7f18b411b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:49.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.970+0000 7f18bb91a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18b413c410 0x7f18b411be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:49.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.970+0000 7f18bb91a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b411e1d0 con 0x7f18b413c410 2023-10-03T10:11:49.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.970+0000 7f18bb91a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b413c200 con 0x7f18b409edb0 2023-10-03T10:11:49.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.970+0000 7f18bb91a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18b40a3af0 con 0x7f18b409a130 2023-10-03T10:11:49.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.970+0000 7f18b8eb5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18b409edb0 0x7f18b411b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:49.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.970+0000 7f18b8eb5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18b409edb0 0x7f18b411b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59014/0 (socket says 172.21.15.146:59014) 2023-10-03T10:11:49.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.970+0000 7f18b8eb5700 1 -- 172.21.15.146:0/835703005 learned_addr learned my addr 172.21.15.146:0/835703005 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:49.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.970+0000 7f18b9eb7700 1 --2- 172.21.15.146:0/835703005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18b413c410 0x7f18b411be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:49.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.970+0000 7f18b96b6700 1 --2- 172.21.15.146:0/835703005 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18b409a130 0x7f18b411b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:49.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.970+0000 7f18b9eb7700 1 -- 172.21.15.146:0/835703005 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18b409a130 msgr2=0x7f18b411b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:49.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.970+0000 7f18b9eb7700 1 --2- 172.21.15.146:0/835703005 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18b409a130 0x7f18b411b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:49.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.970+0000 7f18b9eb7700 1 -- 172.21.15.146:0/835703005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18b409edb0 msgr2=0x7f18b411b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:49.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.970+0000 7f18b9eb7700 1 --2- 172.21.15.146:0/835703005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18b409edb0 0x7f18b411b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:49.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.970+0000 7f18b9eb7700 1 -- 172.21.15.146:0/835703005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a40094a0 con 0x7f18b413c410 2023-10-03T10:11:49.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.970+0000 7f18b9eb7700 1 --2- 172.21.15.146:0/835703005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18b413c410 0x7f18b411be70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00cb90 tx=0x7f18ac00cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:49.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.971+0000 7f18a9ffb700 1 -- 172.21.15.146:0/835703005 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac003c00 con 0x7f18b413c410 2023-10-03T10:11:49.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.971+0000 7f18a9ffb700 1 -- 172.21.15.146:0/835703005 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ac003d60 con 0x7f18b413c410 2023-10-03T10:11:49.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.971+0000 7f18a9ffb700 1 -- 172.21.15.146:0/835703005 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac00aa60 con 0x7f18b413c410 2023-10-03T10:11:49.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.971+0000 7f18bb91a700 1 -- 172.21.15.146:0/835703005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b411e630 con 0x7f18b413c410 2023-10-03T10:11:49.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.971+0000 7f18bb91a700 1 -- 172.21.15.146:0/835703005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b4128070 con 0x7f18b413c410 2023-10-03T10:11:49.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.972+0000 7f18a9ffb700 1 -- 172.21.15.146:0/835703005 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f18ac00abc0 con 0x7f18b413c410 2023-10-03T10:11:49.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.972+0000 7f18a9ffb700 1 -- 172.21.15.146:0/835703005 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f18ac03b780 con 0x7f18b413c410 2023-10-03T10:11:49.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.972+0000 7f18b96b6700 1 -- 172.21.15.146:0/835703005 >> v1:172.21.15.146:6816/118159 conn(0x7f189802c1b0 legacy=0x7f189802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:49.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.972+0000 7f18bb91a700 1 -- 172.21.15.146:0/835703005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b404f2a0 con 0x7f18b413c410 2023-10-03T10:11:49.973 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:49.974+0000 7f2412ef3240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-03T10:11:49.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:49.977+0000 7f18a9ffb700 1 -- 172.21.15.146:0/835703005 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f18ac0198f0 con 0x7f18b413c410 2023-10-03T10:11:50.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.013+0000 7f6061484700 1 Processor -- start 2023-10-03T10:11:50.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.013+0000 7f6061484700 1 -- start start 2023-10-03T10:11:50.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.014+0000 7f6061484700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f605c06a770 0x7f605c1349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:50.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.014+0000 7f6061484700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f605c134f00 0x7f605c09d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:50.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.014+0000 7f6061484700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f605c09dea0 0x7f605c09e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:50.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.014+0000 7f6061484700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605c06b2e0 con 0x7f605c06a770 2023-10-03T10:11:50.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.014+0000 7f6061484700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605c09eca0 con 0x7f605c134f00 2023-10-03T10:11:50.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.014+0000 7f6061484700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f605c09f720 con 0x7f605c09dea0 2023-10-03T10:11:50.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.014+0000 7f605affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f605c06a770 0x7f605c1349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:50.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.014+0000 7f605affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f605c06a770 0x7f605c1349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34440/0 (socket says 172.21.15.146:34440) 2023-10-03T10:11:50.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.014+0000 7f605affd700 1 -- 172.21.15.146:0/2942106469 learned_addr learned my addr 172.21.15.146:0/2942106469 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.014+0000 7f605b7fe700 1 --2- 172.21.15.146:0/2942106469 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f605c09dea0 0x7f605c09e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.014+0000 7f605affd700 1 -- 172.21.15.146:0/2942106469 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f605c09dea0 msgr2=0x7f605c09e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.014+0000 7f605affd700 1 --2- 172.21.15.146:0/2942106469 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f605c09dea0 0x7f605c09e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.014+0000 7f605affd700 1 -- 172.21.15.146:0/2942106469 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f605c134f00 msgr2=0x7f605c09d960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:11:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.014+0000 7f605affd700 1 --2- 172.21.15.146:0/2942106469 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f605c134f00 0x7f605c09d960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.014+0000 7f605affd700 1 -- 172.21.15.146:0/2942106469 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c06b480 con 0x7f605c06a770 2023-10-03T10:11:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.015+0000 7f605affd700 1 --2- 172.21.15.146:0/2942106469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f605c06a770 0x7f605c1349c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f604c0098f0 tx=0x7f604c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13219f51bc746e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.015+0000 7f6059ffb700 1 -- 172.21.15.146:0/2942106469 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c022640 con 0x7f605c06a770 2023-10-03T10:11:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.015+0000 7f6059ffb700 1 -- 172.21.15.146:0/2942106469 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604c0227a0 con 0x7f605c06a770 2023-10-03T10:11:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.015+0000 7f6059ffb700 1 -- 172.21.15.146:0/2942106469 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c022b30 con 0x7f605c06a770 2023-10-03T10:11:50.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.016+0000 7f6061484700 1 -- 172.21.15.146:0/2942106469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f605c06a770 msgr2=0x7f605c1349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:50.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.016+0000 7f6061484700 1 --2- 172.21.15.146:0/2942106469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f605c06a770 0x7f605c1349c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f604c0098f0 tx=0x7f604c009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:50.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.016+0000 7f6061484700 1 -- 172.21.15.146:0/2942106469 shutdown_connections 2023-10-03T10:11:50.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.016+0000 7f6061484700 1 --2- 172.21.15.146:0/2942106469 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f605c09dea0 0x7f605c09e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.016+0000 7f6061484700 1 --2- 172.21.15.146:0/2942106469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f605c06a770 0x7f605c1349c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.016+0000 7f6061484700 1 --2- 172.21.15.146:0/2942106469 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f605c134f00 0x7f605c09d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.016+0000 7f6061484700 1 -- 172.21.15.146:0/2942106469 >> 172.21.15.146:0/2942106469 conn(0x7f605c099c40 msgr2=0x7f605c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:50.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.017+0000 7f6061484700 1 -- 172.21.15.146:0/2942106469 shutdown_connections 2023-10-03T10:11:50.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.017+0000 7f6061484700 1 -- 172.21.15.146:0/2942106469 wait complete. 2023-10-03T10:11:50.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.018+0000 7f6061484700 1 Processor -- start 2023-10-03T10:11:50.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.018+0000 7f6061484700 1 -- start start 2023-10-03T10:11:50.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.019+0000 7f6061484700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f605c06a770 0x7f605c1c4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:50.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.019+0000 7f6061484700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f605c09dea0 0x7f605c1c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:50.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.019+0000 7f6061484700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f605c11e8e0 0x7f605c1bd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:50.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.019+0000 7f6061484700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c070de0 con 0x7f605c09dea0 2023-10-03T10:11:50.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.019+0000 7f6061484700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605c134230 con 0x7f605c11e8e0 2023-10-03T10:11:50.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.019+0000 7f6061484700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f605c0a0260 con 0x7f605c06a770 2023-10-03T10:11:50.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.019+0000 7f605b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f605c11e8e0 0x7f605c1bd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:50.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.019+0000 7f605b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f605c11e8e0 0x7f605c1bd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59028/0 (socket says 172.21.15.146:59028) 2023-10-03T10:11:50.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.019+0000 7f605b7fe700 1 -- 172.21.15.146:0/1900057712 learned_addr learned my addr 172.21.15.146:0/1900057712 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:50.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.019+0000 7f605a7fc700 1 --2- 172.21.15.146:0/1900057712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f605c09dea0 0x7f605c1c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:50.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.019+0000 7f605affd700 1 --2- 172.21.15.146:0/1900057712 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f605c06a770 0x7f605c1c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:50.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.020+0000 7f605b7fe700 1 -- 172.21.15.146:0/1900057712 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f605c06a770 msgr2=0x7f605c1c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:50.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.020+0000 7f605b7fe700 1 --2- 172.21.15.146:0/1900057712 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f605c06a770 0x7f605c1c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.020+0000 7f605b7fe700 1 -- 172.21.15.146:0/1900057712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f605c09dea0 msgr2=0x7f605c1c4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:50.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.020+0000 7f605b7fe700 1 --2- 172.21.15.146:0/1900057712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f605c09dea0 0x7f605c1c4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.020+0000 7f605b7fe700 1 -- 172.21.15.146:0/1900057712 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604c009550 con 0x7f605c11e8e0 2023-10-03T10:11:50.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.021+0000 7f605b7fe700 1 --2- 172.21.15.146:0/1900057712 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f605c11e8e0 0x7f605c1bd9c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f605400efc0 tx=0x7f605400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:50.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.023+0000 7f60437fe700 1 -- 172.21.15.146:0/1900057712 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054009ea0 con 0x7f605c11e8e0 2023-10-03T10:11:50.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.023+0000 7f60437fe700 1 -- 172.21.15.146:0/1900057712 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605400f040 con 0x7f605c11e8e0 2023-10-03T10:11:50.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.023+0000 7f6061484700 1 -- 172.21.15.146:0/1900057712 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605c11de90 con 0x7f605c11e8e0 2023-10-03T10:11:50.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.023+0000 7f60437fe700 1 -- 172.21.15.146:0/1900057712 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605400ceb0 con 0x7f605c11e8e0 2023-10-03T10:11:50.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.023+0000 7f6061484700 1 -- 172.21.15.146:0/1900057712 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605c11e100 con 0x7f605c11e8e0 2023-10-03T10:11:50.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.024+0000 7f60437fe700 1 -- 172.21.15.146:0/1900057712 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f6054014480 con 0x7f605c11e8e0 2023-10-03T10:11:50.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.024+0000 7f60437fe700 1 -- 172.21.15.146:0/1900057712 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f605403c2d0 con 0x7f605c11e8e0 2023-10-03T10:11:50.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.024+0000 7f605affd700 1 -- 172.21.15.146:0/1900057712 >> v1:172.21.15.146:6816/118159 conn(0x7f604802c200 legacy=0x7f604802e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:50.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.028+0000 7f6061484700 1 -- 172.21.15.146:0/1900057712 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605c04f2a0 con 0x7f605c11e8e0 2023-10-03T10:11:50.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.032+0000 7f60437fe700 1 -- 172.21.15.146:0/1900057712 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f6054018020 con 0x7f605c11e8e0 2023-10-03T10:11:50.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.035+0000 7ff3de0a2700 1 Processor -- start 2023-10-03T10:11:50.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.035+0000 7ff3de0a2700 1 -- start start 2023-10-03T10:11:50.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.036+0000 7ff3de0a2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3d809f3d0 0x7ff3d8136760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:50.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.036+0000 7ff3de0a2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d8136ca0 0x7ff3d8139080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:50.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.036+0000 7ff3de0a2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d809d470 con 0x7ff3d812e260 2023-10-03T10:11:50.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.036+0000 7ff3de0a2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d812de50 con 0x7ff3d8136ca0 2023-10-03T10:11:50.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.036+0000 7ff3de0a2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d809e090 con 0x7ff3d809f3d0 2023-10-03T10:11:50.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.036+0000 7ff3d77fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff3d812e260 0x7ff3d812e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59954/0 (socket says 172.21.15.146:59954) 2023-10-03T10:11:50.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.036+0000 7ff3d77fe700 1 -- 172.21.15.146:0/3167189419 learned_addr learned my addr 172.21.15.146:0/3167189419 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:11:50.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.036+0000 7ff3d7fff700 1 --2- 172.21.15.146:0/3167189419 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d8136ca0 0x7ff3d8139080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:50.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.036+0000 7ff3d6ffd700 1 --2- 172.21.15.146:0/3167189419 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3d809f3d0 0x7ff3d8136760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:50.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.036+0000 7ff3d7fff700 1 -- 172.21.15.146:0/3167189419 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3d809f3d0 msgr2=0x7ff3d8136760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:50.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.036+0000 7ff3d7fff700 1 --2- 172.21.15.146:0/3167189419 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3d809f3d0 0x7ff3d8136760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.036+0000 7ff3d7fff700 1 -- 172.21.15.146:0/3167189419 >> v1:172.21.15.146:6789/0 conn(0x7ff3d812e260 legacy=0x7ff3d812e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:50.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.036+0000 7ff3d7fff700 1 -- 172.21.15.146:0/3167189419 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d812e0c0 con 0x7ff3d8136ca0 2023-10-03T10:11:50.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.037+0000 7ff3d7fff700 1 --2- 172.21.15.146:0/3167189419 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d8136ca0 0x7ff3d8139080 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0009dc0 tx=0x7ff3d000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=886d3600d2363520 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:50.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.037+0000 7ff3d67fc700 1 -- 172.21.15.146:0/3167189419 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d000e070 con 0x7ff3d8136ca0 2023-10-03T10:11:50.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.037+0000 7ff3d67fc700 1 -- 172.21.15.146:0/3167189419 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d000bbd0 con 0x7ff3d8136ca0 2023-10-03T10:11:50.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.037+0000 7ff3d67fc700 1 -- 172.21.15.146:0/3167189419 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d0012430 con 0x7ff3d8136ca0 2023-10-03T10:11:50.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.038+0000 7ff3de0a2700 1 -- 172.21.15.146:0/3167189419 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d8136ca0 msgr2=0x7ff3d8139080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:50.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.038+0000 7ff3de0a2700 1 --2- 172.21.15.146:0/3167189419 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d8136ca0 0x7ff3d8139080 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0009dc0 tx=0x7ff3d000b330 comp rx=0 tx=0).stop 2023-10-03T10:11:50.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.038+0000 7ff3de0a2700 1 -- 172.21.15.146:0/3167189419 shutdown_connections 2023-10-03T10:11:50.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.038+0000 7ff3de0a2700 1 --2- 172.21.15.146:0/3167189419 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d8136ca0 0x7ff3d8139080 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.038+0000 7ff3de0a2700 1 --2- 172.21.15.146:0/3167189419 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3d809f3d0 0x7ff3d8136760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.038+0000 7ff3de0a2700 1 -- 172.21.15.146:0/3167189419 >> 172.21.15.146:0/3167189419 conn(0x7ff3d8099c40 msgr2=0x7ff3d80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:50.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.041+0000 7ff3de0a2700 1 -- 172.21.15.146:0/3167189419 shutdown_connections 2023-10-03T10:11:50.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.041+0000 7ff3de0a2700 1 -- 172.21.15.146:0/3167189419 wait complete. 2023-10-03T10:11:50.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.041+0000 7ff3de0a2700 1 Processor -- start 2023-10-03T10:11:50.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.042+0000 7ff3de0a2700 1 -- start start 2023-10-03T10:11:50.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.042+0000 7ff3de0a2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3d809f3d0 0x7ff3d809af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:50.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.042+0000 7ff3de0a2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3d812e260 0x7ff3d809b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:50.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.042+0000 7ff3de0a2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d8136ca0 0x7ff3d8134500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:50.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.042+0000 7ff3de0a2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d809bbc0 con 0x7ff3d812e260 2023-10-03T10:11:50.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.042+0000 7ff3de0a2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d8135960 con 0x7ff3d8136ca0 2023-10-03T10:11:50.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.042+0000 7ff3de0a2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d8139240 con 0x7ff3d809f3d0 2023-10-03T10:11:50.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.042+0000 7ff3d7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d8136ca0 0x7ff3d8134500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:50.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.042+0000 7ff3d7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d8136ca0 0x7ff3d8134500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59044/0 (socket says 172.21.15.146:59044) 2023-10-03T10:11:50.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.042+0000 7ff3d7fff700 1 -- 172.21.15.146:0/1986593914 learned_addr learned my addr 172.21.15.146:0/1986593914 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:50.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.042+0000 7ff3d77fe700 1 --2- 172.21.15.146:0/1986593914 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3d809f3d0 0x7ff3d809af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:50.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.043+0000 7ff3d7fff700 1 -- 172.21.15.146:0/1986593914 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3d809f3d0 msgr2=0x7ff3d809af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:50.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.043+0000 7ff3d7fff700 1 --2- 172.21.15.146:0/1986593914 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3d809f3d0 0x7ff3d809af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.043+0000 7ff3d7fff700 1 -- 172.21.15.146:0/1986593914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3d812e260 msgr2=0x7ff3d809b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:50.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.043+0000 7ff3d7fff700 1 --2- 172.21.15.146:0/1986593914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3d812e260 0x7ff3d809b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.043+0000 7ff3d7fff700 1 -- 172.21.15.146:0/1986593914 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d0009a70 con 0x7ff3d8136ca0 2023-10-03T10:11:50.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.043+0000 7ff3d7fff700 1 --2- 172.21.15.146:0/1986593914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d8136ca0 0x7ff3d8134500 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff3d000b370 tx=0x7ff3d0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:50.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.043+0000 7ff3bffff700 1 -- 172.21.15.146:0/1986593914 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d0012430 con 0x7ff3d8136ca0 2023-10-03T10:11:50.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.043+0000 7ff3de0a2700 1 -- 172.21.15.146:0/1986593914 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d812bb10 con 0x7ff3d8136ca0 2023-10-03T10:11:50.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.043+0000 7ff3bffff700 1 -- 172.21.15.146:0/1986593914 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d0020070 con 0x7ff3d8136ca0 2023-10-03T10:11:50.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.043+0000 7ff3bffff700 1 -- 172.21.15.146:0/1986593914 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d0004280 con 0x7ff3d8136ca0 2023-10-03T10:11:50.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.044+0000 7ff3d77fe700 1 --2- 172.21.15.146:0/1986593914 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3d809f3d0 0x7ff3d809af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:50.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.044+0000 7ff3de0a2700 1 -- 172.21.15.146:0/1986593914 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d809c0d0 con 0x7ff3d8136ca0 2023-10-03T10:11:50.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.045+0000 7ff3bdffb700 1 -- 172.21.15.146:0/1986593914 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b80052e0 con 0x7ff3d8136ca0 2023-10-03T10:11:50.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.045+0000 7ff3bffff700 1 -- 172.21.15.146:0/1986593914 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7ff3d00043e0 con 0x7ff3d8136ca0 2023-10-03T10:11:50.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.046+0000 7ff3bffff700 1 -- 172.21.15.146:0/1986593914 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7ff3d0022070 con 0x7ff3d8136ca0 2023-10-03T10:11:50.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.046+0000 7ff3d77fe700 1 -- 172.21.15.146:0/1986593914 >> v1:172.21.15.146:6816/118159 conn(0x7ff3c402c1e0 legacy=0x7ff3c402e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:50.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.048+0000 7fb62c7dc700 1 Processor -- start 2023-10-03T10:11:50.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.048+0000 7fb62c7dc700 1 -- start start 2023-10-03T10:11:50.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.049+0000 7fb62c7dc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb62409e800 0x7fb62412d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:50.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.049+0000 7fb62c7dc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb624130120 0x7fb624130570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:50.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.049+0000 7fb62c7dc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb624130f20 con 0x7fb624130ab0 2023-10-03T10:11:50.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.049+0000 7fb62c7dc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62409b180 con 0x7fb624130120 2023-10-03T10:11:50.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.049+0000 7fb62c7dc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb62409ebd0 con 0x7fb62409e800 2023-10-03T10:11:50.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.049+0000 7fb62a578700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb62409e800 0x7fb62412d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:50.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.049+0000 7fb62ad79700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb624130ab0 0x7fb624137470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59960/0 (socket says 172.21.15.146:59960) 2023-10-03T10:11:50.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.049+0000 7fb62ad79700 1 -- 172.21.15.146:0/757616829 learned_addr learned my addr 172.21.15.146:0/757616829 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:11:50.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.049+0000 7fb629576700 1 -- 172.21.15.146:0/757616829 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3245689214 0 0) 0x7fb624130f20 con 0x7fb624130ab0 2023-10-03T10:11:50.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.049+0000 7fb629576700 1 -- 172.21.15.146:0/757616829 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6100035b0 con 0x7fb624130ab0 2023-10-03T10:11:50.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.050+0000 7fb62a578700 1 -- 172.21.15.146:0/757616829 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb624130120 msgr2=0x7fb624130570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:50.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.050+0000 7fb62a578700 1 --2- 172.21.15.146:0/757616829 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb624130120 0x7fb624130570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.050+0000 7fb62a578700 1 -- 172.21.15.146:0/757616829 >> v1:172.21.15.146:6789/0 conn(0x7fb624130ab0 legacy=0x7fb624137470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:50.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.050+0000 7fb62a578700 1 -- 172.21.15.146:0/757616829 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62409b440 con 0x7fb62409e800 2023-10-03T10:11:50.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.050+0000 7fb62a578700 1 --2- 172.21.15.146:0/757616829 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb62409e800 0x7fb62412d4e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb620009870 tx=0x7fb620009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=273917c30daa52e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:50.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.050+0000 7fb629576700 1 -- 172.21.15.146:0/757616829 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb620011830 con 0x7fb62409e800 2023-10-03T10:11:50.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.050+0000 7fb629576700 1 -- 172.21.15.146:0/757616829 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb620011990 con 0x7fb62409e800 2023-10-03T10:11:50.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.050+0000 7fb629576700 1 -- 172.21.15.146:0/757616829 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb620011d20 con 0x7fb62409e800 2023-10-03T10:11:50.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.051+0000 7fb62c7dc700 1 -- 172.21.15.146:0/757616829 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb62409e800 msgr2=0x7fb62412d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:50.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.051+0000 7fb62c7dc700 1 --2- 172.21.15.146:0/757616829 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb62409e800 0x7fb62412d4e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb620009870 tx=0x7fb620009b80 comp rx=0 tx=0).stop 2023-10-03T10:11:50.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.051+0000 7fb62c7dc700 1 -- 172.21.15.146:0/757616829 shutdown_connections 2023-10-03T10:11:50.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.051+0000 7fb62c7dc700 1 --2- 172.21.15.146:0/757616829 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb62409e800 0x7fb62412d4e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.051+0000 7fb62c7dc700 1 --2- 172.21.15.146:0/757616829 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb624130120 0x7fb624130570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.051+0000 7fb62c7dc700 1 -- 172.21.15.146:0/757616829 >> 172.21.15.146:0/757616829 conn(0x7fb6240a2ef0 msgr2=0x7fb6240a32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:50.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.051+0000 7fb62c7dc700 1 -- 172.21.15.146:0/757616829 shutdown_connections 2023-10-03T10:11:50.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.051+0000 7fb62c7dc700 1 -- 172.21.15.146:0/757616829 wait complete. 2023-10-03T10:11:50.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.051+0000 7ff3bffff700 1 -- 172.21.15.146:0/1986593914 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7ff3d00048d0 con 0x7ff3d8136ca0 2023-10-03T10:11:50.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.052+0000 7fb62c7dc700 1 Processor -- start 2023-10-03T10:11:50.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.052+0000 7fb62c7dc700 1 -- start start 2023-10-03T10:11:50.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.053+0000 7fb62c7dc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb62409e800 0x7fb624119540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:50.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.053+0000 7fb62c7dc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb624130120 0x7fb624119a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:50.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.053+0000 7fb62c7dc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb624130ab0 0x7fb624119fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:50.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.053+0000 7fb62c7dc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62411cd20 con 0x7fb62409e800 2023-10-03T10:11:50.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.053+0000 7fb62c7dc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62409e310 con 0x7fb624130120 2023-10-03T10:11:50.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.053+0000 7fb62c7dc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb62411ae10 con 0x7fb624130ab0 2023-10-03T10:11:50.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.053+0000 7fb62a578700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb62409e800 0x7fb624119540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:50.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.053+0000 7fb62a578700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb62409e800 0x7fb624119540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34462/0 (socket says 172.21.15.146:34462) 2023-10-03T10:11:50.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.053+0000 7fb62a578700 1 -- 172.21.15.146:0/856626478 learned_addr learned my addr 172.21.15.146:0/856626478 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:50.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.053+0000 7fb629d77700 1 --2- 172.21.15.146:0/856626478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb624130120 0x7fb624119a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:50.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.054+0000 7fb62ad79700 1 --2- 172.21.15.146:0/856626478 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb624130ab0 0x7fb624119fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:50.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.054+0000 7fb629d77700 1 -- 172.21.15.146:0/856626478 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb624130ab0 msgr2=0x7fb624119fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:50.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.054+0000 7fb629d77700 1 --2- 172.21.15.146:0/856626478 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb624130ab0 0x7fb624119fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.054+0000 7fb629d77700 1 -- 172.21.15.146:0/856626478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb62409e800 msgr2=0x7fb624119540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:50.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.054+0000 7fb629d77700 1 --2- 172.21.15.146:0/856626478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb62409e800 0x7fb624119540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.054+0000 7fb629d77700 1 -- 172.21.15.146:0/856626478 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6200094a0 con 0x7fb624130120 2023-10-03T10:11:50.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.054+0000 7fb629d77700 1 --2- 172.21.15.146:0/856626478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb624130120 0x7fb624119a80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb62406d6e0 tx=0x7fb61400d940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:50.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.054+0000 7fb61affd700 1 -- 172.21.15.146:0/856626478 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb614010890 con 0x7fb624130120 2023-10-03T10:11:50.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.054+0000 7fb61affd700 1 -- 172.21.15.146:0/856626478 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61400c070 con 0x7fb624130120 2023-10-03T10:11:50.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.054+0000 7fb61affd700 1 -- 172.21.15.146:0/856626478 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb614010c30 con 0x7fb624130120 2023-10-03T10:11:50.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.054+0000 7fb62c7dc700 1 -- 172.21.15.146:0/856626478 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62412a810 con 0x7fb624130120 2023-10-03T10:11:50.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.054+0000 7fb62c7dc700 1 -- 172.21.15.146:0/856626478 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62412a1b0 con 0x7fb624130120 2023-10-03T10:11:50.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.055+0000 7fb62c7dc700 1 -- 172.21.15.146:0/856626478 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62411c6e0 con 0x7fb624130120 2023-10-03T10:11:50.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.056+0000 7fb61affd700 1 -- 172.21.15.146:0/856626478 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fb614022480 con 0x7fb624130120 2023-10-03T10:11:50.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.056+0000 7fb61affd700 1 -- 172.21.15.146:0/856626478 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fb61403b730 con 0x7fb624130120 2023-10-03T10:11:50.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.056+0000 7fb62a578700 1 -- 172.21.15.146:0/856626478 >> v1:172.21.15.146:6816/118159 conn(0x7fb60802c1b0 legacy=0x7fb60802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:50.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.060+0000 7fb61affd700 1 -- 172.21.15.146:0/856626478 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fb614010d90 con 0x7fb624130120 2023-10-03T10:11:50.089 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:50.090+0000 7f2412ef3240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-03T10:11:50.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.173+0000 7f18b96b6700 1 -- 172.21.15.146:0/835703005 >> v1:172.21.15.146:6816/118159 conn(0x7f189802c1b0 legacy=0x7f189802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:50.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.225+0000 7f605affd700 1 -- 172.21.15.146:0/1900057712 >> v1:172.21.15.146:6816/118159 conn(0x7f604802c200 legacy=0x7f604802e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:50.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.238+0000 7ff3bdffb700 1 -- 172.21.15.146:0/1986593914 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff3b8005590 con 0x7ff3d8136ca0 2023-10-03T10:11:50.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.239+0000 7ff3bffff700 1 -- 172.21.15.146:0/1986593914 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff3d0011b80 con 0x7ff3d8136ca0 2023-10-03T10:11:50.238 INFO:teuthology.orchestra.run.smithi146.stdout:38654705690 2023-10-03T10:11:50.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.240+0000 7ff3bdffb700 1 -- 172.21.15.146:0/1986593914 >> v1:172.21.15.146:6816/118159 conn(0x7ff3c402c1e0 legacy=0x7ff3c402e690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:50.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.240+0000 7ff3bdffb700 1 -- 172.21.15.146:0/1986593914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d8136ca0 msgr2=0x7ff3d8134500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:50.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.240+0000 7ff3bdffb700 1 --2- 172.21.15.146:0/1986593914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d8136ca0 0x7ff3d8134500 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff3d000b370 tx=0x7ff3d0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.241+0000 7ff3bdffb700 1 -- 172.21.15.146:0/1986593914 shutdown_connections 2023-10-03T10:11:50.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.241+0000 7ff3bdffb700 1 --2- 172.21.15.146:0/1986593914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d8136ca0 0x7ff3d8134500 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.241+0000 7ff3bdffb700 1 --2- 172.21.15.146:0/1986593914 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3d809f3d0 0x7ff3d809af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.241+0000 7ff3bdffb700 1 --2- 172.21.15.146:0/1986593914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3d812e260 0x7ff3d809b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.241+0000 7ff3bdffb700 1 -- 172.21.15.146:0/1986593914 >> 172.21.15.146:0/1986593914 conn(0x7ff3d8099c40 msgr2=0x7ff3d80a1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:50.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.242+0000 7ff3bdffb700 1 -- 172.21.15.146:0/1986593914 shutdown_connections 2023-10-03T10:11:50.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.244+0000 7ff3bdffb700 1 -- 172.21.15.146:0/1986593914 wait complete. 2023-10-03T10:11:50.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.249+0000 7fb62c7dc700 1 -- 172.21.15.146:0/856626478 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb62411c8a0 con 0x7fb624130120 2023-10-03T10:11:50.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.249+0000 7fb61affd700 1 -- 172.21.15.146:0/856626478 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb62411c8a0 con 0x7fb624130120 2023-10-03T10:11:50.251 INFO:teuthology.orchestra.run.smithi146.stdout:38654705690 2023-10-03T10:11:50.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.251+0000 7fb62c7dc700 1 -- 172.21.15.146:0/856626478 >> v1:172.21.15.146:6816/118159 conn(0x7fb60802c1b0 legacy=0x7fb60802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:50.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.251+0000 7fb62c7dc700 1 -- 172.21.15.146:0/856626478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb624130120 msgr2=0x7fb624119a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:50.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.251+0000 7fb62c7dc700 1 --2- 172.21.15.146:0/856626478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb624130120 0x7fb624119a80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb62406d6e0 tx=0x7fb61400d940 comp rx=0 tx=0).stop 2023-10-03T10:11:50.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.252+0000 7fb62c7dc700 1 -- 172.21.15.146:0/856626478 shutdown_connections 2023-10-03T10:11:50.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.252+0000 7fb62c7dc700 1 --2- 172.21.15.146:0/856626478 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb624130ab0 0x7fb624119fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.252+0000 7fb62c7dc700 1 --2- 172.21.15.146:0/856626478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb62409e800 0x7fb624119540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.252+0000 7fb62c7dc700 1 --2- 172.21.15.146:0/856626478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb624130120 0x7fb624119a80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.252+0000 7fb62c7dc700 1 -- 172.21.15.146:0/856626478 >> 172.21.15.146:0/856626478 conn(0x7fb6240a2ef0 msgr2=0x7fb62409c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:50.252 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:50.253+0000 7f2412ef3240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-03T10:11:50.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.254+0000 7fb62c7dc700 1 -- 172.21.15.146:0/856626478 shutdown_connections 2023-10-03T10:11:50.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.254+0000 7fb62c7dc700 1 -- 172.21.15.146:0/856626478 wait complete. 2023-10-03T10:11:50.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705690 for osd.3 2023-10-03T10:11:50.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705690 for osd.2 2023-10-03T10:11:50.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.288+0000 7f18bb91a700 1 -- 172.21.15.146:0/835703005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f18b406be20 con 0x7f18b413c410 2023-10-03T10:11:50.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.289+0000 7f18a9ffb700 1 -- 172.21.15.146:0/835703005 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f18ac019300 con 0x7f18b413c410 2023-10-03T10:11:50.288 INFO:teuthology.orchestra.run.smithi146.stdout:38654705691 2023-10-03T10:11:50.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.293+0000 7f18bb91a700 1 -- 172.21.15.146:0/835703005 >> v1:172.21.15.146:6816/118159 conn(0x7f189802c1b0 legacy=0x7f189802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:50.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.293+0000 7f18bb91a700 1 -- 172.21.15.146:0/835703005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18b413c410 msgr2=0x7f18b411be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:50.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.293+0000 7f18bb91a700 1 --2- 172.21.15.146:0/835703005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18b413c410 0x7f18b411be70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00cb90 tx=0x7f18ac00cea0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.293+0000 7f18bb91a700 1 -- 172.21.15.146:0/835703005 shutdown_connections 2023-10-03T10:11:50.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.293+0000 7f18bb91a700 1 --2- 172.21.15.146:0/835703005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18b413c410 0x7f18b411be70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.293+0000 7f18bb91a700 1 --2- 172.21.15.146:0/835703005 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18b409a130 0x7f18b411b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.293+0000 7f18bb91a700 1 --2- 172.21.15.146:0/835703005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18b409edb0 0x7f18b411b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.293+0000 7f18bb91a700 1 -- 172.21.15.146:0/835703005 >> 172.21.15.146:0/835703005 conn(0x7f18b40a4430 msgr2=0x7f18b413e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:50.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.293+0000 7f18bb91a700 1 -- 172.21.15.146:0/835703005 shutdown_connections 2023-10-03T10:11:50.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.293+0000 7f18bb91a700 1 -- 172.21.15.146:0/835703005 wait complete. 2023-10-03T10:11:50.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.0 2023-10-03T10:11:50.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.329+0000 7f6061484700 1 -- 172.21.15.146:0/1900057712 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f605c06c3b0 con 0x7f605c11e8e0 2023-10-03T10:11:50.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.329+0000 7f60437fe700 1 -- 172.21.15.146:0/1900057712 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f605402b090 con 0x7f605c11e8e0 2023-10-03T10:11:50.329 INFO:teuthology.orchestra.run.smithi146.stdout:38654705690 2023-10-03T10:11:50.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.331+0000 7f6061484700 1 -- 172.21.15.146:0/1900057712 >> v1:172.21.15.146:6816/118159 conn(0x7f604802c200 legacy=0x7f604802e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:50.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.331+0000 7f6061484700 1 -- 172.21.15.146:0/1900057712 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f605c11e8e0 msgr2=0x7f605c1bd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:50.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.331+0000 7f6061484700 1 --2- 172.21.15.146:0/1900057712 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f605c11e8e0 0x7f605c1bd9c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f605400efc0 tx=0x7f605400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.331+0000 7f6061484700 1 -- 172.21.15.146:0/1900057712 shutdown_connections 2023-10-03T10:11:50.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.331+0000 7f6061484700 1 --2- 172.21.15.146:0/1900057712 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f605c11e8e0 0x7f605c1bd9c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.331+0000 7f6061484700 1 --2- 172.21.15.146:0/1900057712 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f605c06a770 0x7f605c1c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.331+0000 7f6061484700 1 --2- 172.21.15.146:0/1900057712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f605c09dea0 0x7f605c1c4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:50.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.331+0000 7f6061484700 1 -- 172.21.15.146:0/1900057712 >> 172.21.15.146:0/1900057712 conn(0x7f605c099c40 msgr2=0x7f605c09c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:50.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.331+0000 7f6061484700 1 -- 172.21.15.146:0/1900057712 shutdown_connections 2023-10-03T10:11:50.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:50.331+0000 7f6061484700 1 -- 172.21.15.146:0/1900057712 wait complete. 2023-10-03T10:11:50.334 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:50.335+0000 7f2412ef3240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-03T10:11:50.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705690 for osd.1 2023-10-03T10:11:50.975 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:50.975+0000 7f2412ef3240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-03T10:11:51.096 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:51.097+0000 7f2412ef3240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-03T10:11:51.212 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:51.212+0000 7f2412ef3240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-03T10:11:51.258 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:11:51.271 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:11:51.305 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:11:51.343 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:11:51.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.408+0000 7f8ca60c4700 1 Processor -- start 2023-10-03T10:11:51.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.408+0000 7f8ca60c4700 1 -- start start 2023-10-03T10:11:51.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.409+0000 7f8ca60c4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ca0133ad0 0x7f8ca0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:51.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.409+0000 7f8ca60c4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ca01300a0 0x7f8ca01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:51.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.409+0000 7f8ca60c4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca006b2d0 con 0x7f8ca01309f0 2023-10-03T10:11:51.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.409+0000 7f8ca60c4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca0133610 con 0x7f8ca0133ad0 2023-10-03T10:11:51.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.409+0000 7f8ca60c4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca009a500 con 0x7f8ca01300a0 2023-10-03T10:11:51.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.409+0000 7f8c9ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8ca01309f0 0x7f8ca013a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59974/0 (socket says 172.21.15.146:59974) 2023-10-03T10:11:51.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.410+0000 7f8c9effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ca01300a0 0x7f8ca01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:51.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.410+0000 7f8c9ffff700 1 -- 172.21.15.146:0/1644036697 learned_addr learned my addr 172.21.15.146:0/1644036697 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:11:51.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.410+0000 7f8c9f7fe700 1 --2- 172.21.15.146:0/1644036697 >> v2:172.21.15.146:3300/0 conn(0x7f8ca0133ad0 0x7f8ca0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:51.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.410+0000 7f8c9effd700 1 -- 172.21.15.146:0/1644036697 >> v2:172.21.15.146:3300/0 conn(0x7f8ca0133ad0 msgr2=0x7f8ca0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:51.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.410+0000 7f8c9effd700 1 --2- 172.21.15.146:0/1644036697 >> v2:172.21.15.146:3300/0 conn(0x7f8ca0133ad0 0x7f8ca0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.410+0000 7f8c9effd700 1 -- 172.21.15.146:0/1644036697 >> v1:172.21.15.146:6789/0 conn(0x7f8ca01309f0 legacy=0x7f8ca013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:51.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.410+0000 7f8c9effd700 1 -- 172.21.15.146:0/1644036697 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca01338b0 con 0x7f8ca01300a0 2023-10-03T10:11:51.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.410+0000 7f8c9effd700 1 --2- 172.21.15.146:0/1644036697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ca01300a0 0x7f8ca01304b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8c94009840 tx=0x7f8c94009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffa1084ecbd0ac2f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:51.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.412+0000 7f8c9e7fc700 1 -- 172.21.15.146:0/1644036697 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c94011830 con 0x7f8ca01300a0 2023-10-03T10:11:51.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.412+0000 7f8c9e7fc700 1 -- 172.21.15.146:0/1644036697 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c94011990 con 0x7f8ca01300a0 2023-10-03T10:11:51.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.412+0000 7f8c9e7fc700 1 -- 172.21.15.146:0/1644036697 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c94011d20 con 0x7f8ca01300a0 2023-10-03T10:11:51.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.413+0000 7f8ca60c4700 1 -- 172.21.15.146:0/1644036697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ca01300a0 msgr2=0x7f8ca01304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:51.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.413+0000 7f8ca60c4700 1 --2- 172.21.15.146:0/1644036697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ca01300a0 0x7f8ca01304b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8c94009840 tx=0x7f8c94009b50 comp rx=0 tx=0).stop 2023-10-03T10:11:51.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.413+0000 7f8ca60c4700 1 -- 172.21.15.146:0/1644036697 shutdown_connections 2023-10-03T10:11:51.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.413+0000 7f8ca60c4700 1 --2- 172.21.15.146:0/1644036697 >> v2:172.21.15.146:3300/0 conn(0x7f8ca0133ad0 0x7f8ca0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.413+0000 7f8ca60c4700 1 --2- 172.21.15.146:0/1644036697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ca01300a0 0x7f8ca01304b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.413+0000 7f8ca60c4700 1 -- 172.21.15.146:0/1644036697 >> 172.21.15.146:0/1644036697 conn(0x7f8ca0099c40 msgr2=0x7f8ca00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:51.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.413+0000 7f8ca60c4700 1 -- 172.21.15.146:0/1644036697 shutdown_connections 2023-10-03T10:11:51.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.413+0000 7f8ca60c4700 1 -- 172.21.15.146:0/1644036697 wait complete. 2023-10-03T10:11:51.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.414+0000 7f8ca60c4700 1 Processor -- start 2023-10-03T10:11:51.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.415+0000 7f8ca60c4700 1 -- start start 2023-10-03T10:11:51.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.415+0000 7f8ca60c4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8ca01300a0 0x7f8ca00716c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:51.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.415+0000 7f8ca60c4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ca01309f0 0x7f8ca0071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:51.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.415+0000 7f8ca60c4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ca0133ad0 0x7f8ca01cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:51.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.415+0000 7f8ca60c4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca006ecd0 con 0x7f8ca0133ad0 2023-10-03T10:11:51.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.415+0000 7f8ca60c4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca012fd40 con 0x7f8ca01309f0 2023-10-03T10:11:51.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.415+0000 7f8ca60c4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca0070350 con 0x7f8ca01300a0 2023-10-03T10:11:51.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.415+0000 7f8c9ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ca0133ad0 0x7f8ca01cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:51.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.415+0000 7f8c9effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ca01309f0 0x7f8ca0071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:51.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.415+0000 7f8c9ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ca0133ad0 0x7f8ca01cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34490/0 (socket says 172.21.15.146:34490) 2023-10-03T10:11:51.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.415+0000 7f8c9ffff700 1 -- 172.21.15.146:0/4160202259 learned_addr learned my addr 172.21.15.146:0/4160202259 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:51.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.416+0000 7f8c9f7fe700 1 --2- 172.21.15.146:0/4160202259 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8ca01300a0 0x7f8ca00716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:51.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.416+0000 7f8c9ffff700 1 -- 172.21.15.146:0/4160202259 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8ca01300a0 msgr2=0x7f8ca00716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:51.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.416+0000 7f8c9ffff700 1 --2- 172.21.15.146:0/4160202259 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8ca01300a0 0x7f8ca00716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.416+0000 7f8c9ffff700 1 -- 172.21.15.146:0/4160202259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ca01309f0 msgr2=0x7f8ca0071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:51.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.416+0000 7f8c9ffff700 1 --2- 172.21.15.146:0/4160202259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ca01309f0 0x7f8ca0071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.416+0000 7f8c9ffff700 1 -- 172.21.15.146:0/4160202259 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c940094a0 con 0x7f8ca0133ad0 2023-10-03T10:11:51.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.416+0000 7f8c9ffff700 1 --2- 172.21.15.146:0/4160202259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ca0133ad0 0x7f8ca01cc870 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800ca80 tx=0x7f8c9800cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:51.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.416+0000 7f8c87fff700 1 -- 172.21.15.146:0/4160202259 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9800a9e0 con 0x7f8ca0133ad0 2023-10-03T10:11:51.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.417+0000 7f8c87fff700 1 -- 172.21.15.146:0/4160202259 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9800ab40 con 0x7f8ca0133ad0 2023-10-03T10:11:51.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.417+0000 7f8ca60c4700 1 -- 172.21.15.146:0/4160202259 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca006ef10 con 0x7f8ca0133ad0 2023-10-03T10:11:51.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.417+0000 7f8c87fff700 1 -- 172.21.15.146:0/4160202259 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c98012400 con 0x7f8ca0133ad0 2023-10-03T10:11:51.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.417+0000 7f8ca60c4700 1 -- 172.21.15.146:0/4160202259 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca0070630 con 0x7f8ca0133ad0 2023-10-03T10:11:51.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.418+0000 7f8c87fff700 1 -- 172.21.15.146:0/4160202259 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f8c9801b3b0 con 0x7f8ca0133ad0 2023-10-03T10:11:51.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.418+0000 7f8c87fff700 1 -- 172.21.15.146:0/4160202259 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f8c9803b4b0 con 0x7f8ca0133ad0 2023-10-03T10:11:51.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.418+0000 7f8c9f7fe700 1 -- 172.21.15.146:0/4160202259 >> v1:172.21.15.146:6816/118159 conn(0x7f8c8c02c1b0 legacy=0x7f8c8c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:51.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.418+0000 7f8ca60c4700 1 -- 172.21.15.146:0/4160202259 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca0070190 con 0x7f8ca0133ad0 2023-10-03T10:11:51.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.426+0000 7f8c87fff700 1 -- 172.21.15.146:0/4160202259 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f8c980192c0 con 0x7f8ca0133ad0 2023-10-03T10:11:51.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.441+0000 7fec5e5d9700 1 Processor -- start 2023-10-03T10:11:51.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.441+0000 7fec5e5d9700 1 -- start start 2023-10-03T10:11:51.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.442+0000 7fec5e5d9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec5809d860 0x7fec5809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:51.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.442+0000 7fec5e5d9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fec5809e170 0x7fec581307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:51.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.442+0000 7fec5e5d9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5809aaa0 con 0x7fec58130ce0 2023-10-03T10:11:51.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.442+0000 7fec5e5d9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5809f870 con 0x7fec5809e170 2023-10-03T10:11:51.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.442+0000 7fec5e5d9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5809b360 con 0x7fec5809d860 2023-10-03T10:11:51.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.442+0000 7fec57fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec5809d860 0x7fec5809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:51.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.442+0000 7fec57fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec5809d860 0x7fec5809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59098/0 (socket says 172.21.15.146:59098) 2023-10-03T10:11:51.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.442+0000 7fec57fff700 1 -- 172.21.15.146:0/2713496065 learned_addr learned my addr 172.21.15.146:0/2713496065 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:51.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.442+0000 7fec577fe700 1 --2- 172.21.15.146:0/2713496065 >> v2:172.21.15.146:3300/0 conn(0x7fec5809e170 0x7fec581307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:51.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.442+0000 7fec57fff700 1 -- 172.21.15.146:0/2713496065 >> v2:172.21.15.146:3300/0 conn(0x7fec5809e170 msgr2=0x7fec581307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:51.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.442+0000 7fec57fff700 1 --2- 172.21.15.146:0/2713496065 >> v2:172.21.15.146:3300/0 conn(0x7fec5809e170 0x7fec581307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.443+0000 7fec57fff700 1 -- 172.21.15.146:0/2713496065 >> v1:172.21.15.146:6789/0 conn(0x7fec58130ce0 legacy=0x7fec581379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:51.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.443+0000 7fec56ffd700 1 -- 172.21.15.146:0/2713496065 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3225319025 0 0) 0x7fec5809aaa0 con 0x7fec58130ce0 2023-10-03T10:11:51.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.443+0000 7fec57fff700 1 -- 172.21.15.146:0/2713496065 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5809b620 con 0x7fec5809d860 2023-10-03T10:11:51.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.443+0000 7fec577fe700 1 --2- 172.21.15.146:0/2713496065 >> v2:172.21.15.146:3300/0 conn(0x7fec5809e170 0x7fec581307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:51.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.443+0000 7fec57fff700 1 --2- 172.21.15.146:0/2713496065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec5809d860 0x7fec5809dc30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fec480098f0 tx=0x7fec48009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d5df2a95055a3be server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:51.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.443+0000 7fec56ffd700 1 -- 172.21.15.146:0/2713496065 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec48011830 con 0x7fec5809d860 2023-10-03T10:11:51.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.443+0000 7fec56ffd700 1 -- 172.21.15.146:0/2713496065 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec48011990 con 0x7fec5809d860 2023-10-03T10:11:51.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.443+0000 7fec56ffd700 1 -- 172.21.15.146:0/2713496065 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec48011d20 con 0x7fec5809d860 2023-10-03T10:11:51.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.444+0000 7fec5e5d9700 1 -- 172.21.15.146:0/2713496065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec5809d860 msgr2=0x7fec5809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:51.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.444+0000 7fec5e5d9700 1 --2- 172.21.15.146:0/2713496065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec5809d860 0x7fec5809dc30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fec480098f0 tx=0x7fec48009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:51.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.444+0000 7fec5e5d9700 1 -- 172.21.15.146:0/2713496065 shutdown_connections 2023-10-03T10:11:51.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.444+0000 7fec5e5d9700 1 --2- 172.21.15.146:0/2713496065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec5809d860 0x7fec5809dc30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.444+0000 7fec5e5d9700 1 --2- 172.21.15.146:0/2713496065 >> v2:172.21.15.146:3300/0 conn(0x7fec5809e170 0x7fec581307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.444+0000 7fec5e5d9700 1 -- 172.21.15.146:0/2713496065 >> 172.21.15.146:0/2713496065 conn(0x7fec58099c40 msgr2=0x7fec580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:51.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.444+0000 7fec5e5d9700 1 -- 172.21.15.146:0/2713496065 shutdown_connections 2023-10-03T10:11:51.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.444+0000 7fec5e5d9700 1 -- 172.21.15.146:0/2713496065 wait complete. 2023-10-03T10:11:51.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.445+0000 7fec5e5d9700 1 Processor -- start 2023-10-03T10:11:51.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.445+0000 7fec5e5d9700 1 -- start start 2023-10-03T10:11:51.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.446+0000 7fec5e5d9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec5809d860 0x7fec58135fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:51.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.446+0000 7fec5e5d9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec5809e170 0x7fec58136520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:51.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.446+0000 7fec5e5d9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec58130ce0 0x7fec581cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:51.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.446+0000 7fec5e5d9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec58138f60 con 0x7fec5809e170 2023-10-03T10:11:51.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.446+0000 7fec5e5d9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5809c8b0 con 0x7fec58130ce0 2023-10-03T10:11:51.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.446+0000 7fec5e5d9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec581372a0 con 0x7fec5809d860 2023-10-03T10:11:51.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.446+0000 7fec57fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec5809d860 0x7fec58135fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:51.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.446+0000 7fec57fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec5809d860 0x7fec58135fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57784/0 (socket says 172.21.15.146:57784) 2023-10-03T10:11:51.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.446+0000 7fec57fff700 1 -- 172.21.15.146:0/4204921550 learned_addr learned my addr 172.21.15.146:0/4204921550 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:51.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.446+0000 7fec5cb76700 1 --2- 172.21.15.146:0/4204921550 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec58130ce0 0x7fec581cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:51.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.446+0000 7fec577fe700 1 --2- 172.21.15.146:0/4204921550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec5809e170 0x7fec58136520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:51.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.446+0000 7fec577fe700 1 -- 172.21.15.146:0/4204921550 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec5809d860 msgr2=0x7fec58135fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:51.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.446+0000 7fec577fe700 1 --2- 172.21.15.146:0/4204921550 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec5809d860 0x7fec58135fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.446+0000 7fec577fe700 1 -- 172.21.15.146:0/4204921550 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec58130ce0 msgr2=0x7fec581cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:51.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.446+0000 7fec577fe700 1 --2- 172.21.15.146:0/4204921550 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec58130ce0 0x7fec581cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.446+0000 7fec577fe700 1 -- 172.21.15.146:0/4204921550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c0094a0 con 0x7fec5809e170 2023-10-03T10:11:51.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.447+0000 7fec577fe700 1 --2- 172.21.15.146:0/4204921550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec5809e170 0x7fec58136520 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00e980 tx=0x7fec4c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:51.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.447+0000 7fec54ff9700 1 -- 172.21.15.146:0/4204921550 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c00c690 con 0x7fec5809e170 2023-10-03T10:11:51.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.447+0000 7fec54ff9700 1 -- 172.21.15.146:0/4204921550 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4c00c7f0 con 0x7fec5809e170 2023-10-03T10:11:51.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.447+0000 7fec54ff9700 1 -- 172.21.15.146:0/4204921550 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c00cb80 con 0x7fec5809e170 2023-10-03T10:11:51.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.447+0000 7fec5e5d9700 1 -- 172.21.15.146:0/4204921550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec48009550 con 0x7fec5809e170 2023-10-03T10:11:51.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.447+0000 7fec5e5d9700 1 -- 172.21.15.146:0/4204921550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec58136a60 con 0x7fec5809e170 2023-10-03T10:11:51.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.448+0000 7fec54ff9700 1 -- 172.21.15.146:0/4204921550 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fec4c00cce0 con 0x7fec5809e170 2023-10-03T10:11:51.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.448+0000 7fec5e5d9700 1 -- 172.21.15.146:0/4204921550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5804f2a0 con 0x7fec5809e170 2023-10-03T10:11:51.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.449+0000 7fec54ff9700 1 -- 172.21.15.146:0/4204921550 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7fec4c012df0 con 0x7fec5809e170 2023-10-03T10:11:51.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.449+0000 7fec57fff700 1 -- 172.21.15.146:0/4204921550 >> v1:172.21.15.146:6816/118159 conn(0x7fec4402c1b0 legacy=0x7fec4402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:51.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.456+0000 7fec54ff9700 1 -- 172.21.15.146:0/4204921550 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fec4c017070 con 0x7fec5809e170 2023-10-03T10:11:51.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.497+0000 7f3875911700 1 Processor -- start 2023-10-03T10:11:51.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.497+0000 7f3875911700 1 -- start start 2023-10-03T10:11:51.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.498+0000 7f3875911700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f387006a770 0x7f38701343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:51.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.498+0000 7f3875911700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3870134a40 0x7f3870134eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:51.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.498+0000 7f3875911700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3870137920 0x7f3870137d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:51.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.498+0000 7f3875911700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387006ab40 con 0x7f3870137920 2023-10-03T10:11:51.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.498+0000 7f3875911700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387009b000 con 0x7f387006a770 2023-10-03T10:11:51.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.498+0000 7f3875911700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f387006b820 con 0x7f3870134a40 2023-10-03T10:11:51.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.498+0000 7f386e7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3870134a40 0x7f3870134eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:51.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.498+0000 7f386e7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3870134a40 0x7f3870134eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57790/0 (socket says 172.21.15.146:57790) 2023-10-03T10:11:51.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.498+0000 7f386e7fc700 1 -- 172.21.15.146:0/2569992960 learned_addr learned my addr 172.21.15.146:0/2569992960 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:51.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.498+0000 7f386f7fe700 1 --2- 172.21.15.146:0/2569992960 >> v2:172.21.15.146:3300/0 conn(0x7f3870137920 0x7f3870137d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:51.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.498+0000 7f386effd700 1 --2- 172.21.15.146:0/2569992960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f387006a770 0x7f38701343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:51.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.498+0000 7f386f7fe700 1 -- 172.21.15.146:0/2569992960 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3870134a40 msgr2=0x7f3870134eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:51.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.499+0000 7f386f7fe700 1 --2- 172.21.15.146:0/2569992960 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3870134a40 0x7f3870134eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.499+0000 7f386f7fe700 1 -- 172.21.15.146:0/2569992960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f387006a770 msgr2=0x7f38701343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:51.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.499+0000 7f386f7fe700 1 --2- 172.21.15.146:0/2569992960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f387006a770 0x7f38701343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.499+0000 7f386f7fe700 1 -- 172.21.15.146:0/2569992960 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387009eb80 con 0x7f3870137920 2023-10-03T10:11:51.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.499+0000 7f386f7fe700 1 --2- 172.21.15.146:0/2569992960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3870137920 0x7f3870137d70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3868009dc0 tx=0x7f386800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a7f25fc9964850 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:51.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.499+0000 7f386dffb700 1 -- 172.21.15.146:0/2569992960 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386800e070 con 0x7f3870137920 2023-10-03T10:11:51.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.499+0000 7f386dffb700 1 -- 172.21.15.146:0/2569992960 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386800ba80 con 0x7f3870137920 2023-10-03T10:11:51.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.499+0000 7f386dffb700 1 -- 172.21.15.146:0/2569992960 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386800be30 con 0x7f3870137920 2023-10-03T10:11:51.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.499+0000 7f3875911700 1 -- 172.21.15.146:0/2569992960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3870137920 msgr2=0x7f3870137d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:51.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.499+0000 7f3875911700 1 --2- 172.21.15.146:0/2569992960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3870137920 0x7f3870137d70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3868009dc0 tx=0x7f386800b330 comp rx=0 tx=0).stop 2023-10-03T10:11:51.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.500+0000 7f3875911700 1 -- 172.21.15.146:0/2569992960 shutdown_connections 2023-10-03T10:11:51.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.500+0000 7f3875911700 1 --2- 172.21.15.146:0/2569992960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f387006a770 0x7f38701343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.500+0000 7f3875911700 1 --2- 172.21.15.146:0/2569992960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3870137920 0x7f3870137d70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.500+0000 7f3875911700 1 --2- 172.21.15.146:0/2569992960 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3870134a40 0x7f3870134eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.500+0000 7f3875911700 1 -- 172.21.15.146:0/2569992960 >> 172.21.15.146:0/2569992960 conn(0x7f38700a2ef0 msgr2=0x7f38700a32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:51.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.500+0000 7f3875911700 1 -- 172.21.15.146:0/2569992960 shutdown_connections 2023-10-03T10:11:51.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.500+0000 7f3875911700 1 -- 172.21.15.146:0/2569992960 wait complete. 2023-10-03T10:11:51.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.500+0000 7f9fbe19f700 1 Processor -- start 2023-10-03T10:11:51.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.500+0000 7f9fbe19f700 1 -- start start 2023-10-03T10:11:51.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.501+0000 7f9fbe19f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fb8133a70 0x7f9fb8133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:51.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.501+0000 7f3875911700 1 Processor -- start 2023-10-03T10:11:51.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.501+0000 7f9fbe19f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fb80a08e0 0x7f9fb80a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:51.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.501+0000 7f9fbe19f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9fb80a1290 0x7f9fb813a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:51.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.501+0000 7f9fbe19f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb8133640 con 0x7f9fb80a1290 2023-10-03T10:11:51.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.501+0000 7f9fbe19f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb80a1d50 con 0x7f9fb8133a70 2023-10-03T10:11:51.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.501+0000 7f9fbe19f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb80a1730 con 0x7f9fb80a08e0 2023-10-03T10:11:51.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.501+0000 7f9fb6ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fb80a08e0 0x7f9fb80a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:51.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.501+0000 7f9fb6ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fb80a08e0 0x7f9fb80a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57802/0 (socket says 172.21.15.146:57802) 2023-10-03T10:11:51.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.501+0000 7f9fb6ffd700 1 -- 172.21.15.146:0/1042103599 learned_addr learned my addr 172.21.15.146:0/1042103599 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:51.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.501+0000 7f9fb77fe700 1 --2- 172.21.15.146:0/1042103599 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fb8133a70 0x7f9fb8133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:51.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.501+0000 7f9fb6ffd700 1 -- 172.21.15.146:0/1042103599 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fb8133a70 msgr2=0x7f9fb8133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:51.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.501+0000 7f9fb6ffd700 1 --2- 172.21.15.146:0/1042103599 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fb8133a70 0x7f9fb8133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.501+0000 7f9fb6ffd700 1 -- 172.21.15.146:0/1042103599 >> v2:172.21.15.146:3300/0 conn(0x7f9fb80a1290 msgr2=0x7f9fb813a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:51.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.501+0000 7f9fb6ffd700 1 --2- 172.21.15.146:0/1042103599 >> v2:172.21.15.146:3300/0 conn(0x7f9fb80a1290 0x7f9fb813a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.501+0000 7f9fb6ffd700 1 -- 172.21.15.146:0/1042103599 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb809b620 con 0x7f9fb80a08e0 2023-10-03T10:11:51.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.501+0000 7f9fb77fe700 1 --2- 172.21.15.146:0/1042103599 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fb8133a70 0x7f9fb8133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:11:51.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.502+0000 7f9fb6ffd700 1 --2- 172.21.15.146:0/1042103599 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fb80a08e0 0x7f9fb80a0d50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0131e0 tx=0x7f9fac0134f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e268fffcad5beedd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:51.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.502+0000 7f9fb67fc700 1 -- 172.21.15.146:0/1042103599 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac016070 con 0x7f9fb80a08e0 2023-10-03T10:11:51.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.502+0000 7f9fb67fc700 1 -- 172.21.15.146:0/1042103599 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac013e30 con 0x7f9fb80a08e0 2023-10-03T10:11:51.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.502+0000 7f9fb67fc700 1 -- 172.21.15.146:0/1042103599 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac0112f0 con 0x7f9fb80a08e0 2023-10-03T10:11:51.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.501+0000 7f3875911700 1 -- start start 2023-10-03T10:11:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.502+0000 7f3875911700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f387006a770 0x7f387006f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.502+0000 7f3875911700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3870134a40 0x7f387006fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.502+0000 7f3875911700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3870137920 0x7f3870070320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.502+0000 7f3875911700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3870072710 con 0x7f387006a770 2023-10-03T10:11:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.502+0000 7f3875911700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3870070c90 con 0x7f3870137920 2023-10-03T10:11:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.502+0000 7f3875911700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f387009e1f0 con 0x7f3870134a40 2023-10-03T10:11:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.502+0000 7f386f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3870137920 0x7f3870070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.502+0000 7f386f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3870137920 0x7f3870070320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59120/0 (socket says 172.21.15.146:59120) 2023-10-03T10:11:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.502+0000 7f386f7fe700 1 -- 172.21.15.146:0/575758838 learned_addr learned my addr 172.21.15.146:0/575758838 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.502+0000 7f386effd700 1 --2- 172.21.15.146:0/575758838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f387006a770 0x7f387006f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.502+0000 7f386e7fc700 1 --2- 172.21.15.146:0/575758838 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3870134a40 0x7f387006fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:51.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.503+0000 7f9fbe19f700 1 -- 172.21.15.146:0/1042103599 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fb80a08e0 msgr2=0x7f9fb80a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:51.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.503+0000 7f9fbe19f700 1 --2- 172.21.15.146:0/1042103599 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fb80a08e0 0x7f9fb80a0d50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0131e0 tx=0x7f9fac0134f0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.503+0000 7f386effd700 1 -- 172.21.15.146:0/575758838 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3870134a40 msgr2=0x7f387006fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:51.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.503+0000 7f386effd700 1 --2- 172.21.15.146:0/575758838 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3870134a40 0x7f387006fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.503+0000 7f386effd700 1 -- 172.21.15.146:0/575758838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3870137920 msgr2=0x7f3870070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:51.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.503+0000 7f386effd700 1 --2- 172.21.15.146:0/575758838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3870137920 0x7f3870070320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.503+0000 7f386effd700 1 -- 172.21.15.146:0/575758838 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3868009a70 con 0x7f387006a770 2023-10-03T10:11:51.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.503+0000 7f386e7fc700 1 --2- 172.21.15.146:0/575758838 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3870134a40 0x7f387006fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:11:51.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.503+0000 7f9fbe19f700 1 -- 172.21.15.146:0/1042103599 shutdown_connections 2023-10-03T10:11:51.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.503+0000 7f9fbe19f700 1 --2- 172.21.15.146:0/1042103599 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fb8133a70 0x7f9fb8133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.503+0000 7f9fbe19f700 1 --2- 172.21.15.146:0/1042103599 >> v2:172.21.15.146:3300/0 conn(0x7f9fb80a1290 0x7f9fb813a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.503+0000 7f9fbe19f700 1 --2- 172.21.15.146:0/1042103599 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fb80a08e0 0x7f9fb80a0d50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.503+0000 7f9fbe19f700 1 -- 172.21.15.146:0/1042103599 >> 172.21.15.146:0/1042103599 conn(0x7f9fb80a2980 msgr2=0x7f9fb80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:51.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.503+0000 7f386effd700 1 --2- 172.21.15.146:0/575758838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f387006a770 0x7f387006f8a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f386000e900 tx=0x7f386000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:51.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.503+0000 7f9fbe19f700 1 -- 172.21.15.146:0/1042103599 shutdown_connections 2023-10-03T10:11:51.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.503+0000 7f9fbe19f700 1 -- 172.21.15.146:0/1042103599 wait complete. 2023-10-03T10:11:51.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.503+0000 7f3857fff700 1 -- 172.21.15.146:0/575758838 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3860009650 con 0x7f387006a770 2023-10-03T10:11:51.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.504+0000 7f9fbe19f700 1 Processor -- start 2023-10-03T10:11:51.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.503+0000 7f3857fff700 1 -- 172.21.15.146:0/575758838 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386000c850 con 0x7f387006a770 2023-10-03T10:11:51.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.503+0000 7f3875911700 1 -- 172.21.15.146:0/575758838 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3870134050 con 0x7f387006a770 2023-10-03T10:11:51.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.503+0000 7f3857fff700 1 -- 172.21.15.146:0/575758838 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386000cbc0 con 0x7f387006a770 2023-10-03T10:11:51.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.503+0000 7f3875911700 1 -- 172.21.15.146:0/575758838 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38701261c0 con 0x7f387006a770 2023-10-03T10:11:51.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.505+0000 7f3875911700 1 -- 172.21.15.146:0/575758838 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3870126f50 con 0x7f387006a770 2023-10-03T10:11:51.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.505+0000 7f9fbe19f700 1 -- start start 2023-10-03T10:11:51.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.505+0000 7f9fbe19f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fb80a1290 0x7f9fb8118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:51.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.505+0000 7f9fbe19f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fb8133a70 0x7f9fb8119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:51.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.505+0000 7f9fbe19f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fb8071bb0 0x7f9fb8119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:51.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.505+0000 7f9fbe19f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb811c070 con 0x7f9fb80a1290 2023-10-03T10:11:51.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.505+0000 7f9fbe19f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb809a350 con 0x7f9fb8133a70 2023-10-03T10:11:51.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.505+0000 7f9fbe19f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb811a3b0 con 0x7f9fb8071bb0 2023-10-03T10:11:51.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.505+0000 7f9fb6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fb8133a70 0x7f9fb8119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:51.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.505+0000 7f9fb6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fb8133a70 0x7f9fb8119330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59134/0 (socket says 172.21.15.146:59134) 2023-10-03T10:11:51.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.505+0000 7f9fb6ffd700 1 -- 172.21.15.146:0/2420097013 learned_addr learned my addr 172.21.15.146:0/2420097013 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:51.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.506+0000 7f9fb6ffd700 1 -- 172.21.15.146:0/2420097013 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fb8071bb0 msgr2=0x7f9fb8119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:51.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.506+0000 7f9fb6ffd700 1 --2- 172.21.15.146:0/2420097013 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fb8071bb0 0x7f9fb8119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.506+0000 7f9fb6ffd700 1 -- 172.21.15.146:0/2420097013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fb80a1290 msgr2=0x7f9fb8118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:51.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.506+0000 7f9fb6ffd700 1 --2- 172.21.15.146:0/2420097013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fb80a1290 0x7f9fb8118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.506+0000 7f9fb6ffd700 1 -- 172.21.15.146:0/2420097013 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac011df0 con 0x7f9fb8133a70 2023-10-03T10:11:51.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.506+0000 7f9fb6ffd700 1 --2- 172.21.15.146:0/2420097013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fb8133a70 0x7f9fb8119330 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9fac01a000 tx=0x7f9fac004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:51.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.505+0000 7f3857fff700 1 -- 172.21.15.146:0/575758838 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f386000cd20 con 0x7f387006a770 2023-10-03T10:11:51.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.505+0000 7f3857fff700 1 -- 172.21.15.146:0/575758838 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f386003b9d0 con 0x7f387006a770 2023-10-03T10:11:51.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.505+0000 7f386e7fc700 1 -- 172.21.15.146:0/575758838 >> v1:172.21.15.146:6816/118159 conn(0x7f385c02c200 legacy=0x7f385c02e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:51.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.509+0000 7f9f9ffff700 1 -- 172.21.15.146:0/2420097013 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac00b070 con 0x7f9fb8133a70 2023-10-03T10:11:51.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.509+0000 7f9f9ffff700 1 -- 172.21.15.146:0/2420097013 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac01bb20 con 0x7f9fb8133a70 2023-10-03T10:11:51.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.509+0000 7f9f9ffff700 1 -- 172.21.15.146:0/2420097013 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac01beb0 con 0x7f9fb8133a70 2023-10-03T10:11:51.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.509+0000 7f9fbe19f700 1 -- 172.21.15.146:0/2420097013 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb8131e70 con 0x7f9fb8133a70 2023-10-03T10:11:51.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.509+0000 7f9fbe19f700 1 -- 172.21.15.146:0/2420097013 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb811aa80 con 0x7f9fb8133a70 2023-10-03T10:11:51.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.510+0000 7f9fbe19f700 1 -- 172.21.15.146:0/2420097013 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb804f2a0 con 0x7f9fb8133a70 2023-10-03T10:11:51.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.510+0000 7f3857fff700 1 -- 172.21.15.146:0/575758838 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f38600232f0 con 0x7f387006a770 2023-10-03T10:11:51.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.511+0000 7f9f9ffff700 1 -- 172.21.15.146:0/2420097013 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f9fac004030 con 0x7f9fb8133a70 2023-10-03T10:11:51.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.511+0000 7f9f9ffff700 1 -- 172.21.15.146:0/2420097013 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3922+0+0 (secure 0 0 0) 0x7f9fac03c640 con 0x7f9fb8133a70 2023-10-03T10:11:51.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.514+0000 7f9fb77fe700 1 -- 172.21.15.146:0/2420097013 >> v1:172.21.15.146:6816/118159 conn(0x7f9fa402c1b0 legacy=0x7f9fa402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:51.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.514+0000 7f9f9ffff700 1 -- 172.21.15.146:0/2420097013 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f9fac0042e0 con 0x7f9fb8133a70 2023-10-03T10:11:51.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.619+0000 7f8c9f7fe700 1 -- 172.21.15.146:0/4160202259 >> v1:172.21.15.146:6816/118159 conn(0x7f8c8c02c1b0 legacy=0x7f8c8c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:51.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.636+0000 7fec5e5d9700 1 -- 172.21.15.146:0/4204921550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fec5806c3b0 con 0x7fec5809e170 2023-10-03T10:11:51.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.636+0000 7fec54ff9700 1 -- 172.21.15.146:0/4204921550 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fec4c017030 con 0x7fec5809e170 2023-10-03T10:11:51.636 INFO:teuthology.orchestra.run.smithi146.stdout:38654705690 2023-10-03T10:11:51.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.638+0000 7fec5e5d9700 1 -- 172.21.15.146:0/4204921550 >> v1:172.21.15.146:6816/118159 conn(0x7fec4402c1b0 legacy=0x7fec4402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:51.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.638+0000 7fec5e5d9700 1 -- 172.21.15.146:0/4204921550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec5809e170 msgr2=0x7fec58136520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:51.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.638+0000 7fec5e5d9700 1 --2- 172.21.15.146:0/4204921550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec5809e170 0x7fec58136520 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00e980 tx=0x7fec4c00ec90 comp rx=0 tx=0).stop 2023-10-03T10:11:51.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.638+0000 7fec5e5d9700 1 -- 172.21.15.146:0/4204921550 shutdown_connections 2023-10-03T10:11:51.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.638+0000 7fec5e5d9700 1 --2- 172.21.15.146:0/4204921550 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec58130ce0 0x7fec581cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.638+0000 7fec5e5d9700 1 --2- 172.21.15.146:0/4204921550 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec5809d860 0x7fec58135fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.638+0000 7fec5e5d9700 1 --2- 172.21.15.146:0/4204921550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec5809e170 0x7fec58136520 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.638+0000 7fec5e5d9700 1 -- 172.21.15.146:0/4204921550 >> 172.21.15.146:0/4204921550 conn(0x7fec58099c40 msgr2=0x7fec58130130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:51.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.639+0000 7fec5e5d9700 1 -- 172.21.15.146:0/4204921550 shutdown_connections 2023-10-03T10:11:51.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.640+0000 7fec5e5d9700 1 -- 172.21.15.146:0/4204921550 wait complete. 2023-10-03T10:11:51.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705690 for osd.2 2023-10-03T10:11:51.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.706+0000 7f386e7fc700 1 -- 172.21.15.146:0/575758838 >> v1:172.21.15.146:6816/118159 conn(0x7f385c02c200 legacy=0x7f385c02e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:51.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.715+0000 7f9fb77fe700 1 -- 172.21.15.146:0/2420097013 >> v1:172.21.15.146:6816/118159 conn(0x7f9fa402c1b0 legacy=0x7f9fa402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/118159 2023-10-03T10:11:51.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.724+0000 7f3875911700 1 -- 172.21.15.146:0/575758838 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f387004f2a0 con 0x7f387006a770 2023-10-03T10:11:51.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.725+0000 7f3857fff700 1 -- 172.21.15.146:0/575758838 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3860021090 con 0x7f387006a770 2023-10-03T10:11:51.725 INFO:teuthology.orchestra.run.smithi146.stdout:38654705690 2023-10-03T10:11:51.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.725+0000 7f8ca60c4700 1 -- 172.21.15.146:0/4160202259 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8ca006fff0 con 0x7f8ca0133ad0 2023-10-03T10:11:51.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.725+0000 7f8c87fff700 1 -- 172.21.15.146:0/4160202259 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8ca006fff0 con 0x7f8ca0133ad0 2023-10-03T10:11:51.725 INFO:teuthology.orchestra.run.smithi146.stdout:38654705690 2023-10-03T10:11:51.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.727+0000 7f8ca60c4700 1 -- 172.21.15.146:0/4160202259 >> v1:172.21.15.146:6816/118159 conn(0x7f8c8c02c1b0 legacy=0x7f8c8c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:51.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.727+0000 7f8ca60c4700 1 -- 172.21.15.146:0/4160202259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ca0133ad0 msgr2=0x7f8ca01cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:51.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.727+0000 7f8ca60c4700 1 --2- 172.21.15.146:0/4160202259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ca0133ad0 0x7f8ca01cc870 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800ca80 tx=0x7f8c9800cd90 comp rx=0 tx=0).stop 2023-10-03T10:11:51.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.728+0000 7f8ca60c4700 1 -- 172.21.15.146:0/4160202259 shutdown_connections 2023-10-03T10:11:51.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.728+0000 7f8ca60c4700 1 --2- 172.21.15.146:0/4160202259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ca0133ad0 0x7f8ca01cc870 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.728+0000 7f8ca60c4700 1 --2- 172.21.15.146:0/4160202259 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8ca01300a0 0x7f8ca00716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.728+0000 7f8ca60c4700 1 --2- 172.21.15.146:0/4160202259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ca01309f0 0x7f8ca0071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.728+0000 7f8ca60c4700 1 -- 172.21.15.146:0/4160202259 >> 172.21.15.146:0/4160202259 conn(0x7f8ca0099c40 msgr2=0x7f8ca0132860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:51.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.728+0000 7f8ca60c4700 1 -- 172.21.15.146:0/4160202259 shutdown_connections 2023-10-03T10:11:51.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.728+0000 7f8ca60c4700 1 -- 172.21.15.146:0/4160202259 wait complete. 2023-10-03T10:11:51.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.728+0000 7f3875911700 1 -- 172.21.15.146:0/575758838 >> v1:172.21.15.146:6816/118159 conn(0x7f385c02c200 legacy=0x7f385c02e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:51.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.728+0000 7f3875911700 1 -- 172.21.15.146:0/575758838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f387006a770 msgr2=0x7f387006f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:51.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.728+0000 7f3875911700 1 --2- 172.21.15.146:0/575758838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f387006a770 0x7f387006f8a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f386000e900 tx=0x7f386000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.728+0000 7f3875911700 1 -- 172.21.15.146:0/575758838 shutdown_connections 2023-10-03T10:11:51.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.728+0000 7f3875911700 1 --2- 172.21.15.146:0/575758838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3870137920 0x7f3870070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.728+0000 7f3875911700 1 --2- 172.21.15.146:0/575758838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f387006a770 0x7f387006f8a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.728+0000 7f3875911700 1 --2- 172.21.15.146:0/575758838 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3870134a40 0x7f387006fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.728+0000 7f3875911700 1 -- 172.21.15.146:0/575758838 >> 172.21.15.146:0/575758838 conn(0x7f38700a2ef0 msgr2=0x7f3870135cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:51.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.728+0000 7f3875911700 1 -- 172.21.15.146:0/575758838 shutdown_connections 2023-10-03T10:11:51.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.728+0000 7f3875911700 1 -- 172.21.15.146:0/575758838 wait complete. 2023-10-03T10:11:51.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.741+0000 7f9fbe19f700 1 -- 172.21.15.146:0/2420097013 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9fb806bce0 con 0x7f9fb8133a70 2023-10-03T10:11:51.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.741+0000 7f9f9ffff700 1 -- 172.21.15.146:0/2420097013 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9fac02b380 con 0x7f9fb8133a70 2023-10-03T10:11:51.741 INFO:teuthology.orchestra.run.smithi146.stdout:38654705691 2023-10-03T10:11:51.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705690 for osd.3 2023-10-03T10:11:51.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.744+0000 7f9fbe19f700 1 -- 172.21.15.146:0/2420097013 >> v1:172.21.15.146:6816/118159 conn(0x7f9fa402c1b0 legacy=0x7f9fa402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:51.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.744+0000 7f9fbe19f700 1 -- 172.21.15.146:0/2420097013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fb8133a70 msgr2=0x7f9fb8119330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:51.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.744+0000 7f9fbe19f700 1 --2- 172.21.15.146:0/2420097013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fb8133a70 0x7f9fb8119330 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9fac01a000 tx=0x7f9fac004750 comp rx=0 tx=0).stop 2023-10-03T10:11:51.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.744+0000 7f9fbe19f700 1 -- 172.21.15.146:0/2420097013 shutdown_connections 2023-10-03T10:11:51.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.744+0000 7f9fbe19f700 1 --2- 172.21.15.146:0/2420097013 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fb8071bb0 0x7f9fb8119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.744+0000 7f9fbe19f700 1 --2- 172.21.15.146:0/2420097013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fb80a1290 0x7f9fb8118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.744+0000 7f9fbe19f700 1 --2- 172.21.15.146:0/2420097013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fb8133a70 0x7f9fb8119330 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:51.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.744+0000 7f9fbe19f700 1 -- 172.21.15.146:0/2420097013 >> 172.21.15.146:0/2420097013 conn(0x7f9fb80a2980 msgr2=0x7f9fb812f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:51.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.744+0000 7f9fbe19f700 1 -- 172.21.15.146:0/2420097013 shutdown_connections 2023-10-03T10:11:51.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:51.744+0000 7f9fbe19f700 1 -- 172.21.15.146:0/2420097013 wait complete. 2023-10-03T10:11:51.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705690 for osd.1 2023-10-03T10:11:51.757 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.0 2023-10-03T10:11:51.908 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:51.908+0000 7f2412ef3240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-03T10:11:52.025 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:52.026+0000 7f2412ef3240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-03T10:11:52.200 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:52.200+0000 7f2412ef3240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-03T10:11:52.303 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:52.303+0000 7f2412ef3240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-03T10:11:52.379 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:52.380+0000 7f2390d8a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:11:52.380 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:52.380+0000 7f2390d8a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:11:52.380 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:52.380+0000 7f2390d8a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:11:52.380 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:52.380+0000 7f2390d8a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:11:52.380 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:52.380+0000 7f2390d8a700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:11:52.380 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:52.380+0000 7f238dd84700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:11:52.380 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:52.380+0000 7f238dd84700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:11:52.380 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:52.380+0000 7f238dd84700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:11:52.381 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:52.380+0000 7f238dd84700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:11:52.381 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:52.380+0000 7f238dd84700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:11:52.652 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:11:52.744 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:11:52.749 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:11:52.758 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:11:52.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.776+0000 7f6e76268700 1 Processor -- start 2023-10-03T10:11:52.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.776+0000 7f6e76268700 1 -- start start 2023-10-03T10:11:52.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.776+0000 7f6e76268700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6e7012feb0 0x7f6e70130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:52.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.776+0000 7f6e76268700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e701307c0 0x7f6e700993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:52.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.776+0000 7f6e76268700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e70099920 0x7f6e70099d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:52.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.777+0000 7f6e76268700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e7009a2b0 con 0x7f6e7012feb0 2023-10-03T10:11:52.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.777+0000 7f6e76268700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7009a540 con 0x7f6e70099920 2023-10-03T10:11:52.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.777+0000 7f6e76268700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7009ad40 con 0x7f6e701307c0 2023-10-03T10:11:52.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.777+0000 7f6e6f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e701307c0 0x7f6e700993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:52.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.777+0000 7f6e74805700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e70099920 0x7f6e70099d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:52.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.777+0000 7f6e6ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6e7012feb0 0x7f6e70130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:52.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.777+0000 7f6e6f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e701307c0 0x7f6e700993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57948/0 (socket says 172.21.15.146:57948) 2023-10-03T10:11:52.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.777+0000 7f6e74805700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e70099920 0x7f6e70099d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59238/0 (socket says 172.21.15.146:59238) 2023-10-03T10:11:52.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.777+0000 7f6e6f7fe700 1 -- 172.21.15.146:0/2780618665 learned_addr learned my addr 172.21.15.146:0/2780618665 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:52.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.777+0000 7f6e74805700 1 -- 172.21.15.146:0/2780618665 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e701307c0 msgr2=0x7f6e700993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:52.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.777+0000 7f6e74805700 1 --2- 172.21.15.146:0/2780618665 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e701307c0 0x7f6e700993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.777+0000 7f6e74805700 1 -- 172.21.15.146:0/2780618665 >> v2:172.21.15.146:3300/0 conn(0x7f6e7012feb0 msgr2=0x7f6e70130280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:52.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.777+0000 7f6e74805700 1 --2- 172.21.15.146:0/2780618665 >> v2:172.21.15.146:3300/0 conn(0x7f6e7012feb0 0x7f6e70130280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.777+0000 7f6e74805700 1 -- 172.21.15.146:0/2780618665 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7009e640 con 0x7f6e70099920 2023-10-03T10:11:52.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.777+0000 7f6e6f7fe700 1 --2- 172.21.15.146:0/2780618665 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e701307c0 0x7f6e700993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:52.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.777+0000 7f6e6ffff700 1 --2- 172.21.15.146:0/2780618665 >> v2:172.21.15.146:3300/0 conn(0x7f6e7012feb0 0x7f6e70130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:52.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.777+0000 7f6e74805700 1 --2- 172.21.15.146:0/2780618665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e70099920 0x7f6e70099d70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6e68009d90 tx=0x7f6e6800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccfe0a37c0acbd4d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:52.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.777+0000 7f6e6effd700 1 -- 172.21.15.146:0/2780618665 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6800e070 con 0x7f6e70099920 2023-10-03T10:11:52.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.777+0000 7f6e6effd700 1 -- 172.21.15.146:0/2780618665 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6800bb20 con 0x7f6e70099920 2023-10-03T10:11:52.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.777+0000 7f6e6effd700 1 -- 172.21.15.146:0/2780618665 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e68012430 con 0x7f6e70099920 2023-10-03T10:11:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.778+0000 7f6e76268700 1 -- 172.21.15.146:0/2780618665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e70099920 msgr2=0x7f6e70099d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.778+0000 7f6e76268700 1 --2- 172.21.15.146:0/2780618665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e70099920 0x7f6e70099d70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6e68009d90 tx=0x7f6e6800b330 comp rx=0 tx=0).stop 2023-10-03T10:11:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.778+0000 7f6e76268700 1 -- 172.21.15.146:0/2780618665 shutdown_connections 2023-10-03T10:11:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.778+0000 7f6e76268700 1 --2- 172.21.15.146:0/2780618665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e70099920 0x7f6e70099d70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.778+0000 7f6e76268700 1 --2- 172.21.15.146:0/2780618665 >> v2:172.21.15.146:3300/0 conn(0x7f6e7012feb0 0x7f6e70130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.778+0000 7f6e76268700 1 --2- 172.21.15.146:0/2780618665 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e701307c0 0x7f6e700993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.778+0000 7f6e76268700 1 -- 172.21.15.146:0/2780618665 >> 172.21.15.146:0/2780618665 conn(0x7f6e700a2b30 msgr2=0x7f6e7009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.779+0000 7f6e76268700 1 -- 172.21.15.146:0/2780618665 shutdown_connections 2023-10-03T10:11:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.779+0000 7f6e76268700 1 -- 172.21.15.146:0/2780618665 wait complete. 2023-10-03T10:11:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.780+0000 7f6e76268700 1 Processor -- start 2023-10-03T10:11:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.781+0000 7f6e76268700 1 -- start start 2023-10-03T10:11:52.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.781+0000 7f6e76268700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e70099920 0x7f6e701c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:52.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.781+0000 7f6e76268700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e7012feb0 0x7f6e701c4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:52.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.781+0000 7f6e76268700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e701307c0 0x7f6e7006ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:52.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.781+0000 7f6e76268700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7008b590 con 0x7f6e70099920 2023-10-03T10:11:52.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.781+0000 7f6e76268700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7012f9c0 con 0x7f6e701307c0 2023-10-03T10:11:52.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.781+0000 7f6e76268700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e70072510 con 0x7f6e7012feb0 2023-10-03T10:11:52.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.781+0000 7f6e74805700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e701307c0 0x7f6e7006ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:52.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.781+0000 7f6e6ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e70099920 0x7f6e701c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:52.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.781+0000 7f6e74805700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e701307c0 0x7f6e7006ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59252/0 (socket says 172.21.15.146:59252) 2023-10-03T10:11:52.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.781+0000 7f6e74805700 1 -- 172.21.15.146:0/3726348482 learned_addr learned my addr 172.21.15.146:0/3726348482 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:52.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.781+0000 7f6e6f7fe700 1 --2- 172.21.15.146:0/3726348482 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e7012feb0 0x7f6e701c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:52.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.782+0000 7f6e6ffff700 1 -- 172.21.15.146:0/3726348482 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e7012feb0 msgr2=0x7f6e701c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:52.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.782+0000 7f6e6ffff700 1 --2- 172.21.15.146:0/3726348482 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e7012feb0 0x7f6e701c4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.782+0000 7f6e6ffff700 1 -- 172.21.15.146:0/3726348482 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e701307c0 msgr2=0x7f6e7006ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:52.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.782+0000 7f6e6ffff700 1 --2- 172.21.15.146:0/3726348482 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e701307c0 0x7f6e7006ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.782+0000 7f6e6ffff700 1 -- 172.21.15.146:0/3726348482 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6000d8d0 con 0x7f6e70099920 2023-10-03T10:11:52.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.782+0000 7f6e74805700 1 --2- 172.21.15.146:0/3726348482 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e701307c0 0x7f6e7006ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:52.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.782+0000 7f6e6ffff700 1 --2- 172.21.15.146:0/3726348482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e70099920 0x7f6e701c4010 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000dd10 tx=0x7f6e600103a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:52.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.782+0000 7f6e6cff9700 1 -- 172.21.15.146:0/3726348482 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e60005c20 con 0x7f6e70099920 2023-10-03T10:11:52.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.782+0000 7f6e6cff9700 1 -- 172.21.15.146:0/3726348482 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e60013040 con 0x7f6e70099920 2023-10-03T10:11:52.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.782+0000 7f6e76268700 1 -- 172.21.15.146:0/3726348482 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6400b600 con 0x7f6e70099920 2023-10-03T10:11:52.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.782+0000 7f6e6cff9700 1 -- 172.21.15.146:0/3726348482 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6000d2e0 con 0x7f6e70099920 2023-10-03T10:11:52.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.782+0000 7f6e76268700 1 -- 172.21.15.146:0/3726348482 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e68009a70 con 0x7f6e70099920 2023-10-03T10:11:52.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.783+0000 7f6e76268700 1 -- 172.21.15.146:0/3726348482 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e7004f2a0 con 0x7f6e70099920 2023-10-03T10:11:52.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.784+0000 7f6e6cff9700 1 -- 172.21.15.146:0/3726348482 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f6e60010900 con 0x7f6e70099920 2023-10-03T10:11:52.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.784+0000 7f6e6cff9700 1 -- 172.21.15.146:0/3726348482 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4055+0+0 (secure 0 0 0) 0x7f6e60044360 con 0x7f6e70099920 2023-10-03T10:11:52.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.788+0000 7f6e6cff9700 1 -- 172.21.15.146:0/3726348482 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f6e60010bb0 con 0x7f6e70099920 2023-10-03T10:11:52.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.887+0000 7efeb5e26700 1 Processor -- start 2023-10-03T10:11:52.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.887+0000 7efeb5e26700 1 -- start start 2023-10-03T10:11:52.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.888+0000 7efeb5e26700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efeb0133ad0 0x7efeb0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:52.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.888+0000 7efeb5e26700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeb01300a0 0x7efeb01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:52.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.888+0000 7efeb5e26700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb006b2d0 con 0x7efeb01309f0 2023-10-03T10:11:52.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.888+0000 7efeb5e26700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb0133610 con 0x7efeb0133ad0 2023-10-03T10:11:52.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.888+0000 7efeb5e26700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb009a500 con 0x7efeb01300a0 2023-10-03T10:11:52.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.888+0000 7efeaeffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeb01300a0 0x7efeb01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:52.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.888+0000 7efeaffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7efeb01309f0 0x7efeb013a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59998/0 (socket says 172.21.15.146:59998) 2023-10-03T10:11:52.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.888+0000 7efeaf7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efeb0133ad0 0x7efeb0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:52.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.888+0000 7efeaffff700 1 -- 172.21.15.146:0/190353149 learned_addr learned my addr 172.21.15.146:0/190353149 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:11:52.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.889+0000 7efeae7fc700 1 -- 172.21.15.146:0/190353149 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3270904918 0 0) 0x7efeb006b2d0 con 0x7efeb01309f0 2023-10-03T10:11:52.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.889+0000 7efeae7fc700 1 -- 172.21.15.146:0/190353149 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe980035b0 con 0x7efeb01309f0 2023-10-03T10:11:52.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.889+0000 7efeaeffd700 1 -- 172.21.15.146:0/190353149 >> v2:172.21.15.146:3300/0 conn(0x7efeb0133ad0 msgr2=0x7efeb0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:52.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.889+0000 7efeaeffd700 1 --2- 172.21.15.146:0/190353149 >> v2:172.21.15.146:3300/0 conn(0x7efeb0133ad0 0x7efeb0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.889+0000 7efeaeffd700 1 -- 172.21.15.146:0/190353149 >> v1:172.21.15.146:6789/0 conn(0x7efeb01309f0 legacy=0x7efeb013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:52.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.889+0000 7efeaeffd700 1 -- 172.21.15.146:0/190353149 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb01338b0 con 0x7efeb01300a0 2023-10-03T10:11:52.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.889+0000 7efeaf7fe700 1 --2- 172.21.15.146:0/190353149 >> v2:172.21.15.146:3300/0 conn(0x7efeb0133ad0 0x7efeb0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:52.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.889+0000 7efeaeffd700 1 --2- 172.21.15.146:0/190353149 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeb01300a0 0x7efeb01304b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efea4009840 tx=0x7efea4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74367b3578cdbd6a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:52.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.889+0000 7efeae7fc700 1 -- 172.21.15.146:0/190353149 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4011830 con 0x7efeb01300a0 2023-10-03T10:11:52.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.889+0000 7efeae7fc700 1 -- 172.21.15.146:0/190353149 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea4011990 con 0x7efeb01300a0 2023-10-03T10:11:52.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.889+0000 7efeae7fc700 1 -- 172.21.15.146:0/190353149 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4011d20 con 0x7efeb01300a0 2023-10-03T10:11:52.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.890+0000 7efeb5e26700 1 -- 172.21.15.146:0/190353149 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeb01300a0 msgr2=0x7efeb01304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:52.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.890+0000 7efeb5e26700 1 --2- 172.21.15.146:0/190353149 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeb01300a0 0x7efeb01304b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efea4009840 tx=0x7efea4009b50 comp rx=0 tx=0).stop 2023-10-03T10:11:52.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.890+0000 7efeb5e26700 1 -- 172.21.15.146:0/190353149 shutdown_connections 2023-10-03T10:11:52.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.890+0000 7efeb5e26700 1 --2- 172.21.15.146:0/190353149 >> v2:172.21.15.146:3300/0 conn(0x7efeb0133ad0 0x7efeb0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.890+0000 7efeb5e26700 1 --2- 172.21.15.146:0/190353149 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeb01300a0 0x7efeb01304b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.890+0000 7efeb5e26700 1 -- 172.21.15.146:0/190353149 >> 172.21.15.146:0/190353149 conn(0x7efeb0099c40 msgr2=0x7efeb00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:52.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.890+0000 7efeb5e26700 1 -- 172.21.15.146:0/190353149 shutdown_connections 2023-10-03T10:11:52.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.890+0000 7efeb5e26700 1 -- 172.21.15.146:0/190353149 wait complete. 2023-10-03T10:11:52.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.891+0000 7efeb5e26700 1 Processor -- start 2023-10-03T10:11:52.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.891+0000 7efeb5e26700 1 -- start start 2023-10-03T10:11:52.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.891+0000 7efeb5e26700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efeb01300a0 0x7efeb011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:52.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.891+0000 7efeb5e26700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeb01309f0 0x7efeb011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:52.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.891+0000 7efeb5e26700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efeb0133ad0 0x7efeb011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:52.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.891+0000 7efeb5e26700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb01200c0 con 0x7efeb0133ad0 2023-10-03T10:11:52.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.891+0000 7efeb5e26700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb011f040 con 0x7efeb01309f0 2023-10-03T10:11:52.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.891+0000 7efeb5e26700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efeb011fb20 con 0x7efeb01300a0 2023-10-03T10:11:52.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.892+0000 7efeaf7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efeb01300a0 0x7efeb011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:52.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.892+0000 7efeaf7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efeb01300a0 0x7efeb011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57968/0 (socket says 172.21.15.146:57968) 2023-10-03T10:11:52.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.892+0000 7efeaf7fe700 1 -- 172.21.15.146:0/3705222862 learned_addr learned my addr 172.21.15.146:0/3705222862 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:52.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.892+0000 7efeaeffd700 1 --2- 172.21.15.146:0/3705222862 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeb01309f0 0x7efeb011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:52.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.892+0000 7efeaffff700 1 --2- 172.21.15.146:0/3705222862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efeb0133ad0 0x7efeb011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:52.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.892+0000 7efeaf7fe700 1 -- 172.21.15.146:0/3705222862 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeb01309f0 msgr2=0x7efeb011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:52.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.892+0000 7efeaf7fe700 1 --2- 172.21.15.146:0/3705222862 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeb01309f0 0x7efeb011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.892+0000 7efeaf7fe700 1 -- 172.21.15.146:0/3705222862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efeb0133ad0 msgr2=0x7efeb011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:52.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.892+0000 7efeaf7fe700 1 --2- 172.21.15.146:0/3705222862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efeb0133ad0 0x7efeb011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.892+0000 7efeaf7fe700 1 -- 172.21.15.146:0/3705222862 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea00094a0 con 0x7efeb01300a0 2023-10-03T10:11:52.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.892+0000 7efeaf7fe700 1 --2- 172.21.15.146:0/3705222862 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efeb01300a0 0x7efeb011da40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efea000ebe0 tx=0x7efea000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:52.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.892+0000 7efe97fff700 1 -- 172.21.15.146:0/3705222862 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea000c850 con 0x7efeb01300a0 2023-10-03T10:11:52.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.892+0000 7efe97fff700 1 -- 172.21.15.146:0/3705222862 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea000c9b0 con 0x7efeb01300a0 2023-10-03T10:11:52.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.892+0000 7efe97fff700 1 -- 172.21.15.146:0/3705222862 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea000cd20 con 0x7efeb01300a0 2023-10-03T10:11:52.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.893+0000 7efeb5e26700 1 -- 172.21.15.146:0/3705222862 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea40094a0 con 0x7efeb01300a0 2023-10-03T10:11:52.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.893+0000 7efeb5e26700 1 -- 172.21.15.146:0/3705222862 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb012dd00 con 0x7efeb01300a0 2023-10-03T10:11:52.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.894+0000 7efe97fff700 1 -- 172.21.15.146:0/3705222862 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7efea0013470 con 0x7efeb01300a0 2023-10-03T10:11:52.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.894+0000 7efe97fff700 1 -- 172.21.15.146:0/3705222862 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4055+0+0 (secure 0 0 0) 0x7efea003f660 con 0x7efeb01300a0 2023-10-03T10:11:52.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.894+0000 7efeb5e26700 1 -- 172.21.15.146:0/3705222862 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb006be10 con 0x7efeb01300a0 2023-10-03T10:11:52.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.903+0000 7efe97fff700 1 -- 172.21.15.146:0/3705222862 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7efea0021080 con 0x7efeb01300a0 2023-10-03T10:11:52.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.911+0000 7fb874306700 1 Processor -- start 2023-10-03T10:11:52.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.911+0000 7fb874306700 1 -- start start 2023-10-03T10:11:52.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.912+0000 7fb874306700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb86c09d860 0x7fb86c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:52.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.912+0000 7fb874306700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb86c09e170 0x7fb86c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:52.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.912+0000 7fb874306700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86c09aaa0 con 0x7fb86c130ce0 2023-10-03T10:11:52.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.912+0000 7fb874306700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86c09f870 con 0x7fb86c09d860 2023-10-03T10:11:52.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.912+0000 7fb874306700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c09b360 con 0x7fb86c09e170 2023-10-03T10:11:52.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.912+0000 7fb8718a1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb86c09e170 0x7fb86c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:52.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.913+0000 7fb8718a1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb86c09e170 0x7fb86c1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59298/0 (socket says 172.21.15.146:59298) 2023-10-03T10:11:52.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.913+0000 7fb8718a1700 1 -- 172.21.15.146:0/2802964720 learned_addr learned my addr 172.21.15.146:0/2802964720 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:52.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.913+0000 7fb8720a2700 1 --2- 172.21.15.146:0/2802964720 >> v2:172.21.15.146:3300/0 conn(0x7fb86c09d860 0x7fb86c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:52.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.913+0000 7fb8718a1700 1 -- 172.21.15.146:0/2802964720 >> v2:172.21.15.146:3300/0 conn(0x7fb86c09d860 msgr2=0x7fb86c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.913+0000 7fb8718a1700 1 --2- 172.21.15.146:0/2802964720 >> v2:172.21.15.146:3300/0 conn(0x7fb86c09d860 0x7fb86c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.913+0000 7fb8718a1700 1 -- 172.21.15.146:0/2802964720 >> v1:172.21.15.146:6789/0 conn(0x7fb86c130ce0 legacy=0x7fb86c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.913+0000 7fb8718a1700 1 -- 172.21.15.146:0/2802964720 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c09b620 con 0x7fb86c09e170 2023-10-03T10:11:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.913+0000 7fb8718a1700 1 --2- 172.21.15.146:0/2802964720 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb86c09e170 0x7fb86c1307a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0098f0 tx=0x7fb85c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45d47e19ebf50fbe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.913+0000 7fb8710a0700 1 -- 172.21.15.146:0/2802964720 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c004230 con 0x7fb86c09e170 2023-10-03T10:11:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.913+0000 7fb8710a0700 1 -- 172.21.15.146:0/2802964720 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c004390 con 0x7fb86c09e170 2023-10-03T10:11:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.913+0000 7fb8710a0700 1 -- 172.21.15.146:0/2802964720 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c0036a0 con 0x7fb86c09e170 2023-10-03T10:11:52.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.914+0000 7fee7bb88700 1 Processor -- start 2023-10-03T10:11:52.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.914+0000 7fee7bb88700 1 -- start start 2023-10-03T10:11:52.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.914+0000 7fb874306700 1 -- 172.21.15.146:0/2802964720 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb86c09e170 msgr2=0x7fb86c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:52.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.914+0000 7fb874306700 1 --2- 172.21.15.146:0/2802964720 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb86c09e170 0x7fb86c1307a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0098f0 tx=0x7fb85c009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:52.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.914+0000 7fee7bb88700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fee7409b0d0 0x7fee7409b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:52.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.914+0000 7fee7bb88700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee74130480 0x7fee741308b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:52.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.915+0000 7fee7bb88700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7409b9e0 con 0x7fee74130df0 2023-10-03T10:11:52.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.915+0000 7fee7bb88700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7409bf70 con 0x7fee7409b0d0 2023-10-03T10:11:52.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.915+0000 7fee7bb88700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7409ebb0 con 0x7fee74130480 2023-10-03T10:11:52.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.915+0000 7fee79924700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fee7409b0d0 0x7fee7409b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:52.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.915+0000 7fee79924700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fee7409b0d0 0x7fee7409b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34692/0 (socket says 172.21.15.146:34692) 2023-10-03T10:11:52.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.915+0000 7fee79924700 1 -- 172.21.15.146:0/2408854687 learned_addr learned my addr 172.21.15.146:0/2408854687 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:52.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.915+0000 7fb874306700 1 -- 172.21.15.146:0/2802964720 shutdown_connections 2023-10-03T10:11:52.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.915+0000 7fb874306700 1 --2- 172.21.15.146:0/2802964720 >> v2:172.21.15.146:3300/0 conn(0x7fb86c09d860 0x7fb86c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.915+0000 7fb874306700 1 --2- 172.21.15.146:0/2802964720 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb86c09e170 0x7fb86c1307a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.915+0000 7fb874306700 1 -- 172.21.15.146:0/2802964720 >> 172.21.15.146:0/2802964720 conn(0x7fb86c099c40 msgr2=0x7fb86c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:52.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.915+0000 7fee79123700 1 --2- 172.21.15.146:0/2408854687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee74130480 0x7fee741308b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:52.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.915+0000 7fee79924700 1 -- 172.21.15.146:0/2408854687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee74130480 msgr2=0x7fee741308b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:52.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.915+0000 7fee79924700 1 --2- 172.21.15.146:0/2408854687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee74130480 0x7fee741308b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.915+0000 7fee79924700 1 -- 172.21.15.146:0/2408854687 >> v1:172.21.15.146:6789/0 conn(0x7fee74130df0 legacy=0x7fee741377b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:52.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.915+0000 7fee79924700 1 -- 172.21.15.146:0/2408854687 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7409e350 con 0x7fee7409b0d0 2023-10-03T10:11:52.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.915+0000 7fee79924700 1 --2- 172.21.15.146:0/2408854687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7409b0d0 0x7fee7409b4a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fee7000bb90 tx=0x7fee7000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802716ec0c09b337 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:52.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.915+0000 7fb874306700 1 -- 172.21.15.146:0/2802964720 shutdown_connections 2023-10-03T10:11:52.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.915+0000 7fb874306700 1 -- 172.21.15.146:0/2802964720 wait complete. 2023-10-03T10:11:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.915+0000 7fee78922700 1 -- 172.21.15.146:0/2408854687 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7000dd30 con 0x7fee7409b0d0 2023-10-03T10:11:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.915+0000 7fee78922700 1 -- 172.21.15.146:0/2408854687 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7000de90 con 0x7fee7409b0d0 2023-10-03T10:11:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.915+0000 7fee78922700 1 -- 172.21.15.146:0/2408854687 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70010690 con 0x7fee7409b0d0 2023-10-03T10:11:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.916+0000 7fee7bb88700 1 -- 172.21.15.146:0/2408854687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7409b0d0 msgr2=0x7fee7409b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.916+0000 7fee7bb88700 1 --2- 172.21.15.146:0/2408854687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7409b0d0 0x7fee7409b4a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fee7000bb90 tx=0x7fee7000bea0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.916+0000 7fee7bb88700 1 -- 172.21.15.146:0/2408854687 shutdown_connections 2023-10-03T10:11:52.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.916+0000 7fee7bb88700 1 --2- 172.21.15.146:0/2408854687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7409b0d0 0x7fee7409b4a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.916+0000 7fee7bb88700 1 --2- 172.21.15.146:0/2408854687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee74130480 0x7fee741308b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.916+0000 7fee7bb88700 1 -- 172.21.15.146:0/2408854687 >> 172.21.15.146:0/2408854687 conn(0x7fee740a2eb0 msgr2=0x7fee7409eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:52.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.916+0000 7fee7bb88700 1 -- 172.21.15.146:0/2408854687 shutdown_connections 2023-10-03T10:11:52.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.916+0000 7fee7bb88700 1 -- 172.21.15.146:0/2408854687 wait complete. 2023-10-03T10:11:52.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.917+0000 7fb874306700 1 Processor -- start 2023-10-03T10:11:52.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.917+0000 7fb874306700 1 -- start start 2023-10-03T10:11:52.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.917+0000 7fee7bb88700 1 Processor -- start 2023-10-03T10:11:52.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.917+0000 7fb874306700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb86c09d860 0x7fb86c11e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:52.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.917+0000 7fb874306700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb86c09e170 0x7fb86c11ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:52.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.917+0000 7fb874306700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb86c130ce0 0x7fb86c11f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:52.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.917+0000 7fb874306700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c121f40 con 0x7fb86c09d860 2023-10-03T10:11:52.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.917+0000 7fb874306700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c120420 con 0x7fb86c09e170 2023-10-03T10:11:52.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.917+0000 7fb874306700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c130230 con 0x7fb86c130ce0 2023-10-03T10:11:52.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.917+0000 7fb8718a1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb86c09e170 0x7fb86c11ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:52.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.918+0000 7fb8718a1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb86c09e170 0x7fb86c11ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59308/0 (socket says 172.21.15.146:59308) 2023-10-03T10:11:52.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.918+0000 7fb8718a1700 1 -- 172.21.15.146:0/2244662767 learned_addr learned my addr 172.21.15.146:0/2244662767 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:52.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.918+0000 7fee7bb88700 1 -- start start 2023-10-03T10:11:52.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.918+0000 7fb8720a2700 1 --2- 172.21.15.146:0/2244662767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb86c09d860 0x7fb86c11e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:52.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.918+0000 7fb8718a1700 1 -- 172.21.15.146:0/2244662767 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb86c130ce0 msgr2=0x7fb86c11f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:52.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.918+0000 7fb8718a1700 1 --2- 172.21.15.146:0/2244662767 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb86c130ce0 0x7fb86c11f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.918+0000 7fb8718a1700 1 -- 172.21.15.146:0/2244662767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb86c09d860 msgr2=0x7fb86c11e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:52.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.918+0000 7fb8718a1700 1 --2- 172.21.15.146:0/2244662767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb86c09d860 0x7fb86c11e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.918+0000 7fb8718a1700 1 -- 172.21.15.146:0/2244662767 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c009550 con 0x7fb86c09e170 2023-10-03T10:11:52.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.918+0000 7fb8720a2700 1 --2- 172.21.15.146:0/2244662767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb86c09d860 0x7fb86c11e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:11:52.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.918+0000 7fb8718a1700 1 --2- 172.21.15.146:0/2244662767 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb86c09e170 0x7fb86c11ec40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb85c000c00 tx=0x7fb85c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:52.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.918+0000 7fb862ffd700 1 -- 172.21.15.146:0/2244662767 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c011630 con 0x7fb86c09e170 2023-10-03T10:11:52.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.918+0000 7fb874306700 1 -- 172.21.15.146:0/2244662767 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86c1208c0 con 0x7fb86c09e170 2023-10-03T10:11:52.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.918+0000 7fb862ffd700 1 -- 172.21.15.146:0/2244662767 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c011790 con 0x7fb86c09e170 2023-10-03T10:11:52.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.919+0000 7fb862ffd700 1 -- 172.21.15.146:0/2244662767 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c011b40 con 0x7fb86c09e170 2023-10-03T10:11:52.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.919+0000 7fb874306700 1 -- 172.21.15.146:0/2244662767 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86c120b00 con 0x7fb86c09e170 2023-10-03T10:11:52.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.919+0000 7fee7bb88700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7409b0d0 0x7fee74071710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:52.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.919+0000 7fee7bb88700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee74130480 0x7fee74071c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:52.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.919+0000 7fee7bb88700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee74130df0 0x7fee74072190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:52.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.919+0000 7fee7bb88700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee74072a60 con 0x7fee7409b0d0 2023-10-03T10:11:52.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.919+0000 7fee7bb88700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee74129880 con 0x7fee74130480 2023-10-03T10:11:52.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.919+0000 7fee7bb88700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee74072c90 con 0x7fee74130df0 2023-10-03T10:11:52.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.919+0000 7fee79924700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7409b0d0 0x7fee74071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:52.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.919+0000 7fee79924700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7409b0d0 0x7fee74071710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34712/0 (socket says 172.21.15.146:34712) 2023-10-03T10:11:52.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.919+0000 7fee79924700 1 -- 172.21.15.146:0/2868174220 learned_addr learned my addr 172.21.15.146:0/2868174220 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:52.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.919+0000 7fee79924700 1 -- 172.21.15.146:0/2868174220 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee74130df0 msgr2=0x7fee74072190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:52.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.919+0000 7fee79924700 1 --2- 172.21.15.146:0/2868174220 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee74130df0 0x7fee74072190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.919+0000 7fee79924700 1 -- 172.21.15.146:0/2868174220 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee74130480 msgr2=0x7fee74071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:52.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.919+0000 7fee79924700 1 --2- 172.21.15.146:0/2868174220 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee74130480 0x7fee74071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.919+0000 7fee79924700 1 -- 172.21.15.146:0/2868174220 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7000b7f0 con 0x7fee7409b0d0 2023-10-03T10:11:52.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.919+0000 7fee79924700 1 --2- 172.21.15.146:0/2868174220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7409b0d0 0x7fee74071710 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fee7000bee0 tx=0x7fee70004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:52.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.920+0000 7fb862ffd700 1 -- 172.21.15.146:0/2244662767 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7fb85c021070 con 0x7fb86c09e170 2023-10-03T10:11:52.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.920+0000 7fee6a7fc700 1 -- 172.21.15.146:0/2868174220 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70003cf0 con 0x7fee7409b0d0 2023-10-03T10:11:52.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.920+0000 7fb862ffd700 1 -- 172.21.15.146:0/2244662767 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4055+0+0 (secure 0 0 0) 0x7fb85c01be30 con 0x7fb86c09e170 2023-10-03T10:11:52.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.920+0000 7fee6a7fc700 1 -- 172.21.15.146:0/2868174220 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee70003e50 con 0x7fee7409b0d0 2023-10-03T10:11:52.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.920+0000 7fee7bb88700 1 -- 172.21.15.146:0/2868174220 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee74128c30 con 0x7fee7409b0d0 2023-10-03T10:11:52.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.920+0000 7fee6a7fc700 1 -- 172.21.15.146:0/2868174220 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70010670 con 0x7fee7409b0d0 2023-10-03T10:11:52.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.920+0000 7fee7bb88700 1 -- 172.21.15.146:0/2868174220 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee74128970 con 0x7fee7409b0d0 2023-10-03T10:11:52.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.921+0000 7fee6a7fc700 1 -- 172.21.15.146:0/2868174220 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7fee70019400 con 0x7fee7409b0d0 2023-10-03T10:11:52.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.921+0000 7fb874306700 1 -- 172.21.15.146:0/2244662767 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb86c04f2a0 con 0x7fb86c09e170 2023-10-03T10:11:52.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.921+0000 7fee7bb88700 1 -- 172.21.15.146:0/2868174220 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7404f2a0 con 0x7fee7409b0d0 2023-10-03T10:11:52.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.921+0000 7fee6a7fc700 1 -- 172.21.15.146:0/2868174220 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4055+0+0 (secure 0 0 0) 0x7fee70040b10 con 0x7fee7409b0d0 2023-10-03T10:11:52.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.926+0000 7fee6a7fc700 1 -- 172.21.15.146:0/2868174220 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fee70019cb0 con 0x7fee7409b0d0 2023-10-03T10:11:52.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.929+0000 7fb862ffd700 1 -- 172.21.15.146:0/2244662767 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fb85c010380 con 0x7fb86c09e170 2023-10-03T10:11:52.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.970+0000 7f6e76268700 1 -- 172.21.15.146:0/3726348482 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6e701c4a90 con 0x7f6e70099920 2023-10-03T10:11:52.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.971+0000 7f6e6cff9700 1 -- 172.21.15.146:0/3726348482 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6e60021bf0 con 0x7f6e70099920 2023-10-03T10:11:52.971 INFO:teuthology.orchestra.run.smithi146.stdout:38654705690 2023-10-03T10:11:52.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.973+0000 7f6e76268700 1 -- 172.21.15.146:0/3726348482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e70099920 msgr2=0x7f6e701c4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:52.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.973+0000 7f6e76268700 1 --2- 172.21.15.146:0/3726348482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e70099920 0x7f6e701c4010 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000dd10 tx=0x7f6e600103a0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.973+0000 7f6e76268700 1 -- 172.21.15.146:0/3726348482 shutdown_connections 2023-10-03T10:11:52.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.973+0000 7f6e76268700 1 --2- 172.21.15.146:0/3726348482 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e701307c0 0x7f6e7006ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.973+0000 7f6e76268700 1 --2- 172.21.15.146:0/3726348482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e70099920 0x7f6e701c4010 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.973+0000 7f6e76268700 1 --2- 172.21.15.146:0/3726348482 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e7012feb0 0x7f6e701c4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:52.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.974+0000 7f6e76268700 1 -- 172.21.15.146:0/3726348482 >> 172.21.15.146:0/3726348482 conn(0x7f6e700a2b30 msgr2=0x7f6e7009fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:52.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.975+0000 7f6e76268700 1 -- 172.21.15.146:0/3726348482 shutdown_connections 2023-10-03T10:11:52.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:52.975+0000 7f6e76268700 1 -- 172.21.15.146:0/3726348482 wait complete. 2023-10-03T10:11:52.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705690 for osd.2 2023-10-03T10:11:53.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.093+0000 7efeb5e26700 1 -- 172.21.15.146:0/3705222862 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efeb004f2a0 con 0x7efeb01300a0 2023-10-03T10:11:53.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.094+0000 7efe97fff700 1 -- 172.21.15.146:0/3705222862 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efea000ce80 con 0x7efeb01300a0 2023-10-03T10:11:53.255 INFO:teuthology.orchestra.run.smithi146.stdout:38654705690 2023-10-03T10:11:53.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.096+0000 7efeb5e26700 1 -- 172.21.15.146:0/3705222862 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efeb01300a0 msgr2=0x7efeb011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:53.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.096+0000 7efeb5e26700 1 --2- 172.21.15.146:0/3705222862 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efeb01300a0 0x7efeb011da40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efea000ebe0 tx=0x7efea000eef0 comp rx=0 tx=0).stop 2023-10-03T10:11:53.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.096+0000 7efeb5e26700 1 -- 172.21.15.146:0/3705222862 shutdown_connections 2023-10-03T10:11:53.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.096+0000 7efeb5e26700 1 --2- 172.21.15.146:0/3705222862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efeb0133ad0 0x7efeb011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:53.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.096+0000 7efeb5e26700 1 --2- 172.21.15.146:0/3705222862 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efeb01300a0 0x7efeb011da40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:53.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.096+0000 7efeb5e26700 1 --2- 172.21.15.146:0/3705222862 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeb01309f0 0x7efeb011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:53.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.096+0000 7efeb5e26700 1 -- 172.21.15.146:0/3705222862 >> 172.21.15.146:0/3705222862 conn(0x7efeb0099c40 msgr2=0x7efeb012e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:53.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.096+0000 7efeb5e26700 1 -- 172.21.15.146:0/3705222862 shutdown_connections 2023-10-03T10:11:53.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.096+0000 7efeb5e26700 1 -- 172.21.15.146:0/3705222862 wait complete. 2023-10-03T10:11:53.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.101+0000 7fee7bb88700 1 -- 172.21.15.146:0/2868174220 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fee7406b720 con 0x7fee7409b0d0 2023-10-03T10:11:53.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.101+0000 7fee6a7fc700 1 -- 172.21.15.146:0/2868174220 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fee70018360 con 0x7fee7409b0d0 2023-10-03T10:11:53.258 INFO:teuthology.orchestra.run.smithi146.stdout:38654705690 2023-10-03T10:11:53.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.103+0000 7fee7bb88700 1 -- 172.21.15.146:0/2868174220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7409b0d0 msgr2=0x7fee74071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:53.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.103+0000 7fee7bb88700 1 --2- 172.21.15.146:0/2868174220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7409b0d0 0x7fee74071710 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fee7000bee0 tx=0x7fee70004750 comp rx=0 tx=0).stop 2023-10-03T10:11:53.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.104+0000 7fee7bb88700 1 -- 172.21.15.146:0/2868174220 shutdown_connections 2023-10-03T10:11:53.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.104+0000 7fee7bb88700 1 --2- 172.21.15.146:0/2868174220 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee74130df0 0x7fee74072190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:53.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.104+0000 7fee7bb88700 1 --2- 172.21.15.146:0/2868174220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7409b0d0 0x7fee74071710 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:53.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.104+0000 7fee7bb88700 1 --2- 172.21.15.146:0/2868174220 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee74130480 0x7fee74071c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:53.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.104+0000 7fee7bb88700 1 -- 172.21.15.146:0/2868174220 >> 172.21.15.146:0/2868174220 conn(0x7fee740a2eb0 msgr2=0x7fee74095880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:53.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.104+0000 7fee7bb88700 1 -- 172.21.15.146:0/2868174220 shutdown_connections 2023-10-03T10:11:53.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.104+0000 7fee7bb88700 1 -- 172.21.15.146:0/2868174220 wait complete. 2023-10-03T10:11:53.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705690 for osd.3 2023-10-03T10:11:53.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.113+0000 7fb874306700 1 -- 172.21.15.146:0/2244662767 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb86c04f2a0 con 0x7fb86c09e170 2023-10-03T10:11:53.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.114+0000 7fb862ffd700 1 -- 172.21.15.146:0/2244662767 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb85c029020 con 0x7fb86c09e170 2023-10-03T10:11:53.261 INFO:teuthology.orchestra.run.smithi146.stdout:38654705691 2023-10-03T10:11:53.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.116+0000 7fb874306700 1 -- 172.21.15.146:0/2244662767 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb86c09e170 msgr2=0x7fb86c11ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:53.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.116+0000 7fb874306700 1 --2- 172.21.15.146:0/2244662767 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb86c09e170 0x7fb86c11ec40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb85c000c00 tx=0x7fb85c004750 comp rx=0 tx=0).stop 2023-10-03T10:11:53.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705690 for osd.1 2023-10-03T10:11:53.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.116+0000 7fb874306700 1 -- 172.21.15.146:0/2244662767 shutdown_connections 2023-10-03T10:11:53.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.116+0000 7fb874306700 1 --2- 172.21.15.146:0/2244662767 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb86c130ce0 0x7fb86c11f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:53.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.116+0000 7fb874306700 1 --2- 172.21.15.146:0/2244662767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb86c09d860 0x7fb86c11e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:53.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.116+0000 7fb874306700 1 --2- 172.21.15.146:0/2244662767 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb86c09e170 0x7fb86c11ec40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:53.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.116+0000 7fb874306700 1 -- 172.21.15.146:0/2244662767 >> 172.21.15.146:0/2244662767 conn(0x7fb86c099c40 msgr2=0x7fb86c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:53.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.116+0000 7fb874306700 1 -- 172.21.15.146:0/2244662767 shutdown_connections 2023-10-03T10:11:53.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:53.116+0000 7fb874306700 1 -- 172.21.15.146:0/2244662767 wait complete. 2023-10-03T10:11:53.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705691 for osd.0 2023-10-03T10:11:53.330 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:53.330+0000 7f23d430e700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-10-03T10:11:53.330 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:53.331+0000 7f23d430e700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-03T10:11:53.332 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-10-03T10:11:53.332+0000 7f23d430e700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-03T10:11:53.988 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:11:54.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.121+0000 7f6d245dc700 1 Processor -- start 2023-10-03T10:11:54.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.121+0000 7f6d245dc700 1 -- start start 2023-10-03T10:11:54.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.121+0000 7f6d245dc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d1c133ad0 0x7f6d1c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:54.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.121+0000 7f6d245dc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d1c1300a0 0x7f6d1c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:54.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.121+0000 7f6d245dc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d1c06b2d0 con 0x7f6d1c1309f0 2023-10-03T10:11:54.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.121+0000 7f6d245dc700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d1c133610 con 0x7f6d1c133ad0 2023-10-03T10:11:54.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.121+0000 7f6d245dc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c09a500 con 0x7f6d1c1300a0 2023-10-03T10:11:54.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.121+0000 7f6d21b77700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d1c1300a0 0x7f6d1c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:54.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.121+0000 7f6d22378700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d1c133ad0 0x7f6d1c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:54.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.121+0000 7f6d22378700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d1c133ad0 0x7f6d1c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34728/0 (socket says 172.21.15.146:34728) 2023-10-03T10:11:54.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.121+0000 7f6d21b77700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d1c1300a0 0x7f6d1c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57986/0 (socket says 172.21.15.146:57986) 2023-10-03T10:11:54.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.121+0000 7f6d22378700 1 -- 172.21.15.146:0/637679853 learned_addr learned my addr 172.21.15.146:0/637679853 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:54.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.122+0000 7f6d22378700 1 -- 172.21.15.146:0/637679853 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d1c1300a0 msgr2=0x7f6d1c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:54.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.122+0000 7f6d22378700 1 --2- 172.21.15.146:0/637679853 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d1c1300a0 0x7f6d1c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.122+0000 7f6d22378700 1 -- 172.21.15.146:0/637679853 >> v1:172.21.15.146:6789/0 conn(0x7f6d1c1309f0 legacy=0x7f6d1c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:54.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.122+0000 7f6d22378700 1 -- 172.21.15.146:0/637679853 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1c1338b0 con 0x7f6d1c133ad0 2023-10-03T10:11:54.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.122+0000 7f6d21b77700 1 --2- 172.21.15.146:0/637679853 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d1c1300a0 0x7f6d1c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:54.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.122+0000 7f6d21376700 1 -- 172.21.15.146:0/637679853 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965665962 0 0) 0x7f6d1c06b2d0 con 0x7f6d1c1309f0 2023-10-03T10:11:54.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.122+0000 7f6d22378700 1 --2- 172.21.15.146:0/637679853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d1c133ad0 0x7f6d1c133ea0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c0098f0 tx=0x7f6d0c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d259e280cd08be3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:54.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.122+0000 7f6d21376700 1 -- 172.21.15.146:0/637679853 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c011830 con 0x7f6d1c133ad0 2023-10-03T10:11:54.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.122+0000 7f6d21376700 1 -- 172.21.15.146:0/637679853 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0c011990 con 0x7f6d1c133ad0 2023-10-03T10:11:54.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.122+0000 7f6d21376700 1 -- 172.21.15.146:0/637679853 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c011d20 con 0x7f6d1c133ad0 2023-10-03T10:11:54.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.123+0000 7f6d245dc700 1 -- 172.21.15.146:0/637679853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d1c133ad0 msgr2=0x7f6d1c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:54.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.123+0000 7f6d245dc700 1 --2- 172.21.15.146:0/637679853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d1c133ad0 0x7f6d1c133ea0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c0098f0 tx=0x7f6d0c009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:54.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.123+0000 7f6d245dc700 1 -- 172.21.15.146:0/637679853 shutdown_connections 2023-10-03T10:11:54.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.123+0000 7f6d245dc700 1 --2- 172.21.15.146:0/637679853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d1c133ad0 0x7f6d1c133ea0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.123+0000 7f6d245dc700 1 --2- 172.21.15.146:0/637679853 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d1c1300a0 0x7f6d1c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.123+0000 7f6d245dc700 1 -- 172.21.15.146:0/637679853 >> 172.21.15.146:0/637679853 conn(0x7f6d1c099c40 msgr2=0x7f6d1c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:54.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.123+0000 7f6d245dc700 1 -- 172.21.15.146:0/637679853 shutdown_connections 2023-10-03T10:11:54.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.123+0000 7f6d245dc700 1 -- 172.21.15.146:0/637679853 wait complete. 2023-10-03T10:11:54.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.124+0000 7f6d245dc700 1 Processor -- start 2023-10-03T10:11:54.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.124+0000 7f6d245dc700 1 -- start start 2023-10-03T10:11:54.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.124+0000 7f6d245dc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d1c1300a0 0x7f6d1c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:54.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.124+0000 7f6d245dc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d1c1309f0 0x7f6d1c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:54.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.124+0000 7f6d245dc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d1c133ad0 0x7f6d1c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:54.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.124+0000 7f6d245dc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c11fd70 con 0x7f6d1c1309f0 2023-10-03T10:11:54.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.124+0000 7f6d245dc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c11f080 con 0x7f6d1c1300a0 2023-10-03T10:11:54.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.124+0000 7f6d245dc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c120050 con 0x7f6d1c133ad0 2023-10-03T10:11:54.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.124+0000 7f6d21b77700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d1c1309f0 0x7f6d1c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:54.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.124+0000 7f6d21b77700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d1c1309f0 0x7f6d1c11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34740/0 (socket says 172.21.15.146:34740) 2023-10-03T10:11:54.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.124+0000 7f6d21b77700 1 -- 172.21.15.146:0/2062609166 learned_addr learned my addr 172.21.15.146:0/2062609166 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:54.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.124+0000 7f6d22b79700 1 --2- 172.21.15.146:0/2062609166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d1c133ad0 0x7f6d1c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:54.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.124+0000 7f6d22378700 1 --2- 172.21.15.146:0/2062609166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d1c1300a0 0x7f6d1c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:54.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.124+0000 7f6d21b77700 1 -- 172.21.15.146:0/2062609166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d1c133ad0 msgr2=0x7f6d1c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:54.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.124+0000 7f6d21b77700 1 --2- 172.21.15.146:0/2062609166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d1c133ad0 0x7f6d1c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.124+0000 7f6d21b77700 1 -- 172.21.15.146:0/2062609166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d1c1300a0 msgr2=0x7f6d1c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:54.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.124+0000 7f6d21b77700 1 --2- 172.21.15.146:0/2062609166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d1c1300a0 0x7f6d1c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.124+0000 7f6d21b77700 1 -- 172.21.15.146:0/2062609166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d180094a0 con 0x7f6d1c1309f0 2023-10-03T10:11:54.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.124+0000 7f6d22378700 1 --2- 172.21.15.146:0/2062609166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d1c1300a0 0x7f6d1c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:54.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.124+0000 7f6d22b79700 1 --2- 172.21.15.146:0/2062609166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d1c133ad0 0x7f6d1c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:54.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.125+0000 7f6d21b77700 1 --2- 172.21.15.146:0/2062609166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d1c1309f0 0x7f6d1c11df80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6d1800ebe0 tx=0x7f6d1800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:54.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.125+0000 7f6d12ffd700 1 -- 172.21.15.146:0/2062609166 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d18009760 con 0x7f6d1c1309f0 2023-10-03T10:11:54.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.125+0000 7f6d12ffd700 1 -- 172.21.15.146:0/2062609166 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1800c850 con 0x7f6d1c1309f0 2023-10-03T10:11:54.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.125+0000 7f6d245dc700 1 -- 172.21.15.146:0/2062609166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d0c009550 con 0x7f6d1c1309f0 2023-10-03T10:11:54.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.125+0000 7f6d12ffd700 1 -- 172.21.15.146:0/2062609166 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1800cbe0 con 0x7f6d1c1309f0 2023-10-03T10:11:54.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.125+0000 7f6d245dc700 1 -- 172.21.15.146:0/2062609166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d1c0a3350 con 0x7f6d1c1309f0 2023-10-03T10:11:54.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.126+0000 7f6d12ffd700 1 -- 172.21.15.146:0/2062609166 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f6d1800cd40 con 0x7f6d1c1309f0 2023-10-03T10:11:54.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.126+0000 7f6d12ffd700 1 -- 172.21.15.146:0/2062609166 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4038+0+0 (secure 0 0 0) 0x7f6d1803fab0 con 0x7f6d1c1309f0 2023-10-03T10:11:54.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.126+0000 7f6d245dc700 1 -- 172.21.15.146:0/2062609166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1c04f2a0 con 0x7f6d1c1309f0 2023-10-03T10:11:54.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.131+0000 7f6d12ffd700 1 -- 172.21.15.146:0/2062609166 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d1801b3b0 con 0x7f6d1c1309f0 2023-10-03T10:11:54.261 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:11:54.262 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:11:54.264 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:11:54.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.319+0000 7f6d245dc700 1 -- 172.21.15.146:0/2062609166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6d1c06c3b0 con 0x7f6d1c1309f0 2023-10-03T10:11:54.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.320+0000 7f6d12ffd700 1 -- 172.21.15.146:0/2062609166 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6d1802b090 con 0x7f6d1c1309f0 2023-10-03T10:11:54.320 INFO:teuthology.orchestra.run.smithi146.stdout:38654705690 2023-10-03T10:11:54.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.322+0000 7f6d245dc700 1 -- 172.21.15.146:0/2062609166 >> v1:172.21.15.146:6816/126749 conn(0x7f6d0002f270 legacy=0x7f6d00031720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:54.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.322+0000 7f6d245dc700 1 -- 172.21.15.146:0/2062609166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d1c1309f0 msgr2=0x7f6d1c11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:54.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.322+0000 7f6d245dc700 1 --2- 172.21.15.146:0/2062609166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d1c1309f0 0x7f6d1c11df80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6d1800ebe0 tx=0x7f6d1800eef0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.322+0000 7f6d245dc700 1 -- 172.21.15.146:0/2062609166 shutdown_connections 2023-10-03T10:11:54.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.322+0000 7f6d245dc700 1 --2- 172.21.15.146:0/2062609166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d1c133ad0 0x7f6d1c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.322+0000 7f6d245dc700 1 --2- 172.21.15.146:0/2062609166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d1c1300a0 0x7f6d1c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.322+0000 7f6d245dc700 1 --2- 172.21.15.146:0/2062609166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d1c1309f0 0x7f6d1c11df80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.323+0000 7f6d245dc700 1 -- 172.21.15.146:0/2062609166 >> 172.21.15.146:0/2062609166 conn(0x7f6d1c099c40 msgr2=0x7f6d1c12e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:54.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.323+0000 7f6d245dc700 1 -- 172.21.15.146:0/2062609166 shutdown_connections 2023-10-03T10:11:54.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.323+0000 7f6d245dc700 1 -- 172.21.15.146:0/2062609166 wait complete. 2023-10-03T10:11:54.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705690 for osd.2 2023-10-03T10:11:54.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.410+0000 7f22fb4aa700 1 Processor -- start 2023-10-03T10:11:54.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.410+0000 7f22fb4aa700 1 -- start start 2023-10-03T10:11:54.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.411+0000 7f22fb4aa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22f406a770 0x7f22f406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:54.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.411+0000 7f22fb4aa700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f22f409da80 0x7f22f406b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:54.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.411+0000 7f22fb4aa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22f4131740 0x7f22f4131bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:54.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.411+0000 7f22fb4aa700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f409f6a0 con 0x7f22f409da80 2023-10-03T10:11:54.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.411+0000 7f22fb4aa700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f406b5c0 con 0x7f22f4131740 2023-10-03T10:11:54.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.411+0000 7f22fb4aa700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22f409ec00 con 0x7f22f406a770 2023-10-03T10:11:54.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.411+0000 7f22f9246700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22f406a770 0x7f22f406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:54.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.411+0000 7f22f9246700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22f406a770 0x7f22f406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45738/0 (socket says 172.21.15.146:45738) 2023-10-03T10:11:54.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.411+0000 7f22f9246700 1 -- 172.21.15.146:0/745516573 learned_addr learned my addr 172.21.15.146:0/745516573 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:54.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.412+0000 7f22f8a45700 1 --2- 172.21.15.146:0/745516573 >> v2:172.21.15.146:3300/0 conn(0x7f22f409da80 0x7f22f406b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:54.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.412+0000 7f22f9246700 1 -- 172.21.15.146:0/745516573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22f4131740 msgr2=0x7f22f4131bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:54.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.412+0000 7f22f9246700 1 --2- 172.21.15.146:0/745516573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22f4131740 0x7f22f4131bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.412+0000 7f22f9246700 1 -- 172.21.15.146:0/745516573 >> v2:172.21.15.146:3300/0 conn(0x7f22f409da80 msgr2=0x7f22f406b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:54.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.412+0000 7f22f9246700 1 --2- 172.21.15.146:0/745516573 >> v2:172.21.15.146:3300/0 conn(0x7f22f409da80 0x7f22f406b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.412+0000 7f22f9246700 1 -- 172.21.15.146:0/745516573 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f409f230 con 0x7f22f406a770 2023-10-03T10:11:54.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.412+0000 7f22f8a45700 1 --2- 172.21.15.146:0/745516573 >> v2:172.21.15.146:3300/0 conn(0x7f22f409da80 0x7f22f406b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:11:54.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.412+0000 7f22f9246700 1 --2- 172.21.15.146:0/745516573 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22f406a770 0x7f22f406ab40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f22f0006fd0 tx=0x7f22f0009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f7f4d58df62a157 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:54.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.412+0000 7f22ebfff700 1 -- 172.21.15.146:0/745516573 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f0005e30 con 0x7f22f406a770 2023-10-03T10:11:54.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.412+0000 7f22ebfff700 1 -- 172.21.15.146:0/745516573 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f0004030 con 0x7f22f406a770 2023-10-03T10:11:54.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.412+0000 7f22ebfff700 1 -- 172.21.15.146:0/745516573 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f00043e0 con 0x7f22f406a770 2023-10-03T10:11:54.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.413+0000 7f22fb4aa700 1 -- 172.21.15.146:0/745516573 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22f406a770 msgr2=0x7f22f406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:54.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.413+0000 7f22fb4aa700 1 --2- 172.21.15.146:0/745516573 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22f406a770 0x7f22f406ab40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f22f0006fd0 tx=0x7f22f0009bd0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.413+0000 7f22fb4aa700 1 -- 172.21.15.146:0/745516573 shutdown_connections 2023-10-03T10:11:54.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.413+0000 7f22fb4aa700 1 --2- 172.21.15.146:0/745516573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22f4131740 0x7f22f4131bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.413+0000 7f22fb4aa700 1 --2- 172.21.15.146:0/745516573 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22f406a770 0x7f22f406ab40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.413+0000 7f22fb4aa700 1 --2- 172.21.15.146:0/745516573 >> v2:172.21.15.146:3300/0 conn(0x7f22f409da80 0x7f22f406b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.413+0000 7f22fb4aa700 1 -- 172.21.15.146:0/745516573 >> 172.21.15.146:0/745516573 conn(0x7f22f409f9f0 msgr2=0x7f22f409fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:54.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.414+0000 7f22fb4aa700 1 -- 172.21.15.146:0/745516573 shutdown_connections 2023-10-03T10:11:54.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.414+0000 7f22fb4aa700 1 -- 172.21.15.146:0/745516573 wait complete. 2023-10-03T10:11:54.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.415+0000 7f22fb4aa700 1 Processor -- start 2023-10-03T10:11:54.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.415+0000 7f22fb4aa700 1 -- start start 2023-10-03T10:11:54.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.415+0000 7f22fb4aa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22f406a770 0x7f22f41d2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:54.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.415+0000 7f22fb4aa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22f409da80 0x7f22f41d2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:54.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.415+0000 7f22fb4aa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22f4131740 0x7f22f41d5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:54.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.415+0000 7f22fb4aa700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f41d2b80 con 0x7f22f406a770 2023-10-03T10:11:54.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.415+0000 7f22fb4aa700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f41b8b30 con 0x7f22f4131740 2023-10-03T10:11:54.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.415+0000 7f22fb4aa700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22f40a2480 con 0x7f22f409da80 2023-10-03T10:11:54.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.415+0000 7f22f9246700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22f406a770 0x7f22f41d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:54.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.415+0000 7f22f9246700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22f406a770 0x7f22f41d2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33108/0 (socket says 172.21.15.146:33108) 2023-10-03T10:11:54.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.415+0000 7f22f9246700 1 -- 172.21.15.146:0/1214134424 learned_addr learned my addr 172.21.15.146:0/1214134424 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:54.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.415+0000 7f22f9a47700 1 --2- 172.21.15.146:0/1214134424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22f4131740 0x7f22f41d5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:54.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.416+0000 7f22f9246700 1 -- 172.21.15.146:0/1214134424 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22f409da80 msgr2=0x7f22f41d2640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:54.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.416+0000 7f22f9246700 1 --2- 172.21.15.146:0/1214134424 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22f409da80 0x7f22f41d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.416+0000 7f22f9246700 1 -- 172.21.15.146:0/1214134424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22f4131740 msgr2=0x7f22f41d5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:54.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.416+0000 7f22f9246700 1 --2- 172.21.15.146:0/1214134424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22f4131740 0x7f22f41d5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.416+0000 7f22f9246700 1 -- 172.21.15.146:0/1214134424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f0009500 con 0x7f22f406a770 2023-10-03T10:11:54.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.416+0000 7f22f9a47700 1 --2- 172.21.15.146:0/1214134424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22f4131740 0x7f22f41d5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:54.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.416+0000 7f22f9246700 1 --2- 172.21.15.146:0/1214134424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22f406a770 0x7f22f41d2100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f22f0009130 tx=0x7f22f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:54.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.417+0000 7fcf96bc4700 1 Processor -- start 2023-10-03T10:11:54.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.416+0000 7f22e9ffb700 1 -- 172.21.15.146:0/1214134424 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f0006b70 con 0x7f22f406a770 2023-10-03T10:11:54.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.416+0000 7f22fb4aa700 1 -- 172.21.15.146:0/1214134424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f4072230 con 0x7f22f406a770 2023-10-03T10:11:54.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.416+0000 7f22e9ffb700 1 -- 172.21.15.146:0/1214134424 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f0011420 con 0x7f22f406a770 2023-10-03T10:11:54.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.416+0000 7f22e9ffb700 1 -- 172.21.15.146:0/1214134424 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f00117d0 con 0x7f22f406a770 2023-10-03T10:11:54.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.417+0000 7f22fb4aa700 1 -- 172.21.15.146:0/1214134424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f412fd60 con 0x7f22f406a770 2023-10-03T10:11:54.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.417+0000 7f22e9ffb700 1 -- 172.21.15.146:0/1214134424 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f22f0011930 con 0x7f22f406a770 2023-10-03T10:11:54.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.417+0000 7f22e9ffb700 1 -- 172.21.15.146:0/1214134424 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f22f0040800 con 0x7f22f406a770 2023-10-03T10:11:54.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.418+0000 7fcf96bc4700 1 -- start start 2023-10-03T10:11:54.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.418+0000 7f22fb4aa700 1 -- 172.21.15.146:0/1214134424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f404f2a0 con 0x7f22f406a770 2023-10-03T10:11:54.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.418+0000 7fcf96bc4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf900a1550 0x7fcf9013d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:54.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.418+0000 7fcf96bc4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcf9013d790 0x7fcf9013fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:54.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.418+0000 7fcf96bc4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9009a6d0 con 0x7fcf900a0a70 2023-10-03T10:11:54.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.418+0000 7fcf96bc4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9006d2e0 con 0x7fcf9013d790 2023-10-03T10:11:54.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.418+0000 7fcf96bc4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900a21e0 con 0x7fcf900a1550 2023-10-03T10:11:54.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.418+0000 7fcf94960700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcf900a0a70 0x7fcf900a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40640/0 (socket says 172.21.15.146:40640) 2023-10-03T10:11:54.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.418+0000 7fcf94960700 1 -- 172.21.15.146:0/4006187061 learned_addr learned my addr 172.21.15.146:0/4006187061 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:11:54.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.420+0000 7fcf8ffff700 1 --2- 172.21.15.146:0/4006187061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf900a1550 0x7fcf9013d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:54.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.420+0000 7fcf95161700 1 --2- 172.21.15.146:0/4006187061 >> v2:172.21.15.146:3300/0 conn(0x7fcf9013d790 0x7fcf9013fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:54.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.420+0000 7fcf8ffff700 1 -- 172.21.15.146:0/4006187061 >> v2:172.21.15.146:3300/0 conn(0x7fcf9013d790 msgr2=0x7fcf9013fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:54.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.420+0000 7fcf8ffff700 1 --2- 172.21.15.146:0/4006187061 >> v2:172.21.15.146:3300/0 conn(0x7fcf9013d790 0x7fcf9013fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.420+0000 7fcf8ffff700 1 -- 172.21.15.146:0/4006187061 >> v1:172.21.15.146:6789/0 conn(0x7fcf900a0a70 legacy=0x7fcf900a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:54.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.420+0000 7fcf8ffff700 1 -- 172.21.15.146:0/4006187061 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9009d140 con 0x7fcf900a1550 2023-10-03T10:11:54.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.421+0000 7fcf8ffff700 1 --2- 172.21.15.146:0/4006187061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf900a1550 0x7fcf9013d250 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcf84009870 tx=0x7fcf84009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=304cfc20db467962 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:54.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.421+0000 7fcf8f7fe700 1 -- 172.21.15.146:0/4006187061 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf84011830 con 0x7fcf900a1550 2023-10-03T10:11:54.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.421+0000 7fcf8f7fe700 1 -- 172.21.15.146:0/4006187061 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf84011990 con 0x7fcf900a1550 2023-10-03T10:11:54.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.421+0000 7fcf8f7fe700 1 -- 172.21.15.146:0/4006187061 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf84011d20 con 0x7fcf900a1550 2023-10-03T10:11:54.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.421+0000 7fcf96bc4700 1 -- 172.21.15.146:0/4006187061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf900a1550 msgr2=0x7fcf9013d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:54.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.421+0000 7fcf96bc4700 1 --2- 172.21.15.146:0/4006187061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf900a1550 0x7fcf9013d250 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcf84009870 tx=0x7fcf84009b80 comp rx=0 tx=0).stop 2023-10-03T10:11:54.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.422+0000 7fcf96bc4700 1 -- 172.21.15.146:0/4006187061 shutdown_connections 2023-10-03T10:11:54.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.422+0000 7fcf96bc4700 1 --2- 172.21.15.146:0/4006187061 >> v2:172.21.15.146:3300/0 conn(0x7fcf9013d790 0x7fcf9013fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.422+0000 7fcf96bc4700 1 --2- 172.21.15.146:0/4006187061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf900a1550 0x7fcf9013d250 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.422+0000 7fcf96bc4700 1 -- 172.21.15.146:0/4006187061 >> 172.21.15.146:0/4006187061 conn(0x7fcf900a6210 msgr2=0x7fcf900a6610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:54.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.422+0000 7fcf96bc4700 1 -- 172.21.15.146:0/4006187061 shutdown_connections 2023-10-03T10:11:54.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.422+0000 7fcf96bc4700 1 -- 172.21.15.146:0/4006187061 wait complete. 2023-10-03T10:11:54.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.423+0000 7fcf96bc4700 1 Processor -- start 2023-10-03T10:11:54.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.423+0000 7fcf96bc4700 1 -- start start 2023-10-03T10:11:54.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.423+0000 7fcf96bc4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf900a0a70 0x7fcf901250f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:54.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.423+0000 7fcf96bc4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf900a1550 0x7fcf90125630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:54.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.423+0000 7fcf96bc4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf9013d790 0x7fcf90125b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:54.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.423+0000 7fcf96bc4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9009c140 con 0x7fcf900a0a70 2023-10-03T10:11:54.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.423+0000 7fcf96bc4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9013b0e0 con 0x7fcf9013d790 2023-10-03T10:11:54.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.423+0000 7fcf96bc4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf90126e70 con 0x7fcf900a1550 2023-10-03T10:11:54.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.424+0000 7fcf94960700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf900a0a70 0x7fcf901250f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:54.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.424+0000 7fcf94960700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf900a0a70 0x7fcf901250f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33134/0 (socket says 172.21.15.146:33134) 2023-10-03T10:11:54.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.424+0000 7fcf94960700 1 -- 172.21.15.146:0/3128871852 learned_addr learned my addr 172.21.15.146:0/3128871852 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:54.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.424+0000 7fcf8ffff700 1 --2- 172.21.15.146:0/3128871852 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf900a1550 0x7fcf90125630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:54.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.424+0000 7fcf95161700 1 --2- 172.21.15.146:0/3128871852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf9013d790 0x7fcf90125b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:54.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.424+0000 7fcf8ffff700 1 -- 172.21.15.146:0/3128871852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf9013d790 msgr2=0x7fcf90125b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:54.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.424+0000 7fcf8ffff700 1 --2- 172.21.15.146:0/3128871852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf9013d790 0x7fcf90125b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.424+0000 7fcf8ffff700 1 -- 172.21.15.146:0/3128871852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf900a0a70 msgr2=0x7fcf901250f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:54.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.424+0000 7fcf8ffff700 1 --2- 172.21.15.146:0/3128871852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf900a0a70 0x7fcf901250f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.424+0000 7fcf8ffff700 1 -- 172.21.15.146:0/3128871852 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf840094a0 con 0x7fcf900a1550 2023-10-03T10:11:54.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.424+0000 7fcf95161700 1 --2- 172.21.15.146:0/3128871852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf9013d790 0x7fcf90125b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:11:54.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.424+0000 7fcf8ffff700 1 --2- 172.21.15.146:0/3128871852 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf900a1550 0x7fcf90125630 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcf84016000 tx=0x7fcf84004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:54.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.424+0000 7fcf8d7fa700 1 -- 172.21.15.146:0/3128871852 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf84004480 con 0x7fcf900a1550 2023-10-03T10:11:54.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.424+0000 7fcf8d7fa700 1 -- 172.21.15.146:0/3128871852 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8401f070 con 0x7fcf900a1550 2023-10-03T10:11:54.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.424+0000 7fcf96bc4700 1 -- 172.21.15.146:0/3128871852 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf900a23e0 con 0x7fcf900a1550 2023-10-03T10:11:54.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.424+0000 7fcf8d7fa700 1 -- 172.21.15.146:0/3128871852 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf840038a0 con 0x7fcf900a1550 2023-10-03T10:11:54.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.424+0000 7f22e9ffb700 1 -- 172.21.15.146:0/1214134424 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f22f0020080 con 0x7f22f406a770 2023-10-03T10:11:54.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.424+0000 7fcf96bc4700 1 -- 172.21.15.146:0/3128871852 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf90129170 con 0x7fcf900a1550 2023-10-03T10:11:54.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.425+0000 7fcf96bc4700 1 -- 172.21.15.146:0/3128871852 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf90128400 con 0x7fcf900a1550 2023-10-03T10:11:54.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.426+0000 7fcf8d7fa700 1 -- 172.21.15.146:0/3128871852 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7fcf84021030 con 0x7fcf900a1550 2023-10-03T10:11:54.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.426+0000 7fcf8d7fa700 1 -- 172.21.15.146:0/3128871852 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fcf84040ae0 con 0x7fcf900a1550 2023-10-03T10:11:54.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.431+0000 7fcf8d7fa700 1 -- 172.21.15.146:0/3128871852 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf840239c0 con 0x7fcf900a1550 2023-10-03T10:11:54.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.470+0000 7fc2fb20e700 1 Processor -- start 2023-10-03T10:11:54.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.470+0000 7fc2fb20e700 1 -- start start 2023-10-03T10:11:54.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.471+0000 7fc2fb20e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc2f409d860 0x7fc2f409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:54.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.471+0000 7fc2fb20e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2f409e170 0x7fc2f41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:54.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.471+0000 7fc2fb20e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f409aaa0 con 0x7fc2f4130ce0 2023-10-03T10:11:54.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.471+0000 7fc2fb20e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f409f870 con 0x7fc2f409d860 2023-10-03T10:11:54.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.471+0000 7fc2fb20e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f409b360 con 0x7fc2f409e170 2023-10-03T10:11:54.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.474+0000 7fc2f8faa700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc2f409d860 0x7fc2f409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:54.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.474+0000 7fc2f8faa700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc2f409d860 0x7fc2f409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33164/0 (socket says 172.21.15.146:33164) 2023-10-03T10:11:54.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.474+0000 7fc2f8faa700 1 -- 172.21.15.146:0/814430307 learned_addr learned my addr 172.21.15.146:0/814430307 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:54.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.474+0000 7fc2f3fff700 1 --2- 172.21.15.146:0/814430307 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2f409e170 0x7fc2f41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:54.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.474+0000 7fc2f8faa700 1 -- 172.21.15.146:0/814430307 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2f409e170 msgr2=0x7fc2f41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:54.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.474+0000 7fc2f8faa700 1 --2- 172.21.15.146:0/814430307 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2f409e170 0x7fc2f41307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.474+0000 7fc2f8faa700 1 -- 172.21.15.146:0/814430307 >> v1:172.21.15.146:6789/0 conn(0x7fc2f4130ce0 legacy=0x7fc2f41379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:54.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.474+0000 7fc2f8faa700 1 -- 172.21.15.146:0/814430307 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f409b620 con 0x7fc2f409d860 2023-10-03T10:11:54.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.474+0000 7fc2f8faa700 1 --2- 172.21.15.146:0/814430307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f409d860 0x7fc2f409dc30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80098f0 tx=0x7fc2e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9f6079be71c84f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:54.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.474+0000 7fc2f37fe700 1 -- 172.21.15.146:0/814430307 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8004230 con 0x7fc2f409d860 2023-10-03T10:11:54.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.474+0000 7fc2f37fe700 1 -- 172.21.15.146:0/814430307 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e8004390 con 0x7fc2f409d860 2023-10-03T10:11:54.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.474+0000 7fc2f37fe700 1 -- 172.21.15.146:0/814430307 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80036a0 con 0x7fc2f409d860 2023-10-03T10:11:54.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.475+0000 7fc2fb20e700 1 -- 172.21.15.146:0/814430307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f409d860 msgr2=0x7fc2f409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:54.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.475+0000 7fc2fb20e700 1 --2- 172.21.15.146:0/814430307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f409d860 0x7fc2f409dc30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80098f0 tx=0x7fc2e8009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:54.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.476+0000 7fc2fb20e700 1 -- 172.21.15.146:0/814430307 shutdown_connections 2023-10-03T10:11:54.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.476+0000 7fc2fb20e700 1 --2- 172.21.15.146:0/814430307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f409d860 0x7fc2f409dc30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.476+0000 7fc2fb20e700 1 --2- 172.21.15.146:0/814430307 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2f409e170 0x7fc2f41307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.476+0000 7fc2fb20e700 1 -- 172.21.15.146:0/814430307 >> 172.21.15.146:0/814430307 conn(0x7fc2f4099c40 msgr2=0x7fc2f40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:54.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.476+0000 7fc2fb20e700 1 -- 172.21.15.146:0/814430307 shutdown_connections 2023-10-03T10:11:54.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.476+0000 7fc2fb20e700 1 -- 172.21.15.146:0/814430307 wait complete. 2023-10-03T10:11:54.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.477+0000 7fc2fb20e700 1 Processor -- start 2023-10-03T10:11:54.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.477+0000 7fc2fb20e700 1 -- start start 2023-10-03T10:11:54.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.478+0000 7fc2fb20e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f409d860 0x7fc2f41c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:54.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.478+0000 7fc2fb20e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2f409e170 0x7fc2f41c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:54.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.478+0000 7fc2fb20e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2f4130ce0 0x7fc2f4135720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:54.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.478+0000 7fc2fb20e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f4138d80 con 0x7fc2f409d860 2023-10-03T10:11:54.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.478+0000 7fc2fb20e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f409c8b0 con 0x7fc2f409e170 2023-10-03T10:11:54.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.478+0000 7fc2fb20e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f41c1040 con 0x7fc2f4130ce0 2023-10-03T10:11:54.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.478+0000 7fc2f97ab700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2f4130ce0 0x7fc2f4135720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:54.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.478+0000 7fc2f97ab700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2f4130ce0 0x7fc2f4135720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45788/0 (socket says 172.21.15.146:45788) 2023-10-03T10:11:54.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.478+0000 7fc2f97ab700 1 -- 172.21.15.146:0/1654699521 learned_addr learned my addr 172.21.15.146:0/1654699521 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:54.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.478+0000 7fc2f8faa700 1 --2- 172.21.15.146:0/1654699521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f409d860 0x7fc2f41c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:54.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.478+0000 7fc2f3fff700 1 --2- 172.21.15.146:0/1654699521 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2f409e170 0x7fc2f41c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:54.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.478+0000 7fc2f8faa700 1 -- 172.21.15.146:0/1654699521 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2f4130ce0 msgr2=0x7fc2f4135720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.478+0000 7fc2f8faa700 1 --2- 172.21.15.146:0/1654699521 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2f4130ce0 0x7fc2f4135720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.478+0000 7fc2f8faa700 1 -- 172.21.15.146:0/1654699521 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2f409e170 msgr2=0x7fc2f41c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.478+0000 7fc2f8faa700 1 --2- 172.21.15.146:0/1654699521 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2f409e170 0x7fc2f41c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.478+0000 7fc2f8faa700 1 -- 172.21.15.146:0/1654699521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e8009550 con 0x7fc2f409d860 2023-10-03T10:11:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.479+0000 7fc2f8faa700 1 --2- 172.21.15.146:0/1654699521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f409d860 0x7fc2f41c65e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc2f409f3a0 tx=0x7fc2e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.479+0000 7fc2f17fa700 1 -- 172.21.15.146:0/1654699521 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e801fb10 con 0x7fc2f409d860 2023-10-03T10:11:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.479+0000 7fc2f17fa700 1 -- 172.21.15.146:0/1654699521 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e8023070 con 0x7fc2f409d860 2023-10-03T10:11:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.479+0000 7fc2fb20e700 1 -- 172.21.15.146:0/1654699521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f4130560 con 0x7fc2f409d860 2023-10-03T10:11:54.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.479+0000 7fc2f17fa700 1 -- 172.21.15.146:0/1654699521 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e801fe70 con 0x7fc2f409d860 2023-10-03T10:11:54.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.479+0000 7fc2fb20e700 1 -- 172.21.15.146:0/1654699521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f4138f60 con 0x7fc2f409d860 2023-10-03T10:11:54.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.480+0000 7fc2f17fa700 1 -- 172.21.15.146:0/1654699521 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7fc2e8025030 con 0x7fc2f409d860 2023-10-03T10:11:54.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.480+0000 7fc2fb20e700 1 -- 172.21.15.146:0/1654699521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f404f2a0 con 0x7fc2f409d860 2023-10-03T10:11:54.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.480+0000 7fc2f17fa700 1 -- 172.21.15.146:0/1654699521 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fc2e80450b0 con 0x7fc2f409d860 2023-10-03T10:11:54.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.485+0000 7fc2f17fa700 1 -- 172.21.15.146:0/1654699521 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2e800bc10 con 0x7fc2f409d860 2023-10-03T10:11:54.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.654+0000 7f22fb4aa700 1 -- 172.21.15.146:0/1214134424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f22f4072d60 con 0x7f22f406a770 2023-10-03T10:11:54.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.654+0000 7f22e9ffb700 1 -- 172.21.15.146:0/1214134424 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f22f0016020 con 0x7f22f406a770 2023-10-03T10:11:54.654 INFO:teuthology.orchestra.run.smithi146.stdout:38654705692 2023-10-03T10:11:54.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.657+0000 7f22fb4aa700 1 -- 172.21.15.146:0/1214134424 >> v1:172.21.15.146:6816/126749 conn(0x7f22d802f240 legacy=0x7f22d80316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:54.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.657+0000 7f22fb4aa700 1 -- 172.21.15.146:0/1214134424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22f406a770 msgr2=0x7f22f41d2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:54.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.657+0000 7f22fb4aa700 1 --2- 172.21.15.146:0/1214134424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22f406a770 0x7f22f41d2100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f22f0009130 tx=0x7f22f0004750 comp rx=0 tx=0).stop 2023-10-03T10:11:54.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.657+0000 7f22fb4aa700 1 -- 172.21.15.146:0/1214134424 shutdown_connections 2023-10-03T10:11:54.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.657+0000 7f22fb4aa700 1 --2- 172.21.15.146:0/1214134424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22f4131740 0x7f22f41d5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.657+0000 7f22fb4aa700 1 --2- 172.21.15.146:0/1214134424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22f406a770 0x7f22f41d2100 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.657+0000 7f22fb4aa700 1 --2- 172.21.15.146:0/1214134424 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22f409da80 0x7f22f41d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.657+0000 7f22fb4aa700 1 -- 172.21.15.146:0/1214134424 >> 172.21.15.146:0/1214134424 conn(0x7f22f409f9f0 msgr2=0x7f22f40a19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:54.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.657+0000 7f22fb4aa700 1 -- 172.21.15.146:0/1214134424 shutdown_connections 2023-10-03T10:11:54.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.657+0000 7f22fb4aa700 1 -- 172.21.15.146:0/1214134424 wait complete. 2023-10-03T10:11:54.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.663+0000 7fcf96bc4700 1 -- 172.21.15.146:0/3128871852 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcf9004f2a0 con 0x7fcf900a1550 2023-10-03T10:11:54.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.664+0000 7fcf8d7fa700 1 -- 172.21.15.146:0/3128871852 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf84015020 con 0x7fcf900a1550 2023-10-03T10:11:54.664 INFO:teuthology.orchestra.run.smithi146.stdout:38654705692 2023-10-03T10:11:54.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.666+0000 7fcf96bc4700 1 -- 172.21.15.146:0/3128871852 >> v1:172.21.15.146:6816/126749 conn(0x7fcf7402f240 legacy=0x7fcf740316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:54.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.666+0000 7fcf96bc4700 1 -- 172.21.15.146:0/3128871852 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf900a1550 msgr2=0x7fcf90125630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:54.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.666+0000 7fcf96bc4700 1 --2- 172.21.15.146:0/3128871852 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf900a1550 0x7fcf90125630 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcf84016000 tx=0x7fcf84004750 comp rx=0 tx=0).stop 2023-10-03T10:11:54.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.666+0000 7fcf96bc4700 1 -- 172.21.15.146:0/3128871852 shutdown_connections 2023-10-03T10:11:54.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.666+0000 7fcf96bc4700 1 --2- 172.21.15.146:0/3128871852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf9013d790 0x7fcf90125b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.666+0000 7fcf96bc4700 1 --2- 172.21.15.146:0/3128871852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf900a0a70 0x7fcf901250f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.666+0000 7fcf96bc4700 1 --2- 172.21.15.146:0/3128871852 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf900a1550 0x7fcf90125630 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.666+0000 7fcf96bc4700 1 -- 172.21.15.146:0/3128871852 >> 172.21.15.146:0/3128871852 conn(0x7fcf900a6210 msgr2=0x7fcf9013b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:54.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.666+0000 7fcf96bc4700 1 -- 172.21.15.146:0/3128871852 shutdown_connections 2023-10-03T10:11:54.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.666+0000 7fcf96bc4700 1 -- 172.21.15.146:0/3128871852 wait complete. 2023-10-03T10:11:54.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705692 for osd.3 2023-10-03T10:11:54.670 DEBUG:teuthology.parallel:result is None 2023-10-03T10:11:54.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705692 for osd.1 2023-10-03T10:11:54.680 DEBUG:teuthology.parallel:result is None 2023-10-03T10:11:54.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.704+0000 7fc2fb20e700 1 -- 172.21.15.146:0/1654699521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc2f40a2240 con 0x7fc2f409d860 2023-10-03T10:11:54.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.704+0000 7fc2f17fa700 1 -- 172.21.15.146:0/1654699521 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc2e800be40 con 0x7fc2f409d860 2023-10-03T10:11:54.704 INFO:teuthology.orchestra.run.smithi146.stdout:38654705693 2023-10-03T10:11:54.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.707+0000 7fc2fb20e700 1 -- 172.21.15.146:0/1654699521 >> v1:172.21.15.146:6816/126749 conn(0x7fc2d802f270 legacy=0x7fc2d8031720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:54.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.707+0000 7fc2fb20e700 1 -- 172.21.15.146:0/1654699521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f409d860 msgr2=0x7fc2f41c65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:54.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.707+0000 7fc2fb20e700 1 --2- 172.21.15.146:0/1654699521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f409d860 0x7fc2f41c65e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc2f409f3a0 tx=0x7fc2e8004750 comp rx=0 tx=0).stop 2023-10-03T10:11:54.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.709+0000 7fc2fb20e700 1 -- 172.21.15.146:0/1654699521 shutdown_connections 2023-10-03T10:11:54.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.709+0000 7fc2fb20e700 1 --2- 172.21.15.146:0/1654699521 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2f4130ce0 0x7fc2f4135720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.709+0000 7fc2fb20e700 1 --2- 172.21.15.146:0/1654699521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f409d860 0x7fc2f41c65e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.709+0000 7fc2fb20e700 1 --2- 172.21.15.146:0/1654699521 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2f409e170 0x7fc2f41c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:54.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.709+0000 7fc2fb20e700 1 -- 172.21.15.146:0/1654699521 >> 172.21.15.146:0/1654699521 conn(0x7fc2f4099c40 msgr2=0x7fc2f4139680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:54.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.709+0000 7fc2fb20e700 1 -- 172.21.15.146:0/1654699521 shutdown_connections 2023-10-03T10:11:54.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:54.709+0000 7fc2fb20e700 1 -- 172.21.15.146:0/1654699521 wait complete. 2023-10-03T10:11:54.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705692 got 38654705693 for osd.0 2023-10-03T10:11:54.721 DEBUG:teuthology.parallel:result is None 2023-10-03T10:11:55.346 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:11:55.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.469+0000 7fb228bbe700 1 Processor -- start 2023-10-03T10:11:55.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.469+0000 7fb228bbe700 1 -- start start 2023-10-03T10:11:55.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.469+0000 7fb228bbe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb22409d860 0x7fb22409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:55.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.469+0000 7fb228bbe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb22409e170 0x7fb2241307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:55.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.469+0000 7fb228bbe700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb22409aaa0 con 0x7fb224130ce0 2023-10-03T10:11:55.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.469+0000 7fb228bbe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22409f870 con 0x7fb22409d860 2023-10-03T10:11:55.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.469+0000 7fb228bbe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb22409b360 con 0x7fb22409e170 2023-10-03T10:11:55.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.470+0000 7fb221d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb22409e170 0x7fb2241307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:55.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.470+0000 7fb222d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb224130ce0 0x7fb2241379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40666/0 (socket says 172.21.15.146:40666) 2023-10-03T10:11:55.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.470+0000 7fb22259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb22409d860 0x7fb22409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:55.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.470+0000 7fb222d9d700 1 -- 172.21.15.146:0/3645055974 learned_addr learned my addr 172.21.15.146:0/3645055974 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:11:55.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.470+0000 7fb22159a700 1 -- 172.21.15.146:0/3645055974 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3995363684 0 0) 0x7fb22409aaa0 con 0x7fb224130ce0 2023-10-03T10:11:55.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.470+0000 7fb22159a700 1 -- 172.21.15.146:0/3645055974 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb20c0035b0 con 0x7fb224130ce0 2023-10-03T10:11:55.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.470+0000 7fb22259c700 1 -- 172.21.15.146:0/3645055974 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb22409e170 msgr2=0x7fb2241307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:55.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.470+0000 7fb22259c700 1 --2- 172.21.15.146:0/3645055974 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb22409e170 0x7fb2241307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:55.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.470+0000 7fb22259c700 1 -- 172.21.15.146:0/3645055974 >> v1:172.21.15.146:6789/0 conn(0x7fb224130ce0 legacy=0x7fb2241379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:55.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.470+0000 7fb22259c700 1 -- 172.21.15.146:0/3645055974 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22409b620 con 0x7fb22409d860 2023-10-03T10:11:55.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.470+0000 7fb221d9b700 1 --2- 172.21.15.146:0/3645055974 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb22409e170 0x7fb2241307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:55.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.470+0000 7fb22259c700 1 --2- 172.21.15.146:0/3645055974 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb22409d860 0x7fb22409dc30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb218009870 tx=0x7fb218009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d74fd88d18e82d1a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:55.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.470+0000 7fb22159a700 1 -- 172.21.15.146:0/3645055974 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218011830 con 0x7fb22409d860 2023-10-03T10:11:55.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.470+0000 7fb22159a700 1 -- 172.21.15.146:0/3645055974 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb218011990 con 0x7fb22409d860 2023-10-03T10:11:55.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.470+0000 7fb22159a700 1 -- 172.21.15.146:0/3645055974 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218011d20 con 0x7fb22409d860 2023-10-03T10:11:55.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.471+0000 7fb228bbe700 1 -- 172.21.15.146:0/3645055974 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb22409d860 msgr2=0x7fb22409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:55.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.471+0000 7fb228bbe700 1 --2- 172.21.15.146:0/3645055974 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb22409d860 0x7fb22409dc30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb218009870 tx=0x7fb218009b80 comp rx=0 tx=0).stop 2023-10-03T10:11:55.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.471+0000 7fb228bbe700 1 -- 172.21.15.146:0/3645055974 shutdown_connections 2023-10-03T10:11:55.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.471+0000 7fb228bbe700 1 --2- 172.21.15.146:0/3645055974 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb22409d860 0x7fb22409dc30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:55.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.471+0000 7fb228bbe700 1 --2- 172.21.15.146:0/3645055974 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb22409e170 0x7fb2241307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:55.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.471+0000 7fb228bbe700 1 -- 172.21.15.146:0/3645055974 >> 172.21.15.146:0/3645055974 conn(0x7fb224099c40 msgr2=0x7fb2240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:55.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.471+0000 7fb228bbe700 1 -- 172.21.15.146:0/3645055974 shutdown_connections 2023-10-03T10:11:55.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.471+0000 7fb228bbe700 1 -- 172.21.15.146:0/3645055974 wait complete. 2023-10-03T10:11:55.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.472+0000 7fb228bbe700 1 Processor -- start 2023-10-03T10:11:55.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.472+0000 7fb228bbe700 1 -- start start 2023-10-03T10:11:55.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.472+0000 7fb228bbe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb22409d860 0x7fb224121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:55.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.472+0000 7fb228bbe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb22409e170 0x7fb224121b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:55.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.472+0000 7fb228bbe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb224130ce0 0x7fb2241220c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:55.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.472+0000 7fb228bbe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb224123e60 con 0x7fb22409d860 2023-10-03T10:11:55.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.472+0000 7fb228bbe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22409c8b0 con 0x7fb22409e170 2023-10-03T10:11:55.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.472+0000 7fb228bbe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb22406b510 con 0x7fb224130ce0 2023-10-03T10:11:55.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.472+0000 7fb221d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb22409e170 0x7fb224121b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:55.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.472+0000 7fb222d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb224130ce0 0x7fb2241220c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:55.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.472+0000 7fb221d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb22409e170 0x7fb224121b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59442/0 (socket says 172.21.15.146:59442) 2023-10-03T10:11:55.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.473+0000 7fb221d9b700 1 -- 172.21.15.146:0/1354588386 learned_addr learned my addr 172.21.15.146:0/1354588386 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:55.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.473+0000 7fb22259c700 1 --2- 172.21.15.146:0/1354588386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb22409d860 0x7fb224121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:55.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.473+0000 7fb221d9b700 1 -- 172.21.15.146:0/1354588386 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb224130ce0 msgr2=0x7fb2241220c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:55.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.473+0000 7fb221d9b700 1 --2- 172.21.15.146:0/1354588386 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb224130ce0 0x7fb2241220c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:55.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.473+0000 7fb221d9b700 1 -- 172.21.15.146:0/1354588386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb22409d860 msgr2=0x7fb224121640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:55.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.473+0000 7fb221d9b700 1 --2- 172.21.15.146:0/1354588386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb22409d860 0x7fb224121640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:55.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.473+0000 7fb221d9b700 1 -- 172.21.15.146:0/1354588386 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2140094a0 con 0x7fb22409e170 2023-10-03T10:11:55.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.473+0000 7fb222d9d700 1 --2- 172.21.15.146:0/1354588386 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb224130ce0 0x7fb2241220c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:55.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.473+0000 7fb221d9b700 1 --2- 172.21.15.146:0/1354588386 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb22409e170 0x7fb224121b80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb21400ebb0 tx=0x7fb21400eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:55.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.473+0000 7fb212ffd700 1 -- 172.21.15.146:0/1354588386 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21400c850 con 0x7fb22409e170 2023-10-03T10:11:55.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.473+0000 7fb212ffd700 1 -- 172.21.15.146:0/1354588386 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21400c9b0 con 0x7fb22409e170 2023-10-03T10:11:55.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.473+0000 7fb228bbe700 1 -- 172.21.15.146:0/1354588386 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2180094a0 con 0x7fb22409e170 2023-10-03T10:11:55.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.473+0000 7fb212ffd700 1 -- 172.21.15.146:0/1354588386 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21400cd40 con 0x7fb22409e170 2023-10-03T10:11:55.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.473+0000 7fb228bbe700 1 -- 172.21.15.146:0/1354588386 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2240a0820 con 0x7fb22409e170 2023-10-03T10:11:55.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.474+0000 7fb212ffd700 1 -- 172.21.15.146:0/1354588386 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7fb214013470 con 0x7fb22409e170 2023-10-03T10:11:55.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.474+0000 7fb212ffd700 1 -- 172.21.15.146:0/1354588386 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fb21403ff40 con 0x7fb22409e170 2023-10-03T10:11:55.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.474+0000 7fb228bbe700 1 -- 172.21.15.146:0/1354588386 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb22406ab30 con 0x7fb22409e170 2023-10-03T10:11:55.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.479+0000 7fb212ffd700 1 -- 172.21.15.146:0/1354588386 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb21401b3b0 con 0x7fb22409e170 2023-10-03T10:11:55.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.661+0000 7fb228bbe700 1 -- 172.21.15.146:0/1354588386 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb22404f2a0 con 0x7fb22409e170 2023-10-03T10:11:55.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.661+0000 7fb212ffd700 1 -- 172.21.15.146:0/1354588386 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb21402a090 con 0x7fb22409e170 2023-10-03T10:11:55.661 INFO:teuthology.orchestra.run.smithi146.stdout:38654705692 2023-10-03T10:11:55.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.663+0000 7fb228bbe700 1 -- 172.21.15.146:0/1354588386 >> v1:172.21.15.146:6816/126749 conn(0x7fb20402f480 legacy=0x7fb204031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:55.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.663+0000 7fb228bbe700 1 -- 172.21.15.146:0/1354588386 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb22409e170 msgr2=0x7fb224121b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:55.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.663+0000 7fb228bbe700 1 --2- 172.21.15.146:0/1354588386 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb22409e170 0x7fb224121b80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb21400ebb0 tx=0x7fb21400eec0 comp rx=0 tx=0).stop 2023-10-03T10:11:55.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.663+0000 7fb228bbe700 1 -- 172.21.15.146:0/1354588386 shutdown_connections 2023-10-03T10:11:55.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.663+0000 7fb228bbe700 1 --2- 172.21.15.146:0/1354588386 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb224130ce0 0x7fb2241220c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:55.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.663+0000 7fb228bbe700 1 --2- 172.21.15.146:0/1354588386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb22409d860 0x7fb224121640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:55.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.663+0000 7fb228bbe700 1 --2- 172.21.15.146:0/1354588386 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb22409e170 0x7fb224121b80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:55.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.663+0000 7fb228bbe700 1 -- 172.21.15.146:0/1354588386 >> 172.21.15.146:0/1354588386 conn(0x7fb224099c40 msgr2=0x7fb224119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:55.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.663+0000 7fb228bbe700 1 -- 172.21.15.146:0/1354588386 shutdown_connections 2023-10-03T10:11:55.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.663+0000 7fb228bbe700 1 -- 172.21.15.146:0/1354588386 wait complete. 2023-10-03T10:11:55.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705691 got 38654705692 for osd.2 2023-10-03T10:11:55.675 DEBUG:teuthology.parallel:result is None 2023-10-03T10:11:55.675 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-03T10:11:55.675 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:11:55.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.795+0000 7f4b58cfe700 1 Processor -- start 2023-10-03T10:11:55.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.796+0000 7f4b58cfe700 1 -- start start 2023-10-03T10:11:55.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.796+0000 7f4b58cfe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b54136960 0x7f4b54138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:55.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.796+0000 7f4b58cfe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b54139280 0x7f4b5413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:55.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.796+0000 7f4b58cfe700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b5406b2d0 con 0x7f4b54133ad0 2023-10-03T10:11:55.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.796+0000 7f4b58cfe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b541345b0 con 0x7f4b54139280 2023-10-03T10:11:55.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.796+0000 7f4b58cfe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b54133610 con 0x7f4b54136960 2023-10-03T10:11:55.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.796+0000 7f4b52d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b54139280 0x7f4b5413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:55.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.796+0000 7f4b51d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b54136960 0x7f4b54138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:55.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.796+0000 7f4b5259c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4b54133ad0 0x7f4b54133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40680/0 (socket says 172.21.15.146:40680) 2023-10-03T10:11:55.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.796+0000 7f4b5259c700 1 -- 172.21.15.146:0/768175821 learned_addr learned my addr 172.21.15.146:0/768175821 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:11:55.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.797+0000 7f4b5159a700 1 -- 172.21.15.146:0/768175821 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072088271 0 0) 0x7f4b5406b2d0 con 0x7f4b54133ad0 2023-10-03T10:11:55.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.797+0000 7f4b51d9b700 1 -- 172.21.15.146:0/768175821 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b54139280 msgr2=0x7f4b5413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:55.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.797+0000 7f4b51d9b700 1 --2- 172.21.15.146:0/768175821 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b54139280 0x7f4b5413b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:55.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.797+0000 7f4b51d9b700 1 -- 172.21.15.146:0/768175821 >> v1:172.21.15.146:6789/0 conn(0x7f4b54133ad0 legacy=0x7f4b54133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:55.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.797+0000 7f4b51d9b700 1 -- 172.21.15.146:0/768175821 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5409a500 con 0x7f4b54136960 2023-10-03T10:11:55.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.797+0000 7f4b52d9d700 1 --2- 172.21.15.146:0/768175821 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b54139280 0x7f4b5413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:55.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.797+0000 7f4b51d9b700 1 --2- 172.21.15.146:0/768175821 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b54136960 0x7f4b54138d40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009870 tx=0x7f4b44009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1a3df4394a1cd99 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:55.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.797+0000 7f4b5159a700 1 -- 172.21.15.146:0/768175821 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44011830 con 0x7f4b54136960 2023-10-03T10:11:55.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.797+0000 7f4b5159a700 1 -- 172.21.15.146:0/768175821 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b44011990 con 0x7f4b54136960 2023-10-03T10:11:55.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.797+0000 7f4b5159a700 1 -- 172.21.15.146:0/768175821 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44011d20 con 0x7f4b54136960 2023-10-03T10:11:55.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.797+0000 7f4b58cfe700 1 -- 172.21.15.146:0/768175821 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b54136960 msgr2=0x7f4b54138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:55.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.797+0000 7f4b58cfe700 1 --2- 172.21.15.146:0/768175821 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b54136960 0x7f4b54138d40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009870 tx=0x7f4b44009b80 comp rx=0 tx=0).stop 2023-10-03T10:11:55.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.798+0000 7f4b58cfe700 1 -- 172.21.15.146:0/768175821 shutdown_connections 2023-10-03T10:11:55.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.798+0000 7f4b58cfe700 1 --2- 172.21.15.146:0/768175821 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b54139280 0x7f4b5413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:55.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.798+0000 7f4b58cfe700 1 --2- 172.21.15.146:0/768175821 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b54136960 0x7f4b54138d40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:55.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.798+0000 7f4b58cfe700 1 -- 172.21.15.146:0/768175821 >> 172.21.15.146:0/768175821 conn(0x7f4b54099c40 msgr2=0x7f4b540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:55.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.798+0000 7f4b58cfe700 1 -- 172.21.15.146:0/768175821 shutdown_connections 2023-10-03T10:11:55.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.798+0000 7f4b58cfe700 1 -- 172.21.15.146:0/768175821 wait complete. 2023-10-03T10:11:55.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.799+0000 7f4b58cfe700 1 Processor -- start 2023-10-03T10:11:55.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.799+0000 7f4b58cfe700 1 -- start start 2023-10-03T10:11:55.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.800+0000 7f4b58cfe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b54133ad0 0x7f4b5412cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:55.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.800+0000 7f4b58cfe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b54136960 0x7f4b5412d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:55.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.800+0000 7f4b58cfe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b54139280 0x7f4b5412d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:55.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.800+0000 7f4b58cfe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b541316a0 con 0x7f4b54139280 2023-10-03T10:11:55.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.800+0000 7f4b58cfe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5406ede0 con 0x7f4b54136960 2023-10-03T10:11:55.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.800+0000 7f4b58cfe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5409f390 con 0x7f4b54133ad0 2023-10-03T10:11:55.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.800+0000 7f4b5259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b54133ad0 0x7f4b5412cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:55.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.800+0000 7f4b5259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b54133ad0 0x7f4b5412cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45848/0 (socket says 172.21.15.146:45848) 2023-10-03T10:11:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.800+0000 7f4b5259c700 1 -- 172.21.15.146:0/848383478 learned_addr learned my addr 172.21.15.146:0/848383478 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.800+0000 7f4b52d9d700 1 --2- 172.21.15.146:0/848383478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b54139280 0x7f4b5412d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.800+0000 7f4b51d9b700 1 --2- 172.21.15.146:0/848383478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b54136960 0x7f4b5412d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.800+0000 7f4b5259c700 1 -- 172.21.15.146:0/848383478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b54136960 msgr2=0x7f4b5412d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.800+0000 7f4b5259c700 1 --2- 172.21.15.146:0/848383478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b54136960 0x7f4b5412d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.800+0000 7f4b5259c700 1 -- 172.21.15.146:0/848383478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b54139280 msgr2=0x7f4b5412d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.800+0000 7f4b5259c700 1 --2- 172.21.15.146:0/848383478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b54139280 0x7f4b5412d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.800+0000 7f4b5259c700 1 -- 172.21.15.146:0/848383478 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c009a70 con 0x7f4b54133ad0 2023-10-03T10:11:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.800+0000 7f4b5259c700 1 --2- 172.21.15.146:0/848383478 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b54133ad0 0x7f4b5412cb30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800c520 tx=0x7f4b4800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.800+0000 7f4b42ffd700 1 -- 172.21.15.146:0/848383478 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b48004c80 con 0x7f4b54133ad0 2023-10-03T10:11:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.800+0000 7f4b42ffd700 1 -- 172.21.15.146:0/848383478 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b48004de0 con 0x7f4b54133ad0 2023-10-03T10:11:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.800+0000 7f4b58cfe700 1 -- 172.21.15.146:0/848383478 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b440094a0 con 0x7f4b54133ad0 2023-10-03T10:11:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.800+0000 7f4b42ffd700 1 -- 172.21.15.146:0/848383478 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b48007310 con 0x7f4b54133ad0 2023-10-03T10:11:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.800+0000 7f4b58cfe700 1 -- 172.21.15.146:0/848383478 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b54070c20 con 0x7f4b54133ad0 2023-10-03T10:11:55.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.801+0000 7f4b42ffd700 1 -- 172.21.15.146:0/848383478 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f4b48007470 con 0x7f4b54133ad0 2023-10-03T10:11:55.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.801+0000 7f4b42ffd700 1 -- 172.21.15.146:0/848383478 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f4b4803f710 con 0x7f4b54133ad0 2023-10-03T10:11:55.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.801+0000 7f4b58cfe700 1 -- 172.21.15.146:0/848383478 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b54072780 con 0x7f4b54133ad0 2023-10-03T10:11:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.806+0000 7f4b42ffd700 1 -- 172.21.15.146:0/848383478 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b480123b0 con 0x7f4b54133ad0 2023-10-03T10:11:55.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.985+0000 7f4b58cfe700 1 -- 172.21.15.146:0/848383478 --> v1:172.21.15.146:6816/126749 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b541338b0 con 0x7f4b3402f480 2023-10-03T10:11:55.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.992+0000 7f4b42ffd700 1 -- 172.21.15.146:0/848383478 <== mgr.14102 v1:172.21.15.146:6816/126749 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270314 (unknown 2965378022 0 694884499) 0x7f4b44006c80 con 0x7f4b3402f480 2023-10-03T10:11:55.995 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:11:55.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.995+0000 7f4b58cfe700 1 -- 172.21.15.146:0/848383478 >> v1:172.21.15.146:6816/126749 conn(0x7f4b3402f480 legacy=0x7f4b34031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:55.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.996+0000 7f4b58cfe700 1 -- 172.21.15.146:0/848383478 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b54133ad0 msgr2=0x7f4b5412cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:55.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.996+0000 7f4b58cfe700 1 --2- 172.21.15.146:0/848383478 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b54133ad0 0x7f4b5412cb30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800c520 tx=0x7f4b4800c830 comp rx=0 tx=0).stop 2023-10-03T10:11:55.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.996+0000 7f4b58cfe700 1 -- 172.21.15.146:0/848383478 shutdown_connections 2023-10-03T10:11:55.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.996+0000 7f4b58cfe700 1 --2- 172.21.15.146:0/848383478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b54139280 0x7f4b5412d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:55.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.996+0000 7f4b58cfe700 1 --2- 172.21.15.146:0/848383478 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b54133ad0 0x7f4b5412cb30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:55.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.996+0000 7f4b58cfe700 1 --2- 172.21.15.146:0/848383478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b54136960 0x7f4b5412d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:55.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.996+0000 7f4b58cfe700 1 -- 172.21.15.146:0/848383478 >> 172.21.15.146:0/848383478 conn(0x7f4b54099c40 msgr2=0x7f4b540a30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:55.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.996+0000 7f4b58cfe700 1 -- 172.21.15.146:0/848383478 shutdown_connections 2023-10-03T10:11:55.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:55.996+0000 7f4b58cfe700 1 -- 172.21.15.146:0/848383478 wait complete. 2023-10-03T10:11:55.999 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-03T10:11:56.007 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2023-10-03T10:11:54.344876+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189104,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298256,"statfs":{"total":386547056640,"available":385329414144,"internally_reserved":0,"allocated":737280,"data_stored":251436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.012247"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372444+0000","last_change":"2023-10-03T10:09:48.757714+0000","last_active":"2023-10-03T10:11:52.372444+0000","last_peered":"2023-10-03T10:11:52.372444+0000","last_clean":"2023-10-03T10:11:52.372444+0000","last_became_active":"2023-10-03T10:09:48.757453+0000","last_became_peered":"2023-10-03T10:09:48.757453+0000","last_unstale":"2023-10-03T10:11:52.372444+0000","last_undegraded":"2023-10-03T10:11:52.372444+0000","last_fullsized":"2023-10-03T10:11:52.372444+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372571+0000","last_change":"2023-10-03T10:09:48.741431+0000","last_active":"2023-10-03T10:11:52.372571+0000","last_peered":"2023-10-03T10:11:52.372571+0000","last_clean":"2023-10-03T10:11:52.372571+0000","last_became_active":"2023-10-03T10:09:48.741098+0000","last_became_peered":"2023-10-03T10:09:48.741098+0000","last_unstale":"2023-10-03T10:11:52.372571+0000","last_undegraded":"2023-10-03T10:11:52.372571+0000","last_fullsized":"2023-10-03T10:11:52.372571+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081223+0000","last_change":"2023-10-03T10:09:48.743956+0000","last_active":"2023-10-03T10:10:40.081223+0000","last_peered":"2023-10-03T10:10:40.081223+0000","last_clean":"2023-10-03T10:10:40.081223+0000","last_became_active":"2023-10-03T10:09:48.743706+0000","last_became_peered":"2023-10-03T10:09:48.743706+0000","last_unstale":"2023-10-03T10:10:40.081223+0000","last_undegraded":"2023-10-03T10:10:40.081223+0000","last_fullsized":"2023-10-03T10:10:40.081223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081366+0000","last_change":"2023-10-03T10:09:48.744824+0000","last_active":"2023-10-03T10:10:40.081366+0000","last_peered":"2023-10-03T10:10:40.081366+0000","last_clean":"2023-10-03T10:10:40.081366+0000","last_became_active":"2023-10-03T10:09:48.744559+0000","last_became_peered":"2023-10-03T10:09:48.744559+0000","last_unstale":"2023-10-03T10:10:40.081366+0000","last_undegraded":"2023-10-03T10:10:40.081366+0000","last_fullsized":"2023-10-03T10:10:40.081366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.093788+0000","last_change":"2023-10-03T10:10:40.089153+0000","last_active":"2023-10-03T10:10:40.093788+0000","last_peered":"2023-10-03T10:10:40.093788+0000","last_clean":"2023-10-03T10:10:40.093788+0000","last_became_active":"2023-10-03T10:10:40.088836+0000","last_became_peered":"2023-10-03T10:10:40.088836+0000","last_unstale":"2023-10-03T10:10:40.093788+0000","last_undegraded":"2023-10-03T10:10:40.093788+0000","last_fullsized":"2023-10-03T10:10:40.093788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091067+0000","last_change":"2023-10-03T10:10:40.086811+0000","last_active":"2023-10-03T10:10:40.091067+0000","last_peered":"2023-10-03T10:10:40.091067+0000","last_clean":"2023-10-03T10:10:40.091067+0000","last_became_active":"2023-10-03T10:10:40.086501+0000","last_became_peered":"2023-10-03T10:10:40.086501+0000","last_unstale":"2023-10-03T10:10:40.091067+0000","last_undegraded":"2023-10-03T10:10:40.091067+0000","last_fullsized":"2023-10-03T10:10:40.091067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081089+0000","last_change":"2023-10-03T10:09:48.762070+0000","last_active":"2023-10-03T10:10:40.081089+0000","last_peered":"2023-10-03T10:10:40.081089+0000","last_clean":"2023-10-03T10:10:40.081089+0000","last_became_active":"2023-10-03T10:09:48.758238+0000","last_became_peered":"2023-10-03T10:09:48.758238+0000","last_unstale":"2023-10-03T10:10:40.081089+0000","last_undegraded":"2023-10-03T10:10:40.081089+0000","last_fullsized":"2023-10-03T10:10:40.081089+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091501+0000","last_change":"2023-10-03T10:09:48.746713+0000","last_active":"2023-10-03T10:10:40.091501+0000","last_peered":"2023-10-03T10:10:40.091501+0000","last_clean":"2023-10-03T10:10:40.091501+0000","last_became_active":"2023-10-03T10:09:48.746426+0000","last_became_peered":"2023-10-03T10:09:48.746426+0000","last_unstale":"2023-10-03T10:10:40.091501+0000","last_undegraded":"2023-10-03T10:10:40.091501+0000","last_fullsized":"2023-10-03T10:10:40.091501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.082428+0000","last_change":"2023-10-03T10:09:48.757336+0000","last_active":"2023-10-03T10:10:40.082428+0000","last_peered":"2023-10-03T10:10:40.082428+0000","last_clean":"2023-10-03T10:10:40.082428+0000","last_became_active":"2023-10-03T10:09:48.757059+0000","last_became_peered":"2023-10-03T10:09:48.757059+0000","last_unstale":"2023-10-03T10:10:40.082428+0000","last_undegraded":"2023-10-03T10:10:40.082428+0000","last_fullsized":"2023-10-03T10:10:40.082428+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.092161+0000","last_change":"2023-10-03T10:09:48.748969+0000","last_active":"2023-10-03T10:10:40.092161+0000","last_peered":"2023-10-03T10:10:40.092161+0000","last_clean":"2023-10-03T10:10:40.092161+0000","last_became_active":"2023-10-03T10:09:48.746842+0000","last_became_peered":"2023-10-03T10:09:48.746842+0000","last_unstale":"2023-10-03T10:10:40.092161+0000","last_undegraded":"2023-10-03T10:10:40.092161+0000","last_fullsized":"2023-10-03T10:10:40.092161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091836+0000","last_change":"2023-10-03T10:09:48.745732+0000","last_active":"2023-10-03T10:10:40.091836+0000","last_peered":"2023-10-03T10:10:40.091836+0000","last_clean":"2023-10-03T10:10:40.091836+0000","last_became_active":"2023-10-03T10:09:48.745451+0000","last_became_peered":"2023-10-03T10:09:48.745451+0000","last_unstale":"2023-10-03T10:10:40.091836+0000","last_undegraded":"2023-10-03T10:10:40.091836+0000","last_fullsized":"2023-10-03T10:10:40.091836+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372265+0000","last_change":"2023-10-03T10:09:48.758809+0000","last_active":"2023-10-03T10:11:52.372265+0000","last_peered":"2023-10-03T10:11:52.372265+0000","last_clean":"2023-10-03T10:11:52.372265+0000","last_became_active":"2023-10-03T10:09:48.758533+0000","last_became_peered":"2023-10-03T10:09:48.758533+0000","last_unstale":"2023-10-03T10:11:52.372265+0000","last_undegraded":"2023-10-03T10:11:52.372265+0000","last_fullsized":"2023-10-03T10:11:52.372265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372048+0000","last_change":"2023-10-03T10:09:48.759114+0000","last_active":"2023-10-03T10:11:52.372048+0000","last_peered":"2023-10-03T10:11:52.372048+0000","last_clean":"2023-10-03T10:11:52.372048+0000","last_became_active":"2023-10-03T10:09:48.758569+0000","last_became_peered":"2023-10-03T10:09:48.758569+0000","last_unstale":"2023-10-03T10:11:52.372048+0000","last_undegraded":"2023-10-03T10:11:52.372048+0000","last_fullsized":"2023-10-03T10:11:52.372048+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.092105+0000","last_change":"2023-10-03T10:09:48.740857+0000","last_active":"2023-10-03T10:10:40.092105+0000","last_peered":"2023-10-03T10:10:40.092105+0000","last_clean":"2023-10-03T10:10:40.092105+0000","last_became_active":"2023-10-03T10:09:48.740608+0000","last_became_peered":"2023-10-03T10:09:48.740608+0000","last_unstale":"2023-10-03T10:10:40.092105+0000","last_undegraded":"2023-10-03T10:10:40.092105+0000","last_fullsized":"2023-10-03T10:10:40.092105+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.080968+0000","last_change":"2023-10-03T10:09:48.740412+0000","last_active":"2023-10-03T10:10:40.080968+0000","last_peered":"2023-10-03T10:10:40.080968+0000","last_clean":"2023-10-03T10:10:40.080968+0000","last_became_active":"2023-10-03T10:09:48.740146+0000","last_became_peered":"2023-10-03T10:09:48.740146+0000","last_unstale":"2023-10-03T10:10:40.080968+0000","last_undegraded":"2023-10-03T10:10:40.080968+0000","last_fullsized":"2023-10-03T10:10:40.080968+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.080842+0000","last_change":"2023-10-03T10:09:48.758060+0000","last_active":"2023-10-03T10:10:40.080842+0000","last_peered":"2023-10-03T10:10:40.080842+0000","last_clean":"2023-10-03T10:10:40.080842+0000","last_became_active":"2023-10-03T10:09:48.757793+0000","last_became_peered":"2023-10-03T10:09:48.757793+0000","last_unstale":"2023-10-03T10:10:40.080842+0000","last_undegraded":"2023-10-03T10:10:40.080842+0000","last_fullsized":"2023-10-03T10:10:40.080842+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.094090+0000","last_change":"2023-10-03T10:10:40.089801+0000","last_active":"2023-10-03T10:10:40.094090+0000","last_peered":"2023-10-03T10:10:40.094090+0000","last_clean":"2023-10-03T10:10:40.094090+0000","last_became_active":"2023-10-03T10:10:40.089488+0000","last_became_peered":"2023-10-03T10:10:40.089488+0000","last_unstale":"2023-10-03T10:10:40.094090+0000","last_undegraded":"2023-10-03T10:10:40.094090+0000","last_fullsized":"2023-10-03T10:10:40.094090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081771+0000","last_change":"2023-10-03T10:09:48.745373+0000","last_active":"2023-10-03T10:10:40.081771+0000","last_peered":"2023-10-03T10:10:40.081771+0000","last_clean":"2023-10-03T10:10:40.081771+0000","last_became_active":"2023-10-03T10:09:48.744351+0000","last_became_peered":"2023-10-03T10:09:48.744351+0000","last_unstale":"2023-10-03T10:10:40.081771+0000","last_undegraded":"2023-10-03T10:10:40.081771+0000","last_fullsized":"2023-10-03T10:10:40.081771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372232+0000","last_change":"2023-10-03T10:09:48.759606+0000","last_active":"2023-10-03T10:11:52.372232+0000","last_peered":"2023-10-03T10:11:52.372232+0000","last_clean":"2023-10-03T10:11:52.372232+0000","last_became_active":"2023-10-03T10:09:48.759343+0000","last_became_peered":"2023-10-03T10:09:48.759343+0000","last_unstale":"2023-10-03T10:11:52.372232+0000","last_undegraded":"2023-10-03T10:11:52.372232+0000","last_fullsized":"2023-10-03T10:11:52.372232+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091450+0000","last_change":"2023-10-03T10:09:48.760055+0000","last_active":"2023-10-03T10:10:40.091450+0000","last_peered":"2023-10-03T10:10:40.091450+0000","last_clean":"2023-10-03T10:10:40.091450+0000","last_became_active":"2023-10-03T10:09:48.759787+0000","last_became_peered":"2023-10-03T10:09:48.759787+0000","last_unstale":"2023-10-03T10:10:40.091450+0000","last_undegraded":"2023-10-03T10:10:40.091450+0000","last_fullsized":"2023-10-03T10:10:40.091450+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091462+0000","last_change":"2023-10-03T10:09:48.753483+0000","last_active":"2023-10-03T10:10:40.091462+0000","last_peered":"2023-10-03T10:10:40.091462+0000","last_clean":"2023-10-03T10:10:40.091462+0000","last_became_active":"2023-10-03T10:09:48.752879+0000","last_became_peered":"2023-10-03T10:09:48.752879+0000","last_unstale":"2023-10-03T10:10:40.091462+0000","last_undegraded":"2023-10-03T10:10:40.091462+0000","last_fullsized":"2023-10-03T10:10:40.091462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081340+0000","last_change":"2023-10-03T10:09:48.745699+0000","last_active":"2023-10-03T10:10:40.081340+0000","last_peered":"2023-10-03T10:10:40.081340+0000","last_clean":"2023-10-03T10:10:40.081340+0000","last_became_active":"2023-10-03T10:09:48.745433+0000","last_became_peered":"2023-10-03T10:09:48.745433+0000","last_unstale":"2023-10-03T10:10:40.081340+0000","last_undegraded":"2023-10-03T10:10:40.081340+0000","last_fullsized":"2023-10-03T10:10:40.081340+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372010+0000","last_change":"2023-10-03T10:10:40.086151+0000","last_active":"2023-10-03T10:11:52.372010+0000","last_peered":"2023-10-03T10:11:52.372010+0000","last_clean":"2023-10-03T10:11:52.372010+0000","last_became_active":"2023-10-03T10:10:40.085827+0000","last_became_peered":"2023-10-03T10:10:40.085827+0000","last_unstale":"2023-10-03T10:11:52.372010+0000","last_undegraded":"2023-10-03T10:11:52.372010+0000","last_fullsized":"2023-10-03T10:11:52.372010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091580+0000","last_change":"2023-10-03T10:09:48.760358+0000","last_active":"2023-10-03T10:10:40.091580+0000","last_peered":"2023-10-03T10:10:40.091580+0000","last_clean":"2023-10-03T10:10:40.091580+0000","last_became_active":"2023-10-03T10:09:48.754451+0000","last_became_peered":"2023-10-03T10:09:48.754451+0000","last_unstale":"2023-10-03T10:10:40.091580+0000","last_undegraded":"2023-10-03T10:10:40.091580+0000","last_fullsized":"2023-10-03T10:10:40.091580+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.092270+0000","last_change":"2023-10-03T10:09:48.763060+0000","last_active":"2023-10-03T10:10:40.092270+0000","last_peered":"2023-10-03T10:10:40.092270+0000","last_clean":"2023-10-03T10:10:40.092270+0000","last_became_active":"2023-10-03T10:09:48.762772+0000","last_became_peered":"2023-10-03T10:09:48.762772+0000","last_unstale":"2023-10-03T10:10:40.092270+0000","last_undegraded":"2023-10-03T10:10:40.092270+0000","last_fullsized":"2023-10-03T10:10:40.092270+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.092009+0000","last_change":"2023-10-03T10:09:48.740694+0000","last_active":"2023-10-03T10:10:40.092009+0000","last_peered":"2023-10-03T10:10:40.092009+0000","last_clean":"2023-10-03T10:10:40.092009+0000","last_became_active":"2023-10-03T10:09:48.740403+0000","last_became_peered":"2023-10-03T10:09:48.740403+0000","last_unstale":"2023-10-03T10:10:40.092009+0000","last_undegraded":"2023-10-03T10:10:40.092009+0000","last_fullsized":"2023-10-03T10:10:40.092009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.082088+0000","last_change":"2023-10-03T10:09:48.762261+0000","last_active":"2023-10-03T10:10:40.082088+0000","last_peered":"2023-10-03T10:10:40.082088+0000","last_clean":"2023-10-03T10:10:40.082088+0000","last_became_active":"2023-10-03T10:09:48.758917+0000","last_became_peered":"2023-10-03T10:09:48.758917+0000","last_unstale":"2023-10-03T10:10:40.082088+0000","last_undegraded":"2023-10-03T10:10:40.082088+0000","last_fullsized":"2023-10-03T10:10:40.082088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091873+0000","last_change":"2023-10-03T10:09:48.371325+0000","last_active":"2023-10-03T10:10:40.091873+0000","last_peered":"2023-10-03T10:10:40.091873+0000","last_clean":"2023-10-03T10:10:40.091873+0000","last_became_active":"2023-10-03T10:09:48.371116+0000","last_became_peered":"2023-10-03T10:09:48.371116+0000","last_unstale":"2023-10-03T10:10:40.091873+0000","last_undegraded":"2023-10-03T10:10:40.091873+0000","last_fullsized":"2023-10-03T10:10:40.091873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.082162+0000","last_change":"2023-10-03T10:09:48.766155+0000","last_active":"2023-10-03T10:10:40.082162+0000","last_peered":"2023-10-03T10:10:40.082162+0000","last_clean":"2023-10-03T10:10:40.082162+0000","last_became_active":"2023-10-03T10:09:48.765746+0000","last_became_peered":"2023-10-03T10:09:48.765746+0000","last_unstale":"2023-10-03T10:10:40.082162+0000","last_undegraded":"2023-10-03T10:10:40.082162+0000","last_fullsized":"2023-10-03T10:10:40.082162+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091100+0000","last_change":"2023-10-03T10:09:48.377430+0000","last_active":"2023-10-03T10:10:40.091100+0000","last_peered":"2023-10-03T10:10:40.091100+0000","last_clean":"2023-10-03T10:10:40.091100+0000","last_became_active":"2023-10-03T10:09:48.376947+0000","last_became_peered":"2023-10-03T10:09:48.376947+0000","last_unstale":"2023-10-03T10:10:40.091100+0000","last_undegraded":"2023-10-03T10:10:40.091100+0000","last_fullsized":"2023-10-03T10:10:40.091100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081931+0000","last_change":"2023-10-03T10:09:48.745599+0000","last_active":"2023-10-03T10:10:40.081931+0000","last_peered":"2023-10-03T10:10:40.081931+0000","last_clean":"2023-10-03T10:10:40.081931+0000","last_became_active":"2023-10-03T10:09:48.744772+0000","last_became_peered":"2023-10-03T10:09:48.744772+0000","last_unstale":"2023-10-03T10:10:40.081931+0000","last_undegraded":"2023-10-03T10:10:40.081931+0000","last_fullsized":"2023-10-03T10:10:40.081931+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081221+0000","last_change":"2023-10-03T10:09:48.365550+0000","last_active":"2023-10-03T10:10:40.081221+0000","last_peered":"2023-10-03T10:10:40.081221+0000","last_clean":"2023-10-03T10:10:40.081221+0000","last_became_active":"2023-10-03T10:09:48.364969+0000","last_became_peered":"2023-10-03T10:09:48.364969+0000","last_unstale":"2023-10-03T10:10:40.081221+0000","last_undegraded":"2023-10-03T10:10:40.081221+0000","last_fullsized":"2023-10-03T10:10:40.081221+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.084408+0000","last_change":"2023-10-03T10:09:48.768231+0000","last_active":"2023-10-03T10:10:40.084408+0000","last_peered":"2023-10-03T10:10:40.084408+0000","last_clean":"2023-10-03T10:10:40.084408+0000","last_became_active":"2023-10-03T10:09:48.767982+0000","last_became_peered":"2023-10-03T10:09:48.767982+0000","last_unstale":"2023-10-03T10:10:40.084408+0000","last_undegraded":"2023-10-03T10:10:40.084408+0000","last_fullsized":"2023-10-03T10:10:40.084408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081595+0000","last_change":"2023-10-03T10:09:48.372222+0000","last_active":"2023-10-03T10:10:40.081595+0000","last_peered":"2023-10-03T10:10:40.081595+0000","last_clean":"2023-10-03T10:10:40.081595+0000","last_became_active":"2023-10-03T10:09:48.371919+0000","last_became_peered":"2023-10-03T10:09:48.371919+0000","last_unstale":"2023-10-03T10:10:40.081595+0000","last_undegraded":"2023-10-03T10:10:40.081595+0000","last_fullsized":"2023-10-03T10:10:40.081595+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081268+0000","last_change":"2023-10-03T10:09:48.766829+0000","last_active":"2023-10-03T10:10:40.081268+0000","last_peered":"2023-10-03T10:10:40.081268+0000","last_clean":"2023-10-03T10:10:40.081268+0000","last_became_active":"2023-10-03T10:09:48.766356+0000","last_became_peered":"2023-10-03T10:09:48.766356+0000","last_unstale":"2023-10-03T10:10:40.081268+0000","last_undegraded":"2023-10-03T10:10:40.081268+0000","last_fullsized":"2023-10-03T10:10:40.081268+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372434+0000","last_change":"2023-10-03T10:09:48.375954+0000","last_active":"2023-10-03T10:11:52.372434+0000","last_peered":"2023-10-03T10:11:52.372434+0000","last_clean":"2023-10-03T10:11:52.372434+0000","last_became_active":"2023-10-03T10:09:48.375703+0000","last_became_peered":"2023-10-03T10:09:48.375703+0000","last_unstale":"2023-10-03T10:11:52.372434+0000","last_undegraded":"2023-10-03T10:11:52.372434+0000","last_fullsized":"2023-10-03T10:11:52.372434+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081315+0000","last_change":"2023-10-03T10:09:48.762438+0000","last_active":"2023-10-03T10:10:40.081315+0000","last_peered":"2023-10-03T10:10:40.081315+0000","last_clean":"2023-10-03T10:10:40.081315+0000","last_became_active":"2023-10-03T10:09:48.758825+0000","last_became_peered":"2023-10-03T10:09:48.758825+0000","last_unstale":"2023-10-03T10:10:40.081315+0000","last_undegraded":"2023-10-03T10:10:40.081315+0000","last_fullsized":"2023-10-03T10:10:40.081315+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081142+0000","last_change":"2023-10-03T10:09:48.377186+0000","last_active":"2023-10-03T10:10:40.081142+0000","last_peered":"2023-10-03T10:10:40.081142+0000","last_clean":"2023-10-03T10:10:40.081142+0000","last_became_active":"2023-10-03T10:09:48.376584+0000","last_became_peered":"2023-10-03T10:09:48.376584+0000","last_unstale":"2023-10-03T10:10:40.081142+0000","last_undegraded":"2023-10-03T10:10:40.081142+0000","last_fullsized":"2023-10-03T10:10:40.081142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.092065+0000","last_change":"2023-10-03T10:09:48.762792+0000","last_active":"2023-10-03T10:10:40.092065+0000","last_peered":"2023-10-03T10:10:40.092065+0000","last_clean":"2023-10-03T10:10:40.092065+0000","last_became_active":"2023-10-03T10:09:48.762334+0000","last_became_peered":"2023-10-03T10:09:48.762334+0000","last_unstale":"2023-10-03T10:10:40.092065+0000","last_undegraded":"2023-10-03T10:10:40.092065+0000","last_fullsized":"2023-10-03T10:10:40.092065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'12","reported_seq":26,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.385697+0000","last_change":"2023-10-03T10:09:48.370604+0000","last_active":"2023-10-03T10:11:52.385697+0000","last_peered":"2023-10-03T10:11:52.385697+0000","last_clean":"2023-10-03T10:11:52.385697+0000","last_became_active":"2023-10-03T10:09:48.370305+0000","last_became_peered":"2023-10-03T10:09:48.370305+0000","last_unstale":"2023-10-03T10:11:52.385697+0000","last_undegraded":"2023-10-03T10:11:52.385697+0000","last_fullsized":"2023-10-03T10:11:52.385697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3563,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.371868+0000","last_change":"2023-10-03T10:09:48.758807+0000","last_active":"2023-10-03T10:11:52.371868+0000","last_peered":"2023-10-03T10:11:52.371868+0000","last_clean":"2023-10-03T10:11:52.371868+0000","last_became_active":"2023-10-03T10:09:48.757966+0000","last_became_peered":"2023-10-03T10:09:48.757966+0000","last_unstale":"2023-10-03T10:11:52.371868+0000","last_undegraded":"2023-10-03T10:11:52.371868+0000","last_fullsized":"2023-10-03T10:11:52.371868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.085084+0000","last_change":"2023-10-03T10:09:48.367621+0000","last_active":"2023-10-03T10:10:40.085084+0000","last_peered":"2023-10-03T10:10:40.085084+0000","last_clean":"2023-10-03T10:10:40.085084+0000","last_became_active":"2023-10-03T10:09:48.367354+0000","last_became_peered":"2023-10-03T10:09:48.367354+0000","last_unstale":"2023-10-03T10:10:40.085084+0000","last_undegraded":"2023-10-03T10:10:40.085084+0000","last_fullsized":"2023-10-03T10:10:40.085084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.082135+0000","last_change":"2023-10-03T10:09:48.763072+0000","last_active":"2023-10-03T10:10:40.082135+0000","last_peered":"2023-10-03T10:10:40.082135+0000","last_clean":"2023-10-03T10:10:40.082135+0000","last_became_active":"2023-10-03T10:09:48.762225+0000","last_became_peered":"2023-10-03T10:09:48.762225+0000","last_unstale":"2023-10-03T10:10:40.082135+0000","last_undegraded":"2023-10-03T10:10:40.082135+0000","last_fullsized":"2023-10-03T10:10:40.082135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081385+0000","last_change":"2023-10-03T10:09:48.380634+0000","last_active":"2023-10-03T10:10:40.081385+0000","last_peered":"2023-10-03T10:10:40.081385+0000","last_clean":"2023-10-03T10:10:40.081385+0000","last_became_active":"2023-10-03T10:09:48.380317+0000","last_became_peered":"2023-10-03T10:09:48.380317+0000","last_unstale":"2023-10-03T10:10:40.081385+0000","last_undegraded":"2023-10-03T10:10:40.081385+0000","last_fullsized":"2023-10-03T10:10:40.081385+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.086915+0000","last_change":"2023-10-03T10:09:48.769900+0000","last_active":"2023-10-03T10:10:40.086915+0000","last_peered":"2023-10-03T10:10:40.086915+0000","last_clean":"2023-10-03T10:10:40.086915+0000","last_became_active":"2023-10-03T10:09:48.769431+0000","last_became_peered":"2023-10-03T10:09:48.769431+0000","last_unstale":"2023-10-03T10:10:40.086915+0000","last_undegraded":"2023-10-03T10:10:40.086915+0000","last_fullsized":"2023-10-03T10:10:40.086915+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081238+0000","last_change":"2023-10-03T10:09:48.374660+0000","last_active":"2023-10-03T10:10:40.081238+0000","last_peered":"2023-10-03T10:10:40.081238+0000","last_clean":"2023-10-03T10:10:40.081238+0000","last_became_active":"2023-10-03T10:09:48.371590+0000","last_became_peered":"2023-10-03T10:09:48.371590+0000","last_unstale":"2023-10-03T10:10:40.081238+0000","last_undegraded":"2023-10-03T10:10:40.081238+0000","last_fullsized":"2023-10-03T10:10:40.081238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.082049+0000","last_change":"2023-10-03T10:09:48.758669+0000","last_active":"2023-10-03T10:10:40.082049+0000","last_peered":"2023-10-03T10:10:40.082049+0000","last_clean":"2023-10-03T10:10:40.082049+0000","last_became_active":"2023-10-03T10:09:48.758412+0000","last_became_peered":"2023-10-03T10:09:48.758412+0000","last_unstale":"2023-10-03T10:10:40.082049+0000","last_undegraded":"2023-10-03T10:10:40.082049+0000","last_fullsized":"2023-10-03T10:10:40.082049+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091964+0000","last_change":"2023-10-03T10:09:48.369149+0000","last_active":"2023-10-03T10:10:40.091964+0000","last_peered":"2023-10-03T10:10:40.091964+0000","last_clean":"2023-10-03T10:10:40.091964+0000","last_became_active":"2023-10-03T10:09:48.368855+0000","last_became_peered":"2023-10-03T10:09:48.368855+0000","last_unstale":"2023-10-03T10:10:40.091964+0000","last_undegraded":"2023-10-03T10:10:40.091964+0000","last_fullsized":"2023-10-03T10:10:40.091964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.084320+0000","last_change":"2023-10-03T10:09:48.767773+0000","last_active":"2023-10-03T10:10:40.084320+0000","last_peered":"2023-10-03T10:10:40.084320+0000","last_clean":"2023-10-03T10:10:40.084320+0000","last_became_active":"2023-10-03T10:09:48.767519+0000","last_became_peered":"2023-10-03T10:09:48.767519+0000","last_unstale":"2023-10-03T10:10:40.084320+0000","last_undegraded":"2023-10-03T10:10:40.084320+0000","last_fullsized":"2023-10-03T10:10:40.084320+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081366+0000","last_change":"2023-10-03T10:09:48.377423+0000","last_active":"2023-10-03T10:10:40.081366+0000","last_peered":"2023-10-03T10:10:40.081366+0000","last_clean":"2023-10-03T10:10:40.081366+0000","last_became_active":"2023-10-03T10:09:48.376337+0000","last_became_peered":"2023-10-03T10:09:48.376337+0000","last_unstale":"2023-10-03T10:10:40.081366+0000","last_undegraded":"2023-10-03T10:10:40.081366+0000","last_fullsized":"2023-10-03T10:10:40.081366+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081386+0000","last_change":"2023-10-03T10:09:48.767141+0000","last_active":"2023-10-03T10:10:40.081386+0000","last_peered":"2023-10-03T10:10:40.081386+0000","last_clean":"2023-10-03T10:10:40.081386+0000","last_became_active":"2023-10-03T10:09:48.766563+0000","last_became_peered":"2023-10-03T10:09:48.766563+0000","last_unstale":"2023-10-03T10:10:40.081386+0000","last_undegraded":"2023-10-03T10:10:40.081386+0000","last_fullsized":"2023-10-03T10:10:40.081386+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372451+0000","last_change":"2023-10-03T10:09:48.370781+0000","last_active":"2023-10-03T10:11:52.372451+0000","last_peered":"2023-10-03T10:11:52.372451+0000","last_clean":"2023-10-03T10:11:52.372451+0000","last_became_active":"2023-10-03T10:09:48.370500+0000","last_became_peered":"2023-10-03T10:09:48.370500+0000","last_unstale":"2023-10-03T10:11:52.372451+0000","last_undegraded":"2023-10-03T10:11:52.372451+0000","last_fullsized":"2023-10-03T10:11:52.372451+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091291+0000","last_change":"2023-10-03T10:09:48.762174+0000","last_active":"2023-10-03T10:10:40.091291+0000","last_peered":"2023-10-03T10:10:40.091291+0000","last_clean":"2023-10-03T10:10:40.091291+0000","last_became_active":"2023-10-03T10:09:48.761912+0000","last_became_peered":"2023-10-03T10:09:48.761912+0000","last_unstale":"2023-10-03T10:10:40.091291+0000","last_undegraded":"2023-10-03T10:10:40.091291+0000","last_fullsized":"2023-10-03T10:10:40.091291+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.082248+0000","last_change":"2023-10-03T10:09:48.375317+0000","last_active":"2023-10-03T10:10:40.082248+0000","last_peered":"2023-10-03T10:10:40.082248+0000","last_clean":"2023-10-03T10:10:40.082248+0000","last_became_active":"2023-10-03T10:09:48.375033+0000","last_became_peered":"2023-10-03T10:09:48.375033+0000","last_unstale":"2023-10-03T10:10:40.082248+0000","last_undegraded":"2023-10-03T10:10:40.082248+0000","last_fullsized":"2023-10-03T10:10:40.082248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.371952+0000","last_change":"2023-10-03T10:09:48.758357+0000","last_active":"2023-10-03T10:11:52.371952+0000","last_peered":"2023-10-03T10:11:52.371952+0000","last_clean":"2023-10-03T10:11:52.371952+0000","last_became_active":"2023-10-03T10:09:48.757940+0000","last_became_peered":"2023-10-03T10:09:48.757940+0000","last_unstale":"2023-10-03T10:11:52.371952+0000","last_undegraded":"2023-10-03T10:11:52.371952+0000","last_fullsized":"2023-10-03T10:11:52.371952+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081556+0000","last_change":"2023-10-03T10:09:48.376891+0000","last_active":"2023-10-03T10:10:40.081556+0000","last_peered":"2023-10-03T10:10:40.081556+0000","last_clean":"2023-10-03T10:10:40.081556+0000","last_became_active":"2023-10-03T10:09:48.376350+0000","last_became_peered":"2023-10-03T10:09:48.376350+0000","last_unstale":"2023-10-03T10:10:40.081556+0000","last_undegraded":"2023-10-03T10:10:40.081556+0000","last_fullsized":"2023-10-03T10:10:40.081556+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.093821+0000","last_change":"2023-10-03T10:10:40.089295+0000","last_active":"2023-10-03T10:10:40.093821+0000","last_peered":"2023-10-03T10:10:40.093821+0000","last_clean":"2023-10-03T10:10:40.093821+0000","last_became_active":"2023-10-03T10:10:40.089037+0000","last_became_peered":"2023-10-03T10:10:40.089037+0000","last_unstale":"2023-10-03T10:10:40.093821+0000","last_undegraded":"2023-10-03T10:10:40.093821+0000","last_fullsized":"2023-10-03T10:10:40.093821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.084924+0000","last_change":"2023-10-03T10:09:48.376011+0000","last_active":"2023-10-03T10:10:40.084924+0000","last_peered":"2023-10-03T10:10:40.084924+0000","last_clean":"2023-10-03T10:10:40.084924+0000","last_became_active":"2023-10-03T10:09:48.375731+0000","last_became_peered":"2023-10-03T10:09:48.375731+0000","last_unstale":"2023-10-03T10:10:40.084924+0000","last_undegraded":"2023-10-03T10:10:40.084924+0000","last_fullsized":"2023-10-03T10:10:40.084924+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081517+0000","last_change":"2023-10-03T10:09:48.755197+0000","last_active":"2023-10-03T10:10:40.081517+0000","last_peered":"2023-10-03T10:10:40.081517+0000","last_clean":"2023-10-03T10:10:40.081517+0000","last_became_active":"2023-10-03T10:09:48.754954+0000","last_became_peered":"2023-10-03T10:09:48.754954+0000","last_unstale":"2023-10-03T10:10:40.081517+0000","last_undegraded":"2023-10-03T10:10:40.081517+0000","last_fullsized":"2023-10-03T10:10:40.081517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.084508+0000","last_change":"2023-10-03T10:09:48.371687+0000","last_active":"2023-10-03T10:10:40.084508+0000","last_peered":"2023-10-03T10:10:40.084508+0000","last_clean":"2023-10-03T10:10:40.084508+0000","last_became_active":"2023-10-03T10:09:48.371207+0000","last_became_peered":"2023-10-03T10:09:48.371207+0000","last_unstale":"2023-10-03T10:10:40.084508+0000","last_undegraded":"2023-10-03T10:10:40.084508+0000","last_fullsized":"2023-10-03T10:10:40.084508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.086797+0000","last_change":"2023-10-03T10:09:48.766338+0000","last_active":"2023-10-03T10:10:40.086797+0000","last_peered":"2023-10-03T10:10:40.086797+0000","last_clean":"2023-10-03T10:10:40.086797+0000","last_became_active":"2023-10-03T10:09:48.765944+0000","last_became_peered":"2023-10-03T10:09:48.765944+0000","last_unstale":"2023-10-03T10:10:40.086797+0000","last_undegraded":"2023-10-03T10:10:40.086797+0000","last_fullsized":"2023-10-03T10:10:40.086797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081156+0000","last_change":"2023-10-03T10:09:48.374804+0000","last_active":"2023-10-03T10:10:40.081156+0000","last_peered":"2023-10-03T10:10:40.081156+0000","last_clean":"2023-10-03T10:10:40.081156+0000","last_became_active":"2023-10-03T10:09:48.374469+0000","last_became_peered":"2023-10-03T10:09:48.374469+0000","last_unstale":"2023-10-03T10:10:40.081156+0000","last_undegraded":"2023-10-03T10:10:40.081156+0000","last_fullsized":"2023-10-03T10:10:40.081156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372503+0000","last_change":"2023-10-03T10:09:48.759354+0000","last_active":"2023-10-03T10:11:52.372503+0000","last_peered":"2023-10-03T10:11:52.372503+0000","last_clean":"2023-10-03T10:11:52.372503+0000","last_became_active":"2023-10-03T10:09:48.759106+0000","last_became_peered":"2023-10-03T10:09:48.759106+0000","last_unstale":"2023-10-03T10:11:52.372503+0000","last_undegraded":"2023-10-03T10:11:52.372503+0000","last_fullsized":"2023-10-03T10:11:52.372503+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.080928+0000","last_change":"2023-10-03T10:09:48.379214+0000","last_active":"2023-10-03T10:10:40.080928+0000","last_peered":"2023-10-03T10:10:40.080928+0000","last_clean":"2023-10-03T10:10:40.080928+0000","last_became_active":"2023-10-03T10:09:48.378808+0000","last_became_peered":"2023-10-03T10:09:48.378808+0000","last_unstale":"2023-10-03T10:10:40.080928+0000","last_undegraded":"2023-10-03T10:10:40.080928+0000","last_fullsized":"2023-10-03T10:10:40.080928+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.102112+0000","last_change":"2023-10-03T10:10:40.097130+0000","last_active":"2023-10-03T10:10:40.102112+0000","last_peered":"2023-10-03T10:10:40.102112+0000","last_clean":"2023-10-03T10:10:40.102112+0000","last_became_active":"2023-10-03T10:10:40.096746+0000","last_became_peered":"2023-10-03T10:10:40.096746+0000","last_unstale":"2023-10-03T10:10:40.102112+0000","last_undegraded":"2023-10-03T10:10:40.102112+0000","last_fullsized":"2023-10-03T10:10:40.102112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091530+0000","last_change":"2023-10-03T10:09:44.335057+0000","last_active":"2023-10-03T10:10:40.091530+0000","last_peered":"2023-10-03T10:10:40.091530+0000","last_clean":"2023-10-03T10:10:40.091530+0000","last_became_active":"2023-10-03T10:09:44.334848+0000","last_became_peered":"2023-10-03T10:09:44.334848+0000","last_unstale":"2023-10-03T10:10:40.091530+0000","last_undegraded":"2023-10-03T10:10:40.091530+0000","last_fullsized":"2023-10-03T10:10:40.091530+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372136+0000","last_change":"2023-10-03T10:09:48.379615+0000","last_active":"2023-10-03T10:11:52.372136+0000","last_peered":"2023-10-03T10:11:52.372136+0000","last_clean":"2023-10-03T10:11:52.372136+0000","last_became_active":"2023-10-03T10:09:48.379353+0000","last_became_peered":"2023-10-03T10:09:48.379353+0000","last_unstale":"2023-10-03T10:11:52.372136+0000","last_undegraded":"2023-10-03T10:11:52.372136+0000","last_fullsized":"2023-10-03T10:11:52.372136+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.092019+0000","last_change":"2023-10-03T10:09:48.762628+0000","last_active":"2023-10-03T10:10:40.092019+0000","last_peered":"2023-10-03T10:10:40.092019+0000","last_clean":"2023-10-03T10:10:40.092019+0000","last_became_active":"2023-10-03T10:09:48.762007+0000","last_became_peered":"2023-10-03T10:09:48.762007+0000","last_unstale":"2023-10-03T10:10:40.092019+0000","last_undegraded":"2023-10-03T10:10:40.092019+0000","last_fullsized":"2023-10-03T10:10:40.092019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.084372+0000","last_change":"2023-10-03T10:09:44.331820+0000","last_active":"2023-10-03T10:10:40.084372+0000","last_peered":"2023-10-03T10:10:40.084372+0000","last_clean":"2023-10-03T10:10:40.084372+0000","last_became_active":"2023-10-03T10:09:44.331226+0000","last_became_peered":"2023-10-03T10:09:44.331226+0000","last_unstale":"2023-10-03T10:10:40.084372+0000","last_undegraded":"2023-10-03T10:10:40.084372+0000","last_fullsized":"2023-10-03T10:10:40.084372+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.080445+0000","last_change":"2023-10-03T10:09:48.373278+0000","last_active":"2023-10-03T10:10:40.080445+0000","last_peered":"2023-10-03T10:10:40.080445+0000","last_clean":"2023-10-03T10:10:40.080445+0000","last_became_active":"2023-10-03T10:09:48.372993+0000","last_became_peered":"2023-10-03T10:09:48.372993+0000","last_unstale":"2023-10-03T10:10:40.080445+0000","last_undegraded":"2023-10-03T10:10:40.080445+0000","last_fullsized":"2023-10-03T10:10:40.080445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091358+0000","last_change":"2023-10-03T10:09:48.742549+0000","last_active":"2023-10-03T10:10:40.091358+0000","last_peered":"2023-10-03T10:10:40.091358+0000","last_clean":"2023-10-03T10:10:40.091358+0000","last_became_active":"2023-10-03T10:09:48.740207+0000","last_became_peered":"2023-10-03T10:09:48.740207+0000","last_unstale":"2023-10-03T10:10:40.091358+0000","last_undegraded":"2023-10-03T10:10:40.091358+0000","last_fullsized":"2023-10-03T10:10:40.091358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.371886+0000","last_change":"2023-10-03T10:09:44.331573+0000","last_active":"2023-10-03T10:11:52.371886+0000","last_peered":"2023-10-03T10:11:52.371886+0000","last_clean":"2023-10-03T10:11:52.371886+0000","last_became_active":"2023-10-03T10:09:44.331265+0000","last_became_peered":"2023-10-03T10:09:44.331265+0000","last_unstale":"2023-10-03T10:11:52.371886+0000","last_undegraded":"2023-10-03T10:11:52.371886+0000","last_fullsized":"2023-10-03T10:11:52.371886+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091752+0000","last_change":"2023-10-03T10:09:48.372153+0000","last_active":"2023-10-03T10:10:40.091752+0000","last_peered":"2023-10-03T10:10:40.091752+0000","last_clean":"2023-10-03T10:10:40.091752+0000","last_became_active":"2023-10-03T10:09:48.371868+0000","last_became_peered":"2023-10-03T10:09:48.371868+0000","last_unstale":"2023-10-03T10:10:40.091752+0000","last_undegraded":"2023-10-03T10:10:40.091752+0000","last_fullsized":"2023-10-03T10:10:40.091752+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.092265+0000","last_change":"2023-10-03T10:09:48.745855+0000","last_active":"2023-10-03T10:10:40.092265+0000","last_peered":"2023-10-03T10:10:40.092265+0000","last_clean":"2023-10-03T10:10:40.092265+0000","last_became_active":"2023-10-03T10:09:48.745606+0000","last_became_peered":"2023-10-03T10:09:48.745606+0000","last_unstale":"2023-10-03T10:10:40.092265+0000","last_undegraded":"2023-10-03T10:10:40.092265+0000","last_fullsized":"2023-10-03T10:10:40.092265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.085001+0000","last_change":"2023-10-03T10:09:44.331400+0000","last_active":"2023-10-03T10:10:40.085001+0000","last_peered":"2023-10-03T10:10:40.085001+0000","last_clean":"2023-10-03T10:10:40.085001+0000","last_became_active":"2023-10-03T10:09:44.331097+0000","last_became_peered":"2023-10-03T10:09:44.331097+0000","last_unstale":"2023-10-03T10:10:40.085001+0000","last_undegraded":"2023-10-03T10:10:40.085001+0000","last_fullsized":"2023-10-03T10:10:40.085001+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091650+0000","last_change":"2023-10-03T10:09:44.334568+0000","last_active":"2023-10-03T10:10:40.091650+0000","last_peered":"2023-10-03T10:10:40.091650+0000","last_clean":"2023-10-03T10:10:40.091650+0000","last_became_active":"2023-10-03T10:09:44.333878+0000","last_became_peered":"2023-10-03T10:09:44.333878+0000","last_unstale":"2023-10-03T10:10:40.091650+0000","last_undegraded":"2023-10-03T10:10:40.091650+0000","last_fullsized":"2023-10-03T10:10:40.091650+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.084246+0000","last_change":"2023-10-03T10:09:48.371394+0000","last_active":"2023-10-03T10:10:40.084246+0000","last_peered":"2023-10-03T10:10:40.084246+0000","last_clean":"2023-10-03T10:10:40.084246+0000","last_became_active":"2023-10-03T10:09:48.371089+0000","last_became_peered":"2023-10-03T10:09:48.371089+0000","last_unstale":"2023-10-03T10:10:40.084246+0000","last_undegraded":"2023-10-03T10:10:40.084246+0000","last_fullsized":"2023-10-03T10:10:40.084246+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.086852+0000","last_change":"2023-10-03T10:09:48.766928+0000","last_active":"2023-10-03T10:10:40.086852+0000","last_peered":"2023-10-03T10:10:40.086852+0000","last_clean":"2023-10-03T10:10:40.086852+0000","last_became_active":"2023-10-03T10:09:48.766090+0000","last_became_peered":"2023-10-03T10:09:48.766090+0000","last_unstale":"2023-10-03T10:10:40.086852+0000","last_undegraded":"2023-10-03T10:10:40.086852+0000","last_fullsized":"2023-10-03T10:10:40.086852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081082+0000","last_change":"2023-10-03T10:09:44.333732+0000","last_active":"2023-10-03T10:10:40.081082+0000","last_peered":"2023-10-03T10:10:40.081082+0000","last_clean":"2023-10-03T10:10:40.081082+0000","last_became_active":"2023-10-03T10:09:44.333408+0000","last_became_peered":"2023-10-03T10:09:44.333408+0000","last_unstale":"2023-10-03T10:10:40.081082+0000","last_undegraded":"2023-10-03T10:10:40.081082+0000","last_fullsized":"2023-10-03T10:10:40.081082+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.080880+0000","last_change":"2023-10-03T10:09:48.369173+0000","last_active":"2023-10-03T10:10:40.080880+0000","last_peered":"2023-10-03T10:10:40.080880+0000","last_clean":"2023-10-03T10:10:40.080880+0000","last_became_active":"2023-10-03T10:09:48.368843+0000","last_became_peered":"2023-10-03T10:09:48.368843+0000","last_unstale":"2023-10-03T10:10:40.080880+0000","last_undegraded":"2023-10-03T10:10:40.080880+0000","last_fullsized":"2023-10-03T10:10:40.080880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.082125+0000","last_change":"2023-10-03T10:09:48.747157+0000","last_active":"2023-10-03T10:10:40.082125+0000","last_peered":"2023-10-03T10:10:40.082125+0000","last_clean":"2023-10-03T10:10:40.082125+0000","last_became_active":"2023-10-03T10:09:48.745029+0000","last_became_peered":"2023-10-03T10:09:48.745029+0000","last_unstale":"2023-10-03T10:10:40.082125+0000","last_undegraded":"2023-10-03T10:10:40.082125+0000","last_fullsized":"2023-10-03T10:10:40.082125+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.086696+0000","last_change":"2023-10-03T10:09:44.329886+0000","last_active":"2023-10-03T10:10:40.086696+0000","last_peered":"2023-10-03T10:10:40.086696+0000","last_clean":"2023-10-03T10:10:40.086696+0000","last_became_active":"2023-10-03T10:09:44.329607+0000","last_became_peered":"2023-10-03T10:09:44.329607+0000","last_unstale":"2023-10-03T10:10:40.086696+0000","last_undegraded":"2023-10-03T10:10:40.086696+0000","last_fullsized":"2023-10-03T10:10:40.086696+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091684+0000","last_change":"2023-10-03T10:09:48.371183+0000","last_active":"2023-10-03T10:10:40.091684+0000","last_peered":"2023-10-03T10:10:40.091684+0000","last_clean":"2023-10-03T10:10:40.091684+0000","last_became_active":"2023-10-03T10:09:48.370930+0000","last_became_peered":"2023-10-03T10:09:48.370930+0000","last_unstale":"2023-10-03T10:10:40.091684+0000","last_undegraded":"2023-10-03T10:10:40.091684+0000","last_fullsized":"2023-10-03T10:10:40.091684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.080638+0000","last_change":"2023-10-03T10:09:48.743221+0000","last_active":"2023-10-03T10:10:40.080638+0000","last_peered":"2023-10-03T10:10:40.080638+0000","last_clean":"2023-10-03T10:10:40.080638+0000","last_became_active":"2023-10-03T10:09:48.742967+0000","last_became_peered":"2023-10-03T10:09:48.742967+0000","last_unstale":"2023-10-03T10:10:40.080638+0000","last_undegraded":"2023-10-03T10:10:40.080638+0000","last_fullsized":"2023-10-03T10:10:40.080638+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.084157+0000","last_change":"2023-10-03T10:09:48.371421+0000","last_active":"2023-10-03T10:10:40.084157+0000","last_peered":"2023-10-03T10:10:40.084157+0000","last_clean":"2023-10-03T10:10:40.084157+0000","last_became_active":"2023-10-03T10:09:48.371121+0000","last_became_peered":"2023-10-03T10:09:48.371121+0000","last_unstale":"2023-10-03T10:10:40.084157+0000","last_undegraded":"2023-10-03T10:10:40.084157+0000","last_fullsized":"2023-10-03T10:10:40.084157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.092079+0000","last_change":"2023-10-03T10:09:44.334348+0000","last_active":"2023-10-03T10:10:40.092079+0000","last_peered":"2023-10-03T10:10:40.092079+0000","last_clean":"2023-10-03T10:10:40.092079+0000","last_became_active":"2023-10-03T10:09:44.333893+0000","last_became_peered":"2023-10-03T10:09:44.333893+0000","last_unstale":"2023-10-03T10:10:40.092079+0000","last_undegraded":"2023-10-03T10:10:40.092079+0000","last_fullsized":"2023-10-03T10:10:40.092079+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081008+0000","last_change":"2023-10-03T10:09:48.766676+0000","last_active":"2023-10-03T10:10:40.081008+0000","last_peered":"2023-10-03T10:10:40.081008+0000","last_clean":"2023-10-03T10:10:40.081008+0000","last_became_active":"2023-10-03T10:09:48.766218+0000","last_became_peered":"2023-10-03T10:09:48.766218+0000","last_unstale":"2023-10-03T10:10:40.081008+0000","last_undegraded":"2023-10-03T10:10:40.081008+0000","last_fullsized":"2023-10-03T10:10:40.081008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.084240+0000","last_change":"2023-10-03T10:09:44.333678+0000","last_active":"2023-10-03T10:10:40.084240+0000","last_peered":"2023-10-03T10:10:40.084240+0000","last_clean":"2023-10-03T10:10:40.084240+0000","last_became_active":"2023-10-03T10:09:44.333326+0000","last_became_peered":"2023-10-03T10:09:44.333326+0000","last_unstale":"2023-10-03T10:10:40.084240+0000","last_undegraded":"2023-10-03T10:10:40.084240+0000","last_fullsized":"2023-10-03T10:10:40.084240+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081853+0000","last_change":"2023-10-03T10:09:48.380501+0000","last_active":"2023-10-03T10:10:40.081853+0000","last_peered":"2023-10-03T10:10:40.081853+0000","last_clean":"2023-10-03T10:10:40.081853+0000","last_became_active":"2023-10-03T10:09:48.380205+0000","last_became_peered":"2023-10-03T10:09:48.380205+0000","last_unstale":"2023-10-03T10:10:40.081853+0000","last_undegraded":"2023-10-03T10:10:40.081853+0000","last_fullsized":"2023-10-03T10:10:40.081853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372107+0000","last_change":"2023-10-03T10:09:48.760491+0000","last_active":"2023-10-03T10:11:52.372107+0000","last_peered":"2023-10-03T10:11:52.372107+0000","last_clean":"2023-10-03T10:11:52.372107+0000","last_became_active":"2023-10-03T10:09:48.760201+0000","last_became_peered":"2023-10-03T10:09:48.760201+0000","last_unstale":"2023-10-03T10:11:52.372107+0000","last_undegraded":"2023-10-03T10:11:52.372107+0000","last_fullsized":"2023-10-03T10:11:52.372107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.080569+0000","last_change":"2023-10-03T10:09:48.381420+0000","last_active":"2023-10-03T10:10:40.080569+0000","last_peered":"2023-10-03T10:10:40.080569+0000","last_clean":"2023-10-03T10:10:40.080569+0000","last_became_active":"2023-10-03T10:09:48.380776+0000","last_became_peered":"2023-10-03T10:09:48.380776+0000","last_unstale":"2023-10-03T10:10:40.080569+0000","last_undegraded":"2023-10-03T10:10:40.080569+0000","last_fullsized":"2023-10-03T10:10:40.080569+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372306+0000","last_change":"2023-10-03T10:09:48.747044+0000","last_active":"2023-10-03T10:11:52.372306+0000","last_peered":"2023-10-03T10:11:52.372306+0000","last_clean":"2023-10-03T10:11:52.372306+0000","last_became_active":"2023-10-03T10:09:48.746598+0000","last_became_peered":"2023-10-03T10:09:48.746598+0000","last_unstale":"2023-10-03T10:11:52.372306+0000","last_undegraded":"2023-10-03T10:11:52.372306+0000","last_fullsized":"2023-10-03T10:11:52.372306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091824+0000","last_change":"2023-10-03T10:09:48.368132+0000","last_active":"2023-10-03T10:10:40.091824+0000","last_peered":"2023-10-03T10:10:40.091824+0000","last_clean":"2023-10-03T10:10:40.091824+0000","last_became_active":"2023-10-03T10:09:48.367533+0000","last_became_peered":"2023-10-03T10:09:48.367533+0000","last_unstale":"2023-10-03T10:10:40.091824+0000","last_undegraded":"2023-10-03T10:10:40.091824+0000","last_fullsized":"2023-10-03T10:10:40.091824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.371956+0000","last_change":"2023-10-03T10:10:40.088998+0000","last_active":"2023-10-03T10:11:52.371956+0000","last_peered":"2023-10-03T10:11:52.371956+0000","last_clean":"2023-10-03T10:11:52.371956+0000","last_became_active":"2023-10-03T10:10:40.088689+0000","last_became_peered":"2023-10-03T10:10:40.088689+0000","last_unstale":"2023-10-03T10:11:52.371956+0000","last_undegraded":"2023-10-03T10:11:52.371956+0000","last_fullsized":"2023-10-03T10:11:52.371956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.086753+0000","last_change":"2023-10-03T10:09:48.375975+0000","last_active":"2023-10-03T10:10:40.086753+0000","last_peered":"2023-10-03T10:10:40.086753+0000","last_clean":"2023-10-03T10:10:40.086753+0000","last_became_active":"2023-10-03T10:09:48.375693+0000","last_became_peered":"2023-10-03T10:09:48.375693+0000","last_unstale":"2023-10-03T10:10:40.086753+0000","last_undegraded":"2023-10-03T10:10:40.086753+0000","last_fullsized":"2023-10-03T10:10:40.086753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.371868+0000","last_change":"2023-10-03T10:09:48.758192+0000","last_active":"2023-10-03T10:11:52.371868+0000","last_peered":"2023-10-03T10:11:52.371868+0000","last_clean":"2023-10-03T10:11:52.371868+0000","last_became_active":"2023-10-03T10:09:48.757614+0000","last_became_peered":"2023-10-03T10:09:48.757614+0000","last_unstale":"2023-10-03T10:11:52.371868+0000","last_undegraded":"2023-10-03T10:11:52.371868+0000","last_fullsized":"2023-10-03T10:11:52.371868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.082217+0000","last_change":"2023-10-03T10:09:48.370797+0000","last_active":"2023-10-03T10:10:40.082217+0000","last_peered":"2023-10-03T10:10:40.082217+0000","last_clean":"2023-10-03T10:10:40.082217+0000","last_became_active":"2023-10-03T10:09:48.370506+0000","last_became_peered":"2023-10-03T10:09:48.370506+0000","last_unstale":"2023-10-03T10:10:40.082217+0000","last_undegraded":"2023-10-03T10:10:40.082217+0000","last_fullsized":"2023-10-03T10:10:40.082217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.084701+0000","last_change":"2023-10-03T10:09:48.766806+0000","last_active":"2023-10-03T10:10:40.084701+0000","last_peered":"2023-10-03T10:10:40.084701+0000","last_clean":"2023-10-03T10:10:40.084701+0000","last_became_active":"2023-10-03T10:09:48.765599+0000","last_became_peered":"2023-10-03T10:09:48.765599+0000","last_unstale":"2023-10-03T10:10:40.084701+0000","last_undegraded":"2023-10-03T10:10:40.084701+0000","last_fullsized":"2023-10-03T10:10:40.084701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081532+0000","last_change":"2023-10-03T10:09:48.377631+0000","last_active":"2023-10-03T10:10:40.081532+0000","last_peered":"2023-10-03T10:10:40.081532+0000","last_clean":"2023-10-03T10:10:40.081532+0000","last_became_active":"2023-10-03T10:09:48.377136+0000","last_became_peered":"2023-10-03T10:09:48.377136+0000","last_unstale":"2023-10-03T10:10:40.081532+0000","last_undegraded":"2023-10-03T10:10:40.081532+0000","last_fullsized":"2023-10-03T10:10:40.081532+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.371686+0000","last_change":"2023-10-03T10:09:48.747220+0000","last_active":"2023-10-03T10:11:52.371686+0000","last_peered":"2023-10-03T10:11:52.371686+0000","last_clean":"2023-10-03T10:11:52.371686+0000","last_became_active":"2023-10-03T10:09:48.746293+0000","last_became_peered":"2023-10-03T10:09:48.746293+0000","last_unstale":"2023-10-03T10:11:52.371686+0000","last_undegraded":"2023-10-03T10:11:52.371686+0000","last_fullsized":"2023-10-03T10:11:52.371686+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091829+0000","last_change":"2023-10-03T10:09:48.743844+0000","last_active":"2023-10-03T10:10:40.091829+0000","last_peered":"2023-10-03T10:10:40.091829+0000","last_clean":"2023-10-03T10:10:40.091829+0000","last_became_active":"2023-10-03T10:09:48.743532+0000","last_became_peered":"2023-10-03T10:09:48.743532+0000","last_unstale":"2023-10-03T10:10:40.091829+0000","last_undegraded":"2023-10-03T10:10:40.091829+0000","last_fullsized":"2023-10-03T10:10:40.091829+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081166+0000","last_change":"2023-10-03T10:09:48.764395+0000","last_active":"2023-10-03T10:10:40.081166+0000","last_peered":"2023-10-03T10:10:40.081166+0000","last_clean":"2023-10-03T10:10:40.081166+0000","last_became_active":"2023-10-03T10:09:48.762670+0000","last_became_peered":"2023-10-03T10:09:48.762670+0000","last_unstale":"2023-10-03T10:10:40.081166+0000","last_undegraded":"2023-10-03T10:10:40.081166+0000","last_fullsized":"2023-10-03T10:10:40.081166+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.094118+0000","last_change":"2023-10-03T10:10:40.089092+0000","last_active":"2023-10-03T10:10:40.094118+0000","last_peered":"2023-10-03T10:10:40.094118+0000","last_clean":"2023-10-03T10:10:40.094118+0000","last_became_active":"2023-10-03T10:10:40.088813+0000","last_became_peered":"2023-10-03T10:10:40.088813+0000","last_unstale":"2023-10-03T10:10:40.094118+0000","last_undegraded":"2023-10-03T10:10:40.094118+0000","last_fullsized":"2023-10-03T10:10:40.094118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.085181+0000","last_change":"2023-10-03T10:09:48.766105+0000","last_active":"2023-10-03T10:10:40.085181+0000","last_peered":"2023-10-03T10:10:40.085181+0000","last_clean":"2023-10-03T10:10:40.085181+0000","last_became_active":"2023-10-03T10:09:48.765834+0000","last_became_peered":"2023-10-03T10:09:48.765834+0000","last_unstale":"2023-10-03T10:10:40.085181+0000","last_undegraded":"2023-10-03T10:10:40.085181+0000","last_fullsized":"2023-10-03T10:10:40.085181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091769+0000","last_change":"2023-10-03T10:09:48.743916+0000","last_active":"2023-10-03T10:10:40.091769+0000","last_peered":"2023-10-03T10:10:40.091769+0000","last_clean":"2023-10-03T10:10:40.091769+0000","last_became_active":"2023-10-03T10:09:48.743646+0000","last_became_peered":"2023-10-03T10:09:48.743646+0000","last_unstale":"2023-10-03T10:10:40.091769+0000","last_undegraded":"2023-10-03T10:10:40.091769+0000","last_fullsized":"2023-10-03T10:10:40.091769+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705692,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297284,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074556,"statfs":{"total":96636764160,"available":96332345344,"internally_reserved":0,"allocated":192512,"data_stored":63854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.20799999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.308,"5min":0.313,"15min":0.314},"min":{"1min":0.21099999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.25600000000000001}]},{"osd":1,"last update":"Tue Oct 3 10:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33700000000000002,"15min":0.33800000000000002},"min":{"1min":0.222,"5min":0.219,"15min":0.219},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.75},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.35499999999999998,"15min":0.35699999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.68400000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.313}]},{"osd":2,"last update":"Tue Oct 3 10:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32000000000000001,"15min":0.31900000000000001},"min":{"1min":0.253,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.32200000000000001,"15min":0.31900000000000001},"min":{"1min":0.26000000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.30199999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705692,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":64454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.26900000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"min":{"1min":0.17699999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.28499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"min":{"1min":0.19700000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.311}]},{"osd":1,"last update":"Tue Oct 3 10:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.23400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.317,"15min":0.317},"min":{"1min":0.23000000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.33600000000000002}]},{"osd":3,"last update":"Tue Oct 3 10:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.23100000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.34499999999999997,"15min":0.34599999999999997},"min":{"1min":0.25800000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.34599999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705693,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297276,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074564,"statfs":{"total":96636764160,"available":96332353536,"internally_reserved":0,"allocated":184320,"data_stored":61591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 10:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.29799999999999999,"15min":0.29999999999999999},"min":{"1min":0.20300000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.318,"15min":0.317},"min":{"1min":0.25900000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.45400000000000001}]},{"osd":2,"last update":"Tue Oct 3 10:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.29299999999999998,"5min":0.28399999999999997,"15min":0.28199999999999997},"min":{"1min":0.22800000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.30199999999999999,"15min":0.30399999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":3.0129999999999999}]},{"osd":3,"last update":"Tue Oct 3 10:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.316,"15min":0.316},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":3.052},{"interface":"front","average":{"1min":0.307,"5min":0.29699999999999999,"15min":0.29499999999999998},"min":{"1min":0.23599999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.59999999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705692,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":61537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:47 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28399999999999997},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.29899999999999999,"15min":0.29299999999999998},"min":{"1min":0.221,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.69699999999999995}]},{"osd":2,"last update":"Tue Oct 3 10:11:47 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.308,"15min":0.30099999999999999},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.33700000000000002,"15min":0.33200000000000002},"min":{"1min":0.254,"5min":0.246,"15min":0.246},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.81699999999999995}]},{"osd":3,"last update":"Tue Oct 3 10:11:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.32500000000000001,"15min":0.32100000000000001},"min":{"1min":0.23599999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.37,"5min":0.33400000000000002,"15min":0.32800000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:11:56.013 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:11:56.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.169+0000 7fae50282700 1 Processor -- start 2023-10-03T10:11:56.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.169+0000 7fae50282700 1 -- start start 2023-10-03T10:11:56.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.170+0000 7fae50282700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae4809f350 0x7fae48136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.170+0000 7fae50282700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fae481371c0 0x7fae481395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.170+0000 7fae50282700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4809c970 con 0x7fae4809e870 2023-10-03T10:11:56.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.170+0000 7fae50282700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae480a0920 con 0x7fae481371c0 2023-10-03T10:11:56.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.170+0000 7fae50282700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4809f9c0 con 0x7fae4809f350 2023-10-03T10:11:56.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.170+0000 7fae4d81d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae4809f350 0x7fae48136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.170+0000 7fae4e81f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fae481371c0 0x7fae481395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.170+0000 7fae4d81d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae4809f350 0x7fae48136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59476/0 (socket says 172.21.15.146:59476) 2023-10-03T10:11:56.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.170+0000 7fae4d81d700 1 -- 172.21.15.146:0/3620126563 learned_addr learned my addr 172.21.15.146:0/3620126563 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:56.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.170+0000 7fae4e81f700 1 -- 172.21.15.146:0/3620126563 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae4809f350 msgr2=0x7fae48136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:56.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.170+0000 7fae4e81f700 1 --2- 172.21.15.146:0/3620126563 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae4809f350 0x7fae48136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.170+0000 7fae4e81f700 1 -- 172.21.15.146:0/3620126563 >> v1:172.21.15.146:6789/0 conn(0x7fae4809e870 legacy=0x7fae4809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.170+0000 7fae4e81f700 1 -- 172.21.15.146:0/3620126563 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4809bab0 con 0x7fae481371c0 2023-10-03T10:11:56.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.170+0000 7fae4d01c700 1 -- 172.21.15.146:0/3620126563 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924812671 0 0) 0x7fae4809c970 con 0x7fae4809e870 2023-10-03T10:11:56.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.170+0000 7fae4d81d700 1 --2- 172.21.15.146:0/3620126563 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae4809f350 0x7fae48136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:56.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.171+0000 7fae4e81f700 1 --2- 172.21.15.146:0/3620126563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae481371c0 0x7fae481395a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fae4000f370 tx=0x7fae4000f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22fed3f8844d6d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:56.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.171+0000 7fae4d01c700 1 -- 172.21.15.146:0/3620126563 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae40012070 con 0x7fae481371c0 2023-10-03T10:11:56.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.171+0000 7fae4d01c700 1 -- 172.21.15.146:0/3620126563 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4000fe70 con 0x7fae481371c0 2023-10-03T10:11:56.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.171+0000 7fae4d01c700 1 -- 172.21.15.146:0/3620126563 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4000d2f0 con 0x7fae481371c0 2023-10-03T10:11:56.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.171+0000 7fae50282700 1 -- 172.21.15.146:0/3620126563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae481371c0 msgr2=0x7fae481395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.171+0000 7fae50282700 1 --2- 172.21.15.146:0/3620126563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae481371c0 0x7fae481395a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fae4000f370 tx=0x7fae4000f680 comp rx=0 tx=0).stop 2023-10-03T10:11:56.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.171+0000 7fae50282700 1 -- 172.21.15.146:0/3620126563 shutdown_connections 2023-10-03T10:11:56.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.171+0000 7fae50282700 1 --2- 172.21.15.146:0/3620126563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae481371c0 0x7fae481395a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.171+0000 7fae50282700 1 --2- 172.21.15.146:0/3620126563 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae4809f350 0x7fae48136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.171+0000 7fae50282700 1 -- 172.21.15.146:0/3620126563 >> 172.21.15.146:0/3620126563 conn(0x7fae480a4430 msgr2=0x7fae480a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:56.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.171+0000 7fae50282700 1 -- 172.21.15.146:0/3620126563 shutdown_connections 2023-10-03T10:11:56.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.171+0000 7fae50282700 1 -- 172.21.15.146:0/3620126563 wait complete. 2023-10-03T10:11:56.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.172+0000 7fae50282700 1 Processor -- start 2023-10-03T10:11:56.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.172+0000 7fae50282700 1 -- start start 2023-10-03T10:11:56.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae50282700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae4809e870 0x7fae4811e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae50282700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae4809f350 0x7fae4811e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae50282700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae481371c0 0x7fae4811ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae50282700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae48120960 con 0x7fae4809e870 2023-10-03T10:11:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae50282700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4806d0e0 con 0x7fae481371c0 2023-10-03T10:11:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae50282700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae481368f0 con 0x7fae4809f350 2023-10-03T10:11:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae4e01e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae4809e870 0x7fae4811e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae4e81f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae481371c0 0x7fae4811ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae4d81d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae4809f350 0x7fae4811e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae4e81f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae481371c0 0x7fae4811ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59492/0 (socket says 172.21.15.146:59492) 2023-10-03T10:11:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae4e01e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae4809e870 0x7fae4811e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33212/0 (socket says 172.21.15.146:33212) 2023-10-03T10:11:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae4e81f700 1 -- 172.21.15.146:0/4294950052 learned_addr learned my addr 172.21.15.146:0/4294950052 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae4e01e700 1 -- 172.21.15.146:0/4294950052 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae4809f350 msgr2=0x7fae4811e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae4e01e700 1 --2- 172.21.15.146:0/4294950052 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae4809f350 0x7fae4811e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae4e01e700 1 -- 172.21.15.146:0/4294950052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae481371c0 msgr2=0x7fae4811ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae4e01e700 1 --2- 172.21.15.146:0/4294950052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae481371c0 0x7fae4811ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae4e01e700 1 -- 172.21.15.146:0/4294950052 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae44009550 con 0x7fae4809e870 2023-10-03T10:11:56.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae4e81f700 1 --2- 172.21.15.146:0/4294950052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae481371c0 0x7fae4811ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:56.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae4e01e700 1 --2- 172.21.15.146:0/4294950052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae4809e870 0x7fae4811e4b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00c430 tx=0x7fae3c00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:56.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae3affd700 1 -- 172.21.15.146:0/4294950052 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c0054e0 con 0x7fae4809e870 2023-10-03T10:11:56.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae3affd700 1 -- 172.21.15.146:0/4294950052 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3c00ce40 con 0x7fae4809e870 2023-10-03T10:11:56.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae50282700 1 -- 172.21.15.146:0/4294950052 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4000f050 con 0x7fae4809e870 2023-10-03T10:11:56.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae3affd700 1 -- 172.21.15.146:0/4294950052 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c0038c0 con 0x7fae4809e870 2023-10-03T10:11:56.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.173+0000 7fae50282700 1 -- 172.21.15.146:0/4294950052 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae48121760 con 0x7fae4809e870 2023-10-03T10:11:56.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.174+0000 7fae3affd700 1 -- 172.21.15.146:0/4294950052 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7fae3c003a20 con 0x7fae4809e870 2023-10-03T10:11:56.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.174+0000 7fae3affd700 1 -- 172.21.15.146:0/4294950052 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fae3c03edc0 con 0x7fae4809e870 2023-10-03T10:11:56.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.174+0000 7fae50282700 1 -- 172.21.15.146:0/4294950052 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae4804f2a0 con 0x7fae4809e870 2023-10-03T10:11:56.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.179+0000 7fae3affd700 1 -- 172.21.15.146:0/4294950052 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae3c003cd0 con 0x7fae4809e870 2023-10-03T10:11:56.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.362+0000 7fae50282700 1 -- 172.21.15.146:0/4294950052 --> v1:172.21.15.146:6816/126749 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae480a04e0 con 0x7fae2c02f4b0 2023-10-03T10:11:56.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.369+0000 7fae3affd700 1 -- 172.21.15.146:0/4294950052 <== mgr.14102 v1:172.21.15.146:6816/126749 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270314 (unknown 2965378022 0 718580754) 0x7fae44009860 con 0x7fae2c02f4b0 2023-10-03T10:11:56.372 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:11:56.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.372+0000 7fae50282700 1 -- 172.21.15.146:0/4294950052 >> v1:172.21.15.146:6816/126749 conn(0x7fae2c02f4b0 legacy=0x7fae2c031960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.372+0000 7fae50282700 1 -- 172.21.15.146:0/4294950052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae4809e870 msgr2=0x7fae4811e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.372+0000 7fae50282700 1 --2- 172.21.15.146:0/4294950052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae4809e870 0x7fae4811e4b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00c430 tx=0x7fae3c00c740 comp rx=0 tx=0).stop 2023-10-03T10:11:56.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.372+0000 7fae50282700 1 -- 172.21.15.146:0/4294950052 shutdown_connections 2023-10-03T10:11:56.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.372+0000 7fae50282700 1 --2- 172.21.15.146:0/4294950052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae481371c0 0x7fae4811ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.372+0000 7fae50282700 1 --2- 172.21.15.146:0/4294950052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae4809e870 0x7fae4811e4b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.372+0000 7fae50282700 1 --2- 172.21.15.146:0/4294950052 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae4809f350 0x7fae4811e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.372+0000 7fae50282700 1 -- 172.21.15.146:0/4294950052 >> 172.21.15.146:0/4294950052 conn(0x7fae480a4430 msgr2=0x7fae48071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:56.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.373+0000 7fae50282700 1 -- 172.21.15.146:0/4294950052 shutdown_connections 2023-10-03T10:11:56.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.373+0000 7fae50282700 1 -- 172.21.15.146:0/4294950052 wait complete. 2023-10-03T10:11:56.374 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-03T10:11:56.385 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":7,"stamp":"2023-10-03T10:11:56.328281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189104,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298256,"statfs":{"total":386547056640,"available":385329414144,"internally_reserved":0,"allocated":737280,"data_stored":251436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.995652"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372444+0000","last_change":"2023-10-03T10:09:48.757714+0000","last_active":"2023-10-03T10:11:52.372444+0000","last_peered":"2023-10-03T10:11:52.372444+0000","last_clean":"2023-10-03T10:11:52.372444+0000","last_became_active":"2023-10-03T10:09:48.757453+0000","last_became_peered":"2023-10-03T10:09:48.757453+0000","last_unstale":"2023-10-03T10:11:52.372444+0000","last_undegraded":"2023-10-03T10:11:52.372444+0000","last_fullsized":"2023-10-03T10:11:52.372444+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372571+0000","last_change":"2023-10-03T10:09:48.741431+0000","last_active":"2023-10-03T10:11:52.372571+0000","last_peered":"2023-10-03T10:11:52.372571+0000","last_clean":"2023-10-03T10:11:52.372571+0000","last_became_active":"2023-10-03T10:09:48.741098+0000","last_became_peered":"2023-10-03T10:09:48.741098+0000","last_unstale":"2023-10-03T10:11:52.372571+0000","last_undegraded":"2023-10-03T10:11:52.372571+0000","last_fullsized":"2023-10-03T10:11:52.372571+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081223+0000","last_change":"2023-10-03T10:09:48.743956+0000","last_active":"2023-10-03T10:10:40.081223+0000","last_peered":"2023-10-03T10:10:40.081223+0000","last_clean":"2023-10-03T10:10:40.081223+0000","last_became_active":"2023-10-03T10:09:48.743706+0000","last_became_peered":"2023-10-03T10:09:48.743706+0000","last_unstale":"2023-10-03T10:10:40.081223+0000","last_undegraded":"2023-10-03T10:10:40.081223+0000","last_fullsized":"2023-10-03T10:10:40.081223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081366+0000","last_change":"2023-10-03T10:09:48.744824+0000","last_active":"2023-10-03T10:10:40.081366+0000","last_peered":"2023-10-03T10:10:40.081366+0000","last_clean":"2023-10-03T10:10:40.081366+0000","last_became_active":"2023-10-03T10:09:48.744559+0000","last_became_peered":"2023-10-03T10:09:48.744559+0000","last_unstale":"2023-10-03T10:10:40.081366+0000","last_undegraded":"2023-10-03T10:10:40.081366+0000","last_fullsized":"2023-10-03T10:10:40.081366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.093788+0000","last_change":"2023-10-03T10:10:40.089153+0000","last_active":"2023-10-03T10:10:40.093788+0000","last_peered":"2023-10-03T10:10:40.093788+0000","last_clean":"2023-10-03T10:10:40.093788+0000","last_became_active":"2023-10-03T10:10:40.088836+0000","last_became_peered":"2023-10-03T10:10:40.088836+0000","last_unstale":"2023-10-03T10:10:40.093788+0000","last_undegraded":"2023-10-03T10:10:40.093788+0000","last_fullsized":"2023-10-03T10:10:40.093788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091067+0000","last_change":"2023-10-03T10:10:40.086811+0000","last_active":"2023-10-03T10:10:40.091067+0000","last_peered":"2023-10-03T10:10:40.091067+0000","last_clean":"2023-10-03T10:10:40.091067+0000","last_became_active":"2023-10-03T10:10:40.086501+0000","last_became_peered":"2023-10-03T10:10:40.086501+0000","last_unstale":"2023-10-03T10:10:40.091067+0000","last_undegraded":"2023-10-03T10:10:40.091067+0000","last_fullsized":"2023-10-03T10:10:40.091067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081089+0000","last_change":"2023-10-03T10:09:48.762070+0000","last_active":"2023-10-03T10:10:40.081089+0000","last_peered":"2023-10-03T10:10:40.081089+0000","last_clean":"2023-10-03T10:10:40.081089+0000","last_became_active":"2023-10-03T10:09:48.758238+0000","last_became_peered":"2023-10-03T10:09:48.758238+0000","last_unstale":"2023-10-03T10:10:40.081089+0000","last_undegraded":"2023-10-03T10:10:40.081089+0000","last_fullsized":"2023-10-03T10:10:40.081089+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091501+0000","last_change":"2023-10-03T10:09:48.746713+0000","last_active":"2023-10-03T10:10:40.091501+0000","last_peered":"2023-10-03T10:10:40.091501+0000","last_clean":"2023-10-03T10:10:40.091501+0000","last_became_active":"2023-10-03T10:09:48.746426+0000","last_became_peered":"2023-10-03T10:09:48.746426+0000","last_unstale":"2023-10-03T10:10:40.091501+0000","last_undegraded":"2023-10-03T10:10:40.091501+0000","last_fullsized":"2023-10-03T10:10:40.091501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.082428+0000","last_change":"2023-10-03T10:09:48.757336+0000","last_active":"2023-10-03T10:10:40.082428+0000","last_peered":"2023-10-03T10:10:40.082428+0000","last_clean":"2023-10-03T10:10:40.082428+0000","last_became_active":"2023-10-03T10:09:48.757059+0000","last_became_peered":"2023-10-03T10:09:48.757059+0000","last_unstale":"2023-10-03T10:10:40.082428+0000","last_undegraded":"2023-10-03T10:10:40.082428+0000","last_fullsized":"2023-10-03T10:10:40.082428+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.092161+0000","last_change":"2023-10-03T10:09:48.748969+0000","last_active":"2023-10-03T10:10:40.092161+0000","last_peered":"2023-10-03T10:10:40.092161+0000","last_clean":"2023-10-03T10:10:40.092161+0000","last_became_active":"2023-10-03T10:09:48.746842+0000","last_became_peered":"2023-10-03T10:09:48.746842+0000","last_unstale":"2023-10-03T10:10:40.092161+0000","last_undegraded":"2023-10-03T10:10:40.092161+0000","last_fullsized":"2023-10-03T10:10:40.092161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091836+0000","last_change":"2023-10-03T10:09:48.745732+0000","last_active":"2023-10-03T10:10:40.091836+0000","last_peered":"2023-10-03T10:10:40.091836+0000","last_clean":"2023-10-03T10:10:40.091836+0000","last_became_active":"2023-10-03T10:09:48.745451+0000","last_became_peered":"2023-10-03T10:09:48.745451+0000","last_unstale":"2023-10-03T10:10:40.091836+0000","last_undegraded":"2023-10-03T10:10:40.091836+0000","last_fullsized":"2023-10-03T10:10:40.091836+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372265+0000","last_change":"2023-10-03T10:09:48.758809+0000","last_active":"2023-10-03T10:11:52.372265+0000","last_peered":"2023-10-03T10:11:52.372265+0000","last_clean":"2023-10-03T10:11:52.372265+0000","last_became_active":"2023-10-03T10:09:48.758533+0000","last_became_peered":"2023-10-03T10:09:48.758533+0000","last_unstale":"2023-10-03T10:11:52.372265+0000","last_undegraded":"2023-10-03T10:11:52.372265+0000","last_fullsized":"2023-10-03T10:11:52.372265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372048+0000","last_change":"2023-10-03T10:09:48.759114+0000","last_active":"2023-10-03T10:11:52.372048+0000","last_peered":"2023-10-03T10:11:52.372048+0000","last_clean":"2023-10-03T10:11:52.372048+0000","last_became_active":"2023-10-03T10:09:48.758569+0000","last_became_peered":"2023-10-03T10:09:48.758569+0000","last_unstale":"2023-10-03T10:11:52.372048+0000","last_undegraded":"2023-10-03T10:11:52.372048+0000","last_fullsized":"2023-10-03T10:11:52.372048+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.092105+0000","last_change":"2023-10-03T10:09:48.740857+0000","last_active":"2023-10-03T10:10:40.092105+0000","last_peered":"2023-10-03T10:10:40.092105+0000","last_clean":"2023-10-03T10:10:40.092105+0000","last_became_active":"2023-10-03T10:09:48.740608+0000","last_became_peered":"2023-10-03T10:09:48.740608+0000","last_unstale":"2023-10-03T10:10:40.092105+0000","last_undegraded":"2023-10-03T10:10:40.092105+0000","last_fullsized":"2023-10-03T10:10:40.092105+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.080968+0000","last_change":"2023-10-03T10:09:48.740412+0000","last_active":"2023-10-03T10:10:40.080968+0000","last_peered":"2023-10-03T10:10:40.080968+0000","last_clean":"2023-10-03T10:10:40.080968+0000","last_became_active":"2023-10-03T10:09:48.740146+0000","last_became_peered":"2023-10-03T10:09:48.740146+0000","last_unstale":"2023-10-03T10:10:40.080968+0000","last_undegraded":"2023-10-03T10:10:40.080968+0000","last_fullsized":"2023-10-03T10:10:40.080968+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.080842+0000","last_change":"2023-10-03T10:09:48.758060+0000","last_active":"2023-10-03T10:10:40.080842+0000","last_peered":"2023-10-03T10:10:40.080842+0000","last_clean":"2023-10-03T10:10:40.080842+0000","last_became_active":"2023-10-03T10:09:48.757793+0000","last_became_peered":"2023-10-03T10:09:48.757793+0000","last_unstale":"2023-10-03T10:10:40.080842+0000","last_undegraded":"2023-10-03T10:10:40.080842+0000","last_fullsized":"2023-10-03T10:10:40.080842+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.094090+0000","last_change":"2023-10-03T10:10:40.089801+0000","last_active":"2023-10-03T10:10:40.094090+0000","last_peered":"2023-10-03T10:10:40.094090+0000","last_clean":"2023-10-03T10:10:40.094090+0000","last_became_active":"2023-10-03T10:10:40.089488+0000","last_became_peered":"2023-10-03T10:10:40.089488+0000","last_unstale":"2023-10-03T10:10:40.094090+0000","last_undegraded":"2023-10-03T10:10:40.094090+0000","last_fullsized":"2023-10-03T10:10:40.094090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081771+0000","last_change":"2023-10-03T10:09:48.745373+0000","last_active":"2023-10-03T10:10:40.081771+0000","last_peered":"2023-10-03T10:10:40.081771+0000","last_clean":"2023-10-03T10:10:40.081771+0000","last_became_active":"2023-10-03T10:09:48.744351+0000","last_became_peered":"2023-10-03T10:09:48.744351+0000","last_unstale":"2023-10-03T10:10:40.081771+0000","last_undegraded":"2023-10-03T10:10:40.081771+0000","last_fullsized":"2023-10-03T10:10:40.081771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372232+0000","last_change":"2023-10-03T10:09:48.759606+0000","last_active":"2023-10-03T10:11:52.372232+0000","last_peered":"2023-10-03T10:11:52.372232+0000","last_clean":"2023-10-03T10:11:52.372232+0000","last_became_active":"2023-10-03T10:09:48.759343+0000","last_became_peered":"2023-10-03T10:09:48.759343+0000","last_unstale":"2023-10-03T10:11:52.372232+0000","last_undegraded":"2023-10-03T10:11:52.372232+0000","last_fullsized":"2023-10-03T10:11:52.372232+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091450+0000","last_change":"2023-10-03T10:09:48.760055+0000","last_active":"2023-10-03T10:10:40.091450+0000","last_peered":"2023-10-03T10:10:40.091450+0000","last_clean":"2023-10-03T10:10:40.091450+0000","last_became_active":"2023-10-03T10:09:48.759787+0000","last_became_peered":"2023-10-03T10:09:48.759787+0000","last_unstale":"2023-10-03T10:10:40.091450+0000","last_undegraded":"2023-10-03T10:10:40.091450+0000","last_fullsized":"2023-10-03T10:10:40.091450+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091462+0000","last_change":"2023-10-03T10:09:48.753483+0000","last_active":"2023-10-03T10:10:40.091462+0000","last_peered":"2023-10-03T10:10:40.091462+0000","last_clean":"2023-10-03T10:10:40.091462+0000","last_became_active":"2023-10-03T10:09:48.752879+0000","last_became_peered":"2023-10-03T10:09:48.752879+0000","last_unstale":"2023-10-03T10:10:40.091462+0000","last_undegraded":"2023-10-03T10:10:40.091462+0000","last_fullsized":"2023-10-03T10:10:40.091462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081340+0000","last_change":"2023-10-03T10:09:48.745699+0000","last_active":"2023-10-03T10:10:40.081340+0000","last_peered":"2023-10-03T10:10:40.081340+0000","last_clean":"2023-10-03T10:10:40.081340+0000","last_became_active":"2023-10-03T10:09:48.745433+0000","last_became_peered":"2023-10-03T10:09:48.745433+0000","last_unstale":"2023-10-03T10:10:40.081340+0000","last_undegraded":"2023-10-03T10:10:40.081340+0000","last_fullsized":"2023-10-03T10:10:40.081340+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372010+0000","last_change":"2023-10-03T10:10:40.086151+0000","last_active":"2023-10-03T10:11:52.372010+0000","last_peered":"2023-10-03T10:11:52.372010+0000","last_clean":"2023-10-03T10:11:52.372010+0000","last_became_active":"2023-10-03T10:10:40.085827+0000","last_became_peered":"2023-10-03T10:10:40.085827+0000","last_unstale":"2023-10-03T10:11:52.372010+0000","last_undegraded":"2023-10-03T10:11:52.372010+0000","last_fullsized":"2023-10-03T10:11:52.372010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091580+0000","last_change":"2023-10-03T10:09:48.760358+0000","last_active":"2023-10-03T10:10:40.091580+0000","last_peered":"2023-10-03T10:10:40.091580+0000","last_clean":"2023-10-03T10:10:40.091580+0000","last_became_active":"2023-10-03T10:09:48.754451+0000","last_became_peered":"2023-10-03T10:09:48.754451+0000","last_unstale":"2023-10-03T10:10:40.091580+0000","last_undegraded":"2023-10-03T10:10:40.091580+0000","last_fullsized":"2023-10-03T10:10:40.091580+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.092270+0000","last_change":"2023-10-03T10:09:48.763060+0000","last_active":"2023-10-03T10:10:40.092270+0000","last_peered":"2023-10-03T10:10:40.092270+0000","last_clean":"2023-10-03T10:10:40.092270+0000","last_became_active":"2023-10-03T10:09:48.762772+0000","last_became_peered":"2023-10-03T10:09:48.762772+0000","last_unstale":"2023-10-03T10:10:40.092270+0000","last_undegraded":"2023-10-03T10:10:40.092270+0000","last_fullsized":"2023-10-03T10:10:40.092270+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.092009+0000","last_change":"2023-10-03T10:09:48.740694+0000","last_active":"2023-10-03T10:10:40.092009+0000","last_peered":"2023-10-03T10:10:40.092009+0000","last_clean":"2023-10-03T10:10:40.092009+0000","last_became_active":"2023-10-03T10:09:48.740403+0000","last_became_peered":"2023-10-03T10:09:48.740403+0000","last_unstale":"2023-10-03T10:10:40.092009+0000","last_undegraded":"2023-10-03T10:10:40.092009+0000","last_fullsized":"2023-10-03T10:10:40.092009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.082088+0000","last_change":"2023-10-03T10:09:48.762261+0000","last_active":"2023-10-03T10:10:40.082088+0000","last_peered":"2023-10-03T10:10:40.082088+0000","last_clean":"2023-10-03T10:10:40.082088+0000","last_became_active":"2023-10-03T10:09:48.758917+0000","last_became_peered":"2023-10-03T10:09:48.758917+0000","last_unstale":"2023-10-03T10:10:40.082088+0000","last_undegraded":"2023-10-03T10:10:40.082088+0000","last_fullsized":"2023-10-03T10:10:40.082088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091873+0000","last_change":"2023-10-03T10:09:48.371325+0000","last_active":"2023-10-03T10:10:40.091873+0000","last_peered":"2023-10-03T10:10:40.091873+0000","last_clean":"2023-10-03T10:10:40.091873+0000","last_became_active":"2023-10-03T10:09:48.371116+0000","last_became_peered":"2023-10-03T10:09:48.371116+0000","last_unstale":"2023-10-03T10:10:40.091873+0000","last_undegraded":"2023-10-03T10:10:40.091873+0000","last_fullsized":"2023-10-03T10:10:40.091873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.082162+0000","last_change":"2023-10-03T10:09:48.766155+0000","last_active":"2023-10-03T10:10:40.082162+0000","last_peered":"2023-10-03T10:10:40.082162+0000","last_clean":"2023-10-03T10:10:40.082162+0000","last_became_active":"2023-10-03T10:09:48.765746+0000","last_became_peered":"2023-10-03T10:09:48.765746+0000","last_unstale":"2023-10-03T10:10:40.082162+0000","last_undegraded":"2023-10-03T10:10:40.082162+0000","last_fullsized":"2023-10-03T10:10:40.082162+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091100+0000","last_change":"2023-10-03T10:09:48.377430+0000","last_active":"2023-10-03T10:10:40.091100+0000","last_peered":"2023-10-03T10:10:40.091100+0000","last_clean":"2023-10-03T10:10:40.091100+0000","last_became_active":"2023-10-03T10:09:48.376947+0000","last_became_peered":"2023-10-03T10:09:48.376947+0000","last_unstale":"2023-10-03T10:10:40.091100+0000","last_undegraded":"2023-10-03T10:10:40.091100+0000","last_fullsized":"2023-10-03T10:10:40.091100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081931+0000","last_change":"2023-10-03T10:09:48.745599+0000","last_active":"2023-10-03T10:10:40.081931+0000","last_peered":"2023-10-03T10:10:40.081931+0000","last_clean":"2023-10-03T10:10:40.081931+0000","last_became_active":"2023-10-03T10:09:48.744772+0000","last_became_peered":"2023-10-03T10:09:48.744772+0000","last_unstale":"2023-10-03T10:10:40.081931+0000","last_undegraded":"2023-10-03T10:10:40.081931+0000","last_fullsized":"2023-10-03T10:10:40.081931+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081221+0000","last_change":"2023-10-03T10:09:48.365550+0000","last_active":"2023-10-03T10:10:40.081221+0000","last_peered":"2023-10-03T10:10:40.081221+0000","last_clean":"2023-10-03T10:10:40.081221+0000","last_became_active":"2023-10-03T10:09:48.364969+0000","last_became_peered":"2023-10-03T10:09:48.364969+0000","last_unstale":"2023-10-03T10:10:40.081221+0000","last_undegraded":"2023-10-03T10:10:40.081221+0000","last_fullsized":"2023-10-03T10:10:40.081221+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.084408+0000","last_change":"2023-10-03T10:09:48.768231+0000","last_active":"2023-10-03T10:10:40.084408+0000","last_peered":"2023-10-03T10:10:40.084408+0000","last_clean":"2023-10-03T10:10:40.084408+0000","last_became_active":"2023-10-03T10:09:48.767982+0000","last_became_peered":"2023-10-03T10:09:48.767982+0000","last_unstale":"2023-10-03T10:10:40.084408+0000","last_undegraded":"2023-10-03T10:10:40.084408+0000","last_fullsized":"2023-10-03T10:10:40.084408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081595+0000","last_change":"2023-10-03T10:09:48.372222+0000","last_active":"2023-10-03T10:10:40.081595+0000","last_peered":"2023-10-03T10:10:40.081595+0000","last_clean":"2023-10-03T10:10:40.081595+0000","last_became_active":"2023-10-03T10:09:48.371919+0000","last_became_peered":"2023-10-03T10:09:48.371919+0000","last_unstale":"2023-10-03T10:10:40.081595+0000","last_undegraded":"2023-10-03T10:10:40.081595+0000","last_fullsized":"2023-10-03T10:10:40.081595+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081268+0000","last_change":"2023-10-03T10:09:48.766829+0000","last_active":"2023-10-03T10:10:40.081268+0000","last_peered":"2023-10-03T10:10:40.081268+0000","last_clean":"2023-10-03T10:10:40.081268+0000","last_became_active":"2023-10-03T10:09:48.766356+0000","last_became_peered":"2023-10-03T10:09:48.766356+0000","last_unstale":"2023-10-03T10:10:40.081268+0000","last_undegraded":"2023-10-03T10:10:40.081268+0000","last_fullsized":"2023-10-03T10:10:40.081268+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372434+0000","last_change":"2023-10-03T10:09:48.375954+0000","last_active":"2023-10-03T10:11:52.372434+0000","last_peered":"2023-10-03T10:11:52.372434+0000","last_clean":"2023-10-03T10:11:52.372434+0000","last_became_active":"2023-10-03T10:09:48.375703+0000","last_became_peered":"2023-10-03T10:09:48.375703+0000","last_unstale":"2023-10-03T10:11:52.372434+0000","last_undegraded":"2023-10-03T10:11:52.372434+0000","last_fullsized":"2023-10-03T10:11:52.372434+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081315+0000","last_change":"2023-10-03T10:09:48.762438+0000","last_active":"2023-10-03T10:10:40.081315+0000","last_peered":"2023-10-03T10:10:40.081315+0000","last_clean":"2023-10-03T10:10:40.081315+0000","last_became_active":"2023-10-03T10:09:48.758825+0000","last_became_peered":"2023-10-03T10:09:48.758825+0000","last_unstale":"2023-10-03T10:10:40.081315+0000","last_undegraded":"2023-10-03T10:10:40.081315+0000","last_fullsized":"2023-10-03T10:10:40.081315+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081142+0000","last_change":"2023-10-03T10:09:48.377186+0000","last_active":"2023-10-03T10:10:40.081142+0000","last_peered":"2023-10-03T10:10:40.081142+0000","last_clean":"2023-10-03T10:10:40.081142+0000","last_became_active":"2023-10-03T10:09:48.376584+0000","last_became_peered":"2023-10-03T10:09:48.376584+0000","last_unstale":"2023-10-03T10:10:40.081142+0000","last_undegraded":"2023-10-03T10:10:40.081142+0000","last_fullsized":"2023-10-03T10:10:40.081142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.092065+0000","last_change":"2023-10-03T10:09:48.762792+0000","last_active":"2023-10-03T10:10:40.092065+0000","last_peered":"2023-10-03T10:10:40.092065+0000","last_clean":"2023-10-03T10:10:40.092065+0000","last_became_active":"2023-10-03T10:09:48.762334+0000","last_became_peered":"2023-10-03T10:09:48.762334+0000","last_unstale":"2023-10-03T10:10:40.092065+0000","last_undegraded":"2023-10-03T10:10:40.092065+0000","last_fullsized":"2023-10-03T10:10:40.092065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'12","reported_seq":26,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.385697+0000","last_change":"2023-10-03T10:09:48.370604+0000","last_active":"2023-10-03T10:11:52.385697+0000","last_peered":"2023-10-03T10:11:52.385697+0000","last_clean":"2023-10-03T10:11:52.385697+0000","last_became_active":"2023-10-03T10:09:48.370305+0000","last_became_peered":"2023-10-03T10:09:48.370305+0000","last_unstale":"2023-10-03T10:11:52.385697+0000","last_undegraded":"2023-10-03T10:11:52.385697+0000","last_fullsized":"2023-10-03T10:11:52.385697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3563,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.371868+0000","last_change":"2023-10-03T10:09:48.758807+0000","last_active":"2023-10-03T10:11:52.371868+0000","last_peered":"2023-10-03T10:11:52.371868+0000","last_clean":"2023-10-03T10:11:52.371868+0000","last_became_active":"2023-10-03T10:09:48.757966+0000","last_became_peered":"2023-10-03T10:09:48.757966+0000","last_unstale":"2023-10-03T10:11:52.371868+0000","last_undegraded":"2023-10-03T10:11:52.371868+0000","last_fullsized":"2023-10-03T10:11:52.371868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.085084+0000","last_change":"2023-10-03T10:09:48.367621+0000","last_active":"2023-10-03T10:10:40.085084+0000","last_peered":"2023-10-03T10:10:40.085084+0000","last_clean":"2023-10-03T10:10:40.085084+0000","last_became_active":"2023-10-03T10:09:48.367354+0000","last_became_peered":"2023-10-03T10:09:48.367354+0000","last_unstale":"2023-10-03T10:10:40.085084+0000","last_undegraded":"2023-10-03T10:10:40.085084+0000","last_fullsized":"2023-10-03T10:10:40.085084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.082135+0000","last_change":"2023-10-03T10:09:48.763072+0000","last_active":"2023-10-03T10:10:40.082135+0000","last_peered":"2023-10-03T10:10:40.082135+0000","last_clean":"2023-10-03T10:10:40.082135+0000","last_became_active":"2023-10-03T10:09:48.762225+0000","last_became_peered":"2023-10-03T10:09:48.762225+0000","last_unstale":"2023-10-03T10:10:40.082135+0000","last_undegraded":"2023-10-03T10:10:40.082135+0000","last_fullsized":"2023-10-03T10:10:40.082135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081385+0000","last_change":"2023-10-03T10:09:48.380634+0000","last_active":"2023-10-03T10:10:40.081385+0000","last_peered":"2023-10-03T10:10:40.081385+0000","last_clean":"2023-10-03T10:10:40.081385+0000","last_became_active":"2023-10-03T10:09:48.380317+0000","last_became_peered":"2023-10-03T10:09:48.380317+0000","last_unstale":"2023-10-03T10:10:40.081385+0000","last_undegraded":"2023-10-03T10:10:40.081385+0000","last_fullsized":"2023-10-03T10:10:40.081385+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.086915+0000","last_change":"2023-10-03T10:09:48.769900+0000","last_active":"2023-10-03T10:10:40.086915+0000","last_peered":"2023-10-03T10:10:40.086915+0000","last_clean":"2023-10-03T10:10:40.086915+0000","last_became_active":"2023-10-03T10:09:48.769431+0000","last_became_peered":"2023-10-03T10:09:48.769431+0000","last_unstale":"2023-10-03T10:10:40.086915+0000","last_undegraded":"2023-10-03T10:10:40.086915+0000","last_fullsized":"2023-10-03T10:10:40.086915+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081238+0000","last_change":"2023-10-03T10:09:48.374660+0000","last_active":"2023-10-03T10:10:40.081238+0000","last_peered":"2023-10-03T10:10:40.081238+0000","last_clean":"2023-10-03T10:10:40.081238+0000","last_became_active":"2023-10-03T10:09:48.371590+0000","last_became_peered":"2023-10-03T10:09:48.371590+0000","last_unstale":"2023-10-03T10:10:40.081238+0000","last_undegraded":"2023-10-03T10:10:40.081238+0000","last_fullsized":"2023-10-03T10:10:40.081238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.082049+0000","last_change":"2023-10-03T10:09:48.758669+0000","last_active":"2023-10-03T10:10:40.082049+0000","last_peered":"2023-10-03T10:10:40.082049+0000","last_clean":"2023-10-03T10:10:40.082049+0000","last_became_active":"2023-10-03T10:09:48.758412+0000","last_became_peered":"2023-10-03T10:09:48.758412+0000","last_unstale":"2023-10-03T10:10:40.082049+0000","last_undegraded":"2023-10-03T10:10:40.082049+0000","last_fullsized":"2023-10-03T10:10:40.082049+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091964+0000","last_change":"2023-10-03T10:09:48.369149+0000","last_active":"2023-10-03T10:10:40.091964+0000","last_peered":"2023-10-03T10:10:40.091964+0000","last_clean":"2023-10-03T10:10:40.091964+0000","last_became_active":"2023-10-03T10:09:48.368855+0000","last_became_peered":"2023-10-03T10:09:48.368855+0000","last_unstale":"2023-10-03T10:10:40.091964+0000","last_undegraded":"2023-10-03T10:10:40.091964+0000","last_fullsized":"2023-10-03T10:10:40.091964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.084320+0000","last_change":"2023-10-03T10:09:48.767773+0000","last_active":"2023-10-03T10:10:40.084320+0000","last_peered":"2023-10-03T10:10:40.084320+0000","last_clean":"2023-10-03T10:10:40.084320+0000","last_became_active":"2023-10-03T10:09:48.767519+0000","last_became_peered":"2023-10-03T10:09:48.767519+0000","last_unstale":"2023-10-03T10:10:40.084320+0000","last_undegraded":"2023-10-03T10:10:40.084320+0000","last_fullsized":"2023-10-03T10:10:40.084320+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081366+0000","last_change":"2023-10-03T10:09:48.377423+0000","last_active":"2023-10-03T10:10:40.081366+0000","last_peered":"2023-10-03T10:10:40.081366+0000","last_clean":"2023-10-03T10:10:40.081366+0000","last_became_active":"2023-10-03T10:09:48.376337+0000","last_became_peered":"2023-10-03T10:09:48.376337+0000","last_unstale":"2023-10-03T10:10:40.081366+0000","last_undegraded":"2023-10-03T10:10:40.081366+0000","last_fullsized":"2023-10-03T10:10:40.081366+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081386+0000","last_change":"2023-10-03T10:09:48.767141+0000","last_active":"2023-10-03T10:10:40.081386+0000","last_peered":"2023-10-03T10:10:40.081386+0000","last_clean":"2023-10-03T10:10:40.081386+0000","last_became_active":"2023-10-03T10:09:48.766563+0000","last_became_peered":"2023-10-03T10:09:48.766563+0000","last_unstale":"2023-10-03T10:10:40.081386+0000","last_undegraded":"2023-10-03T10:10:40.081386+0000","last_fullsized":"2023-10-03T10:10:40.081386+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372451+0000","last_change":"2023-10-03T10:09:48.370781+0000","last_active":"2023-10-03T10:11:52.372451+0000","last_peered":"2023-10-03T10:11:52.372451+0000","last_clean":"2023-10-03T10:11:52.372451+0000","last_became_active":"2023-10-03T10:09:48.370500+0000","last_became_peered":"2023-10-03T10:09:48.370500+0000","last_unstale":"2023-10-03T10:11:52.372451+0000","last_undegraded":"2023-10-03T10:11:52.372451+0000","last_fullsized":"2023-10-03T10:11:52.372451+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091291+0000","last_change":"2023-10-03T10:09:48.762174+0000","last_active":"2023-10-03T10:10:40.091291+0000","last_peered":"2023-10-03T10:10:40.091291+0000","last_clean":"2023-10-03T10:10:40.091291+0000","last_became_active":"2023-10-03T10:09:48.761912+0000","last_became_peered":"2023-10-03T10:09:48.761912+0000","last_unstale":"2023-10-03T10:10:40.091291+0000","last_undegraded":"2023-10-03T10:10:40.091291+0000","last_fullsized":"2023-10-03T10:10:40.091291+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.082248+0000","last_change":"2023-10-03T10:09:48.375317+0000","last_active":"2023-10-03T10:10:40.082248+0000","last_peered":"2023-10-03T10:10:40.082248+0000","last_clean":"2023-10-03T10:10:40.082248+0000","last_became_active":"2023-10-03T10:09:48.375033+0000","last_became_peered":"2023-10-03T10:09:48.375033+0000","last_unstale":"2023-10-03T10:10:40.082248+0000","last_undegraded":"2023-10-03T10:10:40.082248+0000","last_fullsized":"2023-10-03T10:10:40.082248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.371952+0000","last_change":"2023-10-03T10:09:48.758357+0000","last_active":"2023-10-03T10:11:52.371952+0000","last_peered":"2023-10-03T10:11:52.371952+0000","last_clean":"2023-10-03T10:11:52.371952+0000","last_became_active":"2023-10-03T10:09:48.757940+0000","last_became_peered":"2023-10-03T10:09:48.757940+0000","last_unstale":"2023-10-03T10:11:52.371952+0000","last_undegraded":"2023-10-03T10:11:52.371952+0000","last_fullsized":"2023-10-03T10:11:52.371952+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081556+0000","last_change":"2023-10-03T10:09:48.376891+0000","last_active":"2023-10-03T10:10:40.081556+0000","last_peered":"2023-10-03T10:10:40.081556+0000","last_clean":"2023-10-03T10:10:40.081556+0000","last_became_active":"2023-10-03T10:09:48.376350+0000","last_became_peered":"2023-10-03T10:09:48.376350+0000","last_unstale":"2023-10-03T10:10:40.081556+0000","last_undegraded":"2023-10-03T10:10:40.081556+0000","last_fullsized":"2023-10-03T10:10:40.081556+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.093821+0000","last_change":"2023-10-03T10:10:40.089295+0000","last_active":"2023-10-03T10:10:40.093821+0000","last_peered":"2023-10-03T10:10:40.093821+0000","last_clean":"2023-10-03T10:10:40.093821+0000","last_became_active":"2023-10-03T10:10:40.089037+0000","last_became_peered":"2023-10-03T10:10:40.089037+0000","last_unstale":"2023-10-03T10:10:40.093821+0000","last_undegraded":"2023-10-03T10:10:40.093821+0000","last_fullsized":"2023-10-03T10:10:40.093821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.084924+0000","last_change":"2023-10-03T10:09:48.376011+0000","last_active":"2023-10-03T10:10:40.084924+0000","last_peered":"2023-10-03T10:10:40.084924+0000","last_clean":"2023-10-03T10:10:40.084924+0000","last_became_active":"2023-10-03T10:09:48.375731+0000","last_became_peered":"2023-10-03T10:09:48.375731+0000","last_unstale":"2023-10-03T10:10:40.084924+0000","last_undegraded":"2023-10-03T10:10:40.084924+0000","last_fullsized":"2023-10-03T10:10:40.084924+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081517+0000","last_change":"2023-10-03T10:09:48.755197+0000","last_active":"2023-10-03T10:10:40.081517+0000","last_peered":"2023-10-03T10:10:40.081517+0000","last_clean":"2023-10-03T10:10:40.081517+0000","last_became_active":"2023-10-03T10:09:48.754954+0000","last_became_peered":"2023-10-03T10:09:48.754954+0000","last_unstale":"2023-10-03T10:10:40.081517+0000","last_undegraded":"2023-10-03T10:10:40.081517+0000","last_fullsized":"2023-10-03T10:10:40.081517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.084508+0000","last_change":"2023-10-03T10:09:48.371687+0000","last_active":"2023-10-03T10:10:40.084508+0000","last_peered":"2023-10-03T10:10:40.084508+0000","last_clean":"2023-10-03T10:10:40.084508+0000","last_became_active":"2023-10-03T10:09:48.371207+0000","last_became_peered":"2023-10-03T10:09:48.371207+0000","last_unstale":"2023-10-03T10:10:40.084508+0000","last_undegraded":"2023-10-03T10:10:40.084508+0000","last_fullsized":"2023-10-03T10:10:40.084508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.086797+0000","last_change":"2023-10-03T10:09:48.766338+0000","last_active":"2023-10-03T10:10:40.086797+0000","last_peered":"2023-10-03T10:10:40.086797+0000","last_clean":"2023-10-03T10:10:40.086797+0000","last_became_active":"2023-10-03T10:09:48.765944+0000","last_became_peered":"2023-10-03T10:09:48.765944+0000","last_unstale":"2023-10-03T10:10:40.086797+0000","last_undegraded":"2023-10-03T10:10:40.086797+0000","last_fullsized":"2023-10-03T10:10:40.086797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081156+0000","last_change":"2023-10-03T10:09:48.374804+0000","last_active":"2023-10-03T10:10:40.081156+0000","last_peered":"2023-10-03T10:10:40.081156+0000","last_clean":"2023-10-03T10:10:40.081156+0000","last_became_active":"2023-10-03T10:09:48.374469+0000","last_became_peered":"2023-10-03T10:09:48.374469+0000","last_unstale":"2023-10-03T10:10:40.081156+0000","last_undegraded":"2023-10-03T10:10:40.081156+0000","last_fullsized":"2023-10-03T10:10:40.081156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372503+0000","last_change":"2023-10-03T10:09:48.759354+0000","last_active":"2023-10-03T10:11:52.372503+0000","last_peered":"2023-10-03T10:11:52.372503+0000","last_clean":"2023-10-03T10:11:52.372503+0000","last_became_active":"2023-10-03T10:09:48.759106+0000","last_became_peered":"2023-10-03T10:09:48.759106+0000","last_unstale":"2023-10-03T10:11:52.372503+0000","last_undegraded":"2023-10-03T10:11:52.372503+0000","last_fullsized":"2023-10-03T10:11:52.372503+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.080928+0000","last_change":"2023-10-03T10:09:48.379214+0000","last_active":"2023-10-03T10:10:40.080928+0000","last_peered":"2023-10-03T10:10:40.080928+0000","last_clean":"2023-10-03T10:10:40.080928+0000","last_became_active":"2023-10-03T10:09:48.378808+0000","last_became_peered":"2023-10-03T10:09:48.378808+0000","last_unstale":"2023-10-03T10:10:40.080928+0000","last_undegraded":"2023-10-03T10:10:40.080928+0000","last_fullsized":"2023-10-03T10:10:40.080928+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.102112+0000","last_change":"2023-10-03T10:10:40.097130+0000","last_active":"2023-10-03T10:10:40.102112+0000","last_peered":"2023-10-03T10:10:40.102112+0000","last_clean":"2023-10-03T10:10:40.102112+0000","last_became_active":"2023-10-03T10:10:40.096746+0000","last_became_peered":"2023-10-03T10:10:40.096746+0000","last_unstale":"2023-10-03T10:10:40.102112+0000","last_undegraded":"2023-10-03T10:10:40.102112+0000","last_fullsized":"2023-10-03T10:10:40.102112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091530+0000","last_change":"2023-10-03T10:09:44.335057+0000","last_active":"2023-10-03T10:10:40.091530+0000","last_peered":"2023-10-03T10:10:40.091530+0000","last_clean":"2023-10-03T10:10:40.091530+0000","last_became_active":"2023-10-03T10:09:44.334848+0000","last_became_peered":"2023-10-03T10:09:44.334848+0000","last_unstale":"2023-10-03T10:10:40.091530+0000","last_undegraded":"2023-10-03T10:10:40.091530+0000","last_fullsized":"2023-10-03T10:10:40.091530+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372136+0000","last_change":"2023-10-03T10:09:48.379615+0000","last_active":"2023-10-03T10:11:52.372136+0000","last_peered":"2023-10-03T10:11:52.372136+0000","last_clean":"2023-10-03T10:11:52.372136+0000","last_became_active":"2023-10-03T10:09:48.379353+0000","last_became_peered":"2023-10-03T10:09:48.379353+0000","last_unstale":"2023-10-03T10:11:52.372136+0000","last_undegraded":"2023-10-03T10:11:52.372136+0000","last_fullsized":"2023-10-03T10:11:52.372136+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.092019+0000","last_change":"2023-10-03T10:09:48.762628+0000","last_active":"2023-10-03T10:10:40.092019+0000","last_peered":"2023-10-03T10:10:40.092019+0000","last_clean":"2023-10-03T10:10:40.092019+0000","last_became_active":"2023-10-03T10:09:48.762007+0000","last_became_peered":"2023-10-03T10:09:48.762007+0000","last_unstale":"2023-10-03T10:10:40.092019+0000","last_undegraded":"2023-10-03T10:10:40.092019+0000","last_fullsized":"2023-10-03T10:10:40.092019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.084372+0000","last_change":"2023-10-03T10:09:44.331820+0000","last_active":"2023-10-03T10:10:40.084372+0000","last_peered":"2023-10-03T10:10:40.084372+0000","last_clean":"2023-10-03T10:10:40.084372+0000","last_became_active":"2023-10-03T10:09:44.331226+0000","last_became_peered":"2023-10-03T10:09:44.331226+0000","last_unstale":"2023-10-03T10:10:40.084372+0000","last_undegraded":"2023-10-03T10:10:40.084372+0000","last_fullsized":"2023-10-03T10:10:40.084372+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.080445+0000","last_change":"2023-10-03T10:09:48.373278+0000","last_active":"2023-10-03T10:10:40.080445+0000","last_peered":"2023-10-03T10:10:40.080445+0000","last_clean":"2023-10-03T10:10:40.080445+0000","last_became_active":"2023-10-03T10:09:48.372993+0000","last_became_peered":"2023-10-03T10:09:48.372993+0000","last_unstale":"2023-10-03T10:10:40.080445+0000","last_undegraded":"2023-10-03T10:10:40.080445+0000","last_fullsized":"2023-10-03T10:10:40.080445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091358+0000","last_change":"2023-10-03T10:09:48.742549+0000","last_active":"2023-10-03T10:10:40.091358+0000","last_peered":"2023-10-03T10:10:40.091358+0000","last_clean":"2023-10-03T10:10:40.091358+0000","last_became_active":"2023-10-03T10:09:48.740207+0000","last_became_peered":"2023-10-03T10:09:48.740207+0000","last_unstale":"2023-10-03T10:10:40.091358+0000","last_undegraded":"2023-10-03T10:10:40.091358+0000","last_fullsized":"2023-10-03T10:10:40.091358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.371886+0000","last_change":"2023-10-03T10:09:44.331573+0000","last_active":"2023-10-03T10:11:52.371886+0000","last_peered":"2023-10-03T10:11:52.371886+0000","last_clean":"2023-10-03T10:11:52.371886+0000","last_became_active":"2023-10-03T10:09:44.331265+0000","last_became_peered":"2023-10-03T10:09:44.331265+0000","last_unstale":"2023-10-03T10:11:52.371886+0000","last_undegraded":"2023-10-03T10:11:52.371886+0000","last_fullsized":"2023-10-03T10:11:52.371886+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091752+0000","last_change":"2023-10-03T10:09:48.372153+0000","last_active":"2023-10-03T10:10:40.091752+0000","last_peered":"2023-10-03T10:10:40.091752+0000","last_clean":"2023-10-03T10:10:40.091752+0000","last_became_active":"2023-10-03T10:09:48.371868+0000","last_became_peered":"2023-10-03T10:09:48.371868+0000","last_unstale":"2023-10-03T10:10:40.091752+0000","last_undegraded":"2023-10-03T10:10:40.091752+0000","last_fullsized":"2023-10-03T10:10:40.091752+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.092265+0000","last_change":"2023-10-03T10:09:48.745855+0000","last_active":"2023-10-03T10:10:40.092265+0000","last_peered":"2023-10-03T10:10:40.092265+0000","last_clean":"2023-10-03T10:10:40.092265+0000","last_became_active":"2023-10-03T10:09:48.745606+0000","last_became_peered":"2023-10-03T10:09:48.745606+0000","last_unstale":"2023-10-03T10:10:40.092265+0000","last_undegraded":"2023-10-03T10:10:40.092265+0000","last_fullsized":"2023-10-03T10:10:40.092265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.085001+0000","last_change":"2023-10-03T10:09:44.331400+0000","last_active":"2023-10-03T10:10:40.085001+0000","last_peered":"2023-10-03T10:10:40.085001+0000","last_clean":"2023-10-03T10:10:40.085001+0000","last_became_active":"2023-10-03T10:09:44.331097+0000","last_became_peered":"2023-10-03T10:09:44.331097+0000","last_unstale":"2023-10-03T10:10:40.085001+0000","last_undegraded":"2023-10-03T10:10:40.085001+0000","last_fullsized":"2023-10-03T10:10:40.085001+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091650+0000","last_change":"2023-10-03T10:09:44.334568+0000","last_active":"2023-10-03T10:10:40.091650+0000","last_peered":"2023-10-03T10:10:40.091650+0000","last_clean":"2023-10-03T10:10:40.091650+0000","last_became_active":"2023-10-03T10:09:44.333878+0000","last_became_peered":"2023-10-03T10:09:44.333878+0000","last_unstale":"2023-10-03T10:10:40.091650+0000","last_undegraded":"2023-10-03T10:10:40.091650+0000","last_fullsized":"2023-10-03T10:10:40.091650+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.084246+0000","last_change":"2023-10-03T10:09:48.371394+0000","last_active":"2023-10-03T10:10:40.084246+0000","last_peered":"2023-10-03T10:10:40.084246+0000","last_clean":"2023-10-03T10:10:40.084246+0000","last_became_active":"2023-10-03T10:09:48.371089+0000","last_became_peered":"2023-10-03T10:09:48.371089+0000","last_unstale":"2023-10-03T10:10:40.084246+0000","last_undegraded":"2023-10-03T10:10:40.084246+0000","last_fullsized":"2023-10-03T10:10:40.084246+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.086852+0000","last_change":"2023-10-03T10:09:48.766928+0000","last_active":"2023-10-03T10:10:40.086852+0000","last_peered":"2023-10-03T10:10:40.086852+0000","last_clean":"2023-10-03T10:10:40.086852+0000","last_became_active":"2023-10-03T10:09:48.766090+0000","last_became_peered":"2023-10-03T10:09:48.766090+0000","last_unstale":"2023-10-03T10:10:40.086852+0000","last_undegraded":"2023-10-03T10:10:40.086852+0000","last_fullsized":"2023-10-03T10:10:40.086852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081082+0000","last_change":"2023-10-03T10:09:44.333732+0000","last_active":"2023-10-03T10:10:40.081082+0000","last_peered":"2023-10-03T10:10:40.081082+0000","last_clean":"2023-10-03T10:10:40.081082+0000","last_became_active":"2023-10-03T10:09:44.333408+0000","last_became_peered":"2023-10-03T10:09:44.333408+0000","last_unstale":"2023-10-03T10:10:40.081082+0000","last_undegraded":"2023-10-03T10:10:40.081082+0000","last_fullsized":"2023-10-03T10:10:40.081082+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.080880+0000","last_change":"2023-10-03T10:09:48.369173+0000","last_active":"2023-10-03T10:10:40.080880+0000","last_peered":"2023-10-03T10:10:40.080880+0000","last_clean":"2023-10-03T10:10:40.080880+0000","last_became_active":"2023-10-03T10:09:48.368843+0000","last_became_peered":"2023-10-03T10:09:48.368843+0000","last_unstale":"2023-10-03T10:10:40.080880+0000","last_undegraded":"2023-10-03T10:10:40.080880+0000","last_fullsized":"2023-10-03T10:10:40.080880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.082125+0000","last_change":"2023-10-03T10:09:48.747157+0000","last_active":"2023-10-03T10:10:40.082125+0000","last_peered":"2023-10-03T10:10:40.082125+0000","last_clean":"2023-10-03T10:10:40.082125+0000","last_became_active":"2023-10-03T10:09:48.745029+0000","last_became_peered":"2023-10-03T10:09:48.745029+0000","last_unstale":"2023-10-03T10:10:40.082125+0000","last_undegraded":"2023-10-03T10:10:40.082125+0000","last_fullsized":"2023-10-03T10:10:40.082125+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.086696+0000","last_change":"2023-10-03T10:09:44.329886+0000","last_active":"2023-10-03T10:10:40.086696+0000","last_peered":"2023-10-03T10:10:40.086696+0000","last_clean":"2023-10-03T10:10:40.086696+0000","last_became_active":"2023-10-03T10:09:44.329607+0000","last_became_peered":"2023-10-03T10:09:44.329607+0000","last_unstale":"2023-10-03T10:10:40.086696+0000","last_undegraded":"2023-10-03T10:10:40.086696+0000","last_fullsized":"2023-10-03T10:10:40.086696+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091684+0000","last_change":"2023-10-03T10:09:48.371183+0000","last_active":"2023-10-03T10:10:40.091684+0000","last_peered":"2023-10-03T10:10:40.091684+0000","last_clean":"2023-10-03T10:10:40.091684+0000","last_became_active":"2023-10-03T10:09:48.370930+0000","last_became_peered":"2023-10-03T10:09:48.370930+0000","last_unstale":"2023-10-03T10:10:40.091684+0000","last_undegraded":"2023-10-03T10:10:40.091684+0000","last_fullsized":"2023-10-03T10:10:40.091684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.080638+0000","last_change":"2023-10-03T10:09:48.743221+0000","last_active":"2023-10-03T10:10:40.080638+0000","last_peered":"2023-10-03T10:10:40.080638+0000","last_clean":"2023-10-03T10:10:40.080638+0000","last_became_active":"2023-10-03T10:09:48.742967+0000","last_became_peered":"2023-10-03T10:09:48.742967+0000","last_unstale":"2023-10-03T10:10:40.080638+0000","last_undegraded":"2023-10-03T10:10:40.080638+0000","last_fullsized":"2023-10-03T10:10:40.080638+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.084157+0000","last_change":"2023-10-03T10:09:48.371421+0000","last_active":"2023-10-03T10:10:40.084157+0000","last_peered":"2023-10-03T10:10:40.084157+0000","last_clean":"2023-10-03T10:10:40.084157+0000","last_became_active":"2023-10-03T10:09:48.371121+0000","last_became_peered":"2023-10-03T10:09:48.371121+0000","last_unstale":"2023-10-03T10:10:40.084157+0000","last_undegraded":"2023-10-03T10:10:40.084157+0000","last_fullsized":"2023-10-03T10:10:40.084157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.092079+0000","last_change":"2023-10-03T10:09:44.334348+0000","last_active":"2023-10-03T10:10:40.092079+0000","last_peered":"2023-10-03T10:10:40.092079+0000","last_clean":"2023-10-03T10:10:40.092079+0000","last_became_active":"2023-10-03T10:09:44.333893+0000","last_became_peered":"2023-10-03T10:09:44.333893+0000","last_unstale":"2023-10-03T10:10:40.092079+0000","last_undegraded":"2023-10-03T10:10:40.092079+0000","last_fullsized":"2023-10-03T10:10:40.092079+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081008+0000","last_change":"2023-10-03T10:09:48.766676+0000","last_active":"2023-10-03T10:10:40.081008+0000","last_peered":"2023-10-03T10:10:40.081008+0000","last_clean":"2023-10-03T10:10:40.081008+0000","last_became_active":"2023-10-03T10:09:48.766218+0000","last_became_peered":"2023-10-03T10:09:48.766218+0000","last_unstale":"2023-10-03T10:10:40.081008+0000","last_undegraded":"2023-10-03T10:10:40.081008+0000","last_fullsized":"2023-10-03T10:10:40.081008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.084240+0000","last_change":"2023-10-03T10:09:44.333678+0000","last_active":"2023-10-03T10:10:40.084240+0000","last_peered":"2023-10-03T10:10:40.084240+0000","last_clean":"2023-10-03T10:10:40.084240+0000","last_became_active":"2023-10-03T10:09:44.333326+0000","last_became_peered":"2023-10-03T10:09:44.333326+0000","last_unstale":"2023-10-03T10:10:40.084240+0000","last_undegraded":"2023-10-03T10:10:40.084240+0000","last_fullsized":"2023-10-03T10:10:40.084240+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:43.308915+0000","last_clean_scrub_stamp":"2023-10-03T10:09:43.308915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081853+0000","last_change":"2023-10-03T10:09:48.380501+0000","last_active":"2023-10-03T10:10:40.081853+0000","last_peered":"2023-10-03T10:10:40.081853+0000","last_clean":"2023-10-03T10:10:40.081853+0000","last_became_active":"2023-10-03T10:09:48.380205+0000","last_became_peered":"2023-10-03T10:09:48.380205+0000","last_unstale":"2023-10-03T10:10:40.081853+0000","last_undegraded":"2023-10-03T10:10:40.081853+0000","last_fullsized":"2023-10-03T10:10:40.081853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372107+0000","last_change":"2023-10-03T10:09:48.760491+0000","last_active":"2023-10-03T10:11:52.372107+0000","last_peered":"2023-10-03T10:11:52.372107+0000","last_clean":"2023-10-03T10:11:52.372107+0000","last_became_active":"2023-10-03T10:09:48.760201+0000","last_became_peered":"2023-10-03T10:09:48.760201+0000","last_unstale":"2023-10-03T10:11:52.372107+0000","last_undegraded":"2023-10-03T10:11:52.372107+0000","last_fullsized":"2023-10-03T10:11:52.372107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.080569+0000","last_change":"2023-10-03T10:09:48.381420+0000","last_active":"2023-10-03T10:10:40.080569+0000","last_peered":"2023-10-03T10:10:40.080569+0000","last_clean":"2023-10-03T10:10:40.080569+0000","last_became_active":"2023-10-03T10:09:48.380776+0000","last_became_peered":"2023-10-03T10:09:48.380776+0000","last_unstale":"2023-10-03T10:10:40.080569+0000","last_undegraded":"2023-10-03T10:10:40.080569+0000","last_fullsized":"2023-10-03T10:10:40.080569+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.372306+0000","last_change":"2023-10-03T10:09:48.747044+0000","last_active":"2023-10-03T10:11:52.372306+0000","last_peered":"2023-10-03T10:11:52.372306+0000","last_clean":"2023-10-03T10:11:52.372306+0000","last_became_active":"2023-10-03T10:09:48.746598+0000","last_became_peered":"2023-10-03T10:09:48.746598+0000","last_unstale":"2023-10-03T10:11:52.372306+0000","last_undegraded":"2023-10-03T10:11:52.372306+0000","last_fullsized":"2023-10-03T10:11:52.372306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091824+0000","last_change":"2023-10-03T10:09:48.368132+0000","last_active":"2023-10-03T10:10:40.091824+0000","last_peered":"2023-10-03T10:10:40.091824+0000","last_clean":"2023-10-03T10:10:40.091824+0000","last_became_active":"2023-10-03T10:09:48.367533+0000","last_became_peered":"2023-10-03T10:09:48.367533+0000","last_unstale":"2023-10-03T10:10:40.091824+0000","last_undegraded":"2023-10-03T10:10:40.091824+0000","last_fullsized":"2023-10-03T10:10:40.091824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.371956+0000","last_change":"2023-10-03T10:10:40.088998+0000","last_active":"2023-10-03T10:11:52.371956+0000","last_peered":"2023-10-03T10:11:52.371956+0000","last_clean":"2023-10-03T10:11:52.371956+0000","last_became_active":"2023-10-03T10:10:40.088689+0000","last_became_peered":"2023-10-03T10:10:40.088689+0000","last_unstale":"2023-10-03T10:11:52.371956+0000","last_undegraded":"2023-10-03T10:11:52.371956+0000","last_fullsized":"2023-10-03T10:11:52.371956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.086753+0000","last_change":"2023-10-03T10:09:48.375975+0000","last_active":"2023-10-03T10:10:40.086753+0000","last_peered":"2023-10-03T10:10:40.086753+0000","last_clean":"2023-10-03T10:10:40.086753+0000","last_became_active":"2023-10-03T10:09:48.375693+0000","last_became_peered":"2023-10-03T10:09:48.375693+0000","last_unstale":"2023-10-03T10:10:40.086753+0000","last_undegraded":"2023-10-03T10:10:40.086753+0000","last_fullsized":"2023-10-03T10:10:40.086753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.371868+0000","last_change":"2023-10-03T10:09:48.758192+0000","last_active":"2023-10-03T10:11:52.371868+0000","last_peered":"2023-10-03T10:11:52.371868+0000","last_clean":"2023-10-03T10:11:52.371868+0000","last_became_active":"2023-10-03T10:09:48.757614+0000","last_became_peered":"2023-10-03T10:09:48.757614+0000","last_unstale":"2023-10-03T10:11:52.371868+0000","last_undegraded":"2023-10-03T10:11:52.371868+0000","last_fullsized":"2023-10-03T10:11:52.371868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.082217+0000","last_change":"2023-10-03T10:09:48.370797+0000","last_active":"2023-10-03T10:10:40.082217+0000","last_peered":"2023-10-03T10:10:40.082217+0000","last_clean":"2023-10-03T10:10:40.082217+0000","last_became_active":"2023-10-03T10:09:48.370506+0000","last_became_peered":"2023-10-03T10:09:48.370506+0000","last_unstale":"2023-10-03T10:10:40.082217+0000","last_undegraded":"2023-10-03T10:10:40.082217+0000","last_fullsized":"2023-10-03T10:10:40.082217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.084701+0000","last_change":"2023-10-03T10:09:48.766806+0000","last_active":"2023-10-03T10:10:40.084701+0000","last_peered":"2023-10-03T10:10:40.084701+0000","last_clean":"2023-10-03T10:10:40.084701+0000","last_became_active":"2023-10-03T10:09:48.765599+0000","last_became_peered":"2023-10-03T10:09:48.765599+0000","last_unstale":"2023-10-03T10:10:40.084701+0000","last_undegraded":"2023-10-03T10:10:40.084701+0000","last_fullsized":"2023-10-03T10:10:40.084701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081532+0000","last_change":"2023-10-03T10:09:48.377631+0000","last_active":"2023-10-03T10:10:40.081532+0000","last_peered":"2023-10-03T10:10:40.081532+0000","last_clean":"2023-10-03T10:10:40.081532+0000","last_became_active":"2023-10-03T10:09:48.377136+0000","last_became_peered":"2023-10-03T10:09:48.377136+0000","last_unstale":"2023-10-03T10:10:40.081532+0000","last_undegraded":"2023-10-03T10:10:40.081532+0000","last_fullsized":"2023-10-03T10:10:40.081532+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:47.339242+0000","last_clean_scrub_stamp":"2023-10-03T10:09:47.339242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:11:52.371686+0000","last_change":"2023-10-03T10:09:48.747220+0000","last_active":"2023-10-03T10:11:52.371686+0000","last_peered":"2023-10-03T10:11:52.371686+0000","last_clean":"2023-10-03T10:11:52.371686+0000","last_became_active":"2023-10-03T10:09:48.746293+0000","last_became_peered":"2023-10-03T10:09:48.746293+0000","last_unstale":"2023-10-03T10:11:52.371686+0000","last_undegraded":"2023-10-03T10:11:52.371686+0000","last_fullsized":"2023-10-03T10:11:52.371686+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091829+0000","last_change":"2023-10-03T10:09:48.743844+0000","last_active":"2023-10-03T10:10:40.091829+0000","last_peered":"2023-10-03T10:10:40.091829+0000","last_clean":"2023-10-03T10:10:40.091829+0000","last_became_active":"2023-10-03T10:09:48.743532+0000","last_became_peered":"2023-10-03T10:09:48.743532+0000","last_unstale":"2023-10-03T10:10:40.091829+0000","last_undegraded":"2023-10-03T10:10:40.091829+0000","last_fullsized":"2023-10-03T10:10:40.091829+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.081166+0000","last_change":"2023-10-03T10:09:48.764395+0000","last_active":"2023-10-03T10:10:40.081166+0000","last_peered":"2023-10-03T10:10:40.081166+0000","last_clean":"2023-10-03T10:10:40.081166+0000","last_became_active":"2023-10-03T10:09:48.762670+0000","last_became_peered":"2023-10-03T10:09:48.762670+0000","last_unstale":"2023-10-03T10:10:40.081166+0000","last_undegraded":"2023-10-03T10:10:40.081166+0000","last_fullsized":"2023-10-03T10:10:40.081166+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.094118+0000","last_change":"2023-10-03T10:10:40.089092+0000","last_active":"2023-10-03T10:10:40.094118+0000","last_peered":"2023-10-03T10:10:40.094118+0000","last_clean":"2023-10-03T10:10:40.094118+0000","last_became_active":"2023-10-03T10:10:40.088813+0000","last_became_peered":"2023-10-03T10:10:40.088813+0000","last_unstale":"2023-10-03T10:10:40.094118+0000","last_undegraded":"2023-10-03T10:10:40.094118+0000","last_fullsized":"2023-10-03T10:10:40.094118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.085181+0000","last_change":"2023-10-03T10:09:48.766105+0000","last_active":"2023-10-03T10:10:40.085181+0000","last_peered":"2023-10-03T10:10:40.085181+0000","last_clean":"2023-10-03T10:10:40.085181+0000","last_became_active":"2023-10-03T10:09:48.765834+0000","last_became_peered":"2023-10-03T10:09:48.765834+0000","last_unstale":"2023-10-03T10:10:40.085181+0000","last_undegraded":"2023-10-03T10:10:40.085181+0000","last_fullsized":"2023-10-03T10:10:40.085181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-03T10:10:40.091769+0000","last_change":"2023-10-03T10:09:48.743916+0000","last_active":"2023-10-03T10:10:40.091769+0000","last_peered":"2023-10-03T10:10:40.091769+0000","last_clean":"2023-10-03T10:10:40.091769+0000","last_became_active":"2023-10-03T10:09:48.743646+0000","last_became_peered":"2023-10-03T10:09:48.743646+0000","last_unstale":"2023-10-03T10:10:40.091769+0000","last_undegraded":"2023-10-03T10:10:40.091769+0000","last_fullsized":"2023-10-03T10:10:40.091769+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:48.343020+0000","last_clean_scrub_stamp":"2023-10-03T10:09:48.343020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705692,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297284,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074556,"statfs":{"total":96636764160,"available":96332345344,"internally_reserved":0,"allocated":192512,"data_stored":63854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"min":{"1min":0.20799999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.308,"5min":0.313,"15min":0.314},"min":{"1min":0.21099999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.25600000000000001}]},{"osd":1,"last update":"Tue Oct 3 10:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33700000000000002,"15min":0.33800000000000002},"min":{"1min":0.222,"5min":0.219,"15min":0.219},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.75},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.35499999999999998,"15min":0.35699999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.68400000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.313}]},{"osd":2,"last update":"Tue Oct 3 10:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32000000000000001,"15min":0.31900000000000001},"min":{"1min":0.253,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.32200000000000001,"15min":0.31900000000000001},"min":{"1min":0.26000000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.30199999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705692,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":64454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.26900000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"min":{"1min":0.17699999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.28499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"min":{"1min":0.19700000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.311}]},{"osd":1,"last update":"Tue Oct 3 10:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.23400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.317,"15min":0.317},"min":{"1min":0.23000000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.33600000000000002}]},{"osd":3,"last update":"Tue Oct 3 10:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.23100000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.34499999999999997,"15min":0.34599999999999997},"min":{"1min":0.25800000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.34599999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705693,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297276,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074564,"statfs":{"total":96636764160,"available":96332353536,"internally_reserved":0,"allocated":184320,"data_stored":61591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 10:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.29799999999999999,"15min":0.29999999999999999},"min":{"1min":0.20300000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.318,"15min":0.317},"min":{"1min":0.25900000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.45400000000000001}]},{"osd":2,"last update":"Tue Oct 3 10:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.29299999999999998,"5min":0.28399999999999997,"15min":0.28199999999999997},"min":{"1min":0.22800000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.30199999999999999,"15min":0.30399999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":3.0129999999999999}]},{"osd":3,"last update":"Tue Oct 3 10:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.316,"15min":0.316},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"last":3.052},{"interface":"front","average":{"1min":0.307,"5min":0.29699999999999999,"15min":0.29499999999999998},"min":{"1min":0.23599999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.59999999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705692,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":61537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:47 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.28999999999999998,"15min":0.28399999999999997},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.29899999999999999,"15min":0.29299999999999998},"min":{"1min":0.221,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.69699999999999995}]},{"osd":2,"last update":"Tue Oct 3 10:11:47 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.308,"15min":0.30099999999999999},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.33700000000000002,"15min":0.33200000000000002},"min":{"1min":0.254,"5min":0.246,"15min":0.246},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.81699999999999995}]},{"osd":3,"last update":"Tue Oct 3 10:11:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.32500000000000001,"15min":0.32100000000000001},"min":{"1min":0.23599999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.37,"5min":0.33400000000000002,"15min":0.32800000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:11:56.390 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-03T10:11:56.391 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-03T10:11:56.391 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-03T10:11:56.391 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-03T10:11:56.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.545+0000 7f3596991700 1 Processor -- start 2023-10-03T10:11:56.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.546+0000 7f3596991700 1 -- start start 2023-10-03T10:11:56.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.546+0000 7f3596991700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f359009e870 0x7f359009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.546+0000 7f3596991700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f359009f180 0x7f3590131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.546+0000 7f3596991700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359009c970 con 0x7f3590131d70 2023-10-03T10:11:56.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.546+0000 7f3596991700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35900a0920 con 0x7f359009f180 2023-10-03T10:11:56.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.546+0000 7f3596991700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f359009f9c0 con 0x7f359009e870 2023-10-03T10:11:56.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.546+0000 7f358f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f359009f180 0x7f3590131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.546+0000 7f358ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f359009e870 0x7f359009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.546+0000 7f358f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f359009f180 0x7f3590131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33216/0 (socket says 172.21.15.146:33216) 2023-10-03T10:11:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.546+0000 7f358ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f359009e870 0x7f359009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45856/0 (socket says 172.21.15.146:45856) 2023-10-03T10:11:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.546+0000 7f358f7fe700 1 -- 172.21.15.146:0/1917205571 learned_addr learned my addr 172.21.15.146:0/1917205571 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.546+0000 7f358f7fe700 1 -- 172.21.15.146:0/1917205571 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f359009e870 msgr2=0x7f359009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.546+0000 7f358f7fe700 1 --2- 172.21.15.146:0/1917205571 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f359009e870 0x7f359009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.546+0000 7f358f7fe700 1 -- 172.21.15.146:0/1917205571 >> v1:172.21.15.146:6789/0 conn(0x7f3590131d70 legacy=0x7f3590138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.546+0000 7f358f7fe700 1 -- 172.21.15.146:0/1917205571 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359009bab0 con 0x7f359009f180 2023-10-03T10:11:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.546+0000 7f358ffff700 1 --2- 172.21.15.146:0/1917205571 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f359009e870 0x7f359009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.547+0000 7f358f7fe700 1 --2- 172.21.15.146:0/1917205571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f359009f180 0x7f3590131830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f35840098f0 tx=0x7f3584009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f95a4273478ab2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.547+0000 7f358effd700 1 -- 172.21.15.146:0/1917205571 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3584011830 con 0x7f359009f180 2023-10-03T10:11:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.547+0000 7f358effd700 1 -- 172.21.15.146:0/1917205571 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3584011990 con 0x7f359009f180 2023-10-03T10:11:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.547+0000 7f358effd700 1 -- 172.21.15.146:0/1917205571 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3584011d20 con 0x7f359009f180 2023-10-03T10:11:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.547+0000 7f3596991700 1 -- 172.21.15.146:0/1917205571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f359009f180 msgr2=0x7f3590131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.547+0000 7f3596991700 1 --2- 172.21.15.146:0/1917205571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f359009f180 0x7f3590131830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f35840098f0 tx=0x7f3584009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.547+0000 7f3596991700 1 -- 172.21.15.146:0/1917205571 shutdown_connections 2023-10-03T10:11:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.547+0000 7f3596991700 1 --2- 172.21.15.146:0/1917205571 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f359009e870 0x7f359009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.547+0000 7f3596991700 1 --2- 172.21.15.146:0/1917205571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f359009f180 0x7f3590131830 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.547+0000 7f3596991700 1 -- 172.21.15.146:0/1917205571 >> 172.21.15.146:0/1917205571 conn(0x7f35900a4430 msgr2=0x7f35900a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.547+0000 7f3596991700 1 -- 172.21.15.146:0/1917205571 shutdown_connections 2023-10-03T10:11:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.547+0000 7f3596991700 1 -- 172.21.15.146:0/1917205571 wait complete. 2023-10-03T10:11:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.548+0000 7f3596991700 1 Processor -- start 2023-10-03T10:11:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.548+0000 7f3596991700 1 -- start start 2023-10-03T10:11:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.549+0000 7f3596991700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f359009e870 0x7f35901201d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.549+0000 7f3596991700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f359009f180 0x7f3590120710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.549+0000 7f3596991700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3590131d70 0x7f3590120c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.549+0000 7f3596991700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35901315a0 con 0x7f359009e870 2023-10-03T10:11:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.549+0000 7f3596991700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3590122c70 con 0x7f3590131d70 2023-10-03T10:11:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.549+0000 7f3596991700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3590123750 con 0x7f359009f180 2023-10-03T10:11:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.549+0000 7f358ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f359009e870 0x7f35901201d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.549+0000 7f358f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f359009f180 0x7f3590120710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.549+0000 7f358ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f359009e870 0x7f35901201d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33220/0 (socket says 172.21.15.146:33220) 2023-10-03T10:11:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.549+0000 7f358ffff700 1 -- 172.21.15.146:0/4129077813 learned_addr learned my addr 172.21.15.146:0/4129077813 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.549+0000 7f3594f2e700 1 --2- 172.21.15.146:0/4129077813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3590131d70 0x7f3590120c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.549+0000 7f358ffff700 1 -- 172.21.15.146:0/4129077813 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f359009f180 msgr2=0x7f3590120710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.549+0000 7f358ffff700 1 --2- 172.21.15.146:0/4129077813 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f359009f180 0x7f3590120710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.549+0000 7f358ffff700 1 -- 172.21.15.146:0/4129077813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3590131d70 msgr2=0x7f3590120c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.549+0000 7f358ffff700 1 --2- 172.21.15.146:0/4129077813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3590131d70 0x7f3590120c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.549+0000 7f358ffff700 1 -- 172.21.15.146:0/4129077813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35800094a0 con 0x7f359009e870 2023-10-03T10:11:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.549+0000 7f358f7fe700 1 --2- 172.21.15.146:0/4129077813 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f359009f180 0x7f3590120710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.549+0000 7f358ffff700 1 --2- 172.21.15.146:0/4129077813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f359009e870 0x7f35901201d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f358000ec10 tx=0x7f358000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.550+0000 7f358cff9700 1 -- 172.21.15.146:0/4129077813 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3580009760 con 0x7f359009e870 2023-10-03T10:11:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.550+0000 7f358cff9700 1 -- 172.21.15.146:0/4129077813 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358000c850 con 0x7f359009e870 2023-10-03T10:11:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.550+0000 7f3596991700 1 -- 172.21.15.146:0/4129077813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3584009550 con 0x7f359009e870 2023-10-03T10:11:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.550+0000 7f358cff9700 1 -- 172.21.15.146:0/4129077813 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358000cbe0 con 0x7f359009e870 2023-10-03T10:11:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.550+0000 7f3596991700 1 -- 172.21.15.146:0/4129077813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35900a2df0 con 0x7f359009e870 2023-10-03T10:11:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.550+0000 7f358cff9700 1 -- 172.21.15.146:0/4129077813 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f358000cd40 con 0x7f359009e870 2023-10-03T10:11:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.551+0000 7f358cff9700 1 -- 172.21.15.146:0/4129077813 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f358003ff50 con 0x7f359009e870 2023-10-03T10:11:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.551+0000 7f3596991700 1 -- 172.21.15.146:0/4129077813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359011d580 con 0x7f359009e870 2023-10-03T10:11:56.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.555+0000 7f358cff9700 1 -- 172.21.15.146:0/4129077813 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3580021080 con 0x7f359009e870 2023-10-03T10:11:56.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.783+0000 7f3596991700 1 -- 172.21.15.146:0/4129077813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f359004f2a0 con 0x7f359009e870 2023-10-03T10:11:56.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.784+0000 7f358cff9700 1 -- 172.21.15.146:0/4129077813 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f3580017020 con 0x7f359009e870 2023-10-03T10:11:56.784 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:11:56.784 INFO:teuthology.orchestra.run.smithi146.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-03T10:11:56.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.786+0000 7f3596991700 1 -- 172.21.15.146:0/4129077813 >> v1:172.21.15.146:6816/126749 conn(0x7f357c02f510 legacy=0x7f357c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.786+0000 7f3596991700 1 -- 172.21.15.146:0/4129077813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f359009e870 msgr2=0x7f35901201d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.786+0000 7f3596991700 1 --2- 172.21.15.146:0/4129077813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f359009e870 0x7f35901201d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f358000ec10 tx=0x7f358000ef20 comp rx=0 tx=0).stop 2023-10-03T10:11:56.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.786+0000 7f3596991700 1 -- 172.21.15.146:0/4129077813 shutdown_connections 2023-10-03T10:11:56.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.786+0000 7f3596991700 1 --2- 172.21.15.146:0/4129077813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3590131d70 0x7f3590120c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.786+0000 7f3596991700 1 --2- 172.21.15.146:0/4129077813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f359009e870 0x7f35901201d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.786+0000 7f3596991700 1 --2- 172.21.15.146:0/4129077813 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f359009f180 0x7f3590120710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.786+0000 7f3596991700 1 -- 172.21.15.146:0/4129077813 >> 172.21.15.146:0/4129077813 conn(0x7f35900a4430 msgr2=0x7f359011a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:56.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.786+0000 7f3596991700 1 -- 172.21.15.146:0/4129077813 shutdown_connections 2023-10-03T10:11:56.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.786+0000 7f3596991700 1 -- 172.21.15.146:0/4129077813 wait complete. 2023-10-03T10:11:56.798 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-03T10:11:56.798 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:56.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.920+0000 7f2076982700 1 Processor -- start 2023-10-03T10:11:56.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.920+0000 7f2076982700 1 -- start start 2023-10-03T10:11:56.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.921+0000 7f2076982700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2070133ad0 0x7f2070133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.921+0000 7f2076982700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20701300a0 0x7f20701304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.921+0000 7f2076982700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f207006b2d0 con 0x7f20701309f0 2023-10-03T10:11:56.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.921+0000 7f2076982700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2070133610 con 0x7f2070133ad0 2023-10-03T10:11:56.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.921+0000 7f2076982700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f207009a500 con 0x7f20701300a0 2023-10-03T10:11:56.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.921+0000 7f206ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2070133ad0 0x7f2070133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.921+0000 7f206f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20701300a0 0x7f20701304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.921+0000 7f2074f1f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f20701309f0 0x7f207013a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40720/0 (socket says 172.21.15.146:40720) 2023-10-03T10:11:56.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.921+0000 7f206f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20701300a0 0x7f20701304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45874/0 (socket says 172.21.15.146:45874) 2023-10-03T10:11:56.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.921+0000 7f206ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2070133ad0 0x7f2070133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33226/0 (socket says 172.21.15.146:33226) 2023-10-03T10:11:56.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.921+0000 7f2074f1f700 1 -- 172.21.15.146:0/3498726559 learned_addr learned my addr 172.21.15.146:0/3498726559 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:11:56.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.921+0000 7f206effd700 1 -- 172.21.15.146:0/3498726559 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202994676 0 0) 0x7f207006b2d0 con 0x7f20701309f0 2023-10-03T10:11:56.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.921+0000 7f206effd700 1 -- 172.21.15.146:0/3498726559 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20580035b0 con 0x7f20701309f0 2023-10-03T10:11:56.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.921+0000 7f206f7fe700 1 -- 172.21.15.146:0/3498726559 >> v2:172.21.15.146:3300/0 conn(0x7f2070133ad0 msgr2=0x7f2070133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:56.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.921+0000 7f206f7fe700 1 --2- 172.21.15.146:0/3498726559 >> v2:172.21.15.146:3300/0 conn(0x7f2070133ad0 0x7f2070133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.921+0000 7f206f7fe700 1 -- 172.21.15.146:0/3498726559 >> v1:172.21.15.146:6789/0 conn(0x7f20701309f0 legacy=0x7f207013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.921+0000 7f206f7fe700 1 -- 172.21.15.146:0/3498726559 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20701338b0 con 0x7f20701300a0 2023-10-03T10:11:56.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.921+0000 7f206ffff700 1 --2- 172.21.15.146:0/3498726559 >> v2:172.21.15.146:3300/0 conn(0x7f2070133ad0 0x7f2070133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:56.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.922+0000 7f206f7fe700 1 --2- 172.21.15.146:0/3498726559 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20701300a0 0x7f20701304b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2064009840 tx=0x7f2064009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6efe89785628150 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:56.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.922+0000 7f206effd700 1 -- 172.21.15.146:0/3498726559 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2064011830 con 0x7f20701300a0 2023-10-03T10:11:56.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.922+0000 7f206effd700 1 -- 172.21.15.146:0/3498726559 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2064011990 con 0x7f20701300a0 2023-10-03T10:11:56.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.922+0000 7f206effd700 1 -- 172.21.15.146:0/3498726559 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2064011d20 con 0x7f20701300a0 2023-10-03T10:11:56.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.922+0000 7f2076982700 1 -- 172.21.15.146:0/3498726559 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20701300a0 msgr2=0x7f20701304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.922+0000 7f2076982700 1 --2- 172.21.15.146:0/3498726559 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20701300a0 0x7f20701304b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2064009840 tx=0x7f2064009b50 comp rx=0 tx=0).stop 2023-10-03T10:11:56.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.922+0000 7f2076982700 1 -- 172.21.15.146:0/3498726559 shutdown_connections 2023-10-03T10:11:56.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.922+0000 7f2076982700 1 --2- 172.21.15.146:0/3498726559 >> v2:172.21.15.146:3300/0 conn(0x7f2070133ad0 0x7f2070133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.922+0000 7f2076982700 1 --2- 172.21.15.146:0/3498726559 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20701300a0 0x7f20701304b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.922+0000 7f2076982700 1 -- 172.21.15.146:0/3498726559 >> 172.21.15.146:0/3498726559 conn(0x7f2070099c40 msgr2=0x7f20700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:56.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.922+0000 7f2076982700 1 -- 172.21.15.146:0/3498726559 shutdown_connections 2023-10-03T10:11:56.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.922+0000 7f2076982700 1 -- 172.21.15.146:0/3498726559 wait complete. 2023-10-03T10:11:56.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.923+0000 7f2076982700 1 Processor -- start 2023-10-03T10:11:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.923+0000 7f2076982700 1 -- start start 2023-10-03T10:11:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.924+0000 7f2076982700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20701300a0 0x7f207011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.924+0000 7f2076982700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20701309f0 0x7f207011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.924+0000 7f2076982700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2070133ad0 0x7f207011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.924+0000 7f2076982700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20701200c0 con 0x7f20701300a0 2023-10-03T10:11:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.924+0000 7f2076982700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207011f040 con 0x7f20701309f0 2023-10-03T10:11:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.924+0000 7f2076982700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f207011fb20 con 0x7f2070133ad0 2023-10-03T10:11:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.924+0000 7f206ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20701300a0 0x7f207011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.924+0000 7f206f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20701309f0 0x7f207011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.924+0000 7f206ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20701300a0 0x7f207011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33230/0 (socket says 172.21.15.146:33230) 2023-10-03T10:11:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.924+0000 7f206ffff700 1 -- 172.21.15.146:0/1805330143 learned_addr learned my addr 172.21.15.146:0/1805330143 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.924+0000 7f2074f1f700 1 --2- 172.21.15.146:0/1805330143 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2070133ad0 0x7f207011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.924+0000 7f206ffff700 1 -- 172.21.15.146:0/1805330143 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2070133ad0 msgr2=0x7f207011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.924+0000 7f206ffff700 1 --2- 172.21.15.146:0/1805330143 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2070133ad0 0x7f207011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.924+0000 7f206ffff700 1 -- 172.21.15.146:0/1805330143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20701309f0 msgr2=0x7f207011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:56.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.924+0000 7f206ffff700 1 --2- 172.21.15.146:0/1805330143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20701309f0 0x7f207011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:56.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.924+0000 7f206ffff700 1 -- 172.21.15.146:0/1805330143 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20600094a0 con 0x7f20701300a0 2023-10-03T10:11:56.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.924+0000 7f206f7fe700 1 --2- 172.21.15.146:0/1805330143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20701309f0 0x7f207011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:56.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.924+0000 7f2074f1f700 1 --2- 172.21.15.146:0/1805330143 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2070133ad0 0x7f207011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:56.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.924+0000 7f206ffff700 1 --2- 172.21.15.146:0/1805330143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20701300a0 0x7f207011da40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f206000ec10 tx=0x7f206000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:56.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.924+0000 7f206cff9700 1 -- 172.21.15.146:0/1805330143 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206000c850 con 0x7f20701300a0 2023-10-03T10:11:56.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.925+0000 7f206cff9700 1 -- 172.21.15.146:0/1805330143 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206000c9b0 con 0x7f20701300a0 2023-10-03T10:11:56.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.925+0000 7f2076982700 1 -- 172.21.15.146:0/1805330143 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20640094a0 con 0x7f20701300a0 2023-10-03T10:11:56.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.925+0000 7f206cff9700 1 -- 172.21.15.146:0/1805330143 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206000cd20 con 0x7f20701300a0 2023-10-03T10:11:56.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.925+0000 7f2076982700 1 -- 172.21.15.146:0/1805330143 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f207012dd00 con 0x7f20701300a0 2023-10-03T10:11:56.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.925+0000 7f206cff9700 1 -- 172.21.15.146:0/1805330143 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2060013470 con 0x7f20701300a0 2023-10-03T10:11:56.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.925+0000 7f206cff9700 1 -- 172.21.15.146:0/1805330143 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f206003fd80 con 0x7f20701300a0 2023-10-03T10:11:56.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.926+0000 7f2076982700 1 -- 172.21.15.146:0/1805330143 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f207006be10 con 0x7f20701300a0 2023-10-03T10:11:56.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:56.930+0000 7f206cff9700 1 -- 172.21.15.146:0/1805330143 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2060021070 con 0x7f20701300a0 2023-10-03T10:11:57.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.114+0000 7f2076982700 1 -- 172.21.15.146:0/1805330143 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f207004f2a0 con 0x7f20701300a0 2023-10-03T10:11:57.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.115+0000 7f206cff9700 1 -- 172.21.15.146:0/1805330143 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+12945 (secure 0 0 0) 0x7f206000ce80 con 0x7f20701300a0 2023-10-03T10:11:57.115 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:11:57.115 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":22,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:11:54.330846+0000","last_up_change":"2023-10-03T10:09:42.301022+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":118758}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":118758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":118758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":118758}]},"public_addr":"172.21.15.146:6800/118758","cluster_addr":"172.21.15.146:6801/118758","heartbeat_back_addr":"172.21.15.146:6803/118758","heartbeat_front_addr":"172.21.15.146:6802/118758","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":118774}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":118774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":118774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":118774}]},"public_addr":"172.21.15.146:6804/118774","cluster_addr":"172.21.15.146:6806/118774","heartbeat_back_addr":"172.21.15.146:6810/118774","heartbeat_front_addr":"172.21.15.146:6808/118774","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":118775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":118775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":118775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":118775}]},"public_addr":"172.21.15.146:6805/118775","cluster_addr":"172.21.15.146:6807/118775","heartbeat_back_addr":"172.21.15.146:6811/118775","heartbeat_front_addr":"172.21.15.146:6809/118775","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":118776}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":118776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":118776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":118776}]},"public_addr":"172.21.15.146:6812/118776","cluster_addr":"172.21.15.146:6813/118776","heartbeat_back_addr":"172.21.15.146:6815/118776","heartbeat_front_addr":"172.21.15.146:6814/118776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:0/45915595":"2023-10-04T10:11:52.317723+0000","172.21.15.146:0/1896339219":"2023-10-04T10:11:52.317723+0000","172.21.15.146:6816/118159":"2023-10-04T10:11:52.317723+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:57.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.117+0000 7f2076982700 1 -- 172.21.15.146:0/1805330143 >> v1:172.21.15.146:6816/126749 conn(0x7f205c02f510 legacy=0x7f205c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.117+0000 7f2076982700 1 -- 172.21.15.146:0/1805330143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20701300a0 msgr2=0x7f207011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.117+0000 7f2076982700 1 --2- 172.21.15.146:0/1805330143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20701300a0 0x7f207011da40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f206000ec10 tx=0x7f206000ef20 comp rx=0 tx=0).stop 2023-10-03T10:11:57.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.118+0000 7f2076982700 1 -- 172.21.15.146:0/1805330143 shutdown_connections 2023-10-03T10:11:57.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.118+0000 7f2076982700 1 --2- 172.21.15.146:0/1805330143 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2070133ad0 0x7f207011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.118+0000 7f2076982700 1 --2- 172.21.15.146:0/1805330143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20701300a0 0x7f207011da40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.118+0000 7f2076982700 1 --2- 172.21.15.146:0/1805330143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20701309f0 0x7f207011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.118+0000 7f2076982700 1 -- 172.21.15.146:0/1805330143 >> 172.21.15.146:0/1805330143 conn(0x7f2070099c40 msgr2=0x7f207012e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:57.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.118+0000 7f2076982700 1 -- 172.21.15.146:0/1805330143 shutdown_connections 2023-10-03T10:11:57.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.118+0000 7f2076982700 1 -- 172.21.15.146:0/1805330143 wait complete. 2023-10-03T10:11:57.129 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T10:09:42.343363+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:43.224375+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:47.108480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:47.686814+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T10:11:57.130 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T10:11:57.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.254+0000 7fef6778b700 1 Processor -- start 2023-10-03T10:11:57.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.254+0000 7fef6778b700 1 -- start start 2023-10-03T10:11:57.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.255+0000 7fef6778b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef6009ed40 0x7fef60136660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.255+0000 7fef6778b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fef60136ba0 0x7fef60138f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.255+0000 7fef6778b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef60131340 con 0x7fef60131730 2023-10-03T10:11:57.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.255+0000 7fef6778b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6006e690 con 0x7fef60136ba0 2023-10-03T10:11:57.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.255+0000 7fef6778b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef6009b3d0 con 0x7fef6009ed40 2023-10-03T10:11:57.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.255+0000 7fef64d26700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef6009ed40 0x7fef60136660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.255+0000 7fef64d26700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef6009ed40 0x7fef60136660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45894/0 (socket says 172.21.15.146:45894) 2023-10-03T10:11:57.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.255+0000 7fef65527700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fef60131730 0x7fef60131b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40732/0 (socket says 172.21.15.146:40732) 2023-10-03T10:11:57.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.255+0000 7fef65d28700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fef60136ba0 0x7fef60138f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.255+0000 7fef64d26700 1 -- 172.21.15.146:0/962169486 learned_addr learned my addr 172.21.15.146:0/962169486 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:57.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.255+0000 7fef64d26700 1 -- 172.21.15.146:0/962169486 >> v2:172.21.15.146:3300/0 conn(0x7fef60136ba0 msgr2=0x7fef60138f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:57.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.255+0000 7fef64d26700 1 --2- 172.21.15.146:0/962169486 >> v2:172.21.15.146:3300/0 conn(0x7fef60136ba0 0x7fef60138f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.255+0000 7fef64d26700 1 -- 172.21.15.146:0/962169486 >> v1:172.21.15.146:6789/0 conn(0x7fef60131730 legacy=0x7fef60131b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.255+0000 7fef64d26700 1 -- 172.21.15.146:0/962169486 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6009a530 con 0x7fef6009ed40 2023-10-03T10:11:57.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.255+0000 7fef57fff700 1 -- 172.21.15.146:0/962169486 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862453836 0 0) 0x7fef60131340 con 0x7fef60131730 2023-10-03T10:11:57.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.255+0000 7fef65d28700 1 --2- 172.21.15.146:0/962169486 >> v2:172.21.15.146:3300/0 conn(0x7fef60136ba0 0x7fef60138f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:57.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.255+0000 7fef64d26700 1 --2- 172.21.15.146:0/962169486 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef6009ed40 0x7fef60136660 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef5c0098f0 tx=0x7fef5c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d3e148f787928b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:57.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.255+0000 7fef57fff700 1 -- 172.21.15.146:0/962169486 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c011830 con 0x7fef6009ed40 2023-10-03T10:11:57.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.255+0000 7fef57fff700 1 -- 172.21.15.146:0/962169486 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5c011990 con 0x7fef6009ed40 2023-10-03T10:11:57.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.255+0000 7fef57fff700 1 -- 172.21.15.146:0/962169486 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c011d20 con 0x7fef6009ed40 2023-10-03T10:11:57.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.256+0000 7fef6778b700 1 -- 172.21.15.146:0/962169486 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef6009ed40 msgr2=0x7fef60136660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.256+0000 7fef6778b700 1 --2- 172.21.15.146:0/962169486 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef6009ed40 0x7fef60136660 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef5c0098f0 tx=0x7fef5c009c00 comp rx=0 tx=0).stop 2023-10-03T10:11:57.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.256+0000 7fef6778b700 1 -- 172.21.15.146:0/962169486 shutdown_connections 2023-10-03T10:11:57.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.256+0000 7fef6778b700 1 --2- 172.21.15.146:0/962169486 >> v2:172.21.15.146:3300/0 conn(0x7fef60136ba0 0x7fef60138f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.256+0000 7fef6778b700 1 --2- 172.21.15.146:0/962169486 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef6009ed40 0x7fef60136660 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.256+0000 7fef6778b700 1 -- 172.21.15.146:0/962169486 >> 172.21.15.146:0/962169486 conn(0x7fef6009f3f0 msgr2=0x7fef6009f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:57.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.256+0000 7fef6778b700 1 -- 172.21.15.146:0/962169486 shutdown_connections 2023-10-03T10:11:57.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.256+0000 7fef6778b700 1 -- 172.21.15.146:0/962169486 wait complete. 2023-10-03T10:11:57.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.257+0000 7fef6778b700 1 Processor -- start 2023-10-03T10:11:57.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.257+0000 7fef6778b700 1 -- start start 2023-10-03T10:11:57.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.257+0000 7fef6778b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef6009ed40 0x7fef60134140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.257+0000 7fef6778b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef60131730 0x7fef60134680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.257+0000 7fef6778b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef60136ba0 0x7fef60134bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.257+0000 7fef6778b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef601392b0 con 0x7fef60131730 2023-10-03T10:11:57.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.257+0000 7fef6778b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef60099eb0 con 0x7fef6009ed40 2023-10-03T10:11:57.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.257+0000 7fef6778b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef60119d30 con 0x7fef60136ba0 2023-10-03T10:11:57.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.257+0000 7fef65d28700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef60136ba0 0x7fef60134bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.257+0000 7fef65527700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef6009ed40 0x7fef60134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.257+0000 7fef65d28700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef60136ba0 0x7fef60134bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45896/0 (socket says 172.21.15.146:45896) 2023-10-03T10:11:57.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.257+0000 7fef65d28700 1 -- 172.21.15.146:0/303181053 learned_addr learned my addr 172.21.15.146:0/303181053 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:57.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.257+0000 7fef64d26700 1 --2- 172.21.15.146:0/303181053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef60131730 0x7fef60134680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.258+0000 7fef65d28700 1 -- 172.21.15.146:0/303181053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef6009ed40 msgr2=0x7fef60134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.258+0000 7fef65d28700 1 --2- 172.21.15.146:0/303181053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef6009ed40 0x7fef60134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.258+0000 7fef65d28700 1 -- 172.21.15.146:0/303181053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef60131730 msgr2=0x7fef60134680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.258+0000 7fef65d28700 1 --2- 172.21.15.146:0/303181053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef60131730 0x7fef60134680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.258+0000 7fef65d28700 1 -- 172.21.15.146:0/303181053 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef58009a70 con 0x7fef60136ba0 2023-10-03T10:11:57.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.258+0000 7fef65d28700 1 --2- 172.21.15.146:0/303181053 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef60136ba0 0x7fef60134bc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fef5800efc0 tx=0x7fef5800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:57.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.258+0000 7fef55ffb700 1 -- 172.21.15.146:0/303181053 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5800ca90 con 0x7fef60136ba0 2023-10-03T10:11:57.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.258+0000 7fef55ffb700 1 -- 172.21.15.146:0/303181053 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5800f040 con 0x7fef60136ba0 2023-10-03T10:11:57.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.258+0000 7fef55ffb700 1 -- 172.21.15.146:0/303181053 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5800ce10 con 0x7fef60136ba0 2023-10-03T10:11:57.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.258+0000 7fef6778b700 1 -- 172.21.15.146:0/303181053 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5c009550 con 0x7fef60136ba0 2023-10-03T10:11:57.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.258+0000 7fef6778b700 1 -- 172.21.15.146:0/303181053 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef60118e80 con 0x7fef60136ba0 2023-10-03T10:11:57.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.259+0000 7fef55ffb700 1 -- 172.21.15.146:0/303181053 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fef58014480 con 0x7fef60136ba0 2023-10-03T10:11:57.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.259+0000 7fef55ffb700 1 -- 172.21.15.146:0/303181053 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fef580402e0 con 0x7fef60136ba0 2023-10-03T10:11:57.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.259+0000 7fef6778b700 1 -- 172.21.15.146:0/303181053 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6004f2a0 con 0x7fef60136ba0 2023-10-03T10:11:57.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.264+0000 7fef55ffb700 1 -- 172.21.15.146:0/303181053 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef58018020 con 0x7fef60136ba0 2023-10-03T10:11:57.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.449+0000 7fef6778b700 1 -- 172.21.15.146:0/303181053 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef60119ea0 con 0x7fef60136ba0 2023-10-03T10:11:57.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.450+0000 7fef55ffb700 1 -- 172.21.15.146:0/303181053 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fef58012930 con 0x7fef60136ba0 2023-10-03T10:11:57.450 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-03T10:11:57.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.452+0000 7fef6778b700 1 -- 172.21.15.146:0/303181053 >> v1:172.21.15.146:6816/126749 conn(0x7fef4402f510 legacy=0x7fef440319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.452+0000 7fef6778b700 1 -- 172.21.15.146:0/303181053 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef60136ba0 msgr2=0x7fef60134bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.452+0000 7fef6778b700 1 --2- 172.21.15.146:0/303181053 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef60136ba0 0x7fef60134bc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fef5800efc0 tx=0x7fef5800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.452+0000 7fef6778b700 1 -- 172.21.15.146:0/303181053 shutdown_connections 2023-10-03T10:11:57.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.452+0000 7fef6778b700 1 --2- 172.21.15.146:0/303181053 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef60136ba0 0x7fef60134bc0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.452+0000 7fef6778b700 1 --2- 172.21.15.146:0/303181053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef6009ed40 0x7fef60134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.452+0000 7fef6778b700 1 --2- 172.21.15.146:0/303181053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef60131730 0x7fef60134680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.452+0000 7fef6778b700 1 -- 172.21.15.146:0/303181053 >> 172.21.15.146:0/303181053 conn(0x7fef6009f3f0 msgr2=0x7fef60136f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:57.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.452+0000 7fef6778b700 1 -- 172.21.15.146:0/303181053 shutdown_connections 2023-10-03T10:11:57.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.452+0000 7fef6778b700 1 -- 172.21.15.146:0/303181053 wait complete. 2023-10-03T10:11:57.464 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:11:57.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.587+0000 7fe23ab47700 1 Processor -- start 2023-10-03T10:11:57.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.587+0000 7fe23ab47700 1 -- start start 2023-10-03T10:11:57.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.587+0000 7fe23ab47700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe23409ed40 0x7fe234136660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.587+0000 7fe23ab47700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe234136ba0 0x7fe234138f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.587+0000 7fe23ab47700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe234131340 con 0x7fe234131730 2023-10-03T10:11:57.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.587+0000 7fe23ab47700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe23406e690 con 0x7fe234136ba0 2023-10-03T10:11:57.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.587+0000 7fe23ab47700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23409b3d0 con 0x7fe23409ed40 2023-10-03T10:11:57.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.587+0000 7fe2390e4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe234136ba0 0x7fe234138f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.587+0000 7fe233fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe23409ed40 0x7fe234136660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.587+0000 7fe2388e3700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe234131730 0x7fe234131b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40740/0 (socket says 172.21.15.146:40740) 2023-10-03T10:11:57.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.587+0000 7fe2388e3700 1 -- 172.21.15.146:0/553144143 learned_addr learned my addr 172.21.15.146:0/553144143 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:11:57.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.588+0000 7fe233fff700 1 -- 172.21.15.146:0/553144143 >> v2:172.21.15.146:3300/0 conn(0x7fe234136ba0 msgr2=0x7fe234138f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:57.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.588+0000 7fe233fff700 1 --2- 172.21.15.146:0/553144143 >> v2:172.21.15.146:3300/0 conn(0x7fe234136ba0 0x7fe234138f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.588+0000 7fe233fff700 1 -- 172.21.15.146:0/553144143 >> v1:172.21.15.146:6789/0 conn(0x7fe234131730 legacy=0x7fe234131b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.588+0000 7fe233fff700 1 -- 172.21.15.146:0/553144143 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23409a530 con 0x7fe23409ed40 2023-10-03T10:11:57.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.588+0000 7fe2337fe700 1 -- 172.21.15.146:0/553144143 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 744496052 0 0) 0x7fe234131340 con 0x7fe234131730 2023-10-03T10:11:57.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.588+0000 7fe2390e4700 1 --2- 172.21.15.146:0/553144143 >> v2:172.21.15.146:3300/0 conn(0x7fe234136ba0 0x7fe234138f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:57.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.588+0000 7fe233fff700 1 --2- 172.21.15.146:0/553144143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe23409ed40 0x7fe234136660 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe220009840 tx=0x7fe220009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=105ce907c61ac6c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:57.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.588+0000 7fe2337fe700 1 -- 172.21.15.146:0/553144143 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe220011830 con 0x7fe23409ed40 2023-10-03T10:11:57.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.588+0000 7fe2337fe700 1 -- 172.21.15.146:0/553144143 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe220011990 con 0x7fe23409ed40 2023-10-03T10:11:57.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.588+0000 7fe2337fe700 1 -- 172.21.15.146:0/553144143 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe220011d20 con 0x7fe23409ed40 2023-10-03T10:11:57.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.588+0000 7fe23ab47700 1 -- 172.21.15.146:0/553144143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe23409ed40 msgr2=0x7fe234136660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.588+0000 7fe23ab47700 1 --2- 172.21.15.146:0/553144143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe23409ed40 0x7fe234136660 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe220009840 tx=0x7fe220009b50 comp rx=0 tx=0).stop 2023-10-03T10:11:57.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.589+0000 7fe23ab47700 1 -- 172.21.15.146:0/553144143 shutdown_connections 2023-10-03T10:11:57.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.589+0000 7fe23ab47700 1 --2- 172.21.15.146:0/553144143 >> v2:172.21.15.146:3300/0 conn(0x7fe234136ba0 0x7fe234138f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.589+0000 7fe23ab47700 1 --2- 172.21.15.146:0/553144143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe23409ed40 0x7fe234136660 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.589+0000 7fe23ab47700 1 -- 172.21.15.146:0/553144143 >> 172.21.15.146:0/553144143 conn(0x7fe23409f3f0 msgr2=0x7fe23409f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:57.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.589+0000 7fe23ab47700 1 -- 172.21.15.146:0/553144143 shutdown_connections 2023-10-03T10:11:57.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.589+0000 7fe23ab47700 1 -- 172.21.15.146:0/553144143 wait complete. 2023-10-03T10:11:57.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.589+0000 7fe23ab47700 1 Processor -- start 2023-10-03T10:11:57.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.589+0000 7fe23ab47700 1 -- start start 2023-10-03T10:11:57.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.590+0000 7fe23ab47700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe23409ed40 0x7fe23406f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.590+0000 7fe23ab47700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe234131730 0x7fe23406f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.590+0000 7fe23ab47700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe234136ba0 0x7fe23406fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.590+0000 7fe23ab47700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe234070db0 con 0x7fe234136ba0 2023-10-03T10:11:57.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.590+0000 7fe23ab47700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe234099f20 con 0x7fe23409ed40 2023-10-03T10:11:57.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.590+0000 7fe23ab47700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe23412e760 con 0x7fe234131730 2023-10-03T10:11:57.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.590+0000 7fe2388e3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe23409ed40 0x7fe23406f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.590+0000 7fe2390e4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe234136ba0 0x7fe23406fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.590+0000 7fe233fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe234131730 0x7fe23406f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.590+0000 7fe2388e3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe23409ed40 0x7fe23406f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59534/0 (socket says 172.21.15.146:59534) 2023-10-03T10:11:57.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.590+0000 7fe2388e3700 1 -- 172.21.15.146:0/2495218685 learned_addr learned my addr 172.21.15.146:0/2495218685 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:57.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.590+0000 7fe2390e4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe234136ba0 0x7fe23406fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33260/0 (socket says 172.21.15.146:33260) 2023-10-03T10:11:57.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.590+0000 7fe2388e3700 1 -- 172.21.15.146:0/2495218685 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe234131730 msgr2=0x7fe23406f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.590+0000 7fe2388e3700 1 --2- 172.21.15.146:0/2495218685 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe234131730 0x7fe23406f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.590+0000 7fe2388e3700 1 -- 172.21.15.146:0/2495218685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe234136ba0 msgr2=0x7fe23406fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.590+0000 7fe2388e3700 1 --2- 172.21.15.146:0/2495218685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe234136ba0 0x7fe23406fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.590+0000 7fe2388e3700 1 -- 172.21.15.146:0/2495218685 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c009a70 con 0x7fe23409ed40 2023-10-03T10:11:57.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.590+0000 7fe2390e4700 1 --2- 172.21.15.146:0/2495218685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe234136ba0 0x7fe23406fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:57.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.591+0000 7fe2388e3700 1 --2- 172.21.15.146:0/2495218685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe23409ed40 0x7fe23406f230 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe22800c550 tx=0x7fe22800c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:57.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.591+0000 7fe2317fa700 1 -- 172.21.15.146:0/2495218685 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe228004c80 con 0x7fe23409ed40 2023-10-03T10:11:57.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.591+0000 7fe2317fa700 1 -- 172.21.15.146:0/2495218685 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe228004e00 con 0x7fe23409ed40 2023-10-03T10:11:57.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.591+0000 7fe23ab47700 1 -- 172.21.15.146:0/2495218685 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2200094a0 con 0x7fe23409ed40 2023-10-03T10:11:57.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.591+0000 7fe2317fa700 1 -- 172.21.15.146:0/2495218685 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe228007310 con 0x7fe23409ed40 2023-10-03T10:11:57.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.591+0000 7fe23ab47700 1 -- 172.21.15.146:0/2495218685 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe234135760 con 0x7fe23409ed40 2023-10-03T10:11:57.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.591+0000 7fe2317fa700 1 -- 172.21.15.146:0/2495218685 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe228007470 con 0x7fe23409ed40 2023-10-03T10:11:57.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.592+0000 7fe2317fa700 1 -- 172.21.15.146:0/2495218685 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fe22803f860 con 0x7fe23409ed40 2023-10-03T10:11:57.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.592+0000 7fe23ab47700 1 -- 172.21.15.146:0/2495218685 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe23404f2a0 con 0x7fe23409ed40 2023-10-03T10:11:57.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.596+0000 7fe2317fa700 1 -- 172.21.15.146:0/2495218685 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe2280123b0 con 0x7fe23409ed40 2023-10-03T10:11:57.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.778+0000 7fe23ab47700 1 -- 172.21.15.146:0/2495218685 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe23406baa0 con 0x7fe23409ed40 2023-10-03T10:11:57.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.778+0000 7fe2317fa700 1 -- 172.21.15.146:0/2495218685 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe2280102c0 con 0x7fe23409ed40 2023-10-03T10:11:57.778 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-03T10:11:57.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.780+0000 7fe23ab47700 1 -- 172.21.15.146:0/2495218685 >> v1:172.21.15.146:6816/126749 conn(0x7fe21802f510 legacy=0x7fe2180319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.780+0000 7fe23ab47700 1 -- 172.21.15.146:0/2495218685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe23409ed40 msgr2=0x7fe23406f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.780+0000 7fe23ab47700 1 --2- 172.21.15.146:0/2495218685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe23409ed40 0x7fe23406f230 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe22800c550 tx=0x7fe22800c860 comp rx=0 tx=0).stop 2023-10-03T10:11:57.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.780+0000 7fe23ab47700 1 -- 172.21.15.146:0/2495218685 shutdown_connections 2023-10-03T10:11:57.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.780+0000 7fe23ab47700 1 --2- 172.21.15.146:0/2495218685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe234136ba0 0x7fe23406fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.780+0000 7fe23ab47700 1 --2- 172.21.15.146:0/2495218685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe23409ed40 0x7fe23406f230 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.780+0000 7fe23ab47700 1 --2- 172.21.15.146:0/2495218685 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe234131730 0x7fe23406f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.780+0000 7fe23ab47700 1 -- 172.21.15.146:0/2495218685 >> 172.21.15.146:0/2495218685 conn(0x7fe23409f3f0 msgr2=0x7fe234136f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:57.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.780+0000 7fe23ab47700 1 -- 172.21.15.146:0/2495218685 shutdown_connections 2023-10-03T10:11:57.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.780+0000 7fe23ab47700 1 -- 172.21.15.146:0/2495218685 wait complete. 2023-10-03T10:11:57.792 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:11:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.915+0000 7f388b45d700 1 Processor -- start 2023-10-03T10:11:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.915+0000 7f388b45d700 1 -- start start 2023-10-03T10:11:57.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.915+0000 7f388b45d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f38840a1530 0x7f3884138cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.915+0000 7f388b45d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38841391f0 0x7f388413b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.915+0000 7f388b45d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f388409dc70 con 0x7f38840a0a50 2023-10-03T10:11:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.915+0000 7f388b45d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38840a25d0 con 0x7f38841391f0 2023-10-03T10:11:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.915+0000 7f388b45d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38840a2040 con 0x7f38840a1530 2023-10-03T10:11:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.916+0000 7f38899fa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38841391f0 0x7f388413b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.916+0000 7f38889f8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f38840a1530 0x7f3884138cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.916+0000 7f38891f9700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f38840a0a50 0x7f38840a0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40748/0 (socket says 172.21.15.146:40748) 2023-10-03T10:11:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.916+0000 7f38891f9700 1 -- 172.21.15.146:0/2688991377 learned_addr learned my addr 172.21.15.146:0/2688991377 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:11:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.916+0000 7f38889f8700 1 -- 172.21.15.146:0/2688991377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38841391f0 msgr2=0x7f388413b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.916+0000 7f38889f8700 1 --2- 172.21.15.146:0/2688991377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38841391f0 0x7f388413b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.916+0000 7f38889f8700 1 -- 172.21.15.146:0/2688991377 >> v1:172.21.15.146:6789/0 conn(0x7f38840a0a50 legacy=0x7f38840a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.916+0000 7f387bfff700 1 -- 172.21.15.146:0/2688991377 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412394739 0 0) 0x7f388409dc70 con 0x7f38840a0a50 2023-10-03T10:11:57.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.916+0000 7f38889f8700 1 -- 172.21.15.146:0/2688991377 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38840a2980 con 0x7f38840a1530 2023-10-03T10:11:57.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.916+0000 7f38899fa700 1 --2- 172.21.15.146:0/2688991377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38841391f0 0x7f388413b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:57.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.916+0000 7f38889f8700 1 --2- 172.21.15.146:0/2688991377 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f38840a1530 0x7f3884138cb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3880009870 tx=0x7f3880009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1d5a6079bba87dc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:57.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.916+0000 7f387bfff700 1 -- 172.21.15.146:0/2688991377 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880011830 con 0x7f38840a1530 2023-10-03T10:11:57.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.916+0000 7f387bfff700 1 -- 172.21.15.146:0/2688991377 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3880011990 con 0x7f38840a1530 2023-10-03T10:11:57.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.916+0000 7f387bfff700 1 -- 172.21.15.146:0/2688991377 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880011d20 con 0x7f38840a1530 2023-10-03T10:11:57.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.917+0000 7f388b45d700 1 -- 172.21.15.146:0/2688991377 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f38840a1530 msgr2=0x7f3884138cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.917+0000 7f388b45d700 1 --2- 172.21.15.146:0/2688991377 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f38840a1530 0x7f3884138cb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3880009870 tx=0x7f3880009b80 comp rx=0 tx=0).stop 2023-10-03T10:11:57.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.917+0000 7f388b45d700 1 -- 172.21.15.146:0/2688991377 shutdown_connections 2023-10-03T10:11:57.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.917+0000 7f388b45d700 1 --2- 172.21.15.146:0/2688991377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38841391f0 0x7f388413b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.917+0000 7f388b45d700 1 --2- 172.21.15.146:0/2688991377 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f38840a1530 0x7f3884138cb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.917+0000 7f388b45d700 1 -- 172.21.15.146:0/2688991377 >> 172.21.15.146:0/2688991377 conn(0x7f38840a3070 msgr2=0x7f38840a3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:57.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.917+0000 7f388b45d700 1 -- 172.21.15.146:0/2688991377 shutdown_connections 2023-10-03T10:11:57.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.917+0000 7f388b45d700 1 -- 172.21.15.146:0/2688991377 wait complete. 2023-10-03T10:11:57.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.918+0000 7f388b45d700 1 Processor -- start 2023-10-03T10:11:57.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.918+0000 7f388b45d700 1 -- start start 2023-10-03T10:11:57.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.918+0000 7f388b45d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38840a0a50 0x7f3884120800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.918+0000 7f388b45d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38840a1530 0x7f3884120d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.918+0000 7f388b45d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f38841391f0 0x7f3884121280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:57.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.918+0000 7f388b45d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3884124ce0 con 0x7f38840a1530 2023-10-03T10:11:57.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.918+0000 7f388b45d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3884122410 con 0x7f38840a0a50 2023-10-03T10:11:57.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.918+0000 7f388b45d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3884123660 con 0x7f38841391f0 2023-10-03T10:11:57.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.918+0000 7f38891f9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38840a0a50 0x7f3884120800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.918+0000 7f38891f9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38840a0a50 0x7f3884120800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59554/0 (socket says 172.21.15.146:59554) 2023-10-03T10:11:57.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.918+0000 7f38891f9700 1 -- 172.21.15.146:0/3239508734 learned_addr learned my addr 172.21.15.146:0/3239508734 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:57.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.918+0000 7f38899fa700 1 --2- 172.21.15.146:0/3239508734 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f38841391f0 0x7f3884121280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.918+0000 7f38889f8700 1 --2- 172.21.15.146:0/3239508734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38840a1530 0x7f3884120d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:57.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.919+0000 7f38891f9700 1 -- 172.21.15.146:0/3239508734 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f38841391f0 msgr2=0x7f3884121280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.919+0000 7f38891f9700 1 --2- 172.21.15.146:0/3239508734 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f38841391f0 0x7f3884121280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.919+0000 7f38891f9700 1 -- 172.21.15.146:0/3239508734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38840a1530 msgr2=0x7f3884120d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:57.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.919+0000 7f38891f9700 1 --2- 172.21.15.146:0/3239508734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38840a1530 0x7f3884120d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:57.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.919+0000 7f38891f9700 1 -- 172.21.15.146:0/3239508734 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c009a70 con 0x7f38840a0a50 2023-10-03T10:11:57.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.919+0000 7f38899fa700 1 --2- 172.21.15.146:0/3239508734 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f38841391f0 0x7f3884121280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:57.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.919+0000 7f38891f9700 1 --2- 172.21.15.146:0/3239508734 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38840a0a50 0x7f3884120800 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f387400c550 tx=0x7f387400c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:57.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.919+0000 7f3879ffb700 1 -- 172.21.15.146:0/3239508734 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3874004c80 con 0x7f38840a0a50 2023-10-03T10:11:57.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.919+0000 7f3879ffb700 1 -- 172.21.15.146:0/3239508734 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3874004e00 con 0x7f38840a0a50 2023-10-03T10:11:57.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.919+0000 7f3879ffb700 1 -- 172.21.15.146:0/3239508734 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3874007310 con 0x7f38840a0a50 2023-10-03T10:11:57.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.919+0000 7f388b45d700 1 -- 172.21.15.146:0/3239508734 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38800094a0 con 0x7f38840a0a50 2023-10-03T10:11:57.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.919+0000 7f388b45d700 1 -- 172.21.15.146:0/3239508734 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38840a52d0 con 0x7f38840a0a50 2023-10-03T10:11:57.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.920+0000 7f3879ffb700 1 -- 172.21.15.146:0/3239508734 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3874007470 con 0x7f38840a0a50 2023-10-03T10:11:57.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.920+0000 7f3879ffb700 1 -- 172.21.15.146:0/3239508734 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f387403f7b0 con 0x7f38840a0a50 2023-10-03T10:11:57.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.920+0000 7f388b45d700 1 -- 172.21.15.146:0/3239508734 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38840a0370 con 0x7f38840a0a50 2023-10-03T10:11:57.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:57.925+0000 7f3879ffb700 1 -- 172.21.15.146:0/3239508734 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38740123b0 con 0x7f38840a0a50 2023-10-03T10:11:58.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.104+0000 7f388b45d700 1 -- 172.21.15.146:0/3239508734 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f388404f2a0 con 0x7f38840a0a50 2023-10-03T10:11:58.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.105+0000 7f3879ffb700 1 -- 172.21.15.146:0/3239508734 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3874011360 con 0x7f38840a0a50 2023-10-03T10:11:58.106 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-03T10:11:58.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.107+0000 7f388b45d700 1 -- 172.21.15.146:0/3239508734 >> v1:172.21.15.146:6816/126749 conn(0x7f386802f510 legacy=0x7f38680319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.107+0000 7f388b45d700 1 -- 172.21.15.146:0/3239508734 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38840a0a50 msgr2=0x7f3884120800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.107+0000 7f388b45d700 1 --2- 172.21.15.146:0/3239508734 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38840a0a50 0x7f3884120800 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f387400c550 tx=0x7f387400c860 comp rx=0 tx=0).stop 2023-10-03T10:11:58.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.107+0000 7f388b45d700 1 -- 172.21.15.146:0/3239508734 shutdown_connections 2023-10-03T10:11:58.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.107+0000 7f388b45d700 1 --2- 172.21.15.146:0/3239508734 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f38841391f0 0x7f3884121280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.107+0000 7f388b45d700 1 --2- 172.21.15.146:0/3239508734 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38840a0a50 0x7f3884120800 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.107+0000 7f388b45d700 1 --2- 172.21.15.146:0/3239508734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38840a1530 0x7f3884120d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.107+0000 7f388b45d700 1 -- 172.21.15.146:0/3239508734 >> 172.21.15.146:0/3239508734 conn(0x7f38840a3070 msgr2=0x7f38840a56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:58.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.107+0000 7f388b45d700 1 -- 172.21.15.146:0/3239508734 shutdown_connections 2023-10-03T10:11:58.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.107+0000 7f388b45d700 1 -- 172.21.15.146:0/3239508734 wait complete. 2023-10-03T10:11:58.119 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:11:58.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.242+0000 7f873219b700 1 Processor -- start 2023-10-03T10:11:58.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.242+0000 7f873219b700 1 -- start start 2023-10-03T10:11:58.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.242+0000 7f873219b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f872c1303f0 0x7f872c134c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:58.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.242+0000 7f873219b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f872c1351d0 0x7f872c1375b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:58.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.242+0000 7f873219b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872c0706f0 con 0x7f872c12f910 2023-10-03T10:11:58.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.242+0000 7f873219b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872c0709c0 con 0x7f872c1303f0 2023-10-03T10:11:58.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.242+0000 7f873219b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872c099a60 con 0x7f872c1351d0 2023-10-03T10:11:58.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.243+0000 7f872affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f872c1303f0 0x7f872c134c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:58.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.243+0000 7f872bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f872c1351d0 0x7f872c1375b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:58.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.243+0000 7f872b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f872c12f910 0x7f872c12fce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40754/0 (socket says 172.21.15.146:40754) 2023-10-03T10:11:58.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.243+0000 7f872affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f872c1303f0 0x7f872c134c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33270/0 (socket says 172.21.15.146:33270) 2023-10-03T10:11:58.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.243+0000 7f872b7fe700 1 -- 172.21.15.146:0/961643149 learned_addr learned my addr 172.21.15.146:0/961643149 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:11:58.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.243+0000 7f872bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f872c1351d0 0x7f872c1375b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59564/0 (socket says 172.21.15.146:59564) 2023-10-03T10:11:58.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.243+0000 7f872bfff700 1 -- 172.21.15.146:0/961643149 >> v2:172.21.15.146:3300/0 conn(0x7f872c1303f0 msgr2=0x7f872c134c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:58.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.243+0000 7f872bfff700 1 --2- 172.21.15.146:0/961643149 >> v2:172.21.15.146:3300/0 conn(0x7f872c1303f0 0x7f872c134c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.243+0000 7f872bfff700 1 -- 172.21.15.146:0/961643149 >> v1:172.21.15.146:6789/0 conn(0x7f872c12f910 legacy=0x7f872c12fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.243+0000 7f872a7fc700 1 -- 172.21.15.146:0/961643149 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635419487 0 0) 0x7f872c0706f0 con 0x7f872c12f910 2023-10-03T10:11:58.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.243+0000 7f872bfff700 1 -- 172.21.15.146:0/961643149 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c072190 con 0x7f872c1351d0 2023-10-03T10:11:58.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.243+0000 7f872affd700 1 --2- 172.21.15.146:0/961643149 >> v2:172.21.15.146:3300/0 conn(0x7f872c1303f0 0x7f872c134c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:58.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.243+0000 7f872bfff700 1 --2- 172.21.15.146:0/961643149 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f872c1351d0 0x7f872c1375b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8724009d90 tx=0x7f872400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd48b5976bf3d3a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:58.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.243+0000 7f872a7fc700 1 -- 172.21.15.146:0/961643149 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872400e070 con 0x7f872c1351d0 2023-10-03T10:11:58.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.243+0000 7f872a7fc700 1 -- 172.21.15.146:0/961643149 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872400bb20 con 0x7f872c1351d0 2023-10-03T10:11:58.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.243+0000 7f872a7fc700 1 -- 172.21.15.146:0/961643149 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724012430 con 0x7f872c1351d0 2023-10-03T10:11:58.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.244+0000 7f873219b700 1 -- 172.21.15.146:0/961643149 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f872c1351d0 msgr2=0x7f872c1375b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.244+0000 7f873219b700 1 --2- 172.21.15.146:0/961643149 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f872c1351d0 0x7f872c1375b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8724009d90 tx=0x7f872400b330 comp rx=0 tx=0).stop 2023-10-03T10:11:58.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.244+0000 7f873219b700 1 -- 172.21.15.146:0/961643149 shutdown_connections 2023-10-03T10:11:58.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.244+0000 7f873219b700 1 --2- 172.21.15.146:0/961643149 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f872c1351d0 0x7f872c1375b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.244+0000 7f873219b700 1 --2- 172.21.15.146:0/961643149 >> v2:172.21.15.146:3300/0 conn(0x7f872c1303f0 0x7f872c134c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.244+0000 7f873219b700 1 -- 172.21.15.146:0/961643149 >> 172.21.15.146:0/961643149 conn(0x7f872c09f3f0 msgr2=0x7f872c09f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:58.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.244+0000 7f873219b700 1 -- 172.21.15.146:0/961643149 shutdown_connections 2023-10-03T10:11:58.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.244+0000 7f873219b700 1 -- 172.21.15.146:0/961643149 wait complete. 2023-10-03T10:11:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.245+0000 7f873219b700 1 Processor -- start 2023-10-03T10:11:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.245+0000 7f873219b700 1 -- start start 2023-10-03T10:11:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.245+0000 7f873219b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f872c12f910 0x7f872c09bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.245+0000 7f873219b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f872c1303f0 0x7f872c09c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.245+0000 7f873219b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f872c1351d0 0x7f872c09ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.245+0000 7f873219b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c09dfd0 con 0x7f872c1303f0 2023-10-03T10:11:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.245+0000 7f873219b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872c119130 con 0x7f872c12f910 2023-10-03T10:11:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.245+0000 7f873219b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f872c12dee0 con 0x7f872c1351d0 2023-10-03T10:11:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.245+0000 7f872b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f872c12f910 0x7f872c09bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.245+0000 7f872affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f872c1303f0 0x7f872c09c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:58.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.245+0000 7f872b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f872c12f910 0x7f872c09bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59580/0 (socket says 172.21.15.146:59580) 2023-10-03T10:11:58.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.245+0000 7f872bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f872c1351d0 0x7f872c09ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:58.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.245+0000 7f872b7fe700 1 -- 172.21.15.146:0/1891370730 learned_addr learned my addr 172.21.15.146:0/1891370730 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:58.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.246+0000 7f872affd700 1 -- 172.21.15.146:0/1891370730 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f872c1351d0 msgr2=0x7f872c09ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.246+0000 7f872affd700 1 --2- 172.21.15.146:0/1891370730 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f872c1351d0 0x7f872c09ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.246+0000 7f872affd700 1 -- 172.21.15.146:0/1891370730 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f872c12f910 msgr2=0x7f872c09bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.246+0000 7f872affd700 1 --2- 172.21.15.146:0/1891370730 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f872c12f910 0x7f872c09bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.246+0000 7f872affd700 1 -- 172.21.15.146:0/1891370730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871400a640 con 0x7f872c1303f0 2023-10-03T10:11:58.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.246+0000 7f872b7fe700 1 --2- 172.21.15.146:0/1891370730 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f872c12f910 0x7f872c09bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:58.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.246+0000 7f872affd700 1 --2- 172.21.15.146:0/1891370730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f872c1303f0 0x7f872c09c4c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f871400e910 tx=0x7f871400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:58.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.246+0000 7f8723fff700 1 -- 172.21.15.146:0/1891370730 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714004230 con 0x7f872c1303f0 2023-10-03T10:11:58.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.246+0000 7f8723fff700 1 -- 172.21.15.146:0/1891370730 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8714004390 con 0x7f872c1303f0 2023-10-03T10:11:58.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.246+0000 7f8723fff700 1 -- 172.21.15.146:0/1891370730 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871400c700 con 0x7f872c1303f0 2023-10-03T10:11:58.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.246+0000 7f873219b700 1 -- 172.21.15.146:0/1891370730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8724009a70 con 0x7f872c1303f0 2023-10-03T10:11:58.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.246+0000 7f873219b700 1 -- 172.21.15.146:0/1891370730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872c09e370 con 0x7f872c1303f0 2023-10-03T10:11:58.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.247+0000 7f8723fff700 1 -- 172.21.15.146:0/1891370730 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f871400c860 con 0x7f872c1303f0 2023-10-03T10:11:58.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.247+0000 7f8723fff700 1 -- 172.21.15.146:0/1891370730 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f871403f730 con 0x7f872c1303f0 2023-10-03T10:11:58.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.247+0000 7f873219b700 1 -- 172.21.15.146:0/1891370730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f872c119270 con 0x7f872c1303f0 2023-10-03T10:11:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.252+0000 7f8723fff700 1 -- 172.21.15.146:0/1891370730 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f872c119270 con 0x7f872c1303f0 2023-10-03T10:11:58.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.438+0000 7f873219b700 1 -- 172.21.15.146:0/1891370730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f872c119270 con 0x7f872c1303f0 2023-10-03T10:11:58.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.439+0000 7f8723fff700 1 -- 172.21.15.146:0/1891370730 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f872c119270 con 0x7f872c1303f0 2023-10-03T10:11:58.439 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-03T10:11:58.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.441+0000 7f873219b700 1 -- 172.21.15.146:0/1891370730 >> v1:172.21.15.146:6816/126749 conn(0x7f870c02f510 legacy=0x7f870c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.441+0000 7f873219b700 1 -- 172.21.15.146:0/1891370730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f872c1303f0 msgr2=0x7f872c09c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.441+0000 7f873219b700 1 --2- 172.21.15.146:0/1891370730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f872c1303f0 0x7f872c09c4c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f871400e910 tx=0x7f871400ec20 comp rx=0 tx=0).stop 2023-10-03T10:11:58.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.441+0000 7f873219b700 1 -- 172.21.15.146:0/1891370730 shutdown_connections 2023-10-03T10:11:58.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.441+0000 7f873219b700 1 --2- 172.21.15.146:0/1891370730 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f872c1351d0 0x7f872c09ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.441+0000 7f873219b700 1 --2- 172.21.15.146:0/1891370730 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f872c12f910 0x7f872c09bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.441+0000 7f873219b700 1 --2- 172.21.15.146:0/1891370730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f872c1303f0 0x7f872c09c4c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.441+0000 7f873219b700 1 -- 172.21.15.146:0/1891370730 >> 172.21.15.146:0/1891370730 conn(0x7f872c09f3f0 msgr2=0x7f872c0a1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:58.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.441+0000 7f873219b700 1 -- 172.21.15.146:0/1891370730 shutdown_connections 2023-10-03T10:11:58.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.441+0000 7f873219b700 1 -- 172.21.15.146:0/1891370730 wait complete. 2023-10-03T10:11:58.454 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:11:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.574+0000 7f015acfc700 1 Processor -- start 2023-10-03T10:11:58.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.574+0000 7f015acfc700 1 -- start start 2023-10-03T10:11:58.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.574+0000 7f015acfc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0154133ad0 0x7f0154133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:58.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.574+0000 7f015acfc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0154130bc0 0x7f015413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:58.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.574+0000 7f015acfc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015406b2d0 con 0x7f01541300a0 2023-10-03T10:11:58.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.574+0000 7f015acfc700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0154133610 con 0x7f0154133ad0 2023-10-03T10:11:58.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.574+0000 7f015acfc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f015409a500 con 0x7f0154130bc0 2023-10-03T10:11:58.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.574+0000 7f0158a98700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0154133ad0 0x7f0154133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:58.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.574+0000 7f0159299700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0154130bc0 0x7f015413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:58.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.574+0000 7f0153fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f01541300a0 0x7f01541304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40756/0 (socket says 172.21.15.146:40756) 2023-10-03T10:11:58.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.574+0000 7f0153fff700 1 -- 172.21.15.146:0/1718491646 learned_addr learned my addr 172.21.15.146:0/1718491646 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:11:58.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.574+0000 7f0158a98700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0154133ad0 0x7f0154133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33280/0 (socket says 172.21.15.146:33280) 2023-10-03T10:11:58.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.575+0000 7f0159299700 1 -- 172.21.15.146:0/1718491646 >> v2:172.21.15.146:3300/0 conn(0x7f0154133ad0 msgr2=0x7f0154133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:58.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.575+0000 7f0159299700 1 --2- 172.21.15.146:0/1718491646 >> v2:172.21.15.146:3300/0 conn(0x7f0154133ad0 0x7f0154133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.575+0000 7f0159299700 1 -- 172.21.15.146:0/1718491646 >> v1:172.21.15.146:6789/0 conn(0x7f01541300a0 legacy=0x7f01541304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.575+0000 7f0159299700 1 -- 172.21.15.146:0/1718491646 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01541338b0 con 0x7f0154130bc0 2023-10-03T10:11:58.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.575+0000 7f01537fe700 1 -- 172.21.15.146:0/1718491646 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866412956 0 0) 0x7f015406b2d0 con 0x7f01541300a0 2023-10-03T10:11:58.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.575+0000 7f0158a98700 1 --2- 172.21.15.146:0/1718491646 >> v2:172.21.15.146:3300/0 conn(0x7f0154133ad0 0x7f0154133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:58.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.575+0000 7f0159299700 1 --2- 172.21.15.146:0/1718491646 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0154130bc0 0x7f015413b990 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f014c009d90 tx=0x7f014c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bdd91f56fbd2fb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:58.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.575+0000 7f01537fe700 1 -- 172.21.15.146:0/1718491646 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c00e070 con 0x7f0154130bc0 2023-10-03T10:11:58.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.575+0000 7f01537fe700 1 -- 172.21.15.146:0/1718491646 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014c00bb20 con 0x7f0154130bc0 2023-10-03T10:11:58.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.575+0000 7f01537fe700 1 -- 172.21.15.146:0/1718491646 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c012430 con 0x7f0154130bc0 2023-10-03T10:11:58.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.575+0000 7f015acfc700 1 -- 172.21.15.146:0/1718491646 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0154130bc0 msgr2=0x7f015413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.575+0000 7f015acfc700 1 --2- 172.21.15.146:0/1718491646 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0154130bc0 0x7f015413b990 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f014c009d90 tx=0x7f014c00b330 comp rx=0 tx=0).stop 2023-10-03T10:11:58.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.576+0000 7f015acfc700 1 -- 172.21.15.146:0/1718491646 shutdown_connections 2023-10-03T10:11:58.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.576+0000 7f015acfc700 1 --2- 172.21.15.146:0/1718491646 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0154130bc0 0x7f015413b990 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.576+0000 7f015acfc700 1 --2- 172.21.15.146:0/1718491646 >> v2:172.21.15.146:3300/0 conn(0x7f0154133ad0 0x7f0154133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.576+0000 7f015acfc700 1 -- 172.21.15.146:0/1718491646 >> 172.21.15.146:0/1718491646 conn(0x7f0154099c40 msgr2=0x7f01540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:58.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.576+0000 7f015acfc700 1 -- 172.21.15.146:0/1718491646 shutdown_connections 2023-10-03T10:11:58.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.576+0000 7f015acfc700 1 -- 172.21.15.146:0/1718491646 wait complete. 2023-10-03T10:11:58.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.576+0000 7f015acfc700 1 Processor -- start 2023-10-03T10:11:58.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.577+0000 7f015acfc700 1 -- start start 2023-10-03T10:11:58.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.577+0000 7f015acfc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01541300a0 0x7f0154071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:58.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.577+0000 7f015acfc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0154130bc0 0x7f01540718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:58.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.577+0000 7f015acfc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0154133ad0 0x7f0154071df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:58.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.577+0000 7f015acfc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015411e100 con 0x7f0154133ad0 2023-10-03T10:11:58.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.577+0000 7f015acfc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015412f6f0 con 0x7f01541300a0 2023-10-03T10:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.577+0000 7f015acfc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f015412dd00 con 0x7f0154130bc0 2023-10-03T10:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.577+0000 7f0158a98700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01541300a0 0x7f0154071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.577+0000 7f0159299700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0154133ad0 0x7f0154071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.577+0000 7f0158a98700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01541300a0 0x7f0154071370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59588/0 (socket says 172.21.15.146:59588) 2023-10-03T10:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.577+0000 7f0153fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0154130bc0 0x7f01540718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.577+0000 7f0158a98700 1 -- 172.21.15.146:0/760407514 learned_addr learned my addr 172.21.15.146:0/760407514 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.577+0000 7f0159299700 1 -- 172.21.15.146:0/760407514 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0154130bc0 msgr2=0x7f01540718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.577+0000 7f0159299700 1 --2- 172.21.15.146:0/760407514 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0154130bc0 0x7f01540718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.577+0000 7f0159299700 1 -- 172.21.15.146:0/760407514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01541300a0 msgr2=0x7f0154071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.577+0000 7f0159299700 1 --2- 172.21.15.146:0/760407514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01541300a0 0x7f0154071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.578+0000 7f0159299700 1 -- 172.21.15.146:0/760407514 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01480094a0 con 0x7f0154133ad0 2023-10-03T10:11:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.578+0000 7f0158a98700 1 --2- 172.21.15.146:0/760407514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01541300a0 0x7f0154071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.578+0000 7f0159299700 1 --2- 172.21.15.146:0/760407514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0154133ad0 0x7f0154071df0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f014c016000 tx=0x7f014c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.578+0000 7f01517fa700 1 -- 172.21.15.146:0/760407514 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c012430 con 0x7f0154133ad0 2023-10-03T10:11:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.578+0000 7f01517fa700 1 -- 172.21.15.146:0/760407514 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014c020070 con 0x7f0154133ad0 2023-10-03T10:11:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.578+0000 7f015acfc700 1 -- 172.21.15.146:0/760407514 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014c009a70 con 0x7f0154133ad0 2023-10-03T10:11:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.578+0000 7f01517fa700 1 -- 172.21.15.146:0/760407514 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c004280 con 0x7f0154133ad0 2023-10-03T10:11:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.578+0000 7f015acfc700 1 -- 172.21.15.146:0/760407514 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f015411f960 con 0x7f0154133ad0 2023-10-03T10:11:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.578+0000 7f01517fa700 1 -- 172.21.15.146:0/760407514 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f014c0043e0 con 0x7f0154133ad0 2023-10-03T10:11:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.579+0000 7f01517fa700 1 -- 172.21.15.146:0/760407514 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f014c022070 con 0x7f0154133ad0 2023-10-03T10:11:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.579+0000 7f015acfc700 1 -- 172.21.15.146:0/760407514 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f015409cb20 con 0x7f0154133ad0 2023-10-03T10:11:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.583+0000 7f01517fa700 1 -- 172.21.15.146:0/760407514 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f014c02c080 con 0x7f0154133ad0 2023-10-03T10:11:58.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.805+0000 7f015acfc700 1 -- 172.21.15.146:0/760407514 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f015404f2a0 con 0x7f0154133ad0 2023-10-03T10:11:58.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.806+0000 7f01517fa700 1 -- 172.21.15.146:0/760407514 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2317 (secure 0 0 0) 0x7f014c01b400 con 0x7f0154133ad0 2023-10-03T10:11:58.807 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:11:58.807 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:48.718228+0000","modified":"2023-10-03T10:10:12.083527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4181":{"gid":4181,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6817/4164614194","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6817","nonce":4164614194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T10:11:58.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.808+0000 7f015acfc700 1 -- 172.21.15.146:0/760407514 >> v1:172.21.15.146:6816/126749 conn(0x7f013802f510 legacy=0x7f01380319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.808+0000 7f015acfc700 1 -- 172.21.15.146:0/760407514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0154133ad0 msgr2=0x7f0154071df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.808+0000 7f015acfc700 1 --2- 172.21.15.146:0/760407514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0154133ad0 0x7f0154071df0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f014c016000 tx=0x7f014c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.808+0000 7f015acfc700 1 -- 172.21.15.146:0/760407514 shutdown_connections 2023-10-03T10:11:58.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.808+0000 7f015acfc700 1 --2- 172.21.15.146:0/760407514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0154133ad0 0x7f0154071df0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.808+0000 7f015acfc700 1 --2- 172.21.15.146:0/760407514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01541300a0 0x7f0154071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.808+0000 7f015acfc700 1 --2- 172.21.15.146:0/760407514 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0154130bc0 0x7f01540718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.808+0000 7f015acfc700 1 -- 172.21.15.146:0/760407514 >> 172.21.15.146:0/760407514 conn(0x7f0154099c40 msgr2=0x7f0154132a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:58.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.808+0000 7f015acfc700 1 -- 172.21.15.146:0/760407514 shutdown_connections 2023-10-03T10:11:58.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.808+0000 7f015acfc700 1 -- 172.21.15.146:0/760407514 wait complete. 2023-10-03T10:11:58.810 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 7 2023-10-03T10:11:58.821 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:58.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.940+0000 7fb1a5d23700 1 Processor -- start 2023-10-03T10:11:58.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.940+0000 7fb1a5d23700 1 -- start start 2023-10-03T10:11:58.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.940+0000 7fb1a5d23700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1a0133ad0 0x7fb1a0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:58.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.940+0000 7fb1a5d23700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a0130bc0 0x7fb1a013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:58.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.940+0000 7fb1a5d23700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a006b2d0 con 0x7fb1a01300a0 2023-10-03T10:11:58.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.940+0000 7fb1a5d23700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a0133610 con 0x7fb1a0130bc0 2023-10-03T10:11:58.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.940+0000 7fb1a5d23700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a009a500 con 0x7fb1a0133ad0 2023-10-03T10:11:58.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.941+0000 7fb19ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a0130bc0 0x7fb1a013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:58.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.941+0000 7fb19effd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb1a01300a0 0x7fb1a01304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40762/0 (socket says 172.21.15.146:40762) 2023-10-03T10:11:58.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.941+0000 7fb19effd700 1 -- 172.21.15.146:0/3097532547 learned_addr learned my addr 172.21.15.146:0/3097532547 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:11:58.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.941+0000 7fb19f7fe700 1 --2- 172.21.15.146:0/3097532547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1a0133ad0 0x7fb1a0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:58.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.941+0000 7fb19f7fe700 1 -- 172.21.15.146:0/3097532547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a0130bc0 msgr2=0x7fb1a013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:58.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.941+0000 7fb19f7fe700 1 --2- 172.21.15.146:0/3097532547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a0130bc0 0x7fb1a013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.941+0000 7fb19f7fe700 1 -- 172.21.15.146:0/3097532547 >> v1:172.21.15.146:6789/0 conn(0x7fb1a01300a0 legacy=0x7fb1a01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.941+0000 7fb19e7fc700 1 -- 172.21.15.146:0/3097532547 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234002533 0 0) 0x7fb1a006b2d0 con 0x7fb1a01300a0 2023-10-03T10:11:58.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.941+0000 7fb19f7fe700 1 -- 172.21.15.146:0/3097532547 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a01338b0 con 0x7fb1a0133ad0 2023-10-03T10:11:58.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.941+0000 7fb19f7fe700 1 --2- 172.21.15.146:0/3097532547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1a0133ad0 0x7fb1a0133ea0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb190009870 tx=0x7fb190009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63ae85d29eef14d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:58.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.941+0000 7fb19e7fc700 1 -- 172.21.15.146:0/3097532547 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190011830 con 0x7fb1a0133ad0 2023-10-03T10:11:58.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.941+0000 7fb19e7fc700 1 -- 172.21.15.146:0/3097532547 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb190011990 con 0x7fb1a0133ad0 2023-10-03T10:11:58.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.941+0000 7fb19e7fc700 1 -- 172.21.15.146:0/3097532547 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190011d20 con 0x7fb1a0133ad0 2023-10-03T10:11:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.942+0000 7fb1a5d23700 1 -- 172.21.15.146:0/3097532547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1a0133ad0 msgr2=0x7fb1a0133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.942+0000 7fb1a5d23700 1 --2- 172.21.15.146:0/3097532547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1a0133ad0 0x7fb1a0133ea0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb190009870 tx=0x7fb190009b80 comp rx=0 tx=0).stop 2023-10-03T10:11:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.942+0000 7fb1a5d23700 1 -- 172.21.15.146:0/3097532547 shutdown_connections 2023-10-03T10:11:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.942+0000 7fb1a5d23700 1 --2- 172.21.15.146:0/3097532547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a0130bc0 0x7fb1a013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.942+0000 7fb1a5d23700 1 --2- 172.21.15.146:0/3097532547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1a0133ad0 0x7fb1a0133ea0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.942+0000 7fb1a5d23700 1 -- 172.21.15.146:0/3097532547 >> 172.21.15.146:0/3097532547 conn(0x7fb1a0099c40 msgr2=0x7fb1a00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.942+0000 7fb1a5d23700 1 -- 172.21.15.146:0/3097532547 shutdown_connections 2023-10-03T10:11:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.942+0000 7fb1a5d23700 1 -- 172.21.15.146:0/3097532547 wait complete. 2023-10-03T10:11:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.943+0000 7fb1a5d23700 1 Processor -- start 2023-10-03T10:11:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.943+0000 7fb1a5d23700 1 -- start start 2023-10-03T10:11:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.943+0000 7fb1a5d23700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a01300a0 0x7fb1a011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:58.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.943+0000 7fb1a5d23700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1a0130bc0 0x7fb1a011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:58.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.943+0000 7fb1a5d23700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a0133ad0 0x7fb1a011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:58.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.943+0000 7fb1a5d23700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a012d890 con 0x7fb1a01300a0 2023-10-03T10:11:58.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.943+0000 7fb1a5d23700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a011fab0 con 0x7fb1a0133ad0 2023-10-03T10:11:58.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.943+0000 7fb1a5d23700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a0120950 con 0x7fb1a0130bc0 2023-10-03T10:11:58.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.943+0000 7fb19f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a01300a0 0x7fb1a011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:58.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.943+0000 7fb19f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a01300a0 0x7fb1a011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33290/0 (socket says 172.21.15.146:33290) 2023-10-03T10:11:58.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.943+0000 7fb19ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a0133ad0 0x7fb1a011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:58.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.943+0000 7fb19f7fe700 1 -- 172.21.15.146:0/3975973796 learned_addr learned my addr 172.21.15.146:0/3975973796 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:58.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.943+0000 7fb19effd700 1 --2- 172.21.15.146:0/3975973796 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1a0130bc0 0x7fb1a011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:58.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.944+0000 7fb19f7fe700 1 -- 172.21.15.146:0/3975973796 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1a0130bc0 msgr2=0x7fb1a011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.944+0000 7fb19f7fe700 1 --2- 172.21.15.146:0/3975973796 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1a0130bc0 0x7fb1a011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.944+0000 7fb19f7fe700 1 -- 172.21.15.146:0/3975973796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a0133ad0 msgr2=0x7fb1a011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:58.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.944+0000 7fb19f7fe700 1 --2- 172.21.15.146:0/3975973796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a0133ad0 0x7fb1a011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:58.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.944+0000 7fb19f7fe700 1 -- 172.21.15.146:0/3975973796 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1900094a0 con 0x7fb1a01300a0 2023-10-03T10:11:58.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.944+0000 7fb19ffff700 1 --2- 172.21.15.146:0/3975973796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a0133ad0 0x7fb1a011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:58.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.944+0000 7fb19f7fe700 1 --2- 172.21.15.146:0/3975973796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a01300a0 0x7fb1a011da40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb190009840 tx=0x7fb190004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:58.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.944+0000 7fb187fff700 1 -- 172.21.15.146:0/3975973796 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190004510 con 0x7fb1a01300a0 2023-10-03T10:11:58.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.944+0000 7fb187fff700 1 -- 172.21.15.146:0/3975973796 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1900036a0 con 0x7fb1a01300a0 2023-10-03T10:11:58.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.944+0000 7fb1a5d23700 1 -- 172.21.15.146:0/3975973796 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a00a33e0 con 0x7fb1a01300a0 2023-10-03T10:11:58.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.944+0000 7fb187fff700 1 -- 172.21.15.146:0/3975973796 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190003a30 con 0x7fb1a01300a0 2023-10-03T10:11:58.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.944+0000 7fb1a5d23700 1 -- 172.21.15.146:0/3975973796 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a011fd70 con 0x7fb1a01300a0 2023-10-03T10:11:58.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.945+0000 7fb187fff700 1 -- 172.21.15.146:0/3975973796 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb190003b90 con 0x7fb1a01300a0 2023-10-03T10:11:58.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.945+0000 7fb187fff700 1 -- 172.21.15.146:0/3975973796 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fb190040aa0 con 0x7fb1a01300a0 2023-10-03T10:11:58.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.945+0000 7fb1a5d23700 1 -- 172.21.15.146:0/3975973796 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a004f2a0 con 0x7fb1a01300a0 2023-10-03T10:11:58.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:58.950+0000 7fb187fff700 1 -- 172.21.15.146:0/3975973796 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb190028080 con 0x7fb1a01300a0 2023-10-03T10:11:59.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.134+0000 7fb1a5d23700 1 -- 172.21.15.146:0/3975973796 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1a006c3b0 con 0x7fb1a01300a0 2023-10-03T10:11:59.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.135+0000 7fb187fff700 1 -- 172.21.15.146:0/3975973796 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+12945 (secure 0 0 0) 0x7fb190015020 con 0x7fb1a01300a0 2023-10-03T10:11:59.135 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:11:59.136 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":22,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:11:54.330846+0000","last_up_change":"2023-10-03T10:09:42.301022+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":118758}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":118758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":118758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":118758}]},"public_addr":"172.21.15.146:6800/118758","cluster_addr":"172.21.15.146:6801/118758","heartbeat_back_addr":"172.21.15.146:6803/118758","heartbeat_front_addr":"172.21.15.146:6802/118758","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":118774}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":118774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":118774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":118774}]},"public_addr":"172.21.15.146:6804/118774","cluster_addr":"172.21.15.146:6806/118774","heartbeat_back_addr":"172.21.15.146:6810/118774","heartbeat_front_addr":"172.21.15.146:6808/118774","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":118775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":118775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":118775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":118775}]},"public_addr":"172.21.15.146:6805/118775","cluster_addr":"172.21.15.146:6807/118775","heartbeat_back_addr":"172.21.15.146:6811/118775","heartbeat_front_addr":"172.21.15.146:6809/118775","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":118776}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":118776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":118776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":118776}]},"public_addr":"172.21.15.146:6812/118776","cluster_addr":"172.21.15.146:6813/118776","heartbeat_back_addr":"172.21.15.146:6815/118776","heartbeat_front_addr":"172.21.15.146:6814/118776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:0/45915595":"2023-10-04T10:11:52.317723+0000","172.21.15.146:0/1896339219":"2023-10-04T10:11:52.317723+0000","172.21.15.146:6816/118159":"2023-10-04T10:11:52.317723+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:59.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.137+0000 7fb1a5d23700 1 -- 172.21.15.146:0/3975973796 >> v1:172.21.15.146:6816/126749 conn(0x7fb18c02f510 legacy=0x7fb18c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:59.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.137+0000 7fb1a5d23700 1 -- 172.21.15.146:0/3975973796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a01300a0 msgr2=0x7fb1a011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:59.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.137+0000 7fb1a5d23700 1 --2- 172.21.15.146:0/3975973796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a01300a0 0x7fb1a011da40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb190009840 tx=0x7fb190004750 comp rx=0 tx=0).stop 2023-10-03T10:11:59.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.137+0000 7fb1a5d23700 1 -- 172.21.15.146:0/3975973796 shutdown_connections 2023-10-03T10:11:59.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.137+0000 7fb1a5d23700 1 --2- 172.21.15.146:0/3975973796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1a0133ad0 0x7fb1a011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.137+0000 7fb1a5d23700 1 --2- 172.21.15.146:0/3975973796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a01300a0 0x7fb1a011da40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.137+0000 7fb1a5d23700 1 --2- 172.21.15.146:0/3975973796 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1a0130bc0 0x7fb1a011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.137+0000 7fb1a5d23700 1 -- 172.21.15.146:0/3975973796 >> 172.21.15.146:0/3975973796 conn(0x7fb1a0099c40 msgr2=0x7fb1a0132c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:59.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.137+0000 7fb1a5d23700 1 -- 172.21.15.146:0/3975973796 shutdown_connections 2023-10-03T10:11:59.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.137+0000 7fb1a5d23700 1 -- 172.21.15.146:0/3975973796 wait complete. 2023-10-03T10:11:59.149 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T10:09:42.343363+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:43.224375+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:47.108480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:47.686814+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T10:11:59.150 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T10:11:59.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.272+0000 7fa8af666700 1 Processor -- start 2023-10-03T10:11:59.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.272+0000 7fa8af666700 1 -- start start 2023-10-03T10:11:59.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.273+0000 7fa8af666700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8a81349c0 0x7fa8a8136da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.273+0000 7fa8af666700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8a81372e0 0x7fa8a81396c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.273+0000 7fa8af666700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a809add0 con 0x7fa8a8131ae0 2023-10-03T10:11:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.273+0000 7fa8af666700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a81325c0 con 0x7fa8a81372e0 2023-10-03T10:11:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.273+0000 7fa8af666700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a809bd90 con 0x7fa8a81349c0 2023-10-03T10:11:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.273+0000 7fa8acc01700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8a81349c0 0x7fa8a8136da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.273+0000 7fa8acc01700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8a81349c0 0x7fa8a8136da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45990/0 (socket says 172.21.15.146:45990) 2023-10-03T10:11:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.273+0000 7fa8acc01700 1 -- 172.21.15.146:0/2307998204 learned_addr learned my addr 172.21.15.146:0/2307998204 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.273+0000 7fa8adc03700 1 --2- 172.21.15.146:0/2307998204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8a81372e0 0x7fa8a81396c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.273+0000 7fa8acc01700 1 -- 172.21.15.146:0/2307998204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8a81372e0 msgr2=0x7fa8a81396c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.273+0000 7fa8acc01700 1 --2- 172.21.15.146:0/2307998204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8a81372e0 0x7fa8a81396c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.273+0000 7fa8acc01700 1 -- 172.21.15.146:0/2307998204 >> v1:172.21.15.146:6789/0 conn(0x7fa8a8131ae0 legacy=0x7fa8a8131eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:59.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.273+0000 7fa89ffff700 1 -- 172.21.15.146:0/2307998204 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989728140 0 0) 0x7fa8a809add0 con 0x7fa8a8131ae0 2023-10-03T10:11:59.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.273+0000 7fa8acc01700 1 -- 172.21.15.146:0/2307998204 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a809b680 con 0x7fa8a81349c0 2023-10-03T10:11:59.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.273+0000 7fa8adc03700 1 --2- 172.21.15.146:0/2307998204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8a81372e0 0x7fa8a81396c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:59.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.274+0000 7fa8acc01700 1 --2- 172.21.15.146:0/2307998204 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8a81349c0 0x7fa8a8136da0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4009920 tx=0x7fa8a4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f91c80d39842508 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:59.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.274+0000 7fa89ffff700 1 -- 172.21.15.146:0/2307998204 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4011830 con 0x7fa8a81349c0 2023-10-03T10:11:59.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.274+0000 7fa89ffff700 1 -- 172.21.15.146:0/2307998204 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a4011990 con 0x7fa8a81349c0 2023-10-03T10:11:59.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.274+0000 7fa89ffff700 1 -- 172.21.15.146:0/2307998204 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4011d20 con 0x7fa8a81349c0 2023-10-03T10:11:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.274+0000 7fa8af666700 1 -- 172.21.15.146:0/2307998204 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8a81349c0 msgr2=0x7fa8a8136da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.274+0000 7fa8af666700 1 --2- 172.21.15.146:0/2307998204 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8a81349c0 0x7fa8a8136da0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4009920 tx=0x7fa8a4009c30 comp rx=0 tx=0).stop 2023-10-03T10:11:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.274+0000 7fa8af666700 1 -- 172.21.15.146:0/2307998204 shutdown_connections 2023-10-03T10:11:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.274+0000 7fa8af666700 1 --2- 172.21.15.146:0/2307998204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8a81372e0 0x7fa8a81396c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.274+0000 7fa8af666700 1 --2- 172.21.15.146:0/2307998204 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8a81349c0 0x7fa8a8136da0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.274+0000 7fa8af666700 1 -- 172.21.15.146:0/2307998204 >> 172.21.15.146:0/2307998204 conn(0x7fa8a80a4390 msgr2=0x7fa8a80a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.275+0000 7fa8af666700 1 -- 172.21.15.146:0/2307998204 shutdown_connections 2023-10-03T10:11:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.275+0000 7fa8af666700 1 -- 172.21.15.146:0/2307998204 wait complete. 2023-10-03T10:11:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.275+0000 7fa8af666700 1 Processor -- start 2023-10-03T10:11:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.275+0000 7fa8af666700 1 -- start start 2023-10-03T10:11:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.276+0000 7fa8af666700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8a8131ae0 0x7fa8a811b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.276+0000 7fa8af666700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8a81349c0 0x7fa8a811ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.276+0000 7fa8af666700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8a81372e0 0x7fa8a811bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.276+0000 7fa8af666700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a809dba0 con 0x7fa8a8131ae0 2023-10-03T10:11:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.276+0000 7fa8af666700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a811d9b0 con 0x7fa8a81372e0 2023-10-03T10:11:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.276+0000 7fa8af666700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a8131430 con 0x7fa8a81349c0 2023-10-03T10:11:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.276+0000 7fa8ad402700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8a8131ae0 0x7fa8a811b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.276+0000 7fa8adc03700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8a81372e0 0x7fa8a811bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.276+0000 7fa8ad402700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8a8131ae0 0x7fa8a811b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33294/0 (socket says 172.21.15.146:33294) 2023-10-03T10:11:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.276+0000 7fa8adc03700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8a81372e0 0x7fa8a811bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59640/0 (socket says 172.21.15.146:59640) 2023-10-03T10:11:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.276+0000 7fa8ad402700 1 -- 172.21.15.146:0/2678598205 learned_addr learned my addr 172.21.15.146:0/2678598205 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.276+0000 7fa8acc01700 1 --2- 172.21.15.146:0/2678598205 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8a81349c0 0x7fa8a811ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.276+0000 7fa8ad402700 1 -- 172.21.15.146:0/2678598205 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8a81349c0 msgr2=0x7fa8a811ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.276+0000 7fa8ad402700 1 --2- 172.21.15.146:0/2678598205 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8a81349c0 0x7fa8a811ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.276+0000 7fa8ad402700 1 -- 172.21.15.146:0/2678598205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8a81372e0 msgr2=0x7fa8a811bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.276+0000 7fa8ad402700 1 --2- 172.21.15.146:0/2678598205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8a81372e0 0x7fa8a811bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.276+0000 7fa8ad402700 1 -- 172.21.15.146:0/2678598205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a0009a70 con 0x7fa8a8131ae0 2023-10-03T10:11:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.276+0000 7fa8acc01700 1 --2- 172.21.15.146:0/2678598205 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8a81349c0 0x7fa8a811ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.276+0000 7fa8adc03700 1 --2- 172.21.15.146:0/2678598205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8a81372e0 0x7fa8a811bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.276+0000 7fa8ad402700 1 --2- 172.21.15.146:0/2678598205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8a8131ae0 0x7fa8a811b540 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa89800bd30 tx=0x7fa898009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.277+0000 7fa89dffb700 1 -- 172.21.15.146:0/2678598205 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89800cd60 con 0x7fa8a8131ae0 2023-10-03T10:11:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.277+0000 7fa89dffb700 1 -- 172.21.15.146:0/2678598205 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa898014440 con 0x7fa8a8131ae0 2023-10-03T10:11:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.277+0000 7fa8af666700 1 -- 172.21.15.146:0/2678598205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a4009550 con 0x7fa8a8131ae0 2023-10-03T10:11:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.277+0000 7fa89dffb700 1 -- 172.21.15.146:0/2678598205 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8980147f0 con 0x7fa8a8131ae0 2023-10-03T10:11:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.277+0000 7fa8af666700 1 -- 172.21.15.146:0/2678598205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a811d240 con 0x7fa8a8131ae0 2023-10-03T10:11:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.277+0000 7fa89dffb700 1 -- 172.21.15.146:0/2678598205 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa89801d3b0 con 0x7fa8a8131ae0 2023-10-03T10:11:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.278+0000 7fa89dffb700 1 -- 172.21.15.146:0/2678598205 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fa89803fab0 con 0x7fa8a8131ae0 2023-10-03T10:11:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.278+0000 7fa8af666700 1 -- 172.21.15.146:0/2678598205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a804f2a0 con 0x7fa8a8131ae0 2023-10-03T10:11:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.282+0000 7fa89dffb700 1 -- 172.21.15.146:0/2678598205 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa898019030 con 0x7fa8a8131ae0 2023-10-03T10:11:59.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.468+0000 7fa8af666700 1 -- 172.21.15.146:0/2678598205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8a8131670 con 0x7fa8a8131ae0 2023-10-03T10:11:59.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.468+0000 7fa89dffb700 1 -- 172.21.15.146:0/2678598205 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa898019030 con 0x7fa8a8131ae0 2023-10-03T10:11:59.469 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-03T10:11:59.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.470+0000 7fa8af666700 1 -- 172.21.15.146:0/2678598205 >> v1:172.21.15.146:6816/126749 conn(0x7fa88c02f510 legacy=0x7fa88c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:59.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.470+0000 7fa8af666700 1 -- 172.21.15.146:0/2678598205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8a8131ae0 msgr2=0x7fa8a811b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:59.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.470+0000 7fa8af666700 1 --2- 172.21.15.146:0/2678598205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8a8131ae0 0x7fa8a811b540 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa89800bd30 tx=0x7fa898009e80 comp rx=0 tx=0).stop 2023-10-03T10:11:59.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.470+0000 7fa8af666700 1 -- 172.21.15.146:0/2678598205 shutdown_connections 2023-10-03T10:11:59.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.470+0000 7fa8af666700 1 --2- 172.21.15.146:0/2678598205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8a81372e0 0x7fa8a811bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.470+0000 7fa8af666700 1 --2- 172.21.15.146:0/2678598205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8a8131ae0 0x7fa8a811b540 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.470+0000 7fa8af666700 1 --2- 172.21.15.146:0/2678598205 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8a81349c0 0x7fa8a811ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.470+0000 7fa8af666700 1 -- 172.21.15.146:0/2678598205 >> 172.21.15.146:0/2678598205 conn(0x7fa8a80a4390 msgr2=0x7fa8a809caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:59.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.470+0000 7fa8af666700 1 -- 172.21.15.146:0/2678598205 shutdown_connections 2023-10-03T10:11:59.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.470+0000 7fa8af666700 1 -- 172.21.15.146:0/2678598205 wait complete. 2023-10-03T10:11:59.483 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:11:59.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.606+0000 7f121c887700 1 Processor -- start 2023-10-03T10:11:59.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.606+0000 7f121c887700 1 -- start start 2023-10-03T10:11:59.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f121c887700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121809d780 0x7f121809db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:59.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f121c887700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f121809ad70 0x7f121809e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:59.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f121c887700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1218133a80 0x7f1218133f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:59.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f121c887700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121809a590 con 0x7f121809ad70 2023-10-03T10:11:59.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f121c887700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121809e5d0 con 0x7f1218133a80 2023-10-03T10:11:59.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f121c887700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f121806b450 con 0x7f121809d780 2023-10-03T10:11:59.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f121659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121809d780 0x7f121809db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:59.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f1216d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1218133a80 0x7f1218133f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:59.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f1215d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f121809ad70 0x7f121809e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:59.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f1216d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1218133a80 0x7f1218133f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59650/0 (socket says 172.21.15.146:59650) 2023-10-03T10:11:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f121659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121809d780 0x7f121809db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45994/0 (socket says 172.21.15.146:45994) 2023-10-03T10:11:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f1216d9d700 1 -- 172.21.15.146:0/3335368725 learned_addr learned my addr 172.21.15.146:0/3335368725 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f1216d9d700 1 -- 172.21.15.146:0/3335368725 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121809d780 msgr2=0x7f121809db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f1216d9d700 1 --2- 172.21.15.146:0/3335368725 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121809d780 0x7f121809db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f1216d9d700 1 -- 172.21.15.146:0/3335368725 >> v2:172.21.15.146:3300/0 conn(0x7f121809ad70 msgr2=0x7f121809e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f1216d9d700 1 --2- 172.21.15.146:0/3335368725 >> v2:172.21.15.146:3300/0 conn(0x7f121809ad70 0x7f121809e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f1216d9d700 1 -- 172.21.15.146:0/3335368725 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121806a9e0 con 0x7f1218133a80 2023-10-03T10:11:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f121659c700 1 --2- 172.21.15.146:0/3335368725 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121809d780 0x7f121809db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f1215d9b700 1 --2- 172.21.15.146:0/3335368725 >> v2:172.21.15.146:3300/0 conn(0x7f121809ad70 0x7f121809e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f1216d9d700 1 --2- 172.21.15.146:0/3335368725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1218133a80 0x7f1218133f00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1210009e50 tx=0x7f121000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aae36921448b0304 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f121559a700 1 -- 172.21.15.146:0/3335368725 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121000e070 con 0x7f1218133a80 2023-10-03T10:11:59.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f121559a700 1 -- 172.21.15.146:0/3335368725 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121000b910 con 0x7f1218133a80 2023-10-03T10:11:59.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.607+0000 7f121559a700 1 -- 172.21.15.146:0/3335368725 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121000bcc0 con 0x7f1218133a80 2023-10-03T10:11:59.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.608+0000 7f121c887700 1 -- 172.21.15.146:0/3335368725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1218133a80 msgr2=0x7f1218133f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:59.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.608+0000 7f121c887700 1 --2- 172.21.15.146:0/3335368725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1218133a80 0x7f1218133f00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1210009e50 tx=0x7f121000b330 comp rx=0 tx=0).stop 2023-10-03T10:11:59.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.608+0000 7f121c887700 1 -- 172.21.15.146:0/3335368725 shutdown_connections 2023-10-03T10:11:59.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.608+0000 7f121c887700 1 --2- 172.21.15.146:0/3335368725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1218133a80 0x7f1218133f00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.608+0000 7f121c887700 1 --2- 172.21.15.146:0/3335368725 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121809d780 0x7f121809db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.608+0000 7f121c887700 1 --2- 172.21.15.146:0/3335368725 >> v2:172.21.15.146:3300/0 conn(0x7f121809ad70 0x7f121809e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.608+0000 7f121c887700 1 -- 172.21.15.146:0/3335368725 >> 172.21.15.146:0/3335368725 conn(0x7f121809f980 msgr2=0x7f121809fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:59.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.608+0000 7f121c887700 1 -- 172.21.15.146:0/3335368725 shutdown_connections 2023-10-03T10:11:59.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.608+0000 7f121c887700 1 -- 172.21.15.146:0/3335368725 wait complete. 2023-10-03T10:11:59.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.609+0000 7f121c887700 1 Processor -- start 2023-10-03T10:11:59.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.609+0000 7f121c887700 1 -- start start 2023-10-03T10:11:59.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.609+0000 7f121c887700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f121809ad70 0x7f12181201d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.609+0000 7f121c887700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121809d780 0x7f1218120710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.609+0000 7f121c887700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1218133a80 0x7f1218120c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.609+0000 7f121c887700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1218124660 con 0x7f121809ad70 2023-10-03T10:11:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.609+0000 7f121c887700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1218121e30 con 0x7f121809d780 2023-10-03T10:11:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.609+0000 7f121c887700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12181239c0 con 0x7f1218133a80 2023-10-03T10:11:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.610+0000 7f1215d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121809d780 0x7f1218120710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.610+0000 7f1216d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1218133a80 0x7f1218120c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.610+0000 7f1215d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121809d780 0x7f1218120710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59654/0 (socket says 172.21.15.146:59654) 2023-10-03T10:11:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.610+0000 7f121659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f121809ad70 0x7f12181201d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.610+0000 7f1215d9b700 1 -- 172.21.15.146:0/1677622028 learned_addr learned my addr 172.21.15.146:0/1677622028 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.610+0000 7f1216d9d700 1 -- 172.21.15.146:0/1677622028 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121809d780 msgr2=0x7f1218120710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.610+0000 7f1216d9d700 1 --2- 172.21.15.146:0/1677622028 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121809d780 0x7f1218120710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.610+0000 7f1216d9d700 1 -- 172.21.15.146:0/1677622028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f121809ad70 msgr2=0x7f12181201d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.610+0000 7f1216d9d700 1 --2- 172.21.15.146:0/1677622028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f121809ad70 0x7f12181201d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.610+0000 7f1216d9d700 1 -- 172.21.15.146:0/1677622028 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12080094a0 con 0x7f1218133a80 2023-10-03T10:11:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.610+0000 7f121659c700 1 --2- 172.21.15.146:0/1677622028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f121809ad70 0x7f12181201d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.610+0000 7f1215d9b700 1 --2- 172.21.15.146:0/1677622028 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121809d780 0x7f1218120710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.610+0000 7f1216d9d700 1 --2- 172.21.15.146:0/1677622028 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1218133a80 0x7f1218120c50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f121806e540 tx=0x7f1210004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.610+0000 7f1206ffd700 1 -- 172.21.15.146:0/1677622028 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1210004240 con 0x7f1218133a80 2023-10-03T10:11:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.610+0000 7f1206ffd700 1 -- 172.21.15.146:0/1677622028 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12100043e0 con 0x7f1218133a80 2023-10-03T10:11:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.610+0000 7f121c887700 1 -- 172.21.15.146:0/1677622028 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f120c0094a0 con 0x7f1218133a80 2023-10-03T10:11:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.610+0000 7f1206ffd700 1 -- 172.21.15.146:0/1677622028 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1210004790 con 0x7f1218133a80 2023-10-03T10:11:59.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.610+0000 7f121c887700 1 -- 172.21.15.146:0/1677622028 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1210009b30 con 0x7f1218133a80 2023-10-03T10:11:59.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.611+0000 7f1206ffd700 1 -- 172.21.15.146:0/1677622028 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f121001c410 con 0x7f1218133a80 2023-10-03T10:11:59.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.611+0000 7f1206ffd700 1 -- 172.21.15.146:0/1677622028 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f1210041960 con 0x7f1218133a80 2023-10-03T10:11:59.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.611+0000 7f121c887700 1 -- 172.21.15.146:0/1677622028 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1218072080 con 0x7f1218133a80 2023-10-03T10:11:59.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.616+0000 7f1206ffd700 1 -- 172.21.15.146:0/1677622028 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f121001c6c0 con 0x7f1218133a80 2023-10-03T10:11:59.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.798+0000 7f121c887700 1 -- 172.21.15.146:0/1677622028 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1218123040 con 0x7f1218133a80 2023-10-03T10:11:59.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.798+0000 7f1206ffd700 1 -- 172.21.15.146:0/1677622028 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f121002db40 con 0x7f1218133a80 2023-10-03T10:11:59.799 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-03T10:11:59.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.800+0000 7f121c887700 1 -- 172.21.15.146:0/1677622028 >> v1:172.21.15.146:6816/126749 conn(0x7f11f802f510 legacy=0x7f11f80319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:59.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.800+0000 7f121c887700 1 -- 172.21.15.146:0/1677622028 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1218133a80 msgr2=0x7f1218120c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:59.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.800+0000 7f121c887700 1 --2- 172.21.15.146:0/1677622028 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1218133a80 0x7f1218120c50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f121806e540 tx=0x7f1210004ad0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.800+0000 7f121c887700 1 -- 172.21.15.146:0/1677622028 shutdown_connections 2023-10-03T10:11:59.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.800+0000 7f121c887700 1 --2- 172.21.15.146:0/1677622028 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1218133a80 0x7f1218120c50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.800+0000 7f121c887700 1 --2- 172.21.15.146:0/1677622028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f121809ad70 0x7f12181201d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.800+0000 7f121c887700 1 --2- 172.21.15.146:0/1677622028 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121809d780 0x7f1218120710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.800+0000 7f121c887700 1 -- 172.21.15.146:0/1677622028 >> 172.21.15.146:0/1677622028 conn(0x7f121809f980 msgr2=0x7f12181bad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:59.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.800+0000 7f121c887700 1 -- 172.21.15.146:0/1677622028 shutdown_connections 2023-10-03T10:11:59.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.800+0000 7f121c887700 1 -- 172.21.15.146:0/1677622028 wait complete. 2023-10-03T10:11:59.813 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:11:59.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.936+0000 7f7f519cc700 1 Processor -- start 2023-10-03T10:11:59.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.937+0000 7f7f519cc700 1 -- start start 2023-10-03T10:11:59.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.937+0000 7f7f519cc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f4c0a0ae0 0x7f7f4c0a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:59.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.937+0000 7f7f519cc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f4c0a13f0 0x7f7f4c137a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:59.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.937+0000 7f7f519cc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f4c0a2500 con 0x7f7f4c137f80 2023-10-03T10:11:59.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.937+0000 7f7f519cc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4c09e560 con 0x7f7f4c0a0ae0 2023-10-03T10:11:59.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.937+0000 7f7f519cc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4c0a22a0 con 0x7f7f4c0a13f0 2023-10-03T10:11:59.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.937+0000 7f7f4a7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f4c0a13f0 0x7f7f4c137a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:59.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.937+0000 7f7f4affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f4c0a0ae0 0x7f7f4c0a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:59.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.937+0000 7f7f4b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7f4c137f80 0x7f7f4c13a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40780/0 (socket says 172.21.15.146:40780) 2023-10-03T10:11:59.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.937+0000 7f7f4b7fe700 1 -- 172.21.15.146:0/1704370480 learned_addr learned my addr 172.21.15.146:0/1704370480 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:11:59.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.937+0000 7f7f4affd700 1 -- 172.21.15.146:0/1704370480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f4c0a13f0 msgr2=0x7f7f4c137a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:59.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.937+0000 7f7f4affd700 1 --2- 172.21.15.146:0/1704370480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f4c0a13f0 0x7f7f4c137a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.937+0000 7f7f49ffb700 1 -- 172.21.15.146:0/1704370480 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2196388472 0 0) 0x7f7f4c0a2500 con 0x7f7f4c137f80 2023-10-03T10:11:59.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.937+0000 7f7f4affd700 1 -- 172.21.15.146:0/1704370480 >> v1:172.21.15.146:6789/0 conn(0x7f7f4c137f80 legacy=0x7f7f4c13a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:59.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.937+0000 7f7f4affd700 1 -- 172.21.15.146:0/1704370480 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f4c06d480 con 0x7f7f4c0a0ae0 2023-10-03T10:11:59.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.937+0000 7f7f4a7fc700 1 --2- 172.21.15.146:0/1704370480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f4c0a13f0 0x7f7f4c137a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:59.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.938+0000 7f7f4affd700 1 --2- 172.21.15.146:0/1704370480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f4c0a0ae0 0x7f7f4c0a0eb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7f40009870 tx=0x7f7f40009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50e471b0c837c9bd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:59.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.938+0000 7f7f49ffb700 1 -- 172.21.15.146:0/1704370480 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f40011830 con 0x7f7f4c0a0ae0 2023-10-03T10:11:59.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.938+0000 7f7f49ffb700 1 -- 172.21.15.146:0/1704370480 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f40011990 con 0x7f7f4c0a0ae0 2023-10-03T10:11:59.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.938+0000 7f7f49ffb700 1 -- 172.21.15.146:0/1704370480 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f40011d20 con 0x7f7f4c0a0ae0 2023-10-03T10:11:59.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.938+0000 7f7f519cc700 1 -- 172.21.15.146:0/1704370480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f4c0a0ae0 msgr2=0x7f7f4c0a0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:59.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.938+0000 7f7f519cc700 1 --2- 172.21.15.146:0/1704370480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f4c0a0ae0 0x7f7f4c0a0eb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7f40009870 tx=0x7f7f40009b80 comp rx=0 tx=0).stop 2023-10-03T10:11:59.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.938+0000 7f7f519cc700 1 -- 172.21.15.146:0/1704370480 shutdown_connections 2023-10-03T10:11:59.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.938+0000 7f7f519cc700 1 --2- 172.21.15.146:0/1704370480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f4c0a0ae0 0x7f7f4c0a0eb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.938+0000 7f7f519cc700 1 --2- 172.21.15.146:0/1704370480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f4c0a13f0 0x7f7f4c137a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.938+0000 7f7f519cc700 1 -- 172.21.15.146:0/1704370480 >> 172.21.15.146:0/1704370480 conn(0x7f7f4c0a2ec0 msgr2=0x7f7f4c0a32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:59.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.938+0000 7f7f519cc700 1 -- 172.21.15.146:0/1704370480 shutdown_connections 2023-10-03T10:11:59.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.938+0000 7f7f519cc700 1 -- 172.21.15.146:0/1704370480 wait complete. 2023-10-03T10:11:59.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.939+0000 7f7f519cc700 1 Processor -- start 2023-10-03T10:11:59.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.939+0000 7f7f519cc700 1 -- start start 2023-10-03T10:11:59.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.940+0000 7f7f519cc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f4c0a0ae0 0x7f7f4c06dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:59.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.940+0000 7f7f519cc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f4c0a13f0 0x7f7f4c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:59.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.940+0000 7f7f519cc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f4c137f80 0x7f7f4c06e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:11:59.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.940+0000 7f7f519cc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4c071300 con 0x7f7f4c0a13f0 2023-10-03T10:11:59.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.940+0000 7f7f519cc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4c06f6d0 con 0x7f7f4c137f80 2023-10-03T10:11:59.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.940+0000 7f7f519cc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4c0a62a0 con 0x7f7f4c0a0ae0 2023-10-03T10:11:59.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.940+0000 7f7f4a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f4c0a13f0 0x7f7f4c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:59.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.940+0000 7f7f4b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f4c137f80 0x7f7f4c06e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:59.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.940+0000 7f7f4a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f4c0a13f0 0x7f7f4c06e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33328/0 (socket says 172.21.15.146:33328) 2023-10-03T10:11:59.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.940+0000 7f7f4affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f4c0a0ae0 0x7f7f4c06dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:11:59.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.940+0000 7f7f4a7fc700 1 -- 172.21.15.146:0/791229389 learned_addr learned my addr 172.21.15.146:0/791229389 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:11:59.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.940+0000 7f7f4b7fe700 1 -- 172.21.15.146:0/791229389 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f4c0a0ae0 msgr2=0x7f7f4c06dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:59.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.940+0000 7f7f4b7fe700 1 --2- 172.21.15.146:0/791229389 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f4c0a0ae0 0x7f7f4c06dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.940+0000 7f7f4b7fe700 1 -- 172.21.15.146:0/791229389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f4c0a13f0 msgr2=0x7f7f4c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:59.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.940+0000 7f7f4b7fe700 1 --2- 172.21.15.146:0/791229389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f4c0a13f0 0x7f7f4c06e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:11:59.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.940+0000 7f7f4b7fe700 1 -- 172.21.15.146:0/791229389 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c0094a0 con 0x7f7f4c137f80 2023-10-03T10:11:59.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.940+0000 7f7f4a7fc700 1 --2- 172.21.15.146:0/791229389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f4c0a13f0 0x7f7f4c06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:59.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.940+0000 7f7f4affd700 1 --2- 172.21.15.146:0/791229389 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f4c0a0ae0 0x7f7f4c06dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:59.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.940+0000 7f7f4b7fe700 1 --2- 172.21.15.146:0/791229389 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f4c137f80 0x7f7f4c06e540 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c06b570 tx=0x7f7f4400cec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:59.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.941+0000 7f7f33fff700 1 -- 172.21.15.146:0/791229389 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4400aa10 con 0x7f7f4c137f80 2023-10-03T10:11:59.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.941+0000 7f7f33fff700 1 -- 172.21.15.146:0/791229389 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4400ab90 con 0x7f7f4c137f80 2023-10-03T10:11:59.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.941+0000 7f7f519cc700 1 -- 172.21.15.146:0/791229389 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f400094a0 con 0x7f7f4c137f80 2023-10-03T10:11:59.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.941+0000 7f7f33fff700 1 -- 172.21.15.146:0/791229389 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f440070d0 con 0x7f7f4c137f80 2023-10-03T10:11:59.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.941+0000 7f7f519cc700 1 -- 172.21.15.146:0/791229389 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f4c12b220 con 0x7f7f4c137f80 2023-10-03T10:11:59.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.942+0000 7f7f519cc700 1 -- 172.21.15.146:0/791229389 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f4c04f2a0 con 0x7f7f4c137f80 2023-10-03T10:11:59.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.942+0000 7f7f33fff700 1 -- 172.21.15.146:0/791229389 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7f44007230 con 0x7f7f4c137f80 2023-10-03T10:11:59.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.942+0000 7f7f33fff700 1 -- 172.21.15.146:0/791229389 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f7f4403fbd0 con 0x7f7f4c137f80 2023-10-03T10:11:59.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:11:59.946+0000 7f7f33fff700 1 -- 172.21.15.146:0/791229389 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f440074e0 con 0x7f7f4c137f80 2023-10-03T10:12:00.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.130+0000 7f7f519cc700 1 -- 172.21.15.146:0/791229389 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f4c0a1dc0 con 0x7f7f4c137f80 2023-10-03T10:12:00.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.130+0000 7f7f33fff700 1 -- 172.21.15.146:0/791229389 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f4401a2c0 con 0x7f7f4c137f80 2023-10-03T10:12:00.131 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-03T10:12:00.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.132+0000 7f7f519cc700 1 -- 172.21.15.146:0/791229389 >> v1:172.21.15.146:6816/126749 conn(0x7f7f3802f510 legacy=0x7f7f380319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.132+0000 7f7f519cc700 1 -- 172.21.15.146:0/791229389 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f4c137f80 msgr2=0x7f7f4c06e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.132+0000 7f7f519cc700 1 --2- 172.21.15.146:0/791229389 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f4c137f80 0x7f7f4c06e540 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c06b570 tx=0x7f7f4400cec0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.132+0000 7f7f519cc700 1 -- 172.21.15.146:0/791229389 shutdown_connections 2023-10-03T10:12:00.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.132+0000 7f7f519cc700 1 --2- 172.21.15.146:0/791229389 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f4c137f80 0x7f7f4c06e540 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.132+0000 7f7f519cc700 1 --2- 172.21.15.146:0/791229389 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f4c0a0ae0 0x7f7f4c06dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.132+0000 7f7f519cc700 1 --2- 172.21.15.146:0/791229389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f4c0a13f0 0x7f7f4c06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.132+0000 7f7f519cc700 1 -- 172.21.15.146:0/791229389 >> 172.21.15.146:0/791229389 conn(0x7f7f4c0a2ec0 msgr2=0x7f7f4c0a4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:00.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.132+0000 7f7f519cc700 1 -- 172.21.15.146:0/791229389 shutdown_connections 2023-10-03T10:12:00.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.132+0000 7f7f519cc700 1 -- 172.21.15.146:0/791229389 wait complete. 2023-10-03T10:12:00.144 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:12:00.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.268+0000 7f5427c7b700 1 Processor -- start 2023-10-03T10:12:00.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.268+0000 7f5427c7b700 1 -- start start 2023-10-03T10:12:00.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.268+0000 7f5427c7b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f542009d780 0x7f542009db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.268+0000 7f5427c7b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f542009ad70 0x7f542009e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.268+0000 7f5427c7b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5420133a80 0x7f5420133ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.268+0000 7f5427c7b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542009a590 con 0x7f542009d780 2023-10-03T10:12:00.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.268+0000 7f5427c7b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542009e5d0 con 0x7f5420133a80 2023-10-03T10:12:00.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.268+0000 7f5427c7b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f542006b450 con 0x7f542009ad70 2023-10-03T10:12:00.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.268+0000 7f5425216700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f542009ad70 0x7f542009e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.268+0000 7f5425a17700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f542009d780 0x7f542009db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.268+0000 7f5426218700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5420133a80 0x7f5420133ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.268+0000 7f5425a17700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f542009d780 0x7f542009db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33332/0 (socket says 172.21.15.146:33332) 2023-10-03T10:12:00.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.268+0000 7f5425216700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f542009ad70 0x7f542009e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46028/0 (socket says 172.21.15.146:46028) 2023-10-03T10:12:00.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.269+0000 7f5425a17700 1 -- 172.21.15.146:0/3947360861 learned_addr learned my addr 172.21.15.146:0/3947360861 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:00.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.269+0000 7f5425a17700 1 -- 172.21.15.146:0/3947360861 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f542009ad70 msgr2=0x7f542009e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:00.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.269+0000 7f5425a17700 1 --2- 172.21.15.146:0/3947360861 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f542009ad70 0x7f542009e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.269+0000 7f5425a17700 1 -- 172.21.15.146:0/3947360861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5420133a80 msgr2=0x7f5420133ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:00.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.269+0000 7f5425a17700 1 --2- 172.21.15.146:0/3947360861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5420133a80 0x7f5420133ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.269+0000 7f5425a17700 1 -- 172.21.15.146:0/3947360861 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542006a9e0 con 0x7f542009d780 2023-10-03T10:12:00.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.269+0000 7f5426218700 1 --2- 172.21.15.146:0/3947360861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5420133a80 0x7f5420133ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:00.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.269+0000 7f5425a17700 1 --2- 172.21.15.146:0/3947360861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542009d780 0x7f542009db50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f54100098f0 tx=0x7f5410009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2caa864c2c28d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:00.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.269+0000 7f5424a15700 1 -- 172.21.15.146:0/3947360861 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5410011830 con 0x7f542009d780 2023-10-03T10:12:00.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.269+0000 7f5424a15700 1 -- 172.21.15.146:0/3947360861 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5410011990 con 0x7f542009d780 2023-10-03T10:12:00.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.269+0000 7f5424a15700 1 -- 172.21.15.146:0/3947360861 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5410011d20 con 0x7f542009d780 2023-10-03T10:12:00.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.270+0000 7f5427c7b700 1 -- 172.21.15.146:0/3947360861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542009d780 msgr2=0x7f542009db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.270+0000 7f5427c7b700 1 --2- 172.21.15.146:0/3947360861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542009d780 0x7f542009db50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f54100098f0 tx=0x7f5410009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:00.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.270+0000 7f5427c7b700 1 -- 172.21.15.146:0/3947360861 shutdown_connections 2023-10-03T10:12:00.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.270+0000 7f5427c7b700 1 --2- 172.21.15.146:0/3947360861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5420133a80 0x7f5420133ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.270+0000 7f5427c7b700 1 --2- 172.21.15.146:0/3947360861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542009d780 0x7f542009db50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.270+0000 7f5427c7b700 1 --2- 172.21.15.146:0/3947360861 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f542009ad70 0x7f542009e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.270+0000 7f5427c7b700 1 -- 172.21.15.146:0/3947360861 >> 172.21.15.146:0/3947360861 conn(0x7f542009f980 msgr2=0x7f542009fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:00.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.270+0000 7f5427c7b700 1 -- 172.21.15.146:0/3947360861 shutdown_connections 2023-10-03T10:12:00.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.270+0000 7f5427c7b700 1 -- 172.21.15.146:0/3947360861 wait complete. 2023-10-03T10:12:00.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.271+0000 7f5427c7b700 1 Processor -- start 2023-10-03T10:12:00.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.271+0000 7f5427c7b700 1 -- start start 2023-10-03T10:12:00.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.271+0000 7f5427c7b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542009ad70 0x7f542011e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.271+0000 7f5427c7b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f542009d780 0x7f542011e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.271+0000 7f5427c7b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5420133a80 0x7f542011eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.271+0000 7f5427c7b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5420122590 con 0x7f542009ad70 2023-10-03T10:12:00.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.271+0000 7f5427c7b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5420121bd0 con 0x7f5420133a80 2023-10-03T10:12:00.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.271+0000 7f5427c7b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54200a28c0 con 0x7f542009d780 2023-10-03T10:12:00.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.271+0000 7f5425a17700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542009ad70 0x7f542011e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.271+0000 7f5426218700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5420133a80 0x7f542011eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.271+0000 7f5425216700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f542009d780 0x7f542011e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.271+0000 7f5425a17700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542009ad70 0x7f542011e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33346/0 (socket says 172.21.15.146:33346) 2023-10-03T10:12:00.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.271+0000 7f5425a17700 1 -- 172.21.15.146:0/2472024684 learned_addr learned my addr 172.21.15.146:0/2472024684 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:00.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.271+0000 7f5425a17700 1 -- 172.21.15.146:0/2472024684 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f542009d780 msgr2=0x7f542011e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.271+0000 7f5425a17700 1 --2- 172.21.15.146:0/2472024684 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f542009d780 0x7f542011e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.271+0000 7f5425a17700 1 -- 172.21.15.146:0/2472024684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5420133a80 msgr2=0x7f542011eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.271+0000 7f5425a17700 1 --2- 172.21.15.146:0/2472024684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5420133a80 0x7f542011eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.271+0000 7f5425a17700 1 -- 172.21.15.146:0/2472024684 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5418009a70 con 0x7f542009ad70 2023-10-03T10:12:00.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.271+0000 7f5425216700 1 --2- 172.21.15.146:0/2472024684 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f542009d780 0x7f542011e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:00.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.271+0000 7f5426218700 1 --2- 172.21.15.146:0/2472024684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5420133a80 0x7f542011eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:00.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.272+0000 7f5425a17700 1 --2- 172.21.15.146:0/2472024684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542009ad70 0x7f542011e100 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5410000c00 tx=0x7f5410004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:00.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.272+0000 7f54167fc700 1 -- 172.21.15.146:0/2472024684 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5410004240 con 0x7f542009ad70 2023-10-03T10:12:00.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.272+0000 7f54167fc700 1 -- 172.21.15.146:0/2472024684 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541001f070 con 0x7f542009ad70 2023-10-03T10:12:00.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.272+0000 7f5427c7b700 1 -- 172.21.15.146:0/2472024684 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5410009550 con 0x7f542009ad70 2023-10-03T10:12:00.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.272+0000 7f54167fc700 1 -- 172.21.15.146:0/2472024684 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54100045c0 con 0x7f542009ad70 2023-10-03T10:12:00.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.272+0000 7f5427c7b700 1 -- 172.21.15.146:0/2472024684 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542009c710 con 0x7f542009ad70 2023-10-03T10:12:00.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.273+0000 7f54167fc700 1 -- 172.21.15.146:0/2472024684 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5410021030 con 0x7f542009ad70 2023-10-03T10:12:00.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.273+0000 7f54167fc700 1 -- 172.21.15.146:0/2472024684 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f5410040c40 con 0x7f542009ad70 2023-10-03T10:12:00.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.273+0000 7f5427c7b700 1 -- 172.21.15.146:0/2472024684 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5420121750 con 0x7f542009ad70 2023-10-03T10:12:00.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.277+0000 7f54167fc700 1 -- 172.21.15.146:0/2472024684 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5420121750 con 0x7f542009ad70 2023-10-03T10:12:00.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.465+0000 7f5427c7b700 1 -- 172.21.15.146:0/2472024684 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f542011fd20 con 0x7f542009ad70 2023-10-03T10:12:00.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.466+0000 7f54167fc700 1 -- 172.21.15.146:0/2472024684 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5410015070 con 0x7f542009ad70 2023-10-03T10:12:00.467 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-03T10:12:00.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.468+0000 7f5427c7b700 1 -- 172.21.15.146:0/2472024684 >> v1:172.21.15.146:6816/126749 conn(0x7f540402f510 legacy=0x7f54040319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.468+0000 7f5427c7b700 1 -- 172.21.15.146:0/2472024684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542009ad70 msgr2=0x7f542011e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.468+0000 7f5427c7b700 1 --2- 172.21.15.146:0/2472024684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542009ad70 0x7f542011e100 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5410000c00 tx=0x7f5410004750 comp rx=0 tx=0).stop 2023-10-03T10:12:00.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.468+0000 7f5427c7b700 1 -- 172.21.15.146:0/2472024684 shutdown_connections 2023-10-03T10:12:00.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.468+0000 7f5427c7b700 1 --2- 172.21.15.146:0/2472024684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5420133a80 0x7f542011eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.468+0000 7f5427c7b700 1 --2- 172.21.15.146:0/2472024684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542009ad70 0x7f542011e100 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.468+0000 7f5427c7b700 1 --2- 172.21.15.146:0/2472024684 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f542009d780 0x7f542011e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.468+0000 7f5427c7b700 1 -- 172.21.15.146:0/2472024684 >> 172.21.15.146:0/2472024684 conn(0x7f542009f980 msgr2=0x7f54201330d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:00.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.468+0000 7f5427c7b700 1 -- 172.21.15.146:0/2472024684 shutdown_connections 2023-10-03T10:12:00.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.468+0000 7f5427c7b700 1 -- 172.21.15.146:0/2472024684 wait complete. 2023-10-03T10:12:00.481 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:12:00.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.601+0000 7f8c12d7b700 1 Processor -- start 2023-10-03T10:12:00.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.601+0000 7f8c12d7b700 1 -- start start 2023-10-03T10:12:00.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.601+0000 7f8c12d7b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8c0c131980 0x7f8c0c131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.601+0000 7f8c12d7b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c0c09bc70 0x7f8c0c09c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.602+0000 7f8c12d7b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0c0a1640 con 0x7f8c0c09c5c0 2023-10-03T10:12:00.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.602+0000 7f8c12d7b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0c06eb30 con 0x7f8c0c131980 2023-10-03T10:12:00.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.602+0000 7f8c12d7b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c0a22d0 con 0x7f8c0c09bc70 2023-10-03T10:12:00.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.602+0000 7f8c10b17700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8c0c131980 0x7f8c0c131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.602+0000 7f8c0bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c0c09bc70 0x7f8c0c09c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.602+0000 7f8c11318700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8c0c09c5c0 0x7f8c0c138700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40790/0 (socket says 172.21.15.146:40790) 2023-10-03T10:12:00.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.602+0000 7f8c11318700 1 -- 172.21.15.146:0/1887498734 learned_addr learned my addr 172.21.15.146:0/1887498734 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:00.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.602+0000 7f8c10b17700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8c0c131980 0x7f8c0c131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33358/0 (socket says 172.21.15.146:33358) 2023-10-03T10:12:00.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.602+0000 7f8c0bfff700 1 -- 172.21.15.146:0/1887498734 >> v2:172.21.15.146:3300/0 conn(0x7f8c0c131980 msgr2=0x7f8c0c131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:00.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.602+0000 7f8c0bfff700 1 --2- 172.21.15.146:0/1887498734 >> v2:172.21.15.146:3300/0 conn(0x7f8c0c131980 0x7f8c0c131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.602+0000 7f8c0bfff700 1 -- 172.21.15.146:0/1887498734 >> v1:172.21.15.146:6789/0 conn(0x7f8c0c09c5c0 legacy=0x7f8c0c138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.602+0000 7f8c0bfff700 1 -- 172.21.15.146:0/1887498734 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c131550 con 0x7f8c0c09bc70 2023-10-03T10:12:00.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.602+0000 7f8c0b7fe700 1 -- 172.21.15.146:0/1887498734 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2366701543 0 0) 0x7f8c0c0a1640 con 0x7f8c0c09c5c0 2023-10-03T10:12:00.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.602+0000 7f8c10b17700 1 --2- 172.21.15.146:0/1887498734 >> v2:172.21.15.146:3300/0 conn(0x7f8c0c131980 0x7f8c0c131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:00.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.602+0000 7f8c0bfff700 1 --2- 172.21.15.146:0/1887498734 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c0c09bc70 0x7f8c0c09c080 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8009840 tx=0x7f8bf8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74631f07dd89cff1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:00.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.602+0000 7f8c0b7fe700 1 -- 172.21.15.146:0/1887498734 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8011830 con 0x7f8c0c09bc70 2023-10-03T10:12:00.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.602+0000 7f8c0b7fe700 1 -- 172.21.15.146:0/1887498734 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf8011990 con 0x7f8c0c09bc70 2023-10-03T10:12:00.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.602+0000 7f8c0b7fe700 1 -- 172.21.15.146:0/1887498734 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8011d20 con 0x7f8c0c09bc70 2023-10-03T10:12:00.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.603+0000 7f8c12d7b700 1 -- 172.21.15.146:0/1887498734 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c0c09bc70 msgr2=0x7f8c0c09c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.603+0000 7f8c12d7b700 1 --2- 172.21.15.146:0/1887498734 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c0c09bc70 0x7f8c0c09c080 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8009840 tx=0x7f8bf8009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:00.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.603+0000 7f8c12d7b700 1 -- 172.21.15.146:0/1887498734 shutdown_connections 2023-10-03T10:12:00.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.603+0000 7f8c12d7b700 1 --2- 172.21.15.146:0/1887498734 >> v2:172.21.15.146:3300/0 conn(0x7f8c0c131980 0x7f8c0c131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.603+0000 7f8c12d7b700 1 --2- 172.21.15.146:0/1887498734 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c0c09bc70 0x7f8c0c09c080 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.603+0000 7f8c12d7b700 1 -- 172.21.15.146:0/1887498734 >> 172.21.15.146:0/1887498734 conn(0x7f8c0c0a2980 msgr2=0x7f8c0c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:00.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.603+0000 7f8c12d7b700 1 -- 172.21.15.146:0/1887498734 shutdown_connections 2023-10-03T10:12:00.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.603+0000 7f8c12d7b700 1 -- 172.21.15.146:0/1887498734 wait complete. 2023-10-03T10:12:00.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.604+0000 7f8c12d7b700 1 Processor -- start 2023-10-03T10:12:00.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.604+0000 7f8c12d7b700 1 -- start start 2023-10-03T10:12:00.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.605+0000 7f8c12d7b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c0c09bc70 0x7f8c0c119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.605+0000 7f8c12d7b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c0c09c5c0 0x7f8c0c119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.605+0000 7f8c12d7b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c0c131980 0x7f8c0c11a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.605+0000 7f8c12d7b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c11da20 con 0x7f8c0c09c5c0 2023-10-03T10:12:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.605+0000 7f8c12d7b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c11b150 con 0x7f8c0c09bc70 2023-10-03T10:12:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.605+0000 7f8c12d7b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c11c3a0 con 0x7f8c0c131980 2023-10-03T10:12:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.605+0000 7f8c0bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c0c09c5c0 0x7f8c0c119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.605+0000 7f8c10b17700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c0c09bc70 0x7f8c0c119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.605+0000 7f8c0bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c0c09c5c0 0x7f8c0c119ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33370/0 (socket says 172.21.15.146:33370) 2023-10-03T10:12:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.605+0000 7f8c0bfff700 1 -- 172.21.15.146:0/2009064197 learned_addr learned my addr 172.21.15.146:0/2009064197 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.605+0000 7f8c11318700 1 --2- 172.21.15.146:0/2009064197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c0c131980 0x7f8c0c11a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.605+0000 7f8c0bfff700 1 -- 172.21.15.146:0/2009064197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c0c131980 msgr2=0x7f8c0c11a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.605+0000 7f8c0bfff700 1 --2- 172.21.15.146:0/2009064197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c0c131980 0x7f8c0c11a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.605+0000 7f8c0bfff700 1 -- 172.21.15.146:0/2009064197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c0c09bc70 msgr2=0x7f8c0c119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.605+0000 7f8c0bfff700 1 --2- 172.21.15.146:0/2009064197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c0c09bc70 0x7f8c0c119590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.605+0000 7f8c0bfff700 1 -- 172.21.15.146:0/2009064197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c00009430 con 0x7f8c0c09c5c0 2023-10-03T10:12:00.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.605+0000 7f8c0bfff700 1 --2- 172.21.15.146:0/2009064197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c0c09c5c0 0x7f8c0c119ad0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80090b0 tx=0x7f8bf8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:00.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.606+0000 7f8c097fa700 1 -- 172.21.15.146:0/2009064197 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8004550 con 0x7f8c0c09c5c0 2023-10-03T10:12:00.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.606+0000 7f8c097fa700 1 -- 172.21.15.146:0/2009064197 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf801f070 con 0x7f8c0c09c5c0 2023-10-03T10:12:00.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.606+0000 7f8c12d7b700 1 -- 172.21.15.146:0/2009064197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf80094a0 con 0x7f8c0c09c5c0 2023-10-03T10:12:00.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.606+0000 7f8c097fa700 1 -- 172.21.15.146:0/2009064197 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf80038e0 con 0x7f8c0c09c5c0 2023-10-03T10:12:00.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.606+0000 7f8c12d7b700 1 -- 172.21.15.146:0/2009064197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0c11c7f0 con 0x7f8c0c09c5c0 2023-10-03T10:12:00.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.606+0000 7f8c097fa700 1 -- 172.21.15.146:0/2009064197 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8bf8003a40 con 0x7f8c0c09c5c0 2023-10-03T10:12:00.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.606+0000 7f8c097fa700 1 -- 172.21.15.146:0/2009064197 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f8bf8021070 con 0x7f8c0c09c5c0 2023-10-03T10:12:00.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.607+0000 7f8c12d7b700 1 -- 172.21.15.146:0/2009064197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0c130940 con 0x7f8c0c09c5c0 2023-10-03T10:12:00.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.611+0000 7f8c097fa700 1 -- 172.21.15.146:0/2009064197 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8bf801a430 con 0x7f8c0c09c5c0 2023-10-03T10:12:00.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.837+0000 7f8c12d7b700 1 -- 172.21.15.146:0/2009064197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c0c0a1c40 con 0x7f8c0c09c5c0 2023-10-03T10:12:00.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.838+0000 7f8c097fa700 1 -- 172.21.15.146:0/2009064197 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2317 (secure 0 0 0) 0x7f8bf802b070 con 0x7f8c0c09c5c0 2023-10-03T10:12:00.839 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:12:00.839 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:48.718228+0000","modified":"2023-10-03T10:10:12.083527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4181":{"gid":4181,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6817/4164614194","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6817","nonce":4164614194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T10:12:00.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.840+0000 7f8c12d7b700 1 -- 172.21.15.146:0/2009064197 >> v1:172.21.15.146:6816/126749 conn(0x7f8bf002f510 legacy=0x7f8bf00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.840+0000 7f8c12d7b700 1 -- 172.21.15.146:0/2009064197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c0c09c5c0 msgr2=0x7f8c0c119ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.840+0000 7f8c12d7b700 1 --2- 172.21.15.146:0/2009064197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c0c09c5c0 0x7f8c0c119ad0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80090b0 tx=0x7f8bf8004750 comp rx=0 tx=0).stop 2023-10-03T10:12:00.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.840+0000 7f8c12d7b700 1 -- 172.21.15.146:0/2009064197 shutdown_connections 2023-10-03T10:12:00.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.840+0000 7f8c12d7b700 1 --2- 172.21.15.146:0/2009064197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c0c131980 0x7f8c0c11a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.840+0000 7f8c12d7b700 1 --2- 172.21.15.146:0/2009064197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c0c09bc70 0x7f8c0c119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.840+0000 7f8c12d7b700 1 --2- 172.21.15.146:0/2009064197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c0c09c5c0 0x7f8c0c119ad0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.840+0000 7f8c12d7b700 1 -- 172.21.15.146:0/2009064197 >> 172.21.15.146:0/2009064197 conn(0x7f8c0c0a2980 msgr2=0x7f8c0c12e630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:00.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.840+0000 7f8c12d7b700 1 -- 172.21.15.146:0/2009064197 shutdown_connections 2023-10-03T10:12:00.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.840+0000 7f8c12d7b700 1 -- 172.21.15.146:0/2009064197 wait complete. 2023-10-03T10:12:00.842 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 7 2023-10-03T10:12:00.853 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:00.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.972+0000 7f2073385700 1 Processor -- start 2023-10-03T10:12:00.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.972+0000 7f2073385700 1 -- start start 2023-10-03T10:12:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.973+0000 7f2073385700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f206c133ad0 0x7f206c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.973+0000 7f2073385700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f206c1300a0 0x7f206c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.973+0000 7f2073385700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f206c06b2d0 con 0x7f206c1309f0 2023-10-03T10:12:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.973+0000 7f2073385700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f206c133610 con 0x7f206c133ad0 2023-10-03T10:12:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.973+0000 7f2073385700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f206c09a500 con 0x7f206c1300a0 2023-10-03T10:12:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.973+0000 7f2071121700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f206c133ad0 0x7f206c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.973+0000 7f2070920700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f206c1300a0 0x7f206c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.973+0000 7f2070920700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f206c1300a0 0x7f206c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46068/0 (socket says 172.21.15.146:46068) 2023-10-03T10:12:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.973+0000 7f2071121700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f206c133ad0 0x7f206c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33374/0 (socket says 172.21.15.146:33374) 2023-10-03T10:12:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.973+0000 7f2070920700 1 -- 172.21.15.146:0/3001252357 learned_addr learned my addr 172.21.15.146:0/3001252357 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.973+0000 7f2071922700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f206c1309f0 0x7f206c13a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40796/0 (socket says 172.21.15.146:40796) 2023-10-03T10:12:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.973+0000 7f2070920700 1 -- 172.21.15.146:0/3001252357 >> v2:172.21.15.146:3300/0 conn(0x7f206c133ad0 msgr2=0x7f206c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:00.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.973+0000 7f2070920700 1 --2- 172.21.15.146:0/3001252357 >> v2:172.21.15.146:3300/0 conn(0x7f206c133ad0 0x7f206c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.973+0000 7f2070920700 1 -- 172.21.15.146:0/3001252357 >> v1:172.21.15.146:6789/0 conn(0x7f206c1309f0 legacy=0x7f206c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.973+0000 7f2070920700 1 -- 172.21.15.146:0/3001252357 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c1338b0 con 0x7f206c1300a0 2023-10-03T10:12:00.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.973+0000 7f2063fff700 1 -- 172.21.15.146:0/3001252357 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244814021 0 0) 0x7f206c06b2d0 con 0x7f206c1309f0 2023-10-03T10:12:00.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.973+0000 7f2071121700 1 --2- 172.21.15.146:0/3001252357 >> v2:172.21.15.146:3300/0 conn(0x7f206c133ad0 0x7f206c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:00.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.974+0000 7f2070920700 1 --2- 172.21.15.146:0/3001252357 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f206c1300a0 0x7f206c1304b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f20680098f0 tx=0x7f2068009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b06bcc7928cdc821 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:00.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.974+0000 7f2063fff700 1 -- 172.21.15.146:0/3001252357 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2068011830 con 0x7f206c1300a0 2023-10-03T10:12:00.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.974+0000 7f2063fff700 1 -- 172.21.15.146:0/3001252357 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2068011990 con 0x7f206c1300a0 2023-10-03T10:12:00.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.974+0000 7f2063fff700 1 -- 172.21.15.146:0/3001252357 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2068011d20 con 0x7f206c1300a0 2023-10-03T10:12:00.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.974+0000 7f2073385700 1 -- 172.21.15.146:0/3001252357 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f206c1300a0 msgr2=0x7f206c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.974+0000 7f2073385700 1 --2- 172.21.15.146:0/3001252357 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f206c1300a0 0x7f206c1304b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f20680098f0 tx=0x7f2068009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:00.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.974+0000 7f2073385700 1 -- 172.21.15.146:0/3001252357 shutdown_connections 2023-10-03T10:12:00.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.974+0000 7f2073385700 1 --2- 172.21.15.146:0/3001252357 >> v2:172.21.15.146:3300/0 conn(0x7f206c133ad0 0x7f206c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.974+0000 7f2073385700 1 --2- 172.21.15.146:0/3001252357 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f206c1300a0 0x7f206c1304b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.974+0000 7f2073385700 1 -- 172.21.15.146:0/3001252357 >> 172.21.15.146:0/3001252357 conn(0x7f206c099c40 msgr2=0x7f206c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:00.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.974+0000 7f2073385700 1 -- 172.21.15.146:0/3001252357 shutdown_connections 2023-10-03T10:12:00.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.974+0000 7f2073385700 1 -- 172.21.15.146:0/3001252357 wait complete. 2023-10-03T10:12:00.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.975+0000 7f2073385700 1 Processor -- start 2023-10-03T10:12:00.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.975+0000 7f2073385700 1 -- start start 2023-10-03T10:12:00.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.976+0000 7f2073385700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f206c1300a0 0x7f206c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.976+0000 7f2073385700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f206c1309f0 0x7f206c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.976+0000 7f2073385700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f206c133ad0 0x7f206c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.976+0000 7f2073385700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c11fe30 con 0x7f206c1309f0 2023-10-03T10:12:00.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.976+0000 7f2073385700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206c120010 con 0x7f206c1300a0 2023-10-03T10:12:00.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.976+0000 7f2073385700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f206c11eb60 con 0x7f206c133ad0 2023-10-03T10:12:00.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.976+0000 7f2070920700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f206c1309f0 0x7f206c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.976+0000 7f2070920700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f206c1309f0 0x7f206c11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33384/0 (socket says 172.21.15.146:33384) 2023-10-03T10:12:00.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.976+0000 7f2071121700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f206c1300a0 0x7f206c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.976+0000 7f2070920700 1 -- 172.21.15.146:0/1906813753 learned_addr learned my addr 172.21.15.146:0/1906813753 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:00.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.976+0000 7f2071922700 1 --2- 172.21.15.146:0/1906813753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f206c133ad0 0x7f206c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.976+0000 7f2070920700 1 -- 172.21.15.146:0/1906813753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f206c133ad0 msgr2=0x7f206c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.976+0000 7f2070920700 1 --2- 172.21.15.146:0/1906813753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f206c133ad0 0x7f206c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.976+0000 7f2070920700 1 -- 172.21.15.146:0/1906813753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f206c1300a0 msgr2=0x7f206c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.976+0000 7f2070920700 1 --2- 172.21.15.146:0/1906813753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f206c1300a0 0x7f206c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.976+0000 7f2070920700 1 -- 172.21.15.146:0/1906813753 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c0094a0 con 0x7f206c1309f0 2023-10-03T10:12:00.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.976+0000 7f2070920700 1 --2- 172.21.15.146:0/1906813753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f206c1309f0 0x7f206c11df80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2068009130 tx=0x7f2068004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:00.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.976+0000 7f2061ffb700 1 -- 172.21.15.146:0/1906813753 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2068004510 con 0x7f206c1309f0 2023-10-03T10:12:00.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.976+0000 7f2061ffb700 1 -- 172.21.15.146:0/1906813753 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206801e070 con 0x7f206c1309f0 2023-10-03T10:12:00.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.976+0000 7f2073385700 1 -- 172.21.15.146:0/1906813753 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2068009550 con 0x7f206c1309f0 2023-10-03T10:12:00.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.976+0000 7f2061ffb700 1 -- 172.21.15.146:0/1906813753 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20680038c0 con 0x7f206c1309f0 2023-10-03T10:12:00.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.977+0000 7f2073385700 1 -- 172.21.15.146:0/1906813753 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f206c12dd60 con 0x7f206c1309f0 2023-10-03T10:12:00.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.977+0000 7f2061ffb700 1 -- 172.21.15.146:0/1906813753 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2068003a20 con 0x7f206c1309f0 2023-10-03T10:12:00.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.977+0000 7f2061ffb700 1 -- 172.21.15.146:0/1906813753 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f2068040aa0 con 0x7f206c1309f0 2023-10-03T10:12:00.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.977+0000 7f2073385700 1 -- 172.21.15.146:0/1906813753 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f206c04f2a0 con 0x7f206c1309f0 2023-10-03T10:12:00.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:00.982+0000 7f2061ffb700 1 -- 172.21.15.146:0/1906813753 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2068015020 con 0x7f206c1309f0 2023-10-03T10:12:01.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.166+0000 7f2073385700 1 -- 172.21.15.146:0/1906813753 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f206c12d950 con 0x7f206c1309f0 2023-10-03T10:12:01.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.167+0000 7f2061ffb700 1 -- 172.21.15.146:0/1906813753 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+12945 (secure 0 0 0) 0x7f2068003cd0 con 0x7f206c1309f0 2023-10-03T10:12:01.168 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:12:01.168 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":22,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:11:54.330846+0000","last_up_change":"2023-10-03T10:09:42.301022+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":118758}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":118758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":118758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":118758}]},"public_addr":"172.21.15.146:6800/118758","cluster_addr":"172.21.15.146:6801/118758","heartbeat_back_addr":"172.21.15.146:6803/118758","heartbeat_front_addr":"172.21.15.146:6802/118758","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":118774}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":118774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":118774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":118774}]},"public_addr":"172.21.15.146:6804/118774","cluster_addr":"172.21.15.146:6806/118774","heartbeat_back_addr":"172.21.15.146:6810/118774","heartbeat_front_addr":"172.21.15.146:6808/118774","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":118775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":118775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":118775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":118775}]},"public_addr":"172.21.15.146:6805/118775","cluster_addr":"172.21.15.146:6807/118775","heartbeat_back_addr":"172.21.15.146:6811/118775","heartbeat_front_addr":"172.21.15.146:6809/118775","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":118776}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":118776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":118776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":118776}]},"public_addr":"172.21.15.146:6812/118776","cluster_addr":"172.21.15.146:6813/118776","heartbeat_back_addr":"172.21.15.146:6815/118776","heartbeat_front_addr":"172.21.15.146:6814/118776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:0/45915595":"2023-10-04T10:11:52.317723+0000","172.21.15.146:0/1896339219":"2023-10-04T10:11:52.317723+0000","172.21.15.146:6816/118159":"2023-10-04T10:11:52.317723+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:01.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.169+0000 7f2073385700 1 -- 172.21.15.146:0/1906813753 >> v1:172.21.15.146:6816/126749 conn(0x7f205002f510 legacy=0x7f20500319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.169+0000 7f2073385700 1 -- 172.21.15.146:0/1906813753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f206c1309f0 msgr2=0x7f206c11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.169+0000 7f2073385700 1 --2- 172.21.15.146:0/1906813753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f206c1309f0 0x7f206c11df80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2068009130 tx=0x7f2068004750 comp rx=0 tx=0).stop 2023-10-03T10:12:01.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.169+0000 7f2073385700 1 -- 172.21.15.146:0/1906813753 shutdown_connections 2023-10-03T10:12:01.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.169+0000 7f2073385700 1 --2- 172.21.15.146:0/1906813753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f206c133ad0 0x7f206c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.169+0000 7f2073385700 1 --2- 172.21.15.146:0/1906813753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f206c1300a0 0x7f206c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.169+0000 7f2073385700 1 --2- 172.21.15.146:0/1906813753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f206c1309f0 0x7f206c11df80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.169+0000 7f2073385700 1 -- 172.21.15.146:0/1906813753 >> 172.21.15.146:0/1906813753 conn(0x7f206c099c40 msgr2=0x7f206c12e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.169+0000 7f2073385700 1 -- 172.21.15.146:0/1906813753 shutdown_connections 2023-10-03T10:12:01.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.169+0000 7f2073385700 1 -- 172.21.15.146:0/1906813753 wait complete. 2023-10-03T10:12:01.182 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:12:01.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.302+0000 7f108adfd700 1 Processor -- start 2023-10-03T10:12:01.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.302+0000 7f108adfd700 1 -- start start 2023-10-03T10:12:01.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.303+0000 7f108adfd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1084133a70 0x7f1084133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.303+0000 7f108adfd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f10840a08e0 0x7f10840a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.303+0000 7f108adfd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1084133640 con 0x7f10840a1290 2023-10-03T10:12:01.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.303+0000 7f108adfd700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10840a1d50 con 0x7f10840a08e0 2023-10-03T10:12:01.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.303+0000 7f108adfd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108409b620 con 0x7f1084133a70 2023-10-03T10:12:01.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.303+0000 7f1088b99700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1084133a70 0x7f1084133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.303+0000 7f108939a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f10840a1290 0x7f108413a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40808/0 (socket says 172.21.15.146:40808) 2023-10-03T10:12:01.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.303+0000 7f1088b99700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1084133a70 0x7f1084133e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59718/0 (socket says 172.21.15.146:59718) 2023-10-03T10:12:01.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.303+0000 7f108939a700 1 -- 172.21.15.146:0/550078010 learned_addr learned my addr 172.21.15.146:0/550078010 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:01.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.303+0000 7f1083fff700 1 --2- 172.21.15.146:0/550078010 >> v2:172.21.15.146:3300/0 conn(0x7f10840a08e0 0x7f10840a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.303+0000 7f10837fe700 1 -- 172.21.15.146:0/550078010 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380974830 0 0) 0x7f1084133640 con 0x7f10840a1290 2023-10-03T10:12:01.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.303+0000 7f10837fe700 1 -- 172.21.15.146:0/550078010 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10740035b0 con 0x7f10840a1290 2023-10-03T10:12:01.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.303+0000 7f1088b99700 1 -- 172.21.15.146:0/550078010 >> v2:172.21.15.146:3300/0 conn(0x7f10840a08e0 msgr2=0x7f10840a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:01.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.303+0000 7f1088b99700 1 --2- 172.21.15.146:0/550078010 >> v2:172.21.15.146:3300/0 conn(0x7f10840a08e0 0x7f10840a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.303+0000 7f1088b99700 1 -- 172.21.15.146:0/550078010 >> v1:172.21.15.146:6789/0 conn(0x7f10840a1290 legacy=0x7f108413a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.303+0000 7f1088b99700 1 -- 172.21.15.146:0/550078010 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1084133870 con 0x7f1084133a70 2023-10-03T10:12:01.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.303+0000 7f1083fff700 1 --2- 172.21.15.146:0/550078010 >> v2:172.21.15.146:3300/0 conn(0x7f10840a08e0 0x7f10840a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:01.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.303+0000 7f1088b99700 1 --2- 172.21.15.146:0/550078010 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1084133a70 0x7f1084133e40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1078009820 tx=0x7f1078009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82658c47a8257477 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:01.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.303+0000 7f10837fe700 1 -- 172.21.15.146:0/550078010 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1078005e30 con 0x7f1084133a70 2023-10-03T10:12:01.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.303+0000 7f10837fe700 1 -- 172.21.15.146:0/550078010 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1078006030 con 0x7f1084133a70 2023-10-03T10:12:01.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.303+0000 7f10837fe700 1 -- 172.21.15.146:0/550078010 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10780063c0 con 0x7f1084133a70 2023-10-03T10:12:01.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.304+0000 7f108adfd700 1 -- 172.21.15.146:0/550078010 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1084133a70 msgr2=0x7f1084133e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.304+0000 7f108adfd700 1 --2- 172.21.15.146:0/550078010 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1084133a70 0x7f1084133e40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1078009820 tx=0x7f1078009b30 comp rx=0 tx=0).stop 2023-10-03T10:12:01.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.304+0000 7f108adfd700 1 -- 172.21.15.146:0/550078010 shutdown_connections 2023-10-03T10:12:01.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.304+0000 7f108adfd700 1 --2- 172.21.15.146:0/550078010 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1084133a70 0x7f1084133e40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.304+0000 7f108adfd700 1 --2- 172.21.15.146:0/550078010 >> v2:172.21.15.146:3300/0 conn(0x7f10840a08e0 0x7f10840a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.304+0000 7f108adfd700 1 -- 172.21.15.146:0/550078010 >> 172.21.15.146:0/550078010 conn(0x7f10840a2980 msgr2=0x7f10840a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.304+0000 7f108adfd700 1 -- 172.21.15.146:0/550078010 shutdown_connections 2023-10-03T10:12:01.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.304+0000 7f108adfd700 1 -- 172.21.15.146:0/550078010 wait complete. 2023-10-03T10:12:01.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.305+0000 7f108adfd700 1 Processor -- start 2023-10-03T10:12:01.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.305+0000 7f108adfd700 1 -- start start 2023-10-03T10:12:01.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f108adfd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10840a08e0 0x7f10841c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f108adfd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f10840a1290 0x7f10841c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f108adfd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1084133a70 0x7f10841c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f108adfd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108411e4c0 con 0x7f10840a08e0 2023-10-03T10:12:01.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f108adfd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108411dcb0 con 0x7f1084133a70 2023-10-03T10:12:01.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f108adfd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f108411f580 con 0x7f10840a1290 2023-10-03T10:12:01.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f108939a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1084133a70 0x7f10841c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f1083fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f10840a1290 0x7f10841c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f1083fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f10840a1290 0x7f10841c84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46084/0 (socket says 172.21.15.146:46084) 2023-10-03T10:12:01.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f108939a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1084133a70 0x7f10841c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59726/0 (socket says 172.21.15.146:59726) 2023-10-03T10:12:01.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f1083fff700 1 -- 172.21.15.146:0/3054579655 learned_addr learned my addr 172.21.15.146:0/3054579655 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:01.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f1088b99700 1 --2- 172.21.15.146:0/3054579655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10840a08e0 0x7f10841c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f108939a700 1 -- 172.21.15.146:0/3054579655 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f10840a1290 msgr2=0x7f10841c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f108939a700 1 --2- 172.21.15.146:0/3054579655 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f10840a1290 0x7f10841c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f108939a700 1 -- 172.21.15.146:0/3054579655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10840a08e0 msgr2=0x7f10841c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f108939a700 1 --2- 172.21.15.146:0/3054579655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10840a08e0 0x7f10841c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f108939a700 1 -- 172.21.15.146:0/3054579655 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10700094a0 con 0x7f1084133a70 2023-10-03T10:12:01.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f1083fff700 1 --2- 172.21.15.146:0/3054579655 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f10840a1290 0x7f10841c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:01.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f1088b99700 1 --2- 172.21.15.146:0/3054579655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10840a08e0 0x7f10841c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:01.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f108939a700 1 --2- 172.21.15.146:0/3054579655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1084133a70 0x7f10841c8a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f107c00cab0 tx=0x7f107c00cdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:01.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f10817fa700 1 -- 172.21.15.146:0/3054579655 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c00a9a0 con 0x7f1084133a70 2023-10-03T10:12:01.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f10817fa700 1 -- 172.21.15.146:0/3054579655 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107c00ab00 con 0x7f1084133a70 2023-10-03T10:12:01.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f10817fa700 1 -- 172.21.15.146:0/3054579655 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c00ae70 con 0x7f1084133a70 2023-10-03T10:12:01.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f108adfd700 1 -- 172.21.15.146:0/3054579655 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1078009430 con 0x7f1084133a70 2023-10-03T10:12:01.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.306+0000 7f108adfd700 1 -- 172.21.15.146:0/3054579655 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1084130ab0 con 0x7f1084133a70 2023-10-03T10:12:01.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.307+0000 7f10817fa700 1 -- 172.21.15.146:0/3054579655 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f107c01b3b0 con 0x7f1084133a70 2023-10-03T10:12:01.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.307+0000 7f10817fa700 1 -- 172.21.15.146:0/3054579655 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f107c03f6e0 con 0x7f1084133a70 2023-10-03T10:12:01.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.307+0000 7f108adfd700 1 -- 172.21.15.146:0/3054579655 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f108409a310 con 0x7f1084133a70 2023-10-03T10:12:01.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.312+0000 7f10817fa700 1 -- 172.21.15.146:0/3054579655 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f107c017070 con 0x7f1084133a70 2023-10-03T10:12:01.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.537+0000 7f108adfd700 1 -- 172.21.15.146:0/3054579655 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f108404f2a0 con 0x7f1084133a70 2023-10-03T10:12:01.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.538+0000 7f10817fa700 1 -- 172.21.15.146:0/3054579655 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2317 (secure 0 0 0) 0x7f107c0192c0 con 0x7f1084133a70 2023-10-03T10:12:01.539 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:12:01.539 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:48.718228+0000","modified":"2023-10-03T10:10:12.083527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4181":{"gid":4181,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6817/4164614194","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6817","nonce":4164614194}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T10:12:01.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.540+0000 7f108adfd700 1 -- 172.21.15.146:0/3054579655 >> v1:172.21.15.146:6816/126749 conn(0x7f106802f510 legacy=0x7f10680319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.540+0000 7f108adfd700 1 -- 172.21.15.146:0/3054579655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1084133a70 msgr2=0x7f10841c8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.540+0000 7f108adfd700 1 --2- 172.21.15.146:0/3054579655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1084133a70 0x7f10841c8a00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f107c00cab0 tx=0x7f107c00cdc0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.540+0000 7f108adfd700 1 -- 172.21.15.146:0/3054579655 shutdown_connections 2023-10-03T10:12:01.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.540+0000 7f108adfd700 1 --2- 172.21.15.146:0/3054579655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1084133a70 0x7f10841c8a00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.540+0000 7f108adfd700 1 --2- 172.21.15.146:0/3054579655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10840a08e0 0x7f10841c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.540+0000 7f108adfd700 1 --2- 172.21.15.146:0/3054579655 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f10840a1290 0x7f10841c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.540+0000 7f108adfd700 1 -- 172.21.15.146:0/3054579655 >> 172.21.15.146:0/3054579655 conn(0x7f10840a2980 msgr2=0x7f10841bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.540+0000 7f108adfd700 1 -- 172.21.15.146:0/3054579655 shutdown_connections 2023-10-03T10:12:01.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.540+0000 7f108adfd700 1 -- 172.21.15.146:0/3054579655 wait complete. 2023-10-03T10:12:01.542 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 7 2023-10-03T10:12:01.653 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T10:09:48.718228+0000', 'modified': '2023-10-03T10:10:12.083527+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4181}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4181': {'gid': 4181, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6817/4164614194', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.146:6817', 'nonce': 4164614194}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-03T10:12:01.654 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T10:12:01.654 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-03T10:12:01.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.775+0000 7ff164473700 1 Processor -- start 2023-10-03T10:12:01.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.775+0000 7ff164473700 1 -- start start 2023-10-03T10:12:01.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.776+0000 7ff164473700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff15c133ad0 0x7ff15c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.776+0000 7ff164473700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff15c130bc0 0x7ff15c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.776+0000 7ff164473700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff15c06b2d0 con 0x7ff15c1300a0 2023-10-03T10:12:01.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.776+0000 7ff164473700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15c133610 con 0x7ff15c133ad0 2023-10-03T10:12:01.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.776+0000 7ff164473700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c09a500 con 0x7ff15c130bc0 2023-10-03T10:12:01.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.776+0000 7ff16220f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff15c133ad0 0x7ff15c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.776+0000 7ff161a0e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff15c1300a0 0x7ff15c1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40816/0 (socket says 172.21.15.146:40816) 2023-10-03T10:12:01.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.776+0000 7ff162a10700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff15c130bc0 0x7ff15c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.776+0000 7ff161a0e700 1 -- 172.21.15.146:0/3804277593 learned_addr learned my addr 172.21.15.146:0/3804277593 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:01.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.776+0000 7ff162a10700 1 -- 172.21.15.146:0/3804277593 >> v2:172.21.15.146:3300/0 conn(0x7ff15c133ad0 msgr2=0x7ff15c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:01.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.776+0000 7ff162a10700 1 --2- 172.21.15.146:0/3804277593 >> v2:172.21.15.146:3300/0 conn(0x7ff15c133ad0 0x7ff15c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.776+0000 7ff162a10700 1 -- 172.21.15.146:0/3804277593 >> v1:172.21.15.146:6789/0 conn(0x7ff15c1300a0 legacy=0x7ff15c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.777+0000 7ff162a10700 1 -- 172.21.15.146:0/3804277593 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15c1338b0 con 0x7ff15c130bc0 2023-10-03T10:12:01.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.777+0000 7ff16220f700 1 --2- 172.21.15.146:0/3804277593 >> v2:172.21.15.146:3300/0 conn(0x7ff15c133ad0 0x7ff15c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:01.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.776+0000 7ff16120d700 1 -- 172.21.15.146:0/3804277593 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298677700 0 0) 0x7ff15c06b2d0 con 0x7ff15c1300a0 2023-10-03T10:12:01.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.777+0000 7ff162a10700 1 --2- 172.21.15.146:0/3804277593 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff15c130bc0 0x7ff15c13b990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff154009d90 tx=0x7ff15400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7314c7f2e682475 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:01.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.777+0000 7ff16120d700 1 -- 172.21.15.146:0/3804277593 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15400e070 con 0x7ff15c130bc0 2023-10-03T10:12:01.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.777+0000 7ff16120d700 1 -- 172.21.15.146:0/3804277593 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15400bb20 con 0x7ff15c130bc0 2023-10-03T10:12:01.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.777+0000 7ff16120d700 1 -- 172.21.15.146:0/3804277593 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154012430 con 0x7ff15c130bc0 2023-10-03T10:12:01.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.777+0000 7ff164473700 1 -- 172.21.15.146:0/3804277593 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff15c130bc0 msgr2=0x7ff15c13b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.777+0000 7ff164473700 1 --2- 172.21.15.146:0/3804277593 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff15c130bc0 0x7ff15c13b990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff154009d90 tx=0x7ff15400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:01.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.777+0000 7ff164473700 1 -- 172.21.15.146:0/3804277593 shutdown_connections 2023-10-03T10:12:01.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.777+0000 7ff164473700 1 --2- 172.21.15.146:0/3804277593 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff15c130bc0 0x7ff15c13b990 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.777+0000 7ff164473700 1 --2- 172.21.15.146:0/3804277593 >> v2:172.21.15.146:3300/0 conn(0x7ff15c133ad0 0x7ff15c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.777+0000 7ff164473700 1 -- 172.21.15.146:0/3804277593 >> 172.21.15.146:0/3804277593 conn(0x7ff15c099c40 msgr2=0x7ff15c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.777+0000 7ff164473700 1 -- 172.21.15.146:0/3804277593 shutdown_connections 2023-10-03T10:12:01.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.777+0000 7ff164473700 1 -- 172.21.15.146:0/3804277593 wait complete. 2023-10-03T10:12:01.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.778+0000 7ff164473700 1 Processor -- start 2023-10-03T10:12:01.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.778+0000 7ff164473700 1 -- start start 2023-10-03T10:12:01.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff164473700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff15c1300a0 0x7ff15c0713b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff164473700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff15c130bc0 0x7ff15c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff164473700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff15c133ad0 0x7ff15c071e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff164473700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c11fec0 con 0x7ff15c1300a0 2023-10-03T10:12:01.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff164473700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c11ee60 con 0x7ff15c130bc0 2023-10-03T10:12:01.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff164473700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c12f680 con 0x7ff15c133ad0 2023-10-03T10:12:01.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff16220f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff15c1300a0 0x7ff15c0713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff162a10700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff15c133ad0 0x7ff15c071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff16220f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff15c1300a0 0x7ff15c0713b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33426/0 (socket says 172.21.15.146:33426) 2023-10-03T10:12:01.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff161a0e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff15c130bc0 0x7ff15c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff16220f700 1 -- 172.21.15.146:0/4208417528 learned_addr learned my addr 172.21.15.146:0/4208417528 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:01.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff16220f700 1 -- 172.21.15.146:0/4208417528 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff15c133ad0 msgr2=0x7ff15c071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff16220f700 1 --2- 172.21.15.146:0/4208417528 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff15c133ad0 0x7ff15c071e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff16220f700 1 -- 172.21.15.146:0/4208417528 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff15c130bc0 msgr2=0x7ff15c0718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff16220f700 1 --2- 172.21.15.146:0/4208417528 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff15c130bc0 0x7ff15c0718f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff16220f700 1 -- 172.21.15.146:0/4208417528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1500094a0 con 0x7ff15c1300a0 2023-10-03T10:12:01.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff162a10700 1 --2- 172.21.15.146:0/4208417528 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff15c133ad0 0x7ff15c071e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:01.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff161a0e700 1 --2- 172.21.15.146:0/4208417528 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff15c130bc0 0x7ff15c0718f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:01.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff16220f700 1 --2- 172.21.15.146:0/4208417528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff15c1300a0 0x7ff15c0713b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff15000ebe0 tx=0x7ff15000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:01.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff14effd700 1 -- 172.21.15.146:0/4208417528 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15000c850 con 0x7ff15c1300a0 2023-10-03T10:12:01.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff14effd700 1 -- 172.21.15.146:0/4208417528 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15000c9b0 con 0x7ff15c1300a0 2023-10-03T10:12:01.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff164473700 1 -- 172.21.15.146:0/4208417528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff154009a70 con 0x7ff15c1300a0 2023-10-03T10:12:01.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.779+0000 7ff14effd700 1 -- 172.21.15.146:0/4208417528 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15000cd40 con 0x7ff15c1300a0 2023-10-03T10:12:01.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.780+0000 7ff164473700 1 -- 172.21.15.146:0/4208417528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15c11f970 con 0x7ff15c1300a0 2023-10-03T10:12:01.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.780+0000 7ff14effd700 1 -- 172.21.15.146:0/4208417528 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff150013470 con 0x7ff15c1300a0 2023-10-03T10:12:01.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.780+0000 7ff14effd700 1 -- 172.21.15.146:0/4208417528 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7ff15003fcf0 con 0x7ff15c1300a0 2023-10-03T10:12:01.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.783+0000 7ff170616b80 1 Processor -- start 2023-10-03T10:12:01.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.783+0000 7ff170616b80 1 -- start start 2023-10-03T10:12:01.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.784+0000 7ff170616b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 0x561db79a9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.784+0000 7ff170616b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 0x561db79a9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.784+0000 7ff170616b80 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 0x561db79bfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.784+0000 7ff170616b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db790bc60 con 0x561db79c5100 2023-10-03T10:12:01.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.784+0000 7ff170616b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x561db7906a10 con 0x561db79a8c50 2023-10-03T10:12:01.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.784+0000 7ff170616b80 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x561db7904210 con 0x561db79bf8f0 2023-10-03T10:12:01.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.784+0000 7ff162a10700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 0x561db79bfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.784+0000 7ff161a0e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 0x561db79a9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.784+0000 7ff162a10700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 0x561db79bfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46104/0 (socket says 172.21.15.146:46104) 2023-10-03T10:12:01.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.784+0000 7ff162a10700 1 -- 172.21.15.146:0/2234898304 learned_addr learned my addr 172.21.15.146:0/2234898304 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:01.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.784+0000 7ff16220f700 1 --2- 172.21.15.146:0/2234898304 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 0x561db79a9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.784+0000 7ff162a10700 1 -- 172.21.15.146:0/2234898304 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 msgr2=0x561db79a9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:01.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.784+0000 7ff162a10700 1 --2- 172.21.15.146:0/2234898304 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 0x561db79a9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.784+0000 7ff162a10700 1 -- 172.21.15.146:0/2234898304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 msgr2=0x561db79a9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:01.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.784+0000 7ff162a10700 1 --2- 172.21.15.146:0/2234898304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 0x561db79a9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.784+0000 7ff162a10700 1 -- 172.21.15.146:0/2234898304 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561db76f3790 con 0x561db79bf8f0 2023-10-03T10:12:01.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.784+0000 7ff161a0e700 1 --2- 172.21.15.146:0/2234898304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 0x561db79a9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:01.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.784+0000 7ff162a10700 1 --2- 172.21.15.146:0/2234898304 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 0x561db79bfd60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff15400b680 tx=0x7ff154010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfc1b835af46058f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:01.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.784+0000 7ff13ffff700 1 -- 172.21.15.146:0/2234898304 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154012680 con 0x561db79bf8f0 2023-10-03T10:12:01.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.784+0000 7ff13ffff700 1 -- 172.21.15.146:0/2234898304 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1540127e0 con 0x561db79bf8f0 2023-10-03T10:12:01.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.784+0000 7ff13ffff700 1 -- 172.21.15.146:0/2234898304 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154012b90 con 0x561db79bf8f0 2023-10-03T10:12:01.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.785+0000 7ff170616b80 1 -- 172.21.15.146:0/2234898304 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 msgr2=0x561db79bfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.785+0000 7ff170616b80 1 --2- 172.21.15.146:0/2234898304 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 0x561db79bfd60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff15400b680 tx=0x7ff154010000 comp rx=0 tx=0).stop 2023-10-03T10:12:01.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.785+0000 7ff170616b80 1 -- 172.21.15.146:0/2234898304 shutdown_connections 2023-10-03T10:12:01.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.785+0000 7ff170616b80 1 --2- 172.21.15.146:0/2234898304 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 0x561db79bfd60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.785+0000 7ff170616b80 1 --2- 172.21.15.146:0/2234898304 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 0x561db79a9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.785+0000 7ff170616b80 1 --2- 172.21.15.146:0/2234898304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 0x561db79a9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.785+0000 7ff170616b80 1 -- 172.21.15.146:0/2234898304 >> 172.21.15.146:0/2234898304 conn(0x561db79ad0f0 msgr2=0x561db79ac690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.785+0000 7ff170616b80 1 -- 172.21.15.146:0/2234898304 shutdown_connections 2023-10-03T10:12:01.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.785+0000 7ff170616b80 1 -- 172.21.15.146:0/2234898304 wait complete. 2023-10-03T10:12:01.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.785+0000 7ff170616b80 1 -- start start 2023-10-03T10:12:01.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.786+0000 7ff170616b80 1 Processor -- start 2023-10-03T10:12:01.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.786+0000 7ff170616b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 0x561db79cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.786+0000 7ff170616b80 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 0x561db79ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.786+0000 7ff170616b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 0x561db79cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.786+0000 7ff170616b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db78ffb00 con 0x561db79c5100 2023-10-03T10:12:01.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.786+0000 7ff170616b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x561db789b770 con 0x561db79a8c50 2023-10-03T10:12:01.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.786+0000 7ff170616b80 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x561db78be6f0 con 0x561db79bf8f0 2023-10-03T10:12:01.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.786+0000 7ff170616b80 10 client.0 _ll_register_callbacks cb 0x561db77075a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:12:01.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.786+0000 7ff16220f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 0x561db79cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.786+0000 7ff16220f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 0x561db79cdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59758/0 (socket says 172.21.15.146:59758) 2023-10-03T10:12:01.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.786+0000 7ff161a0e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 0x561db79ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.786+0000 7ff16220f700 1 -- 172.21.15.146:0/3865980285 learned_addr learned my addr 172.21.15.146:0/3865980285 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:01.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.786+0000 7ff162a10700 1 --2- 172.21.15.146:0/3865980285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 0x561db79cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.787+0000 7ff16220f700 1 -- 172.21.15.146:0/3865980285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 msgr2=0x561db79ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:01.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.787+0000 7ff16220f700 1 --2- 172.21.15.146:0/3865980285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 0x561db79ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.787+0000 7ff16220f700 1 -- 172.21.15.146:0/3865980285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 msgr2=0x561db79cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:01.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.787+0000 7ff16220f700 1 --2- 172.21.15.146:0/3865980285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 0x561db79cea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.787+0000 7ff16220f700 1 -- 172.21.15.146:0/3865980285 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff158001cc0 con 0x561db79a8c50 2023-10-03T10:12:01.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.787+0000 7ff162a10700 1 --2- 172.21.15.146:0/3865980285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 0x561db79cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:01.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.787+0000 7ff161a0e700 1 --2- 172.21.15.146:0/3865980285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 0x561db79ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:01.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.787+0000 7ff16220f700 1 --2- 172.21.15.146:0/3865980285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 0x561db79cdfc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff15001bda0 tx=0x7ff150004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92fffe5c7d2b3e91 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:01.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.787+0000 7ff13d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3301/0 2023-10-03T10:12:01.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.787+0000 7ff13d7fa700 1 -- 172.21.15.146:0/3865980285 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150005e30 con 0x561db79a8c50 2023-10-03T10:12:01.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.787+0000 7ff13d7fa700 1 -- 172.21.15.146:0/3865980285 <== mon.1 v2:172.21.15.146:3301/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7ff150038260 con 0x561db79a8c50 2023-10-03T10:12:01.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.787+0000 7ff170616b80 1 -- 172.21.15.146:0/3865980285 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561db79a12b0 con 0x561db79a8c50 2023-10-03T10:12:01.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.787+0000 7ff13d7fa700 1 -- 172.21.15.146:0/3865980285 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff15001ba00 con 0x561db79a8c50 2023-10-03T10:12:01.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.787+0000 7ff170616b80 10 client.14371 fetch_fsmap learned FSMap version 7 2023-10-03T10:12:01.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.787+0000 7ff170616b80 1 -- 172.21.15.146:0/3865980285 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,fsmap=7,monmap=3+}) v3 -- 0x7ff15c1338b0 con 0x561db79a8c50 2023-10-03T10:12:01.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.787+0000 7ff13d7fa700 1 -- 172.21.15.146:0/3865980285 <== mon.1 v2:172.21.15.146:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561db79a12b0 con 0x561db79a8c50 2023-10-03T10:12:01.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.787+0000 7ff13d7fa700 1 -- 172.21.15.146:0/3865980285 <== mon.1 v2:172.21.15.146:3301/0 5 ==== fsmap(e 7) v1 ==== 1436+0+0 (secure 0 0 0) 0x7ff150038420 con 0x561db79a8c50 2023-10-03T10:12:01.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.787+0000 7ff170616b80 10 client.14371 fetch_fsmap finished waiting for FSMap version 7 2023-10-03T10:12:01.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.787+0000 7ff170616b80 10 client.14371 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:12:01.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.787+0000 7ff170616b80 20 client.14371 populate_metadata read hostname 'smithi146' 2023-10-03T10:12:01.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.787+0000 7ff170616b80 4 client.14371 mds_command: new command op to 4181 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T10:12:01.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.787+0000 7ff170616b80 1 -- 172.21.15.146:0/3865980285 --> v1:172.21.15.146:6817/4164614194 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561db797df40 con 0x561db79e2030 2023-10-03T10:12:01.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.788+0000 7ff13d7fa700 10 client.14371 ms_handle_connect on v1:172.21.15.146:6817/4164614194 2023-10-03T10:12:01.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.788+0000 7ff13d7fa700 1 -- 172.21.15.146:0/3865980285 <== mds.0 v1:172.21.15.146:6817/4164614194 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x561db797df40 con 0x561db79e2030 2023-10-03T10:12:01.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.788+0000 7ff13d7fa700 10 client.14371 handle_command_reply: tid=0 2023-10-03T10:12:01.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.788+0000 7ff170616b80 1 client.14371 shutdown 2023-10-03T10:12:01.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.788+0000 7ff170616b80 1 -- 172.21.15.146:0/3865980285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 msgr2=0x561db79cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.788+0000 7ff170616b80 1 --2- 172.21.15.146:0/3865980285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 0x561db79cdfc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff15001bda0 tx=0x7ff150004750 comp rx=0 tx=0).stop 2023-10-03T10:12:01.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.788+0000 7ff170616b80 1 -- 172.21.15.146:0/3865980285 shutdown_connections 2023-10-03T10:12:01.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.788+0000 7ff170616b80 1 --2- 172.21.15.146:0/3865980285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 0x561db79cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.788+0000 7ff170616b80 1 --2- 172.21.15.146:0/3865980285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 0x561db79cdfc0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.788+0000 7ff170616b80 1 --2- 172.21.15.146:0/3865980285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 0x561db79ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.788+0000 7ff13d7fa700 0 client.14371 ms_handle_reset on v1:172.21.15.146:6817/4164614194 2023-10-03T10:12:01.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.788+0000 7ff170616b80 1 -- 172.21.15.146:0/3865980285 >> 172.21.15.146:0/3865980285 conn(0x561db79ad0f0 msgr2=0x561db79a9230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.789+0000 7ff170616b80 1 -- 172.21.15.146:0/3865980285 shutdown_connections 2023-10-03T10:12:01.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.789+0000 7ff170616b80 1 -- 172.21.15.146:0/3865980285 wait complete. 2023-10-03T10:12:01.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.789+0000 7ff170616b80 20 client.14371 trim_cache size 0 max 16384 2023-10-03T10:12:01.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.805+0000 7ff170616b80 1 Processor -- start 2023-10-03T10:12:01.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.805+0000 7ff170616b80 1 -- start start 2023-10-03T10:12:01.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.805+0000 7ff170616b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 0x561db79c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.805+0000 7ff170616b80 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 0x561db79e5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.805+0000 7ff170616b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 0x561db79a7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.805+0000 7ff170616b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db76f4390 con 0x561db79c5100 2023-10-03T10:12:01.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.805+0000 7ff170616b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x561db79abee0 con 0x561db79a8c50 2023-10-03T10:12:01.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.805+0000 7ff170616b80 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x561db79c2890 con 0x561db79bf8f0 2023-10-03T10:12:01.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.806+0000 7ff16220f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 0x561db79c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.806+0000 7ff161a0e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 0x561db79e5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.806+0000 7ff162a10700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 0x561db79a7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.806+0000 7ff16220f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 0x561db79c0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59774/0 (socket says 172.21.15.146:59774) 2023-10-03T10:12:01.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.806+0000 7ff161a0e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 0x561db79e5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46122/0 (socket says 172.21.15.146:46122) 2023-10-03T10:12:01.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.806+0000 7ff16220f700 1 -- 172.21.15.146:0/1101640971 learned_addr learned my addr 172.21.15.146:0/1101640971 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:01.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.806+0000 7ff161a0e700 1 -- 172.21.15.146:0/1101640971 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 msgr2=0x561db79c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:01.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.806+0000 7ff161a0e700 1 --2- 172.21.15.146:0/1101640971 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 0x561db79c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.806+0000 7ff161a0e700 1 -- 172.21.15.146:0/1101640971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 msgr2=0x561db79a7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:01.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.806+0000 7ff161a0e700 1 --2- 172.21.15.146:0/1101640971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 0x561db79a7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.806+0000 7ff161a0e700 1 -- 172.21.15.146:0/1101640971 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561db77e00a0 con 0x561db79bf8f0 2023-10-03T10:12:01.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.806+0000 7ff16220f700 1 --2- 172.21.15.146:0/1101640971 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 0x561db79c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:01.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.806+0000 7ff162a10700 1 --2- 172.21.15.146:0/1101640971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 0x561db79a7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:01.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.806+0000 7ff161a0e700 1 --2- 172.21.15.146:0/1101640971 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 0x561db79e5420 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff15c11dbf0 tx=0x7ff158001a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c41a493fa318047f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:01.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.806+0000 7ff14cdad700 1 -- 172.21.15.146:0/1101640971 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15801f040 con 0x561db79bf8f0 2023-10-03T10:12:01.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.806+0000 7ff14cdad700 1 -- 172.21.15.146:0/1101640971 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff158007230 con 0x561db79bf8f0 2023-10-03T10:12:01.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.806+0000 7ff14cdad700 1 -- 172.21.15.146:0/1101640971 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1580075a0 con 0x561db79bf8f0 2023-10-03T10:12:01.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.807+0000 7ff170616b80 1 -- 172.21.15.146:0/1101640971 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 msgr2=0x561db79e5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.807+0000 7ff170616b80 1 --2- 172.21.15.146:0/1101640971 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 0x561db79e5420 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff15c11dbf0 tx=0x7ff158001a30 comp rx=0 tx=0).stop 2023-10-03T10:12:01.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.807+0000 7ff170616b80 1 -- 172.21.15.146:0/1101640971 shutdown_connections 2023-10-03T10:12:01.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.807+0000 7ff170616b80 1 --2- 172.21.15.146:0/1101640971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 0x561db79a7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.807+0000 7ff170616b80 1 --2- 172.21.15.146:0/1101640971 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 0x561db79c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.807+0000 7ff170616b80 1 --2- 172.21.15.146:0/1101640971 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 0x561db79e5420 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.807+0000 7ff170616b80 1 -- 172.21.15.146:0/1101640971 >> 172.21.15.146:0/1101640971 conn(0x561db79ad0f0 msgr2=0x561db79ac690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.807+0000 7ff170616b80 1 -- 172.21.15.146:0/1101640971 shutdown_connections 2023-10-03T10:12:01.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.807+0000 7ff170616b80 1 -- 172.21.15.146:0/1101640971 wait complete. 2023-10-03T10:12:01.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.807+0000 7ff170616b80 1 -- start start 2023-10-03T10:12:01.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.807+0000 7ff170616b80 1 Processor -- start 2023-10-03T10:12:01.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.808+0000 7ff170616b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 0x561db79cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.808+0000 7ff170616b80 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 0x561db79d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.808+0000 7ff170616b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 0x561db79d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.808+0000 7ff170616b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db79d3d60 con 0x561db79c5100 2023-10-03T10:12:01.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.808+0000 7ff170616b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x561db79d2010 con 0x561db79a8c50 2023-10-03T10:12:01.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.808+0000 7ff170616b80 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x561db79d2b20 con 0x561db79bf8f0 2023-10-03T10:12:01.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.808+0000 7ff170616b80 10 client.0 _ll_register_callbacks cb 0x7ff15c11f200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:12:01.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.808+0000 7ff16220f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 0x561db79cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.808+0000 7ff161a0e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 0x561db79d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.808+0000 7ff16220f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 0x561db79cffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59776/0 (socket says 172.21.15.146:59776) 2023-10-03T10:12:01.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.808+0000 7ff16220f700 1 -- 172.21.15.146:0/884886219 learned_addr learned my addr 172.21.15.146:0/884886219 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:01.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.808+0000 7ff162a10700 1 --2- 172.21.15.146:0/884886219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 0x561db79d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.808+0000 7ff16220f700 1 -- 172.21.15.146:0/884886219 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 msgr2=0x561db79d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:01.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.808+0000 7ff16220f700 1 --2- 172.21.15.146:0/884886219 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 0x561db79d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.808+0000 7ff16220f700 1 -- 172.21.15.146:0/884886219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 msgr2=0x561db79d0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:01.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.808+0000 7ff16220f700 1 --2- 172.21.15.146:0/884886219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 0x561db79d0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.808+0000 7ff16220f700 1 -- 172.21.15.146:0/884886219 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15c1338b0 con 0x561db79a8c50 2023-10-03T10:12:01.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.808+0000 7ff16220f700 1 --2- 172.21.15.146:0/884886219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 0x561db79cffe0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff15003dc00 tx=0x7ff150008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11ae7a4c6504d367 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:01.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.808+0000 7ff13d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3301/0 2023-10-03T10:12:01.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.808+0000 7ff13d7fa700 1 -- 172.21.15.146:0/884886219 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15001b3b0 con 0x561db79a8c50 2023-10-03T10:12:01.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.808+0000 7ff13d7fa700 1 -- 172.21.15.146:0/884886219 <== mon.1 v2:172.21.15.146:3301/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7ff15003e930 con 0x561db79a8c50 2023-10-03T10:12:01.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.808+0000 7ff170616b80 1 -- 172.21.15.146:0/884886219 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff1540127e0 con 0x561db79a8c50 2023-10-03T10:12:01.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.809+0000 7ff13d7fa700 1 -- 172.21.15.146:0/884886219 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff15001ba00 con 0x561db79a8c50 2023-10-03T10:12:01.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.809+0000 7ff170616b80 10 client.14377 fetch_fsmap learned FSMap version 7 2023-10-03T10:12:01.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.809+0000 7ff170616b80 1 -- 172.21.15.146:0/884886219 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,fsmap=7,monmap=3+}) v3 -- 0x561db76f3790 con 0x561db79a8c50 2023-10-03T10:12:01.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.809+0000 7ff13d7fa700 1 -- 172.21.15.146:0/884886219 <== mon.1 v2:172.21.15.146:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1540127e0 con 0x561db79a8c50 2023-10-03T10:12:01.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.809+0000 7ff13d7fa700 1 -- 172.21.15.146:0/884886219 <== mon.1 v2:172.21.15.146:3301/0 5 ==== fsmap(e 7) v1 ==== 1436+0+0 (secure 0 0 0) 0x7ff15003eaf0 con 0x561db79a8c50 2023-10-03T10:12:01.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.809+0000 7ff170616b80 10 client.14377 fetch_fsmap finished waiting for FSMap version 7 2023-10-03T10:12:01.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.809+0000 7ff170616b80 10 client.14377 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:12:01.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.809+0000 7ff170616b80 20 client.14377 populate_metadata read hostname 'smithi146' 2023-10-03T10:12:01.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.809+0000 7ff170616b80 4 client.14377 mds_command: new command op to 4181 tid=0[{"prefix": "status"}] 2023-10-03T10:12:01.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.809+0000 7ff170616b80 1 -- 172.21.15.146:0/884886219 --> v1:172.21.15.146:6817/4164614194 -- command(tid 0: {"prefix": "status"}) v1 -- 0x561db78f8ce0 con 0x561db7a2a9b0 2023-10-03T10:12:01.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.809+0000 7ff13d7fa700 10 client.14377 ms_handle_connect on v1:172.21.15.146:6817/4164614194 2023-10-03T10:12:01.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.809+0000 7ff13d7fa700 1 -- 172.21.15.146:0/884886219 <== mds.0 v1:172.21.15.146:6817/4164614194 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (unknown 0 0 3336215071) 0x561db78f8ce0 con 0x561db7a2a9b0 2023-10-03T10:12:01.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.809+0000 7ff13d7fa700 10 client.14377 handle_command_reply: tid=0 2023-10-03T10:12:01.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.809+0000 7ff170616b80 1 client.14377 shutdown 2023-10-03T10:12:01.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.810+0000 7ff170616b80 1 -- 172.21.15.146:0/884886219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 msgr2=0x561db79cffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.810+0000 7ff170616b80 1 --2- 172.21.15.146:0/884886219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 0x561db79cffe0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff15003dc00 tx=0x7ff150008030 comp rx=0 tx=0).stop 2023-10-03T10:12:01.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.810+0000 7ff170616b80 1 -- 172.21.15.146:0/884886219 shutdown_connections 2023-10-03T10:12:01.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.810+0000 7ff170616b80 1 --2- 172.21.15.146:0/884886219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561db79c5100 0x561db79d0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.810+0000 7ff170616b80 1 --2- 172.21.15.146:0/884886219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561db79a8c50 0x561db79cffe0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.810+0000 7ff170616b80 1 --2- 172.21.15.146:0/884886219 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x561db79bf8f0 0x561db79d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.810+0000 7ff13d7fa700 0 client.14377 ms_handle_reset on v1:172.21.15.146:6817/4164614194 2023-10-03T10:12:01.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.810+0000 7ff170616b80 1 -- 172.21.15.146:0/884886219 >> 172.21.15.146:0/884886219 conn(0x561db79ad0f0 msgr2=0x561db79a7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.810+0000 7ff170616b80 1 -- 172.21.15.146:0/884886219 shutdown_connections 2023-10-03T10:12:01.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.810+0000 7ff170616b80 1 -- 172.21.15.146:0/884886219 wait complete. 2023-10-03T10:12:01.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.810+0000 7ff170616b80 20 client.14377 trim_cache size 0 max 16384 2023-10-03T10:12:01.817 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-03T10:12:01.818 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "5440411f-9bdd-4ef1-85ef-960d00aa215c", 2023-10-03T10:12:01.818 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2023-10-03T10:12:01.818 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 4181, 2023-10-03T10:12:01.818 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2023-10-03T10:12:01.818 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2023-10-03T10:12:01.818 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2023-10-03T10:12:01.818 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 133.08529898200001, 2023-10-03T10:12:01.818 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 7, 2023-10-03T10:12:01.818 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 22, 2023-10-03T10:12:01.818 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 17, 2023-10-03T10:12:01.818 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 137.37865199399999 2023-10-03T10:12:01.819 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-03T10:12:01.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.810+0000 7ff164473700 1 -- 172.21.15.146:0/4208417528 >> v1:172.21.15.146:6816/126749 conn(0x7ff14002f510 legacy=0x7ff1400319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.810+0000 7ff164473700 1 -- 172.21.15.146:0/4208417528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff15c1300a0 msgr2=0x7ff15c0713b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.810+0000 7ff164473700 1 --2- 172.21.15.146:0/4208417528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff15c1300a0 0x7ff15c0713b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff15000ebe0 tx=0x7ff15000eef0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.810+0000 7ff164473700 1 -- 172.21.15.146:0/4208417528 shutdown_connections 2023-10-03T10:12:01.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.810+0000 7ff164473700 1 --2- 172.21.15.146:0/4208417528 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff15c133ad0 0x7ff15c071e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.810+0000 7ff164473700 1 --2- 172.21.15.146:0/4208417528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff15c1300a0 0x7ff15c0713b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.810+0000 7ff164473700 1 --2- 172.21.15.146:0/4208417528 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff15c130bc0 0x7ff15c0718f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.810+0000 7ff164473700 1 -- 172.21.15.146:0/4208417528 >> 172.21.15.146:0/4208417528 conn(0x7ff15c099c40 msgr2=0x7ff15c132a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.810+0000 7ff164473700 1 -- 172.21.15.146:0/4208417528 shutdown_connections 2023-10-03T10:12:01.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:01.810+0000 7ff164473700 1 -- 172.21.15.146:0/4208417528 wait complete. 2023-10-03T10:12:01.823 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-10-03T10:12:01.833 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-03T10:12:01.833 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:01.857 INFO:tasks.ceph.osd.0:Stopped 2023-10-03T10:12:01.857 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2023-10-03T10:12:02.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.017+0000 7f0cc9136700 1 Processor -- start 2023-10-03T10:12:02.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.017+0000 7f0cc9136700 1 -- start start 2023-10-03T10:12:02.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.017+0000 7f0cc9136700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc409e340 0x7f0cc41359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.017+0000 7f0cc9136700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0cc4135f20 0x7f0cc4138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.018+0000 7f0cc9136700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc409aaa0 con 0x7f0cc409d860 2023-10-03T10:12:02.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.018+0000 7f0cc9136700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc409e730 con 0x7f0cc409e340 2023-10-03T10:12:02.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.018+0000 7f0cc9136700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc409f870 con 0x7f0cc4135f20 2023-10-03T10:12:02.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.018+0000 7f0cc259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc409e340 0x7f0cc41359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.018+0000 7f0cc2d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0cc409d860 0x7f0cc409dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40818/0 (socket says 172.21.15.146:40818) 2023-10-03T10:12:02.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.018+0000 7f0cc2d9d700 1 -- 172.21.15.146:0/3279523462 learned_addr learned my addr 172.21.15.146:0/3279523462 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:02.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.018+0000 7f0cc359e700 1 --2- 172.21.15.146:0/3279523462 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0cc4135f20 0x7f0cc4138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.018+0000 7f0cc1d9b700 1 -- 172.21.15.146:0/3279523462 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913127373 0 0) 0x7f0cc409aaa0 con 0x7f0cc409d860 2023-10-03T10:12:02.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.018+0000 7f0cc359e700 1 -- 172.21.15.146:0/3279523462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc409e340 msgr2=0x7f0cc41359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:02.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.018+0000 7f0cc359e700 1 --2- 172.21.15.146:0/3279523462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc409e340 0x7f0cc41359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.018+0000 7f0cc359e700 1 -- 172.21.15.146:0/3279523462 >> v1:172.21.15.146:6789/0 conn(0x7f0cc409d860 legacy=0x7f0cc409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.018+0000 7f0cc359e700 1 -- 172.21.15.146:0/3279523462 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc409b360 con 0x7f0cc4135f20 2023-10-03T10:12:02.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.018+0000 7f0cc259c700 1 --2- 172.21.15.146:0/3279523462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc409e340 0x7f0cc41359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:02.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.018+0000 7f0cc359e700 1 --2- 172.21.15.146:0/3279523462 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0cc4135f20 0x7f0cc4138300 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009df0 tx=0x7f0cbc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc94b9721de707d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:02.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.018+0000 7f0cc1d9b700 1 -- 172.21.15.146:0/3279523462 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc00e070 con 0x7f0cc4135f20 2023-10-03T10:12:02.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.018+0000 7f0cc1d9b700 1 -- 172.21.15.146:0/3279523462 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc00bae0 con 0x7f0cc4135f20 2023-10-03T10:12:02.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.018+0000 7f0cc1d9b700 1 -- 172.21.15.146:0/3279523462 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc00be90 con 0x7f0cc4135f20 2023-10-03T10:12:02.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.019+0000 7f0cc9136700 1 -- 172.21.15.146:0/3279523462 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0cc4135f20 msgr2=0x7f0cc4138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.019+0000 7f0cc9136700 1 --2- 172.21.15.146:0/3279523462 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0cc4135f20 0x7f0cc4138300 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009df0 tx=0x7f0cbc00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:02.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.019+0000 7f0cc9136700 1 -- 172.21.15.146:0/3279523462 shutdown_connections 2023-10-03T10:12:02.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.019+0000 7f0cc9136700 1 --2- 172.21.15.146:0/3279523462 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0cc4135f20 0x7f0cc4138300 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.019+0000 7f0cc9136700 1 --2- 172.21.15.146:0/3279523462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc409e340 0x7f0cc41359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.019+0000 7f0cc9136700 1 -- 172.21.15.146:0/3279523462 >> 172.21.15.146:0/3279523462 conn(0x7f0cc4099c40 msgr2=0x7f0cc40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:02.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.019+0000 7f0cc9136700 1 -- 172.21.15.146:0/3279523462 shutdown_connections 2023-10-03T10:12:02.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.019+0000 7f0cc9136700 1 -- 172.21.15.146:0/3279523462 wait complete. 2023-10-03T10:12:02.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.020+0000 7f0cc9136700 1 Processor -- start 2023-10-03T10:12:02.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.020+0000 7f0cc9136700 1 -- start start 2023-10-03T10:12:02.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.020+0000 7f0cc9136700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0cc409d860 0x7f0cc4132e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.020+0000 7f0cc9136700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc409e340 0x7f0cc4133370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.020+0000 7f0cc9136700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc4135f20 0x7f0cc41338b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.020+0000 7f0cc9136700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc4122e80 con 0x7f0cc4135f20 2023-10-03T10:12:02.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.020+0000 7f0cc9136700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc409c8b0 con 0x7f0cc409e340 2023-10-03T10:12:02.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.020+0000 7f0cc9136700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc406b510 con 0x7f0cc409d860 2023-10-03T10:12:02.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.021+0000 7f0cc2d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0cc409d860 0x7f0cc4132e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.021+0000 7f0cc259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc409e340 0x7f0cc4133370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.021+0000 7f0cc2d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0cc409d860 0x7f0cc4132e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46162/0 (socket says 172.21.15.146:46162) 2023-10-03T10:12:02.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.021+0000 7f0cc2d9d700 1 -- 172.21.15.146:0/1325102372 learned_addr learned my addr 172.21.15.146:0/1325102372 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:02.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.021+0000 7f0cc359e700 1 --2- 172.21.15.146:0/1325102372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc4135f20 0x7f0cc41338b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.021+0000 7f0cc2d9d700 1 -- 172.21.15.146:0/1325102372 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc409e340 msgr2=0x7f0cc4133370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.021+0000 7f0cc2d9d700 1 --2- 172.21.15.146:0/1325102372 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc409e340 0x7f0cc4133370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.021+0000 7f0cc2d9d700 1 -- 172.21.15.146:0/1325102372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc4135f20 msgr2=0x7f0cc41338b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.021+0000 7f0cc2d9d700 1 --2- 172.21.15.146:0/1325102372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc4135f20 0x7f0cc41338b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.021+0000 7f0cc2d9d700 1 -- 172.21.15.146:0/1325102372 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb40094a0 con 0x7f0cc409d860 2023-10-03T10:12:02.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.021+0000 7f0cc359e700 1 --2- 172.21.15.146:0/1325102372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc4135f20 0x7f0cc41338b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:02.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.021+0000 7f0cc259c700 1 --2- 172.21.15.146:0/1325102372 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc409e340 0x7f0cc4133370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:02.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.021+0000 7f0cc2d9d700 1 --2- 172.21.15.146:0/1325102372 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0cc409d860 0x7f0cc4132e30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800c520 tx=0x7f0cb800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:02.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.021+0000 7f0cab7fe700 1 -- 172.21.15.146:0/1325102372 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8004c80 con 0x7f0cc409d860 2023-10-03T10:12:02.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.021+0000 7f0cab7fe700 1 -- 172.21.15.146:0/1325102372 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb8004de0 con 0x7f0cc409d860 2023-10-03T10:12:02.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.021+0000 7f0cc9136700 1 -- 172.21.15.146:0/1325102372 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cbc009a70 con 0x7f0cc409d860 2023-10-03T10:12:02.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.021+0000 7f0cab7fe700 1 -- 172.21.15.146:0/1325102372 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8007310 con 0x7f0cc409d860 2023-10-03T10:12:02.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.021+0000 7f0cc9136700 1 -- 172.21.15.146:0/1325102372 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc406aa70 con 0x7f0cc409d860 2023-10-03T10:12:02.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.022+0000 7f0cc9136700 1 -- 172.21.15.146:0/1325102372 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc404f2a0 con 0x7f0cc409d860 2023-10-03T10:12:02.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.023+0000 7f0cab7fe700 1 -- 172.21.15.146:0/1325102372 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0cb8007470 con 0x7f0cc409d860 2023-10-03T10:12:02.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.023+0000 7f0cab7fe700 1 -- 172.21.15.146:0/1325102372 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f0cb803fd00 con 0x7f0cc409d860 2023-10-03T10:12:02.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.027+0000 7f0cab7fe700 1 -- 172.21.15.146:0/1325102372 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cb80133c0 con 0x7f0cc409d860 2023-10-03T10:12:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.224+0000 7f0cc9136700 1 -- 172.21.15.146:0/1325102372 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) v1 -- 0x7f0cc406c3b0 con 0x7f0cc409d860 2023-10-03T10:12:02.225 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-03T10:12:02.224+0000 7fc745fb7700 -1 mon.a@0(leader).osd e22 definitely_dead 0 2023-10-03T10:12:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.406+0000 7f0cab7fe700 1 -- 172.21.15.146:0/1325102372 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 marked down osd.0. v23) v1 ==== 89+0+0 (secure 0 0 0) 0x7f0cb8011360 con 0x7f0cc409d860 2023-10-03T10:12:02.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.410+0000 7f0cc9136700 1 -- 172.21.15.146:0/1325102372 >> v1:172.21.15.146:6816/126749 conn(0x7f0cb002f510 legacy=0x7f0cb00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.410+0000 7f0cc9136700 1 -- 172.21.15.146:0/1325102372 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0cc409d860 msgr2=0x7f0cc4132e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.410+0000 7f0cc9136700 1 --2- 172.21.15.146:0/1325102372 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0cc409d860 0x7f0cc4132e30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800c520 tx=0x7f0cb800c830 comp rx=0 tx=0).stop 2023-10-03T10:12:02.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.410+0000 7f0cc9136700 1 -- 172.21.15.146:0/1325102372 shutdown_connections 2023-10-03T10:12:02.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.410+0000 7f0cc9136700 1 --2- 172.21.15.146:0/1325102372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc4135f20 0x7f0cc41338b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.410+0000 7f0cc9136700 1 --2- 172.21.15.146:0/1325102372 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0cc409d860 0x7f0cc4132e30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.410+0000 7f0cc9136700 1 --2- 172.21.15.146:0/1325102372 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc409e340 0x7f0cc4133370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.410+0000 7f0cc9136700 1 -- 172.21.15.146:0/1325102372 >> 172.21.15.146:0/1325102372 conn(0x7f0cc4099c40 msgr2=0x7f0cc4134b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.410+0000 7f0cc9136700 1 -- 172.21.15.146:0/1325102372 shutdown_connections 2023-10-03T10:12:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.410+0000 7f0cc9136700 1 -- 172.21.15.146:0/1325102372 wait complete. 2023-10-03T10:12:02.414 INFO:teuthology.orchestra.run.smithi146.stderr:marked down osd.0. 2023-10-03T10:12:02.425 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-03T10:12:02.425 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-03T10:12:02.427 INFO:tasks.ceph.osd.0:Started 2023-10-03T10:12:02.428 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-03T10:12:02.428 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:02.455 INFO:tasks.ceph.osd.1:Stopped 2023-10-03T10:12:02.455 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2023-10-03T10:12:02.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.617+0000 7fd3715c5700 1 Processor -- start 2023-10-03T10:12:02.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.617+0000 7fd3715c5700 1 -- start start 2023-10-03T10:12:02.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.617+0000 7fd3715c5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd36c0a0a90 0x7fd36c0a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.617+0000 7fd3715c5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd36c0a13a0 0x7fd36c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.617+0000 7fd3715c5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd36c133f70 0x7fd36c1343d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.617+0000 7fd3715c5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd36c0a3aa0 con 0x7fd36c0a0a90 2023-10-03T10:12:02.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.617+0000 7fd3715c5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c09a540 con 0x7fd36c0a13a0 2023-10-03T10:12:02.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.617+0000 7fd3715c5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c0a1fe0 con 0x7fd36c133f70 2023-10-03T10:12:02.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.618+0000 7fd36a7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd36c0a13a0 0x7fd36c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.618+0000 7fd36affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd36c0a0a90 0x7fd36c0a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.618+0000 7fd36b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd36c133f70 0x7fd36c1343d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.618+0000 7fd36affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd36c0a0a90 0x7fd36c0a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33460/0 (socket says 172.21.15.146:33460) 2023-10-03T10:12:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.618+0000 7fd36b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd36c133f70 0x7fd36c1343d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46172/0 (socket says 172.21.15.146:46172) 2023-10-03T10:12:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.618+0000 7fd36affd700 1 -- 172.21.15.146:0/1473994413 learned_addr learned my addr 172.21.15.146:0/1473994413 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.618+0000 7fd36a7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd36c0a13a0 0x7fd36c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59810/0 (socket says 172.21.15.146:59810) 2023-10-03T10:12:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.618+0000 7fd36b7fe700 1 -- 172.21.15.146:0/1473994413 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd36c0a13a0 msgr2=0x7fd36c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.618+0000 7fd36b7fe700 1 --2- 172.21.15.146:0/1473994413 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd36c0a13a0 0x7fd36c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.618+0000 7fd36b7fe700 1 -- 172.21.15.146:0/1473994413 >> v2:172.21.15.146:3300/0 conn(0x7fd36c0a0a90 msgr2=0x7fd36c0a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.618+0000 7fd36b7fe700 1 --2- 172.21.15.146:0/1473994413 >> v2:172.21.15.146:3300/0 conn(0x7fd36c0a0a90 0x7fd36c0a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.618+0000 7fd36b7fe700 1 -- 172.21.15.146:0/1473994413 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c09a280 con 0x7fd36c133f70 2023-10-03T10:12:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.618+0000 7fd36affd700 1 --2- 172.21.15.146:0/1473994413 >> v2:172.21.15.146:3300/0 conn(0x7fd36c0a0a90 0x7fd36c0a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.618+0000 7fd36b7fe700 1 --2- 172.21.15.146:0/1473994413 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd36c133f70 0x7fd36c1343d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd364009dc0 tx=0x7fd36400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6247acc2962124c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.618+0000 7fd369ffb700 1 -- 172.21.15.146:0/1473994413 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36400e070 con 0x7fd36c133f70 2023-10-03T10:12:02.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.618+0000 7fd369ffb700 1 -- 172.21.15.146:0/1473994413 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36400bae0 con 0x7fd36c133f70 2023-10-03T10:12:02.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.618+0000 7fd369ffb700 1 -- 172.21.15.146:0/1473994413 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36400be90 con 0x7fd36c133f70 2023-10-03T10:12:02.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.619+0000 7fd3715c5700 1 -- 172.21.15.146:0/1473994413 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd36c133f70 msgr2=0x7fd36c1343d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.619+0000 7fd3715c5700 1 --2- 172.21.15.146:0/1473994413 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd36c133f70 0x7fd36c1343d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd364009dc0 tx=0x7fd36400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:02.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.619+0000 7fd3715c5700 1 -- 172.21.15.146:0/1473994413 shutdown_connections 2023-10-03T10:12:02.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.619+0000 7fd3715c5700 1 --2- 172.21.15.146:0/1473994413 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd36c133f70 0x7fd36c1343d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.619+0000 7fd3715c5700 1 --2- 172.21.15.146:0/1473994413 >> v2:172.21.15.146:3300/0 conn(0x7fd36c0a0a90 0x7fd36c0a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.619+0000 7fd3715c5700 1 --2- 172.21.15.146:0/1473994413 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd36c0a13a0 0x7fd36c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.619+0000 7fd3715c5700 1 -- 172.21.15.146:0/1473994413 >> 172.21.15.146:0/1473994413 conn(0x7fd36c099c40 msgr2=0x7fd36c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:02.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.619+0000 7fd3715c5700 1 -- 172.21.15.146:0/1473994413 shutdown_connections 2023-10-03T10:12:02.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.619+0000 7fd3715c5700 1 -- 172.21.15.146:0/1473994413 wait complete. 2023-10-03T10:12:02.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.620+0000 7fd3715c5700 1 Processor -- start 2023-10-03T10:12:02.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.620+0000 7fd3715c5700 1 -- start start 2023-10-03T10:12:02.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.620+0000 7fd3715c5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd36c0a0a90 0x7fd36c132970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.620+0000 7fd3715c5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd36c0a13a0 0x7fd36c132eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.620+0000 7fd3715c5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd36c133f70 0x7fd36c1c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.620+0000 7fd3715c5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c120900 con 0x7fd36c133f70 2023-10-03T10:12:02.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.620+0000 7fd3715c5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c120710 con 0x7fd36c0a0a90 2023-10-03T10:12:02.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.620+0000 7fd3715c5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c120fa0 con 0x7fd36c0a13a0 2023-10-03T10:12:02.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.620+0000 7fd36a7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd36c0a13a0 0x7fd36c132eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.620+0000 7fd36affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd36c0a0a90 0x7fd36c132970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.620+0000 7fd36b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd36c133f70 0x7fd36c1c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.620+0000 7fd36a7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd36c0a13a0 0x7fd36c132eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46174/0 (socket says 172.21.15.146:46174) 2023-10-03T10:12:02.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.620+0000 7fd36affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd36c0a0a90 0x7fd36c132970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59816/0 (socket says 172.21.15.146:59816) 2023-10-03T10:12:02.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.620+0000 7fd36b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd36c133f70 0x7fd36c1c8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33466/0 (socket says 172.21.15.146:33466) 2023-10-03T10:12:02.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.620+0000 7fd36a7fc700 1 -- 172.21.15.146:0/31061295 learned_addr learned my addr 172.21.15.146:0/31061295 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:02.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.621+0000 7fd36b7fe700 1 -- 172.21.15.146:0/31061295 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd36c0a13a0 msgr2=0x7fd36c132eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.621+0000 7fd36b7fe700 1 --2- 172.21.15.146:0/31061295 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd36c0a13a0 0x7fd36c132eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.621+0000 7fd36b7fe700 1 -- 172.21.15.146:0/31061295 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd36c0a0a90 msgr2=0x7fd36c132970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.621+0000 7fd36b7fe700 1 --2- 172.21.15.146:0/31061295 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd36c0a0a90 0x7fd36c132970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.621+0000 7fd36b7fe700 1 -- 172.21.15.146:0/31061295 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd360009550 con 0x7fd36c133f70 2023-10-03T10:12:02.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.621+0000 7fd36b7fe700 1 --2- 172.21.15.146:0/31061295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd36c133f70 0x7fd36c1c8300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd364016000 tx=0x7fd364004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:02.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.621+0000 7fd3537fe700 1 -- 172.21.15.146:0/31061295 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3640045d0 con 0x7fd36c133f70 2023-10-03T10:12:02.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.621+0000 7fd3537fe700 1 -- 172.21.15.146:0/31061295 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd364020070 con 0x7fd36c133f70 2023-10-03T10:12:02.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.621+0000 7fd3715c5700 1 -- 172.21.15.146:0/31061295 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd364009a70 con 0x7fd36c133f70 2023-10-03T10:12:02.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.621+0000 7fd3537fe700 1 -- 172.21.15.146:0/31061295 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd364027480 con 0x7fd36c133f70 2023-10-03T10:12:02.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.621+0000 7fd3715c5700 1 -- 172.21.15.146:0/31061295 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36c1220d0 con 0x7fd36c133f70 2023-10-03T10:12:02.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.622+0000 7fd3537fe700 1 -- 172.21.15.146:0/31061295 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd3640275e0 con 0x7fd36c133f70 2023-10-03T10:12:02.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.622+0000 7fd3537fe700 1 -- 172.21.15.146:0/31061295 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fd364022070 con 0x7fd36c133f70 2023-10-03T10:12:02.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.622+0000 7fd3715c5700 1 -- 172.21.15.146:0/31061295 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36c133a10 con 0x7fd36c133f70 2023-10-03T10:12:02.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.627+0000 7fd3537fe700 1 -- 172.21.15.146:0/31061295 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd36402f980 con 0x7fd36c133f70 2023-10-03T10:12:02.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-10-03T10:12:02.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:02.824+0000 7fd3715c5700 1 -- 172.21.15.146:0/31061295 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) v1 -- 0x7fd36c04f2a0 con 0x7fd36c133f70 2023-10-03T10:12:02.825 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-03T10:12:02.825+0000 7fc745fb7700 -1 mon.a@0(leader).osd e23 definitely_dead 0 2023-10-03T10:12:03.019 INFO:tasks.ceph.osd.0.smithi146.stderr:2023-10-03T10:12:03.018+0000 7faea6f71680 -1 Falling back to public interface 2023-10-03T10:12:03.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.416+0000 7fd3537fe700 1 -- 172.21.15.146:0/31061295 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v24) v1 ==== 89+0+0 (secure 0 0 0) 0x7fd36402f390 con 0x7fd36c133f70 2023-10-03T10:12:03.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.421+0000 7fd3715c5700 1 -- 172.21.15.146:0/31061295 >> v1:172.21.15.146:6816/126749 conn(0x7fd35802f510 legacy=0x7fd3580319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.421+0000 7fd3715c5700 1 -- 172.21.15.146:0/31061295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd36c133f70 msgr2=0x7fd36c1c8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.421+0000 7fd3715c5700 1 --2- 172.21.15.146:0/31061295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd36c133f70 0x7fd36c1c8300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd364016000 tx=0x7fd364004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.421+0000 7fd3715c5700 1 -- 172.21.15.146:0/31061295 shutdown_connections 2023-10-03T10:12:03.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.421+0000 7fd3715c5700 1 --2- 172.21.15.146:0/31061295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd36c133f70 0x7fd36c1c8300 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.421+0000 7fd3715c5700 1 --2- 172.21.15.146:0/31061295 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd36c0a0a90 0x7fd36c132970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.421+0000 7fd3715c5700 1 --2- 172.21.15.146:0/31061295 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd36c0a13a0 0x7fd36c132eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.421+0000 7fd3715c5700 1 -- 172.21.15.146:0/31061295 >> 172.21.15.146:0/31061295 conn(0x7fd36c099c40 msgr2=0x7fd36c1bbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.423+0000 7fd3715c5700 1 -- 172.21.15.146:0/31061295 shutdown_connections 2023-10-03T10:12:03.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.423+0000 7fd3715c5700 1 -- 172.21.15.146:0/31061295 wait complete. 2023-10-03T10:12:03.428 INFO:teuthology.orchestra.run.smithi146.stderr:marked down osd.1. 2023-10-03T10:12:03.442 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-03T10:12:03.442 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-03T10:12:03.444 INFO:tasks.ceph.osd.1:Started 2023-10-03T10:12:03.445 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-03T10:12:03.445 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:03.473 INFO:tasks.ceph.osd.2:Stopped 2023-10-03T10:12:03.473 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2023-10-03T10:12:03.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.636+0000 7f098fb9a700 1 Processor -- start 2023-10-03T10:12:03.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.636+0000 7f098fb9a700 1 -- start start 2023-10-03T10:12:03.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.636+0000 7f098fb9a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09881335f0 0x7f09881359d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.636+0000 7f098fb9a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0988135f10 0x7f09881382f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.636+0000 7f098fb9a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098809bb90 con 0x7f098812d380 2023-10-03T10:12:03.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.637+0000 7f098fb9a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098809c210 con 0x7f0988135f10 2023-10-03T10:12:03.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.637+0000 7f098fb9a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f098809ced0 con 0x7f09881335f0 2023-10-03T10:12:03.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.637+0000 7f098d135700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09881335f0 0x7f09881359d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.637+0000 7f098e137700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0988135f10 0x7f09881382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.637+0000 7f098d936700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f098812d380 0x7f098812d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40856/0 (socket says 172.21.15.146:40856) 2023-10-03T10:12:03.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.637+0000 7f098d936700 1 -- 172.21.15.146:0/1708216499 learned_addr learned my addr 172.21.15.146:0/1708216499 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:03.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.637+0000 7f098d135700 1 -- 172.21.15.146:0/1708216499 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0988135f10 msgr2=0x7f09881382f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:03.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.637+0000 7f098d135700 1 --2- 172.21.15.146:0/1708216499 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0988135f10 0x7f09881382f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.637+0000 7f098d135700 1 -- 172.21.15.146:0/1708216499 >> v1:172.21.15.146:6789/0 conn(0x7f098812d380 legacy=0x7f098812d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.637+0000 7f098c934700 1 -- 172.21.15.146:0/1708216499 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488303223 0 0) 0x7f098809bb90 con 0x7f098812d380 2023-10-03T10:12:03.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.637+0000 7f098d135700 1 -- 172.21.15.146:0/1708216499 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098809ac30 con 0x7f09881335f0 2023-10-03T10:12:03.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.637+0000 7f098e137700 1 --2- 172.21.15.146:0/1708216499 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0988135f10 0x7f09881382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:03.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.637+0000 7f098d135700 1 --2- 172.21.15.146:0/1708216499 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09881335f0 0x7f09881359d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0978009870 tx=0x7f0978009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2efdcab9741a399f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.637+0000 7f098c934700 1 -- 172.21.15.146:0/1708216499 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978011830 con 0x7f09881335f0 2023-10-03T10:12:03.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.637+0000 7f098c934700 1 -- 172.21.15.146:0/1708216499 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0978011990 con 0x7f09881335f0 2023-10-03T10:12:03.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.637+0000 7f098c934700 1 -- 172.21.15.146:0/1708216499 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978011d20 con 0x7f09881335f0 2023-10-03T10:12:03.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.638+0000 7f098fb9a700 1 -- 172.21.15.146:0/1708216499 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09881335f0 msgr2=0x7f09881359d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.638+0000 7f098fb9a700 1 --2- 172.21.15.146:0/1708216499 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09881335f0 0x7f09881359d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0978009870 tx=0x7f0978009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:03.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.638+0000 7f098fb9a700 1 -- 172.21.15.146:0/1708216499 shutdown_connections 2023-10-03T10:12:03.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.638+0000 7f098fb9a700 1 --2- 172.21.15.146:0/1708216499 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0988135f10 0x7f09881382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.638+0000 7f098fb9a700 1 --2- 172.21.15.146:0/1708216499 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09881335f0 0x7f09881359d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.638+0000 7f098fb9a700 1 -- 172.21.15.146:0/1708216499 >> 172.21.15.146:0/1708216499 conn(0x7f09880a2980 msgr2=0x7f09880a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.638+0000 7f098fb9a700 1 -- 172.21.15.146:0/1708216499 shutdown_connections 2023-10-03T10:12:03.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.638+0000 7f098fb9a700 1 -- 172.21.15.146:0/1708216499 wait complete. 2023-10-03T10:12:03.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.639+0000 7f098fb9a700 1 Processor -- start 2023-10-03T10:12:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.639+0000 7f098fb9a700 1 -- start start 2023-10-03T10:12:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.639+0000 7f098fb9a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f098812d380 0x7f098812bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.639+0000 7f098fb9a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09881335f0 0x7f098812c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.639+0000 7f098fb9a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0988135f10 0x7f098806efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.639+0000 7f098fb9a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0988070b80 con 0x7f098812d380 2023-10-03T10:12:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.639+0000 7f098fb9a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098811dd50 con 0x7f0988135f10 2023-10-03T10:12:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.639+0000 7f098fb9a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0988071d10 con 0x7f09881335f0 2023-10-03T10:12:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.639+0000 7f098d135700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09881335f0 0x7f098812c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.639+0000 7f098d936700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f098812d380 0x7f098812bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.639+0000 7f098e137700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0988135f10 0x7f098806efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.639+0000 7f098d135700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09881335f0 0x7f098812c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46186/0 (socket says 172.21.15.146:46186) 2023-10-03T10:12:03.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.639+0000 7f098d135700 1 -- 172.21.15.146:0/1132351270 learned_addr learned my addr 172.21.15.146:0/1132351270 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:03.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.640+0000 7f098d135700 1 -- 172.21.15.146:0/1132351270 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0988135f10 msgr2=0x7f098806efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.640+0000 7f098d135700 1 --2- 172.21.15.146:0/1132351270 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0988135f10 0x7f098806efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.640+0000 7f098d135700 1 -- 172.21.15.146:0/1132351270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f098812d380 msgr2=0x7f098812bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.640+0000 7f098d135700 1 --2- 172.21.15.146:0/1132351270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f098812d380 0x7f098812bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.640+0000 7f098d135700 1 -- 172.21.15.146:0/1132351270 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0980009a70 con 0x7f09881335f0 2023-10-03T10:12:03.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.640+0000 7f098d936700 1 --2- 172.21.15.146:0/1132351270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f098812d380 0x7f098812bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:03.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.640+0000 7f098e137700 1 --2- 172.21.15.146:0/1132351270 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0988135f10 0x7f098806efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:03.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.640+0000 7f098d135700 1 --2- 172.21.15.146:0/1132351270 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09881335f0 0x7f098812c260 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f09780090b0 tx=0x7f0978004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.640+0000 7f097e7fc700 1 -- 172.21.15.146:0/1132351270 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09780044d0 con 0x7f09881335f0 2023-10-03T10:12:03.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.640+0000 7f097e7fc700 1 -- 172.21.15.146:0/1132351270 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097801f070 con 0x7f09881335f0 2023-10-03T10:12:03.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.640+0000 7f098fb9a700 1 -- 172.21.15.146:0/1132351270 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09780094a0 con 0x7f09881335f0 2023-10-03T10:12:03.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.640+0000 7f097e7fc700 1 -- 172.21.15.146:0/1132351270 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09780038c0 con 0x7f09881335f0 2023-10-03T10:12:03.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.640+0000 7f098fb9a700 1 -- 172.21.15.146:0/1132351270 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09881326d0 con 0x7f09881335f0 2023-10-03T10:12:03.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.641+0000 7f097e7fc700 1 -- 172.21.15.146:0/1132351270 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0978003a20 con 0x7f09881335f0 2023-10-03T10:12:03.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.641+0000 7f097e7fc700 1 -- 172.21.15.146:0/1132351270 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f0978021070 con 0x7f09881335f0 2023-10-03T10:12:03.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.641+0000 7f098fb9a700 1 -- 172.21.15.146:0/1132351270 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098804f2a0 con 0x7f09881335f0 2023-10-03T10:12:03.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.646+0000 7f097e7fc700 1 -- 172.21.15.146:0/1132351270 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0978010380 con 0x7f09881335f0 2023-10-03T10:12:03.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:03.842+0000 7f098fb9a700 1 -- 172.21.15.146:0/1132351270 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) v1 -- 0x7f0988071340 con 0x7f09881335f0 2023-10-03T10:12:03.843 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-03T10:12:03.843+0000 7fc745fb7700 -1 mon.a@0(leader).osd e24 definitely_dead 0 2023-10-03T10:12:04.038 INFO:tasks.ceph.osd.1.smithi146.stderr:2023-10-03T10:12:04.037+0000 7f0003930680 -1 Falling back to public interface 2023-10-03T10:12:04.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.429+0000 7f097e7fc700 1 -- 172.21.15.146:0/1132351270 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v25) v1 ==== 89+0+0 (secure 0 0 0) 0x7f0978024b70 con 0x7f09881335f0 2023-10-03T10:12:04.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.433+0000 7f098fb9a700 1 -- 172.21.15.146:0/1132351270 >> v1:172.21.15.146:6816/126749 conn(0x7f096c02f510 legacy=0x7f096c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.433+0000 7f098fb9a700 1 -- 172.21.15.146:0/1132351270 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09881335f0 msgr2=0x7f098812c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.433+0000 7f098fb9a700 1 --2- 172.21.15.146:0/1132351270 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09881335f0 0x7f098812c260 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f09780090b0 tx=0x7f0978004750 comp rx=0 tx=0).stop 2023-10-03T10:12:04.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.433+0000 7f098fb9a700 1 -- 172.21.15.146:0/1132351270 shutdown_connections 2023-10-03T10:12:04.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.433+0000 7f098fb9a700 1 --2- 172.21.15.146:0/1132351270 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0988135f10 0x7f098806efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.433+0000 7f098fb9a700 1 --2- 172.21.15.146:0/1132351270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f098812d380 0x7f098812bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.433+0000 7f098fb9a700 1 --2- 172.21.15.146:0/1132351270 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09881335f0 0x7f098812c260 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.433+0000 7f098fb9a700 1 -- 172.21.15.146:0/1132351270 >> 172.21.15.146:0/1132351270 conn(0x7f09880a2980 msgr2=0x7f098809f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:04.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.434+0000 7f098fb9a700 1 -- 172.21.15.146:0/1132351270 shutdown_connections 2023-10-03T10:12:04.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.434+0000 7f098fb9a700 1 -- 172.21.15.146:0/1132351270 wait complete. 2023-10-03T10:12:04.438 INFO:teuthology.orchestra.run.smithi146.stderr:marked down osd.2. 2023-10-03T10:12:04.450 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-03T10:12:04.450 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-03T10:12:04.453 INFO:tasks.ceph.osd.2:Started 2023-10-03T10:12:04.453 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-03T10:12:04.453 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:04.484 INFO:tasks.ceph.osd.3:Stopped 2023-10-03T10:12:04.485 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2023-10-03T10:12:04.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.648+0000 7fc8e12b2700 1 Processor -- start 2023-10-03T10:12:04.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.648+0000 7fc8e12b2700 1 -- start start 2023-10-03T10:12:04.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.648+0000 7fc8e12b2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8dc09e870 0x7fc8dc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.648+0000 7fc8e12b2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8dc09f180 0x7fc8dc133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.648+0000 7fc8e12b2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8dc134160 0x7fc8dc134600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.648+0000 7fc8e12b2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8dc0a0370 con 0x7fc8dc134160 2023-10-03T10:12:04.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.648+0000 7fc8e12b2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc09fa00 con 0x7fc8dc09f180 2023-10-03T10:12:04.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.648+0000 7fc8e12b2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc09ada0 con 0x7fc8dc09e870 2023-10-03T10:12:04.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.648+0000 7fc8db7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8dc134160 0x7fc8dc134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.648+0000 7fc8da7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8dc09f180 0x7fc8dc133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.648+0000 7fc8daffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8dc09e870 0x7fc8dc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.648+0000 7fc8da7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8dc09f180 0x7fc8dc133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49636/0 (socket says 172.21.15.146:49636) 2023-10-03T10:12:04.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.648+0000 7fc8daffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8dc09e870 0x7fc8dc09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45704/0 (socket says 172.21.15.146:45704) 2023-10-03T10:12:04.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.648+0000 7fc8db7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8dc134160 0x7fc8dc134600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38800/0 (socket says 172.21.15.146:38800) 2023-10-03T10:12:04.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.648+0000 7fc8da7fc700 1 -- 172.21.15.146:0/3298666423 learned_addr learned my addr 172.21.15.146:0/3298666423 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:04.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.648+0000 7fc8db7fe700 1 -- 172.21.15.146:0/3298666423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8dc09e870 msgr2=0x7fc8dc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:04.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.649+0000 7fc8db7fe700 1 --2- 172.21.15.146:0/3298666423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8dc09e870 0x7fc8dc09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.649+0000 7fc8db7fe700 1 -- 172.21.15.146:0/3298666423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8dc09f180 msgr2=0x7fc8dc133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:04.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.649+0000 7fc8db7fe700 1 --2- 172.21.15.146:0/3298666423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8dc09f180 0x7fc8dc133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.649+0000 7fc8db7fe700 1 -- 172.21.15.146:0/3298666423 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc06bec0 con 0x7fc8dc134160 2023-10-03T10:12:04.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.649+0000 7fc8da7fc700 1 --2- 172.21.15.146:0/3298666423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8dc09f180 0x7fc8dc133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:04.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.649+0000 7fc8db7fe700 1 --2- 172.21.15.146:0/3298666423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8dc134160 0x7fc8dc134600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4009d90 tx=0x7fc8d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b941186adc529b25 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:04.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.649+0000 7fc8d9ffb700 1 -- 172.21.15.146:0/3298666423 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d400e070 con 0x7fc8dc134160 2023-10-03T10:12:04.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.649+0000 7fc8d9ffb700 1 -- 172.21.15.146:0/3298666423 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d400bb20 con 0x7fc8dc134160 2023-10-03T10:12:04.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.649+0000 7fc8d9ffb700 1 -- 172.21.15.146:0/3298666423 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4012430 con 0x7fc8dc134160 2023-10-03T10:12:04.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.649+0000 7fc8e12b2700 1 -- 172.21.15.146:0/3298666423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8dc134160 msgr2=0x7fc8dc134600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.649+0000 7fc8e12b2700 1 --2- 172.21.15.146:0/3298666423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8dc134160 0x7fc8dc134600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4009d90 tx=0x7fc8d400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:04.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.649+0000 7fc8e12b2700 1 -- 172.21.15.146:0/3298666423 shutdown_connections 2023-10-03T10:12:04.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.649+0000 7fc8e12b2700 1 --2- 172.21.15.146:0/3298666423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8dc134160 0x7fc8dc134600 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.649+0000 7fc8e12b2700 1 --2- 172.21.15.146:0/3298666423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8dc09e870 0x7fc8dc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.649+0000 7fc8e12b2700 1 --2- 172.21.15.146:0/3298666423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8dc09f180 0x7fc8dc133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.649+0000 7fc8e12b2700 1 -- 172.21.15.146:0/3298666423 >> 172.21.15.146:0/3298666423 conn(0x7fc8dc0a4430 msgr2=0x7fc8dc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:04.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.649+0000 7fc8e12b2700 1 -- 172.21.15.146:0/3298666423 shutdown_connections 2023-10-03T10:12:04.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.649+0000 7fc8e12b2700 1 -- 172.21.15.146:0/3298666423 wait complete. 2023-10-03T10:12:04.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.650+0000 7fc8e12b2700 1 Processor -- start 2023-10-03T10:12:04.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.651+0000 7fc8e12b2700 1 -- start start 2023-10-03T10:12:04.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.651+0000 7fc8e12b2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8dc09e870 0x7fc8dc1225c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.651+0000 7fc8e12b2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8dc09f180 0x7fc8dc122b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.651+0000 7fc8e12b2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8dc134160 0x7fc8dc123040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.651+0000 7fc8e12b2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc1260e0 con 0x7fc8dc09e870 2023-10-03T10:12:04.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.651+0000 7fc8e12b2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc125080 con 0x7fc8dc09f180 2023-10-03T10:12:04.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.651+0000 7fc8e12b2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc125bd0 con 0x7fc8dc134160 2023-10-03T10:12:04.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.651+0000 7fc8da7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8dc09f180 0x7fc8dc122b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.651+0000 7fc8db7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8dc134160 0x7fc8dc123040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.651+0000 7fc8daffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8dc09e870 0x7fc8dc1225c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.651+0000 7fc8da7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8dc09f180 0x7fc8dc122b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49642/0 (socket says 172.21.15.146:49642) 2023-10-03T10:12:04.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.651+0000 7fc8da7fc700 1 -- 172.21.15.146:0/162383077 learned_addr learned my addr 172.21.15.146:0/162383077 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:04.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.651+0000 7fc8da7fc700 1 -- 172.21.15.146:0/162383077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8dc134160 msgr2=0x7fc8dc123040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.651+0000 7fc8da7fc700 1 --2- 172.21.15.146:0/162383077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8dc134160 0x7fc8dc123040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.651+0000 7fc8da7fc700 1 -- 172.21.15.146:0/162383077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8dc09e870 msgr2=0x7fc8dc1225c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.651+0000 7fc8da7fc700 1 --2- 172.21.15.146:0/162383077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8dc09e870 0x7fc8dc1225c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.651+0000 7fc8da7fc700 1 -- 172.21.15.146:0/162383077 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8cc009550 con 0x7fc8dc09f180 2023-10-03T10:12:04.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.651+0000 7fc8db7fe700 1 --2- 172.21.15.146:0/162383077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8dc134160 0x7fc8dc123040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:04.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.651+0000 7fc8daffd700 1 --2- 172.21.15.146:0/162383077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8dc09e870 0x7fc8dc1225c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:04.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.651+0000 7fc8da7fc700 1 --2- 172.21.15.146:0/162383077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8dc09f180 0x7fc8dc122b00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00ec10 tx=0x7fc8cc00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:04.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.652+0000 7fc8c37fe700 1 -- 172.21.15.146:0/162383077 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc00c850 con 0x7fc8dc09f180 2023-10-03T10:12:04.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.652+0000 7fc8c37fe700 1 -- 172.21.15.146:0/162383077 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8cc00c9b0 con 0x7fc8dc09f180 2023-10-03T10:12:04.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.652+0000 7fc8e12b2700 1 -- 172.21.15.146:0/162383077 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d4009a70 con 0x7fc8dc09f180 2023-10-03T10:12:04.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.652+0000 7fc8c37fe700 1 -- 172.21.15.146:0/162383077 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc00cd60 con 0x7fc8dc09f180 2023-10-03T10:12:04.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.652+0000 7fc8e12b2700 1 -- 172.21.15.146:0/162383077 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8dc133990 con 0x7fc8dc09f180 2023-10-03T10:12:04.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.652+0000 7fc8c37fe700 1 -- 172.21.15.146:0/162383077 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc8cc013470 con 0x7fc8dc09f180 2023-10-03T10:12:04.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.653+0000 7fc8c37fe700 1 -- 172.21.15.146:0/162383077 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fc8cc03fc00 con 0x7fc8dc09f180 2023-10-03T10:12:04.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.653+0000 7fc8e12b2700 1 -- 172.21.15.146:0/162383077 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8dc06feb0 con 0x7fc8dc09f180 2023-10-03T10:12:04.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.657+0000 7fc8c37fe700 1 -- 172.21.15.146:0/162383077 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8cc0232f0 con 0x7fc8dc09f180 2023-10-03T10:12:04.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:04.852+0000 7fc8e12b2700 1 -- 172.21.15.146:0/162383077 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) v1 -- 0x7fc8dc04f2a0 con 0x7fc8dc09f180 2023-10-03T10:12:04.854 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-03T10:12:04.853+0000 7fc745fb7700 -1 mon.a@0(leader).osd e25 definitely_dead 0 2023-10-03T10:12:05.045 INFO:tasks.ceph.osd.2.smithi146.stderr:2023-10-03T10:12:05.044+0000 7f8c91ca9680 -1 Falling back to public interface 2023-10-03T10:12:05.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.433+0000 7fc8c37fe700 1 -- 172.21.15.146:0/162383077 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v26) v1 ==== 89+0+0 (secure 0 0 0) 0x7fc8cc01bb50 con 0x7fc8dc09f180 2023-10-03T10:12:05.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.435+0000 7fc8e12b2700 1 -- 172.21.15.146:0/162383077 >> v1:172.21.15.146:6816/126749 conn(0x7fc8c802f510 legacy=0x7fc8c80319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.435+0000 7fc8e12b2700 1 -- 172.21.15.146:0/162383077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8dc09f180 msgr2=0x7fc8dc122b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.435+0000 7fc8e12b2700 1 --2- 172.21.15.146:0/162383077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8dc09f180 0x7fc8dc122b00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00ec10 tx=0x7fc8cc00ef20 comp rx=0 tx=0).stop 2023-10-03T10:12:05.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.435+0000 7fc8e12b2700 1 -- 172.21.15.146:0/162383077 shutdown_connections 2023-10-03T10:12:05.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.435+0000 7fc8e12b2700 1 --2- 172.21.15.146:0/162383077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8dc134160 0x7fc8dc123040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.435+0000 7fc8e12b2700 1 --2- 172.21.15.146:0/162383077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8dc09e870 0x7fc8dc1225c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.435+0000 7fc8e12b2700 1 --2- 172.21.15.146:0/162383077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8dc09f180 0x7fc8dc122b00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.435+0000 7fc8e12b2700 1 -- 172.21.15.146:0/162383077 >> 172.21.15.146:0/162383077 conn(0x7fc8dc0a4430 msgr2=0x7fc8dc072480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:05.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.435+0000 7fc8e12b2700 1 -- 172.21.15.146:0/162383077 shutdown_connections 2023-10-03T10:12:05.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.435+0000 7fc8e12b2700 1 -- 172.21.15.146:0/162383077 wait complete. 2023-10-03T10:12:05.437 INFO:teuthology.orchestra.run.smithi146.stderr:marked down osd.3. 2023-10-03T10:12:05.449 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-03T10:12:05.449 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-03T10:12:05.451 INFO:tasks.ceph.osd.3:Started 2023-10-03T10:12:05.451 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:12:05.452 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:05.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.576+0000 7f7fa84b7700 1 Processor -- start 2023-10-03T10:12:05.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.576+0000 7f7fa84b7700 1 -- start start 2023-10-03T10:12:05.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.577+0000 7f7fa84b7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7fa0133ad0 0x7f7fa0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.577+0000 7f7fa84b7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7fa01300a0 0x7f7fa01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.577+0000 7f7fa84b7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa006b2d0 con 0x7f7fa01309f0 2023-10-03T10:12:05.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.577+0000 7f7fa84b7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa0133610 con 0x7f7fa01300a0 2023-10-03T10:12:05.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.577+0000 7f7fa84b7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa009a500 con 0x7f7fa0133ad0 2023-10-03T10:12:05.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.577+0000 7f7fa5a52700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7fa01300a0 0x7f7fa01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.577+0000 7f7fa6253700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7fa0133ad0 0x7f7fa0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.577+0000 7f7fa6a54700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7fa01309f0 0x7f7fa013a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44876/0 (socket says 172.21.15.146:44876) 2023-10-03T10:12:05.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.577+0000 7f7fa6a54700 1 -- 172.21.15.146:0/1846973873 learned_addr learned my addr 172.21.15.146:0/1846973873 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:05.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.577+0000 7f7fa6253700 1 -- 172.21.15.146:0/1846973873 >> v2:172.21.15.146:3300/0 conn(0x7f7fa01300a0 msgr2=0x7f7fa01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:05.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.577+0000 7f7fa6253700 1 --2- 172.21.15.146:0/1846973873 >> v2:172.21.15.146:3300/0 conn(0x7f7fa01300a0 0x7f7fa01304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.577+0000 7f7fa6253700 1 -- 172.21.15.146:0/1846973873 >> v1:172.21.15.146:6789/0 conn(0x7f7fa01309f0 legacy=0x7f7fa013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.577+0000 7f7fa6253700 1 -- 172.21.15.146:0/1846973873 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa01338b0 con 0x7f7fa0133ad0 2023-10-03T10:12:05.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.577+0000 7f7fa5a52700 1 --2- 172.21.15.146:0/1846973873 >> v2:172.21.15.146:3300/0 conn(0x7f7fa01300a0 0x7f7fa01304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:05.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.578+0000 7f7fa6253700 1 --2- 172.21.15.146:0/1846973873 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7fa0133ad0 0x7f7fa0133ea0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009840 tx=0x7f7f90009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6df870deeb947682 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:05.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.578+0000 7f7fa5251700 1 -- 172.21.15.146:0/1846973873 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f90011830 con 0x7f7fa0133ad0 2023-10-03T10:12:05.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.578+0000 7f7fa5251700 1 -- 172.21.15.146:0/1846973873 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f90011990 con 0x7f7fa0133ad0 2023-10-03T10:12:05.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.578+0000 7f7fa5251700 1 -- 172.21.15.146:0/1846973873 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f90011d20 con 0x7f7fa0133ad0 2023-10-03T10:12:05.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.578+0000 7f7fa84b7700 1 -- 172.21.15.146:0/1846973873 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7fa0133ad0 msgr2=0x7f7fa0133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.578+0000 7f7fa84b7700 1 --2- 172.21.15.146:0/1846973873 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7fa0133ad0 0x7f7fa0133ea0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009840 tx=0x7f7f90009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:05.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.578+0000 7f7fa84b7700 1 -- 172.21.15.146:0/1846973873 shutdown_connections 2023-10-03T10:12:05.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.578+0000 7f7fa84b7700 1 --2- 172.21.15.146:0/1846973873 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7fa0133ad0 0x7f7fa0133ea0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.578+0000 7f7fa84b7700 1 --2- 172.21.15.146:0/1846973873 >> v2:172.21.15.146:3300/0 conn(0x7f7fa01300a0 0x7f7fa01304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.578+0000 7f7fa84b7700 1 -- 172.21.15.146:0/1846973873 >> 172.21.15.146:0/1846973873 conn(0x7f7fa0099c40 msgr2=0x7f7fa00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:05.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.578+0000 7f7fa84b7700 1 -- 172.21.15.146:0/1846973873 shutdown_connections 2023-10-03T10:12:05.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.578+0000 7f7fa84b7700 1 -- 172.21.15.146:0/1846973873 wait complete. 2023-10-03T10:12:05.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.580+0000 7f7fa84b7700 1 Processor -- start 2023-10-03T10:12:05.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.580+0000 7f7fa84b7700 1 -- start start 2023-10-03T10:12:05.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.580+0000 7f7fa84b7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fa01300a0 0x7f7fa011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.580+0000 7f7fa84b7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fa01309f0 0x7f7fa011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.580+0000 7f7fa84b7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7fa0133ad0 0x7f7fa011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:05.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.580+0000 7f7fa84b7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa01200c0 con 0x7f7fa01309f0 2023-10-03T10:12:05.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.580+0000 7f7fa84b7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa011fb20 con 0x7f7fa01300a0 2023-10-03T10:12:05.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.580+0000 7f7fa84b7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa011f040 con 0x7f7fa0133ad0 2023-10-03T10:12:05.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.580+0000 7f7fa6253700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fa01300a0 0x7f7fa011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.580+0000 7f7fa5a52700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fa01309f0 0x7f7fa011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.580+0000 7f7fa6253700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fa01300a0 0x7f7fa011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49646/0 (socket says 172.21.15.146:49646) 2023-10-03T10:12:05.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.580+0000 7f7fa6253700 1 -- 172.21.15.146:0/4043202195 learned_addr learned my addr 172.21.15.146:0/4043202195 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:05.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.580+0000 7f7fa6a54700 1 --2- 172.21.15.146:0/4043202195 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7fa0133ad0 0x7f7fa011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:05.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.581+0000 7f7fa5a52700 1 -- 172.21.15.146:0/4043202195 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7fa0133ad0 msgr2=0x7f7fa011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.581+0000 7f7fa5a52700 1 --2- 172.21.15.146:0/4043202195 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7fa0133ad0 0x7f7fa011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.581+0000 7f7fa5a52700 1 -- 172.21.15.146:0/4043202195 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fa01300a0 msgr2=0x7f7fa011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.581+0000 7f7fa5a52700 1 --2- 172.21.15.146:0/4043202195 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fa01300a0 0x7f7fa011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.581+0000 7f7fa5a52700 1 -- 172.21.15.146:0/4043202195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9c0094a0 con 0x7f7fa01309f0 2023-10-03T10:12:05.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.581+0000 7f7fa5a52700 1 --2- 172.21.15.146:0/4043202195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fa01309f0 0x7f7fa011df80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00e9b0 tx=0x7f7f9c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:05.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.581+0000 7f7f96ffd700 1 -- 172.21.15.146:0/4043202195 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c00ee50 con 0x7f7fa01309f0 2023-10-03T10:12:05.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.581+0000 7f7f96ffd700 1 -- 172.21.15.146:0/4043202195 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9c00c850 con 0x7f7fa01309f0 2023-10-03T10:12:05.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.581+0000 7f7f96ffd700 1 -- 172.21.15.146:0/4043202195 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c00cbe0 con 0x7f7fa01309f0 2023-10-03T10:12:05.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.581+0000 7f7fa84b7700 1 -- 172.21.15.146:0/4043202195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f900094a0 con 0x7f7fa01309f0 2023-10-03T10:12:05.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.581+0000 7f7fa84b7700 1 -- 172.21.15.146:0/4043202195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa012dd00 con 0x7f7fa01309f0 2023-10-03T10:12:05.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.582+0000 7f7f96ffd700 1 -- 172.21.15.146:0/4043202195 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7f9c00cd40 con 0x7f7fa01309f0 2023-10-03T10:12:05.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.582+0000 7f7f96ffd700 1 -- 172.21.15.146:0/4043202195 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f7f9c03fbe0 con 0x7f7fa01309f0 2023-10-03T10:12:05.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.582+0000 7f7fa84b7700 1 -- 172.21.15.146:0/4043202195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa011f400 con 0x7f7fa01309f0 2023-10-03T10:12:05.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.587+0000 7f7f96ffd700 1 -- 172.21.15.146:0/4043202195 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f9c021020 con 0x7f7fa01309f0 2023-10-03T10:12:05.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.779+0000 7f7fa84b7700 1 -- 172.21.15.146:0/4043202195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fa004f2a0 con 0x7f7fa01309f0 2023-10-03T10:12:05.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.780+0000 7f7f96ffd700 1 -- 172.21.15.146:0/4043202195 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+11981 (secure 0 0 0) 0x7f7f9c01be10 con 0x7f7fa01309f0 2023-10-03T10:12:05.781 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:12:05.781 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":26,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:12:05.426236+0000","last_up_change":"2023-10-03T10:12:05.426236+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":118758}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":118758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":118758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":118758}]},"public_addr":"172.21.15.146:6800/118758","cluster_addr":"172.21.15.146:6801/118758","heartbeat_back_addr":"172.21.15.146:6803/118758","heartbeat_front_addr":"172.21.15.146:6802/118758","state":["exists"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":118774}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":118774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":118774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":118774}]},"public_addr":"172.21.15.146:6804/118774","cluster_addr":"172.21.15.146:6806/118774","heartbeat_back_addr":"172.21.15.146:6810/118774","heartbeat_front_addr":"172.21.15.146:6808/118774","state":["exists"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":118775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":118775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":118775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":118775}]},"public_addr":"172.21.15.146:6805/118775","cluster_addr":"172.21.15.146:6807/118775","heartbeat_back_addr":"172.21.15.146:6811/118775","heartbeat_front_addr":"172.21.15.146:6809/118775","state":["exists"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":118776}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":118776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":118776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":118776}]},"public_addr":"172.21.15.146:6812/118776","cluster_addr":"172.21.15.146:6813/118776","heartbeat_back_addr":"172.21.15.146:6815/118776","heartbeat_front_addr":"172.21.15.146:6814/118776","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":25},{"osd":3,"down_stamp":"2023-10-03T10:12:05.426236+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:0/45915595":"2023-10-04T10:11:52.317723+0000","172.21.15.146:0/1896339219":"2023-10-04T10:11:52.317723+0000","172.21.15.146:6816/118159":"2023-10-04T10:11:52.317723+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:05.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.783+0000 7f7fa84b7700 1 -- 172.21.15.146:0/4043202195 >> v1:172.21.15.146:6816/126749 conn(0x7f7f8402f510 legacy=0x7f7f840319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.783+0000 7f7fa84b7700 1 -- 172.21.15.146:0/4043202195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fa01309f0 msgr2=0x7f7fa011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.783+0000 7f7fa84b7700 1 --2- 172.21.15.146:0/4043202195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fa01309f0 0x7f7fa011df80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00e9b0 tx=0x7f7f9c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.783+0000 7f7fa84b7700 1 -- 172.21.15.146:0/4043202195 shutdown_connections 2023-10-03T10:12:05.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.783+0000 7f7fa84b7700 1 --2- 172.21.15.146:0/4043202195 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7fa0133ad0 0x7f7fa011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.783+0000 7f7fa84b7700 1 --2- 172.21.15.146:0/4043202195 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fa01300a0 0x7f7fa011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.783+0000 7f7fa84b7700 1 --2- 172.21.15.146:0/4043202195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fa01309f0 0x7f7fa011df80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.783+0000 7f7fa84b7700 1 -- 172.21.15.146:0/4043202195 >> 172.21.15.146:0/4043202195 conn(0x7f7fa0099c40 msgr2=0x7f7fa01320b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:05.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.783+0000 7f7fa84b7700 1 -- 172.21.15.146:0/4043202195 shutdown_connections 2023-10-03T10:12:05.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:05.783+0000 7f7fa84b7700 1 -- 172.21.15.146:0/4043202195 wait complete. 2023-10-03T10:12:06.047 INFO:tasks.ceph.osd.3.smithi146.stderr:2023-10-03T10:12:06.046+0000 7f6d77fc2680 -1 Falling back to public interface 2023-10-03T10:12:06.797 INFO:tasks.ceph.osd.0.smithi146.stderr:2023-10-03T10:12:06.797+0000 7faea6f71680 -1 osd.0 22 log_to_monitors true 2023-10-03T10:12:07.867 INFO:tasks.ceph.osd.1.smithi146.stderr:2023-10-03T10:12:07.866+0000 7f0003930680 -1 osd.1 22 log_to_monitors true 2023-10-03T10:12:08.324 INFO:tasks.ceph.osd.0.smithi146.stderr:2023-10-03T10:12:08.323+0000 7fae92eec700 -1 osd.0 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:12:08.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-10-03T10:12:08.802 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:08.853 INFO:tasks.ceph.osd.2.smithi146.stderr:2023-10-03T10:12:08.853+0000 7f8c91ca9680 -1 osd.2 24 log_to_monitors true 2023-10-03T10:12:08.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.959+0000 7f6ca68e4700 1 Processor -- start 2023-10-03T10:12:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.959+0000 7f6ca68e4700 1 -- start start 2023-10-03T10:12:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.960+0000 7f6ca68e4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ca0138040 0x7f6ca0138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.960+0000 7f6ca68e4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ca00a1400 0x7f6ca013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.960+0000 7f6ca68e4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca01379e0 con 0x7f6ca00a08e0 2023-10-03T10:12:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.960+0000 7f6ca68e4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00a2100 con 0x7f6ca00a1400 2023-10-03T10:12:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.960+0000 7f6ca68e4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca0138950 con 0x7f6ca0138040 2023-10-03T10:12:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.960+0000 7f6c9f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6ca00a08e0 0x7f6ca00a0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44918/0 (socket says 172.21.15.146:44918) 2023-10-03T10:12:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.960+0000 7f6c9f7fe700 1 -- 172.21.15.146:0/3710960610 learned_addr learned my addr 172.21.15.146:0/3710960610 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.960+0000 7f6c9ffff700 1 --2- 172.21.15.146:0/3710960610 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ca0138040 0x7f6ca0138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.961+0000 7f6ca4e81700 1 --2- 172.21.15.146:0/3710960610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ca00a1400 0x7f6ca013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.961+0000 7f6c9ffff700 1 -- 172.21.15.146:0/3710960610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ca00a1400 msgr2=0x7f6ca013fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.961+0000 7f6c9ffff700 1 --2- 172.21.15.146:0/3710960610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ca00a1400 0x7f6ca013fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.961+0000 7f6c9ffff700 1 -- 172.21.15.146:0/3710960610 >> v1:172.21.15.146:6789/0 conn(0x7f6ca00a08e0 legacy=0x7f6ca00a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.961+0000 7f6c9ffff700 1 -- 172.21.15.146:0/3710960610 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca009b9b0 con 0x7f6ca0138040 2023-10-03T10:12:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.961+0000 7f6c9ffff700 1 --2- 172.21.15.146:0/3710960610 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ca0138040 0x7f6ca0138410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009880 tx=0x7f6c90009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6827a64065b970 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.961+0000 7f6c9effd700 1 -- 172.21.15.146:0/3710960610 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90005e30 con 0x7f6ca0138040 2023-10-03T10:12:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.961+0000 7f6c9effd700 1 -- 172.21.15.146:0/3710960610 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c90006030 con 0x7f6ca0138040 2023-10-03T10:12:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.961+0000 7f6c9effd700 1 -- 172.21.15.146:0/3710960610 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900063c0 con 0x7f6ca0138040 2023-10-03T10:12:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.962+0000 7f6ca68e4700 1 -- 172.21.15.146:0/3710960610 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ca0138040 msgr2=0x7f6ca0138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.962+0000 7f6ca68e4700 1 --2- 172.21.15.146:0/3710960610 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ca0138040 0x7f6ca0138410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009880 tx=0x7f6c90009b90 comp rx=0 tx=0).stop 2023-10-03T10:12:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.962+0000 7f6ca68e4700 1 -- 172.21.15.146:0/3710960610 shutdown_connections 2023-10-03T10:12:08.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.962+0000 7f6ca68e4700 1 --2- 172.21.15.146:0/3710960610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ca00a1400 0x7f6ca013fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.962+0000 7f6ca68e4700 1 --2- 172.21.15.146:0/3710960610 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ca0138040 0x7f6ca0138410 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.962+0000 7f6ca68e4700 1 -- 172.21.15.146:0/3710960610 >> 172.21.15.146:0/3710960610 conn(0x7f6ca00a2980 msgr2=0x7f6ca00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:08.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.962+0000 7f6ca68e4700 1 -- 172.21.15.146:0/3710960610 shutdown_connections 2023-10-03T10:12:08.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.962+0000 7f6ca68e4700 1 -- 172.21.15.146:0/3710960610 wait complete. 2023-10-03T10:12:08.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.963+0000 7f6ca68e4700 1 Processor -- start 2023-10-03T10:12:08.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.964+0000 7f6ca68e4700 1 -- start start 2023-10-03T10:12:08.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.964+0000 7f6ca68e4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ca00a08e0 0x7f6ca013e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.964+0000 7f6ca68e4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ca00a1400 0x7f6ca01359c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.964+0000 7f6ca68e4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ca0138040 0x7f6ca0135f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.964+0000 7f6ca68e4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca01372b0 con 0x7f6ca00a1400 2023-10-03T10:12:08.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.964+0000 7f6ca68e4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca0132220 con 0x7f6ca00a08e0 2023-10-03T10:12:08.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.964+0000 7f6ca68e4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca01403a0 con 0x7f6ca0138040 2023-10-03T10:12:08.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.964+0000 7f6c9ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ca00a08e0 0x7f6ca013e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.964+0000 7f6c9ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ca00a08e0 0x7f6ca013e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49660/0 (socket says 172.21.15.146:49660) 2023-10-03T10:12:08.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.964+0000 7f6c9ffff700 1 -- 172.21.15.146:0/3996287540 learned_addr learned my addr 172.21.15.146:0/3996287540 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:08.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.964+0000 7f6ca4e81700 1 --2- 172.21.15.146:0/3996287540 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ca0138040 0x7f6ca0135f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.964+0000 7f6c9f7fe700 1 --2- 172.21.15.146:0/3996287540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ca00a1400 0x7f6ca01359c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.964+0000 7f6c9ffff700 1 -- 172.21.15.146:0/3996287540 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ca0138040 msgr2=0x7f6ca0135f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.965+0000 7f6c9ffff700 1 --2- 172.21.15.146:0/3996287540 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ca0138040 0x7f6ca0135f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.965+0000 7f6c9ffff700 1 -- 172.21.15.146:0/3996287540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ca00a1400 msgr2=0x7f6ca01359c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.965+0000 7f6c9ffff700 1 --2- 172.21.15.146:0/3996287540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ca00a1400 0x7f6ca01359c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.965+0000 7f6c9ffff700 1 -- 172.21.15.146:0/3996287540 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c90009430 con 0x7f6ca00a08e0 2023-10-03T10:12:08.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.965+0000 7f6c9f7fe700 1 --2- 172.21.15.146:0/3996287540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ca00a1400 0x7f6ca01359c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:08.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.965+0000 7f6ca4e81700 1 --2- 172.21.15.146:0/3996287540 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ca0138040 0x7f6ca0135f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:08.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.965+0000 7f6c9ffff700 1 --2- 172.21.15.146:0/3996287540 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ca00a08e0 0x7f6ca013e600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6c90000c00 tx=0x7f6c90004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:08.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.965+0000 7f6c9cff9700 1 -- 172.21.15.146:0/3996287540 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9001b840 con 0x7f6ca00a08e0 2023-10-03T10:12:08.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.965+0000 7f6c9cff9700 1 -- 172.21.15.146:0/3996287540 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c900063b0 con 0x7f6ca00a08e0 2023-10-03T10:12:08.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.965+0000 7f6ca68e4700 1 -- 172.21.15.146:0/3996287540 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca0118e90 con 0x7f6ca00a08e0 2023-10-03T10:12:08.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.965+0000 7f6c9cff9700 1 -- 172.21.15.146:0/3996287540 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9001bbe0 con 0x7f6ca00a08e0 2023-10-03T10:12:08.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.965+0000 7f6ca68e4700 1 -- 172.21.15.146:0/3996287540 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca0119150 con 0x7f6ca00a08e0 2023-10-03T10:12:08.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.966+0000 7f6ca68e4700 1 -- 172.21.15.146:0/3996287540 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c800052e0 con 0x7f6ca00a08e0 2023-10-03T10:12:08.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.967+0000 7f6c9cff9700 1 -- 172.21.15.146:0/3996287540 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6c90022070 con 0x7f6ca00a08e0 2023-10-03T10:12:08.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.967+0000 7f6c9cff9700 1 -- 172.21.15.146:0/3996287540 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4049+0+0 (secure 0 0 0) 0x7f6c900416f0 con 0x7f6ca00a08e0 2023-10-03T10:12:08.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:08.972+0000 7f6c9cff9700 1 -- 172.21.15.146:0/3996287540 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c90006b70 con 0x7f6ca00a08e0 2023-10-03T10:12:09.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:09.217+0000 7f6ca68e4700 1 -- 172.21.15.146:0/3996287540 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c80005860 con 0x7f6ca00a08e0 2023-10-03T10:12:09.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:09.218+0000 7f6c9cff9700 1 -- 172.21.15.146:0/3996287540 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12769 (secure 0 0 0) 0x7f6c9000bb90 con 0x7f6ca00a08e0 2023-10-03T10:12:09.219 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:12:09.219 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":28,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:12:08.436521+0000","last_up_change":"2023-10-03T10:12:08.436521+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.25,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"error_message":"pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.0), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"error_message":"pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.0), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"error_message":"pool 4 has some PGs where all OSDs are with primary_affinity 0 (at least pg 4.0), read balance score may not be reliable","score_acting":0,"score_stable":0}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":18,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":129317}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":129317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":129317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":129317}]},"public_addr":"172.21.15.146:6800/129317","cluster_addr":"172.21.15.146:6801/129317","heartbeat_back_addr":"172.21.15.146:6803/129317","heartbeat_front_addr":"172.21.15.146:6802/129317","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":118774}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":118774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":118774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":118774}]},"public_addr":"172.21.15.146:6804/118774","cluster_addr":"172.21.15.146:6806/118774","heartbeat_back_addr":"172.21.15.146:6810/118774","heartbeat_front_addr":"172.21.15.146:6808/118774","state":["exists"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":118775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":118775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":118775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":118775}]},"public_addr":"172.21.15.146:6805/118775","cluster_addr":"172.21.15.146:6807/118775","heartbeat_back_addr":"172.21.15.146:6811/118775","heartbeat_front_addr":"172.21.15.146:6809/118775","state":["exists"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":118776}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":118776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":118776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":118776}]},"public_addr":"172.21.15.146:6812/118776","cluster_addr":"172.21.15.146:6813/118776","heartbeat_back_addr":"172.21.15.146:6815/118776","heartbeat_front_addr":"172.21.15.146:6814/118776","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":25},{"osd":3,"down_stamp":"2023-10-03T10:12:05.426236+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:0/45915595":"2023-10-04T10:11:52.317723+0000","172.21.15.146:0/1896339219":"2023-10-04T10:11:52.317723+0000","172.21.15.146:6816/118159":"2023-10-04T10:11:52.317723+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:09.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:09.220+0000 7f6ca68e4700 1 -- 172.21.15.146:0/3996287540 >> v1:172.21.15.146:6816/126749 conn(0x7f6c8c02f510 legacy=0x7f6c8c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:09.220+0000 7f6ca68e4700 1 -- 172.21.15.146:0/3996287540 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ca00a08e0 msgr2=0x7f6ca013e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:09.220+0000 7f6ca68e4700 1 --2- 172.21.15.146:0/3996287540 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ca00a08e0 0x7f6ca013e600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6c90000c00 tx=0x7f6c90004750 comp rx=0 tx=0).stop 2023-10-03T10:12:09.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:09.220+0000 7f6ca68e4700 1 -- 172.21.15.146:0/3996287540 shutdown_connections 2023-10-03T10:12:09.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:09.220+0000 7f6ca68e4700 1 --2- 172.21.15.146:0/3996287540 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ca0138040 0x7f6ca0135f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:09.220+0000 7f6ca68e4700 1 --2- 172.21.15.146:0/3996287540 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ca00a08e0 0x7f6ca013e600 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:09.220+0000 7f6ca68e4700 1 --2- 172.21.15.146:0/3996287540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ca00a1400 0x7f6ca01359c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:09.220+0000 7f6ca68e4700 1 -- 172.21.15.146:0/3996287540 >> 172.21.15.146:0/3996287540 conn(0x7f6ca00a2980 msgr2=0x7f6ca009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:09.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:09.220+0000 7f6ca68e4700 1 -- 172.21.15.146:0/3996287540 shutdown_connections 2023-10-03T10:12:09.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:09.220+0000 7f6ca68e4700 1 -- 172.21.15.146:0/3996287540 wait complete. 2023-10-03T10:12:09.350 INFO:tasks.ceph.osd.1.smithi146.stderr:2023-10-03T10:12:09.349+0000 7effef8ab700 -1 osd.1 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:12:09.907 INFO:tasks.ceph.osd.3.smithi146.stderr:2023-10-03T10:12:09.907+0000 7f6d77fc2680 -1 osd.3 25 log_to_monitors true 2023-10-03T10:12:10.318 INFO:tasks.ceph.osd.2.smithi146.stderr:2023-10-03T10:12:10.317+0000 7f8c7dc24700 -1 osd.2 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:12:11.333 INFO:tasks.ceph.osd.3.smithi146.stderr:2023-10-03T10:12:11.333+0000 7f6d63f3d700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:12:12.236 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:12.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.370+0000 7fef65a94700 1 Processor -- start 2023-10-03T10:12:12.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.370+0000 7fef65a94700 1 -- start start 2023-10-03T10:12:12.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.370+0000 7fef65a94700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef6009e870 0x7fef6009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.370+0000 7fef65a94700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fef6009f180 0x7fef60133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.370+0000 7fef65a94700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef601341d0 0x7fef60134670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.370+0000 7fef65a94700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6006ce60 con 0x7fef6009f180 2023-10-03T10:12:12.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.370+0000 7fef65a94700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6006bec0 con 0x7fef601341d0 2023-10-03T10:12:12.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.370+0000 7fef65a94700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef6009fa00 con 0x7fef6009e870 2023-10-03T10:12:12.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.370+0000 7fef5effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fef6009f180 0x7fef60133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.370+0000 7fef5f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef6009e870 0x7fef6009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.370+0000 7fef5ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef601341d0 0x7fef60134670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.370+0000 7fef5f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef6009e870 0x7fef6009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45778/0 (socket says 172.21.15.146:45778) 2023-10-03T10:12:12.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.370+0000 7fef5ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef601341d0 0x7fef60134670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49672/0 (socket says 172.21.15.146:49672) 2023-10-03T10:12:12.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.370+0000 7fef5f7fe700 1 -- 172.21.15.146:0/1011732278 learned_addr learned my addr 172.21.15.146:0/1011732278 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:12.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.370+0000 7fef5effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fef6009f180 0x7fef60133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38850/0 (socket says 172.21.15.146:38850) 2023-10-03T10:12:12.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.371+0000 7fef5f7fe700 1 -- 172.21.15.146:0/1011732278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef601341d0 msgr2=0x7fef60134670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.371+0000 7fef5f7fe700 1 --2- 172.21.15.146:0/1011732278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef601341d0 0x7fef60134670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.371+0000 7fef5f7fe700 1 -- 172.21.15.146:0/1011732278 >> v2:172.21.15.146:3300/0 conn(0x7fef6009f180 msgr2=0x7fef60133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.371+0000 7fef5f7fe700 1 --2- 172.21.15.146:0/1011732278 >> v2:172.21.15.146:3300/0 conn(0x7fef6009f180 0x7fef60133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.371+0000 7fef5f7fe700 1 -- 172.21.15.146:0/1011732278 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6009ad80 con 0x7fef6009e870 2023-10-03T10:12:12.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.371+0000 7fef5ffff700 1 --2- 172.21.15.146:0/1011732278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef601341d0 0x7fef60134670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:12.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.371+0000 7fef5effd700 1 --2- 172.21.15.146:0/1011732278 >> v2:172.21.15.146:3300/0 conn(0x7fef6009f180 0x7fef60133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:12.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.371+0000 7fef5f7fe700 1 --2- 172.21.15.146:0/1011732278 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef6009e870 0x7fef6009ec40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fef50009920 tx=0x7fef50009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f86b99dededd340 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.371+0000 7fef5e7fc700 1 -- 172.21.15.146:0/1011732278 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef50011830 con 0x7fef6009e870 2023-10-03T10:12:12.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.371+0000 7fef5e7fc700 1 -- 172.21.15.146:0/1011732278 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef50011990 con 0x7fef6009e870 2023-10-03T10:12:12.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.371+0000 7fef5e7fc700 1 -- 172.21.15.146:0/1011732278 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef50011d20 con 0x7fef6009e870 2023-10-03T10:12:12.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.372+0000 7fef65a94700 1 -- 172.21.15.146:0/1011732278 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef6009e870 msgr2=0x7fef6009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.372+0000 7fef65a94700 1 --2- 172.21.15.146:0/1011732278 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef6009e870 0x7fef6009ec40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fef50009920 tx=0x7fef50009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:12.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.372+0000 7fef65a94700 1 -- 172.21.15.146:0/1011732278 shutdown_connections 2023-10-03T10:12:12.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.372+0000 7fef65a94700 1 --2- 172.21.15.146:0/1011732278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef601341d0 0x7fef60134670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.372+0000 7fef65a94700 1 --2- 172.21.15.146:0/1011732278 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef6009e870 0x7fef6009ec40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.372+0000 7fef65a94700 1 --2- 172.21.15.146:0/1011732278 >> v2:172.21.15.146:3300/0 conn(0x7fef6009f180 0x7fef60133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.372+0000 7fef65a94700 1 -- 172.21.15.146:0/1011732278 >> 172.21.15.146:0/1011732278 conn(0x7fef600a4430 msgr2=0x7fef600a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.372+0000 7fef65a94700 1 -- 172.21.15.146:0/1011732278 shutdown_connections 2023-10-03T10:12:12.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.372+0000 7fef65a94700 1 -- 172.21.15.146:0/1011732278 wait complete. 2023-10-03T10:12:12.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.372+0000 7fef65a94700 1 Processor -- start 2023-10-03T10:12:12.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.373+0000 7fef65a94700 1 -- start start 2023-10-03T10:12:12.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.373+0000 7fef65a94700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef6009e870 0x7fef60122880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.373+0000 7fef65a94700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef6009f180 0x7fef60122dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.373+0000 7fef65a94700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef601341d0 0x7fef60123300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.373+0000 7fef65a94700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef60126080 con 0x7fef6009f180 2023-10-03T10:12:12.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.373+0000 7fef65a94700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef600a1670 con 0x7fef6009e870 2023-10-03T10:12:12.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.373+0000 7fef65a94700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef6006cfa0 con 0x7fef601341d0 2023-10-03T10:12:12.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.373+0000 7fef5effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef6009f180 0x7fef60122dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.373+0000 7fef5f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef6009e870 0x7fef60122880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.373+0000 7fef5f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef6009e870 0x7fef60122880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49676/0 (socket says 172.21.15.146:49676) 2023-10-03T10:12:12.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.373+0000 7fef5effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef6009f180 0x7fef60122dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38854/0 (socket says 172.21.15.146:38854) 2023-10-03T10:12:12.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.373+0000 7fef5f7fe700 1 -- 172.21.15.146:0/1200926746 learned_addr learned my addr 172.21.15.146:0/1200926746 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:12.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.373+0000 7fef5ffff700 1 --2- 172.21.15.146:0/1200926746 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef601341d0 0x7fef60123300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.374+0000 7fef5f7fe700 1 -- 172.21.15.146:0/1200926746 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef601341d0 msgr2=0x7fef60123300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.374+0000 7fef5f7fe700 1 --2- 172.21.15.146:0/1200926746 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef601341d0 0x7fef60123300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.374+0000 7fef5f7fe700 1 -- 172.21.15.146:0/1200926746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef6009f180 msgr2=0x7fef60122dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.374+0000 7fef5f7fe700 1 --2- 172.21.15.146:0/1200926746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef6009f180 0x7fef60122dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.374+0000 7fef5f7fe700 1 -- 172.21.15.146:0/1200926746 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef540094a0 con 0x7fef6009e870 2023-10-03T10:12:12.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.374+0000 7fef5effd700 1 --2- 172.21.15.146:0/1200926746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef6009f180 0x7fef60122dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:12.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.374+0000 7fef5f7fe700 1 --2- 172.21.15.146:0/1200926746 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef6009e870 0x7fef60122880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fef50009c70 tx=0x7fef50004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.374+0000 7fef47fff700 1 -- 172.21.15.146:0/1200926746 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef50004240 con 0x7fef6009e870 2023-10-03T10:12:12.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.374+0000 7fef47fff700 1 -- 172.21.15.146:0/1200926746 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5001f070 con 0x7fef6009e870 2023-10-03T10:12:12.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.374+0000 7fef65a94700 1 -- 172.21.15.146:0/1200926746 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef58009a70 con 0x7fef6009e870 2023-10-03T10:12:12.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.374+0000 7fef47fff700 1 -- 172.21.15.146:0/1200926746 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef500045e0 con 0x7fef6009e870 2023-10-03T10:12:12.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.374+0000 7fef65a94700 1 -- 172.21.15.146:0/1200926746 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef50009550 con 0x7fef6009e870 2023-10-03T10:12:12.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.375+0000 7fef65a94700 1 -- 172.21.15.146:0/1200926746 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6009f670 con 0x7fef6009e870 2023-10-03T10:12:12.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.375+0000 7fef47fff700 1 -- 172.21.15.146:0/1200926746 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fef50021030 con 0x7fef6009e870 2023-10-03T10:12:12.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.375+0000 7fef47fff700 1 -- 172.21.15.146:0/1200926746 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4049+0+0 (secure 0 0 0) 0x7fef50041340 con 0x7fef6009e870 2023-10-03T10:12:12.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.380+0000 7fef47fff700 1 -- 172.21.15.146:0/1200926746 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef50003e00 con 0x7fef6009e870 2023-10-03T10:12:12.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.583+0000 7fef65a94700 1 -- 172.21.15.146:0/1200926746 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef6004f2a0 con 0x7fef6009e870 2023-10-03T10:12:12.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.584+0000 7fef47fff700 1 -- 172.21.15.146:0/1200926746 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+12983 (secure 0 0 0) 0x7fef50015070 con 0x7fef6009e870 2023-10-03T10:12:12.585 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:12:12.585 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":32,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:12:12.455028+0000","last_up_change":"2023-10-03T10:12:11.453728+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":129317}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":129317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":129317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":129317}]},"public_addr":"172.21.15.146:6800/129317","cluster_addr":"172.21.15.146:6801/129317","heartbeat_back_addr":"172.21.15.146:6803/129317","heartbeat_front_addr":"172.21.15.146:6802/129317","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":129415}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":129415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":129415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":129415}]},"public_addr":"172.21.15.146:6804/129415","cluster_addr":"172.21.15.146:6805/129415","heartbeat_back_addr":"172.21.15.146:6807/129415","heartbeat_front_addr":"172.21.15.146:6806/129415","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":129525}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":129525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":129525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":129525}]},"public_addr":"172.21.15.146:6808/129525","cluster_addr":"172.21.15.146:6809/129525","heartbeat_back_addr":"172.21.15.146:6811/129525","heartbeat_front_addr":"172.21.15.146:6810/129525","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":129865}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":129865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":129865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":129865}]},"public_addr":"172.21.15.146:6812/129865","cluster_addr":"172.21.15.146:6813/129865","heartbeat_back_addr":"172.21.15.146:6815/129865","heartbeat_front_addr":"172.21.15.146:6814/129865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":25},{"osd":3,"down_stamp":"2023-10-03T10:12:05.426236+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:0/45915595":"2023-10-04T10:11:52.317723+0000","172.21.15.146:0/1896339219":"2023-10-04T10:11:52.317723+0000","172.21.15.146:6816/118159":"2023-10-04T10:11:52.317723+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:12.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.586+0000 7fef65a94700 1 -- 172.21.15.146:0/1200926746 >> v1:172.21.15.146:6816/126749 conn(0x7fef4c02f510 legacy=0x7fef4c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.586+0000 7fef65a94700 1 -- 172.21.15.146:0/1200926746 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef6009e870 msgr2=0x7fef60122880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.586+0000 7fef65a94700 1 --2- 172.21.15.146:0/1200926746 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef6009e870 0x7fef60122880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fef50009c70 tx=0x7fef50004750 comp rx=0 tx=0).stop 2023-10-03T10:12:12.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.586+0000 7fef65a94700 1 -- 172.21.15.146:0/1200926746 shutdown_connections 2023-10-03T10:12:12.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.586+0000 7fef65a94700 1 --2- 172.21.15.146:0/1200926746 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef601341d0 0x7fef60123300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.586+0000 7fef65a94700 1 --2- 172.21.15.146:0/1200926746 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef6009e870 0x7fef60122880 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.586+0000 7fef65a94700 1 --2- 172.21.15.146:0/1200926746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef6009f180 0x7fef60122dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.586+0000 7fef65a94700 1 -- 172.21.15.146:0/1200926746 >> 172.21.15.146:0/1200926746 conn(0x7fef600a4430 msgr2=0x7fef6009d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.586+0000 7fef65a94700 1 -- 172.21.15.146:0/1200926746 shutdown_connections 2023-10-03T10:12:12.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:12.586+0000 7fef65a94700 1 -- 172.21.15.146:0/1200926746 wait complete. 2023-10-03T10:12:12.599 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:12:12.599 INFO:teuthology.run_tasks:Running task ceph.stop... 2023-10-03T10:12:12.610 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-03T10:12:12.610 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:12.621 INFO:tasks.ceph.mds.a:Stopped 2023-10-03T10:12:13.569 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog finished 2023-10-03T10:12:13.569 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-10-03T10:12:13.580 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2023-10-03T10:12:13.580 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-03T10:12:13.580 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-03T10:12:13.583 INFO:tasks.ceph.mds.a:Started 2023-10-03T10:12:13.583 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:12:13.583 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:13.671 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2023-10-03T10:12:13.686 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-03T10:12:13.686+0000 7fc745fb7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-03T10:12:13.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.724+0000 7f9d04213700 1 Processor -- start 2023-10-03T10:12:13.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.724+0000 7f9d04213700 1 -- start start 2023-10-03T10:12:13.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.725+0000 7f9d04213700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cfc133ad0 0x7f9cfc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.725+0000 7f9d04213700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9cfc1300a0 0x7f9cfc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.725+0000 7f9d04213700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9cfc1309f0 0x7f9cfc13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.725+0000 7f9d04213700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc06b2d0 con 0x7f9cfc1300a0 2023-10-03T10:12:13.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.725+0000 7f9d04213700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc133610 con 0x7f9cfc133ad0 2023-10-03T10:12:13.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.725+0000 7f9d04213700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc09a500 con 0x7f9cfc1309f0 2023-10-03T10:12:13.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.725+0000 7f9d017ae700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9cfc1300a0 0x7f9cfc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.725+0000 7f9d01faf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cfc133ad0 0x7f9cfc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.725+0000 7f9d027b0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9cfc1309f0 0x7f9cfc13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.725+0000 7f9d017ae700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9cfc1300a0 0x7f9cfc1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38878/0 (socket says 172.21.15.146:38878) 2023-10-03T10:12:13.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.725+0000 7f9d01faf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cfc133ad0 0x7f9cfc133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49688/0 (socket says 172.21.15.146:49688) 2023-10-03T10:12:13.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.725+0000 7f9d017ae700 1 -- 172.21.15.146:0/2221754940 learned_addr learned my addr 172.21.15.146:0/2221754940 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:13.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.725+0000 7f9d01faf700 1 -- 172.21.15.146:0/2221754940 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9cfc1309f0 msgr2=0x7f9cfc13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:13.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.725+0000 7f9d01faf700 1 --2- 172.21.15.146:0/2221754940 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9cfc1309f0 0x7f9cfc13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.725+0000 7f9d01faf700 1 -- 172.21.15.146:0/2221754940 >> v2:172.21.15.146:3300/0 conn(0x7f9cfc1300a0 msgr2=0x7f9cfc1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:13.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.725+0000 7f9d01faf700 1 --2- 172.21.15.146:0/2221754940 >> v2:172.21.15.146:3300/0 conn(0x7f9cfc1300a0 0x7f9cfc1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.725+0000 7f9d01faf700 1 -- 172.21.15.146:0/2221754940 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc1338b0 con 0x7f9cfc133ad0 2023-10-03T10:12:13.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.725+0000 7f9d027b0700 1 --2- 172.21.15.146:0/2221754940 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9cfc1309f0 0x7f9cfc13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:13.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.725+0000 7f9d017ae700 1 --2- 172.21.15.146:0/2221754940 >> v2:172.21.15.146:3300/0 conn(0x7f9cfc1300a0 0x7f9cfc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:13.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.726+0000 7f9d01faf700 1 --2- 172.21.15.146:0/2221754940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cfc133ad0 0x7f9cfc133ea0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9cec009840 tx=0x7f9cec009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3ba5a146ff99f09 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:13.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.726+0000 7f9d00fad700 1 -- 172.21.15.146:0/2221754940 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec011830 con 0x7f9cfc133ad0 2023-10-03T10:12:13.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.726+0000 7f9d00fad700 1 -- 172.21.15.146:0/2221754940 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cec011990 con 0x7f9cfc133ad0 2023-10-03T10:12:13.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.726+0000 7f9d00fad700 1 -- 172.21.15.146:0/2221754940 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec011d20 con 0x7f9cfc133ad0 2023-10-03T10:12:13.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.726+0000 7f9d04213700 1 -- 172.21.15.146:0/2221754940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cfc133ad0 msgr2=0x7f9cfc133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.726+0000 7f9d04213700 1 --2- 172.21.15.146:0/2221754940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cfc133ad0 0x7f9cfc133ea0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9cec009840 tx=0x7f9cec009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:13.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.726+0000 7f9d04213700 1 -- 172.21.15.146:0/2221754940 shutdown_connections 2023-10-03T10:12:13.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.726+0000 7f9d04213700 1 --2- 172.21.15.146:0/2221754940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cfc133ad0 0x7f9cfc133ea0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.726+0000 7f9d04213700 1 --2- 172.21.15.146:0/2221754940 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9cfc1309f0 0x7f9cfc13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.726+0000 7f9d04213700 1 --2- 172.21.15.146:0/2221754940 >> v2:172.21.15.146:3300/0 conn(0x7f9cfc1300a0 0x7f9cfc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.726+0000 7f9d04213700 1 -- 172.21.15.146:0/2221754940 >> 172.21.15.146:0/2221754940 conn(0x7f9cfc099c40 msgr2=0x7f9cfc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:13.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.726+0000 7f9d04213700 1 -- 172.21.15.146:0/2221754940 shutdown_connections 2023-10-03T10:12:13.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.726+0000 7f9d04213700 1 -- 172.21.15.146:0/2221754940 wait complete. 2023-10-03T10:12:13.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.727+0000 7f9d04213700 1 Processor -- start 2023-10-03T10:12:13.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.727+0000 7f9d04213700 1 -- start start 2023-10-03T10:12:13.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9d04213700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9cfc1300a0 0x7f9cfc071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9d04213700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cfc1309f0 0x7f9cfc0718d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9d04213700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cfc133ad0 0x7f9cfc071e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9d04213700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc11e010 con 0x7f9cfc1309f0 2023-10-03T10:12:13.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9d04213700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0727f0 con 0x7f9cfc133ad0 2023-10-03T10:12:13.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9d04213700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc11eea0 con 0x7f9cfc1300a0 2023-10-03T10:12:13.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9d01faf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9cfc1300a0 0x7f9cfc071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9d027b0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cfc133ad0 0x7f9cfc071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9d017ae700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cfc1309f0 0x7f9cfc0718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9d01faf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9cfc1300a0 0x7f9cfc071390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45808/0 (socket says 172.21.15.146:45808) 2023-10-03T10:12:13.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9d027b0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cfc133ad0 0x7f9cfc071e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49692/0 (socket says 172.21.15.146:49692) 2023-10-03T10:12:13.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9d01faf700 1 -- 172.21.15.146:0/2121433526 learned_addr learned my addr 172.21.15.146:0/2121433526 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:13.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9d027b0700 1 -- 172.21.15.146:0/2121433526 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9cfc1300a0 msgr2=0x7f9cfc071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9d027b0700 1 --2- 172.21.15.146:0/2121433526 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9cfc1300a0 0x7f9cfc071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9d027b0700 1 -- 172.21.15.146:0/2121433526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cfc1309f0 msgr2=0x7f9cfc0718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9d027b0700 1 --2- 172.21.15.146:0/2121433526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cfc1309f0 0x7f9cfc0718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9d027b0700 1 -- 172.21.15.146:0/2121433526 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf8009550 con 0x7f9cfc133ad0 2023-10-03T10:12:13.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9d027b0700 1 --2- 172.21.15.146:0/2121433526 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cfc133ad0 0x7f9cfc071e10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4009e50 tx=0x7f9cf400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:13.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9cf27fc700 1 -- 172.21.15.146:0/2121433526 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400ca90 con 0x7f9cfc133ad0 2023-10-03T10:12:13.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9cf27fc700 1 -- 172.21.15.146:0/2121433526 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf400f040 con 0x7f9cfc133ad0 2023-10-03T10:12:13.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9d04213700 1 -- 172.21.15.146:0/2121433526 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf4009a70 con 0x7f9cfc133ad0 2023-10-03T10:12:13.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9cf27fc700 1 -- 172.21.15.146:0/2121433526 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400ce50 con 0x7f9cfc133ad0 2023-10-03T10:12:13.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.728+0000 7f9d04213700 1 -- 172.21.15.146:0/2121433526 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cec0094a0 con 0x7f9cfc133ad0 2023-10-03T10:12:13.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.729+0000 7f9cf27fc700 1 -- 172.21.15.146:0/2121433526 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9cf4014480 con 0x7f9cfc133ad0 2023-10-03T10:12:13.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.729+0000 7f9cf27fc700 1 -- 172.21.15.146:0/2121433526 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f9cf4040210 con 0x7f9cfc133ad0 2023-10-03T10:12:13.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.729+0000 7f9d04213700 1 -- 172.21.15.146:0/2121433526 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cfc0a2620 con 0x7f9cfc133ad0 2023-10-03T10:12:13.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.734+0000 7f9cf27fc700 1 -- 172.21.15.146:0/2121433526 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9cf403ee60 con 0x7f9cfc133ad0 2023-10-03T10:12:13.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.919+0000 7f9d04213700 1 -- 172.21.15.146:0/2121433526 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cfc12dd00 con 0x7f9cfc133ad0 2023-10-03T10:12:13.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.920+0000 7f9cf27fc700 1 -- 172.21.15.146:0/2121433526 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+13049 (secure 0 0 0) 0x7f9cf4018020 con 0x7f9cfc133ad0 2023-10-03T10:12:13.920 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:12:13.921 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":33,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:12:13.687023+0000","last_up_change":"2023-10-03T10:12:11.453728+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":129317}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":129317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":129317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":129317}]},"public_addr":"172.21.15.146:6800/129317","cluster_addr":"172.21.15.146:6801/129317","heartbeat_back_addr":"172.21.15.146:6803/129317","heartbeat_front_addr":"172.21.15.146:6802/129317","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":129415}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":129415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":129415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":129415}]},"public_addr":"172.21.15.146:6804/129415","cluster_addr":"172.21.15.146:6805/129415","heartbeat_back_addr":"172.21.15.146:6807/129415","heartbeat_front_addr":"172.21.15.146:6806/129415","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":129525}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":129525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":129525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":129525}]},"public_addr":"172.21.15.146:6808/129525","cluster_addr":"172.21.15.146:6809/129525","heartbeat_back_addr":"172.21.15.146:6811/129525","heartbeat_front_addr":"172.21.15.146:6810/129525","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":129865}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":129865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":129865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":129865}]},"public_addr":"172.21.15.146:6812/129865","cluster_addr":"172.21.15.146:6813/129865","heartbeat_back_addr":"172.21.15.146:6815/129865","heartbeat_front_addr":"172.21.15.146:6814/129865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":25},{"osd":3,"down_stamp":"2023-10-03T10:12:05.426236+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6817/4164614194":"2023-10-04T10:12:13.686998+0000","172.21.15.146:0/45915595":"2023-10-04T10:11:52.317723+0000","172.21.15.146:0/1896339219":"2023-10-04T10:11:52.317723+0000","172.21.15.146:6816/118159":"2023-10-04T10:11:52.317723+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:13.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.922+0000 7f9d04213700 1 -- 172.21.15.146:0/2121433526 >> v1:172.21.15.146:6816/126749 conn(0x7f9ce002f510 legacy=0x7f9ce00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.922+0000 7f9d04213700 1 -- 172.21.15.146:0/2121433526 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cfc133ad0 msgr2=0x7f9cfc071e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.922+0000 7f9d04213700 1 --2- 172.21.15.146:0/2121433526 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cfc133ad0 0x7f9cfc071e10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4009e50 tx=0x7f9cf400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.922+0000 7f9d04213700 1 -- 172.21.15.146:0/2121433526 shutdown_connections 2023-10-03T10:12:13.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.922+0000 7f9d04213700 1 --2- 172.21.15.146:0/2121433526 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cfc133ad0 0x7f9cfc071e10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.922+0000 7f9d04213700 1 --2- 172.21.15.146:0/2121433526 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9cfc1300a0 0x7f9cfc071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.922+0000 7f9d04213700 1 --2- 172.21.15.146:0/2121433526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cfc1309f0 0x7f9cfc0718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.922+0000 7f9d04213700 1 -- 172.21.15.146:0/2121433526 >> 172.21.15.146:0/2121433526 conn(0x7f9cfc099c40 msgr2=0x7f9cfc12f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:13.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.922+0000 7f9d04213700 1 -- 172.21.15.146:0/2121433526 shutdown_connections 2023-10-03T10:12:13.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:13.922+0000 7f9d04213700 1 -- 172.21.15.146:0/2121433526 wait complete. 2023-10-03T10:12:13.935 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:12:13.935 INFO:teuthology.run_tasks:Running task exec... 2023-10-03T10:12:13.945 INFO:teuthology.task.exec:Executing custom commands... 2023-10-03T10:12:13.945 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T10:12:13.945 DEBUG:teuthology.orchestra.run.smithi146:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2023-10-03T10:12:14.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.063+0000 7fd5a3b12700 1 Processor -- start 2023-10-03T10:12:14.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.064+0000 7fd5a3b12700 1 -- start start 2023-10-03T10:12:14.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.064+0000 7fd5a3b12700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd59c09da00 0x7fd59c09ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.064+0000 7fd5a3b12700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd59c09e310 0x7fd59c134900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.064+0000 7fd5a3b12700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd59c134e40 0x7fd59c137220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.064+0000 7fd5a3b12700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59c09b500 con 0x7fd59c09e310 2023-10-03T10:12:14.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.064+0000 7fd5a3b12700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c09bca0 con 0x7fd59c134e40 2023-10-03T10:12:14.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.064+0000 7fd5a3b12700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c09c880 con 0x7fd59c09da00 2023-10-03T10:12:14.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.064+0000 7fd5a18ae700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd59c09da00 0x7fd59c09ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.064+0000 7fd5a20af700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd59c134e40 0x7fd59c137220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.064+0000 7fd5a18ae700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd59c09da00 0x7fd59c09ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45810/0 (socket says 172.21.15.146:45810) 2023-10-03T10:12:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.064+0000 7fd5a20af700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd59c134e40 0x7fd59c137220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49704/0 (socket says 172.21.15.146:49704) 2023-10-03T10:12:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.064+0000 7fd5a18ae700 1 -- 172.21.15.146:0/3218893054 learned_addr learned my addr 172.21.15.146:0/3218893054 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.064+0000 7fd5a10ad700 1 --2- 172.21.15.146:0/3218893054 >> v2:172.21.15.146:3300/0 conn(0x7fd59c09e310 0x7fd59c134900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.064+0000 7fd5a20af700 1 -- 172.21.15.146:0/3218893054 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd59c09da00 msgr2=0x7fd59c09ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.064+0000 7fd5a20af700 1 --2- 172.21.15.146:0/3218893054 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd59c09da00 0x7fd59c09ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.064+0000 7fd5a20af700 1 -- 172.21.15.146:0/3218893054 >> v2:172.21.15.146:3300/0 conn(0x7fd59c09e310 msgr2=0x7fd59c134900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.064+0000 7fd5a20af700 1 --2- 172.21.15.146:0/3218893054 >> v2:172.21.15.146:3300/0 conn(0x7fd59c09e310 0x7fd59c134900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.064+0000 7fd5a20af700 1 -- 172.21.15.146:0/3218893054 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59c09ac80 con 0x7fd59c134e40 2023-10-03T10:12:14.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.064+0000 7fd5a18ae700 1 --2- 172.21.15.146:0/3218893054 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd59c09da00 0x7fd59c09ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:14.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.064+0000 7fd5a10ad700 1 --2- 172.21.15.146:0/3218893054 >> v2:172.21.15.146:3300/0 conn(0x7fd59c09e310 0x7fd59c134900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:14.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.065+0000 7fd5a20af700 1 --2- 172.21.15.146:0/3218893054 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd59c134e40 0x7fd59c137220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd594009d90 tx=0x7fd59400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48f1f74ae77e2e1a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:14.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.065+0000 7fd5a08ac700 1 -- 172.21.15.146:0/3218893054 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59400e070 con 0x7fd59c134e40 2023-10-03T10:12:14.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.065+0000 7fd5a08ac700 1 -- 172.21.15.146:0/3218893054 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59400bb20 con 0x7fd59c134e40 2023-10-03T10:12:14.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.065+0000 7fd5a08ac700 1 -- 172.21.15.146:0/3218893054 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd594012430 con 0x7fd59c134e40 2023-10-03T10:12:14.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.065+0000 7fd5a3b12700 1 -- 172.21.15.146:0/3218893054 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd59c134e40 msgr2=0x7fd59c137220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.065+0000 7fd5a3b12700 1 --2- 172.21.15.146:0/3218893054 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd59c134e40 0x7fd59c137220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd594009d90 tx=0x7fd59400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:14.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.065+0000 7fd5a3b12700 1 -- 172.21.15.146:0/3218893054 shutdown_connections 2023-10-03T10:12:14.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.065+0000 7fd5a3b12700 1 --2- 172.21.15.146:0/3218893054 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd59c134e40 0x7fd59c137220 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.065+0000 7fd5a3b12700 1 --2- 172.21.15.146:0/3218893054 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd59c09da00 0x7fd59c09ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.065+0000 7fd5a3b12700 1 --2- 172.21.15.146:0/3218893054 >> v2:172.21.15.146:3300/0 conn(0x7fd59c09e310 0x7fd59c134900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.065+0000 7fd5a3b12700 1 -- 172.21.15.146:0/3218893054 >> 172.21.15.146:0/3218893054 conn(0x7fd59c099e60 msgr2=0x7fd59c0a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:14.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.065+0000 7fd5a3b12700 1 -- 172.21.15.146:0/3218893054 shutdown_connections 2023-10-03T10:12:14.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.065+0000 7fd5a3b12700 1 -- 172.21.15.146:0/3218893054 wait complete. 2023-10-03T10:12:14.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.066+0000 7fd5a3b12700 1 Processor -- start 2023-10-03T10:12:14.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.066+0000 7fd5a3b12700 1 -- start start 2023-10-03T10:12:14.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.067+0000 7fd5a3b12700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd59c09da00 0x7fd59c120930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.067+0000 7fd5a3b12700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd59c09e310 0x7fd59c120e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.067+0000 7fd5a3b12700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd59c134e40 0x7fd59c1c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.067+0000 7fd5a3b12700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c134960 con 0x7fd59c09e310 2023-10-03T10:12:14.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.067+0000 7fd5a3b12700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c1204b0 con 0x7fd59c134e40 2023-10-03T10:12:14.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.067+0000 7fd5a3b12700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c072aa0 con 0x7fd59c09da00 2023-10-03T10:12:14.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.067+0000 7fd5a18ae700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd59c09da00 0x7fd59c120930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.067+0000 7fd5a18ae700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd59c09da00 0x7fd59c120930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45826/0 (socket says 172.21.15.146:45826) 2023-10-03T10:12:14.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.067+0000 7fd5a18ae700 1 -- 172.21.15.146:0/1910803546 learned_addr learned my addr 172.21.15.146:0/1910803546 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:14.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.067+0000 7fd5a10ad700 1 --2- 172.21.15.146:0/1910803546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd59c09e310 0x7fd59c120e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.067+0000 7fd5a20af700 1 --2- 172.21.15.146:0/1910803546 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd59c134e40 0x7fd59c1c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.067+0000 7fd5a18ae700 1 -- 172.21.15.146:0/1910803546 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd59c134e40 msgr2=0x7fd59c1c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.067+0000 7fd5a18ae700 1 --2- 172.21.15.146:0/1910803546 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd59c134e40 0x7fd59c1c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.067+0000 7fd5a18ae700 1 -- 172.21.15.146:0/1910803546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd59c09e310 msgr2=0x7fd59c120e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.067+0000 7fd5a18ae700 1 --2- 172.21.15.146:0/1910803546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd59c09e310 0x7fd59c120e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.067+0000 7fd5a18ae700 1 -- 172.21.15.146:0/1910803546 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58c009550 con 0x7fd59c09da00 2023-10-03T10:12:14.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.067+0000 7fd5a18ae700 1 --2- 172.21.15.146:0/1910803546 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd59c09da00 0x7fd59c120930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00ebe0 tx=0x7fd58c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:14.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.067+0000 7fd5927fc700 1 -- 172.21.15.146:0/1910803546 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c00c850 con 0x7fd59c09da00 2023-10-03T10:12:14.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.068+0000 7fd5927fc700 1 -- 172.21.15.146:0/1910803546 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58c00c9b0 con 0x7fd59c09da00 2023-10-03T10:12:14.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.068+0000 7fd5a3b12700 1 -- 172.21.15.146:0/1910803546 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5980094a0 con 0x7fd59c09da00 2023-10-03T10:12:14.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.068+0000 7fd5927fc700 1 -- 172.21.15.146:0/1910803546 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c00cd40 con 0x7fd59c09da00 2023-10-03T10:12:14.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.068+0000 7fd5a3b12700 1 -- 172.21.15.146:0/1910803546 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd594009a70 con 0x7fd59c09da00 2023-10-03T10:12:14.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.068+0000 7fd5927fc700 1 -- 172.21.15.146:0/1910803546 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd58c013470 con 0x7fd59c09da00 2023-10-03T10:12:14.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.068+0000 7fd5927fc700 1 -- 172.21.15.146:0/1910803546 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fd58c040110 con 0x7fd59c09da00 2023-10-03T10:12:14.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.069+0000 7fd5a3b12700 1 -- 172.21.15.146:0/1910803546 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59c0a0a50 con 0x7fd59c09da00 2023-10-03T10:12:14.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.073+0000 7fd5927fc700 1 -- 172.21.15.146:0/1910803546 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd58c01b3b0 con 0x7fd59c09da00 2023-10-03T10:12:14.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.260+0000 7fd5a3b12700 1 -- 172.21.15.146:0/1910803546 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd59c068580 con 0x7fd59c09da00 2023-10-03T10:12:14.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.261+0000 7fd5927fc700 1 -- 172.21.15.146:0/1910803546 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v33) v1 ==== 81+0+24376 (secure 0 0 0) 0x7fd58c024350 con 0x7fd59c09da00 2023-10-03T10:12:14.262 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:12:14.262 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-03T10:12:14.262 INFO:teuthology.orchestra.run.smithi146.stdout: "epoch": 33, 2023-10-03T10:12:14.262 INFO:teuthology.orchestra.run.smithi146.stdout: "fsid": "5440411f-9bdd-4ef1-85ef-960d00aa215c", 2023-10-03T10:12:14.262 INFO:teuthology.orchestra.run.smithi146.stdout: "created": "2023-10-03T10:09:33.329589+0000", 2023-10-03T10:12:14.262 INFO:teuthology.orchestra.run.smithi146.stdout: "modified": "2023-10-03T10:12:13.687023+0000", 2023-10-03T10:12:14.262 INFO:teuthology.orchestra.run.smithi146.stdout: "last_up_change": "2023-10-03T10:12:11.453728+0000", 2023-10-03T10:12:14.262 INFO:teuthology.orchestra.run.smithi146.stdout: "last_in_change": "2023-10-03T10:09:35.344070+0000", 2023-10-03T10:12:14.263 INFO:teuthology.orchestra.run.smithi146.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-03T10:12:14.263 INFO:teuthology.orchestra.run.smithi146.stdout: "flags_num": 5799936, 2023-10-03T10:12:14.263 INFO:teuthology.orchestra.run.smithi146.stdout: "flags_set": [ 2023-10-03T10:12:14.263 INFO:teuthology.orchestra.run.smithi146.stdout: "pglog_hardlimit", 2023-10-03T10:12:14.263 INFO:teuthology.orchestra.run.smithi146.stdout: "purged_snapdirs", 2023-10-03T10:12:14.263 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_deletes", 2023-10-03T10:12:14.263 INFO:teuthology.orchestra.run.smithi146.stdout: "sortbitwise" 2023-10-03T10:12:14.263 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2023-10-03T10:12:14.263 INFO:teuthology.orchestra.run.smithi146.stdout: "crush_version": 8, 2023-10-03T10:12:14.263 INFO:teuthology.orchestra.run.smithi146.stdout: "full_ratio": 0.94999998807907104, 2023-10-03T10:12:14.263 INFO:teuthology.orchestra.run.smithi146.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-10-03T10:12:14.263 INFO:teuthology.orchestra.run.smithi146.stdout: "nearfull_ratio": 0.85000002384185791, 2023-10-03T10:12:14.263 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_snapshot": "", 2023-10-03T10:12:14.264 INFO:teuthology.orchestra.run.smithi146.stdout: "pool_max": 4, 2023-10-03T10:12:14.264 INFO:teuthology.orchestra.run.smithi146.stdout: "max_osd": 4, 2023-10-03T10:12:14.264 INFO:teuthology.orchestra.run.smithi146.stdout: "require_min_compat_client": "pacific", 2023-10-03T10:12:14.264 INFO:teuthology.orchestra.run.smithi146.stdout: "min_compat_client": "luminous", 2023-10-03T10:12:14.264 INFO:teuthology.orchestra.run.smithi146.stdout: "require_osd_release": "pacific", 2023-10-03T10:12:14.264 INFO:teuthology.orchestra.run.smithi146.stdout: "allow_crimson": false, 2023-10-03T10:12:14.264 INFO:teuthology.orchestra.run.smithi146.stdout: "pools": [ 2023-10-03T10:12:14.264 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.264 INFO:teuthology.orchestra.run.smithi146.stdout: "pool": 1, 2023-10-03T10:12:14.264 INFO:teuthology.orchestra.run.smithi146.stdout: "pool_name": ".mgr", 2023-10-03T10:12:14.264 INFO:teuthology.orchestra.run.smithi146.stdout: "create_time": "2023-10-03T10:09:42.343363+0000", 2023-10-03T10:12:14.264 INFO:teuthology.orchestra.run.smithi146.stdout: "flags": 1, 2023-10-03T10:12:14.264 INFO:teuthology.orchestra.run.smithi146.stdout: "flags_names": "hashpspool", 2023-10-03T10:12:14.265 INFO:teuthology.orchestra.run.smithi146.stdout: "type": 1, 2023-10-03T10:12:14.265 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 2, 2023-10-03T10:12:14.265 INFO:teuthology.orchestra.run.smithi146.stdout: "min_size": 1, 2023-10-03T10:12:14.265 INFO:teuthology.orchestra.run.smithi146.stdout: "crush_rule": 0, 2023-10-03T10:12:14.265 INFO:teuthology.orchestra.run.smithi146.stdout: "peering_crush_bucket_count": 0, 2023-10-03T10:12:14.265 INFO:teuthology.orchestra.run.smithi146.stdout: "peering_crush_bucket_target": 0, 2023-10-03T10:12:14.265 INFO:teuthology.orchestra.run.smithi146.stdout: "peering_crush_bucket_barrier": 0, 2023-10-03T10:12:14.265 INFO:teuthology.orchestra.run.smithi146.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-03T10:12:14.265 INFO:teuthology.orchestra.run.smithi146.stdout: "object_hash": 2, 2023-10-03T10:12:14.265 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_autoscale_mode": "off", 2023-10-03T10:12:14.265 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_num": 1, 2023-10-03T10:12:14.265 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_placement_num": 1, 2023-10-03T10:12:14.265 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_placement_num_target": 1, 2023-10-03T10:12:14.265 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_num_target": 1, 2023-10-03T10:12:14.266 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_num_pending": 1, 2023-10-03T10:12:14.266 INFO:teuthology.orchestra.run.smithi146.stdout: "last_pg_merge_meta": { 2023-10-03T10:12:14.266 INFO:teuthology.orchestra.run.smithi146.stdout: "source_pgid": "0.0", 2023-10-03T10:12:14.266 INFO:teuthology.orchestra.run.smithi146.stdout: "ready_epoch": 0, 2023-10-03T10:12:14.266 INFO:teuthology.orchestra.run.smithi146.stdout: "last_epoch_started": 0, 2023-10-03T10:12:14.266 INFO:teuthology.orchestra.run.smithi146.stdout: "last_epoch_clean": 0, 2023-10-03T10:12:14.266 INFO:teuthology.orchestra.run.smithi146.stdout: "source_version": "0'0", 2023-10-03T10:12:14.266 INFO:teuthology.orchestra.run.smithi146.stdout: "target_version": "0'0" 2023-10-03T10:12:14.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.266 INFO:teuthology.orchestra.run.smithi146.stdout: "last_change": "22", 2023-10-03T10:12:14.266 INFO:teuthology.orchestra.run.smithi146.stdout: "last_force_op_resend": "0", 2023-10-03T10:12:14.266 INFO:teuthology.orchestra.run.smithi146.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-03T10:12:14.266 INFO:teuthology.orchestra.run.smithi146.stdout: "last_force_op_resend_preluminous": "0", 2023-10-03T10:12:14.267 INFO:teuthology.orchestra.run.smithi146.stdout: "auid": 0, 2023-10-03T10:12:14.267 INFO:teuthology.orchestra.run.smithi146.stdout: "snap_mode": "selfmanaged", 2023-10-03T10:12:14.267 INFO:teuthology.orchestra.run.smithi146.stdout: "snap_seq": 0, 2023-10-03T10:12:14.267 INFO:teuthology.orchestra.run.smithi146.stdout: "snap_epoch": 0, 2023-10-03T10:12:14.267 INFO:teuthology.orchestra.run.smithi146.stdout: "pool_snaps": [], 2023-10-03T10:12:14.267 INFO:teuthology.orchestra.run.smithi146.stdout: "removed_snaps": "[]", 2023-10-03T10:12:14.267 INFO:teuthology.orchestra.run.smithi146.stdout: "quota_max_bytes": 0, 2023-10-03T10:12:14.267 INFO:teuthology.orchestra.run.smithi146.stdout: "quota_max_objects": 0, 2023-10-03T10:12:14.267 INFO:teuthology.orchestra.run.smithi146.stdout: "tiers": [], 2023-10-03T10:12:14.267 INFO:teuthology.orchestra.run.smithi146.stdout: "tier_of": -1, 2023-10-03T10:12:14.267 INFO:teuthology.orchestra.run.smithi146.stdout: "read_tier": -1, 2023-10-03T10:12:14.267 INFO:teuthology.orchestra.run.smithi146.stdout: "write_tier": -1, 2023-10-03T10:12:14.267 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_mode": "none", 2023-10-03T10:12:14.268 INFO:teuthology.orchestra.run.smithi146.stdout: "target_max_bytes": 0, 2023-10-03T10:12:14.268 INFO:teuthology.orchestra.run.smithi146.stdout: "target_max_objects": 0, 2023-10-03T10:12:14.268 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-03T10:12:14.268 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-03T10:12:14.268 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-03T10:12:14.268 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_min_flush_age": 0, 2023-10-03T10:12:14.268 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_min_evict_age": 0, 2023-10-03T10:12:14.268 INFO:teuthology.orchestra.run.smithi146.stdout: "erasure_code_profile": "", 2023-10-03T10:12:14.268 INFO:teuthology.orchestra.run.smithi146.stdout: "hit_set_params": { 2023-10-03T10:12:14.268 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "none" 2023-10-03T10:12:14.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.268 INFO:teuthology.orchestra.run.smithi146.stdout: "hit_set_period": 0, 2023-10-03T10:12:14.268 INFO:teuthology.orchestra.run.smithi146.stdout: "hit_set_count": 0, 2023-10-03T10:12:14.269 INFO:teuthology.orchestra.run.smithi146.stdout: "use_gmt_hitset": true, 2023-10-03T10:12:14.269 INFO:teuthology.orchestra.run.smithi146.stdout: "min_read_recency_for_promote": 0, 2023-10-03T10:12:14.269 INFO:teuthology.orchestra.run.smithi146.stdout: "min_write_recency_for_promote": 0, 2023-10-03T10:12:14.269 INFO:teuthology.orchestra.run.smithi146.stdout: "hit_set_grade_decay_rate": 0, 2023-10-03T10:12:14.269 INFO:teuthology.orchestra.run.smithi146.stdout: "hit_set_search_last_n": 0, 2023-10-03T10:12:14.269 INFO:teuthology.orchestra.run.smithi146.stdout: "grade_table": [], 2023-10-03T10:12:14.269 INFO:teuthology.orchestra.run.smithi146.stdout: "stripe_width": 0, 2023-10-03T10:12:14.269 INFO:teuthology.orchestra.run.smithi146.stdout: "expected_num_objects": 0, 2023-10-03T10:12:14.269 INFO:teuthology.orchestra.run.smithi146.stdout: "fast_read": false, 2023-10-03T10:12:14.269 INFO:teuthology.orchestra.run.smithi146.stdout: "options": { 2023-10-03T10:12:14.269 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_num_max": 32, 2023-10-03T10:12:14.269 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_num_min": 1 2023-10-03T10:12:14.269 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.270 INFO:teuthology.orchestra.run.smithi146.stdout: "application_metadata": { 2023-10-03T10:12:14.270 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": {}, 2023-10-03T10:12:14.270 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr_devicehealth": {} 2023-10-03T10:12:14.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.270 INFO:teuthology.orchestra.run.smithi146.stdout: "read_balance": { 2023-10-03T10:12:14.270 INFO:teuthology.orchestra.run.smithi146.stdout: "score_acting": 4, 2023-10-03T10:12:14.270 INFO:teuthology.orchestra.run.smithi146.stdout: "score_stable": 4, 2023-10-03T10:12:14.270 INFO:teuthology.orchestra.run.smithi146.stdout: "optimal_score": 0.5, 2023-10-03T10:12:14.270 INFO:teuthology.orchestra.run.smithi146.stdout: "raw_score_acting": 2, 2023-10-03T10:12:14.270 INFO:teuthology.orchestra.run.smithi146.stdout: "raw_score_stable": 2, 2023-10-03T10:12:14.270 INFO:teuthology.orchestra.run.smithi146.stdout: "primary_affinity_weighted": 1, 2023-10-03T10:12:14.270 INFO:teuthology.orchestra.run.smithi146.stdout: "average_primary_affinity": 1, 2023-10-03T10:12:14.270 INFO:teuthology.orchestra.run.smithi146.stdout: "average_primary_affinity_weighted": 1 2023-10-03T10:12:14.271 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.271 INFO:teuthology.orchestra.run.smithi146.stdout: "pool": 2, 2023-10-03T10:12:14.271 INFO:teuthology.orchestra.run.smithi146.stdout: "pool_name": "rbd", 2023-10-03T10:12:14.271 INFO:teuthology.orchestra.run.smithi146.stdout: "create_time": "2023-10-03T10:09:43.224375+0000", 2023-10-03T10:12:14.271 INFO:teuthology.orchestra.run.smithi146.stdout: "flags": 1, 2023-10-03T10:12:14.271 INFO:teuthology.orchestra.run.smithi146.stdout: "flags_names": "hashpspool", 2023-10-03T10:12:14.271 INFO:teuthology.orchestra.run.smithi146.stdout: "type": 1, 2023-10-03T10:12:14.271 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 2, 2023-10-03T10:12:14.271 INFO:teuthology.orchestra.run.smithi146.stdout: "min_size": 1, 2023-10-03T10:12:14.271 INFO:teuthology.orchestra.run.smithi146.stdout: "crush_rule": 0, 2023-10-03T10:12:14.271 INFO:teuthology.orchestra.run.smithi146.stdout: "peering_crush_bucket_count": 0, 2023-10-03T10:12:14.271 INFO:teuthology.orchestra.run.smithi146.stdout: "peering_crush_bucket_target": 0, 2023-10-03T10:12:14.272 INFO:teuthology.orchestra.run.smithi146.stdout: "peering_crush_bucket_barrier": 0, 2023-10-03T10:12:14.272 INFO:teuthology.orchestra.run.smithi146.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-03T10:12:14.272 INFO:teuthology.orchestra.run.smithi146.stdout: "object_hash": 2, 2023-10-03T10:12:14.272 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_autoscale_mode": "off", 2023-10-03T10:12:14.272 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_num": 8, 2023-10-03T10:12:14.272 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_placement_num": 8, 2023-10-03T10:12:14.272 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_placement_num_target": 8, 2023-10-03T10:12:14.272 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_num_target": 8, 2023-10-03T10:12:14.272 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_num_pending": 8, 2023-10-03T10:12:14.272 INFO:teuthology.orchestra.run.smithi146.stdout: "last_pg_merge_meta": { 2023-10-03T10:12:14.272 INFO:teuthology.orchestra.run.smithi146.stdout: "source_pgid": "0.0", 2023-10-03T10:12:14.272 INFO:teuthology.orchestra.run.smithi146.stdout: "ready_epoch": 0, 2023-10-03T10:12:14.272 INFO:teuthology.orchestra.run.smithi146.stdout: "last_epoch_started": 0, 2023-10-03T10:12:14.272 INFO:teuthology.orchestra.run.smithi146.stdout: "last_epoch_clean": 0, 2023-10-03T10:12:14.273 INFO:teuthology.orchestra.run.smithi146.stdout: "source_version": "0'0", 2023-10-03T10:12:14.273 INFO:teuthology.orchestra.run.smithi146.stdout: "target_version": "0'0" 2023-10-03T10:12:14.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.273 INFO:teuthology.orchestra.run.smithi146.stdout: "last_change": "12", 2023-10-03T10:12:14.273 INFO:teuthology.orchestra.run.smithi146.stdout: "last_force_op_resend": "0", 2023-10-03T10:12:14.273 INFO:teuthology.orchestra.run.smithi146.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-03T10:12:14.273 INFO:teuthology.orchestra.run.smithi146.stdout: "last_force_op_resend_preluminous": "0", 2023-10-03T10:12:14.273 INFO:teuthology.orchestra.run.smithi146.stdout: "auid": 0, 2023-10-03T10:12:14.273 INFO:teuthology.orchestra.run.smithi146.stdout: "snap_mode": "selfmanaged", 2023-10-03T10:12:14.273 INFO:teuthology.orchestra.run.smithi146.stdout: "snap_seq": 0, 2023-10-03T10:12:14.273 INFO:teuthology.orchestra.run.smithi146.stdout: "snap_epoch": 0, 2023-10-03T10:12:14.273 INFO:teuthology.orchestra.run.smithi146.stdout: "pool_snaps": [], 2023-10-03T10:12:14.273 INFO:teuthology.orchestra.run.smithi146.stdout: "removed_snaps": "[]", 2023-10-03T10:12:14.274 INFO:teuthology.orchestra.run.smithi146.stdout: "quota_max_bytes": 0, 2023-10-03T10:12:14.274 INFO:teuthology.orchestra.run.smithi146.stdout: "quota_max_objects": 0, 2023-10-03T10:12:14.274 INFO:teuthology.orchestra.run.smithi146.stdout: "tiers": [], 2023-10-03T10:12:14.274 INFO:teuthology.orchestra.run.smithi146.stdout: "tier_of": -1, 2023-10-03T10:12:14.274 INFO:teuthology.orchestra.run.smithi146.stdout: "read_tier": -1, 2023-10-03T10:12:14.274 INFO:teuthology.orchestra.run.smithi146.stdout: "write_tier": -1, 2023-10-03T10:12:14.274 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_mode": "none", 2023-10-03T10:12:14.274 INFO:teuthology.orchestra.run.smithi146.stdout: "target_max_bytes": 0, 2023-10-03T10:12:14.274 INFO:teuthology.orchestra.run.smithi146.stdout: "target_max_objects": 0, 2023-10-03T10:12:14.274 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-03T10:12:14.274 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-03T10:12:14.274 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-03T10:12:14.274 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_min_flush_age": 0, 2023-10-03T10:12:14.274 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_min_evict_age": 0, 2023-10-03T10:12:14.275 INFO:teuthology.orchestra.run.smithi146.stdout: "erasure_code_profile": "", 2023-10-03T10:12:14.275 INFO:teuthology.orchestra.run.smithi146.stdout: "hit_set_params": { 2023-10-03T10:12:14.275 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "none" 2023-10-03T10:12:14.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.275 INFO:teuthology.orchestra.run.smithi146.stdout: "hit_set_period": 0, 2023-10-03T10:12:14.275 INFO:teuthology.orchestra.run.smithi146.stdout: "hit_set_count": 0, 2023-10-03T10:12:14.275 INFO:teuthology.orchestra.run.smithi146.stdout: "use_gmt_hitset": true, 2023-10-03T10:12:14.275 INFO:teuthology.orchestra.run.smithi146.stdout: "min_read_recency_for_promote": 0, 2023-10-03T10:12:14.275 INFO:teuthology.orchestra.run.smithi146.stdout: "min_write_recency_for_promote": 0, 2023-10-03T10:12:14.275 INFO:teuthology.orchestra.run.smithi146.stdout: "hit_set_grade_decay_rate": 0, 2023-10-03T10:12:14.275 INFO:teuthology.orchestra.run.smithi146.stdout: "hit_set_search_last_n": 0, 2023-10-03T10:12:14.275 INFO:teuthology.orchestra.run.smithi146.stdout: "grade_table": [], 2023-10-03T10:12:14.275 INFO:teuthology.orchestra.run.smithi146.stdout: "stripe_width": 0, 2023-10-03T10:12:14.275 INFO:teuthology.orchestra.run.smithi146.stdout: "expected_num_objects": 0, 2023-10-03T10:12:14.276 INFO:teuthology.orchestra.run.smithi146.stdout: "fast_read": false, 2023-10-03T10:12:14.276 INFO:teuthology.orchestra.run.smithi146.stdout: "options": {}, 2023-10-03T10:12:14.276 INFO:teuthology.orchestra.run.smithi146.stdout: "application_metadata": { 2023-10-03T10:12:14.276 INFO:teuthology.orchestra.run.smithi146.stdout: "rbd": {} 2023-10-03T10:12:14.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.276 INFO:teuthology.orchestra.run.smithi146.stdout: "read_balance": { 2023-10-03T10:12:14.276 INFO:teuthology.orchestra.run.smithi146.stdout: "score_acting": 2.5, 2023-10-03T10:12:14.276 INFO:teuthology.orchestra.run.smithi146.stdout: "score_stable": 2.5, 2023-10-03T10:12:14.276 INFO:teuthology.orchestra.run.smithi146.stdout: "optimal_score": 1, 2023-10-03T10:12:14.276 INFO:teuthology.orchestra.run.smithi146.stdout: "raw_score_acting": 2.5, 2023-10-03T10:12:14.276 INFO:teuthology.orchestra.run.smithi146.stdout: "raw_score_stable": 2.5, 2023-10-03T10:12:14.276 INFO:teuthology.orchestra.run.smithi146.stdout: "primary_affinity_weighted": 1, 2023-10-03T10:12:14.276 INFO:teuthology.orchestra.run.smithi146.stdout: "average_primary_affinity": 1, 2023-10-03T10:12:14.276 INFO:teuthology.orchestra.run.smithi146.stdout: "average_primary_affinity_weighted": 1 2023-10-03T10:12:14.277 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.277 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.277 INFO:teuthology.orchestra.run.smithi146.stdout: "pool": 3, 2023-10-03T10:12:14.277 INFO:teuthology.orchestra.run.smithi146.stdout: "pool_name": "cephfs_metadata", 2023-10-03T10:12:14.277 INFO:teuthology.orchestra.run.smithi146.stdout: "create_time": "2023-10-03T10:09:47.108480+0000", 2023-10-03T10:12:14.277 INFO:teuthology.orchestra.run.smithi146.stdout: "flags": 1, 2023-10-03T10:12:14.277 INFO:teuthology.orchestra.run.smithi146.stdout: "flags_names": "hashpspool", 2023-10-03T10:12:14.277 INFO:teuthology.orchestra.run.smithi146.stdout: "type": 1, 2023-10-03T10:12:14.277 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 2, 2023-10-03T10:12:14.277 INFO:teuthology.orchestra.run.smithi146.stdout: "min_size": 1, 2023-10-03T10:12:14.277 INFO:teuthology.orchestra.run.smithi146.stdout: "crush_rule": 0, 2023-10-03T10:12:14.277 INFO:teuthology.orchestra.run.smithi146.stdout: "peering_crush_bucket_count": 0, 2023-10-03T10:12:14.278 INFO:teuthology.orchestra.run.smithi146.stdout: "peering_crush_bucket_target": 0, 2023-10-03T10:12:14.278 INFO:teuthology.orchestra.run.smithi146.stdout: "peering_crush_bucket_barrier": 0, 2023-10-03T10:12:14.278 INFO:teuthology.orchestra.run.smithi146.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-03T10:12:14.278 INFO:teuthology.orchestra.run.smithi146.stdout: "object_hash": 2, 2023-10-03T10:12:14.278 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_autoscale_mode": "off", 2023-10-03T10:12:14.278 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_num": 32, 2023-10-03T10:12:14.278 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_placement_num": 32, 2023-10-03T10:12:14.278 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_placement_num_target": 32, 2023-10-03T10:12:14.278 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_num_target": 32, 2023-10-03T10:12:14.278 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_num_pending": 32, 2023-10-03T10:12:14.278 INFO:teuthology.orchestra.run.smithi146.stdout: "last_pg_merge_meta": { 2023-10-03T10:12:14.278 INFO:teuthology.orchestra.run.smithi146.stdout: "source_pgid": "0.0", 2023-10-03T10:12:14.278 INFO:teuthology.orchestra.run.smithi146.stdout: "ready_epoch": 0, 2023-10-03T10:12:14.279 INFO:teuthology.orchestra.run.smithi146.stdout: "last_epoch_started": 0, 2023-10-03T10:12:14.279 INFO:teuthology.orchestra.run.smithi146.stdout: "last_epoch_clean": 0, 2023-10-03T10:12:14.279 INFO:teuthology.orchestra.run.smithi146.stdout: "source_version": "0'0", 2023-10-03T10:12:14.279 INFO:teuthology.orchestra.run.smithi146.stdout: "target_version": "0'0" 2023-10-03T10:12:14.279 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.279 INFO:teuthology.orchestra.run.smithi146.stdout: "last_change": "15", 2023-10-03T10:12:14.279 INFO:teuthology.orchestra.run.smithi146.stdout: "last_force_op_resend": "0", 2023-10-03T10:12:14.279 INFO:teuthology.orchestra.run.smithi146.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-03T10:12:14.279 INFO:teuthology.orchestra.run.smithi146.stdout: "last_force_op_resend_preluminous": "0", 2023-10-03T10:12:14.279 INFO:teuthology.orchestra.run.smithi146.stdout: "auid": 0, 2023-10-03T10:12:14.279 INFO:teuthology.orchestra.run.smithi146.stdout: "snap_mode": "selfmanaged", 2023-10-03T10:12:14.279 INFO:teuthology.orchestra.run.smithi146.stdout: "snap_seq": 0, 2023-10-03T10:12:14.279 INFO:teuthology.orchestra.run.smithi146.stdout: "snap_epoch": 0, 2023-10-03T10:12:14.280 INFO:teuthology.orchestra.run.smithi146.stdout: "pool_snaps": [], 2023-10-03T10:12:14.280 INFO:teuthology.orchestra.run.smithi146.stdout: "removed_snaps": "[]", 2023-10-03T10:12:14.280 INFO:teuthology.orchestra.run.smithi146.stdout: "quota_max_bytes": 0, 2023-10-03T10:12:14.280 INFO:teuthology.orchestra.run.smithi146.stdout: "quota_max_objects": 0, 2023-10-03T10:12:14.280 INFO:teuthology.orchestra.run.smithi146.stdout: "tiers": [], 2023-10-03T10:12:14.280 INFO:teuthology.orchestra.run.smithi146.stdout: "tier_of": -1, 2023-10-03T10:12:14.280 INFO:teuthology.orchestra.run.smithi146.stdout: "read_tier": -1, 2023-10-03T10:12:14.280 INFO:teuthology.orchestra.run.smithi146.stdout: "write_tier": -1, 2023-10-03T10:12:14.280 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_mode": "none", 2023-10-03T10:12:14.280 INFO:teuthology.orchestra.run.smithi146.stdout: "target_max_bytes": 0, 2023-10-03T10:12:14.280 INFO:teuthology.orchestra.run.smithi146.stdout: "target_max_objects": 0, 2023-10-03T10:12:14.280 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-03T10:12:14.280 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_min_flush_age": 0, 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_min_evict_age": 0, 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi146.stdout: "erasure_code_profile": "", 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi146.stdout: "hit_set_params": { 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "none" 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi146.stdout: "hit_set_period": 0, 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi146.stdout: "hit_set_count": 0, 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi146.stdout: "use_gmt_hitset": true, 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi146.stdout: "min_read_recency_for_promote": 0, 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi146.stdout: "min_write_recency_for_promote": 0, 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi146.stdout: "hit_set_grade_decay_rate": 0, 2023-10-03T10:12:14.282 INFO:teuthology.orchestra.run.smithi146.stdout: "hit_set_search_last_n": 0, 2023-10-03T10:12:14.282 INFO:teuthology.orchestra.run.smithi146.stdout: "grade_table": [], 2023-10-03T10:12:14.282 INFO:teuthology.orchestra.run.smithi146.stdout: "stripe_width": 0, 2023-10-03T10:12:14.282 INFO:teuthology.orchestra.run.smithi146.stdout: "expected_num_objects": 0, 2023-10-03T10:12:14.282 INFO:teuthology.orchestra.run.smithi146.stdout: "fast_read": false, 2023-10-03T10:12:14.282 INFO:teuthology.orchestra.run.smithi146.stdout: "options": { 2023-10-03T10:12:14.282 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_autoscale_bias": 4, 2023-10-03T10:12:14.282 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_num_min": 16, 2023-10-03T10:12:14.282 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_priority": 5 2023-10-03T10:12:14.282 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.282 INFO:teuthology.orchestra.run.smithi146.stdout: "application_metadata": { 2023-10-03T10:12:14.282 INFO:teuthology.orchestra.run.smithi146.stdout: "cephfs": { 2023-10-03T10:12:14.282 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": "cephfs" 2023-10-03T10:12:14.283 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.283 INFO:teuthology.orchestra.run.smithi146.stdout: "read_balance": { 2023-10-03T10:12:14.283 INFO:teuthology.orchestra.run.smithi146.stdout: "score_acting": 1.6299999952316284, 2023-10-03T10:12:14.283 INFO:teuthology.orchestra.run.smithi146.stdout: "score_stable": 1.6299999952316284, 2023-10-03T10:12:14.283 INFO:teuthology.orchestra.run.smithi146.stdout: "optimal_score": 1, 2023-10-03T10:12:14.283 INFO:teuthology.orchestra.run.smithi146.stdout: "raw_score_acting": 1.6299999952316284, 2023-10-03T10:12:14.283 INFO:teuthology.orchestra.run.smithi146.stdout: "raw_score_stable": 1.6299999952316284, 2023-10-03T10:12:14.283 INFO:teuthology.orchestra.run.smithi146.stdout: "primary_affinity_weighted": 1, 2023-10-03T10:12:14.283 INFO:teuthology.orchestra.run.smithi146.stdout: "average_primary_affinity": 1, 2023-10-03T10:12:14.283 INFO:teuthology.orchestra.run.smithi146.stdout: "average_primary_affinity_weighted": 1 2023-10-03T10:12:14.283 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.283 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.284 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.284 INFO:teuthology.orchestra.run.smithi146.stdout: "pool": 4, 2023-10-03T10:12:14.284 INFO:teuthology.orchestra.run.smithi146.stdout: "pool_name": "cephfs_data", 2023-10-03T10:12:14.284 INFO:teuthology.orchestra.run.smithi146.stdout: "create_time": "2023-10-03T10:09:47.686814+0000", 2023-10-03T10:12:14.284 INFO:teuthology.orchestra.run.smithi146.stdout: "flags": 1, 2023-10-03T10:12:14.284 INFO:teuthology.orchestra.run.smithi146.stdout: "flags_names": "hashpspool", 2023-10-03T10:12:14.284 INFO:teuthology.orchestra.run.smithi146.stdout: "type": 1, 2023-10-03T10:12:14.284 INFO:teuthology.orchestra.run.smithi146.stdout: "size": 2, 2023-10-03T10:12:14.284 INFO:teuthology.orchestra.run.smithi146.stdout: "min_size": 1, 2023-10-03T10:12:14.284 INFO:teuthology.orchestra.run.smithi146.stdout: "crush_rule": 0, 2023-10-03T10:12:14.284 INFO:teuthology.orchestra.run.smithi146.stdout: "peering_crush_bucket_count": 0, 2023-10-03T10:12:14.284 INFO:teuthology.orchestra.run.smithi146.stdout: "peering_crush_bucket_target": 0, 2023-10-03T10:12:14.284 INFO:teuthology.orchestra.run.smithi146.stdout: "peering_crush_bucket_barrier": 0, 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi146.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi146.stdout: "object_hash": 2, 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_autoscale_mode": "off", 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_num": 64, 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_placement_num": 64, 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_placement_num_target": 64, 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_num_target": 64, 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_num_pending": 64, 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi146.stdout: "last_pg_merge_meta": { 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi146.stdout: "source_pgid": "0.0", 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi146.stdout: "ready_epoch": 0, 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi146.stdout: "last_epoch_started": 0, 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi146.stdout: "last_epoch_clean": 0, 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi146.stdout: "source_version": "0'0", 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi146.stdout: "target_version": "0'0" 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi146.stdout: "last_change": "16", 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi146.stdout: "last_force_op_resend": "0", 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi146.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi146.stdout: "last_force_op_resend_preluminous": "0", 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi146.stdout: "auid": 0, 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi146.stdout: "snap_mode": "selfmanaged", 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi146.stdout: "snap_seq": 0, 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi146.stdout: "snap_epoch": 0, 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi146.stdout: "pool_snaps": [], 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi146.stdout: "removed_snaps": "[]", 2023-10-03T10:12:14.287 INFO:teuthology.orchestra.run.smithi146.stdout: "quota_max_bytes": 0, 2023-10-03T10:12:14.287 INFO:teuthology.orchestra.run.smithi146.stdout: "quota_max_objects": 0, 2023-10-03T10:12:14.287 INFO:teuthology.orchestra.run.smithi146.stdout: "tiers": [], 2023-10-03T10:12:14.287 INFO:teuthology.orchestra.run.smithi146.stdout: "tier_of": -1, 2023-10-03T10:12:14.287 INFO:teuthology.orchestra.run.smithi146.stdout: "read_tier": -1, 2023-10-03T10:12:14.287 INFO:teuthology.orchestra.run.smithi146.stdout: "write_tier": -1, 2023-10-03T10:12:14.287 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_mode": "none", 2023-10-03T10:12:14.287 INFO:teuthology.orchestra.run.smithi146.stdout: "target_max_bytes": 0, 2023-10-03T10:12:14.287 INFO:teuthology.orchestra.run.smithi146.stdout: "target_max_objects": 0, 2023-10-03T10:12:14.287 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-03T10:12:14.287 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-03T10:12:14.287 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-03T10:12:14.287 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_min_flush_age": 0, 2023-10-03T10:12:14.288 INFO:teuthology.orchestra.run.smithi146.stdout: "cache_min_evict_age": 0, 2023-10-03T10:12:14.288 INFO:teuthology.orchestra.run.smithi146.stdout: "erasure_code_profile": "", 2023-10-03T10:12:14.288 INFO:teuthology.orchestra.run.smithi146.stdout: "hit_set_params": { 2023-10-03T10:12:14.288 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "none" 2023-10-03T10:12:14.288 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.288 INFO:teuthology.orchestra.run.smithi146.stdout: "hit_set_period": 0, 2023-10-03T10:12:14.288 INFO:teuthology.orchestra.run.smithi146.stdout: "hit_set_count": 0, 2023-10-03T10:12:14.288 INFO:teuthology.orchestra.run.smithi146.stdout: "use_gmt_hitset": true, 2023-10-03T10:12:14.288 INFO:teuthology.orchestra.run.smithi146.stdout: "min_read_recency_for_promote": 0, 2023-10-03T10:12:14.288 INFO:teuthology.orchestra.run.smithi146.stdout: "min_write_recency_for_promote": 0, 2023-10-03T10:12:14.288 INFO:teuthology.orchestra.run.smithi146.stdout: "hit_set_grade_decay_rate": 0, 2023-10-03T10:12:14.288 INFO:teuthology.orchestra.run.smithi146.stdout: "hit_set_search_last_n": 0, 2023-10-03T10:12:14.288 INFO:teuthology.orchestra.run.smithi146.stdout: "grade_table": [], 2023-10-03T10:12:14.289 INFO:teuthology.orchestra.run.smithi146.stdout: "stripe_width": 0, 2023-10-03T10:12:14.289 INFO:teuthology.orchestra.run.smithi146.stdout: "expected_num_objects": 0, 2023-10-03T10:12:14.289 INFO:teuthology.orchestra.run.smithi146.stdout: "fast_read": false, 2023-10-03T10:12:14.289 INFO:teuthology.orchestra.run.smithi146.stdout: "options": { 2023-10-03T10:12:14.289 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_num_min": 64, 2023-10-03T10:12:14.289 INFO:teuthology.orchestra.run.smithi146.stdout: "target_size_ratio": 0.89999997615814209 2023-10-03T10:12:14.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.289 INFO:teuthology.orchestra.run.smithi146.stdout: "application_metadata": { 2023-10-03T10:12:14.289 INFO:teuthology.orchestra.run.smithi146.stdout: "cephfs": { 2023-10-03T10:12:14.289 INFO:teuthology.orchestra.run.smithi146.stdout: "data": "cephfs" 2023-10-03T10:12:14.289 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.289 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.289 INFO:teuthology.orchestra.run.smithi146.stdout: "read_balance": { 2023-10-03T10:12:14.289 INFO:teuthology.orchestra.run.smithi146.stdout: "score_acting": 1.059999942779541, 2023-10-03T10:12:14.290 INFO:teuthology.orchestra.run.smithi146.stdout: "score_stable": 1.059999942779541, 2023-10-03T10:12:14.290 INFO:teuthology.orchestra.run.smithi146.stdout: "optimal_score": 1, 2023-10-03T10:12:14.290 INFO:teuthology.orchestra.run.smithi146.stdout: "raw_score_acting": 1.059999942779541, 2023-10-03T10:12:14.290 INFO:teuthology.orchestra.run.smithi146.stdout: "raw_score_stable": 1.059999942779541, 2023-10-03T10:12:14.290 INFO:teuthology.orchestra.run.smithi146.stdout: "primary_affinity_weighted": 1, 2023-10-03T10:12:14.290 INFO:teuthology.orchestra.run.smithi146.stdout: "average_primary_affinity": 1, 2023-10-03T10:12:14.290 INFO:teuthology.orchestra.run.smithi146.stdout: "average_primary_affinity_weighted": 1 2023-10-03T10:12:14.290 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.290 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.290 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2023-10-03T10:12:14.290 INFO:teuthology.orchestra.run.smithi146.stdout: "osds": [ 2023-10-03T10:12:14.290 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.291 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": 0, 2023-10-03T10:12:14.291 INFO:teuthology.orchestra.run.smithi146.stdout: "uuid": "dc508d26-69b6-41de-a054-5e24038acb5f", 2023-10-03T10:12:14.291 INFO:teuthology.orchestra.run.smithi146.stdout: "up": 1, 2023-10-03T10:12:14.291 INFO:teuthology.orchestra.run.smithi146.stdout: "in": 1, 2023-10-03T10:12:14.291 INFO:teuthology.orchestra.run.smithi146.stdout: "weight": 1, 2023-10-03T10:12:14.291 INFO:teuthology.orchestra.run.smithi146.stdout: "primary_affinity": 1, 2023-10-03T10:12:14.291 INFO:teuthology.orchestra.run.smithi146.stdout: "last_clean_begin": 9, 2023-10-03T10:12:14.291 INFO:teuthology.orchestra.run.smithi146.stdout: "last_clean_end": 22, 2023-10-03T10:12:14.291 INFO:teuthology.orchestra.run.smithi146.stdout: "up_from": 28, 2023-10-03T10:12:14.291 INFO:teuthology.orchestra.run.smithi146.stdout: "up_thru": 31, 2023-10-03T10:12:14.291 INFO:teuthology.orchestra.run.smithi146.stdout: "down_at": 23, 2023-10-03T10:12:14.291 INFO:teuthology.orchestra.run.smithi146.stdout: "lost_at": 0, 2023-10-03T10:12:14.291 INFO:teuthology.orchestra.run.smithi146.stdout: "public_addrs": { 2023-10-03T10:12:14.291 INFO:teuthology.orchestra.run.smithi146.stdout: "addrvec": [ 2023-10-03T10:12:14.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.292 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T10:12:14.292 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:6800", 2023-10-03T10:12:14.292 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 129317 2023-10-03T10:12:14.292 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.292 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.292 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.292 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_addrs": { 2023-10-03T10:12:14.292 INFO:teuthology.orchestra.run.smithi146.stdout: "addrvec": [ 2023-10-03T10:12:14.292 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.292 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T10:12:14.292 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:6801", 2023-10-03T10:12:14.292 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 129317 2023-10-03T10:12:14.292 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.293 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.293 INFO:teuthology.orchestra.run.smithi146.stdout: "heartbeat_back_addrs": { 2023-10-03T10:12:14.293 INFO:teuthology.orchestra.run.smithi146.stdout: "addrvec": [ 2023-10-03T10:12:14.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.293 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T10:12:14.293 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:6803", 2023-10-03T10:12:14.293 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 129317 2023-10-03T10:12:14.293 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.293 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.293 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.293 INFO:teuthology.orchestra.run.smithi146.stdout: "heartbeat_front_addrs": { 2023-10-03T10:12:14.293 INFO:teuthology.orchestra.run.smithi146.stdout: "addrvec": [ 2023-10-03T10:12:14.293 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.294 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T10:12:14.294 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:6802", 2023-10-03T10:12:14.294 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 129317 2023-10-03T10:12:14.294 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.294 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.294 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.294 INFO:teuthology.orchestra.run.smithi146.stdout: "public_addr": "172.21.15.146:6800/129317", 2023-10-03T10:12:14.294 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_addr": "172.21.15.146:6801/129317", 2023-10-03T10:12:14.294 INFO:teuthology.orchestra.run.smithi146.stdout: "heartbeat_back_addr": "172.21.15.146:6803/129317", 2023-10-03T10:12:14.294 INFO:teuthology.orchestra.run.smithi146.stdout: "heartbeat_front_addr": "172.21.15.146:6802/129317", 2023-10-03T10:12:14.294 INFO:teuthology.orchestra.run.smithi146.stdout: "state": [ 2023-10-03T10:12:14.294 INFO:teuthology.orchestra.run.smithi146.stdout: "exists", 2023-10-03T10:12:14.294 INFO:teuthology.orchestra.run.smithi146.stdout: "up" 2023-10-03T10:12:14.295 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.295 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.295 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.295 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": 1, 2023-10-03T10:12:14.295 INFO:teuthology.orchestra.run.smithi146.stdout: "uuid": "31a24ed3-888a-480f-a617-3ba1d9611021", 2023-10-03T10:12:14.295 INFO:teuthology.orchestra.run.smithi146.stdout: "up": 1, 2023-10-03T10:12:14.295 INFO:teuthology.orchestra.run.smithi146.stdout: "in": 1, 2023-10-03T10:12:14.295 INFO:teuthology.orchestra.run.smithi146.stdout: "weight": 1, 2023-10-03T10:12:14.295 INFO:teuthology.orchestra.run.smithi146.stdout: "primary_affinity": 1, 2023-10-03T10:12:14.295 INFO:teuthology.orchestra.run.smithi146.stdout: "last_clean_begin": 9, 2023-10-03T10:12:14.295 INFO:teuthology.orchestra.run.smithi146.stdout: "last_clean_end": 22, 2023-10-03T10:12:14.295 INFO:teuthology.orchestra.run.smithi146.stdout: "up_from": 29, 2023-10-03T10:12:14.295 INFO:teuthology.orchestra.run.smithi146.stdout: "up_thru": 31, 2023-10-03T10:12:14.295 INFO:teuthology.orchestra.run.smithi146.stdout: "down_at": 24, 2023-10-03T10:12:14.295 INFO:teuthology.orchestra.run.smithi146.stdout: "lost_at": 0, 2023-10-03T10:12:14.296 INFO:teuthology.orchestra.run.smithi146.stdout: "public_addrs": { 2023-10-03T10:12:14.296 INFO:teuthology.orchestra.run.smithi146.stdout: "addrvec": [ 2023-10-03T10:12:14.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.296 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T10:12:14.296 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:6804", 2023-10-03T10:12:14.296 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 129415 2023-10-03T10:12:14.296 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.296 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.296 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.296 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_addrs": { 2023-10-03T10:12:14.296 INFO:teuthology.orchestra.run.smithi146.stdout: "addrvec": [ 2023-10-03T10:12:14.296 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.296 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T10:12:14.296 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:6805", 2023-10-03T10:12:14.297 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 129415 2023-10-03T10:12:14.297 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.297 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.297 INFO:teuthology.orchestra.run.smithi146.stdout: "heartbeat_back_addrs": { 2023-10-03T10:12:14.297 INFO:teuthology.orchestra.run.smithi146.stdout: "addrvec": [ 2023-10-03T10:12:14.297 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.297 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T10:12:14.297 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:6807", 2023-10-03T10:12:14.297 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 129415 2023-10-03T10:12:14.297 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.297 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.297 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.297 INFO:teuthology.orchestra.run.smithi146.stdout: "heartbeat_front_addrs": { 2023-10-03T10:12:14.298 INFO:teuthology.orchestra.run.smithi146.stdout: "addrvec": [ 2023-10-03T10:12:14.298 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.298 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T10:12:14.298 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:6806", 2023-10-03T10:12:14.298 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 129415 2023-10-03T10:12:14.298 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.298 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.298 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.298 INFO:teuthology.orchestra.run.smithi146.stdout: "public_addr": "172.21.15.146:6804/129415", 2023-10-03T10:12:14.298 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_addr": "172.21.15.146:6805/129415", 2023-10-03T10:12:14.298 INFO:teuthology.orchestra.run.smithi146.stdout: "heartbeat_back_addr": "172.21.15.146:6807/129415", 2023-10-03T10:12:14.298 INFO:teuthology.orchestra.run.smithi146.stdout: "heartbeat_front_addr": "172.21.15.146:6806/129415", 2023-10-03T10:12:14.299 INFO:teuthology.orchestra.run.smithi146.stdout: "state": [ 2023-10-03T10:12:14.299 INFO:teuthology.orchestra.run.smithi146.stdout: "exists", 2023-10-03T10:12:14.299 INFO:teuthology.orchestra.run.smithi146.stdout: "up" 2023-10-03T10:12:14.299 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.299 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.299 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.299 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": 2, 2023-10-03T10:12:14.299 INFO:teuthology.orchestra.run.smithi146.stdout: "uuid": "8e8d366c-c801-4c1d-b8d7-6f27e5bc0689", 2023-10-03T10:12:14.299 INFO:teuthology.orchestra.run.smithi146.stdout: "up": 1, 2023-10-03T10:12:14.299 INFO:teuthology.orchestra.run.smithi146.stdout: "in": 1, 2023-10-03T10:12:14.299 INFO:teuthology.orchestra.run.smithi146.stdout: "weight": 1, 2023-10-03T10:12:14.299 INFO:teuthology.orchestra.run.smithi146.stdout: "primary_affinity": 1, 2023-10-03T10:12:14.299 INFO:teuthology.orchestra.run.smithi146.stdout: "last_clean_begin": 9, 2023-10-03T10:12:14.299 INFO:teuthology.orchestra.run.smithi146.stdout: "last_clean_end": 24, 2023-10-03T10:12:14.300 INFO:teuthology.orchestra.run.smithi146.stdout: "up_from": 30, 2023-10-03T10:12:14.300 INFO:teuthology.orchestra.run.smithi146.stdout: "up_thru": 31, 2023-10-03T10:12:14.300 INFO:teuthology.orchestra.run.smithi146.stdout: "down_at": 25, 2023-10-03T10:12:14.300 INFO:teuthology.orchestra.run.smithi146.stdout: "lost_at": 0, 2023-10-03T10:12:14.300 INFO:teuthology.orchestra.run.smithi146.stdout: "public_addrs": { 2023-10-03T10:12:14.300 INFO:teuthology.orchestra.run.smithi146.stdout: "addrvec": [ 2023-10-03T10:12:14.300 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.300 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T10:12:14.300 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:6808", 2023-10-03T10:12:14.300 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 129525 2023-10-03T10:12:14.300 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.300 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.300 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_addrs": { 2023-10-03T10:12:14.301 INFO:teuthology.orchestra.run.smithi146.stdout: "addrvec": [ 2023-10-03T10:12:14.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.301 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T10:12:14.301 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:6809", 2023-10-03T10:12:14.301 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 129525 2023-10-03T10:12:14.301 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.301 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.301 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.301 INFO:teuthology.orchestra.run.smithi146.stdout: "heartbeat_back_addrs": { 2023-10-03T10:12:14.301 INFO:teuthology.orchestra.run.smithi146.stdout: "addrvec": [ 2023-10-03T10:12:14.301 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.301 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T10:12:14.301 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:6811", 2023-10-03T10:12:14.301 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 129525 2023-10-03T10:12:14.302 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.302 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.302 INFO:teuthology.orchestra.run.smithi146.stdout: "heartbeat_front_addrs": { 2023-10-03T10:12:14.302 INFO:teuthology.orchestra.run.smithi146.stdout: "addrvec": [ 2023-10-03T10:12:14.302 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.302 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T10:12:14.302 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:6810", 2023-10-03T10:12:14.302 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 129525 2023-10-03T10:12:14.302 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.302 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.302 INFO:teuthology.orchestra.run.smithi146.stdout: "public_addr": "172.21.15.146:6808/129525", 2023-10-03T10:12:14.303 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_addr": "172.21.15.146:6809/129525", 2023-10-03T10:12:14.303 INFO:teuthology.orchestra.run.smithi146.stdout: "heartbeat_back_addr": "172.21.15.146:6811/129525", 2023-10-03T10:12:14.303 INFO:teuthology.orchestra.run.smithi146.stdout: "heartbeat_front_addr": "172.21.15.146:6810/129525", 2023-10-03T10:12:14.303 INFO:teuthology.orchestra.run.smithi146.stdout: "state": [ 2023-10-03T10:12:14.303 INFO:teuthology.orchestra.run.smithi146.stdout: "exists", 2023-10-03T10:12:14.303 INFO:teuthology.orchestra.run.smithi146.stdout: "up" 2023-10-03T10:12:14.303 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.303 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.303 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": 3, 2023-10-03T10:12:14.303 INFO:teuthology.orchestra.run.smithi146.stdout: "uuid": "a581fc17-7f9e-41b1-b070-a1e8c17d6e7e", 2023-10-03T10:12:14.303 INFO:teuthology.orchestra.run.smithi146.stdout: "up": 1, 2023-10-03T10:12:14.303 INFO:teuthology.orchestra.run.smithi146.stdout: "in": 1, 2023-10-03T10:12:14.303 INFO:teuthology.orchestra.run.smithi146.stdout: "weight": 1, 2023-10-03T10:12:14.304 INFO:teuthology.orchestra.run.smithi146.stdout: "primary_affinity": 1, 2023-10-03T10:12:14.304 INFO:teuthology.orchestra.run.smithi146.stdout: "last_clean_begin": 9, 2023-10-03T10:12:14.304 INFO:teuthology.orchestra.run.smithi146.stdout: "last_clean_end": 25, 2023-10-03T10:12:14.304 INFO:teuthology.orchestra.run.smithi146.stdout: "up_from": 31, 2023-10-03T10:12:14.304 INFO:teuthology.orchestra.run.smithi146.stdout: "up_thru": 31, 2023-10-03T10:12:14.304 INFO:teuthology.orchestra.run.smithi146.stdout: "down_at": 26, 2023-10-03T10:12:14.304 INFO:teuthology.orchestra.run.smithi146.stdout: "lost_at": 0, 2023-10-03T10:12:14.304 INFO:teuthology.orchestra.run.smithi146.stdout: "public_addrs": { 2023-10-03T10:12:14.304 INFO:teuthology.orchestra.run.smithi146.stdout: "addrvec": [ 2023-10-03T10:12:14.304 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.304 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T10:12:14.304 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:6812", 2023-10-03T10:12:14.304 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 129865 2023-10-03T10:12:14.305 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.305 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.305 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_addrs": { 2023-10-03T10:12:14.305 INFO:teuthology.orchestra.run.smithi146.stdout: "addrvec": [ 2023-10-03T10:12:14.305 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.305 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T10:12:14.305 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:6813", 2023-10-03T10:12:14.305 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 129865 2023-10-03T10:12:14.305 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.305 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.305 INFO:teuthology.orchestra.run.smithi146.stdout: "heartbeat_back_addrs": { 2023-10-03T10:12:14.305 INFO:teuthology.orchestra.run.smithi146.stdout: "addrvec": [ 2023-10-03T10:12:14.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.306 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T10:12:14.306 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:6815", 2023-10-03T10:12:14.306 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 129865 2023-10-03T10:12:14.306 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.306 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.306 INFO:teuthology.orchestra.run.smithi146.stdout: "heartbeat_front_addrs": { 2023-10-03T10:12:14.306 INFO:teuthology.orchestra.run.smithi146.stdout: "addrvec": [ 2023-10-03T10:12:14.306 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.306 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-03T10:12:14.306 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "172.21.15.146:6814", 2023-10-03T10:12:14.306 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 129865 2023-10-03T10:12:14.307 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.307 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.307 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.307 INFO:teuthology.orchestra.run.smithi146.stdout: "public_addr": "172.21.15.146:6812/129865", 2023-10-03T10:12:14.307 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_addr": "172.21.15.146:6813/129865", 2023-10-03T10:12:14.307 INFO:teuthology.orchestra.run.smithi146.stdout: "heartbeat_back_addr": "172.21.15.146:6815/129865", 2023-10-03T10:12:14.307 INFO:teuthology.orchestra.run.smithi146.stdout: "heartbeat_front_addr": "172.21.15.146:6814/129865", 2023-10-03T10:12:14.307 INFO:teuthology.orchestra.run.smithi146.stdout: "state": [ 2023-10-03T10:12:14.307 INFO:teuthology.orchestra.run.smithi146.stdout: "exists", 2023-10-03T10:12:14.307 INFO:teuthology.orchestra.run.smithi146.stdout: "up" 2023-10-03T10:12:14.307 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.307 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.308 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2023-10-03T10:12:14.308 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_xinfo": [ 2023-10-03T10:12:14.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.308 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": 0, 2023-10-03T10:12:14.308 INFO:teuthology.orchestra.run.smithi146.stdout: "down_stamp": "0.000000", 2023-10-03T10:12:14.308 INFO:teuthology.orchestra.run.smithi146.stdout: "laggy_probability": 0, 2023-10-03T10:12:14.308 INFO:teuthology.orchestra.run.smithi146.stdout: "laggy_interval": 0, 2023-10-03T10:12:14.308 INFO:teuthology.orchestra.run.smithi146.stdout: "features": 4540138322906710015, 2023-10-03T10:12:14.308 INFO:teuthology.orchestra.run.smithi146.stdout: "old_weight": 0, 2023-10-03T10:12:14.308 INFO:teuthology.orchestra.run.smithi146.stdout: "last_purged_snaps_scrub": "2023-10-03T10:09:40.402838+0000", 2023-10-03T10:12:14.308 INFO:teuthology.orchestra.run.smithi146.stdout: "dead_epoch": 23 2023-10-03T10:12:14.308 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.308 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.308 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": 1, 2023-10-03T10:12:14.309 INFO:teuthology.orchestra.run.smithi146.stdout: "down_stamp": "0.000000", 2023-10-03T10:12:14.309 INFO:teuthology.orchestra.run.smithi146.stdout: "laggy_probability": 0, 2023-10-03T10:12:14.309 INFO:teuthology.orchestra.run.smithi146.stdout: "laggy_interval": 0, 2023-10-03T10:12:14.309 INFO:teuthology.orchestra.run.smithi146.stdout: "features": 4540138322906710015, 2023-10-03T10:12:14.309 INFO:teuthology.orchestra.run.smithi146.stdout: "old_weight": 0, 2023-10-03T10:12:14.309 INFO:teuthology.orchestra.run.smithi146.stdout: "last_purged_snaps_scrub": "2023-10-03T10:09:40.443261+0000", 2023-10-03T10:12:14.309 INFO:teuthology.orchestra.run.smithi146.stdout: "dead_epoch": 24 2023-10-03T10:12:14.309 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.309 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.309 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": 2, 2023-10-03T10:12:14.309 INFO:teuthology.orchestra.run.smithi146.stdout: "down_stamp": "0.000000", 2023-10-03T10:12:14.309 INFO:teuthology.orchestra.run.smithi146.stdout: "laggy_probability": 0, 2023-10-03T10:12:14.309 INFO:teuthology.orchestra.run.smithi146.stdout: "laggy_interval": 0, 2023-10-03T10:12:14.310 INFO:teuthology.orchestra.run.smithi146.stdout: "features": 4540138322906710015, 2023-10-03T10:12:14.310 INFO:teuthology.orchestra.run.smithi146.stdout: "old_weight": 0, 2023-10-03T10:12:14.310 INFO:teuthology.orchestra.run.smithi146.stdout: "last_purged_snaps_scrub": "2023-10-03T10:09:40.532837+0000", 2023-10-03T10:12:14.310 INFO:teuthology.orchestra.run.smithi146.stdout: "dead_epoch": 25 2023-10-03T10:12:14.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.310 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.310 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": 3, 2023-10-03T10:12:14.310 INFO:teuthology.orchestra.run.smithi146.stdout: "down_stamp": "2023-10-03T10:12:05.426236+0000", 2023-10-03T10:12:14.310 INFO:teuthology.orchestra.run.smithi146.stdout: "laggy_probability": 0, 2023-10-03T10:12:14.310 INFO:teuthology.orchestra.run.smithi146.stdout: "laggy_interval": 0, 2023-10-03T10:12:14.310 INFO:teuthology.orchestra.run.smithi146.stdout: "features": 4540138322906710015, 2023-10-03T10:12:14.310 INFO:teuthology.orchestra.run.smithi146.stdout: "old_weight": 0, 2023-10-03T10:12:14.310 INFO:teuthology.orchestra.run.smithi146.stdout: "last_purged_snaps_scrub": "2023-10-03T10:09:40.549051+0000", 2023-10-03T10:12:14.311 INFO:teuthology.orchestra.run.smithi146.stdout: "dead_epoch": 0 2023-10-03T10:12:14.311 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.311 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2023-10-03T10:12:14.311 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_upmap": [], 2023-10-03T10:12:14.311 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_upmap_items": [ 2023-10-03T10:12:14.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.311 INFO:teuthology.orchestra.run.smithi146.stdout: "pgid": "4.b", 2023-10-03T10:12:14.311 INFO:teuthology.orchestra.run.smithi146.stdout: "mappings": [ 2023-10-03T10:12:14.311 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.311 INFO:teuthology.orchestra.run.smithi146.stdout: "from": 1, 2023-10-03T10:12:14.311 INFO:teuthology.orchestra.run.smithi146.stdout: "to": 2 2023-10-03T10:12:14.311 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.311 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.312 INFO:teuthology.orchestra.run.smithi146.stdout: "pgid": "4.f", 2023-10-03T10:12:14.312 INFO:teuthology.orchestra.run.smithi146.stdout: "mappings": [ 2023-10-03T10:12:14.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.312 INFO:teuthology.orchestra.run.smithi146.stdout: "from": 3, 2023-10-03T10:12:14.312 INFO:teuthology.orchestra.run.smithi146.stdout: "to": 0 2023-10-03T10:12:14.312 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.312 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.312 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.312 INFO:teuthology.orchestra.run.smithi146.stdout: "pgid": "4.1b", 2023-10-03T10:12:14.312 INFO:teuthology.orchestra.run.smithi146.stdout: "mappings": [ 2023-10-03T10:12:14.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.313 INFO:teuthology.orchestra.run.smithi146.stdout: "from": 3, 2023-10-03T10:12:14.313 INFO:teuthology.orchestra.run.smithi146.stdout: "to": 0 2023-10-03T10:12:14.313 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.313 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.313 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.313 INFO:teuthology.orchestra.run.smithi146.stdout: "pgid": "4.22", 2023-10-03T10:12:14.313 INFO:teuthology.orchestra.run.smithi146.stdout: "mappings": [ 2023-10-03T10:12:14.313 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.313 INFO:teuthology.orchestra.run.smithi146.stdout: "from": 3, 2023-10-03T10:12:14.313 INFO:teuthology.orchestra.run.smithi146.stdout: "to": 2 2023-10-03T10:12:14.313 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.313 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.314 INFO:teuthology.orchestra.run.smithi146.stdout: "pgid": "4.29", 2023-10-03T10:12:14.314 INFO:teuthology.orchestra.run.smithi146.stdout: "mappings": [ 2023-10-03T10:12:14.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.314 INFO:teuthology.orchestra.run.smithi146.stdout: "from": 3, 2023-10-03T10:12:14.314 INFO:teuthology.orchestra.run.smithi146.stdout: "to": 2 2023-10-03T10:12:14.314 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.314 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.314 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.314 INFO:teuthology.orchestra.run.smithi146.stdout: "pgid": "4.2f", 2023-10-03T10:12:14.314 INFO:teuthology.orchestra.run.smithi146.stdout: "mappings": [ 2023-10-03T10:12:14.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.315 INFO:teuthology.orchestra.run.smithi146.stdout: "from": 3, 2023-10-03T10:12:14.315 INFO:teuthology.orchestra.run.smithi146.stdout: "to": 2 2023-10-03T10:12:14.315 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.315 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.315 INFO:teuthology.orchestra.run.smithi146.stdout: "pgid": "4.3a", 2023-10-03T10:12:14.315 INFO:teuthology.orchestra.run.smithi146.stdout: "mappings": [ 2023-10-03T10:12:14.315 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.315 INFO:teuthology.orchestra.run.smithi146.stdout: "from": 3, 2023-10-03T10:12:14.315 INFO:teuthology.orchestra.run.smithi146.stdout: "to": 0 2023-10-03T10:12:14.315 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.315 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.316 INFO:teuthology.orchestra.run.smithi146.stdout: "pgid": "4.3b", 2023-10-03T10:12:14.316 INFO:teuthology.orchestra.run.smithi146.stdout: "mappings": [ 2023-10-03T10:12:14.316 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-03T10:12:14.316 INFO:teuthology.orchestra.run.smithi146.stdout: "from": 3, 2023-10-03T10:12:14.316 INFO:teuthology.orchestra.run.smithi146.stdout: "to": 2 2023-10-03T10:12:14.316 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.316 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-03T10:12:14.316 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.316 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2023-10-03T10:12:14.316 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_upmap_primaries": [], 2023-10-03T10:12:14.316 INFO:teuthology.orchestra.run.smithi146.stdout: "pg_temp": [], 2023-10-03T10:12:14.317 INFO:teuthology.orchestra.run.smithi146.stdout: "primary_temp": [], 2023-10-03T10:12:14.317 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklist": { 2023-10-03T10:12:14.317 INFO:teuthology.orchestra.run.smithi146.stdout: "172.21.15.146:6817/4164614194": "2023-10-04T10:12:13.686998+0000", 2023-10-03T10:12:14.317 INFO:teuthology.orchestra.run.smithi146.stdout: "172.21.15.146:0/45915595": "2023-10-04T10:11:52.317723+0000", 2023-10-03T10:12:14.317 INFO:teuthology.orchestra.run.smithi146.stdout: "172.21.15.146:0/1896339219": "2023-10-04T10:11:52.317723+0000", 2023-10-03T10:12:14.317 INFO:teuthology.orchestra.run.smithi146.stdout: "172.21.15.146:6816/118159": "2023-10-04T10:11:52.317723+0000" 2023-10-03T10:12:14.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.317 INFO:teuthology.orchestra.run.smithi146.stdout: "range_blocklist": {}, 2023-10-03T10:12:14.317 INFO:teuthology.orchestra.run.smithi146.stdout: "erasure_code_profiles": { 2023-10-03T10:12:14.317 INFO:teuthology.orchestra.run.smithi146.stdout: "default": { 2023-10-03T10:12:14.317 INFO:teuthology.orchestra.run.smithi146.stdout: "crush-failure-domain": "osd", 2023-10-03T10:12:14.317 INFO:teuthology.orchestra.run.smithi146.stdout: "k": "2", 2023-10-03T10:12:14.317 INFO:teuthology.orchestra.run.smithi146.stdout: "m": "1", 2023-10-03T10:12:14.318 INFO:teuthology.orchestra.run.smithi146.stdout: "plugin": "jerasure", 2023-10-03T10:12:14.318 INFO:teuthology.orchestra.run.smithi146.stdout: "technique": "reed_sol_van" 2023-10-03T10:12:14.318 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.318 INFO:teuthology.orchestra.run.smithi146.stdout: "removed_snaps_queue": [], 2023-10-03T10:12:14.318 INFO:teuthology.orchestra.run.smithi146.stdout: "new_removed_snaps": [], 2023-10-03T10:12:14.318 INFO:teuthology.orchestra.run.smithi146.stdout: "new_purged_snaps": [], 2023-10-03T10:12:14.318 INFO:teuthology.orchestra.run.smithi146.stdout: "crush_node_flags": {}, 2023-10-03T10:12:14.318 INFO:teuthology.orchestra.run.smithi146.stdout: "device_class_flags": {}, 2023-10-03T10:12:14.318 INFO:teuthology.orchestra.run.smithi146.stdout: "stretch_mode": { 2023-10-03T10:12:14.318 INFO:teuthology.orchestra.run.smithi146.stdout: "stretch_mode_enabled": false, 2023-10-03T10:12:14.318 INFO:teuthology.orchestra.run.smithi146.stdout: "stretch_bucket_count": 0, 2023-10-03T10:12:14.319 INFO:teuthology.orchestra.run.smithi146.stdout: "degraded_stretch_mode": 0, 2023-10-03T10:12:14.319 INFO:teuthology.orchestra.run.smithi146.stdout: "recovering_stretch_mode": 0, 2023-10-03T10:12:14.319 INFO:teuthology.orchestra.run.smithi146.stdout: "stretch_mode_bucket": 0 2023-10-03T10:12:14.319 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.319 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-03T10:12:14.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.263+0000 7fd5a3b12700 1 -- 172.21.15.146:0/1910803546 >> v1:172.21.15.146:6816/126749 conn(0x7fd58002f510 legacy=0x7fd5800319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.263+0000 7fd5a3b12700 1 -- 172.21.15.146:0/1910803546 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd59c09da00 msgr2=0x7fd59c120930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.263+0000 7fd5a3b12700 1 --2- 172.21.15.146:0/1910803546 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd59c09da00 0x7fd59c120930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00ebe0 tx=0x7fd58c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.263+0000 7fd5a3b12700 1 -- 172.21.15.146:0/1910803546 shutdown_connections 2023-10-03T10:12:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.263+0000 7fd5a3b12700 1 --2- 172.21.15.146:0/1910803546 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd59c134e40 0x7fd59c1c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.263+0000 7fd5a3b12700 1 --2- 172.21.15.146:0/1910803546 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd59c09da00 0x7fd59c120930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.263+0000 7fd5a3b12700 1 --2- 172.21.15.146:0/1910803546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd59c09e310 0x7fd59c120e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.263+0000 7fd5a3b12700 1 -- 172.21.15.146:0/1910803546 >> 172.21.15.146:0/1910803546 conn(0x7fd59c099e60 msgr2=0x7fd59c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.263+0000 7fd5a3b12700 1 -- 172.21.15.146:0/1910803546 shutdown_connections 2023-10-03T10:12:14.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.263+0000 7fd5a3b12700 1 -- 172.21.15.146:0/1910803546 wait complete. 2023-10-03T10:12:14.321 DEBUG:teuthology.orchestra.run.smithi146:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2023-10-03T10:12:14.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.438+0000 7fecbc5e5700 1 Processor -- start 2023-10-03T10:12:14.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.438+0000 7fecbc5e5700 1 -- start start 2023-10-03T10:12:14.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.439+0000 7fecbc5e5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb409da00 0x7fecb409ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.439+0000 7fecbc5e5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb409e310 0x7fecb4134900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.439+0000 7fecbc5e5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb409bca0 con 0x7fecb4134e40 2023-10-03T10:12:14.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.439+0000 7fecbc5e5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb409b500 con 0x7fecb409da00 2023-10-03T10:12:14.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.439+0000 7fecbc5e5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecb409c880 con 0x7fecb409e310 2023-10-03T10:12:14.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.439+0000 7fecba381700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb409da00 0x7fecb409ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.439+0000 7fecbab82700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fecb4134e40 0x7fecb4137220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39156/0 (socket says 172.21.15.146:39156) 2023-10-03T10:12:14.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.439+0000 7fecbab82700 1 -- 172.21.15.146:0/3991290011 learned_addr learned my addr 172.21.15.146:0/3991290011 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:14.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.439+0000 7fecb9b80700 1 --2- 172.21.15.146:0/3991290011 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb409e310 0x7fecb4134900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.439+0000 7fecba381700 1 -- 172.21.15.146:0/3991290011 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb409e310 msgr2=0x7fecb4134900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:14.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.439+0000 7fecba381700 1 --2- 172.21.15.146:0/3991290011 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb409e310 0x7fecb4134900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.439+0000 7fecba381700 1 -- 172.21.15.146:0/3991290011 >> v1:172.21.15.146:6789/0 conn(0x7fecb4134e40 legacy=0x7fecb4137220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.439+0000 7fecba381700 1 -- 172.21.15.146:0/3991290011 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb409ac80 con 0x7fecb409da00 2023-10-03T10:12:14.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.439+0000 7fecb937f700 1 -- 172.21.15.146:0/3991290011 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3562963931 0 0) 0x7fecb409bca0 con 0x7fecb4134e40 2023-10-03T10:12:14.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.439+0000 7fecb9b80700 1 --2- 172.21.15.146:0/3991290011 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb409e310 0x7fecb4134900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:14.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.439+0000 7fecba381700 1 --2- 172.21.15.146:0/3991290011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb409da00 0x7fecb409ddd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feca4009870 tx=0x7feca4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dea75b390011fe5a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:14.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.439+0000 7fecb937f700 1 -- 172.21.15.146:0/3991290011 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca4011830 con 0x7fecb409da00 2023-10-03T10:12:14.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.439+0000 7fecb937f700 1 -- 172.21.15.146:0/3991290011 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca4011990 con 0x7fecb409da00 2023-10-03T10:12:14.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.439+0000 7fecb937f700 1 -- 172.21.15.146:0/3991290011 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca4011d20 con 0x7fecb409da00 2023-10-03T10:12:14.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.440+0000 7fecbc5e5700 1 -- 172.21.15.146:0/3991290011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb409da00 msgr2=0x7fecb409ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.440+0000 7fecbc5e5700 1 --2- 172.21.15.146:0/3991290011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb409da00 0x7fecb409ddd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feca4009870 tx=0x7feca4009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:14.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.440+0000 7fecbc5e5700 1 -- 172.21.15.146:0/3991290011 shutdown_connections 2023-10-03T10:12:14.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.440+0000 7fecbc5e5700 1 --2- 172.21.15.146:0/3991290011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb409da00 0x7fecb409ddd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.440+0000 7fecbc5e5700 1 --2- 172.21.15.146:0/3991290011 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb409e310 0x7fecb4134900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.440+0000 7fecbc5e5700 1 -- 172.21.15.146:0/3991290011 >> 172.21.15.146:0/3991290011 conn(0x7fecb4099e60 msgr2=0x7fecb40a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:14.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.440+0000 7fecbc5e5700 1 -- 172.21.15.146:0/3991290011 shutdown_connections 2023-10-03T10:12:14.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.440+0000 7fecbc5e5700 1 -- 172.21.15.146:0/3991290011 wait complete. 2023-10-03T10:12:14.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.441+0000 7fecbc5e5700 1 Processor -- start 2023-10-03T10:12:14.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.441+0000 7fecbc5e5700 1 -- start start 2023-10-03T10:12:14.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.441+0000 7fecbc5e5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecb409da00 0x7fecb41c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.441+0000 7fecbc5e5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb409e310 0x7fecb41c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.441+0000 7fecbc5e5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb4134e40 0x7fecb411d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.441+0000 7fecbc5e5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb411f610 con 0x7fecb409da00 2023-10-03T10:12:14.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.441+0000 7fecbc5e5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb411f420 con 0x7fecb409e310 2023-10-03T10:12:14.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.441+0000 7fecbc5e5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecb41321a0 con 0x7fecb4134e40 2023-10-03T10:12:14.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.441+0000 7fecba381700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecb409da00 0x7fecb41c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.441+0000 7fecb9b80700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb409e310 0x7fecb41c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.441+0000 7fecbab82700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb4134e40 0x7fecb411d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.441+0000 7fecb9b80700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb409e310 0x7fecb41c6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33596/0 (socket says 172.21.15.146:33596) 2023-10-03T10:12:14.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.441+0000 7fecb9b80700 1 -- 172.21.15.146:0/1006432707 learned_addr learned my addr 172.21.15.146:0/1006432707 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:14.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.441+0000 7fecba381700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecb409da00 0x7fecb41c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46768/0 (socket says 172.21.15.146:46768) 2023-10-03T10:12:14.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.441+0000 7fecbab82700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb4134e40 0x7fecb411d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54026/0 (socket says 172.21.15.146:54026) 2023-10-03T10:12:14.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.442+0000 7fecb9b80700 1 -- 172.21.15.146:0/1006432707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb4134e40 msgr2=0x7fecb411d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.442+0000 7fecb9b80700 1 --2- 172.21.15.146:0/1006432707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb4134e40 0x7fecb411d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.442+0000 7fecb9b80700 1 -- 172.21.15.146:0/1006432707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecb409da00 msgr2=0x7fecb41c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.442+0000 7fecb9b80700 1 --2- 172.21.15.146:0/1006432707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecb409da00 0x7fecb41c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.442+0000 7fecb9b80700 1 -- 172.21.15.146:0/1006432707 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb00094a0 con 0x7fecb409e310 2023-10-03T10:12:14.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.442+0000 7fecba381700 1 --2- 172.21.15.146:0/1006432707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecb409da00 0x7fecb41c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:14.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.442+0000 7fecbab82700 1 --2- 172.21.15.146:0/1006432707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb4134e40 0x7fecb411d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:14.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.442+0000 7fecb9b80700 1 --2- 172.21.15.146:0/1006432707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb409e310 0x7fecb41c6c40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fecb000ebe0 tx=0x7fecb000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:14.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.442+0000 7fecaaffd700 1 -- 172.21.15.146:0/1006432707 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb000c850 con 0x7fecb409e310 2023-10-03T10:12:14.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.442+0000 7fecaaffd700 1 -- 172.21.15.146:0/1006432707 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb000c9b0 con 0x7fecb409e310 2023-10-03T10:12:14.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.442+0000 7fecbc5e5700 1 -- 172.21.15.146:0/1006432707 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca40094a0 con 0x7fecb409e310 2023-10-03T10:12:14.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.442+0000 7fecaaffd700 1 -- 172.21.15.146:0/1006432707 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb000cd40 con 0x7fecb409e310 2023-10-03T10:12:14.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.442+0000 7fecbc5e5700 1 -- 172.21.15.146:0/1006432707 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb4121050 con 0x7fecb409e310 2023-10-03T10:12:14.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.443+0000 7fecaaffd700 1 -- 172.21.15.146:0/1006432707 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fecb0013470 con 0x7fecb409e310 2023-10-03T10:12:14.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.443+0000 7fecaaffd700 1 -- 172.21.15.146:0/1006432707 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fecb003fcc0 con 0x7fecb409e310 2023-10-03T10:12:14.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.443+0000 7fecbc5e5700 1 -- 172.21.15.146:0/1006432707 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb4120cf0 con 0x7fecb409e310 2023-10-03T10:12:14.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.448+0000 7fecaaffd700 1 -- 172.21.15.146:0/1006432707 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fecb4120cf0 con 0x7fecb409e310 2023-10-03T10:12:14.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.711+0000 7fecbc5e5700 1 -- 172.21.15.146:0/1006432707 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fecb4120eb0 con 0x7fecb409e310 2023-10-03T10:12:14.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.712+0000 7fecaaffd700 1 -- 172.21.15.146:0/1006432707 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+627 (secure 0 0 0) 0x7fecb4120eb0 con 0x7fecb409e310 2023-10-03T10:12:14.713 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-03T10:12:14.713 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": { 2023-10-03T10:12:14.713 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 3 2023-10-03T10:12:14.713 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.713 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": { 2023-10-03T10:12:14.713 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 1 2023-10-03T10:12:14.713 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.713 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": { 2023-10-03T10:12:14.713 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 4 2023-10-03T10:12:14.713 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.713 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": { 2023-10-03T10:12:14.713 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 1 2023-10-03T10:12:14.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-03T10:12:14.714 INFO:teuthology.orchestra.run.smithi146.stdout: "overall": { 2023-10-03T10:12:14.714 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 9 2023-10-03T10:12:14.714 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-03T10:12:14.714 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-03T10:12:14.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.714+0000 7fecbc5e5700 1 -- 172.21.15.146:0/1006432707 >> v1:172.21.15.146:6816/126749 conn(0x7fec9802f510 legacy=0x7fec980319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.714+0000 7fecbc5e5700 1 -- 172.21.15.146:0/1006432707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb409e310 msgr2=0x7fecb41c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.714+0000 7fecbc5e5700 1 --2- 172.21.15.146:0/1006432707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb409e310 0x7fecb41c6c40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fecb000ebe0 tx=0x7fecb000eef0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.714+0000 7fecbc5e5700 1 -- 172.21.15.146:0/1006432707 shutdown_connections 2023-10-03T10:12:14.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.714+0000 7fecbc5e5700 1 --2- 172.21.15.146:0/1006432707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb4134e40 0x7fecb411d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.714+0000 7fecbc5e5700 1 --2- 172.21.15.146:0/1006432707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecb409da00 0x7fecb41c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.714+0000 7fecbc5e5700 1 --2- 172.21.15.146:0/1006432707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb409e310 0x7fecb41c6c40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.714+0000 7fecbc5e5700 1 -- 172.21.15.146:0/1006432707 >> 172.21.15.146:0/1006432707 conn(0x7fecb4099e60 msgr2=0x7fecb406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:14.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.714+0000 7fecbc5e5700 1 -- 172.21.15.146:0/1006432707 shutdown_connections 2023-10-03T10:12:14.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.714+0000 7fecbc5e5700 1 -- 172.21.15.146:0/1006432707 wait complete. 2023-10-03T10:12:14.726 DEBUG:teuthology.orchestra.run.smithi146:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2023-10-03T10:12:14.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.845+0000 7fe7fb6dc700 1 Processor -- start 2023-10-03T10:12:14.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.846+0000 7fe7fb6dc700 1 -- start start 2023-10-03T10:12:14.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.846+0000 7fe7fb6dc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe7f4131640 0x7fe7f4131a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.846+0000 7fe7fb6dc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7f409bf10 0x7fe7f4131f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.846+0000 7fe7fb6dc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7f4097090 0x7fe7f40974e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.846+0000 7fe7fb6dc700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f409b920 con 0x7fe7f4131640 2023-10-03T10:12:14.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.846+0000 7fe7fb6dc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f4132490 con 0x7fe7f409bf10 2023-10-03T10:12:14.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.846+0000 7fe7fb6dc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f409f750 con 0x7fe7f4097090 2023-10-03T10:12:14.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.846+0000 7fe7f9478700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe7f4131640 0x7fe7f4131a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.846+0000 7fe7f8c77700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7f409bf10 0x7fe7f4131f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.846+0000 7fe7f9478700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe7f4131640 0x7fe7f4131a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46772/0 (socket says 172.21.15.146:46772) 2023-10-03T10:12:14.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.846+0000 7fe7f8c77700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7f409bf10 0x7fe7f4131f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33598/0 (socket says 172.21.15.146:33598) 2023-10-03T10:12:14.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.846+0000 7fe7f9478700 1 -- 172.21.15.146:0/4201903338 learned_addr learned my addr 172.21.15.146:0/4201903338 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:14.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.846+0000 7fe7f9c79700 1 --2- 172.21.15.146:0/4201903338 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7f4097090 0x7fe7f40974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.846+0000 7fe7f9478700 1 -- 172.21.15.146:0/4201903338 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7f4097090 msgr2=0x7fe7f40974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:14.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.846+0000 7fe7f9478700 1 --2- 172.21.15.146:0/4201903338 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7f4097090 0x7fe7f40974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.847+0000 7fe7f9478700 1 -- 172.21.15.146:0/4201903338 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7f409bf10 msgr2=0x7fe7f4131f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:14.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.847+0000 7fe7f9478700 1 --2- 172.21.15.146:0/4201903338 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7f409bf10 0x7fe7f4131f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.847+0000 7fe7f9478700 1 -- 172.21.15.146:0/4201903338 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f409d2e0 con 0x7fe7f4131640 2023-10-03T10:12:14.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.847+0000 7fe7f8c77700 1 --2- 172.21.15.146:0/4201903338 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7f409bf10 0x7fe7f4131f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:14.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.847+0000 7fe7f9c79700 1 --2- 172.21.15.146:0/4201903338 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7f4097090 0x7fe7f40974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:14.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.847+0000 7fe7f9478700 1 --2- 172.21.15.146:0/4201903338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7f4131640 0x7fe7f4131a10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00098f0 tx=0x7fe7f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f784303a30e7b070 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:14.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.847+0000 7fe7ebfff700 1 -- 172.21.15.146:0/4201903338 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0011830 con 0x7fe7f4131640 2023-10-03T10:12:14.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.847+0000 7fe7ebfff700 1 -- 172.21.15.146:0/4201903338 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f0011990 con 0x7fe7f4131640 2023-10-03T10:12:14.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.847+0000 7fe7ebfff700 1 -- 172.21.15.146:0/4201903338 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0011d20 con 0x7fe7f4131640 2023-10-03T10:12:14.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.847+0000 7fe7fb6dc700 1 -- 172.21.15.146:0/4201903338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7f4131640 msgr2=0x7fe7f4131a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.847+0000 7fe7fb6dc700 1 --2- 172.21.15.146:0/4201903338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7f4131640 0x7fe7f4131a10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00098f0 tx=0x7fe7f0009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:14.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.847+0000 7fe7fb6dc700 1 -- 172.21.15.146:0/4201903338 shutdown_connections 2023-10-03T10:12:14.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.847+0000 7fe7fb6dc700 1 --2- 172.21.15.146:0/4201903338 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7f4097090 0x7fe7f40974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.847+0000 7fe7fb6dc700 1 --2- 172.21.15.146:0/4201903338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7f4131640 0x7fe7f4131a10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.847+0000 7fe7fb6dc700 1 --2- 172.21.15.146:0/4201903338 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7f409bf10 0x7fe7f4131f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.848+0000 7fe7fb6dc700 1 -- 172.21.15.146:0/4201903338 >> 172.21.15.146:0/4201903338 conn(0x7fe7f40a4630 msgr2=0x7fe7f40a4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:14.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.848+0000 7fe7fb6dc700 1 -- 172.21.15.146:0/4201903338 shutdown_connections 2023-10-03T10:12:14.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.848+0000 7fe7fb6dc700 1 -- 172.21.15.146:0/4201903338 wait complete. 2023-10-03T10:12:14.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.849+0000 7fe7fb6dc700 1 Processor -- start 2023-10-03T10:12:14.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.849+0000 7fe7fb6dc700 1 -- start start 2023-10-03T10:12:14.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.849+0000 7fe7fb6dc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7f4097090 0x7fe7f412a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.849+0000 7fe7fb6dc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7f409bf10 0x7fe7f412a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.849+0000 7fe7fb6dc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7f4131640 0x7fe7f412ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.849+0000 7fe7fb6dc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f412d6a0 con 0x7fe7f4131640 2023-10-03T10:12:14.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.849+0000 7fe7fb6dc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f40a2b80 con 0x7fe7f4097090 2023-10-03T10:12:14.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.849+0000 7fe7fb6dc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f409c750 con 0x7fe7f409bf10 2023-10-03T10:12:14.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.849+0000 7fe7f8c77700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7f409bf10 0x7fe7f412a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.849+0000 7fe7f8c77700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7f409bf10 0x7fe7f412a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54042/0 (socket says 172.21.15.146:54042) 2023-10-03T10:12:14.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.849+0000 7fe7f8c77700 1 -- 172.21.15.146:0/2141243995 learned_addr learned my addr 172.21.15.146:0/2141243995 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:14.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.849+0000 7fe7f9478700 1 --2- 172.21.15.146:0/2141243995 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7f4097090 0x7fe7f412a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.849+0000 7fe7f9c79700 1 --2- 172.21.15.146:0/2141243995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7f4131640 0x7fe7f412ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.849+0000 7fe7f8c77700 1 -- 172.21.15.146:0/2141243995 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7f4097090 msgr2=0x7fe7f412a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.849+0000 7fe7f8c77700 1 --2- 172.21.15.146:0/2141243995 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7f4097090 0x7fe7f412a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.849+0000 7fe7f8c77700 1 -- 172.21.15.146:0/2141243995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7f4131640 msgr2=0x7fe7f412ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.849+0000 7fe7f8c77700 1 --2- 172.21.15.146:0/2141243995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7f4131640 0x7fe7f412ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.849+0000 7fe7f8c77700 1 -- 172.21.15.146:0/2141243995 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ec009a70 con 0x7fe7f409bf10 2023-10-03T10:12:14.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.850+0000 7fe7f8c77700 1 --2- 172.21.15.146:0/2141243995 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7f409bf10 0x7fe7f412a860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4012fc0 tx=0x7fe7e40103a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:14.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.850+0000 7fe7e9ffb700 1 -- 172.21.15.146:0/2141243995 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e400d2d0 con 0x7fe7f409bf10 2023-10-03T10:12:14.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.850+0000 7fe7e9ffb700 1 -- 172.21.15.146:0/2141243995 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e4013040 con 0x7fe7f409bf10 2023-10-03T10:12:14.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.850+0000 7fe7fb6dc700 1 -- 172.21.15.146:0/2141243995 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e400d940 con 0x7fe7f409bf10 2023-10-03T10:12:14.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.850+0000 7fe7e9ffb700 1 -- 172.21.15.146:0/2141243995 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4010bf0 con 0x7fe7f409bf10 2023-10-03T10:12:14.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.850+0000 7fe7fb6dc700 1 -- 172.21.15.146:0/2141243995 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f0009550 con 0x7fe7f409bf10 2023-10-03T10:12:14.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.851+0000 7fe7e9ffb700 1 -- 172.21.15.146:0/2141243995 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe7e4010d50 con 0x7fe7f409bf10 2023-10-03T10:12:14.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.851+0000 7fe7e9ffb700 1 -- 172.21.15.146:0/2141243995 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fe7e4043950 con 0x7fe7f409bf10 2023-10-03T10:12:14.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.851+0000 7fe7fb6dc700 1 -- 172.21.15.146:0/2141243995 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f4097600 con 0x7fe7f409bf10 2023-10-03T10:12:14.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:14.856+0000 7fe7e9ffb700 1 -- 172.21.15.146:0/2141243995 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe7e400b450 con 0x7fe7f409bf10 2023-10-03T10:12:15.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.040+0000 7fe7fb6dc700 1 -- 172.21.15.146:0/2141243995 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7fe7f4068580 con 0x7fe7f409bf10 2023-10-03T10:12:15.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.041+0000 7fe7e9ffb700 1 -- 172.21.15.146:0/2141243995 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v33) v1 ==== 59+0+37 (secure 0 0 0) 0x7fe7e4020370 con 0x7fe7f409bf10 2023-10-03T10:12:15.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.043+0000 7fe7fb6dc700 1 -- 172.21.15.146:0/2141243995 >> v1:172.21.15.146:6816/126749 conn(0x7fe7d802f540 legacy=0x7fe7d80319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.043+0000 7fe7fb6dc700 1 -- 172.21.15.146:0/2141243995 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7f409bf10 msgr2=0x7fe7f412a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.043+0000 7fe7fb6dc700 1 --2- 172.21.15.146:0/2141243995 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7f409bf10 0x7fe7f412a860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4012fc0 tx=0x7fe7e40103a0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.043+0000 7fe7fb6dc700 1 -- 172.21.15.146:0/2141243995 shutdown_connections 2023-10-03T10:12:15.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.043+0000 7fe7fb6dc700 1 --2- 172.21.15.146:0/2141243995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7f4131640 0x7fe7f412ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.043+0000 7fe7fb6dc700 1 --2- 172.21.15.146:0/2141243995 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7f4097090 0x7fe7f412a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.043+0000 7fe7fb6dc700 1 --2- 172.21.15.146:0/2141243995 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7f409bf10 0x7fe7f412a860 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.043+0000 7fe7fb6dc700 1 -- 172.21.15.146:0/2141243995 >> 172.21.15.146:0/2141243995 conn(0x7fe7f40a4630 msgr2=0x7fe7f40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.043+0000 7fe7fb6dc700 1 -- 172.21.15.146:0/2141243995 shutdown_connections 2023-10-03T10:12:15.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.043+0000 7fe7fb6dc700 1 -- 172.21.15.146:0/2141243995 wait complete. 2023-10-03T10:12:15.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.150+0000 7f2d8473d700 1 Processor -- start 2023-10-03T10:12:15.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.150+0000 7f2d8473d700 1 -- start start 2023-10-03T10:12:15.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.151+0000 7f2d8473d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2d7c131b60 0x7f2d7c131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.151+0000 7f2d8473d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d7c06fce0 0x7f2d7c0700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.151+0000 7f2d8473d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d7c0719b0 con 0x7f2d7c070630 2023-10-03T10:12:15.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.151+0000 7f2d8473d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d7c1316c0 con 0x7f2d7c131b60 2023-10-03T10:12:15.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.151+0000 7f2d8473d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c071430 con 0x7f2d7c06fce0 2023-10-03T10:12:15.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.151+0000 7f2d81cd8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d7c06fce0 0x7f2d7c0700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.151+0000 7f2d824d9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2d7c131b60 0x7f2d7c131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.151+0000 7f2d81cd8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d7c06fce0 0x7f2d7c0700f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33612/0 (socket says 172.21.15.146:33612) 2023-10-03T10:12:15.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.151+0000 7f2d82cda700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2d7c070630 0x7f2d7c1389f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39160/0 (socket says 172.21.15.146:39160) 2023-10-03T10:12:15.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.151+0000 7f2d824d9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2d7c131b60 0x7f2d7c131f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46790/0 (socket says 172.21.15.146:46790) 2023-10-03T10:12:15.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.151+0000 7f2d81cd8700 1 -- 172.21.15.146:0/2439590734 learned_addr learned my addr 172.21.15.146:0/2439590734 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:15.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.151+0000 7f2d824d9700 1 -- 172.21.15.146:0/2439590734 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d7c06fce0 msgr2=0x7f2d7c0700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.151+0000 7f2d824d9700 1 --2- 172.21.15.146:0/2439590734 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d7c06fce0 0x7f2d7c0700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.151+0000 7f2d824d9700 1 -- 172.21.15.146:0/2439590734 >> v1:172.21.15.146:6789/0 conn(0x7f2d7c070630 legacy=0x7f2d7c1389f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.151+0000 7f2d824d9700 1 -- 172.21.15.146:0/2439590734 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7c0a0550 con 0x7f2d7c131b60 2023-10-03T10:12:15.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.151+0000 7f2d814d7700 1 -- 172.21.15.146:0/2439590734 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 254450512 0 0) 0x7f2d7c0719b0 con 0x7f2d7c070630 2023-10-03T10:12:15.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.151+0000 7f2d81cd8700 1 --2- 172.21.15.146:0/2439590734 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d7c06fce0 0x7f2d7c0700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:15.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.151+0000 7f2d824d9700 1 --2- 172.21.15.146:0/2439590734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d7c131b60 0x7f2d7c131f30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009840 tx=0x7f2d6c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617194ad49eb2d34 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.152+0000 7f2d814d7700 1 -- 172.21.15.146:0/2439590734 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c011830 con 0x7f2d7c131b60 2023-10-03T10:12:15.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.152+0000 7f2d814d7700 1 -- 172.21.15.146:0/2439590734 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6c011990 con 0x7f2d7c131b60 2023-10-03T10:12:15.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.152+0000 7f2d814d7700 1 -- 172.21.15.146:0/2439590734 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c011d20 con 0x7f2d7c131b60 2023-10-03T10:12:15.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.152+0000 7f2d8473d700 1 -- 172.21.15.146:0/2439590734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d7c131b60 msgr2=0x7f2d7c131f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.152+0000 7f2d8473d700 1 --2- 172.21.15.146:0/2439590734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d7c131b60 0x7f2d7c131f30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009840 tx=0x7f2d6c009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:15.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.152+0000 7f2d8473d700 1 -- 172.21.15.146:0/2439590734 shutdown_connections 2023-10-03T10:12:15.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.152+0000 7f2d8473d700 1 --2- 172.21.15.146:0/2439590734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d7c131b60 0x7f2d7c131f30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.152+0000 7f2d8473d700 1 --2- 172.21.15.146:0/2439590734 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d7c06fce0 0x7f2d7c0700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.152+0000 7f2d8473d700 1 -- 172.21.15.146:0/2439590734 >> 172.21.15.146:0/2439590734 conn(0x7f2d7c0a4230 msgr2=0x7f2d7c0a4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.152+0000 7f2d8473d700 1 -- 172.21.15.146:0/2439590734 shutdown_connections 2023-10-03T10:12:15.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.152+0000 7f2d8473d700 1 -- 172.21.15.146:0/2439590734 wait complete. 2023-10-03T10:12:15.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.153+0000 7f2d8473d700 1 Processor -- start 2023-10-03T10:12:15.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.153+0000 7f2d8473d700 1 -- start start 2023-10-03T10:12:15.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.154+0000 7f2d8473d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d7c06fce0 0x7f2d7c06b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.154+0000 7f2d8473d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d7c070630 0x7f2d7c06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.154+0000 7f2d8473d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d7c131b60 0x7f2d7c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.154+0000 7f2d8473d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c09ac70 con 0x7f2d7c070630 2023-10-03T10:12:15.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.154+0000 7f2d8473d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c0729e0 con 0x7f2d7c06fce0 2023-10-03T10:12:15.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.154+0000 7f2d8473d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c06ca20 con 0x7f2d7c131b60 2023-10-03T10:12:15.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.154+0000 7f2d824d9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d7c06fce0 0x7f2d7c06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.154+0000 7f2d824d9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d7c06fce0 0x7f2d7c06b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33626/0 (socket says 172.21.15.146:33626) 2023-10-03T10:12:15.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.154+0000 7f2d824d9700 1 -- 172.21.15.146:0/116942663 learned_addr learned my addr 172.21.15.146:0/116942663 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:15.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.154+0000 7f2d81cd8700 1 --2- 172.21.15.146:0/116942663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d7c070630 0x7f2d7c06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.154+0000 7f2d82cda700 1 --2- 172.21.15.146:0/116942663 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d7c131b60 0x7f2d7c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.154+0000 7f2d824d9700 1 -- 172.21.15.146:0/116942663 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d7c131b60 msgr2=0x7f2d7c06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.154+0000 7f2d824d9700 1 --2- 172.21.15.146:0/116942663 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d7c131b60 0x7f2d7c06c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.154+0000 7f2d824d9700 1 -- 172.21.15.146:0/116942663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d7c070630 msgr2=0x7f2d7c06bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.154+0000 7f2d824d9700 1 --2- 172.21.15.146:0/116942663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d7c070630 0x7f2d7c06bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.154+0000 7f2d824d9700 1 -- 172.21.15.146:0/116942663 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d78009550 con 0x7f2d7c06fce0 2023-10-03T10:12:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.154+0000 7f2d824d9700 1 --2- 172.21.15.146:0/116942663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d7c06fce0 0x7f2d7c06b880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009fd0 tx=0x7f2d6c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.154+0000 7f2d72ffd700 1 -- 172.21.15.146:0/116942663 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c0036a0 con 0x7f2d7c06fce0 2023-10-03T10:12:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.154+0000 7f2d72ffd700 1 -- 172.21.15.146:0/116942663 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6c01f070 con 0x7f2d7c06fce0 2023-10-03T10:12:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.154+0000 7f2d8473d700 1 -- 172.21.15.146:0/116942663 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d6c0094a0 con 0x7f2d7c06fce0 2023-10-03T10:12:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.154+0000 7f2d72ffd700 1 -- 172.21.15.146:0/116942663 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c003a60 con 0x7f2d7c06fce0 2023-10-03T10:12:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.154+0000 7f2d8473d700 1 -- 172.21.15.146:0/116942663 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7c06aa90 con 0x7f2d7c06fce0 2023-10-03T10:12:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.155+0000 7f2d72ffd700 1 -- 172.21.15.146:0/116942663 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2d6c003bc0 con 0x7f2d7c06fce0 2023-10-03T10:12:15.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.155+0000 7f2d72ffd700 1 -- 172.21.15.146:0/116942663 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f2d6c021070 con 0x7f2d7c06fce0 2023-10-03T10:12:15.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.155+0000 7f2d8473d700 1 -- 172.21.15.146:0/116942663 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d7c075190 con 0x7f2d7c06fce0 2023-10-03T10:12:15.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.160+0000 7f2d72ffd700 1 -- 172.21.15.146:0/116942663 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d6c0253e0 con 0x7f2d7c06fce0 2023-10-03T10:12:15.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.342+0000 7f2d8473d700 1 -- 172.21.15.146:0/116942663 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f2d7c09aeb0 con 0x7f2d7c06fce0 2023-10-03T10:12:15.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.709+0000 7f2d72ffd700 1 -- 172.21.15.146:0/116942663 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7f2d6c015070 con 0x7f2d7c06fce0 2023-10-03T10:12:15.711 INFO:tasks.ceph.mgr.x.smithi146.stderr:terminate called recursively 2023-10-03T10:12:15.711 INFO:tasks.ceph.mgr.x.smithi146.stderr:terminate called after throwing an instance of 'ceph::buffer::v15_2_0::end_of_buffer' 2023-10-03T10:12:15.711 INFO:tasks.ceph.mgr.x.smithi146.stderr: what(): End of buffer [buffer:2] 2023-10-03T10:12:15.711 INFO:tasks.ceph.mgr.x.smithi146.stderr:*** Caught signal (Aborted) ** 2023-10-03T10:12:15.711 INFO:tasks.ceph.mgr.x.smithi146.stderr: in thread 7f238356f700 thread_name:ms_dispatch 2023-10-03T10:12:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.712+0000 7f2d8473d700 1 -- 172.21.15.146:0/116942663 >> v1:172.21.15.146:6816/126749 conn(0x7f2d6002f510 legacy=0x7f2d600319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.712+0000 7f2d8473d700 1 -- 172.21.15.146:0/116942663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d7c06fce0 msgr2=0x7f2d7c06b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.712+0000 7f2d8473d700 1 --2- 172.21.15.146:0/116942663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d7c06fce0 0x7f2d7c06b880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009fd0 tx=0x7f2d6c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.713+0000 7f2d8473d700 1 -- 172.21.15.146:0/116942663 shutdown_connections 2023-10-03T10:12:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.713+0000 7f2d8473d700 1 --2- 172.21.15.146:0/116942663 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d7c131b60 0x7f2d7c06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.713+0000 7f2d8473d700 1 --2- 172.21.15.146:0/116942663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d7c06fce0 0x7f2d7c06b880 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.713+0000 7f2d8473d700 1 --2- 172.21.15.146:0/116942663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d7c070630 0x7f2d7c06bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.713+0000 7f2d8473d700 1 -- 172.21.15.146:0/116942663 >> 172.21.15.146:0/116942663 conn(0x7f2d7c0a4230 msgr2=0x7f2d7c09c980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.713+0000 7f2d8473d700 1 -- 172.21.15.146:0/116942663 shutdown_connections 2023-10-03T10:12:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.713+0000 7f2d8473d700 1 -- 172.21.15.146:0/116942663 wait complete. 2023-10-03T10:12:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:set pool 1 pg_autoscale_mode to off 2023-10-03T10:12:15.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.829+0000 7f8b78664700 1 Processor -- start 2023-10-03T10:12:15.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.829+0000 7f8b78664700 1 -- start start 2023-10-03T10:12:15.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.830+0000 7f8b78664700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8b7006bf90 0x7f8b70139430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.830+0000 7f8b78664700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b7006c3b0 0x7f8b7013b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.830+0000 7f8b78664700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b7006ddf0 con 0x7f8b7009fc20 2023-10-03T10:12:15.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.830+0000 7f8b78664700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b7009fff0 con 0x7f8b7006bf90 2023-10-03T10:12:15.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.830+0000 7f8b78664700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7006e2b0 con 0x7f8b7006c3b0 2023-10-03T10:12:15.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.830+0000 7f8b75bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8b7006bf90 0x7f8b70139430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.830+0000 7f8b76400700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8b7009fc20 0x7f8b7006b880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39166/0 (socket says 172.21.15.146:39166) 2023-10-03T10:12:15.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.830+0000 7f8b76400700 1 -- 172.21.15.146:0/4183111459 learned_addr learned my addr 172.21.15.146:0/4183111459 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:15.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.830+0000 7f8b76c01700 1 --2- 172.21.15.146:0/4183111459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b7006c3b0 0x7f8b7013b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.830+0000 7f8b75bff700 1 -- 172.21.15.146:0/4183111459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b7006c3b0 msgr2=0x7f8b7013b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.830+0000 7f8b75bff700 1 --2- 172.21.15.146:0/4183111459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b7006c3b0 0x7f8b7013b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.831+0000 7f8b75bff700 1 -- 172.21.15.146:0/4183111459 >> v1:172.21.15.146:6789/0 conn(0x7f8b7009fc20 legacy=0x7f8b7006b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.831+0000 7f8b75bff700 1 -- 172.21.15.146:0/4183111459 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7006cfd0 con 0x7f8b7006bf90 2023-10-03T10:12:15.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.831+0000 7f8b75bff700 1 --2- 172.21.15.146:0/4183111459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b7006bf90 0x7f8b70139430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8b60009840 tx=0x7f8b60009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9fad98bdfd8f68d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.831+0000 7f8b753fe700 1 -- 172.21.15.146:0/4183111459 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b60011830 con 0x7f8b7006bf90 2023-10-03T10:12:15.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.831+0000 7f8b753fe700 1 -- 172.21.15.146:0/4183111459 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b60011990 con 0x7f8b7006bf90 2023-10-03T10:12:15.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.831+0000 7f8b753fe700 1 -- 172.21.15.146:0/4183111459 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b60011d20 con 0x7f8b7006bf90 2023-10-03T10:12:15.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.832+0000 7f8b78664700 1 -- 172.21.15.146:0/4183111459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b7006bf90 msgr2=0x7f8b70139430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.832+0000 7f8b78664700 1 --2- 172.21.15.146:0/4183111459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b7006bf90 0x7f8b70139430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8b60009840 tx=0x7f8b60009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:15.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.832+0000 7f8b78664700 1 -- 172.21.15.146:0/4183111459 shutdown_connections 2023-10-03T10:12:15.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.832+0000 7f8b78664700 1 --2- 172.21.15.146:0/4183111459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b7006c3b0 0x7f8b7013b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.832+0000 7f8b78664700 1 --2- 172.21.15.146:0/4183111459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b7006bf90 0x7f8b70139430 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.832+0000 7f8b78664700 1 -- 172.21.15.146:0/4183111459 >> 172.21.15.146:0/4183111459 conn(0x7f8b700a4230 msgr2=0x7f8b700a4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.832+0000 7f8b78664700 1 -- 172.21.15.146:0/4183111459 shutdown_connections 2023-10-03T10:12:15.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.832+0000 7f8b78664700 1 -- 172.21.15.146:0/4183111459 wait complete. 2023-10-03T10:12:15.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.833+0000 7f8b78664700 1 Processor -- start 2023-10-03T10:12:15.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.833+0000 7f8b78664700 1 -- start start 2023-10-03T10:12:15.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.834+0000 7f8b78664700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b7006bf90 0x7f8b701bb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.834+0000 7f8b78664700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b7006c3b0 0x7f8b701bb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.834+0000 7f8b78664700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b7009fc20 0x7f8b700906d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.834+0000 7f8b78664700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b70094d10 con 0x7f8b7006c3b0 2023-10-03T10:12:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.834+0000 7f8b78664700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b70093a80 con 0x7f8b7006bf90 2023-10-03T10:12:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.834+0000 7f8b78664700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b70094100 con 0x7f8b7009fc20 2023-10-03T10:12:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.834+0000 7f8b75bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b7006c3b0 0x7f8b701bb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.834+0000 7f8b75bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b7006c3b0 0x7f8b701bb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46816/0 (socket says 172.21.15.146:46816) 2023-10-03T10:12:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.834+0000 7f8b75bff700 1 -- 172.21.15.146:0/3880739214 learned_addr learned my addr 172.21.15.146:0/3880739214 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.834+0000 7f8b76c01700 1 --2- 172.21.15.146:0/3880739214 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b7009fc20 0x7f8b700906d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.834+0000 7f8b76400700 1 --2- 172.21.15.146:0/3880739214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b7006bf90 0x7f8b701bb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.834+0000 7f8b75bff700 1 -- 172.21.15.146:0/3880739214 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b7009fc20 msgr2=0x7f8b700906d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.834+0000 7f8b75bff700 1 --2- 172.21.15.146:0/3880739214 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b7009fc20 0x7f8b700906d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.834+0000 7f8b75bff700 1 -- 172.21.15.146:0/3880739214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b7006bf90 msgr2=0x7f8b701bb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.834+0000 7f8b75bff700 1 --2- 172.21.15.146:0/3880739214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b7006bf90 0x7f8b701bb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.834+0000 7f8b75bff700 1 -- 172.21.15.146:0/3880739214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b600094a0 con 0x7f8b7006c3b0 2023-10-03T10:12:15.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.834+0000 7f8b76c01700 1 --2- 172.21.15.146:0/3880739214 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b7009fc20 0x7f8b700906d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:15.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.834+0000 7f8b75bff700 1 --2- 172.21.15.146:0/3880739214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b7006c3b0 0x7f8b701bb9c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8b60009fd0 tx=0x7f8b60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.835+0000 7f8b66ffd700 1 -- 172.21.15.146:0/3880739214 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b60004400 con 0x7f8b7006c3b0 2023-10-03T10:12:15.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.835+0000 7f8b66ffd700 1 -- 172.21.15.146:0/3880739214 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6001f070 con 0x7f8b7006c3b0 2023-10-03T10:12:15.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.835+0000 7f8b66ffd700 1 -- 172.21.15.146:0/3880739214 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b600038e0 con 0x7f8b7006c3b0 2023-10-03T10:12:15.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.835+0000 7f8b78664700 1 -- 172.21.15.146:0/3880739214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b700a3e30 con 0x7f8b7006c3b0 2023-10-03T10:12:15.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.835+0000 7f8b78664700 1 -- 172.21.15.146:0/3880739214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b700947b0 con 0x7f8b7006c3b0 2023-10-03T10:12:15.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.835+0000 7f8b66ffd700 1 -- 172.21.15.146:0/3880739214 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8b60021030 con 0x7f8b7006c3b0 2023-10-03T10:12:15.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.836+0000 7f8b78664700 1 -- 172.21.15.146:0/3880739214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b70093ca0 con 0x7f8b7006c3b0 2023-10-03T10:12:15.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.836+0000 7f8b66ffd700 1 -- 172.21.15.146:0/3880739214 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f8b60040d20 con 0x7f8b7006c3b0 2023-10-03T10:12:15.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.845+0000 7f8b66ffd700 1 -- 172.21.15.146:0/3880739214 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b60045070 con 0x7f8b7006c3b0 2023-10-03T10:12:15.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.960+0000 7f8b76400700 1 -- 172.21.15.146:0/3880739214 >> v1:172.21.15.146:6816/126749 conn(0x7f8b5402f510 legacy=0x7f8b540319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk reading from fd=20 : -104 Unknown error -104 2023-10-03T10:12:15.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.960+0000 7f8b76400700 1 -- 172.21.15.146:0/3880739214 >> v1:172.21.15.146:6816/126749 conn(0x7f8b5402f510 legacy=0x7f8b540319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-03T10:12:15.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.960+0000 7f8b76400700 1 --1- 172.21.15.146:0/3880739214 >> v1:172.21.15.146:6816/126749 conn(0x7f8b5402f510 0x7f8b540319c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify read banner and identify addresses failed 2023-10-03T10:12:15.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.960+0000 7f8b76400700 1 --1- 172.21.15.146:0/3880739214 >> v1:172.21.15.146:6816/126749 conn(0x7f8b5402f510 0x7f8b540319c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).fault on lossy channel, failing 2023-10-03T10:12:15.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:15.960+0000 7f8b66ffd700 1 -- 172.21.15.146:0/3880739214 >> v1:172.21.15.146:6816/126749 conn(0x7f8b5402f510 legacy=0x7f8b540319c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-10-03T10:12:16.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.036+0000 7f8b78664700 1 -- 172.21.15.146:0/3880739214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f8b4c0051e0 con 0x7f8b7006c3b0 2023-10-03T10:12:16.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.710+0000 7f8b66ffd700 1 -- 172.21.15.146:0/3880739214 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v35) v1 ==== 152+0+0 (secure 0 0 0) 0x7f8b60015020 con 0x7f8b7006c3b0 2023-10-03T10:12:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.714+0000 7f8b78664700 1 -- 172.21.15.146:0/3880739214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b7006c3b0 msgr2=0x7f8b701bb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.714+0000 7f8b78664700 1 --2- 172.21.15.146:0/3880739214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b7006c3b0 0x7f8b701bb9c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8b60009fd0 tx=0x7f8b60004750 comp rx=0 tx=0).stop 2023-10-03T10:12:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.714+0000 7f8b78664700 1 -- 172.21.15.146:0/3880739214 shutdown_connections 2023-10-03T10:12:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.714+0000 7f8b78664700 1 --2- 172.21.15.146:0/3880739214 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b7009fc20 0x7f8b700906d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.714+0000 7f8b78664700 1 --2- 172.21.15.146:0/3880739214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b7006bf90 0x7f8b701bb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.714+0000 7f8b78664700 1 --2- 172.21.15.146:0/3880739214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b7006c3b0 0x7f8b701bb9c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.714+0000 7f8b78664700 1 -- 172.21.15.146:0/3880739214 >> 172.21.15.146:0/3880739214 conn(0x7f8b700a4230 msgr2=0x7f8b700711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:16.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.714+0000 7f8b78664700 1 -- 172.21.15.146:0/3880739214 shutdown_connections 2023-10-03T10:12:16.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.714+0000 7f8b78664700 1 -- 172.21.15.146:0/3880739214 wait complete. 2023-10-03T10:12:16.716 INFO:teuthology.orchestra.run.smithi146.stderr:set pool 2 pg_autoscale_mode to off 2023-10-03T10:12:16.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.832+0000 7fe291e4e700 1 Processor -- start 2023-10-03T10:12:16.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.832+0000 7fe291e4e700 1 -- start start 2023-10-03T10:12:16.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.832+0000 7fe291e4e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c0a4360 0x7fe28c0a4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.832+0000 7fe291e4e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe28c134390 0x7fe28c13bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.832+0000 7fe291e4e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe28c09e9e0 con 0x7fe28c0a4c70 2023-10-03T10:12:16.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.832+0000 7fe291e4e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe28c09de00 con 0x7fe28c134390 2023-10-03T10:12:16.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.832+0000 7fe291e4e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c0a53e0 con 0x7fe28c0a4360 2023-10-03T10:12:16.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.832+0000 7fe28b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c0a4360 0x7fe28c0a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.832+0000 7fe28bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe28c134390 0x7fe28c13bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.832+0000 7fe28bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe28c134390 0x7fe28c13bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46818/0 (socket says 172.21.15.146:46818) 2023-10-03T10:12:16.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.832+0000 7fe28b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c0a4360 0x7fe28c0a4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33660/0 (socket says 172.21.15.146:33660) 2023-10-03T10:12:16.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.832+0000 7fe28bfff700 1 -- 172.21.15.146:0/3702954663 learned_addr learned my addr 172.21.15.146:0/3702954663 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:16.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.833+0000 7fe28b7fe700 1 -- 172.21.15.146:0/3702954663 >> v2:172.21.15.146:3300/0 conn(0x7fe28c134390 msgr2=0x7fe28c13bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:16.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.833+0000 7fe28b7fe700 1 --2- 172.21.15.146:0/3702954663 >> v2:172.21.15.146:3300/0 conn(0x7fe28c134390 0x7fe28c13bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.833+0000 7fe28b7fe700 1 -- 172.21.15.146:0/3702954663 >> v1:172.21.15.146:6789/0 conn(0x7fe28c0a4c70 legacy=0x7fe28c133c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.833+0000 7fe28b7fe700 1 -- 172.21.15.146:0/3702954663 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28c09db20 con 0x7fe28c0a4360 2023-10-03T10:12:16.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.833+0000 7fe28bfff700 1 --2- 172.21.15.146:0/3702954663 >> v2:172.21.15.146:3300/0 conn(0x7fe28c134390 0x7fe28c13bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:16.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.833+0000 7fe28b7fe700 1 --2- 172.21.15.146:0/3702954663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c0a4360 0x7fe28c0a4730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe27c009840 tx=0x7fe27c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edbec832d99bbdbf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:16.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.833+0000 7fe28a7fc700 1 -- 172.21.15.146:0/3702954663 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c011830 con 0x7fe28c0a4360 2023-10-03T10:12:16.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.833+0000 7fe28a7fc700 1 -- 172.21.15.146:0/3702954663 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c011990 con 0x7fe28c0a4360 2023-10-03T10:12:16.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.833+0000 7fe28a7fc700 1 -- 172.21.15.146:0/3702954663 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c011d20 con 0x7fe28c0a4360 2023-10-03T10:12:16.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.834+0000 7fe291e4e700 1 -- 172.21.15.146:0/3702954663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c0a4360 msgr2=0x7fe28c0a4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.834+0000 7fe291e4e700 1 --2- 172.21.15.146:0/3702954663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c0a4360 0x7fe28c0a4730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe27c009840 tx=0x7fe27c009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:16.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.834+0000 7fe291e4e700 1 -- 172.21.15.146:0/3702954663 shutdown_connections 2023-10-03T10:12:16.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.834+0000 7fe291e4e700 1 --2- 172.21.15.146:0/3702954663 >> v2:172.21.15.146:3300/0 conn(0x7fe28c134390 0x7fe28c13bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.834+0000 7fe291e4e700 1 --2- 172.21.15.146:0/3702954663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c0a4360 0x7fe28c0a4730 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.834+0000 7fe291e4e700 1 -- 172.21.15.146:0/3702954663 >> 172.21.15.146:0/3702954663 conn(0x7fe28c0a2f40 msgr2=0x7fe28c0a3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:16.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.834+0000 7fe291e4e700 1 -- 172.21.15.146:0/3702954663 shutdown_connections 2023-10-03T10:12:16.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.834+0000 7fe291e4e700 1 -- 172.21.15.146:0/3702954663 wait complete. 2023-10-03T10:12:16.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.835+0000 7fe291e4e700 1 Processor -- start 2023-10-03T10:12:16.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.835+0000 7fe291e4e700 1 -- start start 2023-10-03T10:12:16.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.835+0000 7fe291e4e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0a4360 0x7fe28c1c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.835+0000 7fe291e4e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe28c0a4c70 0x7fe28c1c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.835+0000 7fe291e4e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c134390 0x7fe28c1c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.835+0000 7fe291e4e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c124970 con 0x7fe28c0a4360 2023-10-03T10:12:16.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.835+0000 7fe291e4e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c1255e0 con 0x7fe28c134390 2023-10-03T10:12:16.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.835+0000 7fe291e4e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c1262e0 con 0x7fe28c0a4c70 2023-10-03T10:12:16.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.835+0000 7fe28b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0a4360 0x7fe28c1c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.835+0000 7fe28b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0a4360 0x7fe28c1c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46828/0 (socket says 172.21.15.146:46828) 2023-10-03T10:12:16.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.835+0000 7fe28b7fe700 1 -- 172.21.15.146:0/1732766274 learned_addr learned my addr 172.21.15.146:0/1732766274 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:16.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.835+0000 7fe28affd700 1 --2- 172.21.15.146:0/1732766274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe28c0a4c70 0x7fe28c1c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.835+0000 7fe28bfff700 1 --2- 172.21.15.146:0/1732766274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c134390 0x7fe28c1c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.836+0000 7fe28bfff700 1 -- 172.21.15.146:0/1732766274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe28c0a4c70 msgr2=0x7fe28c1c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.836+0000 7fe28bfff700 1 --2- 172.21.15.146:0/1732766274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe28c0a4c70 0x7fe28c1c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.836+0000 7fe28bfff700 1 -- 172.21.15.146:0/1732766274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0a4360 msgr2=0x7fe28c1c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.836+0000 7fe28bfff700 1 --2- 172.21.15.146:0/1732766274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0a4360 0x7fe28c1c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.836+0000 7fe28bfff700 1 -- 172.21.15.146:0/1732766274 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe284009b30 con 0x7fe28c134390 2023-10-03T10:12:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.836+0000 7fe28b7fe700 1 --2- 172.21.15.146:0/1732766274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0a4360 0x7fe28c1c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.836+0000 7fe28bfff700 1 --2- 172.21.15.146:0/1732766274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c134390 0x7fe28c1c9150 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe28400efc0 tx=0x7fe28400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.836+0000 7fe273fff700 1 -- 172.21.15.146:0/1732766274 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284018070 con 0x7fe28c134390 2023-10-03T10:12:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.836+0000 7fe273fff700 1 -- 172.21.15.146:0/1732766274 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28400f040 con 0x7fe28c134390 2023-10-03T10:12:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.836+0000 7fe291e4e700 1 -- 172.21.15.146:0/1732766274 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe27c0094a0 con 0x7fe28c134390 2023-10-03T10:12:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.836+0000 7fe273fff700 1 -- 172.21.15.146:0/1732766274 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284003c60 con 0x7fe28c134390 2023-10-03T10:12:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.836+0000 7fe291e4e700 1 -- 172.21.15.146:0/1732766274 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28c09fd10 con 0x7fe28c134390 2023-10-03T10:12:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.837+0000 7fe273fff700 1 -- 172.21.15.146:0/1732766274 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe28400c880 con 0x7fe28c134390 2023-10-03T10:12:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.837+0000 7fe291e4e700 1 -- 172.21.15.146:0/1732766274 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28c0a4a50 con 0x7fe28c134390 2023-10-03T10:12:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.837+0000 7fe273fff700 1 -- 172.21.15.146:0/1732766274 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fe28403fdc0 con 0x7fe28c134390 2023-10-03T10:12:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.837+0000 7fe28b7fe700 1 -- 172.21.15.146:0/1732766274 >> v1:172.21.15.146:6816/126749 conn(0x7fe27802f510 legacy=0x7fe2780319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:16.841+0000 7fe273fff700 1 -- 172.21.15.146:0/1732766274 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe28401cd40 con 0x7fe28c134390 2023-10-03T10:12:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.029+0000 7fe291e4e700 1 -- 172.21.15.146:0/1732766274 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fe28c068580 con 0x7fe28c134390 2023-10-03T10:12:17.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.038+0000 7fe28b7fe700 1 -- 172.21.15.146:0/1732766274 >> v1:172.21.15.146:6816/126749 conn(0x7fe27802f510 legacy=0x7fe2780319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:17.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.439+0000 7fe28b7fe700 1 -- 172.21.15.146:0/1732766274 >> v1:172.21.15.146:6816/126749 conn(0x7fe27802f510 legacy=0x7fe2780319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:17.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.861+0000 7fe273fff700 1 -- 172.21.15.146:0/1732766274 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 3 pg_autoscale_mode to off v36) v1 ==== 164+0+0 (secure 0 0 0) 0x7fe28401cb60 con 0x7fe28c134390 2023-10-03T10:12:17.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.865+0000 7fe291e4e700 1 -- 172.21.15.146:0/1732766274 >> v1:172.21.15.146:6816/126749 conn(0x7fe27802f510 legacy=0x7fe2780319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:17.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.865+0000 7fe291e4e700 1 -- 172.21.15.146:0/1732766274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c134390 msgr2=0x7fe28c1c9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.865+0000 7fe291e4e700 1 --2- 172.21.15.146:0/1732766274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c134390 0x7fe28c1c9150 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe28400efc0 tx=0x7fe28400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.865+0000 7fe291e4e700 1 -- 172.21.15.146:0/1732766274 shutdown_connections 2023-10-03T10:12:17.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.865+0000 7fe291e4e700 1 --2- 172.21.15.146:0/1732766274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c134390 0x7fe28c1c9150 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.865+0000 7fe291e4e700 1 --2- 172.21.15.146:0/1732766274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0a4360 0x7fe28c1c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.865+0000 7fe291e4e700 1 --2- 172.21.15.146:0/1732766274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe28c0a4c70 0x7fe28c1c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.865+0000 7fe291e4e700 1 -- 172.21.15.146:0/1732766274 >> 172.21.15.146:0/1732766274 conn(0x7fe28c0a2f40 msgr2=0x7fe28c0a0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:17.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.865+0000 7fe291e4e700 1 -- 172.21.15.146:0/1732766274 shutdown_connections 2023-10-03T10:12:17.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.865+0000 7fe291e4e700 1 -- 172.21.15.146:0/1732766274 wait complete. 2023-10-03T10:12:17.867 INFO:teuthology.orchestra.run.smithi146.stderr:set pool 3 pg_autoscale_mode to off 2023-10-03T10:12:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.981+0000 7f1cecc78700 1 Processor -- start 2023-10-03T10:12:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.981+0000 7f1cecc78700 1 -- start start 2023-10-03T10:12:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.981+0000 7f1cecc78700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce809eba0 0x7f1ce806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.981+0000 7f1cecc78700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ce806acb0 0x7f1ce806b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.981+0000 7f1cecc78700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1ce8138350 0x7f1ce813a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.981+0000 7f1cecc78700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce809ef70 con 0x7f1ce8138350 2023-10-03T10:12:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.981+0000 7f1cecc78700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce806b640 con 0x7f1ce809eba0 2023-10-03T10:12:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.981+0000 7f1cecc78700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce806e480 con 0x7f1ce806acb0 2023-10-03T10:12:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.981+0000 7f1ce5d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ce806acb0 0x7f1ce806b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.981+0000 7f1ce6d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1ce8138350 0x7f1ce813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.981+0000 7f1ce659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce809eba0 0x7f1ce806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.981+0000 7f1ce5d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ce806acb0 0x7f1ce806b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54068/0 (socket says 172.21.15.146:54068) 2023-10-03T10:12:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.981+0000 7f1ce6d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1ce8138350 0x7f1ce813a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46832/0 (socket says 172.21.15.146:46832) 2023-10-03T10:12:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.981+0000 7f1ce5d9b700 1 -- 172.21.15.146:0/680551659 learned_addr learned my addr 172.21.15.146:0/680551659 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.982+0000 7f1ce6d9d700 1 -- 172.21.15.146:0/680551659 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ce806acb0 msgr2=0x7f1ce806b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.982+0000 7f1ce6d9d700 1 --2- 172.21.15.146:0/680551659 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ce806acb0 0x7f1ce806b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.982+0000 7f1ce6d9d700 1 -- 172.21.15.146:0/680551659 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce809eba0 msgr2=0x7f1ce806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.982+0000 7f1ce6d9d700 1 --2- 172.21.15.146:0/680551659 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce809eba0 0x7f1ce806a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.982+0000 7f1ce6d9d700 1 -- 172.21.15.146:0/680551659 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce809d4e0 con 0x7f1ce8138350 2023-10-03T10:12:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.982+0000 7f1ce659c700 1 --2- 172.21.15.146:0/680551659 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce809eba0 0x7f1ce806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.982+0000 7f1ce6d9d700 1 --2- 172.21.15.146:0/680551659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ce8138350 0x7f1ce813a730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009d90 tx=0x7f1ce000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727b6842be082a0b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.982+0000 7f1ce559a700 1 -- 172.21.15.146:0/680551659 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce000e070 con 0x7f1ce8138350 2023-10-03T10:12:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.982+0000 7f1ce559a700 1 -- 172.21.15.146:0/680551659 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce000bb20 con 0x7f1ce8138350 2023-10-03T10:12:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.982+0000 7f1ce559a700 1 -- 172.21.15.146:0/680551659 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0012430 con 0x7f1ce8138350 2023-10-03T10:12:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.983+0000 7f1cecc78700 1 -- 172.21.15.146:0/680551659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ce8138350 msgr2=0x7f1ce813a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.983+0000 7f1cecc78700 1 --2- 172.21.15.146:0/680551659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ce8138350 0x7f1ce813a730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009d90 tx=0x7f1ce000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.983+0000 7f1cecc78700 1 -- 172.21.15.146:0/680551659 shutdown_connections 2023-10-03T10:12:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.983+0000 7f1cecc78700 1 --2- 172.21.15.146:0/680551659 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce809eba0 0x7f1ce806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.983+0000 7f1cecc78700 1 --2- 172.21.15.146:0/680551659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ce8138350 0x7f1ce813a730 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.983+0000 7f1cecc78700 1 --2- 172.21.15.146:0/680551659 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ce806acb0 0x7f1ce806b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.983+0000 7f1cecc78700 1 -- 172.21.15.146:0/680551659 >> 172.21.15.146:0/680551659 conn(0x7f1ce809fc90 msgr2=0x7f1ce80a0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.983+0000 7f1cecc78700 1 -- 172.21.15.146:0/680551659 shutdown_connections 2023-10-03T10:12:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.983+0000 7f1cecc78700 1 -- 172.21.15.146:0/680551659 wait complete. 2023-10-03T10:12:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.984+0000 7f1cecc78700 1 Processor -- start 2023-10-03T10:12:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.984+0000 7f1cecc78700 1 -- start start 2023-10-03T10:12:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.984+0000 7f1cecc78700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce806acb0 0x7f1ce8137830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.984+0000 7f1cecc78700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ce809eba0 0x7f1ce8137d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.984+0000 7f1cecc78700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ce8138350 0x7f1ce80914d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.984+0000 7f1cecc78700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce8094820 con 0x7f1ce8138350 2023-10-03T10:12:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.984+0000 7f1cecc78700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce809a930 con 0x7f1ce806acb0 2023-10-03T10:12:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.984+0000 7f1cecc78700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce809cad0 con 0x7f1ce809eba0 2023-10-03T10:12:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.984+0000 7f1ce659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce806acb0 0x7f1ce8137830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.984+0000 7f1ce5d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ce809eba0 0x7f1ce8137d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.984+0000 7f1ce6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ce8138350 0x7f1ce80914d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.984+0000 7f1ce5d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ce809eba0 0x7f1ce8137d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54082/0 (socket says 172.21.15.146:54082) 2023-10-03T10:12:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.984+0000 7f1ce659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce806acb0 0x7f1ce8137830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33694/0 (socket says 172.21.15.146:33694) 2023-10-03T10:12:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.984+0000 7f1ce5d9b700 1 -- 172.21.15.146:0/76079881 learned_addr learned my addr 172.21.15.146:0/76079881 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.985+0000 7f1ce5d9b700 1 -- 172.21.15.146:0/76079881 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce806acb0 msgr2=0x7f1ce8137830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.985+0000 7f1ce5d9b700 1 --2- 172.21.15.146:0/76079881 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce806acb0 0x7f1ce8137830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.985+0000 7f1ce5d9b700 1 -- 172.21.15.146:0/76079881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ce8138350 msgr2=0x7f1ce80914d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.985+0000 7f1ce5d9b700 1 --2- 172.21.15.146:0/76079881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ce8138350 0x7f1ce80914d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.985+0000 7f1ce5d9b700 1 -- 172.21.15.146:0/76079881 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd80094a0 con 0x7f1ce809eba0 2023-10-03T10:12:17.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.985+0000 7f1ce659c700 1 --2- 172.21.15.146:0/76079881 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce806acb0 0x7f1ce8137830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:17.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.985+0000 7f1ce6d9d700 1 --2- 172.21.15.146:0/76079881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ce8138350 0x7f1ce80914d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:17.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.985+0000 7f1ce5d9b700 1 --2- 172.21.15.146:0/76079881 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ce809eba0 0x7f1ce8137d70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00e830 tx=0x7f1cdc00eb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:17.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.985+0000 7f1cd6ffd700 1 -- 172.21.15.146:0/76079881 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc013680 con 0x7f1ce809eba0 2023-10-03T10:12:17.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.985+0000 7f1cd6ffd700 1 -- 172.21.15.146:0/76079881 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc0137e0 con 0x7f1ce809eba0 2023-10-03T10:12:17.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.985+0000 7f1cecc78700 1 -- 172.21.15.146:0/76079881 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce0009a70 con 0x7f1ce809eba0 2023-10-03T10:12:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.985+0000 7f1cd6ffd700 1 -- 172.21.15.146:0/76079881 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc013b70 con 0x7f1ce809eba0 2023-10-03T10:12:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.985+0000 7f1cecc78700 1 -- 172.21.15.146:0/76079881 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce809ad10 con 0x7f1ce809eba0 2023-10-03T10:12:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.986+0000 7f1cd6ffd700 1 -- 172.21.15.146:0/76079881 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1cdc013cd0 con 0x7f1ce809eba0 2023-10-03T10:12:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.986+0000 7f1cd6ffd700 1 -- 172.21.15.146:0/76079881 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f1cdc03fdb0 con 0x7f1ce809eba0 2023-10-03T10:12:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.986+0000 7f1ce659c700 1 -- 172.21.15.146:0/76079881 >> v1:172.21.15.146:6816/126749 conn(0x7f1cc802f510 legacy=0x7f1cc80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.986+0000 7f1cecc78700 1 -- 172.21.15.146:0/76079881 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce8093690 con 0x7f1ce809eba0 2023-10-03T10:12:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:17.991+0000 7f1cd6ffd700 1 -- 172.21.15.146:0/76079881 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1cdc017080 con 0x7f1ce809eba0 2023-10-03T10:12:18.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:18.177+0000 7f1cecc78700 1 -- 172.21.15.146:0/76079881 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f1ce809b160 con 0x7f1ce809eba0 2023-10-03T10:12:18.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:18.187+0000 7f1ce659c700 1 -- 172.21.15.146:0/76079881 >> v1:172.21.15.146:6816/126749 conn(0x7f1cc802f510 legacy=0x7f1cc80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:18.422 INFO:tasks.ceph.mgr.x.smithi146.stderr:daemon-helper: command crashed with signal 6 2023-10-03T10:12:18.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:18.588+0000 7f1ce659c700 1 -- 172.21.15.146:0/76079881 >> v1:172.21.15.146:6816/126749 conn(0x7f1cc802f510 legacy=0x7f1cc80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:18.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:18.864+0000 7f1cd6ffd700 1 -- 172.21.15.146:0/76079881 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 4 pg_autoscale_mode to off v37) v1 ==== 160+0+0 (secure 0 0 0) 0x7f1cdc021030 con 0x7f1ce809eba0 2023-10-03T10:12:18.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:18.868+0000 7f1cecc78700 1 -- 172.21.15.146:0/76079881 >> v1:172.21.15.146:6816/126749 conn(0x7f1cc802f510 legacy=0x7f1cc80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:18.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:18.868+0000 7f1cecc78700 1 -- 172.21.15.146:0/76079881 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ce809eba0 msgr2=0x7f1ce8137d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:18.868+0000 7f1cecc78700 1 --2- 172.21.15.146:0/76079881 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ce809eba0 0x7f1ce8137d70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00e830 tx=0x7f1cdc00eb40 comp rx=0 tx=0).stop 2023-10-03T10:12:18.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:18.868+0000 7f1cecc78700 1 -- 172.21.15.146:0/76079881 shutdown_connections 2023-10-03T10:12:18.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:18.868+0000 7f1cecc78700 1 --2- 172.21.15.146:0/76079881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ce8138350 0x7f1ce80914d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:18.868+0000 7f1cecc78700 1 --2- 172.21.15.146:0/76079881 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce806acb0 0x7f1ce8137830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:18.868+0000 7f1cecc78700 1 --2- 172.21.15.146:0/76079881 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ce809eba0 0x7f1ce8137d70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:18.868+0000 7f1cecc78700 1 -- 172.21.15.146:0/76079881 >> 172.21.15.146:0/76079881 conn(0x7f1ce809fc90 msgr2=0x7f1ce8097f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:18.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:18.868+0000 7f1cecc78700 1 -- 172.21.15.146:0/76079881 shutdown_connections 2023-10-03T10:12:18.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:18.868+0000 7f1cecc78700 1 -- 172.21.15.146:0/76079881 wait complete. 2023-10-03T10:12:18.870 INFO:teuthology.orchestra.run.smithi146.stderr:set pool 4 pg_autoscale_mode to off 2023-10-03T10:12:18.884 DEBUG:teuthology.orchestra.run.smithi146:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release reef' 2023-10-03T10:12:19.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.010+0000 7fa41a813700 1 Processor -- start 2023-10-03T10:12:19.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.010+0000 7fa41a813700 1 -- start start 2023-10-03T10:12:19.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.010+0000 7fa41a813700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa414131640 0x7fa414131a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.010+0000 7fa41a813700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa414131f50 0x7fa4140977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.010+0000 7fa41a813700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41409b920 con 0x7fa41409bf10 2023-10-03T10:12:19.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.010+0000 7fa41a813700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41409f750 con 0x7fa414131f50 2023-10-03T10:12:19.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.010+0000 7fa41a813700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa41409d2e0 con 0x7fa414131640 2023-10-03T10:12:19.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.011+0000 7fa418db0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa414131f50 0x7fa4140977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.011+0000 7fa4137fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa41409bf10 0x7fa414097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39182/0 (socket says 172.21.15.146:39182) 2023-10-03T10:12:19.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.011+0000 7fa4137fe700 1 -- 172.21.15.146:0/1013171146 learned_addr learned my addr 172.21.15.146:0/1013171146 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:19.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.011+0000 7fa413fff700 1 --2- 172.21.15.146:0/1013171146 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa414131640 0x7fa414131a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.011+0000 7fa412ffd700 1 -- 172.21.15.146:0/1013171146 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524154470 0 0) 0x7fa41409b920 con 0x7fa41409bf10 2023-10-03T10:12:19.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.011+0000 7fa418db0700 1 -- 172.21.15.146:0/1013171146 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa414131640 msgr2=0x7fa414131a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:19.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.011+0000 7fa418db0700 1 --2- 172.21.15.146:0/1013171146 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa414131640 0x7fa414131a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.011+0000 7fa418db0700 1 -- 172.21.15.146:0/1013171146 >> v1:172.21.15.146:6789/0 conn(0x7fa41409bf10 legacy=0x7fa414097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.011+0000 7fa418db0700 1 -- 172.21.15.146:0/1013171146 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4141323c0 con 0x7fa414131f50 2023-10-03T10:12:19.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.011+0000 7fa413fff700 1 --2- 172.21.15.146:0/1013171146 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa414131640 0x7fa414131a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:19.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.011+0000 7fa418db0700 1 --2- 172.21.15.146:0/1013171146 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa414131f50 0x7fa4140977a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa40c009dc0 tx=0x7fa40c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=caf097d547414339 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:19.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.011+0000 7fa412ffd700 1 -- 172.21.15.146:0/1013171146 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c00e070 con 0x7fa414131f50 2023-10-03T10:12:19.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.011+0000 7fa412ffd700 1 -- 172.21.15.146:0/1013171146 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40c00bb20 con 0x7fa414131f50 2023-10-03T10:12:19.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.011+0000 7fa412ffd700 1 -- 172.21.15.146:0/1013171146 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c012430 con 0x7fa414131f50 2023-10-03T10:12:19.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.012+0000 7fa41a813700 1 -- 172.21.15.146:0/1013171146 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa414131f50 msgr2=0x7fa4140977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.012+0000 7fa41a813700 1 --2- 172.21.15.146:0/1013171146 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa414131f50 0x7fa4140977a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa40c009dc0 tx=0x7fa40c00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:19.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.012+0000 7fa41a813700 1 -- 172.21.15.146:0/1013171146 shutdown_connections 2023-10-03T10:12:19.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.012+0000 7fa41a813700 1 --2- 172.21.15.146:0/1013171146 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa414131f50 0x7fa4140977a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.012+0000 7fa41a813700 1 --2- 172.21.15.146:0/1013171146 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa414131640 0x7fa414131a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.012+0000 7fa41a813700 1 -- 172.21.15.146:0/1013171146 >> 172.21.15.146:0/1013171146 conn(0x7fa4140a4630 msgr2=0x7fa4140a4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:19.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.012+0000 7fa41a813700 1 -- 172.21.15.146:0/1013171146 shutdown_connections 2023-10-03T10:12:19.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.012+0000 7fa41a813700 1 -- 172.21.15.146:0/1013171146 wait complete. 2023-10-03T10:12:19.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.013+0000 7fa41a813700 1 Processor -- start 2023-10-03T10:12:19.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.013+0000 7fa41a813700 1 -- start start 2023-10-03T10:12:19.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.013+0000 7fa41a813700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa41409bf10 0x7fa41406b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.013+0000 7fa41a813700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa414131640 0x7fa41406bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.013+0000 7fa41a813700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa414131f50 0x7fa41406c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.013+0000 7fa41a813700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41408c220 con 0x7fa41409bf10 2023-10-03T10:12:19.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.013+0000 7fa41a813700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41408baa0 con 0x7fa414131640 2023-10-03T10:12:19.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.013+0000 7fa41a813700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa41408b580 con 0x7fa414131f50 2023-10-03T10:12:19.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.013+0000 7fa413fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa41409bf10 0x7fa41406b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.013+0000 7fa418db0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa414131f50 0x7fa41406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.013+0000 7fa4137fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa414131640 0x7fa41406bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.013+0000 7fa413fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa41409bf10 0x7fa41406b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46860/0 (socket says 172.21.15.146:46860) 2023-10-03T10:12:19.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.013+0000 7fa413fff700 1 -- 172.21.15.146:0/4041220318 learned_addr learned my addr 172.21.15.146:0/4041220318 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:19.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.013+0000 7fa418db0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa414131f50 0x7fa41406c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54102/0 (socket says 172.21.15.146:54102) 2023-10-03T10:12:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.014+0000 7fa4137fe700 1 -- 172.21.15.146:0/4041220318 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa414131f50 msgr2=0x7fa41406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.014+0000 7fa4137fe700 1 --2- 172.21.15.146:0/4041220318 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa414131f50 0x7fa41406c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.014+0000 7fa4137fe700 1 -- 172.21.15.146:0/4041220318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa41409bf10 msgr2=0x7fa41406b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.014+0000 7fa4137fe700 1 --2- 172.21.15.146:0/4041220318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa41409bf10 0x7fa41406b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.014+0000 7fa4137fe700 1 -- 172.21.15.146:0/4041220318 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4080094a0 con 0x7fa414131640 2023-10-03T10:12:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.014+0000 7fa413fff700 1 --2- 172.21.15.146:0/4041220318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa41409bf10 0x7fa41406b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.014+0000 7fa4137fe700 1 --2- 172.21.15.146:0/4041220318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa414131640 0x7fa41406bdc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa41406f2a0 tx=0x7fa40400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.014+0000 7fa410ff9700 1 -- 172.21.15.146:0/4041220318 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa404004a70 con 0x7fa414131640 2023-10-03T10:12:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.014+0000 7fa410ff9700 1 -- 172.21.15.146:0/4041220318 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa404004bd0 con 0x7fa414131640 2023-10-03T10:12:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.014+0000 7fa410ff9700 1 -- 172.21.15.146:0/4041220318 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4040070d0 con 0x7fa414131640 2023-10-03T10:12:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.014+0000 7fa41a813700 1 -- 172.21.15.146:0/4041220318 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40c009a70 con 0x7fa414131640 2023-10-03T10:12:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.014+0000 7fa41a813700 1 -- 172.21.15.146:0/4041220318 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41409ded0 con 0x7fa414131640 2023-10-03T10:12:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.015+0000 7fa410ff9700 1 -- 172.21.15.146:0/4041220318 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa404007230 con 0x7fa414131640 2023-10-03T10:12:19.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.015+0000 7fa410ff9700 1 -- 172.21.15.146:0/4041220318 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fa40403f680 con 0x7fa414131640 2023-10-03T10:12:19.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.015+0000 7fa413fff700 1 -- 172.21.15.146:0/4041220318 >> v1:172.21.15.146:6816/126749 conn(0x7fa40002f510 legacy=0x7fa4000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:19.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.015+0000 7fa41a813700 1 -- 172.21.15.146:0/4041220318 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa414068580 con 0x7fa414131640 2023-10-03T10:12:19.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.020+0000 7fa410ff9700 1 -- 172.21.15.146:0/4041220318 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4040074e0 con 0x7fa414131640 2023-10-03T10:12:19.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.213+0000 7fa41a813700 1 -- 172.21.15.146:0/4041220318 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd require-osd-release", "release": "reef"} v 0) v1 -- 0x7fa41406cbd0 con 0x7fa414131640 2023-10-03T10:12:19.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.216+0000 7fa413fff700 1 -- 172.21.15.146:0/4041220318 >> v1:172.21.15.146:6816/126749 conn(0x7fa40002f510 legacy=0x7fa4000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:19.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.617+0000 7fa413fff700 1 -- 172.21.15.146:0/4041220318 >> v1:172.21.15.146:6816/126749 conn(0x7fa40002f510 legacy=0x7fa4000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:19.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.865+0000 7fa410ff9700 1 -- 172.21.15.146:0/4041220318 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "reef"}]=0 v38) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa40401b340 con 0x7fa414131640 2023-10-03T10:12:19.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.870+0000 7fa41a813700 1 -- 172.21.15.146:0/4041220318 >> v1:172.21.15.146:6816/126749 conn(0x7fa40002f510 legacy=0x7fa4000319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:19.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.870+0000 7fa41a813700 1 -- 172.21.15.146:0/4041220318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa414131640 msgr2=0x7fa41406bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.870+0000 7fa41a813700 1 --2- 172.21.15.146:0/4041220318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa414131640 0x7fa41406bdc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa41406f2a0 tx=0x7fa40400c6a0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.870+0000 7fa41a813700 1 -- 172.21.15.146:0/4041220318 shutdown_connections 2023-10-03T10:12:19.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.870+0000 7fa41a813700 1 --2- 172.21.15.146:0/4041220318 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa414131f50 0x7fa41406c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.870+0000 7fa41a813700 1 --2- 172.21.15.146:0/4041220318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa41409bf10 0x7fa41406b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.870+0000 7fa41a813700 1 --2- 172.21.15.146:0/4041220318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa414131640 0x7fa41406bdc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.870+0000 7fa41a813700 1 -- 172.21.15.146:0/4041220318 >> 172.21.15.146:0/4041220318 conn(0x7fa4140a4630 msgr2=0x7fa41409f950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:19.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.870+0000 7fa41a813700 1 -- 172.21.15.146:0/4041220318 shutdown_connections 2023-10-03T10:12:19.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:19.871+0000 7fa41a813700 1 -- 172.21.15.146:0/4041220318 wait complete. 2023-10-03T10:12:19.886 INFO:teuthology.run_tasks:Running task ceph.healthy... 2023-10-03T10:12:19.897 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-03T10:12:19.897 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-03T10:12:19.897 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-03T10:12:20.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.024+0000 7f8d4c6a2700 1 Processor -- start 2023-10-03T10:12:20.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.024+0000 7f8d4c6a2700 1 -- start start 2023-10-03T10:12:20.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.024+0000 7f8d4c6a2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8d44133ad0 0x7f8d44133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.024+0000 7f8d4c6a2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d441300a0 0x7f8d441304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.024+0000 7f8d4c6a2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d4406b2d0 con 0x7f8d441309f0 2023-10-03T10:12:20.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.024+0000 7f8d4c6a2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d44133610 con 0x7f8d44133ad0 2023-10-03T10:12:20.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.024+0000 7f8d4c6a2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4409a500 con 0x7f8d441300a0 2023-10-03T10:12:20.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.024+0000 7f8d4a43e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8d44133ad0 0x7f8d44133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.024+0000 7f8d49c3d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d441300a0 0x7f8d441304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.025+0000 7f8d4a43e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8d44133ad0 0x7f8d44133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46868/0 (socket says 172.21.15.146:46868) 2023-10-03T10:12:20.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.025+0000 7f8d49c3d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d441300a0 0x7f8d441304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33722/0 (socket says 172.21.15.146:33722) 2023-10-03T10:12:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.025+0000 7f8d4a43e700 1 -- 172.21.15.146:0/1004602792 learned_addr learned my addr 172.21.15.146:0/1004602792 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.025+0000 7f8d4a43e700 1 -- 172.21.15.146:0/1004602792 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d441300a0 msgr2=0x7f8d441304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.025+0000 7f8d4a43e700 1 --2- 172.21.15.146:0/1004602792 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d441300a0 0x7f8d441304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.025+0000 7f8d4a43e700 1 -- 172.21.15.146:0/1004602792 >> v1:172.21.15.146:6789/0 conn(0x7f8d441309f0 legacy=0x7f8d4413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.025+0000 7f8d4a43e700 1 -- 172.21.15.146:0/1004602792 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d441338b0 con 0x7f8d44133ad0 2023-10-03T10:12:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.025+0000 7f8d49c3d700 1 --2- 172.21.15.146:0/1004602792 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d441300a0 0x7f8d441304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.025+0000 7f8d4a43e700 1 --2- 172.21.15.146:0/1004602792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d44133ad0 0x7f8d44133ea0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8d400098f0 tx=0x7f8d40009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995c8e59319b5b3a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.025+0000 7f8d4943c700 1 -- 172.21.15.146:0/1004602792 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40011830 con 0x7f8d44133ad0 2023-10-03T10:12:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.025+0000 7f8d4943c700 1 -- 172.21.15.146:0/1004602792 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d40011990 con 0x7f8d44133ad0 2023-10-03T10:12:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.025+0000 7f8d4943c700 1 -- 172.21.15.146:0/1004602792 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40011d20 con 0x7f8d44133ad0 2023-10-03T10:12:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.026+0000 7f8d4c6a2700 1 -- 172.21.15.146:0/1004602792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d44133ad0 msgr2=0x7f8d44133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.026+0000 7f8d4c6a2700 1 --2- 172.21.15.146:0/1004602792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d44133ad0 0x7f8d44133ea0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8d400098f0 tx=0x7f8d40009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:20.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.026+0000 7f8d4c6a2700 1 -- 172.21.15.146:0/1004602792 shutdown_connections 2023-10-03T10:12:20.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.026+0000 7f8d4c6a2700 1 --2- 172.21.15.146:0/1004602792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d44133ad0 0x7f8d44133ea0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.026+0000 7f8d4c6a2700 1 --2- 172.21.15.146:0/1004602792 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d441300a0 0x7f8d441304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.026+0000 7f8d4c6a2700 1 -- 172.21.15.146:0/1004602792 >> 172.21.15.146:0/1004602792 conn(0x7f8d44099c40 msgr2=0x7f8d440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:20.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.026+0000 7f8d4c6a2700 1 -- 172.21.15.146:0/1004602792 shutdown_connections 2023-10-03T10:12:20.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.026+0000 7f8d4c6a2700 1 -- 172.21.15.146:0/1004602792 wait complete. 2023-10-03T10:12:20.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.027+0000 7f8d4c6a2700 1 Processor -- start 2023-10-03T10:12:20.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.027+0000 7f8d4c6a2700 1 -- start start 2023-10-03T10:12:20.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.027+0000 7f8d4c6a2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d441300a0 0x7f8d4411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.027+0000 7f8d4c6a2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d441309f0 0x7f8d4411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.027+0000 7f8d4c6a2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d44133ad0 0x7f8d4411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.027+0000 7f8d4c6a2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d44120b70 con 0x7f8d44133ad0 2023-10-03T10:12:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.027+0000 7f8d4c6a2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d44072290 con 0x7f8d441309f0 2023-10-03T10:12:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.027+0000 7f8d4c6a2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4411ff90 con 0x7f8d441300a0 2023-10-03T10:12:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.027+0000 7f8d4a43e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d441300a0 0x7f8d4411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.027+0000 7f8d49c3d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d441309f0 0x7f8d4411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.027+0000 7f8d4ac3f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d44133ad0 0x7f8d4411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.027+0000 7f8d4a43e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d441300a0 0x7f8d4411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54114/0 (socket says 172.21.15.146:54114) 2023-10-03T10:12:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.027+0000 7f8d4a43e700 1 -- 172.21.15.146:0/1752302223 learned_addr learned my addr 172.21.15.146:0/1752302223 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.027+0000 7f8d49c3d700 1 -- 172.21.15.146:0/1752302223 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d441300a0 msgr2=0x7f8d4411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.027+0000 7f8d49c3d700 1 --2- 172.21.15.146:0/1752302223 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d441300a0 0x7f8d4411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.027+0000 7f8d49c3d700 1 -- 172.21.15.146:0/1752302223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d44133ad0 msgr2=0x7f8d4411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.027+0000 7f8d49c3d700 1 --2- 172.21.15.146:0/1752302223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d44133ad0 0x7f8d4411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.027+0000 7f8d49c3d700 1 -- 172.21.15.146:0/1752302223 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d340094a0 con 0x7f8d441309f0 2023-10-03T10:12:20.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.028+0000 7f8d49c3d700 1 --2- 172.21.15.146:0/1752302223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d441309f0 0x7f8d4411df80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400e900 tx=0x7f8d3400ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:20.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.028+0000 7f8d3affd700 1 -- 172.21.15.146:0/1752302223 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d34013680 con 0x7f8d441309f0 2023-10-03T10:12:20.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.028+0000 7f8d3affd700 1 -- 172.21.15.146:0/1752302223 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d340137e0 con 0x7f8d441309f0 2023-10-03T10:12:20.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.028+0000 7f8d4c6a2700 1 -- 172.21.15.146:0/1752302223 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d40009550 con 0x7f8d441309f0 2023-10-03T10:12:20.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.028+0000 7f8d3affd700 1 -- 172.21.15.146:0/1752302223 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d34013b70 con 0x7f8d441309f0 2023-10-03T10:12:20.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.028+0000 7f8d4c6a2700 1 -- 172.21.15.146:0/1752302223 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d44120250 con 0x7f8d441309f0 2023-10-03T10:12:20.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.029+0000 7f8d3affd700 1 -- 172.21.15.146:0/1752302223 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8d34013cd0 con 0x7f8d441309f0 2023-10-03T10:12:20.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.029+0000 7f8d4c6a2700 1 -- 172.21.15.146:0/1752302223 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4412dd00 con 0x7f8d441309f0 2023-10-03T10:12:20.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.029+0000 7f8d3affd700 1 -- 172.21.15.146:0/1752302223 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f8d3403fcf0 con 0x7f8d441309f0 2023-10-03T10:12:20.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.029+0000 7f8d4a43e700 1 -- 172.21.15.146:0/1752302223 >> v1:172.21.15.146:6816/126749 conn(0x7f8d2802f540 legacy=0x7f8d280319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:20.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.033+0000 7f8d3affd700 1 -- 172.21.15.146:0/1752302223 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d34021020 con 0x7f8d441309f0 2023-10-03T10:12:20.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.230+0000 7f8d4a43e700 1 -- 172.21.15.146:0/1752302223 >> v1:172.21.15.146:6816/126749 conn(0x7f8d2802f540 legacy=0x7f8d280319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:20.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.268+0000 7f8d4c6a2700 1 -- 172.21.15.146:0/1752302223 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8d44120250 con 0x7f8d441309f0 2023-10-03T10:12:20.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.269+0000 7f8d3affd700 1 -- 172.21.15.146:0/1752302223 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v9) v1 ==== 74+0+70490 (secure 0 0 0) 0x7f8d44120250 con 0x7f8d441309f0 2023-10-03T10:12:20.271 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:12:20.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.271+0000 7f8d4c6a2700 1 -- 172.21.15.146:0/1752302223 >> v1:172.21.15.146:6816/126749 conn(0x7f8d2802f540 legacy=0x7f8d280319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:20.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.271+0000 7f8d4c6a2700 1 -- 172.21.15.146:0/1752302223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d441309f0 msgr2=0x7f8d4411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.271+0000 7f8d4c6a2700 1 --2- 172.21.15.146:0/1752302223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d441309f0 0x7f8d4411df80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400e900 tx=0x7f8d3400ec10 comp rx=0 tx=0).stop 2023-10-03T10:12:20.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.271+0000 7f8d4c6a2700 1 -- 172.21.15.146:0/1752302223 shutdown_connections 2023-10-03T10:12:20.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.271+0000 7f8d4c6a2700 1 --2- 172.21.15.146:0/1752302223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d44133ad0 0x7f8d4411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.271+0000 7f8d4c6a2700 1 --2- 172.21.15.146:0/1752302223 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d441300a0 0x7f8d4411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.271+0000 7f8d4c6a2700 1 --2- 172.21.15.146:0/1752302223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d441309f0 0x7f8d4411df80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.271+0000 7f8d4c6a2700 1 -- 172.21.15.146:0/1752302223 >> 172.21.15.146:0/1752302223 conn(0x7f8d44099c40 msgr2=0x7f8d440a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:20.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.271+0000 7f8d4c6a2700 1 -- 172.21.15.146:0/1752302223 shutdown_connections 2023-10-03T10:12:20.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.271+0000 7f8d4c6a2700 1 -- 172.21.15.146:0/1752302223 wait complete. 2023-10-03T10:12:20.284 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":9,"active_gid":14102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6816","nonce":126749}]},"active_addr":"172.21.15.146:6816/126749","active_change":"2023-10-03T10:11:52.317887+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":20,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":1965600138}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":3123391800}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":1702650323}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":807364756}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":2857084049}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":784768892}]}]} 2023-10-03T10:12:20.286 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-03T10:12:20.286 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:12:20.286 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:20.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.408+0000 7fbf70734700 1 Processor -- start 2023-10-03T10:12:20.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.408+0000 7fbf70734700 1 -- start start 2023-10-03T10:12:20.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.409+0000 7fbf70734700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6806a770 0x7fbf6806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.409+0000 7fbf70734700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf68131ec0 0x7fbf68139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.409+0000 7fbf70734700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6809da80 con 0x7fbf6806b080 2023-10-03T10:12:20.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.409+0000 7fbf70734700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6809dce0 con 0x7fbf68131ec0 2023-10-03T10:12:20.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.409+0000 7fbf70734700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6809eb20 con 0x7fbf6806a770 2023-10-03T10:12:20.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.409+0000 7fbf6e4d0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6806a770 0x7fbf6806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.409+0000 7fbf6ecd1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf68131ec0 0x7fbf68139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.409+0000 7fbf6e4d0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6806a770 0x7fbf6806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54126/0 (socket says 172.21.15.146:54126) 2023-10-03T10:12:20.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.409+0000 7fbf6ecd1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf68131ec0 0x7fbf68139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33752/0 (socket says 172.21.15.146:33752) 2023-10-03T10:12:20.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.409+0000 7fbf6e4d0700 1 -- 172.21.15.146:0/1633196330 learned_addr learned my addr 172.21.15.146:0/1633196330 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:20.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.409+0000 7fbf6d4ce700 1 -- 172.21.15.146:0/1633196330 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052380119 0 0) 0x7fbf6809da80 con 0x7fbf6806b080 2023-10-03T10:12:20.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.410+0000 7fbf6e4d0700 1 -- 172.21.15.146:0/1633196330 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf68131ec0 msgr2=0x7fbf68139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.410+0000 7fbf6e4d0700 1 --2- 172.21.15.146:0/1633196330 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf68131ec0 0x7fbf68139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.410+0000 7fbf6e4d0700 1 -- 172.21.15.146:0/1633196330 >> v1:172.21.15.146:6789/0 conn(0x7fbf6806b080 legacy=0x7fbf681317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.410+0000 7fbf6e4d0700 1 -- 172.21.15.146:0/1633196330 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6809d860 con 0x7fbf6806a770 2023-10-03T10:12:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.410+0000 7fbf6ecd1700 1 --2- 172.21.15.146:0/1633196330 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf68131ec0 0x7fbf68139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.410+0000 7fbf6e4d0700 1 --2- 172.21.15.146:0/1633196330 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6806a770 0x7fbf6806ab40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009920 tx=0x7fbf58009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2413612e58554999 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.410+0000 7fbf6d4ce700 1 -- 172.21.15.146:0/1633196330 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf58011830 con 0x7fbf6806a770 2023-10-03T10:12:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.410+0000 7fbf6d4ce700 1 -- 172.21.15.146:0/1633196330 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf58011990 con 0x7fbf6806a770 2023-10-03T10:12:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.410+0000 7fbf6d4ce700 1 -- 172.21.15.146:0/1633196330 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf58011d20 con 0x7fbf6806a770 2023-10-03T10:12:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.410+0000 7fbf70734700 1 -- 172.21.15.146:0/1633196330 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6806a770 msgr2=0x7fbf6806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.410+0000 7fbf70734700 1 --2- 172.21.15.146:0/1633196330 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6806a770 0x7fbf6806ab40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009920 tx=0x7fbf58009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.410+0000 7fbf70734700 1 -- 172.21.15.146:0/1633196330 shutdown_connections 2023-10-03T10:12:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.410+0000 7fbf70734700 1 --2- 172.21.15.146:0/1633196330 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf68131ec0 0x7fbf68139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.410+0000 7fbf70734700 1 --2- 172.21.15.146:0/1633196330 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6806a770 0x7fbf6806ab40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.410+0000 7fbf70734700 1 -- 172.21.15.146:0/1633196330 >> 172.21.15.146:0/1633196330 conn(0x7fbf68099c40 msgr2=0x7fbf680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:20.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.411+0000 7fbf70734700 1 -- 172.21.15.146:0/1633196330 shutdown_connections 2023-10-03T10:12:20.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.411+0000 7fbf70734700 1 -- 172.21.15.146:0/1633196330 wait complete. 2023-10-03T10:12:20.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.411+0000 7fbf70734700 1 Processor -- start 2023-10-03T10:12:20.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.411+0000 7fbf70734700 1 -- start start 2023-10-03T10:12:20.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.412+0000 7fbf70734700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf6806a770 0x7fbf681c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.412+0000 7fbf70734700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6806b080 0x7fbf681c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.412+0000 7fbf70734700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf68131ec0 0x7fbf6811c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.412+0000 7fbf70734700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf681bae60 con 0x7fbf6806a770 2023-10-03T10:12:20.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.412+0000 7fbf70734700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf680a2c50 con 0x7fbf68131ec0 2023-10-03T10:12:20.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.412+0000 7fbf70734700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf68120290 con 0x7fbf6806b080 2023-10-03T10:12:20.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.412+0000 7fbf6e4d0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf6806a770 0x7fbf681c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.412+0000 7fbf6e4d0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf6806a770 0x7fbf681c6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46896/0 (socket says 172.21.15.146:46896) 2023-10-03T10:12:20.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.412+0000 7fbf6e4d0700 1 -- 172.21.15.146:0/2871073790 learned_addr learned my addr 172.21.15.146:0/2871073790 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:20.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.412+0000 7fbf6dccf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6806b080 0x7fbf681c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.412+0000 7fbf6ecd1700 1 --2- 172.21.15.146:0/2871073790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf68131ec0 0x7fbf6811c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.412+0000 7fbf6dccf700 1 -- 172.21.15.146:0/2871073790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf68131ec0 msgr2=0x7fbf6811c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.412+0000 7fbf6dccf700 1 --2- 172.21.15.146:0/2871073790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf68131ec0 0x7fbf6811c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.412+0000 7fbf6dccf700 1 -- 172.21.15.146:0/2871073790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf6806a770 msgr2=0x7fbf681c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.412+0000 7fbf6dccf700 1 --2- 172.21.15.146:0/2871073790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf6806a770 0x7fbf681c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.412+0000 7fbf6dccf700 1 -- 172.21.15.146:0/2871073790 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf60009a70 con 0x7fbf6806b080 2023-10-03T10:12:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.412+0000 7fbf6e4d0700 1 --2- 172.21.15.146:0/2871073790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf6806a770 0x7fbf681c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.412+0000 7fbf6dccf700 1 --2- 172.21.15.146:0/2871073790 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6806b080 0x7fbf681c6a40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbf680a3ff0 tx=0x7fbf6400c710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.413+0000 7fbf5effd700 1 -- 172.21.15.146:0/2871073790 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf640052e0 con 0x7fbf6806b080 2023-10-03T10:12:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.413+0000 7fbf5effd700 1 -- 172.21.15.146:0/2871073790 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf64005460 con 0x7fbf6806b080 2023-10-03T10:12:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.413+0000 7fbf70734700 1 -- 172.21.15.146:0/2871073790 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf58009550 con 0x7fbf6806b080 2023-10-03T10:12:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.413+0000 7fbf5effd700 1 -- 172.21.15.146:0/2871073790 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf640038c0 con 0x7fbf6806b080 2023-10-03T10:12:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.413+0000 7fbf70734700 1 -- 172.21.15.146:0/2871073790 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6811fbf0 con 0x7fbf6806b080 2023-10-03T10:12:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.413+0000 7fbf5effd700 1 -- 172.21.15.146:0/2871073790 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbf64003a20 con 0x7fbf6806b080 2023-10-03T10:12:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.413+0000 7fbf6e4d0700 1 -- 172.21.15.146:0/2871073790 >> v1:172.21.15.146:6816/126749 conn(0x7fbf4c02f540 legacy=0x7fbf4c0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.413+0000 7fbf5effd700 1 -- 172.21.15.146:0/2871073790 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fbf6403efb0 con 0x7fbf6806b080 2023-10-03T10:12:20.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.413+0000 7fbf70734700 1 -- 172.21.15.146:0/2871073790 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf6811e2e0 con 0x7fbf6806b080 2023-10-03T10:12:20.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.418+0000 7fbf5effd700 1 -- 172.21.15.146:0/2871073790 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf64019d00 con 0x7fbf6806b080 2023-10-03T10:12:20.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.608+0000 7fbf70734700 1 -- 172.21.15.146:0/2871073790 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf6804f2a0 con 0x7fbf6806b080 2023-10-03T10:12:20.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.609+0000 7fbf5effd700 1 -- 172.21.15.146:0/2871073790 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+13046 (secure 0 0 0) 0x7fbf640192c0 con 0x7fbf6806b080 2023-10-03T10:12:20.610 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:12:20.610 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":38,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:12:19.862797+0000","last_up_change":"2023-10-03T10:12:11.453728+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":129317}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":129317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":129317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":129317}]},"public_addr":"172.21.15.146:6800/129317","cluster_addr":"172.21.15.146:6801/129317","heartbeat_back_addr":"172.21.15.146:6803/129317","heartbeat_front_addr":"172.21.15.146:6802/129317","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":129415}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":129415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":129415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":129415}]},"public_addr":"172.21.15.146:6804/129415","cluster_addr":"172.21.15.146:6805/129415","heartbeat_back_addr":"172.21.15.146:6807/129415","heartbeat_front_addr":"172.21.15.146:6806/129415","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":129525}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":129525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":129525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":129525}]},"public_addr":"172.21.15.146:6808/129525","cluster_addr":"172.21.15.146:6809/129525","heartbeat_back_addr":"172.21.15.146:6811/129525","heartbeat_front_addr":"172.21.15.146:6810/129525","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":129865}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":129865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":129865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":129865}]},"public_addr":"172.21.15.146:6812/129865","cluster_addr":"172.21.15.146:6813/129865","heartbeat_back_addr":"172.21.15.146:6815/129865","heartbeat_front_addr":"172.21.15.146:6814/129865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":25},{"osd":3,"down_stamp":"2023-10-03T10:12:05.426236+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6817/4164614194":"2023-10-04T10:12:13.686998+0000","172.21.15.146:0/45915595":"2023-10-04T10:11:52.317723+0000","172.21.15.146:0/1896339219":"2023-10-04T10:11:52.317723+0000","172.21.15.146:6816/118159":"2023-10-04T10:11:52.317723+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:20.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.611+0000 7fbf70734700 1 -- 172.21.15.146:0/2871073790 >> v1:172.21.15.146:6816/126749 conn(0x7fbf4c02f540 legacy=0x7fbf4c0319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:20.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.611+0000 7fbf70734700 1 -- 172.21.15.146:0/2871073790 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6806b080 msgr2=0x7fbf681c6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.611+0000 7fbf70734700 1 --2- 172.21.15.146:0/2871073790 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6806b080 0x7fbf681c6a40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbf680a3ff0 tx=0x7fbf6400c710 comp rx=0 tx=0).stop 2023-10-03T10:12:20.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.611+0000 7fbf70734700 1 -- 172.21.15.146:0/2871073790 shutdown_connections 2023-10-03T10:12:20.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.611+0000 7fbf70734700 1 --2- 172.21.15.146:0/2871073790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf68131ec0 0x7fbf6811c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.611+0000 7fbf70734700 1 --2- 172.21.15.146:0/2871073790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf6806a770 0x7fbf681c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.611+0000 7fbf70734700 1 --2- 172.21.15.146:0/2871073790 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6806b080 0x7fbf681c6a40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.611+0000 7fbf70734700 1 -- 172.21.15.146:0/2871073790 >> 172.21.15.146:0/2871073790 conn(0x7fbf68099c40 msgr2=0x7fbf681b9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:20.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.611+0000 7fbf70734700 1 -- 172.21.15.146:0/2871073790 shutdown_connections 2023-10-03T10:12:20.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.611+0000 7fbf70734700 1 -- 172.21.15.146:0/2871073790 wait complete. 2023-10-03T10:12:20.624 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:12:20.624 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:20.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.744+0000 7fa845049700 1 Processor -- start 2023-10-03T10:12:20.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.744+0000 7fa845049700 1 -- start start 2023-10-03T10:12:20.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.745+0000 7fa845049700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa84009e870 0x7fa84009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.745+0000 7fa845049700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa840131f40 0x7fa840139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.745+0000 7fa845049700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa84009c970 con 0x7fa84009f180 2023-10-03T10:12:20.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.745+0000 7fa845049700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8400a0920 con 0x7fa84009e870 2023-10-03T10:12:20.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.745+0000 7fa845049700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa84009f9c0 con 0x7fa840131f40 2023-10-03T10:12:20.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.745+0000 7fa83ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa84009e870 0x7fa84009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.745+0000 7fa83f59e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa840131f40 0x7fa840139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.745+0000 7fa83f59e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa840131f40 0x7fa840139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54144/0 (socket says 172.21.15.146:54144) 2023-10-03T10:12:20.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.745+0000 7fa83ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa84009e870 0x7fa84009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46906/0 (socket says 172.21.15.146:46906) 2023-10-03T10:12:20.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.745+0000 7fa83f59e700 1 -- 172.21.15.146:0/2436179595 learned_addr learned my addr 172.21.15.146:0/2436179595 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:20.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.745+0000 7fa83f59e700 1 -- 172.21.15.146:0/2436179595 >> v2:172.21.15.146:3300/0 conn(0x7fa84009e870 msgr2=0x7fa84009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:20.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.745+0000 7fa83f59e700 1 --2- 172.21.15.146:0/2436179595 >> v2:172.21.15.146:3300/0 conn(0x7fa84009e870 0x7fa84009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.745+0000 7fa83f59e700 1 -- 172.21.15.146:0/2436179595 >> v1:172.21.15.146:6789/0 conn(0x7fa84009f180 legacy=0x7fa840131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.745+0000 7fa83f59e700 1 -- 172.21.15.146:0/2436179595 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84009bab0 con 0x7fa840131f40 2023-10-03T10:12:20.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.745+0000 7fa83ed9d700 1 --2- 172.21.15.146:0/2436179595 >> v2:172.21.15.146:3300/0 conn(0x7fa84009e870 0x7fa84009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:20.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.745+0000 7fa83f59e700 1 --2- 172.21.15.146:0/2436179595 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa840131f40 0x7fa840139ca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa838009e50 tx=0x7fa83800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59dd7ffe52879dd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:20.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.745+0000 7fa83dd9b700 1 -- 172.21.15.146:0/2436179595 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83800e070 con 0x7fa840131f40 2023-10-03T10:12:20.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.745+0000 7fa83dd9b700 1 -- 172.21.15.146:0/2436179595 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83800b910 con 0x7fa840131f40 2023-10-03T10:12:20.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.745+0000 7fa83dd9b700 1 -- 172.21.15.146:0/2436179595 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83800bcc0 con 0x7fa840131f40 2023-10-03T10:12:20.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.746+0000 7fa845049700 1 -- 172.21.15.146:0/2436179595 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa840131f40 msgr2=0x7fa840139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.746+0000 7fa845049700 1 --2- 172.21.15.146:0/2436179595 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa840131f40 0x7fa840139ca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa838009e50 tx=0x7fa83800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:20.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.746+0000 7fa845049700 1 -- 172.21.15.146:0/2436179595 shutdown_connections 2023-10-03T10:12:20.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.746+0000 7fa845049700 1 --2- 172.21.15.146:0/2436179595 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa840131f40 0x7fa840139ca0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.746+0000 7fa845049700 1 --2- 172.21.15.146:0/2436179595 >> v2:172.21.15.146:3300/0 conn(0x7fa84009e870 0x7fa84009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.746+0000 7fa845049700 1 -- 172.21.15.146:0/2436179595 >> 172.21.15.146:0/2436179595 conn(0x7fa8400a4430 msgr2=0x7fa8400a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:20.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.746+0000 7fa845049700 1 -- 172.21.15.146:0/2436179595 shutdown_connections 2023-10-03T10:12:20.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.746+0000 7fa845049700 1 -- 172.21.15.146:0/2436179595 wait complete. 2023-10-03T10:12:20.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.747+0000 7fa845049700 1 Processor -- start 2023-10-03T10:12:20.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.747+0000 7fa845049700 1 -- start start 2023-10-03T10:12:20.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa845049700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa84009e870 0x7fa84006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa845049700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa84009f180 0x7fa84006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa845049700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa840131f40 0x7fa84006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:20.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa845049700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84006d580 con 0x7fa84009f180 2023-10-03T10:12:20.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa845049700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa840125c10 con 0x7fa84009e870 2023-10-03T10:12:20.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa845049700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8400a2ec0 con 0x7fa840131f40 2023-10-03T10:12:20.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa83ed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa84009e870 0x7fa84006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa83e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa84009f180 0x7fa84006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa83ed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa84009e870 0x7fa84006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33776/0 (socket says 172.21.15.146:33776) 2023-10-03T10:12:20.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa83ed9d700 1 -- 172.21.15.146:0/3159901586 learned_addr learned my addr 172.21.15.146:0/3159901586 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:20.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa83f59e700 1 --2- 172.21.15.146:0/3159901586 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa840131f40 0x7fa84006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:20.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa83e59c700 1 -- 172.21.15.146:0/3159901586 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa840131f40 msgr2=0x7fa84006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa83e59c700 1 --2- 172.21.15.146:0/3159901586 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa840131f40 0x7fa84006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa83e59c700 1 -- 172.21.15.146:0/3159901586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa84009e870 msgr2=0x7fa84006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa83e59c700 1 --2- 172.21.15.146:0/3159901586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa84009e870 0x7fa84006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa83e59c700 1 -- 172.21.15.146:0/3159901586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8340094a0 con 0x7fa84009f180 2023-10-03T10:12:20.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa83f59e700 1 --2- 172.21.15.146:0/3159901586 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa840131f40 0x7fa84006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:20.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa83ed9d700 1 --2- 172.21.15.146:0/3159901586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa84009e870 0x7fa84006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:20.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa83e59c700 1 --2- 172.21.15.146:0/3159901586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa84009f180 0x7fa84006bdf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa830000f60 tx=0x7fa83000c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:20.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa8277fe700 1 -- 172.21.15.146:0/3159901586 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8300052d0 con 0x7fa84009f180 2023-10-03T10:12:20.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa8277fe700 1 -- 172.21.15.146:0/3159901586 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa830005430 con 0x7fa84009f180 2023-10-03T10:12:20.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa845049700 1 -- 172.21.15.146:0/3159901586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa838009b30 con 0x7fa84009f180 2023-10-03T10:12:20.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.748+0000 7fa8277fe700 1 -- 172.21.15.146:0/3159901586 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8300038c0 con 0x7fa84009f180 2023-10-03T10:12:20.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.749+0000 7fa845049700 1 -- 172.21.15.146:0/3159901586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8401247d0 con 0x7fa84009f180 2023-10-03T10:12:20.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.749+0000 7fa8277fe700 1 -- 172.21.15.146:0/3159901586 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa830003a20 con 0x7fa84009f180 2023-10-03T10:12:20.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.749+0000 7fa8277fe700 1 -- 172.21.15.146:0/3159901586 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fa83003eef0 con 0x7fa84009f180 2023-10-03T10:12:20.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.749+0000 7fa83ed9d700 1 -- 172.21.15.146:0/3159901586 >> v1:172.21.15.146:6816/126749 conn(0x7fa82c02f510 legacy=0x7fa82c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:20.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.750+0000 7fa845049700 1 -- 172.21.15.146:0/3159901586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84004f2a0 con 0x7fa84009f180 2023-10-03T10:12:20.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.754+0000 7fa8277fe700 1 -- 172.21.15.146:0/3159901586 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa830017030 con 0x7fa84009f180 2023-10-03T10:12:20.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.940+0000 7fa845049700 1 -- 172.21.15.146:0/3159901586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa84006b2a0 con 0x7fa84009f180 2023-10-03T10:12:20.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.941+0000 7fa8277fe700 1 -- 172.21.15.146:0/3159901586 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+13046 (secure 0 0 0) 0x7fa830017030 con 0x7fa84009f180 2023-10-03T10:12:20.942 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:12:20.942 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":38,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:12:19.862797+0000","last_up_change":"2023-10-03T10:12:11.453728+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":129317}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":129317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":129317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":129317}]},"public_addr":"172.21.15.146:6800/129317","cluster_addr":"172.21.15.146:6801/129317","heartbeat_back_addr":"172.21.15.146:6803/129317","heartbeat_front_addr":"172.21.15.146:6802/129317","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":129415}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":129415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":129415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":129415}]},"public_addr":"172.21.15.146:6804/129415","cluster_addr":"172.21.15.146:6805/129415","heartbeat_back_addr":"172.21.15.146:6807/129415","heartbeat_front_addr":"172.21.15.146:6806/129415","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":129525}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":129525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":129525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":129525}]},"public_addr":"172.21.15.146:6808/129525","cluster_addr":"172.21.15.146:6809/129525","heartbeat_back_addr":"172.21.15.146:6811/129525","heartbeat_front_addr":"172.21.15.146:6810/129525","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":129865}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":129865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":129865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":129865}]},"public_addr":"172.21.15.146:6812/129865","cluster_addr":"172.21.15.146:6813/129865","heartbeat_back_addr":"172.21.15.146:6815/129865","heartbeat_front_addr":"172.21.15.146:6814/129865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":25},{"osd":3,"down_stamp":"2023-10-03T10:12:05.426236+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6817/4164614194":"2023-10-04T10:12:13.686998+0000","172.21.15.146:0/45915595":"2023-10-04T10:11:52.317723+0000","172.21.15.146:0/1896339219":"2023-10-04T10:11:52.317723+0000","172.21.15.146:6816/118159":"2023-10-04T10:11:52.317723+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:20.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.943+0000 7fa845049700 1 -- 172.21.15.146:0/3159901586 >> v1:172.21.15.146:6816/126749 conn(0x7fa82c02f510 legacy=0x7fa82c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:20.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.943+0000 7fa845049700 1 -- 172.21.15.146:0/3159901586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa84009f180 msgr2=0x7fa84006bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:20.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.943+0000 7fa845049700 1 --2- 172.21.15.146:0/3159901586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa84009f180 0x7fa84006bdf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa830000f60 tx=0x7fa83000c730 comp rx=0 tx=0).stop 2023-10-03T10:12:20.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.943+0000 7fa845049700 1 -- 172.21.15.146:0/3159901586 shutdown_connections 2023-10-03T10:12:20.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.943+0000 7fa845049700 1 --2- 172.21.15.146:0/3159901586 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa840131f40 0x7fa84006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.943+0000 7fa845049700 1 --2- 172.21.15.146:0/3159901586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa84009e870 0x7fa84006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.943+0000 7fa845049700 1 --2- 172.21.15.146:0/3159901586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa84009f180 0x7fa84006bdf0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:20.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.943+0000 7fa845049700 1 -- 172.21.15.146:0/3159901586 >> 172.21.15.146:0/3159901586 conn(0x7fa8400a4430 msgr2=0x7fa8400721a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:20.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.943+0000 7fa845049700 1 -- 172.21.15.146:0/3159901586 shutdown_connections 2023-10-03T10:12:20.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:20.943+0000 7fa845049700 1 -- 172.21.15.146:0/3159901586 wait complete. 2023-10-03T10:12:20.958 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-03T10:12:20.958 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-03T10:12:20.959 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-03T10:12:20.960 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-03T10:12:21.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.090+0000 7f7848b54700 1 Processor -- start 2023-10-03T10:12:21.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.090+0000 7fa94c60c700 1 Processor -- start 2023-10-03T10:12:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.091+0000 7f7848b54700 1 -- start start 2023-10-03T10:12:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.091+0000 7f7848b54700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78440a0a90 0x7f78440a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.091+0000 7f7848b54700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f78440a13a0 0x7f7844133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.091+0000 7fa94c60c700 1 -- start start 2023-10-03T10:12:21.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.091+0000 7f7848b54700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78440a1fe0 con 0x7f7844133f70 2023-10-03T10:12:21.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.091+0000 7f7848b54700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78440a3aa0 con 0x7f78440a13a0 2023-10-03T10:12:21.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.091+0000 7f7848b54700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f784409a540 con 0x7f78440a0a90 2023-10-03T10:12:21.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.091+0000 7fa94c60c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa94409a130 0x7fa94409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.091+0000 7f784259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78440a0a90 0x7f78440a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.091+0000 7f784259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78440a0a90 0x7f78440a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54170/0 (socket says 172.21.15.146:54170) 2023-10-03T10:12:21.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.091+0000 7f784259c700 1 -- 172.21.15.146:0/1209353864 learned_addr learned my addr 172.21.15.146:0/1209353864 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:21.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.091+0000 7fa94c60c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa94409f1e0 0x7fa94413fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.091+0000 7fa94c60c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa944072b30 con 0x7fa94409edb0 2023-10-03T10:12:21.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.091+0000 7fa94c60c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa94409a500 con 0x7fa94409a130 2023-10-03T10:12:21.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.091+0000 7fa94c60c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa94409ada0 con 0x7fa94409f1e0 2023-10-03T10:12:21.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.091+0000 7fa94a3a8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa94409a130 0x7fa94409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.092+0000 7fa94a3a8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa94409a130 0x7fa94409e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46932/0 (socket says 172.21.15.146:46932) 2023-10-03T10:12:21.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.092+0000 7fa94a3a8700 1 -- 172.21.15.146:0/999652183 learned_addr learned my addr 172.21.15.146:0/999652183 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:21.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.092+0000 7f7841d9b700 1 --2- 172.21.15.146:0/1209353864 >> v2:172.21.15.146:3300/0 conn(0x7f78440a13a0 0x7f7844133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.092+0000 7f7841d9b700 1 -- 172.21.15.146:0/1209353864 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78440a0a90 msgr2=0x7f78440a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:21.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.092+0000 7f7841d9b700 1 --2- 172.21.15.146:0/1209353864 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78440a0a90 0x7f78440a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.092+0000 7f7841d9b700 1 -- 172.21.15.146:0/1209353864 >> v1:172.21.15.146:6789/0 conn(0x7f7844133f70 legacy=0x7f784413ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.092+0000 7f7841d9b700 1 -- 172.21.15.146:0/1209353864 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784409a280 con 0x7f78440a13a0 2023-10-03T10:12:21.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.092+0000 7f784259c700 1 --2- 172.21.15.146:0/1209353864 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78440a0a90 0x7f78440a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:21.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.092+0000 7fa94a3a8700 1 -- 172.21.15.146:0/999652183 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa94409f1e0 msgr2=0x7fa94413fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:21.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.092+0000 7fa94a3a8700 1 --2- 172.21.15.146:0/999652183 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa94409f1e0 0x7fa94413fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.092+0000 7fa9493a6700 1 -- 172.21.15.146:0/999652183 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886056267 0 0) 0x7fa944072b30 con 0x7fa94409edb0 2023-10-03T10:12:21.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.092+0000 7fa94a3a8700 1 -- 172.21.15.146:0/999652183 >> v1:172.21.15.146:6789/0 conn(0x7fa94409edb0 legacy=0x7fa94413c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.092+0000 7fa94a3a8700 1 -- 172.21.15.146:0/999652183 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94409fe00 con 0x7fa94409a130 2023-10-03T10:12:21.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.092+0000 7fa94a3a8700 1 --2- 172.21.15.146:0/999652183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa94409a130 0x7fa94409e870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa9400098f0 tx=0x7fa940009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b2c1d568dc90bd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:21.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.092+0000 7f7841d9b700 1 --2- 172.21.15.146:0/1209353864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78440a13a0 0x7f7844133a30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7838009840 tx=0x7f7838009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa106374abe0ae4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:21.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.093+0000 7fa9493a6700 1 -- 172.21.15.146:0/999652183 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94000b8a0 con 0x7fa94409a130 2023-10-03T10:12:21.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.093+0000 7fa9493a6700 1 -- 172.21.15.146:0/999652183 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94000ba00 con 0x7fa94409a130 2023-10-03T10:12:21.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.093+0000 7fa9493a6700 1 -- 172.21.15.146:0/999652183 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94000bd90 con 0x7fa94409a130 2023-10-03T10:12:21.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.093+0000 7f784159a700 1 -- 172.21.15.146:0/1209353864 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838004230 con 0x7f78440a13a0 2023-10-03T10:12:21.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.093+0000 7f784159a700 1 -- 172.21.15.146:0/1209353864 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7838004390 con 0x7f78440a13a0 2023-10-03T10:12:21.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.093+0000 7f784159a700 1 -- 172.21.15.146:0/1209353864 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78380036a0 con 0x7f78440a13a0 2023-10-03T10:12:21.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.093+0000 7f7848b54700 1 -- 172.21.15.146:0/1209353864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78440a13a0 msgr2=0x7f7844133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.093+0000 7f7848b54700 1 --2- 172.21.15.146:0/1209353864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78440a13a0 0x7f7844133a30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7838009840 tx=0x7f7838009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:21.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.094+0000 7f7848b54700 1 -- 172.21.15.146:0/1209353864 shutdown_connections 2023-10-03T10:12:21.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.094+0000 7f7848b54700 1 --2- 172.21.15.146:0/1209353864 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78440a0a90 0x7f78440a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.094+0000 7fa94c60c700 1 -- 172.21.15.146:0/999652183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa94409a130 msgr2=0x7fa94409e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.094+0000 7fa94c60c700 1 --2- 172.21.15.146:0/999652183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa94409a130 0x7fa94409e870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa9400098f0 tx=0x7fa940009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:21.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.094+0000 7f7848b54700 1 --2- 172.21.15.146:0/1209353864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78440a13a0 0x7f7844133a30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.094+0000 7f7848b54700 1 -- 172.21.15.146:0/1209353864 >> 172.21.15.146:0/1209353864 conn(0x7f7844099c40 msgr2=0x7f784406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.094+0000 7f7848b54700 1 -- 172.21.15.146:0/1209353864 shutdown_connections 2023-10-03T10:12:21.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.094+0000 7f7848b54700 1 -- 172.21.15.146:0/1209353864 wait complete. 2023-10-03T10:12:21.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.094+0000 7fa94c60c700 1 -- 172.21.15.146:0/999652183 shutdown_connections 2023-10-03T10:12:21.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.094+0000 7fa94c60c700 1 --2- 172.21.15.146:0/999652183 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa94409f1e0 0x7fa94413fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.094+0000 7fa94c60c700 1 --2- 172.21.15.146:0/999652183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa94409a130 0x7fa94409e870 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.094+0000 7fa94c60c700 1 -- 172.21.15.146:0/999652183 >> 172.21.15.146:0/999652183 conn(0x7fa9440a4430 msgr2=0x7fa9440a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.094+0000 7fa94c60c700 1 -- 172.21.15.146:0/999652183 shutdown_connections 2023-10-03T10:12:21.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.094+0000 7fa94c60c700 1 -- 172.21.15.146:0/999652183 wait complete. 2023-10-03T10:12:21.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.095+0000 7fa94c60c700 1 Processor -- start 2023-10-03T10:12:21.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.095+0000 7f7848b54700 1 Processor -- start 2023-10-03T10:12:21.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.095+0000 7fa94c60c700 1 -- start start 2023-10-03T10:12:21.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.095+0000 7fa94c60c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa94409a130 0x7fa94411c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.095+0000 7fa94c60c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa94409edb0 0x7fa94411cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.095+0000 7fa94c60c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa94409f1e0 0x7fa94411d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.095+0000 7fa94c60c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94409e330 con 0x7fa94409f1e0 2023-10-03T10:12:21.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.095+0000 7fa94c60c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9440a00f0 con 0x7fa94409a130 2023-10-03T10:12:21.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.095+0000 7fa94c60c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa94411b970 con 0x7fa94409edb0 2023-10-03T10:12:21.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.095+0000 7f7848b54700 1 -- start start 2023-10-03T10:12:21.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.095+0000 7fa94aba9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa94409f1e0 0x7fa94411d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.095+0000 7fa94aba9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa94409f1e0 0x7fa94411d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46940/0 (socket says 172.21.15.146:46940) 2023-10-03T10:12:21.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.095+0000 7fa94aba9700 1 -- 172.21.15.146:0/106331843 learned_addr learned my addr 172.21.15.146:0/106331843 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:21.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.096+0000 7fa94a3a8700 1 --2- 172.21.15.146:0/106331843 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa94409a130 0x7fa94411c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.096+0000 7fa94aba9700 1 -- 172.21.15.146:0/106331843 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa94409edb0 msgr2=0x7fa94411cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.096+0000 7fa94aba9700 1 --2- 172.21.15.146:0/106331843 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa94409edb0 0x7fa94411cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.096+0000 7fa94aba9700 1 -- 172.21.15.146:0/106331843 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa94409a130 msgr2=0x7fa94411c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.096+0000 7fa94aba9700 1 --2- 172.21.15.146:0/106331843 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa94409a130 0x7fa94411c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.096+0000 7fa94aba9700 1 -- 172.21.15.146:0/106331843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa940009550 con 0x7fa94409f1e0 2023-10-03T10:12:21.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.096+0000 7fa94aba9700 1 --2- 172.21.15.146:0/106331843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa94409f1e0 0x7fa94411d2b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa93c00b970 tx=0x7fa93c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:21.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.096+0000 7fa93affd700 1 -- 172.21.15.146:0/106331843 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c00c9b0 con 0x7fa94409f1e0 2023-10-03T10:12:21.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.096+0000 7fa93affd700 1 -- 172.21.15.146:0/106331843 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93c00cb30 con 0x7fa94409f1e0 2023-10-03T10:12:21.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.096+0000 7fa93affd700 1 -- 172.21.15.146:0/106331843 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c014440 con 0x7fa94409f1e0 2023-10-03T10:12:21.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.096+0000 7fa94c60c700 1 -- 172.21.15.146:0/106331843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94411d7f0 con 0x7fa94409f1e0 2023-10-03T10:12:21.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.096+0000 7fa94c60c700 1 -- 172.21.15.146:0/106331843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94413fb90 con 0x7fa94409f1e0 2023-10-03T10:12:21.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.097+0000 7fa93affd700 1 -- 172.21.15.146:0/106331843 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa93c01d3b0 con 0x7fa94409f1e0 2023-10-03T10:12:21.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.097+0000 7fa94c60c700 1 -- 172.21.15.146:0/106331843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa94409f660 con 0x7fa94409f1e0 2023-10-03T10:12:21.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.097+0000 7fa94a3a8700 1 -- 172.21.15.146:0/106331843 >> v1:172.21.15.146:6816/126749 conn(0x7fa92802f540 legacy=0x7fa9280319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:21.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.098+0000 7fa93affd700 1 -- 172.21.15.146:0/106331843 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fa93c006e40 con 0x7fa94409f1e0 2023-10-03T10:12:21.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.098+0000 7fa93affd700 1 -- 172.21.15.146:0/106331843 --> v1:172.21.15.146:6808/129525 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa92803c390 con 0x7fa928038690 2023-10-03T10:12:21.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.098+0000 7fa93affd700 1 -- 172.21.15.146:0/106331843 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa93c0098b0 con 0x7fa94409f1e0 2023-10-03T10:12:21.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.096+0000 7f7848b54700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78440a0a90 0x7f78441ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.096+0000 7f7848b54700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78440a13a0 0x7f78441cd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.096+0000 7f784259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78440a0a90 0x7f78441ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.096+0000 7f784259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78440a0a90 0x7f78441ccd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33794/0 (socket says 172.21.15.146:33794) 2023-10-03T10:12:21.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.098+0000 7f7841d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78440a13a0 0x7f78441cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.098+0000 7f7841d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78440a13a0 0x7f78441cd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54212/0 (socket says 172.21.15.146:54212) 2023-10-03T10:12:21.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.098+0000 7f7848b54700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7844133f70 0x7f784406dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.098+0000 7f7848b54700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7844071d60 con 0x7f7844133f70 2023-10-03T10:12:21.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.098+0000 7f7848b54700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78440712b0 con 0x7f78440a0a90 2023-10-03T10:12:21.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.098+0000 7f7848b54700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7844133a30 con 0x7f78440a13a0 2023-10-03T10:12:21.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.098+0000 7f784259c700 1 -- 172.21.15.146:0/3316397126 learned_addr learned my addr 172.21.15.146:0/3316397126 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:21.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.098+0000 7f7842d9d700 1 --2- 172.21.15.146:0/3316397126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7844133f70 0x7f784406dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.098+0000 7f784259c700 1 -- 172.21.15.146:0/3316397126 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78440a13a0 msgr2=0x7f78441cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.098+0000 7f784259c700 1 --2- 172.21.15.146:0/3316397126 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78440a13a0 0x7f78441cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.098+0000 7f784259c700 1 -- 172.21.15.146:0/3316397126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7844133f70 msgr2=0x7f784406dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.098+0000 7f784259c700 1 --2- 172.21.15.146:0/3316397126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7844133f70 0x7f784406dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.098+0000 7f784259c700 1 -- 172.21.15.146:0/3316397126 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7834009550 con 0x7f78440a0a90 2023-10-03T10:12:21.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.098+0000 7f784259c700 1 --2- 172.21.15.146:0/3316397126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78440a0a90 0x7f78441ccd00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f783400ebe0 tx=0x7f783400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:21.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.098+0000 7f7832ffd700 1 -- 172.21.15.146:0/3316397126 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783400c850 con 0x7f78440a0a90 2023-10-03T10:12:21.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.099+0000 7f7832ffd700 1 -- 172.21.15.146:0/3316397126 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783400c9b0 con 0x7f78440a0a90 2023-10-03T10:12:21.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.099+0000 7f7832ffd700 1 -- 172.21.15.146:0/3316397126 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783400cd20 con 0x7f78440a0a90 2023-10-03T10:12:21.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.099+0000 7f7848b54700 1 -- 172.21.15.146:0/3316397126 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78380094a0 con 0x7f78440a0a90 2023-10-03T10:12:21.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.099+0000 7f7848b54700 1 -- 172.21.15.146:0/3316397126 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7844070ff0 con 0x7f78440a0a90 2023-10-03T10:12:21.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.099+0000 7f7848b54700 1 -- 172.21.15.146:0/3316397126 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f78440a17d0 con 0x7f78440a0a90 2023-10-03T10:12:21.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.100+0000 7f7832ffd700 1 -- 172.21.15.146:0/3316397126 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7834013470 con 0x7f78440a0a90 2023-10-03T10:12:21.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.100+0000 7fa93affd700 1 -- 172.21.15.146:0/106331843 <== osd.2 v1:172.21.15.146:6808/129525 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7fa92803c390 con 0x7fa928038690 2023-10-03T10:12:21.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.100+0000 7f7841d9b700 1 -- 172.21.15.146:0/3316397126 >> v1:172.21.15.146:6816/126749 conn(0x7f782402f510 legacy=0x7f78240319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:21.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.100+0000 7f7832ffd700 1 -- 172.21.15.146:0/3316397126 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f78340400e0 con 0x7f78440a0a90 2023-10-03T10:12:21.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.100+0000 7f7832ffd700 1 -- 172.21.15.146:0/3316397126 --> v1:172.21.15.146:6812/129865 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f782403c2e0 con 0x7f78240385e0 2023-10-03T10:12:21.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.100+0000 7f7832ffd700 1 -- 172.21.15.146:0/3316397126 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7834011ce0 con 0x7f78440a0a90 2023-10-03T10:12:21.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.101+0000 7f9cc0ac3700 1 Processor -- start 2023-10-03T10:12:21.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.101+0000 7f9cc0ac3700 1 -- start start 2023-10-03T10:12:21.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.101+0000 7ff61e784700 1 Processor -- start 2023-10-03T10:12:21.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7ff61e784700 1 -- start start 2023-10-03T10:12:21.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7f9cc0ac3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9cbc066410 0x7f9cbc0a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7f9cc0ac3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cbc0667e0 0x7f9cbc0a0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7f9cc0ac3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9cbc0a14b0 0x7f9cbc12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7f9cc0ac3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cbc0a1900 con 0x7f9cbc0a14b0 2023-10-03T10:12:21.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7f9cc0ac3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc0a1e70 con 0x7f9cbc0667e0 2023-10-03T10:12:21.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7f9cc0ac3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc09a720 con 0x7f9cbc066410 2023-10-03T10:12:21.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7f9cbad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9cbc0a14b0 0x7f9cbc12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7f9cb9d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cbc0667e0 0x7f9cbc0a0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7f9cb9d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cbc0667e0 0x7f9cbc0a0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33804/0 (socket says 172.21.15.146:33804) 2023-10-03T10:12:21.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7f9cbad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9cbc0a14b0 0x7f9cbc12ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46972/0 (socket says 172.21.15.146:46972) 2023-10-03T10:12:21.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7f9cb9d9b700 1 -- 172.21.15.146:0/805813508 learned_addr learned my addr 172.21.15.146:0/805813508 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:21.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7ff61e784700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff618133ad0 0x7ff618133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7ff61e784700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff6181300a0 0x7ff6181304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7ff61e784700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6181309f0 0x7ff61813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7ff61e784700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff61806b2d0 con 0x7ff6181300a0 2023-10-03T10:12:21.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7ff61e784700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff618133610 con 0x7ff6181309f0 2023-10-03T10:12:21.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7ff61e784700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff61809a500 con 0x7ff618133ad0 2023-10-03T10:12:21.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7ff617fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff618133ad0 0x7ff618133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7ff6177fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff6181300a0 0x7ff6181304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7ff617fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff618133ad0 0x7ff618133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54222/0 (socket says 172.21.15.146:54222) 2023-10-03T10:12:21.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7ff617fff700 1 -- 172.21.15.146:0/2942462460 learned_addr learned my addr 172.21.15.146:0/2942462460 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:21.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7ff61cd21700 1 --2- 172.21.15.146:0/2942462460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6181309f0 0x7ff61813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7ff6177fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff6181300a0 0x7ff6181304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46974/0 (socket says 172.21.15.146:46974) 2023-10-03T10:12:21.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.103+0000 7ff617fff700 1 -- 172.21.15.146:0/2942462460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6181309f0 msgr2=0x7ff61813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:21.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.103+0000 7ff617fff700 1 --2- 172.21.15.146:0/2942462460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6181309f0 0x7ff61813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7f9cbad9d700 1 -- 172.21.15.146:0/805813508 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9cbc066410 msgr2=0x7f9cbc0a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:21.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7f9cbad9d700 1 --2- 172.21.15.146:0/805813508 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9cbc066410 0x7f9cbc0a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7f9cbad9d700 1 -- 172.21.15.146:0/805813508 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cbc0667e0 msgr2=0x7f9cbc0a0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:21.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7f9cbad9d700 1 --2- 172.21.15.146:0/805813508 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cbc0667e0 0x7f9cbc0a0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7f9cbad9d700 1 -- 172.21.15.146:0/805813508 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cbc09b300 con 0x7f9cbc0a14b0 2023-10-03T10:12:21.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.102+0000 7f9cbad9d700 1 --2- 172.21.15.146:0/805813508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cbc0a14b0 0x7f9cbc12ff60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009d90 tx=0x7f9cb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72836ffedc4f9a6b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:21.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.103+0000 7ff617fff700 1 -- 172.21.15.146:0/2942462460 >> v2:172.21.15.146:3300/0 conn(0x7ff6181300a0 msgr2=0x7ff6181304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:21.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.103+0000 7ff617fff700 1 --2- 172.21.15.146:0/2942462460 >> v2:172.21.15.146:3300/0 conn(0x7ff6181300a0 0x7ff6181304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.103+0000 7ff617fff700 1 -- 172.21.15.146:0/2942462460 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6181338b0 con 0x7ff618133ad0 2023-10-03T10:12:21.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.103+0000 7f9cb959a700 1 -- 172.21.15.146:0/805813508 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb400e070 con 0x7f9cbc0a14b0 2023-10-03T10:12:21.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.103+0000 7f9cb959a700 1 -- 172.21.15.146:0/805813508 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb400bb20 con 0x7f9cbc0a14b0 2023-10-03T10:12:21.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.103+0000 7f9cb959a700 1 -- 172.21.15.146:0/805813508 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4012430 con 0x7f9cbc0a14b0 2023-10-03T10:12:21.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.103+0000 7ff617fff700 1 --2- 172.21.15.146:0/2942462460 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff618133ad0 0x7ff618133ea0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff6080098f0 tx=0x7ff608009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3665faf5e8e7ab9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:21.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.103+0000 7f9cc0ac3700 1 -- 172.21.15.146:0/805813508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cbc0a14b0 msgr2=0x7f9cbc12ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.103+0000 7f9cc0ac3700 1 --2- 172.21.15.146:0/805813508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cbc0a14b0 0x7f9cbc12ff60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009d90 tx=0x7f9cb400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:21.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.104+0000 7f9cc0ac3700 1 -- 172.21.15.146:0/805813508 shutdown_connections 2023-10-03T10:12:21.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.104+0000 7f9cc0ac3700 1 --2- 172.21.15.146:0/805813508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cbc0a14b0 0x7f9cbc12ff60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.104+0000 7f9cc0ac3700 1 --2- 172.21.15.146:0/805813508 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9cbc066410 0x7f9cbc0a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.104+0000 7f9cc0ac3700 1 --2- 172.21.15.146:0/805813508 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cbc0667e0 0x7f9cbc0a0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.104+0000 7f9cc0ac3700 1 -- 172.21.15.146:0/805813508 >> 172.21.15.146:0/805813508 conn(0x7f9cbc0a2980 msgr2=0x7f9cbc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.104+0000 7f9cc0ac3700 1 -- 172.21.15.146:0/805813508 shutdown_connections 2023-10-03T10:12:21.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.104+0000 7f9cc0ac3700 1 -- 172.21.15.146:0/805813508 wait complete. 2023-10-03T10:12:21.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.104+0000 7ff616ffd700 1 -- 172.21.15.146:0/2942462460 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff608011830 con 0x7ff618133ad0 2023-10-03T10:12:21.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.104+0000 7ff616ffd700 1 -- 172.21.15.146:0/2942462460 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff608011990 con 0x7ff618133ad0 2023-10-03T10:12:21.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.104+0000 7ff616ffd700 1 -- 172.21.15.146:0/2942462460 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff608011d20 con 0x7ff618133ad0 2023-10-03T10:12:21.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.105+0000 7ff61e784700 1 -- 172.21.15.146:0/2942462460 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff618133ad0 msgr2=0x7ff618133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.105+0000 7ff61e784700 1 --2- 172.21.15.146:0/2942462460 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff618133ad0 0x7ff618133ea0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff6080098f0 tx=0x7ff608009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:21.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.105+0000 7ff61e784700 1 -- 172.21.15.146:0/2942462460 shutdown_connections 2023-10-03T10:12:21.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.105+0000 7ff61e784700 1 --2- 172.21.15.146:0/2942462460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6181309f0 0x7ff61813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.105+0000 7ff61e784700 1 --2- 172.21.15.146:0/2942462460 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff618133ad0 0x7ff618133ea0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.105+0000 7ff61e784700 1 --2- 172.21.15.146:0/2942462460 >> v2:172.21.15.146:3300/0 conn(0x7ff6181300a0 0x7ff6181304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.105+0000 7ff61e784700 1 -- 172.21.15.146:0/2942462460 >> 172.21.15.146:0/2942462460 conn(0x7ff618099c40 msgr2=0x7ff6180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.105+0000 7f9cc0ac3700 1 Processor -- start 2023-10-03T10:12:21.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.105+0000 7f9cc0ac3700 1 -- start start 2023-10-03T10:12:21.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.105+0000 7f9cc0ac3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9cbc066410 0x7f9cbc13d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.105+0000 7f9cc0ac3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cbc0667e0 0x7f9cbc13d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.105+0000 7f9cc0ac3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cbc0a14b0 0x7f9cbc13dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.105+0000 7f9cc0ac3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc120680 con 0x7f9cbc0a14b0 2023-10-03T10:12:21.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.105+0000 7f9cc0ac3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc0713e0 con 0x7f9cbc0667e0 2023-10-03T10:12:21.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.105+0000 7f9cc0ac3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc09ae00 con 0x7f9cbc066410 2023-10-03T10:12:21.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.105+0000 7f9cba59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9cbc066410 0x7f9cbc13d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.105+0000 7f9cba59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9cbc066410 0x7f9cbc13d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54234/0 (socket says 172.21.15.146:54234) 2023-10-03T10:12:21.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.105+0000 7f9cba59c700 1 -- 172.21.15.146:0/3137547596 learned_addr learned my addr 172.21.15.146:0/3137547596 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:21.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.105+0000 7f9cb9d9b700 1 --2- 172.21.15.146:0/3137547596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cbc0667e0 0x7f9cbc13d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.106+0000 7f9cbad9d700 1 --2- 172.21.15.146:0/3137547596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cbc0a14b0 0x7f9cbc13dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.106+0000 7f9cba59c700 1 -- 172.21.15.146:0/3137547596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cbc0667e0 msgr2=0x7f9cbc13d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.106+0000 7f9cba59c700 1 --2- 172.21.15.146:0/3137547596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cbc0667e0 0x7f9cbc13d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.106+0000 7f9cba59c700 1 -- 172.21.15.146:0/3137547596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cbc0a14b0 msgr2=0x7f9cbc13dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.106+0000 7f9cba59c700 1 --2- 172.21.15.146:0/3137547596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cbc0a14b0 0x7f9cbc13dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.106+0000 7f9cba59c700 1 -- 172.21.15.146:0/3137547596 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb4009a70 con 0x7f9cbc066410 2023-10-03T10:12:21.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.106+0000 7f9cbad9d700 1 --2- 172.21.15.146:0/3137547596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cbc0a14b0 0x7f9cbc13dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:21.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.106+0000 7f9cb9d9b700 1 --2- 172.21.15.146:0/3137547596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cbc0667e0 0x7f9cbc13d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:21.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.106+0000 7f9cba59c700 1 --2- 172.21.15.146:0/3137547596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9cbc066410 0x7f9cbc13d280 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00b480 tx=0x7f9cac00b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:21.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.106+0000 7f9caaffd700 1 -- 172.21.15.146:0/3137547596 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac00be90 con 0x7f9cbc066410 2023-10-03T10:12:21.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.106+0000 7f9caaffd700 1 -- 172.21.15.146:0/3137547596 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cac005a00 con 0x7f9cbc066410 2023-10-03T10:12:21.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.106+0000 7f9caaffd700 1 -- 172.21.15.146:0/3137547596 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cac005db0 con 0x7f9cbc066410 2023-10-03T10:12:21.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.106+0000 7f9cc0ac3700 1 -- 172.21.15.146:0/3137547596 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cbc13e6c0 con 0x7f9cbc066410 2023-10-03T10:12:21.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.106+0000 7f9cc0ac3700 1 -- 172.21.15.146:0/3137547596 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cbc122a50 con 0x7f9cbc066410 2023-10-03T10:12:21.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.107+0000 7ff61e784700 1 -- 172.21.15.146:0/2942462460 shutdown_connections 2023-10-03T10:12:21.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.107+0000 7f9caaffd700 1 -- 172.21.15.146:0/3137547596 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9cac011630 con 0x7f9cbc066410 2023-10-03T10:12:21.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.107+0000 7f9cc0ac3700 1 -- 172.21.15.146:0/3137547596 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9cbc09c090 con 0x7f9cbc066410 2023-10-03T10:12:21.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.107+0000 7ff61e784700 1 -- 172.21.15.146:0/2942462460 wait complete. 2023-10-03T10:12:21.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.107+0000 7f9cb9d9b700 1 -- 172.21.15.146:0/3137547596 >> v1:172.21.15.146:6816/126749 conn(0x7f9c9c02f510 legacy=0x7f9c9c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:21.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.107+0000 7f9caaffd700 1 -- 172.21.15.146:0/3137547596 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f9cac03f720 con 0x7f9cbc066410 2023-10-03T10:12:21.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.108+0000 7f9caaffd700 1 -- 172.21.15.146:0/3137547596 --> v1:172.21.15.146:6804/129415 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c9c03c1f0 con 0x7f9c9c0384f0 2023-10-03T10:12:21.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.108+0000 7f9caaffd700 1 -- 172.21.15.146:0/3137547596 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9cac0118e0 con 0x7f9cbc066410 2023-10-03T10:12:21.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.108+0000 7ff61e784700 1 Processor -- start 2023-10-03T10:12:21.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.109+0000 7ff61e784700 1 -- start start 2023-10-03T10:12:21.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.109+0000 7ff61e784700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff6181300a0 0x7ff618071360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.109+0000 7ff61e784700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6181309f0 0x7ff6180718a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.109+0000 7ff61e784700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff618133ad0 0x7ff618071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.109+0000 7f9caaffd700 1 -- 172.21.15.146:0/3137547596 <== osd.1 v1:172.21.15.146:6804/129415 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7f9c9c03c1f0 con 0x7f9c9c0384f0 2023-10-03T10:12:21.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.109+0000 7ff61e784700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61811eeb0 con 0x7ff6181309f0 2023-10-03T10:12:21.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.109+0000 7ff61e784700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61811fef0 con 0x7ff618133ad0 2023-10-03T10:12:21.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.109+0000 7ff61e784700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff61811f9e0 con 0x7ff6181300a0 2023-10-03T10:12:21.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.109+0000 7f7832ffd700 1 -- 172.21.15.146:0/3316397126 <== osd.3 v1:172.21.15.146:6812/129865 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7f782403c2e0 con 0x7f78240385e0 2023-10-03T10:12:21.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.109+0000 7ff61cd21700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff618133ad0 0x7ff618071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.109+0000 7ff61cd21700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff618133ad0 0x7ff618071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33818/0 (socket says 172.21.15.146:33818) 2023-10-03T10:12:21.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.109+0000 7ff61cd21700 1 -- 172.21.15.146:0/1720156395 learned_addr learned my addr 172.21.15.146:0/1720156395 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:21.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.109+0000 7ff6177fe700 1 --2- 172.21.15.146:0/1720156395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6181309f0 0x7ff6180718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.109+0000 7ff617fff700 1 --2- 172.21.15.146:0/1720156395 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff6181300a0 0x7ff618071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.110+0000 7ff61cd21700 1 -- 172.21.15.146:0/1720156395 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff6181300a0 msgr2=0x7ff618071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.110+0000 7ff61cd21700 1 --2- 172.21.15.146:0/1720156395 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff6181300a0 0x7ff618071360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.110+0000 7ff61cd21700 1 -- 172.21.15.146:0/1720156395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6181309f0 msgr2=0x7ff6180718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.110+0000 7ff61cd21700 1 --2- 172.21.15.146:0/1720156395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6181309f0 0x7ff6180718a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.110+0000 7ff61cd21700 1 -- 172.21.15.146:0/1720156395 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff608009550 con 0x7ff618133ad0 2023-10-03T10:12:21.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.110+0000 7ff61cd21700 1 --2- 172.21.15.146:0/1720156395 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff618133ad0 0x7ff618071de0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff610009dd0 tx=0x7ff61000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:21.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.110+0000 7ff614ff9700 1 -- 172.21.15.146:0/1720156395 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61000cd40 con 0x7ff618133ad0 2023-10-03T10:12:21.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.110+0000 7ff614ff9700 1 -- 172.21.15.146:0/1720156395 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61000f040 con 0x7ff618133ad0 2023-10-03T10:12:21.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.110+0000 7ff614ff9700 1 -- 172.21.15.146:0/1720156395 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6100146c0 con 0x7ff618133ad0 2023-10-03T10:12:21.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.110+0000 7ff61e784700 1 -- 172.21.15.146:0/1720156395 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6180727a0 con 0x7ff618133ad0 2023-10-03T10:12:21.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.110+0000 7ff61e784700 1 -- 172.21.15.146:0/1720156395 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61812dd00 con 0x7ff618133ad0 2023-10-03T10:12:21.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.111+0000 7ff61e784700 1 -- 172.21.15.146:0/1720156395 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff618130e90 con 0x7ff618133ad0 2023-10-03T10:12:21.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.111+0000 7ff614ff9700 1 -- 172.21.15.146:0/1720156395 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff610014820 con 0x7ff618133ad0 2023-10-03T10:12:21.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.112+0000 7ff614ff9700 1 -- 172.21.15.146:0/1720156395 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7ff610007980 con 0x7ff618133ad0 2023-10-03T10:12:21.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.112+0000 7ff614ff9700 1 -- 172.21.15.146:0/1720156395 --> v1:172.21.15.146:6800/129317 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff60403c2e0 con 0x7ff6040385e0 2023-10-03T10:12:21.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.112+0000 7ff614ff9700 1 -- 172.21.15.146:0/1720156395 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff61000cec0 con 0x7ff618133ad0 2023-10-03T10:12:21.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.115+0000 7ff617fff700 1 -- 172.21.15.146:0/1720156395 >> v1:172.21.15.146:6816/126749 conn(0x7ff60402f510 legacy=0x7ff6040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:21.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.120+0000 7ff614ff9700 1 -- 172.21.15.146:0/1720156395 <== osd.0 v1:172.21.15.146:6800/129317 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7ff60403c2e0 con 0x7ff6040385e0 2023-10-03T10:12:21.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.120+0000 7fa94c60c700 1 -- 172.21.15.146:0/106331843 --> v1:172.21.15.146:6808/129525 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa9440a36f0 con 0x7fa928038690 2023-10-03T10:12:21.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.121+0000 7fa93affd700 1 -- 172.21.15.146:0/106331843 <== osd.2 v1:172.21.15.146:6808/129525 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2085588430) 0x7fa9440a36f0 con 0x7fa928038690 2023-10-03T10:12:21.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.121+0000 7fa94c60c700 1 -- 172.21.15.146:0/106331843 >> v1:172.21.15.146:6808/129525 conn(0x7fa928038690 legacy=0x7fa92803ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.121+0000 7fa94c60c700 1 -- 172.21.15.146:0/106331843 >> v1:172.21.15.146:6816/126749 conn(0x7fa92802f540 legacy=0x7fa9280319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:21.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.121+0000 7fa94c60c700 1 -- 172.21.15.146:0/106331843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa94409f1e0 msgr2=0x7fa94411d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.121+0000 7fa94c60c700 1 --2- 172.21.15.146:0/106331843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa94409f1e0 0x7fa94411d2b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa93c00b970 tx=0x7fa93c00bd30 comp rx=0 tx=0).stop 2023-10-03T10:12:21.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.121+0000 7fa94aba9700 1 -- 172.21.15.146:0/106331843 reap_dead start 2023-10-03T10:12:21.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.121+0000 7fa94c60c700 1 -- 172.21.15.146:0/106331843 shutdown_connections 2023-10-03T10:12:21.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.121+0000 7fa94c60c700 1 -- 172.21.15.146:0/106331843 >> 172.21.15.146:0/106331843 conn(0x7fa9440a4430 msgr2=0x7fa9440a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.121+0000 7fa94c60c700 1 -- 172.21.15.146:0/106331843 shutdown_connections 2023-10-03T10:12:21.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.121+0000 7fa94c60c700 1 -- 172.21.15.146:0/106331843 wait complete. 2023-10-03T10:12:21.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.126+0000 7f7848b54700 1 -- 172.21.15.146:0/3316397126 --> v1:172.21.15.146:6812/129865 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f78440a2660 con 0x7f78240385e0 2023-10-03T10:12:21.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.127+0000 7f9cc0ac3700 1 -- 172.21.15.146:0/3137547596 --> v1:172.21.15.146:6804/129415 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9cbc122070 con 0x7f9c9c0384f0 2023-10-03T10:12:21.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.127+0000 7f7832ffd700 1 -- 172.21.15.146:0/3316397126 <== osd.3 v1:172.21.15.146:6812/129865 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 1985872850) 0x7f783c0017c0 con 0x7f78240385e0 2023-10-03T10:12:21.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.127+0000 7f9caaffd700 1 -- 172.21.15.146:0/3137547596 <== osd.1 v1:172.21.15.146:6804/129415 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 1318614166) 0x7f9cbc122070 con 0x7f9c9c0384f0 2023-10-03T10:12:21.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.127+0000 7f7848b54700 1 -- 172.21.15.146:0/3316397126 >> v1:172.21.15.146:6812/129865 conn(0x7f78240385e0 legacy=0x7f782403aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.128+0000 7f7848b54700 1 -- 172.21.15.146:0/3316397126 >> v1:172.21.15.146:6816/126749 conn(0x7f782402f510 legacy=0x7f78240319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:21.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.128+0000 7f7848b54700 1 -- 172.21.15.146:0/3316397126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78440a0a90 msgr2=0x7f78441ccd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.128+0000 7f7848b54700 1 --2- 172.21.15.146:0/3316397126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78440a0a90 0x7f78441ccd00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f783400ebe0 tx=0x7f783400eef0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.128+0000 7f7842d9d700 1 -- 172.21.15.146:0/3316397126 reap_dead start 2023-10-03T10:12:21.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.128+0000 7f9cc0ac3700 1 -- 172.21.15.146:0/3137547596 >> v1:172.21.15.146:6804/129415 conn(0x7f9c9c0384f0 legacy=0x7f9c9c03a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.128+0000 7f9cc0ac3700 1 -- 172.21.15.146:0/3137547596 >> v1:172.21.15.146:6816/126749 conn(0x7f9c9c02f510 legacy=0x7f9c9c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:21.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.128+0000 7f9cc0ac3700 1 -- 172.21.15.146:0/3137547596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9cbc066410 msgr2=0x7f9cbc13d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.128+0000 7f9cc0ac3700 1 --2- 172.21.15.146:0/3137547596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9cbc066410 0x7f9cbc13d280 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00b480 tx=0x7f9cac00b790 comp rx=0 tx=0).stop 2023-10-03T10:12:21.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.128+0000 7f9cbad9d700 1 -- 172.21.15.146:0/3137547596 reap_dead start 2023-10-03T10:12:21.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.128+0000 7f9cc0ac3700 1 -- 172.21.15.146:0/3137547596 shutdown_connections 2023-10-03T10:12:21.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.128+0000 7f9cc0ac3700 1 -- 172.21.15.146:0/3137547596 >> 172.21.15.146:0/3137547596 conn(0x7f9cbc0a2980 msgr2=0x7f9cbc118df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.128+0000 7f9cc0ac3700 1 -- 172.21.15.146:0/3137547596 shutdown_connections 2023-10-03T10:12:21.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.128+0000 7f9cc0ac3700 1 -- 172.21.15.146:0/3137547596 wait complete. 2023-10-03T10:12:21.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.128+0000 7f7848b54700 1 -- 172.21.15.146:0/3316397126 shutdown_connections 2023-10-03T10:12:21.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.128+0000 7f7848b54700 1 -- 172.21.15.146:0/3316397126 >> 172.21.15.146:0/3316397126 conn(0x7f7844099c40 msgr2=0x7f78440a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.128+0000 7f7848b54700 1 -- 172.21.15.146:0/3316397126 shutdown_connections 2023-10-03T10:12:21.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.128+0000 7f7848b54700 1 -- 172.21.15.146:0/3316397126 wait complete. 2023-10-03T10:12:21.153 INFO:teuthology.orchestra.run.smithi146.stdout:128849018883 2023-10-03T10:12:21.154 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:21.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.137+0000 7ff61e784700 1 -- 172.21.15.146:0/1720156395 --> v1:172.21.15.146:6800/129317 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff61809ea90 con 0x7ff6040385e0 2023-10-03T10:12:21.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.137+0000 7ff614ff9700 1 -- 172.21.15.146:0/1720156395 <== osd.0 v1:172.21.15.146:6800/129317 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3556540785) 0x7ff60c0092f0 con 0x7ff6040385e0 2023-10-03T10:12:21.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.138+0000 7ff61e784700 1 -- 172.21.15.146:0/1720156395 >> v1:172.21.15.146:6800/129317 conn(0x7ff6040385e0 legacy=0x7ff60403aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.138+0000 7ff61e784700 1 -- 172.21.15.146:0/1720156395 >> v1:172.21.15.146:6816/126749 conn(0x7ff60402f510 legacy=0x7ff6040319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:21.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.138+0000 7ff61e784700 1 -- 172.21.15.146:0/1720156395 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff618133ad0 msgr2=0x7ff618071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.138+0000 7ff61e784700 1 --2- 172.21.15.146:0/1720156395 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff618133ad0 0x7ff618071de0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff610009dd0 tx=0x7ff61000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.138+0000 7ff61cd21700 1 -- 172.21.15.146:0/1720156395 reap_dead start 2023-10-03T10:12:21.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.138+0000 7ff61e784700 1 -- 172.21.15.146:0/1720156395 shutdown_connections 2023-10-03T10:12:21.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.138+0000 7ff61e784700 1 -- 172.21.15.146:0/1720156395 >> 172.21.15.146:0/1720156395 conn(0x7ff618099c40 msgr2=0x7ff61812f070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.138+0000 7ff61e784700 1 -- 172.21.15.146:0/1720156395 shutdown_connections 2023-10-03T10:12:21.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.138+0000 7ff61e784700 1 -- 172.21.15.146:0/1720156395 wait complete. 2023-10-03T10:12:21.157 INFO:teuthology.orchestra.run.smithi146.stdout:133143986179 2023-10-03T10:12:21.157 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:21.158 INFO:teuthology.orchestra.run.smithi146.stdout:124554051587 2023-10-03T10:12:21.158 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:21.159 INFO:teuthology.orchestra.run.smithi146.stdout:120259084291 2023-10-03T10:12:21.159 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:21.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.327+0000 7fb61a245700 1 Processor -- start 2023-10-03T10:12:21.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.327+0000 7fb61a245700 1 -- start start 2023-10-03T10:12:21.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.328+0000 7f148685d700 1 Processor -- start 2023-10-03T10:12:21.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.328+0000 7f148685d700 1 -- start start 2023-10-03T10:12:21.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.328+0000 7fb61a245700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb614133ad0 0x7fb614133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.328+0000 7fb61a245700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb614130bc0 0x7fb61413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.328+0000 7fb61a245700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb61406b2d0 con 0x7fb6141300a0 2023-10-03T10:12:21.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.328+0000 7fb61a245700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb614133610 con 0x7fb614133ad0 2023-10-03T10:12:21.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.328+0000 7fb61a245700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb61409a500 con 0x7fb614130bc0 2023-10-03T10:12:21.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.328+0000 7fb6137fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb614133ad0 0x7fb614133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.328+0000 7fb612ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb6141300a0 0x7fb6141304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39238/0 (socket says 172.21.15.146:39238) 2023-10-03T10:12:21.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.328+0000 7fb612ffd700 1 -- 172.21.15.146:0/3506075855 learned_addr learned my addr 172.21.15.146:0/3506075855 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:21.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.328+0000 7fb613fff700 1 --2- 172.21.15.146:0/3506075855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb614130bc0 0x7fb61413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.328+0000 7f148685d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f148009da80 0x7f1480136b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.328+0000 7f148685d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f148006b250 0x7f14801390e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.328+0000 7f148685d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148009ec00 con 0x7f148006a770 2023-10-03T10:12:21.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.329+0000 7f147ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f148006a770 0x7f148006ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39252/0 (socket says 172.21.15.146:39252) 2023-10-03T10:12:21.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.329+0000 7f147ffff700 1 -- 172.21.15.146:0/1507272626 learned_addr learned my addr 172.21.15.146:0/1507272626 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:21.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.329+0000 7f147f7fe700 1 --2- 172.21.15.146:0/1507272626 >> v2:172.21.15.146:3300/0 conn(0x7f148009da80 0x7f1480136b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.329+0000 7f148685d700 1 -- 172.21.15.146:0/1507272626 --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148009f6a0 con 0x7f148009da80 2023-10-03T10:12:21.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.329+0000 7f148685d700 1 -- 172.21.15.146:0/1507272626 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f148009f230 con 0x7f148006b250 2023-10-03T10:12:21.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.329+0000 7fb613fff700 1 -- 172.21.15.146:0/3506075855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb614133ad0 msgr2=0x7fb614133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:21.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.329+0000 7fb613fff700 1 --2- 172.21.15.146:0/3506075855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb614133ad0 0x7fb614133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.329+0000 7fb613fff700 1 -- 172.21.15.146:0/3506075855 >> v1:172.21.15.146:6789/0 conn(0x7fb6141300a0 legacy=0x7fb6141304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.329+0000 7fb613fff700 1 -- 172.21.15.146:0/3506075855 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6141338b0 con 0x7fb614130bc0 2023-10-03T10:12:21.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.329+0000 7fb613fff700 1 --2- 172.21.15.146:0/3506075855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb614130bc0 0x7fb61413b990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009dc0 tx=0x7fb60c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d6ee5a82195b72e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:21.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.329+0000 7fb6127fc700 1 -- 172.21.15.146:0/3506075855 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c00e070 con 0x7fb614130bc0 2023-10-03T10:12:21.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.329+0000 7f147effd700 1 -- 172.21.15.146:0/1507272626 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1234117917 0 0) 0x7f148009ec00 con 0x7f148006a770 2023-10-03T10:12:21.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.329+0000 7f147f7fe700 1 -- 172.21.15.146:0/1507272626 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f148006b250 msgr2=0x7f14801390e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:21.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.329+0000 7f147f7fe700 1 --2- 172.21.15.146:0/1507272626 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f148006b250 0x7f14801390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.329+0000 7fb6127fc700 1 -- 172.21.15.146:0/3506075855 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60c00bb20 con 0x7fb614130bc0 2023-10-03T10:12:21.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.329+0000 7fb6127fc700 1 -- 172.21.15.146:0/3506075855 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c012430 con 0x7fb614130bc0 2023-10-03T10:12:21.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.329+0000 7f147f7fe700 1 -- 172.21.15.146:0/1507272626 >> v1:172.21.15.146:6789/0 conn(0x7f148006a770 legacy=0x7f148006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.329+0000 7f147f7fe700 1 -- 172.21.15.146:0/1507272626 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148009c870 con 0x7f148009da80 2023-10-03T10:12:21.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.329+0000 7f147f7fe700 1 --2- 172.21.15.146:0/1507272626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f148009da80 0x7f1480136b90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1474009840 tx=0x7f1474009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e569832f4eb6eb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:21.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.330+0000 7f147effd700 1 -- 172.21.15.146:0/1507272626 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474011830 con 0x7f148009da80 2023-10-03T10:12:21.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.330+0000 7f147effd700 1 -- 172.21.15.146:0/1507272626 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1474011990 con 0x7f148009da80 2023-10-03T10:12:21.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.330+0000 7f147effd700 1 -- 172.21.15.146:0/1507272626 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474011d20 con 0x7f148009da80 2023-10-03T10:12:21.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.330+0000 7fb61a245700 1 -- 172.21.15.146:0/3506075855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb614130bc0 msgr2=0x7fb61413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.330+0000 7fb61a245700 1 --2- 172.21.15.146:0/3506075855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb614130bc0 0x7fb61413b990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009dc0 tx=0x7fb60c00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:21.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.330+0000 7fb61a245700 1 -- 172.21.15.146:0/3506075855 shutdown_connections 2023-10-03T10:12:21.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.330+0000 7fb61a245700 1 --2- 172.21.15.146:0/3506075855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb614130bc0 0x7fb61413b990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.330+0000 7fb61a245700 1 --2- 172.21.15.146:0/3506075855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb614133ad0 0x7fb614133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.330+0000 7fb61a245700 1 -- 172.21.15.146:0/3506075855 >> 172.21.15.146:0/3506075855 conn(0x7fb614099c40 msgr2=0x7fb6140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.330+0000 7fb61a245700 1 -- 172.21.15.146:0/3506075855 shutdown_connections 2023-10-03T10:12:21.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.330+0000 7fb61a245700 1 -- 172.21.15.146:0/3506075855 wait complete. 2023-10-03T10:12:21.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.330+0000 7f148685d700 1 -- 172.21.15.146:0/1507272626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f148009da80 msgr2=0x7f1480136b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.330+0000 7f148685d700 1 --2- 172.21.15.146:0/1507272626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f148009da80 0x7f1480136b90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1474009840 tx=0x7f1474009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:21.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.331+0000 7f148685d700 1 -- 172.21.15.146:0/1507272626 shutdown_connections 2023-10-03T10:12:21.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.331+0000 7f148685d700 1 --2- 172.21.15.146:0/1507272626 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f148006b250 0x7f14801390e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.331+0000 7f148685d700 1 --2- 172.21.15.146:0/1507272626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f148009da80 0x7f1480136b90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.331+0000 7f148685d700 1 -- 172.21.15.146:0/1507272626 >> 172.21.15.146:0/1507272626 conn(0x7f148009f9f0 msgr2=0x7f148009fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.331+0000 7fb61a245700 1 Processor -- start 2023-10-03T10:12:21.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.331+0000 7f148685d700 1 -- 172.21.15.146:0/1507272626 shutdown_connections 2023-10-03T10:12:21.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.331+0000 7fb61a245700 1 -- start start 2023-10-03T10:12:21.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.332+0000 7f148685d700 1 -- 172.21.15.146:0/1507272626 wait complete. 2023-10-03T10:12:21.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.332+0000 7fb61a245700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6141300a0 0x7fb61411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.332+0000 7fb61a245700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb614130bc0 0x7fb61411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.332+0000 7fb61a245700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb614133ad0 0x7fb61411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.332+0000 7fb61a245700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6141201f0 con 0x7fb614133ad0 2023-10-03T10:12:21.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.332+0000 7fb61a245700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61411f8e0 con 0x7fb6141300a0 2023-10-03T10:12:21.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.332+0000 7fb61a245700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb61412dd00 con 0x7fb614130bc0 2023-10-03T10:12:21.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.332+0000 7fb6137fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6141300a0 0x7fb61411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.332+0000 7fb6137fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6141300a0 0x7fb61411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33836/0 (socket says 172.21.15.146:33836) 2023-10-03T10:12:21.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.332+0000 7fb6137fe700 1 -- 172.21.15.146:0/1553536423 learned_addr learned my addr 172.21.15.146:0/1553536423 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:21.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.332+0000 7fb613fff700 1 --2- 172.21.15.146:0/1553536423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb614133ad0 0x7fb61411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.333+0000 7fb613fff700 1 -- 172.21.15.146:0/1553536423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb614130bc0 msgr2=0x7fb61411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.333+0000 7fb613fff700 1 --2- 172.21.15.146:0/1553536423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb614130bc0 0x7fb61411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.333+0000 7fb613fff700 1 -- 172.21.15.146:0/1553536423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6141300a0 msgr2=0x7fb61411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.333+0000 7fb613fff700 1 --2- 172.21.15.146:0/1553536423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6141300a0 0x7fb61411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.333+0000 7fb613fff700 1 -- 172.21.15.146:0/1553536423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c009a70 con 0x7fb614133ad0 2023-10-03T10:12:21.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.333+0000 7fb6137fe700 1 --2- 172.21.15.146:0/1553536423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6141300a0 0x7fb61411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:21.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.333+0000 7f148685d700 1 Processor -- start 2023-10-03T10:12:21.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.333+0000 7fb613fff700 1 --2- 172.21.15.146:0/1553536423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb614133ad0 0x7fb61411e4c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb61406e4e0 tx=0x7fb60c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:21.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.333+0000 7f148685d700 1 -- start start 2023-10-03T10:12:21.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.333+0000 7fb5fbfff700 1 -- 172.21.15.146:0/1553536423 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c012430 con 0x7fb614133ad0 2023-10-03T10:12:21.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.333+0000 7fb5fbfff700 1 -- 172.21.15.146:0/1553536423 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60c004280 con 0x7fb614133ad0 2023-10-03T10:12:21.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.333+0000 7fb5fbfff700 1 -- 172.21.15.146:0/1553536423 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c004630 con 0x7fb614133ad0 2023-10-03T10:12:21.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.333+0000 7fb61a245700 1 -- 172.21.15.146:0/1553536423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6140a2ea0 con 0x7fb614133ad0 2023-10-03T10:12:21.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.333+0000 7fb61a245700 1 -- 172.21.15.146:0/1553536423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61411fe70 con 0x7fb614133ad0 2023-10-03T10:12:21.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.334+0000 7f148685d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f148006a770 0x7f1480137410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.334+0000 7f148685d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f148006b250 0x7f1480137950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.334+0000 7f148685d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148009da80 0x7f1480137e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.334+0000 7f148685d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148011a2b0 con 0x7f148006b250 2023-10-03T10:12:21.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.334+0000 7f148685d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148011a670 con 0x7f148009da80 2023-10-03T10:12:21.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.334+0000 7f148685d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14800a11c0 con 0x7f148006a770 2023-10-03T10:12:21.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.334+0000 7f1484dfa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148009da80 0x7f1480137e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.334+0000 7f1484dfa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148009da80 0x7f1480137e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33840/0 (socket says 172.21.15.146:33840) 2023-10-03T10:12:21.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.334+0000 7f1484dfa700 1 -- 172.21.15.146:0/4161110033 learned_addr learned my addr 172.21.15.146:0/4161110033 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:21.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.334+0000 7f1484dfa700 1 -- 172.21.15.146:0/4161110033 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f148006a770 msgr2=0x7f1480137410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:21.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.334+0000 7f1484dfa700 1 --2- 172.21.15.146:0/4161110033 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f148006a770 0x7f1480137410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.334+0000 7f1484dfa700 1 -- 172.21.15.146:0/4161110033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f148006b250 msgr2=0x7f1480137950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:21.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.334+0000 7f1484dfa700 1 --2- 172.21.15.146:0/4161110033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f148006b250 0x7f1480137950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.334+0000 7f1484dfa700 1 -- 172.21.15.146:0/4161110033 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14740094a0 con 0x7f148009da80 2023-10-03T10:12:21.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.334+0000 7fb5fbfff700 1 -- 172.21.15.146:0/1553536423 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb60c004790 con 0x7fb614133ad0 2023-10-03T10:12:21.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.334+0000 7fb5fbfff700 1 -- 172.21.15.146:0/1553536423 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fb60c0424b0 con 0x7fb614133ad0 2023-10-03T10:12:21.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.334+0000 7fb6137fe700 1 -- 172.21.15.146:0/1553536423 >> v1:172.21.15.146:6816/126749 conn(0x7fb60002f560 legacy=0x7fb600031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:21.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.334+0000 7fb5f9ffb700 1 -- 172.21.15.146:0/1553536423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ec0052e0 con 0x7fb614133ad0 2023-10-03T10:12:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.335+0000 7f1484dfa700 1 --2- 172.21.15.146:0/4161110033 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148009da80 0x7f1480137e90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f147800b970 tx=0x7f147800bd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.335+0000 7f147cff9700 1 -- 172.21.15.146:0/4161110033 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147800c9b0 con 0x7f148009da80 2023-10-03T10:12:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.335+0000 7f147cff9700 1 -- 172.21.15.146:0/4161110033 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147800cb30 con 0x7f148009da80 2023-10-03T10:12:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.335+0000 7f147cff9700 1 -- 172.21.15.146:0/4161110033 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478014440 con 0x7f148009da80 2023-10-03T10:12:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.335+0000 7f148685d700 1 -- 172.21.15.146:0/4161110033 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1480072230 con 0x7f148009da80 2023-10-03T10:12:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.335+0000 7f148685d700 1 -- 172.21.15.146:0/4161110033 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148012f5f0 con 0x7f148009da80 2023-10-03T10:12:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.336+0000 7f147cff9700 1 -- 172.21.15.146:0/4161110033 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f147801d3b0 con 0x7f148009da80 2023-10-03T10:12:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.336+0000 7f148685d700 1 -- 172.21.15.146:0/4161110033 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148011aa60 con 0x7f148009da80 2023-10-03T10:12:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.336+0000 7f147ffff700 1 -- 172.21.15.146:0/4161110033 >> v1:172.21.15.146:6816/126749 conn(0x7f146c02f510 legacy=0x7f146c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.336+0000 7f147cff9700 1 -- 172.21.15.146:0/4161110033 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f1478006e40 con 0x7f148009da80 2023-10-03T10:12:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.338+0000 7fb940ea0700 1 Processor -- start 2023-10-03T10:12:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.338+0000 7fb940ea0700 1 -- start start 2023-10-03T10:12:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.339+0000 7fb940ea0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb93c12d280 0x7fb93c12d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.339+0000 7fb940ea0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb93c130ec0 0x7fb93c138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.339+0000 7fb940ea0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93c09ae40 con 0x7fb93c130350 2023-10-03T10:12:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.339+0000 7fb940ea0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93c09b9a0 con 0x7fb93c12d280 2023-10-03T10:12:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.339+0000 7fb940ea0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c09bbb0 con 0x7fb93c130ec0 2023-10-03T10:12:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.339+0000 7fb93a59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb93c12d280 0x7fb93c12d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.339+0000 7fb93a59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb93c12d280 0x7fb93c12d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47024/0 (socket says 172.21.15.146:47024) 2023-10-03T10:12:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.339+0000 7fb93a59c700 1 -- 172.21.15.146:0/3526241148 learned_addr learned my addr 172.21.15.146:0/3526241148 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.339+0000 7f3f8ae12700 1 Processor -- start 2023-10-03T10:12:21.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.340+0000 7f3f8ae12700 1 -- start start 2023-10-03T10:12:21.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.340+0000 7fb93a59c700 1 -- 172.21.15.146:0/3526241148 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb93c130ec0 msgr2=0x7fb93c138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:21.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.340+0000 7fb93a59c700 1 --2- 172.21.15.146:0/3526241148 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb93c130ec0 0x7fb93c138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.340+0000 7fb93a59c700 1 -- 172.21.15.146:0/3526241148 >> v1:172.21.15.146:6789/0 conn(0x7fb93c130350 legacy=0x7fb93c1307b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.340+0000 7fb93a59c700 1 -- 172.21.15.146:0/3526241148 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c09b250 con 0x7fb93c12d280 2023-10-03T10:12:21.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.340+0000 7fb93a59c700 1 --2- 172.21.15.146:0/3526241148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb93c12d280 0x7fb93c12d650 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb92c006fd0 tx=0x7fb92c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b7b34de5e0deb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:21.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.340+0000 7f3f8ae12700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f84138040 0x7f3f84138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.340+0000 7f3f8ae12700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3f840a1400 0x7f3f8413fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.340+0000 7f3f8ae12700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f841379e0 con 0x7f3f840a08e0 2023-10-03T10:12:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.340+0000 7f3f8ae12700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f840a2100 con 0x7f3f840a1400 2023-10-03T10:12:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.340+0000 7f3f8ae12700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f84138950 con 0x7f3f84138040 2023-10-03T10:12:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.340+0000 7f3f83fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3f840a08e0 0x7f3f840a0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39270/0 (socket says 172.21.15.146:39270) 2023-10-03T10:12:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.340+0000 7f3f83fff700 1 -- 172.21.15.146:0/3237736321 learned_addr learned my addr 172.21.15.146:0/3237736321 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.340+0000 7f3f893af700 1 --2- 172.21.15.146:0/3237736321 >> v2:172.21.15.146:3300/0 conn(0x7f3f840a1400 0x7f3f8413fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.340+0000 7f3f88bae700 1 --2- 172.21.15.146:0/3237736321 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f84138040 0x7f3f84138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.340+0000 7f3f893af700 1 -- 172.21.15.146:0/3237736321 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f84138040 msgr2=0x7f3f84138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.340+0000 7f3f893af700 1 --2- 172.21.15.146:0/3237736321 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f84138040 0x7f3f84138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.341+0000 7f3f893af700 1 -- 172.21.15.146:0/3237736321 >> v1:172.21.15.146:6789/0 conn(0x7f3f840a08e0 legacy=0x7f3f840a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.341+0000 7f3f893af700 1 -- 172.21.15.146:0/3237736321 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8409b9b0 con 0x7f3f840a1400 2023-10-03T10:12:21.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.341+0000 7f3f88bae700 1 --2- 172.21.15.146:0/3237736321 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f84138040 0x7f3f84138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:21.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.341+0000 7f3f893af700 1 --2- 172.21.15.146:0/3237736321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f840a1400 0x7f3f8413fd20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c009dc0 tx=0x7f3f7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a986ac58eb9a9f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:21.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.341+0000 7f3f837fe700 1 -- 172.21.15.146:0/3237736321 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c00e070 con 0x7f3f840a1400 2023-10-03T10:12:21.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.342+0000 7f3f837fe700 1 -- 172.21.15.146:0/3237736321 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7c00bb90 con 0x7f3f840a1400 2023-10-03T10:12:21.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.342+0000 7f3f837fe700 1 -- 172.21.15.146:0/3237736321 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c012430 con 0x7f3f840a1400 2023-10-03T10:12:21.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.342+0000 7fb93959a700 1 -- 172.21.15.146:0/3526241148 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c005e30 con 0x7fb93c12d280 2023-10-03T10:12:21.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.342+0000 7fb5fbfff700 1 -- 172.21.15.146:0/1553536423 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb60c02f3e0 con 0x7fb614133ad0 2023-10-03T10:12:21.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.342+0000 7fb93959a700 1 -- 172.21.15.146:0/3526241148 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92c004030 con 0x7fb93c12d280 2023-10-03T10:12:21.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.342+0000 7fb93959a700 1 -- 172.21.15.146:0/3526241148 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c0043e0 con 0x7fb93c12d280 2023-10-03T10:12:21.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.342+0000 7f147cff9700 1 -- 172.21.15.146:0/4161110033 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f148011aa60 con 0x7f148009da80 2023-10-03T10:12:21.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.342+0000 7f3f8ae12700 1 -- 172.21.15.146:0/3237736321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f840a1400 msgr2=0x7f3f8413fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.342+0000 7f3f8ae12700 1 --2- 172.21.15.146:0/3237736321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f840a1400 0x7f3f8413fd20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c009dc0 tx=0x7f3f7c00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:21.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.343+0000 7fb940ea0700 1 -- 172.21.15.146:0/3526241148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb93c12d280 msgr2=0x7fb93c12d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.343+0000 7fb940ea0700 1 --2- 172.21.15.146:0/3526241148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb93c12d280 0x7fb93c12d650 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb92c006fd0 tx=0x7fb92c009bd0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.343+0000 7f3f8ae12700 1 -- 172.21.15.146:0/3237736321 shutdown_connections 2023-10-03T10:12:21.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.343+0000 7f3f8ae12700 1 --2- 172.21.15.146:0/3237736321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f840a1400 0x7f3f8413fd20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.343+0000 7f3f8ae12700 1 --2- 172.21.15.146:0/3237736321 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f84138040 0x7f3f84138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.343+0000 7f3f8ae12700 1 -- 172.21.15.146:0/3237736321 >> 172.21.15.146:0/3237736321 conn(0x7f3f840a2980 msgr2=0x7f3f840a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.343+0000 7f3f8ae12700 1 -- 172.21.15.146:0/3237736321 shutdown_connections 2023-10-03T10:12:21.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.343+0000 7f3f8ae12700 1 -- 172.21.15.146:0/3237736321 wait complete. 2023-10-03T10:12:21.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.343+0000 7fb940ea0700 1 -- 172.21.15.146:0/3526241148 shutdown_connections 2023-10-03T10:12:21.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.343+0000 7fb940ea0700 1 --2- 172.21.15.146:0/3526241148 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb93c130ec0 0x7fb93c138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.343+0000 7fb940ea0700 1 --2- 172.21.15.146:0/3526241148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb93c12d280 0x7fb93c12d650 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.343+0000 7fb940ea0700 1 -- 172.21.15.146:0/3526241148 >> 172.21.15.146:0/3526241148 conn(0x7fb93c0a2980 msgr2=0x7fb93c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.344+0000 7f3f8ae12700 1 Processor -- start 2023-10-03T10:12:21.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.344+0000 7f3f8ae12700 1 -- start start 2023-10-03T10:12:21.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.345+0000 7f3f8ae12700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f840a08e0 0x7f3f841265d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.345+0000 7f3f8ae12700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f840a1400 0x7f3f84126b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.345+0000 7f3f8ae12700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f84138040 0x7f3f84127050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.345+0000 7f3f8ae12700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f84129e10 con 0x7f3f84138040 2023-10-03T10:12:21.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.345+0000 7f3f8ae12700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f841282f0 con 0x7f3f840a08e0 2023-10-03T10:12:21.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.345+0000 7f3f8ae12700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f84137760 con 0x7f3f840a1400 2023-10-03T10:12:21.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.345+0000 7f3f893af700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f84138040 0x7f3f84127050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.345+0000 7f3f893af700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f84138040 0x7f3f84127050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47044/0 (socket says 172.21.15.146:47044) 2023-10-03T10:12:21.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.345+0000 7f3f893af700 1 -- 172.21.15.146:0/978636869 learned_addr learned my addr 172.21.15.146:0/978636869 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:21.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.345+0000 7f3f83fff700 1 --2- 172.21.15.146:0/978636869 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f840a1400 0x7f3f84126b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.345+0000 7f3f893af700 1 -- 172.21.15.146:0/978636869 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f840a1400 msgr2=0x7f3f84126b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.345+0000 7f3f893af700 1 --2- 172.21.15.146:0/978636869 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f840a1400 0x7f3f84126b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.345+0000 7f3f893af700 1 -- 172.21.15.146:0/978636869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f840a08e0 msgr2=0x7f3f841265d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.345+0000 7f3f893af700 1 --2- 172.21.15.146:0/978636869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f840a08e0 0x7f3f841265d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.346+0000 7f3f893af700 1 -- 172.21.15.146:0/978636869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7c009a70 con 0x7f3f84138040 2023-10-03T10:12:21.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.346+0000 7f3f893af700 1 --2- 172.21.15.146:0/978636869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f84138040 0x7f3f84127050 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c014040 tx=0x7f3f7c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:21.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.346+0000 7f3f817fa700 1 -- 172.21.15.146:0/978636869 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c01b810 con 0x7f3f84138040 2023-10-03T10:12:21.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.346+0000 7f3f817fa700 1 -- 172.21.15.146:0/978636869 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7c020070 con 0x7f3f84138040 2023-10-03T10:12:21.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.346+0000 7f3f817fa700 1 -- 172.21.15.146:0/978636869 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c01bc10 con 0x7f3f84138040 2023-10-03T10:12:21.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.346+0000 7f3f8ae12700 1 -- 172.21.15.146:0/978636869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f8409a240 con 0x7f3f84138040 2023-10-03T10:12:21.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.347+0000 7fb940ea0700 1 -- 172.21.15.146:0/3526241148 shutdown_connections 2023-10-03T10:12:21.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.347+0000 7fb940ea0700 1 -- 172.21.15.146:0/3526241148 wait complete. 2023-10-03T10:12:21.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.346+0000 7f3f8ae12700 1 -- 172.21.15.146:0/978636869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8412a880 con 0x7f3f84138040 2023-10-03T10:12:21.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.347+0000 7f3f8ae12700 1 -- 172.21.15.146:0/978636869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f84138ad0 con 0x7f3f84138040 2023-10-03T10:12:21.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.347+0000 7f3f817fa700 1 -- 172.21.15.146:0/978636869 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3f7c027480 con 0x7f3f84138040 2023-10-03T10:12:21.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.347+0000 7f3f817fa700 1 -- 172.21.15.146:0/978636869 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f3f7c022070 con 0x7f3f84138040 2023-10-03T10:12:21.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.347+0000 7f3f88bae700 1 -- 172.21.15.146:0/978636869 >> v1:172.21.15.146:6816/126749 conn(0x7f3f6802f510 legacy=0x7f3f680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:21.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.348+0000 7fb940ea0700 1 Processor -- start 2023-10-03T10:12:21.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.349+0000 7fb940ea0700 1 -- start start 2023-10-03T10:12:21.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.349+0000 7fb940ea0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb93c12d280 0x7fb93c06fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.349+0000 7fb940ea0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb93c130350 0x7fb93c070180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.349+0000 7fb940ea0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb93c130ec0 0x7fb93c1cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:21.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.349+0000 7fb940ea0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c0717a0 con 0x7fb93c130ec0 2023-10-03T10:12:21.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.349+0000 7fb940ea0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c06f850 con 0x7fb93c12d280 2023-10-03T10:12:21.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.349+0000 7fb940ea0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c071dc0 con 0x7fb93c130350 2023-10-03T10:12:21.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.349+0000 7fb93a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb93c12d280 0x7fb93c06fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.349+0000 7fb93a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb93c12d280 0x7fb93c06fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33854/0 (socket says 172.21.15.146:33854) 2023-10-03T10:12:21.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.349+0000 7fb93a59c700 1 -- 172.21.15.146:0/2707360990 learned_addr learned my addr 172.21.15.146:0/2707360990 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:21.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.349+0000 7fb93ad9d700 1 --2- 172.21.15.146:0/2707360990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb93c130ec0 0x7fb93c1cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.349+0000 7fb939d9b700 1 --2- 172.21.15.146:0/2707360990 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb93c130350 0x7fb93c070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:21.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.350+0000 7fb93a59c700 1 -- 172.21.15.146:0/2707360990 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb93c130350 msgr2=0x7fb93c070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.350+0000 7fb93a59c700 1 --2- 172.21.15.146:0/2707360990 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb93c130350 0x7fb93c070180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.350+0000 7fb93a59c700 1 -- 172.21.15.146:0/2707360990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb93c130ec0 msgr2=0x7fb93c1cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.350+0000 7fb93a59c700 1 --2- 172.21.15.146:0/2707360990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb93c130ec0 0x7fb93c1cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.350+0000 7fb93a59c700 1 -- 172.21.15.146:0/2707360990 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92c009500 con 0x7fb93c12d280 2023-10-03T10:12:21.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.350+0000 7fb93a59c700 1 --2- 172.21.15.146:0/2707360990 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb93c12d280 0x7fb93c06fc40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb93c066a10 tx=0x7fb92c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:21.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.350+0000 7fb92affd700 1 -- 172.21.15.146:0/2707360990 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c003c60 con 0x7fb93c12d280 2023-10-03T10:12:21.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.350+0000 7fb940ea0700 1 -- 172.21.15.146:0/2707360990 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb93c12cfc0 con 0x7fb93c12d280 2023-10-03T10:12:21.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.350+0000 7fb92affd700 1 -- 172.21.15.146:0/2707360990 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92c003dc0 con 0x7fb93c12d280 2023-10-03T10:12:21.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.350+0000 7fb92affd700 1 -- 172.21.15.146:0/2707360990 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c011660 con 0x7fb93c12d280 2023-10-03T10:12:21.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.350+0000 7fb940ea0700 1 -- 172.21.15.146:0/2707360990 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93c127010 con 0x7fb93c12d280 2023-10-03T10:12:21.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.351+0000 7fb92affd700 1 -- 172.21.15.146:0/2707360990 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb92c018070 con 0x7fb93c12d280 2023-10-03T10:12:21.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.352+0000 7fb940ea0700 1 -- 172.21.15.146:0/2707360990 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb93c126240 con 0x7fb93c12d280 2023-10-03T10:12:21.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.352+0000 7fb939d9b700 1 -- 172.21.15.146:0/2707360990 >> v1:172.21.15.146:6816/126749 conn(0x7fb91c02f510 legacy=0x7fb91c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:21.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.352+0000 7fb92affd700 1 -- 172.21.15.146:0/2707360990 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fb92c063100 con 0x7fb93c12d280 2023-10-03T10:12:21.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.354+0000 7f3f817fa700 1 -- 172.21.15.146:0/978636869 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f7c01bd70 con 0x7f3f84138040 2023-10-03T10:12:21.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.361+0000 7fb92affd700 1 -- 172.21.15.146:0/2707360990 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb92c094750 con 0x7fb93c12d280 2023-10-03T10:12:21.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.535+0000 7fb6137fe700 1 -- 172.21.15.146:0/1553536423 >> v1:172.21.15.146:6816/126749 conn(0x7fb60002f560 legacy=0x7fb600031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:21.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.537+0000 7f147ffff700 1 -- 172.21.15.146:0/4161110033 >> v1:172.21.15.146:6816/126749 conn(0x7f146c02f510 legacy=0x7f146c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:21.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.537+0000 7fb5f9ffb700 1 -- 172.21.15.146:0/1553536423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb5ec005860 con 0x7fb614133ad0 2023-10-03T10:12:21.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.538+0000 7fb5fbfff700 1 -- 172.21.15.146:0/1553536423 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb60c011390 con 0x7fb614133ad0 2023-10-03T10:12:21.539 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:21.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.540+0000 7fb5f9ffb700 1 -- 172.21.15.146:0/1553536423 >> v1:172.21.15.146:6816/126749 conn(0x7fb60002f560 legacy=0x7fb600031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:21.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.540+0000 7fb5f9ffb700 1 -- 172.21.15.146:0/1553536423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb614133ad0 msgr2=0x7fb61411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.540+0000 7fb5f9ffb700 1 --2- 172.21.15.146:0/1553536423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb614133ad0 0x7fb61411e4c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb61406e4e0 tx=0x7fb60c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.540+0000 7fb5f9ffb700 1 -- 172.21.15.146:0/1553536423 shutdown_connections 2023-10-03T10:12:21.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.540+0000 7fb5f9ffb700 1 --2- 172.21.15.146:0/1553536423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb614133ad0 0x7fb61411e4c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.540+0000 7fb5f9ffb700 1 --2- 172.21.15.146:0/1553536423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6141300a0 0x7fb61411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.540+0000 7fb5f9ffb700 1 --2- 172.21.15.146:0/1553536423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb614130bc0 0x7fb61411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.540+0000 7fb5f9ffb700 1 -- 172.21.15.146:0/1553536423 >> 172.21.15.146:0/1553536423 conn(0x7fb614099c40 msgr2=0x7fb61412e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.540+0000 7fb5f9ffb700 1 -- 172.21.15.146:0/1553536423 shutdown_connections 2023-10-03T10:12:21.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.540+0000 7fb5f9ffb700 1 -- 172.21.15.146:0/1553536423 wait complete. 2023-10-03T10:12:21.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.544+0000 7f148685d700 1 -- 172.21.15.146:0/4161110033 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f148011aa60 con 0x7f148009da80 2023-10-03T10:12:21.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.544+0000 7f147cff9700 1 -- 172.21.15.146:0/4161110033 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f148011aa60 con 0x7f148009da80 2023-10-03T10:12:21.545 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:21.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.548+0000 7f3f88bae700 1 -- 172.21.15.146:0/978636869 >> v1:172.21.15.146:6816/126749 conn(0x7f3f6802f510 legacy=0x7f3f680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:21.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.548+0000 7f148685d700 1 -- 172.21.15.146:0/4161110033 >> v1:172.21.15.146:6816/126749 conn(0x7f146c02f510 legacy=0x7f146c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:21.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.548+0000 7f148685d700 1 -- 172.21.15.146:0/4161110033 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148009da80 msgr2=0x7f1480137e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.548+0000 7f148685d700 1 --2- 172.21.15.146:0/4161110033 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148009da80 0x7f1480137e90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f147800b970 tx=0x7f147800bd30 comp rx=0 tx=0).stop 2023-10-03T10:12:21.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.548+0000 7f148685d700 1 -- 172.21.15.146:0/4161110033 shutdown_connections 2023-10-03T10:12:21.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.548+0000 7f148685d700 1 --2- 172.21.15.146:0/4161110033 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f148009da80 0x7f1480137e90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.548+0000 7f148685d700 1 --2- 172.21.15.146:0/4161110033 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f148006a770 0x7f1480137410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.548+0000 7f148685d700 1 --2- 172.21.15.146:0/4161110033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f148006b250 0x7f1480137950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.548+0000 7f148685d700 1 -- 172.21.15.146:0/4161110033 >> 172.21.15.146:0/4161110033 conn(0x7f148009f9f0 msgr2=0x7f1480134e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.548+0000 7f148685d700 1 -- 172.21.15.146:0/4161110033 shutdown_connections 2023-10-03T10:12:21.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.548+0000 7f148685d700 1 -- 172.21.15.146:0/4161110033 wait complete. 2023-10-03T10:12:21.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.553+0000 7fb939d9b700 1 -- 172.21.15.146:0/2707360990 >> v1:172.21.15.146:6816/126749 conn(0x7fb91c02f510 legacy=0x7fb91c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:21.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:21.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:21.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.662+0000 7f3f8ae12700 1 -- 172.21.15.146:0/978636869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3f8404f2a0 con 0x7f3f84138040 2023-10-03T10:12:21.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.662+0000 7f3f817fa700 1 -- 172.21.15.146:0/978636869 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3f7c01ab70 con 0x7f3f84138040 2023-10-03T10:12:21.663 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:21.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.664+0000 7f3f8ae12700 1 -- 172.21.15.146:0/978636869 >> v1:172.21.15.146:6816/126749 conn(0x7f3f6802f510 legacy=0x7f3f680319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:21.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.664+0000 7f3f8ae12700 1 -- 172.21.15.146:0/978636869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f84138040 msgr2=0x7f3f84127050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.664+0000 7f3f8ae12700 1 --2- 172.21.15.146:0/978636869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f84138040 0x7f3f84127050 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c014040 tx=0x7f3f7c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.664+0000 7f3f8ae12700 1 -- 172.21.15.146:0/978636869 shutdown_connections 2023-10-03T10:12:21.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.664+0000 7f3f8ae12700 1 --2- 172.21.15.146:0/978636869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f84138040 0x7f3f84127050 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.664+0000 7f3f8ae12700 1 --2- 172.21.15.146:0/978636869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f840a08e0 0x7f3f841265d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.664+0000 7f3f8ae12700 1 --2- 172.21.15.146:0/978636869 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f840a1400 0x7f3f84126b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.664+0000 7f3f8ae12700 1 -- 172.21.15.146:0/978636869 >> 172.21.15.146:0/978636869 conn(0x7f3f840a2980 msgr2=0x7f3f8409e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.664+0000 7f3f8ae12700 1 -- 172.21.15.146:0/978636869 shutdown_connections 2023-10-03T10:12:21.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.664+0000 7f3f8ae12700 1 -- 172.21.15.146:0/978636869 wait complete. 2023-10-03T10:12:21.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.670+0000 7fb940ea0700 1 -- 172.21.15.146:0/2707360990 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb93c1263d0 con 0x7fb93c12d280 2023-10-03T10:12:21.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.670+0000 7fb92affd700 1 -- 172.21.15.146:0/2707360990 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb92c043020 con 0x7fb93c12d280 2023-10-03T10:12:21.671 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:21.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.672+0000 7fb940ea0700 1 -- 172.21.15.146:0/2707360990 >> v1:172.21.15.146:6816/126749 conn(0x7fb91c02f510 legacy=0x7fb91c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:21.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.672+0000 7fb940ea0700 1 -- 172.21.15.146:0/2707360990 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb93c12d280 msgr2=0x7fb93c06fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:21.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.672+0000 7fb940ea0700 1 --2- 172.21.15.146:0/2707360990 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb93c12d280 0x7fb93c06fc40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb93c066a10 tx=0x7fb92c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.672+0000 7fb940ea0700 1 -- 172.21.15.146:0/2707360990 shutdown_connections 2023-10-03T10:12:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.672+0000 7fb940ea0700 1 --2- 172.21.15.146:0/2707360990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb93c130ec0 0x7fb93c1cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.672+0000 7fb940ea0700 1 --2- 172.21.15.146:0/2707360990 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb93c12d280 0x7fb93c06fc40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.672+0000 7fb940ea0700 1 --2- 172.21.15.146:0/2707360990 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb93c130350 0x7fb93c070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.672+0000 7fb940ea0700 1 -- 172.21.15.146:0/2707360990 >> 172.21.15.146:0/2707360990 conn(0x7fb93c0a2980 msgr2=0x7fb93c09eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.672+0000 7fb940ea0700 1 -- 172.21.15.146:0/2707360990 shutdown_connections 2023-10-03T10:12:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:21.672+0000 7fb940ea0700 1 -- 172.21.15.146:0/2707360990 wait complete. 2023-10-03T10:12:21.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:21.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:22.555 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:22.563 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:22.679 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:22.686 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:22.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.691+0000 7fae3088e700 1 Processor -- start 2023-10-03T10:12:22.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.691+0000 7fae3088e700 1 -- start start 2023-10-03T10:12:22.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.692+0000 7fae3088e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae2c099e20 0x7fae2c09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.692+0000 7fae3088e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fae2c09a730 0x7fae2c130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.692+0000 7fae3088e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae2c130890 0x7fae2c130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.692+0000 7fae3088e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2c09bf50 con 0x7fae2c09a730 2023-10-03T10:12:22.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.692+0000 7fae3088e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c099a60 con 0x7fae2c099e20 2023-10-03T10:12:22.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.692+0000 7fae3088e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c09b230 con 0x7fae2c130890 2023-10-03T10:12:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.692+0000 7fae2a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae2c099e20 0x7fae2c09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.692+0000 7fae2a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae2c099e20 0x7fae2c09a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33856/0 (socket says 172.21.15.146:33856) 2023-10-03T10:12:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.692+0000 7fae2a59c700 1 -- 172.21.15.146:0/2872699787 learned_addr learned my addr 172.21.15.146:0/2872699787 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.692+0000 7fae2ad9d700 1 --2- 172.21.15.146:0/2872699787 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae2c130890 0x7fae2c130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.692+0000 7fae2a59c700 1 -- 172.21.15.146:0/2872699787 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae2c130890 msgr2=0x7fae2c130d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.692+0000 7fae2a59c700 1 --2- 172.21.15.146:0/2872699787 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae2c130890 0x7fae2c130d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.692+0000 7fae2a59c700 1 -- 172.21.15.146:0/2872699787 >> v2:172.21.15.146:3300/0 conn(0x7fae2c09a730 msgr2=0x7fae2c130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.692+0000 7fae2a59c700 1 --2- 172.21.15.146:0/2872699787 >> v2:172.21.15.146:3300/0 conn(0x7fae2c09a730 0x7fae2c130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.692+0000 7fae2a59c700 1 -- 172.21.15.146:0/2872699787 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c09bb90 con 0x7fae2c099e20 2023-10-03T10:12:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.693+0000 7fae2ad9d700 1 --2- 172.21.15.146:0/2872699787 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae2c130890 0x7fae2c130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.693+0000 7fae2a59c700 1 --2- 172.21.15.146:0/2872699787 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae2c099e20 0x7fae2c09a1f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fae1c006fd0 tx=0x7fae1c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58a3883fcdff8405 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.693+0000 7fae2959a700 1 -- 172.21.15.146:0/2872699787 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c005e30 con 0x7fae2c099e20 2023-10-03T10:12:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.693+0000 7fae2959a700 1 -- 172.21.15.146:0/2872699787 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1c004030 con 0x7fae2c099e20 2023-10-03T10:12:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.693+0000 7fae2959a700 1 -- 172.21.15.146:0/2872699787 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c0043e0 con 0x7fae2c099e20 2023-10-03T10:12:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.694+0000 7fae3088e700 1 -- 172.21.15.146:0/2872699787 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae2c099e20 msgr2=0x7fae2c09a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.694+0000 7fae3088e700 1 --2- 172.21.15.146:0/2872699787 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae2c099e20 0x7fae2c09a1f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fae1c006fd0 tx=0x7fae1c009bd0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.694+0000 7fae3088e700 1 -- 172.21.15.146:0/2872699787 shutdown_connections 2023-10-03T10:12:22.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.694+0000 7fae3088e700 1 --2- 172.21.15.146:0/2872699787 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae2c099e20 0x7fae2c09a1f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.694+0000 7fae3088e700 1 --2- 172.21.15.146:0/2872699787 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae2c130890 0x7fae2c130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.694+0000 7fae3088e700 1 --2- 172.21.15.146:0/2872699787 >> v2:172.21.15.146:3300/0 conn(0x7fae2c09a730 0x7fae2c130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.694+0000 7fae3088e700 1 -- 172.21.15.146:0/2872699787 >> 172.21.15.146:0/2872699787 conn(0x7fae2c0a2980 msgr2=0x7fae2c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:22.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.694+0000 7fae3088e700 1 -- 172.21.15.146:0/2872699787 shutdown_connections 2023-10-03T10:12:22.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.694+0000 7fae3088e700 1 -- 172.21.15.146:0/2872699787 wait complete. 2023-10-03T10:12:22.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.695+0000 7fae3088e700 1 Processor -- start 2023-10-03T10:12:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.695+0000 7fae3088e700 1 -- start start 2023-10-03T10:12:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.696+0000 7fae3088e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae2c099e20 0x7fae2c1369a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.696+0000 7fae3088e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae2c09a730 0x7fae2c136ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.696+0000 7fae3088e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae2c130890 0x7fae2c1376b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.696+0000 7fae3088e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c0a1300 con 0x7fae2c130890 2023-10-03T10:12:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.696+0000 7fae3088e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c1358b0 con 0x7fae2c099e20 2023-10-03T10:12:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.696+0000 7fae3088e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c139340 con 0x7fae2c09a730 2023-10-03T10:12:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.696+0000 7fae2a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae2c099e20 0x7fae2c1369a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.696+0000 7fae2a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae2c099e20 0x7fae2c1369a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33866/0 (socket says 172.21.15.146:33866) 2023-10-03T10:12:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.696+0000 7fae2a59c700 1 -- 172.21.15.146:0/3847557323 learned_addr learned my addr 172.21.15.146:0/3847557323 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.696+0000 7fae29d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae2c09a730 0x7fae2c136ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.696+0000 7fae2ad9d700 1 --2- 172.21.15.146:0/3847557323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae2c130890 0x7fae2c1376b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.697+0000 7fae2a59c700 1 -- 172.21.15.146:0/3847557323 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae2c09a730 msgr2=0x7fae2c136ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.697+0000 7fae2a59c700 1 --2- 172.21.15.146:0/3847557323 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae2c09a730 0x7fae2c136ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.697+0000 7fae2a59c700 1 -- 172.21.15.146:0/3847557323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae2c130890 msgr2=0x7fae2c1376b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.697+0000 7fae2a59c700 1 --2- 172.21.15.146:0/3847557323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae2c130890 0x7fae2c1376b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.697+0000 7fae2a59c700 1 -- 172.21.15.146:0/3847557323 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae24009a70 con 0x7fae2c099e20 2023-10-03T10:12:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.697+0000 7fae2ad9d700 1 --2- 172.21.15.146:0/3847557323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae2c130890 0x7fae2c1376b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.697+0000 7fae2a59c700 1 --2- 172.21.15.146:0/3847557323 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae2c099e20 0x7fae2c1369a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fae1c009f20 tx=0x7fae1c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.697+0000 7fae1affd700 1 -- 172.21.15.146:0/3847557323 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c006b70 con 0x7fae2c099e20 2023-10-03T10:12:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.697+0000 7fae3088e700 1 -- 172.21.15.146:0/3847557323 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae1c009500 con 0x7fae2c099e20 2023-10-03T10:12:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.697+0000 7fae1affd700 1 -- 172.21.15.146:0/3847557323 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1c01d430 con 0x7fae2c099e20 2023-10-03T10:12:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.697+0000 7fae1affd700 1 -- 172.21.15.146:0/3847557323 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c01d7e0 con 0x7fae2c099e20 2023-10-03T10:12:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.697+0000 7fae3088e700 1 -- 172.21.15.146:0/3847557323 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2c134670 con 0x7fae2c099e20 2023-10-03T10:12:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.698+0000 7fae1affd700 1 -- 172.21.15.146:0/3847557323 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fae1c01d940 con 0x7fae2c099e20 2023-10-03T10:12:22.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.698+0000 7fae1affd700 1 -- 172.21.15.146:0/3847557323 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fae1c040d00 con 0x7fae2c099e20 2023-10-03T10:12:22.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.698+0000 7fae29d9b700 1 -- 172.21.15.146:0/3847557323 >> v1:172.21.15.146:6816/126749 conn(0x7fae0c02f510 legacy=0x7fae0c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:22.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.699+0000 7fae3088e700 1 -- 172.21.15.146:0/3847557323 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2c1363e0 con 0x7fae2c099e20 2023-10-03T10:12:22.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.707+0000 7fae1affd700 1 -- 172.21.15.146:0/3847557323 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae1c021020 con 0x7fae2c099e20 2023-10-03T10:12:22.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.739+0000 7fc212b17700 1 Processor -- start 2023-10-03T10:12:22.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.740+0000 7fc212b17700 1 -- start start 2023-10-03T10:12:22.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.740+0000 7fc212b17700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc20c138410 0x7fc20c0a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.740+0000 7fc212b17700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc20c13dd10 0x7fc20c1400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.740+0000 7fc212b17700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c1379e0 con 0x7fc20c138040 2023-10-03T10:12:22.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.740+0000 7fc212b17700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c0a2100 con 0x7fc20c13dd10 2023-10-03T10:12:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.740+0000 7fc212b17700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c09b9b0 con 0x7fc20c138410 2023-10-03T10:12:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.740+0000 7fc20bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc20c138410 0x7fc20c0a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.741+0000 7fc20bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc20c138410 0x7fc20c0a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54324/0 (socket says 172.21.15.146:54324) 2023-10-03T10:12:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.741+0000 7fc20bfff700 1 -- 172.21.15.146:0/2476917051 learned_addr learned my addr 172.21.15.146:0/2476917051 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.741+0000 7fc2110b4700 1 --2- 172.21.15.146:0/2476917051 >> v2:172.21.15.146:3300/0 conn(0x7fc20c13dd10 0x7fc20c1400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.741+0000 7fc20bfff700 1 -- 172.21.15.146:0/2476917051 >> v2:172.21.15.146:3300/0 conn(0x7fc20c13dd10 msgr2=0x7fc20c1400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.741+0000 7fc20bfff700 1 --2- 172.21.15.146:0/2476917051 >> v2:172.21.15.146:3300/0 conn(0x7fc20c13dd10 0x7fc20c1400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.741+0000 7fc20bfff700 1 -- 172.21.15.146:0/2476917051 >> v1:172.21.15.146:6789/0 conn(0x7fc20c138040 legacy=0x7fc20c0a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.741+0000 7fc20bfff700 1 -- 172.21.15.146:0/2476917051 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c137c10 con 0x7fc20c138410 2023-10-03T10:12:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.741+0000 7fc20bfff700 1 --2- 172.21.15.146:0/2476917051 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc20c138410 0x7fc20c0a0ff0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8009920 tx=0x7fc1f8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a104c8b27e180d74 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.741+0000 7fc20b7fe700 1 -- 172.21.15.146:0/2476917051 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8011830 con 0x7fc20c138410 2023-10-03T10:12:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.741+0000 7fc20b7fe700 1 -- 172.21.15.146:0/2476917051 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f8011990 con 0x7fc20c138410 2023-10-03T10:12:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.741+0000 7fc20b7fe700 1 -- 172.21.15.146:0/2476917051 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8011d20 con 0x7fc20c138410 2023-10-03T10:12:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.742+0000 7fc212b17700 1 -- 172.21.15.146:0/2476917051 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc20c138410 msgr2=0x7fc20c0a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.742+0000 7fc212b17700 1 --2- 172.21.15.146:0/2476917051 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc20c138410 0x7fc20c0a0ff0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8009920 tx=0x7fc1f8009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.742+0000 7fc212b17700 1 -- 172.21.15.146:0/2476917051 shutdown_connections 2023-10-03T10:12:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.742+0000 7fc212b17700 1 --2- 172.21.15.146:0/2476917051 >> v2:172.21.15.146:3300/0 conn(0x7fc20c13dd10 0x7fc20c1400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.742+0000 7fc212b17700 1 --2- 172.21.15.146:0/2476917051 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc20c138410 0x7fc20c0a0ff0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.742+0000 7fc212b17700 1 -- 172.21.15.146:0/2476917051 >> 172.21.15.146:0/2476917051 conn(0x7fc20c0a2980 msgr2=0x7fc20c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.742+0000 7fc212b17700 1 -- 172.21.15.146:0/2476917051 shutdown_connections 2023-10-03T10:12:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.742+0000 7fc212b17700 1 -- 172.21.15.146:0/2476917051 wait complete. 2023-10-03T10:12:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.743+0000 7fc212b17700 1 Processor -- start 2023-10-03T10:12:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.743+0000 7fc212b17700 1 -- start start 2023-10-03T10:12:22.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.744+0000 7fc212b17700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc20c138040 0x7fc20c121600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.744+0000 7fc212b17700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc20c138410 0x7fc20c121b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.744+0000 7fc212b17700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc20c13dd10 0x7fc20c122080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.744+0000 7fc212b17700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c1376e0 con 0x7fc20c13dd10 2023-10-03T10:12:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.744+0000 7fc212b17700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c124120 con 0x7fc20c138040 2023-10-03T10:12:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.744+0000 7fc212b17700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c124ba0 con 0x7fc20c138410 2023-10-03T10:12:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.744+0000 7fc2110b4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc20c13dd10 0x7fc20c122080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.744+0000 7fc2110b4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc20c13dd10 0x7fc20c122080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47094/0 (socket says 172.21.15.146:47094) 2023-10-03T10:12:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.744+0000 7fc2110b4700 1 -- 172.21.15.146:0/2275404972 learned_addr learned my addr 172.21.15.146:0/2275404972 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.744+0000 7fc2108b3700 1 --2- 172.21.15.146:0/2275404972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc20c138040 0x7fc20c121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.744+0000 7fc20bfff700 1 --2- 172.21.15.146:0/2275404972 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc20c138410 0x7fc20c121b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.744+0000 7fc2110b4700 1 -- 172.21.15.146:0/2275404972 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc20c138410 msgr2=0x7fc20c121b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.744+0000 7fc2110b4700 1 --2- 172.21.15.146:0/2275404972 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc20c138410 0x7fc20c121b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.744+0000 7fc2110b4700 1 -- 172.21.15.146:0/2275404972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc20c138040 msgr2=0x7fc20c121600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.744+0000 7fc2110b4700 1 --2- 172.21.15.146:0/2275404972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc20c138040 0x7fc20c121600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.744+0000 7fc2110b4700 1 -- 172.21.15.146:0/2275404972 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f8009550 con 0x7fc20c13dd10 2023-10-03T10:12:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.744+0000 7fc20bfff700 1 --2- 172.21.15.146:0/2275404972 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc20c138410 0x7fc20c121b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.744+0000 7fc2108b3700 1 --2- 172.21.15.146:0/2275404972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc20c138040 0x7fc20c121600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.745+0000 7fc2110b4700 1 --2- 172.21.15.146:0/2275404972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc20c13dd10 0x7fc20c122080 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc20400efc0 tx=0x7fc20400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.745+0000 7fc2097fa700 1 -- 172.21.15.146:0/2275404972 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc204009ea0 con 0x7fc20c13dd10 2023-10-03T10:12:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.745+0000 7fc212b17700 1 -- 172.21.15.146:0/2275404972 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc20c09a240 con 0x7fc20c13dd10 2023-10-03T10:12:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.745+0000 7fc212b17700 1 -- 172.21.15.146:0/2275404972 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc20c09eed0 con 0x7fc20c13dd10 2023-10-03T10:12:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.745+0000 7fc2097fa700 1 -- 172.21.15.146:0/2275404972 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20400f040 con 0x7fc20c13dd10 2023-10-03T10:12:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.745+0000 7fc2097fa700 1 -- 172.21.15.146:0/2275404972 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc204014480 con 0x7fc20c13dd10 2023-10-03T10:12:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.746+0000 7fc2097fa700 1 -- 172.21.15.146:0/2275404972 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc2040145e0 con 0x7fc20c13dd10 2023-10-03T10:12:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.746+0000 7fc212b17700 1 -- 172.21.15.146:0/2275404972 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ec0052e0 con 0x7fc20c13dd10 2023-10-03T10:12:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.746+0000 7fc2108b3700 1 -- 172.21.15.146:0/2275404972 >> v1:172.21.15.146:6816/126749 conn(0x7fc1f002f510 legacy=0x7fc1f00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.746+0000 7fc2097fa700 1 -- 172.21.15.146:0/2275404972 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fc204040860 con 0x7fc20c13dd10 2023-10-03T10:12:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.755+0000 7fc2097fa700 1 -- 172.21.15.146:0/2275404972 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc20401d400 con 0x7fc20c13dd10 2023-10-03T10:12:22.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.823+0000 7f8f510fa700 1 Processor -- start 2023-10-03T10:12:22.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.823+0000 7f8f510fa700 1 -- start start 2023-10-03T10:12:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.823+0000 7f8f510fa700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8f4c1346e0 0x7f8f4c136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.823+0000 7f8f510fa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f4c137000 0x7f8f4c1393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.823+0000 7f8f510fa700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4c0a1640 con 0x7f8f4c131980 2023-10-03T10:12:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.823+0000 7f8f510fa700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f4c06eb30 con 0x7f8f4c1346e0 2023-10-03T10:12:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.823+0000 7f8f510fa700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c0a22d0 con 0x7f8f4c137000 2023-10-03T10:12:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.823+0000 7f8f4a59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8f4c1346e0 0x7f8f4c136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.823+0000 7f8f4a59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8f4c1346e0 0x7f8f4c136ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47098/0 (socket says 172.21.15.146:47098) 2023-10-03T10:12:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.823+0000 7f8f4ad9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8f4c131980 0x7f8f4c131d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39286/0 (socket says 172.21.15.146:39286) 2023-10-03T10:12:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.823+0000 7f8f4a59c700 1 -- 172.21.15.146:0/921661720 learned_addr learned my addr 172.21.15.146:0/921661720 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.824+0000 7f8f4b59e700 1 --2- 172.21.15.146:0/921661720 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f4c137000 0x7f8f4c1393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.824+0000 7f8f4a59c700 1 -- 172.21.15.146:0/921661720 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f4c137000 msgr2=0x7f8f4c1393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.824+0000 7f8f4a59c700 1 --2- 172.21.15.146:0/921661720 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f4c137000 0x7f8f4c1393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.824+0000 7f8f4a59c700 1 -- 172.21.15.146:0/921661720 >> v1:172.21.15.146:6789/0 conn(0x7f8f4c131980 legacy=0x7f8f4c131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.824+0000 7f8f49d9b700 1 -- 172.21.15.146:0/921661720 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1709792415 0 0) 0x7f8f4c0a1640 con 0x7f8f4c131980 2023-10-03T10:12:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.824+0000 7f8f4a59c700 1 -- 172.21.15.146:0/921661720 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4c131550 con 0x7f8f4c1346e0 2023-10-03T10:12:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.824+0000 7f8f4a59c700 1 --2- 172.21.15.146:0/921661720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f4c1346e0 0x7f8f4c136ac0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8f400098f0 tx=0x7f8f40009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e07b0a39dd0e74 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.824+0000 7f8f49d9b700 1 -- 172.21.15.146:0/921661720 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4000b8a0 con 0x7f8f4c1346e0 2023-10-03T10:12:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.824+0000 7f8f49d9b700 1 -- 172.21.15.146:0/921661720 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4000ba00 con 0x7f8f4c1346e0 2023-10-03T10:12:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.824+0000 7f8f49d9b700 1 -- 172.21.15.146:0/921661720 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4000bd90 con 0x7f8f4c1346e0 2023-10-03T10:12:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.825+0000 7f8f510fa700 1 -- 172.21.15.146:0/921661720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f4c1346e0 msgr2=0x7f8f4c136ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.825+0000 7f8f510fa700 1 --2- 172.21.15.146:0/921661720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f4c1346e0 0x7f8f4c136ac0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8f400098f0 tx=0x7f8f40009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.825+0000 7f8f510fa700 1 -- 172.21.15.146:0/921661720 shutdown_connections 2023-10-03T10:12:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.825+0000 7f8f510fa700 1 --2- 172.21.15.146:0/921661720 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f4c137000 0x7f8f4c1393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.825+0000 7f8f510fa700 1 --2- 172.21.15.146:0/921661720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f4c1346e0 0x7f8f4c136ac0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.825+0000 7f8f510fa700 1 -- 172.21.15.146:0/921661720 >> 172.21.15.146:0/921661720 conn(0x7f8f4c0a2980 msgr2=0x7f8f4c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.825+0000 7f8f510fa700 1 -- 172.21.15.146:0/921661720 shutdown_connections 2023-10-03T10:12:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.825+0000 7f8f510fa700 1 -- 172.21.15.146:0/921661720 wait complete. 2023-10-03T10:12:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.827+0000 7f8f510fa700 1 Processor -- start 2023-10-03T10:12:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.827+0000 7f8f510fa700 1 -- start start 2023-10-03T10:12:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.828+0000 7f8f510fa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f4c131980 0x7f8f4c1c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.828+0000 7f8f510fa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f4c1346e0 0x7f8f4c1c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.828+0000 7f8f510fa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f4c137000 0x7f8f4c099a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.828+0000 7f8f510fa700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c0a1cb0 con 0x7f8f4c131980 2023-10-03T10:12:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.828+0000 7f8f510fa700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c071750 con 0x7f8f4c137000 2023-10-03T10:12:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.828+0000 7f8f510fa700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c136cf0 con 0x7f8f4c1346e0 2023-10-03T10:12:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.828+0000 7f8f4ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f4c131980 0x7f8f4c1c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.828+0000 7f8f4ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f4c131980 0x7f8f4c1c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47108/0 (socket says 172.21.15.146:47108) 2023-10-03T10:12:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.828+0000 7f8f4ad9d700 1 -- 172.21.15.146:0/2876286520 learned_addr learned my addr 172.21.15.146:0/2876286520 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.828+0000 7f8f4b59e700 1 --2- 172.21.15.146:0/2876286520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f4c137000 0x7f8f4c099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.828+0000 7f8f4a59c700 1 --2- 172.21.15.146:0/2876286520 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f4c1346e0 0x7f8f4c1c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.828+0000 7f8f4ad9d700 1 -- 172.21.15.146:0/2876286520 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f4c1346e0 msgr2=0x7f8f4c1c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.828+0000 7f8f4ad9d700 1 --2- 172.21.15.146:0/2876286520 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f4c1346e0 0x7f8f4c1c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.828+0000 7f8f4ad9d700 1 -- 172.21.15.146:0/2876286520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f4c137000 msgr2=0x7f8f4c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.828+0000 7f8f4ad9d700 1 --2- 172.21.15.146:0/2876286520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f4c137000 0x7f8f4c099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.828+0000 7f8f4ad9d700 1 -- 172.21.15.146:0/2876286520 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f40009550 con 0x7f8f4c131980 2023-10-03T10:12:22.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.828+0000 7f8f4ad9d700 1 --2- 172.21.15.146:0/2876286520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f4c131980 0x7f8f4c1c8280 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00c550 tx=0x7f8f3c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:22.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.828+0000 7f8f337fe700 1 -- 172.21.15.146:0/2876286520 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c0074e0 con 0x7f8f4c131980 2023-10-03T10:12:22.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.828+0000 7f8f337fe700 1 -- 172.21.15.146:0/2876286520 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c007640 con 0x7f8f4c131980 2023-10-03T10:12:22.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.828+0000 7f8f510fa700 1 -- 172.21.15.146:0/2876286520 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f4c11d870 con 0x7f8f4c131980 2023-10-03T10:12:22.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.828+0000 7f8f337fe700 1 -- 172.21.15.146:0/2876286520 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c005a70 con 0x7f8f4c131980 2023-10-03T10:12:22.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.829+0000 7f8f510fa700 1 -- 172.21.15.146:0/2876286520 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f4c09ac30 con 0x7f8f4c131980 2023-10-03T10:12:22.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.829+0000 7f8f337fe700 1 -- 172.21.15.146:0/2876286520 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8f3c005bd0 con 0x7f8f4c131980 2023-10-03T10:12:22.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.830+0000 7f8f510fa700 1 -- 172.21.15.146:0/2876286520 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f4c12dd60 con 0x7f8f4c131980 2023-10-03T10:12:22.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.830+0000 7f8f337fe700 1 -- 172.21.15.146:0/2876286520 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f8f3c03efc0 con 0x7f8f4c131980 2023-10-03T10:12:22.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.830+0000 7f8f4a59c700 1 -- 172.21.15.146:0/2876286520 >> v1:172.21.15.146:6816/126749 conn(0x7f8f3802f510 legacy=0x7f8f380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:22.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.831+0000 7f4441d28700 1 Processor -- start 2023-10-03T10:12:22.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.831+0000 7f4441d28700 1 -- start start 2023-10-03T10:12:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.832+0000 7f4441d28700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f443c12d380 0x7f443c12d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.832+0000 7f4441d28700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f443c09a5a0 0x7f443c138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.832+0000 7f4441d28700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f443c09bb90 con 0x7f443c099a60 2023-10-03T10:12:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.832+0000 7f4441d28700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f443c09c210 con 0x7f443c09a5a0 2023-10-03T10:12:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.832+0000 7f4441d28700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443c09ced0 con 0x7f443c12d380 2023-10-03T10:12:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.832+0000 7f443b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f443c12d380 0x7f443c12d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.832+0000 7f443affd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f443c099a60 0x7f443c099e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39300/0 (socket says 172.21.15.146:39300) 2023-10-03T10:12:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.832+0000 7f443affd700 1 -- 172.21.15.146:0/15444820 learned_addr learned my addr 172.21.15.146:0/15444820 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.832+0000 7f443b7fe700 1 -- 172.21.15.146:0/15444820 >> v2:172.21.15.146:3300/0 conn(0x7f443c09a5a0 msgr2=0x7f443c138620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.832+0000 7f443b7fe700 1 --2- 172.21.15.146:0/15444820 >> v2:172.21.15.146:3300/0 conn(0x7f443c09a5a0 0x7f443c138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.832+0000 7f443b7fe700 1 -- 172.21.15.146:0/15444820 >> v1:172.21.15.146:6789/0 conn(0x7f443c099a60 legacy=0x7f443c099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.832+0000 7f443b7fe700 1 -- 172.21.15.146:0/15444820 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c09ac30 con 0x7f443c12d380 2023-10-03T10:12:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.832+0000 7f443b7fe700 1 --2- 172.21.15.146:0/15444820 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f443c12d380 0x7f443c12d750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f442c009820 tx=0x7f442c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c904adc1806e561 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.833+0000 7f443a7fc700 1 -- 172.21.15.146:0/15444820 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c005e30 con 0x7f443c12d380 2023-10-03T10:12:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.833+0000 7f443a7fc700 1 -- 172.21.15.146:0/15444820 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442c006030 con 0x7f443c12d380 2023-10-03T10:12:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.833+0000 7f443a7fc700 1 -- 172.21.15.146:0/15444820 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c0063e0 con 0x7f443c12d380 2023-10-03T10:12:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.833+0000 7f4441d28700 1 -- 172.21.15.146:0/15444820 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f443c12d380 msgr2=0x7f443c12d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.833+0000 7f4441d28700 1 --2- 172.21.15.146:0/15444820 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f443c12d380 0x7f443c12d750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f442c009820 tx=0x7f442c009b30 comp rx=0 tx=0).stop 2023-10-03T10:12:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.834+0000 7f4441d28700 1 -- 172.21.15.146:0/15444820 shutdown_connections 2023-10-03T10:12:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.834+0000 7f4441d28700 1 --2- 172.21.15.146:0/15444820 >> v2:172.21.15.146:3300/0 conn(0x7f443c09a5a0 0x7f443c138620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.834+0000 7f4441d28700 1 --2- 172.21.15.146:0/15444820 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f443c12d380 0x7f443c12d750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.834+0000 7f4441d28700 1 -- 172.21.15.146:0/15444820 >> 172.21.15.146:0/15444820 conn(0x7f443c0a2980 msgr2=0x7f443c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:22.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.834+0000 7f4441d28700 1 -- 172.21.15.146:0/15444820 shutdown_connections 2023-10-03T10:12:22.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.834+0000 7f4441d28700 1 -- 172.21.15.146:0/15444820 wait complete. 2023-10-03T10:12:22.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.835+0000 7f8f337fe700 1 -- 172.21.15.146:0/2876286520 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f3c017020 con 0x7f8f4c131980 2023-10-03T10:12:22.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.835+0000 7f4441d28700 1 Processor -- start 2023-10-03T10:12:22.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.835+0000 7f4441d28700 1 -- start start 2023-10-03T10:12:22.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.836+0000 7f4441d28700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f443c099a60 0x7f443c132e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.836+0000 7f4441d28700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f443c09a5a0 0x7f443c1333d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.836+0000 7f4441d28700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f443c12d380 0x7f443c133910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:22.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.836+0000 7f4441d28700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c135ca0 con 0x7f443c09a5a0 2023-10-03T10:12:22.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.836+0000 7f4441d28700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443c09b3e0 con 0x7f443c12d380 2023-10-03T10:12:22.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.836+0000 7f4441d28700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f443c134a50 con 0x7f443c099a60 2023-10-03T10:12:22.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.836+0000 7f443b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f443c099a60 0x7f443c132e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.836+0000 7f443b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f443c099a60 0x7f443c132e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54366/0 (socket says 172.21.15.146:54366) 2023-10-03T10:12:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.836+0000 7f443b7fe700 1 -- 172.21.15.146:0/3562057675 learned_addr learned my addr 172.21.15.146:0/3562057675 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.836+0000 7f443affd700 1 --2- 172.21.15.146:0/3562057675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f443c09a5a0 0x7f443c1333d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.836+0000 7f443bfff700 1 --2- 172.21.15.146:0/3562057675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f443c12d380 0x7f443c133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.836+0000 7f443affd700 1 -- 172.21.15.146:0/3562057675 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f443c099a60 msgr2=0x7f443c132e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.836+0000 7f443affd700 1 --2- 172.21.15.146:0/3562057675 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f443c099a60 0x7f443c132e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.836+0000 7f443affd700 1 -- 172.21.15.146:0/3562057675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f443c12d380 msgr2=0x7f443c133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.836+0000 7f443affd700 1 --2- 172.21.15.146:0/3562057675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f443c12d380 0x7f443c133910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.836+0000 7f443affd700 1 -- 172.21.15.146:0/3562057675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442c009430 con 0x7f443c09a5a0 2023-10-03T10:12:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.836+0000 7f443b7fe700 1 --2- 172.21.15.146:0/3562057675 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f443c099a60 0x7f443c132e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.836+0000 7f443bfff700 1 --2- 172.21.15.146:0/3562057675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f443c12d380 0x7f443c133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.837+0000 7f443affd700 1 --2- 172.21.15.146:0/3562057675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f443c09a5a0 0x7f443c1333d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f443000c3c0 tx=0x7f443000c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.837+0000 7f4423fff700 1 -- 172.21.15.146:0/3562057675 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4430005b40 con 0x7f443c09a5a0 2023-10-03T10:12:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.837+0000 7f4423fff700 1 -- 172.21.15.146:0/3562057675 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4430005ca0 con 0x7f443c09a5a0 2023-10-03T10:12:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.837+0000 7f4441d28700 1 -- 172.21.15.146:0/3562057675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443c136680 con 0x7f443c09a5a0 2023-10-03T10:12:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.837+0000 7f4423fff700 1 -- 172.21.15.146:0/3562057675 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44300072f0 con 0x7f443c09a5a0 2023-10-03T10:12:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.837+0000 7f4441d28700 1 -- 172.21.15.146:0/3562057675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443c136140 con 0x7f443c09a5a0 2023-10-03T10:12:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.838+0000 7f4423fff700 1 -- 172.21.15.146:0/3562057675 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4430007450 con 0x7f443c09a5a0 2023-10-03T10:12:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.838+0000 7f4441d28700 1 -- 172.21.15.146:0/3562057675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443c13b5e0 con 0x7f443c09a5a0 2023-10-03T10:12:22.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.838+0000 7f4423fff700 1 -- 172.21.15.146:0/3562057675 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f443003ee50 con 0x7f443c09a5a0 2023-10-03T10:12:22.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.838+0000 7f443b7fe700 1 -- 172.21.15.146:0/3562057675 >> v1:172.21.15.146:6816/126749 conn(0x7f442802f510 legacy=0x7f44280319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:22.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.843+0000 7f4423fff700 1 -- 172.21.15.146:0/3562057675 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f443c13b5e0 con 0x7f443c09a5a0 2023-10-03T10:12:22.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.899+0000 7fae29d9b700 1 -- 172.21.15.146:0/3847557323 >> v1:172.21.15.146:6816/126749 conn(0x7fae0c02f510 legacy=0x7fae0c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:22.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.910+0000 7fae3088e700 1 -- 172.21.15.146:0/3847557323 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fae2c04f2a0 con 0x7fae2c099e20 2023-10-03T10:12:22.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.911+0000 7fae1affd700 1 -- 172.21.15.146:0/3847557323 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fae1c01b6e0 con 0x7fae2c099e20 2023-10-03T10:12:22.911 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:22.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.913+0000 7fae3088e700 1 -- 172.21.15.146:0/3847557323 >> v1:172.21.15.146:6816/126749 conn(0x7fae0c02f510 legacy=0x7fae0c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:22.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.913+0000 7fae3088e700 1 -- 172.21.15.146:0/3847557323 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae2c099e20 msgr2=0x7fae2c1369a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.913+0000 7fae3088e700 1 --2- 172.21.15.146:0/3847557323 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae2c099e20 0x7fae2c1369a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fae1c009f20 tx=0x7fae1c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:22.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.913+0000 7fae3088e700 1 -- 172.21.15.146:0/3847557323 shutdown_connections 2023-10-03T10:12:22.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.913+0000 7fae3088e700 1 --2- 172.21.15.146:0/3847557323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae2c130890 0x7fae2c1376b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.913+0000 7fae3088e700 1 --2- 172.21.15.146:0/3847557323 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae2c099e20 0x7fae2c1369a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.913+0000 7fae3088e700 1 --2- 172.21.15.146:0/3847557323 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae2c09a730 0x7fae2c136ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.913+0000 7fae3088e700 1 -- 172.21.15.146:0/3847557323 >> 172.21.15.146:0/3847557323 conn(0x7fae2c0a2980 msgr2=0x7fae2c12f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:22.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.913+0000 7fae3088e700 1 -- 172.21.15.146:0/3847557323 shutdown_connections 2023-10-03T10:12:22.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.913+0000 7fae3088e700 1 -- 172.21.15.146:0/3847557323 wait complete. 2023-10-03T10:12:22.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:22.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.947+0000 7fc2108b3700 1 -- 172.21.15.146:0/2275404972 >> v1:172.21.15.146:6816/126749 conn(0x7fc1f002f510 legacy=0x7fc1f00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:22.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.968+0000 7fc212b17700 1 -- 172.21.15.146:0/2275404972 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc1ec005860 con 0x7fc20c13dd10 2023-10-03T10:12:22.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.968+0000 7fc2097fa700 1 -- 172.21.15.146:0/2275404972 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc204018030 con 0x7fc20c13dd10 2023-10-03T10:12:22.969 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:22.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.970+0000 7fc212b17700 1 -- 172.21.15.146:0/2275404972 >> v1:172.21.15.146:6816/126749 conn(0x7fc1f002f510 legacy=0x7fc1f00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:22.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.970+0000 7fc212b17700 1 -- 172.21.15.146:0/2275404972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc20c13dd10 msgr2=0x7fc20c122080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:22.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.970+0000 7fc212b17700 1 --2- 172.21.15.146:0/2275404972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc20c13dd10 0x7fc20c122080 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc20400efc0 tx=0x7fc20400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.971+0000 7fc212b17700 1 -- 172.21.15.146:0/2275404972 shutdown_connections 2023-10-03T10:12:22.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.971+0000 7fc212b17700 1 --2- 172.21.15.146:0/2275404972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc20c13dd10 0x7fc20c122080 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.971+0000 7fc212b17700 1 --2- 172.21.15.146:0/2275404972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc20c138040 0x7fc20c121600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.971+0000 7fc212b17700 1 --2- 172.21.15.146:0/2275404972 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc20c138410 0x7fc20c121b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:22.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.971+0000 7fc212b17700 1 -- 172.21.15.146:0/2275404972 >> 172.21.15.146:0/2275404972 conn(0x7fc20c0a2980 msgr2=0x7fc20c09d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:22.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.971+0000 7fc212b17700 1 -- 172.21.15.146:0/2275404972 shutdown_connections 2023-10-03T10:12:22.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:22.971+0000 7fc212b17700 1 -- 172.21.15.146:0/2275404972 wait complete. 2023-10-03T10:12:22.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:23.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.031+0000 7f8f4a59c700 1 -- 172.21.15.146:0/2876286520 >> v1:172.21.15.146:6816/126749 conn(0x7f8f3802f510 legacy=0x7f8f380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:23.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.039+0000 7f443b7fe700 1 -- 172.21.15.146:0/3562057675 >> v1:172.21.15.146:6816/126749 conn(0x7f442802f510 legacy=0x7f44280319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:23.047 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:23.052 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:23.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.051+0000 7f8f510fa700 1 -- 172.21.15.146:0/2876286520 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8f4c04f2a0 con 0x7f8f4c131980 2023-10-03T10:12:23.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.051+0000 7f8f337fe700 1 -- 172.21.15.146:0/2876286520 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8f3c00f260 con 0x7f8f4c131980 2023-10-03T10:12:23.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.053+0000 7f8f510fa700 1 -- 172.21.15.146:0/2876286520 >> v1:172.21.15.146:6816/126749 conn(0x7f8f3802f510 legacy=0x7f8f380319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:23.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.053+0000 7f8f510fa700 1 -- 172.21.15.146:0/2876286520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f4c131980 msgr2=0x7f8f4c1c8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.053+0000 7f8f510fa700 1 --2- 172.21.15.146:0/2876286520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f4c131980 0x7f8f4c1c8280 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00c550 tx=0x7f8f3c00c860 comp rx=0 tx=0).stop 2023-10-03T10:12:23.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.053+0000 7f8f510fa700 1 -- 172.21.15.146:0/2876286520 shutdown_connections 2023-10-03T10:12:23.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.053+0000 7f8f510fa700 1 --2- 172.21.15.146:0/2876286520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f4c137000 0x7f8f4c099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.053+0000 7f8f510fa700 1 --2- 172.21.15.146:0/2876286520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f4c131980 0x7f8f4c1c8280 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.053+0000 7f8f510fa700 1 --2- 172.21.15.146:0/2876286520 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f4c1346e0 0x7f8f4c1c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.053+0000 7f8f510fa700 1 -- 172.21.15.146:0/2876286520 >> 172.21.15.146:0/2876286520 conn(0x7f8f4c0a2980 msgr2=0x7f8f4c133560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:23.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.054+0000 7f8f510fa700 1 -- 172.21.15.146:0/2876286520 shutdown_connections 2023-10-03T10:12:23.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.046+0000 7f4441d28700 1 -- 172.21.15.146:0/3562057675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f443c13b5e0 con 0x7f443c09a5a0 2023-10-03T10:12:23.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.047+0000 7f4423fff700 1 -- 172.21.15.146:0/3562057675 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f443c13b5e0 con 0x7f443c09a5a0 2023-10-03T10:12:23.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.049+0000 7f4441d28700 1 -- 172.21.15.146:0/3562057675 >> v1:172.21.15.146:6816/126749 conn(0x7f442802f510 legacy=0x7f44280319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:23.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.049+0000 7f4441d28700 1 -- 172.21.15.146:0/3562057675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f443c09a5a0 msgr2=0x7f443c1333d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.049+0000 7f4441d28700 1 --2- 172.21.15.146:0/3562057675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f443c09a5a0 0x7f443c1333d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f443000c3c0 tx=0x7f443000c6d0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.049+0000 7f4441d28700 1 -- 172.21.15.146:0/3562057675 shutdown_connections 2023-10-03T10:12:23.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.049+0000 7f4441d28700 1 --2- 172.21.15.146:0/3562057675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f443c12d380 0x7f443c133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.049+0000 7f4441d28700 1 --2- 172.21.15.146:0/3562057675 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f443c099a60 0x7f443c132e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.049+0000 7f4441d28700 1 --2- 172.21.15.146:0/3562057675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f443c09a5a0 0x7f443c1333d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.049+0000 7f4441d28700 1 -- 172.21.15.146:0/3562057675 >> 172.21.15.146:0/3562057675 conn(0x7f443c0a2980 msgr2=0x7f443c071770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:23.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.049+0000 7f4441d28700 1 -- 172.21.15.146:0/3562057675 shutdown_connections 2023-10-03T10:12:23.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.049+0000 7f4441d28700 1 -- 172.21.15.146:0/3562057675 wait complete. 2023-10-03T10:12:23.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:23.054+0000 7f8f510fa700 1 -- 172.21.15.146:0/2876286520 wait complete. 2023-10-03T10:12:23.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:23.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:23.928 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:23.985 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:24.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.067+0000 7fa565ee5700 1 Processor -- start 2023-10-03T10:12:24.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.067+0000 7fa565ee5700 1 -- start start 2023-10-03T10:12:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.067+0000 7fa565ee5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa5600a0a70 0x7fa5600a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.067+0000 7fa565ee5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5600a1380 0x7fa560133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.067+0000 7fa565ee5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56009dc00 con 0x7fa560133f50 2023-10-03T10:12:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.068+0000 7fa565ee5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56009ea60 con 0x7fa5600a0a70 2023-10-03T10:12:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.068+0000 7fa565ee5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa56009dec0 con 0x7fa5600a1380 2023-10-03T10:12:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.068+0000 7fa55effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5600a1380 0x7fa560133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.068+0000 7fa55f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa5600a0a70 0x7fa5600a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.068+0000 7fa55effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5600a1380 0x7fa560133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54374/0 (socket says 172.21.15.146:54374) 2023-10-03T10:12:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.068+0000 7fa55effd700 1 -- 172.21.15.146:0/4109941133 learned_addr learned my addr 172.21.15.146:0/4109941133 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.068+0000 7fa55f7fe700 1 --2- 172.21.15.146:0/4109941133 >> v2:172.21.15.146:3300/0 conn(0x7fa5600a0a70 0x7fa5600a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47140/0 (socket says 172.21.15.146:47140) 2023-10-03T10:12:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.068+0000 7fa55effd700 1 -- 172.21.15.146:0/4109941133 >> v2:172.21.15.146:3300/0 conn(0x7fa5600a0a70 msgr2=0x7fa5600a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.068+0000 7fa55effd700 1 --2- 172.21.15.146:0/4109941133 >> v2:172.21.15.146:3300/0 conn(0x7fa5600a0a70 0x7fa5600a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.068+0000 7fa55effd700 1 -- 172.21.15.146:0/4109941133 >> v1:172.21.15.146:6789/0 conn(0x7fa560133f50 legacy=0x7fa56013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.068+0000 7fa55effd700 1 -- 172.21.15.146:0/4109941133 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56009e6a0 con 0x7fa5600a1380 2023-10-03T10:12:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.068+0000 7fa55effd700 1 --2- 172.21.15.146:0/4109941133 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5600a1380 0x7fa560133a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa5480098f0 tx=0x7fa548009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=856baf4a2bd5ddca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.068+0000 7fa55e7fc700 1 -- 172.21.15.146:0/4109941133 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548011830 con 0x7fa5600a1380 2023-10-03T10:12:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.068+0000 7fa55e7fc700 1 -- 172.21.15.146:0/4109941133 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa548011990 con 0x7fa5600a1380 2023-10-03T10:12:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.068+0000 7fa55e7fc700 1 -- 172.21.15.146:0/4109941133 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548011d20 con 0x7fa5600a1380 2023-10-03T10:12:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.069+0000 7fa565ee5700 1 -- 172.21.15.146:0/4109941133 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5600a1380 msgr2=0x7fa560133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.069+0000 7fa565ee5700 1 --2- 172.21.15.146:0/4109941133 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5600a1380 0x7fa560133a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa5480098f0 tx=0x7fa548009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.069+0000 7fa565ee5700 1 -- 172.21.15.146:0/4109941133 shutdown_connections 2023-10-03T10:12:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.069+0000 7fa565ee5700 1 --2- 172.21.15.146:0/4109941133 >> v2:172.21.15.146:3300/0 conn(0x7fa5600a0a70 0x7fa5600a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.069+0000 7fa565ee5700 1 --2- 172.21.15.146:0/4109941133 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5600a1380 0x7fa560133a10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.069+0000 7fa565ee5700 1 -- 172.21.15.146:0/4109941133 >> 172.21.15.146:0/4109941133 conn(0x7fa5600a6610 msgr2=0x7fa5600a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.069+0000 7fa565ee5700 1 -- 172.21.15.146:0/4109941133 shutdown_connections 2023-10-03T10:12:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.069+0000 7fa565ee5700 1 -- 172.21.15.146:0/4109941133 wait complete. 2023-10-03T10:12:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.070+0000 7fa565ee5700 1 Processor -- start 2023-10-03T10:12:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.070+0000 7fa565ee5700 1 -- start start 2023-10-03T10:12:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa565ee5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5600a0a70 0x7fa5601c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa565ee5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5600a1380 0x7fa5601c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa565ee5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa560133f50 0x7fa5601c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa565ee5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5601267b0 con 0x7fa560133f50 2023-10-03T10:12:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa565ee5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa560124990 con 0x7fa5600a0a70 2023-10-03T10:12:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa565ee5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa560124dc0 con 0x7fa5600a1380 2023-10-03T10:12:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa55effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5600a1380 0x7fa5601c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa55ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa560133f50 0x7fa5601c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa55effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5600a1380 0x7fa5601c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54386/0 (socket says 172.21.15.146:54386) 2023-10-03T10:12:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa55effd700 1 -- 172.21.15.146:0/4253442738 learned_addr learned my addr 172.21.15.146:0/4253442738 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa55f7fe700 1 --2- 172.21.15.146:0/4253442738 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5600a0a70 0x7fa5601c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa55effd700 1 -- 172.21.15.146:0/4253442738 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5600a0a70 msgr2=0x7fa5601c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa55effd700 1 --2- 172.21.15.146:0/4253442738 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5600a0a70 0x7fa5601c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa55effd700 1 -- 172.21.15.146:0/4253442738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa560133f50 msgr2=0x7fa5601c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa55effd700 1 --2- 172.21.15.146:0/4253442738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa560133f50 0x7fa5601c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa55effd700 1 -- 172.21.15.146:0/4253442738 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa548009550 con 0x7fa5600a1380 2023-10-03T10:12:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa55ffff700 1 --2- 172.21.15.146:0/4253442738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa560133f50 0x7fa5601c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa55effd700 1 --2- 172.21.15.146:0/4253442738 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5600a1380 0x7fa5601c8930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa548009c40 tx=0x7fa548004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa557fff700 1 -- 172.21.15.146:0/4253442738 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548004400 con 0x7fa5600a1380 2023-10-03T10:12:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa557fff700 1 -- 172.21.15.146:0/4253442738 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54801f070 con 0x7fa5600a1380 2023-10-03T10:12:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa565ee5700 1 -- 172.21.15.146:0/4253442738 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5600a03e0 con 0x7fa5600a1380 2023-10-03T10:12:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa557fff700 1 -- 172.21.15.146:0/4253442738 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5480038c0 con 0x7fa5600a1380 2023-10-03T10:12:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.071+0000 7fa565ee5700 1 -- 172.21.15.146:0/4253442738 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5601338f0 con 0x7fa5600a1380 2023-10-03T10:12:24.075 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:24.076 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:24.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.072+0000 7fa557fff700 1 -- 172.21.15.146:0/4253442738 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa548021030 con 0x7fa5600a1380 2023-10-03T10:12:24.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.072+0000 7fa565ee5700 1 -- 172.21.15.146:0/4253442738 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa560124160 con 0x7fa5600a1380 2023-10-03T10:12:24.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.072+0000 7fa55f7fe700 1 -- 172.21.15.146:0/4253442738 >> v1:172.21.15.146:6816/126749 conn(0x7fa54002f510 legacy=0x7fa5400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:24.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.072+0000 7fa557fff700 1 -- 172.21.15.146:0/4253442738 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fa548041070 con 0x7fa5600a1380 2023-10-03T10:12:24.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.077+0000 7fa557fff700 1 -- 172.21.15.146:0/4253442738 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa560124160 con 0x7fa5600a1380 2023-10-03T10:12:24.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.118+0000 7f8508c87700 1 Processor -- start 2023-10-03T10:12:24.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.118+0000 7f8508c87700 1 -- start start 2023-10-03T10:12:24.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.119+0000 7f8508c87700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8504099a60 0x7f85041388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.119+0000 7f8508c87700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8504138e30 0x7f850413b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.119+0000 7f8508c87700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850409aa00 con 0x7f8504133b80 2023-10-03T10:12:24.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.119+0000 7f8508c87700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f850409a080 con 0x7f8504099a60 2023-10-03T10:12:24.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.119+0000 7f8508c87700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8504133750 con 0x7f8504138e30 2023-10-03T10:12:24.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.119+0000 7f8502d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8504138e30 0x7f850413b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.119+0000 7f8502d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8504138e30 0x7f850413b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54398/0 (socket says 172.21.15.146:54398) 2023-10-03T10:12:24.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.119+0000 7f8502d9d700 1 -- 172.21.15.146:0/4159862812 learned_addr learned my addr 172.21.15.146:0/4159862812 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:24.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.119+0000 7f8501d9b700 1 --2- 172.21.15.146:0/4159862812 >> v2:172.21.15.146:3300/0 conn(0x7f8504099a60 0x7f85041388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.119+0000 7f8502d9d700 1 -- 172.21.15.146:0/4159862812 >> v2:172.21.15.146:3300/0 conn(0x7f8504099a60 msgr2=0x7f85041388f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:24.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.119+0000 7f8502d9d700 1 --2- 172.21.15.146:0/4159862812 >> v2:172.21.15.146:3300/0 conn(0x7f8504099a60 0x7f85041388f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.119+0000 7f8502d9d700 1 -- 172.21.15.146:0/4159862812 >> v1:172.21.15.146:6789/0 conn(0x7f8504133b80 legacy=0x7f8504133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:24.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.120+0000 7f8502d9d700 1 -- 172.21.15.146:0/4159862812 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850409a760 con 0x7f8504138e30 2023-10-03T10:12:24.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.120+0000 7f8502d9d700 1 --2- 172.21.15.146:0/4159862812 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8504138e30 0x7f850413b210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f84fc009e50 tx=0x7f84fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cf8ea019fb60d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:24.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.120+0000 7f850159a700 1 -- 172.21.15.146:0/4159862812 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc00e070 con 0x7f8504138e30 2023-10-03T10:12:24.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.120+0000 7f850159a700 1 -- 172.21.15.146:0/4159862812 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84fc003a20 con 0x7f8504138e30 2023-10-03T10:12:24.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.120+0000 7f850159a700 1 -- 172.21.15.146:0/4159862812 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc003dd0 con 0x7f8504138e30 2023-10-03T10:12:24.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.121+0000 7f8508c87700 1 -- 172.21.15.146:0/4159862812 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8504138e30 msgr2=0x7f850413b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.121+0000 7f8508c87700 1 --2- 172.21.15.146:0/4159862812 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8504138e30 0x7f850413b210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f84fc009e50 tx=0x7f84fc00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:24.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.121+0000 7f8508c87700 1 -- 172.21.15.146:0/4159862812 shutdown_connections 2023-10-03T10:12:24.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.121+0000 7f8508c87700 1 --2- 172.21.15.146:0/4159862812 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8504138e30 0x7f850413b210 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.121+0000 7f8508c87700 1 --2- 172.21.15.146:0/4159862812 >> v2:172.21.15.146:3300/0 conn(0x7f8504099a60 0x7f85041388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.121+0000 7f8508c87700 1 -- 172.21.15.146:0/4159862812 >> 172.21.15.146:0/4159862812 conn(0x7f85040a2980 msgr2=0x7f85040a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:24.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.121+0000 7f8508c87700 1 -- 172.21.15.146:0/4159862812 shutdown_connections 2023-10-03T10:12:24.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.121+0000 7f8508c87700 1 -- 172.21.15.146:0/4159862812 wait complete. 2023-10-03T10:12:24.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.122+0000 7f8508c87700 1 Processor -- start 2023-10-03T10:12:24.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.122+0000 7f8508c87700 1 -- start start 2023-10-03T10:12:24.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.122+0000 7f8508c87700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8504099a60 0x7f8504118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.122+0000 7f8508c87700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8504133b80 0x7f8504119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.122+0000 7f8508c87700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8504138e30 0x7f8504119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.122+0000 7f8508c87700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850411b5a0 con 0x7f8504133b80 2023-10-03T10:12:24.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.122+0000 7f8508c87700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850411a880 con 0x7f8504099a60 2023-10-03T10:12:24.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.122+0000 7f8508c87700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f850413b220 con 0x7f8504138e30 2023-10-03T10:12:24.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.122+0000 7f850259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8504099a60 0x7f8504118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.123+0000 7f850259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8504099a60 0x7f8504118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33942/0 (socket says 172.21.15.146:33942) 2023-10-03T10:12:24.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.123+0000 7f850259c700 1 -- 172.21.15.146:0/797466545 learned_addr learned my addr 172.21.15.146:0/797466545 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:24.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.123+0000 7f8502d9d700 1 --2- 172.21.15.146:0/797466545 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8504138e30 0x7f8504119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.123+0000 7f8501d9b700 1 --2- 172.21.15.146:0/797466545 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8504133b80 0x7f8504119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.123+0000 7f850259c700 1 -- 172.21.15.146:0/797466545 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8504138e30 msgr2=0x7f8504119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.123+0000 7f850259c700 1 --2- 172.21.15.146:0/797466545 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8504138e30 0x7f8504119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.123+0000 7f850259c700 1 -- 172.21.15.146:0/797466545 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8504133b80 msgr2=0x7f8504119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.123+0000 7f850259c700 1 --2- 172.21.15.146:0/797466545 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8504133b80 0x7f8504119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.123+0000 7f850259c700 1 -- 172.21.15.146:0/797466545 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc009b30 con 0x7f8504099a60 2023-10-03T10:12:24.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.123+0000 7f850259c700 1 --2- 172.21.15.146:0/797466545 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8504099a60 0x7f8504118df0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f84f400c4b0 tx=0x7f84f400c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:24.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.123+0000 7f84f2ffd700 1 -- 172.21.15.146:0/797466545 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f40054e0 con 0x7f8504099a60 2023-10-03T10:12:24.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.123+0000 7f84f2ffd700 1 -- 172.21.15.146:0/797466545 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f4003680 con 0x7f8504099a60 2023-10-03T10:12:24.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.123+0000 7f8508c87700 1 -- 172.21.15.146:0/797466545 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f850409a2c0 con 0x7f8504099a60 2023-10-03T10:12:24.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.123+0000 7f84f2ffd700 1 -- 172.21.15.146:0/797466545 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f4003a30 con 0x7f8504099a60 2023-10-03T10:12:24.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.123+0000 7f8508c87700 1 -- 172.21.15.146:0/797466545 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8504137a50 con 0x7f8504099a60 2023-10-03T10:12:24.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.124+0000 7f84f2ffd700 1 -- 172.21.15.146:0/797466545 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f84f4003b90 con 0x7f8504099a60 2023-10-03T10:12:24.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.125+0000 7f84f2ffd700 1 -- 172.21.15.146:0/797466545 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f84f403ec00 con 0x7f8504099a60 2023-10-03T10:12:24.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.125+0000 7f8508c87700 1 -- 172.21.15.146:0/797466545 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850409c7e0 con 0x7f8504099a60 2023-10-03T10:12:24.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.125+0000 7f8501d9b700 1 -- 172.21.15.146:0/797466545 >> v1:172.21.15.146:6816/126749 conn(0x7f84e402f510 legacy=0x7f84e40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:24.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.134+0000 7f84f2ffd700 1 -- 172.21.15.146:0/797466545 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f84f4017070 con 0x7f8504099a60 2023-10-03T10:12:24.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.212+0000 7fe434ddc700 1 Processor -- start 2023-10-03T10:12:24.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.212+0000 7fe434ddc700 1 -- start start 2023-10-03T10:12:24.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.213+0000 7fe434ddc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe430133ad0 0x7fe430133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.213+0000 7fe434ddc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4301300a0 0x7fe4301304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.213+0000 7fe434ddc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe43006b2d0 con 0x7fe4301309f0 2023-10-03T10:12:24.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.213+0000 7fe434ddc700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe430133610 con 0x7fe430133ad0 2023-10-03T10:12:24.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.213+0000 7fe434ddc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe43009a500 con 0x7fe4301300a0 2023-10-03T10:12:24.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.214+0000 7fe42dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4301300a0 0x7fe4301304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.214+0000 7fe42e59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe430133ad0 0x7fe430133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.214+0000 7fe42dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4301300a0 0x7fe4301304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54416/0 (socket says 172.21.15.146:54416) 2023-10-03T10:12:24.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.214+0000 7fe42e59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe430133ad0 0x7fe430133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47180/0 (socket says 172.21.15.146:47180) 2023-10-03T10:12:24.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.214+0000 7fe42dd9b700 1 -- 172.21.15.146:0/4276371065 learned_addr learned my addr 172.21.15.146:0/4276371065 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:24.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.214+0000 7fe42dd9b700 1 -- 172.21.15.146:0/4276371065 >> v2:172.21.15.146:3300/0 conn(0x7fe430133ad0 msgr2=0x7fe430133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:24.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.214+0000 7fe42dd9b700 1 --2- 172.21.15.146:0/4276371065 >> v2:172.21.15.146:3300/0 conn(0x7fe430133ad0 0x7fe430133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.214+0000 7fe42dd9b700 1 -- 172.21.15.146:0/4276371065 >> v1:172.21.15.146:6789/0 conn(0x7fe4301309f0 legacy=0x7fe43013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.214+0000 7fe42dd9b700 1 -- 172.21.15.146:0/4276371065 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4301338b0 con 0x7fe4301300a0 2023-10-03T10:12:24.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.214+0000 7fe42e59c700 1 --2- 172.21.15.146:0/4276371065 >> v2:172.21.15.146:3300/0 conn(0x7fe430133ad0 0x7fe430133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:24.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.214+0000 7fe42dd9b700 1 --2- 172.21.15.146:0/4276371065 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4301300a0 0x7fe4301304b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe4240098f0 tx=0x7fe424009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4940d75a5af29fc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.214+0000 7fe42d59a700 1 -- 172.21.15.146:0/4276371065 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424011830 con 0x7fe4301300a0 2023-10-03T10:12:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.214+0000 7fe42d59a700 1 -- 172.21.15.146:0/4276371065 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe424011990 con 0x7fe4301300a0 2023-10-03T10:12:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.214+0000 7fe42d59a700 1 -- 172.21.15.146:0/4276371065 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424011d20 con 0x7fe4301300a0 2023-10-03T10:12:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.215+0000 7fe434ddc700 1 -- 172.21.15.146:0/4276371065 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4301300a0 msgr2=0x7fe4301304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.215+0000 7fe434ddc700 1 --2- 172.21.15.146:0/4276371065 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4301300a0 0x7fe4301304b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe4240098f0 tx=0x7fe424009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.215+0000 7fe434ddc700 1 -- 172.21.15.146:0/4276371065 shutdown_connections 2023-10-03T10:12:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.215+0000 7fe434ddc700 1 --2- 172.21.15.146:0/4276371065 >> v2:172.21.15.146:3300/0 conn(0x7fe430133ad0 0x7fe430133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.215+0000 7fe434ddc700 1 --2- 172.21.15.146:0/4276371065 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4301300a0 0x7fe4301304b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.215+0000 7fe434ddc700 1 -- 172.21.15.146:0/4276371065 >> 172.21.15.146:0/4276371065 conn(0x7fe430099c40 msgr2=0x7fe4300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.215+0000 7fe434ddc700 1 -- 172.21.15.146:0/4276371065 shutdown_connections 2023-10-03T10:12:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.215+0000 7fe434ddc700 1 -- 172.21.15.146:0/4276371065 wait complete. 2023-10-03T10:12:24.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.216+0000 7fe434ddc700 1 Processor -- start 2023-10-03T10:12:24.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.216+0000 7fe434ddc700 1 -- start start 2023-10-03T10:12:24.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.217+0000 7fe434ddc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4301300a0 0x7fe43011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.217+0000 7fe434ddc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4301309f0 0x7fe43011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.217+0000 7fe434ddc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe430133ad0 0x7fe43011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.217+0000 7fe434ddc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43012fdf0 con 0x7fe4301309f0 2023-10-03T10:12:24.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.217+0000 7fe434ddc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43012dd00 con 0x7fe430133ad0 2023-10-03T10:12:24.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.217+0000 7fe434ddc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe430072380 con 0x7fe4301300a0 2023-10-03T10:12:24.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.217+0000 7fe42e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4301300a0 0x7fe43011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.217+0000 7fe42e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4301300a0 0x7fe43011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54432/0 (socket says 172.21.15.146:54432) 2023-10-03T10:12:24.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.217+0000 7fe42e59c700 1 -- 172.21.15.146:0/3700351801 learned_addr learned my addr 172.21.15.146:0/3700351801 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:24.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.217+0000 7fe42ed9d700 1 --2- 172.21.15.146:0/3700351801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe430133ad0 0x7fe43011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.217+0000 7fe42dd9b700 1 --2- 172.21.15.146:0/3700351801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4301309f0 0x7fe43011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.217+0000 7fe42e59c700 1 -- 172.21.15.146:0/3700351801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe430133ad0 msgr2=0x7fe43011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.217+0000 7fe42e59c700 1 --2- 172.21.15.146:0/3700351801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe430133ad0 0x7fe43011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.217+0000 7fe42e59c700 1 -- 172.21.15.146:0/3700351801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4301309f0 msgr2=0x7fe43011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.217+0000 7fe42e59c700 1 --2- 172.21.15.146:0/3700351801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4301309f0 0x7fe43011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.217+0000 7fe42e59c700 1 -- 172.21.15.146:0/3700351801 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4200094a0 con 0x7fe4301300a0 2023-10-03T10:12:24.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.217+0000 7fe42dd9b700 1 --2- 172.21.15.146:0/3700351801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4301309f0 0x7fe43011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:24.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.217+0000 7fe42e59c700 1 --2- 172.21.15.146:0/3700351801 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4301300a0 0x7fe43011da40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe42000ebe0 tx=0x7fe42000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:24.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.217+0000 7fe41effd700 1 -- 172.21.15.146:0/3700351801 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe420009800 con 0x7fe4301300a0 2023-10-03T10:12:24.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.218+0000 7fe41effd700 1 -- 172.21.15.146:0/3700351801 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42000c910 con 0x7fe4301300a0 2023-10-03T10:12:24.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.218+0000 7fe41effd700 1 -- 172.21.15.146:0/3700351801 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42000cc80 con 0x7fe4301300a0 2023-10-03T10:12:24.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.218+0000 7fe434ddc700 1 -- 172.21.15.146:0/3700351801 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe424009550 con 0x7fe4301300a0 2023-10-03T10:12:24.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.218+0000 7fe434ddc700 1 -- 172.21.15.146:0/3700351801 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43011ff20 con 0x7fe4301300a0 2023-10-03T10:12:24.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.218+0000 7fe41effd700 1 -- 172.21.15.146:0/3700351801 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe420013470 con 0x7fe4301300a0 2023-10-03T10:12:24.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.218+0000 7fe41effd700 1 -- 172.21.15.146:0/3700351801 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fe4200400e0 con 0x7fe4301300a0 2023-10-03T10:12:24.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.218+0000 7fe42dd9b700 1 -- 172.21.15.146:0/3700351801 >> v1:172.21.15.146:6816/126749 conn(0x7fe41002f510 legacy=0x7fe4100319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:24.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.219+0000 7fe434ddc700 1 -- 172.21.15.146:0/3700351801 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43004f2a0 con 0x7fe4301300a0 2023-10-03T10:12:24.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.220+0000 7f3096949700 1 Processor -- start 2023-10-03T10:12:24.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.220+0000 7f3096949700 1 -- start start 2023-10-03T10:12:24.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.220+0000 7f3096949700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f309009d860 0x7f309009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.220+0000 7f3096949700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f309009e170 0x7f30901307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.220+0000 7f3096949700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3090130ce0 0x7f3090131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.220+0000 7f3096949700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309009aaa0 con 0x7f309009e170 2023-10-03T10:12:24.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.220+0000 7f3096949700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309009f870 con 0x7f309009d860 2023-10-03T10:12:24.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.220+0000 7f3096949700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f309009b360 con 0x7f3090130ce0 2023-10-03T10:12:24.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.221+0000 7f308ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f309009d860 0x7f309009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.221+0000 7f3094ee6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3090130ce0 0x7f3090131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.221+0000 7f308ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f309009d860 0x7f309009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:33960/0 (socket says 172.21.15.146:33960) 2023-10-03T10:12:24.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.221+0000 7f308ffff700 1 -- 172.21.15.146:0/2259185385 learned_addr learned my addr 172.21.15.146:0/2259185385 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.221+0000 7f308f7fe700 1 --2- 172.21.15.146:0/2259185385 >> v2:172.21.15.146:3300/0 conn(0x7f309009e170 0x7f30901307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.221+0000 7f308ffff700 1 -- 172.21.15.146:0/2259185385 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3090130ce0 msgr2=0x7f3090131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.221+0000 7f308ffff700 1 --2- 172.21.15.146:0/2259185385 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3090130ce0 0x7f3090131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.221+0000 7f308ffff700 1 -- 172.21.15.146:0/2259185385 >> v2:172.21.15.146:3300/0 conn(0x7f309009e170 msgr2=0x7f30901307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.221+0000 7f308ffff700 1 --2- 172.21.15.146:0/2259185385 >> v2:172.21.15.146:3300/0 conn(0x7f309009e170 0x7f30901307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.221+0000 7f308ffff700 1 -- 172.21.15.146:0/2259185385 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309009b620 con 0x7f309009d860 2023-10-03T10:12:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.221+0000 7f3094ee6700 1 --2- 172.21.15.146:0/2259185385 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3090130ce0 0x7f3090131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.221+0000 7f308ffff700 1 --2- 172.21.15.146:0/2259185385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f309009d860 0x7f309009dc30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3080009920 tx=0x7f3080009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a5ce4ec67fff107 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.221+0000 7f308effd700 1 -- 172.21.15.146:0/2259185385 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308000f8a0 con 0x7f309009d860 2023-10-03T10:12:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.221+0000 7f308effd700 1 -- 172.21.15.146:0/2259185385 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308000fa00 con 0x7f309009d860 2023-10-03T10:12:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.221+0000 7f308effd700 1 -- 172.21.15.146:0/2259185385 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308000fd90 con 0x7f309009d860 2023-10-03T10:12:24.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.222+0000 7f3096949700 1 -- 172.21.15.146:0/2259185385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f309009d860 msgr2=0x7f309009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.222+0000 7f3096949700 1 --2- 172.21.15.146:0/2259185385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f309009d860 0x7f309009dc30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3080009920 tx=0x7f3080009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.222+0000 7f3096949700 1 -- 172.21.15.146:0/2259185385 shutdown_connections 2023-10-03T10:12:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.222+0000 7f3096949700 1 --2- 172.21.15.146:0/2259185385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f309009d860 0x7f309009dc30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.222+0000 7f3096949700 1 --2- 172.21.15.146:0/2259185385 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3090130ce0 0x7f3090131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.222+0000 7f3096949700 1 --2- 172.21.15.146:0/2259185385 >> v2:172.21.15.146:3300/0 conn(0x7f309009e170 0x7f30901307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.222+0000 7f3096949700 1 -- 172.21.15.146:0/2259185385 >> 172.21.15.146:0/2259185385 conn(0x7f3090099c40 msgr2=0x7f30900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.222+0000 7f3096949700 1 -- 172.21.15.146:0/2259185385 shutdown_connections 2023-10-03T10:12:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.222+0000 7f3096949700 1 -- 172.21.15.146:0/2259185385 wait complete. 2023-10-03T10:12:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.224+0000 7f3096949700 1 Processor -- start 2023-10-03T10:12:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.224+0000 7f3096949700 1 -- start start 2023-10-03T10:12:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.224+0000 7f3096949700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f309009d860 0x7f3090119f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.225+0000 7f3096949700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f309009e170 0x7f309011a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.225+0000 7f3096949700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3090130ce0 0x7f309011aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.225+0000 7f3096949700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309011d480 con 0x7f309009e170 2023-10-03T10:12:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.225+0000 7f3096949700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309011e3e0 con 0x7f309009d860 2023-10-03T10:12:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.225+0000 7f3096949700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30900a22d0 con 0x7f3090130ce0 2023-10-03T10:12:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.225+0000 7f308f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f309009e170 0x7f309011a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.225+0000 7f308f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f309009e170 0x7f309011a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47216/0 (socket says 172.21.15.146:47216) 2023-10-03T10:12:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.225+0000 7f308f7fe700 1 -- 172.21.15.146:0/2571833409 learned_addr learned my addr 172.21.15.146:0/2571833409 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.225+0000 7f3094ee6700 1 --2- 172.21.15.146:0/2571833409 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3090130ce0 0x7f309011aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.225+0000 7f308ffff700 1 --2- 172.21.15.146:0/2571833409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f309009d860 0x7f3090119f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.225+0000 7f308f7fe700 1 -- 172.21.15.146:0/2571833409 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3090130ce0 msgr2=0x7f309011aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.225+0000 7f308f7fe700 1 --2- 172.21.15.146:0/2571833409 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3090130ce0 0x7f309011aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.225+0000 7f308f7fe700 1 -- 172.21.15.146:0/2571833409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f309009d860 msgr2=0x7f3090119f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.225+0000 7f308f7fe700 1 --2- 172.21.15.146:0/2571833409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f309009d860 0x7f3090119f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.225+0000 7f308f7fe700 1 -- 172.21.15.146:0/2571833409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3088009a70 con 0x7f309009e170 2023-10-03T10:12:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.225+0000 7f308f7fe700 1 --2- 172.21.15.146:0/2571833409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f309009e170 0x7f309011a4c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f308400e930 tx=0x7f308400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.225+0000 7f308cff9700 1 -- 172.21.15.146:0/2571833409 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308400ee70 con 0x7f309009e170 2023-10-03T10:12:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.225+0000 7f308cff9700 1 -- 172.21.15.146:0/2571833409 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308400c7f0 con 0x7f309009e170 2023-10-03T10:12:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.225+0000 7f3096949700 1 -- 172.21.15.146:0/2571833409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3080009550 con 0x7f309009e170 2023-10-03T10:12:24.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.225+0000 7f308cff9700 1 -- 172.21.15.146:0/2571833409 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308400cb80 con 0x7f309009e170 2023-10-03T10:12:24.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.226+0000 7f3096949700 1 -- 172.21.15.146:0/2571833409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309011bc20 con 0x7f309009e170 2023-10-03T10:12:24.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.226+0000 7f308cff9700 1 -- 172.21.15.146:0/2571833409 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f308400cce0 con 0x7f309009e170 2023-10-03T10:12:24.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.227+0000 7f308ffff700 1 -- 172.21.15.146:0/2571833409 >> v1:172.21.15.146:6816/126749 conn(0x7f307c02f510 legacy=0x7f307c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:24.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.227+0000 7f308cff9700 1 -- 172.21.15.146:0/2571833409 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f308403f9a0 con 0x7f309009e170 2023-10-03T10:12:24.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.227+0000 7fe41effd700 1 -- 172.21.15.146:0/3700351801 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe420013720 con 0x7fe4301300a0 2023-10-03T10:12:24.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.227+0000 7f3096949700 1 -- 172.21.15.146:0/2571833409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f309004f2a0 con 0x7f309009e170 2023-10-03T10:12:24.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.232+0000 7f308cff9700 1 -- 172.21.15.146:0/2571833409 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3084021080 con 0x7f309009e170 2023-10-03T10:12:24.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.273+0000 7fa55f7fe700 1 -- 172.21.15.146:0/4253442738 >> v1:172.21.15.146:6816/126749 conn(0x7fa54002f510 legacy=0x7fa5400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:24.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.291+0000 7fa565ee5700 1 -- 172.21.15.146:0/4253442738 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa560124160 con 0x7fa5600a1380 2023-10-03T10:12:24.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.291+0000 7fa557fff700 1 -- 172.21.15.146:0/4253442738 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa560124160 con 0x7fa5600a1380 2023-10-03T10:12:24.292 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:24.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.293+0000 7fa565ee5700 1 -- 172.21.15.146:0/4253442738 >> v1:172.21.15.146:6816/126749 conn(0x7fa54002f510 legacy=0x7fa5400319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:24.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.293+0000 7fa565ee5700 1 -- 172.21.15.146:0/4253442738 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5600a1380 msgr2=0x7fa5601c8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.293+0000 7fa565ee5700 1 --2- 172.21.15.146:0/4253442738 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5600a1380 0x7fa5601c8930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa548009c40 tx=0x7fa548004750 comp rx=0 tx=0).stop 2023-10-03T10:12:24.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.293+0000 7fa565ee5700 1 -- 172.21.15.146:0/4253442738 shutdown_connections 2023-10-03T10:12:24.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.293+0000 7fa565ee5700 1 --2- 172.21.15.146:0/4253442738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa560133f50 0x7fa5601c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.293+0000 7fa565ee5700 1 --2- 172.21.15.146:0/4253442738 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5600a0a70 0x7fa5601c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.293+0000 7fa565ee5700 1 --2- 172.21.15.146:0/4253442738 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5600a1380 0x7fa5601c8930 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.293+0000 7fa565ee5700 1 -- 172.21.15.146:0/4253442738 >> 172.21.15.146:0/4253442738 conn(0x7fa5600a6610 msgr2=0x7fa5600a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:24.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.294+0000 7fa565ee5700 1 -- 172.21.15.146:0/4253442738 shutdown_connections 2023-10-03T10:12:24.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.294+0000 7fa565ee5700 1 -- 172.21.15.146:0/4253442738 wait complete. 2023-10-03T10:12:24.307 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:24.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.326+0000 7f8501d9b700 1 -- 172.21.15.146:0/797466545 >> v1:172.21.15.146:6816/126749 conn(0x7f84e402f510 legacy=0x7f84e40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:24.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.345+0000 7f8508c87700 1 -- 172.21.15.146:0/797466545 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f850404f2a0 con 0x7f8504099a60 2023-10-03T10:12:24.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.345+0000 7f84f2ffd700 1 -- 172.21.15.146:0/797466545 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f84f4003e40 con 0x7f8504099a60 2023-10-03T10:12:24.346 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:24.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.347+0000 7f8508c87700 1 -- 172.21.15.146:0/797466545 >> v1:172.21.15.146:6816/126749 conn(0x7f84e402f510 legacy=0x7f84e40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:24.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.347+0000 7f8508c87700 1 -- 172.21.15.146:0/797466545 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8504099a60 msgr2=0x7f8504118df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.347+0000 7f8508c87700 1 --2- 172.21.15.146:0/797466545 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8504099a60 0x7f8504118df0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f84f400c4b0 tx=0x7f84f400c7c0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.347+0000 7f8508c87700 1 -- 172.21.15.146:0/797466545 shutdown_connections 2023-10-03T10:12:24.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.347+0000 7f8508c87700 1 --2- 172.21.15.146:0/797466545 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8504138e30 0x7f8504119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.347+0000 7f8508c87700 1 --2- 172.21.15.146:0/797466545 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8504099a60 0x7f8504118df0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.347+0000 7f8508c87700 1 --2- 172.21.15.146:0/797466545 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8504133b80 0x7f8504119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.347+0000 7f8508c87700 1 -- 172.21.15.146:0/797466545 >> 172.21.15.146:0/797466545 conn(0x7f85040a2980 msgr2=0x7f85041300d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:24.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.348+0000 7f8508c87700 1 -- 172.21.15.146:0/797466545 shutdown_connections 2023-10-03T10:12:24.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.348+0000 7f8508c87700 1 -- 172.21.15.146:0/797466545 wait complete. 2023-10-03T10:12:24.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:24.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.419+0000 7fe42dd9b700 1 -- 172.21.15.146:0/3700351801 >> v1:172.21.15.146:6816/126749 conn(0x7fe41002f510 legacy=0x7fe4100319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.428+0000 7f308ffff700 1 -- 172.21.15.146:0/2571833409 >> v1:172.21.15.146:6816/126749 conn(0x7f307c02f510 legacy=0x7f307c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.429+0000 7f3096949700 1 -- 172.21.15.146:0/2571833409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f309011d1b0 con 0x7f309009e170 2023-10-03T10:12:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.429+0000 7f308cff9700 1 -- 172.21.15.146:0/2571833409 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3084017070 con 0x7f309009e170 2023-10-03T10:12:24.432 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:24.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.431+0000 7fe434ddc700 1 -- 172.21.15.146:0/3700351801 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe43006c3b0 con 0x7fe4301300a0 2023-10-03T10:12:24.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.431+0000 7f3096949700 1 -- 172.21.15.146:0/2571833409 >> v1:172.21.15.146:6816/126749 conn(0x7f307c02f510 legacy=0x7f307c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:24.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.431+0000 7f3096949700 1 -- 172.21.15.146:0/2571833409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f309009e170 msgr2=0x7f309011a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.431+0000 7f3096949700 1 --2- 172.21.15.146:0/2571833409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f309009e170 0x7f309011a4c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f308400e930 tx=0x7f308400ecf0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.431+0000 7f3096949700 1 -- 172.21.15.146:0/2571833409 shutdown_connections 2023-10-03T10:12:24.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.431+0000 7fe41effd700 1 -- 172.21.15.146:0/3700351801 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe42001ab10 con 0x7fe4301300a0 2023-10-03T10:12:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.431+0000 7f3096949700 1 --2- 172.21.15.146:0/2571833409 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3090130ce0 0x7f309011aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.431+0000 7f3096949700 1 --2- 172.21.15.146:0/2571833409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f309009d860 0x7f3090119f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.431+0000 7f3096949700 1 --2- 172.21.15.146:0/2571833409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f309009e170 0x7f309011a4c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.431+0000 7f3096949700 1 -- 172.21.15.146:0/2571833409 >> 172.21.15.146:0/2571833409 conn(0x7f3090099c40 msgr2=0x7f3090130120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.431+0000 7f3096949700 1 -- 172.21.15.146:0/2571833409 shutdown_connections 2023-10-03T10:12:24.434 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.431+0000 7f3096949700 1 -- 172.21.15.146:0/2571833409 wait complete. 2023-10-03T10:12:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.433+0000 7fe434ddc700 1 -- 172.21.15.146:0/3700351801 >> v1:172.21.15.146:6816/126749 conn(0x7fe41002f510 legacy=0x7fe4100319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.433+0000 7fe434ddc700 1 -- 172.21.15.146:0/3700351801 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4301300a0 msgr2=0x7fe43011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.433+0000 7fe434ddc700 1 --2- 172.21.15.146:0/3700351801 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4301300a0 0x7fe43011da40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe42000ebe0 tx=0x7fe42000eef0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.434+0000 7fe434ddc700 1 -- 172.21.15.146:0/3700351801 shutdown_connections 2023-10-03T10:12:24.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.434+0000 7fe434ddc700 1 --2- 172.21.15.146:0/3700351801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe430133ad0 0x7fe43011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.434+0000 7fe434ddc700 1 --2- 172.21.15.146:0/3700351801 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4301300a0 0x7fe43011da40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.434+0000 7fe434ddc700 1 --2- 172.21.15.146:0/3700351801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4301309f0 0x7fe43011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:24.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.434+0000 7fe434ddc700 1 -- 172.21.15.146:0/3700351801 >> 172.21.15.146:0/3700351801 conn(0x7fe430099c40 msgr2=0x7fe430131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:24.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.434+0000 7fe434ddc700 1 -- 172.21.15.146:0/3700351801 shutdown_connections 2023-10-03T10:12:24.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:24.434+0000 7fe434ddc700 1 -- 172.21.15.146:0/3700351801 wait complete. 2023-10-03T10:12:24.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:24.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:25.308 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:25.363 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:25.446 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:25.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.446+0000 7f4e2eef9700 1 Processor -- start 2023-10-03T10:12:25.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.447+0000 7f4e2eef9700 1 -- start start 2023-10-03T10:12:25.448 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.447+0000 7f4e2eef9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e28134140 0x7f4e28138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.447+0000 7f4e2eef9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4e28134570 0x7f4e2813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.447+0000 7f4e2eef9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e2809b110 con 0x7f4e2809ad40 2023-10-03T10:12:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.447+0000 7f4e2eef9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e280a3b60 con 0x7f4e28134570 2023-10-03T10:12:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.447+0000 7f4e2eef9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e280a1a80 con 0x7f4e28134140 2023-10-03T10:12:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.447+0000 7f4e27fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e28134140 0x7f4e28138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.447+0000 7f4e2d496700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4e28134570 0x7f4e2813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.447+0000 7f4e27fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e28134140 0x7f4e28138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49490/0 (socket says 172.21.15.146:49490) 2023-10-03T10:12:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.447+0000 7f4e2d496700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4e28134570 0x7f4e2813b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45120/0 (socket says 172.21.15.146:45120) 2023-10-03T10:12:25.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.447+0000 7f4e27fff700 1 -- 172.21.15.146:0/2437622654 learned_addr learned my addr 172.21.15.146:0/2437622654 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:25.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.448+0000 7f4e2d496700 1 -- 172.21.15.146:0/2437622654 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e28134140 msgr2=0x7f4e28138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:25.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.448+0000 7f4e2d496700 1 --2- 172.21.15.146:0/2437622654 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e28134140 0x7f4e28138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.448+0000 7f4e2d496700 1 -- 172.21.15.146:0/2437622654 >> v1:172.21.15.146:6789/0 conn(0x7f4e2809ad40 legacy=0x7f4e28133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.448+0000 7f4e277fe700 1 -- 172.21.15.146:0/2437622654 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3766913948 0 0) 0x7f4e2809b110 con 0x7f4e2809ad40 2023-10-03T10:12:25.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.448+0000 7f4e2d496700 1 -- 172.21.15.146:0/2437622654 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e280a2fa0 con 0x7f4e28134570 2023-10-03T10:12:25.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.448+0000 7f4e27fff700 1 --2- 172.21.15.146:0/2437622654 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e28134140 0x7f4e28138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:25.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.448+0000 7f4e2d496700 1 --2- 172.21.15.146:0/2437622654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e28134570 0x7f4e2813b3d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4e20009d90 tx=0x7f4e2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c1addbfbf72fe8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.448+0000 7f4e277fe700 1 -- 172.21.15.146:0/2437622654 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2000e070 con 0x7f4e28134570 2023-10-03T10:12:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.448+0000 7f4e277fe700 1 -- 172.21.15.146:0/2437622654 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2000bb20 con 0x7f4e28134570 2023-10-03T10:12:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.448+0000 7f4e277fe700 1 -- 172.21.15.146:0/2437622654 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e20012430 con 0x7f4e28134570 2023-10-03T10:12:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.449+0000 7f4e2eef9700 1 -- 172.21.15.146:0/2437622654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e28134570 msgr2=0x7f4e2813b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.449+0000 7f4e2eef9700 1 --2- 172.21.15.146:0/2437622654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e28134570 0x7f4e2813b3d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4e20009d90 tx=0x7f4e2000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.449+0000 7f4e2eef9700 1 -- 172.21.15.146:0/2437622654 shutdown_connections 2023-10-03T10:12:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.449+0000 7f4e2eef9700 1 --2- 172.21.15.146:0/2437622654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e28134570 0x7f4e2813b3d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.449+0000 7f4e2eef9700 1 --2- 172.21.15.146:0/2437622654 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e28134140 0x7f4e28138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.449+0000 7f4e2eef9700 1 -- 172.21.15.146:0/2437622654 >> 172.21.15.146:0/2437622654 conn(0x7f4e28099c40 msgr2=0x7f4e2806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.450+0000 7f4e2eef9700 1 -- 172.21.15.146:0/2437622654 shutdown_connections 2023-10-03T10:12:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.450+0000 7f4e2eef9700 1 -- 172.21.15.146:0/2437622654 wait complete. 2023-10-03T10:12:25.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.450+0000 7f4e2eef9700 1 Processor -- start 2023-10-03T10:12:25.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.451+0000 7f4e2eef9700 1 -- start start 2023-10-03T10:12:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.451+0000 7f4e2eef9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e2809ad40 0x7f4e281393d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.451+0000 7f4e2eef9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e28134140 0x7f4e28139910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.451+0000 7f4e2eef9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e28134570 0x7f4e28139e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.451+0000 7f4e2eef9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2811e510 con 0x7f4e28134570 2023-10-03T10:12:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.451+0000 7f4e2eef9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2809c7e0 con 0x7f4e2809ad40 2023-10-03T10:12:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.451+0000 7f4e2eef9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e280a4cf0 con 0x7f4e28134140 2023-10-03T10:12:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.451+0000 7f4e27fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e28134140 0x7f4e28139910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.451+0000 7f4e27fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e28134140 0x7f4e28139910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49500/0 (socket says 172.21.15.146:49500) 2023-10-03T10:12:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.451+0000 7f4e27fff700 1 -- 172.21.15.146:0/2208250153 learned_addr learned my addr 172.21.15.146:0/2208250153 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.451+0000 7f4e2d496700 1 --2- 172.21.15.146:0/2208250153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e28134570 0x7f4e28139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.452+0000 7f4e2cc95700 1 --2- 172.21.15.146:0/2208250153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e2809ad40 0x7f4e281393d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.452+0000 7f4e2d496700 1 -- 172.21.15.146:0/2208250153 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e28134140 msgr2=0x7f4e28139910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.452+0000 7f4e2d496700 1 --2- 172.21.15.146:0/2208250153 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e28134140 0x7f4e28139910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.452+0000 7f4e2d496700 1 -- 172.21.15.146:0/2208250153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e2809ad40 msgr2=0x7f4e281393d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.452+0000 7f4e2d496700 1 --2- 172.21.15.146:0/2208250153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e2809ad40 0x7f4e281393d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.452+0000 7f4e2d496700 1 -- 172.21.15.146:0/2208250153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e14009550 con 0x7f4e28134570 2023-10-03T10:12:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.452+0000 7f4e27fff700 1 --2- 172.21.15.146:0/2208250153 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e28134140 0x7f4e28139910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:25.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.452+0000 7f4e2cc95700 1 --2- 172.21.15.146:0/2208250153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e2809ad40 0x7f4e281393d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:25.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.452+0000 7f4e2d496700 1 --2- 172.21.15.146:0/2208250153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e28134570 0x7f4e28139e50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4e20016000 tx=0x7f4e20004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:25.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.452+0000 7f4e257fa700 1 -- 172.21.15.146:0/2208250153 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e20012430 con 0x7f4e28134570 2023-10-03T10:12:25.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.452+0000 7f4e257fa700 1 -- 172.21.15.146:0/2208250153 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e20020070 con 0x7f4e28134570 2023-10-03T10:12:25.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.452+0000 7f4e2eef9700 1 -- 172.21.15.146:0/2208250153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e20009a70 con 0x7f4e28134570 2023-10-03T10:12:25.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.452+0000 7f4e2eef9700 1 -- 172.21.15.146:0/2208250153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e2811e000 con 0x7f4e28134570 2023-10-03T10:12:25.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.452+0000 7f4e257fa700 1 -- 172.21.15.146:0/2208250153 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e20004280 con 0x7f4e28134570 2023-10-03T10:12:25.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.453+0000 7f4e257fa700 1 -- 172.21.15.146:0/2208250153 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4e200043e0 con 0x7f4e28134570 2023-10-03T10:12:25.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.453+0000 7f4e257fa700 1 -- 172.21.15.146:0/2208250153 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f4e20022070 con 0x7f4e28134570 2023-10-03T10:12:25.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.453+0000 7f4e2cc95700 1 -- 172.21.15.146:0/2208250153 >> v1:172.21.15.146:6816/126749 conn(0x7f4e0c02f560 legacy=0x7f4e0c031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:25.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.454+0000 7f4e2eef9700 1 -- 172.21.15.146:0/2208250153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e080052e0 con 0x7f4e28134570 2023-10-03T10:12:25.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.459+0000 7f4e257fa700 1 -- 172.21.15.146:0/2208250153 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e2001b400 con 0x7f4e28134570 2023-10-03T10:12:25.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.506+0000 7f4bc9e91700 1 Processor -- start 2023-10-03T10:12:25.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.506+0000 7f4bc9e91700 1 -- start start 2023-10-03T10:12:25.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.507+0000 7f4bc9e91700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bc4131980 0x7f4bc4131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.507+0000 7f4bc9e91700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4bc409bc70 0x7f4bc409c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.507+0000 7f4bc9e91700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc409c5c0 0x7f4bc4138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.507+0000 7f4bc9e91700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc406eb30 con 0x7f4bc409bc70 2023-10-03T10:12:25.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.507+0000 7f4bc9e91700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc40a1640 con 0x7f4bc409c5c0 2023-10-03T10:12:25.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.507+0000 7f4bc9e91700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc40a22d0 con 0x7f4bc4131980 2023-10-03T10:12:25.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.507+0000 7f4bc37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bc4131980 0x7f4bc4131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.507+0000 7f4bc3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc409c5c0 0x7f4bc4138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.507+0000 7f4bc2ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4bc409bc70 0x7f4bc409c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.507+0000 7f4bc37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bc4131980 0x7f4bc4131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49504/0 (socket says 172.21.15.146:49504) 2023-10-03T10:12:25.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.507+0000 7f4bc37fe700 1 -- 172.21.15.146:0/2612166683 learned_addr learned my addr 172.21.15.146:0/2612166683 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:25.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.508+0000 7f4bc37fe700 1 -- 172.21.15.146:0/2612166683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc409c5c0 msgr2=0x7f4bc4138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:25.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.508+0000 7f4bc37fe700 1 --2- 172.21.15.146:0/2612166683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc409c5c0 0x7f4bc4138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.508+0000 7f4bc37fe700 1 -- 172.21.15.146:0/2612166683 >> v2:172.21.15.146:3300/0 conn(0x7f4bc409bc70 msgr2=0x7f4bc409c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:25.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.508+0000 7f4bc37fe700 1 --2- 172.21.15.146:0/2612166683 >> v2:172.21.15.146:3300/0 conn(0x7f4bc409bc70 0x7f4bc409c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.508+0000 7f4bc37fe700 1 -- 172.21.15.146:0/2612166683 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc4131550 con 0x7f4bc4131980 2023-10-03T10:12:25.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.508+0000 7f4bc3fff700 1 --2- 172.21.15.146:0/2612166683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc409c5c0 0x7f4bc4138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:25.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.508+0000 7f4bc2ffd700 1 --2- 172.21.15.146:0/2612166683 >> v2:172.21.15.146:3300/0 conn(0x7f4bc409bc70 0x7f4bc409c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:25.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.508+0000 7f4bc37fe700 1 --2- 172.21.15.146:0/2612166683 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bc4131980 0x7f4bc4131d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4bb40098f0 tx=0x7f4bb4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bbe230e90e74e45 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:25.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.508+0000 7f4bc27fc700 1 -- 172.21.15.146:0/2612166683 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4005e30 con 0x7f4bc4131980 2023-10-03T10:12:25.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.508+0000 7f4bc27fc700 1 -- 172.21.15.146:0/2612166683 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb4004030 con 0x7f4bc4131980 2023-10-03T10:12:25.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.508+0000 7f4bc27fc700 1 -- 172.21.15.146:0/2612166683 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb40043e0 con 0x7f4bc4131980 2023-10-03T10:12:25.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.509+0000 7f4bc9e91700 1 -- 172.21.15.146:0/2612166683 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bc4131980 msgr2=0x7f4bc4131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.509+0000 7f4bc9e91700 1 --2- 172.21.15.146:0/2612166683 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bc4131980 0x7f4bc4131d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4bb40098f0 tx=0x7f4bb4009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:25.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.509+0000 7f4bc9e91700 1 -- 172.21.15.146:0/2612166683 shutdown_connections 2023-10-03T10:12:25.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.509+0000 7f4bc9e91700 1 --2- 172.21.15.146:0/2612166683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc409c5c0 0x7f4bc4138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.509+0000 7f4bc9e91700 1 --2- 172.21.15.146:0/2612166683 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bc4131980 0x7f4bc4131d50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.509+0000 7f4bc9e91700 1 --2- 172.21.15.146:0/2612166683 >> v2:172.21.15.146:3300/0 conn(0x7f4bc409bc70 0x7f4bc409c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.509+0000 7f4bc9e91700 1 -- 172.21.15.146:0/2612166683 >> 172.21.15.146:0/2612166683 conn(0x7f4bc40a2980 msgr2=0x7f4bc40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:25.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.509+0000 7f4bc9e91700 1 -- 172.21.15.146:0/2612166683 shutdown_connections 2023-10-03T10:12:25.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.509+0000 7f4bc9e91700 1 -- 172.21.15.146:0/2612166683 wait complete. 2023-10-03T10:12:25.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.510+0000 7f4bc9e91700 1 Processor -- start 2023-10-03T10:12:25.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.511+0000 7f4bc9e91700 1 -- start start 2023-10-03T10:12:25.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.511+0000 7f4bc9e91700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bc409bc70 0x7f4bc4099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.511+0000 7f4bc9e91700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bc409c5c0 0x7f4bc4099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.511+0000 7f4bc9e91700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc4131980 0x7f4bc409a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.511+0000 7f4bc9e91700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc411ffc0 con 0x7f4bc409bc70 2023-10-03T10:12:25.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.511+0000 7f4bc9e91700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc4121690 con 0x7f4bc4131980 2023-10-03T10:12:25.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.511+0000 7f4bc9e91700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc412eac0 con 0x7f4bc409c5c0 2023-10-03T10:12:25.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.512+0000 7f4bc37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bc409bc70 0x7f4bc4099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.512+0000 7f4bc37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bc409bc70 0x7f4bc4099a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45142/0 (socket says 172.21.15.146:45142) 2023-10-03T10:12:25.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.512+0000 7f4bc37fe700 1 -- 172.21.15.146:0/3868190134 learned_addr learned my addr 172.21.15.146:0/3868190134 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:25.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.512+0000 7f4bc2ffd700 1 --2- 172.21.15.146:0/3868190134 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bc409c5c0 0x7f4bc4099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.512+0000 7f4bc3fff700 1 --2- 172.21.15.146:0/3868190134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc4131980 0x7f4bc409a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.512+0000 7f4bc37fe700 1 -- 172.21.15.146:0/3868190134 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bc409c5c0 msgr2=0x7f4bc4099fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.512+0000 7f4bc37fe700 1 --2- 172.21.15.146:0/3868190134 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bc409c5c0 0x7f4bc4099fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.512+0000 7f4bc37fe700 1 -- 172.21.15.146:0/3868190134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc4131980 msgr2=0x7f4bc409a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.512+0000 7f4bc37fe700 1 --2- 172.21.15.146:0/3868190134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc4131980 0x7f4bc409a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.512+0000 7f4bc37fe700 1 -- 172.21.15.146:0/3868190134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb80094a0 con 0x7f4bc409bc70 2023-10-03T10:12:25.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.512+0000 7f4bc37fe700 1 --2- 172.21.15.146:0/3868190134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bc409bc70 0x7f4bc4099a90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4014040 tx=0x7f4bb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:25.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.512+0000 7f4babfff700 1 -- 172.21.15.146:0/3868190134 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4003ab0 con 0x7f4bc409bc70 2023-10-03T10:12:25.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.512+0000 7f4babfff700 1 -- 172.21.15.146:0/3868190134 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb4003c10 con 0x7f4bc409bc70 2023-10-03T10:12:25.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.512+0000 7f4bc9e91700 1 -- 172.21.15.146:0/3868190134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bbc009a70 con 0x7f4bc409bc70 2023-10-03T10:12:25.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.512+0000 7f4babfff700 1 -- 172.21.15.146:0/3868190134 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4005e80 con 0x7f4bc409bc70 2023-10-03T10:12:25.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.513+0000 7f4bc9e91700 1 -- 172.21.15.146:0/3868190134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb4009500 con 0x7f4bc409bc70 2023-10-03T10:12:25.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.513+0000 7f4bc9e91700 1 -- 172.21.15.146:0/3868190134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc404f2a0 con 0x7f4bc409bc70 2023-10-03T10:12:25.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.514+0000 7f4babfff700 1 -- 172.21.15.146:0/3868190134 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4bb4018070 con 0x7f4bc409bc70 2023-10-03T10:12:25.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.515+0000 7f4babfff700 1 -- 172.21.15.146:0/3868190134 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f4bb4040980 con 0x7f4bc409bc70 2023-10-03T10:12:25.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.515+0000 7f4bc2ffd700 1 -- 172.21.15.146:0/3868190134 >> v1:172.21.15.146:6816/126749 conn(0x7f4bb002f510 legacy=0x7f4bb00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:25.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.518+0000 7f4babfff700 1 -- 172.21.15.146:0/3868190134 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4bb4006030 con 0x7f4bc409bc70 2023-10-03T10:12:25.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.579+0000 7f9334798700 1 Processor -- start 2023-10-03T10:12:25.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.579+0000 7f9334798700 1 -- start start 2023-10-03T10:12:25.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.580+0000 7f9334798700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f932c137dd0 0x7f932c1381a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.580+0000 7f9334798700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f932c06f1d0 0x7f932c06f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.580+0000 7f9334798700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f932c072200 con 0x7f932c06fb80 2023-10-03T10:12:25.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.580+0000 7f9334798700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f932c09a340 con 0x7f932c137dd0 2023-10-03T10:12:25.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.580+0000 7f9334798700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f932c0707b0 con 0x7f932c06f1d0 2023-10-03T10:12:25.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.580+0000 7f9332534700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f932c137dd0 0x7f932c1381a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.580+0000 7f9331d33700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f932c06f1d0 0x7f932c06f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.580+0000 7f9332534700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f932c137dd0 0x7f932c1381a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45144/0 (socket says 172.21.15.146:45144) 2023-10-03T10:12:25.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.580+0000 7f9332534700 1 -- 172.21.15.146:0/3933563383 learned_addr learned my addr 172.21.15.146:0/3933563383 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:25.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.580+0000 7f9331d33700 1 --2- 172.21.15.146:0/3933563383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f932c06f1d0 0x7f932c06f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49518/0 (socket says 172.21.15.146:49518) 2023-10-03T10:12:25.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.580+0000 7f9331d33700 1 -- 172.21.15.146:0/3933563383 >> v2:172.21.15.146:3300/0 conn(0x7f932c137dd0 msgr2=0x7f932c1381a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:25.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.581+0000 7f9331d33700 1 --2- 172.21.15.146:0/3933563383 >> v2:172.21.15.146:3300/0 conn(0x7f932c137dd0 0x7f932c1381a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.581+0000 7f9331d33700 1 -- 172.21.15.146:0/3933563383 >> v1:172.21.15.146:6789/0 conn(0x7f932c06fb80 legacy=0x7f932c13ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.581+0000 7f9331d33700 1 -- 172.21.15.146:0/3933563383 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c137980 con 0x7f932c06f1d0 2023-10-03T10:12:25.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.581+0000 7f9331d33700 1 --2- 172.21.15.146:0/3933563383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f932c06f1d0 0x7f932c06f640 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f931c009840 tx=0x7f931c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e538d50457725c6a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:25.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.581+0000 7f9331532700 1 -- 172.21.15.146:0/3933563383 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c011830 con 0x7f932c06f1d0 2023-10-03T10:12:25.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.581+0000 7f9331532700 1 -- 172.21.15.146:0/3933563383 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931c011990 con 0x7f932c06f1d0 2023-10-03T10:12:25.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.581+0000 7f9331532700 1 -- 172.21.15.146:0/3933563383 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c011d20 con 0x7f932c06f1d0 2023-10-03T10:12:25.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.581+0000 7fc32dec7700 1 Processor -- start 2023-10-03T10:12:25.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.581+0000 7fc32dec7700 1 -- start start 2023-10-03T10:12:25.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.582+0000 7f9334798700 1 -- 172.21.15.146:0/3933563383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f932c06f1d0 msgr2=0x7f932c06f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.582+0000 7f9334798700 1 --2- 172.21.15.146:0/3933563383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f932c06f1d0 0x7f932c06f640 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f931c009840 tx=0x7f931c009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:25.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.582+0000 7f9334798700 1 -- 172.21.15.146:0/3933563383 shutdown_connections 2023-10-03T10:12:25.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.582+0000 7f9334798700 1 --2- 172.21.15.146:0/3933563383 >> v2:172.21.15.146:3300/0 conn(0x7f932c137dd0 0x7f932c1381a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.582+0000 7f9334798700 1 --2- 172.21.15.146:0/3933563383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f932c06f1d0 0x7f932c06f640 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.582+0000 7f9334798700 1 -- 172.21.15.146:0/3933563383 >> 172.21.15.146:0/3933563383 conn(0x7f932c0a2810 msgr2=0x7f932c0a2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:25.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.582+0000 7f9334798700 1 -- 172.21.15.146:0/3933563383 shutdown_connections 2023-10-03T10:12:25.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.582+0000 7f9334798700 1 -- 172.21.15.146:0/3933563383 wait complete. 2023-10-03T10:12:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.582+0000 7fc32dec7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc32812feb0 0x7fc328130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.582+0000 7fc32dec7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc3281307c0 0x7fc3280993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.582+0000 7fc32dec7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc328099920 0x7fc328099dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.582+0000 7fc32dec7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32809a540 con 0x7fc3281307c0 2023-10-03T10:12:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.582+0000 7fc32dec7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc32809ad40 con 0x7fc32812feb0 2023-10-03T10:12:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.582+0000 7fc32dec7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc32809e640 con 0x7fc328099920 2023-10-03T10:12:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.582+0000 7fc326ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc3281307c0 0x7fc3280993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.582+0000 7fc326ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc3281307c0 0x7fc3280993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45156/0 (socket says 172.21.15.146:45156) 2023-10-03T10:12:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.582+0000 7fc326ffd700 1 -- 172.21.15.146:0/413560532 learned_addr learned my addr 172.21.15.146:0/413560532 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.582+0000 7fc327fff700 1 --2- 172.21.15.146:0/413560532 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc328099920 0x7fc328099dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.583+0000 7fc326ffd700 1 -- 172.21.15.146:0/413560532 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc328099920 msgr2=0x7fc328099dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:25.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.583+0000 7fc326ffd700 1 --2- 172.21.15.146:0/413560532 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc328099920 0x7fc328099dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.583+0000 7fc326ffd700 1 -- 172.21.15.146:0/413560532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc32812feb0 msgr2=0x7fc328130280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:25.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.583+0000 7fc326ffd700 1 --2- 172.21.15.146:0/413560532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc32812feb0 0x7fc328130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.583+0000 7fc326ffd700 1 -- 172.21.15.146:0/413560532 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32809e3c0 con 0x7fc3281307c0 2023-10-03T10:12:25.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.583+0000 7f9334798700 1 Processor -- start 2023-10-03T10:12:25.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.583+0000 7fc326ffd700 1 --2- 172.21.15.146:0/413560532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3281307c0 0x7fc3280993e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00bb90 tx=0x7fc31c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303080ee4000052c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.583+0000 7fc3267fc700 1 -- 172.21.15.146:0/413560532 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c00dcd0 con 0x7fc3281307c0 2023-10-03T10:12:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.583+0000 7fc3267fc700 1 -- 172.21.15.146:0/413560532 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c00de30 con 0x7fc3281307c0 2023-10-03T10:12:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.583+0000 7fc3267fc700 1 -- 172.21.15.146:0/413560532 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c010690 con 0x7fc3281307c0 2023-10-03T10:12:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.583+0000 7f9334798700 1 -- start start 2023-10-03T10:12:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.583+0000 7f9334798700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f932c06f1d0 0x7f932c126480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.583+0000 7f9334798700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f932c06fb80 0x7f932c1269c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.583+0000 7f9334798700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f932c137dd0 0x7f932c126f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.583+0000 7f9334798700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c137680 con 0x7f932c06fb80 2023-10-03T10:12:25.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.583+0000 7f9334798700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932c12a9d0 con 0x7f932c137dd0 2023-10-03T10:12:25.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.583+0000 7f9334798700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f932c071700 con 0x7f932c06f1d0 2023-10-03T10:12:25.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.584+0000 7f9332534700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f932c06f1d0 0x7f932c126480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.584+0000 7f9332534700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f932c06f1d0 0x7f932c126480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49528/0 (socket says 172.21.15.146:49528) 2023-10-03T10:12:25.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.584+0000 7f9332534700 1 -- 172.21.15.146:0/256589767 learned_addr learned my addr 172.21.15.146:0/256589767 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:25.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.584+0000 7f9332534700 1 -- 172.21.15.146:0/256589767 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f932c137dd0 msgr2=0x7f932c126f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.584+0000 7f9332534700 1 --2- 172.21.15.146:0/256589767 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f932c137dd0 0x7f932c126f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.584+0000 7f9332534700 1 -- 172.21.15.146:0/256589767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f932c06fb80 msgr2=0x7f932c1269c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.584+0000 7f9332534700 1 --2- 172.21.15.146:0/256589767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f932c06fb80 0x7f932c1269c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.584+0000 7f9332534700 1 -- 172.21.15.146:0/256589767 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931c0094a0 con 0x7f932c06f1d0 2023-10-03T10:12:25.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.584+0000 7fc32dec7700 1 -- 172.21.15.146:0/413560532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3281307c0 msgr2=0x7fc3280993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.584+0000 7fc32dec7700 1 --2- 172.21.15.146:0/413560532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3281307c0 0x7fc3280993e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00bb90 tx=0x7fc31c00bea0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.584+0000 7fc32dec7700 1 -- 172.21.15.146:0/413560532 shutdown_connections 2023-10-03T10:12:25.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.584+0000 7fc32dec7700 1 --2- 172.21.15.146:0/413560532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc32812feb0 0x7fc328130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.584+0000 7fc32dec7700 1 --2- 172.21.15.146:0/413560532 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc328099920 0x7fc328099dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.584+0000 7fc32dec7700 1 --2- 172.21.15.146:0/413560532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3281307c0 0x7fc3280993e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.584+0000 7fc32dec7700 1 -- 172.21.15.146:0/413560532 >> 172.21.15.146:0/413560532 conn(0x7fc3280a2b30 msgr2=0x7fc32809e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:25.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.584+0000 7fc32dec7700 1 -- 172.21.15.146:0/413560532 shutdown_connections 2023-10-03T10:12:25.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.584+0000 7fc32dec7700 1 -- 172.21.15.146:0/413560532 wait complete. 2023-10-03T10:12:25.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.584+0000 7f9332534700 1 --2- 172.21.15.146:0/256589767 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f932c06f1d0 0x7f932c126480 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f932800e940 tx=0x7f932800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:25.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.585+0000 7f9322ffd700 1 -- 172.21.15.146:0/256589767 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93280096a0 con 0x7f932c06f1d0 2023-10-03T10:12:25.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.585+0000 7f9322ffd700 1 -- 172.21.15.146:0/256589767 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932800c850 con 0x7f932c06f1d0 2023-10-03T10:12:25.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.585+0000 7f9334798700 1 -- 172.21.15.146:0/256589767 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f932c127f10 con 0x7f932c06f1d0 2023-10-03T10:12:25.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.585+0000 7f9322ffd700 1 -- 172.21.15.146:0/256589767 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932800cc00 con 0x7f932c06f1d0 2023-10-03T10:12:25.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.585+0000 7f9334798700 1 -- 172.21.15.146:0/256589767 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932c129df0 con 0x7f932c06f1d0 2023-10-03T10:12:25.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.586+0000 7fc32dec7700 1 Processor -- start 2023-10-03T10:12:25.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.586+0000 7fc32dec7700 1 -- start start 2023-10-03T10:12:25.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.586+0000 7f9334798700 1 -- 172.21.15.146:0/256589767 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f932c1280a0 con 0x7f932c06f1d0 2023-10-03T10:12:25.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.586+0000 7fc32dec7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc328099920 0x7fc3281c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.586+0000 7fc32dec7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc32812feb0 0x7fc3281c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.586+0000 7fc32dec7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3281307c0 0x7fc3281c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:25.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.586+0000 7fc32dec7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc328128510 con 0x7fc3281307c0 2023-10-03T10:12:25.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.586+0000 7fc32dec7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc32808c8e0 con 0x7fc32812feb0 2023-10-03T10:12:25.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.586+0000 7fc32dec7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc32812a100 con 0x7fc328099920 2023-10-03T10:12:25.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.586+0000 7f9322ffd700 1 -- 172.21.15.146:0/256589767 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f932800cd60 con 0x7f932c06f1d0 2023-10-03T10:12:25.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.587+0000 7fc3277fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc328099920 0x7fc3281c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.587+0000 7fc3277fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc328099920 0x7fc3281c8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49530/0 (socket says 172.21.15.146:49530) 2023-10-03T10:12:25.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.587+0000 7fc3277fe700 1 -- 172.21.15.146:0/1296177685 learned_addr learned my addr 172.21.15.146:0/1296177685 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:25.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.587+0000 7f9322ffd700 1 -- 172.21.15.146:0/256589767 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f932803fe40 con 0x7f932c06f1d0 2023-10-03T10:12:25.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.587+0000 7fc326ffd700 1 --2- 172.21.15.146:0/1296177685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc32812feb0 0x7fc3281c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:25.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.587+0000 7fc3277fe700 1 -- 172.21.15.146:0/1296177685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc32812feb0 msgr2=0x7fc3281c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.587+0000 7fc3277fe700 1 --2- 172.21.15.146:0/1296177685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc32812feb0 0x7fc3281c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.587+0000 7fc3277fe700 1 -- 172.21.15.146:0/1296177685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3281307c0 msgr2=0x7fc3281c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.587+0000 7fc3277fe700 1 --2- 172.21.15.146:0/1296177685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3281307c0 0x7fc3281c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.587+0000 7fc3277fe700 1 -- 172.21.15.146:0/1296177685 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c00b7f0 con 0x7fc328099920 2023-10-03T10:12:25.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.587+0000 7fc3277fe700 1 --2- 172.21.15.146:0/1296177685 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc328099920 0x7fc3281c8300 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc31800b520 tx=0x7fc31800b830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:25.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.588+0000 7f9331d33700 1 -- 172.21.15.146:0/256589767 >> v1:172.21.15.146:6816/126749 conn(0x7f931002f510 legacy=0x7f93100319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:25.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.591+0000 7fc30ffff700 1 -- 172.21.15.146:0/1296177685 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318005aa0 con 0x7fc328099920 2023-10-03T10:12:25.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.591+0000 7fc30ffff700 1 -- 172.21.15.146:0/1296177685 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc318005c20 con 0x7fc328099920 2023-10-03T10:12:25.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.591+0000 7fc32dec7700 1 -- 172.21.15.146:0/1296177685 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32808ba10 con 0x7fc328099920 2023-10-03T10:12:25.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.591+0000 7fc30ffff700 1 -- 172.21.15.146:0/1296177685 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318011630 con 0x7fc328099920 2023-10-03T10:12:25.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.591+0000 7fc32dec7700 1 -- 172.21.15.146:0/1296177685 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc328071d30 con 0x7fc328099920 2023-10-03T10:12:25.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.591+0000 7f9322ffd700 1 -- 172.21.15.146:0/256589767 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f93280232f0 con 0x7f932c06f1d0 2023-10-03T10:12:25.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.592+0000 7fc30ffff700 1 -- 172.21.15.146:0/1296177685 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc318011790 con 0x7fc328099920 2023-10-03T10:12:25.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.592+0000 7fc30ffff700 1 -- 172.21.15.146:0/1296177685 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fc31803f760 con 0x7fc328099920 2023-10-03T10:12:25.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.592+0000 7fc326ffd700 1 -- 172.21.15.146:0/1296177685 >> v1:172.21.15.146:6816/126749 conn(0x7fc31402f510 legacy=0x7fc3140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:25.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.592+0000 7fc32dec7700 1 -- 172.21.15.146:0/1296177685 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc32808bba0 con 0x7fc328099920 2023-10-03T10:12:25.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.601+0000 7fc30ffff700 1 -- 172.21.15.146:0/1296177685 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc318005fd0 con 0x7fc328099920 2023-10-03T10:12:25.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.654+0000 7f4e2cc95700 1 -- 172.21.15.146:0/2208250153 >> v1:172.21.15.146:6816/126749 conn(0x7f4e0c02f560 legacy=0x7f4e0c031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:25.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.665+0000 7f4e2eef9700 1 -- 172.21.15.146:0/2208250153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4e08005860 con 0x7f4e28134570 2023-10-03T10:12:25.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.665+0000 7f4e257fa700 1 -- 172.21.15.146:0/2208250153 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e20035090 con 0x7f4e28134570 2023-10-03T10:12:25.666 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:25.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.667+0000 7f4e2eef9700 1 -- 172.21.15.146:0/2208250153 >> v1:172.21.15.146:6816/126749 conn(0x7f4e0c02f560 legacy=0x7f4e0c031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:25.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.667+0000 7f4e2eef9700 1 -- 172.21.15.146:0/2208250153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e28134570 msgr2=0x7f4e28139e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.667+0000 7f4e2eef9700 1 --2- 172.21.15.146:0/2208250153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e28134570 0x7f4e28139e50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4e20016000 tx=0x7f4e20004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.667+0000 7f4e2eef9700 1 -- 172.21.15.146:0/2208250153 shutdown_connections 2023-10-03T10:12:25.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.667+0000 7f4e2eef9700 1 --2- 172.21.15.146:0/2208250153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e28134570 0x7f4e28139e50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.667+0000 7f4e2eef9700 1 --2- 172.21.15.146:0/2208250153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e2809ad40 0x7f4e281393d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.667+0000 7f4e2eef9700 1 --2- 172.21.15.146:0/2208250153 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e28134140 0x7f4e28139910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.667+0000 7f4e2eef9700 1 -- 172.21.15.146:0/2208250153 >> 172.21.15.146:0/2208250153 conn(0x7f4e28099c40 msgr2=0x7f4e2813b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:25.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.667+0000 7f4e2eef9700 1 -- 172.21.15.146:0/2208250153 shutdown_connections 2023-10-03T10:12:25.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.667+0000 7f4e2eef9700 1 -- 172.21.15.146:0/2208250153 wait complete. 2023-10-03T10:12:25.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:25.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.716+0000 7f4bc2ffd700 1 -- 172.21.15.146:0/3868190134 >> v1:172.21.15.146:6816/126749 conn(0x7f4bb002f510 legacy=0x7f4bb00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:25.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.719+0000 7f4bc9e91700 1 -- 172.21.15.146:0/3868190134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4bc412e690 con 0x7f4bc409bc70 2023-10-03T10:12:25.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.719+0000 7f4babfff700 1 -- 172.21.15.146:0/3868190134 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4bb4016030 con 0x7f4bc409bc70 2023-10-03T10:12:25.720 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:25.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.722+0000 7f4bc9e91700 1 -- 172.21.15.146:0/3868190134 >> v1:172.21.15.146:6816/126749 conn(0x7f4bb002f510 legacy=0x7f4bb00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:25.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.722+0000 7f4bc9e91700 1 -- 172.21.15.146:0/3868190134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bc409bc70 msgr2=0x7f4bc4099a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.722+0000 7f4bc9e91700 1 --2- 172.21.15.146:0/3868190134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bc409bc70 0x7f4bc4099a90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4014040 tx=0x7f4bb4004750 comp rx=0 tx=0).stop 2023-10-03T10:12:25.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.722+0000 7f4bc9e91700 1 -- 172.21.15.146:0/3868190134 shutdown_connections 2023-10-03T10:12:25.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.722+0000 7f4bc9e91700 1 --2- 172.21.15.146:0/3868190134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc4131980 0x7f4bc409a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.722+0000 7f4bc9e91700 1 --2- 172.21.15.146:0/3868190134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bc409bc70 0x7f4bc4099a90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.722+0000 7f4bc9e91700 1 --2- 172.21.15.146:0/3868190134 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bc409c5c0 0x7f4bc4099fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.722+0000 7f4bc9e91700 1 -- 172.21.15.146:0/3868190134 >> 172.21.15.146:0/3868190134 conn(0x7f4bc40a2980 msgr2=0x7f4bc41b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:25.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.722+0000 7f4bc9e91700 1 -- 172.21.15.146:0/3868190134 shutdown_connections 2023-10-03T10:12:25.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.722+0000 7f4bc9e91700 1 -- 172.21.15.146:0/3868190134 wait complete. 2023-10-03T10:12:25.740 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:25.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.789+0000 7f9331d33700 1 -- 172.21.15.146:0/256589767 >> v1:172.21.15.146:6816/126749 conn(0x7f931002f510 legacy=0x7f93100319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:25.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.790+0000 7f9334798700 1 -- 172.21.15.146:0/256589767 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f932c04f2a0 con 0x7f932c06f1d0 2023-10-03T10:12:25.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.790+0000 7f9322ffd700 1 -- 172.21.15.146:0/256589767 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9328011350 con 0x7f932c06f1d0 2023-10-03T10:12:25.791 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:25.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.792+0000 7f9334798700 1 -- 172.21.15.146:0/256589767 >> v1:172.21.15.146:6816/126749 conn(0x7f931002f510 legacy=0x7f93100319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:25.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.792+0000 7f9334798700 1 -- 172.21.15.146:0/256589767 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f932c06f1d0 msgr2=0x7f932c126480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.792+0000 7f9334798700 1 --2- 172.21.15.146:0/256589767 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f932c06f1d0 0x7f932c126480 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f932800e940 tx=0x7f932800ed00 comp rx=0 tx=0).stop 2023-10-03T10:12:25.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.792+0000 7f9334798700 1 -- 172.21.15.146:0/256589767 shutdown_connections 2023-10-03T10:12:25.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.792+0000 7f9334798700 1 --2- 172.21.15.146:0/256589767 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f932c137dd0 0x7f932c126f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.792+0000 7f9334798700 1 --2- 172.21.15.146:0/256589767 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f932c06f1d0 0x7f932c126480 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.792+0000 7f9334798700 1 --2- 172.21.15.146:0/256589767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f932c06fb80 0x7f932c1269c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.792+0000 7f9334798700 1 -- 172.21.15.146:0/256589767 >> 172.21.15.146:0/256589767 conn(0x7f932c0a2810 msgr2=0x7f932c0a0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:25.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.792+0000 7f9334798700 1 -- 172.21.15.146:0/256589767 shutdown_connections 2023-10-03T10:12:25.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.792+0000 7f9334798700 1 -- 172.21.15.146:0/256589767 wait complete. 2023-10-03T10:12:25.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.793+0000 7fc326ffd700 1 -- 172.21.15.146:0/1296177685 >> v1:172.21.15.146:6816/126749 conn(0x7fc31402f510 legacy=0x7fc3140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:25.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:25.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.806+0000 7fc32dec7700 1 -- 172.21.15.146:0/1296177685 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc3281298b0 con 0x7fc328099920 2023-10-03T10:12:25.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.806+0000 7fc30ffff700 1 -- 172.21.15.146:0/1296177685 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc318018b50 con 0x7fc328099920 2023-10-03T10:12:25.807 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:25.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.808+0000 7fc32dec7700 1 -- 172.21.15.146:0/1296177685 >> v1:172.21.15.146:6816/126749 conn(0x7fc31402f510 legacy=0x7fc3140319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:25.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.808+0000 7fc32dec7700 1 -- 172.21.15.146:0/1296177685 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc328099920 msgr2=0x7fc3281c8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:25.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.808+0000 7fc32dec7700 1 --2- 172.21.15.146:0/1296177685 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc328099920 0x7fc3281c8300 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc31800b520 tx=0x7fc31800b830 comp rx=0 tx=0).stop 2023-10-03T10:12:25.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.808+0000 7fc32dec7700 1 -- 172.21.15.146:0/1296177685 shutdown_connections 2023-10-03T10:12:25.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.808+0000 7fc32dec7700 1 --2- 172.21.15.146:0/1296177685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3281307c0 0x7fc3281c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.808+0000 7fc32dec7700 1 --2- 172.21.15.146:0/1296177685 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc328099920 0x7fc3281c8300 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.808+0000 7fc32dec7700 1 --2- 172.21.15.146:0/1296177685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc32812feb0 0x7fc3281c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:25.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.808+0000 7fc32dec7700 1 -- 172.21.15.146:0/1296177685 >> 172.21.15.146:0/1296177685 conn(0x7fc3280a2b30 msgr2=0x7fc32809fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:25.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.808+0000 7fc32dec7700 1 -- 172.21.15.146:0/1296177685 shutdown_connections 2023-10-03T10:12:25.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:25.808+0000 7fc32dec7700 1 -- 172.21.15.146:0/1296177685 wait complete. 2023-10-03T10:12:25.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:26.682 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:26.741 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:26.805 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:26.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.817+0000 7fc5f0554700 1 Processor -- start 2023-10-03T10:12:26.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.817+0000 7fc5f0554700 1 -- start start 2023-10-03T10:12:26.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.818+0000 7fc5f0554700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5e8133ad0 0x7fc5e8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.818+0000 7fc5f0554700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc5e81300a0 0x7fc5e81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.818+0000 7fc5f0554700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5e81309f0 0x7fc5e813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.818+0000 7fc5f0554700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e806b2d0 con 0x7fc5e81300a0 2023-10-03T10:12:26.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.818+0000 7fc5f0554700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e8133610 con 0x7fc5e8133ad0 2023-10-03T10:12:26.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.818+0000 7fc5f0554700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e809a500 con 0x7fc5e81309f0 2023-10-03T10:12:26.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.818+0000 7fc5ee2f0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5e8133ad0 0x7fc5e8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.818+0000 7fc5edaef700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc5e81300a0 0x7fc5e81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.818+0000 7fc5ee2f0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5e8133ad0 0x7fc5e8133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49904/0 (socket says 172.21.15.146:49904) 2023-10-03T10:12:26.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.818+0000 7fc5ee2f0700 1 -- 172.21.15.146:0/3514571074 learned_addr learned my addr 172.21.15.146:0/3514571074 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:26.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.818+0000 7fc5eeaf1700 1 --2- 172.21.15.146:0/3514571074 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5e81309f0 0x7fc5e813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.818+0000 7fc5ee2f0700 1 -- 172.21.15.146:0/3514571074 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5e81309f0 msgr2=0x7fc5e813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:26.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.818+0000 7fc5ee2f0700 1 --2- 172.21.15.146:0/3514571074 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5e81309f0 0x7fc5e813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.818+0000 7fc5ee2f0700 1 -- 172.21.15.146:0/3514571074 >> v2:172.21.15.146:3300/0 conn(0x7fc5e81300a0 msgr2=0x7fc5e81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:26.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.818+0000 7fc5ee2f0700 1 --2- 172.21.15.146:0/3514571074 >> v2:172.21.15.146:3300/0 conn(0x7fc5e81300a0 0x7fc5e81304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.818+0000 7fc5ee2f0700 1 -- 172.21.15.146:0/3514571074 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e81338b0 con 0x7fc5e8133ad0 2023-10-03T10:12:26.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.818+0000 7fc5ee2f0700 1 --2- 172.21.15.146:0/3514571074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5e8133ad0 0x7fc5e8133ea0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40098f0 tx=0x7fc5e4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e88335c65a77ecc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.818+0000 7fc5ed2ee700 1 -- 172.21.15.146:0/3514571074 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4011830 con 0x7fc5e8133ad0 2023-10-03T10:12:26.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.818+0000 7fc5ed2ee700 1 -- 172.21.15.146:0/3514571074 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e4011990 con 0x7fc5e8133ad0 2023-10-03T10:12:26.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.818+0000 7fc5ed2ee700 1 -- 172.21.15.146:0/3514571074 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4011d20 con 0x7fc5e8133ad0 2023-10-03T10:12:26.821 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:26.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.819+0000 7fc5f0554700 1 -- 172.21.15.146:0/3514571074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5e8133ad0 msgr2=0x7fc5e8133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.819+0000 7fc5f0554700 1 --2- 172.21.15.146:0/3514571074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5e8133ad0 0x7fc5e8133ea0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40098f0 tx=0x7fc5e4009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:26.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.819+0000 7fc5f0554700 1 -- 172.21.15.146:0/3514571074 shutdown_connections 2023-10-03T10:12:26.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.819+0000 7fc5f0554700 1 --2- 172.21.15.146:0/3514571074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5e8133ad0 0x7fc5e8133ea0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.819+0000 7fc5f0554700 1 --2- 172.21.15.146:0/3514571074 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5e81309f0 0x7fc5e813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.819+0000 7fc5f0554700 1 --2- 172.21.15.146:0/3514571074 >> v2:172.21.15.146:3300/0 conn(0x7fc5e81300a0 0x7fc5e81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.819+0000 7fc5f0554700 1 -- 172.21.15.146:0/3514571074 >> 172.21.15.146:0/3514571074 conn(0x7fc5e8099c40 msgr2=0x7fc5e80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.819+0000 7fc5f0554700 1 -- 172.21.15.146:0/3514571074 shutdown_connections 2023-10-03T10:12:26.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.819+0000 7fc5f0554700 1 -- 172.21.15.146:0/3514571074 wait complete. 2023-10-03T10:12:26.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.820+0000 7fc5f0554700 1 Processor -- start 2023-10-03T10:12:26.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.820+0000 7fc5f0554700 1 -- start start 2023-10-03T10:12:26.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.821+0000 7fc5f0554700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5e81300a0 0x7fc5e811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.821+0000 7fc5f0554700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5e81309f0 0x7fc5e811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.821+0000 7fc5f0554700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5e8133ad0 0x7fc5e811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.821+0000 7fc5f0554700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e8072000 con 0x7fc5e8133ad0 2023-10-03T10:12:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.821+0000 7fc5f0554700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e81209c0 con 0x7fc5e81300a0 2023-10-03T10:12:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.821+0000 7fc5f0554700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e811fe00 con 0x7fc5e81309f0 2023-10-03T10:12:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.821+0000 7fc5ee2f0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5e81300a0 0x7fc5e811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.821+0000 7fc5ee2f0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5e81300a0 0x7fc5e811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49912/0 (socket says 172.21.15.146:49912) 2023-10-03T10:12:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.821+0000 7fc5ee2f0700 1 -- 172.21.15.146:0/3559301285 learned_addr learned my addr 172.21.15.146:0/3559301285 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.821+0000 7fc5eeaf1700 1 --2- 172.21.15.146:0/3559301285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5e8133ad0 0x7fc5e811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.821+0000 7fc5edaef700 1 --2- 172.21.15.146:0/3559301285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5e81309f0 0x7fc5e811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.821+0000 7fc5eeaf1700 1 -- 172.21.15.146:0/3559301285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5e81309f0 msgr2=0x7fc5e811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.821+0000 7fc5eeaf1700 1 --2- 172.21.15.146:0/3559301285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5e81309f0 0x7fc5e811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.821+0000 7fc5eeaf1700 1 -- 172.21.15.146:0/3559301285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5e81300a0 msgr2=0x7fc5e811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.821+0000 7fc5eeaf1700 1 --2- 172.21.15.146:0/3559301285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5e81300a0 0x7fc5e811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.821+0000 7fc5eeaf1700 1 -- 172.21.15.146:0/3559301285 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e4009550 con 0x7fc5e8133ad0 2023-10-03T10:12:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.822+0000 7fc5eeaf1700 1 --2- 172.21.15.146:0/3559301285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5e8133ad0 0x7fc5e811e4c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0007d90 tx=0x7fc5e000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.822+0000 7fc5deffd700 1 -- 172.21.15.146:0/3559301285 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0018070 con 0x7fc5e8133ad0 2023-10-03T10:12:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.822+0000 7fc5deffd700 1 -- 172.21.15.146:0/3559301285 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e000eb30 con 0x7fc5e8133ad0 2023-10-03T10:12:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.822+0000 7fc5f0554700 1 -- 172.21.15.146:0/3559301285 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e8120050 con 0x7fc5e8133ad0 2023-10-03T10:12:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.822+0000 7fc5deffd700 1 -- 172.21.15.146:0/3559301285 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0003a20 con 0x7fc5e8133ad0 2023-10-03T10:12:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.822+0000 7fc5f0554700 1 -- 172.21.15.146:0/3559301285 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e812dd00 con 0x7fc5e8133ad0 2023-10-03T10:12:26.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.823+0000 7fc5deffd700 1 -- 172.21.15.146:0/3559301285 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc5e0014420 con 0x7fc5e8133ad0 2023-10-03T10:12:26.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.823+0000 7fc5f0554700 1 -- 172.21.15.146:0/3559301285 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e804f2a0 con 0x7fc5e8133ad0 2023-10-03T10:12:26.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.823+0000 7fc5deffd700 1 -- 172.21.15.146:0/3559301285 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fc5e003fa40 con 0x7fc5e8133ad0 2023-10-03T10:12:26.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.823+0000 7fc5ee2f0700 1 -- 172.21.15.146:0/3559301285 >> v1:172.21.15.146:6816/126749 conn(0x7fc5cc02f510 legacy=0x7fc5cc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:26.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.828+0000 7fc5deffd700 1 -- 172.21.15.146:0/3559301285 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc5e00128d0 con 0x7fc5e8133ad0 2023-10-03T10:12:26.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.873+0000 7fbbd6236700 1 Processor -- start 2023-10-03T10:12:26.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.874+0000 7fbbd6236700 1 -- start start 2023-10-03T10:12:26.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.874+0000 7fbbd6236700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbbd0099e20 0x7fbbd009a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.874+0000 7fbbd6236700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbbd009a730 0x7fbbd0130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.874+0000 7fbbd6236700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbbd0130890 0x7fbbd0130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.874+0000 7fbbd6236700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd009bf50 con 0x7fbbd0130890 2023-10-03T10:12:26.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.874+0000 7fbbd6236700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd0099a60 con 0x7fbbd009a730 2023-10-03T10:12:26.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.874+0000 7fbbd6236700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd009b230 con 0x7fbbd0099e20 2023-10-03T10:12:26.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.874+0000 7fbbcffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbbd0130890 0x7fbbd0130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.874+0000 7fbbcffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbbd0130890 0x7fbbd0130d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45220/0 (socket says 172.21.15.146:45220) 2023-10-03T10:12:26.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.874+0000 7fbbcffff700 1 -- 172.21.15.146:0/773579479 learned_addr learned my addr 172.21.15.146:0/773579479 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:26.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.875+0000 7fbbcf7fe700 1 --2- 172.21.15.146:0/773579479 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbbd0099e20 0x7fbbd009a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.875+0000 7fbbceffd700 1 --2- 172.21.15.146:0/773579479 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbbd009a730 0x7fbbd0130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.875+0000 7fbbcffff700 1 -- 172.21.15.146:0/773579479 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbbd0099e20 msgr2=0x7fbbd009a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:26.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.875+0000 7fbbcffff700 1 --2- 172.21.15.146:0/773579479 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbbd0099e20 0x7fbbd009a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.875+0000 7fbbcffff700 1 -- 172.21.15.146:0/773579479 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbbd009a730 msgr2=0x7fbbd0130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:26.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.875+0000 7fbbcffff700 1 --2- 172.21.15.146:0/773579479 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbbd009a730 0x7fbbd0130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.875+0000 7fbbcffff700 1 -- 172.21.15.146:0/773579479 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd009bb90 con 0x7fbbd0130890 2023-10-03T10:12:26.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.875+0000 7fbbcf7fe700 1 --2- 172.21.15.146:0/773579479 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbbd0099e20 0x7fbbd009a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:26.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.875+0000 7fbbcffff700 1 --2- 172.21.15.146:0/773579479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbd0130890 0x7fbbd0130d00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8009e80 tx=0x7fbbc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216228cd614157cc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.875+0000 7fbbce7fc700 1 -- 172.21.15.146:0/773579479 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc800e070 con 0x7fbbd0130890 2023-10-03T10:12:26.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.875+0000 7fbbce7fc700 1 -- 172.21.15.146:0/773579479 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc800b8d0 con 0x7fbbd0130890 2023-10-03T10:12:26.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.875+0000 7fbbce7fc700 1 -- 172.21.15.146:0/773579479 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc800bc80 con 0x7fbbd0130890 2023-10-03T10:12:26.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.876+0000 7fbbd6236700 1 -- 172.21.15.146:0/773579479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbd0130890 msgr2=0x7fbbd0130d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.876+0000 7fbbd6236700 1 --2- 172.21.15.146:0/773579479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbd0130890 0x7fbbd0130d00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8009e80 tx=0x7fbbc800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:26.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.876+0000 7fbbd6236700 1 -- 172.21.15.146:0/773579479 shutdown_connections 2023-10-03T10:12:26.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.876+0000 7fbbd6236700 1 --2- 172.21.15.146:0/773579479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbd0130890 0x7fbbd0130d00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.876+0000 7fbbd6236700 1 --2- 172.21.15.146:0/773579479 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbbd0099e20 0x7fbbd009a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.876+0000 7fbbd6236700 1 --2- 172.21.15.146:0/773579479 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbbd009a730 0x7fbbd0130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.876+0000 7fbbd6236700 1 -- 172.21.15.146:0/773579479 >> 172.21.15.146:0/773579479 conn(0x7fbbd00a2980 msgr2=0x7fbbd00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.876+0000 7fbbd6236700 1 -- 172.21.15.146:0/773579479 shutdown_connections 2023-10-03T10:12:26.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.876+0000 7fbbd6236700 1 -- 172.21.15.146:0/773579479 wait complete. 2023-10-03T10:12:26.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.877+0000 7fbbd6236700 1 Processor -- start 2023-10-03T10:12:26.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.877+0000 7fbbd6236700 1 -- start start 2023-10-03T10:12:26.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.878+0000 7fbbd6236700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbbd0099e20 0x7fbbd011a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.878+0000 7fbbd6236700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbd009a730 0x7fbbd011ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.878+0000 7fbbd6236700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbbd0130890 0x7fbbd011b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.878+0000 7fbbd6236700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd011c2f0 con 0x7fbbd009a730 2023-10-03T10:12:26.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.878+0000 7fbbd6236700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd012fcc0 con 0x7fbbd0130890 2023-10-03T10:12:26.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.878+0000 7fbbd6236700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd009b470 con 0x7fbbd0099e20 2023-10-03T10:12:26.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.878+0000 7fbbcf7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbbd0099e20 0x7fbbd011a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.878+0000 7fbbcf7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbbd0099e20 0x7fbbd011a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49558/0 (socket says 172.21.15.146:49558) 2023-10-03T10:12:26.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.878+0000 7fbbcf7fe700 1 -- 172.21.15.146:0/4117172229 learned_addr learned my addr 172.21.15.146:0/4117172229 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:26.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.878+0000 7fbbcffff700 1 --2- 172.21.15.146:0/4117172229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbbd0130890 0x7fbbd011b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.878+0000 7fbbcffff700 1 -- 172.21.15.146:0/4117172229 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbbd0099e20 msgr2=0x7fbbd011a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.878+0000 7fbbcffff700 1 --2- 172.21.15.146:0/4117172229 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbbd0099e20 0x7fbbd011a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.878+0000 7fbbcffff700 1 -- 172.21.15.146:0/4117172229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbd009a730 msgr2=0x7fbbd011ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.878+0000 7fbbcffff700 1 --2- 172.21.15.146:0/4117172229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbd009a730 0x7fbbd011ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.878+0000 7fbbcffff700 1 -- 172.21.15.146:0/4117172229 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc0009430 con 0x7fbbd0130890 2023-10-03T10:12:26.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.878+0000 7fbbcffff700 1 --2- 172.21.15.146:0/4117172229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbbd0130890 0x7fbbd011b1b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8015000 tx=0x7fbbc8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.879+0000 7fbbb7fff700 1 -- 172.21.15.146:0/4117172229 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc8004450 con 0x7fbbd0130890 2023-10-03T10:12:26.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.879+0000 7fbbb7fff700 1 -- 172.21.15.146:0/4117172229 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc80045f0 con 0x7fbbd0130890 2023-10-03T10:12:26.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.879+0000 7fbbb7fff700 1 -- 172.21.15.146:0/4117172229 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc8003e10 con 0x7fbbd0130890 2023-10-03T10:12:26.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.879+0000 7fbbd6236700 1 -- 172.21.15.146:0/4117172229 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc8009b30 con 0x7fbbd0130890 2023-10-03T10:12:26.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.879+0000 7fbbd6236700 1 -- 172.21.15.146:0/4117172229 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd011ca40 con 0x7fbbd0130890 2023-10-03T10:12:26.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.880+0000 7fbbd6236700 1 -- 172.21.15.146:0/4117172229 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd0070740 con 0x7fbbd0130890 2023-10-03T10:12:26.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.881+0000 7fbbb7fff700 1 -- 172.21.15.146:0/4117172229 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbbc802f480 con 0x7fbbd0130890 2023-10-03T10:12:26.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.881+0000 7fbbb7fff700 1 -- 172.21.15.146:0/4117172229 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fbbc8041740 con 0x7fbbd0130890 2023-10-03T10:12:26.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.881+0000 7fbbcf7fe700 1 -- 172.21.15.146:0/4117172229 >> v1:172.21.15.146:6816/126749 conn(0x7fbbbc02f510 legacy=0x7fbbbc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:26.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.885+0000 7fbbb7fff700 1 -- 172.21.15.146:0/4117172229 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbbc802e3e0 con 0x7fbbd0130890 2023-10-03T10:12:26.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.945+0000 7f716c2d6700 1 Processor -- start 2023-10-03T10:12:26.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.945+0000 7f716c2d6700 1 -- start start 2023-10-03T10:12:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.946+0000 7f716c2d6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71641346e0 0x7f7164136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.946+0000 7f716c2d6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7164137000 0x7f71641393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.946+0000 7f716c2d6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71640a1640 con 0x7f7164131980 2023-10-03T10:12:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.946+0000 7f716c2d6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716406eb30 con 0x7f7164137000 2023-10-03T10:12:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.946+0000 7f716c2d6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71640a22d0 con 0x7f71641346e0 2023-10-03T10:12:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.946+0000 7f716a873700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7164137000 0x7f71641393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.946+0000 7f716a072700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7164131980 0x7f7164131d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35200/0 (socket says 172.21.15.146:35200) 2023-10-03T10:12:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.946+0000 7f716a072700 1 -- 172.21.15.146:0/3944083867 learned_addr learned my addr 172.21.15.146:0/3944083867 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.946+0000 7f7169871700 1 --2- 172.21.15.146:0/3944083867 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71641346e0 0x7f7164136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.947+0000 7f716a873700 1 -- 172.21.15.146:0/3944083867 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71641346e0 msgr2=0x7f7164136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.947+0000 7f716a873700 1 --2- 172.21.15.146:0/3944083867 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71641346e0 0x7f7164136ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.947+0000 7f716a873700 1 -- 172.21.15.146:0/3944083867 >> v1:172.21.15.146:6789/0 conn(0x7f7164131980 legacy=0x7f7164131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.947+0000 7f7169070700 1 -- 172.21.15.146:0/3944083867 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3894180580 0 0) 0x7f71640a1640 con 0x7f7164131980 2023-10-03T10:12:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.947+0000 7f716a873700 1 -- 172.21.15.146:0/3944083867 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7164131550 con 0x7f7164137000 2023-10-03T10:12:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.947+0000 7f716a873700 1 --2- 172.21.15.146:0/3944083867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7164137000 0x7f71641393e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f715c009dc0 tx=0x7f715c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8668e07705301cd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.947+0000 7f7169070700 1 -- 172.21.15.146:0/3944083867 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c00e070 con 0x7f7164137000 2023-10-03T10:12:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.947+0000 7f7169070700 1 -- 172.21.15.146:0/3944083867 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715c00bb20 con 0x7f7164137000 2023-10-03T10:12:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.947+0000 7f7169070700 1 -- 172.21.15.146:0/3944083867 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c012430 con 0x7f7164137000 2023-10-03T10:12:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.948+0000 7f716c2d6700 1 -- 172.21.15.146:0/3944083867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7164137000 msgr2=0x7f71641393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.948+0000 7f716c2d6700 1 --2- 172.21.15.146:0/3944083867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7164137000 0x7f71641393e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f715c009dc0 tx=0x7f715c00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.948+0000 7f716c2d6700 1 -- 172.21.15.146:0/3944083867 shutdown_connections 2023-10-03T10:12:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.948+0000 7f716c2d6700 1 --2- 172.21.15.146:0/3944083867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7164137000 0x7f71641393e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.948+0000 7f716c2d6700 1 --2- 172.21.15.146:0/3944083867 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71641346e0 0x7f7164136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.948+0000 7f716c2d6700 1 -- 172.21.15.146:0/3944083867 >> 172.21.15.146:0/3944083867 conn(0x7f71640a2980 msgr2=0x7f71640a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.948+0000 7f716c2d6700 1 -- 172.21.15.146:0/3944083867 shutdown_connections 2023-10-03T10:12:26.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.948+0000 7f716c2d6700 1 -- 172.21.15.146:0/3944083867 wait complete. 2023-10-03T10:12:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.949+0000 7f716c2d6700 1 Processor -- start 2023-10-03T10:12:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.950+0000 7f716c2d6700 1 -- start start 2023-10-03T10:12:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.950+0000 7f716c2d6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7164131980 0x7f716409a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.950+0000 7f716c2d6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71641346e0 0x7f716409ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.950+0000 7f716c2d6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7164137000 0x7f716409b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.950+0000 7f716c2d6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7164119060 con 0x7f7164131980 2023-10-03T10:12:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.950+0000 7f716c2d6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716412efc0 con 0x7f71641346e0 2023-10-03T10:12:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.950+0000 7f716c2d6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71641302e0 con 0x7f7164137000 2023-10-03T10:12:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.950+0000 7f7169871700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71641346e0 0x7f716409ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.950+0000 7f7169871700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71641346e0 0x7f716409ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49934/0 (socket says 172.21.15.146:49934) 2023-10-03T10:12:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.950+0000 7f7169871700 1 -- 172.21.15.146:0/3768163251 learned_addr learned my addr 172.21.15.146:0/3768163251 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.950+0000 7f716a873700 1 --2- 172.21.15.146:0/3768163251 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7164137000 0x7f716409b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.950+0000 7f716a072700 1 --2- 172.21.15.146:0/3768163251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7164131980 0x7f716409a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.951+0000 7f716a873700 1 -- 172.21.15.146:0/3768163251 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71641346e0 msgr2=0x7f716409ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.951+0000 7f716a873700 1 --2- 172.21.15.146:0/3768163251 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71641346e0 0x7f716409ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.951+0000 7f716a873700 1 -- 172.21.15.146:0/3768163251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7164131980 msgr2=0x7f716409a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.951+0000 7f716a873700 1 --2- 172.21.15.146:0/3768163251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7164131980 0x7f716409a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.951+0000 7f716a873700 1 -- 172.21.15.146:0/3768163251 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715c009a70 con 0x7f7164137000 2023-10-03T10:12:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.951+0000 7f716a873700 1 --2- 172.21.15.146:0/3768163251 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7164137000 0x7f716409b3a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f715c016000 tx=0x7f715c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.951+0000 7f715affd700 1 -- 172.21.15.146:0/3768163251 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c012430 con 0x7f7164137000 2023-10-03T10:12:26.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.951+0000 7f715affd700 1 -- 172.21.15.146:0/3768163251 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715c020070 con 0x7f7164137000 2023-10-03T10:12:26.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.951+0000 7f716c2d6700 1 -- 172.21.15.146:0/3768163251 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716411a6a0 con 0x7f7164137000 2023-10-03T10:12:26.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.951+0000 7f716c2d6700 1 -- 172.21.15.146:0/3768163251 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716409c4e0 con 0x7f7164137000 2023-10-03T10:12:26.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.951+0000 7f715affd700 1 -- 172.21.15.146:0/3768163251 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c004280 con 0x7f7164137000 2023-10-03T10:12:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.953+0000 7f7158ff9700 1 -- 172.21.15.146:0/3768163251 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71400052e0 con 0x7f7164137000 2023-10-03T10:12:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.953+0000 7f715affd700 1 -- 172.21.15.146:0/3768163251 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f715c0043e0 con 0x7f7164137000 2023-10-03T10:12:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.953+0000 7f715affd700 1 -- 172.21.15.146:0/3768163251 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f715c022070 con 0x7f7164137000 2023-10-03T10:12:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.953+0000 7f716a072700 1 -- 172.21.15.146:0/3768163251 >> v1:172.21.15.146:6816/126749 conn(0x7f714802f560 legacy=0x7f7148031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.958+0000 7f715affd700 1 -- 172.21.15.146:0/3768163251 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f715c011d60 con 0x7f7164137000 2023-10-03T10:12:26.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.968+0000 7f1828f0e700 1 Processor -- start 2023-10-03T10:12:26.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.968+0000 7f1828f0e700 1 -- start start 2023-10-03T10:12:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.969+0000 7f1828f0e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18241346e0 0x7f1824136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.969+0000 7f1828f0e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1824137000 0x7f18241393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.969+0000 7f1828f0e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18240a1640 con 0x7f1824131980 2023-10-03T10:12:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.969+0000 7f1828f0e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182406eb30 con 0x7f1824137000 2023-10-03T10:12:26.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.969+0000 7f1828f0e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18240a22d0 con 0x7f18241346e0 2023-10-03T10:12:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.969+0000 7f182259c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1824131980 0x7f1824131d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35216/0 (socket says 172.21.15.146:35216) 2023-10-03T10:12:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.969+0000 7f182259c700 1 -- 172.21.15.146:0/4291393890 learned_addr learned my addr 172.21.15.146:0/4291393890 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.970+0000 7f1821d9b700 1 --2- 172.21.15.146:0/4291393890 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18241346e0 0x7f1824136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.970+0000 7f1822d9d700 1 --2- 172.21.15.146:0/4291393890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1824137000 0x7f18241393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.970+0000 7f1821d9b700 1 -- 172.21.15.146:0/4291393890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1824137000 msgr2=0x7f18241393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.970+0000 7f1821d9b700 1 --2- 172.21.15.146:0/4291393890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1824137000 0x7f18241393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.970+0000 7f1821d9b700 1 -- 172.21.15.146:0/4291393890 >> v1:172.21.15.146:6789/0 conn(0x7f1824131980 legacy=0x7f1824131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.970+0000 7f182159a700 1 -- 172.21.15.146:0/4291393890 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328634062 0 0) 0x7f18240a1640 con 0x7f1824131980 2023-10-03T10:12:26.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.970+0000 7f1821d9b700 1 -- 172.21.15.146:0/4291393890 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1824131550 con 0x7f18241346e0 2023-10-03T10:12:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.970+0000 7f1822d9d700 1 --2- 172.21.15.146:0/4291393890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1824137000 0x7f18241393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.970+0000 7f1821d9b700 1 --2- 172.21.15.146:0/4291393890 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18241346e0 0x7f1824136ac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1818009870 tx=0x7f1818009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb42cc214fc7fa0d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.970+0000 7f182159a700 1 -- 172.21.15.146:0/4291393890 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1818011830 con 0x7f18241346e0 2023-10-03T10:12:26.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.970+0000 7f182159a700 1 -- 172.21.15.146:0/4291393890 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1818011990 con 0x7f18241346e0 2023-10-03T10:12:26.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.970+0000 7f182159a700 1 -- 172.21.15.146:0/4291393890 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1818011d20 con 0x7f18241346e0 2023-10-03T10:12:26.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.971+0000 7f1828f0e700 1 -- 172.21.15.146:0/4291393890 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18241346e0 msgr2=0x7f1824136ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.971+0000 7f1828f0e700 1 --2- 172.21.15.146:0/4291393890 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18241346e0 0x7f1824136ac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1818009870 tx=0x7f1818009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:26.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.971+0000 7f1828f0e700 1 -- 172.21.15.146:0/4291393890 shutdown_connections 2023-10-03T10:12:26.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.971+0000 7f1828f0e700 1 --2- 172.21.15.146:0/4291393890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1824137000 0x7f18241393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.971+0000 7f1828f0e700 1 --2- 172.21.15.146:0/4291393890 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18241346e0 0x7f1824136ac0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.971+0000 7f1828f0e700 1 -- 172.21.15.146:0/4291393890 >> 172.21.15.146:0/4291393890 conn(0x7f18240a2980 msgr2=0x7f18240a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.972+0000 7f1828f0e700 1 -- 172.21.15.146:0/4291393890 shutdown_connections 2023-10-03T10:12:26.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.972+0000 7f1828f0e700 1 -- 172.21.15.146:0/4291393890 wait complete. 2023-10-03T10:12:26.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.973+0000 7f1828f0e700 1 Processor -- start 2023-10-03T10:12:26.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.973+0000 7f1828f0e700 1 -- start start 2023-10-03T10:12:26.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.974+0000 7f1828f0e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1824131980 0x7f182406fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.974+0000 7f1828f0e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18241346e0 0x7f1824070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.974+0000 7f1828f0e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1824137000 0x7f1824070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.974+0000 7f1828f0e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1824118ef0 con 0x7f1824137000 2023-10-03T10:12:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.974+0000 7f1828f0e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182411a830 con 0x7f18241346e0 2023-10-03T10:12:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.974+0000 7f1828f0e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18240a1c40 con 0x7f1824131980 2023-10-03T10:12:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.974+0000 7f182259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1824131980 0x7f182406fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.974+0000 7f182259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1824131980 0x7f182406fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49592/0 (socket says 172.21.15.146:49592) 2023-10-03T10:12:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.974+0000 7f182259c700 1 -- 172.21.15.146:0/1352935585 learned_addr learned my addr 172.21.15.146:0/1352935585 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.974+0000 7f1821d9b700 1 --2- 172.21.15.146:0/1352935585 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18241346e0 0x7f1824070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.974+0000 7f182259c700 1 -- 172.21.15.146:0/1352935585 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18241346e0 msgr2=0x7f1824070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.974+0000 7f182259c700 1 --2- 172.21.15.146:0/1352935585 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18241346e0 0x7f1824070330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.974+0000 7f182259c700 1 -- 172.21.15.146:0/1352935585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1824137000 msgr2=0x7f1824070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.974+0000 7f182259c700 1 --2- 172.21.15.146:0/1352935585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1824137000 0x7f1824070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.974+0000 7f182259c700 1 -- 172.21.15.146:0/1352935585 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c009a70 con 0x7f1824131980 2023-10-03T10:12:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.974+0000 7f1821d9b700 1 --2- 172.21.15.146:0/1352935585 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18241346e0 0x7f1824070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.975+0000 7f182259c700 1 --2- 172.21.15.146:0/1352935585 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1824131980 0x7f182406fdf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f181400c6d0 tx=0x7f181400ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.975+0000 7f1812ffd700 1 -- 172.21.15.146:0/1352935585 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18140074e0 con 0x7f1824131980 2023-10-03T10:12:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.975+0000 7f1812ffd700 1 -- 172.21.15.146:0/1352935585 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1814007640 con 0x7f1824131980 2023-10-03T10:12:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.975+0000 7f1812ffd700 1 -- 172.21.15.146:0/1352935585 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1814005a70 con 0x7f1824131980 2023-10-03T10:12:26.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.975+0000 7f1828f0e700 1 -- 172.21.15.146:0/1352935585 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18180094a0 con 0x7f1824131980 2023-10-03T10:12:26.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.975+0000 7f1828f0e700 1 -- 172.21.15.146:0/1352935585 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1824119070 con 0x7f1824131980 2023-10-03T10:12:26.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.976+0000 7f1812ffd700 1 -- 172.21.15.146:0/1352935585 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1814005bd0 con 0x7f1824131980 2023-10-03T10:12:26.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.976+0000 7f1828f0e700 1 -- 172.21.15.146:0/1352935585 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182411a100 con 0x7f1824131980 2023-10-03T10:12:26.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.976+0000 7f1812ffd700 1 -- 172.21.15.146:0/1352935585 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f181403f1d0 con 0x7f1824131980 2023-10-03T10:12:26.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.977+0000 7f1821d9b700 1 -- 172.21.15.146:0/1352935585 >> v1:172.21.15.146:6816/126749 conn(0x7f180402f510 legacy=0x7f18040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:26.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:26.981+0000 7f1812ffd700 1 -- 172.21.15.146:0/1352935585 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f181400e280 con 0x7f1824131980 2023-10-03T10:12:27.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.024+0000 7fc5ee2f0700 1 -- 172.21.15.146:0/3559301285 >> v1:172.21.15.146:6816/126749 conn(0x7fc5cc02f510 legacy=0x7fc5cc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:27.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.037+0000 7fc5f0554700 1 -- 172.21.15.146:0/3559301285 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc5e806c3b0 con 0x7fc5e8133ad0 2023-10-03T10:12:27.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.037+0000 7fc5deffd700 1 -- 172.21.15.146:0/3559301285 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc5e00122e0 con 0x7fc5e8133ad0 2023-10-03T10:12:27.038 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:27.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.039+0000 7fc5f0554700 1 -- 172.21.15.146:0/3559301285 >> v1:172.21.15.146:6816/126749 conn(0x7fc5cc02f510 legacy=0x7fc5cc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:27.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.040+0000 7fc5f0554700 1 -- 172.21.15.146:0/3559301285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5e8133ad0 msgr2=0x7fc5e811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.040+0000 7fc5f0554700 1 --2- 172.21.15.146:0/3559301285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5e8133ad0 0x7fc5e811e4c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0007d90 tx=0x7fc5e000e3c0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.040+0000 7fc5f0554700 1 -- 172.21.15.146:0/3559301285 shutdown_connections 2023-10-03T10:12:27.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.040+0000 7fc5f0554700 1 --2- 172.21.15.146:0/3559301285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5e8133ad0 0x7fc5e811e4c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.040+0000 7fc5f0554700 1 --2- 172.21.15.146:0/3559301285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5e81300a0 0x7fc5e811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.040+0000 7fc5f0554700 1 --2- 172.21.15.146:0/3559301285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5e81309f0 0x7fc5e811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.040+0000 7fc5f0554700 1 -- 172.21.15.146:0/3559301285 >> 172.21.15.146:0/3559301285 conn(0x7fc5e8099c40 msgr2=0x7fc5e8132cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:27.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.040+0000 7fc5f0554700 1 -- 172.21.15.146:0/3559301285 shutdown_connections 2023-10-03T10:12:27.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.040+0000 7fc5f0554700 1 -- 172.21.15.146:0/3559301285 wait complete. 2023-10-03T10:12:27.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:27.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.082+0000 7fbbcf7fe700 1 -- 172.21.15.146:0/4117172229 >> v1:172.21.15.146:6816/126749 conn(0x7fbbbc02f510 legacy=0x7fbbbc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:27.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.088+0000 7fbbd6236700 1 -- 172.21.15.146:0/4117172229 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbbd004f2a0 con 0x7fbbd0130890 2023-10-03T10:12:27.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.089+0000 7fbbb7fff700 1 -- 172.21.15.146:0/4117172229 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbbc802a090 con 0x7fbbd0130890 2023-10-03T10:12:27.090 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:27.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.091+0000 7fbbd6236700 1 -- 172.21.15.146:0/4117172229 >> v1:172.21.15.146:6816/126749 conn(0x7fbbbc02f510 legacy=0x7fbbbc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:27.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.091+0000 7fbbd6236700 1 -- 172.21.15.146:0/4117172229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbbd0130890 msgr2=0x7fbbd011b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.091+0000 7fbbd6236700 1 --2- 172.21.15.146:0/4117172229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbbd0130890 0x7fbbd011b1b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8015000 tx=0x7fbbc8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.091+0000 7fbbd6236700 1 -- 172.21.15.146:0/4117172229 shutdown_connections 2023-10-03T10:12:27.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.091+0000 7fbbd6236700 1 --2- 172.21.15.146:0/4117172229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbbd0130890 0x7fbbd011b1b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.091+0000 7fbbd6236700 1 --2- 172.21.15.146:0/4117172229 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbbd0099e20 0x7fbbd011a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.091+0000 7fbbd6236700 1 --2- 172.21.15.146:0/4117172229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbd009a730 0x7fbbd011ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.091+0000 7fbbd6236700 1 -- 172.21.15.146:0/4117172229 >> 172.21.15.146:0/4117172229 conn(0x7fbbd00a2980 msgr2=0x7fbbd012d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:27.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.091+0000 7fbbd6236700 1 -- 172.21.15.146:0/4117172229 shutdown_connections 2023-10-03T10:12:27.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.091+0000 7fbbd6236700 1 -- 172.21.15.146:0/4117172229 wait complete. 2023-10-03T10:12:27.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:27.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.154+0000 7f716a072700 1 -- 172.21.15.146:0/3768163251 >> v1:172.21.15.146:6816/126749 conn(0x7f714802f560 legacy=0x7f7148031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:27.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.156+0000 7f7158ff9700 1 -- 172.21.15.146:0/3768163251 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7140005860 con 0x7f7164137000 2023-10-03T10:12:27.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.156+0000 7f715affd700 1 -- 172.21.15.146:0/3768163251 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f715c011b80 con 0x7f7164137000 2023-10-03T10:12:27.157 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.159+0000 7f7158ff9700 1 -- 172.21.15.146:0/3768163251 >> v1:172.21.15.146:6816/126749 conn(0x7f714802f560 legacy=0x7f7148031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.159+0000 7f7158ff9700 1 -- 172.21.15.146:0/3768163251 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7164137000 msgr2=0x7f716409b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.159+0000 7f7158ff9700 1 --2- 172.21.15.146:0/3768163251 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7164137000 0x7f716409b3a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f715c016000 tx=0x7f715c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.159+0000 7f7158ff9700 1 -- 172.21.15.146:0/3768163251 shutdown_connections 2023-10-03T10:12:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.159+0000 7f7158ff9700 1 --2- 172.21.15.146:0/3768163251 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7164137000 0x7f716409b3a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.159+0000 7f7158ff9700 1 --2- 172.21.15.146:0/3768163251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7164131980 0x7f716409a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.159+0000 7f7158ff9700 1 --2- 172.21.15.146:0/3768163251 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71641346e0 0x7f716409ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.159+0000 7f7158ff9700 1 -- 172.21.15.146:0/3768163251 >> 172.21.15.146:0/3768163251 conn(0x7f71640a2980 msgr2=0x7f716412f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:27.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.159+0000 7f7158ff9700 1 -- 172.21.15.146:0/3768163251 shutdown_connections 2023-10-03T10:12:27.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.159+0000 7f7158ff9700 1 -- 172.21.15.146:0/3768163251 wait complete. 2023-10-03T10:12:27.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:27.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.177+0000 7f1828f0e700 1 -- 172.21.15.146:0/1352935585 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f182404f2a0 con 0x7f1824131980 2023-10-03T10:12:27.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.177+0000 7f1812ffd700 1 -- 172.21.15.146:0/1352935585 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1814017020 con 0x7f1824131980 2023-10-03T10:12:27.178 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:27.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.178+0000 7f1821d9b700 1 -- 172.21.15.146:0/1352935585 >> v1:172.21.15.146:6816/126749 conn(0x7f180402f510 legacy=0x7f18040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.179+0000 7f1828f0e700 1 -- 172.21.15.146:0/1352935585 >> v1:172.21.15.146:6816/126749 conn(0x7f180402f510 legacy=0x7f18040319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.179+0000 7f1828f0e700 1 -- 172.21.15.146:0/1352935585 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1824131980 msgr2=0x7f182406fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.179+0000 7f1828f0e700 1 --2- 172.21.15.146:0/1352935585 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1824131980 0x7f182406fdf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f181400c6d0 tx=0x7f181400ca90 comp rx=0 tx=0).stop 2023-10-03T10:12:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.179+0000 7f1828f0e700 1 -- 172.21.15.146:0/1352935585 shutdown_connections 2023-10-03T10:12:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.179+0000 7f1828f0e700 1 --2- 172.21.15.146:0/1352935585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1824137000 0x7f1824070870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.179+0000 7f1828f0e700 1 --2- 172.21.15.146:0/1352935585 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1824131980 0x7f182406fdf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.179+0000 7f1828f0e700 1 --2- 172.21.15.146:0/1352935585 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18241346e0 0x7f1824070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.179+0000 7f1828f0e700 1 -- 172.21.15.146:0/1352935585 >> 172.21.15.146:0/1352935585 conn(0x7f18240a2980 msgr2=0x7f1824133560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:27.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.179+0000 7f1828f0e700 1 -- 172.21.15.146:0/1352935585 shutdown_connections 2023-10-03T10:12:27.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:27.179+0000 7f1828f0e700 1 -- 172.21.15.146:0/1352935585 wait complete. 2023-10-03T10:12:27.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:28.054 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:28.104 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:28.172 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:28.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.189+0000 7f4045d9b700 1 Processor -- start 2023-10-03T10:12:28.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.189+0000 7f4045d9b700 1 -- start start 2023-10-03T10:12:28.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.190+0000 7f4045d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4040131980 0x7f4040131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.190+0000 7f4045d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f404009bc70 0x7f404009c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.190+0000 7f4045d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f404009c5c0 0x7f4040138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.190+0000 7f4045d9b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404006eb30 con 0x7f404009bc70 2023-10-03T10:12:28.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.190+0000 7f4045d9b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40400a1640 con 0x7f4040131980 2023-10-03T10:12:28.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.190+0000 7f4045d9b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40400a22d0 con 0x7f404009c5c0 2023-10-03T10:12:28.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.190+0000 7f403f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4040131980 0x7f4040131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.190+0000 7f403effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f404009bc70 0x7f404009c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.190+0000 7f403f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4040131980 0x7f4040131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49972/0 (socket says 172.21.15.146:49972) 2023-10-03T10:12:28.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.190+0000 7f403f7fe700 1 -- 172.21.15.146:0/1467700134 learned_addr learned my addr 172.21.15.146:0/1467700134 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:28.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.190+0000 7f403ffff700 1 --2- 172.21.15.146:0/1467700134 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f404009c5c0 0x7f4040138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.190+0000 7f403effd700 1 -- 172.21.15.146:0/1467700134 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f404009c5c0 msgr2=0x7f4040138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:28.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.190+0000 7f403effd700 1 --2- 172.21.15.146:0/1467700134 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f404009c5c0 0x7f4040138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.190+0000 7f403effd700 1 -- 172.21.15.146:0/1467700134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4040131980 msgr2=0x7f4040131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:28.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.190+0000 7f403effd700 1 --2- 172.21.15.146:0/1467700134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4040131980 0x7f4040131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.190+0000 7f403effd700 1 -- 172.21.15.146:0/1467700134 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4040131550 con 0x7f404009bc70 2023-10-03T10:12:28.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.190+0000 7f403ffff700 1 --2- 172.21.15.146:0/1467700134 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f404009c5c0 0x7f4040138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:28.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.190+0000 7f403f7fe700 1 --2- 172.21.15.146:0/1467700134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4040131980 0x7f4040131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:28.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.190+0000 7f403effd700 1 --2- 172.21.15.146:0/1467700134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f404009bc70 0x7f404009c080 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f403400dc90 tx=0x7f403400f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9a48c3e1d6aadb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:28.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.190+0000 7f403e7fc700 1 -- 172.21.15.146:0/1467700134 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4034012070 con 0x7f404009bc70 2023-10-03T10:12:28.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.191+0000 7f403e7fc700 1 -- 172.21.15.146:0/1467700134 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403400d2e0 con 0x7f404009bc70 2023-10-03T10:12:28.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.191+0000 7f403e7fc700 1 -- 172.21.15.146:0/1467700134 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403400f8b0 con 0x7f404009bc70 2023-10-03T10:12:28.194 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.191+0000 7f4045d9b700 1 -- 172.21.15.146:0/1467700134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f404009bc70 msgr2=0x7f404009c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.191+0000 7f4045d9b700 1 --2- 172.21.15.146:0/1467700134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f404009bc70 0x7f404009c080 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f403400dc90 tx=0x7f403400f050 comp rx=0 tx=0).stop 2023-10-03T10:12:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.191+0000 7f4045d9b700 1 -- 172.21.15.146:0/1467700134 shutdown_connections 2023-10-03T10:12:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.191+0000 7f4045d9b700 1 --2- 172.21.15.146:0/1467700134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4040131980 0x7f4040131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.191+0000 7f4045d9b700 1 --2- 172.21.15.146:0/1467700134 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f404009c5c0 0x7f4040138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.191+0000 7f4045d9b700 1 --2- 172.21.15.146:0/1467700134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f404009bc70 0x7f404009c080 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.191+0000 7f4045d9b700 1 -- 172.21.15.146:0/1467700134 >> 172.21.15.146:0/1467700134 conn(0x7f40400a2980 msgr2=0x7f40400a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.191+0000 7f4045d9b700 1 -- 172.21.15.146:0/1467700134 shutdown_connections 2023-10-03T10:12:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.191+0000 7f4045d9b700 1 -- 172.21.15.146:0/1467700134 wait complete. 2023-10-03T10:12:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.192+0000 7f4045d9b700 1 Processor -- start 2023-10-03T10:12:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.193+0000 7f4045d9b700 1 -- start start 2023-10-03T10:12:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.193+0000 7f4045d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f404009bc70 0x7f404011b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.193+0000 7f4045d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f404009c5c0 0x7f404011bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.193+0000 7f4045d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4040131980 0x7f404011c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.193+0000 7f4045d9b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404011d850 con 0x7f4040131980 2023-10-03T10:12:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.193+0000 7f4045d9b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404011f110 con 0x7f404009bc70 2023-10-03T10:12:28.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.193+0000 7f4045d9b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f404011e4e0 con 0x7f404009c5c0 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.194+0000 7f403effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f404009c5c0 0x7f404011bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.194+0000 7f403effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f404009c5c0 0x7f404011bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49600/0 (socket says 172.21.15.146:49600) 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.194+0000 7f403ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4040131980 0x7f404011c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.194+0000 7f403effd700 1 -- 172.21.15.146:0/173323886 learned_addr learned my addr 172.21.15.146:0/173323886 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.194+0000 7f403f7fe700 1 --2- 172.21.15.146:0/173323886 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f404009bc70 0x7f404011b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.194+0000 7f403effd700 1 -- 172.21.15.146:0/173323886 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f404009bc70 msgr2=0x7f404011b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.194+0000 7f403effd700 1 --2- 172.21.15.146:0/173323886 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f404009bc70 0x7f404011b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.194+0000 7f403effd700 1 -- 172.21.15.146:0/173323886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4040131980 msgr2=0x7f404011c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.194+0000 7f403effd700 1 --2- 172.21.15.146:0/173323886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4040131980 0x7f404011c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.194+0000 7f403effd700 1 -- 172.21.15.146:0/173323886 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4038009a70 con 0x7f404009c5c0 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.194+0000 7f403effd700 1 --2- 172.21.15.146:0/173323886 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f404009c5c0 0x7f404011bb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4034016000 tx=0x7f4034004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:28.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.194+0000 7f4027fff700 1 -- 172.21.15.146:0/173323886 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403400f6b0 con 0x7f404009c5c0 2023-10-03T10:12:28.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.194+0000 7f4027fff700 1 -- 172.21.15.146:0/173323886 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403400f830 con 0x7f404009c5c0 2023-10-03T10:12:28.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.194+0000 7f4027fff700 1 -- 172.21.15.146:0/173323886 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403400fbe0 con 0x7f404009c5c0 2023-10-03T10:12:28.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.194+0000 7f4045d9b700 1 -- 172.21.15.146:0/173323886 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4030009500 con 0x7f404009c5c0 2023-10-03T10:12:28.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.194+0000 7f4045d9b700 1 -- 172.21.15.146:0/173323886 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403400d940 con 0x7f404009c5c0 2023-10-03T10:12:28.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.195+0000 7f4027fff700 1 -- 172.21.15.146:0/173323886 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f403400fd40 con 0x7f404009c5c0 2023-10-03T10:12:28.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.195+0000 7f4045d9b700 1 -- 172.21.15.146:0/173323886 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f404009f9c0 con 0x7f404009c5c0 2023-10-03T10:12:28.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.195+0000 7f4027fff700 1 -- 172.21.15.146:0/173323886 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f40340453c0 con 0x7f404009c5c0 2023-10-03T10:12:28.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.195+0000 7f403f7fe700 1 -- 172.21.15.146:0/173323886 >> v1:172.21.15.146:6816/126749 conn(0x7f402c02f510 legacy=0x7f402c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:28.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.201+0000 7f4027fff700 1 -- 172.21.15.146:0/173323886 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f40340157a0 con 0x7f404009c5c0 2023-10-03T10:12:28.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.252+0000 7fc3e4d16700 1 Processor -- start 2023-10-03T10:12:28.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.252+0000 7fc3e4d16700 1 -- start start 2023-10-03T10:12:28.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.253+0000 7fc3e4d16700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3e00a1510 0x7fc3e01351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.253+0000 7fc3e4d16700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc3e01356e0 0x7fc3e0137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.253+0000 7fc3e4d16700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e00a1e70 con 0x7fc3e00a0a30 2023-10-03T10:12:28.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.253+0000 7fc3e4d16700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e009a720 con 0x7fc3e01356e0 2023-10-03T10:12:28.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.253+0000 7fc3e4d16700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e009b300 con 0x7fc3e00a1510 2023-10-03T10:12:28.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.253+0000 7fc3de59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc3e00a0a30 0x7fc3e00a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35224/0 (socket says 172.21.15.146:35224) 2023-10-03T10:12:28.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.253+0000 7fc3de59c700 1 -- 172.21.15.146:0/1247285361 learned_addr learned my addr 172.21.15.146:0/1247285361 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:28.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.253+0000 7fc3ded9d700 1 --2- 172.21.15.146:0/1247285361 >> v2:172.21.15.146:3300/0 conn(0x7fc3e01356e0 0x7fc3e0137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.253+0000 7fc3ded9d700 1 -- 172.21.15.146:0/1247285361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3e00a1510 msgr2=0x7fc3e01351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:28.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.253+0000 7fc3ded9d700 1 --2- 172.21.15.146:0/1247285361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3e00a1510 0x7fc3e01351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.253+0000 7fc3ded9d700 1 -- 172.21.15.146:0/1247285361 >> v1:172.21.15.146:6789/0 conn(0x7fc3e00a0a30 legacy=0x7fc3e00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.253+0000 7fc3dd59a700 1 -- 172.21.15.146:0/1247285361 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167886030 0 0) 0x7fc3e00a1e70 con 0x7fc3e00a0a30 2023-10-03T10:12:28.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.253+0000 7fc3ded9d700 1 -- 172.21.15.146:0/1247285361 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e009abc0 con 0x7fc3e01356e0 2023-10-03T10:12:28.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.253+0000 7fc3ded9d700 1 --2- 172.21.15.146:0/1247285361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3e01356e0 0x7fc3e0137ac0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8009d90 tx=0x7fc3d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab3a612a5ea1789 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:28.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.253+0000 7fc3dd59a700 1 -- 172.21.15.146:0/1247285361 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d800e070 con 0x7fc3e01356e0 2023-10-03T10:12:28.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.254+0000 7fc3dd59a700 1 -- 172.21.15.146:0/1247285361 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d800bbd0 con 0x7fc3e01356e0 2023-10-03T10:12:28.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.254+0000 7fc3dd59a700 1 -- 172.21.15.146:0/1247285361 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8012430 con 0x7fc3e01356e0 2023-10-03T10:12:28.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.254+0000 7fc3e4d16700 1 -- 172.21.15.146:0/1247285361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3e01356e0 msgr2=0x7fc3e0137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.254+0000 7fc3e4d16700 1 --2- 172.21.15.146:0/1247285361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3e01356e0 0x7fc3e0137ac0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8009d90 tx=0x7fc3d800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:28.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.255+0000 7fc3e4d16700 1 -- 172.21.15.146:0/1247285361 shutdown_connections 2023-10-03T10:12:28.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.255+0000 7fc3e4d16700 1 --2- 172.21.15.146:0/1247285361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3e01356e0 0x7fc3e0137ac0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.255+0000 7fc3e4d16700 1 --2- 172.21.15.146:0/1247285361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3e00a1510 0x7fc3e01351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.255+0000 7fc3e4d16700 1 -- 172.21.15.146:0/1247285361 >> 172.21.15.146:0/1247285361 conn(0x7fc3e00a2980 msgr2=0x7fc3e00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:28.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.255+0000 7fc3e4d16700 1 -- 172.21.15.146:0/1247285361 shutdown_connections 2023-10-03T10:12:28.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.255+0000 7fc3e4d16700 1 -- 172.21.15.146:0/1247285361 wait complete. 2023-10-03T10:12:28.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.256+0000 7fc3e4d16700 1 Processor -- start 2023-10-03T10:12:28.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.256+0000 7fc3e4d16700 1 -- start start 2023-10-03T10:12:28.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.257+0000 7fc3e4d16700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3e00a0a30 0x7fc3e0134540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.257+0000 7fc3e4d16700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3e00a1510 0x7fc3e0134a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.257+0000 7fc3e4d16700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc3e01356e0 0x7fc3e01c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.257+0000 7fc3e4d16700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e009f6f0 con 0x7fc3e00a1510 2023-10-03T10:12:28.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.257+0000 7fc3e4d16700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e01340b0 con 0x7fc3e00a0a30 2023-10-03T10:12:28.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.257+0000 7fc3e4d16700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e013a7e0 con 0x7fc3e01356e0 2023-10-03T10:12:28.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.257+0000 7fc3ddd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3e00a1510 0x7fc3e0134a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.257+0000 7fc3ddd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3e00a1510 0x7fc3e0134a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45288/0 (socket says 172.21.15.146:45288) 2023-10-03T10:12:28.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.257+0000 7fc3ddd9b700 1 -- 172.21.15.146:0/669903262 learned_addr learned my addr 172.21.15.146:0/669903262 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:28.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.258+0000 7fc3ddd9b700 1 -- 172.21.15.146:0/669903262 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc3e01356e0 msgr2=0x7fc3e01c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.258+0000 7fc3ddd9b700 1 --2- 172.21.15.146:0/669903262 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc3e01356e0 0x7fc3e01c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.258+0000 7fc3ddd9b700 1 -- 172.21.15.146:0/669903262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3e00a0a30 msgr2=0x7fc3e0134540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.258+0000 7fc3ddd9b700 1 --2- 172.21.15.146:0/669903262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3e00a0a30 0x7fc3e0134540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.258+0000 7fc3ddd9b700 1 -- 172.21.15.146:0/669903262 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d8009a70 con 0x7fc3e00a1510 2023-10-03T10:12:28.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.258+0000 7fc3ddd9b700 1 --2- 172.21.15.146:0/669903262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3e00a1510 0x7fc3e0134a80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400b530 tx=0x7fc3d400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:28.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.258+0000 7fc3ceffd700 1 -- 172.21.15.146:0/669903262 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4011830 con 0x7fc3e00a1510 2023-10-03T10:12:28.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.258+0000 7fc3ceffd700 1 -- 172.21.15.146:0/669903262 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d40119b0 con 0x7fc3e00a1510 2023-10-03T10:12:28.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.258+0000 7fc3e4d16700 1 -- 172.21.15.146:0/669903262 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e0134fc0 con 0x7fc3e00a1510 2023-10-03T10:12:28.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.258+0000 7fc3e4d16700 1 -- 172.21.15.146:0/669903262 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e013aa20 con 0x7fc3e00a1510 2023-10-03T10:12:28.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.258+0000 7fc3ceffd700 1 -- 172.21.15.146:0/669903262 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4011d60 con 0x7fc3e00a1510 2023-10-03T10:12:28.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.259+0000 7fc3e4d16700 1 -- 172.21.15.146:0/669903262 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c40052e0 con 0x7fc3e00a1510 2023-10-03T10:12:28.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.260+0000 7fc3ceffd700 1 -- 172.21.15.146:0/669903262 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc3d401a400 con 0x7fc3e00a1510 2023-10-03T10:12:28.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.260+0000 7fc3ceffd700 1 -- 172.21.15.146:0/669903262 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fc3d403fdc0 con 0x7fc3e00a1510 2023-10-03T10:12:28.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.260+0000 7fc3de59c700 1 -- 172.21.15.146:0/669903262 >> v1:172.21.15.146:6816/126749 conn(0x7fc3c002f510 legacy=0x7fc3c00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:28.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.265+0000 7fc3ceffd700 1 -- 172.21.15.146:0/669903262 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc3d400f8d0 con 0x7fc3e00a1510 2023-10-03T10:12:28.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.309+0000 7fc2c7162700 1 Processor -- start 2023-10-03T10:12:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.309+0000 7fc2c7162700 1 -- start start 2023-10-03T10:12:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.309+0000 7fc2c7162700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2c009e870 0x7fc2c009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.309+0000 7fc2c7162700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2c0131f40 0x7fc2c0139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.309+0000 7fc2c7162700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c009c970 con 0x7fc2c009f180 2023-10-03T10:12:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.309+0000 7fc2c7162700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c00a0920 con 0x7fc2c0131f40 2023-10-03T10:12:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.309+0000 7fc2c7162700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c009f9c0 con 0x7fc2c009e870 2023-10-03T10:12:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.310+0000 7fc2c4efe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2c009e870 0x7fc2c009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.310+0000 7fc2c56ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2c0131f40 0x7fc2c0139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.310+0000 7fc2c4efe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2c009e870 0x7fc2c009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49624/0 (socket says 172.21.15.146:49624) 2023-10-03T10:12:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.310+0000 7fc2c4efe700 1 -- 172.21.15.146:0/2854803643 learned_addr learned my addr 172.21.15.146:0/2854803643 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.310+0000 7fc2c56ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2c0131f40 0x7fc2c0139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50018/0 (socket says 172.21.15.146:50018) 2023-10-03T10:12:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.310+0000 7fc2c4efe700 1 -- 172.21.15.146:0/2854803643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2c0131f40 msgr2=0x7fc2c0139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.310+0000 7fc2c4efe700 1 --2- 172.21.15.146:0/2854803643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2c0131f40 0x7fc2c0139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.310+0000 7fc2c4efe700 1 -- 172.21.15.146:0/2854803643 >> v1:172.21.15.146:6789/0 conn(0x7fc2c009f180 legacy=0x7fc2c0131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.310+0000 7fc2bf7fe700 1 -- 172.21.15.146:0/2854803643 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232368636 0 0) 0x7fc2c009c970 con 0x7fc2c009f180 2023-10-03T10:12:28.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.310+0000 7fc2c4efe700 1 -- 172.21.15.146:0/2854803643 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c009bab0 con 0x7fc2c009e870 2023-10-03T10:12:28.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.310+0000 7fc2c4efe700 1 --2- 172.21.15.146:0/2854803643 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2c009e870 0x7fc2c009ec40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009920 tx=0x7fc2b4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18b9fe20d2ceb38e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:28.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.310+0000 7fc2bf7fe700 1 -- 172.21.15.146:0/2854803643 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4011830 con 0x7fc2c009e870 2023-10-03T10:12:28.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.311+0000 7fc2bf7fe700 1 -- 172.21.15.146:0/2854803643 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b4011990 con 0x7fc2c009e870 2023-10-03T10:12:28.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.311+0000 7fc2bf7fe700 1 -- 172.21.15.146:0/2854803643 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4011d20 con 0x7fc2c009e870 2023-10-03T10:12:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.311+0000 7fc2c7162700 1 -- 172.21.15.146:0/2854803643 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2c009e870 msgr2=0x7fc2c009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.311+0000 7fc2c7162700 1 --2- 172.21.15.146:0/2854803643 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2c009e870 0x7fc2c009ec40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009920 tx=0x7fc2b4009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.311+0000 7fc2c7162700 1 -- 172.21.15.146:0/2854803643 shutdown_connections 2023-10-03T10:12:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.311+0000 7fc2c7162700 1 --2- 172.21.15.146:0/2854803643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2c0131f40 0x7fc2c0139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.311+0000 7fc2c7162700 1 --2- 172.21.15.146:0/2854803643 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2c009e870 0x7fc2c009ec40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.311+0000 7fc2c7162700 1 -- 172.21.15.146:0/2854803643 >> 172.21.15.146:0/2854803643 conn(0x7fc2c00a4430 msgr2=0x7fc2c00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.312+0000 7fc2c7162700 1 -- 172.21.15.146:0/2854803643 shutdown_connections 2023-10-03T10:12:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.312+0000 7fc2c7162700 1 -- 172.21.15.146:0/2854803643 wait complete. 2023-10-03T10:12:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.312+0000 7fc2c7162700 1 Processor -- start 2023-10-03T10:12:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.312+0000 7fc2c7162700 1 -- start start 2023-10-03T10:12:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.313+0000 7fc2c7162700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2c009e870 0x7fc2c01272e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.313+0000 7fc2c7162700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2c009f180 0x7fc2c0127820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.313+0000 7fc2c7162700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2c0131f40 0x7fc2c0127d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.313+0000 7fc2c7162700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c011e560 con 0x7fc2c009e870 2023-10-03T10:12:28.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.313+0000 7fc2c7162700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c01288b0 con 0x7fc2c009f180 2023-10-03T10:12:28.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.313+0000 7fc2c7162700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c0131830 con 0x7fc2c0131f40 2023-10-03T10:12:28.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.313+0000 7fc2bffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2c009f180 0x7fc2c0127820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.313+0000 7fc2bffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2c009f180 0x7fc2c0127820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50028/0 (socket says 172.21.15.146:50028) 2023-10-03T10:12:28.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.313+0000 7fc2bffff700 1 -- 172.21.15.146:0/393703247 learned_addr learned my addr 172.21.15.146:0/393703247 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:28.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.313+0000 7fc2c56ff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2c0131f40 0x7fc2c0127d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.313+0000 7fc2c4efe700 1 --2- 172.21.15.146:0/393703247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2c009e870 0x7fc2c01272e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.314+0000 7fc2bffff700 1 -- 172.21.15.146:0/393703247 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2c0131f40 msgr2=0x7fc2c0127d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.314+0000 7fc2bffff700 1 --2- 172.21.15.146:0/393703247 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2c0131f40 0x7fc2c0127d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.314+0000 7fc2bffff700 1 -- 172.21.15.146:0/393703247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2c009e870 msgr2=0x7fc2c01272e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.314+0000 7fc2bffff700 1 --2- 172.21.15.146:0/393703247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2c009e870 0x7fc2c01272e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.314+0000 7fc2bffff700 1 -- 172.21.15.146:0/393703247 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b4009550 con 0x7fc2c009f180 2023-10-03T10:12:28.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.314+0000 7fc2bffff700 1 --2- 172.21.15.146:0/393703247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2c009f180 0x7fc2c0127820 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00c450 tx=0x7fc2ac00c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:28.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.314+0000 7fc2bd7fa700 1 -- 172.21.15.146:0/393703247 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac0054e0 con 0x7fc2c009f180 2023-10-03T10:12:28.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.314+0000 7fc2bd7fa700 1 -- 172.21.15.146:0/393703247 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ac00ce60 con 0x7fc2c009f180 2023-10-03T10:12:28.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.314+0000 7fc2bd7fa700 1 -- 172.21.15.146:0/393703247 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac0038a0 con 0x7fc2c009f180 2023-10-03T10:12:28.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.315+0000 7fc2c7162700 1 -- 172.21.15.146:0/393703247 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c009dba0 con 0x7fc2c009f180 2023-10-03T10:12:28.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.315+0000 7fc2c7162700 1 -- 172.21.15.146:0/393703247 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c011db10 con 0x7fc2c009f180 2023-10-03T10:12:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.315+0000 7fc2bd7fa700 1 -- 172.21.15.146:0/393703247 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc2ac003a00 con 0x7fc2c009f180 2023-10-03T10:12:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.316+0000 7fc2bd7fa700 1 -- 172.21.15.146:0/393703247 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fc2ac03efb0 con 0x7fc2c009f180 2023-10-03T10:12:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.316+0000 7fc2c4efe700 1 -- 172.21.15.146:0/393703247 >> v1:172.21.15.146:6816/126749 conn(0x7fc2a402f510 legacy=0x7fc2a40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.316+0000 7fc2c7162700 1 -- 172.21.15.146:0/393703247 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c00a2350 con 0x7fc2c009f180 2023-10-03T10:12:28.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.320+0000 7fc2bd7fa700 1 -- 172.21.15.146:0/393703247 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2ac017020 con 0x7fc2c009f180 2023-10-03T10:12:28.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.332+0000 7f20bb672700 1 Processor -- start 2023-10-03T10:12:28.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.332+0000 7f20bb672700 1 -- start start 2023-10-03T10:12:28.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.332+0000 7f20bb672700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20b40a0a70 0x7f20b40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.333+0000 7f20bb672700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20b40a1380 0x7f20b4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.333+0000 7f20bb672700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b409dc00 con 0x7f20b4133f50 2023-10-03T10:12:28.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.333+0000 7f20bb672700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b409ea60 con 0x7f20b40a1380 2023-10-03T10:12:28.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.333+0000 7f20bb672700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20b409dec0 con 0x7f20b40a0a70 2023-10-03T10:12:28.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.333+0000 7f20b8c0d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20b40a1380 0x7f20b4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.333+0000 7f20b8c0d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20b40a1380 0x7f20b4133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50038/0 (socket says 172.21.15.146:50038) 2023-10-03T10:12:28.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.333+0000 7f20b8c0d700 1 -- 172.21.15.146:0/2640688099 learned_addr learned my addr 172.21.15.146:0/2640688099 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:28.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.333+0000 7f20b8c0d700 1 -- 172.21.15.146:0/2640688099 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20b40a0a70 msgr2=0x7f20b40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:28.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.333+0000 7f20b8c0d700 1 --2- 172.21.15.146:0/2640688099 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20b40a0a70 0x7f20b40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.333+0000 7f20b8c0d700 1 -- 172.21.15.146:0/2640688099 >> v1:172.21.15.146:6789/0 conn(0x7f20b4133f50 legacy=0x7f20b413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:28.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.333+0000 7f20b8c0d700 1 -- 172.21.15.146:0/2640688099 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b409e6a0 con 0x7f20b40a1380 2023-10-03T10:12:28.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.333+0000 7f20b8c0d700 1 --2- 172.21.15.146:0/2640688099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20b40a1380 0x7f20b4133a10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f20a4009920 tx=0x7f20a4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7d468ea9519c129 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:28.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.334+0000 7f20abfff700 1 -- 172.21.15.146:0/2640688099 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a400ba60 con 0x7f20b40a1380 2023-10-03T10:12:28.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.334+0000 7f20abfff700 1 -- 172.21.15.146:0/2640688099 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a400bbc0 con 0x7f20b40a1380 2023-10-03T10:12:28.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.334+0000 7f20abfff700 1 -- 172.21.15.146:0/2640688099 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a4009e70 con 0x7f20b40a1380 2023-10-03T10:12:28.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.334+0000 7f20bb672700 1 -- 172.21.15.146:0/2640688099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20b40a1380 msgr2=0x7f20b4133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.334+0000 7f20bb672700 1 --2- 172.21.15.146:0/2640688099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20b40a1380 0x7f20b4133a10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f20a4009920 tx=0x7f20a4009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:28.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.334+0000 7f20bb672700 1 -- 172.21.15.146:0/2640688099 shutdown_connections 2023-10-03T10:12:28.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.334+0000 7f20bb672700 1 --2- 172.21.15.146:0/2640688099 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20b40a0a70 0x7f20b40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.334+0000 7f20bb672700 1 --2- 172.21.15.146:0/2640688099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20b40a1380 0x7f20b4133a10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.334+0000 7f20bb672700 1 -- 172.21.15.146:0/2640688099 >> 172.21.15.146:0/2640688099 conn(0x7f20b40a6610 msgr2=0x7f20b40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:28.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.334+0000 7f20bb672700 1 -- 172.21.15.146:0/2640688099 shutdown_connections 2023-10-03T10:12:28.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.334+0000 7f20bb672700 1 -- 172.21.15.146:0/2640688099 wait complete. 2023-10-03T10:12:28.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.336+0000 7f20bb672700 1 Processor -- start 2023-10-03T10:12:28.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.336+0000 7f20bb672700 1 -- start start 2023-10-03T10:12:28.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.336+0000 7f20bb672700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20b40a0a70 0x7f20b411e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.336+0000 7f20bb672700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20b40a1380 0x7f20b411ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.336+0000 7f20bb672700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20b4133f50 0x7f20b411f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.336+0000 7f20bb672700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b4120560 con 0x7f20b40a0a70 2023-10-03T10:12:28.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.336+0000 7f20bb672700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b4133aa0 con 0x7f20b40a1380 2023-10-03T10:12:28.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.336+0000 7f20bb672700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20b40a03e0 con 0x7f20b4133f50 2023-10-03T10:12:28.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.336+0000 7f20b9c0f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20b4133f50 0x7f20b411f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.336+0000 7f20b9c0f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20b4133f50 0x7f20b411f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49658/0 (socket says 172.21.15.146:49658) 2023-10-03T10:12:28.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.336+0000 7f20b9c0f700 1 -- 172.21.15.146:0/655909329 learned_addr learned my addr 172.21.15.146:0/655909329 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:28.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.336+0000 7f20b940e700 1 --2- 172.21.15.146:0/655909329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20b40a0a70 0x7f20b411e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.337+0000 7f20b8c0d700 1 --2- 172.21.15.146:0/655909329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20b40a1380 0x7f20b411ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.337+0000 7f20b9c0f700 1 -- 172.21.15.146:0/655909329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20b40a1380 msgr2=0x7f20b411ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.337+0000 7f20b9c0f700 1 --2- 172.21.15.146:0/655909329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20b40a1380 0x7f20b411ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.337+0000 7f20b9c0f700 1 -- 172.21.15.146:0/655909329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20b40a0a70 msgr2=0x7f20b411e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.337+0000 7f20b9c0f700 1 --2- 172.21.15.146:0/655909329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20b40a0a70 0x7f20b411e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.337+0000 7f20b9c0f700 1 -- 172.21.15.146:0/655909329 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a4009550 con 0x7f20b4133f50 2023-10-03T10:12:28.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.337+0000 7f20b940e700 1 --2- 172.21.15.146:0/655909329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20b40a0a70 0x7f20b411e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:28.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.337+0000 7f20b9c0f700 1 --2- 172.21.15.146:0/655909329 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20b4133f50 0x7f20b411f2c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f20ac014570 tx=0x7f20ac014880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:28.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.337+0000 7f20a9ffb700 1 -- 172.21.15.146:0/655909329 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac017070 con 0x7f20b4133f50 2023-10-03T10:12:28.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.337+0000 7f20bb672700 1 -- 172.21.15.146:0/655909329 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b4120c00 con 0x7f20b4133f50 2023-10-03T10:12:28.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.337+0000 7f20a9ffb700 1 -- 172.21.15.146:0/655909329 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ac003a00 con 0x7f20b4133f50 2023-10-03T10:12:28.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.337+0000 7f20a9ffb700 1 -- 172.21.15.146:0/655909329 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac003db0 con 0x7f20b4133f50 2023-10-03T10:12:28.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.337+0000 7f20bb672700 1 -- 172.21.15.146:0/655909329 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b4122a60 con 0x7f20b4133f50 2023-10-03T10:12:28.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.338+0000 7f20bb672700 1 -- 172.21.15.146:0/655909329 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b404f2a0 con 0x7f20b4133f50 2023-10-03T10:12:28.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.338+0000 7f20a9ffb700 1 -- 172.21.15.146:0/655909329 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f20ac0120d0 con 0x7f20b4133f50 2023-10-03T10:12:28.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.339+0000 7f20a9ffb700 1 -- 172.21.15.146:0/655909329 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f20ac047e20 con 0x7f20b4133f50 2023-10-03T10:12:28.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.339+0000 7f20b940e700 1 -- 172.21.15.146:0/655909329 >> v1:172.21.15.146:6816/126749 conn(0x7f209802f510 legacy=0x7f20980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:28.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.343+0000 7f20a9ffb700 1 -- 172.21.15.146:0/655909329 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20ac024bd0 con 0x7f20b4133f50 2023-10-03T10:12:28.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.396+0000 7f403f7fe700 1 -- 172.21.15.146:0/173323886 >> v1:172.21.15.146:6816/126749 conn(0x7f402c02f510 legacy=0x7f402c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:28.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.461+0000 7fc3de59c700 1 -- 172.21.15.146:0/669903262 >> v1:172.21.15.146:6816/126749 conn(0x7fc3c002f510 legacy=0x7fc3c00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:28.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.497+0000 7f4045d9b700 1 -- 172.21.15.146:0/173323886 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f404004f2a0 con 0x7f404009c5c0 2023-10-03T10:12:28.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.497+0000 7f4027fff700 1 -- 172.21.15.146:0/173323886 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4034024020 con 0x7f404009c5c0 2023-10-03T10:12:28.498 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:28.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.499+0000 7f4045d9b700 1 -- 172.21.15.146:0/173323886 >> v1:172.21.15.146:6816/126749 conn(0x7f402c02f510 legacy=0x7f402c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:28.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.499+0000 7f4045d9b700 1 -- 172.21.15.146:0/173323886 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f404009c5c0 msgr2=0x7f404011bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.499+0000 7f4045d9b700 1 --2- 172.21.15.146:0/173323886 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f404009c5c0 0x7f404011bb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4034016000 tx=0x7f4034004750 comp rx=0 tx=0).stop 2023-10-03T10:12:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.500+0000 7f4045d9b700 1 -- 172.21.15.146:0/173323886 shutdown_connections 2023-10-03T10:12:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.500+0000 7f4045d9b700 1 --2- 172.21.15.146:0/173323886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4040131980 0x7f404011c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.500+0000 7f4045d9b700 1 --2- 172.21.15.146:0/173323886 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f404009bc70 0x7f404011b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.500+0000 7f4045d9b700 1 --2- 172.21.15.146:0/173323886 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f404009c5c0 0x7f404011bb30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.500+0000 7f4045d9b700 1 -- 172.21.15.146:0/173323886 >> 172.21.15.146:0/173323886 conn(0x7f40400a2980 msgr2=0x7f4040071370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.500+0000 7f4045d9b700 1 -- 172.21.15.146:0/173323886 shutdown_connections 2023-10-03T10:12:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.500+0000 7f4045d9b700 1 -- 172.21.15.146:0/173323886 wait complete. 2023-10-03T10:12:28.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:28.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.517+0000 7fc2c4efe700 1 -- 172.21.15.146:0/393703247 >> v1:172.21.15.146:6816/126749 conn(0x7fc2a402f510 legacy=0x7fc2a40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:28.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.521+0000 7fc2c7162700 1 -- 172.21.15.146:0/393703247 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc2c004f2a0 con 0x7fc2c009f180 2023-10-03T10:12:28.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.522+0000 7fc2bd7fa700 1 -- 172.21.15.146:0/393703247 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc2ac019b40 con 0x7fc2c009f180 2023-10-03T10:12:28.523 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:28.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.524+0000 7fc2c7162700 1 -- 172.21.15.146:0/393703247 >> v1:172.21.15.146:6816/126749 conn(0x7fc2a402f510 legacy=0x7fc2a40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:28.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.524+0000 7fc2c7162700 1 -- 172.21.15.146:0/393703247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2c009f180 msgr2=0x7fc2c0127820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.524+0000 7fc2c7162700 1 --2- 172.21.15.146:0/393703247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2c009f180 0x7fc2c0127820 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00c450 tx=0x7fc2ac00c760 comp rx=0 tx=0).stop 2023-10-03T10:12:28.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.524+0000 7fc2c7162700 1 -- 172.21.15.146:0/393703247 shutdown_connections 2023-10-03T10:12:28.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.524+0000 7fc2c7162700 1 --2- 172.21.15.146:0/393703247 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2c0131f40 0x7fc2c0127d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.524+0000 7fc2c7162700 1 --2- 172.21.15.146:0/393703247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2c009e870 0x7fc2c01272e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.524+0000 7fc2c7162700 1 --2- 172.21.15.146:0/393703247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2c009f180 0x7fc2c0127820 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.524+0000 7fc2c7162700 1 -- 172.21.15.146:0/393703247 >> 172.21.15.146:0/393703247 conn(0x7fc2c00a4430 msgr2=0x7fc2c006fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:28.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.524+0000 7fc2c7162700 1 -- 172.21.15.146:0/393703247 shutdown_connections 2023-10-03T10:12:28.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.524+0000 7fc2c7162700 1 -- 172.21.15.146:0/393703247 wait complete. 2023-10-03T10:12:28.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:28.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.540+0000 7f20b940e700 1 -- 172.21.15.146:0/655909329 >> v1:172.21.15.146:6816/126749 conn(0x7f209802f510 legacy=0x7f20980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:28.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.542+0000 7f20bb672700 1 -- 172.21.15.146:0/655909329 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f20b4122140 con 0x7f20b4133f50 2023-10-03T10:12:28.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.542+0000 7f20a9ffb700 1 -- 172.21.15.146:0/655909329 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f20ac024810 con 0x7f20b4133f50 2023-10-03T10:12:28.543 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.544+0000 7f20bb672700 1 -- 172.21.15.146:0/655909329 >> v1:172.21.15.146:6816/126749 conn(0x7f209802f510 legacy=0x7f20980319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.544+0000 7f20bb672700 1 -- 172.21.15.146:0/655909329 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20b4133f50 msgr2=0x7f20b411f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.544+0000 7f20bb672700 1 --2- 172.21.15.146:0/655909329 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20b4133f50 0x7f20b411f2c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f20ac014570 tx=0x7f20ac014880 comp rx=0 tx=0).stop 2023-10-03T10:12:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.544+0000 7f20bb672700 1 -- 172.21.15.146:0/655909329 shutdown_connections 2023-10-03T10:12:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.544+0000 7f20bb672700 1 --2- 172.21.15.146:0/655909329 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20b4133f50 0x7f20b411f2c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.544+0000 7f20bb672700 1 --2- 172.21.15.146:0/655909329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20b40a0a70 0x7f20b411e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.544+0000 7f20bb672700 1 --2- 172.21.15.146:0/655909329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20b40a1380 0x7f20b411ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.544+0000 7f20bb672700 1 -- 172.21.15.146:0/655909329 >> 172.21.15.146:0/655909329 conn(0x7f20b40a6610 msgr2=0x7f20b40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.544+0000 7f20bb672700 1 -- 172.21.15.146:0/655909329 shutdown_connections 2023-10-03T10:12:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.544+0000 7f20bb672700 1 -- 172.21.15.146:0/655909329 wait complete. 2023-10-03T10:12:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.545+0000 7fc3e4d16700 1 -- 172.21.15.146:0/669903262 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc3c4005860 con 0x7fc3e00a1510 2023-10-03T10:12:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.545+0000 7fc3ceffd700 1 -- 172.21.15.146:0/669903262 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc3d4015030 con 0x7fc3e00a1510 2023-10-03T10:12:28.547 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.547+0000 7fc3e4d16700 1 -- 172.21.15.146:0/669903262 >> v1:172.21.15.146:6816/126749 conn(0x7fc3c002f510 legacy=0x7fc3c00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.547+0000 7fc3e4d16700 1 -- 172.21.15.146:0/669903262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3e00a1510 msgr2=0x7fc3e0134a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.547+0000 7fc3e4d16700 1 --2- 172.21.15.146:0/669903262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3e00a1510 0x7fc3e0134a80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400b530 tx=0x7fc3d400b8f0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.547+0000 7fc3e4d16700 1 -- 172.21.15.146:0/669903262 shutdown_connections 2023-10-03T10:12:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.547+0000 7fc3e4d16700 1 --2- 172.21.15.146:0/669903262 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc3e01356e0 0x7fc3e01c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.547+0000 7fc3e4d16700 1 --2- 172.21.15.146:0/669903262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3e00a0a30 0x7fc3e0134540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.547+0000 7fc3e4d16700 1 --2- 172.21.15.146:0/669903262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3e00a1510 0x7fc3e0134a80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.547+0000 7fc3e4d16700 1 -- 172.21.15.146:0/669903262 >> 172.21.15.146:0/669903262 conn(0x7fc3e00a2980 msgr2=0x7fc3e0070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.548+0000 7fc3e4d16700 1 -- 172.21.15.146:0/669903262 shutdown_connections 2023-10-03T10:12:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:28.548+0000 7fc3e4d16700 1 -- 172.21.15.146:0/669903262 wait complete. 2023-10-03T10:12:28.558 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:28.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:29.518 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:29.537 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:29.559 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:29.561 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:29.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.663+0000 7f6805005700 1 Processor -- start 2023-10-03T10:12:29.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.663+0000 7f6805005700 1 -- start start 2023-10-03T10:12:29.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.663+0000 7f6805005700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6800133b80 0x7f6800133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.663+0000 7f6805005700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6800099a60 0x7f68000a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.663+0000 7f6805005700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f68000a0e20 0x7f68000a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.663+0000 7f6805005700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680009aa00 con 0x7f6800099a60 2023-10-03T10:12:29.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.663+0000 7f6805005700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680009a080 con 0x7f6800133b80 2023-10-03T10:12:29.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.663+0000 7f6805005700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6800133750 con 0x7f68000a0e20 2023-10-03T10:12:29.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.663+0000 7f67fed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6800133b80 0x7f6800133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.663+0000 7f67fed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6800133b80 0x7f6800133f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50058/0 (socket says 172.21.15.146:50058) 2023-10-03T10:12:29.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.663+0000 7f67fed9d700 1 -- 172.21.15.146:0/3963517534 learned_addr learned my addr 172.21.15.146:0/3963517534 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:29.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.663+0000 7f67fe59c700 1 --2- 172.21.15.146:0/3963517534 >> v2:172.21.15.146:3300/0 conn(0x7f6800099a60 0x7f68000a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.664+0000 7f67fed9d700 1 -- 172.21.15.146:0/3963517534 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f68000a0e20 msgr2=0x7f68000a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.664+0000 7f67fed9d700 1 --2- 172.21.15.146:0/3963517534 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f68000a0e20 0x7f68000a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.664+0000 7f67fed9d700 1 -- 172.21.15.146:0/3963517534 >> v2:172.21.15.146:3300/0 conn(0x7f6800099a60 msgr2=0x7f68000a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.664+0000 7f67fed9d700 1 --2- 172.21.15.146:0/3963517534 >> v2:172.21.15.146:3300/0 conn(0x7f6800099a60 0x7f68000a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.664+0000 7f67fed9d700 1 -- 172.21.15.146:0/3963517534 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680009a760 con 0x7f6800133b80 2023-10-03T10:12:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.664+0000 7f67fed9d700 1 --2- 172.21.15.146:0/3963517534 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6800133b80 0x7f6800133f50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f67f0006fd0 tx=0x7f67f0009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a268b5348726a4d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.664+0000 7f67fdd9b700 1 -- 172.21.15.146:0/3963517534 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f0005e30 con 0x7f6800133b80 2023-10-03T10:12:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.664+0000 7f67fdd9b700 1 -- 172.21.15.146:0/3963517534 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f0004030 con 0x7f6800133b80 2023-10-03T10:12:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.664+0000 7f67fdd9b700 1 -- 172.21.15.146:0/3963517534 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f00043e0 con 0x7f6800133b80 2023-10-03T10:12:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.665+0000 7f6805005700 1 -- 172.21.15.146:0/3963517534 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6800133b80 msgr2=0x7f6800133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.665+0000 7f6805005700 1 --2- 172.21.15.146:0/3963517534 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6800133b80 0x7f6800133f50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f67f0006fd0 tx=0x7f67f0009bd0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.665+0000 7f6805005700 1 -- 172.21.15.146:0/3963517534 shutdown_connections 2023-10-03T10:12:29.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.665+0000 7f6805005700 1 --2- 172.21.15.146:0/3963517534 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6800133b80 0x7f6800133f50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.665+0000 7f6805005700 1 --2- 172.21.15.146:0/3963517534 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f68000a0e20 0x7f68000a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.665+0000 7f6805005700 1 --2- 172.21.15.146:0/3963517534 >> v2:172.21.15.146:3300/0 conn(0x7f6800099a60 0x7f68000a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.665+0000 7f6805005700 1 -- 172.21.15.146:0/3963517534 >> 172.21.15.146:0/3963517534 conn(0x7f68000a2980 msgr2=0x7f68000a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:29.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.665+0000 7f6805005700 1 -- 172.21.15.146:0/3963517534 shutdown_connections 2023-10-03T10:12:29.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.665+0000 7f6805005700 1 -- 172.21.15.146:0/3963517534 wait complete. 2023-10-03T10:12:29.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.667+0000 7f6805005700 1 Processor -- start 2023-10-03T10:12:29.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.667+0000 7f6805005700 1 -- start start 2023-10-03T10:12:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.667+0000 7f6805005700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6800099a60 0x7f680011cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.667+0000 7f6805005700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f68000a0e20 0x7f680011d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.667+0000 7f6805005700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6800133b80 0x7f680011d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.667+0000 7f6805005700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680011dfc0 con 0x7f6800133b80 2023-10-03T10:12:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.667+0000 7f6805005700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680009c3c0 con 0x7f6800099a60 2023-10-03T10:12:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.667+0000 7f6805005700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f680009a2c0 con 0x7f68000a0e20 2023-10-03T10:12:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.668+0000 7f67fed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6800099a60 0x7f680011cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.668+0000 7f67fed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6800099a60 0x7f680011cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50064/0 (socket says 172.21.15.146:50064) 2023-10-03T10:12:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.668+0000 7f67fed9d700 1 -- 172.21.15.146:0/2703447817 learned_addr learned my addr 172.21.15.146:0/2703447817 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.668+0000 7f67ff59e700 1 --2- 172.21.15.146:0/2703447817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6800133b80 0x7f680011d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.668+0000 7f67fe59c700 1 --2- 172.21.15.146:0/2703447817 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f68000a0e20 0x7f680011d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.668+0000 7f67fed9d700 1 -- 172.21.15.146:0/2703447817 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f68000a0e20 msgr2=0x7f680011d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.668+0000 7f67fed9d700 1 --2- 172.21.15.146:0/2703447817 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f68000a0e20 0x7f680011d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.668+0000 7f67fed9d700 1 -- 172.21.15.146:0/2703447817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6800133b80 msgr2=0x7f680011d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.668+0000 7f67fed9d700 1 --2- 172.21.15.146:0/2703447817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6800133b80 0x7f680011d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.668+0000 7f67fed9d700 1 -- 172.21.15.146:0/2703447817 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f0009500 con 0x7f6800099a60 2023-10-03T10:12:29.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.668+0000 7f67fed9d700 1 --2- 172.21.15.146:0/2703447817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6800099a60 0x7f680011cbd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009c10 tx=0x7f67f0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:29.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.668+0000 7f67e77fe700 1 -- 172.21.15.146:0/2703447817 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f0003ab0 con 0x7f6800099a60 2023-10-03T10:12:29.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.668+0000 7f67e77fe700 1 -- 172.21.15.146:0/2703447817 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f0003c30 con 0x7f6800099a60 2023-10-03T10:12:29.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.668+0000 7f67e77fe700 1 -- 172.21.15.146:0/2703447817 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f0006030 con 0x7f6800099a60 2023-10-03T10:12:29.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.668+0000 7f6805005700 1 -- 172.21.15.146:0/2703447817 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680011ec50 con 0x7f6800099a60 2023-10-03T10:12:29.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.669+0000 7f6805005700 1 -- 172.21.15.146:0/2703447817 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6800120670 con 0x7f6800099a60 2023-10-03T10:12:29.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.669+0000 7f67e77fe700 1 -- 172.21.15.146:0/2703447817 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f67f0006190 con 0x7f6800099a60 2023-10-03T10:12:29.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.670+0000 7f67e77fe700 1 -- 172.21.15.146:0/2703447817 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f67f0040dd0 con 0x7f6800099a60 2023-10-03T10:12:29.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.670+0000 7f67fe59c700 1 -- 172.21.15.146:0/2703447817 >> v1:172.21.15.146:6816/126749 conn(0x7f67ec02f510 legacy=0x7f67ec0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:29.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.670+0000 7f6805005700 1 -- 172.21.15.146:0/2703447817 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f680011ff40 con 0x7f6800099a60 2023-10-03T10:12:29.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.675+0000 7f67e77fe700 1 -- 172.21.15.146:0/2703447817 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f67f002b080 con 0x7f6800099a60 2023-10-03T10:12:29.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.699+0000 7f872acfa700 1 Processor -- start 2023-10-03T10:12:29.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.699+0000 7f872acfa700 1 -- start start 2023-10-03T10:12:29.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.699+0000 7f35d57d1700 1 Processor -- start 2023-10-03T10:12:29.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.699+0000 7f35d57d1700 1 -- start start 2023-10-03T10:12:29.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.699+0000 7f872acfa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f872409f430 0x7f8724136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.699+0000 7f872acfa700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8724137010 0x7f87241393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.699+0000 7f872acfa700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872409b6d0 con 0x7f872409e950 2023-10-03T10:12:29.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.699+0000 7f872acfa700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872409afb0 con 0x7f8724137010 2023-10-03T10:12:29.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.699+0000 7f872acfa700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87240a0970 con 0x7f872409f430 2023-10-03T10:12:29.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.699+0000 7f8723fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f872409f430 0x7f8724136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.699+0000 7f8723fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f872409f430 0x7f8724136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49680/0 (socket says 172.21.15.146:49680) 2023-10-03T10:12:29.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.699+0000 7f8723fff700 1 -- 172.21.15.146:0/3708857980 learned_addr learned my addr 172.21.15.146:0/3708857980 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:29.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f8723fff700 1 -- 172.21.15.146:0/3708857980 >> v2:172.21.15.146:3300/0 conn(0x7f8724137010 msgr2=0x7f87241393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:29.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f8723fff700 1 --2- 172.21.15.146:0/3708857980 >> v2:172.21.15.146:3300/0 conn(0x7f8724137010 0x7f87241393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f8723fff700 1 -- 172.21.15.146:0/3708857980 >> v1:172.21.15.146:6789/0 conn(0x7f872409e950 legacy=0x7f872409ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:29.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f8723fff700 1 -- 172.21.15.146:0/3708857980 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87240a0320 con 0x7f872409f430 2023-10-03T10:12:29.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f35d57d1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35d0131a40 0x7f35d0131e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f35d57d1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35d009dcb0 0x7f35d009e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f35d57d1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d00741b0 con 0x7f35d009e5e0 2023-10-03T10:12:29.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f35d57d1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0099de0 con 0x7f35d0131a40 2023-10-03T10:12:29.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f35d57d1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0099020 con 0x7f35d009dcb0 2023-10-03T10:12:29.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f35cf7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f35d009e5e0 0x7f35d013abc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35256/0 (socket says 172.21.15.146:35256) 2023-10-03T10:12:29.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f35cf7fe700 1 -- 172.21.15.146:0/3393584305 learned_addr learned my addr 172.21.15.146:0/3393584305 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:29.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f35ceffd700 1 --2- 172.21.15.146:0/3393584305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35d0131a40 0x7f35d0131e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f8723fff700 1 --2- 172.21.15.146:0/3708857980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f872409f430 0x7f8724136ad0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f87100098f0 tx=0x7f8710009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be412430d45c5982 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:29.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f87237fe700 1 -- 172.21.15.146:0/3708857980 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710004230 con 0x7f872409f430 2023-10-03T10:12:29.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f87237fe700 1 -- 172.21.15.146:0/3708857980 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8710004390 con 0x7f872409f430 2023-10-03T10:12:29.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f87237fe700 1 -- 172.21.15.146:0/3708857980 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87100036a0 con 0x7f872409f430 2023-10-03T10:12:29.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.701+0000 7f872acfa700 1 -- 172.21.15.146:0/3708857980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f872409f430 msgr2=0x7f8724136ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.701+0000 7f872acfa700 1 --2- 172.21.15.146:0/3708857980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f872409f430 0x7f8724136ad0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f87100098f0 tx=0x7f8710009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:29.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.701+0000 7f872acfa700 1 -- 172.21.15.146:0/3708857980 shutdown_connections 2023-10-03T10:12:29.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.701+0000 7f872acfa700 1 --2- 172.21.15.146:0/3708857980 >> v2:172.21.15.146:3300/0 conn(0x7f8724137010 0x7f87241393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.701+0000 7f872acfa700 1 --2- 172.21.15.146:0/3708857980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f872409f430 0x7f8724136ad0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.701+0000 7f872acfa700 1 -- 172.21.15.146:0/3708857980 >> 172.21.15.146:0/3708857980 conn(0x7f87240a0f70 msgr2=0x7f87240a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:29.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.701+0000 7f872acfa700 1 -- 172.21.15.146:0/3708857980 shutdown_connections 2023-10-03T10:12:29.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.701+0000 7f872acfa700 1 -- 172.21.15.146:0/3708857980 wait complete. 2023-10-03T10:12:29.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.702+0000 7f872acfa700 1 Processor -- start 2023-10-03T10:12:29.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.702+0000 7f872acfa700 1 -- start start 2023-10-03T10:12:29.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f35cdffb700 1 -- 172.21.15.146:0/3393584305 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178639018 0 0) 0x7f35d00741b0 con 0x7f35d009e5e0 2023-10-03T10:12:29.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f35ce7fc700 1 --2- 172.21.15.146:0/3393584305 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35d009dcb0 0x7f35d009e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f35cdffb700 1 -- 172.21.15.146:0/3393584305 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35b80035b0 con 0x7f35d009e5e0 2023-10-03T10:12:29.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f35ce7fc700 1 -- 172.21.15.146:0/3393584305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35d0131a40 msgr2=0x7f35d0131e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:29.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f35ce7fc700 1 --2- 172.21.15.146:0/3393584305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35d0131a40 0x7f35d0131e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f35ce7fc700 1 -- 172.21.15.146:0/3393584305 >> v1:172.21.15.146:6789/0 conn(0x7f35d009e5e0 legacy=0x7f35d013abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.700+0000 7f35ce7fc700 1 -- 172.21.15.146:0/3393584305 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d0131610 con 0x7f35d009dcb0 2023-10-03T10:12:29.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.701+0000 7f35ce7fc700 1 --2- 172.21.15.146:0/3393584305 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35d009dcb0 0x7f35d009e0a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f35c40098a0 tx=0x7f35c4009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bb9328a286794c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:29.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.701+0000 7f35cdffb700 1 -- 172.21.15.146:0/3393584305 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4011830 con 0x7f35d009dcb0 2023-10-03T10:12:29.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.701+0000 7f35cdffb700 1 -- 172.21.15.146:0/3393584305 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c4011990 con 0x7f35d009dcb0 2023-10-03T10:12:29.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.701+0000 7f35cdffb700 1 -- 172.21.15.146:0/3393584305 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4011d20 con 0x7f35d009dcb0 2023-10-03T10:12:29.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.702+0000 7f35d57d1700 1 -- 172.21.15.146:0/3393584305 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35d009dcb0 msgr2=0x7f35d009e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.702+0000 7f35d57d1700 1 --2- 172.21.15.146:0/3393584305 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35d009dcb0 0x7f35d009e0a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f35c40098a0 tx=0x7f35c4009bb0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.702+0000 7f35d57d1700 1 -- 172.21.15.146:0/3393584305 shutdown_connections 2023-10-03T10:12:29.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.702+0000 7f35d57d1700 1 --2- 172.21.15.146:0/3393584305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35d0131a40 0x7f35d0131e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.702+0000 7f35d57d1700 1 --2- 172.21.15.146:0/3393584305 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35d009dcb0 0x7f35d009e0a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.702+0000 7f35d57d1700 1 -- 172.21.15.146:0/3393584305 >> 172.21.15.146:0/3393584305 conn(0x7f35d00a2eb0 msgr2=0x7f35d009eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:29.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.703+0000 7f35d57d1700 1 -- 172.21.15.146:0/3393584305 shutdown_connections 2023-10-03T10:12:29.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.703+0000 7f35d57d1700 1 -- 172.21.15.146:0/3393584305 wait complete. 2023-10-03T10:12:29.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.703+0000 7f872acfa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f872409e950 0x7f872413b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.703+0000 7f872acfa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f872409f430 0x7f872413baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.703+0000 7f872acfa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8724137010 0x7f872413c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.703+0000 7f872acfa700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8724123160 con 0x7f8724137010 2023-10-03T10:12:29.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.703+0000 7f872acfa700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872409dab0 con 0x7f872409f430 2023-10-03T10:12:29.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.703+0000 7f872acfa700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f872413ca10 con 0x7f872409e950 2023-10-03T10:12:29.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.703+0000 7f8728a96700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f872409e950 0x7f872413b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.703+0000 7f8723fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f872409f430 0x7f872413baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.703+0000 7f8723fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f872409f430 0x7f872413baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50074/0 (socket says 172.21.15.146:50074) 2023-10-03T10:12:29.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.703+0000 7f8723fff700 1 -- 172.21.15.146:0/1426536558 learned_addr learned my addr 172.21.15.146:0/1426536558 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:29.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.703+0000 7f8723fff700 1 -- 172.21.15.146:0/1426536558 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f872409e950 msgr2=0x7f872413b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.703+0000 7f8723fff700 1 --2- 172.21.15.146:0/1426536558 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f872409e950 0x7f872413b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.703+0000 7f8723fff700 1 -- 172.21.15.146:0/1426536558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8724137010 msgr2=0x7f872413c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.703+0000 7f8723fff700 1 --2- 172.21.15.146:0/1426536558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8724137010 0x7f872413c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.703+0000 7f8723fff700 1 -- 172.21.15.146:0/1426536558 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8710009550 con 0x7f872409f430 2023-10-03T10:12:29.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.704+0000 7f8723fff700 1 --2- 172.21.15.146:0/1426536558 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f872409f430 0x7f872413baf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f872406eff0 tx=0x7f8710004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:29.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.704+0000 7f87217fa700 1 -- 172.21.15.146:0/1426536558 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871000b660 con 0x7f872409f430 2023-10-03T10:12:29.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.704+0000 7f87217fa700 1 -- 172.21.15.146:0/1426536558 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871000b7c0 con 0x7f872409f430 2023-10-03T10:12:29.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.704+0000 7f872acfa700 1 -- 172.21.15.146:0/1426536558 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87240a4e30 con 0x7f872409f430 2023-10-03T10:12:29.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.704+0000 7f87217fa700 1 -- 172.21.15.146:0/1426536558 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871000bb70 con 0x7f872409f430 2023-10-03T10:12:29.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.704+0000 7f872acfa700 1 -- 172.21.15.146:0/1426536558 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8724123dc0 con 0x7f872409f430 2023-10-03T10:12:29.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.705+0000 7f87217fa700 1 -- 172.21.15.146:0/1426536558 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8710021070 con 0x7f872409f430 2023-10-03T10:12:29.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.705+0000 7f87217fa700 1 -- 172.21.15.146:0/1426536558 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f8710042ca0 con 0x7f872409f430 2023-10-03T10:12:29.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.705+0000 7f8728a96700 1 -- 172.21.15.146:0/1426536558 >> v1:172.21.15.146:6816/126749 conn(0x7f870802f510 legacy=0x7f87080319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:29.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.704+0000 7f35d57d1700 1 Processor -- start 2023-10-03T10:12:29.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.705+0000 7f35d57d1700 1 -- start start 2023-10-03T10:12:29.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.706+0000 7f35d57d1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35d009dcb0 0x7f35d013c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.706+0000 7f35d57d1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35d009e5e0 0x7f35d013cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.705+0000 7f872acfa700 1 -- 172.21.15.146:0/1426536558 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f872404f2a0 con 0x7f872409f430 2023-10-03T10:12:29.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.706+0000 7f35d57d1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35d012f7f0 0x7f35d012fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.706+0000 7f35d57d1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d012cd00 con 0x7f35d009e5e0 2023-10-03T10:12:29.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.706+0000 7f35d57d1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d00a0530 con 0x7f35d009dcb0 2023-10-03T10:12:29.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.706+0000 7f35d57d1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35d009c060 con 0x7f35d012f7f0 2023-10-03T10:12:29.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.706+0000 7f35ce7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35d009e5e0 0x7f35d013cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.706+0000 7f35ce7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35d009e5e0 0x7f35d013cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45352/0 (socket says 172.21.15.146:45352) 2023-10-03T10:12:29.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.706+0000 7f35ce7fc700 1 -- 172.21.15.146:0/3954490370 learned_addr learned my addr 172.21.15.146:0/3954490370 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:29.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.706+0000 7f35cf7fe700 1 --2- 172.21.15.146:0/3954490370 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35d012f7f0 0x7f35d012fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.706+0000 7f35ce7fc700 1 -- 172.21.15.146:0/3954490370 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35d012f7f0 msgr2=0x7f35d012fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.706+0000 7f35ce7fc700 1 --2- 172.21.15.146:0/3954490370 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35d012f7f0 0x7f35d012fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.706+0000 7f35ce7fc700 1 -- 172.21.15.146:0/3954490370 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35d009dcb0 msgr2=0x7f35d013c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.706+0000 7f35ce7fc700 1 --2- 172.21.15.146:0/3954490370 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35d009dcb0 0x7f35d013c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.706+0000 7f35ce7fc700 1 -- 172.21.15.146:0/3954490370 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c40094a0 con 0x7f35d009e5e0 2023-10-03T10:12:29.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.707+0000 7f35ce7fc700 1 --2- 172.21.15.146:0/3954490370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35d009e5e0 0x7f35d013cb60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f35c4000c00 tx=0x7f35c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:29.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.707+0000 7f35b77fe700 1 -- 172.21.15.146:0/3954490370 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4004340 con 0x7f35d009e5e0 2023-10-03T10:12:29.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.707+0000 7f35b77fe700 1 -- 172.21.15.146:0/3954490370 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c401f070 con 0x7f35d009e5e0 2023-10-03T10:12:29.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.707+0000 7f35d57d1700 1 -- 172.21.15.146:0/3954490370 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d012e9a0 con 0x7f35d009e5e0 2023-10-03T10:12:29.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.707+0000 7f35b77fe700 1 -- 172.21.15.146:0/3954490370 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c40036a0 con 0x7f35d009e5e0 2023-10-03T10:12:29.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.707+0000 7f35d57d1700 1 -- 172.21.15.146:0/3954490370 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d013d0a0 con 0x7f35d009e5e0 2023-10-03T10:12:29.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.708+0000 7f35b77fe700 1 -- 172.21.15.146:0/3954490370 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f35c4021030 con 0x7f35d009e5e0 2023-10-03T10:12:29.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.708+0000 7f35b77fe700 1 -- 172.21.15.146:0/3954490370 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f35c4040db0 con 0x7f35d009e5e0 2023-10-03T10:12:29.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.708+0000 7f35ceffd700 1 -- 172.21.15.146:0/3954490370 >> v1:172.21.15.146:6816/126749 conn(0x7f35bc02f510 legacy=0x7f35bc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:29.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.708+0000 7f35d57d1700 1 -- 172.21.15.146:0/3954490370 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d004f2a0 con 0x7f35d009e5e0 2023-10-03T10:12:29.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.711+0000 7f87217fa700 1 -- 172.21.15.146:0/1426536558 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8710042e60 con 0x7f872409f430 2023-10-03T10:12:29.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.713+0000 7f35b77fe700 1 -- 172.21.15.146:0/3954490370 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f35c40239c0 con 0x7f35d009e5e0 2023-10-03T10:12:29.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.715+0000 7f66c92ef700 1 Processor -- start 2023-10-03T10:12:29.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.715+0000 7f66c92ef700 1 -- start start 2023-10-03T10:12:29.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.716+0000 7f66c92ef700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f66c40a1510 0x7f66c41351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.716+0000 7f66c92ef700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66c41356e0 0x7f66c4137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.716+0000 7f66c92ef700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c40a1e70 con 0x7f66c40a0a30 2023-10-03T10:12:29.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.716+0000 7f66c92ef700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c409a720 con 0x7f66c41356e0 2023-10-03T10:12:29.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.716+0000 7f66c92ef700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66c409b300 con 0x7f66c40a1510 2023-10-03T10:12:29.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.716+0000 7f66c2ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f66c40a0a30 0x7f66c40a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35262/0 (socket says 172.21.15.146:35262) 2023-10-03T10:12:29.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.716+0000 7f66c2ffd700 1 -- 172.21.15.146:0/1995708683 learned_addr learned my addr 172.21.15.146:0/1995708683 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:29.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.716+0000 7f66c37fe700 1 --2- 172.21.15.146:0/1995708683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66c41356e0 0x7f66c4137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.716+0000 7f66c1ffb700 1 -- 172.21.15.146:0/1995708683 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618263030 0 0) 0x7f66c40a1e70 con 0x7f66c40a0a30 2023-10-03T10:12:29.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.716+0000 7f66c27fc700 1 --2- 172.21.15.146:0/1995708683 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f66c40a1510 0x7f66c41351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.716+0000 7f66c1ffb700 1 -- 172.21.15.146:0/1995708683 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66ac0035b0 con 0x7f66c40a0a30 2023-10-03T10:12:29.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.716+0000 7f66c37fe700 1 -- 172.21.15.146:0/1995708683 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f66c40a1510 msgr2=0x7f66c41351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:29.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.716+0000 7f66c37fe700 1 --2- 172.21.15.146:0/1995708683 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f66c40a1510 0x7f66c41351a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.716+0000 7f66c37fe700 1 -- 172.21.15.146:0/1995708683 >> v1:172.21.15.146:6789/0 conn(0x7f66c40a0a30 legacy=0x7f66c40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.716+0000 7f66c37fe700 1 -- 172.21.15.146:0/1995708683 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c409abc0 con 0x7f66c41356e0 2023-10-03T10:12:29.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.716+0000 7f66c27fc700 1 --2- 172.21.15.146:0/1995708683 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f66c40a1510 0x7f66c41351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:29.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.717+0000 7f66c37fe700 1 --2- 172.21.15.146:0/1995708683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66c41356e0 0x7f66c4137ac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f66bc009dc0 tx=0x7f66bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fd7e01f2c1749ec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:29.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.717+0000 7f66c1ffb700 1 -- 172.21.15.146:0/1995708683 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc00e070 con 0x7f66c41356e0 2023-10-03T10:12:29.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.717+0000 7f66c1ffb700 1 -- 172.21.15.146:0/1995708683 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66bc00bb20 con 0x7f66c41356e0 2023-10-03T10:12:29.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.717+0000 7f66c1ffb700 1 -- 172.21.15.146:0/1995708683 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc00be90 con 0x7f66c41356e0 2023-10-03T10:12:29.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.717+0000 7f66c92ef700 1 -- 172.21.15.146:0/1995708683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66c41356e0 msgr2=0x7f66c4137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.717+0000 7f66c92ef700 1 --2- 172.21.15.146:0/1995708683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66c41356e0 0x7f66c4137ac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f66bc009dc0 tx=0x7f66bc00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:29.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.717+0000 7f66c92ef700 1 -- 172.21.15.146:0/1995708683 shutdown_connections 2023-10-03T10:12:29.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.717+0000 7f66c92ef700 1 --2- 172.21.15.146:0/1995708683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66c41356e0 0x7f66c4137ac0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.717+0000 7f66c92ef700 1 --2- 172.21.15.146:0/1995708683 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f66c40a1510 0x7f66c41351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.717+0000 7f66c92ef700 1 -- 172.21.15.146:0/1995708683 >> 172.21.15.146:0/1995708683 conn(0x7f66c40a2980 msgr2=0x7f66c40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:29.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.718+0000 7f66c92ef700 1 -- 172.21.15.146:0/1995708683 shutdown_connections 2023-10-03T10:12:29.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.718+0000 7f66c92ef700 1 -- 172.21.15.146:0/1995708683 wait complete. 2023-10-03T10:12:29.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.719+0000 7f66c92ef700 1 Processor -- start 2023-10-03T10:12:29.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.719+0000 7f66c92ef700 1 -- start start 2023-10-03T10:12:29.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.719+0000 7f66c92ef700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f66c40a0a30 0x7f66c406ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.719+0000 7f66c92ef700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66c40a1510 0x7f66c406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.719+0000 7f66c92ef700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66c41356e0 0x7f66c406f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.719+0000 7f66c92ef700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c4071800 con 0x7f66c40a1510 2023-10-03T10:12:29.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.719+0000 7f66c92ef700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c409fb80 con 0x7f66c41356e0 2023-10-03T10:12:29.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.719+0000 7f66c92ef700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66c409ae00 con 0x7f66c40a0a30 2023-10-03T10:12:29.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.719+0000 7f66c2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f66c40a0a30 0x7f66c406ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.719+0000 7f66c27fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66c40a1510 0x7f66c406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.719+0000 7f66c37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66c41356e0 0x7f66c406f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.719+0000 7f66c2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f66c40a0a30 0x7f66c406ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49724/0 (socket says 172.21.15.146:49724) 2023-10-03T10:12:29.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.719+0000 7f66c27fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66c40a1510 0x7f66c406f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45354/0 (socket says 172.21.15.146:45354) 2023-10-03T10:12:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.719+0000 7f66c2ffd700 1 -- 172.21.15.146:0/2488556593 learned_addr learned my addr 172.21.15.146:0/2488556593 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.720+0000 7f66c37fe700 1 -- 172.21.15.146:0/2488556593 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f66c40a0a30 msgr2=0x7f66c406ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.720+0000 7f66c37fe700 1 --2- 172.21.15.146:0/2488556593 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f66c40a0a30 0x7f66c406ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.720+0000 7f66c37fe700 1 -- 172.21.15.146:0/2488556593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66c40a1510 msgr2=0x7f66c406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.720+0000 7f66c37fe700 1 --2- 172.21.15.146:0/2488556593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66c40a1510 0x7f66c406f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.720+0000 7f66c37fe700 1 -- 172.21.15.146:0/2488556593 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc009a70 con 0x7f66c41356e0 2023-10-03T10:12:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.720+0000 7f66c37fe700 1 --2- 172.21.15.146:0/2488556593 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66c41356e0 0x7f66c406f6f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f66bc016000 tx=0x7f66bc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.720+0000 7f66ab7fe700 1 -- 172.21.15.146:0/2488556593 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc004880 con 0x7f66c41356e0 2023-10-03T10:12:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.720+0000 7f66ab7fe700 1 -- 172.21.15.146:0/2488556593 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66bc020070 con 0x7f66c41356e0 2023-10-03T10:12:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.720+0000 7f66ab7fe700 1 -- 172.21.15.146:0/2488556593 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc0276c0 con 0x7f66c41356e0 2023-10-03T10:12:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.720+0000 7f66c92ef700 1 -- 172.21.15.146:0/2488556593 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c406ff30 con 0x7f66c41356e0 2023-10-03T10:12:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.720+0000 7f66c92ef700 1 -- 172.21.15.146:0/2488556593 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c4118df0 con 0x7f66c41356e0 2023-10-03T10:12:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.721+0000 7f66c92ef700 1 -- 172.21.15.146:0/2488556593 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c404f2a0 con 0x7f66c41356e0 2023-10-03T10:12:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.721+0000 7f66ab7fe700 1 -- 172.21.15.146:0/2488556593 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f66bc012430 con 0x7f66c41356e0 2023-10-03T10:12:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.721+0000 7f66ab7fe700 1 -- 172.21.15.146:0/2488556593 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f66bc022070 con 0x7f66c41356e0 2023-10-03T10:12:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.722+0000 7f66c2ffd700 1 -- 172.21.15.146:0/2488556593 >> v1:172.21.15.146:6816/126749 conn(0x7f66b002f560 legacy=0x7f66b0031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.726+0000 7f66ab7fe700 1 -- 172.21.15.146:0/2488556593 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66bc012e40 con 0x7f66c41356e0 2023-10-03T10:12:29.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.871+0000 7f67fe59c700 1 -- 172.21.15.146:0/2703447817 >> v1:172.21.15.146:6816/126749 conn(0x7f67ec02f510 legacy=0x7f67ec0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:29.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.886+0000 7f6805005700 1 -- 172.21.15.146:0/2703447817 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f68000a2e70 con 0x7f6800099a60 2023-10-03T10:12:29.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.886+0000 7f67e77fe700 1 -- 172.21.15.146:0/2703447817 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f67f0016020 con 0x7f6800099a60 2023-10-03T10:12:29.887 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:29.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.888+0000 7f6805005700 1 -- 172.21.15.146:0/2703447817 >> v1:172.21.15.146:6816/126749 conn(0x7f67ec02f510 legacy=0x7f67ec0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:29.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.888+0000 7f6805005700 1 -- 172.21.15.146:0/2703447817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6800099a60 msgr2=0x7f680011cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.888+0000 7f6805005700 1 --2- 172.21.15.146:0/2703447817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6800099a60 0x7f680011cbd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009c10 tx=0x7f67f0004750 comp rx=0 tx=0).stop 2023-10-03T10:12:29.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.889+0000 7f6805005700 1 -- 172.21.15.146:0/2703447817 shutdown_connections 2023-10-03T10:12:29.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.889+0000 7f6805005700 1 --2- 172.21.15.146:0/2703447817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6800133b80 0x7f680011d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.889+0000 7f6805005700 1 --2- 172.21.15.146:0/2703447817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6800099a60 0x7f680011cbd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.889+0000 7f6805005700 1 --2- 172.21.15.146:0/2703447817 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f68000a0e20 0x7f680011d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.889+0000 7f6805005700 1 -- 172.21.15.146:0/2703447817 >> 172.21.15.146:0/2703447817 conn(0x7f68000a2980 msgr2=0x7f680009f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:29.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.889+0000 7f6805005700 1 -- 172.21.15.146:0/2703447817 shutdown_connections 2023-10-03T10:12:29.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.889+0000 7f6805005700 1 -- 172.21.15.146:0/2703447817 wait complete. 2023-10-03T10:12:29.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:29.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.906+0000 7f8728a96700 1 -- 172.21.15.146:0/1426536558 >> v1:172.21.15.146:6816/126749 conn(0x7f870802f510 legacy=0x7f87080319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:29.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.909+0000 7f35ceffd700 1 -- 172.21.15.146:0/3954490370 >> v1:172.21.15.146:6816/126749 conn(0x7f35bc02f510 legacy=0x7f35bc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.921+0000 7f35d57d1700 1 -- 172.21.15.146:0/3954490370 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f35d006b720 con 0x7f35d009e5e0 2023-10-03T10:12:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.921+0000 7f35b77fe700 1 -- 172.21.15.146:0/3954490370 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f35c40233d0 con 0x7f35d009e5e0 2023-10-03T10:12:29.922 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.921+0000 7f66c92ef700 1 -- 172.21.15.146:0/2488556593 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f66c406bce0 con 0x7f66c41356e0 2023-10-03T10:12:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.922+0000 7f66ab7fe700 1 -- 172.21.15.146:0/2488556593 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f66bc0303e0 con 0x7f66c41356e0 2023-10-03T10:12:29.923 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:29.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.923+0000 7f66c2ffd700 1 -- 172.21.15.146:0/2488556593 >> v1:172.21.15.146:6816/126749 conn(0x7f66b002f560 legacy=0x7f66b0031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:29.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.923+0000 7f35d57d1700 1 -- 172.21.15.146:0/3954490370 >> v1:172.21.15.146:6816/126749 conn(0x7f35bc02f510 legacy=0x7f35bc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:29.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.923+0000 7f35d57d1700 1 -- 172.21.15.146:0/3954490370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35d009e5e0 msgr2=0x7f35d013cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.923+0000 7f35d57d1700 1 --2- 172.21.15.146:0/3954490370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35d009e5e0 0x7f35d013cb60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f35c4000c00 tx=0x7f35c4004750 comp rx=0 tx=0).stop 2023-10-03T10:12:29.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.923+0000 7f35d57d1700 1 -- 172.21.15.146:0/3954490370 shutdown_connections 2023-10-03T10:12:29.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.923+0000 7f35d57d1700 1 --2- 172.21.15.146:0/3954490370 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35d012f7f0 0x7f35d012fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.923+0000 7f35d57d1700 1 --2- 172.21.15.146:0/3954490370 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35d009dcb0 0x7f35d013c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.923+0000 7f35d57d1700 1 --2- 172.21.15.146:0/3954490370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35d009e5e0 0x7f35d013cb60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.923+0000 7f35d57d1700 1 -- 172.21.15.146:0/3954490370 >> 172.21.15.146:0/3954490370 conn(0x7f35d00a2eb0 msgr2=0x7f35d0071140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.923+0000 7f35d57d1700 1 -- 172.21.15.146:0/3954490370 shutdown_connections 2023-10-03T10:12:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.923+0000 7f35d57d1700 1 -- 172.21.15.146:0/3954490370 wait complete. 2023-10-03T10:12:29.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.924+0000 7f66c92ef700 1 -- 172.21.15.146:0/2488556593 >> v1:172.21.15.146:6816/126749 conn(0x7f66b002f560 legacy=0x7f66b0031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:29.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.924+0000 7f66c92ef700 1 -- 172.21.15.146:0/2488556593 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66c41356e0 msgr2=0x7f66c406f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.924+0000 7f66c92ef700 1 --2- 172.21.15.146:0/2488556593 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66c41356e0 0x7f66c406f6f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f66bc016000 tx=0x7f66bc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.924+0000 7f66c92ef700 1 -- 172.21.15.146:0/2488556593 shutdown_connections 2023-10-03T10:12:29.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.924+0000 7f66c92ef700 1 --2- 172.21.15.146:0/2488556593 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66c41356e0 0x7f66c406f6f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.924+0000 7f66c92ef700 1 --2- 172.21.15.146:0/2488556593 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f66c40a0a30 0x7f66c406ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.924+0000 7f66c92ef700 1 --2- 172.21.15.146:0/2488556593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66c40a1510 0x7f66c406f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.924+0000 7f66c92ef700 1 -- 172.21.15.146:0/2488556593 >> 172.21.15.146:0/2488556593 conn(0x7f66c40a2980 msgr2=0x7f66c409e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:29.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.924+0000 7f66c92ef700 1 -- 172.21.15.146:0/2488556593 shutdown_connections 2023-10-03T10:12:29.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.924+0000 7f66c92ef700 1 -- 172.21.15.146:0/2488556593 wait complete. 2023-10-03T10:12:29.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.924+0000 7f872acfa700 1 -- 172.21.15.146:0/1426536558 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f872409b8b0 con 0x7f872409f430 2023-10-03T10:12:29.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.925+0000 7f87217fa700 1 -- 172.21.15.146:0/1426536558 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8710046060 con 0x7f872409f430 2023-10-03T10:12:29.927 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:29.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.927+0000 7f872acfa700 1 -- 172.21.15.146:0/1426536558 >> v1:172.21.15.146:6816/126749 conn(0x7f870802f510 legacy=0x7f87080319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:29.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.927+0000 7f872acfa700 1 -- 172.21.15.146:0/1426536558 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f872409f430 msgr2=0x7f872413baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.927+0000 7f872acfa700 1 --2- 172.21.15.146:0/1426536558 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f872409f430 0x7f872413baf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f872406eff0 tx=0x7f8710004750 comp rx=0 tx=0).stop 2023-10-03T10:12:29.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.927+0000 7f872acfa700 1 -- 172.21.15.146:0/1426536558 shutdown_connections 2023-10-03T10:12:29.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.927+0000 7f872acfa700 1 --2- 172.21.15.146:0/1426536558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8724137010 0x7f872413c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.927+0000 7f872acfa700 1 --2- 172.21.15.146:0/1426536558 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f872409e950 0x7f872413b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.927+0000 7f872acfa700 1 --2- 172.21.15.146:0/1426536558 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f872409f430 0x7f872413baf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.927+0000 7f872acfa700 1 -- 172.21.15.146:0/1426536558 >> 172.21.15.146:0/1426536558 conn(0x7f87240a0f70 msgr2=0x7f872406d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:29.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.927+0000 7f872acfa700 1 -- 172.21.15.146:0/1426536558 shutdown_connections 2023-10-03T10:12:29.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:29.927+0000 7f872acfa700 1 -- 172.21.15.146:0/1426536558 wait complete. 2023-10-03T10:12:29.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:29.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:29.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:30.903 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:30.941 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:30.941 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:30.943 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:31.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.056+0000 7f16ae18c700 1 Processor -- start 2023-10-03T10:12:31.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.056+0000 7f16ae18c700 1 -- start start 2023-10-03T10:12:31.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.057+0000 7f16ae18c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16a809e870 0x7f16a809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.057+0000 7f16ae18c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16a809f180 0x7f16a8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.057+0000 7f16ae18c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a809c970 con 0x7f16a8131d70 2023-10-03T10:12:31.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.057+0000 7f16ae18c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a80a0920 con 0x7f16a809e870 2023-10-03T10:12:31.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.057+0000 7f16ae18c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16a809f9c0 con 0x7f16a809f180 2023-10-03T10:12:31.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.057+0000 7f16a77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16a809e870 0x7f16a809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.057+0000 7f16a77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16a809e870 0x7f16a809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50102/0 (socket says 172.21.15.146:50102) 2023-10-03T10:12:31.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.057+0000 7f16a77fe700 1 -- 172.21.15.146:0/2137656923 learned_addr learned my addr 172.21.15.146:0/2137656923 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:31.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.057+0000 7f16a6ffd700 1 --2- 172.21.15.146:0/2137656923 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16a809f180 0x7f16a8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.058+0000 7f16a6ffd700 1 -- 172.21.15.146:0/2137656923 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16a809e870 msgr2=0x7f16a809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:31.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.058+0000 7f16a6ffd700 1 --2- 172.21.15.146:0/2137656923 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16a809e870 0x7f16a809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.058+0000 7f16a6ffd700 1 -- 172.21.15.146:0/2137656923 >> v1:172.21.15.146:6789/0 conn(0x7f16a8131d70 legacy=0x7f16a8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.058+0000 7f16a6ffd700 1 -- 172.21.15.146:0/2137656923 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a809bab0 con 0x7f16a809f180 2023-10-03T10:12:31.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.058+0000 7f16a6ffd700 1 --2- 172.21.15.146:0/2137656923 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16a809f180 0x7f16a8131830 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f169c009870 tx=0x7f169c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=751fa2b40b68e46a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:31.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.058+0000 7f16a67fc700 1 -- 172.21.15.146:0/2137656923 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c011830 con 0x7f16a809f180 2023-10-03T10:12:31.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.058+0000 7f16a67fc700 1 -- 172.21.15.146:0/2137656923 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c011990 con 0x7f16a809f180 2023-10-03T10:12:31.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.058+0000 7f16a67fc700 1 -- 172.21.15.146:0/2137656923 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c011d20 con 0x7f16a809f180 2023-10-03T10:12:31.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.059+0000 7f16ae18c700 1 -- 172.21.15.146:0/2137656923 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16a809f180 msgr2=0x7f16a8131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.059+0000 7f16ae18c700 1 --2- 172.21.15.146:0/2137656923 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16a809f180 0x7f16a8131830 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f169c009870 tx=0x7f169c009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:31.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.059+0000 7f16ae18c700 1 -- 172.21.15.146:0/2137656923 shutdown_connections 2023-10-03T10:12:31.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.059+0000 7f16ae18c700 1 --2- 172.21.15.146:0/2137656923 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16a809e870 0x7f16a809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.059+0000 7f16ae18c700 1 --2- 172.21.15.146:0/2137656923 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16a809f180 0x7f16a8131830 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.059+0000 7f16ae18c700 1 -- 172.21.15.146:0/2137656923 >> 172.21.15.146:0/2137656923 conn(0x7f16a80a4430 msgr2=0x7f16a80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:31.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.059+0000 7f16ae18c700 1 -- 172.21.15.146:0/2137656923 shutdown_connections 2023-10-03T10:12:31.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.059+0000 7f16ae18c700 1 -- 172.21.15.146:0/2137656923 wait complete. 2023-10-03T10:12:31.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.060+0000 7f16ae18c700 1 Processor -- start 2023-10-03T10:12:31.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.060+0000 7f16ae18c700 1 -- start start 2023-10-03T10:12:31.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.061+0000 7f16ae18c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16a809e870 0x7f16a81227c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.061+0000 7f16ae18c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a809f180 0x7f16a8122d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.061+0000 7f16ae18c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16a8131d70 0x7f16a8123240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.061+0000 7f16ae18c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a8124a00 con 0x7f16a809f180 2023-10-03T10:12:31.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.061+0000 7f16ae18c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a809dba0 con 0x7f16a809e870 2023-10-03T10:12:31.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.061+0000 7f16ae18c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16a80a2ba0 con 0x7f16a8131d70 2023-10-03T10:12:31.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.061+0000 7f16a6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a809f180 0x7f16a8122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.061+0000 7f16a6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a809f180 0x7f16a8122d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45362/0 (socket says 172.21.15.146:45362) 2023-10-03T10:12:31.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.061+0000 7f16a6ffd700 1 -- 172.21.15.146:0/1099997823 learned_addr learned my addr 172.21.15.146:0/1099997823 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:31.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.061+0000 7f16a7fff700 1 --2- 172.21.15.146:0/1099997823 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16a8131d70 0x7f16a8123240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.061+0000 7f16a77fe700 1 --2- 172.21.15.146:0/1099997823 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16a809e870 0x7f16a81227c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.061+0000 7f16a6ffd700 1 -- 172.21.15.146:0/1099997823 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16a8131d70 msgr2=0x7f16a8123240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.061+0000 7f16a6ffd700 1 --2- 172.21.15.146:0/1099997823 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16a8131d70 0x7f16a8123240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.061+0000 7f16a6ffd700 1 -- 172.21.15.146:0/1099997823 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16a809e870 msgr2=0x7f16a81227c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.061+0000 7f16a6ffd700 1 --2- 172.21.15.146:0/1099997823 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16a809e870 0x7f16a81227c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.061+0000 7f16a6ffd700 1 -- 172.21.15.146:0/1099997823 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c0094a0 con 0x7f16a809f180 2023-10-03T10:12:31.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.061+0000 7f16a7fff700 1 --2- 172.21.15.146:0/1099997823 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16a8131d70 0x7f16a8123240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:31.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.062+0000 7f16a77fe700 1 --2- 172.21.15.146:0/1099997823 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16a809e870 0x7f16a81227c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:31.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.062+0000 7f16a6ffd700 1 --2- 172.21.15.146:0/1099997823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a809f180 0x7f16a8122d00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f169c009bc0 tx=0x7f169c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:31.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.062+0000 7f168ffff700 1 -- 172.21.15.146:0/1099997823 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c004450 con 0x7f16a809f180 2023-10-03T10:12:31.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.062+0000 7f168ffff700 1 -- 172.21.15.146:0/1099997823 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c01f070 con 0x7f16a809f180 2023-10-03T10:12:31.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.062+0000 7f168ffff700 1 -- 172.21.15.146:0/1099997823 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c0038e0 con 0x7f16a809f180 2023-10-03T10:12:31.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.062+0000 7f16ae18c700 1 -- 172.21.15.146:0/1099997823 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a8125a70 con 0x7f16a809f180 2023-10-03T10:12:31.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.062+0000 7f16ae18c700 1 -- 172.21.15.146:0/1099997823 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a8124bc0 con 0x7f16a809f180 2023-10-03T10:12:31.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.063+0000 7f168ffff700 1 -- 172.21.15.146:0/1099997823 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f169c003a40 con 0x7f16a809f180 2023-10-03T10:12:31.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.063+0000 7f16ae18c700 1 -- 172.21.15.146:0/1099997823 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a804f2a0 con 0x7f16a809f180 2023-10-03T10:12:31.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.063+0000 7f168ffff700 1 -- 172.21.15.146:0/1099997823 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f169c021070 con 0x7f16a809f180 2023-10-03T10:12:31.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.063+0000 7f16a77fe700 1 -- 172.21.15.146:0/1099997823 >> v1:172.21.15.146:6816/126749 conn(0x7f169402f510 legacy=0x7f16940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:31.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.068+0000 7f168ffff700 1 -- 172.21.15.146:0/1099997823 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f169c02b020 con 0x7f16a809f180 2023-10-03T10:12:31.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.084+0000 7f4c4999e700 1 Processor -- start 2023-10-03T10:12:31.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.084+0000 7f87b5af8700 1 Processor -- start 2023-10-03T10:12:31.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.084+0000 7f87b5af8700 1 -- start start 2023-10-03T10:12:31.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.084+0000 7f4c4999e700 1 -- start start 2023-10-03T10:12:31.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f87b5af8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87b01368e0 0x7f87b0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f87b5af8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87b0139200 0x7f87b013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f87b5af8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b009a760 con 0x7f87b0133900 2023-10-03T10:12:31.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f87b5af8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b01336e0 con 0x7f87b01368e0 2023-10-03T10:12:31.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f87b5af8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87b009a080 con 0x7f87b0139200 2023-10-03T10:12:31.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f87aeffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87b01368e0 0x7f87b0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f87affff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87b0139200 0x7f87b013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f87aeffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87b01368e0 0x7f87b0138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50120/0 (socket says 172.21.15.146:50120) 2023-10-03T10:12:31.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f87aeffd700 1 -- 172.21.15.146:0/755321342 learned_addr learned my addr 172.21.15.146:0/755321342 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:31.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f4c4999e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4409e950 0x7f4c44138920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f4c4999e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4c44138e60 0x7f4c4413b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f4c4999e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4409fdf0 con 0x7f4c4409de70 2023-10-03T10:12:31.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f4c4999e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c440a0050 con 0x7f4c44138e60 2023-10-03T10:12:31.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f4c4999e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4406ffb0 con 0x7f4c4409e950 2023-10-03T10:12:31.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f4c43fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4409e950 0x7f4c44138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f4c43fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4409e950 0x7f4c44138920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50116/0 (socket says 172.21.15.146:50116) 2023-10-03T10:12:31.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f4c43fff700 1 -- 172.21.15.146:0/2459155483 learned_addr learned my addr 172.21.15.146:0/2459155483 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:31.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f4c4919d700 1 --2- 172.21.15.146:0/2459155483 >> v2:172.21.15.146:3300/0 conn(0x7f4c44138e60 0x7f4c4413b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f87ae7fc700 1 -- 172.21.15.146:0/755321342 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1206559037 0 0) 0x7f87b009a760 con 0x7f87b0133900 2023-10-03T10:12:31.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f87ae7fc700 1 -- 172.21.15.146:0/755321342 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87980035b0 con 0x7f87b0133900 2023-10-03T10:12:31.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f4c43fff700 1 -- 172.21.15.146:0/2459155483 >> v2:172.21.15.146:3300/0 conn(0x7f4c44138e60 msgr2=0x7f4c4413b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:31.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f4c43fff700 1 --2- 172.21.15.146:0/2459155483 >> v2:172.21.15.146:3300/0 conn(0x7f4c44138e60 0x7f4c4413b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f4c43fff700 1 -- 172.21.15.146:0/2459155483 >> v1:172.21.15.146:6789/0 conn(0x7f4c4409de70 legacy=0x7f4c4409e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:31.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.085+0000 7f4c43fff700 1 -- 172.21.15.146:0/2459155483 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4406b670 con 0x7f4c4409e950 2023-10-03T10:12:31.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.086+0000 7f87aeffd700 1 -- 172.21.15.146:0/755321342 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87b0139200 msgr2=0x7f87b013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:31.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.086+0000 7f87aeffd700 1 --2- 172.21.15.146:0/755321342 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87b0139200 0x7f87b013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.086+0000 7f87aeffd700 1 -- 172.21.15.146:0/755321342 >> v1:172.21.15.146:6789/0 conn(0x7f87b0133900 legacy=0x7f87b0133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.086+0000 7f87aeffd700 1 -- 172.21.15.146:0/755321342 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b00a23e0 con 0x7f87b01368e0 2023-10-03T10:12:31.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.086+0000 7f4c43fff700 1 --2- 172.21.15.146:0/2459155483 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4409e950 0x7f4c44138920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4c300098f0 tx=0x7f4c30009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15eef9d820ee1896 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:31.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.086+0000 7f87affff700 1 --2- 172.21.15.146:0/755321342 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87b0139200 0x7f87b013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:31.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.086+0000 7f87aeffd700 1 --2- 172.21.15.146:0/755321342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87b01368e0 0x7f87b0138cc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f87a4009920 tx=0x7f87a4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b707090981c31b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:31.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.086+0000 7f4c437fe700 1 -- 172.21.15.146:0/2459155483 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c30004230 con 0x7f4c4409e950 2023-10-03T10:12:31.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.086+0000 7f87ae7fc700 1 -- 172.21.15.146:0/755321342 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4011830 con 0x7f87b01368e0 2023-10-03T10:12:31.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.086+0000 7f4c437fe700 1 -- 172.21.15.146:0/2459155483 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c30004390 con 0x7f4c4409e950 2023-10-03T10:12:31.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.086+0000 7f4c437fe700 1 -- 172.21.15.146:0/2459155483 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c300036a0 con 0x7f4c4409e950 2023-10-03T10:12:31.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.086+0000 7f87ae7fc700 1 -- 172.21.15.146:0/755321342 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a4011990 con 0x7f87b01368e0 2023-10-03T10:12:31.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.086+0000 7f87ae7fc700 1 -- 172.21.15.146:0/755321342 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4011d20 con 0x7f87b01368e0 2023-10-03T10:12:31.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.087+0000 7f87b5af8700 1 -- 172.21.15.146:0/755321342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87b01368e0 msgr2=0x7f87b0138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.087+0000 7f87b5af8700 1 --2- 172.21.15.146:0/755321342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87b01368e0 0x7f87b0138cc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f87a4009920 tx=0x7f87a4009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:31.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.087+0000 7f4c4999e700 1 -- 172.21.15.146:0/2459155483 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4409e950 msgr2=0x7f4c44138920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.087+0000 7f4c4999e700 1 --2- 172.21.15.146:0/2459155483 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4409e950 0x7f4c44138920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4c300098f0 tx=0x7f4c30009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:31.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.087+0000 7f87b5af8700 1 -- 172.21.15.146:0/755321342 shutdown_connections 2023-10-03T10:12:31.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.087+0000 7f87b5af8700 1 --2- 172.21.15.146:0/755321342 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87b0139200 0x7f87b013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.087+0000 7f4c4999e700 1 -- 172.21.15.146:0/2459155483 shutdown_connections 2023-10-03T10:12:31.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.087+0000 7f87b5af8700 1 --2- 172.21.15.146:0/755321342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87b01368e0 0x7f87b0138cc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.087+0000 7f87b5af8700 1 -- 172.21.15.146:0/755321342 >> 172.21.15.146:0/755321342 conn(0x7f87b00a2980 msgr2=0x7f87b00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:31.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.087+0000 7f4c4999e700 1 --2- 172.21.15.146:0/2459155483 >> v2:172.21.15.146:3300/0 conn(0x7f4c44138e60 0x7f4c4413b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.087+0000 7f4c4999e700 1 --2- 172.21.15.146:0/2459155483 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4409e950 0x7f4c44138920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.087+0000 7f4c4999e700 1 -- 172.21.15.146:0/2459155483 >> 172.21.15.146:0/2459155483 conn(0x7f4c440a27a0 msgr2=0x7f4c440a2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:31.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.087+0000 7f87b5af8700 1 -- 172.21.15.146:0/755321342 shutdown_connections 2023-10-03T10:12:31.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.087+0000 7f4c4999e700 1 -- 172.21.15.146:0/2459155483 shutdown_connections 2023-10-03T10:12:31.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.087+0000 7f4c4999e700 1 -- 172.21.15.146:0/2459155483 wait complete. 2023-10-03T10:12:31.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.087+0000 7f87b5af8700 1 -- 172.21.15.146:0/755321342 wait complete. 2023-10-03T10:12:31.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.088+0000 7f87b5af8700 1 Processor -- start 2023-10-03T10:12:31.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.088+0000 7f4c4999e700 1 Processor -- start 2023-10-03T10:12:31.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.088+0000 7f87b5af8700 1 -- start start 2023-10-03T10:12:31.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.088+0000 7f87b5af8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87b0133900 0x7f87b0119c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.088+0000 7f87b5af8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87b01368e0 0x7f87b011a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.088+0000 7f87b5af8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87b0139200 0x7f87b011a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.088+0000 7f87b5af8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b011cb40 con 0x7f87b0139200 2023-10-03T10:12:31.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f87b5af8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b011c0e0 con 0x7f87b01368e0 2023-10-03T10:12:31.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f87b5af8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87b011d790 con 0x7f87b0133900 2023-10-03T10:12:31.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f87af7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87b0133900 0x7f87b0119c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f87af7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87b0133900 0x7f87b0119c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49766/0 (socket says 172.21.15.146:49766) 2023-10-03T10:12:31.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f87af7fe700 1 -- 172.21.15.146:0/1392890216 learned_addr learned my addr 172.21.15.146:0/1392890216 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:31.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f87affff700 1 --2- 172.21.15.146:0/1392890216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87b0139200 0x7f87b011a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f87aeffd700 1 --2- 172.21.15.146:0/1392890216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87b01368e0 0x7f87b011a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.088+0000 7f4c4999e700 1 -- start start 2023-10-03T10:12:31.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f4c4999e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4409de70 0x7f4c44136fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f4c4999e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4c4409e950 0x7f4c44137510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f4c4999e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c44138e60 0x7f4c441cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f4c4999e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c44138400 con 0x7f4c44138e60 2023-10-03T10:12:31.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f4c4999e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c440a0530 con 0x7f4c4409de70 2023-10-03T10:12:31.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f4c4999e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4406f4b0 con 0x7f4c4409e950 2023-10-03T10:12:31.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f4c4919d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c44138e60 0x7f4c441cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f4c4919d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c44138e60 0x7f4c441cc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45390/0 (socket says 172.21.15.146:45390) 2023-10-03T10:12:31.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f4c4919d700 1 -- 172.21.15.146:0/2179813974 learned_addr learned my addr 172.21.15.146:0/2179813974 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:31.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f4c43fff700 1 --2- 172.21.15.146:0/2179813974 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4c4409e950 0x7f4c44137510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f4c4899c700 1 --2- 172.21.15.146:0/2179813974 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4409de70 0x7f4c44136fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f4c4919d700 1 -- 172.21.15.146:0/2179813974 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4c4409e950 msgr2=0x7f4c44137510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f4c4919d700 1 --2- 172.21.15.146:0/2179813974 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4c4409e950 0x7f4c44137510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f4c4919d700 1 -- 172.21.15.146:0/2179813974 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4409de70 msgr2=0x7f4c44136fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f4c4919d700 1 --2- 172.21.15.146:0/2179813974 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4409de70 0x7f4c44136fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f4c4919d700 1 -- 172.21.15.146:0/2179813974 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c30009550 con 0x7f4c44138e60 2023-10-03T10:12:31.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f4c4899c700 1 --2- 172.21.15.146:0/2179813974 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4409de70 0x7f4c44136fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:31.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f87affff700 1 -- 172.21.15.146:0/1392890216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87b0133900 msgr2=0x7f87b0119c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f87affff700 1 --2- 172.21.15.146:0/1392890216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87b0133900 0x7f87b0119c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f87affff700 1 -- 172.21.15.146:0/1392890216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87b01368e0 msgr2=0x7f87b011a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f87affff700 1 --2- 172.21.15.146:0/1392890216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87b01368e0 0x7f87b011a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.090+0000 7f87affff700 1 -- 172.21.15.146:0/1392890216 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a8009a70 con 0x7f87b0139200 2023-10-03T10:12:31.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.089+0000 7f4c4919d700 1 --2- 172.21.15.146:0/2179813974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c44138e60 0x7f4c441cc480 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c007e70 tx=0x7f4c3c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:31.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.090+0000 7f4c417fa700 1 -- 172.21.15.146:0/2179813974 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c00ede0 con 0x7f4c44138e60 2023-10-03T10:12:31.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.090+0000 7f87affff700 1 --2- 172.21.15.146:0/1392890216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87b0139200 0x7f87b011a6f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f87a800efc0 tx=0x7f87a800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:31.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.090+0000 7f4c4999e700 1 -- 172.21.15.146:0/2179813974 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c44136d10 con 0x7f4c44138e60 2023-10-03T10:12:31.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.090+0000 7f4c4999e700 1 -- 172.21.15.146:0/2179813974 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c44121970 con 0x7f4c44138e60 2023-10-03T10:12:31.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.090+0000 7f4c417fa700 1 -- 172.21.15.146:0/2179813974 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c01e460 con 0x7f4c44138e60 2023-10-03T10:12:31.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.090+0000 7f4c417fa700 1 -- 172.21.15.146:0/2179813974 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c01e7d0 con 0x7f4c44138e60 2023-10-03T10:12:31.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.090+0000 7f8797fff700 1 -- 172.21.15.146:0/1392890216 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a800cb40 con 0x7f87b0139200 2023-10-03T10:12:31.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.090+0000 7f8797fff700 1 -- 172.21.15.146:0/1392890216 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a800f040 con 0x7f87b0139200 2023-10-03T10:12:31.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.090+0000 7f87b5af8700 1 -- 172.21.15.146:0/1392890216 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a4009550 con 0x7f87b0139200 2023-10-03T10:12:31.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.090+0000 7f87b5af8700 1 -- 172.21.15.146:0/1392890216 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b009a2c0 con 0x7f87b0139200 2023-10-03T10:12:31.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.091+0000 7f4c4999e700 1 -- 172.21.15.146:0/2179813974 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c240052e0 con 0x7f4c44138e60 2023-10-03T10:12:31.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.091+0000 7f8797fff700 1 -- 172.21.15.146:0/1392890216 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a800cee0 con 0x7f87b0139200 2023-10-03T10:12:31.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.091+0000 7f4c417fa700 1 -- 172.21.15.146:0/2179813974 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4c3c01e930 con 0x7f4c44138e60 2023-10-03T10:12:31.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.092+0000 7f8797fff700 1 -- 172.21.15.146:0/1392890216 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f87a8014480 con 0x7f87b0139200 2023-10-03T10:12:31.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.092+0000 7f8797fff700 1 -- 172.21.15.146:0/1392890216 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f87a8040400 con 0x7f87b0139200 2023-10-03T10:12:31.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.092+0000 7f87af7fe700 1 -- 172.21.15.146:0/1392890216 >> v1:172.21.15.146:6816/126749 conn(0x7f879c02f560 legacy=0x7f879c031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:31.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.093+0000 7f4c4899c700 1 -- 172.21.15.146:0/2179813974 >> v1:172.21.15.146:6816/126749 conn(0x7f4c2802f510 legacy=0x7f4c280319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:31.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.093+0000 7f87b5af8700 1 -- 172.21.15.146:0/1392890216 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b011d5d0 con 0x7f87b0139200 2023-10-03T10:12:31.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.095+0000 7f4c417fa700 1 -- 172.21.15.146:0/2179813974 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f4c3c01c9b0 con 0x7f4c44138e60 2023-10-03T10:12:31.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.097+0000 7f4c417fa700 1 -- 172.21.15.146:0/2179813974 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c3c070750 con 0x7f4c44138e60 2023-10-03T10:12:31.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.101+0000 7fd40eaa7700 1 Processor -- start 2023-10-03T10:12:31.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.101+0000 7fd40eaa7700 1 -- start start 2023-10-03T10:12:31.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.101+0000 7fd40eaa7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd4080a0a30 0x7fd4080a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.101+0000 7fd40eaa7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4080a1340 0x7fd40812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.101+0000 7fd40eaa7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080a1e70 con 0x7fd4081304a0 2023-10-03T10:12:31.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.101+0000 7fd40eaa7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40809a720 con 0x7fd4080a0a30 2023-10-03T10:12:31.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.101+0000 7fd40eaa7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40809b300 con 0x7fd4080a1340 2023-10-03T10:12:31.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.101+0000 7fd40c843700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd4080a0a30 0x7fd4080a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.102+0000 7fd40d044700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd4081304a0 0x7fd4081371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35292/0 (socket says 172.21.15.146:35292) 2023-10-03T10:12:31.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.102+0000 7fd40d044700 1 -- 172.21.15.146:0/2973526974 learned_addr learned my addr 172.21.15.146:0/2973526974 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:31.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.102+0000 7fd407fff700 1 --2- 172.21.15.146:0/2973526974 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4080a1340 0x7fd40812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.102+0000 7fd40c843700 1 -- 172.21.15.146:0/2973526974 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4080a1340 msgr2=0x7fd40812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:31.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.102+0000 7fd40c843700 1 --2- 172.21.15.146:0/2973526974 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4080a1340 0x7fd40812ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.102+0000 7fd40c843700 1 -- 172.21.15.146:0/2973526974 >> v1:172.21.15.146:6789/0 conn(0x7fd4081304a0 legacy=0x7fd4081371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.102+0000 7fd40c843700 1 -- 172.21.15.146:0/2973526974 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40809abc0 con 0x7fd4080a0a30 2023-10-03T10:12:31.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.102+0000 7fd40c843700 1 --2- 172.21.15.146:0/2973526974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4080a0a30 0x7fd4080a0e00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00dde0 tx=0x7fd3fc00f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4e9737e61bca10 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:31.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.105+0000 7fd4077fe700 1 -- 172.21.15.146:0/2973526974 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc012070 con 0x7fd4080a0a30 2023-10-03T10:12:31.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.105+0000 7fd4077fe700 1 -- 172.21.15.146:0/2973526974 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc00fbd0 con 0x7fd4080a0a30 2023-10-03T10:12:31.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.106+0000 7fd4077fe700 1 -- 172.21.15.146:0/2973526974 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc016430 con 0x7fd4080a0a30 2023-10-03T10:12:31.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.106+0000 7fd40eaa7700 1 -- 172.21.15.146:0/2973526974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4080a0a30 msgr2=0x7fd4080a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.106+0000 7fd40eaa7700 1 --2- 172.21.15.146:0/2973526974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4080a0a30 0x7fd4080a0e00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00dde0 tx=0x7fd3fc00f330 comp rx=0 tx=0).stop 2023-10-03T10:12:31.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.106+0000 7fd40eaa7700 1 -- 172.21.15.146:0/2973526974 shutdown_connections 2023-10-03T10:12:31.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.106+0000 7fd40eaa7700 1 --2- 172.21.15.146:0/2973526974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4080a0a30 0x7fd4080a0e00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.106+0000 7fd40eaa7700 1 --2- 172.21.15.146:0/2973526974 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4080a1340 0x7fd40812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.106+0000 7fd40eaa7700 1 -- 172.21.15.146:0/2973526974 >> 172.21.15.146:0/2973526974 conn(0x7fd4080a2980 msgr2=0x7fd4080a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:31.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.106+0000 7fd40eaa7700 1 -- 172.21.15.146:0/2973526974 shutdown_connections 2023-10-03T10:12:31.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.106+0000 7fd40eaa7700 1 -- 172.21.15.146:0/2973526974 wait complete. 2023-10-03T10:12:31.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.107+0000 7fd40eaa7700 1 Processor -- start 2023-10-03T10:12:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.107+0000 7fd40eaa7700 1 -- start start 2023-10-03T10:12:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.108+0000 7fd40eaa7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4080a0a30 0x7fd408121e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.108+0000 7fd40eaa7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4080a1340 0x7fd408122360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.108+0000 7fd40eaa7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4081304a0 0x7fd4081228a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.108+0000 7fd40eaa7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd408123b40 con 0x7fd4080a0a30 2023-10-03T10:12:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.108+0000 7fd40eaa7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd408125660 con 0x7fd4080a1340 2023-10-03T10:12:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.108+0000 7fd40eaa7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd40812ef50 con 0x7fd4081304a0 2023-10-03T10:12:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.108+0000 7fd407fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4080a1340 0x7fd408122360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.108+0000 7fd407fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4080a1340 0x7fd408122360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50150/0 (socket says 172.21.15.146:50150) 2023-10-03T10:12:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.108+0000 7fd407fff700 1 -- 172.21.15.146:0/2004104008 learned_addr learned my addr 172.21.15.146:0/2004104008 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:31.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.108+0000 7fd40d044700 1 --2- 172.21.15.146:0/2004104008 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4081304a0 0x7fd4081228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.105+0000 7f8797fff700 1 -- 172.21.15.146:0/1392890216 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f87a8012930 con 0x7f87b0139200 2023-10-03T10:12:31.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.109+0000 7fd40d044700 1 -- 172.21.15.146:0/2004104008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4080a1340 msgr2=0x7fd408122360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.109+0000 7fd40d044700 1 --2- 172.21.15.146:0/2004104008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4080a1340 0x7fd408122360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.109+0000 7fd40d044700 1 -- 172.21.15.146:0/2004104008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4080a0a30 msgr2=0x7fd408121e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.109+0000 7fd40d044700 1 --2- 172.21.15.146:0/2004104008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4080a0a30 0x7fd408121e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.109+0000 7fd40d044700 1 -- 172.21.15.146:0/2004104008 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc00da70 con 0x7fd4081304a0 2023-10-03T10:12:31.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.109+0000 7fd407fff700 1 --2- 172.21.15.146:0/2004104008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4080a1340 0x7fd408122360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:31.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.109+0000 7fd40d044700 1 --2- 172.21.15.146:0/2004104008 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4081304a0 0x7fd4081228a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd40000caa0 tx=0x7fd40000cdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:31.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.109+0000 7fd4057fa700 1 -- 172.21.15.146:0/2004104008 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40000aa60 con 0x7fd4081304a0 2023-10-03T10:12:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.109+0000 7fd4057fa700 1 -- 172.21.15.146:0/2004104008 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40000abc0 con 0x7fd4081304a0 2023-10-03T10:12:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.109+0000 7fd4057fa700 1 -- 172.21.15.146:0/2004104008 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd400012400 con 0x7fd4081304a0 2023-10-03T10:12:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.109+0000 7fd40eaa7700 1 -- 172.21.15.146:0/2004104008 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40809ae00 con 0x7fd4081304a0 2023-10-03T10:12:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.109+0000 7fd40eaa7700 1 -- 172.21.15.146:0/2004104008 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4081260d0 con 0x7fd4081304a0 2023-10-03T10:12:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.110+0000 7fd40eaa7700 1 -- 172.21.15.146:0/2004104008 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40804f2a0 con 0x7fd4081304a0 2023-10-03T10:12:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.111+0000 7fd4057fa700 1 -- 172.21.15.146:0/2004104008 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd40001b3b0 con 0x7fd4081304a0 2023-10-03T10:12:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.111+0000 7fd4057fa700 1 -- 172.21.15.146:0/2004104008 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fd40003f950 con 0x7fd4081304a0 2023-10-03T10:12:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.111+0000 7fd40c843700 1 -- 172.21.15.146:0/2004104008 >> v1:172.21.15.146:6816/126749 conn(0x7fd3ec02f510 legacy=0x7fd3ec0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:31.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.115+0000 7fd4057fa700 1 -- 172.21.15.146:0/2004104008 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd4000192c0 con 0x7fd4081304a0 2023-10-03T10:12:31.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.264+0000 7f16a77fe700 1 -- 172.21.15.146:0/1099997823 >> v1:172.21.15.146:6816/126749 conn(0x7f169402f510 legacy=0x7f16940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:31.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.293+0000 7f87af7fe700 1 -- 172.21.15.146:0/1392890216 >> v1:172.21.15.146:6816/126749 conn(0x7f879c02f560 legacy=0x7f879c031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:31.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.294+0000 7f4c4899c700 1 -- 172.21.15.146:0/2179813974 >> v1:172.21.15.146:6816/126749 conn(0x7f4c2802f510 legacy=0x7f4c280319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:31.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.296+0000 7f4c4999e700 1 -- 172.21.15.146:0/2179813974 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4c24005860 con 0x7f4c44138e60 2023-10-03T10:12:31.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.297+0000 7f4c417fa700 1 -- 172.21.15.146:0/2179813974 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4c3c01bd70 con 0x7f4c44138e60 2023-10-03T10:12:31.298 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:31.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.299+0000 7f4c4999e700 1 -- 172.21.15.146:0/2179813974 >> v1:172.21.15.146:6816/126749 conn(0x7f4c2802f510 legacy=0x7f4c280319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:31.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.299+0000 7f4c4999e700 1 -- 172.21.15.146:0/2179813974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c44138e60 msgr2=0x7f4c441cc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.299+0000 7f4c4999e700 1 --2- 172.21.15.146:0/2179813974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c44138e60 0x7f4c441cc480 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c007e70 tx=0x7f4c3c00e3c0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.299+0000 7f4c4999e700 1 -- 172.21.15.146:0/2179813974 shutdown_connections 2023-10-03T10:12:31.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.299+0000 7f4c4999e700 1 --2- 172.21.15.146:0/2179813974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c44138e60 0x7f4c441cc480 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.299+0000 7f4c4999e700 1 --2- 172.21.15.146:0/2179813974 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4409de70 0x7f4c44136fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.299+0000 7f4c4999e700 1 --2- 172.21.15.146:0/2179813974 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4c4409e950 0x7f4c44137510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.299+0000 7f4c4999e700 1 -- 172.21.15.146:0/2179813974 >> 172.21.15.146:0/2179813974 conn(0x7f4c440a27a0 msgr2=0x7f4c44070a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:31.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.299+0000 7f4c4999e700 1 -- 172.21.15.146:0/2179813974 shutdown_connections 2023-10-03T10:12:31.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.299+0000 7f4c4999e700 1 -- 172.21.15.146:0/2179813974 wait complete. 2023-10-03T10:12:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.301+0000 7f87b5af8700 1 -- 172.21.15.146:0/1392890216 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f87b004f2a0 con 0x7f87b0139200 2023-10-03T10:12:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.301+0000 7f8797fff700 1 -- 172.21.15.146:0/1392890216 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f87a8012340 con 0x7f87b0139200 2023-10-03T10:12:31.302 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:31.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.303+0000 7f87b5af8700 1 -- 172.21.15.146:0/1392890216 >> v1:172.21.15.146:6816/126749 conn(0x7f879c02f560 legacy=0x7f879c031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:31.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.303+0000 7f87b5af8700 1 -- 172.21.15.146:0/1392890216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87b0139200 msgr2=0x7f87b011a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.303+0000 7f87b5af8700 1 --2- 172.21.15.146:0/1392890216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87b0139200 0x7f87b011a6f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f87a800efc0 tx=0x7f87a800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.303+0000 7f87b5af8700 1 -- 172.21.15.146:0/1392890216 shutdown_connections 2023-10-03T10:12:31.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.303+0000 7f87b5af8700 1 --2- 172.21.15.146:0/1392890216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87b0139200 0x7f87b011a6f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.303+0000 7f87b5af8700 1 --2- 172.21.15.146:0/1392890216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87b0133900 0x7f87b0119c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.303+0000 7f87b5af8700 1 --2- 172.21.15.146:0/1392890216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87b01368e0 0x7f87b011a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.303+0000 7f87b5af8700 1 -- 172.21.15.146:0/1392890216 >> 172.21.15.146:0/1392890216 conn(0x7f87b00a2980 msgr2=0x7f87b00a0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:31.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.304+0000 7f87b5af8700 1 -- 172.21.15.146:0/1392890216 shutdown_connections 2023-10-03T10:12:31.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.304+0000 7f87b5af8700 1 -- 172.21.15.146:0/1392890216 wait complete. 2023-10-03T10:12:31.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.312+0000 7fd40c843700 1 -- 172.21.15.146:0/2004104008 >> v1:172.21.15.146:6816/126749 conn(0x7fd3ec02f510 legacy=0x7fd3ec0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:31.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:31.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:31.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.329+0000 7f16ae18c700 1 -- 172.21.15.146:0/1099997823 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f16a806b2a0 con 0x7f16a809f180 2023-10-03T10:12:31.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.329+0000 7f168ffff700 1 -- 172.21.15.146:0/1099997823 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f169c015070 con 0x7f16a809f180 2023-10-03T10:12:31.330 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:31.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.331+0000 7f16ae18c700 1 -- 172.21.15.146:0/1099997823 >> v1:172.21.15.146:6816/126749 conn(0x7f169402f510 legacy=0x7f16940319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:31.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.331+0000 7f16ae18c700 1 -- 172.21.15.146:0/1099997823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a809f180 msgr2=0x7f16a8122d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.332+0000 7f16ae18c700 1 --2- 172.21.15.146:0/1099997823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a809f180 0x7f16a8122d00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f169c009bc0 tx=0x7f169c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:31.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.332+0000 7f16ae18c700 1 -- 172.21.15.146:0/1099997823 shutdown_connections 2023-10-03T10:12:31.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.332+0000 7f16ae18c700 1 --2- 172.21.15.146:0/1099997823 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16a8131d70 0x7f16a8123240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.332+0000 7f16ae18c700 1 --2- 172.21.15.146:0/1099997823 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16a809e870 0x7f16a81227c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.332+0000 7f16ae18c700 1 --2- 172.21.15.146:0/1099997823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16a809f180 0x7f16a8122d00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.332+0000 7f16ae18c700 1 -- 172.21.15.146:0/1099997823 >> 172.21.15.146:0/1099997823 conn(0x7f16a80a4430 msgr2=0x7f16a809cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:31.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.332+0000 7f16ae18c700 1 -- 172.21.15.146:0/1099997823 shutdown_connections 2023-10-03T10:12:31.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.332+0000 7f16ae18c700 1 -- 172.21.15.146:0/1099997823 wait complete. 2023-10-03T10:12:31.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:31.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.368+0000 7fd40eaa7700 1 -- 172.21.15.146:0/2004104008 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd40809f960 con 0x7fd4081304a0 2023-10-03T10:12:31.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.368+0000 7fd4057fa700 1 -- 172.21.15.146:0/2004104008 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd400017030 con 0x7fd4081304a0 2023-10-03T10:12:31.369 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.370+0000 7fd40eaa7700 1 -- 172.21.15.146:0/2004104008 >> v1:172.21.15.146:6816/126749 conn(0x7fd3ec02f510 legacy=0x7fd3ec0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.370+0000 7fd40eaa7700 1 -- 172.21.15.146:0/2004104008 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4081304a0 msgr2=0x7fd4081228a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.370+0000 7fd40eaa7700 1 --2- 172.21.15.146:0/2004104008 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4081304a0 0x7fd4081228a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd40000caa0 tx=0x7fd40000cdb0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.370+0000 7fd40eaa7700 1 -- 172.21.15.146:0/2004104008 shutdown_connections 2023-10-03T10:12:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.370+0000 7fd40eaa7700 1 --2- 172.21.15.146:0/2004104008 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4081304a0 0x7fd4081228a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.370+0000 7fd40eaa7700 1 --2- 172.21.15.146:0/2004104008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4080a0a30 0x7fd408121e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.370+0000 7fd40eaa7700 1 --2- 172.21.15.146:0/2004104008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4080a1340 0x7fd408122360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.370+0000 7fd40eaa7700 1 -- 172.21.15.146:0/2004104008 >> 172.21.15.146:0/2004104008 conn(0x7fd4080a2980 msgr2=0x7fd40812e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.370+0000 7fd40eaa7700 1 -- 172.21.15.146:0/2004104008 shutdown_connections 2023-10-03T10:12:31.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:31.370+0000 7fd40eaa7700 1 -- 172.21.15.146:0/2004104008 wait complete. 2023-10-03T10:12:31.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:32.315 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:32.318 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:32.345 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:32.383 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:32.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.459+0000 7fde0d780700 1 Processor -- start 2023-10-03T10:12:32.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.459+0000 7fde0d780700 1 -- start start 2023-10-03T10:12:32.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.459+0000 7fde0d780700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde08131980 0x7fde08131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.460+0000 7fde0d780700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fde0809bc70 0x7fde0809c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.460+0000 7fde0d780700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fde0809c5c0 0x7fde08138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.460+0000 7fde0d780700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0806eb30 con 0x7fde0809bc70 2023-10-03T10:12:32.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.460+0000 7fde0d780700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde080a1640 con 0x7fde0809c5c0 2023-10-03T10:12:32.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.460+0000 7fde0d780700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde080a22d0 con 0x7fde08131980 2023-10-03T10:12:32.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.460+0000 7fde06ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde08131980 0x7fde08131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.460+0000 7fde06ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde08131980 0x7fde08131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49792/0 (socket says 172.21.15.146:49792) 2023-10-03T10:12:32.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.460+0000 7fde06ffd700 1 -- 172.21.15.146:0/3892333099 learned_addr learned my addr 172.21.15.146:0/3892333099 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:32.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.460+0000 7fde067fc700 1 --2- 172.21.15.146:0/3892333099 >> v2:172.21.15.146:3300/0 conn(0x7fde0809bc70 0x7fde0809c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.460+0000 7fde077fe700 1 --2- 172.21.15.146:0/3892333099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fde0809c5c0 0x7fde08138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.460+0000 7fde06ffd700 1 -- 172.21.15.146:0/3892333099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fde0809c5c0 msgr2=0x7fde08138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:32.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.460+0000 7fde06ffd700 1 --2- 172.21.15.146:0/3892333099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fde0809c5c0 0x7fde08138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.460+0000 7fde06ffd700 1 -- 172.21.15.146:0/3892333099 >> v2:172.21.15.146:3300/0 conn(0x7fde0809bc70 msgr2=0x7fde0809c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:32.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.460+0000 7fde06ffd700 1 --2- 172.21.15.146:0/3892333099 >> v2:172.21.15.146:3300/0 conn(0x7fde0809bc70 0x7fde0809c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.460+0000 7fde06ffd700 1 -- 172.21.15.146:0/3892333099 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde08131550 con 0x7fde08131980 2023-10-03T10:12:32.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.460+0000 7fde06ffd700 1 --2- 172.21.15.146:0/3892333099 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde08131980 0x7fde08131d50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fddf80098f0 tx=0x7fddf8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd3faa24c87aed02 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:32.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.461+0000 7fde05ffb700 1 -- 172.21.15.146:0/3892333099 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf8005e30 con 0x7fde08131980 2023-10-03T10:12:32.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.461+0000 7fde05ffb700 1 -- 172.21.15.146:0/3892333099 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf8004030 con 0x7fde08131980 2023-10-03T10:12:32.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.461+0000 7fde05ffb700 1 -- 172.21.15.146:0/3892333099 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf80043a0 con 0x7fde08131980 2023-10-03T10:12:32.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.461+0000 7fde0d780700 1 -- 172.21.15.146:0/3892333099 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde08131980 msgr2=0x7fde08131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.461+0000 7fde0d780700 1 --2- 172.21.15.146:0/3892333099 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde08131980 0x7fde08131d50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fddf80098f0 tx=0x7fddf8009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:32.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.461+0000 7fde0d780700 1 -- 172.21.15.146:0/3892333099 shutdown_connections 2023-10-03T10:12:32.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.461+0000 7fde0d780700 1 --2- 172.21.15.146:0/3892333099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fde0809c5c0 0x7fde08138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.461+0000 7fde0d780700 1 --2- 172.21.15.146:0/3892333099 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde08131980 0x7fde08131d50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.461+0000 7fde0d780700 1 --2- 172.21.15.146:0/3892333099 >> v2:172.21.15.146:3300/0 conn(0x7fde0809bc70 0x7fde0809c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.461+0000 7fde0d780700 1 -- 172.21.15.146:0/3892333099 >> 172.21.15.146:0/3892333099 conn(0x7fde080a2980 msgr2=0x7fde080a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:32.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.461+0000 7fde0d780700 1 -- 172.21.15.146:0/3892333099 shutdown_connections 2023-10-03T10:12:32.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.461+0000 7fde0d780700 1 -- 172.21.15.146:0/3892333099 wait complete. 2023-10-03T10:12:32.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.462+0000 7fde0d780700 1 Processor -- start 2023-10-03T10:12:32.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.463+0000 7fde0d780700 1 -- start start 2023-10-03T10:12:32.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.463+0000 7fde0d780700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fde0809bc70 0x7fde081c0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.463+0000 7fde0d780700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde0809c5c0 0x7fde081c1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.463+0000 7fde0d780700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde08131980 0x7fde081c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.463+0000 7fde0d780700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0811ce40 con 0x7fde0809c5c0 2023-10-03T10:12:32.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.463+0000 7fde0d780700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0811c380 con 0x7fde0809bc70 2023-10-03T10:12:32.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.463+0000 7fde0d780700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde081c1750 con 0x7fde08131980 2023-10-03T10:12:32.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.463+0000 7fde06ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fde0809bc70 0x7fde081c0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.463+0000 7fde067fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde0809c5c0 0x7fde081c1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.463+0000 7fde067fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde0809c5c0 0x7fde081c1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45422/0 (socket says 172.21.15.146:45422) 2023-10-03T10:12:32.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.463+0000 7fde06ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fde0809bc70 0x7fde081c0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50164/0 (socket says 172.21.15.146:50164) 2023-10-03T10:12:32.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.463+0000 7fde067fc700 1 -- 172.21.15.146:0/3826413549 learned_addr learned my addr 172.21.15.146:0/3826413549 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:32.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.463+0000 7fde077fe700 1 --2- 172.21.15.146:0/3826413549 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde08131980 0x7fde081c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.463+0000 7fde06ffd700 1 -- 172.21.15.146:0/3826413549 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde08131980 msgr2=0x7fde081c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.463+0000 7fde06ffd700 1 --2- 172.21.15.146:0/3826413549 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde08131980 0x7fde081c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.463+0000 7fde06ffd700 1 -- 172.21.15.146:0/3826413549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde0809c5c0 msgr2=0x7fde081c1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.463+0000 7fde06ffd700 1 --2- 172.21.15.146:0/3826413549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde0809c5c0 0x7fde081c1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.463+0000 7fde06ffd700 1 -- 172.21.15.146:0/3826413549 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf8009500 con 0x7fde0809bc70 2023-10-03T10:12:32.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.463+0000 7fde067fc700 1 --2- 172.21.15.146:0/3826413549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde0809c5c0 0x7fde081c1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:32.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.464+0000 7fde06ffd700 1 --2- 172.21.15.146:0/3826413549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fde0809bc70 0x7fde081c0cd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fddf8013000 tx=0x7fddf8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:32.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.464+0000 7fddef7fe700 1 -- 172.21.15.146:0/3826413549 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf80036a0 con 0x7fde0809bc70 2023-10-03T10:12:32.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.464+0000 7fddef7fe700 1 -- 172.21.15.146:0/3826413549 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf8003840 con 0x7fde0809bc70 2023-10-03T10:12:32.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.464+0000 7fddef7fe700 1 -- 172.21.15.146:0/3826413549 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf8003bf0 con 0x7fde0809bc70 2023-10-03T10:12:32.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.464+0000 7fde0d780700 1 -- 172.21.15.146:0/3826413549 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0811b130 con 0x7fde0809bc70 2023-10-03T10:12:32.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.464+0000 7fde0d780700 1 -- 172.21.15.146:0/3826413549 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0811d040 con 0x7fde0809bc70 2023-10-03T10:12:32.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.465+0000 7fddef7fe700 1 -- 172.21.15.146:0/3826413549 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fddf8027070 con 0x7fde0809bc70 2023-10-03T10:12:32.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.465+0000 7fde0d780700 1 -- 172.21.15.146:0/3826413549 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0811cad0 con 0x7fde0809bc70 2023-10-03T10:12:32.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.465+0000 7fde067fc700 1 -- 172.21.15.146:0/3826413549 >> v1:172.21.15.146:6816/126749 conn(0x7fddf402f510 legacy=0x7fddf40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:32.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.465+0000 7fddef7fe700 1 -- 172.21.15.146:0/3826413549 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fddf8048a10 con 0x7fde0809bc70 2023-10-03T10:12:32.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.470+0000 7fecff487700 1 Processor -- start 2023-10-03T10:12:32.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.470+0000 7fecff487700 1 -- start start 2023-10-03T10:12:32.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.470+0000 7fecff487700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fecf8138040 0x7fecf8138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.470+0000 7fecff487700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecf80a08e0 0x7fecf80a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.470+0000 7fecff487700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecf80a1230 0x7fecf813ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.470+0000 7fecff487700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf80a2100 con 0x7fecf8138040 2023-10-03T10:12:32.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.470+0000 7fecff487700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf8138950 con 0x7fecf80a1230 2023-10-03T10:12:32.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.470+0000 7fecff487700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecf81379e0 con 0x7fecf80a08e0 2023-10-03T10:12:32.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.471+0000 7fecfda24700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecf80a1230 0x7fecf813ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.471+0000 7fecfda24700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecf80a1230 0x7fecf813ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50178/0 (socket says 172.21.15.146:50178) 2023-10-03T10:12:32.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.471+0000 7fecfda24700 1 -- 172.21.15.146:0/2180552100 learned_addr learned my addr 172.21.15.146:0/2180552100 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:32.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.471+0000 7fecfd223700 1 --2- 172.21.15.146:0/2180552100 >> v2:172.21.15.146:3300/0 conn(0x7fecf8138040 0x7fecf8138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.471+0000 7fecfda24700 1 -- 172.21.15.146:0/2180552100 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecf80a08e0 msgr2=0x7fecf80a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:32.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.471+0000 7fecfda24700 1 --2- 172.21.15.146:0/2180552100 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecf80a08e0 0x7fecf80a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.471+0000 7fecfda24700 1 -- 172.21.15.146:0/2180552100 >> v2:172.21.15.146:3300/0 conn(0x7fecf8138040 msgr2=0x7fecf8138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:32.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.471+0000 7fecfda24700 1 --2- 172.21.15.146:0/2180552100 >> v2:172.21.15.146:3300/0 conn(0x7fecf8138040 0x7fecf8138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.471+0000 7fecfda24700 1 -- 172.21.15.146:0/2180552100 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf809b9b0 con 0x7fecf80a1230 2023-10-03T10:12:32.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.471+0000 7fecfd223700 1 --2- 172.21.15.146:0/2180552100 >> v2:172.21.15.146:3300/0 conn(0x7fecf8138040 0x7fecf8138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:32.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.471+0000 7fecfda24700 1 --2- 172.21.15.146:0/2180552100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecf80a1230 0x7fecf813ed10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fecf0009e80 tx=0x7fecf000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69ad7c05529e1d16 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:32.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.474+0000 7feceffff700 1 -- 172.21.15.146:0/2180552100 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf000e070 con 0x7fecf80a1230 2023-10-03T10:12:32.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.474+0000 7feceffff700 1 -- 172.21.15.146:0/2180552100 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf000b8d0 con 0x7fecf80a1230 2023-10-03T10:12:32.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.474+0000 7feceffff700 1 -- 172.21.15.146:0/2180552100 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf000bc80 con 0x7fecf80a1230 2023-10-03T10:12:32.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.474+0000 7fddef7fe700 1 -- 172.21.15.146:0/3826413549 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fddf800b3e0 con 0x7fde0809bc70 2023-10-03T10:12:32.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.475+0000 7fecff487700 1 -- 172.21.15.146:0/2180552100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecf80a1230 msgr2=0x7fecf813ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.475+0000 7fecff487700 1 --2- 172.21.15.146:0/2180552100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecf80a1230 0x7fecf813ed10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fecf0009e80 tx=0x7fecf000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:32.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.475+0000 7fecff487700 1 -- 172.21.15.146:0/2180552100 shutdown_connections 2023-10-03T10:12:32.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.475+0000 7fecff487700 1 --2- 172.21.15.146:0/2180552100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecf80a1230 0x7fecf813ed10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.475+0000 7fecff487700 1 --2- 172.21.15.146:0/2180552100 >> v2:172.21.15.146:3300/0 conn(0x7fecf8138040 0x7fecf8138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.475+0000 7fecff487700 1 --2- 172.21.15.146:0/2180552100 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecf80a08e0 0x7fecf80a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.475+0000 7fecff487700 1 -- 172.21.15.146:0/2180552100 >> 172.21.15.146:0/2180552100 conn(0x7fecf80a2980 msgr2=0x7fecf80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:32.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.475+0000 7fecff487700 1 -- 172.21.15.146:0/2180552100 shutdown_connections 2023-10-03T10:12:32.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.475+0000 7fecff487700 1 -- 172.21.15.146:0/2180552100 wait complete. 2023-10-03T10:12:32.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.476+0000 7fecff487700 1 Processor -- start 2023-10-03T10:12:32.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.476+0000 7fecff487700 1 -- start start 2023-10-03T10:12:32.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.477+0000 7fecff487700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecf80a08e0 0x7fecf81d5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.477+0000 7fecff487700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecf80a1230 0x7fecf81d5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.477+0000 7fecff487700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecf8138040 0x7fecf8118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.477+0000 7fecff487700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf81342f0 con 0x7fecf8138040 2023-10-03T10:12:32.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.477+0000 7fecff487700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf811b500 con 0x7fecf80a08e0 2023-10-03T10:12:32.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.477+0000 7fecff487700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecf81d5160 con 0x7fecf80a1230 2023-10-03T10:12:32.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.477+0000 7fecfda24700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecf8138040 0x7fecf8118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.477+0000 7fecfda24700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecf8138040 0x7fecf8118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45438/0 (socket says 172.21.15.146:45438) 2023-10-03T10:12:32.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.477+0000 7fecfda24700 1 -- 172.21.15.146:0/3901420199 learned_addr learned my addr 172.21.15.146:0/3901420199 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:32.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.477+0000 7fecfd223700 1 --2- 172.21.15.146:0/3901420199 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecf80a08e0 0x7fecf81d5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.477+0000 7fecfda24700 1 -- 172.21.15.146:0/3901420199 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecf80a1230 msgr2=0x7fecf81d5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.477+0000 7fecfda24700 1 --2- 172.21.15.146:0/3901420199 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecf80a1230 0x7fecf81d5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.478+0000 7fecfda24700 1 -- 172.21.15.146:0/3901420199 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecf80a08e0 msgr2=0x7fecf81d5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.478+0000 7fecfda24700 1 --2- 172.21.15.146:0/3901420199 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecf80a08e0 0x7fecf81d5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.478+0000 7fecfda24700 1 -- 172.21.15.146:0/3901420199 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf4009430 con 0x7fecf8138040 2023-10-03T10:12:32.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.478+0000 7fecfd223700 1 --2- 172.21.15.146:0/3901420199 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecf80a08e0 0x7fecf81d5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:32.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.478+0000 7fecfda24700 1 --2- 172.21.15.146:0/3901420199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecf8138040 0x7fecf8118df0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fecf000b680 tx=0x7fecf0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:32.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.478+0000 7fecedffb700 1 -- 172.21.15.146:0/3901420199 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf00092e0 con 0x7fecf8138040 2023-10-03T10:12:32.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.478+0000 7fecedffb700 1 -- 172.21.15.146:0/3901420199 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf0004250 con 0x7fecf8138040 2023-10-03T10:12:32.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.478+0000 7fecedffb700 1 -- 172.21.15.146:0/3901420199 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf0004600 con 0x7fecf8138040 2023-10-03T10:12:32.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.478+0000 7fecff487700 1 -- 172.21.15.146:0/3901420199 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf0009b30 con 0x7fecf8138040 2023-10-03T10:12:32.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.478+0000 7fecff487700 1 -- 172.21.15.146:0/3901420199 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf811a310 con 0x7fecf8138040 2023-10-03T10:12:32.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.479+0000 7fecedffb700 1 -- 172.21.15.146:0/3901420199 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fecf0004760 con 0x7fecf8138040 2023-10-03T10:12:32.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.479+0000 7fecedffb700 1 -- 172.21.15.146:0/3901420199 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fecf0040c30 con 0x7fecf8138040 2023-10-03T10:12:32.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.479+0000 7fecfd223700 1 -- 172.21.15.146:0/3901420199 >> v1:172.21.15.146:6816/126749 conn(0x7fecdc02f510 legacy=0x7fecdc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:32.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.480+0000 7fecff487700 1 -- 172.21.15.146:0/3901420199 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf804f2a0 con 0x7fecf8138040 2023-10-03T10:12:32.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.485+0000 7fecedffb700 1 -- 172.21.15.146:0/3901420199 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fecf0019320 con 0x7fecf8138040 2023-10-03T10:12:32.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.508+0000 7f1a2ae70700 1 Processor -- start 2023-10-03T10:12:32.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.508+0000 7f1a2ae70700 1 -- start start 2023-10-03T10:12:32.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.509+0000 7f1a2ae70700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a24133ad0 0x7f1a24133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.509+0000 7f1a2ae70700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1a24130bc0 0x7f1a2413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.509+0000 7f1a2ae70700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2406b2d0 con 0x7f1a241300a0 2023-10-03T10:12:32.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.509+0000 7f1a2ae70700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a24133610 con 0x7f1a24130bc0 2023-10-03T10:12:32.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.509+0000 7f1a2ae70700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2409a500 con 0x7f1a24133ad0 2023-10-03T10:12:32.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.509+0000 7f1a2940d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1a24130bc0 0x7f1a2413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.509+0000 7f1a28c0c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a24133ad0 0x7f1a24133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.509+0000 7f1a2940d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1a24130bc0 0x7f1a2413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45448/0 (socket says 172.21.15.146:45448) 2023-10-03T10:12:32.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.509+0000 7f1a28c0c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a24133ad0 0x7f1a24133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49830/0 (socket says 172.21.15.146:49830) 2023-10-03T10:12:32.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.509+0000 7f1a2940d700 1 -- 172.21.15.146:0/3781799819 learned_addr learned my addr 172.21.15.146:0/3781799819 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:32.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.510+0000 7f1a2940d700 1 -- 172.21.15.146:0/3781799819 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a24133ad0 msgr2=0x7f1a24133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:32.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.510+0000 7f1a2940d700 1 --2- 172.21.15.146:0/3781799819 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a24133ad0 0x7f1a24133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.510+0000 7f1a2940d700 1 -- 172.21.15.146:0/3781799819 >> v1:172.21.15.146:6789/0 conn(0x7f1a241300a0 legacy=0x7f1a241304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.510+0000 7f1a2940d700 1 -- 172.21.15.146:0/3781799819 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a241338b0 con 0x7f1a24130bc0 2023-10-03T10:12:32.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.510+0000 7f1a237fe700 1 -- 172.21.15.146:0/3781799819 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3106626766 0 0) 0x7f1a2406b2d0 con 0x7f1a241300a0 2023-10-03T10:12:32.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.510+0000 7f1a2940d700 1 --2- 172.21.15.146:0/3781799819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a24130bc0 0x7f1a2413b990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009e50 tx=0x7f1a1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b32a8cac907166b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:32.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.510+0000 7f1a237fe700 1 -- 172.21.15.146:0/3781799819 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c00e070 con 0x7f1a24130bc0 2023-10-03T10:12:32.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.510+0000 7f1a237fe700 1 -- 172.21.15.146:0/3781799819 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c00b910 con 0x7f1a24130bc0 2023-10-03T10:12:32.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.510+0000 7f1a237fe700 1 -- 172.21.15.146:0/3781799819 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c00bcc0 con 0x7f1a24130bc0 2023-10-03T10:12:32.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.511+0000 7f1a2ae70700 1 -- 172.21.15.146:0/3781799819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a24130bc0 msgr2=0x7f1a2413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.511+0000 7f1a2ae70700 1 --2- 172.21.15.146:0/3781799819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a24130bc0 0x7f1a2413b990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009e50 tx=0x7f1a1c00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:32.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.511+0000 7f1a2ae70700 1 -- 172.21.15.146:0/3781799819 shutdown_connections 2023-10-03T10:12:32.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.511+0000 7f1a2ae70700 1 --2- 172.21.15.146:0/3781799819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a24130bc0 0x7f1a2413b990 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.511+0000 7f1a2ae70700 1 --2- 172.21.15.146:0/3781799819 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a24133ad0 0x7f1a24133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.511+0000 7f1a2ae70700 1 -- 172.21.15.146:0/3781799819 >> 172.21.15.146:0/3781799819 conn(0x7f1a24099c40 msgr2=0x7f1a240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:32.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.511+0000 7f1a2ae70700 1 -- 172.21.15.146:0/3781799819 shutdown_connections 2023-10-03T10:12:32.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.511+0000 7f1a2ae70700 1 -- 172.21.15.146:0/3781799819 wait complete. 2023-10-03T10:12:32.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.512+0000 7f1a2ae70700 1 Processor -- start 2023-10-03T10:12:32.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.512+0000 7f1a2ae70700 1 -- start start 2023-10-03T10:12:32.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.513+0000 7f1a2ae70700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a241300a0 0x7f1a2411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.513+0000 7f1a2ae70700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a24130bc0 0x7f1a2411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.513+0000 7f1a2ae70700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a24133ad0 0x7f1a2411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.513+0000 7f1a2ae70700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a241208e0 con 0x7f1a241300a0 2023-10-03T10:12:32.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.513+0000 7f1a2ae70700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2411f9d0 con 0x7f1a24130bc0 2023-10-03T10:12:32.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.513+0000 7f1a2ae70700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a24120070 con 0x7f1a24133ad0 2023-10-03T10:12:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.513+0000 7f1a28c0c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a241300a0 0x7f1a2411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.513+0000 7f1a28c0c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a241300a0 0x7f1a2411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45464/0 (socket says 172.21.15.146:45464) 2023-10-03T10:12:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.513+0000 7f1a28c0c700 1 -- 172.21.15.146:0/432509007 learned_addr learned my addr 172.21.15.146:0/432509007 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.513+0000 7f1a2940d700 1 --2- 172.21.15.146:0/432509007 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a24133ad0 0x7f1a2411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.513+0000 7f1a28c0c700 1 -- 172.21.15.146:0/432509007 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a24133ad0 msgr2=0x7f1a2411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.513+0000 7f1a28c0c700 1 --2- 172.21.15.146:0/432509007 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a24133ad0 0x7f1a2411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.513+0000 7f1a28c0c700 1 -- 172.21.15.146:0/432509007 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a24130bc0 msgr2=0x7f1a2411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.513+0000 7f1a28c0c700 1 --2- 172.21.15.146:0/432509007 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a24130bc0 0x7f1a2411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.513+0000 7f1a28c0c700 1 -- 172.21.15.146:0/432509007 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c009b30 con 0x7f1a241300a0 2023-10-03T10:12:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.514+0000 7f1a28c0c700 1 --2- 172.21.15.146:0/432509007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a241300a0 0x7f1a2411da40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800e9b0 tx=0x7f1a1800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.514+0000 7f1a217fa700 1 -- 172.21.15.146:0/432509007 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a18009710 con 0x7f1a241300a0 2023-10-03T10:12:32.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.514+0000 7f1a217fa700 1 -- 172.21.15.146:0/432509007 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1800c850 con 0x7f1a241300a0 2023-10-03T10:12:32.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.514+0000 7f1a2ae70700 1 -- 172.21.15.146:0/432509007 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2411ee50 con 0x7f1a241300a0 2023-10-03T10:12:32.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.514+0000 7f1a217fa700 1 -- 172.21.15.146:0/432509007 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1800cbc0 con 0x7f1a241300a0 2023-10-03T10:12:32.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.514+0000 7f1a2ae70700 1 -- 172.21.15.146:0/432509007 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a240a34a0 con 0x7f1a241300a0 2023-10-03T10:12:32.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.515+0000 7f1a2ae70700 1 -- 172.21.15.146:0/432509007 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2411feb0 con 0x7f1a241300a0 2023-10-03T10:12:32.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.516+0000 7f1a217fa700 1 -- 172.21.15.146:0/432509007 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1a1800cd20 con 0x7f1a241300a0 2023-10-03T10:12:32.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.516+0000 7f1a217fa700 1 -- 172.21.15.146:0/432509007 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f1a18040350 con 0x7f1a241300a0 2023-10-03T10:12:32.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.516+0000 7f1a23fff700 1 -- 172.21.15.146:0/432509007 >> v1:172.21.15.146:6816/126749 conn(0x7f1a0802f510 legacy=0x7f1a080319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:32.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.520+0000 7f1a217fa700 1 -- 172.21.15.146:0/432509007 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a18013470 con 0x7f1a241300a0 2023-10-03T10:12:32.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.539+0000 7f6307836700 1 Processor -- start 2023-10-03T10:12:32.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.539+0000 7f6307836700 1 -- start start 2023-10-03T10:12:32.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.540+0000 7f6307836700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f630009dec0 0x7f630006b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.540+0000 7f6307836700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6300136cb0 0x7f6300139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.540+0000 7f6307836700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630006e900 con 0x7f630006a770 2023-10-03T10:12:32.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.540+0000 7f6307836700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f630009d180 con 0x7f6300136cb0 2023-10-03T10:12:32.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.540+0000 7f6307836700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630009e780 con 0x7f630009dec0 2023-10-03T10:12:32.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.540+0000 7f63055d2700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f630006a770 0x7f630006ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35312/0 (socket says 172.21.15.146:35312) 2023-10-03T10:12:32.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.540+0000 7f63055d2700 1 -- 172.21.15.146:0/3010266871 learned_addr learned my addr 172.21.15.146:0/3010266871 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:32.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.540+0000 7f6304dd1700 1 --2- 172.21.15.146:0/3010266871 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f630009dec0 0x7f630006b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.540+0000 7f6305dd3700 1 --2- 172.21.15.146:0/3010266871 >> v2:172.21.15.146:3300/0 conn(0x7f6300136cb0 0x7f6300139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.541+0000 7f6304dd1700 1 -- 172.21.15.146:0/3010266871 >> v2:172.21.15.146:3300/0 conn(0x7f6300136cb0 msgr2=0x7f6300139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:32.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.541+0000 7f6304dd1700 1 --2- 172.21.15.146:0/3010266871 >> v2:172.21.15.146:3300/0 conn(0x7f6300136cb0 0x7f6300139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.541+0000 7f62f7fff700 1 -- 172.21.15.146:0/3010266871 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250494436 0 0) 0x7f630006e900 con 0x7f630006a770 2023-10-03T10:12:32.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.541+0000 7f6304dd1700 1 -- 172.21.15.146:0/3010266871 >> v1:172.21.15.146:6789/0 conn(0x7f630006a770 legacy=0x7f630006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.541+0000 7f6304dd1700 1 -- 172.21.15.146:0/3010266871 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630009d3c0 con 0x7f630009dec0 2023-10-03T10:12:32.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.541+0000 7f6304dd1700 1 --2- 172.21.15.146:0/3010266871 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f630009dec0 0x7f630006b250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009840 tx=0x7f62f0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93afc24ea13eb939 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:32.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.541+0000 7f62f7fff700 1 -- 172.21.15.146:0/3010266871 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f0011830 con 0x7f630009dec0 2023-10-03T10:12:32.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.541+0000 7f62f7fff700 1 -- 172.21.15.146:0/3010266871 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f0011990 con 0x7f630009dec0 2023-10-03T10:12:32.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.541+0000 7f62f7fff700 1 -- 172.21.15.146:0/3010266871 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f0011d20 con 0x7f630009dec0 2023-10-03T10:12:32.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.542+0000 7f6307836700 1 -- 172.21.15.146:0/3010266871 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f630009dec0 msgr2=0x7f630006b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.542+0000 7f6307836700 1 --2- 172.21.15.146:0/3010266871 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f630009dec0 0x7f630006b250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009840 tx=0x7f62f0009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:32.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.542+0000 7f6307836700 1 -- 172.21.15.146:0/3010266871 shutdown_connections 2023-10-03T10:12:32.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.542+0000 7f6307836700 1 --2- 172.21.15.146:0/3010266871 >> v2:172.21.15.146:3300/0 conn(0x7f6300136cb0 0x7f6300139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.542+0000 7f6307836700 1 --2- 172.21.15.146:0/3010266871 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f630009dec0 0x7f630006b250 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.542+0000 7f6307836700 1 -- 172.21.15.146:0/3010266871 >> 172.21.15.146:0/3010266871 conn(0x7f6300099c40 msgr2=0x7f63000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:32.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.542+0000 7f6307836700 1 -- 172.21.15.146:0/3010266871 shutdown_connections 2023-10-03T10:12:32.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.542+0000 7f6307836700 1 -- 172.21.15.146:0/3010266871 wait complete. 2023-10-03T10:12:32.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.543+0000 7f6307836700 1 Processor -- start 2023-10-03T10:12:32.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.543+0000 7f6307836700 1 -- start start 2023-10-03T10:12:32.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.543+0000 7f6307836700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f630006a770 0x7f63001340f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.543+0000 7f6307836700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f630009dec0 0x7f6300134630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.544+0000 7f6307836700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6300136cb0 0x7f6300134b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.544+0000 7f6304dd1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f630009dec0 0x7f6300134630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.544+0000 7f6307836700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6300136500 con 0x7f630006a770 2023-10-03T10:12:32.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.544+0000 7f6307836700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63001354e0 con 0x7f630009dec0 2023-10-03T10:12:32.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.544+0000 7f6304dd1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f630009dec0 0x7f6300134630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50224/0 (socket says 172.21.15.146:50224) 2023-10-03T10:12:32.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.544+0000 7f6304dd1700 1 -- 172.21.15.146:0/4102009334 learned_addr learned my addr 172.21.15.146:0/4102009334 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:32.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.544+0000 7f63055d2700 1 --2- 172.21.15.146:0/4102009334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f630006a770 0x7f63001340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.544+0000 7f6307836700 1 -- 172.21.15.146:0/4102009334 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6300071ce0 con 0x7f6300136cb0 2023-10-03T10:12:32.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.544+0000 7f6305dd3700 1 --2- 172.21.15.146:0/4102009334 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6300136cb0 0x7f6300134b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.544+0000 7f6304dd1700 1 -- 172.21.15.146:0/4102009334 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6300136cb0 msgr2=0x7f6300134b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.544+0000 7f6304dd1700 1 --2- 172.21.15.146:0/4102009334 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6300136cb0 0x7f6300134b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.544+0000 7f6304dd1700 1 -- 172.21.15.146:0/4102009334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f630006a770 msgr2=0x7f63001340f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.544+0000 7f6304dd1700 1 --2- 172.21.15.146:0/4102009334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f630006a770 0x7f63001340f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.544+0000 7f6304dd1700 1 -- 172.21.15.146:0/4102009334 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f00094a0 con 0x7f630009dec0 2023-10-03T10:12:32.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.544+0000 7f6305dd3700 1 --2- 172.21.15.146:0/4102009334 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6300136cb0 0x7f6300134b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:32.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.544+0000 7f63055d2700 1 --2- 172.21.15.146:0/4102009334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f630006a770 0x7f63001340f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:32.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.544+0000 7f6304dd1700 1 --2- 172.21.15.146:0/4102009334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f630009dec0 0x7f6300134630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f62f00090b0 tx=0x7f62f0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:32.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.544+0000 7f62f5ffb700 1 -- 172.21.15.146:0/4102009334 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f00045d0 con 0x7f630009dec0 2023-10-03T10:12:32.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.544+0000 7f62f5ffb700 1 -- 172.21.15.146:0/4102009334 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f001f070 con 0x7f630009dec0 2023-10-03T10:12:32.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.544+0000 7f62f5ffb700 1 -- 172.21.15.146:0/4102009334 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f00038e0 con 0x7f630009dec0 2023-10-03T10:12:32.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.545+0000 7f6307836700 1 -- 172.21.15.146:0/4102009334 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630011aaf0 con 0x7f630009dec0 2023-10-03T10:12:32.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.545+0000 7f6307836700 1 -- 172.21.15.146:0/4102009334 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6300119e30 con 0x7f630009dec0 2023-10-03T10:12:32.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.546+0000 7f6307836700 1 -- 172.21.15.146:0/4102009334 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f630011a490 con 0x7f630009dec0 2023-10-03T10:12:32.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.546+0000 7f62f5ffb700 1 -- 172.21.15.146:0/4102009334 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f62f0003a40 con 0x7f630009dec0 2023-10-03T10:12:32.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.546+0000 7f62f5ffb700 1 -- 172.21.15.146:0/4102009334 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f62f0021070 con 0x7f630009dec0 2023-10-03T10:12:32.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.546+0000 7f63055d2700 1 -- 172.21.15.146:0/4102009334 >> v1:172.21.15.146:6816/126749 conn(0x7f62e402f510 legacy=0x7f62e40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:32.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.555+0000 7f62f5ffb700 1 -- 172.21.15.146:0/4102009334 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f630011a490 con 0x7f630009dec0 2023-10-03T10:12:32.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.666+0000 7fde067fc700 1 -- 172.21.15.146:0/3826413549 >> v1:172.21.15.146:6816/126749 conn(0x7fddf402f510 legacy=0x7fddf40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:32.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.680+0000 7fecfd223700 1 -- 172.21.15.146:0/3901420199 >> v1:172.21.15.146:6816/126749 conn(0x7fecdc02f510 legacy=0x7fecdc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:32.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.717+0000 7f1a23fff700 1 -- 172.21.15.146:0/432509007 >> v1:172.21.15.146:6816/126749 conn(0x7f1a0802f510 legacy=0x7f1a080319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:32.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.720+0000 7f1a2ae70700 1 -- 172.21.15.146:0/432509007 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1a2411feb0 con 0x7f1a241300a0 2023-10-03T10:12:32.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.720+0000 7f1a217fa700 1 -- 172.21.15.146:0/432509007 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a2411feb0 con 0x7f1a241300a0 2023-10-03T10:12:32.721 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:32.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.723+0000 7f1a2ae70700 1 -- 172.21.15.146:0/432509007 >> v1:172.21.15.146:6816/126749 conn(0x7f1a0802f510 legacy=0x7f1a080319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:32.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.723+0000 7f1a2ae70700 1 -- 172.21.15.146:0/432509007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a241300a0 msgr2=0x7f1a2411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.723+0000 7f1a2ae70700 1 --2- 172.21.15.146:0/432509007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a241300a0 0x7f1a2411da40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800e9b0 tx=0x7f1a1800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.723+0000 7f1a2ae70700 1 -- 172.21.15.146:0/432509007 shutdown_connections 2023-10-03T10:12:32.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.723+0000 7f1a2ae70700 1 --2- 172.21.15.146:0/432509007 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a24133ad0 0x7f1a2411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.723+0000 7f1a2ae70700 1 --2- 172.21.15.146:0/432509007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a241300a0 0x7f1a2411da40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.723+0000 7f1a2ae70700 1 --2- 172.21.15.146:0/432509007 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a24130bc0 0x7f1a2411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.723+0000 7f1a2ae70700 1 -- 172.21.15.146:0/432509007 >> 172.21.15.146:0/432509007 conn(0x7f1a24099c40 msgr2=0x7f1a24132950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:32.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.723+0000 7f1a2ae70700 1 -- 172.21.15.146:0/432509007 shutdown_connections 2023-10-03T10:12:32.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.723+0000 7f1a2ae70700 1 -- 172.21.15.146:0/432509007 wait complete. 2023-10-03T10:12:32.741 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:32.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.741+0000 7fde0d780700 1 -- 172.21.15.146:0/3826413549 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fde0804f2a0 con 0x7fde0809bc70 2023-10-03T10:12:32.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.741+0000 7fddef7fe700 1 -- 172.21.15.146:0/3826413549 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fddf802f030 con 0x7fde0809bc70 2023-10-03T10:12:32.742 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:32.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.743+0000 7fde0d780700 1 -- 172.21.15.146:0/3826413549 >> v1:172.21.15.146:6816/126749 conn(0x7fddf402f510 legacy=0x7fddf40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:32.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.743+0000 7fde0d780700 1 -- 172.21.15.146:0/3826413549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fde0809bc70 msgr2=0x7fde081c0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.743+0000 7fde0d780700 1 --2- 172.21.15.146:0/3826413549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fde0809bc70 0x7fde081c0cd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fddf8013000 tx=0x7fddf8004750 comp rx=0 tx=0).stop 2023-10-03T10:12:32.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.743+0000 7fde0d780700 1 -- 172.21.15.146:0/3826413549 shutdown_connections 2023-10-03T10:12:32.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.743+0000 7fde0d780700 1 --2- 172.21.15.146:0/3826413549 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde08131980 0x7fde081c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.743+0000 7fde0d780700 1 --2- 172.21.15.146:0/3826413549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fde0809bc70 0x7fde081c0cd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.743+0000 7fde0d780700 1 --2- 172.21.15.146:0/3826413549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde0809c5c0 0x7fde081c1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.743+0000 7fde0d780700 1 -- 172.21.15.146:0/3826413549 >> 172.21.15.146:0/3826413549 conn(0x7fde080a2980 msgr2=0x7fde0812e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:32.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.743+0000 7fde0d780700 1 -- 172.21.15.146:0/3826413549 shutdown_connections 2023-10-03T10:12:32.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.743+0000 7fde0d780700 1 -- 172.21.15.146:0/3826413549 wait complete. 2023-10-03T10:12:32.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.747+0000 7f63055d2700 1 -- 172.21.15.146:0/4102009334 >> v1:172.21.15.146:6816/126749 conn(0x7f62e402f510 legacy=0x7f62e40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:32.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.752+0000 7f6307836700 1 -- 172.21.15.146:0/4102009334 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f630011a490 con 0x7f630009dec0 2023-10-03T10:12:32.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.752+0000 7f62f5ffb700 1 -- 172.21.15.146:0/4102009334 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f630011a490 con 0x7f630009dec0 2023-10-03T10:12:32.753 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:32.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.755+0000 7f6307836700 1 -- 172.21.15.146:0/4102009334 >> v1:172.21.15.146:6816/126749 conn(0x7f62e402f510 legacy=0x7f62e40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:32.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.755+0000 7f6307836700 1 -- 172.21.15.146:0/4102009334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f630009dec0 msgr2=0x7f6300134630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.755+0000 7f6307836700 1 --2- 172.21.15.146:0/4102009334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f630009dec0 0x7f6300134630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f62f00090b0 tx=0x7f62f0004750 comp rx=0 tx=0).stop 2023-10-03T10:12:32.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.756+0000 7f6307836700 1 -- 172.21.15.146:0/4102009334 shutdown_connections 2023-10-03T10:12:32.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.756+0000 7f6307836700 1 --2- 172.21.15.146:0/4102009334 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6300136cb0 0x7f6300134b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.756+0000 7f6307836700 1 --2- 172.21.15.146:0/4102009334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f630006a770 0x7f63001340f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.756+0000 7f6307836700 1 --2- 172.21.15.146:0/4102009334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f630009dec0 0x7f6300134630 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.756+0000 7f6307836700 1 -- 172.21.15.146:0/4102009334 >> 172.21.15.146:0/4102009334 conn(0x7f6300099c40 msgr2=0x7f630012f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:32.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.756+0000 7f6307836700 1 -- 172.21.15.146:0/4102009334 shutdown_connections 2023-10-03T10:12:32.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.756+0000 7f6307836700 1 -- 172.21.15.146:0/4102009334 wait complete. 2023-10-03T10:12:32.758 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:32.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.759+0000 7fecff487700 1 -- 172.21.15.146:0/3901420199 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fecf806bce0 con 0x7fecf8138040 2023-10-03T10:12:32.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.759+0000 7fecedffb700 1 -- 172.21.15.146:0/3901420199 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fecf0011b40 con 0x7fecf8138040 2023-10-03T10:12:32.760 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:32.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.762+0000 7fecff487700 1 -- 172.21.15.146:0/3901420199 >> v1:172.21.15.146:6816/126749 conn(0x7fecdc02f510 legacy=0x7fecdc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:32.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.762+0000 7fecff487700 1 -- 172.21.15.146:0/3901420199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecf8138040 msgr2=0x7fecf8118df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.762+0000 7fecff487700 1 --2- 172.21.15.146:0/3901420199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecf8138040 0x7fecf8118df0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fecf000b680 tx=0x7fecf0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.762+0000 7fecff487700 1 -- 172.21.15.146:0/3901420199 shutdown_connections 2023-10-03T10:12:32.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.762+0000 7fecff487700 1 --2- 172.21.15.146:0/3901420199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecf8138040 0x7fecf8118df0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.762+0000 7fecff487700 1 --2- 172.21.15.146:0/3901420199 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecf80a08e0 0x7fecf81d5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.762+0000 7fecff487700 1 --2- 172.21.15.146:0/3901420199 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecf80a1230 0x7fecf81d5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.762+0000 7fecff487700 1 -- 172.21.15.146:0/3901420199 >> 172.21.15.146:0/3901420199 conn(0x7fecf80a2980 msgr2=0x7fecf809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:32.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.762+0000 7fecff487700 1 -- 172.21.15.146:0/3901420199 shutdown_connections 2023-10-03T10:12:32.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:32.762+0000 7fecff487700 1 -- 172.21.15.146:0/3901420199 wait complete. 2023-10-03T10:12:32.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:32.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:33.742 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:33.759 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:33.771 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:33.775 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:33.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.897+0000 7fac0c593700 1 Processor -- start 2023-10-03T10:12:33.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.898+0000 7fac0c593700 1 -- start start 2023-10-03T10:12:33.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.898+0000 7fac0c593700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac04133ad0 0x7fac04133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.898+0000 7fac0c593700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac041300a0 0x7fac041304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.898+0000 7fac0c593700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fac041309f0 0x7fac0413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.898+0000 7fac0c593700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0406b2d0 con 0x7fac041309f0 2023-10-03T10:12:33.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.898+0000 7fac0c593700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac04133610 con 0x7fac04133ad0 2023-10-03T10:12:33.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.898+0000 7fac0c593700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac0409a500 con 0x7fac041300a0 2023-10-03T10:12:33.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.899+0000 7fac09b2e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac041300a0 0x7fac041304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.899+0000 7fac0a32f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac04133ad0 0x7fac04133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.899+0000 7fac0ab30700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fac041309f0 0x7fac0413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.899+0000 7fac09b2e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac041300a0 0x7fac041304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49864/0 (socket says 172.21.15.146:49864) 2023-10-03T10:12:33.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.899+0000 7fac0a32f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac04133ad0 0x7fac04133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50240/0 (socket says 172.21.15.146:50240) 2023-10-03T10:12:33.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.899+0000 7fac09b2e700 1 -- 172.21.15.146:0/3882696380 learned_addr learned my addr 172.21.15.146:0/3882696380 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:33.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.899+0000 7fac0a32f700 1 -- 172.21.15.146:0/3882696380 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac041300a0 msgr2=0x7fac041304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:33.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.899+0000 7fac0a32f700 1 --2- 172.21.15.146:0/3882696380 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac041300a0 0x7fac041304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.899+0000 7fac0a32f700 1 -- 172.21.15.146:0/3882696380 >> v2:172.21.15.146:3300/0 conn(0x7fac041309f0 msgr2=0x7fac0413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:33.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.899+0000 7fac0a32f700 1 --2- 172.21.15.146:0/3882696380 >> v2:172.21.15.146:3300/0 conn(0x7fac041309f0 0x7fac0413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.899+0000 7fac0a32f700 1 -- 172.21.15.146:0/3882696380 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac041338b0 con 0x7fac04133ad0 2023-10-03T10:12:33.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.899+0000 7fac09b2e700 1 --2- 172.21.15.146:0/3882696380 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac041300a0 0x7fac041304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:33.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.899+0000 7fac0a32f700 1 --2- 172.21.15.146:0/3882696380 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac04133ad0 0x7fac04133ea0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fac00009840 tx=0x7fac00009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df8cb743a0783b74 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:33.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.899+0000 7fac0932d700 1 -- 172.21.15.146:0/3882696380 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac00011830 con 0x7fac04133ad0 2023-10-03T10:12:33.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.899+0000 7fac0932d700 1 -- 172.21.15.146:0/3882696380 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac00011990 con 0x7fac04133ad0 2023-10-03T10:12:33.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.899+0000 7fac0932d700 1 -- 172.21.15.146:0/3882696380 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac00011d20 con 0x7fac04133ad0 2023-10-03T10:12:33.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.900+0000 7fac0c593700 1 -- 172.21.15.146:0/3882696380 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac04133ad0 msgr2=0x7fac04133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.900+0000 7fac0c593700 1 --2- 172.21.15.146:0/3882696380 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac04133ad0 0x7fac04133ea0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fac00009840 tx=0x7fac00009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:33.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.900+0000 7fac0c593700 1 -- 172.21.15.146:0/3882696380 shutdown_connections 2023-10-03T10:12:33.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.900+0000 7fac0c593700 1 --2- 172.21.15.146:0/3882696380 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac04133ad0 0x7fac04133ea0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.900+0000 7fac0c593700 1 --2- 172.21.15.146:0/3882696380 >> v2:172.21.15.146:3300/0 conn(0x7fac041309f0 0x7fac0413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.900+0000 7fac0c593700 1 --2- 172.21.15.146:0/3882696380 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac041300a0 0x7fac041304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.900+0000 7fac0c593700 1 -- 172.21.15.146:0/3882696380 >> 172.21.15.146:0/3882696380 conn(0x7fac04099c40 msgr2=0x7fac040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:33.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.900+0000 7fac0c593700 1 -- 172.21.15.146:0/3882696380 shutdown_connections 2023-10-03T10:12:33.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.900+0000 7fac0c593700 1 -- 172.21.15.146:0/3882696380 wait complete. 2023-10-03T10:12:33.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.902+0000 7fac0c593700 1 Processor -- start 2023-10-03T10:12:33.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.902+0000 7fac0c593700 1 -- start start 2023-10-03T10:12:33.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.902+0000 7fac0c593700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac041300a0 0x7fac0411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.902+0000 7fac0c593700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac041309f0 0x7fac0411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.902+0000 7fac0c593700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac04133ad0 0x7fac0411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.902+0000 7fac0c593700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac04120af0 con 0x7fac041309f0 2023-10-03T10:12:33.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.902+0000 7fac0c593700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0411f0f0 con 0x7fac04133ad0 2023-10-03T10:12:33.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.902+0000 7fac0c593700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac04120110 con 0x7fac041300a0 2023-10-03T10:12:33.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.902+0000 7fac0a32f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac041300a0 0x7fac0411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.902+0000 7fac0a32f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac041300a0 0x7fac0411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49868/0 (socket says 172.21.15.146:49868) 2023-10-03T10:12:33.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.902+0000 7fac0a32f700 1 -- 172.21.15.146:0/2422630633 learned_addr learned my addr 172.21.15.146:0/2422630633 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:33.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.903+0000 7fac09b2e700 1 --2- 172.21.15.146:0/2422630633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac041309f0 0x7fac0411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.903+0000 7fac0ab30700 1 --2- 172.21.15.146:0/2422630633 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac04133ad0 0x7fac0411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.903+0000 7fac09b2e700 1 -- 172.21.15.146:0/2422630633 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac041300a0 msgr2=0x7fac0411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.903+0000 7fac09b2e700 1 --2- 172.21.15.146:0/2422630633 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac041300a0 0x7fac0411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.903+0000 7fac09b2e700 1 -- 172.21.15.146:0/2422630633 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac04133ad0 msgr2=0x7fac0411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.903+0000 7fac09b2e700 1 --2- 172.21.15.146:0/2422630633 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac04133ad0 0x7fac0411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.903+0000 7fac09b2e700 1 -- 172.21.15.146:0/2422630633 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf4009550 con 0x7fac041309f0 2023-10-03T10:12:33.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.903+0000 7fac0ab30700 1 --2- 172.21.15.146:0/2422630633 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac04133ad0 0x7fac0411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:33.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.903+0000 7fac0a32f700 1 --2- 172.21.15.146:0/2422630633 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac041300a0 0x7fac0411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:33.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.903+0000 7fac09b2e700 1 --2- 172.21.15.146:0/2422630633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac041309f0 0x7fac0411df80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fac0409ea20 tx=0x7fabf400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:33.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.903+0000 7fabfaffd700 1 -- 172.21.15.146:0/2422630633 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf4004240 con 0x7fac041309f0 2023-10-03T10:12:33.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.903+0000 7fabfaffd700 1 -- 172.21.15.146:0/2422630633 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf40043a0 con 0x7fac041309f0 2023-10-03T10:12:33.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.903+0000 7fabfaffd700 1 -- 172.21.15.146:0/2422630633 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf40036a0 con 0x7fac041309f0 2023-10-03T10:12:33.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.905+0000 7fac0c593700 1 -- 172.21.15.146:0/2422630633 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac000094a0 con 0x7fac041309f0 2023-10-03T10:12:33.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.905+0000 7fac0c593700 1 -- 172.21.15.146:0/2422630633 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0411fb70 con 0x7fac041309f0 2023-10-03T10:12:33.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.905+0000 7fabfaffd700 1 -- 172.21.15.146:0/2422630633 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fabf4003800 con 0x7fac041309f0 2023-10-03T10:12:33.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.906+0000 7fac0a32f700 1 -- 172.21.15.146:0/2422630633 >> v1:172.21.15.146:6816/126749 conn(0x7fabe802f510 legacy=0x7fabe80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:33.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.906+0000 7fabfaffd700 1 -- 172.21.15.146:0/2422630633 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fabf403fd50 con 0x7fac041309f0 2023-10-03T10:12:33.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.908+0000 7fac0c593700 1 -- 172.21.15.146:0/2422630633 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac040a2ea0 con 0x7fac041309f0 2023-10-03T10:12:33.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.916+0000 7fabfaffd700 1 -- 172.21.15.146:0/2422630633 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fabf4013470 con 0x7fac041309f0 2023-10-03T10:12:33.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.924+0000 7fef3825c700 1 Processor -- start 2023-10-03T10:12:33.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.924+0000 7fe34d7cd700 1 Processor -- start 2023-10-03T10:12:33.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.924+0000 7fe34d7cd700 1 -- start start 2023-10-03T10:12:33.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.925+0000 7fef3825c700 1 -- start start 2023-10-03T10:12:33.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.925+0000 7fe34d7cd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe348133ad0 0x7fe348133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.925+0000 7fe34d7cd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe348130bc0 0x7fe34813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.925+0000 7fe34d7cd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe34806b2d0 con 0x7fe3481300a0 2023-10-03T10:12:33.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.925+0000 7fe34d7cd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe348133610 con 0x7fe348130bc0 2023-10-03T10:12:33.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.925+0000 7fe34d7cd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe34809a500 con 0x7fe348133ad0 2023-10-03T10:12:33.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.925+0000 7fe3467fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe3481300a0 0x7fe3481304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35320/0 (socket says 172.21.15.146:35320) 2023-10-03T10:12:33.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.925+0000 7fe3467fc700 1 -- 172.21.15.146:0/4259292255 learned_addr learned my addr 172.21.15.146:0/4259292255 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:33.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.925+0000 7fef3825c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef300a1550 0x7fef30138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.925+0000 7fef3825c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef30139200 0x7fef3013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.925+0000 7fef35ff8700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fef300a0a70 0x7fef300a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35336/0 (socket says 172.21.15.146:35336) 2023-10-03T10:12:33.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.925+0000 7fef35ff8700 1 -- 172.21.15.146:0/1384718212 learned_addr learned my addr 172.21.15.146:0/1384718212 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:33.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.925+0000 7fef3825c700 1 -- 172.21.15.146:0/1384718212 --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3009e9d0 con 0x7fef300a0a70 2023-10-03T10:12:33.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.925+0000 7fef3825c700 1 -- 172.21.15.146:0/1384718212 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3009dc00 con 0x7fef300a1550 2023-10-03T10:12:33.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.925+0000 7fef3825c700 1 -- 172.21.15.146:0/1384718212 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef3009dec0 con 0x7fef30139200 2023-10-03T10:12:33.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.925+0000 7fef367f9700 1 --2- 172.21.15.146:0/1384718212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef30139200 0x7fef3013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fe345ffb700 1 -- 172.21.15.146:0/4259292255 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066462976 0 0) 0x7fe34806b2d0 con 0x7fe3481300a0 2023-10-03T10:12:33.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fe345ffb700 1 -- 172.21.15.146:0/4259292255 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3300035b0 con 0x7fe3481300a0 2023-10-03T10:12:33.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fe345ffb700 1 -- 172.21.15.146:0/4259292255 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3312493389 0 0) 0x7fe3300035b0 con 0x7fe3481300a0 2023-10-03T10:12:33.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fe345ffb700 1 -- 172.21.15.146:0/4259292255 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe348133ad0 msgr2=0x7fe348133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:33.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fe345ffb700 1 --2- 172.21.15.146:0/4259292255 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe348133ad0 0x7fe348133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fe345ffb700 1 -- 172.21.15.146:0/4259292255 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe348130bc0 msgr2=0x7fe34813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:33.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fe345ffb700 1 --2- 172.21.15.146:0/4259292255 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe348130bc0 0x7fe34813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fe345ffb700 1 -- 172.21.15.146:0/4259292255 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3481338b0 con 0x7fe3481300a0 2023-10-03T10:12:33.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fef367f9700 1 -- 172.21.15.146:0/1384718212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef300a1550 msgr2=0x7fef30138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:33.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fef367f9700 1 --2- 172.21.15.146:0/1384718212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef300a1550 0x7fef30138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fe345ffb700 1 -- 172.21.15.146:0/4259292255 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2532932501 0 0) 0x7fe33c001670 con 0x7fe3481300a0 2023-10-03T10:12:33.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fef367f9700 1 -- 172.21.15.146:0/1384718212 >> v1:172.21.15.146:6789/0 conn(0x7fef300a0a70 legacy=0x7fef300a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fef367f9700 1 -- 172.21.15.146:0/1384718212 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3009e6a0 con 0x7fef30139200 2023-10-03T10:12:33.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fe345ffb700 1 -- 172.21.15.146:0/4259292255 >> v1:172.21.15.146:6789/0 conn(0x7fe3481300a0 legacy=0x7fe3481304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fe345ffb700 1 --2- 172.21.15.146:0/4259292255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe330003a70 0x7fe330003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fe345ffb700 1 --2- 172.21.15.146:0/4259292255 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe330004850 0x7fe330004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fe345ffb700 1 --2- 172.21.15.146:0/4259292255 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe330005430 0x7fe33000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fe345ffb700 1 -- 172.21.15.146:0/4259292255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe348133610 con 0x7fe330003a70 2023-10-03T10:12:33.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fe345ffb700 1 -- 172.21.15.146:0/4259292255 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe34809a500 con 0x7fe330004850 2023-10-03T10:12:33.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fe345ffb700 1 -- 172.21.15.146:0/4259292255 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe33000c2b0 con 0x7fe330005430 2023-10-03T10:12:33.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fef367f9700 1 --2- 172.21.15.146:0/1384718212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef30139200 0x7fef3013b5e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fef28009dc0 tx=0x7fef2800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ab6d456e7839bdb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:33.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fef34ff6700 1 -- 172.21.15.146:0/1384718212 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2800e070 con 0x7fef30139200 2023-10-03T10:12:33.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fef34ff6700 1 -- 172.21.15.146:0/1384718212 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2800bbd0 con 0x7fef30139200 2023-10-03T10:12:33.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.926+0000 7fef34ff6700 1 -- 172.21.15.146:0/1384718212 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef28012430 con 0x7fef30139200 2023-10-03T10:12:33.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.927+0000 7fe346ffd700 1 --2- 172.21.15.146:0/4259292255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe330003a70 0x7fe330003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.927+0000 7fe3477fe700 1 --2- 172.21.15.146:0/4259292255 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe330005430 0x7fe33000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.927+0000 7fe346ffd700 1 -- 172.21.15.146:0/4259292255 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe330005430 msgr2=0x7fe33000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:33.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.927+0000 7fe346ffd700 1 --2- 172.21.15.146:0/4259292255 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe330005430 0x7fe33000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.927+0000 7fe346ffd700 1 -- 172.21.15.146:0/4259292255 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe330004850 msgr2=0x7fe330004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:33.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.927+0000 7fe346ffd700 1 --2- 172.21.15.146:0/4259292255 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe330004850 0x7fe330004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.927+0000 7fe346ffd700 1 -- 172.21.15.146:0/4259292255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3300035b0 con 0x7fe330003a70 2023-10-03T10:12:33.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.927+0000 7fe346ffd700 1 --2- 172.21.15.146:0/4259292255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe330003a70 0x7fe330003e80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe34806e5d0 tx=0x7fe330005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfbc14534add491 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:33.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.927+0000 7fe345ffb700 1 -- 172.21.15.146:0/4259292255 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe338011620 con 0x7fe330003a70 2023-10-03T10:12:33.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.927+0000 7fe345ffb700 1 -- 172.21.15.146:0/4259292255 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe338011780 con 0x7fe330003a70 2023-10-03T10:12:33.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.927+0000 7fe345ffb700 1 -- 172.21.15.146:0/4259292255 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe338011b30 con 0x7fe330003a70 2023-10-03T10:12:33.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.927+0000 7fef3825c700 1 -- 172.21.15.146:0/1384718212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef30139200 msgr2=0x7fef3013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.927+0000 7fef3825c700 1 --2- 172.21.15.146:0/1384718212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef30139200 0x7fef3013b5e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fef28009dc0 tx=0x7fef2800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:33.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.927+0000 7fef3825c700 1 -- 172.21.15.146:0/1384718212 shutdown_connections 2023-10-03T10:12:33.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.927+0000 7fef3825c700 1 --2- 172.21.15.146:0/1384718212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef30139200 0x7fef3013b5e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.927+0000 7fef3825c700 1 --2- 172.21.15.146:0/1384718212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef300a1550 0x7fef30138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.928+0000 7fef3825c700 1 -- 172.21.15.146:0/1384718212 >> 172.21.15.146:0/1384718212 conn(0x7fef300a6610 msgr2=0x7fef300a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:33.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.928+0000 7fef3825c700 1 -- 172.21.15.146:0/1384718212 shutdown_connections 2023-10-03T10:12:33.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.928+0000 7fef3825c700 1 -- 172.21.15.146:0/1384718212 wait complete. 2023-10-03T10:12:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.928+0000 7fe34d7cd700 1 -- 172.21.15.146:0/4259292255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe330003a70 msgr2=0x7fe330003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.928+0000 7fe34d7cd700 1 --2- 172.21.15.146:0/4259292255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe330003a70 0x7fe330003e80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe34806e5d0 tx=0x7fe330005880 comp rx=0 tx=0).stop 2023-10-03T10:12:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.928+0000 7fe34d7cd700 1 -- 172.21.15.146:0/4259292255 shutdown_connections 2023-10-03T10:12:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.928+0000 7fe34d7cd700 1 --2- 172.21.15.146:0/4259292255 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe330005430 0x7fe33000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.928+0000 7fe34d7cd700 1 --2- 172.21.15.146:0/4259292255 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe330004850 0x7fe330004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.928+0000 7fe34d7cd700 1 --2- 172.21.15.146:0/4259292255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe330003a70 0x7fe330003e80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.928+0000 7fe34d7cd700 1 -- 172.21.15.146:0/4259292255 >> 172.21.15.146:0/4259292255 conn(0x7fe348099c40 msgr2=0x7fe3480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.928+0000 7fe34d7cd700 1 -- 172.21.15.146:0/4259292255 shutdown_connections 2023-10-03T10:12:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.928+0000 7fe34d7cd700 1 -- 172.21.15.146:0/4259292255 wait complete. 2023-10-03T10:12:33.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.929+0000 7fef3825c700 1 Processor -- start 2023-10-03T10:12:33.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.929+0000 7fe34d7cd700 1 Processor -- start 2023-10-03T10:12:33.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.929+0000 7fef3825c700 1 -- start start 2023-10-03T10:12:33.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.929+0000 7fe34d7cd700 1 -- start start 2023-10-03T10:12:33.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.929+0000 7fe34d7cd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe330003a70 0x7fe348070e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.929+0000 7fe34d7cd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe330004850 0x7fe3480713b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.929+0000 7fe34d7cd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe330005430 0x7fe3480718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.929+0000 7fe34d7cd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34811b6b0 con 0x7fe330003a70 2023-10-03T10:12:33.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.929+0000 7fe34d7cd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3480722d0 con 0x7fe330004850 2023-10-03T10:12:33.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.929+0000 7fe34d7cd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe34806fcf0 con 0x7fe330005430 2023-10-03T10:12:33.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fef3825c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef300a0a70 0x7fef3011c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fef3825c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef300a1550 0x7fef3011cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fef3825c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef30139200 0x7fef3011d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fef3825c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3011ef00 con 0x7fef300a1550 2023-10-03T10:12:33.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fef3825c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3011e260 con 0x7fef30139200 2023-10-03T10:12:33.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fef3825c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef3011dbf0 con 0x7fef300a0a70 2023-10-03T10:12:33.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fef35ff8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef300a0a70 0x7fef3011c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fef35ff8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef300a0a70 0x7fef3011c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49920/0 (socket says 172.21.15.146:49920) 2023-10-03T10:12:33.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fef35ff8700 1 -- 172.21.15.146:0/989505411 learned_addr learned my addr 172.21.15.146:0/989505411 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:33.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fef357f7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef300a1550 0x7fef3011cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fe346ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe330003a70 0x7fe348070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fe346ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe330003a70 0x7fe348070e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45508/0 (socket says 172.21.15.146:45508) 2023-10-03T10:12:33.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fe346ffd700 1 -- 172.21.15.146:0/1277367863 learned_addr learned my addr 172.21.15.146:0/1277367863 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:33.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fef35ff8700 1 -- 172.21.15.146:0/989505411 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef30139200 msgr2=0x7fef3011d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fef35ff8700 1 --2- 172.21.15.146:0/989505411 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef30139200 0x7fef3011d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fef35ff8700 1 -- 172.21.15.146:0/989505411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef300a1550 msgr2=0x7fef3011cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fef35ff8700 1 --2- 172.21.15.146:0/989505411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef300a1550 0x7fef3011cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fef35ff8700 1 -- 172.21.15.146:0/989505411 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef28009a70 con 0x7fef300a0a70 2023-10-03T10:12:33.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fe346ffd700 1 -- 172.21.15.146:0/1277367863 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe330005430 msgr2=0x7fe3480718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fe346ffd700 1 --2- 172.21.15.146:0/1277367863 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe330005430 0x7fe3480718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fe346ffd700 1 -- 172.21.15.146:0/1277367863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe330004850 msgr2=0x7fe3480713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fe346ffd700 1 --2- 172.21.15.146:0/1277367863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe330004850 0x7fe3480713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fe346ffd700 1 -- 172.21.15.146:0/1277367863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34806ffb0 con 0x7fe330003a70 2023-10-03T10:12:33.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.930+0000 7fef35ff8700 1 --2- 172.21.15.146:0/989505411 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef300a0a70 0x7fef3011c8a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00c520 tx=0x7fef2c00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:33.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.931+0000 7fe346ffd700 1 --2- 172.21.15.146:0/1277367863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe330003a70 0x7fe348070e70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe33000c200 tx=0x7fe338004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:33.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.931+0000 7fef267fc700 1 -- 172.21.15.146:0/989505411 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c005d70 con 0x7fef300a0a70 2023-10-03T10:12:33.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.931+0000 7fef3825c700 1 -- 172.21.15.146:0/989505411 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef300a5290 con 0x7fef300a0a70 2023-10-03T10:12:33.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.931+0000 7fef3825c700 1 -- 172.21.15.146:0/989505411 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3011f400 con 0x7fef300a0a70 2023-10-03T10:12:33.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.931+0000 7fef267fc700 1 -- 172.21.15.146:0/989505411 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2c0070d0 con 0x7fef300a0a70 2023-10-03T10:12:33.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.931+0000 7fef267fc700 1 -- 172.21.15.146:0/989505411 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c007440 con 0x7fef300a0a70 2023-10-03T10:12:33.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.931+0000 7fe32f7fe700 1 -- 172.21.15.146:0/1277367863 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe338024620 con 0x7fe330003a70 2023-10-03T10:12:33.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.931+0000 7fe32f7fe700 1 -- 172.21.15.146:0/1277367863 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe338024780 con 0x7fe330003a70 2023-10-03T10:12:33.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.931+0000 7fe32f7fe700 1 -- 172.21.15.146:0/1277367863 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe338024b10 con 0x7fe330003a70 2023-10-03T10:12:33.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.932+0000 7fef267fc700 1 -- 172.21.15.146:0/989505411 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fef2c0075a0 con 0x7fef300a0a70 2023-10-03T10:12:33.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.932+0000 7fe34d7cd700 1 -- 172.21.15.146:0/1277367863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe34811d080 con 0x7fe330003a70 2023-10-03T10:12:33.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.932+0000 7fe34d7cd700 1 -- 172.21.15.146:0/1277367863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe348072680 con 0x7fe330003a70 2023-10-03T10:12:33.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.932+0000 7fef267fc700 1 -- 172.21.15.146:0/989505411 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fef2c03f190 con 0x7fef300a0a70 2023-10-03T10:12:33.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.932+0000 7fef357f7700 1 -- 172.21.15.146:0/989505411 >> v1:172.21.15.146:6816/126749 conn(0x7fef1402f510 legacy=0x7fef140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:33.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.933+0000 7fef3825c700 1 -- 172.21.15.146:0/989505411 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef180052e0 con 0x7fef300a0a70 2023-10-03T10:12:33.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.933+0000 7fe32f7fe700 1 -- 172.21.15.146:0/1277367863 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe338022070 con 0x7fe330003a70 2023-10-03T10:12:33.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.933+0000 7fe34d7cd700 1 -- 172.21.15.146:0/1277367863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe34804f2a0 con 0x7fe330003a70 2023-10-03T10:12:33.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.933+0000 7fe32f7fe700 1 -- 172.21.15.146:0/1277367863 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fe338040a40 con 0x7fe330003a70 2023-10-03T10:12:33.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.935+0000 7fe3467fc700 1 -- 172.21.15.146:0/1277367863 >> v1:172.21.15.146:6816/126749 conn(0x7fe33402f560 legacy=0x7fe334031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:33.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.938+0000 7fe32f7fe700 1 -- 172.21.15.146:0/1277367863 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe33802c950 con 0x7fe330003a70 2023-10-03T10:12:33.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.941+0000 7fc4c0c00700 1 Processor -- start 2023-10-03T10:12:33.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.941+0000 7fc4c0c00700 1 -- start start 2023-10-03T10:12:33.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.941+0000 7fc4c0c00700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc4bc09d860 0x7fc4bc09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.942+0000 7fc4c0c00700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4bc09e170 0x7fc4bc1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.942+0000 7fc4c0c00700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc09aaa0 con 0x7fc4bc130ce0 2023-10-03T10:12:33.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.942+0000 7fc4c0c00700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4bc09f870 con 0x7fc4bc09d860 2023-10-03T10:12:33.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.942+0000 7fc4c0c00700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc09b360 con 0x7fc4bc09e170 2023-10-03T10:12:33.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.942+0000 7fc4ba59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc4bc09d860 0x7fc4bc09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.942+0000 7fc4ba59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc4bc09d860 0x7fc4bc09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45520/0 (socket says 172.21.15.146:45520) 2023-10-03T10:12:33.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.942+0000 7fc4ba59c700 1 -- 172.21.15.146:0/1651440021 learned_addr learned my addr 172.21.15.146:0/1651440021 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:33.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.942+0000 7fc4b9d9b700 1 --2- 172.21.15.146:0/1651440021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4bc09e170 0x7fc4bc1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.942+0000 7fef267fc700 1 -- 172.21.15.146:0/989505411 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef2c017070 con 0x7fef300a0a70 2023-10-03T10:12:33.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.942+0000 7fc4ba59c700 1 -- 172.21.15.146:0/1651440021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4bc09e170 msgr2=0x7fc4bc1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:33.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.942+0000 7fc4ba59c700 1 --2- 172.21.15.146:0/1651440021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4bc09e170 0x7fc4bc1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.942+0000 7fc4ba59c700 1 -- 172.21.15.146:0/1651440021 >> v1:172.21.15.146:6789/0 conn(0x7fc4bc130ce0 legacy=0x7fc4bc06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.942+0000 7fc4ba59c700 1 -- 172.21.15.146:0/1651440021 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc09b620 con 0x7fc4bc09d860 2023-10-03T10:12:33.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.942+0000 7fc4ba59c700 1 --2- 172.21.15.146:0/1651440021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4bc09d860 0x7fc4bc09dc30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009920 tx=0x7fc4ac009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411ad16c0aec1699 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:33.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.942+0000 7fc4b959a700 1 -- 172.21.15.146:0/1651440021 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac00ba20 con 0x7fc4bc09d860 2023-10-03T10:12:33.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.942+0000 7fc4b959a700 1 -- 172.21.15.146:0/1651440021 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac00bb80 con 0x7fc4bc09d860 2023-10-03T10:12:33.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.942+0000 7fc4b959a700 1 -- 172.21.15.146:0/1651440021 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac009e70 con 0x7fc4bc09d860 2023-10-03T10:12:33.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.943+0000 7fc4c0c00700 1 -- 172.21.15.146:0/1651440021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4bc09d860 msgr2=0x7fc4bc09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.943+0000 7fc4c0c00700 1 --2- 172.21.15.146:0/1651440021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4bc09d860 0x7fc4bc09dc30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009920 tx=0x7fc4ac009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:33.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.945+0000 7fc4c0c00700 1 -- 172.21.15.146:0/1651440021 shutdown_connections 2023-10-03T10:12:33.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.945+0000 7fc4c0c00700 1 --2- 172.21.15.146:0/1651440021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4bc09d860 0x7fc4bc09dc30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.945+0000 7fc4c0c00700 1 --2- 172.21.15.146:0/1651440021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4bc09e170 0x7fc4bc1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.945+0000 7fc4c0c00700 1 -- 172.21.15.146:0/1651440021 >> 172.21.15.146:0/1651440021 conn(0x7fc4bc099c40 msgr2=0x7fc4bc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:33.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.945+0000 7fc4c0c00700 1 -- 172.21.15.146:0/1651440021 shutdown_connections 2023-10-03T10:12:33.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.945+0000 7fc4c0c00700 1 -- 172.21.15.146:0/1651440021 wait complete. 2023-10-03T10:12:33.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.946+0000 7fc4c0c00700 1 Processor -- start 2023-10-03T10:12:33.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.946+0000 7fc4c0c00700 1 -- start start 2023-10-03T10:12:33.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.947+0000 7fc4c0c00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4bc09d860 0x7fc4bc13ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.947+0000 7fc4c0c00700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc4bc09e170 0x7fc4bc135d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.947+0000 7fc4c0c00700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4bc130ce0 0x7fc4bc136250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.947+0000 7fc4c0c00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc138ae0 con 0x7fc4bc09d860 2023-10-03T10:12:33.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.947+0000 7fc4c0c00700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc09c8b0 con 0x7fc4bc130ce0 2023-10-03T10:12:33.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.947+0000 7fc4c0c00700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc1397a0 con 0x7fc4bc09e170 2023-10-03T10:12:33.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.947+0000 7fc4ba59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4bc09d860 0x7fc4bc13ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.947+0000 7fc4bad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4bc130ce0 0x7fc4bc136250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.947+0000 7fc4ba59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4bc09d860 0x7fc4bc13ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45532/0 (socket says 172.21.15.146:45532) 2023-10-03T10:12:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.947+0000 7fc4bad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4bc130ce0 0x7fc4bc136250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50316/0 (socket says 172.21.15.146:50316) 2023-10-03T10:12:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.947+0000 7fc4ba59c700 1 -- 172.21.15.146:0/3478591749 learned_addr learned my addr 172.21.15.146:0/3478591749 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.947+0000 7fc4b9d9b700 1 --2- 172.21.15.146:0/3478591749 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc4bc09e170 0x7fc4bc135d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.947+0000 7fc4ba59c700 1 -- 172.21.15.146:0/3478591749 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc4bc09e170 msgr2=0x7fc4bc135d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.947+0000 7fc4ba59c700 1 --2- 172.21.15.146:0/3478591749 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc4bc09e170 0x7fc4bc135d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.948+0000 7fc4ba59c700 1 -- 172.21.15.146:0/3478591749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4bc130ce0 msgr2=0x7fc4bc136250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.948+0000 7fc4ba59c700 1 --2- 172.21.15.146:0/3478591749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4bc130ce0 0x7fc4bc136250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.948+0000 7fc4ba59c700 1 -- 172.21.15.146:0/3478591749 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac009550 con 0x7fc4bc09d860 2023-10-03T10:12:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.948+0000 7fc4ba59c700 1 --2- 172.21.15.146:0/3478591749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4bc09d860 0x7fc4bc13ac90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009c70 tx=0x7fc4ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.948+0000 7fc4aaffd700 1 -- 172.21.15.146:0/3478591749 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac0044d0 con 0x7fc4bc09d860 2023-10-03T10:12:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.948+0000 7fc4aaffd700 1 -- 172.21.15.146:0/3478591749 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac01e070 con 0x7fc4bc09d860 2023-10-03T10:12:33.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.948+0000 7fc4aaffd700 1 -- 172.21.15.146:0/3478591749 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac0038e0 con 0x7fc4bc09d860 2023-10-03T10:12:33.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.948+0000 7fc4c0c00700 1 -- 172.21.15.146:0/3478591749 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4bc0a21b0 con 0x7fc4bc09d860 2023-10-03T10:12:33.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.948+0000 7fc4c0c00700 1 -- 172.21.15.146:0/3478591749 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4bc138040 con 0x7fc4bc09d860 2023-10-03T10:12:33.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.949+0000 7fc4aaffd700 1 -- 172.21.15.146:0/3478591749 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc4ac003a40 con 0x7fc4bc09d860 2023-10-03T10:12:33.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.949+0000 7fc4c0c00700 1 -- 172.21.15.146:0/3478591749 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4bc13a380 con 0x7fc4bc09d860 2023-10-03T10:12:33.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.949+0000 7fc4b9d9b700 1 -- 172.21.15.146:0/3478591749 >> v1:172.21.15.146:6816/126749 conn(0x7fc49c02f510 legacy=0x7fc49c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:33.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.952+0000 7fc4aaffd700 1 -- 172.21.15.146:0/3478591749 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fc4ac020070 con 0x7fc4bc09d860 2023-10-03T10:12:33.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:33.954+0000 7fc4aaffd700 1 -- 172.21.15.146:0/3478591749 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc4ac046060 con 0x7fc4bc09d860 2023-10-03T10:12:34.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.107+0000 7fac0a32f700 1 -- 172.21.15.146:0/2422630633 >> v1:172.21.15.146:6816/126749 conn(0x7fabe802f510 legacy=0x7fabe80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:34.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.120+0000 7fac0c593700 1 -- 172.21.15.146:0/2422630633 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fac0404f2a0 con 0x7fac041309f0 2023-10-03T10:12:34.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.120+0000 7fabfaffd700 1 -- 172.21.15.146:0/2422630633 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fabf401bba0 con 0x7fac041309f0 2023-10-03T10:12:34.121 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:34.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.123+0000 7fac0c593700 1 -- 172.21.15.146:0/2422630633 >> v1:172.21.15.146:6816/126749 conn(0x7fabe802f510 legacy=0x7fabe80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:34.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.123+0000 7fac0c593700 1 -- 172.21.15.146:0/2422630633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac041309f0 msgr2=0x7fac0411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.123+0000 7fac0c593700 1 --2- 172.21.15.146:0/2422630633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac041309f0 0x7fac0411df80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fac0409ea20 tx=0x7fabf400ec60 comp rx=0 tx=0).stop 2023-10-03T10:12:34.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.123+0000 7fac0c593700 1 -- 172.21.15.146:0/2422630633 shutdown_connections 2023-10-03T10:12:34.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.123+0000 7fac0c593700 1 --2- 172.21.15.146:0/2422630633 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac04133ad0 0x7fac0411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.123+0000 7fac0c593700 1 --2- 172.21.15.146:0/2422630633 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac041300a0 0x7fac0411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.123+0000 7fac0c593700 1 --2- 172.21.15.146:0/2422630633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac041309f0 0x7fac0411df80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.123+0000 7fac0c593700 1 -- 172.21.15.146:0/2422630633 >> 172.21.15.146:0/2422630633 conn(0x7fac04099c40 msgr2=0x7fac041321d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.124+0000 7fac0c593700 1 -- 172.21.15.146:0/2422630633 shutdown_connections 2023-10-03T10:12:34.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.124+0000 7fac0c593700 1 -- 172.21.15.146:0/2422630633 wait complete. 2023-10-03T10:12:34.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.133+0000 7fef357f7700 1 -- 172.21.15.146:0/989505411 >> v1:172.21.15.146:6816/126749 conn(0x7fef1402f510 legacy=0x7fef140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.136+0000 7fe3467fc700 1 -- 172.21.15.146:0/1277367863 >> v1:172.21.15.146:6816/126749 conn(0x7fe33402f560 legacy=0x7fe334031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:34.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:34.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.143+0000 7fe34d7cd700 1 -- 172.21.15.146:0/1277367863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe34806c3b0 con 0x7fe330003a70 2023-10-03T10:12:34.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.143+0000 7fe32f7fe700 1 -- 172.21.15.146:0/1277367863 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe338029090 con 0x7fe330003a70 2023-10-03T10:12:34.144 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:34.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.145+0000 7fe34d7cd700 1 -- 172.21.15.146:0/1277367863 >> v1:172.21.15.146:6816/126749 conn(0x7fe33402f560 legacy=0x7fe334031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:34.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.145+0000 7fe34d7cd700 1 -- 172.21.15.146:0/1277367863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe330003a70 msgr2=0x7fe348070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.145+0000 7fe34d7cd700 1 --2- 172.21.15.146:0/1277367863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe330003a70 0x7fe348070e70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe33000c200 tx=0x7fe338004750 comp rx=0 tx=0).stop 2023-10-03T10:12:34.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.145+0000 7fe34d7cd700 1 -- 172.21.15.146:0/1277367863 shutdown_connections 2023-10-03T10:12:34.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.145+0000 7fe34d7cd700 1 --2- 172.21.15.146:0/1277367863 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe330005430 0x7fe3480718f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.145+0000 7fe34d7cd700 1 --2- 172.21.15.146:0/1277367863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe330003a70 0x7fe348070e70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.145+0000 7fe34d7cd700 1 --2- 172.21.15.146:0/1277367863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe330004850 0x7fe3480713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.145+0000 7fe34d7cd700 1 -- 172.21.15.146:0/1277367863 >> 172.21.15.146:0/1277367863 conn(0x7fe348099c40 msgr2=0x7fe34812eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.145+0000 7fe34d7cd700 1 -- 172.21.15.146:0/1277367863 shutdown_connections 2023-10-03T10:12:34.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.145+0000 7fe34d7cd700 1 -- 172.21.15.146:0/1277367863 wait complete. 2023-10-03T10:12:34.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.153+0000 7fc4b9d9b700 1 -- 172.21.15.146:0/3478591749 >> v1:172.21.15.146:6816/126749 conn(0x7fc49c02f510 legacy=0x7fc49c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:34.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.157+0000 7fef3825c700 1 -- 172.21.15.146:0/989505411 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fef18005860 con 0x7fef300a0a70 2023-10-03T10:12:34.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:34.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.158+0000 7fef267fc700 1 -- 172.21.15.146:0/989505411 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef2c024070 con 0x7fef300a0a70 2023-10-03T10:12:34.159 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:34.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.160+0000 7fef3825c700 1 -- 172.21.15.146:0/989505411 >> v1:172.21.15.146:6816/126749 conn(0x7fef1402f510 legacy=0x7fef140319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:34.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.160+0000 7fef3825c700 1 -- 172.21.15.146:0/989505411 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef300a0a70 msgr2=0x7fef3011c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.160+0000 7fef3825c700 1 --2- 172.21.15.146:0/989505411 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef300a0a70 0x7fef3011c8a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00c520 tx=0x7fef2c00c830 comp rx=0 tx=0).stop 2023-10-03T10:12:34.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.160+0000 7fef3825c700 1 -- 172.21.15.146:0/989505411 shutdown_connections 2023-10-03T10:12:34.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.160+0000 7fef3825c700 1 --2- 172.21.15.146:0/989505411 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef30139200 0x7fef3011d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.160+0000 7fef3825c700 1 --2- 172.21.15.146:0/989505411 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef300a0a70 0x7fef3011c8a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.160+0000 7fef3825c700 1 --2- 172.21.15.146:0/989505411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef300a1550 0x7fef3011cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.160+0000 7fef3825c700 1 -- 172.21.15.146:0/989505411 >> 172.21.15.146:0/989505411 conn(0x7fef300a6610 msgr2=0x7fef301360c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.160+0000 7fef3825c700 1 -- 172.21.15.146:0/989505411 shutdown_connections 2023-10-03T10:12:34.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.160+0000 7fef3825c700 1 -- 172.21.15.146:0/989505411 wait complete. 2023-10-03T10:12:34.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.166+0000 7fc4c0c00700 1 -- 172.21.15.146:0/3478591749 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc4bc04f2a0 con 0x7fc4bc09d860 2023-10-03T10:12:34.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.166+0000 7fc4aaffd700 1 -- 172.21.15.146:0/3478591749 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc4ac046020 con 0x7fc4bc09d860 2023-10-03T10:12:34.167 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:34.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.168+0000 7fc4c0c00700 1 -- 172.21.15.146:0/3478591749 >> v1:172.21.15.146:6816/126749 conn(0x7fc49c02f510 legacy=0x7fc49c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:34.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.168+0000 7fc4c0c00700 1 -- 172.21.15.146:0/3478591749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4bc09d860 msgr2=0x7fc4bc13ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.168+0000 7fc4c0c00700 1 --2- 172.21.15.146:0/3478591749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4bc09d860 0x7fc4bc13ac90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009c70 tx=0x7fc4ac004750 comp rx=0 tx=0).stop 2023-10-03T10:12:34.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.168+0000 7fc4c0c00700 1 -- 172.21.15.146:0/3478591749 shutdown_connections 2023-10-03T10:12:34.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.168+0000 7fc4c0c00700 1 --2- 172.21.15.146:0/3478591749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4bc130ce0 0x7fc4bc136250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.168+0000 7fc4c0c00700 1 --2- 172.21.15.146:0/3478591749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4bc09d860 0x7fc4bc13ac90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.168+0000 7fc4c0c00700 1 --2- 172.21.15.146:0/3478591749 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc4bc09e170 0x7fc4bc135d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.168+0000 7fc4c0c00700 1 -- 172.21.15.146:0/3478591749 >> 172.21.15.146:0/3478591749 conn(0x7fc4bc099c40 msgr2=0x7fc4bc070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.168+0000 7fc4c0c00700 1 -- 172.21.15.146:0/3478591749 shutdown_connections 2023-10-03T10:12:34.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:34.168+0000 7fc4c0c00700 1 -- 172.21.15.146:0/3478591749 wait complete. 2023-10-03T10:12:34.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:34.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:35.141 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:35.160 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:35.175 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:35.182 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:35.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.284+0000 7f94f6998700 1 Processor -- start 2023-10-03T10:12:35.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.284+0000 7f94f6998700 1 -- start start 2023-10-03T10:12:35.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.285+0000 7f94f6998700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f94f009f350 0x7f94f0136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.285+0000 7f94f6998700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94f01371c0 0x7f94f01395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.285+0000 7f94f6998700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f009c970 con 0x7f94f009e870 2023-10-03T10:12:35.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.285+0000 7f94f6998700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f00a0920 con 0x7f94f009f350 2023-10-03T10:12:35.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.285+0000 7f94f6998700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f009f9c0 con 0x7f94f01371c0 2023-10-03T10:12:35.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.285+0000 7f94ef7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f94f009f350 0x7f94f0136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.285+0000 7f94f4f35700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94f01371c0 0x7f94f01395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.285+0000 7f94ef7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f94f009f350 0x7f94f0136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44338/0 (socket says 172.21.15.146:44338) 2023-10-03T10:12:35.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.285+0000 7f94ef7fe700 1 -- 172.21.15.146:0/1460146009 learned_addr learned my addr 172.21.15.146:0/1460146009 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:35.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.285+0000 7f94f4f35700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94f01371c0 0x7f94f01395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42642/0 (socket says 172.21.15.146:42642) 2023-10-03T10:12:35.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.285+0000 7f94f4f35700 1 -- 172.21.15.146:0/1460146009 >> v2:172.21.15.146:3300/0 conn(0x7f94f009f350 msgr2=0x7f94f0136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:35.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.285+0000 7f94f4f35700 1 --2- 172.21.15.146:0/1460146009 >> v2:172.21.15.146:3300/0 conn(0x7f94f009f350 0x7f94f0136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.285+0000 7f94f4f35700 1 -- 172.21.15.146:0/1460146009 >> v1:172.21.15.146:6789/0 conn(0x7f94f009e870 legacy=0x7f94f009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.285+0000 7f94f4f35700 1 -- 172.21.15.146:0/1460146009 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f009bab0 con 0x7f94f01371c0 2023-10-03T10:12:35.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.285+0000 7f94ef7fe700 1 --2- 172.21.15.146:0/1460146009 >> v2:172.21.15.146:3300/0 conn(0x7f94f009f350 0x7f94f0136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:35.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.286+0000 7f94f4f35700 1 --2- 172.21.15.146:0/1460146009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94f01371c0 0x7f94f01395a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009d90 tx=0x7f94e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7128660c621f88d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:35.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.286+0000 7f94eeffd700 1 -- 172.21.15.146:0/1460146009 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e800e070 con 0x7f94f01371c0 2023-10-03T10:12:35.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.286+0000 7f94eeffd700 1 -- 172.21.15.146:0/1460146009 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e800bb20 con 0x7f94f01371c0 2023-10-03T10:12:35.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.286+0000 7f94eeffd700 1 -- 172.21.15.146:0/1460146009 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e8012430 con 0x7f94f01371c0 2023-10-03T10:12:35.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.287+0000 7f94f6998700 1 -- 172.21.15.146:0/1460146009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94f01371c0 msgr2=0x7f94f01395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.287+0000 7f94f6998700 1 --2- 172.21.15.146:0/1460146009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94f01371c0 0x7f94f01395a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009d90 tx=0x7f94e800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:35.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.287+0000 7f94f6998700 1 -- 172.21.15.146:0/1460146009 shutdown_connections 2023-10-03T10:12:35.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.287+0000 7f94f6998700 1 --2- 172.21.15.146:0/1460146009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94f01371c0 0x7f94f01395a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.287+0000 7f94f6998700 1 --2- 172.21.15.146:0/1460146009 >> v2:172.21.15.146:3300/0 conn(0x7f94f009f350 0x7f94f0136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.287+0000 7f94f6998700 1 -- 172.21.15.146:0/1460146009 >> 172.21.15.146:0/1460146009 conn(0x7f94f00a4430 msgr2=0x7f94f00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:35.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.287+0000 7f94f6998700 1 -- 172.21.15.146:0/1460146009 shutdown_connections 2023-10-03T10:12:35.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.287+0000 7f94f6998700 1 -- 172.21.15.146:0/1460146009 wait complete. 2023-10-03T10:12:35.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.288+0000 7f94f6998700 1 Processor -- start 2023-10-03T10:12:35.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.288+0000 7f94f6998700 1 -- start start 2023-10-03T10:12:35.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.288+0000 7f94f6998700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94f009e870 0x7f94f0127a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.288+0000 7f94f6998700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f94f009f350 0x7f94f0127f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.289+0000 7f94f6998700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94f01371c0 0x7f94f01cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.289+0000 7f94f6998700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f01275f0 con 0x7f94f009e870 2023-10-03T10:12:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.289+0000 7f94f6998700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f012a4e0 con 0x7f94f01371c0 2023-10-03T10:12:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.289+0000 7f94f6998700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94f012a7a0 con 0x7f94f009f350 2023-10-03T10:12:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.289+0000 7f94f4f35700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94f01371c0 0x7f94f01cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.289+0000 7f94effff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94f009e870 0x7f94f0127a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.289+0000 7f94f4f35700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94f01371c0 0x7f94f01cc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42644/0 (socket says 172.21.15.146:42644) 2023-10-03T10:12:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.289+0000 7f94f4f35700 1 -- 172.21.15.146:0/3826362714 learned_addr learned my addr 172.21.15.146:0/3826362714 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.289+0000 7f94effff700 1 -- 172.21.15.146:0/3826362714 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f94f009f350 msgr2=0x7f94f0127f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.289+0000 7f94effff700 1 --2- 172.21.15.146:0/3826362714 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f94f009f350 0x7f94f0127f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.289+0000 7f94effff700 1 -- 172.21.15.146:0/3826362714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94f01371c0 msgr2=0x7f94f01cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.289+0000 7f94effff700 1 --2- 172.21.15.146:0/3826362714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94f01371c0 0x7f94f01cc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.289+0000 7f94effff700 1 -- 172.21.15.146:0/3826362714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e4009550 con 0x7f94f009e870 2023-10-03T10:12:35.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.289+0000 7f94f4f35700 1 --2- 172.21.15.146:0/3826362714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94f01371c0 0x7f94f01cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:35.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.289+0000 7f94effff700 1 --2- 172.21.15.146:0/3826362714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94f009e870 0x7f94f0127a40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f94e0000f60 tx=0x7f94e000c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:35.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.289+0000 7f94ecff9700 1 -- 172.21.15.146:0/3826362714 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e00052d0 con 0x7f94f009e870 2023-10-03T10:12:35.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.289+0000 7f94ecff9700 1 -- 172.21.15.146:0/3826362714 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e0005430 con 0x7f94f009e870 2023-10-03T10:12:35.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.289+0000 7f94f6998700 1 -- 172.21.15.146:0/3826362714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e8009a70 con 0x7f94f009e870 2023-10-03T10:12:35.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.289+0000 7f94ecff9700 1 -- 172.21.15.146:0/3826362714 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e00038c0 con 0x7f94f009e870 2023-10-03T10:12:35.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.290+0000 7f94f6998700 1 -- 172.21.15.146:0/3826362714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f01272e0 con 0x7f94f009e870 2023-10-03T10:12:35.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.290+0000 7f94ecff9700 1 -- 172.21.15.146:0/3826362714 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f94e0003a20 con 0x7f94f009e870 2023-10-03T10:12:35.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.291+0000 7f94f6998700 1 -- 172.21.15.146:0/3826362714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f004f2a0 con 0x7f94f009e870 2023-10-03T10:12:35.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.291+0000 7f94ef7fe700 1 -- 172.21.15.146:0/3826362714 >> v1:172.21.15.146:6816/126749 conn(0x7f94dc02f510 legacy=0x7f94dc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:35.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.291+0000 7f94ecff9700 1 -- 172.21.15.146:0/3826362714 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f94e003f040 con 0x7f94f009e870 2023-10-03T10:12:35.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.295+0000 7f94ecff9700 1 -- 172.21.15.146:0/3826362714 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f94e0019d00 con 0x7f94f009e870 2023-10-03T10:12:35.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.317+0000 7fc1f91b4700 1 Processor -- start 2023-10-03T10:12:35.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.318+0000 7fc1f91b4700 1 -- start start 2023-10-03T10:12:35.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.318+0000 7fc1f91b4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1f409a090 0x7fc1f409e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.318+0000 7fc1f91b4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc1f409f2a0 0x7fc1f413fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.318+0000 7fc1f91b4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f406bc80 con 0x7fc1f409ee90 2023-10-03T10:12:35.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.318+0000 7fc1f91b4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f409a460 con 0x7fc1f409a090 2023-10-03T10:12:35.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.318+0000 7fc1f91b4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f406c0f0 con 0x7fc1f409f2a0 2023-10-03T10:12:35.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.318+0000 7fc1f259c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc1f409ee90 0x7fc1f413c470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53860/0 (socket says 172.21.15.146:53860) 2023-10-03T10:12:35.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.318+0000 7fc1f259c700 1 -- 172.21.15.146:0/2534311191 learned_addr learned my addr 172.21.15.146:0/2534311191 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:35.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.318+0000 7fc1f359e700 1 --2- 172.21.15.146:0/2534311191 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc1f409f2a0 0x7fc1f413fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.318+0000 7fc1f2d9d700 1 --2- 172.21.15.146:0/2534311191 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1f409a090 0x7fc1f409e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.319+0000 7fc1f359e700 1 -- 172.21.15.146:0/2534311191 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1f409a090 msgr2=0x7fc1f409e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:35.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.319+0000 7fc1f359e700 1 --2- 172.21.15.146:0/2534311191 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1f409a090 0x7fc1f409e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.319+0000 7fc1f359e700 1 -- 172.21.15.146:0/2534311191 >> v1:172.21.15.146:6789/0 conn(0x7fc1f409ee90 legacy=0x7fc1f413c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.319+0000 7fc1f1d9b700 1 -- 172.21.15.146:0/2534311191 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139512504 0 0) 0x7fc1f406bc80 con 0x7fc1f409ee90 2023-10-03T10:12:35.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.319+0000 7fc1f359e700 1 -- 172.21.15.146:0/2534311191 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f406d8f0 con 0x7fc1f409f2a0 2023-10-03T10:12:35.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.319+0000 7fc1f2d9d700 1 --2- 172.21.15.146:0/2534311191 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1f409a090 0x7fc1f409e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:35.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.319+0000 7fc1f359e700 1 --2- 172.21.15.146:0/2534311191 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc1f409f2a0 0x7fc1f413fba0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec009dc0 tx=0x7fc1ec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cebe7d943d566d56 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:35.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.319+0000 7fc1f1d9b700 1 -- 172.21.15.146:0/2534311191 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec00e070 con 0x7fc1f409f2a0 2023-10-03T10:12:35.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.319+0000 7fc1f1d9b700 1 -- 172.21.15.146:0/2534311191 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec00bbd0 con 0x7fc1f409f2a0 2023-10-03T10:12:35.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.319+0000 7fc1f1d9b700 1 -- 172.21.15.146:0/2534311191 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec012430 con 0x7fc1f409f2a0 2023-10-03T10:12:35.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.320+0000 7fc1f91b4700 1 -- 172.21.15.146:0/2534311191 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc1f409f2a0 msgr2=0x7fc1f413fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.320+0000 7fc1f91b4700 1 --2- 172.21.15.146:0/2534311191 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc1f409f2a0 0x7fc1f413fba0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec009dc0 tx=0x7fc1ec00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:35.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.320+0000 7fc1f91b4700 1 -- 172.21.15.146:0/2534311191 shutdown_connections 2023-10-03T10:12:35.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.320+0000 7fc1f91b4700 1 --2- 172.21.15.146:0/2534311191 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc1f409f2a0 0x7fc1f413fba0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.320+0000 7fc1f91b4700 1 --2- 172.21.15.146:0/2534311191 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1f409a090 0x7fc1f409e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.320+0000 7fc1f91b4700 1 -- 172.21.15.146:0/2534311191 >> 172.21.15.146:0/2534311191 conn(0x7fc1f40a0f70 msgr2=0x7fc1f40a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:35.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.320+0000 7fc1f91b4700 1 -- 172.21.15.146:0/2534311191 shutdown_connections 2023-10-03T10:12:35.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.320+0000 7fc1f91b4700 1 -- 172.21.15.146:0/2534311191 wait complete. 2023-10-03T10:12:35.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.321+0000 7fc1f91b4700 1 Processor -- start 2023-10-03T10:12:35.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.322+0000 7fc1f91b4700 1 -- start start 2023-10-03T10:12:35.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.322+0000 7fc1f91b4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc1f409a090 0x7fc1f412fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.322+0000 7fc1f91b4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1f409ee90 0x7fc1f4130530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.322+0000 7fc1f91b4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1f409f2a0 0x7fc1f411b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.322+0000 7fc1f91b4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f411dcb0 con 0x7fc1f409f2a0 2023-10-03T10:12:35.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.322+0000 7fc1f91b4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f4134dc0 con 0x7fc1f409ee90 2023-10-03T10:12:35.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.322+0000 7fc1f91b4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f41348e0 con 0x7fc1f409a090 2023-10-03T10:12:35.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.322+0000 7fc1f259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1f409ee90 0x7fc1f4130530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.322+0000 7fc1f259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1f409ee90 0x7fc1f4130530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42662/0 (socket says 172.21.15.146:42662) 2023-10-03T10:12:35.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.322+0000 7fc1f359e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1f409f2a0 0x7fc1f411b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.322+0000 7fc1f259c700 1 -- 172.21.15.146:0/943945513 learned_addr learned my addr 172.21.15.146:0/943945513 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:35.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.323+0000 7fc1f2d9d700 1 --2- 172.21.15.146:0/943945513 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc1f409a090 0x7fc1f412fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.323+0000 7fc1f359e700 1 -- 172.21.15.146:0/943945513 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc1f409a090 msgr2=0x7fc1f412fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.323+0000 7fc1f359e700 1 --2- 172.21.15.146:0/943945513 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc1f409a090 0x7fc1f412fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.323+0000 7fc1f359e700 1 -- 172.21.15.146:0/943945513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1f409ee90 msgr2=0x7fc1f4130530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.323+0000 7fc1f359e700 1 --2- 172.21.15.146:0/943945513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1f409ee90 0x7fc1f4130530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.323+0000 7fc1f359e700 1 -- 172.21.15.146:0/943945513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec009a70 con 0x7fc1f409f2a0 2023-10-03T10:12:35.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.323+0000 7fc1f259c700 1 --2- 172.21.15.146:0/943945513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1f409ee90 0x7fc1f4130530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:35.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.323+0000 7fc1f359e700 1 --2- 172.21.15.146:0/943945513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1f409f2a0 0x7fc1f411b940 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec009dc0 tx=0x7fc1ec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:35.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.323+0000 7fc1db7fe700 1 -- 172.21.15.146:0/943945513 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec01b810 con 0x7fc1f409f2a0 2023-10-03T10:12:35.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.323+0000 7fc1db7fe700 1 -- 172.21.15.146:0/943945513 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec020070 con 0x7fc1f409f2a0 2023-10-03T10:12:35.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.323+0000 7fc1f91b4700 1 -- 172.21.15.146:0/943945513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f411d630 con 0x7fc1f409f2a0 2023-10-03T10:12:35.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.323+0000 7fc1db7fe700 1 -- 172.21.15.146:0/943945513 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec01bbd0 con 0x7fc1f409f2a0 2023-10-03T10:12:35.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.323+0000 7fc1f91b4700 1 -- 172.21.15.146:0/943945513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f4134140 con 0x7fc1f409f2a0 2023-10-03T10:12:35.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.324+0000 7fc1db7fe700 1 -- 172.21.15.146:0/943945513 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc1ec01bd30 con 0x7fc1f409f2a0 2023-10-03T10:12:35.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.324+0000 7fc1f91b4700 1 -- 172.21.15.146:0/943945513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f404f2a0 con 0x7fc1f409f2a0 2023-10-03T10:12:35.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.325+0000 7fc1db7fe700 1 -- 172.21.15.146:0/943945513 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fc1ec022070 con 0x7fc1f409f2a0 2023-10-03T10:12:35.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.325+0000 7fc1f2d9d700 1 -- 172.21.15.146:0/943945513 >> v1:172.21.15.146:6816/126749 conn(0x7fc1e002f510 legacy=0x7fc1e00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:35.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.325+0000 7f821f4ee700 1 Processor -- start 2023-10-03T10:12:35.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.326+0000 7f821f4ee700 1 -- start start 2023-10-03T10:12:35.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.326+0000 7f821f4ee700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8218138040 0x7f8218138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.326+0000 7f821f4ee700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82180a08e0 0x7f82180a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.326+0000 7f821f4ee700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f82180a1230 0x7f821813ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.326+0000 7f821f4ee700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82180a2100 con 0x7f82180a1230 2023-10-03T10:12:35.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.326+0000 7f821f4ee700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8218138950 con 0x7f82180a08e0 2023-10-03T10:12:35.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.326+0000 7f821f4ee700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82181379e0 con 0x7f8218138040 2023-10-03T10:12:35.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.326+0000 7f821d28a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8218138040 0x7f8218138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.326+0000 7f821d28a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8218138040 0x7f8218138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:42910/0 (socket says 172.21.15.146:42910) 2023-10-03T10:12:35.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.326+0000 7f821d28a700 1 -- 172.21.15.146:0/1538832692 learned_addr learned my addr 172.21.15.146:0/1538832692 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:35.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.327+0000 7f821da8b700 1 --2- 172.21.15.146:0/1538832692 >> v2:172.21.15.146:3300/0 conn(0x7f82180a1230 0x7f821813ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.327+0000 7f821ca89700 1 --2- 172.21.15.146:0/1538832692 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82180a08e0 0x7f82180a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.327+0000 7f821d28a700 1 -- 172.21.15.146:0/1538832692 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82180a08e0 msgr2=0x7f82180a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:35.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.327+0000 7f821d28a700 1 --2- 172.21.15.146:0/1538832692 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82180a08e0 0x7f82180a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.327+0000 7f821d28a700 1 -- 172.21.15.146:0/1538832692 >> v2:172.21.15.146:3300/0 conn(0x7f82180a1230 msgr2=0x7f821813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:35.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.327+0000 7f821d28a700 1 --2- 172.21.15.146:0/1538832692 >> v2:172.21.15.146:3300/0 conn(0x7f82180a1230 0x7f821813ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.327+0000 7f821d28a700 1 -- 172.21.15.146:0/1538832692 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821809b9b0 con 0x7f8218138040 2023-10-03T10:12:35.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.327+0000 7f821da8b700 1 --2- 172.21.15.146:0/1538832692 >> v2:172.21.15.146:3300/0 conn(0x7f82180a1230 0x7f821813ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:35.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.327+0000 7f821d28a700 1 --2- 172.21.15.146:0/1538832692 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8218138040 0x7f8218138410 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8208009920 tx=0x7f8208009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e28d7955e219b5e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:35.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.327+0000 7f820ffff700 1 -- 172.21.15.146:0/1538832692 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208005e30 con 0x7f8218138040 2023-10-03T10:12:35.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.327+0000 7f820ffff700 1 -- 172.21.15.146:0/1538832692 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8208004030 con 0x7f8218138040 2023-10-03T10:12:35.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.327+0000 7f820ffff700 1 -- 172.21.15.146:0/1538832692 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82080043e0 con 0x7f8218138040 2023-10-03T10:12:35.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.328+0000 7f821f4ee700 1 -- 172.21.15.146:0/1538832692 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8218138040 msgr2=0x7f8218138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.328+0000 7f821f4ee700 1 --2- 172.21.15.146:0/1538832692 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8218138040 0x7f8218138410 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8208009920 tx=0x7f8208009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:35.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.328+0000 7f821f4ee700 1 -- 172.21.15.146:0/1538832692 shutdown_connections 2023-10-03T10:12:35.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.328+0000 7f821f4ee700 1 --2- 172.21.15.146:0/1538832692 >> v2:172.21.15.146:3300/0 conn(0x7f82180a1230 0x7f821813ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.328+0000 7f821f4ee700 1 --2- 172.21.15.146:0/1538832692 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8218138040 0x7f8218138410 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.328+0000 7f821f4ee700 1 --2- 172.21.15.146:0/1538832692 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82180a08e0 0x7f82180a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.328+0000 7f821f4ee700 1 -- 172.21.15.146:0/1538832692 >> 172.21.15.146:0/1538832692 conn(0x7f82180a2980 msgr2=0x7f82180a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:35.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.328+0000 7f821f4ee700 1 -- 172.21.15.146:0/1538832692 shutdown_connections 2023-10-03T10:12:35.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.328+0000 7f821f4ee700 1 -- 172.21.15.146:0/1538832692 wait complete. 2023-10-03T10:12:35.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.329+0000 7f821f4ee700 1 Processor -- start 2023-10-03T10:12:35.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.329+0000 7f821f4ee700 1 -- start start 2023-10-03T10:12:35.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.329+0000 7f821f4ee700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82180a08e0 0x7f8218126310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.330+0000 7f821f4ee700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82180a1230 0x7f8218126850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.330+0000 7f821f4ee700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8218138040 0x7f8218126d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.330+0000 7f821f4ee700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8218129e30 con 0x7f82180a08e0 2023-10-03T10:12:35.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.330+0000 7f821f4ee700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821809a240 con 0x7f8218138040 2023-10-03T10:12:35.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.330+0000 7f821f4ee700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8218127fc0 con 0x7f82180a1230 2023-10-03T10:12:35.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.330+0000 7f821d28a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82180a08e0 0x7f8218126310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.330+0000 7f821d28a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82180a08e0 0x7f8218126310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44376/0 (socket says 172.21.15.146:44376) 2023-10-03T10:12:35.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.330+0000 7f821d28a700 1 -- 172.21.15.146:0/354040421 learned_addr learned my addr 172.21.15.146:0/354040421 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:35.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.330+0000 7f821da8b700 1 --2- 172.21.15.146:0/354040421 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8218138040 0x7f8218126d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.330+0000 7f821d28a700 1 -- 172.21.15.146:0/354040421 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82180a1230 msgr2=0x7f8218126850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:35.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.330+0000 7f821d28a700 1 --2- 172.21.15.146:0/354040421 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82180a1230 0x7f8218126850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.330+0000 7f821d28a700 1 -- 172.21.15.146:0/354040421 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8218138040 msgr2=0x7f8218126d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.330+0000 7f821d28a700 1 --2- 172.21.15.146:0/354040421 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8218138040 0x7f8218126d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.330+0000 7f821d28a700 1 -- 172.21.15.146:0/354040421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8210009a70 con 0x7f82180a08e0 2023-10-03T10:12:35.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.330+0000 7f821da8b700 1 --2- 172.21.15.146:0/354040421 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8218138040 0x7f8218126d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:35.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.330+0000 7fc1db7fe700 1 -- 172.21.15.146:0/943945513 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc1ec025bb0 con 0x7fc1f409f2a0 2023-10-03T10:12:35.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.330+0000 7f821d28a700 1 --2- 172.21.15.146:0/354040421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82180a08e0 0x7f8218126310 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8208000c00 tx=0x7f8208004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:35.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.331+0000 7f820dffb700 1 -- 172.21.15.146:0/354040421 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208003ab0 con 0x7f82180a08e0 2023-10-03T10:12:35.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.331+0000 7f820dffb700 1 -- 172.21.15.146:0/354040421 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8208003c10 con 0x7f82180a08e0 2023-10-03T10:12:35.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.331+0000 7f820dffb700 1 -- 172.21.15.146:0/354040421 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208006030 con 0x7f82180a08e0 2023-10-03T10:12:35.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.331+0000 7f65ae55f700 1 Processor -- start 2023-10-03T10:12:35.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.331+0000 7f65ae55f700 1 -- start start 2023-10-03T10:12:35.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.331+0000 7f65ae55f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f65a809e870 0x7f65a809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.331+0000 7f65ae55f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65a8131f40 0x7f65a8139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.331+0000 7f65ae55f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a809c970 con 0x7f65a809f180 2023-10-03T10:12:35.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.331+0000 7f65ae55f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a80a0920 con 0x7f65a809e870 2023-10-03T10:12:35.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.331+0000 7f65ae55f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a809f9c0 con 0x7f65a8131f40 2023-10-03T10:12:35.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.331+0000 7f821f4ee700 1 -- 172.21.15.146:0/354040421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8208009500 con 0x7f82180a08e0 2023-10-03T10:12:35.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.331+0000 7f65a77fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f65a809f180 0x7f65a8131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53866/0 (socket says 172.21.15.146:53866) 2023-10-03T10:12:35.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.331+0000 7f65a77fe700 1 -- 172.21.15.146:0/3134780965 learned_addr learned my addr 172.21.15.146:0/3134780965 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:35.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.332+0000 7f65acafc700 1 --2- 172.21.15.146:0/3134780965 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65a8131f40 0x7f65a8139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.332+0000 7f821f4ee700 1 -- 172.21.15.146:0/354040421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82181376b0 con 0x7f82180a08e0 2023-10-03T10:12:35.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.332+0000 7f65acafc700 1 -- 172.21.15.146:0/3134780965 >> v2:172.21.15.146:3300/0 conn(0x7f65a809e870 msgr2=0x7f65a809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:35.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.332+0000 7f65acafc700 1 --2- 172.21.15.146:0/3134780965 >> v2:172.21.15.146:3300/0 conn(0x7f65a809e870 0x7f65a809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.332+0000 7f65acafc700 1 -- 172.21.15.146:0/3134780965 >> v1:172.21.15.146:6789/0 conn(0x7f65a809f180 legacy=0x7f65a8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.332+0000 7f65acafc700 1 -- 172.21.15.146:0/3134780965 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a809bab0 con 0x7f65a8131f40 2023-10-03T10:12:35.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.332+0000 7f65acafc700 1 --2- 172.21.15.146:0/3134780965 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65a8131f40 0x7f65a8139ca0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f65a0009d90 tx=0x7f65a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4952422249a1e2e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:35.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.332+0000 7f65a6ffd700 1 -- 172.21.15.146:0/3134780965 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a000e070 con 0x7f65a8131f40 2023-10-03T10:12:35.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.332+0000 7f65a6ffd700 1 -- 172.21.15.146:0/3134780965 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a000bbd0 con 0x7f65a8131f40 2023-10-03T10:12:35.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.332+0000 7f65a6ffd700 1 -- 172.21.15.146:0/3134780965 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a0012430 con 0x7f65a8131f40 2023-10-03T10:12:35.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.333+0000 7f821f4ee700 1 -- 172.21.15.146:0/354040421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8218129a70 con 0x7f82180a08e0 2023-10-03T10:12:35.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.333+0000 7f65ae55f700 1 -- 172.21.15.146:0/3134780965 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65a8131f40 msgr2=0x7f65a8139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.333+0000 7f65ae55f700 1 --2- 172.21.15.146:0/3134780965 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65a8131f40 0x7f65a8139ca0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f65a0009d90 tx=0x7f65a000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:35.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.333+0000 7f820dffb700 1 -- 172.21.15.146:0/354040421 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8208006190 con 0x7f82180a08e0 2023-10-03T10:12:35.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.333+0000 7f65ae55f700 1 -- 172.21.15.146:0/3134780965 shutdown_connections 2023-10-03T10:12:35.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.333+0000 7f65ae55f700 1 --2- 172.21.15.146:0/3134780965 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65a8131f40 0x7f65a8139ca0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.333+0000 7f65ae55f700 1 --2- 172.21.15.146:0/3134780965 >> v2:172.21.15.146:3300/0 conn(0x7f65a809e870 0x7f65a809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.333+0000 7f65ae55f700 1 -- 172.21.15.146:0/3134780965 >> 172.21.15.146:0/3134780965 conn(0x7f65a80a4430 msgr2=0x7f65a80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:35.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.333+0000 7f65ae55f700 1 -- 172.21.15.146:0/3134780965 shutdown_connections 2023-10-03T10:12:35.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.333+0000 7f820dffb700 1 -- 172.21.15.146:0/354040421 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f8208040ab0 con 0x7f82180a08e0 2023-10-03T10:12:35.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.333+0000 7f821ca89700 1 -- 172.21.15.146:0/354040421 >> v1:172.21.15.146:6816/126749 conn(0x7f81fc02f510 legacy=0x7f81fc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:35.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.333+0000 7f65ae55f700 1 -- 172.21.15.146:0/3134780965 wait complete. 2023-10-03T10:12:35.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.334+0000 7f65ae55f700 1 Processor -- start 2023-10-03T10:12:35.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.334+0000 7f65ae55f700 1 -- start start 2023-10-03T10:12:35.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.335+0000 7f65ae55f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65a809e870 0x7f65a8126870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.335+0000 7f65ae55f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65a809f180 0x7f65a8126db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.335+0000 7f65ae55f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f65a8131f40 0x7f65a81272f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.335+0000 7f65ae55f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a8128620 con 0x7f65a809e870 2023-10-03T10:12:35.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.335+0000 7f65ae55f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a8128430 con 0x7f65a809f180 2023-10-03T10:12:35.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.335+0000 7f65ae55f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65a812a340 con 0x7f65a8131f40 2023-10-03T10:12:35.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.335+0000 7f65a77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65a809f180 0x7f65a8126db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.335+0000 7f65a77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65a809f180 0x7f65a8126db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42694/0 (socket says 172.21.15.146:42694) 2023-10-03T10:12:35.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.335+0000 7f65a77fe700 1 -- 172.21.15.146:0/2152676935 learned_addr learned my addr 172.21.15.146:0/2152676935 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:35.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.335+0000 7f65acafc700 1 --2- 172.21.15.146:0/2152676935 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f65a8131f40 0x7f65a81272f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.335+0000 7f65acafc700 1 -- 172.21.15.146:0/2152676935 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65a809f180 msgr2=0x7f65a8126db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.335+0000 7f65acafc700 1 --2- 172.21.15.146:0/2152676935 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65a809f180 0x7f65a8126db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.335+0000 7f65acafc700 1 -- 172.21.15.146:0/2152676935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65a809e870 msgr2=0x7f65a8126870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.335+0000 7f65acafc700 1 --2- 172.21.15.146:0/2152676935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65a809e870 0x7f65a8126870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.335+0000 7f65acafc700 1 -- 172.21.15.146:0/2152676935 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a0009a70 con 0x7f65a8131f40 2023-10-03T10:12:35.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.336+0000 7f65acafc700 1 --2- 172.21.15.146:0/2152676935 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f65a8131f40 0x7f65a81272f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f65a0016000 tx=0x7f65a0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:35.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.336+0000 7f65a4ff9700 1 -- 172.21.15.146:0/2152676935 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a0007000 con 0x7f65a8131f40 2023-10-03T10:12:35.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.336+0000 7f65a4ff9700 1 -- 172.21.15.146:0/2152676935 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a0020070 con 0x7f65a8131f40 2023-10-03T10:12:35.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.336+0000 7f65ae55f700 1 -- 172.21.15.146:0/2152676935 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a809dba0 con 0x7f65a8131f40 2023-10-03T10:12:35.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.336+0000 7f65a4ff9700 1 -- 172.21.15.146:0/2152676935 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a0004280 con 0x7f65a8131f40 2023-10-03T10:12:35.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.336+0000 7f65ae55f700 1 -- 172.21.15.146:0/2152676935 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a8128c20 con 0x7f65a8131f40 2023-10-03T10:12:35.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.337+0000 7f65a4ff9700 1 -- 172.21.15.146:0/2152676935 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f65a00043e0 con 0x7f65a8131f40 2023-10-03T10:12:35.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.337+0000 7f65a4ff9700 1 -- 172.21.15.146:0/2152676935 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f65a0022070 con 0x7f65a8131f40 2023-10-03T10:12:35.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.337+0000 7f65a7fff700 1 -- 172.21.15.146:0/2152676935 >> v1:172.21.15.146:6816/126749 conn(0x7f659402f510 legacy=0x7f65940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:35.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.337+0000 7f65ae55f700 1 -- 172.21.15.146:0/2152676935 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a812ab90 con 0x7f65a8131f40 2023-10-03T10:12:35.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.342+0000 7f820dffb700 1 -- 172.21.15.146:0/354040421 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f820801b790 con 0x7f82180a08e0 2023-10-03T10:12:35.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.346+0000 7f65a4ff9700 1 -- 172.21.15.146:0/2152676935 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f65a0011980 con 0x7f65a8131f40 2023-10-03T10:12:35.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.492+0000 7f94ef7fe700 1 -- 172.21.15.146:0/3826362714 >> v1:172.21.15.146:6816/126749 conn(0x7f94dc02f510 legacy=0x7f94dc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:35.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.503+0000 7f94f6998700 1 -- 172.21.15.146:0/3826362714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f94f0129550 con 0x7f94f009e870 2023-10-03T10:12:35.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.503+0000 7f94ecff9700 1 -- 172.21.15.146:0/3826362714 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f94e0017020 con 0x7f94f009e870 2023-10-03T10:12:35.504 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:35.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.505+0000 7f94f6998700 1 -- 172.21.15.146:0/3826362714 >> v1:172.21.15.146:6816/126749 conn(0x7f94dc02f510 legacy=0x7f94dc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:35.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.505+0000 7f94f6998700 1 -- 172.21.15.146:0/3826362714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94f009e870 msgr2=0x7f94f0127a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.505+0000 7f94f6998700 1 --2- 172.21.15.146:0/3826362714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94f009e870 0x7f94f0127a40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f94e0000f60 tx=0x7f94e000c730 comp rx=0 tx=0).stop 2023-10-03T10:12:35.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.505+0000 7f94f6998700 1 -- 172.21.15.146:0/3826362714 shutdown_connections 2023-10-03T10:12:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.505+0000 7f94f6998700 1 --2- 172.21.15.146:0/3826362714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94f01371c0 0x7f94f01cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.505+0000 7f94f6998700 1 --2- 172.21.15.146:0/3826362714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94f009e870 0x7f94f0127a40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.505+0000 7f94f6998700 1 --2- 172.21.15.146:0/3826362714 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f94f009f350 0x7f94f0127f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.505+0000 7f94f6998700 1 -- 172.21.15.146:0/3826362714 >> 172.21.15.146:0/3826362714 conn(0x7f94f00a4430 msgr2=0x7f94f00a0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.506+0000 7f94f6998700 1 -- 172.21.15.146:0/3826362714 shutdown_connections 2023-10-03T10:12:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.506+0000 7f94f6998700 1 -- 172.21.15.146:0/3826362714 wait complete. 2023-10-03T10:12:35.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:35.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.526+0000 7fc1f2d9d700 1 -- 172.21.15.146:0/943945513 >> v1:172.21.15.146:6816/126749 conn(0x7fc1e002f510 legacy=0x7fc1e00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:35.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.534+0000 7f821ca89700 1 -- 172.21.15.146:0/354040421 >> v1:172.21.15.146:6816/126749 conn(0x7f81fc02f510 legacy=0x7f81fc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:35.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.536+0000 7f821f4ee700 1 -- 172.21.15.146:0/354040421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f821804f2a0 con 0x7f82180a08e0 2023-10-03T10:12:35.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.537+0000 7f820dffb700 1 -- 172.21.15.146:0/354040421 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8208020020 con 0x7f82180a08e0 2023-10-03T10:12:35.537 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:35.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.538+0000 7f65a7fff700 1 -- 172.21.15.146:0/2152676935 >> v1:172.21.15.146:6816/126749 conn(0x7f659402f510 legacy=0x7f65940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:35.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.539+0000 7f821f4ee700 1 -- 172.21.15.146:0/354040421 >> v1:172.21.15.146:6816/126749 conn(0x7f81fc02f510 legacy=0x7f81fc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:35.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.539+0000 7f821f4ee700 1 -- 172.21.15.146:0/354040421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82180a08e0 msgr2=0x7f8218126310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.539+0000 7f821f4ee700 1 --2- 172.21.15.146:0/354040421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82180a08e0 0x7f8218126310 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8208000c00 tx=0x7f8208004750 comp rx=0 tx=0).stop 2023-10-03T10:12:35.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.539+0000 7f821f4ee700 1 -- 172.21.15.146:0/354040421 shutdown_connections 2023-10-03T10:12:35.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.539+0000 7f821f4ee700 1 --2- 172.21.15.146:0/354040421 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8218138040 0x7f8218126d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.539+0000 7f821f4ee700 1 --2- 172.21.15.146:0/354040421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82180a08e0 0x7f8218126310 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.539+0000 7f821f4ee700 1 --2- 172.21.15.146:0/354040421 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82180a1230 0x7f8218126850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.539+0000 7f821f4ee700 1 -- 172.21.15.146:0/354040421 >> 172.21.15.146:0/354040421 conn(0x7f82180a2980 msgr2=0x7f821809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:35.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.539+0000 7f821f4ee700 1 -- 172.21.15.146:0/354040421 shutdown_connections 2023-10-03T10:12:35.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.539+0000 7f821f4ee700 1 -- 172.21.15.146:0/354040421 wait complete. 2023-10-03T10:12:35.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:35.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.558+0000 7fc1f91b4700 1 -- 172.21.15.146:0/943945513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc1f406d8f0 con 0x7fc1f409f2a0 2023-10-03T10:12:35.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.559+0000 7fc1db7fe700 1 -- 172.21.15.146:0/943945513 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc1f406d8f0 con 0x7fc1f409f2a0 2023-10-03T10:12:35.559 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:35.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.561+0000 7fc1f91b4700 1 -- 172.21.15.146:0/943945513 >> v1:172.21.15.146:6816/126749 conn(0x7fc1e002f510 legacy=0x7fc1e00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:35.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.561+0000 7fc1f91b4700 1 -- 172.21.15.146:0/943945513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1f409f2a0 msgr2=0x7fc1f411b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.561+0000 7fc1f91b4700 1 --2- 172.21.15.146:0/943945513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1f409f2a0 0x7fc1f411b940 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec009dc0 tx=0x7fc1ec004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.561+0000 7fc1f91b4700 1 -- 172.21.15.146:0/943945513 shutdown_connections 2023-10-03T10:12:35.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.561+0000 7fc1f91b4700 1 --2- 172.21.15.146:0/943945513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1f409f2a0 0x7fc1f411b940 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.561+0000 7fc1f91b4700 1 --2- 172.21.15.146:0/943945513 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc1f409a090 0x7fc1f412fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.561+0000 7fc1f91b4700 1 --2- 172.21.15.146:0/943945513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1f409ee90 0x7fc1f4130530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.561+0000 7fc1f91b4700 1 -- 172.21.15.146:0/943945513 >> 172.21.15.146:0/943945513 conn(0x7fc1f40a0f70 msgr2=0x7fc1f40a3910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:35.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.561+0000 7fc1f91b4700 1 -- 172.21.15.146:0/943945513 shutdown_connections 2023-10-03T10:12:35.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.561+0000 7fc1f91b4700 1 -- 172.21.15.146:0/943945513 wait complete. 2023-10-03T10:12:35.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.566+0000 7f65ae55f700 1 -- 172.21.15.146:0/2152676935 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f65a804f2a0 con 0x7f65a8131f40 2023-10-03T10:12:35.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.567+0000 7f65a4ff9700 1 -- 172.21.15.146:0/2152676935 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f65a0011390 con 0x7f65a8131f40 2023-10-03T10:12:35.567 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:35.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.570+0000 7f65ae55f700 1 -- 172.21.15.146:0/2152676935 >> v1:172.21.15.146:6816/126749 conn(0x7f659402f510 legacy=0x7f65940319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:35.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.570+0000 7f65ae55f700 1 -- 172.21.15.146:0/2152676935 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f65a8131f40 msgr2=0x7f65a81272f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.570+0000 7f65ae55f700 1 --2- 172.21.15.146:0/2152676935 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f65a8131f40 0x7f65a81272f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f65a0016000 tx=0x7f65a0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.570+0000 7f65ae55f700 1 -- 172.21.15.146:0/2152676935 shutdown_connections 2023-10-03T10:12:35.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.570+0000 7f65ae55f700 1 --2- 172.21.15.146:0/2152676935 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f65a8131f40 0x7f65a81272f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.570+0000 7f65ae55f700 1 --2- 172.21.15.146:0/2152676935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65a809e870 0x7f65a8126870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.570+0000 7f65ae55f700 1 --2- 172.21.15.146:0/2152676935 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65a809f180 0x7f65a8126db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.570+0000 7f65ae55f700 1 -- 172.21.15.146:0/2152676935 >> 172.21.15.146:0/2152676935 conn(0x7f65a80a4430 msgr2=0x7f65a80a0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:35.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.570+0000 7f65ae55f700 1 -- 172.21.15.146:0/2152676935 shutdown_connections 2023-10-03T10:12:35.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:35.570+0000 7f65ae55f700 1 -- 172.21.15.146:0/2152676935 wait complete. 2023-10-03T10:12:35.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:35.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:36.519 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:36.552 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:36.576 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:36.584 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:36.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.666+0000 7f884cd31700 1 Processor -- start 2023-10-03T10:12:36.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.666+0000 7f884cd31700 1 -- start start 2023-10-03T10:12:36.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.667+0000 7f884cd31700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8848133ad0 0x7f8848133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.667+0000 7f884cd31700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88481300a0 0x7f88481304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.667+0000 7f884cd31700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f88481309f0 0x7f884813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.667+0000 7f884cd31700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884806b2d0 con 0x7f88481309f0 2023-10-03T10:12:36.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.667+0000 7f884cd31700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8848133610 con 0x7f88481300a0 2023-10-03T10:12:36.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.667+0000 7f884cd31700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f884809a500 con 0x7f8848133ad0 2023-10-03T10:12:36.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.668+0000 7f8846d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f88481309f0 0x7f884813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.668+0000 7f884659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8848133ad0 0x7f8848133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.668+0000 7f8846d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f88481309f0 0x7f884813a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44402/0 (socket says 172.21.15.146:44402) 2023-10-03T10:12:36.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.668+0000 7f8846d9d700 1 -- 172.21.15.146:0/4211974348 learned_addr learned my addr 172.21.15.146:0/4211974348 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:36.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.668+0000 7f8845d9b700 1 --2- 172.21.15.146:0/4211974348 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88481300a0 0x7f88481304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.668+0000 7f884659c700 1 -- 172.21.15.146:0/4211974348 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88481300a0 msgr2=0x7f88481304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:36.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.668+0000 7f884659c700 1 --2- 172.21.15.146:0/4211974348 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88481300a0 0x7f88481304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.668+0000 7f884659c700 1 -- 172.21.15.146:0/4211974348 >> v2:172.21.15.146:3300/0 conn(0x7f88481309f0 msgr2=0x7f884813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:36.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.668+0000 7f884659c700 1 --2- 172.21.15.146:0/4211974348 >> v2:172.21.15.146:3300/0 conn(0x7f88481309f0 0x7f884813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.668+0000 7f884659c700 1 -- 172.21.15.146:0/4211974348 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88481338b0 con 0x7f8848133ad0 2023-10-03T10:12:36.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.668+0000 7f8846d9d700 1 --2- 172.21.15.146:0/4211974348 >> v2:172.21.15.146:3300/0 conn(0x7f88481309f0 0x7f884813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:36.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.668+0000 7f884659c700 1 --2- 172.21.15.146:0/4211974348 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8848133ad0 0x7f8848133ea0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8838009840 tx=0x7f8838009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6651a4eadaff5c7b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.668+0000 7f884559a700 1 -- 172.21.15.146:0/4211974348 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838011830 con 0x7f8848133ad0 2023-10-03T10:12:36.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.668+0000 7f884559a700 1 -- 172.21.15.146:0/4211974348 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8838011990 con 0x7f8848133ad0 2023-10-03T10:12:36.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.668+0000 7f884559a700 1 -- 172.21.15.146:0/4211974348 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838011d20 con 0x7f8848133ad0 2023-10-03T10:12:36.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.669+0000 7f884cd31700 1 -- 172.21.15.146:0/4211974348 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8848133ad0 msgr2=0x7f8848133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.669+0000 7f884cd31700 1 --2- 172.21.15.146:0/4211974348 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8848133ad0 0x7f8848133ea0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8838009840 tx=0x7f8838009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:36.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.669+0000 7f884cd31700 1 -- 172.21.15.146:0/4211974348 shutdown_connections 2023-10-03T10:12:36.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.669+0000 7f884cd31700 1 --2- 172.21.15.146:0/4211974348 >> v2:172.21.15.146:3300/0 conn(0x7f88481309f0 0x7f884813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.669+0000 7f884cd31700 1 --2- 172.21.15.146:0/4211974348 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8848133ad0 0x7f8848133ea0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.669+0000 7f884cd31700 1 --2- 172.21.15.146:0/4211974348 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88481300a0 0x7f88481304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.669+0000 7f884cd31700 1 -- 172.21.15.146:0/4211974348 >> 172.21.15.146:0/4211974348 conn(0x7f8848099c40 msgr2=0x7f88480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.669+0000 7f884cd31700 1 -- 172.21.15.146:0/4211974348 shutdown_connections 2023-10-03T10:12:36.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.669+0000 7f884cd31700 1 -- 172.21.15.146:0/4211974348 wait complete. 2023-10-03T10:12:36.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.671+0000 7f884cd31700 1 Processor -- start 2023-10-03T10:12:36.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.671+0000 7f884cd31700 1 -- start start 2023-10-03T10:12:36.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.671+0000 7f884cd31700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f88481300a0 0x7f88481c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.671+0000 7f884cd31700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88481309f0 0x7f88481c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.671+0000 7f884cd31700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8848133ad0 0x7f88481c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.671+0000 7f884cd31700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884812da50 con 0x7f88481309f0 2023-10-03T10:12:36.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.671+0000 7f884cd31700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8848072230 con 0x7f8848133ad0 2023-10-03T10:12:36.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.671+0000 7f884cd31700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f884811fe50 con 0x7f88481300a0 2023-10-03T10:12:36.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.672+0000 7f8845d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88481309f0 0x7f88481c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.672+0000 7f8845d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88481309f0 0x7f88481c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44408/0 (socket says 172.21.15.146:44408) 2023-10-03T10:12:36.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.672+0000 7f8845d9b700 1 -- 172.21.15.146:0/3836574811 learned_addr learned my addr 172.21.15.146:0/3836574811 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:36.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.672+0000 7f8846d9d700 1 --2- 172.21.15.146:0/3836574811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8848133ad0 0x7f88481c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.672+0000 7f884659c700 1 --2- 172.21.15.146:0/3836574811 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f88481300a0 0x7f88481c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.672+0000 7f8846d9d700 1 -- 172.21.15.146:0/3836574811 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f88481300a0 msgr2=0x7f88481c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.672+0000 7f8846d9d700 1 --2- 172.21.15.146:0/3836574811 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f88481300a0 0x7f88481c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.672+0000 7f8846d9d700 1 -- 172.21.15.146:0/3836574811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88481309f0 msgr2=0x7f88481c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.672+0000 7f8846d9d700 1 --2- 172.21.15.146:0/3836574811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88481309f0 0x7f88481c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.672+0000 7f8846d9d700 1 -- 172.21.15.146:0/3836574811 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8840009b30 con 0x7f8848133ad0 2023-10-03T10:12:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.672+0000 7f8846d9d700 1 --2- 172.21.15.146:0/3836574811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8848133ad0 0x7f88481c91d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f884000efc0 tx=0x7f884000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.672+0000 7f8836ffd700 1 -- 172.21.15.146:0/3836574811 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840018070 con 0x7f8848133ad0 2023-10-03T10:12:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.673+0000 7f8836ffd700 1 -- 172.21.15.146:0/3836574811 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884000f040 con 0x7f8848133ad0 2023-10-03T10:12:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.673+0000 7f884cd31700 1 -- 172.21.15.146:0/3836574811 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88380094a0 con 0x7f8848133ad0 2023-10-03T10:12:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.673+0000 7f8836ffd700 1 -- 172.21.15.146:0/3836574811 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840003c60 con 0x7f8848133ad0 2023-10-03T10:12:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.673+0000 7f884cd31700 1 -- 172.21.15.146:0/3836574811 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884811fb90 con 0x7f8848133ad0 2023-10-03T10:12:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.673+0000 7f8836ffd700 1 -- 172.21.15.146:0/3836574811 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f884000c880 con 0x7f8848133ad0 2023-10-03T10:12:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.674+0000 7f884659c700 1 -- 172.21.15.146:0/3836574811 >> v1:172.21.15.146:6816/126749 conn(0x7f882802f560 legacy=0x7f8828031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.674+0000 7f8836ffd700 1 -- 172.21.15.146:0/3836574811 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f884003fb00 con 0x7f8848133ad0 2023-10-03T10:12:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.674+0000 7f884cd31700 1 -- 172.21.15.146:0/3836574811 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884804f2a0 con 0x7f8848133ad0 2023-10-03T10:12:36.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.679+0000 7f8836ffd700 1 -- 172.21.15.146:0/3836574811 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8840003dc0 con 0x7f8848133ad0 2023-10-03T10:12:36.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.700+0000 7f356b021700 1 Processor -- start 2023-10-03T10:12:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.700+0000 7f356b021700 1 -- start start 2023-10-03T10:12:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.700+0000 7f356b021700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f356412d380 0x7f356412d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.700+0000 7f356b021700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3564099a60 0x7f3564099e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.700+0000 7f356b021700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f356409a3d0 0x7f3564137610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.700+0000 7f356b021700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356409bb90 con 0x7f356409a3d0 2023-10-03T10:12:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.701+0000 7f356b021700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356409c210 con 0x7f356412d380 2023-10-03T10:12:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.701+0000 7f356b021700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f356409a870 con 0x7f3564099a60 2023-10-03T10:12:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.701+0000 7f3563fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3564099a60 0x7f3564099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.701+0000 7f3563fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3564099a60 0x7f3564099e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:42938/0 (socket says 172.21.15.146:42938) 2023-10-03T10:12:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.701+0000 7f3563fff700 1 -- 172.21.15.146:0/1477163361 learned_addr learned my addr 172.21.15.146:0/1477163361 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.701+0000 7f3568dbd700 1 --2- 172.21.15.146:0/1477163361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f356412d380 0x7f356412d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.701+0000 7f3563fff700 1 -- 172.21.15.146:0/1477163361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f356412d380 msgr2=0x7f356412d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:36.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.701+0000 7f3563fff700 1 --2- 172.21.15.146:0/1477163361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f356412d380 0x7f356412d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.701+0000 7f3563fff700 1 -- 172.21.15.146:0/1477163361 >> v2:172.21.15.146:3300/0 conn(0x7f356409a3d0 msgr2=0x7f3564137610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.701+0000 7f3563fff700 1 --2- 172.21.15.146:0/1477163361 >> v2:172.21.15.146:3300/0 conn(0x7f356409a3d0 0x7f3564137610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.701+0000 7f3563fff700 1 -- 172.21.15.146:0/1477163361 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356409ced0 con 0x7f3564099a60 2023-10-03T10:12:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.701+0000 7f3563fff700 1 --2- 172.21.15.146:0/1477163361 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3564099a60 0x7f3564099e90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f355000bb90 tx=0x7f355000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cf81b8875d086fa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.701+0000 7f35637fe700 1 -- 172.21.15.146:0/1477163361 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355000dc70 con 0x7f3564099a60 2023-10-03T10:12:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.701+0000 7f35637fe700 1 -- 172.21.15.146:0/1477163361 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355000ddd0 con 0x7f3564099a60 2023-10-03T10:12:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.701+0000 7f35637fe700 1 -- 172.21.15.146:0/1477163361 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3550012990 con 0x7f3564099a60 2023-10-03T10:12:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.702+0000 7f356b021700 1 -- 172.21.15.146:0/1477163361 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3564099a60 msgr2=0x7f3564099e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.702+0000 7f356b021700 1 --2- 172.21.15.146:0/1477163361 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3564099a60 0x7f3564099e90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f355000bb90 tx=0x7f355000bea0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.702+0000 7f356b021700 1 -- 172.21.15.146:0/1477163361 shutdown_connections 2023-10-03T10:12:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.702+0000 7f356b021700 1 --2- 172.21.15.146:0/1477163361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f356412d380 0x7f356412d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.702+0000 7f356b021700 1 --2- 172.21.15.146:0/1477163361 >> v2:172.21.15.146:3300/0 conn(0x7f356409a3d0 0x7f3564137610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.702+0000 7f356b021700 1 --2- 172.21.15.146:0/1477163361 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3564099a60 0x7f3564099e90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.702+0000 7f356b021700 1 -- 172.21.15.146:0/1477163361 >> 172.21.15.146:0/1477163361 conn(0x7f35640a2980 msgr2=0x7f35640a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.702+0000 7f356b021700 1 -- 172.21.15.146:0/1477163361 shutdown_connections 2023-10-03T10:12:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.702+0000 7f356b021700 1 -- 172.21.15.146:0/1477163361 wait complete. 2023-10-03T10:12:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.703+0000 7f356b021700 1 Processor -- start 2023-10-03T10:12:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.703+0000 7f356b021700 1 -- start start 2023-10-03T10:12:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.704+0000 7f356b021700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3564099a60 0x7f356411ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.704+0000 7f356b021700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f356409a3d0 0x7f356411b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.704+0000 7f356b021700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f356412d380 0x7f356411b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.704+0000 7f356b021700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356411d080 con 0x7f356409a3d0 2023-10-03T10:12:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.704+0000 7f356b021700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356409b3e0 con 0x7f356412d380 2023-10-03T10:12:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.704+0000 7f356b021700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f356409eea0 con 0x7f3564099a60 2023-10-03T10:12:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.704+0000 7f35695be700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f356412d380 0x7f356411b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.704+0000 7f35695be700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f356412d380 0x7f356411b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42734/0 (socket says 172.21.15.146:42734) 2023-10-03T10:12:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.704+0000 7f35695be700 1 -- 172.21.15.146:0/3794710894 learned_addr learned my addr 172.21.15.146:0/3794710894 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.704+0000 7f3563fff700 1 --2- 172.21.15.146:0/3794710894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f356409a3d0 0x7f356411b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.704+0000 7f3568dbd700 1 --2- 172.21.15.146:0/3794710894 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3564099a60 0x7f356411ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.704+0000 7f35695be700 1 -- 172.21.15.146:0/3794710894 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3564099a60 msgr2=0x7f356411ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.704+0000 7f35695be700 1 --2- 172.21.15.146:0/3794710894 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3564099a60 0x7f356411ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.704+0000 7f35695be700 1 -- 172.21.15.146:0/3794710894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f356409a3d0 msgr2=0x7f356411b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.704+0000 7f35695be700 1 --2- 172.21.15.146:0/3794710894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f356409a3d0 0x7f356411b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.704+0000 7f35695be700 1 -- 172.21.15.146:0/3794710894 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355000b7f0 con 0x7f356412d380 2023-10-03T10:12:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.706+0000 7f3568dbd700 1 --2- 172.21.15.146:0/3794710894 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3564099a60 0x7f356411ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.706+0000 7f35695be700 1 --2- 172.21.15.146:0/3794710894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f356412d380 0x7f356411b600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f355c00b970 tx=0x7f355c00bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.706+0000 7f35617fa700 1 -- 172.21.15.146:0/3794710894 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c00d860 con 0x7f356412d380 2023-10-03T10:12:36.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.706+0000 7f35617fa700 1 -- 172.21.15.146:0/3794710894 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c00d9e0 con 0x7f356412d380 2023-10-03T10:12:36.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.706+0000 7f356b021700 1 -- 172.21.15.146:0/3794710894 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356411de30 con 0x7f356412d380 2023-10-03T10:12:36.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.706+0000 7f356b021700 1 -- 172.21.15.146:0/3794710894 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356411cd00 con 0x7f356412d380 2023-10-03T10:12:36.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.706+0000 7f35617fa700 1 -- 172.21.15.146:0/3794710894 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c00dd90 con 0x7f356412d380 2023-10-03T10:12:36.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.706+0000 7f35617fa700 1 -- 172.21.15.146:0/3794710894 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f355c00e430 con 0x7f356412d380 2023-10-03T10:12:36.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.707+0000 7f3568dbd700 1 -- 172.21.15.146:0/3794710894 >> v1:172.21.15.146:6816/126749 conn(0x7f354802f510 legacy=0x7f35480319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:36.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.707+0000 7f35617fa700 1 -- 172.21.15.146:0/3794710894 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f355c015700 con 0x7f356412d380 2023-10-03T10:12:36.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.707+0000 7f356b021700 1 -- 172.21.15.146:0/3794710894 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356411e020 con 0x7f356412d380 2023-10-03T10:12:36.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.712+0000 7f35617fa700 1 -- 172.21.15.146:0/3794710894 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f355c045060 con 0x7f356412d380 2023-10-03T10:12:36.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.742+0000 7f3237738700 1 Processor -- start 2023-10-03T10:12:36.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.742+0000 7f4f17210700 1 Processor -- start 2023-10-03T10:12:36.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.742+0000 7f4f17210700 1 -- start start 2023-10-03T10:12:36.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.742+0000 7f3237738700 1 -- start start 2023-10-03T10:12:36.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.743+0000 7f3237738700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32300a0a90 0x7f32300a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.743+0000 7f4f17210700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4f10133ad0 0x7f4f10133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.743+0000 7f4f17210700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f101300a0 0x7f4f101304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.743+0000 7f4f17210700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1006b2d0 con 0x7f4f101309f0 2023-10-03T10:12:36.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.743+0000 7f4f17210700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f10133610 con 0x7f4f10133ad0 2023-10-03T10:12:36.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.743+0000 7f4f17210700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1009a500 con 0x7f4f101300a0 2023-10-03T10:12:36.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.743+0000 7f3237738700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3230134140 0x7f323013bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.743+0000 7f3237738700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32300a1fe0 con 0x7f32300a13a0 2023-10-03T10:12:36.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.743+0000 7f3237738700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32300a3aa0 con 0x7f32300a0a90 2023-10-03T10:12:36.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.743+0000 7f3237738700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f323009a540 con 0x7f3230134140 2023-10-03T10:12:36.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.743+0000 7f3235cd5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3230134140 0x7f323013bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.743+0000 7f3235cd5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3230134140 0x7f323013bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:42948/0 (socket says 172.21.15.146:42948) 2023-10-03T10:12:36.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.743+0000 7f3235cd5700 1 -- 172.21.15.146:0/307649054 learned_addr learned my addr 172.21.15.146:0/307649054 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:36.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.743+0000 7f32354d4700 1 --2- 172.21.15.146:0/307649054 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32300a0a90 0x7f32300a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.743+0000 7f4f157ad700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4f101309f0 0x7f4f1013a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53880/0 (socket says 172.21.15.146:53880) 2023-10-03T10:12:36.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.743+0000 7f4f157ad700 1 -- 172.21.15.146:0/3887288561 learned_addr learned my addr 172.21.15.146:0/3887288561 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:36.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.743+0000 7f4f0ffff700 1 --2- 172.21.15.146:0/3887288561 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f101300a0 0x7f4f101304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.743+0000 7f4f14fac700 1 --2- 172.21.15.146:0/3887288561 >> v2:172.21.15.146:3300/0 conn(0x7f4f10133ad0 0x7f4f10133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.743+0000 7f3235cd5700 1 -- 172.21.15.146:0/307649054 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32300a0a90 msgr2=0x7f32300a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:36.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.743+0000 7f3235cd5700 1 --2- 172.21.15.146:0/307649054 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32300a0a90 0x7f32300a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.743+0000 7f3235cd5700 1 -- 172.21.15.146:0/307649054 >> v1:172.21.15.146:6789/0 conn(0x7f32300a13a0 legacy=0x7f3230133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.743+0000 7f3235cd5700 1 -- 172.21.15.146:0/307649054 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323009a280 con 0x7f3230134140 2023-10-03T10:12:36.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.744+0000 7f4f0ffff700 1 -- 172.21.15.146:0/3887288561 >> v2:172.21.15.146:3300/0 conn(0x7f4f10133ad0 msgr2=0x7f4f10133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:36.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.744+0000 7f4f0ffff700 1 --2- 172.21.15.146:0/3887288561 >> v2:172.21.15.146:3300/0 conn(0x7f4f10133ad0 0x7f4f10133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.744+0000 7f4f0ffff700 1 -- 172.21.15.146:0/3887288561 >> v1:172.21.15.146:6789/0 conn(0x7f4f101309f0 legacy=0x7f4f1013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.744+0000 7f4f0ffff700 1 -- 172.21.15.146:0/3887288561 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f101338b0 con 0x7f4f101300a0 2023-10-03T10:12:36.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.744+0000 7f4f14fac700 1 --2- 172.21.15.146:0/3887288561 >> v2:172.21.15.146:3300/0 conn(0x7f4f10133ad0 0x7f4f10133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:36.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.744+0000 7f3235cd5700 1 --2- 172.21.15.146:0/307649054 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3230134140 0x7f323013bea0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3228014a30 tx=0x7f3228014d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae3325f28736cf79 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.744+0000 7f4f0ffff700 1 --2- 172.21.15.146:0/3887288561 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f101300a0 0x7f4f101304b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009840 tx=0x7f4efc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e8d4f7b84880d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.744+0000 7f3227fff700 1 -- 172.21.15.146:0/307649054 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3228013af0 con 0x7f3230134140 2023-10-03T10:12:36.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.744+0000 7f3227fff700 1 -- 172.21.15.146:0/307649054 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3228013c50 con 0x7f3230134140 2023-10-03T10:12:36.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.744+0000 7f3227fff700 1 -- 172.21.15.146:0/307649054 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3228013fe0 con 0x7f3230134140 2023-10-03T10:12:36.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.744+0000 7f4f0f7fe700 1 -- 172.21.15.146:0/3887288561 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc011830 con 0x7f4f101300a0 2023-10-03T10:12:36.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.744+0000 7f4f0f7fe700 1 -- 172.21.15.146:0/3887288561 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc011990 con 0x7f4f101300a0 2023-10-03T10:12:36.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.744+0000 7f4f0f7fe700 1 -- 172.21.15.146:0/3887288561 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc011d20 con 0x7f4f101300a0 2023-10-03T10:12:36.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.745+0000 7f3237738700 1 -- 172.21.15.146:0/307649054 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3230134140 msgr2=0x7f323013bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.745+0000 7f3237738700 1 --2- 172.21.15.146:0/307649054 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3230134140 0x7f323013bea0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3228014a30 tx=0x7f3228014d40 comp rx=0 tx=0).stop 2023-10-03T10:12:36.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.745+0000 7f3237738700 1 -- 172.21.15.146:0/307649054 shutdown_connections 2023-10-03T10:12:36.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.745+0000 7f3237738700 1 --2- 172.21.15.146:0/307649054 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3230134140 0x7f323013bea0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.745+0000 7f3237738700 1 --2- 172.21.15.146:0/307649054 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32300a0a90 0x7f32300a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.745+0000 7f3237738700 1 -- 172.21.15.146:0/307649054 >> 172.21.15.146:0/307649054 conn(0x7f3230099c40 msgr2=0x7f323006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.745+0000 7f3237738700 1 -- 172.21.15.146:0/307649054 shutdown_connections 2023-10-03T10:12:36.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.745+0000 7f4f17210700 1 -- 172.21.15.146:0/3887288561 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f101300a0 msgr2=0x7f4f101304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.745+0000 7f4f17210700 1 --2- 172.21.15.146:0/3887288561 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f101300a0 0x7f4f101304b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009840 tx=0x7f4efc009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:36.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.745+0000 7f3237738700 1 -- 172.21.15.146:0/307649054 wait complete. 2023-10-03T10:12:36.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.745+0000 7f4f17210700 1 -- 172.21.15.146:0/3887288561 shutdown_connections 2023-10-03T10:12:36.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.745+0000 7f4f17210700 1 --2- 172.21.15.146:0/3887288561 >> v2:172.21.15.146:3300/0 conn(0x7f4f10133ad0 0x7f4f10133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.745+0000 7f4f17210700 1 --2- 172.21.15.146:0/3887288561 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f101300a0 0x7f4f101304b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.745+0000 7f4f17210700 1 -- 172.21.15.146:0/3887288561 >> 172.21.15.146:0/3887288561 conn(0x7f4f10099c40 msgr2=0x7f4f100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.746+0000 7f4f17210700 1 -- 172.21.15.146:0/3887288561 shutdown_connections 2023-10-03T10:12:36.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.746+0000 7f4f17210700 1 -- 172.21.15.146:0/3887288561 wait complete. 2023-10-03T10:12:36.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.746+0000 7f3237738700 1 Processor -- start 2023-10-03T10:12:36.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.746+0000 7f3237738700 1 -- start start 2023-10-03T10:12:36.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.746+0000 7f4f17210700 1 Processor -- start 2023-10-03T10:12:36.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f3237738700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32300a0a90 0x7f32301c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f3237738700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32300a13a0 0x7f32301c4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f3237738700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3230134140 0x7f32301c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f3237738700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32301218c0 con 0x7f3230134140 2023-10-03T10:12:36.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f3237738700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3230120e20 con 0x7f32300a13a0 2023-10-03T10:12:36.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f3237738700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3230121b20 con 0x7f32300a0a90 2023-10-03T10:12:36.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f4f17210700 1 -- start start 2023-10-03T10:12:36.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f3234cd3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32300a13a0 0x7f32301c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f3234cd3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32300a13a0 0x7f32301c4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42748/0 (socket says 172.21.15.146:42748) 2023-10-03T10:12:36.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f3234cd3700 1 -- 172.21.15.146:0/1750332003 learned_addr learned my addr 172.21.15.146:0/1750332003 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:36.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f32354d4700 1 --2- 172.21.15.146:0/1750332003 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32300a0a90 0x7f32301c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f3235cd5700 1 --2- 172.21.15.146:0/1750332003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3230134140 0x7f32301c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f32354d4700 1 -- 172.21.15.146:0/1750332003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32300a13a0 msgr2=0x7f32301c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f32354d4700 1 --2- 172.21.15.146:0/1750332003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32300a13a0 0x7f32301c4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f32354d4700 1 -- 172.21.15.146:0/1750332003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3230134140 msgr2=0x7f32301c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f32354d4700 1 --2- 172.21.15.146:0/1750332003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3230134140 0x7f32301c4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f32354d4700 1 -- 172.21.15.146:0/1750332003 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3228014660 con 0x7f32300a0a90 2023-10-03T10:12:36.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f4f17210700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f101300a0 0x7f4f10071330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f4f17210700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f101309f0 0x7f4f10071870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f4f17210700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f10133ad0 0x7f4f101cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f4f17210700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1011b0a0 con 0x7f4f10133ad0 2023-10-03T10:12:36.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f4f17210700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1012fe10 con 0x7f4f101309f0 2023-10-03T10:12:36.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f4f17210700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f10119c60 con 0x7f4f101300a0 2023-10-03T10:12:36.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.748+0000 7f4f0ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f101309f0 0x7f4f10071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.748+0000 7f4f0ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f101309f0 0x7f4f10071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42762/0 (socket says 172.21.15.146:42762) 2023-10-03T10:12:36.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.748+0000 7f4f0ffff700 1 -- 172.21.15.146:0/2717409150 learned_addr learned my addr 172.21.15.146:0/2717409150 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:36.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.747+0000 7f32354d4700 1 --2- 172.21.15.146:0/1750332003 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32300a0a90 0x7f32301c3ed0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f322c00e900 tx=0x7f322c00ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.748+0000 7f4f157ad700 1 --2- 172.21.15.146:0/2717409150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f10133ad0 0x7f4f101cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.748+0000 7f4f14fac700 1 --2- 172.21.15.146:0/2717409150 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f101300a0 0x7f4f10071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.748+0000 7f3225ffb700 1 -- 172.21.15.146:0/1750332003 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c013680 con 0x7f32300a0a90 2023-10-03T10:12:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.748+0000 7f3225ffb700 1 -- 172.21.15.146:0/1750332003 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322c0137e0 con 0x7f32300a0a90 2023-10-03T10:12:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.748+0000 7f4f0ffff700 1 -- 172.21.15.146:0/2717409150 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f101300a0 msgr2=0x7f4f10071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.748+0000 7f4f0ffff700 1 --2- 172.21.15.146:0/2717409150 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f101300a0 0x7f4f10071330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.748+0000 7f4f0ffff700 1 -- 172.21.15.146:0/2717409150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f10133ad0 msgr2=0x7f4f101cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.748+0000 7f4f0ffff700 1 --2- 172.21.15.146:0/2717409150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f10133ad0 0x7f4f101cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.748+0000 7f4f0ffff700 1 -- 172.21.15.146:0/2717409150 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f040094a0 con 0x7f4f101309f0 2023-10-03T10:12:36.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.748+0000 7f3225ffb700 1 -- 172.21.15.146:0/1750332003 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c013b50 con 0x7f32300a0a90 2023-10-03T10:12:36.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.748+0000 7f4f14fac700 1 --2- 172.21.15.146:0/2717409150 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f101300a0 0x7f4f10071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:36.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.748+0000 7f3237738700 1 -- 172.21.15.146:0/1750332003 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32301212e0 con 0x7f32300a0a90 2023-10-03T10:12:36.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.748+0000 7f3237738700 1 -- 172.21.15.146:0/1750332003 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32301201b0 con 0x7f32300a0a90 2023-10-03T10:12:36.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.748+0000 7f4f0ffff700 1 --2- 172.21.15.146:0/2717409150 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f101309f0 0x7f4f10071870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009fd0 tx=0x7f4efc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.749+0000 7f4f0d7fa700 1 -- 172.21.15.146:0/2717409150 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc0038a0 con 0x7f4f101309f0 2023-10-03T10:12:36.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.749+0000 7f4f0d7fa700 1 -- 172.21.15.146:0/2717409150 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc01e070 con 0x7f4f101309f0 2023-10-03T10:12:36.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.749+0000 7f4f0d7fa700 1 -- 172.21.15.146:0/2717409150 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc003c00 con 0x7f4f101309f0 2023-10-03T10:12:36.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.749+0000 7f3237738700 1 -- 172.21.15.146:0/1750332003 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323004f2a0 con 0x7f32300a0a90 2023-10-03T10:12:36.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.749+0000 7f3225ffb700 1 -- 172.21.15.146:0/1750332003 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f322c013cb0 con 0x7f32300a0a90 2023-10-03T10:12:36.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.750+0000 7f3225ffb700 1 -- 172.21.15.146:0/1750332003 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f322c03fd10 con 0x7f32300a0a90 2023-10-03T10:12:36.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.750+0000 7f3234cd3700 1 -- 172.21.15.146:0/1750332003 >> v1:172.21.15.146:6816/126749 conn(0x7f321402f510 legacy=0x7f32140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:36.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.750+0000 7f4f17210700 1 -- 172.21.15.146:0/2717409150 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4efc0094a0 con 0x7f4f101309f0 2023-10-03T10:12:36.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.750+0000 7f4f17210700 1 -- 172.21.15.146:0/2717409150 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f1011b380 con 0x7f4f101309f0 2023-10-03T10:12:36.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.750+0000 7f4f0d7fa700 1 -- 172.21.15.146:0/2717409150 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4efc01a420 con 0x7f4f101309f0 2023-10-03T10:12:36.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.751+0000 7f4f17210700 1 -- 172.21.15.146:0/2717409150 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1011aee0 con 0x7f4f101309f0 2023-10-03T10:12:36.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.751+0000 7f4f0d7fa700 1 -- 172.21.15.146:0/2717409150 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f4efc042680 con 0x7f4f101309f0 2023-10-03T10:12:36.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.755+0000 7f4f14fac700 1 -- 172.21.15.146:0/2717409150 >> v1:172.21.15.146:6816/126749 conn(0x7f4ef402f560 legacy=0x7f4ef4031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:36.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.755+0000 7f4f0d7fa700 1 -- 172.21.15.146:0/2717409150 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4efc046060 con 0x7f4f101309f0 2023-10-03T10:12:36.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.758+0000 7f3225ffb700 1 -- 172.21.15.146:0/1750332003 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f322c01bc70 con 0x7f32300a0a90 2023-10-03T10:12:36.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.875+0000 7f884659c700 1 -- 172.21.15.146:0/3836574811 >> v1:172.21.15.146:6816/126749 conn(0x7f882802f560 legacy=0x7f8828031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:36.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.883+0000 7f884cd31700 1 -- 172.21.15.146:0/3836574811 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f884806c3b0 con 0x7f8848133ad0 2023-10-03T10:12:36.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.884+0000 7f8836ffd700 1 -- 172.21.15.146:0/3836574811 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f884001cb60 con 0x7f8848133ad0 2023-10-03T10:12:36.883 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:36.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.886+0000 7f884cd31700 1 -- 172.21.15.146:0/3836574811 >> v1:172.21.15.146:6816/126749 conn(0x7f882802f560 legacy=0x7f8828031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:36.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.886+0000 7f884cd31700 1 -- 172.21.15.146:0/3836574811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8848133ad0 msgr2=0x7f88481c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.886+0000 7f884cd31700 1 --2- 172.21.15.146:0/3836574811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8848133ad0 0x7f88481c91d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f884000efc0 tx=0x7f884000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.886+0000 7f884cd31700 1 -- 172.21.15.146:0/3836574811 shutdown_connections 2023-10-03T10:12:36.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.886+0000 7f884cd31700 1 --2- 172.21.15.146:0/3836574811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8848133ad0 0x7f88481c91d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.886+0000 7f884cd31700 1 --2- 172.21.15.146:0/3836574811 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f88481300a0 0x7f88481c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.886+0000 7f884cd31700 1 --2- 172.21.15.146:0/3836574811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88481309f0 0x7f88481c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.886+0000 7f884cd31700 1 -- 172.21.15.146:0/3836574811 >> 172.21.15.146:0/3836574811 conn(0x7f8848099c40 msgr2=0x7f88480a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.886+0000 7f884cd31700 1 -- 172.21.15.146:0/3836574811 shutdown_connections 2023-10-03T10:12:36.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.886+0000 7f884cd31700 1 -- 172.21.15.146:0/3836574811 wait complete. 2023-10-03T10:12:36.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:36.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.908+0000 7f3568dbd700 1 -- 172.21.15.146:0/3794710894 >> v1:172.21.15.146:6816/126749 conn(0x7f354802f510 legacy=0x7f35480319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:36.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.924+0000 7f356b021700 1 -- 172.21.15.146:0/3794710894 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f356404f2a0 con 0x7f356412d380 2023-10-03T10:12:36.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.924+0000 7f35617fa700 1 -- 172.21.15.146:0/3794710894 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f355c0148a0 con 0x7f356412d380 2023-10-03T10:12:36.923 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.926+0000 7f356b021700 1 -- 172.21.15.146:0/3794710894 >> v1:172.21.15.146:6816/126749 conn(0x7f354802f510 legacy=0x7f35480319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.926+0000 7f356b021700 1 -- 172.21.15.146:0/3794710894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f356412d380 msgr2=0x7f356411b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.926+0000 7f356b021700 1 --2- 172.21.15.146:0/3794710894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f356412d380 0x7f356411b600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f355c00b970 tx=0x7f355c00bc80 comp rx=0 tx=0).stop 2023-10-03T10:12:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.926+0000 7f356b021700 1 -- 172.21.15.146:0/3794710894 shutdown_connections 2023-10-03T10:12:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.926+0000 7f356b021700 1 --2- 172.21.15.146:0/3794710894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f356412d380 0x7f356411b600 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.926+0000 7f356b021700 1 --2- 172.21.15.146:0/3794710894 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3564099a60 0x7f356411ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.926+0000 7f356b021700 1 --2- 172.21.15.146:0/3794710894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f356409a3d0 0x7f356411b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.926+0000 7f356b021700 1 -- 172.21.15.146:0/3794710894 >> 172.21.15.146:0/3794710894 conn(0x7f35640a2980 msgr2=0x7f356409d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.926+0000 7f356b021700 1 -- 172.21.15.146:0/3794710894 shutdown_connections 2023-10-03T10:12:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.926+0000 7f356b021700 1 -- 172.21.15.146:0/3794710894 wait complete. 2023-10-03T10:12:36.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:36.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.951+0000 7f3234cd3700 1 -- 172.21.15.146:0/1750332003 >> v1:172.21.15.146:6816/126749 conn(0x7f321402f510 legacy=0x7f32140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:36.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.956+0000 7f4f14fac700 1 -- 172.21.15.146:0/2717409150 >> v1:172.21.15.146:6816/126749 conn(0x7f4ef402f560 legacy=0x7f4ef4031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:36.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.964+0000 7f4f17210700 1 -- 172.21.15.146:0/2717409150 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4f1004f2a0 con 0x7f4f101309f0 2023-10-03T10:12:36.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.964+0000 7f4f0d7fa700 1 -- 172.21.15.146:0/2717409150 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4efc015090 con 0x7f4f101309f0 2023-10-03T10:12:36.964 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:36.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.967+0000 7f4f17210700 1 -- 172.21.15.146:0/2717409150 >> v1:172.21.15.146:6816/126749 conn(0x7f4ef402f560 legacy=0x7f4ef4031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:36.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.967+0000 7f4f17210700 1 -- 172.21.15.146:0/2717409150 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f101309f0 msgr2=0x7f4f10071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.967+0000 7f4f17210700 1 --2- 172.21.15.146:0/2717409150 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f101309f0 0x7f4f10071870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009fd0 tx=0x7f4efc004750 comp rx=0 tx=0).stop 2023-10-03T10:12:36.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.967+0000 7f4f17210700 1 -- 172.21.15.146:0/2717409150 shutdown_connections 2023-10-03T10:12:36.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.967+0000 7f4f17210700 1 --2- 172.21.15.146:0/2717409150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f10133ad0 0x7f4f101cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.967+0000 7f4f17210700 1 --2- 172.21.15.146:0/2717409150 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f101300a0 0x7f4f10071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.967+0000 7f4f17210700 1 --2- 172.21.15.146:0/2717409150 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f101309f0 0x7f4f10071870 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.967+0000 7f4f17210700 1 -- 172.21.15.146:0/2717409150 >> 172.21.15.146:0/2717409150 conn(0x7f4f10099c40 msgr2=0x7f4f101327e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.967+0000 7f4f17210700 1 -- 172.21.15.146:0/2717409150 shutdown_connections 2023-10-03T10:12:36.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.967+0000 7f4f17210700 1 -- 172.21.15.146:0/2717409150 wait complete. 2023-10-03T10:12:36.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.969+0000 7f3237738700 1 -- 172.21.15.146:0/1750332003 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f32300729d0 con 0x7f32300a0a90 2023-10-03T10:12:36.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.970+0000 7f3225ffb700 1 -- 172.21.15.146:0/1750332003 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f322c021020 con 0x7f32300a0a90 2023-10-03T10:12:36.969 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:36.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.972+0000 7f3237738700 1 -- 172.21.15.146:0/1750332003 >> v1:172.21.15.146:6816/126749 conn(0x7f321402f510 legacy=0x7f32140319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:36.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.972+0000 7f3237738700 1 -- 172.21.15.146:0/1750332003 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32300a0a90 msgr2=0x7f32301c3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.972+0000 7f3237738700 1 --2- 172.21.15.146:0/1750332003 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32300a0a90 0x7f32301c3ed0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f322c00e900 tx=0x7f322c00ec10 comp rx=0 tx=0).stop 2023-10-03T10:12:36.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.972+0000 7f3237738700 1 -- 172.21.15.146:0/1750332003 shutdown_connections 2023-10-03T10:12:36.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.972+0000 7f3237738700 1 --2- 172.21.15.146:0/1750332003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3230134140 0x7f32301c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.972+0000 7f3237738700 1 --2- 172.21.15.146:0/1750332003 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32300a0a90 0x7f32301c3ed0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.972+0000 7f3237738700 1 --2- 172.21.15.146:0/1750332003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32300a13a0 0x7f32301c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.972+0000 7f3237738700 1 -- 172.21.15.146:0/1750332003 >> 172.21.15.146:0/1750332003 conn(0x7f3230099c40 msgr2=0x7f32300a47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.972+0000 7f3237738700 1 -- 172.21.15.146:0/1750332003 shutdown_connections 2023-10-03T10:12:36.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:36.972+0000 7f3237738700 1 -- 172.21.15.146:0/1750332003 wait complete. 2023-10-03T10:12:36.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:36.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:37.904 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:37.939 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:37.981 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:37.985 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:38.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.053+0000 7f16cd4d6700 1 Processor -- start 2023-10-03T10:12:38.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.053+0000 7f16cd4d6700 1 -- start start 2023-10-03T10:12:38.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.054+0000 7f16cd4d6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16c8133ad0 0x7f16c8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.054+0000 7f16cd4d6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16c8130bc0 0x7f16c813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.054+0000 7f16cd4d6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c806b2d0 con 0x7f16c81300a0 2023-10-03T10:12:38.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.054+0000 7f16cd4d6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8133610 con 0x7f16c8133ad0 2023-10-03T10:12:38.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.054+0000 7f16cd4d6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16c809a500 con 0x7f16c8130bc0 2023-10-03T10:12:38.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.054+0000 7f16c6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16c8133ad0 0x7f16c8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.054+0000 7f16c6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16c8133ad0 0x7f16c8133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42778/0 (socket says 172.21.15.146:42778) 2023-10-03T10:12:38.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.054+0000 7f16c6ffd700 1 -- 172.21.15.146:0/2971140214 learned_addr learned my addr 172.21.15.146:0/2971140214 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:38.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.054+0000 7f16c77fe700 1 --2- 172.21.15.146:0/2971140214 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16c8130bc0 0x7f16c813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.054+0000 7f16c5ffb700 1 -- 172.21.15.146:0/2971140214 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833137836 0 0) 0x7f16c806b2d0 con 0x7f16c81300a0 2023-10-03T10:12:38.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.054+0000 7f16c6ffd700 1 -- 172.21.15.146:0/2971140214 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16c8130bc0 msgr2=0x7f16c813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:38.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.054+0000 7f16c6ffd700 1 --2- 172.21.15.146:0/2971140214 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16c8130bc0 0x7f16c813b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.054+0000 7f16c6ffd700 1 -- 172.21.15.146:0/2971140214 >> v1:172.21.15.146:6789/0 conn(0x7f16c81300a0 legacy=0x7f16c81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.054+0000 7f16c6ffd700 1 -- 172.21.15.146:0/2971140214 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c81338b0 con 0x7f16c8133ad0 2023-10-03T10:12:38.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.054+0000 7f16c77fe700 1 --2- 172.21.15.146:0/2971140214 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16c8130bc0 0x7f16c813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:38.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.055+0000 7f16c6ffd700 1 --2- 172.21.15.146:0/2971140214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16c8133ad0 0x7f16c8133ea0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f16b8009920 tx=0x7f16b8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23564c2adfec6b54 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:38.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.055+0000 7f16c5ffb700 1 -- 172.21.15.146:0/2971140214 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8011830 con 0x7f16c8133ad0 2023-10-03T10:12:38.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.055+0000 7f16c5ffb700 1 -- 172.21.15.146:0/2971140214 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b8011990 con 0x7f16c8133ad0 2023-10-03T10:12:38.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.055+0000 7f16c5ffb700 1 -- 172.21.15.146:0/2971140214 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8011d20 con 0x7f16c8133ad0 2023-10-03T10:12:38.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.056+0000 7f16cd4d6700 1 -- 172.21.15.146:0/2971140214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16c8133ad0 msgr2=0x7f16c8133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.056+0000 7f16cd4d6700 1 --2- 172.21.15.146:0/2971140214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16c8133ad0 0x7f16c8133ea0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f16b8009920 tx=0x7f16b8009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:38.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.056+0000 7f16cd4d6700 1 -- 172.21.15.146:0/2971140214 shutdown_connections 2023-10-03T10:12:38.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.056+0000 7f16cd4d6700 1 --2- 172.21.15.146:0/2971140214 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16c8130bc0 0x7f16c813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.056+0000 7f16cd4d6700 1 --2- 172.21.15.146:0/2971140214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16c8133ad0 0x7f16c8133ea0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.056+0000 7f16cd4d6700 1 -- 172.21.15.146:0/2971140214 >> 172.21.15.146:0/2971140214 conn(0x7f16c8099c40 msgr2=0x7f16c80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.056+0000 7f16cd4d6700 1 -- 172.21.15.146:0/2971140214 shutdown_connections 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.056+0000 7f16cd4d6700 1 -- 172.21.15.146:0/2971140214 wait complete. 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.057+0000 7f16cd4d6700 1 Processor -- start 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.057+0000 7f16cd4d6700 1 -- start start 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.057+0000 7f16cd4d6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16c81300a0 0x7f16c811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.057+0000 7f16cd4d6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16c8130bc0 0x7f16c811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.057+0000 7f16cd4d6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16c8133ad0 0x7f16c811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.057+0000 7f16cd4d6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80a33c0 con 0x7f16c8133ad0 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.057+0000 7f16cd4d6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c812dd00 con 0x7f16c81300a0 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.057+0000 7f16cd4d6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80722e0 con 0x7f16c8130bc0 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.058+0000 7f16c6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16c81300a0 0x7f16c811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.058+0000 7f16c6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16c81300a0 0x7f16c811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42792/0 (socket says 172.21.15.146:42792) 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.058+0000 7f16c6ffd700 1 -- 172.21.15.146:0/2474884803 learned_addr learned my addr 172.21.15.146:0/2474884803 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.058+0000 7f16c67fc700 1 --2- 172.21.15.146:0/2474884803 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16c8130bc0 0x7f16c811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.058+0000 7f16c77fe700 1 --2- 172.21.15.146:0/2474884803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16c8133ad0 0x7f16c811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.058+0000 7f16c67fc700 1 -- 172.21.15.146:0/2474884803 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16c81300a0 msgr2=0x7f16c811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.058+0000 7f16c67fc700 1 --2- 172.21.15.146:0/2474884803 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16c81300a0 0x7f16c811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.058+0000 7f16c67fc700 1 -- 172.21.15.146:0/2474884803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16c8133ad0 msgr2=0x7f16c811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.058+0000 7f16c67fc700 1 --2- 172.21.15.146:0/2474884803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16c8133ad0 0x7f16c811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.058+0000 7f16c67fc700 1 -- 172.21.15.146:0/2474884803 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c0009a70 con 0x7f16c8130bc0 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.058+0000 7f16c67fc700 1 --2- 172.21.15.146:0/2474884803 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16c8130bc0 0x7f16c811df80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f16c809ea20 tx=0x7f16bc00c6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.058+0000 7f16af7fe700 1 -- 172.21.15.146:0/2474884803 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0052d0 con 0x7f16c8130bc0 2023-10-03T10:12:38.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.058+0000 7f16cd4d6700 1 -- 172.21.15.146:0/2474884803 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b8009550 con 0x7f16c8130bc0 2023-10-03T10:12:38.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.058+0000 7f16cd4d6700 1 -- 172.21.15.146:0/2474884803 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c811ed00 con 0x7f16c8130bc0 2023-10-03T10:12:38.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.059+0000 7f16af7fe700 1 -- 172.21.15.146:0/2474884803 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc005430 con 0x7f16c8130bc0 2023-10-03T10:12:38.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.059+0000 7f16af7fe700 1 -- 172.21.15.146:0/2474884803 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0038a0 con 0x7f16c8130bc0 2023-10-03T10:12:38.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.059+0000 7f16af7fe700 1 -- 172.21.15.146:0/2474884803 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f16bc003a00 con 0x7f16c8130bc0 2023-10-03T10:12:38.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.060+0000 7f16af7fe700 1 -- 172.21.15.146:0/2474884803 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f16bc03ef60 con 0x7f16c8130bc0 2023-10-03T10:12:38.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.060+0000 7f16c6ffd700 1 -- 172.21.15.146:0/2474884803 >> v1:172.21.15.146:6816/126749 conn(0x7f16b402f510 legacy=0x7f16b40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:38.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.060+0000 7f16cd4d6700 1 -- 172.21.15.146:0/2474884803 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a80052e0 con 0x7f16c8130bc0 2023-10-03T10:12:38.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.069+0000 7f16af7fe700 1 -- 172.21.15.146:0/2474884803 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16bc06a750 con 0x7f16c8130bc0 2023-10-03T10:12:38.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.101+0000 7f0927c04700 1 Processor -- start 2023-10-03T10:12:38.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.102+0000 7f0927c04700 1 -- start start 2023-10-03T10:12:38.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.102+0000 7f0927c04700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0920133ad0 0x7f0920133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.102+0000 7f0927c04700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09201300a0 0x7f09201304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.102+0000 7f0927c04700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09201309f0 0x7f092013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.102+0000 7f0927c04700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f092006b2d0 con 0x7f0920133ad0 2023-10-03T10:12:38.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.102+0000 7f0927c04700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0920133610 con 0x7f09201300a0 2023-10-03T10:12:38.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.102+0000 7f0927c04700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f092009a500 con 0x7f09201309f0 2023-10-03T10:12:38.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.102+0000 7f09259a0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0920133ad0 0x7f0920133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.102+0000 7f09259a0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0920133ad0 0x7f0920133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44458/0 (socket says 172.21.15.146:44458) 2023-10-03T10:12:38.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.102+0000 7f09259a0700 1 -- 172.21.15.146:0/2140025229 learned_addr learned my addr 172.21.15.146:0/2140025229 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:38.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.102+0000 7f092519f700 1 --2- 172.21.15.146:0/2140025229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09201300a0 0x7f09201304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.103+0000 7f09259a0700 1 -- 172.21.15.146:0/2140025229 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09201309f0 msgr2=0x7f092013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:38.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.103+0000 7f09259a0700 1 --2- 172.21.15.146:0/2140025229 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09201309f0 0x7f092013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.103+0000 7f09259a0700 1 -- 172.21.15.146:0/2140025229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09201300a0 msgr2=0x7f09201304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:38.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.103+0000 7f09259a0700 1 --2- 172.21.15.146:0/2140025229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09201300a0 0x7f09201304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.103+0000 7f09259a0700 1 -- 172.21.15.146:0/2140025229 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09201338b0 con 0x7f0920133ad0 2023-10-03T10:12:38.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.103+0000 7f092519f700 1 --2- 172.21.15.146:0/2140025229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09201300a0 0x7f09201304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:38.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.103+0000 7f09259a0700 1 --2- 172.21.15.146:0/2140025229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0920133ad0 0x7f0920133ea0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f091c0098f0 tx=0x7f091c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d4477d8df5b426 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:38.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.103+0000 7f092499e700 1 -- 172.21.15.146:0/2140025229 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c011830 con 0x7f0920133ad0 2023-10-03T10:12:38.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.103+0000 7f092499e700 1 -- 172.21.15.146:0/2140025229 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c011990 con 0x7f0920133ad0 2023-10-03T10:12:38.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.103+0000 7f092499e700 1 -- 172.21.15.146:0/2140025229 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c011d20 con 0x7f0920133ad0 2023-10-03T10:12:38.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.104+0000 7f0927c04700 1 -- 172.21.15.146:0/2140025229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0920133ad0 msgr2=0x7f0920133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.104+0000 7f0927c04700 1 --2- 172.21.15.146:0/2140025229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0920133ad0 0x7f0920133ea0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f091c0098f0 tx=0x7f091c009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.104+0000 7f0927c04700 1 -- 172.21.15.146:0/2140025229 shutdown_connections 2023-10-03T10:12:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.104+0000 7f0927c04700 1 --2- 172.21.15.146:0/2140025229 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09201309f0 0x7f092013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.104+0000 7f0927c04700 1 --2- 172.21.15.146:0/2140025229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0920133ad0 0x7f0920133ea0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.104+0000 7f0927c04700 1 --2- 172.21.15.146:0/2140025229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09201300a0 0x7f09201304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.104+0000 7f0927c04700 1 -- 172.21.15.146:0/2140025229 >> 172.21.15.146:0/2140025229 conn(0x7f0920099c40 msgr2=0x7f09200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.104+0000 7f0927c04700 1 -- 172.21.15.146:0/2140025229 shutdown_connections 2023-10-03T10:12:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.104+0000 7f0927c04700 1 -- 172.21.15.146:0/2140025229 wait complete. 2023-10-03T10:12:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.105+0000 7f0927c04700 1 Processor -- start 2023-10-03T10:12:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.105+0000 7f0927c04700 1 -- start start 2023-10-03T10:12:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.105+0000 7f0927c04700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09201300a0 0x7f092011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.105+0000 7f0927c04700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09201309f0 0x7f092011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.105+0000 7f0927c04700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0920133ad0 0x7f092011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.105+0000 7f0927c04700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0920120130 con 0x7f09201300a0 2023-10-03T10:12:38.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.105+0000 7f0927c04700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092012d900 con 0x7f0920133ad0 2023-10-03T10:12:38.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.105+0000 7f0927c04700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0920120a30 con 0x7f09201309f0 2023-10-03T10:12:38.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.106+0000 7f09261a1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0920133ad0 0x7f092011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.106+0000 7f09259a0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09201300a0 0x7f092011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.106+0000 7f09261a1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0920133ad0 0x7f092011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42810/0 (socket says 172.21.15.146:42810) 2023-10-03T10:12:38.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.106+0000 7f09261a1700 1 -- 172.21.15.146:0/231910077 learned_addr learned my addr 172.21.15.146:0/231910077 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:38.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.106+0000 7f09259a0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09201300a0 0x7f092011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44462/0 (socket says 172.21.15.146:44462) 2023-10-03T10:12:38.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.106+0000 7f092519f700 1 --2- 172.21.15.146:0/231910077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09201309f0 0x7f092011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.106+0000 7f09261a1700 1 -- 172.21.15.146:0/231910077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09201309f0 msgr2=0x7f092011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.106+0000 7f09261a1700 1 --2- 172.21.15.146:0/231910077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09201309f0 0x7f092011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.106+0000 7f09261a1700 1 -- 172.21.15.146:0/231910077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09201300a0 msgr2=0x7f092011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.106+0000 7f09261a1700 1 --2- 172.21.15.146:0/231910077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09201300a0 0x7f092011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.106+0000 7f09261a1700 1 -- 172.21.15.146:0/231910077 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09100094a0 con 0x7f0920133ad0 2023-10-03T10:12:38.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.106+0000 7f09259a0700 1 --2- 172.21.15.146:0/231910077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09201300a0 0x7f092011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:38.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.106+0000 7f09261a1700 1 --2- 172.21.15.146:0/231910077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0920133ad0 0x7f092011e4c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f091800b970 tx=0x7f091800bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:38.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.106+0000 7f09167fc700 1 -- 172.21.15.146:0/231910077 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091800c930 con 0x7f0920133ad0 2023-10-03T10:12:38.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.106+0000 7f09167fc700 1 -- 172.21.15.146:0/231910077 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091800cab0 con 0x7f0920133ad0 2023-10-03T10:12:38.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.106+0000 7f09167fc700 1 -- 172.21.15.146:0/231910077 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091800ce60 con 0x7f0920133ad0 2023-10-03T10:12:38.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.107+0000 7f0927c04700 1 -- 172.21.15.146:0/231910077 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f091c009550 con 0x7f0920133ad0 2023-10-03T10:12:38.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.107+0000 7f0927c04700 1 -- 172.21.15.146:0/231910077 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f092011fb90 con 0x7f0920133ad0 2023-10-03T10:12:38.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.108+0000 7f09167fc700 1 -- 172.21.15.146:0/231910077 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0918007370 con 0x7f0920133ad0 2023-10-03T10:12:38.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.108+0000 7f09167fc700 1 -- 172.21.15.146:0/231910077 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f0918006e40 con 0x7f0920133ad0 2023-10-03T10:12:38.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.108+0000 7f09259a0700 1 -- 172.21.15.146:0/231910077 >> v1:172.21.15.146:6816/126749 conn(0x7f090402f510 legacy=0x7f09040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:38.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.109+0000 7f0927c04700 1 -- 172.21.15.146:0/231910077 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f092004f2a0 con 0x7f0920133ad0 2023-10-03T10:12:38.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.118+0000 7f09167fc700 1 -- 172.21.15.146:0/231910077 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f091801c360 con 0x7f0920133ad0 2023-10-03T10:12:38.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.125+0000 7f62e4148700 1 Processor -- start 2023-10-03T10:12:38.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.125+0000 7f62e4148700 1 -- start start 2023-10-03T10:12:38.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.126+0000 7f62e4148700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62dc09e870 0x7f62dc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.126+0000 7f62e4148700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f62dc09f180 0x7f62dc131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.126+0000 7f62e4148700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62dc09c970 con 0x7f62dc131d70 2023-10-03T10:12:38.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.126+0000 7f62e4148700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62dc0a0920 con 0x7f62dc09f180 2023-10-03T10:12:38.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.126+0000 7f62e4148700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62dc09f9c0 con 0x7f62dc09e870 2023-10-03T10:12:38.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.126+0000 7f62e16e3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f62dc09f180 0x7f62dc131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.126+0000 7f62e16e3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f62dc09f180 0x7f62dc131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44468/0 (socket says 172.21.15.146:44468) 2023-10-03T10:12:38.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.126+0000 7f62e16e3700 1 -- 172.21.15.146:0/4022804843 learned_addr learned my addr 172.21.15.146:0/4022804843 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:38.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.126+0000 7f62e1ee4700 1 --2- 172.21.15.146:0/4022804843 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62dc09e870 0x7f62dc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.126+0000 7f62e16e3700 1 -- 172.21.15.146:0/4022804843 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62dc09e870 msgr2=0x7f62dc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:38.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.126+0000 7f62e16e3700 1 --2- 172.21.15.146:0/4022804843 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62dc09e870 0x7f62dc09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.126+0000 7f62e16e3700 1 -- 172.21.15.146:0/4022804843 >> v1:172.21.15.146:6789/0 conn(0x7f62dc131d70 legacy=0x7f62dc138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.126+0000 7f62e16e3700 1 -- 172.21.15.146:0/4022804843 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62dc09bab0 con 0x7f62dc09f180 2023-10-03T10:12:38.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.126+0000 7f62e16e3700 1 --2- 172.21.15.146:0/4022804843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62dc09f180 0x7f62dc131830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f62cc0098f0 tx=0x7f62cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6dab7a80739056 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:38.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.127+0000 7f62e0ee2700 1 -- 172.21.15.146:0/4022804843 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc011830 con 0x7f62dc09f180 2023-10-03T10:12:38.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.127+0000 7f62e0ee2700 1 -- 172.21.15.146:0/4022804843 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62cc011990 con 0x7f62dc09f180 2023-10-03T10:12:38.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.127+0000 7f62e0ee2700 1 -- 172.21.15.146:0/4022804843 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc011d20 con 0x7f62dc09f180 2023-10-03T10:12:38.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.127+0000 7f62e4148700 1 -- 172.21.15.146:0/4022804843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62dc09f180 msgr2=0x7f62dc131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.127+0000 7f62e4148700 1 --2- 172.21.15.146:0/4022804843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62dc09f180 0x7f62dc131830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f62cc0098f0 tx=0x7f62cc009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:38.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.127+0000 7f62e4148700 1 -- 172.21.15.146:0/4022804843 shutdown_connections 2023-10-03T10:12:38.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.127+0000 7f62e4148700 1 --2- 172.21.15.146:0/4022804843 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62dc09e870 0x7f62dc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.127+0000 7f62e4148700 1 --2- 172.21.15.146:0/4022804843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62dc09f180 0x7f62dc131830 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.127+0000 7f62e4148700 1 -- 172.21.15.146:0/4022804843 >> 172.21.15.146:0/4022804843 conn(0x7f62dc0a4430 msgr2=0x7f62dc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:38.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.127+0000 7f62e4148700 1 -- 172.21.15.146:0/4022804843 shutdown_connections 2023-10-03T10:12:38.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.127+0000 7f62e4148700 1 -- 172.21.15.146:0/4022804843 wait complete. 2023-10-03T10:12:38.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.128+0000 7f62e4148700 1 Processor -- start 2023-10-03T10:12:38.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.128+0000 7f62e4148700 1 -- start start 2023-10-03T10:12:38.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.129+0000 7f62e4148700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62dc09e870 0x7f62dc1c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.129+0000 7f62e4148700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62dc09f180 0x7f62dc1c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.129+0000 7f62e4148700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62dc131d70 0x7f62dc1c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.129+0000 7f62e4148700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62dc125120 con 0x7f62dc09f180 2023-10-03T10:12:38.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.129+0000 7f62e4148700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62dc09dc10 con 0x7f62dc09e870 2023-10-03T10:12:38.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.129+0000 7f62e4148700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62dc06d640 con 0x7f62dc131d70 2023-10-03T10:12:38.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.129+0000 7f62e1ee4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62dc09e870 0x7f62dc1c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.129+0000 7f62e26e5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62dc131d70 0x7f62dc1c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.129+0000 7f62e26e5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62dc131d70 0x7f62dc1c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43022/0 (socket says 172.21.15.146:43022) 2023-10-03T10:12:38.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.129+0000 7f62e1ee4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62dc09e870 0x7f62dc1c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42818/0 (socket says 172.21.15.146:42818) 2023-10-03T10:12:38.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.129+0000 7f62e26e5700 1 -- 172.21.15.146:0/1026309241 learned_addr learned my addr 172.21.15.146:0/1026309241 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:38.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.129+0000 7f62e16e3700 1 --2- 172.21.15.146:0/1026309241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62dc09f180 0x7f62dc1c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.129+0000 7f62e1ee4700 1 -- 172.21.15.146:0/1026309241 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62dc131d70 msgr2=0x7f62dc1c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.129+0000 7f62e1ee4700 1 --2- 172.21.15.146:0/1026309241 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62dc131d70 0x7f62dc1c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.129+0000 7f62e1ee4700 1 -- 172.21.15.146:0/1026309241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62dc09f180 msgr2=0x7f62dc1c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.129+0000 7f62e1ee4700 1 --2- 172.21.15.146:0/1026309241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62dc09f180 0x7f62dc1c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.129+0000 7f62e1ee4700 1 -- 172.21.15.146:0/1026309241 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62cc009550 con 0x7f62dc09e870 2023-10-03T10:12:38.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.130+0000 7f62e1ee4700 1 --2- 172.21.15.146:0/1026309241 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62dc09e870 0x7f62dc1c88e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f62d800e8a0 tx=0x7f62d800ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:38.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.130+0000 7f62d27fc700 1 -- 172.21.15.146:0/1026309241 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d8013680 con 0x7f62dc09e870 2023-10-03T10:12:38.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.130+0000 7f62d27fc700 1 -- 172.21.15.146:0/1026309241 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d80137e0 con 0x7f62dc09e870 2023-10-03T10:12:38.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.130+0000 7f62d27fc700 1 -- 172.21.15.146:0/1026309241 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d8013b70 con 0x7f62dc09e870 2023-10-03T10:12:38.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.130+0000 7f62e4148700 1 -- 172.21.15.146:0/1026309241 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62dc126350 con 0x7f62dc09e870 2023-10-03T10:12:38.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.130+0000 7f62e4148700 1 -- 172.21.15.146:0/1026309241 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62dc09b1c0 con 0x7f62dc09e870 2023-10-03T10:12:38.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.131+0000 7f62d27fc700 1 -- 172.21.15.146:0/1026309241 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f62d8013cd0 con 0x7f62dc09e870 2023-10-03T10:12:38.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.131+0000 7f62d27fc700 1 -- 172.21.15.146:0/1026309241 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f62d803ff40 con 0x7f62dc09e870 2023-10-03T10:12:38.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.131+0000 7f62e16e3700 1 -- 172.21.15.146:0/1026309241 >> v1:172.21.15.146:6816/126749 conn(0x7f62c002f510 legacy=0x7f62c00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:38.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.131+0000 7f62e4148700 1 -- 172.21.15.146:0/1026309241 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62dc124ca0 con 0x7f62dc09e870 2023-10-03T10:12:38.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.131+0000 7efccde57700 1 Processor -- start 2023-10-03T10:12:38.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.131+0000 7efccde57700 1 -- start start 2023-10-03T10:12:38.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.132+0000 7efccde57700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcc812f700 0x7efcc812fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.132+0000 7efccde57700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efcc8130010 0x7efcc80987d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.132+0000 7efccde57700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc809a6c0 con 0x7efcc809a0a0 2023-10-03T10:12:38.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.132+0000 7efccde57700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc809ac80 con 0x7efcc8130010 2023-10-03T10:12:38.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.132+0000 7efccde57700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc809bff0 con 0x7efcc812f700 2023-10-03T10:12:38.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.132+0000 7efcc77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcc812f700 0x7efcc812fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.132+0000 7efcc77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcc812f700 0x7efcc812fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42828/0 (socket says 172.21.15.146:42828) 2023-10-03T10:12:38.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.132+0000 7efcc77fe700 1 -- 172.21.15.146:0/194996745 learned_addr learned my addr 172.21.15.146:0/194996745 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:38.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.132+0000 7efcc7fff700 1 --2- 172.21.15.146:0/194996745 >> v2:172.21.15.146:3300/0 conn(0x7efcc8130010 0x7efcc80987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.133+0000 7efcc7fff700 1 -- 172.21.15.146:0/194996745 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcc812f700 msgr2=0x7efcc812fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:38.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.133+0000 7efcc7fff700 1 --2- 172.21.15.146:0/194996745 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcc812f700 0x7efcc812fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.133+0000 7efcc7fff700 1 -- 172.21.15.146:0/194996745 >> v1:172.21.15.146:6789/0 conn(0x7efcc809a0a0 legacy=0x7efcc80980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:38.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.133+0000 7efcc7fff700 1 -- 172.21.15.146:0/194996745 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc8130490 con 0x7efcc8130010 2023-10-03T10:12:38.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.133+0000 7efcc77fe700 1 --2- 172.21.15.146:0/194996745 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcc812f700 0x7efcc812fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:38.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.133+0000 7efcc7fff700 1 --2- 172.21.15.146:0/194996745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcc8130010 0x7efcc80987d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efcc0009e10 tx=0x7efcc000f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e00e507a177b9ee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:38.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.133+0000 7efcc67fc700 1 -- 172.21.15.146:0/194996745 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc0003a20 con 0x7efcc8130010 2023-10-03T10:12:38.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.133+0000 7efcc67fc700 1 -- 172.21.15.146:0/194996745 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc0003b80 con 0x7efcc8130010 2023-10-03T10:12:38.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.133+0000 7efcc67fc700 1 -- 172.21.15.146:0/194996745 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc0004030 con 0x7efcc8130010 2023-10-03T10:12:38.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.134+0000 7efccde57700 1 -- 172.21.15.146:0/194996745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcc8130010 msgr2=0x7efcc80987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.134+0000 7efccde57700 1 --2- 172.21.15.146:0/194996745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcc8130010 0x7efcc80987d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efcc0009e10 tx=0x7efcc000f740 comp rx=0 tx=0).stop 2023-10-03T10:12:38.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.134+0000 7efccde57700 1 -- 172.21.15.146:0/194996745 shutdown_connections 2023-10-03T10:12:38.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.134+0000 7efccde57700 1 --2- 172.21.15.146:0/194996745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcc8130010 0x7efcc80987d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.134+0000 7efccde57700 1 --2- 172.21.15.146:0/194996745 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcc812f700 0x7efcc812fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.134+0000 7efccde57700 1 -- 172.21.15.146:0/194996745 >> 172.21.15.146:0/194996745 conn(0x7efcc80a1ee0 msgr2=0x7efcc80a22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:38.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.134+0000 7efccde57700 1 -- 172.21.15.146:0/194996745 shutdown_connections 2023-10-03T10:12:38.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.134+0000 7efccde57700 1 -- 172.21.15.146:0/194996745 wait complete. 2023-10-03T10:12:38.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.135+0000 7efccde57700 1 Processor -- start 2023-10-03T10:12:38.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.135+0000 7efccde57700 1 -- start start 2023-10-03T10:12:38.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.136+0000 7efccde57700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcc809a0a0 0x7efcc8098560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.136+0000 7efccde57700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcc812f700 0x7efcc806eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.136+0000 7efccde57700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efcc8130010 0x7efcc806efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:38.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.136+0000 7efccde57700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc8071c60 con 0x7efcc809a0a0 2023-10-03T10:12:38.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.136+0000 7efccde57700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc812f2a0 con 0x7efcc812f700 2023-10-03T10:12:38.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.136+0000 7efccde57700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efcc8129fd0 con 0x7efcc8130010 2023-10-03T10:12:38.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.136+0000 7efcc77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcc809a0a0 0x7efcc8098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.136+0000 7efcc77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcc809a0a0 0x7efcc8098560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44492/0 (socket says 172.21.15.146:44492) 2023-10-03T10:12:38.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.136+0000 7efcc7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efcc8130010 0x7efcc806efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.136+0000 7efcc77fe700 1 -- 172.21.15.146:0/1716002217 learned_addr learned my addr 172.21.15.146:0/1716002217 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:38.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.136+0000 7efcc6ffd700 1 --2- 172.21.15.146:0/1716002217 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcc812f700 0x7efcc806eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:38.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.136+0000 7f62d27fc700 1 -- 172.21.15.146:0/1026309241 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62d8021080 con 0x7f62dc09e870 2023-10-03T10:12:38.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.137+0000 7efcc77fe700 1 -- 172.21.15.146:0/1716002217 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efcc8130010 msgr2=0x7efcc806efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.137+0000 7efcc77fe700 1 --2- 172.21.15.146:0/1716002217 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efcc8130010 0x7efcc806efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.137+0000 7efcc77fe700 1 -- 172.21.15.146:0/1716002217 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcc812f700 msgr2=0x7efcc806eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.137+0000 7efcc77fe700 1 --2- 172.21.15.146:0/1716002217 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcc812f700 0x7efcc806eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.137+0000 7efcc77fe700 1 -- 172.21.15.146:0/1716002217 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb80085d0 con 0x7efcc809a0a0 2023-10-03T10:12:38.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.137+0000 7efcc77fe700 1 --2- 172.21.15.146:0/1716002217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcc809a0a0 0x7efcc8098560 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efcb800b9e0 tx=0x7efcb800e3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:38.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.137+0000 7efcaffff700 1 -- 172.21.15.146:0/1716002217 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb8010040 con 0x7efcc809a0a0 2023-10-03T10:12:38.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.137+0000 7efcaffff700 1 -- 172.21.15.146:0/1716002217 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb800ed10 con 0x7efcc809a0a0 2023-10-03T10:12:38.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.137+0000 7efcaffff700 1 -- 172.21.15.146:0/1716002217 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb8004230 con 0x7efcc809a0a0 2023-10-03T10:12:38.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.137+0000 7efccde57700 1 -- 172.21.15.146:0/1716002217 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc0009a70 con 0x7efcc809a0a0 2023-10-03T10:12:38.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.137+0000 7efccde57700 1 -- 172.21.15.146:0/1716002217 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc8072700 con 0x7efcc809a0a0 2023-10-03T10:12:38.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.138+0000 7efcaffff700 1 -- 172.21.15.146:0/1716002217 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7efcb8004390 con 0x7efcc809a0a0 2023-10-03T10:12:38.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.138+0000 7efcaffff700 1 -- 172.21.15.146:0/1716002217 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7efcb803ffc0 con 0x7efcc809a0a0 2023-10-03T10:12:38.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.138+0000 7efcc6ffd700 1 -- 172.21.15.146:0/1716002217 >> v1:172.21.15.146:6816/126749 conn(0x7efcb402f540 legacy=0x7efcb40319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:38.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.138+0000 7efccde57700 1 -- 172.21.15.146:0/1716002217 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc809f8e0 con 0x7efcc809a0a0 2023-10-03T10:12:38.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.143+0000 7efcaffff700 1 -- 172.21.15.146:0/1716002217 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efcb80036a0 con 0x7efcc809a0a0 2023-10-03T10:12:38.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.261+0000 7f16c6ffd700 1 -- 172.21.15.146:0/2474884803 >> v1:172.21.15.146:6816/126749 conn(0x7f16b402f510 legacy=0x7f16b40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:38.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.309+0000 7f09259a0700 1 -- 172.21.15.146:0/231910077 >> v1:172.21.15.146:6816/126749 conn(0x7f090402f510 legacy=0x7f09040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:38.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.315+0000 7f16cd4d6700 1 -- 172.21.15.146:0/2474884803 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f16a8005860 con 0x7f16c8130bc0 2023-10-03T10:12:38.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.315+0000 7f16af7fe700 1 -- 172.21.15.146:0/2474884803 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f16bc017020 con 0x7f16c8130bc0 2023-10-03T10:12:38.315 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:38.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.317+0000 7f16cd4d6700 1 -- 172.21.15.146:0/2474884803 >> v1:172.21.15.146:6816/126749 conn(0x7f16b402f510 legacy=0x7f16b40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:38.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.317+0000 7f16cd4d6700 1 -- 172.21.15.146:0/2474884803 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16c8130bc0 msgr2=0x7f16c811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.317+0000 7f16cd4d6700 1 --2- 172.21.15.146:0/2474884803 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16c8130bc0 0x7f16c811df80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f16c809ea20 tx=0x7f16bc00c6c0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.317+0000 7f16cd4d6700 1 -- 172.21.15.146:0/2474884803 shutdown_connections 2023-10-03T10:12:38.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.317+0000 7f16cd4d6700 1 --2- 172.21.15.146:0/2474884803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16c8133ad0 0x7f16c811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.317+0000 7f16cd4d6700 1 --2- 172.21.15.146:0/2474884803 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16c81300a0 0x7f16c811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.317+0000 7f16cd4d6700 1 --2- 172.21.15.146:0/2474884803 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16c8130bc0 0x7f16c811df80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.317+0000 7f16cd4d6700 1 -- 172.21.15.146:0/2474884803 >> 172.21.15.146:0/2474884803 conn(0x7f16c8099c40 msgr2=0x7f16c8132c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:38.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.317+0000 7f16cd4d6700 1 -- 172.21.15.146:0/2474884803 shutdown_connections 2023-10-03T10:12:38.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.317+0000 7f16cd4d6700 1 -- 172.21.15.146:0/2474884803 wait complete. 2023-10-03T10:12:38.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:38.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.332+0000 7f62e16e3700 1 -- 172.21.15.146:0/1026309241 >> v1:172.21.15.146:6816/126749 conn(0x7f62c002f510 legacy=0x7f62c00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:38.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.333+0000 7f62e4148700 1 -- 172.21.15.146:0/1026309241 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f62dc132660 con 0x7f62dc09e870 2023-10-03T10:12:38.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.333+0000 7f62d27fc700 1 -- 172.21.15.146:0/1026309241 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f62d8017020 con 0x7f62dc09e870 2023-10-03T10:12:38.333 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:38.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.335+0000 7f62e4148700 1 -- 172.21.15.146:0/1026309241 >> v1:172.21.15.146:6816/126749 conn(0x7f62c002f510 legacy=0x7f62c00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:38.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.335+0000 7f62e4148700 1 -- 172.21.15.146:0/1026309241 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62dc09e870 msgr2=0x7f62dc1c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.335+0000 7f62e4148700 1 --2- 172.21.15.146:0/1026309241 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62dc09e870 0x7f62dc1c88e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f62d800e8a0 tx=0x7f62d800ebb0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.335+0000 7f62e4148700 1 -- 172.21.15.146:0/1026309241 shutdown_connections 2023-10-03T10:12:38.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.335+0000 7f62e4148700 1 --2- 172.21.15.146:0/1026309241 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62dc131d70 0x7f62dc1c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.335+0000 7f62e4148700 1 --2- 172.21.15.146:0/1026309241 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62dc09e870 0x7f62dc1c88e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.335+0000 7f62e4148700 1 --2- 172.21.15.146:0/1026309241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62dc09f180 0x7f62dc1c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.335+0000 7f62e4148700 1 -- 172.21.15.146:0/1026309241 >> 172.21.15.146:0/1026309241 conn(0x7f62dc0a4430 msgr2=0x7f62dc06fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:38.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.335+0000 7f62e4148700 1 -- 172.21.15.146:0/1026309241 shutdown_connections 2023-10-03T10:12:38.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.335+0000 7f62e4148700 1 -- 172.21.15.146:0/1026309241 wait complete. 2023-10-03T10:12:38.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.336+0000 7efccde57700 1 -- 172.21.15.146:0/1716002217 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efcc8071e60 con 0x7efcc809a0a0 2023-10-03T10:12:38.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.337+0000 7efcaffff700 1 -- 172.21.15.146:0/1716002217 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efcc8071e60 con 0x7efcc809a0a0 2023-10-03T10:12:38.337 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:38.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.339+0000 7efccde57700 1 -- 172.21.15.146:0/1716002217 >> v1:172.21.15.146:6816/126749 conn(0x7efcb402f540 legacy=0x7efcb40319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:38.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.339+0000 7efccde57700 1 -- 172.21.15.146:0/1716002217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcc809a0a0 msgr2=0x7efcc8098560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.339+0000 7efccde57700 1 --2- 172.21.15.146:0/1716002217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcc809a0a0 0x7efcc8098560 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efcb800b9e0 tx=0x7efcb800e3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.339+0000 7efccde57700 1 -- 172.21.15.146:0/1716002217 shutdown_connections 2023-10-03T10:12:38.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.339+0000 7efccde57700 1 --2- 172.21.15.146:0/1716002217 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efcc8130010 0x7efcc806efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.339+0000 7efccde57700 1 --2- 172.21.15.146:0/1716002217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcc809a0a0 0x7efcc8098560 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.339+0000 7efccde57700 1 --2- 172.21.15.146:0/1716002217 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcc812f700 0x7efcc806eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.339+0000 7efccde57700 1 -- 172.21.15.146:0/1716002217 >> 172.21.15.146:0/1716002217 conn(0x7efcc80a1ee0 msgr2=0x7efcc809fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:38.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.339+0000 7efccde57700 1 -- 172.21.15.146:0/1716002217 shutdown_connections 2023-10-03T10:12:38.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.339+0000 7efccde57700 1 -- 172.21.15.146:0/1716002217 wait complete. 2023-10-03T10:12:38.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.344+0000 7f0927c04700 1 -- 172.21.15.146:0/231910077 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f092011ef80 con 0x7f0920133ad0 2023-10-03T10:12:38.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.344+0000 7f09167fc700 1 -- 172.21.15.146:0/231910077 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0918012340 con 0x7f0920133ad0 2023-10-03T10:12:38.344 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:38.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.348+0000 7f0927c04700 1 -- 172.21.15.146:0/231910077 >> v1:172.21.15.146:6816/126749 conn(0x7f090402f510 legacy=0x7f09040319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:38.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.348+0000 7f0927c04700 1 -- 172.21.15.146:0/231910077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0920133ad0 msgr2=0x7f092011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.348+0000 7f0927c04700 1 --2- 172.21.15.146:0/231910077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0920133ad0 0x7f092011e4c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f091800b970 tx=0x7f091800bc80 comp rx=0 tx=0).stop 2023-10-03T10:12:38.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.348+0000 7f0927c04700 1 -- 172.21.15.146:0/231910077 shutdown_connections 2023-10-03T10:12:38.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.348+0000 7f0927c04700 1 --2- 172.21.15.146:0/231910077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0920133ad0 0x7f092011e4c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.348+0000 7f0927c04700 1 --2- 172.21.15.146:0/231910077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09201300a0 0x7f092011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.348+0000 7f0927c04700 1 --2- 172.21.15.146:0/231910077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09201309f0 0x7f092011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.348+0000 7f0927c04700 1 -- 172.21.15.146:0/231910077 >> 172.21.15.146:0/231910077 conn(0x7f0920099c40 msgr2=0x7f0920132100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:38.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.348+0000 7f0927c04700 1 -- 172.21.15.146:0/231910077 shutdown_connections 2023-10-03T10:12:38.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:38.348+0000 7f0927c04700 1 -- 172.21.15.146:0/231910077 wait complete. 2023-10-03T10:12:38.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:38.353 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:38.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:39.331 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:39.351 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:39.354 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:39.361 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:39.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.472+0000 7f0792da6700 1 Processor -- start 2023-10-03T10:12:39.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.472+0000 7f0792da6700 1 -- start start 2023-10-03T10:12:39.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.472+0000 7f0792da6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f078c12d380 0x7f078c12d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.472+0000 7f0792da6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f078c09a5a0 0x7f078c138620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.472+0000 7f0792da6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078c09bb90 con 0x7f078c099a60 2023-10-03T10:12:39.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.472+0000 7f0792da6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078c09c210 con 0x7f078c09a5a0 2023-10-03T10:12:39.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.472+0000 7f0792da6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078c09ced0 con 0x7f078c12d380 2023-10-03T10:12:39.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.473+0000 7f0791343700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f078c09a5a0 0x7f078c138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.473+0000 7f0791343700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f078c09a5a0 0x7f078c138620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44504/0 (socket says 172.21.15.146:44504) 2023-10-03T10:12:39.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.473+0000 7f0791343700 1 -- 172.21.15.146:0/2751935132 learned_addr learned my addr 172.21.15.146:0/2751935132 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:39.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.473+0000 7f0790b42700 1 --2- 172.21.15.146:0/2751935132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f078c12d380 0x7f078c12d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.473+0000 7f0791343700 1 -- 172.21.15.146:0/2751935132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f078c12d380 msgr2=0x7f078c12d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:39.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.473+0000 7f0791343700 1 --2- 172.21.15.146:0/2751935132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f078c12d380 0x7f078c12d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.473+0000 7f0791343700 1 -- 172.21.15.146:0/2751935132 >> v1:172.21.15.146:6789/0 conn(0x7f078c099a60 legacy=0x7f078c099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.473+0000 7f0791343700 1 -- 172.21.15.146:0/2751935132 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c09ac30 con 0x7f078c09a5a0 2023-10-03T10:12:39.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.473+0000 7f0791343700 1 --2- 172.21.15.146:0/2751935132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f078c09a5a0 0x7f078c138620 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0784009e50 tx=0x7f078400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9baef61b8b835c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:39.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.474+0000 7f078b7fe700 1 -- 172.21.15.146:0/2751935132 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078400e070 con 0x7f078c09a5a0 2023-10-03T10:12:39.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.474+0000 7f078b7fe700 1 -- 172.21.15.146:0/2751935132 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078400b910 con 0x7f078c09a5a0 2023-10-03T10:12:39.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.474+0000 7f078b7fe700 1 -- 172.21.15.146:0/2751935132 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078400bcc0 con 0x7f078c09a5a0 2023-10-03T10:12:39.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.474+0000 7f0792da6700 1 -- 172.21.15.146:0/2751935132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f078c09a5a0 msgr2=0x7f078c138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.474+0000 7f0792da6700 1 --2- 172.21.15.146:0/2751935132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f078c09a5a0 0x7f078c138620 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0784009e50 tx=0x7f078400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:39.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.474+0000 7f0792da6700 1 -- 172.21.15.146:0/2751935132 shutdown_connections 2023-10-03T10:12:39.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.474+0000 7f0792da6700 1 --2- 172.21.15.146:0/2751935132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f078c09a5a0 0x7f078c138620 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.474+0000 7f0792da6700 1 --2- 172.21.15.146:0/2751935132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f078c12d380 0x7f078c12d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.474+0000 7f0792da6700 1 -- 172.21.15.146:0/2751935132 >> 172.21.15.146:0/2751935132 conn(0x7f078c0a2980 msgr2=0x7f078c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:39.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.475+0000 7f0792da6700 1 -- 172.21.15.146:0/2751935132 shutdown_connections 2023-10-03T10:12:39.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.475+0000 7f0792da6700 1 -- 172.21.15.146:0/2751935132 wait complete. 2023-10-03T10:12:39.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.476+0000 7f0792da6700 1 Processor -- start 2023-10-03T10:12:39.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.476+0000 7f0792da6700 1 -- start start 2023-10-03T10:12:39.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.476+0000 7f0792da6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f078c099a60 0x7f078c127700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.477+0000 7f0792da6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f078c09a5a0 0x7f078c1c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.477+0000 7f0792da6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f078c12d380 0x7f078c1c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.477+0000 7f0792da6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c128e70 con 0x7f078c12d380 2023-10-03T10:12:39.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.477+0000 7f0792da6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078c129b00 con 0x7f078c09a5a0 2023-10-03T10:12:39.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.477+0000 7f0792da6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f078c1292a0 con 0x7f078c099a60 2023-10-03T10:12:39.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.477+0000 7f078bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f078c09a5a0 0x7f078c1c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.477+0000 7f0790b42700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f078c099a60 0x7f078c127700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.477+0000 7f078bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f078c09a5a0 0x7f078c1c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42852/0 (socket says 172.21.15.146:42852) 2023-10-03T10:12:39.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.477+0000 7f0790b42700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f078c099a60 0x7f078c127700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43032/0 (socket says 172.21.15.146:43032) 2023-10-03T10:12:39.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.477+0000 7f078bfff700 1 -- 172.21.15.146:0/1065617432 learned_addr learned my addr 172.21.15.146:0/1065617432 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:39.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.477+0000 7f0791343700 1 --2- 172.21.15.146:0/1065617432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f078c12d380 0x7f078c1c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.477+0000 7f078bfff700 1 -- 172.21.15.146:0/1065617432 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f078c099a60 msgr2=0x7f078c127700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.477+0000 7f078bfff700 1 --2- 172.21.15.146:0/1065617432 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f078c099a60 0x7f078c127700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.477+0000 7f078bfff700 1 -- 172.21.15.146:0/1065617432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f078c12d380 msgr2=0x7f078c1c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.477+0000 7f078bfff700 1 --2- 172.21.15.146:0/1065617432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f078c12d380 0x7f078c1c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.477+0000 7f078bfff700 1 -- 172.21.15.146:0/1065617432 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0784009b30 con 0x7f078c09a5a0 2023-10-03T10:12:39.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.477+0000 7f0791343700 1 --2- 172.21.15.146:0/1065617432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f078c12d380 0x7f078c1c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:39.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.477+0000 7f0790b42700 1 --2- 172.21.15.146:0/1065617432 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f078c099a60 0x7f078c127700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:39.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.477+0000 7f078bfff700 1 --2- 172.21.15.146:0/1065617432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f078c09a5a0 0x7f078c1c88e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f077800c420 tx=0x7f077800c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:39.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.478+0000 7f07897fa700 1 -- 172.21.15.146:0/1065617432 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07780052d0 con 0x7f078c09a5a0 2023-10-03T10:12:39.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.478+0000 7f07897fa700 1 -- 172.21.15.146:0/1065617432 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0778005430 con 0x7f078c09a5a0 2023-10-03T10:12:39.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.478+0000 7f07897fa700 1 -- 172.21.15.146:0/1065617432 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07780038c0 con 0x7f078c09a5a0 2023-10-03T10:12:39.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.478+0000 7f0792da6700 1 -- 172.21.15.146:0/1065617432 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078c12a830 con 0x7f078c09a5a0 2023-10-03T10:12:39.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.478+0000 7f0792da6700 1 -- 172.21.15.146:0/1065617432 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078c128370 con 0x7f078c09a5a0 2023-10-03T10:12:39.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.479+0000 7f07897fa700 1 -- 172.21.15.146:0/1065617432 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0778003a20 con 0x7f078c09a5a0 2023-10-03T10:12:39.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.479+0000 7f0792da6700 1 -- 172.21.15.146:0/1065617432 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078c04f2a0 con 0x7f078c09a5a0 2023-10-03T10:12:39.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.479+0000 7f0790b42700 1 -- 172.21.15.146:0/1065617432 >> v1:172.21.15.146:6816/126749 conn(0x7f077002f510 legacy=0x7f07700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:39.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.479+0000 7f07897fa700 1 -- 172.21.15.146:0/1065617432 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f077803ee70 con 0x7f078c09a5a0 2023-10-03T10:12:39.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.488+0000 7f07897fa700 1 -- 172.21.15.146:0/1065617432 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0778017080 con 0x7f078c09a5a0 2023-10-03T10:12:39.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.511+0000 7f25a84c0700 1 Processor -- start 2023-10-03T10:12:39.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.511+0000 7f25a84c0700 1 -- start start 2023-10-03T10:12:39.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.512+0000 7f25a84c0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f25a00a1550 0x7f25a0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.512+0000 7f25a84c0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a0139200 0x7f25a013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.512+0000 7f25a84c0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a009e9d0 con 0x7f25a00a0a70 2023-10-03T10:12:39.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.512+0000 7f25a84c0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a009dc00 con 0x7f25a00a1550 2023-10-03T10:12:39.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.512+0000 7f25a84c0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25a009dec0 con 0x7f25a0139200 2023-10-03T10:12:39.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.512+0000 7f25a5a5b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f25a00a1550 0x7f25a0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.512+0000 7f25a5a5b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f25a00a1550 0x7f25a0138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44520/0 (socket says 172.21.15.146:44520) 2023-10-03T10:12:39.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.512+0000 7f25a5a5b700 1 -- 172.21.15.146:0/927421851 learned_addr learned my addr 172.21.15.146:0/927421851 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:39.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.512+0000 7f25a6a5d700 1 --2- 172.21.15.146:0/927421851 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a0139200 0x7f25a013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.513+0000 7f25a5a5b700 1 -- 172.21.15.146:0/927421851 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a0139200 msgr2=0x7f25a013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:39.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.513+0000 7f25a5a5b700 1 --2- 172.21.15.146:0/927421851 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a0139200 0x7f25a013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.513+0000 7f25a5a5b700 1 -- 172.21.15.146:0/927421851 >> v1:172.21.15.146:6789/0 conn(0x7f25a00a0a70 legacy=0x7f25a00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.513+0000 7f25a5a5b700 1 -- 172.21.15.146:0/927421851 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a009e6a0 con 0x7f25a00a1550 2023-10-03T10:12:39.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.513+0000 7f25a5a5b700 1 --2- 172.21.15.146:0/927421851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a00a1550 0x7f25a0138cc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f25900098f0 tx=0x7f2590009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab00af26c7ffddf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:39.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.513+0000 7f25a525a700 1 -- 172.21.15.146:0/927421851 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590011830 con 0x7f25a00a1550 2023-10-03T10:12:39.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.513+0000 7f25a525a700 1 -- 172.21.15.146:0/927421851 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2590011990 con 0x7f25a00a1550 2023-10-03T10:12:39.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.513+0000 7f25a525a700 1 -- 172.21.15.146:0/927421851 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590011d20 con 0x7f25a00a1550 2023-10-03T10:12:39.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.514+0000 7f25a84c0700 1 -- 172.21.15.146:0/927421851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a00a1550 msgr2=0x7f25a0138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.514+0000 7f25a84c0700 1 --2- 172.21.15.146:0/927421851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a00a1550 0x7f25a0138cc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f25900098f0 tx=0x7f2590009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:39.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.514+0000 7f25a84c0700 1 -- 172.21.15.146:0/927421851 shutdown_connections 2023-10-03T10:12:39.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.514+0000 7f25a84c0700 1 --2- 172.21.15.146:0/927421851 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a0139200 0x7f25a013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.514+0000 7f25a84c0700 1 --2- 172.21.15.146:0/927421851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a00a1550 0x7f25a0138cc0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.514+0000 7f25a84c0700 1 -- 172.21.15.146:0/927421851 >> 172.21.15.146:0/927421851 conn(0x7f25a00a6610 msgr2=0x7f25a00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:39.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.514+0000 7f25a84c0700 1 -- 172.21.15.146:0/927421851 shutdown_connections 2023-10-03T10:12:39.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.514+0000 7f25a84c0700 1 -- 172.21.15.146:0/927421851 wait complete. 2023-10-03T10:12:39.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.515+0000 7f25a84c0700 1 Processor -- start 2023-10-03T10:12:39.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.515+0000 7f25a84c0700 1 -- start start 2023-10-03T10:12:39.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.515+0000 7faaccf00700 1 Processor -- start 2023-10-03T10:12:39.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.515+0000 7faaccf00700 1 -- start start 2023-10-03T10:12:39.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7f25a84c0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a00a0a70 0x7f25a01cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7f25a84c0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a00a1550 0x7f25a01250b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7f25a84c0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25a0139200 0x7f25a01255f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7f25a84c0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a01cc640 con 0x7f25a00a0a70 2023-10-03T10:12:39.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7f25a84c0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a0127800 con 0x7f25a0139200 2023-10-03T10:12:39.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7f25a84c0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25a00a03e0 con 0x7f25a00a1550 2023-10-03T10:12:39.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7f25a625c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a00a0a70 0x7f25a01cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7f25a6a5d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25a0139200 0x7f25a01255f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7f25a625c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a00a0a70 0x7f25a01cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44524/0 (socket says 172.21.15.146:44524) 2023-10-03T10:12:39.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7f25a625c700 1 -- 172.21.15.146:0/2151643685 learned_addr learned my addr 172.21.15.146:0/2151643685 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:39.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7f25a6a5d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25a0139200 0x7f25a01255f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42862/0 (socket says 172.21.15.146:42862) 2023-10-03T10:12:39.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7f25a5a5b700 1 --2- 172.21.15.146:0/2151643685 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a00a1550 0x7f25a01250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7faaccf00700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faac8133660 0x7faac8135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7faaccf00700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faac8135f80 0x7faac8138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7faaccf00700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac809ae40 con 0x7faac812d280 2023-10-03T10:12:39.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7faaccf00700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac809b9a0 con 0x7faac8133660 2023-10-03T10:12:39.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7faaccf00700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faac812dd60 con 0x7faac8135f80 2023-10-03T10:12:39.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7f25a625c700 1 -- 172.21.15.146:0/2151643685 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a00a1550 msgr2=0x7f25a01250b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7f25a625c700 1 --2- 172.21.15.146:0/2151643685 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a00a1550 0x7f25a01250b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7f25a625c700 1 -- 172.21.15.146:0/2151643685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25a0139200 msgr2=0x7f25a01255f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7f25a625c700 1 --2- 172.21.15.146:0/2151643685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25a0139200 0x7f25a01255f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7f25a625c700 1 -- 172.21.15.146:0/2151643685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2590009550 con 0x7f25a00a0a70 2023-10-03T10:12:39.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7faac6d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faac8135f80 0x7faac8138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.516+0000 7faac6d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faac8135f80 0x7faac8138360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43056/0 (socket says 172.21.15.146:43056) 2023-10-03T10:12:39.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.517+0000 7faac6d9d700 1 -- 172.21.15.146:0/4160480095 learned_addr learned my addr 172.21.15.146:0/4160480095 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:39.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.517+0000 7faac5d9b700 1 --2- 172.21.15.146:0/4160480095 >> v2:172.21.15.146:3300/0 conn(0x7faac8133660 0x7faac8135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.517+0000 7f25a625c700 1 --2- 172.21.15.146:0/2151643685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a00a0a70 0x7f25a01cccc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f259c00c4e0 tx=0x7f259c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:39.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.517+0000 7faac6d9d700 1 -- 172.21.15.146:0/4160480095 >> v2:172.21.15.146:3300/0 conn(0x7faac8133660 msgr2=0x7faac8135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:39.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.517+0000 7faac6d9d700 1 --2- 172.21.15.146:0/4160480095 >> v2:172.21.15.146:3300/0 conn(0x7faac8133660 0x7faac8135a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.517+0000 7faac6d9d700 1 -- 172.21.15.146:0/4160480095 >> v1:172.21.15.146:6789/0 conn(0x7faac812d280 legacy=0x7faac812d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:39.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.517+0000 7faac6d9d700 1 -- 172.21.15.146:0/4160480095 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac809bbb0 con 0x7faac8135f80 2023-10-03T10:12:39.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.517+0000 7faac6d9d700 1 --2- 172.21.15.146:0/4160480095 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faac8135f80 0x7faac8138360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faac0009e50 tx=0x7faac000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3728022d6aaea587 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:39.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.517+0000 7faac559a700 1 -- 172.21.15.146:0/4160480095 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac000e070 con 0x7faac8135f80 2023-10-03T10:12:39.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.517+0000 7faac559a700 1 -- 172.21.15.146:0/4160480095 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac0003a20 con 0x7faac8135f80 2023-10-03T10:12:39.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.517+0000 7faac559a700 1 -- 172.21.15.146:0/4160480095 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac0003dd0 con 0x7faac8135f80 2023-10-03T10:12:39.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.517+0000 7f2596ffd700 1 -- 172.21.15.146:0/2151643685 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c0052d0 con 0x7f25a00a0a70 2023-10-03T10:12:39.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.517+0000 7f2596ffd700 1 -- 172.21.15.146:0/2151643685 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259c005430 con 0x7f25a00a0a70 2023-10-03T10:12:39.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.517+0000 7f2596ffd700 1 -- 172.21.15.146:0/2151643685 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c0038c0 con 0x7f25a00a0a70 2023-10-03T10:12:39.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.517+0000 7f25a84c0700 1 -- 172.21.15.146:0/2151643685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a01cc870 con 0x7f25a00a0a70 2023-10-03T10:12:39.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.517+0000 7f25a84c0700 1 -- 172.21.15.146:0/2151643685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a00719b0 con 0x7f25a00a0a70 2023-10-03T10:12:39.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.518+0000 7faaccf00700 1 -- 172.21.15.146:0/4160480095 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faac8135f80 msgr2=0x7faac8138360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.518+0000 7faaccf00700 1 --2- 172.21.15.146:0/4160480095 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faac8135f80 0x7faac8138360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faac0009e50 tx=0x7faac000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:39.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.518+0000 7faaccf00700 1 -- 172.21.15.146:0/4160480095 shutdown_connections 2023-10-03T10:12:39.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.518+0000 7faaccf00700 1 --2- 172.21.15.146:0/4160480095 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faac8135f80 0x7faac8138360 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.518+0000 7faaccf00700 1 --2- 172.21.15.146:0/4160480095 >> v2:172.21.15.146:3300/0 conn(0x7faac8133660 0x7faac8135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.518+0000 7faaccf00700 1 -- 172.21.15.146:0/4160480095 >> 172.21.15.146:0/4160480095 conn(0x7faac80a2980 msgr2=0x7faac80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:39.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.518+0000 7faaccf00700 1 -- 172.21.15.146:0/4160480095 shutdown_connections 2023-10-03T10:12:39.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.518+0000 7f25a84c0700 1 -- 172.21.15.146:0/2151643685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a004f2a0 con 0x7f25a00a0a70 2023-10-03T10:12:39.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.519+0000 7f2596ffd700 1 -- 172.21.15.146:0/2151643685 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f259c003a20 con 0x7f25a00a0a70 2023-10-03T10:12:39.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.519+0000 7f25a5a5b700 1 -- 172.21.15.146:0/2151643685 >> v1:172.21.15.146:6816/126749 conn(0x7f258402f540 legacy=0x7f25840319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:39.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.519+0000 7f2596ffd700 1 -- 172.21.15.146:0/2151643685 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f259c0411d0 con 0x7f25a00a0a70 2023-10-03T10:12:39.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.518+0000 7faaccf00700 1 -- 172.21.15.146:0/4160480095 wait complete. 2023-10-03T10:12:39.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.520+0000 7faaccf00700 1 Processor -- start 2023-10-03T10:12:39.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.520+0000 7faaccf00700 1 -- start start 2023-10-03T10:12:39.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.520+0000 7faaccf00700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faac812d280 0x7faac806df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.520+0000 7faaccf00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac8133660 0x7faac806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.520+0000 7faaccf00700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faac8135f80 0x7faac806ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.520+0000 7faaccf00700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac8071fc0 con 0x7faac8133660 2023-10-03T10:12:39.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.520+0000 7faaccf00700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac8071100 con 0x7faac812d280 2023-10-03T10:12:39.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.520+0000 7faaccf00700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faac80716e0 con 0x7faac8135f80 2023-10-03T10:12:39.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.520+0000 7faac6d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faac8135f80 0x7faac806ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.520+0000 7faac6d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faac8135f80 0x7faac806ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43064/0 (socket says 172.21.15.146:43064) 2023-10-03T10:12:39.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.520+0000 7faac6d9d700 1 -- 172.21.15.146:0/1982487422 learned_addr learned my addr 172.21.15.146:0/1982487422 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:39.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.520+0000 7faac6d9d700 1 -- 172.21.15.146:0/1982487422 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faac812d280 msgr2=0x7faac806df90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:39.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.521+0000 7faac5d9b700 1 --2- 172.21.15.146:0/1982487422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac8133660 0x7faac806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.521+0000 7faac6d9d700 1 --2- 172.21.15.146:0/1982487422 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faac812d280 0x7faac806df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.521+0000 7faac6d9d700 1 -- 172.21.15.146:0/1982487422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac8133660 msgr2=0x7faac806e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.521+0000 7faac6d9d700 1 --2- 172.21.15.146:0/1982487422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac8133660 0x7faac806e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.521+0000 7faac6d9d700 1 -- 172.21.15.146:0/1982487422 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac0009b30 con 0x7faac8135f80 2023-10-03T10:12:39.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.521+0000 7faac5d9b700 1 --2- 172.21.15.146:0/1982487422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac8133660 0x7faac806e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:39.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.521+0000 7faac6d9d700 1 --2- 172.21.15.146:0/1982487422 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faac8135f80 0x7faac806ea10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faac809afd0 tx=0x7faac0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:39.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.521+0000 7faab6ffd700 1 -- 172.21.15.146:0/1982487422 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac0004440 con 0x7faac8135f80 2023-10-03T10:12:39.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.521+0000 7faab6ffd700 1 -- 172.21.15.146:0/1982487422 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac00045c0 con 0x7faac8135f80 2023-10-03T10:12:39.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.521+0000 7faab6ffd700 1 -- 172.21.15.146:0/1982487422 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac0004970 con 0x7faac8135f80 2023-10-03T10:12:39.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.521+0000 7faaccf00700 1 -- 172.21.15.146:0/1982487422 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac813f080 con 0x7faac8135f80 2023-10-03T10:12:39.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.521+0000 7faaccf00700 1 -- 172.21.15.146:0/1982487422 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac812c3a0 con 0x7faac8135f80 2023-10-03T10:12:39.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.522+0000 7faab6ffd700 1 -- 172.21.15.146:0/1982487422 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7faac0012430 con 0x7faac8135f80 2023-10-03T10:12:39.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.522+0000 7faab6ffd700 1 -- 172.21.15.146:0/1982487422 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7faac0040f40 con 0x7faac8135f80 2023-10-03T10:12:39.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.522+0000 7faac659c700 1 -- 172.21.15.146:0/1982487422 >> v1:172.21.15.146:6816/126749 conn(0x7faaa802f510 legacy=0x7faaa80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:39.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.522+0000 7f1d38a42700 1 Processor -- start 2023-10-03T10:12:39.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.522+0000 7f1d38a42700 1 -- start start 2023-10-03T10:12:39.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.523+0000 7faaccf00700 1 -- 172.21.15.146:0/1982487422 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac809a9d0 con 0x7faac8135f80 2023-10-03T10:12:39.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.523+0000 7f1d38a42700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1d34133730 0x7f1d34135b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.523+0000 7f1d38a42700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d34136050 0x7f1d34138430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.523+0000 7f1d38a42700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3409c1f0 con 0x7f1d341309f0 2023-10-03T10:12:39.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.523+0000 7f1d38a42700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d3409b1f0 con 0x7f1d34133730 2023-10-03T10:12:39.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.523+0000 7f1d38a42700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d341305a0 con 0x7f1d34136050 2023-10-03T10:12:39.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.523+0000 7f1d32d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d34136050 0x7f1d34138430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.523+0000 7f1d31d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1d34133730 0x7f1d34135b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.523+0000 7f1d32d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d34136050 0x7f1d34138430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43080/0 (socket says 172.21.15.146:43080) 2023-10-03T10:12:39.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.523+0000 7f1d32d9d700 1 -- 172.21.15.146:0/2443661748 learned_addr learned my addr 172.21.15.146:0/2443661748 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:39.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.524+0000 7f1d32d9d700 1 -- 172.21.15.146:0/2443661748 >> v2:172.21.15.146:3300/0 conn(0x7f1d34133730 msgr2=0x7f1d34135b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:39.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.524+0000 7f1d32d9d700 1 --2- 172.21.15.146:0/2443661748 >> v2:172.21.15.146:3300/0 conn(0x7f1d34133730 0x7f1d34135b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.524+0000 7f1d32d9d700 1 -- 172.21.15.146:0/2443661748 >> v1:172.21.15.146:6789/0 conn(0x7f1d341309f0 legacy=0x7f1d34130dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.524+0000 7f1d32d9d700 1 -- 172.21.15.146:0/2443661748 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3409bb50 con 0x7f1d34136050 2023-10-03T10:12:39.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.524+0000 7f1d31d9b700 1 --2- 172.21.15.146:0/2443661748 >> v2:172.21.15.146:3300/0 conn(0x7f1d34133730 0x7f1d34135b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:39.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.524+0000 7f1d32d9d700 1 --2- 172.21.15.146:0/2443661748 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d34136050 0x7f1d34138430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00d150 tx=0x7f1d2c00d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad361b3ac1958d45 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:39.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.527+0000 7f1d3159a700 1 -- 172.21.15.146:0/2443661748 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c010070 con 0x7f1d34136050 2023-10-03T10:12:39.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.528+0000 7f1d3159a700 1 -- 172.21.15.146:0/2443661748 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c00dd10 con 0x7f1d34136050 2023-10-03T10:12:39.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.528+0000 7f1d3159a700 1 -- 172.21.15.146:0/2443661748 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c00b310 con 0x7f1d34136050 2023-10-03T10:12:39.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.528+0000 7faab6ffd700 1 -- 172.21.15.146:0/1982487422 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faac0017080 con 0x7faac8135f80 2023-10-03T10:12:39.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.528+0000 7f2596ffd700 1 -- 172.21.15.146:0/2151643685 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f259c019d20 con 0x7f25a00a0a70 2023-10-03T10:12:39.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.528+0000 7f1d38a42700 1 -- 172.21.15.146:0/2443661748 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d34136050 msgr2=0x7f1d34138430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.528+0000 7f1d38a42700 1 --2- 172.21.15.146:0/2443661748 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d34136050 0x7f1d34138430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00d150 tx=0x7f1d2c00d460 comp rx=0 tx=0).stop 2023-10-03T10:12:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.529+0000 7f1d38a42700 1 -- 172.21.15.146:0/2443661748 shutdown_connections 2023-10-03T10:12:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.529+0000 7f1d38a42700 1 --2- 172.21.15.146:0/2443661748 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d34136050 0x7f1d34138430 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.529+0000 7f1d38a42700 1 --2- 172.21.15.146:0/2443661748 >> v2:172.21.15.146:3300/0 conn(0x7f1d34133730 0x7f1d34135b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.529+0000 7f1d38a42700 1 -- 172.21.15.146:0/2443661748 >> 172.21.15.146:0/2443661748 conn(0x7f1d340a2b30 msgr2=0x7f1d3409e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.529+0000 7f1d38a42700 1 -- 172.21.15.146:0/2443661748 shutdown_connections 2023-10-03T10:12:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.529+0000 7f1d38a42700 1 -- 172.21.15.146:0/2443661748 wait complete. 2023-10-03T10:12:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.530+0000 7f1d38a42700 1 Processor -- start 2023-10-03T10:12:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.530+0000 7f1d38a42700 1 -- start start 2023-10-03T10:12:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.530+0000 7f1d38a42700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d341309f0 0x7f1d341c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.530+0000 7f1d38a42700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d34133730 0x7f1d341c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.530+0000 7f1d38a42700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d34136050 0x7f1d341c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.530+0000 7f1d38a42700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d34071160 con 0x7f1d341309f0 2023-10-03T10:12:39.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.530+0000 7f1d38a42700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3412b6d0 con 0x7f1d34136050 2023-10-03T10:12:39.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.530+0000 7f1d38a42700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d34071860 con 0x7f1d34133730 2023-10-03T10:12:39.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.530+0000 7f1d31d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d34133730 0x7f1d341c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.530+0000 7f1d31d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d34133730 0x7f1d341c8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43084/0 (socket says 172.21.15.146:43084) 2023-10-03T10:12:39.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.530+0000 7f1d31d9b700 1 -- 172.21.15.146:0/212897798 learned_addr learned my addr 172.21.15.146:0/212897798 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:39.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.530+0000 7f1d32d9d700 1 --2- 172.21.15.146:0/212897798 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d34136050 0x7f1d341c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.531+0000 7f1d32d9d700 1 -- 172.21.15.146:0/212897798 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d34133730 msgr2=0x7f1d341c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.531+0000 7f1d32d9d700 1 --2- 172.21.15.146:0/212897798 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d34133730 0x7f1d341c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.531+0000 7f1d32d9d700 1 -- 172.21.15.146:0/212897798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d341309f0 msgr2=0x7f1d341c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.531+0000 7f1d32d9d700 1 --2- 172.21.15.146:0/212897798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d341309f0 0x7f1d341c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.531+0000 7f1d32d9d700 1 -- 172.21.15.146:0/212897798 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d280094a0 con 0x7f1d34136050 2023-10-03T10:12:39.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.531+0000 7f1d32d9d700 1 --2- 172.21.15.146:0/212897798 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d34136050 0x7f1d341c8d60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c017000 tx=0x7f1d2c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:39.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.531+0000 7f1d22ffd700 1 -- 172.21.15.146:0/212897798 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c00b4c0 con 0x7f1d34136050 2023-10-03T10:12:39.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.531+0000 7f1d22ffd700 1 -- 172.21.15.146:0/212897798 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c009810 con 0x7f1d34136050 2023-10-03T10:12:39.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.531+0000 7f1d22ffd700 1 -- 172.21.15.146:0/212897798 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c009ba0 con 0x7f1d34136050 2023-10-03T10:12:39.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.531+0000 7f1d38a42700 1 -- 172.21.15.146:0/212897798 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2c00bd40 con 0x7f1d34136050 2023-10-03T10:12:39.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.531+0000 7f1d38a42700 1 -- 172.21.15.146:0/212897798 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3409ea60 con 0x7f1d34136050 2023-10-03T10:12:39.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.532+0000 7f1d22ffd700 1 -- 172.21.15.146:0/212897798 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1d2c009d00 con 0x7f1d34136050 2023-10-03T10:12:39.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.532+0000 7f1d22ffd700 1 -- 172.21.15.146:0/212897798 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f1d2c0410d0 con 0x7f1d34136050 2023-10-03T10:12:39.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.532+0000 7f1d3259c700 1 -- 172.21.15.146:0/212897798 >> v1:172.21.15.146:6816/126749 conn(0x7f1d1402f510 legacy=0x7f1d140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:39.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.533+0000 7f1d38a42700 1 -- 172.21.15.146:0/212897798 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d3404f2a0 con 0x7f1d34136050 2023-10-03T10:12:39.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.538+0000 7f1d22ffd700 1 -- 172.21.15.146:0/212897798 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d2c0137a0 con 0x7f1d34136050 2023-10-03T10:12:39.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.680+0000 7f0790b42700 1 -- 172.21.15.146:0/1065617432 >> v1:172.21.15.146:6816/126749 conn(0x7f077002f510 legacy=0x7f07700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:39.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.700+0000 7f0792da6700 1 -- 172.21.15.146:0/1065617432 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f078c128370 con 0x7f078c09a5a0 2023-10-03T10:12:39.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.700+0000 7f07897fa700 1 -- 172.21.15.146:0/1065617432 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f078c128370 con 0x7f078c09a5a0 2023-10-03T10:12:39.700 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:39.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.703+0000 7f0792da6700 1 -- 172.21.15.146:0/1065617432 >> v1:172.21.15.146:6816/126749 conn(0x7f077002f510 legacy=0x7f07700319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:39.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.703+0000 7f0792da6700 1 -- 172.21.15.146:0/1065617432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f078c09a5a0 msgr2=0x7f078c1c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.703+0000 7f0792da6700 1 --2- 172.21.15.146:0/1065617432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f078c09a5a0 0x7f078c1c88e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f077800c420 tx=0x7f077800c730 comp rx=0 tx=0).stop 2023-10-03T10:12:39.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.703+0000 7f0792da6700 1 -- 172.21.15.146:0/1065617432 shutdown_connections 2023-10-03T10:12:39.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.703+0000 7f0792da6700 1 --2- 172.21.15.146:0/1065617432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f078c12d380 0x7f078c1c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.703+0000 7f0792da6700 1 --2- 172.21.15.146:0/1065617432 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f078c099a60 0x7f078c127700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.703+0000 7f0792da6700 1 --2- 172.21.15.146:0/1065617432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f078c09a5a0 0x7f078c1c88e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.703+0000 7f0792da6700 1 -- 172.21.15.146:0/1065617432 >> 172.21.15.146:0/1065617432 conn(0x7f078c0a2980 msgr2=0x7f078c124080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:39.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.703+0000 7f0792da6700 1 -- 172.21.15.146:0/1065617432 shutdown_connections 2023-10-03T10:12:39.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.703+0000 7f0792da6700 1 -- 172.21.15.146:0/1065617432 wait complete. 2023-10-03T10:12:39.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:39.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.720+0000 7f25a5a5b700 1 -- 172.21.15.146:0/2151643685 >> v1:172.21.15.146:6816/126749 conn(0x7f258402f540 legacy=0x7f25840319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:39.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.723+0000 7faac659c700 1 -- 172.21.15.146:0/1982487422 >> v1:172.21.15.146:6816/126749 conn(0x7faaa802f510 legacy=0x7faaa80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:39.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.731+0000 7f1d38a42700 1 -- 172.21.15.146:0/212897798 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1d3412d8f0 con 0x7f1d34136050 2023-10-03T10:12:39.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.731+0000 7f1d22ffd700 1 -- 172.21.15.146:0/212897798 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1d2c034090 con 0x7f1d34136050 2023-10-03T10:12:39.731 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:39.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.733+0000 7f1d3259c700 1 -- 172.21.15.146:0/212897798 >> v1:172.21.15.146:6816/126749 conn(0x7f1d1402f510 legacy=0x7f1d140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:39.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.734+0000 7f1d38a42700 1 -- 172.21.15.146:0/212897798 >> v1:172.21.15.146:6816/126749 conn(0x7f1d1402f510 legacy=0x7f1d140319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:39.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.734+0000 7f1d38a42700 1 -- 172.21.15.146:0/212897798 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d34136050 msgr2=0x7f1d341c8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.734+0000 7f1d38a42700 1 --2- 172.21.15.146:0/212897798 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d34136050 0x7f1d341c8d60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c017000 tx=0x7f1d2c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.734+0000 7f1d38a42700 1 -- 172.21.15.146:0/212897798 shutdown_connections 2023-10-03T10:12:39.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.734+0000 7f1d38a42700 1 --2- 172.21.15.146:0/212897798 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d34136050 0x7f1d341c8d60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.734+0000 7f1d38a42700 1 --2- 172.21.15.146:0/212897798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d341309f0 0x7f1d341c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.734+0000 7f1d38a42700 1 --2- 172.21.15.146:0/212897798 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d34133730 0x7f1d341c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.734+0000 7f1d38a42700 1 -- 172.21.15.146:0/212897798 >> 172.21.15.146:0/212897798 conn(0x7f1d340a2b30 msgr2=0x7f1d340a0330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:39.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.735+0000 7f1d38a42700 1 -- 172.21.15.146:0/212897798 shutdown_connections 2023-10-03T10:12:39.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.735+0000 7f1d38a42700 1 -- 172.21.15.146:0/212897798 wait complete. 2023-10-03T10:12:39.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.742+0000 7faaccf00700 1 -- 172.21.15.146:0/1982487422 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faac804f2a0 con 0x7faac8135f80 2023-10-03T10:12:39.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.742+0000 7faab6ffd700 1 -- 172.21.15.146:0/1982487422 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faac0011390 con 0x7faac8135f80 2023-10-03T10:12:39.742 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:39.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.746+0000 7faaccf00700 1 -- 172.21.15.146:0/1982487422 >> v1:172.21.15.146:6816/126749 conn(0x7faaa802f510 legacy=0x7faaa80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:39.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.746+0000 7faaccf00700 1 -- 172.21.15.146:0/1982487422 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faac8135f80 msgr2=0x7faac806ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.746+0000 7faaccf00700 1 --2- 172.21.15.146:0/1982487422 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faac8135f80 0x7faac806ea10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faac809afd0 tx=0x7faac0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.746+0000 7faaccf00700 1 -- 172.21.15.146:0/1982487422 shutdown_connections 2023-10-03T10:12:39.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.746+0000 7faaccf00700 1 --2- 172.21.15.146:0/1982487422 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faac8135f80 0x7faac806ea10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.746+0000 7faaccf00700 1 --2- 172.21.15.146:0/1982487422 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faac812d280 0x7faac806df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.746+0000 7faaccf00700 1 --2- 172.21.15.146:0/1982487422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac8133660 0x7faac806e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.746+0000 7faaccf00700 1 -- 172.21.15.146:0/1982487422 >> 172.21.15.146:0/1982487422 conn(0x7faac80a2980 msgr2=0x7faac80a0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:39.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.746+0000 7faaccf00700 1 -- 172.21.15.146:0/1982487422 shutdown_connections 2023-10-03T10:12:39.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.746+0000 7faaccf00700 1 -- 172.21.15.146:0/1982487422 wait complete. 2023-10-03T10:12:39.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.746+0000 7f25a84c0700 1 -- 172.21.15.146:0/2151643685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f25a0072980 con 0x7f25a00a0a70 2023-10-03T10:12:39.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.747+0000 7f2596ffd700 1 -- 172.21.15.146:0/2151643685 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f259c017020 con 0x7f25a00a0a70 2023-10-03T10:12:39.747 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:39.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:39.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.750+0000 7f25a84c0700 1 -- 172.21.15.146:0/2151643685 >> v1:172.21.15.146:6816/126749 conn(0x7f258402f540 legacy=0x7f25840319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.750+0000 7f25a84c0700 1 -- 172.21.15.146:0/2151643685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a00a0a70 msgr2=0x7f25a01cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.750+0000 7f25a84c0700 1 --2- 172.21.15.146:0/2151643685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a00a0a70 0x7f25a01cccc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f259c00c4e0 tx=0x7f259c00c7f0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.750+0000 7f25a84c0700 1 -- 172.21.15.146:0/2151643685 shutdown_connections 2023-10-03T10:12:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.750+0000 7f25a84c0700 1 --2- 172.21.15.146:0/2151643685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25a0139200 0x7f25a01255f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.750+0000 7f25a84c0700 1 --2- 172.21.15.146:0/2151643685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a00a0a70 0x7f25a01cccc0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.750+0000 7f25a84c0700 1 --2- 172.21.15.146:0/2151643685 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a00a1550 0x7f25a01250b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.750+0000 7f25a84c0700 1 -- 172.21.15.146:0/2151643685 >> 172.21.15.146:0/2151643685 conn(0x7f25a00a6610 msgr2=0x7f25a00a5980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.751+0000 7f25a84c0700 1 -- 172.21.15.146:0/2151643685 shutdown_connections 2023-10-03T10:12:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:39.751+0000 7f25a84c0700 1 -- 172.21.15.146:0/2151643685 wait complete. 2023-10-03T10:12:39.763 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:39.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:40.716 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:40.748 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:40.764 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:40.766 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:40.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.866+0000 7fc32a93b700 1 Processor -- start 2023-10-03T10:12:40.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.866+0000 7fc32a93b700 1 -- start start 2023-10-03T10:12:40.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.867+0000 7fc32a93b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc32409e870 0x7fc32409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.867+0000 7fc32a93b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc32409f180 0x7fc324133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.867+0000 7fc32a93b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32409fa00 con 0x7fc324134160 2023-10-03T10:12:40.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.867+0000 7fc32a93b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3240a0370 con 0x7fc32409f180 2023-10-03T10:12:40.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.867+0000 7fc32a93b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc32406bec0 con 0x7fc32409e870 2023-10-03T10:12:40.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.867+0000 7fc323fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc32409e870 0x7fc32409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.867+0000 7fc328ed8700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc324134160 0x7fc32413ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53958/0 (socket says 172.21.15.146:53958) 2023-10-03T10:12:40.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.867+0000 7fc328ed8700 1 -- 172.21.15.146:0/3682773204 learned_addr learned my addr 172.21.15.146:0/3682773204 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:40.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.867+0000 7fc3237fe700 1 --2- 172.21.15.146:0/3682773204 >> v2:172.21.15.146:3300/0 conn(0x7fc32409f180 0x7fc324133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.867+0000 7fc323fff700 1 -- 172.21.15.146:0/3682773204 >> v2:172.21.15.146:3300/0 conn(0x7fc32409f180 msgr2=0x7fc324133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:40.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.867+0000 7fc323fff700 1 --2- 172.21.15.146:0/3682773204 >> v2:172.21.15.146:3300/0 conn(0x7fc32409f180 0x7fc324133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.867+0000 7fc323fff700 1 -- 172.21.15.146:0/3682773204 >> v1:172.21.15.146:6789/0 conn(0x7fc324134160 legacy=0x7fc32413ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.867+0000 7fc322ffd700 1 -- 172.21.15.146:0/3682773204 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787367983 0 0) 0x7fc32409fa00 con 0x7fc324134160 2023-10-03T10:12:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.867+0000 7fc323fff700 1 -- 172.21.15.146:0/3682773204 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32409ada0 con 0x7fc32409e870 2023-10-03T10:12:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.867+0000 7fc3237fe700 1 --2- 172.21.15.146:0/3682773204 >> v2:172.21.15.146:3300/0 conn(0x7fc32409f180 0x7fc324133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.868+0000 7fc323fff700 1 --2- 172.21.15.146:0/3682773204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc32409e870 0x7fc32409ec40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc314009840 tx=0x7fc314009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f28a736675169a0d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.868+0000 7fc322ffd700 1 -- 172.21.15.146:0/3682773204 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314011830 con 0x7fc32409e870 2023-10-03T10:12:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.868+0000 7fc322ffd700 1 -- 172.21.15.146:0/3682773204 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc314011990 con 0x7fc32409e870 2023-10-03T10:12:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.868+0000 7fc322ffd700 1 -- 172.21.15.146:0/3682773204 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314011d20 con 0x7fc32409e870 2023-10-03T10:12:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.869+0000 7fc32a93b700 1 -- 172.21.15.146:0/3682773204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc32409e870 msgr2=0x7fc32409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.869+0000 7fc32a93b700 1 --2- 172.21.15.146:0/3682773204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc32409e870 0x7fc32409ec40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc314009840 tx=0x7fc314009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.869+0000 7fc32a93b700 1 -- 172.21.15.146:0/3682773204 shutdown_connections 2023-10-03T10:12:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.869+0000 7fc32a93b700 1 --2- 172.21.15.146:0/3682773204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc32409e870 0x7fc32409ec40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.869+0000 7fc32a93b700 1 --2- 172.21.15.146:0/3682773204 >> v2:172.21.15.146:3300/0 conn(0x7fc32409f180 0x7fc324133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.869+0000 7fc32a93b700 1 -- 172.21.15.146:0/3682773204 >> 172.21.15.146:0/3682773204 conn(0x7fc3240a4430 msgr2=0x7fc3240a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.869+0000 7fc32a93b700 1 -- 172.21.15.146:0/3682773204 shutdown_connections 2023-10-03T10:12:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.869+0000 7fc32a93b700 1 -- 172.21.15.146:0/3682773204 wait complete. 2023-10-03T10:12:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.870+0000 7fc32a93b700 1 Processor -- start 2023-10-03T10:12:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.870+0000 7fc32a93b700 1 -- start start 2023-10-03T10:12:40.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.871+0000 7fc32a93b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc32409e870 0x7fc3241228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.871+0000 7fc32a93b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc32409f180 0x7fc324122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.871+0000 7fc32a93b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc324134160 0x7fc324123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.871+0000 7fc32a93b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3241334d0 con 0x7fc32409e870 2023-10-03T10:12:40.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.871+0000 7fc32a93b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc324125ad0 con 0x7fc324134160 2023-10-03T10:12:40.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.871+0000 7fc32a93b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3241244e0 con 0x7fc32409f180 2023-10-03T10:12:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.871+0000 7fc323fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc32409e870 0x7fc3241228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.871+0000 7fc323fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc32409e870 0x7fc3241228d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44594/0 (socket says 172.21.15.146:44594) 2023-10-03T10:12:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.871+0000 7fc323fff700 1 -- 172.21.15.146:0/2341653918 learned_addr learned my addr 172.21.15.146:0/2341653918 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.871+0000 7fc328ed8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc324134160 0x7fc324123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.872+0000 7fc3237fe700 1 --2- 172.21.15.146:0/2341653918 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc32409f180 0x7fc324122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.872+0000 7fc323fff700 1 -- 172.21.15.146:0/2341653918 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc32409f180 msgr2=0x7fc324122e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.872+0000 7fc323fff700 1 --2- 172.21.15.146:0/2341653918 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc32409f180 0x7fc324122e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.872+0000 7fc323fff700 1 -- 172.21.15.146:0/2341653918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc324134160 msgr2=0x7fc324123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.872+0000 7fc323fff700 1 --2- 172.21.15.146:0/2341653918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc324134160 0x7fc324123350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.872+0000 7fc323fff700 1 -- 172.21.15.146:0/2341653918 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3180094a0 con 0x7fc32409e870 2023-10-03T10:12:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.872+0000 7fc328ed8700 1 --2- 172.21.15.146:0/2341653918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc324134160 0x7fc324123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.872+0000 7fc3237fe700 1 --2- 172.21.15.146:0/2341653918 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc32409f180 0x7fc324122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:40.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.872+0000 7fc323fff700 1 --2- 172.21.15.146:0/2341653918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc32409e870 0x7fc3241228d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc314009fd0 tx=0x7fc314004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.872+0000 7fc320ff9700 1 -- 172.21.15.146:0/2341653918 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3140036a0 con 0x7fc32409e870 2023-10-03T10:12:40.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.872+0000 7fc320ff9700 1 -- 172.21.15.146:0/2341653918 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31401f070 con 0x7fc32409e870 2023-10-03T10:12:40.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.872+0000 7fc320ff9700 1 -- 172.21.15.146:0/2341653918 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314003a20 con 0x7fc32409e870 2023-10-03T10:12:40.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.872+0000 7fc32a93b700 1 -- 172.21.15.146:0/2341653918 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3140094a0 con 0x7fc32409e870 2023-10-03T10:12:40.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.872+0000 7fc32a93b700 1 -- 172.21.15.146:0/2341653918 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc32406cfa0 con 0x7fc32409e870 2023-10-03T10:12:40.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.873+0000 7fc320ff9700 1 -- 172.21.15.146:0/2341653918 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc314003b80 con 0x7fc32409e870 2023-10-03T10:12:40.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.873+0000 7fc32a93b700 1 -- 172.21.15.146:0/2341653918 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc32404f2a0 con 0x7fc32409e870 2023-10-03T10:12:40.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.874+0000 7fc320ff9700 1 -- 172.21.15.146:0/2341653918 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fc314021070 con 0x7fc32409e870 2023-10-03T10:12:40.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.874+0000 7fc3237fe700 1 -- 172.21.15.146:0/2341653918 >> v1:172.21.15.146:6816/126749 conn(0x7fc31002f510 legacy=0x7fc3100319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:40.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.878+0000 7fc320ff9700 1 -- 172.21.15.146:0/2341653918 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc314003e30 con 0x7fc32409e870 2023-10-03T10:12:40.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.906+0000 7eff47c48700 1 Processor -- start 2023-10-03T10:12:40.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.907+0000 7eff47c48700 1 -- start start 2023-10-03T10:12:40.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.907+0000 7eff47c48700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7eff4012cc80 0x7eff4012d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.907+0000 7eff47c48700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff4012fc00 0x7eff40130030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.908+0000 7eff47c48700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4009b520 con 0x7eff40130570 2023-10-03T10:12:40.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.908+0000 7eff47c48700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff4009b8e0 con 0x7eff4012cc80 2023-10-03T10:12:40.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.908+0000 7eff47c48700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff4009c430 con 0x7eff4012fc00 2023-10-03T10:12:40.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.908+0000 7eff461e5700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7eff40130570 0x7eff40136f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53972/0 (socket says 172.21.15.146:53972) 2023-10-03T10:12:40.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.908+0000 7eff461e5700 1 -- 172.21.15.146:0/3621401495 learned_addr learned my addr 172.21.15.146:0/3621401495 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:40.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.908+0000 7eff459e4700 1 --2- 172.21.15.146:0/3621401495 >> v2:172.21.15.146:3300/0 conn(0x7eff4012cc80 0x7eff4012d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.908+0000 7eff451e3700 1 --2- 172.21.15.146:0/3621401495 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff4012fc00 0x7eff40130030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.908+0000 7eff451e3700 1 -- 172.21.15.146:0/3621401495 >> v2:172.21.15.146:3300/0 conn(0x7eff4012cc80 msgr2=0x7eff4012d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:40.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.908+0000 7eff451e3700 1 --2- 172.21.15.146:0/3621401495 >> v2:172.21.15.146:3300/0 conn(0x7eff4012cc80 0x7eff4012d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.908+0000 7eff451e3700 1 -- 172.21.15.146:0/3621401495 >> v1:172.21.15.146:6789/0 conn(0x7eff40130570 legacy=0x7eff40136f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.908+0000 7eff451e3700 1 -- 172.21.15.146:0/3621401495 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4012ca60 con 0x7eff4012fc00 2023-10-03T10:12:40.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.908+0000 7eff459e4700 1 --2- 172.21.15.146:0/3621401495 >> v2:172.21.15.146:3300/0 conn(0x7eff4012cc80 0x7eff4012d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:40.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.908+0000 7eff451e3700 1 --2- 172.21.15.146:0/3621401495 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff4012fc00 0x7eff40130030 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7eff30009840 tx=0x7eff30009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7a3b8b55cdb0e86 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.909+0000 7eff449e2700 1 -- 172.21.15.146:0/3621401495 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff30011830 con 0x7eff4012fc00 2023-10-03T10:12:40.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.909+0000 7eff449e2700 1 -- 172.21.15.146:0/3621401495 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff30011990 con 0x7eff4012fc00 2023-10-03T10:12:40.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.909+0000 7eff449e2700 1 -- 172.21.15.146:0/3621401495 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff30011d20 con 0x7eff4012fc00 2023-10-03T10:12:40.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.909+0000 7eff47c48700 1 -- 172.21.15.146:0/3621401495 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff4012fc00 msgr2=0x7eff40130030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.909+0000 7eff47c48700 1 --2- 172.21.15.146:0/3621401495 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff4012fc00 0x7eff40130030 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7eff30009840 tx=0x7eff30009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:40.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.909+0000 7eff47c48700 1 -- 172.21.15.146:0/3621401495 shutdown_connections 2023-10-03T10:12:40.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.909+0000 7eff47c48700 1 --2- 172.21.15.146:0/3621401495 >> v2:172.21.15.146:3300/0 conn(0x7eff4012cc80 0x7eff4012d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.909+0000 7eff47c48700 1 --2- 172.21.15.146:0/3621401495 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff4012fc00 0x7eff40130030 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.909+0000 7eff47c48700 1 -- 172.21.15.146:0/3621401495 >> 172.21.15.146:0/3621401495 conn(0x7eff400a2eb0 msgr2=0x7eff4009eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:40.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.910+0000 7eff47c48700 1 -- 172.21.15.146:0/3621401495 shutdown_connections 2023-10-03T10:12:40.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.910+0000 7eff47c48700 1 -- 172.21.15.146:0/3621401495 wait complete. 2023-10-03T10:12:40.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.911+0000 7eff47c48700 1 Processor -- start 2023-10-03T10:12:40.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.911+0000 7eff47c48700 1 -- start start 2023-10-03T10:12:40.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.911+0000 7eff47c48700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff4012cc80 0x7eff4006ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.911+0000 7eff47c48700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff4012fc00 0x7eff4006f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.911+0000 7eff47c48700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff40130570 0x7eff4006f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.911+0000 7eff47c48700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff40070f20 con 0x7eff4012cc80 2023-10-03T10:12:40.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.911+0000 7eff47c48700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff40070090 con 0x7eff4012fc00 2023-10-03T10:12:40.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.911+0000 7eff47c48700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff40071a00 con 0x7eff40130570 2023-10-03T10:12:40.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.911+0000 7eff459e4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff4012cc80 0x7eff4006ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.911+0000 7eff461e5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff40130570 0x7eff4006f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.911+0000 7eff459e4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff4012cc80 0x7eff4006ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44616/0 (socket says 172.21.15.146:44616) 2023-10-03T10:12:40.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.911+0000 7eff461e5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff40130570 0x7eff4006f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43104/0 (socket says 172.21.15.146:43104) 2023-10-03T10:12:40.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.911+0000 7eff459e4700 1 -- 172.21.15.146:0/724485524 learned_addr learned my addr 172.21.15.146:0/724485524 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:40.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.911+0000 7eff451e3700 1 --2- 172.21.15.146:0/724485524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff4012fc00 0x7eff4006f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.912+0000 7eff461e5700 1 -- 172.21.15.146:0/724485524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff4012fc00 msgr2=0x7eff4006f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.912+0000 7eff461e5700 1 --2- 172.21.15.146:0/724485524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff4012fc00 0x7eff4006f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.912+0000 7eff461e5700 1 -- 172.21.15.146:0/724485524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff4012cc80 msgr2=0x7eff4006ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.912+0000 7eff461e5700 1 --2- 172.21.15.146:0/724485524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff4012cc80 0x7eff4006ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.912+0000 7eff461e5700 1 -- 172.21.15.146:0/724485524 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c0094a0 con 0x7eff40130570 2023-10-03T10:12:40.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.912+0000 7eff461e5700 1 --2- 172.21.15.146:0/724485524 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff40130570 0x7eff4006f740 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7eff38002220 tx=0x7eff3800cdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.912+0000 7eff459e4700 1 --2- 172.21.15.146:0/724485524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff4012cc80 0x7eff4006ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:40.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.912+0000 7eff367fc700 1 -- 172.21.15.146:0/724485524 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3800a9a0 con 0x7eff40130570 2023-10-03T10:12:40.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.912+0000 7eff367fc700 1 -- 172.21.15.146:0/724485524 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3800ab00 con 0x7eff40130570 2023-10-03T10:12:40.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.912+0000 7eff47c48700 1 -- 172.21.15.146:0/724485524 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff300094a0 con 0x7eff40130570 2023-10-03T10:12:40.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.912+0000 7eff367fc700 1 -- 172.21.15.146:0/724485524 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3800ae70 con 0x7eff40130570 2023-10-03T10:12:40.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.912+0000 7eff47c48700 1 -- 172.21.15.146:0/724485524 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff40070890 con 0x7eff40130570 2023-10-03T10:12:40.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.913+0000 7eff367fc700 1 -- 172.21.15.146:0/724485524 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7eff38017070 con 0x7eff40130570 2023-10-03T10:12:40.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.913+0000 7eff367fc700 1 -- 172.21.15.146:0/724485524 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7eff38043a40 con 0x7eff40130570 2023-10-03T10:12:40.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.913+0000 7eff459e4700 1 -- 172.21.15.146:0/724485524 >> v1:172.21.15.146:6816/126749 conn(0x7eff2402f510 legacy=0x7eff240319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:40.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.913+0000 7eff47c48700 1 -- 172.21.15.146:0/724485524 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff40071fe0 con 0x7eff40130570 2023-10-03T10:12:40.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.922+0000 7eff367fc700 1 -- 172.21.15.146:0/724485524 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7eff3801f020 con 0x7eff40130570 2023-10-03T10:12:40.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.941+0000 7f32703af700 1 Processor -- start 2023-10-03T10:12:40.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.941+0000 7f32703af700 1 -- start start 2023-10-03T10:12:40.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.942+0000 7f32703af700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f326809e870 0x7f326809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.942+0000 7f32703af700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f326809f180 0x7f3268133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.942+0000 7f32703af700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f326809fa00 con 0x7f3268134160 2023-10-03T10:12:40.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.942+0000 7f32703af700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32680a0370 con 0x7f326809e870 2023-10-03T10:12:40.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.942+0000 7f32703af700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f326806bec0 con 0x7f326809f180 2023-10-03T10:12:40.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.942+0000 7f326e94c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3268134160 0x7f326813ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53978/0 (socket says 172.21.15.146:53978) 2023-10-03T10:12:40.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.942+0000 7f326e94c700 1 -- 172.21.15.146:0/1039186466 learned_addr learned my addr 172.21.15.146:0/1039186466 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:40.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.942+0000 7f326e14b700 1 --2- 172.21.15.146:0/1039186466 >> v2:172.21.15.146:3300/0 conn(0x7f326809e870 0x7f326809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.942+0000 7f326d94a700 1 --2- 172.21.15.146:0/1039186466 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f326809f180 0x7f3268133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.942+0000 7f326d94a700 1 -- 172.21.15.146:0/1039186466 >> v2:172.21.15.146:3300/0 conn(0x7f326809e870 msgr2=0x7f326809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:40.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.942+0000 7f326d94a700 1 --2- 172.21.15.146:0/1039186466 >> v2:172.21.15.146:3300/0 conn(0x7f326809e870 0x7f326809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.942+0000 7f326d94a700 1 -- 172.21.15.146:0/1039186466 >> v1:172.21.15.146:6789/0 conn(0x7f3268134160 legacy=0x7f326813ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.942+0000 7f326d149700 1 -- 172.21.15.146:0/1039186466 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 696608439 0 0) 0x7f326809fa00 con 0x7f3268134160 2023-10-03T10:12:40.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.942+0000 7f326d94a700 1 -- 172.21.15.146:0/1039186466 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326809ada0 con 0x7f326809f180 2023-10-03T10:12:40.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.942+0000 7f326e14b700 1 --2- 172.21.15.146:0/1039186466 >> v2:172.21.15.146:3300/0 conn(0x7f326809e870 0x7f326809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:40.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.942+0000 7f326d94a700 1 --2- 172.21.15.146:0/1039186466 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f326809f180 0x7f3268133c20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3258009840 tx=0x7f3258009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9afa482ddf4ad1cf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.943+0000 7f326d149700 1 -- 172.21.15.146:0/1039186466 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258011830 con 0x7f326809f180 2023-10-03T10:12:40.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.943+0000 7f326d149700 1 -- 172.21.15.146:0/1039186466 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3258011990 con 0x7f326809f180 2023-10-03T10:12:40.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.943+0000 7f326d149700 1 -- 172.21.15.146:0/1039186466 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258011d20 con 0x7f326809f180 2023-10-03T10:12:40.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.943+0000 7f32703af700 1 -- 172.21.15.146:0/1039186466 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f326809f180 msgr2=0x7f3268133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.943+0000 7f32703af700 1 --2- 172.21.15.146:0/1039186466 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f326809f180 0x7f3268133c20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3258009840 tx=0x7f3258009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:40.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.943+0000 7f32703af700 1 -- 172.21.15.146:0/1039186466 shutdown_connections 2023-10-03T10:12:40.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.943+0000 7f32703af700 1 --2- 172.21.15.146:0/1039186466 >> v2:172.21.15.146:3300/0 conn(0x7f326809e870 0x7f326809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.943+0000 7f32703af700 1 --2- 172.21.15.146:0/1039186466 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f326809f180 0x7f3268133c20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.943+0000 7f32703af700 1 -- 172.21.15.146:0/1039186466 >> 172.21.15.146:0/1039186466 conn(0x7f32680a4430 msgr2=0x7f32680a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:40.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.943+0000 7f32703af700 1 -- 172.21.15.146:0/1039186466 shutdown_connections 2023-10-03T10:12:40.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.944+0000 7f32703af700 1 -- 172.21.15.146:0/1039186466 wait complete. 2023-10-03T10:12:40.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.944+0000 7f32703af700 1 Processor -- start 2023-10-03T10:12:40.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.944+0000 7f32703af700 1 -- start start 2023-10-03T10:12:40.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.945+0000 7f32703af700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f326809e870 0x7f32681cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.945+0000 7f32703af700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f326809f180 0x7f32681cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.945+0000 7f32703af700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3268134160 0x7f32681ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.945+0000 7f32703af700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32681272e0 con 0x7f326809e870 2023-10-03T10:12:40.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.945+0000 7f32703af700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f326806d010 con 0x7f326809f180 2023-10-03T10:12:40.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.945+0000 7f32703af700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3268128760 con 0x7f3268134160 2023-10-03T10:12:40.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.945+0000 7f326e14b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f326809e870 0x7f32681cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.945+0000 7f326e14b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f326809e870 0x7f32681cc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44632/0 (socket says 172.21.15.146:44632) 2023-10-03T10:12:40.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.945+0000 7f326e14b700 1 -- 172.21.15.146:0/2043196049 learned_addr learned my addr 172.21.15.146:0/2043196049 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:40.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.945+0000 7f326d94a700 1 --2- 172.21.15.146:0/2043196049 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f326809f180 0x7f32681cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.945+0000 7f326e14b700 1 -- 172.21.15.146:0/2043196049 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3268134160 msgr2=0x7f32681ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.945+0000 7f326e14b700 1 --2- 172.21.15.146:0/2043196049 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3268134160 0x7f32681ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.945+0000 7f326e14b700 1 -- 172.21.15.146:0/2043196049 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f326809f180 msgr2=0x7f32681cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.945+0000 7f326e14b700 1 --2- 172.21.15.146:0/2043196049 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f326809f180 0x7f32681cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.945+0000 7f326e14b700 1 -- 172.21.15.146:0/2043196049 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32640094a0 con 0x7f326809e870 2023-10-03T10:12:40.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.946+0000 7f326e14b700 1 --2- 172.21.15.146:0/2043196049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f326809e870 0x7f32681cc550 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f326400ebe0 tx=0x7f326400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.946+0000 7f325effd700 1 -- 172.21.15.146:0/2043196049 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3264009800 con 0x7f326809e870 2023-10-03T10:12:40.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.946+0000 7f325effd700 1 -- 172.21.15.146:0/2043196049 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326400c910 con 0x7f326809e870 2023-10-03T10:12:40.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.946+0000 7f325effd700 1 -- 172.21.15.146:0/2043196049 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326400cc80 con 0x7f326809e870 2023-10-03T10:12:40.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.946+0000 7f32703af700 1 -- 172.21.15.146:0/2043196049 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32580094a0 con 0x7f326809e870 2023-10-03T10:12:40.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.946+0000 7f32703af700 1 -- 172.21.15.146:0/2043196049 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32680a1770 con 0x7f326809e870 2023-10-03T10:12:40.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.947+0000 7f325effd700 1 -- 172.21.15.146:0/2043196049 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3264013470 con 0x7f326809e870 2023-10-03T10:12:40.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.947+0000 7f32703af700 1 -- 172.21.15.146:0/2043196049 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f326804f2a0 con 0x7f326809e870 2023-10-03T10:12:40.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.947+0000 7f325effd700 1 -- 172.21.15.146:0/2043196049 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f3264040140 con 0x7f326809e870 2023-10-03T10:12:40.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.951+0000 7f326d94a700 1 -- 172.21.15.146:0/2043196049 >> v1:172.21.15.146:6816/126749 conn(0x7f324c02f510 legacy=0x7f324c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:40.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.952+0000 7f325effd700 1 -- 172.21.15.146:0/2043196049 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f326401b3b0 con 0x7f326809e870 2023-10-03T10:12:40.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.955+0000 7f1d7d6b4700 1 Processor -- start 2023-10-03T10:12:40.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.956+0000 7f1d7d6b4700 1 -- start start 2023-10-03T10:12:40.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.956+0000 7f1d7d6b4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d7812d280 0x7f1d7812d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.956+0000 7f1d7d6b4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d78130eb0 0x7f1d78138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.956+0000 7f1d7d6b4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7809ae40 con 0x7f1d78130350 2023-10-03T10:12:40.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.956+0000 7f1d7d6b4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7809b9a0 con 0x7f1d78130eb0 2023-10-03T10:12:40.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.956+0000 7f1d7d6b4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7809bbb0 con 0x7f1d7812d280 2023-10-03T10:12:40.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.957+0000 7f1d76ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d7812d280 0x7f1d7812d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.957+0000 7f1d767fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1d78130350 0x7f1d781307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53982/0 (socket says 172.21.15.146:53982) 2023-10-03T10:12:40.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.957+0000 7f1d767fc700 1 -- 172.21.15.146:0/2436185139 learned_addr learned my addr 172.21.15.146:0/2436185139 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:40.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.957+0000 7f1d777fe700 1 --2- 172.21.15.146:0/2436185139 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d78130eb0 0x7f1d78138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.957+0000 7f1d75ffb700 1 -- 172.21.15.146:0/2436185139 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1726629731 0 0) 0x7f1d7809ae40 con 0x7f1d78130350 2023-10-03T10:12:40.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.957+0000 7f1d75ffb700 1 -- 172.21.15.146:0/2436185139 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d600035b0 con 0x7f1d78130350 2023-10-03T10:12:40.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.957+0000 7f1d76ffd700 1 -- 172.21.15.146:0/2436185139 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d78130eb0 msgr2=0x7f1d78138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:40.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.957+0000 7f1d76ffd700 1 --2- 172.21.15.146:0/2436185139 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d78130eb0 0x7f1d78138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.957+0000 7f1d76ffd700 1 -- 172.21.15.146:0/2436185139 >> v1:172.21.15.146:6789/0 conn(0x7f1d78130350 legacy=0x7f1d781307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.957+0000 7f1d76ffd700 1 -- 172.21.15.146:0/2436185139 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7809b250 con 0x7f1d7812d280 2023-10-03T10:12:40.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.957+0000 7f1d76ffd700 1 --2- 172.21.15.146:0/2436185139 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d7812d280 0x7f1d7812d650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1d68009850 tx=0x7f1d68009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddff5d7ed8ac77ea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.957+0000 7f1d75ffb700 1 -- 172.21.15.146:0/2436185139 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d68005e30 con 0x7f1d7812d280 2023-10-03T10:12:40.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.958+0000 7f1d75ffb700 1 -- 172.21.15.146:0/2436185139 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d68006030 con 0x7f1d7812d280 2023-10-03T10:12:40.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.958+0000 7f1d75ffb700 1 -- 172.21.15.146:0/2436185139 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d680063c0 con 0x7f1d7812d280 2023-10-03T10:12:40.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.958+0000 7f1d7d6b4700 1 -- 172.21.15.146:0/2436185139 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d7812d280 msgr2=0x7f1d7812d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.958+0000 7f1d7d6b4700 1 --2- 172.21.15.146:0/2436185139 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d7812d280 0x7f1d7812d650 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1d68009850 tx=0x7f1d68009b60 comp rx=0 tx=0).stop 2023-10-03T10:12:40.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.958+0000 7f1d7d6b4700 1 -- 172.21.15.146:0/2436185139 shutdown_connections 2023-10-03T10:12:40.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.958+0000 7f1d7d6b4700 1 --2- 172.21.15.146:0/2436185139 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d78130eb0 0x7f1d78138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.958+0000 7f1d7d6b4700 1 --2- 172.21.15.146:0/2436185139 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d7812d280 0x7f1d7812d650 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.958+0000 7f1d7d6b4700 1 -- 172.21.15.146:0/2436185139 >> 172.21.15.146:0/2436185139 conn(0x7f1d780a2980 msgr2=0x7f1d780a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:40.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.959+0000 7f1d7d6b4700 1 -- 172.21.15.146:0/2436185139 shutdown_connections 2023-10-03T10:12:40.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.959+0000 7f1d7d6b4700 1 -- 172.21.15.146:0/2436185139 wait complete. 2023-10-03T10:12:40.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.960+0000 7f1d7d6b4700 1 Processor -- start 2023-10-03T10:12:40.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.960+0000 7f1d7d6b4700 1 -- start start 2023-10-03T10:12:40.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.960+0000 7f1d7d6b4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d7812d280 0x7f1d7812a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.960+0000 7f1d7d6b4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d78130350 0x7f1d7812a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.960+0000 7f1d7d6b4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d78130eb0 0x7f1d7812abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.960+0000 7f1d7d6b4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7812c850 con 0x7f1d78130350 2023-10-03T10:12:40.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.960+0000 7f1d7d6b4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d781bfec0 con 0x7f1d78130eb0 2023-10-03T10:12:40.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.960+0000 7f1d7d6b4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7812eb40 con 0x7f1d7812d280 2023-10-03T10:12:40.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.961+0000 7f1d767fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d78130350 0x7f1d7812a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.961+0000 7f1d767fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d78130350 0x7f1d7812a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44642/0 (socket says 172.21.15.146:44642) 2023-10-03T10:12:40.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.961+0000 7f1d767fc700 1 -- 172.21.15.146:0/3257033972 learned_addr learned my addr 172.21.15.146:0/3257033972 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:40.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.961+0000 7f1d777fe700 1 --2- 172.21.15.146:0/3257033972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d78130eb0 0x7f1d7812abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.961+0000 7f1d76ffd700 1 --2- 172.21.15.146:0/3257033972 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d7812d280 0x7f1d7812a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.961+0000 7f1d767fc700 1 -- 172.21.15.146:0/3257033972 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d7812d280 msgr2=0x7f1d7812a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.961+0000 7f1d767fc700 1 --2- 172.21.15.146:0/3257033972 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d7812d280 0x7f1d7812a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.961+0000 7f1d767fc700 1 -- 172.21.15.146:0/3257033972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d78130eb0 msgr2=0x7f1d7812abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.961+0000 7f1d767fc700 1 --2- 172.21.15.146:0/3257033972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d78130eb0 0x7f1d7812abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.961+0000 7f1d767fc700 1 -- 172.21.15.146:0/3257033972 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d68009430 con 0x7f1d78130350 2023-10-03T10:12:40.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.961+0000 7f1d767fc700 1 --2- 172.21.15.146:0/3257033972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d78130350 0x7f1d7812a690 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c005910 tx=0x7f1d6c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.961+0000 7f1d5f7fe700 1 -- 172.21.15.146:0/3257033972 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c005d70 con 0x7f1d78130350 2023-10-03T10:12:40.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.961+0000 7f1d5f7fe700 1 -- 172.21.15.146:0/3257033972 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c0070d0 con 0x7f1d78130350 2023-10-03T10:12:40.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.961+0000 7f1d7d6b4700 1 -- 172.21.15.146:0/3257033972 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d781c7a00 con 0x7f1d78130350 2023-10-03T10:12:40.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.962+0000 7f1d7d6b4700 1 -- 172.21.15.146:0/3257033972 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d781c0930 con 0x7f1d78130350 2023-10-03T10:12:40.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.962+0000 7f1d5f7fe700 1 -- 172.21.15.146:0/3257033972 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c007440 con 0x7f1d78130350 2023-10-03T10:12:40.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.963+0000 7f1d5f7fe700 1 -- 172.21.15.146:0/3257033972 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1d6c0075a0 con 0x7f1d78130350 2023-10-03T10:12:40.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.963+0000 7f1d7d6b4700 1 -- 172.21.15.146:0/3257033972 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d580052e0 con 0x7f1d78130350 2023-10-03T10:12:40.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.963+0000 7f1d5f7fe700 1 -- 172.21.15.146:0/3257033972 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f1d6c03f130 con 0x7f1d78130350 2023-10-03T10:12:40.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.963+0000 7f1d76ffd700 1 -- 172.21.15.146:0/3257033972 >> v1:172.21.15.146:6816/126749 conn(0x7f1d6402f510 legacy=0x7f1d640319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:40.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:40.969+0000 7f1d5f7fe700 1 -- 172.21.15.146:0/3257033972 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d6c011d70 con 0x7f1d78130350 2023-10-03T10:12:41.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.075+0000 7fc3237fe700 1 -- 172.21.15.146:0/2341653918 >> v1:172.21.15.146:6816/126749 conn(0x7fc31002f510 legacy=0x7fc3100319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:41.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.086+0000 7fc32a93b700 1 -- 172.21.15.146:0/2341653918 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc32406c9d0 con 0x7fc32409e870 2023-10-03T10:12:41.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.086+0000 7fc320ff9700 1 -- 172.21.15.146:0/2341653918 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc314015020 con 0x7fc32409e870 2023-10-03T10:12:41.086 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:41.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.088+0000 7fc32a93b700 1 -- 172.21.15.146:0/2341653918 >> v1:172.21.15.146:6816/126749 conn(0x7fc31002f510 legacy=0x7fc3100319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:41.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.088+0000 7fc32a93b700 1 -- 172.21.15.146:0/2341653918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc32409e870 msgr2=0x7fc3241228d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.088+0000 7fc32a93b700 1 --2- 172.21.15.146:0/2341653918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc32409e870 0x7fc3241228d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc314009fd0 tx=0x7fc314004750 comp rx=0 tx=0).stop 2023-10-03T10:12:41.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.088+0000 7fc32a93b700 1 -- 172.21.15.146:0/2341653918 shutdown_connections 2023-10-03T10:12:41.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.088+0000 7fc32a93b700 1 --2- 172.21.15.146:0/2341653918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc324134160 0x7fc324123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.088+0000 7fc32a93b700 1 --2- 172.21.15.146:0/2341653918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc32409e870 0x7fc3241228d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.088+0000 7fc32a93b700 1 --2- 172.21.15.146:0/2341653918 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc32409f180 0x7fc324122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.088+0000 7fc32a93b700 1 -- 172.21.15.146:0/2341653918 >> 172.21.15.146:0/2341653918 conn(0x7fc3240a4430 msgr2=0x7fc324070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:41.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.089+0000 7fc32a93b700 1 -- 172.21.15.146:0/2341653918 shutdown_connections 2023-10-03T10:12:41.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.089+0000 7fc32a93b700 1 -- 172.21.15.146:0/2341653918 wait complete. 2023-10-03T10:12:41.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:41.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.114+0000 7eff459e4700 1 -- 172.21.15.146:0/724485524 >> v1:172.21.15.146:6816/126749 conn(0x7eff2402f510 legacy=0x7eff240319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:41.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.146+0000 7eff47c48700 1 -- 172.21.15.146:0/724485524 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7eff4004f2a0 con 0x7eff40130570 2023-10-03T10:12:41.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.146+0000 7eff367fc700 1 -- 172.21.15.146:0/724485524 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7eff38028070 con 0x7eff40130570 2023-10-03T10:12:41.146 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:41.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.149+0000 7eff47c48700 1 -- 172.21.15.146:0/724485524 >> v1:172.21.15.146:6816/126749 conn(0x7eff2402f510 legacy=0x7eff240319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:41.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.149+0000 7eff47c48700 1 -- 172.21.15.146:0/724485524 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff40130570 msgr2=0x7eff4006f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.149+0000 7eff47c48700 1 --2- 172.21.15.146:0/724485524 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff40130570 0x7eff4006f740 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7eff38002220 tx=0x7eff3800cdb0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.149+0000 7eff47c48700 1 -- 172.21.15.146:0/724485524 shutdown_connections 2023-10-03T10:12:41.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.149+0000 7eff47c48700 1 --2- 172.21.15.146:0/724485524 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff40130570 0x7eff4006f740 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.149+0000 7eff47c48700 1 --2- 172.21.15.146:0/724485524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff4012cc80 0x7eff4006ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.149+0000 7eff47c48700 1 --2- 172.21.15.146:0/724485524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff4012fc00 0x7eff4006f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.149+0000 7eff47c48700 1 -- 172.21.15.146:0/724485524 >> 172.21.15.146:0/724485524 conn(0x7eff400a2eb0 msgr2=0x7eff4012a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:41.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.149+0000 7eff47c48700 1 -- 172.21.15.146:0/724485524 shutdown_connections 2023-10-03T10:12:41.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.149+0000 7eff47c48700 1 -- 172.21.15.146:0/724485524 wait complete. 2023-10-03T10:12:41.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.152+0000 7f326d94a700 1 -- 172.21.15.146:0/2043196049 >> v1:172.21.15.146:6816/126749 conn(0x7f324c02f510 legacy=0x7f324c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:41.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.153+0000 7f32703af700 1 -- 172.21.15.146:0/2043196049 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f326806c9d0 con 0x7f326809e870 2023-10-03T10:12:41.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.154+0000 7f325effd700 1 -- 172.21.15.146:0/2043196049 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f326401b3b0 con 0x7f326809e870 2023-10-03T10:12:41.153 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:41.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.156+0000 7f32703af700 1 -- 172.21.15.146:0/2043196049 >> v1:172.21.15.146:6816/126749 conn(0x7f324c02f510 legacy=0x7f324c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:41.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.156+0000 7f32703af700 1 -- 172.21.15.146:0/2043196049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f326809e870 msgr2=0x7f32681cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.156+0000 7f32703af700 1 --2- 172.21.15.146:0/2043196049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f326809e870 0x7f32681cc550 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f326400ebe0 tx=0x7f326400eef0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.156+0000 7f32703af700 1 -- 172.21.15.146:0/2043196049 shutdown_connections 2023-10-03T10:12:41.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.156+0000 7f32703af700 1 --2- 172.21.15.146:0/2043196049 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3268134160 0x7f32681ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.156+0000 7f32703af700 1 --2- 172.21.15.146:0/2043196049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f326809e870 0x7f32681cc550 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.156+0000 7f32703af700 1 --2- 172.21.15.146:0/2043196049 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f326809f180 0x7f32681cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.156+0000 7f32703af700 1 -- 172.21.15.146:0/2043196049 >> 172.21.15.146:0/2043196049 conn(0x7f32680a4430 msgr2=0x7f3268071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:41.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.156+0000 7f32703af700 1 -- 172.21.15.146:0/2043196049 shutdown_connections 2023-10-03T10:12:41.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.156+0000 7f32703af700 1 -- 172.21.15.146:0/2043196049 wait complete. 2023-10-03T10:12:41.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:41.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.164+0000 7f1d76ffd700 1 -- 172.21.15.146:0/3257033972 >> v1:172.21.15.146:6816/126749 conn(0x7f1d6402f510 legacy=0x7f1d640319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:41.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:41.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.179+0000 7f1d7d6b4700 1 -- 172.21.15.146:0/3257033972 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1d58005860 con 0x7f1d78130350 2023-10-03T10:12:41.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.179+0000 7f1d5f7fe700 1 -- 172.21.15.146:0/3257033972 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d6c017030 con 0x7f1d78130350 2023-10-03T10:12:41.179 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:41.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.181+0000 7f1d7d6b4700 1 -- 172.21.15.146:0/3257033972 >> v1:172.21.15.146:6816/126749 conn(0x7f1d6402f510 legacy=0x7f1d640319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:41.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.181+0000 7f1d7d6b4700 1 -- 172.21.15.146:0/3257033972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d78130350 msgr2=0x7f1d7812a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:41.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.181+0000 7f1d7d6b4700 1 --2- 172.21.15.146:0/3257033972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d78130350 0x7f1d7812a690 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c005910 tx=0x7f1d6c00c9e0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.181+0000 7f1d7d6b4700 1 -- 172.21.15.146:0/3257033972 shutdown_connections 2023-10-03T10:12:41.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.181+0000 7f1d7d6b4700 1 --2- 172.21.15.146:0/3257033972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d78130eb0 0x7f1d7812abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.181+0000 7f1d7d6b4700 1 --2- 172.21.15.146:0/3257033972 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d7812d280 0x7f1d7812a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.181+0000 7f1d7d6b4700 1 --2- 172.21.15.146:0/3257033972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d78130350 0x7f1d7812a690 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.181+0000 7f1d7d6b4700 1 -- 172.21.15.146:0/3257033972 >> 172.21.15.146:0/3257033972 conn(0x7f1d780a2980 msgr2=0x7f1d7809d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:41.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.181+0000 7f1d7d6b4700 1 -- 172.21.15.146:0/3257033972 shutdown_connections 2023-10-03T10:12:41.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:41.182+0000 7f1d7d6b4700 1 -- 172.21.15.146:0/3257033972 wait complete. 2023-10-03T10:12:41.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:42.102 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:42.162 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:42.168 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:42.194 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:42.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.242+0000 7fa06efd6700 1 Processor -- start 2023-10-03T10:12:42.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.242+0000 7fa06efd6700 1 -- start start 2023-10-03T10:12:42.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.243+0000 7fa06efd6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa06809d860 0x7fa06809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.243+0000 7fa06efd6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa06809e170 0x7fa0681307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.243+0000 7fa06efd6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa068130ce0 0x7fa068131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.243+0000 7fa06efd6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa06809aaa0 con 0x7fa068130ce0 2023-10-03T10:12:42.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.243+0000 7fa06efd6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06809f870 con 0x7fa06809e170 2023-10-03T10:12:42.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.243+0000 7fa06efd6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa06809b360 con 0x7fa06809d860 2023-10-03T10:12:42.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.243+0000 7fa06cd72700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa06809d860 0x7fa06809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.243+0000 7fa06cd72700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa06809d860 0x7fa06809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43148/0 (socket says 172.21.15.146:43148) 2023-10-03T10:12:42.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.243+0000 7fa06cd72700 1 -- 172.21.15.146:0/1998872512 learned_addr learned my addr 172.21.15.146:0/1998872512 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:42.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.243+0000 7fa06d573700 1 --2- 172.21.15.146:0/1998872512 >> v2:172.21.15.146:3300/0 conn(0x7fa068130ce0 0x7fa068131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.243+0000 7fa067fff700 1 --2- 172.21.15.146:0/1998872512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa06809e170 0x7fa0681307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.243+0000 7fa06cd72700 1 -- 172.21.15.146:0/1998872512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa06809e170 msgr2=0x7fa0681307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:42.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.243+0000 7fa06cd72700 1 --2- 172.21.15.146:0/1998872512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa06809e170 0x7fa0681307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.243+0000 7fa06cd72700 1 -- 172.21.15.146:0/1998872512 >> v2:172.21.15.146:3300/0 conn(0x7fa068130ce0 msgr2=0x7fa068131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:42.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.243+0000 7fa06cd72700 1 --2- 172.21.15.146:0/1998872512 >> v2:172.21.15.146:3300/0 conn(0x7fa068130ce0 0x7fa068131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.243+0000 7fa06cd72700 1 -- 172.21.15.146:0/1998872512 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06809b620 con 0x7fa06809d860 2023-10-03T10:12:42.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.244+0000 7fa06cd72700 1 --2- 172.21.15.146:0/1998872512 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa06809d860 0x7fa06809dc30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0098f0 tx=0x7fa05c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c034e02e9e1cce8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:42.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.244+0000 7fa0677fe700 1 -- 172.21.15.146:0/1998872512 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c00b8a0 con 0x7fa06809d860 2023-10-03T10:12:42.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.244+0000 7fa0677fe700 1 -- 172.21.15.146:0/1998872512 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05c00ba00 con 0x7fa06809d860 2023-10-03T10:12:42.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.244+0000 7fa0677fe700 1 -- 172.21.15.146:0/1998872512 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c00bd90 con 0x7fa06809d860 2023-10-03T10:12:42.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.245+0000 7fa06efd6700 1 -- 172.21.15.146:0/1998872512 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa06809d860 msgr2=0x7fa06809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.245+0000 7fa06efd6700 1 --2- 172.21.15.146:0/1998872512 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa06809d860 0x7fa06809dc30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0098f0 tx=0x7fa05c009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:42.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.245+0000 7fa06efd6700 1 -- 172.21.15.146:0/1998872512 shutdown_connections 2023-10-03T10:12:42.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.245+0000 7fa06efd6700 1 --2- 172.21.15.146:0/1998872512 >> v2:172.21.15.146:3300/0 conn(0x7fa068130ce0 0x7fa068131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.245+0000 7fa06efd6700 1 --2- 172.21.15.146:0/1998872512 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa06809d860 0x7fa06809dc30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.245+0000 7fa06efd6700 1 --2- 172.21.15.146:0/1998872512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa06809e170 0x7fa0681307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.245+0000 7fa06efd6700 1 -- 172.21.15.146:0/1998872512 >> 172.21.15.146:0/1998872512 conn(0x7fa068099c40 msgr2=0x7fa0680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:42.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.245+0000 7fa06efd6700 1 -- 172.21.15.146:0/1998872512 shutdown_connections 2023-10-03T10:12:42.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.245+0000 7fa06efd6700 1 -- 172.21.15.146:0/1998872512 wait complete. 2023-10-03T10:12:42.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.246+0000 7fa06efd6700 1 Processor -- start 2023-10-03T10:12:42.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.246+0000 7fa06efd6700 1 -- start start 2023-10-03T10:12:42.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.247+0000 7fa06efd6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa06809d860 0x7fa06811f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.247+0000 7fa06efd6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa06809e170 0x7fa06811f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.247+0000 7fa06efd6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa068130ce0 0x7fa06811fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.247+0000 7fa06efd6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa068122ba0 con 0x7fa068130ce0 2023-10-03T10:12:42.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.247+0000 7fa06efd6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa068120570 con 0x7fa06809d860 2023-10-03T10:12:42.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.247+0000 7fa06efd6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa068121b20 con 0x7fa06809e170 2023-10-03T10:12:42.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.247+0000 7fa06cd72700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa06809d860 0x7fa06811f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.247+0000 7fa06cd72700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa06809d860 0x7fa06811f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42980/0 (socket says 172.21.15.146:42980) 2023-10-03T10:12:42.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.247+0000 7fa06cd72700 1 -- 172.21.15.146:0/4177596099 learned_addr learned my addr 172.21.15.146:0/4177596099 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:42.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.247+0000 7fa06d573700 1 --2- 172.21.15.146:0/4177596099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa068130ce0 0x7fa06811fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.247+0000 7fa067fff700 1 --2- 172.21.15.146:0/4177596099 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa06809e170 0x7fa06811f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.248+0000 7fa06d573700 1 -- 172.21.15.146:0/4177596099 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa06809e170 msgr2=0x7fa06811f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.248+0000 7fa06d573700 1 --2- 172.21.15.146:0/4177596099 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa06809e170 0x7fa06811f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.248+0000 7fa06d573700 1 -- 172.21.15.146:0/4177596099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa06809d860 msgr2=0x7fa06811f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.248+0000 7fa06d573700 1 --2- 172.21.15.146:0/4177596099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa06809d860 0x7fa06811f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.248+0000 7fa06d573700 1 -- 172.21.15.146:0/4177596099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c009550 con 0x7fa068130ce0 2023-10-03T10:12:42.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.248+0000 7fa06d573700 1 --2- 172.21.15.146:0/4177596099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa068130ce0 0x7fa06811fb90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa060009fc0 tx=0x7fa060007610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:42.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.248+0000 7fa0657fa700 1 -- 172.21.15.146:0/4177596099 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06001f070 con 0x7fa068130ce0 2023-10-03T10:12:42.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.248+0000 7fa0657fa700 1 -- 172.21.15.146:0/4177596099 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa060007c30 con 0x7fa068130ce0 2023-10-03T10:12:42.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.248+0000 7fa06efd6700 1 -- 172.21.15.146:0/4177596099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa068122390 con 0x7fa068130ce0 2023-10-03T10:12:42.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.248+0000 7fa0657fa700 1 -- 172.21.15.146:0/4177596099 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa060003a20 con 0x7fa068130ce0 2023-10-03T10:12:42.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.248+0000 7fa06efd6700 1 -- 172.21.15.146:0/4177596099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa068130450 con 0x7fa068130ce0 2023-10-03T10:12:42.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.249+0000 7fa0657fa700 1 -- 172.21.15.146:0/4177596099 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa06001b8d0 con 0x7fa068130ce0 2023-10-03T10:12:42.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.250+0000 7fa06efd6700 1 -- 172.21.15.146:0/4177596099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa06809a5b0 con 0x7fa068130ce0 2023-10-03T10:12:42.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.250+0000 7fa06cd72700 1 -- 172.21.15.146:0/4177596099 >> v1:172.21.15.146:6816/126749 conn(0x7fa04c02f510 legacy=0x7fa04c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:42.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.250+0000 7fa0657fa700 1 -- 172.21.15.146:0/4177596099 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fa060047d10 con 0x7fa068130ce0 2023-10-03T10:12:42.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.258+0000 7fa0657fa700 1 -- 172.21.15.146:0/4177596099 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa06001be10 con 0x7fa068130ce0 2023-10-03T10:12:42.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.318+0000 7ff4cb94e700 1 Processor -- start 2023-10-03T10:12:42.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.318+0000 7ff4cb94e700 1 -- start start 2023-10-03T10:12:42.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.319+0000 7ff4cb94e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4c4099e20 0x7ff4c409a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.319+0000 7ff4cb94e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4c4130a60 0x7ff4c4138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.319+0000 7ff4cb94e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c4099a60 con 0x7ff4c409a730 2023-10-03T10:12:42.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.319+0000 7ff4cb94e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c409bf50 con 0x7ff4c4099e20 2023-10-03T10:12:42.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.319+0000 7ff4cb94e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c409b230 con 0x7ff4c4130a60 2023-10-03T10:12:42.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.319+0000 7ff4c9eeb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4c4130a60 0x7ff4c4138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.319+0000 7ff4c9eeb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4c4130a60 0x7ff4c4138690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43172/0 (socket says 172.21.15.146:43172) 2023-10-03T10:12:42.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.319+0000 7ff4c9eeb700 1 -- 172.21.15.146:0/2405196280 learned_addr learned my addr 172.21.15.146:0/2405196280 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:42.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.319+0000 7ff4c96ea700 1 --2- 172.21.15.146:0/2405196280 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4c4099e20 0x7ff4c409a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.319+0000 7ff4c9eeb700 1 -- 172.21.15.146:0/2405196280 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4c4099e20 msgr2=0x7ff4c409a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:42.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.319+0000 7ff4c9eeb700 1 --2- 172.21.15.146:0/2405196280 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4c4099e20 0x7ff4c409a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.319+0000 7ff4c9eeb700 1 -- 172.21.15.146:0/2405196280 >> v1:172.21.15.146:6789/0 conn(0x7ff4c409a730 legacy=0x7ff4c4130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:42.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.319+0000 7ff4c9eeb700 1 -- 172.21.15.146:0/2405196280 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c409bb90 con 0x7ff4c4130a60 2023-10-03T10:12:42.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.319+0000 7ff4c9eeb700 1 --2- 172.21.15.146:0/2405196280 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4c4130a60 0x7ff4c4138690 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc009e80 tx=0x7ff4bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10503cabc63de01b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:42.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.320+0000 7ff4bbfff700 1 -- 172.21.15.146:0/2405196280 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc00e070 con 0x7ff4c4130a60 2023-10-03T10:12:42.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.320+0000 7ff4bbfff700 1 -- 172.21.15.146:0/2405196280 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4bc003a20 con 0x7ff4c4130a60 2023-10-03T10:12:42.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.320+0000 7ff4bbfff700 1 -- 172.21.15.146:0/2405196280 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc003dd0 con 0x7ff4c4130a60 2023-10-03T10:12:42.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.320+0000 7ff4cb94e700 1 -- 172.21.15.146:0/2405196280 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4c4130a60 msgr2=0x7ff4c4138690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.320+0000 7ff4cb94e700 1 --2- 172.21.15.146:0/2405196280 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4c4130a60 0x7ff4c4138690 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc009e80 tx=0x7ff4bc00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:42.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.321+0000 7ff4cb94e700 1 -- 172.21.15.146:0/2405196280 shutdown_connections 2023-10-03T10:12:42.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.321+0000 7ff4cb94e700 1 --2- 172.21.15.146:0/2405196280 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4c4130a60 0x7ff4c4138690 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.321+0000 7ff4cb94e700 1 --2- 172.21.15.146:0/2405196280 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4c4099e20 0x7ff4c409a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.321+0000 7ff4cb94e700 1 -- 172.21.15.146:0/2405196280 >> 172.21.15.146:0/2405196280 conn(0x7ff4c40a2980 msgr2=0x7ff4c40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:42.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.321+0000 7ff4cb94e700 1 -- 172.21.15.146:0/2405196280 shutdown_connections 2023-10-03T10:12:42.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.321+0000 7ff4cb94e700 1 -- 172.21.15.146:0/2405196280 wait complete. 2023-10-03T10:12:42.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.322+0000 7ff4cb94e700 1 Processor -- start 2023-10-03T10:12:42.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.322+0000 7ff4cb94e700 1 -- start start 2023-10-03T10:12:42.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.323+0000 7ff4cb94e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c4099e20 0x7ff4c412b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.323+0000 7ff4cb94e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4c409a730 0x7ff4c412b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.323+0000 7ff4cb94e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4c4130a60 0x7ff4c41c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.323+0000 7ff4cb94e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c412d010 con 0x7ff4c4099e20 2023-10-03T10:12:42.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.323+0000 7ff4cb94e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c412aa90 con 0x7ff4c4130a60 2023-10-03T10:12:42.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.323+0000 7ff4cb94e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c41399d0 con 0x7ff4c409a730 2023-10-03T10:12:42.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.323+0000 7ff4c8ee9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4c409a730 0x7ff4c412b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.323+0000 7ff4c8ee9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4c409a730 0x7ff4c412b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43182/0 (socket says 172.21.15.146:43182) 2023-10-03T10:12:42.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.323+0000 7ff4c8ee9700 1 -- 172.21.15.146:0/1246581423 learned_addr learned my addr 172.21.15.146:0/1246581423 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:42.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.323+0000 7ff4c9eeb700 1 --2- 172.21.15.146:0/1246581423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4c4130a60 0x7ff4c41c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.323+0000 7ff4c96ea700 1 --2- 172.21.15.146:0/1246581423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c4099e20 0x7ff4c412b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.323+0000 7ff4c8ee9700 1 -- 172.21.15.146:0/1246581423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4c4130a60 msgr2=0x7ff4c41c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.323+0000 7ff4c8ee9700 1 --2- 172.21.15.146:0/1246581423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4c4130a60 0x7ff4c41c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.323+0000 7ff4c8ee9700 1 -- 172.21.15.146:0/1246581423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c4099e20 msgr2=0x7ff4c412b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.323+0000 7ff4c8ee9700 1 --2- 172.21.15.146:0/1246581423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c4099e20 0x7ff4c412b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.323+0000 7ff4c8ee9700 1 -- 172.21.15.146:0/1246581423 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc009b30 con 0x7ff4c409a730 2023-10-03T10:12:42.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.323+0000 7ff4c8ee9700 1 --2- 172.21.15.146:0/1246581423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4c409a730 0x7ff4c412b660 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400c4a0 tx=0x7ff4b400c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:42.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.324+0000 7ff4b9ffb700 1 -- 172.21.15.146:0/1246581423 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4011970 con 0x7ff4c409a730 2023-10-03T10:12:42.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.324+0000 7ff4b9ffb700 1 -- 172.21.15.146:0/1246581423 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b4011ad0 con 0x7ff4c409a730 2023-10-03T10:12:42.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.324+0000 7ff4cb94e700 1 -- 172.21.15.146:0/1246581423 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c4139bf0 con 0x7ff4c409a730 2023-10-03T10:12:42.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.324+0000 7ff4b9ffb700 1 -- 172.21.15.146:0/1246581423 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4011e80 con 0x7ff4c409a730 2023-10-03T10:12:42.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.324+0000 7ff4cb94e700 1 -- 172.21.15.146:0/1246581423 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c413a120 con 0x7ff4c409a730 2023-10-03T10:12:42.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.325+0000 7ff4b9ffb700 1 -- 172.21.15.146:0/1246581423 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff4b40193f0 con 0x7ff4c409a730 2023-10-03T10:12:42.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.325+0000 7ff4b9ffb700 1 -- 172.21.15.146:0/1246581423 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7ff4b4043610 con 0x7ff4c409a730 2023-10-03T10:12:42.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.325+0000 7ff4c96ea700 1 -- 172.21.15.146:0/1246581423 >> v1:172.21.15.146:6816/126749 conn(0x7ff4a802f510 legacy=0x7ff4a80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:42.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.325+0000 7ff4cb94e700 1 -- 172.21.15.146:0/1246581423 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c409b470 con 0x7ff4c409a730 2023-10-03T10:12:42.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.330+0000 7ff4b9ffb700 1 -- 172.21.15.146:0/1246581423 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4b40176e0 con 0x7ff4c409a730 2023-10-03T10:12:42.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.337+0000 7ff7d0f66700 1 Processor -- start 2023-10-03T10:12:42.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.337+0000 7ff7d0f66700 1 -- start start 2023-10-03T10:12:42.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.337+0000 7ff7d0f66700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff7cc133900 0x7ff7cc133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.337+0000 7ff7d0f66700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7cc0a10b0 0x7ff7cc13b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.337+0000 7ff7d0f66700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7cc09a760 con 0x7ff7cc134210 2023-10-03T10:12:42.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.337+0000 7ff7d0f66700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7cc1336e0 con 0x7ff7cc133900 2023-10-03T10:12:42.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.337+0000 7ff7d0f66700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc09a080 con 0x7ff7cc0a10b0 2023-10-03T10:12:42.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.338+0000 7ff7cad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7cc0a10b0 0x7ff7cc13b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.338+0000 7ff7cad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7cc0a10b0 0x7ff7cc13b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43010/0 (socket says 172.21.15.146:43010) 2023-10-03T10:12:42.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.338+0000 7ff7cad9d700 1 -- 172.21.15.146:0/4240875259 learned_addr learned my addr 172.21.15.146:0/4240875259 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:42.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.338+0000 7ff7ca59c700 1 --2- 172.21.15.146:0/4240875259 >> v2:172.21.15.146:3300/0 conn(0x7ff7cc133900 0x7ff7cc133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.338+0000 7ff7cad9d700 1 -- 172.21.15.146:0/4240875259 >> v2:172.21.15.146:3300/0 conn(0x7ff7cc133900 msgr2=0x7ff7cc133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:42.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.338+0000 7ff7cad9d700 1 --2- 172.21.15.146:0/4240875259 >> v2:172.21.15.146:3300/0 conn(0x7ff7cc133900 0x7ff7cc133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.338+0000 7ff7cad9d700 1 -- 172.21.15.146:0/4240875259 >> v1:172.21.15.146:6789/0 conn(0x7ff7cc134210 legacy=0x7ff7cc0a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.338+0000 7ff7cad9d700 1 -- 172.21.15.146:0/4240875259 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc0a23e0 con 0x7ff7cc0a10b0 2023-10-03T10:12:42.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.338+0000 7ff7cad9d700 1 --2- 172.21.15.146:0/4240875259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7cc0a10b0 0x7ff7cc13b910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4009e50 tx=0x7ff7c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab003a4c8be8bc35 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:42.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.338+0000 7fe7838ca700 1 Processor -- start 2023-10-03T10:12:42.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.338+0000 7ff7c959a700 1 -- 172.21.15.146:0/4240875259 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c400e070 con 0x7ff7cc0a10b0 2023-10-03T10:12:42.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.338+0000 7ff7c959a700 1 -- 172.21.15.146:0/4240875259 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c400b9c0 con 0x7ff7cc0a10b0 2023-10-03T10:12:42.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.338+0000 7ff7c959a700 1 -- 172.21.15.146:0/4240875259 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c400bd70 con 0x7ff7cc0a10b0 2023-10-03T10:12:42.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.339+0000 7fe7838ca700 1 -- start start 2023-10-03T10:12:42.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.339+0000 7fe7838ca700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe77c09a150 0x7fe77c09e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.339+0000 7fe7838ca700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe77c09edb0 0x7fe77c09f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.339+0000 7fe7838ca700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe77c133c20 0x7fe77c1340c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.339+0000 7fe7838ca700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe77c09a520 con 0x7fe77c133c20 2023-10-03T10:12:42.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.339+0000 7fe7838ca700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c09fe00 con 0x7fe77c09edb0 2023-10-03T10:12:42.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.339+0000 7fe7838ca700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c06bec0 con 0x7fe77c09a150 2023-10-03T10:12:42.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.339+0000 7fe780e65700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe77c09edb0 0x7fe77c09f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.339+0000 7fe781e67700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe77c133c20 0x7fe77c1340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.339+0000 7fe780e65700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe77c09edb0 0x7fe77c09f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43024/0 (socket says 172.21.15.146:43024) 2023-10-03T10:12:42.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.339+0000 7fe781e67700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe77c133c20 0x7fe77c1340c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44704/0 (socket says 172.21.15.146:44704) 2023-10-03T10:12:42.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.339+0000 7fe780e65700 1 -- 172.21.15.146:0/1915719461 learned_addr learned my addr 172.21.15.146:0/1915719461 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:42.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.339+0000 7fe781666700 1 --2- 172.21.15.146:0/1915719461 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe77c09a150 0x7fe77c09e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.339+0000 7ff7d0f66700 1 -- 172.21.15.146:0/4240875259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7cc0a10b0 msgr2=0x7ff7cc13b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.339+0000 7ff7d0f66700 1 --2- 172.21.15.146:0/4240875259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7cc0a10b0 0x7ff7cc13b910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4009e50 tx=0x7ff7c400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:42.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.340+0000 7ff7d0f66700 1 -- 172.21.15.146:0/4240875259 shutdown_connections 2023-10-03T10:12:42.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.340+0000 7ff7d0f66700 1 --2- 172.21.15.146:0/4240875259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7cc0a10b0 0x7ff7cc13b910 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.340+0000 7ff7d0f66700 1 --2- 172.21.15.146:0/4240875259 >> v2:172.21.15.146:3300/0 conn(0x7ff7cc133900 0x7ff7cc133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.340+0000 7ff7d0f66700 1 -- 172.21.15.146:0/4240875259 >> 172.21.15.146:0/4240875259 conn(0x7ff7cc0a2980 msgr2=0x7ff7cc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:42.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.340+0000 7fe780e65700 1 -- 172.21.15.146:0/1915719461 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe77c09a150 msgr2=0x7fe77c09e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:42.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.340+0000 7fe780e65700 1 --2- 172.21.15.146:0/1915719461 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe77c09a150 0x7fe77c09e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.340+0000 7fe780e65700 1 -- 172.21.15.146:0/1915719461 >> v2:172.21.15.146:3300/0 conn(0x7fe77c133c20 msgr2=0x7fe77c1340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:42.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.340+0000 7fe780e65700 1 --2- 172.21.15.146:0/1915719461 >> v2:172.21.15.146:3300/0 conn(0x7fe77c133c20 0x7fe77c1340c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.340+0000 7ff7d0f66700 1 -- 172.21.15.146:0/4240875259 shutdown_connections 2023-10-03T10:12:42.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.340+0000 7ff7d0f66700 1 -- 172.21.15.146:0/4240875259 wait complete. 2023-10-03T10:12:42.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.340+0000 7fe780e65700 1 -- 172.21.15.146:0/1915719461 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c09af80 con 0x7fe77c09edb0 2023-10-03T10:12:42.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.340+0000 7fe780e65700 1 --2- 172.21.15.146:0/1915719461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe77c09edb0 0x7fe77c09f1a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0098f0 tx=0x7fe76c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5c7b79d1eb3219f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:42.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.340+0000 7fe773fff700 1 -- 172.21.15.146:0/1915719461 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c011830 con 0x7fe77c09edb0 2023-10-03T10:12:42.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.340+0000 7fe773fff700 1 -- 172.21.15.146:0/1915719461 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c011990 con 0x7fe77c09edb0 2023-10-03T10:12:42.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.340+0000 7fe773fff700 1 -- 172.21.15.146:0/1915719461 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c011d20 con 0x7fe77c09edb0 2023-10-03T10:12:42.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.341+0000 7fe7838ca700 1 -- 172.21.15.146:0/1915719461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe77c09edb0 msgr2=0x7fe77c09f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.341+0000 7fe7838ca700 1 --2- 172.21.15.146:0/1915719461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe77c09edb0 0x7fe77c09f1a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0098f0 tx=0x7fe76c009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:42.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.341+0000 7ff7d0f66700 1 Processor -- start 2023-10-03T10:12:42.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.341+0000 7fe7838ca700 1 -- 172.21.15.146:0/1915719461 shutdown_connections 2023-10-03T10:12:42.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.341+0000 7fe7838ca700 1 --2- 172.21.15.146:0/1915719461 >> v2:172.21.15.146:3300/0 conn(0x7fe77c133c20 0x7fe77c1340c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.341+0000 7fe7838ca700 1 --2- 172.21.15.146:0/1915719461 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe77c09a150 0x7fe77c09e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.341+0000 7fe7838ca700 1 --2- 172.21.15.146:0/1915719461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe77c09edb0 0x7fe77c09f1a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.341+0000 7fe7838ca700 1 -- 172.21.15.146:0/1915719461 >> 172.21.15.146:0/1915719461 conn(0x7fe77c0a4430 msgr2=0x7fe77c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:42.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.341+0000 7ff7d0f66700 1 -- start start 2023-10-03T10:12:42.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.341+0000 7ff7d0f66700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7cc0a10b0 0x7ff7cc11d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.341+0000 7ff7d0f66700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7cc133900 0x7ff7cc11dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.341+0000 7ff7d0f66700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7cc134210 0x7ff7cc11e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.341+0000 7ff7d0f66700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc121340 con 0x7ff7cc0a10b0 2023-10-03T10:12:42.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.341+0000 7ff7d0f66700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc11f4a0 con 0x7ff7cc134210 2023-10-03T10:12:42.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.341+0000 7ff7d0f66700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc120140 con 0x7ff7cc133900 2023-10-03T10:12:42.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.342+0000 7ff7c9d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7cc133900 0x7ff7cc11dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.342+0000 7ff7c9d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7cc133900 0x7ff7cc11dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43206/0 (socket says 172.21.15.146:43206) 2023-10-03T10:12:42.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.342+0000 7ff7c9d9b700 1 -- 172.21.15.146:0/2954840513 learned_addr learned my addr 172.21.15.146:0/2954840513 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:42.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.342+0000 7ff7cad9d700 1 --2- 172.21.15.146:0/2954840513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7cc134210 0x7ff7cc11e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.342+0000 7ff7ca59c700 1 --2- 172.21.15.146:0/2954840513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7cc0a10b0 0x7ff7cc11d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.342+0000 7fe7838ca700 1 -- 172.21.15.146:0/1915719461 shutdown_connections 2023-10-03T10:12:42.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.342+0000 7fe7838ca700 1 -- 172.21.15.146:0/1915719461 wait complete. 2023-10-03T10:12:42.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.342+0000 7ff7cad9d700 1 -- 172.21.15.146:0/2954840513 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7cc133900 msgr2=0x7ff7cc11dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.342+0000 7ff7cad9d700 1 --2- 172.21.15.146:0/2954840513 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7cc133900 0x7ff7cc11dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.342+0000 7ff7cad9d700 1 -- 172.21.15.146:0/2954840513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7cc0a10b0 msgr2=0x7ff7cc11d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.342+0000 7ff7cad9d700 1 --2- 172.21.15.146:0/2954840513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7cc0a10b0 0x7ff7cc11d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.342+0000 7ff7cad9d700 1 -- 172.21.15.146:0/2954840513 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c4009b30 con 0x7ff7cc134210 2023-10-03T10:12:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.342+0000 7ff7cad9d700 1 --2- 172.21.15.146:0/2954840513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7cc134210 0x7ff7cc11e280 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4015000 tx=0x7ff7c4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.342+0000 7ff7baffd700 1 -- 172.21.15.146:0/2954840513 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4004800 con 0x7ff7cc134210 2023-10-03T10:12:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.342+0000 7ff7baffd700 1 -- 172.21.15.146:0/2954840513 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c4004960 con 0x7ff7cc134210 2023-10-03T10:12:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.342+0000 7ff7d0f66700 1 -- 172.21.15.146:0/2954840513 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7cc132e40 con 0x7ff7cc134210 2023-10-03T10:12:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.342+0000 7ff7baffd700 1 -- 172.21.15.146:0/2954840513 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c401c680 con 0x7ff7cc134210 2023-10-03T10:12:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.342+0000 7ff7d0f66700 1 -- 172.21.15.146:0/2954840513 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7cc120fc0 con 0x7ff7cc134210 2023-10-03T10:12:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.343+0000 7ff7baffd700 1 -- 172.21.15.146:0/2954840513 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff7c401c7e0 con 0x7ff7cc134210 2023-10-03T10:12:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.343+0000 7ff7baffd700 1 -- 172.21.15.146:0/2954840513 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7ff7c4041650 con 0x7ff7cc134210 2023-10-03T10:12:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.343+0000 7ff7ca59c700 1 -- 172.21.15.146:0/2954840513 >> v1:172.21.15.146:6816/126749 conn(0x7ff7ac02f510 legacy=0x7ff7ac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:42.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.343+0000 7fe7838ca700 1 Processor -- start 2023-10-03T10:12:42.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.343+0000 7fe7838ca700 1 -- start start 2023-10-03T10:12:42.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.344+0000 7ff7d0f66700 1 -- 172.21.15.146:0/2954840513 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7cc04f2a0 con 0x7ff7cc134210 2023-10-03T10:12:42.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.344+0000 7fe7838ca700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe77c09a150 0x7fe77c11fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.344+0000 7fe7838ca700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe77c09edb0 0x7fe77c11ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.344+0000 7fe7838ca700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe77c133c20 0x7fe77c1c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.344+0000 7fe7838ca700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c11f400 con 0x7fe77c133c20 2023-10-03T10:12:42.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.344+0000 7fe7838ca700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c0a0440 con 0x7fe77c09edb0 2023-10-03T10:12:42.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.344+0000 7fe7838ca700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c122a30 con 0x7fe77c09a150 2023-10-03T10:12:42.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.344+0000 7fe780e65700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe77c09edb0 0x7fe77c11ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.344+0000 7fe780e65700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe77c09edb0 0x7fe77c11ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43038/0 (socket says 172.21.15.146:43038) 2023-10-03T10:12:42.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.344+0000 7fe780e65700 1 -- 172.21.15.146:0/2261278264 learned_addr learned my addr 172.21.15.146:0/2261278264 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:42.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.344+0000 7fe781666700 1 --2- 172.21.15.146:0/2261278264 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe77c09a150 0x7fe77c11fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.344+0000 7fe781e67700 1 --2- 172.21.15.146:0/2261278264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe77c133c20 0x7fe77c1c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.344+0000 7fe780e65700 1 -- 172.21.15.146:0/2261278264 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe77c09a150 msgr2=0x7fe77c11fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.344+0000 7fe780e65700 1 --2- 172.21.15.146:0/2261278264 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe77c09a150 0x7fe77c11fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.344+0000 7fe780e65700 1 -- 172.21.15.146:0/2261278264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe77c133c20 msgr2=0x7fe77c1c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.344+0000 7fe780e65700 1 --2- 172.21.15.146:0/2261278264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe77c133c20 0x7fe77c1c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.344+0000 7fe780e65700 1 -- 172.21.15.146:0/2261278264 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c009550 con 0x7fe77c09edb0 2023-10-03T10:12:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.345+0000 7fe780e65700 1 --2- 172.21.15.146:0/2261278264 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe77c09edb0 0x7fe77c11ff70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009f50 tx=0x7fe76c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.349+0000 7fe771ffb700 1 -- 172.21.15.146:0/2261278264 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c004240 con 0x7fe77c09edb0 2023-10-03T10:12:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.349+0000 7fe771ffb700 1 -- 172.21.15.146:0/2261278264 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c01f070 con 0x7fe77c09edb0 2023-10-03T10:12:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.349+0000 7fe771ffb700 1 -- 172.21.15.146:0/2261278264 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c0045a0 con 0x7fe77c09edb0 2023-10-03T10:12:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.349+0000 7fe7838ca700 1 -- 172.21.15.146:0/2261278264 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77c09b470 con 0x7fe77c09edb0 2023-10-03T10:12:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.349+0000 7fe7838ca700 1 -- 172.21.15.146:0/2261278264 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77c122390 con 0x7fe77c09edb0 2023-10-03T10:12:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.349+0000 7ff7baffd700 1 -- 172.21.15.146:0/2954840513 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff7c40123f0 con 0x7ff7cc134210 2023-10-03T10:12:42.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.350+0000 7fe7838ca700 1 -- 172.21.15.146:0/2261278264 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77c09fa30 con 0x7fe77c09edb0 2023-10-03T10:12:42.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.350+0000 7fe771ffb700 1 -- 172.21.15.146:0/2261278264 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe76c021030 con 0x7fe77c09edb0 2023-10-03T10:12:42.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.351+0000 7fe771ffb700 1 -- 172.21.15.146:0/2261278264 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fe76c040bf0 con 0x7fe77c09edb0 2023-10-03T10:12:42.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.351+0000 7fe781666700 1 -- 172.21.15.146:0/2261278264 >> v1:172.21.15.146:6816/126749 conn(0x7fe76002f510 legacy=0x7fe7600319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:42.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.355+0000 7fe771ffb700 1 -- 172.21.15.146:0/2261278264 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe76c0036a0 con 0x7fe77c09edb0 2023-10-03T10:12:42.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.451+0000 7fa06cd72700 1 -- 172.21.15.146:0/4177596099 >> v1:172.21.15.146:6816/126749 conn(0x7fa04c02f510 legacy=0x7fa04c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:42.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.482+0000 7fa06efd6700 1 -- 172.21.15.146:0/4177596099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa068122330 con 0x7fa068130ce0 2023-10-03T10:12:42.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.483+0000 7fa0657fa700 1 -- 172.21.15.146:0/4177596099 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa06000e290 con 0x7fa068130ce0 2023-10-03T10:12:42.482 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:42.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.485+0000 7fa06efd6700 1 -- 172.21.15.146:0/4177596099 >> v1:172.21.15.146:6816/126749 conn(0x7fa04c02f510 legacy=0x7fa04c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:42.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.485+0000 7fa06efd6700 1 -- 172.21.15.146:0/4177596099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa068130ce0 msgr2=0x7fa06811fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.485+0000 7fa06efd6700 1 --2- 172.21.15.146:0/4177596099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa068130ce0 0x7fa06811fb90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa060009fc0 tx=0x7fa060007610 comp rx=0 tx=0).stop 2023-10-03T10:12:42.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.485+0000 7fa06efd6700 1 -- 172.21.15.146:0/4177596099 shutdown_connections 2023-10-03T10:12:42.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.485+0000 7fa06efd6700 1 --2- 172.21.15.146:0/4177596099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa068130ce0 0x7fa06811fb90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.485+0000 7fa06efd6700 1 --2- 172.21.15.146:0/4177596099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa06809d860 0x7fa06811f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.485+0000 7fa06efd6700 1 --2- 172.21.15.146:0/4177596099 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa06809e170 0x7fa06811f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.485+0000 7fa06efd6700 1 -- 172.21.15.146:0/4177596099 >> 172.21.15.146:0/4177596099 conn(0x7fa068099c40 msgr2=0x7fa068119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:42.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.485+0000 7fa06efd6700 1 -- 172.21.15.146:0/4177596099 shutdown_connections 2023-10-03T10:12:42.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.485+0000 7fa06efd6700 1 -- 172.21.15.146:0/4177596099 wait complete. 2023-10-03T10:12:42.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:42.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.526+0000 7ff4c96ea700 1 -- 172.21.15.146:0/1246581423 >> v1:172.21.15.146:6816/126749 conn(0x7ff4a802f510 legacy=0x7ff4a80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:42.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.539+0000 7ff4cb94e700 1 -- 172.21.15.146:0/1246581423 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff4c4072480 con 0x7ff4c409a730 2023-10-03T10:12:42.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.539+0000 7ff4b9ffb700 1 -- 172.21.15.146:0/1246581423 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff4c4072480 con 0x7ff4c409a730 2023-10-03T10:12:42.539 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:42.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.541+0000 7ff4cb94e700 1 -- 172.21.15.146:0/1246581423 >> v1:172.21.15.146:6816/126749 conn(0x7ff4a802f510 legacy=0x7ff4a80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:42.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.541+0000 7ff4cb94e700 1 -- 172.21.15.146:0/1246581423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4c409a730 msgr2=0x7ff4c412b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.541+0000 7ff4cb94e700 1 --2- 172.21.15.146:0/1246581423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4c409a730 0x7ff4c412b660 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400c4a0 tx=0x7ff4b400c7b0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.541+0000 7ff4cb94e700 1 -- 172.21.15.146:0/1246581423 shutdown_connections 2023-10-03T10:12:42.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.541+0000 7ff4cb94e700 1 --2- 172.21.15.146:0/1246581423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4c4130a60 0x7ff4c41c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.541+0000 7ff4cb94e700 1 --2- 172.21.15.146:0/1246581423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c4099e20 0x7ff4c412b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.541+0000 7ff4cb94e700 1 --2- 172.21.15.146:0/1246581423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4c409a730 0x7ff4c412b660 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.541+0000 7ff4cb94e700 1 -- 172.21.15.146:0/1246581423 >> 172.21.15.146:0/1246581423 conn(0x7ff4c40a2980 msgr2=0x7ff4c406df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:42.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.542+0000 7ff4cb94e700 1 -- 172.21.15.146:0/1246581423 shutdown_connections 2023-10-03T10:12:42.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.542+0000 7ff4cb94e700 1 -- 172.21.15.146:0/1246581423 wait complete. 2023-10-03T10:12:42.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.544+0000 7ff7ca59c700 1 -- 172.21.15.146:0/2954840513 >> v1:172.21.15.146:6816/126749 conn(0x7ff7ac02f510 legacy=0x7ff7ac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:42.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.548+0000 7ff7d0f66700 1 -- 172.21.15.146:0/2954840513 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff7cc06bce0 con 0x7ff7cc134210 2023-10-03T10:12:42.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.548+0000 7ff7baffd700 1 -- 172.21.15.146:0/2954840513 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff7c4034090 con 0x7ff7cc134210 2023-10-03T10:12:42.548 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:42.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.550+0000 7ff7d0f66700 1 -- 172.21.15.146:0/2954840513 >> v1:172.21.15.146:6816/126749 conn(0x7ff7ac02f510 legacy=0x7ff7ac0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:42.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.550+0000 7ff7d0f66700 1 -- 172.21.15.146:0/2954840513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7cc134210 msgr2=0x7ff7cc11e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.550+0000 7ff7d0f66700 1 --2- 172.21.15.146:0/2954840513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7cc134210 0x7ff7cc11e280 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4015000 tx=0x7ff7c4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.550+0000 7ff7d0f66700 1 -- 172.21.15.146:0/2954840513 shutdown_connections 2023-10-03T10:12:42.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.550+0000 7ff7d0f66700 1 --2- 172.21.15.146:0/2954840513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7cc134210 0x7ff7cc11e280 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.550+0000 7ff7d0f66700 1 --2- 172.21.15.146:0/2954840513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7cc0a10b0 0x7ff7cc11d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.550+0000 7ff7d0f66700 1 --2- 172.21.15.146:0/2954840513 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7cc133900 0x7ff7cc11dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.550+0000 7ff7d0f66700 1 -- 172.21.15.146:0/2954840513 >> 172.21.15.146:0/2954840513 conn(0x7ff7cc0a2980 msgr2=0x7ff7cc1b95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:42.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.550+0000 7ff7d0f66700 1 -- 172.21.15.146:0/2954840513 shutdown_connections 2023-10-03T10:12:42.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.550+0000 7ff7d0f66700 1 -- 172.21.15.146:0/2954840513 wait complete. 2023-10-03T10:12:42.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.552+0000 7fe781666700 1 -- 172.21.15.146:0/2261278264 >> v1:172.21.15.146:6816/126749 conn(0x7fe76002f510 legacy=0x7fe7600319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:42.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.553+0000 7fe7838ca700 1 -- 172.21.15.146:0/2261278264 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe77c04f2a0 con 0x7fe77c09edb0 2023-10-03T10:12:42.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.553+0000 7fe771ffb700 1 -- 172.21.15.146:0/2261278264 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe76c015020 con 0x7fe77c09edb0 2023-10-03T10:12:42.553 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:42.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:42.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.555+0000 7fe7838ca700 1 -- 172.21.15.146:0/2261278264 >> v1:172.21.15.146:6816/126749 conn(0x7fe76002f510 legacy=0x7fe7600319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:42.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.555+0000 7fe7838ca700 1 -- 172.21.15.146:0/2261278264 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe77c09edb0 msgr2=0x7fe77c11ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.555+0000 7fe7838ca700 1 --2- 172.21.15.146:0/2261278264 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe77c09edb0 0x7fe77c11ff70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009f50 tx=0x7fe76c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:42.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.555+0000 7fe7838ca700 1 -- 172.21.15.146:0/2261278264 shutdown_connections 2023-10-03T10:12:42.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.555+0000 7fe7838ca700 1 --2- 172.21.15.146:0/2261278264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe77c133c20 0x7fe77c1c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.555+0000 7fe7838ca700 1 --2- 172.21.15.146:0/2261278264 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe77c09a150 0x7fe77c11fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.555+0000 7fe7838ca700 1 --2- 172.21.15.146:0/2261278264 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe77c09edb0 0x7fe77c11ff70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.555+0000 7fe7838ca700 1 -- 172.21.15.146:0/2261278264 >> 172.21.15.146:0/2261278264 conn(0x7fe77c0a4430 msgr2=0x7fe77c1b8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:42.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.555+0000 7fe7838ca700 1 -- 172.21.15.146:0/2261278264 shutdown_connections 2023-10-03T10:12:42.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:42.555+0000 7fe7838ca700 1 -- 172.21.15.146:0/2261278264 wait complete. 2023-10-03T10:12:42.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:42.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:43.502 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:43.555 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:43.565 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:43.569 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:43.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.644+0000 7f091ef7a700 1 Processor -- start 2023-10-03T10:12:43.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.645+0000 7f091ef7a700 1 -- start start 2023-10-03T10:12:43.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.645+0000 7f091ef7a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f091809d860 0x7f091809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.645+0000 7f091ef7a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f091809e170 0x7f09181307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.645+0000 7f091ef7a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f091809aaa0 con 0x7f0918130ce0 2023-10-03T10:12:43.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.645+0000 7f091ef7a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f091809f870 con 0x7f091809d860 2023-10-03T10:12:43.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.645+0000 7f091ef7a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f091809b360 con 0x7f091809e170 2023-10-03T10:12:43.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.645+0000 7f0917fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f091809e170 0x7f09181307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.645+0000 7f0917fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f091809e170 0x7f09181307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43224/0 (socket says 172.21.15.146:43224) 2023-10-03T10:12:43.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.645+0000 7f0917fff700 1 -- 172.21.15.146:0/3899940285 learned_addr learned my addr 172.21.15.146:0/3899940285 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:43.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.645+0000 7f091cd16700 1 --2- 172.21.15.146:0/3899940285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f091809d860 0x7f091809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.646+0000 7f0917fff700 1 -- 172.21.15.146:0/3899940285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f091809d860 msgr2=0x7f091809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:43.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.646+0000 7f0917fff700 1 --2- 172.21.15.146:0/3899940285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f091809d860 0x7f091809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.646+0000 7f0917fff700 1 -- 172.21.15.146:0/3899940285 >> v1:172.21.15.146:6789/0 conn(0x7f0918130ce0 legacy=0x7f09181379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:43.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.646+0000 7f0917fff700 1 -- 172.21.15.146:0/3899940285 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091809b620 con 0x7f091809e170 2023-10-03T10:12:43.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.646+0000 7f0917fff700 1 --2- 172.21.15.146:0/3899940285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f091809e170 0x7f09181307a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0904009920 tx=0x7f0904009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffea15bec2d0aa7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.646+0000 7f09177fe700 1 -- 172.21.15.146:0/3899940285 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0904004230 con 0x7f091809e170 2023-10-03T10:12:43.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.646+0000 7f09177fe700 1 -- 172.21.15.146:0/3899940285 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0904004390 con 0x7f091809e170 2023-10-03T10:12:43.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.646+0000 7f09177fe700 1 -- 172.21.15.146:0/3899940285 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09040036a0 con 0x7f091809e170 2023-10-03T10:12:43.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.647+0000 7f091ef7a700 1 -- 172.21.15.146:0/3899940285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f091809e170 msgr2=0x7f09181307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.647+0000 7f091ef7a700 1 --2- 172.21.15.146:0/3899940285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f091809e170 0x7f09181307a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0904009920 tx=0x7f0904009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:43.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.647+0000 7f091ef7a700 1 -- 172.21.15.146:0/3899940285 shutdown_connections 2023-10-03T10:12:43.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.647+0000 7f091ef7a700 1 --2- 172.21.15.146:0/3899940285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f091809d860 0x7f091809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.647+0000 7f091ef7a700 1 --2- 172.21.15.146:0/3899940285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f091809e170 0x7f09181307a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.647+0000 7f091ef7a700 1 -- 172.21.15.146:0/3899940285 >> 172.21.15.146:0/3899940285 conn(0x7f0918099c40 msgr2=0x7f09180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.647+0000 7f091ef7a700 1 -- 172.21.15.146:0/3899940285 shutdown_connections 2023-10-03T10:12:43.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.647+0000 7f091ef7a700 1 -- 172.21.15.146:0/3899940285 wait complete. 2023-10-03T10:12:43.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.648+0000 7f091ef7a700 1 Processor -- start 2023-10-03T10:12:43.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.648+0000 7f091ef7a700 1 -- start start 2023-10-03T10:12:43.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.649+0000 7f091ef7a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f091809d860 0x7f091811b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.649+0000 7f091ef7a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f091809e170 0x7f091811bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.649+0000 7f091ef7a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0918130ce0 0x7f091811c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.649+0000 7f091ef7a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091811ec00 con 0x7f091809d860 2023-10-03T10:12:43.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.649+0000 7f091ef7a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f091809c8b0 con 0x7f0918130ce0 2023-10-03T10:12:43.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.649+0000 7f091ef7a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f091811ede0 con 0x7f091809e170 2023-10-03T10:12:43.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.649+0000 7f091cd16700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f091809d860 0x7f091811b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.649+0000 7f0917fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f091809e170 0x7f091811bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.649+0000 7f0917fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f091809e170 0x7f091811bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43240/0 (socket says 172.21.15.146:43240) 2023-10-03T10:12:43.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.649+0000 7f0917fff700 1 -- 172.21.15.146:0/3517420019 learned_addr learned my addr 172.21.15.146:0/3517420019 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:43.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.649+0000 7f091cd16700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f091809d860 0x7f091811b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44734/0 (socket says 172.21.15.146:44734) 2023-10-03T10:12:43.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.649+0000 7f091d517700 1 --2- 172.21.15.146:0/3517420019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0918130ce0 0x7f091811c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.649+0000 7f091cd16700 1 -- 172.21.15.146:0/3517420019 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f091809e170 msgr2=0x7f091811bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.649+0000 7f091cd16700 1 --2- 172.21.15.146:0/3517420019 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f091809e170 0x7f091811bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.649+0000 7f091cd16700 1 -- 172.21.15.146:0/3517420019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0918130ce0 msgr2=0x7f091811c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.649+0000 7f091cd16700 1 --2- 172.21.15.146:0/3517420019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0918130ce0 0x7f091811c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.649+0000 7f091cd16700 1 -- 172.21.15.146:0/3517420019 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0904009550 con 0x7f091809d860 2023-10-03T10:12:43.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.649+0000 7f091cd16700 1 --2- 172.21.15.146:0/3517420019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f091809d860 0x7f091811b5f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f090c00e930 tx=0x7f090c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.650+0000 7f09157fa700 1 -- 172.21.15.146:0/3517420019 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c013680 con 0x7f091809d860 2023-10-03T10:12:43.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.650+0000 7f09157fa700 1 -- 172.21.15.146:0/3517420019 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c0137e0 con 0x7f091809d860 2023-10-03T10:12:43.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.650+0000 7f09157fa700 1 -- 172.21.15.146:0/3517420019 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c013b50 con 0x7f091809d860 2023-10-03T10:12:43.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.651+0000 7f091ef7a700 1 -- 172.21.15.146:0/3517420019 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0918130930 con 0x7f091809d860 2023-10-03T10:12:43.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.651+0000 7f091ef7a700 1 -- 172.21.15.146:0/3517420019 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091811f850 con 0x7f091809d860 2023-10-03T10:12:43.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.652+0000 7f09157fa700 1 -- 172.21.15.146:0/3517420019 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f090c013cb0 con 0x7f091809d860 2023-10-03T10:12:43.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.652+0000 7f09157fa700 1 -- 172.21.15.146:0/3517420019 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f090c03fba0 con 0x7f091809d860 2023-10-03T10:12:43.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.652+0000 7f0917fff700 1 -- 172.21.15.146:0/3517420019 >> v1:172.21.15.146:6816/126749 conn(0x7f08fc02f510 legacy=0x7f08fc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:43.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.652+0000 7f091ef7a700 1 -- 172.21.15.146:0/3517420019 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091804f2a0 con 0x7f091809d860 2023-10-03T10:12:43.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.661+0000 7f09157fa700 1 -- 172.21.15.146:0/3517420019 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f090c01be10 con 0x7f091809d860 2023-10-03T10:12:43.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.694+0000 7f3681129700 1 Processor -- start 2023-10-03T10:12:43.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.694+0000 7f3681129700 1 -- start start 2023-10-03T10:12:43.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.695+0000 7f3681129700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f367c1319f0 0x7f367c131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.695+0000 7f3681129700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f367c09bc70 0x7f367c09c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.695+0000 7f3681129700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f367c0a2590 con 0x7f367c09c5e0 2023-10-03T10:12:43.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.695+0000 7f3681129700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367c06eaa0 con 0x7f367c1319f0 2023-10-03T10:12:43.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.695+0000 7f3681129700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f367c1315c0 con 0x7f367c09bc70 2023-10-03T10:12:43.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.695+0000 7f367a59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f367c09bc70 0x7f367c09c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.695+0000 7f367ad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f367c1319f0 0x7f367c131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.695+0000 7f367a59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f367c09bc70 0x7f367c09c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43254/0 (socket says 172.21.15.146:43254) 2023-10-03T10:12:43.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.695+0000 7f367a59c700 1 -- 172.21.15.146:0/2414816841 learned_addr learned my addr 172.21.15.146:0/2414816841 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:43.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.695+0000 7f367a59c700 1 -- 172.21.15.146:0/2414816841 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f367c1319f0 msgr2=0x7f367c131dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:43.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.695+0000 7f367a59c700 1 --2- 172.21.15.146:0/2414816841 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f367c1319f0 0x7f367c131dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.695+0000 7f367a59c700 1 -- 172.21.15.146:0/2414816841 >> v1:172.21.15.146:6789/0 conn(0x7f367c09c5e0 legacy=0x7f367c138770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.695+0000 7f367a59c700 1 -- 172.21.15.146:0/2414816841 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367c0a1640 con 0x7f367c09bc70 2023-10-03T10:12:43.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.695+0000 7f367ad9d700 1 --2- 172.21.15.146:0/2414816841 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f367c1319f0 0x7f367c131dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:43.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.696+0000 7f367a59c700 1 --2- 172.21.15.146:0/2414816841 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f367c09bc70 0x7f367c09c0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3670009950 tx=0x7f3670009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3960a95b0cc551d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.696+0000 7f3679d9b700 1 -- 172.21.15.146:0/2414816841 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670009ea0 con 0x7f367c09bc70 2023-10-03T10:12:43.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.696+0000 7f3679d9b700 1 -- 172.21.15.146:0/2414816841 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367000ba20 con 0x7f367c09bc70 2023-10-03T10:12:43.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.696+0000 7f3679d9b700 1 -- 172.21.15.146:0/2414816841 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367000bdb0 con 0x7f367c09bc70 2023-10-03T10:12:43.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.696+0000 7f3681129700 1 -- 172.21.15.146:0/2414816841 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f367c09bc70 msgr2=0x7f367c09c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.696+0000 7f3681129700 1 --2- 172.21.15.146:0/2414816841 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f367c09bc70 0x7f367c09c0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3670009950 tx=0x7f3670009c60 comp rx=0 tx=0).stop 2023-10-03T10:12:43.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.697+0000 7f3681129700 1 -- 172.21.15.146:0/2414816841 shutdown_connections 2023-10-03T10:12:43.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.697+0000 7f3681129700 1 --2- 172.21.15.146:0/2414816841 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f367c1319f0 0x7f367c131dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.697+0000 7f3681129700 1 --2- 172.21.15.146:0/2414816841 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f367c09bc70 0x7f367c09c0a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.697+0000 7f3681129700 1 -- 172.21.15.146:0/2414816841 >> 172.21.15.146:0/2414816841 conn(0x7f367c0a2980 msgr2=0x7f367c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.697+0000 7f3681129700 1 -- 172.21.15.146:0/2414816841 shutdown_connections 2023-10-03T10:12:43.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.697+0000 7f3681129700 1 -- 172.21.15.146:0/2414816841 wait complete. 2023-10-03T10:12:43.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.698+0000 7f3681129700 1 Processor -- start 2023-10-03T10:12:43.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.698+0000 7f3681129700 1 -- start start 2023-10-03T10:12:43.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.699+0000 7f3681129700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f367c09bc70 0x7f367c11b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.699+0000 7f3681129700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f367c09c5e0 0x7f367c11bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.699+0000 7f3681129700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f367c1319f0 0x7f367c11c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.699+0000 7f3681129700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367c11fba0 con 0x7f367c1319f0 2023-10-03T10:12:43.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.699+0000 7f3681129700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367c11f1e0 con 0x7f367c09c5e0 2023-10-03T10:12:43.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.699+0000 7f3681129700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f367c11e5b0 con 0x7f367c09bc70 2023-10-03T10:12:43.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.699+0000 7f367ad9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f367c09bc70 0x7f367c11b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.699+0000 7f367ad9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f367c09bc70 0x7f367c11b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43270/0 (socket says 172.21.15.146:43270) 2023-10-03T10:12:43.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.699+0000 7f367ad9d700 1 -- 172.21.15.146:0/1087874063 learned_addr learned my addr 172.21.15.146:0/1087874063 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:43.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.699+0000 7f367a59c700 1 --2- 172.21.15.146:0/1087874063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f367c09c5e0 0x7f367c11bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.699+0000 7f367b59e700 1 --2- 172.21.15.146:0/1087874063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f367c1319f0 0x7f367c11c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.700+0000 7f367b59e700 1 -- 172.21.15.146:0/1087874063 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f367c09bc70 msgr2=0x7f367c11b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.700+0000 7f367b59e700 1 --2- 172.21.15.146:0/1087874063 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f367c09bc70 0x7f367c11b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.700+0000 7f367b59e700 1 -- 172.21.15.146:0/1087874063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f367c09c5e0 msgr2=0x7f367c11bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.700+0000 7f367b59e700 1 --2- 172.21.15.146:0/1087874063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f367c09c5e0 0x7f367c11bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.700+0000 7f367b59e700 1 -- 172.21.15.146:0/1087874063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3670009550 con 0x7f367c1319f0 2023-10-03T10:12:43.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.700+0000 7f367ad9d700 1 --2- 172.21.15.146:0/1087874063 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f367c09bc70 0x7f367c11b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:43.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.700+0000 7f367a59c700 1 --2- 172.21.15.146:0/1087874063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f367c09c5e0 0x7f367c11bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:43.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.700+0000 7f367b59e700 1 --2- 172.21.15.146:0/1087874063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f367c1319f0 0x7f367c11c140 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f367400cb90 tx=0x7f367400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.700+0000 7f36637fe700 1 -- 172.21.15.146:0/1087874063 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3674003c00 con 0x7f367c1319f0 2023-10-03T10:12:43.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.700+0000 7f36637fe700 1 -- 172.21.15.146:0/1087874063 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3674003d60 con 0x7f367c1319f0 2023-10-03T10:12:43.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.700+0000 7f3681129700 1 -- 172.21.15.146:0/1087874063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f367c11e970 con 0x7f367c1319f0 2023-10-03T10:12:43.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.700+0000 7f36637fe700 1 -- 172.21.15.146:0/1087874063 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367400aa80 con 0x7f367c1319f0 2023-10-03T10:12:43.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.700+0000 7f3681129700 1 -- 172.21.15.146:0/1087874063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f367c0a1cb0 con 0x7f367c1319f0 2023-10-03T10:12:43.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.701+0000 7f36637fe700 1 -- 172.21.15.146:0/1087874063 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f367400abe0 con 0x7f367c1319f0 2023-10-03T10:12:43.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.702+0000 7f36637fe700 1 -- 172.21.15.146:0/1087874063 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f367403fb20 con 0x7f367c1319f0 2023-10-03T10:12:43.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.702+0000 7f367ad9d700 1 -- 172.21.15.146:0/1087874063 >> v1:172.21.15.146:6816/126749 conn(0x7f366802f510 legacy=0x7f36680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:43.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.702+0000 7f3681129700 1 -- 172.21.15.146:0/1087874063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f365c0052e0 con 0x7f367c1319f0 2023-10-03T10:12:43.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.711+0000 7f36637fe700 1 -- 172.21.15.146:0/1087874063 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f36740198f0 con 0x7f367c1319f0 2023-10-03T10:12:43.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.732+0000 7f2ae845d700 1 Processor -- start 2023-10-03T10:12:43.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.732+0000 7f2ae845d700 1 -- start start 2023-10-03T10:12:43.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.733+0000 7f2ae845d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ae009ad40 0x7f2ae0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.733+0000 7f2ae845d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ae0133f70 0x7f2ae01343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.733+0000 7f2ae845d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae009b110 con 0x7f2ae00a0a70 2023-10-03T10:12:43.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.733+0000 7f2ae845d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae00a3b60 con 0x7f2ae009ad40 2023-10-03T10:12:43.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.733+0000 7f2ae845d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae01348e0 con 0x7f2ae0133f70 2023-10-03T10:12:43.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.733+0000 7f2ae69fa700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2ae00a0a70 0x7f2ae00a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54040/0 (socket says 172.21.15.146:54040) 2023-10-03T10:12:43.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.733+0000 7f2ae69fa700 1 -- 172.21.15.146:0/1259866022 learned_addr learned my addr 172.21.15.146:0/1259866022 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:43.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.733+0000 7f2ae59f8700 1 --2- 172.21.15.146:0/1259866022 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ae0133f70 0x7f2ae01343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.733+0000 7f2ae61f9700 1 --2- 172.21.15.146:0/1259866022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ae009ad40 0x7f2ae0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.733+0000 7f2ae51f7700 1 -- 172.21.15.146:0/1259866022 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772083726 0 0) 0x7f2ae009b110 con 0x7f2ae00a0a70 2023-10-03T10:12:43.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.734+0000 7f2ae51f7700 1 -- 172.21.15.146:0/1259866022 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2acc0035b0 con 0x7f2ae00a0a70 2023-10-03T10:12:43.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.734+0000 7f2ae59f8700 1 -- 172.21.15.146:0/1259866022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ae009ad40 msgr2=0x7f2ae0133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:43.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.734+0000 7f2ae59f8700 1 --2- 172.21.15.146:0/1259866022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ae009ad40 0x7f2ae0133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.734+0000 7f2ae59f8700 1 -- 172.21.15.146:0/1259866022 >> v1:172.21.15.146:6789/0 conn(0x7f2ae00a0a70 legacy=0x7f2ae00a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.734+0000 7f2ae59f8700 1 -- 172.21.15.146:0/1259866022 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae00a2fa0 con 0x7f2ae0133f70 2023-10-03T10:12:43.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.734+0000 7f2ae59f8700 1 --2- 172.21.15.146:0/1259866022 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ae0133f70 0x7f2ae01343a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009870 tx=0x7f2ad0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3807babaa6ca67d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.734+0000 7f2ae51f7700 1 -- 172.21.15.146:0/1259866022 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0011830 con 0x7f2ae0133f70 2023-10-03T10:12:43.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.734+0000 7f8aa4a78700 1 Processor -- start 2023-10-03T10:12:43.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.734+0000 7f2ae51f7700 1 -- 172.21.15.146:0/1259866022 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad0011990 con 0x7f2ae0133f70 2023-10-03T10:12:43.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.734+0000 7f2ae51f7700 1 -- 172.21.15.146:0/1259866022 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0011d00 con 0x7f2ae0133f70 2023-10-03T10:12:43.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.734+0000 7f8aa4a78700 1 -- start start 2023-10-03T10:12:43.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.735+0000 7f2ae845d700 1 -- 172.21.15.146:0/1259866022 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ae0133f70 msgr2=0x7f2ae01343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.735+0000 7f2ae845d700 1 --2- 172.21.15.146:0/1259866022 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ae0133f70 0x7f2ae01343a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009870 tx=0x7f2ad0009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:43.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.735+0000 7f2ae845d700 1 -- 172.21.15.146:0/1259866022 shutdown_connections 2023-10-03T10:12:43.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.735+0000 7f2ae845d700 1 --2- 172.21.15.146:0/1259866022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ae009ad40 0x7f2ae0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.735+0000 7f2ae845d700 1 --2- 172.21.15.146:0/1259866022 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ae0133f70 0x7f2ae01343a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.735+0000 7f2ae845d700 1 -- 172.21.15.146:0/1259866022 >> 172.21.15.146:0/1259866022 conn(0x7f2ae0099c40 msgr2=0x7f2ae006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.735+0000 7f8aa4a78700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa0136930 0x7f8aa0138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.735+0000 7f8aa4a78700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8aa0139250 0x7f8aa013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.735+0000 7f8aa4a78700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa01337a0 con 0x7f8aa01339a0 2023-10-03T10:12:43.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.735+0000 7f8aa4a78700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa0096850 con 0x7f8aa0136930 2023-10-03T10:12:43.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.735+0000 7f8aa4a78700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa00962a0 con 0x7f8aa0139250 2023-10-03T10:12:43.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.735+0000 7f8a9e59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8aa01339a0 0x7f8aa0133d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54042/0 (socket says 172.21.15.146:54042) 2023-10-03T10:12:43.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.735+0000 7f8a9e59c700 1 -- 172.21.15.146:0/588463194 learned_addr learned my addr 172.21.15.146:0/588463194 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:43.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.735+0000 7f8a9ed9d700 1 --2- 172.21.15.146:0/588463194 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8aa0139250 0x7f8aa013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.735+0000 7f2ae845d700 1 -- 172.21.15.146:0/1259866022 shutdown_connections 2023-10-03T10:12:43.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.736+0000 7f2ae845d700 1 -- 172.21.15.146:0/1259866022 wait complete. 2023-10-03T10:12:43.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.736+0000 7f2ae845d700 1 Processor -- start 2023-10-03T10:12:43.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.736+0000 7f2ae845d700 1 -- start start 2023-10-03T10:12:43.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.736+0000 7f8a9dd9b700 1 --2- 172.21.15.146:0/588463194 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa0136930 0x7f8aa0138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f8a9ed9d700 1 -- 172.21.15.146:0/588463194 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa0136930 msgr2=0x7f8aa0138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:43.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f8a9ed9d700 1 --2- 172.21.15.146:0/588463194 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa0136930 0x7f8aa0138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f8a9ed9d700 1 -- 172.21.15.146:0/588463194 >> v1:172.21.15.146:6789/0 conn(0x7f8aa01339a0 legacy=0x7f8aa0133d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f8a9ed9d700 1 -- 172.21.15.146:0/588463194 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa0072af0 con 0x7f8aa0139250 2023-10-03T10:12:43.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f8a9d59a700 1 -- 172.21.15.146:0/588463194 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 158920626 0 0) 0x7f8aa01337a0 con 0x7f8aa01339a0 2023-10-03T10:12:43.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f8a9dd9b700 1 --2- 172.21.15.146:0/588463194 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa0136930 0x7f8aa0138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:43.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f8a9ed9d700 1 --2- 172.21.15.146:0/588463194 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8aa0139250 0x7f8aa013b630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8a98009dc0 tx=0x7f8a9800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11b702f4c56a8da5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f8a9d59a700 1 -- 172.21.15.146:0/588463194 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9800e070 con 0x7f8aa0139250 2023-10-03T10:12:43.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f8a9d59a700 1 -- 172.21.15.146:0/588463194 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9800bbd0 con 0x7f8aa0139250 2023-10-03T10:12:43.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f8a9d59a700 1 -- 172.21.15.146:0/588463194 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a98012430 con 0x7f8aa0139250 2023-10-03T10:12:43.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f2ae845d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ae009ad40 0x7f2ae011f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f2ae845d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ae00a0a70 0x7f2ae011f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f2ae845d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ae0133f70 0x7f2ae01c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f2ae845d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae00a51b0 con 0x7f2ae0133f70 2023-10-03T10:12:43.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f2ae845d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae009c7e0 con 0x7f2ae00a0a70 2023-10-03T10:12:43.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f2ae845d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae0120760 con 0x7f2ae009ad40 2023-10-03T10:12:43.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f2ae61f9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ae009ad40 0x7f2ae011f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f2ae59f8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ae00a0a70 0x7f2ae011f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f2ae61f9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ae009ad40 0x7f2ae011f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43296/0 (socket says 172.21.15.146:43296) 2023-10-03T10:12:43.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f2ae61f9700 1 -- 172.21.15.146:0/2023472676 learned_addr learned my addr 172.21.15.146:0/2023472676 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:43.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f2ae69fa700 1 --2- 172.21.15.146:0/2023472676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ae0133f70 0x7f2ae01c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f2ae61f9700 1 -- 172.21.15.146:0/2023472676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ae00a0a70 msgr2=0x7f2ae011f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f2ae61f9700 1 --2- 172.21.15.146:0/2023472676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ae00a0a70 0x7f2ae011f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f2ae61f9700 1 -- 172.21.15.146:0/2023472676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ae0133f70 msgr2=0x7f2ae01c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.737+0000 7f2ae61f9700 1 --2- 172.21.15.146:0/2023472676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ae0133f70 0x7f2ae01c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.738+0000 7f2ae61f9700 1 -- 172.21.15.146:0/2023472676 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad00094a0 con 0x7f2ae009ad40 2023-10-03T10:12:43.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.738+0000 7f2ae69fa700 1 --2- 172.21.15.146:0/2023472676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ae0133f70 0x7f2ae01c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:43.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.738+0000 7f2ae61f9700 1 --2- 172.21.15.146:0/2023472676 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ae009ad40 0x7f2ae011f480 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00e870 tx=0x7f2adc00eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.739+0000 7f8aa4a78700 1 -- 172.21.15.146:0/588463194 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8aa0139250 msgr2=0x7f8aa013b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.739+0000 7f8aa4a78700 1 --2- 172.21.15.146:0/588463194 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8aa0139250 0x7f8aa013b630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8a98009dc0 tx=0x7f8a9800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:43.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.738+0000 7f2ad6ffd700 1 -- 172.21.15.146:0/2023472676 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc009590 con 0x7f2ae009ad40 2023-10-03T10:12:43.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.738+0000 7f2ad6ffd700 1 -- 172.21.15.146:0/2023472676 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2adc013680 con 0x7f2ae009ad40 2023-10-03T10:12:43.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.738+0000 7f2ae845d700 1 -- 172.21.15.146:0/2023472676 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae0120ec0 con 0x7f2ae009ad40 2023-10-03T10:12:43.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.738+0000 7f2ad6ffd700 1 -- 172.21.15.146:0/2023472676 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc0139f0 con 0x7f2ae009ad40 2023-10-03T10:12:43.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.738+0000 7f2ae845d700 1 -- 172.21.15.146:0/2023472676 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae011ef70 con 0x7f2ae009ad40 2023-10-03T10:12:43.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.739+0000 7f8aa4a78700 1 -- 172.21.15.146:0/588463194 shutdown_connections 2023-10-03T10:12:43.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.739+0000 7f8aa4a78700 1 --2- 172.21.15.146:0/588463194 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8aa0139250 0x7f8aa013b630 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.739+0000 7f8aa4a78700 1 --2- 172.21.15.146:0/588463194 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa0136930 0x7f8aa0138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.739+0000 7f8aa4a78700 1 -- 172.21.15.146:0/588463194 >> 172.21.15.146:0/588463194 conn(0x7f8aa00a2eb0 msgr2=0x7f8aa009eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.739+0000 7f2ae845d700 1 -- 172.21.15.146:0/2023472676 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae004f2a0 con 0x7f2ae009ad40 2023-10-03T10:12:43.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.739+0000 7f2ad6ffd700 1 -- 172.21.15.146:0/2023472676 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2adc013b50 con 0x7f2ae009ad40 2023-10-03T10:12:43.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.739+0000 7f2ad6ffd700 1 -- 172.21.15.146:0/2023472676 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f2adc03fc20 con 0x7f2ae009ad40 2023-10-03T10:12:43.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.739+0000 7f2ae59f8700 1 -- 172.21.15.146:0/2023472676 >> v1:172.21.15.146:6816/126749 conn(0x7f2ac402f510 legacy=0x7f2ac40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:43.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.741+0000 7f8aa4a78700 1 -- 172.21.15.146:0/588463194 shutdown_connections 2023-10-03T10:12:43.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.741+0000 7f8aa4a78700 1 -- 172.21.15.146:0/588463194 wait complete. 2023-10-03T10:12:43.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.742+0000 7f8aa4a78700 1 Processor -- start 2023-10-03T10:12:43.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.742+0000 7f8aa4a78700 1 -- start start 2023-10-03T10:12:43.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.743+0000 7f8aa4a78700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa01339a0 0x7f8aa009ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.743+0000 7f8aa4a78700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8aa0136930 0x7f8aa009b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.743+0000 7f8aa4a78700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8aa0139250 0x7f8aa009b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.743+0000 7f8aa4a78700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa01c0820 con 0x7f8aa0139250 2023-10-03T10:12:43.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.743+0000 7f8aa4a78700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa0099ea0 con 0x7f8aa01339a0 2023-10-03T10:12:43.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.743+0000 7f8aa4a78700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa01c1160 con 0x7f8aa0136930 2023-10-03T10:12:43.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.743+0000 7f8a9e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa01339a0 0x7f8aa009ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.743+0000 7f8a9e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa01339a0 0x7f8aa009ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43122/0 (socket says 172.21.15.146:43122) 2023-10-03T10:12:43.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.743+0000 7f8a9e59c700 1 -- 172.21.15.146:0/1602527731 learned_addr learned my addr 172.21.15.146:0/1602527731 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:43.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.743+0000 7f8a9ed9d700 1 --2- 172.21.15.146:0/1602527731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8aa0139250 0x7f8aa009b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.743+0000 7f8a9e59c700 1 -- 172.21.15.146:0/1602527731 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8aa0136930 msgr2=0x7f8aa009b2a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:43.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.743+0000 7f8a9e59c700 1 --2- 172.21.15.146:0/1602527731 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8aa0136930 0x7f8aa009b2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.743+0000 7f8a9e59c700 1 -- 172.21.15.146:0/1602527731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8aa0139250 msgr2=0x7f8aa009b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.743+0000 7f8a9e59c700 1 --2- 172.21.15.146:0/1602527731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8aa0139250 0x7f8aa009b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.743+0000 7f8a9e59c700 1 -- 172.21.15.146:0/1602527731 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a98009a70 con 0x7f8aa01339a0 2023-10-03T10:12:43.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.743+0000 7f8a9e59c700 1 --2- 172.21.15.146:0/1602527731 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa01339a0 0x7f8aa009ad60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8a9000c550 tx=0x7f8a9000c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.744+0000 7f8a8effd700 1 -- 172.21.15.146:0/1602527731 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a90004c80 con 0x7f8aa01339a0 2023-10-03T10:12:43.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.744+0000 7f8a8effd700 1 -- 172.21.15.146:0/1602527731 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a90004e00 con 0x7f8aa01339a0 2023-10-03T10:12:43.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.744+0000 7f8a8effd700 1 -- 172.21.15.146:0/1602527731 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a90007310 con 0x7f8aa01339a0 2023-10-03T10:12:43.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.744+0000 7f8aa4a78700 1 -- 172.21.15.146:0/1602527731 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa01c0480 con 0x7f8aa01339a0 2023-10-03T10:12:43.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.744+0000 7f8aa4a78700 1 -- 172.21.15.146:0/1602527731 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa009a180 con 0x7f8aa01339a0 2023-10-03T10:12:43.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.745+0000 7f8a8effd700 1 -- 172.21.15.146:0/1602527731 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8a90007470 con 0x7f8aa01339a0 2023-10-03T10:12:43.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.745+0000 7f8a8effd700 1 -- 172.21.15.146:0/1602527731 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f8a9003f9f0 con 0x7f8aa01339a0 2023-10-03T10:12:43.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.745+0000 7f8a9dd9b700 1 -- 172.21.15.146:0/1602527731 >> v1:172.21.15.146:6816/126749 conn(0x7f8a8002f510 legacy=0x7f8a800319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:43.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.745+0000 7f8aa4a78700 1 -- 172.21.15.146:0/1602527731 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa0138e90 con 0x7f8aa01339a0 2023-10-03T10:12:43.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.746+0000 7f2ad6ffd700 1 -- 172.21.15.146:0/2023472676 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2adc00c970 con 0x7f2ae009ad40 2023-10-03T10:12:43.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.750+0000 7f8a8effd700 1 -- 172.21.15.146:0/1602527731 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a900123b0 con 0x7f8aa01339a0 2023-10-03T10:12:43.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.853+0000 7f0917fff700 1 -- 172.21.15.146:0/3517420019 >> v1:172.21.15.146:6816/126749 conn(0x7f08fc02f510 legacy=0x7f08fc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:43.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.864+0000 7f091ef7a700 1 -- 172.21.15.146:0/3517420019 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f091806c3b0 con 0x7f091809d860 2023-10-03T10:12:43.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.864+0000 7f09157fa700 1 -- 172.21.15.146:0/3517420019 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f090c01b3b0 con 0x7f091809d860 2023-10-03T10:12:43.864 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:43.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.866+0000 7f091ef7a700 1 -- 172.21.15.146:0/3517420019 >> v1:172.21.15.146:6816/126749 conn(0x7f08fc02f510 legacy=0x7f08fc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:43.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.866+0000 7f091ef7a700 1 -- 172.21.15.146:0/3517420019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f091809d860 msgr2=0x7f091811b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.866+0000 7f091ef7a700 1 --2- 172.21.15.146:0/3517420019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f091809d860 0x7f091811b5f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f090c00e930 tx=0x7f090c00ec40 comp rx=0 tx=0).stop 2023-10-03T10:12:43.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.866+0000 7f091ef7a700 1 -- 172.21.15.146:0/3517420019 shutdown_connections 2023-10-03T10:12:43.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.866+0000 7f091ef7a700 1 --2- 172.21.15.146:0/3517420019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0918130ce0 0x7f091811c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.866+0000 7f091ef7a700 1 --2- 172.21.15.146:0/3517420019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f091809d860 0x7f091811b5f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.866+0000 7f091ef7a700 1 --2- 172.21.15.146:0/3517420019 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f091809e170 0x7f091811bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.866+0000 7f091ef7a700 1 -- 172.21.15.146:0/3517420019 >> 172.21.15.146:0/3517420019 conn(0x7f0918099c40 msgr2=0x7f091806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.866+0000 7f091ef7a700 1 -- 172.21.15.146:0/3517420019 shutdown_connections 2023-10-03T10:12:43.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.866+0000 7f091ef7a700 1 -- 172.21.15.146:0/3517420019 wait complete. 2023-10-03T10:12:43.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:43.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.903+0000 7f367ad9d700 1 -- 172.21.15.146:0/1087874063 >> v1:172.21.15.146:6816/126749 conn(0x7f366802f510 legacy=0x7f36680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:43.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.917+0000 7f3681129700 1 -- 172.21.15.146:0/1087874063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f365c005860 con 0x7f367c1319f0 2023-10-03T10:12:43.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.918+0000 7f36637fe700 1 -- 172.21.15.146:0/1087874063 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3674001c20 con 0x7f367c1319f0 2023-10-03T10:12:43.917 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:43.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.919+0000 7f3681129700 1 -- 172.21.15.146:0/1087874063 >> v1:172.21.15.146:6816/126749 conn(0x7f366802f510 legacy=0x7f36680319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:43.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.919+0000 7f3681129700 1 -- 172.21.15.146:0/1087874063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f367c1319f0 msgr2=0x7f367c11c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.919+0000 7f3681129700 1 --2- 172.21.15.146:0/1087874063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f367c1319f0 0x7f367c11c140 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f367400cb90 tx=0x7f367400cea0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.920+0000 7f3681129700 1 -- 172.21.15.146:0/1087874063 shutdown_connections 2023-10-03T10:12:43.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.920+0000 7f3681129700 1 --2- 172.21.15.146:0/1087874063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f367c1319f0 0x7f367c11c140 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.920+0000 7f3681129700 1 --2- 172.21.15.146:0/1087874063 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f367c09bc70 0x7f367c11b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.920+0000 7f3681129700 1 --2- 172.21.15.146:0/1087874063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f367c09c5e0 0x7f367c11bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.920+0000 7f3681129700 1 -- 172.21.15.146:0/1087874063 >> 172.21.15.146:0/1087874063 conn(0x7f367c0a2980 msgr2=0x7f367c1b8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.920+0000 7f3681129700 1 -- 172.21.15.146:0/1087874063 shutdown_connections 2023-10-03T10:12:43.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.920+0000 7f3681129700 1 -- 172.21.15.146:0/1087874063 wait complete. 2023-10-03T10:12:43.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:43.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.940+0000 7f2ae59f8700 1 -- 172.21.15.146:0/2023472676 >> v1:172.21.15.146:6816/126749 conn(0x7f2ac402f510 legacy=0x7f2ac40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:43.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.941+0000 7f2ae845d700 1 -- 172.21.15.146:0/2023472676 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2ae00729d0 con 0x7f2ae009ad40 2023-10-03T10:12:43.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.942+0000 7f2ad6ffd700 1 -- 172.21.15.146:0/2023472676 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2adc01b3b0 con 0x7f2ae009ad40 2023-10-03T10:12:43.942 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.944+0000 7f2ae845d700 1 -- 172.21.15.146:0/2023472676 >> v1:172.21.15.146:6816/126749 conn(0x7f2ac402f510 legacy=0x7f2ac40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.944+0000 7f2ae845d700 1 -- 172.21.15.146:0/2023472676 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ae009ad40 msgr2=0x7f2ae011f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.944+0000 7f2ae845d700 1 --2- 172.21.15.146:0/2023472676 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ae009ad40 0x7f2ae011f480 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00e870 tx=0x7f2adc00eb80 comp rx=0 tx=0).stop 2023-10-03T10:12:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.944+0000 7f2ae845d700 1 -- 172.21.15.146:0/2023472676 shutdown_connections 2023-10-03T10:12:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.944+0000 7f2ae845d700 1 --2- 172.21.15.146:0/2023472676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ae0133f70 0x7f2ae01c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.944+0000 7f2ae845d700 1 --2- 172.21.15.146:0/2023472676 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ae009ad40 0x7f2ae011f480 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.944+0000 7f2ae845d700 1 --2- 172.21.15.146:0/2023472676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ae00a0a70 0x7f2ae011f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.944+0000 7f2ae845d700 1 -- 172.21.15.146:0/2023472676 >> 172.21.15.146:0/2023472676 conn(0x7f2ae0099c40 msgr2=0x7f2ae00a4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.944+0000 7f2ae845d700 1 -- 172.21.15.146:0/2023472676 shutdown_connections 2023-10-03T10:12:43.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.944+0000 7f2ae845d700 1 -- 172.21.15.146:0/2023472676 wait complete. 2023-10-03T10:12:43.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.946+0000 7f8a9dd9b700 1 -- 172.21.15.146:0/1602527731 >> v1:172.21.15.146:6816/126749 conn(0x7f8a8002f510 legacy=0x7f8a800319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:43.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.946+0000 7f8aa4a78700 1 -- 172.21.15.146:0/1602527731 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8aa0134450 con 0x7f8aa01339a0 2023-10-03T10:12:43.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.946+0000 7f8a8effd700 1 -- 172.21.15.146:0/1602527731 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a90011360 con 0x7f8aa01339a0 2023-10-03T10:12:43.946 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.948+0000 7f8aa4a78700 1 -- 172.21.15.146:0/1602527731 >> v1:172.21.15.146:6816/126749 conn(0x7f8a8002f510 legacy=0x7f8a800319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.948+0000 7f8aa4a78700 1 -- 172.21.15.146:0/1602527731 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa01339a0 msgr2=0x7f8aa009ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.948+0000 7f8aa4a78700 1 --2- 172.21.15.146:0/1602527731 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa01339a0 0x7f8aa009ad60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8a9000c550 tx=0x7f8a9000c860 comp rx=0 tx=0).stop 2023-10-03T10:12:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.948+0000 7f8aa4a78700 1 -- 172.21.15.146:0/1602527731 shutdown_connections 2023-10-03T10:12:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.948+0000 7f8aa4a78700 1 --2- 172.21.15.146:0/1602527731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8aa0139250 0x7f8aa009b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.948+0000 7f8aa4a78700 1 --2- 172.21.15.146:0/1602527731 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa01339a0 0x7f8aa009ad60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.948+0000 7f8aa4a78700 1 --2- 172.21.15.146:0/1602527731 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8aa0136930 0x7f8aa009b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.948+0000 7f8aa4a78700 1 -- 172.21.15.146:0/1602527731 >> 172.21.15.146:0/1602527731 conn(0x7f8aa00a2eb0 msgr2=0x7f8aa01357b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.948+0000 7f8aa4a78700 1 -- 172.21.15.146:0/1602527731 shutdown_connections 2023-10-03T10:12:43.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:43.948+0000 7f8aa4a78700 1 -- 172.21.15.146:0/1602527731 wait complete. 2023-10-03T10:12:43.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:43.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:44.883 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:44.932 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:44.958 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:44.962 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:45.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.029+0000 7f62b3818700 1 Processor -- start 2023-10-03T10:12:45.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.029+0000 7f62b3818700 1 -- start start 2023-10-03T10:12:45.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.030+0000 7f62b3818700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f62ac133ad0 0x7f62ac133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.030+0000 7f62b3818700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ac130bc0 0x7f62ac13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.030+0000 7f62b3818700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62ac06b2d0 con 0x7f62ac1300a0 2023-10-03T10:12:45.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.030+0000 7f62b3818700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ac133610 con 0x7f62ac133ad0 2023-10-03T10:12:45.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.030+0000 7f62b3818700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac09a500 con 0x7f62ac130bc0 2023-10-03T10:12:45.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.030+0000 7f62b1db5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ac130bc0 0x7f62ac13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.030+0000 7f62b1db5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ac130bc0 0x7f62ac13b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52474/0 (socket says 172.21.15.146:52474) 2023-10-03T10:12:45.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.030+0000 7f62b1db5700 1 -- 172.21.15.146:0/393692519 learned_addr learned my addr 172.21.15.146:0/393692519 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:45.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.030+0000 7f62b15b4700 1 --2- 172.21.15.146:0/393692519 >> v2:172.21.15.146:3300/0 conn(0x7f62ac133ad0 0x7f62ac133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.030+0000 7f62b1db5700 1 -- 172.21.15.146:0/393692519 >> v2:172.21.15.146:3300/0 conn(0x7f62ac133ad0 msgr2=0x7f62ac133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:45.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.030+0000 7f62b1db5700 1 --2- 172.21.15.146:0/393692519 >> v2:172.21.15.146:3300/0 conn(0x7f62ac133ad0 0x7f62ac133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.030+0000 7f62b1db5700 1 -- 172.21.15.146:0/393692519 >> v1:172.21.15.146:6789/0 conn(0x7f62ac1300a0 legacy=0x7f62ac1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.030+0000 7f62b1db5700 1 -- 172.21.15.146:0/393692519 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ac1338b0 con 0x7f62ac130bc0 2023-10-03T10:12:45.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.030+0000 7f62b15b4700 1 --2- 172.21.15.146:0/393692519 >> v2:172.21.15.146:3300/0 conn(0x7f62ac133ad0 0x7f62ac133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:45.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.031+0000 7f62b1db5700 1 --2- 172.21.15.146:0/393692519 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ac130bc0 0x7f62ac13b990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009e50 tx=0x7f62a400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88c68c77a34818e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.031+0000 7f62a3fff700 1 -- 172.21.15.146:0/393692519 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a400e070 con 0x7f62ac130bc0 2023-10-03T10:12:45.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.031+0000 7f62a3fff700 1 -- 172.21.15.146:0/393692519 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a400b910 con 0x7f62ac130bc0 2023-10-03T10:12:45.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.031+0000 7f62a3fff700 1 -- 172.21.15.146:0/393692519 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a400bcc0 con 0x7f62ac130bc0 2023-10-03T10:12:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.032+0000 7f62b3818700 1 -- 172.21.15.146:0/393692519 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ac130bc0 msgr2=0x7f62ac13b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.032+0000 7f62b3818700 1 --2- 172.21.15.146:0/393692519 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ac130bc0 0x7f62ac13b990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009e50 tx=0x7f62a400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.032+0000 7f62b3818700 1 -- 172.21.15.146:0/393692519 shutdown_connections 2023-10-03T10:12:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.032+0000 7f62b3818700 1 --2- 172.21.15.146:0/393692519 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ac130bc0 0x7f62ac13b990 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.032+0000 7f62b3818700 1 --2- 172.21.15.146:0/393692519 >> v2:172.21.15.146:3300/0 conn(0x7f62ac133ad0 0x7f62ac133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.032+0000 7f62b3818700 1 -- 172.21.15.146:0/393692519 >> 172.21.15.146:0/393692519 conn(0x7f62ac099c40 msgr2=0x7f62ac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.032+0000 7f62b3818700 1 -- 172.21.15.146:0/393692519 shutdown_connections 2023-10-03T10:12:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.032+0000 7f62b3818700 1 -- 172.21.15.146:0/393692519 wait complete. 2023-10-03T10:12:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.033+0000 7f62b3818700 1 Processor -- start 2023-10-03T10:12:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.033+0000 7f62b3818700 1 -- start start 2023-10-03T10:12:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.033+0000 7f62b3818700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62ac1300a0 0x7f62ac11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.033+0000 7f62b3818700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ac130bc0 0x7f62ac11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.033+0000 7f62b3818700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62ac133ad0 0x7f62ac11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.033+0000 7f62b3818700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac12d8f0 con 0x7f62ac133ad0 2023-10-03T10:12:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.033+0000 7f62b3818700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac11ffa0 con 0x7f62ac130bc0 2023-10-03T10:12:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.033+0000 7f62b3818700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac12dd00 con 0x7f62ac1300a0 2023-10-03T10:12:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.034+0000 7f62b1db5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62ac133ad0 0x7f62ac11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.034+0000 7f62b1db5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62ac133ad0 0x7f62ac11e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50974/0 (socket says 172.21.15.146:50974) 2023-10-03T10:12:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.034+0000 7f62b1db5700 1 -- 172.21.15.146:0/1952414654 learned_addr learned my addr 172.21.15.146:0/1952414654 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.034+0000 7f62b0db3700 1 --2- 172.21.15.146:0/1952414654 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ac130bc0 0x7f62ac11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.034+0000 7f62b15b4700 1 --2- 172.21.15.146:0/1952414654 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62ac1300a0 0x7f62ac11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.034+0000 7f62b1db5700 1 -- 172.21.15.146:0/1952414654 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62ac1300a0 msgr2=0x7f62ac11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.034+0000 7f62b1db5700 1 --2- 172.21.15.146:0/1952414654 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62ac1300a0 0x7f62ac11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.034+0000 7f62b1db5700 1 -- 172.21.15.146:0/1952414654 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ac130bc0 msgr2=0x7f62ac11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.034+0000 7f62b1db5700 1 --2- 172.21.15.146:0/1952414654 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ac130bc0 0x7f62ac11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.034+0000 7f62b1db5700 1 -- 172.21.15.146:0/1952414654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a80094a0 con 0x7f62ac133ad0 2023-10-03T10:12:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.034+0000 7f62b0db3700 1 --2- 172.21.15.146:0/1952414654 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ac130bc0 0x7f62ac11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.034+0000 7f62b1db5700 1 --2- 172.21.15.146:0/1952414654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62ac133ad0 0x7f62ac11e4c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f62ac09a640 tx=0x7f62a4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.034+0000 7f62a1ffb700 1 -- 172.21.15.146:0/1952414654 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a40048b0 con 0x7f62ac133ad0 2023-10-03T10:12:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.034+0000 7f62a1ffb700 1 -- 172.21.15.146:0/1952414654 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a40092e0 con 0x7f62ac133ad0 2023-10-03T10:12:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.034+0000 7f62b3818700 1 -- 172.21.15.146:0/1952414654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a4009b30 con 0x7f62ac133ad0 2023-10-03T10:12:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.034+0000 7f62a1ffb700 1 -- 172.21.15.146:0/1952414654 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a401c660 con 0x7f62ac133ad0 2023-10-03T10:12:45.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.035+0000 7f62b3818700 1 -- 172.21.15.146:0/1952414654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ac11f2e0 con 0x7f62ac133ad0 2023-10-03T10:12:45.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.035+0000 7f62a1ffb700 1 -- 172.21.15.146:0/1952414654 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f62a401c7c0 con 0x7f62ac133ad0 2023-10-03T10:12:45.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.036+0000 7f62a1ffb700 1 -- 172.21.15.146:0/1952414654 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f62a4041980 con 0x7f62ac133ad0 2023-10-03T10:12:45.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.036+0000 7f62b15b4700 1 -- 172.21.15.146:0/1952414654 >> v1:172.21.15.146:6816/126749 conn(0x7f629002f540 legacy=0x7f62900319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:45.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.036+0000 7f62b3818700 1 -- 172.21.15.146:0/1952414654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62ac04f2a0 con 0x7f62ac133ad0 2023-10-03T10:12:45.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.041+0000 7f62a1ffb700 1 -- 172.21.15.146:0/1952414654 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62a40257d0 con 0x7f62ac133ad0 2023-10-03T10:12:45.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.072+0000 7fca0e8e3700 1 Processor -- start 2023-10-03T10:12:45.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.072+0000 7fca0e8e3700 1 -- start start 2023-10-03T10:12:45.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.073+0000 7fca0e8e3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca0809e870 0x7fca0809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.073+0000 7fca0e8e3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fca0809f180 0x7fca08131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.073+0000 7fca0e8e3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0809c970 con 0x7fca08131d70 2023-10-03T10:12:45.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.073+0000 7fca0e8e3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca080a0920 con 0x7fca0809e870 2023-10-03T10:12:45.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.073+0000 7fca0e8e3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca0809f9c0 con 0x7fca0809f180 2023-10-03T10:12:45.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.073+0000 7fca0ce80700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fca08131d70 0x7fca08138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53258/0 (socket says 172.21.15.146:53258) 2023-10-03T10:12:45.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.073+0000 7fca0ce80700 1 -- 172.21.15.146:0/955519051 learned_addr learned my addr 172.21.15.146:0/955519051 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:45.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.073+0000 7fca07fff700 1 --2- 172.21.15.146:0/955519051 >> v2:172.21.15.146:3300/0 conn(0x7fca0809e870 0x7fca0809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.073+0000 7fca077fe700 1 --2- 172.21.15.146:0/955519051 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fca0809f180 0x7fca08131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.073+0000 7fca077fe700 1 -- 172.21.15.146:0/955519051 >> v2:172.21.15.146:3300/0 conn(0x7fca0809e870 msgr2=0x7fca0809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:45.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.073+0000 7fca077fe700 1 --2- 172.21.15.146:0/955519051 >> v2:172.21.15.146:3300/0 conn(0x7fca0809e870 0x7fca0809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.073+0000 7fca077fe700 1 -- 172.21.15.146:0/955519051 >> v1:172.21.15.146:6789/0 conn(0x7fca08131d70 legacy=0x7fca08138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.073+0000 7fca077fe700 1 -- 172.21.15.146:0/955519051 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0809bab0 con 0x7fca0809f180 2023-10-03T10:12:45.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.073+0000 7fca07fff700 1 --2- 172.21.15.146:0/955519051 >> v2:172.21.15.146:3300/0 conn(0x7fca0809e870 0x7fca0809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:45.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.073+0000 7fca077fe700 1 --2- 172.21.15.146:0/955519051 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fca0809f180 0x7fca08131830 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009840 tx=0x7fc9fc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeff18691f3d8a0b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.074+0000 7fca06ffd700 1 -- 172.21.15.146:0/955519051 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc011830 con 0x7fca0809f180 2023-10-03T10:12:45.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.074+0000 7fca06ffd700 1 -- 172.21.15.146:0/955519051 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9fc011990 con 0x7fca0809f180 2023-10-03T10:12:45.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.074+0000 7fca06ffd700 1 -- 172.21.15.146:0/955519051 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc011d20 con 0x7fca0809f180 2023-10-03T10:12:45.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.074+0000 7fca0e8e3700 1 -- 172.21.15.146:0/955519051 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fca0809f180 msgr2=0x7fca08131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.074+0000 7fca0e8e3700 1 --2- 172.21.15.146:0/955519051 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fca0809f180 0x7fca08131830 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009840 tx=0x7fc9fc009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:45.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.074+0000 7fca0e8e3700 1 -- 172.21.15.146:0/955519051 shutdown_connections 2023-10-03T10:12:45.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.074+0000 7fca0e8e3700 1 --2- 172.21.15.146:0/955519051 >> v2:172.21.15.146:3300/0 conn(0x7fca0809e870 0x7fca0809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.074+0000 7fca0e8e3700 1 --2- 172.21.15.146:0/955519051 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fca0809f180 0x7fca08131830 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.074+0000 7fca0e8e3700 1 -- 172.21.15.146:0/955519051 >> 172.21.15.146:0/955519051 conn(0x7fca080a4430 msgr2=0x7fca080a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.074+0000 7fca0e8e3700 1 -- 172.21.15.146:0/955519051 shutdown_connections 2023-10-03T10:12:45.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.075+0000 7fca0e8e3700 1 -- 172.21.15.146:0/955519051 wait complete. 2023-10-03T10:12:45.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.075+0000 7fca0e8e3700 1 Processor -- start 2023-10-03T10:12:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.076+0000 7fca0e8e3700 1 -- start start 2023-10-03T10:12:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.076+0000 7fca0e8e3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca0809e870 0x7fca0806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.076+0000 7fca0e8e3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fca0809f180 0x7fca0806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.076+0000 7fca0e8e3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca08131d70 0x7fca0806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.076+0000 7fca0e8e3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca08131010 con 0x7fca0809e870 2023-10-03T10:12:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.076+0000 7fca0e8e3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0806d550 con 0x7fca08131d70 2023-10-03T10:12:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.076+0000 7fca0e8e3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca0809dba0 con 0x7fca0809f180 2023-10-03T10:12:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.076+0000 7fca077fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fca0809f180 0x7fca0806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.076+0000 7fca077fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fca0809f180 0x7fca0806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40492/0 (socket says 172.21.15.146:40492) 2023-10-03T10:12:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.076+0000 7fca077fe700 1 -- 172.21.15.146:0/225722297 learned_addr learned my addr 172.21.15.146:0/225722297 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.076+0000 7fca0ce80700 1 --2- 172.21.15.146:0/225722297 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca08131d70 0x7fca0806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.076+0000 7fca07fff700 1 --2- 172.21.15.146:0/225722297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca0809e870 0x7fca0806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.077+0000 7fca077fe700 1 -- 172.21.15.146:0/225722297 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca08131d70 msgr2=0x7fca0806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.077+0000 7fca077fe700 1 --2- 172.21.15.146:0/225722297 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca08131d70 0x7fca0806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.077+0000 7fca077fe700 1 -- 172.21.15.146:0/225722297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca0809e870 msgr2=0x7fca0806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.077+0000 7fca077fe700 1 --2- 172.21.15.146:0/225722297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca0809e870 0x7fca0806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.077+0000 7fca077fe700 1 -- 172.21.15.146:0/225722297 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f80094a0 con 0x7fca0809f180 2023-10-03T10:12:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.077+0000 7fca077fe700 1 --2- 172.21.15.146:0/225722297 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fca0809f180 0x7fca0806bdf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009fd0 tx=0x7fc9fc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.077+0000 7fca04ff9700 1 -- 172.21.15.146:0/225722297 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc0036a0 con 0x7fca0809f180 2023-10-03T10:12:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.077+0000 7fca04ff9700 1 -- 172.21.15.146:0/225722297 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9fc01f070 con 0x7fca0809f180 2023-10-03T10:12:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.077+0000 7fca04ff9700 1 -- 172.21.15.146:0/225722297 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc003a60 con 0x7fca0809f180 2023-10-03T10:12:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.077+0000 7fca0e8e3700 1 -- 172.21.15.146:0/225722297 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9fc0094a0 con 0x7fca0809f180 2023-10-03T10:12:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.077+0000 7fca0e8e3700 1 -- 172.21.15.146:0/225722297 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca08125d50 con 0x7fca0809f180 2023-10-03T10:12:45.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.078+0000 7fca04ff9700 1 -- 172.21.15.146:0/225722297 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc9fc003bc0 con 0x7fca0809f180 2023-10-03T10:12:45.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.078+0000 7fca0e8e3700 1 -- 172.21.15.146:0/225722297 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0804f2a0 con 0x7fca0809f180 2023-10-03T10:12:45.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.078+0000 7fca04ff9700 1 -- 172.21.15.146:0/225722297 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fc9fc021070 con 0x7fca0809f180 2023-10-03T10:12:45.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.078+0000 7fca07fff700 1 -- 172.21.15.146:0/225722297 >> v1:172.21.15.146:6816/126749 conn(0x7fc9f402f510 legacy=0x7fc9f40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:45.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.083+0000 7fca04ff9700 1 -- 172.21.15.146:0/225722297 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc9fc02fd70 con 0x7fca0809f180 2023-10-03T10:12:45.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.112+0000 7fd96d38d700 1 Processor -- start 2023-10-03T10:12:45.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.112+0000 7fd96d38d700 1 -- start start 2023-10-03T10:12:45.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.112+0000 7fd96d38d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9680a0a30 0x7fd9680a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.112+0000 7fd96d38d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd9680a1340 0x7fd96812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.112+0000 7fd96d38d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9680a1e70 con 0x7fd9681304a0 2023-10-03T10:12:45.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.112+0000 7fd96d38d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96809a720 con 0x7fd9680a1340 2023-10-03T10:12:45.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.112+0000 7fd96d38d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96809b300 con 0x7fd9680a0a30 2023-10-03T10:12:45.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.113+0000 7fd9667fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd9680a1340 0x7fd96812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.113+0000 7fd9677fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd9681304a0 0x7fd9681371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53262/0 (socket says 172.21.15.146:53262) 2023-10-03T10:12:45.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.113+0000 7fd9677fe700 1 -- 172.21.15.146:0/2565794337 learned_addr learned my addr 172.21.15.146:0/2565794337 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:45.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.113+0000 7fd966ffd700 1 --2- 172.21.15.146:0/2565794337 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9680a0a30 0x7fd9680a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.113+0000 7fd9667fc700 1 -- 172.21.15.146:0/2565794337 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9680a0a30 msgr2=0x7fd9680a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:45.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.113+0000 7fd9667fc700 1 --2- 172.21.15.146:0/2565794337 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9680a0a30 0x7fd9680a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.113+0000 7fd9667fc700 1 -- 172.21.15.146:0/2565794337 >> v1:172.21.15.146:6789/0 conn(0x7fd9681304a0 legacy=0x7fd9681371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.113+0000 7fd9667fc700 1 -- 172.21.15.146:0/2565794337 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96809abc0 con 0x7fd9680a1340 2023-10-03T10:12:45.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.113+0000 7fd9667fc700 1 --2- 172.21.15.146:0/2565794337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9680a1340 0x7fd96812ff60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009840 tx=0x7fd95c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e63a917a85844e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.113+0000 7fd965ffb700 1 -- 172.21.15.146:0/2565794337 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c011830 con 0x7fd9680a1340 2023-10-03T10:12:45.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.113+0000 7fd965ffb700 1 -- 172.21.15.146:0/2565794337 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c011990 con 0x7fd9680a1340 2023-10-03T10:12:45.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.113+0000 7fd965ffb700 1 -- 172.21.15.146:0/2565794337 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c011d20 con 0x7fd9680a1340 2023-10-03T10:12:45.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.114+0000 7fd96d38d700 1 -- 172.21.15.146:0/2565794337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9680a1340 msgr2=0x7fd96812ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.114+0000 7fd96d38d700 1 --2- 172.21.15.146:0/2565794337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9680a1340 0x7fd96812ff60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009840 tx=0x7fd95c009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:45.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.114+0000 7fd96d38d700 1 -- 172.21.15.146:0/2565794337 shutdown_connections 2023-10-03T10:12:45.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.114+0000 7fd96d38d700 1 --2- 172.21.15.146:0/2565794337 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9680a0a30 0x7fd9680a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.114+0000 7fd96d38d700 1 --2- 172.21.15.146:0/2565794337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9680a1340 0x7fd96812ff60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.114+0000 7fd96d38d700 1 -- 172.21.15.146:0/2565794337 >> 172.21.15.146:0/2565794337 conn(0x7fd9680a2980 msgr2=0x7fd9680a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.114+0000 7fd96d38d700 1 -- 172.21.15.146:0/2565794337 shutdown_connections 2023-10-03T10:12:45.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.114+0000 7fd96d38d700 1 -- 172.21.15.146:0/2565794337 wait complete. 2023-10-03T10:12:45.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.115+0000 7fd96d38d700 1 Processor -- start 2023-10-03T10:12:45.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.116+0000 7fd96d38d700 1 -- start start 2023-10-03T10:12:45.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.116+0000 7fd96d38d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9680a0a30 0x7fd96811a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.116+0000 7fd96d38d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9680a1340 0x7fd96811ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.116+0000 7fd96d38d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9681304a0 0x7fd96811b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.116+0000 7fd96d38d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96811e030 con 0x7fd9680a0a30 2023-10-03T10:12:45.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.116+0000 7fd96d38d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd968072720 con 0x7fd9680a1340 2023-10-03T10:12:45.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.116+0000 7fd96d38d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd96811c510 con 0x7fd9681304a0 2023-10-03T10:12:45.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.116+0000 7fd966ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9680a0a30 0x7fd96811a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.116+0000 7fd966ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9680a0a30 0x7fd96811a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51000/0 (socket says 172.21.15.146:51000) 2023-10-03T10:12:45.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.116+0000 7fd966ffd700 1 -- 172.21.15.146:0/3069055688 learned_addr learned my addr 172.21.15.146:0/3069055688 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:45.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.116+0000 7fd9667fc700 1 --2- 172.21.15.146:0/3069055688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9680a1340 0x7fd96811ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.116+0000 7fd9677fe700 1 --2- 172.21.15.146:0/3069055688 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9681304a0 0x7fd96811b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.117+0000 7fd9677fe700 1 -- 172.21.15.146:0/3069055688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9680a1340 msgr2=0x7fd96811ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.117+0000 7fd9677fe700 1 --2- 172.21.15.146:0/3069055688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9680a1340 0x7fd96811ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.117+0000 7fd9677fe700 1 -- 172.21.15.146:0/3069055688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9680a0a30 msgr2=0x7fd96811a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.117+0000 7fd9677fe700 1 --2- 172.21.15.146:0/3069055688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9680a0a30 0x7fd96811a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.117+0000 7fd9677fe700 1 -- 172.21.15.146:0/3069055688 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c0094a0 con 0x7fd9681304a0 2023-10-03T10:12:45.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.117+0000 7fd9667fc700 1 --2- 172.21.15.146:0/3069055688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9680a1340 0x7fd96811ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:45.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.117+0000 7fd966ffd700 1 --2- 172.21.15.146:0/3069055688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9680a0a30 0x7fd96811a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:45.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.117+0000 7fd9677fe700 1 --2- 172.21.15.146:0/3069055688 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9681304a0 0x7fd96811b2c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd96000cad0 tx=0x7fd96000cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.117+0000 7fd94f7fe700 1 -- 172.21.15.146:0/3069055688 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96000ce50 con 0x7fd9681304a0 2023-10-03T10:12:45.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.117+0000 7fd94f7fe700 1 -- 172.21.15.146:0/3069055688 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96000a7a0 con 0x7fd9681304a0 2023-10-03T10:12:45.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.117+0000 7fd96d38d700 1 -- 172.21.15.146:0/3069055688 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96809ae00 con 0x7fd9681304a0 2023-10-03T10:12:45.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.117+0000 7fd96d38d700 1 -- 172.21.15.146:0/3069055688 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96811e810 con 0x7fd9681304a0 2023-10-03T10:12:45.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.117+0000 7fd94f7fe700 1 -- 172.21.15.146:0/3069055688 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96000ab30 con 0x7fd9681304a0 2023-10-03T10:12:45.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.118+0000 7fd94f7fe700 1 -- 172.21.15.146:0/3069055688 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd96000ac90 con 0x7fd9681304a0 2023-10-03T10:12:45.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.119+0000 7fd96d38d700 1 -- 172.21.15.146:0/3069055688 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9480052e0 con 0x7fd9681304a0 2023-10-03T10:12:45.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.119+0000 7fd966ffd700 1 -- 172.21.15.146:0/3069055688 >> v1:172.21.15.146:6816/126749 conn(0x7fd95402f510 legacy=0x7fd9540319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:45.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.119+0000 7fd94f7fe700 1 -- 172.21.15.146:0/3069055688 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fd96003fd50 con 0x7fd9681304a0 2023-10-03T10:12:45.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.123+0000 7fd94f7fe700 1 -- 172.21.15.146:0/3069055688 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd960022300 con 0x7fd9681304a0 2023-10-03T10:12:45.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.142+0000 7f3bee79f700 1 Processor -- start 2023-10-03T10:12:45.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.142+0000 7f3bee79f700 1 -- start start 2023-10-03T10:12:45.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.142+0000 7f3bee79f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3be8137d30 0x7f3be8138100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.142+0000 7f3bee79f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3be809a060 0x7f3be806f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.142+0000 7f3bee79f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3be806f5b0 0x7f3be806fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.142+0000 7f3bee79f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be8071f80 con 0x7f3be809a060 2023-10-03T10:12:45.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.142+0000 7f3bee79f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be80a0020 con 0x7f3be806f5b0 2023-10-03T10:12:45.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.143+0000 7f3bee79f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3be80708c0 con 0x7f3be8137d30 2023-10-03T10:12:45.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.143+0000 7f3bedf9e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3be806f5b0 0x7f3be806fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.143+0000 7f3bedf9e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3be806f5b0 0x7f3be806fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52522/0 (socket says 172.21.15.146:52522) 2023-10-03T10:12:45.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.143+0000 7f3bedf9e700 1 -- 172.21.15.146:0/92264624 learned_addr learned my addr 172.21.15.146:0/92264624 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:45.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.143+0000 7f3becf9c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3be809a060 0x7f3be806f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.143+0000 7f3bed79d700 1 --2- 172.21.15.146:0/92264624 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3be8137d30 0x7f3be8138100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.143+0000 7f3bedf9e700 1 -- 172.21.15.146:0/92264624 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3be8137d30 msgr2=0x7f3be8138100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:45.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.143+0000 7f3bedf9e700 1 --2- 172.21.15.146:0/92264624 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3be8137d30 0x7f3be8138100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.143+0000 7f3bedf9e700 1 -- 172.21.15.146:0/92264624 >> v2:172.21.15.146:3300/0 conn(0x7f3be809a060 msgr2=0x7f3be806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:45.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.143+0000 7f3bedf9e700 1 --2- 172.21.15.146:0/92264624 >> v2:172.21.15.146:3300/0 conn(0x7f3be809a060 0x7f3be806f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.143+0000 7f3bedf9e700 1 -- 172.21.15.146:0/92264624 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be8138640 con 0x7f3be806f5b0 2023-10-03T10:12:45.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.143+0000 7f3becf9c700 1 --2- 172.21.15.146:0/92264624 >> v2:172.21.15.146:3300/0 conn(0x7f3be809a060 0x7f3be806f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:45.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.143+0000 7f3bedf9e700 1 --2- 172.21.15.146:0/92264624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3be806f5b0 0x7f3be806fa20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009e50 tx=0x7f3be000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86fb8e673e9834c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.144+0000 7f3bdffff700 1 -- 172.21.15.146:0/92264624 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be000e070 con 0x7f3be806f5b0 2023-10-03T10:12:45.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.144+0000 7f3bdffff700 1 -- 172.21.15.146:0/92264624 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be000b910 con 0x7f3be806f5b0 2023-10-03T10:12:45.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.144+0000 7f3bdffff700 1 -- 172.21.15.146:0/92264624 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be000bcc0 con 0x7f3be806f5b0 2023-10-03T10:12:45.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.144+0000 7f3bee79f700 1 -- 172.21.15.146:0/92264624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3be806f5b0 msgr2=0x7f3be806fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.144+0000 7f3bee79f700 1 --2- 172.21.15.146:0/92264624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3be806f5b0 0x7f3be806fa20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009e50 tx=0x7f3be000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:45.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.144+0000 7f3bee79f700 1 -- 172.21.15.146:0/92264624 shutdown_connections 2023-10-03T10:12:45.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.144+0000 7f3bee79f700 1 --2- 172.21.15.146:0/92264624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3be806f5b0 0x7f3be806fa20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.144+0000 7f3bee79f700 1 --2- 172.21.15.146:0/92264624 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3be8137d30 0x7f3be8138100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.144+0000 7f3bee79f700 1 --2- 172.21.15.146:0/92264624 >> v2:172.21.15.146:3300/0 conn(0x7f3be809a060 0x7f3be806f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.144+0000 7f3bee79f700 1 -- 172.21.15.146:0/92264624 >> 172.21.15.146:0/92264624 conn(0x7f3be80a27a0 msgr2=0x7f3be80a2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.145+0000 7f3bee79f700 1 -- 172.21.15.146:0/92264624 shutdown_connections 2023-10-03T10:12:45.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.145+0000 7f3bee79f700 1 -- 172.21.15.146:0/92264624 wait complete. 2023-10-03T10:12:45.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.146+0000 7f3bee79f700 1 Processor -- start 2023-10-03T10:12:45.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.146+0000 7f3bee79f700 1 -- start start 2023-10-03T10:12:45.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.146+0000 7f3bee79f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3be806f5b0 0x7f3be809d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.146+0000 7f3bee79f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3be809a060 0x7f3be8133750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.146+0000 7f3bee79f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3be8137d30 0x7f3be8133c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:45.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.146+0000 7f3bee79f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be809dfb0 con 0x7f3be8137d30 2023-10-03T10:12:45.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.146+0000 7f3bee79f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be809ddc0 con 0x7f3be806f5b0 2023-10-03T10:12:45.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.146+0000 7f3bee79f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3be809f4d0 con 0x7f3be809a060 2023-10-03T10:12:45.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.146+0000 7f3bedf9e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3be8137d30 0x7f3be8133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.146+0000 7f3bedf9e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3be8137d30 0x7f3be8133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51016/0 (socket says 172.21.15.146:51016) 2023-10-03T10:12:45.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.146+0000 7f3bedf9e700 1 -- 172.21.15.146:0/261680359 learned_addr learned my addr 172.21.15.146:0/261680359 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:45.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.146+0000 7f3becf9c700 1 --2- 172.21.15.146:0/261680359 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3be809a060 0x7f3be8133750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:45.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.146+0000 7f3bedf9e700 1 -- 172.21.15.146:0/261680359 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3be809a060 msgr2=0x7f3be8133750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.146+0000 7f3bedf9e700 1 --2- 172.21.15.146:0/261680359 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3be809a060 0x7f3be8133750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.146+0000 7f3bedf9e700 1 -- 172.21.15.146:0/261680359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3be806f5b0 msgr2=0x7f3be809d1c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:45.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.146+0000 7f3bedf9e700 1 --2- 172.21.15.146:0/261680359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3be806f5b0 0x7f3be809d1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.146+0000 7f3bedf9e700 1 -- 172.21.15.146:0/261680359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd80094a0 con 0x7f3be8137d30 2023-10-03T10:12:45.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.147+0000 7f3bedf9e700 1 --2- 172.21.15.146:0/261680359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3be8137d30 0x7f3be8133c90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3be0003f50 tx=0x7f3be0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:45.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.147+0000 7f3bddffb700 1 -- 172.21.15.146:0/261680359 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be000ce80 con 0x7f3be8137d30 2023-10-03T10:12:45.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.147+0000 7f3bddffb700 1 -- 172.21.15.146:0/261680359 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be0004250 con 0x7f3be8137d30 2023-10-03T10:12:45.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.147+0000 7f3bee79f700 1 -- 172.21.15.146:0/261680359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be0009b30 con 0x7f3be8137d30 2023-10-03T10:12:45.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.147+0000 7f3bddffb700 1 -- 172.21.15.146:0/261680359 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0004600 con 0x7f3be8137d30 2023-10-03T10:12:45.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.147+0000 7f3bee79f700 1 -- 172.21.15.146:0/261680359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be809ebc0 con 0x7f3be8137d30 2023-10-03T10:12:45.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.148+0000 7f3bddffb700 1 -- 172.21.15.146:0/261680359 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3be0004760 con 0x7f3be8137d30 2023-10-03T10:12:45.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.148+0000 7f3bee79f700 1 -- 172.21.15.146:0/261680359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be804f2a0 con 0x7f3be8137d30 2023-10-03T10:12:45.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.148+0000 7f3bddffb700 1 -- 172.21.15.146:0/261680359 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f3be0040c70 con 0x7f3be8137d30 2023-10-03T10:12:45.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.148+0000 7f3bed79d700 1 -- 172.21.15.146:0/261680359 >> v1:172.21.15.146:6816/126749 conn(0x7f3bcc02f510 legacy=0x7f3bcc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:45.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.153+0000 7f3bddffb700 1 -- 172.21.15.146:0/261680359 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3be0019320 con 0x7f3be8137d30 2023-10-03T10:12:45.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.237+0000 7f62b15b4700 1 -- 172.21.15.146:0/1952414654 >> v1:172.21.15.146:6816/126749 conn(0x7f629002f540 legacy=0x7f62900319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.278+0000 7f62b3818700 1 -- 172.21.15.146:0/1952414654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f62ac06c3b0 con 0x7f62ac133ad0 2023-10-03T10:12:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.278+0000 7f62a1ffb700 1 -- 172.21.15.146:0/1952414654 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f62a402db40 con 0x7f62ac133ad0 2023-10-03T10:12:45.278 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.279+0000 7fca07fff700 1 -- 172.21.15.146:0/225722297 >> v1:172.21.15.146:6816/126749 conn(0x7fc9f402f510 legacy=0x7fc9f40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.280+0000 7f62b3818700 1 -- 172.21.15.146:0/1952414654 >> v1:172.21.15.146:6816/126749 conn(0x7f629002f540 legacy=0x7f62900319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.280+0000 7f62b3818700 1 -- 172.21.15.146:0/1952414654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62ac133ad0 msgr2=0x7f62ac11e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.280+0000 7f62b3818700 1 --2- 172.21.15.146:0/1952414654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62ac133ad0 0x7f62ac11e4c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f62ac09a640 tx=0x7f62a4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.280+0000 7f62b3818700 1 -- 172.21.15.146:0/1952414654 shutdown_connections 2023-10-03T10:12:45.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.280+0000 7f62b3818700 1 --2- 172.21.15.146:0/1952414654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62ac133ad0 0x7f62ac11e4c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.280+0000 7f62b3818700 1 --2- 172.21.15.146:0/1952414654 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62ac1300a0 0x7f62ac11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.280+0000 7f62b3818700 1 --2- 172.21.15.146:0/1952414654 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62ac130bc0 0x7f62ac11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.280+0000 7f62b3818700 1 -- 172.21.15.146:0/1952414654 >> 172.21.15.146:0/1952414654 conn(0x7f62ac099c40 msgr2=0x7f62ac12e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.280+0000 7f62b3818700 1 -- 172.21.15.146:0/1952414654 shutdown_connections 2023-10-03T10:12:45.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.281+0000 7f62b3818700 1 -- 172.21.15.146:0/1952414654 wait complete. 2023-10-03T10:12:45.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.281+0000 7fca0e8e3700 1 -- 172.21.15.146:0/225722297 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fca0806b2a0 con 0x7fca0809f180 2023-10-03T10:12:45.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.282+0000 7fca04ff9700 1 -- 172.21.15.146:0/225722297 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc9fc015090 con 0x7fca0809f180 2023-10-03T10:12:45.282 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:45.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.284+0000 7fca0e8e3700 1 -- 172.21.15.146:0/225722297 >> v1:172.21.15.146:6816/126749 conn(0x7fc9f402f510 legacy=0x7fc9f40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:45.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.284+0000 7fca0e8e3700 1 -- 172.21.15.146:0/225722297 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fca0809f180 msgr2=0x7fca0806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.284+0000 7fca0e8e3700 1 --2- 172.21.15.146:0/225722297 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fca0809f180 0x7fca0806bdf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009fd0 tx=0x7fc9fc004750 comp rx=0 tx=0).stop 2023-10-03T10:12:45.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.285+0000 7fca0e8e3700 1 -- 172.21.15.146:0/225722297 shutdown_connections 2023-10-03T10:12:45.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.285+0000 7fca0e8e3700 1 --2- 172.21.15.146:0/225722297 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca08131d70 0x7fca0806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.285+0000 7fca0e8e3700 1 --2- 172.21.15.146:0/225722297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca0809e870 0x7fca0806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.285+0000 7fca0e8e3700 1 --2- 172.21.15.146:0/225722297 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fca0809f180 0x7fca0806bdf0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.285+0000 7fca0e8e3700 1 -- 172.21.15.146:0/225722297 >> 172.21.15.146:0/225722297 conn(0x7fca080a4430 msgr2=0x7fca080a0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.285+0000 7fca0e8e3700 1 -- 172.21.15.146:0/225722297 shutdown_connections 2023-10-03T10:12:45.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.285+0000 7fca0e8e3700 1 -- 172.21.15.146:0/225722297 wait complete. 2023-10-03T10:12:45.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:45.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:45.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.320+0000 7fd966ffd700 1 -- 172.21.15.146:0/3069055688 >> v1:172.21.15.146:6816/126749 conn(0x7fd95402f510 legacy=0x7fd9540319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:45.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.321+0000 7fd96d38d700 1 -- 172.21.15.146:0/3069055688 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd948005860 con 0x7fd9681304a0 2023-10-03T10:12:45.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.322+0000 7fd94f7fe700 1 -- 172.21.15.146:0/3069055688 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd960016070 con 0x7fd9681304a0 2023-10-03T10:12:45.322 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:45.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.324+0000 7fd96d38d700 1 -- 172.21.15.146:0/3069055688 >> v1:172.21.15.146:6816/126749 conn(0x7fd95402f510 legacy=0x7fd9540319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:45.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.324+0000 7fd96d38d700 1 -- 172.21.15.146:0/3069055688 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9681304a0 msgr2=0x7fd96811b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.324+0000 7fd96d38d700 1 --2- 172.21.15.146:0/3069055688 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9681304a0 0x7fd96811b2c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd96000cad0 tx=0x7fd96000cde0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.324+0000 7fd96d38d700 1 -- 172.21.15.146:0/3069055688 shutdown_connections 2023-10-03T10:12:45.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.324+0000 7fd96d38d700 1 --2- 172.21.15.146:0/3069055688 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9681304a0 0x7fd96811b2c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.324+0000 7fd96d38d700 1 --2- 172.21.15.146:0/3069055688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9680a0a30 0x7fd96811a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.324+0000 7fd96d38d700 1 --2- 172.21.15.146:0/3069055688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9680a1340 0x7fd96811ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.324+0000 7fd96d38d700 1 -- 172.21.15.146:0/3069055688 >> 172.21.15.146:0/3069055688 conn(0x7fd9680a2980 msgr2=0x7fd96809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.324+0000 7fd96d38d700 1 -- 172.21.15.146:0/3069055688 shutdown_connections 2023-10-03T10:12:45.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.324+0000 7fd96d38d700 1 -- 172.21.15.146:0/3069055688 wait complete. 2023-10-03T10:12:45.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:45.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.349+0000 7f3bed79d700 1 -- 172.21.15.146:0/261680359 >> v1:172.21.15.146:6816/126749 conn(0x7f3bcc02f510 legacy=0x7f3bcc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:45.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.350+0000 7f3bee79f700 1 -- 172.21.15.146:0/261680359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3be806b930 con 0x7f3be8137d30 2023-10-03T10:12:45.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.350+0000 7f3bddffb700 1 -- 172.21.15.146:0/261680359 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3be0011b40 con 0x7f3be8137d30 2023-10-03T10:12:45.350 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:45.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.352+0000 7f3bee79f700 1 -- 172.21.15.146:0/261680359 >> v1:172.21.15.146:6816/126749 conn(0x7f3bcc02f510 legacy=0x7f3bcc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:45.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.352+0000 7f3bee79f700 1 -- 172.21.15.146:0/261680359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3be8137d30 msgr2=0x7f3be8133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.352+0000 7f3bee79f700 1 --2- 172.21.15.146:0/261680359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3be8137d30 0x7f3be8133c90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3be0003f50 tx=0x7f3be0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.352+0000 7f3bee79f700 1 -- 172.21.15.146:0/261680359 shutdown_connections 2023-10-03T10:12:45.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.352+0000 7f3bee79f700 1 --2- 172.21.15.146:0/261680359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3be8137d30 0x7f3be8133c90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.352+0000 7f3bee79f700 1 --2- 172.21.15.146:0/261680359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3be806f5b0 0x7f3be809d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.352+0000 7f3bee79f700 1 --2- 172.21.15.146:0/261680359 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3be809a060 0x7f3be8133750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.352+0000 7f3bee79f700 1 -- 172.21.15.146:0/261680359 >> 172.21.15.146:0/261680359 conn(0x7f3be80a27a0 msgr2=0x7f3be81364f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.352+0000 7f3bee79f700 1 -- 172.21.15.146:0/261680359 shutdown_connections 2023-10-03T10:12:45.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:45.352+0000 7f3bee79f700 1 -- 172.21.15.146:0/261680359 wait complete. 2023-10-03T10:12:45.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:46.296 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:46.299 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:46.337 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:46.365 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:46.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.443+0000 7fe8ebde3700 1 Processor -- start 2023-10-03T10:12:46.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.443+0000 7fe8ebde3700 1 -- start start 2023-10-03T10:12:46.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.444+0000 7fe8ebde3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8e40a0a30 0x7fe8e40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.444+0000 7fe8ebde3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe8e4130670 0x7fe8e41381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.444+0000 7fe8ebde3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e40a1e70 con 0x7fe8e40a1340 2023-10-03T10:12:46.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.444+0000 7fe8ebde3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e409a720 con 0x7fe8e4130670 2023-10-03T10:12:46.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.444+0000 7fe8ebde3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e409b300 con 0x7fe8e40a0a30 2023-10-03T10:12:46.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.444+0000 7fe8e9b7f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8e40a0a30 0x7fe8e40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.444+0000 7fe8e9b7f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8e40a0a30 0x7fe8e40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40526/0 (socket says 172.21.15.146:40526) 2023-10-03T10:12:46.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.444+0000 7fe8e9b7f700 1 -- 172.21.15.146:0/1296279275 learned_addr learned my addr 172.21.15.146:0/1296279275 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:46.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.445+0000 7fe8e9b7f700 1 -- 172.21.15.146:0/1296279275 >> v2:172.21.15.146:3300/0 conn(0x7fe8e4130670 msgr2=0x7fe8e41381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:46.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.445+0000 7fe8e9b7f700 1 --2- 172.21.15.146:0/1296279275 >> v2:172.21.15.146:3300/0 conn(0x7fe8e4130670 0x7fe8e41381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.445+0000 7fe8e9b7f700 1 -- 172.21.15.146:0/1296279275 >> v1:172.21.15.146:6789/0 conn(0x7fe8e40a1340 legacy=0x7fe8e412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:46.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.445+0000 7fe8e9b7f700 1 -- 172.21.15.146:0/1296279275 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e409abc0 con 0x7fe8e40a0a30 2023-10-03T10:12:46.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.445+0000 7fe8e9b7f700 1 --2- 172.21.15.146:0/1296279275 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8e40a0a30 0x7fe8e40a0e00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0006fd0 tx=0x7fe8e000be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71b97209c4f7d1ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.445+0000 7fe8e8b7d700 1 -- 172.21.15.146:0/1296279275 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0005c20 con 0x7fe8e40a0a30 2023-10-03T10:12:46.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.445+0000 7fe8e8b7d700 1 -- 172.21.15.146:0/1296279275 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e0005d80 con 0x7fe8e40a0a30 2023-10-03T10:12:46.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.445+0000 7fe8e8b7d700 1 -- 172.21.15.146:0/1296279275 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e000dc20 con 0x7fe8e40a0a30 2023-10-03T10:12:46.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.446+0000 7fe8ebde3700 1 -- 172.21.15.146:0/1296279275 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8e40a0a30 msgr2=0x7fe8e40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.446+0000 7fe8ebde3700 1 --2- 172.21.15.146:0/1296279275 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8e40a0a30 0x7fe8e40a0e00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0006fd0 tx=0x7fe8e000be70 comp rx=0 tx=0).stop 2023-10-03T10:12:46.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.446+0000 7fe8ebde3700 1 -- 172.21.15.146:0/1296279275 shutdown_connections 2023-10-03T10:12:46.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.446+0000 7fe8ebde3700 1 --2- 172.21.15.146:0/1296279275 >> v2:172.21.15.146:3300/0 conn(0x7fe8e4130670 0x7fe8e41381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.446+0000 7fe8ebde3700 1 --2- 172.21.15.146:0/1296279275 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8e40a0a30 0x7fe8e40a0e00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.446+0000 7fe8ebde3700 1 -- 172.21.15.146:0/1296279275 >> 172.21.15.146:0/1296279275 conn(0x7fe8e40a2980 msgr2=0x7fe8e40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.446+0000 7fe8ebde3700 1 -- 172.21.15.146:0/1296279275 shutdown_connections 2023-10-03T10:12:46.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.446+0000 7fe8ebde3700 1 -- 172.21.15.146:0/1296279275 wait complete. 2023-10-03T10:12:46.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.447+0000 7fe8ebde3700 1 Processor -- start 2023-10-03T10:12:46.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.447+0000 7fe8ebde3700 1 -- start start 2023-10-03T10:12:46.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.447+0000 7fe8ebde3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8e40a0a30 0x7fe8e41c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.448+0000 7fe8ebde3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8e40a1340 0x7fe8e41c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.448+0000 7fe8ebde3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8e4130670 0x7fe8e41c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.448+0000 7fe8ebde3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e412eff0 con 0x7fe8e40a1340 2023-10-03T10:12:46.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.448+0000 7fe8ebde3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e4121110 con 0x7fe8e4130670 2023-10-03T10:12:46.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.448+0000 7fe8ebde3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e4121970 con 0x7fe8e40a0a30 2023-10-03T10:12:46.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.448+0000 7fe8e9b7f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8e40a0a30 0x7fe8e41c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.448+0000 7fe8e9b7f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8e40a0a30 0x7fe8e41c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40530/0 (socket says 172.21.15.146:40530) 2023-10-03T10:12:46.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.448+0000 7fe8e9b7f700 1 -- 172.21.15.146:0/2044667943 learned_addr learned my addr 172.21.15.146:0/2044667943 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:46.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.448+0000 7fe8ea380700 1 --2- 172.21.15.146:0/2044667943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8e4130670 0x7fe8e41c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.448+0000 7fe8e937e700 1 --2- 172.21.15.146:0/2044667943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8e40a1340 0x7fe8e41c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.448+0000 7fe8e9b7f700 1 -- 172.21.15.146:0/2044667943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8e4130670 msgr2=0x7fe8e41c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.448+0000 7fe8e9b7f700 1 --2- 172.21.15.146:0/2044667943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8e4130670 0x7fe8e41c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.448+0000 7fe8e9b7f700 1 -- 172.21.15.146:0/2044667943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8e40a1340 msgr2=0x7fe8e41c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.448+0000 7fe8e9b7f700 1 --2- 172.21.15.146:0/2044667943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8e40a1340 0x7fe8e41c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.448+0000 7fe8e9b7f700 1 -- 172.21.15.146:0/2044667943 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e000b7a0 con 0x7fe8e40a0a30 2023-10-03T10:12:46.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.448+0000 7fe8e9b7f700 1 --2- 172.21.15.146:0/2044667943 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8e40a0a30 0x7fe8e41c8280 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000beb0 tx=0x7fe8e0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.448+0000 7fe8da7fc700 1 -- 172.21.15.146:0/2044667943 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0009040 con 0x7fe8e40a0a30 2023-10-03T10:12:46.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.448+0000 7fe8ebde3700 1 -- 172.21.15.146:0/2044667943 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e4120c70 con 0x7fe8e40a0a30 2023-10-03T10:12:46.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.449+0000 7fe8da7fc700 1 -- 172.21.15.146:0/2044667943 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e0004300 con 0x7fe8e40a0a30 2023-10-03T10:12:46.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.449+0000 7fe8da7fc700 1 -- 172.21.15.146:0/2044667943 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e00036a0 con 0x7fe8e40a0a30 2023-10-03T10:12:46.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.449+0000 7fe8ebde3700 1 -- 172.21.15.146:0/2044667943 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e4120000 con 0x7fe8e40a0a30 2023-10-03T10:12:46.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.449+0000 7fe8da7fc700 1 -- 172.21.15.146:0/2044667943 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe8e0020070 con 0x7fe8e40a0a30 2023-10-03T10:12:46.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.450+0000 7fe8da7fc700 1 -- 172.21.15.146:0/2044667943 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fe8e0040f50 con 0x7fe8e40a0a30 2023-10-03T10:12:46.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.450+0000 7fe8e937e700 1 -- 172.21.15.146:0/2044667943 >> v1:172.21.15.146:6816/126749 conn(0x7fe8c802f510 legacy=0x7fe8c80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:46.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.450+0000 7fe8ebde3700 1 -- 172.21.15.146:0/2044667943 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e4120000 con 0x7fe8e40a0a30 2023-10-03T10:12:46.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.454+0000 7fe8da7fc700 1 -- 172.21.15.146:0/2044667943 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe8e0003800 con 0x7fe8e40a0a30 2023-10-03T10:12:46.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.485+0000 7ff9ff28d700 1 Processor -- start 2023-10-03T10:12:46.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.486+0000 7ff9ff28d700 1 -- start start 2023-10-03T10:12:46.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.486+0000 7ff9ff28d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff9f809f350 0x7ff9f8138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.486+0000 7ff9ff28d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9f81393a0 0x7ff9f813b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.486+0000 7ff9ff28d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f809fa00 con 0x7ff9f809e870 2023-10-03T10:12:46.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.486+0000 7ff9ff28d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f80a0370 con 0x7ff9f809f350 2023-10-03T10:12:46.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.486+0000 7ff9ff28d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f806bec0 con 0x7ff9f81393a0 2023-10-03T10:12:46.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.486+0000 7ff9fc828700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff9f809f350 0x7ff9f8138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.486+0000 7ff9fc828700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff9f809f350 0x7ff9f8138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51044/0 (socket says 172.21.15.146:51044) 2023-10-03T10:12:46.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.486+0000 7ff9fd82a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9f81393a0 0x7ff9f813b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.486+0000 7ff9fc828700 1 -- 172.21.15.146:0/1057661285 learned_addr learned my addr 172.21.15.146:0/1057661285 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:46.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.487+0000 7ff9fd82a700 1 -- 172.21.15.146:0/1057661285 >> v2:172.21.15.146:3300/0 conn(0x7ff9f809f350 msgr2=0x7ff9f8138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:46.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.487+0000 7ff9fd82a700 1 --2- 172.21.15.146:0/1057661285 >> v2:172.21.15.146:3300/0 conn(0x7ff9f809f350 0x7ff9f8138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.487+0000 7ff9fd82a700 1 -- 172.21.15.146:0/1057661285 >> v1:172.21.15.146:6789/0 conn(0x7ff9f809e870 legacy=0x7ff9f809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.487+0000 7ff9fd82a700 1 -- 172.21.15.146:0/1057661285 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f809ada0 con 0x7ff9f81393a0 2023-10-03T10:12:46.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.487+0000 7ff9fd82a700 1 --2- 172.21.15.146:0/1057661285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9f81393a0 0x7ff9f813b780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009d90 tx=0x7ff9f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f4bd64bda9744e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.487+0000 7ff9effff700 1 -- 172.21.15.146:0/1057661285 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f000e070 con 0x7ff9f81393a0 2023-10-03T10:12:46.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.487+0000 7ff9effff700 1 -- 172.21.15.146:0/1057661285 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f000bb20 con 0x7ff9f81393a0 2023-10-03T10:12:46.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.487+0000 7ff9effff700 1 -- 172.21.15.146:0/1057661285 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0012430 con 0x7ff9f81393a0 2023-10-03T10:12:46.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.488+0000 7ff9ff28d700 1 -- 172.21.15.146:0/1057661285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9f81393a0 msgr2=0x7ff9f813b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.488+0000 7ff9ff28d700 1 --2- 172.21.15.146:0/1057661285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9f81393a0 0x7ff9f813b780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009d90 tx=0x7ff9f000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:46.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.488+0000 7ff9ff28d700 1 -- 172.21.15.146:0/1057661285 shutdown_connections 2023-10-03T10:12:46.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.488+0000 7ff9ff28d700 1 --2- 172.21.15.146:0/1057661285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9f81393a0 0x7ff9f813b780 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.488+0000 7ff9ff28d700 1 --2- 172.21.15.146:0/1057661285 >> v2:172.21.15.146:3300/0 conn(0x7ff9f809f350 0x7ff9f8138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.488+0000 7ff9ff28d700 1 -- 172.21.15.146:0/1057661285 >> 172.21.15.146:0/1057661285 conn(0x7ff9f80a4430 msgr2=0x7ff9f80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.488+0000 7ff9ff28d700 1 -- 172.21.15.146:0/1057661285 shutdown_connections 2023-10-03T10:12:46.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.488+0000 7ff9ff28d700 1 -- 172.21.15.146:0/1057661285 wait complete. 2023-10-03T10:12:46.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.489+0000 7ff9ff28d700 1 Processor -- start 2023-10-03T10:12:46.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.489+0000 7ff9ff28d700 1 -- start start 2023-10-03T10:12:46.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.489+0000 7ff9ff28d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9f809e870 0x7ff9f811ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.489+0000 7ff9ff28d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9f809f350 0x7ff9f811f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.489+0000 7ff9ff28d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9f81393a0 0x7ff9f811f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.489+0000 7ff9ff28d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f806cfa0 con 0x7ff9f81393a0 2023-10-03T10:12:46.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.489+0000 7ff9ff28d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f81205c0 con 0x7ff9f809f350 2023-10-03T10:12:46.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.489+0000 7ff9ff28d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f806f8f0 con 0x7ff9f809e870 2023-10-03T10:12:46.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.489+0000 7ff9fd029700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9f809e870 0x7ff9f811ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.489+0000 7ff9fd029700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9f809e870 0x7ff9f811ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40552/0 (socket says 172.21.15.146:40552) 2023-10-03T10:12:46.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.489+0000 7ff9fd029700 1 -- 172.21.15.146:0/3728891918 learned_addr learned my addr 172.21.15.146:0/3728891918 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:46.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.489+0000 7ff9fc828700 1 --2- 172.21.15.146:0/3728891918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9f809f350 0x7ff9f811f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.490+0000 7ff9fd82a700 1 --2- 172.21.15.146:0/3728891918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9f81393a0 0x7ff9f811f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.490+0000 7ff9fc828700 1 -- 172.21.15.146:0/3728891918 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9f809e870 msgr2=0x7ff9f811ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.490+0000 7ff9fc828700 1 --2- 172.21.15.146:0/3728891918 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9f809e870 0x7ff9f811ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.490+0000 7ff9fc828700 1 -- 172.21.15.146:0/3728891918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9f81393a0 msgr2=0x7ff9f811f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.490+0000 7ff9fc828700 1 --2- 172.21.15.146:0/3728891918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9f81393a0 0x7ff9f811f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.490+0000 7ff9fc828700 1 -- 172.21.15.146:0/3728891918 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f0009a70 con 0x7ff9f809f350 2023-10-03T10:12:46.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.490+0000 7fe01edc9700 1 Processor -- start 2023-10-03T10:12:46.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.490+0000 7fe01edc9700 1 -- start start 2023-10-03T10:12:46.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.490+0000 7ff9fc828700 1 --2- 172.21.15.146:0/3728891918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9f809f350 0x7ff9f811f010 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800e8e0 tx=0x7ff9e800ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.490+0000 7ff9edffb700 1 -- 172.21.15.146:0/3728891918 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e800c690 con 0x7ff9f809f350 2023-10-03T10:12:46.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.490+0000 7ff9edffb700 1 -- 172.21.15.146:0/3728891918 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e800c7f0 con 0x7ff9f809f350 2023-10-03T10:12:46.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.490+0000 7ff9edffb700 1 -- 172.21.15.146:0/3728891918 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e800cb80 con 0x7ff9f809f350 2023-10-03T10:12:46.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.490+0000 7ff9ff28d700 1 -- 172.21.15.146:0/3728891918 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f8121f50 con 0x7ff9f809f350 2023-10-03T10:12:46.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.491+0000 7ff9ff28d700 1 -- 172.21.15.146:0/3728891918 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f81229f0 con 0x7ff9f809f350 2023-10-03T10:12:46.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.492+0000 7ff9ff28d700 1 -- 172.21.15.146:0/3728891918 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f804f2a0 con 0x7ff9f809f350 2023-10-03T10:12:46.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.493+0000 7ff9edffb700 1 -- 172.21.15.146:0/3728891918 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff9e800cce0 con 0x7ff9f809f350 2023-10-03T10:12:46.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.493+0000 7ff9edffb700 1 -- 172.21.15.146:0/3728891918 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7ff9e8040570 con 0x7ff9f809f350 2023-10-03T10:12:46.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.494+0000 7ff9fd029700 1 -- 172.21.15.146:0/3728891918 >> v1:172.21.15.146:6816/126749 conn(0x7ff9dc02f510 legacy=0x7ff9dc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:46.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.491+0000 7fe01edc9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01809e870 0x7fe01809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.491+0000 7fe01edc9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01809f180 0x7fe018131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.491+0000 7fe01edc9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe018131d70 0x7fe018132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.491+0000 7fe01edc9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0180a0920 con 0x7fe018131d70 2023-10-03T10:12:46.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.491+0000 7fe01edc9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01809c970 con 0x7fe01809f180 2023-10-03T10:12:46.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.491+0000 7fe01edc9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe01809bab0 con 0x7fe01809e870 2023-10-03T10:12:46.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.491+0000 7fe01d366700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe018131d70 0x7fe018132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.491+0000 7fe01d366700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe018131d70 0x7fe018132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51064/0 (socket says 172.21.15.146:51064) 2023-10-03T10:12:46.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.491+0000 7fe01d366700 1 -- 172.21.15.146:0/3633483663 learned_addr learned my addr 172.21.15.146:0/3633483663 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:46.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.491+0000 7fe01cb65700 1 --2- 172.21.15.146:0/3633483663 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01809e870 0x7fe01809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.491+0000 7fe01d366700 1 -- 172.21.15.146:0/3633483663 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01809e870 msgr2=0x7fe01809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:46.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.491+0000 7fe01d366700 1 --2- 172.21.15.146:0/3633483663 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01809e870 0x7fe01809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.491+0000 7fe01d366700 1 -- 172.21.15.146:0/3633483663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01809f180 msgr2=0x7fe018131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:46.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.491+0000 7fe01d366700 1 --2- 172.21.15.146:0/3633483663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01809f180 0x7fe018131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.491+0000 7fe01d366700 1 -- 172.21.15.146:0/3633483663 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01809f9c0 con 0x7fe018131d70 2023-10-03T10:12:46.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.491+0000 7fe01d366700 1 --2- 172.21.15.146:0/3633483663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe018131d70 0x7fe018132210 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe010009e50 tx=0x7fe01000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d36f5af519c9552 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.492+0000 7fe0177fe700 1 -- 172.21.15.146:0/3633483663 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01000e070 con 0x7fe018131d70 2023-10-03T10:12:46.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.492+0000 7fe0177fe700 1 -- 172.21.15.146:0/3633483663 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01000b910 con 0x7fe018131d70 2023-10-03T10:12:46.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.492+0000 7fe0177fe700 1 -- 172.21.15.146:0/3633483663 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01000bcc0 con 0x7fe018131d70 2023-10-03T10:12:46.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.492+0000 7fe01edc9700 1 -- 172.21.15.146:0/3633483663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe018131d70 msgr2=0x7fe018132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.492+0000 7fe01edc9700 1 --2- 172.21.15.146:0/3633483663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe018131d70 0x7fe018132210 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe010009e50 tx=0x7fe01000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:46.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.493+0000 7fe01edc9700 1 -- 172.21.15.146:0/3633483663 shutdown_connections 2023-10-03T10:12:46.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.493+0000 7fe01edc9700 1 --2- 172.21.15.146:0/3633483663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe018131d70 0x7fe018132210 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.493+0000 7fe01edc9700 1 --2- 172.21.15.146:0/3633483663 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01809e870 0x7fe01809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.493+0000 7fe01edc9700 1 --2- 172.21.15.146:0/3633483663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01809f180 0x7fe018131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.493+0000 7fe01edc9700 1 -- 172.21.15.146:0/3633483663 >> 172.21.15.146:0/3633483663 conn(0x7fe0180a4430 msgr2=0x7fe0180a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.493+0000 7fe01edc9700 1 -- 172.21.15.146:0/3633483663 shutdown_connections 2023-10-03T10:12:46.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.493+0000 7fe01edc9700 1 -- 172.21.15.146:0/3633483663 wait complete. 2023-10-03T10:12:46.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.494+0000 7fe01edc9700 1 Processor -- start 2023-10-03T10:12:46.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.494+0000 7fe01edc9700 1 -- start start 2023-10-03T10:12:46.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.495+0000 7fe01edc9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01809e870 0x7fe018134a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.495+0000 7fe01edc9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01809f180 0x7fe018134f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.495+0000 7fe01edc9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe018131d70 0x7fe0181354b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.495+0000 7fe01edc9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0180a0280 con 0x7fe018131d70 2023-10-03T10:12:46.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.495+0000 7fe01edc9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0180a28b0 con 0x7fe01809e870 2023-10-03T10:12:46.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.495+0000 7fe01edc9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe018136ac0 con 0x7fe01809f180 2023-10-03T10:12:46.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.495+0000 7fe017fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01809f180 0x7fe018134f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.495+0000 7fe017fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01809f180 0x7fe018134f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40572/0 (socket says 172.21.15.146:40572) 2023-10-03T10:12:46.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.495+0000 7fe017fff700 1 -- 172.21.15.146:0/773725243 learned_addr learned my addr 172.21.15.146:0/773725243 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:46.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.495+0000 7fe01d366700 1 --2- 172.21.15.146:0/773725243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe018131d70 0x7fe0181354b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.496+0000 7fe017fff700 1 -- 172.21.15.146:0/773725243 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01809e870 msgr2=0x7fe018134a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.496+0000 7fe017fff700 1 --2- 172.21.15.146:0/773725243 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01809e870 0x7fe018134a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.496+0000 7fe017fff700 1 -- 172.21.15.146:0/773725243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe018131d70 msgr2=0x7fe0181354b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.496+0000 7fe017fff700 1 --2- 172.21.15.146:0/773725243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe018131d70 0x7fe0181354b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.496+0000 7fe017fff700 1 -- 172.21.15.146:0/773725243 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe010009b30 con 0x7fe01809f180 2023-10-03T10:12:46.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.496+0000 7fe017fff700 1 --2- 172.21.15.146:0/773725243 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01809f180 0x7fe018134f70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00b500 tx=0x7fe00c00b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.496+0000 7fe0157fa700 1 -- 172.21.15.146:0/773725243 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c011830 con 0x7fe01809f180 2023-10-03T10:12:46.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.496+0000 7fe0157fa700 1 -- 172.21.15.146:0/773725243 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c0119b0 con 0x7fe01809f180 2023-10-03T10:12:46.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.496+0000 7fe01edc9700 1 -- 172.21.15.146:0/773725243 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe018136d30 con 0x7fe01809f180 2023-10-03T10:12:46.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.496+0000 7fe0157fa700 1 -- 172.21.15.146:0/773725243 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c011d60 con 0x7fe01809f180 2023-10-03T10:12:46.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.496+0000 7fe01edc9700 1 -- 172.21.15.146:0/773725243 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe018137bb0 con 0x7fe01809f180 2023-10-03T10:12:46.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.497+0000 7fe01edc9700 1 -- 172.21.15.146:0/773725243 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01804f2a0 con 0x7fe01809f180 2023-10-03T10:12:46.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.498+0000 7fe0157fa700 1 -- 172.21.15.146:0/773725243 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe00c01a400 con 0x7fe01809f180 2023-10-03T10:12:46.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.498+0000 7fe0157fa700 1 -- 172.21.15.146:0/773725243 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7fe00c040220 con 0x7fe01809f180 2023-10-03T10:12:46.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.498+0000 7fe01cb65700 1 -- 172.21.15.146:0/773725243 >> v1:172.21.15.146:6816/126749 conn(0x7fdffc02f510 legacy=0x7fdffc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:46.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.499+0000 7ff9edffb700 1 -- 172.21.15.146:0/3728891918 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff9e8024350 con 0x7ff9f809f350 2023-10-03T10:12:46.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.506+0000 7fe0157fa700 1 -- 172.21.15.146:0/773725243 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe00c021710 con 0x7fe01809f180 2023-10-03T10:12:46.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.533+0000 7f1be5062700 1 Processor -- start 2023-10-03T10:12:46.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.533+0000 7f1be5062700 1 -- start start 2023-10-03T10:12:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.533+0000 7f1be5062700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1be00a0a70 0x7f1be00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.533+0000 7f1be5062700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1be0134120 0x7f1be013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.533+0000 7f1be5062700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be009dc00 con 0x7f1be00a1380 2023-10-03T10:12:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.533+0000 7f1be5062700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be009ea60 con 0x7f1be0134120 2023-10-03T10:12:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.533+0000 7f1be5062700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1be009dec0 con 0x7f1be00a0a70 2023-10-03T10:12:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.533+0000 7f1bdf59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1be0134120 0x7f1be013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.533+0000 7f1bdf59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1be0134120 0x7f1be013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51074/0 (socket says 172.21.15.146:51074) 2023-10-03T10:12:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.533+0000 7f1bdf59e700 1 -- 172.21.15.146:0/3675090772 learned_addr learned my addr 172.21.15.146:0/3675090772 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.534+0000 7f1bdf59e700 1 -- 172.21.15.146:0/3675090772 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1be00a0a70 msgr2=0x7f1be00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.534+0000 7f1bdf59e700 1 --2- 172.21.15.146:0/3675090772 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1be00a0a70 0x7f1be00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.534+0000 7f1bdf59e700 1 -- 172.21.15.146:0/3675090772 >> v1:172.21.15.146:6789/0 conn(0x7f1be00a1380 legacy=0x7f1be0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.534+0000 7f1bdf59e700 1 -- 172.21.15.146:0/3675090772 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be009e6a0 con 0x7f1be0134120 2023-10-03T10:12:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.534+0000 7f1bdf59e700 1 --2- 172.21.15.146:0/3675090772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1be0134120 0x7f1be013bce0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8009e50 tx=0x7f1bd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5cf800e3cb04c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.534+0000 7f1bddd9b700 1 -- 172.21.15.146:0/3675090772 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800e070 con 0x7f1be0134120 2023-10-03T10:12:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.534+0000 7f1bddd9b700 1 -- 172.21.15.146:0/3675090772 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd800b9c0 con 0x7f1be0134120 2023-10-03T10:12:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.534+0000 7f1bddd9b700 1 -- 172.21.15.146:0/3675090772 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800bd70 con 0x7f1be0134120 2023-10-03T10:12:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.535+0000 7f1be5062700 1 -- 172.21.15.146:0/3675090772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1be0134120 msgr2=0x7f1be013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.535+0000 7f1be5062700 1 --2- 172.21.15.146:0/3675090772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1be0134120 0x7f1be013bce0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8009e50 tx=0x7f1bd800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.535+0000 7f1be5062700 1 -- 172.21.15.146:0/3675090772 shutdown_connections 2023-10-03T10:12:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.535+0000 7f1be5062700 1 --2- 172.21.15.146:0/3675090772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1be0134120 0x7f1be013bce0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.535+0000 7f1be5062700 1 --2- 172.21.15.146:0/3675090772 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1be00a0a70 0x7f1be00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.535+0000 7f1be5062700 1 -- 172.21.15.146:0/3675090772 >> 172.21.15.146:0/3675090772 conn(0x7f1be00a6610 msgr2=0x7f1be00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.535+0000 7f1be5062700 1 -- 172.21.15.146:0/3675090772 shutdown_connections 2023-10-03T10:12:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.535+0000 7f1be5062700 1 -- 172.21.15.146:0/3675090772 wait complete. 2023-10-03T10:12:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.536+0000 7f1be5062700 1 Processor -- start 2023-10-03T10:12:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.536+0000 7f1be5062700 1 -- start start 2023-10-03T10:12:46.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.536+0000 7f1be5062700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1be00a0a70 0x7f1be011e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.536+0000 7f1be5062700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1be00a1380 0x7f1be011ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.536+0000 7f1be5062700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1be0134120 0x7f1be011f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.536+0000 7f1be5062700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be0133190 con 0x7f1be00a0a70 2023-10-03T10:12:46.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.536+0000 7f1be5062700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be0133000 con 0x7f1be00a1380 2023-10-03T10:12:46.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.536+0000 7f1be5062700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1be01202f0 con 0x7f1be0134120 2023-10-03T10:12:46.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.537+0000 7f1bded9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1be00a0a70 0x7f1be011e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.537+0000 7f1bdf59e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1be0134120 0x7f1be011f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.537+0000 7f1bdf59e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1be0134120 0x7f1be011f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40590/0 (socket says 172.21.15.146:40590) 2023-10-03T10:12:46.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.537+0000 7f1bded9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1be00a0a70 0x7f1be011e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51080/0 (socket says 172.21.15.146:51080) 2023-10-03T10:12:46.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.537+0000 7f1bdf59e700 1 -- 172.21.15.146:0/3353069917 learned_addr learned my addr 172.21.15.146:0/3353069917 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:46.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.537+0000 7f1bded9d700 1 -- 172.21.15.146:0/3353069917 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1be0134120 msgr2=0x7f1be011f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.537+0000 7f1bded9d700 1 --2- 172.21.15.146:0/3353069917 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1be0134120 0x7f1be011f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.537+0000 7f1bded9d700 1 -- 172.21.15.146:0/3353069917 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1be00a1380 msgr2=0x7f1be011ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.537+0000 7f1bded9d700 1 --2- 172.21.15.146:0/3353069917 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1be00a1380 0x7f1be011ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.537+0000 7f1bded9d700 1 -- 172.21.15.146:0/3353069917 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd8009b30 con 0x7f1be00a0a70 2023-10-03T10:12:46.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.537+0000 7f1bdf59e700 1 --2- 172.21.15.146:0/3353069917 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1be0134120 0x7f1be011f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:46.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.537+0000 7f1bded9d700 1 --2- 172.21.15.146:0/3353069917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1be00a0a70 0x7f1be011e730 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000b480 tx=0x7f1bd000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.537+0000 7f1bc77fe700 1 -- 172.21.15.146:0/3353069917 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0011830 con 0x7f1be00a0a70 2023-10-03T10:12:46.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.537+0000 7f1bc77fe700 1 -- 172.21.15.146:0/3353069917 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd0011990 con 0x7f1be00a0a70 2023-10-03T10:12:46.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.537+0000 7f1bc77fe700 1 -- 172.21.15.146:0/3353069917 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0011d40 con 0x7f1be00a0a70 2023-10-03T10:12:46.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.538+0000 7f1be5062700 1 -- 172.21.15.146:0/3353069917 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be0122260 con 0x7f1be00a0a70 2023-10-03T10:12:46.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.538+0000 7f1be5062700 1 -- 172.21.15.146:0/3353069917 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be00a03e0 con 0x7f1be00a0a70 2023-10-03T10:12:46.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.539+0000 7f1bc77fe700 1 -- 172.21.15.146:0/3353069917 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1bd001a400 con 0x7f1be00a0a70 2023-10-03T10:12:46.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.539+0000 7f1be5062700 1 -- 172.21.15.146:0/3353069917 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be004f2a0 con 0x7f1be00a0a70 2023-10-03T10:12:46.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.539+0000 7f1bde59c700 1 -- 172.21.15.146:0/3353069917 >> v1:172.21.15.146:6816/126749 conn(0x7f1bcc02f510 legacy=0x7f1bcc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:46.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.539+0000 7f1bc77fe700 1 -- 172.21.15.146:0/3353069917 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4092+0+0 (secure 0 0 0) 0x7f1bd003faa0 con 0x7f1be00a0a70 2023-10-03T10:12:46.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.544+0000 7f1bc77fe700 1 -- 172.21.15.146:0/3353069917 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1bd000f8d0 con 0x7f1be00a0a70 2023-10-03T10:12:46.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.651+0000 7fe8e937e700 1 -- 172.21.15.146:0/2044667943 >> v1:172.21.15.146:6816/126749 conn(0x7fe8c802f510 legacy=0x7fe8c80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:46.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.665+0000 7fe8ebde3700 1 -- 172.21.15.146:0/2044667943 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe8e4120000 con 0x7fe8e40a0a30 2023-10-03T10:12:46.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.666+0000 7fe8da7fc700 1 -- 172.21.15.146:0/2044667943 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe8e001f3b0 con 0x7fe8e40a0a30 2023-10-03T10:12:46.666 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.669+0000 7fe8ebde3700 1 -- 172.21.15.146:0/2044667943 >> v1:172.21.15.146:6816/126749 conn(0x7fe8c802f510 legacy=0x7fe8c80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.669+0000 7fe8ebde3700 1 -- 172.21.15.146:0/2044667943 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8e40a0a30 msgr2=0x7fe8e41c8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.669+0000 7fe8ebde3700 1 --2- 172.21.15.146:0/2044667943 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8e40a0a30 0x7fe8e41c8280 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000beb0 tx=0x7fe8e0004750 comp rx=0 tx=0).stop 2023-10-03T10:12:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.669+0000 7fe8ebde3700 1 -- 172.21.15.146:0/2044667943 shutdown_connections 2023-10-03T10:12:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.669+0000 7fe8ebde3700 1 --2- 172.21.15.146:0/2044667943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8e4130670 0x7fe8e41c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.669+0000 7fe8ebde3700 1 --2- 172.21.15.146:0/2044667943 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8e40a0a30 0x7fe8e41c8280 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.669+0000 7fe8ebde3700 1 --2- 172.21.15.146:0/2044667943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8e40a1340 0x7fe8e41c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.669+0000 7fe8ebde3700 1 -- 172.21.15.146:0/2044667943 >> 172.21.15.146:0/2044667943 conn(0x7fe8e40a2980 msgr2=0x7fe8e412f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.669+0000 7fe8ebde3700 1 -- 172.21.15.146:0/2044667943 shutdown_connections 2023-10-03T10:12:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.669+0000 7fe8ebde3700 1 -- 172.21.15.146:0/2044667943 wait complete. 2023-10-03T10:12:46.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:46.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.695+0000 7ff9fd029700 1 -- 172.21.15.146:0/3728891918 >> v1:172.21.15.146:6816/126749 conn(0x7ff9dc02f510 legacy=0x7ff9dc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:46.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.699+0000 7fe01cb65700 1 -- 172.21.15.146:0/773725243 >> v1:172.21.15.146:6816/126749 conn(0x7fdffc02f510 legacy=0x7fdffc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:46.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.737+0000 7fe01edc9700 1 -- 172.21.15.146:0/773725243 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe01809f660 con 0x7fe01809f180 2023-10-03T10:12:46.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.738+0000 7fe0157fa700 1 -- 172.21.15.146:0/773725243 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe00c028090 con 0x7fe01809f180 2023-10-03T10:12:46.737 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:46.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.738+0000 7f1be5062700 1 -- 172.21.15.146:0/3353069917 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1be0072980 con 0x7f1be00a0a70 2023-10-03T10:12:46.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.738+0000 7f1bc77fe700 1 -- 172.21.15.146:0/3353069917 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1bd0015070 con 0x7f1be00a0a70 2023-10-03T10:12:46.738 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:46.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.739+0000 7ff9ff28d700 1 -- 172.21.15.146:0/3728891918 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff9f8072d60 con 0x7ff9f809f350 2023-10-03T10:12:46.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.740+0000 7ff9edffb700 1 -- 172.21.15.146:0/3728891918 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff9e801ab50 con 0x7ff9f809f350 2023-10-03T10:12:46.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.740+0000 7f1bde59c700 1 -- 172.21.15.146:0/3353069917 >> v1:172.21.15.146:6816/126749 conn(0x7f1bcc02f510 legacy=0x7f1bcc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.146:6816/126749 2023-10-03T10:12:46.739 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:46.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.740+0000 7fe01edc9700 1 -- 172.21.15.146:0/773725243 >> v1:172.21.15.146:6816/126749 conn(0x7fdffc02f510 legacy=0x7fdffc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:46.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.740+0000 7fe01edc9700 1 -- 172.21.15.146:0/773725243 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01809f180 msgr2=0x7fe018134f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.740+0000 7fe01edc9700 1 --2- 172.21.15.146:0/773725243 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01809f180 0x7fe018134f70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00b500 tx=0x7fe00c00b810 comp rx=0 tx=0).stop 2023-10-03T10:12:46.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.740+0000 7f1be5062700 1 -- 172.21.15.146:0/3353069917 >> v1:172.21.15.146:6816/126749 conn(0x7f1bcc02f510 legacy=0x7f1bcc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:46.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.740+0000 7f1be5062700 1 -- 172.21.15.146:0/3353069917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1be00a0a70 msgr2=0x7f1be011e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.740+0000 7f1be5062700 1 --2- 172.21.15.146:0/3353069917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1be00a0a70 0x7f1be011e730 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000b480 tx=0x7f1bd000b790 comp rx=0 tx=0).stop 2023-10-03T10:12:46.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.741+0000 7fe01edc9700 1 -- 172.21.15.146:0/773725243 shutdown_connections 2023-10-03T10:12:46.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.741+0000 7fe01edc9700 1 --2- 172.21.15.146:0/773725243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe018131d70 0x7fe0181354b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.741+0000 7fe01edc9700 1 --2- 172.21.15.146:0/773725243 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01809e870 0x7fe018134a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.741+0000 7fe01edc9700 1 --2- 172.21.15.146:0/773725243 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01809f180 0x7fe018134f70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.741+0000 7fe01edc9700 1 -- 172.21.15.146:0/773725243 >> 172.21.15.146:0/773725243 conn(0x7fe0180a4430 msgr2=0x7fe01809cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.741+0000 7f1be5062700 1 -- 172.21.15.146:0/3353069917 shutdown_connections 2023-10-03T10:12:46.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.741+0000 7f1be5062700 1 --2- 172.21.15.146:0/3353069917 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1be0134120 0x7f1be011f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.741+0000 7f1be5062700 1 --2- 172.21.15.146:0/3353069917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1be00a0a70 0x7f1be011e730 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.741+0000 7f1be5062700 1 --2- 172.21.15.146:0/3353069917 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1be00a1380 0x7f1be011ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.741+0000 7f1be5062700 1 -- 172.21.15.146:0/3353069917 >> 172.21.15.146:0/3353069917 conn(0x7f1be00a6610 msgr2=0x7f1be00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.741+0000 7f1be5062700 1 -- 172.21.15.146:0/3353069917 shutdown_connections 2023-10-03T10:12:46.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.741+0000 7f1be5062700 1 -- 172.21.15.146:0/3353069917 wait complete. 2023-10-03T10:12:46.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.741+0000 7fe01edc9700 1 -- 172.21.15.146:0/773725243 shutdown_connections 2023-10-03T10:12:46.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.741+0000 7fe01edc9700 1 -- 172.21.15.146:0/773725243 wait complete. 2023-10-03T10:12:46.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.742+0000 7ff9ff28d700 1 -- 172.21.15.146:0/3728891918 >> v1:172.21.15.146:6816/126749 conn(0x7ff9dc02f510 legacy=0x7ff9dc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:46.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.742+0000 7ff9ff28d700 1 -- 172.21.15.146:0/3728891918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9f809f350 msgr2=0x7ff9f811f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.742+0000 7ff9ff28d700 1 --2- 172.21.15.146:0/3728891918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9f809f350 0x7ff9f811f010 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800e8e0 tx=0x7ff9e800ebf0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.742+0000 7ff9ff28d700 1 -- 172.21.15.146:0/3728891918 shutdown_connections 2023-10-03T10:12:46.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.743+0000 7ff9ff28d700 1 --2- 172.21.15.146:0/3728891918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9f81393a0 0x7ff9f811f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.743+0000 7ff9ff28d700 1 --2- 172.21.15.146:0/3728891918 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9f809e870 0x7ff9f811ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.743+0000 7ff9ff28d700 1 --2- 172.21.15.146:0/3728891918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9f809f350 0x7ff9f811f010 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.743+0000 7ff9ff28d700 1 -- 172.21.15.146:0/3728891918 >> 172.21.15.146:0/3728891918 conn(0x7ff9f80a4430 msgr2=0x7ff9f8136e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.743+0000 7ff9ff28d700 1 -- 172.21.15.146:0/3728891918 shutdown_connections 2023-10-03T10:12:46.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:46.743+0000 7ff9ff28d700 1 -- 172.21.15.146:0/3728891918 wait complete. 2023-10-03T10:12:46.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:46.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:46.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:47.686 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:47.756 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:47.761 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:47.763 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:47.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.830+0000 7f1d9ca81700 1 Processor -- start 2023-10-03T10:12:47.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.830+0000 7f1d9ca81700 1 -- start start 2023-10-03T10:12:47.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.831+0000 7f1d9ca81700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d980a0a90 0x7f1d980a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.831+0000 7f1d9ca81700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1d980a13a0 0x7f1d98133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.831+0000 7f1d9ca81700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d98133f70 0x7f1d981343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.831+0000 7f1d9ca81700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d980a3aa0 con 0x7f1d980a13a0 2023-10-03T10:12:47.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.831+0000 7f1d9ca81700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9809a540 con 0x7f1d980a0a90 2023-10-03T10:12:47.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.831+0000 7f1d9ca81700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d980a1fe0 con 0x7f1d98133f70 2023-10-03T10:12:47.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.831+0000 7f1d9659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d980a0a90 0x7f1d980a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.831+0000 7f1d9659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d980a0a90 0x7f1d980a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52582/0 (socket says 172.21.15.146:52582) 2023-10-03T10:12:47.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.831+0000 7f1d9659c700 1 -- 172.21.15.146:0/821646493 learned_addr learned my addr 172.21.15.146:0/821646493 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:47.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.831+0000 7f1d96d9d700 1 --2- 172.21.15.146:0/821646493 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d98133f70 0x7f1d981343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.832+0000 7f1d96d9d700 1 -- 172.21.15.146:0/821646493 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d980a0a90 msgr2=0x7f1d980a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.832+0000 7f1d96d9d700 1 --2- 172.21.15.146:0/821646493 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d980a0a90 0x7f1d980a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.832+0000 7f1d96d9d700 1 -- 172.21.15.146:0/821646493 >> v2:172.21.15.146:3300/0 conn(0x7f1d980a13a0 msgr2=0x7f1d98133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.832+0000 7f1d96d9d700 1 --2- 172.21.15.146:0/821646493 >> v2:172.21.15.146:3300/0 conn(0x7f1d980a13a0 0x7f1d98133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.832+0000 7f1d96d9d700 1 -- 172.21.15.146:0/821646493 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9809a280 con 0x7f1d98133f70 2023-10-03T10:12:47.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.832+0000 7f1d9659c700 1 --2- 172.21.15.146:0/821646493 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d980a0a90 0x7f1d980a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:47.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.832+0000 7f1d96d9d700 1 --2- 172.21.15.146:0/821646493 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d98133f70 0x7f1d981343f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009dc0 tx=0x7f1d9000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a12e0abb26cf7d93 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.832+0000 7f1d9559a700 1 -- 172.21.15.146:0/821646493 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9000e070 con 0x7f1d98133f70 2023-10-03T10:12:47.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.832+0000 7f1d9559a700 1 -- 172.21.15.146:0/821646493 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9000bae0 con 0x7f1d98133f70 2023-10-03T10:12:47.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.832+0000 7f1d9559a700 1 -- 172.21.15.146:0/821646493 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9000be90 con 0x7f1d98133f70 2023-10-03T10:12:47.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.833+0000 7f1d9ca81700 1 -- 172.21.15.146:0/821646493 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d98133f70 msgr2=0x7f1d981343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.833+0000 7f1d9ca81700 1 --2- 172.21.15.146:0/821646493 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d98133f70 0x7f1d981343f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009dc0 tx=0x7f1d9000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:47.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.833+0000 7f1d9ca81700 1 -- 172.21.15.146:0/821646493 shutdown_connections 2023-10-03T10:12:47.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.833+0000 7f1d9ca81700 1 --2- 172.21.15.146:0/821646493 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d980a0a90 0x7f1d980a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.833+0000 7f1d9ca81700 1 --2- 172.21.15.146:0/821646493 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d98133f70 0x7f1d981343f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.833+0000 7f1d9ca81700 1 --2- 172.21.15.146:0/821646493 >> v2:172.21.15.146:3300/0 conn(0x7f1d980a13a0 0x7f1d98133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.833+0000 7f1d9ca81700 1 -- 172.21.15.146:0/821646493 >> 172.21.15.146:0/821646493 conn(0x7f1d98099c40 msgr2=0x7f1d9806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.833+0000 7f1d9ca81700 1 -- 172.21.15.146:0/821646493 shutdown_connections 2023-10-03T10:12:47.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.833+0000 7f1d9ca81700 1 -- 172.21.15.146:0/821646493 wait complete. 2023-10-03T10:12:47.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.835+0000 7f1d9ca81700 1 Processor -- start 2023-10-03T10:12:47.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.835+0000 7f1d9ca81700 1 -- start start 2023-10-03T10:12:47.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.835+0000 7f1d9ca81700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d980a0a90 0x7f1d981222d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.835+0000 7f1d9ca81700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d980a13a0 0x7f1d98122810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.835+0000 7f1d9ca81700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d98133f70 0x7f1d98122d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.835+0000 7f1d9ca81700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d98124d70 con 0x7f1d980a0a90 2023-10-03T10:12:47.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.835+0000 7f1d9ca81700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9809c7e0 con 0x7f1d980a13a0 2023-10-03T10:12:47.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.835+0000 7f1d9ca81700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d98125580 con 0x7f1d98133f70 2023-10-03T10:12:47.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.836+0000 7f1d95d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d980a13a0 0x7f1d98122810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.836+0000 7f1d95d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d980a13a0 0x7f1d98122810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52588/0 (socket says 172.21.15.146:52588) 2023-10-03T10:12:47.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.836+0000 7f1d95d9b700 1 -- 172.21.15.146:0/1111603876 learned_addr learned my addr 172.21.15.146:0/1111603876 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:47.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.836+0000 7f1d96d9d700 1 --2- 172.21.15.146:0/1111603876 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d98133f70 0x7f1d98122d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.836+0000 7f1d9659c700 1 --2- 172.21.15.146:0/1111603876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d980a0a90 0x7f1d981222d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.836+0000 7f1d95d9b700 1 -- 172.21.15.146:0/1111603876 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d98133f70 msgr2=0x7f1d98122d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.836+0000 7f1d95d9b700 1 --2- 172.21.15.146:0/1111603876 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d98133f70 0x7f1d98122d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.836+0000 7f1d95d9b700 1 -- 172.21.15.146:0/1111603876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d980a0a90 msgr2=0x7f1d981222d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.836+0000 7f1d95d9b700 1 --2- 172.21.15.146:0/1111603876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d980a0a90 0x7f1d981222d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.836+0000 7f1d95d9b700 1 -- 172.21.15.146:0/1111603876 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d88009550 con 0x7f1d980a13a0 2023-10-03T10:12:47.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.836+0000 7f1d9659c700 1 --2- 172.21.15.146:0/1111603876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d980a0a90 0x7f1d981222d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:47.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.836+0000 7f1d95d9b700 1 --2- 172.21.15.146:0/1111603876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d980a13a0 0x7f1d98122810 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00b500 tx=0x7f1d8c00b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.836+0000 7f1d86ffd700 1 -- 172.21.15.146:0/1111603876 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c011830 con 0x7f1d980a13a0 2023-10-03T10:12:47.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.836+0000 7f1d86ffd700 1 -- 172.21.15.146:0/1111603876 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c0119b0 con 0x7f1d980a13a0 2023-10-03T10:12:47.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.836+0000 7f1d86ffd700 1 -- 172.21.15.146:0/1111603876 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c011d60 con 0x7f1d980a13a0 2023-10-03T10:12:47.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.836+0000 7f1d9ca81700 1 -- 172.21.15.146:0/1111603876 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d90009a70 con 0x7f1d980a13a0 2023-10-03T10:12:47.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.837+0000 7f1d9ca81700 1 -- 172.21.15.146:0/1111603876 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9806ca60 con 0x7f1d980a13a0 2023-10-03T10:12:47.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.837+0000 7f1d86ffd700 1 -- 172.21.15.146:0/1111603876 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d8c01a400 con 0x7f1d980a13a0 2023-10-03T10:12:47.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.838+0000 7f1d86ffd700 1 -- 172.21.15.146:0/1111603876 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1d8c03f600 con 0x7f1d980a13a0 2023-10-03T10:12:47.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.838+0000 7f1d9ca81700 1 -- 172.21.15.146:0/1111603876 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d981251c0 con 0x7f1d980a13a0 2023-10-03T10:12:47.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.847+0000 7f1d86ffd700 1 -- 172.21.15.146:0/1111603876 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d8c015080 con 0x7f1d980a13a0 2023-10-03T10:12:47.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.902+0000 7f6f8e772700 1 Processor -- start 2023-10-03T10:12:47.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.902+0000 7f6f8e772700 1 -- start start 2023-10-03T10:12:47.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.903+0000 7f6f8e772700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f8809e870 0x7f6f8809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.903+0000 7f6f8e772700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6f8809f180 0x7f6f88131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.903+0000 7f6f8e772700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8809c970 con 0x7f6f88131d70 2023-10-03T10:12:47.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.903+0000 7f6f8e772700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f880a0920 con 0x7f6f8809f180 2023-10-03T10:12:47.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.903+0000 7f6f8e772700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8809f9c0 con 0x7f6f8809e870 2023-10-03T10:12:47.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.903+0000 7f6f87fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f8809e870 0x7f6f8809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.903+0000 7f6f87fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f8809e870 0x7f6f8809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40616/0 (socket says 172.21.15.146:40616) 2023-10-03T10:12:47.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.903+0000 7f6f87fff700 1 -- 172.21.15.146:0/2674048775 learned_addr learned my addr 172.21.15.146:0/2674048775 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:47.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.904+0000 7f6f877fe700 1 --2- 172.21.15.146:0/2674048775 >> v2:172.21.15.146:3300/0 conn(0x7f6f8809f180 0x7f6f88131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.904+0000 7f6f86ffd700 1 -- 172.21.15.146:0/2674048775 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2159701019 0 0) 0x7f6f8809c970 con 0x7f6f88131d70 2023-10-03T10:12:47.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.904+0000 7f6f87fff700 1 -- 172.21.15.146:0/2674048775 >> v2:172.21.15.146:3300/0 conn(0x7f6f8809f180 msgr2=0x7f6f88131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.904+0000 7f6f87fff700 1 --2- 172.21.15.146:0/2674048775 >> v2:172.21.15.146:3300/0 conn(0x7f6f8809f180 0x7f6f88131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.904+0000 7f6f87fff700 1 -- 172.21.15.146:0/2674048775 >> v1:172.21.15.146:6789/0 conn(0x7f6f88131d70 legacy=0x7f6f88138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.904+0000 7f6f87fff700 1 -- 172.21.15.146:0/2674048775 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8809bab0 con 0x7f6f8809e870 2023-10-03T10:12:47.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.904+0000 7f6f877fe700 1 --2- 172.21.15.146:0/2674048775 >> v2:172.21.15.146:3300/0 conn(0x7f6f8809f180 0x7f6f88131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:47.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.904+0000 7f6f87fff700 1 --2- 172.21.15.146:0/2674048775 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f8809e870 0x7f6f8809ec40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6f780098f0 tx=0x7f6f78009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6bef4ecea8bd255 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.904+0000 7f6f86ffd700 1 -- 172.21.15.146:0/2674048775 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7800b8a0 con 0x7f6f8809e870 2023-10-03T10:12:47.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.904+0000 7f6f86ffd700 1 -- 172.21.15.146:0/2674048775 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7800ba00 con 0x7f6f8809e870 2023-10-03T10:12:47.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.904+0000 7f6f86ffd700 1 -- 172.21.15.146:0/2674048775 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7800bd90 con 0x7f6f8809e870 2023-10-03T10:12:47.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.905+0000 7f6f8e772700 1 -- 172.21.15.146:0/2674048775 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f8809e870 msgr2=0x7f6f8809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.905+0000 7f6f8e772700 1 --2- 172.21.15.146:0/2674048775 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f8809e870 0x7f6f8809ec40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6f780098f0 tx=0x7f6f78009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:47.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.905+0000 7f6f8e772700 1 -- 172.21.15.146:0/2674048775 shutdown_connections 2023-10-03T10:12:47.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.905+0000 7f6f8e772700 1 --2- 172.21.15.146:0/2674048775 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f8809e870 0x7f6f8809ec40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.905+0000 7f6f8e772700 1 --2- 172.21.15.146:0/2674048775 >> v2:172.21.15.146:3300/0 conn(0x7f6f8809f180 0x7f6f88131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.905+0000 7f6f8e772700 1 -- 172.21.15.146:0/2674048775 >> 172.21.15.146:0/2674048775 conn(0x7f6f880a4430 msgr2=0x7f6f880a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.905+0000 7f6f8e772700 1 -- 172.21.15.146:0/2674048775 shutdown_connections 2023-10-03T10:12:47.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.905+0000 7f6f8e772700 1 -- 172.21.15.146:0/2674048775 wait complete. 2023-10-03T10:12:47.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.906+0000 7f6f8e772700 1 Processor -- start 2023-10-03T10:12:47.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.907+0000 7f6f8e772700 1 -- start start 2023-10-03T10:12:47.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.907+0000 7f6f8e772700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f8809e870 0x7f6f881d5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.907+0000 7f6f8e772700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f8809f180 0x7f6f881d58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.907+0000 7f6f8e772700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f88131d70 0x7f6f8811a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.907+0000 7f6f8e772700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8811d890 con 0x7f6f8809e870 2023-10-03T10:12:47.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.907+0000 7f6f8e772700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8811da70 con 0x7f6f8809f180 2023-10-03T10:12:47.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.907+0000 7f6f8e772700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f881d4e30 con 0x7f6f88131d70 2023-10-03T10:12:47.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.907+0000 7f6f87fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f8809e870 0x7f6f881d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.907+0000 7f6f87fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f8809e870 0x7f6f881d5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51120/0 (socket says 172.21.15.146:51120) 2023-10-03T10:12:47.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.907+0000 7f6f87fff700 1 -- 172.21.15.146:0/1380951590 learned_addr learned my addr 172.21.15.146:0/1380951590 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:47.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.907+0000 7f6f8cd0f700 1 --2- 172.21.15.146:0/1380951590 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f88131d70 0x7f6f8811a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.908+0000 7f6f8cd0f700 1 -- 172.21.15.146:0/1380951590 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f8809f180 msgr2=0x7f6f881d58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.908+0000 7f6f8cd0f700 1 --2- 172.21.15.146:0/1380951590 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f8809f180 0x7f6f881d58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.908+0000 7f6f8cd0f700 1 -- 172.21.15.146:0/1380951590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f8809e870 msgr2=0x7f6f881d5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.908+0000 7f6f8cd0f700 1 --2- 172.21.15.146:0/1380951590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f8809e870 0x7f6f881d5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.908+0000 7f6f8cd0f700 1 -- 172.21.15.146:0/1380951590 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f78009550 con 0x7f6f88131d70 2023-10-03T10:12:47.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.908+0000 7f6f87fff700 1 --2- 172.21.15.146:0/1380951590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f8809e870 0x7f6f881d5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:47.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.908+0000 7f6f8cd0f700 1 --2- 172.21.15.146:0/1380951590 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f88131d70 0x7f6f8811a6c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000c7f0 tx=0x7f6f8000cb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.908+0000 7f6f84ff9700 1 -- 172.21.15.146:0/1380951590 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f80003e30 con 0x7f6f88131d70 2023-10-03T10:12:47.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.908+0000 7f6f84ff9700 1 -- 172.21.15.146:0/1380951590 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f80005070 con 0x7f6f88131d70 2023-10-03T10:12:47.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.908+0000 7f6f84ff9700 1 -- 172.21.15.146:0/1380951590 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f80005420 con 0x7f6f88131d70 2023-10-03T10:12:47.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.908+0000 7f6f8e772700 1 -- 172.21.15.146:0/1380951590 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8811d170 con 0x7f6f88131d70 2023-10-03T10:12:47.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.908+0000 7f6f8e772700 1 -- 172.21.15.146:0/1380951590 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8809dba0 con 0x7f6f88131d70 2023-10-03T10:12:47.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.909+0000 7f6f84ff9700 1 -- 172.21.15.146:0/1380951590 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f80005580 con 0x7f6f88131d70 2023-10-03T10:12:47.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.909+0000 7f6f84ff9700 1 -- 172.21.15.146:0/1380951590 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6f8003ee40 con 0x7f6f88131d70 2023-10-03T10:12:47.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.910+0000 7f6f8e772700 1 -- 172.21.15.146:0/1380951590 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8804f2a0 con 0x7f6f88131d70 2023-10-03T10:12:47.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.914+0000 7f6f84ff9700 1 -- 172.21.15.146:0/1380951590 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f80017020 con 0x7f6f88131d70 2023-10-03T10:12:47.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.938+0000 7ff0ce768700 1 Processor -- start 2023-10-03T10:12:47.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.938+0000 7ff0ce768700 1 -- start start 2023-10-03T10:12:47.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.938+0000 7ff0ce768700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff0c8138040 0x7ff0c8138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.938+0000 7ff0ce768700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c80a08e0 0x7ff0c80a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.938+0000 7ff0ce768700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0c80a1230 0x7ff0c813ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.938+0000 7ff0ce768700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c80a2100 con 0x7ff0c8138040 2023-10-03T10:12:47.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.938+0000 7ff0ce768700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c8138950 con 0x7ff0c80a1230 2023-10-03T10:12:47.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.938+0000 7ff0ce768700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c81379e0 con 0x7ff0c80a08e0 2023-10-03T10:12:47.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.938+0000 7ff0c77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c80a08e0 0x7ff0c80a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.938+0000 7ff0c77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c80a08e0 0x7ff0c80a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40634/0 (socket says 172.21.15.146:40634) 2023-10-03T10:12:47.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.938+0000 7ff0c77fe700 1 -- 172.21.15.146:0/2321122144 learned_addr learned my addr 172.21.15.146:0/2321122144 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:47.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.938+0000 7ff0ccd05700 1 --2- 172.21.15.146:0/2321122144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0c80a1230 0x7ff0c813ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.939+0000 7ff0c7fff700 1 --2- 172.21.15.146:0/2321122144 >> v2:172.21.15.146:3300/0 conn(0x7ff0c8138040 0x7ff0c8138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.939+0000 7ff0c77fe700 1 -- 172.21.15.146:0/2321122144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0c80a1230 msgr2=0x7ff0c813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.939+0000 7ff0c77fe700 1 --2- 172.21.15.146:0/2321122144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0c80a1230 0x7ff0c813ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.939+0000 7ff0c77fe700 1 -- 172.21.15.146:0/2321122144 >> v2:172.21.15.146:3300/0 conn(0x7ff0c8138040 msgr2=0x7ff0c8138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.939+0000 7ff0c77fe700 1 --2- 172.21.15.146:0/2321122144 >> v2:172.21.15.146:3300/0 conn(0x7ff0c8138040 0x7ff0c8138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.939+0000 7ff0c77fe700 1 -- 172.21.15.146:0/2321122144 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c809b9b0 con 0x7ff0c80a08e0 2023-10-03T10:12:47.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.939+0000 7ff0c77fe700 1 --2- 172.21.15.146:0/2321122144 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c80a08e0 0x7ff0c80a0cf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009950 tx=0x7ff0bc009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80010475059577aa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.939+0000 7ff0c6ffd700 1 -- 172.21.15.146:0/2321122144 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc011830 con 0x7ff0c80a08e0 2023-10-03T10:12:47.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.939+0000 7ff0c6ffd700 1 -- 172.21.15.146:0/2321122144 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0bc011990 con 0x7ff0c80a08e0 2023-10-03T10:12:47.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.939+0000 7ff0c6ffd700 1 -- 172.21.15.146:0/2321122144 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc011d40 con 0x7ff0c80a08e0 2023-10-03T10:12:47.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.940+0000 7ff0ce768700 1 -- 172.21.15.146:0/2321122144 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c80a08e0 msgr2=0x7ff0c80a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.940+0000 7ff0ce768700 1 --2- 172.21.15.146:0/2321122144 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c80a08e0 0x7ff0c80a0cf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009950 tx=0x7ff0bc009c60 comp rx=0 tx=0).stop 2023-10-03T10:12:47.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.940+0000 7ff0ce768700 1 -- 172.21.15.146:0/2321122144 shutdown_connections 2023-10-03T10:12:47.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.940+0000 7ff0ce768700 1 --2- 172.21.15.146:0/2321122144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0c80a1230 0x7ff0c813ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.940+0000 7ff0ce768700 1 --2- 172.21.15.146:0/2321122144 >> v2:172.21.15.146:3300/0 conn(0x7ff0c8138040 0x7ff0c8138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.940+0000 7ff0ce768700 1 --2- 172.21.15.146:0/2321122144 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c80a08e0 0x7ff0c80a0cf0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.940+0000 7ff0ce768700 1 -- 172.21.15.146:0/2321122144 >> 172.21.15.146:0/2321122144 conn(0x7ff0c80a2980 msgr2=0x7ff0c80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.940+0000 7ff0ce768700 1 -- 172.21.15.146:0/2321122144 shutdown_connections 2023-10-03T10:12:47.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.940+0000 7ff0ce768700 1 -- 172.21.15.146:0/2321122144 wait complete. 2023-10-03T10:12:47.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.941+0000 7ff0ce768700 1 Processor -- start 2023-10-03T10:12:47.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.941+0000 7ff0ce768700 1 -- start start 2023-10-03T10:12:47.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.942+0000 7ff0ce768700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c80a08e0 0x7ff0c81370a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.942+0000 7ff0ce768700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0c80a1230 0x7ff0c81359c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.942+0000 7ff0ce768700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0c8138040 0x7ff0c8135f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.942+0000 7ff0ce768700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c809c7e0 con 0x7ff0c80a1230 2023-10-03T10:12:47.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.942+0000 7ff0ce768700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c811a7b0 con 0x7ff0c8138040 2023-10-03T10:12:47.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.942+0000 7ff0ce768700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c811aed0 con 0x7ff0c80a08e0 2023-10-03T10:12:47.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.942+0000 7fae4395b700 1 Processor -- start 2023-10-03T10:12:47.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.942+0000 7ff0c7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c80a08e0 0x7ff0c81370a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.942+0000 7ff0ccd05700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0c8138040 0x7ff0c8135f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.942+0000 7ff0c7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c80a08e0 0x7ff0c81370a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40636/0 (socket says 172.21.15.146:40636) 2023-10-03T10:12:47.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.942+0000 7ff0c7fff700 1 -- 172.21.15.146:0/3772676782 learned_addr learned my addr 172.21.15.146:0/3772676782 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:47.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.942+0000 7ff0c77fe700 1 --2- 172.21.15.146:0/3772676782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0c80a1230 0x7ff0c81359c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.942+0000 7fae4395b700 1 -- start start 2023-10-03T10:12:47.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.942+0000 7ff0c7fff700 1 -- 172.21.15.146:0/3772676782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0c8138040 msgr2=0x7ff0c8135f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.942+0000 7ff0c7fff700 1 --2- 172.21.15.146:0/3772676782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0c8138040 0x7ff0c8135f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.942+0000 7ff0c7fff700 1 -- 172.21.15.146:0/3772676782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0c80a1230 msgr2=0x7ff0c81359c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.942+0000 7ff0c7fff700 1 --2- 172.21.15.146:0/3772676782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0c80a1230 0x7ff0c81359c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.942+0000 7ff0c7fff700 1 -- 172.21.15.146:0/3772676782 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0bc009550 con 0x7ff0c80a08e0 2023-10-03T10:12:47.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.942+0000 7ff0ccd05700 1 --2- 172.21.15.146:0/3772676782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0c8138040 0x7ff0c8135f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:47.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.943+0000 7ff0c7fff700 1 --2- 172.21.15.146:0/3772676782 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c80a08e0 0x7ff0c81370a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800e730 tx=0x7ff0b800ea40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.943+0000 7fae4395b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae3c0a0a30 0x7fae3c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.943+0000 7fae4395b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae3c0a1340 0x7fae3c12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.943+0000 7fae4395b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3c0a1e70 con 0x7fae3c1304a0 2023-10-03T10:12:47.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.943+0000 7fae4395b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c09a720 con 0x7fae3c0a1340 2023-10-03T10:12:47.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.943+0000 7fae4395b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c09b300 con 0x7fae3c0a0a30 2023-10-03T10:12:47.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.943+0000 7fae416f7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae3c0a0a30 0x7fae3c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.943+0000 7fae416f7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae3c0a0a30 0x7fae3c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40644/0 (socket says 172.21.15.146:40644) 2023-10-03T10:12:47.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.943+0000 7fae416f7700 1 -- 172.21.15.146:0/1067437043 learned_addr learned my addr 172.21.15.146:0/1067437043 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:47.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.943+0000 7fae40ef6700 1 --2- 172.21.15.146:0/1067437043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae3c0a1340 0x7fae3c12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.943+0000 7ff0c4ff9700 1 -- 172.21.15.146:0/3772676782 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8013610 con 0x7ff0c80a08e0 2023-10-03T10:12:47.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.943+0000 7ff0c4ff9700 1 -- 172.21.15.146:0/3772676782 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b8013770 con 0x7ff0c80a08e0 2023-10-03T10:12:47.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.943+0000 7ff0ce768700 1 -- 172.21.15.146:0/3772676782 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c813e510 con 0x7ff0c80a08e0 2023-10-03T10:12:47.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.943+0000 7ff0c4ff9700 1 -- 172.21.15.146:0/3772676782 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8013b20 con 0x7ff0c80a08e0 2023-10-03T10:12:47.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.943+0000 7ff0ce768700 1 -- 172.21.15.146:0/3772676782 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c809a240 con 0x7ff0c80a08e0 2023-10-03T10:12:47.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.943+0000 7fae416f7700 1 -- 172.21.15.146:0/1067437043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae3c0a1340 msgr2=0x7fae3c12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.943+0000 7fae416f7700 1 --2- 172.21.15.146:0/1067437043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae3c0a1340 0x7fae3c12ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.943+0000 7fae416f7700 1 -- 172.21.15.146:0/1067437043 >> v1:172.21.15.146:6789/0 conn(0x7fae3c1304a0 legacy=0x7fae3c1371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.943+0000 7fae416f7700 1 -- 172.21.15.146:0/1067437043 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c09abc0 con 0x7fae3c0a0a30 2023-10-03T10:12:47.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.943+0000 7fae416f7700 1 --2- 172.21.15.146:0/1067437043 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae3c0a0a30 0x7fae3c0a0e00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fae3800bb90 tx=0x7fae3800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f930df038a431341 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.944+0000 7fae33fff700 1 -- 172.21.15.146:0/1067437043 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae38005e30 con 0x7fae3c0a0a30 2023-10-03T10:12:47.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.944+0000 7fae33fff700 1 -- 172.21.15.146:0/1067437043 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3800d820 con 0x7fae3c0a0a30 2023-10-03T10:12:47.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.944+0000 7fae33fff700 1 -- 172.21.15.146:0/1067437043 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3800dbb0 con 0x7fae3c0a0a30 2023-10-03T10:12:47.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.944+0000 7ff0ce768700 1 -- 172.21.15.146:0/3772676782 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c804f2a0 con 0x7ff0c80a08e0 2023-10-03T10:12:47.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.944+0000 7ff0c4ff9700 1 -- 172.21.15.146:0/3772676782 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0b8013c80 con 0x7ff0c80a08e0 2023-10-03T10:12:47.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.944+0000 7ff0c4ff9700 1 -- 172.21.15.146:0/3772676782 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff0b801b9f0 con 0x7ff0c80a08e0 2023-10-03T10:12:47.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.945+0000 7fae4395b700 1 -- 172.21.15.146:0/1067437043 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae3c0a0a30 msgr2=0x7fae3c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.945+0000 7fae4395b700 1 --2- 172.21.15.146:0/1067437043 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae3c0a0a30 0x7fae3c0a0e00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fae3800bb90 tx=0x7fae3800bea0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.945+0000 7fae4395b700 1 -- 172.21.15.146:0/1067437043 shutdown_connections 2023-10-03T10:12:47.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.945+0000 7fae4395b700 1 --2- 172.21.15.146:0/1067437043 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae3c0a0a30 0x7fae3c0a0e00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.945+0000 7fae4395b700 1 --2- 172.21.15.146:0/1067437043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae3c0a1340 0x7fae3c12ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.945+0000 7fae4395b700 1 -- 172.21.15.146:0/1067437043 >> 172.21.15.146:0/1067437043 conn(0x7fae3c0a2980 msgr2=0x7fae3c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.945+0000 7fae4395b700 1 -- 172.21.15.146:0/1067437043 shutdown_connections 2023-10-03T10:12:47.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.945+0000 7fae4395b700 1 -- 172.21.15.146:0/1067437043 wait complete. 2023-10-03T10:12:47.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.946+0000 7fae4395b700 1 Processor -- start 2023-10-03T10:12:47.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.946+0000 7fae4395b700 1 -- start start 2023-10-03T10:12:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.946+0000 7fae4395b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae3c0a0a30 0x7fae3c12e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.946+0000 7fae4395b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae3c0a1340 0x7fae3c12e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.946+0000 7fae4395b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae3c1304a0 0x7fae3c12cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.946+0000 7fae4395b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c09ae00 con 0x7fae3c1304a0 2023-10-03T10:12:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.946+0000 7fae4395b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c07c8c0 con 0x7fae3c0a1340 2023-10-03T10:12:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.946+0000 7fae4395b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c07bd60 con 0x7fae3c0a0a30 2023-10-03T10:12:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.946+0000 7fae416f7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae3c0a0a30 0x7fae3c12e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.946+0000 7fae416f7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae3c0a0a30 0x7fae3c12e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40656/0 (socket says 172.21.15.146:40656) 2023-10-03T10:12:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.946+0000 7fae416f7700 1 -- 172.21.15.146:0/2669054418 learned_addr learned my addr 172.21.15.146:0/2669054418 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.946+0000 7fae40ef6700 1 --2- 172.21.15.146:0/2669054418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae3c0a1340 0x7fae3c12e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.946+0000 7fae41ef8700 1 --2- 172.21.15.146:0/2669054418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae3c1304a0 0x7fae3c12cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.947+0000 7fae41ef8700 1 -- 172.21.15.146:0/2669054418 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae3c0a0a30 msgr2=0x7fae3c12e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.947+0000 7fae41ef8700 1 --2- 172.21.15.146:0/2669054418 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae3c0a0a30 0x7fae3c12e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.947+0000 7fae41ef8700 1 -- 172.21.15.146:0/2669054418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae3c0a1340 msgr2=0x7fae3c12e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.947+0000 7fae41ef8700 1 --2- 172.21.15.146:0/2669054418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae3c0a1340 0x7fae3c12e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.947+0000 7fae41ef8700 1 -- 172.21.15.146:0/2669054418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3800b7a0 con 0x7fae3c1304a0 2023-10-03T10:12:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.947+0000 7fae41ef8700 1 --2- 172.21.15.146:0/2669054418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae3c1304a0 0x7fae3c12cb40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fae3400cb10 tx=0x7fae3400ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.947+0000 7fae31ffb700 1 -- 172.21.15.146:0/2669054418 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3400a7e0 con 0x7fae3c1304a0 2023-10-03T10:12:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.947+0000 7fae31ffb700 1 -- 172.21.15.146:0/2669054418 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3400a940 con 0x7fae3c1304a0 2023-10-03T10:12:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.947+0000 7fae31ffb700 1 -- 172.21.15.146:0/2669054418 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3400acf0 con 0x7fae3c1304a0 2023-10-03T10:12:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.948+0000 7fae4395b700 1 -- 172.21.15.146:0/2669054418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3c12ff60 con 0x7fae3c1304a0 2023-10-03T10:12:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.948+0000 7fae4395b700 1 -- 172.21.15.146:0/2669054418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3c07db50 con 0x7fae3c1304a0 2023-10-03T10:12:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.949+0000 7fae31ffb700 1 -- 172.21.15.146:0/2669054418 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae34056430 con 0x7fae3c1304a0 2023-10-03T10:12:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.949+0000 7fae31ffb700 1 -- 172.21.15.146:0/2669054418 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fae34083ac0 con 0x7fae3c1304a0 2023-10-03T10:12:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.949+0000 7fae4395b700 1 -- 172.21.15.146:0/2669054418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3c04f2a0 con 0x7fae3c1304a0 2023-10-03T10:12:47.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.950+0000 7ff0c4ff9700 1 -- 172.21.15.146:0/3772676782 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0b8044060 con 0x7ff0c80a08e0 2023-10-03T10:12:47.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:47.954+0000 7fae31ffb700 1 -- 172.21.15.146:0/2669054418 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae3405a020 con 0x7fae3c1304a0 2023-10-03T10:12:48.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.046+0000 7f1d9ca81700 1 -- 172.21.15.146:0/1111603876 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1d98125e80 con 0x7f1d980a13a0 2023-10-03T10:12:48.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.046+0000 7f1d86ffd700 1 -- 172.21.15.146:0/1111603876 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d8c00f8d0 con 0x7f1d980a13a0 2023-10-03T10:12:48.046 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:48.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.049+0000 7f1d9ca81700 1 -- 172.21.15.146:0/1111603876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d980a13a0 msgr2=0x7f1d98122810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.049+0000 7f1d9ca81700 1 --2- 172.21.15.146:0/1111603876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d980a13a0 0x7f1d98122810 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00b500 tx=0x7f1d8c00b810 comp rx=0 tx=0).stop 2023-10-03T10:12:48.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.050+0000 7f1d9ca81700 1 -- 172.21.15.146:0/1111603876 shutdown_connections 2023-10-03T10:12:48.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.050+0000 7f1d9ca81700 1 --2- 172.21.15.146:0/1111603876 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d98133f70 0x7f1d98122d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.050+0000 7f1d9ca81700 1 --2- 172.21.15.146:0/1111603876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d980a0a90 0x7f1d981222d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.050+0000 7f1d9ca81700 1 --2- 172.21.15.146:0/1111603876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d980a13a0 0x7f1d98122810 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.050+0000 7f1d9ca81700 1 -- 172.21.15.146:0/1111603876 >> 172.21.15.146:0/1111603876 conn(0x7f1d98099c40 msgr2=0x7f1d9811c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:48.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.050+0000 7f1d9ca81700 1 -- 172.21.15.146:0/1111603876 shutdown_connections 2023-10-03T10:12:48.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.050+0000 7f1d9ca81700 1 -- 172.21.15.146:0/1111603876 wait complete. 2023-10-03T10:12:48.062 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:48.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.115+0000 7f6f8e772700 1 -- 172.21.15.146:0/1380951590 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6f8806b2a0 con 0x7f6f88131d70 2023-10-03T10:12:48.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.116+0000 7f6f84ff9700 1 -- 172.21.15.146:0/1380951590 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f8000ad40 con 0x7f6f88131d70 2023-10-03T10:12:48.116 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:48.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.119+0000 7f6f8e772700 1 -- 172.21.15.146:0/1380951590 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f88131d70 msgr2=0x7f6f8811a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.119+0000 7f6f8e772700 1 --2- 172.21.15.146:0/1380951590 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f88131d70 0x7f6f8811a6c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000c7f0 tx=0x7f6f8000cb00 comp rx=0 tx=0).stop 2023-10-03T10:12:48.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.119+0000 7f6f8e772700 1 -- 172.21.15.146:0/1380951590 shutdown_connections 2023-10-03T10:12:48.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.119+0000 7f6f8e772700 1 --2- 172.21.15.146:0/1380951590 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f88131d70 0x7f6f8811a6c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.119+0000 7f6f8e772700 1 --2- 172.21.15.146:0/1380951590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f8809e870 0x7f6f881d5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.119+0000 7f6f8e772700 1 --2- 172.21.15.146:0/1380951590 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f8809f180 0x7f6f881d58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.119+0000 7f6f8e772700 1 -- 172.21.15.146:0/1380951590 >> 172.21.15.146:0/1380951590 conn(0x7f6f880a4430 msgr2=0x7f6f8806b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:48.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.119+0000 7f6f8e772700 1 -- 172.21.15.146:0/1380951590 shutdown_connections 2023-10-03T10:12:48.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.119+0000 7f6f8e772700 1 -- 172.21.15.146:0/1380951590 wait complete. 2023-10-03T10:12:48.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:48.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.150+0000 7fae4395b700 1 -- 172.21.15.146:0/2669054418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fae3c09f940 con 0x7fae3c1304a0 2023-10-03T10:12:48.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.150+0000 7fae31ffb700 1 -- 172.21.15.146:0/2669054418 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fae3406e090 con 0x7fae3c1304a0 2023-10-03T10:12:48.150 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:48.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.152+0000 7fae4395b700 1 -- 172.21.15.146:0/2669054418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae3c1304a0 msgr2=0x7fae3c12cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.152+0000 7fae4395b700 1 --2- 172.21.15.146:0/2669054418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae3c1304a0 0x7fae3c12cb40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fae3400cb10 tx=0x7fae3400ce20 comp rx=0 tx=0).stop 2023-10-03T10:12:48.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.153+0000 7fae4395b700 1 -- 172.21.15.146:0/2669054418 shutdown_connections 2023-10-03T10:12:48.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.153+0000 7fae4395b700 1 --2- 172.21.15.146:0/2669054418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae3c1304a0 0x7fae3c12cb40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.153+0000 7fae4395b700 1 --2- 172.21.15.146:0/2669054418 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae3c0a0a30 0x7fae3c12e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.153+0000 7fae4395b700 1 --2- 172.21.15.146:0/2669054418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae3c0a1340 0x7fae3c12e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.153+0000 7fae4395b700 1 -- 172.21.15.146:0/2669054418 >> 172.21.15.146:0/2669054418 conn(0x7fae3c0a2980 msgr2=0x7fae3c12f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:48.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.153+0000 7fae4395b700 1 -- 172.21.15.146:0/2669054418 shutdown_connections 2023-10-03T10:12:48.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.153+0000 7fae4395b700 1 -- 172.21.15.146:0/2669054418 wait complete. 2023-10-03T10:12:48.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.160+0000 7ff0ce768700 1 -- 172.21.15.146:0/3772676782 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff0c811b250 con 0x7ff0c80a08e0 2023-10-03T10:12:48.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.160+0000 7ff0c4ff9700 1 -- 172.21.15.146:0/3772676782 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff0b8012370 con 0x7ff0c80a08e0 2023-10-03T10:12:48.160 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:48.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.163+0000 7ff0ce768700 1 -- 172.21.15.146:0/3772676782 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c80a08e0 msgr2=0x7ff0c81370a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:48.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.163+0000 7ff0ce768700 1 --2- 172.21.15.146:0/3772676782 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c80a08e0 0x7ff0c81370a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800e730 tx=0x7ff0b800ea40 comp rx=0 tx=0).stop 2023-10-03T10:12:48.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.163+0000 7ff0ce768700 1 -- 172.21.15.146:0/3772676782 shutdown_connections 2023-10-03T10:12:48.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.163+0000 7ff0ce768700 1 --2- 172.21.15.146:0/3772676782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0c8138040 0x7ff0c8135f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.163+0000 7ff0ce768700 1 --2- 172.21.15.146:0/3772676782 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c80a08e0 0x7ff0c81370a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.163+0000 7ff0ce768700 1 --2- 172.21.15.146:0/3772676782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0c80a1230 0x7ff0c81359c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:48.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.163+0000 7ff0ce768700 1 -- 172.21.15.146:0/3772676782 >> 172.21.15.146:0/3772676782 conn(0x7ff0c80a2980 msgr2=0x7ff0c809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:48.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.163+0000 7ff0ce768700 1 -- 172.21.15.146:0/3772676782 shutdown_connections 2023-10-03T10:12:48.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:48.163+0000 7ff0ce768700 1 -- 172.21.15.146:0/3772676782 wait complete. 2023-10-03T10:12:48.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:48.174 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:49.063 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:49.136 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:49.165 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:49.175 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:49.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.209+0000 7f069582a700 1 Processor -- start 2023-10-03T10:12:49.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.209+0000 7f069582a700 1 -- start start 2023-10-03T10:12:49.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.210+0000 7f069582a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f069012cef0 0x7f069012d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.210+0000 7f069582a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0690133540 0x7f0690133910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.210+0000 7f069582a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069009ac40 con 0x7f0690133e50 2023-10-03T10:12:49.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.210+0000 7f069582a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069009a740 con 0x7f0690133540 2023-10-03T10:12:49.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.210+0000 7f069582a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f069009f3a0 con 0x7f069012cef0 2023-10-03T10:12:49.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.210+0000 7f068e7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0690133540 0x7f0690133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.210+0000 7f068f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0690133e50 0x7f069013a8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53326/0 (socket says 172.21.15.146:53326) 2023-10-03T10:12:49.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.210+0000 7f068f7fe700 1 -- 172.21.15.146:0/3972516960 learned_addr learned my addr 172.21.15.146:0/3972516960 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:49.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.210+0000 7f068effd700 1 --2- 172.21.15.146:0/3972516960 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f069012cef0 0x7f069012d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.210+0000 7f068dffb700 1 -- 172.21.15.146:0/3972516960 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450525826 0 0) 0x7f069009ac40 con 0x7f0690133e50 2023-10-03T10:12:49.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.211+0000 7f068dffb700 1 -- 172.21.15.146:0/3972516960 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f067c0035b0 con 0x7f0690133e50 2023-10-03T10:12:49.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.211+0000 7f068effd700 1 -- 172.21.15.146:0/3972516960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0690133540 msgr2=0x7f0690133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:49.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.211+0000 7f068effd700 1 --2- 172.21.15.146:0/3972516960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0690133540 0x7f0690133910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.211+0000 7f068effd700 1 -- 172.21.15.146:0/3972516960 >> v1:172.21.15.146:6789/0 conn(0x7f0690133e50 legacy=0x7f069013a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.211+0000 7f068effd700 1 -- 172.21.15.146:0/3972516960 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069009b010 con 0x7f069012cef0 2023-10-03T10:12:49.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.211+0000 7f068effd700 1 --2- 172.21.15.146:0/3972516960 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f069012cef0 0x7f069012d2c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0678009870 tx=0x7f0678009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f48feb7c5721a85 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.211+0000 7f068dffb700 1 -- 172.21.15.146:0/3972516960 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0678011830 con 0x7f069012cef0 2023-10-03T10:12:49.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.211+0000 7f068dffb700 1 -- 172.21.15.146:0/3972516960 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0678011990 con 0x7f069012cef0 2023-10-03T10:12:49.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.211+0000 7f068dffb700 1 -- 172.21.15.146:0/3972516960 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0678011d00 con 0x7f069012cef0 2023-10-03T10:12:49.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.212+0000 7f069582a700 1 -- 172.21.15.146:0/3972516960 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f069012cef0 msgr2=0x7f069012d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.212+0000 7f069582a700 1 --2- 172.21.15.146:0/3972516960 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f069012cef0 0x7f069012d2c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0678009870 tx=0x7f0678009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:49.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.213+0000 7f069582a700 1 -- 172.21.15.146:0/3972516960 shutdown_connections 2023-10-03T10:12:49.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.213+0000 7f069582a700 1 --2- 172.21.15.146:0/3972516960 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f069012cef0 0x7f069012d2c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.213+0000 7f069582a700 1 --2- 172.21.15.146:0/3972516960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0690133540 0x7f0690133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.213+0000 7f069582a700 1 -- 172.21.15.146:0/3972516960 >> 172.21.15.146:0/3972516960 conn(0x7f0690099c40 msgr2=0x7f06900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.213+0000 7f069582a700 1 -- 172.21.15.146:0/3972516960 shutdown_connections 2023-10-03T10:12:49.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.213+0000 7f069582a700 1 -- 172.21.15.146:0/3972516960 wait complete. 2023-10-03T10:12:49.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.214+0000 7f069582a700 1 Processor -- start 2023-10-03T10:12:49.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.214+0000 7f069582a700 1 -- start start 2023-10-03T10:12:49.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.215+0000 7f069582a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f069012cef0 0x7f0690070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.215+0000 7f069582a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0690133540 0x7f0690070c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.215+0000 7f069582a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0690133e50 0x7f0690071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.215+0000 7f069582a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069011ec70 con 0x7f0690133e50 2023-10-03T10:12:49.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.215+0000 7f069582a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069011fdf0 con 0x7f069012cef0 2023-10-03T10:12:49.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.215+0000 7f069582a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0690130fa0 con 0x7f0690133540 2023-10-03T10:12:49.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.215+0000 7f068f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0690133e50 0x7f0690071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.215+0000 7f068f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0690133e50 0x7f0690071180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51158/0 (socket says 172.21.15.146:51158) 2023-10-03T10:12:49.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.215+0000 7f068f7fe700 1 -- 172.21.15.146:0/422617631 learned_addr learned my addr 172.21.15.146:0/422617631 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:49.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.215+0000 7f068e7fc700 1 --2- 172.21.15.146:0/422617631 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0690133540 0x7f0690070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.216+0000 7f068f7fe700 1 -- 172.21.15.146:0/422617631 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0690133540 msgr2=0x7f0690070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.216+0000 7f068f7fe700 1 --2- 172.21.15.146:0/422617631 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0690133540 0x7f0690070c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.216+0000 7f068f7fe700 1 -- 172.21.15.146:0/422617631 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f069012cef0 msgr2=0x7f0690070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.216+0000 7f068f7fe700 1 --2- 172.21.15.146:0/422617631 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f069012cef0 0x7f0690070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.216+0000 7f068f7fe700 1 -- 172.21.15.146:0/422617631 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06780094a0 con 0x7f0690133e50 2023-10-03T10:12:49.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.216+0000 7f068e7fc700 1 --2- 172.21.15.146:0/422617631 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0690133540 0x7f0690070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:49.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.216+0000 7f068f7fe700 1 --2- 172.21.15.146:0/422617631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0690133e50 0x7f0690071180 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f068800cb70 tx=0x7f068800ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.216+0000 7f0687fff700 1 -- 172.21.15.146:0/422617631 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068800aa60 con 0x7f0690133e50 2023-10-03T10:12:49.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.216+0000 7f0687fff700 1 -- 172.21.15.146:0/422617631 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068800abc0 con 0x7f0690133e50 2023-10-03T10:12:49.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.216+0000 7f069582a700 1 -- 172.21.15.146:0/422617631 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069009a510 con 0x7f0690133e50 2023-10-03T10:12:49.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.216+0000 7f0687fff700 1 -- 172.21.15.146:0/422617631 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688012400 con 0x7f0690133e50 2023-10-03T10:12:49.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.216+0000 7f069582a700 1 -- 172.21.15.146:0/422617631 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069012dbb0 con 0x7f0690133e50 2023-10-03T10:12:49.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.217+0000 7f069582a700 1 -- 172.21.15.146:0/422617631 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0690072250 con 0x7f0690133e50 2023-10-03T10:12:49.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.218+0000 7f0687fff700 1 -- 172.21.15.146:0/422617631 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f068801b3b0 con 0x7f0690133e50 2023-10-03T10:12:49.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.218+0000 7f0687fff700 1 -- 172.21.15.146:0/422617631 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f068803f860 con 0x7f0690133e50 2023-10-03T10:12:49.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.222+0000 7f0687fff700 1 -- 172.21.15.146:0/422617631 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f06880113a0 con 0x7f0690133e50 2023-10-03T10:12:49.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.275+0000 7f8d4131f700 1 Processor -- start 2023-10-03T10:12:49.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.275+0000 7f8d4131f700 1 -- start start 2023-10-03T10:12:49.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.275+0000 7f8d4131f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8d3c138410 0x7f8d3c0a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.275+0000 7f8d4131f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c13dd10 0x7f8d3c1400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.275+0000 7f8d4131f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d3c1379e0 con 0x7f8d3c138040 2023-10-03T10:12:49.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.275+0000 7f8d4131f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d3c0a2100 con 0x7f8d3c138410 2023-10-03T10:12:49.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.275+0000 7f8d4131f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c09b9b0 con 0x7f8d3c13dd10 2023-10-03T10:12:49.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.276+0000 7f8d3a7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8d3c138410 0x7f8d3c0a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.276+0000 7f8d3a7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8d3c138410 0x7f8d3c0a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51174/0 (socket says 172.21.15.146:51174) 2023-10-03T10:12:49.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.276+0000 7f8d3a7fc700 1 -- 172.21.15.146:0/122049975 learned_addr learned my addr 172.21.15.146:0/122049975 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:49.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.276+0000 7f8d3b7fe700 1 --2- 172.21.15.146:0/122049975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c13dd10 0x7f8d3c1400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.276+0000 7f8d3b7fe700 1 -- 172.21.15.146:0/122049975 >> v2:172.21.15.146:3300/0 conn(0x7f8d3c138410 msgr2=0x7f8d3c0a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:49.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.276+0000 7f8d3b7fe700 1 --2- 172.21.15.146:0/122049975 >> v2:172.21.15.146:3300/0 conn(0x7f8d3c138410 0x7f8d3c0a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.276+0000 7f8d3b7fe700 1 -- 172.21.15.146:0/122049975 >> v1:172.21.15.146:6789/0 conn(0x7f8d3c138040 legacy=0x7f8d3c0a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.276+0000 7f8d3b7fe700 1 -- 172.21.15.146:0/122049975 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3c137c10 con 0x7f8d3c13dd10 2023-10-03T10:12:49.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.276+0000 7f8d3a7fc700 1 --2- 172.21.15.146:0/122049975 >> v2:172.21.15.146:3300/0 conn(0x7f8d3c138410 0x7f8d3c0a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:49.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.276+0000 7f8d3b7fe700 1 --2- 172.21.15.146:0/122049975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c13dd10 0x7f8d3c1400f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8d34009dc0 tx=0x7f8d3400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb74b03de5ed7965 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.276+0000 7f8d39ffb700 1 -- 172.21.15.146:0/122049975 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3400e070 con 0x7f8d3c13dd10 2023-10-03T10:12:49.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.277+0000 7f8d39ffb700 1 -- 172.21.15.146:0/122049975 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3400bae0 con 0x7f8d3c13dd10 2023-10-03T10:12:49.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.277+0000 7f8d39ffb700 1 -- 172.21.15.146:0/122049975 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3400be90 con 0x7f8d3c13dd10 2023-10-03T10:12:49.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.277+0000 7f8d4131f700 1 -- 172.21.15.146:0/122049975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c13dd10 msgr2=0x7f8d3c1400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.277+0000 7f8d4131f700 1 --2- 172.21.15.146:0/122049975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c13dd10 0x7f8d3c1400f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8d34009dc0 tx=0x7f8d3400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:49.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.277+0000 7f8d4131f700 1 -- 172.21.15.146:0/122049975 shutdown_connections 2023-10-03T10:12:49.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.277+0000 7f8d4131f700 1 --2- 172.21.15.146:0/122049975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c13dd10 0x7f8d3c1400f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.277+0000 7f8d4131f700 1 --2- 172.21.15.146:0/122049975 >> v2:172.21.15.146:3300/0 conn(0x7f8d3c138410 0x7f8d3c0a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.277+0000 7f8d4131f700 1 -- 172.21.15.146:0/122049975 >> 172.21.15.146:0/122049975 conn(0x7f8d3c0a2980 msgr2=0x7f8d3c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.277+0000 7f8d4131f700 1 -- 172.21.15.146:0/122049975 shutdown_connections 2023-10-03T10:12:49.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.277+0000 7f8d4131f700 1 -- 172.21.15.146:0/122049975 wait complete. 2023-10-03T10:12:49.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.279+0000 7f8d4131f700 1 Processor -- start 2023-10-03T10:12:49.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.279+0000 7f8d4131f700 1 -- start start 2023-10-03T10:12:49.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.279+0000 7f8d4131f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d3c138040 0x7f8d3c137110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.279+0000 7f8d4131f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d3c138410 0x7f8d3c1358c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.279+0000 7f8d4131f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c13dd10 0x7f8d3c135e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.279+0000 7f8d4131f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c070710 con 0x7f8d3c138410 2023-10-03T10:12:49.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.279+0000 7f8d4131f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c070520 con 0x7f8d3c13dd10 2023-10-03T10:12:49.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.279+0000 7f8d4131f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c130020 con 0x7f8d3c138040 2023-10-03T10:12:49.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.279+0000 7f8d3b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c13dd10 0x7f8d3c135e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.279+0000 7f8d3b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c13dd10 0x7f8d3c135e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52642/0 (socket says 172.21.15.146:52642) 2023-10-03T10:12:49.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.279+0000 7f8d3a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d3c138410 0x7f8d3c1358c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.279+0000 7f8d3b7fe700 1 -- 172.21.15.146:0/298013599 learned_addr learned my addr 172.21.15.146:0/298013599 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:49.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.279+0000 7f8d3affd700 1 --2- 172.21.15.146:0/298013599 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d3c138040 0x7f8d3c137110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.280+0000 7f8d3b7fe700 1 -- 172.21.15.146:0/298013599 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d3c138040 msgr2=0x7f8d3c137110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.280+0000 7f8d3b7fe700 1 --2- 172.21.15.146:0/298013599 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d3c138040 0x7f8d3c137110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.280+0000 7f8d3b7fe700 1 -- 172.21.15.146:0/298013599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d3c138410 msgr2=0x7f8d3c1358c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.280+0000 7f8d3b7fe700 1 --2- 172.21.15.146:0/298013599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d3c138410 0x7f8d3c1358c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.280+0000 7f8d3b7fe700 1 -- 172.21.15.146:0/298013599 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d30009550 con 0x7f8d3c13dd10 2023-10-03T10:12:49.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.280+0000 7f8d3affd700 1 --2- 172.21.15.146:0/298013599 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d3c138040 0x7f8d3c137110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:49.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.280+0000 7f8d3a7fc700 1 --2- 172.21.15.146:0/298013599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d3c138410 0x7f8d3c1358c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:49.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.280+0000 7f8d3b7fe700 1 --2- 172.21.15.146:0/298013599 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c13dd10 0x7f8d3c135e00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8d34013000 tx=0x7f8d34004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.280+0000 7f8d237fe700 1 -- 172.21.15.146:0/298013599 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d340048b0 con 0x7f8d3c13dd10 2023-10-03T10:12:49.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.280+0000 7f8d237fe700 1 -- 172.21.15.146:0/298013599 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d34020070 con 0x7f8d3c13dd10 2023-10-03T10:12:49.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.280+0000 7f8d237fe700 1 -- 172.21.15.146:0/298013599 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d34026670 con 0x7f8d3c13dd10 2023-10-03T10:12:49.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.280+0000 7f8d4131f700 1 -- 172.21.15.146:0/298013599 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d34009a70 con 0x7f8d3c13dd10 2023-10-03T10:12:49.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.280+0000 7f8d4131f700 1 -- 172.21.15.146:0/298013599 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d3c09a240 con 0x7f8d3c13dd10 2023-10-03T10:12:49.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.281+0000 7f8d4131f700 1 -- 172.21.15.146:0/298013599 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d3c072780 con 0x7f8d3c13dd10 2023-10-03T10:12:49.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.282+0000 7f8d237fe700 1 -- 172.21.15.146:0/298013599 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d34030430 con 0x7f8d3c13dd10 2023-10-03T10:12:49.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.282+0000 7f8d237fe700 1 -- 172.21.15.146:0/298013599 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8d34022070 con 0x7f8d3c13dd10 2023-10-03T10:12:49.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.291+0000 7f8d237fe700 1 -- 172.21.15.146:0/298013599 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d34012430 con 0x7f8d3c13dd10 2023-10-03T10:12:49.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.314+0000 7f1bf3fbe700 1 Processor -- start 2023-10-03T10:12:49.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.314+0000 7f1bf3fbe700 1 -- start start 2023-10-03T10:12:49.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.315+0000 7f1bf3fbe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1bec09a090 0x7f1bec09e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.315+0000 7f1bf3fbe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1bec09f2a0 0x7f1bec13fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.315+0000 7f1bf3fbe700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bec06bc80 con 0x7f1bec09ee90 2023-10-03T10:12:49.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.315+0000 7f1bf3fbe700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bec09a460 con 0x7f1bec09f2a0 2023-10-03T10:12:49.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.315+0000 7f1bf3fbe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec06c0f0 con 0x7f1bec09a090 2023-10-03T10:12:49.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.315+0000 7f1bf1d5a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1bec09a090 0x7f1bec09e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.315+0000 7f1bf1d5a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1bec09a090 0x7f1bec09e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40698/0 (socket says 172.21.15.146:40698) 2023-10-03T10:12:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.315+0000 7f1bf1559700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1bec09ee90 0x7f1bec13c470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53336/0 (socket says 172.21.15.146:53336) 2023-10-03T10:12:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.315+0000 7f1bf1d5a700 1 -- 172.21.15.146:0/2863743073 learned_addr learned my addr 172.21.15.146:0/2863743073 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.315+0000 7f1bf255b700 1 --2- 172.21.15.146:0/2863743073 >> v2:172.21.15.146:3300/0 conn(0x7f1bec09f2a0 0x7f1bec13fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.315+0000 7f1bf1d5a700 1 -- 172.21.15.146:0/2863743073 >> v2:172.21.15.146:3300/0 conn(0x7f1bec09f2a0 msgr2=0x7f1bec13fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.315+0000 7f1bf1d5a700 1 --2- 172.21.15.146:0/2863743073 >> v2:172.21.15.146:3300/0 conn(0x7f1bec09f2a0 0x7f1bec13fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.315+0000 7f1bf1d5a700 1 -- 172.21.15.146:0/2863743073 >> v1:172.21.15.146:6789/0 conn(0x7f1bec09ee90 legacy=0x7f1bec13c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.315+0000 7f1bf1d5a700 1 -- 172.21.15.146:0/2863743073 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec06d8f0 con 0x7f1bec09a090 2023-10-03T10:12:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.315+0000 7f1bf1d5a700 1 --2- 172.21.15.146:0/2863743073 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1bec09a090 0x7f1bec09e950 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1be80098f0 tx=0x7f1be8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5411017f00e5a2c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.316+0000 7f1bf0d58700 1 -- 172.21.15.146:0/2863743073 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be8005e30 con 0x7f1bec09a090 2023-10-03T10:12:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.316+0000 7f1bf0d58700 1 -- 172.21.15.146:0/2863743073 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be8004030 con 0x7f1bec09a090 2023-10-03T10:12:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.316+0000 7f1bf0d58700 1 -- 172.21.15.146:0/2863743073 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be80043e0 con 0x7f1bec09a090 2023-10-03T10:12:49.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.316+0000 7f1bf3fbe700 1 -- 172.21.15.146:0/2863743073 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1bec09a090 msgr2=0x7f1bec09e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.316+0000 7f1bf3fbe700 1 --2- 172.21.15.146:0/2863743073 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1bec09a090 0x7f1bec09e950 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1be80098f0 tx=0x7f1be8009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:49.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.316+0000 7f1bf3fbe700 1 -- 172.21.15.146:0/2863743073 shutdown_connections 2023-10-03T10:12:49.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.316+0000 7f1bf3fbe700 1 --2- 172.21.15.146:0/2863743073 >> v2:172.21.15.146:3300/0 conn(0x7f1bec09f2a0 0x7f1bec13fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.316+0000 7f1bf3fbe700 1 --2- 172.21.15.146:0/2863743073 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1bec09a090 0x7f1bec09e950 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.316+0000 7f1bf3fbe700 1 -- 172.21.15.146:0/2863743073 >> 172.21.15.146:0/2863743073 conn(0x7f1bec0a0f70 msgr2=0x7f1bec0a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.316+0000 7f1bf3fbe700 1 -- 172.21.15.146:0/2863743073 shutdown_connections 2023-10-03T10:12:49.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.316+0000 7f1bf3fbe700 1 -- 172.21.15.146:0/2863743073 wait complete. 2023-10-03T10:12:49.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.318+0000 7f1bf3fbe700 1 Processor -- start 2023-10-03T10:12:49.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.318+0000 7f1bf3fbe700 1 -- start start 2023-10-03T10:12:49.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.318+0000 7f1bf3fbe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bec09a090 0x7f1bec11cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.318+0000 7f1bf3fbe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bec09ee90 0x7f1bec12ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.318+0000 7f1bf3fbe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1bec09f2a0 0x7f1bec12f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.318+0000 7f1bf3fbe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec11d760 con 0x7f1bec09ee90 2023-10-03T10:12:49.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.318+0000 7f1bf3fbe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec11d570 con 0x7f1bec09a090 2023-10-03T10:12:49.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.318+0000 7f1bf3fbe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec11de40 con 0x7f1bec09f2a0 2023-10-03T10:12:49.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.319+0000 7f1bf255b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1bec09f2a0 0x7f1bec12f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.319+0000 7f1bf1559700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bec09ee90 0x7f1bec12ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.319+0000 7f1bf255b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1bec09f2a0 0x7f1bec12f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40704/0 (socket says 172.21.15.146:40704) 2023-10-03T10:12:49.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.319+0000 7f1bf1559700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bec09ee90 0x7f1bec12ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51194/0 (socket says 172.21.15.146:51194) 2023-10-03T10:12:49.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.319+0000 7f1bf255b700 1 -- 172.21.15.146:0/2767435018 learned_addr learned my addr 172.21.15.146:0/2767435018 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:49.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.319+0000 7f1bf1d5a700 1 --2- 172.21.15.146:0/2767435018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bec09a090 0x7f1bec11cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.319+0000 7f1bf255b700 1 -- 172.21.15.146:0/2767435018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bec09a090 msgr2=0x7f1bec11cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.319+0000 7f1bf255b700 1 --2- 172.21.15.146:0/2767435018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bec09a090 0x7f1bec11cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.319+0000 7f1bf255b700 1 -- 172.21.15.146:0/2767435018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bec09ee90 msgr2=0x7f1bec12ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.319+0000 7f1bf255b700 1 --2- 172.21.15.146:0/2767435018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bec09ee90 0x7f1bec12ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.319+0000 7f1bf255b700 1 -- 172.21.15.146:0/2767435018 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be8009500 con 0x7f1bec09f2a0 2023-10-03T10:12:49.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.319+0000 7f1bf255b700 1 --2- 172.21.15.146:0/2767435018 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1bec09f2a0 0x7f1bec12f170 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1be4009dd0 tx=0x7f1be400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.319+0000 7f1be27fc700 1 -- 172.21.15.146:0/2767435018 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be4009c40 con 0x7f1bec09f2a0 2023-10-03T10:12:49.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.319+0000 7f1be27fc700 1 -- 172.21.15.146:0/2767435018 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be400f040 con 0x7f1bec09f2a0 2023-10-03T10:12:49.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.319+0000 7f1bf3fbe700 1 -- 172.21.15.146:0/2767435018 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bec0a2000 con 0x7f1bec09f2a0 2023-10-03T10:12:49.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.319+0000 7f1be27fc700 1 -- 172.21.15.146:0/2767435018 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be400ceb0 con 0x7f1bec09f2a0 2023-10-03T10:12:49.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.319+0000 7f1bf3fbe700 1 -- 172.21.15.146:0/2767435018 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bec0a0460 con 0x7f1bec09f2a0 2023-10-03T10:12:49.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.320+0000 7f1be27fc700 1 -- 172.21.15.146:0/2767435018 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1be4014480 con 0x7f1bec09f2a0 2023-10-03T10:12:49.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.320+0000 7f1bf3fbe700 1 -- 172.21.15.146:0/2767435018 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bec04f2a0 con 0x7f1bec09f2a0 2023-10-03T10:12:49.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.320+0000 7f1be27fc700 1 -- 172.21.15.146:0/2767435018 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1be403ff30 con 0x7f1bec09f2a0 2023-10-03T10:12:49.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.322+0000 7f6091475700 1 Processor -- start 2023-10-03T10:12:49.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.322+0000 7f6091475700 1 -- start start 2023-10-03T10:12:49.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.323+0000 7f6091475700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f608c136950 0x7f608c138d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.323+0000 7f6091475700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f608c139270 0x7f608c13b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.323+0000 7f6091475700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f608c133640 con 0x7f608c133a70 2023-10-03T10:12:49.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.323+0000 7f6091475700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608c0a1d50 con 0x7f608c136950 2023-10-03T10:12:49.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.323+0000 7f6091475700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f608c134550 con 0x7f608c139270 2023-10-03T10:12:49.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.323+0000 7f608affd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f608c133a70 0x7f608c133e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53346/0 (socket says 172.21.15.146:53346) 2023-10-03T10:12:49.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.323+0000 7f608affd700 1 -- 172.21.15.146:0/1129152197 learned_addr learned my addr 172.21.15.146:0/1129152197 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:49.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.323+0000 7f608b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f608c139270 0x7f608c13b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.323+0000 7f608b7fe700 1 -- 172.21.15.146:0/1129152197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f608c136950 msgr2=0x7f608c138d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:49.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.323+0000 7f608b7fe700 1 --2- 172.21.15.146:0/1129152197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f608c136950 0x7f608c138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.323+0000 7f608b7fe700 1 -- 172.21.15.146:0/1129152197 >> v1:172.21.15.146:6789/0 conn(0x7f608c133a70 legacy=0x7f608c133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.323+0000 7f6089ffb700 1 -- 172.21.15.146:0/1129152197 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1751220300 0 0) 0x7f608c133640 con 0x7f608c133a70 2023-10-03T10:12:49.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.323+0000 7f608b7fe700 1 -- 172.21.15.146:0/1129152197 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c09b620 con 0x7f608c139270 2023-10-03T10:12:49.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.324+0000 7f608b7fe700 1 --2- 172.21.15.146:0/1129152197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f608c139270 0x7f608c13b650 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6084009dc0 tx=0x7f608400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=220cb8d25a4188ed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.326+0000 7f6089ffb700 1 -- 172.21.15.146:0/1129152197 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608400e070 con 0x7f608c139270 2023-10-03T10:12:49.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.326+0000 7f1be27fc700 1 -- 172.21.15.146:0/2767435018 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1be40118b0 con 0x7f1bec09f2a0 2023-10-03T10:12:49.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.326+0000 7f6089ffb700 1 -- 172.21.15.146:0/1129152197 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608400bbd0 con 0x7f608c139270 2023-10-03T10:12:49.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.326+0000 7f6089ffb700 1 -- 172.21.15.146:0/1129152197 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6084012430 con 0x7f608c139270 2023-10-03T10:12:49.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.326+0000 7f6091475700 1 -- 172.21.15.146:0/1129152197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f608c139270 msgr2=0x7f608c13b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.326+0000 7f6091475700 1 --2- 172.21.15.146:0/1129152197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f608c139270 0x7f608c13b650 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6084009dc0 tx=0x7f608400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:49.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.330+0000 7f6091475700 1 -- 172.21.15.146:0/1129152197 shutdown_connections 2023-10-03T10:12:49.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.330+0000 7f6091475700 1 --2- 172.21.15.146:0/1129152197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f608c139270 0x7f608c13b650 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.330+0000 7f6091475700 1 --2- 172.21.15.146:0/1129152197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f608c136950 0x7f608c138d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.330+0000 7f6091475700 1 -- 172.21.15.146:0/1129152197 >> 172.21.15.146:0/1129152197 conn(0x7f608c0a2980 msgr2=0x7f608c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.330+0000 7f6091475700 1 -- 172.21.15.146:0/1129152197 shutdown_connections 2023-10-03T10:12:49.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.330+0000 7f6091475700 1 -- 172.21.15.146:0/1129152197 wait complete. 2023-10-03T10:12:49.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.331+0000 7f6091475700 1 Processor -- start 2023-10-03T10:12:49.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.331+0000 7f6091475700 1 -- start start 2023-10-03T10:12:49.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.332+0000 7f6091475700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f608c133a70 0x7f608c119e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.332+0000 7f6091475700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f608c136950 0x7f608c11a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.332+0000 7f6091475700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f608c139270 0x7f608c11a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.332+0000 7f6091475700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608c138dd0 con 0x7f608c136950 2023-10-03T10:12:49.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.332+0000 7f6091475700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608c11da30 con 0x7f608c133a70 2023-10-03T10:12:49.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.332+0000 7f6091475700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f608c11d0d0 con 0x7f608c139270 2023-10-03T10:12:49.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.332+0000 7f608a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f608c136950 0x7f608c11a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.332+0000 7f608b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f608c139270 0x7f608c11a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.332+0000 7f608a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f608c136950 0x7f608c11a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51198/0 (socket says 172.21.15.146:51198) 2023-10-03T10:12:49.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.332+0000 7f608b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f608c139270 0x7f608c11a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40734/0 (socket says 172.21.15.146:40734) 2023-10-03T10:12:49.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.332+0000 7f608a7fc700 1 -- 172.21.15.146:0/2384144916 learned_addr learned my addr 172.21.15.146:0/2384144916 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:49.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.332+0000 7f608affd700 1 --2- 172.21.15.146:0/2384144916 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f608c133a70 0x7f608c119e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.333+0000 7f608a7fc700 1 -- 172.21.15.146:0/2384144916 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f608c139270 msgr2=0x7f608c11a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.333+0000 7f608a7fc700 1 --2- 172.21.15.146:0/2384144916 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f608c139270 0x7f608c11a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.333+0000 7f608a7fc700 1 -- 172.21.15.146:0/2384144916 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f608c133a70 msgr2=0x7f608c119e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.333+0000 7f608a7fc700 1 --2- 172.21.15.146:0/2384144916 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f608c133a70 0x7f608c119e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.333+0000 7f608a7fc700 1 -- 172.21.15.146:0/2384144916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6084009a70 con 0x7f608c136950 2023-10-03T10:12:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.333+0000 7f608b7fe700 1 --2- 172.21.15.146:0/2384144916 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f608c139270 0x7f608c11a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.333+0000 7f608a7fc700 1 --2- 172.21.15.146:0/2384144916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f608c136950 0x7f608c11a3d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f608000b500 tx=0x7f608000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.333+0000 7f60737fe700 1 -- 172.21.15.146:0/2384144916 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6080011830 con 0x7f608c136950 2023-10-03T10:12:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.333+0000 7f60737fe700 1 -- 172.21.15.146:0/2384144916 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6080011990 con 0x7f608c136950 2023-10-03T10:12:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.333+0000 7f60737fe700 1 -- 172.21.15.146:0/2384144916 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6080011d40 con 0x7f608c136950 2023-10-03T10:12:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.333+0000 7f6091475700 1 -- 172.21.15.146:0/2384144916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608c11d380 con 0x7f608c136950 2023-10-03T10:12:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.333+0000 7f6091475700 1 -- 172.21.15.146:0/2384144916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608c11c1c0 con 0x7f608c136950 2023-10-03T10:12:49.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.334+0000 7f60737fe700 1 -- 172.21.15.146:0/2384144916 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f608001a400 con 0x7f608c136950 2023-10-03T10:12:49.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.334+0000 7f60737fe700 1 -- 172.21.15.146:0/2384144916 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6080040b80 con 0x7f608c136950 2023-10-03T10:12:49.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.335+0000 7f6091475700 1 -- 172.21.15.146:0/2384144916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f608c04f2a0 con 0x7f608c136950 2023-10-03T10:12:49.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.344+0000 7f60737fe700 1 -- 172.21.15.146:0/2384144916 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6080015070 con 0x7f608c136950 2023-10-03T10:12:49.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.434+0000 7f069582a700 1 -- 172.21.15.146:0/422617631 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f069004f2a0 con 0x7f0690133e50 2023-10-03T10:12:49.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.435+0000 7f0687fff700 1 -- 172.21.15.146:0/422617631 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0688017070 con 0x7f0690133e50 2023-10-03T10:12:49.435 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:49.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.437+0000 7f069582a700 1 -- 172.21.15.146:0/422617631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0690133e50 msgr2=0x7f0690071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.437+0000 7f069582a700 1 --2- 172.21.15.146:0/422617631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0690133e50 0x7f0690071180 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f068800cb70 tx=0x7f068800ce80 comp rx=0 tx=0).stop 2023-10-03T10:12:49.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.437+0000 7f069582a700 1 -- 172.21.15.146:0/422617631 shutdown_connections 2023-10-03T10:12:49.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.437+0000 7f069582a700 1 --2- 172.21.15.146:0/422617631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0690133e50 0x7f0690071180 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.437+0000 7f069582a700 1 --2- 172.21.15.146:0/422617631 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f069012cef0 0x7f0690070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.437+0000 7f069582a700 1 --2- 172.21.15.146:0/422617631 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0690133540 0x7f0690070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.437+0000 7f069582a700 1 -- 172.21.15.146:0/422617631 >> 172.21.15.146:0/422617631 conn(0x7f0690099c40 msgr2=0x7f06900a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.437+0000 7f069582a700 1 -- 172.21.15.146:0/422617631 shutdown_connections 2023-10-03T10:12:49.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.437+0000 7f069582a700 1 -- 172.21.15.146:0/422617631 wait complete. 2023-10-03T10:12:49.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:49.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.501+0000 7f8d4131f700 1 -- 172.21.15.146:0/298013599 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8d3c04f2a0 con 0x7f8d3c13dd10 2023-10-03T10:12:49.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.501+0000 7f8d237fe700 1 -- 172.21.15.146:0/298013599 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d3402b020 con 0x7f8d3c13dd10 2023-10-03T10:12:49.501 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:49.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.503+0000 7f8d4131f700 1 -- 172.21.15.146:0/298013599 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c13dd10 msgr2=0x7f8d3c135e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.503+0000 7f8d4131f700 1 --2- 172.21.15.146:0/298013599 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c13dd10 0x7f8d3c135e00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8d34013000 tx=0x7f8d34004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.503+0000 7f8d4131f700 1 -- 172.21.15.146:0/298013599 shutdown_connections 2023-10-03T10:12:49.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.503+0000 7f8d4131f700 1 --2- 172.21.15.146:0/298013599 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c13dd10 0x7f8d3c135e00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.503+0000 7f8d4131f700 1 --2- 172.21.15.146:0/298013599 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d3c138040 0x7f8d3c137110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.503+0000 7f8d4131f700 1 --2- 172.21.15.146:0/298013599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d3c138410 0x7f8d3c1358c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.503+0000 7f8d4131f700 1 -- 172.21.15.146:0/298013599 >> 172.21.15.146:0/298013599 conn(0x7f8d3c0a2980 msgr2=0x7f8d3c13e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.503+0000 7f8d4131f700 1 -- 172.21.15.146:0/298013599 shutdown_connections 2023-10-03T10:12:49.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.503+0000 7f8d4131f700 1 -- 172.21.15.146:0/298013599 wait complete. 2023-10-03T10:12:49.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:49.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.523+0000 7f1bf3fbe700 1 -- 172.21.15.146:0/2767435018 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1bec06b250 con 0x7f1bec09f2a0 2023-10-03T10:12:49.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.524+0000 7f1be27fc700 1 -- 172.21.15.146:0/2767435018 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1be4018070 con 0x7f1bec09f2a0 2023-10-03T10:12:49.523 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:49.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.526+0000 7f1bf3fbe700 1 -- 172.21.15.146:0/2767435018 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1bec09f2a0 msgr2=0x7f1bec12f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.526+0000 7f1bf3fbe700 1 --2- 172.21.15.146:0/2767435018 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1bec09f2a0 0x7f1bec12f170 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1be4009dd0 tx=0x7f1be400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.526+0000 7f1bf3fbe700 1 -- 172.21.15.146:0/2767435018 shutdown_connections 2023-10-03T10:12:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.526+0000 7f1bf3fbe700 1 --2- 172.21.15.146:0/2767435018 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1bec09f2a0 0x7f1bec12f170 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.526+0000 7f1bf3fbe700 1 --2- 172.21.15.146:0/2767435018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bec09a090 0x7f1bec11cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.526+0000 7f1bf3fbe700 1 --2- 172.21.15.146:0/2767435018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bec09ee90 0x7f1bec12ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.526+0000 7f1bf3fbe700 1 -- 172.21.15.146:0/2767435018 >> 172.21.15.146:0/2767435018 conn(0x7f1bec0a0f70 msgr2=0x7f1bec0a3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.526+0000 7f1bf3fbe700 1 -- 172.21.15.146:0/2767435018 shutdown_connections 2023-10-03T10:12:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.526+0000 7f1bf3fbe700 1 -- 172.21.15.146:0/2767435018 wait complete. 2023-10-03T10:12:49.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:49.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.538+0000 7f6091475700 1 -- 172.21.15.146:0/2384144916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f608c09a350 con 0x7f608c136950 2023-10-03T10:12:49.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.538+0000 7f60737fe700 1 -- 172.21.15.146:0/2384144916 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6080015020 con 0x7f608c136950 2023-10-03T10:12:49.538 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:49.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.541+0000 7f6091475700 1 -- 172.21.15.146:0/2384144916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f608c136950 msgr2=0x7f608c11a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.541+0000 7f6091475700 1 --2- 172.21.15.146:0/2384144916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f608c136950 0x7f608c11a3d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f608000b500 tx=0x7f608000b810 comp rx=0 tx=0).stop 2023-10-03T10:12:49.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.541+0000 7f6091475700 1 -- 172.21.15.146:0/2384144916 shutdown_connections 2023-10-03T10:12:49.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.541+0000 7f6091475700 1 --2- 172.21.15.146:0/2384144916 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f608c139270 0x7f608c11a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.541+0000 7f6091475700 1 --2- 172.21.15.146:0/2384144916 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f608c133a70 0x7f608c119e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.541+0000 7f6091475700 1 --2- 172.21.15.146:0/2384144916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f608c136950 0x7f608c11a3d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.541+0000 7f6091475700 1 -- 172.21.15.146:0/2384144916 >> 172.21.15.146:0/2384144916 conn(0x7f608c0a2980 msgr2=0x7f608c137420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.541+0000 7f6091475700 1 -- 172.21.15.146:0/2384144916 shutdown_connections 2023-10-03T10:12:49.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:49.541+0000 7f6091475700 1 -- 172.21.15.146:0/2384144916 wait complete. 2023-10-03T10:12:49.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:50.455 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:50.516 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:50.538 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:50.553 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:50.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.602+0000 7ff00207b700 1 Processor -- start 2023-10-03T10:12:50.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.602+0000 7ff00207b700 1 -- start start 2023-10-03T10:12:50.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.603+0000 7ff00207b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feffc132100 0x7feffc1367d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.603+0000 7ff00207b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feffc1314b0 0x7feffc138d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.603+0000 7ff00207b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feffc0a0f20 con 0x7feffc066410 2023-10-03T10:12:50.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.603+0000 7ff00207b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feffc0667e0 con 0x7feffc132100 2023-10-03T10:12:50.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.603+0000 7ff00207b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feffc0a23c0 con 0x7feffc1314b0 2023-10-03T10:12:50.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.603+0000 7feffaffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feffc132100 0x7feffc1367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.603+0000 7feffaffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feffc132100 0x7feffc1367d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51214/0 (socket says 172.21.15.146:51214) 2023-10-03T10:12:50.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.603+0000 7feffaffd700 1 -- 172.21.15.146:0/3951284183 learned_addr learned my addr 172.21.15.146:0/3951284183 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:50.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.603+0000 7feffb7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7feffc066410 0x7feffc1319f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53348/0 (socket says 172.21.15.146:53348) 2023-10-03T10:12:50.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.603+0000 7feffbfff700 1 --2- 172.21.15.146:0/3951284183 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feffc1314b0 0x7feffc138d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.603+0000 7feffbfff700 1 -- 172.21.15.146:0/3951284183 >> v2:172.21.15.146:3300/0 conn(0x7feffc132100 msgr2=0x7feffc1367d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:50.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.603+0000 7feffbfff700 1 --2- 172.21.15.146:0/3951284183 >> v2:172.21.15.146:3300/0 conn(0x7feffc132100 0x7feffc1367d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.603+0000 7feffbfff700 1 -- 172.21.15.146:0/3951284183 >> v1:172.21.15.146:6789/0 conn(0x7feffc066410 legacy=0x7feffc1319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.603+0000 7feffa7fc700 1 -- 172.21.15.146:0/3951284183 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895802844 0 0) 0x7feffc0a0f20 con 0x7feffc066410 2023-10-03T10:12:50.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.603+0000 7feffbfff700 1 -- 172.21.15.146:0/3951284183 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc0a16e0 con 0x7feffc1314b0 2023-10-03T10:12:50.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.603+0000 7feffaffd700 1 --2- 172.21.15.146:0/3951284183 >> v2:172.21.15.146:3300/0 conn(0x7feffc132100 0x7feffc1367d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:50.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.604+0000 7feffbfff700 1 --2- 172.21.15.146:0/3951284183 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feffc1314b0 0x7feffc138d20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feff4009dc0 tx=0x7feff400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7faf37fa124d2921 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.604+0000 7feffa7fc700 1 -- 172.21.15.146:0/3951284183 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff400e070 con 0x7feffc1314b0 2023-10-03T10:12:50.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.604+0000 7feffa7fc700 1 -- 172.21.15.146:0/3951284183 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff400bae0 con 0x7feffc1314b0 2023-10-03T10:12:50.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.604+0000 7feffa7fc700 1 -- 172.21.15.146:0/3951284183 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff400be90 con 0x7feffc1314b0 2023-10-03T10:12:50.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.605+0000 7ff00207b700 1 -- 172.21.15.146:0/3951284183 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feffc1314b0 msgr2=0x7feffc138d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.605+0000 7ff00207b700 1 --2- 172.21.15.146:0/3951284183 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feffc1314b0 0x7feffc138d20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feff4009dc0 tx=0x7feff400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:50.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.605+0000 7ff00207b700 1 -- 172.21.15.146:0/3951284183 shutdown_connections 2023-10-03T10:12:50.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.605+0000 7ff00207b700 1 --2- 172.21.15.146:0/3951284183 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feffc1314b0 0x7feffc138d20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.605+0000 7ff00207b700 1 --2- 172.21.15.146:0/3951284183 >> v2:172.21.15.146:3300/0 conn(0x7feffc132100 0x7feffc1367d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.605+0000 7ff00207b700 1 -- 172.21.15.146:0/3951284183 >> 172.21.15.146:0/3951284183 conn(0x7feffc0a2980 msgr2=0x7feffc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.605+0000 7ff00207b700 1 -- 172.21.15.146:0/3951284183 shutdown_connections 2023-10-03T10:12:50.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.605+0000 7ff00207b700 1 -- 172.21.15.146:0/3951284183 wait complete. 2023-10-03T10:12:50.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.606+0000 7ff00207b700 1 Processor -- start 2023-10-03T10:12:50.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.606+0000 7ff00207b700 1 -- start start 2023-10-03T10:12:50.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.607+0000 7ff00207b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feffc066410 0x7feffc099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.607+0000 7ff00207b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feffc1314b0 0x7feffc09a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.607+0000 7ff00207b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feffc132100 0x7feffc09a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.607+0000 7ff00207b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc137910 con 0x7feffc066410 2023-10-03T10:12:50.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.607+0000 7ff00207b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feffc136300 con 0x7feffc132100 2023-10-03T10:12:50.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.607+0000 7ff00207b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feffc09d510 con 0x7feffc1314b0 2023-10-03T10:12:50.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.607+0000 7feffaffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feffc1314b0 0x7feffc09a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.607+0000 7feffb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feffc066410 0x7feffc099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.607+0000 7feffaffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feffc1314b0 0x7feffc09a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40764/0 (socket says 172.21.15.146:40764) 2023-10-03T10:12:50.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.607+0000 7feffaffd700 1 -- 172.21.15.146:0/1864434755 learned_addr learned my addr 172.21.15.146:0/1864434755 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:50.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.607+0000 7feffbfff700 1 --2- 172.21.15.146:0/1864434755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feffc132100 0x7feffc09a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.608+0000 7feffaffd700 1 -- 172.21.15.146:0/1864434755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feffc132100 msgr2=0x7feffc09a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.608+0000 7feffaffd700 1 --2- 172.21.15.146:0/1864434755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feffc132100 0x7feffc09a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.608+0000 7feffaffd700 1 -- 172.21.15.146:0/1864434755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feffc066410 msgr2=0x7feffc099d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.608+0000 7feffaffd700 1 --2- 172.21.15.146:0/1864434755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feffc066410 0x7feffc099d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.608+0000 7feffaffd700 1 -- 172.21.15.146:0/1864434755 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff0009550 con 0x7feffc1314b0 2023-10-03T10:12:50.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.608+0000 7feffaffd700 1 --2- 172.21.15.146:0/1864434755 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feffc1314b0 0x7feffc09a240 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feff000ec10 tx=0x7feff000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.608+0000 7fefe3fff700 1 -- 172.21.15.146:0/1864434755 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff000c850 con 0x7feffc1314b0 2023-10-03T10:12:50.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.608+0000 7fefe3fff700 1 -- 172.21.15.146:0/1864434755 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff000c9b0 con 0x7feffc1314b0 2023-10-03T10:12:50.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.608+0000 7ff00207b700 1 -- 172.21.15.146:0/1864434755 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff4009a70 con 0x7feffc1314b0 2023-10-03T10:12:50.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.608+0000 7fefe3fff700 1 -- 172.21.15.146:0/1864434755 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff000cd20 con 0x7feffc1314b0 2023-10-03T10:12:50.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.608+0000 7ff00207b700 1 -- 172.21.15.146:0/1864434755 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feffc137380 con 0x7feffc1314b0 2023-10-03T10:12:50.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.609+0000 7fefe3fff700 1 -- 172.21.15.146:0/1864434755 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feff0013470 con 0x7feffc1314b0 2023-10-03T10:12:50.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.610+0000 7fefe3fff700 1 -- 172.21.15.146:0/1864434755 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feff003f8d0 con 0x7feffc1314b0 2023-10-03T10:12:50.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.611+0000 7ff00207b700 1 -- 172.21.15.146:0/1864434755 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feffc04f2a0 con 0x7feffc1314b0 2023-10-03T10:12:50.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.619+0000 7fefe3fff700 1 -- 172.21.15.146:0/1864434755 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feff0017080 con 0x7feffc1314b0 2023-10-03T10:12:50.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.659+0000 7fa3ba9e3700 1 Processor -- start 2023-10-03T10:12:50.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.659+0000 7fa3ba9e3700 1 -- start start 2023-10-03T10:12:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.660+0000 7fa3ba9e3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3b4133b80 0x7fa3b4133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.660+0000 7fa3ba9e3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3b4099a60 0x7fa3b40a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.660+0000 7fa3ba9e3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa3b40a0e20 0x7fa3b40a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.660+0000 7fa3ba9e3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b409aa00 con 0x7fa3b40a0e20 2023-10-03T10:12:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.660+0000 7fa3ba9e3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b409a080 con 0x7fa3b4133b80 2023-10-03T10:12:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.660+0000 7fa3ba9e3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b4133750 con 0x7fa3b4099a60 2023-10-03T10:12:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.660+0000 7fa3b37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3b4099a60 0x7fa3b40a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.660+0000 7fa3b3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3b4133b80 0x7fa3b4133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.660+0000 7fa3b37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3b4099a60 0x7fa3b40a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40778/0 (socket says 172.21.15.146:40778) 2023-10-03T10:12:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.660+0000 7fa3b37fe700 1 -- 172.21.15.146:0/2944194486 learned_addr learned my addr 172.21.15.146:0/2944194486 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.660+0000 7fa3b8f80700 1 --2- 172.21.15.146:0/2944194486 >> v2:172.21.15.146:3300/0 conn(0x7fa3b40a0e20 0x7fa3b40a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.660+0000 7fa3b37fe700 1 -- 172.21.15.146:0/2944194486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3b4133b80 msgr2=0x7fa3b4133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:50.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.660+0000 7fa3b37fe700 1 --2- 172.21.15.146:0/2944194486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3b4133b80 0x7fa3b4133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.660+0000 7fa3b37fe700 1 -- 172.21.15.146:0/2944194486 >> v2:172.21.15.146:3300/0 conn(0x7fa3b40a0e20 msgr2=0x7fa3b40a12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:50.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.660+0000 7fa3b37fe700 1 --2- 172.21.15.146:0/2944194486 >> v2:172.21.15.146:3300/0 conn(0x7fa3b40a0e20 0x7fa3b40a12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.660+0000 7fa3b37fe700 1 -- 172.21.15.146:0/2944194486 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b409a760 con 0x7fa3b4099a60 2023-10-03T10:12:50.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.660+0000 7fa3b37fe700 1 --2- 172.21.15.146:0/2944194486 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3b4099a60 0x7fa3b40a08e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa3a80098f0 tx=0x7fa3a8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=191f51ae49da435d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.661+0000 7fa3b2ffd700 1 -- 172.21.15.146:0/2944194486 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8011830 con 0x7fa3b4099a60 2023-10-03T10:12:50.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.661+0000 7fa3b2ffd700 1 -- 172.21.15.146:0/2944194486 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a8011990 con 0x7fa3b4099a60 2023-10-03T10:12:50.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.661+0000 7fa3b2ffd700 1 -- 172.21.15.146:0/2944194486 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8011d20 con 0x7fa3b4099a60 2023-10-03T10:12:50.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.661+0000 7fa3ba9e3700 1 -- 172.21.15.146:0/2944194486 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3b4099a60 msgr2=0x7fa3b40a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.661+0000 7fa3ba9e3700 1 --2- 172.21.15.146:0/2944194486 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3b4099a60 0x7fa3b40a08e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa3a80098f0 tx=0x7fa3a8009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:50.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.661+0000 7fa3ba9e3700 1 -- 172.21.15.146:0/2944194486 shutdown_connections 2023-10-03T10:12:50.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.661+0000 7fa3ba9e3700 1 --2- 172.21.15.146:0/2944194486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3b4133b80 0x7fa3b4133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.661+0000 7fa3ba9e3700 1 --2- 172.21.15.146:0/2944194486 >> v2:172.21.15.146:3300/0 conn(0x7fa3b40a0e20 0x7fa3b40a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.661+0000 7fa3ba9e3700 1 --2- 172.21.15.146:0/2944194486 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3b4099a60 0x7fa3b40a08e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.661+0000 7fa3ba9e3700 1 -- 172.21.15.146:0/2944194486 >> 172.21.15.146:0/2944194486 conn(0x7fa3b40a2980 msgr2=0x7fa3b40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.661+0000 7fa3ba9e3700 1 -- 172.21.15.146:0/2944194486 shutdown_connections 2023-10-03T10:12:50.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.661+0000 7fa3ba9e3700 1 -- 172.21.15.146:0/2944194486 wait complete. 2023-10-03T10:12:50.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.662+0000 7fa3ba9e3700 1 Processor -- start 2023-10-03T10:12:50.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.663+0000 7fa3ba9e3700 1 -- start start 2023-10-03T10:12:50.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.663+0000 7fa3ba9e3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3b4099a60 0x7fa3b411c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.663+0000 7fa3ba9e3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3b40a0e20 0x7fa3b411cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.663+0000 7fa3ba9e3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3b4133b80 0x7fa3b411d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.663+0000 7fa3ba9e3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b411dbf0 con 0x7fa3b40a0e20 2023-10-03T10:12:50.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.663+0000 7fa3ba9e3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b411e2b0 con 0x7fa3b4099a60 2023-10-03T10:12:50.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.663+0000 7fa3ba9e3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b411f500 con 0x7fa3b4133b80 2023-10-03T10:12:50.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.663+0000 7fa3b37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3b40a0e20 0x7fa3b411cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.663+0000 7fa3b37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3b40a0e20 0x7fa3b411cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51238/0 (socket says 172.21.15.146:51238) 2023-10-03T10:12:50.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.663+0000 7fa3b37fe700 1 -- 172.21.15.146:0/3479773346 learned_addr learned my addr 172.21.15.146:0/3479773346 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:50.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.664+0000 7fa3b8f80700 1 --2- 172.21.15.146:0/3479773346 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3b4133b80 0x7fa3b411d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.664+0000 7fa3b37fe700 1 -- 172.21.15.146:0/3479773346 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3b4133b80 msgr2=0x7fa3b411d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.664+0000 7fa3b37fe700 1 --2- 172.21.15.146:0/3479773346 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3b4133b80 0x7fa3b411d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.664+0000 7fa3b37fe700 1 -- 172.21.15.146:0/3479773346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3b4099a60 msgr2=0x7fa3b411c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.664+0000 7fa3b37fe700 1 --2- 172.21.15.146:0/3479773346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3b4099a60 0x7fa3b411c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.664+0000 7fa3b37fe700 1 -- 172.21.15.146:0/3479773346 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a8009550 con 0x7fa3b40a0e20 2023-10-03T10:12:50.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.664+0000 7fa3b37fe700 1 --2- 172.21.15.146:0/3479773346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3b40a0e20 0x7fa3b411cc80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009c40 tx=0x7fa3a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.664+0000 7fa3b0ff9700 1 -- 172.21.15.146:0/3479773346 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8004400 con 0x7fa3b40a0e20 2023-10-03T10:12:50.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.664+0000 7fa3b0ff9700 1 -- 172.21.15.146:0/3479773346 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a801f070 con 0x7fa3b40a0e20 2023-10-03T10:12:50.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.664+0000 7fa3b0ff9700 1 -- 172.21.15.146:0/3479773346 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a80038e0 con 0x7fa3b40a0e20 2023-10-03T10:12:50.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.664+0000 7fa3ba9e3700 1 -- 172.21.15.146:0/3479773346 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b411fee0 con 0x7fa3b40a0e20 2023-10-03T10:12:50.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.664+0000 7fa3ba9e3700 1 -- 172.21.15.146:0/3479773346 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b409c4c0 con 0x7fa3b40a0e20 2023-10-03T10:12:50.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.665+0000 7fa3ba9e3700 1 -- 172.21.15.146:0/3479773346 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b404f2a0 con 0x7fa3b40a0e20 2023-10-03T10:12:50.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.666+0000 7fa3b0ff9700 1 -- 172.21.15.146:0/3479773346 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa3a8021030 con 0x7fa3b40a0e20 2023-10-03T10:12:50.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.666+0000 7fa3b0ff9700 1 -- 172.21.15.146:0/3479773346 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa3a80409b0 con 0x7fa3b40a0e20 2023-10-03T10:12:50.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.675+0000 7fa3b0ff9700 1 -- 172.21.15.146:0/3479773346 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3a80199a0 con 0x7fa3b40a0e20 2023-10-03T10:12:50.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.695+0000 7f3ab7b16700 1 Processor -- start 2023-10-03T10:12:50.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.695+0000 7f3ab7b16700 1 -- start start 2023-10-03T10:12:50.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.696+0000 7f3ab7b16700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ab009d860 0x7f3ab009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.696+0000 7f3ab7b16700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ab0130eb0 0x7f3ab0138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.696+0000 7f3ab7b16700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab009aaa0 con 0x7f3ab009e170 2023-10-03T10:12:50.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.696+0000 7f3ab7b16700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab009f870 con 0x7f3ab0130eb0 2023-10-03T10:12:50.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.696+0000 7f3ab7b16700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab009b360 con 0x7f3ab009d860 2023-10-03T10:12:50.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.696+0000 7f3ab58b2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ab009d860 0x7f3ab009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.696+0000 7f3ab58b2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ab009d860 0x7f3ab009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40802/0 (socket says 172.21.15.146:40802) 2023-10-03T10:12:50.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.696+0000 7f3ab50b1700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3ab009e170 0x7f3ab01307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53358/0 (socket says 172.21.15.146:53358) 2023-10-03T10:12:50.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.696+0000 7f3ab58b2700 1 -- 172.21.15.146:0/4175070961 learned_addr learned my addr 172.21.15.146:0/4175070961 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:50.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.696+0000 7f3ab60b3700 1 --2- 172.21.15.146:0/4175070961 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ab0130eb0 0x7f3ab0138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.696+0000 7f3ab60b3700 1 -- 172.21.15.146:0/4175070961 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ab009d860 msgr2=0x7f3ab009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:50.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.696+0000 7f3ab60b3700 1 --2- 172.21.15.146:0/4175070961 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ab009d860 0x7f3ab009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.696+0000 7f3ab60b3700 1 -- 172.21.15.146:0/4175070961 >> v1:172.21.15.146:6789/0 conn(0x7f3ab009e170 legacy=0x7f3ab01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.696+0000 7f3ab60b3700 1 -- 172.21.15.146:0/4175070961 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab009b620 con 0x7f3ab0130eb0 2023-10-03T10:12:50.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.696+0000 7f3ab48b0700 1 -- 172.21.15.146:0/4175070961 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306342681 0 0) 0x7f3ab009aaa0 con 0x7f3ab009e170 2023-10-03T10:12:50.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.696+0000 7f3ab60b3700 1 --2- 172.21.15.146:0/4175070961 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ab0130eb0 0x7f3ab0138a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009dc0 tx=0x7f3aa800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=835bba4768d87fce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.697+0000 7f3ab48b0700 1 -- 172.21.15.146:0/4175070961 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa800e070 con 0x7f3ab0130eb0 2023-10-03T10:12:50.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.697+0000 7f3ab48b0700 1 -- 172.21.15.146:0/4175070961 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa800bb20 con 0x7f3ab0130eb0 2023-10-03T10:12:50.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.697+0000 7f3ab48b0700 1 -- 172.21.15.146:0/4175070961 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8012430 con 0x7f3ab0130eb0 2023-10-03T10:12:50.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.697+0000 7f3ab7b16700 1 -- 172.21.15.146:0/4175070961 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ab0130eb0 msgr2=0x7f3ab0138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.697+0000 7f3ab7b16700 1 --2- 172.21.15.146:0/4175070961 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ab0130eb0 0x7f3ab0138a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009dc0 tx=0x7f3aa800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.697+0000 7f3ab7b16700 1 -- 172.21.15.146:0/4175070961 shutdown_connections 2023-10-03T10:12:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.697+0000 7f3ab7b16700 1 --2- 172.21.15.146:0/4175070961 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ab0130eb0 0x7f3ab0138a00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.697+0000 7f3ab7b16700 1 --2- 172.21.15.146:0/4175070961 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ab009d860 0x7f3ab009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.697+0000 7f3ab7b16700 1 -- 172.21.15.146:0/4175070961 >> 172.21.15.146:0/4175070961 conn(0x7f3ab0099c40 msgr2=0x7f3ab00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.697+0000 7f3ab7b16700 1 -- 172.21.15.146:0/4175070961 shutdown_connections 2023-10-03T10:12:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.698+0000 7f3ab7b16700 1 -- 172.21.15.146:0/4175070961 wait complete. 2023-10-03T10:12:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.698+0000 7f3ab7b16700 1 Processor -- start 2023-10-03T10:12:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.699+0000 7f3ab7b16700 1 -- start start 2023-10-03T10:12:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.699+0000 7f3ab7b16700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ab009d860 0x7f3ab011e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.699+0000 7f3ab7b16700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ab009e170 0x7f3ab011e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.699+0000 7f3ab7b16700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ab0130eb0 0x7f3ab011ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.699+0000 7f3ab7b16700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab0121b00 con 0x7f3ab009d860 2023-10-03T10:12:50.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.699+0000 7f3ab7b16700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab0121de0 con 0x7f3ab0130eb0 2023-10-03T10:12:50.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.699+0000 7f3ab7b16700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00a0380 con 0x7f3ab009e170 2023-10-03T10:12:50.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.699+0000 7f3ab58b2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ab009d860 0x7f3ab011e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.699+0000 7f3ab58b2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ab009d860 0x7f3ab011e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51250/0 (socket says 172.21.15.146:51250) 2023-10-03T10:12:50.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.699+0000 7f3ab58b2700 1 -- 172.21.15.146:0/777117346 learned_addr learned my addr 172.21.15.146:0/777117346 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:50.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.699+0000 7f3ab50b1700 1 --2- 172.21.15.146:0/777117346 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ab009e170 0x7f3ab011e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.699+0000 7f3ab60b3700 1 --2- 172.21.15.146:0/777117346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ab0130eb0 0x7f3ab011ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.700+0000 7f3ab50b1700 1 -- 172.21.15.146:0/777117346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ab0130eb0 msgr2=0x7f3ab011ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.700+0000 7f3ab50b1700 1 --2- 172.21.15.146:0/777117346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ab0130eb0 0x7f3ab011ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.700+0000 7f3ab50b1700 1 -- 172.21.15.146:0/777117346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ab009d860 msgr2=0x7f3ab011e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.700+0000 7f3ab50b1700 1 --2- 172.21.15.146:0/777117346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ab009d860 0x7f3ab011e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.700+0000 7f3ab50b1700 1 -- 172.21.15.146:0/777117346 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa8009a70 con 0x7f3ab009e170 2023-10-03T10:12:50.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.700+0000 7f3ab60b3700 1 --2- 172.21.15.146:0/777117346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ab0130eb0 0x7f3ab011ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:50.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.700+0000 7f3ab50b1700 1 --2- 172.21.15.146:0/777117346 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ab009e170 0x7f3ab011e8a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3ab009a100 tx=0x7f3aa000c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.700+0000 7f3aa67fc700 1 -- 172.21.15.146:0/777117346 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0004c80 con 0x7f3ab009e170 2023-10-03T10:12:50.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.700+0000 7f3aa67fc700 1 -- 172.21.15.146:0/777117346 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa0004e00 con 0x7f3ab009e170 2023-10-03T10:12:50.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.700+0000 7f3ab7b16700 1 -- 172.21.15.146:0/777117346 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab009c8b0 con 0x7f3ab009e170 2023-10-03T10:12:50.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.700+0000 7f3aa67fc700 1 -- 172.21.15.146:0/777117346 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0007310 con 0x7f3ab009e170 2023-10-03T10:12:50.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.700+0000 7f3ab7b16700 1 -- 172.21.15.146:0/777117346 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab0121570 con 0x7f3ab009e170 2023-10-03T10:12:50.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.701+0000 7f3ab7b16700 1 -- 172.21.15.146:0/777117346 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab004f2a0 con 0x7f3ab009e170 2023-10-03T10:12:50.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.703+0000 7f3aa67fc700 1 -- 172.21.15.146:0/777117346 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3aa0007470 con 0x7f3ab009e170 2023-10-03T10:12:50.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.703+0000 7f3aa67fc700 1 -- 172.21.15.146:0/777117346 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3aa003f590 con 0x7f3ab009e170 2023-10-03T10:12:50.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.706+0000 7fa2f09f4700 1 Processor -- start 2023-10-03T10:12:50.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.706+0000 7fa2f09f4700 1 -- start start 2023-10-03T10:12:50.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.706+0000 7fa2f09f4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2ec138040 0x7fa2ec138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.706+0000 7fa2f09f4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa2ec0a08e0 0x7fa2ec0a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.707+0000 7fa2f09f4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2ec0a1230 0x7fa2ec13ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.707+0000 7fa2f09f4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ec0a2100 con 0x7fa2ec0a08e0 2023-10-03T10:12:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.707+0000 7fa2f09f4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec138950 con 0x7fa2ec0a1230 2023-10-03T10:12:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.707+0000 7fa2f09f4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec1379e0 con 0x7fa2ec138040 2023-10-03T10:12:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.707+0000 7fa2ead9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2ec0a1230 0x7fa2ec13ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.707+0000 7fa2ead9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2ec0a1230 0x7fa2ec13ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52726/0 (socket says 172.21.15.146:52726) 2023-10-03T10:12:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.707+0000 7fa2ead9d700 1 -- 172.21.15.146:0/1750980091 learned_addr learned my addr 172.21.15.146:0/1750980091 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.707+0000 7fa2e9d9b700 1 --2- 172.21.15.146:0/1750980091 >> v2:172.21.15.146:3300/0 conn(0x7fa2ec0a08e0 0x7fa2ec0a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.707+0000 7fa2ead9d700 1 -- 172.21.15.146:0/1750980091 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2ec138040 msgr2=0x7fa2ec138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.707+0000 7fa2ead9d700 1 --2- 172.21.15.146:0/1750980091 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2ec138040 0x7fa2ec138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.707+0000 7fa2ead9d700 1 -- 172.21.15.146:0/1750980091 >> v2:172.21.15.146:3300/0 conn(0x7fa2ec0a08e0 msgr2=0x7fa2ec0a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:50.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.707+0000 7fa2ead9d700 1 --2- 172.21.15.146:0/1750980091 >> v2:172.21.15.146:3300/0 conn(0x7fa2ec0a08e0 0x7fa2ec0a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.707+0000 7fa2ead9d700 1 -- 172.21.15.146:0/1750980091 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ec09b9b0 con 0x7fa2ec0a1230 2023-10-03T10:12:50.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.707+0000 7fa2ead9d700 1 --2- 172.21.15.146:0/1750980091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2ec0a1230 0x7fa2ec13ed10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009e80 tx=0x7fa2e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e247bf0e1f851e4a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.707+0000 7fa2e959a700 1 -- 172.21.15.146:0/1750980091 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e400e070 con 0x7fa2ec0a1230 2023-10-03T10:12:50.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.707+0000 7fa2e959a700 1 -- 172.21.15.146:0/1750980091 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e400b980 con 0x7fa2ec0a1230 2023-10-03T10:12:50.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.707+0000 7fa2e959a700 1 -- 172.21.15.146:0/1750980091 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e400bd30 con 0x7fa2ec0a1230 2023-10-03T10:12:50.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.708+0000 7fa2f09f4700 1 -- 172.21.15.146:0/1750980091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2ec0a1230 msgr2=0x7fa2ec13ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.708+0000 7fa2f09f4700 1 --2- 172.21.15.146:0/1750980091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2ec0a1230 0x7fa2ec13ed10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009e80 tx=0x7fa2e400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:50.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.708+0000 7fa2f09f4700 1 -- 172.21.15.146:0/1750980091 shutdown_connections 2023-10-03T10:12:50.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.708+0000 7fa2f09f4700 1 --2- 172.21.15.146:0/1750980091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2ec0a1230 0x7fa2ec13ed10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.708+0000 7fa2f09f4700 1 --2- 172.21.15.146:0/1750980091 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2ec138040 0x7fa2ec138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.708+0000 7fa2f09f4700 1 --2- 172.21.15.146:0/1750980091 >> v2:172.21.15.146:3300/0 conn(0x7fa2ec0a08e0 0x7fa2ec0a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.708+0000 7fa2f09f4700 1 -- 172.21.15.146:0/1750980091 >> 172.21.15.146:0/1750980091 conn(0x7fa2ec0a2980 msgr2=0x7fa2ec0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.708+0000 7fa2f09f4700 1 -- 172.21.15.146:0/1750980091 shutdown_connections 2023-10-03T10:12:50.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.708+0000 7fa2f09f4700 1 -- 172.21.15.146:0/1750980091 wait complete. 2023-10-03T10:12:50.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.709+0000 7f3aa67fc700 1 -- 172.21.15.146:0/777117346 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3aa001a6c0 con 0x7f3ab009e170 2023-10-03T10:12:50.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.709+0000 7fa2f09f4700 1 Processor -- start 2023-10-03T10:12:50.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.713+0000 7fa2f09f4700 1 -- start start 2023-10-03T10:12:50.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.713+0000 7fa2f09f4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2ec0a08e0 0x7fa2ec1d5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.713+0000 7fa2f09f4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2ec0a1230 0x7fa2ec1d5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.713+0000 7fa2f09f4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2ec138040 0x7fa2ec118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.713+0000 7fa2f09f4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec11b220 con 0x7fa2ec0a08e0 2023-10-03T10:12:50.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.713+0000 7fa2f09f4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec11b400 con 0x7fa2ec0a1230 2023-10-03T10:12:50.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.713+0000 7fa2f09f4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec1d4f70 con 0x7fa2ec138040 2023-10-03T10:12:50.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.713+0000 7fa2ea59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2ec0a08e0 0x7fa2ec1d5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.713+0000 7fa2ea59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2ec0a08e0 0x7fa2ec1d5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51266/0 (socket says 172.21.15.146:51266) 2023-10-03T10:12:50.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.713+0000 7fa2ea59c700 1 -- 172.21.15.146:0/608836683 learned_addr learned my addr 172.21.15.146:0/608836683 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:50.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.713+0000 7fa2e9d9b700 1 --2- 172.21.15.146:0/608836683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2ec0a1230 0x7fa2ec1d5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.714+0000 7fa2ead9d700 1 --2- 172.21.15.146:0/608836683 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2ec138040 0x7fa2ec118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.714+0000 7fa2e9d9b700 1 -- 172.21.15.146:0/608836683 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2ec138040 msgr2=0x7fa2ec118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.714+0000 7fa2e9d9b700 1 --2- 172.21.15.146:0/608836683 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2ec138040 0x7fa2ec118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.714+0000 7fa2e9d9b700 1 -- 172.21.15.146:0/608836683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2ec0a08e0 msgr2=0x7fa2ec1d5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.714+0000 7fa2e9d9b700 1 --2- 172.21.15.146:0/608836683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2ec0a08e0 0x7fa2ec1d5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.714+0000 7fa2e9d9b700 1 -- 172.21.15.146:0/608836683 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e4009b30 con 0x7fa2ec0a1230 2023-10-03T10:12:50.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.714+0000 7fa2ead9d700 1 --2- 172.21.15.146:0/608836683 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2ec138040 0x7fa2ec118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:50.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.714+0000 7fa2e9d9b700 1 --2- 172.21.15.146:0/608836683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2ec0a1230 0x7fa2ec1d5970 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000d5a0 tx=0x7fa2e000d8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.714+0000 7fa2daffd700 1 -- 172.21.15.146:0/608836683 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0017070 con 0x7fa2ec0a1230 2023-10-03T10:12:50.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.714+0000 7fa2daffd700 1 -- 172.21.15.146:0/608836683 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e0004020 con 0x7fa2ec0a1230 2023-10-03T10:12:50.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.714+0000 7fa2daffd700 1 -- 172.21.15.146:0/608836683 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e00041b0 con 0x7fa2ec0a1230 2023-10-03T10:12:50.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.714+0000 7fa2f09f4700 1 -- 172.21.15.146:0/608836683 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ec1d5eb0 con 0x7fa2ec0a1230 2023-10-03T10:12:50.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.714+0000 7fa2f09f4700 1 -- 172.21.15.146:0/608836683 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ec11a690 con 0x7fa2ec0a1230 2023-10-03T10:12:50.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.716+0000 7fa2f09f4700 1 -- 172.21.15.146:0/608836683 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ec04f2a0 con 0x7fa2ec0a1230 2023-10-03T10:12:50.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.716+0000 7fa2daffd700 1 -- 172.21.15.146:0/608836683 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa2e0004310 con 0x7fa2ec0a1230 2023-10-03T10:12:50.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.716+0000 7fa2daffd700 1 -- 172.21.15.146:0/608836683 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa2e003fc20 con 0x7fa2ec0a1230 2023-10-03T10:12:50.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.725+0000 7fa2daffd700 1 -- 172.21.15.146:0/608836683 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2e001bba0 con 0x7fa2ec0a1230 2023-10-03T10:12:50.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.824+0000 7ff00207b700 1 -- 172.21.15.146:0/1864434755 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feffc137b50 con 0x7feffc1314b0 2023-10-03T10:12:50.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.824+0000 7fefe3fff700 1 -- 172.21.15.146:0/1864434755 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feff0021020 con 0x7feffc1314b0 2023-10-03T10:12:50.824 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:50.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.826+0000 7ff00207b700 1 -- 172.21.15.146:0/1864434755 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feffc1314b0 msgr2=0x7feffc09a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.826+0000 7ff00207b700 1 --2- 172.21.15.146:0/1864434755 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feffc1314b0 0x7feffc09a240 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feff000ec10 tx=0x7feff000ef20 comp rx=0 tx=0).stop 2023-10-03T10:12:50.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.827+0000 7ff00207b700 1 -- 172.21.15.146:0/1864434755 shutdown_connections 2023-10-03T10:12:50.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.827+0000 7ff00207b700 1 --2- 172.21.15.146:0/1864434755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feffc132100 0x7feffc09a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.827+0000 7ff00207b700 1 --2- 172.21.15.146:0/1864434755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feffc066410 0x7feffc099d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.827+0000 7ff00207b700 1 --2- 172.21.15.146:0/1864434755 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feffc1314b0 0x7feffc09a240 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.827+0000 7ff00207b700 1 -- 172.21.15.146:0/1864434755 >> 172.21.15.146:0/1864434755 conn(0x7feffc0a2980 msgr2=0x7feffc09e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.827+0000 7ff00207b700 1 -- 172.21.15.146:0/1864434755 shutdown_connections 2023-10-03T10:12:50.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.827+0000 7ff00207b700 1 -- 172.21.15.146:0/1864434755 wait complete. 2023-10-03T10:12:50.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:50.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.885+0000 7fa3ba9e3700 1 -- 172.21.15.146:0/3479773346 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa3b411fb80 con 0x7fa3b40a0e20 2023-10-03T10:12:50.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.885+0000 7fa3b0ff9700 1 -- 172.21.15.146:0/3479773346 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa3a801b430 con 0x7fa3b40a0e20 2023-10-03T10:12:50.885 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:50.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.887+0000 7fa3ba9e3700 1 -- 172.21.15.146:0/3479773346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3b40a0e20 msgr2=0x7fa3b411cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.887+0000 7fa3ba9e3700 1 --2- 172.21.15.146:0/3479773346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3b40a0e20 0x7fa3b411cc80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009c40 tx=0x7fa3a8004750 comp rx=0 tx=0).stop 2023-10-03T10:12:50.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.887+0000 7fa3ba9e3700 1 -- 172.21.15.146:0/3479773346 shutdown_connections 2023-10-03T10:12:50.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.887+0000 7fa3ba9e3700 1 --2- 172.21.15.146:0/3479773346 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3b4133b80 0x7fa3b411d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.887+0000 7fa3ba9e3700 1 --2- 172.21.15.146:0/3479773346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3b4099a60 0x7fa3b411c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.887+0000 7fa3ba9e3700 1 --2- 172.21.15.146:0/3479773346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3b40a0e20 0x7fa3b411cc80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.887+0000 7fa3ba9e3700 1 -- 172.21.15.146:0/3479773346 >> 172.21.15.146:0/3479773346 conn(0x7fa3b40a2980 msgr2=0x7fa3b41baf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.887+0000 7fa3ba9e3700 1 -- 172.21.15.146:0/3479773346 shutdown_connections 2023-10-03T10:12:50.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.887+0000 7fa3ba9e3700 1 -- 172.21.15.146:0/3479773346 wait complete. 2023-10-03T10:12:50.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:50.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.947+0000 7f3ab7b16700 1 -- 172.21.15.146:0/777117346 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3ab006c3b0 con 0x7f3ab009e170 2023-10-03T10:12:50.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.947+0000 7f3aa67fc700 1 -- 172.21.15.146:0/777117346 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3aa001b340 con 0x7f3ab009e170 2023-10-03T10:12:50.947 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:50.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.949+0000 7f3ab7b16700 1 -- 172.21.15.146:0/777117346 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ab009e170 msgr2=0x7f3ab011e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.949+0000 7f3ab7b16700 1 --2- 172.21.15.146:0/777117346 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ab009e170 0x7f3ab011e8a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3ab009a100 tx=0x7f3aa000c790 comp rx=0 tx=0).stop 2023-10-03T10:12:50.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.949+0000 7f3ab7b16700 1 -- 172.21.15.146:0/777117346 shutdown_connections 2023-10-03T10:12:50.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.949+0000 7f3ab7b16700 1 --2- 172.21.15.146:0/777117346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ab0130eb0 0x7f3ab011ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.949+0000 7f3ab7b16700 1 --2- 172.21.15.146:0/777117346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ab009d860 0x7f3ab011e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.949+0000 7f3ab7b16700 1 --2- 172.21.15.146:0/777117346 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ab009e170 0x7f3ab011e8a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.949+0000 7f3ab7b16700 1 -- 172.21.15.146:0/777117346 >> 172.21.15.146:0/777117346 conn(0x7f3ab0099c40 msgr2=0x7f3ab00a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.949+0000 7f3ab7b16700 1 -- 172.21.15.146:0/777117346 shutdown_connections 2023-10-03T10:12:50.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.949+0000 7f3ab7b16700 1 -- 172.21.15.146:0/777117346 wait complete. 2023-10-03T10:12:50.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:50.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.964+0000 7fa2f09f4700 1 -- 172.21.15.146:0/608836683 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa2ec13e1c0 con 0x7fa2ec0a1230 2023-10-03T10:12:50.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.965+0000 7fa2daffd700 1 -- 172.21.15.146:0/608836683 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa2e001b370 con 0x7fa2ec0a1230 2023-10-03T10:12:50.964 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:50.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.967+0000 7fa2f09f4700 1 -- 172.21.15.146:0/608836683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2ec0a1230 msgr2=0x7fa2ec1d5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.967+0000 7fa2f09f4700 1 --2- 172.21.15.146:0/608836683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2ec0a1230 0x7fa2ec1d5970 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000d5a0 tx=0x7fa2e000d8b0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.967+0000 7fa2f09f4700 1 -- 172.21.15.146:0/608836683 shutdown_connections 2023-10-03T10:12:50.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.967+0000 7fa2f09f4700 1 --2- 172.21.15.146:0/608836683 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2ec138040 0x7fa2ec118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.967+0000 7fa2f09f4700 1 --2- 172.21.15.146:0/608836683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2ec0a08e0 0x7fa2ec1d5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.967+0000 7fa2f09f4700 1 --2- 172.21.15.146:0/608836683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2ec0a1230 0x7fa2ec1d5970 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.967+0000 7fa2f09f4700 1 -- 172.21.15.146:0/608836683 >> 172.21.15.146:0/608836683 conn(0x7fa2ec0a2980 msgr2=0x7fa2ec070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.967+0000 7fa2f09f4700 1 -- 172.21.15.146:0/608836683 shutdown_connections 2023-10-03T10:12:50.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:50.967+0000 7fa2f09f4700 1 -- 172.21.15.146:0/608836683 wait complete. 2023-10-03T10:12:50.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:51.841 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:51.901 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:51.961 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:51.979 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:51.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.984+0000 7f9bcbbae700 1 Processor -- start 2023-10-03T10:12:51.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.984+0000 7f9bcbbae700 1 -- start start 2023-10-03T10:12:51.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.985+0000 7f9bcbbae700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9bc4133a70 0x7f9bc4133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.985+0000 7f9bcbbae700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bc40a08e0 0x7f9bc40a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.985+0000 7f9bcbbae700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bc40a1290 0x7f9bc413a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.985+0000 7f9bcbbae700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc4133640 con 0x7f9bc4133a70 2023-10-03T10:12:51.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.985+0000 7f9bcbbae700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc40a1d50 con 0x7f9bc40a1290 2023-10-03T10:12:51.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.985+0000 7f9bcbbae700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc40a1710 con 0x7f9bc40a08e0 2023-10-03T10:12:51.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.985+0000 7f9bca14b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bc40a1290 0x7f9bc413a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.985+0000 7f9bca14b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bc40a1290 0x7f9bc413a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52746/0 (socket says 172.21.15.146:52746) 2023-10-03T10:12:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.985+0000 7f9bc9149700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bc40a08e0 0x7f9bc40a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.985+0000 7f9bca14b700 1 -- 172.21.15.146:0/2827367651 learned_addr learned my addr 172.21.15.146:0/2827367651 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.985+0000 7f9bc994a700 1 --2- 172.21.15.146:0/2827367651 >> v2:172.21.15.146:3300/0 conn(0x7f9bc4133a70 0x7f9bc4133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.985+0000 7f9bca14b700 1 -- 172.21.15.146:0/2827367651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bc40a08e0 msgr2=0x7f9bc40a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.985+0000 7f9bca14b700 1 --2- 172.21.15.146:0/2827367651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bc40a08e0 0x7f9bc40a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.985+0000 7f9bca14b700 1 -- 172.21.15.146:0/2827367651 >> v2:172.21.15.146:3300/0 conn(0x7f9bc4133a70 msgr2=0x7f9bc4133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.985+0000 7f9bca14b700 1 --2- 172.21.15.146:0/2827367651 >> v2:172.21.15.146:3300/0 conn(0x7f9bc4133a70 0x7f9bc4133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.985+0000 7f9bca14b700 1 -- 172.21.15.146:0/2827367651 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc409b620 con 0x7f9bc40a1290 2023-10-03T10:12:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.986+0000 7f9bc994a700 1 --2- 172.21.15.146:0/2827367651 >> v2:172.21.15.146:3300/0 conn(0x7f9bc4133a70 0x7f9bc4133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.986+0000 7f9bca14b700 1 --2- 172.21.15.146:0/2827367651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bc40a1290 0x7f9bc413a970 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0098f0 tx=0x7f9bbc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c724b8795b180ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.986+0000 7f9bc8948700 1 -- 172.21.15.146:0/2827367651 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc011830 con 0x7f9bc40a1290 2023-10-03T10:12:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.986+0000 7f9bc8948700 1 -- 172.21.15.146:0/2827367651 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc011990 con 0x7f9bc40a1290 2023-10-03T10:12:51.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.986+0000 7f9bc8948700 1 -- 172.21.15.146:0/2827367651 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc011d20 con 0x7f9bc40a1290 2023-10-03T10:12:51.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.987+0000 7f9bcbbae700 1 -- 172.21.15.146:0/2827367651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bc40a1290 msgr2=0x7f9bc413a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.987+0000 7f9bcbbae700 1 --2- 172.21.15.146:0/2827367651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bc40a1290 0x7f9bc413a970 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0098f0 tx=0x7f9bbc009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:51.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.987+0000 7f9bcbbae700 1 -- 172.21.15.146:0/2827367651 shutdown_connections 2023-10-03T10:12:51.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.987+0000 7f9bcbbae700 1 --2- 172.21.15.146:0/2827367651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bc40a1290 0x7f9bc413a970 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.987+0000 7f9bcbbae700 1 --2- 172.21.15.146:0/2827367651 >> v2:172.21.15.146:3300/0 conn(0x7f9bc4133a70 0x7f9bc4133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.987+0000 7f9bcbbae700 1 --2- 172.21.15.146:0/2827367651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bc40a08e0 0x7f9bc40a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.987+0000 7f9bcbbae700 1 -- 172.21.15.146:0/2827367651 >> 172.21.15.146:0/2827367651 conn(0x7f9bc40a2980 msgr2=0x7f9bc40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:51.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.988+0000 7f9bcbbae700 1 -- 172.21.15.146:0/2827367651 shutdown_connections 2023-10-03T10:12:51.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.988+0000 7f9bcbbae700 1 -- 172.21.15.146:0/2827367651 wait complete. 2023-10-03T10:12:51.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.989+0000 7f9bcbbae700 1 Processor -- start 2023-10-03T10:12:51.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.989+0000 7f9bcbbae700 1 -- start start 2023-10-03T10:12:51.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.990+0000 7f9bcbbae700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bc40a08e0 0x7f9bc411e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.990+0000 7f9bcbbae700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bc40a1290 0x7f9bc411ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.990+0000 7f9bcbbae700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bc4133a70 0x7f9bc411f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.990+0000 7f9bcbbae700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc41213f0 con 0x7f9bc40a1290 2023-10-03T10:12:51.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.990+0000 7f9bcbbae700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc4122430 con 0x7f9bc40a08e0 2023-10-03T10:12:51.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.990+0000 7f9bcbbae700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc4121f20 con 0x7f9bc4133a70 2023-10-03T10:12:51.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.990+0000 7f9bc994a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bc40a08e0 0x7f9bc411e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.990+0000 7f9bc994a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bc40a08e0 0x7f9bc411e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52752/0 (socket says 172.21.15.146:52752) 2023-10-03T10:12:51.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.990+0000 7f9bc994a700 1 -- 172.21.15.146:0/3930765653 learned_addr learned my addr 172.21.15.146:0/3930765653 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:51.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.990+0000 7f9bc9149700 1 --2- 172.21.15.146:0/3930765653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bc40a1290 0x7f9bc411ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.990+0000 7f9bca14b700 1 --2- 172.21.15.146:0/3930765653 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bc4133a70 0x7f9bc411f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.990+0000 7f9bca14b700 1 -- 172.21.15.146:0/3930765653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bc40a08e0 msgr2=0x7f9bc411e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.990+0000 7f9bca14b700 1 --2- 172.21.15.146:0/3930765653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bc40a08e0 0x7f9bc411e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.990+0000 7f9bca14b700 1 -- 172.21.15.146:0/3930765653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bc40a1290 msgr2=0x7f9bc411ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.990+0000 7f9bca14b700 1 --2- 172.21.15.146:0/3930765653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bc40a1290 0x7f9bc411ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.990+0000 7f9bca14b700 1 -- 172.21.15.146:0/3930765653 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb4009a70 con 0x7f9bc4133a70 2023-10-03T10:12:51.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.990+0000 7f9bca14b700 1 --2- 172.21.15.146:0/3930765653 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bc4133a70 0x7f9bc411f390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc016000 tx=0x7f9bbc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:51.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.991+0000 7f9bc27fc700 1 -- 172.21.15.146:0/3930765653 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc004240 con 0x7f9bc4133a70 2023-10-03T10:12:51.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.991+0000 7f9bc27fc700 1 -- 172.21.15.146:0/3930765653 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc01f070 con 0x7f9bc4133a70 2023-10-03T10:12:51.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.991+0000 7f9bcbbae700 1 -- 172.21.15.146:0/3930765653 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bbc009550 con 0x7f9bc4133a70 2023-10-03T10:12:51.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.991+0000 7f9bcbbae700 1 -- 172.21.15.146:0/3930765653 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc4130f70 con 0x7f9bc4133a70 2023-10-03T10:12:51.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.991+0000 7f9bc27fc700 1 -- 172.21.15.146:0/3930765653 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc0036a0 con 0x7f9bc4133a70 2023-10-03T10:12:51.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.992+0000 7f9bc27fc700 1 -- 172.21.15.146:0/3930765653 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9bbc021030 con 0x7f9bc4133a70 2023-10-03T10:12:51.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.992+0000 7f9bc27fc700 1 -- 172.21.15.146:0/3930765653 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9bbc040680 con 0x7f9bc4133a70 2023-10-03T10:12:51.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.992+0000 7f9bcbbae700 1 -- 172.21.15.146:0/3930765653 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba40052e0 con 0x7f9bc4133a70 2023-10-03T10:12:51.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:51.998+0000 7f9bc27fc700 1 -- 172.21.15.146:0/3930765653 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9bbc0239c0 con 0x7f9bc4133a70 2023-10-03T10:12:52.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.049+0000 7f87e67db700 1 Processor -- start 2023-10-03T10:12:52.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.049+0000 7f87e67db700 1 -- start start 2023-10-03T10:12:52.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.050+0000 7f87e67db700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87e009e870 0x7f87e009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.050+0000 7f87e67db700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f87e0131f40 0x7f87e0139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.050+0000 7f87e67db700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e009c970 con 0x7f87e009f180 2023-10-03T10:12:52.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.050+0000 7f87e67db700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e00a0920 con 0x7f87e0131f40 2023-10-03T10:12:52.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.050+0000 7f87e67db700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87e009f9c0 con 0x7f87e009e870 2023-10-03T10:12:52.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.050+0000 7f87dffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87e009e870 0x7f87e009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.050+0000 7f87dffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87e009e870 0x7f87e009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40820/0 (socket says 172.21.15.146:40820) 2023-10-03T10:12:52.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.050+0000 7f87df7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f87e009f180 0x7f87e0131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53362/0 (socket says 172.21.15.146:53362) 2023-10-03T10:12:52.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.050+0000 7f87dffff700 1 -- 172.21.15.146:0/1582941219 learned_addr learned my addr 172.21.15.146:0/1582941219 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:52.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.050+0000 7f87e4d78700 1 --2- 172.21.15.146:0/1582941219 >> v2:172.21.15.146:3300/0 conn(0x7f87e0131f40 0x7f87e0139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.051+0000 7f87e4d78700 1 -- 172.21.15.146:0/1582941219 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87e009e870 msgr2=0x7f87e009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:52.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.051+0000 7f87e4d78700 1 --2- 172.21.15.146:0/1582941219 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87e009e870 0x7f87e009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.051+0000 7f87e4d78700 1 -- 172.21.15.146:0/1582941219 >> v1:172.21.15.146:6789/0 conn(0x7f87e009f180 legacy=0x7f87e0131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.051+0000 7f87e4d78700 1 -- 172.21.15.146:0/1582941219 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e009bab0 con 0x7f87e0131f40 2023-10-03T10:12:52.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.051+0000 7f87dffff700 1 --2- 172.21.15.146:0/1582941219 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87e009e870 0x7f87e009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:52.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.051+0000 7f87deffd700 1 -- 172.21.15.146:0/1582941219 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1590582768 0 0) 0x7f87e009c970 con 0x7f87e009f180 2023-10-03T10:12:52.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.051+0000 7f87e4d78700 1 --2- 172.21.15.146:0/1582941219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87e0131f40 0x7f87e0139ca0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009d90 tx=0x7f87d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6efc50abb238ce29 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:52.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.051+0000 7f87deffd700 1 -- 172.21.15.146:0/1582941219 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d800e070 con 0x7f87e0131f40 2023-10-03T10:12:52.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.051+0000 7f87deffd700 1 -- 172.21.15.146:0/1582941219 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d800bb20 con 0x7f87e0131f40 2023-10-03T10:12:52.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.051+0000 7f87deffd700 1 -- 172.21.15.146:0/1582941219 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8012430 con 0x7f87e0131f40 2023-10-03T10:12:52.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.052+0000 7f87e67db700 1 -- 172.21.15.146:0/1582941219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87e0131f40 msgr2=0x7f87e0139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.052+0000 7f87e67db700 1 --2- 172.21.15.146:0/1582941219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87e0131f40 0x7f87e0139ca0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009d90 tx=0x7f87d800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:52.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.052+0000 7f87e67db700 1 -- 172.21.15.146:0/1582941219 shutdown_connections 2023-10-03T10:12:52.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.052+0000 7f87e67db700 1 --2- 172.21.15.146:0/1582941219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87e0131f40 0x7f87e0139ca0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.052+0000 7f87e67db700 1 --2- 172.21.15.146:0/1582941219 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87e009e870 0x7f87e009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.052+0000 7f87e67db700 1 -- 172.21.15.146:0/1582941219 >> 172.21.15.146:0/1582941219 conn(0x7f87e00a4430 msgr2=0x7f87e00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.052+0000 7f87e67db700 1 -- 172.21.15.146:0/1582941219 shutdown_connections 2023-10-03T10:12:52.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.052+0000 7f87e67db700 1 -- 172.21.15.146:0/1582941219 wait complete. 2023-10-03T10:12:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.053+0000 7f87e67db700 1 Processor -- start 2023-10-03T10:12:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.053+0000 7f87e67db700 1 -- start start 2023-10-03T10:12:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.054+0000 7f87e67db700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87e009e870 0x7f87e01c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.054+0000 7f87e67db700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87e009f180 0x7f87e01c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.054+0000 7f87e67db700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87e0131f40 0x7f87e01c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.054+0000 7f87e67db700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e0121090 con 0x7f87e0131f40 2023-10-03T10:12:52.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.054+0000 7f87e67db700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e0131830 con 0x7f87e009e870 2023-10-03T10:12:52.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.054+0000 7f87e67db700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87e01218b0 con 0x7f87e009f180 2023-10-03T10:12:52.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.054+0000 7f87df7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87e009f180 0x7f87e01c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.054+0000 7f87e4d78700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87e0131f40 0x7f87e01c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.054+0000 7f87df7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87e009f180 0x7f87e01c8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40826/0 (socket says 172.21.15.146:40826) 2023-10-03T10:12:52.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.054+0000 7f87df7fe700 1 -- 172.21.15.146:0/798953988 learned_addr learned my addr 172.21.15.146:0/798953988 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.055+0000 7f87e4d78700 1 -- 172.21.15.146:0/798953988 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87e009f180 msgr2=0x7f87e01c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.055+0000 7f87e4d78700 1 --2- 172.21.15.146:0/798953988 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87e009f180 0x7f87e01c8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.055+0000 7f87e4d78700 1 -- 172.21.15.146:0/798953988 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87e009e870 msgr2=0x7f87e01c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.055+0000 7f87e4d78700 1 --2- 172.21.15.146:0/798953988 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87e009e870 0x7f87e01c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.055+0000 7f87e4d78700 1 -- 172.21.15.146:0/798953988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d0009550 con 0x7f87e0131f40 2023-10-03T10:12:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.055+0000 7f87df7fe700 1 --2- 172.21.15.146:0/798953988 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87e009f180 0x7f87e01c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:52.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.055+0000 7f87e4d78700 1 --2- 172.21.15.146:0/798953988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87e0131f40 0x7f87e01c8cb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f87d8016000 tx=0x7f87d8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:52.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.055+0000 7f87dcff9700 1 -- 172.21.15.146:0/798953988 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8012430 con 0x7f87e0131f40 2023-10-03T10:12:52.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.055+0000 7f87dcff9700 1 -- 172.21.15.146:0/798953988 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d8020070 con 0x7f87e0131f40 2023-10-03T10:12:52.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.055+0000 7f87e67db700 1 -- 172.21.15.146:0/798953988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d8009a70 con 0x7f87e0131f40 2023-10-03T10:12:52.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.055+0000 7f87dcff9700 1 -- 172.21.15.146:0/798953988 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8004280 con 0x7f87e0131f40 2023-10-03T10:12:52.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.055+0000 7f87e67db700 1 -- 172.21.15.146:0/798953988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e0122ed0 con 0x7f87e0131f40 2023-10-03T10:12:52.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.056+0000 7f87dcff9700 1 -- 172.21.15.146:0/798953988 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f87d80043e0 con 0x7f87e0131f40 2023-10-03T10:12:52.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.057+0000 7f87dcff9700 1 -- 172.21.15.146:0/798953988 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f87d8022070 con 0x7f87e0131f40 2023-10-03T10:12:52.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.057+0000 7f87e67db700 1 -- 172.21.15.146:0/798953988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e004f2a0 con 0x7f87e0131f40 2023-10-03T10:12:52.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.066+0000 7f87dcff9700 1 -- 172.21.15.146:0/798953988 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f87d801b400 con 0x7f87e0131f40 2023-10-03T10:12:52.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.094+0000 7fd4083f0700 1 Processor -- start 2023-10-03T10:12:52.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.094+0000 7fd4083f0700 1 -- start start 2023-10-03T10:12:52.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.095+0000 7fd4083f0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd400138040 0x7fd400138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.095+0000 7fd4083f0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4000a08e0 0x7fd4000a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.095+0000 7fd4083f0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd4000a1230 0x7fd40013ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.095+0000 7fd4083f0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4000a2100 con 0x7fd4000a1230 2023-10-03T10:12:52.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.095+0000 7fd4083f0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd400138950 con 0x7fd400138040 2023-10-03T10:12:52.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.095+0000 7fd4083f0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4001379e0 con 0x7fd4000a08e0 2023-10-03T10:12:52.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.095+0000 7fd40618c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd400138040 0x7fd400138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.095+0000 7fd40598b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4000a08e0 0x7fd4000a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.095+0000 7fd40618c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd400138040 0x7fd400138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52764/0 (socket says 172.21.15.146:52764) 2023-10-03T10:12:52.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.095+0000 7fd40618c700 1 -- 172.21.15.146:0/869984867 learned_addr learned my addr 172.21.15.146:0/869984867 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:52.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.095+0000 7fd40598b700 1 --2- 172.21.15.146:0/869984867 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4000a08e0 0x7fd4000a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40832/0 (socket says 172.21.15.146:40832) 2023-10-03T10:12:52.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.095+0000 7fd40698d700 1 --2- 172.21.15.146:0/869984867 >> v2:172.21.15.146:3300/0 conn(0x7fd4000a1230 0x7fd40013ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.095+0000 7fd40598b700 1 -- 172.21.15.146:0/869984867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd400138040 msgr2=0x7fd400138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:52.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.095+0000 7fd40598b700 1 --2- 172.21.15.146:0/869984867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd400138040 0x7fd400138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.095+0000 7fd40598b700 1 -- 172.21.15.146:0/869984867 >> v2:172.21.15.146:3300/0 conn(0x7fd4000a1230 msgr2=0x7fd40013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:52.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.095+0000 7fd40598b700 1 --2- 172.21.15.146:0/869984867 >> v2:172.21.15.146:3300/0 conn(0x7fd4000a1230 0x7fd40013ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.095+0000 7fd40598b700 1 -- 172.21.15.146:0/869984867 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40009b9b0 con 0x7fd4000a08e0 2023-10-03T10:12:52.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.095+0000 7fd40698d700 1 --2- 172.21.15.146:0/869984867 >> v2:172.21.15.146:3300/0 conn(0x7fd4000a1230 0x7fd40013ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:52.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.095+0000 7fd40598b700 1 --2- 172.21.15.146:0/869984867 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4000a08e0 0x7fd4000a0cf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00098a0 tx=0x7fd3f0009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0943a5ea4baa141 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:52.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.096+0000 7fd40518a700 1 -- 172.21.15.146:0/869984867 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0011830 con 0x7fd4000a08e0 2023-10-03T10:12:52.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.096+0000 7fd40518a700 1 -- 172.21.15.146:0/869984867 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f0011990 con 0x7fd4000a08e0 2023-10-03T10:12:52.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.096+0000 7fd40518a700 1 -- 172.21.15.146:0/869984867 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0011d20 con 0x7fd4000a08e0 2023-10-03T10:12:52.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.096+0000 7fd4083f0700 1 -- 172.21.15.146:0/869984867 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4000a08e0 msgr2=0x7fd4000a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.096+0000 7fd4083f0700 1 --2- 172.21.15.146:0/869984867 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4000a08e0 0x7fd4000a0cf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00098a0 tx=0x7fd3f0009bb0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.096+0000 7fd4083f0700 1 -- 172.21.15.146:0/869984867 shutdown_connections 2023-10-03T10:12:52.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.096+0000 7fd4083f0700 1 --2- 172.21.15.146:0/869984867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd400138040 0x7fd400138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.096+0000 7fd4083f0700 1 --2- 172.21.15.146:0/869984867 >> v2:172.21.15.146:3300/0 conn(0x7fd4000a1230 0x7fd40013ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.096+0000 7fd4083f0700 1 --2- 172.21.15.146:0/869984867 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4000a08e0 0x7fd4000a0cf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.096+0000 7fd4083f0700 1 -- 172.21.15.146:0/869984867 >> 172.21.15.146:0/869984867 conn(0x7fd4000a2980 msgr2=0x7fd4000a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.096+0000 7fd4083f0700 1 -- 172.21.15.146:0/869984867 shutdown_connections 2023-10-03T10:12:52.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.096+0000 7fd4083f0700 1 -- 172.21.15.146:0/869984867 wait complete. 2023-10-03T10:12:52.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.097+0000 7fd4083f0700 1 Processor -- start 2023-10-03T10:12:52.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.097+0000 7fd4083f0700 1 -- start start 2023-10-03T10:12:52.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.098+0000 7fd4083f0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4000a08e0 0x7fd4001263b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.098+0000 7fd4083f0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4000a1230 0x7fd4001268f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.098+0000 7fd4083f0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd400138040 0x7fd400126e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.098+0000 7fd4083f0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd400129ba0 con 0x7fd4000a1230 2023-10-03T10:12:52.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.098+0000 7fd4083f0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd400128080 con 0x7fd400138040 2023-10-03T10:12:52.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.098+0000 7fd4083f0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd40009a240 con 0x7fd4000a08e0 2023-10-03T10:12:52.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.098+0000 7fd40618c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4000a08e0 0x7fd4001263b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.098+0000 7fd40618c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4000a08e0 0x7fd4001263b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40840/0 (socket says 172.21.15.146:40840) 2023-10-03T10:12:52.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.098+0000 7fd40618c700 1 -- 172.21.15.146:0/4177290946 learned_addr learned my addr 172.21.15.146:0/4177290946 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:52.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.098+0000 7fd40698d700 1 --2- 172.21.15.146:0/4177290946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd400138040 0x7fd400126e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.098+0000 7fd40598b700 1 --2- 172.21.15.146:0/4177290946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4000a1230 0x7fd4001268f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.098+0000 7fd40618c700 1 -- 172.21.15.146:0/4177290946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd400138040 msgr2=0x7fd400126e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.098+0000 7fd40618c700 1 --2- 172.21.15.146:0/4177290946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd400138040 0x7fd400126e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.098+0000 7fd40618c700 1 -- 172.21.15.146:0/4177290946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4000a1230 msgr2=0x7fd4001268f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.098+0000 7fd40618c700 1 --2- 172.21.15.146:0/4177290946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4000a1230 0x7fd4001268f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.098+0000 7fd40618c700 1 -- 172.21.15.146:0/4177290946 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f8009a70 con 0x7fd4000a08e0 2023-10-03T10:12:52.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.098+0000 7fd40598b700 1 --2- 172.21.15.146:0/4177290946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4000a1230 0x7fd4001268f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:52.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.098+0000 7fd40698d700 1 --2- 172.21.15.146:0/4177290946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd400138040 0x7fd400126e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:52.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.098+0000 7fd40618c700 1 --2- 172.21.15.146:0/4177290946 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4000a08e0 0x7fd4001263b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00e8f0 tx=0x7fd3fc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:52.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.099+0000 7fd3f6ffd700 1 -- 172.21.15.146:0/4177290946 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc00c850 con 0x7fd4000a08e0 2023-10-03T10:12:52.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.099+0000 7fd3f6ffd700 1 -- 172.21.15.146:0/4177290946 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc00c9b0 con 0x7fd4000a08e0 2023-10-03T10:12:52.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.099+0000 7fd4083f0700 1 -- 172.21.15.146:0/4177290946 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f00094a0 con 0x7fd4000a08e0 2023-10-03T10:12:52.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.099+0000 7fd3f6ffd700 1 -- 172.21.15.146:0/4177290946 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc00cd60 con 0x7fd4000a08e0 2023-10-03T10:12:52.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.099+0000 7fd4083f0700 1 -- 172.21.15.146:0/4177290946 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd400136e80 con 0x7fd4000a08e0 2023-10-03T10:12:52.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.100+0000 7fd4083f0700 1 -- 172.21.15.146:0/4177290946 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40004f2a0 con 0x7fd4000a08e0 2023-10-03T10:12:52.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.100+0000 7fd3f6ffd700 1 -- 172.21.15.146:0/4177290946 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd3fc013470 con 0x7fd4000a08e0 2023-10-03T10:12:52.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.100+0000 7fd3f6ffd700 1 -- 172.21.15.146:0/4177290946 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd3fc03fb80 con 0x7fd4000a08e0 2023-10-03T10:12:52.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.104+0000 7fd3f6ffd700 1 -- 172.21.15.146:0/4177290946 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3fc01b3b0 con 0x7fd4000a08e0 2023-10-03T10:12:52.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.148+0000 7f36afcd4700 1 Processor -- start 2023-10-03T10:12:52.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.148+0000 7f36afcd4700 1 -- start start 2023-10-03T10:12:52.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.148+0000 7f36afcd4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f36a809e950 0x7f36a809ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.148+0000 7f36afcd4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a809f260 0x7f36a8137ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.148+0000 7f36afcd4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36a81381e0 0x7f36a813a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.148+0000 7f36afcd4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a80a06c0 con 0x7f36a809e950 2023-10-03T10:12:52.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.148+0000 7f36afcd4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a809ae90 con 0x7f36a809f260 2023-10-03T10:12:52.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.148+0000 7f36afcd4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36a809ac20 con 0x7f36a81381e0 2023-10-03T10:12:52.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.148+0000 7f36ad26f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a809f260 0x7f36a8137ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.148+0000 7f36ada70700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f36a809e950 0x7f36a809ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.148+0000 7f36ad26f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a809f260 0x7f36a8137ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52788/0 (socket says 172.21.15.146:52788) 2023-10-03T10:12:52.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.148+0000 7f36ad26f700 1 -- 172.21.15.146:0/2830326480 learned_addr learned my addr 172.21.15.146:0/2830326480 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:52.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.149+0000 7f36ae271700 1 --2- 172.21.15.146:0/2830326480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36a81381e0 0x7f36a813a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.149+0000 7f36ad26f700 1 -- 172.21.15.146:0/2830326480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36a81381e0 msgr2=0x7f36a813a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:52.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.149+0000 7f36ad26f700 1 --2- 172.21.15.146:0/2830326480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36a81381e0 0x7f36a813a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.149+0000 7f36ad26f700 1 -- 172.21.15.146:0/2830326480 >> v2:172.21.15.146:3300/0 conn(0x7f36a809e950 msgr2=0x7f36a809ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:52.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.149+0000 7f36ad26f700 1 --2- 172.21.15.146:0/2830326480 >> v2:172.21.15.146:3300/0 conn(0x7f36a809e950 0x7f36a809ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.149+0000 7f36ad26f700 1 -- 172.21.15.146:0/2830326480 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a806ba00 con 0x7f36a809f260 2023-10-03T10:12:52.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.149+0000 7f36ada70700 1 --2- 172.21.15.146:0/2830326480 >> v2:172.21.15.146:3300/0 conn(0x7f36a809e950 0x7f36a809ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:52.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.149+0000 7f36ad26f700 1 --2- 172.21.15.146:0/2830326480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a809f260 0x7f36a8137ca0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f36980098f0 tx=0x7f3698009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58fbbe150b0b12f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:52.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.149+0000 7f36aca6e700 1 -- 172.21.15.146:0/2830326480 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3698011830 con 0x7f36a809f260 2023-10-03T10:12:52.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.149+0000 7f36aca6e700 1 -- 172.21.15.146:0/2830326480 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3698011990 con 0x7f36a809f260 2023-10-03T10:12:52.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.149+0000 7f36aca6e700 1 -- 172.21.15.146:0/2830326480 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3698011d20 con 0x7f36a809f260 2023-10-03T10:12:52.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.150+0000 7f36afcd4700 1 -- 172.21.15.146:0/2830326480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a809f260 msgr2=0x7f36a8137ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.150+0000 7f36afcd4700 1 --2- 172.21.15.146:0/2830326480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a809f260 0x7f36a8137ca0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f36980098f0 tx=0x7f3698009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:52.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.150+0000 7f36afcd4700 1 -- 172.21.15.146:0/2830326480 shutdown_connections 2023-10-03T10:12:52.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.150+0000 7f36afcd4700 1 --2- 172.21.15.146:0/2830326480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36a81381e0 0x7f36a813a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.150+0000 7f36afcd4700 1 --2- 172.21.15.146:0/2830326480 >> v2:172.21.15.146:3300/0 conn(0x7f36a809e950 0x7f36a809ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.150+0000 7f36afcd4700 1 --2- 172.21.15.146:0/2830326480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a809f260 0x7f36a8137ca0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.150+0000 7f36afcd4700 1 -- 172.21.15.146:0/2830326480 >> 172.21.15.146:0/2830326480 conn(0x7f36a80a0f70 msgr2=0x7f36a80a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.150+0000 7f36afcd4700 1 -- 172.21.15.146:0/2830326480 shutdown_connections 2023-10-03T10:12:52.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.150+0000 7f36afcd4700 1 -- 172.21.15.146:0/2830326480 wait complete. 2023-10-03T10:12:52.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.151+0000 7f36afcd4700 1 Processor -- start 2023-10-03T10:12:52.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.151+0000 7f36afcd4700 1 -- start start 2023-10-03T10:12:52.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.152+0000 7f36afcd4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36a809e950 0x7f36a8122a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.152+0000 7f36afcd4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a809f260 0x7f36a8122f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.152+0000 7f36afcd4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a81381e0 0x7f36a81234b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:52.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.152+0000 7f36afcd4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a8124640 con 0x7f36a809f260 2023-10-03T10:12:52.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.152+0000 7f36afcd4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a81379c0 con 0x7f36a81381e0 2023-10-03T10:12:52.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.152+0000 7f36afcd4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36a8126550 con 0x7f36a809e950 2023-10-03T10:12:52.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.152+0000 7f36ad26f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a809f260 0x7f36a8122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.152+0000 7f36ada70700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36a809e950 0x7f36a8122a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.152+0000 7f36ad26f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a809f260 0x7f36a8122f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51326/0 (socket says 172.21.15.146:51326) 2023-10-03T10:12:52.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.152+0000 7f36ad26f700 1 -- 172.21.15.146:0/3228643827 learned_addr learned my addr 172.21.15.146:0/3228643827 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:52.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.152+0000 7f36ae271700 1 --2- 172.21.15.146:0/3228643827 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a81381e0 0x7f36a81234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:52.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.153+0000 7f36ad26f700 1 -- 172.21.15.146:0/3228643827 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36a809e950 msgr2=0x7f36a8122a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.153+0000 7f36ad26f700 1 --2- 172.21.15.146:0/3228643827 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36a809e950 0x7f36a8122a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.153+0000 7f36ad26f700 1 -- 172.21.15.146:0/3228643827 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a81381e0 msgr2=0x7f36a81234b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.153+0000 7f36ad26f700 1 --2- 172.21.15.146:0/3228643827 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a81381e0 0x7f36a81234b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.153+0000 7f36ad26f700 1 -- 172.21.15.146:0/3228643827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a4009430 con 0x7f36a809f260 2023-10-03T10:12:52.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.153+0000 7f36ad26f700 1 --2- 172.21.15.146:0/3228643827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a809f260 0x7f36a8122f70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3698011db0 tx=0x7f3698004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:52.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.153+0000 7f369e7fc700 1 -- 172.21.15.146:0/3228643827 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3698004240 con 0x7f36a809f260 2023-10-03T10:12:52.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.153+0000 7f369e7fc700 1 -- 172.21.15.146:0/3228643827 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369801f070 con 0x7f36a809f260 2023-10-03T10:12:52.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.153+0000 7f36afcd4700 1 -- 172.21.15.146:0/3228643827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3698009550 con 0x7f36a809f260 2023-10-03T10:12:52.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.153+0000 7f369e7fc700 1 -- 172.21.15.146:0/3228643827 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36980045a0 con 0x7f36a809f260 2023-10-03T10:12:52.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.153+0000 7f36afcd4700 1 -- 172.21.15.146:0/3228643827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a809e2b0 con 0x7f36a809f260 2023-10-03T10:12:52.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.154+0000 7f36afcd4700 1 -- 172.21.15.146:0/3228643827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a804f2a0 con 0x7f36a809f260 2023-10-03T10:12:52.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.154+0000 7f369e7fc700 1 -- 172.21.15.146:0/3228643827 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3698021030 con 0x7f36a809f260 2023-10-03T10:12:52.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.155+0000 7f369e7fc700 1 -- 172.21.15.146:0/3228643827 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3698040840 con 0x7f36a809f260 2023-10-03T10:12:52.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.163+0000 7f369e7fc700 1 -- 172.21.15.146:0/3228643827 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f36980036a0 con 0x7f36a809f260 2023-10-03T10:12:52.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.201+0000 7f9bcbbae700 1 -- 172.21.15.146:0/3930765653 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9ba4005590 con 0x7f9bc4133a70 2023-10-03T10:12:52.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.202+0000 7f9bc27fc700 1 -- 172.21.15.146:0/3930765653 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9bbc015030 con 0x7f9bc4133a70 2023-10-03T10:12:52.201 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:52.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.204+0000 7f9bcbbae700 1 -- 172.21.15.146:0/3930765653 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bc4133a70 msgr2=0x7f9bc411f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.204+0000 7f9bcbbae700 1 --2- 172.21.15.146:0/3930765653 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bc4133a70 0x7f9bc411f390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc016000 tx=0x7f9bbc004750 comp rx=0 tx=0).stop 2023-10-03T10:12:52.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.204+0000 7f9bcbbae700 1 -- 172.21.15.146:0/3930765653 shutdown_connections 2023-10-03T10:12:52.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.204+0000 7f9bcbbae700 1 --2- 172.21.15.146:0/3930765653 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bc4133a70 0x7f9bc411f390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.204+0000 7f9bcbbae700 1 --2- 172.21.15.146:0/3930765653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bc40a08e0 0x7f9bc411e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.204+0000 7f9bcbbae700 1 --2- 172.21.15.146:0/3930765653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bc40a1290 0x7f9bc411ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.204+0000 7f9bcbbae700 1 -- 172.21.15.146:0/3930765653 >> 172.21.15.146:0/3930765653 conn(0x7f9bc40a2980 msgr2=0x7f9bc4131540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.204+0000 7f9bcbbae700 1 -- 172.21.15.146:0/3930765653 shutdown_connections 2023-10-03T10:12:52.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.204+0000 7f9bcbbae700 1 -- 172.21.15.146:0/3930765653 wait complete. 2023-10-03T10:12:52.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:52.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.292+0000 7f87e67db700 1 -- 172.21.15.146:0/798953988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f87e006b2a0 con 0x7f87e0131f40 2023-10-03T10:12:52.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.292+0000 7f87dcff9700 1 -- 172.21.15.146:0/798953988 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f87d8026850 con 0x7f87e0131f40 2023-10-03T10:12:52.292 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:52.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.294+0000 7f87e67db700 1 -- 172.21.15.146:0/798953988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87e0131f40 msgr2=0x7f87e01c8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.294+0000 7f87e67db700 1 --2- 172.21.15.146:0/798953988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87e0131f40 0x7f87e01c8cb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f87d8016000 tx=0x7f87d8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.294+0000 7f87e67db700 1 -- 172.21.15.146:0/798953988 shutdown_connections 2023-10-03T10:12:52.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.294+0000 7f87e67db700 1 --2- 172.21.15.146:0/798953988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87e0131f40 0x7f87e01c8cb0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.294+0000 7f87e67db700 1 --2- 172.21.15.146:0/798953988 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87e009e870 0x7f87e01c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.294+0000 7f87e67db700 1 --2- 172.21.15.146:0/798953988 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87e009f180 0x7f87e01c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.294+0000 7f87e67db700 1 -- 172.21.15.146:0/798953988 >> 172.21.15.146:0/798953988 conn(0x7f87e00a4430 msgr2=0x7f87e009c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.295+0000 7f87e67db700 1 -- 172.21.15.146:0/798953988 shutdown_connections 2023-10-03T10:12:52.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.295+0000 7f87e67db700 1 -- 172.21.15.146:0/798953988 wait complete. 2023-10-03T10:12:52.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.307+0000 7fd4083f0700 1 -- 172.21.15.146:0/4177290946 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd40012a670 con 0x7fd4000a08e0 2023-10-03T10:12:52.307 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:52.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.307+0000 7fd3f6ffd700 1 -- 172.21.15.146:0/4177290946 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd3fc017030 con 0x7fd4000a08e0 2023-10-03T10:12:52.307 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:52.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.309+0000 7fd4083f0700 1 -- 172.21.15.146:0/4177290946 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4000a08e0 msgr2=0x7fd4001263b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.309+0000 7fd4083f0700 1 --2- 172.21.15.146:0/4177290946 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4000a08e0 0x7fd4001263b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00e8f0 tx=0x7fd3fc00ecb0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.309+0000 7fd4083f0700 1 -- 172.21.15.146:0/4177290946 shutdown_connections 2023-10-03T10:12:52.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.309+0000 7fd4083f0700 1 --2- 172.21.15.146:0/4177290946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd400138040 0x7fd400126e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.309+0000 7fd4083f0700 1 --2- 172.21.15.146:0/4177290946 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4000a08e0 0x7fd4001263b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.309+0000 7fd4083f0700 1 --2- 172.21.15.146:0/4177290946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4000a1230 0x7fd4001268f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.309+0000 7fd4083f0700 1 -- 172.21.15.146:0/4177290946 >> 172.21.15.146:0/4177290946 conn(0x7fd4000a2980 msgr2=0x7fd40009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.309+0000 7fd4083f0700 1 -- 172.21.15.146:0/4177290946 shutdown_connections 2023-10-03T10:12:52.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.309+0000 7fd4083f0700 1 -- 172.21.15.146:0/4177290946 wait complete. 2023-10-03T10:12:52.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:52.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.358+0000 7f36afcd4700 1 -- 172.21.15.146:0/3228643827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f36a8126330 con 0x7f36a809f260 2023-10-03T10:12:52.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.358+0000 7f369e7fc700 1 -- 172.21.15.146:0/3228643827 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3698015020 con 0x7f36a809f260 2023-10-03T10:12:52.358 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:52.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.360+0000 7f36afcd4700 1 -- 172.21.15.146:0/3228643827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a809f260 msgr2=0x7f36a8122f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.360+0000 7f36afcd4700 1 --2- 172.21.15.146:0/3228643827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a809f260 0x7f36a8122f70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3698011db0 tx=0x7f3698004750 comp rx=0 tx=0).stop 2023-10-03T10:12:52.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.360+0000 7f36afcd4700 1 -- 172.21.15.146:0/3228643827 shutdown_connections 2023-10-03T10:12:52.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.360+0000 7f36afcd4700 1 --2- 172.21.15.146:0/3228643827 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a81381e0 0x7f36a81234b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.360+0000 7f36afcd4700 1 --2- 172.21.15.146:0/3228643827 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36a809e950 0x7f36a8122a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.360+0000 7f36afcd4700 1 --2- 172.21.15.146:0/3228643827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a809f260 0x7f36a8122f70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.360+0000 7f36afcd4700 1 -- 172.21.15.146:0/3228643827 >> 172.21.15.146:0/3228643827 conn(0x7f36a80a0f70 msgr2=0x7f36a8071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.360+0000 7f36afcd4700 1 -- 172.21.15.146:0/3228643827 shutdown_connections 2023-10-03T10:12:52.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:52.360+0000 7f36afcd4700 1 -- 172.21.15.146:0/3228643827 wait complete. 2023-10-03T10:12:52.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:53.219 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:53.308 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:53.321 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:53.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.349+0000 7fd12507c700 1 Processor -- start 2023-10-03T10:12:53.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.349+0000 7fd12507c700 1 -- start start 2023-10-03T10:12:53.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.349+0000 7fd12507c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd12009f350 0x7fd120136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.349+0000 7fd12507c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1201371c0 0x7fd1201395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.349+0000 7fd12507c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd12009c970 con 0x7fd12009e870 2023-10-03T10:12:53.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.349+0000 7fd12507c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1200a0920 con 0x7fd12009f350 2023-10-03T10:12:53.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.349+0000 7fd12507c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12009f9c0 con 0x7fd1201371c0 2023-10-03T10:12:53.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.349+0000 7fd11f59e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1201371c0 0x7fd1201395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.349+0000 7fd11e59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd12009f350 0x7fd120136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.350+0000 7fd11ed9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd12009e870 0x7fd12009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53376/0 (socket says 172.21.15.146:53376) 2023-10-03T10:12:53.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.350+0000 7fd11ed9d700 1 -- 172.21.15.146:0/65088106 learned_addr learned my addr 172.21.15.146:0/65088106 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:53.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.350+0000 7fd11dd9b700 1 -- 172.21.15.146:0/65088106 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2356751868 0 0) 0x7fd12009c970 con 0x7fd12009e870 2023-10-03T10:12:53.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.350+0000 7fd11e59c700 1 -- 172.21.15.146:0/65088106 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1201371c0 msgr2=0x7fd1201395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:53.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.350+0000 7fd11e59c700 1 --2- 172.21.15.146:0/65088106 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1201371c0 0x7fd1201395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.350+0000 7fd11e59c700 1 -- 172.21.15.146:0/65088106 >> v1:172.21.15.146:6789/0 conn(0x7fd12009e870 legacy=0x7fd12009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.350+0000 7fd11e59c700 1 -- 172.21.15.146:0/65088106 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12009bab0 con 0x7fd12009f350 2023-10-03T10:12:53.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.350+0000 7fd11f59e700 1 --2- 172.21.15.146:0/65088106 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1201371c0 0x7fd1201395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:53.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.350+0000 7fd11e59c700 1 --2- 172.21.15.146:0/65088106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd12009f350 0x7fd120136c80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd114009840 tx=0x7fd114009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f86b054c969095 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.350+0000 7fd11dd9b700 1 -- 172.21.15.146:0/65088106 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd114011830 con 0x7fd12009f350 2023-10-03T10:12:53.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.350+0000 7fd11dd9b700 1 -- 172.21.15.146:0/65088106 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd114011990 con 0x7fd12009f350 2023-10-03T10:12:53.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.350+0000 7fd11dd9b700 1 -- 172.21.15.146:0/65088106 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd114011d20 con 0x7fd12009f350 2023-10-03T10:12:53.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.351+0000 7fd12507c700 1 -- 172.21.15.146:0/65088106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd12009f350 msgr2=0x7fd120136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.351+0000 7fd12507c700 1 --2- 172.21.15.146:0/65088106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd12009f350 0x7fd120136c80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd114009840 tx=0x7fd114009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:53.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.351+0000 7fd12507c700 1 -- 172.21.15.146:0/65088106 shutdown_connections 2023-10-03T10:12:53.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.351+0000 7fd12507c700 1 --2- 172.21.15.146:0/65088106 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1201371c0 0x7fd1201395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.351+0000 7fd12507c700 1 --2- 172.21.15.146:0/65088106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd12009f350 0x7fd120136c80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.351+0000 7fd12507c700 1 -- 172.21.15.146:0/65088106 >> 172.21.15.146:0/65088106 conn(0x7fd1200a4430 msgr2=0x7fd1200a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.351+0000 7fd12507c700 1 -- 172.21.15.146:0/65088106 shutdown_connections 2023-10-03T10:12:53.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.351+0000 7fd12507c700 1 -- 172.21.15.146:0/65088106 wait complete. 2023-10-03T10:12:53.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.352+0000 7fd12507c700 1 Processor -- start 2023-10-03T10:12:53.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.352+0000 7fd12507c700 1 -- start start 2023-10-03T10:12:53.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.353+0000 7fd12507c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd12009e870 0x7fd1201207e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.353+0000 7fd12507c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd12009f350 0x7fd120120d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.353+0000 7fd12507c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1201371c0 0x7fd120121260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.353+0000 7fd12507c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1201225e0 con 0x7fd12009f350 2023-10-03T10:12:53.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.353+0000 7fd12507c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1201223f0 con 0x7fd12009e870 2023-10-03T10:12:53.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.353+0000 7fd12507c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd12009dba0 con 0x7fd1201371c0 2023-10-03T10:12:53.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.353+0000 7fd11ed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd12009e870 0x7fd1201207e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.353+0000 7fd11e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd12009f350 0x7fd120120d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.353+0000 7fd11e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd12009f350 0x7fd120120d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51336/0 (socket says 172.21.15.146:51336) 2023-10-03T10:12:53.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.353+0000 7fd11ed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd12009e870 0x7fd1201207e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52830/0 (socket says 172.21.15.146:52830) 2023-10-03T10:12:53.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.353+0000 7fd11e59c700 1 -- 172.21.15.146:0/2631541534 learned_addr learned my addr 172.21.15.146:0/2631541534 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:53.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.353+0000 7fd11f59e700 1 --2- 172.21.15.146:0/2631541534 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1201371c0 0x7fd120121260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.353+0000 7fd11e59c700 1 -- 172.21.15.146:0/2631541534 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1201371c0 msgr2=0x7fd120121260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.353+0000 7fd11e59c700 1 --2- 172.21.15.146:0/2631541534 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1201371c0 0x7fd120121260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.353+0000 7fd11e59c700 1 -- 172.21.15.146:0/2631541534 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd12009e870 msgr2=0x7fd1201207e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.353+0000 7fd11e59c700 1 --2- 172.21.15.146:0/2631541534 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd12009e870 0x7fd1201207e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.353+0000 7fd11e59c700 1 -- 172.21.15.146:0/2631541534 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd118009a70 con 0x7fd12009f350 2023-10-03T10:12:53.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.353+0000 7fd11ed9d700 1 --2- 172.21.15.146:0/2631541534 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd12009e870 0x7fd1201207e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:53.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.354+0000 7fd11e59c700 1 --2- 172.21.15.146:0/2631541534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd12009f350 0x7fd120120d20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd114009fd0 tx=0x7fd114004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.354+0000 7fd1077fe700 1 -- 172.21.15.146:0/2631541534 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1140045d0 con 0x7fd12009f350 2023-10-03T10:12:53.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.354+0000 7fd1077fe700 1 -- 172.21.15.146:0/2631541534 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11401f070 con 0x7fd12009f350 2023-10-03T10:12:53.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.354+0000 7fd12507c700 1 -- 172.21.15.146:0/2631541534 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1140094a0 con 0x7fd12009f350 2023-10-03T10:12:53.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.354+0000 7fd1077fe700 1 -- 172.21.15.146:0/2631541534 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1140038e0 con 0x7fd12009f350 2023-10-03T10:12:53.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.354+0000 7fd12507c700 1 -- 172.21.15.146:0/2631541534 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd120124020 con 0x7fd12009f350 2023-10-03T10:12:53.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.355+0000 7fd12507c700 1 -- 172.21.15.146:0/2631541534 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd120122c40 con 0x7fd12009f350 2023-10-03T10:12:53.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.355+0000 7fd1077fe700 1 -- 172.21.15.146:0/2631541534 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd114003a40 con 0x7fd12009f350 2023-10-03T10:12:53.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.356+0000 7fd1077fe700 1 -- 172.21.15.146:0/2631541534 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd114021070 con 0x7fd12009f350 2023-10-03T10:12:53.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.364+0000 7fd1077fe700 1 -- 172.21.15.146:0/2631541534 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd114010380 con 0x7fd12009f350 2023-10-03T10:12:53.373 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:53.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.441+0000 7fe04a7f3700 1 Processor -- start 2023-10-03T10:12:53.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.441+0000 7fe04a7f3700 1 -- start start 2023-10-03T10:12:53.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.441+0000 7fe04a7f3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0440a0a30 0x7fe0440a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.441+0000 7fe04a7f3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0440a1340 0x7fe04412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.441+0000 7fe04a7f3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0440a1e70 con 0x7fe0441304a0 2023-10-03T10:12:53.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.441+0000 7fe04a7f3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04409a720 con 0x7fe0440a1340 2023-10-03T10:12:53.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.441+0000 7fe04a7f3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe04409b300 con 0x7fe0440a0a30 2023-10-03T10:12:53.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.441+0000 7fe0437fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0440a1340 0x7fe04412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.441+0000 7fe043fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0440a0a30 0x7fe0440a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.441+0000 7fe048d90700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe0441304a0 0x7fe0441371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53380/0 (socket says 172.21.15.146:53380) 2023-10-03T10:12:53.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.441+0000 7fe0437fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0440a1340 0x7fe04412ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52832/0 (socket says 172.21.15.146:52832) 2023-10-03T10:12:53.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.441+0000 7fe048d90700 1 -- 172.21.15.146:0/2047068536 learned_addr learned my addr 172.21.15.146:0/2047068536 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:53.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.442+0000 7fe043fff700 1 -- 172.21.15.146:0/2047068536 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0440a1340 msgr2=0x7fe04412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:53.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.442+0000 7fe043fff700 1 --2- 172.21.15.146:0/2047068536 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0440a1340 0x7fe04412ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.442+0000 7fe043fff700 1 -- 172.21.15.146:0/2047068536 >> v1:172.21.15.146:6789/0 conn(0x7fe0441304a0 legacy=0x7fe0441371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.442+0000 7fe043fff700 1 -- 172.21.15.146:0/2047068536 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04409abc0 con 0x7fe0440a0a30 2023-10-03T10:12:53.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.442+0000 7fe0437fe700 1 --2- 172.21.15.146:0/2047068536 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0440a1340 0x7fe04412ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:53.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.442+0000 7fe043fff700 1 --2- 172.21.15.146:0/2047068536 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0440a0a30 0x7fe0440a0e00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe03400dc70 tx=0x7fe03400df80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a3e446593016b10 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.442+0000 7fe042ffd700 1 -- 172.21.15.146:0/2047068536 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe034012070 con 0x7fe0440a0a30 2023-10-03T10:12:53.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.442+0000 7fe042ffd700 1 -- 172.21.15.146:0/2047068536 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe034005a20 con 0x7fe0440a0a30 2023-10-03T10:12:53.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.442+0000 7fe042ffd700 1 -- 172.21.15.146:0/2047068536 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe034005db0 con 0x7fe0440a0a30 2023-10-03T10:12:53.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.443+0000 7fe04a7f3700 1 -- 172.21.15.146:0/2047068536 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0440a0a30 msgr2=0x7fe0440a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.443+0000 7fe04a7f3700 1 --2- 172.21.15.146:0/2047068536 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0440a0a30 0x7fe0440a0e00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe03400dc70 tx=0x7fe03400df80 comp rx=0 tx=0).stop 2023-10-03T10:12:53.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.443+0000 7fe04a7f3700 1 -- 172.21.15.146:0/2047068536 shutdown_connections 2023-10-03T10:12:53.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.443+0000 7fe04a7f3700 1 --2- 172.21.15.146:0/2047068536 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0440a0a30 0x7fe0440a0e00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.443+0000 7fe04a7f3700 1 --2- 172.21.15.146:0/2047068536 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0440a1340 0x7fe04412ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.443+0000 7fe04a7f3700 1 -- 172.21.15.146:0/2047068536 >> 172.21.15.146:0/2047068536 conn(0x7fe0440a2980 msgr2=0x7fe0440a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.443+0000 7fe04a7f3700 1 -- 172.21.15.146:0/2047068536 shutdown_connections 2023-10-03T10:12:53.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.443+0000 7fe04a7f3700 1 -- 172.21.15.146:0/2047068536 wait complete. 2023-10-03T10:12:53.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.444+0000 7fe04a7f3700 1 Processor -- start 2023-10-03T10:12:53.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.444+0000 7fe04a7f3700 1 -- start start 2023-10-03T10:12:53.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.445+0000 7fe04a7f3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0440a0a30 0x7fe04411e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.445+0000 7fe04a7f3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0440a1340 0x7fe04411ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.445+0000 7fe04a7f3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0441304a0 0x7fe04411f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.445+0000 7fe04a7f3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0441213f0 con 0x7fe0440a0a30 2023-10-03T10:12:53.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.445+0000 7fe04a7f3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04412fcb0 con 0x7fe0441304a0 2023-10-03T10:12:53.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.445+0000 7fe04a7f3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe04409ae00 con 0x7fe0440a1340 2023-10-03T10:12:53.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.445+0000 7fe043fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0440a0a30 0x7fe04411e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.445+0000 7fe043fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0440a0a30 0x7fe04411e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51344/0 (socket says 172.21.15.146:51344) 2023-10-03T10:12:53.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.445+0000 7fe043fff700 1 -- 172.21.15.146:0/881236502 learned_addr learned my addr 172.21.15.146:0/881236502 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:53.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.445+0000 7fe0437fe700 1 --2- 172.21.15.146:0/881236502 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0440a1340 0x7fe04411ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.445+0000 7fe048d90700 1 --2- 172.21.15.146:0/881236502 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0441304a0 0x7fe04411f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.445+0000 7fe0437fe700 1 -- 172.21.15.146:0/881236502 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0441304a0 msgr2=0x7fe04411f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.445+0000 7fe0437fe700 1 --2- 172.21.15.146:0/881236502 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0441304a0 0x7fe04411f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.445+0000 7fe0437fe700 1 -- 172.21.15.146:0/881236502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0440a0a30 msgr2=0x7fe04411e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.445+0000 7fe0437fe700 1 --2- 172.21.15.146:0/881236502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0440a0a30 0x7fe04411e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.445+0000 7fe0437fe700 1 -- 172.21.15.146:0/881236502 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0380094a0 con 0x7fe0440a1340 2023-10-03T10:12:53.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.446+0000 7fe0437fe700 1 --2- 172.21.15.146:0/881236502 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0440a1340 0x7fe04411ee60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe03800e9b0 tx=0x7fe03800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.446+0000 7fe040ff9700 1 -- 172.21.15.146:0/881236502 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03800c850 con 0x7fe0440a1340 2023-10-03T10:12:53.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.446+0000 7fe040ff9700 1 -- 172.21.15.146:0/881236502 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03800c9b0 con 0x7fe0440a1340 2023-10-03T10:12:53.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.446+0000 7fe04a7f3700 1 -- 172.21.15.146:0/881236502 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03400d8d0 con 0x7fe0440a1340 2023-10-03T10:12:53.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.446+0000 7fe040ff9700 1 -- 172.21.15.146:0/881236502 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03800cd40 con 0x7fe0440a1340 2023-10-03T10:12:53.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.446+0000 7fe04a7f3700 1 -- 172.21.15.146:0/881236502 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe044122170 con 0x7fe0440a1340 2023-10-03T10:12:53.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.447+0000 7fe04a7f3700 1 -- 172.21.15.146:0/881236502 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe044121f20 con 0x7fe0440a1340 2023-10-03T10:12:53.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.447+0000 7fe040ff9700 1 -- 172.21.15.146:0/881236502 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe038013470 con 0x7fe0440a1340 2023-10-03T10:12:53.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.448+0000 7fe040ff9700 1 -- 172.21.15.146:0/881236502 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe03803fdd0 con 0x7fe0440a1340 2023-10-03T10:12:53.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.456+0000 7fe040ff9700 1 -- 172.21.15.146:0/881236502 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe03800cea0 con 0x7fe0440a1340 2023-10-03T10:12:53.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.478+0000 7fb5f7dcb700 1 Processor -- start 2023-10-03T10:12:53.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.479+0000 7fb5f7dcb700 1 -- start start 2023-10-03T10:12:53.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.479+0000 7fb5f7dcb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb5f006a770 0x7fb5f006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.479+0000 7fb5f7dcb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5f006b080 0x7fb5f01317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.479+0000 7fb5f7dcb700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f009da80 con 0x7fb5f0131cf0 2023-10-03T10:12:53.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.479+0000 7fb5f7dcb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f009dce0 con 0x7fb5f006b080 2023-10-03T10:12:53.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.479+0000 7fb5f7dcb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f009eb20 con 0x7fb5f006a770 2023-10-03T10:12:53.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.479+0000 7fb5f5366700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5f006b080 0x7fb5f01317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.479+0000 7fb5f5b67700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb5f006a770 0x7fb5f006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.479+0000 7fb5f5366700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5f006b080 0x7fb5f01317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52842/0 (socket says 172.21.15.146:52842) 2023-10-03T10:12:53.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.479+0000 7fb5f5b67700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb5f006a770 0x7fb5f006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40890/0 (socket says 172.21.15.146:40890) 2023-10-03T10:12:53.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.479+0000 7fb5f5366700 1 -- 172.21.15.146:0/3290252379 learned_addr learned my addr 172.21.15.146:0/3290252379 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:53.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.480+0000 7fb5f4b65700 1 -- 172.21.15.146:0/3290252379 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2403649317 0 0) 0x7fb5f009da80 con 0x7fb5f0131cf0 2023-10-03T10:12:53.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.480+0000 7fb5f4b65700 1 -- 172.21.15.146:0/3290252379 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5dc0035b0 con 0x7fb5f0131cf0 2023-10-03T10:12:53.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.480+0000 7fb5f5b67700 1 -- 172.21.15.146:0/3290252379 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5f006b080 msgr2=0x7fb5f01317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:53.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.480+0000 7fb5f5b67700 1 --2- 172.21.15.146:0/3290252379 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5f006b080 0x7fb5f01317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.480+0000 7fb5f5b67700 1 -- 172.21.15.146:0/3290252379 >> v1:172.21.15.146:6789/0 conn(0x7fb5f0131cf0 legacy=0x7fb5f0138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.480+0000 7fb5f5b67700 1 -- 172.21.15.146:0/3290252379 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f009d860 con 0x7fb5f006a770 2023-10-03T10:12:53.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.480+0000 7fb5f5366700 1 --2- 172.21.15.146:0/3290252379 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5f006b080 0x7fb5f01317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:53.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.480+0000 7fb5f5b67700 1 --2- 172.21.15.146:0/3290252379 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb5f006a770 0x7fb5f006ab40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0098a0 tx=0x7fb5ec009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a60242bb24e09f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.480+0000 7fb5f4b65700 1 -- 172.21.15.146:0/3290252379 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec011830 con 0x7fb5f006a770 2023-10-03T10:12:53.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.480+0000 7fb5f4b65700 1 -- 172.21.15.146:0/3290252379 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ec011990 con 0x7fb5f006a770 2023-10-03T10:12:53.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.480+0000 7fb5f4b65700 1 -- 172.21.15.146:0/3290252379 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec011d20 con 0x7fb5f006a770 2023-10-03T10:12:53.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.481+0000 7fb5f7dcb700 1 -- 172.21.15.146:0/3290252379 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb5f006a770 msgr2=0x7fb5f006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.481+0000 7fb5f7dcb700 1 --2- 172.21.15.146:0/3290252379 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb5f006a770 0x7fb5f006ab40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0098a0 tx=0x7fb5ec009bb0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.481+0000 7fb5f7dcb700 1 -- 172.21.15.146:0/3290252379 shutdown_connections 2023-10-03T10:12:53.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.481+0000 7fb5f7dcb700 1 --2- 172.21.15.146:0/3290252379 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb5f006a770 0x7fb5f006ab40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.481+0000 7fb5f7dcb700 1 --2- 172.21.15.146:0/3290252379 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5f006b080 0x7fb5f01317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.481+0000 7fb5f7dcb700 1 -- 172.21.15.146:0/3290252379 >> 172.21.15.146:0/3290252379 conn(0x7fb5f0099c40 msgr2=0x7fb5f00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.481+0000 7fb5f7dcb700 1 -- 172.21.15.146:0/3290252379 shutdown_connections 2023-10-03T10:12:53.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.481+0000 7fb5f7dcb700 1 -- 172.21.15.146:0/3290252379 wait complete. 2023-10-03T10:12:53.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.482+0000 7fb5f7dcb700 1 Processor -- start 2023-10-03T10:12:53.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.482+0000 7fb5f7dcb700 1 -- start start 2023-10-03T10:12:53.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.483+0000 7fb5f7dcb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb5f006a770 0x7fb5f01c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.483+0000 7fb5f7dcb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5f006b080 0x7fb5f01c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.483+0000 7fb5f7dcb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5f0131cf0 0x7fb5f01c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.483+0000 7fb5f7dcb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f011e6e0 con 0x7fb5f0131cf0 2023-10-03T10:12:53.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.483+0000 7fb5f7dcb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f011e4f0 con 0x7fb5f006b080 2023-10-03T10:12:53.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.483+0000 7fb5f7dcb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f00a2db0 con 0x7fb5f006a770 2023-10-03T10:12:53.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.483+0000 7fb5f5366700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5f006b080 0x7fb5f01c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.483+0000 7fb5f5b67700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb5f006a770 0x7fb5f01c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.483+0000 7fb5f5366700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5f006b080 0x7fb5f01c62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52854/0 (socket says 172.21.15.146:52854) 2023-10-03T10:12:53.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.483+0000 7fb5f5366700 1 -- 172.21.15.146:0/45043929 learned_addr learned my addr 172.21.15.146:0/45043929 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:53.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.483+0000 7fb5f6368700 1 --2- 172.21.15.146:0/45043929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5f0131cf0 0x7fb5f01c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.484+0000 7fb5f5366700 1 -- 172.21.15.146:0/45043929 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb5f006a770 msgr2=0x7fb5f01c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.484+0000 7fb5f5366700 1 --2- 172.21.15.146:0/45043929 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb5f006a770 0x7fb5f01c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.484+0000 7fb5f5366700 1 -- 172.21.15.146:0/45043929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5f0131cf0 msgr2=0x7fb5f01c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.484+0000 7fb5f5366700 1 --2- 172.21.15.146:0/45043929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5f0131cf0 0x7fb5f01c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.484+0000 7fb5f5366700 1 -- 172.21.15.146:0/45043929 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e0009550 con 0x7fb5f006b080 2023-10-03T10:12:53.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.484+0000 7fb5f5366700 1 --2- 172.21.15.146:0/45043929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5f006b080 0x7fb5f01c62d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000ec10 tx=0x7fb5e000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.484+0000 7fb5e67fc700 1 -- 172.21.15.146:0/45043929 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e000c850 con 0x7fb5f006b080 2023-10-03T10:12:53.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.484+0000 7fb5e67fc700 1 -- 172.21.15.146:0/45043929 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e000c9b0 con 0x7fb5f006b080 2023-10-03T10:12:53.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.484+0000 7fb5e67fc700 1 -- 172.21.15.146:0/45043929 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e000cd60 con 0x7fb5f006b080 2023-10-03T10:12:53.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.484+0000 7fb5f7dcb700 1 -- 172.21.15.146:0/45043929 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ec0094a0 con 0x7fb5f006b080 2023-10-03T10:12:53.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.484+0000 7fb5f7dcb700 1 -- 172.21.15.146:0/45043929 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f0120120 con 0x7fb5f006b080 2023-10-03T10:12:53.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.485+0000 7fb5f7dcb700 1 -- 172.21.15.146:0/45043929 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f011fdc0 con 0x7fb5f006b080 2023-10-03T10:12:53.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.485+0000 7fb5e67fc700 1 -- 172.21.15.146:0/45043929 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb5e0013470 con 0x7fb5f006b080 2023-10-03T10:12:53.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.485+0000 7fb5e67fc700 1 -- 172.21.15.146:0/45043929 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb5e003fc00 con 0x7fb5f006b080 2023-10-03T10:12:53.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.494+0000 7fb5e67fc700 1 -- 172.21.15.146:0/45043929 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5f011fdc0 con 0x7fb5f006b080 2023-10-03T10:12:53.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.509+0000 7f23afaea700 1 Processor -- start 2023-10-03T10:12:53.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.509+0000 7f23afaea700 1 -- start start 2023-10-03T10:12:53.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.510+0000 7f23afaea700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a8131830 0x7f23a8131c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.510+0000 7f23afaea700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a809a5a0 0x7f23a81395c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.510+0000 7f23afaea700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a806f730 con 0x7f23a8099a60 2023-10-03T10:12:53.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.510+0000 7f23afaea700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a806fb00 con 0x7f23a809a5a0 2023-10-03T10:12:53.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.510+0000 7f23afaea700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23a809bd30 con 0x7f23a8131830 2023-10-03T10:12:53.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.510+0000 7f23ae087700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a809a5a0 0x7f23a81395c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.510+0000 7f23ad886700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a8131830 0x7f23a8131c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.510+0000 7f23ae087700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a809a5a0 0x7f23a81395c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52862/0 (socket says 172.21.15.146:52862) 2023-10-03T10:12:53.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.510+0000 7f23ae087700 1 -- 172.21.15.146:0/381373027 learned_addr learned my addr 172.21.15.146:0/381373027 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:53.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.510+0000 7f23ad085700 1 --1- 172.21.15.146:0/381373027 >> v1:172.21.15.146:6789/0 conn(0x7f23a8099a60 0x7f23a8099e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:53404/0 (socket says 172.21.15.146:53404) 2023-10-03T10:12:53.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.510+0000 7f23ac884700 1 -- 172.21.15.146:0/381373027 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922793159 0 0) 0x7f23a806f730 con 0x7f23a8099a60 2023-10-03T10:12:53.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.511+0000 7f23ac884700 1 -- 172.21.15.146:0/381373027 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23940035b0 con 0x7f23a8099a60 2023-10-03T10:12:53.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.511+0000 7f23ae087700 1 -- 172.21.15.146:0/381373027 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a8131830 msgr2=0x7f23a8131c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:53.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.511+0000 7f23ae087700 1 --2- 172.21.15.146:0/381373027 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a8131830 0x7f23a8131c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.511+0000 7f23ae087700 1 -- 172.21.15.146:0/381373027 >> v1:172.21.15.146:6789/0 conn(0x7f23a8099a60 legacy=0x7f23a8099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.511+0000 7f23ae087700 1 -- 172.21.15.146:0/381373027 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a81313e0 con 0x7f23a809a5a0 2023-10-03T10:12:53.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.511+0000 7f23ad886700 1 --2- 172.21.15.146:0/381373027 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a8131830 0x7f23a8131c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:53.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.511+0000 7f23ae087700 1 --2- 172.21.15.146:0/381373027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a809a5a0 0x7f23a81395c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009eb0 tx=0x7f23a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fa057df31533463 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.511+0000 7f23ac884700 1 -- 172.21.15.146:0/381373027 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a000e070 con 0x7f23a809a5a0 2023-10-03T10:12:53.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.511+0000 7f23ac884700 1 -- 172.21.15.146:0/381373027 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a000b8d0 con 0x7f23a809a5a0 2023-10-03T10:12:53.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.511+0000 7f23ac884700 1 -- 172.21.15.146:0/381373027 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a000bc40 con 0x7f23a809a5a0 2023-10-03T10:12:53.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.512+0000 7f23afaea700 1 -- 172.21.15.146:0/381373027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a809a5a0 msgr2=0x7f23a81395c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.512+0000 7f23afaea700 1 --2- 172.21.15.146:0/381373027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a809a5a0 0x7f23a81395c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009eb0 tx=0x7f23a000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:53.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.512+0000 7f23afaea700 1 -- 172.21.15.146:0/381373027 shutdown_connections 2023-10-03T10:12:53.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.512+0000 7f23afaea700 1 --2- 172.21.15.146:0/381373027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a809a5a0 0x7f23a81395c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.512+0000 7f23afaea700 1 --2- 172.21.15.146:0/381373027 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a8131830 0x7f23a8131c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.512+0000 7f23afaea700 1 -- 172.21.15.146:0/381373027 >> 172.21.15.146:0/381373027 conn(0x7f23a80a2810 msgr2=0x7f23a80a2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.512+0000 7f23afaea700 1 -- 172.21.15.146:0/381373027 shutdown_connections 2023-10-03T10:12:53.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.512+0000 7f23afaea700 1 -- 172.21.15.146:0/381373027 wait complete. 2023-10-03T10:12:53.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.513+0000 7f23afaea700 1 Processor -- start 2023-10-03T10:12:53.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.513+0000 7f23afaea700 1 -- start start 2023-10-03T10:12:53.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.514+0000 7f23afaea700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a8099a60 0x7f23a8070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.514+0000 7f23afaea700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a809a5a0 0x7f23a80707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.514+0000 7f23afaea700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a8131830 0x7f23a8070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.514+0000 7f23afaea700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a80716d0 con 0x7f23a8131830 2023-10-03T10:12:53.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.514+0000 7f23afaea700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a812ec20 con 0x7f23a809a5a0 2023-10-03T10:12:53.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.514+0000 7f23afaea700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23a8120dd0 con 0x7f23a8099a60 2023-10-03T10:12:53.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.514+0000 7f23ad886700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a8099a60 0x7f23a8070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.514+0000 7f23ad886700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a8099a60 0x7f23a8070270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40924/0 (socket says 172.21.15.146:40924) 2023-10-03T10:12:53.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.514+0000 7f23ad886700 1 -- 172.21.15.146:0/3026230046 learned_addr learned my addr 172.21.15.146:0/3026230046 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:53.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.514+0000 7f23ae087700 1 --2- 172.21.15.146:0/3026230046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a8131830 0x7f23a8070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.514+0000 7f23ad085700 1 --2- 172.21.15.146:0/3026230046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a809a5a0 0x7f23a80707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.514+0000 7f23ad886700 1 -- 172.21.15.146:0/3026230046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a809a5a0 msgr2=0x7f23a80707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.514+0000 7f23ad886700 1 --2- 172.21.15.146:0/3026230046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a809a5a0 0x7f23a80707b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.514+0000 7f23ad886700 1 -- 172.21.15.146:0/3026230046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a8131830 msgr2=0x7f23a8070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.514+0000 7f23ad886700 1 --2- 172.21.15.146:0/3026230046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a8131830 0x7f23a8070cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.514+0000 7f23ad886700 1 -- 172.21.15.146:0/3026230046 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a40094a0 con 0x7f23a8099a60 2023-10-03T10:12:53.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.514+0000 7f23ae087700 1 --2- 172.21.15.146:0/3026230046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a8131830 0x7f23a8070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:53.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.514+0000 7f23ad886700 1 --2- 172.21.15.146:0/3026230046 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a8099a60 0x7f23a8070270 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f23a400ebe0 tx=0x7f23a400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.515+0000 7f239e7fc700 1 -- 172.21.15.146:0/3026230046 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a400c850 con 0x7f23a8099a60 2023-10-03T10:12:53.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.515+0000 7f239e7fc700 1 -- 172.21.15.146:0/3026230046 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a400c9b0 con 0x7f23a8099a60 2023-10-03T10:12:53.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.515+0000 7f23afaea700 1 -- 172.21.15.146:0/3026230046 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a0009b30 con 0x7f23a8099a60 2023-10-03T10:12:53.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.515+0000 7f23afaea700 1 -- 172.21.15.146:0/3026230046 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a8121370 con 0x7f23a8099a60 2023-10-03T10:12:53.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.515+0000 7f239e7fc700 1 -- 172.21.15.146:0/3026230046 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a400cd40 con 0x7f23a8099a60 2023-10-03T10:12:53.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.516+0000 7f239e7fc700 1 -- 172.21.15.146:0/3026230046 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23a4013470 con 0x7f23a8099a60 2023-10-03T10:12:53.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.516+0000 7f23afaea700 1 -- 172.21.15.146:0/3026230046 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23900052e0 con 0x7f23a8099a60 2023-10-03T10:12:53.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.516+0000 7f239e7fc700 1 -- 172.21.15.146:0/3026230046 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f23a403f8c0 con 0x7f23a8099a60 2023-10-03T10:12:53.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.525+0000 7f239e7fc700 1 -- 172.21.15.146:0/3026230046 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23a4013720 con 0x7f23a8099a60 2023-10-03T10:12:53.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.577+0000 7fd12507c700 1 -- 172.21.15.146:0/2631541534 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd12004f2a0 con 0x7fd12009f350 2023-10-03T10:12:53.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.578+0000 7fd1077fe700 1 -- 172.21.15.146:0/2631541534 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd114015020 con 0x7fd12009f350 2023-10-03T10:12:53.577 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:53.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.581+0000 7fd12507c700 1 -- 172.21.15.146:0/2631541534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd12009f350 msgr2=0x7fd120120d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.581+0000 7fd12507c700 1 --2- 172.21.15.146:0/2631541534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd12009f350 0x7fd120120d20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd114009fd0 tx=0x7fd114004750 comp rx=0 tx=0).stop 2023-10-03T10:12:53.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.581+0000 7fd12507c700 1 -- 172.21.15.146:0/2631541534 shutdown_connections 2023-10-03T10:12:53.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.581+0000 7fd12507c700 1 --2- 172.21.15.146:0/2631541534 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1201371c0 0x7fd120121260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.581+0000 7fd12507c700 1 --2- 172.21.15.146:0/2631541534 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd12009e870 0x7fd1201207e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.581+0000 7fd12507c700 1 --2- 172.21.15.146:0/2631541534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd12009f350 0x7fd120120d20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.581+0000 7fd12507c700 1 -- 172.21.15.146:0/2631541534 >> 172.21.15.146:0/2631541534 conn(0x7fd1200a4430 msgr2=0x7fd1200a2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.581+0000 7fd12507c700 1 -- 172.21.15.146:0/2631541534 shutdown_connections 2023-10-03T10:12:53.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.581+0000 7fd12507c700 1 -- 172.21.15.146:0/2631541534 wait complete. 2023-10-03T10:12:53.597 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:53.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.655+0000 7fe04a7f3700 1 -- 172.21.15.146:0/881236502 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe044122170 con 0x7fe0440a1340 2023-10-03T10:12:53.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.655+0000 7fe040ff9700 1 -- 172.21.15.146:0/881236502 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe044122170 con 0x7fe0440a1340 2023-10-03T10:12:53.655 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:53.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.657+0000 7fe04a7f3700 1 -- 172.21.15.146:0/881236502 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0440a1340 msgr2=0x7fe04411ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.657+0000 7fe04a7f3700 1 --2- 172.21.15.146:0/881236502 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0440a1340 0x7fe04411ee60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe03800e9b0 tx=0x7fe03800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.657+0000 7fe04a7f3700 1 -- 172.21.15.146:0/881236502 shutdown_connections 2023-10-03T10:12:53.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.657+0000 7fe04a7f3700 1 --2- 172.21.15.146:0/881236502 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0441304a0 0x7fe04411f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.657+0000 7fe04a7f3700 1 --2- 172.21.15.146:0/881236502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0440a0a30 0x7fe04411e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.657+0000 7fe04a7f3700 1 --2- 172.21.15.146:0/881236502 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0440a1340 0x7fe04411ee60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.657+0000 7fe04a7f3700 1 -- 172.21.15.146:0/881236502 >> 172.21.15.146:0/881236502 conn(0x7fe0440a2980 msgr2=0x7fe04406ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.658+0000 7fe04a7f3700 1 -- 172.21.15.146:0/881236502 shutdown_connections 2023-10-03T10:12:53.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.658+0000 7fe04a7f3700 1 -- 172.21.15.146:0/881236502 wait complete. 2023-10-03T10:12:53.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:53.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.704+0000 7fb5f7dcb700 1 -- 172.21.15.146:0/45043929 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb5f0120310 con 0x7fb5f006b080 2023-10-03T10:12:53.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.704+0000 7fb5e67fc700 1 -- 172.21.15.146:0/45043929 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb5e0017030 con 0x7fb5f006b080 2023-10-03T10:12:53.704 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:53.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.706+0000 7fb5f7dcb700 1 -- 172.21.15.146:0/45043929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5f006b080 msgr2=0x7fb5f01c62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.706+0000 7fb5f7dcb700 1 --2- 172.21.15.146:0/45043929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5f006b080 0x7fb5f01c62d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000ec10 tx=0x7fb5e000ef20 comp rx=0 tx=0).stop 2023-10-03T10:12:53.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.706+0000 7fb5f7dcb700 1 -- 172.21.15.146:0/45043929 shutdown_connections 2023-10-03T10:12:53.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.706+0000 7fb5f7dcb700 1 --2- 172.21.15.146:0/45043929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5f0131cf0 0x7fb5f01c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.706+0000 7fb5f7dcb700 1 --2- 172.21.15.146:0/45043929 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb5f006a770 0x7fb5f01c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.706+0000 7fb5f7dcb700 1 --2- 172.21.15.146:0/45043929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5f006b080 0x7fb5f01c62d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.706+0000 7fb5f7dcb700 1 -- 172.21.15.146:0/45043929 >> 172.21.15.146:0/45043929 conn(0x7fb5f0099c40 msgr2=0x7fb5f01b9870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.706+0000 7fb5f7dcb700 1 -- 172.21.15.146:0/45043929 shutdown_connections 2023-10-03T10:12:53.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.706+0000 7fb5f7dcb700 1 -- 172.21.15.146:0/45043929 wait complete. 2023-10-03T10:12:53.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:53.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.723+0000 7f23afaea700 1 -- 172.21.15.146:0/3026230046 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2390005590 con 0x7f23a8099a60 2023-10-03T10:12:53.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.723+0000 7f239e7fc700 1 -- 172.21.15.146:0/3026230046 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f23a4017070 con 0x7f23a8099a60 2023-10-03T10:12:53.723 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:53.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.725+0000 7f23afaea700 1 -- 172.21.15.146:0/3026230046 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a8099a60 msgr2=0x7f23a8070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.725+0000 7f23afaea700 1 --2- 172.21.15.146:0/3026230046 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a8099a60 0x7f23a8070270 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f23a400ebe0 tx=0x7f23a400eef0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.725+0000 7f23afaea700 1 -- 172.21.15.146:0/3026230046 shutdown_connections 2023-10-03T10:12:53.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.725+0000 7f23afaea700 1 --2- 172.21.15.146:0/3026230046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a8131830 0x7f23a8070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.725+0000 7f23afaea700 1 --2- 172.21.15.146:0/3026230046 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a8099a60 0x7f23a8070270 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.725+0000 7f23afaea700 1 --2- 172.21.15.146:0/3026230046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a809a5a0 0x7f23a80707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.725+0000 7f23afaea700 1 -- 172.21.15.146:0/3026230046 >> 172.21.15.146:0/3026230046 conn(0x7f23a80a2810 msgr2=0x7f23a81b8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.725+0000 7f23afaea700 1 -- 172.21.15.146:0/3026230046 shutdown_connections 2023-10-03T10:12:53.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:53.725+0000 7f23afaea700 1 -- 172.21.15.146:0/3026230046 wait complete. 2023-10-03T10:12:53.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:54.599 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:54.898 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:54.899 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:54.900 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.047+0000 7f47278c8700 1 Processor -- start 2023-10-03T10:12:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.047+0000 7f0d0edd6700 1 Processor -- start 2023-10-03T10:12:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.047+0000 7f0d0edd6700 1 -- start start 2023-10-03T10:12:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.047+0000 7f47278c8700 1 -- start start 2023-10-03T10:12:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.047+0000 7f47278c8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47200a0a70 0x7f47200a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.047+0000 7f47278c8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f47200a1380 0x7f4720133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.047+0000 7f47278c8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4720133f50 0x7f4720134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.047+0000 7f47278c8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f472009e9d0 con 0x7f47200a1380 2023-10-03T10:12:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.047+0000 7f47278c8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472009dc00 con 0x7f47200a0a70 2023-10-03T10:12:55.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.047+0000 7f47278c8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f472009dec0 con 0x7f4720133f50 2023-10-03T10:12:55.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f4725664700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47200a0a70 0x7f47200a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f4725664700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47200a0a70 0x7f47200a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53088/0 (socket says 172.21.15.146:53088) 2023-10-03T10:12:55.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f4725664700 1 -- 172.21.15.146:0/3881157971 learned_addr learned my addr 172.21.15.146:0/3881157971 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:55.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f4724e63700 1 --2- 172.21.15.146:0/3881157971 >> v2:172.21.15.146:3300/0 conn(0x7f47200a1380 0x7f4720133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f0d0edd6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0809dec0 0x7f0d0806b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f0d0edd6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0d08136cb0 0x7f0d08139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f0d0edd6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0806e900 con 0x7f0d0806a770 2023-10-03T10:12:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f0d0cb72700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0d0806a770 0x7f0d0806ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39888/0 (socket says 172.21.15.146:39888) 2023-10-03T10:12:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f0d0cb72700 1 -- 172.21.15.146:0/2107031774 learned_addr learned my addr 172.21.15.146:0/2107031774 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f0d07fff700 1 --2- 172.21.15.146:0/2107031774 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0809dec0 0x7f0d0806b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f0d0edd6700 1 -- 172.21.15.146:0/2107031774 --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0809d180 con 0x7f0d08136cb0 2023-10-03T10:12:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f0d0edd6700 1 -- 172.21.15.146:0/2107031774 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0809e780 con 0x7f0d0809dec0 2023-10-03T10:12:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f0d0d373700 1 --2- 172.21.15.146:0/2107031774 >> v2:172.21.15.146:3300/0 conn(0x7f0d08136cb0 0x7f0d08139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f0d077fe700 1 -- 172.21.15.146:0/2107031774 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603373135 0 0) 0x7f0d0806e900 con 0x7f0d0806a770 2023-10-03T10:12:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f0d077fe700 1 -- 172.21.15.146:0/2107031774 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cf80035b0 con 0x7f0d0806a770 2023-10-03T10:12:55.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f4725664700 1 -- 172.21.15.146:0/3881157971 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4720133f50 msgr2=0x7f4720134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:55.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f4725664700 1 --2- 172.21.15.146:0/3881157971 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4720133f50 0x7f4720134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f4725664700 1 -- 172.21.15.146:0/3881157971 >> v2:172.21.15.146:3300/0 conn(0x7f47200a1380 msgr2=0x7f4720133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:55.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f4725664700 1 --2- 172.21.15.146:0/3881157971 >> v2:172.21.15.146:3300/0 conn(0x7f47200a1380 0x7f4720133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f4725664700 1 -- 172.21.15.146:0/3881157971 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472009e6a0 con 0x7f47200a0a70 2023-10-03T10:12:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f0d07fff700 1 -- 172.21.15.146:0/2107031774 >> v2:172.21.15.146:3300/0 conn(0x7f0d08136cb0 msgr2=0x7f0d08139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f0d07fff700 1 --2- 172.21.15.146:0/2107031774 >> v2:172.21.15.146:3300/0 conn(0x7f0d08136cb0 0x7f0d08139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f0d07fff700 1 -- 172.21.15.146:0/2107031774 >> v1:172.21.15.146:6789/0 conn(0x7f0d0806a770 legacy=0x7f0d0806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.048+0000 7f0d07fff700 1 -- 172.21.15.146:0/2107031774 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0809d3c0 con 0x7f0d0809dec0 2023-10-03T10:12:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.049+0000 7f4725664700 1 --2- 172.21.15.146:0/3881157971 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47200a0a70 0x7f47200a0e40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f471c0098f0 tx=0x7f471c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76c9c2d49506d104 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.049+0000 7f4717fff700 1 -- 172.21.15.146:0/3881157971 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c00b8a0 con 0x7f47200a0a70 2023-10-03T10:12:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.049+0000 7f0d07fff700 1 --2- 172.21.15.146:0/2107031774 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0809dec0 0x7f0d0806b250 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009840 tx=0x7f0cf4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=149f73958e3d4085 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.049+0000 7f4717fff700 1 -- 172.21.15.146:0/3881157971 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c00ba00 con 0x7f47200a0a70 2023-10-03T10:12:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.049+0000 7f4717fff700 1 -- 172.21.15.146:0/3881157971 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c00bd90 con 0x7f47200a0a70 2023-10-03T10:12:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.049+0000 7f0d077fe700 1 -- 172.21.15.146:0/2107031774 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4011830 con 0x7f0d0809dec0 2023-10-03T10:12:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.049+0000 7f0d077fe700 1 -- 172.21.15.146:0/2107031774 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf4011990 con 0x7f0d0809dec0 2023-10-03T10:12:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.049+0000 7f0d077fe700 1 -- 172.21.15.146:0/2107031774 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4011d20 con 0x7f0d0809dec0 2023-10-03T10:12:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.050+0000 7f47278c8700 1 -- 172.21.15.146:0/3881157971 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47200a0a70 msgr2=0x7f47200a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.050+0000 7f47278c8700 1 --2- 172.21.15.146:0/3881157971 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47200a0a70 0x7f47200a0e40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f471c0098f0 tx=0x7f471c009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.050+0000 7f0d0edd6700 1 -- 172.21.15.146:0/2107031774 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0809dec0 msgr2=0x7f0d0806b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.050+0000 7f0d0edd6700 1 --2- 172.21.15.146:0/2107031774 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0809dec0 0x7f0d0806b250 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009840 tx=0x7f0cf4009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.050+0000 7f47278c8700 1 -- 172.21.15.146:0/3881157971 shutdown_connections 2023-10-03T10:12:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.050+0000 7f47278c8700 1 --2- 172.21.15.146:0/3881157971 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47200a0a70 0x7f47200a0e40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.050+0000 7f47278c8700 1 --2- 172.21.15.146:0/3881157971 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4720133f50 0x7f4720134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.050+0000 7f47278c8700 1 --2- 172.21.15.146:0/3881157971 >> v2:172.21.15.146:3300/0 conn(0x7f47200a1380 0x7f4720133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.050+0000 7f47278c8700 1 -- 172.21.15.146:0/3881157971 >> 172.21.15.146:0/3881157971 conn(0x7f47200a6610 msgr2=0x7f47200a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:55.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.050+0000 7f0d0edd6700 1 -- 172.21.15.146:0/2107031774 shutdown_connections 2023-10-03T10:12:55.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.050+0000 7f0d0edd6700 1 --2- 172.21.15.146:0/2107031774 >> v2:172.21.15.146:3300/0 conn(0x7f0d08136cb0 0x7f0d08139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.050+0000 7f0d0edd6700 1 --2- 172.21.15.146:0/2107031774 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0809dec0 0x7f0d0806b250 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.050+0000 7f0d0edd6700 1 -- 172.21.15.146:0/2107031774 >> 172.21.15.146:0/2107031774 conn(0x7f0d08099c40 msgr2=0x7f0d080a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:55.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.050+0000 7f0d0edd6700 1 -- 172.21.15.146:0/2107031774 shutdown_connections 2023-10-03T10:12:55.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.050+0000 7f47278c8700 1 -- 172.21.15.146:0/3881157971 shutdown_connections 2023-10-03T10:12:55.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.050+0000 7f0d0edd6700 1 -- 172.21.15.146:0/2107031774 wait complete. 2023-10-03T10:12:55.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.050+0000 7f47278c8700 1 -- 172.21.15.146:0/3881157971 wait complete. 2023-10-03T10:12:55.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.051+0000 7f0d0edd6700 1 Processor -- start 2023-10-03T10:12:55.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.051+0000 7f0d0edd6700 1 -- start start 2023-10-03T10:12:55.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.051+0000 7f47278c8700 1 Processor -- start 2023-10-03T10:12:55.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.052+0000 7f0d0edd6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d0806a770 0x7f0d08134c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.052+0000 7f0d0edd6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0809dec0 0x7f0d081351d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.052+0000 7f0d0edd6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d08136cb0 0x7f0d08135710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.052+0000 7f0d0edd6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d08123a70 con 0x7f0d0806a770 2023-10-03T10:12:55.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.052+0000 7f0d0edd6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d08136770 con 0x7f0d08136cb0 2023-10-03T10:12:55.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.052+0000 7f0d0edd6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080a31f0 con 0x7f0d0809dec0 2023-10-03T10:12:55.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.052+0000 7f0d0d373700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d08136cb0 0x7f0d08135710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.052+0000 7f0d0cb72700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d0806a770 0x7f0d08134c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.052+0000 7f0d0d373700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d08136cb0 0x7f0d08135710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53100/0 (socket says 172.21.15.146:53100) 2023-10-03T10:12:55.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.052+0000 7f0d0d373700 1 -- 172.21.15.146:0/3678289697 learned_addr learned my addr 172.21.15.146:0/3678289697 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:55.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.052+0000 7f0d07fff700 1 --2- 172.21.15.146:0/3678289697 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0809dec0 0x7f0d081351d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.052+0000 7f0d0cb72700 1 -- 172.21.15.146:0/3678289697 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0809dec0 msgr2=0x7f0d081351d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.052+0000 7f0d0cb72700 1 --2- 172.21.15.146:0/3678289697 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0809dec0 0x7f0d081351d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.052+0000 7f0d0cb72700 1 -- 172.21.15.146:0/3678289697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d08136cb0 msgr2=0x7f0d08135710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.052+0000 7f0d0cb72700 1 --2- 172.21.15.146:0/3678289697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d08136cb0 0x7f0d08135710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.052+0000 7f0d0cb72700 1 -- 172.21.15.146:0/3678289697 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf40094a0 con 0x7f0d0806a770 2023-10-03T10:12:55.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.052+0000 7f0d07fff700 1 --2- 172.21.15.146:0/3678289697 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0809dec0 0x7f0d081351d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:55.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.052+0000 7f0d0d373700 1 --2- 172.21.15.146:0/3678289697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d08136cb0 0x7f0d08135710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:55.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.053+0000 7f0d0cb72700 1 --2- 172.21.15.146:0/3678289697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d0806a770 0x7f0d08134c90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00c490 tx=0x7f0cfc00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.053+0000 7f0d057fa700 1 -- 172.21.15.146:0/3678289697 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc005d70 con 0x7f0d0806a770 2023-10-03T10:12:55.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.053+0000 7f0d057fa700 1 -- 172.21.15.146:0/3678289697 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cfc0070d0 con 0x7f0d0806a770 2023-10-03T10:12:55.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.053+0000 7f0d0edd6700 1 -- 172.21.15.146:0/3678289697 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d08071ce0 con 0x7f0d0806a770 2023-10-03T10:12:55.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.053+0000 7f0d057fa700 1 -- 172.21.15.146:0/3678289697 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc007440 con 0x7f0d0806a770 2023-10-03T10:12:55.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.053+0000 7f0d0edd6700 1 -- 172.21.15.146:0/3678289697 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d081228f0 con 0x7f0d0806a770 2023-10-03T10:12:55.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.054+0000 7f0d057fa700 1 -- 172.21.15.146:0/3678289697 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0cfc0075a0 con 0x7f0d0806a770 2023-10-03T10:12:55.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.054+0000 7f0d057fa700 1 -- 172.21.15.146:0/3678289697 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0cfc03e810 con 0x7f0d0806a770 2023-10-03T10:12:55.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.054+0000 7f0d0edd6700 1 -- 172.21.15.146:0/3678289697 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d081236b0 con 0x7f0d0806a770 2023-10-03T10:12:55.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.055+0000 7f47278c8700 1 -- start start 2023-10-03T10:12:55.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.055+0000 7f47278c8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47200a0a70 0x7f4720122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.055+0000 7f47278c8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f47200a1380 0x7f4720122d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.055+0000 7f47278c8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4720133f50 0x7f4720123280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.055+0000 7f47278c8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47201260d0 con 0x7f4720133f50 2023-10-03T10:12:55.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.055+0000 7f47278c8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4720133990 con 0x7f47200a0a70 2023-10-03T10:12:55.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.055+0000 7f47278c8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47200a03e0 con 0x7f47200a1380 2023-10-03T10:12:55.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.055+0000 7f4725e65700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4720133f50 0x7f4720123280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.055+0000 7f4725e65700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4720133f50 0x7f4720123280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37694/0 (socket says 172.21.15.146:37694) 2023-10-03T10:12:55.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.055+0000 7f4725e65700 1 -- 172.21.15.146:0/2410408349 learned_addr learned my addr 172.21.15.146:0/2410408349 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:55.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.055+0000 7f4725664700 1 --2- 172.21.15.146:0/2410408349 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47200a0a70 0x7f4720122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.055+0000 7f4724e63700 1 --2- 172.21.15.146:0/2410408349 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f47200a1380 0x7f4720122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.056+0000 7f4725e65700 1 -- 172.21.15.146:0/2410408349 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f47200a1380 msgr2=0x7f4720122d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.056+0000 7f4725e65700 1 --2- 172.21.15.146:0/2410408349 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f47200a1380 0x7f4720122d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.056+0000 7f4725e65700 1 -- 172.21.15.146:0/2410408349 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47200a0a70 msgr2=0x7f4720122800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.056+0000 7f4725e65700 1 --2- 172.21.15.146:0/2410408349 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47200a0a70 0x7f4720122800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.056+0000 7f4725e65700 1 -- 172.21.15.146:0/2410408349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c009550 con 0x7f4720133f50 2023-10-03T10:12:55.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.056+0000 7f4725e65700 1 --2- 172.21.15.146:0/2410408349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4720133f50 0x7f4720123280 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f471800b970 tx=0x7f471800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.059+0000 7f4715ffb700 1 -- 172.21.15.146:0/2410408349 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471800d860 con 0x7f4720133f50 2023-10-03T10:12:55.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.059+0000 7f4715ffb700 1 -- 172.21.15.146:0/2410408349 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471800d9e0 con 0x7f4720133f50 2023-10-03T10:12:55.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.059+0000 7f47278c8700 1 -- 172.21.15.146:0/2410408349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47201244b0 con 0x7f4720133f50 2023-10-03T10:12:55.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.059+0000 7f4715ffb700 1 -- 172.21.15.146:0/2410408349 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471800dd90 con 0x7f4720133f50 2023-10-03T10:12:55.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.059+0000 7f0d057fa700 1 -- 172.21.15.146:0/3678289697 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cfc017020 con 0x7f0d0806a770 2023-10-03T10:12:55.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.059+0000 7f47278c8700 1 -- 172.21.15.146:0/2410408349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4720126820 con 0x7f4720133f50 2023-10-03T10:12:55.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.060+0000 7f4715ffb700 1 -- 172.21.15.146:0/2410408349 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f471800e430 con 0x7f4720133f50 2023-10-03T10:12:55.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.060+0000 7f4715ffb700 1 -- 172.21.15.146:0/2410408349 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4718006e40 con 0x7f4720133f50 2023-10-03T10:12:55.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.060+0000 7f47278c8700 1 -- 172.21.15.146:0/2410408349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47200747c0 con 0x7f4720133f50 2023-10-03T10:12:55.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.065+0000 7f4715ffb700 1 -- 172.21.15.146:0/2410408349 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f471800e8c0 con 0x7f4720133f50 2023-10-03T10:12:55.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.081+0000 7feac5461700 1 Processor -- start 2023-10-03T10:12:55.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.082+0000 7feac5461700 1 -- start start 2023-10-03T10:12:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.082+0000 7feac5461700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feac00a0a30 0x7feac00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.082+0000 7feac5461700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feac00a1340 0x7feac012ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.082+0000 7feac5461700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feac01304a0 0x7feac01308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.082+0000 7feac5461700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac0130e30 con 0x7feac00a0a30 2023-10-03T10:12:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.082+0000 7feac5461700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac00a1e70 con 0x7feac01304a0 2023-10-03T10:12:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.082+0000 7feac5461700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feac009a720 con 0x7feac00a1340 2023-10-03T10:12:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.082+0000 7feabeffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feac00a0a30 0x7feac00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.082+0000 7feabeffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feac00a0a30 0x7feac00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37708/0 (socket says 172.21.15.146:37708) 2023-10-03T10:12:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.082+0000 7feabeffd700 1 -- 172.21.15.146:0/507907379 learned_addr learned my addr 172.21.15.146:0/507907379 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.082+0000 7feabf7fe700 1 --2- 172.21.15.146:0/507907379 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feac01304a0 0x7feac01308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.082+0000 7feabeffd700 1 -- 172.21.15.146:0/507907379 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feac00a1340 msgr2=0x7feac012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.082+0000 7feabeffd700 1 --2- 172.21.15.146:0/507907379 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feac00a1340 0x7feac012ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.082+0000 7feabeffd700 1 -- 172.21.15.146:0/507907379 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feac01304a0 msgr2=0x7feac01308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.082+0000 7feabeffd700 1 --2- 172.21.15.146:0/507907379 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feac01304a0 0x7feac01308f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.082+0000 7feabeffd700 1 -- 172.21.15.146:0/507907379 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac009b300 con 0x7feac00a0a30 2023-10-03T10:12:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.083+0000 7feabeffd700 1 --2- 172.21.15.146:0/507907379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feac00a0a30 0x7feac00a0e00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7feab0006fd0 tx=0x7feab000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682fb00384dc5ea0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.083+0000 7feabdffb700 1 -- 172.21.15.146:0/507907379 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab0005e30 con 0x7feac00a0a30 2023-10-03T10:12:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.083+0000 7feabdffb700 1 -- 172.21.15.146:0/507907379 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab0004030 con 0x7feac00a0a30 2023-10-03T10:12:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.083+0000 7feabdffb700 1 -- 172.21.15.146:0/507907379 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab00043e0 con 0x7feac00a0a30 2023-10-03T10:12:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.083+0000 7feac5461700 1 -- 172.21.15.146:0/507907379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feac00a0a30 msgr2=0x7feac00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.083+0000 7feac5461700 1 --2- 172.21.15.146:0/507907379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feac00a0a30 0x7feac00a0e00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7feab0006fd0 tx=0x7feab000be70 comp rx=0 tx=0).stop 2023-10-03T10:12:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.084+0000 7feac5461700 1 -- 172.21.15.146:0/507907379 shutdown_connections 2023-10-03T10:12:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.084+0000 7feac5461700 1 --2- 172.21.15.146:0/507907379 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feac01304a0 0x7feac01308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.084+0000 7feac5461700 1 --2- 172.21.15.146:0/507907379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feac00a0a30 0x7feac00a0e00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.084+0000 7feac5461700 1 --2- 172.21.15.146:0/507907379 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feac00a1340 0x7feac012ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.084+0000 7feac5461700 1 -- 172.21.15.146:0/507907379 >> 172.21.15.146:0/507907379 conn(0x7feac00a2980 msgr2=0x7feac00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.084+0000 7feac5461700 1 -- 172.21.15.146:0/507907379 shutdown_connections 2023-10-03T10:12:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.084+0000 7feac5461700 1 -- 172.21.15.146:0/507907379 wait complete. 2023-10-03T10:12:55.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.085+0000 7feac5461700 1 Processor -- start 2023-10-03T10:12:55.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.085+0000 7feac5461700 1 -- start start 2023-10-03T10:12:55.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.085+0000 7feac5461700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feac00a0a30 0x7feac011e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.085+0000 7feac5461700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feac00a1340 0x7feac011edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.085+0000 7feac5461700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feac01304a0 0x7feac01c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.085+0000 7feac5461700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac01218d0 con 0x7feac00a0a30 2023-10-03T10:12:55.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.085+0000 7feac5461700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac009ae00 con 0x7feac00a1340 2023-10-03T10:12:55.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.085+0000 7feac5461700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feac0121ad0 con 0x7feac01304a0 2023-10-03T10:12:55.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.085+0000 7feabf7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feac01304a0 0x7feac01c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.085+0000 7feabe7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feac00a1340 0x7feac011edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.085+0000 7feabf7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feac01304a0 0x7feac01c3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51540/0 (socket says 172.21.15.146:51540) 2023-10-03T10:12:55.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.085+0000 7feabf7fe700 1 -- 172.21.15.146:0/2525559627 learned_addr learned my addr 172.21.15.146:0/2525559627 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:55.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.085+0000 7feabeffd700 1 --2- 172.21.15.146:0/2525559627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feac00a0a30 0x7feac011e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.086+0000 7feabf7fe700 1 -- 172.21.15.146:0/2525559627 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feac00a1340 msgr2=0x7feac011edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.086+0000 7feabf7fe700 1 --2- 172.21.15.146:0/2525559627 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feac00a1340 0x7feac011edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.086+0000 7feabf7fe700 1 -- 172.21.15.146:0/2525559627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feac00a0a30 msgr2=0x7feac011e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.086+0000 7feabf7fe700 1 --2- 172.21.15.146:0/2525559627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feac00a0a30 0x7feac011e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.086+0000 7feabf7fe700 1 -- 172.21.15.146:0/2525559627 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab000b7a0 con 0x7feac01304a0 2023-10-03T10:12:55.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.086+0000 7feabf7fe700 1 --2- 172.21.15.146:0/2525559627 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feac01304a0 0x7feac01c3dd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feab8009dd0 tx=0x7feab800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.086+0000 7feaa77fe700 1 -- 172.21.15.146:0/2525559627 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab8009c40 con 0x7feac01304a0 2023-10-03T10:12:55.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.086+0000 7feaa77fe700 1 -- 172.21.15.146:0/2525559627 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab800f040 con 0x7feac01304a0 2023-10-03T10:12:55.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.086+0000 7feac5461700 1 -- 172.21.15.146:0/2525559627 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac011fbc0 con 0x7feac01304a0 2023-10-03T10:12:55.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.086+0000 7feaa77fe700 1 -- 172.21.15.146:0/2525559627 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab800ceb0 con 0x7feac01304a0 2023-10-03T10:12:55.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.086+0000 7feac5461700 1 -- 172.21.15.146:0/2525559627 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac0122260 con 0x7feac01304a0 2023-10-03T10:12:55.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.087+0000 7f137f1a6700 1 Processor -- start 2023-10-03T10:12:55.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.087+0000 7f137f1a6700 1 -- start start 2023-10-03T10:12:55.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.087+0000 7f137f1a6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1378133a70 0x7f1378133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.087+0000 7f137f1a6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13780a08e0 0x7f13780a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.087+0000 7f137f1a6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f13780a1290 0x7f137813a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.087+0000 7f137f1a6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1378133640 con 0x7f1378133a70 2023-10-03T10:12:55.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.087+0000 7f137f1a6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13780a1d50 con 0x7f13780a08e0 2023-10-03T10:12:55.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.087+0000 7f137f1a6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13780a1710 con 0x7f13780a1290 2023-10-03T10:12:55.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.087+0000 7f136ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13780a08e0 0x7f13780a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.087+0000 7f136ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13780a08e0 0x7f13780a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53134/0 (socket says 172.21.15.146:53134) 2023-10-03T10:12:55.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.087+0000 7f136ffff700 1 -- 172.21.15.146:0/3620127219 learned_addr learned my addr 172.21.15.146:0/3620127219 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:55.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.087+0000 7feac5461700 1 -- 172.21.15.146:0/2525559627 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac004f2a0 con 0x7feac01304a0 2023-10-03T10:12:55.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.087+0000 7f137cf42700 1 --2- 172.21.15.146:0/3620127219 >> v2:172.21.15.146:3300/0 conn(0x7f1378133a70 0x7f1378133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.088+0000 7f137cf42700 1 -- 172.21.15.146:0/3620127219 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f13780a1290 msgr2=0x7f137813a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:55.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.088+0000 7f137cf42700 1 --2- 172.21.15.146:0/3620127219 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f13780a1290 0x7f137813a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.088+0000 7f137cf42700 1 -- 172.21.15.146:0/3620127219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13780a08e0 msgr2=0x7f13780a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:55.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.088+0000 7f137cf42700 1 --2- 172.21.15.146:0/3620127219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13780a08e0 0x7f13780a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.088+0000 7f137cf42700 1 -- 172.21.15.146:0/3620127219 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137809b620 con 0x7f1378133a70 2023-10-03T10:12:55.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.088+0000 7f137cf42700 1 --2- 172.21.15.146:0/3620127219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1378133a70 0x7f1378133e40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1374009de0 tx=0x7f137400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe1c5ef3f8d2816 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.088+0000 7f136f7fe700 1 -- 172.21.15.146:0/3620127219 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137400e070 con 0x7f1378133a70 2023-10-03T10:12:55.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.088+0000 7f136f7fe700 1 -- 172.21.15.146:0/3620127219 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137400bb20 con 0x7f1378133a70 2023-10-03T10:12:55.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.088+0000 7f136f7fe700 1 -- 172.21.15.146:0/3620127219 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374012430 con 0x7f1378133a70 2023-10-03T10:12:55.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.089+0000 7f137f1a6700 1 -- 172.21.15.146:0/3620127219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1378133a70 msgr2=0x7f1378133e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.089+0000 7f137f1a6700 1 --2- 172.21.15.146:0/3620127219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1378133a70 0x7f1378133e40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1374009de0 tx=0x7f137400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.089+0000 7f137f1a6700 1 -- 172.21.15.146:0/3620127219 shutdown_connections 2023-10-03T10:12:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.089+0000 7f137f1a6700 1 --2- 172.21.15.146:0/3620127219 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f13780a1290 0x7f137813a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.089+0000 7f137f1a6700 1 --2- 172.21.15.146:0/3620127219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1378133a70 0x7f1378133e40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.089+0000 7f137f1a6700 1 --2- 172.21.15.146:0/3620127219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13780a08e0 0x7f13780a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.089+0000 7f137f1a6700 1 -- 172.21.15.146:0/3620127219 >> 172.21.15.146:0/3620127219 conn(0x7f13780a2980 msgr2=0x7f13780a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.089+0000 7f137f1a6700 1 -- 172.21.15.146:0/3620127219 shutdown_connections 2023-10-03T10:12:55.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.089+0000 7f137f1a6700 1 -- 172.21.15.146:0/3620127219 wait complete. 2023-10-03T10:12:55.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.090+0000 7f137f1a6700 1 Processor -- start 2023-10-03T10:12:55.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.091+0000 7feaa77fe700 1 -- 172.21.15.146:0/2525559627 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feab8014480 con 0x7feac01304a0 2023-10-03T10:12:55.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.091+0000 7feaa77fe700 1 -- 172.21.15.146:0/2525559627 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feab8040800 con 0x7feac01304a0 2023-10-03T10:12:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.091+0000 7f137f1a6700 1 -- start start 2023-10-03T10:12:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.091+0000 7f137f1a6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13780a08e0 0x7f1378137ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.091+0000 7f137f1a6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f13780a1290 0x7f1378137ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.091+0000 7f137f1a6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1378133a70 0x7f13781300a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.091+0000 7f137f1a6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1378119190 con 0x7f13780a08e0 2023-10-03T10:12:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.091+0000 7f137f1a6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1378132c30 con 0x7f1378133a70 2023-10-03T10:12:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.091+0000 7f137f1a6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13781376c0 con 0x7f13780a1290 2023-10-03T10:12:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.092+0000 7f137d743700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1378133a70 0x7f13781300a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.092+0000 7f137d743700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1378133a70 0x7f13781300a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53142/0 (socket says 172.21.15.146:53142) 2023-10-03T10:12:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.092+0000 7f137d743700 1 -- 172.21.15.146:0/1454025378 learned_addr learned my addr 172.21.15.146:0/1454025378 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.092+0000 7f137cf42700 1 --2- 172.21.15.146:0/1454025378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13780a08e0 0x7f1378137ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.092+0000 7f137d743700 1 -- 172.21.15.146:0/1454025378 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f13780a1290 msgr2=0x7f1378137ff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.092+0000 7f137d743700 1 --2- 172.21.15.146:0/1454025378 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f13780a1290 0x7f1378137ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.092+0000 7f137d743700 1 -- 172.21.15.146:0/1454025378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13780a08e0 msgr2=0x7f1378137ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.092+0000 7f137d743700 1 --2- 172.21.15.146:0/1454025378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13780a08e0 0x7f1378137ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.092+0000 7f137d743700 1 -- 172.21.15.146:0/1454025378 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1374009a70 con 0x7f1378133a70 2023-10-03T10:12:55.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.092+0000 7f137d743700 1 --2- 172.21.15.146:0/1454025378 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1378133a70 0x7f13781300a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f137000b580 tx=0x7f137000b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.093+0000 7f136d7fa700 1 -- 172.21.15.146:0/1454025378 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370011830 con 0x7f1378133a70 2023-10-03T10:12:55.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.093+0000 7f137f1a6700 1 -- 172.21.15.146:0/1454025378 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f137809a350 con 0x7f1378133a70 2023-10-03T10:12:55.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.093+0000 7f136d7fa700 1 -- 172.21.15.146:0/1454025378 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1370011990 con 0x7f1378133a70 2023-10-03T10:12:55.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.093+0000 7f136d7fa700 1 -- 172.21.15.146:0/1454025378 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370011d40 con 0x7f1378133a70 2023-10-03T10:12:55.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.093+0000 7f137f1a6700 1 -- 172.21.15.146:0/1454025378 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1378138d60 con 0x7f1378133a70 2023-10-03T10:12:55.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.093+0000 7feaa77fe700 1 -- 172.21.15.146:0/2525559627 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feab8012930 con 0x7feac01304a0 2023-10-03T10:12:55.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.094+0000 7f136d7fa700 1 -- 172.21.15.146:0/1454025378 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f137001a400 con 0x7f1378133a70 2023-10-03T10:12:55.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.094+0000 7f137f1a6700 1 -- 172.21.15.146:0/1454025378 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1378118fa0 con 0x7f1378133a70 2023-10-03T10:12:55.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.094+0000 7f136d7fa700 1 -- 172.21.15.146:0/1454025378 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f137003f6d0 con 0x7f1378133a70 2023-10-03T10:12:55.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.103+0000 7f136d7fa700 1 -- 172.21.15.146:0/1454025378 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1370015080 con 0x7f1378133a70 2023-10-03T10:12:55.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.262+0000 7f0d0edd6700 1 -- 172.21.15.146:0/3678289697 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0d0804f2a0 con 0x7f0d0806a770 2023-10-03T10:12:55.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.262+0000 7f0d057fa700 1 -- 172.21.15.146:0/3678289697 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0cfc023070 con 0x7f0d0806a770 2023-10-03T10:12:55.262 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:55.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.264+0000 7f47278c8700 1 -- 172.21.15.146:0/2410408349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f472004f2a0 con 0x7f4720133f50 2023-10-03T10:12:55.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.264+0000 7f0d0edd6700 1 -- 172.21.15.146:0/3678289697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d0806a770 msgr2=0x7f0d08134c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.264+0000 7f0d0edd6700 1 --2- 172.21.15.146:0/3678289697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d0806a770 0x7f0d08134c90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00c490 tx=0x7f0cfc00c7a0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.264+0000 7f0d0edd6700 1 -- 172.21.15.146:0/3678289697 shutdown_connections 2023-10-03T10:12:55.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.264+0000 7f0d0edd6700 1 --2- 172.21.15.146:0/3678289697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d08136cb0 0x7f0d08135710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.264+0000 7f0d0edd6700 1 --2- 172.21.15.146:0/3678289697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d0806a770 0x7f0d08134c90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.264+0000 7f0d0edd6700 1 --2- 172.21.15.146:0/3678289697 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0809dec0 0x7f0d081351d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.265+0000 7f0d0edd6700 1 -- 172.21.15.146:0/3678289697 >> 172.21.15.146:0/3678289697 conn(0x7f0d08099c40 msgr2=0x7f0d0809a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:55.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.265+0000 7f0d0edd6700 1 -- 172.21.15.146:0/3678289697 shutdown_connections 2023-10-03T10:12:55.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.265+0000 7f4715ffb700 1 -- 172.21.15.146:0/2410408349 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f471800c380 con 0x7f4720133f50 2023-10-03T10:12:55.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.265+0000 7f0d0edd6700 1 -- 172.21.15.146:0/3678289697 wait complete. 2023-10-03T10:12:55.266 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:55.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.267+0000 7f47278c8700 1 -- 172.21.15.146:0/2410408349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4720133f50 msgr2=0x7f4720123280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.267+0000 7f47278c8700 1 --2- 172.21.15.146:0/2410408349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4720133f50 0x7f4720123280 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f471800b970 tx=0x7f471800bc80 comp rx=0 tx=0).stop 2023-10-03T10:12:55.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.267+0000 7f47278c8700 1 -- 172.21.15.146:0/2410408349 shutdown_connections 2023-10-03T10:12:55.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.267+0000 7f47278c8700 1 --2- 172.21.15.146:0/2410408349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4720133f50 0x7f4720123280 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.267+0000 7f47278c8700 1 --2- 172.21.15.146:0/2410408349 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47200a0a70 0x7f4720122800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.267+0000 7f47278c8700 1 --2- 172.21.15.146:0/2410408349 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f47200a1380 0x7f4720122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.267+0000 7f47278c8700 1 -- 172.21.15.146:0/2410408349 >> 172.21.15.146:0/2410408349 conn(0x7f47200a6610 msgr2=0x7f472009b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:55.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.267+0000 7f47278c8700 1 -- 172.21.15.146:0/2410408349 shutdown_connections 2023-10-03T10:12:55.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.267+0000 7f47278c8700 1 -- 172.21.15.146:0/2410408349 wait complete. 2023-10-03T10:12:55.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:55.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:55.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.287+0000 7feac5461700 1 -- 172.21.15.146:0/2525559627 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feac006bce0 con 0x7feac01304a0 2023-10-03T10:12:55.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.288+0000 7feaa77fe700 1 -- 172.21.15.146:0/2525559627 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feab802a090 con 0x7feac01304a0 2023-10-03T10:12:55.288 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:55.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.290+0000 7feac5461700 1 -- 172.21.15.146:0/2525559627 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feac01304a0 msgr2=0x7feac01c3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.290+0000 7feac5461700 1 --2- 172.21.15.146:0/2525559627 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feac01304a0 0x7feac01c3dd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feab8009dd0 tx=0x7feab800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.290+0000 7feac5461700 1 -- 172.21.15.146:0/2525559627 shutdown_connections 2023-10-03T10:12:55.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.290+0000 7feac5461700 1 --2- 172.21.15.146:0/2525559627 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feac01304a0 0x7feac01c3dd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.290+0000 7feac5461700 1 --2- 172.21.15.146:0/2525559627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feac00a0a30 0x7feac011e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.290+0000 7feac5461700 1 --2- 172.21.15.146:0/2525559627 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feac00a1340 0x7feac011edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.290+0000 7feac5461700 1 -- 172.21.15.146:0/2525559627 >> 172.21.15.146:0/2525559627 conn(0x7feac00a2980 msgr2=0x7feac009deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:55.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.290+0000 7feac5461700 1 -- 172.21.15.146:0/2525559627 shutdown_connections 2023-10-03T10:12:55.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.290+0000 7feac5461700 1 -- 172.21.15.146:0/2525559627 wait complete. 2023-10-03T10:12:55.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:55.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.306+0000 7f137f1a6700 1 -- 172.21.15.146:0/1454025378 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f137804f2a0 con 0x7f1378133a70 2023-10-03T10:12:55.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.306+0000 7f136d7fa700 1 -- 172.21.15.146:0/1454025378 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1370032070 con 0x7f1378133a70 2023-10-03T10:12:55.306 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:55.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.308+0000 7f137f1a6700 1 -- 172.21.15.146:0/1454025378 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1378133a70 msgr2=0x7f13781300a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:55.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.308+0000 7f137f1a6700 1 --2- 172.21.15.146:0/1454025378 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1378133a70 0x7f13781300a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f137000b580 tx=0x7f137000b890 comp rx=0 tx=0).stop 2023-10-03T10:12:55.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.308+0000 7f137f1a6700 1 -- 172.21.15.146:0/1454025378 shutdown_connections 2023-10-03T10:12:55.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.308+0000 7f137f1a6700 1 --2- 172.21.15.146:0/1454025378 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1378133a70 0x7f13781300a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.308+0000 7f137f1a6700 1 --2- 172.21.15.146:0/1454025378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13780a08e0 0x7f1378137ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.308+0000 7f137f1a6700 1 --2- 172.21.15.146:0/1454025378 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f13780a1290 0x7f1378137ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.308+0000 7f137f1a6700 1 -- 172.21.15.146:0/1454025378 >> 172.21.15.146:0/1454025378 conn(0x7f13780a2980 msgr2=0x7f137809f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:55.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.308+0000 7f137f1a6700 1 -- 172.21.15.146:0/1454025378 shutdown_connections 2023-10-03T10:12:55.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:55.308+0000 7f137f1a6700 1 -- 172.21.15.146:0/1454025378 wait complete. 2023-10-03T10:12:55.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:56.279 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:56.286 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:56.302 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:56.322 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:56.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.425+0000 7f9b9c5c5700 1 Processor -- start 2023-10-03T10:12:56.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.425+0000 7f9b9c5c5700 1 -- start start 2023-10-03T10:12:56.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.426+0000 7f9b9c5c5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9b9409e340 0x7f9b941359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.426+0000 7f9b9c5c5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b94135f20 0x7f9b94138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.426+0000 7f9b9c5c5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b9409aaa0 con 0x7f9b9409d860 2023-10-03T10:12:56.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.426+0000 7f9b9c5c5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b9409e730 con 0x7f9b9409e340 2023-10-03T10:12:56.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.426+0000 7f9b9c5c5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9409f870 con 0x7f9b94135f20 2023-10-03T10:12:56.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.426+0000 7f9b9ab62700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b94135f20 0x7f9b94138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.426+0000 7f9b9ab62700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b94135f20 0x7f9b94138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53146/0 (socket says 172.21.15.146:53146) 2023-10-03T10:12:56.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.426+0000 7f9b9ab62700 1 -- 172.21.15.146:0/175946150 learned_addr learned my addr 172.21.15.146:0/175946150 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:56.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.426+0000 7f9b99b60700 1 --2- 172.21.15.146:0/175946150 >> v2:172.21.15.146:3300/0 conn(0x7f9b9409e340 0x7f9b941359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.426+0000 7f9b9ab62700 1 -- 172.21.15.146:0/175946150 >> v2:172.21.15.146:3300/0 conn(0x7f9b9409e340 msgr2=0x7f9b941359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:56.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.426+0000 7f9b9ab62700 1 --2- 172.21.15.146:0/175946150 >> v2:172.21.15.146:3300/0 conn(0x7f9b9409e340 0x7f9b941359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.426+0000 7f9b9ab62700 1 -- 172.21.15.146:0/175946150 >> v1:172.21.15.146:6789/0 conn(0x7f9b9409d860 legacy=0x7f9b9409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.426+0000 7f9b9ab62700 1 -- 172.21.15.146:0/175946150 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9409b360 con 0x7f9b94135f20 2023-10-03T10:12:56.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.427+0000 7f9b9ab62700 1 --2- 172.21.15.146:0/175946150 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b94135f20 0x7f9b94138300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c009e80 tx=0x7f9b8c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59a36a42889e2144 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:56.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.427+0000 7f9b9935f700 1 -- 172.21.15.146:0/175946150 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c00e070 con 0x7f9b94135f20 2023-10-03T10:12:56.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.427+0000 7f9b9935f700 1 -- 172.21.15.146:0/175946150 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c00b8d0 con 0x7f9b94135f20 2023-10-03T10:12:56.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.427+0000 7f9b9935f700 1 -- 172.21.15.146:0/175946150 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c00bc80 con 0x7f9b94135f20 2023-10-03T10:12:56.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.427+0000 7f9b9c5c5700 1 -- 172.21.15.146:0/175946150 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b94135f20 msgr2=0x7f9b94138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.427+0000 7f9b9c5c5700 1 --2- 172.21.15.146:0/175946150 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b94135f20 0x7f9b94138300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c009e80 tx=0x7f9b8c00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:56.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.428+0000 7f9b9c5c5700 1 -- 172.21.15.146:0/175946150 shutdown_connections 2023-10-03T10:12:56.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.428+0000 7f9b9c5c5700 1 --2- 172.21.15.146:0/175946150 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b94135f20 0x7f9b94138300 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.428+0000 7f9b9c5c5700 1 --2- 172.21.15.146:0/175946150 >> v2:172.21.15.146:3300/0 conn(0x7f9b9409e340 0x7f9b941359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.428+0000 7f9b9c5c5700 1 -- 172.21.15.146:0/175946150 >> 172.21.15.146:0/175946150 conn(0x7f9b94099c40 msgr2=0x7f9b940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.428+0000 7f9b9c5c5700 1 -- 172.21.15.146:0/175946150 shutdown_connections 2023-10-03T10:12:56.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.428+0000 7f9b9c5c5700 1 -- 172.21.15.146:0/175946150 wait complete. 2023-10-03T10:12:56.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.429+0000 7f9b9c5c5700 1 Processor -- start 2023-10-03T10:12:56.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.429+0000 7f9b9c5c5700 1 -- start start 2023-10-03T10:12:56.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.430+0000 7f9b9c5c5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b9409d860 0x7f9b9411a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.430+0000 7f9b9c5c5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b9409e340 0x7f9b9411aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.430+0000 7f9b9c5c5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b94135f20 0x7f9b9411b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.430+0000 7f9b9c5c5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9411ea80 con 0x7f9b94135f20 2023-10-03T10:12:56.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.430+0000 7f9b9c5c5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9411c250 con 0x7f9b9409d860 2023-10-03T10:12:56.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.430+0000 7f9b9c5c5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9411dde0 con 0x7f9b9409e340 2023-10-03T10:12:56.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.430+0000 7f9b9ab62700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b94135f20 0x7f9b9411b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.430+0000 7f9b9ab62700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b94135f20 0x7f9b9411b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37768/0 (socket says 172.21.15.146:37768) 2023-10-03T10:12:56.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.430+0000 7f9b9ab62700 1 -- 172.21.15.146:0/3969655743 learned_addr learned my addr 172.21.15.146:0/3969655743 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:56.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.430+0000 7f9b9a361700 1 --2- 172.21.15.146:0/3969655743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b9409d860 0x7f9b9411a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.430+0000 7f9b99b60700 1 --2- 172.21.15.146:0/3969655743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b9409e340 0x7f9b9411aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.430+0000 7f9b9ab62700 1 -- 172.21.15.146:0/3969655743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b9409e340 msgr2=0x7f9b9411aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.430+0000 7f9b9ab62700 1 --2- 172.21.15.146:0/3969655743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b9409e340 0x7f9b9411aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.430+0000 7f9b9ab62700 1 -- 172.21.15.146:0/3969655743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b9409d860 msgr2=0x7f9b9411a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.430+0000 7f9b9ab62700 1 --2- 172.21.15.146:0/3969655743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b9409d860 0x7f9b9411a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.430+0000 7f9b9ab62700 1 -- 172.21.15.146:0/3969655743 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8c009b30 con 0x7f9b94135f20 2023-10-03T10:12:56.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.430+0000 7f9b9a361700 1 --2- 172.21.15.146:0/3969655743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b9409d860 0x7f9b9411a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:56.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.430+0000 7f9b9ab62700 1 --2- 172.21.15.146:0/3969655743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b94135f20 0x7f9b9411b020 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c012000 tx=0x7f9b8c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:56.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.431+0000 7f9b8affd700 1 -- 172.21.15.146:0/3969655743 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c0048b0 con 0x7f9b94135f20 2023-10-03T10:12:56.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.431+0000 7f9b8affd700 1 -- 172.21.15.146:0/3969655743 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c0092e0 con 0x7f9b94135f20 2023-10-03T10:12:56.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.431+0000 7f9b8affd700 1 -- 172.21.15.146:0/3969655743 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c01c630 con 0x7f9b94135f20 2023-10-03T10:12:56.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.431+0000 7f9b9c5c5700 1 -- 172.21.15.146:0/3969655743 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b9409a150 con 0x7f9b94135f20 2023-10-03T10:12:56.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.431+0000 7f9b9c5c5700 1 -- 172.21.15.146:0/3969655743 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9411d400 con 0x7f9b94135f20 2023-10-03T10:12:56.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.432+0000 7f9b9c5c5700 1 -- 172.21.15.146:0/3969655743 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9404f2a0 con 0x7f9b94135f20 2023-10-03T10:12:56.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.434+0000 7f9b8affd700 1 -- 172.21.15.146:0/3969655743 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b8c01c790 con 0x7f9b94135f20 2023-10-03T10:12:56.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.434+0000 7f9b8affd700 1 -- 172.21.15.146:0/3969655743 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9b8c0417b0 con 0x7f9b94135f20 2023-10-03T10:12:56.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.437+0000 7f9b8affd700 1 -- 172.21.15.146:0/3969655743 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b8c01ca40 con 0x7f9b94135f20 2023-10-03T10:12:56.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.454+0000 7f9d4e069700 1 Processor -- start 2023-10-03T10:12:56.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.454+0000 7f9d4e069700 1 -- start start 2023-10-03T10:12:56.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.455+0000 7f349b74e700 1 Processor -- start 2023-10-03T10:12:56.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.455+0000 7f9d4e069700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d48131980 0x7f9d48131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.455+0000 7f9d4e069700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d4809bc70 0x7f9d4809c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.455+0000 7f9d4e069700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d480a1640 con 0x7f9d4809c5c0 2023-10-03T10:12:56.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.455+0000 7f9d4e069700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4806eb30 con 0x7f9d48131980 2023-10-03T10:12:56.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.455+0000 7f9d4e069700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d480a22d0 con 0x7f9d4809bc70 2023-10-03T10:12:56.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.455+0000 7f349b74e700 1 -- start start 2023-10-03T10:12:56.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.455+0000 7f9d477fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d48131980 0x7f9d48131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.455+0000 7f9d477fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d48131980 0x7f9d48131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53166/0 (socket says 172.21.15.146:53166) 2023-10-03T10:12:56.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.455+0000 7f9d477fe700 1 -- 172.21.15.146:0/1575792374 learned_addr learned my addr 172.21.15.146:0/1575792374 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:56.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.455+0000 7f9d477fe700 1 -- 172.21.15.146:0/1575792374 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d4809bc70 msgr2=0x7f9d4809c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:56.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.455+0000 7f9d477fe700 1 --2- 172.21.15.146:0/1575792374 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d4809bc70 0x7f9d4809c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.455+0000 7f9d477fe700 1 -- 172.21.15.146:0/1575792374 >> v1:172.21.15.146:6789/0 conn(0x7f9d4809c5c0 legacy=0x7f9d48138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:56.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.455+0000 7f9d477fe700 1 -- 172.21.15.146:0/1575792374 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d48131550 con 0x7f9d48131980 2023-10-03T10:12:56.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.456+0000 7f9d477fe700 1 --2- 172.21.15.146:0/1575792374 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d48131980 0x7f9d48131d50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9d380098f0 tx=0x7f9d38009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beb4767ef8d00e84 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:56.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.456+0000 7f9d467fc700 1 -- 172.21.15.146:0/1575792374 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d38005e30 con 0x7f9d48131980 2023-10-03T10:12:56.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.456+0000 7f9d467fc700 1 -- 172.21.15.146:0/1575792374 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d38006030 con 0x7f9d48131980 2023-10-03T10:12:56.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.456+0000 7f9d467fc700 1 -- 172.21.15.146:0/1575792374 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d380063c0 con 0x7f9d48131980 2023-10-03T10:12:56.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.456+0000 7f349b74e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3494133a70 0x7f3494133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.456+0000 7f349b74e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34940a1460 0x7f349413b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.456+0000 7f349b74e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3494133640 con 0x7f34940a08e0 2023-10-03T10:12:56.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.456+0000 7f349b74e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34940a1d50 con 0x7f34940a1460 2023-10-03T10:12:56.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.456+0000 7f349b74e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f349409b620 con 0x7f3494133a70 2023-10-03T10:12:56.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.456+0000 7f3499ceb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34940a1460 0x7f349413b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.456+0000 7f3499ceb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34940a1460 0x7f349413b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53182/0 (socket says 172.21.15.146:53182) 2023-10-03T10:12:56.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.456+0000 7f3499ceb700 1 -- 172.21.15.146:0/1198609781 learned_addr learned my addr 172.21.15.146:0/1198609781 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:56.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.456+0000 7f3499ceb700 1 -- 172.21.15.146:0/1198609781 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3494133a70 msgr2=0x7f3494133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:56.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.456+0000 7f3499ceb700 1 --2- 172.21.15.146:0/1198609781 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3494133a70 0x7f3494133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.456+0000 7f3499ceb700 1 -- 172.21.15.146:0/1198609781 >> v1:172.21.15.146:6789/0 conn(0x7f34940a08e0 legacy=0x7f34940a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:56.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.456+0000 7f3499ceb700 1 -- 172.21.15.146:0/1198609781 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3494133870 con 0x7f34940a1460 2023-10-03T10:12:56.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.456+0000 7f3499ceb700 1 --2- 172.21.15.146:0/1198609781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34940a1460 0x7f349413b980 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f348c009e80 tx=0x7f348c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0d2f0adce2602fd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:56.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.457+0000 7f9d4e069700 1 -- 172.21.15.146:0/1575792374 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d48131980 msgr2=0x7f9d48131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.457+0000 7f9d4e069700 1 --2- 172.21.15.146:0/1575792374 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d48131980 0x7f9d48131d50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9d380098f0 tx=0x7f9d38009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:56.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.457+0000 7f9d4e069700 1 -- 172.21.15.146:0/1575792374 shutdown_connections 2023-10-03T10:12:56.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.457+0000 7f9d4e069700 1 --2- 172.21.15.146:0/1575792374 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d48131980 0x7f9d48131d50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.457+0000 7f9d4e069700 1 --2- 172.21.15.146:0/1575792374 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d4809bc70 0x7f9d4809c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.457+0000 7f9d4e069700 1 -- 172.21.15.146:0/1575792374 >> 172.21.15.146:0/1575792374 conn(0x7f9d480a2980 msgr2=0x7f9d480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.457+0000 7f348bfff700 1 -- 172.21.15.146:0/1198609781 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c00e070 con 0x7f34940a1460 2023-10-03T10:12:56.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.457+0000 7f348bfff700 1 -- 172.21.15.146:0/1198609781 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348c003a20 con 0x7f34940a1460 2023-10-03T10:12:56.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.457+0000 7f348bfff700 1 -- 172.21.15.146:0/1198609781 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c003dd0 con 0x7f34940a1460 2023-10-03T10:12:56.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.457+0000 7f9d4e069700 1 -- 172.21.15.146:0/1575792374 shutdown_connections 2023-10-03T10:12:56.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.457+0000 7f9d4e069700 1 -- 172.21.15.146:0/1575792374 wait complete. 2023-10-03T10:12:56.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.457+0000 7f349b74e700 1 -- 172.21.15.146:0/1198609781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34940a1460 msgr2=0x7f349413b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.457+0000 7f349b74e700 1 --2- 172.21.15.146:0/1198609781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34940a1460 0x7f349413b980 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f348c009e80 tx=0x7f348c00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:56.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.458+0000 7f349b74e700 1 -- 172.21.15.146:0/1198609781 shutdown_connections 2023-10-03T10:12:56.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.458+0000 7f349b74e700 1 --2- 172.21.15.146:0/1198609781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34940a1460 0x7f349413b980 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.458+0000 7f349b74e700 1 --2- 172.21.15.146:0/1198609781 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3494133a70 0x7f3494133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.458+0000 7f349b74e700 1 -- 172.21.15.146:0/1198609781 >> 172.21.15.146:0/1198609781 conn(0x7f34940a2980 msgr2=0x7f34940a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.458+0000 7f9d4e069700 1 Processor -- start 2023-10-03T10:12:56.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.458+0000 7f349b74e700 1 -- 172.21.15.146:0/1198609781 shutdown_connections 2023-10-03T10:12:56.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.458+0000 7f9d4e069700 1 -- start start 2023-10-03T10:12:56.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.459+0000 7f349b74e700 1 -- 172.21.15.146:0/1198609781 wait complete. 2023-10-03T10:12:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.459+0000 7f9d4e069700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d4809bc70 0x7f9d4811dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.459+0000 7f9d4e069700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d4809c5c0 0x7f9d4811e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.459+0000 7f9d4e069700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d48131980 0x7f9d4811e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.459+0000 7f9d4e069700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d48121640 con 0x7f9d48131980 2023-10-03T10:12:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.459+0000 7f9d4e069700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4811ffc0 con 0x7f9d4809c5c0 2023-10-03T10:12:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.459+0000 7f9d4e069700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4811f010 con 0x7f9d4809bc70 2023-10-03T10:12:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.459+0000 7f9d47fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d48131980 0x7f9d4811e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.459+0000 7f9d47fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d48131980 0x7f9d4811e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37782/0 (socket says 172.21.15.146:37782) 2023-10-03T10:12:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.459+0000 7f9d47fff700 1 -- 172.21.15.146:0/2581125738 learned_addr learned my addr 172.21.15.146:0/2581125738 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.459+0000 7f9d47fff700 1 -- 172.21.15.146:0/2581125738 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d4809bc70 msgr2=0x7f9d4811dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.459+0000 7f9d47fff700 1 --2- 172.21.15.146:0/2581125738 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d4809bc70 0x7f9d4811dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.459+0000 7f9d47fff700 1 -- 172.21.15.146:0/2581125738 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d4809c5c0 msgr2=0x7f9d4811e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.459+0000 7f9d47fff700 1 --2- 172.21.15.146:0/2581125738 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d4809c5c0 0x7f9d4811e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.459+0000 7f9d47fff700 1 -- 172.21.15.146:0/2581125738 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d38009500 con 0x7f9d48131980 2023-10-03T10:12:56.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.459+0000 7f9d47fff700 1 --2- 172.21.15.146:0/2581125738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d48131980 0x7f9d4811e630 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9d4000c7b0 tx=0x7f9d4000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:56.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.459+0000 7f349b74e700 1 Processor -- start 2023-10-03T10:12:56.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.460+0000 7f349b74e700 1 -- start start 2023-10-03T10:12:56.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.460+0000 7f9d2ffff700 1 -- 172.21.15.146:0/2581125738 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40003e10 con 0x7f9d48131980 2023-10-03T10:12:56.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.460+0000 7f9d2ffff700 1 -- 172.21.15.146:0/2581125738 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d40005070 con 0x7f9d48131980 2023-10-03T10:12:56.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.460+0000 7f9d2ffff700 1 -- 172.21.15.146:0/2581125738 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40005420 con 0x7f9d48131980 2023-10-03T10:12:56.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.460+0000 7f9d4e069700 1 -- 172.21.15.146:0/2581125738 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d48130ea0 con 0x7f9d48131980 2023-10-03T10:12:56.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.460+0000 7f9d4e069700 1 -- 172.21.15.146:0/2581125738 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4812e640 con 0x7f9d48131980 2023-10-03T10:12:56.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.460+0000 7f349b74e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34940a08e0 0x7f349411fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.460+0000 7f349b74e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f34940a1460 0x7f3494120120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.460+0000 7f349b74e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3494133a70 0x7f3494120660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.460+0000 7f349b74e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349409a350 con 0x7f3494133a70 2023-10-03T10:12:56.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.460+0000 7f349b74e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3494121900 con 0x7f34940a08e0 2023-10-03T10:12:56.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.460+0000 7f349b74e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3494123420 con 0x7f34940a1460 2023-10-03T10:12:56.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.460+0000 7f34994ea700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34940a08e0 0x7f349411fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.461+0000 7f34994ea700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34940a08e0 0x7f349411fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53210/0 (socket says 172.21.15.146:53210) 2023-10-03T10:12:56.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.461+0000 7f34994ea700 1 -- 172.21.15.146:0/6480891 learned_addr learned my addr 172.21.15.146:0/6480891 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:56.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.461+0000 7f3498ce9700 1 --2- 172.21.15.146:0/6480891 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f34940a1460 0x7f3494120120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.461+0000 7f34994ea700 1 -- 172.21.15.146:0/6480891 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f34940a1460 msgr2=0x7f3494120120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.461+0000 7f34994ea700 1 --2- 172.21.15.146:0/6480891 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f34940a1460 0x7f3494120120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.461+0000 7f34994ea700 1 -- 172.21.15.146:0/6480891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3494133a70 msgr2=0x7f3494120660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.461+0000 7f34994ea700 1 --2- 172.21.15.146:0/6480891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3494133a70 0x7f3494120660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.461+0000 7f34994ea700 1 -- 172.21.15.146:0/6480891 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c009b30 con 0x7f34940a08e0 2023-10-03T10:12:56.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.461+0000 7f3498ce9700 1 --2- 172.21.15.146:0/6480891 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f34940a1460 0x7f3494120120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:56.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.461+0000 7f9d4e069700 1 -- 172.21.15.146:0/2581125738 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d48121000 con 0x7f9d48131980 2023-10-03T10:12:56.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.461+0000 7f34994ea700 1 --2- 172.21.15.146:0/6480891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34940a08e0 0x7f349411fbe0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f349000b520 tx=0x7f349000b830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:56.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.461+0000 7f3489ffb700 1 -- 172.21.15.146:0/6480891 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490005aa0 con 0x7f34940a08e0 2023-10-03T10:12:56.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.462+0000 7f9d2ffff700 1 -- 172.21.15.146:0/2581125738 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d40006ba0 con 0x7f9d48131980 2023-10-03T10:12:56.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.462+0000 7f9d2ffff700 1 -- 172.21.15.146:0/2581125738 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9d4003e9b0 con 0x7f9d48131980 2023-10-03T10:12:56.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.461+0000 7f3489ffb700 1 -- 172.21.15.146:0/6480891 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3490005c20 con 0x7f34940a08e0 2023-10-03T10:12:56.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.461+0000 7f349b74e700 1 -- 172.21.15.146:0/6480891 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3494130700 con 0x7f34940a08e0 2023-10-03T10:12:56.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.462+0000 7f3489ffb700 1 -- 172.21.15.146:0/6480891 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490011630 con 0x7f34940a08e0 2023-10-03T10:12:56.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.462+0000 7f349b74e700 1 -- 172.21.15.146:0/6480891 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3494123e90 con 0x7f34940a08e0 2023-10-03T10:12:56.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.462+0000 7f349b74e700 1 -- 172.21.15.146:0/6480891 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3494130b30 con 0x7f34940a08e0 2023-10-03T10:12:56.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.463+0000 7f3489ffb700 1 -- 172.21.15.146:0/6480891 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3490011790 con 0x7f34940a08e0 2023-10-03T10:12:56.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.463+0000 7f3489ffb700 1 -- 172.21.15.146:0/6480891 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f349003faa0 con 0x7f34940a08e0 2023-10-03T10:12:56.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.467+0000 7f9d2ffff700 1 -- 172.21.15.146:0/2581125738 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d40005580 con 0x7f9d48131980 2023-10-03T10:12:56.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.468+0000 7f3489ffb700 1 -- 172.21.15.146:0/6480891 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3490010de0 con 0x7f34940a08e0 2023-10-03T10:12:56.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.478+0000 7f44e056d700 1 Processor -- start 2023-10-03T10:12:56.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.478+0000 7f44e056d700 1 -- start start 2023-10-03T10:12:56.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.479+0000 7f44e056d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44d8133ad0 0x7f44d8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.479+0000 7f44e056d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f44d81300a0 0x7f44d81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.479+0000 7f44e056d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44d806b2d0 con 0x7f44d81309f0 2023-10-03T10:12:56.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.479+0000 7f44e056d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d8133610 con 0x7f44d81300a0 2023-10-03T10:12:56.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.479+0000 7f44e056d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44d809a500 con 0x7f44d8133ad0 2023-10-03T10:12:56.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.479+0000 7f44deb0a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f44d81309f0 0x7f44d813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39930/0 (socket says 172.21.15.146:39930) 2023-10-03T10:12:56.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.479+0000 7f44deb0a700 1 -- 172.21.15.146:0/538720789 learned_addr learned my addr 172.21.15.146:0/538720789 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:56.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.479+0000 7f44ddb08700 1 --2- 172.21.15.146:0/538720789 >> v2:172.21.15.146:3300/0 conn(0x7f44d81300a0 0x7f44d81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.479+0000 7f44de309700 1 --2- 172.21.15.146:0/538720789 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44d8133ad0 0x7f44d8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.479+0000 7f44dd307700 1 -- 172.21.15.146:0/538720789 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947847085 0 0) 0x7f44d806b2d0 con 0x7f44d81309f0 2023-10-03T10:12:56.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.480+0000 7f44dd307700 1 -- 172.21.15.146:0/538720789 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44c40035b0 con 0x7f44d81309f0 2023-10-03T10:12:56.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.480+0000 7f44ddb08700 1 -- 172.21.15.146:0/538720789 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44d8133ad0 msgr2=0x7f44d8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:56.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.480+0000 7f44ddb08700 1 --2- 172.21.15.146:0/538720789 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44d8133ad0 0x7f44d8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.480+0000 7f44ddb08700 1 -- 172.21.15.146:0/538720789 >> v1:172.21.15.146:6789/0 conn(0x7f44d81309f0 legacy=0x7f44d813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.480+0000 7f44ddb08700 1 -- 172.21.15.146:0/538720789 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d81338b0 con 0x7f44d81300a0 2023-10-03T10:12:56.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.480+0000 7f44ddb08700 1 --2- 172.21.15.146:0/538720789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44d81300a0 0x7f44d81304b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f44c8009840 tx=0x7f44c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4eefb7f17ddb8c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:56.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.480+0000 7f44dd307700 1 -- 172.21.15.146:0/538720789 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c8011830 con 0x7f44d81300a0 2023-10-03T10:12:56.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.480+0000 7f44dd307700 1 -- 172.21.15.146:0/538720789 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c8011990 con 0x7f44d81300a0 2023-10-03T10:12:56.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.480+0000 7f44dd307700 1 -- 172.21.15.146:0/538720789 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c8011d20 con 0x7f44d81300a0 2023-10-03T10:12:56.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.481+0000 7f44e056d700 1 -- 172.21.15.146:0/538720789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44d81300a0 msgr2=0x7f44d81304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.481+0000 7f44e056d700 1 --2- 172.21.15.146:0/538720789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44d81300a0 0x7f44d81304b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f44c8009840 tx=0x7f44c8009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:56.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.481+0000 7f44e056d700 1 -- 172.21.15.146:0/538720789 shutdown_connections 2023-10-03T10:12:56.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.481+0000 7f44e056d700 1 --2- 172.21.15.146:0/538720789 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44d8133ad0 0x7f44d8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.481+0000 7f44e056d700 1 --2- 172.21.15.146:0/538720789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44d81300a0 0x7f44d81304b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.481+0000 7f44e056d700 1 -- 172.21.15.146:0/538720789 >> 172.21.15.146:0/538720789 conn(0x7f44d8099c40 msgr2=0x7f44d80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.481+0000 7f44e056d700 1 -- 172.21.15.146:0/538720789 shutdown_connections 2023-10-03T10:12:56.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.481+0000 7f44e056d700 1 -- 172.21.15.146:0/538720789 wait complete. 2023-10-03T10:12:56.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.483+0000 7f44e056d700 1 Processor -- start 2023-10-03T10:12:56.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.483+0000 7f44e056d700 1 -- start start 2023-10-03T10:12:56.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.483+0000 7f44e056d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44d81300a0 0x7f44d81cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.483+0000 7f44e056d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44d81309f0 0x7f44d81cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.483+0000 7f44e056d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44d8133ad0 0x7f44d81cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.483+0000 7f44e056d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d806ff20 con 0x7f44d8133ad0 2023-10-03T10:12:56.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.483+0000 7f44e056d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d8070190 con 0x7f44d81309f0 2023-10-03T10:12:56.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.483+0000 7f44e056d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44d806fbf0 con 0x7f44d81300a0 2023-10-03T10:12:56.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.483+0000 7f44deb0a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44d8133ad0 0x7f44d81cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.483+0000 7f44ddb08700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44d81309f0 0x7f44d81cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.483+0000 7f44deb0a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44d8133ad0 0x7f44d81cd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37806/0 (socket says 172.21.15.146:37806) 2023-10-03T10:12:56.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.483+0000 7f44deb0a700 1 -- 172.21.15.146:0/3366139617 learned_addr learned my addr 172.21.15.146:0/3366139617 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:56.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.484+0000 7f44de309700 1 --2- 172.21.15.146:0/3366139617 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44d81300a0 0x7f44d81cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.484+0000 7f44ddb08700 1 -- 172.21.15.146:0/3366139617 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44d81300a0 msgr2=0x7f44d81cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.484+0000 7f44ddb08700 1 --2- 172.21.15.146:0/3366139617 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44d81300a0 0x7f44d81cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.484+0000 7f44ddb08700 1 -- 172.21.15.146:0/3366139617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44d8133ad0 msgr2=0x7f44d81cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.484+0000 7f44ddb08700 1 --2- 172.21.15.146:0/3366139617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44d8133ad0 0x7f44d81cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.484+0000 7f44ddb08700 1 -- 172.21.15.146:0/3366139617 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c80094a0 con 0x7f44d81309f0 2023-10-03T10:12:56.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.484+0000 7f44de309700 1 --2- 172.21.15.146:0/3366139617 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44d81300a0 0x7f44d81cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:56.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.484+0000 7f44deb0a700 1 --2- 172.21.15.146:0/3366139617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44d8133ad0 0x7f44d81cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:56.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.484+0000 7f44ddb08700 1 --2- 172.21.15.146:0/3366139617 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44d81309f0 0x7f44d81cccd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f44c8016000 tx=0x7f44c8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:56.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.484+0000 7f44ceffd700 1 -- 172.21.15.146:0/3366139617 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c8004380 con 0x7f44d81309f0 2023-10-03T10:12:56.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.484+0000 7f44ceffd700 1 -- 172.21.15.146:0/3366139617 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c801f070 con 0x7f44d81309f0 2023-10-03T10:12:56.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.484+0000 7f44ceffd700 1 -- 172.21.15.146:0/3366139617 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c80036a0 con 0x7f44d81309f0 2023-10-03T10:12:56.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.484+0000 7f44e056d700 1 -- 172.21.15.146:0/3366139617 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d8070a90 con 0x7f44d81309f0 2023-10-03T10:12:56.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.484+0000 7f44e056d700 1 -- 172.21.15.146:0/3366139617 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d812dd00 con 0x7f44d81309f0 2023-10-03T10:12:56.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.485+0000 7f44ceffd700 1 -- 172.21.15.146:0/3366139617 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f44c8021030 con 0x7f44d81309f0 2023-10-03T10:12:56.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.486+0000 7f44e056d700 1 -- 172.21.15.146:0/3366139617 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d804f2a0 con 0x7f44d81309f0 2023-10-03T10:12:56.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.486+0000 7f44ceffd700 1 -- 172.21.15.146:0/3366139617 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f44c8040720 con 0x7f44d81309f0 2023-10-03T10:12:56.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.495+0000 7f44ceffd700 1 -- 172.21.15.146:0/3366139617 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44c80239c0 con 0x7f44d81309f0 2023-10-03T10:12:56.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.648+0000 7f9b9c5c5700 1 -- 172.21.15.146:0/3969655743 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9b9411e180 con 0x7f9b94135f20 2023-10-03T10:12:56.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.649+0000 7f9b8affd700 1 -- 172.21.15.146:0/3969655743 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9b8c033090 con 0x7f9b94135f20 2023-10-03T10:12:56.649 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:56.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.651+0000 7f9b9c5c5700 1 -- 172.21.15.146:0/3969655743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b94135f20 msgr2=0x7f9b9411b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.651+0000 7f9b9c5c5700 1 --2- 172.21.15.146:0/3969655743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b94135f20 0x7f9b9411b020 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c012000 tx=0x7f9b8c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.651+0000 7f9b9c5c5700 1 -- 172.21.15.146:0/3969655743 shutdown_connections 2023-10-03T10:12:56.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.651+0000 7f9b9c5c5700 1 --2- 172.21.15.146:0/3969655743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b94135f20 0x7f9b9411b020 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.651+0000 7f9b9c5c5700 1 --2- 172.21.15.146:0/3969655743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b9409d860 0x7f9b9411a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.651+0000 7f9b9c5c5700 1 --2- 172.21.15.146:0/3969655743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b9409e340 0x7f9b9411aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.651+0000 7f9b9c5c5700 1 -- 172.21.15.146:0/3969655743 >> 172.21.15.146:0/3969655743 conn(0x7f9b94099c40 msgr2=0x7f9b94070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.651+0000 7f9b9c5c5700 1 -- 172.21.15.146:0/3969655743 shutdown_connections 2023-10-03T10:12:56.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.651+0000 7f9b9c5c5700 1 -- 172.21.15.146:0/3969655743 wait complete. 2023-10-03T10:12:56.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.661+0000 7f9d4e069700 1 -- 172.21.15.146:0/2581125738 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9d48121000 con 0x7f9d48131980 2023-10-03T10:12:56.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.661+0000 7f9d2ffff700 1 -- 172.21.15.146:0/2581125738 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9d40017030 con 0x7f9d48131980 2023-10-03T10:12:56.661 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:56.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:56.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.664+0000 7f9d4e069700 1 -- 172.21.15.146:0/2581125738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d48131980 msgr2=0x7f9d4811e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.664+0000 7f9d4e069700 1 --2- 172.21.15.146:0/2581125738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d48131980 0x7f9d4811e630 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9d4000c7b0 tx=0x7f9d4000cb70 comp rx=0 tx=0).stop 2023-10-03T10:12:56.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.664+0000 7f9d4e069700 1 -- 172.21.15.146:0/2581125738 shutdown_connections 2023-10-03T10:12:56.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.664+0000 7f9d4e069700 1 --2- 172.21.15.146:0/2581125738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d48131980 0x7f9d4811e630 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.664+0000 7f9d4e069700 1 --2- 172.21.15.146:0/2581125738 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d4809bc70 0x7f9d4811dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.664+0000 7f9d4e069700 1 --2- 172.21.15.146:0/2581125738 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d4809c5c0 0x7f9d4811e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.664+0000 7f9d4e069700 1 -- 172.21.15.146:0/2581125738 >> 172.21.15.146:0/2581125738 conn(0x7f9d480a2980 msgr2=0x7f9d4809d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.664+0000 7f9d4e069700 1 -- 172.21.15.146:0/2581125738 shutdown_connections 2023-10-03T10:12:56.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.664+0000 7f9d4e069700 1 -- 172.21.15.146:0/2581125738 wait complete. 2023-10-03T10:12:56.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.671+0000 7f349b74e700 1 -- 172.21.15.146:0/6480891 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f349404f2a0 con 0x7f34940a08e0 2023-10-03T10:12:56.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.671+0000 7f3489ffb700 1 -- 172.21.15.146:0/6480891 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3490010380 con 0x7f34940a08e0 2023-10-03T10:12:56.671 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:56.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.674+0000 7f349b74e700 1 -- 172.21.15.146:0/6480891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34940a08e0 msgr2=0x7f349411fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.674+0000 7f349b74e700 1 --2- 172.21.15.146:0/6480891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34940a08e0 0x7f349411fbe0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f349000b520 tx=0x7f349000b830 comp rx=0 tx=0).stop 2023-10-03T10:12:56.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.674+0000 7f349b74e700 1 -- 172.21.15.146:0/6480891 shutdown_connections 2023-10-03T10:12:56.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.674+0000 7f349b74e700 1 --2- 172.21.15.146:0/6480891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3494133a70 0x7f3494120660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.674+0000 7f349b74e700 1 --2- 172.21.15.146:0/6480891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34940a08e0 0x7f349411fbe0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.674+0000 7f349b74e700 1 --2- 172.21.15.146:0/6480891 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f34940a1460 0x7f3494120120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.674+0000 7f349b74e700 1 -- 172.21.15.146:0/6480891 >> 172.21.15.146:0/6480891 conn(0x7f34940a2980 msgr2=0x7f3494131540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.675+0000 7f349b74e700 1 -- 172.21.15.146:0/6480891 shutdown_connections 2023-10-03T10:12:56.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.675+0000 7f349b74e700 1 -- 172.21.15.146:0/6480891 wait complete. 2023-10-03T10:12:56.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:56.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:56.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.691+0000 7f44e056d700 1 -- 172.21.15.146:0/3366139617 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f44d806c3b0 con 0x7f44d81309f0 2023-10-03T10:12:56.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.691+0000 7f44ceffd700 1 -- 172.21.15.146:0/3366139617 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f44c8015070 con 0x7f44d81309f0 2023-10-03T10:12:56.691 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:56.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.693+0000 7f44e056d700 1 -- 172.21.15.146:0/3366139617 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44d81309f0 msgr2=0x7f44d81cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.693+0000 7f44e056d700 1 --2- 172.21.15.146:0/3366139617 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44d81309f0 0x7f44d81cccd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f44c8016000 tx=0x7f44c8004750 comp rx=0 tx=0).stop 2023-10-03T10:12:56.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.693+0000 7f44e056d700 1 -- 172.21.15.146:0/3366139617 shutdown_connections 2023-10-03T10:12:56.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.693+0000 7f44e056d700 1 --2- 172.21.15.146:0/3366139617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44d8133ad0 0x7f44d81cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.693+0000 7f44e056d700 1 --2- 172.21.15.146:0/3366139617 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44d81300a0 0x7f44d81cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.693+0000 7f44e056d700 1 --2- 172.21.15.146:0/3366139617 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44d81309f0 0x7f44d81cccd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.693+0000 7f44e056d700 1 -- 172.21.15.146:0/3366139617 >> 172.21.15.146:0/3366139617 conn(0x7f44d8099c40 msgr2=0x7f44d8132290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.693+0000 7f44e056d700 1 -- 172.21.15.146:0/3366139617 shutdown_connections 2023-10-03T10:12:56.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:56.693+0000 7f44e056d700 1 -- 172.21.15.146:0/3366139617 wait complete. 2023-10-03T10:12:56.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:57.664 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:57.677 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:57.688 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:57.705 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:57.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.804+0000 7f7076d95700 1 Processor -- start 2023-10-03T10:12:57.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.804+0000 7f7076d95700 1 -- start start 2023-10-03T10:12:57.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.805+0000 7f7076d95700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7070099e20 0x7f707009a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.805+0000 7f7076d95700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f707009a730 0x7f7070130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.805+0000 7f7076d95700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7070130890 0x7f7070130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.805+0000 7f7076d95700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f707009bf50 con 0x7f707009a730 2023-10-03T10:12:57.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.805+0000 7f7076d95700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7070099a60 con 0x7f7070099e20 2023-10-03T10:12:57.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.805+0000 7f7076d95700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f707009b230 con 0x7f7070130890 2023-10-03T10:12:57.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.805+0000 7f7074b31700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7070099e20 0x7f707009a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.805+0000 7f7074b31700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7070099e20 0x7f707009a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53222/0 (socket says 172.21.15.146:53222) 2023-10-03T10:12:57.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.805+0000 7f7074b31700 1 -- 172.21.15.146:0/3815810744 learned_addr learned my addr 172.21.15.146:0/3815810744 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:57.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.805+0000 7f7075332700 1 --2- 172.21.15.146:0/3815810744 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7070130890 0x7f7070130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.805+0000 7f7074b31700 1 -- 172.21.15.146:0/3815810744 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7070130890 msgr2=0x7f7070130d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.805+0000 7f7074b31700 1 --2- 172.21.15.146:0/3815810744 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7070130890 0x7f7070130d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.805+0000 7f7074b31700 1 -- 172.21.15.146:0/3815810744 >> v2:172.21.15.146:3300/0 conn(0x7f707009a730 msgr2=0x7f7070130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.805+0000 7f7074b31700 1 --2- 172.21.15.146:0/3815810744 >> v2:172.21.15.146:3300/0 conn(0x7f707009a730 0x7f7070130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.805+0000 7f7074b31700 1 -- 172.21.15.146:0/3815810744 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707009bb90 con 0x7f7070099e20 2023-10-03T10:12:57.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.805+0000 7f7075332700 1 --2- 172.21.15.146:0/3815810744 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7070130890 0x7f7070130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:57.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.806+0000 7f7074b31700 1 --2- 172.21.15.146:0/3815810744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7070099e20 0x7f707009a1f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f70640098f0 tx=0x7f7064009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1eb1864a3709522c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.806+0000 7f706f7fe700 1 -- 172.21.15.146:0/3815810744 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7064005e30 con 0x7f7070099e20 2023-10-03T10:12:57.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.806+0000 7f706f7fe700 1 -- 172.21.15.146:0/3815810744 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7064004030 con 0x7f7070099e20 2023-10-03T10:12:57.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.806+0000 7f706f7fe700 1 -- 172.21.15.146:0/3815810744 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70640043e0 con 0x7f7070099e20 2023-10-03T10:12:57.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.807+0000 7f7076d95700 1 -- 172.21.15.146:0/3815810744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7070099e20 msgr2=0x7f707009a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.807+0000 7f7076d95700 1 --2- 172.21.15.146:0/3815810744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7070099e20 0x7f707009a1f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f70640098f0 tx=0x7f7064009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:57.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.807+0000 7f7076d95700 1 -- 172.21.15.146:0/3815810744 shutdown_connections 2023-10-03T10:12:57.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.807+0000 7f7076d95700 1 --2- 172.21.15.146:0/3815810744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7070099e20 0x7f707009a1f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.807+0000 7f7076d95700 1 --2- 172.21.15.146:0/3815810744 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7070130890 0x7f7070130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.807+0000 7f7076d95700 1 --2- 172.21.15.146:0/3815810744 >> v2:172.21.15.146:3300/0 conn(0x7f707009a730 0x7f7070130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.807+0000 7f7076d95700 1 -- 172.21.15.146:0/3815810744 >> 172.21.15.146:0/3815810744 conn(0x7f70700a2980 msgr2=0x7f70700a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.807+0000 7f7076d95700 1 -- 172.21.15.146:0/3815810744 shutdown_connections 2023-10-03T10:12:57.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.807+0000 7f7076d95700 1 -- 172.21.15.146:0/3815810744 wait complete. 2023-10-03T10:12:57.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.808+0000 7f7076d95700 1 Processor -- start 2023-10-03T10:12:57.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.808+0000 7f7076d95700 1 -- start start 2023-10-03T10:12:57.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.809+0000 7f7076d95700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7070099e20 0x7f7070134240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.809+0000 7f7076d95700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f707009a730 0x7f7070134780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.809+0000 7f7076d95700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7070130890 0x7f7070134cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.809+0000 7f7076d95700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7070118f00 con 0x7f7070130890 2023-10-03T10:12:57.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.809+0000 7f7076d95700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707009b470 con 0x7f707009a730 2023-10-03T10:12:57.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.809+0000 7f7076d95700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7070136f70 con 0x7f7070099e20 2023-10-03T10:12:57.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.809+0000 7f706ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f707009a730 0x7f7070134780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.810+0000 7f706ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f707009a730 0x7f7070134780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53232/0 (socket says 172.21.15.146:53232) 2023-10-03T10:12:57.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.810+0000 7f706ffff700 1 -- 172.21.15.146:0/2885640161 learned_addr learned my addr 172.21.15.146:0/2885640161 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:57.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.810+0000 7f7074b31700 1 --2- 172.21.15.146:0/2885640161 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7070099e20 0x7f7070134240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.810+0000 7f7075332700 1 --2- 172.21.15.146:0/2885640161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7070130890 0x7f7070134cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.810+0000 7f706ffff700 1 -- 172.21.15.146:0/2885640161 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7070099e20 msgr2=0x7f7070134240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.810+0000 7f706ffff700 1 --2- 172.21.15.146:0/2885640161 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7070099e20 0x7f7070134240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.810+0000 7f706ffff700 1 -- 172.21.15.146:0/2885640161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7070130890 msgr2=0x7f7070134cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.810+0000 7f706ffff700 1 --2- 172.21.15.146:0/2885640161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7070130890 0x7f7070134cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.810+0000 7f706ffff700 1 -- 172.21.15.146:0/2885640161 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7068009a70 con 0x7f707009a730 2023-10-03T10:12:57.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.810+0000 7f7074b31700 1 --2- 172.21.15.146:0/2885640161 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7070099e20 0x7f7070134240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:57.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.810+0000 7f706ffff700 1 --2- 172.21.15.146:0/2885640161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f707009a730 0x7f7070134780 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f705c00b500 tx=0x7f705c00b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.810+0000 7f706d7fa700 1 -- 172.21.15.146:0/2885640161 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c011830 con 0x7f707009a730 2023-10-03T10:12:57.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.810+0000 7f706d7fa700 1 -- 172.21.15.146:0/2885640161 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705c0119b0 con 0x7f707009a730 2023-10-03T10:12:57.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.810+0000 7f706d7fa700 1 -- 172.21.15.146:0/2885640161 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c011d60 con 0x7f707009a730 2023-10-03T10:12:57.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.810+0000 7f7076d95700 1 -- 172.21.15.146:0/2885640161 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7064009500 con 0x7f707009a730 2023-10-03T10:12:57.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.810+0000 7f7076d95700 1 -- 172.21.15.146:0/2885640161 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707012def0 con 0x7f707009a730 2023-10-03T10:12:57.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.812+0000 7f7076d95700 1 -- 172.21.15.146:0/2885640161 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7070119070 con 0x7f707009a730 2023-10-03T10:12:57.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.812+0000 7f706d7fa700 1 -- 172.21.15.146:0/2885640161 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f705c01a400 con 0x7f707009a730 2023-10-03T10:12:57.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.813+0000 7f706d7fa700 1 -- 172.21.15.146:0/2885640161 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f705c03fc00 con 0x7f707009a730 2023-10-03T10:12:57.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.821+0000 7f706d7fa700 1 -- 172.21.15.146:0/2885640161 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f705c01ae60 con 0x7f707009a730 2023-10-03T10:12:57.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.842+0000 7f9f218d1700 1 Processor -- start 2023-10-03T10:12:57.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.842+0000 7f9f218d1700 1 -- start start 2023-10-03T10:12:57.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.842+0000 7f9f218d1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f1c06a770 0x7f9f1c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.842+0000 7f9f218d1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f1c09dec0 0x7f9f1c06b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.842+0000 7f9f218d1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f1c06b5c0 con 0x7f9f1c131a00 2023-10-03T10:12:57.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.842+0000 7f9f218d1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c06e900 con 0x7f9f1c06a770 2023-10-03T10:12:57.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.842+0000 7f9f218d1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c09d180 con 0x7f9f1c09dec0 2023-10-03T10:12:57.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.843+0000 7f9f1a7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f1c09dec0 0x7f9f1c06b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.843+0000 7f9f1b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9f1c131a00 0x7f9f1c131e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39936/0 (socket says 172.21.15.146:39936) 2023-10-03T10:12:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.843+0000 7f9f1b7fe700 1 -- 172.21.15.146:0/803943820 learned_addr learned my addr 172.21.15.146:0/803943820 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.843+0000 7f9f1affd700 1 --2- 172.21.15.146:0/803943820 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f1c06a770 0x7f9f1c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.843+0000 7f9f19ffb700 1 -- 172.21.15.146:0/803943820 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5817354 0 0) 0x7f9f1c06b5c0 con 0x7f9f1c131a00 2023-10-03T10:12:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.843+0000 7f9f1a7fc700 1 -- 172.21.15.146:0/803943820 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f1c06a770 msgr2=0x7f9f1c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.843+0000 7f9f1a7fc700 1 --2- 172.21.15.146:0/803943820 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f1c06a770 0x7f9f1c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.843+0000 7f9f1a7fc700 1 -- 172.21.15.146:0/803943820 >> v1:172.21.15.146:6789/0 conn(0x7f9f1c131a00 legacy=0x7f9f1c131e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.843+0000 7f9f1a7fc700 1 -- 172.21.15.146:0/803943820 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1c09e780 con 0x7f9f1c09dec0 2023-10-03T10:12:57.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.844+0000 7f9f1a7fc700 1 --2- 172.21.15.146:0/803943820 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f1c09dec0 0x7f9f1c06b080 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009870 tx=0x7f9f10009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9a9e193598d1ee5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.844+0000 7f9f19ffb700 1 -- 172.21.15.146:0/803943820 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f10011830 con 0x7f9f1c09dec0 2023-10-03T10:12:57.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.844+0000 7f9f19ffb700 1 -- 172.21.15.146:0/803943820 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f10011990 con 0x7f9f1c09dec0 2023-10-03T10:12:57.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.844+0000 7f9f19ffb700 1 -- 172.21.15.146:0/803943820 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f10011d20 con 0x7f9f1c09dec0 2023-10-03T10:12:57.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.844+0000 7f9f218d1700 1 -- 172.21.15.146:0/803943820 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f1c09dec0 msgr2=0x7f9f1c06b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.844+0000 7f9f218d1700 1 --2- 172.21.15.146:0/803943820 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f1c09dec0 0x7f9f1c06b080 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009870 tx=0x7f9f10009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:57.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.844+0000 7f9f218d1700 1 -- 172.21.15.146:0/803943820 shutdown_connections 2023-10-03T10:12:57.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.844+0000 7f9f218d1700 1 --2- 172.21.15.146:0/803943820 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f1c06a770 0x7f9f1c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.844+0000 7f9f218d1700 1 --2- 172.21.15.146:0/803943820 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f1c09dec0 0x7f9f1c06b080 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.845+0000 7f9f218d1700 1 -- 172.21.15.146:0/803943820 >> 172.21.15.146:0/803943820 conn(0x7f9f1c099c40 msgr2=0x7f9f1c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.845+0000 7f9f218d1700 1 -- 172.21.15.146:0/803943820 shutdown_connections 2023-10-03T10:12:57.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.845+0000 7f9f218d1700 1 -- 172.21.15.146:0/803943820 wait complete. 2023-10-03T10:12:57.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.846+0000 7f9f218d1700 1 Processor -- start 2023-10-03T10:12:57.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.846+0000 7f9f218d1700 1 -- start start 2023-10-03T10:12:57.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.846+0000 7f9f218d1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f1c06a770 0x7f9f1c1291b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.846+0000 7f9f218d1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f1c09dec0 0x7f9f1c1296f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.846+0000 7f9f218d1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f1c131a00 0x7f9f1c1c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.846+0000 7f9f218d1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c128cf0 con 0x7f9f1c131a00 2023-10-03T10:12:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.846+0000 7f9f218d1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c12aa90 con 0x7f9f1c06a770 2023-10-03T10:12:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.847+0000 7f9f218d1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c12b2f0 con 0x7f9f1c09dec0 2023-10-03T10:12:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.847+0000 7f9f1b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f1c131a00 0x7f9f1c1c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.847+0000 7f9f1b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f1c131a00 0x7f9f1c1c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37824/0 (socket says 172.21.15.146:37824) 2023-10-03T10:12:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.847+0000 7f9f1b7fe700 1 -- 172.21.15.146:0/756236476 learned_addr learned my addr 172.21.15.146:0/756236476 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.847+0000 7f9f1affd700 1 --2- 172.21.15.146:0/756236476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f1c06a770 0x7f9f1c1291b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.847+0000 7f9f1a7fc700 1 --2- 172.21.15.146:0/756236476 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f1c09dec0 0x7f9f1c1296f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.847+0000 7f9f1affd700 1 -- 172.21.15.146:0/756236476 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f1c09dec0 msgr2=0x7f9f1c1296f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.847+0000 7f9f1affd700 1 --2- 172.21.15.146:0/756236476 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f1c09dec0 0x7f9f1c1296f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.847+0000 7f9f1affd700 1 -- 172.21.15.146:0/756236476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f1c131a00 msgr2=0x7f9f1c1c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.847+0000 7f9f1affd700 1 --2- 172.21.15.146:0/756236476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f1c131a00 0x7f9f1c1c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.847+0000 7f9f1affd700 1 -- 172.21.15.146:0/756236476 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f100094a0 con 0x7f9f1c06a770 2023-10-03T10:12:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.847+0000 7f9f1affd700 1 --2- 172.21.15.146:0/756236476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f1c06a770 0x7f9f1c1291b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00e900 tx=0x7f9f0c00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.847+0000 7f9f03fff700 1 -- 172.21.15.146:0/756236476 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c013680 con 0x7f9f1c06a770 2023-10-03T10:12:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.847+0000 7f9f03fff700 1 -- 172.21.15.146:0/756236476 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0c0137e0 con 0x7f9f1c06a770 2023-10-03T10:12:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.847+0000 7f9f218d1700 1 -- 172.21.15.146:0/756236476 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f1c12b5b0 con 0x7f9f1c06a770 2023-10-03T10:12:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.848+0000 7f9f03fff700 1 -- 172.21.15.146:0/756236476 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c013b50 con 0x7f9f1c06a770 2023-10-03T10:12:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.848+0000 7f9f218d1700 1 -- 172.21.15.146:0/756236476 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f1c0710e0 con 0x7f9f1c06a770 2023-10-03T10:12:57.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.849+0000 7f9f03fff700 1 -- 172.21.15.146:0/756236476 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f0c013cb0 con 0x7f9f1c06a770 2023-10-03T10:12:57.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.849+0000 7f9f03fff700 1 -- 172.21.15.146:0/756236476 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9f0c03f650 con 0x7f9f1c06a770 2023-10-03T10:12:57.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.849+0000 7f9f218d1700 1 -- 172.21.15.146:0/756236476 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f1c04f2a0 con 0x7f9f1c06a770 2023-10-03T10:12:57.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.850+0000 7fef8101e700 1 Processor -- start 2023-10-03T10:12:57.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.850+0000 7fef8101e700 1 -- start start 2023-10-03T10:12:57.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.851+0000 7fef8101e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fef7c133ad0 0x7fef7c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.851+0000 7fef8101e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef7c1300a0 0x7fef7c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.851+0000 7fef8101e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef7c06b2d0 con 0x7fef7c1309f0 2023-10-03T10:12:57.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.851+0000 7fef8101e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7c133610 con 0x7fef7c133ad0 2023-10-03T10:12:57.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.851+0000 7fef8101e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c09a500 con 0x7fef7c1300a0 2023-10-03T10:12:57.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.851+0000 7fef7a59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef7c1300a0 0x7fef7c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.851+0000 7fef7a59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef7c1300a0 0x7fef7c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51654/0 (socket says 172.21.15.146:51654) 2023-10-03T10:12:57.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.851+0000 7fef7ad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fef7c133ad0 0x7fef7c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.851+0000 7fef7a59c700 1 -- 172.21.15.146:0/2441443816 learned_addr learned my addr 172.21.15.146:0/2441443816 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:57.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.852+0000 7fef7a59c700 1 -- 172.21.15.146:0/2441443816 >> v2:172.21.15.146:3300/0 conn(0x7fef7c133ad0 msgr2=0x7fef7c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.852+0000 7fef7a59c700 1 --2- 172.21.15.146:0/2441443816 >> v2:172.21.15.146:3300/0 conn(0x7fef7c133ad0 0x7fef7c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.852+0000 7fef7a59c700 1 -- 172.21.15.146:0/2441443816 >> v1:172.21.15.146:6789/0 conn(0x7fef7c1309f0 legacy=0x7fef7c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.852+0000 7fef7a59c700 1 -- 172.21.15.146:0/2441443816 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c1338b0 con 0x7fef7c1300a0 2023-10-03T10:12:57.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.852+0000 7fef7ad9d700 1 --2- 172.21.15.146:0/2441443816 >> v2:172.21.15.146:3300/0 conn(0x7fef7c133ad0 0x7fef7c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:57.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.852+0000 7fef7a59c700 1 --2- 172.21.15.146:0/2441443816 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef7c1300a0 0x7fef7c1304b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fef700098f0 tx=0x7fef70009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=109a3ee13ac3a2b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.852+0000 7fef79d9b700 1 -- 172.21.15.146:0/2441443816 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70011830 con 0x7fef7c1300a0 2023-10-03T10:12:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.852+0000 7fef79d9b700 1 -- 172.21.15.146:0/2441443816 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef70011990 con 0x7fef7c1300a0 2023-10-03T10:12:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.852+0000 7fef79d9b700 1 -- 172.21.15.146:0/2441443816 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70011d20 con 0x7fef7c1300a0 2023-10-03T10:12:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.852+0000 7fef8101e700 1 -- 172.21.15.146:0/2441443816 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef7c1300a0 msgr2=0x7fef7c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.852+0000 7fef8101e700 1 --2- 172.21.15.146:0/2441443816 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef7c1300a0 0x7fef7c1304b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fef700098f0 tx=0x7fef70009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.853+0000 7fef8101e700 1 -- 172.21.15.146:0/2441443816 shutdown_connections 2023-10-03T10:12:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.853+0000 7fef8101e700 1 --2- 172.21.15.146:0/2441443816 >> v2:172.21.15.146:3300/0 conn(0x7fef7c133ad0 0x7fef7c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.853+0000 7fef8101e700 1 --2- 172.21.15.146:0/2441443816 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef7c1300a0 0x7fef7c1304b0 secure :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fef700098f0 tx=0x7fef70009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.853+0000 7fef8101e700 1 -- 172.21.15.146:0/2441443816 >> 172.21.15.146:0/2441443816 conn(0x7fef7c099c40 msgr2=0x7fef7c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.853+0000 7fef8101e700 1 -- 172.21.15.146:0/2441443816 shutdown_connections 2023-10-03T10:12:57.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.853+0000 7fef8101e700 1 -- 172.21.15.146:0/2441443816 wait complete. 2023-10-03T10:12:57.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.854+0000 7fef8101e700 1 Processor -- start 2023-10-03T10:12:57.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.854+0000 7fef8101e700 1 -- start start 2023-10-03T10:12:57.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.854+0000 7f3e93d32700 1 Processor -- start 2023-10-03T10:12:57.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.855+0000 7f3e93d32700 1 -- start start 2023-10-03T10:12:57.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.854+0000 7fef8101e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef7c1309f0 0x7fef7c071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.854+0000 7fef8101e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef7c133ad0 0x7fef7c071770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.854+0000 7fef8101e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef7c071cb0 0x7fef7c1db750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.854+0000 7fef8101e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c0a1930 con 0x7fef7c071cb0 2023-10-03T10:12:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.854+0000 7fef8101e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c070650 con 0x7fef7c1309f0 2023-10-03T10:12:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.854+0000 7fef8101e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c072630 con 0x7fef7c133ad0 2023-10-03T10:12:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.855+0000 7fef7ad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef7c1309f0 0x7fef7c071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.855+0000 7fef7a59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef7c133ad0 0x7fef7c071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.855+0000 7fef7ad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef7c1309f0 0x7fef7c071230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53258/0 (socket says 172.21.15.146:53258) 2023-10-03T10:12:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.855+0000 7fef7ad9d700 1 -- 172.21.15.146:0/2763606963 learned_addr learned my addr 172.21.15.146:0/2763606963 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.855+0000 7fef7a59c700 1 -- 172.21.15.146:0/2763606963 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef7c1309f0 msgr2=0x7fef7c071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.855+0000 7fef7a59c700 1 --2- 172.21.15.146:0/2763606963 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef7c1309f0 0x7fef7c071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.855+0000 7fef7a59c700 1 -- 172.21.15.146:0/2763606963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef7c071cb0 msgr2=0x7fef7c1db750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.855+0000 7fef7a59c700 1 --2- 172.21.15.146:0/2763606963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef7c071cb0 0x7fef7c1db750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.855+0000 7fef7a59c700 1 -- 172.21.15.146:0/2763606963 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c009a70 con 0x7fef7c133ad0 2023-10-03T10:12:57.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.856+0000 7f3e93d32700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e8c0a0a30 0x7f3e8c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.856+0000 7f3e93d32700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3e8c130670 0x7f3e8c1381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.856+0000 7f3e93d32700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e8c0a1e70 con 0x7f3e8c0a1340 2023-10-03T10:12:57.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.856+0000 7f3e93d32700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e8c09a720 con 0x7f3e8c130670 2023-10-03T10:12:57.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.856+0000 7f3e93d32700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c09b300 con 0x7f3e8c0a0a30 2023-10-03T10:12:57.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.856+0000 7f3e922cf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3e8c130670 0x7f3e8c1381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.856+0000 7f3e922cf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3e8c130670 0x7f3e8c1381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37854/0 (socket says 172.21.15.146:37854) 2023-10-03T10:12:57.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.856+0000 7f3e922cf700 1 -- 172.21.15.146:0/3966766006 learned_addr learned my addr 172.21.15.146:0/3966766006 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:57.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.855+0000 7fef7a59c700 1 --2- 172.21.15.146:0/2763606963 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef7c133ad0 0x7fef7c071770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fef7c06c6f0 tx=0x7fef70004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.855+0000 7fef637fe700 1 -- 172.21.15.146:0/2763606963 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef700045d0 con 0x7fef7c133ad0 2023-10-03T10:12:57.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.856+0000 7fef637fe700 1 -- 172.21.15.146:0/2763606963 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7001f070 con 0x7fef7c133ad0 2023-10-03T10:12:57.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.856+0000 7fef8101e700 1 -- 172.21.15.146:0/2763606963 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef70009550 con 0x7fef7c133ad0 2023-10-03T10:12:57.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.856+0000 7fef637fe700 1 -- 172.21.15.146:0/2763606963 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef700038c0 con 0x7fef7c133ad0 2023-10-03T10:12:57.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.856+0000 7fef8101e700 1 -- 172.21.15.146:0/2763606963 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7c06ecb0 con 0x7fef7c133ad0 2023-10-03T10:12:57.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.856+0000 7fef637fe700 1 -- 172.21.15.146:0/2763606963 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef70003a20 con 0x7fef7c133ad0 2023-10-03T10:12:57.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.857+0000 7fef637fe700 1 -- 172.21.15.146:0/2763606963 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fef70021070 con 0x7fef7c133ad0 2023-10-03T10:12:57.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.857+0000 7fef8101e700 1 -- 172.21.15.146:0/2763606963 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7c0701c0 con 0x7fef7c133ad0 2023-10-03T10:12:57.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.857+0000 7f3e922cf700 1 -- 172.21.15.146:0/3966766006 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e8c0a0a30 msgr2=0x7f3e8c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.857+0000 7f3e922cf700 1 --2- 172.21.15.146:0/3966766006 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e8c0a0a30 0x7f3e8c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.857+0000 7f3e922cf700 1 -- 172.21.15.146:0/3966766006 >> v1:172.21.15.146:6789/0 conn(0x7f3e8c0a1340 legacy=0x7f3e8c12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.857+0000 7f3e922cf700 1 -- 172.21.15.146:0/3966766006 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c09abc0 con 0x7f3e8c130670 2023-10-03T10:12:57.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.857+0000 7f3e922cf700 1 --2- 172.21.15.146:0/3966766006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e8c130670 0x7f3e8c1381c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400d150 tx=0x7f3e8400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee19e11c11e0a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.858+0000 7f3e90acc700 1 -- 172.21.15.146:0/3966766006 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84010070 con 0x7f3e8c130670 2023-10-03T10:12:57.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.858+0000 7f3e90acc700 1 -- 172.21.15.146:0/3966766006 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8400db70 con 0x7f3e8c130670 2023-10-03T10:12:57.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.858+0000 7f3e90acc700 1 -- 172.21.15.146:0/3966766006 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84003a20 con 0x7f3e8c130670 2023-10-03T10:12:57.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.859+0000 7f9f03fff700 1 -- 172.21.15.146:0/756236476 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f0c021080 con 0x7f9f1c06a770 2023-10-03T10:12:57.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.859+0000 7f3e93d32700 1 -- 172.21.15.146:0/3966766006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e8c130670 msgr2=0x7f3e8c1381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.859+0000 7f3e93d32700 1 --2- 172.21.15.146:0/3966766006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e8c130670 0x7f3e8c1381c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400d150 tx=0x7f3e8400d460 comp rx=0 tx=0).stop 2023-10-03T10:12:57.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.859+0000 7f3e93d32700 1 -- 172.21.15.146:0/3966766006 shutdown_connections 2023-10-03T10:12:57.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.859+0000 7f3e93d32700 1 --2- 172.21.15.146:0/3966766006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e8c130670 0x7f3e8c1381c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.859+0000 7f3e93d32700 1 --2- 172.21.15.146:0/3966766006 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e8c0a0a30 0x7f3e8c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.859+0000 7f3e93d32700 1 -- 172.21.15.146:0/3966766006 >> 172.21.15.146:0/3966766006 conn(0x7f3e8c0a2980 msgr2=0x7f3e8c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.860+0000 7f3e93d32700 1 -- 172.21.15.146:0/3966766006 shutdown_connections 2023-10-03T10:12:57.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.860+0000 7f3e93d32700 1 -- 172.21.15.146:0/3966766006 wait complete. 2023-10-03T10:12:57.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.860+0000 7f3e93d32700 1 Processor -- start 2023-10-03T10:12:57.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.862+0000 7fef637fe700 1 -- 172.21.15.146:0/2763606963 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef70026480 con 0x7fef7c133ad0 2023-10-03T10:12:57.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.861+0000 7f3e93d32700 1 -- start start 2023-10-03T10:12:57.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.861+0000 7f3e93d32700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e8c0a0a30 0x7f3e8c11b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.861+0000 7f3e93d32700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e8c0a1340 0x7f3e8c11b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.861+0000 7f3e93d32700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e8c130670 0x7f3e8c11ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.861+0000 7f3e93d32700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c11e8a0 con 0x7f3e8c130670 2023-10-03T10:12:57.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.861+0000 7f3e93d32700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c11cbd0 con 0x7f3e8c0a1340 2023-10-03T10:12:57.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.861+0000 7f3e93d32700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c11de20 con 0x7f3e8c0a0a30 2023-10-03T10:12:57.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.861+0000 7f3e91ace700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e8c0a0a30 0x7f3e8c11b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.861+0000 7f3e91ace700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e8c0a0a30 0x7f3e8c11b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51688/0 (socket says 172.21.15.146:51688) 2023-10-03T10:12:57.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.861+0000 7f3e91ace700 1 -- 172.21.15.146:0/1603521442 learned_addr learned my addr 172.21.15.146:0/1603521442 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:57.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.862+0000 7f3e91ace700 1 -- 172.21.15.146:0/1603521442 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e8c0a1340 msgr2=0x7f3e8c11b550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:57.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.862+0000 7f3e91ace700 1 --2- 172.21.15.146:0/1603521442 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e8c0a1340 0x7f3e8c11b550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.862+0000 7f3e91ace700 1 -- 172.21.15.146:0/1603521442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e8c130670 msgr2=0x7f3e8c11ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.862+0000 7f3e91ace700 1 --2- 172.21.15.146:0/1603521442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e8c130670 0x7f3e8c11ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.862+0000 7f3e91ace700 1 -- 172.21.15.146:0/1603521442 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8400bd40 con 0x7f3e8c0a0a30 2023-10-03T10:12:57.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.862+0000 7f3e91ace700 1 --2- 172.21.15.146:0/1603521442 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e8c0a0a30 0x7f3e8c11b010 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3e8800b550 tx=0x7f3e8800b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.864+0000 7f3e827fc700 1 -- 172.21.15.146:0/1603521442 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e88005aa0 con 0x7f3e8c0a0a30 2023-10-03T10:12:57.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.864+0000 7f3e827fc700 1 -- 172.21.15.146:0/1603521442 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e88005c00 con 0x7f3e8c0a0a30 2023-10-03T10:12:57.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.864+0000 7f3e827fc700 1 -- 172.21.15.146:0/1603521442 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e88011630 con 0x7f3e8c0a0a30 2023-10-03T10:12:57.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.864+0000 7f3e93d32700 1 -- 172.21.15.146:0/1603521442 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8c11d430 con 0x7f3e8c0a0a30 2023-10-03T10:12:57.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.864+0000 7f3e93d32700 1 -- 172.21.15.146:0/1603521442 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e8c11e540 con 0x7f3e8c0a0a30 2023-10-03T10:12:57.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.865+0000 7f3e93d32700 1 -- 172.21.15.146:0/1603521442 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e8c04f2a0 con 0x7f3e8c0a0a30 2023-10-03T10:12:57.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.866+0000 7f3e827fc700 1 -- 172.21.15.146:0/1603521442 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e88011790 con 0x7f3e8c0a0a30 2023-10-03T10:12:57.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.866+0000 7f3e827fc700 1 -- 172.21.15.146:0/1603521442 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3e8803fae0 con 0x7f3e8c0a0a30 2023-10-03T10:12:57.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:57.874+0000 7f3e827fc700 1 -- 172.21.15.146:0/1603521442 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e88010970 con 0x7f3e8c0a0a30 2023-10-03T10:12:58.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.021+0000 7f7076d95700 1 -- 172.21.15.146:0/2885640161 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f707004f2a0 con 0x7f707009a730 2023-10-03T10:12:58.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.022+0000 7f706d7fa700 1 -- 172.21.15.146:0/2885640161 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f705c028070 con 0x7f707009a730 2023-10-03T10:12:58.022 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:58.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.025+0000 7f7076d95700 1 -- 172.21.15.146:0/2885640161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f707009a730 msgr2=0x7f7070134780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.025+0000 7f7076d95700 1 --2- 172.21.15.146:0/2885640161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f707009a730 0x7f7070134780 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f705c00b500 tx=0x7f705c00b8c0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.025+0000 7f7076d95700 1 -- 172.21.15.146:0/2885640161 shutdown_connections 2023-10-03T10:12:58.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.025+0000 7f7076d95700 1 --2- 172.21.15.146:0/2885640161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7070130890 0x7f7070134cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.025+0000 7f7076d95700 1 --2- 172.21.15.146:0/2885640161 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7070099e20 0x7f7070134240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.025+0000 7f7076d95700 1 --2- 172.21.15.146:0/2885640161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f707009a730 0x7f7070134780 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.025+0000 7f7076d95700 1 -- 172.21.15.146:0/2885640161 >> 172.21.15.146:0/2885640161 conn(0x7f70700a2980 msgr2=0x7f707012f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:58.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.025+0000 7f7076d95700 1 -- 172.21.15.146:0/2885640161 shutdown_connections 2023-10-03T10:12:58.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.025+0000 7f7076d95700 1 -- 172.21.15.146:0/2885640161 wait complete. 2023-10-03T10:12:58.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:58.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.054+0000 7f9f218d1700 1 -- 172.21.15.146:0/756236476 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9f1c09e3a0 con 0x7f9f1c06a770 2023-10-03T10:12:58.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.054+0000 7f9f03fff700 1 -- 172.21.15.146:0/756236476 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f0c01bde0 con 0x7f9f1c06a770 2023-10-03T10:12:58.054 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:58.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.056+0000 7f9f218d1700 1 -- 172.21.15.146:0/756236476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f1c06a770 msgr2=0x7f9f1c1291b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.056+0000 7f9f218d1700 1 --2- 172.21.15.146:0/756236476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f1c06a770 0x7f9f1c1291b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00e900 tx=0x7f9f0c00ec10 comp rx=0 tx=0).stop 2023-10-03T10:12:58.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.056+0000 7f9f218d1700 1 -- 172.21.15.146:0/756236476 shutdown_connections 2023-10-03T10:12:58.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.056+0000 7f9f218d1700 1 --2- 172.21.15.146:0/756236476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f1c131a00 0x7f9f1c1c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.056+0000 7f9f218d1700 1 --2- 172.21.15.146:0/756236476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f1c06a770 0x7f9f1c1291b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.056+0000 7f9f218d1700 1 --2- 172.21.15.146:0/756236476 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f1c09dec0 0x7f9f1c1296f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.056+0000 7f9f218d1700 1 -- 172.21.15.146:0/756236476 >> 172.21.15.146:0/756236476 conn(0x7f9f1c099c40 msgr2=0x7f9f1c12f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:58.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.057+0000 7f9f218d1700 1 -- 172.21.15.146:0/756236476 shutdown_connections 2023-10-03T10:12:58.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.057+0000 7f9f218d1700 1 -- 172.21.15.146:0/756236476 wait complete. 2023-10-03T10:12:58.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:58.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.070+0000 7fef8101e700 1 -- 172.21.15.146:0/2763606963 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fef7c09cb20 con 0x7fef7c133ad0 2023-10-03T10:12:58.069 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:58.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.070+0000 7fef637fe700 1 -- 172.21.15.146:0/2763606963 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef7002b030 con 0x7fef7c133ad0 2023-10-03T10:12:58.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.071+0000 7f3e93d32700 1 -- 172.21.15.146:0/1603521442 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3e8c06bce0 con 0x7f3e8c0a0a30 2023-10-03T10:12:58.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.072+0000 7f3e827fc700 1 -- 172.21.15.146:0/1603521442 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3e88010380 con 0x7f3e8c0a0a30 2023-10-03T10:12:58.071 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:58.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.072+0000 7fef8101e700 1 -- 172.21.15.146:0/2763606963 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef7c133ad0 msgr2=0x7fef7c071770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.072+0000 7fef8101e700 1 --2- 172.21.15.146:0/2763606963 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef7c133ad0 0x7fef7c071770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fef7c06c6f0 tx=0x7fef70004750 comp rx=0 tx=0).stop 2023-10-03T10:12:58.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.072+0000 7fef8101e700 1 -- 172.21.15.146:0/2763606963 shutdown_connections 2023-10-03T10:12:58.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.072+0000 7fef8101e700 1 --2- 172.21.15.146:0/2763606963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef7c071cb0 0x7fef7c1db750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.072+0000 7fef8101e700 1 --2- 172.21.15.146:0/2763606963 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef7c1309f0 0x7fef7c071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.072+0000 7fef8101e700 1 --2- 172.21.15.146:0/2763606963 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef7c133ad0 0x7fef7c071770 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.072+0000 7fef8101e700 1 -- 172.21.15.146:0/2763606963 >> 172.21.15.146:0/2763606963 conn(0x7fef7c099c40 msgr2=0x7fef7c131f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:58.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.072+0000 7fef8101e700 1 -- 172.21.15.146:0/2763606963 shutdown_connections 2023-10-03T10:12:58.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.072+0000 7fef8101e700 1 -- 172.21.15.146:0/2763606963 wait complete. 2023-10-03T10:12:58.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.074+0000 7f3e93d32700 1 -- 172.21.15.146:0/1603521442 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e8c0a0a30 msgr2=0x7f3e8c11b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.074+0000 7f3e93d32700 1 --2- 172.21.15.146:0/1603521442 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e8c0a0a30 0x7f3e8c11b010 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3e8800b550 tx=0x7f3e8800b910 comp rx=0 tx=0).stop 2023-10-03T10:12:58.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.074+0000 7f3e93d32700 1 -- 172.21.15.146:0/1603521442 shutdown_connections 2023-10-03T10:12:58.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.074+0000 7f3e93d32700 1 --2- 172.21.15.146:0/1603521442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e8c130670 0x7f3e8c11ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.074+0000 7f3e93d32700 1 --2- 172.21.15.146:0/1603521442 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e8c0a0a30 0x7f3e8c11b010 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.074+0000 7f3e93d32700 1 --2- 172.21.15.146:0/1603521442 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e8c0a1340 0x7f3e8c11b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.074+0000 7f3e93d32700 1 -- 172.21.15.146:0/1603521442 >> 172.21.15.146:0/1603521442 conn(0x7f3e8c0a2980 msgr2=0x7f3e8c1b7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:58.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.075+0000 7f3e93d32700 1 -- 172.21.15.146:0/1603521442 shutdown_connections 2023-10-03T10:12:58.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:58.075+0000 7f3e93d32700 1 -- 172.21.15.146:0/1603521442 wait complete. 2023-10-03T10:12:58.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:12:58.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:59.042 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:59.069 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:59.087 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:59.089 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:59.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.189+0000 7f7f0aab6700 1 Processor -- start 2023-10-03T10:12:59.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.189+0000 7f7f0aab6700 1 -- start start 2023-10-03T10:12:59.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.190+0000 7f7f0aab6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f0409d860 0x7f7f0409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.190+0000 7f7f0aab6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7f04130eb0 0x7f7f04138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.190+0000 7f7f0aab6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f0409aaa0 con 0x7f7f0409e170 2023-10-03T10:12:59.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.190+0000 7f7f0aab6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f0409f870 con 0x7f7f04130eb0 2023-10-03T10:12:59.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.190+0000 7f7f0aab6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0409b360 con 0x7f7f0409d860 2023-10-03T10:12:59.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.190+0000 7f7f09053700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7f04130eb0 0x7f7f04138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.190+0000 7f7f08852700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f0409d860 0x7f7f0409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.190+0000 7f7f03fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7f0409e170 0x7f7f041307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39960/0 (socket says 172.21.15.146:39960) 2023-10-03T10:12:59.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.190+0000 7f7f03fff700 1 -- 172.21.15.146:0/937796321 learned_addr learned my addr 172.21.15.146:0/937796321 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:59.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.190+0000 7f7f09053700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7f04130eb0 0x7f7f04138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37868/0 (socket says 172.21.15.146:37868) 2023-10-03T10:12:59.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.191+0000 7f7f09053700 1 -- 172.21.15.146:0/937796321 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f0409d860 msgr2=0x7f7f0409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:59.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.191+0000 7f7f09053700 1 --2- 172.21.15.146:0/937796321 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f0409d860 0x7f7f0409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.191+0000 7f7f09053700 1 -- 172.21.15.146:0/937796321 >> v1:172.21.15.146:6789/0 conn(0x7f7f0409e170 legacy=0x7f7f041307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.191+0000 7f7f09053700 1 -- 172.21.15.146:0/937796321 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0409b620 con 0x7f7f04130eb0 2023-10-03T10:12:59.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.191+0000 7f7f09053700 1 --2- 172.21.15.146:0/937796321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f04130eb0 0x7f7f04138a00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009d90 tx=0x7f7efc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c105b2e7b63583e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:59.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.191+0000 7f7f037fe700 1 -- 172.21.15.146:0/937796321 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc00e070 con 0x7f7f04130eb0 2023-10-03T10:12:59.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.191+0000 7f7f037fe700 1 -- 172.21.15.146:0/937796321 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc003a20 con 0x7f7f04130eb0 2023-10-03T10:12:59.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.191+0000 7f7f037fe700 1 -- 172.21.15.146:0/937796321 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc003dd0 con 0x7f7f04130eb0 2023-10-03T10:12:59.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.192+0000 7f7f0aab6700 1 -- 172.21.15.146:0/937796321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f04130eb0 msgr2=0x7f7f04138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.192+0000 7f7f0aab6700 1 --2- 172.21.15.146:0/937796321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f04130eb0 0x7f7f04138a00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009d90 tx=0x7f7efc00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:59.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.192+0000 7f7f0aab6700 1 -- 172.21.15.146:0/937796321 shutdown_connections 2023-10-03T10:12:59.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.192+0000 7f7f0aab6700 1 --2- 172.21.15.146:0/937796321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f04130eb0 0x7f7f04138a00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.192+0000 7f7f0aab6700 1 --2- 172.21.15.146:0/937796321 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f0409d860 0x7f7f0409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.192+0000 7f7f0aab6700 1 -- 172.21.15.146:0/937796321 >> 172.21.15.146:0/937796321 conn(0x7f7f04099c40 msgr2=0x7f7f040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.192+0000 7f7f0aab6700 1 -- 172.21.15.146:0/937796321 shutdown_connections 2023-10-03T10:12:59.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.192+0000 7f7f0aab6700 1 -- 172.21.15.146:0/937796321 wait complete. 2023-10-03T10:12:59.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.193+0000 7f7f0aab6700 1 Processor -- start 2023-10-03T10:12:59.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.193+0000 7f7f0aab6700 1 -- start start 2023-10-03T10:12:59.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.194+0000 7f7f0aab6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f0409d860 0x7f7f0411e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.194+0000 7f7f0aab6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0409e170 0x7f7f0411eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.194+0000 7f7f0aab6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f04130eb0 0x7f7f0411f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.194+0000 7f7f0aab6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f041200e0 con 0x7f7f0409e170 2023-10-03T10:12:59.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.194+0000 7f7f0aab6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f04120700 con 0x7f7f04130eb0 2023-10-03T10:12:59.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.194+0000 7f7f0aab6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f04130430 con 0x7f7f0409d860 2023-10-03T10:12:59.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.194+0000 7f7f03fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0409e170 0x7f7f0411eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.194+0000 7f7f08852700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f0409d860 0x7f7f0411e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.194+0000 7f7f03fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0409e170 0x7f7f0411eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37874/0 (socket says 172.21.15.146:37874) 2023-10-03T10:12:59.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.194+0000 7f7f03fff700 1 -- 172.21.15.146:0/1560079405 learned_addr learned my addr 172.21.15.146:0/1560079405 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:59.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.195+0000 7f7f09053700 1 --2- 172.21.15.146:0/1560079405 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f04130eb0 0x7f7f0411f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.195+0000 7f7f03fff700 1 -- 172.21.15.146:0/1560079405 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f0409d860 msgr2=0x7f7f0411e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.195+0000 7f7f03fff700 1 --2- 172.21.15.146:0/1560079405 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f0409d860 0x7f7f0411e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.195+0000 7f7f03fff700 1 -- 172.21.15.146:0/1560079405 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f04130eb0 msgr2=0x7f7f0411f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.195+0000 7f7f03fff700 1 --2- 172.21.15.146:0/1560079405 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f04130eb0 0x7f7f0411f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.195+0000 7f7f03fff700 1 -- 172.21.15.146:0/1560079405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc009a70 con 0x7f7f0409e170 2023-10-03T10:12:59.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.195+0000 7f7f03fff700 1 --2- 172.21.15.146:0/1560079405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0409e170 0x7f7f0411eb40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7ef000c700 tx=0x7f7ef000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:59.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.195+0000 7f7f017fa700 1 -- 172.21.15.146:0/1560079405 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0004c80 con 0x7f7f0409e170 2023-10-03T10:12:59.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.195+0000 7f7f017fa700 1 -- 172.21.15.146:0/1560079405 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef0004de0 con 0x7f7f0409e170 2023-10-03T10:12:59.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.195+0000 7f7f017fa700 1 -- 172.21.15.146:0/1560079405 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0007310 con 0x7f7f0409e170 2023-10-03T10:12:59.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.195+0000 7f7f0aab6700 1 -- 172.21.15.146:0/1560079405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f04121ff0 con 0x7f7f0409e170 2023-10-03T10:12:59.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.195+0000 7f7f0aab6700 1 -- 172.21.15.146:0/1560079405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f04121d10 con 0x7f7f0409e170 2023-10-03T10:12:59.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.197+0000 7f7f0aab6700 1 -- 172.21.15.146:0/1560079405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0404f2a0 con 0x7f7f0409e170 2023-10-03T10:12:59.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.197+0000 7f7f017fa700 1 -- 172.21.15.146:0/1560079405 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ef0017020 con 0x7f7f0409e170 2023-10-03T10:12:59.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.198+0000 7f7f017fa700 1 -- 172.21.15.146:0/1560079405 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7ef0043620 con 0x7f7f0409e170 2023-10-03T10:12:59.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.206+0000 7f7f017fa700 1 -- 172.21.15.146:0/1560079405 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ef0011680 con 0x7f7f0409e170 2023-10-03T10:12:59.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.226+0000 7fa552ced700 1 Processor -- start 2023-10-03T10:12:59.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.227+0000 7fa552ced700 1 -- start start 2023-10-03T10:12:59.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.227+0000 7fa552ced700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa54c0a0a30 0x7fa54c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.227+0000 7fa552ced700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa54c0a1340 0x7fa54c12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.227+0000 7fa552ced700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa54c1304a0 0x7fa54c1308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.227+0000 7fa552ced700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa54c130e30 con 0x7fa54c0a0a30 2023-10-03T10:12:59.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.227+0000 7fa552ced700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c0a1e70 con 0x7fa54c0a1340 2023-10-03T10:12:59.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.227+0000 7fa552ced700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c09a720 con 0x7fa54c1304a0 2023-10-03T10:12:59.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.227+0000 7fa54bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa54c0a1340 0x7fa54c12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.227+0000 7fa54bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa54c0a1340 0x7fa54c12ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53286/0 (socket says 172.21.15.146:53286) 2023-10-03T10:12:59.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.227+0000 7fa55128a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa54c1304a0 0x7fa54c1308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.227+0000 7fa54bfff700 1 -- 172.21.15.146:0/3543233661 learned_addr learned my addr 172.21.15.146:0/3543233661 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:59.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.227+0000 7fa550a89700 1 --2- 172.21.15.146:0/3543233661 >> v2:172.21.15.146:3300/0 conn(0x7fa54c0a0a30 0x7fa54c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.228+0000 7fa550a89700 1 -- 172.21.15.146:0/3543233661 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa54c1304a0 msgr2=0x7fa54c1308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:59.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.228+0000 7fa550a89700 1 --2- 172.21.15.146:0/3543233661 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa54c1304a0 0x7fa54c1308f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.228+0000 7fa550a89700 1 -- 172.21.15.146:0/3543233661 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa54c0a1340 msgr2=0x7fa54c12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:59.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.228+0000 7fa550a89700 1 --2- 172.21.15.146:0/3543233661 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa54c0a1340 0x7fa54c12ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.228+0000 7fa550a89700 1 -- 172.21.15.146:0/3543233661 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c09b300 con 0x7fa54c0a0a30 2023-10-03T10:12:59.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.228+0000 7fa54bfff700 1 --2- 172.21.15.146:0/3543233661 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa54c0a1340 0x7fa54c12ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:59.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.228+0000 7fa55128a700 1 --2- 172.21.15.146:0/3543233661 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa54c1304a0 0x7fa54c1308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:59.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.228+0000 7fa550a89700 1 --2- 172.21.15.146:0/3543233661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa54c0a0a30 0x7fa54c0a0e00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa5400130a0 tx=0x7fa5400133b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34dc51fb05a3dd13 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:59.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.228+0000 7fa54b7fe700 1 -- 172.21.15.146:0/3543233661 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa540016070 con 0x7fa54c0a0a30 2023-10-03T10:12:59.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.228+0000 7fa54b7fe700 1 -- 172.21.15.146:0/3543233661 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa540013cc0 con 0x7fa54c0a0a30 2023-10-03T10:12:59.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.228+0000 7fa54b7fe700 1 -- 172.21.15.146:0/3543233661 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa540005c40 con 0x7fa54c0a0a30 2023-10-03T10:12:59.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.229+0000 7fa552ced700 1 -- 172.21.15.146:0/3543233661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa54c0a0a30 msgr2=0x7fa54c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.229+0000 7fa552ced700 1 --2- 172.21.15.146:0/3543233661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa54c0a0a30 0x7fa54c0a0e00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa5400130a0 tx=0x7fa5400133b0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.229+0000 7fa552ced700 1 -- 172.21.15.146:0/3543233661 shutdown_connections 2023-10-03T10:12:59.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.229+0000 7fa552ced700 1 --2- 172.21.15.146:0/3543233661 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa54c1304a0 0x7fa54c1308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.229+0000 7fa552ced700 1 --2- 172.21.15.146:0/3543233661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa54c0a0a30 0x7fa54c0a0e00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.229+0000 7fa552ced700 1 --2- 172.21.15.146:0/3543233661 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa54c0a1340 0x7fa54c12ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.229+0000 7fa552ced700 1 -- 172.21.15.146:0/3543233661 >> 172.21.15.146:0/3543233661 conn(0x7fa54c0a2980 msgr2=0x7fa54c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.229+0000 7fa552ced700 1 -- 172.21.15.146:0/3543233661 shutdown_connections 2023-10-03T10:12:59.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.229+0000 7fa552ced700 1 -- 172.21.15.146:0/3543233661 wait complete. 2023-10-03T10:12:59.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.230+0000 7fa552ced700 1 Processor -- start 2023-10-03T10:12:59.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.230+0000 7fa552ced700 1 -- start start 2023-10-03T10:12:59.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.231+0000 7fa552ced700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa54c0a0a30 0x7fa54c1c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.231+0000 7fa552ced700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa54c0a1340 0x7fa54c1c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.231+0000 7fa552ced700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa54c1304a0 0x7fa54c1c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.231+0000 7fa552ced700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c120520 con 0x7fa54c1304a0 2023-10-03T10:12:59.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.231+0000 7fa552ced700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c121940 con 0x7fa54c0a0a30 2023-10-03T10:12:59.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.231+0000 7fa552ced700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c11fc30 con 0x7fa54c0a1340 2023-10-03T10:12:59.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.231+0000 7fa55128a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa54c1304a0 0x7fa54c1c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.231+0000 7fa550a89700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa54c0a0a30 0x7fa54c1c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.231+0000 7fa55128a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa54c1304a0 0x7fa54c1c48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37888/0 (socket says 172.21.15.146:37888) 2023-10-03T10:12:59.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.231+0000 7fa55128a700 1 -- 172.21.15.146:0/1595483463 learned_addr learned my addr 172.21.15.146:0/1595483463 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:59.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.231+0000 7fa54bfff700 1 --2- 172.21.15.146:0/1595483463 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa54c0a1340 0x7fa54c1c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.231+0000 7fa550a89700 1 -- 172.21.15.146:0/1595483463 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa54c0a1340 msgr2=0x7fa54c1c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.231+0000 7fa550a89700 1 --2- 172.21.15.146:0/1595483463 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa54c0a1340 0x7fa54c1c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.231+0000 7fa550a89700 1 -- 172.21.15.146:0/1595483463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa54c1304a0 msgr2=0x7fa54c1c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.231+0000 7fa550a89700 1 --2- 172.21.15.146:0/1595483463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa54c1304a0 0x7fa54c1c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.231+0000 7fa550a89700 1 -- 172.21.15.146:0/1595483463 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53800b600 con 0x7fa54c0a0a30 2023-10-03T10:12:59.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.231+0000 7fa550a89700 1 --2- 172.21.15.146:0/1595483463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa54c0a0a30 0x7fa54c1c3e40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa5400130a0 tx=0x7fa540004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:59.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.232+0000 7fa5497fa700 1 -- 172.21.15.146:0/1595483463 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa540006ee0 con 0x7fa54c0a0a30 2023-10-03T10:12:59.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.232+0000 7fa5497fa700 1 -- 172.21.15.146:0/1595483463 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa540005c20 con 0x7fa54c0a0a30 2023-10-03T10:12:59.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.232+0000 7fa552ced700 1 -- 172.21.15.146:0/1595483463 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54400eb70 con 0x7fa54c0a0a30 2023-10-03T10:12:59.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.232+0000 7fa5497fa700 1 -- 172.21.15.146:0/1595483463 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54000f850 con 0x7fa54c0a0a30 2023-10-03T10:12:59.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.232+0000 7fa552ced700 1 -- 172.21.15.146:0/1595483463 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa540011cd0 con 0x7fa54c0a0a30 2023-10-03T10:12:59.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.233+0000 7fa552ced700 1 -- 172.21.15.146:0/1595483463 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54c11e470 con 0x7fa54c0a0a30 2023-10-03T10:12:59.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.233+0000 7efdf52a8700 1 Processor -- start 2023-10-03T10:12:59.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.234+0000 7fa5497fa700 1 -- 172.21.15.146:0/1595483463 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa54000f9b0 con 0x7fa54c0a0a30 2023-10-03T10:12:59.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.234+0000 7fa5497fa700 1 -- 172.21.15.146:0/1595483463 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa540049320 con 0x7fa54c0a0a30 2023-10-03T10:12:59.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.233+0000 7efdf52a8700 1 -- start start 2023-10-03T10:12:59.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.234+0000 7efdf52a8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efdf009d860 0x7efdf009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.234+0000 7efdf52a8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efdf009e170 0x7efdf01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.234+0000 7efdf52a8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf009aaa0 con 0x7efdf0130ce0 2023-10-03T10:12:59.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.234+0000 7efdf52a8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf009f870 con 0x7efdf009e170 2023-10-03T10:12:59.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.234+0000 7efdf52a8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdf009b360 con 0x7efdf009d860 2023-10-03T10:12:59.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.234+0000 7efdee7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efdf009e170 0x7efdf01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.234+0000 7efdee7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efdf009e170 0x7efdf01307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53298/0 (socket says 172.21.15.146:53298) 2023-10-03T10:12:59.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.234+0000 7efdee7fc700 1 -- 172.21.15.146:0/1277464249 learned_addr learned my addr 172.21.15.146:0/1277464249 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:59.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.235+0000 7efdeeffd700 1 --2- 172.21.15.146:0/1277464249 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efdf009d860 0x7efdf009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.235+0000 7efdedffb700 1 -- 172.21.15.146:0/1277464249 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4224429677 0 0) 0x7efdf009aaa0 con 0x7efdf0130ce0 2023-10-03T10:12:59.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.235+0000 7efdedffb700 1 -- 172.21.15.146:0/1277464249 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdd80035b0 con 0x7efdf0130ce0 2023-10-03T10:12:59.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.235+0000 7efdee7fc700 1 -- 172.21.15.146:0/1277464249 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efdf009d860 msgr2=0x7efdf009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:59.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.235+0000 7efdee7fc700 1 --2- 172.21.15.146:0/1277464249 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efdf009d860 0x7efdf009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.235+0000 7efdee7fc700 1 -- 172.21.15.146:0/1277464249 >> v1:172.21.15.146:6789/0 conn(0x7efdf0130ce0 legacy=0x7efdf01379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.235+0000 7efdee7fc700 1 -- 172.21.15.146:0/1277464249 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf009b620 con 0x7efdf009e170 2023-10-03T10:12:59.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.235+0000 7efdee7fc700 1 --2- 172.21.15.146:0/1277464249 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efdf009e170 0x7efdf01307a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efde4009920 tx=0x7efde4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=941083e5c04735e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:59.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.235+0000 7efdeeffd700 1 --2- 172.21.15.146:0/1277464249 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efdf009d860 0x7efdf009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:59.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.235+0000 7f2eeecd4700 1 Processor -- start 2023-10-03T10:12:59.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.235+0000 7f2eeecd4700 1 -- start start 2023-10-03T10:12:59.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.236+0000 7f2eeecd4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2ee80a1510 0x7f2ee81351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.236+0000 7f2eeecd4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ee81356e0 0x7f2ee8137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.236+0000 7f2eeecd4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee80a1e70 con 0x7f2ee80a0a30 2023-10-03T10:12:59.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.236+0000 7f2eeecd4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee809a720 con 0x7f2ee80a1510 2023-10-03T10:12:59.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.236+0000 7f2eeecd4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee809b300 con 0x7f2ee81356e0 2023-10-03T10:12:59.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.236+0000 7f2ee7fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2ee80a1510 0x7f2ee81351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.236+0000 7f2eeca70700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2ee80a0a30 0x7f2ee80a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39972/0 (socket says 172.21.15.146:39972) 2023-10-03T10:12:59.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.236+0000 7f2eeca70700 1 -- 172.21.15.146:0/3303174981 learned_addr learned my addr 172.21.15.146:0/3303174981 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:12:59.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.236+0000 7f2ee7fff700 1 -- 172.21.15.146:0/3303174981 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ee81356e0 msgr2=0x7f2ee8137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:59.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.236+0000 7f2ee7fff700 1 --2- 172.21.15.146:0/3303174981 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ee81356e0 0x7f2ee8137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.236+0000 7f2ee7fff700 1 -- 172.21.15.146:0/3303174981 >> v1:172.21.15.146:6789/0 conn(0x7f2ee80a0a30 legacy=0x7f2ee80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.236+0000 7f2ee7fff700 1 -- 172.21.15.146:0/3303174981 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee809abc0 con 0x7f2ee80a1510 2023-10-03T10:12:59.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.236+0000 7f2ee7fff700 1 --2- 172.21.15.146:0/3303174981 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee80a1510 0x7f2ee81351a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800bae0 tx=0x7f2ed800bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed1efd8366d3a7a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:59.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.236+0000 7f2ee77fe700 1 -- 172.21.15.146:0/3303174981 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed800dd30 con 0x7f2ee80a1510 2023-10-03T10:12:59.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.236+0000 7f2ee77fe700 1 -- 172.21.15.146:0/3303174981 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed800de90 con 0x7f2ee80a1510 2023-10-03T10:12:59.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.236+0000 7f2ee77fe700 1 -- 172.21.15.146:0/3303174981 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8010690 con 0x7f2ee80a1510 2023-10-03T10:12:59.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.237+0000 7f2eeecd4700 1 -- 172.21.15.146:0/3303174981 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee80a1510 msgr2=0x7f2ee81351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.237+0000 7f2eeecd4700 1 --2- 172.21.15.146:0/3303174981 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee80a1510 0x7f2ee81351a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800bae0 tx=0x7f2ed800bdf0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.237+0000 7f2eeecd4700 1 -- 172.21.15.146:0/3303174981 shutdown_connections 2023-10-03T10:12:59.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.237+0000 7f2eeecd4700 1 --2- 172.21.15.146:0/3303174981 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ee81356e0 0x7f2ee8137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.237+0000 7f2eeecd4700 1 --2- 172.21.15.146:0/3303174981 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee80a1510 0x7f2ee81351a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.237+0000 7f2eeecd4700 1 -- 172.21.15.146:0/3303174981 >> 172.21.15.146:0/3303174981 conn(0x7f2ee80a2980 msgr2=0x7f2ee80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.237+0000 7f2eeecd4700 1 -- 172.21.15.146:0/3303174981 shutdown_connections 2023-10-03T10:12:59.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.237+0000 7f2eeecd4700 1 -- 172.21.15.146:0/3303174981 wait complete. 2023-10-03T10:12:59.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.238+0000 7f2eeecd4700 1 Processor -- start 2023-10-03T10:12:59.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.238+0000 7f2eeecd4700 1 -- start start 2023-10-03T10:12:59.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.239+0000 7f2eeecd4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee80a0a30 0x7f2ee811ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.239+0000 7f2eeecd4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ee80a1510 0x7f2ee811f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.239+0000 7f2eeecd4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ee81356e0 0x7f2ee811f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.239+0000 7f2eeecd4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee8122a90 con 0x7f2ee80a0a30 2023-10-03T10:12:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.239+0000 7f2eeecd4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee8122220 con 0x7f2ee80a1510 2023-10-03T10:12:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.239+0000 7f2eeecd4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee809ae00 con 0x7f2ee81356e0 2023-10-03T10:12:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.239+0000 7f2ee7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ee80a1510 0x7f2ee811f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.239+0000 7f2ee7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ee80a1510 0x7f2ee811f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53304/0 (socket says 172.21.15.146:53304) 2023-10-03T10:12:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.239+0000 7f2ee7fff700 1 -- 172.21.15.146:0/968510684 learned_addr learned my addr 172.21.15.146:0/968510684 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.239+0000 7f2eed271700 1 --2- 172.21.15.146:0/968510684 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ee81356e0 0x7f2ee811f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.239+0000 7f2ee7fff700 1 -- 172.21.15.146:0/968510684 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ee81356e0 msgr2=0x7f2ee811f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.239+0000 7f2ee7fff700 1 --2- 172.21.15.146:0/968510684 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ee81356e0 0x7f2ee811f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.239+0000 7f2ee7fff700 1 -- 172.21.15.146:0/968510684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee80a0a30 msgr2=0x7f2ee811ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.239+0000 7f2ee7fff700 1 --2- 172.21.15.146:0/968510684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee80a0a30 0x7f2ee811ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.239+0000 7f2ee7fff700 1 -- 172.21.15.146:0/968510684 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed800b740 con 0x7f2ee80a1510 2023-10-03T10:12:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.239+0000 7fa5497fa700 1 -- 172.21.15.146:0/1595483463 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa54001a3f0 con 0x7fa54c0a0a30 2023-10-03T10:12:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.240+0000 7f2ee7fff700 1 --2- 172.21.15.146:0/968510684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ee80a1510 0x7f2ee811f4b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800b2c0 tx=0x7f2ed8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:59.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.240+0000 7efdedffb700 1 -- 172.21.15.146:0/1277464249 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4011830 con 0x7efdf009e170 2023-10-03T10:12:59.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.240+0000 7efdedffb700 1 -- 172.21.15.146:0/1277464249 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde4011990 con 0x7efdf009e170 2023-10-03T10:12:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.240+0000 7efdedffb700 1 -- 172.21.15.146:0/1277464249 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4011d00 con 0x7efdf009e170 2023-10-03T10:12:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.240+0000 7efdf52a8700 1 -- 172.21.15.146:0/1277464249 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efdf009e170 msgr2=0x7efdf01307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.240+0000 7efdf52a8700 1 --2- 172.21.15.146:0/1277464249 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efdf009e170 0x7efdf01307a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efde4009920 tx=0x7efde4009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.240+0000 7efdf52a8700 1 -- 172.21.15.146:0/1277464249 shutdown_connections 2023-10-03T10:12:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.240+0000 7efdf52a8700 1 --2- 172.21.15.146:0/1277464249 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efdf009d860 0x7efdf009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.240+0000 7efdf52a8700 1 --2- 172.21.15.146:0/1277464249 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efdf009e170 0x7efdf01307a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.240+0000 7efdf52a8700 1 -- 172.21.15.146:0/1277464249 >> 172.21.15.146:0/1277464249 conn(0x7efdf0099c40 msgr2=0x7efdf00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.240+0000 7efdf52a8700 1 -- 172.21.15.146:0/1277464249 shutdown_connections 2023-10-03T10:12:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.240+0000 7efdf52a8700 1 -- 172.21.15.146:0/1277464249 wait complete. 2023-10-03T10:12:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.242+0000 7efdf52a8700 1 Processor -- start 2023-10-03T10:12:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.242+0000 7efdf52a8700 1 -- start start 2023-10-03T10:12:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.242+0000 7efdf52a8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efdf009d860 0x7efdf01231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.242+0000 7efdf52a8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efdf009e170 0x7efdf0123710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.242+0000 7efdf52a8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdf0130ce0 0x7efdf01c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.242+0000 7efdf52a8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf0124d00 con 0x7efdf0130ce0 2023-10-03T10:12:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.242+0000 7efdf52a8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf00a2050 con 0x7efdf009d860 2023-10-03T10:12:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.242+0000 7efdf52a8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdf009c8b0 con 0x7efdf009e170 2023-10-03T10:12:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.242+0000 7efdef7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdf0130ce0 0x7efdf01c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.242+0000 7efdee7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efdf009e170 0x7efdf0123710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.242+0000 7efdef7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdf0130ce0 0x7efdf01c8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37918/0 (socket says 172.21.15.146:37918) 2023-10-03T10:12:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.242+0000 7efdef7fe700 1 -- 172.21.15.146:0/4181302088 learned_addr learned my addr 172.21.15.146:0/4181302088 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:12:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.242+0000 7efdeeffd700 1 --2- 172.21.15.146:0/4181302088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efdf009d860 0x7efdf01231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.243+0000 7efdef7fe700 1 -- 172.21.15.146:0/4181302088 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efdf009e170 msgr2=0x7efdf0123710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.243+0000 7efdef7fe700 1 --2- 172.21.15.146:0/4181302088 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efdf009e170 0x7efdf0123710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.243+0000 7efdef7fe700 1 -- 172.21.15.146:0/4181302088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efdf009d860 msgr2=0x7efdf01231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.243+0000 7efdef7fe700 1 --2- 172.21.15.146:0/4181302088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efdf009d860 0x7efdf01231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.243+0000 7efdef7fe700 1 -- 172.21.15.146:0/4181302088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde4009550 con 0x7efdf0130ce0 2023-10-03T10:12:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.243+0000 7efdeeffd700 1 --2- 172.21.15.146:0/4181302088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efdf009d860 0x7efdf01231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.243+0000 7efdef7fe700 1 --2- 172.21.15.146:0/4181302088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdf0130ce0 0x7efdf01c8060 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efde800cc20 tx=0x7efde800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.243+0000 7efdd77fe700 1 -- 172.21.15.146:0/4181302088 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8003c00 con 0x7efdf0130ce0 2023-10-03T10:12:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.243+0000 7efdd77fe700 1 -- 172.21.15.146:0/4181302088 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde8003d60 con 0x7efdf0130ce0 2023-10-03T10:12:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.243+0000 7efdf52a8700 1 -- 172.21.15.146:0/4181302088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf0124540 con 0x7efdf0130ce0 2023-10-03T10:12:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.243+0000 7efdd77fe700 1 -- 172.21.15.146:0/4181302088 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde800aae0 con 0x7efdf0130ce0 2023-10-03T10:12:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.243+0000 7efdf52a8700 1 -- 172.21.15.146:0/4181302088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf0123c50 con 0x7efdf0130ce0 2023-10-03T10:12:59.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.245+0000 7efdf52a8700 1 -- 172.21.15.146:0/4181302088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf004f2a0 con 0x7efdf0130ce0 2023-10-03T10:12:59.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.245+0000 7efdd77fe700 1 -- 172.21.15.146:0/4181302088 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efde800ac40 con 0x7efdf0130ce0 2023-10-03T10:12:59.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.245+0000 7f2ee57fa700 1 -- 172.21.15.146:0/968510684 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed801f070 con 0x7f2ee80a1510 2023-10-03T10:12:59.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.245+0000 7f2eeecd4700 1 -- 172.21.15.146:0/968510684 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee809ff00 con 0x7f2ee80a1510 2023-10-03T10:12:59.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.245+0000 7f2ee57fa700 1 -- 172.21.15.146:0/968510684 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed8003b20 con 0x7f2ee80a1510 2023-10-03T10:12:59.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.245+0000 7f2ee57fa700 1 -- 172.21.15.146:0/968510684 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8024470 con 0x7f2ee80a1510 2023-10-03T10:12:59.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.245+0000 7f2eeecd4700 1 -- 172.21.15.146:0/968510684 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee8121390 con 0x7f2ee80a1510 2023-10-03T10:12:59.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.246+0000 7f2ee57fa700 1 -- 172.21.15.146:0/968510684 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ed802d430 con 0x7f2ee80a1510 2023-10-03T10:12:59.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.247+0000 7f2eeecd4700 1 -- 172.21.15.146:0/968510684 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee8122450 con 0x7f2ee80a1510 2023-10-03T10:12:59.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.247+0000 7f2ee57fa700 1 -- 172.21.15.146:0/968510684 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2ed8042d00 con 0x7f2ee80a1510 2023-10-03T10:12:59.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.250+0000 7efdd77fe700 1 -- 172.21.15.146:0/4181302088 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efde80052b0 con 0x7efdf0130ce0 2023-10-03T10:12:59.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.250+0000 7efdd77fe700 1 -- 172.21.15.146:0/4181302088 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efde80108d0 con 0x7efdf0130ce0 2023-10-03T10:12:59.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.256+0000 7f2ee57fa700 1 -- 172.21.15.146:0/968510684 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ee8122450 con 0x7f2ee80a1510 2023-10-03T10:12:59.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.409+0000 7f7f0aab6700 1 -- 172.21.15.146:0/1560079405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7f0406c3b0 con 0x7f7f0409e170 2023-10-03T10:12:59.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.409+0000 7f7f017fa700 1 -- 172.21.15.146:0/1560079405 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7ef0029030 con 0x7f7f0409e170 2023-10-03T10:12:59.409 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:59.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.412+0000 7f7f0aab6700 1 -- 172.21.15.146:0/1560079405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0409e170 msgr2=0x7f7f0411eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.412+0000 7f7f0aab6700 1 --2- 172.21.15.146:0/1560079405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0409e170 0x7f7f0411eb40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7ef000c700 tx=0x7f7ef000ca10 comp rx=0 tx=0).stop 2023-10-03T10:12:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.412+0000 7f7f0aab6700 1 -- 172.21.15.146:0/1560079405 shutdown_connections 2023-10-03T10:12:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.412+0000 7f7f0aab6700 1 --2- 172.21.15.146:0/1560079405 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f04130eb0 0x7f7f0411f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.412+0000 7f7f0aab6700 1 --2- 172.21.15.146:0/1560079405 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f0409d860 0x7f7f0411e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.412+0000 7f7f0aab6700 1 --2- 172.21.15.146:0/1560079405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0409e170 0x7f7f0411eb40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.412+0000 7f7f0aab6700 1 -- 172.21.15.146:0/1560079405 >> 172.21.15.146:0/1560079405 conn(0x7f7f04099c40 msgr2=0x7f7f040a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.412+0000 7f7f0aab6700 1 -- 172.21.15.146:0/1560079405 shutdown_connections 2023-10-03T10:12:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.412+0000 7f7f0aab6700 1 -- 172.21.15.146:0/1560079405 wait complete. 2023-10-03T10:12:59.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:12:59.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.442+0000 7fa552ced700 1 -- 172.21.15.146:0/1595483463 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa54c11e470 con 0x7fa54c0a0a30 2023-10-03T10:12:59.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.443+0000 7fa5497fa700 1 -- 172.21.15.146:0/1595483463 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa54c11e470 con 0x7fa54c0a0a30 2023-10-03T10:12:59.443 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:12:59.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.445+0000 7fa552ced700 1 -- 172.21.15.146:0/1595483463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa54c0a0a30 msgr2=0x7fa54c1c3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.445+0000 7fa552ced700 1 --2- 172.21.15.146:0/1595483463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa54c0a0a30 0x7fa54c1c3e40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa5400130a0 tx=0x7fa540004750 comp rx=0 tx=0).stop 2023-10-03T10:12:59.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.445+0000 7fa552ced700 1 -- 172.21.15.146:0/1595483463 shutdown_connections 2023-10-03T10:12:59.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.445+0000 7fa552ced700 1 --2- 172.21.15.146:0/1595483463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa54c1304a0 0x7fa54c1c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.445+0000 7fa552ced700 1 --2- 172.21.15.146:0/1595483463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa54c0a0a30 0x7fa54c1c3e40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.445+0000 7fa552ced700 1 --2- 172.21.15.146:0/1595483463 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa54c0a1340 0x7fa54c1c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.445+0000 7fa552ced700 1 -- 172.21.15.146:0/1595483463 >> 172.21.15.146:0/1595483463 conn(0x7fa54c0a2980 msgr2=0x7fa54c09deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.445+0000 7fa552ced700 1 -- 172.21.15.146:0/1595483463 shutdown_connections 2023-10-03T10:12:59.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.445+0000 7fa552ced700 1 -- 172.21.15.146:0/1595483463 wait complete. 2023-10-03T10:12:59.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.446+0000 7efdf52a8700 1 -- 172.21.15.146:0/4181302088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efdf0125f20 con 0x7efdf0130ce0 2023-10-03T10:12:59.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.447+0000 7efdd77fe700 1 -- 172.21.15.146:0/4181302088 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efde80102e0 con 0x7efdf0130ce0 2023-10-03T10:12:59.447 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:12:59.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.449+0000 7efdf52a8700 1 -- 172.21.15.146:0/4181302088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdf0130ce0 msgr2=0x7efdf01c8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.449+0000 7efdf52a8700 1 --2- 172.21.15.146:0/4181302088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdf0130ce0 0x7efdf01c8060 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efde800cc20 tx=0x7efde800cf30 comp rx=0 tx=0).stop 2023-10-03T10:12:59.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.449+0000 7efdf52a8700 1 -- 172.21.15.146:0/4181302088 shutdown_connections 2023-10-03T10:12:59.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.449+0000 7efdf52a8700 1 --2- 172.21.15.146:0/4181302088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdf0130ce0 0x7efdf01c8060 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.449+0000 7efdf52a8700 1 --2- 172.21.15.146:0/4181302088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efdf009d860 0x7efdf01231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.449+0000 7efdf52a8700 1 --2- 172.21.15.146:0/4181302088 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efdf009e170 0x7efdf0123710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.449+0000 7efdf52a8700 1 -- 172.21.15.146:0/4181302088 >> 172.21.15.146:0/4181302088 conn(0x7efdf0099c40 msgr2=0x7efdf00a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.449+0000 7efdf52a8700 1 -- 172.21.15.146:0/4181302088 shutdown_connections 2023-10-03T10:12:59.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.449+0000 7efdf52a8700 1 -- 172.21.15.146:0/4181302088 wait complete. 2023-10-03T10:12:59.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.453+0000 7f2eeecd4700 1 -- 172.21.15.146:0/968510684 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2ee8122450 con 0x7f2ee80a1510 2023-10-03T10:12:59.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.453+0000 7f2ee57fa700 1 -- 172.21.15.146:0/968510684 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ee8122450 con 0x7f2ee80a1510 2023-10-03T10:12:59.453 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:12:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.456+0000 7f2eeecd4700 1 -- 172.21.15.146:0/968510684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ee80a1510 msgr2=0x7f2ee811f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.456+0000 7f2eeecd4700 1 --2- 172.21.15.146:0/968510684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ee80a1510 0x7f2ee811f4b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800b2c0 tx=0x7f2ed8004750 comp rx=0 tx=0).stop 2023-10-03T10:12:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.456+0000 7f2eeecd4700 1 -- 172.21.15.146:0/968510684 shutdown_connections 2023-10-03T10:12:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.456+0000 7f2eeecd4700 1 --2- 172.21.15.146:0/968510684 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ee81356e0 0x7f2ee811f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.456+0000 7f2eeecd4700 1 --2- 172.21.15.146:0/968510684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee80a0a30 0x7f2ee811ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.456+0000 7f2eeecd4700 1 --2- 172.21.15.146:0/968510684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ee80a1510 0x7f2ee811f4b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.456+0000 7f2eeecd4700 1 -- 172.21.15.146:0/968510684 >> 172.21.15.146:0/968510684 conn(0x7f2ee80a2980 msgr2=0x7f2ee809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.456+0000 7f2eeecd4700 1 -- 172.21.15.146:0/968510684 shutdown_connections 2023-10-03T10:12:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:12:59.456+0000 7f2eeecd4700 1 -- 172.21.15.146:0/968510684 wait complete. 2023-10-03T10:12:59.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:12:59.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:12:59.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:00.426 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:00.461 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:00.465 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:00.470 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:00.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.583+0000 7f4aa0c23700 1 Processor -- start 2023-10-03T10:13:00.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.583+0000 7f4aa0c23700 1 -- start start 2023-10-03T10:13:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.584+0000 7f4aa0c23700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4a9c0a0a70 0x7f4a9c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.584+0000 7f4aa0c23700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a9c134120 0x7f4a9c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.584+0000 7f4aa0c23700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a9c09dc00 con 0x7f4a9c0a1380 2023-10-03T10:13:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.584+0000 7f4aa0c23700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a9c09ea90 con 0x7f4a9c0a0a70 2023-10-03T10:13:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.584+0000 7f4aa0c23700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c09dec0 con 0x7f4a9c134120 2023-10-03T10:13:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.584+0000 7f4a9a59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4a9c0a0a70 0x7f4a9c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.584+0000 7f4a99d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4a9c0a1380 0x7f4a9c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39976/0 (socket says 172.21.15.146:39976) 2023-10-03T10:13:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.584+0000 7f4a9a59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4a9c0a0a70 0x7f4a9c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37922/0 (socket says 172.21.15.146:37922) 2023-10-03T10:13:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.584+0000 7f4a99d9b700 1 -- 172.21.15.146:0/3348673804 learned_addr learned my addr 172.21.15.146:0/3348673804 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:00.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.584+0000 7f4a9ad9d700 1 --2- 172.21.15.146:0/3348673804 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a9c134120 0x7f4a9c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.585+0000 7f4a9a59c700 1 -- 172.21.15.146:0/3348673804 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a9c134120 msgr2=0x7f4a9c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:00.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.585+0000 7f4a9a59c700 1 --2- 172.21.15.146:0/3348673804 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a9c134120 0x7f4a9c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.585+0000 7f4a9a59c700 1 -- 172.21.15.146:0/3348673804 >> v1:172.21.15.146:6789/0 conn(0x7f4a9c0a1380 legacy=0x7f4a9c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.585+0000 7f4a9959a700 1 -- 172.21.15.146:0/3348673804 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4052724487 0 0) 0x7f4a9c09dc00 con 0x7f4a9c0a1380 2023-10-03T10:13:00.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.585+0000 7f4a9a59c700 1 -- 172.21.15.146:0/3348673804 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c09e6a0 con 0x7f4a9c0a0a70 2023-10-03T10:13:00.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.585+0000 7f4a9ad9d700 1 --2- 172.21.15.146:0/3348673804 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a9c134120 0x7f4a9c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:00.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.585+0000 7f4a9a59c700 1 --2- 172.21.15.146:0/3348673804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a9c0a0a70 0x7f4a9c0a0e40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c009840 tx=0x7f4a8c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07a6a7467dfc983 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.585+0000 7f4a9959a700 1 -- 172.21.15.146:0/3348673804 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c011830 con 0x7f4a9c0a0a70 2023-10-03T10:13:00.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.585+0000 7f4a9959a700 1 -- 172.21.15.146:0/3348673804 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8c011990 con 0x7f4a9c0a0a70 2023-10-03T10:13:00.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.585+0000 7f4a9959a700 1 -- 172.21.15.146:0/3348673804 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c011d20 con 0x7f4a9c0a0a70 2023-10-03T10:13:00.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.586+0000 7f4aa0c23700 1 -- 172.21.15.146:0/3348673804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a9c0a0a70 msgr2=0x7f4a9c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.586+0000 7f4aa0c23700 1 --2- 172.21.15.146:0/3348673804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a9c0a0a70 0x7f4a9c0a0e40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c009840 tx=0x7f4a8c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:00.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.586+0000 7f4aa0c23700 1 -- 172.21.15.146:0/3348673804 shutdown_connections 2023-10-03T10:13:00.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.586+0000 7f4aa0c23700 1 --2- 172.21.15.146:0/3348673804 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a9c134120 0x7f4a9c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.586+0000 7f4aa0c23700 1 --2- 172.21.15.146:0/3348673804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a9c0a0a70 0x7f4a9c0a0e40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.586+0000 7f4aa0c23700 1 -- 172.21.15.146:0/3348673804 >> 172.21.15.146:0/3348673804 conn(0x7f4a9c0a6610 msgr2=0x7f4a9c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.586+0000 7f4aa0c23700 1 -- 172.21.15.146:0/3348673804 shutdown_connections 2023-10-03T10:13:00.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.586+0000 7f4aa0c23700 1 -- 172.21.15.146:0/3348673804 wait complete. 2023-10-03T10:13:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.588+0000 7f4aa0c23700 1 Processor -- start 2023-10-03T10:13:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.588+0000 7f4aa0c23700 1 -- start start 2023-10-03T10:13:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.589+0000 7f4aa0c23700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a9c0a0a70 0x7f4a9c1c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.589+0000 7f4aa0c23700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a9c0a1380 0x7f4a9c1c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.589+0000 7f4aa0c23700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a9c134120 0x7f4a9c122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.589+0000 7f4aa0c23700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c125f80 con 0x7f4a9c0a1380 2023-10-03T10:13:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.589+0000 7f4aa0c23700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c127070 con 0x7f4a9c0a0a70 2023-10-03T10:13:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.589+0000 7f4aa0c23700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c133aa0 con 0x7f4a9c134120 2023-10-03T10:13:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.589+0000 7f4a9a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a9c0a0a70 0x7f4a9c1c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.589+0000 7f4a9a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a9c0a0a70 0x7f4a9c1c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53334/0 (socket says 172.21.15.146:53334) 2023-10-03T10:13:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.589+0000 7f4a9a59c700 1 -- 172.21.15.146:0/3237980985 learned_addr learned my addr 172.21.15.146:0/3237980985 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.589+0000 7f4a99d9b700 1 --2- 172.21.15.146:0/3237980985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a9c0a1380 0x7f4a9c1c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.589+0000 7f4a9a59c700 1 -- 172.21.15.146:0/3237980985 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a9c134120 msgr2=0x7f4a9c122970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.589+0000 7f4a9a59c700 1 --2- 172.21.15.146:0/3237980985 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a9c134120 0x7f4a9c122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.589+0000 7f4a9a59c700 1 -- 172.21.15.146:0/3237980985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a9c0a1380 msgr2=0x7f4a9c1c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.589+0000 7f4a9a59c700 1 --2- 172.21.15.146:0/3237980985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a9c0a1380 0x7f4a9c1c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.589+0000 7f4a9a59c700 1 -- 172.21.15.146:0/3237980985 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a94009a70 con 0x7f4a9c0a0a70 2023-10-03T10:13:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.589+0000 7f4a9a59c700 1 --2- 172.21.15.146:0/3237980985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a9c0a0a70 0x7f4a9c1c86f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c0090b0 tx=0x7f4a8c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.589+0000 7f4a8affd700 1 -- 172.21.15.146:0/3237980985 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c0045d0 con 0x7f4a9c0a0a70 2023-10-03T10:13:00.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.590+0000 7f4a8affd700 1 -- 172.21.15.146:0/3237980985 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8c01f070 con 0x7f4a9c0a0a70 2023-10-03T10:13:00.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.590+0000 7f4aa0c23700 1 -- 172.21.15.146:0/3237980985 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a8c0094a0 con 0x7f4a9c0a0a70 2023-10-03T10:13:00.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.590+0000 7f4a8affd700 1 -- 172.21.15.146:0/3237980985 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c0038a0 con 0x7f4a9c0a0a70 2023-10-03T10:13:00.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.590+0000 7f4aa0c23700 1 -- 172.21.15.146:0/3237980985 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a9c126200 con 0x7f4a9c0a0a70 2023-10-03T10:13:00.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.591+0000 7f4a8affd700 1 -- 172.21.15.146:0/3237980985 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4a8c003a00 con 0x7f4a9c0a0a70 2023-10-03T10:13:00.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.591+0000 7f4a8affd700 1 -- 172.21.15.146:0/3237980985 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4a8c021070 con 0x7f4a9c0a0a70 2023-10-03T10:13:00.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.591+0000 7f4aa0c23700 1 -- 172.21.15.146:0/3237980985 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a9c126200 con 0x7f4a9c0a0a70 2023-10-03T10:13:00.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.600+0000 7f4a8affd700 1 -- 172.21.15.146:0/3237980985 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4a9c126200 con 0x7f4a9c0a0a70 2023-10-03T10:13:00.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.612+0000 7f743afc4700 1 Processor -- start 2023-10-03T10:13:00.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.612+0000 7f743afc4700 1 -- start start 2023-10-03T10:13:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.612+0000 7f743afc4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74340a1550 0x7f7434138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.612+0000 7f743afc4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7434139200 0x7f743413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.612+0000 7f743afc4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743409e9d0 con 0x7f74340a0a70 2023-10-03T10:13:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.612+0000 7f743afc4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743409dc00 con 0x7f7434139200 2023-10-03T10:13:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.612+0000 7f743afc4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743409dec0 con 0x7f74340a1550 2023-10-03T10:13:00.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.614+0000 7f7438d60700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f74340a0a70 0x7f74340a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39992/0 (socket says 172.21.15.146:39992) 2023-10-03T10:13:00.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.614+0000 7f7439561700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7434139200 0x7f743413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.614+0000 7f7438d60700 1 -- 172.21.15.146:0/3059218573 learned_addr learned my addr 172.21.15.146:0/3059218573 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:00.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.614+0000 7f7433fff700 1 --2- 172.21.15.146:0/3059218573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74340a1550 0x7f7434138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.614+0000 7f7439561700 1 -- 172.21.15.146:0/3059218573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74340a1550 msgr2=0x7f7434138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:00.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.614+0000 7f7439561700 1 --2- 172.21.15.146:0/3059218573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74340a1550 0x7f7434138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.614+0000 7f7439561700 1 -- 172.21.15.146:0/3059218573 >> v1:172.21.15.146:6789/0 conn(0x7f74340a0a70 legacy=0x7f74340a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.614+0000 7f7439561700 1 -- 172.21.15.146:0/3059218573 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743409e6a0 con 0x7f7434139200 2023-10-03T10:13:00.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.614+0000 7f74337fe700 1 -- 172.21.15.146:0/3059218573 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 992981616 0 0) 0x7f743409e9d0 con 0x7f74340a0a70 2023-10-03T10:13:00.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.614+0000 7f7439561700 1 --2- 172.21.15.146:0/3059218573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7434139200 0x7f743413b5e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f742c009d90 tx=0x7f742c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58557801451ed624 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.614+0000 7f74337fe700 1 -- 172.21.15.146:0/3059218573 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c00e070 con 0x7f7434139200 2023-10-03T10:13:00.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.614+0000 7f74337fe700 1 -- 172.21.15.146:0/3059218573 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742c00bb20 con 0x7f7434139200 2023-10-03T10:13:00.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.614+0000 7f74337fe700 1 -- 172.21.15.146:0/3059218573 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c012430 con 0x7f7434139200 2023-10-03T10:13:00.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.615+0000 7f743afc4700 1 -- 172.21.15.146:0/3059218573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7434139200 msgr2=0x7f743413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.615+0000 7f743afc4700 1 --2- 172.21.15.146:0/3059218573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7434139200 0x7f743413b5e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f742c009d90 tx=0x7f742c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.615+0000 7f743afc4700 1 -- 172.21.15.146:0/3059218573 shutdown_connections 2023-10-03T10:13:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.615+0000 7f743afc4700 1 --2- 172.21.15.146:0/3059218573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7434139200 0x7f743413b5e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.615+0000 7f743afc4700 1 --2- 172.21.15.146:0/3059218573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74340a1550 0x7f7434138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.615+0000 7f743afc4700 1 -- 172.21.15.146:0/3059218573 >> 172.21.15.146:0/3059218573 conn(0x7f74340a6610 msgr2=0x7f74340a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.616+0000 7f743afc4700 1 -- 172.21.15.146:0/3059218573 shutdown_connections 2023-10-03T10:13:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.616+0000 7f743afc4700 1 -- 172.21.15.146:0/3059218573 wait complete. 2023-10-03T10:13:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.617+0000 7f743afc4700 1 Processor -- start 2023-10-03T10:13:00.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.617+0000 7f743afc4700 1 -- start start 2023-10-03T10:13:00.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.618+0000 7f743afc4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f74340a0a70 0x7f7434120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.618+0000 7f743afc4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74340a1550 0x7f7434120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.618+0000 7f743afc4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7434139200 0x7f74341210a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.618+0000 7f743afc4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7434124140 con 0x7f74340a1550 2023-10-03T10:13:00.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.618+0000 7f743afc4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7434122850 con 0x7f7434139200 2023-10-03T10:13:00.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.618+0000 7f743afc4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74340a03e0 con 0x7f74340a0a70 2023-10-03T10:13:00.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.618+0000 7f7433fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74340a1550 0x7f7434120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.618+0000 7f7439561700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7434139200 0x7f74341210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.618+0000 7f7433fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74340a1550 0x7f7434120b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37942/0 (socket says 172.21.15.146:37942) 2023-10-03T10:13:00.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.618+0000 7f7433fff700 1 -- 172.21.15.146:0/2587795614 learned_addr learned my addr 172.21.15.146:0/2587795614 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:00.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.618+0000 7f7433fff700 1 -- 172.21.15.146:0/2587795614 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f74340a0a70 msgr2=0x7f7434120620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.618+0000 7f7433fff700 1 --2- 172.21.15.146:0/2587795614 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f74340a0a70 0x7f7434120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.618+0000 7f7433fff700 1 -- 172.21.15.146:0/2587795614 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7434139200 msgr2=0x7f74341210a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.618+0000 7f7433fff700 1 --2- 172.21.15.146:0/2587795614 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7434139200 0x7f74341210a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.618+0000 7f7433fff700 1 -- 172.21.15.146:0/2587795614 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c009a70 con 0x7f74340a1550 2023-10-03T10:13:00.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.618+0000 7f7439561700 1 --2- 172.21.15.146:0/2587795614 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7434139200 0x7f74341210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:00.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.618+0000 7f7433fff700 1 --2- 172.21.15.146:0/2587795614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74340a1550 0x7f7434120b60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f742000e9e0 tx=0x7f742000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.619+0000 7f74317fa700 1 -- 172.21.15.146:0/2587795614 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7420009710 con 0x7f74340a1550 2023-10-03T10:13:00.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.619+0000 7f74317fa700 1 -- 172.21.15.146:0/2587795614 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742000c850 con 0x7f74340a1550 2023-10-03T10:13:00.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.619+0000 7f743afc4700 1 -- 172.21.15.146:0/2587795614 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7434122230 con 0x7f74340a1550 2023-10-03T10:13:00.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.619+0000 7f74317fa700 1 -- 172.21.15.146:0/2587795614 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742000cbc0 con 0x7f74340a1550 2023-10-03T10:13:00.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.619+0000 7f743afc4700 1 -- 172.21.15.146:0/2587795614 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7434122a20 con 0x7f74340a1550 2023-10-03T10:13:00.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.620+0000 7f74317fa700 1 -- 172.21.15.146:0/2587795614 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f742000cd20 con 0x7f74340a1550 2023-10-03T10:13:00.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.620+0000 7f74317fa700 1 -- 172.21.15.146:0/2587795614 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f742003f7e0 con 0x7f74340a1550 2023-10-03T10:13:00.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.622+0000 7f743afc4700 1 -- 172.21.15.146:0/2587795614 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743404f2a0 con 0x7f74340a1550 2023-10-03T10:13:00.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.622+0000 7fb27f9cc700 1 Processor -- start 2023-10-03T10:13:00.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.623+0000 7fb27f9cc700 1 -- start start 2023-10-03T10:13:00.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.623+0000 7fb27f9cc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb27809d860 0x7fb27809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.623+0000 7fb27f9cc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb278130eb0 0x7fb278138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.623+0000 7fb27f9cc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27809aaa0 con 0x7fb27809e170 2023-10-03T10:13:00.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.623+0000 7fb27f9cc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27809f870 con 0x7fb278130eb0 2023-10-03T10:13:00.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.623+0000 7fb27f9cc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb27809b360 con 0x7fb27809d860 2023-10-03T10:13:00.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.623+0000 7fb27d768700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb27809d860 0x7fb27809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.623+0000 7fb27d768700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb27809d860 0x7fb27809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51774/0 (socket says 172.21.15.146:51774) 2023-10-03T10:13:00.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.623+0000 7fb27d768700 1 -- 172.21.15.146:0/2202939155 learned_addr learned my addr 172.21.15.146:0/2202939155 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:00.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.623+0000 7fb27df69700 1 --2- 172.21.15.146:0/2202939155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb278130eb0 0x7fb278138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.624+0000 7fb27d768700 1 -- 172.21.15.146:0/2202939155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb278130eb0 msgr2=0x7fb278138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:00.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.624+0000 7fb27d768700 1 --2- 172.21.15.146:0/2202939155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb278130eb0 0x7fb278138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.624+0000 7fb27d768700 1 -- 172.21.15.146:0/2202939155 >> v1:172.21.15.146:6789/0 conn(0x7fb27809e170 legacy=0x7fb2781307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:00.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.624+0000 7fb27d768700 1 -- 172.21.15.146:0/2202939155 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27809b620 con 0x7fb27809d860 2023-10-03T10:13:00.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.624+0000 7fb27d768700 1 --2- 172.21.15.146:0/2202939155 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb27809d860 0x7fb27809dc30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb27400bbc0 tx=0x7fb27400bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63a01d943b6cf737 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.624+0000 7fb26ffff700 1 -- 172.21.15.146:0/2202939155 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27400dcf0 con 0x7fb27809d860 2023-10-03T10:13:00.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.624+0000 7fb26ffff700 1 -- 172.21.15.146:0/2202939155 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27400de50 con 0x7fb27809d860 2023-10-03T10:13:00.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.624+0000 7fb26ffff700 1 -- 172.21.15.146:0/2202939155 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb274004250 con 0x7fb27809d860 2023-10-03T10:13:00.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.625+0000 7fb27f9cc700 1 -- 172.21.15.146:0/2202939155 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb27809d860 msgr2=0x7fb27809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.625+0000 7fb27f9cc700 1 --2- 172.21.15.146:0/2202939155 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb27809d860 0x7fb27809dc30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb27400bbc0 tx=0x7fb27400bed0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.625+0000 7fb27f9cc700 1 -- 172.21.15.146:0/2202939155 shutdown_connections 2023-10-03T10:13:00.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.625+0000 7fb27f9cc700 1 --2- 172.21.15.146:0/2202939155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb278130eb0 0x7fb278138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.625+0000 7fb27f9cc700 1 --2- 172.21.15.146:0/2202939155 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb27809d860 0x7fb27809dc30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.625+0000 7fb27f9cc700 1 -- 172.21.15.146:0/2202939155 >> 172.21.15.146:0/2202939155 conn(0x7fb278099c40 msgr2=0x7fb2780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.625+0000 7fb27f9cc700 1 -- 172.21.15.146:0/2202939155 shutdown_connections 2023-10-03T10:13:00.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.625+0000 7fb27f9cc700 1 -- 172.21.15.146:0/2202939155 wait complete. 2023-10-03T10:13:00.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.626+0000 7fb27f9cc700 1 Processor -- start 2023-10-03T10:13:00.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.626+0000 7fb27f9cc700 1 -- start start 2023-10-03T10:13:00.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.626+0000 7fb27f9cc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb27809e170 0x7fb2781c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.626+0000 7fb27f9cc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb278130eb0 0x7fb2781c4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.626+0000 7fb27f9cc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb27811e720 0x7fb27811ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.626+0000 7fb27f9cc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb278121c20 con 0x7fb278130eb0 2023-10-03T10:13:00.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.626+0000 7fb27f9cc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb278122e40 con 0x7fb27811e720 2023-10-03T10:13:00.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.626+0000 7fb27f9cc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2781c4fa0 con 0x7fb27809e170 2023-10-03T10:13:00.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.627+0000 7fb27df69700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb27811e720 0x7fb27811ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.627+0000 7fb27df69700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb27811e720 0x7fb27811ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53368/0 (socket says 172.21.15.146:53368) 2023-10-03T10:13:00.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.627+0000 7fb27df69700 1 -- 172.21.15.146:0/1552659197 learned_addr learned my addr 172.21.15.146:0/1552659197 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:00.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.627+0000 7fb27d768700 1 --2- 172.21.15.146:0/1552659197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb27809e170 0x7fb2781c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.627+0000 7fb27df69700 1 -- 172.21.15.146:0/1552659197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb27809e170 msgr2=0x7fb2781c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.627+0000 7fb27df69700 1 --2- 172.21.15.146:0/1552659197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb27809e170 0x7fb2781c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.627+0000 7fb27df69700 1 -- 172.21.15.146:0/1552659197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb278130eb0 msgr2=0x7fb2781c4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.627+0000 7fb27df69700 1 --2- 172.21.15.146:0/1552659197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb278130eb0 0x7fb2781c4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.627+0000 7fb27df69700 1 -- 172.21.15.146:0/1552659197 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27400b7f0 con 0x7fb27811e720 2023-10-03T10:13:00.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.627+0000 7fb27df69700 1 --2- 172.21.15.146:0/1552659197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb27811e720 0x7fb27811ebc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb270009dd0 tx=0x7fb27000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.627+0000 7fb26dffb700 1 -- 172.21.15.146:0/1552659197 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27000cce0 con 0x7fb27811e720 2023-10-03T10:13:00.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.628+0000 7fb27f9cc700 1 -- 172.21.15.146:0/1552659197 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2781221c0 con 0x7fb27811e720 2023-10-03T10:13:00.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.628+0000 7fb26dffb700 1 -- 172.21.15.146:0/1552659197 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27000f040 con 0x7fb27811e720 2023-10-03T10:13:00.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.628+0000 7fb26dffb700 1 -- 172.21.15.146:0/1552659197 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2700146c0 con 0x7fb27811e720 2023-10-03T10:13:00.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.628+0000 7fb27f9cc700 1 -- 172.21.15.146:0/1552659197 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2780a1e90 con 0x7fb27811e720 2023-10-03T10:13:00.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.629+0000 7fb27f9cc700 1 -- 172.21.15.146:0/1552659197 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27804f2a0 con 0x7fb27811e720 2023-10-03T10:13:00.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.629+0000 7fb26dffb700 1 -- 172.21.15.146:0/1552659197 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb270014820 con 0x7fb27811e720 2023-10-03T10:13:00.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.629+0000 7f74317fa700 1 -- 172.21.15.146:0/2587795614 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f74200232f0 con 0x7f74340a1550 2023-10-03T10:13:00.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.630+0000 7fb26dffb700 1 -- 172.21.15.146:0/1552659197 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb27000ce60 con 0x7fb27811e720 2023-10-03T10:13:00.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.634+0000 7fb26dffb700 1 -- 172.21.15.146:0/1552659197 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb270045060 con 0x7fb27811e720 2023-10-03T10:13:00.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.657+0000 7f3ea3d1c700 1 Processor -- start 2023-10-03T10:13:00.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.658+0000 7f3ea3d1c700 1 -- start start 2023-10-03T10:13:00.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.658+0000 7f3ea3d1c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9c09e870 0x7f3e9c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.658+0000 7f3ea3d1c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9c09f180 0x7f3e9c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.658+0000 7f3ea3d1c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3e9c131d70 0x7f3e9c132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.658+0000 7f3ea3d1c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e9c0a0920 con 0x7f3e9c131d70 2023-10-03T10:13:00.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.658+0000 7f3ea3d1c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c09c970 con 0x7f3e9c09e870 2023-10-03T10:13:00.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.658+0000 7f3ea3d1c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c09bab0 con 0x7f3e9c09f180 2023-10-03T10:13:00.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.658+0000 7f3ea1ab8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9c09e870 0x7f3e9c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.658+0000 7f3ea12b7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9c09f180 0x7f3e9c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.659+0000 7f3ea1ab8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9c09e870 0x7f3e9c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53378/0 (socket says 172.21.15.146:53378) 2023-10-03T10:13:00.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.659+0000 7f3ea1ab8700 1 -- 172.21.15.146:0/271436087 learned_addr learned my addr 172.21.15.146:0/271436087 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:00.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.659+0000 7f3ea22b9700 1 --2- 172.21.15.146:0/271436087 >> v2:172.21.15.146:3300/0 conn(0x7f3e9c131d70 0x7f3e9c132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.659+0000 7f3ea1ab8700 1 -- 172.21.15.146:0/271436087 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9c09f180 msgr2=0x7f3e9c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:00.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.659+0000 7f3ea1ab8700 1 --2- 172.21.15.146:0/271436087 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9c09f180 0x7f3e9c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.659+0000 7f3ea1ab8700 1 -- 172.21.15.146:0/271436087 >> v2:172.21.15.146:3300/0 conn(0x7f3e9c131d70 msgr2=0x7f3e9c132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:00.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.659+0000 7f3ea1ab8700 1 --2- 172.21.15.146:0/271436087 >> v2:172.21.15.146:3300/0 conn(0x7f3e9c131d70 0x7f3e9c132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.659+0000 7f3ea1ab8700 1 -- 172.21.15.146:0/271436087 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9c09f9c0 con 0x7f3e9c09e870 2023-10-03T10:13:00.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.659+0000 7f3ea12b7700 1 --2- 172.21.15.146:0/271436087 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9c09f180 0x7f3e9c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:00.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.659+0000 7f3ea1ab8700 1 --2- 172.21.15.146:0/271436087 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9c09e870 0x7f3e9c09ec40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3e980098f0 tx=0x7f3e98009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dc37365fe8eea71 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.659+0000 7f3ea0ab6700 1 -- 172.21.15.146:0/271436087 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e98011830 con 0x7f3e9c09e870 2023-10-03T10:13:00.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.659+0000 7f3ea0ab6700 1 -- 172.21.15.146:0/271436087 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e98011990 con 0x7f3e9c09e870 2023-10-03T10:13:00.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.659+0000 7f3ea0ab6700 1 -- 172.21.15.146:0/271436087 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e98011d20 con 0x7f3e9c09e870 2023-10-03T10:13:00.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.660+0000 7f3ea3d1c700 1 -- 172.21.15.146:0/271436087 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9c09e870 msgr2=0x7f3e9c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.660+0000 7f3ea3d1c700 1 --2- 172.21.15.146:0/271436087 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9c09e870 0x7f3e9c09ec40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3e980098f0 tx=0x7f3e98009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:00.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.660+0000 7f3ea3d1c700 1 -- 172.21.15.146:0/271436087 shutdown_connections 2023-10-03T10:13:00.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.660+0000 7f3ea3d1c700 1 --2- 172.21.15.146:0/271436087 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9c09e870 0x7f3e9c09ec40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.660+0000 7f3ea3d1c700 1 --2- 172.21.15.146:0/271436087 >> v2:172.21.15.146:3300/0 conn(0x7f3e9c131d70 0x7f3e9c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.660+0000 7f3ea3d1c700 1 --2- 172.21.15.146:0/271436087 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9c09f180 0x7f3e9c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.660+0000 7f3ea3d1c700 1 -- 172.21.15.146:0/271436087 >> 172.21.15.146:0/271436087 conn(0x7f3e9c0a4430 msgr2=0x7f3e9c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.660+0000 7f3ea3d1c700 1 -- 172.21.15.146:0/271436087 shutdown_connections 2023-10-03T10:13:00.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.660+0000 7f3ea3d1c700 1 -- 172.21.15.146:0/271436087 wait complete. 2023-10-03T10:13:00.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.661+0000 7f3ea3d1c700 1 Processor -- start 2023-10-03T10:13:00.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.661+0000 7f3ea3d1c700 1 -- start start 2023-10-03T10:13:00.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.661+0000 7f3ea3d1c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9c09e870 0x7f3e9c06c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.661+0000 7f3ea3d1c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e9c09f180 0x7f3e9c06c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.661+0000 7f3ea3d1c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9c131d70 0x7f3e9c1c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.661+0000 7f3ea3d1c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c120f90 con 0x7f3e9c09f180 2023-10-03T10:13:00.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.661+0000 7f3ea3d1c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c131450 con 0x7f3e9c131d70 2023-10-03T10:13:00.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.661+0000 7f3ea3d1c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c131620 con 0x7f3e9c09e870 2023-10-03T10:13:00.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.662+0000 7f3ea12b7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e9c09f180 0x7f3e9c06c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.662+0000 7f3ea12b7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e9c09f180 0x7f3e9c06c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37966/0 (socket says 172.21.15.146:37966) 2023-10-03T10:13:00.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.662+0000 7f3ea12b7700 1 -- 172.21.15.146:0/847224308 learned_addr learned my addr 172.21.15.146:0/847224308 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:00.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.662+0000 7f3ea1ab8700 1 --2- 172.21.15.146:0/847224308 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9c09e870 0x7f3e9c06c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.662+0000 7f3ea22b9700 1 --2- 172.21.15.146:0/847224308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9c131d70 0x7f3e9c1c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.662+0000 7f3ea12b7700 1 -- 172.21.15.146:0/847224308 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9c09e870 msgr2=0x7f3e9c06c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.662+0000 7f3ea12b7700 1 --2- 172.21.15.146:0/847224308 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9c09e870 0x7f3e9c06c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.662+0000 7f3ea12b7700 1 -- 172.21.15.146:0/847224308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9c131d70 msgr2=0x7f3e9c1c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.662+0000 7f3ea12b7700 1 --2- 172.21.15.146:0/847224308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9c131d70 0x7f3e9c1c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.662+0000 7f3ea12b7700 1 -- 172.21.15.146:0/847224308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c0094a0 con 0x7f3e9c09f180 2023-10-03T10:13:00.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.662+0000 7f3ea12b7700 1 --2- 172.21.15.146:0/847224308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e9c09f180 0x7f3e9c06c850 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c00ebe0 tx=0x7f3e8c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.663+0000 7f3e927fc700 1 -- 172.21.15.146:0/847224308 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c00c7f0 con 0x7f3e9c09f180 2023-10-03T10:13:00.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.663+0000 7f3e927fc700 1 -- 172.21.15.146:0/847224308 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8c00c950 con 0x7f3e9c09f180 2023-10-03T10:13:00.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.663+0000 7f3ea3d1c700 1 -- 172.21.15.146:0/847224308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e98009550 con 0x7f3e9c09f180 2023-10-03T10:13:00.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.663+0000 7f3ea3d1c700 1 -- 172.21.15.146:0/847224308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9c122380 con 0x7f3e9c09f180 2023-10-03T10:13:00.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.663+0000 7f3e927fc700 1 -- 172.21.15.146:0/847224308 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c00cce0 con 0x7f3e9c09f180 2023-10-03T10:13:00.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.664+0000 7f3e927fc700 1 -- 172.21.15.146:0/847224308 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e8c013470 con 0x7f3e9c09f180 2023-10-03T10:13:00.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.664+0000 7f3ea3d1c700 1 -- 172.21.15.146:0/847224308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e840052e0 con 0x7f3e9c09f180 2023-10-03T10:13:00.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.664+0000 7f3e927fc700 1 -- 172.21.15.146:0/847224308 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3e8c03fca0 con 0x7f3e9c09f180 2023-10-03T10:13:00.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.668+0000 7f3e927fc700 1 -- 172.21.15.146:0/847224308 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e8c013720 con 0x7f3e9c09f180 2023-10-03T10:13:00.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.811+0000 7f4aa0c23700 1 -- 172.21.15.146:0/3237980985 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4a9c126200 con 0x7f4a9c0a0a70 2023-10-03T10:13:00.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.811+0000 7f4a8affd700 1 -- 172.21.15.146:0/3237980985 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4a9c126200 con 0x7f4a9c0a0a70 2023-10-03T10:13:00.812 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:00.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.813+0000 7f4aa0c23700 1 -- 172.21.15.146:0/3237980985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a9c0a0a70 msgr2=0x7f4a9c1c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.813+0000 7f4aa0c23700 1 --2- 172.21.15.146:0/3237980985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a9c0a0a70 0x7f4a9c1c86f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c0090b0 tx=0x7f4a8c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:00.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.813+0000 7f4aa0c23700 1 -- 172.21.15.146:0/3237980985 shutdown_connections 2023-10-03T10:13:00.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.813+0000 7f4aa0c23700 1 --2- 172.21.15.146:0/3237980985 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a9c134120 0x7f4a9c122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.813+0000 7f4aa0c23700 1 --2- 172.21.15.146:0/3237980985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a9c0a0a70 0x7f4a9c1c86f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.813+0000 7f4aa0c23700 1 --2- 172.21.15.146:0/3237980985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a9c0a1380 0x7f4a9c1c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.813+0000 7f4aa0c23700 1 -- 172.21.15.146:0/3237980985 >> 172.21.15.146:0/3237980985 conn(0x7f4a9c0a6610 msgr2=0x7f4a9c0a5070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.814+0000 7f4aa0c23700 1 -- 172.21.15.146:0/3237980985 shutdown_connections 2023-10-03T10:13:00.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.814+0000 7f4aa0c23700 1 -- 172.21.15.146:0/3237980985 wait complete. 2023-10-03T10:13:00.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:00.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.830+0000 7fb27f9cc700 1 -- 172.21.15.146:0/1552659197 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb278121d60 con 0x7fb27811e720 2023-10-03T10:13:00.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.830+0000 7fb26dffb700 1 -- 172.21.15.146:0/1552659197 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb270045020 con 0x7fb27811e720 2023-10-03T10:13:00.831 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:00.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.832+0000 7fb27f9cc700 1 -- 172.21.15.146:0/1552659197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb27811e720 msgr2=0x7fb27811ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.832+0000 7fb27f9cc700 1 --2- 172.21.15.146:0/1552659197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb27811e720 0x7fb27811ebc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb270009dd0 tx=0x7fb27000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.832+0000 7fb27f9cc700 1 -- 172.21.15.146:0/1552659197 shutdown_connections 2023-10-03T10:13:00.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.832+0000 7fb27f9cc700 1 --2- 172.21.15.146:0/1552659197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb27811e720 0x7fb27811ebc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.832+0000 7fb27f9cc700 1 --2- 172.21.15.146:0/1552659197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb27809e170 0x7fb2781c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.832+0000 7fb27f9cc700 1 --2- 172.21.15.146:0/1552659197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb278130eb0 0x7fb2781c4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.832+0000 7fb27f9cc700 1 -- 172.21.15.146:0/1552659197 >> 172.21.15.146:0/1552659197 conn(0x7fb278099c40 msgr2=0x7fb2780a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.832+0000 7fb27f9cc700 1 -- 172.21.15.146:0/1552659197 shutdown_connections 2023-10-03T10:13:00.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.832+0000 7fb27f9cc700 1 -- 172.21.15.146:0/1552659197 wait complete. 2023-10-03T10:13:00.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:00.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.850+0000 7f743afc4700 1 -- 172.21.15.146:0/2587795614 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7434072980 con 0x7f74340a1550 2023-10-03T10:13:00.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.851+0000 7f74317fa700 1 -- 172.21.15.146:0/2587795614 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7420021020 con 0x7f74340a1550 2023-10-03T10:13:00.851 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:00.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.853+0000 7f743afc4700 1 -- 172.21.15.146:0/2587795614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74340a1550 msgr2=0x7f7434120b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.853+0000 7f743afc4700 1 --2- 172.21.15.146:0/2587795614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74340a1550 0x7f7434120b60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f742000e9e0 tx=0x7f742000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.853+0000 7f743afc4700 1 -- 172.21.15.146:0/2587795614 shutdown_connections 2023-10-03T10:13:00.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.853+0000 7f743afc4700 1 --2- 172.21.15.146:0/2587795614 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7434139200 0x7f74341210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.853+0000 7f743afc4700 1 --2- 172.21.15.146:0/2587795614 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f74340a0a70 0x7f7434120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.853+0000 7f743afc4700 1 --2- 172.21.15.146:0/2587795614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74340a1550 0x7f7434120b60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.853+0000 7f743afc4700 1 -- 172.21.15.146:0/2587795614 >> 172.21.15.146:0/2587795614 conn(0x7f74340a6610 msgr2=0x7f74340a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.853+0000 7f743afc4700 1 -- 172.21.15.146:0/2587795614 shutdown_connections 2023-10-03T10:13:00.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.853+0000 7f743afc4700 1 -- 172.21.15.146:0/2587795614 wait complete. 2023-10-03T10:13:00.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:00.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.886+0000 7f3ea3d1c700 1 -- 172.21.15.146:0/847224308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3e84005590 con 0x7f3e9c09f180 2023-10-03T10:13:00.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.886+0000 7f3e927fc700 1 -- 172.21.15.146:0/847224308 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3e8c017070 con 0x7f3e9c09f180 2023-10-03T10:13:00.887 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:00.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.888+0000 7f3ea3d1c700 1 -- 172.21.15.146:0/847224308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e9c09f180 msgr2=0x7f3e9c06c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.888+0000 7f3ea3d1c700 1 --2- 172.21.15.146:0/847224308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e9c09f180 0x7f3e9c06c850 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c00ebe0 tx=0x7f3e8c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.888+0000 7f3ea3d1c700 1 -- 172.21.15.146:0/847224308 shutdown_connections 2023-10-03T10:13:00.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.888+0000 7f3ea3d1c700 1 --2- 172.21.15.146:0/847224308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9c131d70 0x7f3e9c1c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.888+0000 7f3ea3d1c700 1 --2- 172.21.15.146:0/847224308 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9c09e870 0x7f3e9c06c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.888+0000 7f3ea3d1c700 1 --2- 172.21.15.146:0/847224308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e9c09f180 0x7f3e9c06c850 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.888+0000 7f3ea3d1c700 1 -- 172.21.15.146:0/847224308 >> 172.21.15.146:0/847224308 conn(0x7f3e9c0a4430 msgr2=0x7f3e9c1b9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.888+0000 7f3ea3d1c700 1 -- 172.21.15.146:0/847224308 shutdown_connections 2023-10-03T10:13:00.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:00.888+0000 7f3ea3d1c700 1 -- 172.21.15.146:0/847224308 wait complete. 2023-10-03T10:13:00.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:01.827 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:01.846 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:01.871 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:01.902 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:01.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.983+0000 7fa7cf152700 1 Processor -- start 2023-10-03T10:13:01.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.983+0000 7fa7cf152700 1 -- start start 2023-10-03T10:13:01.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.983+0000 7fa7cf152700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa7c809e870 0x7fa7c809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.983+0000 7fa7cf152700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7c809f180 0x7fa7c8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.983+0000 7fa7cf152700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c809c970 con 0x7fa7c8131d70 2023-10-03T10:13:01.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.983+0000 7fa7cf152700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c80a0920 con 0x7fa7c809e870 2023-10-03T10:13:01.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.983+0000 7fa7cf152700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c809f9c0 con 0x7fa7c809f180 2023-10-03T10:13:01.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.984+0000 7fa7c7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7c809f180 0x7fa7c8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.984+0000 7fa7cceee700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa7c809e870 0x7fa7c809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.984+0000 7fa7cd6ef700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa7c8131d70 0x7fa7c8138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40010/0 (socket says 172.21.15.146:40010) 2023-10-03T10:13:01.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.984+0000 7fa7cd6ef700 1 -- 172.21.15.146:0/2020050471 learned_addr learned my addr 172.21.15.146:0/2020050471 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:01.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.984+0000 7fa7c7fff700 1 -- 172.21.15.146:0/2020050471 >> v2:172.21.15.146:3300/0 conn(0x7fa7c809e870 msgr2=0x7fa7c809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:01.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.984+0000 7fa7c7fff700 1 --2- 172.21.15.146:0/2020050471 >> v2:172.21.15.146:3300/0 conn(0x7fa7c809e870 0x7fa7c809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.984+0000 7fa7c7fff700 1 -- 172.21.15.146:0/2020050471 >> v1:172.21.15.146:6789/0 conn(0x7fa7c8131d70 legacy=0x7fa7c8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.984+0000 7fa7c7fff700 1 -- 172.21.15.146:0/2020050471 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c809bab0 con 0x7fa7c809f180 2023-10-03T10:13:01.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.984+0000 7fa7cceee700 1 --2- 172.21.15.146:0/2020050471 >> v2:172.21.15.146:3300/0 conn(0x7fa7c809e870 0x7fa7c809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:01.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.984+0000 7fa7c7fff700 1 --2- 172.21.15.146:0/2020050471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7c809f180 0x7fa7c8131830 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009840 tx=0x7fa7b4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9f934da4817e29d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:01.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.984+0000 7fa7c77fe700 1 -- 172.21.15.146:0/2020050471 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4011830 con 0x7fa7c809f180 2023-10-03T10:13:01.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.984+0000 7fa7c77fe700 1 -- 172.21.15.146:0/2020050471 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b4011990 con 0x7fa7c809f180 2023-10-03T10:13:01.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.984+0000 7fa7c77fe700 1 -- 172.21.15.146:0/2020050471 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4011d20 con 0x7fa7c809f180 2023-10-03T10:13:01.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.985+0000 7fa7cf152700 1 -- 172.21.15.146:0/2020050471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7c809f180 msgr2=0x7fa7c8131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.985+0000 7fa7cf152700 1 --2- 172.21.15.146:0/2020050471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7c809f180 0x7fa7c8131830 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009840 tx=0x7fa7b4009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:01.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.985+0000 7fa7cf152700 1 -- 172.21.15.146:0/2020050471 shutdown_connections 2023-10-03T10:13:01.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.985+0000 7fa7cf152700 1 --2- 172.21.15.146:0/2020050471 >> v2:172.21.15.146:3300/0 conn(0x7fa7c809e870 0x7fa7c809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.985+0000 7fa7cf152700 1 --2- 172.21.15.146:0/2020050471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7c809f180 0x7fa7c8131830 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.985+0000 7fa7cf152700 1 -- 172.21.15.146:0/2020050471 >> 172.21.15.146:0/2020050471 conn(0x7fa7c80a4430 msgr2=0x7fa7c80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:01.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.985+0000 7fa7cf152700 1 -- 172.21.15.146:0/2020050471 shutdown_connections 2023-10-03T10:13:01.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.985+0000 7fa7cf152700 1 -- 172.21.15.146:0/2020050471 wait complete. 2023-10-03T10:13:01.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.987+0000 7fa7cf152700 1 Processor -- start 2023-10-03T10:13:01.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.987+0000 7fa7cf152700 1 -- start start 2023-10-03T10:13:01.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.988+0000 7fa7cf152700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7c809e870 0x7fa7c806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.988+0000 7fa7cf152700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7c809f180 0x7fa7c806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.988+0000 7fa7cf152700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7c8131d70 0x7fa7c806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.988+0000 7fa7cf152700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c8125d40 con 0x7fa7c809f180 2023-10-03T10:13:01.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.988+0000 7fa7cf152700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c806cd10 con 0x7fa7c809e870 2023-10-03T10:13:01.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.988+0000 7fa7cf152700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c8125f40 con 0x7fa7c8131d70 2023-10-03T10:13:01.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.988+0000 7fa7cceee700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7c809e870 0x7fa7c806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.988+0000 7fa7cceee700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7c809e870 0x7fa7c806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53402/0 (socket says 172.21.15.146:53402) 2023-10-03T10:13:01.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.988+0000 7fa7cceee700 1 -- 172.21.15.146:0/884138591 learned_addr learned my addr 172.21.15.146:0/884138591 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:01.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.988+0000 7fa7cd6ef700 1 --2- 172.21.15.146:0/884138591 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7c8131d70 0x7fa7c806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.988+0000 7fa7c7fff700 1 --2- 172.21.15.146:0/884138591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7c809f180 0x7fa7c806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.988+0000 7fa7cceee700 1 -- 172.21.15.146:0/884138591 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7c8131d70 msgr2=0x7fa7c806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.988+0000 7fa7cceee700 1 --2- 172.21.15.146:0/884138591 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7c8131d70 0x7fa7c806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.988+0000 7fa7cceee700 1 -- 172.21.15.146:0/884138591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7c809f180 msgr2=0x7fa7c806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.988+0000 7fa7cceee700 1 --2- 172.21.15.146:0/884138591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7c809f180 0x7fa7c806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.988+0000 7fa7cceee700 1 -- 172.21.15.146:0/884138591 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc0094a0 con 0x7fa7c809e870 2023-10-03T10:13:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.989+0000 7fa7cceee700 1 --2- 172.21.15.146:0/884138591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7c809e870 0x7fa7c806b8b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc00ec10 tx=0x7fa7bc00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.989+0000 7fa7c57fa700 1 -- 172.21.15.146:0/884138591 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc009760 con 0x7fa7c809e870 2023-10-03T10:13:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.989+0000 7fa7c57fa700 1 -- 172.21.15.146:0/884138591 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7bc00c850 con 0x7fa7c809e870 2023-10-03T10:13:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.989+0000 7fa7cf152700 1 -- 172.21.15.146:0/884138591 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b40094a0 con 0x7fa7c809e870 2023-10-03T10:13:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.989+0000 7fa7cf152700 1 -- 172.21.15.146:0/884138591 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c806d430 con 0x7fa7c809e870 2023-10-03T10:13:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.989+0000 7fa7c57fa700 1 -- 172.21.15.146:0/884138591 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc00cbe0 con 0x7fa7c809e870 2023-10-03T10:13:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.990+0000 7fa7c57fa700 1 -- 172.21.15.146:0/884138591 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa7bc00cd40 con 0x7fa7c809e870 2023-10-03T10:13:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.990+0000 7fa7c57fa700 1 -- 172.21.15.146:0/884138591 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa7bc03f810 con 0x7fa7c809e870 2023-10-03T10:13:01.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:01.991+0000 7fa7cf152700 1 -- 172.21.15.146:0/884138591 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a80052e0 con 0x7fa7c809e870 2023-10-03T10:13:02.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.000+0000 7fa7c57fa700 1 -- 172.21.15.146:0/884138591 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa7bc021020 con 0x7fa7c809e870 2023-10-03T10:13:02.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.008+0000 7f8cf5b6e700 1 Processor -- start 2023-10-03T10:13:02.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.009+0000 7f8cf5b6e700 1 -- start start 2023-10-03T10:13:02.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.009+0000 7f8cf5b6e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf00a0a30 0x7f8cf00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.009+0000 7f8cf5b6e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8cf0130670 0x7f8cf01381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.009+0000 7f8cf5b6e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf00a1e70 con 0x7f8cf00a1340 2023-10-03T10:13:02.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.009+0000 7f8cf5b6e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf009a720 con 0x7f8cf0130670 2023-10-03T10:13:02.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.009+0000 7f8cf5b6e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf009b300 con 0x7f8cf00a0a30 2023-10-03T10:13:02.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.009+0000 7f8ceffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8cf0130670 0x7f8cf01381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.009+0000 7f8ceeffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8cf00a1340 0x7f8cf012ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40020/0 (socket says 172.21.15.146:40020) 2023-10-03T10:13:02.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.009+0000 7f8ceeffd700 1 -- 172.21.15.146:0/834580160 learned_addr learned my addr 172.21.15.146:0/834580160 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:02.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.009+0000 7f8cef7fe700 1 --2- 172.21.15.146:0/834580160 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf00a0a30 0x7f8cf00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.010+0000 7f8ceffff700 1 -- 172.21.15.146:0/834580160 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf00a0a30 msgr2=0x7f8cf00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:02.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.010+0000 7f8ceffff700 1 --2- 172.21.15.146:0/834580160 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf00a0a30 0x7f8cf00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.010+0000 7f8ceffff700 1 -- 172.21.15.146:0/834580160 >> v1:172.21.15.146:6789/0 conn(0x7f8cf00a1340 legacy=0x7f8cf012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:02.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.010+0000 7f8ceffff700 1 -- 172.21.15.146:0/834580160 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf009abc0 con 0x7f8cf0130670 2023-10-03T10:13:02.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.010+0000 7f8cef7fe700 1 --2- 172.21.15.146:0/834580160 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf00a0a30 0x7f8cf00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:02.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.010+0000 7f8ceffff700 1 --2- 172.21.15.146:0/834580160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cf0130670 0x7f8cf01381c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009d90 tx=0x7f8ce800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35f6c6d8e151b84 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:02.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.010+0000 7f8cee7fc700 1 -- 172.21.15.146:0/834580160 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce800e070 con 0x7f8cf0130670 2023-10-03T10:13:02.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.010+0000 7f8cee7fc700 1 -- 172.21.15.146:0/834580160 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce800bb20 con 0x7f8cf0130670 2023-10-03T10:13:02.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.010+0000 7f8cee7fc700 1 -- 172.21.15.146:0/834580160 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8012430 con 0x7f8cf0130670 2023-10-03T10:13:02.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.011+0000 7f8cf5b6e700 1 -- 172.21.15.146:0/834580160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cf0130670 msgr2=0x7f8cf01381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:02.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.011+0000 7f8cf5b6e700 1 --2- 172.21.15.146:0/834580160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cf0130670 0x7f8cf01381c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009d90 tx=0x7f8ce800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:02.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.011+0000 7f8cf5b6e700 1 -- 172.21.15.146:0/834580160 shutdown_connections 2023-10-03T10:13:02.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.011+0000 7f8cf5b6e700 1 --2- 172.21.15.146:0/834580160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cf0130670 0x7f8cf01381c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.011+0000 7f8cf5b6e700 1 --2- 172.21.15.146:0/834580160 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf00a0a30 0x7f8cf00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.011+0000 7f8cf5b6e700 1 -- 172.21.15.146:0/834580160 >> 172.21.15.146:0/834580160 conn(0x7f8cf00a2980 msgr2=0x7f8cf00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:02.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.011+0000 7f8cf5b6e700 1 -- 172.21.15.146:0/834580160 shutdown_connections 2023-10-03T10:13:02.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.011+0000 7f8cf5b6e700 1 -- 172.21.15.146:0/834580160 wait complete. 2023-10-03T10:13:02.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.012+0000 7f8cf5b6e700 1 Processor -- start 2023-10-03T10:13:02.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.012+0000 7f8cf5b6e700 1 -- start start 2023-10-03T10:13:02.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.013+0000 7f8cf5b6e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cf00a0a30 0x7f8cf011bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.013+0000 7f8cf5b6e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf00a1340 0x7f8cf011c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.013+0000 7f8cf5b6e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf0130670 0x7f8cf01c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.013+0000 7f8cf5b6e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf011e800 con 0x7f8cf00a0a30 2023-10-03T10:13:02.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.013+0000 7f8cf5b6e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf011d8d0 con 0x7f8cf0130670 2023-10-03T10:13:02.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.013+0000 7f8cf5b6e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf012f950 con 0x7f8cf00a1340 2023-10-03T10:13:02.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.013+0000 7f8cef7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cf00a0a30 0x7f8cf011bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.013+0000 7f8ceeffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf00a1340 0x7f8cf011c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.013+0000 7f8cef7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cf00a0a30 0x7f8cf011bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37984/0 (socket says 172.21.15.146:37984) 2023-10-03T10:13:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.013+0000 7f8cef7fe700 1 -- 172.21.15.146:0/393358320 learned_addr learned my addr 172.21.15.146:0/393358320 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.013+0000 7f8ceffff700 1 --2- 172.21.15.146:0/393358320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf0130670 0x7f8cf01c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.013+0000 7f8ceeffd700 1 -- 172.21.15.146:0/393358320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf0130670 msgr2=0x7f8cf01c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.013+0000 7f8ceeffd700 1 --2- 172.21.15.146:0/393358320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf0130670 0x7f8cf01c5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.013+0000 7f8ceeffd700 1 -- 172.21.15.146:0/393358320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cf00a0a30 msgr2=0x7f8cf011bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.013+0000 7f8ceeffd700 1 --2- 172.21.15.146:0/393358320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cf00a0a30 0x7f8cf011bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.013+0000 7f8ceeffd700 1 -- 172.21.15.146:0/393358320 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce000a5d0 con 0x7f8cf00a1340 2023-10-03T10:13:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.014+0000 7f8ceeffd700 1 --2- 172.21.15.146:0/393358320 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf00a1340 0x7f8cf011c000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40016f0 tx=0x7f8ce4001a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.014+0000 7f8cd7fff700 1 -- 172.21.15.146:0/393358320 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce400c070 con 0x7f8cf00a1340 2023-10-03T10:13:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.014+0000 7f8cd7fff700 1 -- 172.21.15.146:0/393358320 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce4012070 con 0x7f8cf00a1340 2023-10-03T10:13:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.014+0000 7f8cd7fff700 1 -- 172.21.15.146:0/393358320 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce40070d0 con 0x7f8cf00a1340 2023-10-03T10:13:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.014+0000 7f8cf5b6e700 1 -- 172.21.15.146:0/393358320 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce8009a70 con 0x7f8cf00a1340 2023-10-03T10:13:02.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.014+0000 7f8cf5b6e700 1 -- 172.21.15.146:0/393358320 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf011b5e0 con 0x7f8cf00a1340 2023-10-03T10:13:02.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.015+0000 7f8cd7fff700 1 -- 172.21.15.146:0/393358320 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ce4007230 con 0x7f8cf00a1340 2023-10-03T10:13:02.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.015+0000 7f8cd7fff700 1 -- 172.21.15.146:0/393358320 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8ce403ecb0 con 0x7f8cf00a1340 2023-10-03T10:13:02.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.016+0000 7f8cf5b6e700 1 -- 172.21.15.146:0/393358320 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf004f2a0 con 0x7f8cf00a1340 2023-10-03T10:13:02.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.016+0000 7f6c1f581700 1 Processor -- start 2023-10-03T10:13:02.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.017+0000 7f6c1f581700 1 -- start start 2023-10-03T10:13:02.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.017+0000 7f6c1f581700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c180a0a30 0x7f6c180a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.017+0000 7f6c1f581700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6c180a1340 0x7f6c1812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.017+0000 7f6c1f581700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c181304a0 0x7f6c18130940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.017+0000 7f6c1f581700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c180a1e70 con 0x7f6c180a1340 2023-10-03T10:13:02.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.017+0000 7f6c1f581700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1809a720 con 0x7f6c181304a0 2023-10-03T10:13:02.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.017+0000 7f6c1f581700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1809b300 con 0x7f6c180a0a30 2023-10-03T10:13:02.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.018+0000 7f6c1d31d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c180a0a30 0x7f6c180a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.018+0000 7f6c1d31d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c180a0a30 0x7f6c180a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51844/0 (socket says 172.21.15.146:51844) 2023-10-03T10:13:02.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.018+0000 7f6c1d31d700 1 -- 172.21.15.146:0/454746977 learned_addr learned my addr 172.21.15.146:0/454746977 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:02.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.018+0000 7f6c1cb1c700 1 --2- 172.21.15.146:0/454746977 >> v2:172.21.15.146:3300/0 conn(0x7f6c180a1340 0x7f6c1812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.018+0000 7f6c1db1e700 1 --2- 172.21.15.146:0/454746977 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c181304a0 0x7f6c18130940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.018+0000 7f6c1d31d700 1 -- 172.21.15.146:0/454746977 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c181304a0 msgr2=0x7f6c18130940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:02.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.018+0000 7f6c1d31d700 1 --2- 172.21.15.146:0/454746977 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c181304a0 0x7f6c18130940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.018+0000 7f6c1d31d700 1 -- 172.21.15.146:0/454746977 >> v2:172.21.15.146:3300/0 conn(0x7f6c180a1340 msgr2=0x7f6c1812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:02.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.018+0000 7f6c1d31d700 1 --2- 172.21.15.146:0/454746977 >> v2:172.21.15.146:3300/0 conn(0x7f6c180a1340 0x7f6c1812ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.018+0000 7f6c1d31d700 1 -- 172.21.15.146:0/454746977 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1809abc0 con 0x7f6c180a0a30 2023-10-03T10:13:02.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.018+0000 7f6c1db1e700 1 --2- 172.21.15.146:0/454746977 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c181304a0 0x7f6c18130940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:02.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.018+0000 7f6c1d31d700 1 --2- 172.21.15.146:0/454746977 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c180a0a30 0x7f6c180a0e00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6c14006fd0 tx=0x7f6c1400bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=974f67c55f107657 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:02.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.021+0000 7f6c0ffff700 1 -- 172.21.15.146:0/454746977 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c14009070 con 0x7f6c180a0a30 2023-10-03T10:13:02.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.021+0000 7f6c0ffff700 1 -- 172.21.15.146:0/454746977 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c14005e30 con 0x7f6c180a0a30 2023-10-03T10:13:02.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.021+0000 7f6c0ffff700 1 -- 172.21.15.146:0/454746977 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c14004270 con 0x7f6c180a0a30 2023-10-03T10:13:02.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.022+0000 7f8cd7fff700 1 -- 172.21.15.146:0/393358320 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ce401c080 con 0x7f8cf00a1340 2023-10-03T10:13:02.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.022+0000 7f6c1f581700 1 -- 172.21.15.146:0/454746977 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c180a0a30 msgr2=0x7f6c180a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:02.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.022+0000 7f6c1f581700 1 --2- 172.21.15.146:0/454746977 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c180a0a30 0x7f6c180a0e00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6c14006fd0 tx=0x7f6c1400bc80 comp rx=0 tx=0).stop 2023-10-03T10:13:02.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.025+0000 7f6c1f581700 1 -- 172.21.15.146:0/454746977 shutdown_connections 2023-10-03T10:13:02.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.025+0000 7f6c1f581700 1 --2- 172.21.15.146:0/454746977 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c181304a0 0x7f6c18130940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.025+0000 7f6c1f581700 1 --2- 172.21.15.146:0/454746977 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c180a0a30 0x7f6c180a0e00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.025+0000 7f6c1f581700 1 --2- 172.21.15.146:0/454746977 >> v2:172.21.15.146:3300/0 conn(0x7f6c180a1340 0x7f6c1812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.025+0000 7f6c1f581700 1 -- 172.21.15.146:0/454746977 >> 172.21.15.146:0/454746977 conn(0x7f6c180a2980 msgr2=0x7f6c180a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:02.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.025+0000 7f6c1f581700 1 -- 172.21.15.146:0/454746977 shutdown_connections 2023-10-03T10:13:02.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.025+0000 7f6c1f581700 1 -- 172.21.15.146:0/454746977 wait complete. 2023-10-03T10:13:02.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.026+0000 7f6c1f581700 1 Processor -- start 2023-10-03T10:13:02.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.026+0000 7f6c1f581700 1 -- start start 2023-10-03T10:13:02.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.027+0000 7f6c1f581700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c180a0a30 0x7f6c1811bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.027+0000 7f6c1f581700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c180a1340 0x7f6c1811c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.027+0000 7f6c1f581700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c181304a0 0x7f6c181c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.027+0000 7f6c1f581700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1811eb90 con 0x7f6c181304a0 2023-10-03T10:13:02.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.027+0000 7f6c1f581700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1812fc00 con 0x7f6c180a1340 2023-10-03T10:13:02.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.027+0000 7f6c1f581700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1811b730 con 0x7f6c180a0a30 2023-10-03T10:13:02.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.027+0000 7f6c1db1e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c181304a0 0x7f6c181c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.027+0000 7f6c1d31d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c180a0a30 0x7f6c1811bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.027+0000 7f6c1db1e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c181304a0 0x7f6c181c3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38014/0 (socket says 172.21.15.146:38014) 2023-10-03T10:13:02.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.027+0000 7f6c1d31d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c180a0a30 0x7f6c1811bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51856/0 (socket says 172.21.15.146:51856) 2023-10-03T10:13:02.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.027+0000 7f6c1db1e700 1 -- 172.21.15.146:0/1571638429 learned_addr learned my addr 172.21.15.146:0/1571638429 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:02.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.027+0000 7f6c1db1e700 1 -- 172.21.15.146:0/1571638429 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c180a0a30 msgr2=0x7f6c1811bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:02.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.027+0000 7f6c1db1e700 1 --2- 172.21.15.146:0/1571638429 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c180a0a30 0x7f6c1811bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.027+0000 7f6c1db1e700 1 -- 172.21.15.146:0/1571638429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c180a1340 msgr2=0x7f6c1811c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:02.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.027+0000 7f6c1db1e700 1 --2- 172.21.15.146:0/1571638429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c180a1340 0x7f6c1811c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.027+0000 7f6c1db1e700 1 -- 172.21.15.146:0/1571638429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1400b5b0 con 0x7f6c181304a0 2023-10-03T10:13:02.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.028+0000 7f6c1db1e700 1 --2- 172.21.15.146:0/1571638429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c181304a0 0x7f6c181c3f90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6c10007f20 tx=0x7f6c1000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:02.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.028+0000 7f6c0dffb700 1 -- 172.21.15.146:0/1571638429 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1000dde0 con 0x7f6c181304a0 2023-10-03T10:13:02.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.028+0000 7f6c0dffb700 1 -- 172.21.15.146:0/1571638429 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1000f040 con 0x7f6c181304a0 2023-10-03T10:13:02.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.028+0000 7f6c0dffb700 1 -- 172.21.15.146:0/1571638429 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10003c60 con 0x7f6c181304a0 2023-10-03T10:13:02.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.028+0000 7f6c1f581700 1 -- 172.21.15.146:0/1571638429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c1811ce80 con 0x7f6c181304a0 2023-10-03T10:13:02.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.028+0000 7f6c1f581700 1 -- 172.21.15.146:0/1571638429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c1811ddd0 con 0x7f6c181304a0 2023-10-03T10:13:02.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.029+0000 7f6c0dffb700 1 -- 172.21.15.146:0/1571638429 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c10004030 con 0x7f6c181304a0 2023-10-03T10:13:02.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.029+0000 7f6c0dffb700 1 -- 172.21.15.146:0/1571638429 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6c10041800 con 0x7f6c181304a0 2023-10-03T10:13:02.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.029+0000 7f6c1f581700 1 -- 172.21.15.146:0/1571638429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1804f2a0 con 0x7f6c181304a0 2023-10-03T10:13:02.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.034+0000 7f6c0dffb700 1 -- 172.21.15.146:0/1571638429 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c1001a080 con 0x7f6c181304a0 2023-10-03T10:13:02.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.058+0000 7f55c97e9700 1 Processor -- start 2023-10-03T10:13:02.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.058+0000 7f55c97e9700 1 -- start start 2023-10-03T10:13:02.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.058+0000 7f55c97e9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55c41319f0 0x7f55c4131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.058+0000 7f55c97e9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f55c409bc70 0x7f55c409c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.058+0000 7f55c97e9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55c409c5e0 0x7f55c4138770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.058+0000 7f55c97e9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c40a2590 con 0x7f55c409bc70 2023-10-03T10:13:02.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.058+0000 7f55c97e9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c406eaa0 con 0x7f55c409c5e0 2023-10-03T10:13:02.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.058+0000 7f55c97e9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55c41315c0 con 0x7f55c41319f0 2023-10-03T10:13:02.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.058+0000 7f55c27fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f55c409bc70 0x7f55c409c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.058+0000 7f55c27fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f55c409bc70 0x7f55c409c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38020/0 (socket says 172.21.15.146:38020) 2023-10-03T10:13:02.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.058+0000 7f55c27fc700 1 -- 172.21.15.146:0/4147193253 learned_addr learned my addr 172.21.15.146:0/4147193253 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:02.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.058+0000 7f55c2ffd700 1 --2- 172.21.15.146:0/4147193253 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55c41319f0 0x7f55c4131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.059+0000 7f55c37fe700 1 --2- 172.21.15.146:0/4147193253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55c409c5e0 0x7f55c4138770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.059+0000 7f55c37fe700 1 -- 172.21.15.146:0/4147193253 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55c41319f0 msgr2=0x7f55c4131dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:02.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.059+0000 7f55c37fe700 1 --2- 172.21.15.146:0/4147193253 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55c41319f0 0x7f55c4131dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.059+0000 7f55c37fe700 1 -- 172.21.15.146:0/4147193253 >> v2:172.21.15.146:3300/0 conn(0x7f55c409bc70 msgr2=0x7f55c409c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:02.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.059+0000 7f55c37fe700 1 --2- 172.21.15.146:0/4147193253 >> v2:172.21.15.146:3300/0 conn(0x7f55c409bc70 0x7f55c409c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.059+0000 7f55c37fe700 1 -- 172.21.15.146:0/4147193253 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c40a1640 con 0x7f55c409c5e0 2023-10-03T10:13:02.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.059+0000 7f55c37fe700 1 --2- 172.21.15.146:0/4147193253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55c409c5e0 0x7f55c4138770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f55bc009d90 tx=0x7f55bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f62f6a99ed456d2d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:02.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.059+0000 7f55c1ffb700 1 -- 172.21.15.146:0/4147193253 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc00e070 con 0x7f55c409c5e0 2023-10-03T10:13:02.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.059+0000 7f55c1ffb700 1 -- 172.21.15.146:0/4147193253 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc00bb20 con 0x7f55c409c5e0 2023-10-03T10:13:02.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.059+0000 7f55c1ffb700 1 -- 172.21.15.146:0/4147193253 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc012430 con 0x7f55c409c5e0 2023-10-03T10:13:02.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.060+0000 7f55c97e9700 1 -- 172.21.15.146:0/4147193253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55c409c5e0 msgr2=0x7f55c4138770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:02.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.060+0000 7f55c97e9700 1 --2- 172.21.15.146:0/4147193253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55c409c5e0 0x7f55c4138770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f55bc009d90 tx=0x7f55bc00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:02.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.060+0000 7f55c97e9700 1 -- 172.21.15.146:0/4147193253 shutdown_connections 2023-10-03T10:13:02.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.060+0000 7f55c97e9700 1 --2- 172.21.15.146:0/4147193253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55c409c5e0 0x7f55c4138770 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.060+0000 7f55c97e9700 1 --2- 172.21.15.146:0/4147193253 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55c41319f0 0x7f55c4131dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.060+0000 7f55c97e9700 1 --2- 172.21.15.146:0/4147193253 >> v2:172.21.15.146:3300/0 conn(0x7f55c409bc70 0x7f55c409c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.060+0000 7f55c97e9700 1 -- 172.21.15.146:0/4147193253 >> 172.21.15.146:0/4147193253 conn(0x7f55c40a2980 msgr2=0x7f55c40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:02.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.060+0000 7f55c97e9700 1 -- 172.21.15.146:0/4147193253 shutdown_connections 2023-10-03T10:13:02.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.060+0000 7f55c97e9700 1 -- 172.21.15.146:0/4147193253 wait complete. 2023-10-03T10:13:02.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.061+0000 7f55c97e9700 1 Processor -- start 2023-10-03T10:13:02.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.061+0000 7f55c97e9700 1 -- start start 2023-10-03T10:13:02.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.062+0000 7f55c97e9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55c409bc70 0x7f55c4099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.062+0000 7f55c97e9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55c409c5e0 0x7f55c4099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.062+0000 7f55c97e9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55c41319f0 0x7f55c409a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:02.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.062+0000 7f55c97e9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c409af60 con 0x7f55c409c5e0 2023-10-03T10:13:02.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.062+0000 7f55c97e9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c412ec70 con 0x7f55c41319f0 2023-10-03T10:13:02.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.062+0000 7f55c97e9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55c4120e20 con 0x7f55c409bc70 2023-10-03T10:13:02.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.062+0000 7f55c2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55c409bc70 0x7f55c4099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.062+0000 7f55c37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55c41319f0 0x7f55c409a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.062+0000 7f55c37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55c41319f0 0x7f55c409a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53446/0 (socket says 172.21.15.146:53446) 2023-10-03T10:13:02.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.062+0000 7f55c2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55c409bc70 0x7f55c4099a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51862/0 (socket says 172.21.15.146:51862) 2023-10-03T10:13:02.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.062+0000 7f55c37fe700 1 -- 172.21.15.146:0/1822989636 learned_addr learned my addr 172.21.15.146:0/1822989636 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:02.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.062+0000 7f55c27fc700 1 --2- 172.21.15.146:0/1822989636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55c409c5e0 0x7f55c4099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:02.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.062+0000 7f55c37fe700 1 -- 172.21.15.146:0/1822989636 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55c409bc70 msgr2=0x7f55c4099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:02.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.062+0000 7f55c37fe700 1 --2- 172.21.15.146:0/1822989636 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55c409bc70 0x7f55c4099a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.062+0000 7f55c37fe700 1 -- 172.21.15.146:0/1822989636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55c409c5e0 msgr2=0x7f55c4099fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:02.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.062+0000 7f55c37fe700 1 --2- 172.21.15.146:0/1822989636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55c409c5e0 0x7f55c4099fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.062+0000 7f55c37fe700 1 -- 172.21.15.146:0/1822989636 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55bc009a70 con 0x7f55c41319f0 2023-10-03T10:13:02.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.062+0000 7f55c37fe700 1 --2- 172.21.15.146:0/1822989636 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55c41319f0 0x7f55c409a510 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f55bc014040 tx=0x7f55bc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:02.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.062+0000 7f55ab7fe700 1 -- 172.21.15.146:0/1822989636 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc004450 con 0x7f55c41319f0 2023-10-03T10:13:02.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.062+0000 7f55ab7fe700 1 -- 172.21.15.146:0/1822989636 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc020070 con 0x7f55c41319f0 2023-10-03T10:13:02.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.063+0000 7f55c97e9700 1 -- 172.21.15.146:0/1822989636 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c4120340 con 0x7f55c41319f0 2023-10-03T10:13:02.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.063+0000 7f55ab7fe700 1 -- 172.21.15.146:0/1822989636 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc004810 con 0x7f55c41319f0 2023-10-03T10:13:02.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.063+0000 7f55c97e9700 1 -- 172.21.15.146:0/1822989636 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c4130cf0 con 0x7f55c41319f0 2023-10-03T10:13:02.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.064+0000 7f55c97e9700 1 -- 172.21.15.146:0/1822989636 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c40a1cb0 con 0x7f55c41319f0 2023-10-03T10:13:02.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.064+0000 7f55ab7fe700 1 -- 172.21.15.146:0/1822989636 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f55bc012430 con 0x7f55c41319f0 2023-10-03T10:13:02.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.064+0000 7f55ab7fe700 1 -- 172.21.15.146:0/1822989636 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f55bc022070 con 0x7f55c41319f0 2023-10-03T10:13:02.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.073+0000 7f55ab7fe700 1 -- 172.21.15.146:0/1822989636 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f55bc011750 con 0x7f55c41319f0 2023-10-03T10:13:02.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.205+0000 7fa7cf152700 1 -- 172.21.15.146:0/884138591 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa7a8005590 con 0x7fa7c809e870 2023-10-03T10:13:02.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.205+0000 7fa7c57fa700 1 -- 172.21.15.146:0/884138591 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa7bc0232f0 con 0x7fa7c809e870 2023-10-03T10:13:02.591 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:02.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.207+0000 7fa7cf152700 1 -- 172.21.15.146:0/884138591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7c809e870 msgr2=0x7fa7c806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:02.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.207+0000 7fa7cf152700 1 --2- 172.21.15.146:0/884138591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7c809e870 0x7fa7c806b8b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc00ec10 tx=0x7fa7bc00ef20 comp rx=0 tx=0).stop 2023-10-03T10:13:02.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.208+0000 7fa7cf152700 1 -- 172.21.15.146:0/884138591 shutdown_connections 2023-10-03T10:13:02.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.208+0000 7fa7cf152700 1 --2- 172.21.15.146:0/884138591 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7c8131d70 0x7fa7c806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.208+0000 7fa7cf152700 1 --2- 172.21.15.146:0/884138591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7c809e870 0x7fa7c806b8b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.208+0000 7fa7cf152700 1 --2- 172.21.15.146:0/884138591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7c809f180 0x7fa7c806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.208+0000 7fa7cf152700 1 -- 172.21.15.146:0/884138591 >> 172.21.15.146:0/884138591 conn(0x7fa7c80a4430 msgr2=0x7fa7c80a0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:02.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.208+0000 7fa7cf152700 1 -- 172.21.15.146:0/884138591 shutdown_connections 2023-10-03T10:13:02.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.208+0000 7fa7cf152700 1 -- 172.21.15.146:0/884138591 wait complete. 2023-10-03T10:13:02.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:02.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.225+0000 7f8cf5b6e700 1 -- 172.21.15.146:0/393358320 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8cf012fd40 con 0x7f8cf00a1340 2023-10-03T10:13:02.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.225+0000 7f8cd7fff700 1 -- 172.21.15.146:0/393358320 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8ce401f350 con 0x7f8cf00a1340 2023-10-03T10:13:02.594 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:02.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.227+0000 7f8cf5b6e700 1 -- 172.21.15.146:0/393358320 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf00a1340 msgr2=0x7f8cf011c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:02.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.227+0000 7f8cf5b6e700 1 --2- 172.21.15.146:0/393358320 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf00a1340 0x7f8cf011c000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40016f0 tx=0x7f8ce4001a00 comp rx=0 tx=0).stop 2023-10-03T10:13:02.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.227+0000 7f8cf5b6e700 1 -- 172.21.15.146:0/393358320 shutdown_connections 2023-10-03T10:13:02.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.227+0000 7f8cf5b6e700 1 --2- 172.21.15.146:0/393358320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cf0130670 0x7f8cf01c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.227+0000 7f8cf5b6e700 1 --2- 172.21.15.146:0/393358320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cf00a0a30 0x7f8cf011bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.227+0000 7f8cf5b6e700 1 --2- 172.21.15.146:0/393358320 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8cf00a1340 0x7f8cf011c000 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.227+0000 7f8cf5b6e700 1 -- 172.21.15.146:0/393358320 >> 172.21.15.146:0/393358320 conn(0x7f8cf00a2980 msgr2=0x7f8cf01b9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:02.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.227+0000 7f8cf5b6e700 1 -- 172.21.15.146:0/393358320 shutdown_connections 2023-10-03T10:13:02.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.227+0000 7f8cf5b6e700 1 -- 172.21.15.146:0/393358320 wait complete. 2023-10-03T10:13:02.596 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:02.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.245+0000 7f6c1f581700 1 -- 172.21.15.146:0/1571638429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6c18071c40 con 0x7f6c181304a0 2023-10-03T10:13:02.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.246+0000 7f6c0dffb700 1 -- 172.21.15.146:0/1571638429 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c1811ddd0 con 0x7f6c181304a0 2023-10-03T10:13:02.915 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:02.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.248+0000 7f6c1f581700 1 -- 172.21.15.146:0/1571638429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c181304a0 msgr2=0x7f6c181c3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:02.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.248+0000 7f6c1f581700 1 --2- 172.21.15.146:0/1571638429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c181304a0 0x7f6c181c3f90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6c10007f20 tx=0x7f6c1000d3b0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.248+0000 7f6c1f581700 1 -- 172.21.15.146:0/1571638429 shutdown_connections 2023-10-03T10:13:02.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.248+0000 7f6c1f581700 1 --2- 172.21.15.146:0/1571638429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c181304a0 0x7f6c181c3f90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.248+0000 7f6c1f581700 1 --2- 172.21.15.146:0/1571638429 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c180a0a30 0x7f6c1811bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.248+0000 7f6c1f581700 1 --2- 172.21.15.146:0/1571638429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c180a1340 0x7f6c1811c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.248+0000 7f6c1f581700 1 -- 172.21.15.146:0/1571638429 >> 172.21.15.146:0/1571638429 conn(0x7f6c180a2980 msgr2=0x7f6c181b78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:02.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.248+0000 7f6c1f581700 1 -- 172.21.15.146:0/1571638429 shutdown_connections 2023-10-03T10:13:02.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.248+0000 7f6c1f581700 1 -- 172.21.15.146:0/1571638429 wait complete. 2023-10-03T10:13:02.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:02.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.283+0000 7f55c97e9700 1 -- 172.21.15.146:0/1822989636 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f55c406b720 con 0x7f55c41319f0 2023-10-03T10:13:02.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.284+0000 7f55ab7fe700 1 -- 172.21.15.146:0/1822989636 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f55bc035090 con 0x7f55c41319f0 2023-10-03T10:13:02.917 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:02.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.286+0000 7f55c97e9700 1 -- 172.21.15.146:0/1822989636 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55c41319f0 msgr2=0x7f55c409a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:02.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.286+0000 7f55c97e9700 1 --2- 172.21.15.146:0/1822989636 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55c41319f0 0x7f55c409a510 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f55bc014040 tx=0x7f55bc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.286+0000 7f55c97e9700 1 -- 172.21.15.146:0/1822989636 shutdown_connections 2023-10-03T10:13:02.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.286+0000 7f55c97e9700 1 --2- 172.21.15.146:0/1822989636 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55c41319f0 0x7f55c409a510 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.286+0000 7f55c97e9700 1 --2- 172.21.15.146:0/1822989636 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55c409bc70 0x7f55c4099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.286+0000 7f55c97e9700 1 --2- 172.21.15.146:0/1822989636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55c409c5e0 0x7f55c4099fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:02.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.286+0000 7f55c97e9700 1 -- 172.21.15.146:0/1822989636 >> 172.21.15.146:0/1822989636 conn(0x7f55c40a2980 msgr2=0x7f55c40714e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:02.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.286+0000 7f55c97e9700 1 -- 172.21.15.146:0/1822989636 shutdown_connections 2023-10-03T10:13:02.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:02.286+0000 7f55c97e9700 1 -- 172.21.15.146:0/1822989636 wait complete. 2023-10-03T10:13:02.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:03.594 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:03.597 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:03.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.733+0000 7fbf67274700 1 Processor -- start 2023-10-03T10:13:03.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.733+0000 7fa0f3539700 1 Processor -- start 2023-10-03T10:13:03.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.733+0000 7fbf67274700 1 -- start start 2023-10-03T10:13:03.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.733+0000 7fa0f3539700 1 -- start start 2023-10-03T10:13:03.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fbf67274700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbf6009e950 0x7fbf6009ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fbf67274700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6009f260 0x7fbf60131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fbf67274700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6009afb0 con 0x7fbf60131dd0 2023-10-03T10:13:03.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fbf67274700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf600a0970 con 0x7fbf6009e950 2023-10-03T10:13:03.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fbf67274700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf600a0320 con 0x7fbf6009f260 2023-10-03T10:13:03.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fa0f3539700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0ec133ad0 0x7fa0ec133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fa0f3539700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0ec1300a0 0x7fa0ec1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fa0f3539700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0ec06b2d0 con 0x7fa0ec1309f0 2023-10-03T10:13:03.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fa0f3539700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec133610 con 0x7fa0ec133ad0 2023-10-03T10:13:03.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fa0f3539700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec09a500 con 0x7fa0ec1300a0 2023-10-03T10:13:03.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fa0f1ad6700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa0ec1309f0 0x7fa0ec13a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40052/0 (socket says 172.21.15.146:40052) 2023-10-03T10:13:03.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fa0f12d5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0ec133ad0 0x7fa0ec133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fa0f1ad6700 1 -- 172.21.15.146:0/3316524317 learned_addr learned my addr 172.21.15.146:0/3316524317 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:03.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fa0f0ad4700 1 --2- 172.21.15.146:0/3316524317 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0ec1300a0 0x7fa0ec1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fbf6480f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6009f260 0x7fbf60131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fbf65811700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbf60131dd0 0x7fbf60138ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40036/0 (socket says 172.21.15.146:40036) 2023-10-03T10:13:03.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fbf65811700 1 -- 172.21.15.146:0/2658182704 learned_addr learned my addr 172.21.15.146:0/2658182704 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:03.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fbf65010700 1 --2- 172.21.15.146:0/2658182704 >> v2:172.21.15.146:3300/0 conn(0x7fbf6009e950 0x7fbf6009ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fa0f12d5700 1 -- 172.21.15.146:0/3316524317 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0ec1300a0 msgr2=0x7fa0ec1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:03.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fa0f12d5700 1 --2- 172.21.15.146:0/3316524317 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0ec1300a0 0x7fa0ec1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fa0f12d5700 1 -- 172.21.15.146:0/3316524317 >> v1:172.21.15.146:6789/0 conn(0x7fa0ec1309f0 legacy=0x7fa0ec13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:03.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fa0f12d5700 1 -- 172.21.15.146:0/3316524317 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ec1338b0 con 0x7fa0ec133ad0 2023-10-03T10:13:03.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fbf6480f700 1 -- 172.21.15.146:0/2658182704 >> v2:172.21.15.146:3300/0 conn(0x7fbf6009e950 msgr2=0x7fbf6009ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:03.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fbf6480f700 1 --2- 172.21.15.146:0/2658182704 >> v2:172.21.15.146:3300/0 conn(0x7fbf6009e950 0x7fbf6009ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fbf57fff700 1 -- 172.21.15.146:0/2658182704 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301494923 0 0) 0x7fbf6009afb0 con 0x7fbf60131dd0 2023-10-03T10:13:03.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fbf6480f700 1 -- 172.21.15.146:0/2658182704 >> v1:172.21.15.146:6789/0 conn(0x7fbf60131dd0 legacy=0x7fbf60138ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.734+0000 7fbf6480f700 1 -- 172.21.15.146:0/2658182704 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf600a0750 con 0x7fbf6009f260 2023-10-03T10:13:03.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.735+0000 7fbf6480f700 1 --2- 172.21.15.146:0/2658182704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6009f260 0x7fbf60131890 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000f9b0 tx=0x7fbf5000fcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72ba6c000f28f5ed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.735+0000 7fa0f12d5700 1 --2- 172.21.15.146:0/3316524317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0ec133ad0 0x7fa0ec133ea0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009870 tx=0x7fa0e8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c48299f0a289eb14 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.735+0000 7fa0e3fff700 1 -- 172.21.15.146:0/3316524317 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8004230 con 0x7fa0ec133ad0 2023-10-03T10:13:03.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.735+0000 7fa0e3fff700 1 -- 172.21.15.146:0/3316524317 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e8004390 con 0x7fa0ec133ad0 2023-10-03T10:13:03.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.735+0000 7fbf57fff700 1 -- 172.21.15.146:0/2658182704 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5000f460 con 0x7fbf6009f260 2023-10-03T10:13:03.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.735+0000 7fbf57fff700 1 -- 172.21.15.146:0/2658182704 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf500098f0 con 0x7fbf6009f260 2023-10-03T10:13:03.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.735+0000 7fbf57fff700 1 -- 172.21.15.146:0/2658182704 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf50009c80 con 0x7fbf6009f260 2023-10-03T10:13:03.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.735+0000 7fa0e3fff700 1 -- 172.21.15.146:0/3316524317 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e80036a0 con 0x7fa0ec133ad0 2023-10-03T10:13:03.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.735+0000 7fbf67274700 1 -- 172.21.15.146:0/2658182704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6009f260 msgr2=0x7fbf60131890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.735+0000 7fa0f3539700 1 -- 172.21.15.146:0/3316524317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0ec133ad0 msgr2=0x7fa0ec133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.735+0000 7fa0f3539700 1 --2- 172.21.15.146:0/3316524317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0ec133ad0 0x7fa0ec133ea0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009870 tx=0x7fa0e8009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:03.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.735+0000 7fbf67274700 1 --2- 172.21.15.146:0/2658182704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6009f260 0x7fbf60131890 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000f9b0 tx=0x7fbf5000fcc0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.735+0000 7fbf67274700 1 -- 172.21.15.146:0/2658182704 shutdown_connections 2023-10-03T10:13:03.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.735+0000 7fbf67274700 1 --2- 172.21.15.146:0/2658182704 >> v2:172.21.15.146:3300/0 conn(0x7fbf6009e950 0x7fbf6009ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.735+0000 7fbf67274700 1 --2- 172.21.15.146:0/2658182704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6009f260 0x7fbf60131890 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.735+0000 7fbf67274700 1 -- 172.21.15.146:0/2658182704 >> 172.21.15.146:0/2658182704 conn(0x7fbf600a0f70 msgr2=0x7fbf600a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.735+0000 7fa0f3539700 1 -- 172.21.15.146:0/3316524317 shutdown_connections 2023-10-03T10:13:03.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.735+0000 7fa0f3539700 1 --2- 172.21.15.146:0/3316524317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0ec133ad0 0x7fa0ec133ea0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.735+0000 7fa0f3539700 1 --2- 172.21.15.146:0/3316524317 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0ec1300a0 0x7fa0ec1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.735+0000 7fa0f3539700 1 -- 172.21.15.146:0/3316524317 >> 172.21.15.146:0/3316524317 conn(0x7fa0ec099c40 msgr2=0x7fa0ec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.736+0000 7fbf67274700 1 -- 172.21.15.146:0/2658182704 shutdown_connections 2023-10-03T10:13:03.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.736+0000 7fa0f3539700 1 -- 172.21.15.146:0/3316524317 shutdown_connections 2023-10-03T10:13:03.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.736+0000 7fa0f3539700 1 -- 172.21.15.146:0/3316524317 wait complete. 2023-10-03T10:13:03.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.736+0000 7fbf67274700 1 -- 172.21.15.146:0/2658182704 wait complete. 2023-10-03T10:13:03.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.736+0000 7fa0f3539700 1 Processor -- start 2023-10-03T10:13:03.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.736+0000 7fbf67274700 1 Processor -- start 2023-10-03T10:13:03.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fa0f3539700 1 -- start start 2023-10-03T10:13:03.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fbf67274700 1 -- start start 2023-10-03T10:13:03.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fbf67274700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6009e950 0x7fbf6011e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fbf67274700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf6009f260 0x7fbf6011e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fa0f3539700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0ec1300a0 0x7fa0ec11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fbf67274700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf60131dd0 0x7fbf6011eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fbf67274700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf60121a10 con 0x7fbf60131dd0 2023-10-03T10:13:03.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fbf67274700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6009da40 con 0x7fbf6009f260 2023-10-03T10:13:03.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fa0f3539700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0ec1309f0 0x7fa0ec11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fbf67274700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf601200d0 con 0x7fbf6009e950 2023-10-03T10:13:03.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fbf6480f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf6009f260 0x7fbf6011e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fbf6480f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf6009f260 0x7fbf6011e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53458/0 (socket says 172.21.15.146:53458) 2023-10-03T10:13:03.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fbf6480f700 1 -- 172.21.15.146:0/3192799989 learned_addr learned my addr 172.21.15.146:0/3192799989 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:03.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fbf65811700 1 --2- 172.21.15.146:0/3192799989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf60131dd0 0x7fbf6011eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fbf65010700 1 --2- 172.21.15.146:0/3192799989 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6009e950 0x7fbf6011e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fa0f3539700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0ec133ad0 0x7fa0ec11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fa0f3539700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec12fcb0 con 0x7fa0ec1309f0 2023-10-03T10:13:03.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fa0f3539700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec12dd00 con 0x7fa0ec1300a0 2023-10-03T10:13:03.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fa0f3539700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec0723e0 con 0x7fa0ec133ad0 2023-10-03T10:13:03.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fa0f0ad4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0ec1309f0 0x7fa0ec11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fa0f0ad4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0ec1309f0 0x7fa0ec11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38050/0 (socket says 172.21.15.146:38050) 2023-10-03T10:13:03.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fa0f0ad4700 1 -- 172.21.15.146:0/197624825 learned_addr learned my addr 172.21.15.146:0/197624825 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:03.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fa0f12d5700 1 --2- 172.21.15.146:0/197624825 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0ec1300a0 0x7fa0ec11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.737+0000 7fa0f1ad6700 1 --2- 172.21.15.146:0/197624825 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0ec133ad0 0x7fa0ec11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.738+0000 7fa0f0ad4700 1 -- 172.21.15.146:0/197624825 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0ec133ad0 msgr2=0x7fa0ec11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.738+0000 7fa0f0ad4700 1 --2- 172.21.15.146:0/197624825 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0ec133ad0 0x7fa0ec11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.738+0000 7fa0f0ad4700 1 -- 172.21.15.146:0/197624825 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0ec1300a0 msgr2=0x7fa0ec11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.738+0000 7fa0f0ad4700 1 --2- 172.21.15.146:0/197624825 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0ec1300a0 0x7fa0ec11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.738+0000 7fa0f0ad4700 1 -- 172.21.15.146:0/197624825 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e80094a0 con 0x7fa0ec1309f0 2023-10-03T10:13:03.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.738+0000 7fbf6480f700 1 -- 172.21.15.146:0/3192799989 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6009e950 msgr2=0x7fbf6011e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.738+0000 7fbf6480f700 1 --2- 172.21.15.146:0/3192799989 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6009e950 0x7fbf6011e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.738+0000 7fbf6480f700 1 -- 172.21.15.146:0/3192799989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf60131dd0 msgr2=0x7fbf6011eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.738+0000 7fbf6480f700 1 --2- 172.21.15.146:0/3192799989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf60131dd0 0x7fbf6011eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.738+0000 7fbf6480f700 1 -- 172.21.15.146:0/3192799989 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5000f610 con 0x7fbf6009f260 2023-10-03T10:13:03.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.738+0000 7fbf6480f700 1 --2- 172.21.15.146:0/3192799989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf6009f260 0x7fbf6011e9a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbf500090b0 tx=0x7fbf50004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.738+0000 7fa0f0ad4700 1 --2- 172.21.15.146:0/197624825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0ec1309f0 0x7fa0ec11df80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc009f10 tx=0x7fa0dc00b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.738+0000 7fbf55ffb700 1 -- 172.21.15.146:0/3192799989 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf500038a0 con 0x7fbf6009f260 2023-10-03T10:13:03.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.738+0000 7fa0e1ffb700 1 -- 172.21.15.146:0/197624825 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc014af0 con 0x7fa0ec1309f0 2023-10-03T10:13:03.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.738+0000 7fbf55ffb700 1 -- 172.21.15.146:0/3192799989 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf50003a00 con 0x7fbf6009f260 2023-10-03T10:13:03.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.738+0000 7fbf67274700 1 -- 172.21.15.146:0/3192799989 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf601205e0 con 0x7fbf6009f260 2023-10-03T10:13:03.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.738+0000 7fbf55ffb700 1 -- 172.21.15.146:0/3192799989 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf50003d90 con 0x7fbf6009f260 2023-10-03T10:13:03.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.738+0000 7fa0e1ffb700 1 -- 172.21.15.146:0/197624825 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0dc00be50 con 0x7fa0ec1309f0 2023-10-03T10:13:03.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.738+0000 7fa0e1ffb700 1 -- 172.21.15.146:0/197624825 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc014360 con 0x7fa0ec1309f0 2023-10-03T10:13:03.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.738+0000 7fa0f3539700 1 -- 172.21.15.146:0/197624825 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0ec11ff40 con 0x7fa0ec1309f0 2023-10-03T10:13:03.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.738+0000 7fbf67274700 1 -- 172.21.15.146:0/3192799989 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf60121c60 con 0x7fbf6009f260 2023-10-03T10:13:03.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.738+0000 7fa0f3539700 1 -- 172.21.15.146:0/197624825 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0ec071940 con 0x7fa0ec1309f0 2023-10-03T10:13:03.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.739+0000 7fa0e1ffb700 1 -- 172.21.15.146:0/197624825 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa0dc0144c0 con 0x7fa0ec1309f0 2023-10-03T10:13:03.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.739+0000 7fa0e1ffb700 1 -- 172.21.15.146:0/197624825 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa0dc03f250 con 0x7fa0ec1309f0 2023-10-03T10:13:03.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.739+0000 7fbf55ffb700 1 -- 172.21.15.146:0/3192799989 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf5001e040 con 0x7fbf6009f260 2023-10-03T10:13:03.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.740+0000 7fbf55ffb700 1 -- 172.21.15.146:0/3192799989 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbf50044a40 con 0x7fbf6009f260 2023-10-03T10:13:03.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.740+0000 7fa0f3539700 1 -- 172.21.15.146:0/197624825 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0ec04f2a0 con 0x7fa0ec1309f0 2023-10-03T10:13:03.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.740+0000 7fbf67274700 1 -- 172.21.15.146:0/3192799989 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf60131420 con 0x7fbf6009f260 2023-10-03T10:13:03.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.744+0000 7fa0e1ffb700 1 -- 172.21.15.146:0/197624825 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa0dc00f300 con 0x7fa0ec1309f0 2023-10-03T10:13:03.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.744+0000 7fbf55ffb700 1 -- 172.21.15.146:0/3192799989 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf5001f390 con 0x7fbf6009f260 2023-10-03T10:13:03.918 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:03.920 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:03.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.936+0000 7fa0f3539700 1 -- 172.21.15.146:0/197624825 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa0ec12d200 con 0x7fa0ec1309f0 2023-10-03T10:13:03.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.936+0000 7fa0e1ffb700 1 -- 172.21.15.146:0/197624825 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa0dc01caf0 con 0x7fa0ec1309f0 2023-10-03T10:13:03.937 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:03.938 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:03.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.937+0000 7fbf67274700 1 -- 172.21.15.146:0/3192799989 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbf60122790 con 0x7fbf6009f260 2023-10-03T10:13:03.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.937+0000 7fbf55ffb700 1 -- 172.21.15.146:0/3192799989 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbf50026030 con 0x7fbf6009f260 2023-10-03T10:13:03.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.939+0000 7fa0f3539700 1 -- 172.21.15.146:0/197624825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0ec1309f0 msgr2=0x7fa0ec11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.939+0000 7fa0f3539700 1 --2- 172.21.15.146:0/197624825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0ec1309f0 0x7fa0ec11df80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc009f10 tx=0x7fa0dc00b420 comp rx=0 tx=0).stop 2023-10-03T10:13:03.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.939+0000 7fa0f3539700 1 -- 172.21.15.146:0/197624825 shutdown_connections 2023-10-03T10:13:03.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.939+0000 7fa0f3539700 1 --2- 172.21.15.146:0/197624825 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0ec133ad0 0x7fa0ec11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.939+0000 7fa0f3539700 1 --2- 172.21.15.146:0/197624825 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0ec1300a0 0x7fa0ec11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.939+0000 7fa0f3539700 1 --2- 172.21.15.146:0/197624825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0ec1309f0 0x7fa0ec11df80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.939+0000 7fa0f3539700 1 -- 172.21.15.146:0/197624825 >> 172.21.15.146:0/197624825 conn(0x7fa0ec099c40 msgr2=0x7fa0ec131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.939+0000 7fa0f3539700 1 -- 172.21.15.146:0/197624825 shutdown_connections 2023-10-03T10:13:03.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.939+0000 7fa0f3539700 1 -- 172.21.15.146:0/197624825 wait complete. 2023-10-03T10:13:03.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.940+0000 7fbf67274700 1 -- 172.21.15.146:0/3192799989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf6009f260 msgr2=0x7fbf6011e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.940+0000 7fbf67274700 1 --2- 172.21.15.146:0/3192799989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf6009f260 0x7fbf6011e9a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbf500090b0 tx=0x7fbf50004750 comp rx=0 tx=0).stop 2023-10-03T10:13:03.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.940+0000 7fbf67274700 1 -- 172.21.15.146:0/3192799989 shutdown_connections 2023-10-03T10:13:03.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.940+0000 7fbf67274700 1 --2- 172.21.15.146:0/3192799989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf60131dd0 0x7fbf6011eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.940+0000 7fbf67274700 1 --2- 172.21.15.146:0/3192799989 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf6009e950 0x7fbf6011e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.940+0000 7fbf67274700 1 --2- 172.21.15.146:0/3192799989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf6009f260 0x7fbf6011e9a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.940+0000 7fbf67274700 1 -- 172.21.15.146:0/3192799989 >> 172.21.15.146:0/3192799989 conn(0x7fbf600a0f70 msgr2=0x7fbf600a1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.940+0000 7fbf67274700 1 -- 172.21.15.146:0/3192799989 shutdown_connections 2023-10-03T10:13:03.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:03.940+0000 7fbf67274700 1 -- 172.21.15.146:0/3192799989 wait complete. 2023-10-03T10:13:03.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:03.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:04.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.046+0000 7f3803b24700 1 Processor -- start 2023-10-03T10:13:04.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.046+0000 7f3803b24700 1 -- start start 2023-10-03T10:13:04.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.047+0000 7f3803b24700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f37fc136960 0x7f37fc138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.047+0000 7f3803b24700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37fc139280 0x7f37fc13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.047+0000 7f3803b24700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37fc06b2d0 con 0x7f37fc133ad0 2023-10-03T10:13:04.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.047+0000 7f3803b24700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37fc1345b0 con 0x7f37fc136960 2023-10-03T10:13:04.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.047+0000 7f3803b24700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc133610 con 0x7f37fc139280 2023-10-03T10:13:04.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.047+0000 7f38020c1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37fc139280 0x7f37fc13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.047+0000 7f38020c1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37fc139280 0x7f37fc13b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51896/0 (socket says 172.21.15.146:51896) 2023-10-03T10:13:04.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.047+0000 7f38010bf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f37fc136960 0x7f37fc138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.047+0000 7f38020c1700 1 -- 172.21.15.146:0/503686580 learned_addr learned my addr 172.21.15.146:0/503686580 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:04.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.047+0000 7f38020c1700 1 -- 172.21.15.146:0/503686580 >> v2:172.21.15.146:3300/0 conn(0x7f37fc136960 msgr2=0x7f37fc138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:04.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.047+0000 7f38020c1700 1 --2- 172.21.15.146:0/503686580 >> v2:172.21.15.146:3300/0 conn(0x7f37fc136960 0x7f37fc138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.047+0000 7f38020c1700 1 -- 172.21.15.146:0/503686580 >> v1:172.21.15.146:6789/0 conn(0x7f37fc133ad0 legacy=0x7f37fc133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.047+0000 7f38008be700 1 -- 172.21.15.146:0/503686580 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43269394 0 0) 0x7f37fc06b2d0 con 0x7f37fc133ad0 2023-10-03T10:13:04.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.047+0000 7f38020c1700 1 -- 172.21.15.146:0/503686580 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37fc09a500 con 0x7f37fc139280 2023-10-03T10:13:04.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.047+0000 7f38010bf700 1 --2- 172.21.15.146:0/503686580 >> v2:172.21.15.146:3300/0 conn(0x7f37fc136960 0x7f37fc138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:04.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.048+0000 7f38020c1700 1 --2- 172.21.15.146:0/503686580 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37fc139280 0x7f37fc13b660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f37f40098f0 tx=0x7f37f4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39e640b28faac9c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.048+0000 7f38008be700 1 -- 172.21.15.146:0/503686580 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4011830 con 0x7f37fc139280 2023-10-03T10:13:04.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.048+0000 7f38008be700 1 -- 172.21.15.146:0/503686580 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f4011990 con 0x7f37fc139280 2023-10-03T10:13:04.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.048+0000 7f38008be700 1 -- 172.21.15.146:0/503686580 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4011d20 con 0x7f37fc139280 2023-10-03T10:13:04.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.048+0000 7f3803b24700 1 -- 172.21.15.146:0/503686580 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37fc139280 msgr2=0x7f37fc13b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.048+0000 7f3803b24700 1 --2- 172.21.15.146:0/503686580 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37fc139280 0x7f37fc13b660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f37f40098f0 tx=0x7f37f4009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:04.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.048+0000 7f3803b24700 1 -- 172.21.15.146:0/503686580 shutdown_connections 2023-10-03T10:13:04.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.048+0000 7f3803b24700 1 --2- 172.21.15.146:0/503686580 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37fc139280 0x7f37fc13b660 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.048+0000 7f3803b24700 1 --2- 172.21.15.146:0/503686580 >> v2:172.21.15.146:3300/0 conn(0x7f37fc136960 0x7f37fc138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.048+0000 7f3803b24700 1 -- 172.21.15.146:0/503686580 >> 172.21.15.146:0/503686580 conn(0x7f37fc099c40 msgr2=0x7f37fc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.049+0000 7f3803b24700 1 -- 172.21.15.146:0/503686580 shutdown_connections 2023-10-03T10:13:04.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.049+0000 7f3803b24700 1 -- 172.21.15.146:0/503686580 wait complete. 2023-10-03T10:13:04.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.049+0000 7f3803b24700 1 Processor -- start 2023-10-03T10:13:04.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.049+0000 7f3803b24700 1 -- start start 2023-10-03T10:13:04.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.050+0000 7f3803b24700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37fc133ad0 0x7f37fc12cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.050+0000 7f3803b24700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37fc136960 0x7f37fc12d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.050+0000 7f3803b24700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37fc139280 0x7f37fc12d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.050+0000 7f3803b24700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc130420 con 0x7f37fc133ad0 2023-10-03T10:13:04.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.050+0000 7f3803b24700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc072600 con 0x7f37fc139280 2023-10-03T10:13:04.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.050+0000 7f3803b24700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc12dd00 con 0x7f37fc136960 2023-10-03T10:13:04.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.050+0000 7f38010bf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37fc136960 0x7f37fc12d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.050+0000 7f38018c0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37fc133ad0 0x7f37fc12cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.050+0000 7f38010bf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37fc136960 0x7f37fc12d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51900/0 (socket says 172.21.15.146:51900) 2023-10-03T10:13:04.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.050+0000 7f38018c0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37fc133ad0 0x7f37fc12cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38060/0 (socket says 172.21.15.146:38060) 2023-10-03T10:13:04.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.050+0000 7f38010bf700 1 -- 172.21.15.146:0/3791954650 learned_addr learned my addr 172.21.15.146:0/3791954650 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:04.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.050+0000 7f38020c1700 1 --2- 172.21.15.146:0/3791954650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37fc139280 0x7f37fc12d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.050+0000 7f38010bf700 1 -- 172.21.15.146:0/3791954650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37fc139280 msgr2=0x7f37fc12d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.050+0000 7f38010bf700 1 --2- 172.21.15.146:0/3791954650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37fc139280 0x7f37fc12d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.050+0000 7f38010bf700 1 -- 172.21.15.146:0/3791954650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37fc133ad0 msgr2=0x7f37fc12cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.050+0000 7f38010bf700 1 --2- 172.21.15.146:0/3791954650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37fc133ad0 0x7f37fc12cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.050+0000 7f38010bf700 1 -- 172.21.15.146:0/3791954650 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ec0094a0 con 0x7f37fc136960 2023-10-03T10:13:04.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.050+0000 7f38018c0700 1 --2- 172.21.15.146:0/3791954650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37fc133ad0 0x7f37fc12cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:04.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.050+0000 7f38010bf700 1 --2- 172.21.15.146:0/3791954650 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37fc136960 0x7f37fc12d070 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00ebe0 tx=0x7f37ec00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.051+0000 7f37f27fc700 1 -- 172.21.15.146:0/3791954650 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ec009760 con 0x7f37fc136960 2023-10-03T10:13:04.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.051+0000 7f37f27fc700 1 -- 172.21.15.146:0/3791954650 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ec00c850 con 0x7f37fc136960 2023-10-03T10:13:04.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.051+0000 7f3803b24700 1 -- 172.21.15.146:0/3791954650 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f4009550 con 0x7f37fc136960 2023-10-03T10:13:04.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.051+0000 7f37f27fc700 1 -- 172.21.15.146:0/3791954650 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ec00cbe0 con 0x7f37fc136960 2023-10-03T10:13:04.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.051+0000 7f3803b24700 1 -- 172.21.15.146:0/3791954650 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37fc06fa10 con 0x7f37fc136960 2023-10-03T10:13:04.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.051+0000 7f3803b24700 1 -- 172.21.15.146:0/3791954650 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37fc04f2a0 con 0x7f37fc136960 2023-10-03T10:13:04.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.052+0000 7f37f27fc700 1 -- 172.21.15.146:0/3791954650 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f37ec00cd40 con 0x7f37fc136960 2023-10-03T10:13:04.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.052+0000 7f37f27fc700 1 -- 172.21.15.146:0/3791954650 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f37ec03fea0 con 0x7f37fc136960 2023-10-03T10:13:04.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.060+0000 7f37f27fc700 1 -- 172.21.15.146:0/3791954650 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f37ec024350 con 0x7f37fc136960 2023-10-03T10:13:04.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.070+0000 7fa0bfdad700 1 Processor -- start 2023-10-03T10:13:04.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.070+0000 7fa0bfdad700 1 -- start start 2023-10-03T10:13:04.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.071+0000 7fa0bfdad700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0b80a0a70 0x7fa0b80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.071+0000 7fa0bfdad700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0b80a1380 0x7fa0b8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.071+0000 7fa0bfdad700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa0b8133f50 0x7fa0b81343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.071+0000 7fa0bfdad700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b809e9d0 con 0x7fa0b8133f50 2023-10-03T10:13:04.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.071+0000 7fa0bfdad700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b809dc00 con 0x7fa0b80a0a70 2023-10-03T10:13:04.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.071+0000 7fa0bfdad700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b809dec0 con 0x7fa0b80a1380 2023-10-03T10:13:04.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.071+0000 7fa0bd348700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0b80a1380 0x7fa0b8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.071+0000 7fa0bdb49700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0b80a0a70 0x7fa0b80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.071+0000 7fa0bd348700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0b80a1380 0x7fa0b8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51902/0 (socket says 172.21.15.146:51902) 2023-10-03T10:13:04.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.071+0000 7fa0bd348700 1 -- 172.21.15.146:0/3364222794 learned_addr learned my addr 172.21.15.146:0/3364222794 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:04.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.071+0000 7fa0be34a700 1 --2- 172.21.15.146:0/3364222794 >> v2:172.21.15.146:3300/0 conn(0x7fa0b8133f50 0x7fa0b81343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.071+0000 7fa0bd348700 1 -- 172.21.15.146:0/3364222794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0b80a0a70 msgr2=0x7fa0b80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:04.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.071+0000 7fa0bd348700 1 --2- 172.21.15.146:0/3364222794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0b80a0a70 0x7fa0b80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.071+0000 7fa0bd348700 1 -- 172.21.15.146:0/3364222794 >> v2:172.21.15.146:3300/0 conn(0x7fa0b8133f50 msgr2=0x7fa0b81343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:04.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.071+0000 7fa0bd348700 1 --2- 172.21.15.146:0/3364222794 >> v2:172.21.15.146:3300/0 conn(0x7fa0b8133f50 0x7fa0b81343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.071+0000 7fa0bd348700 1 -- 172.21.15.146:0/3364222794 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b809e6a0 con 0x7fa0b80a1380 2023-10-03T10:13:04.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.071+0000 7fa0bdb49700 1 --2- 172.21.15.146:0/3364222794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0b80a0a70 0x7fa0b80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:04.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.071+0000 7fa0be34a700 1 --2- 172.21.15.146:0/3364222794 >> v2:172.21.15.146:3300/0 conn(0x7fa0b8133f50 0x7fa0b81343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:04.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.071+0000 7fa0bd348700 1 --2- 172.21.15.146:0/3364222794 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0b80a1380 0x7fa0b8133a10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa0a80098f0 tx=0x7fa0a8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=519e71f2ac1d61ea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.071+0000 7fa0bcb47700 1 -- 172.21.15.146:0/3364222794 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8011830 con 0x7fa0b80a1380 2023-10-03T10:13:04.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.071+0000 7fa0bcb47700 1 -- 172.21.15.146:0/3364222794 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a8011990 con 0x7fa0b80a1380 2023-10-03T10:13:04.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.071+0000 7fa0bcb47700 1 -- 172.21.15.146:0/3364222794 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8011d20 con 0x7fa0b80a1380 2023-10-03T10:13:04.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.072+0000 7fa0bfdad700 1 -- 172.21.15.146:0/3364222794 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0b80a1380 msgr2=0x7fa0b8133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.072+0000 7fa0bfdad700 1 --2- 172.21.15.146:0/3364222794 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0b80a1380 0x7fa0b8133a10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa0a80098f0 tx=0x7fa0a8009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:04.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.072+0000 7fa0bfdad700 1 -- 172.21.15.146:0/3364222794 shutdown_connections 2023-10-03T10:13:04.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.072+0000 7fa0bfdad700 1 --2- 172.21.15.146:0/3364222794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0b80a0a70 0x7fa0b80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.072+0000 7fa0bfdad700 1 --2- 172.21.15.146:0/3364222794 >> v2:172.21.15.146:3300/0 conn(0x7fa0b8133f50 0x7fa0b81343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.072+0000 7fa0bfdad700 1 --2- 172.21.15.146:0/3364222794 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0b80a1380 0x7fa0b8133a10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.072+0000 7fa0bfdad700 1 -- 172.21.15.146:0/3364222794 >> 172.21.15.146:0/3364222794 conn(0x7fa0b80a6610 msgr2=0x7fa0b80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.072+0000 7fa0bfdad700 1 -- 172.21.15.146:0/3364222794 shutdown_connections 2023-10-03T10:13:04.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.072+0000 7fa0bfdad700 1 -- 172.21.15.146:0/3364222794 wait complete. 2023-10-03T10:13:04.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.073+0000 7fa0bfdad700 1 Processor -- start 2023-10-03T10:13:04.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.073+0000 7fa0bfdad700 1 -- start start 2023-10-03T10:13:04.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.073+0000 7fa0bfdad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0b80a0a70 0x7fa0b811f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.073+0000 7fa0bfdad700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0b80a1380 0x7fa0b811fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.073+0000 7fa0bfdad700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0b8133f50 0x7fa0b81c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.073+0000 7fa0bfdad700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b80a5080 con 0x7fa0b80a0a70 2023-10-03T10:13:04.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.073+0000 7fa0bfdad700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b81223c0 con 0x7fa0b80a1380 2023-10-03T10:13:04.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.073+0000 7fa0bfdad700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b81228e0 con 0x7fa0b8133f50 2023-10-03T10:13:04.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.073+0000 7fa0be34a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0b8133f50 0x7fa0b81c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.074+0000 7fa0be34a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0b8133f50 0x7fa0b81c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51916/0 (socket says 172.21.15.146:51916) 2023-10-03T10:13:04.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.074+0000 7fa0be34a700 1 -- 172.21.15.146:0/325134013 learned_addr learned my addr 172.21.15.146:0/325134013 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:04.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.074+0000 7fa0bdb49700 1 --2- 172.21.15.146:0/325134013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0b80a0a70 0x7fa0b811f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.074+0000 7fa0bd348700 1 --2- 172.21.15.146:0/325134013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0b80a1380 0x7fa0b811fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.074+0000 7fa0be34a700 1 -- 172.21.15.146:0/325134013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0b80a1380 msgr2=0x7fa0b811fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.074+0000 7fa0be34a700 1 --2- 172.21.15.146:0/325134013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0b80a1380 0x7fa0b811fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.074+0000 7fa0be34a700 1 -- 172.21.15.146:0/325134013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0b80a0a70 msgr2=0x7fa0b811f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.074+0000 7fa0be34a700 1 --2- 172.21.15.146:0/325134013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0b80a0a70 0x7fa0b811f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.074+0000 7fa0be34a700 1 -- 172.21.15.146:0/325134013 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b40094a0 con 0x7fa0b8133f50 2023-10-03T10:13:04.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.074+0000 7fa0be34a700 1 --2- 172.21.15.146:0/325134013 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0b8133f50 0x7fa0b81c8140 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009f00 tx=0x7fa0b000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.074+0000 7fa0ae7fc700 1 -- 172.21.15.146:0/325134013 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0009d70 con 0x7fa0b8133f50 2023-10-03T10:13:04.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.074+0000 7fa0ae7fc700 1 -- 172.21.15.146:0/325134013 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b000f040 con 0x7fa0b8133f50 2023-10-03T10:13:04.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.074+0000 7fa0bfdad700 1 -- 172.21.15.146:0/325134013 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b0009a70 con 0x7fa0b8133f50 2023-10-03T10:13:04.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.074+0000 7fa0ae7fc700 1 -- 172.21.15.146:0/325134013 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0014680 con 0x7fa0b8133f50 2023-10-03T10:13:04.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.074+0000 7fa0bfdad700 1 -- 172.21.15.146:0/325134013 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a8009550 con 0x7fa0b8133f50 2023-10-03T10:13:04.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.075+0000 7fa0ae7fc700 1 -- 172.21.15.146:0/325134013 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa0b00147e0 con 0x7fa0b8133f50 2023-10-03T10:13:04.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.075+0000 7fa0ae7fc700 1 -- 172.21.15.146:0/325134013 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa0b0040560 con 0x7fa0b8133f50 2023-10-03T10:13:04.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.075+0000 7fa0bfdad700 1 -- 172.21.15.146:0/325134013 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b804f2a0 con 0x7fa0b8133f50 2023-10-03T10:13:04.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.080+0000 7fa0ae7fc700 1 -- 172.21.15.146:0/325134013 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa0b0018080 con 0x7fa0b8133f50 2023-10-03T10:13:04.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.251+0000 7f3803b24700 1 -- 172.21.15.146:0/3791954650 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f37fc06c3b0 con 0x7f37fc136960 2023-10-03T10:13:04.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.252+0000 7f37f27fc700 1 -- 172.21.15.146:0/3791954650 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f37ec017070 con 0x7f37fc136960 2023-10-03T10:13:04.253 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:04.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.254+0000 7f3803b24700 1 -- 172.21.15.146:0/3791954650 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37fc136960 msgr2=0x7f37fc12d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.254+0000 7f3803b24700 1 --2- 172.21.15.146:0/3791954650 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37fc136960 0x7f37fc12d070 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00ebe0 tx=0x7f37ec00eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.254+0000 7f3803b24700 1 -- 172.21.15.146:0/3791954650 shutdown_connections 2023-10-03T10:13:04.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.254+0000 7f3803b24700 1 --2- 172.21.15.146:0/3791954650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37fc139280 0x7f37fc12d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.254+0000 7f3803b24700 1 --2- 172.21.15.146:0/3791954650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37fc133ad0 0x7f37fc12cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.254+0000 7f3803b24700 1 --2- 172.21.15.146:0/3791954650 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37fc136960 0x7f37fc12d070 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.254+0000 7f3803b24700 1 -- 172.21.15.146:0/3791954650 >> 172.21.15.146:0/3791954650 conn(0x7f37fc099c40 msgr2=0x7f37fc134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.254+0000 7f3803b24700 1 -- 172.21.15.146:0/3791954650 shutdown_connections 2023-10-03T10:13:04.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.254+0000 7f3803b24700 1 -- 172.21.15.146:0/3791954650 wait complete. 2023-10-03T10:13:04.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:04.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.269+0000 7fa0bfdad700 1 -- 172.21.15.146:0/325134013 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa0b8122500 con 0x7fa0b8133f50 2023-10-03T10:13:04.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.269+0000 7fa0ae7fc700 1 -- 172.21.15.146:0/325134013 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa0b8122500 con 0x7fa0b8133f50 2023-10-03T10:13:04.270 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:04.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.271+0000 7fa0bfdad700 1 -- 172.21.15.146:0/325134013 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0b8133f50 msgr2=0x7fa0b81c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.271+0000 7fa0bfdad700 1 --2- 172.21.15.146:0/325134013 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0b8133f50 0x7fa0b81c8140 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009f00 tx=0x7fa0b000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.271+0000 7fa0bfdad700 1 -- 172.21.15.146:0/325134013 shutdown_connections 2023-10-03T10:13:04.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.271+0000 7fa0bfdad700 1 --2- 172.21.15.146:0/325134013 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0b8133f50 0x7fa0b81c8140 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.271+0000 7fa0bfdad700 1 --2- 172.21.15.146:0/325134013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0b80a0a70 0x7fa0b811f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.271+0000 7fa0bfdad700 1 --2- 172.21.15.146:0/325134013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0b80a1380 0x7fa0b811fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.271+0000 7fa0bfdad700 1 -- 172.21.15.146:0/325134013 >> 172.21.15.146:0/325134013 conn(0x7fa0b80a6610 msgr2=0x7fa0b81bbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.271+0000 7fa0bfdad700 1 -- 172.21.15.146:0/325134013 shutdown_connections 2023-10-03T10:13:04.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:04.271+0000 7fa0bfdad700 1 -- 172.21.15.146:0/325134013 wait complete. 2023-10-03T10:13:04.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:04.959 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:04.959 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:05.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.091+0000 7fd527623700 1 Processor -- start 2023-10-03T10:13:05.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.091+0000 7fd527623700 1 -- start start 2023-10-03T10:13:05.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.092+0000 7fb648e26700 1 Processor -- start 2023-10-03T10:13:05.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.092+0000 7fb648e26700 1 -- start start 2023-10-03T10:13:05.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.092+0000 7fd527623700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd5200a1550 0x7fd520138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.092+0000 7fd527623700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd520139200 0x7fd52013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.092+0000 7fd527623700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52009e9d0 con 0x7fd5200a0a70 2023-10-03T10:13:05.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.092+0000 7fd527623700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd52009dc00 con 0x7fd5200a1550 2023-10-03T10:13:05.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.092+0000 7fd527623700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd52009dec0 con 0x7fd520139200 2023-10-03T10:13:05.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.092+0000 7fd524bbe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd5200a1550 0x7fd520138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.092+0000 7fd524bbe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd5200a1550 0x7fd520138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41650/0 (socket says 172.21.15.146:41650) 2023-10-03T10:13:05.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.092+0000 7fd524bbe700 1 -- 172.21.15.146:0/1350423798 learned_addr learned my addr 172.21.15.146:0/1350423798 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:05.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.092+0000 7fd525bc0700 1 --2- 172.21.15.146:0/1350423798 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd520139200 0x7fd52013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.092+0000 7fd524bbe700 1 -- 172.21.15.146:0/1350423798 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd520139200 msgr2=0x7fd52013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:05.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.092+0000 7fd524bbe700 1 --2- 172.21.15.146:0/1350423798 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd520139200 0x7fd52013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.092+0000 7fd524bbe700 1 -- 172.21.15.146:0/1350423798 >> v1:172.21.15.146:6789/0 conn(0x7fd5200a0a70 legacy=0x7fd5200a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.092+0000 7fd524bbe700 1 -- 172.21.15.146:0/1350423798 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52009e6a0 con 0x7fd5200a1550 2023-10-03T10:13:05.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.092+0000 7fd525bc0700 1 --2- 172.21.15.146:0/1350423798 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd520139200 0x7fd52013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:05.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.092+0000 7fb648e26700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb64409e870 0x7fb64409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.093+0000 7fd524bbe700 1 --2- 172.21.15.146:0/1350423798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5200a1550 0x7fd520138cc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd5100098f0 tx=0x7fd510009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8d45b149815202 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.092+0000 7fb648e26700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb644131f40 0x7fb644139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.092+0000 7fb648e26700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb64409c970 con 0x7fb64409f180 2023-10-03T10:13:05.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.092+0000 7fb648e26700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6440a0920 con 0x7fb64409e870 2023-10-03T10:13:05.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.092+0000 7fb648e26700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb64409f9c0 con 0x7fb644131f40 2023-10-03T10:13:05.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.093+0000 7fb641d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb64409f180 0x7fb644131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55202/0 (socket says 172.21.15.146:55202) 2023-10-03T10:13:05.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.093+0000 7fb641d9b700 1 -- 172.21.15.146:0/574198427 learned_addr learned my addr 172.21.15.146:0/574198427 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:05.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.093+0000 7fb64259c700 1 --2- 172.21.15.146:0/574198427 >> v2:172.21.15.146:3300/0 conn(0x7fb64409e870 0x7fb64409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.093+0000 7fb642d9d700 1 --2- 172.21.15.146:0/574198427 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb644131f40 0x7fb644139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.093+0000 7fb642d9d700 1 -- 172.21.15.146:0/574198427 >> v2:172.21.15.146:3300/0 conn(0x7fb64409e870 msgr2=0x7fb64409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:05.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.093+0000 7fb642d9d700 1 --2- 172.21.15.146:0/574198427 >> v2:172.21.15.146:3300/0 conn(0x7fb64409e870 0x7fb64409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.093+0000 7fb642d9d700 1 -- 172.21.15.146:0/574198427 >> v1:172.21.15.146:6789/0 conn(0x7fb64409f180 legacy=0x7fb644131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.093+0000 7fb642d9d700 1 -- 172.21.15.146:0/574198427 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64409bab0 con 0x7fb644131f40 2023-10-03T10:13:05.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.093+0000 7fb64159a700 1 -- 172.21.15.146:0/574198427 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2367491022 0 0) 0x7fb64409c970 con 0x7fb64409f180 2023-10-03T10:13:05.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.093+0000 7fd517fff700 1 -- 172.21.15.146:0/1350423798 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510011830 con 0x7fd5200a1550 2023-10-03T10:13:05.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.093+0000 7fd517fff700 1 -- 172.21.15.146:0/1350423798 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd510011990 con 0x7fd5200a1550 2023-10-03T10:13:05.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.093+0000 7fd517fff700 1 -- 172.21.15.146:0/1350423798 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510011d20 con 0x7fd5200a1550 2023-10-03T10:13:05.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.093+0000 7fb642d9d700 1 --2- 172.21.15.146:0/574198427 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb644131f40 0x7fb644139ca0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009d90 tx=0x7fb63c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e99eb9ebc1090258 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.093+0000 7fb64159a700 1 -- 172.21.15.146:0/574198427 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c00e070 con 0x7fb644131f40 2023-10-03T10:13:05.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.093+0000 7fb64159a700 1 -- 172.21.15.146:0/574198427 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c00bbd0 con 0x7fb644131f40 2023-10-03T10:13:05.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.093+0000 7fb64159a700 1 -- 172.21.15.146:0/574198427 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c012430 con 0x7fb644131f40 2023-10-03T10:13:05.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.094+0000 7fd527623700 1 -- 172.21.15.146:0/1350423798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5200a1550 msgr2=0x7fd520138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.094+0000 7fd527623700 1 --2- 172.21.15.146:0/1350423798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5200a1550 0x7fd520138cc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd5100098f0 tx=0x7fd510009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:05.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.094+0000 7fd527623700 1 -- 172.21.15.146:0/1350423798 shutdown_connections 2023-10-03T10:13:05.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.094+0000 7fd527623700 1 --2- 172.21.15.146:0/1350423798 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd520139200 0x7fd52013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.094+0000 7fd527623700 1 --2- 172.21.15.146:0/1350423798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5200a1550 0x7fd520138cc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.094+0000 7fd527623700 1 -- 172.21.15.146:0/1350423798 >> 172.21.15.146:0/1350423798 conn(0x7fd5200a6610 msgr2=0x7fd5200a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.094+0000 7fd527623700 1 -- 172.21.15.146:0/1350423798 shutdown_connections 2023-10-03T10:13:05.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.094+0000 7fd527623700 1 -- 172.21.15.146:0/1350423798 wait complete. 2023-10-03T10:13:05.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.094+0000 7fb648e26700 1 -- 172.21.15.146:0/574198427 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb644131f40 msgr2=0x7fb644139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.094+0000 7fb648e26700 1 --2- 172.21.15.146:0/574198427 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb644131f40 0x7fb644139ca0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009d90 tx=0x7fb63c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:05.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.094+0000 7fb648e26700 1 -- 172.21.15.146:0/574198427 shutdown_connections 2023-10-03T10:13:05.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.094+0000 7fb648e26700 1 --2- 172.21.15.146:0/574198427 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb644131f40 0x7fb644139ca0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.094+0000 7fb648e26700 1 --2- 172.21.15.146:0/574198427 >> v2:172.21.15.146:3300/0 conn(0x7fb64409e870 0x7fb64409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.094+0000 7fb648e26700 1 -- 172.21.15.146:0/574198427 >> 172.21.15.146:0/574198427 conn(0x7fb6440a4430 msgr2=0x7fb6440a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.094+0000 7fb648e26700 1 -- 172.21.15.146:0/574198427 shutdown_connections 2023-10-03T10:13:05.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.094+0000 7fb648e26700 1 -- 172.21.15.146:0/574198427 wait complete. 2023-10-03T10:13:05.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.095+0000 7fd527623700 1 Processor -- start 2023-10-03T10:13:05.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.095+0000 7fd527623700 1 -- start start 2023-10-03T10:13:05.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.095+0000 7fd527623700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5200a0a70 0x7fd52011e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.095+0000 7fd527623700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5200a1550 0x7fd52011ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.095+0000 7fd527623700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd520139200 0x7fd52011f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.095+0000 7fd527623700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd520122070 con 0x7fd5200a1550 2023-10-03T10:13:05.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.095+0000 7fd527623700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd520120440 con 0x7fd5200a0a70 2023-10-03T10:13:05.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.095+0000 7fd527623700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5200a5290 con 0x7fd520139200 2023-10-03T10:13:05.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.095+0000 7fd524bbe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5200a1550 0x7fd52011ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.095+0000 7fd5253bf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5200a0a70 0x7fd52011e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.095+0000 7fd524bbe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5200a1550 0x7fd52011ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41666/0 (socket says 172.21.15.146:41666) 2023-10-03T10:13:05.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.095+0000 7fd525bc0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd520139200 0x7fd52011f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.095+0000 7fd524bbe700 1 -- 172.21.15.146:0/2146422431 learned_addr learned my addr 172.21.15.146:0/2146422431 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:05.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fb648e26700 1 Processor -- start 2023-10-03T10:13:05.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fb648e26700 1 -- start start 2023-10-03T10:13:05.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fd524bbe700 1 -- 172.21.15.146:0/2146422431 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd520139200 msgr2=0x7fd52011f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fd524bbe700 1 --2- 172.21.15.146:0/2146422431 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd520139200 0x7fd52011f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fd524bbe700 1 -- 172.21.15.146:0/2146422431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5200a0a70 msgr2=0x7fd52011e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fd524bbe700 1 --2- 172.21.15.146:0/2146422431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5200a0a70 0x7fd52011e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fd524bbe700 1 -- 172.21.15.146:0/2146422431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd518009a70 con 0x7fd5200a1550 2023-10-03T10:13:05.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fd525bc0700 1 --2- 172.21.15.146:0/2146422431 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd520139200 0x7fd52011f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:05.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fd5253bf700 1 --2- 172.21.15.146:0/2146422431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5200a0a70 0x7fd52011e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:05.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fd524bbe700 1 --2- 172.21.15.146:0/2146422431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5200a1550 0x7fd52011ed70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd510000c00 tx=0x7fd510004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fd515ffb700 1 -- 172.21.15.146:0/2146422431 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5100043c0 con 0x7fd5200a1550 2023-10-03T10:13:05.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fd515ffb700 1 -- 172.21.15.146:0/2146422431 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51001f070 con 0x7fd5200a1550 2023-10-03T10:13:05.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fd527623700 1 -- 172.21.15.146:0/2146422431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd510009550 con 0x7fd5200a1550 2023-10-03T10:13:05.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fd515ffb700 1 -- 172.21.15.146:0/2146422431 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5100038c0 con 0x7fd5200a1550 2023-10-03T10:13:05.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fb648e26700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb64409e870 0x7fb64406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fb648e26700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb64409f180 0x7fb64406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fb648e26700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb644131f40 0x7fb64406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fb648e26700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb644125070 con 0x7fb644131f40 2023-10-03T10:13:05.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fb648e26700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64409dba0 con 0x7fb64409e870 2023-10-03T10:13:05.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fb648e26700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb644124680 con 0x7fb64409f180 2023-10-03T10:13:05.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fb64259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb64409e870 0x7fb64406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fb641d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb64409f180 0x7fb64406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fb64259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb64409e870 0x7fb64406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:47204/0 (socket says 172.21.15.146:47204) 2023-10-03T10:13:05.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fd527623700 1 -- 172.21.15.146:0/2146422431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd520121db0 con 0x7fd5200a1550 2023-10-03T10:13:05.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.096+0000 7fb64259c700 1 -- 172.21.15.146:0/1463748357 learned_addr learned my addr 172.21.15.146:0/1463748357 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.097+0000 7fb64259c700 1 -- 172.21.15.146:0/1463748357 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb64409f180 msgr2=0x7fb64406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.097+0000 7fb64259c700 1 --2- 172.21.15.146:0/1463748357 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb64409f180 0x7fb64406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.097+0000 7fb64259c700 1 -- 172.21.15.146:0/1463748357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb644131f40 msgr2=0x7fb64406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.097+0000 7fb64259c700 1 --2- 172.21.15.146:0/1463748357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb644131f40 0x7fb64406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.097+0000 7fb64259c700 1 -- 172.21.15.146:0/1463748357 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c009a70 con 0x7fb64409e870 2023-10-03T10:13:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.097+0000 7fb641d9b700 1 --2- 172.21.15.146:0/1463748357 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb64409f180 0x7fb64406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.097+0000 7fb64259c700 1 --2- 172.21.15.146:0/1463748357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb64409e870 0x7fb64406b8b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb63400d830 tx=0x7fb63400db40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.097+0000 7fb632ffd700 1 -- 172.21.15.146:0/1463748357 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6340125f0 con 0x7fb64409e870 2023-10-03T10:13:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.097+0000 7fb632ffd700 1 -- 172.21.15.146:0/1463748357 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb634012750 con 0x7fb64409e870 2023-10-03T10:13:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.097+0000 7fb632ffd700 1 -- 172.21.15.146:0/1463748357 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634012b00 con 0x7fb64409e870 2023-10-03T10:13:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.097+0000 7fb648e26700 1 -- 172.21.15.146:0/1463748357 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb644125d30 con 0x7fb64409e870 2023-10-03T10:13:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.097+0000 7fb648e26700 1 -- 172.21.15.146:0/1463748357 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb644125790 con 0x7fb64409e870 2023-10-03T10:13:05.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.097+0000 7fd515ffb700 1 -- 172.21.15.146:0/2146422431 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd510021030 con 0x7fd5200a1550 2023-10-03T10:13:05.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.097+0000 7fd515ffb700 1 -- 172.21.15.146:0/2146422431 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd510040910 con 0x7fd5200a1550 2023-10-03T10:13:05.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.098+0000 7fb632ffd700 1 -- 172.21.15.146:0/1463748357 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb634012c60 con 0x7fb64409e870 2023-10-03T10:13:05.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.098+0000 7fb632ffd700 1 -- 172.21.15.146:0/1463748357 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb63403faf0 con 0x7fb64409e870 2023-10-03T10:13:05.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.098+0000 7fb648e26700 1 -- 172.21.15.146:0/1463748357 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64411d580 con 0x7fb64409e870 2023-10-03T10:13:05.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.098+0000 7fd527623700 1 -- 172.21.15.146:0/2146422431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd52004f2a0 con 0x7fd5200a1550 2023-10-03T10:13:05.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.103+0000 7fb632ffd700 1 -- 172.21.15.146:0/1463748357 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb634014430 con 0x7fb64409e870 2023-10-03T10:13:05.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.103+0000 7fd515ffb700 1 -- 172.21.15.146:0/2146422431 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd510015080 con 0x7fd5200a1550 2023-10-03T10:13:05.267 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:05.284 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:05.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.296+0000 7fb648e26700 1 -- 172.21.15.146:0/1463748357 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb6441254c0 con 0x7fb64409e870 2023-10-03T10:13:05.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.296+0000 7fb632ffd700 1 -- 172.21.15.146:0/1463748357 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb63401c360 con 0x7fb64409e870 2023-10-03T10:13:05.297 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:05.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.299+0000 7fb648e26700 1 -- 172.21.15.146:0/1463748357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb64409e870 msgr2=0x7fb64406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.299+0000 7fb648e26700 1 --2- 172.21.15.146:0/1463748357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb64409e870 0x7fb64406b8b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb63400d830 tx=0x7fb63400db40 comp rx=0 tx=0).stop 2023-10-03T10:13:05.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.299+0000 7fb648e26700 1 -- 172.21.15.146:0/1463748357 shutdown_connections 2023-10-03T10:13:05.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.299+0000 7fb648e26700 1 --2- 172.21.15.146:0/1463748357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb644131f40 0x7fb64406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.299+0000 7fb648e26700 1 --2- 172.21.15.146:0/1463748357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb64409e870 0x7fb64406b8b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.299+0000 7fb648e26700 1 --2- 172.21.15.146:0/1463748357 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb64409f180 0x7fb64406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.299+0000 7fb648e26700 1 -- 172.21.15.146:0/1463748357 >> 172.21.15.146:0/1463748357 conn(0x7fb6440a4430 msgr2=0x7fb64411a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.299+0000 7fb648e26700 1 -- 172.21.15.146:0/1463748357 shutdown_connections 2023-10-03T10:13:05.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.299+0000 7fb648e26700 1 -- 172.21.15.146:0/1463748357 wait complete. 2023-10-03T10:13:05.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.302+0000 7fd527623700 1 -- 172.21.15.146:0/2146422431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd520120c00 con 0x7fd5200a1550 2023-10-03T10:13:05.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.303+0000 7fd515ffb700 1 -- 172.21.15.146:0/2146422431 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd510004560 con 0x7fd5200a1550 2023-10-03T10:13:05.303 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:05.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.305+0000 7fd527623700 1 -- 172.21.15.146:0/2146422431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5200a1550 msgr2=0x7fd52011ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.305+0000 7fd527623700 1 --2- 172.21.15.146:0/2146422431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5200a1550 0x7fd52011ed70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd510000c00 tx=0x7fd510004750 comp rx=0 tx=0).stop 2023-10-03T10:13:05.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.305+0000 7fd527623700 1 -- 172.21.15.146:0/2146422431 shutdown_connections 2023-10-03T10:13:05.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.305+0000 7fd527623700 1 --2- 172.21.15.146:0/2146422431 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd520139200 0x7fd52011f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.305+0000 7fd527623700 1 --2- 172.21.15.146:0/2146422431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5200a0a70 0x7fd52011e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.305+0000 7fd527623700 1 --2- 172.21.15.146:0/2146422431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5200a1550 0x7fd52011ed70 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.305+0000 7fd527623700 1 -- 172.21.15.146:0/2146422431 >> 172.21.15.146:0/2146422431 conn(0x7fd5200a6610 msgr2=0x7fd520136c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.305+0000 7fd527623700 1 -- 172.21.15.146:0/2146422431 shutdown_connections 2023-10-03T10:13:05.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.305+0000 7fd527623700 1 -- 172.21.15.146:0/2146422431 wait complete. 2023-10-03T10:13:05.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:05.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:05.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.399+0000 7f4e387fa700 1 Processor -- start 2023-10-03T10:13:05.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.399+0000 7f4e387fa700 1 -- start start 2023-10-03T10:13:05.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.400+0000 7f4e387fa700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4e300a0a70 0x7f4e300a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.400+0000 7f4e387fa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e300a1380 0x7f4e30133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.400+0000 7f4e387fa700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3009dc00 con 0x7f4e30133f50 2023-10-03T10:13:05.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.400+0000 7f4e387fa700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3009ea60 con 0x7f4e300a0a70 2023-10-03T10:13:05.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.400+0000 7f4e387fa700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3009dec0 con 0x7f4e300a1380 2023-10-03T10:13:05.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.400+0000 7f4e36596700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4e300a0a70 0x7f4e300a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.400+0000 7f4e35d95700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e300a1380 0x7f4e30133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.400+0000 7f4e36d97700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4e30133f50 0x7f4e3013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55214/0 (socket says 172.21.15.146:55214) 2023-10-03T10:13:05.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.400+0000 7f4e36d97700 1 -- 172.21.15.146:0/860868429 learned_addr learned my addr 172.21.15.146:0/860868429 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:05.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.400+0000 7f4e36596700 1 -- 172.21.15.146:0/860868429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e300a1380 msgr2=0x7f4e30133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:05.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.400+0000 7f4e36596700 1 --2- 172.21.15.146:0/860868429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e300a1380 0x7f4e30133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.400+0000 7f4e36596700 1 -- 172.21.15.146:0/860868429 >> v1:172.21.15.146:6789/0 conn(0x7f4e30133f50 legacy=0x7f4e3013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.400+0000 7f4e35594700 1 -- 172.21.15.146:0/860868429 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205886974 0 0) 0x7f4e3009dc00 con 0x7f4e30133f50 2023-10-03T10:13:05.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.400+0000 7f4e36596700 1 -- 172.21.15.146:0/860868429 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3009e6a0 con 0x7f4e300a0a70 2023-10-03T10:13:05.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.400+0000 7f4e35d95700 1 --2- 172.21.15.146:0/860868429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e300a1380 0x7f4e30133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:05.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.401+0000 7f4e36596700 1 --2- 172.21.15.146:0/860868429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e300a0a70 0x7f4e300a0e40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009840 tx=0x7f4e2c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1be8feb24c3639 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.401+0000 7f4e35594700 1 -- 172.21.15.146:0/860868429 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c011830 con 0x7f4e300a0a70 2023-10-03T10:13:05.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.401+0000 7f4e35594700 1 -- 172.21.15.146:0/860868429 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c011990 con 0x7f4e300a0a70 2023-10-03T10:13:05.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.401+0000 7f4e35594700 1 -- 172.21.15.146:0/860868429 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c011d20 con 0x7f4e300a0a70 2023-10-03T10:13:05.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.401+0000 7f4e387fa700 1 -- 172.21.15.146:0/860868429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e300a0a70 msgr2=0x7f4e300a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.401+0000 7f4e387fa700 1 --2- 172.21.15.146:0/860868429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e300a0a70 0x7f4e300a0e40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009840 tx=0x7f4e2c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:05.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.401+0000 7f4e387fa700 1 -- 172.21.15.146:0/860868429 shutdown_connections 2023-10-03T10:13:05.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.401+0000 7f4e387fa700 1 --2- 172.21.15.146:0/860868429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e300a0a70 0x7f4e300a0e40 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.401+0000 7f4e387fa700 1 --2- 172.21.15.146:0/860868429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e300a1380 0x7f4e30133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.401+0000 7f4e387fa700 1 -- 172.21.15.146:0/860868429 >> 172.21.15.146:0/860868429 conn(0x7f4e300a6610 msgr2=0x7f4e300a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.401+0000 7f4e387fa700 1 -- 172.21.15.146:0/860868429 shutdown_connections 2023-10-03T10:13:05.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.401+0000 7f4e387fa700 1 -- 172.21.15.146:0/860868429 wait complete. 2023-10-03T10:13:05.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.402+0000 7f4e387fa700 1 Processor -- start 2023-10-03T10:13:05.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.402+0000 7f4e387fa700 1 -- start start 2023-10-03T10:13:05.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.403+0000 7f4e387fa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e300a0a70 0x7f4e30122920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.403+0000 7f4e387fa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e300a1380 0x7f4e30122e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.403+0000 7f4e387fa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e30133f50 0x7f4e301233a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.403+0000 7f4e387fa700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e30133aa0 con 0x7f4e30133f50 2023-10-03T10:13:05.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.403+0000 7f4e387fa700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e30124560 con 0x7f4e300a0a70 2023-10-03T10:13:05.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.403+0000 7f4e387fa700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e30124c90 con 0x7f4e300a1380 2023-10-03T10:13:05.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.403+0000 7f4e35d95700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e300a1380 0x7f4e30122e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.403+0000 7f4e35d95700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e300a1380 0x7f4e30122e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:32956/0 (socket says 172.21.15.146:32956) 2023-10-03T10:13:05.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.403+0000 7f4e35d95700 1 -- 172.21.15.146:0/227684519 learned_addr learned my addr 172.21.15.146:0/227684519 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:05.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.403+0000 7f4e36d97700 1 --2- 172.21.15.146:0/227684519 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e30133f50 0x7f4e301233a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.403+0000 7f4e36596700 1 --2- 172.21.15.146:0/227684519 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e300a0a70 0x7f4e30122920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.403+0000 7f4e35d95700 1 -- 172.21.15.146:0/227684519 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e300a0a70 msgr2=0x7f4e30122920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.403+0000 7f4e35d95700 1 --2- 172.21.15.146:0/227684519 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e300a0a70 0x7f4e30122920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.403+0000 7f4e35d95700 1 -- 172.21.15.146:0/227684519 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e30133f50 msgr2=0x7f4e301233a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.403+0000 7f4e35d95700 1 --2- 172.21.15.146:0/227684519 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e30133f50 0x7f4e301233a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.403+0000 7f4e35d95700 1 -- 172.21.15.146:0/227684519 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e200094a0 con 0x7f4e300a1380 2023-10-03T10:13:05.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.403+0000 7f4e36d97700 1 --2- 172.21.15.146:0/227684519 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e30133f50 0x7f4e301233a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:05.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.403+0000 7f4e35d95700 1 --2- 172.21.15.146:0/227684519 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e300a1380 0x7f4e30122e60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000ebe0 tx=0x7f4e2000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.403+0000 7f4e26ffd700 1 -- 172.21.15.146:0/227684519 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2000c850 con 0x7f4e300a1380 2023-10-03T10:13:05.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.403+0000 7f4e26ffd700 1 -- 172.21.15.146:0/227684519 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2000c9b0 con 0x7f4e300a1380 2023-10-03T10:13:05.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.403+0000 7f4e26ffd700 1 -- 172.21.15.146:0/227684519 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2000cd40 con 0x7f4e300a1380 2023-10-03T10:13:05.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.403+0000 7f4e387fa700 1 -- 172.21.15.146:0/227684519 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2c0094a0 con 0x7f4e300a1380 2023-10-03T10:13:05.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.404+0000 7f4e387fa700 1 -- 172.21.15.146:0/227684519 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e30133360 con 0x7f4e300a1380 2023-10-03T10:13:05.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.404+0000 7f4e26ffd700 1 -- 172.21.15.146:0/227684519 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e20013470 con 0x7f4e300a1380 2023-10-03T10:13:05.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.405+0000 7f4e26ffd700 1 -- 172.21.15.146:0/227684519 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4e2003fb50 con 0x7f4e300a1380 2023-10-03T10:13:05.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.405+0000 7f4e387fa700 1 -- 172.21.15.146:0/227684519 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3004f2a0 con 0x7f4e300a1380 2023-10-03T10:13:05.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.410+0000 7f4e26ffd700 1 -- 172.21.15.146:0/227684519 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e20013720 con 0x7f4e300a1380 2023-10-03T10:13:05.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.426+0000 7f9ff4719700 1 Processor -- start 2023-10-03T10:13:05.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.426+0000 7f9ff4719700 1 -- start start 2023-10-03T10:13:05.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.427+0000 7f9ff4719700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9fec0a0a70 0x7f9fec0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.427+0000 7f9ff4719700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fec0a1380 0x7f9fec133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.427+0000 7f9ff4719700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fec09dc00 con 0x7f9fec133f50 2023-10-03T10:13:05.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.427+0000 7f9ff4719700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fec09ea60 con 0x7f9fec0a0a70 2023-10-03T10:13:05.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.427+0000 7f9ff4719700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec09dec0 con 0x7f9fec0a1380 2023-10-03T10:13:05.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.427+0000 7f9ff1cb4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fec0a1380 0x7f9fec133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.427+0000 7f9ff24b5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9fec0a0a70 0x7f9fec0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.427+0000 7f9ff2cb6700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9fec133f50 0x7f9fec13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55228/0 (socket says 172.21.15.146:55228) 2023-10-03T10:13:05.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.427+0000 7f9ff2cb6700 1 -- 172.21.15.146:0/322149921 learned_addr learned my addr 172.21.15.146:0/322149921 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:05.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.427+0000 7f9ff1cb4700 1 --2- 172.21.15.146:0/322149921 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fec0a1380 0x7f9fec133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:32966/0 (socket says 172.21.15.146:32966) 2023-10-03T10:13:05.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.427+0000 7f9ff1cb4700 1 -- 172.21.15.146:0/322149921 >> v2:172.21.15.146:3300/0 conn(0x7f9fec0a0a70 msgr2=0x7f9fec0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:05.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.427+0000 7f9ff1cb4700 1 --2- 172.21.15.146:0/322149921 >> v2:172.21.15.146:3300/0 conn(0x7f9fec0a0a70 0x7f9fec0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.427+0000 7f9ff1cb4700 1 -- 172.21.15.146:0/322149921 >> v1:172.21.15.146:6789/0 conn(0x7f9fec133f50 legacy=0x7f9fec13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.427+0000 7f9ff1cb4700 1 -- 172.21.15.146:0/322149921 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec09e6a0 con 0x7f9fec0a1380 2023-10-03T10:13:05.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.427+0000 7f9ff1cb4700 1 --2- 172.21.15.146:0/322149921 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fec0a1380 0x7f9fec133a10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc009840 tx=0x7f9fdc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3913750174ba8b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.427+0000 7f9ff14b3700 1 -- 172.21.15.146:0/322149921 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc011830 con 0x7f9fec0a1380 2023-10-03T10:13:05.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.427+0000 7f9ff14b3700 1 -- 172.21.15.146:0/322149921 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc011990 con 0x7f9fec0a1380 2023-10-03T10:13:05.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.427+0000 7f9ff14b3700 1 -- 172.21.15.146:0/322149921 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc011d20 con 0x7f9fec0a1380 2023-10-03T10:13:05.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.428+0000 7f9ff4719700 1 -- 172.21.15.146:0/322149921 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fec0a1380 msgr2=0x7f9fec133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.428+0000 7f9ff4719700 1 --2- 172.21.15.146:0/322149921 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fec0a1380 0x7f9fec133a10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc009840 tx=0x7f9fdc009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:05.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.428+0000 7f9ff4719700 1 -- 172.21.15.146:0/322149921 shutdown_connections 2023-10-03T10:13:05.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.428+0000 7f9ff4719700 1 --2- 172.21.15.146:0/322149921 >> v2:172.21.15.146:3300/0 conn(0x7f9fec0a0a70 0x7f9fec0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.428+0000 7f9ff4719700 1 --2- 172.21.15.146:0/322149921 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fec0a1380 0x7f9fec133a10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.428+0000 7f9ff4719700 1 -- 172.21.15.146:0/322149921 >> 172.21.15.146:0/322149921 conn(0x7f9fec0a6610 msgr2=0x7f9fec0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.428+0000 7f9ff4719700 1 -- 172.21.15.146:0/322149921 shutdown_connections 2023-10-03T10:13:05.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.428+0000 7f9ff4719700 1 -- 172.21.15.146:0/322149921 wait complete. 2023-10-03T10:13:05.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.429+0000 7f9ff4719700 1 Processor -- start 2023-10-03T10:13:05.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.429+0000 7f9ff4719700 1 -- start start 2023-10-03T10:13:05.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.429+0000 7f9ff4719700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fec0a0a70 0x7f9fec1c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.429+0000 7f9ff4719700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fec0a1380 0x7f9fec1c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.429+0000 7f9ff4719700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fec133f50 0x7f9fec1c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.429+0000 7f9ff4719700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec124870 con 0x7f9fec0a0a70 2023-10-03T10:13:05.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.429+0000 7f9ff4719700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec124680 con 0x7f9fec133f50 2023-10-03T10:13:05.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.429+0000 7f9ff4719700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec133a50 con 0x7f9fec0a1380 2023-10-03T10:13:05.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.430+0000 7f9ff1cb4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fec0a1380 0x7f9fec1c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.430+0000 7f9ff1cb4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fec0a1380 0x7f9fec1c8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:32972/0 (socket says 172.21.15.146:32972) 2023-10-03T10:13:05.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.430+0000 7f9ff1cb4700 1 -- 172.21.15.146:0/3822268303 learned_addr learned my addr 172.21.15.146:0/3822268303 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:05.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.430+0000 7f9ff24b5700 1 --2- 172.21.15.146:0/3822268303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fec0a0a70 0x7f9fec1c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.430+0000 7f9ff1cb4700 1 -- 172.21.15.146:0/3822268303 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fec133f50 msgr2=0x7f9fec1c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.430+0000 7f9ff1cb4700 1 --2- 172.21.15.146:0/3822268303 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fec133f50 0x7f9fec1c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.430+0000 7f9ff1cb4700 1 -- 172.21.15.146:0/3822268303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fec0a0a70 msgr2=0x7f9fec1c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.430+0000 7f9ff1cb4700 1 --2- 172.21.15.146:0/3822268303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fec0a0a70 0x7f9fec1c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.430+0000 7f9ff1cb4700 1 -- 172.21.15.146:0/3822268303 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fdc0094a0 con 0x7f9fec0a1380 2023-10-03T10:13:05.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.430+0000 7f9ff24b5700 1 --2- 172.21.15.146:0/3822268303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fec0a0a70 0x7f9fec1c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:05.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.430+0000 7f9ff1cb4700 1 --2- 172.21.15.146:0/3822268303 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fec0a1380 0x7f9fec1c8770 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9fec09e000 tx=0x7f9fdc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.430+0000 7f9fe2ffd700 1 -- 172.21.15.146:0/3822268303 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc0036a0 con 0x7f9fec0a1380 2023-10-03T10:13:05.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.430+0000 7f9fe2ffd700 1 -- 172.21.15.146:0/3822268303 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc01f070 con 0x7f9fec0a1380 2023-10-03T10:13:05.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.430+0000 7f9ff4719700 1 -- 172.21.15.146:0/3822268303 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fec125ff0 con 0x7f9fec0a1380 2023-10-03T10:13:05.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.430+0000 7f9fe2ffd700 1 -- 172.21.15.146:0/3822268303 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc003a40 con 0x7f9fec0a1380 2023-10-03T10:13:05.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.430+0000 7f9ff4719700 1 -- 172.21.15.146:0/3822268303 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fec1252f0 con 0x7f9fec0a1380 2023-10-03T10:13:05.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.431+0000 7f9fe2ffd700 1 -- 172.21.15.146:0/3822268303 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9fdc003ba0 con 0x7f9fec0a1380 2023-10-03T10:13:05.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.431+0000 7f9fe2ffd700 1 -- 172.21.15.146:0/3822268303 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9fdc021070 con 0x7f9fec0a1380 2023-10-03T10:13:05.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.431+0000 7f9ff4719700 1 -- 172.21.15.146:0/3822268303 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fec04f2a0 con 0x7f9fec0a1380 2023-10-03T10:13:05.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.436+0000 7f9fe2ffd700 1 -- 172.21.15.146:0/3822268303 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9fdc015070 con 0x7f9fec0a1380 2023-10-03T10:13:05.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.604+0000 7f4e387fa700 1 -- 172.21.15.146:0/227684519 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4e30072980 con 0x7f4e300a1380 2023-10-03T10:13:05.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.604+0000 7f4e26ffd700 1 -- 172.21.15.146:0/227684519 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e20021030 con 0x7f4e300a1380 2023-10-03T10:13:05.605 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:05.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.606+0000 7f4e387fa700 1 -- 172.21.15.146:0/227684519 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e300a1380 msgr2=0x7f4e30122e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.606+0000 7f4e387fa700 1 --2- 172.21.15.146:0/227684519 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e300a1380 0x7f4e30122e60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000ebe0 tx=0x7f4e2000eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.606+0000 7f4e387fa700 1 -- 172.21.15.146:0/227684519 shutdown_connections 2023-10-03T10:13:05.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.606+0000 7f4e387fa700 1 --2- 172.21.15.146:0/227684519 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e30133f50 0x7f4e301233a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.606+0000 7f4e387fa700 1 --2- 172.21.15.146:0/227684519 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e300a0a70 0x7f4e30122920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.606+0000 7f4e387fa700 1 --2- 172.21.15.146:0/227684519 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e300a1380 0x7f4e30122e60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.606+0000 7f4e387fa700 1 -- 172.21.15.146:0/227684519 >> 172.21.15.146:0/227684519 conn(0x7f4e300a6610 msgr2=0x7f4e3009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.606+0000 7f4e387fa700 1 -- 172.21.15.146:0/227684519 shutdown_connections 2023-10-03T10:13:05.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.606+0000 7f4e387fa700 1 -- 172.21.15.146:0/227684519 wait complete. 2023-10-03T10:13:05.619 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:05.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.627+0000 7f9ff4719700 1 -- 172.21.15.146:0/3822268303 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9fec072980 con 0x7f9fec0a1380 2023-10-03T10:13:05.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.627+0000 7f9fe2ffd700 1 -- 172.21.15.146:0/3822268303 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9fdc024380 con 0x7f9fec0a1380 2023-10-03T10:13:05.628 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:05.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.629+0000 7f9ff4719700 1 -- 172.21.15.146:0/3822268303 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fec0a1380 msgr2=0x7f9fec1c8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.629+0000 7f9ff4719700 1 --2- 172.21.15.146:0/3822268303 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fec0a1380 0x7f9fec1c8770 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9fec09e000 tx=0x7f9fdc004750 comp rx=0 tx=0).stop 2023-10-03T10:13:05.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.629+0000 7f9ff4719700 1 -- 172.21.15.146:0/3822268303 shutdown_connections 2023-10-03T10:13:05.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.629+0000 7f9ff4719700 1 --2- 172.21.15.146:0/3822268303 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fec133f50 0x7f9fec1c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.629+0000 7f9ff4719700 1 --2- 172.21.15.146:0/3822268303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fec0a0a70 0x7f9fec1c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.629+0000 7f9ff4719700 1 --2- 172.21.15.146:0/3822268303 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fec0a1380 0x7f9fec1c8770 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.629+0000 7f9ff4719700 1 -- 172.21.15.146:0/3822268303 >> 172.21.15.146:0/3822268303 conn(0x7f9fec0a6610 msgr2=0x7f9fec0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.629+0000 7f9ff4719700 1 -- 172.21.15.146:0/3822268303 shutdown_connections 2023-10-03T10:13:05.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:05.629+0000 7f9ff4719700 1 -- 172.21.15.146:0/3822268303 wait complete. 2023-10-03T10:13:05.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:06.317 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:06.323 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.449+0000 7f7ec341f700 1 Processor -- start 2023-10-03T10:13:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.449+0000 7f7ec341f700 1 -- start start 2023-10-03T10:13:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.449+0000 7f7ec341f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ebc0a0a70 0x7f7ebc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.449+0000 7f7ec341f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7ebc0a1380 0x7f7ebc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.449+0000 7f7ec341f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ebc133f50 0x7f7ebc134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.449+0000 7f7ec341f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ebc09e9d0 con 0x7f7ebc0a1380 2023-10-03T10:13:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.449+0000 7f7ec341f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc09dc00 con 0x7f7ebc0a0a70 2023-10-03T10:13:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.449+0000 7f7ec341f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc09dec0 con 0x7f7ebc133f50 2023-10-03T10:13:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.449+0000 7f7ec19bc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ebc133f50 0x7f7ebc134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.450+0000 7f7ec09ba700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7ebc0a1380 0x7f7ebc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.450+0000 7f7ec11bb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ebc0a0a70 0x7f7ebc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.450+0000 7f7ec19bc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ebc133f50 0x7f7ebc134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:32982/0 (socket says 172.21.15.146:32982) 2023-10-03T10:13:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.450+0000 7f7ec19bc700 1 -- 172.21.15.146:0/3246161960 learned_addr learned my addr 172.21.15.146:0/3246161960 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.450+0000 7f7ec11bb700 1 -- 172.21.15.146:0/3246161960 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ebc133f50 msgr2=0x7f7ebc134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.450+0000 7f7ec11bb700 1 --2- 172.21.15.146:0/3246161960 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ebc133f50 0x7f7ebc134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.450+0000 7f7ec11bb700 1 -- 172.21.15.146:0/3246161960 >> v2:172.21.15.146:3300/0 conn(0x7f7ebc0a1380 msgr2=0x7f7ebc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.450+0000 7f7ec11bb700 1 --2- 172.21.15.146:0/3246161960 >> v2:172.21.15.146:3300/0 conn(0x7f7ebc0a1380 0x7f7ebc133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.450+0000 7f7ec11bb700 1 -- 172.21.15.146:0/3246161960 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ebc09e6a0 con 0x7f7ebc0a0a70 2023-10-03T10:13:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.450+0000 7f7ec19bc700 1 --2- 172.21.15.146:0/3246161960 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ebc133f50 0x7f7ebc134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.450+0000 7f7ec09ba700 1 --2- 172.21.15.146:0/3246161960 >> v2:172.21.15.146:3300/0 conn(0x7f7ebc0a1380 0x7f7ebc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.450+0000 7f7ec11bb700 1 --2- 172.21.15.146:0/3246161960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ebc0a0a70 0x7f7ebc0a0e40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009840 tx=0x7f7eb8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c9ee41ef4ab2327 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.450+0000 7f7eb3fff700 1 -- 172.21.15.146:0/3246161960 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8011830 con 0x7f7ebc0a0a70 2023-10-03T10:13:06.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.450+0000 7f7eb3fff700 1 -- 172.21.15.146:0/3246161960 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb8011990 con 0x7f7ebc0a0a70 2023-10-03T10:13:06.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.450+0000 7f7eb3fff700 1 -- 172.21.15.146:0/3246161960 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8011d20 con 0x7f7ebc0a0a70 2023-10-03T10:13:06.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.451+0000 7f7ec341f700 1 -- 172.21.15.146:0/3246161960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ebc0a0a70 msgr2=0x7f7ebc0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.451+0000 7f7ec341f700 1 --2- 172.21.15.146:0/3246161960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ebc0a0a70 0x7f7ebc0a0e40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009840 tx=0x7f7eb8009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:06.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.451+0000 7f7ec341f700 1 -- 172.21.15.146:0/3246161960 shutdown_connections 2023-10-03T10:13:06.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.451+0000 7f7ec341f700 1 --2- 172.21.15.146:0/3246161960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ebc0a0a70 0x7f7ebc0a0e40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.451+0000 7f7ec341f700 1 --2- 172.21.15.146:0/3246161960 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ebc133f50 0x7f7ebc134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.451+0000 7f7ec341f700 1 --2- 172.21.15.146:0/3246161960 >> v2:172.21.15.146:3300/0 conn(0x7f7ebc0a1380 0x7f7ebc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.451+0000 7f7ec341f700 1 -- 172.21.15.146:0/3246161960 >> 172.21.15.146:0/3246161960 conn(0x7f7ebc0a6610 msgr2=0x7f7ebc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:06.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.451+0000 7f7ec341f700 1 -- 172.21.15.146:0/3246161960 shutdown_connections 2023-10-03T10:13:06.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.451+0000 7f7ec341f700 1 -- 172.21.15.146:0/3246161960 wait complete. 2023-10-03T10:13:06.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.452+0000 7f7ec341f700 1 Processor -- start 2023-10-03T10:13:06.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.452+0000 7f7ec341f700 1 -- start start 2023-10-03T10:13:06.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.452+0000 7f7ec341f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ebc0a0a70 0x7f7ebc1223c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.452+0000 7f7ec341f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ebc0a1380 0x7f7ebc122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.452+0000 7f7ec341f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ebc133f50 0x7f7ebc122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.452+0000 7f7ec341f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc123890 con 0x7f7ebc0a1380 2023-10-03T10:13:06.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.452+0000 7f7ec341f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc133790 con 0x7f7ebc133f50 2023-10-03T10:13:06.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.452+0000 7f7ec341f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc124e60 con 0x7f7ebc0a0a70 2023-10-03T10:13:06.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.452+0000 7f7ec09ba700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ebc0a1380 0x7f7ebc122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.452+0000 7f7ec09ba700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ebc0a1380 0x7f7ebc122900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41730/0 (socket says 172.21.15.146:41730) 2023-10-03T10:13:06.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.452+0000 7f7ec09ba700 1 -- 172.21.15.146:0/2896914068 learned_addr learned my addr 172.21.15.146:0/2896914068 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:06.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.452+0000 7f7ec19bc700 1 --2- 172.21.15.146:0/2896914068 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ebc133f50 0x7f7ebc122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.452+0000 7f7ec11bb700 1 --2- 172.21.15.146:0/2896914068 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ebc0a0a70 0x7f7ebc1223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.453+0000 7f7ec09ba700 1 -- 172.21.15.146:0/2896914068 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ebc0a0a70 msgr2=0x7f7ebc1223c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.453+0000 7f7ec09ba700 1 --2- 172.21.15.146:0/2896914068 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ebc0a0a70 0x7f7ebc1223c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.453+0000 7f7ec09ba700 1 -- 172.21.15.146:0/2896914068 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ebc133f50 msgr2=0x7f7ebc122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.453+0000 7f7ec09ba700 1 --2- 172.21.15.146:0/2896914068 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ebc133f50 0x7f7ebc122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.453+0000 7f7ec09ba700 1 -- 172.21.15.146:0/2896914068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eac0094a0 con 0x7f7ebc0a1380 2023-10-03T10:13:06.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.453+0000 7f7ec19bc700 1 --2- 172.21.15.146:0/2896914068 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ebc133f50 0x7f7ebc122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:06.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.453+0000 7f7ec09ba700 1 --2- 172.21.15.146:0/2896914068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ebc0a1380 0x7f7ebc122900 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00ebb0 tx=0x7f7eac00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:06.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.453+0000 7f7eb1ffb700 1 -- 172.21.15.146:0/2896914068 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac00c850 con 0x7f7ebc0a1380 2023-10-03T10:13:06.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.453+0000 7f7eb1ffb700 1 -- 172.21.15.146:0/2896914068 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac00c9b0 con 0x7f7ebc0a1380 2023-10-03T10:13:06.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.453+0000 7f7ec341f700 1 -- 172.21.15.146:0/2896914068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb4009b30 con 0x7f7ebc0a1380 2023-10-03T10:13:06.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.453+0000 7f7eb1ffb700 1 -- 172.21.15.146:0/2896914068 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac00cd40 con 0x7f7ebc0a1380 2023-10-03T10:13:06.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.453+0000 7f7ec341f700 1 -- 172.21.15.146:0/2896914068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb80094a0 con 0x7f7ebc0a1380 2023-10-03T10:13:06.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.454+0000 7f7eb1ffb700 1 -- 172.21.15.146:0/2896914068 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7eac013470 con 0x7f7ebc0a1380 2023-10-03T10:13:06.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.454+0000 7f7eb1ffb700 1 -- 172.21.15.146:0/2896914068 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7eac03f6d0 con 0x7f7ebc0a1380 2023-10-03T10:13:06.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.454+0000 7f7ec341f700 1 -- 172.21.15.146:0/2896914068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ebc11f050 con 0x7f7ebc0a1380 2023-10-03T10:13:06.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.459+0000 7f7eb1ffb700 1 -- 172.21.15.146:0/2896914068 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7eac021020 con 0x7f7ebc0a1380 2023-10-03T10:13:06.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.488+0000 7fd3865b9700 1 Processor -- start 2023-10-03T10:13:06.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.488+0000 7fd3865b9700 1 -- start start 2023-10-03T10:13:06.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.489+0000 7fd3865b9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd380132e70 0x7fd380135250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.489+0000 7fd3865b9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd380135790 0x7fd380137b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.489+0000 7fd3865b9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd38009a540 con 0x7fd38012feb0 2023-10-03T10:13:06.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.489+0000 7fd3865b9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38009ad40 con 0x7fd380135790 2023-10-03T10:13:06.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.489+0000 7fd3865b9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd38009e640 con 0x7fd380132e70 2023-10-03T10:13:06.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.489+0000 7fd37ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd38012feb0 0x7fd380130280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55238/0 (socket says 172.21.15.146:55238) 2023-10-03T10:13:06.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.489+0000 7fd37ffff700 1 -- 172.21.15.146:0/335356056 learned_addr learned my addr 172.21.15.146:0/335356056 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:06.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.489+0000 7fd37f7fe700 1 --2- 172.21.15.146:0/335356056 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd380132e70 0x7fd380135250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.489+0000 7fd384b56700 1 --2- 172.21.15.146:0/335356056 >> v2:172.21.15.146:3300/0 conn(0x7fd380135790 0x7fd380137b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.489+0000 7fd37effd700 1 -- 172.21.15.146:0/335356056 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518324311 0 0) 0x7fd38009a540 con 0x7fd38012feb0 2023-10-03T10:13:06.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.489+0000 7fd37effd700 1 -- 172.21.15.146:0/335356056 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3680035b0 con 0x7fd38012feb0 2023-10-03T10:13:06.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.489+0000 7fd384b56700 1 -- 172.21.15.146:0/335356056 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd380132e70 msgr2=0x7fd380135250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:06.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.489+0000 7fd384b56700 1 --2- 172.21.15.146:0/335356056 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd380132e70 0x7fd380135250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.489+0000 7fd384b56700 1 -- 172.21.15.146:0/335356056 >> v1:172.21.15.146:6789/0 conn(0x7fd38012feb0 legacy=0x7fd380130280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.489+0000 7fd384b56700 1 -- 172.21.15.146:0/335356056 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38009e3c0 con 0x7fd380135790 2023-10-03T10:13:06.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.489+0000 7fd37f7fe700 1 --2- 172.21.15.146:0/335356056 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd380132e70 0x7fd380135250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:06.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.489+0000 7fd384b56700 1 --2- 172.21.15.146:0/335356056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd380135790 0x7fd380137b70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd378009d90 tx=0x7fd37800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a8c07bb148785c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:06.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.489+0000 7fd37effd700 1 -- 172.21.15.146:0/335356056 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37800e070 con 0x7fd380135790 2023-10-03T10:13:06.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.489+0000 7fd37effd700 1 -- 172.21.15.146:0/335356056 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37800bb20 con 0x7fd380135790 2023-10-03T10:13:06.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.489+0000 7fd37effd700 1 -- 172.21.15.146:0/335356056 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37800be90 con 0x7fd380135790 2023-10-03T10:13:06.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.490+0000 7fd3865b9700 1 -- 172.21.15.146:0/335356056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd380135790 msgr2=0x7fd380137b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.490+0000 7fd3865b9700 1 --2- 172.21.15.146:0/335356056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd380135790 0x7fd380137b70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd378009d90 tx=0x7fd37800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:06.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.490+0000 7fd3865b9700 1 -- 172.21.15.146:0/335356056 shutdown_connections 2023-10-03T10:13:06.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.490+0000 7fd3865b9700 1 --2- 172.21.15.146:0/335356056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd380135790 0x7fd380137b70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.490+0000 7fd3865b9700 1 --2- 172.21.15.146:0/335356056 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd380132e70 0x7fd380135250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.490+0000 7fd3865b9700 1 -- 172.21.15.146:0/335356056 >> 172.21.15.146:0/335356056 conn(0x7fd3800a2b30 msgr2=0x7fd38009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:06.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.490+0000 7fd3865b9700 1 -- 172.21.15.146:0/335356056 shutdown_connections 2023-10-03T10:13:06.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.490+0000 7fd3865b9700 1 -- 172.21.15.146:0/335356056 wait complete. 2023-10-03T10:13:06.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.491+0000 7fd3865b9700 1 Processor -- start 2023-10-03T10:13:06.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.491+0000 7fd3865b9700 1 -- start start 2023-10-03T10:13:06.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.491+0000 7fd3865b9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd38012feb0 0x7fd3801c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.491+0000 7fd3865b9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd380132e70 0x7fd3801c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.491+0000 7fd3865b9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd380135790 0x7fd38012b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.491+0000 7fd3865b9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38012a310 con 0x7fd38012feb0 2023-10-03T10:13:06.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.491+0000 7fd3865b9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3801c3bf0 con 0x7fd380135790 2023-10-03T10:13:06.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.491+0000 7fd3865b9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd380127c30 con 0x7fd380132e70 2023-10-03T10:13:06.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.492+0000 7fd37f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd380132e70 0x7fd3801c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.492+0000 7fd384b56700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd380135790 0x7fd38012b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.492+0000 7fd37f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd380132e70 0x7fd3801c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:33016/0 (socket says 172.21.15.146:33016) 2023-10-03T10:13:06.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.492+0000 7fd37f7fe700 1 -- 172.21.15.146:0/4221757429 learned_addr learned my addr 172.21.15.146:0/4221757429 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:06.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.492+0000 7fd384b56700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd380135790 0x7fd38012b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:47268/0 (socket says 172.21.15.146:47268) 2023-10-03T10:13:06.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.492+0000 7fd37ffff700 1 --2- 172.21.15.146:0/4221757429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd38012feb0 0x7fd3801c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.492+0000 7fd384b56700 1 -- 172.21.15.146:0/4221757429 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd380132e70 msgr2=0x7fd3801c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.492+0000 7fd384b56700 1 --2- 172.21.15.146:0/4221757429 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd380132e70 0x7fd3801c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.492+0000 7fd384b56700 1 -- 172.21.15.146:0/4221757429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd38012feb0 msgr2=0x7fd3801c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.492+0000 7fd384b56700 1 --2- 172.21.15.146:0/4221757429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd38012feb0 0x7fd3801c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.492+0000 7fd384b56700 1 -- 172.21.15.146:0/4221757429 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3740094a0 con 0x7fd380135790 2023-10-03T10:13:06.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.492+0000 7fd37f7fe700 1 --2- 172.21.15.146:0/4221757429 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd380132e70 0x7fd3801c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:06.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.492+0000 7fd37ffff700 1 --2- 172.21.15.146:0/4221757429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd38012feb0 0x7fd3801c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:06.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.492+0000 7fd384b56700 1 --2- 172.21.15.146:0/4221757429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd380135790 0x7fd38012b4b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd378016000 tx=0x7fd378004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:06.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.492+0000 7fd37cff9700 1 -- 172.21.15.146:0/4221757429 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd378004880 con 0x7fd380135790 2023-10-03T10:13:06.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.492+0000 7fd37cff9700 1 -- 172.21.15.146:0/4221757429 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd378020070 con 0x7fd380135790 2023-10-03T10:13:06.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.492+0000 7fd37cff9700 1 -- 172.21.15.146:0/4221757429 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3780276c0 con 0x7fd380135790 2023-10-03T10:13:06.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.492+0000 7fd3865b9700 1 -- 172.21.15.146:0/4221757429 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd378009a70 con 0x7fd380135790 2023-10-03T10:13:06.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.492+0000 7fd3865b9700 1 -- 172.21.15.146:0/4221757429 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd380127260 con 0x7fd380135790 2023-10-03T10:13:06.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.493+0000 7fd3865b9700 1 -- 172.21.15.146:0/4221757429 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38004f2a0 con 0x7fd380135790 2023-10-03T10:13:06.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.493+0000 7fd37cff9700 1 -- 172.21.15.146:0/4221757429 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd378012430 con 0x7fd380135790 2023-10-03T10:13:06.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.494+0000 7fd37cff9700 1 -- 172.21.15.146:0/4221757429 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd378022070 con 0x7fd380135790 2023-10-03T10:13:06.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.498+0000 7fd37cff9700 1 -- 172.21.15.146:0/4221757429 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd378072750 con 0x7fd380135790 2023-10-03T10:13:06.620 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:06.642 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:06.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.655+0000 7f7ec341f700 1 -- 172.21.15.146:0/2896914068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7ebc0a50e0 con 0x7f7ebc0a1380 2023-10-03T10:13:06.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.656+0000 7f7eb1ffb700 1 -- 172.21.15.146:0/2896914068 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7eac0232f0 con 0x7f7ebc0a1380 2023-10-03T10:13:06.657 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:06.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.658+0000 7f7ec341f700 1 -- 172.21.15.146:0/2896914068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ebc0a1380 msgr2=0x7f7ebc122900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.658+0000 7f7ec341f700 1 --2- 172.21.15.146:0/2896914068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ebc0a1380 0x7f7ebc122900 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00ebb0 tx=0x7f7eac00eec0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.658+0000 7f7ec341f700 1 -- 172.21.15.146:0/2896914068 shutdown_connections 2023-10-03T10:13:06.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.658+0000 7f7ec341f700 1 --2- 172.21.15.146:0/2896914068 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ebc133f50 0x7f7ebc122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.658+0000 7f7ec341f700 1 --2- 172.21.15.146:0/2896914068 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ebc0a0a70 0x7f7ebc1223c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.658+0000 7f7ec341f700 1 --2- 172.21.15.146:0/2896914068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ebc0a1380 0x7f7ebc122900 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.658+0000 7f7ec341f700 1 -- 172.21.15.146:0/2896914068 >> 172.21.15.146:0/2896914068 conn(0x7f7ebc0a6610 msgr2=0x7f7ebc09f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:06.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.658+0000 7f7ec341f700 1 -- 172.21.15.146:0/2896914068 shutdown_connections 2023-10-03T10:13:06.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.658+0000 7f7ec341f700 1 -- 172.21.15.146:0/2896914068 wait complete. 2023-10-03T10:13:06.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:06.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.700+0000 7fd3865b9700 1 -- 172.21.15.146:0/4221757429 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd38006b2a0 con 0x7fd380135790 2023-10-03T10:13:06.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.701+0000 7fd37cff9700 1 -- 172.21.15.146:0/4221757429 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd378003e30 con 0x7fd380135790 2023-10-03T10:13:06.702 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:06.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.703+0000 7fd3865b9700 1 -- 172.21.15.146:0/4221757429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd380135790 msgr2=0x7fd38012b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.703+0000 7fd3865b9700 1 --2- 172.21.15.146:0/4221757429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd380135790 0x7fd38012b4b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd378016000 tx=0x7fd378004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.703+0000 7fd3865b9700 1 -- 172.21.15.146:0/4221757429 shutdown_connections 2023-10-03T10:13:06.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.703+0000 7fd3865b9700 1 --2- 172.21.15.146:0/4221757429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd380135790 0x7fd38012b4b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.703+0000 7fd3865b9700 1 --2- 172.21.15.146:0/4221757429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd38012feb0 0x7fd3801c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.703+0000 7fd3865b9700 1 --2- 172.21.15.146:0/4221757429 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd380132e70 0x7fd3801c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.703+0000 7fd3865b9700 1 -- 172.21.15.146:0/4221757429 >> 172.21.15.146:0/4221757429 conn(0x7fd3800a2b30 msgr2=0x7fd38009c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:06.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.704+0000 7fd3865b9700 1 -- 172.21.15.146:0/4221757429 shutdown_connections 2023-10-03T10:13:06.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.704+0000 7fd3865b9700 1 -- 172.21.15.146:0/4221757429 wait complete. 2023-10-03T10:13:06.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:06.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.747+0000 7f6dfe4f4700 1 Processor -- start 2023-10-03T10:13:06.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.747+0000 7f6dfe4f4700 1 -- start start 2023-10-03T10:13:06.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6dfe4f4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6df80a0a70 0x7f6df80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6dfe4f4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6df80a1380 0x7f6df8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6dfe4f4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6df8133f50 0x7f6df81343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6dfe4f4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df809e9d0 con 0x7f6df80a0a70 2023-10-03T10:13:06.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6dfe4f4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df809dc00 con 0x7f6df8133f50 2023-10-03T10:13:06.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6dfe4f4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6df809dec0 con 0x7f6df80a1380 2023-10-03T10:13:06.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6df77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6df80a1380 0x7f6df8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6df7fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6df80a0a70 0x7f6df80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6dfca91700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6df8133f50 0x7f6df81343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6df7fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6df80a0a70 0x7f6df80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41762/0 (socket says 172.21.15.146:41762) 2023-10-03T10:13:06.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6df77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6df80a1380 0x7f6df8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:33020/0 (socket says 172.21.15.146:33020) 2023-10-03T10:13:06.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6df7fff700 1 -- 172.21.15.146:0/1757407583 learned_addr learned my addr 172.21.15.146:0/1757407583 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:06.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6df7fff700 1 -- 172.21.15.146:0/1757407583 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6df80a1380 msgr2=0x7f6df8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:06.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6df7fff700 1 --2- 172.21.15.146:0/1757407583 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6df80a1380 0x7f6df8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6df7fff700 1 -- 172.21.15.146:0/1757407583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6df8133f50 msgr2=0x7f6df81343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:06.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6df7fff700 1 --2- 172.21.15.146:0/1757407583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6df8133f50 0x7f6df81343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6df7fff700 1 -- 172.21.15.146:0/1757407583 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df809e6a0 con 0x7f6df80a0a70 2023-10-03T10:13:06.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6df77fe700 1 --2- 172.21.15.146:0/1757407583 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6df80a1380 0x7f6df8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:06.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6dfca91700 1 --2- 172.21.15.146:0/1757407583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6df8133f50 0x7f6df81343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:06.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6df7fff700 1 --2- 172.21.15.146:0/1757407583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6df80a0a70 0x7f6df80a0e40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6de80098f0 tx=0x7f6de8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ffe1e91091b1618 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:06.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6df6ffd700 1 -- 172.21.15.146:0/1757407583 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de8011830 con 0x7f6df80a0a70 2023-10-03T10:13:06.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6df6ffd700 1 -- 172.21.15.146:0/1757407583 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de8011990 con 0x7f6df80a0a70 2023-10-03T10:13:06.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.748+0000 7f6df6ffd700 1 -- 172.21.15.146:0/1757407583 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de8011d20 con 0x7f6df80a0a70 2023-10-03T10:13:06.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.749+0000 7f6dfe4f4700 1 -- 172.21.15.146:0/1757407583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6df80a0a70 msgr2=0x7f6df80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.749+0000 7f6dfe4f4700 1 --2- 172.21.15.146:0/1757407583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6df80a0a70 0x7f6df80a0e40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6de80098f0 tx=0x7f6de8009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:06.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.749+0000 7f6dfe4f4700 1 -- 172.21.15.146:0/1757407583 shutdown_connections 2023-10-03T10:13:06.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.749+0000 7f6dfe4f4700 1 --2- 172.21.15.146:0/1757407583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6df8133f50 0x7f6df81343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.749+0000 7f6dfe4f4700 1 --2- 172.21.15.146:0/1757407583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6df80a0a70 0x7f6df80a0e40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.749+0000 7f6dfe4f4700 1 --2- 172.21.15.146:0/1757407583 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6df80a1380 0x7f6df8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.749+0000 7f6dfe4f4700 1 -- 172.21.15.146:0/1757407583 >> 172.21.15.146:0/1757407583 conn(0x7f6df80a6610 msgr2=0x7f6df80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:06.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.749+0000 7f6dfe4f4700 1 -- 172.21.15.146:0/1757407583 shutdown_connections 2023-10-03T10:13:06.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.749+0000 7f6dfe4f4700 1 -- 172.21.15.146:0/1757407583 wait complete. 2023-10-03T10:13:06.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.750+0000 7f6dfe4f4700 1 Processor -- start 2023-10-03T10:13:06.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.750+0000 7f6dfe4f4700 1 -- start start 2023-10-03T10:13:06.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6dfe4f4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6df80a0a70 0x7f6df8121580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6dfe4f4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6df80a1380 0x7f6df8121ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6dfe4f4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6df8133f50 0x7f6df8122000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6dfe4f4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df8132900 con 0x7f6df8133f50 2023-10-03T10:13:06.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6dfe4f4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df8123fd0 con 0x7f6df80a0a70 2023-10-03T10:13:06.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6dfe4f4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6df8124ab0 con 0x7f6df80a1380 2023-10-03T10:13:06.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6df77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6df80a1380 0x7f6df8121ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6df7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6df80a0a70 0x7f6df8121580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6df77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6df80a1380 0x7f6df8121ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:33022/0 (socket says 172.21.15.146:33022) 2023-10-03T10:13:06.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6dfca91700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6df8133f50 0x7f6df8122000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6df77fe700 1 -- 172.21.15.146:0/1008241337 learned_addr learned my addr 172.21.15.146:0/1008241337 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:06.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6df7fff700 1 -- 172.21.15.146:0/1008241337 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6df80a1380 msgr2=0x7f6df8121ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6df7fff700 1 --2- 172.21.15.146:0/1008241337 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6df80a1380 0x7f6df8121ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6df7fff700 1 -- 172.21.15.146:0/1008241337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6df8133f50 msgr2=0x7f6df8122000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6df7fff700 1 --2- 172.21.15.146:0/1008241337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6df8133f50 0x7f6df8122000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6df7fff700 1 -- 172.21.15.146:0/1008241337 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec0094a0 con 0x7f6df80a0a70 2023-10-03T10:13:06.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6df77fe700 1 --2- 172.21.15.146:0/1008241337 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6df80a1380 0x7f6df8121ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:06.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6dfca91700 1 --2- 172.21.15.146:0/1008241337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6df8133f50 0x7f6df8122000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:06.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6df7fff700 1 --2- 172.21.15.146:0/1008241337 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6df80a0a70 0x7f6df8121580 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6df80a72d0 tx=0x7f6de8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:06.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6df4ff9700 1 -- 172.21.15.146:0/1008241337 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de8004240 con 0x7f6df80a0a70 2023-10-03T10:13:06.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6df4ff9700 1 -- 172.21.15.146:0/1008241337 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de801f070 con 0x7f6df80a0a70 2023-10-03T10:13:06.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6df4ff9700 1 -- 172.21.15.146:0/1008241337 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de80036a0 con 0x7f6df80a0a70 2023-10-03T10:13:06.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6dfe4f4700 1 -- 172.21.15.146:0/1008241337 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df0009a70 con 0x7f6df80a0a70 2023-10-03T10:13:06.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.751+0000 7f6dfe4f4700 1 -- 172.21.15.146:0/1008241337 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de8009550 con 0x7f6df80a0a70 2023-10-03T10:13:06.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.752+0000 7f6df4ff9700 1 -- 172.21.15.146:0/1008241337 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6de8021030 con 0x7f6df80a0a70 2023-10-03T10:13:06.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.752+0000 7f6df4ff9700 1 -- 172.21.15.146:0/1008241337 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6de80407b0 con 0x7f6df80a0a70 2023-10-03T10:13:06.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.752+0000 7f6dfe4f4700 1 -- 172.21.15.146:0/1008241337 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df811e040 con 0x7f6df80a0a70 2023-10-03T10:13:06.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.757+0000 7f6df4ff9700 1 -- 172.21.15.146:0/1008241337 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6de80199a0 con 0x7f6df80a0a70 2023-10-03T10:13:06.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.784+0000 7fa8b52c9700 1 Processor -- start 2023-10-03T10:13:06.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.784+0000 7fa8b52c9700 1 -- start start 2023-10-03T10:13:06.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.784+0000 7fa8b52c9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa8b00a0a70 0x7fa8b00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.784+0000 7fa8b52c9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b00a1380 0x7fa8b0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.784+0000 7fa8b52c9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b0133f50 0x7fa8b01343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.784+0000 7fa8b52c9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b009e9d0 con 0x7fa8b00a0a70 2023-10-03T10:13:06.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.784+0000 7fa8b52c9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b009dc00 con 0x7fa8b0133f50 2023-10-03T10:13:06.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.784+0000 7fa8b52c9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b009dec0 con 0x7fa8b00a1380 2023-10-03T10:13:06.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.784+0000 7fa8af7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b0133f50 0x7fa8b01343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.784+0000 7fa8aeffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa8b00a0a70 0x7fa8b00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.784+0000 7fa8aeffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa8b00a0a70 0x7fa8b00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41780/0 (socket says 172.21.15.146:41780) 2023-10-03T10:13:06.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.784+0000 7fa8aeffd700 1 -- 172.21.15.146:0/2740484233 learned_addr learned my addr 172.21.15.146:0/2740484233 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:06.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.784+0000 7fa8af7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b0133f50 0x7fa8b01343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:47306/0 (socket says 172.21.15.146:47306) 2023-10-03T10:13:06.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.784+0000 7fa8ae7fc700 1 --2- 172.21.15.146:0/2740484233 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b00a1380 0x7fa8b0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.785+0000 7fa8af7fe700 1 -- 172.21.15.146:0/2740484233 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b00a1380 msgr2=0x7fa8b0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:06.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.785+0000 7fa8af7fe700 1 --2- 172.21.15.146:0/2740484233 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b00a1380 0x7fa8b0133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.785+0000 7fa8af7fe700 1 -- 172.21.15.146:0/2740484233 >> v2:172.21.15.146:3300/0 conn(0x7fa8b00a0a70 msgr2=0x7fa8b00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:06.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.785+0000 7fa8af7fe700 1 --2- 172.21.15.146:0/2740484233 >> v2:172.21.15.146:3300/0 conn(0x7fa8b00a0a70 0x7fa8b00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.785+0000 7fa8af7fe700 1 -- 172.21.15.146:0/2740484233 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b009e6a0 con 0x7fa8b0133f50 2023-10-03T10:13:06.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.785+0000 7fa8aeffd700 1 --2- 172.21.15.146:0/2740484233 >> v2:172.21.15.146:3300/0 conn(0x7fa8b00a0a70 0x7fa8b00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:06.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.785+0000 7fa8ae7fc700 1 --2- 172.21.15.146:0/2740484233 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b00a1380 0x7fa8b0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:06.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.785+0000 7fa8af7fe700 1 --2- 172.21.15.146:0/2740484233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b0133f50 0x7fa8b01343b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8009d90 tx=0x7fa8a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5aa7fa6229b02b90 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:06.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.785+0000 7fa8adffb700 1 -- 172.21.15.146:0/2740484233 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a800e070 con 0x7fa8b0133f50 2023-10-03T10:13:06.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.785+0000 7fa8adffb700 1 -- 172.21.15.146:0/2740484233 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a800bb20 con 0x7fa8b0133f50 2023-10-03T10:13:06.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.785+0000 7fa8adffb700 1 -- 172.21.15.146:0/2740484233 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8012430 con 0x7fa8b0133f50 2023-10-03T10:13:06.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.786+0000 7fa8b52c9700 1 -- 172.21.15.146:0/2740484233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b0133f50 msgr2=0x7fa8b01343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.786+0000 7fa8b52c9700 1 --2- 172.21.15.146:0/2740484233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b0133f50 0x7fa8b01343b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8009d90 tx=0x7fa8a800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:06.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.786+0000 7fa8b52c9700 1 -- 172.21.15.146:0/2740484233 shutdown_connections 2023-10-03T10:13:06.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.786+0000 7fa8b52c9700 1 --2- 172.21.15.146:0/2740484233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b0133f50 0x7fa8b01343b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.786+0000 7fa8b52c9700 1 --2- 172.21.15.146:0/2740484233 >> v2:172.21.15.146:3300/0 conn(0x7fa8b00a0a70 0x7fa8b00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.786+0000 7fa8b52c9700 1 --2- 172.21.15.146:0/2740484233 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b00a1380 0x7fa8b0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.786+0000 7fa8b52c9700 1 -- 172.21.15.146:0/2740484233 >> 172.21.15.146:0/2740484233 conn(0x7fa8b00a6610 msgr2=0x7fa8b00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:06.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.786+0000 7fa8b52c9700 1 -- 172.21.15.146:0/2740484233 shutdown_connections 2023-10-03T10:13:06.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.786+0000 7fa8b52c9700 1 -- 172.21.15.146:0/2740484233 wait complete. 2023-10-03T10:13:06.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.787+0000 7fa8b52c9700 1 Processor -- start 2023-10-03T10:13:06.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.787+0000 7fa8b52c9700 1 -- start start 2023-10-03T10:13:06.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.787+0000 7fa8b52c9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b00a0a70 0x7fa8b0121330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.787+0000 7fa8b52c9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b00a1380 0x7fa8b0121870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.787+0000 7fa8b52c9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b0133f50 0x7fa8b0121db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.787+0000 7fa8b52c9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b0124e50 con 0x7fa8b00a0a70 2023-10-03T10:13:06.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.787+0000 7fa8b52c9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b0123dd0 con 0x7fa8b00a1380 2023-10-03T10:13:06.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.787+0000 7fa8b52c9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00a03e0 con 0x7fa8b0133f50 2023-10-03T10:13:06.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.787+0000 7fa8ae7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b00a1380 0x7fa8b0121870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.787+0000 7fa8af7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b0133f50 0x7fa8b0121db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.787+0000 7fa8af7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b0133f50 0x7fa8b0121db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:33052/0 (socket says 172.21.15.146:33052) 2023-10-03T10:13:06.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.787+0000 7fa8ae7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b00a1380 0x7fa8b0121870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:47312/0 (socket says 172.21.15.146:47312) 2023-10-03T10:13:06.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.787+0000 7fa8af7fe700 1 -- 172.21.15.146:0/2722792373 learned_addr learned my addr 172.21.15.146:0/2722792373 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:06.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.787+0000 7fa8aeffd700 1 --2- 172.21.15.146:0/2722792373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b00a0a70 0x7fa8b0121330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.788+0000 7fa8af7fe700 1 -- 172.21.15.146:0/2722792373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b00a1380 msgr2=0x7fa8b0121870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.788+0000 7fa8af7fe700 1 --2- 172.21.15.146:0/2722792373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b00a1380 0x7fa8b0121870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.788+0000 7fa8af7fe700 1 -- 172.21.15.146:0/2722792373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b00a0a70 msgr2=0x7fa8b0121330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.788+0000 7fa8af7fe700 1 --2- 172.21.15.146:0/2722792373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b00a0a70 0x7fa8b0121330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.788+0000 7fa8af7fe700 1 -- 172.21.15.146:0/2722792373 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a0009550 con 0x7fa8b0133f50 2023-10-03T10:13:06.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.788+0000 7fa8ae7fc700 1 --2- 172.21.15.146:0/2722792373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b00a1380 0x7fa8b0121870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:06.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.788+0000 7fa8aeffd700 1 --2- 172.21.15.146:0/2722792373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b00a0a70 0x7fa8b0121330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:06.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.788+0000 7fa8af7fe700 1 --2- 172.21.15.146:0/2722792373 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b0133f50 0x7fa8b0121db0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8014040 tx=0x7fa8a8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:06.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.788+0000 7fa8977fe700 1 -- 172.21.15.146:0/2722792373 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a80044d0 con 0x7fa8b0133f50 2023-10-03T10:13:06.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.788+0000 7fa8977fe700 1 -- 172.21.15.146:0/2722792373 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a8020070 con 0x7fa8b0133f50 2023-10-03T10:13:06.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.788+0000 7fa8977fe700 1 -- 172.21.15.146:0/2722792373 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8004890 con 0x7fa8b0133f50 2023-10-03T10:13:06.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.788+0000 7fa8b52c9700 1 -- 172.21.15.146:0/2722792373 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a40094a0 con 0x7fa8b0133f50 2023-10-03T10:13:06.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.788+0000 7fa8b52c9700 1 -- 172.21.15.146:0/2722792373 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a8009a70 con 0x7fa8b0133f50 2023-10-03T10:13:06.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.789+0000 7fa8977fe700 1 -- 172.21.15.146:0/2722792373 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa8a8012430 con 0x7fa8b0133f50 2023-10-03T10:13:06.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.789+0000 7fa8b52c9700 1 -- 172.21.15.146:0/2722792373 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b011e040 con 0x7fa8b0133f50 2023-10-03T10:13:06.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.789+0000 7fa8977fe700 1 -- 172.21.15.146:0/2722792373 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa8a8022070 con 0x7fa8b0133f50 2023-10-03T10:13:06.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.793+0000 7fa8977fe700 1 -- 172.21.15.146:0/2722792373 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa8a801c400 con 0x7fa8b0133f50 2023-10-03T10:13:06.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.953+0000 7f6dfe4f4700 1 -- 172.21.15.146:0/1008241337 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6df8133a10 con 0x7f6df80a0a70 2023-10-03T10:13:06.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.954+0000 7f6df4ff9700 1 -- 172.21.15.146:0/1008241337 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6de8015020 con 0x7f6df80a0a70 2023-10-03T10:13:06.955 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:06.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.956+0000 7f6dfe4f4700 1 -- 172.21.15.146:0/1008241337 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6df80a0a70 msgr2=0x7f6df8121580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.956+0000 7f6dfe4f4700 1 --2- 172.21.15.146:0/1008241337 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6df80a0a70 0x7f6df8121580 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6df80a72d0 tx=0x7f6de8004750 comp rx=0 tx=0).stop 2023-10-03T10:13:06.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.956+0000 7f6dfe4f4700 1 -- 172.21.15.146:0/1008241337 shutdown_connections 2023-10-03T10:13:06.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.956+0000 7f6dfe4f4700 1 --2- 172.21.15.146:0/1008241337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6df8133f50 0x7f6df8122000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.956+0000 7f6dfe4f4700 1 --2- 172.21.15.146:0/1008241337 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6df80a0a70 0x7f6df8121580 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.956+0000 7f6dfe4f4700 1 --2- 172.21.15.146:0/1008241337 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6df80a1380 0x7f6df8121ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.956+0000 7f6dfe4f4700 1 -- 172.21.15.146:0/1008241337 >> 172.21.15.146:0/1008241337 conn(0x7f6df80a6610 msgr2=0x7f6df81332f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:06.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.956+0000 7f6dfe4f4700 1 -- 172.21.15.146:0/1008241337 shutdown_connections 2023-10-03T10:13:06.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.956+0000 7f6dfe4f4700 1 -- 172.21.15.146:0/1008241337 wait complete. 2023-10-03T10:13:06.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:06.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.987+0000 7fa8b52c9700 1 -- 172.21.15.146:0/2722792373 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa8b0122fa0 con 0x7fa8b0133f50 2023-10-03T10:13:06.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.987+0000 7fa8977fe700 1 -- 172.21.15.146:0/2722792373 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa8a801a380 con 0x7fa8b0133f50 2023-10-03T10:13:06.988 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:06.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.989+0000 7fa8b52c9700 1 -- 172.21.15.146:0/2722792373 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b0133f50 msgr2=0x7fa8b0121db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.989+0000 7fa8b52c9700 1 --2- 172.21.15.146:0/2722792373 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b0133f50 0x7fa8b0121db0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8014040 tx=0x7fa8a8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.989+0000 7fa8b52c9700 1 -- 172.21.15.146:0/2722792373 shutdown_connections 2023-10-03T10:13:06.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.989+0000 7fa8b52c9700 1 --2- 172.21.15.146:0/2722792373 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b0133f50 0x7fa8b0121db0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.989+0000 7fa8b52c9700 1 --2- 172.21.15.146:0/2722792373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b00a0a70 0x7fa8b0121330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.989+0000 7fa8b52c9700 1 --2- 172.21.15.146:0/2722792373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b00a1380 0x7fa8b0121870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.989+0000 7fa8b52c9700 1 -- 172.21.15.146:0/2722792373 >> 172.21.15.146:0/2722792373 conn(0x7fa8b00a6610 msgr2=0x7fa8b0133260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:06.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.989+0000 7fa8b52c9700 1 -- 172.21.15.146:0/2722792373 shutdown_connections 2023-10-03T10:13:06.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:06.989+0000 7fa8b52c9700 1 -- 172.21.15.146:0/2722792373 wait complete. 2023-10-03T10:13:07.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:07.679 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:07.718 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:07.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.813+0000 7f581b0e8700 1 Processor -- start 2023-10-03T10:13:07.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.813+0000 7f581b0e8700 1 -- start start 2023-10-03T10:13:07.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.814+0000 7f581b0e8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f581409e870 0x7f581409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.814+0000 7f581b0e8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5814134330 0x7f581413be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.814+0000 7f581b0e8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f581409fa00 con 0x7f581409f180 2023-10-03T10:13:07.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.814+0000 7f581b0e8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58140a0370 con 0x7f581409e870 2023-10-03T10:13:07.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.814+0000 7f581b0e8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f581406bec0 con 0x7f5814134330 2023-10-03T10:13:07.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.814+0000 7f5819685700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5814134330 0x7f581413be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.814+0000 7f5818e84700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f581409e870 0x7f581409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.814+0000 7f5819685700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5814134330 0x7f581413be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:33062/0 (socket says 172.21.15.146:33062) 2023-10-03T10:13:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.814+0000 7f5819685700 1 -- 172.21.15.146:0/315163702 learned_addr learned my addr 172.21.15.146:0/315163702 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.814+0000 7f5818e84700 1 --2- 172.21.15.146:0/315163702 >> v2:172.21.15.146:3300/0 conn(0x7f581409e870 0x7f581409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41804/0 (socket says 172.21.15.146:41804) 2023-10-03T10:13:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.814+0000 7f5818e84700 1 -- 172.21.15.146:0/315163702 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5814134330 msgr2=0x7f581413be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.814+0000 7f5818e84700 1 --2- 172.21.15.146:0/315163702 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5814134330 0x7f581413be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.814+0000 7f5818e84700 1 -- 172.21.15.146:0/315163702 >> v1:172.21.15.146:6789/0 conn(0x7f581409f180 legacy=0x7f5814133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.814+0000 7f5818e84700 1 -- 172.21.15.146:0/315163702 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581409ada0 con 0x7f581409e870 2023-10-03T10:13:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.814+0000 7f58137fe700 1 -- 172.21.15.146:0/315163702 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281457634 0 0) 0x7f581409fa00 con 0x7f581409f180 2023-10-03T10:13:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.814+0000 7f5819685700 1 --2- 172.21.15.146:0/315163702 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5814134330 0x7f581413be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.814+0000 7f5818e84700 1 --2- 172.21.15.146:0/315163702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f581409e870 0x7f581409ec40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5808009840 tx=0x7f5808009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ff333286fb1225 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.815+0000 7f58137fe700 1 -- 172.21.15.146:0/315163702 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5808011830 con 0x7f581409e870 2023-10-03T10:13:07.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.815+0000 7f58137fe700 1 -- 172.21.15.146:0/315163702 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5808011990 con 0x7f581409e870 2023-10-03T10:13:07.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.815+0000 7f58137fe700 1 -- 172.21.15.146:0/315163702 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5808011d20 con 0x7f581409e870 2023-10-03T10:13:07.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.815+0000 7f581b0e8700 1 -- 172.21.15.146:0/315163702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f581409e870 msgr2=0x7f581409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.815+0000 7f581b0e8700 1 --2- 172.21.15.146:0/315163702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f581409e870 0x7f581409ec40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5808009840 tx=0x7f5808009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:07.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.815+0000 7f581b0e8700 1 -- 172.21.15.146:0/315163702 shutdown_connections 2023-10-03T10:13:07.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.815+0000 7f581b0e8700 1 --2- 172.21.15.146:0/315163702 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5814134330 0x7f581413be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.815+0000 7f581b0e8700 1 --2- 172.21.15.146:0/315163702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f581409e870 0x7f581409ec40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.815+0000 7f581b0e8700 1 -- 172.21.15.146:0/315163702 >> 172.21.15.146:0/315163702 conn(0x7f58140a4430 msgr2=0x7f58140a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.815+0000 7f581b0e8700 1 -- 172.21.15.146:0/315163702 shutdown_connections 2023-10-03T10:13:07.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.815+0000 7f581b0e8700 1 -- 172.21.15.146:0/315163702 wait complete. 2023-10-03T10:13:07.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.816+0000 7f581b0e8700 1 Processor -- start 2023-10-03T10:13:07.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.816+0000 7f581b0e8700 1 -- start start 2023-10-03T10:13:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.817+0000 7f581b0e8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f581409e870 0x7f5814122940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.817+0000 7f581b0e8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f581409f180 0x7f5814122e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.817+0000 7f581b0e8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5814134330 0x7f58141233c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.817+0000 7f581b0e8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5814123e10 con 0x7f581409f180 2023-10-03T10:13:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.817+0000 7f581b0e8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5814124520 con 0x7f581409e870 2023-10-03T10:13:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.817+0000 7f581b0e8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58141260b0 con 0x7f5814134330 2023-10-03T10:13:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.817+0000 7f5813fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f581409f180 0x7f5814122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.817+0000 7f5818e84700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f581409e870 0x7f5814122940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.817+0000 7f5818e84700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f581409e870 0x7f5814122940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:47320/0 (socket says 172.21.15.146:47320) 2023-10-03T10:13:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.817+0000 7f5813fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f581409f180 0x7f5814122e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41810/0 (socket says 172.21.15.146:41810) 2023-10-03T10:13:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.817+0000 7f5818e84700 1 -- 172.21.15.146:0/2180586966 learned_addr learned my addr 172.21.15.146:0/2180586966 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.817+0000 7f5819685700 1 --2- 172.21.15.146:0/2180586966 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5814134330 0x7f58141233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.817+0000 7f5818e84700 1 -- 172.21.15.146:0/2180586966 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5814134330 msgr2=0x7f58141233c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.817+0000 7f5818e84700 1 --2- 172.21.15.146:0/2180586966 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5814134330 0x7f58141233c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.817+0000 7f5818e84700 1 -- 172.21.15.146:0/2180586966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f581409f180 msgr2=0x7f5814122e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.817+0000 7f5818e84700 1 --2- 172.21.15.146:0/2180586966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f581409f180 0x7f5814122e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.817+0000 7f5818e84700 1 -- 172.21.15.146:0/2180586966 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c009b30 con 0x7f581409e870 2023-10-03T10:13:07.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.817+0000 7f5818e84700 1 --2- 172.21.15.146:0/2180586966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f581409e870 0x7f5814122940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5808009fd0 tx=0x7f5808004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.818+0000 7f58117fa700 1 -- 172.21.15.146:0/2180586966 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5808004550 con 0x7f581409e870 2023-10-03T10:13:07.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.818+0000 7f58117fa700 1 -- 172.21.15.146:0/2180586966 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580801f070 con 0x7f581409e870 2023-10-03T10:13:07.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.818+0000 7f581b0e8700 1 -- 172.21.15.146:0/2180586966 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58080094a0 con 0x7f581409e870 2023-10-03T10:13:07.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.818+0000 7f58117fa700 1 -- 172.21.15.146:0/2180586966 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58080038e0 con 0x7f581409e870 2023-10-03T10:13:07.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.818+0000 7f581b0e8700 1 -- 172.21.15.146:0/2180586966 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f581406cfa0 con 0x7f581409e870 2023-10-03T10:13:07.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.818+0000 7f58117fa700 1 -- 172.21.15.146:0/2180586966 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5808003a40 con 0x7f581409e870 2023-10-03T10:13:07.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.819+0000 7f58117fa700 1 -- 172.21.15.146:0/2180586966 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5808021070 con 0x7f581409e870 2023-10-03T10:13:07.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.819+0000 7f581b0e8700 1 -- 172.21.15.146:0/2180586966 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f581404f2a0 con 0x7f581409e870 2023-10-03T10:13:07.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.823+0000 7f58117fa700 1 -- 172.21.15.146:0/2180586966 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5808015080 con 0x7f581409e870 2023-10-03T10:13:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.851+0000 7f326ab52700 1 Processor -- start 2023-10-03T10:13:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.851+0000 7f326ab52700 1 -- start start 2023-10-03T10:13:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.851+0000 7f326ab52700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f32640a0a70 0x7f32640a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.851+0000 7f326ab52700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32640a1380 0x7f3264133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.851+0000 7f326ab52700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3264133f50 0x7f32641343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.851+0000 7f326ab52700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f326409e9d0 con 0x7f32640a0a70 2023-10-03T10:13:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.851+0000 7f326ab52700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f326409dc00 con 0x7f3264133f50 2023-10-03T10:13:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.851+0000 7f326ab52700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f326409dec0 con 0x7f32640a1380 2023-10-03T10:13:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.852+0000 7f3263fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32640a1380 0x7f3264133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.852+0000 7f32688ee700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f32640a0a70 0x7f32640a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.852+0000 7f3263fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32640a1380 0x7f3264133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:33082/0 (socket says 172.21.15.146:33082) 2023-10-03T10:13:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.852+0000 7f3263fff700 1 -- 172.21.15.146:0/317961666 learned_addr learned my addr 172.21.15.146:0/317961666 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.852+0000 7f32690ef700 1 --2- 172.21.15.146:0/317961666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3264133f50 0x7f32641343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.852+0000 7f3263fff700 1 -- 172.21.15.146:0/317961666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3264133f50 msgr2=0x7f32641343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.852+0000 7f3263fff700 1 --2- 172.21.15.146:0/317961666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3264133f50 0x7f32641343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.852+0000 7f3263fff700 1 -- 172.21.15.146:0/317961666 >> v2:172.21.15.146:3300/0 conn(0x7f32640a0a70 msgr2=0x7f32640a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.852+0000 7f3263fff700 1 --2- 172.21.15.146:0/317961666 >> v2:172.21.15.146:3300/0 conn(0x7f32640a0a70 0x7f32640a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.852+0000 7f3263fff700 1 -- 172.21.15.146:0/317961666 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326409e6a0 con 0x7f32640a1380 2023-10-03T10:13:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.852+0000 7f32688ee700 1 --2- 172.21.15.146:0/317961666 >> v2:172.21.15.146:3300/0 conn(0x7f32640a0a70 0x7f32640a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.852+0000 7f3263fff700 1 --2- 172.21.15.146:0/317961666 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32640a1380 0x7f3264133a10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f32500098f0 tx=0x7f3250009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76ba015c80787c44 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.852+0000 7f32637fe700 1 -- 172.21.15.146:0/317961666 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250011830 con 0x7f32640a1380 2023-10-03T10:13:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.852+0000 7f32637fe700 1 -- 172.21.15.146:0/317961666 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3250011990 con 0x7f32640a1380 2023-10-03T10:13:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.852+0000 7f32637fe700 1 -- 172.21.15.146:0/317961666 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250011d20 con 0x7f32640a1380 2023-10-03T10:13:07.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.853+0000 7f326ab52700 1 -- 172.21.15.146:0/317961666 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32640a1380 msgr2=0x7f3264133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.853+0000 7f326ab52700 1 --2- 172.21.15.146:0/317961666 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32640a1380 0x7f3264133a10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f32500098f0 tx=0x7f3250009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:07.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.853+0000 7f326ab52700 1 -- 172.21.15.146:0/317961666 shutdown_connections 2023-10-03T10:13:07.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.853+0000 7f326ab52700 1 --2- 172.21.15.146:0/317961666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3264133f50 0x7f32641343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.853+0000 7f326ab52700 1 --2- 172.21.15.146:0/317961666 >> v2:172.21.15.146:3300/0 conn(0x7f32640a0a70 0x7f32640a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.853+0000 7f326ab52700 1 --2- 172.21.15.146:0/317961666 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32640a1380 0x7f3264133a10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.853+0000 7f326ab52700 1 -- 172.21.15.146:0/317961666 >> 172.21.15.146:0/317961666 conn(0x7f32640a6610 msgr2=0x7f32640a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.853+0000 7f326ab52700 1 -- 172.21.15.146:0/317961666 shutdown_connections 2023-10-03T10:13:07.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.853+0000 7f326ab52700 1 -- 172.21.15.146:0/317961666 wait complete. 2023-10-03T10:13:07.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.854+0000 7f326ab52700 1 Processor -- start 2023-10-03T10:13:07.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.854+0000 7f326ab52700 1 -- start start 2023-10-03T10:13:07.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.855+0000 7f326ab52700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32640a0a70 0x7f32641223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.855+0000 7f326ab52700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32640a1380 0x7f32641228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.855+0000 7f326ab52700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3264133f50 0x7f3264122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.855+0000 7f326ab52700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3264125180 con 0x7f32640a0a70 2023-10-03T10:13:07.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.855+0000 7f326ab52700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3264124dc0 con 0x7f32640a1380 2023-10-03T10:13:07.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.855+0000 7f326ab52700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32640a03e0 con 0x7f3264133f50 2023-10-03T10:13:07.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.855+0000 7f3263fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32640a1380 0x7f32641228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.855+0000 7f32688ee700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32640a0a70 0x7f32641223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.855+0000 7f3263fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32640a1380 0x7f32641228f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:47328/0 (socket says 172.21.15.146:47328) 2023-10-03T10:13:07.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.855+0000 7f3263fff700 1 -- 172.21.15.146:0/1754029382 learned_addr learned my addr 172.21.15.146:0/1754029382 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:07.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.855+0000 7f32690ef700 1 --2- 172.21.15.146:0/1754029382 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3264133f50 0x7f3264122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.855+0000 7f32688ee700 1 -- 172.21.15.146:0/1754029382 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3264133f50 msgr2=0x7f3264122e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.855+0000 7f32688ee700 1 --2- 172.21.15.146:0/1754029382 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3264133f50 0x7f3264122e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.855+0000 7f32688ee700 1 -- 172.21.15.146:0/1754029382 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32640a1380 msgr2=0x7f32641228f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.855+0000 7f32688ee700 1 --2- 172.21.15.146:0/1754029382 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32640a1380 0x7f32641228f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.855+0000 7f32688ee700 1 -- 172.21.15.146:0/1754029382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32580094a0 con 0x7f32640a0a70 2023-10-03T10:13:07.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.855+0000 7f3263fff700 1 --2- 172.21.15.146:0/1754029382 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32640a1380 0x7f32641228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:07.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.855+0000 7f32690ef700 1 --2- 172.21.15.146:0/1754029382 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3264133f50 0x7f3264122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:07.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.855+0000 7f32688ee700 1 --2- 172.21.15.146:0/1754029382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32640a0a70 0x7f32641223b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f325800e980 tx=0x7f325800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.856+0000 7f32617fa700 1 -- 172.21.15.146:0/1754029382 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258004030 con 0x7f32640a0a70 2023-10-03T10:13:07.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.856+0000 7f32617fa700 1 -- 172.21.15.146:0/1754029382 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32580041b0 con 0x7f32640a0a70 2023-10-03T10:13:07.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.856+0000 7f326ab52700 1 -- 172.21.15.146:0/1754029382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3250009550 con 0x7f32640a0a70 2023-10-03T10:13:07.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.856+0000 7f32617fa700 1 -- 172.21.15.146:0/1754029382 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258004560 con 0x7f32640a0a70 2023-10-03T10:13:07.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.856+0000 7f326ab52700 1 -- 172.21.15.146:0/1754029382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3264125e40 con 0x7f32640a0a70 2023-10-03T10:13:07.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.856+0000 7f32617fa700 1 -- 172.21.15.146:0/1754029382 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f32580036a0 con 0x7f32640a0a70 2023-10-03T10:13:07.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.857+0000 7f32617fa700 1 -- 172.21.15.146:0/1754029382 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f325803f4f0 con 0x7f32640a0a70 2023-10-03T10:13:07.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.857+0000 7f326ab52700 1 -- 172.21.15.146:0/1754029382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f326411f760 con 0x7f32640a0a70 2023-10-03T10:13:07.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:07.861+0000 7f32617fa700 1 -- 172.21.15.146:0/1754029382 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3258003950 con 0x7f32640a0a70 2023-10-03T10:13:07.969 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:08.003 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:08.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.020+0000 7f581b0e8700 1 -- 172.21.15.146:0/2180586966 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5814072d60 con 0x7f581409e870 2023-10-03T10:13:08.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.021+0000 7f58117fa700 1 -- 172.21.15.146:0/2180586966 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5808035090 con 0x7f581409e870 2023-10-03T10:13:08.022 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:08.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.024+0000 7f581b0e8700 1 -- 172.21.15.146:0/2180586966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f581409e870 msgr2=0x7f5814122940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.024+0000 7f581b0e8700 1 --2- 172.21.15.146:0/2180586966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f581409e870 0x7f5814122940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5808009fd0 tx=0x7f5808004750 comp rx=0 tx=0).stop 2023-10-03T10:13:08.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.024+0000 7f581b0e8700 1 -- 172.21.15.146:0/2180586966 shutdown_connections 2023-10-03T10:13:08.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.024+0000 7f581b0e8700 1 --2- 172.21.15.146:0/2180586966 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5814134330 0x7f58141233c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.024+0000 7f581b0e8700 1 --2- 172.21.15.146:0/2180586966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f581409e870 0x7f5814122940 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.024+0000 7f581b0e8700 1 --2- 172.21.15.146:0/2180586966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f581409f180 0x7f5814122e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.024+0000 7f581b0e8700 1 -- 172.21.15.146:0/2180586966 >> 172.21.15.146:0/2180586966 conn(0x7f58140a4430 msgr2=0x7f5814070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.024+0000 7f581b0e8700 1 -- 172.21.15.146:0/2180586966 shutdown_connections 2023-10-03T10:13:08.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.024+0000 7f581b0e8700 1 -- 172.21.15.146:0/2180586966 wait complete. 2023-10-03T10:13:08.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:08.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.059+0000 7f326ab52700 1 -- 172.21.15.146:0/1754029382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f326404f2a0 con 0x7f32640a0a70 2023-10-03T10:13:08.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.059+0000 7f32617fa700 1 -- 172.21.15.146:0/1754029382 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f32580222f0 con 0x7f32640a0a70 2023-10-03T10:13:08.060 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:08.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.061+0000 7f326ab52700 1 -- 172.21.15.146:0/1754029382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32640a0a70 msgr2=0x7f32641223b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.061+0000 7f326ab52700 1 --2- 172.21.15.146:0/1754029382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32640a0a70 0x7f32641223b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f325800e980 tx=0x7f325800ec90 comp rx=0 tx=0).stop 2023-10-03T10:13:08.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.061+0000 7f326ab52700 1 -- 172.21.15.146:0/1754029382 shutdown_connections 2023-10-03T10:13:08.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.061+0000 7f326ab52700 1 --2- 172.21.15.146:0/1754029382 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3264133f50 0x7f3264122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.061+0000 7f326ab52700 1 --2- 172.21.15.146:0/1754029382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32640a0a70 0x7f32641223b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.061+0000 7f326ab52700 1 --2- 172.21.15.146:0/1754029382 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32640a1380 0x7f32641228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.061+0000 7f326ab52700 1 -- 172.21.15.146:0/1754029382 >> 172.21.15.146:0/1754029382 conn(0x7f32640a6610 msgr2=0x7f326411c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.061+0000 7f326ab52700 1 -- 172.21.15.146:0/1754029382 shutdown_connections 2023-10-03T10:13:08.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.062+0000 7f326ab52700 1 -- 172.21.15.146:0/1754029382 wait complete. 2023-10-03T10:13:08.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:08.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.110+0000 7f27a6d77700 1 Processor -- start 2023-10-03T10:13:08.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.110+0000 7f27a6d77700 1 -- start start 2023-10-03T10:13:08.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.110+0000 7f27a6d77700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27a009ef80 0x7f27a0138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.110+0000 7f27a6d77700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27a009f370 0x7f27a013b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.110+0000 7f27a6d77700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a009af80 con 0x7f27a009a150 2023-10-03T10:13:08.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.110+0000 7f27a6d77700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a009a520 con 0x7f27a009ef80 2023-10-03T10:13:08.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.111+0000 7f27a6d77700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27a009fe00 con 0x7f27a009f370 2023-10-03T10:13:08.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.111+0000 7f279ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27a009ef80 0x7f27a0138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.111+0000 7f27a4b13700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f27a009a150 0x7f27a009e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55258/0 (socket says 172.21.15.146:55258) 2023-10-03T10:13:08.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.111+0000 7f27a4b13700 1 -- 172.21.15.146:0/1227475066 learned_addr learned my addr 172.21.15.146:0/1227475066 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:08.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.111+0000 7f27a5314700 1 --2- 172.21.15.146:0/1227475066 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27a009f370 0x7f27a013b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.111+0000 7f279f7fe700 1 -- 172.21.15.146:0/1227475066 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229877823 0 0) 0x7f27a009af80 con 0x7f27a009a150 2023-10-03T10:13:08.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.111+0000 7f279ffff700 1 -- 172.21.15.146:0/1227475066 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27a009f370 msgr2=0x7f27a013b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:08.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.111+0000 7f279ffff700 1 --2- 172.21.15.146:0/1227475066 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27a009f370 0x7f27a013b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.111+0000 7f279ffff700 1 -- 172.21.15.146:0/1227475066 >> v1:172.21.15.146:6789/0 conn(0x7f27a009a150 legacy=0x7f27a009e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.111+0000 7f279ffff700 1 -- 172.21.15.146:0/1227475066 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a006bc20 con 0x7f27a009ef80 2023-10-03T10:13:08.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.111+0000 7f27a5314700 1 --2- 172.21.15.146:0/1227475066 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27a009f370 0x7f27a013b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:08.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.111+0000 7f279ffff700 1 --2- 172.21.15.146:0/1227475066 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27a009ef80 0x7f27a0138e60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f278c009870 tx=0x7f278c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d25981249b0e367 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.111+0000 7f279f7fe700 1 -- 172.21.15.146:0/1227475066 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c011830 con 0x7f27a009ef80 2023-10-03T10:13:08.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.111+0000 7f279f7fe700 1 -- 172.21.15.146:0/1227475066 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278c011990 con 0x7f27a009ef80 2023-10-03T10:13:08.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.111+0000 7f279f7fe700 1 -- 172.21.15.146:0/1227475066 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c011d20 con 0x7f27a009ef80 2023-10-03T10:13:08.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.112+0000 7f27a6d77700 1 -- 172.21.15.146:0/1227475066 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27a009ef80 msgr2=0x7f27a0138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.112+0000 7f27a6d77700 1 --2- 172.21.15.146:0/1227475066 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27a009ef80 0x7f27a0138e60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f278c009870 tx=0x7f278c009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:08.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.112+0000 7f27a6d77700 1 -- 172.21.15.146:0/1227475066 shutdown_connections 2023-10-03T10:13:08.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.112+0000 7f27a6d77700 1 --2- 172.21.15.146:0/1227475066 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27a009f370 0x7f27a013b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.112+0000 7f27a6d77700 1 --2- 172.21.15.146:0/1227475066 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27a009ef80 0x7f27a0138e60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.112+0000 7f27a6d77700 1 -- 172.21.15.146:0/1227475066 >> 172.21.15.146:0/1227475066 conn(0x7f27a00a4430 msgr2=0x7f27a00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.112+0000 7f27a6d77700 1 -- 172.21.15.146:0/1227475066 shutdown_connections 2023-10-03T10:13:08.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.112+0000 7f27a6d77700 1 -- 172.21.15.146:0/1227475066 wait complete. 2023-10-03T10:13:08.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.113+0000 7f27a6d77700 1 Processor -- start 2023-10-03T10:13:08.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.113+0000 7f27a6d77700 1 -- start start 2023-10-03T10:13:08.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.113+0000 7f27a6d77700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27a009a150 0x7f27a01396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.113+0000 7f27a6d77700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27a009ef80 0x7f27a0139c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.113+0000 7f27a6d77700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27a009f370 0x7f27a013a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.113+0000 7f27a6d77700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a013aba0 con 0x7f27a009f370 2023-10-03T10:13:08.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.113+0000 7f27a6d77700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a013b290 con 0x7f27a009a150 2023-10-03T10:13:08.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.113+0000 7f27a6d77700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27a011ef10 con 0x7f27a009ef80 2023-10-03T10:13:08.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.114+0000 7f279ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27a009ef80 0x7f27a0139c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.114+0000 7f279ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27a009ef80 0x7f27a0139c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:33122/0 (socket says 172.21.15.146:33122) 2023-10-03T10:13:08.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.114+0000 7f27a5314700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27a009f370 0x7f27a013a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.114+0000 7f279ffff700 1 -- 172.21.15.146:0/472637596 learned_addr learned my addr 172.21.15.146:0/472637596 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:08.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.114+0000 7f27a4b13700 1 --2- 172.21.15.146:0/472637596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27a009a150 0x7f27a01396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.114+0000 7f279ffff700 1 -- 172.21.15.146:0/472637596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27a009a150 msgr2=0x7f27a01396d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.114+0000 7f279ffff700 1 --2- 172.21.15.146:0/472637596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27a009a150 0x7f27a01396d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.114+0000 7f279ffff700 1 -- 172.21.15.146:0/472637596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27a009f370 msgr2=0x7f27a013a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.114+0000 7f279ffff700 1 --2- 172.21.15.146:0/472637596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27a009f370 0x7f27a013a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.114+0000 7f279ffff700 1 -- 172.21.15.146:0/472637596 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2798009a70 con 0x7f27a009ef80 2023-10-03T10:13:08.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.114+0000 7f279ffff700 1 --2- 172.21.15.146:0/472637596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27a009ef80 0x7f27a0139c10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f278c0090b0 tx=0x7f278c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.114+0000 7f279d7fa700 1 -- 172.21.15.146:0/472637596 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c024620 con 0x7f27a009ef80 2023-10-03T10:13:08.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.114+0000 7f279d7fa700 1 -- 172.21.15.146:0/472637596 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278c024780 con 0x7f27a009ef80 2023-10-03T10:13:08.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.114+0000 7f27a6d77700 1 -- 172.21.15.146:0/472637596 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278c0094a0 con 0x7f27a009ef80 2023-10-03T10:13:08.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.114+0000 7f279d7fa700 1 -- 172.21.15.146:0/472637596 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c024b10 con 0x7f27a009ef80 2023-10-03T10:13:08.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.114+0000 7f27a6d77700 1 -- 172.21.15.146:0/472637596 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a011fb10 con 0x7f27a009ef80 2023-10-03T10:13:08.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.115+0000 7f279d7fa700 1 -- 172.21.15.146:0/472637596 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f278c022070 con 0x7f27a009ef80 2023-10-03T10:13:08.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.115+0000 7f279d7fa700 1 -- 172.21.15.146:0/472637596 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f278c040970 con 0x7f27a009ef80 2023-10-03T10:13:08.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.116+0000 7f27a6d77700 1 -- 172.21.15.146:0/472637596 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a009fa30 con 0x7f27a009ef80 2023-10-03T10:13:08.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.120+0000 7f279d7fa700 1 -- 172.21.15.146:0/472637596 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f278c029080 con 0x7f27a009ef80 2023-10-03T10:13:08.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.142+0000 7fb169bb9700 1 Processor -- start 2023-10-03T10:13:08.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.142+0000 7fb169bb9700 1 -- start start 2023-10-03T10:13:08.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.143+0000 7fb169bb9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb1640a1550 0x7fb164138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.143+0000 7fb169bb9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb164139200 0x7fb16413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.143+0000 7fb169bb9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb16409e9d0 con 0x7fb1640a0a70 2023-10-03T10:13:08.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.143+0000 7fb169bb9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb16409dc00 con 0x7fb1640a1550 2023-10-03T10:13:08.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.143+0000 7fb169bb9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb16409dec0 con 0x7fb164139200 2023-10-03T10:13:08.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.143+0000 7fb163fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb164139200 0x7fb16413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.143+0000 7fb162ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb1640a1550 0x7fb164138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.143+0000 7fb1637fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb1640a0a70 0x7fb1640a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55266/0 (socket says 172.21.15.146:55266) 2023-10-03T10:13:08.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.143+0000 7fb1637fe700 1 -- 172.21.15.146:0/4155837053 learned_addr learned my addr 172.21.15.146:0/4155837053 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:08.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.143+0000 7fb162ffd700 1 -- 172.21.15.146:0/4155837053 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb164139200 msgr2=0x7fb16413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:08.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.143+0000 7fb162ffd700 1 --2- 172.21.15.146:0/4155837053 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb164139200 0x7fb16413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.143+0000 7fb162ffd700 1 -- 172.21.15.146:0/4155837053 >> v1:172.21.15.146:6789/0 conn(0x7fb1640a0a70 legacy=0x7fb1640a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.143+0000 7fb162ffd700 1 -- 172.21.15.146:0/4155837053 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16409e6a0 con 0x7fb1640a1550 2023-10-03T10:13:08.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.143+0000 7fb1627fc700 1 -- 172.21.15.146:0/4155837053 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901568309 0 0) 0x7fb16409e9d0 con 0x7fb1640a0a70 2023-10-03T10:13:08.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.143+0000 7fb163fff700 1 --2- 172.21.15.146:0/4155837053 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb164139200 0x7fb16413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:08.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.144+0000 7fb162ffd700 1 --2- 172.21.15.146:0/4155837053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1640a1550 0x7fb164138cc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb14c009840 tx=0x7fb14c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eaa4efae3a7a370 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.144+0000 7fb1627fc700 1 -- 172.21.15.146:0/4155837053 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c011830 con 0x7fb1640a1550 2023-10-03T10:13:08.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.144+0000 7fb1627fc700 1 -- 172.21.15.146:0/4155837053 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14c011990 con 0x7fb1640a1550 2023-10-03T10:13:08.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.144+0000 7fb1627fc700 1 -- 172.21.15.146:0/4155837053 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c011d20 con 0x7fb1640a1550 2023-10-03T10:13:08.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.144+0000 7fb169bb9700 1 -- 172.21.15.146:0/4155837053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1640a1550 msgr2=0x7fb164138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.144+0000 7fb169bb9700 1 --2- 172.21.15.146:0/4155837053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1640a1550 0x7fb164138cc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb14c009840 tx=0x7fb14c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:08.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.144+0000 7fb169bb9700 1 -- 172.21.15.146:0/4155837053 shutdown_connections 2023-10-03T10:13:08.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.144+0000 7fb169bb9700 1 --2- 172.21.15.146:0/4155837053 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb164139200 0x7fb16413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.144+0000 7fb169bb9700 1 --2- 172.21.15.146:0/4155837053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1640a1550 0x7fb164138cc0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.144+0000 7fb169bb9700 1 -- 172.21.15.146:0/4155837053 >> 172.21.15.146:0/4155837053 conn(0x7fb1640a6610 msgr2=0x7fb1640a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.144+0000 7fb169bb9700 1 -- 172.21.15.146:0/4155837053 shutdown_connections 2023-10-03T10:13:08.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.144+0000 7fb169bb9700 1 -- 172.21.15.146:0/4155837053 wait complete. 2023-10-03T10:13:08.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.145+0000 7fb169bb9700 1 Processor -- start 2023-10-03T10:13:08.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.145+0000 7fb169bb9700 1 -- start start 2023-10-03T10:13:08.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.146+0000 7fb169bb9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1640a0a70 0x7fb16411e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.146+0000 7fb169bb9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1640a1550 0x7fb16411ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.146+0000 7fb169bb9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb164139200 0x7fb16411f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.146+0000 7fb169bb9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1641219d0 con 0x7fb1640a1550 2023-10-03T10:13:08.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.146+0000 7fb169bb9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640a5100 con 0x7fb164139200 2023-10-03T10:13:08.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.146+0000 7fb169bb9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640a03e0 con 0x7fb1640a0a70 2023-10-03T10:13:08.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.146+0000 7fb1637fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1640a0a70 0x7fb16411e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.146+0000 7fb163fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb164139200 0x7fb16411f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.146+0000 7fb1637fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1640a0a70 0x7fb16411e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:33138/0 (socket says 172.21.15.146:33138) 2023-10-03T10:13:08.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.146+0000 7fb163fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb164139200 0x7fb16411f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:47346/0 (socket says 172.21.15.146:47346) 2023-10-03T10:13:08.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.146+0000 7fb1637fe700 1 -- 172.21.15.146:0/4016722400 learned_addr learned my addr 172.21.15.146:0/4016722400 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:08.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.146+0000 7fb162ffd700 1 --2- 172.21.15.146:0/4016722400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1640a1550 0x7fb16411ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.146+0000 7fb1637fe700 1 -- 172.21.15.146:0/4016722400 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb164139200 msgr2=0x7fb16411f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.146+0000 7fb1637fe700 1 --2- 172.21.15.146:0/4016722400 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb164139200 0x7fb16411f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.146+0000 7fb1637fe700 1 -- 172.21.15.146:0/4016722400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1640a1550 msgr2=0x7fb16411ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.146+0000 7fb1637fe700 1 --2- 172.21.15.146:0/4016722400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1640a1550 0x7fb16411ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.146+0000 7fb1637fe700 1 -- 172.21.15.146:0/4016722400 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb154009a70 con 0x7fb1640a0a70 2023-10-03T10:13:08.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.146+0000 7fb163fff700 1 --2- 172.21.15.146:0/4016722400 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb164139200 0x7fb16411f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:08.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.146+0000 7fb1637fe700 1 --2- 172.21.15.146:0/4016722400 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1640a0a70 0x7fb16411e770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00c520 tx=0x7fb15c00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.147+0000 7fb15bfff700 1 -- 172.21.15.146:0/4016722400 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c004c80 con 0x7fb1640a0a70 2023-10-03T10:13:08.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.147+0000 7fb15bfff700 1 -- 172.21.15.146:0/4016722400 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15c004e00 con 0x7fb1640a0a70 2023-10-03T10:13:08.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.147+0000 7fb15bfff700 1 -- 172.21.15.146:0/4016722400 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c007310 con 0x7fb1640a0a70 2023-10-03T10:13:08.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.147+0000 7fb169bb9700 1 -- 172.21.15.146:0/4016722400 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb14c0094a0 con 0x7fb1640a0a70 2023-10-03T10:13:08.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.147+0000 7fb169bb9700 1 -- 172.21.15.146:0/4016722400 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb164120ae0 con 0x7fb1640a0a70 2023-10-03T10:13:08.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.147+0000 7fb15bfff700 1 -- 172.21.15.146:0/4016722400 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb15c007470 con 0x7fb1640a0a70 2023-10-03T10:13:08.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.148+0000 7fb169bb9700 1 -- 172.21.15.146:0/4016722400 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb16404f2a0 con 0x7fb1640a0a70 2023-10-03T10:13:08.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.148+0000 7fb15bfff700 1 -- 172.21.15.146:0/4016722400 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb15c03f290 con 0x7fb1640a0a70 2023-10-03T10:13:08.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.152+0000 7fb15bfff700 1 -- 172.21.15.146:0/4016722400 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb15c0133c0 con 0x7fb1640a0a70 2023-10-03T10:13:08.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.311+0000 7f27a6d77700 1 -- 172.21.15.146:0/472637596 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f27a00a0440 con 0x7f27a009ef80 2023-10-03T10:13:08.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.312+0000 7f279d7fa700 1 -- 172.21.15.146:0/472637596 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f278c015020 con 0x7f27a009ef80 2023-10-03T10:13:08.312 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:08.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.314+0000 7f27a6d77700 1 -- 172.21.15.146:0/472637596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27a009ef80 msgr2=0x7f27a0139c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.314+0000 7f27a6d77700 1 --2- 172.21.15.146:0/472637596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27a009ef80 0x7f27a0139c10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f278c0090b0 tx=0x7f278c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.314+0000 7f27a6d77700 1 -- 172.21.15.146:0/472637596 shutdown_connections 2023-10-03T10:13:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.314+0000 7f27a6d77700 1 --2- 172.21.15.146:0/472637596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27a009f370 0x7f27a013a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.314+0000 7f27a6d77700 1 --2- 172.21.15.146:0/472637596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27a009a150 0x7f27a01396d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.314+0000 7f27a6d77700 1 --2- 172.21.15.146:0/472637596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27a009ef80 0x7f27a0139c10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.314+0000 7f27a6d77700 1 -- 172.21.15.146:0/472637596 >> 172.21.15.146:0/472637596 conn(0x7f27a00a4430 msgr2=0x7f27a009d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.314+0000 7f27a6d77700 1 -- 172.21.15.146:0/472637596 shutdown_connections 2023-10-03T10:13:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.314+0000 7f27a6d77700 1 -- 172.21.15.146:0/472637596 wait complete. 2023-10-03T10:13:08.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.341+0000 7fb169bb9700 1 -- 172.21.15.146:0/4016722400 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb164072980 con 0x7fb1640a0a70 2023-10-03T10:13:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.342+0000 7fb15bfff700 1 -- 172.21.15.146:0/4016722400 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb15c00ce60 con 0x7fb1640a0a70 2023-10-03T10:13:08.343 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.344+0000 7fb169bb9700 1 -- 172.21.15.146:0/4016722400 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1640a0a70 msgr2=0x7fb16411e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.344+0000 7fb169bb9700 1 --2- 172.21.15.146:0/4016722400 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1640a0a70 0x7fb16411e770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00c520 tx=0x7fb15c00c830 comp rx=0 tx=0).stop 2023-10-03T10:13:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.344+0000 7fb169bb9700 1 -- 172.21.15.146:0/4016722400 shutdown_connections 2023-10-03T10:13:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.344+0000 7fb169bb9700 1 --2- 172.21.15.146:0/4016722400 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb164139200 0x7fb16411f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.344+0000 7fb169bb9700 1 --2- 172.21.15.146:0/4016722400 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1640a0a70 0x7fb16411e770 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.344+0000 7fb169bb9700 1 --2- 172.21.15.146:0/4016722400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1640a1550 0x7fb16411ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.344+0000 7fb169bb9700 1 -- 172.21.15.146:0/4016722400 >> 172.21.15.146:0/4016722400 conn(0x7fb1640a6610 msgr2=0x7fb1640a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.344+0000 7fb169bb9700 1 -- 172.21.15.146:0/4016722400 shutdown_connections 2023-10-03T10:13:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:08.344+0000 7fb169bb9700 1 -- 172.21.15.146:0/4016722400 wait complete. 2023-10-03T10:13:08.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:09.044 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:09.081 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:09.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.178+0000 7f78596a3700 1 Processor -- start 2023-10-03T10:13:09.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.178+0000 7f78596a3700 1 -- start start 2023-10-03T10:13:09.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.179+0000 7f78596a3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f785409e870 0x7f785409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.179+0000 7f78596a3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f785409f180 0x7f7854131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.179+0000 7f78596a3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7854131d70 0x7f7854132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.179+0000 7f78596a3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78540a0920 con 0x7f785409f180 2023-10-03T10:13:09.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.179+0000 7f78596a3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785409c970 con 0x7f7854131d70 2023-10-03T10:13:09.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.179+0000 7f78596a3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f785409bab0 con 0x7f785409e870 2023-10-03T10:13:09.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.179+0000 7f78527fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f785409f180 0x7f7854131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.179+0000 7f78537fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7854131d70 0x7f7854132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.179+0000 7f78527fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f785409f180 0x7f7854131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41840/0 (socket says 172.21.15.146:41840) 2023-10-03T10:13:09.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.179+0000 7f78527fc700 1 -- 172.21.15.146:0/2423180326 learned_addr learned my addr 172.21.15.146:0/2423180326 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:09.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.179+0000 7f7852ffd700 1 --2- 172.21.15.146:0/2423180326 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f785409e870 0x7f785409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.179+0000 7f78527fc700 1 -- 172.21.15.146:0/2423180326 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f785409e870 msgr2=0x7f785409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:09.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.179+0000 7f78527fc700 1 --2- 172.21.15.146:0/2423180326 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f785409e870 0x7f785409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.179+0000 7f78527fc700 1 -- 172.21.15.146:0/2423180326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7854131d70 msgr2=0x7f7854132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:09.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.179+0000 7f78527fc700 1 --2- 172.21.15.146:0/2423180326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7854131d70 0x7f7854132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.179+0000 7f78527fc700 1 -- 172.21.15.146:0/2423180326 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785409f9c0 con 0x7f785409f180 2023-10-03T10:13:09.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.179+0000 7f78537fe700 1 --2- 172.21.15.146:0/2423180326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7854131d70 0x7f7854132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:09.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.180+0000 7f78527fc700 1 --2- 172.21.15.146:0/2423180326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f785409f180 0x7f7854131830 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7848009920 tx=0x7f7848009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efcf07bc42d48df server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:09.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.180+0000 7f7851ffb700 1 -- 172.21.15.146:0/2423180326 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7848011830 con 0x7f785409f180 2023-10-03T10:13:09.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.180+0000 7f7851ffb700 1 -- 172.21.15.146:0/2423180326 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7848011990 con 0x7f785409f180 2023-10-03T10:13:09.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.180+0000 7f7851ffb700 1 -- 172.21.15.146:0/2423180326 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7848011d20 con 0x7f785409f180 2023-10-03T10:13:09.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.180+0000 7f78596a3700 1 -- 172.21.15.146:0/2423180326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f785409f180 msgr2=0x7f7854131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.180+0000 7f78596a3700 1 --2- 172.21.15.146:0/2423180326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f785409f180 0x7f7854131830 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7848009920 tx=0x7f7848009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:09.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.180+0000 7f78596a3700 1 -- 172.21.15.146:0/2423180326 shutdown_connections 2023-10-03T10:13:09.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.180+0000 7f78596a3700 1 --2- 172.21.15.146:0/2423180326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7854131d70 0x7f7854132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.180+0000 7f78596a3700 1 --2- 172.21.15.146:0/2423180326 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f785409e870 0x7f785409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.180+0000 7f78596a3700 1 --2- 172.21.15.146:0/2423180326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f785409f180 0x7f7854131830 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.180+0000 7f78596a3700 1 -- 172.21.15.146:0/2423180326 >> 172.21.15.146:0/2423180326 conn(0x7f78540a4430 msgr2=0x7f78540a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:09.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.180+0000 7f78596a3700 1 -- 172.21.15.146:0/2423180326 shutdown_connections 2023-10-03T10:13:09.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.180+0000 7f78596a3700 1 -- 172.21.15.146:0/2423180326 wait complete. 2023-10-03T10:13:09.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.182+0000 7f78596a3700 1 Processor -- start 2023-10-03T10:13:09.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.182+0000 7f78596a3700 1 -- start start 2023-10-03T10:13:09.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.182+0000 7f78596a3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f785409e870 0x7f785411bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.182+0000 7f78596a3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f785409f180 0x7f785411c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.182+0000 7f78596a3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7854131d70 0x7f785411ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.182+0000 7f78596a3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785412f6d0 con 0x7f7854131d70 2023-10-03T10:13:09.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.182+0000 7f78596a3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785411f780 con 0x7f785409e870 2023-10-03T10:13:09.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.182+0000 7f78596a3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78540a2ca0 con 0x7f785409f180 2023-10-03T10:13:09.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.182+0000 7f78537fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7854131d70 0x7f785411ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.182+0000 7f78537fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7854131d70 0x7f785411ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41854/0 (socket says 172.21.15.146:41854) 2023-10-03T10:13:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.182+0000 7f78537fe700 1 -- 172.21.15.146:0/1448817877 learned_addr learned my addr 172.21.15.146:0/1448817877 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.182+0000 7f78527fc700 1 --2- 172.21.15.146:0/1448817877 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f785409f180 0x7f785411c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.182+0000 7f7852ffd700 1 --2- 172.21.15.146:0/1448817877 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f785409e870 0x7f785411bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.182+0000 7f78537fe700 1 -- 172.21.15.146:0/1448817877 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f785409f180 msgr2=0x7f785411c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.182+0000 7f78537fe700 1 --2- 172.21.15.146:0/1448817877 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f785409f180 0x7f785411c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.182+0000 7f78537fe700 1 -- 172.21.15.146:0/1448817877 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f785409e870 msgr2=0x7f785411bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.182+0000 7f78537fe700 1 --2- 172.21.15.146:0/1448817877 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f785409e870 0x7f785411bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.182+0000 7f78537fe700 1 -- 172.21.15.146:0/1448817877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784c00f050 con 0x7f7854131d70 2023-10-03T10:13:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.182+0000 7f7852ffd700 1 --2- 172.21.15.146:0/1448817877 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f785409e870 0x7f785411bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.183+0000 7f78537fe700 1 --2- 172.21.15.146:0/1448817877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7854131d70 0x7f785411ca40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f784c00f530 tx=0x7f784c00f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.183+0000 7f783b7fe700 1 -- 172.21.15.146:0/1448817877 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c012050 con 0x7f7854131d70 2023-10-03T10:13:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.183+0000 7f783b7fe700 1 -- 172.21.15.146:0/1448817877 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c013040 con 0x7f7854131d70 2023-10-03T10:13:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.183+0000 7f78596a3700 1 -- 172.21.15.146:0/1448817877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7848009550 con 0x7f7854131d70 2023-10-03T10:13:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.183+0000 7f783b7fe700 1 -- 172.21.15.146:0/1448817877 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c003e60 con 0x7f7854131d70 2023-10-03T10:13:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.183+0000 7f78596a3700 1 -- 172.21.15.146:0/1448817877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78540a0210 con 0x7f7854131d70 2023-10-03T10:13:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.184+0000 7f783b7fe700 1 -- 172.21.15.146:0/1448817877 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f784c004030 con 0x7f7854131d70 2023-10-03T10:13:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.184+0000 7f783b7fe700 1 -- 172.21.15.146:0/1448817877 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f784c044080 con 0x7f7854131d70 2023-10-03T10:13:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.184+0000 7f78596a3700 1 -- 172.21.15.146:0/1448817877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f785404f2a0 con 0x7f7854131d70 2023-10-03T10:13:09.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.188+0000 7f783b7fe700 1 -- 172.21.15.146:0/1448817877 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f784c021950 con 0x7f7854131d70 2023-10-03T10:13:09.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.215+0000 7f8293dde700 1 Processor -- start 2023-10-03T10:13:09.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.215+0000 7f8293dde700 1 -- start start 2023-10-03T10:13:09.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.215+0000 7f8293dde700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f828c0a0a70 0x7f828c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.215+0000 7f8293dde700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f828c0a1380 0x7f828c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.215+0000 7f8293dde700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f828c133f50 0x7f828c1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.215+0000 7f8293dde700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828c09e9d0 con 0x7f828c133f50 2023-10-03T10:13:09.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.215+0000 7f8293dde700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c09dc00 con 0x7f828c0a0a70 2023-10-03T10:13:09.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.215+0000 7f8293dde700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f828c09dec0 con 0x7f828c0a1380 2023-10-03T10:13:09.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.215+0000 7f8291b7a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f828c0a0a70 0x7f828c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.216+0000 7f8291b7a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f828c0a0a70 0x7f828c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:47368/0 (socket says 172.21.15.146:47368) 2023-10-03T10:13:09.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.216+0000 7f8291b7a700 1 -- 172.21.15.146:0/3440084710 learned_addr learned my addr 172.21.15.146:0/3440084710 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:09.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.216+0000 7f8291379700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f828c0a1380 0x7f828c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.216+0000 7f829237b700 1 --2- 172.21.15.146:0/3440084710 >> v2:172.21.15.146:3300/0 conn(0x7f828c133f50 0x7f828c1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.216+0000 7f8291b7a700 1 -- 172.21.15.146:0/3440084710 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f828c0a1380 msgr2=0x7f828c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:09.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.216+0000 7f8291b7a700 1 --2- 172.21.15.146:0/3440084710 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f828c0a1380 0x7f828c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.216+0000 7f8291b7a700 1 -- 172.21.15.146:0/3440084710 >> v2:172.21.15.146:3300/0 conn(0x7f828c133f50 msgr2=0x7f828c1343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:09.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.216+0000 7f8291b7a700 1 --2- 172.21.15.146:0/3440084710 >> v2:172.21.15.146:3300/0 conn(0x7f828c133f50 0x7f828c1343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.216+0000 7f8291b7a700 1 -- 172.21.15.146:0/3440084710 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c09e6a0 con 0x7f828c0a0a70 2023-10-03T10:13:09.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.216+0000 7f829237b700 1 --2- 172.21.15.146:0/3440084710 >> v2:172.21.15.146:3300/0 conn(0x7f828c133f50 0x7f828c1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:09.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.216+0000 7f8291379700 1 --2- 172.21.15.146:0/3440084710 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f828c0a1380 0x7f828c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:09.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.216+0000 7f8291b7a700 1 --2- 172.21.15.146:0/3440084710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f828c0a0a70 0x7f828c0a0e40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f82880098f0 tx=0x7f8288009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e34d8e16642c861 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:09.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.216+0000 7f8290b78700 1 -- 172.21.15.146:0/3440084710 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8288011830 con 0x7f828c0a0a70 2023-10-03T10:13:09.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.216+0000 7f8290b78700 1 -- 172.21.15.146:0/3440084710 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8288011990 con 0x7f828c0a0a70 2023-10-03T10:13:09.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.216+0000 7f8290b78700 1 -- 172.21.15.146:0/3440084710 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8288011d20 con 0x7f828c0a0a70 2023-10-03T10:13:09.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.217+0000 7f8293dde700 1 -- 172.21.15.146:0/3440084710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f828c0a0a70 msgr2=0x7f828c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.217+0000 7f8293dde700 1 --2- 172.21.15.146:0/3440084710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f828c0a0a70 0x7f828c0a0e40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f82880098f0 tx=0x7f8288009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:09.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.217+0000 7f8293dde700 1 -- 172.21.15.146:0/3440084710 shutdown_connections 2023-10-03T10:13:09.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.217+0000 7f8293dde700 1 --2- 172.21.15.146:0/3440084710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f828c0a0a70 0x7f828c0a0e40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.217+0000 7f8293dde700 1 --2- 172.21.15.146:0/3440084710 >> v2:172.21.15.146:3300/0 conn(0x7f828c133f50 0x7f828c1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.217+0000 7f8293dde700 1 --2- 172.21.15.146:0/3440084710 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f828c0a1380 0x7f828c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.217+0000 7f8293dde700 1 -- 172.21.15.146:0/3440084710 >> 172.21.15.146:0/3440084710 conn(0x7f828c0a6610 msgr2=0x7f828c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:09.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.217+0000 7f8293dde700 1 -- 172.21.15.146:0/3440084710 shutdown_connections 2023-10-03T10:13:09.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.217+0000 7f8293dde700 1 -- 172.21.15.146:0/3440084710 wait complete. 2023-10-03T10:13:09.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.218+0000 7f8293dde700 1 Processor -- start 2023-10-03T10:13:09.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.218+0000 7f8293dde700 1 -- start start 2023-10-03T10:13:09.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.218+0000 7f8293dde700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f828c0a0a70 0x7f828c11f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.218+0000 7f8293dde700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f828c0a1380 0x7f828c11f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.218+0000 7f8293dde700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f828c133f50 0x7f828c11ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.218+0000 7f8293dde700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c121170 con 0x7f828c133f50 2023-10-03T10:13:09.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.218+0000 7f8293dde700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c120f80 con 0x7f828c0a1380 2023-10-03T10:13:09.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.218+0000 7f8293dde700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f828c1215a0 con 0x7f828c0a0a70 2023-10-03T10:13:09.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.218+0000 7f8291b7a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f828c0a0a70 0x7f828c11f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.218+0000 7f8291379700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f828c0a1380 0x7f828c11f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.218+0000 7f8291b7a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f828c0a0a70 0x7f828c11f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:33172/0 (socket says 172.21.15.146:33172) 2023-10-03T10:13:09.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.218+0000 7f8291b7a700 1 -- 172.21.15.146:0/3029973758 learned_addr learned my addr 172.21.15.146:0/3029973758 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:09.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.218+0000 7f829237b700 1 --2- 172.21.15.146:0/3029973758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f828c133f50 0x7f828c11ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.218+0000 7f8291379700 1 -- 172.21.15.146:0/3029973758 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f828c0a0a70 msgr2=0x7f828c11f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.219+0000 7f8291379700 1 --2- 172.21.15.146:0/3029973758 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f828c0a0a70 0x7f828c11f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.219+0000 7f8291379700 1 -- 172.21.15.146:0/3029973758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f828c133f50 msgr2=0x7f828c11ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.219+0000 7f8291379700 1 --2- 172.21.15.146:0/3029973758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f828c133f50 0x7f828c11ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.219+0000 7f8291379700 1 -- 172.21.15.146:0/3029973758 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827c0094a0 con 0x7f828c0a1380 2023-10-03T10:13:09.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.219+0000 7f8291b7a700 1 --2- 172.21.15.146:0/3029973758 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f828c0a0a70 0x7f828c11f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:09.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.219+0000 7f8291379700 1 --2- 172.21.15.146:0/3029973758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f828c0a1380 0x7f828c11f9f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f827c00e980 tx=0x7f827c00ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:09.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.219+0000 7f82827fc700 1 -- 172.21.15.146:0/3029973758 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c004030 con 0x7f828c0a1380 2023-10-03T10:13:09.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.219+0000 7f82827fc700 1 -- 172.21.15.146:0/3029973758 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c004190 con 0x7f828c0a1380 2023-10-03T10:13:09.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.219+0000 7f8293dde700 1 -- 172.21.15.146:0/3029973758 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8284009a70 con 0x7f828c0a1380 2023-10-03T10:13:09.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.219+0000 7f82827fc700 1 -- 172.21.15.146:0/3029973758 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c004520 con 0x7f828c0a1380 2023-10-03T10:13:09.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.219+0000 7f8293dde700 1 -- 172.21.15.146:0/3029973758 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8288009550 con 0x7f828c0a1380 2023-10-03T10:13:09.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.220+0000 7f82827fc700 1 -- 172.21.15.146:0/3029973758 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f827c0036a0 con 0x7f828c0a1380 2023-10-03T10:13:09.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.220+0000 7f82827fc700 1 -- 172.21.15.146:0/3029973758 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f827c03f7d0 con 0x7f828c0a1380 2023-10-03T10:13:09.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.220+0000 7f8293dde700 1 -- 172.21.15.146:0/3029973758 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828c0a03e0 con 0x7f828c0a1380 2023-10-03T10:13:09.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.224+0000 7f82827fc700 1 -- 172.21.15.146:0/3029973758 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f827c01bbe0 con 0x7f828c0a1380 2023-10-03T10:13:09.328 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:09.357 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:09.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.384+0000 7f78596a3700 1 -- 172.21.15.146:0/1448817877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f785411f390 con 0x7f7854131d70 2023-10-03T10:13:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.384+0000 7f783b7fe700 1 -- 172.21.15.146:0/1448817877 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f784c021360 con 0x7f7854131d70 2023-10-03T10:13:09.385 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.387+0000 7f78596a3700 1 -- 172.21.15.146:0/1448817877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7854131d70 msgr2=0x7f785411ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.387+0000 7f78596a3700 1 --2- 172.21.15.146:0/1448817877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7854131d70 0x7f785411ca40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f784c00f530 tx=0x7f784c00f840 comp rx=0 tx=0).stop 2023-10-03T10:13:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.387+0000 7f78596a3700 1 -- 172.21.15.146:0/1448817877 shutdown_connections 2023-10-03T10:13:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.387+0000 7f78596a3700 1 --2- 172.21.15.146:0/1448817877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7854131d70 0x7f785411ca40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.387+0000 7f78596a3700 1 --2- 172.21.15.146:0/1448817877 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f785409e870 0x7f785411bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.387+0000 7f78596a3700 1 --2- 172.21.15.146:0/1448817877 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f785409f180 0x7f785411c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.388+0000 7f78596a3700 1 -- 172.21.15.146:0/1448817877 >> 172.21.15.146:0/1448817877 conn(0x7f78540a4430 msgr2=0x7f7854130f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.388+0000 7f78596a3700 1 -- 172.21.15.146:0/1448817877 shutdown_connections 2023-10-03T10:13:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.388+0000 7f78596a3700 1 -- 172.21.15.146:0/1448817877 wait complete. 2023-10-03T10:13:09.404 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:09.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.420+0000 7f8293dde700 1 -- 172.21.15.146:0/3029973758 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f828c122bb0 con 0x7f828c0a1380 2023-10-03T10:13:09.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.420+0000 7f82827fc700 1 -- 172.21.15.146:0/3029973758 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f827c029070 con 0x7f828c0a1380 2023-10-03T10:13:09.421 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:09.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.422+0000 7f8293dde700 1 -- 172.21.15.146:0/3029973758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f828c0a1380 msgr2=0x7f828c11f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.422+0000 7f8293dde700 1 --2- 172.21.15.146:0/3029973758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f828c0a1380 0x7f828c11f9f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f827c00e980 tx=0x7f827c00ec90 comp rx=0 tx=0).stop 2023-10-03T10:13:09.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.422+0000 7f8293dde700 1 -- 172.21.15.146:0/3029973758 shutdown_connections 2023-10-03T10:13:09.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.422+0000 7f8293dde700 1 --2- 172.21.15.146:0/3029973758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f828c133f50 0x7f828c11ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.422+0000 7f8293dde700 1 --2- 172.21.15.146:0/3029973758 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f828c0a0a70 0x7f828c11f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.422+0000 7f8293dde700 1 --2- 172.21.15.146:0/3029973758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f828c0a1380 0x7f828c11f9f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.422+0000 7f8293dde700 1 -- 172.21.15.146:0/3029973758 >> 172.21.15.146:0/3029973758 conn(0x7f828c0a6610 msgr2=0x7f828c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:09.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.422+0000 7f8293dde700 1 -- 172.21.15.146:0/3029973758 shutdown_connections 2023-10-03T10:13:09.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.422+0000 7f8293dde700 1 -- 172.21.15.146:0/3029973758 wait complete. 2023-10-03T10:13:09.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:09.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.458+0000 7f670f9e7700 1 Processor -- start 2023-10-03T10:13:09.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.458+0000 7f670f9e7700 1 -- start start 2023-10-03T10:13:09.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.458+0000 7f670f9e7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f67080a0a70 0x7f67080a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.458+0000 7f670f9e7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f67080a1380 0x7f6708133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.458+0000 7f670f9e7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6708133f50 0x7f6708134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.459+0000 7f670f9e7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f670809e9d0 con 0x7f67080a1380 2023-10-03T10:13:09.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.459+0000 7f670f9e7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670809dc00 con 0x7f6708133f50 2023-10-03T10:13:09.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.459+0000 7f670f9e7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f670809dec0 con 0x7f67080a0a70 2023-10-03T10:13:09.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.459+0000 7f670cf82700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f67080a1380 0x7f6708133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.459+0000 7f670d783700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f67080a0a70 0x7f67080a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.459+0000 7f670cf82700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f67080a1380 0x7f6708133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41876/0 (socket says 172.21.15.146:41876) 2023-10-03T10:13:09.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.459+0000 7f670cf82700 1 -- 172.21.15.146:0/790469580 learned_addr learned my addr 172.21.15.146:0/790469580 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:09.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.459+0000 7f670df84700 1 --2- 172.21.15.146:0/790469580 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6708133f50 0x7f6708134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.459+0000 7f670df84700 1 -- 172.21.15.146:0/790469580 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f67080a0a70 msgr2=0x7f67080a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:09.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.459+0000 7f670df84700 1 --2- 172.21.15.146:0/790469580 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f67080a0a70 0x7f67080a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.459+0000 7f670df84700 1 -- 172.21.15.146:0/790469580 >> v2:172.21.15.146:3300/0 conn(0x7f67080a1380 msgr2=0x7f6708133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:09.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.459+0000 7f670df84700 1 --2- 172.21.15.146:0/790469580 >> v2:172.21.15.146:3300/0 conn(0x7f67080a1380 0x7f6708133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.459+0000 7f670df84700 1 -- 172.21.15.146:0/790469580 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670809e6a0 con 0x7f6708133f50 2023-10-03T10:13:09.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.459+0000 7f670cf82700 1 --2- 172.21.15.146:0/790469580 >> v2:172.21.15.146:3300/0 conn(0x7f67080a1380 0x7f6708133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:09.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.459+0000 7f670d783700 1 --2- 172.21.15.146:0/790469580 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f67080a0a70 0x7f67080a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:09.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.459+0000 7f670df84700 1 --2- 172.21.15.146:0/790469580 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6708133f50 0x7f6708134380 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6700009d90 tx=0x7f670000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d522a32855869d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:09.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.459+0000 7f66fffff700 1 -- 172.21.15.146:0/790469580 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670000e070 con 0x7f6708133f50 2023-10-03T10:13:09.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.459+0000 7f66fffff700 1 -- 172.21.15.146:0/790469580 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670000bb20 con 0x7f6708133f50 2023-10-03T10:13:09.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.459+0000 7f66fffff700 1 -- 172.21.15.146:0/790469580 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700012430 con 0x7f6708133f50 2023-10-03T10:13:09.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.460+0000 7f670f9e7700 1 -- 172.21.15.146:0/790469580 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6708133f50 msgr2=0x7f6708134380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.460+0000 7f670f9e7700 1 --2- 172.21.15.146:0/790469580 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6708133f50 0x7f6708134380 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6700009d90 tx=0x7f670000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:09.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.460+0000 7f670f9e7700 1 -- 172.21.15.146:0/790469580 shutdown_connections 2023-10-03T10:13:09.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.460+0000 7f670f9e7700 1 --2- 172.21.15.146:0/790469580 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6708133f50 0x7f6708134380 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.460+0000 7f670f9e7700 1 --2- 172.21.15.146:0/790469580 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f67080a0a70 0x7f67080a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.460+0000 7f670f9e7700 1 --2- 172.21.15.146:0/790469580 >> v2:172.21.15.146:3300/0 conn(0x7f67080a1380 0x7f6708133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.460+0000 7f670f9e7700 1 -- 172.21.15.146:0/790469580 >> 172.21.15.146:0/790469580 conn(0x7f67080a6610 msgr2=0x7f67080a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:09.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.460+0000 7f670f9e7700 1 -- 172.21.15.146:0/790469580 shutdown_connections 2023-10-03T10:13:09.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.460+0000 7f670f9e7700 1 -- 172.21.15.146:0/790469580 wait complete. 2023-10-03T10:13:09.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.461+0000 7f670f9e7700 1 Processor -- start 2023-10-03T10:13:09.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.461+0000 7f670f9e7700 1 -- start start 2023-10-03T10:13:09.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.461+0000 7f670f9e7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f67080a0a70 0x7f67081213f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.461+0000 7f670f9e7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67080a1380 0x7f6708121930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.461+0000 7f670f9e7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6708133f50 0x7f6708121e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.461+0000 7f670f9e7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6708124cd0 con 0x7f67080a1380 2023-10-03T10:13:09.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.461+0000 7f670f9e7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67081327c0 con 0x7f6708133f50 2023-10-03T10:13:09.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.461+0000 7f670f9e7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6708124970 con 0x7f67080a0a70 2023-10-03T10:13:09.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.461+0000 7f670df84700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6708133f50 0x7f6708121e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.461+0000 7f670cf82700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67080a1380 0x7f6708121930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.461+0000 7f670df84700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6708133f50 0x7f6708121e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:47382/0 (socket says 172.21.15.146:47382) 2023-10-03T10:13:09.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.461+0000 7f670cf82700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67080a1380 0x7f6708121930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41884/0 (socket says 172.21.15.146:41884) 2023-10-03T10:13:09.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.461+0000 7f670df84700 1 -- 172.21.15.146:0/2010509349 learned_addr learned my addr 172.21.15.146:0/2010509349 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:09.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.461+0000 7f670d783700 1 --2- 172.21.15.146:0/2010509349 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f67080a0a70 0x7f67081213f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.462+0000 7f670df84700 1 -- 172.21.15.146:0/2010509349 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f67080a0a70 msgr2=0x7f67081213f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.462+0000 7f670df84700 1 --2- 172.21.15.146:0/2010509349 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f67080a0a70 0x7f67081213f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.462+0000 7f670df84700 1 -- 172.21.15.146:0/2010509349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67080a1380 msgr2=0x7f6708121930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.462+0000 7f670df84700 1 --2- 172.21.15.146:0/2010509349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67080a1380 0x7f6708121930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.462+0000 7f670df84700 1 -- 172.21.15.146:0/2010509349 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67040094a0 con 0x7f6708133f50 2023-10-03T10:13:09.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.462+0000 7f670cf82700 1 --2- 172.21.15.146:0/2010509349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67080a1380 0x7f6708121930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:09.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.462+0000 7f670df84700 1 --2- 172.21.15.146:0/2010509349 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6708133f50 0x7f6708121e70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6700014040 tx=0x7f6700004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:09.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.462+0000 7f66fdffb700 1 -- 172.21.15.146:0/2010509349 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700004450 con 0x7f6708133f50 2023-10-03T10:13:09.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.462+0000 7f66fdffb700 1 -- 172.21.15.146:0/2010509349 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6700020070 con 0x7f6708133f50 2023-10-03T10:13:09.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.462+0000 7f66fdffb700 1 -- 172.21.15.146:0/2010509349 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700004810 con 0x7f6708133f50 2023-10-03T10:13:09.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.462+0000 7f670f9e7700 1 -- 172.21.15.146:0/2010509349 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f8009550 con 0x7f6708133f50 2023-10-03T10:13:09.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.462+0000 7f670f9e7700 1 -- 172.21.15.146:0/2010509349 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6700009a70 con 0x7f6708133f50 2023-10-03T10:13:09.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.463+0000 7f66fdffb700 1 -- 172.21.15.146:0/2010509349 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6700012430 con 0x7f6708133f50 2023-10-03T10:13:09.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.463+0000 7f670f9e7700 1 -- 172.21.15.146:0/2010509349 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f670811e040 con 0x7f6708133f50 2023-10-03T10:13:09.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.463+0000 7f66fdffb700 1 -- 172.21.15.146:0/2010509349 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6700022070 con 0x7f6708133f50 2023-10-03T10:13:09.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.468+0000 7f66fdffb700 1 -- 172.21.15.146:0/2010509349 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f670001c400 con 0x7f6708133f50 2023-10-03T10:13:09.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.503+0000 7f76c3fec700 1 Processor -- start 2023-10-03T10:13:09.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.503+0000 7f76c3fec700 1 -- start start 2023-10-03T10:13:09.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.503+0000 7f76c3fec700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f76bc09ad40 0x7f76bc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.503+0000 7f76c3fec700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f76bc1343d0 0x7f76bc0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.503+0000 7f76c3fec700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76bc09b110 con 0x7f76bc133f70 2023-10-03T10:13:09.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.503+0000 7f76c3fec700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76bc0a3b60 con 0x7f76bc09ad40 2023-10-03T10:13:09.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.503+0000 7f76c3fec700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc134850 con 0x7f76bc1343d0 2023-10-03T10:13:09.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.503+0000 7f76c2589700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f76bc1343d0 0x7f76bc0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.503+0000 7f76c1d88700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f76bc09ad40 0x7f76bc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.503+0000 7f76c2589700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f76bc1343d0 0x7f76bc0a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:33200/0 (socket says 172.21.15.146:33200) 2023-10-03T10:13:09.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.503+0000 7f76c1d88700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f76bc09ad40 0x7f76bc133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41888/0 (socket says 172.21.15.146:41888) 2023-10-03T10:13:09.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.504+0000 7f76c2589700 1 -- 172.21.15.146:0/2473189039 learned_addr learned my addr 172.21.15.146:0/2473189039 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:09.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.504+0000 7f76c2589700 1 -- 172.21.15.146:0/2473189039 >> v2:172.21.15.146:3300/0 conn(0x7f76bc09ad40 msgr2=0x7f76bc133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:09.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.504+0000 7f76c2589700 1 --2- 172.21.15.146:0/2473189039 >> v2:172.21.15.146:3300/0 conn(0x7f76bc09ad40 0x7f76bc133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.504+0000 7f76c2589700 1 -- 172.21.15.146:0/2473189039 >> v1:172.21.15.146:6789/0 conn(0x7f76bc133f70 legacy=0x7f76bc0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.504+0000 7f76c2589700 1 -- 172.21.15.146:0/2473189039 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76bc0a2fa0 con 0x7f76bc1343d0 2023-10-03T10:13:09.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.504+0000 7f76c2589700 1 --2- 172.21.15.146:0/2473189039 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f76bc1343d0 0x7f76bc0a1180 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009e50 tx=0x7f76b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2545e5db8b02549 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:09.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.504+0000 7f76c0d86700 1 -- 172.21.15.146:0/2473189039 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b400e070 con 0x7f76bc1343d0 2023-10-03T10:13:09.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.504+0000 7f76c0d86700 1 -- 172.21.15.146:0/2473189039 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b400b910 con 0x7f76bc1343d0 2023-10-03T10:13:09.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.504+0000 7f76c0d86700 1 -- 172.21.15.146:0/2473189039 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b400bcc0 con 0x7f76bc1343d0 2023-10-03T10:13:09.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.505+0000 7f76c3fec700 1 -- 172.21.15.146:0/2473189039 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f76bc1343d0 msgr2=0x7f76bc0a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.505+0000 7f76c3fec700 1 --2- 172.21.15.146:0/2473189039 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f76bc1343d0 0x7f76bc0a1180 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009e50 tx=0x7f76b400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:09.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.505+0000 7f76c3fec700 1 -- 172.21.15.146:0/2473189039 shutdown_connections 2023-10-03T10:13:09.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.505+0000 7f76c3fec700 1 --2- 172.21.15.146:0/2473189039 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f76bc1343d0 0x7f76bc0a1180 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.505+0000 7f76c3fec700 1 --2- 172.21.15.146:0/2473189039 >> v2:172.21.15.146:3300/0 conn(0x7f76bc09ad40 0x7f76bc133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.505+0000 7f76c3fec700 1 -- 172.21.15.146:0/2473189039 >> 172.21.15.146:0/2473189039 conn(0x7f76bc099c40 msgr2=0x7f76bc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:09.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.505+0000 7f76c3fec700 1 -- 172.21.15.146:0/2473189039 shutdown_connections 2023-10-03T10:13:09.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.505+0000 7f76c3fec700 1 -- 172.21.15.146:0/2473189039 wait complete. 2023-10-03T10:13:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.506+0000 7f76c3fec700 1 Processor -- start 2023-10-03T10:13:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.506+0000 7f76c3fec700 1 -- start start 2023-10-03T10:13:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.506+0000 7f76c3fec700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76bc09ad40 0x7f76bc122210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.506+0000 7f76c3fec700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76bc133f70 0x7f76bc122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.506+0000 7f76c3fec700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f76bc1343d0 0x7f76bc122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.506+0000 7f76c3fec700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc125800 con 0x7f76bc09ad40 2023-10-03T10:13:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.506+0000 7f76c3fec700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc123e20 con 0x7f76bc133f70 2023-10-03T10:13:09.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.506+0000 7f76c3fec700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc124cb0 con 0x7f76bc1343d0 2023-10-03T10:13:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.506+0000 7f76c1587700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76bc133f70 0x7f76bc122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.506+0000 7f76c1587700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76bc133f70 0x7f76bc122750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:47386/0 (socket says 172.21.15.146:47386) 2023-10-03T10:13:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.506+0000 7f76c1587700 1 -- 172.21.15.146:0/850411325 learned_addr learned my addr 172.21.15.146:0/850411325 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.506+0000 7f76c1d88700 1 --2- 172.21.15.146:0/850411325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76bc09ad40 0x7f76bc122210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.506+0000 7f76c2589700 1 --2- 172.21.15.146:0/850411325 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f76bc1343d0 0x7f76bc122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.507+0000 7f76c1587700 1 -- 172.21.15.146:0/850411325 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f76bc1343d0 msgr2=0x7f76bc122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.507+0000 7f76c1587700 1 --2- 172.21.15.146:0/850411325 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f76bc1343d0 0x7f76bc122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.507+0000 7f76c1587700 1 -- 172.21.15.146:0/850411325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76bc09ad40 msgr2=0x7f76bc122210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.507+0000 7f76c1587700 1 --2- 172.21.15.146:0/850411325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76bc09ad40 0x7f76bc122210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.507+0000 7f76c1587700 1 -- 172.21.15.146:0/850411325 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b4009b30 con 0x7f76bc133f70 2023-10-03T10:13:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.507+0000 7f76c1d88700 1 --2- 172.21.15.146:0/850411325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76bc09ad40 0x7f76bc122210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.507+0000 7f76c1587700 1 --2- 172.21.15.146:0/850411325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76bc133f70 0x7f76bc122750 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00c4e0 tx=0x7f76ac00c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.507+0000 7f76b27fc700 1 -- 172.21.15.146:0/850411325 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac0052d0 con 0x7f76bc133f70 2023-10-03T10:13:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.507+0000 7f76b27fc700 1 -- 172.21.15.146:0/850411325 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ac005430 con 0x7f76bc133f70 2023-10-03T10:13:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.507+0000 7f76b27fc700 1 -- 172.21.15.146:0/850411325 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac0038c0 con 0x7f76bc133f70 2023-10-03T10:13:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.507+0000 7f76c3fec700 1 -- 172.21.15.146:0/850411325 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76bc125a50 con 0x7f76bc133f70 2023-10-03T10:13:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.507+0000 7f76c3fec700 1 -- 172.21.15.146:0/850411325 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76bc0a4490 con 0x7f76bc133f70 2023-10-03T10:13:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.508+0000 7f76b27fc700 1 -- 172.21.15.146:0/850411325 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f76ac003a20 con 0x7f76bc133f70 2023-10-03T10:13:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.508+0000 7f76b27fc700 1 -- 172.21.15.146:0/850411325 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f76ac03ea50 con 0x7f76bc133f70 2023-10-03T10:13:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.508+0000 7f76c3fec700 1 -- 172.21.15.146:0/850411325 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76bc125070 con 0x7f76bc133f70 2023-10-03T10:13:09.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.513+0000 7f76b27fc700 1 -- 172.21.15.146:0/850411325 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f76ac017080 con 0x7f76bc133f70 2023-10-03T10:13:09.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.662+0000 7f670f9e7700 1 -- 172.21.15.146:0/2010509349 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f67080a03e0 con 0x7f6708133f50 2023-10-03T10:13:09.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.662+0000 7f66fdffb700 1 -- 172.21.15.146:0/2010509349 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6700035090 con 0x7f6708133f50 2023-10-03T10:13:09.663 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:09.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.664+0000 7f670f9e7700 1 -- 172.21.15.146:0/2010509349 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6708133f50 msgr2=0x7f6708121e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.664+0000 7f670f9e7700 1 --2- 172.21.15.146:0/2010509349 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6708133f50 0x7f6708121e70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6700014040 tx=0x7f6700004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.664+0000 7f670f9e7700 1 -- 172.21.15.146:0/2010509349 shutdown_connections 2023-10-03T10:13:09.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.664+0000 7f670f9e7700 1 --2- 172.21.15.146:0/2010509349 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6708133f50 0x7f6708121e70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.664+0000 7f670f9e7700 1 --2- 172.21.15.146:0/2010509349 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f67080a0a70 0x7f67081213f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.664+0000 7f670f9e7700 1 --2- 172.21.15.146:0/2010509349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67080a1380 0x7f6708121930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.664+0000 7f670f9e7700 1 -- 172.21.15.146:0/2010509349 >> 172.21.15.146:0/2010509349 conn(0x7f67080a6610 msgr2=0x7f6708133280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:09.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.664+0000 7f670f9e7700 1 -- 172.21.15.146:0/2010509349 shutdown_connections 2023-10-03T10:13:09.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.664+0000 7f670f9e7700 1 -- 172.21.15.146:0/2010509349 wait complete. 2023-10-03T10:13:09.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.704+0000 7f76c3fec700 1 -- 172.21.15.146:0/850411325 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f76bc11f070 con 0x7f76bc133f70 2023-10-03T10:13:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.705+0000 7f76b27fc700 1 -- 172.21.15.146:0/850411325 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f76ac0192c0 con 0x7f76bc133f70 2023-10-03T10:13:09.705 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:09.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.707+0000 7f76c3fec700 1 -- 172.21.15.146:0/850411325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76bc133f70 msgr2=0x7f76bc122750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.707+0000 7f76c3fec700 1 --2- 172.21.15.146:0/850411325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76bc133f70 0x7f76bc122750 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00c4e0 tx=0x7f76ac00c7f0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.707+0000 7f76c3fec700 1 -- 172.21.15.146:0/850411325 shutdown_connections 2023-10-03T10:13:09.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.707+0000 7f76c3fec700 1 --2- 172.21.15.146:0/850411325 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f76bc1343d0 0x7f76bc122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.707+0000 7f76c3fec700 1 --2- 172.21.15.146:0/850411325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76bc09ad40 0x7f76bc122210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.707+0000 7f76c3fec700 1 --2- 172.21.15.146:0/850411325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76bc133f70 0x7f76bc122750 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.707+0000 7f76c3fec700 1 -- 172.21.15.146:0/850411325 >> 172.21.15.146:0/850411325 conn(0x7f76bc099c40 msgr2=0x7f76bc0a0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:09.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.707+0000 7f76c3fec700 1 -- 172.21.15.146:0/850411325 shutdown_connections 2023-10-03T10:13:09.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:09.707+0000 7f76c3fec700 1 -- 172.21.15.146:0/850411325 wait complete. 2023-10-03T10:13:09.720 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:10.405 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:10.437 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.539+0000 7f0264bf3700 1 Processor -- start 2023-10-03T10:13:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.539+0000 7f0264bf3700 1 -- start start 2023-10-03T10:13:10.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.540+0000 7f0264bf3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f02600a0a70 0x7f02600a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.540+0000 7f0264bf3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02600a1380 0x7f0260133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.540+0000 7f0264bf3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0260133f50 0x7f02601343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.540+0000 7f0264bf3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026009e9d0 con 0x7f02600a0a70 2023-10-03T10:13:10.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.540+0000 7f0264bf3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026009dc00 con 0x7f02600a1380 2023-10-03T10:13:10.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.540+0000 7f0264bf3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f026009dec0 con 0x7f0260133f50 2023-10-03T10:13:10.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.540+0000 7f025dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02600a1380 0x7f0260133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.540+0000 7f025ed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0260133f50 0x7f02601343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.540+0000 7f025e59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f02600a0a70 0x7f02600a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.540+0000 7f025e59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f02600a0a70 0x7f02600a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41910/0 (socket says 172.21.15.146:41910) 2023-10-03T10:13:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.540+0000 7f025ed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0260133f50 0x7f02601343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:33224/0 (socket says 172.21.15.146:33224) 2023-10-03T10:13:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.540+0000 7f025dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02600a1380 0x7f0260133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:47396/0 (socket says 172.21.15.146:47396) 2023-10-03T10:13:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.540+0000 7f025e59c700 1 -- 172.21.15.146:0/2380315059 learned_addr learned my addr 172.21.15.146:0/2380315059 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.540+0000 7f025e59c700 1 -- 172.21.15.146:0/2380315059 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0260133f50 msgr2=0x7f02601343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.540+0000 7f025e59c700 1 --2- 172.21.15.146:0/2380315059 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0260133f50 0x7f02601343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.540+0000 7f025e59c700 1 -- 172.21.15.146:0/2380315059 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02600a1380 msgr2=0x7f0260133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.540+0000 7f025e59c700 1 --2- 172.21.15.146:0/2380315059 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02600a1380 0x7f0260133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.541+0000 7f025e59c700 1 -- 172.21.15.146:0/2380315059 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026009e6a0 con 0x7f02600a0a70 2023-10-03T10:13:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.541+0000 7f025dd9b700 1 --2- 172.21.15.146:0/2380315059 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02600a1380 0x7f0260133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.541+0000 7f025e59c700 1 --2- 172.21.15.146:0/2380315059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02600a0a70 0x7f02600a0e40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f02500098f0 tx=0x7f0250009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d922d31b97b594 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.541+0000 7f025d59a700 1 -- 172.21.15.146:0/2380315059 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250011830 con 0x7f02600a0a70 2023-10-03T10:13:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.541+0000 7f025d59a700 1 -- 172.21.15.146:0/2380315059 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0250011990 con 0x7f02600a0a70 2023-10-03T10:13:10.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.541+0000 7f025d59a700 1 -- 172.21.15.146:0/2380315059 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250011d20 con 0x7f02600a0a70 2023-10-03T10:13:10.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.541+0000 7f0264bf3700 1 -- 172.21.15.146:0/2380315059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02600a0a70 msgr2=0x7f02600a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.541+0000 7f0264bf3700 1 --2- 172.21.15.146:0/2380315059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02600a0a70 0x7f02600a0e40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f02500098f0 tx=0x7f0250009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:10.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.542+0000 7f0264bf3700 1 -- 172.21.15.146:0/2380315059 shutdown_connections 2023-10-03T10:13:10.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.542+0000 7f0264bf3700 1 --2- 172.21.15.146:0/2380315059 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0260133f50 0x7f02601343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.542+0000 7f0264bf3700 1 --2- 172.21.15.146:0/2380315059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02600a0a70 0x7f02600a0e40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.542+0000 7f0264bf3700 1 --2- 172.21.15.146:0/2380315059 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02600a1380 0x7f0260133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.542+0000 7f0264bf3700 1 -- 172.21.15.146:0/2380315059 >> 172.21.15.146:0/2380315059 conn(0x7f02600a6610 msgr2=0x7f02600a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.542+0000 7f0264bf3700 1 -- 172.21.15.146:0/2380315059 shutdown_connections 2023-10-03T10:13:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.542+0000 7f0264bf3700 1 -- 172.21.15.146:0/2380315059 wait complete. 2023-10-03T10:13:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.543+0000 7f0264bf3700 1 Processor -- start 2023-10-03T10:13:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.543+0000 7f0264bf3700 1 -- start start 2023-10-03T10:13:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.543+0000 7f0264bf3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02600a0a70 0x7f026011f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.543+0000 7f0264bf3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02600a1380 0x7f026011fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.543+0000 7f0264bf3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0260133f50 0x7f02601c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.543+0000 7f0264bf3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02601337c0 con 0x7f02600a0a70 2023-10-03T10:13:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.543+0000 7f0264bf3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026011f310 con 0x7f02600a1380 2023-10-03T10:13:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.543+0000 7f0264bf3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0260122950 con 0x7f0260133f50 2023-10-03T10:13:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.543+0000 7f025dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02600a1380 0x7f026011fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.543+0000 7f025e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02600a0a70 0x7f026011f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.543+0000 7f025dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02600a1380 0x7f026011fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:47404/0 (socket says 172.21.15.146:47404) 2023-10-03T10:13:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.543+0000 7f025e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02600a0a70 0x7f026011f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41912/0 (socket says 172.21.15.146:41912) 2023-10-03T10:13:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.543+0000 7f025dd9b700 1 -- 172.21.15.146:0/1079991047 learned_addr learned my addr 172.21.15.146:0/1079991047 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.543+0000 7f025ed9d700 1 --2- 172.21.15.146:0/1079991047 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0260133f50 0x7f02601c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.544+0000 7f025dd9b700 1 -- 172.21.15.146:0/1079991047 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0260133f50 msgr2=0x7f02601c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.544+0000 7f025dd9b700 1 --2- 172.21.15.146:0/1079991047 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0260133f50 0x7f02601c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.544+0000 7f025dd9b700 1 -- 172.21.15.146:0/1079991047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02600a0a70 msgr2=0x7f026011f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.544+0000 7f025dd9b700 1 --2- 172.21.15.146:0/1079991047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02600a0a70 0x7f026011f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.544+0000 7f025dd9b700 1 -- 172.21.15.146:0/1079991047 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02540094a0 con 0x7f02600a1380 2023-10-03T10:13:10.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.544+0000 7f025e59c700 1 --2- 172.21.15.146:0/1079991047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02600a0a70 0x7f026011f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:10.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.544+0000 7f025ed9d700 1 --2- 172.21.15.146:0/1079991047 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0260133f50 0x7f02601c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:10.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.544+0000 7f025dd9b700 1 --2- 172.21.15.146:0/1079991047 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02600a1380 0x7f026011fc40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f025400ebe0 tx=0x7f025400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.544+0000 7f024effd700 1 -- 172.21.15.146:0/1079991047 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0254009780 con 0x7f02600a1380 2023-10-03T10:13:10.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.544+0000 7f024effd700 1 -- 172.21.15.146:0/1079991047 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025400c850 con 0x7f02600a1380 2023-10-03T10:13:10.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.544+0000 7f0264bf3700 1 -- 172.21.15.146:0/1079991047 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0250009550 con 0x7f02600a1380 2023-10-03T10:13:10.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.544+0000 7f024effd700 1 -- 172.21.15.146:0/1079991047 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025400cbe0 con 0x7f02600a1380 2023-10-03T10:13:10.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.544+0000 7f0264bf3700 1 -- 172.21.15.146:0/1079991047 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0260121ae0 con 0x7f02600a1380 2023-10-03T10:13:10.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.545+0000 7f024effd700 1 -- 172.21.15.146:0/1079991047 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f025400cd40 con 0x7f02600a1380 2023-10-03T10:13:10.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.545+0000 7f0264bf3700 1 -- 172.21.15.146:0/1079991047 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0260099a60 con 0x7f02600a1380 2023-10-03T10:13:10.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.545+0000 7f024effd700 1 -- 172.21.15.146:0/1079991047 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f025403f8b0 con 0x7f02600a1380 2023-10-03T10:13:10.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.550+0000 7f024effd700 1 -- 172.21.15.146:0/1079991047 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f02540232f0 con 0x7f02600a1380 2023-10-03T10:13:10.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.578+0000 7f4440489700 1 Processor -- start 2023-10-03T10:13:10.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.578+0000 7f4440489700 1 -- start start 2023-10-03T10:13:10.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.578+0000 7f4440489700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4438136960 0x7f4438138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.578+0000 7f4440489700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4438139280 0x7f443813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.578+0000 7f4440489700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f443806b2d0 con 0x7f4438133ad0 2023-10-03T10:13:10.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.578+0000 7f4440489700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44381345b0 con 0x7f4438136960 2023-10-03T10:13:10.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.578+0000 7f4440489700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4438133610 con 0x7f4438139280 2023-10-03T10:13:10.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.579+0000 7f443da24700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4438136960 0x7f4438138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.579+0000 7f443ea26700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4438139280 0x7f443813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.579+0000 7f443e225700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4438133ad0 0x7f4438133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55276/0 (socket says 172.21.15.146:55276) 2023-10-03T10:13:10.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.579+0000 7f443e225700 1 -- 172.21.15.146:0/3595262647 learned_addr learned my addr 172.21.15.146:0/3595262647 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:10.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.579+0000 7f443da24700 1 -- 172.21.15.146:0/3595262647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4438139280 msgr2=0x7f443813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:10.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.579+0000 7f443da24700 1 --2- 172.21.15.146:0/3595262647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4438139280 0x7f443813b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.579+0000 7f443da24700 1 -- 172.21.15.146:0/3595262647 >> v1:172.21.15.146:6789/0 conn(0x7f4438133ad0 legacy=0x7f4438133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.579+0000 7f443d223700 1 -- 172.21.15.146:0/3595262647 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4098456827 0 0) 0x7f443806b2d0 con 0x7f4438133ad0 2023-10-03T10:13:10.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.579+0000 7f443da24700 1 -- 172.21.15.146:0/3595262647 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443809a500 con 0x7f4438136960 2023-10-03T10:13:10.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.579+0000 7f443ea26700 1 --2- 172.21.15.146:0/3595262647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4438139280 0x7f443813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:10.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.579+0000 7f443da24700 1 --2- 172.21.15.146:0/3595262647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4438136960 0x7f4438138d40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4428009870 tx=0x7f4428009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f02dd47860fcdcd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.579+0000 7f443d223700 1 -- 172.21.15.146:0/3595262647 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4428011830 con 0x7f4438136960 2023-10-03T10:13:10.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.579+0000 7f443d223700 1 -- 172.21.15.146:0/3595262647 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4428011990 con 0x7f4438136960 2023-10-03T10:13:10.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.579+0000 7f443d223700 1 -- 172.21.15.146:0/3595262647 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4428011d20 con 0x7f4438136960 2023-10-03T10:13:10.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.580+0000 7f4440489700 1 -- 172.21.15.146:0/3595262647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4438136960 msgr2=0x7f4438138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.580+0000 7f4440489700 1 --2- 172.21.15.146:0/3595262647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4438136960 0x7f4438138d40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4428009870 tx=0x7f4428009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:10.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.580+0000 7f4440489700 1 -- 172.21.15.146:0/3595262647 shutdown_connections 2023-10-03T10:13:10.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.580+0000 7f4440489700 1 --2- 172.21.15.146:0/3595262647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4438139280 0x7f443813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.580+0000 7f4440489700 1 --2- 172.21.15.146:0/3595262647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4438136960 0x7f4438138d40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.580+0000 7f4440489700 1 -- 172.21.15.146:0/3595262647 >> 172.21.15.146:0/3595262647 conn(0x7f4438099c40 msgr2=0x7f44380a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.580+0000 7f4440489700 1 -- 172.21.15.146:0/3595262647 shutdown_connections 2023-10-03T10:13:10.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.580+0000 7f4440489700 1 -- 172.21.15.146:0/3595262647 wait complete. 2023-10-03T10:13:10.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.581+0000 7f4440489700 1 Processor -- start 2023-10-03T10:13:10.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.581+0000 7f4440489700 1 -- start start 2023-10-03T10:13:10.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.581+0000 7f4440489700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4438133ad0 0x7f443812cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.581+0000 7f4440489700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4438136960 0x7f443812d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.581+0000 7f4440489700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4438139280 0x7f443812d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.581+0000 7f4440489700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4438130bc0 con 0x7f4438139280 2023-10-03T10:13:10.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.581+0000 7f4440489700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4438072670 con 0x7f4438136960 2023-10-03T10:13:10.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.581+0000 7f4440489700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f443812dd00 con 0x7f4438133ad0 2023-10-03T10:13:10.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.581+0000 7f443e225700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4438133ad0 0x7f443812cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.581+0000 7f443ea26700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4438139280 0x7f443812d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.581+0000 7f443da24700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4438136960 0x7f443812d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.581+0000 7f443ea26700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4438139280 0x7f443812d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41924/0 (socket says 172.21.15.146:41924) 2023-10-03T10:13:10.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.581+0000 7f443e225700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4438133ad0 0x7f443812cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:33256/0 (socket says 172.21.15.146:33256) 2023-10-03T10:13:10.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.581+0000 7f443ea26700 1 -- 172.21.15.146:0/3211319235 learned_addr learned my addr 172.21.15.146:0/3211319235 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:10.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.582+0000 7f443ea26700 1 -- 172.21.15.146:0/3211319235 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4438133ad0 msgr2=0x7f443812cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.582+0000 7f443ea26700 1 --2- 172.21.15.146:0/3211319235 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4438133ad0 0x7f443812cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.582+0000 7f443ea26700 1 -- 172.21.15.146:0/3211319235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4438136960 msgr2=0x7f443812d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.582+0000 7f443ea26700 1 --2- 172.21.15.146:0/3211319235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4438136960 0x7f443812d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.582+0000 7f443ea26700 1 -- 172.21.15.146:0/3211319235 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4430009a70 con 0x7f4438139280 2023-10-03T10:13:10.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.582+0000 7f443ea26700 1 --2- 172.21.15.146:0/3211319235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4438139280 0x7f443812d5b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f443000efc0 tx=0x7f443000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.582+0000 7f442effd700 1 -- 172.21.15.146:0/3211319235 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443000ca90 con 0x7f4438139280 2023-10-03T10:13:10.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.582+0000 7f442effd700 1 -- 172.21.15.146:0/3211319235 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443000f040 con 0x7f4438139280 2023-10-03T10:13:10.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.582+0000 7f4440489700 1 -- 172.21.15.146:0/3211319235 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44280094a0 con 0x7f4438139280 2023-10-03T10:13:10.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.582+0000 7f442effd700 1 -- 172.21.15.146:0/3211319235 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443000ce10 con 0x7f4438139280 2023-10-03T10:13:10.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.582+0000 7f4440489700 1 -- 172.21.15.146:0/3211319235 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443806faf0 con 0x7f4438139280 2023-10-03T10:13:10.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.583+0000 7f442effd700 1 -- 172.21.15.146:0/3211319235 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4430014480 con 0x7f4438139280 2023-10-03T10:13:10.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.583+0000 7f4440489700 1 -- 172.21.15.146:0/3211319235 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443804f2a0 con 0x7f4438139280 2023-10-03T10:13:10.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.583+0000 7f442effd700 1 -- 172.21.15.146:0/3211319235 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f443003fd80 con 0x7f4438139280 2023-10-03T10:13:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.588+0000 7f442effd700 1 -- 172.21.15.146:0/3211319235 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4430043030 con 0x7f4438139280 2023-10-03T10:13:10.678 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:10.721 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:10.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.746+0000 7f0264bf3700 1 -- 172.21.15.146:0/1079991047 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f02600a2710 con 0x7f02600a1380 2023-10-03T10:13:10.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.746+0000 7f024effd700 1 -- 172.21.15.146:0/1079991047 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0254011350 con 0x7f02600a1380 2023-10-03T10:13:10.747 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:10.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.749+0000 7f0264bf3700 1 -- 172.21.15.146:0/1079991047 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02600a1380 msgr2=0x7f026011fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.749+0000 7f0264bf3700 1 --2- 172.21.15.146:0/1079991047 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02600a1380 0x7f026011fc40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f025400ebe0 tx=0x7f025400eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.749+0000 7f0264bf3700 1 -- 172.21.15.146:0/1079991047 shutdown_connections 2023-10-03T10:13:10.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.749+0000 7f0264bf3700 1 --2- 172.21.15.146:0/1079991047 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0260133f50 0x7f02601c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.749+0000 7f0264bf3700 1 --2- 172.21.15.146:0/1079991047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02600a0a70 0x7f026011f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.749+0000 7f0264bf3700 1 --2- 172.21.15.146:0/1079991047 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02600a1380 0x7f026011fc40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.749+0000 7f0264bf3700 1 -- 172.21.15.146:0/1079991047 >> 172.21.15.146:0/1079991047 conn(0x7f02600a6610 msgr2=0x7f02601bbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.750+0000 7f0264bf3700 1 -- 172.21.15.146:0/1079991047 shutdown_connections 2023-10-03T10:13:10.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.750+0000 7f0264bf3700 1 -- 172.21.15.146:0/1079991047 wait complete. 2023-10-03T10:13:10.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:10.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.785+0000 7f4440489700 1 -- 172.21.15.146:0/3211319235 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f443806ffc0 con 0x7f4438139280 2023-10-03T10:13:10.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.786+0000 7f442effd700 1 -- 172.21.15.146:0/3211319235 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4430012930 con 0x7f4438139280 2023-10-03T10:13:10.787 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:10.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.788+0000 7f4440489700 1 -- 172.21.15.146:0/3211319235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4438139280 msgr2=0x7f443812d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.788+0000 7f4440489700 1 --2- 172.21.15.146:0/3211319235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4438139280 0x7f443812d5b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f443000efc0 tx=0x7f443000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.788+0000 7f4440489700 1 -- 172.21.15.146:0/3211319235 shutdown_connections 2023-10-03T10:13:10.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.788+0000 7f4440489700 1 --2- 172.21.15.146:0/3211319235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4438139280 0x7f443812d5b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.788+0000 7f4440489700 1 --2- 172.21.15.146:0/3211319235 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4438133ad0 0x7f443812cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.788+0000 7f4440489700 1 --2- 172.21.15.146:0/3211319235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4438136960 0x7f443812d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.788+0000 7f4440489700 1 -- 172.21.15.146:0/3211319235 >> 172.21.15.146:0/3211319235 conn(0x7f4438099c40 msgr2=0x7f4438134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.788+0000 7f4440489700 1 -- 172.21.15.146:0/3211319235 shutdown_connections 2023-10-03T10:13:10.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.788+0000 7f4440489700 1 -- 172.21.15.146:0/3211319235 wait complete. 2023-10-03T10:13:10.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:10.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.807+0000 7fd34e88e700 1 Processor -- start 2023-10-03T10:13:10.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.807+0000 7fd34e88e700 1 -- start start 2023-10-03T10:13:10.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.808+0000 7fd34e88e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd34806a770 0x7fd34806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.808+0000 7fd34e88e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd34806b080 0x7fd3481317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.808+0000 7fd34e88e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd34809da80 con 0x7fd348131cf0 2023-10-03T10:13:10.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.808+0000 7fd34e88e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34809dce0 con 0x7fd34806b080 2023-10-03T10:13:10.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.808+0000 7fd34e88e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd34809eb20 con 0x7fd34806a770 2023-10-03T10:13:10.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.808+0000 7fd3477fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd34806b080 0x7fd3481317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.808+0000 7fd34ce2b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd348131cf0 0x7fd348138c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55280/0 (socket says 172.21.15.146:55280) 2023-10-03T10:13:10.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.808+0000 7fd347fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd34806a770 0x7fd34806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.808+0000 7fd34ce2b700 1 -- 172.21.15.146:0/1261375744 learned_addr learned my addr 172.21.15.146:0/1261375744 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:10.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.808+0000 7fd346ffd700 1 -- 172.21.15.146:0/1261375744 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1381132553 0 0) 0x7fd34809da80 con 0x7fd348131cf0 2023-10-03T10:13:10.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.808+0000 7fd346ffd700 1 -- 172.21.15.146:0/1261375744 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3300035b0 con 0x7fd348131cf0 2023-10-03T10:13:10.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.808+0000 7fd3477fe700 1 -- 172.21.15.146:0/1261375744 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd34806a770 msgr2=0x7fd34806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:10.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.808+0000 7fd3477fe700 1 --2- 172.21.15.146:0/1261375744 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd34806a770 0x7fd34806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.808+0000 7fd3477fe700 1 -- 172.21.15.146:0/1261375744 >> v1:172.21.15.146:6789/0 conn(0x7fd348131cf0 legacy=0x7fd348138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.808+0000 7fd3477fe700 1 -- 172.21.15.146:0/1261375744 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34809d860 con 0x7fd34806b080 2023-10-03T10:13:10.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.808+0000 7fd347fff700 1 --2- 172.21.15.146:0/1261375744 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd34806a770 0x7fd34806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:10.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.809+0000 7fd3477fe700 1 --2- 172.21.15.146:0/1261375744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd34806b080 0x7fd3481317b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0098a0 tx=0x7fd33c009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7496035e77530fd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.809+0000 7fd346ffd700 1 -- 172.21.15.146:0/1261375744 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c011830 con 0x7fd34806b080 2023-10-03T10:13:10.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.809+0000 7fd346ffd700 1 -- 172.21.15.146:0/1261375744 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c011990 con 0x7fd34806b080 2023-10-03T10:13:10.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.809+0000 7fd346ffd700 1 -- 172.21.15.146:0/1261375744 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c011d20 con 0x7fd34806b080 2023-10-03T10:13:10.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.809+0000 7fd34e88e700 1 -- 172.21.15.146:0/1261375744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd34806b080 msgr2=0x7fd3481317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.809+0000 7fd34e88e700 1 --2- 172.21.15.146:0/1261375744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd34806b080 0x7fd3481317b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0098a0 tx=0x7fd33c009bb0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.809+0000 7fd34e88e700 1 -- 172.21.15.146:0/1261375744 shutdown_connections 2023-10-03T10:13:10.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.809+0000 7fd34e88e700 1 --2- 172.21.15.146:0/1261375744 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd34806a770 0x7fd34806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.809+0000 7fd34e88e700 1 --2- 172.21.15.146:0/1261375744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd34806b080 0x7fd3481317b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.809+0000 7fd34e88e700 1 -- 172.21.15.146:0/1261375744 >> 172.21.15.146:0/1261375744 conn(0x7fd348099c40 msgr2=0x7fd3480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.809+0000 7fd34e88e700 1 -- 172.21.15.146:0/1261375744 shutdown_connections 2023-10-03T10:13:10.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.809+0000 7fd34e88e700 1 -- 172.21.15.146:0/1261375744 wait complete. 2023-10-03T10:13:10.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.810+0000 7fd34e88e700 1 Processor -- start 2023-10-03T10:13:10.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.811+0000 7fd34e88e700 1 -- start start 2023-10-03T10:13:10.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.811+0000 7fd34e88e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd34806a770 0x7fd3481c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.811+0000 7fd34e88e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd34806b080 0x7fd3481c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.811+0000 7fd34e88e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd348131cf0 0x7fd3481c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.811+0000 7fd34e88e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34811da40 con 0x7fd34806b080 2023-10-03T10:13:10.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.811+0000 7fd34e88e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3480a2f60 con 0x7fd348131cf0 2023-10-03T10:13:10.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.811+0000 7fd34e88e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd348071e10 con 0x7fd34806a770 2023-10-03T10:13:10.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.811+0000 7fd347fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd34806a770 0x7fd3481c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.811+0000 7fd34ce2b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd348131cf0 0x7fd3481c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.811+0000 7fd347fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd34806a770 0x7fd3481c7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:33274/0 (socket says 172.21.15.146:33274) 2023-10-03T10:13:10.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.811+0000 7fd347fff700 1 -- 172.21.15.146:0/4172365535 learned_addr learned my addr 172.21.15.146:0/4172365535 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:10.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.811+0000 7fd3477fe700 1 --2- 172.21.15.146:0/4172365535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd34806b080 0x7fd3481c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.811+0000 7fd347fff700 1 -- 172.21.15.146:0/4172365535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd348131cf0 msgr2=0x7fd3481c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.811+0000 7fd347fff700 1 --2- 172.21.15.146:0/4172365535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd348131cf0 0x7fd3481c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.811+0000 7fd347fff700 1 -- 172.21.15.146:0/4172365535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd34806b080 msgr2=0x7fd3481c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.811+0000 7fd347fff700 1 --2- 172.21.15.146:0/4172365535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd34806b080 0x7fd3481c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.811+0000 7fd347fff700 1 -- 172.21.15.146:0/4172365535 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3380094a0 con 0x7fd34806a770 2023-10-03T10:13:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.811+0000 7fd34ce2b700 1 --2- 172.21.15.146:0/4172365535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd348131cf0 0x7fd3481c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.812+0000 7fd347fff700 1 --2- 172.21.15.146:0/4172365535 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd34806a770 0x7fd3481c7fa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd33800ebe0 tx=0x7fd33800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.812+0000 7fd344ff9700 1 -- 172.21.15.146:0/4172365535 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33800c850 con 0x7fd34806a770 2023-10-03T10:13:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.812+0000 7fd344ff9700 1 -- 172.21.15.146:0/4172365535 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33800c9b0 con 0x7fd34806a770 2023-10-03T10:13:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.812+0000 7fd344ff9700 1 -- 172.21.15.146:0/4172365535 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33800cd40 con 0x7fd34806a770 2023-10-03T10:13:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.812+0000 7fd34e88e700 1 -- 172.21.15.146:0/4172365535 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33c0094a0 con 0x7fd34806a770 2023-10-03T10:13:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.812+0000 7fd34e88e700 1 -- 172.21.15.146:0/4172365535 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3481201d0 con 0x7fd34806a770 2023-10-03T10:13:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.813+0000 7fd344ff9700 1 -- 172.21.15.146:0/4172365535 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd338013470 con 0x7fd34806a770 2023-10-03T10:13:10.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.813+0000 7fd344ff9700 1 -- 172.21.15.146:0/4172365535 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd33803f800 con 0x7fd34806a770 2023-10-03T10:13:10.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.813+0000 7fd34e88e700 1 -- 172.21.15.146:0/4172365535 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd348071240 con 0x7fd34806a770 2023-10-03T10:13:10.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.818+0000 7fd344ff9700 1 -- 172.21.15.146:0/4172365535 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd338013720 con 0x7fd34806a770 2023-10-03T10:13:10.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.852+0000 7f09ee5ab700 1 Processor -- start 2023-10-03T10:13:10.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.852+0000 7f09ee5ab700 1 -- start start 2023-10-03T10:13:10.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.852+0000 7f09ee5ab700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09e8134140 0x7f09e8138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.852+0000 7f09ee5ab700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09e81345a0 0x7f09e813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.852+0000 7f09ee5ab700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e809b110 con 0x7f09e809ad40 2023-10-03T10:13:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.852+0000 7f09ee5ab700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e80a3b60 con 0x7f09e8134140 2023-10-03T10:13:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.852+0000 7f09ee5ab700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09e80a1a80 con 0x7f09e81345a0 2023-10-03T10:13:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.852+0000 7f09e77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09e8134140 0x7f09e8138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.852+0000 7f09ecb48700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09e81345a0 0x7f09e813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.852+0000 7f09e7fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f09e809ad40 0x7f09e8133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55290/0 (socket says 172.21.15.146:55290) 2023-10-03T10:13:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.852+0000 7f09ecb48700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09e81345a0 0x7f09e813b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:33288/0 (socket says 172.21.15.146:33288) 2023-10-03T10:13:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.852+0000 7f09e7fff700 1 -- 172.21.15.146:0/3166501982 learned_addr learned my addr 172.21.15.146:0/3166501982 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.853+0000 7f09e77fe700 1 -- 172.21.15.146:0/3166501982 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09e81345a0 msgr2=0x7f09e813b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.853+0000 7f09e77fe700 1 --2- 172.21.15.146:0/3166501982 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09e81345a0 0x7f09e813b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.853+0000 7f09e77fe700 1 -- 172.21.15.146:0/3166501982 >> v1:172.21.15.146:6789/0 conn(0x7f09e809ad40 legacy=0x7f09e8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.853+0000 7f09e6ffd700 1 -- 172.21.15.146:0/3166501982 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686048683 0 0) 0x7f09e809b110 con 0x7f09e809ad40 2023-10-03T10:13:10.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.853+0000 7f09e77fe700 1 -- 172.21.15.146:0/3166501982 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e80a2fa0 con 0x7f09e8134140 2023-10-03T10:13:10.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.853+0000 7f09ecb48700 1 --2- 172.21.15.146:0/3166501982 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09e81345a0 0x7f09e813b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:10.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.853+0000 7f09e77fe700 1 --2- 172.21.15.146:0/3166501982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09e8134140 0x7f09e8138e80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009840 tx=0x7f09dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2281f6de7e6abe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.853+0000 7f09e6ffd700 1 -- 172.21.15.146:0/3166501982 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc011830 con 0x7f09e8134140 2023-10-03T10:13:10.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.853+0000 7f09e6ffd700 1 -- 172.21.15.146:0/3166501982 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc011990 con 0x7f09e8134140 2023-10-03T10:13:10.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.853+0000 7f09e6ffd700 1 -- 172.21.15.146:0/3166501982 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc011d20 con 0x7f09e8134140 2023-10-03T10:13:10.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.853+0000 7f09ee5ab700 1 -- 172.21.15.146:0/3166501982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09e8134140 msgr2=0x7f09e8138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.853+0000 7f09ee5ab700 1 --2- 172.21.15.146:0/3166501982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09e8134140 0x7f09e8138e80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009840 tx=0x7f09dc009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:10.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.853+0000 7f09ee5ab700 1 -- 172.21.15.146:0/3166501982 shutdown_connections 2023-10-03T10:13:10.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.853+0000 7f09ee5ab700 1 --2- 172.21.15.146:0/3166501982 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09e81345a0 0x7f09e813b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.853+0000 7f09ee5ab700 1 --2- 172.21.15.146:0/3166501982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09e8134140 0x7f09e8138e80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.853+0000 7f09ee5ab700 1 -- 172.21.15.146:0/3166501982 >> 172.21.15.146:0/3166501982 conn(0x7f09e8099c40 msgr2=0x7f09e806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.854+0000 7f09ee5ab700 1 -- 172.21.15.146:0/3166501982 shutdown_connections 2023-10-03T10:13:10.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.854+0000 7f09ee5ab700 1 -- 172.21.15.146:0/3166501982 wait complete. 2023-10-03T10:13:10.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.854+0000 7f09ee5ab700 1 Processor -- start 2023-10-03T10:13:10.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.855+0000 7f09ee5ab700 1 -- start start 2023-10-03T10:13:10.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.855+0000 7f09ee5ab700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09e809ad40 0x7f09e811c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.855+0000 7f09ee5ab700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09e8134140 0x7f09e811ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.855+0000 7f09ee5ab700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09e81345a0 0x7f09e811d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.855+0000 7f09ee5ab700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e811edf0 con 0x7f09e8134140 2023-10-03T10:13:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.855+0000 7f09ee5ab700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e813a980 con 0x7f09e81345a0 2023-10-03T10:13:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.855+0000 7f09ee5ab700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09e811e1c0 con 0x7f09e809ad40 2023-10-03T10:13:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.855+0000 7f09e7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09e809ad40 0x7f09e811c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.855+0000 7f09e77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09e8134140 0x7f09e811ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.855+0000 7f09e77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09e8134140 0x7f09e811ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41946/0 (socket says 172.21.15.146:41946) 2023-10-03T10:13:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.855+0000 7f09e7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09e809ad40 0x7f09e811c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:33290/0 (socket says 172.21.15.146:33290) 2023-10-03T10:13:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.855+0000 7f09e77fe700 1 -- 172.21.15.146:0/3761440168 learned_addr learned my addr 172.21.15.146:0/3761440168 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.855+0000 7f09ecb48700 1 --2- 172.21.15.146:0/3761440168 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09e81345a0 0x7f09e811d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.855+0000 7f09e77fe700 1 -- 172.21.15.146:0/3761440168 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09e809ad40 msgr2=0x7f09e811c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.855+0000 7f09e77fe700 1 --2- 172.21.15.146:0/3761440168 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09e809ad40 0x7f09e811c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.855+0000 7f09e77fe700 1 -- 172.21.15.146:0/3761440168 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09e81345a0 msgr2=0x7f09e811d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.855+0000 7f09e77fe700 1 --2- 172.21.15.146:0/3761440168 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09e81345a0 0x7f09e811d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.855+0000 7f09e77fe700 1 -- 172.21.15.146:0/3761440168 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e0009a70 con 0x7f09e8134140 2023-10-03T10:13:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.855+0000 7f09e7fff700 1 --2- 172.21.15.146:0/3761440168 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09e809ad40 0x7f09e811c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.855+0000 7f09ecb48700 1 --2- 172.21.15.146:0/3761440168 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09e81345a0 0x7f09e811d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.856+0000 7f09e77fe700 1 --2- 172.21.15.146:0/3761440168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09e8134140 0x7f09e811ce00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009b90 tx=0x7f09dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.856+0000 7f09e4ff9700 1 -- 172.21.15.146:0/3761440168 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc0045d0 con 0x7f09e8134140 2023-10-03T10:13:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.856+0000 7f09e4ff9700 1 -- 172.21.15.146:0/3761440168 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc01e070 con 0x7f09e8134140 2023-10-03T10:13:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.856+0000 7f09ee5ab700 1 -- 172.21.15.146:0/3761440168 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09dc0094a0 con 0x7f09e8134140 2023-10-03T10:13:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.856+0000 7f09e4ff9700 1 -- 172.21.15.146:0/3761440168 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc0038a0 con 0x7f09e8134140 2023-10-03T10:13:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.856+0000 7f09ee5ab700 1 -- 172.21.15.146:0/3761440168 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e8133710 con 0x7f09e8134140 2023-10-03T10:13:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.857+0000 7f09e4ff9700 1 -- 172.21.15.146:0/3761440168 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09dc003a00 con 0x7f09e8134140 2023-10-03T10:13:10.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.857+0000 7f09e4ff9700 1 -- 172.21.15.146:0/3761440168 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f09dc040490 con 0x7f09e8134140 2023-10-03T10:13:10.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.857+0000 7f09ee5ab700 1 -- 172.21.15.146:0/3761440168 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e811e7b0 con 0x7f09e8134140 2023-10-03T10:13:10.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:10.861+0000 7f09e4ff9700 1 -- 172.21.15.146:0/3761440168 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09e811e7b0 con 0x7f09e8134140 2023-10-03T10:13:11.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.015+0000 7fd34e88e700 1 -- 172.21.15.146:0/4172365535 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd348120360 con 0x7fd34806a770 2023-10-03T10:13:11.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.015+0000 7fd344ff9700 1 -- 172.21.15.146:0/4172365535 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd33801b9c0 con 0x7fd34806a770 2023-10-03T10:13:11.016 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:11.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.018+0000 7fd34e88e700 1 -- 172.21.15.146:0/4172365535 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd34806a770 msgr2=0x7fd3481c7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.018+0000 7fd34e88e700 1 --2- 172.21.15.146:0/4172365535 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd34806a770 0x7fd3481c7fa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd33800ebe0 tx=0x7fd33800eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.018+0000 7fd34e88e700 1 -- 172.21.15.146:0/4172365535 shutdown_connections 2023-10-03T10:13:11.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.018+0000 7fd34e88e700 1 --2- 172.21.15.146:0/4172365535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd348131cf0 0x7fd3481c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.018+0000 7fd34e88e700 1 --2- 172.21.15.146:0/4172365535 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd34806a770 0x7fd3481c7fa0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.018+0000 7fd34e88e700 1 --2- 172.21.15.146:0/4172365535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd34806b080 0x7fd3481c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.018+0000 7fd34e88e700 1 -- 172.21.15.146:0/4172365535 >> 172.21.15.146:0/4172365535 conn(0x7fd348099c40 msgr2=0x7fd3480a3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.018+0000 7fd34e88e700 1 -- 172.21.15.146:0/4172365535 shutdown_connections 2023-10-03T10:13:11.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.018+0000 7fd34e88e700 1 -- 172.21.15.146:0/4172365535 wait complete. 2023-10-03T10:13:11.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:11.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.056+0000 7f09ee5ab700 1 -- 172.21.15.146:0/3761440168 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f09e811e7b0 con 0x7f09e8134140 2023-10-03T10:13:11.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.056+0000 7f09e4ff9700 1 -- 172.21.15.146:0/3761440168 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f09e811e7b0 con 0x7f09e8134140 2023-10-03T10:13:11.057 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:11.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.058+0000 7f09ee5ab700 1 -- 172.21.15.146:0/3761440168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09e8134140 msgr2=0x7f09e811ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.058+0000 7f09ee5ab700 1 --2- 172.21.15.146:0/3761440168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09e8134140 0x7f09e811ce00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009b90 tx=0x7f09dc004750 comp rx=0 tx=0).stop 2023-10-03T10:13:11.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.058+0000 7f09ee5ab700 1 -- 172.21.15.146:0/3761440168 shutdown_connections 2023-10-03T10:13:11.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.058+0000 7f09ee5ab700 1 --2- 172.21.15.146:0/3761440168 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09e81345a0 0x7f09e811d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.058+0000 7f09ee5ab700 1 --2- 172.21.15.146:0/3761440168 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09e809ad40 0x7f09e811c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.058+0000 7f09ee5ab700 1 --2- 172.21.15.146:0/3761440168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09e8134140 0x7f09e811ce00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.058+0000 7f09ee5ab700 1 -- 172.21.15.146:0/3761440168 >> 172.21.15.146:0/3761440168 conn(0x7f09e8099c40 msgr2=0x7f09e809b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.058+0000 7f09ee5ab700 1 -- 172.21.15.146:0/3761440168 shutdown_connections 2023-10-03T10:13:11.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.058+0000 7f09ee5ab700 1 -- 172.21.15.146:0/3761440168 wait complete. 2023-10-03T10:13:11.071 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:11.765 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:11.802 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:11.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.913+0000 7fa4dc0c9700 1 Processor -- start 2023-10-03T10:13:11.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.913+0000 7fa4dc0c9700 1 -- start start 2023-10-03T10:13:11.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.913+0000 7fa4dc0c9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4d409e870 0x7fa4d409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.913+0000 7fa4dc0c9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4d409f180 0x7fa4d4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.913+0000 7fa4dc0c9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa4d4131d70 0x7fa4d4132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.913+0000 7fa4dc0c9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d40a0920 con 0x7fa4d4131d70 2023-10-03T10:13:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.913+0000 7fa4dc0c9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d409c970 con 0x7fa4d409e870 2023-10-03T10:13:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.913+0000 7fa4dc0c9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d409bab0 con 0x7fa4d409f180 2023-10-03T10:13:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.913+0000 7fa4d9e65700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4d409e870 0x7fa4d409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.914+0000 7fa4d9664700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4d409f180 0x7fa4d4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.914+0000 7fa4d9e65700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4d409e870 0x7fa4d409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:47468/0 (socket says 172.21.15.146:47468) 2023-10-03T10:13:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.914+0000 7fa4d9e65700 1 -- 172.21.15.146:0/2168572537 learned_addr learned my addr 172.21.15.146:0/2168572537 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.914+0000 7fa4da666700 1 --2- 172.21.15.146:0/2168572537 >> v2:172.21.15.146:3300/0 conn(0x7fa4d4131d70 0x7fa4d4132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.914+0000 7fa4d9664700 1 -- 172.21.15.146:0/2168572537 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4d409e870 msgr2=0x7fa4d409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.914+0000 7fa4d9664700 1 --2- 172.21.15.146:0/2168572537 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4d409e870 0x7fa4d409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.914+0000 7fa4d9664700 1 -- 172.21.15.146:0/2168572537 >> v2:172.21.15.146:3300/0 conn(0x7fa4d4131d70 msgr2=0x7fa4d4132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.914+0000 7fa4d9664700 1 --2- 172.21.15.146:0/2168572537 >> v2:172.21.15.146:3300/0 conn(0x7fa4d4131d70 0x7fa4d4132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.914+0000 7fa4d9664700 1 -- 172.21.15.146:0/2168572537 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d409f9c0 con 0x7fa4d409f180 2023-10-03T10:13:11.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.914+0000 7fa4d9e65700 1 --2- 172.21.15.146:0/2168572537 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4d409e870 0x7fa4d409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:11.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.914+0000 7fa4da666700 1 --2- 172.21.15.146:0/2168572537 >> v2:172.21.15.146:3300/0 conn(0x7fa4d4131d70 0x7fa4d4132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:11.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.914+0000 7fa4d9664700 1 --2- 172.21.15.146:0/2168572537 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4d409f180 0x7fa4d4131830 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009840 tx=0x7fa4c4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b008219f0bb43a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.914+0000 7fa4d8e63700 1 -- 172.21.15.146:0/2168572537 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4011830 con 0x7fa4d409f180 2023-10-03T10:13:11.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.914+0000 7fa4d8e63700 1 -- 172.21.15.146:0/2168572537 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c4011990 con 0x7fa4d409f180 2023-10-03T10:13:11.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.914+0000 7fa4d8e63700 1 -- 172.21.15.146:0/2168572537 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4011d20 con 0x7fa4d409f180 2023-10-03T10:13:11.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.915+0000 7fa4dc0c9700 1 -- 172.21.15.146:0/2168572537 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4d409f180 msgr2=0x7fa4d4131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.915+0000 7fa4dc0c9700 1 --2- 172.21.15.146:0/2168572537 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4d409f180 0x7fa4d4131830 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009840 tx=0x7fa4c4009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:11.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.915+0000 7fa4dc0c9700 1 -- 172.21.15.146:0/2168572537 shutdown_connections 2023-10-03T10:13:11.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.915+0000 7fa4dc0c9700 1 --2- 172.21.15.146:0/2168572537 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4d409e870 0x7fa4d409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.915+0000 7fa4dc0c9700 1 --2- 172.21.15.146:0/2168572537 >> v2:172.21.15.146:3300/0 conn(0x7fa4d4131d70 0x7fa4d4132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.915+0000 7fa4dc0c9700 1 --2- 172.21.15.146:0/2168572537 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4d409f180 0x7fa4d4131830 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.915+0000 7fa4dc0c9700 1 -- 172.21.15.146:0/2168572537 >> 172.21.15.146:0/2168572537 conn(0x7fa4d40a4430 msgr2=0x7fa4d40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.915+0000 7fa4dc0c9700 1 -- 172.21.15.146:0/2168572537 shutdown_connections 2023-10-03T10:13:11.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.915+0000 7fa4dc0c9700 1 -- 172.21.15.146:0/2168572537 wait complete. 2023-10-03T10:13:11.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.917+0000 7fa4dc0c9700 1 Processor -- start 2023-10-03T10:13:11.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.917+0000 7fa4dc0c9700 1 -- start start 2023-10-03T10:13:11.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.917+0000 7fa4dc0c9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4d409e870 0x7fa4d406b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.917+0000 7fa4dc0c9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4d409f180 0x7fa4d406bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.917+0000 7fa4dc0c9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4d4131d70 0x7fa4d406c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.917+0000 7fa4dc0c9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d4131830 con 0x7fa4d4131d70 2023-10-03T10:13:11.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.917+0000 7fa4dc0c9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d40a0210 con 0x7fa4d409e870 2023-10-03T10:13:11.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.917+0000 7fa4dc0c9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d4124670 con 0x7fa4d409f180 2023-10-03T10:13:11.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.917+0000 7fa4da666700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4d4131d70 0x7fa4d406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.917+0000 7fa4d9664700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4d409f180 0x7fa4d406bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.917+0000 7fa4da666700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4d4131d70 0x7fa4d406c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41960/0 (socket says 172.21.15.146:41960) 2023-10-03T10:13:11.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.917+0000 7fa4d9664700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4d409f180 0x7fa4d406bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:33308/0 (socket says 172.21.15.146:33308) 2023-10-03T10:13:11.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.917+0000 7fa4d9e65700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4d409e870 0x7fa4d406b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.917+0000 7fa4da666700 1 -- 172.21.15.146:0/725241205 learned_addr learned my addr 172.21.15.146:0/725241205 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:11.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.918+0000 7fa4da666700 1 -- 172.21.15.146:0/725241205 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4d409f180 msgr2=0x7fa4d406bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.918+0000 7fa4da666700 1 --2- 172.21.15.146:0/725241205 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4d409f180 0x7fa4d406bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.918+0000 7fa4da666700 1 -- 172.21.15.146:0/725241205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4d409e870 msgr2=0x7fa4d406b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.918+0000 7fa4da666700 1 --2- 172.21.15.146:0/725241205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4d409e870 0x7fa4d406b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.918+0000 7fa4da666700 1 -- 172.21.15.146:0/725241205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d0009550 con 0x7fa4d4131d70 2023-10-03T10:13:11.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.918+0000 7fa4da666700 1 --2- 172.21.15.146:0/725241205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4d4131d70 0x7fa4d406c300 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00efc0 tx=0x7fa4cc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.918+0000 7fa4ca7fc700 1 -- 172.21.15.146:0/725241205 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc00cb40 con 0x7fa4d4131d70 2023-10-03T10:13:11.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.918+0000 7fa4ca7fc700 1 -- 172.21.15.146:0/725241205 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc00f040 con 0x7fa4d4131d70 2023-10-03T10:13:11.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.918+0000 7fa4dc0c9700 1 -- 172.21.15.146:0/725241205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4cc009a70 con 0x7fa4d4131d70 2023-10-03T10:13:11.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.918+0000 7fa4ca7fc700 1 -- 172.21.15.146:0/725241205 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc003a20 con 0x7fa4d4131d70 2023-10-03T10:13:11.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.918+0000 7fa4dc0c9700 1 -- 172.21.15.146:0/725241205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c40094a0 con 0x7fa4d4131d70 2023-10-03T10:13:11.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.919+0000 7fa4ca7fc700 1 -- 172.21.15.146:0/725241205 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4cc014480 con 0x7fa4d4131d70 2023-10-03T10:13:11.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.919+0000 7fa4ca7fc700 1 -- 172.21.15.146:0/725241205 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa4cc03ff50 con 0x7fa4d4131d70 2023-10-03T10:13:11.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.919+0000 7fa4dc0c9700 1 -- 172.21.15.146:0/725241205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d404f2a0 con 0x7fa4d4131d70 2023-10-03T10:13:11.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.924+0000 7fa4ca7fc700 1 -- 172.21.15.146:0/725241205 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4cc012910 con 0x7fa4d4131d70 2023-10-03T10:13:11.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.958+0000 7f9c99d06700 1 Processor -- start 2023-10-03T10:13:11.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.958+0000 7f9c99d06700 1 -- start start 2023-10-03T10:13:11.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.958+0000 7f9c99d06700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c9409e870 0x7f9c9409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.959+0000 7f9c99d06700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9c9409f180 0x7f9c94131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.959+0000 7f9c99d06700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c9409c970 con 0x7f9c94131d70 2023-10-03T10:13:11.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.959+0000 7f9c99d06700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c940a0920 con 0x7f9c9409f180 2023-10-03T10:13:11.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.959+0000 7f9c99d06700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9409f9c0 con 0x7f9c9409e870 2023-10-03T10:13:11.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.959+0000 7f9c92ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9c9409f180 0x7f9c94131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.959+0000 7f9c937fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c9409e870 0x7f9c9409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.959+0000 7f9c92ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9c9409f180 0x7f9c94131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41966/0 (socket says 172.21.15.146:41966) 2023-10-03T10:13:11.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.959+0000 7f9c92ffd700 1 -- 172.21.15.146:0/2655333206 learned_addr learned my addr 172.21.15.146:0/2655333206 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:11.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.959+0000 7f9c93fff700 1 --1- 172.21.15.146:0/2655333206 >> v1:172.21.15.146:6789/0 conn(0x7f9c94131d70 0x7f9c94138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55302/0 (socket says 172.21.15.146:55302) 2023-10-03T10:13:11.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.959+0000 7f9c92ffd700 1 -- 172.21.15.146:0/2655333206 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c9409e870 msgr2=0x7f9c9409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:11.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.959+0000 7f9c92ffd700 1 --2- 172.21.15.146:0/2655333206 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c9409e870 0x7f9c9409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.959+0000 7f9c92ffd700 1 -- 172.21.15.146:0/2655333206 >> v1:172.21.15.146:6789/0 conn(0x7f9c94131d70 legacy=0x7f9c94138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.959+0000 7f9c927fc700 1 -- 172.21.15.146:0/2655333206 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760600743 0 0) 0x7f9c9409c970 con 0x7f9c94131d70 2023-10-03T10:13:11.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.959+0000 7f9c92ffd700 1 -- 172.21.15.146:0/2655333206 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9409bab0 con 0x7f9c9409f180 2023-10-03T10:13:11.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.959+0000 7f9c937fe700 1 --2- 172.21.15.146:0/2655333206 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c9409e870 0x7f9c9409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:11.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.959+0000 7f9c92ffd700 1 --2- 172.21.15.146:0/2655333206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c9409f180 0x7f9c94131830 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0098f0 tx=0x7f9c7c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1046d2f9f26f3c9d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.959+0000 7f9c927fc700 1 -- 172.21.15.146:0/2655333206 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c011830 con 0x7f9c9409f180 2023-10-03T10:13:11.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.959+0000 7f9c927fc700 1 -- 172.21.15.146:0/2655333206 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c011990 con 0x7f9c9409f180 2023-10-03T10:13:11.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.959+0000 7f9c927fc700 1 -- 172.21.15.146:0/2655333206 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c011d20 con 0x7f9c9409f180 2023-10-03T10:13:11.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.960+0000 7f9c99d06700 1 -- 172.21.15.146:0/2655333206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c9409f180 msgr2=0x7f9c94131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.960+0000 7f9c99d06700 1 --2- 172.21.15.146:0/2655333206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c9409f180 0x7f9c94131830 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0098f0 tx=0x7f9c7c009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:11.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.960+0000 7f9c99d06700 1 -- 172.21.15.146:0/2655333206 shutdown_connections 2023-10-03T10:13:11.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.960+0000 7f9c99d06700 1 --2- 172.21.15.146:0/2655333206 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c9409e870 0x7f9c9409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.960+0000 7f9c99d06700 1 --2- 172.21.15.146:0/2655333206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c9409f180 0x7f9c94131830 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.960+0000 7f9c99d06700 1 -- 172.21.15.146:0/2655333206 >> 172.21.15.146:0/2655333206 conn(0x7f9c940a4430 msgr2=0x7f9c940a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.960+0000 7f9c99d06700 1 -- 172.21.15.146:0/2655333206 shutdown_connections 2023-10-03T10:13:11.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.960+0000 7f9c99d06700 1 -- 172.21.15.146:0/2655333206 wait complete. 2023-10-03T10:13:11.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.961+0000 7f9c99d06700 1 Processor -- start 2023-10-03T10:13:11.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.961+0000 7f9c99d06700 1 -- start start 2023-10-03T10:13:11.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c99d06700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c9409e870 0x7f9c9406c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c99d06700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c9409f180 0x7f9c9406c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c99d06700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c94131d70 0x7f9c941c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c99d06700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c94122330 con 0x7f9c9409f180 2023-10-03T10:13:11.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c99d06700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c94131380 con 0x7f9c9409e870 2023-10-03T10:13:11.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c99d06700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9409dba0 con 0x7f9c94131d70 2023-10-03T10:13:11.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c92ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c9409f180 0x7f9c9406c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c93fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c94131d70 0x7f9c941c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c937fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c9409e870 0x7f9c9406c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c92ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c9409f180 0x7f9c9406c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41976/0 (socket says 172.21.15.146:41976) 2023-10-03T10:13:11.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c92ffd700 1 -- 172.21.15.146:0/2980674169 learned_addr learned my addr 172.21.15.146:0/2980674169 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:11.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c92ffd700 1 -- 172.21.15.146:0/2980674169 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c94131d70 msgr2=0x7f9c941c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c92ffd700 1 --2- 172.21.15.146:0/2980674169 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c94131d70 0x7f9c941c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c92ffd700 1 -- 172.21.15.146:0/2980674169 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c9409e870 msgr2=0x7f9c9406c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c92ffd700 1 --2- 172.21.15.146:0/2980674169 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c9409e870 0x7f9c9406c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c92ffd700 1 -- 172.21.15.146:0/2980674169 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c84009a70 con 0x7f9c9409f180 2023-10-03T10:13:11.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c937fe700 1 --2- 172.21.15.146:0/2980674169 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c9409e870 0x7f9c9406c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:11.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c92ffd700 1 --2- 172.21.15.146:0/2980674169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c9409f180 0x7f9c9406c850 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009c40 tx=0x7f9c7c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c8bfff700 1 -- 172.21.15.146:0/2980674169 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c004510 con 0x7f9c9409f180 2023-10-03T10:13:11.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c8bfff700 1 -- 172.21.15.146:0/2980674169 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c0036a0 con 0x7f9c9409f180 2023-10-03T10:13:11.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c8bfff700 1 -- 172.21.15.146:0/2980674169 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c003a10 con 0x7f9c9409f180 2023-10-03T10:13:11.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c99d06700 1 -- 172.21.15.146:0/2980674169 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c7c009550 con 0x7f9c9409f180 2023-10-03T10:13:11.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.962+0000 7f9c99d06700 1 -- 172.21.15.146:0/2980674169 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c9406d430 con 0x7f9c9409f180 2023-10-03T10:13:11.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.963+0000 7f9c8bfff700 1 -- 172.21.15.146:0/2980674169 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c7c021070 con 0x7f9c9409f180 2023-10-03T10:13:11.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.963+0000 7f9c8bfff700 1 -- 172.21.15.146:0/2980674169 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9c7c0404d0 con 0x7f9c9409f180 2023-10-03T10:13:11.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.964+0000 7f9c99d06700 1 -- 172.21.15.146:0/2980674169 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c940a2b10 con 0x7f9c9409f180 2023-10-03T10:13:11.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:11.968+0000 7f9c8bfff700 1 -- 172.21.15.146:0/2980674169 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c7c022960 con 0x7f9c9409f180 2023-10-03T10:13:12.031 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:12.072 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:12.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.163+0000 7efca6a25700 1 Processor -- start 2023-10-03T10:13:12.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.163+0000 7efca6a25700 1 -- start start 2023-10-03T10:13:12.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.163+0000 7efca6a25700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efca009d860 0x7efca009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.163+0000 7efca6a25700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efca0130eb0 0x7efca0138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.163+0000 7efca6a25700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca009aaa0 con 0x7efca009e170 2023-10-03T10:13:12.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.163+0000 7efca6a25700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca009f870 con 0x7efca009d860 2023-10-03T10:13:12.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.163+0000 7efca6a25700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efca009b360 con 0x7efca0130eb0 2023-10-03T10:13:12.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.164+0000 7efc9ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efca009d860 0x7efca009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.164+0000 7efc9ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efca009d860 0x7efca009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41980/0 (socket says 172.21.15.146:41980) 2023-10-03T10:13:12.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.164+0000 7efc9ffff700 1 -- 172.21.15.146:0/1542094323 learned_addr learned my addr 172.21.15.146:0/1542094323 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:12.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.164+0000 7efca4fc2700 1 --2- 172.21.15.146:0/1542094323 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efca0130eb0 0x7efca0138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.164+0000 7efc9f7fe700 1 --1- 172.21.15.146:0/1542094323 >> v1:172.21.15.146:6789/0 conn(0x7efca009e170 0x7efca01307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55304/0 (socket says 172.21.15.146:55304) 2023-10-03T10:13:12.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.164+0000 7efc9ffff700 1 -- 172.21.15.146:0/1542094323 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efca0130eb0 msgr2=0x7efca0138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:12.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.164+0000 7efc9ffff700 1 --2- 172.21.15.146:0/1542094323 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efca0130eb0 0x7efca0138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.164+0000 7efc9effd700 1 -- 172.21.15.146:0/1542094323 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488338387 0 0) 0x7efca009aaa0 con 0x7efca009e170 2023-10-03T10:13:12.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.164+0000 7efc9ffff700 1 -- 172.21.15.146:0/1542094323 >> v1:172.21.15.146:6789/0 conn(0x7efca009e170 legacy=0x7efca01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.164+0000 7efc9ffff700 1 -- 172.21.15.146:0/1542094323 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca009b620 con 0x7efca009d860 2023-10-03T10:13:12.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.164+0000 7efca4fc2700 1 --2- 172.21.15.146:0/1542094323 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efca0130eb0 0x7efca0138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:12.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.164+0000 7efc9ffff700 1 --2- 172.21.15.146:0/1542094323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efca009d860 0x7efca009dc30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efc900098f0 tx=0x7efc90009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28d2850787230d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.164+0000 7efc9effd700 1 -- 172.21.15.146:0/1542094323 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc90011830 con 0x7efca009d860 2023-10-03T10:13:12.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.164+0000 7efc9effd700 1 -- 172.21.15.146:0/1542094323 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc90011990 con 0x7efca009d860 2023-10-03T10:13:12.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.164+0000 7efc9effd700 1 -- 172.21.15.146:0/1542094323 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc90011d20 con 0x7efca009d860 2023-10-03T10:13:12.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.165+0000 7efca6a25700 1 -- 172.21.15.146:0/1542094323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efca009d860 msgr2=0x7efca009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.165+0000 7efca6a25700 1 --2- 172.21.15.146:0/1542094323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efca009d860 0x7efca009dc30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efc900098f0 tx=0x7efc90009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:12.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.165+0000 7efca6a25700 1 -- 172.21.15.146:0/1542094323 shutdown_connections 2023-10-03T10:13:12.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.165+0000 7efca6a25700 1 --2- 172.21.15.146:0/1542094323 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efca0130eb0 0x7efca0138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.165+0000 7efca6a25700 1 --2- 172.21.15.146:0/1542094323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efca009d860 0x7efca009dc30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.165+0000 7efca6a25700 1 -- 172.21.15.146:0/1542094323 >> 172.21.15.146:0/1542094323 conn(0x7efca0099c40 msgr2=0x7efca00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:12.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.166+0000 7efca6a25700 1 -- 172.21.15.146:0/1542094323 shutdown_connections 2023-10-03T10:13:12.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.166+0000 7efca6a25700 1 -- 172.21.15.146:0/1542094323 wait complete. 2023-10-03T10:13:12.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.166+0000 7efca6a25700 1 Processor -- start 2023-10-03T10:13:12.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.167+0000 7efca6a25700 1 -- start start 2023-10-03T10:13:12.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.167+0000 7efca6a25700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efca009d860 0x7efca011e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.167+0000 7efca6a25700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efca009e170 0x7efca011e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.167+0000 7efca6a25700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efca0130eb0 0x7efca011ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.167+0000 7efca6a25700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca011fee0 con 0x7efca0130eb0 2023-10-03T10:13:12.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.167+0000 7efca6a25700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca0121f60 con 0x7efca009e170 2023-10-03T10:13:12.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.167+0000 7efca6a25700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efca0071fc0 con 0x7efca009d860 2023-10-03T10:13:12.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.167+0000 7efca4fc2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efca0130eb0 0x7efca011ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.167+0000 7efca4fc2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efca0130eb0 0x7efca011ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41988/0 (socket says 172.21.15.146:41988) 2023-10-03T10:13:12.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.167+0000 7efca4fc2700 1 -- 172.21.15.146:0/261191236 learned_addr learned my addr 172.21.15.146:0/261191236 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:12.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.167+0000 7efc9f7fe700 1 --2- 172.21.15.146:0/261191236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efca009e170 0x7efca011e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.168+0000 7efc9ffff700 1 --2- 172.21.15.146:0/261191236 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efca009d860 0x7efca011e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.168+0000 7efca4fc2700 1 -- 172.21.15.146:0/261191236 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efca009d860 msgr2=0x7efca011e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.168+0000 7efca4fc2700 1 --2- 172.21.15.146:0/261191236 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efca009d860 0x7efca011e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.168+0000 7efca4fc2700 1 -- 172.21.15.146:0/261191236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efca009e170 msgr2=0x7efca011e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.168+0000 7efca4fc2700 1 --2- 172.21.15.146:0/261191236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efca009e170 0x7efca011e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.168+0000 7efca4fc2700 1 -- 172.21.15.146:0/261191236 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc98009a70 con 0x7efca0130eb0 2023-10-03T10:13:12.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.168+0000 7efca4fc2700 1 --2- 172.21.15.146:0/261191236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efca0130eb0 0x7efca011ee40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7efc9800efc0 tx=0x7efc9800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.168+0000 7efc9cff9700 1 -- 172.21.15.146:0/261191236 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9800cb40 con 0x7efca0130eb0 2023-10-03T10:13:12.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.168+0000 7efca6a25700 1 -- 172.21.15.146:0/261191236 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc90009550 con 0x7efca0130eb0 2023-10-03T10:13:12.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.168+0000 7efca6a25700 1 -- 172.21.15.146:0/261191236 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca009c900 con 0x7efca0130eb0 2023-10-03T10:13:12.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.168+0000 7efc9cff9700 1 -- 172.21.15.146:0/261191236 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9800f040 con 0x7efca0130eb0 2023-10-03T10:13:12.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.168+0000 7efc9cff9700 1 -- 172.21.15.146:0/261191236 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98003a20 con 0x7efca0130eb0 2023-10-03T10:13:12.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.169+0000 7efc9cff9700 1 -- 172.21.15.146:0/261191236 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc98014480 con 0x7efca0130eb0 2023-10-03T10:13:12.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.169+0000 7efc9cff9700 1 -- 172.21.15.146:0/261191236 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efc98040110 con 0x7efca0130eb0 2023-10-03T10:13:12.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.169+0000 7efca6a25700 1 -- 172.21.15.146:0/261191236 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc800052e0 con 0x7efca0130eb0 2023-10-03T10:13:12.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.174+0000 7efc9cff9700 1 -- 172.21.15.146:0/261191236 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc98012930 con 0x7efca0130eb0 2023-10-03T10:13:12.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.206+0000 7f0f6dcac700 1 Processor -- start 2023-10-03T10:13:12.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.206+0000 7f0f6dcac700 1 -- start start 2023-10-03T10:13:12.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.206+0000 7f0f6dcac700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0f68133ad0 0x7f0f68133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.206+0000 7f0f6dcac700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f681300a0 0x7f0f681304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.207+0000 7f0f6dcac700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f681309f0 0x7f0f6813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.207+0000 7f0f6dcac700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6806b2d0 con 0x7f0f68133ad0 2023-10-03T10:13:12.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.207+0000 7f0f6dcac700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f68133610 con 0x7f0f681300a0 2023-10-03T10:13:12.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.207+0000 7f0f6dcac700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6809a500 con 0x7f0f681309f0 2023-10-03T10:13:12.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.207+0000 7f0f677fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0f68133ad0 0x7f0f68133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.207+0000 7f0f677fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0f68133ad0 0x7f0f68133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42000/0 (socket says 172.21.15.146:42000) 2023-10-03T10:13:12.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.207+0000 7f0f677fe700 1 -- 172.21.15.146:0/3439486188 learned_addr learned my addr 172.21.15.146:0/3439486188 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:12.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.207+0000 7f0f66ffd700 1 --2- 172.21.15.146:0/3439486188 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f681300a0 0x7f0f681304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.207+0000 7f0f677fe700 1 -- 172.21.15.146:0/3439486188 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f681309f0 msgr2=0x7f0f6813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:12.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.207+0000 7f0f677fe700 1 --2- 172.21.15.146:0/3439486188 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f681309f0 0x7f0f6813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.207+0000 7f0f677fe700 1 -- 172.21.15.146:0/3439486188 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f681300a0 msgr2=0x7f0f681304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:12.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.207+0000 7f0f677fe700 1 --2- 172.21.15.146:0/3439486188 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f681300a0 0x7f0f681304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.207+0000 7f0f677fe700 1 -- 172.21.15.146:0/3439486188 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f681338b0 con 0x7f0f68133ad0 2023-10-03T10:13:12.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.207+0000 7f0f677fe700 1 --2- 172.21.15.146:0/3439486188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f68133ad0 0x7f0f68133ea0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0f580098f0 tx=0x7f0f58009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5054e635aa5944f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.207+0000 7f0f667fc700 1 -- 172.21.15.146:0/3439486188 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58011830 con 0x7f0f68133ad0 2023-10-03T10:13:12.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.208+0000 7f0f667fc700 1 -- 172.21.15.146:0/3439486188 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f58011990 con 0x7f0f68133ad0 2023-10-03T10:13:12.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.208+0000 7f0f667fc700 1 -- 172.21.15.146:0/3439486188 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58011d20 con 0x7f0f68133ad0 2023-10-03T10:13:12.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.208+0000 7f0f6dcac700 1 -- 172.21.15.146:0/3439486188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f68133ad0 msgr2=0x7f0f68133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.208+0000 7f0f6dcac700 1 --2- 172.21.15.146:0/3439486188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f68133ad0 0x7f0f68133ea0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0f580098f0 tx=0x7f0f58009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:12.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.208+0000 7f0f6dcac700 1 -- 172.21.15.146:0/3439486188 shutdown_connections 2023-10-03T10:13:12.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.208+0000 7f0f6dcac700 1 --2- 172.21.15.146:0/3439486188 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f681309f0 0x7f0f6813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.208+0000 7f0f6dcac700 1 --2- 172.21.15.146:0/3439486188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f68133ad0 0x7f0f68133ea0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.208+0000 7f0f6dcac700 1 --2- 172.21.15.146:0/3439486188 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f681300a0 0x7f0f681304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.208+0000 7f0f6dcac700 1 -- 172.21.15.146:0/3439486188 >> 172.21.15.146:0/3439486188 conn(0x7f0f68099c40 msgr2=0x7f0f680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:12.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.208+0000 7f0f6dcac700 1 -- 172.21.15.146:0/3439486188 shutdown_connections 2023-10-03T10:13:12.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.208+0000 7f0f6dcac700 1 -- 172.21.15.146:0/3439486188 wait complete. 2023-10-03T10:13:12.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.209+0000 7f0f6dcac700 1 Processor -- start 2023-10-03T10:13:12.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.210+0000 7f0f6dcac700 1 -- start start 2023-10-03T10:13:12.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.210+0000 7f0f6dcac700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f681300a0 0x7f0f6811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.210+0000 7f0f6dcac700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f681309f0 0x7f0f6811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.210+0000 7f0f6dcac700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f68133ad0 0x7f0f6811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.210+0000 7f0f6dcac700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6811f0b0 con 0x7f0f681309f0 2023-10-03T10:13:12.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.210+0000 7f0f6dcac700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6811fde0 con 0x7f0f681300a0 2023-10-03T10:13:12.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.210+0000 7f0f6dcac700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6811fbb0 con 0x7f0f68133ad0 2023-10-03T10:13:12.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.211+0000 7f0f66ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f681309f0 0x7f0f6811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.211+0000 7f0f66ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f681309f0 0x7f0f6811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42014/0 (socket says 172.21.15.146:42014) 2023-10-03T10:13:12.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.211+0000 7f0f66ffd700 1 -- 172.21.15.146:0/66274036 learned_addr learned my addr 172.21.15.146:0/66274036 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:12.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.211+0000 7f0f67fff700 1 --2- 172.21.15.146:0/66274036 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f68133ad0 0x7f0f6811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.211+0000 7f0f677fe700 1 --2- 172.21.15.146:0/66274036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f681300a0 0x7f0f6811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.211+0000 7f0f66ffd700 1 -- 172.21.15.146:0/66274036 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f68133ad0 msgr2=0x7f0f6811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.211+0000 7f0f66ffd700 1 --2- 172.21.15.146:0/66274036 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f68133ad0 0x7f0f6811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.211+0000 7f0f66ffd700 1 -- 172.21.15.146:0/66274036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f681300a0 msgr2=0x7f0f6811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.211+0000 7f0f66ffd700 1 --2- 172.21.15.146:0/66274036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f681300a0 0x7f0f6811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.211+0000 7f0f66ffd700 1 -- 172.21.15.146:0/66274036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f58009550 con 0x7f0f681309f0 2023-10-03T10:13:12.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.211+0000 7f0f677fe700 1 --2- 172.21.15.146:0/66274036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f681300a0 0x7f0f6811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:12.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.211+0000 7f0f66ffd700 1 --2- 172.21.15.146:0/66274036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f681309f0 0x7f0f6811df80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00e9e0 tx=0x7f0f5c00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.211+0000 7f0f4ffff700 1 -- 172.21.15.146:0/66274036 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c009710 con 0x7f0f681309f0 2023-10-03T10:13:12.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.211+0000 7f0f4ffff700 1 -- 172.21.15.146:0/66274036 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c00c850 con 0x7f0f681309f0 2023-10-03T10:13:12.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.211+0000 7f0f6dcac700 1 -- 172.21.15.146:0/66274036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6811f850 con 0x7f0f681309f0 2023-10-03T10:13:12.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.211+0000 7f0f4ffff700 1 -- 172.21.15.146:0/66274036 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00cbc0 con 0x7f0f681309f0 2023-10-03T10:13:12.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.211+0000 7f0f6dcac700 1 -- 172.21.15.146:0/66274036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f681200c0 con 0x7f0f681309f0 2023-10-03T10:13:12.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.212+0000 7f0f6dcac700 1 -- 172.21.15.146:0/66274036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6804f2a0 con 0x7f0f681309f0 2023-10-03T10:13:12.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.212+0000 7f0f4ffff700 1 -- 172.21.15.146:0/66274036 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f5c00cd20 con 0x7f0f681309f0 2023-10-03T10:13:12.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.213+0000 7f0f4ffff700 1 -- 172.21.15.146:0/66274036 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0f5c03fb80 con 0x7f0f681309f0 2023-10-03T10:13:12.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.217+0000 7f0f4ffff700 1 -- 172.21.15.146:0/66274036 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f5c01adc0 con 0x7f0f681309f0 2023-10-03T10:13:12.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.218+0000 7fa4dc0c9700 1 -- 172.21.15.146:0/725241205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa4d409f660 con 0x7fa4d4131d70 2023-10-03T10:13:12.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.219+0000 7fa4ca7fc700 1 -- 172.21.15.146:0/725241205 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa4cc012340 con 0x7fa4d4131d70 2023-10-03T10:13:12.219 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:12.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.221+0000 7fa4dc0c9700 1 -- 172.21.15.146:0/725241205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4d4131d70 msgr2=0x7fa4d406c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.221+0000 7fa4dc0c9700 1 --2- 172.21.15.146:0/725241205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4d4131d70 0x7fa4d406c300 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00efc0 tx=0x7fa4cc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.221+0000 7fa4dc0c9700 1 -- 172.21.15.146:0/725241205 shutdown_connections 2023-10-03T10:13:12.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.221+0000 7fa4dc0c9700 1 --2- 172.21.15.146:0/725241205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4d4131d70 0x7fa4d406c300 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.221+0000 7fa4dc0c9700 1 --2- 172.21.15.146:0/725241205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4d409e870 0x7fa4d406b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.221+0000 7fa4dc0c9700 1 --2- 172.21.15.146:0/725241205 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4d409f180 0x7fa4d406bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.221+0000 7fa4dc0c9700 1 -- 172.21.15.146:0/725241205 >> 172.21.15.146:0/725241205 conn(0x7fa4d40a4430 msgr2=0x7fa4d409cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:12.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.221+0000 7fa4dc0c9700 1 -- 172.21.15.146:0/725241205 shutdown_connections 2023-10-03T10:13:12.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.221+0000 7fa4dc0c9700 1 -- 172.21.15.146:0/725241205 wait complete. 2023-10-03T10:13:12.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:12.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.255+0000 7f9c99d06700 1 -- 172.21.15.146:0/2980674169 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9c9404f2a0 con 0x7f9c9409f180 2023-10-03T10:13:12.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.256+0000 7f9c8bfff700 1 -- 172.21.15.146:0/2980674169 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9c7c029030 con 0x7f9c9409f180 2023-10-03T10:13:12.256 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:12.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.259+0000 7f9c99d06700 1 -- 172.21.15.146:0/2980674169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c9409f180 msgr2=0x7f9c9406c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.259+0000 7f9c99d06700 1 --2- 172.21.15.146:0/2980674169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c9409f180 0x7f9c9406c850 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009c40 tx=0x7f9c7c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:12.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.259+0000 7f9c99d06700 1 -- 172.21.15.146:0/2980674169 shutdown_connections 2023-10-03T10:13:12.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.259+0000 7f9c99d06700 1 --2- 172.21.15.146:0/2980674169 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c94131d70 0x7f9c941c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.259+0000 7f9c99d06700 1 --2- 172.21.15.146:0/2980674169 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c9409e870 0x7f9c9406c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.259+0000 7f9c99d06700 1 --2- 172.21.15.146:0/2980674169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c9409f180 0x7f9c9406c850 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.259+0000 7f9c99d06700 1 -- 172.21.15.146:0/2980674169 >> 172.21.15.146:0/2980674169 conn(0x7f9c940a4430 msgr2=0x7f9c941b9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:12.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.259+0000 7f9c99d06700 1 -- 172.21.15.146:0/2980674169 shutdown_connections 2023-10-03T10:13:12.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.259+0000 7f9c99d06700 1 -- 172.21.15.146:0/2980674169 wait complete. 2023-10-03T10:13:12.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:12.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.382+0000 7efca6a25700 1 -- 172.21.15.146:0/261191236 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efc80005590 con 0x7efca0130eb0 2023-10-03T10:13:12.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.383+0000 7efc9cff9700 1 -- 172.21.15.146:0/261191236 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc9801c3b0 con 0x7efca0130eb0 2023-10-03T10:13:12.384 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:12.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.385+0000 7efca6a25700 1 -- 172.21.15.146:0/261191236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efca0130eb0 msgr2=0x7efca011ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.385+0000 7efca6a25700 1 --2- 172.21.15.146:0/261191236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efca0130eb0 0x7efca011ee40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7efc9800efc0 tx=0x7efc9800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.385+0000 7efca6a25700 1 -- 172.21.15.146:0/261191236 shutdown_connections 2023-10-03T10:13:12.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.385+0000 7efca6a25700 1 --2- 172.21.15.146:0/261191236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efca0130eb0 0x7efca011ee40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.385+0000 7efca6a25700 1 --2- 172.21.15.146:0/261191236 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efca009d860 0x7efca011e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.385+0000 7efca6a25700 1 --2- 172.21.15.146:0/261191236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efca009e170 0x7efca011e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.385+0000 7efca6a25700 1 -- 172.21.15.146:0/261191236 >> 172.21.15.146:0/261191236 conn(0x7efca0099c40 msgr2=0x7efca00a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:12.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.385+0000 7efca6a25700 1 -- 172.21.15.146:0/261191236 shutdown_connections 2023-10-03T10:13:12.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.385+0000 7efca6a25700 1 -- 172.21.15.146:0/261191236 wait complete. 2023-10-03T10:13:12.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:12.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.413+0000 7f0f6dcac700 1 -- 172.21.15.146:0/66274036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0f6806c3b0 con 0x7f0f681309f0 2023-10-03T10:13:12.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.414+0000 7f0f4ffff700 1 -- 172.21.15.146:0/66274036 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f5c017030 con 0x7f0f681309f0 2023-10-03T10:13:12.415 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:12.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.416+0000 7f0f6dcac700 1 -- 172.21.15.146:0/66274036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f681309f0 msgr2=0x7f0f6811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.416+0000 7f0f6dcac700 1 --2- 172.21.15.146:0/66274036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f681309f0 0x7f0f6811df80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00e9e0 tx=0x7f0f5c00ecf0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.416+0000 7f0f6dcac700 1 -- 172.21.15.146:0/66274036 shutdown_connections 2023-10-03T10:13:12.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.416+0000 7f0f6dcac700 1 --2- 172.21.15.146:0/66274036 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f68133ad0 0x7f0f6811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.416+0000 7f0f6dcac700 1 --2- 172.21.15.146:0/66274036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f681300a0 0x7f0f6811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.416+0000 7f0f6dcac700 1 --2- 172.21.15.146:0/66274036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f681309f0 0x7f0f6811df80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.416+0000 7f0f6dcac700 1 -- 172.21.15.146:0/66274036 >> 172.21.15.146:0/66274036 conn(0x7f0f68099c40 msgr2=0x7f0f681320f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:12.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.416+0000 7f0f6dcac700 1 -- 172.21.15.146:0/66274036 shutdown_connections 2023-10-03T10:13:12.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:12.416+0000 7f0f6dcac700 1 -- 172.21.15.146:0/66274036 wait complete. 2023-10-03T10:13:12.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:13.235 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:13.277 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:13.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.367+0000 7ff9a698a700 1 Processor -- start 2023-10-03T10:13:13.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.367+0000 7ff9a698a700 1 -- start start 2023-10-03T10:13:13.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.368+0000 7ff9a698a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9a009ef80 0x7ff9a0138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.368+0000 7ff9a698a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff9a009f370 0x7ff9a013b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.368+0000 7ff9a698a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a009af80 con 0x7ff9a009a150 2023-10-03T10:13:13.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.368+0000 7ff9a698a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a009fe00 con 0x7ff9a009f370 2023-10-03T10:13:13.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.368+0000 7ff9a698a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a006bec0 con 0x7ff9a009ef80 2023-10-03T10:13:13.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.368+0000 7ff99f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9a009ef80 0x7ff9a0138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.368+0000 7ff99ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff9a009a150 0x7ff9a009e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55320/0 (socket says 172.21.15.146:55320) 2023-10-03T10:13:13.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.368+0000 7ff99ffff700 1 -- 172.21.15.146:0/1539276117 learned_addr learned my addr 172.21.15.146:0/1539276117 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:13.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.368+0000 7ff9a4f27700 1 --2- 172.21.15.146:0/1539276117 >> v2:172.21.15.146:3300/0 conn(0x7ff9a009f370 0x7ff9a013b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.368+0000 7ff99effd700 1 -- 172.21.15.146:0/1539276117 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1391049693 0 0) 0x7ff9a009af80 con 0x7ff9a009a150 2023-10-03T10:13:13.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.368+0000 7ff99effd700 1 -- 172.21.15.146:0/1539276117 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9880035b0 con 0x7ff9a009a150 2023-10-03T10:13:13.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.368+0000 7ff99f7fe700 1 -- 172.21.15.146:0/1539276117 >> v2:172.21.15.146:3300/0 conn(0x7ff9a009f370 msgr2=0x7ff9a013b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:13.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.368+0000 7ff99f7fe700 1 --2- 172.21.15.146:0/1539276117 >> v2:172.21.15.146:3300/0 conn(0x7ff9a009f370 0x7ff9a013b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.368+0000 7ff99f7fe700 1 -- 172.21.15.146:0/1539276117 >> v1:172.21.15.146:6789/0 conn(0x7ff9a009a150 legacy=0x7ff9a009e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.368+0000 7ff99f7fe700 1 -- 172.21.15.146:0/1539276117 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a006bc20 con 0x7ff9a009ef80 2023-10-03T10:13:13.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.368+0000 7ff9a4f27700 1 --2- 172.21.15.146:0/1539276117 >> v2:172.21.15.146:3300/0 conn(0x7ff9a009f370 0x7ff9a013b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:13.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.369+0000 7ff99f7fe700 1 --2- 172.21.15.146:0/1539276117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9a009ef80 0x7ff9a0138e60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff994009840 tx=0x7ff994009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c818887865139bf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:13.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.369+0000 7ff99effd700 1 -- 172.21.15.146:0/1539276117 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994011830 con 0x7ff9a009ef80 2023-10-03T10:13:13.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.369+0000 7ff99effd700 1 -- 172.21.15.146:0/1539276117 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff994011990 con 0x7ff9a009ef80 2023-10-03T10:13:13.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.369+0000 7ff99effd700 1 -- 172.21.15.146:0/1539276117 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994011d20 con 0x7ff9a009ef80 2023-10-03T10:13:13.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.369+0000 7ff9a698a700 1 -- 172.21.15.146:0/1539276117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9a009ef80 msgr2=0x7ff9a0138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.369+0000 7ff9a698a700 1 --2- 172.21.15.146:0/1539276117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9a009ef80 0x7ff9a0138e60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff994009840 tx=0x7ff994009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:13.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.369+0000 7ff9a698a700 1 -- 172.21.15.146:0/1539276117 shutdown_connections 2023-10-03T10:13:13.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.369+0000 7ff9a698a700 1 --2- 172.21.15.146:0/1539276117 >> v2:172.21.15.146:3300/0 conn(0x7ff9a009f370 0x7ff9a013b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.369+0000 7ff9a698a700 1 --2- 172.21.15.146:0/1539276117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9a009ef80 0x7ff9a0138e60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.369+0000 7ff9a698a700 1 -- 172.21.15.146:0/1539276117 >> 172.21.15.146:0/1539276117 conn(0x7ff9a00a4430 msgr2=0x7ff9a00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.369+0000 7ff9a698a700 1 -- 172.21.15.146:0/1539276117 shutdown_connections 2023-10-03T10:13:13.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.369+0000 7ff9a698a700 1 -- 172.21.15.146:0/1539276117 wait complete. 2023-10-03T10:13:13.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.371+0000 7ff9a698a700 1 Processor -- start 2023-10-03T10:13:13.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.371+0000 7ff9a698a700 1 -- start start 2023-10-03T10:13:13.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.371+0000 7ff9a698a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9a009a150 0x7ff9a0139380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.371+0000 7ff9a698a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9a009ef80 0x7ff9a01398c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.371+0000 7ff9a698a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9a009f370 0x7ff9a0139e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.371+0000 7ff9a698a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a013a850 con 0x7ff9a009f370 2023-10-03T10:13:13.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.371+0000 7ff9a698a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a011fb50 con 0x7ff9a009a150 2023-10-03T10:13:13.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.371+0000 7ff9a698a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a013b010 con 0x7ff9a009ef80 2023-10-03T10:13:13.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.371+0000 7ff9a4f27700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9a009f370 0x7ff9a0139e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.372+0000 7ff99ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9a009a150 0x7ff9a0139380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.372+0000 7ff9a4f27700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9a009f370 0x7ff9a0139e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42028/0 (socket says 172.21.15.146:42028) 2023-10-03T10:13:13.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.372+0000 7ff9a4f27700 1 -- 172.21.15.146:0/3863908771 learned_addr learned my addr 172.21.15.146:0/3863908771 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:13.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.372+0000 7ff99ffff700 1 --2- 172.21.15.146:0/3863908771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9a009a150 0x7ff9a0139380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:47548/0 (socket says 172.21.15.146:47548) 2023-10-03T10:13:13.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.372+0000 7ff99f7fe700 1 --2- 172.21.15.146:0/3863908771 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9a009ef80 0x7ff9a01398c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.372+0000 7ff9a4f27700 1 -- 172.21.15.146:0/3863908771 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9a009ef80 msgr2=0x7ff9a01398c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.372+0000 7ff9a4f27700 1 --2- 172.21.15.146:0/3863908771 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9a009ef80 0x7ff9a01398c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.372+0000 7ff9a4f27700 1 -- 172.21.15.146:0/3863908771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9a009a150 msgr2=0x7ff9a0139380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.372+0000 7ff9a4f27700 1 --2- 172.21.15.146:0/3863908771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9a009a150 0x7ff9a0139380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.372+0000 7ff9a4f27700 1 -- 172.21.15.146:0/3863908771 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff998009a70 con 0x7ff9a009f370 2023-10-03T10:13:13.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.372+0000 7ff99ffff700 1 --2- 172.21.15.146:0/3863908771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9a009a150 0x7ff9a0139380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:13.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.372+0000 7ff9a4f27700 1 --2- 172.21.15.146:0/3863908771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9a009f370 0x7ff9a0139e00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff99800efc0 tx=0x7ff99800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:13.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.372+0000 7ff99cff9700 1 -- 172.21.15.146:0/3863908771 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99800ca90 con 0x7ff9a009f370 2023-10-03T10:13:13.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.372+0000 7ff99cff9700 1 -- 172.21.15.146:0/3863908771 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99800f040 con 0x7ff9a009f370 2023-10-03T10:13:13.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.372+0000 7ff9a698a700 1 -- 172.21.15.146:0/3863908771 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9940094a0 con 0x7ff9a009f370 2023-10-03T10:13:13.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.372+0000 7ff99cff9700 1 -- 172.21.15.146:0/3863908771 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99800ce10 con 0x7ff9a009f370 2023-10-03T10:13:13.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.372+0000 7ff9a698a700 1 -- 172.21.15.146:0/3863908771 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a00a0490 con 0x7ff9a009f370 2023-10-03T10:13:13.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.373+0000 7ff99cff9700 1 -- 172.21.15.146:0/3863908771 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff998014480 con 0x7ff9a009f370 2023-10-03T10:13:13.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.373+0000 7ff99cff9700 1 -- 172.21.15.146:0/3863908771 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff99803fcb0 con 0x7ff9a009f370 2023-10-03T10:13:13.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.373+0000 7ff9a698a700 1 -- 172.21.15.146:0/3863908771 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a009fa30 con 0x7ff9a009f370 2023-10-03T10:13:13.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.378+0000 7ff99cff9700 1 -- 172.21.15.146:0/3863908771 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff998012930 con 0x7ff9a009f370 2023-10-03T10:13:13.398 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:13.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.406+0000 7fb8abe76700 1 Processor -- start 2023-10-03T10:13:13.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.406+0000 7fb8abe76700 1 -- start start 2023-10-03T10:13:13.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.407+0000 7fb8abe76700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8a4133ad0 0x7fb8a4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.407+0000 7fb8abe76700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a41300a0 0x7fb8a41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.407+0000 7fb8abe76700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a406b2d0 con 0x7fb8a41309f0 2023-10-03T10:13:13.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.407+0000 7fb8abe76700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a4133610 con 0x7fb8a4133ad0 2023-10-03T10:13:13.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.407+0000 7fb8abe76700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a409a500 con 0x7fb8a41300a0 2023-10-03T10:13:13.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.407+0000 7fb8a9411700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a41300a0 0x7fb8a41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.407+0000 7fb8a9411700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a41300a0 0x7fb8a41304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:47560/0 (socket says 172.21.15.146:47560) 2023-10-03T10:13:13.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.407+0000 7fb8a9411700 1 -- 172.21.15.146:0/2119242630 learned_addr learned my addr 172.21.15.146:0/2119242630 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:13.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.407+0000 7fb8a9c12700 1 --2- 172.21.15.146:0/2119242630 >> v2:172.21.15.146:3300/0 conn(0x7fb8a4133ad0 0x7fb8a4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.407+0000 7fb8a9411700 1 -- 172.21.15.146:0/2119242630 >> v2:172.21.15.146:3300/0 conn(0x7fb8a4133ad0 msgr2=0x7fb8a4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:13.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.407+0000 7fb8a9411700 1 --2- 172.21.15.146:0/2119242630 >> v2:172.21.15.146:3300/0 conn(0x7fb8a4133ad0 0x7fb8a4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.407+0000 7fb8a9411700 1 -- 172.21.15.146:0/2119242630 >> v1:172.21.15.146:6789/0 conn(0x7fb8a41309f0 legacy=0x7fb8a413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.407+0000 7fb8a9411700 1 -- 172.21.15.146:0/2119242630 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a41338b0 con 0x7fb8a41300a0 2023-10-03T10:13:13.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.407+0000 7fb8a9411700 1 --2- 172.21.15.146:0/2119242630 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a41300a0 0x7fb8a41304b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb8940098f0 tx=0x7fb894009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8788332fdfcd6bf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:13.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.407+0000 7fb8a8c10700 1 -- 172.21.15.146:0/2119242630 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894011830 con 0x7fb8a41300a0 2023-10-03T10:13:13.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.407+0000 7fb8a8c10700 1 -- 172.21.15.146:0/2119242630 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb894011990 con 0x7fb8a41300a0 2023-10-03T10:13:13.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.408+0000 7fb8a8c10700 1 -- 172.21.15.146:0/2119242630 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894011d20 con 0x7fb8a41300a0 2023-10-03T10:13:13.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.408+0000 7fb8abe76700 1 -- 172.21.15.146:0/2119242630 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a41300a0 msgr2=0x7fb8a41304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.408+0000 7fb8abe76700 1 --2- 172.21.15.146:0/2119242630 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a41300a0 0x7fb8a41304b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb8940098f0 tx=0x7fb894009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:13.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.408+0000 7fb8abe76700 1 -- 172.21.15.146:0/2119242630 shutdown_connections 2023-10-03T10:13:13.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.408+0000 7fb8abe76700 1 --2- 172.21.15.146:0/2119242630 >> v2:172.21.15.146:3300/0 conn(0x7fb8a4133ad0 0x7fb8a4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.408+0000 7fb8abe76700 1 --2- 172.21.15.146:0/2119242630 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a41300a0 0x7fb8a41304b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.408+0000 7fb8abe76700 1 -- 172.21.15.146:0/2119242630 >> 172.21.15.146:0/2119242630 conn(0x7fb8a4099c40 msgr2=0x7fb8a40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.408+0000 7fb8abe76700 1 -- 172.21.15.146:0/2119242630 shutdown_connections 2023-10-03T10:13:13.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.408+0000 7fb8abe76700 1 -- 172.21.15.146:0/2119242630 wait complete. 2023-10-03T10:13:13.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.409+0000 7fb8abe76700 1 Processor -- start 2023-10-03T10:13:13.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.409+0000 7fb8abe76700 1 -- start start 2023-10-03T10:13:13.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.410+0000 7fb8abe76700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8a41300a0 0x7fb8a411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.410+0000 7fb8abe76700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8a41309f0 0x7fb8a411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.410+0000 7fb8abe76700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a4133ad0 0x7fb8a411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.410+0000 7fb8abe76700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a411f5b0 con 0x7fb8a41309f0 2023-10-03T10:13:13.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.410+0000 7fb8abe76700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a412fcc0 con 0x7fb8a4133ad0 2023-10-03T10:13:13.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.410+0000 7fb8abe76700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a412dd00 con 0x7fb8a41300a0 2023-10-03T10:13:13.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.410+0000 7fb8a9411700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8a41309f0 0x7fb8a411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.410+0000 7fb8a9411700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8a41309f0 0x7fb8a411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42044/0 (socket says 172.21.15.146:42044) 2023-10-03T10:13:13.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.410+0000 7fb8a9411700 1 -- 172.21.15.146:0/858330600 learned_addr learned my addr 172.21.15.146:0/858330600 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:13.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.410+0000 7fb8a9c12700 1 --2- 172.21.15.146:0/858330600 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8a41300a0 0x7fb8a411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.410+0000 7fb8aa413700 1 --2- 172.21.15.146:0/858330600 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a4133ad0 0x7fb8a411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.410+0000 7fb8a9411700 1 -- 172.21.15.146:0/858330600 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8a41300a0 msgr2=0x7fb8a411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.410+0000 7fb8a9411700 1 --2- 172.21.15.146:0/858330600 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8a41300a0 0x7fb8a411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.410+0000 7fb8a9411700 1 -- 172.21.15.146:0/858330600 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a4133ad0 msgr2=0x7fb8a411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.410+0000 7fb8a9411700 1 --2- 172.21.15.146:0/858330600 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a4133ad0 0x7fb8a411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.410+0000 7fb8a9411700 1 -- 172.21.15.146:0/858330600 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb894009550 con 0x7fb8a41309f0 2023-10-03T10:13:13.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.410+0000 7fb8aa413700 1 --2- 172.21.15.146:0/858330600 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a4133ad0 0x7fb8a411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:13.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.410+0000 7fb8a9411700 1 --2- 172.21.15.146:0/858330600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8a41309f0 0x7fb8a411df80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb894009c40 tx=0x7fb894004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:13.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.410+0000 7fb89a7fc700 1 -- 172.21.15.146:0/858330600 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894004590 con 0x7fb8a41309f0 2023-10-03T10:13:13.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.410+0000 7fb89a7fc700 1 -- 172.21.15.146:0/858330600 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb894026070 con 0x7fb8a41309f0 2023-10-03T10:13:13.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.410+0000 7fb89a7fc700 1 -- 172.21.15.146:0/858330600 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8940038e0 con 0x7fb8a41309f0 2023-10-03T10:13:13.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.411+0000 7fb8abe76700 1 -- 172.21.15.146:0/858330600 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a411fbf0 con 0x7fb8a41309f0 2023-10-03T10:13:13.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.411+0000 7fb8abe76700 1 -- 172.21.15.146:0/858330600 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a411feb0 con 0x7fb8a41309f0 2023-10-03T10:13:13.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.412+0000 7fb89a7fc700 1 -- 172.21.15.146:0/858330600 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb894003a40 con 0x7fb8a41309f0 2023-10-03T10:13:13.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.412+0000 7fb89a7fc700 1 -- 172.21.15.146:0/858330600 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb894049310 con 0x7fb8a41309f0 2023-10-03T10:13:13.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.412+0000 7fb8abe76700 1 -- 172.21.15.146:0/858330600 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a4072720 con 0x7fb8a41309f0 2023-10-03T10:13:13.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.417+0000 7fb89a7fc700 1 -- 172.21.15.146:0/858330600 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb894003cf0 con 0x7fb8a41309f0 2023-10-03T10:13:13.430 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:13.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.533+0000 7f5f168a6700 1 Processor -- start 2023-10-03T10:13:13.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.533+0000 7f5f168a6700 1 -- start start 2023-10-03T10:13:13.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.534+0000 7f5f168a6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f1009ef80 0x7f5f10138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.534+0000 7f5f168a6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5f1009f370 0x7f5f1013b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.534+0000 7f5f168a6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f1009af80 con 0x7f5f1009a150 2023-10-03T10:13:13.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.534+0000 7f5f168a6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f1009fe00 con 0x7f5f1009f370 2023-10-03T10:13:13.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.534+0000 7f5f168a6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1006bec0 con 0x7f5f1009ef80 2023-10-03T10:13:13.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.534+0000 7f5f14e43700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5f1009f370 0x7f5f1013b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.534+0000 7f5f0f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f1009ef80 0x7f5f10138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.534+0000 7f5f14e43700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5f1009f370 0x7f5f1013b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42048/0 (socket says 172.21.15.146:42048) 2023-10-03T10:13:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.534+0000 7f5f14e43700 1 -- 172.21.15.146:0/380262197 learned_addr learned my addr 172.21.15.146:0/380262197 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.534+0000 7f5f0f7fe700 1 -- 172.21.15.146:0/380262197 >> v2:172.21.15.146:3300/0 conn(0x7f5f1009f370 msgr2=0x7f5f1013b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.534+0000 7f5f0f7fe700 1 --2- 172.21.15.146:0/380262197 >> v2:172.21.15.146:3300/0 conn(0x7f5f1009f370 0x7f5f1013b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.534+0000 7f5f0f7fe700 1 -- 172.21.15.146:0/380262197 >> v1:172.21.15.146:6789/0 conn(0x7f5f1009a150 legacy=0x7f5f1009e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.534+0000 7f5f0effd700 1 -- 172.21.15.146:0/380262197 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609965627 0 0) 0x7f5f1009af80 con 0x7f5f1009a150 2023-10-03T10:13:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.534+0000 7f5f0f7fe700 1 -- 172.21.15.146:0/380262197 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1006bc20 con 0x7f5f1009ef80 2023-10-03T10:13:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.534+0000 7f5f14e43700 1 --2- 172.21.15.146:0/380262197 >> v2:172.21.15.146:3300/0 conn(0x7f5f1009f370 0x7f5f1013b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.535+0000 7f5f0f7fe700 1 --2- 172.21.15.146:0/380262197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f1009ef80 0x7f5f10138e60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5f04013150 tx=0x7f5f04013460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7affb44de72fcef5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.535+0000 7f5f0effd700 1 -- 172.21.15.146:0/380262197 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f04016070 con 0x7f5f1009ef80 2023-10-03T10:13:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.535+0000 7f5f0effd700 1 -- 172.21.15.146:0/380262197 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f04013d10 con 0x7f5f1009ef80 2023-10-03T10:13:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.535+0000 7f5f0effd700 1 -- 172.21.15.146:0/380262197 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f040112f0 con 0x7f5f1009ef80 2023-10-03T10:13:13.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.536+0000 7f5f168a6700 1 -- 172.21.15.146:0/380262197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f1009ef80 msgr2=0x7f5f10138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.536+0000 7f5f168a6700 1 --2- 172.21.15.146:0/380262197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f1009ef80 0x7f5f10138e60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5f04013150 tx=0x7f5f04013460 comp rx=0 tx=0).stop 2023-10-03T10:13:13.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.536+0000 7f5f168a6700 1 -- 172.21.15.146:0/380262197 shutdown_connections 2023-10-03T10:13:13.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.536+0000 7f5f168a6700 1 --2- 172.21.15.146:0/380262197 >> v2:172.21.15.146:3300/0 conn(0x7f5f1009f370 0x7f5f1013b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.536+0000 7f5f168a6700 1 --2- 172.21.15.146:0/380262197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f1009ef80 0x7f5f10138e60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.536+0000 7f5f168a6700 1 -- 172.21.15.146:0/380262197 >> 172.21.15.146:0/380262197 conn(0x7f5f100a4430 msgr2=0x7f5f100a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.536+0000 7f5f168a6700 1 -- 172.21.15.146:0/380262197 shutdown_connections 2023-10-03T10:13:13.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.536+0000 7f5f168a6700 1 -- 172.21.15.146:0/380262197 wait complete. 2023-10-03T10:13:13.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.537+0000 7f5f168a6700 1 Processor -- start 2023-10-03T10:13:13.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.537+0000 7f5f168a6700 1 -- start start 2023-10-03T10:13:13.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.538+0000 7f5f168a6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f1009a150 0x7f5f101b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.538+0000 7f5f168a6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f1009ef80 0x7f5f101b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.538+0000 7f5f168a6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f1009f370 0x7f5f101c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.538+0000 7f5f168a6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f101a5790 con 0x7f5f1009ef80 2023-10-03T10:13:13.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.538+0000 7f5f168a6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f101b8470 con 0x7f5f1009f370 2023-10-03T10:13:13.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.538+0000 7f5f168a6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f101a7780 con 0x7f5f1009a150 2023-10-03T10:13:13.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.538+0000 7f5f0ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f1009a150 0x7f5f101b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.538+0000 7f5f0ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f1009a150 0x7f5f101b79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:33376/0 (socket says 172.21.15.146:33376) 2023-10-03T10:13:13.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.538+0000 7f5f0ffff700 1 -- 172.21.15.146:0/2276132983 learned_addr learned my addr 172.21.15.146:0/2276132983 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:13.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.538+0000 7f5f0f7fe700 1 --2- 172.21.15.146:0/2276132983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f1009ef80 0x7f5f101b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.538+0000 7f5f14e43700 1 --2- 172.21.15.146:0/2276132983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f1009f370 0x7f5f101c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.539+0000 7f5f0f7fe700 1 -- 172.21.15.146:0/2276132983 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f1009a150 msgr2=0x7f5f101b79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.539+0000 7f5f0f7fe700 1 --2- 172.21.15.146:0/2276132983 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f1009a150 0x7f5f101b79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.539+0000 7f5f0f7fe700 1 -- 172.21.15.146:0/2276132983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f1009f370 msgr2=0x7f5f101c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.539+0000 7f5f0f7fe700 1 --2- 172.21.15.146:0/2276132983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f1009f370 0x7f5f101c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.539+0000 7f5f0f7fe700 1 -- 172.21.15.146:0/2276132983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f08009b30 con 0x7f5f1009ef80 2023-10-03T10:13:13.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.539+0000 7f5f0f7fe700 1 --2- 172.21.15.146:0/2276132983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f1009ef80 0x7f5f101b7f30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5f0401d000 tx=0x7f5f04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:13.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.539+0000 7f5f0cff9700 1 -- 172.21.15.146:0/2276132983 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0400fa50 con 0x7f5f1009ef80 2023-10-03T10:13:13.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.539+0000 7f5f0cff9700 1 -- 172.21.15.146:0/2276132983 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0400fbb0 con 0x7f5f1009ef80 2023-10-03T10:13:13.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.539+0000 7f5f168a6700 1 -- 172.21.15.146:0/2276132983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f04011d40 con 0x7f5f1009ef80 2023-10-03T10:13:13.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.539+0000 7f5f0cff9700 1 -- 172.21.15.146:0/2276132983 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f040036a0 con 0x7f5f1009ef80 2023-10-03T10:13:13.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.539+0000 7f5f168a6700 1 -- 172.21.15.146:0/2276132983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f100a0440 con 0x7f5f1009ef80 2023-10-03T10:13:13.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.540+0000 7f5f0cff9700 1 -- 172.21.15.146:0/2276132983 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f04003800 con 0x7f5f1009ef80 2023-10-03T10:13:13.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.540+0000 7f5f0cff9700 1 -- 172.21.15.146:0/2276132983 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5f04049110 con 0x7f5f1009ef80 2023-10-03T10:13:13.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.540+0000 7f5f168a6700 1 -- 172.21.15.146:0/2276132983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1009fa30 con 0x7f5f1009ef80 2023-10-03T10:13:13.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.545+0000 7f5f0cff9700 1 -- 172.21.15.146:0/2276132983 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f04024440 con 0x7f5f1009ef80 2023-10-03T10:13:13.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.572+0000 7f80a7d4c700 1 Processor -- start 2023-10-03T10:13:13.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.572+0000 7f80a7d4c700 1 -- start start 2023-10-03T10:13:13.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.573+0000 7f80a7d4c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f80a009e340 0x7f80a01359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.573+0000 7f80a7d4c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80a0135f20 0x7f80a0138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.573+0000 7f80a7d4c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a009aaa0 con 0x7f80a009d860 2023-10-03T10:13:13.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.573+0000 7f80a7d4c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a009e730 con 0x7f80a009e340 2023-10-03T10:13:13.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.573+0000 7f80a7d4c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80a009f870 con 0x7f80a0135f20 2023-10-03T10:13:13.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.573+0000 7f80a52e7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f80a009e340 0x7f80a01359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.573+0000 7f80a52e7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f80a009e340 0x7f80a01359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42062/0 (socket says 172.21.15.146:42062) 2023-10-03T10:13:13.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.573+0000 7f80a5ae8700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f80a009d860 0x7f80a009dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55350/0 (socket says 172.21.15.146:55350) 2023-10-03T10:13:13.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.573+0000 7f80a52e7700 1 -- 172.21.15.146:0/2179022430 learned_addr learned my addr 172.21.15.146:0/2179022430 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:13.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.573+0000 7f80a62e9700 1 --2- 172.21.15.146:0/2179022430 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80a0135f20 0x7f80a0138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.574+0000 7f80a52e7700 1 -- 172.21.15.146:0/2179022430 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80a0135f20 msgr2=0x7f80a0138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:13.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.574+0000 7f80a52e7700 1 --2- 172.21.15.146:0/2179022430 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80a0135f20 0x7f80a0138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.574+0000 7f80a52e7700 1 -- 172.21.15.146:0/2179022430 >> v1:172.21.15.146:6789/0 conn(0x7f80a009d860 legacy=0x7f80a009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:13.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.574+0000 7f80a52e7700 1 -- 172.21.15.146:0/2179022430 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a009b360 con 0x7f80a009e340 2023-10-03T10:13:13.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.574+0000 7f80a52e7700 1 --2- 172.21.15.146:0/2179022430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80a009e340 0x7f80a01359e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f80900098f0 tx=0x7f8090009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d363eab5bc0063ef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:13.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.574+0000 7f80a4ae6700 1 -- 172.21.15.146:0/2179022430 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090011830 con 0x7f80a009e340 2023-10-03T10:13:13.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.574+0000 7f80a4ae6700 1 -- 172.21.15.146:0/2179022430 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8090011990 con 0x7f80a009e340 2023-10-03T10:13:13.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.574+0000 7f80a4ae6700 1 -- 172.21.15.146:0/2179022430 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090011d00 con 0x7f80a009e340 2023-10-03T10:13:13.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.575+0000 7f80a7d4c700 1 -- 172.21.15.146:0/2179022430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80a009e340 msgr2=0x7f80a01359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.575+0000 7f80a7d4c700 1 --2- 172.21.15.146:0/2179022430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80a009e340 0x7f80a01359e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f80900098f0 tx=0x7f8090009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:13.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.575+0000 7f80a7d4c700 1 -- 172.21.15.146:0/2179022430 shutdown_connections 2023-10-03T10:13:13.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.575+0000 7f80a7d4c700 1 --2- 172.21.15.146:0/2179022430 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80a0135f20 0x7f80a0138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.575+0000 7f80a7d4c700 1 --2- 172.21.15.146:0/2179022430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80a009e340 0x7f80a01359e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.575+0000 7f80a7d4c700 1 -- 172.21.15.146:0/2179022430 >> 172.21.15.146:0/2179022430 conn(0x7f80a0099c40 msgr2=0x7f80a00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.575+0000 7f80a7d4c700 1 -- 172.21.15.146:0/2179022430 shutdown_connections 2023-10-03T10:13:13.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.575+0000 7f80a7d4c700 1 -- 172.21.15.146:0/2179022430 wait complete. 2023-10-03T10:13:13.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.576+0000 7f80a7d4c700 1 Processor -- start 2023-10-03T10:13:13.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.576+0000 7f80a7d4c700 1 -- start start 2023-10-03T10:13:13.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.577+0000 7f80a7d4c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80a009d860 0x7f80a0139880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.577+0000 7f80a7d4c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80a009e340 0x7f80a0139dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.577+0000 7f80a7d4c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80a0135f20 0x7f80a013a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.577+0000 7f80a7d4c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a0135c80 con 0x7f80a009e340 2023-10-03T10:13:13.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.577+0000 7f80a7d4c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a01206a0 con 0x7f80a009d860 2023-10-03T10:13:13.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.577+0000 7f80a7d4c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80a011fcb0 con 0x7f80a0135f20 2023-10-03T10:13:13.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.577+0000 7f80a5ae8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80a009d860 0x7f80a0139880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.577+0000 7f80a52e7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80a009e340 0x7f80a0139dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.577+0000 7f80a5ae8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80a009d860 0x7f80a0139880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:47602/0 (socket says 172.21.15.146:47602) 2023-10-03T10:13:13.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.577+0000 7f80a5ae8700 1 -- 172.21.15.146:0/4249216653 learned_addr learned my addr 172.21.15.146:0/4249216653 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:13.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.577+0000 7f80a62e9700 1 --2- 172.21.15.146:0/4249216653 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80a0135f20 0x7f80a013a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.577+0000 7f80a52e7700 1 -- 172.21.15.146:0/4249216653 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80a0135f20 msgr2=0x7f80a013a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.577+0000 7f80a52e7700 1 --2- 172.21.15.146:0/4249216653 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80a0135f20 0x7f80a013a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.577+0000 7f80a52e7700 1 -- 172.21.15.146:0/4249216653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80a009d860 msgr2=0x7f80a0139880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.577+0000 7f80a52e7700 1 --2- 172.21.15.146:0/4249216653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80a009d860 0x7f80a0139880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.577+0000 7f80a52e7700 1 -- 172.21.15.146:0/4249216653 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8090009550 con 0x7f80a009e340 2023-10-03T10:13:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.578+0000 7f80a52e7700 1 --2- 172.21.15.146:0/4249216653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80a009e340 0x7f80a0139dc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f80a009ee50 tx=0x7f8090004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.578+0000 7f80967fc700 1 -- 172.21.15.146:0/4249216653 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090004510 con 0x7f80a009e340 2023-10-03T10:13:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.578+0000 7f80967fc700 1 -- 172.21.15.146:0/4249216653 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80900036a0 con 0x7f80a009e340 2023-10-03T10:13:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.578+0000 7f80967fc700 1 -- 172.21.15.146:0/4249216653 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090003a10 con 0x7f80a009e340 2023-10-03T10:13:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.578+0000 7f80a7d4c700 1 -- 172.21.15.146:0/4249216653 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a0121080 con 0x7f80a009e340 2023-10-03T10:13:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.578+0000 7f80a7d4c700 1 -- 172.21.15.146:0/4249216653 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a00a28d0 con 0x7f80a009e340 2023-10-03T10:13:13.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.579+0000 7f80a7d4c700 1 -- 172.21.15.146:0/4249216653 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a009c910 con 0x7f80a009e340 2023-10-03T10:13:13.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.579+0000 7f80967fc700 1 -- 172.21.15.146:0/4249216653 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8090003b70 con 0x7f80a009e340 2023-10-03T10:13:13.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.580+0000 7f80967fc700 1 -- 172.21.15.146:0/4249216653 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8090021030 con 0x7f80a009e340 2023-10-03T10:13:13.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.584+0000 7f80967fc700 1 -- 172.21.15.146:0/4249216653 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f809001a430 con 0x7f80a009e340 2023-10-03T10:13:13.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.601+0000 7ff9a698a700 1 -- 172.21.15.146:0/3863908771 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff9a011eba0 con 0x7ff9a009f370 2023-10-03T10:13:13.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.602+0000 7ff99cff9700 1 -- 172.21.15.146:0/3863908771 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff998012340 con 0x7ff9a009f370 2023-10-03T10:13:13.603 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:13.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.605+0000 7ff9a698a700 1 -- 172.21.15.146:0/3863908771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9a009f370 msgr2=0x7ff9a0139e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.605+0000 7ff9a698a700 1 --2- 172.21.15.146:0/3863908771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9a009f370 0x7ff9a0139e00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff99800efc0 tx=0x7ff99800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.605+0000 7ff9a698a700 1 -- 172.21.15.146:0/3863908771 shutdown_connections 2023-10-03T10:13:13.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.605+0000 7ff9a698a700 1 --2- 172.21.15.146:0/3863908771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9a009f370 0x7ff9a0139e00 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.605+0000 7ff9a698a700 1 --2- 172.21.15.146:0/3863908771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9a009a150 0x7ff9a0139380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.605+0000 7ff9a698a700 1 --2- 172.21.15.146:0/3863908771 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9a009ef80 0x7ff9a01398c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.605+0000 7ff9a698a700 1 -- 172.21.15.146:0/3863908771 >> 172.21.15.146:0/3863908771 conn(0x7ff9a00a4430 msgr2=0x7ff9a00a2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.606+0000 7ff9a698a700 1 -- 172.21.15.146:0/3863908771 shutdown_connections 2023-10-03T10:13:13.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.606+0000 7ff9a698a700 1 -- 172.21.15.146:0/3863908771 wait complete. 2023-10-03T10:13:13.619 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:13.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.642+0000 7fb8abe76700 1 -- 172.21.15.146:0/858330600 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb8a404f2a0 con 0x7fb8a41309f0 2023-10-03T10:13:13.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.642+0000 7fb89a7fc700 1 -- 172.21.15.146:0/858330600 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb894015020 con 0x7fb8a41309f0 2023-10-03T10:13:13.643 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:13.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.644+0000 7fb8abe76700 1 -- 172.21.15.146:0/858330600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8a41309f0 msgr2=0x7fb8a411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.644+0000 7fb8abe76700 1 --2- 172.21.15.146:0/858330600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8a41309f0 0x7fb8a411df80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb894009c40 tx=0x7fb894004750 comp rx=0 tx=0).stop 2023-10-03T10:13:13.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.644+0000 7fb8abe76700 1 -- 172.21.15.146:0/858330600 shutdown_connections 2023-10-03T10:13:13.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.644+0000 7fb8abe76700 1 --2- 172.21.15.146:0/858330600 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a4133ad0 0x7fb8a411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.644+0000 7fb8abe76700 1 --2- 172.21.15.146:0/858330600 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8a41300a0 0x7fb8a411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.644+0000 7fb8abe76700 1 --2- 172.21.15.146:0/858330600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8a41309f0 0x7fb8a411df80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.644+0000 7fb8abe76700 1 -- 172.21.15.146:0/858330600 >> 172.21.15.146:0/858330600 conn(0x7fb8a4099c40 msgr2=0x7fb8a40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.644+0000 7fb8abe76700 1 -- 172.21.15.146:0/858330600 shutdown_connections 2023-10-03T10:13:13.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.644+0000 7fb8abe76700 1 -- 172.21.15.146:0/858330600 wait complete. 2023-10-03T10:13:13.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:13.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.750+0000 7f5f168a6700 1 -- 172.21.15.146:0/2276132983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5f1004f2a0 con 0x7f5f1009ef80 2023-10-03T10:13:13.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.751+0000 7f5f0cff9700 1 -- 172.21.15.146:0/2276132983 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f0402b7d0 con 0x7f5f1009ef80 2023-10-03T10:13:13.752 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:13.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.753+0000 7f5f168a6700 1 -- 172.21.15.146:0/2276132983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f1009ef80 msgr2=0x7f5f101b7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.753+0000 7f5f168a6700 1 --2- 172.21.15.146:0/2276132983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f1009ef80 0x7f5f101b7f30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5f0401d000 tx=0x7f5f04004750 comp rx=0 tx=0).stop 2023-10-03T10:13:13.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.753+0000 7f5f168a6700 1 -- 172.21.15.146:0/2276132983 shutdown_connections 2023-10-03T10:13:13.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.753+0000 7f5f168a6700 1 --2- 172.21.15.146:0/2276132983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f1009f370 0x7f5f101c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.753+0000 7f5f168a6700 1 --2- 172.21.15.146:0/2276132983 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f1009a150 0x7f5f101b79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.753+0000 7f5f168a6700 1 --2- 172.21.15.146:0/2276132983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f1009ef80 0x7f5f101b7f30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.753+0000 7f5f168a6700 1 -- 172.21.15.146:0/2276132983 >> 172.21.15.146:0/2276132983 conn(0x7f5f100a4430 msgr2=0x7f5f1009cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.753+0000 7f5f168a6700 1 -- 172.21.15.146:0/2276132983 shutdown_connections 2023-10-03T10:13:13.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.753+0000 7f5f168a6700 1 -- 172.21.15.146:0/2276132983 wait complete. 2023-10-03T10:13:13.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:13.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.784+0000 7f80a7d4c700 1 -- 172.21.15.146:0/4249216653 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f80a004f2a0 con 0x7f80a009e340 2023-10-03T10:13:13.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.784+0000 7f80967fc700 1 -- 172.21.15.146:0/4249216653 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8090015070 con 0x7f80a009e340 2023-10-03T10:13:13.785 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:13.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.786+0000 7f80a7d4c700 1 -- 172.21.15.146:0/4249216653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80a009e340 msgr2=0x7f80a0139dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.786+0000 7f80a7d4c700 1 --2- 172.21.15.146:0/4249216653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80a009e340 0x7f80a0139dc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f80a009ee50 tx=0x7f8090004750 comp rx=0 tx=0).stop 2023-10-03T10:13:13.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.786+0000 7f80a7d4c700 1 -- 172.21.15.146:0/4249216653 shutdown_connections 2023-10-03T10:13:13.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.786+0000 7f80a7d4c700 1 --2- 172.21.15.146:0/4249216653 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80a0135f20 0x7f80a013a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.786+0000 7f80a7d4c700 1 --2- 172.21.15.146:0/4249216653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80a009d860 0x7f80a0139880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.786+0000 7f80a7d4c700 1 --2- 172.21.15.146:0/4249216653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80a009e340 0x7f80a0139dc0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.786+0000 7f80a7d4c700 1 -- 172.21.15.146:0/4249216653 >> 172.21.15.146:0/4249216653 conn(0x7f80a0099c40 msgr2=0x7f80a00a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.787+0000 7f80a7d4c700 1 -- 172.21.15.146:0/4249216653 shutdown_connections 2023-10-03T10:13:13.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:13.787+0000 7f80a7d4c700 1 -- 172.21.15.146:0/4249216653 wait complete. 2023-10-03T10:13:13.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:14.620 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:14.659 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:14.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.756+0000 7fc91d135700 1 Processor -- start 2023-10-03T10:13:14.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.757+0000 7fc91d135700 1 -- start start 2023-10-03T10:13:14.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.757+0000 7fc91d135700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc91809e870 0x7fc91809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.757+0000 7fc91d135700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc91809f180 0x7fc918133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.757+0000 7fc91d135700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91806bec0 con 0x7fc9181341d0 2023-10-03T10:13:14.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.757+0000 7fc91d135700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91806ce60 con 0x7fc91809f180 2023-10-03T10:13:14.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.757+0000 7fc91d135700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91809fa00 con 0x7fc91809e870 2023-10-03T10:13:14.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.757+0000 7fc916d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc91809e870 0x7fc91809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.757+0000 7fc91659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc91809f180 0x7fc918133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.757+0000 7fc916d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc91809e870 0x7fc91809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39290/0 (socket says 172.21.15.146:39290) 2023-10-03T10:13:14.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.757+0000 7fc91659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc91809f180 0x7fc918133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50822/0 (socket says 172.21.15.146:50822) 2023-10-03T10:13:14.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.757+0000 7fc916d9d700 1 -- 172.21.15.146:0/129245931 learned_addr learned my addr 172.21.15.146:0/129245931 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:14.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.757+0000 7fc91659c700 1 -- 172.21.15.146:0/129245931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc91809e870 msgr2=0x7fc91809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:14.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.757+0000 7fc91659c700 1 --2- 172.21.15.146:0/129245931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc91809e870 0x7fc91809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.757+0000 7fc91659c700 1 -- 172.21.15.146:0/129245931 >> v1:172.21.15.146:6789/0 conn(0x7fc9181341d0 legacy=0x7fc91813af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.758+0000 7fc91659c700 1 -- 172.21.15.146:0/129245931 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91809ad80 con 0x7fc91809f180 2023-10-03T10:13:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.758+0000 7fc915d9b700 1 -- 172.21.15.146:0/129245931 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54370934 0 0) 0x7fc91806bec0 con 0x7fc9181341d0 2023-10-03T10:13:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.758+0000 7fc916d9d700 1 --2- 172.21.15.146:0/129245931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc91809e870 0x7fc91809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.758+0000 7fc91659c700 1 --2- 172.21.15.146:0/129245931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc91809f180 0x7fc918133c90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009840 tx=0x7fc90c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdcfdaf5db2490b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.758+0000 7fc915d9b700 1 -- 172.21.15.146:0/129245931 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c011830 con 0x7fc91809f180 2023-10-03T10:13:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.758+0000 7fc915d9b700 1 -- 172.21.15.146:0/129245931 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c011990 con 0x7fc91809f180 2023-10-03T10:13:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.758+0000 7fc915d9b700 1 -- 172.21.15.146:0/129245931 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c011d20 con 0x7fc91809f180 2023-10-03T10:13:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.758+0000 7fc91d135700 1 -- 172.21.15.146:0/129245931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc91809f180 msgr2=0x7fc918133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.758+0000 7fc91d135700 1 --2- 172.21.15.146:0/129245931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc91809f180 0x7fc918133c90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009840 tx=0x7fc90c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.758+0000 7fc91d135700 1 -- 172.21.15.146:0/129245931 shutdown_connections 2023-10-03T10:13:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.758+0000 7fc91d135700 1 --2- 172.21.15.146:0/129245931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc91809e870 0x7fc91809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.758+0000 7fc91d135700 1 --2- 172.21.15.146:0/129245931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc91809f180 0x7fc918133c90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.758+0000 7fc91d135700 1 -- 172.21.15.146:0/129245931 >> 172.21.15.146:0/129245931 conn(0x7fc9180a4430 msgr2=0x7fc9180a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.758+0000 7fc91d135700 1 -- 172.21.15.146:0/129245931 shutdown_connections 2023-10-03T10:13:14.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.759+0000 7fc91d135700 1 -- 172.21.15.146:0/129245931 wait complete. 2023-10-03T10:13:14.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.760+0000 7fc91d135700 1 Processor -- start 2023-10-03T10:13:14.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.760+0000 7fc91d135700 1 -- start start 2023-10-03T10:13:14.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.760+0000 7fc91d135700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc91809e870 0x7fc918122a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.760+0000 7fc91d135700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc91809f180 0x7fc918122f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.760+0000 7fc91d135700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9181341d0 0x7fc918123490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.760+0000 7fc91d135700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc918126530 con 0x7fc91809e870 2023-10-03T10:13:14.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.760+0000 7fc91d135700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc918124620 con 0x7fc9181341d0 2023-10-03T10:13:14.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.760+0000 7fc91d135700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9180a35c0 con 0x7fc91809f180 2023-10-03T10:13:14.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.760+0000 7fc91659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc91809f180 0x7fc918122f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.760+0000 7fc916d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc91809e870 0x7fc918122a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.760+0000 7fc91759e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9181341d0 0x7fc918123490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.760+0000 7fc91659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc91809f180 0x7fc918122f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36186/0 (socket says 172.21.15.146:36186) 2023-10-03T10:13:14.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.760+0000 7fc91659c700 1 -- 172.21.15.146:0/3869808704 learned_addr learned my addr 172.21.15.146:0/3869808704 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:14.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.761+0000 7fc91759e700 1 -- 172.21.15.146:0/3869808704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc91809f180 msgr2=0x7fc918122f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.761+0000 7fc91759e700 1 --2- 172.21.15.146:0/3869808704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc91809f180 0x7fc918122f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.761+0000 7fc91759e700 1 -- 172.21.15.146:0/3869808704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc91809e870 msgr2=0x7fc918122a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.761+0000 7fc91759e700 1 --2- 172.21.15.146:0/3869808704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc91809e870 0x7fc918122a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.761+0000 7fc91759e700 1 -- 172.21.15.146:0/3869808704 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc908009550 con 0x7fc9181341d0 2023-10-03T10:13:14.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.761+0000 7fc91659c700 1 --2- 172.21.15.146:0/3869808704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc91809f180 0x7fc918122f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:14.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.761+0000 7fc916d9d700 1 --2- 172.21.15.146:0/3869808704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc91809e870 0x7fc918122a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:14.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.761+0000 7fc91759e700 1 --2- 172.21.15.146:0/3869808704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9181341d0 0x7fc918123490 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc91000c7c0 tx=0x7fc91000cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.761+0000 7fc8ff7fe700 1 -- 172.21.15.146:0/3869808704 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc910003e30 con 0x7fc9181341d0 2023-10-03T10:13:14.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.761+0000 7fc8ff7fe700 1 -- 172.21.15.146:0/3869808704 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc910005070 con 0x7fc9181341d0 2023-10-03T10:13:14.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.761+0000 7fc91d135700 1 -- 172.21.15.146:0/3869808704 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc90c0094a0 con 0x7fc9181341d0 2023-10-03T10:13:14.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.761+0000 7fc8ff7fe700 1 -- 172.21.15.146:0/3869808704 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc910005420 con 0x7fc9181341d0 2023-10-03T10:13:14.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.761+0000 7fc91d135700 1 -- 172.21.15.146:0/3869808704 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc918133530 con 0x7fc9181341d0 2023-10-03T10:13:14.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.762+0000 7fc8ff7fe700 1 -- 172.21.15.146:0/3869808704 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc910005580 con 0x7fc9181341d0 2023-10-03T10:13:14.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.762+0000 7fc8ff7fe700 1 -- 172.21.15.146:0/3869808704 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc91003edd0 con 0x7fc9181341d0 2023-10-03T10:13:14.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.762+0000 7fc91d135700 1 -- 172.21.15.146:0/3869808704 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc918125ef0 con 0x7fc9181341d0 2023-10-03T10:13:14.766 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:14.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.771+0000 7fc8ff7fe700 1 -- 172.21.15.146:0/3869808704 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc918125ef0 con 0x7fc9181341d0 2023-10-03T10:13:14.800 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:14.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.800+0000 7f8d2095b700 1 Processor -- start 2023-10-03T10:13:14.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.800+0000 7f8d2095b700 1 -- start start 2023-10-03T10:13:14.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.800+0000 7f8d2095b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d1c09f350 0x7f8d1c136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.800+0000 7f8d2095b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c1371c0 0x7f8d1c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.800+0000 7f8d2095b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d1c09c970 con 0x7f8d1c09e870 2023-10-03T10:13:14.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.800+0000 7f8d2095b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c0a0920 con 0x7f8d1c1371c0 2023-10-03T10:13:14.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.800+0000 7f8d2095b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c09f9c0 con 0x7f8d1c09f350 2023-10-03T10:13:14.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.800+0000 7f8d1ad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c1371c0 0x7f8d1c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.800+0000 7f8d1a59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8d1c09e870 0x7f8d1c09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50202/0 (socket says 172.21.15.146:50202) 2023-10-03T10:13:14.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.800+0000 7f8d1ad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c1371c0 0x7f8d1c1395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39310/0 (socket says 172.21.15.146:39310) 2023-10-03T10:13:14.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.800+0000 7f8d1a59c700 1 -- 172.21.15.146:0/3423380548 learned_addr learned my addr 172.21.15.146:0/3423380548 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:14.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.800+0000 7f8d19d9b700 1 --2- 172.21.15.146:0/3423380548 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d1c09f350 0x7f8d1c136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.801+0000 7f8d1959a700 1 -- 172.21.15.146:0/3423380548 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940124065 0 0) 0x7f8d1c09c970 con 0x7f8d1c09e870 2023-10-03T10:13:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.801+0000 7f8d1959a700 1 -- 172.21.15.146:0/3423380548 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d040035b0 con 0x7f8d1c09e870 2023-10-03T10:13:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.801+0000 7f8d19d9b700 1 -- 172.21.15.146:0/3423380548 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c1371c0 msgr2=0x7f8d1c1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.801+0000 7f8d19d9b700 1 --2- 172.21.15.146:0/3423380548 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c1371c0 0x7f8d1c1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.801+0000 7f8d19d9b700 1 -- 172.21.15.146:0/3423380548 >> v1:172.21.15.146:6789/0 conn(0x7f8d1c09e870 legacy=0x7f8d1c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.801+0000 7f8d19d9b700 1 -- 172.21.15.146:0/3423380548 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c09bab0 con 0x7f8d1c09f350 2023-10-03T10:13:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.801+0000 7f8d1ad9d700 1 --2- 172.21.15.146:0/3423380548 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c1371c0 0x7f8d1c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.801+0000 7f8d19d9b700 1 --2- 172.21.15.146:0/3423380548 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d1c09f350 0x7f8d1c136c80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8d10009870 tx=0x7f8d10009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1016a850beae2aec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.801+0000 7f8d1959a700 1 -- 172.21.15.146:0/3423380548 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d10004230 con 0x7f8d1c09f350 2023-10-03T10:13:14.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.801+0000 7f8d1959a700 1 -- 172.21.15.146:0/3423380548 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d10004390 con 0x7f8d1c09f350 2023-10-03T10:13:14.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.801+0000 7f8d1959a700 1 -- 172.21.15.146:0/3423380548 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d100036a0 con 0x7f8d1c09f350 2023-10-03T10:13:14.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.802+0000 7f8d2095b700 1 -- 172.21.15.146:0/3423380548 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d1c09f350 msgr2=0x7f8d1c136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.802+0000 7f8d2095b700 1 --2- 172.21.15.146:0/3423380548 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d1c09f350 0x7f8d1c136c80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8d10009870 tx=0x7f8d10009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:14.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.802+0000 7f8d2095b700 1 -- 172.21.15.146:0/3423380548 shutdown_connections 2023-10-03T10:13:14.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.802+0000 7f8d2095b700 1 --2- 172.21.15.146:0/3423380548 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c1371c0 0x7f8d1c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.802+0000 7f8d2095b700 1 --2- 172.21.15.146:0/3423380548 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d1c09f350 0x7f8d1c136c80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.802+0000 7f8d2095b700 1 -- 172.21.15.146:0/3423380548 >> 172.21.15.146:0/3423380548 conn(0x7f8d1c0a4430 msgr2=0x7f8d1c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.802+0000 7f8d2095b700 1 -- 172.21.15.146:0/3423380548 shutdown_connections 2023-10-03T10:13:14.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.802+0000 7f8d2095b700 1 -- 172.21.15.146:0/3423380548 wait complete. 2023-10-03T10:13:14.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.803+0000 7f8d2095b700 1 Processor -- start 2023-10-03T10:13:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.803+0000 7f8d2095b700 1 -- start start 2023-10-03T10:13:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.804+0000 7f8d2095b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d1c09e870 0x7f8d1c1c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.804+0000 7f8d2095b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c09f350 0x7f8d1c1c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.804+0000 7f8d2095b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d1c1371c0 0x7f8d1c1c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.804+0000 7f8d2095b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c09dba0 con 0x7f8d1c1371c0 2023-10-03T10:13:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.804+0000 7f8d2095b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c126660 con 0x7f8d1c09f350 2023-10-03T10:13:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.804+0000 7f8d2095b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c06d4c0 con 0x7f8d1c09e870 2023-10-03T10:13:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.804+0000 7f8d1a59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d1c09e870 0x7f8d1c1c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.804+0000 7f8d19d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c09f350 0x7f8d1c1c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.804+0000 7f8d1a59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d1c09e870 0x7f8d1c1c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36206/0 (socket says 172.21.15.146:36206) 2023-10-03T10:13:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.804+0000 7f8d1a59c700 1 -- 172.21.15.146:0/1360795074 learned_addr learned my addr 172.21.15.146:0/1360795074 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.804+0000 7f8d1ad9d700 1 --2- 172.21.15.146:0/1360795074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d1c1371c0 0x7f8d1c1c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.804+0000 7f8d1a59c700 1 -- 172.21.15.146:0/1360795074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c09f350 msgr2=0x7f8d1c1c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.804+0000 7f8d1a59c700 1 --2- 172.21.15.146:0/1360795074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c09f350 0x7f8d1c1c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.805+0000 7f8d1a59c700 1 -- 172.21.15.146:0/1360795074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d1c1371c0 msgr2=0x7f8d1c1c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.805+0000 7f8d1a59c700 1 --2- 172.21.15.146:0/1360795074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d1c1371c0 0x7f8d1c1c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.805+0000 7f8d1a59c700 1 -- 172.21.15.146:0/1360795074 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d14009a70 con 0x7f8d1c09e870 2023-10-03T10:13:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.805+0000 7f8d1a59c700 1 --2- 172.21.15.146:0/1360795074 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d1c09e870 0x7f8d1c1c8540 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0011e0 tx=0x7f8d0c00ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.805+0000 7f8d0affd700 1 -- 172.21.15.146:0/1360795074 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c004c80 con 0x7f8d1c09e870 2023-10-03T10:13:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.805+0000 7f8d0affd700 1 -- 172.21.15.146:0/1360795074 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c004de0 con 0x7f8d1c09e870 2023-10-03T10:13:14.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.805+0000 7f8d2095b700 1 -- 172.21.15.146:0/1360795074 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d100094a0 con 0x7f8d1c09e870 2023-10-03T10:13:14.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.805+0000 7f8d0affd700 1 -- 172.21.15.146:0/1360795074 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c0072f0 con 0x7f8d1c09e870 2023-10-03T10:13:14.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.805+0000 7f8d2095b700 1 -- 172.21.15.146:0/1360795074 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1c072350 con 0x7f8d1c09e870 2023-10-03T10:13:14.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.807+0000 7f8d0affd700 1 -- 172.21.15.146:0/1360795074 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d0c007450 con 0x7f8d1c09e870 2023-10-03T10:13:14.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.807+0000 7f8d2095b700 1 -- 172.21.15.146:0/1360795074 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1c1270b0 con 0x7f8d1c09e870 2023-10-03T10:13:14.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.807+0000 7f8d0affd700 1 -- 172.21.15.146:0/1360795074 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8d0c043170 con 0x7f8d1c09e870 2023-10-03T10:13:14.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.812+0000 7f8d0affd700 1 -- 172.21.15.146:0/1360795074 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d0c044060 con 0x7f8d1c09e870 2023-10-03T10:13:14.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.904+0000 7f4296e90700 1 Processor -- start 2023-10-03T10:13:14.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.904+0000 7f4296e90700 1 -- start start 2023-10-03T10:13:14.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.905+0000 7f4296e90700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4290134140 0x7f4290138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.905+0000 7f4296e90700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42901345a0 0x7f429013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.905+0000 7f4296e90700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f429009b110 con 0x7f429009ad40 2023-10-03T10:13:14.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.905+0000 7f4296e90700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42900a3b60 con 0x7f4290134140 2023-10-03T10:13:14.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.905+0000 7f4296e90700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42900a1a80 con 0x7f42901345a0 2023-10-03T10:13:14.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.905+0000 7f4294c2c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f429009ad40 0x7f4290133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50206/0 (socket says 172.21.15.146:50206) 2023-10-03T10:13:14.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.905+0000 7f4294c2c700 1 -- 172.21.15.146:0/751136869 learned_addr learned my addr 172.21.15.146:0/751136869 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:14.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.905+0000 7f428ffff700 1 --2- 172.21.15.146:0/751136869 >> v2:172.21.15.146:3300/0 conn(0x7f4290134140 0x7f4290138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.905+0000 7f429542d700 1 --2- 172.21.15.146:0/751136869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42901345a0 0x7f429013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.906+0000 7f428ffff700 1 -- 172.21.15.146:0/751136869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42901345a0 msgr2=0x7f429013b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.906+0000 7f428ffff700 1 --2- 172.21.15.146:0/751136869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42901345a0 0x7f429013b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.906+0000 7f428ffff700 1 -- 172.21.15.146:0/751136869 >> v1:172.21.15.146:6789/0 conn(0x7f429009ad40 legacy=0x7f4290133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.906+0000 7f428f7fe700 1 -- 172.21.15.146:0/751136869 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468175663 0 0) 0x7f429009b110 con 0x7f429009ad40 2023-10-03T10:13:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.906+0000 7f428ffff700 1 -- 172.21.15.146:0/751136869 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42900a2fa0 con 0x7f4290134140 2023-10-03T10:13:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.906+0000 7f428ffff700 1 --2- 172.21.15.146:0/751136869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4290134140 0x7f4290138e80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f427c009840 tx=0x7f427c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5f001d1c863244 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.906+0000 7f428f7fe700 1 -- 172.21.15.146:0/751136869 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c011830 con 0x7f4290134140 2023-10-03T10:13:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.906+0000 7f428f7fe700 1 -- 172.21.15.146:0/751136869 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427c011990 con 0x7f4290134140 2023-10-03T10:13:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.906+0000 7f428f7fe700 1 -- 172.21.15.146:0/751136869 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c011d20 con 0x7f4290134140 2023-10-03T10:13:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.907+0000 7f4296e90700 1 -- 172.21.15.146:0/751136869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4290134140 msgr2=0x7f4290138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.907+0000 7f4296e90700 1 --2- 172.21.15.146:0/751136869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4290134140 0x7f4290138e80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f427c009840 tx=0x7f427c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:14.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.907+0000 7f4296e90700 1 -- 172.21.15.146:0/751136869 shutdown_connections 2023-10-03T10:13:14.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.907+0000 7f4296e90700 1 --2- 172.21.15.146:0/751136869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42901345a0 0x7f429013b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.907+0000 7f4296e90700 1 --2- 172.21.15.146:0/751136869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4290134140 0x7f4290138e80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.907+0000 7f4296e90700 1 -- 172.21.15.146:0/751136869 >> 172.21.15.146:0/751136869 conn(0x7f4290099c40 msgr2=0x7f429006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.907+0000 7f4296e90700 1 -- 172.21.15.146:0/751136869 shutdown_connections 2023-10-03T10:13:14.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.907+0000 7f4296e90700 1 -- 172.21.15.146:0/751136869 wait complete. 2023-10-03T10:13:14.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.908+0000 7f4296e90700 1 Processor -- start 2023-10-03T10:13:14.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.908+0000 7f4296e90700 1 -- start start 2023-10-03T10:13:14.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.909+0000 7f4296e90700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f429009ad40 0x7f4290139400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.909+0000 7f4296e90700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4290134140 0x7f4290139940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.909+0000 7f4296e90700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42901345a0 0x7f4290139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.909+0000 7f4296e90700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429011e4d0 con 0x7f42901345a0 2023-10-03T10:13:14.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.909+0000 7f4296e90700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429009c7e0 con 0x7f4290134140 2023-10-03T10:13:14.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.909+0000 7f4296e90700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42900a4de0 con 0x7f429009ad40 2023-10-03T10:13:14.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.909+0000 7f429542d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42901345a0 0x7f4290139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.909+0000 7f429542d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42901345a0 0x7f4290139e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50850/0 (socket says 172.21.15.146:50850) 2023-10-03T10:13:14.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.909+0000 7f429542d700 1 -- 172.21.15.146:0/2325272132 learned_addr learned my addr 172.21.15.146:0/2325272132 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:14.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.909+0000 7f428ffff700 1 --2- 172.21.15.146:0/2325272132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4290134140 0x7f4290139940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.909+0000 7f429542d700 1 -- 172.21.15.146:0/2325272132 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f429009ad40 msgr2=0x7f4290139400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.909+0000 7f429542d700 1 --2- 172.21.15.146:0/2325272132 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f429009ad40 0x7f4290139400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.909+0000 7f429542d700 1 -- 172.21.15.146:0/2325272132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4290134140 msgr2=0x7f4290139940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.909+0000 7f429542d700 1 --2- 172.21.15.146:0/2325272132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4290134140 0x7f4290139940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.909+0000 7f429542d700 1 -- 172.21.15.146:0/2325272132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c0094a0 con 0x7f42901345a0 2023-10-03T10:13:14.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.910+0000 7f429542d700 1 --2- 172.21.15.146:0/2325272132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42901345a0 0x7f4290139e80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f428800efc0 tx=0x7f428800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.910+0000 7f428d7fa700 1 -- 172.21.15.146:0/2325272132 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4288009ea0 con 0x7f42901345a0 2023-10-03T10:13:14.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.910+0000 7f428d7fa700 1 -- 172.21.15.146:0/2325272132 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428800f040 con 0x7f42901345a0 2023-10-03T10:13:14.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.910+0000 7f4296e90700 1 -- 172.21.15.146:0/2325272132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429011ce30 con 0x7f42901345a0 2023-10-03T10:13:14.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.910+0000 7f428d7fa700 1 -- 172.21.15.146:0/2325272132 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4288014480 con 0x7f42901345a0 2023-10-03T10:13:14.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.910+0000 7f4296e90700 1 -- 172.21.15.146:0/2325272132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429011f240 con 0x7f42901345a0 2023-10-03T10:13:14.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.911+0000 7f428d7fa700 1 -- 172.21.15.146:0/2325272132 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f42880145e0 con 0x7f42901345a0 2023-10-03T10:13:14.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.911+0000 7f428d7fa700 1 -- 172.21.15.146:0/2325272132 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f428803ff80 con 0x7f42901345a0 2023-10-03T10:13:14.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.911+0000 7f4296e90700 1 -- 172.21.15.146:0/2325272132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42700052e0 con 0x7f42901345a0 2023-10-03T10:13:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.916+0000 7f428d7fa700 1 -- 172.21.15.146:0/2325272132 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4288018020 con 0x7f42901345a0 2023-10-03T10:13:14.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.957+0000 7fcbe00b5700 1 Processor -- start 2023-10-03T10:13:14.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.957+0000 7fcbe00b5700 1 -- start start 2023-10-03T10:13:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.958+0000 7fcbe00b5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbd8131980 0x7fcbd8131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.958+0000 7fcbe00b5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcbd809c790 0x7fcbd8139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.958+0000 7fcbe00b5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd80a1640 con 0x7fcbd809bc70 2023-10-03T10:13:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.958+0000 7fcbe00b5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd806eb30 con 0x7fcbd8131980 2023-10-03T10:13:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.958+0000 7fcbe00b5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd80a22d0 con 0x7fcbd809c790 2023-10-03T10:13:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.958+0000 7fcbdd650700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcbd809bc70 0x7fcbd809c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50210/0 (socket says 172.21.15.146:50210) 2023-10-03T10:13:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.958+0000 7fcbdd650700 1 -- 172.21.15.146:0/1911934815 learned_addr learned my addr 172.21.15.146:0/1911934815 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.958+0000 7fcbde652700 1 --2- 172.21.15.146:0/1911934815 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcbd809c790 0x7fcbd8139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.958+0000 7fcbdde51700 1 --2- 172.21.15.146:0/1911934815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbd8131980 0x7fcbd8131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.959+0000 7fcbdce4f700 1 -- 172.21.15.146:0/1911934815 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261958161 0 0) 0x7fcbd80a1640 con 0x7fcbd809bc70 2023-10-03T10:13:14.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.959+0000 7fcbdde51700 1 -- 172.21.15.146:0/1911934815 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcbd809c790 msgr2=0x7fcbd8139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:14.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.959+0000 7fcbdde51700 1 --2- 172.21.15.146:0/1911934815 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcbd809c790 0x7fcbd8139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.959+0000 7fcbdde51700 1 -- 172.21.15.146:0/1911934815 >> v1:172.21.15.146:6789/0 conn(0x7fcbd809bc70 legacy=0x7fcbd809c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.959+0000 7fcbdde51700 1 -- 172.21.15.146:0/1911934815 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd8131550 con 0x7fcbd8131980 2023-10-03T10:13:14.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.959+0000 7fcbdde51700 1 --2- 172.21.15.146:0/1911934815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbd8131980 0x7fcbd8131d50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009850 tx=0x7fcbd4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d606b0a14a71963 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.959+0000 7fcbdce4f700 1 -- 172.21.15.146:0/1911934815 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4005e30 con 0x7fcbd8131980 2023-10-03T10:13:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.959+0000 7fcbdce4f700 1 -- 172.21.15.146:0/1911934815 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd4006030 con 0x7fcbd8131980 2023-10-03T10:13:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.959+0000 7fcbdce4f700 1 -- 172.21.15.146:0/1911934815 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd40063e0 con 0x7fcbd8131980 2023-10-03T10:13:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.960+0000 7fcbe00b5700 1 -- 172.21.15.146:0/1911934815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbd8131980 msgr2=0x7fcbd8131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.960+0000 7fcbe00b5700 1 --2- 172.21.15.146:0/1911934815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbd8131980 0x7fcbd8131d50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009850 tx=0x7fcbd4009b60 comp rx=0 tx=0).stop 2023-10-03T10:13:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.960+0000 7fcbe00b5700 1 -- 172.21.15.146:0/1911934815 shutdown_connections 2023-10-03T10:13:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.960+0000 7fcbe00b5700 1 --2- 172.21.15.146:0/1911934815 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcbd809c790 0x7fcbd8139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.960+0000 7fcbe00b5700 1 --2- 172.21.15.146:0/1911934815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbd8131980 0x7fcbd8131d50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.960+0000 7fcbe00b5700 1 -- 172.21.15.146:0/1911934815 >> 172.21.15.146:0/1911934815 conn(0x7fcbd80a2980 msgr2=0x7fcbd80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.960+0000 7fcbe00b5700 1 -- 172.21.15.146:0/1911934815 shutdown_connections 2023-10-03T10:13:14.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.960+0000 7fcbe00b5700 1 -- 172.21.15.146:0/1911934815 wait complete. 2023-10-03T10:13:14.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.962+0000 7fcbe00b5700 1 Processor -- start 2023-10-03T10:13:14.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.962+0000 7fcbe00b5700 1 -- start start 2023-10-03T10:13:14.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.962+0000 7fcbe00b5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcbd809bc70 0x7fcbd811b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.962+0000 7fcbe00b5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbd809c790 0x7fcbd811bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.962+0000 7fcbe00b5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbd8131980 0x7fcbd811c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.962+0000 7fcbe00b5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd811fb60 con 0x7fcbd8131980 2023-10-03T10:13:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.962+0000 7fcbe00b5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd811d330 con 0x7fcbd809c790 2023-10-03T10:13:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.962+0000 7fcbe00b5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd811eec0 con 0x7fcbd809bc70 2023-10-03T10:13:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.962+0000 7fcbdde51700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcbd809bc70 0x7fcbd811b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.962+0000 7fcbdde51700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcbd809bc70 0x7fcbd811b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36242/0 (socket says 172.21.15.146:36242) 2023-10-03T10:13:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.962+0000 7fcbdde51700 1 -- 172.21.15.146:0/3231319296 learned_addr learned my addr 172.21.15.146:0/3231319296 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.963+0000 7fcbde652700 1 --2- 172.21.15.146:0/3231319296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbd8131980 0x7fcbd811c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.963+0000 7fcbdde51700 1 -- 172.21.15.146:0/3231319296 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbd809c790 msgr2=0x7fcbd811bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.963+0000 7fcbdde51700 1 --2- 172.21.15.146:0/3231319296 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbd809c790 0x7fcbd811bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.963+0000 7fcbdde51700 1 -- 172.21.15.146:0/3231319296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbd8131980 msgr2=0x7fcbd811c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.963+0000 7fcbdde51700 1 --2- 172.21.15.146:0/3231319296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbd8131980 0x7fcbd811c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.963+0000 7fcbdde51700 1 -- 172.21.15.146:0/3231319296 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd4009430 con 0x7fcbd809bc70 2023-10-03T10:13:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.963+0000 7fcbdde51700 1 --2- 172.21.15.146:0/3231319296 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcbd809bc70 0x7fcbd811b720 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009ba0 tx=0x7fcbd4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.964+0000 7fcbce7fc700 1 -- 172.21.15.146:0/3231319296 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4004240 con 0x7fcbd809bc70 2023-10-03T10:13:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.964+0000 7fcbce7fc700 1 -- 172.21.15.146:0/3231319296 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd40043c0 con 0x7fcbd809bc70 2023-10-03T10:13:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.964+0000 7fcbce7fc700 1 -- 172.21.15.146:0/3231319296 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4006a70 con 0x7fcbd809bc70 2023-10-03T10:13:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.964+0000 7fcbe00b5700 1 -- 172.21.15.146:0/3231319296 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd81309d0 con 0x7fcbd809bc70 2023-10-03T10:13:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.964+0000 7fcbe00b5700 1 -- 172.21.15.146:0/3231319296 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd811e4e0 con 0x7fcbd809bc70 2023-10-03T10:13:14.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.965+0000 7fcbce7fc700 1 -- 172.21.15.146:0/3231319296 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcbd4022070 con 0x7fcbd809bc70 2023-10-03T10:13:14.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.966+0000 7fcbce7fc700 1 -- 172.21.15.146:0/3231319296 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcbd4043030 con 0x7fcbd809bc70 2023-10-03T10:13:14.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.966+0000 7fcbe00b5700 1 -- 172.21.15.146:0/3231319296 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd804f2a0 con 0x7fcbd809bc70 2023-10-03T10:13:14.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.975+0000 7fcbce7fc700 1 -- 172.21.15.146:0/3231319296 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcbd4041080 con 0x7fcbd809bc70 2023-10-03T10:13:14.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.979+0000 7fc91d135700 1 -- 172.21.15.146:0/3869808704 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc9181260b0 con 0x7fc9181341d0 2023-10-03T10:13:14.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.979+0000 7fc8ff7fe700 1 -- 172.21.15.146:0/3869808704 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc9181260b0 con 0x7fc9181341d0 2023-10-03T10:13:14.980 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:14.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.982+0000 7fc91d135700 1 -- 172.21.15.146:0/3869808704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9181341d0 msgr2=0x7fc918123490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.982+0000 7fc91d135700 1 --2- 172.21.15.146:0/3869808704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9181341d0 0x7fc918123490 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc91000c7c0 tx=0x7fc91000cad0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.982+0000 7fc91d135700 1 -- 172.21.15.146:0/3869808704 shutdown_connections 2023-10-03T10:13:14.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.982+0000 7fc91d135700 1 --2- 172.21.15.146:0/3869808704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9181341d0 0x7fc918123490 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.982+0000 7fc91d135700 1 --2- 172.21.15.146:0/3869808704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc91809e870 0x7fc918122a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.982+0000 7fc91d135700 1 --2- 172.21.15.146:0/3869808704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc91809f180 0x7fc918122f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.982+0000 7fc91d135700 1 -- 172.21.15.146:0/3869808704 >> 172.21.15.146:0/3869808704 conn(0x7fc9180a4430 msgr2=0x7fc91809d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.982+0000 7fc91d135700 1 -- 172.21.15.146:0/3869808704 shutdown_connections 2023-10-03T10:13:14.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:14.982+0000 7fc91d135700 1 -- 172.21.15.146:0/3869808704 wait complete. 2023-10-03T10:13:15.001 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:15.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.043+0000 7f8d2095b700 1 -- 172.21.15.146:0/1360795074 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8d1c09ddb0 con 0x7f8d1c09e870 2023-10-03T10:13:15.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.044+0000 7f8d0affd700 1 -- 172.21.15.146:0/1360795074 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8d0c007700 con 0x7f8d1c09e870 2023-10-03T10:13:15.045 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:15.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.046+0000 7f8d2095b700 1 -- 172.21.15.146:0/1360795074 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d1c09e870 msgr2=0x7f8d1c1c8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.046+0000 7f8d2095b700 1 --2- 172.21.15.146:0/1360795074 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d1c09e870 0x7f8d1c1c8540 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0011e0 tx=0x7f8d0c00ca30 comp rx=0 tx=0).stop 2023-10-03T10:13:15.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.046+0000 7f8d2095b700 1 -- 172.21.15.146:0/1360795074 shutdown_connections 2023-10-03T10:13:15.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.046+0000 7f8d2095b700 1 --2- 172.21.15.146:0/1360795074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d1c1371c0 0x7f8d1c1c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.046+0000 7f8d2095b700 1 --2- 172.21.15.146:0/1360795074 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d1c09e870 0x7f8d1c1c8540 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.046+0000 7f8d2095b700 1 --2- 172.21.15.146:0/1360795074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c09f350 0x7f8d1c1c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.046+0000 7f8d2095b700 1 -- 172.21.15.146:0/1360795074 >> 172.21.15.146:0/1360795074 conn(0x7f8d1c0a4430 msgr2=0x7f8d1c0a2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:15.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.046+0000 7f8d2095b700 1 -- 172.21.15.146:0/1360795074 shutdown_connections 2023-10-03T10:13:15.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.046+0000 7f8d2095b700 1 -- 172.21.15.146:0/1360795074 wait complete. 2023-10-03T10:13:15.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.134+0000 7f4296e90700 1 -- 172.21.15.146:0/2325272132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4270005590 con 0x7f42901345a0 2023-10-03T10:13:15.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.134+0000 7f428d7fa700 1 -- 172.21.15.146:0/2325272132 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f428801a4a0 con 0x7f42901345a0 2023-10-03T10:13:15.135 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:15.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.136+0000 7f4296e90700 1 -- 172.21.15.146:0/2325272132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42901345a0 msgr2=0x7f4290139e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.136+0000 7f4296e90700 1 --2- 172.21.15.146:0/2325272132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42901345a0 0x7f4290139e80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f428800efc0 tx=0x7f428800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.136+0000 7f4296e90700 1 -- 172.21.15.146:0/2325272132 shutdown_connections 2023-10-03T10:13:15.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.136+0000 7f4296e90700 1 --2- 172.21.15.146:0/2325272132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42901345a0 0x7f4290139e80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.136+0000 7f4296e90700 1 --2- 172.21.15.146:0/2325272132 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f429009ad40 0x7f4290139400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.136+0000 7f4296e90700 1 --2- 172.21.15.146:0/2325272132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4290134140 0x7f4290139940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.136+0000 7f4296e90700 1 -- 172.21.15.146:0/2325272132 >> 172.21.15.146:0/2325272132 conn(0x7f4290099c40 msgr2=0x7f429013b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:15.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.136+0000 7f4296e90700 1 -- 172.21.15.146:0/2325272132 shutdown_connections 2023-10-03T10:13:15.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.136+0000 7f4296e90700 1 -- 172.21.15.146:0/2325272132 wait complete. 2023-10-03T10:13:15.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:15.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.180+0000 7fcbe00b5700 1 -- 172.21.15.146:0/3231319296 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcbd811f260 con 0x7fcbd809bc70 2023-10-03T10:13:15.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.181+0000 7fcbce7fc700 1 -- 172.21.15.146:0/3231319296 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcbd401a770 con 0x7fcbd809bc70 2023-10-03T10:13:15.182 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:15.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.183+0000 7fcbe00b5700 1 -- 172.21.15.146:0/3231319296 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcbd809bc70 msgr2=0x7fcbd811b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.183+0000 7fcbe00b5700 1 --2- 172.21.15.146:0/3231319296 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcbd809bc70 0x7fcbd811b720 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009ba0 tx=0x7fcbd4004750 comp rx=0 tx=0).stop 2023-10-03T10:13:15.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.183+0000 7fcbe00b5700 1 -- 172.21.15.146:0/3231319296 shutdown_connections 2023-10-03T10:13:15.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.183+0000 7fcbe00b5700 1 --2- 172.21.15.146:0/3231319296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbd8131980 0x7fcbd811c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.183+0000 7fcbe00b5700 1 --2- 172.21.15.146:0/3231319296 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcbd809bc70 0x7fcbd811b720 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.183+0000 7fcbe00b5700 1 --2- 172.21.15.146:0/3231319296 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbd809c790 0x7fcbd811bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.183+0000 7fcbe00b5700 1 -- 172.21.15.146:0/3231319296 >> 172.21.15.146:0/3231319296 conn(0x7fcbd80a2980 msgr2=0x7fcbd81b8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:15.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.183+0000 7fcbe00b5700 1 -- 172.21.15.146:0/3231319296 shutdown_connections 2023-10-03T10:13:15.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:15.183+0000 7fcbe00b5700 1 -- 172.21.15.146:0/3231319296 wait complete. 2023-10-03T10:13:15.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:16.002 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:16.059 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:16.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.143+0000 7fb61d11f700 1 Processor -- start 2023-10-03T10:13:16.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.143+0000 7fb61d11f700 1 -- start start 2023-10-03T10:13:16.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.143+0000 7fb61d11f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb6180a1550 0x7fb618138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.143+0000 7fb61d11f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb618139200 0x7fb61813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.143+0000 7fb61d11f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb61809e9d0 con 0x7fb6180a0a70 2023-10-03T10:13:16.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.143+0000 7fb61d11f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb61809dc00 con 0x7fb6180a1550 2023-10-03T10:13:16.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.143+0000 7fb61d11f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb61809dec0 con 0x7fb618139200 2023-10-03T10:13:16.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.143+0000 7fb61659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb6180a1550 0x7fb618138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.143+0000 7fb61759e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb618139200 0x7fb61813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.143+0000 7fb61659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb6180a1550 0x7fb618138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50866/0 (socket says 172.21.15.146:50866) 2023-10-03T10:13:16.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.143+0000 7fb61659c700 1 -- 172.21.15.146:0/3160769121 learned_addr learned my addr 172.21.15.146:0/3160769121 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:16.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.144+0000 7fb61659c700 1 -- 172.21.15.146:0/3160769121 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb618139200 msgr2=0x7fb61813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:16.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.144+0000 7fb61659c700 1 --2- 172.21.15.146:0/3160769121 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb618139200 0x7fb61813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.144+0000 7fb61659c700 1 -- 172.21.15.146:0/3160769121 >> v1:172.21.15.146:6789/0 conn(0x7fb6180a0a70 legacy=0x7fb6180a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.144+0000 7fb615d9b700 1 -- 172.21.15.146:0/3160769121 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388767651 0 0) 0x7fb61809e9d0 con 0x7fb6180a0a70 2023-10-03T10:13:16.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.144+0000 7fb61659c700 1 -- 172.21.15.146:0/3160769121 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61809e6a0 con 0x7fb6180a1550 2023-10-03T10:13:16.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.144+0000 7fb61659c700 1 --2- 172.21.15.146:0/3160769121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6180a1550 0x7fb618138cc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb60c0098f0 tx=0x7fb60c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f408d3470eae33fa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:16.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.144+0000 7fb615d9b700 1 -- 172.21.15.146:0/3160769121 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c011830 con 0x7fb6180a1550 2023-10-03T10:13:16.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.144+0000 7fb615d9b700 1 -- 172.21.15.146:0/3160769121 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60c011990 con 0x7fb6180a1550 2023-10-03T10:13:16.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.144+0000 7fb615d9b700 1 -- 172.21.15.146:0/3160769121 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c011d20 con 0x7fb6180a1550 2023-10-03T10:13:16.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.145+0000 7fb61d11f700 1 -- 172.21.15.146:0/3160769121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6180a1550 msgr2=0x7fb618138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.145+0000 7fb61d11f700 1 --2- 172.21.15.146:0/3160769121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6180a1550 0x7fb618138cc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb60c0098f0 tx=0x7fb60c009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:16.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.145+0000 7fb61d11f700 1 -- 172.21.15.146:0/3160769121 shutdown_connections 2023-10-03T10:13:16.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.145+0000 7fb61d11f700 1 --2- 172.21.15.146:0/3160769121 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb618139200 0x7fb61813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.145+0000 7fb61d11f700 1 --2- 172.21.15.146:0/3160769121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6180a1550 0x7fb618138cc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.145+0000 7fb61d11f700 1 -- 172.21.15.146:0/3160769121 >> 172.21.15.146:0/3160769121 conn(0x7fb6180a6610 msgr2=0x7fb6180a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:16.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.145+0000 7fb61d11f700 1 -- 172.21.15.146:0/3160769121 shutdown_connections 2023-10-03T10:13:16.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.145+0000 7fb61d11f700 1 -- 172.21.15.146:0/3160769121 wait complete. 2023-10-03T10:13:16.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.146+0000 7fb61d11f700 1 Processor -- start 2023-10-03T10:13:16.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.146+0000 7fb61d11f700 1 -- start start 2023-10-03T10:13:16.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.146+0000 7fb61d11f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb6180a0a70 0x7fb6181207c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.146+0000 7fb61d11f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6180a1550 0x7fb618120d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.146+0000 7fb61d11f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb618139200 0x7fb618121240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.146+0000 7fb61d11f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6181360a0 con 0x7fb6180a1550 2023-10-03T10:13:16.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.146+0000 7fb61d11f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb618136660 con 0x7fb618139200 2023-10-03T10:13:16.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.146+0000 7fb61d11f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb618124290 con 0x7fb6180a0a70 2023-10-03T10:13:16.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.147+0000 7fb61659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6180a1550 0x7fb618120d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.147+0000 7fb616d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb6180a0a70 0x7fb6181207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.147+0000 7fb61659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6180a1550 0x7fb618120d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50868/0 (socket says 172.21.15.146:50868) 2023-10-03T10:13:16.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.147+0000 7fb61659c700 1 -- 172.21.15.146:0/26788542 learned_addr learned my addr 172.21.15.146:0/26788542 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:16.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.147+0000 7fb61759e700 1 --2- 172.21.15.146:0/26788542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb618139200 0x7fb618121240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.147+0000 7fb61759e700 1 -- 172.21.15.146:0/26788542 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb6180a0a70 msgr2=0x7fb6181207c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.147+0000 7fb61759e700 1 --2- 172.21.15.146:0/26788542 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb6180a0a70 0x7fb6181207c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.147+0000 7fb61759e700 1 -- 172.21.15.146:0/26788542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6180a1550 msgr2=0x7fb618120d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.147+0000 7fb61759e700 1 --2- 172.21.15.146:0/26788542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6180a1550 0x7fb618120d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.147+0000 7fb61759e700 1 -- 172.21.15.146:0/26788542 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c009550 con 0x7fb618139200 2023-10-03T10:13:16.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.147+0000 7fb616d9d700 1 --2- 172.21.15.146:0/26788542 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb6180a0a70 0x7fb6181207c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:16.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.147+0000 7fb61759e700 1 --2- 172.21.15.146:0/26788542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb618139200 0x7fb618121240 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb61000ef90 tx=0x7fb61000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.147+0000 7fb5ff7fe700 1 -- 172.21.15.146:0/26788542 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61000cc90 con 0x7fb618139200 2023-10-03T10:13:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.147+0000 7fb5ff7fe700 1 -- 172.21.15.146:0/26788542 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61000f040 con 0x7fb618139200 2023-10-03T10:13:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.147+0000 7fb5ff7fe700 1 -- 172.21.15.146:0/26788542 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6100146c0 con 0x7fb618139200 2023-10-03T10:13:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.147+0000 7fb61d11f700 1 -- 172.21.15.146:0/26788542 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6180a5100 con 0x7fb618139200 2023-10-03T10:13:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.147+0000 7fb61d11f700 1 -- 172.21.15.146:0/26788542 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb618122b80 con 0x7fb618139200 2023-10-03T10:13:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.148+0000 7fb5ff7fe700 1 -- 172.21.15.146:0/26788542 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb610014820 con 0x7fb618139200 2023-10-03T10:13:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.148+0000 7fb5ff7fe700 1 -- 172.21.15.146:0/26788542 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb6100403f0 con 0x7fb618139200 2023-10-03T10:13:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.148+0000 7fb61d11f700 1 -- 172.21.15.146:0/26788542 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61804f2a0 con 0x7fb618139200 2023-10-03T10:13:16.154 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:16.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.153+0000 7fb5ff7fe700 1 -- 172.21.15.146:0/26788542 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb610009e60 con 0x7fb618139200 2023-10-03T10:13:16.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.193+0000 7f36f8ea2700 1 Processor -- start 2023-10-03T10:13:16.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.193+0000 7f36f8ea2700 1 -- start start 2023-10-03T10:13:16.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.194+0000 7f36f8ea2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f4138040 0x7f36f4138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.194+0000 7f36f8ea2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f36f40a08e0 0x7f36f40a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.194+0000 7f36f8ea2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36f40a1230 0x7f36f413ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.194+0000 7f36f8ea2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f40a2100 con 0x7f36f40a08e0 2023-10-03T10:13:16.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.194+0000 7f36f8ea2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f4138950 con 0x7f36f4138040 2023-10-03T10:13:16.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.194+0000 7f36f8ea2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36f41379e0 con 0x7f36f40a1230 2023-10-03T10:13:16.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.194+0000 7f36f259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f4138040 0x7f36f4138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.194+0000 7f36f2d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36f40a1230 0x7f36f413ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.194+0000 7f36f259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f4138040 0x7f36f4138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39378/0 (socket says 172.21.15.146:39378) 2023-10-03T10:13:16.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.194+0000 7f36f259c700 1 -- 172.21.15.146:0/2829352171 learned_addr learned my addr 172.21.15.146:0/2829352171 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:16.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.194+0000 7f36f1d9b700 1 --2- 172.21.15.146:0/2829352171 >> v2:172.21.15.146:3300/0 conn(0x7f36f40a08e0 0x7f36f40a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.194+0000 7f36f1d9b700 1 -- 172.21.15.146:0/2829352171 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36f40a1230 msgr2=0x7f36f413ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:16.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.194+0000 7f36f1d9b700 1 --2- 172.21.15.146:0/2829352171 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36f40a1230 0x7f36f413ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.194+0000 7f36f1d9b700 1 -- 172.21.15.146:0/2829352171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f4138040 msgr2=0x7f36f4138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:16.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.194+0000 7f36f1d9b700 1 --2- 172.21.15.146:0/2829352171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f4138040 0x7f36f4138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.194+0000 7f36f1d9b700 1 -- 172.21.15.146:0/2829352171 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f409b9b0 con 0x7f36f40a08e0 2023-10-03T10:13:16.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.195+0000 7f36f1d9b700 1 --2- 172.21.15.146:0/2829352171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36f40a08e0 0x7f36f40a0cf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009870 tx=0x7f36e8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3eb03e1c4fd2a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:16.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.195+0000 7f36f159a700 1 -- 172.21.15.146:0/2829352171 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e8011830 con 0x7f36f40a08e0 2023-10-03T10:13:16.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.195+0000 7f36f159a700 1 -- 172.21.15.146:0/2829352171 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e8011990 con 0x7f36f40a08e0 2023-10-03T10:13:16.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.195+0000 7f36f159a700 1 -- 172.21.15.146:0/2829352171 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e8011d20 con 0x7f36f40a08e0 2023-10-03T10:13:16.197 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:16.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.195+0000 7f36f8ea2700 1 -- 172.21.15.146:0/2829352171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36f40a08e0 msgr2=0x7f36f40a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.195+0000 7f36f8ea2700 1 --2- 172.21.15.146:0/2829352171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36f40a08e0 0x7f36f40a0cf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009870 tx=0x7f36e8009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:16.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.196+0000 7f36f8ea2700 1 -- 172.21.15.146:0/2829352171 shutdown_connections 2023-10-03T10:13:16.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.196+0000 7f36f8ea2700 1 --2- 172.21.15.146:0/2829352171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f4138040 0x7f36f4138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.196+0000 7f36f8ea2700 1 --2- 172.21.15.146:0/2829352171 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36f40a1230 0x7f36f413ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.196+0000 7f36f8ea2700 1 --2- 172.21.15.146:0/2829352171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36f40a08e0 0x7f36f40a0cf0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.196+0000 7f36f8ea2700 1 -- 172.21.15.146:0/2829352171 >> 172.21.15.146:0/2829352171 conn(0x7f36f40a2980 msgr2=0x7f36f40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:16.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.196+0000 7f36f8ea2700 1 -- 172.21.15.146:0/2829352171 shutdown_connections 2023-10-03T10:13:16.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.196+0000 7f36f8ea2700 1 -- 172.21.15.146:0/2829352171 wait complete. 2023-10-03T10:13:16.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.197+0000 7f36f8ea2700 1 Processor -- start 2023-10-03T10:13:16.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.197+0000 7f36f8ea2700 1 -- start start 2023-10-03T10:13:16.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.197+0000 7f36f8ea2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36f40a08e0 0x7f36f41264a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.197+0000 7f36f8ea2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36f40a1230 0x7f36f41269e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.197+0000 7f36f8ea2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f4138040 0x7f36f4126f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.197+0000 7f36f8ea2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f4129c10 con 0x7f36f40a08e0 2023-10-03T10:13:16.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.197+0000 7f36f8ea2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f4127f00 con 0x7f36f4138040 2023-10-03T10:13:16.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.197+0000 7f36f8ea2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36f4129870 con 0x7f36f40a1230 2023-10-03T10:13:16.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.197+0000 7f36f2d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f4138040 0x7f36f4126f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.197+0000 7f36f1d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36f40a1230 0x7f36f41269e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.197+0000 7f36f259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36f40a08e0 0x7f36f41264a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.197+0000 7f36f259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36f40a08e0 0x7f36f41264a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50878/0 (socket says 172.21.15.146:50878) 2023-10-03T10:13:16.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.197+0000 7f36f2d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f4138040 0x7f36f4126f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39382/0 (socket says 172.21.15.146:39382) 2023-10-03T10:13:16.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.197+0000 7f36f259c700 1 -- 172.21.15.146:0/613144407 learned_addr learned my addr 172.21.15.146:0/613144407 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:16.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.198+0000 7f36f259c700 1 -- 172.21.15.146:0/613144407 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36f40a1230 msgr2=0x7f36f41269e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.198+0000 7f36f259c700 1 --2- 172.21.15.146:0/613144407 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36f40a1230 0x7f36f41269e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.198+0000 7f36f259c700 1 -- 172.21.15.146:0/613144407 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f4138040 msgr2=0x7f36f4126f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.198+0000 7f36f259c700 1 --2- 172.21.15.146:0/613144407 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f4138040 0x7f36f4126f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.198+0000 7f36f259c700 1 -- 172.21.15.146:0/613144407 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e80094a0 con 0x7f36f40a08e0 2023-10-03T10:13:16.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.198+0000 7f36f1d9b700 1 --2- 172.21.15.146:0/613144407 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36f40a1230 0x7f36f41269e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:16.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.198+0000 7f36f259c700 1 --2- 172.21.15.146:0/613144407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36f40a08e0 0x7f36f41264a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f36e400e8c0 tx=0x7f36e400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:16.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.198+0000 7f36e2ffd700 1 -- 172.21.15.146:0/613144407 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4013680 con 0x7f36f40a08e0 2023-10-03T10:13:16.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.198+0000 7f36e2ffd700 1 -- 172.21.15.146:0/613144407 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e40137e0 con 0x7f36f40a08e0 2023-10-03T10:13:16.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.198+0000 7f36e2ffd700 1 -- 172.21.15.146:0/613144407 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4013b90 con 0x7f36f40a08e0 2023-10-03T10:13:16.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.198+0000 7f36f8ea2700 1 -- 172.21.15.146:0/613144407 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f4129e10 con 0x7f36f40a08e0 2023-10-03T10:13:16.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.198+0000 7f36f8ea2700 1 -- 172.21.15.146:0/613144407 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f4136e10 con 0x7f36f40a08e0 2023-10-03T10:13:16.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.199+0000 7f36f8ea2700 1 -- 172.21.15.146:0/613144407 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f404f2a0 con 0x7f36f40a08e0 2023-10-03T10:13:16.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.199+0000 7f36e2ffd700 1 -- 172.21.15.146:0/613144407 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f36e4013cf0 con 0x7f36f40a08e0 2023-10-03T10:13:16.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.200+0000 7f36e2ffd700 1 -- 172.21.15.146:0/613144407 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f36e403fea0 con 0x7f36f40a08e0 2023-10-03T10:13:16.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.208+0000 7f36e2ffd700 1 -- 172.21.15.146:0/613144407 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f36e401ab50 con 0x7f36f40a08e0 2023-10-03T10:13:16.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.293+0000 7f925d570700 1 Processor -- start 2023-10-03T10:13:16.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.293+0000 7f925d570700 1 -- start start 2023-10-03T10:13:16.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.293+0000 7f925d570700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f925809ad40 0x7f9258133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.293+0000 7f925d570700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9258133f70 0x7f92581343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.293+0000 7f925d570700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92580a0a70 0x7f92580a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.293+0000 7f925d570700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92580a3b60 con 0x7f9258133f70 2023-10-03T10:13:16.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.294+0000 7f925d570700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92581348e0 con 0x7f92580a0a70 2023-10-03T10:13:16.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.294+0000 7f925d570700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f925809b110 con 0x7f925809ad40 2023-10-03T10:13:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.294+0000 7f92567fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9258133f70 0x7f92581343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.294+0000 7f92567fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9258133f70 0x7f92581343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50890/0 (socket says 172.21.15.146:50890) 2023-10-03T10:13:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.294+0000 7f92577fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92580a0a70 0x7f92580a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.294+0000 7f92567fc700 1 -- 172.21.15.146:0/1460244788 learned_addr learned my addr 172.21.15.146:0/1460244788 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.294+0000 7f9256ffd700 1 --2- 172.21.15.146:0/1460244788 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f925809ad40 0x7f9258133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.294+0000 7f9256ffd700 1 -- 172.21.15.146:0/1460244788 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92580a0a70 msgr2=0x7f92580a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.294+0000 7f9256ffd700 1 --2- 172.21.15.146:0/1460244788 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92580a0a70 0x7f92580a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.294+0000 7f9256ffd700 1 -- 172.21.15.146:0/1460244788 >> v2:172.21.15.146:3300/0 conn(0x7f9258133f70 msgr2=0x7f92581343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.294+0000 7f9256ffd700 1 --2- 172.21.15.146:0/1460244788 >> v2:172.21.15.146:3300/0 conn(0x7f9258133f70 0x7f92581343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.294+0000 7f9256ffd700 1 -- 172.21.15.146:0/1460244788 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92580a2fa0 con 0x7f925809ad40 2023-10-03T10:13:16.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.294+0000 7f92567fc700 1 --2- 172.21.15.146:0/1460244788 >> v2:172.21.15.146:3300/0 conn(0x7f9258133f70 0x7f92581343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:16.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.294+0000 7f9256ffd700 1 --2- 172.21.15.146:0/1460244788 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f925809ad40 0x7f9258133a30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9248009870 tx=0x7f9248009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adba7f9f273a005a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:16.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.294+0000 7f9255ffb700 1 -- 172.21.15.146:0/1460244788 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9248011830 con 0x7f925809ad40 2023-10-03T10:13:16.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.295+0000 7f9255ffb700 1 -- 172.21.15.146:0/1460244788 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9248011990 con 0x7f925809ad40 2023-10-03T10:13:16.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.295+0000 7f9255ffb700 1 -- 172.21.15.146:0/1460244788 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9248011d20 con 0x7f925809ad40 2023-10-03T10:13:16.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.295+0000 7f925d570700 1 -- 172.21.15.146:0/1460244788 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f925809ad40 msgr2=0x7f9258133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.295+0000 7f925d570700 1 --2- 172.21.15.146:0/1460244788 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f925809ad40 0x7f9258133a30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9248009870 tx=0x7f9248009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:16.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.295+0000 7f925d570700 1 -- 172.21.15.146:0/1460244788 shutdown_connections 2023-10-03T10:13:16.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.295+0000 7f925d570700 1 --2- 172.21.15.146:0/1460244788 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92580a0a70 0x7f92580a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.295+0000 7f925d570700 1 --2- 172.21.15.146:0/1460244788 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f925809ad40 0x7f9258133a30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.295+0000 7f925d570700 1 --2- 172.21.15.146:0/1460244788 >> v2:172.21.15.146:3300/0 conn(0x7f9258133f70 0x7f92581343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.295+0000 7f925d570700 1 -- 172.21.15.146:0/1460244788 >> 172.21.15.146:0/1460244788 conn(0x7f9258099c40 msgr2=0x7f925806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:16.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.295+0000 7f925d570700 1 -- 172.21.15.146:0/1460244788 shutdown_connections 2023-10-03T10:13:16.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.295+0000 7f925d570700 1 -- 172.21.15.146:0/1460244788 wait complete. 2023-10-03T10:13:16.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.297+0000 7f925d570700 1 Processor -- start 2023-10-03T10:13:16.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.297+0000 7f925d570700 1 -- start start 2023-10-03T10:13:16.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.297+0000 7f925d570700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f925809ad40 0x7f92581c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.297+0000 7f925d570700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92580a0a70 0x7f92581c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.297+0000 7f925d570700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9258133f70 0x7f92581c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.297+0000 7f925d570700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92581208f0 con 0x7f9258133f70 2023-10-03T10:13:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.297+0000 7f925d570700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9258120ad0 con 0x7f92580a0a70 2023-10-03T10:13:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.297+0000 7f925d570700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92581c5cf0 con 0x7f925809ad40 2023-10-03T10:13:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.298+0000 7f92577fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9258133f70 0x7f92581c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.298+0000 7f92577fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9258133f70 0x7f92581c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50902/0 (socket says 172.21.15.146:50902) 2023-10-03T10:13:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.298+0000 7f92577fe700 1 -- 172.21.15.146:0/2167127427 learned_addr learned my addr 172.21.15.146:0/2167127427 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.298+0000 7f9256ffd700 1 --2- 172.21.15.146:0/2167127427 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f925809ad40 0x7f92581c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.298+0000 7f92567fc700 1 --2- 172.21.15.146:0/2167127427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92580a0a70 0x7f92581c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.298+0000 7f92567fc700 1 -- 172.21.15.146:0/2167127427 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f925809ad40 msgr2=0x7f92581c5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.298+0000 7f92567fc700 1 --2- 172.21.15.146:0/2167127427 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f925809ad40 0x7f92581c5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.298+0000 7f92567fc700 1 -- 172.21.15.146:0/2167127427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9258133f70 msgr2=0x7f92581c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.298+0000 7f92567fc700 1 --2- 172.21.15.146:0/2167127427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9258133f70 0x7f92581c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.298+0000 7f92567fc700 1 -- 172.21.15.146:0/2167127427 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924c009550 con 0x7f92580a0a70 2023-10-03T10:13:16.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.298+0000 7f92567fc700 1 --2- 172.21.15.146:0/2167127427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92580a0a70 0x7f92581c57b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f924c00e9a0 tx=0x7f924c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:16.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.298+0000 7f923f7fe700 1 -- 172.21.15.146:0/2167127427 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c004240 con 0x7f92580a0a70 2023-10-03T10:13:16.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.298+0000 7f923f7fe700 1 -- 172.21.15.146:0/2167127427 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924c0043a0 con 0x7f92580a0a70 2023-10-03T10:13:16.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.298+0000 7f925d570700 1 -- 172.21.15.146:0/2167127427 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92480094a0 con 0x7f92580a0a70 2023-10-03T10:13:16.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.298+0000 7f923f7fe700 1 -- 172.21.15.146:0/2167127427 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c0036a0 con 0x7f92580a0a70 2023-10-03T10:13:16.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.298+0000 7f925d570700 1 -- 172.21.15.146:0/2167127427 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9258120530 con 0x7f92580a0a70 2023-10-03T10:13:16.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.299+0000 7f923f7fe700 1 -- 172.21.15.146:0/2167127427 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f924c003800 con 0x7f92580a0a70 2023-10-03T10:13:16.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.299+0000 7f923f7fe700 1 -- 172.21.15.146:0/2167127427 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f924c03f7c0 con 0x7f92580a0a70 2023-10-03T10:13:16.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.300+0000 7f925d570700 1 -- 172.21.15.146:0/2167127427 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9258120720 con 0x7f92580a0a70 2023-10-03T10:13:16.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.304+0000 7f923f7fe700 1 -- 172.21.15.146:0/2167127427 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f924c013470 con 0x7f92580a0a70 2023-10-03T10:13:16.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.350+0000 7f25e614a700 1 Processor -- start 2023-10-03T10:13:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.350+0000 7f25e614a700 1 -- start start 2023-10-03T10:13:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.350+0000 7f25e614a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25e00a0a70 0x7f25e00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.350+0000 7f25e614a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f25e00a1380 0x7f25e0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.350+0000 7f25e614a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25e0133f50 0x7f25e0134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.350+0000 7f25e614a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e009e9d0 con 0x7f25e00a1380 2023-10-03T10:13:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.350+0000 7f25e614a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e009dc00 con 0x7f25e00a0a70 2023-10-03T10:13:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.350+0000 7f25e614a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25e009dec0 con 0x7f25e0133f50 2023-10-03T10:13:16.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.351+0000 7f25deffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f25e00a1380 0x7f25e0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.351+0000 7f25deffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f25e00a1380 0x7f25e0133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50914/0 (socket says 172.21.15.146:50914) 2023-10-03T10:13:16.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.351+0000 7f25deffd700 1 -- 172.21.15.146:0/3703677366 learned_addr learned my addr 172.21.15.146:0/3703677366 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:16.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.351+0000 7f25df7fe700 1 --2- 172.21.15.146:0/3703677366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25e00a0a70 0x7f25e00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.351+0000 7f25dffff700 1 --2- 172.21.15.146:0/3703677366 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25e0133f50 0x7f25e0134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.351+0000 7f25deffd700 1 -- 172.21.15.146:0/3703677366 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25e0133f50 msgr2=0x7f25e0134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:16.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.351+0000 7f25deffd700 1 --2- 172.21.15.146:0/3703677366 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25e0133f50 0x7f25e0134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.351+0000 7f25deffd700 1 -- 172.21.15.146:0/3703677366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25e00a0a70 msgr2=0x7f25e00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:16.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.351+0000 7f25deffd700 1 --2- 172.21.15.146:0/3703677366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25e00a0a70 0x7f25e00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.351+0000 7f25deffd700 1 -- 172.21.15.146:0/3703677366 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e009e6a0 con 0x7f25e00a1380 2023-10-03T10:13:16.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.351+0000 7f25deffd700 1 --2- 172.21.15.146:0/3703677366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25e00a1380 0x7f25e0133a10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f25d40098f0 tx=0x7f25d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2942a2180635d08f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:16.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.351+0000 7f25de7fc700 1 -- 172.21.15.146:0/3703677366 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d4011830 con 0x7f25e00a1380 2023-10-03T10:13:16.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.351+0000 7f25de7fc700 1 -- 172.21.15.146:0/3703677366 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d4011990 con 0x7f25e00a1380 2023-10-03T10:13:16.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.351+0000 7f25de7fc700 1 -- 172.21.15.146:0/3703677366 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d4011d20 con 0x7f25e00a1380 2023-10-03T10:13:16.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.352+0000 7f25e614a700 1 -- 172.21.15.146:0/3703677366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25e00a1380 msgr2=0x7f25e0133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.352+0000 7f25e614a700 1 --2- 172.21.15.146:0/3703677366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25e00a1380 0x7f25e0133a10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f25d40098f0 tx=0x7f25d4009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:16.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.352+0000 7f25e614a700 1 -- 172.21.15.146:0/3703677366 shutdown_connections 2023-10-03T10:13:16.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.352+0000 7f25e614a700 1 --2- 172.21.15.146:0/3703677366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25e00a0a70 0x7f25e00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.352+0000 7f25e614a700 1 --2- 172.21.15.146:0/3703677366 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25e0133f50 0x7f25e0134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.352+0000 7f25e614a700 1 --2- 172.21.15.146:0/3703677366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25e00a1380 0x7f25e0133a10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.352+0000 7f25e614a700 1 -- 172.21.15.146:0/3703677366 >> 172.21.15.146:0/3703677366 conn(0x7f25e00a6610 msgr2=0x7f25e00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:16.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.352+0000 7f25e614a700 1 -- 172.21.15.146:0/3703677366 shutdown_connections 2023-10-03T10:13:16.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.352+0000 7f25e614a700 1 -- 172.21.15.146:0/3703677366 wait complete. 2023-10-03T10:13:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.353+0000 7f25e614a700 1 Processor -- start 2023-10-03T10:13:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.354+0000 7f25e614a700 1 -- start start 2023-10-03T10:13:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.354+0000 7f25e614a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25e00a0a70 0x7f25e0126360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.354+0000 7f25e614a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25e00a1380 0x7f25e01268a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.354+0000 7f25e614a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25e0133f50 0x7f25e0126de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.354+0000 7f25e614a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e0129760 con 0x7f25e0133f50 2023-10-03T10:13:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.354+0000 7f25e614a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e012a850 con 0x7f25e00a0a70 2023-10-03T10:13:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.354+0000 7f25e614a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25e0129eb0 con 0x7f25e00a1380 2023-10-03T10:13:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.354+0000 7f25dffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25e0133f50 0x7f25e0126de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.354+0000 7f25dffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25e0133f50 0x7f25e0126de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50930/0 (socket says 172.21.15.146:50930) 2023-10-03T10:13:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.354+0000 7f25dffff700 1 -- 172.21.15.146:0/281800234 learned_addr learned my addr 172.21.15.146:0/281800234 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.354+0000 7f25df7fe700 1 --2- 172.21.15.146:0/281800234 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25e00a0a70 0x7f25e0126360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.354+0000 7f25deffd700 1 --2- 172.21.15.146:0/281800234 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25e00a1380 0x7f25e01268a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.355+0000 7f25deffd700 1 -- 172.21.15.146:0/281800234 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25e00a0a70 msgr2=0x7f25e0126360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.355+0000 7f25deffd700 1 --2- 172.21.15.146:0/281800234 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25e00a0a70 0x7f25e0126360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.355+0000 7f25deffd700 1 -- 172.21.15.146:0/281800234 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25e0133f50 msgr2=0x7f25e0126de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.355+0000 7f25deffd700 1 --2- 172.21.15.146:0/281800234 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25e0133f50 0x7f25e0126de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.355+0000 7f25deffd700 1 -- 172.21.15.146:0/281800234 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d4009550 con 0x7f25e00a1380 2023-10-03T10:13:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.355+0000 7f25dffff700 1 --2- 172.21.15.146:0/281800234 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25e0133f50 0x7f25e0126de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.355+0000 7f25deffd700 1 --2- 172.21.15.146:0/281800234 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25e00a1380 0x7f25e01268a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f25d4016000 tx=0x7f25d4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.355+0000 7f25c7fff700 1 -- 172.21.15.146:0/281800234 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d4004240 con 0x7f25e00a1380 2023-10-03T10:13:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.355+0000 7f25c7fff700 1 -- 172.21.15.146:0/281800234 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d401f070 con 0x7f25e00a1380 2023-10-03T10:13:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.355+0000 7f25e614a700 1 -- 172.21.15.146:0/281800234 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e0127d60 con 0x7f25e00a1380 2023-10-03T10:13:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.355+0000 7f25c7fff700 1 -- 172.21.15.146:0/281800234 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d40036a0 con 0x7f25e00a1380 2023-10-03T10:13:16.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.355+0000 7f25e614a700 1 -- 172.21.15.146:0/281800234 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e0128550 con 0x7f25e00a1380 2023-10-03T10:13:16.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.356+0000 7f25e614a700 1 -- 172.21.15.146:0/281800234 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e0128370 con 0x7f25e00a1380 2023-10-03T10:13:16.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.357+0000 7f25c7fff700 1 -- 172.21.15.146:0/281800234 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25d4021030 con 0x7f25e00a1380 2023-10-03T10:13:16.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.357+0000 7f25c7fff700 1 -- 172.21.15.146:0/281800234 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f25d4040b10 con 0x7f25e00a1380 2023-10-03T10:13:16.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.358+0000 7fb61d11f700 1 -- 172.21.15.146:0/26788542 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb618072980 con 0x7fb618139200 2023-10-03T10:13:16.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.358+0000 7fb5ff7fe700 1 -- 172.21.15.146:0/26788542 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb61002c090 con 0x7fb618139200 2023-10-03T10:13:16.361 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:16.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.360+0000 7fb61d11f700 1 -- 172.21.15.146:0/26788542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb618139200 msgr2=0x7fb618121240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.360+0000 7fb61d11f700 1 --2- 172.21.15.146:0/26788542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb618139200 0x7fb618121240 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb61000ef90 tx=0x7fb61000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.361+0000 7fb61d11f700 1 -- 172.21.15.146:0/26788542 shutdown_connections 2023-10-03T10:13:16.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.361+0000 7fb61d11f700 1 --2- 172.21.15.146:0/26788542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb618139200 0x7fb618121240 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.361+0000 7fb61d11f700 1 --2- 172.21.15.146:0/26788542 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb6180a0a70 0x7fb6181207c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.361+0000 7fb61d11f700 1 --2- 172.21.15.146:0/26788542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6180a1550 0x7fb618120d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.361+0000 7fb61d11f700 1 -- 172.21.15.146:0/26788542 >> 172.21.15.146:0/26788542 conn(0x7fb6180a6610 msgr2=0x7fb6180a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:16.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.361+0000 7fb61d11f700 1 -- 172.21.15.146:0/26788542 shutdown_connections 2023-10-03T10:13:16.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.361+0000 7fb61d11f700 1 -- 172.21.15.146:0/26788542 wait complete. 2023-10-03T10:13:16.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.366+0000 7f25c7fff700 1 -- 172.21.15.146:0/281800234 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25e0128370 con 0x7f25e00a1380 2023-10-03T10:13:16.374 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:16.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.414+0000 7f36f8ea2700 1 -- 172.21.15.146:0/613144407 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f36f406bce0 con 0x7f36f40a08e0 2023-10-03T10:13:16.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.415+0000 7f36e2ffd700 1 -- 172.21.15.146:0/613144407 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f36e402b090 con 0x7f36f40a08e0 2023-10-03T10:13:16.415 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:16.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.417+0000 7f36f8ea2700 1 -- 172.21.15.146:0/613144407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36f40a08e0 msgr2=0x7f36f41264a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.417+0000 7f36f8ea2700 1 --2- 172.21.15.146:0/613144407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36f40a08e0 0x7f36f41264a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f36e400e8c0 tx=0x7f36e400ebd0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.417+0000 7f36f8ea2700 1 -- 172.21.15.146:0/613144407 shutdown_connections 2023-10-03T10:13:16.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.417+0000 7f36f8ea2700 1 --2- 172.21.15.146:0/613144407 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f4138040 0x7f36f4126f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.417+0000 7f36f8ea2700 1 --2- 172.21.15.146:0/613144407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36f40a08e0 0x7f36f41264a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.417+0000 7f36f8ea2700 1 --2- 172.21.15.146:0/613144407 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36f40a1230 0x7f36f41269e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.417+0000 7f36f8ea2700 1 -- 172.21.15.146:0/613144407 >> 172.21.15.146:0/613144407 conn(0x7f36f40a2980 msgr2=0x7f36f409e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:16.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.417+0000 7f36f8ea2700 1 -- 172.21.15.146:0/613144407 shutdown_connections 2023-10-03T10:13:16.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.417+0000 7f36f8ea2700 1 -- 172.21.15.146:0/613144407 wait complete. 2023-10-03T10:13:16.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:16.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.532+0000 7f925d570700 1 -- 172.21.15.146:0/2167127427 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f925804f2a0 con 0x7f92580a0a70 2023-10-03T10:13:16.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.532+0000 7f923f7fe700 1 -- 172.21.15.146:0/2167127427 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f924c02b090 con 0x7f92580a0a70 2023-10-03T10:13:16.533 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:16.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.536+0000 7f925d570700 1 -- 172.21.15.146:0/2167127427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92580a0a70 msgr2=0x7f92581c57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.536+0000 7f925d570700 1 --2- 172.21.15.146:0/2167127427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92580a0a70 0x7f92581c57b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f924c00e9a0 tx=0x7f924c00ecb0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.536+0000 7f925d570700 1 -- 172.21.15.146:0/2167127427 shutdown_connections 2023-10-03T10:13:16.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.536+0000 7f925d570700 1 --2- 172.21.15.146:0/2167127427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9258133f70 0x7f92581c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.536+0000 7f925d570700 1 --2- 172.21.15.146:0/2167127427 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f925809ad40 0x7f92581c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.536+0000 7f925d570700 1 --2- 172.21.15.146:0/2167127427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92580a0a70 0x7f92581c57b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.536+0000 7f925d570700 1 -- 172.21.15.146:0/2167127427 >> 172.21.15.146:0/2167127427 conn(0x7f9258099c40 msgr2=0x7f9258132170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:16.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.536+0000 7f925d570700 1 -- 172.21.15.146:0/2167127427 shutdown_connections 2023-10-03T10:13:16.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.536+0000 7f925d570700 1 -- 172.21.15.146:0/2167127427 wait complete. 2023-10-03T10:13:16.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:16.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.574+0000 7f25e614a700 1 -- 172.21.15.146:0/281800234 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f25e0128370 con 0x7f25e00a1380 2023-10-03T10:13:16.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.574+0000 7f25c7fff700 1 -- 172.21.15.146:0/281800234 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25e0128370 con 0x7f25e00a1380 2023-10-03T10:13:16.575 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:16.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.577+0000 7f25e614a700 1 -- 172.21.15.146:0/281800234 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25e00a1380 msgr2=0x7f25e01268a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.577+0000 7f25e614a700 1 --2- 172.21.15.146:0/281800234 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25e00a1380 0x7f25e01268a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f25d4016000 tx=0x7f25d4004750 comp rx=0 tx=0).stop 2023-10-03T10:13:16.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.577+0000 7f25e614a700 1 -- 172.21.15.146:0/281800234 shutdown_connections 2023-10-03T10:13:16.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.577+0000 7f25e614a700 1 --2- 172.21.15.146:0/281800234 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25e0133f50 0x7f25e0126de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.577+0000 7f25e614a700 1 --2- 172.21.15.146:0/281800234 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25e00a0a70 0x7f25e0126360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.577+0000 7f25e614a700 1 --2- 172.21.15.146:0/281800234 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25e00a1380 0x7f25e01268a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.577+0000 7f25e614a700 1 -- 172.21.15.146:0/281800234 >> 172.21.15.146:0/281800234 conn(0x7f25e00a6610 msgr2=0x7f25e0099e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:16.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.577+0000 7f25e614a700 1 -- 172.21.15.146:0/281800234 shutdown_connections 2023-10-03T10:13:16.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:16.577+0000 7f25e614a700 1 -- 172.21.15.146:0/281800234 wait complete. 2023-10-03T10:13:16.589 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:17.375 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:17.431 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:17.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.506+0000 7f95cc3c5700 1 Processor -- start 2023-10-03T10:13:17.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.506+0000 7f95cc3c5700 1 -- start start 2023-10-03T10:13:17.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.507+0000 7f95cc3c5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95c40a0a70 0x7f95c40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.507+0000 7f95cc3c5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f95c4134120 0x7f95c413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.507+0000 7f95cc3c5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c409dc00 con 0x7f95c40a1380 2023-10-03T10:13:17.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.507+0000 7f95cc3c5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c409ea60 con 0x7f95c4134120 2023-10-03T10:13:17.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.507+0000 7f95cc3c5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c409dec0 con 0x7f95c40a0a70 2023-10-03T10:13:17.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.507+0000 7f95ca962700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f95c4134120 0x7f95c413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.507+0000 7f95ca161700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95c40a0a70 0x7f95c40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.507+0000 7f95c9960700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f95c40a1380 0x7f95c4133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50232/0 (socket says 172.21.15.146:50232) 2023-10-03T10:13:17.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.507+0000 7f95c9960700 1 -- 172.21.15.146:0/2636233467 learned_addr learned my addr 172.21.15.146:0/2636233467 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:17.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.507+0000 7f95ca161700 1 -- 172.21.15.146:0/2636233467 >> v2:172.21.15.146:3300/0 conn(0x7f95c4134120 msgr2=0x7f95c413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:17.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.507+0000 7f95ca161700 1 --2- 172.21.15.146:0/2636233467 >> v2:172.21.15.146:3300/0 conn(0x7f95c4134120 0x7f95c413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.507+0000 7f95ca161700 1 -- 172.21.15.146:0/2636233467 >> v1:172.21.15.146:6789/0 conn(0x7f95c40a1380 legacy=0x7f95c4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.507+0000 7f95ca161700 1 -- 172.21.15.146:0/2636233467 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c409e6a0 con 0x7f95c40a0a70 2023-10-03T10:13:17.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.507+0000 7f95c915f700 1 -- 172.21.15.146:0/2636233467 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598241355 0 0) 0x7f95c409dc00 con 0x7f95c40a1380 2023-10-03T10:13:17.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.507+0000 7f95ca962700 1 --2- 172.21.15.146:0/2636233467 >> v2:172.21.15.146:3300/0 conn(0x7f95c4134120 0x7f95c413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:17.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.508+0000 7f95ca161700 1 --2- 172.21.15.146:0/2636233467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95c40a0a70 0x7f95c40a0e40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009840 tx=0x7f95c0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed4464869539a7e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.508+0000 7f95c915f700 1 -- 172.21.15.146:0/2636233467 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c0011830 con 0x7f95c40a0a70 2023-10-03T10:13:17.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.508+0000 7f95c915f700 1 -- 172.21.15.146:0/2636233467 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c0011990 con 0x7f95c40a0a70 2023-10-03T10:13:17.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.508+0000 7f95c915f700 1 -- 172.21.15.146:0/2636233467 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c0011d20 con 0x7f95c40a0a70 2023-10-03T10:13:17.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.508+0000 7f95cc3c5700 1 -- 172.21.15.146:0/2636233467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95c40a0a70 msgr2=0x7f95c40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.508+0000 7f95cc3c5700 1 --2- 172.21.15.146:0/2636233467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95c40a0a70 0x7f95c40a0e40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009840 tx=0x7f95c0009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:17.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.508+0000 7f95cc3c5700 1 -- 172.21.15.146:0/2636233467 shutdown_connections 2023-10-03T10:13:17.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.508+0000 7f95cc3c5700 1 --2- 172.21.15.146:0/2636233467 >> v2:172.21.15.146:3300/0 conn(0x7f95c4134120 0x7f95c413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.508+0000 7f95cc3c5700 1 --2- 172.21.15.146:0/2636233467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95c40a0a70 0x7f95c40a0e40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.508+0000 7f95cc3c5700 1 -- 172.21.15.146:0/2636233467 >> 172.21.15.146:0/2636233467 conn(0x7f95c40a6610 msgr2=0x7f95c40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.508+0000 7f95cc3c5700 1 -- 172.21.15.146:0/2636233467 shutdown_connections 2023-10-03T10:13:17.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.508+0000 7f95cc3c5700 1 -- 172.21.15.146:0/2636233467 wait complete. 2023-10-03T10:13:17.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.509+0000 7f95cc3c5700 1 Processor -- start 2023-10-03T10:13:17.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.509+0000 7f95cc3c5700 1 -- start start 2023-10-03T10:13:17.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.510+0000 7f95cc3c5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95c40a0a70 0x7f95c4122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.510+0000 7f95cc3c5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95c40a1380 0x7f95c4122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.510+0000 7f95cc3c5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95c4134120 0x7f95c4123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.510+0000 7f95cc3c5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c4133300 con 0x7f95c40a0a70 2023-10-03T10:13:17.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.510+0000 7f95cc3c5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c4125aa0 con 0x7f95c40a1380 2023-10-03T10:13:17.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.510+0000 7f95cc3c5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95c4133650 con 0x7f95c4134120 2023-10-03T10:13:17.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.510+0000 7f95c9960700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95c40a1380 0x7f95c4122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.510+0000 7f95ca161700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95c40a0a70 0x7f95c4122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.510+0000 7f95c9960700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95c40a1380 0x7f95c4122cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39432/0 (socket says 172.21.15.146:39432) 2023-10-03T10:13:17.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.510+0000 7f95c9960700 1 -- 172.21.15.146:0/690545915 learned_addr learned my addr 172.21.15.146:0/690545915 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:17.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.510+0000 7f95ca962700 1 --2- 172.21.15.146:0/690545915 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95c4134120 0x7f95c4123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.510+0000 7f95ca161700 1 -- 172.21.15.146:0/690545915 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95c4134120 msgr2=0x7f95c4123210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.510+0000 7f95ca161700 1 --2- 172.21.15.146:0/690545915 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95c4134120 0x7f95c4123210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.510+0000 7f95ca161700 1 -- 172.21.15.146:0/690545915 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95c40a1380 msgr2=0x7f95c4122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.510+0000 7f95ca161700 1 --2- 172.21.15.146:0/690545915 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95c40a1380 0x7f95c4122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.510+0000 7f95ca161700 1 -- 172.21.15.146:0/690545915 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc009a70 con 0x7f95c40a0a70 2023-10-03T10:13:17.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.510+0000 7f95c9960700 1 --2- 172.21.15.146:0/690545915 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95c40a1380 0x7f95c4122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:17.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.510+0000 7f95ca962700 1 --2- 172.21.15.146:0/690545915 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95c4134120 0x7f95c4123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:17.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.510+0000 7f95ca161700 1 --2- 172.21.15.146:0/690545915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95c40a0a70 0x7f95c4122790 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f95c0016000 tx=0x7f95c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.510+0000 7f95baffd700 1 -- 172.21.15.146:0/690545915 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c00045d0 con 0x7f95c40a0a70 2023-10-03T10:13:17.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.510+0000 7f95baffd700 1 -- 172.21.15.146:0/690545915 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c001f070 con 0x7f95c40a0a70 2023-10-03T10:13:17.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.510+0000 7f95baffd700 1 -- 172.21.15.146:0/690545915 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c00038a0 con 0x7f95c40a0a70 2023-10-03T10:13:17.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.511+0000 7f95cc3c5700 1 -- 172.21.15.146:0/690545915 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c00094a0 con 0x7f95c40a0a70 2023-10-03T10:13:17.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.511+0000 7f95cc3c5700 1 -- 172.21.15.146:0/690545915 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c4133990 con 0x7f95c40a0a70 2023-10-03T10:13:17.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.511+0000 7f95baffd700 1 -- 172.21.15.146:0/690545915 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f95c0003a00 con 0x7f95c40a0a70 2023-10-03T10:13:17.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.511+0000 7f95cc3c5700 1 -- 172.21.15.146:0/690545915 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c4125e60 con 0x7f95c40a0a70 2023-10-03T10:13:17.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.512+0000 7f95baffd700 1 -- 172.21.15.146:0/690545915 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f95c0021070 con 0x7f95c40a0a70 2023-10-03T10:13:17.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.520+0000 7f95baffd700 1 -- 172.21.15.146:0/690545915 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f95c002f760 con 0x7f95c40a0a70 2023-10-03T10:13:17.549 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:17.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.559+0000 7fb8f0759700 1 Processor -- start 2023-10-03T10:13:17.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.560+0000 7fb8f0759700 1 -- start start 2023-10-03T10:13:17.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.560+0000 7fb8f0759700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8e806a770 0x7fb8e806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.560+0000 7fb8f0759700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8e806b080 0x7fb8e81317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.560+0000 7fb8f0759700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8e8131cf0 0x7fb8e8132190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.560+0000 7fb8f0759700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e809f770 con 0x7fb8e8131cf0 2023-10-03T10:13:17.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.560+0000 7fb8f0759700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e809dce0 con 0x7fb8e806b080 2023-10-03T10:13:17.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.560+0000 7fb8f0759700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e809da80 con 0x7fb8e806a770 2023-10-03T10:13:17.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.560+0000 7fb8edcf4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8e806b080 0x7fb8e81317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.560+0000 7fb8eecf6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8e8131cf0 0x7fb8e8132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.560+0000 7fb8eecf6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8e8131cf0 0x7fb8e8132190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50956/0 (socket says 172.21.15.146:50956) 2023-10-03T10:13:17.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.560+0000 7fb8eecf6700 1 -- 172.21.15.146:0/3998145314 learned_addr learned my addr 172.21.15.146:0/3998145314 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:17.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.560+0000 7fb8edcf4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8e806b080 0x7fb8e81317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39446/0 (socket says 172.21.15.146:39446) 2023-10-03T10:13:17.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.560+0000 7fb8ee4f5700 1 --2- 172.21.15.146:0/3998145314 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8e806a770 0x7fb8e806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.561+0000 7fb8edcf4700 1 -- 172.21.15.146:0/3998145314 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8e806a770 msgr2=0x7fb8e806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:17.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.561+0000 7fb8edcf4700 1 --2- 172.21.15.146:0/3998145314 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8e806a770 0x7fb8e806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.561+0000 7fb8edcf4700 1 -- 172.21.15.146:0/3998145314 >> v2:172.21.15.146:3300/0 conn(0x7fb8e8131cf0 msgr2=0x7fb8e8132190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:17.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.561+0000 7fb8edcf4700 1 --2- 172.21.15.146:0/3998145314 >> v2:172.21.15.146:3300/0 conn(0x7fb8e8131cf0 0x7fb8e8132190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.561+0000 7fb8edcf4700 1 -- 172.21.15.146:0/3998145314 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e809eb20 con 0x7fb8e806b080 2023-10-03T10:13:17.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.561+0000 7fb8ee4f5700 1 --2- 172.21.15.146:0/3998145314 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8e806a770 0x7fb8e806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:17.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.561+0000 7fb8eecf6700 1 --2- 172.21.15.146:0/3998145314 >> v2:172.21.15.146:3300/0 conn(0x7fb8e8131cf0 0x7fb8e8132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:17.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.561+0000 7fb8edcf4700 1 --2- 172.21.15.146:0/3998145314 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8e806b080 0x7fb8e81317b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8009870 tx=0x7fb8d8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccd771ef7597e056 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.561+0000 7fb8ed4f3700 1 -- 172.21.15.146:0/3998145314 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8011830 con 0x7fb8e806b080 2023-10-03T10:13:17.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.561+0000 7fb8ed4f3700 1 -- 172.21.15.146:0/3998145314 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d8011990 con 0x7fb8e806b080 2023-10-03T10:13:17.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.561+0000 7fb8ed4f3700 1 -- 172.21.15.146:0/3998145314 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8011d20 con 0x7fb8e806b080 2023-10-03T10:13:17.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.562+0000 7fb8f0759700 1 -- 172.21.15.146:0/3998145314 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8e806b080 msgr2=0x7fb8e81317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.562+0000 7fb8f0759700 1 --2- 172.21.15.146:0/3998145314 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8e806b080 0x7fb8e81317b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8009870 tx=0x7fb8d8009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:17.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.562+0000 7fb8f0759700 1 -- 172.21.15.146:0/3998145314 shutdown_connections 2023-10-03T10:13:17.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.562+0000 7fb8f0759700 1 --2- 172.21.15.146:0/3998145314 >> v2:172.21.15.146:3300/0 conn(0x7fb8e8131cf0 0x7fb8e8132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.562+0000 7fb8f0759700 1 --2- 172.21.15.146:0/3998145314 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8e806a770 0x7fb8e806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.562+0000 7fb8f0759700 1 --2- 172.21.15.146:0/3998145314 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8e806b080 0x7fb8e81317b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.562+0000 7fb8f0759700 1 -- 172.21.15.146:0/3998145314 >> 172.21.15.146:0/3998145314 conn(0x7fb8e8099c40 msgr2=0x7fb8e80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.562+0000 7fb8f0759700 1 -- 172.21.15.146:0/3998145314 shutdown_connections 2023-10-03T10:13:17.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.562+0000 7fb8f0759700 1 -- 172.21.15.146:0/3998145314 wait complete. 2023-10-03T10:13:17.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.563+0000 7fb8f0759700 1 Processor -- start 2023-10-03T10:13:17.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.563+0000 7fb8f0759700 1 -- start start 2023-10-03T10:13:17.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.563+0000 7fb8f0759700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8e806a770 0x7fb8e809ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.563+0000 7fb8f0759700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8e806b080 0x7fb8e809b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.563+0000 7fb8f0759700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8e8131cf0 0x7fb8e81c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.563+0000 7fb8f0759700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e809aa40 con 0x7fb8e8131cf0 2023-10-03T10:13:17.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.563+0000 7fb8f0759700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80a3180 con 0x7fb8e806a770 2023-10-03T10:13:17.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.563+0000 7fb8f0759700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e8071e10 con 0x7fb8e806b080 2023-10-03T10:13:17.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.564+0000 7fb8ee4f5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8e806a770 0x7fb8e809ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.564+0000 7fb8eecf6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8e8131cf0 0x7fb8e81c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.564+0000 7fb8ee4f5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8e806a770 0x7fb8e809ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39450/0 (socket says 172.21.15.146:39450) 2023-10-03T10:13:17.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.564+0000 7fb8ee4f5700 1 -- 172.21.15.146:0/1388681857 learned_addr learned my addr 172.21.15.146:0/1388681857 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:17.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.564+0000 7fb8edcf4700 1 --2- 172.21.15.146:0/1388681857 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8e806b080 0x7fb8e809b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.564+0000 7fb8ee4f5700 1 -- 172.21.15.146:0/1388681857 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8e806b080 msgr2=0x7fb8e809b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.564+0000 7fb8ee4f5700 1 --2- 172.21.15.146:0/1388681857 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8e806b080 0x7fb8e809b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.564+0000 7fb8ee4f5700 1 -- 172.21.15.146:0/1388681857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8e8131cf0 msgr2=0x7fb8e81c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.564+0000 7fb8ee4f5700 1 --2- 172.21.15.146:0/1388681857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8e8131cf0 0x7fb8e81c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.564+0000 7fb8ee4f5700 1 -- 172.21.15.146:0/1388681857 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e40094a0 con 0x7fb8e806a770 2023-10-03T10:13:17.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.564+0000 7fb8eecf6700 1 --2- 172.21.15.146:0/1388681857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8e8131cf0 0x7fb8e81c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:17.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.564+0000 7fb8ee4f5700 1 --2- 172.21.15.146:0/1388681857 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8e806a770 0x7fb8e809ae50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400ebe0 tx=0x7fb8e400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.564+0000 7fb8edcf4700 1 --2- 172.21.15.146:0/1388681857 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8e806b080 0x7fb8e809b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:17.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.564+0000 7fb8deffd700 1 -- 172.21.15.146:0/1388681857 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400c910 con 0x7fb8e806a770 2023-10-03T10:13:17.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.564+0000 7fb8deffd700 1 -- 172.21.15.146:0/1388681857 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e400ca70 con 0x7fb8e806a770 2023-10-03T10:13:17.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.564+0000 7fb8f0759700 1 -- 172.21.15.146:0/1388681857 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e0009b30 con 0x7fb8e806a770 2023-10-03T10:13:17.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.564+0000 7fb8deffd700 1 -- 172.21.15.146:0/1388681857 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400cde0 con 0x7fb8e806a770 2023-10-03T10:13:17.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.564+0000 7fb8f0759700 1 -- 172.21.15.146:0/1388681857 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d80094a0 con 0x7fb8e806a770 2023-10-03T10:13:17.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.565+0000 7fb8f0759700 1 -- 172.21.15.146:0/1388681857 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e8121000 con 0x7fb8e806a770 2023-10-03T10:13:17.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.566+0000 7fb8deffd700 1 -- 172.21.15.146:0/1388681857 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8e4013470 con 0x7fb8e806a770 2023-10-03T10:13:17.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.566+0000 7fb8deffd700 1 -- 172.21.15.146:0/1388681857 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb8e4040010 con 0x7fb8e806a770 2023-10-03T10:13:17.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.574+0000 7fb8deffd700 1 -- 172.21.15.146:0/1388681857 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8e4013720 con 0x7fb8e806a770 2023-10-03T10:13:17.590 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.680+0000 7f0685893700 1 Processor -- start 2023-10-03T10:13:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.680+0000 7f0685893700 1 -- start start 2023-10-03T10:13:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.680+0000 7f0685893700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0680133ad0 0x7f0680133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.680+0000 7f0685893700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0680130bc0 0x7f068013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.680+0000 7f0685893700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f068006b2d0 con 0x7f06801300a0 2023-10-03T10:13:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.681+0000 7f0685893700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0680133610 con 0x7f0680130bc0 2023-10-03T10:13:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.681+0000 7f0685893700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068009a500 con 0x7f0680133ad0 2023-10-03T10:13:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.681+0000 7f067f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0680130bc0 0x7f068013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.681+0000 7f067f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0680130bc0 0x7f068013b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50970/0 (socket says 172.21.15.146:50970) 2023-10-03T10:13:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.681+0000 7f067f7fe700 1 -- 172.21.15.146:0/2028362800 learned_addr learned my addr 172.21.15.146:0/2028362800 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:17.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.681+0000 7f067e7fc700 1 --1- 172.21.15.146:0/2028362800 >> v1:172.21.15.146:6789/0 conn(0x7f06801300a0 0x7f06801304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50240/0 (socket says 172.21.15.146:50240) 2023-10-03T10:13:17.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.681+0000 7f067effd700 1 --2- 172.21.15.146:0/2028362800 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0680133ad0 0x7f0680133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.681+0000 7f067f7fe700 1 -- 172.21.15.146:0/2028362800 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0680133ad0 msgr2=0x7f0680133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.681+0000 7f067f7fe700 1 --2- 172.21.15.146:0/2028362800 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0680133ad0 0x7f0680133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.681+0000 7f067f7fe700 1 -- 172.21.15.146:0/2028362800 >> v1:172.21.15.146:6789/0 conn(0x7f06801300a0 legacy=0x7f06801304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.681+0000 7f067f7fe700 1 -- 172.21.15.146:0/2028362800 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06801338b0 con 0x7f0680130bc0 2023-10-03T10:13:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.681+0000 7f067f7fe700 1 --2- 172.21.15.146:0/2028362800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0680130bc0 0x7f068013b990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0678009e50 tx=0x7f067800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35d8c50f7db6bb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.681+0000 7f067dffb700 1 -- 172.21.15.146:0/2028362800 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067800e070 con 0x7f0680130bc0 2023-10-03T10:13:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.682+0000 7f067dffb700 1 -- 172.21.15.146:0/2028362800 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067800b910 con 0x7f0680130bc0 2023-10-03T10:13:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.682+0000 7f067dffb700 1 -- 172.21.15.146:0/2028362800 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067800bca0 con 0x7f0680130bc0 2023-10-03T10:13:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.682+0000 7f0685893700 1 -- 172.21.15.146:0/2028362800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0680130bc0 msgr2=0x7f068013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.682+0000 7f0685893700 1 --2- 172.21.15.146:0/2028362800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0680130bc0 0x7f068013b990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0678009e50 tx=0x7f067800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.682+0000 7f0685893700 1 -- 172.21.15.146:0/2028362800 shutdown_connections 2023-10-03T10:13:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.682+0000 7f0685893700 1 --2- 172.21.15.146:0/2028362800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0680130bc0 0x7f068013b990 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.682+0000 7f0685893700 1 --2- 172.21.15.146:0/2028362800 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0680133ad0 0x7f0680133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.682+0000 7f0685893700 1 -- 172.21.15.146:0/2028362800 >> 172.21.15.146:0/2028362800 conn(0x7f0680099c40 msgr2=0x7f06800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.682+0000 7f0685893700 1 -- 172.21.15.146:0/2028362800 shutdown_connections 2023-10-03T10:13:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.682+0000 7f0685893700 1 -- 172.21.15.146:0/2028362800 wait complete. 2023-10-03T10:13:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.683+0000 7f0685893700 1 Processor -- start 2023-10-03T10:13:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.683+0000 7f0685893700 1 -- start start 2023-10-03T10:13:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.684+0000 7f0685893700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06801300a0 0x7f068011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.684+0000 7f0685893700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0680130bc0 0x7f068011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.684+0000 7f0685893700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0680133ad0 0x7f068011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.684+0000 7f0685893700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06801201f0 con 0x7f0680133ad0 2023-10-03T10:13:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.684+0000 7f0685893700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0680132720 con 0x7f06801300a0 2023-10-03T10:13:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.684+0000 7f0685893700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f068012dd00 con 0x7f0680130bc0 2023-10-03T10:13:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.684+0000 7f067effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06801300a0 0x7f068011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.684+0000 7f067effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06801300a0 0x7f068011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39472/0 (socket says 172.21.15.146:39472) 2023-10-03T10:13:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.684+0000 7f067effd700 1 -- 172.21.15.146:0/3245296838 learned_addr learned my addr 172.21.15.146:0/3245296838 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.684+0000 7f067f7fe700 1 --2- 172.21.15.146:0/3245296838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0680133ad0 0x7f068011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.684+0000 7f067e7fc700 1 --2- 172.21.15.146:0/3245296838 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0680130bc0 0x7f068011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.684+0000 7f067f7fe700 1 -- 172.21.15.146:0/3245296838 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0680130bc0 msgr2=0x7f068011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.684+0000 7f067f7fe700 1 --2- 172.21.15.146:0/3245296838 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0680130bc0 0x7f068011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.684+0000 7f067f7fe700 1 -- 172.21.15.146:0/3245296838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06801300a0 msgr2=0x7f068011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.684+0000 7f067f7fe700 1 --2- 172.21.15.146:0/3245296838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06801300a0 0x7f068011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.684+0000 7f067f7fe700 1 -- 172.21.15.146:0/3245296838 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0678009b30 con 0x7f0680133ad0 2023-10-03T10:13:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.684+0000 7f067effd700 1 --2- 172.21.15.146:0/3245296838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06801300a0 0x7f068011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.685+0000 7f067f7fe700 1 --2- 172.21.15.146:0/3245296838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0680133ad0 0x7f068011e4c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0678015000 tx=0x7f0678004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.685+0000 7f0667fff700 1 -- 172.21.15.146:0/3245296838 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06780047c0 con 0x7f0680133ad0 2023-10-03T10:13:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.685+0000 7f0667fff700 1 -- 172.21.15.146:0/3245296838 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06780092e0 con 0x7f0680133ad0 2023-10-03T10:13:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.685+0000 7f0685893700 1 -- 172.21.15.146:0/3245296838 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f068011fbb0 con 0x7f0680133ad0 2023-10-03T10:13:17.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.685+0000 7f0667fff700 1 -- 172.21.15.146:0/3245296838 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067801c660 con 0x7f0680133ad0 2023-10-03T10:13:17.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.685+0000 7f0685893700 1 -- 172.21.15.146:0/3245296838 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f068011fe70 con 0x7f0680133ad0 2023-10-03T10:13:17.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.686+0000 7f0667fff700 1 -- 172.21.15.146:0/3245296838 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f067801c7c0 con 0x7f0680133ad0 2023-10-03T10:13:17.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.686+0000 7f0667fff700 1 -- 172.21.15.146:0/3245296838 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0678040e70 con 0x7f0680133ad0 2023-10-03T10:13:17.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.686+0000 7f0685893700 1 -- 172.21.15.146:0/3245296838 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f068009cb20 con 0x7f0680133ad0 2023-10-03T10:13:17.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.691+0000 7f0667fff700 1 -- 172.21.15.146:0/3245296838 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0678024980 con 0x7f0680133ad0 2023-10-03T10:13:17.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.716+0000 7f053890d700 1 Processor -- start 2023-10-03T10:13:17.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.716+0000 7f053890d700 1 -- start start 2023-10-03T10:13:17.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.716+0000 7f053890d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0534138040 0x7f0534138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.716+0000 7f053890d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05340a1400 0x7f053413fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.716+0000 7f053890d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05341379e0 con 0x7f05340a08e0 2023-10-03T10:13:17.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.716+0000 7f053890d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05340a2100 con 0x7f05340a1400 2023-10-03T10:13:17.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.716+0000 7f053890d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0534138950 con 0x7f0534138040 2023-10-03T10:13:17.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.717+0000 7f053259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0534138040 0x7f0534138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.717+0000 7f053259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0534138040 0x7f0534138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36370/0 (socket says 172.21.15.146:36370) 2023-10-03T10:13:17.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.717+0000 7f053259c700 1 -- 172.21.15.146:0/358094677 learned_addr learned my addr 172.21.15.146:0/358094677 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.717+0000 7f0532d9d700 1 --2- 172.21.15.146:0/358094677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05340a1400 0x7f053413fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.717+0000 7f0532d9d700 1 -- 172.21.15.146:0/358094677 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0534138040 msgr2=0x7f0534138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.717+0000 7f0532d9d700 1 --2- 172.21.15.146:0/358094677 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0534138040 0x7f0534138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.717+0000 7f0532d9d700 1 -- 172.21.15.146:0/358094677 >> v1:172.21.15.146:6789/0 conn(0x7f05340a08e0 legacy=0x7f05340a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.717+0000 7f0532d9d700 1 -- 172.21.15.146:0/358094677 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053409b9b0 con 0x7f05340a1400 2023-10-03T10:13:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.717+0000 7f0532d9d700 1 --2- 172.21.15.146:0/358094677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05340a1400 0x7f053413fd20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f052c009df0 tx=0x7f052c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcf636031cd2b9e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.717+0000 7f053159a700 1 -- 172.21.15.146:0/358094677 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c00e070 con 0x7f05340a1400 2023-10-03T10:13:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.717+0000 7f053159a700 1 -- 172.21.15.146:0/358094677 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c00bae0 con 0x7f05340a1400 2023-10-03T10:13:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.717+0000 7f053159a700 1 -- 172.21.15.146:0/358094677 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c00be90 con 0x7f05340a1400 2023-10-03T10:13:17.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.718+0000 7f053890d700 1 -- 172.21.15.146:0/358094677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05340a1400 msgr2=0x7f053413fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.718+0000 7f053890d700 1 --2- 172.21.15.146:0/358094677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05340a1400 0x7f053413fd20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f052c009df0 tx=0x7f052c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:17.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.718+0000 7f053890d700 1 -- 172.21.15.146:0/358094677 shutdown_connections 2023-10-03T10:13:17.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.718+0000 7f053890d700 1 --2- 172.21.15.146:0/358094677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05340a1400 0x7f053413fd20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.718+0000 7f053890d700 1 --2- 172.21.15.146:0/358094677 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0534138040 0x7f0534138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.718+0000 7f053890d700 1 -- 172.21.15.146:0/358094677 >> 172.21.15.146:0/358094677 conn(0x7f05340a2980 msgr2=0x7f05340a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.718+0000 7f053890d700 1 -- 172.21.15.146:0/358094677 shutdown_connections 2023-10-03T10:13:17.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.719+0000 7f053890d700 1 -- 172.21.15.146:0/358094677 wait complete. 2023-10-03T10:13:17.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.719+0000 7f95cc3c5700 1 -- 172.21.15.146:0/690545915 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f95c404f2a0 con 0x7f95c40a0a70 2023-10-03T10:13:17.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.720+0000 7f95baffd700 1 -- 172.21.15.146:0/690545915 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f95c002b020 con 0x7f95c40a0a70 2023-10-03T10:13:17.721 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:17.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.720+0000 7f053890d700 1 Processor -- start 2023-10-03T10:13:17.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.720+0000 7f053890d700 1 -- start start 2023-10-03T10:13:17.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.721+0000 7f053890d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05340a08e0 0x7f0534137220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.721+0000 7f053890d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05340a1400 0x7f0534135a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.721+0000 7f053890d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0534138040 0x7f0534135f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.721+0000 7f053890d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053409c690 con 0x7f05340a1400 2023-10-03T10:13:17.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.721+0000 7f053890d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0534130160 con 0x7f05340a08e0 2023-10-03T10:13:17.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.721+0000 7f053890d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0534118df0 con 0x7f0534138040 2023-10-03T10:13:17.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.721+0000 7f053259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05340a08e0 0x7f0534137220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.721+0000 7f0531d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05340a1400 0x7f0534135a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.721+0000 7f053259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05340a08e0 0x7f0534137220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39480/0 (socket says 172.21.15.146:39480) 2023-10-03T10:13:17.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.721+0000 7f0531d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05340a1400 0x7f0534135a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50990/0 (socket says 172.21.15.146:50990) 2023-10-03T10:13:17.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.721+0000 7f053259c700 1 -- 172.21.15.146:0/75819137 learned_addr learned my addr 172.21.15.146:0/75819137 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:17.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.721+0000 7f0532d9d700 1 --2- 172.21.15.146:0/75819137 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0534138040 0x7f0534135f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.721+0000 7f0531d9b700 1 -- 172.21.15.146:0/75819137 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0534138040 msgr2=0x7f0534135f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.721+0000 7f0531d9b700 1 --2- 172.21.15.146:0/75819137 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0534138040 0x7f0534135f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.721+0000 7f0531d9b700 1 -- 172.21.15.146:0/75819137 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05340a08e0 msgr2=0x7f0534137220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.721+0000 7f0531d9b700 1 --2- 172.21.15.146:0/75819137 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05340a08e0 0x7f0534137220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.721+0000 7f0531d9b700 1 -- 172.21.15.146:0/75819137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c009a70 con 0x7f05340a1400 2023-10-03T10:13:17.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.722+0000 7f0531d9b700 1 --2- 172.21.15.146:0/75819137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05340a1400 0x7f0534135a00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f05340a2630 tx=0x7f052800c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.722+0000 7f0522ffd700 1 -- 172.21.15.146:0/75819137 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05280052d0 con 0x7f05340a1400 2023-10-03T10:13:17.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.722+0000 7f0522ffd700 1 -- 172.21.15.146:0/75819137 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0528005430 con 0x7f05340a1400 2023-10-03T10:13:17.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.722+0000 7f053890d700 1 -- 172.21.15.146:0/75819137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053413f360 con 0x7f05340a1400 2023-10-03T10:13:17.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.722+0000 7f0522ffd700 1 -- 172.21.15.146:0/75819137 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05280038c0 con 0x7f05340a1400 2023-10-03T10:13:17.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.722+0000 7f053890d700 1 -- 172.21.15.146:0/75819137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05341193e0 con 0x7f05340a1400 2023-10-03T10:13:17.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.723+0000 7f0522ffd700 1 -- 172.21.15.146:0/75819137 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0528003a20 con 0x7f05340a1400 2023-10-03T10:13:17.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.723+0000 7f053890d700 1 -- 172.21.15.146:0/75819137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053404f2a0 con 0x7f05340a1400 2023-10-03T10:13:17.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.723+0000 7f95cc3c5700 1 -- 172.21.15.146:0/690545915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95c40a0a70 msgr2=0x7f95c4122790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.723+0000 7f95cc3c5700 1 --2- 172.21.15.146:0/690545915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95c40a0a70 0x7f95c4122790 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f95c0016000 tx=0x7f95c0004750 comp rx=0 tx=0).stop 2023-10-03T10:13:17.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.723+0000 7f0522ffd700 1 -- 172.21.15.146:0/75819137 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f052803e720 con 0x7f05340a1400 2023-10-03T10:13:17.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.724+0000 7f95cc3c5700 1 -- 172.21.15.146:0/690545915 shutdown_connections 2023-10-03T10:13:17.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.724+0000 7f95cc3c5700 1 --2- 172.21.15.146:0/690545915 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95c4134120 0x7f95c4123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.724+0000 7f95cc3c5700 1 --2- 172.21.15.146:0/690545915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95c40a0a70 0x7f95c4122790 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.724+0000 7f95cc3c5700 1 --2- 172.21.15.146:0/690545915 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95c40a1380 0x7f95c4122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.724+0000 7f95cc3c5700 1 -- 172.21.15.146:0/690545915 >> 172.21.15.146:0/690545915 conn(0x7f95c40a6610 msgr2=0x7f95c40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.727+0000 7f95cc3c5700 1 -- 172.21.15.146:0/690545915 shutdown_connections 2023-10-03T10:13:17.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.727+0000 7f95cc3c5700 1 -- 172.21.15.146:0/690545915 wait complete. 2023-10-03T10:13:17.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.728+0000 7f0522ffd700 1 -- 172.21.15.146:0/75819137 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f052801b3b0 con 0x7f05340a1400 2023-10-03T10:13:17.740 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:17.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.790+0000 7fb8f0759700 1 -- 172.21.15.146:0/1388681857 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb8e8121000 con 0x7fb8e806a770 2023-10-03T10:13:17.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.790+0000 7fb8deffd700 1 -- 172.21.15.146:0/1388681857 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb8e8121000 con 0x7fb8e806a770 2023-10-03T10:13:17.791 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.794+0000 7fb8f0759700 1 -- 172.21.15.146:0/1388681857 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8e806a770 msgr2=0x7fb8e809ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.794+0000 7fb8f0759700 1 --2- 172.21.15.146:0/1388681857 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8e806a770 0x7fb8e809ae50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400ebe0 tx=0x7fb8e400eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.794+0000 7fb8f0759700 1 -- 172.21.15.146:0/1388681857 shutdown_connections 2023-10-03T10:13:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.794+0000 7fb8f0759700 1 --2- 172.21.15.146:0/1388681857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8e8131cf0 0x7fb8e81c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.794+0000 7fb8f0759700 1 --2- 172.21.15.146:0/1388681857 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8e806a770 0x7fb8e809ae50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.794+0000 7fb8f0759700 1 --2- 172.21.15.146:0/1388681857 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8e806b080 0x7fb8e809b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.794+0000 7fb8f0759700 1 -- 172.21.15.146:0/1388681857 >> 172.21.15.146:0/1388681857 conn(0x7fb8e8099c40 msgr2=0x7fb8e81b9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.794+0000 7fb8f0759700 1 -- 172.21.15.146:0/1388681857 shutdown_connections 2023-10-03T10:13:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.794+0000 7fb8f0759700 1 -- 172.21.15.146:0/1388681857 wait complete. 2023-10-03T10:13:17.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:17.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.901+0000 7f0685893700 1 -- 172.21.15.146:0/3245296838 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f068004f2a0 con 0x7f0680133ad0 2023-10-03T10:13:17.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.902+0000 7f0667fff700 1 -- 172.21.15.146:0/3245296838 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0678033090 con 0x7f0680133ad0 2023-10-03T10:13:17.903 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:17.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.904+0000 7f0685893700 1 -- 172.21.15.146:0/3245296838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0680133ad0 msgr2=0x7f068011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.904+0000 7f0685893700 1 --2- 172.21.15.146:0/3245296838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0680133ad0 0x7f068011e4c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0678015000 tx=0x7f0678004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.904+0000 7f0685893700 1 -- 172.21.15.146:0/3245296838 shutdown_connections 2023-10-03T10:13:17.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.904+0000 7f0685893700 1 --2- 172.21.15.146:0/3245296838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0680133ad0 0x7f068011e4c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.904+0000 7f0685893700 1 --2- 172.21.15.146:0/3245296838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06801300a0 0x7f068011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.904+0000 7f0685893700 1 --2- 172.21.15.146:0/3245296838 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0680130bc0 0x7f068011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.904+0000 7f0685893700 1 -- 172.21.15.146:0/3245296838 >> 172.21.15.146:0/3245296838 conn(0x7f0680099c40 msgr2=0x7f06800a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.904+0000 7f0685893700 1 -- 172.21.15.146:0/3245296838 shutdown_connections 2023-10-03T10:13:17.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.904+0000 7f0685893700 1 -- 172.21.15.146:0/3245296838 wait complete. 2023-10-03T10:13:17.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.923+0000 7f053890d700 1 -- 172.21.15.146:0/75819137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f05341193e0 con 0x7f05340a1400 2023-10-03T10:13:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.923+0000 7f0522ffd700 1 -- 172.21.15.146:0/75819137 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f05341193e0 con 0x7f05340a1400 2023-10-03T10:13:17.924 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:17.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.925+0000 7f053890d700 1 -- 172.21.15.146:0/75819137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05340a1400 msgr2=0x7f0534135a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.925+0000 7f053890d700 1 --2- 172.21.15.146:0/75819137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05340a1400 0x7f0534135a00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f05340a2630 tx=0x7f052800c6e0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.925+0000 7f053890d700 1 -- 172.21.15.146:0/75819137 shutdown_connections 2023-10-03T10:13:17.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.925+0000 7f053890d700 1 --2- 172.21.15.146:0/75819137 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0534138040 0x7f0534135f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.925+0000 7f053890d700 1 --2- 172.21.15.146:0/75819137 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05340a08e0 0x7f0534137220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.925+0000 7f053890d700 1 --2- 172.21.15.146:0/75819137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05340a1400 0x7f0534135a00 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.925+0000 7f053890d700 1 -- 172.21.15.146:0/75819137 >> 172.21.15.146:0/75819137 conn(0x7f05340a2980 msgr2=0x7f053409e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.925+0000 7f053890d700 1 -- 172.21.15.146:0/75819137 shutdown_connections 2023-10-03T10:13:17.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:17.925+0000 7f053890d700 1 -- 172.21.15.146:0/75819137 wait complete. 2023-10-03T10:13:17.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:18.741 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:18.808 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:18.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.879+0000 7fa582592700 1 Processor -- start 2023-10-03T10:13:18.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.879+0000 7fa582592700 1 -- start start 2023-10-03T10:13:18.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.879+0000 7fa582592700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa57c0a0a70 0x7fa57c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.879+0000 7fa582592700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa57c134120 0x7fa57c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.879+0000 7fa582592700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa57c09dc00 con 0x7fa57c0a1380 2023-10-03T10:13:18.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.879+0000 7fa582592700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa57c09ea90 con 0x7fa57c0a0a70 2023-10-03T10:13:18.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.879+0000 7fa582592700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c09dec0 con 0x7fa57c134120 2023-10-03T10:13:18.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.879+0000 7fa57bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa57c0a0a70 0x7fa57c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.879+0000 7fa57b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa57c0a1380 0x7fa57c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50262/0 (socket says 172.21.15.146:50262) 2023-10-03T10:13:18.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.879+0000 7fa57bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa57c0a0a70 0x7fa57c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51002/0 (socket says 172.21.15.146:51002) 2023-10-03T10:13:18.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.879+0000 7fa580b2f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa57c134120 0x7fa57c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.879+0000 7fa57b7fe700 1 -- 172.21.15.146:0/2196517014 learned_addr learned my addr 172.21.15.146:0/2196517014 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:18.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.880+0000 7fa57bfff700 1 -- 172.21.15.146:0/2196517014 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa57c134120 msgr2=0x7fa57c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:18.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.880+0000 7fa57bfff700 1 --2- 172.21.15.146:0/2196517014 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa57c134120 0x7fa57c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.880+0000 7fa57bfff700 1 -- 172.21.15.146:0/2196517014 >> v1:172.21.15.146:6789/0 conn(0x7fa57c0a1380 legacy=0x7fa57c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.880+0000 7fa57bfff700 1 -- 172.21.15.146:0/2196517014 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57c09e6a0 con 0x7fa57c0a0a70 2023-10-03T10:13:18.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.880+0000 7fa580b2f700 1 --2- 172.21.15.146:0/2196517014 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa57c134120 0x7fa57c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:18.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.880+0000 7fa57bfff700 1 --2- 172.21.15.146:0/2196517014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa57c0a0a70 0x7fa57c0a0e40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa56c009840 tx=0x7fa56c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a707cd054994ed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.880+0000 7fa57affd700 1 -- 172.21.15.146:0/2196517014 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c011830 con 0x7fa57c0a0a70 2023-10-03T10:13:18.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.880+0000 7fa57affd700 1 -- 172.21.15.146:0/2196517014 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56c011990 con 0x7fa57c0a0a70 2023-10-03T10:13:18.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.880+0000 7fa57affd700 1 -- 172.21.15.146:0/2196517014 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c011d20 con 0x7fa57c0a0a70 2023-10-03T10:13:18.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.881+0000 7fa582592700 1 -- 172.21.15.146:0/2196517014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa57c0a0a70 msgr2=0x7fa57c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.881+0000 7fa582592700 1 --2- 172.21.15.146:0/2196517014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa57c0a0a70 0x7fa57c0a0e40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa56c009840 tx=0x7fa56c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:18.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.881+0000 7fa582592700 1 -- 172.21.15.146:0/2196517014 shutdown_connections 2023-10-03T10:13:18.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.881+0000 7fa582592700 1 --2- 172.21.15.146:0/2196517014 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa57c134120 0x7fa57c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.881+0000 7fa582592700 1 --2- 172.21.15.146:0/2196517014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa57c0a0a70 0x7fa57c0a0e40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.881+0000 7fa582592700 1 -- 172.21.15.146:0/2196517014 >> 172.21.15.146:0/2196517014 conn(0x7fa57c0a6610 msgr2=0x7fa57c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.881+0000 7fa582592700 1 -- 172.21.15.146:0/2196517014 shutdown_connections 2023-10-03T10:13:18.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.881+0000 7fa582592700 1 -- 172.21.15.146:0/2196517014 wait complete. 2023-10-03T10:13:18.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.882+0000 7fa582592700 1 Processor -- start 2023-10-03T10:13:18.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.882+0000 7fa582592700 1 -- start start 2023-10-03T10:13:18.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.883+0000 7fa582592700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa57c0a0a70 0x7fa57c123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.883+0000 7fa582592700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa57c0a1380 0x7fa57c123890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.883+0000 7fa582592700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa57c134120 0x7fa57c1c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.883+0000 7fa582592700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c133aa0 con 0x7fa57c134120 2023-10-03T10:13:18.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.883+0000 7fa582592700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c0a03e0 con 0x7fa57c0a1380 2023-10-03T10:13:18.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.883+0000 7fa582592700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c125300 con 0x7fa57c0a0a70 2023-10-03T10:13:18.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.883+0000 7fa57bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa57c0a0a70 0x7fa57c123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.883+0000 7fa580b2f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa57c134120 0x7fa57c1c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.883+0000 7fa57bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa57c0a0a70 0x7fa57c123350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36404/0 (socket says 172.21.15.146:36404) 2023-10-03T10:13:18.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.883+0000 7fa57bfff700 1 -- 172.21.15.146:0/603450648 learned_addr learned my addr 172.21.15.146:0/603450648 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:18.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.883+0000 7fa57b7fe700 1 --2- 172.21.15.146:0/603450648 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa57c0a1380 0x7fa57c123890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.883+0000 7fa580b2f700 1 -- 172.21.15.146:0/603450648 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa57c0a0a70 msgr2=0x7fa57c123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.883+0000 7fa580b2f700 1 --2- 172.21.15.146:0/603450648 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa57c0a0a70 0x7fa57c123350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.883+0000 7fa580b2f700 1 -- 172.21.15.146:0/603450648 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa57c0a1380 msgr2=0x7fa57c123890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.883+0000 7fa580b2f700 1 --2- 172.21.15.146:0/603450648 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa57c0a1380 0x7fa57c123890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.883+0000 7fa580b2f700 1 -- 172.21.15.146:0/603450648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa574009a70 con 0x7fa57c134120 2023-10-03T10:13:18.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.883+0000 7fa580b2f700 1 --2- 172.21.15.146:0/603450648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa57c134120 0x7fa57c1c8410 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa57400efc0 tx=0x7fa57400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.883+0000 7fa578ff9700 1 -- 172.21.15.146:0/603450648 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57400ca90 con 0x7fa57c134120 2023-10-03T10:13:18.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.884+0000 7fa578ff9700 1 -- 172.21.15.146:0/603450648 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57400f040 con 0x7fa57c134120 2023-10-03T10:13:18.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.884+0000 7fa582592700 1 -- 172.21.15.146:0/603450648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56c0094a0 con 0x7fa57c134120 2023-10-03T10:13:18.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.884+0000 7fa578ff9700 1 -- 172.21.15.146:0/603450648 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57400ce30 con 0x7fa57c134120 2023-10-03T10:13:18.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.884+0000 7fa582592700 1 -- 172.21.15.146:0/603450648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa57c126d30 con 0x7fa57c134120 2023-10-03T10:13:18.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.884+0000 7fa578ff9700 1 -- 172.21.15.146:0/603450648 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa574014480 con 0x7fa57c134120 2023-10-03T10:13:18.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.885+0000 7fa578ff9700 1 -- 172.21.15.146:0/603450648 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa57403fc40 con 0x7fa57c134120 2023-10-03T10:13:18.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.884+0000 7fa582592700 1 -- 172.21.15.146:0/603450648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa57c09c8f0 con 0x7fa57c134120 2023-10-03T10:13:18.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.893+0000 7fa578ff9700 1 -- 172.21.15.146:0/603450648 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa574012930 con 0x7fa57c134120 2023-10-03T10:13:18.917 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:18.938 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:18.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.943+0000 7f4fe56e8700 1 Processor -- start 2023-10-03T10:13:18.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.943+0000 7f4fe56e8700 1 -- start start 2023-10-03T10:13:18.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.944+0000 7f4fe56e8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4fe009d860 0x7f4fe009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.944+0000 7f4fe56e8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4fe009e170 0x7f4fe01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.944+0000 7f4fe56e8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fe0130ce0 0x7f4fe0131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.944+0000 7f4fe56e8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe009aaa0 con 0x7f4fe009e170 2023-10-03T10:13:18.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.944+0000 7f4fe56e8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe009f870 con 0x7f4fe0130ce0 2023-10-03T10:13:18.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.944+0000 7f4fe56e8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe009b360 con 0x7f4fe009d860 2023-10-03T10:13:18.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.944+0000 7f4fde7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4fe009e170 0x7f4fe01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.944+0000 7f4fde7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4fe009e170 0x7f4fe01307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51010/0 (socket says 172.21.15.146:51010) 2023-10-03T10:13:18.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.944+0000 7f4fde7fc700 1 -- 172.21.15.146:0/4140313047 learned_addr learned my addr 172.21.15.146:0/4140313047 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:18.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.944+0000 7f4fdf7fe700 1 --2- 172.21.15.146:0/4140313047 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fe0130ce0 0x7f4fe0131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.944+0000 7f4fdeffd700 1 --2- 172.21.15.146:0/4140313047 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4fe009d860 0x7f4fe009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.944+0000 7f4fde7fc700 1 -- 172.21.15.146:0/4140313047 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4fe009d860 msgr2=0x7f4fe009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:18.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.944+0000 7f4fde7fc700 1 --2- 172.21.15.146:0/4140313047 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4fe009d860 0x7f4fe009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.944+0000 7f4fde7fc700 1 -- 172.21.15.146:0/4140313047 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fe0130ce0 msgr2=0x7f4fe0131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:18.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.944+0000 7f4fde7fc700 1 --2- 172.21.15.146:0/4140313047 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fe0130ce0 0x7f4fe0131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.944+0000 7f4fde7fc700 1 -- 172.21.15.146:0/4140313047 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe009b620 con 0x7f4fe009e170 2023-10-03T10:13:18.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.944+0000 7f4fdf7fe700 1 --2- 172.21.15.146:0/4140313047 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fe0130ce0 0x7f4fe0131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:18.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.944+0000 7f4fde7fc700 1 --2- 172.21.15.146:0/4140313047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe009e170 0x7f4fe01307a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400bb90 tx=0x7f4fd400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be73b28d41d2d5f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.945+0000 7f4fddffb700 1 -- 172.21.15.146:0/4140313047 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd400dd30 con 0x7f4fe009e170 2023-10-03T10:13:18.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.945+0000 7f4fddffb700 1 -- 172.21.15.146:0/4140313047 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd400de90 con 0x7f4fe009e170 2023-10-03T10:13:18.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.945+0000 7f4fddffb700 1 -- 172.21.15.146:0/4140313047 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4010690 con 0x7f4fe009e170 2023-10-03T10:13:18.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.945+0000 7f4fe56e8700 1 -- 172.21.15.146:0/4140313047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe009e170 msgr2=0x7f4fe01307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.945+0000 7f4fe56e8700 1 --2- 172.21.15.146:0/4140313047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe009e170 0x7f4fe01307a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400bb90 tx=0x7f4fd400bea0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.946+0000 7f4fe56e8700 1 -- 172.21.15.146:0/4140313047 shutdown_connections 2023-10-03T10:13:18.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.946+0000 7f4fe56e8700 1 --2- 172.21.15.146:0/4140313047 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fe0130ce0 0x7f4fe0131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.946+0000 7f4fe56e8700 1 --2- 172.21.15.146:0/4140313047 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4fe009d860 0x7f4fe009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.946+0000 7f4fe56e8700 1 --2- 172.21.15.146:0/4140313047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe009e170 0x7f4fe01307a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.946+0000 7f4fe56e8700 1 -- 172.21.15.146:0/4140313047 >> 172.21.15.146:0/4140313047 conn(0x7f4fe0099c40 msgr2=0x7f4fe00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.946+0000 7f4fe56e8700 1 -- 172.21.15.146:0/4140313047 shutdown_connections 2023-10-03T10:13:18.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.946+0000 7f4fe56e8700 1 -- 172.21.15.146:0/4140313047 wait complete. 2023-10-03T10:13:18.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.948+0000 7f4fe56e8700 1 Processor -- start 2023-10-03T10:13:18.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.948+0000 7f4fe56e8700 1 -- start start 2023-10-03T10:13:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.948+0000 7f4fe56e8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4fe009d860 0x7f4fe01203b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.948+0000 7f4fe56e8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fe009e170 0x7f4fe01208f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.949+0000 7f4fe56e8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe0130ce0 0x7f4fe0120e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.949+0000 7f4fe56e8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe0121fc0 con 0x7f4fe0130ce0 2023-10-03T10:13:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.949+0000 7f4fe56e8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe01225e0 con 0x7f4fe009e170 2023-10-03T10:13:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.949+0000 7f4fe56e8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe0123bf0 con 0x7f4fe009d860 2023-10-03T10:13:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.949+0000 7f4fdeffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4fe009d860 0x7f4fe01203b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.949+0000 7f4fdeffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4fe009d860 0x7f4fe01203b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36426/0 (socket says 172.21.15.146:36426) 2023-10-03T10:13:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.949+0000 7f4fdeffd700 1 -- 172.21.15.146:0/1240166434 learned_addr learned my addr 172.21.15.146:0/1240166434 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.949+0000 7f4fde7fc700 1 --2- 172.21.15.146:0/1240166434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fe009e170 0x7f4fe01208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.949+0000 7f4fdf7fe700 1 --2- 172.21.15.146:0/1240166434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe0130ce0 0x7f4fe0120e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.949+0000 7f4fde7fc700 1 -- 172.21.15.146:0/1240166434 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4fe009d860 msgr2=0x7f4fe01203b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.949+0000 7f4fde7fc700 1 --2- 172.21.15.146:0/1240166434 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4fe009d860 0x7f4fe01203b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.949+0000 7f4fde7fc700 1 -- 172.21.15.146:0/1240166434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe0130ce0 msgr2=0x7f4fe0120e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.949+0000 7f4fde7fc700 1 --2- 172.21.15.146:0/1240166434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe0130ce0 0x7f4fe0120e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.949+0000 7f4fde7fc700 1 -- 172.21.15.146:0/1240166434 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd8009a70 con 0x7f4fe009e170 2023-10-03T10:13:18.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.949+0000 7f4fde7fc700 1 --2- 172.21.15.146:0/1240166434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fe009e170 0x7f4fe01208f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4fe009a100 tx=0x7f4fd4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.950+0000 7f4fc77fe700 1 -- 172.21.15.146:0/1240166434 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4003b70 con 0x7f4fe009e170 2023-10-03T10:13:18.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.950+0000 7f4fe56e8700 1 -- 172.21.15.146:0/1240166434 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd400b7f0 con 0x7f4fe009e170 2023-10-03T10:13:18.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.950+0000 7f4fc77fe700 1 -- 172.21.15.146:0/1240166434 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd4003cd0 con 0x7f4fe009e170 2023-10-03T10:13:18.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.950+0000 7f4fc77fe700 1 -- 172.21.15.146:0/1240166434 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4010670 con 0x7f4fe009e170 2023-10-03T10:13:18.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.950+0000 7f4fc77fe700 1 -- 172.21.15.146:0/1240166434 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4fd402a3f0 con 0x7f4fe009e170 2023-10-03T10:13:18.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.951+0000 7f4fe56e8700 1 -- 172.21.15.146:0/1240166434 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe01227b0 con 0x7f4fe009e170 2023-10-03T10:13:18.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.951+0000 7f4fc77fe700 1 -- 172.21.15.146:0/1240166434 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4fd4031300 con 0x7f4fe009e170 2023-10-03T10:13:18.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.951+0000 7f4fe56e8700 1 -- 172.21.15.146:0/1240166434 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe004f2a0 con 0x7f4fe009e170 2023-10-03T10:13:18.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:18.960+0000 7f4fc77fe700 1 -- 172.21.15.146:0/1240166434 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4fd402f030 con 0x7f4fe009e170 2023-10-03T10:13:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.056+0000 7f7072bbc700 1 Processor -- start 2023-10-03T10:13:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.056+0000 7f7072bbc700 1 -- start start 2023-10-03T10:13:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.057+0000 7f7072bbc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f706c09d860 0x7f706c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.057+0000 7f7072bbc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f706c09e170 0x7f706c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.057+0000 7f7072bbc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706c09aaa0 con 0x7f706c130ce0 2023-10-03T10:13:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.057+0000 7f7072bbc700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706c09f870 con 0x7f706c09e170 2023-10-03T10:13:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.057+0000 7f7072bbc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706c09b360 con 0x7f706c09d860 2023-10-03T10:13:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.057+0000 7f7070958700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f706c09d860 0x7f706c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.057+0000 7f706bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f706c09e170 0x7f706c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.057+0000 7f7070958700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f706c09d860 0x7f706c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39516/0 (socket says 172.21.15.146:39516) 2023-10-03T10:13:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.057+0000 7f7071159700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f706c130ce0 0x7f706c1379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50274/0 (socket says 172.21.15.146:50274) 2023-10-03T10:13:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.057+0000 7f7070958700 1 -- 172.21.15.146:0/4217200088 learned_addr learned my addr 172.21.15.146:0/4217200088 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.058+0000 7f7070958700 1 -- 172.21.15.146:0/4217200088 >> v2:172.21.15.146:3300/0 conn(0x7f706c09e170 msgr2=0x7f706c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.058+0000 7f7070958700 1 --2- 172.21.15.146:0/4217200088 >> v2:172.21.15.146:3300/0 conn(0x7f706c09e170 0x7f706c1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.058+0000 7f7070958700 1 -- 172.21.15.146:0/4217200088 >> v1:172.21.15.146:6789/0 conn(0x7f706c130ce0 legacy=0x7f706c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.058+0000 7f7070958700 1 -- 172.21.15.146:0/4217200088 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c09b620 con 0x7f706c09d860 2023-10-03T10:13:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.058+0000 7f7070958700 1 --2- 172.21.15.146:0/4217200088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f706c09d860 0x7f706c09dc30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f70600098f0 tx=0x7f7060009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d17738188e3597c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.058+0000 7f706b7fe700 1 -- 172.21.15.146:0/4217200088 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706000f8a0 con 0x7f706c09d860 2023-10-03T10:13:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.058+0000 7f706b7fe700 1 -- 172.21.15.146:0/4217200088 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706000fa00 con 0x7f706c09d860 2023-10-03T10:13:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.058+0000 7f706b7fe700 1 -- 172.21.15.146:0/4217200088 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706000fd90 con 0x7f706c09d860 2023-10-03T10:13:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.059+0000 7f7072bbc700 1 -- 172.21.15.146:0/4217200088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f706c09d860 msgr2=0x7f706c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.059+0000 7f7072bbc700 1 --2- 172.21.15.146:0/4217200088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f706c09d860 0x7f706c09dc30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f70600098f0 tx=0x7f7060009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.059+0000 7f7072bbc700 1 -- 172.21.15.146:0/4217200088 shutdown_connections 2023-10-03T10:13:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.059+0000 7f7072bbc700 1 --2- 172.21.15.146:0/4217200088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f706c09d860 0x7f706c09dc30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.059+0000 7f7072bbc700 1 --2- 172.21.15.146:0/4217200088 >> v2:172.21.15.146:3300/0 conn(0x7f706c09e170 0x7f706c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.059+0000 7f7072bbc700 1 -- 172.21.15.146:0/4217200088 >> 172.21.15.146:0/4217200088 conn(0x7f706c099c40 msgr2=0x7f706c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.059+0000 7f7072bbc700 1 -- 172.21.15.146:0/4217200088 shutdown_connections 2023-10-03T10:13:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.059+0000 7f7072bbc700 1 -- 172.21.15.146:0/4217200088 wait complete. 2023-10-03T10:13:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.060+0000 7f7072bbc700 1 Processor -- start 2023-10-03T10:13:19.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.060+0000 7f7072bbc700 1 -- start start 2023-10-03T10:13:19.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.061+0000 7f7072bbc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f706c09d860 0x7f706c1c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.061+0000 7f7072bbc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f706c09e170 0x7f706c1c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.061+0000 7f7072bbc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f706c130ce0 0x7f706c1c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.061+0000 7f7072bbc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c0721e0 con 0x7f706c130ce0 2023-10-03T10:13:19.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.061+0000 7f7072bbc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706c1262a0 con 0x7f706c09e170 2023-10-03T10:13:19.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.061+0000 7f7072bbc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f706c1c5f00 con 0x7f706c09d860 2023-10-03T10:13:19.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.062+0000 7f7071159700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f706c130ce0 0x7f706c1c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.062+0000 7f7070958700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f706c09d860 0x7f706c1c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.062+0000 7f706bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f706c09e170 0x7f706c1c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.062+0000 7f7071159700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f706c130ce0 0x7f706c1c84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51044/0 (socket says 172.21.15.146:51044) 2023-10-03T10:13:19.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.062+0000 7f7071159700 1 -- 172.21.15.146:0/4267794140 learned_addr learned my addr 172.21.15.146:0/4267794140 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:19.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.062+0000 7f7070958700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f706c09d860 0x7f706c1c5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36430/0 (socket says 172.21.15.146:36430) 2023-10-03T10:13:19.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.062+0000 7f7070958700 1 -- 172.21.15.146:0/4267794140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f706c09e170 msgr2=0x7f706c1c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.062+0000 7f7070958700 1 --2- 172.21.15.146:0/4267794140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f706c09e170 0x7f706c1c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.062+0000 7f7070958700 1 -- 172.21.15.146:0/4267794140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f706c130ce0 msgr2=0x7f706c1c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.062+0000 7f7070958700 1 --2- 172.21.15.146:0/4267794140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f706c130ce0 0x7f706c1c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.062+0000 7f7070958700 1 -- 172.21.15.146:0/4267794140 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7060009550 con 0x7f706c09d860 2023-10-03T10:13:19.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.062+0000 7f7070958700 1 --2- 172.21.15.146:0/4267794140 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f706c09d860 0x7f706c1c5480 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f706c09f3d0 tx=0x7f7060004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:19.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.063+0000 7f70697fa700 1 -- 172.21.15.146:0/4267794140 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70600038a0 con 0x7f706c09d860 2023-10-03T10:13:19.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.063+0000 7f70697fa700 1 -- 172.21.15.146:0/4267794140 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7060003a00 con 0x7f706c09d860 2023-10-03T10:13:19.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.063+0000 7f7072bbc700 1 -- 172.21.15.146:0/4267794140 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706c1256a0 con 0x7f706c09d860 2023-10-03T10:13:19.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.063+0000 7f70697fa700 1 -- 172.21.15.146:0/4267794140 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7060003d90 con 0x7f706c09d860 2023-10-03T10:13:19.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.063+0000 7f7072bbc700 1 -- 172.21.15.146:0/4267794140 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706c126840 con 0x7f706c09d860 2023-10-03T10:13:19.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.064+0000 7f7072bbc700 1 -- 172.21.15.146:0/4267794140 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706c04f2a0 con 0x7f706c09d860 2023-10-03T10:13:19.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.064+0000 7f70697fa700 1 -- 172.21.15.146:0/4267794140 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f706002b460 con 0x7f706c09d860 2023-10-03T10:13:19.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.064+0000 7f70697fa700 1 -- 172.21.15.146:0/4267794140 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7060040b80 con 0x7f706c09d860 2023-10-03T10:13:19.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.070+0000 7ff4e747b700 1 Processor -- start 2023-10-03T10:13:19.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.070+0000 7ff4e747b700 1 -- start start 2023-10-03T10:13:19.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.071+0000 7ff4e747b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff4e006a770 0x7ff4e01349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.071+0000 7ff4e747b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4e0134f00 0x7ff4e009d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.071+0000 7ff4e747b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4e009dea0 0x7ff4e009e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.071+0000 7ff4e747b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e006b2e0 con 0x7ff4e006a770 2023-10-03T10:13:19.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.071+0000 7ff4e747b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e009eca0 con 0x7ff4e009dea0 2023-10-03T10:13:19.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.071+0000 7ff4e747b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e009f720 con 0x7ff4e0134f00 2023-10-03T10:13:19.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.071+0000 7ff4e4a16700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4e0134f00 0x7ff4e009d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.071+0000 7ff4e4a16700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4e0134f00 0x7ff4e009d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36444/0 (socket says 172.21.15.146:36444) 2023-10-03T10:13:19.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.071+0000 7ff4e4a16700 1 -- 172.21.15.146:0/1643423963 learned_addr learned my addr 172.21.15.146:0/1643423963 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:19.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.071+0000 7ff4e5a18700 1 --2- 172.21.15.146:0/1643423963 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4e009dea0 0x7ff4e009e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.071+0000 7ff4e4a16700 1 -- 172.21.15.146:0/1643423963 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4e009dea0 msgr2=0x7ff4e009e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:19.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.071+0000 7ff4e4a16700 1 --2- 172.21.15.146:0/1643423963 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4e009dea0 0x7ff4e009e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.071+0000 7ff4e4a16700 1 -- 172.21.15.146:0/1643423963 >> v2:172.21.15.146:3300/0 conn(0x7ff4e006a770 msgr2=0x7ff4e01349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:19.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.071+0000 7ff4e4a16700 1 --2- 172.21.15.146:0/1643423963 >> v2:172.21.15.146:3300/0 conn(0x7ff4e006a770 0x7ff4e01349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.071+0000 7ff4e4a16700 1 -- 172.21.15.146:0/1643423963 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e006b480 con 0x7ff4e0134f00 2023-10-03T10:13:19.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.071+0000 7ff4e4a16700 1 --2- 172.21.15.146:0/1643423963 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4e0134f00 0x7ff4e009d960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00098f0 tx=0x7ff4d0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77408c880093f9e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.073+0000 7ff4d7fff700 1 -- 172.21.15.146:0/1643423963 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0011830 con 0x7ff4e0134f00 2023-10-03T10:13:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.073+0000 7ff4d7fff700 1 -- 172.21.15.146:0/1643423963 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d0011990 con 0x7ff4e0134f00 2023-10-03T10:13:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.073+0000 7ff4d7fff700 1 -- 172.21.15.146:0/1643423963 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0011d20 con 0x7ff4e0134f00 2023-10-03T10:13:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.073+0000 7f70697fa700 1 -- 172.21.15.146:0/4267794140 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f706000e780 con 0x7f706c09d860 2023-10-03T10:13:19.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.074+0000 7ff4e747b700 1 -- 172.21.15.146:0/1643423963 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4e0134f00 msgr2=0x7ff4e009d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.074+0000 7ff4e747b700 1 --2- 172.21.15.146:0/1643423963 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4e0134f00 0x7ff4e009d960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00098f0 tx=0x7ff4d0009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:19.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.074+0000 7ff4e747b700 1 -- 172.21.15.146:0/1643423963 shutdown_connections 2023-10-03T10:13:19.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.074+0000 7ff4e747b700 1 --2- 172.21.15.146:0/1643423963 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4e009dea0 0x7ff4e009e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.074+0000 7ff4e747b700 1 --2- 172.21.15.146:0/1643423963 >> v2:172.21.15.146:3300/0 conn(0x7ff4e006a770 0x7ff4e01349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.074+0000 7ff4e747b700 1 --2- 172.21.15.146:0/1643423963 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4e0134f00 0x7ff4e009d960 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.074+0000 7ff4e747b700 1 -- 172.21.15.146:0/1643423963 >> 172.21.15.146:0/1643423963 conn(0x7ff4e0099c40 msgr2=0x7ff4e00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:19.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.074+0000 7ff4e747b700 1 -- 172.21.15.146:0/1643423963 shutdown_connections 2023-10-03T10:13:19.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.074+0000 7ff4e747b700 1 -- 172.21.15.146:0/1643423963 wait complete. 2023-10-03T10:13:19.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.075+0000 7ff4e747b700 1 Processor -- start 2023-10-03T10:13:19.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.075+0000 7ff4e747b700 1 -- start start 2023-10-03T10:13:19.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.075+0000 7ff4e747b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4e006a770 0x7ff4e011aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.075+0000 7ff4e747b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4e009dea0 0x7ff4e011afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.075+0000 7ff4e747b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4e0134f00 0x7ff4e011b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.075+0000 7ff4e747b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e011bf40 con 0x7ff4e0134f00 2023-10-03T10:13:19.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.075+0000 7ff4e747b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e011d570 con 0x7ff4e009dea0 2023-10-03T10:13:19.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.075+0000 7ff4e747b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e01398a0 con 0x7ff4e006a770 2023-10-03T10:13:19.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.075+0000 7ff4e5217700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4e006a770 0x7ff4e011aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.075+0000 7ff4e5217700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4e006a770 0x7ff4e011aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36446/0 (socket says 172.21.15.146:36446) 2023-10-03T10:13:19.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.075+0000 7ff4e5217700 1 -- 172.21.15.146:0/2361231442 learned_addr learned my addr 172.21.15.146:0/2361231442 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:19.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.075+0000 7ff4e4a16700 1 --2- 172.21.15.146:0/2361231442 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4e009dea0 0x7ff4e011afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.075+0000 7ff4e5a18700 1 --2- 172.21.15.146:0/2361231442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4e0134f00 0x7ff4e011b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.076+0000 7ff4e5a18700 1 -- 172.21.15.146:0/2361231442 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4e006a770 msgr2=0x7ff4e011aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.076+0000 7ff4e5a18700 1 --2- 172.21.15.146:0/2361231442 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4e006a770 0x7ff4e011aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.076+0000 7ff4e5a18700 1 -- 172.21.15.146:0/2361231442 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4e009dea0 msgr2=0x7ff4e011afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.076+0000 7ff4e5a18700 1 --2- 172.21.15.146:0/2361231442 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4e009dea0 0x7ff4e011afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.076+0000 7ff4e5a18700 1 -- 172.21.15.146:0/2361231442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d0009550 con 0x7ff4e0134f00 2023-10-03T10:13:19.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.076+0000 7ff4e5a18700 1 --2- 172.21.15.146:0/2361231442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4e0134f00 0x7ff4e011b510 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8009d90 tx=0x7ff4d800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:19.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.076+0000 7ff4d5ffb700 1 -- 172.21.15.146:0/2361231442 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8009c00 con 0x7ff4e0134f00 2023-10-03T10:13:19.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.076+0000 7ff4d5ffb700 1 -- 172.21.15.146:0/2361231442 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d800f040 con 0x7ff4e0134f00 2023-10-03T10:13:19.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.076+0000 7ff4d5ffb700 1 -- 172.21.15.146:0/2361231442 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8014480 con 0x7ff4e0134f00 2023-10-03T10:13:19.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.077+0000 7ff4e747b700 1 -- 172.21.15.146:0/2361231442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e011c6a0 con 0x7ff4e0134f00 2023-10-03T10:13:19.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.077+0000 7ff4e747b700 1 -- 172.21.15.146:0/2361231442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e011ccb0 con 0x7ff4e0134f00 2023-10-03T10:13:19.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.078+0000 7ff4d5ffb700 1 -- 172.21.15.146:0/2361231442 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff4d80145e0 con 0x7ff4e0134f00 2023-10-03T10:13:19.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.078+0000 7ff4d5ffb700 1 -- 172.21.15.146:0/2361231442 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff4d803fff0 con 0x7ff4e0134f00 2023-10-03T10:13:19.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.078+0000 7ff4e747b700 1 -- 172.21.15.146:0/2361231442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e011cc50 con 0x7ff4e0134f00 2023-10-03T10:13:19.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.083+0000 7ff4d5ffb700 1 -- 172.21.15.146:0/2361231442 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4d8018070 con 0x7ff4e0134f00 2023-10-03T10:13:19.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.112+0000 7fa582592700 1 -- 172.21.15.146:0/603450648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa57c04f2a0 con 0x7fa57c134120 2023-10-03T10:13:19.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.112+0000 7fa578ff9700 1 -- 172.21.15.146:0/603450648 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa574012340 con 0x7fa57c134120 2023-10-03T10:13:19.113 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:19.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.114+0000 7fa582592700 1 -- 172.21.15.146:0/603450648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa57c134120 msgr2=0x7fa57c1c8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.114+0000 7fa582592700 1 --2- 172.21.15.146:0/603450648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa57c134120 0x7fa57c1c8410 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa57400efc0 tx=0x7fa57400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.114+0000 7fa582592700 1 -- 172.21.15.146:0/603450648 shutdown_connections 2023-10-03T10:13:19.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.114+0000 7fa582592700 1 --2- 172.21.15.146:0/603450648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa57c134120 0x7fa57c1c8410 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.114+0000 7fa582592700 1 --2- 172.21.15.146:0/603450648 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa57c0a0a70 0x7fa57c123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.114+0000 7fa582592700 1 --2- 172.21.15.146:0/603450648 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa57c0a1380 0x7fa57c123890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.114+0000 7fa582592700 1 -- 172.21.15.146:0/603450648 >> 172.21.15.146:0/603450648 conn(0x7fa57c0a6610 msgr2=0x7fa57c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:19.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.114+0000 7fa582592700 1 -- 172.21.15.146:0/603450648 shutdown_connections 2023-10-03T10:13:19.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.114+0000 7fa582592700 1 -- 172.21.15.146:0/603450648 wait complete. 2023-10-03T10:13:19.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:19.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.185+0000 7f4fe56e8700 1 -- 172.21.15.146:0/1240166434 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4fe006c3b0 con 0x7f4fe009e170 2023-10-03T10:13:19.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.185+0000 7f4fc77fe700 1 -- 172.21.15.146:0/1240166434 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4fd4003e40 con 0x7f4fe009e170 2023-10-03T10:13:19.186 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:19.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.187+0000 7f4fe56e8700 1 -- 172.21.15.146:0/1240166434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fe009e170 msgr2=0x7f4fe01208f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.187+0000 7f4fe56e8700 1 --2- 172.21.15.146:0/1240166434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fe009e170 0x7f4fe01208f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4fe009a100 tx=0x7f4fd4004750 comp rx=0 tx=0).stop 2023-10-03T10:13:19.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.187+0000 7f4fe56e8700 1 -- 172.21.15.146:0/1240166434 shutdown_connections 2023-10-03T10:13:19.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.187+0000 7f4fe56e8700 1 --2- 172.21.15.146:0/1240166434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe0130ce0 0x7f4fe0120e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.187+0000 7f4fe56e8700 1 --2- 172.21.15.146:0/1240166434 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4fe009d860 0x7f4fe01203b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.187+0000 7f4fe56e8700 1 --2- 172.21.15.146:0/1240166434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fe009e170 0x7f4fe01208f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.187+0000 7f4fe56e8700 1 -- 172.21.15.146:0/1240166434 >> 172.21.15.146:0/1240166434 conn(0x7f4fe0099c40 msgr2=0x7f4fe00a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:19.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.187+0000 7f4fe56e8700 1 -- 172.21.15.146:0/1240166434 shutdown_connections 2023-10-03T10:13:19.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.187+0000 7f4fe56e8700 1 -- 172.21.15.146:0/1240166434 wait complete. 2023-10-03T10:13:19.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:19.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.271+0000 7f7072bbc700 1 -- 172.21.15.146:0/4267794140 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f706c071f50 con 0x7f706c09d860 2023-10-03T10:13:19.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.271+0000 7f70697fa700 1 -- 172.21.15.146:0/4267794140 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7060030090 con 0x7f706c09d860 2023-10-03T10:13:19.272 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:19.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.273+0000 7f7072bbc700 1 -- 172.21.15.146:0/4267794140 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f706c09d860 msgr2=0x7f706c1c5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.273+0000 7f7072bbc700 1 --2- 172.21.15.146:0/4267794140 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f706c09d860 0x7f706c1c5480 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f706c09f3d0 tx=0x7f7060004750 comp rx=0 tx=0).stop 2023-10-03T10:13:19.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.273+0000 7f7072bbc700 1 -- 172.21.15.146:0/4267794140 shutdown_connections 2023-10-03T10:13:19.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.273+0000 7f7072bbc700 1 --2- 172.21.15.146:0/4267794140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f706c130ce0 0x7f706c1c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.273+0000 7f7072bbc700 1 --2- 172.21.15.146:0/4267794140 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f706c09d860 0x7f706c1c5480 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.273+0000 7f7072bbc700 1 --2- 172.21.15.146:0/4267794140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f706c09e170 0x7f706c1c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.273+0000 7f7072bbc700 1 -- 172.21.15.146:0/4267794140 >> 172.21.15.146:0/4267794140 conn(0x7f706c099c40 msgr2=0x7f706c070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:19.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.273+0000 7f7072bbc700 1 -- 172.21.15.146:0/4267794140 shutdown_connections 2023-10-03T10:13:19.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.274+0000 7f7072bbc700 1 -- 172.21.15.146:0/4267794140 wait complete. 2023-10-03T10:13:19.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.279+0000 7ff4e747b700 1 -- 172.21.15.146:0/2361231442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff4e004f2a0 con 0x7ff4e0134f00 2023-10-03T10:13:19.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.280+0000 7ff4d5ffb700 1 -- 172.21.15.146:0/2361231442 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4d802c090 con 0x7ff4e0134f00 2023-10-03T10:13:19.280 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:19.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.282+0000 7ff4e747b700 1 -- 172.21.15.146:0/2361231442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4e0134f00 msgr2=0x7ff4e011b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.282+0000 7ff4e747b700 1 --2- 172.21.15.146:0/2361231442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4e0134f00 0x7ff4e011b510 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8009d90 tx=0x7ff4d800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.282+0000 7ff4e747b700 1 -- 172.21.15.146:0/2361231442 shutdown_connections 2023-10-03T10:13:19.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.282+0000 7ff4e747b700 1 --2- 172.21.15.146:0/2361231442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4e0134f00 0x7ff4e011b510 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.282+0000 7ff4e747b700 1 --2- 172.21.15.146:0/2361231442 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4e006a770 0x7ff4e011aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.282+0000 7ff4e747b700 1 --2- 172.21.15.146:0/2361231442 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4e009dea0 0x7ff4e011afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.282+0000 7ff4e747b700 1 -- 172.21.15.146:0/2361231442 >> 172.21.15.146:0/2361231442 conn(0x7ff4e0099c40 msgr2=0x7ff4e009c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:19.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.282+0000 7ff4e747b700 1 -- 172.21.15.146:0/2361231442 shutdown_connections 2023-10-03T10:13:19.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:19.282+0000 7ff4e747b700 1 -- 172.21.15.146:0/2361231442 wait complete. 2023-10-03T10:13:19.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:19.295 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:20.129 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:20.201 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:20.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.268+0000 7f718c957700 1 Processor -- start 2023-10-03T10:13:20.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.268+0000 7f718c957700 1 -- start start 2023-10-03T10:13:20.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.269+0000 7f718c957700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7188134140 0x7f7188138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.269+0000 7f718c957700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7188134570 0x7f718813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.269+0000 7f718c957700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f718809b110 con 0x7f718809ad40 2023-10-03T10:13:20.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.269+0000 7f718c957700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71880a3b60 con 0x7f7188134570 2023-10-03T10:13:20.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.269+0000 7f718c957700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71880a1a80 con 0x7f7188134140 2023-10-03T10:13:20.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.269+0000 7f7186d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7188134570 0x7f718813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.269+0000 7f7185d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7188134140 0x7f7188138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.269+0000 7f7186d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7188134570 0x7f718813b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39560/0 (socket says 172.21.15.146:39560) 2023-10-03T10:13:20.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.269+0000 7f7186d9d700 1 -- 172.21.15.146:0/2403829633 learned_addr learned my addr 172.21.15.146:0/2403829633 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:20.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.269+0000 7f718659c700 1 --1- 172.21.15.146:0/2403829633 >> v1:172.21.15.146:6789/0 conn(0x7f718809ad40 0x7f7188133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50276/0 (socket says 172.21.15.146:50276) 2023-10-03T10:13:20.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.270+0000 7f7185d9b700 1 -- 172.21.15.146:0/2403829633 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7188134570 msgr2=0x7f718813b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:20.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.270+0000 7f7185d9b700 1 --2- 172.21.15.146:0/2403829633 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7188134570 0x7f718813b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.270+0000 7f718559a700 1 -- 172.21.15.146:0/2403829633 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 921702264 0 0) 0x7f718809b110 con 0x7f718809ad40 2023-10-03T10:13:20.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.270+0000 7f7185d9b700 1 -- 172.21.15.146:0/2403829633 >> v1:172.21.15.146:6789/0 conn(0x7f718809ad40 legacy=0x7f7188133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.270+0000 7f7185d9b700 1 -- 172.21.15.146:0/2403829633 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71880a2fa0 con 0x7f7188134140 2023-10-03T10:13:20.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.270+0000 7f7186d9d700 1 --2- 172.21.15.146:0/2403829633 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7188134570 0x7f718813b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:20.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.270+0000 7f7185d9b700 1 --2- 172.21.15.146:0/2403829633 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7188134140 0x7f7188138e80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f717c009870 tx=0x7f717c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db785f2789802987 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.270+0000 7f718559a700 1 -- 172.21.15.146:0/2403829633 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c011830 con 0x7f7188134140 2023-10-03T10:13:20.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.270+0000 7f718559a700 1 -- 172.21.15.146:0/2403829633 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717c011990 con 0x7f7188134140 2023-10-03T10:13:20.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.270+0000 7f718559a700 1 -- 172.21.15.146:0/2403829633 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c011d20 con 0x7f7188134140 2023-10-03T10:13:20.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.271+0000 7f718c957700 1 -- 172.21.15.146:0/2403829633 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7188134140 msgr2=0x7f7188138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.271+0000 7f718c957700 1 --2- 172.21.15.146:0/2403829633 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7188134140 0x7f7188138e80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f717c009870 tx=0x7f717c009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:20.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.271+0000 7f718c957700 1 -- 172.21.15.146:0/2403829633 shutdown_connections 2023-10-03T10:13:20.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.271+0000 7f718c957700 1 --2- 172.21.15.146:0/2403829633 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7188134570 0x7f718813b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.271+0000 7f718c957700 1 --2- 172.21.15.146:0/2403829633 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7188134140 0x7f7188138e80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.271+0000 7f718c957700 1 -- 172.21.15.146:0/2403829633 >> 172.21.15.146:0/2403829633 conn(0x7f7188099c40 msgr2=0x7f718806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.271+0000 7f718c957700 1 -- 172.21.15.146:0/2403829633 shutdown_connections 2023-10-03T10:13:20.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.271+0000 7f718c957700 1 -- 172.21.15.146:0/2403829633 wait complete. 2023-10-03T10:13:20.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.272+0000 7f718c957700 1 Processor -- start 2023-10-03T10:13:20.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.272+0000 7f718c957700 1 -- start start 2023-10-03T10:13:20.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.272+0000 7f718c957700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f718809ad40 0x7f7188139470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.272+0000 7f718c957700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7188134140 0x7f71881399b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.272+0000 7f718c957700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7188134570 0x7f7188139ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.272+0000 7f718c957700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718811ede0 con 0x7f718809ad40 2023-10-03T10:13:20.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.272+0000 7f718c957700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718809c7e0 con 0x7f7188134140 2023-10-03T10:13:20.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.272+0000 7f718c957700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f718809e3c0 con 0x7f7188134570 2023-10-03T10:13:20.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.272+0000 7f718659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f718809ad40 0x7f7188139470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.272+0000 7f7186d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7188134570 0x7f7188139ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.272+0000 7f718659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f718809ad40 0x7f7188139470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51068/0 (socket says 172.21.15.146:51068) 2023-10-03T10:13:20.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.272+0000 7f718659c700 1 -- 172.21.15.146:0/3937889808 learned_addr learned my addr 172.21.15.146:0/3937889808 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:20.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.272+0000 7f7185d9b700 1 --2- 172.21.15.146:0/3937889808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7188134140 0x7f71881399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.273+0000 7f718659c700 1 -- 172.21.15.146:0/3937889808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7188134570 msgr2=0x7f7188139ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.273+0000 7f718659c700 1 --2- 172.21.15.146:0/3937889808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7188134570 0x7f7188139ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.273+0000 7f718659c700 1 -- 172.21.15.146:0/3937889808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7188134140 msgr2=0x7f71881399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.273+0000 7f718659c700 1 --2- 172.21.15.146:0/3937889808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7188134140 0x7f71881399b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.273+0000 7f718659c700 1 -- 172.21.15.146:0/3937889808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7180009b30 con 0x7f718809ad40 2023-10-03T10:13:20.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.273+0000 7f7186d9d700 1 --2- 172.21.15.146:0/3937889808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7188134570 0x7f7188139ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:20.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.273+0000 7f718659c700 1 --2- 172.21.15.146:0/3937889808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f718809ad40 0x7f7188139470 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f717800c550 tx=0x7f717800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.273+0000 7f7176ffd700 1 -- 172.21.15.146:0/3937889808 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7178004c80 con 0x7f718809ad40 2023-10-03T10:13:20.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.273+0000 7f7176ffd700 1 -- 172.21.15.146:0/3937889808 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7178004de0 con 0x7f718809ad40 2023-10-03T10:13:20.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.273+0000 7f718c957700 1 -- 172.21.15.146:0/3937889808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717c0094a0 con 0x7f718809ad40 2023-10-03T10:13:20.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.273+0000 7f7176ffd700 1 -- 172.21.15.146:0/3937889808 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7178007310 con 0x7f718809ad40 2023-10-03T10:13:20.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.273+0000 7f718c957700 1 -- 172.21.15.146:0/3937889808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f718811d620 con 0x7f718809ad40 2023-10-03T10:13:20.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.274+0000 7f7176ffd700 1 -- 172.21.15.146:0/3937889808 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7178007470 con 0x7f718809ad40 2023-10-03T10:13:20.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.274+0000 7f7176ffd700 1 -- 172.21.15.146:0/3937889808 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f717803f2b0 con 0x7f718809ad40 2023-10-03T10:13:20.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.274+0000 7f718c957700 1 -- 172.21.15.146:0/3937889808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71881361e0 con 0x7f718809ad40 2023-10-03T10:13:20.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.279+0000 7f7176ffd700 1 -- 172.21.15.146:0/3937889808 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f71780123b0 con 0x7f718809ad40 2023-10-03T10:13:20.288 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:20.296 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:20.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.336+0000 7fa4960b0700 1 Processor -- start 2023-10-03T10:13:20.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.336+0000 7fa4960b0700 1 -- start start 2023-10-03T10:13:20.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.337+0000 7fa4960b0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa490133a70 0x7fa490133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.337+0000 7fa4960b0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4900a08e0 0x7fa4900a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.337+0000 7fa4960b0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa490133640 con 0x7fa4900a1290 2023-10-03T10:13:20.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.337+0000 7fa4960b0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4900a1d50 con 0x7fa490133a70 2023-10-03T10:13:20.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.337+0000 7fa4960b0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4900a1710 con 0x7fa4900a08e0 2023-10-03T10:13:20.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.337+0000 7fa48ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa4900a1290 0x7fa49013a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50292/0 (socket says 172.21.15.146:50292) 2023-10-03T10:13:20.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.337+0000 7fa48ffff700 1 -- 172.21.15.146:0/2952758953 learned_addr learned my addr 172.21.15.146:0/2952758953 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:20.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.337+0000 7fa48f7fe700 1 --2- 172.21.15.146:0/2952758953 >> v2:172.21.15.146:3300/0 conn(0x7fa490133a70 0x7fa490133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.337+0000 7fa48effd700 1 --2- 172.21.15.146:0/2952758953 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4900a08e0 0x7fa4900a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.337+0000 7fa48e7fc700 1 -- 172.21.15.146:0/2952758953 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1151633636 0 0) 0x7fa490133640 con 0x7fa4900a1290 2023-10-03T10:13:20.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.337+0000 7fa48effd700 1 -- 172.21.15.146:0/2952758953 >> v2:172.21.15.146:3300/0 conn(0x7fa490133a70 msgr2=0x7fa490133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:20.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.337+0000 7fa48effd700 1 --2- 172.21.15.146:0/2952758953 >> v2:172.21.15.146:3300/0 conn(0x7fa490133a70 0x7fa490133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.337+0000 7fa48effd700 1 -- 172.21.15.146:0/2952758953 >> v1:172.21.15.146:6789/0 conn(0x7fa4900a1290 legacy=0x7fa49013a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.337+0000 7fa48effd700 1 -- 172.21.15.146:0/2952758953 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49009b620 con 0x7fa4900a08e0 2023-10-03T10:13:20.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.338+0000 7fa48effd700 1 --2- 172.21.15.146:0/2952758953 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4900a08e0 0x7fa4900a0d50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa484009840 tx=0x7fa484009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5ae063cd182704e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.338+0000 7fa48e7fc700 1 -- 172.21.15.146:0/2952758953 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa484011830 con 0x7fa4900a08e0 2023-10-03T10:13:20.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.338+0000 7fa48e7fc700 1 -- 172.21.15.146:0/2952758953 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa484011990 con 0x7fa4900a08e0 2023-10-03T10:13:20.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.338+0000 7fa48e7fc700 1 -- 172.21.15.146:0/2952758953 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa484011d20 con 0x7fa4900a08e0 2023-10-03T10:13:20.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.339+0000 7fa4960b0700 1 -- 172.21.15.146:0/2952758953 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4900a08e0 msgr2=0x7fa4900a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.339+0000 7fa4960b0700 1 --2- 172.21.15.146:0/2952758953 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4900a08e0 0x7fa4900a0d50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa484009840 tx=0x7fa484009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:20.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.339+0000 7fa4960b0700 1 -- 172.21.15.146:0/2952758953 shutdown_connections 2023-10-03T10:13:20.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.339+0000 7fa4960b0700 1 --2- 172.21.15.146:0/2952758953 >> v2:172.21.15.146:3300/0 conn(0x7fa490133a70 0x7fa490133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.339+0000 7fa4960b0700 1 --2- 172.21.15.146:0/2952758953 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4900a08e0 0x7fa4900a0d50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.339+0000 7fa4960b0700 1 -- 172.21.15.146:0/2952758953 >> 172.21.15.146:0/2952758953 conn(0x7fa4900a2980 msgr2=0x7fa4900a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.339+0000 7fa4960b0700 1 -- 172.21.15.146:0/2952758953 shutdown_connections 2023-10-03T10:13:20.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.339+0000 7fa4960b0700 1 -- 172.21.15.146:0/2952758953 wait complete. 2023-10-03T10:13:20.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.340+0000 7fa4960b0700 1 Processor -- start 2023-10-03T10:13:20.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.341+0000 7fa4960b0700 1 -- start start 2023-10-03T10:13:20.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.341+0000 7fa4960b0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4900a08e0 0x7fa4901c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.341+0000 7fa4960b0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4900a1290 0x7fa4901c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.341+0000 7fa4960b0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa490133a70 0x7fa4901c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.341+0000 7fa4960b0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49011ddd0 con 0x7fa4900a1290 2023-10-03T10:13:20.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.341+0000 7fa4960b0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4901c59e0 con 0x7fa4900a08e0 2023-10-03T10:13:20.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.341+0000 7fa4960b0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa49011dfd0 con 0x7fa490133a70 2023-10-03T10:13:20.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.341+0000 7fa48f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4900a08e0 0x7fa4901c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.341+0000 7fa48f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4900a08e0 0x7fa4901c4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39574/0 (socket says 172.21.15.146:39574) 2023-10-03T10:13:20.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.341+0000 7fa48f7fe700 1 -- 172.21.15.146:0/4200797610 learned_addr learned my addr 172.21.15.146:0/4200797610 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:20.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.341+0000 7fa48effd700 1 --2- 172.21.15.146:0/4200797610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4900a1290 0x7fa4901c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.341+0000 7fa48ffff700 1 --2- 172.21.15.146:0/4200797610 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa490133a70 0x7fa4901c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.342+0000 7fa48f7fe700 1 -- 172.21.15.146:0/4200797610 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa490133a70 msgr2=0x7fa4901c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.342+0000 7fa48f7fe700 1 --2- 172.21.15.146:0/4200797610 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa490133a70 0x7fa4901c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.342+0000 7fa48f7fe700 1 -- 172.21.15.146:0/4200797610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4900a1290 msgr2=0x7fa4901c54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.342+0000 7fa48f7fe700 1 --2- 172.21.15.146:0/4200797610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4900a1290 0x7fa4901c54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.342+0000 7fa48f7fe700 1 -- 172.21.15.146:0/4200797610 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4840094a0 con 0x7fa4900a08e0 2023-10-03T10:13:20.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.342+0000 7fa48effd700 1 --2- 172.21.15.146:0/4200797610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4900a1290 0x7fa4901c54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:20.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.342+0000 7fa48f7fe700 1 --2- 172.21.15.146:0/4200797610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4900a08e0 0x7fa4901c4f60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa48000e990 tx=0x7fa48000eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.342+0000 7fa477fff700 1 -- 172.21.15.146:0/4200797610 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48000eee0 con 0x7fa4900a08e0 2023-10-03T10:13:20.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.342+0000 7fa477fff700 1 -- 172.21.15.146:0/4200797610 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48000c850 con 0x7fa4900a08e0 2023-10-03T10:13:20.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.342+0000 7fa477fff700 1 -- 172.21.15.146:0/4200797610 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48000cbc0 con 0x7fa4900a08e0 2023-10-03T10:13:20.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.342+0000 7fa4960b0700 1 -- 172.21.15.146:0/4200797610 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa49011c0c0 con 0x7fa4900a08e0 2023-10-03T10:13:20.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.342+0000 7fa4960b0700 1 -- 172.21.15.146:0/4200797610 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa49009a350 con 0x7fa4900a08e0 2023-10-03T10:13:20.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.343+0000 7fa4960b0700 1 -- 172.21.15.146:0/4200797610 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa49011d3e0 con 0x7fa4900a08e0 2023-10-03T10:13:20.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.343+0000 7fa477fff700 1 -- 172.21.15.146:0/4200797610 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa48000cd20 con 0x7fa4900a08e0 2023-10-03T10:13:20.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.343+0000 7fa477fff700 1 -- 172.21.15.146:0/4200797610 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa48003fb80 con 0x7fa4900a08e0 2023-10-03T10:13:20.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.348+0000 7fa477fff700 1 -- 172.21.15.146:0/4200797610 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa48001ada0 con 0x7fa4900a08e0 2023-10-03T10:13:20.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.420+0000 7fd386b51700 1 Processor -- start 2023-10-03T10:13:20.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.420+0000 7fd386b51700 1 -- start start 2023-10-03T10:13:20.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.421+0000 7fd386b51700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd38009ad40 0x7fd380133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.421+0000 7fd386b51700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd380133f70 0x7fd3801343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.421+0000 7fd386b51700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd38009b110 con 0x7fd3800a0a70 2023-10-03T10:13:20.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.421+0000 7fd386b51700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3800a3b60 con 0x7fd380133f70 2023-10-03T10:13:20.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.421+0000 7fd386b51700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3801348e0 con 0x7fd38009ad40 2023-10-03T10:13:20.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.421+0000 7fd37ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd380133f70 0x7fd3801343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.421+0000 7fd3850ee700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd3800a0a70 0x7fd3800a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50308/0 (socket says 172.21.15.146:50308) 2023-10-03T10:13:20.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.421+0000 7fd37ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd380133f70 0x7fd3801343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39584/0 (socket says 172.21.15.146:39584) 2023-10-03T10:13:20.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.421+0000 7fd3850ee700 1 -- 172.21.15.146:0/3657905612 learned_addr learned my addr 172.21.15.146:0/3657905612 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:20.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.421+0000 7fd3848ed700 1 --2- 172.21.15.146:0/3657905612 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd38009ad40 0x7fd380133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.421+0000 7fd37f7fe700 1 -- 172.21.15.146:0/3657905612 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101785959 0 0) 0x7fd38009b110 con 0x7fd3800a0a70 2023-10-03T10:13:20.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.421+0000 7fd37f7fe700 1 -- 172.21.15.146:0/3657905612 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3700035b0 con 0x7fd3800a0a70 2023-10-03T10:13:20.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.421+0000 7fd37ffff700 1 -- 172.21.15.146:0/3657905612 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd38009ad40 msgr2=0x7fd380133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:20.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.421+0000 7fd37ffff700 1 --2- 172.21.15.146:0/3657905612 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd38009ad40 0x7fd380133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.421+0000 7fd37ffff700 1 -- 172.21.15.146:0/3657905612 >> v1:172.21.15.146:6789/0 conn(0x7fd3800a0a70 legacy=0x7fd3800a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.421+0000 7fd37ffff700 1 -- 172.21.15.146:0/3657905612 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3800a2fa0 con 0x7fd380133f70 2023-10-03T10:13:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.422+0000 7fd37ffff700 1 --2- 172.21.15.146:0/3657905612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd380133f70 0x7fd3801343a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009870 tx=0x7fd36c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2ea80ce57b88e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.422+0000 7fd37f7fe700 1 -- 172.21.15.146:0/3657905612 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c011830 con 0x7fd380133f70 2023-10-03T10:13:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.422+0000 7fd37f7fe700 1 -- 172.21.15.146:0/3657905612 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c011990 con 0x7fd380133f70 2023-10-03T10:13:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.422+0000 7fd37f7fe700 1 -- 172.21.15.146:0/3657905612 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c011d00 con 0x7fd380133f70 2023-10-03T10:13:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.422+0000 7fd386b51700 1 -- 172.21.15.146:0/3657905612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd380133f70 msgr2=0x7fd3801343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.422+0000 7fd386b51700 1 --2- 172.21.15.146:0/3657905612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd380133f70 0x7fd3801343a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009870 tx=0x7fd36c009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.422+0000 7fd386b51700 1 -- 172.21.15.146:0/3657905612 shutdown_connections 2023-10-03T10:13:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.422+0000 7fd386b51700 1 --2- 172.21.15.146:0/3657905612 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd38009ad40 0x7fd380133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.422+0000 7fd386b51700 1 --2- 172.21.15.146:0/3657905612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd380133f70 0x7fd3801343a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.422+0000 7fd386b51700 1 -- 172.21.15.146:0/3657905612 >> 172.21.15.146:0/3657905612 conn(0x7fd380099c40 msgr2=0x7fd38006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.423+0000 7fd386b51700 1 -- 172.21.15.146:0/3657905612 shutdown_connections 2023-10-03T10:13:20.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.423+0000 7fd386b51700 1 -- 172.21.15.146:0/3657905612 wait complete. 2023-10-03T10:13:20.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.423+0000 7fd386b51700 1 Processor -- start 2023-10-03T10:13:20.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.423+0000 7fd386b51700 1 -- start start 2023-10-03T10:13:20.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.424+0000 7fd386b51700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd38009ad40 0x7fd380132770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.424+0000 7fd386b51700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3800a0a70 0x7fd380132cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.424+0000 7fd386b51700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd380133f70 0x7fd38011e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.424+0000 7fd386b51700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd380120580 con 0x7fd3800a0a70 2023-10-03T10:13:20.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.424+0000 7fd386b51700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3801226b0 con 0x7fd38009ad40 2023-10-03T10:13:20.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.424+0000 7fd386b51700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd380120b30 con 0x7fd380133f70 2023-10-03T10:13:20.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.424+0000 7fd3850ee700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd380133f70 0x7fd38011e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.424+0000 7fd3850ee700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd380133f70 0x7fd38011e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36522/0 (socket says 172.21.15.146:36522) 2023-10-03T10:13:20.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.424+0000 7fd3848ed700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd38009ad40 0x7fd380132770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.424+0000 7fd3850ee700 1 -- 172.21.15.146:0/1008109620 learned_addr learned my addr 172.21.15.146:0/1008109620 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:20.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.424+0000 7fd37ffff700 1 --2- 172.21.15.146:0/1008109620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3800a0a70 0x7fd380132cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.425+0000 7fd3850ee700 1 -- 172.21.15.146:0/1008109620 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd38009ad40 msgr2=0x7fd380132770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.425+0000 7fd3850ee700 1 --2- 172.21.15.146:0/1008109620 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd38009ad40 0x7fd380132770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.425+0000 7fd3850ee700 1 -- 172.21.15.146:0/1008109620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3800a0a70 msgr2=0x7fd380132cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.425+0000 7fd3850ee700 1 --2- 172.21.15.146:0/1008109620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3800a0a70 0x7fd380132cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.425+0000 7fd3850ee700 1 -- 172.21.15.146:0/1008109620 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c0094a0 con 0x7fd380133f70 2023-10-03T10:13:20.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.425+0000 7fd3850ee700 1 --2- 172.21.15.146:0/1008109620 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd380133f70 0x7fd38011e970 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd37800cb40 tx=0x7fd37800ce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.425+0000 7fd37d7fa700 1 -- 172.21.15.146:0/1008109620 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37800aaa0 con 0x7fd380133f70 2023-10-03T10:13:20.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.425+0000 7fd37d7fa700 1 -- 172.21.15.146:0/1008109620 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37800ac00 con 0x7fd380133f70 2023-10-03T10:13:20.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.425+0000 7fd37d7fa700 1 -- 172.21.15.146:0/1008109620 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd378012400 con 0x7fd380133f70 2023-10-03T10:13:20.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.425+0000 7fd386b51700 1 -- 172.21.15.146:0/1008109620 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd380121ef0 con 0x7fd380133f70 2023-10-03T10:13:20.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.425+0000 7fd386b51700 1 -- 172.21.15.146:0/1008109620 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd380120d70 con 0x7fd380133f70 2023-10-03T10:13:20.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.426+0000 7fd386b51700 1 -- 172.21.15.146:0/1008109620 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38004f2a0 con 0x7fd380133f70 2023-10-03T10:13:20.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.426+0000 7fd37d7fa700 1 -- 172.21.15.146:0/1008109620 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd378012560 con 0x7fd380133f70 2023-10-03T10:13:20.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.426+0000 7fd37d7fa700 1 -- 172.21.15.146:0/1008109620 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd37803f400 con 0x7fd380133f70 2023-10-03T10:13:20.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.431+0000 7fd37d7fa700 1 -- 172.21.15.146:0/1008109620 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd37801b3b0 con 0x7fd380133f70 2023-10-03T10:13:20.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.465+0000 7fb69a547700 1 Processor -- start 2023-10-03T10:13:20.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.465+0000 7fb69a547700 1 -- start start 2023-10-03T10:13:20.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.465+0000 7fb69a547700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb694131980 0x7fb694131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.465+0000 7fb69a547700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb69409bc70 0x7fb69409c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.465+0000 7fb69a547700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb69409c5c0 0x7fb694138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.465+0000 7fb69a547700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb69406eb30 con 0x7fb69409c5c0 2023-10-03T10:13:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.465+0000 7fb69a547700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6940a1640 con 0x7fb694131980 2023-10-03T10:13:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.465+0000 7fb69a547700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6940a22d0 con 0x7fb69409bc70 2023-10-03T10:13:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.465+0000 7fb693fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb694131980 0x7fb694131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.465+0000 7fb6937fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb69409bc70 0x7fb69409c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.465+0000 7fb698ae4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb69409c5c0 0x7fb694138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.465+0000 7fb6937fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb69409bc70 0x7fb69409c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36536/0 (socket says 172.21.15.146:36536) 2023-10-03T10:13:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.465+0000 7fb6937fe700 1 -- 172.21.15.146:0/2637112404 learned_addr learned my addr 172.21.15.146:0/2637112404 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.465+0000 7fb693fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb694131980 0x7fb694131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39592/0 (socket says 172.21.15.146:39592) 2023-10-03T10:13:20.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.466+0000 7fb6937fe700 1 -- 172.21.15.146:0/2637112404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb694131980 msgr2=0x7fb694131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:20.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.466+0000 7fb6937fe700 1 --2- 172.21.15.146:0/2637112404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb694131980 0x7fb694131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.466+0000 7fb6937fe700 1 -- 172.21.15.146:0/2637112404 >> v2:172.21.15.146:3300/0 conn(0x7fb69409c5c0 msgr2=0x7fb694138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:20.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.466+0000 7fb6937fe700 1 --2- 172.21.15.146:0/2637112404 >> v2:172.21.15.146:3300/0 conn(0x7fb69409c5c0 0x7fb694138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.466+0000 7fb6937fe700 1 -- 172.21.15.146:0/2637112404 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb694131550 con 0x7fb69409bc70 2023-10-03T10:13:20.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.466+0000 7fb6937fe700 1 --2- 172.21.15.146:0/2637112404 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb69409bc70 0x7fb69409c080 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb6880098f0 tx=0x7fb688009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f18831078278cc8e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.466+0000 7fb692ffd700 1 -- 172.21.15.146:0/2637112404 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb688011830 con 0x7fb69409bc70 2023-10-03T10:13:20.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.466+0000 7fb692ffd700 1 -- 172.21.15.146:0/2637112404 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb688011990 con 0x7fb69409bc70 2023-10-03T10:13:20.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.466+0000 7fb692ffd700 1 -- 172.21.15.146:0/2637112404 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb688011d20 con 0x7fb69409bc70 2023-10-03T10:13:20.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.467+0000 7fb69a547700 1 -- 172.21.15.146:0/2637112404 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb69409bc70 msgr2=0x7fb69409c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.467+0000 7fb69a547700 1 --2- 172.21.15.146:0/2637112404 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb69409bc70 0x7fb69409c080 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb6880098f0 tx=0x7fb688009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:20.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.467+0000 7fb69a547700 1 -- 172.21.15.146:0/2637112404 shutdown_connections 2023-10-03T10:13:20.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.467+0000 7fb69a547700 1 --2- 172.21.15.146:0/2637112404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb694131980 0x7fb694131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.467+0000 7fb69a547700 1 --2- 172.21.15.146:0/2637112404 >> v2:172.21.15.146:3300/0 conn(0x7fb69409c5c0 0x7fb694138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.467+0000 7fb69a547700 1 --2- 172.21.15.146:0/2637112404 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb69409bc70 0x7fb69409c080 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.467+0000 7fb69a547700 1 -- 172.21.15.146:0/2637112404 >> 172.21.15.146:0/2637112404 conn(0x7fb6940a2980 msgr2=0x7fb6940a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.467+0000 7fb69a547700 1 -- 172.21.15.146:0/2637112404 shutdown_connections 2023-10-03T10:13:20.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.467+0000 7fb69a547700 1 -- 172.21.15.146:0/2637112404 wait complete. 2023-10-03T10:13:20.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.468+0000 7fb69a547700 1 Processor -- start 2023-10-03T10:13:20.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.468+0000 7fb69a547700 1 -- start start 2023-10-03T10:13:20.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.469+0000 7fb69a547700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb69409bc70 0x7fb69411b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.469+0000 7fb69a547700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb69409c5c0 0x7fb69411bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.469+0000 7fb69a547700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb694131980 0x7fb69411c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:20.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.469+0000 7fb69a547700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69411f2c0 con 0x7fb69409bc70 2023-10-03T10:13:20.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.469+0000 7fb69a547700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb694130b80 con 0x7fb694131980 2023-10-03T10:13:20.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.469+0000 7fb69a547700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb69411ea50 con 0x7fb69409c5c0 2023-10-03T10:13:20.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.469+0000 7fb6937fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb69409c5c0 0x7fb69411bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.469+0000 7fb693fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb69409bc70 0x7fb69411b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.469+0000 7fb698ae4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb694131980 0x7fb69411c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:20.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.469+0000 7fb6937fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb69409c5c0 0x7fb69411bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36552/0 (socket says 172.21.15.146:36552) 2023-10-03T10:13:20.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.469+0000 7fb6937fe700 1 -- 172.21.15.146:0/2207271505 learned_addr learned my addr 172.21.15.146:0/2207271505 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:20.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.470+0000 7fb6937fe700 1 -- 172.21.15.146:0/2207271505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb694131980 msgr2=0x7fb69411c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.470+0000 7fb6937fe700 1 --2- 172.21.15.146:0/2207271505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb694131980 0x7fb69411c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.470+0000 7fb6937fe700 1 -- 172.21.15.146:0/2207271505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb69409bc70 msgr2=0x7fb69411b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.470+0000 7fb6937fe700 1 --2- 172.21.15.146:0/2207271505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb69409bc70 0x7fb69411b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.470+0000 7fb6937fe700 1 -- 172.21.15.146:0/2207271505 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb688009550 con 0x7fb69409c5c0 2023-10-03T10:13:20.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.470+0000 7fb6937fe700 1 --2- 172.21.15.146:0/2207271505 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb69409c5c0 0x7fb69411bd70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb688009c40 tx=0x7fb688004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:20.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.470+0000 7fb690ff9700 1 -- 172.21.15.146:0/2207271505 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb688004450 con 0x7fb69409c5c0 2023-10-03T10:13:20.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.470+0000 7fb690ff9700 1 -- 172.21.15.146:0/2207271505 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6880045b0 con 0x7fb69409c5c0 2023-10-03T10:13:20.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.470+0000 7fb69a547700 1 -- 172.21.15.146:0/2207271505 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6940a1c40 con 0x7fb69409c5c0 2023-10-03T10:13:20.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.470+0000 7fb690ff9700 1 -- 172.21.15.146:0/2207271505 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6880038a0 con 0x7fb69409c5c0 2023-10-03T10:13:20.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.470+0000 7fb69a547700 1 -- 172.21.15.146:0/2207271505 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69411e600 con 0x7fb69409c5c0 2023-10-03T10:13:20.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.471+0000 7fb69a547700 1 -- 172.21.15.146:0/2207271505 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb69411ec80 con 0x7fb69409c5c0 2023-10-03T10:13:20.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.472+0000 7fb690ff9700 1 -- 172.21.15.146:0/2207271505 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb688021070 con 0x7fb69409c5c0 2023-10-03T10:13:20.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.472+0000 7fb690ff9700 1 -- 172.21.15.146:0/2207271505 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb688040b00 con 0x7fb69409c5c0 2023-10-03T10:13:20.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.476+0000 7fb690ff9700 1 -- 172.21.15.146:0/2207271505 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb688003a00 con 0x7fb69409c5c0 2023-10-03T10:13:20.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.485+0000 7f718c957700 1 -- 172.21.15.146:0/3937889808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f718811e6b0 con 0x7f718809ad40 2023-10-03T10:13:20.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.485+0000 7f7176ffd700 1 -- 172.21.15.146:0/3937889808 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7178011360 con 0x7f718809ad40 2023-10-03T10:13:20.486 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:20.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.487+0000 7f718c957700 1 -- 172.21.15.146:0/3937889808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f718809ad40 msgr2=0x7f7188139470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.487+0000 7f718c957700 1 --2- 172.21.15.146:0/3937889808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f718809ad40 0x7f7188139470 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f717800c550 tx=0x7f717800c860 comp rx=0 tx=0).stop 2023-10-03T10:13:20.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.487+0000 7f718c957700 1 -- 172.21.15.146:0/3937889808 shutdown_connections 2023-10-03T10:13:20.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.487+0000 7f718c957700 1 --2- 172.21.15.146:0/3937889808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7188134570 0x7f7188139ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.487+0000 7f718c957700 1 --2- 172.21.15.146:0/3937889808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f718809ad40 0x7f7188139470 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.487+0000 7f718c957700 1 --2- 172.21.15.146:0/3937889808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7188134140 0x7f71881399b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.487+0000 7f718c957700 1 -- 172.21.15.146:0/3937889808 >> 172.21.15.146:0/3937889808 conn(0x7f7188099c40 msgr2=0x7f718813b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.487+0000 7f718c957700 1 -- 172.21.15.146:0/3937889808 shutdown_connections 2023-10-03T10:13:20.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.487+0000 7f718c957700 1 -- 172.21.15.146:0/3937889808 wait complete. 2023-10-03T10:13:20.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:20.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.554+0000 7fa4960b0700 1 -- 172.21.15.146:0/4200797610 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa49004f2a0 con 0x7fa4900a08e0 2023-10-03T10:13:20.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.554+0000 7fa477fff700 1 -- 172.21.15.146:0/4200797610 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa480021070 con 0x7fa4900a08e0 2023-10-03T10:13:20.555 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:20.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.556+0000 7fa4960b0700 1 -- 172.21.15.146:0/4200797610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4900a08e0 msgr2=0x7fa4901c4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.556+0000 7fa4960b0700 1 --2- 172.21.15.146:0/4200797610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4900a08e0 0x7fa4901c4f60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa48000e990 tx=0x7fa48000eca0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.556+0000 7fa4960b0700 1 -- 172.21.15.146:0/4200797610 shutdown_connections 2023-10-03T10:13:20.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.556+0000 7fa4960b0700 1 --2- 172.21.15.146:0/4200797610 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa490133a70 0x7fa4901c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.556+0000 7fa4960b0700 1 --2- 172.21.15.146:0/4200797610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4900a08e0 0x7fa4901c4f60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.556+0000 7fa4960b0700 1 --2- 172.21.15.146:0/4200797610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4900a1290 0x7fa4901c54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.556+0000 7fa4960b0700 1 -- 172.21.15.146:0/4200797610 >> 172.21.15.146:0/4200797610 conn(0x7fa4900a2980 msgr2=0x7fa49012f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.556+0000 7fa4960b0700 1 -- 172.21.15.146:0/4200797610 shutdown_connections 2023-10-03T10:13:20.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.556+0000 7fa4960b0700 1 -- 172.21.15.146:0/4200797610 wait complete. 2023-10-03T10:13:20.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:20.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.632+0000 7fd386b51700 1 -- 172.21.15.146:0/1008109620 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd38009e6f0 con 0x7fd380133f70 2023-10-03T10:13:20.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.633+0000 7fd37d7fa700 1 -- 172.21.15.146:0/1008109620 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd378007070 con 0x7fd380133f70 2023-10-03T10:13:20.634 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:20.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.635+0000 7fd386b51700 1 -- 172.21.15.146:0/1008109620 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd380133f70 msgr2=0x7fd38011e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.635+0000 7fd386b51700 1 --2- 172.21.15.146:0/1008109620 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd380133f70 0x7fd38011e970 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd37800cb40 tx=0x7fd37800ce50 comp rx=0 tx=0).stop 2023-10-03T10:13:20.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.635+0000 7fd386b51700 1 -- 172.21.15.146:0/1008109620 shutdown_connections 2023-10-03T10:13:20.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.635+0000 7fd386b51700 1 --2- 172.21.15.146:0/1008109620 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd380133f70 0x7fd38011e970 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.635+0000 7fd386b51700 1 --2- 172.21.15.146:0/1008109620 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd38009ad40 0x7fd380132770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.635+0000 7fd386b51700 1 --2- 172.21.15.146:0/1008109620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3800a0a70 0x7fd380132cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.635+0000 7fd386b51700 1 -- 172.21.15.146:0/1008109620 >> 172.21.15.146:0/1008109620 conn(0x7fd380099c40 msgr2=0x7fd3801bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.635+0000 7fd386b51700 1 -- 172.21.15.146:0/1008109620 shutdown_connections 2023-10-03T10:13:20.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.635+0000 7fd386b51700 1 -- 172.21.15.146:0/1008109620 wait complete. 2023-10-03T10:13:20.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:20.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.673+0000 7fb69a547700 1 -- 172.21.15.146:0/2207271505 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb69411ec80 con 0x7fb69409c5c0 2023-10-03T10:13:20.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.674+0000 7fb690ff9700 1 -- 172.21.15.146:0/2207271505 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb688029030 con 0x7fb69409c5c0 2023-10-03T10:13:20.674 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:20.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.675+0000 7fb69a547700 1 -- 172.21.15.146:0/2207271505 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb69409c5c0 msgr2=0x7fb69411bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.675+0000 7fb69a547700 1 --2- 172.21.15.146:0/2207271505 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb69409c5c0 0x7fb69411bd70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb688009c40 tx=0x7fb688004750 comp rx=0 tx=0).stop 2023-10-03T10:13:20.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.676+0000 7fb69a547700 1 -- 172.21.15.146:0/2207271505 shutdown_connections 2023-10-03T10:13:20.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.676+0000 7fb69a547700 1 --2- 172.21.15.146:0/2207271505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb694131980 0x7fb69411c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.676+0000 7fb69a547700 1 --2- 172.21.15.146:0/2207271505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb69409bc70 0x7fb69411b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.676+0000 7fb69a547700 1 --2- 172.21.15.146:0/2207271505 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb69409c5c0 0x7fb69411bd70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.676+0000 7fb69a547700 1 -- 172.21.15.146:0/2207271505 >> 172.21.15.146:0/2207271505 conn(0x7fb6940a2980 msgr2=0x7fb69409d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.676+0000 7fb69a547700 1 -- 172.21.15.146:0/2207271505 shutdown_connections 2023-10-03T10:13:20.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:20.676+0000 7fb69a547700 1 -- 172.21.15.146:0/2207271505 wait complete. 2023-10-03T10:13:20.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:21.503 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:21.571 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:21.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.641+0000 7ff4aeb1e700 1 Processor -- start 2023-10-03T10:13:21.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.641+0000 7ff4aeb1e700 1 -- start start 2023-10-03T10:13:21.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.641+0000 7ff4aeb1e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff4a80a0a70 0x7ff4a80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.641+0000 7ff4aeb1e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4a80a1380 0x7ff4a8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.641+0000 7ff4aeb1e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4a8133f50 0x7ff4a81343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.641+0000 7ff4aeb1e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a809e9d0 con 0x7ff4a80a0a70 2023-10-03T10:13:21.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.641+0000 7ff4aeb1e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a809dc00 con 0x7ff4a8133f50 2023-10-03T10:13:21.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.641+0000 7ff4aeb1e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a809dec0 con 0x7ff4a80a1380 2023-10-03T10:13:21.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.642+0000 7ff4ac8ba700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff4a80a0a70 0x7ff4a80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.642+0000 7ff4a7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4a80a1380 0x7ff4a8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.642+0000 7ff4ac8ba700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff4a80a0a70 0x7ff4a80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51120/0 (socket says 172.21.15.146:51120) 2023-10-03T10:13:21.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.642+0000 7ff4a7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4a80a1380 0x7ff4a8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36564/0 (socket says 172.21.15.146:36564) 2023-10-03T10:13:21.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.642+0000 7ff4ac8ba700 1 -- 172.21.15.146:0/2523332215 learned_addr learned my addr 172.21.15.146:0/2523332215 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:21.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.642+0000 7ff4ad0bb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4a8133f50 0x7ff4a81343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.642+0000 7ff4a7fff700 1 -- 172.21.15.146:0/2523332215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4a8133f50 msgr2=0x7ff4a81343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.642+0000 7ff4a7fff700 1 --2- 172.21.15.146:0/2523332215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4a8133f50 0x7ff4a81343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.642+0000 7ff4a7fff700 1 -- 172.21.15.146:0/2523332215 >> v2:172.21.15.146:3300/0 conn(0x7ff4a80a0a70 msgr2=0x7ff4a80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.642+0000 7ff4a7fff700 1 --2- 172.21.15.146:0/2523332215 >> v2:172.21.15.146:3300/0 conn(0x7ff4a80a0a70 0x7ff4a80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.642+0000 7ff4a7fff700 1 -- 172.21.15.146:0/2523332215 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a809e6a0 con 0x7ff4a80a1380 2023-10-03T10:13:21.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.642+0000 7ff4ac8ba700 1 --2- 172.21.15.146:0/2523332215 >> v2:172.21.15.146:3300/0 conn(0x7ff4a80a0a70 0x7ff4a80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:21.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.642+0000 7ff4a7fff700 1 --2- 172.21.15.146:0/2523332215 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4a80a1380 0x7ff4a8133a10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff494009840 tx=0x7ff494009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=669be5d66faee500 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.642+0000 7ff4a77fe700 1 -- 172.21.15.146:0/2523332215 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff494011830 con 0x7ff4a80a1380 2023-10-03T10:13:21.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.642+0000 7ff4a77fe700 1 -- 172.21.15.146:0/2523332215 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff494011990 con 0x7ff4a80a1380 2023-10-03T10:13:21.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.642+0000 7ff4a77fe700 1 -- 172.21.15.146:0/2523332215 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff494011d20 con 0x7ff4a80a1380 2023-10-03T10:13:21.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.643+0000 7ff4aeb1e700 1 -- 172.21.15.146:0/2523332215 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4a80a1380 msgr2=0x7ff4a8133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.643+0000 7ff4aeb1e700 1 --2- 172.21.15.146:0/2523332215 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4a80a1380 0x7ff4a8133a10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff494009840 tx=0x7ff494009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:21.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.643+0000 7ff4aeb1e700 1 -- 172.21.15.146:0/2523332215 shutdown_connections 2023-10-03T10:13:21.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.643+0000 7ff4aeb1e700 1 --2- 172.21.15.146:0/2523332215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4a8133f50 0x7ff4a81343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.643+0000 7ff4aeb1e700 1 --2- 172.21.15.146:0/2523332215 >> v2:172.21.15.146:3300/0 conn(0x7ff4a80a0a70 0x7ff4a80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.643+0000 7ff4aeb1e700 1 --2- 172.21.15.146:0/2523332215 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4a80a1380 0x7ff4a8133a10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.643+0000 7ff4aeb1e700 1 -- 172.21.15.146:0/2523332215 >> 172.21.15.146:0/2523332215 conn(0x7ff4a80a6610 msgr2=0x7ff4a80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.643+0000 7ff4aeb1e700 1 -- 172.21.15.146:0/2523332215 shutdown_connections 2023-10-03T10:13:21.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.643+0000 7ff4aeb1e700 1 -- 172.21.15.146:0/2523332215 wait complete. 2023-10-03T10:13:21.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.644+0000 7ff4aeb1e700 1 Processor -- start 2023-10-03T10:13:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.644+0000 7ff4aeb1e700 1 -- start start 2023-10-03T10:13:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4aeb1e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4a80a0a70 0x7ff4a81223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4aeb1e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4a80a1380 0x7ff4a81228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4aeb1e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4a8133f50 0x7ff4a8122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4aeb1e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a8125180 con 0x7ff4a8133f50 2023-10-03T10:13:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4aeb1e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a8124dc0 con 0x7ff4a80a0a70 2023-10-03T10:13:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4aeb1e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a80a03e0 con 0x7ff4a80a1380 2023-10-03T10:13:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4a7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4a80a1380 0x7ff4a81228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4ad0bb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4a8133f50 0x7ff4a8122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4ac8ba700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4a80a0a70 0x7ff4a81223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4a7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4a80a1380 0x7ff4a81228f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36572/0 (socket says 172.21.15.146:36572) 2023-10-03T10:13:21.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4a7fff700 1 -- 172.21.15.146:0/3788437393 learned_addr learned my addr 172.21.15.146:0/3788437393 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:21.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4ad0bb700 1 --2- 172.21.15.146:0/3788437393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4a8133f50 0x7ff4a8122e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51122/0 (socket says 172.21.15.146:51122) 2023-10-03T10:13:21.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4a7fff700 1 -- 172.21.15.146:0/3788437393 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4a80a0a70 msgr2=0x7ff4a81223b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4a7fff700 1 --2- 172.21.15.146:0/3788437393 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4a80a0a70 0x7ff4a81223b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4a7fff700 1 -- 172.21.15.146:0/3788437393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4a8133f50 msgr2=0x7ff4a8122e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4a7fff700 1 --2- 172.21.15.146:0/3788437393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4a8133f50 0x7ff4a8122e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4a7fff700 1 -- 172.21.15.146:0/3788437393 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c009550 con 0x7ff4a80a1380 2023-10-03T10:13:21.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4ac8ba700 1 --2- 172.21.15.146:0/3788437393 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4a80a0a70 0x7ff4a81223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:21.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4ad0bb700 1 --2- 172.21.15.146:0/3788437393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4a8133f50 0x7ff4a8122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:21.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4a7fff700 1 --2- 172.21.15.146:0/3788437393 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4a80a1380 0x7ff4a81228f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff4940090b0 tx=0x7ff494004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4a57fa700 1 -- 172.21.15.146:0/3788437393 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff494004450 con 0x7ff4a80a1380 2023-10-03T10:13:21.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4a57fa700 1 -- 172.21.15.146:0/3788437393 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49401f070 con 0x7ff4a80a1380 2023-10-03T10:13:21.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4aeb1e700 1 -- 172.21.15.146:0/3788437393 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4940094a0 con 0x7ff4a80a1380 2023-10-03T10:13:21.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4a57fa700 1 -- 172.21.15.146:0/3788437393 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4940038e0 con 0x7ff4a80a1380 2023-10-03T10:13:21.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.645+0000 7ff4aeb1e700 1 -- 172.21.15.146:0/3788437393 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a8125900 con 0x7ff4a80a1380 2023-10-03T10:13:21.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.646+0000 7ff4a57fa700 1 -- 172.21.15.146:0/3788437393 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff494003a40 con 0x7ff4a80a1380 2023-10-03T10:13:21.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.646+0000 7ff4a57fa700 1 -- 172.21.15.146:0/3788437393 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff494021070 con 0x7ff4a80a1380 2023-10-03T10:13:21.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.647+0000 7ff4aeb1e700 1 -- 172.21.15.146:0/3788437393 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a811f760 con 0x7ff4a80a1380 2023-10-03T10:13:21.656 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:21.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.651+0000 7ff4a57fa700 1 -- 172.21.15.146:0/3788437393 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff49401a430 con 0x7ff4a80a1380 2023-10-03T10:13:21.690 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.703+0000 7fb2d130b700 1 Processor -- start 2023-10-03T10:13:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.703+0000 7fb2d130b700 1 -- start start 2023-10-03T10:13:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.704+0000 7fb2d130b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2cc0a0a30 0x7fb2cc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.704+0000 7fb2d130b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb2cc0a1340 0x7fb2cc12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.704+0000 7fb2d130b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb2cc1304a0 0x7fb2cc1308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.704+0000 7fb2d130b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2cc130e30 con 0x7fb2cc1304a0 2023-10-03T10:13:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.704+0000 7fb2d130b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc0a1e70 con 0x7fb2cc0a0a30 2023-10-03T10:13:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.704+0000 7fb2d130b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc09a720 con 0x7fb2cc0a1340 2023-10-03T10:13:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.704+0000 7fb2cb7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb2cc1304a0 0x7fb2cc1308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.704+0000 7fb2cb7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb2cc1304a0 0x7fb2cc1308f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51134/0 (socket says 172.21.15.146:51134) 2023-10-03T10:13:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.704+0000 7fb2caffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2cc0a0a30 0x7fb2cc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.704+0000 7fb2cb7fe700 1 -- 172.21.15.146:0/711632691 learned_addr learned my addr 172.21.15.146:0/711632691 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.704+0000 7fb2ca7fc700 1 --2- 172.21.15.146:0/711632691 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb2cc0a1340 0x7fb2cc12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.704+0000 7fb2caffd700 1 -- 172.21.15.146:0/711632691 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb2cc0a1340 msgr2=0x7fb2cc12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.704+0000 7fb2caffd700 1 --2- 172.21.15.146:0/711632691 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb2cc0a1340 0x7fb2cc12ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.704+0000 7fb2caffd700 1 -- 172.21.15.146:0/711632691 >> v2:172.21.15.146:3300/0 conn(0x7fb2cc1304a0 msgr2=0x7fb2cc1308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.704+0000 7fb2caffd700 1 --2- 172.21.15.146:0/711632691 >> v2:172.21.15.146:3300/0 conn(0x7fb2cc1304a0 0x7fb2cc1308f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.704+0000 7fb2caffd700 1 -- 172.21.15.146:0/711632691 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc09b300 con 0x7fb2cc0a0a30 2023-10-03T10:13:21.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.704+0000 7fb2cb7fe700 1 --2- 172.21.15.146:0/711632691 >> v2:172.21.15.146:3300/0 conn(0x7fb2cc1304a0 0x7fb2cc1308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.705+0000 7fb2caffd700 1 --2- 172.21.15.146:0/711632691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2cc0a0a30 0x7fb2cc0a0e00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009820 tx=0x7fb2bc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ea1484e02a08a45 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.705+0000 7fb2c9ffb700 1 -- 172.21.15.146:0/711632691 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc005e30 con 0x7fb2cc0a0a30 2023-10-03T10:13:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.705+0000 7fb2c9ffb700 1 -- 172.21.15.146:0/711632691 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2bc006030 con 0x7fb2cc0a0a30 2023-10-03T10:13:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.705+0000 7fb2c9ffb700 1 -- 172.21.15.146:0/711632691 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc0063c0 con 0x7fb2cc0a0a30 2023-10-03T10:13:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.705+0000 7fb2d130b700 1 -- 172.21.15.146:0/711632691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2cc0a0a30 msgr2=0x7fb2cc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.705+0000 7fb2d130b700 1 --2- 172.21.15.146:0/711632691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2cc0a0a30 0x7fb2cc0a0e00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009820 tx=0x7fb2bc009b30 comp rx=0 tx=0).stop 2023-10-03T10:13:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.706+0000 7fb2d130b700 1 -- 172.21.15.146:0/711632691 shutdown_connections 2023-10-03T10:13:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.706+0000 7fb2d130b700 1 --2- 172.21.15.146:0/711632691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2cc0a0a30 0x7fb2cc0a0e00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.706+0000 7fb2d130b700 1 --2- 172.21.15.146:0/711632691 >> v2:172.21.15.146:3300/0 conn(0x7fb2cc1304a0 0x7fb2cc1308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.706+0000 7fb2d130b700 1 --2- 172.21.15.146:0/711632691 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb2cc0a1340 0x7fb2cc12ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.706+0000 7fb2d130b700 1 -- 172.21.15.146:0/711632691 >> 172.21.15.146:0/711632691 conn(0x7fb2cc0a2980 msgr2=0x7fb2cc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.706+0000 7fb2d130b700 1 -- 172.21.15.146:0/711632691 shutdown_connections 2023-10-03T10:13:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.706+0000 7fb2d130b700 1 -- 172.21.15.146:0/711632691 wait complete. 2023-10-03T10:13:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.707+0000 7fb2d130b700 1 Processor -- start 2023-10-03T10:13:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.707+0000 7fb2d130b700 1 -- start start 2023-10-03T10:13:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.707+0000 7fb2d130b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2cc0a0a30 0x7fb2cc11ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.707+0000 7fb2d130b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb2cc0a1340 0x7fb2cc11b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.707+0000 7fb2d130b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2cc1304a0 0x7fb2cc11b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.707+0000 7fb2d130b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc11c260 con 0x7fb2cc1304a0 2023-10-03T10:13:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.707+0000 7fb2d130b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc11e8b0 con 0x7fb2cc0a0a30 2023-10-03T10:13:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.707+0000 7fb2d130b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc11c9a0 con 0x7fb2cc0a1340 2023-10-03T10:13:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.707+0000 7fb2caffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2cc0a0a30 0x7fb2cc11ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.708+0000 7fb2caffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2cc0a0a30 0x7fb2cc11ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39640/0 (socket says 172.21.15.146:39640) 2023-10-03T10:13:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.708+0000 7fb2caffd700 1 -- 172.21.15.146:0/2125035813 learned_addr learned my addr 172.21.15.146:0/2125035813 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.708+0000 7fb2ca7fc700 1 --2- 172.21.15.146:0/2125035813 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb2cc0a1340 0x7fb2cc11b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.708+0000 7fb2cb7fe700 1 --2- 172.21.15.146:0/2125035813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2cc1304a0 0x7fb2cc11b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.708+0000 7fb2ca7fc700 1 -- 172.21.15.146:0/2125035813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2cc0a0a30 msgr2=0x7fb2cc11ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.708+0000 7fb2ca7fc700 1 --2- 172.21.15.146:0/2125035813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2cc0a0a30 0x7fb2cc11ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.708+0000 7fb2ca7fc700 1 -- 172.21.15.146:0/2125035813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2cc1304a0 msgr2=0x7fb2cc11b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.708+0000 7fb2ca7fc700 1 --2- 172.21.15.146:0/2125035813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2cc1304a0 0x7fb2cc11b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.708+0000 7fb2ca7fc700 1 -- 172.21.15.146:0/2125035813 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c400d040 con 0x7fb2cc0a1340 2023-10-03T10:13:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.708+0000 7fb2caffd700 1 --2- 172.21.15.146:0/2125035813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2cc0a0a30 0x7fb2cc11ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.708+0000 7fb2cb7fe700 1 --2- 172.21.15.146:0/2125035813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2cc1304a0 0x7fb2cc11b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.708+0000 7fb2ca7fc700 1 --2- 172.21.15.146:0/2125035813 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb2cc0a1340 0x7fb2cc11b2d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000e600 tx=0x7fb2c000e910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.708+0000 7fb2b37fe700 1 -- 172.21.15.146:0/2125035813 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0004440 con 0x7fb2cc0a1340 2023-10-03T10:13:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.708+0000 7fb2d130b700 1 -- 172.21.15.146:0/2125035813 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2bc009430 con 0x7fb2cc0a1340 2023-10-03T10:13:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.708+0000 7fb2b37fe700 1 -- 172.21.15.146:0/2125035813 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c00045a0 con 0x7fb2cc0a1340 2023-10-03T10:13:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.708+0000 7fb2b37fe700 1 -- 172.21.15.146:0/2125035813 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c00138d0 con 0x7fb2cc0a1340 2023-10-03T10:13:21.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.708+0000 7fb2d130b700 1 -- 172.21.15.146:0/2125035813 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2cc11e310 con 0x7fb2cc0a1340 2023-10-03T10:13:21.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.710+0000 7fb2d130b700 1 -- 172.21.15.146:0/2125035813 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2cc11d1d0 con 0x7fb2cc0a1340 2023-10-03T10:13:21.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.710+0000 7fb2b37fe700 1 -- 172.21.15.146:0/2125035813 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2c0013a30 con 0x7fb2cc0a1340 2023-10-03T10:13:21.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.711+0000 7fb2b37fe700 1 -- 172.21.15.146:0/2125035813 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb2c0043390 con 0x7fb2cc0a1340 2023-10-03T10:13:21.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.718+0000 7fb2b37fe700 1 -- 172.21.15.146:0/2125035813 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2c000f040 con 0x7fb2cc0a1340 2023-10-03T10:13:21.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.789+0000 7f940d8ec700 1 Processor -- start 2023-10-03T10:13:21.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.789+0000 7f940d8ec700 1 -- start start 2023-10-03T10:13:21.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.789+0000 7f940d8ec700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f940809e340 0x7f94081359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.789+0000 7f940d8ec700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9408135f20 0x7f9408138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.789+0000 7f940d8ec700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f940809aaa0 con 0x7f940809d860 2023-10-03T10:13:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.789+0000 7f940d8ec700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940809e730 con 0x7f940809e340 2023-10-03T10:13:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.789+0000 7f940d8ec700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f940809f870 con 0x7f9408135f20 2023-10-03T10:13:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.790+0000 7f94067fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f940809e340 0x7f94081359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.790+0000 7f94067fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f940809e340 0x7f94081359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39644/0 (socket says 172.21.15.146:39644) 2023-10-03T10:13:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.790+0000 7f94067fc700 1 -- 172.21.15.146:0/1982987123 learned_addr learned my addr 172.21.15.146:0/1982987123 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.790+0000 7f9406ffd700 1 --1- 172.21.15.146:0/1982987123 >> v1:172.21.15.146:6789/0 conn(0x7f940809d860 0x7f940809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50312/0 (socket says 172.21.15.146:50312) 2023-10-03T10:13:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.790+0000 7f94077fe700 1 --2- 172.21.15.146:0/1982987123 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9408135f20 0x7f9408138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.790+0000 7f94067fc700 1 -- 172.21.15.146:0/1982987123 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9408135f20 msgr2=0x7f9408138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.790+0000 7f94067fc700 1 --2- 172.21.15.146:0/1982987123 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9408135f20 0x7f9408138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.790+0000 7f94067fc700 1 -- 172.21.15.146:0/1982987123 >> v1:172.21.15.146:6789/0 conn(0x7f940809d860 legacy=0x7f940809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.790+0000 7f94067fc700 1 -- 172.21.15.146:0/1982987123 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940809b360 con 0x7f940809e340 2023-10-03T10:13:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.790+0000 7f94077fe700 1 --2- 172.21.15.146:0/1982987123 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9408135f20 0x7f9408138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.790+0000 7f94067fc700 1 --2- 172.21.15.146:0/1982987123 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f940809e340 0x7f94081359e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00bbc0 tx=0x7f93fc00bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc2fb4c44f4ea31e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.790+0000 7f9405ffb700 1 -- 172.21.15.146:0/1982987123 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc00dd90 con 0x7f940809e340 2023-10-03T10:13:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.791+0000 7f9405ffb700 1 -- 172.21.15.146:0/1982987123 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93fc010470 con 0x7f940809e340 2023-10-03T10:13:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.791+0000 7f9405ffb700 1 -- 172.21.15.146:0/1982987123 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc010800 con 0x7f940809e340 2023-10-03T10:13:21.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.791+0000 7f940d8ec700 1 -- 172.21.15.146:0/1982987123 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f940809e340 msgr2=0x7f94081359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.791+0000 7f940d8ec700 1 --2- 172.21.15.146:0/1982987123 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f940809e340 0x7f94081359e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00bbc0 tx=0x7f93fc00bed0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.791+0000 7f940d8ec700 1 -- 172.21.15.146:0/1982987123 shutdown_connections 2023-10-03T10:13:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.791+0000 7f940d8ec700 1 --2- 172.21.15.146:0/1982987123 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9408135f20 0x7f9408138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.791+0000 7f940d8ec700 1 --2- 172.21.15.146:0/1982987123 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f940809e340 0x7f94081359e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.791+0000 7f940d8ec700 1 -- 172.21.15.146:0/1982987123 >> 172.21.15.146:0/1982987123 conn(0x7f9408099c40 msgr2=0x7f94080a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.791+0000 7f940d8ec700 1 -- 172.21.15.146:0/1982987123 shutdown_connections 2023-10-03T10:13:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.791+0000 7f940d8ec700 1 -- 172.21.15.146:0/1982987123 wait complete. 2023-10-03T10:13:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.793+0000 7f940d8ec700 1 Processor -- start 2023-10-03T10:13:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.793+0000 7f940d8ec700 1 -- start start 2023-10-03T10:13:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.794+0000 7f940d8ec700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f940809d860 0x7f9408121110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.794+0000 7f940d8ec700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f940809e340 0x7f9408121650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.794+0000 7f940d8ec700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9408135f20 0x7f94081c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.794+0000 7f940d8ec700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9408123e50 con 0x7f940809d860 2023-10-03T10:13:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.794+0000 7f940d8ec700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9408120d50 con 0x7f9408135f20 2023-10-03T10:13:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.794+0000 7f940d8ec700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94081333e0 con 0x7f940809e340 2023-10-03T10:13:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.794+0000 7f9406ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f940809d860 0x7f9408121110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.794+0000 7f94077fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9408135f20 0x7f94081c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.794+0000 7f9406ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f940809d860 0x7f9408121110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51150/0 (socket says 172.21.15.146:51150) 2023-10-03T10:13:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.794+0000 7f94077fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9408135f20 0x7f94081c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39658/0 (socket says 172.21.15.146:39658) 2023-10-03T10:13:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.794+0000 7f9406ffd700 1 -- 172.21.15.146:0/1393581926 learned_addr learned my addr 172.21.15.146:0/1393581926 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.794+0000 7f94067fc700 1 --2- 172.21.15.146:0/1393581926 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f940809e340 0x7f9408121650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.794+0000 7f94077fe700 1 -- 172.21.15.146:0/1393581926 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f940809e340 msgr2=0x7f9408121650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.794+0000 7f94077fe700 1 --2- 172.21.15.146:0/1393581926 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f940809e340 0x7f9408121650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.794+0000 7f94077fe700 1 -- 172.21.15.146:0/1393581926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f940809d860 msgr2=0x7f9408121110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.794+0000 7f94077fe700 1 --2- 172.21.15.146:0/1393581926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f940809d860 0x7f9408121110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.794+0000 7f94077fe700 1 -- 172.21.15.146:0/1393581926 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc00b7f0 con 0x7f9408135f20 2023-10-03T10:13:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.794+0000 7f94077fe700 1 --2- 172.21.15.146:0/1393581926 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9408135f20 0x7f94081c8140 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f940000ce20 tx=0x7f940000ce50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.795+0000 7f93effff700 1 -- 172.21.15.146:0/1393581926 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940000abe0 con 0x7f9408135f20 2023-10-03T10:13:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.795+0000 7f93effff700 1 -- 172.21.15.146:0/1393581926 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940000ad40 con 0x7f9408135f20 2023-10-03T10:13:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.795+0000 7f93effff700 1 -- 172.21.15.146:0/1393581926 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9400015680 con 0x7f9408135f20 2023-10-03T10:13:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.795+0000 7f940d8ec700 1 -- 172.21.15.146:0/1393581926 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9408122450 con 0x7f9408135f20 2023-10-03T10:13:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.795+0000 7f940d8ec700 1 -- 172.21.15.146:0/1393581926 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9408122a00 con 0x7f9408135f20 2023-10-03T10:13:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.796+0000 7f940d8ec700 1 -- 172.21.15.146:0/1393581926 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94080a2270 con 0x7f9408135f20 2023-10-03T10:13:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.796+0000 7f93effff700 1 -- 172.21.15.146:0/1393581926 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f940000d430 con 0x7f9408135f20 2023-10-03T10:13:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.796+0000 7f93effff700 1 -- 172.21.15.146:0/1393581926 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9400013500 con 0x7f9408135f20 2023-10-03T10:13:21.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.805+0000 7f93effff700 1 -- 172.21.15.146:0/1393581926 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9400045060 con 0x7f9408135f20 2023-10-03T10:13:21.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.829+0000 7f9c4fcea700 1 Processor -- start 2023-10-03T10:13:21.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.829+0000 7f9c4fcea700 1 -- start start 2023-10-03T10:13:21.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.830+0000 7f9c4fcea700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c4809e870 0x7f9c4809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.830+0000 7f9c4fcea700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9c4809f180 0x7f9c48131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.830+0000 7f9c4fcea700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c48131d70 0x7f9c48132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.830+0000 7f9c4fcea700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c480a0920 con 0x7f9c4809f180 2023-10-03T10:13:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.830+0000 7f9c4fcea700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4809c970 con 0x7f9c4809e870 2023-10-03T10:13:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.830+0000 7f9c4fcea700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4809bab0 con 0x7f9c48131d70 2023-10-03T10:13:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.830+0000 7f9c4da86700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c4809e870 0x7f9c4809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.830+0000 7f9c4da86700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c4809e870 0x7f9c4809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39666/0 (socket says 172.21.15.146:39666) 2023-10-03T10:13:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.830+0000 7f9c4da86700 1 -- 172.21.15.146:0/745217114 learned_addr learned my addr 172.21.15.146:0/745217114 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.830+0000 7f9c4e287700 1 --2- 172.21.15.146:0/745217114 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c48131d70 0x7f9c48132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.830+0000 7f9c4d285700 1 --2- 172.21.15.146:0/745217114 >> v2:172.21.15.146:3300/0 conn(0x7f9c4809f180 0x7f9c48131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.830+0000 7f9c4e287700 1 -- 172.21.15.146:0/745217114 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c4809e870 msgr2=0x7f9c4809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.831+0000 7f9c4e287700 1 --2- 172.21.15.146:0/745217114 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c4809e870 0x7f9c4809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.831+0000 7f9c4e287700 1 -- 172.21.15.146:0/745217114 >> v2:172.21.15.146:3300/0 conn(0x7f9c4809f180 msgr2=0x7f9c48131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.831+0000 7f9c4e287700 1 --2- 172.21.15.146:0/745217114 >> v2:172.21.15.146:3300/0 conn(0x7f9c4809f180 0x7f9c48131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.831+0000 7f9c4e287700 1 -- 172.21.15.146:0/745217114 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4809f9c0 con 0x7f9c48131d70 2023-10-03T10:13:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.831+0000 7f9c4da86700 1 --2- 172.21.15.146:0/745217114 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c4809e870 0x7f9c4809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.831+0000 7f9c4e287700 1 --2- 172.21.15.146:0/745217114 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c48131d70 0x7f9c48132210 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9c40009d90 tx=0x7f9c4000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65d8b400d4c1fa5b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.831+0000 7f9c4ca84700 1 -- 172.21.15.146:0/745217114 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4000bd20 con 0x7f9c48131d70 2023-10-03T10:13:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.831+0000 7f9c4ca84700 1 -- 172.21.15.146:0/745217114 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4000be80 con 0x7f9c48131d70 2023-10-03T10:13:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.831+0000 7f9c4ca84700 1 -- 172.21.15.146:0/745217114 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c40010710 con 0x7f9c48131d70 2023-10-03T10:13:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.831+0000 7f9c4fcea700 1 -- 172.21.15.146:0/745217114 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c48131d70 msgr2=0x7f9c48132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.831+0000 7f9c4fcea700 1 --2- 172.21.15.146:0/745217114 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c48131d70 0x7f9c48132210 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9c40009d90 tx=0x7f9c4000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.832+0000 7f9c4fcea700 1 -- 172.21.15.146:0/745217114 shutdown_connections 2023-10-03T10:13:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.832+0000 7f9c4fcea700 1 --2- 172.21.15.146:0/745217114 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c4809e870 0x7f9c4809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.832+0000 7f9c4fcea700 1 --2- 172.21.15.146:0/745217114 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c48131d70 0x7f9c48132210 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.832+0000 7f9c4fcea700 1 --2- 172.21.15.146:0/745217114 >> v2:172.21.15.146:3300/0 conn(0x7f9c4809f180 0x7f9c48131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.832+0000 7f9c4fcea700 1 -- 172.21.15.146:0/745217114 >> 172.21.15.146:0/745217114 conn(0x7f9c480a4430 msgr2=0x7f9c480a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.832+0000 7f9c4fcea700 1 -- 172.21.15.146:0/745217114 shutdown_connections 2023-10-03T10:13:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.832+0000 7f9c4fcea700 1 -- 172.21.15.146:0/745217114 wait complete. 2023-10-03T10:13:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.833+0000 7f9c4fcea700 1 Processor -- start 2023-10-03T10:13:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.833+0000 7f9c4fcea700 1 -- start start 2023-10-03T10:13:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.833+0000 7f9c4fcea700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c4809e870 0x7f9c4811b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.833+0000 7f9c4fcea700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c4809f180 0x7f9c4811b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.833+0000 7f9c4fcea700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c48131d70 0x7f9c4811ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.833+0000 7f9c4fcea700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4811cc20 con 0x7f9c4809f180 2023-10-03T10:13:21.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.833+0000 7f9c4fcea700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4811de70 con 0x7f9c48131d70 2023-10-03T10:13:21.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.833+0000 7f9c4fcea700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4811d200 con 0x7f9c4809e870 2023-10-03T10:13:21.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.833+0000 7f9c4d285700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c4809f180 0x7f9c4811b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.833+0000 7f9c4d285700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c4809f180 0x7f9c4811b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51176/0 (socket says 172.21.15.146:51176) 2023-10-03T10:13:21.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.833+0000 7f9c4d285700 1 -- 172.21.15.146:0/2041716432 learned_addr learned my addr 172.21.15.146:0/2041716432 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:21.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.833+0000 7f9c4da86700 1 --2- 172.21.15.146:0/2041716432 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c4809e870 0x7f9c4811b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.833+0000 7f9c4e287700 1 --2- 172.21.15.146:0/2041716432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c48131d70 0x7f9c4811ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.834+0000 7f9c4da86700 1 -- 172.21.15.146:0/2041716432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c48131d70 msgr2=0x7f9c4811ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.834+0000 7f9c4da86700 1 --2- 172.21.15.146:0/2041716432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c48131d70 0x7f9c4811ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.834+0000 7f9c4da86700 1 -- 172.21.15.146:0/2041716432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c4809f180 msgr2=0x7f9c4811b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.834+0000 7f9c4da86700 1 --2- 172.21.15.146:0/2041716432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c4809f180 0x7f9c4811b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.834+0000 7f9c4da86700 1 -- 172.21.15.146:0/2041716432 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c44009550 con 0x7f9c4809e870 2023-10-03T10:13:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.834+0000 7f9c4da86700 1 --2- 172.21.15.146:0/2041716432 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c4809e870 0x7f9c4811b010 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400e9b0 tx=0x7f9c4400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.834+0000 7f9c3e7fc700 1 -- 172.21.15.146:0/2041716432 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4400eeb0 con 0x7f9c4809e870 2023-10-03T10:13:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.834+0000 7f9c3e7fc700 1 -- 172.21.15.146:0/2041716432 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4400c850 con 0x7f9c4809e870 2023-10-03T10:13:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.834+0000 7f9c4fcea700 1 -- 172.21.15.146:0/2041716432 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c40009a70 con 0x7f9c4809e870 2023-10-03T10:13:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.834+0000 7f9c3e7fc700 1 -- 172.21.15.146:0/2041716432 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4400cbc0 con 0x7f9c4809e870 2023-10-03T10:13:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.834+0000 7f9c4fcea700 1 -- 172.21.15.146:0/2041716432 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c480a2a20 con 0x7f9c4809e870 2023-10-03T10:13:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.835+0000 7f9c4fcea700 1 -- 172.21.15.146:0/2041716432 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4804f2a0 con 0x7f9c4809e870 2023-10-03T10:13:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.835+0000 7f9c3e7fc700 1 -- 172.21.15.146:0/2041716432 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c4400cd20 con 0x7f9c4809e870 2023-10-03T10:13:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.835+0000 7f9c3e7fc700 1 -- 172.21.15.146:0/2041716432 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9c4403fa60 con 0x7f9c4809e870 2023-10-03T10:13:21.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.844+0000 7f9c3e7fc700 1 -- 172.21.15.146:0/2041716432 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c44011d90 con 0x7f9c4809e870 2023-10-03T10:13:21.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.859+0000 7ff4aeb1e700 1 -- 172.21.15.146:0/3788437393 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff4a804f2a0 con 0x7ff4a80a1380 2023-10-03T10:13:21.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.859+0000 7ff4a57fa700 1 -- 172.21.15.146:0/3788437393 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff494015020 con 0x7ff4a80a1380 2023-10-03T10:13:21.860 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:21.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.862+0000 7ff4aeb1e700 1 -- 172.21.15.146:0/3788437393 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4a80a1380 msgr2=0x7ff4a81228f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.862+0000 7ff4aeb1e700 1 --2- 172.21.15.146:0/3788437393 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4a80a1380 0x7ff4a81228f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff4940090b0 tx=0x7ff494004750 comp rx=0 tx=0).stop 2023-10-03T10:13:21.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.862+0000 7ff4aeb1e700 1 -- 172.21.15.146:0/3788437393 shutdown_connections 2023-10-03T10:13:21.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.862+0000 7ff4aeb1e700 1 --2- 172.21.15.146:0/3788437393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4a8133f50 0x7ff4a8122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.862+0000 7ff4aeb1e700 1 --2- 172.21.15.146:0/3788437393 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4a80a0a70 0x7ff4a81223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.862+0000 7ff4aeb1e700 1 --2- 172.21.15.146:0/3788437393 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4a80a1380 0x7ff4a81228f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.862+0000 7ff4aeb1e700 1 -- 172.21.15.146:0/3788437393 >> 172.21.15.146:0/3788437393 conn(0x7ff4a80a6610 msgr2=0x7ff4a811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.862+0000 7ff4aeb1e700 1 -- 172.21.15.146:0/3788437393 shutdown_connections 2023-10-03T10:13:21.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.862+0000 7ff4aeb1e700 1 -- 172.21.15.146:0/3788437393 wait complete. 2023-10-03T10:13:21.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.929+0000 7fb2d130b700 1 -- 172.21.15.146:0/2125035813 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb2cc04f2a0 con 0x7fb2cc0a1340 2023-10-03T10:13:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.929+0000 7fb2b37fe700 1 -- 172.21.15.146:0/2125035813 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb2c001ab40 con 0x7fb2cc0a1340 2023-10-03T10:13:21.930 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.931+0000 7fb2d130b700 1 -- 172.21.15.146:0/2125035813 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb2cc0a1340 msgr2=0x7fb2cc11b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.931+0000 7fb2d130b700 1 --2- 172.21.15.146:0/2125035813 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb2cc0a1340 0x7fb2cc11b2d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000e600 tx=0x7fb2c000e910 comp rx=0 tx=0).stop 2023-10-03T10:13:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.931+0000 7fb2d130b700 1 -- 172.21.15.146:0/2125035813 shutdown_connections 2023-10-03T10:13:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.931+0000 7fb2d130b700 1 --2- 172.21.15.146:0/2125035813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2cc1304a0 0x7fb2cc11b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.931+0000 7fb2d130b700 1 --2- 172.21.15.146:0/2125035813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2cc0a0a30 0x7fb2cc11ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.931+0000 7fb2d130b700 1 --2- 172.21.15.146:0/2125035813 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb2cc0a1340 0x7fb2cc11b2d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.931+0000 7fb2d130b700 1 -- 172.21.15.146:0/2125035813 >> 172.21.15.146:0/2125035813 conn(0x7fb2cc0a2980 msgr2=0x7fb2cc09deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.931+0000 7fb2d130b700 1 -- 172.21.15.146:0/2125035813 shutdown_connections 2023-10-03T10:13:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:21.931+0000 7fb2d130b700 1 -- 172.21.15.146:0/2125035813 wait complete. 2023-10-03T10:13:21.945 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:22.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:22.005+0000 7f940d8ec700 1 -- 172.21.15.146:0/1393581926 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f940804f2a0 con 0x7f9408135f20 2023-10-03T10:13:22.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:22.005+0000 7f93effff700 1 -- 172.21.15.146:0/1393581926 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f940001a020 con 0x7f9408135f20 2023-10-03T10:13:22.006 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:22.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:22.007+0000 7f940d8ec700 1 -- 172.21.15.146:0/1393581926 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9408135f20 msgr2=0x7f94081c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:22.007+0000 7f940d8ec700 1 --2- 172.21.15.146:0/1393581926 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9408135f20 0x7f94081c8140 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f940000ce20 tx=0x7f940000ce50 comp rx=0 tx=0).stop 2023-10-03T10:13:22.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:22.007+0000 7f940d8ec700 1 -- 172.21.15.146:0/1393581926 shutdown_connections 2023-10-03T10:13:22.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:22.007+0000 7f940d8ec700 1 --2- 172.21.15.146:0/1393581926 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9408135f20 0x7f94081c8140 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:22.007+0000 7f940d8ec700 1 --2- 172.21.15.146:0/1393581926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f940809d860 0x7f9408121110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:22.007+0000 7f940d8ec700 1 --2- 172.21.15.146:0/1393581926 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f940809e340 0x7f9408121650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:22.007+0000 7f940d8ec700 1 -- 172.21.15.146:0/1393581926 >> 172.21.15.146:0/1393581926 conn(0x7f9408099c40 msgr2=0x7f94080a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:22.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:22.007+0000 7f940d8ec700 1 -- 172.21.15.146:0/1393581926 shutdown_connections 2023-10-03T10:13:22.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:22.007+0000 7f940d8ec700 1 -- 172.21.15.146:0/1393581926 wait complete. 2023-10-03T10:13:22.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:22.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:22.040+0000 7f9c4fcea700 1 -- 172.21.15.146:0/2041716432 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9c4811e620 con 0x7f9c4809e870 2023-10-03T10:13:22.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:22.041+0000 7f9c3e7fc700 1 -- 172.21.15.146:0/2041716432 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c44017070 con 0x7f9c4809e870 2023-10-03T10:13:22.042 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:22.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:22.043+0000 7f9c4fcea700 1 -- 172.21.15.146:0/2041716432 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c4809e870 msgr2=0x7f9c4811b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:22.043+0000 7f9c4fcea700 1 --2- 172.21.15.146:0/2041716432 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c4809e870 0x7f9c4811b010 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400e9b0 tx=0x7f9c4400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:22.043+0000 7f9c4fcea700 1 -- 172.21.15.146:0/2041716432 shutdown_connections 2023-10-03T10:13:22.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:22.043+0000 7f9c4fcea700 1 --2- 172.21.15.146:0/2041716432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c48131d70 0x7f9c4811ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:22.043+0000 7f9c4fcea700 1 --2- 172.21.15.146:0/2041716432 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c4809e870 0x7f9c4811b010 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:22.043+0000 7f9c4fcea700 1 --2- 172.21.15.146:0/2041716432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c4809f180 0x7f9c4811b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:22.043+0000 7f9c4fcea700 1 -- 172.21.15.146:0/2041716432 >> 172.21.15.146:0/2041716432 conn(0x7f9c480a4430 msgr2=0x7f9c4812fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:22.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:22.043+0000 7f9c4fcea700 1 -- 172.21.15.146:0/2041716432 shutdown_connections 2023-10-03T10:13:22.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:22.043+0000 7f9c4fcea700 1 -- 172.21.15.146:0/2041716432 wait complete. 2023-10-03T10:13:22.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:22.878 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:22.946 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:23.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.012+0000 7fe0ad6e2700 1 Processor -- start 2023-10-03T10:13:23.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.012+0000 7fe0ad6e2700 1 -- start start 2023-10-03T10:13:23.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.012+0000 7fe0ad6e2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0a80a09e0 0x7fe0a80a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.012+0000 7fe0ad6e2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe0a80a12f0 0x7fe0a8133a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.012+0000 7fe0ad6e2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a809db90 con 0x7fe0a8133f40 2023-10-03T10:13:23.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.013+0000 7fe0ad6e2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a809de10 con 0x7fe0a80a12f0 2023-10-03T10:13:23.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.013+0000 7fe0ad6e2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a80a2560 con 0x7fe0a80a09e0 2023-10-03T10:13:23.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.013+0000 7fe0a67fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe0a80a12f0 0x7fe0a8133a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.013+0000 7fe0a6ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0a80a09e0 0x7fe0a80a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.013+0000 7fe0a67fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe0a80a12f0 0x7fe0a8133a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51188/0 (socket says 172.21.15.146:51188) 2023-10-03T10:13:23.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.013+0000 7fe0a6ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0a80a09e0 0x7fe0a80a0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36640/0 (socket says 172.21.15.146:36640) 2023-10-03T10:13:23.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.013+0000 7fe0a67fc700 1 -- 172.21.15.146:0/3181218113 learned_addr learned my addr 172.21.15.146:0/3181218113 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:23.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.013+0000 7fe0a67fc700 1 -- 172.21.15.146:0/3181218113 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0a80a09e0 msgr2=0x7fe0a80a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:23.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.013+0000 7fe0a67fc700 1 --2- 172.21.15.146:0/3181218113 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0a80a09e0 0x7fe0a80a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.013+0000 7fe0a67fc700 1 -- 172.21.15.146:0/3181218113 >> v1:172.21.15.146:6789/0 conn(0x7fe0a8133f40 legacy=0x7fe0a813acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.013+0000 7fe0a67fc700 1 -- 172.21.15.146:0/3181218113 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a80a1f60 con 0x7fe0a80a12f0 2023-10-03T10:13:23.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.013+0000 7fe0a5ffb700 1 -- 172.21.15.146:0/3181218113 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3131729420 0 0) 0x7fe0a809db90 con 0x7fe0a8133f40 2023-10-03T10:13:23.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.013+0000 7fe0a6ffd700 1 --2- 172.21.15.146:0/3181218113 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0a80a09e0 0x7fe0a80a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:23.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.013+0000 7fe0a67fc700 1 --2- 172.21.15.146:0/3181218113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0a80a12f0 0x7fe0a8133a00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0098f0 tx=0x7fe09c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d0e2b9de6876cf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.013+0000 7fe0a5ffb700 1 -- 172.21.15.146:0/3181218113 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c011830 con 0x7fe0a80a12f0 2023-10-03T10:13:23.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.013+0000 7fe0a5ffb700 1 -- 172.21.15.146:0/3181218113 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c011990 con 0x7fe0a80a12f0 2023-10-03T10:13:23.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.013+0000 7fe0a5ffb700 1 -- 172.21.15.146:0/3181218113 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c011d20 con 0x7fe0a80a12f0 2023-10-03T10:13:23.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.014+0000 7fe0ad6e2700 1 -- 172.21.15.146:0/3181218113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0a80a12f0 msgr2=0x7fe0a8133a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.014+0000 7fe0ad6e2700 1 --2- 172.21.15.146:0/3181218113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0a80a12f0 0x7fe0a8133a00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0098f0 tx=0x7fe09c009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:23.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.014+0000 7fe0ad6e2700 1 -- 172.21.15.146:0/3181218113 shutdown_connections 2023-10-03T10:13:23.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.014+0000 7fe0ad6e2700 1 --2- 172.21.15.146:0/3181218113 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0a80a09e0 0x7fe0a80a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.014+0000 7fe0ad6e2700 1 --2- 172.21.15.146:0/3181218113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0a80a12f0 0x7fe0a8133a00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.014+0000 7fe0ad6e2700 1 -- 172.21.15.146:0/3181218113 >> 172.21.15.146:0/3181218113 conn(0x7fe0a80a3000 msgr2=0x7fe0a80a3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.014+0000 7fe0ad6e2700 1 -- 172.21.15.146:0/3181218113 shutdown_connections 2023-10-03T10:13:23.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.014+0000 7fe0ad6e2700 1 -- 172.21.15.146:0/3181218113 wait complete. 2023-10-03T10:13:23.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.015+0000 7fe0ad6e2700 1 Processor -- start 2023-10-03T10:13:23.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.015+0000 7fe0ad6e2700 1 -- start start 2023-10-03T10:13:23.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe0ad6e2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0a80a09e0 0x7fe0a8122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe0ad6e2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0a80a12f0 0x7fe0a8122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe0ad6e2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0a8133f40 0x7fe0a8123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe0ad6e2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a8124520 con 0x7fe0a80a09e0 2023-10-03T10:13:23.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe0ad6e2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a80a4ab0 con 0x7fe0a80a12f0 2023-10-03T10:13:23.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe0ad6e2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a8125d10 con 0x7fe0a8133f40 2023-10-03T10:13:23.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe0a67fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0a80a12f0 0x7fe0a8122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe0a77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0a8133f40 0x7fe0a8123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe0a67fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0a80a12f0 0x7fe0a8122cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39682/0 (socket says 172.21.15.146:39682) 2023-10-03T10:13:23.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe0a77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0a8133f40 0x7fe0a8123210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36652/0 (socket says 172.21.15.146:36652) 2023-10-03T10:13:23.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe0a67fc700 1 -- 172.21.15.146:0/1958420894 learned_addr learned my addr 172.21.15.146:0/1958420894 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:23.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe0a6ffd700 1 --2- 172.21.15.146:0/1958420894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0a80a09e0 0x7fe0a8122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe0a77fe700 1 -- 172.21.15.146:0/1958420894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0a80a12f0 msgr2=0x7fe0a8122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe0a77fe700 1 --2- 172.21.15.146:0/1958420894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0a80a12f0 0x7fe0a8122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe0a77fe700 1 -- 172.21.15.146:0/1958420894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0a80a09e0 msgr2=0x7fe0a8122790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe0a77fe700 1 --2- 172.21.15.146:0/1958420894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0a80a09e0 0x7fe0a8122790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe0a77fe700 1 -- 172.21.15.146:0/1958420894 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0980094a0 con 0x7fe0a8133f40 2023-10-03T10:13:23.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe0a67fc700 1 --2- 172.21.15.146:0/1958420894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0a80a12f0 0x7fe0a8122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:23.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe0a77fe700 1 --2- 172.21.15.146:0/1958420894 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0a8133f40 0x7fe0a8123210 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000cbc0 tx=0x7fe0a000ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe08f7fe700 1 -- 172.21.15.146:0/1958420894 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0003e80 con 0x7fe0a8133f40 2023-10-03T10:13:23.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe08f7fe700 1 -- 172.21.15.146:0/1958420894 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a0005070 con 0x7fe0a8133f40 2023-10-03T10:13:23.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe0ad6e2700 1 -- 172.21.15.146:0/1958420894 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09c009550 con 0x7fe0a8133f40 2023-10-03T10:13:23.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe08f7fe700 1 -- 172.21.15.146:0/1958420894 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0005400 con 0x7fe0a8133f40 2023-10-03T10:13:23.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.016+0000 7fe0ad6e2700 1 -- 172.21.15.146:0/1958420894 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a8126a40 con 0x7fe0a8133f40 2023-10-03T10:13:23.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.017+0000 7fe0ad6e2700 1 -- 172.21.15.146:0/1958420894 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a8125ed0 con 0x7fe0a8133f40 2023-10-03T10:13:23.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.018+0000 7fe08f7fe700 1 -- 172.21.15.146:0/1958420894 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe0a0005560 con 0x7fe0a8133f40 2023-10-03T10:13:23.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.018+0000 7fe08f7fe700 1 -- 172.21.15.146:0/1958420894 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe0a0040070 con 0x7fe0a8133f40 2023-10-03T10:13:23.022 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:23.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.026+0000 7fe08f7fe700 1 -- 172.21.15.146:0/1958420894 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe0a000ad30 con 0x7fe0a8133f40 2023-10-03T10:13:23.056 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:23.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.086+0000 7f0f34c4c700 1 Processor -- start 2023-10-03T10:13:23.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.086+0000 7f0f34c4c700 1 -- start start 2023-10-03T10:13:23.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.087+0000 7f0f34c4c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0f3006a770 0x7f0f301349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.087+0000 7f0f34c4c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f30134f00 0x7f0f3009d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.087+0000 7f0f34c4c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f3009dea0 0x7f0f3009e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.087+0000 7f0f34c4c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3006b2e0 con 0x7f0f3006a770 2023-10-03T10:13:23.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.087+0000 7f0f34c4c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3009eca0 con 0x7f0f30134f00 2023-10-03T10:13:23.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.087+0000 7f0f34c4c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3009f720 con 0x7f0f3009dea0 2023-10-03T10:13:23.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.087+0000 7f0f2dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f30134f00 0x7f0f3009d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.087+0000 7f0f2dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f30134f00 0x7f0f3009d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39684/0 (socket says 172.21.15.146:39684) 2023-10-03T10:13:23.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.087+0000 7f0f2dd9b700 1 -- 172.21.15.146:0/777900363 learned_addr learned my addr 172.21.15.146:0/777900363 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:23.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.087+0000 7f0f2ed9d700 1 --2- 172.21.15.146:0/777900363 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f3009dea0 0x7f0f3009e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.087+0000 7f0f2e59c700 1 --2- 172.21.15.146:0/777900363 >> v2:172.21.15.146:3300/0 conn(0x7f0f3006a770 0x7f0f301349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.087+0000 7f0f2dd9b700 1 -- 172.21.15.146:0/777900363 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f3009dea0 msgr2=0x7f0f3009e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:23.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.087+0000 7f0f2dd9b700 1 --2- 172.21.15.146:0/777900363 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f3009dea0 0x7f0f3009e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.087+0000 7f0f2dd9b700 1 -- 172.21.15.146:0/777900363 >> v2:172.21.15.146:3300/0 conn(0x7f0f3006a770 msgr2=0x7f0f301349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:23.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.087+0000 7f0f2dd9b700 1 --2- 172.21.15.146:0/777900363 >> v2:172.21.15.146:3300/0 conn(0x7f0f3006a770 0x7f0f301349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.087+0000 7f0f2dd9b700 1 -- 172.21.15.146:0/777900363 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3006b480 con 0x7f0f30134f00 2023-10-03T10:13:23.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.087+0000 7f0f2e59c700 1 --2- 172.21.15.146:0/777900363 >> v2:172.21.15.146:3300/0 conn(0x7f0f3006a770 0x7f0f301349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:23.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.087+0000 7f0f2dd9b700 1 --2- 172.21.15.146:0/777900363 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f30134f00 0x7f0f3009d960 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0f240098f0 tx=0x7f0f24009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9c36c6112f6b8f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.088+0000 7f0f2d59a700 1 -- 172.21.15.146:0/777900363 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24011830 con 0x7f0f30134f00 2023-10-03T10:13:23.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.088+0000 7f0f2d59a700 1 -- 172.21.15.146:0/777900363 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f24011990 con 0x7f0f30134f00 2023-10-03T10:13:23.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.088+0000 7f0f2d59a700 1 -- 172.21.15.146:0/777900363 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24011d20 con 0x7f0f30134f00 2023-10-03T10:13:23.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.088+0000 7f0f34c4c700 1 -- 172.21.15.146:0/777900363 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f30134f00 msgr2=0x7f0f3009d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.088+0000 7f0f34c4c700 1 --2- 172.21.15.146:0/777900363 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f30134f00 0x7f0f3009d960 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0f240098f0 tx=0x7f0f24009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:23.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.088+0000 7f0f34c4c700 1 -- 172.21.15.146:0/777900363 shutdown_connections 2023-10-03T10:13:23.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.088+0000 7f0f34c4c700 1 --2- 172.21.15.146:0/777900363 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f3009dea0 0x7f0f3009e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.088+0000 7f0f34c4c700 1 --2- 172.21.15.146:0/777900363 >> v2:172.21.15.146:3300/0 conn(0x7f0f3006a770 0x7f0f301349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.088+0000 7f0f34c4c700 1 --2- 172.21.15.146:0/777900363 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f30134f00 0x7f0f3009d960 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.088+0000 7f0f34c4c700 1 -- 172.21.15.146:0/777900363 >> 172.21.15.146:0/777900363 conn(0x7f0f30099c40 msgr2=0x7f0f300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.088+0000 7f0f34c4c700 1 -- 172.21.15.146:0/777900363 shutdown_connections 2023-10-03T10:13:23.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.089+0000 7f0f34c4c700 1 -- 172.21.15.146:0/777900363 wait complete. 2023-10-03T10:13:23.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.090+0000 7f0f34c4c700 1 Processor -- start 2023-10-03T10:13:23.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.090+0000 7f0f34c4c700 1 -- start start 2023-10-03T10:13:23.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.090+0000 7f0f34c4c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f3006a770 0x7f0f30132d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.090+0000 7f0f34c4c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f3009dea0 0x7f0f30133240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.090+0000 7f0f34c4c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f30134f00 0x7f0f30133780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.090+0000 7f0f34c4c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f300a03f0 con 0x7f0f30134f00 2023-10-03T10:13:23.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.090+0000 7f0f34c4c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f30071e00 con 0x7f0f3006a770 2023-10-03T10:13:23.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.090+0000 7f0f34c4c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f30071930 con 0x7f0f3009dea0 2023-10-03T10:13:23.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.090+0000 7f0f2dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f3009dea0 0x7f0f30133240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.090+0000 7f0f2ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f30134f00 0x7f0f30133780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.090+0000 7f0f2dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f3009dea0 0x7f0f30133240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36678/0 (socket says 172.21.15.146:36678) 2023-10-03T10:13:23.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.090+0000 7f0f2dd9b700 1 -- 172.21.15.146:0/1807695471 learned_addr learned my addr 172.21.15.146:0/1807695471 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:23.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.090+0000 7f0f2e59c700 1 --2- 172.21.15.146:0/1807695471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f3006a770 0x7f0f30132d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.091+0000 7f0f2ed9d700 1 -- 172.21.15.146:0/1807695471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f3009dea0 msgr2=0x7f0f30133240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.091+0000 7f0f2ed9d700 1 --2- 172.21.15.146:0/1807695471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f3009dea0 0x7f0f30133240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.091+0000 7f0f2ed9d700 1 -- 172.21.15.146:0/1807695471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f3006a770 msgr2=0x7f0f30132d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.091+0000 7f0f2ed9d700 1 --2- 172.21.15.146:0/1807695471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f3006a770 0x7f0f30132d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.091+0000 7f0f2ed9d700 1 -- 172.21.15.146:0/1807695471 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f24009550 con 0x7f0f30134f00 2023-10-03T10:13:23.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.091+0000 7f0f2ed9d700 1 --2- 172.21.15.146:0/1807695471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f30134f00 0x7f0f30133780 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0f28009d90 tx=0x7f0f2800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.091+0000 7f0f1effd700 1 -- 172.21.15.146:0/1807695471 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2800cc90 con 0x7f0f30134f00 2023-10-03T10:13:23.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.091+0000 7f0f1effd700 1 -- 172.21.15.146:0/1807695471 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2800f040 con 0x7f0f30134f00 2023-10-03T10:13:23.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.091+0000 7f0f1effd700 1 -- 172.21.15.146:0/1807695471 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f28014480 con 0x7f0f30134f00 2023-10-03T10:13:23.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.091+0000 7f0f34c4c700 1 -- 172.21.15.146:0/1807695471 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f301395c0 con 0x7f0f30134f00 2023-10-03T10:13:23.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.091+0000 7f0f34c4c700 1 -- 172.21.15.146:0/1807695471 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f30072010 con 0x7f0f30134f00 2023-10-03T10:13:23.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.092+0000 7f0f34c4c700 1 -- 172.21.15.146:0/1807695471 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3004f2a0 con 0x7f0f30134f00 2023-10-03T10:13:23.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.093+0000 7f0f1effd700 1 -- 172.21.15.146:0/1807695471 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f280145e0 con 0x7f0f30134f00 2023-10-03T10:13:23.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.093+0000 7f0f1effd700 1 -- 172.21.15.146:0/1807695471 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0f28040610 con 0x7f0f30134f00 2023-10-03T10:13:23.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.101+0000 7f0f1effd700 1 -- 172.21.15.146:0/1807695471 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f28012930 con 0x7f0f30134f00 2023-10-03T10:13:23.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.162+0000 7f60ff6ab700 1 Processor -- start 2023-10-03T10:13:23.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.162+0000 7f60ff6ab700 1 -- start start 2023-10-03T10:13:23.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.162+0000 7f60ff6ab700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60f8099a60 0x7f60f81388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.162+0000 7f60ff6ab700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60f8138e30 0x7f60f813b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.162+0000 7f60ff6ab700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f809aa00 con 0x7f60f8133b80 2023-10-03T10:13:23.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.162+0000 7f60ff6ab700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f809a080 con 0x7f60f8138e30 2023-10-03T10:13:23.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.162+0000 7f60ff6ab700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60f8133750 con 0x7f60f8099a60 2023-10-03T10:13:23.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.163+0000 7f60fcc46700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60f8099a60 0x7f60f81388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.163+0000 7f60fcc46700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60f8099a60 0x7f60f81388f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36686/0 (socket says 172.21.15.146:36686) 2023-10-03T10:13:23.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.163+0000 7f60fcc46700 1 -- 172.21.15.146:0/2849709727 learned_addr learned my addr 172.21.15.146:0/2849709727 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:23.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.163+0000 7f60fdc48700 1 --2- 172.21.15.146:0/2849709727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60f8138e30 0x7f60f813b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.163+0000 7f60effff700 1 -- 172.21.15.146:0/2849709727 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653267679 0 0) 0x7f60f809aa00 con 0x7f60f8133b80 2023-10-03T10:13:23.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.163+0000 7f60effff700 1 -- 172.21.15.146:0/2849709727 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60e40035b0 con 0x7f60f8133b80 2023-10-03T10:13:23.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.163+0000 7f60fdc48700 1 -- 172.21.15.146:0/2849709727 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60f8099a60 msgr2=0x7f60f81388f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:23.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.163+0000 7f60fdc48700 1 --2- 172.21.15.146:0/2849709727 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60f8099a60 0x7f60f81388f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.163+0000 7f60fdc48700 1 -- 172.21.15.146:0/2849709727 >> v1:172.21.15.146:6789/0 conn(0x7f60f8133b80 legacy=0x7f60f8133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.163+0000 7f60fdc48700 1 -- 172.21.15.146:0/2849709727 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f809a760 con 0x7f60f8138e30 2023-10-03T10:13:23.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.163+0000 7f60fcc46700 1 --2- 172.21.15.146:0/2849709727 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60f8099a60 0x7f60f81388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:23.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.163+0000 7f60fdc48700 1 --2- 172.21.15.146:0/2849709727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60f8138e30 0x7f60f813b210 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009dc0 tx=0x7f60f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=197997e715e1798e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.163+0000 7f60effff700 1 -- 172.21.15.146:0/2849709727 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f000e070 con 0x7f60f8138e30 2023-10-03T10:13:23.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.163+0000 7f60effff700 1 -- 172.21.15.146:0/2849709727 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f000bb20 con 0x7f60f8138e30 2023-10-03T10:13:23.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.163+0000 7f60effff700 1 -- 172.21.15.146:0/2849709727 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0012430 con 0x7f60f8138e30 2023-10-03T10:13:23.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.164+0000 7f60ff6ab700 1 -- 172.21.15.146:0/2849709727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60f8138e30 msgr2=0x7f60f813b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.164+0000 7f60ff6ab700 1 --2- 172.21.15.146:0/2849709727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60f8138e30 0x7f60f813b210 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009dc0 tx=0x7f60f000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:23.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.164+0000 7f60ff6ab700 1 -- 172.21.15.146:0/2849709727 shutdown_connections 2023-10-03T10:13:23.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.165+0000 7f60ff6ab700 1 --2- 172.21.15.146:0/2849709727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60f8138e30 0x7f60f813b210 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.165+0000 7f60ff6ab700 1 --2- 172.21.15.146:0/2849709727 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60f8099a60 0x7f60f81388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.165+0000 7f60ff6ab700 1 -- 172.21.15.146:0/2849709727 >> 172.21.15.146:0/2849709727 conn(0x7f60f80a2980 msgr2=0x7f60f80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.165+0000 7f60ff6ab700 1 -- 172.21.15.146:0/2849709727 shutdown_connections 2023-10-03T10:13:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.165+0000 7f60ff6ab700 1 -- 172.21.15.146:0/2849709727 wait complete. 2023-10-03T10:13:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.166+0000 7f60ff6ab700 1 Processor -- start 2023-10-03T10:13:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.166+0000 7f60ff6ab700 1 -- start start 2023-10-03T10:13:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.166+0000 7f60ff6ab700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60f8099a60 0x7f60f8136c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.166+0000 7f60ff6ab700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60f8133b80 0x7f60f8137180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.166+0000 7f60ff6ab700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60f8138e30 0x7f60f81376c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.166+0000 7f60ff6ab700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f809a330 con 0x7f60f8099a60 2023-10-03T10:13:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.166+0000 7f60ff6ab700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f8135d80 con 0x7f60f8138e30 2023-10-03T10:13:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.166+0000 7f60ff6ab700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60f80713c0 con 0x7f60f8133b80 2023-10-03T10:13:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.167+0000 7f60fd447700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60f8099a60 0x7f60f8136c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.167+0000 7f60fd447700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60f8099a60 0x7f60f8136c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51216/0 (socket says 172.21.15.146:51216) 2023-10-03T10:13:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.167+0000 7f60fd447700 1 -- 172.21.15.146:0/2406248210 learned_addr learned my addr 172.21.15.146:0/2406248210 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.167+0000 7f60fdc48700 1 --2- 172.21.15.146:0/2406248210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60f8138e30 0x7f60f81376c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.167+0000 7f60fcc46700 1 --2- 172.21.15.146:0/2406248210 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60f8133b80 0x7f60f8137180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.167+0000 7f60fd447700 1 -- 172.21.15.146:0/2406248210 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60f8133b80 msgr2=0x7f60f8137180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.167+0000 7f60fd447700 1 --2- 172.21.15.146:0/2406248210 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60f8133b80 0x7f60f8137180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.167+0000 7f60fd447700 1 -- 172.21.15.146:0/2406248210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60f8138e30 msgr2=0x7f60f81376c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.167+0000 7f60fd447700 1 --2- 172.21.15.146:0/2406248210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60f8138e30 0x7f60f81376c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.167+0000 7f60fd447700 1 -- 172.21.15.146:0/2406248210 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e8009550 con 0x7f60f8099a60 2023-10-03T10:13:23.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.167+0000 7f60fd447700 1 --2- 172.21.15.146:0/2406248210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60f8099a60 0x7f60f8136c40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f60f400c730 tx=0x7f60f400ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.167+0000 7f60edffb700 1 -- 172.21.15.146:0/2406248210 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f40054e0 con 0x7f60f8099a60 2023-10-03T10:13:23.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.167+0000 7f60edffb700 1 -- 172.21.15.146:0/2406248210 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f4003680 con 0x7f60f8099a60 2023-10-03T10:13:23.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.167+0000 7f60edffb700 1 -- 172.21.15.146:0/2406248210 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f40039f0 con 0x7f60f8099a60 2023-10-03T10:13:23.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.167+0000 7f60ff6ab700 1 -- 172.21.15.146:0/2406248210 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f0009a70 con 0x7f60f8099a60 2023-10-03T10:13:23.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.168+0000 7f60ff6ab700 1 -- 172.21.15.146:0/2406248210 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f8137cf0 con 0x7f60f8099a60 2023-10-03T10:13:23.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.169+0000 7f60ff6ab700 1 -- 172.21.15.146:0/2406248210 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f81383e0 con 0x7f60f8099a60 2023-10-03T10:13:23.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.170+0000 7f60edffb700 1 -- 172.21.15.146:0/2406248210 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f60f4003b50 con 0x7f60f8099a60 2023-10-03T10:13:23.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.170+0000 7f60edffb700 1 -- 172.21.15.146:0/2406248210 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f60f403f470 con 0x7f60f8099a60 2023-10-03T10:13:23.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.178+0000 7f60edffb700 1 -- 172.21.15.146:0/2406248210 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f60f4012400 con 0x7f60f8099a60 2023-10-03T10:13:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.185+0000 7f0ffa284700 1 Processor -- start 2023-10-03T10:13:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.186+0000 7f0ffa284700 1 -- start start 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.186+0000 7f0ffa284700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ff40a1550 0x7f0ff4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.186+0000 7f0ffa284700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ff4139200 0x7f0ff413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.186+0000 7f0ffa284700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff409e9d0 con 0x7f0ff40a0a70 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.186+0000 7f0ffa284700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff409dc00 con 0x7f0ff4139200 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.186+0000 7f0ffa284700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff409dec0 con 0x7f0ff40a1550 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.186+0000 7f0ff3fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0ff40a0a70 0x7f0ff40a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50332/0 (socket says 172.21.15.146:50332) 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.186+0000 7f0ff3fff700 1 -- 172.21.15.146:0/3083624359 learned_addr learned my addr 172.21.15.146:0/3083624359 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.187+0000 7f0ff37fe700 1 --2- 172.21.15.146:0/3083624359 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ff40a1550 0x7f0ff4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.187+0000 7f0ff8821700 1 --2- 172.21.15.146:0/3083624359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ff4139200 0x7f0ff413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.187+0000 7f0ff2ffd700 1 -- 172.21.15.146:0/3083624359 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055248920 0 0) 0x7f0ff409e9d0 con 0x7f0ff40a0a70 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.187+0000 7f0ff2ffd700 1 -- 172.21.15.146:0/3083624359 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fdc0035b0 con 0x7f0ff40a0a70 2023-10-03T10:13:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.187+0000 7f0ff8821700 1 -- 172.21.15.146:0/3083624359 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ff40a1550 msgr2=0x7f0ff4138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.187+0000 7f0ff8821700 1 --2- 172.21.15.146:0/3083624359 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ff40a1550 0x7f0ff4138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.187+0000 7f0ff8821700 1 -- 172.21.15.146:0/3083624359 >> v1:172.21.15.146:6789/0 conn(0x7f0ff40a0a70 legacy=0x7f0ff40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.187+0000 7f0ff8821700 1 -- 172.21.15.146:0/3083624359 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff409e6a0 con 0x7f0ff4139200 2023-10-03T10:13:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.187+0000 7f0ff8821700 1 --2- 172.21.15.146:0/3083624359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ff4139200 0x7f0ff413b5e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0fec009dc0 tx=0x7f0fec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77791bc5023998bd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.187+0000 7f0ff2ffd700 1 -- 172.21.15.146:0/3083624359 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec00e070 con 0x7f0ff4139200 2023-10-03T10:13:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.187+0000 7f0ff2ffd700 1 -- 172.21.15.146:0/3083624359 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec00bb20 con 0x7f0ff4139200 2023-10-03T10:13:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.187+0000 7f0ff2ffd700 1 -- 172.21.15.146:0/3083624359 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec00be90 con 0x7f0ff4139200 2023-10-03T10:13:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.188+0000 7f0ffa284700 1 -- 172.21.15.146:0/3083624359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ff4139200 msgr2=0x7f0ff413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.188+0000 7f0ffa284700 1 --2- 172.21.15.146:0/3083624359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ff4139200 0x7f0ff413b5e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0fec009dc0 tx=0x7f0fec00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.188+0000 7f0ffa284700 1 -- 172.21.15.146:0/3083624359 shutdown_connections 2023-10-03T10:13:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.188+0000 7f0ffa284700 1 --2- 172.21.15.146:0/3083624359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ff4139200 0x7f0ff413b5e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.188+0000 7f0ffa284700 1 --2- 172.21.15.146:0/3083624359 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ff40a1550 0x7f0ff4138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.188+0000 7f0ffa284700 1 -- 172.21.15.146:0/3083624359 >> 172.21.15.146:0/3083624359 conn(0x7f0ff40a6610 msgr2=0x7f0ff40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.188+0000 7f0ffa284700 1 -- 172.21.15.146:0/3083624359 shutdown_connections 2023-10-03T10:13:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.188+0000 7f0ffa284700 1 -- 172.21.15.146:0/3083624359 wait complete. 2023-10-03T10:13:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.189+0000 7f0ffa284700 1 Processor -- start 2023-10-03T10:13:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.190+0000 7f0ffa284700 1 -- start start 2023-10-03T10:13:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.190+0000 7f0ffa284700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ff40a0a70 0x7f0ff412f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.190+0000 7f0ffa284700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ff40a1550 0x7f0ff412fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.190+0000 7f0ffa284700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ff4139200 0x7f0ff4130190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.190+0000 7f0ffa284700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff4133180 con 0x7f0ff40a0a70 2023-10-03T10:13:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.190+0000 7f0ffa284700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff4131170 con 0x7f0ff40a1550 2023-10-03T10:13:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.190+0000 7f0ffa284700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff4131a50 con 0x7f0ff4139200 2023-10-03T10:13:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.190+0000 7f0ff3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ff40a0a70 0x7f0ff412f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.190+0000 7f0ff37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ff40a1550 0x7f0ff412fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.190+0000 7f0ff3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ff40a0a70 0x7f0ff412f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51218/0 (socket says 172.21.15.146:51218) 2023-10-03T10:13:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.190+0000 7f0ff37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ff40a1550 0x7f0ff412fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:39742/0 (socket says 172.21.15.146:39742) 2023-10-03T10:13:23.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.190+0000 7f0ff3fff700 1 -- 172.21.15.146:0/4071127905 learned_addr learned my addr 172.21.15.146:0/4071127905 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:23.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.191+0000 7f0ff8821700 1 --2- 172.21.15.146:0/4071127905 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ff4139200 0x7f0ff4130190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.191+0000 7f0ff3fff700 1 -- 172.21.15.146:0/4071127905 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ff4139200 msgr2=0x7f0ff4130190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.191+0000 7f0ff3fff700 1 --2- 172.21.15.146:0/4071127905 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ff4139200 0x7f0ff4130190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.191+0000 7f0ff3fff700 1 -- 172.21.15.146:0/4071127905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ff40a1550 msgr2=0x7f0ff412fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.191+0000 7f0ff3fff700 1 --2- 172.21.15.146:0/4071127905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ff40a1550 0x7f0ff412fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.191+0000 7f0ff3fff700 1 -- 172.21.15.146:0/4071127905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fec009a70 con 0x7f0ff40a0a70 2023-10-03T10:13:23.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.191+0000 7f0ff3fff700 1 --2- 172.21.15.146:0/4071127905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ff40a0a70 0x7f0ff412f710 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400c730 tx=0x7f0fe400ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.191+0000 7f0ff0ff9700 1 -- 172.21.15.146:0/4071127905 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4005d70 con 0x7f0ff40a0a70 2023-10-03T10:13:23.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.191+0000 7f0ff0ff9700 1 -- 172.21.15.146:0/4071127905 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe40070d0 con 0x7f0ff40a0a70 2023-10-03T10:13:23.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.191+0000 7f0ff0ff9700 1 -- 172.21.15.146:0/4071127905 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4007440 con 0x7f0ff40a0a70 2023-10-03T10:13:23.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.191+0000 7f0ffa284700 1 -- 172.21.15.146:0/4071127905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff4132b50 con 0x7f0ff40a0a70 2023-10-03T10:13:23.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.191+0000 7f0ffa284700 1 -- 172.21.15.146:0/4071127905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff40a03e0 con 0x7f0ff40a0a70 2023-10-03T10:13:23.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.192+0000 7f0ff0ff9700 1 -- 172.21.15.146:0/4071127905 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0fe40075a0 con 0x7f0ff40a0a70 2023-10-03T10:13:23.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.192+0000 7f0ffa284700 1 -- 172.21.15.146:0/4071127905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff404f2a0 con 0x7f0ff40a0a70 2023-10-03T10:13:23.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.192+0000 7f0ff0ff9700 1 -- 172.21.15.146:0/4071127905 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0fe403ebb0 con 0x7f0ff40a0a70 2023-10-03T10:13:23.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.197+0000 7f0ff0ff9700 1 -- 172.21.15.146:0/4071127905 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0fe4011d70 con 0x7f0ff40a0a70 2023-10-03T10:13:23.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.272+0000 7fe0ad6e2700 1 -- 172.21.15.146:0/1958420894 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe0a804f2a0 con 0x7fe0a8133f40 2023-10-03T10:13:23.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.273+0000 7fe08f7fe700 1 -- 172.21.15.146:0/1958420894 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe0a0012400 con 0x7fe0a8133f40 2023-10-03T10:13:23.274 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:23.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.275+0000 7fe0ad6e2700 1 -- 172.21.15.146:0/1958420894 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0a8133f40 msgr2=0x7fe0a8123210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.275+0000 7fe0ad6e2700 1 --2- 172.21.15.146:0/1958420894 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0a8133f40 0x7fe0a8123210 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000cbc0 tx=0x7fe0a000ced0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.275+0000 7fe0ad6e2700 1 -- 172.21.15.146:0/1958420894 shutdown_connections 2023-10-03T10:13:23.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.275+0000 7fe0ad6e2700 1 --2- 172.21.15.146:0/1958420894 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe0a8133f40 0x7fe0a8123210 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.275+0000 7fe0ad6e2700 1 --2- 172.21.15.146:0/1958420894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0a80a09e0 0x7fe0a8122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.275+0000 7fe0ad6e2700 1 --2- 172.21.15.146:0/1958420894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0a80a12f0 0x7fe0a8122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.275+0000 7fe0ad6e2700 1 -- 172.21.15.146:0/1958420894 >> 172.21.15.146:0/1958420894 conn(0x7fe0a80a3000 msgr2=0x7fe0a809ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.276+0000 7fe0ad6e2700 1 -- 172.21.15.146:0/1958420894 shutdown_connections 2023-10-03T10:13:23.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.276+0000 7fe0ad6e2700 1 -- 172.21.15.146:0/1958420894 wait complete. 2023-10-03T10:13:23.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:23.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.304+0000 7f0f34c4c700 1 -- 172.21.15.146:0/1807695471 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0f300a3210 con 0x7f0f30134f00 2023-10-03T10:13:23.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.304+0000 7f0f1effd700 1 -- 172.21.15.146:0/1807695471 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0f2802a090 con 0x7f0f30134f00 2023-10-03T10:13:23.305 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:23.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.306+0000 7f0f34c4c700 1 -- 172.21.15.146:0/1807695471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f30134f00 msgr2=0x7f0f30133780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.306+0000 7f0f34c4c700 1 --2- 172.21.15.146:0/1807695471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f30134f00 0x7f0f30133780 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0f28009d90 tx=0x7f0f2800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.306+0000 7f0f34c4c700 1 -- 172.21.15.146:0/1807695471 shutdown_connections 2023-10-03T10:13:23.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.306+0000 7f0f34c4c700 1 --2- 172.21.15.146:0/1807695471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f30134f00 0x7f0f30133780 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.306+0000 7f0f34c4c700 1 --2- 172.21.15.146:0/1807695471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f3006a770 0x7f0f30132d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.306+0000 7f0f34c4c700 1 --2- 172.21.15.146:0/1807695471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f3009dea0 0x7f0f30133240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.306+0000 7f0f34c4c700 1 -- 172.21.15.146:0/1807695471 >> 172.21.15.146:0/1807695471 conn(0x7f0f30099c40 msgr2=0x7f0f3009c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.306+0000 7f0f34c4c700 1 -- 172.21.15.146:0/1807695471 shutdown_connections 2023-10-03T10:13:23.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.306+0000 7f0f34c4c700 1 -- 172.21.15.146:0/1807695471 wait complete. 2023-10-03T10:13:23.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:23.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.393+0000 7f0ffa284700 1 -- 172.21.15.146:0/4071127905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0ff409c2f0 con 0x7f0ff40a0a70 2023-10-03T10:13:23.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.393+0000 7f0ff0ff9700 1 -- 172.21.15.146:0/4071127905 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0fe401ae80 con 0x7f0ff40a0a70 2023-10-03T10:13:23.394 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:23.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.395+0000 7f0ffa284700 1 -- 172.21.15.146:0/4071127905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ff40a0a70 msgr2=0x7f0ff412f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.395+0000 7f0ffa284700 1 --2- 172.21.15.146:0/4071127905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ff40a0a70 0x7f0ff412f710 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400c730 tx=0x7f0fe400ca40 comp rx=0 tx=0).stop 2023-10-03T10:13:23.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.395+0000 7f0ffa284700 1 -- 172.21.15.146:0/4071127905 shutdown_connections 2023-10-03T10:13:23.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.395+0000 7f0ffa284700 1 --2- 172.21.15.146:0/4071127905 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ff4139200 0x7f0ff4130190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.395+0000 7f0ffa284700 1 --2- 172.21.15.146:0/4071127905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ff40a0a70 0x7f0ff412f710 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.395+0000 7f0ffa284700 1 --2- 172.21.15.146:0/4071127905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ff40a1550 0x7f0ff412fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.395+0000 7f0ffa284700 1 -- 172.21.15.146:0/4071127905 >> 172.21.15.146:0/4071127905 conn(0x7f0ff40a6610 msgr2=0x7f0ff406da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.396+0000 7f0ffa284700 1 -- 172.21.15.146:0/4071127905 shutdown_connections 2023-10-03T10:13:23.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.396+0000 7f0ffa284700 1 -- 172.21.15.146:0/4071127905 wait complete. 2023-10-03T10:13:23.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:23.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.418+0000 7f60ff6ab700 1 -- 172.21.15.146:0/2406248210 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f60f8135b80 con 0x7f60f8099a60 2023-10-03T10:13:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.418+0000 7f60edffb700 1 -- 172.21.15.146:0/2406248210 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f60f4017030 con 0x7f60f8099a60 2023-10-03T10:13:23.419 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:23.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.420+0000 7f60ff6ab700 1 -- 172.21.15.146:0/2406248210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60f8099a60 msgr2=0x7f60f8136c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.420+0000 7f60ff6ab700 1 --2- 172.21.15.146:0/2406248210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60f8099a60 0x7f60f8136c40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f60f400c730 tx=0x7f60f400ca40 comp rx=0 tx=0).stop 2023-10-03T10:13:23.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.420+0000 7f60ff6ab700 1 -- 172.21.15.146:0/2406248210 shutdown_connections 2023-10-03T10:13:23.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.420+0000 7f60ff6ab700 1 --2- 172.21.15.146:0/2406248210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60f8138e30 0x7f60f81376c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.420+0000 7f60ff6ab700 1 --2- 172.21.15.146:0/2406248210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60f8099a60 0x7f60f8136c40 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.420+0000 7f60ff6ab700 1 --2- 172.21.15.146:0/2406248210 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60f8133b80 0x7f60f8137180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.420+0000 7f60ff6ab700 1 -- 172.21.15.146:0/2406248210 >> 172.21.15.146:0/2406248210 conn(0x7f60f80a2980 msgr2=0x7f60f812f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.420+0000 7f60ff6ab700 1 -- 172.21.15.146:0/2406248210 shutdown_connections 2023-10-03T10:13:23.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:23.420+0000 7f60ff6ab700 1 -- 172.21.15.146:0/2406248210 wait complete. 2023-10-03T10:13:23.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:24.294 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:24.320 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:24.409 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.427+0000 7f22987a6700 1 Processor -- start 2023-10-03T10:13:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.427+0000 7f22987a6700 1 -- start start 2023-10-03T10:13:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.428+0000 7f22987a6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2290133900 0x7f2290133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.428+0000 7f22987a6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2290134210 0x7f22900a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.428+0000 7f22987a6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f229009a760 con 0x7f22900a0ee0 2023-10-03T10:13:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.428+0000 7f22987a6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22901336e0 con 0x7f2290134210 2023-10-03T10:13:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.428+0000 7f22987a6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f229009a080 con 0x7f2290133900 2023-10-03T10:13:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.428+0000 7f2296d43700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f22900a0ee0 0x7f229013a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47918/0 (socket says 172.21.15.146:47918) 2023-10-03T10:13:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.428+0000 7f2296d43700 1 -- 172.21.15.146:0/1530671625 learned_addr learned my addr 172.21.15.146:0/1530671625 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.428+0000 7f2295d41700 1 --2- 172.21.15.146:0/1530671625 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2290134210 0x7f22900a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.428+0000 7f2296542700 1 --2- 172.21.15.146:0/1530671625 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2290133900 0x7f2290133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.429+0000 7f2295540700 1 -- 172.21.15.146:0/1530671625 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146749518 0 0) 0x7f229009a760 con 0x7f22900a0ee0 2023-10-03T10:13:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.429+0000 7f2295540700 1 -- 172.21.15.146:0/1530671625 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f227c0035b0 con 0x7f22900a0ee0 2023-10-03T10:13:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.429+0000 7f2295d41700 1 -- 172.21.15.146:0/1530671625 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2290133900 msgr2=0x7f2290133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.429+0000 7f2295d41700 1 --2- 172.21.15.146:0/1530671625 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2290133900 0x7f2290133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.429+0000 7f2295d41700 1 -- 172.21.15.146:0/1530671625 >> v1:172.21.15.146:6789/0 conn(0x7f22900a0ee0 legacy=0x7f229013a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.429+0000 7f2295d41700 1 -- 172.21.15.146:0/1530671625 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22900a23e0 con 0x7f2290134210 2023-10-03T10:13:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.429+0000 7f2296542700 1 --2- 172.21.15.146:0/1530671625 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2290133900 0x7f2290133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.429+0000 7f2295d41700 1 --2- 172.21.15.146:0/1530671625 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2290134210 0x7f22900a09a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2280009870 tx=0x7f2280009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b93a9bb088a1efe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.429+0000 7f2295540700 1 -- 172.21.15.146:0/1530671625 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2280011830 con 0x7f2290134210 2023-10-03T10:13:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.429+0000 7f2295540700 1 -- 172.21.15.146:0/1530671625 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2280011990 con 0x7f2290134210 2023-10-03T10:13:24.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.429+0000 7f2295540700 1 -- 172.21.15.146:0/1530671625 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2280011d20 con 0x7f2290134210 2023-10-03T10:13:24.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.430+0000 7f22987a6700 1 -- 172.21.15.146:0/1530671625 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2290134210 msgr2=0x7f22900a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.430+0000 7f22987a6700 1 --2- 172.21.15.146:0/1530671625 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2290134210 0x7f22900a09a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2280009870 tx=0x7f2280009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:24.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.430+0000 7f22987a6700 1 -- 172.21.15.146:0/1530671625 shutdown_connections 2023-10-03T10:13:24.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.430+0000 7f22987a6700 1 --2- 172.21.15.146:0/1530671625 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2290133900 0x7f2290133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.430+0000 7f22987a6700 1 --2- 172.21.15.146:0/1530671625 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2290134210 0x7f22900a09a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.430+0000 7f22987a6700 1 -- 172.21.15.146:0/1530671625 >> 172.21.15.146:0/1530671625 conn(0x7f22900a2980 msgr2=0x7f22900a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.430+0000 7f22987a6700 1 -- 172.21.15.146:0/1530671625 shutdown_connections 2023-10-03T10:13:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.430+0000 7f22987a6700 1 -- 172.21.15.146:0/1530671625 wait complete. 2023-10-03T10:13:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.431+0000 7f22987a6700 1 Processor -- start 2023-10-03T10:13:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.431+0000 7f22987a6700 1 -- start start 2023-10-03T10:13:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.432+0000 7f22987a6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22900a0ee0 0x7f229011cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.432+0000 7f22987a6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2290133900 0x7f229011d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.432+0000 7f22987a6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2290134210 0x7f22901c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.432+0000 7f22987a6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229011f690 con 0x7f2290134210 2023-10-03T10:13:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.432+0000 7f22987a6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f229011c620 con 0x7f22900a0ee0 2023-10-03T10:13:24.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.432+0000 7f22987a6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f229011dd20 con 0x7f2290133900 2023-10-03T10:13:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.432+0000 7f2296d43700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2290134210 0x7f22901c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.432+0000 7f2296542700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22900a0ee0 0x7f229011cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.432+0000 7f2296d43700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2290134210 0x7f22901c7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54752/0 (socket says 172.21.15.146:54752) 2023-10-03T10:13:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.432+0000 7f2296d43700 1 -- 172.21.15.146:0/2806922610 learned_addr learned my addr 172.21.15.146:0/2806922610 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.432+0000 7f2296542700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22900a0ee0 0x7f229011cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42524/0 (socket says 172.21.15.146:42524) 2023-10-03T10:13:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.432+0000 7f2295d41700 1 --2- 172.21.15.146:0/2806922610 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2290133900 0x7f229011d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.433+0000 7f2296542700 1 -- 172.21.15.146:0/2806922610 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2290133900 msgr2=0x7f229011d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.433+0000 7f2296542700 1 --2- 172.21.15.146:0/2806922610 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2290133900 0x7f229011d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.433+0000 7f2296542700 1 -- 172.21.15.146:0/2806922610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2290134210 msgr2=0x7f22901c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.433+0000 7f2296542700 1 --2- 172.21.15.146:0/2806922610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2290134210 0x7f22901c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.433+0000 7f2296542700 1 -- 172.21.15.146:0/2806922610 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228c009430 con 0x7f22900a0ee0 2023-10-03T10:13:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.433+0000 7f2295d41700 1 --2- 172.21.15.146:0/2806922610 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2290133900 0x7f229011d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:24.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.433+0000 7f2296d43700 1 --2- 172.21.15.146:0/2806922610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2290134210 0x7f22901c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:24.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.433+0000 7f2296542700 1 --2- 172.21.15.146:0/2806922610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22900a0ee0 0x7f229011cbc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f228c00e980 tx=0x7f228c00ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.436 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:24.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.433+0000 7f2286ffd700 1 -- 172.21.15.146:0/2806922610 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c005a20 con 0x7f22900a0ee0 2023-10-03T10:13:24.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.433+0000 7f2286ffd700 1 -- 172.21.15.146:0/2806922610 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c005b80 con 0x7f22900a0ee0 2023-10-03T10:13:24.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.433+0000 7f22987a6700 1 -- 172.21.15.146:0/2806922610 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22800094a0 con 0x7f22900a0ee0 2023-10-03T10:13:24.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.433+0000 7f22987a6700 1 -- 172.21.15.146:0/2806922610 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f229009a2c0 con 0x7f22900a0ee0 2023-10-03T10:13:24.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.433+0000 7f2286ffd700 1 -- 172.21.15.146:0/2806922610 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c00c690 con 0x7f22900a0ee0 2023-10-03T10:13:24.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.434+0000 7f2286ffd700 1 -- 172.21.15.146:0/2806922610 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f228c00c7f0 con 0x7f22900a0ee0 2023-10-03T10:13:24.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.434+0000 7f2286ffd700 1 -- 172.21.15.146:0/2806922610 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f228c03f8a0 con 0x7f22900a0ee0 2023-10-03T10:13:24.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.434+0000 7f22987a6700 1 -- 172.21.15.146:0/2806922610 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22780052e0 con 0x7f22900a0ee0 2023-10-03T10:13:24.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.439+0000 7f2286ffd700 1 -- 172.21.15.146:0/2806922610 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f228c006030 con 0x7f22900a0ee0 2023-10-03T10:13:24.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.474+0000 7f6124f83700 1 Processor -- start 2023-10-03T10:13:24.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.474+0000 7f6124f83700 1 -- start start 2023-10-03T10:13:24.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.474+0000 7f6124f83700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f612006a770 0x7f61201349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.475+0000 7f6124f83700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6120134f00 0x7f612009d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.475+0000 7f6124f83700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612009eca0 con 0x7f612009dea0 2023-10-03T10:13:24.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.475+0000 7f6124f83700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612009f720 con 0x7f6120134f00 2023-10-03T10:13:24.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.475+0000 7f6124f83700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f612006b480 con 0x7f612006a770 2023-10-03T10:13:24.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.475+0000 7f611dd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6120134f00 0x7f612009d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.475+0000 7f611ed9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f612009dea0 0x7f612013ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47924/0 (socket says 172.21.15.146:47924) 2023-10-03T10:13:24.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.475+0000 7f611ed9d700 1 -- 172.21.15.146:0/4259044245 learned_addr learned my addr 172.21.15.146:0/4259044245 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:24.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.475+0000 7f611e59c700 1 --2- 172.21.15.146:0/4259044245 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f612006a770 0x7f61201349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.476+0000 7f611e59c700 1 -- 172.21.15.146:0/4259044245 >> v2:172.21.15.146:3300/0 conn(0x7f6120134f00 msgr2=0x7f612009d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.476+0000 7f611e59c700 1 --2- 172.21.15.146:0/4259044245 >> v2:172.21.15.146:3300/0 conn(0x7f6120134f00 0x7f612009d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.476+0000 7f611e59c700 1 -- 172.21.15.146:0/4259044245 >> v1:172.21.15.146:6789/0 conn(0x7f612009dea0 legacy=0x7f612013ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.476+0000 7f611e59c700 1 -- 172.21.15.146:0/4259044245 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61201352d0 con 0x7f612006a770 2023-10-03T10:13:24.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.476+0000 7f611e59c700 1 --2- 172.21.15.146:0/4259044245 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f612006a770 0x7f61201349c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6118009d90 tx=0x7f611800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3fe317d1ad1118b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.476+0000 7f611d59a700 1 -- 172.21.15.146:0/4259044245 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611800e070 con 0x7f612006a770 2023-10-03T10:13:24.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.476+0000 7f611d59a700 1 -- 172.21.15.146:0/4259044245 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611800bb20 con 0x7f612006a770 2023-10-03T10:13:24.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.476+0000 7f611d59a700 1 -- 172.21.15.146:0/4259044245 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118012430 con 0x7f612006a770 2023-10-03T10:13:24.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.477+0000 7f6124f83700 1 -- 172.21.15.146:0/4259044245 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f612006a770 msgr2=0x7f61201349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.477+0000 7f6124f83700 1 --2- 172.21.15.146:0/4259044245 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f612006a770 0x7f61201349c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6118009d90 tx=0x7f611800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:24.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.478+0000 7f6124f83700 1 -- 172.21.15.146:0/4259044245 shutdown_connections 2023-10-03T10:13:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.478+0000 7f6124f83700 1 --2- 172.21.15.146:0/4259044245 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f612006a770 0x7f61201349c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.478+0000 7f6124f83700 1 --2- 172.21.15.146:0/4259044245 >> v2:172.21.15.146:3300/0 conn(0x7f6120134f00 0x7f612009d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.478+0000 7f6124f83700 1 -- 172.21.15.146:0/4259044245 >> 172.21.15.146:0/4259044245 conn(0x7f6120099c40 msgr2=0x7f61200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.478+0000 7f6124f83700 1 -- 172.21.15.146:0/4259044245 shutdown_connections 2023-10-03T10:13:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.478+0000 7f6124f83700 1 -- 172.21.15.146:0/4259044245 wait complete. 2023-10-03T10:13:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.479+0000 7f6124f83700 1 Processor -- start 2023-10-03T10:13:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.479+0000 7f6124f83700 1 -- start start 2023-10-03T10:13:24.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.479+0000 7f6124f83700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f612006a770 0x7f612011a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.479+0000 7f6124f83700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f612009dea0 0x7f612011ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.479+0000 7f6124f83700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6120134f00 0x7f612011b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.479+0000 7f6124f83700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61200a01b0 con 0x7f612009dea0 2023-10-03T10:13:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.479+0000 7f6124f83700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6120126de0 con 0x7f612006a770 2023-10-03T10:13:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.479+0000 7f6124f83700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f612011c5c0 con 0x7f6120134f00 2023-10-03T10:13:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.480+0000 7f611dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f612009dea0 0x7f612011ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.480+0000 7f611dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f612009dea0 0x7f612011ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54772/0 (socket says 172.21.15.146:54772) 2023-10-03T10:13:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.480+0000 7f611dd9b700 1 -- 172.21.15.146:0/1544708761 learned_addr learned my addr 172.21.15.146:0/1544708761 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.480+0000 7f611e59c700 1 --2- 172.21.15.146:0/1544708761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f612006a770 0x7f612011a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.480+0000 7f611dd9b700 1 -- 172.21.15.146:0/1544708761 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6120134f00 msgr2=0x7f612011b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.480+0000 7f611dd9b700 1 --2- 172.21.15.146:0/1544708761 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6120134f00 0x7f612011b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.480+0000 7f611dd9b700 1 -- 172.21.15.146:0/1544708761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f612006a770 msgr2=0x7f612011a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.480+0000 7f611dd9b700 1 --2- 172.21.15.146:0/1544708761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f612006a770 0x7f612011a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.480+0000 7f611dd9b700 1 -- 172.21.15.146:0/1544708761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6118009a70 con 0x7f612009dea0 2023-10-03T10:13:24.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.480+0000 7f611dd9b700 1 --2- 172.21.15.146:0/1544708761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f612009dea0 0x7f612011ae20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f611400e980 tx=0x7f611400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.481+0000 7f610effd700 1 -- 172.21.15.146:0/1544708761 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6114009710 con 0x7f612009dea0 2023-10-03T10:13:24.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.481+0000 7f610effd700 1 -- 172.21.15.146:0/1544708761 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611400eed0 con 0x7f612009dea0 2023-10-03T10:13:24.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.481+0000 7f6124f83700 1 -- 172.21.15.146:0/1544708761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6120126390 con 0x7f612009dea0 2023-10-03T10:13:24.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.481+0000 7f610effd700 1 -- 172.21.15.146:0/1544708761 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611400ca70 con 0x7f612009dea0 2023-10-03T10:13:24.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.481+0000 7f6124f83700 1 -- 172.21.15.146:0/1544708761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612011ca20 con 0x7f612009dea0 2023-10-03T10:13:24.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.482+0000 7f610effd700 1 -- 172.21.15.146:0/1544708761 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f611400cbd0 con 0x7f612009dea0 2023-10-03T10:13:24.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.482+0000 7f610effd700 1 -- 172.21.15.146:0/1544708761 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f611403f720 con 0x7f612009dea0 2023-10-03T10:13:24.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.482+0000 7f6124f83700 1 -- 172.21.15.146:0/1544708761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612004f2a0 con 0x7f612009dea0 2023-10-03T10:13:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.488+0000 7f610effd700 1 -- 172.21.15.146:0/1544708761 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61140232f0 con 0x7f612009dea0 2023-10-03T10:13:24.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.550+0000 7f86f10c9700 1 Processor -- start 2023-10-03T10:13:24.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.550+0000 7f86f10c9700 1 -- start start 2023-10-03T10:13:24.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.551+0000 7f86f10c9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f86ec0a0a70 0x7f86ec0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.551+0000 7f86f10c9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ec0a1380 0x7f86ec133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.551+0000 7f86f10c9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86ec09dc00 con 0x7f86ec133f50 2023-10-03T10:13:24.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.551+0000 7f86f10c9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ec09ea60 con 0x7f86ec0a0a70 2023-10-03T10:13:24.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.551+0000 7f86f10c9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec09dec0 con 0x7f86ec0a1380 2023-10-03T10:13:24.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.551+0000 7f86ead9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f86ec0a0a70 0x7f86ec0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.551+0000 7f86ead9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f86ec0a0a70 0x7f86ec0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54786/0 (socket says 172.21.15.146:54786) 2023-10-03T10:13:24.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.551+0000 7f86ead9d700 1 -- 172.21.15.146:0/3892107942 learned_addr learned my addr 172.21.15.146:0/3892107942 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:24.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.551+0000 7f86ea59c700 1 --2- 172.21.15.146:0/3892107942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ec0a1380 0x7f86ec133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.552+0000 7f86ea59c700 1 -- 172.21.15.146:0/3892107942 >> v2:172.21.15.146:3300/0 conn(0x7f86ec0a0a70 msgr2=0x7f86ec0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.552+0000 7f86ea59c700 1 --2- 172.21.15.146:0/3892107942 >> v2:172.21.15.146:3300/0 conn(0x7f86ec0a0a70 0x7f86ec0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.552+0000 7f86ea59c700 1 -- 172.21.15.146:0/3892107942 >> v1:172.21.15.146:6789/0 conn(0x7f86ec133f50 legacy=0x7f86ec13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.552+0000 7f86e9d9b700 1 -- 172.21.15.146:0/3892107942 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968807146 0 0) 0x7f86ec09dc00 con 0x7f86ec133f50 2023-10-03T10:13:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.552+0000 7f86ea59c700 1 -- 172.21.15.146:0/3892107942 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec09e6a0 con 0x7f86ec0a1380 2023-10-03T10:13:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.552+0000 7f86ead9d700 1 --2- 172.21.15.146:0/3892107942 >> v2:172.21.15.146:3300/0 conn(0x7f86ec0a0a70 0x7f86ec0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.552+0000 7f86ea59c700 1 --2- 172.21.15.146:0/3892107942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ec0a1380 0x7f86ec133a10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009840 tx=0x7f86e0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8a30a61ad74a572 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.552+0000 7f86e9d9b700 1 -- 172.21.15.146:0/3892107942 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0011830 con 0x7f86ec0a1380 2023-10-03T10:13:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.552+0000 7f86e9d9b700 1 -- 172.21.15.146:0/3892107942 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e0011990 con 0x7f86ec0a1380 2023-10-03T10:13:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.552+0000 7f86e9d9b700 1 -- 172.21.15.146:0/3892107942 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0011d20 con 0x7f86ec0a1380 2023-10-03T10:13:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.553+0000 7f86f10c9700 1 -- 172.21.15.146:0/3892107942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ec0a1380 msgr2=0x7f86ec133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.553+0000 7f86f10c9700 1 --2- 172.21.15.146:0/3892107942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ec0a1380 0x7f86ec133a10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009840 tx=0x7f86e0009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.553+0000 7f86f10c9700 1 -- 172.21.15.146:0/3892107942 shutdown_connections 2023-10-03T10:13:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.553+0000 7f86f10c9700 1 --2- 172.21.15.146:0/3892107942 >> v2:172.21.15.146:3300/0 conn(0x7f86ec0a0a70 0x7f86ec0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.553+0000 7f86f10c9700 1 --2- 172.21.15.146:0/3892107942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ec0a1380 0x7f86ec133a10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.553+0000 7f86f10c9700 1 -- 172.21.15.146:0/3892107942 >> 172.21.15.146:0/3892107942 conn(0x7f86ec0a6610 msgr2=0x7f86ec0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.553+0000 7f86f10c9700 1 -- 172.21.15.146:0/3892107942 shutdown_connections 2023-10-03T10:13:24.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.553+0000 7f86f10c9700 1 -- 172.21.15.146:0/3892107942 wait complete. 2023-10-03T10:13:24.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.554+0000 7f86f10c9700 1 Processor -- start 2023-10-03T10:13:24.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.555+0000 7f86f10c9700 1 -- start start 2023-10-03T10:13:24.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.555+0000 7f86f10c9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ec0a0a70 0x7f86ec11e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.555+0000 7f86f10c9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ec0a1380 0x7f86ec11ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.555+0000 7f86f10c9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f86ec133f50 0x7f86ec11f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.555+0000 7f86f10c9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec121f40 con 0x7f86ec0a0a70 2023-10-03T10:13:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.555+0000 7f86f10c9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec122120 con 0x7f86ec0a1380 2023-10-03T10:13:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.555+0000 7f86f10c9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec133590 con 0x7f86ec133f50 2023-10-03T10:13:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.555+0000 7f86ead9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ec0a0a70 0x7f86ec11e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.555+0000 7f86ea59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ec0a1380 0x7f86ec11ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.555+0000 7f86ead9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ec0a0a70 0x7f86ec11e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54790/0 (socket says 172.21.15.146:54790) 2023-10-03T10:13:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.555+0000 7f86ead9d700 1 -- 172.21.15.146:0/571105531 learned_addr learned my addr 172.21.15.146:0/571105531 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.555+0000 7f86eb59e700 1 --2- 172.21.15.146:0/571105531 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f86ec133f50 0x7f86ec11f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.556+0000 7f86ea59c700 1 -- 172.21.15.146:0/571105531 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f86ec133f50 msgr2=0x7f86ec11f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.556+0000 7f86ea59c700 1 --2- 172.21.15.146:0/571105531 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f86ec133f50 0x7f86ec11f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.556+0000 7f86ea59c700 1 -- 172.21.15.146:0/571105531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ec0a0a70 msgr2=0x7f86ec11e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.556+0000 7f86ea59c700 1 --2- 172.21.15.146:0/571105531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ec0a0a70 0x7f86ec11e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.556+0000 7f86ea59c700 1 -- 172.21.15.146:0/571105531 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc009550 con 0x7f86ec0a1380 2023-10-03T10:13:24.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.556+0000 7f86ea59c700 1 --2- 172.21.15.146:0/571105531 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ec0a1380 0x7f86ec11ec70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f86e0016000 tx=0x7f86e0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.556+0000 7f86d37fe700 1 -- 172.21.15.146:0/571105531 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0004550 con 0x7f86ec0a1380 2023-10-03T10:13:24.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.556+0000 7f86d37fe700 1 -- 172.21.15.146:0/571105531 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e001f070 con 0x7f86ec0a1380 2023-10-03T10:13:24.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.556+0000 7f86f10c9700 1 -- 172.21.15.146:0/571105531 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e00094a0 con 0x7f86ec0a1380 2023-10-03T10:13:24.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.556+0000 7f86d37fe700 1 -- 172.21.15.146:0/571105531 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e00038e0 con 0x7f86ec0a1380 2023-10-03T10:13:24.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.556+0000 7f86f10c9700 1 -- 172.21.15.146:0/571105531 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ec1339e0 con 0x7f86ec0a1380 2023-10-03T10:13:24.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.557+0000 7f86d37fe700 1 -- 172.21.15.146:0/571105531 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f86e0003a40 con 0x7f86ec0a1380 2023-10-03T10:13:24.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.557+0000 7f86d37fe700 1 -- 172.21.15.146:0/571105531 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f86e0021070 con 0x7f86ec0a1380 2023-10-03T10:13:24.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.558+0000 7f86f10c9700 1 -- 172.21.15.146:0/571105531 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ec121da0 con 0x7f86ec0a1380 2023-10-03T10:13:24.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.566+0000 7f86d37fe700 1 -- 172.21.15.146:0/571105531 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86ec121da0 con 0x7f86ec0a1380 2023-10-03T10:13:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.575+0000 7fec5c0e6700 1 Processor -- start 2023-10-03T10:13:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.575+0000 7fec5c0e6700 1 -- start start 2023-10-03T10:13:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.575+0000 7fec5c0e6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec540a0a30 0x7fec540a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.575+0000 7fec5c0e6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec540a1340 0x7fec5412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.575+0000 7fec5c0e6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fec541304a0 0x7fec541308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.575+0000 7fec5c0e6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec54130e30 con 0x7fec541304a0 2023-10-03T10:13:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.575+0000 7fec5c0e6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec540a1e70 con 0x7fec540a0a30 2023-10-03T10:13:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.575+0000 7fec5c0e6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec5409a720 con 0x7fec540a1340 2023-10-03T10:13:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.576+0000 7fec5a683700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fec541304a0 0x7fec541308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.576+0000 7fec5a683700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fec541304a0 0x7fec541308f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54802/0 (socket says 172.21.15.146:54802) 2023-10-03T10:13:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.576+0000 7fec5a683700 1 -- 172.21.15.146:0/1302714005 learned_addr learned my addr 172.21.15.146:0/1302714005 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.576+0000 7fec59681700 1 --2- 172.21.15.146:0/1302714005 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec540a1340 0x7fec5412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.576+0000 7fec59e82700 1 --2- 172.21.15.146:0/1302714005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec540a0a30 0x7fec540a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.576+0000 7fec59681700 1 -- 172.21.15.146:0/1302714005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec540a0a30 msgr2=0x7fec540a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.576+0000 7fec59681700 1 --2- 172.21.15.146:0/1302714005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec540a0a30 0x7fec540a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.576+0000 7fec59681700 1 -- 172.21.15.146:0/1302714005 >> v2:172.21.15.146:3300/0 conn(0x7fec541304a0 msgr2=0x7fec541308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.576+0000 7fec59681700 1 --2- 172.21.15.146:0/1302714005 >> v2:172.21.15.146:3300/0 conn(0x7fec541304a0 0x7fec541308f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.576+0000 7fec59681700 1 -- 172.21.15.146:0/1302714005 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5409b300 con 0x7fec540a1340 2023-10-03T10:13:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.576+0000 7fec59e82700 1 --2- 172.21.15.146:0/1302714005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec540a0a30 0x7fec540a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.576+0000 7fec59681700 1 --2- 172.21.15.146:0/1302714005 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec540a1340 0x7fec5412ff60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fec44009840 tx=0x7fec44009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0ce568811f0540b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.576+0000 7fec58e80700 1 -- 172.21.15.146:0/1302714005 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec44010800 con 0x7fec540a1340 2023-10-03T10:13:24.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.576+0000 7fec58e80700 1 -- 172.21.15.146:0/1302714005 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec44010960 con 0x7fec540a1340 2023-10-03T10:13:24.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.576+0000 7fec58e80700 1 -- 172.21.15.146:0/1302714005 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec44010cf0 con 0x7fec540a1340 2023-10-03T10:13:24.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.577+0000 7fec5c0e6700 1 -- 172.21.15.146:0/1302714005 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec540a1340 msgr2=0x7fec5412ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.577+0000 7fec5c0e6700 1 --2- 172.21.15.146:0/1302714005 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec540a1340 0x7fec5412ff60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fec44009840 tx=0x7fec44009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:24.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.577+0000 7fec5c0e6700 1 -- 172.21.15.146:0/1302714005 shutdown_connections 2023-10-03T10:13:24.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.577+0000 7fec5c0e6700 1 --2- 172.21.15.146:0/1302714005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec540a0a30 0x7fec540a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.577+0000 7fec5c0e6700 1 --2- 172.21.15.146:0/1302714005 >> v2:172.21.15.146:3300/0 conn(0x7fec541304a0 0x7fec541308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.577+0000 7fec5c0e6700 1 --2- 172.21.15.146:0/1302714005 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec540a1340 0x7fec5412ff60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.577+0000 7fec5c0e6700 1 -- 172.21.15.146:0/1302714005 >> 172.21.15.146:0/1302714005 conn(0x7fec540a2980 msgr2=0x7fec540a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.577+0000 7fec5c0e6700 1 -- 172.21.15.146:0/1302714005 shutdown_connections 2023-10-03T10:13:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.577+0000 7fec5c0e6700 1 -- 172.21.15.146:0/1302714005 wait complete. 2023-10-03T10:13:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.578+0000 7fec5c0e6700 1 Processor -- start 2023-10-03T10:13:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.578+0000 7fec5c0e6700 1 -- start start 2023-10-03T10:13:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.578+0000 7fec5c0e6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec540a0a30 0x7fec541ba900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.579+0000 7fec5c0e6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec540a1340 0x7fec541bae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.579+0000 7fec5c0e6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec541304a0 0x7fec541c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.579+0000 7fec5c0e6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5411ea20 con 0x7fec541304a0 2023-10-03T10:13:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.579+0000 7fec5c0e6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5412ffd0 con 0x7fec540a1340 2023-10-03T10:13:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.579+0000 7fec5c0e6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec5411ec50 con 0x7fec540a0a30 2023-10-03T10:13:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.579+0000 7fec59681700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec540a1340 0x7fec541bae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.579+0000 7fec59681700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec540a1340 0x7fec541bae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42550/0 (socket says 172.21.15.146:42550) 2023-10-03T10:13:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.579+0000 7fec59681700 1 -- 172.21.15.146:0/449234601 learned_addr learned my addr 172.21.15.146:0/449234601 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.579+0000 7fec59e82700 1 --2- 172.21.15.146:0/449234601 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec540a0a30 0x7fec541ba900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.579+0000 7fec5a683700 1 --2- 172.21.15.146:0/449234601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec541304a0 0x7fec541c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.579+0000 7fec59e82700 1 -- 172.21.15.146:0/449234601 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec540a1340 msgr2=0x7fec541bae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.579+0000 7fec59e82700 1 --2- 172.21.15.146:0/449234601 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec540a1340 0x7fec541bae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.579+0000 7fec59e82700 1 -- 172.21.15.146:0/449234601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec541304a0 msgr2=0x7fec541c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.579+0000 7fec59e82700 1 --2- 172.21.15.146:0/449234601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec541304a0 0x7fec541c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.579+0000 7fec59e82700 1 -- 172.21.15.146:0/449234601 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec440094a0 con 0x7fec540a0a30 2023-10-03T10:13:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.579+0000 7fec59e82700 1 --2- 172.21.15.146:0/449234601 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec540a0a30 0x7fec541ba900 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fec5000e810 tx=0x7fec5000ebd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.579+0000 7fec4a7fc700 1 -- 172.21.15.146:0/449234601 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5000c070 con 0x7fec540a0a30 2023-10-03T10:13:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.579+0000 7fec4a7fc700 1 -- 172.21.15.146:0/449234601 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec50005c20 con 0x7fec540a0a30 2023-10-03T10:13:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.579+0000 7fec4a7fc700 1 -- 172.21.15.146:0/449234601 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec50004030 con 0x7fec540a0a30 2023-10-03T10:13:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.579+0000 7fec5c0e6700 1 -- 172.21.15.146:0/449234601 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec541bb380 con 0x7fec540a0a30 2023-10-03T10:13:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.579+0000 7fec5c0e6700 1 -- 172.21.15.146:0/449234601 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5409f0b0 con 0x7fec540a0a30 2023-10-03T10:13:24.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.580+0000 7fec5c0e6700 1 -- 172.21.15.146:0/449234601 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5404f2a0 con 0x7fec540a0a30 2023-10-03T10:13:24.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.581+0000 7fec4a7fc700 1 -- 172.21.15.146:0/449234601 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fec50004190 con 0x7fec540a0a30 2023-10-03T10:13:24.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.582+0000 7fec4a7fc700 1 -- 172.21.15.146:0/449234601 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fec5003fa10 con 0x7fec540a0a30 2023-10-03T10:13:24.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.590+0000 7fec4a7fc700 1 -- 172.21.15.146:0/449234601 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fec5000f040 con 0x7fec540a0a30 2023-10-03T10:13:24.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.665+0000 7f22987a6700 1 -- 172.21.15.146:0/2806922610 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2278005590 con 0x7f22900a0ee0 2023-10-03T10:13:24.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.665+0000 7f2286ffd700 1 -- 172.21.15.146:0/2806922610 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f228c029090 con 0x7f22900a0ee0 2023-10-03T10:13:24.666 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:24.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.667+0000 7f22987a6700 1 -- 172.21.15.146:0/2806922610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22900a0ee0 msgr2=0x7f229011cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.667+0000 7f22987a6700 1 --2- 172.21.15.146:0/2806922610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22900a0ee0 0x7f229011cbc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f228c00e980 tx=0x7f228c00ec90 comp rx=0 tx=0).stop 2023-10-03T10:13:24.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.668+0000 7f22987a6700 1 -- 172.21.15.146:0/2806922610 shutdown_connections 2023-10-03T10:13:24.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.668+0000 7f22987a6700 1 --2- 172.21.15.146:0/2806922610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2290134210 0x7f22901c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.668+0000 7f22987a6700 1 --2- 172.21.15.146:0/2806922610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22900a0ee0 0x7f229011cbc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.668+0000 7f22987a6700 1 --2- 172.21.15.146:0/2806922610 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2290133900 0x7f229011d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.668+0000 7f22987a6700 1 -- 172.21.15.146:0/2806922610 >> 172.21.15.146:0/2806922610 conn(0x7f22900a2980 msgr2=0x7f22901bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.668+0000 7f22987a6700 1 -- 172.21.15.146:0/2806922610 shutdown_connections 2023-10-03T10:13:24.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.668+0000 7f22987a6700 1 -- 172.21.15.146:0/2806922610 wait complete. 2023-10-03T10:13:24.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:24.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.697+0000 7f6124f83700 1 -- 172.21.15.146:0/1544708761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f612011c2b0 con 0x7f612009dea0 2023-10-03T10:13:24.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.697+0000 7f610effd700 1 -- 172.21.15.146:0/1544708761 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6114021020 con 0x7f612009dea0 2023-10-03T10:13:24.698 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:24.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.699+0000 7f6124f83700 1 -- 172.21.15.146:0/1544708761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f612009dea0 msgr2=0x7f612011ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.699+0000 7f6124f83700 1 --2- 172.21.15.146:0/1544708761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f612009dea0 0x7f612011ae20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f611400e980 tx=0x7f611400ec90 comp rx=0 tx=0).stop 2023-10-03T10:13:24.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.699+0000 7f6124f83700 1 -- 172.21.15.146:0/1544708761 shutdown_connections 2023-10-03T10:13:24.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.699+0000 7f6124f83700 1 --2- 172.21.15.146:0/1544708761 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6120134f00 0x7f612011b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.699+0000 7f6124f83700 1 --2- 172.21.15.146:0/1544708761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f612006a770 0x7f612011a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.699+0000 7f6124f83700 1 --2- 172.21.15.146:0/1544708761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f612009dea0 0x7f612011ae20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.699+0000 7f6124f83700 1 -- 172.21.15.146:0/1544708761 >> 172.21.15.146:0/1544708761 conn(0x7f6120099c40 msgr2=0x7f61200a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.699+0000 7f6124f83700 1 -- 172.21.15.146:0/1544708761 shutdown_connections 2023-10-03T10:13:24.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.699+0000 7f6124f83700 1 -- 172.21.15.146:0/1544708761 wait complete. 2023-10-03T10:13:24.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:24.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.763+0000 7f86f10c9700 1 -- 172.21.15.146:0/571105531 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f86ec121da0 con 0x7f86ec0a1380 2023-10-03T10:13:24.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.763+0000 7f86d37fe700 1 -- 172.21.15.146:0/571105531 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f86ec121da0 con 0x7f86ec0a1380 2023-10-03T10:13:24.764 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:24.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.765+0000 7f86f10c9700 1 -- 172.21.15.146:0/571105531 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ec0a1380 msgr2=0x7f86ec11ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.765+0000 7f86f10c9700 1 --2- 172.21.15.146:0/571105531 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ec0a1380 0x7f86ec11ec70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f86e0016000 tx=0x7f86e0004750 comp rx=0 tx=0).stop 2023-10-03T10:13:24.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.765+0000 7f86f10c9700 1 -- 172.21.15.146:0/571105531 shutdown_connections 2023-10-03T10:13:24.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.765+0000 7f86f10c9700 1 --2- 172.21.15.146:0/571105531 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f86ec133f50 0x7f86ec11f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.765+0000 7f86f10c9700 1 --2- 172.21.15.146:0/571105531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ec0a0a70 0x7f86ec11e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.765+0000 7f86f10c9700 1 --2- 172.21.15.146:0/571105531 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86ec0a1380 0x7f86ec11ec70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.765+0000 7f86f10c9700 1 -- 172.21.15.146:0/571105531 >> 172.21.15.146:0/571105531 conn(0x7f86ec0a6610 msgr2=0x7f86ec09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.765+0000 7f86f10c9700 1 -- 172.21.15.146:0/571105531 shutdown_connections 2023-10-03T10:13:24.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.765+0000 7f86f10c9700 1 -- 172.21.15.146:0/571105531 wait complete. 2023-10-03T10:13:24.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:24.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.784+0000 7fec5c0e6700 1 -- 172.21.15.146:0/449234601 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fec541ba550 con 0x7fec540a0a30 2023-10-03T10:13:24.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.784+0000 7fec4a7fc700 1 -- 172.21.15.146:0/449234601 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fec50017020 con 0x7fec540a0a30 2023-10-03T10:13:24.785 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:24.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.786+0000 7fec5c0e6700 1 -- 172.21.15.146:0/449234601 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec540a0a30 msgr2=0x7fec541ba900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.786+0000 7fec5c0e6700 1 --2- 172.21.15.146:0/449234601 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec540a0a30 0x7fec541ba900 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fec5000e810 tx=0x7fec5000ebd0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.786+0000 7fec5c0e6700 1 -- 172.21.15.146:0/449234601 shutdown_connections 2023-10-03T10:13:24.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.786+0000 7fec5c0e6700 1 --2- 172.21.15.146:0/449234601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec541304a0 0x7fec541c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.786+0000 7fec5c0e6700 1 --2- 172.21.15.146:0/449234601 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec540a0a30 0x7fec541ba900 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.786+0000 7fec5c0e6700 1 --2- 172.21.15.146:0/449234601 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec540a1340 0x7fec541bae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.786+0000 7fec5c0e6700 1 -- 172.21.15.146:0/449234601 >> 172.21.15.146:0/449234601 conn(0x7fec540a2980 msgr2=0x7fec5409e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.786+0000 7fec5c0e6700 1 -- 172.21.15.146:0/449234601 shutdown_connections 2023-10-03T10:13:24.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:24.787+0000 7fec5c0e6700 1 -- 172.21.15.146:0/449234601 wait complete. 2023-10-03T10:13:24.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:25.681 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:25.713 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:25.779 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:25.800 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.845+0000 7f557a08d700 1 Processor -- start 2023-10-03T10:13:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.845+0000 7f557a08d700 1 -- start start 2023-10-03T10:13:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.846+0000 7f557a08d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f55741335f0 0x7f55741359d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.846+0000 7f557a08d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5574135f10 0x7f55741382f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.846+0000 7f557a08d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f557409bb90 con 0x7f557412d380 2023-10-03T10:13:25.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.846+0000 7f557a08d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f557409c210 con 0x7f55741335f0 2023-10-03T10:13:25.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.846+0000 7f557a08d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f557409ced0 con 0x7f5574135f10 2023-10-03T10:13:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.846+0000 7f55737fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f557412d380 0x7f557412d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47948/0 (socket says 172.21.15.146:47948) 2023-10-03T10:13:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.846+0000 7f55737fe700 1 -- 172.21.15.146:0/1056893557 learned_addr learned my addr 172.21.15.146:0/1056893557 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.846+0000 7f5572ffd700 1 --2- 172.21.15.146:0/1056893557 >> v2:172.21.15.146:3300/0 conn(0x7f55741335f0 0x7f55741359d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.846+0000 7f5573fff700 1 --2- 172.21.15.146:0/1056893557 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5574135f10 0x7f55741382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.847+0000 7f5572ffd700 1 -- 172.21.15.146:0/1056893557 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5574135f10 msgr2=0x7f55741382f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.847+0000 7f5572ffd700 1 --2- 172.21.15.146:0/1056893557 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5574135f10 0x7f55741382f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.847+0000 7f5572ffd700 1 -- 172.21.15.146:0/1056893557 >> v1:172.21.15.146:6789/0 conn(0x7f557412d380 legacy=0x7f557412d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.847+0000 7f5572ffd700 1 -- 172.21.15.146:0/1056893557 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557409ac30 con 0x7f55741335f0 2023-10-03T10:13:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.847+0000 7f5572ffd700 1 --2- 172.21.15.146:0/1056893557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55741335f0 0x7f55741359d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f556800bae0 tx=0x7f556800bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1cfcbd75b872f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.847+0000 7f55727fc700 1 -- 172.21.15.146:0/1056893557 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556800dc70 con 0x7f55741335f0 2023-10-03T10:13:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.847+0000 7f55727fc700 1 -- 172.21.15.146:0/1056893557 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556800ddd0 con 0x7f55741335f0 2023-10-03T10:13:25.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.847+0000 7f55727fc700 1 -- 172.21.15.146:0/1056893557 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5568010690 con 0x7f55741335f0 2023-10-03T10:13:25.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.848+0000 7f557a08d700 1 -- 172.21.15.146:0/1056893557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55741335f0 msgr2=0x7f55741359d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.848+0000 7f557a08d700 1 --2- 172.21.15.146:0/1056893557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55741335f0 0x7f55741359d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f556800bae0 tx=0x7f556800bdf0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.848+0000 7f557a08d700 1 -- 172.21.15.146:0/1056893557 shutdown_connections 2023-10-03T10:13:25.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.848+0000 7f557a08d700 1 --2- 172.21.15.146:0/1056893557 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5574135f10 0x7f55741382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.848+0000 7f557a08d700 1 --2- 172.21.15.146:0/1056893557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55741335f0 0x7f55741359d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.848+0000 7f557a08d700 1 -- 172.21.15.146:0/1056893557 >> 172.21.15.146:0/1056893557 conn(0x7f55740a2980 msgr2=0x7f55740a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.848+0000 7f557a08d700 1 -- 172.21.15.146:0/1056893557 shutdown_connections 2023-10-03T10:13:25.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.848+0000 7f557a08d700 1 -- 172.21.15.146:0/1056893557 wait complete. 2023-10-03T10:13:25.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.849+0000 7f557a08d700 1 Processor -- start 2023-10-03T10:13:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.850+0000 7f557a08d700 1 -- start start 2023-10-03T10:13:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.850+0000 7f557a08d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f557412d380 0x7f557406fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.850+0000 7f557a08d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55741335f0 0x7f557406ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.850+0000 7f557a08d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5574135f10 0x7f55741c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.850+0000 7f557a08d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557412cde0 con 0x7f55741335f0 2023-10-03T10:13:25.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.850+0000 7f557a08d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557412cba0 con 0x7f557412d380 2023-10-03T10:13:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.850+0000 7f557a08d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f557406f5f0 con 0x7f5574135f10 2023-10-03T10:13:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.850+0000 7f5573fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5574135f10 0x7f55741c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.850+0000 7f55737fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f557412d380 0x7f557406fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.850+0000 7f5573fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5574135f10 0x7f55741c8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:60500/0 (socket says 172.21.15.146:60500) 2023-10-03T10:13:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.850+0000 7f55737fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f557412d380 0x7f557406fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42560/0 (socket says 172.21.15.146:42560) 2023-10-03T10:13:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.850+0000 7f5573fff700 1 -- 172.21.15.146:0/3999455984 learned_addr learned my addr 172.21.15.146:0/3999455984 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.850+0000 7f5572ffd700 1 --2- 172.21.15.146:0/3999455984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55741335f0 0x7f557406ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.851+0000 7f55737fe700 1 -- 172.21.15.146:0/3999455984 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5574135f10 msgr2=0x7f55741c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.851+0000 7f55737fe700 1 --2- 172.21.15.146:0/3999455984 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5574135f10 0x7f55741c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.851+0000 7f55737fe700 1 -- 172.21.15.146:0/3999455984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55741335f0 msgr2=0x7f557406ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.851+0000 7f55737fe700 1 --2- 172.21.15.146:0/3999455984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55741335f0 0x7f557406ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.851+0000 7f55737fe700 1 -- 172.21.15.146:0/3999455984 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556800b740 con 0x7f557412d380 2023-10-03T10:13:25.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.851+0000 7f55737fe700 1 --2- 172.21.15.146:0/3999455984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f557412d380 0x7f557406fa60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f556400c3c0 tx=0x7f556400c6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.851+0000 7f555bfff700 1 -- 172.21.15.146:0/3999455984 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55640074e0 con 0x7f557412d380 2023-10-03T10:13:25.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.851+0000 7f555bfff700 1 -- 172.21.15.146:0/3999455984 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5564007640 con 0x7f557412d380 2023-10-03T10:13:25.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.851+0000 7f555bfff700 1 -- 172.21.15.146:0/3999455984 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5564005a70 con 0x7f557412d380 2023-10-03T10:13:25.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.851+0000 7f557a08d700 1 -- 172.21.15.146:0/3999455984 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5574071300 con 0x7f557412d380 2023-10-03T10:13:25.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.851+0000 7f557a08d700 1 -- 172.21.15.146:0/3999455984 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5574070d50 con 0x7f557412d380 2023-10-03T10:13:25.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.852+0000 7f555bfff700 1 -- 172.21.15.146:0/3999455984 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5564005bd0 con 0x7f557412d380 2023-10-03T10:13:25.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.853+0000 7f555bfff700 1 -- 172.21.15.146:0/3999455984 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f556403eb70 con 0x7f557412d380 2023-10-03T10:13:25.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.853+0000 7f557a08d700 1 -- 172.21.15.146:0/3999455984 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f557411d8b0 con 0x7f557412d380 2023-10-03T10:13:25.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.857+0000 7f555bfff700 1 -- 172.21.15.146:0/3999455984 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f556400f260 con 0x7f557412d380 2023-10-03T10:13:25.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.883+0000 7f5f70f0d700 1 Processor -- start 2023-10-03T10:13:25.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.883+0000 7f5f70f0d700 1 -- start start 2023-10-03T10:13:25.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.883+0000 7f5f70f0d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5f6c0a0a30 0x7f5f6c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.883+0000 7f5f70f0d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f6c130670 0x7f5f6c1381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.883+0000 7f5f70f0d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f6c0a1e70 con 0x7f5f6c0a1340 2023-10-03T10:13:25.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.883+0000 7f5f70f0d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f6c09a720 con 0x7f5f6c0a0a30 2023-10-03T10:13:25.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.883+0000 7f5f70f0d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c09b300 con 0x7f5f6c130670 2023-10-03T10:13:25.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.884+0000 7f5f6ad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f6c130670 0x7f5f6c1381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.884+0000 7f5f6a59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5f6c0a0a30 0x7f5f6c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.884+0000 7f5f6ad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f6c130670 0x7f5f6c1381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42564/0 (socket says 172.21.15.146:42564) 2023-10-03T10:13:25.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.884+0000 7f5f6ad9d700 1 -- 172.21.15.146:0/629767563 learned_addr learned my addr 172.21.15.146:0/629767563 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:25.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.884+0000 7f5f69d9b700 1 --1- 172.21.15.146:0/629767563 >> v1:172.21.15.146:6789/0 conn(0x7f5f6c0a1340 0x7f5f6c12ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47958/0 (socket says 172.21.15.146:47958) 2023-10-03T10:13:25.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.884+0000 7f5f6959a700 1 -- 172.21.15.146:0/629767563 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189416049 0 0) 0x7f5f6c0a1e70 con 0x7f5f6c0a1340 2023-10-03T10:13:25.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.884+0000 7f5f6ad9d700 1 -- 172.21.15.146:0/629767563 >> v2:172.21.15.146:3300/0 conn(0x7f5f6c0a0a30 msgr2=0x7f5f6c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.884+0000 7f5f6ad9d700 1 --2- 172.21.15.146:0/629767563 >> v2:172.21.15.146:3300/0 conn(0x7f5f6c0a0a30 0x7f5f6c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.884+0000 7f5f6ad9d700 1 -- 172.21.15.146:0/629767563 >> v1:172.21.15.146:6789/0 conn(0x7f5f6c0a1340 legacy=0x7f5f6c12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.884+0000 7f5f6ad9d700 1 -- 172.21.15.146:0/629767563 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c09abc0 con 0x7f5f6c130670 2023-10-03T10:13:25.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.884+0000 7f5f6a59c700 1 --2- 172.21.15.146:0/629767563 >> v2:172.21.15.146:3300/0 conn(0x7f5f6c0a0a30 0x7f5f6c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:25.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.884+0000 7f5f6ad9d700 1 --2- 172.21.15.146:0/629767563 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f6c130670 0x7f5f6c1381c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400af60 tx=0x7f5f6400af90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d329c241687d1486 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.884+0000 7f5f6959a700 1 -- 172.21.15.146:0/629767563 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6400f070 con 0x7f5f6c130670 2023-10-03T10:13:25.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.885+0000 7f5f6959a700 1 -- 172.21.15.146:0/629767563 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6400a2e0 con 0x7f5f6c130670 2023-10-03T10:13:25.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.885+0000 7f5f6959a700 1 -- 172.21.15.146:0/629767563 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6400cc00 con 0x7f5f6c130670 2023-10-03T10:13:25.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.885+0000 7f5f70f0d700 1 -- 172.21.15.146:0/629767563 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f6c130670 msgr2=0x7f5f6c1381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.885+0000 7f5f70f0d700 1 --2- 172.21.15.146:0/629767563 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f6c130670 0x7f5f6c1381c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400af60 tx=0x7f5f6400af90 comp rx=0 tx=0).stop 2023-10-03T10:13:25.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.885+0000 7f5f70f0d700 1 -- 172.21.15.146:0/629767563 shutdown_connections 2023-10-03T10:13:25.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.885+0000 7f5f70f0d700 1 --2- 172.21.15.146:0/629767563 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f6c130670 0x7f5f6c1381c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.885+0000 7f5f70f0d700 1 --2- 172.21.15.146:0/629767563 >> v2:172.21.15.146:3300/0 conn(0x7f5f6c0a0a30 0x7f5f6c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.885+0000 7f5f70f0d700 1 -- 172.21.15.146:0/629767563 >> 172.21.15.146:0/629767563 conn(0x7f5f6c0a2980 msgr2=0x7f5f6c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.885+0000 7f5f70f0d700 1 -- 172.21.15.146:0/629767563 shutdown_connections 2023-10-03T10:13:25.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.885+0000 7f5f70f0d700 1 -- 172.21.15.146:0/629767563 wait complete. 2023-10-03T10:13:25.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.887+0000 7f5f70f0d700 1 Processor -- start 2023-10-03T10:13:25.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.887+0000 7f5f70f0d700 1 -- start start 2023-10-03T10:13:25.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.887+0000 7f5f70f0d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f6c0a0a30 0x7f5f6c1c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.887+0000 7f5f70f0d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f6c0a1340 0x7f5f6c1c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.887+0000 7f5f70f0d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f6c130670 0x7f5f6c1c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.887+0000 7f5f70f0d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c11ca70 con 0x7f5f6c130670 2023-10-03T10:13:25.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.887+0000 7f5f70f0d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c122b20 con 0x7f5f6c0a1340 2023-10-03T10:13:25.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.887+0000 7f5f70f0d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c09fa10 con 0x7f5f6c0a0a30 2023-10-03T10:13:25.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.887+0000 7f5f69d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f6c0a1340 0x7f5f6c1c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.887+0000 7f5f69d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f6c0a1340 0x7f5f6c1c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42580/0 (socket says 172.21.15.146:42580) 2023-10-03T10:13:25.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.887+0000 7f5f69d9b700 1 -- 172.21.15.146:0/3849456073 learned_addr learned my addr 172.21.15.146:0/3849456073 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:25.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.887+0000 7f5f6ad9d700 1 --2- 172.21.15.146:0/3849456073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f6c130670 0x7f5f6c1c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.887+0000 7f5f6a59c700 1 --2- 172.21.15.146:0/3849456073 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f6c0a0a30 0x7f5f6c1c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.888+0000 7f5f69d9b700 1 -- 172.21.15.146:0/3849456073 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f6c0a0a30 msgr2=0x7f5f6c1c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.888+0000 7f5f69d9b700 1 --2- 172.21.15.146:0/3849456073 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f6c0a0a30 0x7f5f6c1c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.888+0000 7f5f69d9b700 1 -- 172.21.15.146:0/3849456073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f6c130670 msgr2=0x7f5f6c1c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.888+0000 7f5f69d9b700 1 --2- 172.21.15.146:0/3849456073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f6c130670 0x7f5f6c1c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.888+0000 7f5f69d9b700 1 -- 172.21.15.146:0/3849456073 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c009430 con 0x7f5f6c0a1340 2023-10-03T10:13:25.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.888+0000 7f5f6a59c700 1 --2- 172.21.15.146:0/3849456073 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f6c0a0a30 0x7f5f6c1c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:25.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.888+0000 7f5f69d9b700 1 --2- 172.21.15.146:0/3849456073 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f6c0a1340 0x7f5f6c1c8530 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000c520 tx=0x7f5f6000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.888+0000 7f5f5affd700 1 -- 172.21.15.146:0/3849456073 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f60004c80 con 0x7f5f6c0a1340 2023-10-03T10:13:25.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.888+0000 7f5f5affd700 1 -- 172.21.15.146:0/3849456073 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f60004de0 con 0x7f5f6c0a1340 2023-10-03T10:13:25.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.888+0000 7f5f70f0d700 1 -- 172.21.15.146:0/3849456073 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6400ac40 con 0x7f5f6c0a1340 2023-10-03T10:13:25.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.888+0000 7f5f70f0d700 1 -- 172.21.15.146:0/3849456073 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6c121670 con 0x7f5f6c0a1340 2023-10-03T10:13:25.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.888+0000 7f5f5affd700 1 -- 172.21.15.146:0/3849456073 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f60007310 con 0x7f5f6c0a1340 2023-10-03T10:13:25.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.889+0000 7f5f70f0d700 1 -- 172.21.15.146:0/3849456073 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f500052e0 con 0x7f5f6c0a1340 2023-10-03T10:13:25.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.890+0000 7f5f5affd700 1 -- 172.21.15.146:0/3849456073 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f60007470 con 0x7f5f6c0a1340 2023-10-03T10:13:25.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.890+0000 7f5f5affd700 1 -- 172.21.15.146:0/3849456073 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5f6003f310 con 0x7f5f6c0a1340 2023-10-03T10:13:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.899+0000 7f5f5affd700 1 -- 172.21.15.146:0/3849456073 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f600106d0 con 0x7f5f6c0a1340 2023-10-03T10:13:25.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.936+0000 7f6179fbc700 1 Processor -- start 2023-10-03T10:13:25.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.936+0000 7f6179fbc700 1 -- start start 2023-10-03T10:13:25.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.937+0000 7f6179fbc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f617409e870 0x7f617409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.937+0000 7f6179fbc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6174131f40 0x7f6174139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.937+0000 7f6179fbc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f617409c970 con 0x7f617409f180 2023-10-03T10:13:25.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.937+0000 7f6179fbc700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61740a0920 con 0x7f6174131f40 2023-10-03T10:13:25.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.937+0000 7f6179fbc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f617409f9c0 con 0x7f617409e870 2023-10-03T10:13:25.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.937+0000 7f61737fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f617409e870 0x7f617409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.937+0000 7f6173fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6174131f40 0x7f6174139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.937+0000 7f61737fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f617409e870 0x7f617409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:60522/0 (socket says 172.21.15.146:60522) 2023-10-03T10:13:25.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.937+0000 7f61737fe700 1 -- 172.21.15.146:0/35141214 learned_addr learned my addr 172.21.15.146:0/35141214 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:25.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.937+0000 7f6172ffd700 1 --1- 172.21.15.146:0/35141214 >> v1:172.21.15.146:6789/0 conn(0x7f617409f180 0x7f6174131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47962/0 (socket says 172.21.15.146:47962) 2023-10-03T10:13:25.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.937+0000 7f6173fff700 1 -- 172.21.15.146:0/35141214 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f617409e870 msgr2=0x7f617409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.937+0000 7f6173fff700 1 --2- 172.21.15.146:0/35141214 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f617409e870 0x7f617409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.937+0000 7f6173fff700 1 -- 172.21.15.146:0/35141214 >> v1:172.21.15.146:6789/0 conn(0x7f617409f180 legacy=0x7f6174131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.937+0000 7f6173fff700 1 -- 172.21.15.146:0/35141214 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617409bab0 con 0x7f6174131f40 2023-10-03T10:13:25.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.937+0000 7f61727fc700 1 -- 172.21.15.146:0/35141214 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334291133 0 0) 0x7f617409c970 con 0x7f617409f180 2023-10-03T10:13:25.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.938+0000 7f6173fff700 1 --2- 172.21.15.146:0/35141214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6174131f40 0x7f6174139ca0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f616c009d90 tx=0x7f616c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a5d2fba6e8b97 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.938+0000 7f61727fc700 1 -- 172.21.15.146:0/35141214 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c00e070 con 0x7f6174131f40 2023-10-03T10:13:25.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.938+0000 7f61727fc700 1 -- 172.21.15.146:0/35141214 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616c00bb20 con 0x7f6174131f40 2023-10-03T10:13:25.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.938+0000 7f61727fc700 1 -- 172.21.15.146:0/35141214 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c012430 con 0x7f6174131f40 2023-10-03T10:13:25.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.939+0000 7f6179fbc700 1 -- 172.21.15.146:0/35141214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6174131f40 msgr2=0x7f6174139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.939+0000 7f6179fbc700 1 --2- 172.21.15.146:0/35141214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6174131f40 0x7f6174139ca0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f616c009d90 tx=0x7f616c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:25.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.939+0000 7f6179fbc700 1 -- 172.21.15.146:0/35141214 shutdown_connections 2023-10-03T10:13:25.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.939+0000 7f6179fbc700 1 --2- 172.21.15.146:0/35141214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6174131f40 0x7f6174139ca0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.939+0000 7f6179fbc700 1 --2- 172.21.15.146:0/35141214 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f617409e870 0x7f617409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.939+0000 7f6179fbc700 1 -- 172.21.15.146:0/35141214 >> 172.21.15.146:0/35141214 conn(0x7f61740a4430 msgr2=0x7f61740a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.939+0000 7f6179fbc700 1 -- 172.21.15.146:0/35141214 shutdown_connections 2023-10-03T10:13:25.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.939+0000 7f6179fbc700 1 -- 172.21.15.146:0/35141214 wait complete. 2023-10-03T10:13:25.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.940+0000 7f6179fbc700 1 Processor -- start 2023-10-03T10:13:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.940+0000 7f6179fbc700 1 -- start start 2023-10-03T10:13:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.941+0000 7f6179fbc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f617409e870 0x7f617406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.941+0000 7f6179fbc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f617409f180 0x7f617406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.941+0000 7f6179fbc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6174131f40 0x7f617406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.941+0000 7f6179fbc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6174125530 con 0x7f617409e870 2023-10-03T10:13:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.941+0000 7f6179fbc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6174131660 con 0x7f617409f180 2023-10-03T10:13:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.941+0000 7f6179fbc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f617406cca0 con 0x7f6174131f40 2023-10-03T10:13:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.941+0000 7f61737fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f617409e870 0x7f617406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.941+0000 7f61737fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f617409e870 0x7f617406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54862/0 (socket says 172.21.15.146:54862) 2023-10-03T10:13:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.941+0000 7f61737fe700 1 -- 172.21.15.146:0/1178470318 learned_addr learned my addr 172.21.15.146:0/1178470318 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.941+0000 7f6172ffd700 1 --2- 172.21.15.146:0/1178470318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f617409f180 0x7f617406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.941+0000 7f6173fff700 1 --2- 172.21.15.146:0/1178470318 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6174131f40 0x7f617406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.942+0000 7f61737fe700 1 -- 172.21.15.146:0/1178470318 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6174131f40 msgr2=0x7f617406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.942+0000 7f61737fe700 1 --2- 172.21.15.146:0/1178470318 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6174131f40 0x7f617406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.942+0000 7f61737fe700 1 -- 172.21.15.146:0/1178470318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f617409f180 msgr2=0x7f617406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.942+0000 7f61737fe700 1 --2- 172.21.15.146:0/1178470318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f617409f180 0x7f617406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.942+0000 7f61737fe700 1 -- 172.21.15.146:0/1178470318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c009a70 con 0x7f617409e870 2023-10-03T10:13:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.942+0000 7f61737fe700 1 --2- 172.21.15.146:0/1178470318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f617409e870 0x7f617406b8b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f616400e8b0 tx=0x7f616400ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.942+0000 7f615bfff700 1 -- 172.21.15.146:0/1178470318 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6164009600 con 0x7f617409e870 2023-10-03T10:13:25.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.942+0000 7f615bfff700 1 -- 172.21.15.146:0/1178470318 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6164013680 con 0x7f617409e870 2023-10-03T10:13:25.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.942+0000 7f6179fbc700 1 -- 172.21.15.146:0/1178470318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61740a2ce0 con 0x7f617409e870 2023-10-03T10:13:25.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.942+0000 7f615bfff700 1 -- 172.21.15.146:0/1178470318 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6164013a30 con 0x7f617409e870 2023-10-03T10:13:25.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.942+0000 7f6179fbc700 1 -- 172.21.15.146:0/1178470318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6174125a50 con 0x7f617409e870 2023-10-03T10:13:25.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.943+0000 7f615bfff700 1 -- 172.21.15.146:0/1178470318 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6164013b90 con 0x7f617409e870 2023-10-03T10:13:25.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.943+0000 7f615bfff700 1 -- 172.21.15.146:0/1178470318 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f616403f5a0 con 0x7f617409e870 2023-10-03T10:13:25.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.944+0000 7f6179fbc700 1 -- 172.21.15.146:0/1178470318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617404f2a0 con 0x7f617409e870 2023-10-03T10:13:25.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.948+0000 7f615bfff700 1 -- 172.21.15.146:0/1178470318 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6164017080 con 0x7f617409e870 2023-10-03T10:13:25.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.974+0000 7f12c7048700 1 Processor -- start 2023-10-03T10:13:25.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.975+0000 7f12c7048700 1 -- start start 2023-10-03T10:13:25.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.975+0000 7f12c7048700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12c009ad40 0x7f12c0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.975+0000 7f12c7048700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12c01343a0 0x7f12c00a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.975+0000 7f12c7048700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c009b110 con 0x7f12c0133f70 2023-10-03T10:13:25.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.975+0000 7f12c7048700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c00a3b60 con 0x7f12c009ad40 2023-10-03T10:13:25.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.975+0000 7f12c7048700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12c00a2fa0 con 0x7f12c01343a0 2023-10-03T10:13:25.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.975+0000 7f12c55e5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12c01343a0 0x7f12c00a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.975+0000 7f12c55e5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12c01343a0 0x7f12c00a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:60526/0 (socket says 172.21.15.146:60526) 2023-10-03T10:13:25.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.975+0000 7f12c55e5700 1 -- 172.21.15.146:0/2680218743 learned_addr learned my addr 172.21.15.146:0/2680218743 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:25.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.976+0000 7f12c4de4700 1 --2- 172.21.15.146:0/2680218743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12c009ad40 0x7f12c0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.976+0000 7f12bf7fe700 1 -- 172.21.15.146:0/2680218743 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069062391 0 0) 0x7f12c009b110 con 0x7f12c0133f70 2023-10-03T10:13:25.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.976+0000 7f12c55e5700 1 -- 172.21.15.146:0/2680218743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12c009ad40 msgr2=0x7f12c0133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.976+0000 7f12c55e5700 1 --2- 172.21.15.146:0/2680218743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12c009ad40 0x7f12c0133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.976+0000 7f12c55e5700 1 -- 172.21.15.146:0/2680218743 >> v1:172.21.15.146:6789/0 conn(0x7f12c0133f70 legacy=0x7f12c00a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.976+0000 7f12c55e5700 1 -- 172.21.15.146:0/2680218743 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c009a280 con 0x7f12c01343a0 2023-10-03T10:13:25.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.976+0000 7f12c55e5700 1 --2- 172.21.15.146:0/2680218743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12c01343a0 0x7f12c00a1180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f12b8009e80 tx=0x7f12b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bb0847eb4d45c4d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.976+0000 7f12bf7fe700 1 -- 172.21.15.146:0/2680218743 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b800e070 con 0x7f12c01343a0 2023-10-03T10:13:25.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.976+0000 7f12bf7fe700 1 -- 172.21.15.146:0/2680218743 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b800b9c0 con 0x7f12c01343a0 2023-10-03T10:13:25.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.976+0000 7f12bf7fe700 1 -- 172.21.15.146:0/2680218743 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b800bd70 con 0x7f12c01343a0 2023-10-03T10:13:25.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.977+0000 7f12c7048700 1 -- 172.21.15.146:0/2680218743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12c01343a0 msgr2=0x7f12c00a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.977+0000 7f12c7048700 1 --2- 172.21.15.146:0/2680218743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12c01343a0 0x7f12c00a1180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f12b8009e80 tx=0x7f12b800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:25.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.977+0000 7f12c7048700 1 -- 172.21.15.146:0/2680218743 shutdown_connections 2023-10-03T10:13:25.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.977+0000 7f12c7048700 1 --2- 172.21.15.146:0/2680218743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12c01343a0 0x7f12c00a1180 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.977+0000 7f12c7048700 1 --2- 172.21.15.146:0/2680218743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12c009ad40 0x7f12c0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.977+0000 7f12c7048700 1 -- 172.21.15.146:0/2680218743 >> 172.21.15.146:0/2680218743 conn(0x7f12c0099c40 msgr2=0x7f12c006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.977+0000 7f12c7048700 1 -- 172.21.15.146:0/2680218743 shutdown_connections 2023-10-03T10:13:25.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.977+0000 7f12c7048700 1 -- 172.21.15.146:0/2680218743 wait complete. 2023-10-03T10:13:25.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.979+0000 7f12c7048700 1 Processor -- start 2023-10-03T10:13:25.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.979+0000 7f12c7048700 1 -- start start 2023-10-03T10:13:25.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.979+0000 7f12c7048700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12c009ad40 0x7f12c011f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.979+0000 7f12c7048700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12c0133f70 0x7f12c011fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.979+0000 7f12c7048700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12c01343a0 0x7f12c01c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.979+0000 7f12c7048700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c0122150 con 0x7f12c0133f70 2023-10-03T10:13:25.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.979+0000 7f12c7048700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c01227f0 con 0x7f12c009ad40 2023-10-03T10:13:25.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.979+0000 7f12c7048700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12c011f0e0 con 0x7f12c01343a0 2023-10-03T10:13:25.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.980+0000 7f12bffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12c0133f70 0x7f12c011fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.980+0000 7f12bffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12c0133f70 0x7f12c011fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54878/0 (socket says 172.21.15.146:54878) 2023-10-03T10:13:25.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.980+0000 7f12bffff700 1 -- 172.21.15.146:0/1220725707 learned_addr learned my addr 172.21.15.146:0/1220725707 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:25.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.980+0000 7f12c4de4700 1 --2- 172.21.15.146:0/1220725707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12c009ad40 0x7f12c011f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.980+0000 7f12bffff700 1 -- 172.21.15.146:0/1220725707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12c01343a0 msgr2=0x7f12c01c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.980+0000 7f12bffff700 1 --2- 172.21.15.146:0/1220725707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12c01343a0 0x7f12c01c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.980+0000 7f12bffff700 1 -- 172.21.15.146:0/1220725707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12c009ad40 msgr2=0x7f12c011f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.980+0000 7f12bffff700 1 --2- 172.21.15.146:0/1220725707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12c009ad40 0x7f12c011f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.980+0000 7f12bffff700 1 -- 172.21.15.146:0/1220725707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b8009b30 con 0x7f12c0133f70 2023-10-03T10:13:25.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.980+0000 7f12c4de4700 1 --2- 172.21.15.146:0/1220725707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12c009ad40 0x7f12c011f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:25.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.980+0000 7f12bffff700 1 --2- 172.21.15.146:0/1220725707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12c0133f70 0x7f12c011fbc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f12ac00c550 tx=0x7f12ac00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.980+0000 7f12bd7fa700 1 -- 172.21.15.146:0/1220725707 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac0054e0 con 0x7f12c0133f70 2023-10-03T10:13:25.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.981+0000 7f12bd7fa700 1 -- 172.21.15.146:0/1220725707 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac003680 con 0x7f12c0133f70 2023-10-03T10:13:25.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.981+0000 7f12c7048700 1 -- 172.21.15.146:0/1220725707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c009e6f0 con 0x7f12c0133f70 2023-10-03T10:13:25.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.981+0000 7f12bd7fa700 1 -- 172.21.15.146:0/1220725707 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac003a30 con 0x7f12c0133f70 2023-10-03T10:13:25.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.981+0000 7f12c7048700 1 -- 172.21.15.146:0/1220725707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c01207e0 con 0x7f12c0133f70 2023-10-03T10:13:25.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.981+0000 7f12bd7fa700 1 -- 172.21.15.146:0/1220725707 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12ac003b90 con 0x7f12c0133f70 2023-10-03T10:13:25.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.982+0000 7f12bd7fa700 1 -- 172.21.15.146:0/1220725707 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f12ac00f260 con 0x7f12c0133f70 2023-10-03T10:13:25.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.982+0000 7f12c7048700 1 -- 172.21.15.146:0/1220725707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c004f2a0 con 0x7f12c0133f70 2023-10-03T10:13:25.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:25.987+0000 7f12bd7fa700 1 -- 172.21.15.146:0/1220725707 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12ac017070 con 0x7f12c0133f70 2023-10-03T10:13:26.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.058+0000 7f557a08d700 1 -- 172.21.15.146:0/3999455984 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f557411d710 con 0x7f557412d380 2023-10-03T10:13:26.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.058+0000 7f555bfff700 1 -- 172.21.15.146:0/3999455984 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f557411d710 con 0x7f557412d380 2023-10-03T10:13:26.059 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:26.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.061+0000 7f557a08d700 1 -- 172.21.15.146:0/3999455984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f557412d380 msgr2=0x7f557406fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.061+0000 7f557a08d700 1 --2- 172.21.15.146:0/3999455984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f557412d380 0x7f557406fa60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f556400c3c0 tx=0x7f556400c6d0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.061+0000 7f557a08d700 1 -- 172.21.15.146:0/3999455984 shutdown_connections 2023-10-03T10:13:26.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.061+0000 7f557a08d700 1 --2- 172.21.15.146:0/3999455984 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5574135f10 0x7f55741c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.061+0000 7f557a08d700 1 --2- 172.21.15.146:0/3999455984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f557412d380 0x7f557406fa60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.061+0000 7f557a08d700 1 --2- 172.21.15.146:0/3999455984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55741335f0 0x7f557406ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.061+0000 7f557a08d700 1 -- 172.21.15.146:0/3999455984 >> 172.21.15.146:0/3999455984 conn(0x7f55740a2980 msgr2=0x7f5574130260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.061+0000 7f557a08d700 1 -- 172.21.15.146:0/3999455984 shutdown_connections 2023-10-03T10:13:26.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.061+0000 7f557a08d700 1 -- 172.21.15.146:0/3999455984 wait complete. 2023-10-03T10:13:26.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:26.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.107+0000 7f5f70f0d700 1 -- 172.21.15.146:0/3849456073 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5f50005590 con 0x7f5f6c0a1340 2023-10-03T10:13:26.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.108+0000 7f5f5affd700 1 -- 172.21.15.146:0/3849456073 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5f60011360 con 0x7f5f6c0a1340 2023-10-03T10:13:26.108 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:26.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.110+0000 7f5f70f0d700 1 -- 172.21.15.146:0/3849456073 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f6c0a1340 msgr2=0x7f5f6c1c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.110+0000 7f5f70f0d700 1 --2- 172.21.15.146:0/3849456073 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f6c0a1340 0x7f5f6c1c8530 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000c520 tx=0x7f5f6000c830 comp rx=0 tx=0).stop 2023-10-03T10:13:26.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.110+0000 7f5f70f0d700 1 -- 172.21.15.146:0/3849456073 shutdown_connections 2023-10-03T10:13:26.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.110+0000 7f5f70f0d700 1 --2- 172.21.15.146:0/3849456073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f6c130670 0x7f5f6c1c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.110+0000 7f5f70f0d700 1 --2- 172.21.15.146:0/3849456073 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f6c0a0a30 0x7f5f6c1c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.110+0000 7f5f70f0d700 1 --2- 172.21.15.146:0/3849456073 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f6c0a1340 0x7f5f6c1c8530 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.110+0000 7f5f70f0d700 1 -- 172.21.15.146:0/3849456073 >> 172.21.15.146:0/3849456073 conn(0x7f5f6c0a2980 msgr2=0x7f5f6c1b7910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.110+0000 7f5f70f0d700 1 -- 172.21.15.146:0/3849456073 shutdown_connections 2023-10-03T10:13:26.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.110+0000 7f5f70f0d700 1 -- 172.21.15.146:0/3849456073 wait complete. 2023-10-03T10:13:26.123 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:26.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.247+0000 7f6179fbc700 1 -- 172.21.15.146:0/1178470318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f617406b2a0 con 0x7f617409e870 2023-10-03T10:13:26.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.247+0000 7f615bfff700 1 -- 172.21.15.146:0/1178470318 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f616401ba10 con 0x7f617409e870 2023-10-03T10:13:26.250 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:26.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.249+0000 7f6179fbc700 1 -- 172.21.15.146:0/1178470318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f617409e870 msgr2=0x7f617406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.249+0000 7f6179fbc700 1 --2- 172.21.15.146:0/1178470318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f617409e870 0x7f617406b8b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f616400e8b0 tx=0x7f616400ebc0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.250+0000 7f6179fbc700 1 -- 172.21.15.146:0/1178470318 shutdown_connections 2023-10-03T10:13:26.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.250+0000 7f6179fbc700 1 --2- 172.21.15.146:0/1178470318 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6174131f40 0x7f617406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.250+0000 7f6179fbc700 1 --2- 172.21.15.146:0/1178470318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f617409e870 0x7f617406b8b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.250+0000 7f6179fbc700 1 --2- 172.21.15.146:0/1178470318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f617409f180 0x7f617406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.250+0000 7f6179fbc700 1 -- 172.21.15.146:0/1178470318 >> 172.21.15.146:0/1178470318 conn(0x7f61740a4430 msgr2=0x7f6174072210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.250+0000 7f6179fbc700 1 -- 172.21.15.146:0/1178470318 shutdown_connections 2023-10-03T10:13:26.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.250+0000 7f6179fbc700 1 -- 172.21.15.146:0/1178470318 wait complete. 2023-10-03T10:13:26.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:26.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.271+0000 7f12c7048700 1 -- 172.21.15.146:0/1220725707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f12c0122630 con 0x7f12c0133f70 2023-10-03T10:13:26.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.271+0000 7f12bd7fa700 1 -- 172.21.15.146:0/1220725707 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f12c0122630 con 0x7f12c0133f70 2023-10-03T10:13:26.272 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:26.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.273+0000 7f12c7048700 1 -- 172.21.15.146:0/1220725707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12c0133f70 msgr2=0x7f12c011fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.273+0000 7f12c7048700 1 --2- 172.21.15.146:0/1220725707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12c0133f70 0x7f12c011fbc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f12ac00c550 tx=0x7f12ac00c860 comp rx=0 tx=0).stop 2023-10-03T10:13:26.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.273+0000 7f12c7048700 1 -- 172.21.15.146:0/1220725707 shutdown_connections 2023-10-03T10:13:26.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.273+0000 7f12c7048700 1 --2- 172.21.15.146:0/1220725707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12c01343a0 0x7f12c01c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.273+0000 7f12c7048700 1 --2- 172.21.15.146:0/1220725707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12c009ad40 0x7f12c011f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.273+0000 7f12c7048700 1 --2- 172.21.15.146:0/1220725707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12c0133f70 0x7f12c011fbc0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.273+0000 7f12c7048700 1 -- 172.21.15.146:0/1220725707 >> 172.21.15.146:0/1220725707 conn(0x7f12c0099c40 msgr2=0x7f12c009d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.273+0000 7f12c7048700 1 -- 172.21.15.146:0/1220725707 shutdown_connections 2023-10-03T10:13:26.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:26.273+0000 7f12c7048700 1 -- 172.21.15.146:0/1220725707 wait complete. 2023-10-03T10:13:26.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:27.074 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:27.123 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:27.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.211+0000 7f1204cea700 1 Processor -- start 2023-10-03T10:13:27.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.211+0000 7f1204cea700 1 -- start start 2023-10-03T10:13:27.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.211+0000 7f1204cea700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f120009e870 0x7f120009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.211+0000 7f1204cea700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f120009f180 0x7f1200131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.211+0000 7f1204cea700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f120009c970 con 0x7f1200131d70 2023-10-03T10:13:27.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.211+0000 7f1204cea700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12000a0920 con 0x7f120009e870 2023-10-03T10:13:27.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.211+0000 7f1204cea700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f120009f9c0 con 0x7f120009f180 2023-10-03T10:13:27.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.212+0000 7f11fdd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f120009f180 0x7f1200131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.212+0000 7f11fe59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f120009e870 0x7f120009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.212+0000 7f11fed9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1200131d70 0x7f1200138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47984/0 (socket says 172.21.15.146:47984) 2023-10-03T10:13:27.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.212+0000 7f11fed9d700 1 -- 172.21.15.146:0/1264648929 learned_addr learned my addr 172.21.15.146:0/1264648929 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:27.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.212+0000 7f11fdd9b700 1 -- 172.21.15.146:0/1264648929 >> v2:172.21.15.146:3300/0 conn(0x7f120009e870 msgr2=0x7f120009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:27.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.212+0000 7f11fdd9b700 1 --2- 172.21.15.146:0/1264648929 >> v2:172.21.15.146:3300/0 conn(0x7f120009e870 0x7f120009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.212+0000 7f11fdd9b700 1 -- 172.21.15.146:0/1264648929 >> v1:172.21.15.146:6789/0 conn(0x7f1200131d70 legacy=0x7f1200138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.212+0000 7f11fdd9b700 1 -- 172.21.15.146:0/1264648929 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120009bab0 con 0x7f120009f180 2023-10-03T10:13:27.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.212+0000 7f11fe59c700 1 --2- 172.21.15.146:0/1264648929 >> v2:172.21.15.146:3300/0 conn(0x7f120009e870 0x7f120009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:27.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.212+0000 7f11fdd9b700 1 --2- 172.21.15.146:0/1264648929 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f120009f180 0x7f1200131830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f11f4009840 tx=0x7f11f4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5155960ace865a35 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.212+0000 7f11fd59a700 1 -- 172.21.15.146:0/1264648929 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f4011830 con 0x7f120009f180 2023-10-03T10:13:27.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.212+0000 7f11fd59a700 1 -- 172.21.15.146:0/1264648929 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f4011990 con 0x7f120009f180 2023-10-03T10:13:27.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.212+0000 7f11fd59a700 1 -- 172.21.15.146:0/1264648929 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f4011d20 con 0x7f120009f180 2023-10-03T10:13:27.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.213+0000 7f1204cea700 1 -- 172.21.15.146:0/1264648929 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f120009f180 msgr2=0x7f1200131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.213+0000 7f1204cea700 1 --2- 172.21.15.146:0/1264648929 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f120009f180 0x7f1200131830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f11f4009840 tx=0x7f11f4009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:27.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.213+0000 7f1204cea700 1 -- 172.21.15.146:0/1264648929 shutdown_connections 2023-10-03T10:13:27.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.213+0000 7f1204cea700 1 --2- 172.21.15.146:0/1264648929 >> v2:172.21.15.146:3300/0 conn(0x7f120009e870 0x7f120009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.213+0000 7f1204cea700 1 --2- 172.21.15.146:0/1264648929 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f120009f180 0x7f1200131830 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.213+0000 7f1204cea700 1 -- 172.21.15.146:0/1264648929 >> 172.21.15.146:0/1264648929 conn(0x7f12000a4430 msgr2=0x7f12000a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.213+0000 7f1204cea700 1 -- 172.21.15.146:0/1264648929 shutdown_connections 2023-10-03T10:13:27.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.213+0000 7f1204cea700 1 -- 172.21.15.146:0/1264648929 wait complete. 2023-10-03T10:13:27.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.214+0000 7f1204cea700 1 Processor -- start 2023-10-03T10:13:27.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.214+0000 7f1204cea700 1 -- start start 2023-10-03T10:13:27.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.214+0000 7f1204cea700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f120009e870 0x7f120006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.214+0000 7f1204cea700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f120009f180 0x7f120006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.214+0000 7f1204cea700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1200131d70 0x7f120006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.214+0000 7f1204cea700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1200125d40 con 0x7f1200131d70 2023-10-03T10:13:27.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.214+0000 7f1204cea700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120006cd10 con 0x7f120009e870 2023-10-03T10:13:27.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.214+0000 7f1204cea700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1200125f40 con 0x7f120009f180 2023-10-03T10:13:27.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.215+0000 7f11fdd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f120009f180 0x7f120006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.215+0000 7f11fe59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f120009e870 0x7f120006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.215+0000 7f11fdd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f120009f180 0x7f120006bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:60548/0 (socket says 172.21.15.146:60548) 2023-10-03T10:13:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.215+0000 7f11fed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1200131d70 0x7f120006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.215+0000 7f11fdd9b700 1 -- 172.21.15.146:0/2419288226 learned_addr learned my addr 172.21.15.146:0/2419288226 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.215+0000 7f11fdd9b700 1 -- 172.21.15.146:0/2419288226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f120009e870 msgr2=0x7f120006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.215+0000 7f11fdd9b700 1 --2- 172.21.15.146:0/2419288226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f120009e870 0x7f120006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.215+0000 7f11fdd9b700 1 -- 172.21.15.146:0/2419288226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1200131d70 msgr2=0x7f120006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.215+0000 7f11fdd9b700 1 --2- 172.21.15.146:0/2419288226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1200131d70 0x7f120006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.215+0000 7f11fdd9b700 1 -- 172.21.15.146:0/2419288226 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f00094a0 con 0x7f120009f180 2023-10-03T10:13:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.215+0000 7f11fe59c700 1 --2- 172.21.15.146:0/2419288226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f120009e870 0x7f120006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.215+0000 7f11fed9d700 1 --2- 172.21.15.146:0/2419288226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1200131d70 0x7f120006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.215+0000 7f11fdd9b700 1 --2- 172.21.15.146:0/2419288226 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f120009f180 0x7f120006bdf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f11f40090b0 tx=0x7f11f4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.215+0000 7f11eeffd700 1 -- 172.21.15.146:0/2419288226 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f40036a0 con 0x7f120009f180 2023-10-03T10:13:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.215+0000 7f11eeffd700 1 -- 172.21.15.146:0/2419288226 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f401f070 con 0x7f120009f180 2023-10-03T10:13:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.215+0000 7f1204cea700 1 -- 172.21.15.146:0/2419288226 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f40094a0 con 0x7f120009f180 2023-10-03T10:13:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.215+0000 7f11eeffd700 1 -- 172.21.15.146:0/2419288226 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f4003a60 con 0x7f120009f180 2023-10-03T10:13:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.215+0000 7f1204cea700 1 -- 172.21.15.146:0/2419288226 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f120006d430 con 0x7f120009f180 2023-10-03T10:13:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.216+0000 7f11eeffd700 1 -- 172.21.15.146:0/2419288226 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f11f4003bc0 con 0x7f120009f180 2023-10-03T10:13:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.216+0000 7f11eeffd700 1 -- 172.21.15.146:0/2419288226 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f11f4021070 con 0x7f120009f180 2023-10-03T10:13:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.217+0000 7f1204cea700 1 -- 172.21.15.146:0/2419288226 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f120004f2a0 con 0x7f120009f180 2023-10-03T10:13:27.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.221+0000 7f11eeffd700 1 -- 172.21.15.146:0/2419288226 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11f4015080 con 0x7f120009f180 2023-10-03T10:13:27.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.254+0000 7f1ced4f8700 1 Processor -- start 2023-10-03T10:13:27.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.254+0000 7f1ced4f8700 1 -- start start 2023-10-03T10:13:27.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.254+0000 7f1ced4f8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce80a0a70 0x7f1ce80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.254+0000 7f1ced4f8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1ce8134120 0x7f1ce813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.254+0000 7f1ced4f8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce809dc00 con 0x7f1ce80a1380 2023-10-03T10:13:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.254+0000 7f1ced4f8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce809ea60 con 0x7f1ce8134120 2023-10-03T10:13:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.254+0000 7f1ced4f8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce809dec0 con 0x7f1ce80a0a70 2023-10-03T10:13:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.254+0000 7f1ce6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce80a0a70 0x7f1ce80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.254+0000 7f1ce77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1ce8134120 0x7f1ce813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.254+0000 7f1ce67fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1ce80a1380 0x7f1ce8133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47990/0 (socket says 172.21.15.146:47990) 2023-10-03T10:13:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.254+0000 7f1ce6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce80a0a70 0x7f1ce80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42644/0 (socket says 172.21.15.146:42644) 2023-10-03T10:13:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.254+0000 7f1ce67fc700 1 -- 172.21.15.146:0/1187292905 learned_addr learned my addr 172.21.15.146:0/1187292905 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.255+0000 7f1ce6ffd700 1 -- 172.21.15.146:0/1187292905 >> v2:172.21.15.146:3300/0 conn(0x7f1ce8134120 msgr2=0x7f1ce813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.255+0000 7f1ce6ffd700 1 --2- 172.21.15.146:0/1187292905 >> v2:172.21.15.146:3300/0 conn(0x7f1ce8134120 0x7f1ce813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.255+0000 7f1ce6ffd700 1 -- 172.21.15.146:0/1187292905 >> v1:172.21.15.146:6789/0 conn(0x7f1ce80a1380 legacy=0x7f1ce8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.255+0000 7f1ce6ffd700 1 -- 172.21.15.146:0/1187292905 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce809e6a0 con 0x7f1ce80a0a70 2023-10-03T10:13:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.255+0000 7f1ce5ffb700 1 -- 172.21.15.146:0/1187292905 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103734699 0 0) 0x7f1ce809dc00 con 0x7f1ce80a1380 2023-10-03T10:13:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.255+0000 7f1ce77fe700 1 --2- 172.21.15.146:0/1187292905 >> v2:172.21.15.146:3300/0 conn(0x7f1ce8134120 0x7f1ce813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.255+0000 7f1ce6ffd700 1 --2- 172.21.15.146:0/1187292905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce80a0a70 0x7f1ce80a0e40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009840 tx=0x7f1cd8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=912750b093aa04f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.255+0000 7f1ce5ffb700 1 -- 172.21.15.146:0/1187292905 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8011830 con 0x7f1ce80a0a70 2023-10-03T10:13:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.255+0000 7f1ce5ffb700 1 -- 172.21.15.146:0/1187292905 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd8011990 con 0x7f1ce80a0a70 2023-10-03T10:13:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.255+0000 7f1ce5ffb700 1 -- 172.21.15.146:0/1187292905 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8011d20 con 0x7f1ce80a0a70 2023-10-03T10:13:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.255+0000 7f1ced4f8700 1 -- 172.21.15.146:0/1187292905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce80a0a70 msgr2=0x7f1ce80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.255+0000 7f1ced4f8700 1 --2- 172.21.15.146:0/1187292905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce80a0a70 0x7f1ce80a0e40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009840 tx=0x7f1cd8009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.256+0000 7f1ced4f8700 1 -- 172.21.15.146:0/1187292905 shutdown_connections 2023-10-03T10:13:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.256+0000 7f1ced4f8700 1 --2- 172.21.15.146:0/1187292905 >> v2:172.21.15.146:3300/0 conn(0x7f1ce8134120 0x7f1ce813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.256+0000 7f1ced4f8700 1 --2- 172.21.15.146:0/1187292905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce80a0a70 0x7f1ce80a0e40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.256+0000 7f1ced4f8700 1 -- 172.21.15.146:0/1187292905 >> 172.21.15.146:0/1187292905 conn(0x7f1ce80a6610 msgr2=0x7f1ce80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.256+0000 7f1ced4f8700 1 -- 172.21.15.146:0/1187292905 shutdown_connections 2023-10-03T10:13:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.256+0000 7f1ced4f8700 1 -- 172.21.15.146:0/1187292905 wait complete. 2023-10-03T10:13:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.257+0000 7f1ced4f8700 1 Processor -- start 2023-10-03T10:13:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.257+0000 7f1ced4f8700 1 -- start start 2023-10-03T10:13:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.257+0000 7f1ced4f8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce80a0a70 0x7f1ce8122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.257+0000 7f1ced4f8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ce80a1380 0x7f1ce8122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.257+0000 7f1ced4f8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ce8134120 0x7f1ce8123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.257+0000 7f1ced4f8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce8133300 con 0x7f1ce8134120 2023-10-03T10:13:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.257+0000 7f1ced4f8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce8125aa0 con 0x7f1ce80a0a70 2023-10-03T10:13:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.257+0000 7f1ced4f8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce8133650 con 0x7f1ce80a1380 2023-10-03T10:13:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.257+0000 7f1ce77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ce8134120 0x7f1ce8123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.257+0000 7f1ce6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce80a0a70 0x7f1ce8122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.257+0000 7f1ce77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ce8134120 0x7f1ce8123210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54916/0 (socket says 172.21.15.146:54916) 2023-10-03T10:13:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.257+0000 7f1ce77fe700 1 -- 172.21.15.146:0/3864000949 learned_addr learned my addr 172.21.15.146:0/3864000949 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.257+0000 7f1ce67fc700 1 --2- 172.21.15.146:0/3864000949 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ce80a1380 0x7f1ce8122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.257+0000 7f1ce77fe700 1 -- 172.21.15.146:0/3864000949 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ce80a1380 msgr2=0x7f1ce8122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.257+0000 7f1ce77fe700 1 --2- 172.21.15.146:0/3864000949 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ce80a1380 0x7f1ce8122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.257+0000 7f1ce77fe700 1 -- 172.21.15.146:0/3864000949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce80a0a70 msgr2=0x7f1ce8122790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.257+0000 7f1ce77fe700 1 --2- 172.21.15.146:0/3864000949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce80a0a70 0x7f1ce8122790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.257+0000 7f1ce77fe700 1 -- 172.21.15.146:0/3864000949 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce0009a70 con 0x7f1ce8134120 2023-10-03T10:13:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.258+0000 7f1ce67fc700 1 --2- 172.21.15.146:0/3864000949 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ce80a1380 0x7f1ce8122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.258+0000 7f1ce6ffd700 1 --2- 172.21.15.146:0/3864000949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce80a0a70 0x7f1ce8122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.258+0000 7f1ce77fe700 1 --2- 172.21.15.146:0/3864000949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ce8134120 0x7f1ce8123210 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000efc0 tx=0x7f1ce000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.258+0000 7f1ccf7fe700 1 -- 172.21.15.146:0/3864000949 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce000ca90 con 0x7f1ce8134120 2023-10-03T10:13:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.258+0000 7f1ccf7fe700 1 -- 172.21.15.146:0/3864000949 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce000f040 con 0x7f1ce8134120 2023-10-03T10:13:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.258+0000 7f1ccf7fe700 1 -- 172.21.15.146:0/3864000949 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce000ce10 con 0x7f1ce8134120 2023-10-03T10:13:27.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.258+0000 7f1ced4f8700 1 -- 172.21.15.146:0/3864000949 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd80094a0 con 0x7f1ce8134120 2023-10-03T10:13:27.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.258+0000 7f1ced4f8700 1 -- 172.21.15.146:0/3864000949 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce8133990 con 0x7f1ce8134120 2023-10-03T10:13:27.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.259+0000 7f1ced4f8700 1 -- 172.21.15.146:0/3864000949 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce8125e60 con 0x7f1ce8134120 2023-10-03T10:13:27.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.259+0000 7f1ccf7fe700 1 -- 172.21.15.146:0/3864000949 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ce0003a20 con 0x7f1ce8134120 2023-10-03T10:13:27.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.259+0000 7f1ccf7fe700 1 -- 172.21.15.146:0/3864000949 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1ce0040780 con 0x7f1ce8134120 2023-10-03T10:13:27.263 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:27.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.268+0000 7f1ccf7fe700 1 -- 172.21.15.146:0/3864000949 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ce001c3b0 con 0x7f1ce8134120 2023-10-03T10:13:27.286 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.389+0000 7f3511325700 1 Processor -- start 2023-10-03T10:13:27.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.389+0000 7f3511325700 1 -- start start 2023-10-03T10:13:27.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.390+0000 7f3511325700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f350c133ad0 0x7f350c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.390+0000 7f3511325700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f350c1300a0 0x7f350c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.390+0000 7f3511325700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f350c1309f0 0x7f350c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.390+0000 7f3511325700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f350c06b2d0 con 0x7f350c1300a0 2023-10-03T10:13:27.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.390+0000 7f3511325700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350c133610 con 0x7f350c1309f0 2023-10-03T10:13:27.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.390+0000 7f3511325700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f350c09a500 con 0x7f350c133ad0 2023-10-03T10:13:27.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.390+0000 7f350affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f350c133ad0 0x7f350c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.390+0000 7f350b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f350c1309f0 0x7f350c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.390+0000 7f350affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f350c133ad0 0x7f350c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:60568/0 (socket says 172.21.15.146:60568) 2023-10-03T10:13:27.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.390+0000 7f350affd700 1 -- 172.21.15.146:0/3893693061 learned_addr learned my addr 172.21.15.146:0/3893693061 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:27.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.390+0000 7f350a7fc700 1 --2- 172.21.15.146:0/3893693061 >> v2:172.21.15.146:3300/0 conn(0x7f350c1300a0 0x7f350c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.390+0000 7f350affd700 1 -- 172.21.15.146:0/3893693061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f350c1309f0 msgr2=0x7f350c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:27.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.390+0000 7f350affd700 1 --2- 172.21.15.146:0/3893693061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f350c1309f0 0x7f350c13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.390+0000 7f350affd700 1 -- 172.21.15.146:0/3893693061 >> v2:172.21.15.146:3300/0 conn(0x7f350c1300a0 msgr2=0x7f350c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:27.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.390+0000 7f350affd700 1 --2- 172.21.15.146:0/3893693061 >> v2:172.21.15.146:3300/0 conn(0x7f350c1300a0 0x7f350c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.390+0000 7f350affd700 1 -- 172.21.15.146:0/3893693061 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c1338b0 con 0x7f350c133ad0 2023-10-03T10:13:27.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.391+0000 7f350affd700 1 --2- 172.21.15.146:0/3893693061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f350c133ad0 0x7f350c133ea0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0098f0 tx=0x7f34fc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9d1ee358397fdf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.391+0000 7f3509ffb700 1 -- 172.21.15.146:0/3893693061 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc011830 con 0x7f350c133ad0 2023-10-03T10:13:27.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.391+0000 7f3509ffb700 1 -- 172.21.15.146:0/3893693061 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34fc011990 con 0x7f350c133ad0 2023-10-03T10:13:27.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.391+0000 7f3509ffb700 1 -- 172.21.15.146:0/3893693061 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc011d20 con 0x7f350c133ad0 2023-10-03T10:13:27.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.391+0000 7f3511325700 1 -- 172.21.15.146:0/3893693061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f350c133ad0 msgr2=0x7f350c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.391+0000 7f3511325700 1 --2- 172.21.15.146:0/3893693061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f350c133ad0 0x7f350c133ea0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0098f0 tx=0x7f34fc009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:27.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.391+0000 7f3511325700 1 -- 172.21.15.146:0/3893693061 shutdown_connections 2023-10-03T10:13:27.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.391+0000 7f3511325700 1 --2- 172.21.15.146:0/3893693061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f350c1309f0 0x7f350c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.391+0000 7f3511325700 1 --2- 172.21.15.146:0/3893693061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f350c133ad0 0x7f350c133ea0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.391+0000 7f3511325700 1 --2- 172.21.15.146:0/3893693061 >> v2:172.21.15.146:3300/0 conn(0x7f350c1300a0 0x7f350c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.391+0000 7f3511325700 1 -- 172.21.15.146:0/3893693061 >> 172.21.15.146:0/3893693061 conn(0x7f350c099c40 msgr2=0x7f350c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.392+0000 7f3511325700 1 -- 172.21.15.146:0/3893693061 shutdown_connections 2023-10-03T10:13:27.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.392+0000 7f3511325700 1 -- 172.21.15.146:0/3893693061 wait complete. 2023-10-03T10:13:27.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.393+0000 7f3511325700 1 Processor -- start 2023-10-03T10:13:27.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.393+0000 7f3511325700 1 -- start start 2023-10-03T10:13:27.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.393+0000 7f3511325700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f350c1300a0 0x7f350c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.393+0000 7f3511325700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f350c1309f0 0x7f350c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.393+0000 7f3511325700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f350c133ad0 0x7f350c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.393+0000 7f3511325700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c11fde0 con 0x7f350c1300a0 2023-10-03T10:13:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.393+0000 7f3511325700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350c0a3350 con 0x7f350c1309f0 2023-10-03T10:13:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.393+0000 7f3511325700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f350c12dd00 con 0x7f350c133ad0 2023-10-03T10:13:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.393+0000 7f350b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f350c133ad0 0x7f350c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.394+0000 7f350affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f350c1300a0 0x7f350c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.394+0000 7f350b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f350c133ad0 0x7f350c11e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:60576/0 (socket says 172.21.15.146:60576) 2023-10-03T10:13:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.394+0000 7f350affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f350c1300a0 0x7f350c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54944/0 (socket says 172.21.15.146:54944) 2023-10-03T10:13:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.394+0000 7f350b7fe700 1 -- 172.21.15.146:0/3110403148 learned_addr learned my addr 172.21.15.146:0/3110403148 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.394+0000 7f350a7fc700 1 --2- 172.21.15.146:0/3110403148 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f350c1309f0 0x7f350c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.394+0000 7f350affd700 1 -- 172.21.15.146:0/3110403148 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f350c133ad0 msgr2=0x7f350c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.394+0000 7f350affd700 1 --2- 172.21.15.146:0/3110403148 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f350c133ad0 0x7f350c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.394+0000 7f350affd700 1 -- 172.21.15.146:0/3110403148 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f350c1309f0 msgr2=0x7f350c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.394+0000 7f350affd700 1 --2- 172.21.15.146:0/3110403148 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f350c1309f0 0x7f350c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.394+0000 7f350affd700 1 -- 172.21.15.146:0/3110403148 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc009550 con 0x7f350c1300a0 2023-10-03T10:13:27.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.394+0000 7f350b7fe700 1 --2- 172.21.15.146:0/3110403148 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f350c133ad0 0x7f350c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:27.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.394+0000 7f350affd700 1 --2- 172.21.15.146:0/3110403148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f350c1300a0 0x7f350c11da40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f34fc016000 tx=0x7f34fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.394+0000 7f34f37fe700 1 -- 172.21.15.146:0/3110403148 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc004450 con 0x7f350c1300a0 2023-10-03T10:13:27.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.394+0000 7f34f37fe700 1 -- 172.21.15.146:0/3110403148 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34fc0045d0 con 0x7f350c1300a0 2023-10-03T10:13:27.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.394+0000 7f3511325700 1 -- 172.21.15.146:0/3110403148 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350c1200c0 con 0x7f350c1300a0 2023-10-03T10:13:27.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.394+0000 7f34f37fe700 1 -- 172.21.15.146:0/3110403148 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc0038e0 con 0x7f350c1300a0 2023-10-03T10:13:27.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.394+0000 7f3511325700 1 -- 172.21.15.146:0/3110403148 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f350c11f850 con 0x7f350c1300a0 2023-10-03T10:13:27.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.395+0000 7f34f37fe700 1 -- 172.21.15.146:0/3110403148 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f34fc003a40 con 0x7f350c1300a0 2023-10-03T10:13:27.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.395+0000 7f3511325700 1 -- 172.21.15.146:0/3110403148 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350c11f490 con 0x7f350c1300a0 2023-10-03T10:13:27.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.396+0000 7f34f37fe700 1 -- 172.21.15.146:0/3110403148 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f34fc040570 con 0x7f350c1300a0 2023-10-03T10:13:27.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.404+0000 7f34f37fe700 1 -- 172.21.15.146:0/3110403148 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f34fc01a420 con 0x7f350c1300a0 2023-10-03T10:13:27.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.415+0000 7ff9d37a3700 1 Processor -- start 2023-10-03T10:13:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.415+0000 7ff9d37a3700 1 -- start start 2023-10-03T10:13:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.416+0000 7ff9d37a3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9cc09e870 0x7ff9cc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.416+0000 7ff9d37a3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff9cc09f180 0x7ff9cc133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.416+0000 7ff9d37a3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9cc06bec0 con 0x7ff9cc1341d0 2023-10-03T10:13:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.416+0000 7ff9d37a3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9cc06ce60 con 0x7ff9cc09f180 2023-10-03T10:13:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.416+0000 7ff9d37a3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc09fa00 con 0x7ff9cc09e870 2023-10-03T10:13:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.416+0000 7ff9d153f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9cc09e870 0x7ff9cc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.416+0000 7ff9d153f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9cc09e870 0x7ff9cc09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:60586/0 (socket says 172.21.15.146:60586) 2023-10-03T10:13:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.416+0000 7ff9d153f700 1 -- 172.21.15.146:0/299736020 learned_addr learned my addr 172.21.15.146:0/299736020 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.416+0000 7ff9d0d3e700 1 --2- 172.21.15.146:0/299736020 >> v2:172.21.15.146:3300/0 conn(0x7ff9cc09f180 0x7ff9cc133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.416+0000 7ff9d153f700 1 -- 172.21.15.146:0/299736020 >> v2:172.21.15.146:3300/0 conn(0x7ff9cc09f180 msgr2=0x7ff9cc133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.416+0000 7ff9d153f700 1 --2- 172.21.15.146:0/299736020 >> v2:172.21.15.146:3300/0 conn(0x7ff9cc09f180 0x7ff9cc133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.416+0000 7ff9d153f700 1 -- 172.21.15.146:0/299736020 >> v1:172.21.15.146:6789/0 conn(0x7ff9cc1341d0 legacy=0x7ff9cc13af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.416+0000 7ff9d153f700 1 -- 172.21.15.146:0/299736020 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc09ad80 con 0x7ff9cc09e870 2023-10-03T10:13:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.416+0000 7ff9d153f700 1 --2- 172.21.15.146:0/299736020 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9cc09e870 0x7ff9cc09ec40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80098f0 tx=0x7ff9c8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93672e74689b6deb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.417+0000 7ff9c3fff700 1 -- 172.21.15.146:0/299736020 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8011830 con 0x7ff9cc09e870 2023-10-03T10:13:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.417+0000 7ff9c3fff700 1 -- 172.21.15.146:0/299736020 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c8011990 con 0x7ff9cc09e870 2023-10-03T10:13:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.417+0000 7ff9c3fff700 1 -- 172.21.15.146:0/299736020 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8011d20 con 0x7ff9cc09e870 2023-10-03T10:13:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.417+0000 7ff9d37a3700 1 -- 172.21.15.146:0/299736020 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9cc09e870 msgr2=0x7ff9cc09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.417+0000 7ff9d37a3700 1 --2- 172.21.15.146:0/299736020 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9cc09e870 0x7ff9cc09ec40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80098f0 tx=0x7ff9c8009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.417+0000 7ff9d37a3700 1 -- 172.21.15.146:0/299736020 shutdown_connections 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.417+0000 7ff9d37a3700 1 --2- 172.21.15.146:0/299736020 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9cc09e870 0x7ff9cc09ec40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.417+0000 7ff9d37a3700 1 --2- 172.21.15.146:0/299736020 >> v2:172.21.15.146:3300/0 conn(0x7ff9cc09f180 0x7ff9cc133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.417+0000 7ff9d37a3700 1 -- 172.21.15.146:0/299736020 >> 172.21.15.146:0/299736020 conn(0x7ff9cc0a4430 msgr2=0x7ff9cc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.417+0000 7ff9d37a3700 1 -- 172.21.15.146:0/299736020 shutdown_connections 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.417+0000 7ff9d37a3700 1 -- 172.21.15.146:0/299736020 wait complete. 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.418+0000 7ff9d37a3700 1 Processor -- start 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.418+0000 7ff9d37a3700 1 -- start start 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.419+0000 7ff9d37a3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9cc09e870 0x7ff9cc122c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.419+0000 7ff9d37a3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9cc09f180 0x7ff9cc123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.419+0000 7ff9d37a3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9cc1341d0 0x7ff9cc1236c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.419+0000 7ff9d37a3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc06fcc0 con 0x7ff9cc09f180 2023-10-03T10:13:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.419+0000 7ff9d37a3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc1272a0 con 0x7ff9cc1341d0 2023-10-03T10:13:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.419+0000 7ff9d37a3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc126900 con 0x7ff9cc09e870 2023-10-03T10:13:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.419+0000 7ff9d153f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9cc09e870 0x7ff9cc122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.419+0000 7ff9d153f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9cc09e870 0x7ff9cc122c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:60596/0 (socket says 172.21.15.146:60596) 2023-10-03T10:13:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.419+0000 7ff9d153f700 1 -- 172.21.15.146:0/306419586 learned_addr learned my addr 172.21.15.146:0/306419586 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.419+0000 7ff9d0d3e700 1 --2- 172.21.15.146:0/306419586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9cc09f180 0x7ff9cc123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.419+0000 7ff9d153f700 1 -- 172.21.15.146:0/306419586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9cc1341d0 msgr2=0x7ff9cc1236c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.419+0000 7ff9d153f700 1 --2- 172.21.15.146:0/306419586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9cc1341d0 0x7ff9cc1236c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.419+0000 7ff9d153f700 1 -- 172.21.15.146:0/306419586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9cc09f180 msgr2=0x7ff9cc123180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.419+0000 7ff9d153f700 1 --2- 172.21.15.146:0/306419586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9cc09f180 0x7ff9cc123180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.419+0000 7ff9d153f700 1 -- 172.21.15.146:0/306419586 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c8009550 con 0x7ff9cc09e870 2023-10-03T10:13:27.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.419+0000 7ff9d0d3e700 1 --2- 172.21.15.146:0/306419586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9cc09f180 0x7ff9cc123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:27.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.419+0000 7ff9d153f700 1 --2- 172.21.15.146:0/306419586 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9cc09e870 0x7ff9cc122c40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8000c00 tx=0x7ff9c8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:27.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.419+0000 7ff9c1ffb700 1 -- 172.21.15.146:0/306419586 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8004570 con 0x7ff9cc09e870 2023-10-03T10:13:27.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.419+0000 7ff9c1ffb700 1 -- 172.21.15.146:0/306419586 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c801f070 con 0x7ff9cc09e870 2023-10-03T10:13:27.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.419+0000 7ff9c1ffb700 1 -- 172.21.15.146:0/306419586 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c80038c0 con 0x7ff9cc09e870 2023-10-03T10:13:27.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.419+0000 7ff9d37a3700 1 -- 172.21.15.146:0/306419586 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9cc1263e0 con 0x7ff9cc09e870 2023-10-03T10:13:27.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.420+0000 7ff9d37a3700 1 -- 172.21.15.146:0/306419586 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9cc126e50 con 0x7ff9cc09e870 2023-10-03T10:13:27.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.420+0000 7ff9c1ffb700 1 -- 172.21.15.146:0/306419586 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff9c8021030 con 0x7ff9cc09e870 2023-10-03T10:13:27.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.421+0000 7ff9c1ffb700 1 -- 172.21.15.146:0/306419586 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff9c8040bd0 con 0x7ff9cc09e870 2023-10-03T10:13:27.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.421+0000 7ff9d37a3700 1 -- 172.21.15.146:0/306419586 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9cc126220 con 0x7ff9cc09e870 2023-10-03T10:13:27.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.425+0000 7ff9c1ffb700 1 -- 172.21.15.146:0/306419586 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff9c8015070 con 0x7ff9cc09e870 2023-10-03T10:13:27.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.427+0000 7f1204cea700 1 -- 172.21.15.146:0/2419288226 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1200124a20 con 0x7f120009f180 2023-10-03T10:13:27.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.428+0000 7f11eeffd700 1 -- 172.21.15.146:0/2419288226 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f11f4035090 con 0x7f120009f180 2023-10-03T10:13:27.428 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:27.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.430+0000 7f1204cea700 1 -- 172.21.15.146:0/2419288226 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f120009f180 msgr2=0x7f120006bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.430+0000 7f1204cea700 1 --2- 172.21.15.146:0/2419288226 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f120009f180 0x7f120006bdf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f11f40090b0 tx=0x7f11f4004750 comp rx=0 tx=0).stop 2023-10-03T10:13:27.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.430+0000 7f1204cea700 1 -- 172.21.15.146:0/2419288226 shutdown_connections 2023-10-03T10:13:27.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.430+0000 7f1204cea700 1 --2- 172.21.15.146:0/2419288226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1200131d70 0x7f120006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.430+0000 7f1204cea700 1 --2- 172.21.15.146:0/2419288226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f120009e870 0x7f120006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.430+0000 7f1204cea700 1 --2- 172.21.15.146:0/2419288226 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f120009f180 0x7f120006bdf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.430+0000 7f1204cea700 1 -- 172.21.15.146:0/2419288226 >> 172.21.15.146:0/2419288226 conn(0x7f12000a4430 msgr2=0x7f12000a0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.430+0000 7f1204cea700 1 -- 172.21.15.146:0/2419288226 shutdown_connections 2023-10-03T10:13:27.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.430+0000 7f1204cea700 1 -- 172.21.15.146:0/2419288226 wait complete. 2023-10-03T10:13:27.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:27.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.503+0000 7f1ced4f8700 1 -- 172.21.15.146:0/3864000949 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1ce804f2a0 con 0x7f1ce8134120 2023-10-03T10:13:27.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.503+0000 7f1ccf7fe700 1 -- 172.21.15.146:0/3864000949 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1ce002b090 con 0x7f1ce8134120 2023-10-03T10:13:27.504 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:27.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.505+0000 7f1ced4f8700 1 -- 172.21.15.146:0/3864000949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ce8134120 msgr2=0x7f1ce8123210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.505+0000 7f1ced4f8700 1 --2- 172.21.15.146:0/3864000949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ce8134120 0x7f1ce8123210 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000efc0 tx=0x7f1ce000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.505+0000 7f1ced4f8700 1 -- 172.21.15.146:0/3864000949 shutdown_connections 2023-10-03T10:13:27.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.505+0000 7f1ced4f8700 1 --2- 172.21.15.146:0/3864000949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ce8134120 0x7f1ce8123210 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.505+0000 7f1ced4f8700 1 --2- 172.21.15.146:0/3864000949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce80a0a70 0x7f1ce8122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.505+0000 7f1ced4f8700 1 --2- 172.21.15.146:0/3864000949 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ce80a1380 0x7f1ce8122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.505+0000 7f1ced4f8700 1 -- 172.21.15.146:0/3864000949 >> 172.21.15.146:0/3864000949 conn(0x7f1ce80a6610 msgr2=0x7f1ce80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.505+0000 7f1ced4f8700 1 -- 172.21.15.146:0/3864000949 shutdown_connections 2023-10-03T10:13:27.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.505+0000 7f1ced4f8700 1 -- 172.21.15.146:0/3864000949 wait complete. 2023-10-03T10:13:27.518 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:27.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.620+0000 7ff9d37a3700 1 -- 172.21.15.146:0/306419586 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff9cc04f2a0 con 0x7ff9cc09e870 2023-10-03T10:13:27.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.620+0000 7ff9c1ffb700 1 -- 172.21.15.146:0/306419586 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff9c801a7d0 con 0x7ff9cc09e870 2023-10-03T10:13:27.621 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:27.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.622+0000 7ff9d37a3700 1 -- 172.21.15.146:0/306419586 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9cc09e870 msgr2=0x7ff9cc122c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.622+0000 7ff9d37a3700 1 --2- 172.21.15.146:0/306419586 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9cc09e870 0x7ff9cc122c40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8000c00 tx=0x7ff9c8004750 comp rx=0 tx=0).stop 2023-10-03T10:13:27.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.622+0000 7ff9d37a3700 1 -- 172.21.15.146:0/306419586 shutdown_connections 2023-10-03T10:13:27.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.622+0000 7ff9d37a3700 1 --2- 172.21.15.146:0/306419586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9cc1341d0 0x7ff9cc1236c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.622+0000 7ff9d37a3700 1 --2- 172.21.15.146:0/306419586 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9cc09e870 0x7ff9cc122c40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.622+0000 7ff9d37a3700 1 --2- 172.21.15.146:0/306419586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9cc09f180 0x7ff9cc123180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.622+0000 7ff9d37a3700 1 -- 172.21.15.146:0/306419586 >> 172.21.15.146:0/306419586 conn(0x7ff9cc0a4430 msgr2=0x7ff9cc071010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.623+0000 7ff9d37a3700 1 -- 172.21.15.146:0/306419586 shutdown_connections 2023-10-03T10:13:27.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.623+0000 7ff9d37a3700 1 -- 172.21.15.146:0/306419586 wait complete. 2023-10-03T10:13:27.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.626+0000 7f3511325700 1 -- 172.21.15.146:0/3110403148 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f350c04f2a0 con 0x7f350c1300a0 2023-10-03T10:13:27.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.627+0000 7f34f37fe700 1 -- 172.21.15.146:0/3110403148 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f34fc028090 con 0x7f350c1300a0 2023-10-03T10:13:27.627 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:27.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.629+0000 7f3511325700 1 -- 172.21.15.146:0/3110403148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f350c1300a0 msgr2=0x7f350c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.629+0000 7f3511325700 1 --2- 172.21.15.146:0/3110403148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f350c1300a0 0x7f350c11da40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f34fc016000 tx=0x7f34fc004750 comp rx=0 tx=0).stop 2023-10-03T10:13:27.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.629+0000 7f3511325700 1 -- 172.21.15.146:0/3110403148 shutdown_connections 2023-10-03T10:13:27.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.629+0000 7f3511325700 1 --2- 172.21.15.146:0/3110403148 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f350c133ad0 0x7f350c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.629+0000 7f3511325700 1 --2- 172.21.15.146:0/3110403148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f350c1300a0 0x7f350c11da40 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.629+0000 7f3511325700 1 --2- 172.21.15.146:0/3110403148 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f350c1309f0 0x7f350c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.629+0000 7f3511325700 1 -- 172.21.15.146:0/3110403148 >> 172.21.15.146:0/3110403148 conn(0x7f350c099c40 msgr2=0x7f350c12e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.629+0000 7f3511325700 1 -- 172.21.15.146:0/3110403148 shutdown_connections 2023-10-03T10:13:27.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:27.629+0000 7f3511325700 1 -- 172.21.15.146:0/3110403148 wait complete. 2023-10-03T10:13:27.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:27.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:28.444 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:28.519 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:28.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.580+0000 7f0f564fd700 1 Processor -- start 2023-10-03T10:13:28.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.580+0000 7f0f564fd700 1 -- start start 2023-10-03T10:13:28.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.580+0000 7f0f564fd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f5009ad40 0x7f0f50133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.580+0000 7f0f564fd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0f50133f70 0x7f0f501343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.580+0000 7f0f564fd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5009b110 con 0x7f0f500a0a70 2023-10-03T10:13:28.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.580+0000 7f0f564fd700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f500a3b60 con 0x7f0f50133f70 2023-10-03T10:13:28.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.580+0000 7f0f564fd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f501348e0 con 0x7f0f5009ad40 2023-10-03T10:13:28.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.581+0000 7f0f4f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0f50133f70 0x7f0f501343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.581+0000 7f0f4ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f5009ad40 0x7f0f50133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.581+0000 7f0f54a9a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0f500a0a70 0x7f0f500a0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48002/0 (socket says 172.21.15.146:48002) 2023-10-03T10:13:28.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.581+0000 7f0f4ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f5009ad40 0x7f0f50133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:60598/0 (socket says 172.21.15.146:60598) 2023-10-03T10:13:28.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.581+0000 7f0f4f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0f50133f70 0x7f0f501343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54976/0 (socket says 172.21.15.146:54976) 2023-10-03T10:13:28.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.581+0000 7f0f54a9a700 1 -- 172.21.15.146:0/1692880043 learned_addr learned my addr 172.21.15.146:0/1692880043 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:28.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.581+0000 7f0f4f7fe700 1 -- 172.21.15.146:0/1692880043 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f5009ad40 msgr2=0x7f0f50133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.581+0000 7f0f4f7fe700 1 --2- 172.21.15.146:0/1692880043 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f5009ad40 0x7f0f50133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.581+0000 7f0f4f7fe700 1 -- 172.21.15.146:0/1692880043 >> v1:172.21.15.146:6789/0 conn(0x7f0f500a0a70 legacy=0x7f0f500a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.581+0000 7f0f4effd700 1 -- 172.21.15.146:0/1692880043 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075251996 0 0) 0x7f0f5009b110 con 0x7f0f500a0a70 2023-10-03T10:13:28.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.581+0000 7f0f4f7fe700 1 -- 172.21.15.146:0/1692880043 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f500a2fa0 con 0x7f0f50133f70 2023-10-03T10:13:28.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.581+0000 7f0f4ffff700 1 --2- 172.21.15.146:0/1692880043 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f5009ad40 0x7f0f50133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:28.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.581+0000 7f0f4f7fe700 1 --2- 172.21.15.146:0/1692880043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f50133f70 0x7f0f501343a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009840 tx=0x7f0f44009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d089db865332aec7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.581+0000 7f0f4effd700 1 -- 172.21.15.146:0/1692880043 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f44011830 con 0x7f0f50133f70 2023-10-03T10:13:28.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.581+0000 7f0f4effd700 1 -- 172.21.15.146:0/1692880043 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f44011990 con 0x7f0f50133f70 2023-10-03T10:13:28.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.581+0000 7f0f4effd700 1 -- 172.21.15.146:0/1692880043 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f44011d20 con 0x7f0f50133f70 2023-10-03T10:13:28.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.582+0000 7f0f564fd700 1 -- 172.21.15.146:0/1692880043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f50133f70 msgr2=0x7f0f501343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.582+0000 7f0f564fd700 1 --2- 172.21.15.146:0/1692880043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f50133f70 0x7f0f501343a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009840 tx=0x7f0f44009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:28.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.582+0000 7f0f564fd700 1 -- 172.21.15.146:0/1692880043 shutdown_connections 2023-10-03T10:13:28.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.582+0000 7f0f564fd700 1 --2- 172.21.15.146:0/1692880043 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f5009ad40 0x7f0f50133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.582+0000 7f0f564fd700 1 --2- 172.21.15.146:0/1692880043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f50133f70 0x7f0f501343a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.582+0000 7f0f564fd700 1 -- 172.21.15.146:0/1692880043 >> 172.21.15.146:0/1692880043 conn(0x7f0f50099c40 msgr2=0x7f0f5006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.582+0000 7f0f564fd700 1 -- 172.21.15.146:0/1692880043 shutdown_connections 2023-10-03T10:13:28.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.582+0000 7f0f564fd700 1 -- 172.21.15.146:0/1692880043 wait complete. 2023-10-03T10:13:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.583+0000 7f0f564fd700 1 Processor -- start 2023-10-03T10:13:28.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.583+0000 7f0f564fd700 1 -- start start 2023-10-03T10:13:28.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.583+0000 7f0f564fd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f5009ad40 0x7f0f50121230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.583+0000 7f0f564fd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f500a0a70 0x7f0f50121770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.583+0000 7f0f564fd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f50133f70 0x7f0f50121cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.583+0000 7f0f564fd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f50125710 con 0x7f0f500a0a70 2023-10-03T10:13:28.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.583+0000 7f0f564fd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f50124d50 con 0x7f0f5009ad40 2023-10-03T10:13:28.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.583+0000 7f0f564fd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5009e680 con 0x7f0f50133f70 2023-10-03T10:13:28.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.584+0000 7f0f4f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f500a0a70 0x7f0f50121770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.584+0000 7f0f54a9a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f50133f70 0x7f0f50121cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.584+0000 7f0f4f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f500a0a70 0x7f0f50121770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54990/0 (socket says 172.21.15.146:54990) 2023-10-03T10:13:28.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.584+0000 7f0f4f7fe700 1 -- 172.21.15.146:0/2708992949 learned_addr learned my addr 172.21.15.146:0/2708992949 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:28.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.584+0000 7f0f54a9a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f50133f70 0x7f0f50121cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:60602/0 (socket says 172.21.15.146:60602) 2023-10-03T10:13:28.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.584+0000 7f0f4ffff700 1 --2- 172.21.15.146:0/2708992949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f5009ad40 0x7f0f50121230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.584+0000 7f0f4f7fe700 1 -- 172.21.15.146:0/2708992949 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f50133f70 msgr2=0x7f0f50121cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.584+0000 7f0f4f7fe700 1 --2- 172.21.15.146:0/2708992949 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f50133f70 0x7f0f50121cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.584+0000 7f0f4f7fe700 1 -- 172.21.15.146:0/2708992949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f5009ad40 msgr2=0x7f0f50121230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.584+0000 7f0f4f7fe700 1 --2- 172.21.15.146:0/2708992949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f5009ad40 0x7f0f50121230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.584+0000 7f0f4f7fe700 1 -- 172.21.15.146:0/2708992949 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f400094a0 con 0x7f0f500a0a70 2023-10-03T10:13:28.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.584+0000 7f0f54a9a700 1 --2- 172.21.15.146:0/2708992949 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f50133f70 0x7f0f50121cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:28.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.584+0000 7f0f4ffff700 1 --2- 172.21.15.146:0/2708992949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f5009ad40 0x7f0f50121230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:28.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.584+0000 7f0f4f7fe700 1 --2- 172.21.15.146:0/2708992949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f500a0a70 0x7f0f50121770 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009fd0 tx=0x7f0f44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.584+0000 7f0f4cff9700 1 -- 172.21.15.146:0/2708992949 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f440045d0 con 0x7f0f500a0a70 2023-10-03T10:13:28.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.584+0000 7f0f4cff9700 1 -- 172.21.15.146:0/2708992949 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4401f070 con 0x7f0f500a0a70 2023-10-03T10:13:28.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.584+0000 7f0f564fd700 1 -- 172.21.15.146:0/2708992949 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f440094a0 con 0x7f0f500a0a70 2023-10-03T10:13:28.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.584+0000 7f0f4cff9700 1 -- 172.21.15.146:0/2708992949 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f440038c0 con 0x7f0f500a0a70 2023-10-03T10:13:28.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.584+0000 7f0f564fd700 1 -- 172.21.15.146:0/2708992949 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f501247b0 con 0x7f0f500a0a70 2023-10-03T10:13:28.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.585+0000 7f0f4cff9700 1 -- 172.21.15.146:0/2708992949 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f44003a20 con 0x7f0f500a0a70 2023-10-03T10:13:28.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.585+0000 7f0f4cff9700 1 -- 172.21.15.146:0/2708992949 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0f44021070 con 0x7f0f500a0a70 2023-10-03T10:13:28.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.586+0000 7f0f564fd700 1 -- 172.21.15.146:0/2708992949 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f501249a0 con 0x7f0f500a0a70 2023-10-03T10:13:28.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.590+0000 7f0f4cff9700 1 -- 172.21.15.146:0/2708992949 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f44026480 con 0x7f0f500a0a70 2023-10-03T10:13:28.637 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:28.643 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:28.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.678+0000 7f5cc194e700 1 Processor -- start 2023-10-03T10:13:28.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.678+0000 7f5cc194e700 1 -- start start 2023-10-03T10:13:28.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.679+0000 7f5cc194e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5cbc099eb0 0x7f5cbc09a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.679+0000 7f5cc194e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5cbc09a7c0 0x7f5cbc130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.679+0000 7f5cc194e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5cbc130890 0x7f5cbc130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.679+0000 7f5cc194e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cbc09b930 con 0x7f5cbc099eb0 2023-10-03T10:13:28.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.679+0000 7f5cc194e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc072410 con 0x7f5cbc09a7c0 2023-10-03T10:13:28.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.679+0000 7f5cc194e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc09cd30 con 0x7f5cbc130890 2023-10-03T10:13:28.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.679+0000 7f5cbaffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5cbc099eb0 0x7f5cbc09a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.679+0000 7f5cbaffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5cbc099eb0 0x7f5cbc09a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55004/0 (socket says 172.21.15.146:55004) 2023-10-03T10:13:28.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.679+0000 7f5cbaffd700 1 -- 172.21.15.146:0/4269368452 learned_addr learned my addr 172.21.15.146:0/4269368452 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:28.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.679+0000 7f5cba7fc700 1 --2- 172.21.15.146:0/4269368452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5cbc09a7c0 0x7f5cbc130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.679+0000 7f5cbb7fe700 1 --2- 172.21.15.146:0/4269368452 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5cbc130890 0x7f5cbc130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.679+0000 7f5cbaffd700 1 -- 172.21.15.146:0/4269368452 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5cbc130890 msgr2=0x7f5cbc130d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.679+0000 7f5cbaffd700 1 --2- 172.21.15.146:0/4269368452 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5cbc130890 0x7f5cbc130d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.679+0000 7f5cbaffd700 1 -- 172.21.15.146:0/4269368452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5cbc09a7c0 msgr2=0x7f5cbc130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.679+0000 7f5cbaffd700 1 --2- 172.21.15.146:0/4269368452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5cbc09a7c0 0x7f5cbc130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.679+0000 7f5cbaffd700 1 -- 172.21.15.146:0/4269368452 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cbc099a60 con 0x7f5cbc099eb0 2023-10-03T10:13:28.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.680+0000 7f5cbaffd700 1 --2- 172.21.15.146:0/4269368452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cbc099eb0 0x7f5cbc09a280 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5cac006fd0 tx=0x7f5cac00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8129a1a9a5b8d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.680+0000 7f5cb9ffb700 1 -- 172.21.15.146:0/4269368452 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac005e30 con 0x7f5cbc099eb0 2023-10-03T10:13:28.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.680+0000 7f5cb9ffb700 1 -- 172.21.15.146:0/4269368452 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac004030 con 0x7f5cbc099eb0 2023-10-03T10:13:28.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.680+0000 7f5cb9ffb700 1 -- 172.21.15.146:0/4269368452 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac0043e0 con 0x7f5cbc099eb0 2023-10-03T10:13:28.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.680+0000 7f5cc194e700 1 -- 172.21.15.146:0/4269368452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cbc099eb0 msgr2=0x7f5cbc09a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.680+0000 7f5cc194e700 1 --2- 172.21.15.146:0/4269368452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cbc099eb0 0x7f5cbc09a280 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5cac006fd0 tx=0x7f5cac00bc80 comp rx=0 tx=0).stop 2023-10-03T10:13:28.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.681+0000 7f5cc194e700 1 -- 172.21.15.146:0/4269368452 shutdown_connections 2023-10-03T10:13:28.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.681+0000 7f5cc194e700 1 --2- 172.21.15.146:0/4269368452 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5cbc130890 0x7f5cbc130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.681+0000 7f5cc194e700 1 --2- 172.21.15.146:0/4269368452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cbc099eb0 0x7f5cbc09a280 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.681+0000 7f5cc194e700 1 --2- 172.21.15.146:0/4269368452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5cbc09a7c0 0x7f5cbc130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.681+0000 7f5cc194e700 1 -- 172.21.15.146:0/4269368452 >> 172.21.15.146:0/4269368452 conn(0x7f5cbc0a2980 msgr2=0x7f5cbc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.681+0000 7f5cc194e700 1 -- 172.21.15.146:0/4269368452 shutdown_connections 2023-10-03T10:13:28.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.681+0000 7f5cc194e700 1 -- 172.21.15.146:0/4269368452 wait complete. 2023-10-03T10:13:28.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.683+0000 7f5cc194e700 1 Processor -- start 2023-10-03T10:13:28.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.683+0000 7f5cc194e700 1 -- start start 2023-10-03T10:13:28.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.683+0000 7f5cc194e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cbc099eb0 0x7f5cbc11b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.683+0000 7f5cc194e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5cbc09a7c0 0x7f5cbc11be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.683+0000 7f5cc194e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5cbc130890 0x7f5cbc11c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.683+0000 7f5cc194e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc11cde0 con 0x7f5cbc099eb0 2023-10-03T10:13:28.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.683+0000 7f5cc194e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc12dcf0 con 0x7f5cbc09a7c0 2023-10-03T10:13:28.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.683+0000 7f5cc194e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc11e770 con 0x7f5cbc130890 2023-10-03T10:13:28.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.684+0000 7f5cbaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cbc099eb0 0x7f5cbc11b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.684+0000 7f5cbaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cbc099eb0 0x7f5cbc11b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55020/0 (socket says 172.21.15.146:55020) 2023-10-03T10:13:28.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.684+0000 7f5cbaffd700 1 -- 172.21.15.146:0/3694421275 learned_addr learned my addr 172.21.15.146:0/3694421275 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:28.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.684+0000 7f5cba7fc700 1 --2- 172.21.15.146:0/3694421275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5cbc09a7c0 0x7f5cbc11be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.684+0000 7f5cbb7fe700 1 --2- 172.21.15.146:0/3694421275 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5cbc130890 0x7f5cbc11c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.684+0000 7f5cbaffd700 1 -- 172.21.15.146:0/3694421275 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5cbc130890 msgr2=0x7f5cbc11c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.684+0000 7f5cbaffd700 1 --2- 172.21.15.146:0/3694421275 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5cbc130890 0x7f5cbc11c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.684+0000 7f5cbaffd700 1 -- 172.21.15.146:0/3694421275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5cbc09a7c0 msgr2=0x7f5cbc11be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.684+0000 7f5cbaffd700 1 --2- 172.21.15.146:0/3694421275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5cbc09a7c0 0x7f5cbc11be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.684+0000 7f5cbaffd700 1 -- 172.21.15.146:0/3694421275 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac00b5b0 con 0x7f5cbc099eb0 2023-10-03T10:13:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.684+0000 7f5cbb7fe700 1 --2- 172.21.15.146:0/3694421275 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5cbc130890 0x7f5cbc11c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.684+0000 7f5cbaffd700 1 --2- 172.21.15.146:0/3694421275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cbc099eb0 0x7f5cbc11b910 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5cac00bfd0 tx=0x7f5cac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.684+0000 7f5ca3fff700 1 -- 172.21.15.146:0/3694421275 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac01f070 con 0x7f5cbc099eb0 2023-10-03T10:13:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.684+0000 7f5ca3fff700 1 -- 172.21.15.146:0/3694421275 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac004590 con 0x7f5cbc099eb0 2023-10-03T10:13:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.684+0000 7f5ca3fff700 1 -- 172.21.15.146:0/3694421275 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac00cab0 con 0x7f5cbc099eb0 2023-10-03T10:13:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.685+0000 7f5cc194e700 1 -- 172.21.15.146:0/3694421275 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cbc11db00 con 0x7f5cbc099eb0 2023-10-03T10:13:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.685+0000 7f5cc194e700 1 -- 172.21.15.146:0/3694421275 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cbc0a1750 con 0x7f5cbc099eb0 2023-10-03T10:13:28.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.685+0000 7f5ca3fff700 1 -- 172.21.15.146:0/3694421275 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5cac00cc10 con 0x7f5cbc099eb0 2023-10-03T10:13:28.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.686+0000 7f5ca3fff700 1 -- 172.21.15.146:0/3694421275 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5cac02fcf0 con 0x7f5cbc099eb0 2023-10-03T10:13:28.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.686+0000 7f5cc194e700 1 -- 172.21.15.146:0/3694421275 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cbc09b490 con 0x7f5cbc099eb0 2023-10-03T10:13:28.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.695+0000 7f5ca3fff700 1 -- 172.21.15.146:0/3694421275 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5cac003e30 con 0x7f5cbc099eb0 2023-10-03T10:13:28.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.769+0000 7f73c26d1700 1 Processor -- start 2023-10-03T10:13:28.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.769+0000 7f73c26d1700 1 -- start start 2023-10-03T10:13:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.770+0000 7f73c26d1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73bc09e870 0x7f73bc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.770+0000 7f73c26d1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73bc09f180 0x7f73bc131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.770+0000 7f73c26d1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f73bc131d70 0x7f73bc132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.770+0000 7f73c26d1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73bc0a0920 con 0x7f73bc131d70 2023-10-03T10:13:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.770+0000 7f73c26d1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc09c970 con 0x7f73bc09f180 2023-10-03T10:13:28.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.770+0000 7f73c26d1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc09bab0 con 0x7f73bc09e870 2023-10-03T10:13:28.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.770+0000 7f73bb7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73bc09f180 0x7f73bc131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.770+0000 7f73bb7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73bc09f180 0x7f73bc131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42724/0 (socket says 172.21.15.146:42724) 2023-10-03T10:13:28.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.770+0000 7f73bb7fe700 1 -- 172.21.15.146:0/3232777335 learned_addr learned my addr 172.21.15.146:0/3232777335 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:28.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.770+0000 7f73c0c6e700 1 --2- 172.21.15.146:0/3232777335 >> v2:172.21.15.146:3300/0 conn(0x7f73bc131d70 0x7f73bc132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.770+0000 7f73bbfff700 1 --2- 172.21.15.146:0/3232777335 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73bc09e870 0x7f73bc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.770+0000 7f73bb7fe700 1 -- 172.21.15.146:0/3232777335 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73bc09e870 msgr2=0x7f73bc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.770+0000 7f73bb7fe700 1 --2- 172.21.15.146:0/3232777335 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73bc09e870 0x7f73bc09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.770+0000 7f73bb7fe700 1 -- 172.21.15.146:0/3232777335 >> v2:172.21.15.146:3300/0 conn(0x7f73bc131d70 msgr2=0x7f73bc132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.770+0000 7f73bb7fe700 1 --2- 172.21.15.146:0/3232777335 >> v2:172.21.15.146:3300/0 conn(0x7f73bc131d70 0x7f73bc132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.770+0000 7f73bb7fe700 1 -- 172.21.15.146:0/3232777335 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73bc09f9c0 con 0x7f73bc09f180 2023-10-03T10:13:28.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.770+0000 7f73bbfff700 1 --2- 172.21.15.146:0/3232777335 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73bc09e870 0x7f73bc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:28.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.770+0000 7f73c0c6e700 1 --2- 172.21.15.146:0/3232777335 >> v2:172.21.15.146:3300/0 conn(0x7f73bc131d70 0x7f73bc132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:28.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.770+0000 7f73bb7fe700 1 --2- 172.21.15.146:0/3232777335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73bc09f180 0x7f73bc131830 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f73b00098f0 tx=0x7f73b0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e4b7e7403889c51 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.771+0000 7f73baffd700 1 -- 172.21.15.146:0/3232777335 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b0011830 con 0x7f73bc09f180 2023-10-03T10:13:28.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.771+0000 7f73baffd700 1 -- 172.21.15.146:0/3232777335 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b0011990 con 0x7f73bc09f180 2023-10-03T10:13:28.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.771+0000 7f73baffd700 1 -- 172.21.15.146:0/3232777335 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b0011d20 con 0x7f73bc09f180 2023-10-03T10:13:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.771+0000 7f73c26d1700 1 -- 172.21.15.146:0/3232777335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73bc09f180 msgr2=0x7f73bc131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.771+0000 7f73c26d1700 1 --2- 172.21.15.146:0/3232777335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73bc09f180 0x7f73bc131830 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f73b00098f0 tx=0x7f73b0009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.771+0000 7f73c26d1700 1 -- 172.21.15.146:0/3232777335 shutdown_connections 2023-10-03T10:13:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.771+0000 7f73c26d1700 1 --2- 172.21.15.146:0/3232777335 >> v2:172.21.15.146:3300/0 conn(0x7f73bc131d70 0x7f73bc132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.771+0000 7f73c26d1700 1 --2- 172.21.15.146:0/3232777335 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73bc09e870 0x7f73bc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.771+0000 7f73c26d1700 1 --2- 172.21.15.146:0/3232777335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73bc09f180 0x7f73bc131830 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.771+0000 7f73c26d1700 1 -- 172.21.15.146:0/3232777335 >> 172.21.15.146:0/3232777335 conn(0x7f73bc0a4430 msgr2=0x7f73bc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.771+0000 7f73c26d1700 1 -- 172.21.15.146:0/3232777335 shutdown_connections 2023-10-03T10:13:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.771+0000 7f73c26d1700 1 -- 172.21.15.146:0/3232777335 wait complete. 2023-10-03T10:13:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.772+0000 7f73c26d1700 1 Processor -- start 2023-10-03T10:13:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.773+0000 7f73c26d1700 1 -- start start 2023-10-03T10:13:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.773+0000 7f73c26d1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73bc09e870 0x7f73bc11f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.773+0000 7f73c26d1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73bc09f180 0x7f73bc11f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.773+0000 7f73c26d1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73bc131d70 0x7f73bc11fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.773+0000 7f73c26d1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc122c10 con 0x7f73bc09f180 2023-10-03T10:13:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.773+0000 7f73c26d1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc121b90 con 0x7f73bc09e870 2023-10-03T10:13:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.773+0000 7f73c26d1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc0a0210 con 0x7f73bc131d70 2023-10-03T10:13:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.773+0000 7f73bbfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73bc09e870 0x7f73bc11f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.773+0000 7f73bbfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73bc09e870 0x7f73bc11f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42730/0 (socket says 172.21.15.146:42730) 2023-10-03T10:13:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.773+0000 7f73bbfff700 1 -- 172.21.15.146:0/3811900685 learned_addr learned my addr 172.21.15.146:0/3811900685 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.773+0000 7f73bb7fe700 1 --2- 172.21.15.146:0/3811900685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73bc09f180 0x7f73bc11f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.773+0000 7f73c0c6e700 1 --2- 172.21.15.146:0/3811900685 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73bc131d70 0x7f73bc11fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.773+0000 7f73bbfff700 1 -- 172.21.15.146:0/3811900685 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73bc131d70 msgr2=0x7f73bc11fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.773+0000 7f73bbfff700 1 --2- 172.21.15.146:0/3811900685 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73bc131d70 0x7f73bc11fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.773+0000 7f73bbfff700 1 -- 172.21.15.146:0/3811900685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73bc09f180 msgr2=0x7f73bc11f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.773+0000 7f73bbfff700 1 --2- 172.21.15.146:0/3811900685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73bc09f180 0x7f73bc11f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.773+0000 7f73bbfff700 1 -- 172.21.15.146:0/3811900685 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b4009a70 con 0x7f73bc09e870 2023-10-03T10:13:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.773+0000 7f73bb7fe700 1 --2- 172.21.15.146:0/3811900685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73bc09f180 0x7f73bc11f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.774+0000 7f73bbfff700 1 --2- 172.21.15.146:0/3811900685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73bc09e870 0x7f73bc11f140 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00c7a0 tx=0x7f73ac00cb60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.774+0000 7f73b8ff9700 1 -- 172.21.15.146:0/3811900685 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ac011800 con 0x7f73bc09e870 2023-10-03T10:13:28.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.774+0000 7f73b8ff9700 1 -- 172.21.15.146:0/3811900685 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ac011960 con 0x7f73bc09e870 2023-10-03T10:13:28.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.774+0000 7f73c26d1700 1 -- 172.21.15.146:0/3811900685 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b0009550 con 0x7f73bc09e870 2023-10-03T10:13:28.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.774+0000 7f73b8ff9700 1 -- 172.21.15.146:0/3811900685 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ac011cd0 con 0x7f73bc09e870 2023-10-03T10:13:28.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.774+0000 7f73c26d1700 1 -- 172.21.15.146:0/3811900685 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73bc120d00 con 0x7f73bc09e870 2023-10-03T10:13:28.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.776+0000 7f73b8ff9700 1 -- 172.21.15.146:0/3811900685 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f73ac021350 con 0x7f73bc09e870 2023-10-03T10:13:28.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.776+0000 7f73c26d1700 1 -- 172.21.15.146:0/3811900685 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73bc11be60 con 0x7f73bc09e870 2023-10-03T10:13:28.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.776+0000 7f73b8ff9700 1 -- 172.21.15.146:0/3811900685 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f73ac00e2f0 con 0x7f73bc09e870 2023-10-03T10:13:28.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.785+0000 7f73b8ff9700 1 -- 172.21.15.146:0/3811900685 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73ac011e30 con 0x7f73bc09e870 2023-10-03T10:13:28.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.810+0000 7f3c40c6c700 1 Processor -- start 2023-10-03T10:13:28.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.810+0000 7f3c40c6c700 1 -- start start 2023-10-03T10:13:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.811+0000 7f3c40c6c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c3c09ad40 0x7f3c3c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.811+0000 7f3c40c6c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c3c1343a0 0x7f3c3c0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.811+0000 7f3c40c6c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c3c09b110 con 0x7f3c3c133f70 2023-10-03T10:13:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.811+0000 7f3c40c6c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c0a3b60 con 0x7f3c3c1343a0 2023-10-03T10:13:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.811+0000 7f3c40c6c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c0a2fa0 con 0x7f3c3c09ad40 2023-10-03T10:13:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.811+0000 7f3c3ad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c3c1343a0 0x7f3c3c0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.811+0000 7f3c3ad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c3c1343a0 0x7f3c3c0a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42746/0 (socket says 172.21.15.146:42746) 2023-10-03T10:13:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.811+0000 7f3c39d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3c3c133f70 0x7f3c3c0a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48012/0 (socket says 172.21.15.146:48012) 2023-10-03T10:13:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.811+0000 7f3c3ad9d700 1 -- 172.21.15.146:0/1249411754 learned_addr learned my addr 172.21.15.146:0/1249411754 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:28.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.812+0000 7f3c3a59c700 1 --2- 172.21.15.146:0/1249411754 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c3c09ad40 0x7f3c3c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.812+0000 7f3c3ad9d700 1 -- 172.21.15.146:0/1249411754 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c3c09ad40 msgr2=0x7f3c3c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.812+0000 7f3c3959a700 1 -- 172.21.15.146:0/1249411754 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679205554 0 0) 0x7f3c3c09b110 con 0x7f3c3c133f70 2023-10-03T10:13:28.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.812+0000 7f3c3ad9d700 1 --2- 172.21.15.146:0/1249411754 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c3c09ad40 0x7f3c3c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.812+0000 7f3c3ad9d700 1 -- 172.21.15.146:0/1249411754 >> v1:172.21.15.146:6789/0 conn(0x7f3c3c133f70 legacy=0x7f3c3c0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.812+0000 7f3c3ad9d700 1 -- 172.21.15.146:0/1249411754 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c09a280 con 0x7f3c3c1343a0 2023-10-03T10:13:28.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.812+0000 7f3c3a59c700 1 --2- 172.21.15.146:0/1249411754 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c3c09ad40 0x7f3c3c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:28.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.812+0000 7f3c3ad9d700 1 --2- 172.21.15.146:0/1249411754 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c3c1343a0 0x7f3c3c0a1180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3c34009e80 tx=0x7f3c3400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41a1054b5e423298 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.812+0000 7f3c3959a700 1 -- 172.21.15.146:0/1249411754 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3400e070 con 0x7f3c3c1343a0 2023-10-03T10:13:28.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.812+0000 7f3c3959a700 1 -- 172.21.15.146:0/1249411754 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3400b9c0 con 0x7f3c3c1343a0 2023-10-03T10:13:28.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.812+0000 7f3c3959a700 1 -- 172.21.15.146:0/1249411754 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3400bd70 con 0x7f3c3c1343a0 2023-10-03T10:13:28.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.813+0000 7f3c40c6c700 1 -- 172.21.15.146:0/1249411754 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c3c1343a0 msgr2=0x7f3c3c0a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.813+0000 7f3c40c6c700 1 --2- 172.21.15.146:0/1249411754 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c3c1343a0 0x7f3c3c0a1180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3c34009e80 tx=0x7f3c3400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:28.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.813+0000 7f3c40c6c700 1 -- 172.21.15.146:0/1249411754 shutdown_connections 2023-10-03T10:13:28.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.813+0000 7f3c40c6c700 1 --2- 172.21.15.146:0/1249411754 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c3c1343a0 0x7f3c3c0a1180 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.813+0000 7f3c40c6c700 1 --2- 172.21.15.146:0/1249411754 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c3c09ad40 0x7f3c3c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.813+0000 7f3c40c6c700 1 -- 172.21.15.146:0/1249411754 >> 172.21.15.146:0/1249411754 conn(0x7f3c3c099c40 msgr2=0x7f3c3c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.813+0000 7f3c40c6c700 1 -- 172.21.15.146:0/1249411754 shutdown_connections 2023-10-03T10:13:28.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.813+0000 7f3c40c6c700 1 -- 172.21.15.146:0/1249411754 wait complete. 2023-10-03T10:13:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.814+0000 7f3c40c6c700 1 Processor -- start 2023-10-03T10:13:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.814+0000 7f3c40c6c700 1 -- start start 2023-10-03T10:13:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.814+0000 7f3c40c6c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c3c09ad40 0x7f3c3c1c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.814+0000 7f3c40c6c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c3c133f70 0x7f3c3c1c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.814+0000 7f3c40c6c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c3c1343a0 0x7f3c3c1c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.814+0000 7f3c40c6c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c120f20 con 0x7f3c3c09ad40 2023-10-03T10:13:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.814+0000 7f3c40c6c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c1207d0 con 0x7f3c3c133f70 2023-10-03T10:13:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.814+0000 7f3c40c6c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c09e810 con 0x7f3c3c1343a0 2023-10-03T10:13:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.815+0000 7f3c3a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c3c09ad40 0x7f3c3c1c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.815+0000 7f3c39d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c3c133f70 0x7f3c3c1c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.815+0000 7f3c3a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c3c09ad40 0x7f3c3c1c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55046/0 (socket says 172.21.15.146:55046) 2023-10-03T10:13:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.815+0000 7f3c3a59c700 1 -- 172.21.15.146:0/911007568 learned_addr learned my addr 172.21.15.146:0/911007568 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.815+0000 7f3c3ad9d700 1 --2- 172.21.15.146:0/911007568 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c3c1343a0 0x7f3c3c1c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.815+0000 7f3c3ad9d700 1 -- 172.21.15.146:0/911007568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c3c133f70 msgr2=0x7f3c3c1c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.815+0000 7f3c3ad9d700 1 --2- 172.21.15.146:0/911007568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c3c133f70 0x7f3c3c1c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.815+0000 7f3c3ad9d700 1 -- 172.21.15.146:0/911007568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c3c09ad40 msgr2=0x7f3c3c1c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.815+0000 7f3c3ad9d700 1 --2- 172.21.15.146:0/911007568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c3c09ad40 0x7f3c3c1c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.815+0000 7f3c3ad9d700 1 -- 172.21.15.146:0/911007568 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c34009b30 con 0x7f3c3c1343a0 2023-10-03T10:13:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.815+0000 7f3c3a59c700 1 --2- 172.21.15.146:0/911007568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c3c09ad40 0x7f3c3c1c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.815+0000 7f3c3ad9d700 1 --2- 172.21.15.146:0/911007568 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c3c1343a0 0x7f3c3c1c8b80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c06b550 tx=0x7f3c34004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.815+0000 7f3c2affd700 1 -- 172.21.15.146:0/911007568 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34004450 con 0x7f3c3c1343a0 2023-10-03T10:13:28.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.816+0000 7f3c2affd700 1 -- 172.21.15.146:0/911007568 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c340045b0 con 0x7f3c3c1343a0 2023-10-03T10:13:28.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.816+0000 7f3c40c6c700 1 -- 172.21.15.146:0/911007568 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3c121fc0 con 0x7f3c3c1343a0 2023-10-03T10:13:28.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.816+0000 7f3c2affd700 1 -- 172.21.15.146:0/911007568 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34004960 con 0x7f3c3c1343a0 2023-10-03T10:13:28.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.816+0000 7f3c40c6c700 1 -- 172.21.15.146:0/911007568 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3c122cf0 con 0x7f3c3c1343a0 2023-10-03T10:13:28.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.817+0000 7f3c40c6c700 1 -- 172.21.15.146:0/911007568 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3c04f2a0 con 0x7f3c3c1343a0 2023-10-03T10:13:28.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.817+0000 7f3c2affd700 1 -- 172.21.15.146:0/911007568 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3c34025460 con 0x7f3c3c1343a0 2023-10-03T10:13:28.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.817+0000 7f3c2affd700 1 -- 172.21.15.146:0/911007568 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3c340418b0 con 0x7f3c3c1343a0 2023-10-03T10:13:28.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.821+0000 7f3c2affd700 1 -- 172.21.15.146:0/911007568 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3c3402d980 con 0x7f3c3c1343a0 2023-10-03T10:13:28.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.834+0000 7f0f564fd700 1 -- 172.21.15.146:0/2708992949 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0f5011e060 con 0x7f0f500a0a70 2023-10-03T10:13:28.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.834+0000 7f0f4cff9700 1 -- 172.21.15.146:0/2708992949 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0f44015020 con 0x7f0f500a0a70 2023-10-03T10:13:28.835 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.836+0000 7f0f564fd700 1 -- 172.21.15.146:0/2708992949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f500a0a70 msgr2=0x7f0f50121770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.836+0000 7f0f564fd700 1 --2- 172.21.15.146:0/2708992949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f500a0a70 0x7f0f50121770 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009fd0 tx=0x7f0f44004750 comp rx=0 tx=0).stop 2023-10-03T10:13:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.836+0000 7f0f564fd700 1 -- 172.21.15.146:0/2708992949 shutdown_connections 2023-10-03T10:13:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.836+0000 7f0f564fd700 1 --2- 172.21.15.146:0/2708992949 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f50133f70 0x7f0f50121cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.836+0000 7f0f564fd700 1 --2- 172.21.15.146:0/2708992949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f5009ad40 0x7f0f50121230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.836+0000 7f0f564fd700 1 --2- 172.21.15.146:0/2708992949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f500a0a70 0x7f0f50121770 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.836+0000 7f0f564fd700 1 -- 172.21.15.146:0/2708992949 >> 172.21.15.146:0/2708992949 conn(0x7f0f50099c40 msgr2=0x7f0f50133310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.837+0000 7f0f564fd700 1 -- 172.21.15.146:0/2708992949 shutdown_connections 2023-10-03T10:13:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.837+0000 7f0f564fd700 1 -- 172.21.15.146:0/2708992949 wait complete. 2023-10-03T10:13:28.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.983+0000 7f5cc194e700 1 -- 172.21.15.146:0/3694421275 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5cbc04f2a0 con 0x7f5cbc099eb0 2023-10-03T10:13:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.983+0000 7f5ca3fff700 1 -- 172.21.15.146:0/3694421275 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5cac00ebb0 con 0x7f5cbc099eb0 2023-10-03T10:13:28.984 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:28.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.985+0000 7f5cc194e700 1 -- 172.21.15.146:0/3694421275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cbc099eb0 msgr2=0x7f5cbc11b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.985+0000 7f5cc194e700 1 --2- 172.21.15.146:0/3694421275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cbc099eb0 0x7f5cbc11b910 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5cac00bfd0 tx=0x7f5cac004750 comp rx=0 tx=0).stop 2023-10-03T10:13:28.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.985+0000 7f5cc194e700 1 -- 172.21.15.146:0/3694421275 shutdown_connections 2023-10-03T10:13:28.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.985+0000 7f5cc194e700 1 --2- 172.21.15.146:0/3694421275 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5cbc130890 0x7f5cbc11c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.985+0000 7f5cc194e700 1 --2- 172.21.15.146:0/3694421275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cbc099eb0 0x7f5cbc11b910 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.985+0000 7f5cc194e700 1 --2- 172.21.15.146:0/3694421275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5cbc09a7c0 0x7f5cbc11be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.986+0000 7f5cc194e700 1 -- 172.21.15.146:0/3694421275 >> 172.21.15.146:0/3694421275 conn(0x7f5cbc0a2980 msgr2=0x7f5cbc12f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.986+0000 7f5cc194e700 1 -- 172.21.15.146:0/3694421275 shutdown_connections 2023-10-03T10:13:28.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:28.986+0000 7f5cc194e700 1 -- 172.21.15.146:0/3694421275 wait complete. 2023-10-03T10:13:28.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:29.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.016+0000 7f3c40c6c700 1 -- 172.21.15.146:0/911007568 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3c3c0729d0 con 0x7f3c3c1343a0 2023-10-03T10:13:29.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.017+0000 7f3c2affd700 1 -- 172.21.15.146:0/911007568 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3c3402d390 con 0x7f3c3c1343a0 2023-10-03T10:13:29.017 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.019+0000 7f3c40c6c700 1 -- 172.21.15.146:0/911007568 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c3c1343a0 msgr2=0x7f3c3c1c8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.019+0000 7f3c40c6c700 1 --2- 172.21.15.146:0/911007568 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c3c1343a0 0x7f3c3c1c8b80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c06b550 tx=0x7f3c34004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.019+0000 7f3c40c6c700 1 -- 172.21.15.146:0/911007568 shutdown_connections 2023-10-03T10:13:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.019+0000 7f3c40c6c700 1 --2- 172.21.15.146:0/911007568 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c3c1343a0 0x7f3c3c1c8b80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.019+0000 7f3c40c6c700 1 --2- 172.21.15.146:0/911007568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c3c09ad40 0x7f3c3c1c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.019+0000 7f3c40c6c700 1 --2- 172.21.15.146:0/911007568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c3c133f70 0x7f3c3c1c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.019+0000 7f3c40c6c700 1 -- 172.21.15.146:0/911007568 >> 172.21.15.146:0/911007568 conn(0x7f3c3c099c40 msgr2=0x7f3c3c1bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.019+0000 7f3c40c6c700 1 -- 172.21.15.146:0/911007568 shutdown_connections 2023-10-03T10:13:29.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.019+0000 7f3c40c6c700 1 -- 172.21.15.146:0/911007568 wait complete. 2023-10-03T10:13:29.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:29.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.070+0000 7f73c26d1700 1 -- 172.21.15.146:0/3811900685 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f73bc04f2a0 con 0x7f73bc09e870 2023-10-03T10:13:29.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.070+0000 7f73b8ff9700 1 -- 172.21.15.146:0/3811900685 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f73ac017af0 con 0x7f73bc09e870 2023-10-03T10:13:29.071 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:29.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.072+0000 7f73c26d1700 1 -- 172.21.15.146:0/3811900685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73bc09e870 msgr2=0x7f73bc11f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.072+0000 7f73c26d1700 1 --2- 172.21.15.146:0/3811900685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73bc09e870 0x7f73bc11f140 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00c7a0 tx=0x7f73ac00cb60 comp rx=0 tx=0).stop 2023-10-03T10:13:29.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.072+0000 7f73c26d1700 1 -- 172.21.15.146:0/3811900685 shutdown_connections 2023-10-03T10:13:29.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.072+0000 7f73c26d1700 1 --2- 172.21.15.146:0/3811900685 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73bc131d70 0x7f73bc11fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.072+0000 7f73c26d1700 1 --2- 172.21.15.146:0/3811900685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73bc09e870 0x7f73bc11f140 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.072+0000 7f73c26d1700 1 --2- 172.21.15.146:0/3811900685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73bc09f180 0x7f73bc11f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.072+0000 7f73c26d1700 1 -- 172.21.15.146:0/3811900685 >> 172.21.15.146:0/3811900685 conn(0x7f73bc0a4430 msgr2=0x7f73bc1310a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.072+0000 7f73c26d1700 1 -- 172.21.15.146:0/3811900685 shutdown_connections 2023-10-03T10:13:29.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.072+0000 7f73c26d1700 1 -- 172.21.15.146:0/3811900685 wait complete. 2023-10-03T10:13:29.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:29.850 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:29.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.983+0000 7fddf2e9e700 1 Processor -- start 2023-10-03T10:13:29.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.983+0000 7fddf2e9e700 1 -- start start 2023-10-03T10:13:29.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.984+0000 7fddf2e9e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fddec06a770 0x7fddec06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.984+0000 7fddf2e9e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddec131ec0 0x7fddec139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.984+0000 7fddf2e9e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddec09da80 con 0x7fddec06b080 2023-10-03T10:13:29.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.984+0000 7fddf2e9e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddec09dce0 con 0x7fddec06a770 2023-10-03T10:13:29.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.984+0000 7fddf2e9e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec09eb20 con 0x7fddec131ec0 2023-10-03T10:13:29.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.984+0000 7fddf143b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddec131ec0 0x7fddec139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.984+0000 7fddf0c3a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fddec06a770 0x7fddec06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.984+0000 7fddf0c3a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fddec06a770 0x7fddec06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55050/0 (socket says 172.21.15.146:55050) 2023-10-03T10:13:29.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.984+0000 7fddf143b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddec131ec0 0x7fddec139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42756/0 (socket says 172.21.15.146:42756) 2023-10-03T10:13:29.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.984+0000 7fddf0c3a700 1 -- 172.21.15.146:0/3186977655 learned_addr learned my addr 172.21.15.146:0/3186977655 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:29.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.984+0000 7fddebfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fddec06b080 0x7fddec1317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48016/0 (socket says 172.21.15.146:48016) 2023-10-03T10:13:29.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.984+0000 7fddf0c3a700 1 -- 172.21.15.146:0/3186977655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddec131ec0 msgr2=0x7fddec139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:29.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.984+0000 7fddf0c3a700 1 --2- 172.21.15.146:0/3186977655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddec131ec0 0x7fddec139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.984+0000 7fddf0c3a700 1 -- 172.21.15.146:0/3186977655 >> v1:172.21.15.146:6789/0 conn(0x7fddec06b080 legacy=0x7fddec1317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.984+0000 7fddeb7fe700 1 -- 172.21.15.146:0/3186977655 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882655942 0 0) 0x7fddec09da80 con 0x7fddec06b080 2023-10-03T10:13:29.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.984+0000 7fddf0c3a700 1 -- 172.21.15.146:0/3186977655 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec09d860 con 0x7fddec06a770 2023-10-03T10:13:29.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.984+0000 7fddf0c3a700 1 --2- 172.21.15.146:0/3186977655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddec06a770 0x7fddec06ab40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdde00098f0 tx=0x7fdde0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e4d8ee1d2c379e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.984+0000 7fddeb7fe700 1 -- 172.21.15.146:0/3186977655 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0011830 con 0x7fddec06a770 2023-10-03T10:13:29.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.984+0000 7fddeb7fe700 1 -- 172.21.15.146:0/3186977655 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde0011990 con 0x7fddec06a770 2023-10-03T10:13:29.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.984+0000 7fddeb7fe700 1 -- 172.21.15.146:0/3186977655 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0011d20 con 0x7fddec06a770 2023-10-03T10:13:29.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.985+0000 7fddf2e9e700 1 -- 172.21.15.146:0/3186977655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddec06a770 msgr2=0x7fddec06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.985+0000 7fddf2e9e700 1 --2- 172.21.15.146:0/3186977655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddec06a770 0x7fddec06ab40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdde00098f0 tx=0x7fdde0009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:29.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.985+0000 7fddf2e9e700 1 -- 172.21.15.146:0/3186977655 shutdown_connections 2023-10-03T10:13:29.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.985+0000 7fddf2e9e700 1 --2- 172.21.15.146:0/3186977655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddec131ec0 0x7fddec139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.985+0000 7fddf2e9e700 1 --2- 172.21.15.146:0/3186977655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddec06a770 0x7fddec06ab40 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.985+0000 7fddf2e9e700 1 -- 172.21.15.146:0/3186977655 >> 172.21.15.146:0/3186977655 conn(0x7fddec099c40 msgr2=0x7fddec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.985+0000 7fddf2e9e700 1 -- 172.21.15.146:0/3186977655 shutdown_connections 2023-10-03T10:13:29.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.985+0000 7fddf2e9e700 1 -- 172.21.15.146:0/3186977655 wait complete. 2023-10-03T10:13:29.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.986+0000 7fddf2e9e700 1 Processor -- start 2023-10-03T10:13:29.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.986+0000 7fddf2e9e700 1 -- start start 2023-10-03T10:13:29.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.987+0000 7fddf2e9e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddec06a770 0x7fddec119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.987+0000 7fddf2e9e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddec06b080 0x7fddec119b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.987+0000 7fddf2e9e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fddec131ec0 0x7fddec11a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.987+0000 7fddf2e9e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec11b990 con 0x7fddec06a770 2023-10-03T10:13:29.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.987+0000 7fddf2e9e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec11c130 con 0x7fddec06b080 2023-10-03T10:13:29.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.987+0000 7fddf2e9e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddec11a880 con 0x7fddec131ec0 2023-10-03T10:13:29.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.987+0000 7fddf0c3a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddec06a770 0x7fddec119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.987+0000 7fddebfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddec06b080 0x7fddec119b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.987+0000 7fddf0c3a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddec06a770 0x7fddec119630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55052/0 (socket says 172.21.15.146:55052) 2023-10-03T10:13:29.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.987+0000 7fddf0c3a700 1 -- 172.21.15.146:0/1615036358 learned_addr learned my addr 172.21.15.146:0/1615036358 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:29.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.987+0000 7fddf143b700 1 --2- 172.21.15.146:0/1615036358 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fddec131ec0 0x7fddec11a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.987+0000 7fddf0c3a700 1 -- 172.21.15.146:0/1615036358 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fddec131ec0 msgr2=0x7fddec11a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.987+0000 7fddf0c3a700 1 --2- 172.21.15.146:0/1615036358 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fddec131ec0 0x7fddec11a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.987+0000 7fddf0c3a700 1 -- 172.21.15.146:0/1615036358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddec06b080 msgr2=0x7fddec119b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.987+0000 7fddf0c3a700 1 --2- 172.21.15.146:0/1615036358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddec06b080 0x7fddec119b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.987+0000 7fddf0c3a700 1 -- 172.21.15.146:0/1615036358 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde0009550 con 0x7fddec06a770 2023-10-03T10:13:29.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.987+0000 7fddebfff700 1 --2- 172.21.15.146:0/1615036358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddec06b080 0x7fddec119b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:29.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.988+0000 7fddf0c3a700 1 --2- 172.21.15.146:0/1615036358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddec06a770 0x7fddec119630 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fdde0009c40 tx=0x7fdde0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.988+0000 7fdde97fa700 1 -- 172.21.15.146:0/1615036358 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0004510 con 0x7fddec06a770 2023-10-03T10:13:29.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.988+0000 7fdde97fa700 1 -- 172.21.15.146:0/1615036358 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde00036a0 con 0x7fddec06a770 2023-10-03T10:13:29.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.988+0000 7fddf2e9e700 1 -- 172.21.15.146:0/1615036358 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddec11c3f0 con 0x7fddec06a770 2023-10-03T10:13:29.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.988+0000 7fdde97fa700 1 -- 172.21.15.146:0/1615036358 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0003a50 con 0x7fddec06a770 2023-10-03T10:13:29.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.988+0000 7fddf2e9e700 1 -- 172.21.15.146:0/1615036358 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddec071170 con 0x7fddec06a770 2023-10-03T10:13:29.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.989+0000 7fdde97fa700 1 -- 172.21.15.146:0/1615036358 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdde0021070 con 0x7fddec06a770 2023-10-03T10:13:29.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.989+0000 7fdde97fa700 1 -- 172.21.15.146:0/1615036358 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdde0040aa0 con 0x7fddec06a770 2023-10-03T10:13:29.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.989+0000 7fddf2e9e700 1 -- 172.21.15.146:0/1615036358 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddec09d2f0 con 0x7fddec06a770 2023-10-03T10:13:29.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:29.993+0000 7fdde97fa700 1 -- 172.21.15.146:0/1615036358 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdde0015070 con 0x7fddec06a770 2023-10-03T10:13:29.999 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:30.033 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:30.086 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:30.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.127+0000 7f76c86b1700 1 Processor -- start 2023-10-03T10:13:30.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.127+0000 7f76c86b1700 1 -- start start 2023-10-03T10:13:30.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.127+0000 7f76c86b1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76c0133ad0 0x7f76c0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.127+0000 7f76c86b1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f76c01300a0 0x7f76c01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.127+0000 7f76c86b1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f76c01309f0 0x7f76c013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.127+0000 7f76c86b1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c006b2d0 con 0x7f76c01309f0 2023-10-03T10:13:30.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.128+0000 7f76c86b1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c0133610 con 0x7f76c0133ad0 2023-10-03T10:13:30.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.128+0000 7f76c86b1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76c009a500 con 0x7f76c01300a0 2023-10-03T10:13:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.128+0000 7f76c6c4e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f76c01309f0 0x7f76c013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.128+0000 7f76c6c4e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f76c01309f0 0x7f76c013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55054/0 (socket says 172.21.15.146:55054) 2023-10-03T10:13:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.128+0000 7f76c6c4e700 1 -- 172.21.15.146:0/2429497132 learned_addr learned my addr 172.21.15.146:0/2429497132 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.128+0000 7f76c5c4c700 1 --2- 172.21.15.146:0/2429497132 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f76c01300a0 0x7f76c01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.128+0000 7f76c644d700 1 --2- 172.21.15.146:0/2429497132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76c0133ad0 0x7f76c0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.128+0000 7f76c6c4e700 1 -- 172.21.15.146:0/2429497132 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f76c01300a0 msgr2=0x7f76c01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.128+0000 7f76c6c4e700 1 --2- 172.21.15.146:0/2429497132 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f76c01300a0 0x7f76c01304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.128+0000 7f76c6c4e700 1 -- 172.21.15.146:0/2429497132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76c0133ad0 msgr2=0x7f76c0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.128+0000 7f76c6c4e700 1 --2- 172.21.15.146:0/2429497132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76c0133ad0 0x7f76c0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.128+0000 7f76c6c4e700 1 -- 172.21.15.146:0/2429497132 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c01338b0 con 0x7f76c01309f0 2023-10-03T10:13:30.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.128+0000 7f76c6c4e700 1 --2- 172.21.15.146:0/2429497132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76c01309f0 0x7f76c013a980 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009e50 tx=0x7f76b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca467e7e8b6bdd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:30.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.129+0000 7f76c544b700 1 -- 172.21.15.146:0/2429497132 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b800e070 con 0x7f76c01309f0 2023-10-03T10:13:30.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.129+0000 7f76c544b700 1 -- 172.21.15.146:0/2429497132 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b800b910 con 0x7f76c01309f0 2023-10-03T10:13:30.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.129+0000 7f76c544b700 1 -- 172.21.15.146:0/2429497132 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b800bca0 con 0x7f76c01309f0 2023-10-03T10:13:30.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.129+0000 7f76c86b1700 1 -- 172.21.15.146:0/2429497132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76c01309f0 msgr2=0x7f76c013a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.129+0000 7f76c86b1700 1 --2- 172.21.15.146:0/2429497132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76c01309f0 0x7f76c013a980 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f76b8009e50 tx=0x7f76b800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:30.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.129+0000 7f76c86b1700 1 -- 172.21.15.146:0/2429497132 shutdown_connections 2023-10-03T10:13:30.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.129+0000 7f76c86b1700 1 --2- 172.21.15.146:0/2429497132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76c0133ad0 0x7f76c0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.129+0000 7f76c86b1700 1 --2- 172.21.15.146:0/2429497132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76c01309f0 0x7f76c013a980 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.129+0000 7f76c86b1700 1 --2- 172.21.15.146:0/2429497132 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f76c01300a0 0x7f76c01304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.129+0000 7f76c86b1700 1 -- 172.21.15.146:0/2429497132 >> 172.21.15.146:0/2429497132 conn(0x7f76c0099c40 msgr2=0x7f76c00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.129+0000 7f76c86b1700 1 -- 172.21.15.146:0/2429497132 shutdown_connections 2023-10-03T10:13:30.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.130+0000 7f76c86b1700 1 -- 172.21.15.146:0/2429497132 wait complete. 2023-10-03T10:13:30.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.130+0000 7f76c86b1700 1 Processor -- start 2023-10-03T10:13:30.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.131+0000 7f76c86b1700 1 -- start start 2023-10-03T10:13:30.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.131+0000 7f76c86b1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76c01300a0 0x7f76c011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.131+0000 7f76c86b1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f76c01309f0 0x7f76c011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.131+0000 7f76c86b1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76c0133ad0 0x7f76c011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.131+0000 7f76c86b1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c0120bb0 con 0x7f76c0133ad0 2023-10-03T10:13:30.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.131+0000 7f76c86b1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c011ffb0 con 0x7f76c01300a0 2023-10-03T10:13:30.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.131+0000 7f76c86b1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76c01201b0 con 0x7f76c01309f0 2023-10-03T10:13:30.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.131+0000 7f76c644d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76c01300a0 0x7f76c011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.131+0000 7f76c6c4e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76c0133ad0 0x7f76c011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.131+0000 7f76c644d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76c01300a0 0x7f76c011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42798/0 (socket says 172.21.15.146:42798) 2023-10-03T10:13:30.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.131+0000 7f76c644d700 1 -- 172.21.15.146:0/3475261320 learned_addr learned my addr 172.21.15.146:0/3475261320 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:30.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.131+0000 7f76c5c4c700 1 --2- 172.21.15.146:0/3475261320 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f76c01309f0 0x7f76c011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.131+0000 7f76c644d700 1 -- 172.21.15.146:0/3475261320 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f76c01309f0 msgr2=0x7f76c011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.131+0000 7f76c644d700 1 --2- 172.21.15.146:0/3475261320 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f76c01309f0 0x7f76c011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.131+0000 7f76c644d700 1 -- 172.21.15.146:0/3475261320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76c0133ad0 msgr2=0x7f76c011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.131+0000 7f76c644d700 1 --2- 172.21.15.146:0/3475261320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76c0133ad0 0x7f76c011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.131+0000 7f76c644d700 1 -- 172.21.15.146:0/3475261320 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b8009b30 con 0x7f76c01300a0 2023-10-03T10:13:30.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.132+0000 7f76c644d700 1 --2- 172.21.15.146:0/3475261320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76c01300a0 0x7f76c011da40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00e9b0 tx=0x7f76bc00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:30.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.132+0000 7f76b6ffd700 1 -- 172.21.15.146:0/3475261320 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc009710 con 0x7f76c01300a0 2023-10-03T10:13:30.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.132+0000 7f76b6ffd700 1 -- 172.21.15.146:0/3475261320 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76bc00c850 con 0x7f76c01300a0 2023-10-03T10:13:30.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.132+0000 7f76c86b1700 1 -- 172.21.15.146:0/3475261320 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c011f560 con 0x7f76c01300a0 2023-10-03T10:13:30.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.132+0000 7f76b6ffd700 1 -- 172.21.15.146:0/3475261320 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc00cbc0 con 0x7f76c01300a0 2023-10-03T10:13:30.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.132+0000 7f76c86b1700 1 -- 172.21.15.146:0/3475261320 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c0072820 con 0x7f76c01300a0 2023-10-03T10:13:30.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.133+0000 7f76b6ffd700 1 -- 172.21.15.146:0/3475261320 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f76bc00cd20 con 0x7f76c01300a0 2023-10-03T10:13:30.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.133+0000 7f76c86b1700 1 -- 172.21.15.146:0/3475261320 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c004f2a0 con 0x7f76c01300a0 2023-10-03T10:13:30.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.133+0000 7f76b6ffd700 1 -- 172.21.15.146:0/3475261320 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f76bc03faa0 con 0x7f76c01300a0 2023-10-03T10:13:30.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.142+0000 7f76b6ffd700 1 -- 172.21.15.146:0/3475261320 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f76bc01abb0 con 0x7f76c01300a0 2023-10-03T10:13:30.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.169+0000 7f5fbd95a700 1 Processor -- start 2023-10-03T10:13:30.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.169+0000 7f5fbd95a700 1 -- start start 2023-10-03T10:13:30.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.169+0000 7f5fbd95a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fb809e870 0x7f5fb809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.169+0000 7f5fbd95a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fb809f180 0x7f5fb8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.169+0000 7f5fbd95a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5fb8131d70 0x7f5fb8132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.169+0000 7f5fbd95a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb80a0920 con 0x7f5fb8131d70 2023-10-03T10:13:30.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.169+0000 7f5fbd95a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb809c970 con 0x7f5fb809f180 2023-10-03T10:13:30.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.169+0000 7f5fbd95a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb809bab0 con 0x7f5fb809e870 2023-10-03T10:13:30.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.170+0000 7f5fb77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5fb8131d70 0x7f5fb8132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.170+0000 7f5fb67fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fb809f180 0x7f5fb8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.170+0000 7f5fb77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5fb8131d70 0x7f5fb8132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55082/0 (socket says 172.21.15.146:55082) 2023-10-03T10:13:30.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.170+0000 7f5fb77fe700 1 -- 172.21.15.146:0/3894595675 learned_addr learned my addr 172.21.15.146:0/3894595675 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:30.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.170+0000 7f5fb6ffd700 1 --2- 172.21.15.146:0/3894595675 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fb809e870 0x7f5fb809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.170+0000 7f5fb67fc700 1 -- 172.21.15.146:0/3894595675 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fb809e870 msgr2=0x7f5fb809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:30.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.170+0000 7f5fb67fc700 1 --2- 172.21.15.146:0/3894595675 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fb809e870 0x7f5fb809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.170+0000 7f5fb67fc700 1 -- 172.21.15.146:0/3894595675 >> v2:172.21.15.146:3300/0 conn(0x7f5fb8131d70 msgr2=0x7f5fb8132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:30.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.170+0000 7f5fb67fc700 1 --2- 172.21.15.146:0/3894595675 >> v2:172.21.15.146:3300/0 conn(0x7f5fb8131d70 0x7f5fb8132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.170+0000 7f5fb67fc700 1 -- 172.21.15.146:0/3894595675 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb809f9c0 con 0x7f5fb809f180 2023-10-03T10:13:30.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.170+0000 7f5fb67fc700 1 --2- 172.21.15.146:0/3894595675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fb809f180 0x7f5fb8131830 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5fac0098a0 tx=0x7f5fac009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c81a51834f6b87b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:30.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.170+0000 7f5fb5ffb700 1 -- 172.21.15.146:0/3894595675 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac004230 con 0x7f5fb809f180 2023-10-03T10:13:30.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.170+0000 7f5fb5ffb700 1 -- 172.21.15.146:0/3894595675 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fac004390 con 0x7f5fb809f180 2023-10-03T10:13:30.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.170+0000 7f5fb5ffb700 1 -- 172.21.15.146:0/3894595675 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac010890 con 0x7f5fb809f180 2023-10-03T10:13:30.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.171+0000 7f5fbd95a700 1 -- 172.21.15.146:0/3894595675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fb809f180 msgr2=0x7f5fb8131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.171+0000 7f5fbd95a700 1 --2- 172.21.15.146:0/3894595675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fb809f180 0x7f5fb8131830 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5fac0098a0 tx=0x7f5fac009bb0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.171+0000 7f5fbd95a700 1 -- 172.21.15.146:0/3894595675 shutdown_connections 2023-10-03T10:13:30.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.171+0000 7f5fbd95a700 1 --2- 172.21.15.146:0/3894595675 >> v2:172.21.15.146:3300/0 conn(0x7f5fb8131d70 0x7f5fb8132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.171+0000 7f5fbd95a700 1 --2- 172.21.15.146:0/3894595675 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fb809e870 0x7f5fb809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.171+0000 7f5fbd95a700 1 --2- 172.21.15.146:0/3894595675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fb809f180 0x7f5fb8131830 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.171+0000 7f5fbd95a700 1 -- 172.21.15.146:0/3894595675 >> 172.21.15.146:0/3894595675 conn(0x7f5fb80a4430 msgr2=0x7f5fb80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.171+0000 7f5fbd95a700 1 -- 172.21.15.146:0/3894595675 shutdown_connections 2023-10-03T10:13:30.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.171+0000 7f5fbd95a700 1 -- 172.21.15.146:0/3894595675 wait complete. 2023-10-03T10:13:30.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.173+0000 7f5fbd95a700 1 Processor -- start 2023-10-03T10:13:30.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.173+0000 7f5fbd95a700 1 -- start start 2023-10-03T10:13:30.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.174+0000 7f5fbd95a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fb809e870 0x7f5fb81c0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.174+0000 7f5fbd95a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fb809f180 0x7f5fb81c1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.174+0000 7f5fbd95a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fb8131d70 0x7f5fb81c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.174+0000 7f5fbd95a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb811e710 con 0x7f5fb8131d70 2023-10-03T10:13:30.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.174+0000 7f5fbd95a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb81c18c0 con 0x7f5fb809f180 2023-10-03T10:13:30.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.174+0000 7f5fbd95a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb811ca00 con 0x7f5fb809e870 2023-10-03T10:13:30.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.174+0000 7f5fb77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fb8131d70 0x7f5fb81c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.174+0000 7f5fb77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fb8131d70 0x7f5fb81c3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55092/0 (socket says 172.21.15.146:55092) 2023-10-03T10:13:30.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.174+0000 7f5fb77fe700 1 -- 172.21.15.146:0/1603510650 learned_addr learned my addr 172.21.15.146:0/1603510650 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:30.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.174+0000 7f5fb6ffd700 1 --2- 172.21.15.146:0/1603510650 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fb809e870 0x7f5fb81c0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.174+0000 7f5fb67fc700 1 --2- 172.21.15.146:0/1603510650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fb809f180 0x7f5fb81c1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.174+0000 7f5fb6ffd700 1 -- 172.21.15.146:0/1603510650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fb809f180 msgr2=0x7f5fb81c1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.174+0000 7f5fb6ffd700 1 --2- 172.21.15.146:0/1603510650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fb809f180 0x7f5fb81c1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.174+0000 7f5fb6ffd700 1 -- 172.21.15.146:0/1603510650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fb8131d70 msgr2=0x7f5fb81c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.174+0000 7f5fb6ffd700 1 --2- 172.21.15.146:0/1603510650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fb8131d70 0x7f5fb81c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.174+0000 7f5fb6ffd700 1 -- 172.21.15.146:0/1603510650 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fac0094a0 con 0x7f5fb809e870 2023-10-03T10:13:30.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.174+0000 7f5fb77fe700 1 --2- 172.21.15.146:0/1603510650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fb8131d70 0x7f5fb81c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.174+0000 7f5fb6ffd700 1 --2- 172.21.15.146:0/1603510650 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fb809e870 0x7f5fb81c0e40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800e630 tx=0x7f5fa800e940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.174+0000 7f5f9ffff700 1 -- 172.21.15.146:0/1603510650 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa800c070 con 0x7f5fb809e870 2023-10-03T10:13:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.175+0000 7f5fbd95a700 1 -- 172.21.15.146:0/1603510650 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb809dba0 con 0x7f5fb809e870 2023-10-03T10:13:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.175+0000 7f5f9ffff700 1 -- 172.21.15.146:0/1603510650 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa8013610 con 0x7f5fb809e870 2023-10-03T10:13:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.175+0000 7f5f9ffff700 1 -- 172.21.15.146:0/1603510650 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8013980 con 0x7f5fb809e870 2023-10-03T10:13:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.175+0000 7f5fbd95a700 1 -- 172.21.15.146:0/1603510650 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb811e910 con 0x7f5fb809e870 2023-10-03T10:13:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.176+0000 7f5fbd95a700 1 -- 172.21.15.146:0/1603510650 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb804f2a0 con 0x7f5fb809e870 2023-10-03T10:13:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.176+0000 7f5f9ffff700 1 -- 172.21.15.146:0/1603510650 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5fa8013ae0 con 0x7f5fb809e870 2023-10-03T10:13:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.176+0000 7f5f9ffff700 1 -- 172.21.15.146:0/1603510650 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5fa803f3f0 con 0x7f5fb809e870 2023-10-03T10:13:30.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.185+0000 7f5f9ffff700 1 -- 172.21.15.146:0/1603510650 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5fa8012960 con 0x7f5fb809e870 2023-10-03T10:13:30.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.223+0000 7fa23f38a700 1 Processor -- start 2023-10-03T10:13:30.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.223+0000 7fa23f38a700 1 -- start start 2023-10-03T10:13:30.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.223+0000 7fa23f38a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa23809ad40 0x7fa238133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.223+0000 7fa23f38a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa238133f70 0x7fa2381343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.223+0000 7fa23f38a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23809b110 con 0x7fa2380a0a70 2023-10-03T10:13:30.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.223+0000 7fa23f38a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2380a3b60 con 0x7fa238133f70 2023-10-03T10:13:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.223+0000 7fa23f38a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2381348e0 con 0x7fa23809ad40 2023-10-03T10:13:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.223+0000 7fa23d927700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa2380a0a70 0x7fa2380a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48022/0 (socket says 172.21.15.146:48022) 2023-10-03T10:13:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.223+0000 7fa23d927700 1 -- 172.21.15.146:0/2485655922 learned_addr learned my addr 172.21.15.146:0/2485655922 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.223+0000 7fa23d126700 1 --2- 172.21.15.146:0/2485655922 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa23809ad40 0x7fa238133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.224+0000 7fa23c925700 1 --2- 172.21.15.146:0/2485655922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa238133f70 0x7fa2381343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.224+0000 7fa22ffff700 1 -- 172.21.15.146:0/2485655922 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687064453 0 0) 0x7fa23809b110 con 0x7fa2380a0a70 2023-10-03T10:13:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.224+0000 7fa22ffff700 1 -- 172.21.15.146:0/2485655922 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2240035b0 con 0x7fa2380a0a70 2023-10-03T10:13:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.224+0000 7fa23c925700 1 -- 172.21.15.146:0/2485655922 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa23809ad40 msgr2=0x7fa238133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:30.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.224+0000 7fa23c925700 1 --2- 172.21.15.146:0/2485655922 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa23809ad40 0x7fa238133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.224+0000 7fa23c925700 1 -- 172.21.15.146:0/2485655922 >> v1:172.21.15.146:6789/0 conn(0x7fa2380a0a70 legacy=0x7fa2380a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.224+0000 7fa23c925700 1 -- 172.21.15.146:0/2485655922 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2380a2fa0 con 0x7fa238133f70 2023-10-03T10:13:30.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.224+0000 7fa23c925700 1 --2- 172.21.15.146:0/2485655922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa238133f70 0x7fa2381343a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa228009870 tx=0x7fa228009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd5d2753e811304e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:30.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.224+0000 7fa22ffff700 1 -- 172.21.15.146:0/2485655922 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228011830 con 0x7fa238133f70 2023-10-03T10:13:30.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.224+0000 7fa22ffff700 1 -- 172.21.15.146:0/2485655922 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa228011990 con 0x7fa238133f70 2023-10-03T10:13:30.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.224+0000 7fa22ffff700 1 -- 172.21.15.146:0/2485655922 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228011d20 con 0x7fa238133f70 2023-10-03T10:13:30.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.225+0000 7fa23f38a700 1 -- 172.21.15.146:0/2485655922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa238133f70 msgr2=0x7fa2381343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.225+0000 7fa23f38a700 1 --2- 172.21.15.146:0/2485655922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa238133f70 0x7fa2381343a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa228009870 tx=0x7fa228009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:30.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.225+0000 7fa23f38a700 1 -- 172.21.15.146:0/2485655922 shutdown_connections 2023-10-03T10:13:30.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.225+0000 7fa23f38a700 1 --2- 172.21.15.146:0/2485655922 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa23809ad40 0x7fa238133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.225+0000 7fa23f38a700 1 --2- 172.21.15.146:0/2485655922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa238133f70 0x7fa2381343a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.225+0000 7fa23f38a700 1 -- 172.21.15.146:0/2485655922 >> 172.21.15.146:0/2485655922 conn(0x7fa238099c40 msgr2=0x7fa23806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.225+0000 7fa23f38a700 1 -- 172.21.15.146:0/2485655922 shutdown_connections 2023-10-03T10:13:30.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.225+0000 7fa23f38a700 1 -- 172.21.15.146:0/2485655922 wait complete. 2023-10-03T10:13:30.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.225+0000 7fddf2e9e700 1 -- 172.21.15.146:0/1615036358 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fddec04f2a0 con 0x7fddec06a770 2023-10-03T10:13:30.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.226+0000 7fdde97fa700 1 -- 172.21.15.146:0/1615036358 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdde0024470 con 0x7fddec06a770 2023-10-03T10:13:30.230 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:30.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.226+0000 7fa23f38a700 1 Processor -- start 2023-10-03T10:13:30.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.226+0000 7fa23f38a700 1 -- start start 2023-10-03T10:13:30.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.226+0000 7fa23f38a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa23809ad40 0x7fa23811f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.227+0000 7fa23f38a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2380a0a70 0x7fa23811fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.227+0000 7fa23f38a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa238133f70 0x7fa2381c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.227+0000 7fa23f38a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa238121340 con 0x7fa238133f70 2023-10-03T10:13:30.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.227+0000 7fa23f38a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa238122020 con 0x7fa23809ad40 2023-10-03T10:13:30.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.227+0000 7fa23f38a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2381333a0 con 0x7fa2380a0a70 2023-10-03T10:13:30.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.227+0000 7fa23d126700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa23809ad40 0x7fa23811f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.227+0000 7fa23d126700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa23809ad40 0x7fa23811f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42822/0 (socket says 172.21.15.146:42822) 2023-10-03T10:13:30.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.227+0000 7fa23d126700 1 -- 172.21.15.146:0/1592441847 learned_addr learned my addr 172.21.15.146:0/1592441847 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:30.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.227+0000 7fa23d927700 1 --2- 172.21.15.146:0/1592441847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa238133f70 0x7fa2381c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.227+0000 7fa23c925700 1 --2- 172.21.15.146:0/1592441847 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2380a0a70 0x7fa23811fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.227+0000 7fa23d126700 1 -- 172.21.15.146:0/1592441847 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2380a0a70 msgr2=0x7fa23811fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.227+0000 7fa23d126700 1 --2- 172.21.15.146:0/1592441847 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2380a0a70 0x7fa23811fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.227+0000 7fa23d126700 1 -- 172.21.15.146:0/1592441847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa238133f70 msgr2=0x7fa2381c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.227+0000 7fa23d126700 1 --2- 172.21.15.146:0/1592441847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa238133f70 0x7fa2381c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.227+0000 7fa23d126700 1 -- 172.21.15.146:0/1592441847 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2280094a0 con 0x7fa23809ad40 2023-10-03T10:13:30.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.227+0000 7fa23d126700 1 --2- 172.21.15.146:0/1592441847 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa23809ad40 0x7fa23811f510 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa23400e870 tx=0x7fa23400eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:30.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.227+0000 7fa22dffb700 1 -- 172.21.15.146:0/1592441847 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa234009590 con 0x7fa23809ad40 2023-10-03T10:13:30.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.227+0000 7fa22dffb700 1 -- 172.21.15.146:0/1592441847 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa234013680 con 0x7fa23809ad40 2023-10-03T10:13:30.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.227+0000 7fa23f38a700 1 -- 172.21.15.146:0/1592441847 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2381222b0 con 0x7fa23809ad40 2023-10-03T10:13:30.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.227+0000 7fa22dffb700 1 -- 172.21.15.146:0/1592441847 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2340139f0 con 0x7fa23809ad40 2023-10-03T10:13:30.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.228+0000 7fa23f38a700 1 -- 172.21.15.146:0/1592441847 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23809e7f0 con 0x7fa23809ad40 2023-10-03T10:13:30.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.229+0000 7fa23f38a700 1 -- 172.21.15.146:0/1592441847 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23804f2a0 con 0x7fa23809ad40 2023-10-03T10:13:30.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.229+0000 7fddf2e9e700 1 -- 172.21.15.146:0/1615036358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddec06a770 msgr2=0x7fddec119630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.229+0000 7fddf2e9e700 1 --2- 172.21.15.146:0/1615036358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddec06a770 0x7fddec119630 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fdde0009c40 tx=0x7fdde0004750 comp rx=0 tx=0).stop 2023-10-03T10:13:30.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.229+0000 7fa22dffb700 1 -- 172.21.15.146:0/1592441847 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa234013b50 con 0x7fa23809ad40 2023-10-03T10:13:30.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.229+0000 7fa22dffb700 1 -- 172.21.15.146:0/1592441847 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa23403fe10 con 0x7fa23809ad40 2023-10-03T10:13:30.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.233+0000 7fddf2e9e700 1 -- 172.21.15.146:0/1615036358 shutdown_connections 2023-10-03T10:13:30.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.233+0000 7fddf2e9e700 1 --2- 172.21.15.146:0/1615036358 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fddec131ec0 0x7fddec11a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.233+0000 7fddf2e9e700 1 --2- 172.21.15.146:0/1615036358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddec06a770 0x7fddec119630 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.233+0000 7fddf2e9e700 1 --2- 172.21.15.146:0/1615036358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddec06b080 0x7fddec119b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.233+0000 7fddf2e9e700 1 -- 172.21.15.146:0/1615036358 >> 172.21.15.146:0/1615036358 conn(0x7fddec099c40 msgr2=0x7fddec09a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.233+0000 7fddf2e9e700 1 -- 172.21.15.146:0/1615036358 shutdown_connections 2023-10-03T10:13:30.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.233+0000 7fddf2e9e700 1 -- 172.21.15.146:0/1615036358 wait complete. 2023-10-03T10:13:30.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.233+0000 7fa22dffb700 1 -- 172.21.15.146:0/1592441847 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa23400c7d0 con 0x7fa23809ad40 2023-10-03T10:13:30.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:30.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.348+0000 7f76c86b1700 1 -- 172.21.15.146:0/3475261320 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f76c011f110 con 0x7f76c01300a0 2023-10-03T10:13:30.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.348+0000 7f76b6ffd700 1 -- 172.21.15.146:0/3475261320 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f76bc017020 con 0x7f76c01300a0 2023-10-03T10:13:30.349 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:30.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.350+0000 7f76c86b1700 1 -- 172.21.15.146:0/3475261320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76c01300a0 msgr2=0x7f76c011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.350+0000 7f76c86b1700 1 --2- 172.21.15.146:0/3475261320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76c01300a0 0x7f76c011da40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00e9b0 tx=0x7f76bc00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.350+0000 7f76c86b1700 1 -- 172.21.15.146:0/3475261320 shutdown_connections 2023-10-03T10:13:30.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.350+0000 7f76c86b1700 1 --2- 172.21.15.146:0/3475261320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76c0133ad0 0x7f76c011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.350+0000 7f76c86b1700 1 --2- 172.21.15.146:0/3475261320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76c01300a0 0x7f76c011da40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.350+0000 7f76c86b1700 1 --2- 172.21.15.146:0/3475261320 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f76c01309f0 0x7f76c011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.350+0000 7f76c86b1700 1 -- 172.21.15.146:0/3475261320 >> 172.21.15.146:0/3475261320 conn(0x7f76c0099c40 msgr2=0x7f76c012e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.350+0000 7f76c86b1700 1 -- 172.21.15.146:0/3475261320 shutdown_connections 2023-10-03T10:13:30.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.350+0000 7f76c86b1700 1 -- 172.21.15.146:0/3475261320 wait complete. 2023-10-03T10:13:30.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.401+0000 7f5fbd95a700 1 -- 172.21.15.146:0/1603510650 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5fb806b2a0 con 0x7f5fb809e870 2023-10-03T10:13:30.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.402+0000 7f5f9ffff700 1 -- 172.21.15.146:0/1603510650 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5fa8012370 con 0x7f5fb809e870 2023-10-03T10:13:30.403 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:30.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.405+0000 7f5fbd95a700 1 -- 172.21.15.146:0/1603510650 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fb809e870 msgr2=0x7f5fb81c0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.405+0000 7f5fbd95a700 1 --2- 172.21.15.146:0/1603510650 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fb809e870 0x7f5fb81c0e40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800e630 tx=0x7f5fa800e940 comp rx=0 tx=0).stop 2023-10-03T10:13:30.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.405+0000 7f5fbd95a700 1 -- 172.21.15.146:0/1603510650 shutdown_connections 2023-10-03T10:13:30.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.405+0000 7f5fbd95a700 1 --2- 172.21.15.146:0/1603510650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fb8131d70 0x7f5fb81c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.405+0000 7f5fbd95a700 1 --2- 172.21.15.146:0/1603510650 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fb809e870 0x7f5fb81c0e40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.405+0000 7f5fbd95a700 1 --2- 172.21.15.146:0/1603510650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fb809f180 0x7f5fb81c1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.405+0000 7f5fbd95a700 1 -- 172.21.15.146:0/1603510650 >> 172.21.15.146:0/1603510650 conn(0x7f5fb80a4430 msgr2=0x7f5fb8130050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.405+0000 7f5fbd95a700 1 -- 172.21.15.146:0/1603510650 shutdown_connections 2023-10-03T10:13:30.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.405+0000 7f5fbd95a700 1 -- 172.21.15.146:0/1603510650 wait complete. 2023-10-03T10:13:30.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:30.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.436+0000 7fa23f38a700 1 -- 172.21.15.146:0/1592441847 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa238120e10 con 0x7fa23809ad40 2023-10-03T10:13:30.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.436+0000 7fa22dffb700 1 -- 172.21.15.146:0/1592441847 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa234024b40 con 0x7fa23809ad40 2023-10-03T10:13:30.437 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:30.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.438+0000 7fa23f38a700 1 -- 172.21.15.146:0/1592441847 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa23809ad40 msgr2=0x7fa23811f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.438+0000 7fa23f38a700 1 --2- 172.21.15.146:0/1592441847 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa23809ad40 0x7fa23811f510 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa23400e870 tx=0x7fa23400eb80 comp rx=0 tx=0).stop 2023-10-03T10:13:30.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.438+0000 7fa23f38a700 1 -- 172.21.15.146:0/1592441847 shutdown_connections 2023-10-03T10:13:30.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.438+0000 7fa23f38a700 1 --2- 172.21.15.146:0/1592441847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa238133f70 0x7fa2381c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.438+0000 7fa23f38a700 1 --2- 172.21.15.146:0/1592441847 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa23809ad40 0x7fa23811f510 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.438+0000 7fa23f38a700 1 --2- 172.21.15.146:0/1592441847 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2380a0a70 0x7fa23811fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.438+0000 7fa23f38a700 1 -- 172.21.15.146:0/1592441847 >> 172.21.15.146:0/1592441847 conn(0x7fa238099c40 msgr2=0x7fa2381bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.438+0000 7fa23f38a700 1 -- 172.21.15.146:0/1592441847 shutdown_connections 2023-10-03T10:13:30.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:30.438+0000 7fa23f38a700 1 -- 172.21.15.146:0/1592441847 wait complete. 2023-10-03T10:13:30.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:31.255 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:31.363 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:31.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.395+0000 7fd965d3e700 1 Processor -- start 2023-10-03T10:13:31.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.395+0000 7fd965d3e700 1 -- start start 2023-10-03T10:13:31.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.395+0000 7fd965d3e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd9600a0a70 0x7fd9600a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.395+0000 7fd965d3e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9600a1380 0x7fd960133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.395+0000 7fd965d3e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd960133f50 0x7fd9601343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.395+0000 7fd965d3e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96009e9d0 con 0x7fd9600a0a70 2023-10-03T10:13:31.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.395+0000 7fd965d3e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96009dc00 con 0x7fd960133f50 2023-10-03T10:13:31.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.395+0000 7fd965d3e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd96009dec0 con 0x7fd9600a1380 2023-10-03T10:13:31.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.395+0000 7fd95f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd9600a0a70 0x7fd9600a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.395+0000 7fd95ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd960133f50 0x7fd9601343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.395+0000 7fd95f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd9600a0a70 0x7fd9600a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55120/0 (socket says 172.21.15.146:55120) 2023-10-03T10:13:31.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.395+0000 7fd95f7fe700 1 -- 172.21.15.146:0/1987511444 learned_addr learned my addr 172.21.15.146:0/1987511444 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:31.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.395+0000 7fd95effd700 1 --2- 172.21.15.146:0/1987511444 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9600a1380 0x7fd960133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.396+0000 7fd95ffff700 1 -- 172.21.15.146:0/1987511444 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9600a1380 msgr2=0x7fd960133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.396+0000 7fd95ffff700 1 --2- 172.21.15.146:0/1987511444 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9600a1380 0x7fd960133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.396+0000 7fd95ffff700 1 -- 172.21.15.146:0/1987511444 >> v2:172.21.15.146:3300/0 conn(0x7fd9600a0a70 msgr2=0x7fd9600a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.396+0000 7fd95ffff700 1 --2- 172.21.15.146:0/1987511444 >> v2:172.21.15.146:3300/0 conn(0x7fd9600a0a70 0x7fd9600a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.396+0000 7fd95ffff700 1 -- 172.21.15.146:0/1987511444 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96009e6a0 con 0x7fd960133f50 2023-10-03T10:13:31.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.396+0000 7fd95f7fe700 1 --2- 172.21.15.146:0/1987511444 >> v2:172.21.15.146:3300/0 conn(0x7fd9600a0a70 0x7fd9600a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:31.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.396+0000 7fd95effd700 1 --2- 172.21.15.146:0/1987511444 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9600a1380 0x7fd960133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:31.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.396+0000 7fd95ffff700 1 --2- 172.21.15.146:0/1987511444 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd960133f50 0x7fd9601343b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd958009d90 tx=0x7fd95800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6257a1314506eb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.396+0000 7fd95e7fc700 1 -- 172.21.15.146:0/1987511444 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95800e070 con 0x7fd960133f50 2023-10-03T10:13:31.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.396+0000 7fd95e7fc700 1 -- 172.21.15.146:0/1987511444 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95800bb20 con 0x7fd960133f50 2023-10-03T10:13:31.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.396+0000 7fd95e7fc700 1 -- 172.21.15.146:0/1987511444 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd958012430 con 0x7fd960133f50 2023-10-03T10:13:31.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.397+0000 7fd965d3e700 1 -- 172.21.15.146:0/1987511444 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd960133f50 msgr2=0x7fd9601343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.397+0000 7fd965d3e700 1 --2- 172.21.15.146:0/1987511444 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd960133f50 0x7fd9601343b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd958009d90 tx=0x7fd95800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:31.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.397+0000 7fd965d3e700 1 -- 172.21.15.146:0/1987511444 shutdown_connections 2023-10-03T10:13:31.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.397+0000 7fd965d3e700 1 --2- 172.21.15.146:0/1987511444 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd960133f50 0x7fd9601343b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.397+0000 7fd965d3e700 1 --2- 172.21.15.146:0/1987511444 >> v2:172.21.15.146:3300/0 conn(0x7fd9600a0a70 0x7fd9600a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.397+0000 7fd965d3e700 1 --2- 172.21.15.146:0/1987511444 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9600a1380 0x7fd960133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.397+0000 7fd965d3e700 1 -- 172.21.15.146:0/1987511444 >> 172.21.15.146:0/1987511444 conn(0x7fd9600a6610 msgr2=0x7fd9600a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.397+0000 7fd965d3e700 1 -- 172.21.15.146:0/1987511444 shutdown_connections 2023-10-03T10:13:31.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.397+0000 7fd965d3e700 1 -- 172.21.15.146:0/1987511444 wait complete. 2023-10-03T10:13:31.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.398+0000 7fd965d3e700 1 Processor -- start 2023-10-03T10:13:31.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.398+0000 7fd965d3e700 1 -- start start 2023-10-03T10:13:31.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.398+0000 7fd965d3e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9600a0a70 0x7fd960121560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.398+0000 7fd965d3e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9600a1380 0x7fd960121aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.398+0000 7fd965d3e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd960133f50 0x7fd960121fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.398+0000 7fd965d3e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd960124cd0 con 0x7fd9600a1380 2023-10-03T10:13:31.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.398+0000 7fd965d3e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd960124eb0 con 0x7fd960133f50 2023-10-03T10:13:31.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.398+0000 7fd965d3e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd960122930 con 0x7fd9600a0a70 2023-10-03T10:13:31.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.398+0000 7fd95f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9600a0a70 0x7fd960121560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.399+0000 7fd95ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd960133f50 0x7fd960121fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.399+0000 7fd95f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9600a0a70 0x7fd960121560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:60718/0 (socket says 172.21.15.146:60718) 2023-10-03T10:13:31.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.399+0000 7fd95f7fe700 1 -- 172.21.15.146:0/3218487642 learned_addr learned my addr 172.21.15.146:0/3218487642 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:31.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.399+0000 7fd95effd700 1 --2- 172.21.15.146:0/3218487642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9600a1380 0x7fd960121aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.399+0000 7fd95f7fe700 1 -- 172.21.15.146:0/3218487642 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd960133f50 msgr2=0x7fd960121fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.399+0000 7fd95f7fe700 1 --2- 172.21.15.146:0/3218487642 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd960133f50 0x7fd960121fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.399+0000 7fd95f7fe700 1 -- 172.21.15.146:0/3218487642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9600a1380 msgr2=0x7fd960121aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.399+0000 7fd95f7fe700 1 --2- 172.21.15.146:0/3218487642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9600a1380 0x7fd960121aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.399+0000 7fd95f7fe700 1 -- 172.21.15.146:0/3218487642 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd950009550 con 0x7fd9600a0a70 2023-10-03T10:13:31.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.399+0000 7fd95effd700 1 --2- 172.21.15.146:0/3218487642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9600a1380 0x7fd960121aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:31.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.399+0000 7fd95f7fe700 1 --2- 172.21.15.146:0/3218487642 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9600a0a70 0x7fd960121560 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd95000ebe0 tx=0x7fd95000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.399+0000 7fd947fff700 1 -- 172.21.15.146:0/3218487642 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd950004030 con 0x7fd9600a0a70 2023-10-03T10:13:31.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.399+0000 7fd947fff700 1 -- 172.21.15.146:0/3218487642 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd950004190 con 0x7fd9600a0a70 2023-10-03T10:13:31.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.399+0000 7fd965d3e700 1 -- 172.21.15.146:0/3218487642 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9540094a0 con 0x7fd9600a0a70 2023-10-03T10:13:31.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.399+0000 7fd947fff700 1 -- 172.21.15.146:0/3218487642 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd950004520 con 0x7fd9600a0a70 2023-10-03T10:13:31.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.399+0000 7fd965d3e700 1 -- 172.21.15.146:0/3218487642 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd958009a70 con 0x7fd9600a0a70 2023-10-03T10:13:31.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.400+0000 7fd947fff700 1 -- 172.21.15.146:0/3218487642 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd95000c850 con 0x7fd9600a0a70 2023-10-03T10:13:31.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.400+0000 7fd947fff700 1 -- 172.21.15.146:0/3218487642 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd95003f8f0 con 0x7fd9600a0a70 2023-10-03T10:13:31.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.400+0000 7fd965d3e700 1 -- 172.21.15.146:0/3218487642 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd960124b10 con 0x7fd9600a0a70 2023-10-03T10:13:31.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.405+0000 7fd947fff700 1 -- 172.21.15.146:0/3218487642 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd960124b10 con 0x7fd9600a0a70 2023-10-03T10:13:31.422 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:31.452 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:31.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.513+0000 7f685b606700 1 Processor -- start 2023-10-03T10:13:31.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.513+0000 7f685b606700 1 -- start start 2023-10-03T10:13:31.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.514+0000 7f685b606700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6854133900 0x7f6854133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.514+0000 7f685b606700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6854134210 0x7f68540a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.514+0000 7f685b606700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f68540a0ee0 0x7f68540a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.514+0000 7f685b606700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685409a760 con 0x7f6854134210 2023-10-03T10:13:31.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.514+0000 7f685b606700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68541336e0 con 0x7f6854133900 2023-10-03T10:13:31.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.514+0000 7f685b606700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f685409a080 con 0x7f68540a0ee0 2023-10-03T10:13:31.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.514+0000 7f68593a2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6854133900 0x7f6854133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.514+0000 7f68593a2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6854133900 0x7f6854133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42842/0 (socket says 172.21.15.146:42842) 2023-10-03T10:13:31.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.514+0000 7f68593a2700 1 -- 172.21.15.146:0/2220524751 learned_addr learned my addr 172.21.15.146:0/2220524751 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:31.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.514+0000 7f6859ba3700 1 --2- 172.21.15.146:0/2220524751 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f68540a0ee0 0x7f68540a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.514+0000 7f6858ba1700 1 --2- 172.21.15.146:0/2220524751 >> v2:172.21.15.146:3300/0 conn(0x7f6854134210 0x7f68540a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.514+0000 7f6859ba3700 1 -- 172.21.15.146:0/2220524751 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6854133900 msgr2=0x7f6854133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.514+0000 7f6859ba3700 1 --2- 172.21.15.146:0/2220524751 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6854133900 0x7f6854133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.514+0000 7f6859ba3700 1 -- 172.21.15.146:0/2220524751 >> v2:172.21.15.146:3300/0 conn(0x7f6854134210 msgr2=0x7f68540a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.514+0000 7f6859ba3700 1 --2- 172.21.15.146:0/2220524751 >> v2:172.21.15.146:3300/0 conn(0x7f6854134210 0x7f68540a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.514+0000 7f6859ba3700 1 -- 172.21.15.146:0/2220524751 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68540a23e0 con 0x7f68540a0ee0 2023-10-03T10:13:31.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.514+0000 7f68593a2700 1 --2- 172.21.15.146:0/2220524751 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6854133900 0x7f6854133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:31.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.515+0000 7f6859ba3700 1 --2- 172.21.15.146:0/2220524751 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f68540a0ee0 0x7f68540a1360 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f684c009d90 tx=0x7f684c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fa5e653ead3ef2c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.515+0000 7f684bfff700 1 -- 172.21.15.146:0/2220524751 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c00e070 con 0x7f68540a0ee0 2023-10-03T10:13:31.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.515+0000 7f684bfff700 1 -- 172.21.15.146:0/2220524751 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684c00bb20 con 0x7f68540a0ee0 2023-10-03T10:13:31.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.515+0000 7f684bfff700 1 -- 172.21.15.146:0/2220524751 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c012430 con 0x7f68540a0ee0 2023-10-03T10:13:31.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.516+0000 7f685b606700 1 -- 172.21.15.146:0/2220524751 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f68540a0ee0 msgr2=0x7f68540a1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.516+0000 7f685b606700 1 --2- 172.21.15.146:0/2220524751 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f68540a0ee0 0x7f68540a1360 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f684c009d90 tx=0x7f684c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:31.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.516+0000 7f685b606700 1 -- 172.21.15.146:0/2220524751 shutdown_connections 2023-10-03T10:13:31.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.516+0000 7f685b606700 1 --2- 172.21.15.146:0/2220524751 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6854133900 0x7f6854133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.516+0000 7f685b606700 1 --2- 172.21.15.146:0/2220524751 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f68540a0ee0 0x7f68540a1360 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.516+0000 7f685b606700 1 --2- 172.21.15.146:0/2220524751 >> v2:172.21.15.146:3300/0 conn(0x7f6854134210 0x7f68540a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.516+0000 7f685b606700 1 -- 172.21.15.146:0/2220524751 >> 172.21.15.146:0/2220524751 conn(0x7f68540a2980 msgr2=0x7f68540a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.516+0000 7f685b606700 1 -- 172.21.15.146:0/2220524751 shutdown_connections 2023-10-03T10:13:31.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.516+0000 7f685b606700 1 -- 172.21.15.146:0/2220524751 wait complete. 2023-10-03T10:13:31.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.517+0000 7f685b606700 1 Processor -- start 2023-10-03T10:13:31.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.517+0000 7f685b606700 1 -- start start 2023-10-03T10:13:31.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.517+0000 7f685b606700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68540a0ee0 0x7f685411d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.517+0000 7f685b606700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6854133900 0x7f685411dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.517+0000 7f685b606700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6854134210 0x7f685411e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.517+0000 7f685b606700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68541213c0 con 0x7f68540a0ee0 2023-10-03T10:13:31.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.517+0000 7f685b606700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685411fa90 con 0x7f6854133900 2023-10-03T10:13:31.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.517+0000 7f685b606700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6854120b50 con 0x7f6854134210 2023-10-03T10:13:31.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.517+0000 7f6858ba1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6854133900 0x7f685411dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.517+0000 7f6858ba1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6854133900 0x7f685411dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42858/0 (socket says 172.21.15.146:42858) 2023-10-03T10:13:31.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.517+0000 7f6858ba1700 1 -- 172.21.15.146:0/784578235 learned_addr learned my addr 172.21.15.146:0/784578235 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:31.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.517+0000 7f6859ba3700 1 --2- 172.21.15.146:0/784578235 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6854134210 0x7f685411e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.517+0000 7f68593a2700 1 --2- 172.21.15.146:0/784578235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68540a0ee0 0x7f685411d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.518+0000 7f6859ba3700 1 -- 172.21.15.146:0/784578235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6854133900 msgr2=0x7f685411dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.518+0000 7f6859ba3700 1 --2- 172.21.15.146:0/784578235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6854133900 0x7f685411dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.518+0000 7f6859ba3700 1 -- 172.21.15.146:0/784578235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68540a0ee0 msgr2=0x7f685411d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.518+0000 7f6859ba3700 1 --2- 172.21.15.146:0/784578235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68540a0ee0 0x7f685411d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.518+0000 7f6859ba3700 1 -- 172.21.15.146:0/784578235 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6850009500 con 0x7f6854134210 2023-10-03T10:13:31.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.518+0000 7f6858ba1700 1 --2- 172.21.15.146:0/784578235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6854133900 0x7f685411dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:31.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.518+0000 7f6859ba3700 1 --2- 172.21.15.146:0/784578235 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6854134210 0x7f685411e320 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f684c016000 tx=0x7f684c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.518+0000 7f6849ffb700 1 -- 172.21.15.146:0/784578235 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c004800 con 0x7f6854134210 2023-10-03T10:13:31.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.518+0000 7f6849ffb700 1 -- 172.21.15.146:0/784578235 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684c020070 con 0x7f6854134210 2023-10-03T10:13:31.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.518+0000 7f685b606700 1 -- 172.21.15.146:0/784578235 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684c009a70 con 0x7f6854134210 2023-10-03T10:13:31.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.518+0000 7f6849ffb700 1 -- 172.21.15.146:0/784578235 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c0276c0 con 0x7f6854134210 2023-10-03T10:13:31.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.518+0000 7f685b606700 1 -- 172.21.15.146:0/784578235 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68540a3150 con 0x7f6854134210 2023-10-03T10:13:31.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.519+0000 7f6849ffb700 1 -- 172.21.15.146:0/784578235 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f684c012430 con 0x7f6854134210 2023-10-03T10:13:31.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.519+0000 7f6849ffb700 1 -- 172.21.15.146:0/784578235 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f684c022070 con 0x7f6854134210 2023-10-03T10:13:31.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.520+0000 7f685b606700 1 -- 172.21.15.146:0/784578235 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6854120d80 con 0x7f6854134210 2023-10-03T10:13:31.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.524+0000 7f6849ffb700 1 -- 172.21.15.146:0/784578235 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6854120d80 con 0x7f6854134210 2023-10-03T10:13:31.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.569+0000 7f051a709700 1 Processor -- start 2023-10-03T10:13:31.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.569+0000 7f051a709700 1 -- start start 2023-10-03T10:13:31.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.570+0000 7f051a709700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0514130a20 0x7f0514138820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.570+0000 7f051a709700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0514138d60 0x7f051413b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.570+0000 7f051a709700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f051406fe50 con 0x7f0514066410 2023-10-03T10:13:31.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.570+0000 7f051a709700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f051409f530 con 0x7f0514130a20 2023-10-03T10:13:31.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.570+0000 7f051a709700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0514066810 con 0x7f0514138d60 2023-10-03T10:13:31.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.570+0000 7f05137fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0514130a20 0x7f0514138820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.570+0000 7f0513fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0514066410 0x7f0514130310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48036/0 (socket says 172.21.15.146:48036) 2023-10-03T10:13:31.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.570+0000 7f0513fff700 1 -- 172.21.15.146:0/670796230 learned_addr learned my addr 172.21.15.146:0/670796230 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:31.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.570+0000 7f0518ca6700 1 --2- 172.21.15.146:0/670796230 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0514138d60 0x7f051413b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.570+0000 7f05137fe700 1 -- 172.21.15.146:0/670796230 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0514138d60 msgr2=0x7f051413b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.570+0000 7f05137fe700 1 --2- 172.21.15.146:0/670796230 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0514138d60 0x7f051413b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.570+0000 7f05137fe700 1 -- 172.21.15.146:0/670796230 >> v1:172.21.15.146:6789/0 conn(0x7f0514066410 legacy=0x7f0514130310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.570+0000 7f05137fe700 1 -- 172.21.15.146:0/670796230 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051406f120 con 0x7f0514130a20 2023-10-03T10:13:31.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.571+0000 7f05137fe700 1 --2- 172.21.15.146:0/670796230 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0514130a20 0x7f0514138820 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0508009840 tx=0x7f0508009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc3dffe56416f08 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.571+0000 7f0512ffd700 1 -- 172.21.15.146:0/670796230 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0508004230 con 0x7f0514130a20 2023-10-03T10:13:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.571+0000 7f0512ffd700 1 -- 172.21.15.146:0/670796230 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0508004390 con 0x7f0514130a20 2023-10-03T10:13:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.571+0000 7f0512ffd700 1 -- 172.21.15.146:0/670796230 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05080036a0 con 0x7f0514130a20 2023-10-03T10:13:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.571+0000 7f051a709700 1 -- 172.21.15.146:0/670796230 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0514130a20 msgr2=0x7f0514138820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.571+0000 7f051a709700 1 --2- 172.21.15.146:0/670796230 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0514130a20 0x7f0514138820 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0508009840 tx=0x7f0508009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.571+0000 7f051a709700 1 -- 172.21.15.146:0/670796230 shutdown_connections 2023-10-03T10:13:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.571+0000 7f051a709700 1 --2- 172.21.15.146:0/670796230 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0514138d60 0x7f051413b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.571+0000 7f051a709700 1 --2- 172.21.15.146:0/670796230 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0514130a20 0x7f0514138820 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.572+0000 7f051a709700 1 -- 172.21.15.146:0/670796230 >> 172.21.15.146:0/670796230 conn(0x7f05140a2810 msgr2=0x7f05140a2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.572+0000 7f051a709700 1 -- 172.21.15.146:0/670796230 shutdown_connections 2023-10-03T10:13:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.572+0000 7f051a709700 1 -- 172.21.15.146:0/670796230 wait complete. 2023-10-03T10:13:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.573+0000 7f051a709700 1 Processor -- start 2023-10-03T10:13:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.573+0000 7f051a709700 1 -- start start 2023-10-03T10:13:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.574+0000 7f051a709700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0514066410 0x7f05141c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.574+0000 7f051a709700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0514130a20 0x7f05141c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.574+0000 7f051a709700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0514138d60 0x7f0514118c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.574+0000 7f051a709700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05141c81d0 con 0x7f0514130a20 2023-10-03T10:13:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.574+0000 7f051a709700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f051411b8e0 con 0x7f0514138d60 2023-10-03T10:13:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.574+0000 7f051a709700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f051412db60 con 0x7f0514066410 2023-10-03T10:13:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.574+0000 7f05137fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0514130a20 0x7f05141c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.574+0000 7f05137fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0514130a20 0x7f05141c8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55148/0 (socket says 172.21.15.146:55148) 2023-10-03T10:13:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.574+0000 7f05137fe700 1 -- 172.21.15.146:0/492949819 learned_addr learned my addr 172.21.15.146:0/492949819 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.574+0000 7f0513fff700 1 --2- 172.21.15.146:0/492949819 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0514066410 0x7f05141c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.574+0000 7f0518ca6700 1 --2- 172.21.15.146:0/492949819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0514138d60 0x7f0514118c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.574+0000 7f05137fe700 1 -- 172.21.15.146:0/492949819 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0514066410 msgr2=0x7f05141c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.574+0000 7f05137fe700 1 --2- 172.21.15.146:0/492949819 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0514066410 0x7f05141c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.574+0000 7f05137fe700 1 -- 172.21.15.146:0/492949819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0514138d60 msgr2=0x7f0514118c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.574+0000 7f05137fe700 1 --2- 172.21.15.146:0/492949819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0514138d60 0x7f0514118c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.574+0000 7f05137fe700 1 -- 172.21.15.146:0/492949819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05080094a0 con 0x7f0514130a20 2023-10-03T10:13:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.575+0000 7f05137fe700 1 --2- 172.21.15.146:0/492949819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0514130a20 0x7f05141c8b20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f05080090b0 tx=0x7f0508004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.575+0000 7f0510ff9700 1 -- 172.21.15.146:0/492949819 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05080045d0 con 0x7f0514130a20 2023-10-03T10:13:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.575+0000 7f0510ff9700 1 -- 172.21.15.146:0/492949819 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050801f070 con 0x7f0514130a20 2023-10-03T10:13:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.575+0000 7f051a709700 1 -- 172.21.15.146:0/492949819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05140a0530 con 0x7f0514130a20 2023-10-03T10:13:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.575+0000 7f0510ff9700 1 -- 172.21.15.146:0/492949819 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0508011850 con 0x7f0514130a20 2023-10-03T10:13:31.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.575+0000 7f051a709700 1 -- 172.21.15.146:0/492949819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f051411a510 con 0x7f0514130a20 2023-10-03T10:13:31.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.576+0000 7f0510ff9700 1 -- 172.21.15.146:0/492949819 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f05080119b0 con 0x7f0514130a20 2023-10-03T10:13:31.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.576+0000 7f0510ff9700 1 -- 172.21.15.146:0/492949819 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0508021070 con 0x7f0514130a20 2023-10-03T10:13:31.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.576+0000 7f051a709700 1 -- 172.21.15.146:0/492949819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f051411b720 con 0x7f0514130a20 2023-10-03T10:13:31.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.581+0000 7f0510ff9700 1 -- 172.21.15.146:0/492949819 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f050802b080 con 0x7f0514130a20 2023-10-03T10:13:31.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.605+0000 7f9b7eb88700 1 Processor -- start 2023-10-03T10:13:31.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.606+0000 7f9b7eb88700 1 -- start start 2023-10-03T10:13:31.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.606+0000 7f9b7eb88700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b7806a770 0x7f9b781349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.606+0000 7f9b7eb88700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b78134f00 0x7f9b7809d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.606+0000 7f9b7eb88700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b7809eca0 con 0x7f9b7809dea0 2023-10-03T10:13:31.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.606+0000 7f9b7eb88700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7806b2e0 con 0x7f9b78134f00 2023-10-03T10:13:31.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.606+0000 7f9b7eb88700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7809f720 con 0x7f9b7806a770 2023-10-03T10:13:31.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.606+0000 7f9b77fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b78134f00 0x7f9b7809d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.606+0000 7f9b77fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b78134f00 0x7f9b7809d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42874/0 (socket says 172.21.15.146:42874) 2023-10-03T10:13:31.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.606+0000 7f9b77fff700 1 -- 172.21.15.146:0/1011035128 learned_addr learned my addr 172.21.15.146:0/1011035128 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:31.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.606+0000 7f9b7c924700 1 --2- 172.21.15.146:0/1011035128 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b7806a770 0x7f9b781349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.607+0000 7f9b777fe700 1 -- 172.21.15.146:0/1011035128 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410122332 0 0) 0x7f9b7809eca0 con 0x7f9b7809dea0 2023-10-03T10:13:31.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.607+0000 7f9b777fe700 1 -- 172.21.15.146:0/1011035128 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b680035b0 con 0x7f9b7809dea0 2023-10-03T10:13:31.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.607+0000 7f9b77fff700 1 -- 172.21.15.146:0/1011035128 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b7806a770 msgr2=0x7f9b781349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.607+0000 7f9b77fff700 1 --2- 172.21.15.146:0/1011035128 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b7806a770 0x7f9b781349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.607+0000 7f9b77fff700 1 -- 172.21.15.146:0/1011035128 >> v1:172.21.15.146:6789/0 conn(0x7f9b7809dea0 legacy=0x7f9b7813ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.607+0000 7f9b77fff700 1 -- 172.21.15.146:0/1011035128 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7806b480 con 0x7f9b78134f00 2023-10-03T10:13:31.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.607+0000 7f9b77fff700 1 --2- 172.21.15.146:0/1011035128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b78134f00 0x7f9b7809d960 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9b64009920 tx=0x7f9b64009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98bcba56b9eaca5d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.607+0000 7f9b777fe700 1 -- 172.21.15.146:0/1011035128 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b64011830 con 0x7f9b78134f00 2023-10-03T10:13:31.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.607+0000 7f9b777fe700 1 -- 172.21.15.146:0/1011035128 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b64011990 con 0x7f9b78134f00 2023-10-03T10:13:31.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.607+0000 7f9b777fe700 1 -- 172.21.15.146:0/1011035128 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b64011d00 con 0x7f9b78134f00 2023-10-03T10:13:31.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.608+0000 7f9b7eb88700 1 -- 172.21.15.146:0/1011035128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b78134f00 msgr2=0x7f9b7809d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.608+0000 7f9b7eb88700 1 --2- 172.21.15.146:0/1011035128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b78134f00 0x7f9b7809d960 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9b64009920 tx=0x7f9b64009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:31.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.608+0000 7f9b7eb88700 1 -- 172.21.15.146:0/1011035128 shutdown_connections 2023-10-03T10:13:31.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.608+0000 7f9b7eb88700 1 --2- 172.21.15.146:0/1011035128 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b7806a770 0x7f9b781349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.608+0000 7f9b7eb88700 1 --2- 172.21.15.146:0/1011035128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b78134f00 0x7f9b7809d960 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.608+0000 7f9b7eb88700 1 -- 172.21.15.146:0/1011035128 >> 172.21.15.146:0/1011035128 conn(0x7f9b78099c40 msgr2=0x7f9b780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.608+0000 7f9b7eb88700 1 -- 172.21.15.146:0/1011035128 shutdown_connections 2023-10-03T10:13:31.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.608+0000 7f9b7eb88700 1 -- 172.21.15.146:0/1011035128 wait complete. 2023-10-03T10:13:31.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.609+0000 7f9b7eb88700 1 Processor -- start 2023-10-03T10:13:31.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.609+0000 7f9b7eb88700 1 -- start start 2023-10-03T10:13:31.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.610+0000 7f9b7eb88700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b7806a770 0x7f9b781334e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.610+0000 7f9b7eb88700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b7809dea0 0x7f9b78133a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.610+0000 7f9b7eb88700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b78134f00 0x7f9b78135850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.610+0000 7f9b7eb88700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b78136d40 con 0x7f9b7806a770 2023-10-03T10:13:31.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.610+0000 7f9b7eb88700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b78141030 con 0x7f9b78134f00 2023-10-03T10:13:31.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.610+0000 7f9b7eb88700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7809f220 con 0x7f9b7809dea0 2023-10-03T10:13:31.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.610+0000 7f9b7c924700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b7806a770 0x7f9b781334e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.610+0000 7f9b7c924700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b7806a770 0x7f9b781334e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55152/0 (socket says 172.21.15.146:55152) 2023-10-03T10:13:31.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.610+0000 7f9b7c924700 1 -- 172.21.15.146:0/2285915073 learned_addr learned my addr 172.21.15.146:0/2285915073 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:31.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.610+0000 7f9b77fff700 1 --2- 172.21.15.146:0/2285915073 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b7809dea0 0x7f9b78133a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.610+0000 7f9b7d125700 1 --2- 172.21.15.146:0/2285915073 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b78134f00 0x7f9b78135850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.610+0000 7f9b7c924700 1 -- 172.21.15.146:0/2285915073 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b7809dea0 msgr2=0x7f9b78133a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.610+0000 7f9b7c924700 1 --2- 172.21.15.146:0/2285915073 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b7809dea0 0x7f9b78133a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.610+0000 7f9b7c924700 1 -- 172.21.15.146:0/2285915073 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b78134f00 msgr2=0x7f9b78135850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.610+0000 7f9b7c924700 1 --2- 172.21.15.146:0/2285915073 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b78134f00 0x7f9b78135850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.610+0000 7f9b7c924700 1 -- 172.21.15.146:0/2285915073 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b64009550 con 0x7f9b7806a770 2023-10-03T10:13:31.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.610+0000 7f9b7c924700 1 --2- 172.21.15.146:0/2285915073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b7806a770 0x7f9b781334e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00e8a0 tx=0x7f9b6c00ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.611+0000 7f9b757fa700 1 -- 172.21.15.146:0/2285915073 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c009590 con 0x7f9b7806a770 2023-10-03T10:13:31.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.611+0000 7f9b757fa700 1 -- 172.21.15.146:0/2285915073 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6c013680 con 0x7f9b7806a770 2023-10-03T10:13:31.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.611+0000 7f9b757fa700 1 -- 172.21.15.146:0/2285915073 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c0139f0 con 0x7f9b7806a770 2023-10-03T10:13:31.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.611+0000 7f9b7eb88700 1 -- 172.21.15.146:0/2285915073 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b78138c50 con 0x7f9b7806a770 2023-10-03T10:13:31.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.611+0000 7f9b7eb88700 1 -- 172.21.15.146:0/2285915073 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b78137ff0 con 0x7f9b7806a770 2023-10-03T10:13:31.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.612+0000 7f9b7eb88700 1 -- 172.21.15.146:0/2285915073 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b7804f2a0 con 0x7f9b7806a770 2023-10-03T10:13:31.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.612+0000 7f9b757fa700 1 -- 172.21.15.146:0/2285915073 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b6c013b50 con 0x7f9b7806a770 2023-10-03T10:13:31.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.612+0000 7f9b757fa700 1 -- 172.21.15.146:0/2285915073 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9b6c03f940 con 0x7f9b7806a770 2023-10-03T10:13:31.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.621+0000 7f9b757fa700 1 -- 172.21.15.146:0/2285915073 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b6c01adc0 con 0x7f9b7806a770 2023-10-03T10:13:31.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.640+0000 7fd965d3e700 1 -- 172.21.15.146:0/3218487642 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd960124b10 con 0x7fd9600a0a70 2023-10-03T10:13:31.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.640+0000 7fd947fff700 1 -- 172.21.15.146:0/3218487642 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd960124b10 con 0x7fd9600a0a70 2023-10-03T10:13:31.641 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:31.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.643+0000 7fd965d3e700 1 -- 172.21.15.146:0/3218487642 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9600a0a70 msgr2=0x7fd960121560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.643+0000 7fd965d3e700 1 --2- 172.21.15.146:0/3218487642 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9600a0a70 0x7fd960121560 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd95000ebe0 tx=0x7fd95000eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.643+0000 7fd965d3e700 1 -- 172.21.15.146:0/3218487642 shutdown_connections 2023-10-03T10:13:31.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.643+0000 7fd965d3e700 1 --2- 172.21.15.146:0/3218487642 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd960133f50 0x7fd960121fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.643+0000 7fd965d3e700 1 --2- 172.21.15.146:0/3218487642 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9600a0a70 0x7fd960121560 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.643+0000 7fd965d3e700 1 --2- 172.21.15.146:0/3218487642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9600a1380 0x7fd960121aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.643+0000 7fd965d3e700 1 -- 172.21.15.146:0/3218487642 >> 172.21.15.146:0/3218487642 conn(0x7fd9600a6610 msgr2=0x7fd96009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.643+0000 7fd965d3e700 1 -- 172.21.15.146:0/3218487642 shutdown_connections 2023-10-03T10:13:31.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.643+0000 7fd965d3e700 1 -- 172.21.15.146:0/3218487642 wait complete. 2023-10-03T10:13:31.657 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:31.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.746+0000 7f685b606700 1 -- 172.21.15.146:0/784578235 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6854120d80 con 0x7f6854134210 2023-10-03T10:13:31.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.747+0000 7f6849ffb700 1 -- 172.21.15.146:0/784578235 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6854120d80 con 0x7f6854134210 2023-10-03T10:13:31.748 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:31.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.749+0000 7f685b606700 1 -- 172.21.15.146:0/784578235 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6854134210 msgr2=0x7f685411e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.749+0000 7f685b606700 1 --2- 172.21.15.146:0/784578235 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6854134210 0x7f685411e320 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f684c016000 tx=0x7f684c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.749+0000 7f685b606700 1 -- 172.21.15.146:0/784578235 shutdown_connections 2023-10-03T10:13:31.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.749+0000 7f685b606700 1 --2- 172.21.15.146:0/784578235 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6854134210 0x7f685411e320 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.749+0000 7f685b606700 1 --2- 172.21.15.146:0/784578235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68540a0ee0 0x7f685411d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.749+0000 7f685b606700 1 --2- 172.21.15.146:0/784578235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6854133900 0x7f685411dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.749+0000 7f685b606700 1 -- 172.21.15.146:0/784578235 >> 172.21.15.146:0/784578235 conn(0x7f68540a2980 msgr2=0x7f68541bae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.749+0000 7f685b606700 1 -- 172.21.15.146:0/784578235 shutdown_connections 2023-10-03T10:13:31.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.749+0000 7f685b606700 1 -- 172.21.15.146:0/784578235 wait complete. 2023-10-03T10:13:31.763 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:31.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.777+0000 7f051a709700 1 -- 172.21.15.146:0/492949819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f051404f2a0 con 0x7f0514130a20 2023-10-03T10:13:31.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.778+0000 7f0510ff9700 1 -- 172.21.15.146:0/492949819 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0508010380 con 0x7f0514130a20 2023-10-03T10:13:31.778 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:31.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.780+0000 7f051a709700 1 -- 172.21.15.146:0/492949819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0514130a20 msgr2=0x7f05141c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.780+0000 7f051a709700 1 --2- 172.21.15.146:0/492949819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0514130a20 0x7f05141c8b20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f05080090b0 tx=0x7f0508004750 comp rx=0 tx=0).stop 2023-10-03T10:13:31.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.780+0000 7f051a709700 1 -- 172.21.15.146:0/492949819 shutdown_connections 2023-10-03T10:13:31.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.780+0000 7f051a709700 1 --2- 172.21.15.146:0/492949819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0514138d60 0x7f0514118c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.780+0000 7f051a709700 1 --2- 172.21.15.146:0/492949819 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0514066410 0x7f05141c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.780+0000 7f051a709700 1 --2- 172.21.15.146:0/492949819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0514130a20 0x7f05141c8b20 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.780+0000 7f051a709700 1 -- 172.21.15.146:0/492949819 >> 172.21.15.146:0/492949819 conn(0x7f05140a2810 msgr2=0x7f051412f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.780+0000 7f051a709700 1 -- 172.21.15.146:0/492949819 shutdown_connections 2023-10-03T10:13:31.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.780+0000 7f051a709700 1 -- 172.21.15.146:0/492949819 wait complete. 2023-10-03T10:13:31.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.817+0000 7f9b7eb88700 1 -- 172.21.15.146:0/2285915073 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9b78138500 con 0x7f9b7806a770 2023-10-03T10:13:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.817+0000 7f9b757fa700 1 -- 172.21.15.146:0/2285915073 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b6c021070 con 0x7f9b7806a770 2023-10-03T10:13:31.818 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:31.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.819+0000 7f9b7eb88700 1 -- 172.21.15.146:0/2285915073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b7806a770 msgr2=0x7f9b781334e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.819+0000 7f9b7eb88700 1 --2- 172.21.15.146:0/2285915073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b7806a770 0x7f9b781334e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00e8a0 tx=0x7f9b6c00ebb0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.819+0000 7f9b7eb88700 1 -- 172.21.15.146:0/2285915073 shutdown_connections 2023-10-03T10:13:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.819+0000 7f9b7eb88700 1 --2- 172.21.15.146:0/2285915073 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b78134f00 0x7f9b78135850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.819+0000 7f9b7eb88700 1 --2- 172.21.15.146:0/2285915073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b7806a770 0x7f9b781334e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.819+0000 7f9b7eb88700 1 --2- 172.21.15.146:0/2285915073 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b7809dea0 0x7f9b78133a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.819+0000 7f9b7eb88700 1 -- 172.21.15.146:0/2285915073 >> 172.21.15.146:0/2285915073 conn(0x7f9b78099c40 msgr2=0x7f9b78072050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.819+0000 7f9b7eb88700 1 -- 172.21.15.146:0/2285915073 shutdown_connections 2023-10-03T10:13:31.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:31.819+0000 7f9b7eb88700 1 -- 172.21.15.146:0/2285915073 wait complete. 2023-10-03T10:13:31.832 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:32.658 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:32.764 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:32.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.784+0000 7f5314dbb700 1 Processor -- start 2023-10-03T10:13:32.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.784+0000 7f5314dbb700 1 -- start start 2023-10-03T10:13:32.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.785+0000 7f5314dbb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f531006a770 0x7f531006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.785+0000 7f5314dbb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f531006b080 0x7f53101317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.785+0000 7f5314dbb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5310131cf0 0x7f5310132190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.785+0000 7f5314dbb700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f531009f770 con 0x7f5310131cf0 2023-10-03T10:13:32.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.785+0000 7f5314dbb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531009dce0 con 0x7f531006b080 2023-10-03T10:13:32.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.785+0000 7f5314dbb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f531009da80 con 0x7f531006a770 2023-10-03T10:13:32.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.785+0000 7f530e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f531006a770 0x7f531006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.785+0000 7f530ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5310131cf0 0x7f5310132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.785+0000 7f530dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f531006b080 0x7f53101317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.785+0000 7f530ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5310131cf0 0x7f5310132190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55166/0 (socket says 172.21.15.146:55166) 2023-10-03T10:13:32.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.785+0000 7f530e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f531006a770 0x7f531006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:60760/0 (socket says 172.21.15.146:60760) 2023-10-03T10:13:32.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.785+0000 7f530ed9d700 1 -- 172.21.15.146:0/989081238 learned_addr learned my addr 172.21.15.146:0/989081238 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:32.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.785+0000 7f530dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f531006b080 0x7f53101317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42896/0 (socket says 172.21.15.146:42896) 2023-10-03T10:13:32.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.785+0000 7f530dd9b700 1 -- 172.21.15.146:0/989081238 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f531006a770 msgr2=0x7f531006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:32.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.785+0000 7f530dd9b700 1 --2- 172.21.15.146:0/989081238 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f531006a770 0x7f531006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.785+0000 7f530dd9b700 1 -- 172.21.15.146:0/989081238 >> v2:172.21.15.146:3300/0 conn(0x7f5310131cf0 msgr2=0x7f5310132190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:32.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.785+0000 7f530dd9b700 1 --2- 172.21.15.146:0/989081238 >> v2:172.21.15.146:3300/0 conn(0x7f5310131cf0 0x7f5310132190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.785+0000 7f530dd9b700 1 -- 172.21.15.146:0/989081238 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531009eb20 con 0x7f531006b080 2023-10-03T10:13:32.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.785+0000 7f530ed9d700 1 --2- 172.21.15.146:0/989081238 >> v2:172.21.15.146:3300/0 conn(0x7f5310131cf0 0x7f5310132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:32.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.785+0000 7f530e59c700 1 --2- 172.21.15.146:0/989081238 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f531006a770 0x7f531006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:32.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.785+0000 7f530dd9b700 1 --2- 172.21.15.146:0/989081238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f531006b080 0x7f53101317b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5304009870 tx=0x7f5304009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8a2565fd1229045 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.786+0000 7f530d59a700 1 -- 172.21.15.146:0/989081238 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304011830 con 0x7f531006b080 2023-10-03T10:13:32.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.786+0000 7f530d59a700 1 -- 172.21.15.146:0/989081238 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5304011990 con 0x7f531006b080 2023-10-03T10:13:32.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.786+0000 7f530d59a700 1 -- 172.21.15.146:0/989081238 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304011d20 con 0x7f531006b080 2023-10-03T10:13:32.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.786+0000 7f5314dbb700 1 -- 172.21.15.146:0/989081238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f531006b080 msgr2=0x7f53101317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.786+0000 7f5314dbb700 1 --2- 172.21.15.146:0/989081238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f531006b080 0x7f53101317b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5304009870 tx=0x7f5304009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:32.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.787+0000 7f5314dbb700 1 -- 172.21.15.146:0/989081238 shutdown_connections 2023-10-03T10:13:32.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.787+0000 7f5314dbb700 1 --2- 172.21.15.146:0/989081238 >> v2:172.21.15.146:3300/0 conn(0x7f5310131cf0 0x7f5310132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.787+0000 7f5314dbb700 1 --2- 172.21.15.146:0/989081238 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f531006a770 0x7f531006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.787+0000 7f5314dbb700 1 --2- 172.21.15.146:0/989081238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f531006b080 0x7f53101317b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.787+0000 7f5314dbb700 1 -- 172.21.15.146:0/989081238 >> 172.21.15.146:0/989081238 conn(0x7f5310099c40 msgr2=0x7f53100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.787+0000 7f5314dbb700 1 -- 172.21.15.146:0/989081238 shutdown_connections 2023-10-03T10:13:32.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.787+0000 7f5314dbb700 1 -- 172.21.15.146:0/989081238 wait complete. 2023-10-03T10:13:32.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.788+0000 7f5314dbb700 1 Processor -- start 2023-10-03T10:13:32.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.788+0000 7f5314dbb700 1 -- start start 2023-10-03T10:13:32.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.788+0000 7f5314dbb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f531006a770 0x7f531011aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.788+0000 7f5314dbb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f531006b080 0x7f531011b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.788+0000 7f5314dbb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5310131cf0 0x7f531011b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.788+0000 7f5314dbb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531012e600 con 0x7f5310131cf0 2023-10-03T10:13:32.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.788+0000 7f5314dbb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531011c330 con 0x7f531006b080 2023-10-03T10:13:32.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.788+0000 7f5314dbb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f531011cab0 con 0x7f531006a770 2023-10-03T10:13:32.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.788+0000 7f530dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f531006b080 0x7f531011b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.788+0000 7f530e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f531006a770 0x7f531011aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.788+0000 7f530e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f531006a770 0x7f531011aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:60768/0 (socket says 172.21.15.146:60768) 2023-10-03T10:13:32.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.788+0000 7f530dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f531006b080 0x7f531011b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42898/0 (socket says 172.21.15.146:42898) 2023-10-03T10:13:32.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.788+0000 7f530e59c700 1 -- 172.21.15.146:0/1488599492 learned_addr learned my addr 172.21.15.146:0/1488599492 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:32.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.788+0000 7f530ed9d700 1 --2- 172.21.15.146:0/1488599492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5310131cf0 0x7f531011b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.789+0000 7f530e59c700 1 -- 172.21.15.146:0/1488599492 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f531006b080 msgr2=0x7f531011b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.789+0000 7f530e59c700 1 --2- 172.21.15.146:0/1488599492 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f531006b080 0x7f531011b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.789+0000 7f530e59c700 1 -- 172.21.15.146:0/1488599492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5310131cf0 msgr2=0x7f531011b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.789+0000 7f530e59c700 1 --2- 172.21.15.146:0/1488599492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5310131cf0 0x7f531011b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.789+0000 7f530e59c700 1 -- 172.21.15.146:0/1488599492 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530000d940 con 0x7f531006a770 2023-10-03T10:13:32.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.789+0000 7f530dd9b700 1 --2- 172.21.15.146:0/1488599492 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f531006b080 0x7f531011b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:32.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.789+0000 7f530e59c700 1 --2- 172.21.15.146:0/1488599492 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f531006a770 0x7f531011aef0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f530000de30 tx=0x7f53000103a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.789+0000 7f52feffd700 1 -- 172.21.15.146:0/1488599492 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5300010b00 con 0x7f531006a770 2023-10-03T10:13:32.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.789+0000 7f52feffd700 1 -- 172.21.15.146:0/1488599492 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5300013040 con 0x7f531006a770 2023-10-03T10:13:32.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.789+0000 7f52feffd700 1 -- 172.21.15.146:0/1488599492 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5300010e80 con 0x7f531006a770 2023-10-03T10:13:32.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.789+0000 7f5314dbb700 1 -- 172.21.15.146:0/1488599492 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5308009b30 con 0x7f531006a770 2023-10-03T10:13:32.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.789+0000 7f5314dbb700 1 -- 172.21.15.146:0/1488599492 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53040094a0 con 0x7f531006a770 2023-10-03T10:13:32.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.790+0000 7f52feffd700 1 -- 172.21.15.146:0/1488599492 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5300018480 con 0x7f531006a770 2023-10-03T10:13:32.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.790+0000 7f52feffd700 1 -- 172.21.15.146:0/1488599492 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5300043690 con 0x7f531006a770 2023-10-03T10:13:32.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.790+0000 7f5314dbb700 1 -- 172.21.15.146:0/1488599492 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53100a04d0 con 0x7f531006a770 2023-10-03T10:13:32.795 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:32.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.795+0000 7f52feffd700 1 -- 172.21.15.146:0/1488599492 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5300018910 con 0x7f531006a770 2023-10-03T10:13:32.833 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:32.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.895+0000 7f1505403700 1 Processor -- start 2023-10-03T10:13:32.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.895+0000 7f1505403700 1 -- start start 2023-10-03T10:13:32.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.896+0000 7f1505403700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1500070bc0 0x7f15001356a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.896+0000 7f1505403700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1500135be0 0x7f1500137fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.896+0000 7f1505403700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1500099d90 con 0x7f15000700e0 2023-10-03T10:13:32.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.896+0000 7f1505403700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1500070fb0 con 0x7f1500135be0 2023-10-03T10:13:32.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.896+0000 7f1505403700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f150009aad0 con 0x7f1500070bc0 2023-10-03T10:13:32.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.896+0000 7f14feffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f15000700e0 0x7f15000704b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48042/0 (socket says 172.21.15.146:48042) 2023-10-03T10:13:32.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.896+0000 7f14fe7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1500070bc0 0x7f15001356a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.896+0000 7f14feffd700 1 -- 172.21.15.146:0/2792600596 learned_addr learned my addr 172.21.15.146:0/2792600596 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:32.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.896+0000 7f14ff7fe700 1 --2- 172.21.15.146:0/2792600596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1500135be0 0x7f1500137fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.896+0000 7f14fe7fc700 1 -- 172.21.15.146:0/2792600596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1500135be0 msgr2=0x7f1500137fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:32.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.896+0000 7f14fdffb700 1 -- 172.21.15.146:0/2792600596 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232750064 0 0) 0x7f1500099d90 con 0x7f15000700e0 2023-10-03T10:13:32.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.896+0000 7f14fe7fc700 1 --2- 172.21.15.146:0/2792600596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1500135be0 0x7f1500137fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.896+0000 7f14fe7fc700 1 -- 172.21.15.146:0/2792600596 >> v1:172.21.15.146:6789/0 conn(0x7f15000700e0 legacy=0x7f15000704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.897+0000 7f14fe7fc700 1 -- 172.21.15.146:0/2792600596 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150006b670 con 0x7f1500070bc0 2023-10-03T10:13:32.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.897+0000 7f14ff7fe700 1 --2- 172.21.15.146:0/2792600596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1500135be0 0x7f1500137fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:32.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.897+0000 7f14fe7fc700 1 --2- 172.21.15.146:0/2792600596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1500070bc0 0x7f15001356a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f14f400bb40 tx=0x7f14f400be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2ed4ddc2772da51 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.897+0000 7f14fdffb700 1 -- 172.21.15.146:0/2792600596 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f400dc30 con 0x7f1500070bc0 2023-10-03T10:13:32.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.897+0000 7f14fdffb700 1 -- 172.21.15.146:0/2792600596 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f400dd90 con 0x7f1500070bc0 2023-10-03T10:13:32.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.897+0000 7f14fdffb700 1 -- 172.21.15.146:0/2792600596 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f4010690 con 0x7f1500070bc0 2023-10-03T10:13:32.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.897+0000 7f1505403700 1 -- 172.21.15.146:0/2792600596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1500070bc0 msgr2=0x7f15001356a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.897+0000 7f1505403700 1 --2- 172.21.15.146:0/2792600596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1500070bc0 0x7f15001356a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f14f400bb40 tx=0x7f14f400be50 comp rx=0 tx=0).stop 2023-10-03T10:13:32.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.898+0000 7f1505403700 1 -- 172.21.15.146:0/2792600596 shutdown_connections 2023-10-03T10:13:32.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.898+0000 7f1505403700 1 --2- 172.21.15.146:0/2792600596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1500135be0 0x7f1500137fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.898+0000 7f1505403700 1 --2- 172.21.15.146:0/2792600596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1500070bc0 0x7f15001356a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.898+0000 7f1505403700 1 -- 172.21.15.146:0/2792600596 >> 172.21.15.146:0/2792600596 conn(0x7f15000a27a0 msgr2=0x7f15000a2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.898+0000 7f1505403700 1 -- 172.21.15.146:0/2792600596 shutdown_connections 2023-10-03T10:13:32.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.898+0000 7f1505403700 1 -- 172.21.15.146:0/2792600596 wait complete. 2023-10-03T10:13:32.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.899+0000 7f1505403700 1 Processor -- start 2023-10-03T10:13:32.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.899+0000 7f1505403700 1 -- start start 2023-10-03T10:13:32.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.900+0000 7f1505403700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15000700e0 0x7f150009d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.900+0000 7f1505403700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1500070bc0 0x7f150009da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.900+0000 7f1505403700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1500135be0 0x7f150009dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.900+0000 7f1505403700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15001192b0 con 0x7f15000700e0 2023-10-03T10:13:32.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.900+0000 7f1505403700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15001359f0 con 0x7f1500070bc0 2023-10-03T10:13:32.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.900+0000 7f1505403700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f150009fc40 con 0x7f1500135be0 2023-10-03T10:13:32.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.900+0000 7f14ff7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1500135be0 0x7f150009dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.900+0000 7f14ff7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1500135be0 0x7f150009dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:60792/0 (socket says 172.21.15.146:60792) 2023-10-03T10:13:32.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.900+0000 7f14ff7fe700 1 -- 172.21.15.146:0/1746730058 learned_addr learned my addr 172.21.15.146:0/1746730058 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:32.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.900+0000 7f14fe7fc700 1 --2- 172.21.15.146:0/1746730058 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1500070bc0 0x7f150009da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.900+0000 7f14feffd700 1 --2- 172.21.15.146:0/1746730058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15000700e0 0x7f150009d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.900+0000 7f14fe7fc700 1 -- 172.21.15.146:0/1746730058 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1500135be0 msgr2=0x7f150009dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.900+0000 7f14fe7fc700 1 --2- 172.21.15.146:0/1746730058 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1500135be0 0x7f150009dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.900+0000 7f14fe7fc700 1 -- 172.21.15.146:0/1746730058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15000700e0 msgr2=0x7f150009d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.900+0000 7f14fe7fc700 1 --2- 172.21.15.146:0/1746730058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15000700e0 0x7f150009d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.900+0000 7f14fe7fc700 1 -- 172.21.15.146:0/1746730058 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f8009a70 con 0x7f1500070bc0 2023-10-03T10:13:32.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.900+0000 7f14fe7fc700 1 --2- 172.21.15.146:0/1746730058 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1500070bc0 0x7f150009da70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1500071b70 tx=0x7f14f40047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.901+0000 7f14e77fe700 1 -- 172.21.15.146:0/1746730058 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f4023630 con 0x7f1500070bc0 2023-10-03T10:13:32.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.901+0000 7f14e77fe700 1 -- 172.21.15.146:0/1746730058 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f40237b0 con 0x7f1500070bc0 2023-10-03T10:13:32.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.901+0000 7f14e77fe700 1 -- 172.21.15.146:0/1746730058 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f4023b60 con 0x7f1500070bc0 2023-10-03T10:13:32.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.901+0000 7f1505403700 1 -- 172.21.15.146:0/1746730058 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f400b740 con 0x7f1500070bc0 2023-10-03T10:13:32.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.901+0000 7f1505403700 1 -- 172.21.15.146:0/1746730058 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150011a270 con 0x7f1500070bc0 2023-10-03T10:13:32.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.902+0000 7f1505403700 1 -- 172.21.15.146:0/1746730058 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150004f2a0 con 0x7f1500070bc0 2023-10-03T10:13:32.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.903+0000 7f14e77fe700 1 -- 172.21.15.146:0/1746730058 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f14f4019400 con 0x7f1500070bc0 2023-10-03T10:13:32.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.903+0000 7f14e77fe700 1 -- 172.21.15.146:0/1746730058 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f14f4041680 con 0x7f1500070bc0 2023-10-03T10:13:32.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.910+0000 7f14e77fe700 1 -- 172.21.15.146:0/1746730058 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f14f400e360 con 0x7f1500070bc0 2023-10-03T10:13:32.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.937+0000 7fb67121c700 1 Processor -- start 2023-10-03T10:13:32.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.937+0000 7fb67121c700 1 -- start start 2023-10-03T10:13:32.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.937+0000 7fb67121c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb66c0a0a70 0x7fb66c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.937+0000 7fb67121c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb66c134120 0x7fb66c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.937+0000 7fb67121c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb66c09dc00 con 0x7fb66c0a1380 2023-10-03T10:13:32.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.937+0000 7fb67121c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb66c09ea90 con 0x7fb66c0a0a70 2023-10-03T10:13:32.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.937+0000 7fb67121c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c09dec0 con 0x7fb66c134120 2023-10-03T10:13:32.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.938+0000 7fb66a59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb66c0a1380 0x7fb66c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48046/0 (socket says 172.21.15.146:48046) 2023-10-03T10:13:32.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.938+0000 7fb66a59c700 1 -- 172.21.15.146:0/2672167794 learned_addr learned my addr 172.21.15.146:0/2672167794 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:32.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.938+0000 7fb66ad9d700 1 --2- 172.21.15.146:0/2672167794 >> v2:172.21.15.146:3300/0 conn(0x7fb66c0a0a70 0x7fb66c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.938+0000 7fb66b59e700 1 --2- 172.21.15.146:0/2672167794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb66c134120 0x7fb66c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.938+0000 7fb66ad9d700 1 -- 172.21.15.146:0/2672167794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb66c134120 msgr2=0x7fb66c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:32.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.938+0000 7fb66ad9d700 1 --2- 172.21.15.146:0/2672167794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb66c134120 0x7fb66c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.938+0000 7fb66ad9d700 1 -- 172.21.15.146:0/2672167794 >> v1:172.21.15.146:6789/0 conn(0x7fb66c0a1380 legacy=0x7fb66c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.938+0000 7fb66ad9d700 1 -- 172.21.15.146:0/2672167794 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c09e6a0 con 0x7fb66c0a0a70 2023-10-03T10:13:32.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.938+0000 7fb66ad9d700 1 --2- 172.21.15.146:0/2672167794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb66c0a0a70 0x7fb66c0a0e40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb65c009840 tx=0x7fb65c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb335656021b51d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.938+0000 7fb669d9b700 1 -- 172.21.15.146:0/2672167794 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c011830 con 0x7fb66c0a0a70 2023-10-03T10:13:32.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.938+0000 7fb669d9b700 1 -- 172.21.15.146:0/2672167794 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65c011990 con 0x7fb66c0a0a70 2023-10-03T10:13:32.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.938+0000 7fb669d9b700 1 -- 172.21.15.146:0/2672167794 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c011d20 con 0x7fb66c0a0a70 2023-10-03T10:13:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.939+0000 7fb67121c700 1 -- 172.21.15.146:0/2672167794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb66c0a0a70 msgr2=0x7fb66c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.939+0000 7fb67121c700 1 --2- 172.21.15.146:0/2672167794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb66c0a0a70 0x7fb66c0a0e40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb65c009840 tx=0x7fb65c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.940+0000 7fb67121c700 1 -- 172.21.15.146:0/2672167794 shutdown_connections 2023-10-03T10:13:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.940+0000 7fb67121c700 1 --2- 172.21.15.146:0/2672167794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb66c134120 0x7fb66c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.940+0000 7fb67121c700 1 --2- 172.21.15.146:0/2672167794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb66c0a0a70 0x7fb66c0a0e40 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.940+0000 7fb67121c700 1 -- 172.21.15.146:0/2672167794 >> 172.21.15.146:0/2672167794 conn(0x7fb66c0a6610 msgr2=0x7fb66c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.940+0000 7fb67121c700 1 -- 172.21.15.146:0/2672167794 shutdown_connections 2023-10-03T10:13:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.940+0000 7fb67121c700 1 -- 172.21.15.146:0/2672167794 wait complete. 2023-10-03T10:13:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.941+0000 7fb67121c700 1 Processor -- start 2023-10-03T10:13:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.941+0000 7fb67121c700 1 -- start start 2023-10-03T10:13:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.941+0000 7fb67121c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb66c0a0a70 0x7fb66c1229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.941+0000 7fb67121c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb66c0a1380 0x7fb66c122ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.941+0000 7fb67121c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb66c134120 0x7fb66c123430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.941+0000 7fb67121c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c126160 con 0x7fb66c0a1380 2023-10-03T10:13:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.941+0000 7fb67121c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c133aa0 con 0x7fb66c134120 2023-10-03T10:13:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.941+0000 7fb67121c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c1334b0 con 0x7fb66c0a0a70 2023-10-03T10:13:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.942+0000 7fb66b59e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb66c134120 0x7fb66c123430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.942+0000 7fb66b59e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb66c134120 0x7fb66c123430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42952/0 (socket says 172.21.15.146:42952) 2023-10-03T10:13:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.942+0000 7fb66a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb66c0a1380 0x7fb66c122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.942+0000 7fb66b59e700 1 -- 172.21.15.146:0/3078096835 learned_addr learned my addr 172.21.15.146:0/3078096835 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.942+0000 7fb66ad9d700 1 --2- 172.21.15.146:0/3078096835 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb66c0a0a70 0x7fb66c1229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.942+0000 7fb66b59e700 1 -- 172.21.15.146:0/3078096835 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb66c0a0a70 msgr2=0x7fb66c1229b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.942+0000 7fb66b59e700 1 --2- 172.21.15.146:0/3078096835 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb66c0a0a70 0x7fb66c1229b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.942+0000 7fb66b59e700 1 -- 172.21.15.146:0/3078096835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb66c0a1380 msgr2=0x7fb66c122ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.942+0000 7fb66b59e700 1 --2- 172.21.15.146:0/3078096835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb66c0a1380 0x7fb66c122ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.942+0000 7fb66b59e700 1 -- 172.21.15.146:0/3078096835 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65c0094a0 con 0x7fb66c134120 2023-10-03T10:13:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.942+0000 7fb66a59c700 1 --2- 172.21.15.146:0/3078096835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb66c0a1380 0x7fb66c122ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.942+0000 7fb66ad9d700 1 --2- 172.21.15.146:0/3078096835 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb66c0a0a70 0x7fb66c1229b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.942+0000 7fb66b59e700 1 --2- 172.21.15.146:0/3078096835 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb66c134120 0x7fb66c123430 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb664009dd0 tx=0x7fb66400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.942+0000 7fb6537fe700 1 -- 172.21.15.146:0/3078096835 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb664009c40 con 0x7fb66c134120 2023-10-03T10:13:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.942+0000 7fb6537fe700 1 -- 172.21.15.146:0/3078096835 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66400f040 con 0x7fb66c134120 2023-10-03T10:13:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.942+0000 7fb67121c700 1 -- 172.21.15.146:0/3078096835 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb66c125ea0 con 0x7fb66c134120 2023-10-03T10:13:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.942+0000 7fb6537fe700 1 -- 172.21.15.146:0/3078096835 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb664014480 con 0x7fb66c134120 2023-10-03T10:13:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.942+0000 7fb67121c700 1 -- 172.21.15.146:0/3078096835 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb66c126b40 con 0x7fb66c134120 2023-10-03T10:13:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.943+0000 7fb6537fe700 1 -- 172.21.15.146:0/3078096835 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb6640145e0 con 0x7fb66c134120 2023-10-03T10:13:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.944+0000 7fb6537fe700 1 -- 172.21.15.146:0/3078096835 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb664040060 con 0x7fb66c134120 2023-10-03T10:13:32.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.945+0000 7fb67121c700 1 -- 172.21.15.146:0/3078096835 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb66c1263a0 con 0x7fb66c134120 2023-10-03T10:13:32.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.949+0000 7fb6537fe700 1 -- 172.21.15.146:0/3078096835 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb664018020 con 0x7fb66c134120 2023-10-03T10:13:32.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.979+0000 7f3be422f700 1 Processor -- start 2023-10-03T10:13:32.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.980+0000 7f3be422f700 1 -- start start 2023-10-03T10:13:32.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.980+0000 7f3be422f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bdc133ad0 0x7f3bdc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.980+0000 7f3be422f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bdc1300a0 0x7f3bdc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.980+0000 7f3be422f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3bdc1309f0 0x7f3bdc13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.980+0000 7f3be422f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bdc06b2d0 con 0x7f3bdc1309f0 2023-10-03T10:13:32.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.980+0000 7f3be422f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc133610 con 0x7f3bdc133ad0 2023-10-03T10:13:32.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.980+0000 7f3be422f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc09a500 con 0x7f3bdc1300a0 2023-10-03T10:13:32.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.980+0000 7f3be17ca700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bdc1300a0 0x7f3bdc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.980+0000 7f3be17ca700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bdc1300a0 0x7f3bdc1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:60810/0 (socket says 172.21.15.146:60810) 2023-10-03T10:13:32.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.980+0000 7f3be17ca700 1 -- 172.21.15.146:0/1045992077 learned_addr learned my addr 172.21.15.146:0/1045992077 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:32.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.980+0000 7f3be1fcb700 1 --2- 172.21.15.146:0/1045992077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bdc133ad0 0x7f3bdc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.980+0000 7f3be27cc700 1 --2- 172.21.15.146:0/1045992077 >> v2:172.21.15.146:3300/0 conn(0x7f3bdc1309f0 0x7f3bdc13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.981+0000 7f3be17ca700 1 -- 172.21.15.146:0/1045992077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bdc133ad0 msgr2=0x7f3bdc133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:32.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.981+0000 7f3be17ca700 1 --2- 172.21.15.146:0/1045992077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bdc133ad0 0x7f3bdc133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.981+0000 7f3be17ca700 1 -- 172.21.15.146:0/1045992077 >> v2:172.21.15.146:3300/0 conn(0x7f3bdc1309f0 msgr2=0x7f3bdc13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:32.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.981+0000 7f3be17ca700 1 --2- 172.21.15.146:0/1045992077 >> v2:172.21.15.146:3300/0 conn(0x7f3bdc1309f0 0x7f3bdc13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.981+0000 7f3be17ca700 1 -- 172.21.15.146:0/1045992077 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc1338b0 con 0x7f3bdc1300a0 2023-10-03T10:13:32.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.981+0000 7f3be1fcb700 1 --2- 172.21.15.146:0/1045992077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bdc133ad0 0x7f3bdc133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:32.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.981+0000 7f3be27cc700 1 --2- 172.21.15.146:0/1045992077 >> v2:172.21.15.146:3300/0 conn(0x7f3bdc1309f0 0x7f3bdc13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:32.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.981+0000 7f3be17ca700 1 --2- 172.21.15.146:0/1045992077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bdc1300a0 0x7f3bdc1304b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc0098f0 tx=0x7f3bcc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9e30115e53064d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.981+0000 7f3be0fc9700 1 -- 172.21.15.146:0/1045992077 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc011830 con 0x7f3bdc1300a0 2023-10-03T10:13:32.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.981+0000 7f3be0fc9700 1 -- 172.21.15.146:0/1045992077 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bcc011990 con 0x7f3bdc1300a0 2023-10-03T10:13:32.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.981+0000 7f3be0fc9700 1 -- 172.21.15.146:0/1045992077 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc011d20 con 0x7f3bdc1300a0 2023-10-03T10:13:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.982+0000 7f3be422f700 1 -- 172.21.15.146:0/1045992077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bdc1300a0 msgr2=0x7f3bdc1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.982+0000 7f3be422f700 1 --2- 172.21.15.146:0/1045992077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bdc1300a0 0x7f3bdc1304b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc0098f0 tx=0x7f3bcc009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.982+0000 7f3be422f700 1 -- 172.21.15.146:0/1045992077 shutdown_connections 2023-10-03T10:13:32.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.982+0000 7f3be422f700 1 --2- 172.21.15.146:0/1045992077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bdc133ad0 0x7f3bdc133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.982+0000 7f3be422f700 1 --2- 172.21.15.146:0/1045992077 >> v2:172.21.15.146:3300/0 conn(0x7f3bdc1309f0 0x7f3bdc13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.982+0000 7f3be422f700 1 --2- 172.21.15.146:0/1045992077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bdc1300a0 0x7f3bdc1304b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.982+0000 7f3be422f700 1 -- 172.21.15.146:0/1045992077 >> 172.21.15.146:0/1045992077 conn(0x7f3bdc099c40 msgr2=0x7f3bdc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.982+0000 7f3be422f700 1 -- 172.21.15.146:0/1045992077 shutdown_connections 2023-10-03T10:13:32.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.982+0000 7f3be422f700 1 -- 172.21.15.146:0/1045992077 wait complete. 2023-10-03T10:13:32.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.983+0000 7f3be422f700 1 Processor -- start 2023-10-03T10:13:32.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.983+0000 7f3be422f700 1 -- start start 2023-10-03T10:13:32.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.983+0000 7f3be422f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bdc1300a0 0x7f3bdc1c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.983+0000 7f3be422f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bdc1309f0 0x7f3bdc1c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.983+0000 7f3be422f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bdc133ad0 0x7f3bdc06e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.983+0000 7f3be422f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc070cd0 con 0x7f3bdc133ad0 2023-10-03T10:13:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.983+0000 7f3be422f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc072310 con 0x7f3bdc1300a0 2023-10-03T10:13:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.983+0000 7f3be422f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc12fe40 con 0x7f3bdc1309f0 2023-10-03T10:13:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.983+0000 7f3be17ca700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bdc1309f0 0x7f3bdc1c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.983+0000 7f3be17ca700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bdc1309f0 0x7f3bdc1c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:60826/0 (socket says 172.21.15.146:60826) 2023-10-03T10:13:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.983+0000 7f3be17ca700 1 -- 172.21.15.146:0/763241589 learned_addr learned my addr 172.21.15.146:0/763241589 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.983+0000 7f3be1fcb700 1 --2- 172.21.15.146:0/763241589 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bdc1300a0 0x7f3bdc1c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.984+0000 7f3be27cc700 1 --2- 172.21.15.146:0/763241589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bdc133ad0 0x7f3bdc06e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.984+0000 7f3be17ca700 1 -- 172.21.15.146:0/763241589 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bdc1300a0 msgr2=0x7f3bdc1c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.984+0000 7f3be17ca700 1 --2- 172.21.15.146:0/763241589 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bdc1300a0 0x7f3bdc1c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.984+0000 7f3be17ca700 1 -- 172.21.15.146:0/763241589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bdc133ad0 msgr2=0x7f3bdc06e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.984+0000 7f3be17ca700 1 --2- 172.21.15.146:0/763241589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bdc133ad0 0x7f3bdc06e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.984+0000 7f3be17ca700 1 -- 172.21.15.146:0/763241589 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd80094a0 con 0x7f3bdc1309f0 2023-10-03T10:13:32.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.984+0000 7f3be17ca700 1 --2- 172.21.15.146:0/763241589 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bdc1309f0 0x7f3bdc1c8f00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc009c40 tx=0x7f3bcc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.984+0000 7f3bd27fc700 1 -- 172.21.15.146:0/763241589 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc004590 con 0x7f3bdc1309f0 2023-10-03T10:13:32.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.984+0000 7f3bd27fc700 1 -- 172.21.15.146:0/763241589 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bcc01e070 con 0x7f3bdc1309f0 2023-10-03T10:13:32.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.984+0000 7f3be422f700 1 -- 172.21.15.146:0/763241589 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bcc009550 con 0x7f3bdc1309f0 2023-10-03T10:13:32.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.984+0000 7f3bd27fc700 1 -- 172.21.15.146:0/763241589 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc0038e0 con 0x7f3bdc1309f0 2023-10-03T10:13:32.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.984+0000 7f3be422f700 1 -- 172.21.15.146:0/763241589 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bdc12dd00 con 0x7f3bdc1309f0 2023-10-03T10:13:32.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.985+0000 7f3bd27fc700 1 -- 172.21.15.146:0/763241589 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3bcc003a40 con 0x7f3bdc1309f0 2023-10-03T10:13:32.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.985+0000 7f3be422f700 1 -- 172.21.15.146:0/763241589 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bdc12a810 con 0x7f3bdc1309f0 2023-10-03T10:13:32.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.986+0000 7f3bd27fc700 1 -- 172.21.15.146:0/763241589 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3bcc040570 con 0x7f3bdc1309f0 2023-10-03T10:13:32.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:32.990+0000 7f3bd27fc700 1 -- 172.21.15.146:0/763241589 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3bcc02d450 con 0x7f3bdc1309f0 2023-10-03T10:13:33.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.003+0000 7f5314dbb700 1 -- 172.21.15.146:0/1488599492 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f531004f2a0 con 0x7f531006a770 2023-10-03T10:13:33.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.003+0000 7f52feffd700 1 -- 172.21.15.146:0/1488599492 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5300016340 con 0x7f531006a770 2023-10-03T10:13:33.004 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:33.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.006+0000 7f5314dbb700 1 -- 172.21.15.146:0/1488599492 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f531006a770 msgr2=0x7f531011aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.006+0000 7f5314dbb700 1 --2- 172.21.15.146:0/1488599492 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f531006a770 0x7f531011aef0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f530000de30 tx=0x7f53000103a0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.006+0000 7f5314dbb700 1 -- 172.21.15.146:0/1488599492 shutdown_connections 2023-10-03T10:13:33.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.006+0000 7f5314dbb700 1 --2- 172.21.15.146:0/1488599492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5310131cf0 0x7f531011b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.006+0000 7f5314dbb700 1 --2- 172.21.15.146:0/1488599492 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f531006a770 0x7f531011aef0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.006+0000 7f5314dbb700 1 --2- 172.21.15.146:0/1488599492 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f531006b080 0x7f531011b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.006+0000 7f5314dbb700 1 -- 172.21.15.146:0/1488599492 >> 172.21.15.146:0/1488599492 conn(0x7f5310099c40 msgr2=0x7f531012fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.006+0000 7f5314dbb700 1 -- 172.21.15.146:0/1488599492 shutdown_connections 2023-10-03T10:13:33.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.006+0000 7f5314dbb700 1 -- 172.21.15.146:0/1488599492 wait complete. 2023-10-03T10:13:33.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:33.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.112+0000 7f1505403700 1 -- 172.21.15.146:0/1746730058 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f150011a060 con 0x7f1500070bc0 2023-10-03T10:13:33.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.112+0000 7f14e77fe700 1 -- 172.21.15.146:0/1746730058 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f14f4028030 con 0x7f1500070bc0 2023-10-03T10:13:33.113 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:33.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.114+0000 7f1505403700 1 -- 172.21.15.146:0/1746730058 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1500070bc0 msgr2=0x7f150009da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.114+0000 7f1505403700 1 --2- 172.21.15.146:0/1746730058 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1500070bc0 0x7f150009da70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1500071b70 tx=0x7f14f40047c0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.114+0000 7f1505403700 1 -- 172.21.15.146:0/1746730058 shutdown_connections 2023-10-03T10:13:33.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.114+0000 7f1505403700 1 --2- 172.21.15.146:0/1746730058 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1500135be0 0x7f150009dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.114+0000 7f1505403700 1 --2- 172.21.15.146:0/1746730058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15000700e0 0x7f150009d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.114+0000 7f1505403700 1 --2- 172.21.15.146:0/1746730058 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1500070bc0 0x7f150009da70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.114+0000 7f1505403700 1 -- 172.21.15.146:0/1746730058 >> 172.21.15.146:0/1746730058 conn(0x7f15000a27a0 msgr2=0x7f15000a0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.114+0000 7f1505403700 1 -- 172.21.15.146:0/1746730058 shutdown_connections 2023-10-03T10:13:33.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.115+0000 7f1505403700 1 -- 172.21.15.146:0/1746730058 wait complete. 2023-10-03T10:13:33.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:33.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.151+0000 7fb67121c700 1 -- 172.21.15.146:0/3078096835 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb66c04f2a0 con 0x7fb66c134120 2023-10-03T10:13:33.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.151+0000 7fb6537fe700 1 -- 172.21.15.146:0/3078096835 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb66402b090 con 0x7fb66c134120 2023-10-03T10:13:33.152 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:33.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.153+0000 7fb67121c700 1 -- 172.21.15.146:0/3078096835 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb66c134120 msgr2=0x7fb66c123430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.153+0000 7fb67121c700 1 --2- 172.21.15.146:0/3078096835 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb66c134120 0x7fb66c123430 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb664009dd0 tx=0x7fb66400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.153+0000 7fb67121c700 1 -- 172.21.15.146:0/3078096835 shutdown_connections 2023-10-03T10:13:33.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.153+0000 7fb67121c700 1 --2- 172.21.15.146:0/3078096835 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb66c134120 0x7fb66c123430 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.153+0000 7fb67121c700 1 --2- 172.21.15.146:0/3078096835 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb66c0a0a70 0x7fb66c1229b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.153+0000 7fb67121c700 1 --2- 172.21.15.146:0/3078096835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb66c0a1380 0x7fb66c122ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.153+0000 7fb67121c700 1 -- 172.21.15.146:0/3078096835 >> 172.21.15.146:0/3078096835 conn(0x7fb66c0a6610 msgr2=0x7fb66c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.153+0000 7fb67121c700 1 -- 172.21.15.146:0/3078096835 shutdown_connections 2023-10-03T10:13:33.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.153+0000 7fb67121c700 1 -- 172.21.15.146:0/3078096835 wait complete. 2023-10-03T10:13:33.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:33.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.187+0000 7f3be422f700 1 -- 172.21.15.146:0/763241589 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3bdc071e70 con 0x7f3bdc1309f0 2023-10-03T10:13:33.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.187+0000 7f3bd27fc700 1 -- 172.21.15.146:0/763241589 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3bcc029220 con 0x7f3bdc1309f0 2023-10-03T10:13:33.188 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:33.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.189+0000 7f3be422f700 1 -- 172.21.15.146:0/763241589 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bdc1309f0 msgr2=0x7f3bdc1c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.189+0000 7f3be422f700 1 --2- 172.21.15.146:0/763241589 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bdc1309f0 0x7f3bdc1c8f00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc009c40 tx=0x7f3bcc004750 comp rx=0 tx=0).stop 2023-10-03T10:13:33.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.189+0000 7f3be422f700 1 -- 172.21.15.146:0/763241589 shutdown_connections 2023-10-03T10:13:33.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.189+0000 7f3be422f700 1 --2- 172.21.15.146:0/763241589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bdc133ad0 0x7f3bdc06e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.189+0000 7f3be422f700 1 --2- 172.21.15.146:0/763241589 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bdc1300a0 0x7f3bdc1c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.189+0000 7f3be422f700 1 --2- 172.21.15.146:0/763241589 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bdc1309f0 0x7f3bdc1c8f00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.189+0000 7f3be422f700 1 -- 172.21.15.146:0/763241589 >> 172.21.15.146:0/763241589 conn(0x7f3bdc099c40 msgr2=0x7f3bdc131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.189+0000 7f3be422f700 1 -- 172.21.15.146:0/763241589 shutdown_connections 2023-10-03T10:13:33.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:33.189+0000 7f3be422f700 1 -- 172.21.15.146:0/763241589 wait complete. 2023-10-03T10:13:33.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:34.020 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:34.128 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:34.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.148+0000 7f179a60f700 1 Processor -- start 2023-10-03T10:13:34.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.148+0000 7f179a60f700 1 -- start start 2023-10-03T10:13:34.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.148+0000 7f179a60f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f179406b250 0x7f1794136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.148+0000 7f179a60f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1794137140 0x7f1794139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.148+0000 7f179a60f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f179409da80 con 0x7f179406a770 2023-10-03T10:13:34.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.148+0000 7f179a60f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f179409f770 con 0x7f179406b250 2023-10-03T10:13:34.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.148+0000 7f179a60f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f179409dce0 con 0x7f1794137140 2023-10-03T10:13:34.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.149+0000 7f17937fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f179406b250 0x7f1794136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.149+0000 7f17937fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f179406b250 0x7f1794136c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55238/0 (socket says 172.21.15.146:55238) 2023-10-03T10:13:34.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.149+0000 7f1793fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f179406a770 0x7f179406ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48054/0 (socket says 172.21.15.146:48054) 2023-10-03T10:13:34.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.148+0000 7f1798bac700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1794137140 0x7f1794139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.149+0000 7f17937fe700 1 -- 172.21.15.146:0/1304813994 learned_addr learned my addr 172.21.15.146:0/1304813994 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:34.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.149+0000 7f17937fe700 1 -- 172.21.15.146:0/1304813994 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1794137140 msgr2=0x7f1794139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:34.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.149+0000 7f17937fe700 1 --2- 172.21.15.146:0/1304813994 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1794137140 0x7f1794139520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.149+0000 7f17937fe700 1 -- 172.21.15.146:0/1304813994 >> v1:172.21.15.146:6789/0 conn(0x7f179406a770 legacy=0x7f179406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.149+0000 7f17937fe700 1 -- 172.21.15.146:0/1304813994 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179409eb20 con 0x7f179406b250 2023-10-03T10:13:34.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.149+0000 7f1792ffd700 1 -- 172.21.15.146:0/1304813994 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303947141 0 0) 0x7f179409da80 con 0x7f179406a770 2023-10-03T10:13:34.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.149+0000 7f17937fe700 1 --2- 172.21.15.146:0/1304813994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f179406b250 0x7f1794136c00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f17880098f0 tx=0x7f1788009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22844ee7aedb28f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.149+0000 7f1792ffd700 1 -- 172.21.15.146:0/1304813994 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1788011830 con 0x7f179406b250 2023-10-03T10:13:34.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.149+0000 7f1792ffd700 1 -- 172.21.15.146:0/1304813994 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1788011990 con 0x7f179406b250 2023-10-03T10:13:34.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.149+0000 7f1792ffd700 1 -- 172.21.15.146:0/1304813994 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1788011d20 con 0x7f179406b250 2023-10-03T10:13:34.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.150+0000 7f179a60f700 1 -- 172.21.15.146:0/1304813994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f179406b250 msgr2=0x7f1794136c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.150+0000 7f179a60f700 1 --2- 172.21.15.146:0/1304813994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f179406b250 0x7f1794136c00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f17880098f0 tx=0x7f1788009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:34.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.150+0000 7f179a60f700 1 -- 172.21.15.146:0/1304813994 shutdown_connections 2023-10-03T10:13:34.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.150+0000 7f179a60f700 1 --2- 172.21.15.146:0/1304813994 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1794137140 0x7f1794139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.150+0000 7f179a60f700 1 --2- 172.21.15.146:0/1304813994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f179406b250 0x7f1794136c00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.150+0000 7f179a60f700 1 -- 172.21.15.146:0/1304813994 >> 172.21.15.146:0/1304813994 conn(0x7f1794099c40 msgr2=0x7f17940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.150+0000 7f179a60f700 1 -- 172.21.15.146:0/1304813994 shutdown_connections 2023-10-03T10:13:34.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.150+0000 7f179a60f700 1 -- 172.21.15.146:0/1304813994 wait complete. 2023-10-03T10:13:34.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.151+0000 7f179a60f700 1 Processor -- start 2023-10-03T10:13:34.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.151+0000 7f179a60f700 1 -- start start 2023-10-03T10:13:34.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.151+0000 7f179a60f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f179406a770 0x7f17941204a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.151+0000 7f179a60f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f179406b250 0x7f17941209e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.151+0000 7f179a60f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1794137140 0x7f1794120f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.151+0000 7f179a60f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1794122f70 con 0x7f1794137140 2023-10-03T10:13:34.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.151+0000 7f179a60f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1794123c90 con 0x7f179406b250 2023-10-03T10:13:34.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.151+0000 7f179a60f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17940a0680 con 0x7f179406a770 2023-10-03T10:13:34.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.152+0000 7f17937fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f179406b250 0x7f17941209e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.152+0000 7f17937fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f179406b250 0x7f17941209e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42988/0 (socket says 172.21.15.146:42988) 2023-10-03T10:13:34.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.152+0000 7f17937fe700 1 -- 172.21.15.146:0/2439173249 learned_addr learned my addr 172.21.15.146:0/2439173249 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:34.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.152+0000 7f1793fff700 1 --2- 172.21.15.146:0/2439173249 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f179406a770 0x7f17941204a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.152+0000 7f1798bac700 1 --2- 172.21.15.146:0/2439173249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1794137140 0x7f1794120f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.152+0000 7f17937fe700 1 -- 172.21.15.146:0/2439173249 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f179406a770 msgr2=0x7f17941204a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.152+0000 7f17937fe700 1 --2- 172.21.15.146:0/2439173249 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f179406a770 0x7f17941204a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.152+0000 7f17937fe700 1 -- 172.21.15.146:0/2439173249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1794137140 msgr2=0x7f1794120f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.152+0000 7f17937fe700 1 --2- 172.21.15.146:0/2439173249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1794137140 0x7f1794120f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.152+0000 7f17937fe700 1 -- 172.21.15.146:0/2439173249 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1788009550 con 0x7f179406b250 2023-10-03T10:13:34.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.152+0000 7f17937fe700 1 --2- 172.21.15.146:0/2439173249 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f179406b250 0x7f17941209e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1788009c40 tx=0x7f1788004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.152+0000 7f1790ff9700 1 -- 172.21.15.146:0/2439173249 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1788004510 con 0x7f179406b250 2023-10-03T10:13:34.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.152+0000 7f1790ff9700 1 -- 172.21.15.146:0/2439173249 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17880036a0 con 0x7f179406b250 2023-10-03T10:13:34.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.152+0000 7f179a60f700 1 -- 172.21.15.146:0/2439173249 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1794122850 con 0x7f179406b250 2023-10-03T10:13:34.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.152+0000 7f1790ff9700 1 -- 172.21.15.146:0/2439173249 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1788003a50 con 0x7f179406b250 2023-10-03T10:13:34.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.152+0000 7f179a60f700 1 -- 172.21.15.146:0/2439173249 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1794123f70 con 0x7f179406b250 2023-10-03T10:13:34.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.153+0000 7f1790ff9700 1 -- 172.21.15.146:0/2439173249 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1788021070 con 0x7f179406b250 2023-10-03T10:13:34.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.153+0000 7f179a60f700 1 -- 172.21.15.146:0/2439173249 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179404f2a0 con 0x7f179406b250 2023-10-03T10:13:34.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.153+0000 7f1790ff9700 1 -- 172.21.15.146:0/2439173249 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1788040b00 con 0x7f179406b250 2023-10-03T10:13:34.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.158+0000 7f1790ff9700 1 -- 172.21.15.146:0/2439173249 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1788019770 con 0x7f179406b250 2023-10-03T10:13:34.167 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:34.203 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:34.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.260+0000 7ff6eb851700 1 Processor -- start 2023-10-03T10:13:34.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.261+0000 7ff6eb851700 1 -- start start 2023-10-03T10:13:34.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.261+0000 7ff6eb851700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff6e40a0a30 0x7ff6e40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.261+0000 7ff6eb851700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6e4130670 0x7ff6e41381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.261+0000 7ff6eb851700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e40a1e70 con 0x7ff6e40a1340 2023-10-03T10:13:34.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.261+0000 7ff6eb851700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e409a720 con 0x7ff6e4130670 2023-10-03T10:13:34.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.261+0000 7ff6eb851700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e409b300 con 0x7ff6e40a0a30 2023-10-03T10:13:34.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.262+0000 7ff6e8dec700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff6e40a1340 0x7ff6e412ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35844/0 (socket says 172.21.15.146:35844) 2023-10-03T10:13:34.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.262+0000 7ff6e8dec700 1 -- 172.21.15.146:0/3562116342 learned_addr learned my addr 172.21.15.146:0/3562116342 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:34.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.262+0000 7ff6e95ed700 1 --2- 172.21.15.146:0/3562116342 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff6e40a0a30 0x7ff6e40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.262+0000 7ff6e9dee700 1 --2- 172.21.15.146:0/3562116342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6e4130670 0x7ff6e41381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.262+0000 7ff6dbfff700 1 -- 172.21.15.146:0/3562116342 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 796339243 0 0) 0x7ff6e40a1e70 con 0x7ff6e40a1340 2023-10-03T10:13:34.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.262+0000 7ff6dbfff700 1 -- 172.21.15.146:0/3562116342 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6d00035b0 con 0x7ff6e40a1340 2023-10-03T10:13:34.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.262+0000 7ff6e95ed700 1 -- 172.21.15.146:0/3562116342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6e4130670 msgr2=0x7ff6e41381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:34.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.262+0000 7ff6e95ed700 1 --2- 172.21.15.146:0/3562116342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6e4130670 0x7ff6e41381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.262+0000 7ff6e95ed700 1 -- 172.21.15.146:0/3562116342 >> v1:172.21.15.146:6789/0 conn(0x7ff6e40a1340 legacy=0x7ff6e412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.262+0000 7ff6e95ed700 1 -- 172.21.15.146:0/3562116342 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e409abc0 con 0x7ff6e40a0a30 2023-10-03T10:13:34.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.262+0000 7ff6e95ed700 1 --2- 172.21.15.146:0/3562116342 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff6e40a0a30 0x7ff6e40a0e00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff6e000baf0 tx=0x7ff6e000be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b227bbcfd6c37 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.262+0000 7ff6dbfff700 1 -- 172.21.15.146:0/3562116342 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0005c20 con 0x7ff6e40a0a30 2023-10-03T10:13:34.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.263+0000 7ff6dbfff700 1 -- 172.21.15.146:0/3562116342 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e0005d80 con 0x7ff6e40a0a30 2023-10-03T10:13:34.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.263+0000 7ff6dbfff700 1 -- 172.21.15.146:0/3562116342 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e000db60 con 0x7ff6e40a0a30 2023-10-03T10:13:34.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.263+0000 7ff6eb851700 1 -- 172.21.15.146:0/3562116342 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff6e40a0a30 msgr2=0x7ff6e40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.263+0000 7ff6eb851700 1 --2- 172.21.15.146:0/3562116342 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff6e40a0a30 0x7ff6e40a0e00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff6e000baf0 tx=0x7ff6e000be00 comp rx=0 tx=0).stop 2023-10-03T10:13:34.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.263+0000 7ff6eb851700 1 -- 172.21.15.146:0/3562116342 shutdown_connections 2023-10-03T10:13:34.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.263+0000 7ff6eb851700 1 --2- 172.21.15.146:0/3562116342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6e4130670 0x7ff6e41381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.263+0000 7ff6eb851700 1 --2- 172.21.15.146:0/3562116342 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff6e40a0a30 0x7ff6e40a0e00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.263+0000 7ff6eb851700 1 -- 172.21.15.146:0/3562116342 >> 172.21.15.146:0/3562116342 conn(0x7ff6e40a2980 msgr2=0x7ff6e40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.263+0000 7ff6eb851700 1 -- 172.21.15.146:0/3562116342 shutdown_connections 2023-10-03T10:13:34.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.263+0000 7ff6eb851700 1 -- 172.21.15.146:0/3562116342 wait complete. 2023-10-03T10:13:34.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.265+0000 7ff6eb851700 1 Processor -- start 2023-10-03T10:13:34.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.265+0000 7ff6eb851700 1 -- start start 2023-10-03T10:13:34.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.265+0000 7ff6eb851700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff6e40a0a30 0x7ff6e41c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.265+0000 7ff6eb851700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6e40a1340 0x7ff6e41c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.265+0000 7ff6eb851700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6e4130670 0x7ff6e41c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.265+0000 7ff6eb851700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e411ce00 con 0x7ff6e40a1340 2023-10-03T10:13:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.265+0000 7ff6eb851700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e411cc10 con 0x7ff6e4130670 2023-10-03T10:13:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.265+0000 7ff6eb851700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e411eb20 con 0x7ff6e40a0a30 2023-10-03T10:13:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.266+0000 7ff6e8dec700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6e40a1340 0x7ff6e41c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.266+0000 7ff6e8dec700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6e40a1340 0x7ff6e41c4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40504/0 (socket says 172.21.15.146:40504) 2023-10-03T10:13:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.266+0000 7ff6e8dec700 1 -- 172.21.15.146:0/533135572 learned_addr learned my addr 172.21.15.146:0/533135572 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.266+0000 7ff6e9dee700 1 --2- 172.21.15.146:0/533135572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6e4130670 0x7ff6e41c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.266+0000 7ff6e95ed700 1 --2- 172.21.15.146:0/533135572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff6e40a0a30 0x7ff6e41c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.266+0000 7ff6e8dec700 1 -- 172.21.15.146:0/533135572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff6e40a0a30 msgr2=0x7ff6e41c3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.266+0000 7ff6e8dec700 1 --2- 172.21.15.146:0/533135572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff6e40a0a30 0x7ff6e41c3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.266+0000 7ff6e8dec700 1 -- 172.21.15.146:0/533135572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6e4130670 msgr2=0x7ff6e41c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.266+0000 7ff6e8dec700 1 --2- 172.21.15.146:0/533135572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6e4130670 0x7ff6e41c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.266+0000 7ff6e8dec700 1 -- 172.21.15.146:0/533135572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e000b6d0 con 0x7ff6e40a1340 2023-10-03T10:13:34.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.266+0000 7ff6e8dec700 1 --2- 172.21.15.146:0/533135572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6e40a1340 0x7ff6e41c4310 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4005910 tx=0x7ff6d400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.266+0000 7ff6d9ffb700 1 -- 172.21.15.146:0/533135572 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4005d70 con 0x7ff6e40a1340 2023-10-03T10:13:34.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.266+0000 7ff6d9ffb700 1 -- 172.21.15.146:0/533135572 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d40070d0 con 0x7ff6e40a1340 2023-10-03T10:13:34.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.266+0000 7ff6eb851700 1 -- 172.21.15.146:0/533135572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e409fb50 con 0x7ff6e40a1340 2023-10-03T10:13:34.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.266+0000 7ff6d9ffb700 1 -- 172.21.15.146:0/533135572 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4007440 con 0x7ff6e40a1340 2023-10-03T10:13:34.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.267+0000 7ff6eb851700 1 -- 172.21.15.146:0/533135572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e409ae50 con 0x7ff6e40a1340 2023-10-03T10:13:34.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.268+0000 7ff6eb851700 1 -- 172.21.15.146:0/533135572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e411e4e0 con 0x7ff6e40a1340 2023-10-03T10:13:34.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.268+0000 7ff6d9ffb700 1 -- 172.21.15.146:0/533135572 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff6d4017020 con 0x7ff6e40a1340 2023-10-03T10:13:34.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.268+0000 7ff6d9ffb700 1 -- 172.21.15.146:0/533135572 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff6d4046070 con 0x7ff6e40a1340 2023-10-03T10:13:34.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.273+0000 7ff6d9ffb700 1 -- 172.21.15.146:0/533135572 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff6d4016ca0 con 0x7ff6e40a1340 2023-10-03T10:13:34.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.298+0000 7f7725db9700 1 Processor -- start 2023-10-03T10:13:34.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.298+0000 7f7725db9700 1 -- start start 2023-10-03T10:13:34.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.298+0000 7f7725db9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772006a770 0x7f77201349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.298+0000 7f7725db9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7720134f00 0x7f772009d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.298+0000 7f7725db9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f772009eca0 con 0x7f772009dea0 2023-10-03T10:13:34.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.298+0000 7f7725db9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772006b2e0 con 0x7f772006a770 2023-10-03T10:13:34.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.298+0000 7f7725db9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f772009f720 con 0x7f7720134f00 2023-10-03T10:13:34.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.298+0000 7f771ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f772009dea0 0x7f772013ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35852/0 (socket says 172.21.15.146:35852) 2023-10-03T10:13:34.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.298+0000 7f771ffff700 1 -- 172.21.15.146:0/2482789460 learned_addr learned my addr 172.21.15.146:0/2482789460 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:34.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.298+0000 7f771f7fe700 1 --2- 172.21.15.146:0/2482789460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772006a770 0x7f77201349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.298+0000 7f771effd700 1 --2- 172.21.15.146:0/2482789460 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7720134f00 0x7f772009d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.299+0000 7f771f7fe700 1 -- 172.21.15.146:0/2482789460 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7720134f00 msgr2=0x7f772009d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:34.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.299+0000 7f771f7fe700 1 --2- 172.21.15.146:0/2482789460 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7720134f00 0x7f772009d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.299+0000 7f771f7fe700 1 -- 172.21.15.146:0/2482789460 >> v1:172.21.15.146:6789/0 conn(0x7f772009dea0 legacy=0x7f772013ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.299+0000 7f771f7fe700 1 -- 172.21.15.146:0/2482789460 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772006b480 con 0x7f772006a770 2023-10-03T10:13:34.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.299+0000 7f771f7fe700 1 --2- 172.21.15.146:0/2482789460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772006a770 0x7f77201349c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7710009870 tx=0x7f7710009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c522f011dcf5b442 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.299+0000 7f771e7fc700 1 -- 172.21.15.146:0/2482789460 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7710011830 con 0x7f772006a770 2023-10-03T10:13:34.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.299+0000 7f771e7fc700 1 -- 172.21.15.146:0/2482789460 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7710011990 con 0x7f772006a770 2023-10-03T10:13:34.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.299+0000 7f771e7fc700 1 -- 172.21.15.146:0/2482789460 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7710011d20 con 0x7f772006a770 2023-10-03T10:13:34.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.300+0000 7f7725db9700 1 -- 172.21.15.146:0/2482789460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772006a770 msgr2=0x7f77201349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.300+0000 7f7725db9700 1 --2- 172.21.15.146:0/2482789460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772006a770 0x7f77201349c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7710009870 tx=0x7f7710009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:34.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.300+0000 7f7725db9700 1 -- 172.21.15.146:0/2482789460 shutdown_connections 2023-10-03T10:13:34.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.300+0000 7f7725db9700 1 --2- 172.21.15.146:0/2482789460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772006a770 0x7f77201349c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.300+0000 7f7725db9700 1 --2- 172.21.15.146:0/2482789460 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7720134f00 0x7f772009d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.300+0000 7f7725db9700 1 -- 172.21.15.146:0/2482789460 >> 172.21.15.146:0/2482789460 conn(0x7f7720099c40 msgr2=0x7f77200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.300+0000 7f7725db9700 1 -- 172.21.15.146:0/2482789460 shutdown_connections 2023-10-03T10:13:34.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.300+0000 7f7725db9700 1 -- 172.21.15.146:0/2482789460 wait complete. 2023-10-03T10:13:34.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.301+0000 7f7725db9700 1 Processor -- start 2023-10-03T10:13:34.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.302+0000 7f7725db9700 1 -- start start 2023-10-03T10:13:34.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.302+0000 7f7725db9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f772006a770 0x7f7720133d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.302+0000 7f7725db9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772009dea0 0x7f772006f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.302+0000 7f7725db9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7720134f00 0x7f772006fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.302+0000 7f7725db9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7720070cb0 con 0x7f7720134f00 2023-10-03T10:13:34.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.302+0000 7f7725db9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7720140b90 con 0x7f772009dea0 2023-10-03T10:13:34.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.302+0000 7f7725db9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77200a0260 con 0x7f772006a770 2023-10-03T10:13:34.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.302+0000 7f771f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f772006a770 0x7f7720133d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.302+0000 7f771effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772009dea0 0x7f772006f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.302+0000 7f771f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f772006a770 0x7f7720133d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56022/0 (socket says 172.21.15.146:56022) 2023-10-03T10:13:34.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.302+0000 7f771f7fe700 1 -- 172.21.15.146:0/3337348549 learned_addr learned my addr 172.21.15.146:0/3337348549 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:34.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.302+0000 7f771effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772009dea0 0x7f772006f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55092/0 (socket says 172.21.15.146:55092) 2023-10-03T10:13:34.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.303+0000 7f771ffff700 1 --2- 172.21.15.146:0/3337348549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7720134f00 0x7f772006fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.303+0000 7f771ffff700 1 -- 172.21.15.146:0/3337348549 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f772006a770 msgr2=0x7f7720133d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.303+0000 7f771ffff700 1 --2- 172.21.15.146:0/3337348549 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f772006a770 0x7f7720133d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.303+0000 7f771ffff700 1 -- 172.21.15.146:0/3337348549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772009dea0 msgr2=0x7f772006f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.303+0000 7f771ffff700 1 --2- 172.21.15.146:0/3337348549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772009dea0 0x7f772006f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.303+0000 7f771ffff700 1 -- 172.21.15.146:0/3337348549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77100094a0 con 0x7f7720134f00 2023-10-03T10:13:34.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.303+0000 7f771effd700 1 --2- 172.21.15.146:0/3337348549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772009dea0 0x7f772006f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.303+0000 7f771f7fe700 1 --2- 172.21.15.146:0/3337348549 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f772006a770 0x7f7720133d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.303+0000 7f771ffff700 1 --2- 172.21.15.146:0/3337348549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7720134f00 0x7f772006fd20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f771800caa0 tx=0x7f771800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.303+0000 7f7707fff700 1 -- 172.21.15.146:0/3337348549 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771800a9a0 con 0x7f7720134f00 2023-10-03T10:13:34.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.303+0000 7f7707fff700 1 -- 172.21.15.146:0/3337348549 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771800ab00 con 0x7f7720134f00 2023-10-03T10:13:34.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.303+0000 7f7707fff700 1 -- 172.21.15.146:0/3337348549 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771800ae70 con 0x7f7720134f00 2023-10-03T10:13:34.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.303+0000 7f7725db9700 1 -- 172.21.15.146:0/3337348549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7720138b70 con 0x7f7720134f00 2023-10-03T10:13:34.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.303+0000 7f7725db9700 1 -- 172.21.15.146:0/3337348549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7720071910 con 0x7f7720134f00 2023-10-03T10:13:34.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.304+0000 7f7725db9700 1 -- 172.21.15.146:0/3337348549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772004f2a0 con 0x7f7720134f00 2023-10-03T10:13:34.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.305+0000 7f7707fff700 1 -- 172.21.15.146:0/3337348549 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f771801b3b0 con 0x7f7720134f00 2023-10-03T10:13:34.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.305+0000 7f7707fff700 1 -- 172.21.15.146:0/3337348549 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f771803f770 con 0x7f7720134f00 2023-10-03T10:13:34.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.314+0000 7f7707fff700 1 -- 172.21.15.146:0/3337348549 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77180192c0 con 0x7f7720134f00 2023-10-03T10:13:34.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.346+0000 7fe332e91700 1 Processor -- start 2023-10-03T10:13:34.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.346+0000 7fe332e91700 1 -- start start 2023-10-03T10:13:34.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.347+0000 7fe332e91700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe32c09e870 0x7fe32c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.347+0000 7fe332e91700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe32c09f180 0x7fe32c133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.347+0000 7fe332e91700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe32c134160 0x7fe32c134600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.347+0000 7fe332e91700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32c0a0370 con 0x7fe32c134160 2023-10-03T10:13:34.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.347+0000 7fe332e91700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c09fa00 con 0x7fe32c09f180 2023-10-03T10:13:34.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.347+0000 7fe332e91700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c09ada0 con 0x7fe32c09e870 2023-10-03T10:13:34.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.347+0000 7fe33142e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe32c134160 0x7fe32c134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.347+0000 7fe32bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe32c09f180 0x7fe32c133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.347+0000 7fe33142e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe32c134160 0x7fe32c134600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40518/0 (socket says 172.21.15.146:40518) 2023-10-03T10:13:34.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.347+0000 7fe33142e700 1 -- 172.21.15.146:0/1960144035 learned_addr learned my addr 172.21.15.146:0/1960144035 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:34.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.347+0000 7fe330c2d700 1 --2- 172.21.15.146:0/1960144035 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe32c09e870 0x7fe32c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.348+0000 7fe32bfff700 1 -- 172.21.15.146:0/1960144035 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe32c09e870 msgr2=0x7fe32c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:34.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.348+0000 7fe32bfff700 1 --2- 172.21.15.146:0/1960144035 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe32c09e870 0x7fe32c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.348+0000 7fe32bfff700 1 -- 172.21.15.146:0/1960144035 >> v2:172.21.15.146:3300/0 conn(0x7fe32c134160 msgr2=0x7fe32c134600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:34.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.348+0000 7fe32bfff700 1 --2- 172.21.15.146:0/1960144035 >> v2:172.21.15.146:3300/0 conn(0x7fe32c134160 0x7fe32c134600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.348+0000 7fe32bfff700 1 -- 172.21.15.146:0/1960144035 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c06bec0 con 0x7fe32c09f180 2023-10-03T10:13:34.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.348+0000 7fe33142e700 1 --2- 172.21.15.146:0/1960144035 >> v2:172.21.15.146:3300/0 conn(0x7fe32c134160 0x7fe32c134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.348+0000 7fe32bfff700 1 --2- 172.21.15.146:0/1960144035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe32c09f180 0x7fe32c133c20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe318009870 tx=0x7fe318009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94f46bd521d78ee7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.348+0000 7fe32b7fe700 1 -- 172.21.15.146:0/1960144035 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe318011830 con 0x7fe32c09f180 2023-10-03T10:13:34.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.348+0000 7fe32b7fe700 1 -- 172.21.15.146:0/1960144035 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe318011990 con 0x7fe32c09f180 2023-10-03T10:13:34.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.348+0000 7fe32b7fe700 1 -- 172.21.15.146:0/1960144035 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe318011d20 con 0x7fe32c09f180 2023-10-03T10:13:34.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.348+0000 7fe332e91700 1 -- 172.21.15.146:0/1960144035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe32c09f180 msgr2=0x7fe32c133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.348+0000 7fe332e91700 1 --2- 172.21.15.146:0/1960144035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe32c09f180 0x7fe32c133c20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe318009870 tx=0x7fe318009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:34.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.349+0000 7fe332e91700 1 -- 172.21.15.146:0/1960144035 shutdown_connections 2023-10-03T10:13:34.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.349+0000 7fe332e91700 1 --2- 172.21.15.146:0/1960144035 >> v2:172.21.15.146:3300/0 conn(0x7fe32c134160 0x7fe32c134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.349+0000 7fe332e91700 1 --2- 172.21.15.146:0/1960144035 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe32c09e870 0x7fe32c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.349+0000 7fe332e91700 1 --2- 172.21.15.146:0/1960144035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe32c09f180 0x7fe32c133c20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.349+0000 7fe332e91700 1 -- 172.21.15.146:0/1960144035 >> 172.21.15.146:0/1960144035 conn(0x7fe32c0a4430 msgr2=0x7fe32c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.349+0000 7fe332e91700 1 -- 172.21.15.146:0/1960144035 shutdown_connections 2023-10-03T10:13:34.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.349+0000 7fe332e91700 1 -- 172.21.15.146:0/1960144035 wait complete. 2023-10-03T10:13:34.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.349+0000 7fe332e91700 1 Processor -- start 2023-10-03T10:13:34.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.350+0000 7fe332e91700 1 -- start start 2023-10-03T10:13:34.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.350+0000 7fe332e91700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe32c09e870 0x7fe32c1216d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.350+0000 7fe332e91700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32c09f180 0x7fe32c121c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.350+0000 7fe332e91700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe32c134160 0x7fe32c122150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.350+0000 7fe332e91700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c132af0 con 0x7fe32c09f180 2023-10-03T10:13:34.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.350+0000 7fe332e91700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c124e50 con 0x7fe32c134160 2023-10-03T10:13:34.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.350+0000 7fe332e91700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c0a3c40 con 0x7fe32c09e870 2023-10-03T10:13:34.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.350+0000 7fe32bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32c09f180 0x7fe32c121c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.350+0000 7fe32bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32c09f180 0x7fe32c121c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40526/0 (socket says 172.21.15.146:40526) 2023-10-03T10:13:34.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.350+0000 7fe32bfff700 1 -- 172.21.15.146:0/1676685780 learned_addr learned my addr 172.21.15.146:0/1676685780 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:34.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.350+0000 7fe330c2d700 1 --2- 172.21.15.146:0/1676685780 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe32c09e870 0x7fe32c1216d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.350+0000 7fe33142e700 1 --2- 172.21.15.146:0/1676685780 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe32c134160 0x7fe32c122150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.351+0000 7fe32bfff700 1 -- 172.21.15.146:0/1676685780 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe32c09e870 msgr2=0x7fe32c1216d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.351+0000 7fe32bfff700 1 --2- 172.21.15.146:0/1676685780 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe32c09e870 0x7fe32c1216d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.351+0000 7fe32bfff700 1 -- 172.21.15.146:0/1676685780 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe32c134160 msgr2=0x7fe32c122150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.351+0000 7fe32bfff700 1 --2- 172.21.15.146:0/1676685780 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe32c134160 0x7fe32c122150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.351+0000 7fe32bfff700 1 -- 172.21.15.146:0/1676685780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe324009b30 con 0x7fe32c09f180 2023-10-03T10:13:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.351+0000 7fe33142e700 1 --2- 172.21.15.146:0/1676685780 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe32c134160 0x7fe32c122150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.351+0000 7fe32bfff700 1 --2- 172.21.15.146:0/1676685780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32c09f180 0x7fe32c121c10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe318000c00 tx=0x7fe318004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.351+0000 7fe3297fa700 1 -- 172.21.15.146:0/1676685780 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe318004450 con 0x7fe32c09f180 2023-10-03T10:13:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.351+0000 7fe3297fa700 1 -- 172.21.15.146:0/1676685780 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31801f070 con 0x7fe32c09f180 2023-10-03T10:13:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.351+0000 7fe332e91700 1 -- 172.21.15.146:0/1676685780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3180094a0 con 0x7fe32c09f180 2023-10-03T10:13:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.351+0000 7fe3297fa700 1 -- 172.21.15.146:0/1676685780 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3180038a0 con 0x7fe32c09f180 2023-10-03T10:13:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.351+0000 7fe332e91700 1 -- 172.21.15.146:0/1676685780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32c06cfa0 con 0x7fe32c09f180 2023-10-03T10:13:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.352+0000 7fe3297fa700 1 -- 172.21.15.146:0/1676685780 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe318003a00 con 0x7fe32c09f180 2023-10-03T10:13:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.352+0000 7fe3297fa700 1 -- 172.21.15.146:0/1676685780 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe318021070 con 0x7fe32c09f180 2023-10-03T10:13:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.352+0000 7fe332e91700 1 -- 172.21.15.146:0/1676685780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32c09db20 con 0x7fe32c09f180 2023-10-03T10:13:34.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.357+0000 7fe3297fa700 1 -- 172.21.15.146:0/1676685780 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe31802b080 con 0x7fe32c09f180 2023-10-03T10:13:34.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.371+0000 7f179a60f700 1 -- 172.21.15.146:0/2439173249 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f179406c3b0 con 0x7f179406b250 2023-10-03T10:13:34.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.372+0000 7f1790ff9700 1 -- 172.21.15.146:0/2439173249 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1788029020 con 0x7f179406b250 2023-10-03T10:13:34.372 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:34.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.374+0000 7f179a60f700 1 -- 172.21.15.146:0/2439173249 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f179406b250 msgr2=0x7f17941209e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.374+0000 7f179a60f700 1 --2- 172.21.15.146:0/2439173249 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f179406b250 0x7f17941209e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1788009c40 tx=0x7f1788004750 comp rx=0 tx=0).stop 2023-10-03T10:13:34.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.374+0000 7f179a60f700 1 -- 172.21.15.146:0/2439173249 shutdown_connections 2023-10-03T10:13:34.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.374+0000 7f179a60f700 1 --2- 172.21.15.146:0/2439173249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1794137140 0x7f1794120f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.374+0000 7f179a60f700 1 --2- 172.21.15.146:0/2439173249 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f179406a770 0x7f17941204a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.374+0000 7f179a60f700 1 --2- 172.21.15.146:0/2439173249 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f179406b250 0x7f17941209e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.374+0000 7f179a60f700 1 -- 172.21.15.146:0/2439173249 >> 172.21.15.146:0/2439173249 conn(0x7f1794099c40 msgr2=0x7f179406fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.374+0000 7f179a60f700 1 -- 172.21.15.146:0/2439173249 shutdown_connections 2023-10-03T10:13:34.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.374+0000 7f179a60f700 1 -- 172.21.15.146:0/2439173249 wait complete. 2023-10-03T10:13:34.387 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:34.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.474+0000 7ff6eb851700 1 -- 172.21.15.146:0/533135572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff6e411e6a0 con 0x7ff6e40a1340 2023-10-03T10:13:34.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.475+0000 7ff6d9ffb700 1 -- 172.21.15.146:0/533135572 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff6e411e6a0 con 0x7ff6e40a1340 2023-10-03T10:13:34.475 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:34.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.477+0000 7ff6eb851700 1 -- 172.21.15.146:0/533135572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6e40a1340 msgr2=0x7ff6e41c4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.477+0000 7ff6eb851700 1 --2- 172.21.15.146:0/533135572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6e40a1340 0x7ff6e41c4310 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4005910 tx=0x7ff6d400c960 comp rx=0 tx=0).stop 2023-10-03T10:13:34.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.477+0000 7ff6eb851700 1 -- 172.21.15.146:0/533135572 shutdown_connections 2023-10-03T10:13:34.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.477+0000 7ff6eb851700 1 --2- 172.21.15.146:0/533135572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6e4130670 0x7ff6e41c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.477+0000 7ff6eb851700 1 --2- 172.21.15.146:0/533135572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff6e40a0a30 0x7ff6e41c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.477+0000 7ff6eb851700 1 --2- 172.21.15.146:0/533135572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6e40a1340 0x7ff6e41c4310 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.477+0000 7ff6eb851700 1 -- 172.21.15.146:0/533135572 >> 172.21.15.146:0/533135572 conn(0x7ff6e40a2980 msgr2=0x7ff6e41b78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.477+0000 7ff6eb851700 1 -- 172.21.15.146:0/533135572 shutdown_connections 2023-10-03T10:13:34.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.477+0000 7ff6eb851700 1 -- 172.21.15.146:0/533135572 wait complete. 2023-10-03T10:13:34.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:34.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.508+0000 7f7725db9700 1 -- 172.21.15.146:0/3337348549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7720071b50 con 0x7f7720134f00 2023-10-03T10:13:34.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.509+0000 7f7707fff700 1 -- 172.21.15.146:0/3337348549 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7718017030 con 0x7f7720134f00 2023-10-03T10:13:34.509 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:34.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.512+0000 7f7725db9700 1 -- 172.21.15.146:0/3337348549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7720134f00 msgr2=0x7f772006fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.512+0000 7f7725db9700 1 --2- 172.21.15.146:0/3337348549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7720134f00 0x7f772006fd20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f771800caa0 tx=0x7f771800cdb0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.512+0000 7f7725db9700 1 -- 172.21.15.146:0/3337348549 shutdown_connections 2023-10-03T10:13:34.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.512+0000 7f7725db9700 1 --2- 172.21.15.146:0/3337348549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7720134f00 0x7f772006fd20 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.512+0000 7f7725db9700 1 --2- 172.21.15.146:0/3337348549 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f772006a770 0x7f7720133d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.512+0000 7f7725db9700 1 --2- 172.21.15.146:0/3337348549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772009dea0 0x7f772006f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.512+0000 7f7725db9700 1 -- 172.21.15.146:0/3337348549 >> 172.21.15.146:0/3337348549 conn(0x7f7720099c40 msgr2=0x7f772009c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.512+0000 7f7725db9700 1 -- 172.21.15.146:0/3337348549 shutdown_connections 2023-10-03T10:13:34.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.512+0000 7f7725db9700 1 -- 172.21.15.146:0/3337348549 wait complete. 2023-10-03T10:13:34.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:34.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.560+0000 7fe332e91700 1 -- 172.21.15.146:0/1676685780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe32c074f10 con 0x7fe32c09f180 2023-10-03T10:13:34.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.560+0000 7fe3297fa700 1 -- 172.21.15.146:0/1676685780 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe318035090 con 0x7fe32c09f180 2023-10-03T10:13:34.561 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:34.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.562+0000 7fe332e91700 1 -- 172.21.15.146:0/1676685780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32c09f180 msgr2=0x7fe32c121c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.562+0000 7fe332e91700 1 --2- 172.21.15.146:0/1676685780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32c09f180 0x7fe32c121c10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe318000c00 tx=0x7fe318004750 comp rx=0 tx=0).stop 2023-10-03T10:13:34.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.562+0000 7fe332e91700 1 -- 172.21.15.146:0/1676685780 shutdown_connections 2023-10-03T10:13:34.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.562+0000 7fe332e91700 1 --2- 172.21.15.146:0/1676685780 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe32c134160 0x7fe32c122150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.562+0000 7fe332e91700 1 --2- 172.21.15.146:0/1676685780 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe32c09e870 0x7fe32c1216d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.562+0000 7fe332e91700 1 --2- 172.21.15.146:0/1676685780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32c09f180 0x7fe32c121c10 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.562+0000 7fe332e91700 1 -- 172.21.15.146:0/1676685780 >> 172.21.15.146:0/1676685780 conn(0x7fe32c0a4430 msgr2=0x7fe32c06f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.562+0000 7fe332e91700 1 -- 172.21.15.146:0/1676685780 shutdown_connections 2023-10-03T10:13:34.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:34.562+0000 7fe332e91700 1 -- 172.21.15.146:0/1676685780 wait complete. 2023-10-03T10:13:34.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:35.388 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:35.490 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:35.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.524+0000 7f567e7de700 1 Processor -- start 2023-10-03T10:13:35.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.524+0000 7f567e7de700 1 -- start start 2023-10-03T10:13:35.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.525+0000 7f567e7de700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5678133ad0 0x7f5678133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.525+0000 7f567e7de700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f56781300a0 0x7f56781304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.525+0000 7f567e7de700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567806b2d0 con 0x7f56781309f0 2023-10-03T10:13:35.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.525+0000 7f567e7de700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5678133610 con 0x7f5678133ad0 2023-10-03T10:13:35.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.525+0000 7f567e7de700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f567809a500 con 0x7f56781300a0 2023-10-03T10:13:35.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.525+0000 7f5677fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5678133ad0 0x7f5678133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.525+0000 7f56777fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f56781300a0 0x7f56781304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.525+0000 7f567cd7b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f56781309f0 0x7f567813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35858/0 (socket says 172.21.15.146:35858) 2023-10-03T10:13:35.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.525+0000 7f567cd7b700 1 -- 172.21.15.146:0/788659382 learned_addr learned my addr 172.21.15.146:0/788659382 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:35.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.525+0000 7f56777fe700 1 -- 172.21.15.146:0/788659382 >> v2:172.21.15.146:3300/0 conn(0x7f5678133ad0 msgr2=0x7f5678133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:35.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.525+0000 7f56777fe700 1 --2- 172.21.15.146:0/788659382 >> v2:172.21.15.146:3300/0 conn(0x7f5678133ad0 0x7f5678133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.525+0000 7f56777fe700 1 -- 172.21.15.146:0/788659382 >> v1:172.21.15.146:6789/0 conn(0x7f56781309f0 legacy=0x7f567813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.525+0000 7f56777fe700 1 -- 172.21.15.146:0/788659382 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56781338b0 con 0x7f56781300a0 2023-10-03T10:13:35.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.525+0000 7f5677fff700 1 --2- 172.21.15.146:0/788659382 >> v2:172.21.15.146:3300/0 conn(0x7f5678133ad0 0x7f5678133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:35.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.525+0000 7f56777fe700 1 --2- 172.21.15.146:0/788659382 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f56781300a0 0x7f56781304b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f566c009840 tx=0x7f566c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=839e80242765c8f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.525+0000 7f5676ffd700 1 -- 172.21.15.146:0/788659382 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c011830 con 0x7f56781300a0 2023-10-03T10:13:35.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.525+0000 7f5676ffd700 1 -- 172.21.15.146:0/788659382 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c011990 con 0x7f56781300a0 2023-10-03T10:13:35.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.525+0000 7f5676ffd700 1 -- 172.21.15.146:0/788659382 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c011d20 con 0x7f56781300a0 2023-10-03T10:13:35.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.526+0000 7f567e7de700 1 -- 172.21.15.146:0/788659382 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f56781300a0 msgr2=0x7f56781304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.526+0000 7f567e7de700 1 --2- 172.21.15.146:0/788659382 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f56781300a0 0x7f56781304b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f566c009840 tx=0x7f566c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:35.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.526+0000 7f567e7de700 1 -- 172.21.15.146:0/788659382 shutdown_connections 2023-10-03T10:13:35.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.526+0000 7f567e7de700 1 --2- 172.21.15.146:0/788659382 >> v2:172.21.15.146:3300/0 conn(0x7f5678133ad0 0x7f5678133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.526+0000 7f567e7de700 1 --2- 172.21.15.146:0/788659382 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f56781300a0 0x7f56781304b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.526+0000 7f567e7de700 1 -- 172.21.15.146:0/788659382 >> 172.21.15.146:0/788659382 conn(0x7f5678099c40 msgr2=0x7f56780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.526+0000 7f567e7de700 1 -- 172.21.15.146:0/788659382 shutdown_connections 2023-10-03T10:13:35.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.526+0000 7f567e7de700 1 -- 172.21.15.146:0/788659382 wait complete. 2023-10-03T10:13:35.530 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:35.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.527+0000 7f567e7de700 1 Processor -- start 2023-10-03T10:13:35.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.527+0000 7f567e7de700 1 -- start start 2023-10-03T10:13:35.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f567e7de700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56781300a0 0x7f567811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f567e7de700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f56781309f0 0x7f567811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f567e7de700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5678133ad0 0x7f567811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f567e7de700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567812fdf0 con 0x7f56781300a0 2023-10-03T10:13:35.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f567e7de700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567812dd00 con 0x7f5678133ad0 2023-10-03T10:13:35.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f567e7de700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5678072380 con 0x7f56781309f0 2023-10-03T10:13:35.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f567cd7b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5678133ad0 0x7f567811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f56777fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f56781309f0 0x7f567811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f56777fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f56781309f0 0x7f567811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56060/0 (socket says 172.21.15.146:56060) 2023-10-03T10:13:35.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f56777fe700 1 -- 172.21.15.146:0/3993828409 learned_addr learned my addr 172.21.15.146:0/3993828409 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:35.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f5677fff700 1 --2- 172.21.15.146:0/3993828409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56781300a0 0x7f567811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f56777fe700 1 -- 172.21.15.146:0/3993828409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5678133ad0 msgr2=0x7f567811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f56777fe700 1 --2- 172.21.15.146:0/3993828409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5678133ad0 0x7f567811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f56777fe700 1 -- 172.21.15.146:0/3993828409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56781300a0 msgr2=0x7f567811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f56777fe700 1 --2- 172.21.15.146:0/3993828409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56781300a0 0x7f567811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f56777fe700 1 -- 172.21.15.146:0/3993828409 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56680094a0 con 0x7f56781309f0 2023-10-03T10:13:35.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f567cd7b700 1 --2- 172.21.15.146:0/3993828409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5678133ad0 0x7f567811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:35.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f56777fe700 1 --2- 172.21.15.146:0/3993828409 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f56781309f0 0x7f567811df80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f566c009fd0 tx=0x7f566c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f5674ff9700 1 -- 172.21.15.146:0/3993828409 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c0036a0 con 0x7f56781309f0 2023-10-03T10:13:35.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f5674ff9700 1 -- 172.21.15.146:0/3993828409 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c01e070 con 0x7f56781309f0 2023-10-03T10:13:35.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f567e7de700 1 -- 172.21.15.146:0/3993828409 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566c0094a0 con 0x7f56781309f0 2023-10-03T10:13:35.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f5674ff9700 1 -- 172.21.15.146:0/3993828409 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c003a60 con 0x7f56781309f0 2023-10-03T10:13:35.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.528+0000 7f567e7de700 1 -- 172.21.15.146:0/3993828409 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f567811ff20 con 0x7f56781309f0 2023-10-03T10:13:35.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.529+0000 7f5674ff9700 1 -- 172.21.15.146:0/3993828409 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f566c003bc0 con 0x7f56781309f0 2023-10-03T10:13:35.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.529+0000 7f5674ff9700 1 -- 172.21.15.146:0/3993828409 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f566c020070 con 0x7f56781309f0 2023-10-03T10:13:35.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.530+0000 7f567e7de700 1 -- 172.21.15.146:0/3993828409 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f567804f2a0 con 0x7f56781309f0 2023-10-03T10:13:35.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.534+0000 7f5674ff9700 1 -- 172.21.15.146:0/3993828409 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f566c023790 con 0x7f56781309f0 2023-10-03T10:13:35.575 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:35.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.619+0000 7face0095700 1 Processor -- start 2023-10-03T10:13:35.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.620+0000 7face0095700 1 -- start start 2023-10-03T10:13:35.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.620+0000 7face0095700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facd81346e0 0x7facd8136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.620+0000 7face0095700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facd8137000 0x7facd81393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.620+0000 7face0095700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd80a1640 con 0x7facd8131980 2023-10-03T10:13:35.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.620+0000 7face0095700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd806eb30 con 0x7facd81346e0 2023-10-03T10:13:35.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.620+0000 7face0095700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facd80a22d0 con 0x7facd8137000 2023-10-03T10:13:35.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.620+0000 7facde632700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facd8137000 0x7facd81393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.620+0000 7facde632700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facd8137000 0x7facd81393e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56066/0 (socket says 172.21.15.146:56066) 2023-10-03T10:13:35.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.620+0000 7facdde31700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7facd8131980 0x7facd8131d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35860/0 (socket says 172.21.15.146:35860) 2023-10-03T10:13:35.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.620+0000 7facde632700 1 -- 172.21.15.146:0/1742683927 learned_addr learned my addr 172.21.15.146:0/1742683927 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:35.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.620+0000 7facdd630700 1 --2- 172.21.15.146:0/1742683927 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facd81346e0 0x7facd8136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.621+0000 7facdce2f700 1 -- 172.21.15.146:0/1742683927 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920665141 0 0) 0x7facd80a1640 con 0x7facd8131980 2023-10-03T10:13:35.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.621+0000 7facde632700 1 -- 172.21.15.146:0/1742683927 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facd81346e0 msgr2=0x7facd8136ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:35.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.621+0000 7facde632700 1 --2- 172.21.15.146:0/1742683927 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facd81346e0 0x7facd8136ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.621+0000 7facde632700 1 -- 172.21.15.146:0/1742683927 >> v1:172.21.15.146:6789/0 conn(0x7facd8131980 legacy=0x7facd8131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.621+0000 7facde632700 1 -- 172.21.15.146:0/1742683927 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd8131550 con 0x7facd8137000 2023-10-03T10:13:35.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.621+0000 7facde632700 1 --2- 172.21.15.146:0/1742683927 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facd8137000 0x7facd81393e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7facd0009e80 tx=0x7facd000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51da4b9c5dcc4b4c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.621+0000 7facdce2f700 1 -- 172.21.15.146:0/1742683927 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd000e070 con 0x7facd8137000 2023-10-03T10:13:35.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.621+0000 7facdce2f700 1 -- 172.21.15.146:0/1742683927 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd000b910 con 0x7facd8137000 2023-10-03T10:13:35.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.621+0000 7facdce2f700 1 -- 172.21.15.146:0/1742683927 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd000bcc0 con 0x7facd8137000 2023-10-03T10:13:35.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.622+0000 7face0095700 1 -- 172.21.15.146:0/1742683927 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facd8137000 msgr2=0x7facd81393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.622+0000 7face0095700 1 --2- 172.21.15.146:0/1742683927 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facd8137000 0x7facd81393e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7facd0009e80 tx=0x7facd000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:35.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.622+0000 7face0095700 1 -- 172.21.15.146:0/1742683927 shutdown_connections 2023-10-03T10:13:35.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.622+0000 7face0095700 1 --2- 172.21.15.146:0/1742683927 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facd8137000 0x7facd81393e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.622+0000 7face0095700 1 --2- 172.21.15.146:0/1742683927 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facd81346e0 0x7facd8136ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.622+0000 7face0095700 1 -- 172.21.15.146:0/1742683927 >> 172.21.15.146:0/1742683927 conn(0x7facd80a2980 msgr2=0x7facd80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.622+0000 7face0095700 1 -- 172.21.15.146:0/1742683927 shutdown_connections 2023-10-03T10:13:35.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.622+0000 7face0095700 1 -- 172.21.15.146:0/1742683927 wait complete. 2023-10-03T10:13:35.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.624+0000 7face0095700 1 Processor -- start 2023-10-03T10:13:35.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.624+0000 7face0095700 1 -- start start 2023-10-03T10:13:35.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.624+0000 7face0095700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facd8131980 0x7facd8099a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.624+0000 7face0095700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facd81346e0 0x7facd8099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.624+0000 7face0095700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facd8137000 0x7facd809a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.624+0000 7face0095700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd811e6c0 con 0x7facd8131980 2023-10-03T10:13:35.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.624+0000 7face0095700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd811e300 con 0x7facd81346e0 2023-10-03T10:13:35.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.624+0000 7face0095700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facd811d320 con 0x7facd8137000 2023-10-03T10:13:35.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.625+0000 7facdde31700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facd8131980 0x7facd8099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.625+0000 7facdd630700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facd81346e0 0x7facd8099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.625+0000 7facdde31700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facd8131980 0x7facd8099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40554/0 (socket says 172.21.15.146:40554) 2023-10-03T10:13:35.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.625+0000 7facdde31700 1 -- 172.21.15.146:0/1741310597 learned_addr learned my addr 172.21.15.146:0/1741310597 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:35.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.625+0000 7facdd630700 1 --2- 172.21.15.146:0/1741310597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facd81346e0 0x7facd8099fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55132/0 (socket says 172.21.15.146:55132) 2023-10-03T10:13:35.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.625+0000 7facde632700 1 --2- 172.21.15.146:0/1741310597 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facd8137000 0x7facd809a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.625+0000 7facdd630700 1 -- 172.21.15.146:0/1741310597 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facd8137000 msgr2=0x7facd809a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.625+0000 7facdd630700 1 --2- 172.21.15.146:0/1741310597 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facd8137000 0x7facd809a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.625+0000 7facdd630700 1 -- 172.21.15.146:0/1741310597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facd8131980 msgr2=0x7facd8099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.625+0000 7facdd630700 1 --2- 172.21.15.146:0/1741310597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facd8131980 0x7facd8099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.625+0000 7facdd630700 1 -- 172.21.15.146:0/1741310597 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd0009b30 con 0x7facd81346e0 2023-10-03T10:13:35.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.625+0000 7facdde31700 1 --2- 172.21.15.146:0/1741310597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facd8131980 0x7facd8099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:35.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.625+0000 7facdd630700 1 --2- 172.21.15.146:0/1741310597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facd81346e0 0x7facd8099fa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7facc800e930 tx=0x7facc800ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.625+0000 7facce7fc700 1 -- 172.21.15.146:0/1741310597 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8013680 con 0x7facd81346e0 2023-10-03T10:13:35.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.625+0000 7facce7fc700 1 -- 172.21.15.146:0/1741310597 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc80137e0 con 0x7facd81346e0 2023-10-03T10:13:35.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.626+0000 7face0095700 1 -- 172.21.15.146:0/1741310597 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd80a1c40 con 0x7facd81346e0 2023-10-03T10:13:35.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.626+0000 7facce7fc700 1 -- 172.21.15.146:0/1741310597 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8013b50 con 0x7facd81346e0 2023-10-03T10:13:35.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.626+0000 7face0095700 1 -- 172.21.15.146:0/1741310597 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd811dff0 con 0x7facd81346e0 2023-10-03T10:13:35.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.627+0000 7face0095700 1 -- 172.21.15.146:0/1741310597 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd811e500 con 0x7facd81346e0 2023-10-03T10:13:35.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.627+0000 7facce7fc700 1 -- 172.21.15.146:0/1741310597 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7facc8013cb0 con 0x7facd81346e0 2023-10-03T10:13:35.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.627+0000 7facce7fc700 1 -- 172.21.15.146:0/1741310597 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7facc803f780 con 0x7facd81346e0 2023-10-03T10:13:35.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.636+0000 7facce7fc700 1 -- 172.21.15.146:0/1741310597 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7facc801be10 con 0x7facd81346e0 2023-10-03T10:13:35.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.663+0000 7f08866c8700 1 Processor -- start 2023-10-03T10:13:35.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.663+0000 7f08866c8700 1 -- start start 2023-10-03T10:13:35.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.664+0000 7f08866c8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0880099e20 0x7f088009a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.664+0000 7f08866c8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f088009a730 0x7f0880130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.664+0000 7f08866c8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0880099a60 con 0x7f0880130890 2023-10-03T10:13:35.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.664+0000 7f08866c8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088009bf50 con 0x7f0880099e20 2023-10-03T10:13:35.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.664+0000 7f08866c8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f088009b230 con 0x7f088009a730 2023-10-03T10:13:35.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.664+0000 7f0884c65700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0880130890 0x7f0880137680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35876/0 (socket says 172.21.15.146:35876) 2023-10-03T10:13:35.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.664+0000 7f0884c65700 1 -- 172.21.15.146:0/1176482183 learned_addr learned my addr 172.21.15.146:0/1176482183 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:35.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.664+0000 7f087f7fe700 1 --2- 172.21.15.146:0/1176482183 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f088009a730 0x7f0880130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.664+0000 7f087ffff700 1 --2- 172.21.15.146:0/1176482183 >> v2:172.21.15.146:3300/0 conn(0x7f0880099e20 0x7f088009a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.664+0000 7f087effd700 1 -- 172.21.15.146:0/1176482183 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181433143 0 0) 0x7f0880099a60 con 0x7f0880130890 2023-10-03T10:13:35.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.664+0000 7f087effd700 1 -- 172.21.15.146:0/1176482183 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08680035b0 con 0x7f0880130890 2023-10-03T10:13:35.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.664+0000 7f087ffff700 1 -- 172.21.15.146:0/1176482183 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f088009a730 msgr2=0x7f0880130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:35.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.664+0000 7f087ffff700 1 --2- 172.21.15.146:0/1176482183 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f088009a730 0x7f0880130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.665+0000 7f087ffff700 1 -- 172.21.15.146:0/1176482183 >> v1:172.21.15.146:6789/0 conn(0x7f0880130890 legacy=0x7f0880137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.665+0000 7f087ffff700 1 -- 172.21.15.146:0/1176482183 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088009bb90 con 0x7f0880099e20 2023-10-03T10:13:35.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.665+0000 7f087ffff700 1 --2- 172.21.15.146:0/1176482183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0880099e20 0x7f088009a1f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0870009820 tx=0x7f0870009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c019ee74cca7eed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.665+0000 7f087effd700 1 -- 172.21.15.146:0/1176482183 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870005e30 con 0x7f0880099e20 2023-10-03T10:13:35.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.665+0000 7f087effd700 1 -- 172.21.15.146:0/1176482183 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0870006030 con 0x7f0880099e20 2023-10-03T10:13:35.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.665+0000 7f087effd700 1 -- 172.21.15.146:0/1176482183 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08700063a0 con 0x7f0880099e20 2023-10-03T10:13:35.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.666+0000 7f08866c8700 1 -- 172.21.15.146:0/1176482183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0880099e20 msgr2=0x7f088009a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.666+0000 7f08866c8700 1 --2- 172.21.15.146:0/1176482183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0880099e20 0x7f088009a1f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0870009820 tx=0x7f0870009b30 comp rx=0 tx=0).stop 2023-10-03T10:13:35.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.666+0000 7f08866c8700 1 -- 172.21.15.146:0/1176482183 shutdown_connections 2023-10-03T10:13:35.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.666+0000 7f08866c8700 1 --2- 172.21.15.146:0/1176482183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0880099e20 0x7f088009a1f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.666+0000 7f08866c8700 1 --2- 172.21.15.146:0/1176482183 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f088009a730 0x7f0880130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.666+0000 7f08866c8700 1 -- 172.21.15.146:0/1176482183 >> 172.21.15.146:0/1176482183 conn(0x7f08800a2980 msgr2=0x7f08800a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.666+0000 7f08866c8700 1 -- 172.21.15.146:0/1176482183 shutdown_connections 2023-10-03T10:13:35.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.666+0000 7f08866c8700 1 -- 172.21.15.146:0/1176482183 wait complete. 2023-10-03T10:13:35.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.667+0000 7f08866c8700 1 Processor -- start 2023-10-03T10:13:35.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.668+0000 7f08866c8700 1 -- start start 2023-10-03T10:13:35.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.668+0000 7f08866c8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0880099e20 0x7f088012aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.668+0000 7f08866c8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f088009a730 0x7f088012b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.668+0000 7f08866c8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0880130890 0x7f08801c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.668+0000 7f08866c8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088012db10 con 0x7f088009a730 2023-10-03T10:13:35.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.668+0000 7f08866c8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088012d850 con 0x7f0880099e20 2023-10-03T10:13:35.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.668+0000 7f08866c8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f088009b470 con 0x7f0880130890 2023-10-03T10:13:35.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.668+0000 7f087f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f088009a730 0x7f088012b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.668+0000 7f087ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0880099e20 0x7f088012aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.669+0000 7f087f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f088009a730 0x7f088012b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40570/0 (socket says 172.21.15.146:40570) 2023-10-03T10:13:35.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.669+0000 7f087f7fe700 1 -- 172.21.15.146:0/2500539479 learned_addr learned my addr 172.21.15.146:0/2500539479 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:35.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.669+0000 7f087ffff700 1 --2- 172.21.15.146:0/2500539479 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0880099e20 0x7f088012aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55142/0 (socket says 172.21.15.146:55142) 2023-10-03T10:13:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.669+0000 7f0884c65700 1 --2- 172.21.15.146:0/2500539479 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0880130890 0x7f08801c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.669+0000 7f087ffff700 1 -- 172.21.15.146:0/2500539479 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0880130890 msgr2=0x7f08801c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.669+0000 7f087ffff700 1 --2- 172.21.15.146:0/2500539479 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0880130890 0x7f08801c5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.669+0000 7f087ffff700 1 -- 172.21.15.146:0/2500539479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f088009a730 msgr2=0x7f088012b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.669+0000 7f087ffff700 1 --2- 172.21.15.146:0/2500539479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f088009a730 0x7f088012b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.669+0000 7f087ffff700 1 -- 172.21.15.146:0/2500539479 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0870009430 con 0x7f0880099e20 2023-10-03T10:13:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.669+0000 7f087f7fe700 1 --2- 172.21.15.146:0/2500539479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f088009a730 0x7f088012b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.669+0000 7f087ffff700 1 --2- 172.21.15.146:0/2500539479 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0880099e20 0x7f088012aca0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0870015000 tx=0x7f0870004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.669+0000 7f087cff9700 1 -- 172.21.15.146:0/2500539479 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870022070 con 0x7f0880099e20 2023-10-03T10:13:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.669+0000 7f087cff9700 1 -- 172.21.15.146:0/2500539479 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08700067b0 con 0x7f0880099e20 2023-10-03T10:13:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.669+0000 7f087cff9700 1 -- 172.21.15.146:0/2500539479 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08700042a0 con 0x7f0880099e20 2023-10-03T10:13:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.669+0000 7f08866c8700 1 -- 172.21.15.146:0/2500539479 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088012b720 con 0x7f0880099e20 2023-10-03T10:13:35.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.669+0000 7f08866c8700 1 -- 172.21.15.146:0/2500539479 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f088012a960 con 0x7f0880099e20 2023-10-03T10:13:35.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.670+0000 7f087cff9700 1 -- 172.21.15.146:0/2500539479 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0870004400 con 0x7f0880099e20 2023-10-03T10:13:35.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.670+0000 7f087cff9700 1 -- 172.21.15.146:0/2500539479 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0870044240 con 0x7f0880099e20 2023-10-03T10:13:35.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.670+0000 7f08667fc700 1 -- 172.21.15.146:0/2500539479 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08580052e0 con 0x7f0880099e20 2023-10-03T10:13:35.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.675+0000 7f087cff9700 1 -- 172.21.15.146:0/2500539479 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f087001c900 con 0x7f0880099e20 2023-10-03T10:13:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.709+0000 7fd2e6196700 1 Processor -- start 2023-10-03T10:13:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.710+0000 7fd2e6196700 1 -- start start 2023-10-03T10:13:35.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.710+0000 7fd2e6196700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2e009e870 0x7fd2e009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.710+0000 7fd2e6196700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd2e0131f40 0x7fd2e0139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.710+0000 7fd2e6196700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e009c970 con 0x7fd2e009f180 2023-10-03T10:13:35.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.710+0000 7fd2e6196700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e00a0920 con 0x7fd2e0131f40 2023-10-03T10:13:35.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.710+0000 7fd2e6196700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e009f9c0 con 0x7fd2e009e870 2023-10-03T10:13:35.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.710+0000 7fd2df7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2e009e870 0x7fd2e009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.711+0000 7fd2df7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2e009e870 0x7fd2e009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55146/0 (socket says 172.21.15.146:55146) 2023-10-03T10:13:35.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.711+0000 7fd2df7fe700 1 -- 172.21.15.146:0/246652335 learned_addr learned my addr 172.21.15.146:0/246652335 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:35.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.711+0000 7fd2dffff700 1 --2- 172.21.15.146:0/246652335 >> v2:172.21.15.146:3300/0 conn(0x7fd2e0131f40 0x7fd2e0139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.711+0000 7fd2df7fe700 1 -- 172.21.15.146:0/246652335 >> v2:172.21.15.146:3300/0 conn(0x7fd2e0131f40 msgr2=0x7fd2e0139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:35.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.711+0000 7fd2df7fe700 1 --2- 172.21.15.146:0/246652335 >> v2:172.21.15.146:3300/0 conn(0x7fd2e0131f40 0x7fd2e0139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.711+0000 7fd2de7fc700 1 -- 172.21.15.146:0/246652335 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880653990 0 0) 0x7fd2e009c970 con 0x7fd2e009f180 2023-10-03T10:13:35.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.711+0000 7fd2df7fe700 1 -- 172.21.15.146:0/246652335 >> v1:172.21.15.146:6789/0 conn(0x7fd2e009f180 legacy=0x7fd2e0131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.711+0000 7fd2df7fe700 1 -- 172.21.15.146:0/246652335 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e009bab0 con 0x7fd2e009e870 2023-10-03T10:13:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.711+0000 7fd2dffff700 1 --2- 172.21.15.146:0/246652335 >> v2:172.21.15.146:3300/0 conn(0x7fd2e0131f40 0x7fd2e0139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.711+0000 7fd2df7fe700 1 --2- 172.21.15.146:0/246652335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2e009e870 0x7fd2e009ec40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd2d00131e0 tx=0x7fd2d00134f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f36334301e8ebc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.711+0000 7fd2de7fc700 1 -- 172.21.15.146:0/246652335 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0016070 con 0x7fd2e009e870 2023-10-03T10:13:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.711+0000 7fd2de7fc700 1 -- 172.21.15.146:0/246652335 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d0013d80 con 0x7fd2e009e870 2023-10-03T10:13:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.711+0000 7fd2de7fc700 1 -- 172.21.15.146:0/246652335 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d00112f0 con 0x7fd2e009e870 2023-10-03T10:13:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.712+0000 7fd2e6196700 1 -- 172.21.15.146:0/246652335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2e009e870 msgr2=0x7fd2e009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.712+0000 7fd2e6196700 1 --2- 172.21.15.146:0/246652335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2e009e870 0x7fd2e009ec40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd2d00131e0 tx=0x7fd2d00134f0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.712+0000 7fd2e6196700 1 -- 172.21.15.146:0/246652335 shutdown_connections 2023-10-03T10:13:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.712+0000 7fd2e6196700 1 --2- 172.21.15.146:0/246652335 >> v2:172.21.15.146:3300/0 conn(0x7fd2e0131f40 0x7fd2e0139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.712+0000 7fd2e6196700 1 --2- 172.21.15.146:0/246652335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2e009e870 0x7fd2e009ec40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.712+0000 7fd2e6196700 1 -- 172.21.15.146:0/246652335 >> 172.21.15.146:0/246652335 conn(0x7fd2e00a4430 msgr2=0x7fd2e00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.712+0000 7fd2e6196700 1 -- 172.21.15.146:0/246652335 shutdown_connections 2023-10-03T10:13:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.712+0000 7fd2e6196700 1 -- 172.21.15.146:0/246652335 wait complete. 2023-10-03T10:13:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.713+0000 7fd2e6196700 1 Processor -- start 2023-10-03T10:13:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.713+0000 7fd2e6196700 1 -- start start 2023-10-03T10:13:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.714+0000 7fd2e6196700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2e009e870 0x7fd2e011be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.714+0000 7fd2e6196700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2e009f180 0x7fd2e011c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.714+0000 7fd2e6196700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2e0131f40 0x7fd2e011c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.714+0000 7fd2e6196700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e011f940 con 0x7fd2e0131f40 2023-10-03T10:13:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.714+0000 7fd2e6196700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e011ed10 con 0x7fd2e009f180 2023-10-03T10:13:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.714+0000 7fd2e6196700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e011d280 con 0x7fd2e009e870 2023-10-03T10:13:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.714+0000 7fd2df7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2e009e870 0x7fd2e011be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.714+0000 7fd2df7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2e009e870 0x7fd2e011be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56090/0 (socket says 172.21.15.146:56090) 2023-10-03T10:13:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.714+0000 7fd2df7fe700 1 -- 172.21.15.146:0/1602395886 learned_addr learned my addr 172.21.15.146:0/1602395886 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.714+0000 7fd2dffff700 1 --2- 172.21.15.146:0/1602395886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2e0131f40 0x7fd2e011c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.714+0000 7fd2deffd700 1 --2- 172.21.15.146:0/1602395886 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2e009f180 0x7fd2e011c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.714+0000 7fd2df7fe700 1 -- 172.21.15.146:0/1602395886 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2e009f180 msgr2=0x7fd2e011c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.714+0000 7fd2df7fe700 1 --2- 172.21.15.146:0/1602395886 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2e009f180 0x7fd2e011c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.714+0000 7fd2df7fe700 1 -- 172.21.15.146:0/1602395886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2e0131f40 msgr2=0x7fd2e011c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.714+0000 7fd2df7fe700 1 --2- 172.21.15.146:0/1602395886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2e0131f40 0x7fd2e011c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.714+0000 7fd2df7fe700 1 -- 172.21.15.146:0/1602395886 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d8009a70 con 0x7fd2e009e870 2023-10-03T10:13:35.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.714+0000 7fd2dffff700 1 --2- 172.21.15.146:0/1602395886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2e0131f40 0x7fd2e011c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:35.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.714+0000 7fd2df7fe700 1 --2- 172.21.15.146:0/1602395886 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2e009e870 0x7fd2e011be20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd2e009fb00 tx=0x7fd2d0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.715+0000 7fd2c7fff700 1 -- 172.21.15.146:0/1602395886 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d000fc60 con 0x7fd2e009e870 2023-10-03T10:13:35.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.715+0000 7fd2c7fff700 1 -- 172.21.15.146:0/1602395886 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d000fdc0 con 0x7fd2e009e870 2023-10-03T10:13:35.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.715+0000 7fd2e6196700 1 -- 172.21.15.146:0/1602395886 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d0011df0 con 0x7fd2e009e870 2023-10-03T10:13:35.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.715+0000 7fd2c7fff700 1 -- 172.21.15.146:0/1602395886 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d00038a0 con 0x7fd2e009e870 2023-10-03T10:13:35.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.715+0000 7fd2e6196700 1 -- 172.21.15.146:0/1602395886 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e00a2d90 con 0x7fd2e009e870 2023-10-03T10:13:35.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.716+0000 7fd2c7fff700 1 -- 172.21.15.146:0/1602395886 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd2d0003a00 con 0x7fd2e009e870 2023-10-03T10:13:35.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.716+0000 7fd2e6196700 1 -- 172.21.15.146:0/1602395886 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e011f4c0 con 0x7fd2e009e870 2023-10-03T10:13:35.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.716+0000 7fd2c7fff700 1 -- 172.21.15.146:0/1602395886 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd2d00496a0 con 0x7fd2e009e870 2023-10-03T10:13:35.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.724+0000 7fd2c7fff700 1 -- 172.21.15.146:0/1602395886 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd2e011f4c0 con 0x7fd2e009e870 2023-10-03T10:13:35.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.747+0000 7f567e7de700 1 -- 172.21.15.146:0/3993828409 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f567811fcf0 con 0x7f56781309f0 2023-10-03T10:13:35.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.747+0000 7f5674ff9700 1 -- 172.21.15.146:0/3993828409 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f566c015020 con 0x7f56781309f0 2023-10-03T10:13:35.750 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:35.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.749+0000 7f567e7de700 1 -- 172.21.15.146:0/3993828409 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f56781309f0 msgr2=0x7f567811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.749+0000 7f567e7de700 1 --2- 172.21.15.146:0/3993828409 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f56781309f0 0x7f567811df80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f566c009fd0 tx=0x7f566c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:35.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.750+0000 7f567e7de700 1 -- 172.21.15.146:0/3993828409 shutdown_connections 2023-10-03T10:13:35.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.750+0000 7f567e7de700 1 --2- 172.21.15.146:0/3993828409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5678133ad0 0x7f567811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.750+0000 7f567e7de700 1 --2- 172.21.15.146:0/3993828409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56781300a0 0x7f567811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.750+0000 7f567e7de700 1 --2- 172.21.15.146:0/3993828409 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f56781309f0 0x7f567811df80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.750+0000 7f567e7de700 1 -- 172.21.15.146:0/3993828409 >> 172.21.15.146:0/3993828409 conn(0x7f5678099c40 msgr2=0x7f5678131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.750+0000 7f567e7de700 1 -- 172.21.15.146:0/3993828409 shutdown_connections 2023-10-03T10:13:35.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.750+0000 7f567e7de700 1 -- 172.21.15.146:0/3993828409 wait complete. 2023-10-03T10:13:35.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:35.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.843+0000 7face0095700 1 -- 172.21.15.146:0/1741310597 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7facd804f2a0 con 0x7facd81346e0 2023-10-03T10:13:35.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.844+0000 7facce7fc700 1 -- 172.21.15.146:0/1741310597 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7facc8021020 con 0x7facd81346e0 2023-10-03T10:13:35.848 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:35.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.846+0000 7face0095700 1 -- 172.21.15.146:0/1741310597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facd81346e0 msgr2=0x7facd8099fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.846+0000 7face0095700 1 --2- 172.21.15.146:0/1741310597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facd81346e0 0x7facd8099fa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7facc800e930 tx=0x7facc800ec40 comp rx=0 tx=0).stop 2023-10-03T10:13:35.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.846+0000 7face0095700 1 -- 172.21.15.146:0/1741310597 shutdown_connections 2023-10-03T10:13:35.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.846+0000 7face0095700 1 --2- 172.21.15.146:0/1741310597 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facd8137000 0x7facd809a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.846+0000 7face0095700 1 --2- 172.21.15.146:0/1741310597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facd8131980 0x7facd8099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.846+0000 7face0095700 1 --2- 172.21.15.146:0/1741310597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facd81346e0 0x7facd8099fa0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.846+0000 7face0095700 1 -- 172.21.15.146:0/1741310597 >> 172.21.15.146:0/1741310597 conn(0x7facd80a2980 msgr2=0x7facd8133560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.846+0000 7face0095700 1 -- 172.21.15.146:0/1741310597 shutdown_connections 2023-10-03T10:13:35.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.846+0000 7face0095700 1 -- 172.21.15.146:0/1741310597 wait complete. 2023-10-03T10:13:35.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:35.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.879+0000 7f08667fc700 1 -- 172.21.15.146:0/2500539479 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0858005590 con 0x7f0880099e20 2023-10-03T10:13:35.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.879+0000 7f087cff9700 1 -- 172.21.15.146:0/2500539479 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0870025b60 con 0x7f0880099e20 2023-10-03T10:13:35.880 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:35.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.881+0000 7f08667fc700 1 -- 172.21.15.146:0/2500539479 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0880099e20 msgr2=0x7f088012aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.881+0000 7f08667fc700 1 --2- 172.21.15.146:0/2500539479 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0880099e20 0x7f088012aca0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0870015000 tx=0x7f0870004750 comp rx=0 tx=0).stop 2023-10-03T10:13:35.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.881+0000 7f08667fc700 1 -- 172.21.15.146:0/2500539479 shutdown_connections 2023-10-03T10:13:35.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.881+0000 7f08667fc700 1 --2- 172.21.15.146:0/2500539479 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0880130890 0x7f08801c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.881+0000 7f08667fc700 1 --2- 172.21.15.146:0/2500539479 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0880099e20 0x7f088012aca0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.881+0000 7f08667fc700 1 --2- 172.21.15.146:0/2500539479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f088009a730 0x7f088012b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.881+0000 7f08667fc700 1 -- 172.21.15.146:0/2500539479 >> 172.21.15.146:0/2500539479 conn(0x7f08800a2980 msgr2=0x7f088006df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.881+0000 7f08667fc700 1 -- 172.21.15.146:0/2500539479 shutdown_connections 2023-10-03T10:13:35.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.881+0000 7f08667fc700 1 -- 172.21.15.146:0/2500539479 wait complete. 2023-10-03T10:13:35.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:35.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.920+0000 7fd2e6196700 1 -- 172.21.15.146:0/1602395886 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd2e011f4c0 con 0x7fd2e009e870 2023-10-03T10:13:35.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.921+0000 7fd2c7fff700 1 -- 172.21.15.146:0/1602395886 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd2e011f4c0 con 0x7fd2e009e870 2023-10-03T10:13:35.922 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:35.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.923+0000 7fd2e6196700 1 -- 172.21.15.146:0/1602395886 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2e009e870 msgr2=0x7fd2e011be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.923+0000 7fd2e6196700 1 --2- 172.21.15.146:0/1602395886 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2e009e870 0x7fd2e011be20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd2e009fb00 tx=0x7fd2d0004750 comp rx=0 tx=0).stop 2023-10-03T10:13:35.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.923+0000 7fd2e6196700 1 -- 172.21.15.146:0/1602395886 shutdown_connections 2023-10-03T10:13:35.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.923+0000 7fd2e6196700 1 --2- 172.21.15.146:0/1602395886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2e0131f40 0x7fd2e011c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.923+0000 7fd2e6196700 1 --2- 172.21.15.146:0/1602395886 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2e009e870 0x7fd2e011be20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.923+0000 7fd2e6196700 1 --2- 172.21.15.146:0/1602395886 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2e009f180 0x7fd2e011c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.923+0000 7fd2e6196700 1 -- 172.21.15.146:0/1602395886 >> 172.21.15.146:0/1602395886 conn(0x7fd2e00a4430 msgr2=0x7fd2e0130e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.923+0000 7fd2e6196700 1 -- 172.21.15.146:0/1602395886 shutdown_connections 2023-10-03T10:13:35.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:35.923+0000 7fd2e6196700 1 -- 172.21.15.146:0/1602395886 wait complete. 2023-10-03T10:13:35.936 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:36.768 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:36.860 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:36.896 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:36.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.905+0000 7f12455c2700 1 Processor -- start 2023-10-03T10:13:36.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.905+0000 7f12455c2700 1 -- start start 2023-10-03T10:13:36.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.906+0000 7f12455c2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f124009e870 0x7f124009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.906+0000 7f12455c2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f124009f180 0x7f1240131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.906+0000 7f12455c2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f124009c970 con 0x7f1240131d70 2023-10-03T10:13:36.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.906+0000 7f12455c2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12400a0920 con 0x7f124009f180 2023-10-03T10:13:36.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.906+0000 7f12455c2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f124009f9c0 con 0x7f124009e870 2023-10-03T10:13:36.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.906+0000 7f123effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f124009e870 0x7f124009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.906+0000 7f123e7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f124009f180 0x7f1240131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.906+0000 7f123effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f124009e870 0x7f124009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56106/0 (socket says 172.21.15.146:56106) 2023-10-03T10:13:36.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.906+0000 7f123e7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f124009f180 0x7f1240131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40598/0 (socket says 172.21.15.146:40598) 2023-10-03T10:13:36.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.906+0000 7f123f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1240131d70 0x7f1240138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35894/0 (socket says 172.21.15.146:35894) 2023-10-03T10:13:36.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.906+0000 7f123effd700 1 -- 172.21.15.146:0/1284563672 learned_addr learned my addr 172.21.15.146:0/1284563672 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:36.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.906+0000 7f123e7fc700 1 -- 172.21.15.146:0/1284563672 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f124009e870 msgr2=0x7f124009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:36.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.906+0000 7f123e7fc700 1 --2- 172.21.15.146:0/1284563672 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f124009e870 0x7f124009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.906+0000 7f123e7fc700 1 -- 172.21.15.146:0/1284563672 >> v1:172.21.15.146:6789/0 conn(0x7f1240131d70 legacy=0x7f1240138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.906+0000 7f123dffb700 1 -- 172.21.15.146:0/1284563672 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3329535172 0 0) 0x7f124009c970 con 0x7f1240131d70 2023-10-03T10:13:36.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.907+0000 7f123e7fc700 1 -- 172.21.15.146:0/1284563672 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124009bab0 con 0x7f124009f180 2023-10-03T10:13:36.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.907+0000 7f123effd700 1 --2- 172.21.15.146:0/1284563672 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f124009e870 0x7f124009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:36.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.907+0000 7f123e7fc700 1 --2- 172.21.15.146:0/1284563672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f124009f180 0x7f1240131830 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1234009840 tx=0x7f1234009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbfdc09d50eda7c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.907+0000 7f123dffb700 1 -- 172.21.15.146:0/1284563672 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1234011830 con 0x7f124009f180 2023-10-03T10:13:36.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.907+0000 7f123dffb700 1 -- 172.21.15.146:0/1284563672 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1234011990 con 0x7f124009f180 2023-10-03T10:13:36.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.907+0000 7f123dffb700 1 -- 172.21.15.146:0/1284563672 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1234011d20 con 0x7f124009f180 2023-10-03T10:13:36.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.907+0000 7f12455c2700 1 -- 172.21.15.146:0/1284563672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f124009f180 msgr2=0x7f1240131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.907+0000 7f12455c2700 1 --2- 172.21.15.146:0/1284563672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f124009f180 0x7f1240131830 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1234009840 tx=0x7f1234009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:36.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.908+0000 7f12455c2700 1 -- 172.21.15.146:0/1284563672 shutdown_connections 2023-10-03T10:13:36.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.908+0000 7f12455c2700 1 --2- 172.21.15.146:0/1284563672 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f124009e870 0x7f124009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.908+0000 7f12455c2700 1 --2- 172.21.15.146:0/1284563672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f124009f180 0x7f1240131830 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.908+0000 7f12455c2700 1 -- 172.21.15.146:0/1284563672 >> 172.21.15.146:0/1284563672 conn(0x7f12400a4430 msgr2=0x7f12400a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.908+0000 7f12455c2700 1 -- 172.21.15.146:0/1284563672 shutdown_connections 2023-10-03T10:13:36.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.908+0000 7f12455c2700 1 -- 172.21.15.146:0/1284563672 wait complete. 2023-10-03T10:13:36.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.909+0000 7f12455c2700 1 Processor -- start 2023-10-03T10:13:36.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.909+0000 7f12455c2700 1 -- start start 2023-10-03T10:13:36.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.909+0000 7f12455c2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f124009e870 0x7f124006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.909+0000 7f12455c2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f124009f180 0x7f124006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.909+0000 7f12455c2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1240131d70 0x7f124006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.909+0000 7f12455c2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124006cd80 con 0x7f124009e870 2023-10-03T10:13:36.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.909+0000 7f12455c2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12401304c0 con 0x7f1240131d70 2023-10-03T10:13:36.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.909+0000 7f12455c2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f124006d560 con 0x7f124009f180 2023-10-03T10:13:36.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.910+0000 7f123effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f124009e870 0x7f124006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.910+0000 7f123effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f124009e870 0x7f124006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40614/0 (socket says 172.21.15.146:40614) 2023-10-03T10:13:36.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.910+0000 7f123effd700 1 -- 172.21.15.146:0/757483084 learned_addr learned my addr 172.21.15.146:0/757483084 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:36.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.910+0000 7f123f7fe700 1 --2- 172.21.15.146:0/757483084 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1240131d70 0x7f124006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.910+0000 7f123e7fc700 1 --2- 172.21.15.146:0/757483084 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f124009f180 0x7f124006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.910+0000 7f123effd700 1 -- 172.21.15.146:0/757483084 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f124009f180 msgr2=0x7f124006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.910+0000 7f123effd700 1 --2- 172.21.15.146:0/757483084 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f124009f180 0x7f124006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.910+0000 7f123effd700 1 -- 172.21.15.146:0/757483084 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1240131d70 msgr2=0x7f124006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.910+0000 7f123effd700 1 --2- 172.21.15.146:0/757483084 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1240131d70 0x7f124006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.910+0000 7f123effd700 1 -- 172.21.15.146:0/757483084 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1230009550 con 0x7f124009e870 2023-10-03T10:13:36.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.910+0000 7f123effd700 1 --2- 172.21.15.146:0/757483084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f124009e870 0x7f124006b8b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f123000e9e0 tx=0x7f123000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.910+0000 7f12277fe700 1 -- 172.21.15.146:0/757483084 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123000ee80 con 0x7f124009e870 2023-10-03T10:13:36.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.910+0000 7f12277fe700 1 -- 172.21.15.146:0/757483084 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123000c850 con 0x7f124009e870 2023-10-03T10:13:36.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.910+0000 7f12455c2700 1 -- 172.21.15.146:0/757483084 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12340094a0 con 0x7f124009e870 2023-10-03T10:13:36.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.910+0000 7f12277fe700 1 -- 172.21.15.146:0/757483084 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123000cbc0 con 0x7f124009e870 2023-10-03T10:13:36.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.910+0000 7f12455c2700 1 -- 172.21.15.146:0/757483084 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1240123900 con 0x7f124009e870 2023-10-03T10:13:36.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.911+0000 7f12277fe700 1 -- 172.21.15.146:0/757483084 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f123000cd20 con 0x7f124009e870 2023-10-03T10:13:36.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.912+0000 7f12277fe700 1 -- 172.21.15.146:0/757483084 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f123003f760 con 0x7f124009e870 2023-10-03T10:13:36.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.912+0000 7f12455c2700 1 -- 172.21.15.146:0/757483084 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1240124c30 con 0x7f124009e870 2023-10-03T10:13:36.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.917+0000 7f12277fe700 1 -- 172.21.15.146:0/757483084 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1230017020 con 0x7f124009e870 2023-10-03T10:13:36.937 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:36.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.994+0000 7f760fe34700 1 Processor -- start 2023-10-03T10:13:36.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.994+0000 7f760fe34700 1 -- start start 2023-10-03T10:13:36.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.995+0000 7f760fe34700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f760809f350 0x7f7608136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.995+0000 7f760fe34700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76081371c0 0x7f76081395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.995+0000 7f760fe34700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760809c970 con 0x7f760809e870 2023-10-03T10:13:36.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.995+0000 7f760fe34700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76080a0920 con 0x7f76081371c0 2023-10-03T10:13:36.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.995+0000 7f760fe34700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f760809f9c0 con 0x7f760809f350 2023-10-03T10:13:36.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.995+0000 7f760e3d1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76081371c0 0x7f76081395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.995+0000 7f760dbd0700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f760809e870 0x7f760809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35906/0 (socket says 172.21.15.146:35906) 2023-10-03T10:13:36.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.995+0000 7f760e3d1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76081371c0 0x7f76081395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55170/0 (socket says 172.21.15.146:55170) 2023-10-03T10:13:36.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.995+0000 7f760dbd0700 1 -- 172.21.15.146:0/1273787347 learned_addr learned my addr 172.21.15.146:0/1273787347 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:36.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.995+0000 7f760d3cf700 1 --2- 172.21.15.146:0/1273787347 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f760809f350 0x7f7608136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.995+0000 7f760cbce700 1 -- 172.21.15.146:0/1273787347 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2342374670 0 0) 0x7f760809c970 con 0x7f760809e870 2023-10-03T10:13:36.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.995+0000 7f760cbce700 1 -- 172.21.15.146:0/1273787347 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75f40035b0 con 0x7f760809e870 2023-10-03T10:13:36.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.996+0000 7f760e3d1700 1 -- 172.21.15.146:0/1273787347 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f760809f350 msgr2=0x7f7608136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:36.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.996+0000 7f760e3d1700 1 --2- 172.21.15.146:0/1273787347 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f760809f350 0x7f7608136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.996+0000 7f760e3d1700 1 -- 172.21.15.146:0/1273787347 >> v1:172.21.15.146:6789/0 conn(0x7f760809e870 legacy=0x7f760809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.996+0000 7f760e3d1700 1 -- 172.21.15.146:0/1273787347 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760809bab0 con 0x7f76081371c0 2023-10-03T10:13:36.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.996+0000 7f760d3cf700 1 --2- 172.21.15.146:0/1273787347 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f760809f350 0x7f7608136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:36.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.996+0000 7f760e3d1700 1 --2- 172.21.15.146:0/1273787347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76081371c0 0x7f76081395a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7600009dc0 tx=0x7f760000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7502cbe7412827b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.996+0000 7f760cbce700 1 -- 172.21.15.146:0/1273787347 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760000e070 con 0x7f76081371c0 2023-10-03T10:13:36.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.996+0000 7f760cbce700 1 -- 172.21.15.146:0/1273787347 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760000bae0 con 0x7f76081371c0 2023-10-03T10:13:36.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.996+0000 7f760cbce700 1 -- 172.21.15.146:0/1273787347 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760000be50 con 0x7f76081371c0 2023-10-03T10:13:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.997+0000 7f760fe34700 1 -- 172.21.15.146:0/1273787347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76081371c0 msgr2=0x7f76081395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.997+0000 7f760fe34700 1 --2- 172.21.15.146:0/1273787347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76081371c0 0x7f76081395a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7600009dc0 tx=0x7f760000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.997+0000 7f760fe34700 1 -- 172.21.15.146:0/1273787347 shutdown_connections 2023-10-03T10:13:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.997+0000 7f760fe34700 1 --2- 172.21.15.146:0/1273787347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76081371c0 0x7f76081395a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.997+0000 7f760fe34700 1 --2- 172.21.15.146:0/1273787347 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f760809f350 0x7f7608136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.997+0000 7f760fe34700 1 -- 172.21.15.146:0/1273787347 >> 172.21.15.146:0/1273787347 conn(0x7f76080a4430 msgr2=0x7f76080a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.997+0000 7f760fe34700 1 -- 172.21.15.146:0/1273787347 shutdown_connections 2023-10-03T10:13:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.997+0000 7f760fe34700 1 -- 172.21.15.146:0/1273787347 wait complete. 2023-10-03T10:13:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.998+0000 7f760fe34700 1 Processor -- start 2023-10-03T10:13:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.998+0000 7f760fe34700 1 -- start start 2023-10-03T10:13:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.998+0000 7f760fe34700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f760809e870 0x7f760806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.998+0000 7f760fe34700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f760809f350 0x7f760806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.998+0000 7f760fe34700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76081371c0 0x7f760806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.998+0000 7f760fe34700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7608136820 con 0x7f760809f350 2023-10-03T10:13:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.998+0000 7f760fe34700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76081261c0 con 0x7f76081371c0 2023-10-03T10:13:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.998+0000 7f760fe34700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7608136240 con 0x7f760809e870 2023-10-03T10:13:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.998+0000 7f760e3d1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76081371c0 0x7f760806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.998+0000 7f760e3d1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76081371c0 0x7f760806c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55182/0 (socket says 172.21.15.146:55182) 2023-10-03T10:13:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.998+0000 7f760e3d1700 1 -- 172.21.15.146:0/2061294354 learned_addr learned my addr 172.21.15.146:0/2061294354 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.998+0000 7f760dbd0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f760809e870 0x7f760806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.998+0000 7f760d3cf700 1 --2- 172.21.15.146:0/2061294354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f760809f350 0x7f760806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.999+0000 7f760e3d1700 1 -- 172.21.15.146:0/2061294354 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f760809e870 msgr2=0x7f760806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.999+0000 7f760e3d1700 1 --2- 172.21.15.146:0/2061294354 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f760809e870 0x7f760806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.999+0000 7f760e3d1700 1 -- 172.21.15.146:0/2061294354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f760809f350 msgr2=0x7f760806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.999+0000 7f760e3d1700 1 --2- 172.21.15.146:0/2061294354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f760809f350 0x7f760806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.999+0000 7f760e3d1700 1 -- 172.21.15.146:0/2061294354 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7600009a70 con 0x7f76081371c0 2023-10-03T10:13:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.999+0000 7f760e3d1700 1 --2- 172.21.15.146:0/2061294354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76081371c0 0x7f760806c330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f760000b680 tx=0x7f7600004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.999+0000 7f75fe7fc700 1 -- 172.21.15.146:0/2061294354 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7600004600 con 0x7f76081371c0 2023-10-03T10:13:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.999+0000 7f75fe7fc700 1 -- 172.21.15.146:0/2061294354 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7600004760 con 0x7f76081371c0 2023-10-03T10:13:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.999+0000 7f760fe34700 1 -- 172.21.15.146:0/2061294354 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7608126420 con 0x7f76081371c0 2023-10-03T10:13:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:36.999+0000 7f75fe7fc700 1 -- 172.21.15.146:0/2061294354 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7600012430 con 0x7f76081371c0 2023-10-03T10:13:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.000+0000 7f760fe34700 1 -- 172.21.15.146:0/2061294354 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7608072150 con 0x7f76081371c0 2023-10-03T10:13:37.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.001+0000 7f760fe34700 1 -- 172.21.15.146:0/2061294354 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760804f2a0 con 0x7f76081371c0 2023-10-03T10:13:37.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.001+0000 7f75fe7fc700 1 -- 172.21.15.146:0/2061294354 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7600012590 con 0x7f76081371c0 2023-10-03T10:13:37.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.005+0000 7f75fe7fc700 1 -- 172.21.15.146:0/2061294354 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f760001bcd0 con 0x7f76081371c0 2023-10-03T10:13:37.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.006+0000 7f75fe7fc700 1 -- 172.21.15.146:0/2061294354 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7600046060 con 0x7f76081371c0 2023-10-03T10:13:37.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.044+0000 7fe392b54700 1 Processor -- start 2023-10-03T10:13:37.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.044+0000 7fe392b54700 1 -- start start 2023-10-03T10:13:37.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.045+0000 7fe392b54700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c0a0a70 0x7fe38c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.045+0000 7fe392b54700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c134120 0x7fe38c13bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.045+0000 7fe392b54700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe38c09dc00 con 0x7fe38c0a1380 2023-10-03T10:13:37.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.045+0000 7fe392b54700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c09ea90 con 0x7fe38c0a0a70 2023-10-03T10:13:37.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.045+0000 7fe392b54700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c09dec0 con 0x7fe38c134120 2023-10-03T10:13:37.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.045+0000 7fe3908f0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c0a0a70 0x7fe38c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.045+0000 7fe38bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe38c0a1380 0x7fe38c133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35910/0 (socket says 172.21.15.146:35910) 2023-10-03T10:13:37.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.045+0000 7fe38bfff700 1 -- 172.21.15.146:0/493958212 learned_addr learned my addr 172.21.15.146:0/493958212 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:37.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.045+0000 7fe3910f1700 1 --2- 172.21.15.146:0/493958212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c134120 0x7fe38c13bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.045+0000 7fe3908f0700 1 -- 172.21.15.146:0/493958212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c134120 msgr2=0x7fe38c13bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:37.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.045+0000 7fe3908f0700 1 --2- 172.21.15.146:0/493958212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c134120 0x7fe38c13bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.045+0000 7fe3908f0700 1 -- 172.21.15.146:0/493958212 >> v1:172.21.15.146:6789/0 conn(0x7fe38c0a1380 legacy=0x7fe38c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.045+0000 7fe38b7fe700 1 -- 172.21.15.146:0/493958212 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3035678700 0 0) 0x7fe38c09dc00 con 0x7fe38c0a1380 2023-10-03T10:13:37.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.045+0000 7fe3908f0700 1 -- 172.21.15.146:0/493958212 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38c09e6a0 con 0x7fe38c0a0a70 2023-10-03T10:13:37.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.046+0000 7fe3908f0700 1 --2- 172.21.15.146:0/493958212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c0a0a70 0x7fe38c0a0e40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe380009870 tx=0x7fe380009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27f0c0d7be46b10f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.046+0000 7fe38b7fe700 1 -- 172.21.15.146:0/493958212 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe380011830 con 0x7fe38c0a0a70 2023-10-03T10:13:37.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.046+0000 7fe38b7fe700 1 -- 172.21.15.146:0/493958212 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe380011990 con 0x7fe38c0a0a70 2023-10-03T10:13:37.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.046+0000 7fe38b7fe700 1 -- 172.21.15.146:0/493958212 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe380011d20 con 0x7fe38c0a0a70 2023-10-03T10:13:37.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.046+0000 7fe392b54700 1 -- 172.21.15.146:0/493958212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c0a0a70 msgr2=0x7fe38c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.046+0000 7fe392b54700 1 --2- 172.21.15.146:0/493958212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c0a0a70 0x7fe38c0a0e40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe380009870 tx=0x7fe380009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:37.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.047+0000 7fe392b54700 1 -- 172.21.15.146:0/493958212 shutdown_connections 2023-10-03T10:13:37.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.047+0000 7fe392b54700 1 --2- 172.21.15.146:0/493958212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c134120 0x7fe38c13bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.047+0000 7fe392b54700 1 --2- 172.21.15.146:0/493958212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c0a0a70 0x7fe38c0a0e40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.047+0000 7fe392b54700 1 -- 172.21.15.146:0/493958212 >> 172.21.15.146:0/493958212 conn(0x7fe38c0a6610 msgr2=0x7fe38c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.047+0000 7fe392b54700 1 -- 172.21.15.146:0/493958212 shutdown_connections 2023-10-03T10:13:37.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.047+0000 7fe392b54700 1 -- 172.21.15.146:0/493958212 wait complete. 2023-10-03T10:13:37.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.048+0000 7fe392b54700 1 Processor -- start 2023-10-03T10:13:37.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.048+0000 7fe392b54700 1 -- start start 2023-10-03T10:13:37.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.049+0000 7fe392b54700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c0a0a70 0x7fe38c11e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.049+0000 7fe392b54700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c0a1380 0x7fe38c11eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.049+0000 7fe392b54700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe38c134120 0x7fe38c11eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.049+0000 7fe392b54700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c120770 con 0x7fe38c134120 2023-10-03T10:13:37.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.049+0000 7fe392b54700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c122050 con 0x7fe38c0a0a70 2023-10-03T10:13:37.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.049+0000 7fe392b54700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c09d340 con 0x7fe38c0a1380 2023-10-03T10:13:37.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.049+0000 7fe3910f1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe38c134120 0x7fe38c11eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.049+0000 7fe3910f1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe38c134120 0x7fe38c11eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40630/0 (socket says 172.21.15.146:40630) 2023-10-03T10:13:37.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.049+0000 7fe3910f1700 1 -- 172.21.15.146:0/3044985541 learned_addr learned my addr 172.21.15.146:0/3044985541 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:37.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.049+0000 7fe38bfff700 1 --2- 172.21.15.146:0/3044985541 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c0a1380 0x7fe38c11eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.049+0000 7fe3910f1700 1 -- 172.21.15.146:0/3044985541 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c0a1380 msgr2=0x7fe38c11eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.049+0000 7fe3910f1700 1 --2- 172.21.15.146:0/3044985541 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c0a1380 0x7fe38c11eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.049+0000 7fe3910f1700 1 -- 172.21.15.146:0/3044985541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c0a0a70 msgr2=0x7fe38c11e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.049+0000 7fe3910f1700 1 --2- 172.21.15.146:0/3044985541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c0a0a70 0x7fe38c11e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.049+0000 7fe3910f1700 1 -- 172.21.15.146:0/3044985541 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3800094a0 con 0x7fe38c134120 2023-10-03T10:13:37.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.049+0000 7fe38bfff700 1 --2- 172.21.15.146:0/3044985541 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c0a1380 0x7fe38c11eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:37.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.049+0000 7fe3910f1700 1 --2- 172.21.15.146:0/3044985541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe38c134120 0x7fe38c11eff0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe38400efc0 tx=0x7fe38400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.050+0000 7fe3897fa700 1 -- 172.21.15.146:0/3044985541 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe384009ea0 con 0x7fe38c134120 2023-10-03T10:13:37.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.050+0000 7fe3897fa700 1 -- 172.21.15.146:0/3044985541 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38400f040 con 0x7fe38c134120 2023-10-03T10:13:37.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.050+0000 7fe392b54700 1 -- 172.21.15.146:0/3044985541 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38c0a03e0 con 0x7fe38c134120 2023-10-03T10:13:37.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.050+0000 7fe3897fa700 1 -- 172.21.15.146:0/3044985541 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe384014480 con 0x7fe38c134120 2023-10-03T10:13:37.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.050+0000 7fe392b54700 1 -- 172.21.15.146:0/3044985541 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38c121ab0 con 0x7fe38c134120 2023-10-03T10:13:37.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.051+0000 7fe3897fa700 1 -- 172.21.15.146:0/3044985541 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe3840145e0 con 0x7fe38c134120 2023-10-03T10:13:37.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.051+0000 7fe3897fa700 1 -- 172.21.15.146:0/3044985541 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe3840404c0 con 0x7fe38c134120 2023-10-03T10:13:37.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.051+0000 7fe392b54700 1 -- 172.21.15.146:0/3044985541 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe38c04f2a0 con 0x7fe38c134120 2023-10-03T10:13:37.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.056+0000 7fe3897fa700 1 -- 172.21.15.146:0/3044985541 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe384018070 con 0x7fe38c134120 2023-10-03T10:13:37.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.081+0000 7f5748fb7700 1 Processor -- start 2023-10-03T10:13:37.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.081+0000 7f5748fb7700 1 -- start start 2023-10-03T10:13:37.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.082+0000 7f5748fb7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f574409ad40 0x7f5744133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.082+0000 7f5748fb7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5744133f70 0x7f57441343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.082+0000 7f5748fb7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f574409b110 con 0x7f57440a0a70 2023-10-03T10:13:37.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.082+0000 7f5748fb7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57440a3b60 con 0x7f5744133f70 2023-10-03T10:13:37.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.082+0000 7f5748fb7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57441348e0 con 0x7f574409ad40 2023-10-03T10:13:37.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.082+0000 7f5741d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5744133f70 0x7f57441343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.082+0000 7f5741d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5744133f70 0x7f57441343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55202/0 (socket says 172.21.15.146:55202) 2023-10-03T10:13:37.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.082+0000 7f574259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f574409ad40 0x7f5744133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.082+0000 7f5741d9b700 1 -- 172.21.15.146:0/2879325025 learned_addr learned my addr 172.21.15.146:0/2879325025 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:37.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.083+0000 7f574259c700 1 -- 172.21.15.146:0/2879325025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5744133f70 msgr2=0x7f57441343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:37.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.083+0000 7f574259c700 1 --2- 172.21.15.146:0/2879325025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5744133f70 0x7f57441343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.083+0000 7f574259c700 1 -- 172.21.15.146:0/2879325025 >> v1:172.21.15.146:6789/0 conn(0x7f57440a0a70 legacy=0x7f57440a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.083+0000 7f574259c700 1 -- 172.21.15.146:0/2879325025 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57440a2fa0 con 0x7f574409ad40 2023-10-03T10:13:37.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.083+0000 7f574259c700 1 --2- 172.21.15.146:0/2879325025 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f574409ad40 0x7f5744133a30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5734009870 tx=0x7f5734009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfa8271972a02ba7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.083+0000 7f574159a700 1 -- 172.21.15.146:0/2879325025 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5734011830 con 0x7f574409ad40 2023-10-03T10:13:37.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.083+0000 7f574159a700 1 -- 172.21.15.146:0/2879325025 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5734011990 con 0x7f574409ad40 2023-10-03T10:13:37.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.083+0000 7f574159a700 1 -- 172.21.15.146:0/2879325025 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5734011d20 con 0x7f574409ad40 2023-10-03T10:13:37.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.084+0000 7f5748fb7700 1 -- 172.21.15.146:0/2879325025 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f574409ad40 msgr2=0x7f5744133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.084+0000 7f5748fb7700 1 --2- 172.21.15.146:0/2879325025 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f574409ad40 0x7f5744133a30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5734009870 tx=0x7f5734009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:37.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.084+0000 7f5748fb7700 1 -- 172.21.15.146:0/2879325025 shutdown_connections 2023-10-03T10:13:37.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.084+0000 7f5748fb7700 1 --2- 172.21.15.146:0/2879325025 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f574409ad40 0x7f5744133a30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.084+0000 7f5748fb7700 1 --2- 172.21.15.146:0/2879325025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5744133f70 0x7f57441343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.084+0000 7f5748fb7700 1 -- 172.21.15.146:0/2879325025 >> 172.21.15.146:0/2879325025 conn(0x7f5744099c40 msgr2=0x7f574406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.084+0000 7f5748fb7700 1 -- 172.21.15.146:0/2879325025 shutdown_connections 2023-10-03T10:13:37.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.084+0000 7f5748fb7700 1 -- 172.21.15.146:0/2879325025 wait complete. 2023-10-03T10:13:37.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.086+0000 7f5748fb7700 1 Processor -- start 2023-10-03T10:13:37.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.086+0000 7f5748fb7700 1 -- start start 2023-10-03T10:13:37.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.086+0000 7f5748fb7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f574409ad40 0x7f5744120100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.086+0000 7f5748fb7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57440a0a70 0x7f5744120640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.087+0000 7f5748fb7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5744133f70 0x7f5744120b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.087+0000 7f5748fb7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57441245a0 con 0x7f57440a0a70 2023-10-03T10:13:37.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.087+0000 7f5748fb7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5744123900 con 0x7f5744133f70 2023-10-03T10:13:37.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.087+0000 7f5748fb7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57440a1040 con 0x7f574409ad40 2023-10-03T10:13:37.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.087+0000 7f574259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f574409ad40 0x7f5744120100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.087+0000 7f574259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f574409ad40 0x7f5744120100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56174/0 (socket says 172.21.15.146:56174) 2023-10-03T10:13:37.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.087+0000 7f574259c700 1 -- 172.21.15.146:0/1949246340 learned_addr learned my addr 172.21.15.146:0/1949246340 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:37.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.087+0000 7f5742d9d700 1 --2- 172.21.15.146:0/1949246340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5744133f70 0x7f5744120b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.087+0000 7f5741d9b700 1 --2- 172.21.15.146:0/1949246340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57440a0a70 0x7f5744120640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.087+0000 7f574259c700 1 -- 172.21.15.146:0/1949246340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5744133f70 msgr2=0x7f5744120b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.087+0000 7f574259c700 1 --2- 172.21.15.146:0/1949246340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5744133f70 0x7f5744120b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.087+0000 7f574259c700 1 -- 172.21.15.146:0/1949246340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57440a0a70 msgr2=0x7f5744120640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.087+0000 7f574259c700 1 --2- 172.21.15.146:0/1949246340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57440a0a70 0x7f5744120640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.087+0000 7f574259c700 1 -- 172.21.15.146:0/1949246340 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57340094a0 con 0x7f574409ad40 2023-10-03T10:13:37.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.087+0000 7f5741d9b700 1 --2- 172.21.15.146:0/1949246340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57440a0a70 0x7f5744120640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:37.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.087+0000 7f574259c700 1 --2- 172.21.15.146:0/1949246340 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f574409ad40 0x7f5744120100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f57340090b0 tx=0x7f5734004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.087+0000 7f5732ffd700 1 -- 172.21.15.146:0/1949246340 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57340036a0 con 0x7f574409ad40 2023-10-03T10:13:37.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.087+0000 7f5732ffd700 1 -- 172.21.15.146:0/1949246340 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573401e070 con 0x7f574409ad40 2023-10-03T10:13:37.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.087+0000 7f5732ffd700 1 -- 172.21.15.146:0/1949246340 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5734003a60 con 0x7f574409ad40 2023-10-03T10:13:37.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.088+0000 7f5748fb7700 1 -- 172.21.15.146:0/1949246340 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f574409c7e0 con 0x7f574409ad40 2023-10-03T10:13:37.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.088+0000 7f5748fb7700 1 -- 172.21.15.146:0/1949246340 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5744122f20 con 0x7f574409ad40 2023-10-03T10:13:37.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.088+0000 7f5732ffd700 1 -- 172.21.15.146:0/1949246340 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5734003bc0 con 0x7f574409ad40 2023-10-03T10:13:37.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.089+0000 7f5732ffd700 1 -- 172.21.15.146:0/1949246340 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5734020070 con 0x7f574409ad40 2023-10-03T10:13:37.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.089+0000 7f5748fb7700 1 -- 172.21.15.146:0/1949246340 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5744123d00 con 0x7f574409ad40 2023-10-03T10:13:37.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.098+0000 7f5732ffd700 1 -- 172.21.15.146:0/1949246340 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5734015070 con 0x7f574409ad40 2023-10-03T10:13:37.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.124+0000 7f12455c2700 1 -- 172.21.15.146:0/757483084 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f12400a3810 con 0x7f124009e870 2023-10-03T10:13:37.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.124+0000 7f12277fe700 1 -- 172.21.15.146:0/757483084 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f12300232f0 con 0x7f124009e870 2023-10-03T10:13:37.125 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.126+0000 7f12455c2700 1 -- 172.21.15.146:0/757483084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f124009e870 msgr2=0x7f124006b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.126+0000 7f12455c2700 1 --2- 172.21.15.146:0/757483084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f124009e870 0x7f124006b8b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f123000e9e0 tx=0x7f123000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.127+0000 7f12455c2700 1 -- 172.21.15.146:0/757483084 shutdown_connections 2023-10-03T10:13:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.127+0000 7f12455c2700 1 --2- 172.21.15.146:0/757483084 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1240131d70 0x7f124006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.127+0000 7f12455c2700 1 --2- 172.21.15.146:0/757483084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f124009e870 0x7f124006b8b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.127+0000 7f12455c2700 1 --2- 172.21.15.146:0/757483084 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f124009f180 0x7f124006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.127+0000 7f12455c2700 1 -- 172.21.15.146:0/757483084 >> 172.21.15.146:0/757483084 conn(0x7f12400a4430 msgr2=0x7f12401310a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.128+0000 7f12455c2700 1 -- 172.21.15.146:0/757483084 shutdown_connections 2023-10-03T10:13:37.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.129+0000 7f12455c2700 1 -- 172.21.15.146:0/757483084 wait complete. 2023-10-03T10:13:37.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:37.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.208+0000 7f760fe34700 1 -- 172.21.15.146:0/2061294354 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7608125f90 con 0x7f76081371c0 2023-10-03T10:13:37.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.208+0000 7f75fe7fc700 1 -- 172.21.15.146:0/2061294354 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7600046070 con 0x7f76081371c0 2023-10-03T10:13:37.209 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:37.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.210+0000 7f760fe34700 1 -- 172.21.15.146:0/2061294354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76081371c0 msgr2=0x7f760806c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.210+0000 7f760fe34700 1 --2- 172.21.15.146:0/2061294354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76081371c0 0x7f760806c330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f760000b680 tx=0x7f7600004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.210+0000 7f760fe34700 1 -- 172.21.15.146:0/2061294354 shutdown_connections 2023-10-03T10:13:37.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.210+0000 7f760fe34700 1 --2- 172.21.15.146:0/2061294354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76081371c0 0x7f760806c330 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.210+0000 7f760fe34700 1 --2- 172.21.15.146:0/2061294354 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f760809e870 0x7f760806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.210+0000 7f760fe34700 1 --2- 172.21.15.146:0/2061294354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f760809f350 0x7f760806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.210+0000 7f760fe34700 1 -- 172.21.15.146:0/2061294354 >> 172.21.15.146:0/2061294354 conn(0x7f76080a4430 msgr2=0x7f76080a2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.211+0000 7f760fe34700 1 -- 172.21.15.146:0/2061294354 shutdown_connections 2023-10-03T10:13:37.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.211+0000 7f760fe34700 1 -- 172.21.15.146:0/2061294354 wait complete. 2023-10-03T10:13:37.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:37.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.277+0000 7fe392b54700 1 -- 172.21.15.146:0/3044985541 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe38c09cba0 con 0x7fe38c134120 2023-10-03T10:13:37.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.278+0000 7fe3897fa700 1 -- 172.21.15.146:0/3044985541 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe384012700 con 0x7fe38c134120 2023-10-03T10:13:37.279 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:37.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.280+0000 7fe392b54700 1 -- 172.21.15.146:0/3044985541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe38c134120 msgr2=0x7fe38c11eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.280+0000 7fe392b54700 1 --2- 172.21.15.146:0/3044985541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe38c134120 0x7fe38c11eff0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe38400efc0 tx=0x7fe38400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.280+0000 7fe392b54700 1 -- 172.21.15.146:0/3044985541 shutdown_connections 2023-10-03T10:13:37.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.280+0000 7fe392b54700 1 --2- 172.21.15.146:0/3044985541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe38c134120 0x7fe38c11eff0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.280+0000 7fe392b54700 1 --2- 172.21.15.146:0/3044985541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c0a0a70 0x7fe38c11e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.280+0000 7fe392b54700 1 --2- 172.21.15.146:0/3044985541 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c0a1380 0x7fe38c11eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.280+0000 7fe392b54700 1 -- 172.21.15.146:0/3044985541 >> 172.21.15.146:0/3044985541 conn(0x7fe38c0a6610 msgr2=0x7fe38c09abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.280+0000 7fe392b54700 1 -- 172.21.15.146:0/3044985541 shutdown_connections 2023-10-03T10:13:37.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.280+0000 7fe392b54700 1 -- 172.21.15.146:0/3044985541 wait complete. 2023-10-03T10:13:37.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:37.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.308+0000 7f5748fb7700 1 -- 172.21.15.146:0/1949246340 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5744123470 con 0x7f574409ad40 2023-10-03T10:13:37.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.309+0000 7f5732ffd700 1 -- 172.21.15.146:0/1949246340 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f573402a030 con 0x7f574409ad40 2023-10-03T10:13:37.309 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:37.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.311+0000 7f5748fb7700 1 -- 172.21.15.146:0/1949246340 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f574409ad40 msgr2=0x7f5744120100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.311+0000 7f5748fb7700 1 --2- 172.21.15.146:0/1949246340 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f574409ad40 0x7f5744120100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f57340090b0 tx=0x7f5734004750 comp rx=0 tx=0).stop 2023-10-03T10:13:37.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.311+0000 7f5748fb7700 1 -- 172.21.15.146:0/1949246340 shutdown_connections 2023-10-03T10:13:37.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.311+0000 7f5748fb7700 1 --2- 172.21.15.146:0/1949246340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5744133f70 0x7f5744120b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.311+0000 7f5748fb7700 1 --2- 172.21.15.146:0/1949246340 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f574409ad40 0x7f5744120100 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.311+0000 7f5748fb7700 1 --2- 172.21.15.146:0/1949246340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57440a0a70 0x7f5744120640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.311+0000 7f5748fb7700 1 -- 172.21.15.146:0/1949246340 >> 172.21.15.146:0/1949246340 conn(0x7f5744099c40 msgr2=0x7f57441bb120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.311+0000 7f5748fb7700 1 -- 172.21.15.146:0/1949246340 shutdown_connections 2023-10-03T10:13:37.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:37.311+0000 7f5748fb7700 1 -- 172.21.15.146:0/1949246340 wait complete. 2023-10-03T10:13:37.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:38.144 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:38.225 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:38.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.276+0000 7f12fc026700 1 Processor -- start 2023-10-03T10:13:38.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.276+0000 7f12fc026700 1 -- start start 2023-10-03T10:13:38.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.276+0000 7f12fc026700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12f409e870 0x7f12f409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.276+0000 7f12fc026700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f12f4131f40 0x7f12f4139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.276+0000 7f12fc026700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f409c970 con 0x7f12f409f180 2023-10-03T10:13:38.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.276+0000 7f12fc026700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f40a0920 con 0x7f12f4131f40 2023-10-03T10:13:38.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.276+0000 7f12fc026700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f409f9c0 con 0x7f12f409e870 2023-10-03T10:13:38.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.276+0000 7f12fa5c3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f12f4131f40 0x7f12f4139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.276+0000 7f12f9dc2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12f409e870 0x7f12f409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.276+0000 7f12f95c1700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f12f409f180 0x7f12f4131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35934/0 (socket says 172.21.15.146:35934) 2023-10-03T10:13:38.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.276+0000 7f12fa5c3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f12f4131f40 0x7f12f4139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40642/0 (socket says 172.21.15.146:40642) 2023-10-03T10:13:38.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.276+0000 7f12f95c1700 1 -- 172.21.15.146:0/1899938517 learned_addr learned my addr 172.21.15.146:0/1899938517 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:38.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.276+0000 7f12fa5c3700 1 -- 172.21.15.146:0/1899938517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12f409e870 msgr2=0x7f12f409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:38.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.276+0000 7f12fa5c3700 1 --2- 172.21.15.146:0/1899938517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12f409e870 0x7f12f409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.276+0000 7f12fa5c3700 1 -- 172.21.15.146:0/1899938517 >> v1:172.21.15.146:6789/0 conn(0x7f12f409f180 legacy=0x7f12f4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.277+0000 7f12f8dc0700 1 -- 172.21.15.146:0/1899938517 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420783009 0 0) 0x7f12f409c970 con 0x7f12f409f180 2023-10-03T10:13:38.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.277+0000 7f12fa5c3700 1 -- 172.21.15.146:0/1899938517 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f409bab0 con 0x7f12f4131f40 2023-10-03T10:13:38.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.277+0000 7f12f9dc2700 1 --2- 172.21.15.146:0/1899938517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12f409e870 0x7f12f409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:38.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.277+0000 7f12fa5c3700 1 --2- 172.21.15.146:0/1899938517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12f4131f40 0x7f12f4139ca0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009d90 tx=0x7f12ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b9ac508cdcbb78 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.277+0000 7f12f8dc0700 1 -- 172.21.15.146:0/1899938517 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec00e070 con 0x7f12f4131f40 2023-10-03T10:13:38.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.277+0000 7f12f8dc0700 1 -- 172.21.15.146:0/1899938517 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ec00bb20 con 0x7f12f4131f40 2023-10-03T10:13:38.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.277+0000 7f12f8dc0700 1 -- 172.21.15.146:0/1899938517 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec012430 con 0x7f12f4131f40 2023-10-03T10:13:38.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.278+0000 7f12fc026700 1 -- 172.21.15.146:0/1899938517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12f4131f40 msgr2=0x7f12f4139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.278+0000 7f12fc026700 1 --2- 172.21.15.146:0/1899938517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12f4131f40 0x7f12f4139ca0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009d90 tx=0x7f12ec00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:38.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.278+0000 7f12fc026700 1 -- 172.21.15.146:0/1899938517 shutdown_connections 2023-10-03T10:13:38.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.278+0000 7f12fc026700 1 --2- 172.21.15.146:0/1899938517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12f4131f40 0x7f12f4139ca0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.278+0000 7f12fc026700 1 --2- 172.21.15.146:0/1899938517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12f409e870 0x7f12f409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.278+0000 7f12fc026700 1 -- 172.21.15.146:0/1899938517 >> 172.21.15.146:0/1899938517 conn(0x7f12f40a4430 msgr2=0x7f12f40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.278+0000 7f12fc026700 1 -- 172.21.15.146:0/1899938517 shutdown_connections 2023-10-03T10:13:38.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.278+0000 7f12fc026700 1 -- 172.21.15.146:0/1899938517 wait complete. 2023-10-03T10:13:38.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.279+0000 7f12fc026700 1 Processor -- start 2023-10-03T10:13:38.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.279+0000 7f12fc026700 1 -- start start 2023-10-03T10:13:38.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.280+0000 7f12fc026700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12f409e870 0x7f12f41c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.280+0000 7f12fc026700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12f409f180 0x7f12f41c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.280+0000 7f12fc026700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12f4131f40 0x7f12f41c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.280+0000 7f12fc026700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f4120150 con 0x7f12f409f180 2023-10-03T10:13:38.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.280+0000 7f12fc026700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f411e490 con 0x7f12f409e870 2023-10-03T10:13:38.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.280+0000 7f12fc026700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12f411fe00 con 0x7f12f4131f40 2023-10-03T10:13:38.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.280+0000 7f12f9dc2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12f409e870 0x7f12f41c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.280+0000 7f12f9dc2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12f409e870 0x7f12f41c6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55228/0 (socket says 172.21.15.146:55228) 2023-10-03T10:13:38.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.280+0000 7f12f9dc2700 1 -- 172.21.15.146:0/3494796278 learned_addr learned my addr 172.21.15.146:0/3494796278 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:38.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.280+0000 7f12fa5c3700 1 --2- 172.21.15.146:0/3494796278 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12f4131f40 0x7f12f41c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.280+0000 7f12f95c1700 1 --2- 172.21.15.146:0/3494796278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12f409f180 0x7f12f41c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.280+0000 7f12f9dc2700 1 -- 172.21.15.146:0/3494796278 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12f4131f40 msgr2=0x7f12f41c6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.280+0000 7f12f9dc2700 1 --2- 172.21.15.146:0/3494796278 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12f4131f40 0x7f12f41c6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.280+0000 7f12f9dc2700 1 -- 172.21.15.146:0/3494796278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12f409f180 msgr2=0x7f12f41c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.280+0000 7f12f9dc2700 1 --2- 172.21.15.146:0/3494796278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12f409f180 0x7f12f41c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.280+0000 7f12f9dc2700 1 -- 172.21.15.146:0/3494796278 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f00094a0 con 0x7f12f409e870 2023-10-03T10:13:38.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.280+0000 7f12f95c1700 1 --2- 172.21.15.146:0/3494796278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12f409f180 0x7f12f41c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:38.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.281+0000 7f12f9dc2700 1 --2- 172.21.15.146:0/3494796278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12f409e870 0x7f12f41c6000 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f12f000ebe0 tx=0x7f12f000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.281+0000 7f12ea7fc700 1 -- 172.21.15.146:0/3494796278 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0009760 con 0x7f12f409e870 2023-10-03T10:13:38.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.281+0000 7f12ea7fc700 1 -- 172.21.15.146:0/3494796278 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f000c850 con 0x7f12f409e870 2023-10-03T10:13:38.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.281+0000 7f12ea7fc700 1 -- 172.21.15.146:0/3494796278 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f000cbe0 con 0x7f12f409e870 2023-10-03T10:13:38.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.281+0000 7f12fc026700 1 -- 172.21.15.146:0/3494796278 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ec009a70 con 0x7f12f409e870 2023-10-03T10:13:38.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.281+0000 7f12fc026700 1 -- 172.21.15.146:0/3494796278 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f411ec80 con 0x7f12f409e870 2023-10-03T10:13:38.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.282+0000 7f12ea7fc700 1 -- 172.21.15.146:0/3494796278 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12f000cd40 con 0x7f12f409e870 2023-10-03T10:13:38.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.282+0000 7f12fc026700 1 -- 172.21.15.146:0/3494796278 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f404f2a0 con 0x7f12f409e870 2023-10-03T10:13:38.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.282+0000 7f12ea7fc700 1 -- 172.21.15.146:0/3494796278 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f12f003f7a0 con 0x7f12f409e870 2023-10-03T10:13:38.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.286+0000 7f12ea7fc700 1 -- 172.21.15.146:0/3494796278 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12f00232f0 con 0x7f12f409e870 2023-10-03T10:13:38.293 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:38.324 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:38.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.353+0000 7f027339d700 1 Processor -- start 2023-10-03T10:13:38.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.353+0000 7f027339d700 1 -- start start 2023-10-03T10:13:38.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.354+0000 7f027339d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f026c133660 0x7f026c135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.354+0000 7f027339d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f026c135f80 0x7f026c138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.354+0000 7f027339d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026c099a60 con 0x7f026c099e20 2023-10-03T10:13:38.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.354+0000 7f027339d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026c09bf50 con 0x7f026c133660 2023-10-03T10:13:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.354+0000 7f027339d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f026c09b230 con 0x7f026c135f80 2023-10-03T10:13:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.354+0000 7f0270938700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f026c133660 0x7f026c135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.354+0000 7f0271139700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f026c099e20 0x7f026c09a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35950/0 (socket says 172.21.15.146:35950) 2023-10-03T10:13:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.354+0000 7f0271139700 1 -- 172.21.15.146:0/3675462222 learned_addr learned my addr 172.21.15.146:0/3675462222 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.354+0000 7f027193a700 1 --2- 172.21.15.146:0/3675462222 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f026c135f80 0x7f026c138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.354+0000 7f0270938700 1 -- 172.21.15.146:0/3675462222 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f026c135f80 msgr2=0x7f026c138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.354+0000 7f0270938700 1 --2- 172.21.15.146:0/3675462222 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f026c135f80 0x7f026c138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.354+0000 7f0270938700 1 -- 172.21.15.146:0/3675462222 >> v1:172.21.15.146:6789/0 conn(0x7f026c099e20 legacy=0x7f026c09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.354+0000 7f0270938700 1 -- 172.21.15.146:0/3675462222 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026c09bb90 con 0x7f026c133660 2023-10-03T10:13:38.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.354+0000 7f0270938700 1 --2- 172.21.15.146:0/3675462222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f026c133660 0x7f026c135a40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f025c00bb10 tx=0x7f025c00be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d6fdb953fb46028 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.355+0000 7f0263fff700 1 -- 172.21.15.146:0/3675462222 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c00dc70 con 0x7f026c133660 2023-10-03T10:13:38.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.355+0000 7f0263fff700 1 -- 172.21.15.146:0/3675462222 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c00ddd0 con 0x7f026c133660 2023-10-03T10:13:38.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.355+0000 7f0263fff700 1 -- 172.21.15.146:0/3675462222 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c010690 con 0x7f026c133660 2023-10-03T10:13:38.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.356+0000 7f027339d700 1 -- 172.21.15.146:0/3675462222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f026c133660 msgr2=0x7f026c135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.356+0000 7f027339d700 1 --2- 172.21.15.146:0/3675462222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f026c133660 0x7f026c135a40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f025c00bb10 tx=0x7f025c00be20 comp rx=0 tx=0).stop 2023-10-03T10:13:38.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.356+0000 7f027339d700 1 -- 172.21.15.146:0/3675462222 shutdown_connections 2023-10-03T10:13:38.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.356+0000 7f027339d700 1 --2- 172.21.15.146:0/3675462222 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f026c135f80 0x7f026c138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.356+0000 7f027339d700 1 --2- 172.21.15.146:0/3675462222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f026c133660 0x7f026c135a40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.356+0000 7f027339d700 1 -- 172.21.15.146:0/3675462222 >> 172.21.15.146:0/3675462222 conn(0x7f026c0a2980 msgr2=0x7f026c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.356+0000 7f027339d700 1 -- 172.21.15.146:0/3675462222 shutdown_connections 2023-10-03T10:13:38.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.356+0000 7f027339d700 1 -- 172.21.15.146:0/3675462222 wait complete. 2023-10-03T10:13:38.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.357+0000 7f027339d700 1 Processor -- start 2023-10-03T10:13:38.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.357+0000 7f027339d700 1 -- start start 2023-10-03T10:13:38.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.357+0000 7f027339d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f026c099e20 0x7f026c1c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.357+0000 7f027339d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f026c133660 0x7f026c1c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.357+0000 7f027339d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f026c135f80 0x7f026c1c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.357+0000 7f027339d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c11ece0 con 0x7f026c099e20 2023-10-03T10:13:38.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.357+0000 7f027339d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026c11d200 con 0x7f026c133660 2023-10-03T10:13:38.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.357+0000 7f027339d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f026c11e6c0 con 0x7f026c135f80 2023-10-03T10:13:38.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.357+0000 7f0271139700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f026c099e20 0x7f026c1c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.357+0000 7f0271139700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f026c099e20 0x7f026c1c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40662/0 (socket says 172.21.15.146:40662) 2023-10-03T10:13:38.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.357+0000 7f0271139700 1 -- 172.21.15.146:0/2535631632 learned_addr learned my addr 172.21.15.146:0/2535631632 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:38.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.357+0000 7f0270938700 1 --2- 172.21.15.146:0/2535631632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f026c133660 0x7f026c1c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.357+0000 7f027193a700 1 --2- 172.21.15.146:0/2535631632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f026c135f80 0x7f026c1c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.358+0000 7f0270938700 1 -- 172.21.15.146:0/2535631632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f026c135f80 msgr2=0x7f026c1c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.358+0000 7f0270938700 1 --2- 172.21.15.146:0/2535631632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f026c135f80 0x7f026c1c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.358+0000 7f0270938700 1 -- 172.21.15.146:0/2535631632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f026c099e20 msgr2=0x7f026c1c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.358+0000 7f0270938700 1 --2- 172.21.15.146:0/2535631632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f026c099e20 0x7f026c1c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.358+0000 7f0270938700 1 -- 172.21.15.146:0/2535631632 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c00b740 con 0x7f026c133660 2023-10-03T10:13:38.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.358+0000 7f0271139700 1 --2- 172.21.15.146:0/2535631632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f026c099e20 0x7f026c1c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:38.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.358+0000 7f0270938700 1 --2- 172.21.15.146:0/2535631632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f026c133660 0x7f026c1c8a60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f025c018000 tx=0x7f025c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.358+0000 7f0261ffb700 1 -- 172.21.15.146:0/2535631632 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c004560 con 0x7f026c133660 2023-10-03T10:13:38.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.358+0000 7f027339d700 1 -- 172.21.15.146:0/2535631632 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026c1358c0 con 0x7f026c133660 2023-10-03T10:13:38.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.358+0000 7f0261ffb700 1 -- 172.21.15.146:0/2535631632 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c010470 con 0x7f026c133660 2023-10-03T10:13:38.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.358+0000 7f0261ffb700 1 -- 172.21.15.146:0/2535631632 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c010820 con 0x7f026c133660 2023-10-03T10:13:38.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.358+0000 7f027339d700 1 -- 172.21.15.146:0/2535631632 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026c11f750 con 0x7f026c133660 2023-10-03T10:13:38.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.359+0000 7f0261ffb700 1 -- 172.21.15.146:0/2535631632 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f025c019400 con 0x7f026c133660 2023-10-03T10:13:38.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.360+0000 7f0261ffb700 1 -- 172.21.15.146:0/2535631632 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f025c041010 con 0x7f026c133660 2023-10-03T10:13:38.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.360+0000 7f027339d700 1 -- 172.21.15.146:0/2535631632 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026c072480 con 0x7f026c133660 2023-10-03T10:13:38.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.365+0000 7f0261ffb700 1 -- 172.21.15.146:0/2535631632 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f026c072480 con 0x7f026c133660 2023-10-03T10:13:38.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.421+0000 7fd3f063a700 1 Processor -- start 2023-10-03T10:13:38.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.421+0000 7fd3f063a700 1 -- start start 2023-10-03T10:13:38.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.422+0000 7fd3f063a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3e8133b80 0x7fd3e8133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.422+0000 7fd3f063a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd3e80a0ff0 0x7fd3e813b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.422+0000 7fd3f063a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e809aa00 con 0x7fd3e8099a60 2023-10-03T10:13:38.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.422+0000 7fd3f063a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e809a080 con 0x7fd3e80a0ff0 2023-10-03T10:13:38.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.422+0000 7fd3f063a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8133750 con 0x7fd3e8133b80 2023-10-03T10:13:38.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.422+0000 7fd3edbd5700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd3e8099a60 0x7fd3e80a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35952/0 (socket says 172.21.15.146:35952) 2023-10-03T10:13:38.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.422+0000 7fd3ee3d6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3e8133b80 0x7fd3e8133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.422+0000 7fd3edbd5700 1 -- 172.21.15.146:0/3435470079 learned_addr learned my addr 172.21.15.146:0/3435470079 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:38.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.422+0000 7fd3eebd7700 1 --2- 172.21.15.146:0/3435470079 >> v2:172.21.15.146:3300/0 conn(0x7fd3e80a0ff0 0x7fd3e813b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.422+0000 7fd3ed3d4700 1 -- 172.21.15.146:0/3435470079 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394027323 0 0) 0x7fd3e809aa00 con 0x7fd3e8099a60 2023-10-03T10:13:38.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.422+0000 7fd3ed3d4700 1 -- 172.21.15.146:0/3435470079 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3d40035b0 con 0x7fd3e8099a60 2023-10-03T10:13:38.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.422+0000 7fd3ee3d6700 1 -- 172.21.15.146:0/3435470079 >> v2:172.21.15.146:3300/0 conn(0x7fd3e80a0ff0 msgr2=0x7fd3e813b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:38.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.422+0000 7fd3ee3d6700 1 --2- 172.21.15.146:0/3435470079 >> v2:172.21.15.146:3300/0 conn(0x7fd3e80a0ff0 0x7fd3e813b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.422+0000 7fd3ee3d6700 1 -- 172.21.15.146:0/3435470079 >> v1:172.21.15.146:6789/0 conn(0x7fd3e8099a60 legacy=0x7fd3e80a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.422+0000 7fd3ee3d6700 1 -- 172.21.15.146:0/3435470079 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e809a760 con 0x7fd3e8133b80 2023-10-03T10:13:38.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.422+0000 7fd3eebd7700 1 --2- 172.21.15.146:0/3435470079 >> v2:172.21.15.146:3300/0 conn(0x7fd3e80a0ff0 0x7fd3e813b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:38.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.422+0000 7fd3ee3d6700 1 --2- 172.21.15.146:0/3435470079 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3e8133b80 0x7fd3e8133f50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009820 tx=0x7fd3e4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d17227e1f56b94a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.423+0000 7fd3ed3d4700 1 -- 172.21.15.146:0/3435470079 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4005e30 con 0x7fd3e8133b80 2023-10-03T10:13:38.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.423+0000 7fd3ed3d4700 1 -- 172.21.15.146:0/3435470079 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e4006030 con 0x7fd3e8133b80 2023-10-03T10:13:38.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.423+0000 7fd3ed3d4700 1 -- 172.21.15.146:0/3435470079 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e40063c0 con 0x7fd3e8133b80 2023-10-03T10:13:38.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.423+0000 7fd3f063a700 1 -- 172.21.15.146:0/3435470079 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3e8133b80 msgr2=0x7fd3e8133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.423+0000 7fd3f063a700 1 --2- 172.21.15.146:0/3435470079 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3e8133b80 0x7fd3e8133f50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009820 tx=0x7fd3e4009b30 comp rx=0 tx=0).stop 2023-10-03T10:13:38.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.424+0000 7fd3f063a700 1 -- 172.21.15.146:0/3435470079 shutdown_connections 2023-10-03T10:13:38.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.424+0000 7fd3f063a700 1 --2- 172.21.15.146:0/3435470079 >> v2:172.21.15.146:3300/0 conn(0x7fd3e80a0ff0 0x7fd3e813b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.424+0000 7fd3f063a700 1 --2- 172.21.15.146:0/3435470079 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3e8133b80 0x7fd3e8133f50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.424+0000 7fd3f063a700 1 -- 172.21.15.146:0/3435470079 >> 172.21.15.146:0/3435470079 conn(0x7fd3e80a2980 msgr2=0x7fd3e80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.424+0000 7fd3f063a700 1 -- 172.21.15.146:0/3435470079 shutdown_connections 2023-10-03T10:13:38.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.424+0000 7fd3f063a700 1 -- 172.21.15.146:0/3435470079 wait complete. 2023-10-03T10:13:38.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.424+0000 7fd3f063a700 1 Processor -- start 2023-10-03T10:13:38.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.425+0000 7fd3f063a700 1 -- start start 2023-10-03T10:13:38.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.425+0000 7fd3f063a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3e8099a60 0x7fd3e811d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.425+0000 7fd3f063a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3e80a0ff0 0x7fd3e811dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.425+0000 7fd3f063a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3e8133b80 0x7fd3e811e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.425+0000 7fd3f063a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e811ee30 con 0x7fd3e80a0ff0 2023-10-03T10:13:38.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.425+0000 7fd3f063a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8121480 con 0x7fd3e8099a60 2023-10-03T10:13:38.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.425+0000 7fd3f063a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8130d50 con 0x7fd3e8133b80 2023-10-03T10:13:38.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.425+0000 7fd3ee3d6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3e8099a60 0x7fd3e811d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.425+0000 7fd3ee3d6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3e8099a60 0x7fd3e811d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55256/0 (socket says 172.21.15.146:55256) 2023-10-03T10:13:38.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.425+0000 7fd3ee3d6700 1 -- 172.21.15.146:0/3160292966 learned_addr learned my addr 172.21.15.146:0/3160292966 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:38.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.425+0000 7fd3eebd7700 1 --2- 172.21.15.146:0/3160292966 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3e8133b80 0x7fd3e811e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.425+0000 7fd3edbd5700 1 --2- 172.21.15.146:0/3160292966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3e80a0ff0 0x7fd3e811dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.425+0000 7fd3ee3d6700 1 -- 172.21.15.146:0/3160292966 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3e8133b80 msgr2=0x7fd3e811e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.425+0000 7fd3ee3d6700 1 --2- 172.21.15.146:0/3160292966 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3e8133b80 0x7fd3e811e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.426+0000 7fd3ee3d6700 1 -- 172.21.15.146:0/3160292966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3e80a0ff0 msgr2=0x7fd3e811dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.426+0000 7fd3ee3d6700 1 --2- 172.21.15.146:0/3160292966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3e80a0ff0 0x7fd3e811dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.426+0000 7fd3ee3d6700 1 -- 172.21.15.146:0/3160292966 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e0009a70 con 0x7fd3e8099a60 2023-10-03T10:13:38.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.426+0000 7fd3ee3d6700 1 --2- 172.21.15.146:0/3160292966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3e8099a60 0x7fd3e811d960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009b70 tx=0x7fd3e4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.426+0000 7fd3deffd700 1 -- 172.21.15.146:0/3160292966 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e40063a0 con 0x7fd3e8099a60 2023-10-03T10:13:38.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.426+0000 7fd3deffd700 1 -- 172.21.15.146:0/3160292966 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e4020070 con 0x7fd3e8099a60 2023-10-03T10:13:38.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.426+0000 7fd3deffd700 1 -- 172.21.15.146:0/3160292966 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4006760 con 0x7fd3e8099a60 2023-10-03T10:13:38.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.426+0000 7fd3f063a700 1 -- 172.21.15.146:0/3160292966 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e4009430 con 0x7fd3e8099a60 2023-10-03T10:13:38.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.426+0000 7fd3f063a700 1 -- 172.21.15.146:0/3160292966 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e811fb50 con 0x7fd3e8099a60 2023-10-03T10:13:38.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.427+0000 7fd3deffd700 1 -- 172.21.15.146:0/3160292966 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd3e4022030 con 0x7fd3e8099a60 2023-10-03T10:13:38.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.427+0000 7fd3f063a700 1 -- 172.21.15.146:0/3160292966 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e81207c0 con 0x7fd3e8099a60 2023-10-03T10:13:38.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.427+0000 7fd3deffd700 1 -- 172.21.15.146:0/3160292966 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd3e4040a50 con 0x7fd3e8099a60 2023-10-03T10:13:38.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.436+0000 7fd3deffd700 1 -- 172.21.15.146:0/3160292966 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3e4006b70 con 0x7fd3e8099a60 2023-10-03T10:13:38.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.484+0000 7ffb1401a700 1 Processor -- start 2023-10-03T10:13:38.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.484+0000 7ffb1401a700 1 -- start start 2023-10-03T10:13:38.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.484+0000 7ffb1401a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffb0c09e870 0x7ffb0c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.484+0000 7ffb1401a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb0c09f180 0x7ffb0c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.484+0000 7ffb1401a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0c06bec0 con 0x7ffb0c1341d0 2023-10-03T10:13:38.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.484+0000 7ffb1401a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb0c06ce60 con 0x7ffb0c09e870 2023-10-03T10:13:38.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.484+0000 7ffb1401a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c09fa00 con 0x7ffb0c09f180 2023-10-03T10:13:38.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.485+0000 7ffb11db6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffb0c09e870 0x7ffb0c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.485+0000 7ffb11db6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffb0c09e870 0x7ffb0c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40686/0 (socket says 172.21.15.146:40686) 2023-10-03T10:13:38.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.485+0000 7ffb11db6700 1 -- 172.21.15.146:0/2562593630 learned_addr learned my addr 172.21.15.146:0/2562593630 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:38.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.485+0000 7ffb11db6700 1 -- 172.21.15.146:0/2562593630 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb0c09f180 msgr2=0x7ffb0c133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:38.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.485+0000 7ffb11db6700 1 --2- 172.21.15.146:0/2562593630 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb0c09f180 0x7ffb0c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.485+0000 7ffb11db6700 1 -- 172.21.15.146:0/2562593630 >> v1:172.21.15.146:6789/0 conn(0x7ffb0c1341d0 legacy=0x7ffb0c13af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.485+0000 7ffb11db6700 1 -- 172.21.15.146:0/2562593630 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c09ad80 con 0x7ffb0c09e870 2023-10-03T10:13:38.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.485+0000 7ffb11db6700 1 --2- 172.21.15.146:0/2562593630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb0c09e870 0x7ffb0c09ec40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ffb080098f0 tx=0x7ffb08009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36561f4146e44878 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.485+0000 7ffb10db4700 1 -- 172.21.15.146:0/2562593630 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0800b8a0 con 0x7ffb0c09e870 2023-10-03T10:13:38.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.485+0000 7ffb10db4700 1 -- 172.21.15.146:0/2562593630 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0800ba00 con 0x7ffb0c09e870 2023-10-03T10:13:38.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.485+0000 7ffb10db4700 1 -- 172.21.15.146:0/2562593630 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0800bd90 con 0x7ffb0c09e870 2023-10-03T10:13:38.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.486+0000 7ffb1401a700 1 -- 172.21.15.146:0/2562593630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb0c09e870 msgr2=0x7ffb0c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.486+0000 7ffb1401a700 1 --2- 172.21.15.146:0/2562593630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb0c09e870 0x7ffb0c09ec40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ffb080098f0 tx=0x7ffb08009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:38.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.486+0000 7ffb1401a700 1 -- 172.21.15.146:0/2562593630 shutdown_connections 2023-10-03T10:13:38.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.486+0000 7ffb1401a700 1 --2- 172.21.15.146:0/2562593630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb0c09e870 0x7ffb0c09ec40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.486+0000 7ffb1401a700 1 --2- 172.21.15.146:0/2562593630 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb0c09f180 0x7ffb0c133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.486+0000 7ffb1401a700 1 -- 172.21.15.146:0/2562593630 >> 172.21.15.146:0/2562593630 conn(0x7ffb0c0a4430 msgr2=0x7ffb0c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.486+0000 7ffb1401a700 1 -- 172.21.15.146:0/2562593630 shutdown_connections 2023-10-03T10:13:38.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.486+0000 7ffb1401a700 1 -- 172.21.15.146:0/2562593630 wait complete. 2023-10-03T10:13:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.487+0000 7ffb1401a700 1 Processor -- start 2023-10-03T10:13:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.487+0000 7ffb1401a700 1 -- start start 2023-10-03T10:13:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.487+0000 7ffb1401a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb0c09e870 0x7ffb0c1c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.487+0000 7ffb1401a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb0c09f180 0x7ffb0c1c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.487+0000 7ffb1401a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb0c1341d0 0x7ffb0c11ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.487+0000 7ffb1401a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c1222b0 con 0x7ffb0c09e870 2023-10-03T10:13:38.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.487+0000 7ffb1401a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c133400 con 0x7ffb0c1341d0 2023-10-03T10:13:38.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.487+0000 7ffb1401a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c133c30 con 0x7ffb0c09f180 2023-10-03T10:13:38.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.488+0000 7ffb115b5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb0c09f180 0x7ffb0c1c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.488+0000 7ffb125b7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb0c1341d0 0x7ffb0c11ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.488+0000 7ffb115b5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb0c09f180 0x7ffb0c1c8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56230/0 (socket says 172.21.15.146:56230) 2023-10-03T10:13:38.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.488+0000 7ffb115b5700 1 -- 172.21.15.146:0/1922076355 learned_addr learned my addr 172.21.15.146:0/1922076355 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:38.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.488+0000 7ffb11db6700 1 --2- 172.21.15.146:0/1922076355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb0c09e870 0x7ffb0c1c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.488+0000 7ffb125b7700 1 -- 172.21.15.146:0/1922076355 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb0c09f180 msgr2=0x7ffb0c1c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.488+0000 7ffb125b7700 1 --2- 172.21.15.146:0/1922076355 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb0c09f180 0x7ffb0c1c8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.488+0000 7ffb125b7700 1 -- 172.21.15.146:0/1922076355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb0c09e870 msgr2=0x7ffb0c1c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.488+0000 7ffb125b7700 1 --2- 172.21.15.146:0/1922076355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb0c09e870 0x7ffb0c1c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.488+0000 7ffb125b7700 1 -- 172.21.15.146:0/1922076355 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb08009550 con 0x7ffb0c1341d0 2023-10-03T10:13:38.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.488+0000 7ffb125b7700 1 --2- 172.21.15.146:0/1922076355 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb0c1341d0 0x7ffb0c11ead0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400cbf0 tx=0x7ffb0400cf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.488+0000 7ffb027fc700 1 -- 172.21.15.146:0/1922076355 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04003c00 con 0x7ffb0c1341d0 2023-10-03T10:13:38.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.488+0000 7ffb027fc700 1 -- 172.21.15.146:0/1922076355 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb04003d60 con 0x7ffb0c1341d0 2023-10-03T10:13:38.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.488+0000 7ffb1401a700 1 -- 172.21.15.146:0/1922076355 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0c120ee0 con 0x7ffb0c1341d0 2023-10-03T10:13:38.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.488+0000 7ffb027fc700 1 -- 172.21.15.146:0/1922076355 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0400a9e0 con 0x7ffb0c1341d0 2023-10-03T10:13:38.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.488+0000 7ffb1401a700 1 -- 172.21.15.146:0/1922076355 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0c06cfa0 con 0x7ffb0c1341d0 2023-10-03T10:13:38.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.490+0000 7ffb1401a700 1 -- 172.21.15.146:0/1922076355 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0c04f2a0 con 0x7ffb0c1341d0 2023-10-03T10:13:38.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.490+0000 7ffb027fc700 1 -- 172.21.15.146:0/1922076355 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb0400ab40 con 0x7ffb0c1341d0 2023-10-03T10:13:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.490+0000 7ffb027fc700 1 -- 172.21.15.146:0/1922076355 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffb0403f580 con 0x7ffb0c1341d0 2023-10-03T10:13:38.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.499+0000 7ffb027fc700 1 -- 172.21.15.146:0/1922076355 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb04019710 con 0x7ffb0c1341d0 2023-10-03T10:13:38.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.522+0000 7f12fc026700 1 -- 172.21.15.146:0/3494796278 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f12f411f100 con 0x7f12f409e870 2023-10-03T10:13:38.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.522+0000 7f12ea7fc700 1 -- 172.21.15.146:0/3494796278 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f12f0011350 con 0x7f12f409e870 2023-10-03T10:13:38.523 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:38.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.524+0000 7f12fc026700 1 -- 172.21.15.146:0/3494796278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12f409e870 msgr2=0x7f12f41c6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.524+0000 7f12fc026700 1 --2- 172.21.15.146:0/3494796278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12f409e870 0x7f12f41c6000 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f12f000ebe0 tx=0x7f12f000eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.524+0000 7f12fc026700 1 -- 172.21.15.146:0/3494796278 shutdown_connections 2023-10-03T10:13:38.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.524+0000 7f12fc026700 1 --2- 172.21.15.146:0/3494796278 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12f4131f40 0x7f12f41c6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.524+0000 7f12fc026700 1 --2- 172.21.15.146:0/3494796278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12f409e870 0x7f12f41c6000 secure :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f12f000ebe0 tx=0x7f12f000eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.524+0000 7f12fc026700 1 --2- 172.21.15.146:0/3494796278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12f409f180 0x7f12f41c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.524+0000 7f12fc026700 1 -- 172.21.15.146:0/3494796278 >> 172.21.15.146:0/3494796278 conn(0x7f12f40a4430 msgr2=0x7f12f409c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.525+0000 7f12fc026700 1 -- 172.21.15.146:0/3494796278 shutdown_connections 2023-10-03T10:13:38.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.525+0000 7f12fc026700 1 -- 172.21.15.146:0/3494796278 wait complete. 2023-10-03T10:13:38.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:38.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.590+0000 7f027339d700 1 -- 172.21.15.146:0/2535631632 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f026c072480 con 0x7f026c133660 2023-10-03T10:13:38.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.591+0000 7f0261ffb700 1 -- 172.21.15.146:0/2535631632 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f026c072480 con 0x7f026c133660 2023-10-03T10:13:38.592 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:38.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.593+0000 7f027339d700 1 -- 172.21.15.146:0/2535631632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f026c133660 msgr2=0x7f026c1c8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.593+0000 7f027339d700 1 --2- 172.21.15.146:0/2535631632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f026c133660 0x7f026c1c8a60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f025c018000 tx=0x7f025c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:38.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.593+0000 7f027339d700 1 -- 172.21.15.146:0/2535631632 shutdown_connections 2023-10-03T10:13:38.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.593+0000 7f027339d700 1 --2- 172.21.15.146:0/2535631632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f026c135f80 0x7f026c1c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.593+0000 7f027339d700 1 --2- 172.21.15.146:0/2535631632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f026c099e20 0x7f026c1c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.593+0000 7f027339d700 1 --2- 172.21.15.146:0/2535631632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f026c133660 0x7f026c1c8a60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.593+0000 7f027339d700 1 -- 172.21.15.146:0/2535631632 >> 172.21.15.146:0/2535631632 conn(0x7f026c0a2980 msgr2=0x7f026c1324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.593+0000 7f027339d700 1 -- 172.21.15.146:0/2535631632 shutdown_connections 2023-10-03T10:13:38.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.593+0000 7f027339d700 1 -- 172.21.15.146:0/2535631632 wait complete. 2023-10-03T10:13:38.606 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:38.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.672+0000 7fd3f063a700 1 -- 172.21.15.146:0/3160292966 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd3e8121000 con 0x7fd3e8099a60 2023-10-03T10:13:38.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.673+0000 7fd3deffd700 1 -- 172.21.15.146:0/3160292966 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd3e8121000 con 0x7fd3e8099a60 2023-10-03T10:13:38.673 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:38.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.676+0000 7fd3f063a700 1 -- 172.21.15.146:0/3160292966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3e8099a60 msgr2=0x7fd3e811d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.676+0000 7fd3f063a700 1 --2- 172.21.15.146:0/3160292966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3e8099a60 0x7fd3e811d960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009b70 tx=0x7fd3e4004750 comp rx=0 tx=0).stop 2023-10-03T10:13:38.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.676+0000 7fd3f063a700 1 -- 172.21.15.146:0/3160292966 shutdown_connections 2023-10-03T10:13:38.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.676+0000 7fd3f063a700 1 --2- 172.21.15.146:0/3160292966 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3e8133b80 0x7fd3e811e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.676+0000 7fd3f063a700 1 --2- 172.21.15.146:0/3160292966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3e8099a60 0x7fd3e811d960 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.676+0000 7fd3f063a700 1 --2- 172.21.15.146:0/3160292966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3e80a0ff0 0x7fd3e811dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.676+0000 7fd3f063a700 1 -- 172.21.15.146:0/3160292966 >> 172.21.15.146:0/3160292966 conn(0x7fd3e80a2980 msgr2=0x7fd3e81bac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.676+0000 7fd3f063a700 1 -- 172.21.15.146:0/3160292966 shutdown_connections 2023-10-03T10:13:38.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.676+0000 7fd3f063a700 1 -- 172.21.15.146:0/3160292966 wait complete. 2023-10-03T10:13:38.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.721+0000 7ffb1401a700 1 -- 172.21.15.146:0/1922076355 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffb0c1224f0 con 0x7ffb0c1341d0 2023-10-03T10:13:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.721+0000 7ffb027fc700 1 -- 172.21.15.146:0/1922076355 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb0401a360 con 0x7ffb0c1341d0 2023-10-03T10:13:38.722 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.723+0000 7ffb1401a700 1 -- 172.21.15.146:0/1922076355 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb0c1341d0 msgr2=0x7ffb0c11ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.723+0000 7ffb1401a700 1 --2- 172.21.15.146:0/1922076355 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb0c1341d0 0x7ffb0c11ead0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400cbf0 tx=0x7ffb0400cf00 comp rx=0 tx=0).stop 2023-10-03T10:13:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.723+0000 7ffb1401a700 1 -- 172.21.15.146:0/1922076355 shutdown_connections 2023-10-03T10:13:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.723+0000 7ffb1401a700 1 --2- 172.21.15.146:0/1922076355 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb0c1341d0 0x7ffb0c11ead0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.723+0000 7ffb1401a700 1 --2- 172.21.15.146:0/1922076355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb0c09e870 0x7ffb0c1c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.723+0000 7ffb1401a700 1 --2- 172.21.15.146:0/1922076355 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb0c09f180 0x7ffb0c1c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.723+0000 7ffb1401a700 1 -- 172.21.15.146:0/1922076355 >> 172.21.15.146:0/1922076355 conn(0x7ffb0c0a4430 msgr2=0x7ffb0c0a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.724+0000 7ffb1401a700 1 -- 172.21.15.146:0/1922076355 shutdown_connections 2023-10-03T10:13:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:38.724+0000 7ffb1401a700 1 -- 172.21.15.146:0/1922076355 wait complete. 2023-10-03T10:13:38.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:39.539 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:39.607 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:39.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.672+0000 7f09bc861700 1 Processor -- start 2023-10-03T10:13:39.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.672+0000 7f09bc861700 1 -- start start 2023-10-03T10:13:39.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.672+0000 7f09bc861700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09b80a1550 0x7f09b8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.672+0000 7f09bc861700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09b8139200 0x7f09b813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.672+0000 7f09bc861700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b809e9d0 con 0x7f09b80a0a70 2023-10-03T10:13:39.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.672+0000 7f09bc861700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b809dc00 con 0x7f09b8139200 2023-10-03T10:13:39.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.672+0000 7f09bc861700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b809dec0 con 0x7f09b80a1550 2023-10-03T10:13:39.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.672+0000 7f09b5d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09b80a1550 0x7f09b8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.672+0000 7f09b659c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f09b80a0a70 0x7f09b80a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35978/0 (socket says 172.21.15.146:35978) 2023-10-03T10:13:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.673+0000 7f09b659c700 1 -- 172.21.15.146:0/793515931 learned_addr learned my addr 172.21.15.146:0/793515931 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.673+0000 7f09b6d9d700 1 --2- 172.21.15.146:0/793515931 >> v2:172.21.15.146:3300/0 conn(0x7f09b8139200 0x7f09b813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.673+0000 7f09b5d9b700 1 -- 172.21.15.146:0/793515931 >> v2:172.21.15.146:3300/0 conn(0x7f09b8139200 msgr2=0x7f09b813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.673+0000 7f09b5d9b700 1 --2- 172.21.15.146:0/793515931 >> v2:172.21.15.146:3300/0 conn(0x7f09b8139200 0x7f09b813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.673+0000 7f09b5d9b700 1 -- 172.21.15.146:0/793515931 >> v1:172.21.15.146:6789/0 conn(0x7f09b80a0a70 legacy=0x7f09b80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.673+0000 7f09b5d9b700 1 -- 172.21.15.146:0/793515931 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b809e6a0 con 0x7f09b80a1550 2023-10-03T10:13:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.673+0000 7f09b6d9d700 1 --2- 172.21.15.146:0/793515931 >> v2:172.21.15.146:3300/0 conn(0x7f09b8139200 0x7f09b813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.673+0000 7f09b5d9b700 1 --2- 172.21.15.146:0/793515931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09b80a1550 0x7f09b8138cc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f09ac009840 tx=0x7f09ac009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c812ba3f6ac3a5b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.673+0000 7f09b559a700 1 -- 172.21.15.146:0/793515931 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac011830 con 0x7f09b80a1550 2023-10-03T10:13:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.673+0000 7f09b559a700 1 -- 172.21.15.146:0/793515931 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ac011990 con 0x7f09b80a1550 2023-10-03T10:13:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.673+0000 7f09b559a700 1 -- 172.21.15.146:0/793515931 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac011d20 con 0x7f09b80a1550 2023-10-03T10:13:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.674+0000 7f09bc861700 1 -- 172.21.15.146:0/793515931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09b80a1550 msgr2=0x7f09b8138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.674+0000 7f09bc861700 1 --2- 172.21.15.146:0/793515931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09b80a1550 0x7f09b8138cc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f09ac009840 tx=0x7f09ac009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.674+0000 7f09bc861700 1 -- 172.21.15.146:0/793515931 shutdown_connections 2023-10-03T10:13:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.674+0000 7f09bc861700 1 --2- 172.21.15.146:0/793515931 >> v2:172.21.15.146:3300/0 conn(0x7f09b8139200 0x7f09b813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.674+0000 7f09bc861700 1 --2- 172.21.15.146:0/793515931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09b80a1550 0x7f09b8138cc0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.674+0000 7f09bc861700 1 -- 172.21.15.146:0/793515931 >> 172.21.15.146:0/793515931 conn(0x7f09b80a6610 msgr2=0x7f09b80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.674+0000 7f09bc861700 1 -- 172.21.15.146:0/793515931 shutdown_connections 2023-10-03T10:13:39.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.674+0000 7f09bc861700 1 -- 172.21.15.146:0/793515931 wait complete. 2023-10-03T10:13:39.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.675+0000 7f09bc861700 1 Processor -- start 2023-10-03T10:13:39.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.675+0000 7f09bc861700 1 -- start start 2023-10-03T10:13:39.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.675+0000 7f09bc861700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09b80a0a70 0x7f09b811e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.675+0000 7f09bc861700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09b80a1550 0x7f09b811eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.675+0000 7f09bc861700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09b8139200 0x7f09b811f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.675+0000 7f09bc861700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b81224a0 con 0x7f09b8139200 2023-10-03T10:13:39.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.675+0000 7f09bc861700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b81220a0 con 0x7f09b80a1550 2023-10-03T10:13:39.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.675+0000 7f09bc861700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09b8121af0 con 0x7f09b80a0a70 2023-10-03T10:13:39.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.676+0000 7f09b6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09b8139200 0x7f09b811f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.676+0000 7f09b5d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09b80a1550 0x7f09b811eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.676+0000 7f09b6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09b8139200 0x7f09b811f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40724/0 (socket says 172.21.15.146:40724) 2023-10-03T10:13:39.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.676+0000 7f09b6d9d700 1 -- 172.21.15.146:0/2526546354 learned_addr learned my addr 172.21.15.146:0/2526546354 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:39.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.676+0000 7f09b659c700 1 --2- 172.21.15.146:0/2526546354 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09b80a0a70 0x7f09b811e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.676+0000 7f09b5d9b700 1 -- 172.21.15.146:0/2526546354 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09b80a0a70 msgr2=0x7f09b811e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.676+0000 7f09b5d9b700 1 --2- 172.21.15.146:0/2526546354 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09b80a0a70 0x7f09b811e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.676+0000 7f09b5d9b700 1 -- 172.21.15.146:0/2526546354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09b8139200 msgr2=0x7f09b811f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.676+0000 7f09b5d9b700 1 --2- 172.21.15.146:0/2526546354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09b8139200 0x7f09b811f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.676+0000 7f09b5d9b700 1 -- 172.21.15.146:0/2526546354 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b0009a70 con 0x7f09b80a1550 2023-10-03T10:13:39.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.676+0000 7f09b6d9d700 1 --2- 172.21.15.146:0/2526546354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09b8139200 0x7f09b811f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.676+0000 7f09b5d9b700 1 --2- 172.21.15.146:0/2526546354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09b80a1550 0x7f09b811eda0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f09ac016000 tx=0x7f09ac004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.676+0000 7f09a6ffd700 1 -- 172.21.15.146:0/2526546354 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac0036a0 con 0x7f09b80a1550 2023-10-03T10:13:39.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.676+0000 7f09a6ffd700 1 -- 172.21.15.146:0/2526546354 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ac01f070 con 0x7f09b80a1550 2023-10-03T10:13:39.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.676+0000 7f09bc861700 1 -- 172.21.15.146:0/2526546354 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09ac0094a0 con 0x7f09b80a1550 2023-10-03T10:13:39.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.676+0000 7f09a6ffd700 1 -- 172.21.15.146:0/2526546354 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac003a60 con 0x7f09b80a1550 2023-10-03T10:13:39.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.676+0000 7f09bc861700 1 -- 172.21.15.146:0/2526546354 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b8120580 con 0x7f09b80a1550 2023-10-03T10:13:39.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.677+0000 7f09bc861700 1 -- 172.21.15.146:0/2526546354 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b804f2a0 con 0x7f09b80a1550 2023-10-03T10:13:39.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.678+0000 7f09a6ffd700 1 -- 172.21.15.146:0/2526546354 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09ac003bc0 con 0x7f09b80a1550 2023-10-03T10:13:39.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.678+0000 7f09a6ffd700 1 -- 172.21.15.146:0/2526546354 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f09ac021070 con 0x7f09b80a1550 2023-10-03T10:13:39.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.686+0000 7f09a6ffd700 1 -- 172.21.15.146:0/2526546354 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09ac0197c0 con 0x7f09b80a1550 2023-10-03T10:13:39.693 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:39.737 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:39.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.743+0000 7fbe977b5700 1 Processor -- start 2023-10-03T10:13:39.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.743+0000 7fbe977b5700 1 -- start start 2023-10-03T10:13:39.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.744+0000 7fbe977b5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe9009d860 0x7fbe9009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.744+0000 7fbe977b5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 0x7fbe901307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.744+0000 7fbe977b5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbe90130ce0 0x7fbe90131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.744+0000 7fbe977b5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9009aaa0 con 0x7fbe90130ce0 2023-10-03T10:13:39.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.744+0000 7fbe977b5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9009f870 con 0x7fbe9009d860 2023-10-03T10:13:39.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.744+0000 7fbe977b5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9009b360 con 0x7fbe9009e170 2023-10-03T10:13:39.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.744+0000 7fbe94d50700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 0x7fbe901307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.744+0000 7fbe95d52700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbe90130ce0 0x7fbe90131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.744+0000 7fbe94d50700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 0x7fbe901307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56240/0 (socket says 172.21.15.146:56240) 2023-10-03T10:13:39.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.744+0000 7fbe94d50700 1 -- 172.21.15.146:0/2989588232 learned_addr learned my addr 172.21.15.146:0/2989588232 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:39.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.744+0000 7fbe95551700 1 --2- 172.21.15.146:0/2989588232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe9009d860 0x7fbe9009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.744+0000 7fbe94d50700 1 -- 172.21.15.146:0/2989588232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe9009d860 msgr2=0x7fbe9009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.744+0000 7fbe94d50700 1 --2- 172.21.15.146:0/2989588232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe9009d860 0x7fbe9009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.744+0000 7fbe94d50700 1 -- 172.21.15.146:0/2989588232 >> v2:172.21.15.146:3300/0 conn(0x7fbe90130ce0 msgr2=0x7fbe90131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.744+0000 7fbe94d50700 1 --2- 172.21.15.146:0/2989588232 >> v2:172.21.15.146:3300/0 conn(0x7fbe90130ce0 0x7fbe90131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.744+0000 7fbe94d50700 1 -- 172.21.15.146:0/2989588232 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9009b620 con 0x7fbe9009e170 2023-10-03T10:13:39.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.744+0000 7fbe95d52700 1 --2- 172.21.15.146:0/2989588232 >> v2:172.21.15.146:3300/0 conn(0x7fbe90130ce0 0x7fbe90131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.744+0000 7fbe94d50700 1 --2- 172.21.15.146:0/2989588232 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 0x7fbe901307a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000bb90 tx=0x7fbe8000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff7dee854b791b4c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.745+0000 7fbe87fff700 1 -- 172.21.15.146:0/2989588232 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8000dd30 con 0x7fbe9009e170 2023-10-03T10:13:39.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.745+0000 7fbe87fff700 1 -- 172.21.15.146:0/2989588232 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8000de90 con 0x7fbe9009e170 2023-10-03T10:13:39.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.745+0000 7fbe87fff700 1 -- 172.21.15.146:0/2989588232 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe80010690 con 0x7fbe9009e170 2023-10-03T10:13:39.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.746+0000 7fbe977b5700 1 -- 172.21.15.146:0/2989588232 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 msgr2=0x7fbe901307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.746+0000 7fbe977b5700 1 --2- 172.21.15.146:0/2989588232 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 0x7fbe901307a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000bb90 tx=0x7fbe8000bea0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.746+0000 7fbe977b5700 1 -- 172.21.15.146:0/2989588232 shutdown_connections 2023-10-03T10:13:39.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.746+0000 7fbe977b5700 1 --2- 172.21.15.146:0/2989588232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe9009d860 0x7fbe9009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.746+0000 7fbe977b5700 1 --2- 172.21.15.146:0/2989588232 >> v2:172.21.15.146:3300/0 conn(0x7fbe90130ce0 0x7fbe90131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.746+0000 7fbe977b5700 1 --2- 172.21.15.146:0/2989588232 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 0x7fbe901307a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.746+0000 7fbe977b5700 1 -- 172.21.15.146:0/2989588232 >> 172.21.15.146:0/2989588232 conn(0x7fbe90099c40 msgr2=0x7fbe900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.746+0000 7fbe977b5700 1 -- 172.21.15.146:0/2989588232 shutdown_connections 2023-10-03T10:13:39.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.746+0000 7fbe977b5700 1 -- 172.21.15.146:0/2989588232 wait complete. 2023-10-03T10:13:39.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.747+0000 7fbe977b5700 1 Processor -- start 2023-10-03T10:13:39.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.747+0000 7fbe977b5700 1 -- start start 2023-10-03T10:13:39.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.747+0000 7fbe977b5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe9009d860 0x7fbe90120410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.747+0000 7fbe977b5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 0x7fbe90120950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.747+0000 7fbe977b5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe90130ce0 0x7fbe90120e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.747+0000 7fbe977b5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe90121870 con 0x7fbe9009d860 2023-10-03T10:13:39.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.747+0000 7fbe977b5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe90123c30 con 0x7fbe90130ce0 2023-10-03T10:13:39.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.747+0000 7fbe977b5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9009c8b0 con 0x7fbe9009e170 2023-10-03T10:13:39.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.748+0000 7fbe95551700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe9009d860 0x7fbe90120410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.748+0000 7fbe95551700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe9009d860 0x7fbe90120410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40740/0 (socket says 172.21.15.146:40740) 2023-10-03T10:13:39.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.748+0000 7fbe95551700 1 -- 172.21.15.146:0/485325223 learned_addr learned my addr 172.21.15.146:0/485325223 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:39.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.748+0000 7fbe95d52700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe90130ce0 0x7fbe90120e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.748+0000 7fbe94d50700 1 --2- 172.21.15.146:0/485325223 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 0x7fbe90120950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.748+0000 7fbe95551700 1 -- 172.21.15.146:0/485325223 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 msgr2=0x7fbe90120950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.748+0000 7fbe95551700 1 --2- 172.21.15.146:0/485325223 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 0x7fbe90120950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.748+0000 7fbe95551700 1 -- 172.21.15.146:0/485325223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe90130ce0 msgr2=0x7fbe90120e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.748+0000 7fbe95551700 1 --2- 172.21.15.146:0/485325223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe90130ce0 0x7fbe90120e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.748+0000 7fbe95551700 1 -- 172.21.15.146:0/485325223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe88009a70 con 0x7fbe9009d860 2023-10-03T10:13:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.748+0000 7fbe95551700 1 --2- 172.21.15.146:0/485325223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe9009d860 0x7fbe90120410 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00e930 tx=0x7fbe8c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.748+0000 7fbe85ffb700 1 -- 172.21.15.146:0/485325223 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c017a50 con 0x7fbe9009d860 2023-10-03T10:13:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.748+0000 7fbe85ffb700 1 -- 172.21.15.146:0/485325223 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8c017bb0 con 0x7fbe9009d860 2023-10-03T10:13:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.748+0000 7fbe977b5700 1 -- 172.21.15.146:0/485325223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe8000b7f0 con 0x7fbe9009d860 2023-10-03T10:13:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.748+0000 7fbe85ffb700 1 -- 172.21.15.146:0/485325223 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c00c640 con 0x7fbe9009d860 2023-10-03T10:13:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.749+0000 7fbe977b5700 1 -- 172.21.15.146:0/485325223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe901227f0 con 0x7fbe9009d860 2023-10-03T10:13:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.750+0000 7fbe85ffb700 1 -- 172.21.15.146:0/485325223 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe8c00c7a0 con 0x7fbe9009d860 2023-10-03T10:13:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.750+0000 7fbe85ffb700 1 -- 172.21.15.146:0/485325223 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbe8c047950 con 0x7fbe9009d860 2023-10-03T10:13:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.750+0000 7fbe977b5700 1 -- 172.21.15.146:0/485325223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe9004f2a0 con 0x7fbe9009d860 2023-10-03T10:13:39.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.755+0000 7fbe85ffb700 1 -- 172.21.15.146:0/485325223 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe8c024020 con 0x7fbe9009d860 2023-10-03T10:13:39.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.832+0000 7fec09ca5700 1 Processor -- start 2023-10-03T10:13:39.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.832+0000 7fec09ca5700 1 -- start start 2023-10-03T10:13:39.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.833+0000 7fec09ca5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec0409a130 0x7fec0409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.833+0000 7fec09ca5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fec0409f1e0 0x7fec0413fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.833+0000 7fec09ca5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec04072b30 con 0x7fec0409edb0 2023-10-03T10:13:39.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.833+0000 7fec09ca5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0409a500 con 0x7fec0409f1e0 2023-10-03T10:13:39.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.833+0000 7fec09ca5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec0409ada0 con 0x7fec0409a130 2023-10-03T10:13:39.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.833+0000 7fec03fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fec0409f1e0 0x7fec0413fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.833+0000 7fec037fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec0409a130 0x7fec0409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.833+0000 7fec02ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fec0409edb0 0x7fec0413c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35990/0 (socket says 172.21.15.146:35990) 2023-10-03T10:13:39.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.833+0000 7fec02ffd700 1 -- 172.21.15.146:0/990164519 learned_addr learned my addr 172.21.15.146:0/990164519 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:39.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.834+0000 7fec037fe700 1 -- 172.21.15.146:0/990164519 >> v2:172.21.15.146:3300/0 conn(0x7fec0409f1e0 msgr2=0x7fec0413fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.834+0000 7fec037fe700 1 --2- 172.21.15.146:0/990164519 >> v2:172.21.15.146:3300/0 conn(0x7fec0409f1e0 0x7fec0413fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.834+0000 7fec037fe700 1 -- 172.21.15.146:0/990164519 >> v1:172.21.15.146:6789/0 conn(0x7fec0409edb0 legacy=0x7fec0413c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.834+0000 7fec037fe700 1 -- 172.21.15.146:0/990164519 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0409fe00 con 0x7fec0409a130 2023-10-03T10:13:39.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.834+0000 7fec027fc700 1 -- 172.21.15.146:0/990164519 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166296321 0 0) 0x7fec04072b30 con 0x7fec0409edb0 2023-10-03T10:13:39.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.834+0000 7fec037fe700 1 --2- 172.21.15.146:0/990164519 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec0409a130 0x7fec0409e870 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7febf4009840 tx=0x7febf4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=633e306802c0e41b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.834+0000 7fec027fc700 1 -- 172.21.15.146:0/990164519 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf4011830 con 0x7fec0409a130 2023-10-03T10:13:39.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.834+0000 7fec027fc700 1 -- 172.21.15.146:0/990164519 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf4011990 con 0x7fec0409a130 2023-10-03T10:13:39.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.834+0000 7fec027fc700 1 -- 172.21.15.146:0/990164519 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf4011d20 con 0x7fec0409a130 2023-10-03T10:13:39.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.835+0000 7fec09ca5700 1 -- 172.21.15.146:0/990164519 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec0409a130 msgr2=0x7fec0409e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.835+0000 7fec09ca5700 1 --2- 172.21.15.146:0/990164519 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec0409a130 0x7fec0409e870 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7febf4009840 tx=0x7febf4009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:39.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.835+0000 7fec09ca5700 1 -- 172.21.15.146:0/990164519 shutdown_connections 2023-10-03T10:13:39.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.835+0000 7fec09ca5700 1 --2- 172.21.15.146:0/990164519 >> v2:172.21.15.146:3300/0 conn(0x7fec0409f1e0 0x7fec0413fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.835+0000 7fec09ca5700 1 --2- 172.21.15.146:0/990164519 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec0409a130 0x7fec0409e870 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.835+0000 7fec09ca5700 1 -- 172.21.15.146:0/990164519 >> 172.21.15.146:0/990164519 conn(0x7fec040a4430 msgr2=0x7fec040a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.835+0000 7fec09ca5700 1 -- 172.21.15.146:0/990164519 shutdown_connections 2023-10-03T10:13:39.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.835+0000 7fec09ca5700 1 -- 172.21.15.146:0/990164519 wait complete. 2023-10-03T10:13:39.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.836+0000 7fec09ca5700 1 Processor -- start 2023-10-03T10:13:39.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.836+0000 7fec09ca5700 1 -- start start 2023-10-03T10:13:39.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.836+0000 7fec09ca5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec0409a130 0x7fec041382f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.836+0000 7fec09ca5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec0409edb0 0x7fec04138830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.836+0000 7fec09ca5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec0409f1e0 0x7fec04138d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.836+0000 7fec09ca5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0413c790 con 0x7fec0409a130 2023-10-03T10:13:39.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.836+0000 7fec09ca5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0413a630 con 0x7fec0409edb0 2023-10-03T10:13:39.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.836+0000 7fec09ca5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec0413b570 con 0x7fec0409f1e0 2023-10-03T10:13:39.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.837+0000 7fec03fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec0409f1e0 0x7fec04138d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.837+0000 7fec03fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec0409f1e0 0x7fec04138d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56266/0 (socket says 172.21.15.146:56266) 2023-10-03T10:13:39.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.837+0000 7fec03fff700 1 -- 172.21.15.146:0/1298448505 learned_addr learned my addr 172.21.15.146:0/1298448505 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:39.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.837+0000 7fec02ffd700 1 --2- 172.21.15.146:0/1298448505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec0409edb0 0x7fec04138830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.837+0000 7fec037fe700 1 --2- 172.21.15.146:0/1298448505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec0409a130 0x7fec041382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.837+0000 7fec02ffd700 1 -- 172.21.15.146:0/1298448505 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec0409f1e0 msgr2=0x7fec04138d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.837+0000 7fec02ffd700 1 --2- 172.21.15.146:0/1298448505 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec0409f1e0 0x7fec04138d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.837+0000 7fec02ffd700 1 -- 172.21.15.146:0/1298448505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec0409a130 msgr2=0x7fec041382f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.837+0000 7fec02ffd700 1 --2- 172.21.15.146:0/1298448505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec0409a130 0x7fec041382f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.837+0000 7fec02ffd700 1 -- 172.21.15.146:0/1298448505 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf40094a0 con 0x7fec0409edb0 2023-10-03T10:13:39.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.837+0000 7fec02ffd700 1 --2- 172.21.15.146:0/1298448505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec0409edb0 0x7fec04138830 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7febf800c470 tx=0x7febf800c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.837+0000 7febebfff700 1 -- 172.21.15.146:0/1298448505 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf8004c80 con 0x7fec0409edb0 2023-10-03T10:13:39.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.837+0000 7febebfff700 1 -- 172.21.15.146:0/1298448505 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf8004de0 con 0x7fec0409edb0 2023-10-03T10:13:39.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.837+0000 7fec09ca5700 1 -- 172.21.15.146:0/1298448505 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0413b2e0 con 0x7fec0409edb0 2023-10-03T10:13:39.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.837+0000 7febebfff700 1 -- 172.21.15.146:0/1298448505 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf8007310 con 0x7fec0409edb0 2023-10-03T10:13:39.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.837+0000 7fec09ca5700 1 -- 172.21.15.146:0/1298448505 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0413c2a0 con 0x7fec0409edb0 2023-10-03T10:13:39.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.838+0000 7febebfff700 1 -- 172.21.15.146:0/1298448505 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7febf8007470 con 0x7fec0409edb0 2023-10-03T10:13:39.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.839+0000 7febebfff700 1 -- 172.21.15.146:0/1298448505 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7febf803f130 con 0x7fec0409edb0 2023-10-03T10:13:39.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.839+0000 7fec09ca5700 1 -- 172.21.15.146:0/1298448505 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0413b280 con 0x7fec0409edb0 2023-10-03T10:13:39.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.848+0000 7febebfff700 1 -- 172.21.15.146:0/1298448505 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7febf8007720 con 0x7fec0409edb0 2023-10-03T10:13:39.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.868+0000 7f31d1dc6700 1 Processor -- start 2023-10-03T10:13:39.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.869+0000 7f31d1dc6700 1 -- start start 2023-10-03T10:13:39.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.869+0000 7f31d1dc6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31cc09e340 0x7f31cc1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.869+0000 7f31d1dc6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f31cc135f20 0x7f31cc138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.869+0000 7f31d1dc6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31cc09aaa0 con 0x7f31cc09d860 2023-10-03T10:13:39.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.869+0000 7f31d1dc6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31cc09e730 con 0x7f31cc135f20 2023-10-03T10:13:39.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.869+0000 7f31d1dc6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc09f870 con 0x7f31cc09e340 2023-10-03T10:13:39.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.869+0000 7f31cbfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f31cc135f20 0x7f31cc138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.869+0000 7f31cb7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f31cc09d860 0x7f31cc09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36002/0 (socket says 172.21.15.146:36002) 2023-10-03T10:13:39.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.870+0000 7f31cbfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f31cc135f20 0x7f31cc138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40770/0 (socket says 172.21.15.146:40770) 2023-10-03T10:13:39.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.870+0000 7f31cb7fe700 1 -- 172.21.15.146:0/3282229565 learned_addr learned my addr 172.21.15.146:0/3282229565 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:39.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.870+0000 7f31caffd700 1 --2- 172.21.15.146:0/3282229565 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31cc09e340 0x7f31cc1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.870+0000 7f31caffd700 1 -- 172.21.15.146:0/3282229565 >> v2:172.21.15.146:3300/0 conn(0x7f31cc135f20 msgr2=0x7f31cc138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.870+0000 7f31caffd700 1 --2- 172.21.15.146:0/3282229565 >> v2:172.21.15.146:3300/0 conn(0x7f31cc135f20 0x7f31cc138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.870+0000 7f31caffd700 1 -- 172.21.15.146:0/3282229565 >> v1:172.21.15.146:6789/0 conn(0x7f31cc09d860 legacy=0x7f31cc09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.870+0000 7f31caffd700 1 -- 172.21.15.146:0/3282229565 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc09b360 con 0x7f31cc09e340 2023-10-03T10:13:39.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.870+0000 7f31cbfff700 1 --2- 172.21.15.146:0/3282229565 >> v2:172.21.15.146:3300/0 conn(0x7f31cc135f20 0x7f31cc138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.870+0000 7f31caffd700 1 --2- 172.21.15.146:0/3282229565 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31cc09e340 0x7f31cc1359e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009840 tx=0x7f31c0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c4ba8524502f927 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.871+0000 7f31ca7fc700 1 -- 172.21.15.146:0/3282229565 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0011830 con 0x7f31cc09e340 2023-10-03T10:13:39.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.871+0000 7f31ca7fc700 1 -- 172.21.15.146:0/3282229565 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c0011990 con 0x7f31cc09e340 2023-10-03T10:13:39.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.871+0000 7f31ca7fc700 1 -- 172.21.15.146:0/3282229565 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0011d20 con 0x7f31cc09e340 2023-10-03T10:13:39.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.871+0000 7f31d1dc6700 1 -- 172.21.15.146:0/3282229565 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31cc09e340 msgr2=0x7f31cc1359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.871+0000 7f31d1dc6700 1 --2- 172.21.15.146:0/3282229565 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31cc09e340 0x7f31cc1359e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009840 tx=0x7f31c0009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:39.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.871+0000 7f31d1dc6700 1 -- 172.21.15.146:0/3282229565 shutdown_connections 2023-10-03T10:13:39.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.871+0000 7f31d1dc6700 1 --2- 172.21.15.146:0/3282229565 >> v2:172.21.15.146:3300/0 conn(0x7f31cc135f20 0x7f31cc138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.871+0000 7f31d1dc6700 1 --2- 172.21.15.146:0/3282229565 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31cc09e340 0x7f31cc1359e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.871+0000 7f31d1dc6700 1 -- 172.21.15.146:0/3282229565 >> 172.21.15.146:0/3282229565 conn(0x7f31cc099c40 msgr2=0x7f31cc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.871+0000 7f31d1dc6700 1 -- 172.21.15.146:0/3282229565 shutdown_connections 2023-10-03T10:13:39.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.871+0000 7f31d1dc6700 1 -- 172.21.15.146:0/3282229565 wait complete. 2023-10-03T10:13:39.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.872+0000 7f31d1dc6700 1 Processor -- start 2023-10-03T10:13:39.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.872+0000 7f31d1dc6700 1 -- start start 2023-10-03T10:13:39.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.873+0000 7f31d1dc6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31cc09d860 0x7f31cc119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.873+0000 7f31d1dc6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31cc09e340 0x7f31cc119b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.873+0000 7f31d1dc6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31cc135f20 0x7f31cc11a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.873+0000 7f31d1dc6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc11b670 con 0x7f31cc135f20 2023-10-03T10:13:39.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.873+0000 7f31d1dc6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc0a2100 con 0x7f31cc09e340 2023-10-03T10:13:39.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.873+0000 7f31d1dc6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc11cf30 con 0x7f31cc09d860 2023-10-03T10:13:39.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.873+0000 7f31cb7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31cc09d860 0x7f31cc119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.873+0000 7f31cb7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31cc09d860 0x7f31cc119630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56272/0 (socket says 172.21.15.146:56272) 2023-10-03T10:13:39.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.873+0000 7f31cb7fe700 1 -- 172.21.15.146:0/1386864108 learned_addr learned my addr 172.21.15.146:0/1386864108 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:39.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.873+0000 7f31cbfff700 1 --2- 172.21.15.146:0/1386864108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31cc135f20 0x7f31cc11a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.873+0000 7f31caffd700 1 --2- 172.21.15.146:0/1386864108 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31cc09e340 0x7f31cc119b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.873+0000 7f31cb7fe700 1 -- 172.21.15.146:0/1386864108 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31cc09e340 msgr2=0x7f31cc119b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.873+0000 7f31cb7fe700 1 --2- 172.21.15.146:0/1386864108 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31cc09e340 0x7f31cc119b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.873+0000 7f31cb7fe700 1 -- 172.21.15.146:0/1386864108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31cc135f20 msgr2=0x7f31cc11a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.873+0000 7f31cb7fe700 1 --2- 172.21.15.146:0/1386864108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31cc135f20 0x7f31cc11a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.873+0000 7f31cb7fe700 1 -- 172.21.15.146:0/1386864108 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c400bc80 con 0x7f31cc09d860 2023-10-03T10:13:39.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.874+0000 7f31cb7fe700 1 --2- 172.21.15.146:0/1386864108 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31cc09d860 0x7f31cc119630 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00c520 tx=0x7f31bc00c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.874+0000 7f31b3fff700 1 -- 172.21.15.146:0/1386864108 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc005d70 con 0x7f31cc09d860 2023-10-03T10:13:39.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.874+0000 7f31b3fff700 1 -- 172.21.15.146:0/1386864108 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc0070d0 con 0x7f31cc09d860 2023-10-03T10:13:39.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.874+0000 7f31b3fff700 1 -- 172.21.15.146:0/1386864108 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc007440 con 0x7f31cc09d860 2023-10-03T10:13:39.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.874+0000 7f31d1dc6700 1 -- 172.21.15.146:0/1386864108 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c00094a0 con 0x7f31cc09d860 2023-10-03T10:13:39.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.874+0000 7f31d1dc6700 1 -- 172.21.15.146:0/1386864108 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31cc11c6c0 con 0x7f31cc09d860 2023-10-03T10:13:39.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.875+0000 7f31d1dc6700 1 -- 172.21.15.146:0/1386864108 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31cc04f2a0 con 0x7f31cc09d860 2023-10-03T10:13:39.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.875+0000 7f31b3fff700 1 -- 172.21.15.146:0/1386864108 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f31bc0075a0 con 0x7f31cc09d860 2023-10-03T10:13:39.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.876+0000 7f31b3fff700 1 -- 172.21.15.146:0/1386864108 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f31bc040bc0 con 0x7f31cc09d860 2023-10-03T10:13:39.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.880+0000 7f31b3fff700 1 -- 172.21.15.146:0/1386864108 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f31bc044060 con 0x7f31cc09d860 2023-10-03T10:13:39.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.956+0000 7f09bc861700 1 -- 172.21.15.146:0/2526546354 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f09b8120c60 con 0x7f09b80a1550 2023-10-03T10:13:39.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.957+0000 7f09a6ffd700 1 -- 172.21.15.146:0/2526546354 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f09ac010380 con 0x7f09b80a1550 2023-10-03T10:13:39.957 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.958+0000 7fbe977b5700 1 -- 172.21.15.146:0/485325223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbe90124760 con 0x7fbe9009d860 2023-10-03T10:13:39.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.958+0000 7fbe85ffb700 1 -- 172.21.15.146:0/485325223 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbe8c01f440 con 0x7fbe9009d860 2023-10-03T10:13:39.958 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:39.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.960+0000 7f09bc861700 1 -- 172.21.15.146:0/2526546354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09b80a1550 msgr2=0x7f09b811eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.960+0000 7f09bc861700 1 --2- 172.21.15.146:0/2526546354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09b80a1550 0x7f09b811eda0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f09ac016000 tx=0x7f09ac004750 comp rx=0 tx=0).stop 2023-10-03T10:13:39.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.960+0000 7f09bc861700 1 -- 172.21.15.146:0/2526546354 shutdown_connections 2023-10-03T10:13:39.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.960+0000 7f09bc861700 1 --2- 172.21.15.146:0/2526546354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09b8139200 0x7f09b811f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.960+0000 7f09bc861700 1 --2- 172.21.15.146:0/2526546354 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09b80a0a70 0x7f09b811e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.960+0000 7f09bc861700 1 --2- 172.21.15.146:0/2526546354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09b80a1550 0x7f09b811eda0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.960+0000 7f09bc861700 1 -- 172.21.15.146:0/2526546354 >> 172.21.15.146:0/2526546354 conn(0x7f09b80a6610 msgr2=0x7f09b81381b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.960+0000 7f09bc861700 1 -- 172.21.15.146:0/2526546354 shutdown_connections 2023-10-03T10:13:39.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.960+0000 7f09bc861700 1 -- 172.21.15.146:0/2526546354 wait complete. 2023-10-03T10:13:39.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.961+0000 7fbe977b5700 1 -- 172.21.15.146:0/485325223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe9009d860 msgr2=0x7fbe90120410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.961+0000 7fbe977b5700 1 --2- 172.21.15.146:0/485325223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe9009d860 0x7fbe90120410 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00e930 tx=0x7fbe8c00ec40 comp rx=0 tx=0).stop 2023-10-03T10:13:39.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.962+0000 7fbe977b5700 1 -- 172.21.15.146:0/485325223 shutdown_connections 2023-10-03T10:13:39.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.962+0000 7fbe977b5700 1 --2- 172.21.15.146:0/485325223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe90130ce0 0x7fbe90120e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.962+0000 7fbe977b5700 1 --2- 172.21.15.146:0/485325223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe9009d860 0x7fbe90120410 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.962+0000 7fbe977b5700 1 --2- 172.21.15.146:0/485325223 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 0x7fbe90120950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.962+0000 7fbe977b5700 1 -- 172.21.15.146:0/485325223 >> 172.21.15.146:0/485325223 conn(0x7fbe90099c40 msgr2=0x7fbe900a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.962+0000 7fbe977b5700 1 -- 172.21.15.146:0/485325223 shutdown_connections 2023-10-03T10:13:39.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:39.962+0000 7fbe977b5700 1 -- 172.21.15.146:0/485325223 wait complete. 2023-10-03T10:13:39.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:39.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:40.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:40.074+0000 7f31d1dc6700 1 -- 172.21.15.146:0/1386864108 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f31cc11b810 con 0x7f31cc09d860 2023-10-03T10:13:40.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:40.074+0000 7f31b3fff700 1 -- 172.21.15.146:0/1386864108 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f31bc044070 con 0x7f31cc09d860 2023-10-03T10:13:40.074 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:40.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:40.076+0000 7f31d1dc6700 1 -- 172.21.15.146:0/1386864108 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31cc09d860 msgr2=0x7f31cc119630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:40.076+0000 7f31d1dc6700 1 --2- 172.21.15.146:0/1386864108 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31cc09d860 0x7f31cc119630 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00c520 tx=0x7f31bc00c8e0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:40.076+0000 7f31d1dc6700 1 -- 172.21.15.146:0/1386864108 shutdown_connections 2023-10-03T10:13:40.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:40.076+0000 7f31d1dc6700 1 --2- 172.21.15.146:0/1386864108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31cc135f20 0x7f31cc11a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:40.076+0000 7f31d1dc6700 1 --2- 172.21.15.146:0/1386864108 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31cc09d860 0x7f31cc119630 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:40.076+0000 7f31d1dc6700 1 --2- 172.21.15.146:0/1386864108 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31cc09e340 0x7f31cc119b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:40.076+0000 7f31d1dc6700 1 -- 172.21.15.146:0/1386864108 >> 172.21.15.146:0/1386864108 conn(0x7f31cc099c40 msgr2=0x7f31cc1329c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:40.077+0000 7f31d1dc6700 1 -- 172.21.15.146:0/1386864108 shutdown_connections 2023-10-03T10:13:40.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:40.077+0000 7f31d1dc6700 1 -- 172.21.15.146:0/1386864108 wait complete. 2023-10-03T10:13:40.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:40.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:40.105+0000 7fec09ca5700 1 -- 172.21.15.146:0/1298448505 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fec040a1420 con 0x7fec0409edb0 2023-10-03T10:13:40.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:40.105+0000 7febebfff700 1 -- 172.21.15.146:0/1298448505 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fec040a1420 con 0x7fec0409edb0 2023-10-03T10:13:40.105 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:40.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:40.107+0000 7fec09ca5700 1 -- 172.21.15.146:0/1298448505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec0409edb0 msgr2=0x7fec04138830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:40.107+0000 7fec09ca5700 1 --2- 172.21.15.146:0/1298448505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec0409edb0 0x7fec04138830 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7febf800c470 tx=0x7febf800c780 comp rx=0 tx=0).stop 2023-10-03T10:13:40.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:40.107+0000 7fec09ca5700 1 -- 172.21.15.146:0/1298448505 shutdown_connections 2023-10-03T10:13:40.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:40.107+0000 7fec09ca5700 1 --2- 172.21.15.146:0/1298448505 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fec0409f1e0 0x7fec04138d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:40.107+0000 7fec09ca5700 1 --2- 172.21.15.146:0/1298448505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec0409a130 0x7fec041382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:40.107+0000 7fec09ca5700 1 --2- 172.21.15.146:0/1298448505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec0409edb0 0x7fec04138830 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:40.107+0000 7fec09ca5700 1 -- 172.21.15.146:0/1298448505 >> 172.21.15.146:0/1298448505 conn(0x7fec040a4430 msgr2=0x7fec04071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:40.107+0000 7fec09ca5700 1 -- 172.21.15.146:0/1298448505 shutdown_connections 2023-10-03T10:13:40.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:40.107+0000 7fec09ca5700 1 -- 172.21.15.146:0/1298448505 wait complete. 2023-10-03T10:13:40.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:40.975 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:40.980 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:41.089 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:41.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.117+0000 7f9d8eea6700 1 Processor -- start 2023-10-03T10:13:41.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.117+0000 7f9d8eea6700 1 -- start start 2023-10-03T10:13:41.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.117+0000 7f9d8eea6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d8809ad40 0x7f9d88133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.117+0000 7f9d8eea6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d88133f70 0x7f9d881343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.117+0000 7f9d8eea6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9d880a0a70 0x7f9d880a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.117+0000 7f9d8eea6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d880a3b60 con 0x7f9d880a0a70 2023-10-03T10:13:41.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.117+0000 7f9d8eea6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d881348e0 con 0x7f9d88133f70 2023-10-03T10:13:41.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.118+0000 7f9d8eea6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8809b110 con 0x7f9d8809ad40 2023-10-03T10:13:41.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.118+0000 7f9d87fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d88133f70 0x7f9d881343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.118+0000 7f9d87fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d88133f70 0x7f9d881343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55368/0 (socket says 172.21.15.146:55368) 2023-10-03T10:13:41.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.118+0000 7f9d87fff700 1 -- 172.21.15.146:0/1507562735 learned_addr learned my addr 172.21.15.146:0/1507562735 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:41.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.118+0000 7f9d87fff700 1 -- 172.21.15.146:0/1507562735 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d8809ad40 msgr2=0x7f9d88133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:41.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.118+0000 7f9d87fff700 1 --2- 172.21.15.146:0/1507562735 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d8809ad40 0x7f9d88133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.118+0000 7f9d87fff700 1 -- 172.21.15.146:0/1507562735 >> v2:172.21.15.146:3300/0 conn(0x7f9d880a0a70 msgr2=0x7f9d880a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:41.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.118+0000 7f9d87fff700 1 --2- 172.21.15.146:0/1507562735 >> v2:172.21.15.146:3300/0 conn(0x7f9d880a0a70 0x7f9d880a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.118+0000 7f9d87fff700 1 -- 172.21.15.146:0/1507562735 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d880a2fa0 con 0x7f9d88133f70 2023-10-03T10:13:41.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.118+0000 7f9d87fff700 1 --2- 172.21.15.146:0/1507562735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d88133f70 0x7f9d881343a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009920 tx=0x7f9d74009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e851410e3bcab87b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:41.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.118+0000 7f9d877fe700 1 -- 172.21.15.146:0/1507562735 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7400ba20 con 0x7f9d88133f70 2023-10-03T10:13:41.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.118+0000 7f9d877fe700 1 -- 172.21.15.146:0/1507562735 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7400bb80 con 0x7f9d88133f70 2023-10-03T10:13:41.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.118+0000 7f9d877fe700 1 -- 172.21.15.146:0/1507562735 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d74009e70 con 0x7f9d88133f70 2023-10-03T10:13:41.120 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:41.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.119+0000 7f9d8eea6700 1 -- 172.21.15.146:0/1507562735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d88133f70 msgr2=0x7f9d881343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.119+0000 7f9d8eea6700 1 --2- 172.21.15.146:0/1507562735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d88133f70 0x7f9d881343a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009920 tx=0x7f9d74009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:41.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.119+0000 7f9d8eea6700 1 -- 172.21.15.146:0/1507562735 shutdown_connections 2023-10-03T10:13:41.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.119+0000 7f9d8eea6700 1 --2- 172.21.15.146:0/1507562735 >> v2:172.21.15.146:3300/0 conn(0x7f9d880a0a70 0x7f9d880a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.119+0000 7f9d8eea6700 1 --2- 172.21.15.146:0/1507562735 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d8809ad40 0x7f9d88133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.119+0000 7f9d8eea6700 1 --2- 172.21.15.146:0/1507562735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d88133f70 0x7f9d881343a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.119+0000 7f9d8eea6700 1 -- 172.21.15.146:0/1507562735 >> 172.21.15.146:0/1507562735 conn(0x7f9d88099c40 msgr2=0x7f9d8806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.119+0000 7f9d8eea6700 1 -- 172.21.15.146:0/1507562735 shutdown_connections 2023-10-03T10:13:41.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.119+0000 7f9d8eea6700 1 -- 172.21.15.146:0/1507562735 wait complete. 2023-10-03T10:13:41.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.120+0000 7f9d8eea6700 1 Processor -- start 2023-10-03T10:13:41.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.120+0000 7f9d8eea6700 1 -- start start 2023-10-03T10:13:41.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.121+0000 7f9d8eea6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d8809ad40 0x7f9d88122400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.121+0000 7f9d8eea6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d880a0a70 0x7f9d88122940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.121+0000 7f9d8eea6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d88133f70 0x7f9d88122e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.121+0000 7f9d8eea6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d88124190 con 0x7f9d8809ad40 2023-10-03T10:13:41.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.121+0000 7f9d8eea6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d88124ea0 con 0x7f9d88133f70 2023-10-03T10:13:41.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.121+0000 7f9d8eea6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d88125260 con 0x7f9d880a0a70 2023-10-03T10:13:41.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.121+0000 7f9d87fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d880a0a70 0x7f9d88122940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.121+0000 7f9d8cc42700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d8809ad40 0x7f9d88122400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.121+0000 7f9d87fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d880a0a70 0x7f9d88122940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56288/0 (socket says 172.21.15.146:56288) 2023-10-03T10:13:41.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.121+0000 7f9d87fff700 1 -- 172.21.15.146:0/3811398365 learned_addr learned my addr 172.21.15.146:0/3811398365 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:41.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.121+0000 7f9d8d443700 1 --2- 172.21.15.146:0/3811398365 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d88133f70 0x7f9d88122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.122+0000 7f9d8cc42700 1 -- 172.21.15.146:0/3811398365 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d880a0a70 msgr2=0x7f9d88122940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.122+0000 7f9d8cc42700 1 --2- 172.21.15.146:0/3811398365 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d880a0a70 0x7f9d88122940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.122+0000 7f9d8cc42700 1 -- 172.21.15.146:0/3811398365 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d88133f70 msgr2=0x7f9d88122e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.122+0000 7f9d8cc42700 1 --2- 172.21.15.146:0/3811398365 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d88133f70 0x7f9d88122e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.122+0000 7f9d8cc42700 1 -- 172.21.15.146:0/3811398365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d74009550 con 0x7f9d8809ad40 2023-10-03T10:13:41.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.122+0000 7f9d87fff700 1 --2- 172.21.15.146:0/3811398365 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d880a0a70 0x7f9d88122940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:41.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.122+0000 7f9d8cc42700 1 --2- 172.21.15.146:0/3811398365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d8809ad40 0x7f9d88122400 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00b440 tx=0x7f9d7c00b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:41.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.122+0000 7f9d857fa700 1 -- 172.21.15.146:0/3811398365 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c011620 con 0x7f9d8809ad40 2023-10-03T10:13:41.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.122+0000 7f9d857fa700 1 -- 172.21.15.146:0/3811398365 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c011780 con 0x7f9d8809ad40 2023-10-03T10:13:41.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.122+0000 7f9d8eea6700 1 -- 172.21.15.146:0/3811398365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d88125f20 con 0x7f9d8809ad40 2023-10-03T10:13:41.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.122+0000 7f9d857fa700 1 -- 172.21.15.146:0/3811398365 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c011b30 con 0x7f9d8809ad40 2023-10-03T10:13:41.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.122+0000 7f9d8eea6700 1 -- 172.21.15.146:0/3811398365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d88125c40 con 0x7f9d8809ad40 2023-10-03T10:13:41.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.124+0000 7f9d8eea6700 1 -- 172.21.15.146:0/3811398365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8804f2a0 con 0x7f9d8809ad40 2023-10-03T10:13:41.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.124+0000 7f9d857fa700 1 -- 172.21.15.146:0/3811398365 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d7c011c90 con 0x7f9d8809ad40 2023-10-03T10:13:41.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.124+0000 7f9d857fa700 1 -- 172.21.15.146:0/3811398365 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9d7c03f480 con 0x7f9d8809ad40 2023-10-03T10:13:41.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.129+0000 7f9d857fa700 1 -- 172.21.15.146:0/3811398365 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d7c00f2e0 con 0x7f9d8809ad40 2023-10-03T10:13:41.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.161+0000 7fecd8bf4700 1 Processor -- start 2023-10-03T10:13:41.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.161+0000 7fecd8bf4700 1 -- start start 2023-10-03T10:13:41.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.162+0000 7fecd8bf4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd409f350 0x7fecd4138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.162+0000 7fecd8bf4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd41393a0 0x7fecd413b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.162+0000 7fecd8bf4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd409fa00 con 0x7fecd409e870 2023-10-03T10:13:41.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.162+0000 7fecd8bf4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd40a0370 con 0x7fecd41393a0 2023-10-03T10:13:41.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.162+0000 7fecd8bf4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecd406bec0 con 0x7fecd409f350 2023-10-03T10:13:41.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.162+0000 7fecd1d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd409f350 0x7fecd4138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.162+0000 7fecd2d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd41393a0 0x7fecd413b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.162+0000 7fecd1d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd409f350 0x7fecd4138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56298/0 (socket says 172.21.15.146:56298) 2023-10-03T10:13:41.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.162+0000 7fecd1d9b700 1 -- 172.21.15.146:0/650047391 learned_addr learned my addr 172.21.15.146:0/650047391 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:41.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.162+0000 7fecd2d9d700 1 -- 172.21.15.146:0/650047391 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd409f350 msgr2=0x7fecd4138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:41.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.162+0000 7fecd2d9d700 1 --2- 172.21.15.146:0/650047391 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd409f350 0x7fecd4138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.162+0000 7fecd2d9d700 1 -- 172.21.15.146:0/650047391 >> v1:172.21.15.146:6789/0 conn(0x7fecd409e870 legacy=0x7fecd409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:41.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.162+0000 7fecd2d9d700 1 -- 172.21.15.146:0/650047391 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd409ada0 con 0x7fecd41393a0 2023-10-03T10:13:41.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.162+0000 7fecd1d9b700 1 --2- 172.21.15.146:0/650047391 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd409f350 0x7fecd4138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:41.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.162+0000 7fecd2d9d700 1 --2- 172.21.15.146:0/650047391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd41393a0 0x7fecd413b780 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7feccc009dc0 tx=0x7feccc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=220b462b1c2aefa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:41.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.163+0000 7fecd159a700 1 -- 172.21.15.146:0/650047391 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc00e070 con 0x7fecd41393a0 2023-10-03T10:13:41.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.163+0000 7fecd159a700 1 -- 172.21.15.146:0/650047391 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feccc00bae0 con 0x7fecd41393a0 2023-10-03T10:13:41.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.163+0000 7fecd159a700 1 -- 172.21.15.146:0/650047391 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc00be90 con 0x7fecd41393a0 2023-10-03T10:13:41.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.164+0000 7fecd8bf4700 1 -- 172.21.15.146:0/650047391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd41393a0 msgr2=0x7fecd413b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.164+0000 7fecd8bf4700 1 --2- 172.21.15.146:0/650047391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd41393a0 0x7fecd413b780 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7feccc009dc0 tx=0x7feccc00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:41.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.164+0000 7fecd8bf4700 1 -- 172.21.15.146:0/650047391 shutdown_connections 2023-10-03T10:13:41.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.164+0000 7fecd8bf4700 1 --2- 172.21.15.146:0/650047391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd41393a0 0x7fecd413b780 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.164+0000 7fecd8bf4700 1 --2- 172.21.15.146:0/650047391 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd409f350 0x7fecd4138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.164+0000 7fecd8bf4700 1 -- 172.21.15.146:0/650047391 >> 172.21.15.146:0/650047391 conn(0x7fecd40a4430 msgr2=0x7fecd40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.164+0000 7fecd8bf4700 1 -- 172.21.15.146:0/650047391 shutdown_connections 2023-10-03T10:13:41.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.164+0000 7fecd8bf4700 1 -- 172.21.15.146:0/650047391 wait complete. 2023-10-03T10:13:41.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.165+0000 7fecd8bf4700 1 Processor -- start 2023-10-03T10:13:41.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.165+0000 7fecd8bf4700 1 -- start start 2023-10-03T10:13:41.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.166+0000 7fecd8bf4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd409e870 0x7fecd411ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.166+0000 7fecd8bf4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecd409f350 0x7fecd411f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.166+0000 7fecd8bf4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd41393a0 0x7fecd411f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.166+0000 7fecd8bf4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd4120be0 con 0x7fecd409f350 2023-10-03T10:13:41.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.166+0000 7fecd8bf4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd409dd30 con 0x7fecd41393a0 2023-10-03T10:13:41.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.166+0000 7fecd8bf4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecd41206c0 con 0x7fecd409e870 2023-10-03T10:13:41.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.166+0000 7fecd259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd409e870 0x7fecd411ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.166+0000 7fecd259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd409e870 0x7fecd411ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56302/0 (socket says 172.21.15.146:56302) 2023-10-03T10:13:41.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.166+0000 7fecd259c700 1 -- 172.21.15.146:0/1209012727 learned_addr learned my addr 172.21.15.146:0/1209012727 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:41.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.166+0000 7fecd1d9b700 1 --2- 172.21.15.146:0/1209012727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecd409f350 0x7fecd411f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.166+0000 7fecd2d9d700 1 --2- 172.21.15.146:0/1209012727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd41393a0 0x7fecd411f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.167+0000 7fecd2d9d700 1 -- 172.21.15.146:0/1209012727 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd409e870 msgr2=0x7fecd411ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.167+0000 7fecd2d9d700 1 --2- 172.21.15.146:0/1209012727 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd409e870 0x7fecd411ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.167+0000 7fecd2d9d700 1 -- 172.21.15.146:0/1209012727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecd409f350 msgr2=0x7fecd411f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.167+0000 7fecd2d9d700 1 --2- 172.21.15.146:0/1209012727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecd409f350 0x7fecd411f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.167+0000 7fecd2d9d700 1 -- 172.21.15.146:0/1209012727 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc8009550 con 0x7fecd41393a0 2023-10-03T10:13:41.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.167+0000 7fecd2d9d700 1 --2- 172.21.15.146:0/1209012727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd41393a0 0x7fecd411f550 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fecd40a1b00 tx=0x7feccc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:41.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.167+0000 7fecc2ffd700 1 -- 172.21.15.146:0/1209012727 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc0045c0 con 0x7fecd41393a0 2023-10-03T10:13:41.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.167+0000 7fecc2ffd700 1 -- 172.21.15.146:0/1209012727 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feccc004740 con 0x7fecd41393a0 2023-10-03T10:13:41.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.167+0000 7fecd8bf4700 1 -- 172.21.15.146:0/1209012727 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feccc009a70 con 0x7fecd41393a0 2023-10-03T10:13:41.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.167+0000 7fecc2ffd700 1 -- 172.21.15.146:0/1209012727 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc012430 con 0x7fecd41393a0 2023-10-03T10:13:41.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.167+0000 7fecd8bf4700 1 -- 172.21.15.146:0/1209012727 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd4120da0 con 0x7fecd41393a0 2023-10-03T10:13:41.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.168+0000 7fecc2ffd700 1 -- 172.21.15.146:0/1209012727 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feccc0125b0 con 0x7fecd41393a0 2023-10-03T10:13:41.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.168+0000 7fecc2ffd700 1 -- 172.21.15.146:0/1209012727 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feccc041560 con 0x7fecd41393a0 2023-10-03T10:13:41.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.168+0000 7fecd8bf4700 1 -- 172.21.15.146:0/1209012727 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd404f2a0 con 0x7fecd41393a0 2023-10-03T10:13:41.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.177+0000 7fecc2ffd700 1 -- 172.21.15.146:0/1209012727 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feccc011980 con 0x7fecd41393a0 2023-10-03T10:13:41.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.229+0000 7f767232c700 1 Processor -- start 2023-10-03T10:13:41.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.229+0000 7f767232c700 1 -- start start 2023-10-03T10:13:41.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.230+0000 7f767232c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f766c133ad0 0x7f766c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.230+0000 7f767232c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c1300a0 0x7f766c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.230+0000 7f767232c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f766c1309f0 0x7f766c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.230+0000 7f767232c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766c06b2d0 con 0x7f766c133ad0 2023-10-03T10:13:41.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.230+0000 7f767232c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766c133610 con 0x7f766c1309f0 2023-10-03T10:13:41.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.230+0000 7f767232c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f766c09a500 con 0x7f766c1300a0 2023-10-03T10:13:41.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.230+0000 7f766bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f766c133ad0 0x7f766c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.230+0000 7f766b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c1300a0 0x7f766c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.230+0000 7f766b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c1300a0 0x7f766c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56316/0 (socket says 172.21.15.146:56316) 2023-10-03T10:13:41.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.230+0000 7f766bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f766c133ad0 0x7f766c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40788/0 (socket says 172.21.15.146:40788) 2023-10-03T10:13:41.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.230+0000 7f766b7fe700 1 -- 172.21.15.146:0/1805687299 learned_addr learned my addr 172.21.15.146:0/1805687299 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:41.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.230+0000 7f76708c9700 1 --2- 172.21.15.146:0/1805687299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f766c1309f0 0x7f766c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.230+0000 7f766b7fe700 1 -- 172.21.15.146:0/1805687299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f766c1309f0 msgr2=0x7f766c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:41.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.230+0000 7f766b7fe700 1 --2- 172.21.15.146:0/1805687299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f766c1309f0 0x7f766c13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.230+0000 7f766b7fe700 1 -- 172.21.15.146:0/1805687299 >> v2:172.21.15.146:3300/0 conn(0x7f766c133ad0 msgr2=0x7f766c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:41.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.230+0000 7f766b7fe700 1 --2- 172.21.15.146:0/1805687299 >> v2:172.21.15.146:3300/0 conn(0x7f766c133ad0 0x7f766c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.230+0000 7f766b7fe700 1 -- 172.21.15.146:0/1805687299 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c1338b0 con 0x7f766c1300a0 2023-10-03T10:13:41.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.230+0000 7f766bfff700 1 --2- 172.21.15.146:0/1805687299 >> v2:172.21.15.146:3300/0 conn(0x7f766c133ad0 0x7f766c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:41.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.230+0000 7f766b7fe700 1 --2- 172.21.15.146:0/1805687299 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c1300a0 0x7f766c1304b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f76600098f0 tx=0x7f7660009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12d13c290244b3ce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:41.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.231+0000 7f766affd700 1 -- 172.21.15.146:0/1805687299 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660011830 con 0x7f766c1300a0 2023-10-03T10:13:41.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.231+0000 7f766affd700 1 -- 172.21.15.146:0/1805687299 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7660011990 con 0x7f766c1300a0 2023-10-03T10:13:41.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.231+0000 7f766affd700 1 -- 172.21.15.146:0/1805687299 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660011d20 con 0x7f766c1300a0 2023-10-03T10:13:41.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.231+0000 7f767232c700 1 -- 172.21.15.146:0/1805687299 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c1300a0 msgr2=0x7f766c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.231+0000 7f767232c700 1 --2- 172.21.15.146:0/1805687299 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c1300a0 0x7f766c1304b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f76600098f0 tx=0x7f7660009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:41.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.231+0000 7f767232c700 1 -- 172.21.15.146:0/1805687299 shutdown_connections 2023-10-03T10:13:41.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.231+0000 7f767232c700 1 --2- 172.21.15.146:0/1805687299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f766c1309f0 0x7f766c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.231+0000 7f767232c700 1 --2- 172.21.15.146:0/1805687299 >> v2:172.21.15.146:3300/0 conn(0x7f766c133ad0 0x7f766c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.231+0000 7f767232c700 1 --2- 172.21.15.146:0/1805687299 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c1300a0 0x7f766c1304b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.231+0000 7f767232c700 1 -- 172.21.15.146:0/1805687299 >> 172.21.15.146:0/1805687299 conn(0x7f766c099c40 msgr2=0x7f766c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.231+0000 7f767232c700 1 -- 172.21.15.146:0/1805687299 shutdown_connections 2023-10-03T10:13:41.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.231+0000 7f767232c700 1 -- 172.21.15.146:0/1805687299 wait complete. 2023-10-03T10:13:41.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.232+0000 7f767232c700 1 Processor -- start 2023-10-03T10:13:41.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.233+0000 7f767232c700 1 -- start start 2023-10-03T10:13:41.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.233+0000 7f767232c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c1300a0 0x7f766c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.233+0000 7f767232c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f766c1309f0 0x7f766c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.233+0000 7f767232c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f766c133ad0 0x7f766c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.233+0000 7f767232c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c11f060 con 0x7f766c133ad0 2023-10-03T10:13:41.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.233+0000 7f767232c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766c11f490 con 0x7f766c1309f0 2023-10-03T10:13:41.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.233+0000 7f767232c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f766c0a3400 con 0x7f766c1300a0 2023-10-03T10:13:41.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.233+0000 7f766bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c1300a0 0x7f766c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.233+0000 7f76708c9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f766c133ad0 0x7f766c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.233+0000 7f766bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c1300a0 0x7f766c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56318/0 (socket says 172.21.15.146:56318) 2023-10-03T10:13:41.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.233+0000 7f766bfff700 1 -- 172.21.15.146:0/118405905 learned_addr learned my addr 172.21.15.146:0/118405905 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:41.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.233+0000 7f766b7fe700 1 --2- 172.21.15.146:0/118405905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f766c1309f0 0x7f766c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.233+0000 7f766bfff700 1 -- 172.21.15.146:0/118405905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f766c1309f0 msgr2=0x7f766c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.233+0000 7f766bfff700 1 --2- 172.21.15.146:0/118405905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f766c1309f0 0x7f766c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.233+0000 7f766bfff700 1 -- 172.21.15.146:0/118405905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f766c133ad0 msgr2=0x7f766c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.233+0000 7f766bfff700 1 --2- 172.21.15.146:0/118405905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f766c133ad0 0x7f766c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.234+0000 7f766bfff700 1 -- 172.21.15.146:0/118405905 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7660009550 con 0x7f766c1300a0 2023-10-03T10:13:41.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.234+0000 7f76708c9700 1 --2- 172.21.15.146:0/118405905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f766c133ad0 0x7f766c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:41.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.234+0000 7f766bfff700 1 --2- 172.21.15.146:0/118405905 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c1300a0 0x7f766c11da40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f765c00e810 tx=0x7f765c00eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:41.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.234+0000 7f7668ff9700 1 -- 172.21.15.146:0/118405905 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c013610 con 0x7f766c1300a0 2023-10-03T10:13:41.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.234+0000 7f7668ff9700 1 -- 172.21.15.146:0/118405905 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765c013770 con 0x7f766c1300a0 2023-10-03T10:13:41.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.234+0000 7f767232c700 1 -- 172.21.15.146:0/118405905 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766c12dd00 con 0x7f766c1300a0 2023-10-03T10:13:41.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.234+0000 7f7668ff9700 1 -- 172.21.15.146:0/118405905 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c013b20 con 0x7f766c1300a0 2023-10-03T10:13:41.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.234+0000 7f767232c700 1 -- 172.21.15.146:0/118405905 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766c0716e0 con 0x7f766c1300a0 2023-10-03T10:13:41.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.235+0000 7f7668ff9700 1 -- 172.21.15.146:0/118405905 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f765c013c80 con 0x7f766c1300a0 2023-10-03T10:13:41.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.235+0000 7f7668ff9700 1 -- 172.21.15.146:0/118405905 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f765c03f390 con 0x7f766c1300a0 2023-10-03T10:13:41.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.235+0000 7f767232c700 1 -- 172.21.15.146:0/118405905 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766c11ff60 con 0x7f766c1300a0 2023-10-03T10:13:41.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.240+0000 7f7668ff9700 1 -- 172.21.15.146:0/118405905 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f765c012370 con 0x7f766c1300a0 2023-10-03T10:13:41.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.256+0000 7f5f3a535700 1 Processor -- start 2023-10-03T10:13:41.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.256+0000 7f5f3a535700 1 -- start start 2023-10-03T10:13:41.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.256+0000 7f5f3a535700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5f340a0a30 0x7f5f340a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.256+0000 7f5f3a535700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f34130670 0x7f5f341381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.256+0000 7f5f3a535700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f340a1e70 con 0x7f5f340a1340 2023-10-03T10:13:41.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.256+0000 7f5f3a535700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3409a720 con 0x7f5f340a0a30 2023-10-03T10:13:41.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.256+0000 7f5f3a535700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3409b300 con 0x7f5f34130670 2023-10-03T10:13:41.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.256+0000 7f5f33fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5f340a0a30 0x7f5f340a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.256+0000 7f5f38ad2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f34130670 0x7f5f341381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.256+0000 7f5f33fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5f340a0a30 0x7f5f340a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40804/0 (socket says 172.21.15.146:40804) 2023-10-03T10:13:41.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.256+0000 7f5f337fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5f340a1340 0x7f5f3412ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36018/0 (socket says 172.21.15.146:36018) 2023-10-03T10:13:41.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.256+0000 7f5f38ad2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f34130670 0x7f5f341381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55438/0 (socket says 172.21.15.146:55438) 2023-10-03T10:13:41.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.256+0000 7f5f33fff700 1 -- 172.21.15.146:0/128821779 learned_addr learned my addr 172.21.15.146:0/128821779 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:41.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.257+0000 7f5f33fff700 1 -- 172.21.15.146:0/128821779 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f34130670 msgr2=0x7f5f341381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:41.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.257+0000 7f5f33fff700 1 --2- 172.21.15.146:0/128821779 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f34130670 0x7f5f341381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.257+0000 7f5f33fff700 1 -- 172.21.15.146:0/128821779 >> v1:172.21.15.146:6789/0 conn(0x7f5f340a1340 legacy=0x7f5f3412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.257+0000 7f5f33fff700 1 -- 172.21.15.146:0/128821779 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3409abc0 con 0x7f5f340a0a30 2023-10-03T10:13:41.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.257+0000 7f5f38ad2700 1 --2- 172.21.15.146:0/128821779 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f34130670 0x7f5f341381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:41.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.257+0000 7f5f33fff700 1 --2- 172.21.15.146:0/128821779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f340a0a30 0x7f5f340a0e00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5f24006fd0 tx=0x7f5f24009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ca360f5c20a7ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:41.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.257+0000 7f5f32ffd700 1 -- 172.21.15.146:0/128821779 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f24005e30 con 0x7f5f340a0a30 2023-10-03T10:13:41.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.257+0000 7f5f32ffd700 1 -- 172.21.15.146:0/128821779 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f24004030 con 0x7f5f340a0a30 2023-10-03T10:13:41.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.257+0000 7f5f32ffd700 1 -- 172.21.15.146:0/128821779 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f240043e0 con 0x7f5f340a0a30 2023-10-03T10:13:41.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.258+0000 7f5f3a535700 1 -- 172.21.15.146:0/128821779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f340a0a30 msgr2=0x7f5f340a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.258+0000 7f5f3a535700 1 --2- 172.21.15.146:0/128821779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f340a0a30 0x7f5f340a0e00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5f24006fd0 tx=0x7f5f24009bd0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.258+0000 7f5f3a535700 1 -- 172.21.15.146:0/128821779 shutdown_connections 2023-10-03T10:13:41.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.258+0000 7f5f3a535700 1 --2- 172.21.15.146:0/128821779 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f34130670 0x7f5f341381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.258+0000 7f5f3a535700 1 --2- 172.21.15.146:0/128821779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f340a0a30 0x7f5f340a0e00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.258+0000 7f5f3a535700 1 -- 172.21.15.146:0/128821779 >> 172.21.15.146:0/128821779 conn(0x7f5f340a2980 msgr2=0x7f5f340a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.258+0000 7f5f3a535700 1 -- 172.21.15.146:0/128821779 shutdown_connections 2023-10-03T10:13:41.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.258+0000 7f5f3a535700 1 -- 172.21.15.146:0/128821779 wait complete. 2023-10-03T10:13:41.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.259+0000 7f5f3a535700 1 Processor -- start 2023-10-03T10:13:41.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.259+0000 7f5f3a535700 1 -- start start 2023-10-03T10:13:41.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.259+0000 7f5f3a535700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f340a0a30 0x7f5f341c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.259+0000 7f5f3a535700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f340a1340 0x7f5f341c5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.259+0000 7f5f3a535700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f34130670 0x7f5f341c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.259+0000 7f5f3a535700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f34122840 con 0x7f5f340a1340 2023-10-03T10:13:41.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.259+0000 7f5f3a535700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3411c370 con 0x7f5f340a0a30 2023-10-03T10:13:41.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.259+0000 7f5f3a535700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3411d000 con 0x7f5f34130670 2023-10-03T10:13:41.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.260+0000 7f5f33fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f340a0a30 0x7f5f341c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.260+0000 7f5f337fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f340a1340 0x7f5f341c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.260+0000 7f5f33fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f340a0a30 0x7f5f341c51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55440/0 (socket says 172.21.15.146:55440) 2023-10-03T10:13:41.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.260+0000 7f5f337fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f340a1340 0x7f5f341c5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40806/0 (socket says 172.21.15.146:40806) 2023-10-03T10:13:41.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.260+0000 7f5f33fff700 1 -- 172.21.15.146:0/2729406929 learned_addr learned my addr 172.21.15.146:0/2729406929 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:41.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.260+0000 7f5f38ad2700 1 --2- 172.21.15.146:0/2729406929 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f34130670 0x7f5f341c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.260+0000 7f5f337fe700 1 -- 172.21.15.146:0/2729406929 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f34130670 msgr2=0x7f5f341c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.260+0000 7f5f337fe700 1 --2- 172.21.15.146:0/2729406929 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f34130670 0x7f5f341c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.260+0000 7f5f337fe700 1 -- 172.21.15.146:0/2729406929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f340a0a30 msgr2=0x7f5f341c51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.260+0000 7f5f337fe700 1 --2- 172.21.15.146:0/2729406929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f340a0a30 0x7f5f341c51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.260+0000 7f5f337fe700 1 -- 172.21.15.146:0/2729406929 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c009a70 con 0x7f5f340a1340 2023-10-03T10:13:41.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.260+0000 7f5f337fe700 1 --2- 172.21.15.146:0/2729406929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f340a1340 0x7f5f341c5720 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800c450 tx=0x7f5f2800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:41.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.260+0000 7f5f30ff9700 1 -- 172.21.15.146:0/2729406929 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28005cb0 con 0x7f5f340a1340 2023-10-03T10:13:41.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.260+0000 7f5f30ff9700 1 -- 172.21.15.146:0/2729406929 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f28005e10 con 0x7f5f340a1340 2023-10-03T10:13:41.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.260+0000 7f5f30ff9700 1 -- 172.21.15.146:0/2729406929 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f280072d0 con 0x7f5f340a1340 2023-10-03T10:13:41.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.260+0000 7f5f3a535700 1 -- 172.21.15.146:0/2729406929 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f24009500 con 0x7f5f340a1340 2023-10-03T10:13:41.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.260+0000 7f5f3a535700 1 -- 172.21.15.146:0/2729406929 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f341c5c60 con 0x7f5f340a1340 2023-10-03T10:13:41.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.261+0000 7f5f30ff9700 1 -- 172.21.15.146:0/2729406929 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f28007430 con 0x7f5f340a1340 2023-10-03T10:13:41.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.261+0000 7f5f30ff9700 1 -- 172.21.15.146:0/2729406929 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5f2803e9d0 con 0x7f5f340a1340 2023-10-03T10:13:41.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.262+0000 7f5f3a535700 1 -- 172.21.15.146:0/2729406929 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f34121d50 con 0x7f5f340a1340 2023-10-03T10:13:41.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.266+0000 7f5f30ff9700 1 -- 172.21.15.146:0/2729406929 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f34121d50 con 0x7f5f340a1340 2023-10-03T10:13:41.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.374+0000 7f9d8eea6700 1 -- 172.21.15.146:0/3811398365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9d880729d0 con 0x7f9d8809ad40 2023-10-03T10:13:41.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.374+0000 7f9d857fa700 1 -- 172.21.15.146:0/3811398365 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9d7c022350 con 0x7f9d8809ad40 2023-10-03T10:13:41.375 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:41.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.378+0000 7f9d8eea6700 1 -- 172.21.15.146:0/3811398365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d8809ad40 msgr2=0x7f9d88122400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.378+0000 7f9d8eea6700 1 --2- 172.21.15.146:0/3811398365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d8809ad40 0x7f9d88122400 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00b440 tx=0x7f9d7c00b750 comp rx=0 tx=0).stop 2023-10-03T10:13:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.378+0000 7f9d8eea6700 1 -- 172.21.15.146:0/3811398365 shutdown_connections 2023-10-03T10:13:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.378+0000 7f9d8eea6700 1 --2- 172.21.15.146:0/3811398365 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d88133f70 0x7f9d88122e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.378+0000 7f9d8eea6700 1 --2- 172.21.15.146:0/3811398365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d8809ad40 0x7f9d88122400 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.378+0000 7f9d8eea6700 1 --2- 172.21.15.146:0/3811398365 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d880a0a70 0x7f9d88122940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.378+0000 7f9d8eea6700 1 -- 172.21.15.146:0/3811398365 >> 172.21.15.146:0/3811398365 conn(0x7f9d88099c40 msgr2=0x7f9d8809e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.378+0000 7f9d8eea6700 1 -- 172.21.15.146:0/3811398365 shutdown_connections 2023-10-03T10:13:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.378+0000 7f9d8eea6700 1 -- 172.21.15.146:0/3811398365 wait complete. 2023-10-03T10:13:41.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:41.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.412+0000 7fecd8bf4700 1 -- 172.21.15.146:0/1209012727 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fecd4072d60 con 0x7fecd41393a0 2023-10-03T10:13:41.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.412+0000 7fecc2ffd700 1 -- 172.21.15.146:0/1209012727 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7feccc02a030 con 0x7fecd41393a0 2023-10-03T10:13:41.412 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:41.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.414+0000 7fecd8bf4700 1 -- 172.21.15.146:0/1209012727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd41393a0 msgr2=0x7fecd411f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.414+0000 7fecd8bf4700 1 --2- 172.21.15.146:0/1209012727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd41393a0 0x7fecd411f550 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fecd40a1b00 tx=0x7feccc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.414+0000 7fecd8bf4700 1 -- 172.21.15.146:0/1209012727 shutdown_connections 2023-10-03T10:13:41.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.414+0000 7fecd8bf4700 1 --2- 172.21.15.146:0/1209012727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd41393a0 0x7fecd411f550 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.414+0000 7fecd8bf4700 1 --2- 172.21.15.146:0/1209012727 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecd409e870 0x7fecd411ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.414+0000 7fecd8bf4700 1 --2- 172.21.15.146:0/1209012727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecd409f350 0x7fecd411f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.415+0000 7fecd8bf4700 1 -- 172.21.15.146:0/1209012727 >> 172.21.15.146:0/1209012727 conn(0x7fecd40a4430 msgr2=0x7fecd4136dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.415+0000 7fecd8bf4700 1 -- 172.21.15.146:0/1209012727 shutdown_connections 2023-10-03T10:13:41.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.415+0000 7fecd8bf4700 1 -- 172.21.15.146:0/1209012727 wait complete. 2023-10-03T10:13:41.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:41.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.459+0000 7f767232c700 1 -- 172.21.15.146:0/118405905 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f766c04f2a0 con 0x7f766c1300a0 2023-10-03T10:13:41.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.459+0000 7f7668ff9700 1 -- 172.21.15.146:0/118405905 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f765c021030 con 0x7f766c1300a0 2023-10-03T10:13:41.459 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:41.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.461+0000 7f767232c700 1 -- 172.21.15.146:0/118405905 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c1300a0 msgr2=0x7f766c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.461+0000 7f767232c700 1 --2- 172.21.15.146:0/118405905 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c1300a0 0x7f766c11da40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f765c00e810 tx=0x7f765c00eb20 comp rx=0 tx=0).stop 2023-10-03T10:13:41.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.461+0000 7f767232c700 1 -- 172.21.15.146:0/118405905 shutdown_connections 2023-10-03T10:13:41.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.461+0000 7f767232c700 1 --2- 172.21.15.146:0/118405905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f766c133ad0 0x7f766c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.461+0000 7f767232c700 1 --2- 172.21.15.146:0/118405905 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c1300a0 0x7f766c11da40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.461+0000 7f767232c700 1 --2- 172.21.15.146:0/118405905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f766c1309f0 0x7f766c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.461+0000 7f767232c700 1 -- 172.21.15.146:0/118405905 >> 172.21.15.146:0/118405905 conn(0x7f766c099c40 msgr2=0x7f766c12e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.461+0000 7f767232c700 1 -- 172.21.15.146:0/118405905 shutdown_connections 2023-10-03T10:13:41.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.461+0000 7f767232c700 1 -- 172.21.15.146:0/118405905 wait complete. 2023-10-03T10:13:41.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.490+0000 7f5f3a535700 1 -- 172.21.15.146:0/2729406929 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5f34121d50 con 0x7f5f340a1340 2023-10-03T10:13:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.490+0000 7f5f30ff9700 1 -- 172.21.15.146:0/2729406929 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f34121d50 con 0x7f5f340a1340 2023-10-03T10:13:41.490 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.492+0000 7f5f3a535700 1 -- 172.21.15.146:0/2729406929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f340a1340 msgr2=0x7f5f341c5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.492+0000 7f5f3a535700 1 --2- 172.21.15.146:0/2729406929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f340a1340 0x7f5f341c5720 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800c450 tx=0x7f5f2800c760 comp rx=0 tx=0).stop 2023-10-03T10:13:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.492+0000 7f5f3a535700 1 -- 172.21.15.146:0/2729406929 shutdown_connections 2023-10-03T10:13:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.492+0000 7f5f3a535700 1 --2- 172.21.15.146:0/2729406929 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f34130670 0x7f5f341c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.492+0000 7f5f3a535700 1 --2- 172.21.15.146:0/2729406929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f340a0a30 0x7f5f341c51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.492+0000 7f5f3a535700 1 --2- 172.21.15.146:0/2729406929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f340a1340 0x7f5f341c5720 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.492+0000 7f5f3a535700 1 -- 172.21.15.146:0/2729406929 >> 172.21.15.146:0/2729406929 conn(0x7f5f340a2980 msgr2=0x7f5f341b5800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.492+0000 7f5f3a535700 1 -- 172.21.15.146:0/2729406929 shutdown_connections 2023-10-03T10:13:41.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:41.492+0000 7f5f3a535700 1 -- 172.21.15.146:0/2729406929 wait complete. 2023-10-03T10:13:41.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:42.396 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:42.427 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:42.474 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:42.505 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:42.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.538+0000 7fdccb8b3700 1 Processor -- start 2023-10-03T10:13:42.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.539+0000 7fdccb8b3700 1 -- start start 2023-10-03T10:13:42.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.539+0000 7fdccb8b3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdcc4138040 0x7fdcc4138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.539+0000 7fdccb8b3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcc40a1400 0x7fdcc413fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.539+0000 7fdccb8b3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc41379e0 con 0x7fdcc40a08e0 2023-10-03T10:13:42.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.539+0000 7fdccb8b3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc40a2100 con 0x7fdcc4138040 2023-10-03T10:13:42.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.539+0000 7fdccb8b3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4138950 con 0x7fdcc40a1400 2023-10-03T10:13:42.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.539+0000 7fdcc8e4e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdcc40a08e0 0x7fdcc40a0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36030/0 (socket says 172.21.15.146:36030) 2023-10-03T10:13:42.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.539+0000 7fdcc8e4e700 1 -- 172.21.15.146:0/3548313532 learned_addr learned my addr 172.21.15.146:0/3548313532 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:42.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.540+0000 7fdcc9e50700 1 --2- 172.21.15.146:0/3548313532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcc40a1400 0x7fdcc413fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.540+0000 7fdcc964f700 1 --2- 172.21.15.146:0/3548313532 >> v2:172.21.15.146:3300/0 conn(0x7fdcc4138040 0x7fdcc4138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.540+0000 7fdcbbfff700 1 -- 172.21.15.146:0/3548313532 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1016189031 0 0) 0x7fdcc41379e0 con 0x7fdcc40a08e0 2023-10-03T10:13:42.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.540+0000 7fdcbbfff700 1 -- 172.21.15.146:0/3548313532 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcb00035b0 con 0x7fdcc40a08e0 2023-10-03T10:13:42.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.540+0000 7fdcc9e50700 1 -- 172.21.15.146:0/3548313532 >> v2:172.21.15.146:3300/0 conn(0x7fdcc4138040 msgr2=0x7fdcc4138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:42.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.540+0000 7fdcc9e50700 1 --2- 172.21.15.146:0/3548313532 >> v2:172.21.15.146:3300/0 conn(0x7fdcc4138040 0x7fdcc4138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.540+0000 7fdcc9e50700 1 -- 172.21.15.146:0/3548313532 >> v1:172.21.15.146:6789/0 conn(0x7fdcc40a08e0 legacy=0x7fdcc40a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.540+0000 7fdcc9e50700 1 -- 172.21.15.146:0/3548313532 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc409b9b0 con 0x7fdcc40a1400 2023-10-03T10:13:42.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.540+0000 7fdcc9e50700 1 --2- 172.21.15.146:0/3548313532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcc40a1400 0x7fdcc413fd20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc009dc0 tx=0x7fdcbc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a75101d8d172469 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.540+0000 7fdcbbfff700 1 -- 172.21.15.146:0/3548313532 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc00e070 con 0x7fdcc40a1400 2023-10-03T10:13:42.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.540+0000 7fdcbbfff700 1 -- 172.21.15.146:0/3548313532 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc00bae0 con 0x7fdcc40a1400 2023-10-03T10:13:42.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.540+0000 7fdcbbfff700 1 -- 172.21.15.146:0/3548313532 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc00be50 con 0x7fdcc40a1400 2023-10-03T10:13:42.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.541+0000 7fdccb8b3700 1 -- 172.21.15.146:0/3548313532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcc40a1400 msgr2=0x7fdcc413fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.541+0000 7fdccb8b3700 1 --2- 172.21.15.146:0/3548313532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcc40a1400 0x7fdcc413fd20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc009dc0 tx=0x7fdcbc00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:42.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.541+0000 7fdccb8b3700 1 -- 172.21.15.146:0/3548313532 shutdown_connections 2023-10-03T10:13:42.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.541+0000 7fdccb8b3700 1 --2- 172.21.15.146:0/3548313532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcc40a1400 0x7fdcc413fd20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.541+0000 7fdccb8b3700 1 --2- 172.21.15.146:0/3548313532 >> v2:172.21.15.146:3300/0 conn(0x7fdcc4138040 0x7fdcc4138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.541+0000 7fdccb8b3700 1 -- 172.21.15.146:0/3548313532 >> 172.21.15.146:0/3548313532 conn(0x7fdcc40a2980 msgr2=0x7fdcc40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.542+0000 7fdccb8b3700 1 -- 172.21.15.146:0/3548313532 shutdown_connections 2023-10-03T10:13:42.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.542+0000 7fdccb8b3700 1 -- 172.21.15.146:0/3548313532 wait complete. 2023-10-03T10:13:42.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.543+0000 7fdccb8b3700 1 Processor -- start 2023-10-03T10:13:42.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.543+0000 7fdccb8b3700 1 -- start start 2023-10-03T10:13:42.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.543+0000 7fdccb8b3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcc40a08e0 0x7fdcc41371a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.543+0000 7fdccb8b3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcc40a1400 0x7fdcc4135990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.543+0000 7fdccb8b3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdcc4138040 0x7fdcc4135ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.543+0000 7fdccb8b3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4119140 con 0x7fdcc40a1400 2023-10-03T10:13:42.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.543+0000 7fdccb8b3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc413ec40 con 0x7fdcc40a08e0 2023-10-03T10:13:42.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.543+0000 7fdccb8b3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc413fc70 con 0x7fdcc4138040 2023-10-03T10:13:42.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.543+0000 7fdcc964f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcc40a08e0 0x7fdcc41371a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.543+0000 7fdcc964f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcc40a08e0 0x7fdcc41371a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55446/0 (socket says 172.21.15.146:55446) 2023-10-03T10:13:42.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.543+0000 7fdcc964f700 1 -- 172.21.15.146:0/1086994359 learned_addr learned my addr 172.21.15.146:0/1086994359 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:42.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.544+0000 7fdcc964f700 1 -- 172.21.15.146:0/1086994359 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdcc4138040 msgr2=0x7fdcc4135ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.544+0000 7fdcc964f700 1 --2- 172.21.15.146:0/1086994359 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdcc4138040 0x7fdcc4135ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.544+0000 7fdcc964f700 1 -- 172.21.15.146:0/1086994359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcc40a1400 msgr2=0x7fdcc4135990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.544+0000 7fdcc964f700 1 --2- 172.21.15.146:0/1086994359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcc40a1400 0x7fdcc4135990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.544+0000 7fdcc964f700 1 -- 172.21.15.146:0/1086994359 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc009a70 con 0x7fdcc40a08e0 2023-10-03T10:13:42.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.544+0000 7fdcc964f700 1 --2- 172.21.15.146:0/1086994359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcc40a08e0 0x7fdcc41371a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000e9c0 tx=0x7fdcc000ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.544+0000 7fdcb9ffb700 1 -- 172.21.15.146:0/1086994359 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc000c850 con 0x7fdcc40a08e0 2023-10-03T10:13:42.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.544+0000 7fdcb9ffb700 1 -- 172.21.15.146:0/1086994359 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc000c9b0 con 0x7fdcc40a08e0 2023-10-03T10:13:42.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.544+0000 7fdccb8b3700 1 -- 172.21.15.146:0/1086994359 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc4119320 con 0x7fdcc40a08e0 2023-10-03T10:13:42.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.544+0000 7fdcb9ffb700 1 -- 172.21.15.146:0/1086994359 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc000cd20 con 0x7fdcc40a08e0 2023-10-03T10:13:42.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.545+0000 7fdccb8b3700 1 -- 172.21.15.146:0/1086994359 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc413f3a0 con 0x7fdcc40a08e0 2023-10-03T10:13:42.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.545+0000 7fdcb9ffb700 1 -- 172.21.15.146:0/1086994359 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdcc0013470 con 0x7fdcc40a08e0 2023-10-03T10:13:42.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.546+0000 7fdcb9ffb700 1 -- 172.21.15.146:0/1086994359 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdcc003fc00 con 0x7fdcc40a08e0 2023-10-03T10:13:42.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.546+0000 7fdccb8b3700 1 -- 172.21.15.146:0/1086994359 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc404f2a0 con 0x7fdcc40a08e0 2023-10-03T10:13:42.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.555+0000 7fdcb9ffb700 1 -- 172.21.15.146:0/1086994359 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdcc0017080 con 0x7fdcc40a08e0 2023-10-03T10:13:42.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.582+0000 7ff1acc83700 1 Processor -- start 2023-10-03T10:13:42.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.582+0000 7ff1acc83700 1 -- start start 2023-10-03T10:13:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.583+0000 7ff1acc83700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1a809d860 0x7ff1a809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.583+0000 7ff1acc83700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1a809e170 0x7ff1a81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.583+0000 7ff1acc83700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff1a8130ce0 0x7ff1a8131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.583+0000 7ff1acc83700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a809aaa0 con 0x7ff1a8130ce0 2023-10-03T10:13:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.583+0000 7ff1acc83700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a809f870 con 0x7ff1a809d860 2023-10-03T10:13:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.583+0000 7ff1acc83700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a809b360 con 0x7ff1a809e170 2023-10-03T10:13:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.583+0000 7ff1a5d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1a809e170 0x7ff1a81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.583+0000 7ff1a659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1a809d860 0x7ff1a809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.583+0000 7ff1a5d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1a809e170 0x7ff1a81307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56346/0 (socket says 172.21.15.146:56346) 2023-10-03T10:13:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.583+0000 7ff1a5d9b700 1 -- 172.21.15.146:0/578527939 learned_addr learned my addr 172.21.15.146:0/578527939 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:42.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.583+0000 7ff1a6d9d700 1 --2- 172.21.15.146:0/578527939 >> v2:172.21.15.146:3300/0 conn(0x7ff1a8130ce0 0x7ff1a8131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.584+0000 7ff1a659c700 1 -- 172.21.15.146:0/578527939 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1a809e170 msgr2=0x7ff1a81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:42.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.584+0000 7ff1a659c700 1 --2- 172.21.15.146:0/578527939 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1a809e170 0x7ff1a81307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.584+0000 7ff1a659c700 1 -- 172.21.15.146:0/578527939 >> v2:172.21.15.146:3300/0 conn(0x7ff1a8130ce0 msgr2=0x7ff1a8131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:42.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.584+0000 7ff1a659c700 1 --2- 172.21.15.146:0/578527939 >> v2:172.21.15.146:3300/0 conn(0x7ff1a8130ce0 0x7ff1a8131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.584+0000 7ff1a659c700 1 -- 172.21.15.146:0/578527939 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a809b620 con 0x7ff1a809d860 2023-10-03T10:13:42.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.584+0000 7ff1a5d9b700 1 --2- 172.21.15.146:0/578527939 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1a809e170 0x7ff1a81307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:42.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.584+0000 7ff1a659c700 1 --2- 172.21.15.146:0/578527939 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1a809d860 0x7ff1a809dc30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff198009840 tx=0x7ff198009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46d3400e92d93ef0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.584+0000 7ff1a559a700 1 -- 172.21.15.146:0/578527939 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff198011830 con 0x7ff1a809d860 2023-10-03T10:13:42.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.584+0000 7ff1a559a700 1 -- 172.21.15.146:0/578527939 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff198011990 con 0x7ff1a809d860 2023-10-03T10:13:42.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.584+0000 7ff1a559a700 1 -- 172.21.15.146:0/578527939 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff198011d20 con 0x7ff1a809d860 2023-10-03T10:13:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.585+0000 7ff1acc83700 1 -- 172.21.15.146:0/578527939 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1a809d860 msgr2=0x7ff1a809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.585+0000 7ff1acc83700 1 --2- 172.21.15.146:0/578527939 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1a809d860 0x7ff1a809dc30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff198009840 tx=0x7ff198009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.585+0000 7ff1acc83700 1 -- 172.21.15.146:0/578527939 shutdown_connections 2023-10-03T10:13:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.585+0000 7ff1acc83700 1 --2- 172.21.15.146:0/578527939 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1a809d860 0x7ff1a809dc30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.585+0000 7ff1acc83700 1 --2- 172.21.15.146:0/578527939 >> v2:172.21.15.146:3300/0 conn(0x7ff1a8130ce0 0x7ff1a8131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.585+0000 7ff1acc83700 1 --2- 172.21.15.146:0/578527939 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1a809e170 0x7ff1a81307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.585+0000 7ff1acc83700 1 -- 172.21.15.146:0/578527939 >> 172.21.15.146:0/578527939 conn(0x7ff1a8099c40 msgr2=0x7ff1a80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.585+0000 7ff1acc83700 1 -- 172.21.15.146:0/578527939 shutdown_connections 2023-10-03T10:13:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.585+0000 7ff1acc83700 1 -- 172.21.15.146:0/578527939 wait complete. 2023-10-03T10:13:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.587+0000 7ff1acc83700 1 Processor -- start 2023-10-03T10:13:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.587+0000 7ff1acc83700 1 -- start start 2023-10-03T10:13:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.587+0000 7ff1acc83700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1a809d860 0x7ff1a811f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.587+0000 7ff1acc83700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1a809e170 0x7ff1a811f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.587+0000 7ff1acc83700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1a8130ce0 0x7ff1a811fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.587+0000 7ff1acc83700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a8120c50 con 0x7ff1a809e170 2023-10-03T10:13:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.587+0000 7ff1acc83700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a81204f0 con 0x7ff1a8130ce0 2023-10-03T10:13:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.587+0000 7ff1acc83700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a8121ae0 con 0x7ff1a809d860 2023-10-03T10:13:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.587+0000 7ff1a659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1a809d860 0x7ff1a811f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.587+0000 7ff1a659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1a809d860 0x7ff1a811f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56354/0 (socket says 172.21.15.146:56354) 2023-10-03T10:13:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.587+0000 7ff1a659c700 1 -- 172.21.15.146:0/2080690298 learned_addr learned my addr 172.21.15.146:0/2080690298 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.587+0000 7ff1a6d9d700 1 --2- 172.21.15.146:0/2080690298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1a8130ce0 0x7ff1a811fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.587+0000 7ff1a5d9b700 1 --2- 172.21.15.146:0/2080690298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1a809e170 0x7ff1a811f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.588+0000 7ff1a6d9d700 1 -- 172.21.15.146:0/2080690298 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1a809d860 msgr2=0x7ff1a811f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.588+0000 7ff1a6d9d700 1 --2- 172.21.15.146:0/2080690298 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1a809d860 0x7ff1a811f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.588+0000 7ff1a6d9d700 1 -- 172.21.15.146:0/2080690298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1a809e170 msgr2=0x7ff1a811f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.588+0000 7ff1a6d9d700 1 --2- 172.21.15.146:0/2080690298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1a809e170 0x7ff1a811f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.588+0000 7ff1a6d9d700 1 -- 172.21.15.146:0/2080690298 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19c009550 con 0x7ff1a8130ce0 2023-10-03T10:13:42.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.588+0000 7ff1a6d9d700 1 --2- 172.21.15.146:0/2080690298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1a8130ce0 0x7ff1a811fb10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009d90 tx=0x7ff1a000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.588+0000 7ff196ffd700 1 -- 172.21.15.146:0/2080690298 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0009c00 con 0x7ff1a8130ce0 2023-10-03T10:13:42.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.588+0000 7ff1acc83700 1 -- 172.21.15.146:0/2080690298 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1980094a0 con 0x7ff1a8130ce0 2023-10-03T10:13:42.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.588+0000 7ff196ffd700 1 -- 172.21.15.146:0/2080690298 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a000f040 con 0x7ff1a8130ce0 2023-10-03T10:13:42.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.588+0000 7ff196ffd700 1 -- 172.21.15.146:0/2080690298 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0014480 con 0x7ff1a8130ce0 2023-10-03T10:13:42.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.588+0000 7ff1acc83700 1 -- 172.21.15.146:0/2080690298 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a80a07b0 con 0x7ff1a8130ce0 2023-10-03T10:13:42.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.589+0000 7ff196ffd700 1 -- 172.21.15.146:0/2080690298 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff1a00145e0 con 0x7ff1a8130ce0 2023-10-03T10:13:42.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.589+0000 7ff196ffd700 1 -- 172.21.15.146:0/2080690298 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff1a001ae50 con 0x7ff1a8130ce0 2023-10-03T10:13:42.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.589+0000 7ff1acc83700 1 -- 172.21.15.146:0/2080690298 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a809c910 con 0x7ff1a8130ce0 2023-10-03T10:13:42.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.598+0000 7ff196ffd700 1 -- 172.21.15.146:0/2080690298 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1a0045060 con 0x7ff1a8130ce0 2023-10-03T10:13:42.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.629+0000 7f48aa1d9700 1 Processor -- start 2023-10-03T10:13:42.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.629+0000 7f48aa1d9700 1 -- start start 2023-10-03T10:13:42.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.630+0000 7f48aa1d9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f48a409f430 0x7f48a4136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.630+0000 7f48aa1d9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a4137010 0x7f48a41393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.630+0000 7f48aa1d9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a409b6d0 con 0x7f48a409e950 2023-10-03T10:13:42.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.630+0000 7f48aa1d9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a409afb0 con 0x7f48a409f430 2023-10-03T10:13:42.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.630+0000 7f48aa1d9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a40a0970 con 0x7f48a4137010 2023-10-03T10:13:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.630+0000 7f48a3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a4137010 0x7f48a41393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.630+0000 7f48a3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a4137010 0x7f48a41393f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55472/0 (socket says 172.21.15.146:55472) 2023-10-03T10:13:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.630+0000 7f48a3fff700 1 -- 172.21.15.146:0/2166044463 learned_addr learned my addr 172.21.15.146:0/2166044463 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.630+0000 7f48a2ffd700 1 --2- 172.21.15.146:0/2166044463 >> v2:172.21.15.146:3300/0 conn(0x7f48a409f430 0x7f48a4136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.631+0000 7f48a3fff700 1 -- 172.21.15.146:0/2166044463 >> v2:172.21.15.146:3300/0 conn(0x7f48a409f430 msgr2=0x7f48a4136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.631+0000 7f48a3fff700 1 --2- 172.21.15.146:0/2166044463 >> v2:172.21.15.146:3300/0 conn(0x7f48a409f430 0x7f48a4136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.631+0000 7f48a3fff700 1 -- 172.21.15.146:0/2166044463 >> v1:172.21.15.146:6789/0 conn(0x7f48a409e950 legacy=0x7f48a409ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.631+0000 7f48a27fc700 1 -- 172.21.15.146:0/2166044463 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2470152930 0 0) 0x7f48a409b6d0 con 0x7f48a409e950 2023-10-03T10:13:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.631+0000 7f48a3fff700 1 -- 172.21.15.146:0/2166044463 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a40a0320 con 0x7f48a4137010 2023-10-03T10:13:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.631+0000 7f48a2ffd700 1 --2- 172.21.15.146:0/2166044463 >> v2:172.21.15.146:3300/0 conn(0x7f48a409f430 0x7f48a4136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:42.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.631+0000 7f48a3fff700 1 --2- 172.21.15.146:0/2166044463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a4137010 0x7f48a41393f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f489c009e50 tx=0x7f489c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bde9ab997875d03 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.631+0000 7f48a27fc700 1 -- 172.21.15.146:0/2166044463 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c00e070 con 0x7f48a4137010 2023-10-03T10:13:42.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.631+0000 7f48a27fc700 1 -- 172.21.15.146:0/2166044463 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c00b910 con 0x7f48a4137010 2023-10-03T10:13:42.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.631+0000 7f48a27fc700 1 -- 172.21.15.146:0/2166044463 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c00bcc0 con 0x7f48a4137010 2023-10-03T10:13:42.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.632+0000 7f48aa1d9700 1 -- 172.21.15.146:0/2166044463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a4137010 msgr2=0x7f48a41393f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.632+0000 7f48aa1d9700 1 --2- 172.21.15.146:0/2166044463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a4137010 0x7f48a41393f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f489c009e50 tx=0x7f489c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:42.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.632+0000 7f48aa1d9700 1 -- 172.21.15.146:0/2166044463 shutdown_connections 2023-10-03T10:13:42.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.632+0000 7f48aa1d9700 1 --2- 172.21.15.146:0/2166044463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a4137010 0x7f48a41393f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.632+0000 7f48aa1d9700 1 --2- 172.21.15.146:0/2166044463 >> v2:172.21.15.146:3300/0 conn(0x7f48a409f430 0x7f48a4136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.632+0000 7f48aa1d9700 1 -- 172.21.15.146:0/2166044463 >> 172.21.15.146:0/2166044463 conn(0x7f48a40a0f70 msgr2=0x7f48a40a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.632+0000 7f48aa1d9700 1 -- 172.21.15.146:0/2166044463 shutdown_connections 2023-10-03T10:13:42.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.632+0000 7f48aa1d9700 1 -- 172.21.15.146:0/2166044463 wait complete. 2023-10-03T10:13:42.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.633+0000 7f48aa1d9700 1 Processor -- start 2023-10-03T10:13:42.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.634+0000 7f48aa1d9700 1 -- start start 2023-10-03T10:13:42.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.634+0000 7f48aa1d9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48a409e950 0x7f48a4123100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.634+0000 7f48aa1d9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48a409f430 0x7f48a4121ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.634+0000 7f48aa1d9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a4137010 0x7f48a4121ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.634+0000 7f48aa1d9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a4120ed0 con 0x7f48a409f430 2023-10-03T10:13:42.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.634+0000 7f48aa1d9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a409da40 con 0x7f48a4137010 2023-10-03T10:13:42.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.634+0000 7f48aa1d9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48a40721b0 con 0x7f48a409e950 2023-10-03T10:13:42.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.634+0000 7f48a2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48a409f430 0x7f48a4121ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.635+0000 7f48a2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48a409f430 0x7f48a4121ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40874/0 (socket says 172.21.15.146:40874) 2023-10-03T10:13:42.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.635+0000 7f48a2ffd700 1 -- 172.21.15.146:0/3908958817 learned_addr learned my addr 172.21.15.146:0/3908958817 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:42.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.635+0000 7f48a37fe700 1 --2- 172.21.15.146:0/3908958817 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48a409e950 0x7f48a4123100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.635+0000 7f48a3fff700 1 --2- 172.21.15.146:0/3908958817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a4137010 0x7f48a4121ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.635+0000 7f48a2ffd700 1 -- 172.21.15.146:0/3908958817 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48a409e950 msgr2=0x7f48a4123100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.635+0000 7f48a2ffd700 1 --2- 172.21.15.146:0/3908958817 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48a409e950 0x7f48a4123100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.635+0000 7f48a2ffd700 1 -- 172.21.15.146:0/3908958817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a4137010 msgr2=0x7f48a4121ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.635+0000 7f48a2ffd700 1 --2- 172.21.15.146:0/3908958817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a4137010 0x7f48a4121ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.635+0000 7f48a2ffd700 1 -- 172.21.15.146:0/3908958817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48980094a0 con 0x7f48a409f430 2023-10-03T10:13:42.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.635+0000 7f48a3fff700 1 --2- 172.21.15.146:0/3908958817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a4137010 0x7f48a4121ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:42.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.635+0000 7f48a2ffd700 1 --2- 172.21.15.146:0/3908958817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48a409f430 0x7f48a4121ab0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f489800ebe0 tx=0x7f489800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.635+0000 7f488bfff700 1 -- 172.21.15.146:0/3908958817 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4898009800 con 0x7f48a409f430 2023-10-03T10:13:42.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.635+0000 7f488bfff700 1 -- 172.21.15.146:0/3908958817 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489800c910 con 0x7f48a409f430 2023-10-03T10:13:42.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.635+0000 7f48aa1d9700 1 -- 172.21.15.146:0/3908958817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489c009b30 con 0x7f48a409f430 2023-10-03T10:13:42.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.635+0000 7f488bfff700 1 -- 172.21.15.146:0/3908958817 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489800cc80 con 0x7f48a409f430 2023-10-03T10:13:42.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.635+0000 7f48aa1d9700 1 -- 172.21.15.146:0/3908958817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a4123640 con 0x7f48a409f430 2023-10-03T10:13:42.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.637+0000 7f488bfff700 1 -- 172.21.15.146:0/3908958817 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4898013470 con 0x7f48a409f430 2023-10-03T10:13:42.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.637+0000 7f48aa1d9700 1 -- 172.21.15.146:0/3908958817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a404f2a0 con 0x7f48a409f430 2023-10-03T10:13:42.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.637+0000 7f488bfff700 1 -- 172.21.15.146:0/3908958817 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f489803fbc0 con 0x7f48a409f430 2023-10-03T10:13:42.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.646+0000 7f488bfff700 1 -- 172.21.15.146:0/3908958817 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4898013720 con 0x7f48a409f430 2023-10-03T10:13:42.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.665+0000 7fddc3115700 1 Processor -- start 2023-10-03T10:13:42.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.665+0000 7fddc3115700 1 -- start start 2023-10-03T10:13:42.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.666+0000 7fddc3115700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fddbc1350d0 0x7fddbc13ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.666+0000 7fddc3115700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddbc13d210 0x7fddbc13f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.666+0000 7fddc3115700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddbc09eca0 con 0x7fddbc06a770 2023-10-03T10:13:42.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.666+0000 7fddc3115700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc06b2e0 con 0x7fddbc13d210 2023-10-03T10:13:42.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.666+0000 7fddc3115700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc09f720 con 0x7fddbc1350d0 2023-10-03T10:13:42.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.666+0000 7fddc0eb1700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fddbc06a770 0x7fddbc1349c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36052/0 (socket says 172.21.15.146:36052) 2023-10-03T10:13:42.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.666+0000 7fddc0eb1700 1 -- 172.21.15.146:0/4095421396 learned_addr learned my addr 172.21.15.146:0/4095421396 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:42.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.666+0000 7fddc16b2700 1 --2- 172.21.15.146:0/4095421396 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddbc13d210 0x7fddbc13f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.666+0000 7fddbbfff700 1 --2- 172.21.15.146:0/4095421396 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fddbc1350d0 0x7fddbc13ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.666+0000 7fddbb7fe700 1 -- 172.21.15.146:0/4095421396 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635903178 0 0) 0x7fddbc09eca0 con 0x7fddbc06a770 2023-10-03T10:13:42.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.666+0000 7fddbb7fe700 1 -- 172.21.15.146:0/4095421396 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddac0035b0 con 0x7fddbc06a770 2023-10-03T10:13:42.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.667+0000 7fddbbfff700 1 -- 172.21.15.146:0/4095421396 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddbc13d210 msgr2=0x7fddbc13f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:42.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.667+0000 7fddbbfff700 1 --2- 172.21.15.146:0/4095421396 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddbc13d210 0x7fddbc13f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.667+0000 7fddbbfff700 1 -- 172.21.15.146:0/4095421396 >> v1:172.21.15.146:6789/0 conn(0x7fddbc06a770 legacy=0x7fddbc1349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.667+0000 7fddbbfff700 1 -- 172.21.15.146:0/4095421396 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddbc06b480 con 0x7fddbc1350d0 2023-10-03T10:13:42.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.667+0000 7fddbbfff700 1 --2- 172.21.15.146:0/4095421396 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fddbc1350d0 0x7fddbc13ccd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdda80098a0 tx=0x7fdda8009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2af878b591d09d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.667+0000 7fddbb7fe700 1 -- 172.21.15.146:0/4095421396 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda8011830 con 0x7fddbc1350d0 2023-10-03T10:13:42.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.667+0000 7fddbb7fe700 1 -- 172.21.15.146:0/4095421396 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda8011990 con 0x7fddbc1350d0 2023-10-03T10:13:42.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.667+0000 7fddbb7fe700 1 -- 172.21.15.146:0/4095421396 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda8011d20 con 0x7fddbc1350d0 2023-10-03T10:13:42.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.668+0000 7fddc3115700 1 -- 172.21.15.146:0/4095421396 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fddbc1350d0 msgr2=0x7fddbc13ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.668+0000 7fddc3115700 1 --2- 172.21.15.146:0/4095421396 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fddbc1350d0 0x7fddbc13ccd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdda80098a0 tx=0x7fdda8009bb0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.668+0000 7fddc3115700 1 -- 172.21.15.146:0/4095421396 shutdown_connections 2023-10-03T10:13:42.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.668+0000 7fddc3115700 1 --2- 172.21.15.146:0/4095421396 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddbc13d210 0x7fddbc13f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.668+0000 7fddc3115700 1 --2- 172.21.15.146:0/4095421396 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fddbc1350d0 0x7fddbc13ccd0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.668+0000 7fddc3115700 1 -- 172.21.15.146:0/4095421396 >> 172.21.15.146:0/4095421396 conn(0x7fddbc099c40 msgr2=0x7fddbc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.668+0000 7fddc3115700 1 -- 172.21.15.146:0/4095421396 shutdown_connections 2023-10-03T10:13:42.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.668+0000 7fddc3115700 1 -- 172.21.15.146:0/4095421396 wait complete. 2023-10-03T10:13:42.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.669+0000 7fddc3115700 1 Processor -- start 2023-10-03T10:13:42.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.669+0000 7fddc3115700 1 -- start start 2023-10-03T10:13:42.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.670+0000 7fddc3115700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc06a770 0x7fddbc1ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.670+0000 7fddc3115700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddbc1350d0 0x7fddbc1cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.670+0000 7fddc3115700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fddbc13d210 0x7fddbc1cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.670+0000 7fddc3115700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc13bfe0 con 0x7fddbc06a770 2023-10-03T10:13:42.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.670+0000 7fddc3115700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc13a020 con 0x7fddbc1350d0 2023-10-03T10:13:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.670+0000 7fddc3115700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc11c9b0 con 0x7fddbc13d210 2023-10-03T10:13:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.670+0000 7fddc0eb1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc06a770 0x7fddbc1ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.670+0000 7fddc0eb1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc06a770 0x7fddbc1ccdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40888/0 (socket says 172.21.15.146:40888) 2023-10-03T10:13:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.670+0000 7fddc0eb1700 1 -- 172.21.15.146:0/3127249095 learned_addr learned my addr 172.21.15.146:0/3127249095 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.670+0000 7fddbbfff700 1 --2- 172.21.15.146:0/3127249095 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddbc1350d0 0x7fddbc1cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.670+0000 7fddc16b2700 1 --2- 172.21.15.146:0/3127249095 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fddbc13d210 0x7fddbc1cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.671+0000 7fddc16b2700 1 -- 172.21.15.146:0/3127249095 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddbc1350d0 msgr2=0x7fddbc1cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.671+0000 7fddc16b2700 1 --2- 172.21.15.146:0/3127249095 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddbc1350d0 0x7fddbc1cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.671+0000 7fddc16b2700 1 -- 172.21.15.146:0/3127249095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc06a770 msgr2=0x7fddbc1ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.671+0000 7fddc16b2700 1 --2- 172.21.15.146:0/3127249095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc06a770 0x7fddbc1ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.671+0000 7fddc16b2700 1 -- 172.21.15.146:0/3127249095 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda80094a0 con 0x7fddbc13d210 2023-10-03T10:13:42.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.671+0000 7fddc0eb1700 1 --2- 172.21.15.146:0/3127249095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc06a770 0x7fddbc1ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:42.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.671+0000 7fddc16b2700 1 --2- 172.21.15.146:0/3127249095 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fddbc13d210 0x7fddbc1cd840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fddb4009d90 tx=0x7fddb400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.671+0000 7fddb97fa700 1 -- 172.21.15.146:0/3127249095 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb4009c00 con 0x7fddbc13d210 2023-10-03T10:13:42.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.671+0000 7fddb97fa700 1 -- 172.21.15.146:0/3127249095 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb400f040 con 0x7fddbc13d210 2023-10-03T10:13:42.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.671+0000 7fddc3115700 1 -- 172.21.15.146:0/3127249095 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddbc09b0f0 con 0x7fddbc13d210 2023-10-03T10:13:42.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.671+0000 7fddb97fa700 1 -- 172.21.15.146:0/3127249095 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb4014480 con 0x7fddbc13d210 2023-10-03T10:13:42.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.672+0000 7fddb97fa700 1 -- 172.21.15.146:0/3127249095 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fddb40145e0 con 0x7fddbc13d210 2023-10-03T10:13:42.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.672+0000 7fddc3115700 1 -- 172.21.15.146:0/3127249095 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddbc139cd0 con 0x7fddbc13d210 2023-10-03T10:13:42.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.673+0000 7fddb97fa700 1 -- 172.21.15.146:0/3127249095 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fddb401c570 con 0x7fddbc13d210 2023-10-03T10:13:42.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.673+0000 7fddc3115700 1 -- 172.21.15.146:0/3127249095 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddbc0a3e60 con 0x7fddbc13d210 2023-10-03T10:13:42.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.682+0000 7fddb97fa700 1 -- 172.21.15.146:0/3127249095 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fddb4018030 con 0x7fddbc13d210 2023-10-03T10:13:42.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.787+0000 7fdccb8b3700 1 -- 172.21.15.146:0/1086994359 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdcc406bce0 con 0x7fdcc40a08e0 2023-10-03T10:13:42.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.787+0000 7fdcb9ffb700 1 -- 172.21.15.146:0/1086994359 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdcc0013720 con 0x7fdcc40a08e0 2023-10-03T10:13:42.787 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:42.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.789+0000 7fdccb8b3700 1 -- 172.21.15.146:0/1086994359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcc40a08e0 msgr2=0x7fdcc41371a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.789+0000 7fdccb8b3700 1 --2- 172.21.15.146:0/1086994359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcc40a08e0 0x7fdcc41371a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000e9c0 tx=0x7fdcc000ed80 comp rx=0 tx=0).stop 2023-10-03T10:13:42.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.789+0000 7fdccb8b3700 1 -- 172.21.15.146:0/1086994359 shutdown_connections 2023-10-03T10:13:42.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.789+0000 7fdccb8b3700 1 --2- 172.21.15.146:0/1086994359 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdcc4138040 0x7fdcc4135ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.789+0000 7fdccb8b3700 1 --2- 172.21.15.146:0/1086994359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcc40a08e0 0x7fdcc41371a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.789+0000 7fdccb8b3700 1 --2- 172.21.15.146:0/1086994359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcc40a1400 0x7fdcc4135990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.789+0000 7fdccb8b3700 1 -- 172.21.15.146:0/1086994359 >> 172.21.15.146:0/1086994359 conn(0x7fdcc40a2980 msgr2=0x7fdcc409e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.789+0000 7fdccb8b3700 1 -- 172.21.15.146:0/1086994359 shutdown_connections 2023-10-03T10:13:42.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.789+0000 7fdccb8b3700 1 -- 172.21.15.146:0/1086994359 wait complete. 2023-10-03T10:13:42.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:42.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.818+0000 7ff1acc83700 1 -- 172.21.15.146:0/2080690298 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff1a811bde0 con 0x7ff1a8130ce0 2023-10-03T10:13:42.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.818+0000 7ff196ffd700 1 -- 172.21.15.146:0/2080690298 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff1a0018020 con 0x7ff1a8130ce0 2023-10-03T10:13:42.818 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:42.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.820+0000 7ff1acc83700 1 -- 172.21.15.146:0/2080690298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1a8130ce0 msgr2=0x7ff1a811fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.820+0000 7ff1acc83700 1 --2- 172.21.15.146:0/2080690298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1a8130ce0 0x7ff1a811fb10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009d90 tx=0x7ff1a000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.820+0000 7ff1acc83700 1 -- 172.21.15.146:0/2080690298 shutdown_connections 2023-10-03T10:13:42.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.820+0000 7ff1acc83700 1 --2- 172.21.15.146:0/2080690298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1a8130ce0 0x7ff1a811fb10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.820+0000 7ff1acc83700 1 --2- 172.21.15.146:0/2080690298 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1a809d860 0x7ff1a811f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.820+0000 7ff1acc83700 1 --2- 172.21.15.146:0/2080690298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1a809e170 0x7ff1a811f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.820+0000 7ff1acc83700 1 -- 172.21.15.146:0/2080690298 >> 172.21.15.146:0/2080690298 conn(0x7ff1a8099c40 msgr2=0x7ff1a8072340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.820+0000 7ff1acc83700 1 -- 172.21.15.146:0/2080690298 shutdown_connections 2023-10-03T10:13:42.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.820+0000 7ff1acc83700 1 -- 172.21.15.146:0/2080690298 wait complete. 2023-10-03T10:13:42.832 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:42.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.847+0000 7f48aa1d9700 1 -- 172.21.15.146:0/3908958817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f48a4120a50 con 0x7f48a409f430 2023-10-03T10:13:42.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.847+0000 7f488bfff700 1 -- 172.21.15.146:0/3908958817 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f48a4120a50 con 0x7f48a409f430 2023-10-03T10:13:42.847 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:42.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.849+0000 7f48aa1d9700 1 -- 172.21.15.146:0/3908958817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48a409f430 msgr2=0x7f48a4121ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.849+0000 7f48aa1d9700 1 --2- 172.21.15.146:0/3908958817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48a409f430 0x7f48a4121ab0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f489800ebe0 tx=0x7f489800eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.849+0000 7f48aa1d9700 1 -- 172.21.15.146:0/3908958817 shutdown_connections 2023-10-03T10:13:42.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.849+0000 7f48aa1d9700 1 --2- 172.21.15.146:0/3908958817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a4137010 0x7f48a4121ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.849+0000 7f48aa1d9700 1 --2- 172.21.15.146:0/3908958817 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48a409e950 0x7f48a4123100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.849+0000 7f48aa1d9700 1 --2- 172.21.15.146:0/3908958817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48a409f430 0x7f48a4121ab0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.849+0000 7f48aa1d9700 1 -- 172.21.15.146:0/3908958817 >> 172.21.15.146:0/3908958817 conn(0x7f48a40a0f70 msgr2=0x7f48a40a1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.849+0000 7f48aa1d9700 1 -- 172.21.15.146:0/3908958817 shutdown_connections 2023-10-03T10:13:42.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.849+0000 7f48aa1d9700 1 -- 172.21.15.146:0/3908958817 wait complete. 2023-10-03T10:13:42.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:42.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.900+0000 7fddc3115700 1 -- 172.21.15.146:0/3127249095 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fddbc04f2a0 con 0x7fddbc13d210 2023-10-03T10:13:42.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.901+0000 7fddb97fa700 1 -- 172.21.15.146:0/3127249095 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fddb40076f0 con 0x7fddbc13d210 2023-10-03T10:13:42.900 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:42.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.903+0000 7fddc3115700 1 -- 172.21.15.146:0/3127249095 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fddbc13d210 msgr2=0x7fddbc1cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.903+0000 7fddc3115700 1 --2- 172.21.15.146:0/3127249095 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fddbc13d210 0x7fddbc1cd840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fddb4009d90 tx=0x7fddb400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.903+0000 7fddc3115700 1 -- 172.21.15.146:0/3127249095 shutdown_connections 2023-10-03T10:13:42.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.903+0000 7fddc3115700 1 --2- 172.21.15.146:0/3127249095 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fddbc13d210 0x7fddbc1cd840 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.903+0000 7fddc3115700 1 --2- 172.21.15.146:0/3127249095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc06a770 0x7fddbc1ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.903+0000 7fddc3115700 1 --2- 172.21.15.146:0/3127249095 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fddbc1350d0 0x7fddbc1cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.903+0000 7fddc3115700 1 -- 172.21.15.146:0/3127249095 >> 172.21.15.146:0/3127249095 conn(0x7fddbc099c40 msgr2=0x7fddbc13d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.903+0000 7fddc3115700 1 -- 172.21.15.146:0/3127249095 shutdown_connections 2023-10-03T10:13:42.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:42.903+0000 7fddc3115700 1 -- 172.21.15.146:0/3127249095 wait complete. 2023-10-03T10:13:42.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:43.807 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:43.833 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:43.862 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:43.915 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.948+0000 7f1a8efc5700 1 Processor -- start 2023-10-03T10:13:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.948+0000 7f1a8efc5700 1 -- start start 2023-10-03T10:13:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.949+0000 7f1a8efc5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a880a0a30 0x7f1a880a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.949+0000 7f1a8efc5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a88130670 0x7f1a881381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.949+0000 7f1a8efc5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a880a1e70 con 0x7f1a880a1340 2023-10-03T10:13:43.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.949+0000 7f1a8efc5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8809a720 con 0x7f1a880a0a30 2023-10-03T10:13:43.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.949+0000 7f1a8efc5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8809b300 con 0x7f1a88130670 2023-10-03T10:13:43.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.949+0000 7f1a8cd61700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a880a0a30 0x7f1a880a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.949+0000 7f1a8d562700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a88130670 0x7f1a881381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.949+0000 7f1a8cd61700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a880a0a30 0x7f1a880a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55506/0 (socket says 172.21.15.146:55506) 2023-10-03T10:13:43.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.949+0000 7f1a8d562700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a88130670 0x7f1a881381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56380/0 (socket says 172.21.15.146:56380) 2023-10-03T10:13:43.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.949+0000 7f1a8cd61700 1 -- 172.21.15.146:0/3433541471 learned_addr learned my addr 172.21.15.146:0/3433541471 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:43.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.950+0000 7f1a8d562700 1 -- 172.21.15.146:0/3433541471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a880a0a30 msgr2=0x7f1a880a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:43.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.950+0000 7f1a8d562700 1 --2- 172.21.15.146:0/3433541471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a880a0a30 0x7f1a880a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.950+0000 7f1a8d562700 1 -- 172.21.15.146:0/3433541471 >> v1:172.21.15.146:6789/0 conn(0x7f1a880a1340 legacy=0x7f1a8812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.950+0000 7f1a8d562700 1 -- 172.21.15.146:0/3433541471 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8809abc0 con 0x7f1a88130670 2023-10-03T10:13:43.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.950+0000 7f1a8d562700 1 --2- 172.21.15.146:0/3433541471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a88130670 0x7f1a881381c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1a80009dc0 tx=0x7f1a8000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b12dde15afe9f5a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.950+0000 7f1a877fe700 1 -- 172.21.15.146:0/3433541471 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8000e070 con 0x7f1a88130670 2023-10-03T10:13:43.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.950+0000 7f1a877fe700 1 -- 172.21.15.146:0/3433541471 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8000bb20 con 0x7f1a88130670 2023-10-03T10:13:43.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.950+0000 7f1a877fe700 1 -- 172.21.15.146:0/3433541471 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a80012430 con 0x7f1a88130670 2023-10-03T10:13:43.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.951+0000 7f1a8efc5700 1 -- 172.21.15.146:0/3433541471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a88130670 msgr2=0x7f1a881381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.951+0000 7f1a8efc5700 1 --2- 172.21.15.146:0/3433541471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a88130670 0x7f1a881381c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1a80009dc0 tx=0x7f1a8000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:43.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.951+0000 7f1a8efc5700 1 -- 172.21.15.146:0/3433541471 shutdown_connections 2023-10-03T10:13:43.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.951+0000 7f1a8efc5700 1 --2- 172.21.15.146:0/3433541471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a88130670 0x7f1a881381c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.951+0000 7f1a8efc5700 1 --2- 172.21.15.146:0/3433541471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a880a0a30 0x7f1a880a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.951+0000 7f1a8efc5700 1 -- 172.21.15.146:0/3433541471 >> 172.21.15.146:0/3433541471 conn(0x7f1a880a2980 msgr2=0x7f1a880a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.951+0000 7f1a8efc5700 1 -- 172.21.15.146:0/3433541471 shutdown_connections 2023-10-03T10:13:43.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.951+0000 7f1a8efc5700 1 -- 172.21.15.146:0/3433541471 wait complete. 2023-10-03T10:13:43.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.953+0000 7f1a8efc5700 1 Processor -- start 2023-10-03T10:13:43.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.953+0000 7f1a8efc5700 1 -- start start 2023-10-03T10:13:43.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.954+0000 7f1a8efc5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a880a0a30 0x7f1a8811a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.954+0000 7f1a8efc5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a880a1340 0x7f1a8811acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.954+0000 7f1a8efc5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a88130670 0x7f1a881c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.954+0000 7f1a8efc5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8809ae00 con 0x7f1a880a1340 2023-10-03T10:13:43.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.954+0000 7f1a8efc5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8809fde0 con 0x7f1a880a0a30 2023-10-03T10:13:43.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.954+0000 7f1a8efc5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a88120ef0 con 0x7f1a88130670 2023-10-03T10:13:43.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.954+0000 7f1a8cd61700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a880a0a30 0x7f1a8811a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.954+0000 7f1a8cd61700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a880a0a30 0x7f1a8811a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55516/0 (socket says 172.21.15.146:55516) 2023-10-03T10:13:43.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.954+0000 7f1a8cd61700 1 -- 172.21.15.146:0/3001536756 learned_addr learned my addr 172.21.15.146:0/3001536756 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:43.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.954+0000 7f1a87fff700 1 --2- 172.21.15.146:0/3001536756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a880a1340 0x7f1a8811acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.954+0000 7f1a8d562700 1 --2- 172.21.15.146:0/3001536756 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a88130670 0x7f1a881c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.954+0000 7f1a8cd61700 1 -- 172.21.15.146:0/3001536756 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a88130670 msgr2=0x7f1a881c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.954+0000 7f1a8cd61700 1 --2- 172.21.15.146:0/3001536756 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a88130670 0x7f1a881c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.954+0000 7f1a8cd61700 1 -- 172.21.15.146:0/3001536756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a880a1340 msgr2=0x7f1a8811acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.954+0000 7f1a8cd61700 1 --2- 172.21.15.146:0/3001536756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a880a1340 0x7f1a8811acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.954+0000 7f1a8cd61700 1 -- 172.21.15.146:0/3001536756 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a80009a70 con 0x7f1a880a0a30 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.955+0000 7f1a8cd61700 1 --2- 172.21.15.146:0/3001536756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a880a0a30 0x7f1a8811a790 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00e8e0 tx=0x7f1a7c00ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.955+0000 7f1a857fa700 1 -- 172.21.15.146:0/3001536756 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c010820 con 0x7f1a880a0a30 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.955+0000 7f1a857fa700 1 -- 172.21.15.146:0/3001536756 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7c010980 con 0x7f1a880a0a30 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.955+0000 7f1a8efc5700 1 -- 172.21.15.146:0/3001536756 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8811a310 con 0x7f1a880a0a30 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.955+0000 7f1a857fa700 1 -- 172.21.15.146:0/3001536756 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c010cf0 con 0x7f1a880a0a30 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.955+0000 7f1a8efc5700 1 -- 172.21.15.146:0/3001536756 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a88122580 con 0x7f1a880a0a30 2023-10-03T10:13:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.956+0000 7f1a857fa700 1 -- 172.21.15.146:0/3001536756 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a7c0113f0 con 0x7f1a880a0a30 2023-10-03T10:13:43.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.956+0000 7f1a857fa700 1 -- 172.21.15.146:0/3001536756 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1a7c015030 con 0x7f1a880a0a30 2023-10-03T10:13:43.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.956+0000 7f1a8efc5700 1 -- 172.21.15.146:0/3001536756 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8804f2a0 con 0x7f1a880a0a30 2023-10-03T10:13:43.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.961+0000 7f1a857fa700 1 -- 172.21.15.146:0/3001536756 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a7c0116a0 con 0x7f1a880a0a30 2023-10-03T10:13:43.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.997+0000 7fc84f40b700 1 Processor -- start 2023-10-03T10:13:43.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.997+0000 7fc84f40b700 1 -- start start 2023-10-03T10:13:43.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.998+0000 7fc84f40b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc848133900 0x7fc848133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.998+0000 7fc84f40b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8480a10b0 0x7fc84813b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.998+0000 7fc84f40b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc84809a760 con 0x7fc848134210 2023-10-03T10:13:43.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.998+0000 7fc84f40b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8481336e0 con 0x7fc848133900 2023-10-03T10:13:43.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.998+0000 7fc84f40b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84809a080 con 0x7fc8480a10b0 2023-10-03T10:13:43.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.998+0000 7fc84d9a8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8480a10b0 0x7fc84813b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.998+0000 7fc84d9a8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8480a10b0 0x7fc84813b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55518/0 (socket says 172.21.15.146:55518) 2023-10-03T10:13:43.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.998+0000 7fc84d1a7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc848133900 0x7fc848133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.998+0000 7fc84d9a8700 1 -- 172.21.15.146:0/2714947057 learned_addr learned my addr 172.21.15.146:0/2714947057 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:43.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.998+0000 7fc84d9a8700 1 -- 172.21.15.146:0/2714947057 >> v2:172.21.15.146:3300/0 conn(0x7fc848133900 msgr2=0x7fc848133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:43.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.998+0000 7fc84d9a8700 1 --2- 172.21.15.146:0/2714947057 >> v2:172.21.15.146:3300/0 conn(0x7fc848133900 0x7fc848133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.998+0000 7fc84d9a8700 1 -- 172.21.15.146:0/2714947057 >> v1:172.21.15.146:6789/0 conn(0x7fc848134210 legacy=0x7fc8480a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.998+0000 7fc84d9a8700 1 -- 172.21.15.146:0/2714947057 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8480a23e0 con 0x7fc8480a10b0 2023-10-03T10:13:43.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.998+0000 7fc84d1a7700 1 --2- 172.21.15.146:0/2714947057 >> v2:172.21.15.146:3300/0 conn(0x7fc848133900 0x7fc848133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:43.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.999+0000 7fc84d9a8700 1 --2- 172.21.15.146:0/2714947057 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8480a10b0 0x7fc84813b910 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc840009e50 tx=0x7fc84000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcc49fd52ea34309 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.999+0000 7fc83ffff700 1 -- 172.21.15.146:0/2714947057 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84000e070 con 0x7fc8480a10b0 2023-10-03T10:13:44.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.999+0000 7fc83ffff700 1 -- 172.21.15.146:0/2714947057 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84000b910 con 0x7fc8480a10b0 2023-10-03T10:13:44.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:43.999+0000 7fc83ffff700 1 -- 172.21.15.146:0/2714947057 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84000bcc0 con 0x7fc8480a10b0 2023-10-03T10:13:44.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.000+0000 7fc84f40b700 1 -- 172.21.15.146:0/2714947057 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8480a10b0 msgr2=0x7fc84813b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.000+0000 7fc84f40b700 1 --2- 172.21.15.146:0/2714947057 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8480a10b0 0x7fc84813b910 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc840009e50 tx=0x7fc84000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:44.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.000+0000 7fc84f40b700 1 -- 172.21.15.146:0/2714947057 shutdown_connections 2023-10-03T10:13:44.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.000+0000 7fc84f40b700 1 --2- 172.21.15.146:0/2714947057 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8480a10b0 0x7fc84813b910 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.000+0000 7fc84f40b700 1 --2- 172.21.15.146:0/2714947057 >> v2:172.21.15.146:3300/0 conn(0x7fc848133900 0x7fc848133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.000+0000 7fc84f40b700 1 -- 172.21.15.146:0/2714947057 >> 172.21.15.146:0/2714947057 conn(0x7fc8480a2980 msgr2=0x7fc8480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.000+0000 7fc84f40b700 1 -- 172.21.15.146:0/2714947057 shutdown_connections 2023-10-03T10:13:44.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.000+0000 7fc84f40b700 1 -- 172.21.15.146:0/2714947057 wait complete. 2023-10-03T10:13:44.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.001+0000 7fc84f40b700 1 Processor -- start 2023-10-03T10:13:44.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.001+0000 7fc84f40b700 1 -- start start 2023-10-03T10:13:44.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.002+0000 7fc84f40b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8480a10b0 0x7fc84811c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.002+0000 7fc84f40b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc848133900 0x7fc84811ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.002+0000 7fc84f40b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc848134210 0x7fc84811d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.002+0000 7fc84f40b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84811dba0 con 0x7fc848133900 2023-10-03T10:13:44.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.002+0000 7fc84f40b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84811e310 con 0x7fc8480a10b0 2023-10-03T10:13:44.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.002+0000 7fc84f40b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc84809a2c0 con 0x7fc848134210 2023-10-03T10:13:44.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.002+0000 7fc84d1a7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8480a10b0 0x7fc84811c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.002+0000 7fc84d1a7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8480a10b0 0x7fc84811c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55524/0 (socket says 172.21.15.146:55524) 2023-10-03T10:13:44.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.002+0000 7fc84d1a7700 1 -- 172.21.15.146:0/2322687611 learned_addr learned my addr 172.21.15.146:0/2322687611 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:44.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.002+0000 7fc84d9a8700 1 --2- 172.21.15.146:0/2322687611 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc848134210 0x7fc84811d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.002+0000 7fc84c9a6700 1 --2- 172.21.15.146:0/2322687611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc848133900 0x7fc84811ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.003+0000 7fc84d9a8700 1 -- 172.21.15.146:0/2322687611 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8480a10b0 msgr2=0x7fc84811c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.003+0000 7fc84d9a8700 1 --2- 172.21.15.146:0/2322687611 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8480a10b0 0x7fc84811c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.003+0000 7fc84d9a8700 1 -- 172.21.15.146:0/2322687611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc848133900 msgr2=0x7fc84811ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.003+0000 7fc84d9a8700 1 --2- 172.21.15.146:0/2322687611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc848133900 0x7fc84811ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.003+0000 7fc84d9a8700 1 -- 172.21.15.146:0/2322687611 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc844009430 con 0x7fc848134210 2023-10-03T10:13:44.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.003+0000 7fc84d9a8700 1 --2- 172.21.15.146:0/2322687611 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc848134210 0x7fc84811d200 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc840015000 tx=0x7fc840004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.003+0000 7fc83dffb700 1 -- 172.21.15.146:0/2322687611 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc840004800 con 0x7fc848134210 2023-10-03T10:13:44.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.003+0000 7fc83dffb700 1 -- 172.21.15.146:0/2322687611 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc840004960 con 0x7fc848134210 2023-10-03T10:13:44.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.003+0000 7fc84f40b700 1 -- 172.21.15.146:0/2322687611 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc840009b30 con 0x7fc848134210 2023-10-03T10:13:44.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.003+0000 7fc83dffb700 1 -- 172.21.15.146:0/2322687611 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84001c660 con 0x7fc848134210 2023-10-03T10:13:44.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.003+0000 7fc84f40b700 1 -- 172.21.15.146:0/2322687611 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84811ff90 con 0x7fc848134210 2023-10-03T10:13:44.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.004+0000 7fc83dffb700 1 -- 172.21.15.146:0/2322687611 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc84001c7c0 con 0x7fc848134210 2023-10-03T10:13:44.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.004+0000 7fc83dffb700 1 -- 172.21.15.146:0/2322687611 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc840040d10 con 0x7fc848134210 2023-10-03T10:13:44.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.005+0000 7fc84f40b700 1 -- 172.21.15.146:0/2322687611 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84811ff90 con 0x7fc848134210 2023-10-03T10:13:44.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.009+0000 7fc83dffb700 1 -- 172.21.15.146:0/2322687611 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc84811ff90 con 0x7fc848134210 2023-10-03T10:13:44.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.032+0000 7f63c8779700 1 Processor -- start 2023-10-03T10:13:44.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.032+0000 7f63c8779700 1 -- start start 2023-10-03T10:13:44.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.033+0000 7f63c8779700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f63c0133ad0 0x7f63c0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.033+0000 7f63c8779700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63c01300a0 0x7f63c01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.033+0000 7f63c8779700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63c01309f0 0x7f63c013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.033+0000 7f63c8779700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c006b2d0 con 0x7f63c01300a0 2023-10-03T10:13:44.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.033+0000 7f63c8779700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c0133610 con 0x7f63c01309f0 2023-10-03T10:13:44.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.033+0000 7f63c8779700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63c009a500 con 0x7f63c0133ad0 2023-10-03T10:13:44.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.033+0000 7f63c5d14700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63c01300a0 0x7f63c01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.033+0000 7f63c6515700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f63c0133ad0 0x7f63c0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.033+0000 7f63c5d14700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63c01300a0 0x7f63c01304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40926/0 (socket says 172.21.15.146:40926) 2023-10-03T10:13:44.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.033+0000 7f63c5d14700 1 -- 172.21.15.146:0/3198331154 learned_addr learned my addr 172.21.15.146:0/3198331154 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:44.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.033+0000 7f63c6d16700 1 --2- 172.21.15.146:0/3198331154 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63c01309f0 0x7f63c013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.033+0000 7f63c6515700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f63c0133ad0 0x7f63c0133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56392/0 (socket says 172.21.15.146:56392) 2023-10-03T10:13:44.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.034+0000 7f63c5d14700 1 -- 172.21.15.146:0/3198331154 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f63c0133ad0 msgr2=0x7f63c0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:44.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.034+0000 7f63c5d14700 1 --2- 172.21.15.146:0/3198331154 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f63c0133ad0 0x7f63c0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.034+0000 7f63c5d14700 1 -- 172.21.15.146:0/3198331154 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63c01309f0 msgr2=0x7f63c013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:44.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.034+0000 7f63c5d14700 1 --2- 172.21.15.146:0/3198331154 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63c01309f0 0x7f63c013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.034+0000 7f63c5d14700 1 -- 172.21.15.146:0/3198331154 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c01338b0 con 0x7f63c01300a0 2023-10-03T10:13:44.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.034+0000 7f63c5d14700 1 --2- 172.21.15.146:0/3198331154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63c01300a0 0x7f63c01304b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f63b00098f0 tx=0x7f63b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17eaa0c6fa18a8b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.034+0000 7f63c5513700 1 -- 172.21.15.146:0/3198331154 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b0011830 con 0x7f63c01300a0 2023-10-03T10:13:44.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.034+0000 7f63c5513700 1 -- 172.21.15.146:0/3198331154 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b0011990 con 0x7f63c01300a0 2023-10-03T10:13:44.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.034+0000 7f63c5513700 1 -- 172.21.15.146:0/3198331154 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b0011d20 con 0x7f63c01300a0 2023-10-03T10:13:44.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.035+0000 7f63c8779700 1 -- 172.21.15.146:0/3198331154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63c01300a0 msgr2=0x7f63c01304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.035+0000 7f63c8779700 1 --2- 172.21.15.146:0/3198331154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63c01300a0 0x7f63c01304b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f63b00098f0 tx=0x7f63b0009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:44.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.035+0000 7f63c8779700 1 -- 172.21.15.146:0/3198331154 shutdown_connections 2023-10-03T10:13:44.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.035+0000 7f63c8779700 1 --2- 172.21.15.146:0/3198331154 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63c01309f0 0x7f63c013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.035+0000 7f63c8779700 1 --2- 172.21.15.146:0/3198331154 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f63c0133ad0 0x7f63c0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.035+0000 7f63c8779700 1 --2- 172.21.15.146:0/3198331154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63c01300a0 0x7f63c01304b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.035+0000 7f63c8779700 1 -- 172.21.15.146:0/3198331154 >> 172.21.15.146:0/3198331154 conn(0x7f63c0099c40 msgr2=0x7f63c00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.035+0000 7f63c8779700 1 -- 172.21.15.146:0/3198331154 shutdown_connections 2023-10-03T10:13:44.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.035+0000 7f63c8779700 1 -- 172.21.15.146:0/3198331154 wait complete. 2023-10-03T10:13:44.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.036+0000 7f63c8779700 1 Processor -- start 2023-10-03T10:13:44.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.036+0000 7f63c8779700 1 -- start start 2023-10-03T10:13:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.037+0000 7f63c8779700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63c01300a0 0x7f63c011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.037+0000 7f63c8779700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63c01309f0 0x7f63c011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.037+0000 7f63c8779700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f63c0133ad0 0x7f63c011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.037+0000 7f63c8779700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c011f5b0 con 0x7f63c01300a0 2023-10-03T10:13:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.037+0000 7f63c8779700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c012f800 con 0x7f63c01309f0 2023-10-03T10:13:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.037+0000 7f63c8779700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63c012dd00 con 0x7f63c0133ad0 2023-10-03T10:13:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.037+0000 7f63c6d16700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f63c0133ad0 0x7f63c011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.037+0000 7f63c5d14700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63c01309f0 0x7f63c011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.037+0000 7f63c6d16700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f63c0133ad0 0x7f63c011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56394/0 (socket says 172.21.15.146:56394) 2023-10-03T10:13:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.037+0000 7f63c6d16700 1 -- 172.21.15.146:0/2227624664 learned_addr learned my addr 172.21.15.146:0/2227624664 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.037+0000 7f63c6515700 1 --2- 172.21.15.146:0/2227624664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63c01300a0 0x7f63c011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.038+0000 7f63c6d16700 1 -- 172.21.15.146:0/2227624664 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63c01309f0 msgr2=0x7f63c011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.038+0000 7f63c6d16700 1 --2- 172.21.15.146:0/2227624664 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63c01309f0 0x7f63c011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.038+0000 7f63c6d16700 1 -- 172.21.15.146:0/2227624664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63c01300a0 msgr2=0x7f63c011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.038+0000 7f63c6d16700 1 --2- 172.21.15.146:0/2227624664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63c01300a0 0x7f63c011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.038+0000 7f63c6d16700 1 -- 172.21.15.146:0/2227624664 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b0009550 con 0x7f63c0133ad0 2023-10-03T10:13:44.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.038+0000 7f63c6515700 1 --2- 172.21.15.146:0/2227624664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63c01300a0 0x7f63c011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:44.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.038+0000 7f63c6d16700 1 --2- 172.21.15.146:0/2227624664 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f63c0133ad0 0x7f63c011e4c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009dd0 tx=0x7f63b800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.038+0000 7f63b6ffd700 1 -- 172.21.15.146:0/2227624664 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b8009c40 con 0x7f63c0133ad0 2023-10-03T10:13:44.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.038+0000 7f63b6ffd700 1 -- 172.21.15.146:0/2227624664 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b800f040 con 0x7f63c0133ad0 2023-10-03T10:13:44.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.038+0000 7f63c8779700 1 -- 172.21.15.146:0/2227624664 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c011fbf0 con 0x7f63c0133ad0 2023-10-03T10:13:44.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.038+0000 7f63b6ffd700 1 -- 172.21.15.146:0/2227624664 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b800ceb0 con 0x7f63c0133ad0 2023-10-03T10:13:44.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.038+0000 7f63c8779700 1 -- 172.21.15.146:0/2227624664 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c011feb0 con 0x7f63c0133ad0 2023-10-03T10:13:44.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.039+0000 7f63b6ffd700 1 -- 172.21.15.146:0/2227624664 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f63b8014480 con 0x7f63c0133ad0 2023-10-03T10:13:44.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.039+0000 7f63c8779700 1 -- 172.21.15.146:0/2227624664 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c0072720 con 0x7f63c0133ad0 2023-10-03T10:13:44.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.040+0000 7f63b6ffd700 1 -- 172.21.15.146:0/2227624664 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f63b803feb0 con 0x7f63c0133ad0 2023-10-03T10:13:44.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.048+0000 7f63b6ffd700 1 -- 172.21.15.146:0/2227624664 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f63b80118b0 con 0x7f63c0133ad0 2023-10-03T10:13:44.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.081+0000 7f79942f8700 1 Processor -- start 2023-10-03T10:13:44.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.081+0000 7f79942f8700 1 -- start start 2023-10-03T10:13:44.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.081+0000 7f79942f8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f798c133900 0x7f798c133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.081+0000 7f79942f8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f798c134210 0x7f798c0a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.081+0000 7f79942f8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f798c09a760 con 0x7f798c0a0ee0 2023-10-03T10:13:44.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.081+0000 7f79942f8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f798c1336e0 con 0x7f798c134210 2023-10-03T10:13:44.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.081+0000 7f79942f8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f798c09a080 con 0x7f798c133900 2023-10-03T10:13:44.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.081+0000 7f7991893700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f798c134210 0x7f798c0a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.081+0000 7f7991893700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f798c134210 0x7f798c0a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40944/0 (socket says 172.21.15.146:40944) 2023-10-03T10:13:44.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.081+0000 7f7991893700 1 -- 172.21.15.146:0/3050964088 learned_addr learned my addr 172.21.15.146:0/3050964088 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:44.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.082+0000 7f7992094700 1 --2- 172.21.15.146:0/3050964088 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f798c133900 0x7f798c133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.082+0000 7f7991893700 1 -- 172.21.15.146:0/3050964088 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f798c133900 msgr2=0x7f798c133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:44.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.082+0000 7f7991893700 1 --2- 172.21.15.146:0/3050964088 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f798c133900 0x7f798c133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.082+0000 7f7991893700 1 -- 172.21.15.146:0/3050964088 >> v1:172.21.15.146:6789/0 conn(0x7f798c0a0ee0 legacy=0x7f798c13a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.082+0000 7f7991893700 1 -- 172.21.15.146:0/3050964088 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798c0a23e0 con 0x7f798c134210 2023-10-03T10:13:44.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.082+0000 7f7991893700 1 --2- 172.21.15.146:0/3050964088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f798c134210 0x7f798c0a09a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f797c0098f0 tx=0x7f797c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b096228de17082 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.082+0000 7f7991092700 1 -- 172.21.15.146:0/3050964088 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c011830 con 0x7f798c134210 2023-10-03T10:13:44.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.082+0000 7f7991092700 1 -- 172.21.15.146:0/3050964088 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c011990 con 0x7f798c134210 2023-10-03T10:13:44.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.082+0000 7f7991092700 1 -- 172.21.15.146:0/3050964088 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c011d20 con 0x7f798c134210 2023-10-03T10:13:44.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.083+0000 7f79942f8700 1 -- 172.21.15.146:0/3050964088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f798c134210 msgr2=0x7f798c0a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.083+0000 7f79942f8700 1 --2- 172.21.15.146:0/3050964088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f798c134210 0x7f798c0a09a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f797c0098f0 tx=0x7f797c009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:44.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.083+0000 7f79942f8700 1 -- 172.21.15.146:0/3050964088 shutdown_connections 2023-10-03T10:13:44.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.083+0000 7f79942f8700 1 --2- 172.21.15.146:0/3050964088 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f798c133900 0x7f798c133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.083+0000 7f79942f8700 1 --2- 172.21.15.146:0/3050964088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f798c134210 0x7f798c0a09a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.083+0000 7f79942f8700 1 -- 172.21.15.146:0/3050964088 >> 172.21.15.146:0/3050964088 conn(0x7f798c0a2980 msgr2=0x7f798c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.083+0000 7f79942f8700 1 -- 172.21.15.146:0/3050964088 shutdown_connections 2023-10-03T10:13:44.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.083+0000 7f79942f8700 1 -- 172.21.15.146:0/3050964088 wait complete. 2023-10-03T10:13:44.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.085+0000 7f79942f8700 1 Processor -- start 2023-10-03T10:13:44.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.085+0000 7f79942f8700 1 -- start start 2023-10-03T10:13:44.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.085+0000 7f79942f8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f798c0a0ee0 0x7f798c11d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.085+0000 7f79942f8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f798c133900 0x7f798c11dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.085+0000 7f79942f8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f798c134210 0x7f798c11e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.085+0000 7f79942f8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798c11f930 con 0x7f798c0a0ee0 2023-10-03T10:13:44.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.085+0000 7f79942f8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798c132ea0 con 0x7f798c133900 2023-10-03T10:13:44.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.085+0000 7f79942f8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f798c09a2c0 con 0x7f798c134210 2023-10-03T10:13:44.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.086+0000 7f7992094700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f798c0a0ee0 0x7f798c11d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.086+0000 7f7991893700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f798c133900 0x7f798c11dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.086+0000 7f7992094700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f798c0a0ee0 0x7f798c11d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40960/0 (socket says 172.21.15.146:40960) 2023-10-03T10:13:44.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.086+0000 7f7992094700 1 -- 172.21.15.146:0/3117930960 learned_addr learned my addr 172.21.15.146:0/3117930960 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:44.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.086+0000 7f7992895700 1 --2- 172.21.15.146:0/3117930960 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f798c134210 0x7f798c11e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.086+0000 7f7991893700 1 -- 172.21.15.146:0/3117930960 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f798c134210 msgr2=0x7f798c11e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.086+0000 7f7991893700 1 --2- 172.21.15.146:0/3117930960 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f798c134210 0x7f798c11e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.086+0000 7f7991893700 1 -- 172.21.15.146:0/3117930960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f798c0a0ee0 msgr2=0x7f798c11d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.086+0000 7f7991893700 1 --2- 172.21.15.146:0/3117930960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f798c0a0ee0 0x7f798c11d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.086+0000 7f7991893700 1 -- 172.21.15.146:0/3117930960 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c009550 con 0x7f798c133900 2023-10-03T10:13:44.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.086+0000 7f7991893700 1 --2- 172.21.15.146:0/3117930960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f798c133900 0x7f798c11dd20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f797c016000 tx=0x7f797c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.086+0000 7f7982ffd700 1 -- 172.21.15.146:0/3117930960 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c004400 con 0x7f798c133900 2023-10-03T10:13:44.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.086+0000 7f7982ffd700 1 -- 172.21.15.146:0/3117930960 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c01f070 con 0x7f798c133900 2023-10-03T10:13:44.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.086+0000 7f7982ffd700 1 -- 172.21.15.146:0/3117930960 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c0038e0 con 0x7f798c133900 2023-10-03T10:13:44.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.086+0000 7f79942f8700 1 -- 172.21.15.146:0/3117930960 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798c120a20 con 0x7f798c133900 2023-10-03T10:13:44.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.087+0000 7f79942f8700 1 -- 172.21.15.146:0/3117930960 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f798c121790 con 0x7f798c133900 2023-10-03T10:13:44.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.087+0000 7f79942f8700 1 -- 172.21.15.146:0/3117930960 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798c1205d0 con 0x7f798c133900 2023-10-03T10:13:44.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.088+0000 7f7982ffd700 1 -- 172.21.15.146:0/3117930960 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f797c021030 con 0x7f798c133900 2023-10-03T10:13:44.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.088+0000 7f7982ffd700 1 -- 172.21.15.146:0/3117930960 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f797c040830 con 0x7f798c133900 2023-10-03T10:13:44.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.097+0000 7f7982ffd700 1 -- 172.21.15.146:0/3117930960 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f797c023790 con 0x7f798c133900 2023-10-03T10:13:44.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.170+0000 7f1a8efc5700 1 -- 172.21.15.146:0/3001536756 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1a8806bce0 con 0x7f1a880a0a30 2023-10-03T10:13:44.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.170+0000 7f1a857fa700 1 -- 172.21.15.146:0/3001536756 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1a7c00fe60 con 0x7f1a880a0a30 2023-10-03T10:13:44.170 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:44.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.172+0000 7f1a8efc5700 1 -- 172.21.15.146:0/3001536756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a880a0a30 msgr2=0x7f1a8811a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.172+0000 7f1a8efc5700 1 --2- 172.21.15.146:0/3001536756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a880a0a30 0x7f1a8811a790 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00e8e0 tx=0x7f1a7c00ebf0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.173+0000 7f1a8efc5700 1 -- 172.21.15.146:0/3001536756 shutdown_connections 2023-10-03T10:13:44.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.173+0000 7f1a8efc5700 1 --2- 172.21.15.146:0/3001536756 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a88130670 0x7f1a881c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.173+0000 7f1a8efc5700 1 --2- 172.21.15.146:0/3001536756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a880a0a30 0x7f1a8811a790 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.173+0000 7f1a8efc5700 1 --2- 172.21.15.146:0/3001536756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a880a1340 0x7f1a8811acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.173+0000 7f1a8efc5700 1 -- 172.21.15.146:0/3001536756 >> 172.21.15.146:0/3001536756 conn(0x7f1a880a2980 msgr2=0x7f1a8812f050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.173+0000 7f1a8efc5700 1 -- 172.21.15.146:0/3001536756 shutdown_connections 2023-10-03T10:13:44.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.173+0000 7f1a8efc5700 1 -- 172.21.15.146:0/3001536756 wait complete. 2023-10-03T10:13:44.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:44.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.216+0000 7fc84f40b700 1 -- 172.21.15.146:0/2322687611 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc84811ff90 con 0x7fc848134210 2023-10-03T10:13:44.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.216+0000 7fc83dffb700 1 -- 172.21.15.146:0/2322687611 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc84811ff90 con 0x7fc848134210 2023-10-03T10:13:44.216 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:44.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.218+0000 7fc84f40b700 1 -- 172.21.15.146:0/2322687611 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc848134210 msgr2=0x7fc84811d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.218+0000 7fc84f40b700 1 --2- 172.21.15.146:0/2322687611 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc848134210 0x7fc84811d200 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc840015000 tx=0x7fc840004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.218+0000 7fc84f40b700 1 -- 172.21.15.146:0/2322687611 shutdown_connections 2023-10-03T10:13:44.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.218+0000 7fc84f40b700 1 --2- 172.21.15.146:0/2322687611 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc848134210 0x7fc84811d200 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.218+0000 7fc84f40b700 1 --2- 172.21.15.146:0/2322687611 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8480a10b0 0x7fc84811c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.218+0000 7fc84f40b700 1 --2- 172.21.15.146:0/2322687611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc848133900 0x7fc84811ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.218+0000 7fc84f40b700 1 -- 172.21.15.146:0/2322687611 >> 172.21.15.146:0/2322687611 conn(0x7fc8480a2980 msgr2=0x7fc8481baec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.218+0000 7fc84f40b700 1 -- 172.21.15.146:0/2322687611 shutdown_connections 2023-10-03T10:13:44.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.218+0000 7fc84f40b700 1 -- 172.21.15.146:0/2322687611 wait complete. 2023-10-03T10:13:44.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:44.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.257+0000 7f63c8779700 1 -- 172.21.15.146:0/2227624664 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f63c004f2a0 con 0x7f63c0133ad0 2023-10-03T10:13:44.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.258+0000 7f63b6ffd700 1 -- 172.21.15.146:0/2227624664 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f63b8012340 con 0x7f63c0133ad0 2023-10-03T10:13:44.257 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:44.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.260+0000 7f63c8779700 1 -- 172.21.15.146:0/2227624664 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f63c0133ad0 msgr2=0x7f63c011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.260+0000 7f63c8779700 1 --2- 172.21.15.146:0/2227624664 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f63c0133ad0 0x7f63c011e4c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009dd0 tx=0x7f63b800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.260+0000 7f63c8779700 1 -- 172.21.15.146:0/2227624664 shutdown_connections 2023-10-03T10:13:44.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.260+0000 7f63c8779700 1 --2- 172.21.15.146:0/2227624664 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f63c0133ad0 0x7f63c011e4c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.260+0000 7f63c8779700 1 --2- 172.21.15.146:0/2227624664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63c01300a0 0x7f63c011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.260+0000 7f63c8779700 1 --2- 172.21.15.146:0/2227624664 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63c01309f0 0x7f63c011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.260+0000 7f63c8779700 1 -- 172.21.15.146:0/2227624664 >> 172.21.15.146:0/2227624664 conn(0x7f63c0099c40 msgr2=0x7f63c012e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.260+0000 7f63c8779700 1 -- 172.21.15.146:0/2227624664 shutdown_connections 2023-10-03T10:13:44.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.260+0000 7f63c8779700 1 -- 172.21.15.146:0/2227624664 wait complete. 2023-10-03T10:13:44.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:44.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.294+0000 7f79942f8700 1 -- 172.21.15.146:0/3117930960 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f798c04f2a0 con 0x7f798c133900 2023-10-03T10:13:44.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.295+0000 7f7982ffd700 1 -- 172.21.15.146:0/3117930960 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f797c015020 con 0x7f798c133900 2023-10-03T10:13:44.294 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:44.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.297+0000 7f79942f8700 1 -- 172.21.15.146:0/3117930960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f798c133900 msgr2=0x7f798c11dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.297+0000 7f79942f8700 1 --2- 172.21.15.146:0/3117930960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f798c133900 0x7f798c11dd20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f797c016000 tx=0x7f797c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:44.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.297+0000 7f79942f8700 1 -- 172.21.15.146:0/3117930960 shutdown_connections 2023-10-03T10:13:44.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.297+0000 7f79942f8700 1 --2- 172.21.15.146:0/3117930960 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f798c134210 0x7f798c11e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.297+0000 7f79942f8700 1 --2- 172.21.15.146:0/3117930960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f798c0a0ee0 0x7f798c11d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.297+0000 7f79942f8700 1 --2- 172.21.15.146:0/3117930960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f798c133900 0x7f798c11dd20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.297+0000 7f79942f8700 1 -- 172.21.15.146:0/3117930960 >> 172.21.15.146:0/3117930960 conn(0x7f798c0a2980 msgr2=0x7f798c1b95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.297+0000 7f79942f8700 1 -- 172.21.15.146:0/3117930960 shutdown_connections 2023-10-03T10:13:44.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:44.297+0000 7f79942f8700 1 -- 172.21.15.146:0/3117930960 wait complete. 2023-10-03T10:13:44.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:45.186 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:45.232 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:45.273 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:45.309 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:45.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.324+0000 7fc785dd3700 1 Processor -- start 2023-10-03T10:13:45.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.324+0000 7fc785dd3700 1 -- start start 2023-10-03T10:13:45.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.324+0000 7fc785dd3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc780133ad0 0x7fc780133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.324+0000 7fc785dd3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc7801300a0 0x7fc7801304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.324+0000 7fc785dd3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7801309f0 0x7fc78013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.324+0000 7fc785dd3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78006b2d0 con 0x7fc7801300a0 2023-10-03T10:13:45.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.324+0000 7fc785dd3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc780133610 con 0x7fc7801309f0 2023-10-03T10:13:45.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.324+0000 7fc785dd3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc78009a500 con 0x7fc780133ad0 2023-10-03T10:13:45.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.324+0000 7fc77ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7801309f0 0x7fc78013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.324+0000 7fc77ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7801309f0 0x7fc78013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40204/0 (socket says 172.21.15.146:40204) 2023-10-03T10:13:45.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.324+0000 7fc77ffff700 1 -- 172.21.15.146:0/3870881704 learned_addr learned my addr 172.21.15.146:0/3870881704 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:45.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.324+0000 7fc77f7fe700 1 --2- 172.21.15.146:0/3870881704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc780133ad0 0x7fc780133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.324+0000 7fc77effd700 1 --2- 172.21.15.146:0/3870881704 >> v2:172.21.15.146:3300/0 conn(0x7fc7801300a0 0x7fc7801304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.325+0000 7fc77ffff700 1 -- 172.21.15.146:0/3870881704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc780133ad0 msgr2=0x7fc780133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:45.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.325+0000 7fc77ffff700 1 --2- 172.21.15.146:0/3870881704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc780133ad0 0x7fc780133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.325+0000 7fc77ffff700 1 -- 172.21.15.146:0/3870881704 >> v2:172.21.15.146:3300/0 conn(0x7fc7801300a0 msgr2=0x7fc7801304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:45.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.325+0000 7fc77ffff700 1 --2- 172.21.15.146:0/3870881704 >> v2:172.21.15.146:3300/0 conn(0x7fc7801300a0 0x7fc7801304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.325+0000 7fc77ffff700 1 -- 172.21.15.146:0/3870881704 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7801338b0 con 0x7fc7801309f0 2023-10-03T10:13:45.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.325+0000 7fc77effd700 1 --2- 172.21.15.146:0/3870881704 >> v2:172.21.15.146:3300/0 conn(0x7fc7801300a0 0x7fc7801304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:45.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.325+0000 7fc77ffff700 1 --2- 172.21.15.146:0/3870881704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7801309f0 0x7fc78013a980 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc778009e50 tx=0x7fc77800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74097fc0e720700f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:45.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.325+0000 7fc77e7fc700 1 -- 172.21.15.146:0/3870881704 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77800e070 con 0x7fc7801309f0 2023-10-03T10:13:45.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.325+0000 7fc77e7fc700 1 -- 172.21.15.146:0/3870881704 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77800b910 con 0x7fc7801309f0 2023-10-03T10:13:45.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.325+0000 7fc77e7fc700 1 -- 172.21.15.146:0/3870881704 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77800bcc0 con 0x7fc7801309f0 2023-10-03T10:13:45.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.326+0000 7fc785dd3700 1 -- 172.21.15.146:0/3870881704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7801309f0 msgr2=0x7fc78013a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.326+0000 7fc785dd3700 1 --2- 172.21.15.146:0/3870881704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7801309f0 0x7fc78013a980 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc778009e50 tx=0x7fc77800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:45.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.326+0000 7fc785dd3700 1 -- 172.21.15.146:0/3870881704 shutdown_connections 2023-10-03T10:13:45.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.326+0000 7fc785dd3700 1 --2- 172.21.15.146:0/3870881704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7801309f0 0x7fc78013a980 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.326+0000 7fc785dd3700 1 --2- 172.21.15.146:0/3870881704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc780133ad0 0x7fc780133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.326+0000 7fc785dd3700 1 --2- 172.21.15.146:0/3870881704 >> v2:172.21.15.146:3300/0 conn(0x7fc7801300a0 0x7fc7801304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.326+0000 7fc785dd3700 1 -- 172.21.15.146:0/3870881704 >> 172.21.15.146:0/3870881704 conn(0x7fc780099c40 msgr2=0x7fc7800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:45.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.326+0000 7fc785dd3700 1 -- 172.21.15.146:0/3870881704 shutdown_connections 2023-10-03T10:13:45.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.326+0000 7fc785dd3700 1 -- 172.21.15.146:0/3870881704 wait complete. 2023-10-03T10:13:45.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.327+0000 7fc785dd3700 1 Processor -- start 2023-10-03T10:13:45.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.327+0000 7fc785dd3700 1 -- start start 2023-10-03T10:13:45.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.328+0000 7fc785dd3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7801300a0 0x7fc78011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.328+0000 7fc785dd3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7801309f0 0x7fc78011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.328+0000 7fc785dd3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc780133ad0 0x7fc78011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.328+0000 7fc785dd3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78012dd00 con 0x7fc7801300a0 2023-10-03T10:13:45.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.328+0000 7fc785dd3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78011eb00 con 0x7fc7801309f0 2023-10-03T10:13:45.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.328+0000 7fc785dd3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc78012f720 con 0x7fc780133ad0 2023-10-03T10:13:45.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.328+0000 7fc77f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7801300a0 0x7fc78011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.328+0000 7fc77f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7801300a0 0x7fc78011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42832/0 (socket says 172.21.15.146:42832) 2023-10-03T10:13:45.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.328+0000 7fc77f7fe700 1 -- 172.21.15.146:0/1708751467 learned_addr learned my addr 172.21.15.146:0/1708751467 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:45.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.328+0000 7fc77effd700 1 --2- 172.21.15.146:0/1708751467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7801309f0 0x7fc78011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.328+0000 7fc77ffff700 1 --2- 172.21.15.146:0/1708751467 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc780133ad0 0x7fc78011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.328+0000 7fc77ffff700 1 -- 172.21.15.146:0/1708751467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7801309f0 msgr2=0x7fc78011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.328+0000 7fc77ffff700 1 --2- 172.21.15.146:0/1708751467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7801309f0 0x7fc78011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.328+0000 7fc77ffff700 1 -- 172.21.15.146:0/1708751467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7801300a0 msgr2=0x7fc78011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.328+0000 7fc77ffff700 1 --2- 172.21.15.146:0/1708751467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7801300a0 0x7fc78011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.328+0000 7fc77ffff700 1 -- 172.21.15.146:0/1708751467 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc778009b30 con 0x7fc780133ad0 2023-10-03T10:13:45.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.328+0000 7fc77f7fe700 1 --2- 172.21.15.146:0/1708751467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7801300a0 0x7fc78011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:45.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.329+0000 7fc77ffff700 1 --2- 172.21.15.146:0/1708751467 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc780133ad0 0x7fc78011e4c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc778015000 tx=0x7fc778004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:45.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.329+0000 7fc767fff700 1 -- 172.21.15.146:0/1708751467 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7780092e0 con 0x7fc780133ad0 2023-10-03T10:13:45.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.329+0000 7fc767fff700 1 -- 172.21.15.146:0/1708751467 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc778004250 con 0x7fc780133ad0 2023-10-03T10:13:45.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.329+0000 7fc767fff700 1 -- 172.21.15.146:0/1708751467 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778004600 con 0x7fc780133ad0 2023-10-03T10:13:45.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.329+0000 7fc785dd3700 1 -- 172.21.15.146:0/1708751467 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc780072190 con 0x7fc780133ad0 2023-10-03T10:13:45.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.329+0000 7fc785dd3700 1 -- 172.21.15.146:0/1708751467 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78012d1b0 con 0x7fc780133ad0 2023-10-03T10:13:45.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.330+0000 7fc767fff700 1 -- 172.21.15.146:0/1708751467 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc778004760 con 0x7fc780133ad0 2023-10-03T10:13:45.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.330+0000 7fc767fff700 1 -- 172.21.15.146:0/1708751467 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc778040a00 con 0x7fc780133ad0 2023-10-03T10:13:45.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.330+0000 7fc785dd3700 1 -- 172.21.15.146:0/1708751467 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc78009cb20 con 0x7fc780133ad0 2023-10-03T10:13:45.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.335+0000 7fc767fff700 1 -- 172.21.15.146:0/1708751467 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc77801a330 con 0x7fc780133ad0 2023-10-03T10:13:45.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.366+0000 7f060ea6e700 1 Processor -- start 2023-10-03T10:13:45.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.366+0000 7f060ea6e700 1 -- start start 2023-10-03T10:13:45.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.366+0000 7f060ea6e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06080a0a30 0x7f06080a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.366+0000 7f060ea6e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06080a1340 0x7f060812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.366+0000 7f060ea6e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f06081304a0 0x7f06081308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.366+0000 7f060ea6e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0608130e30 con 0x7f06081304a0 2023-10-03T10:13:45.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.366+0000 7f060ea6e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06080a1e70 con 0x7f06080a1340 2023-10-03T10:13:45.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.366+0000 7f060ea6e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f060809a720 con 0x7f06080a0a30 2023-10-03T10:13:45.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.367+0000 7f060d00b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f06081304a0 0x7f06081308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.367+0000 7f060d00b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f06081304a0 0x7f06081308f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42840/0 (socket says 172.21.15.146:42840) 2023-10-03T10:13:45.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.367+0000 7f060d00b700 1 -- 172.21.15.146:0/1687642669 learned_addr learned my addr 172.21.15.146:0/1687642669 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:45.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.367+0000 7f060c80a700 1 --2- 172.21.15.146:0/1687642669 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06080a0a30 0x7f06080a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.367+0000 7f0607fff700 1 --2- 172.21.15.146:0/1687642669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06080a1340 0x7f060812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.367+0000 7f060d00b700 1 -- 172.21.15.146:0/1687642669 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06080a0a30 msgr2=0x7f06080a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.367+0000 7f060d00b700 1 --2- 172.21.15.146:0/1687642669 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06080a0a30 0x7f06080a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.367+0000 7f060d00b700 1 -- 172.21.15.146:0/1687642669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06080a1340 msgr2=0x7f060812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.367+0000 7f060d00b700 1 --2- 172.21.15.146:0/1687642669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06080a1340 0x7f060812ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.367+0000 7f060d00b700 1 -- 172.21.15.146:0/1687642669 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060809b300 con 0x7f06081304a0 2023-10-03T10:13:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.367+0000 7f060c80a700 1 --2- 172.21.15.146:0/1687642669 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06080a0a30 0x7f06080a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.367+0000 7f060d00b700 1 --2- 172.21.15.146:0/1687642669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06081304a0 0x7f06081308f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f060000bef0 tx=0x7f060000a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d59dd0d1819452b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.367+0000 7f06077fe700 1 -- 172.21.15.146:0/1687642669 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060000a2e0 con 0x7f06081304a0 2023-10-03T10:13:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.367+0000 7f06077fe700 1 -- 172.21.15.146:0/1687642669 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060000cb50 con 0x7f06081304a0 2023-10-03T10:13:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.367+0000 7f06077fe700 1 -- 172.21.15.146:0/1687642669 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0600014480 con 0x7f06081304a0 2023-10-03T10:13:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.368+0000 7f060ea6e700 1 -- 172.21.15.146:0/1687642669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06081304a0 msgr2=0x7f06081308f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.368+0000 7f060ea6e700 1 --2- 172.21.15.146:0/1687642669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06081304a0 0x7f06081308f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f060000bef0 tx=0x7f060000a4c0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.368+0000 7f060ea6e700 1 -- 172.21.15.146:0/1687642669 shutdown_connections 2023-10-03T10:13:45.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.368+0000 7f060ea6e700 1 --2- 172.21.15.146:0/1687642669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06081304a0 0x7f06081308f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.368+0000 7f060ea6e700 1 --2- 172.21.15.146:0/1687642669 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06080a0a30 0x7f06080a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.368+0000 7f060ea6e700 1 --2- 172.21.15.146:0/1687642669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06080a1340 0x7f060812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.368+0000 7f060ea6e700 1 -- 172.21.15.146:0/1687642669 >> 172.21.15.146:0/1687642669 conn(0x7f06080a2980 msgr2=0x7f06080a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:45.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.368+0000 7f060ea6e700 1 -- 172.21.15.146:0/1687642669 shutdown_connections 2023-10-03T10:13:45.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.368+0000 7f060ea6e700 1 -- 172.21.15.146:0/1687642669 wait complete. 2023-10-03T10:13:45.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.370+0000 7f060ea6e700 1 Processor -- start 2023-10-03T10:13:45.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.370+0000 7f060ea6e700 1 -- start start 2023-10-03T10:13:45.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.370+0000 7f060ea6e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06080a0a30 0x7f060811ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.370+0000 7f060ea6e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06080a1340 0x7f060811b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.370+0000 7f060ea6e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06081304a0 0x7f060811b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.370+0000 7f060ea6e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060811cf80 con 0x7f06080a0a30 2023-10-03T10:13:45.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.370+0000 7f060ea6e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060809ae00 con 0x7f06080a1340 2023-10-03T10:13:45.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.370+0000 7f060ea6e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f060811c960 con 0x7f06081304a0 2023-10-03T10:13:45.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.371+0000 7f060d00b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06081304a0 0x7f060811b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.371+0000 7f060d00b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06081304a0 0x7f060811b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57276/0 (socket says 172.21.15.146:57276) 2023-10-03T10:13:45.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.371+0000 7f0607fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06080a1340 0x7f060811b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.371+0000 7f060c80a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06080a0a30 0x7f060811ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.371+0000 7f060d00b700 1 -- 172.21.15.146:0/429174362 learned_addr learned my addr 172.21.15.146:0/429174362 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:45.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.371+0000 7f060d00b700 1 -- 172.21.15.146:0/429174362 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06080a1340 msgr2=0x7f060811b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.371+0000 7f060d00b700 1 --2- 172.21.15.146:0/429174362 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06080a1340 0x7f060811b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.371+0000 7f060d00b700 1 -- 172.21.15.146:0/429174362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06080a0a30 msgr2=0x7f060811ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.371+0000 7f060d00b700 1 --2- 172.21.15.146:0/429174362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06080a0a30 0x7f060811ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.371+0000 7f060d00b700 1 -- 172.21.15.146:0/429174362 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05fc009430 con 0x7f06081304a0 2023-10-03T10:13:45.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.371+0000 7f060d00b700 1 --2- 172.21.15.146:0/429174362 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06081304a0 0x7f060811b7d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0608099eb0 tx=0x7f0600004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:45.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.371+0000 7f06057fa700 1 -- 172.21.15.146:0/429174362 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0600021c30 con 0x7f06081304a0 2023-10-03T10:13:45.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.372+0000 7f06057fa700 1 -- 172.21.15.146:0/429174362 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0600021db0 con 0x7f06081304a0 2023-10-03T10:13:45.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.372+0000 7f060ea6e700 1 -- 172.21.15.146:0/429174362 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060000bb50 con 0x7f06081304a0 2023-10-03T10:13:45.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.372+0000 7f06057fa700 1 -- 172.21.15.146:0/429174362 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06000146c0 con 0x7f06081304a0 2023-10-03T10:13:45.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.372+0000 7f060ea6e700 1 -- 172.21.15.146:0/429174362 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060811d150 con 0x7f06081304a0 2023-10-03T10:13:45.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.372+0000 7f06057fa700 1 -- 172.21.15.146:0/429174362 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0600014820 con 0x7f06081304a0 2023-10-03T10:13:45.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.373+0000 7f06057fa700 1 -- 172.21.15.146:0/429174362 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0600048fd0 con 0x7f06081304a0 2023-10-03T10:13:45.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.373+0000 7f060ea6e700 1 -- 172.21.15.146:0/429174362 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f060804f2a0 con 0x7f06081304a0 2023-10-03T10:13:45.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.378+0000 7f06057fa700 1 -- 172.21.15.146:0/429174362 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0600019070 con 0x7f06081304a0 2023-10-03T10:13:45.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.419+0000 7f0cc7360700 1 Processor -- start 2023-10-03T10:13:45.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.419+0000 7f0cc7360700 1 -- start start 2023-10-03T10:13:45.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.420+0000 7f0cc7360700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0cc009e870 0x7f0cc009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.420+0000 7f0cc7360700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc009f180 0x7f0cc0131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.420+0000 7f0cc7360700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0cc0131d70 0x7f0cc0132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.420+0000 7f0cc7360700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc00a0920 con 0x7f0cc0131d70 2023-10-03T10:13:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.420+0000 7f0cc7360700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc009c970 con 0x7f0cc009f180 2023-10-03T10:13:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.420+0000 7f0cc7360700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc009bab0 con 0x7f0cc009e870 2023-10-03T10:13:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.420+0000 7f0cc48fb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc009f180 0x7f0cc0131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.420+0000 7f0cc58fd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0cc0131d70 0x7f0cc0132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.420+0000 7f0cc48fb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc009f180 0x7f0cc0131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40236/0 (socket says 172.21.15.146:40236) 2023-10-03T10:13:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.420+0000 7f0cc48fb700 1 -- 172.21.15.146:0/3799190657 learned_addr learned my addr 172.21.15.146:0/3799190657 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.420+0000 7f0cc48fb700 1 -- 172.21.15.146:0/3799190657 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0cc009e870 msgr2=0x7f0cc009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.420+0000 7f0cc48fb700 1 --2- 172.21.15.146:0/3799190657 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0cc009e870 0x7f0cc009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.420+0000 7f0cc48fb700 1 -- 172.21.15.146:0/3799190657 >> v2:172.21.15.146:3300/0 conn(0x7f0cc0131d70 msgr2=0x7f0cc0132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.420+0000 7f0cc48fb700 1 --2- 172.21.15.146:0/3799190657 >> v2:172.21.15.146:3300/0 conn(0x7f0cc0131d70 0x7f0cc0132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.420+0000 7f0cc48fb700 1 -- 172.21.15.146:0/3799190657 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc009f9c0 con 0x7f0cc009f180 2023-10-03T10:13:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.421+0000 7f0cc48fb700 1 --2- 172.21.15.146:0/3799190657 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc009f180 0x7f0cc0131830 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00098f0 tx=0x7f0cb0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90704f3c3904fb0b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.421+0000 7f0cb7fff700 1 -- 172.21.15.146:0/3799190657 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0011830 con 0x7f0cc009f180 2023-10-03T10:13:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.421+0000 7f0cb7fff700 1 -- 172.21.15.146:0/3799190657 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb0011990 con 0x7f0cc009f180 2023-10-03T10:13:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.421+0000 7f0cb7fff700 1 -- 172.21.15.146:0/3799190657 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0011d20 con 0x7f0cc009f180 2023-10-03T10:13:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.421+0000 7f0cc7360700 1 -- 172.21.15.146:0/3799190657 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc009f180 msgr2=0x7f0cc0131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.421+0000 7f0cc7360700 1 --2- 172.21.15.146:0/3799190657 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc009f180 0x7f0cc0131830 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00098f0 tx=0x7f0cb0009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.421+0000 7f0cc7360700 1 -- 172.21.15.146:0/3799190657 shutdown_connections 2023-10-03T10:13:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.421+0000 7f0cc7360700 1 --2- 172.21.15.146:0/3799190657 >> v2:172.21.15.146:3300/0 conn(0x7f0cc0131d70 0x7f0cc0132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.421+0000 7f0cc7360700 1 --2- 172.21.15.146:0/3799190657 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0cc009e870 0x7f0cc009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.421+0000 7f0cc7360700 1 --2- 172.21.15.146:0/3799190657 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc009f180 0x7f0cc0131830 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.421+0000 7f0cc7360700 1 -- 172.21.15.146:0/3799190657 >> 172.21.15.146:0/3799190657 conn(0x7f0cc00a4430 msgr2=0x7f0cc00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.422+0000 7f0cc7360700 1 -- 172.21.15.146:0/3799190657 shutdown_connections 2023-10-03T10:13:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.422+0000 7f0cc7360700 1 -- 172.21.15.146:0/3799190657 wait complete. 2023-10-03T10:13:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.422+0000 7f0cc7360700 1 Processor -- start 2023-10-03T10:13:45.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.423+0000 7f0cc7360700 1 -- start start 2023-10-03T10:13:45.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.423+0000 7f0cc7360700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc009e870 0x7f0cc0135a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.423+0000 7f0cc7360700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0cc009f180 0x7f0cc0135f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.423+0000 7f0cc7360700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc0131d70 0x7f0cc01364d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.423+0000 7f0cc7360700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc011a9a0 con 0x7f0cc0131d70 2023-10-03T10:13:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.423+0000 7f0cc7360700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc0137bd0 con 0x7f0cc009e870 2023-10-03T10:13:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.423+0000 7f0cc7360700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc0137660 con 0x7f0cc009f180 2023-10-03T10:13:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.423+0000 7f0cc50fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc009e870 0x7f0cc0135a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.423+0000 7f0cc50fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc009e870 0x7f0cc0135a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40246/0 (socket says 172.21.15.146:40246) 2023-10-03T10:13:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.423+0000 7f0cc50fc700 1 -- 172.21.15.146:0/2520303383 learned_addr learned my addr 172.21.15.146:0/2520303383 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.423+0000 7f0cc58fd700 1 --2- 172.21.15.146:0/2520303383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc0131d70 0x7f0cc01364d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.423+0000 7f0cc48fb700 1 --2- 172.21.15.146:0/2520303383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0cc009f180 0x7f0cc0135f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.423+0000 7f0cc50fc700 1 -- 172.21.15.146:0/2520303383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0cc009f180 msgr2=0x7f0cc0135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.423+0000 7f0cc50fc700 1 --2- 172.21.15.146:0/2520303383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0cc009f180 0x7f0cc0135f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.423+0000 7f0cc50fc700 1 -- 172.21.15.146:0/2520303383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc0131d70 msgr2=0x7f0cc01364d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.423+0000 7f0cc50fc700 1 --2- 172.21.15.146:0/2520303383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc0131d70 0x7f0cc01364d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.423+0000 7f0cc50fc700 1 -- 172.21.15.146:0/2520303383 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb0009550 con 0x7f0cc009e870 2023-10-03T10:13:45.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.424+0000 7f0cc50fc700 1 --2- 172.21.15.146:0/2520303383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc009e870 0x7f0cc0135a50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00b560 tx=0x7f0cbc00b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:45.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.424+0000 7f0cb5ffb700 1 -- 172.21.15.146:0/2520303383 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc011830 con 0x7f0cc009e870 2023-10-03T10:13:45.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.424+0000 7f0cb5ffb700 1 -- 172.21.15.146:0/2520303383 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc011990 con 0x7f0cc009e870 2023-10-03T10:13:45.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.424+0000 7f0cc7360700 1 -- 172.21.15.146:0/2520303383 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc00a0210 con 0x7f0cc009e870 2023-10-03T10:13:45.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.424+0000 7f0cb5ffb700 1 -- 172.21.15.146:0/2520303383 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc011d40 con 0x7f0cc009e870 2023-10-03T10:13:45.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.424+0000 7f0cc7360700 1 -- 172.21.15.146:0/2520303383 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc011bd00 con 0x7f0cc009e870 2023-10-03T10:13:45.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.425+0000 7f0cb5ffb700 1 -- 172.21.15.146:0/2520303383 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0cbc01a400 con 0x7f0cc009e870 2023-10-03T10:13:45.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.425+0000 7f0cb5ffb700 1 -- 172.21.15.146:0/2520303383 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0cbc03f680 con 0x7f0cc009e870 2023-10-03T10:13:45.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.426+0000 7f0cc7360700 1 -- 172.21.15.146:0/2520303383 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc004f2a0 con 0x7f0cc009e870 2023-10-03T10:13:45.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.430+0000 7f0cb5ffb700 1 -- 172.21.15.146:0/2520303383 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cbc0193b0 con 0x7f0cc009e870 2023-10-03T10:13:45.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.452+0000 7f4c08ffb700 1 Processor -- start 2023-10-03T10:13:45.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.452+0000 7f4c08ffb700 1 -- start start 2023-10-03T10:13:45.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.453+0000 7f4c08ffb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c0409f350 0x7f4c04136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.453+0000 7f4c08ffb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4c041371c0 0x7f4c041395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.453+0000 7f4c08ffb700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c0409c970 con 0x7f4c0409e870 2023-10-03T10:13:45.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.453+0000 7f4c08ffb700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c040a0920 con 0x7f4c041371c0 2023-10-03T10:13:45.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.453+0000 7f4c08ffb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0409f9c0 con 0x7f4c0409f350 2023-10-03T10:13:45.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.453+0000 7f4c02d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4c041371c0 0x7f4c041395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.453+0000 7f4c02d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4c041371c0 0x7f4c041395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42876/0 (socket says 172.21.15.146:42876) 2023-10-03T10:13:45.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.453+0000 7f4c02d9d700 1 -- 172.21.15.146:0/3304139897 learned_addr learned my addr 172.21.15.146:0/3304139897 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:45.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.453+0000 7f4c01d9b700 1 --2- 172.21.15.146:0/3304139897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c0409f350 0x7f4c04136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.453+0000 7f4c02d9d700 1 -- 172.21.15.146:0/3304139897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c0409f350 msgr2=0x7f4c04136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:45.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.453+0000 7f4c02d9d700 1 --2- 172.21.15.146:0/3304139897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c0409f350 0x7f4c04136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.453+0000 7f4c02d9d700 1 -- 172.21.15.146:0/3304139897 >> v1:172.21.15.146:6789/0 conn(0x7f4c0409e870 legacy=0x7f4c0409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.453+0000 7f4c02d9d700 1 -- 172.21.15.146:0/3304139897 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0409bab0 con 0x7f4c041371c0 2023-10-03T10:13:45.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.454+0000 7f4c02d9d700 1 --2- 172.21.15.146:0/3304139897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c041371c0 0x7f4c041395a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc009e50 tx=0x7f4bfc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff163a839c624df3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:45.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.454+0000 7f4c0159a700 1 -- 172.21.15.146:0/3304139897 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc00e070 con 0x7f4c041371c0 2023-10-03T10:13:45.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.454+0000 7f4c0159a700 1 -- 172.21.15.146:0/3304139897 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc00b910 con 0x7f4c041371c0 2023-10-03T10:13:45.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.454+0000 7f4c0159a700 1 -- 172.21.15.146:0/3304139897 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc00bca0 con 0x7f4c041371c0 2023-10-03T10:13:45.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.454+0000 7f4c08ffb700 1 -- 172.21.15.146:0/3304139897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c041371c0 msgr2=0x7f4c041395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.454+0000 7f4c08ffb700 1 --2- 172.21.15.146:0/3304139897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c041371c0 0x7f4c041395a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc009e50 tx=0x7f4bfc00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:45.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.454+0000 7f4c08ffb700 1 -- 172.21.15.146:0/3304139897 shutdown_connections 2023-10-03T10:13:45.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.454+0000 7f4c08ffb700 1 --2- 172.21.15.146:0/3304139897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c041371c0 0x7f4c041395a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.454+0000 7f4c08ffb700 1 --2- 172.21.15.146:0/3304139897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c0409f350 0x7f4c04136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.454+0000 7f4c08ffb700 1 -- 172.21.15.146:0/3304139897 >> 172.21.15.146:0/3304139897 conn(0x7f4c040a4430 msgr2=0x7f4c040a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:45.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.454+0000 7f4c08ffb700 1 -- 172.21.15.146:0/3304139897 shutdown_connections 2023-10-03T10:13:45.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.454+0000 7f4c08ffb700 1 -- 172.21.15.146:0/3304139897 wait complete. 2023-10-03T10:13:45.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.455+0000 7f4c08ffb700 1 Processor -- start 2023-10-03T10:13:45.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.456+0000 7f4c08ffb700 1 -- start start 2023-10-03T10:13:45.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.456+0000 7f4c08ffb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c0409e870 0x7f4c041c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.456+0000 7f4c08ffb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4c0409f350 0x7f4c041c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.456+0000 7f4c08ffb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c041371c0 0x7f4c041c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:45.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.456+0000 7f4c08ffb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0406d4c0 con 0x7f4c0409e870 2023-10-03T10:13:45.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.456+0000 7f4c08ffb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c04125090 con 0x7f4c041371c0 2023-10-03T10:13:45.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.456+0000 7f4c08ffb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c04125300 con 0x7f4c0409f350 2023-10-03T10:13:45.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.456+0000 7f4c0259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c0409e870 0x7f4c041c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.456+0000 7f4c0259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c0409e870 0x7f4c041c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42882/0 (socket says 172.21.15.146:42882) 2023-10-03T10:13:45.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.456+0000 7f4c0259c700 1 -- 172.21.15.146:0/2016354554 learned_addr learned my addr 172.21.15.146:0/2016354554 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:45.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.456+0000 7f4c02d9d700 1 --2- 172.21.15.146:0/2016354554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c041371c0 0x7f4c041c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:45.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.456+0000 7f4c0259c700 1 -- 172.21.15.146:0/2016354554 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4c0409f350 msgr2=0x7f4c041c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.456+0000 7f4c0259c700 1 --2- 172.21.15.146:0/2016354554 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4c0409f350 0x7f4c041c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.456+0000 7f4c0259c700 1 -- 172.21.15.146:0/2016354554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c041371c0 msgr2=0x7f4c041c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.456+0000 7f4c0259c700 1 --2- 172.21.15.146:0/2016354554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c041371c0 0x7f4c041c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.456+0000 7f4c0259c700 1 -- 172.21.15.146:0/2016354554 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bfc009b30 con 0x7f4c0409e870 2023-10-03T10:13:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.457+0000 7f4c0259c700 1 --2- 172.21.15.146:0/2016354554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c0409e870 0x7f4c041c83d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400c4e0 tx=0x7f4bf400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.457+0000 7f4bf2ffd700 1 -- 172.21.15.146:0/2016354554 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf40052d0 con 0x7f4c0409e870 2023-10-03T10:13:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.457+0000 7f4c08ffb700 1 -- 172.21.15.146:0/2016354554 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c040723f0 con 0x7f4c0409e870 2023-10-03T10:13:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.457+0000 7f4bf2ffd700 1 -- 172.21.15.146:0/2016354554 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf4005430 con 0x7f4c0409e870 2023-10-03T10:13:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.457+0000 7f4bf2ffd700 1 -- 172.21.15.146:0/2016354554 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf40038c0 con 0x7f4c0409e870 2023-10-03T10:13:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.457+0000 7f4c08ffb700 1 -- 172.21.15.146:0/2016354554 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c04125a90 con 0x7f4c0409e870 2023-10-03T10:13:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.458+0000 7f4bf2ffd700 1 -- 172.21.15.146:0/2016354554 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4bf4003a20 con 0x7f4c0409e870 2023-10-03T10:13:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.458+0000 7f4bf2ffd700 1 -- 172.21.15.146:0/2016354554 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4bf4010e00 con 0x7f4c0409e870 2023-10-03T10:13:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.458+0000 7f4c08ffb700 1 -- 172.21.15.146:0/2016354554 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c04124cc0 con 0x7f4c0409e870 2023-10-03T10:13:45.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.463+0000 7f4bf2ffd700 1 -- 172.21.15.146:0/2016354554 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4bf4017070 con 0x7f4c0409e870 2023-10-03T10:13:45.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.564+0000 7fc785dd3700 1 -- 172.21.15.146:0/1708751467 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc78004f2a0 con 0x7fc780133ad0 2023-10-03T10:13:45.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.564+0000 7fc767fff700 1 -- 172.21.15.146:0/1708751467 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc778011b40 con 0x7fc780133ad0 2023-10-03T10:13:45.564 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:45.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.566+0000 7fc785dd3700 1 -- 172.21.15.146:0/1708751467 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc780133ad0 msgr2=0x7fc78011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.566+0000 7fc785dd3700 1 --2- 172.21.15.146:0/1708751467 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc780133ad0 0x7fc78011e4c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc778015000 tx=0x7fc778004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.566+0000 7fc785dd3700 1 -- 172.21.15.146:0/1708751467 shutdown_connections 2023-10-03T10:13:45.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.566+0000 7fc785dd3700 1 --2- 172.21.15.146:0/1708751467 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc780133ad0 0x7fc78011e4c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.566+0000 7fc785dd3700 1 --2- 172.21.15.146:0/1708751467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7801300a0 0x7fc78011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.566+0000 7fc785dd3700 1 --2- 172.21.15.146:0/1708751467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7801309f0 0x7fc78011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.566+0000 7fc785dd3700 1 -- 172.21.15.146:0/1708751467 >> 172.21.15.146:0/1708751467 conn(0x7fc780099c40 msgr2=0x7fc780132ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:45.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.567+0000 7fc785dd3700 1 -- 172.21.15.146:0/1708751467 shutdown_connections 2023-10-03T10:13:45.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.567+0000 7fc785dd3700 1 -- 172.21.15.146:0/1708751467 wait complete. 2023-10-03T10:13:45.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.581+0000 7f060ea6e700 1 -- 172.21.15.146:0/429174362 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f060806bce0 con 0x7f06081304a0 2023-10-03T10:13:45.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.582+0000 7f06057fa700 1 -- 172.21.15.146:0/429174362 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f060002b710 con 0x7f06081304a0 2023-10-03T10:13:45.581 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:45.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:45.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.585+0000 7f060ea6e700 1 -- 172.21.15.146:0/429174362 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06081304a0 msgr2=0x7f060811b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.585+0000 7f060ea6e700 1 --2- 172.21.15.146:0/429174362 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06081304a0 0x7f060811b7d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0608099eb0 tx=0x7f0600004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.585+0000 7f060ea6e700 1 -- 172.21.15.146:0/429174362 shutdown_connections 2023-10-03T10:13:45.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.585+0000 7f060ea6e700 1 --2- 172.21.15.146:0/429174362 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06081304a0 0x7f060811b7d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.585+0000 7f060ea6e700 1 --2- 172.21.15.146:0/429174362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06080a0a30 0x7f060811ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.585+0000 7f060ea6e700 1 --2- 172.21.15.146:0/429174362 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06080a1340 0x7f060811b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.585+0000 7f060ea6e700 1 -- 172.21.15.146:0/429174362 >> 172.21.15.146:0/429174362 conn(0x7f06080a2980 msgr2=0x7f060809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:45.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.585+0000 7f060ea6e700 1 -- 172.21.15.146:0/429174362 shutdown_connections 2023-10-03T10:13:45.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.585+0000 7f060ea6e700 1 -- 172.21.15.146:0/429174362 wait complete. 2023-10-03T10:13:45.597 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:45.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.646+0000 7f0cc7360700 1 -- 172.21.15.146:0/2520303383 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0cc009f660 con 0x7f0cc009e870 2023-10-03T10:13:45.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.646+0000 7f0cb5ffb700 1 -- 172.21.15.146:0/2520303383 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0cbc029090 con 0x7f0cc009e870 2023-10-03T10:13:45.646 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.649+0000 7f0cc7360700 1 -- 172.21.15.146:0/2520303383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc009e870 msgr2=0x7f0cc0135a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.649+0000 7f0cc7360700 1 --2- 172.21.15.146:0/2520303383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc009e870 0x7f0cc0135a50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00b560 tx=0x7f0cbc00b870 comp rx=0 tx=0).stop 2023-10-03T10:13:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.649+0000 7f0cc7360700 1 -- 172.21.15.146:0/2520303383 shutdown_connections 2023-10-03T10:13:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.649+0000 7f0cc7360700 1 --2- 172.21.15.146:0/2520303383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc0131d70 0x7f0cc01364d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.649+0000 7f0cc7360700 1 --2- 172.21.15.146:0/2520303383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0cc009e870 0x7f0cc0135a50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.649+0000 7f0cc7360700 1 --2- 172.21.15.146:0/2520303383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0cc009f180 0x7f0cc0135f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.649+0000 7f0cc7360700 1 -- 172.21.15.146:0/2520303383 >> 172.21.15.146:0/2520303383 conn(0x7f0cc00a4430 msgr2=0x7f0cc009cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:45.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.649+0000 7f0cc7360700 1 -- 172.21.15.146:0/2520303383 shutdown_connections 2023-10-03T10:13:45.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.649+0000 7f0cc7360700 1 -- 172.21.15.146:0/2520303383 wait complete. 2023-10-03T10:13:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.655+0000 7f4c08ffb700 1 -- 172.21.15.146:0/2016354554 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4c0404f2a0 con 0x7f4c0409e870 2023-10-03T10:13:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.655+0000 7f4bf2ffd700 1 -- 172.21.15.146:0/2016354554 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4bf4017030 con 0x7f4c0409e870 2023-10-03T10:13:45.655 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:45.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.657+0000 7f4c08ffb700 1 -- 172.21.15.146:0/2016354554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c0409e870 msgr2=0x7f4c041c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.657+0000 7f4c08ffb700 1 --2- 172.21.15.146:0/2016354554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c0409e870 0x7f4c041c83d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400c4e0 tx=0x7f4bf400c7f0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.657+0000 7f4c08ffb700 1 -- 172.21.15.146:0/2016354554 shutdown_connections 2023-10-03T10:13:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.657+0000 7f4c08ffb700 1 --2- 172.21.15.146:0/2016354554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c041371c0 0x7f4c041c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.657+0000 7f4c08ffb700 1 --2- 172.21.15.146:0/2016354554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c0409e870 0x7f4c041c83d0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.657+0000 7f4c08ffb700 1 --2- 172.21.15.146:0/2016354554 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4c0409f350 0x7f4c041c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.657+0000 7f4c08ffb700 1 -- 172.21.15.146:0/2016354554 >> 172.21.15.146:0/2016354554 conn(0x7f4c040a4430 msgr2=0x7f4c0409cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.658+0000 7f4c08ffb700 1 -- 172.21.15.146:0/2016354554 shutdown_connections 2023-10-03T10:13:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:45.658+0000 7f4c08ffb700 1 -- 172.21.15.146:0/2016354554 wait complete. 2023-10-03T10:13:45.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:45.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:46.584 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:46.598 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:46.661 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:46.670 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:46.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.720+0000 7f514cd5c700 1 Processor -- start 2023-10-03T10:13:46.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.720+0000 7f514cd5c700 1 -- start start 2023-10-03T10:13:46.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.721+0000 7f514cd5c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5148133ad0 0x7f5148133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.721+0000 7f514cd5c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51481300a0 0x7f51481304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.721+0000 7f514cd5c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514806b2d0 con 0x7f51481309f0 2023-10-03T10:13:46.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.721+0000 7f514cd5c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5148133610 con 0x7f51481300a0 2023-10-03T10:13:46.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.721+0000 7f514cd5c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f514809a500 con 0x7f5148133ad0 2023-10-03T10:13:46.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.721+0000 7f5146d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f51481309f0 0x7f514813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58606/0 (socket says 172.21.15.146:58606) 2023-10-03T10:13:46.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.721+0000 7f514659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5148133ad0 0x7f5148133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.721+0000 7f5146d9d700 1 -- 172.21.15.146:0/3021244004 learned_addr learned my addr 172.21.15.146:0/3021244004 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:46.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.721+0000 7f5145d9b700 1 --2- 172.21.15.146:0/3021244004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51481300a0 0x7f51481304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.721+0000 7f514559a700 1 -- 172.21.15.146:0/3021244004 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576198145 0 0) 0x7f514806b2d0 con 0x7f51481309f0 2023-10-03T10:13:46.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.721+0000 7f514659c700 1 -- 172.21.15.146:0/3021244004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51481300a0 msgr2=0x7f51481304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:46.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.721+0000 7f514659c700 1 --2- 172.21.15.146:0/3021244004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51481300a0 0x7f51481304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.721+0000 7f514659c700 1 -- 172.21.15.146:0/3021244004 >> v1:172.21.15.146:6789/0 conn(0x7f51481309f0 legacy=0x7f514813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.721+0000 7f514659c700 1 -- 172.21.15.146:0/3021244004 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51481338b0 con 0x7f5148133ad0 2023-10-03T10:13:46.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.722+0000 7f514659c700 1 --2- 172.21.15.146:0/3021244004 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5148133ad0 0x7f5148133ea0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5138009870 tx=0x7f5138009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cacbe8b1f707b9f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.722+0000 7f514559a700 1 -- 172.21.15.146:0/3021244004 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5138011830 con 0x7f5148133ad0 2023-10-03T10:13:46.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.722+0000 7f514559a700 1 -- 172.21.15.146:0/3021244004 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5138011990 con 0x7f5148133ad0 2023-10-03T10:13:46.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.722+0000 7f514559a700 1 -- 172.21.15.146:0/3021244004 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5138011d20 con 0x7f5148133ad0 2023-10-03T10:13:46.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.723+0000 7f514cd5c700 1 -- 172.21.15.146:0/3021244004 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5148133ad0 msgr2=0x7f5148133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.723+0000 7f514cd5c700 1 --2- 172.21.15.146:0/3021244004 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5148133ad0 0x7f5148133ea0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5138009870 tx=0x7f5138009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:46.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.723+0000 7f514cd5c700 1 -- 172.21.15.146:0/3021244004 shutdown_connections 2023-10-03T10:13:46.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.723+0000 7f514cd5c700 1 --2- 172.21.15.146:0/3021244004 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5148133ad0 0x7f5148133ea0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.723+0000 7f514cd5c700 1 --2- 172.21.15.146:0/3021244004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51481300a0 0x7f51481304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.723+0000 7f514cd5c700 1 -- 172.21.15.146:0/3021244004 >> 172.21.15.146:0/3021244004 conn(0x7f5148099c40 msgr2=0x7f51480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.723+0000 7f514cd5c700 1 -- 172.21.15.146:0/3021244004 shutdown_connections 2023-10-03T10:13:46.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.723+0000 7f514cd5c700 1 -- 172.21.15.146:0/3021244004 wait complete. 2023-10-03T10:13:46.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.724+0000 7f514cd5c700 1 Processor -- start 2023-10-03T10:13:46.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.724+0000 7f514cd5c700 1 -- start start 2023-10-03T10:13:46.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.725+0000 7f514cd5c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51481300a0 0x7f51480713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.725+0000 7f514cd5c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51481309f0 0x7f5148071920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.725+0000 7f514cd5c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5148133ad0 0x7f5148071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.725+0000 7f514cd5c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514811e040 con 0x7f51481309f0 2023-10-03T10:13:46.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.725+0000 7f514cd5c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5148072840 con 0x7f51481300a0 2023-10-03T10:13:46.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.725+0000 7f514cd5c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f514811eed0 con 0x7f5148133ad0 2023-10-03T10:13:46.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.725+0000 7f5146d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5148133ad0 0x7f5148071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.725+0000 7f5146d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5148133ad0 0x7f5148071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57330/0 (socket says 172.21.15.146:57330) 2023-10-03T10:13:46.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.725+0000 7f5146d9d700 1 -- 172.21.15.146:0/1219023761 learned_addr learned my addr 172.21.15.146:0/1219023761 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:46.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.725+0000 7f5145d9b700 1 --2- 172.21.15.146:0/1219023761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51481309f0 0x7f5148071920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.725+0000 7f514659c700 1 --2- 172.21.15.146:0/1219023761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51481300a0 0x7f51480713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.726+0000 7f5145d9b700 1 -- 172.21.15.146:0/1219023761 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5148133ad0 msgr2=0x7f5148071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.726+0000 7f5145d9b700 1 --2- 172.21.15.146:0/1219023761 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5148133ad0 0x7f5148071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.726+0000 7f5145d9b700 1 -- 172.21.15.146:0/1219023761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51481300a0 msgr2=0x7f51480713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.726+0000 7f5145d9b700 1 --2- 172.21.15.146:0/1219023761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51481300a0 0x7f51480713e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.726+0000 7f5145d9b700 1 -- 172.21.15.146:0/1219023761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51380094a0 con 0x7f51481309f0 2023-10-03T10:13:46.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.726+0000 7f5145d9b700 1 --2- 172.21.15.146:0/1219023761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51481309f0 0x7f5148071920 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f513c00e870 tx=0x7f513c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.726+0000 7f5136ffd700 1 -- 172.21.15.146:0/1219023761 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c013680 con 0x7f51481309f0 2023-10-03T10:13:46.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.726+0000 7f5136ffd700 1 -- 172.21.15.146:0/1219023761 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c0137e0 con 0x7f51481309f0 2023-10-03T10:13:46.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.726+0000 7f5136ffd700 1 -- 172.21.15.146:0/1219023761 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c013b50 con 0x7f51481309f0 2023-10-03T10:13:46.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.726+0000 7f514cd5c700 1 -- 172.21.15.146:0/1219023761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514811f9b0 con 0x7f51481309f0 2023-10-03T10:13:46.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.726+0000 7f514cd5c700 1 -- 172.21.15.146:0/1219023761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514812dd00 con 0x7f51481309f0 2023-10-03T10:13:46.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.727+0000 7f514cd5c700 1 -- 172.21.15.146:0/1219023761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514804f2a0 con 0x7f51481309f0 2023-10-03T10:13:46.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.727+0000 7f5136ffd700 1 -- 172.21.15.146:0/1219023761 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f513c013cb0 con 0x7f51481309f0 2023-10-03T10:13:46.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.728+0000 7f5136ffd700 1 -- 172.21.15.146:0/1219023761 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f513c03f900 con 0x7f51481309f0 2023-10-03T10:13:46.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.736+0000 7f5136ffd700 1 -- 172.21.15.146:0/1219023761 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f513c011d90 con 0x7f51481309f0 2023-10-03T10:13:46.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.766+0000 7f6c75036700 1 Processor -- start 2023-10-03T10:13:46.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.766+0000 7f6c75036700 1 -- start start 2023-10-03T10:13:46.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.766+0000 7f6c75036700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6c70138040 0x7f6c70138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.766+0000 7f6c75036700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700a08e0 0x7f6c700a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.766+0000 7f6c75036700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c701379e0 con 0x7f6c700a1230 2023-10-03T10:13:46.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.766+0000 7f6c75036700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c700a2100 con 0x7f6c70138040 2023-10-03T10:13:46.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.766+0000 7f6c75036700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c70138950 con 0x7f6c700a08e0 2023-10-03T10:13:46.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.766+0000 7f6c6e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700a08e0 0x7f6c700a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.767+0000 7f6c6e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700a08e0 0x7f6c700a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40294/0 (socket says 172.21.15.146:40294) 2023-10-03T10:13:46.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.766+0000 7f6c6f59e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6c700a1230 0x7f6c7013ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58622/0 (socket says 172.21.15.146:58622) 2023-10-03T10:13:46.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.767+0000 7f6c6e59c700 1 -- 172.21.15.146:0/2376754306 learned_addr learned my addr 172.21.15.146:0/2376754306 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:46.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.767+0000 7f6c6ed9d700 1 --2- 172.21.15.146:0/2376754306 >> v2:172.21.15.146:3300/0 conn(0x7f6c70138040 0x7f6c70138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.767+0000 7f6c6e59c700 1 -- 172.21.15.146:0/2376754306 >> v2:172.21.15.146:3300/0 conn(0x7f6c70138040 msgr2=0x7f6c70138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:46.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.767+0000 7f6c6e59c700 1 --2- 172.21.15.146:0/2376754306 >> v2:172.21.15.146:3300/0 conn(0x7f6c70138040 0x7f6c70138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.767+0000 7f6c6e59c700 1 -- 172.21.15.146:0/2376754306 >> v1:172.21.15.146:6789/0 conn(0x7f6c700a1230 legacy=0x7f6c7013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.767+0000 7f6c6e59c700 1 -- 172.21.15.146:0/2376754306 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7009b9b0 con 0x7f6c700a08e0 2023-10-03T10:13:46.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.767+0000 7f6c6e59c700 1 --2- 172.21.15.146:0/2376754306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700a08e0 0x7f6c700a0cf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6c64009920 tx=0x7f6c64009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8334c5d8ee814c35 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.767+0000 7f6c6dd9b700 1 -- 172.21.15.146:0/2376754306 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64011830 con 0x7f6c700a08e0 2023-10-03T10:13:46.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.767+0000 7f6c6dd9b700 1 -- 172.21.15.146:0/2376754306 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c64011990 con 0x7f6c700a08e0 2023-10-03T10:13:46.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.767+0000 7f6c6dd9b700 1 -- 172.21.15.146:0/2376754306 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64011d20 con 0x7f6c700a08e0 2023-10-03T10:13:46.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.768+0000 7f6c75036700 1 -- 172.21.15.146:0/2376754306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700a08e0 msgr2=0x7f6c700a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.768+0000 7f6c75036700 1 --2- 172.21.15.146:0/2376754306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700a08e0 0x7f6c700a0cf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6c64009920 tx=0x7f6c64009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:46.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.768+0000 7f6c75036700 1 -- 172.21.15.146:0/2376754306 shutdown_connections 2023-10-03T10:13:46.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.768+0000 7f6c75036700 1 --2- 172.21.15.146:0/2376754306 >> v2:172.21.15.146:3300/0 conn(0x7f6c70138040 0x7f6c70138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.768+0000 7f6c75036700 1 --2- 172.21.15.146:0/2376754306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700a08e0 0x7f6c700a0cf0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.768+0000 7f6c75036700 1 -- 172.21.15.146:0/2376754306 >> 172.21.15.146:0/2376754306 conn(0x7f6c700a2980 msgr2=0x7f6c700a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.768+0000 7f6c75036700 1 -- 172.21.15.146:0/2376754306 shutdown_connections 2023-10-03T10:13:46.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.768+0000 7f6c75036700 1 -- 172.21.15.146:0/2376754306 wait complete. 2023-10-03T10:13:46.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.769+0000 7f6c75036700 1 Processor -- start 2023-10-03T10:13:46.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.769+0000 7f6c75036700 1 -- start start 2023-10-03T10:13:46.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.770+0000 7f6c75036700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c700a08e0 0x7f6c70137330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.770+0000 7f6c75036700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c700a1230 0x7f6c70135b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.770+0000 7f6c75036700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c70138040 0x7f6c70136050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.770+0000 7f6c75036700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c701406d0 con 0x7f6c700a1230 2023-10-03T10:13:46.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.770+0000 7f6c75036700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c70137870 con 0x7f6c70138040 2023-10-03T10:13:46.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.770+0000 7f6c75036700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c70130270 con 0x7f6c700a08e0 2023-10-03T10:13:46.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.770+0000 7f6c6ed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c700a08e0 0x7f6c70137330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.770+0000 7f6c6ed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c700a08e0 0x7f6c70137330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57346/0 (socket says 172.21.15.146:57346) 2023-10-03T10:13:46.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.770+0000 7f6c6ed9d700 1 -- 172.21.15.146:0/3976933679 learned_addr learned my addr 172.21.15.146:0/3976933679 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:46.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.770+0000 7f6c6f59e700 1 --2- 172.21.15.146:0/3976933679 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c70138040 0x7f6c70136050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.770+0000 7f6c6e59c700 1 --2- 172.21.15.146:0/3976933679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c700a1230 0x7f6c70135b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.771+0000 7f6c6e59c700 1 -- 172.21.15.146:0/3976933679 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c700a08e0 msgr2=0x7f6c70137330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.771+0000 7f6c6e59c700 1 --2- 172.21.15.146:0/3976933679 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c700a08e0 0x7f6c70137330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.771+0000 7f6c6e59c700 1 -- 172.21.15.146:0/3976933679 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c70138040 msgr2=0x7f6c70136050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.771+0000 7f6c6e59c700 1 --2- 172.21.15.146:0/3976933679 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c70138040 0x7f6c70136050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.771+0000 7f6c6e59c700 1 -- 172.21.15.146:0/3976933679 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c64009550 con 0x7f6c700a1230 2023-10-03T10:13:46.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.771+0000 7f6c6f59e700 1 --2- 172.21.15.146:0/3976933679 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c70138040 0x7f6c70136050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:46.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.771+0000 7f6c6ed9d700 1 --2- 172.21.15.146:0/3976933679 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c700a08e0 0x7f6c70137330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:46.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.771+0000 7f6c6e59c700 1 --2- 172.21.15.146:0/3976933679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c700a1230 0x7f6c70135b10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6c64009920 tx=0x7f6c64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.771+0000 7f6c577fe700 1 -- 172.21.15.146:0/3976933679 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64004510 con 0x7f6c700a1230 2023-10-03T10:13:46.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.771+0000 7f6c577fe700 1 -- 172.21.15.146:0/3976933679 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6401e070 con 0x7f6c700a1230 2023-10-03T10:13:46.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.771+0000 7f6c75036700 1 -- 172.21.15.146:0/3976933679 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c701194a0 con 0x7f6c700a1230 2023-10-03T10:13:46.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.771+0000 7f6c577fe700 1 -- 172.21.15.146:0/3976933679 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c640038e0 con 0x7f6c700a1230 2023-10-03T10:13:46.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.771+0000 7f6c75036700 1 -- 172.21.15.146:0/3976933679 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7009a240 con 0x7f6c700a1230 2023-10-03T10:13:46.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.772+0000 7f6c577fe700 1 -- 172.21.15.146:0/3976933679 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c64003a40 con 0x7f6c700a1230 2023-10-03T10:13:46.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.772+0000 7f6c577fe700 1 -- 172.21.15.146:0/3976933679 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6c64040660 con 0x7f6c700a1230 2023-10-03T10:13:46.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.772+0000 7f6c75036700 1 -- 172.21.15.146:0/3976933679 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7004f2a0 con 0x7f6c700a1230 2023-10-03T10:13:46.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.777+0000 7f6c577fe700 1 -- 172.21.15.146:0/3976933679 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c64015080 con 0x7f6c700a1230 2023-10-03T10:13:46.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.805+0000 7fc611002700 1 Processor -- start 2023-10-03T10:13:46.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.805+0000 7fc611002700 1 -- start start 2023-10-03T10:13:46.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.806+0000 7fc611002700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc60c1338e0 0x7fc60c133cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.806+0000 7fc611002700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc60c099a60 0x7fc60c099e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.806+0000 7fc611002700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60c09ba00 con 0x7fc60c09a3d0 2023-10-03T10:13:46.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.806+0000 7fc611002700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc60c06f790 con 0x7fc60c099a60 2023-10-03T10:13:46.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.806+0000 7fc611002700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c06f970 con 0x7fc60c1338e0 2023-10-03T10:13:46.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.806+0000 7fc60a59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc60c099a60 0x7fc60c099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.806+0000 7fc60b59e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc60c09a3d0 0x7fc60c13a720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58636/0 (socket says 172.21.15.146:58636) 2023-10-03T10:13:46.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.806+0000 7fc60a59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc60c099a60 0x7fc60c099e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42932/0 (socket says 172.21.15.146:42932) 2023-10-03T10:13:46.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.806+0000 7fc60b59e700 1 -- 172.21.15.146:0/1410577338 learned_addr learned my addr 172.21.15.146:0/1410577338 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:46.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.806+0000 7fc60ad9d700 1 --2- 172.21.15.146:0/1410577338 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc60c1338e0 0x7fc60c133cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.806+0000 7fc60ad9d700 1 -- 172.21.15.146:0/1410577338 >> v2:172.21.15.146:3300/0 conn(0x7fc60c099a60 msgr2=0x7fc60c099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:46.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.806+0000 7fc60ad9d700 1 --2- 172.21.15.146:0/1410577338 >> v2:172.21.15.146:3300/0 conn(0x7fc60c099a60 0x7fc60c099e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.806+0000 7fc60ad9d700 1 -- 172.21.15.146:0/1410577338 >> v1:172.21.15.146:6789/0 conn(0x7fc60c09a3d0 legacy=0x7fc60c13a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.806+0000 7fc60ad9d700 1 -- 172.21.15.146:0/1410577338 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60c09b680 con 0x7fc60c1338e0 2023-10-03T10:13:46.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.806+0000 7fc60a59c700 1 --2- 172.21.15.146:0/1410577338 >> v2:172.21.15.146:3300/0 conn(0x7fc60c099a60 0x7fc60c099e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:46.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.806+0000 7fc60ad9d700 1 --2- 172.21.15.146:0/1410577338 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc60c1338e0 0x7fc60c133cb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009840 tx=0x7fc5fc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c41a9840cb9c5dc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.808+0000 7fc609d9b700 1 -- 172.21.15.146:0/1410577338 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc004230 con 0x7fc60c1338e0 2023-10-03T10:13:46.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.808+0000 7fc609d9b700 1 -- 172.21.15.146:0/1410577338 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc004390 con 0x7fc60c1338e0 2023-10-03T10:13:46.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.808+0000 7fc609d9b700 1 -- 172.21.15.146:0/1410577338 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc0036a0 con 0x7fc60c1338e0 2023-10-03T10:13:46.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.808+0000 7fc611002700 1 -- 172.21.15.146:0/1410577338 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc60c1338e0 msgr2=0x7fc60c133cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.808+0000 7fc611002700 1 --2- 172.21.15.146:0/1410577338 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc60c1338e0 0x7fc60c133cb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009840 tx=0x7fc5fc009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:46.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.808+0000 7fc611002700 1 -- 172.21.15.146:0/1410577338 shutdown_connections 2023-10-03T10:13:46.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.808+0000 7fc611002700 1 --2- 172.21.15.146:0/1410577338 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc60c1338e0 0x7fc60c133cb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.808+0000 7fc611002700 1 --2- 172.21.15.146:0/1410577338 >> v2:172.21.15.146:3300/0 conn(0x7fc60c099a60 0x7fc60c099e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.808+0000 7fc611002700 1 -- 172.21.15.146:0/1410577338 >> 172.21.15.146:0/1410577338 conn(0x7fc60c0a27a0 msgr2=0x7fc60c0a2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.810+0000 7fc611002700 1 -- 172.21.15.146:0/1410577338 shutdown_connections 2023-10-03T10:13:46.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.810+0000 7fc611002700 1 -- 172.21.15.146:0/1410577338 wait complete. 2023-10-03T10:13:46.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.811+0000 7fc611002700 1 Processor -- start 2023-10-03T10:13:46.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.811+0000 7fc611002700 1 -- start start 2023-10-03T10:13:46.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.811+0000 7fc611002700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc60c099a60 0x7fc60c1d5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.811+0000 7fc611002700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc60c09a3d0 0x7fc60c1d56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.811+0000 7fc611002700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc60c1338e0 0x7fc60c1d1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.811+0000 7fc611002700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c12f920 con 0x7fc60c09a3d0 2023-10-03T10:13:46.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.811+0000 7fc611002700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c12fbe0 con 0x7fc60c099a60 2023-10-03T10:13:46.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.811+0000 7fc611002700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c0a1410 con 0x7fc60c1338e0 2023-10-03T10:13:46.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.812+0000 7fc60b59e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc60c1338e0 0x7fc60c1d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.812+0000 7fc60ad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc60c099a60 0x7fc60c1d5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.812+0000 7fc60a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc60c09a3d0 0x7fc60c1d56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.812+0000 7fc60ad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc60c099a60 0x7fc60c1d5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40302/0 (socket says 172.21.15.146:40302) 2023-10-03T10:13:46.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.812+0000 7fc60ad9d700 1 -- 172.21.15.146:0/1140234603 learned_addr learned my addr 172.21.15.146:0/1140234603 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:46.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.812+0000 7fc60b59e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc60c1338e0 0x7fc60c1d1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57360/0 (socket says 172.21.15.146:57360) 2023-10-03T10:13:46.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.812+0000 7fc60b59e700 1 -- 172.21.15.146:0/1140234603 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc60c099a60 msgr2=0x7fc60c1d5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.812+0000 7fc60b59e700 1 --2- 172.21.15.146:0/1140234603 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc60c099a60 0x7fc60c1d5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.812+0000 7fc60b59e700 1 -- 172.21.15.146:0/1140234603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc60c09a3d0 msgr2=0x7fc60c1d56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.812+0000 7fc60b59e700 1 --2- 172.21.15.146:0/1140234603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc60c09a3d0 0x7fc60c1d56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.812+0000 7fc60b59e700 1 -- 172.21.15.146:0/1140234603 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6000094a0 con 0x7fc60c1338e0 2023-10-03T10:13:46.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.812+0000 7fc60ad9d700 1 --2- 172.21.15.146:0/1140234603 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc60c099a60 0x7fc60c1d5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:46.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.812+0000 7fc60b59e700 1 --2- 172.21.15.146:0/1140234603 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc60c1338e0 0x7fc60c1d1660 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc60400cc80 tx=0x7fc60400cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.812+0000 7fc5f37fe700 1 -- 172.21.15.146:0/1140234603 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60400aac0 con 0x7fc60c1338e0 2023-10-03T10:13:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.813+0000 7fc5f37fe700 1 -- 172.21.15.146:0/1140234603 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60400ac20 con 0x7fc60c1338e0 2023-10-03T10:13:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.813+0000 7fc611002700 1 -- 172.21.15.146:0/1140234603 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5fc0094a0 con 0x7fc60c1338e0 2023-10-03T10:13:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.813+0000 7fc5f37fe700 1 -- 172.21.15.146:0/1140234603 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6040070d0 con 0x7fc60c1338e0 2023-10-03T10:13:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.813+0000 7fc611002700 1 -- 172.21.15.146:0/1140234603 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60c12dfb0 con 0x7fc60c1338e0 2023-10-03T10:13:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.814+0000 7fc611002700 1 -- 172.21.15.146:0/1140234603 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc60c04f2a0 con 0x7fc60c1338e0 2023-10-03T10:13:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.814+0000 7fc5f37fe700 1 -- 172.21.15.146:0/1140234603 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc604007230 con 0x7fc60c1338e0 2023-10-03T10:13:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.814+0000 7fc5f37fe700 1 -- 172.21.15.146:0/1140234603 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc60403f380 con 0x7fc60c1338e0 2023-10-03T10:13:46.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.816+0000 7f109e239700 1 Processor -- start 2023-10-03T10:13:46.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.816+0000 7f109e239700 1 -- start start 2023-10-03T10:13:46.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.817+0000 7f109e239700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f109809d860 0x7f109809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.817+0000 7f109e239700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1098130eb0 0x7f1098138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.817+0000 7f109e239700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109809aaa0 con 0x7f109809e170 2023-10-03T10:13:46.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.817+0000 7f109e239700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109809f870 con 0x7f1098130eb0 2023-10-03T10:13:46.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.817+0000 7f109e239700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f109809b360 con 0x7f109809d860 2023-10-03T10:13:46.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.819+0000 7f10977fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f109809d860 0x7f109809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.819+0000 7f10977fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f109809d860 0x7f109809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57372/0 (socket says 172.21.15.146:57372) 2023-10-03T10:13:46.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.819+0000 7f10977fe700 1 -- 172.21.15.146:0/284010001 learned_addr learned my addr 172.21.15.146:0/284010001 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:46.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.820+0000 7f1097fff700 1 --2- 172.21.15.146:0/284010001 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1098130eb0 0x7f1098138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.820+0000 7f10977fe700 1 -- 172.21.15.146:0/284010001 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1098130eb0 msgr2=0x7f1098138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:46.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.820+0000 7f10977fe700 1 --2- 172.21.15.146:0/284010001 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1098130eb0 0x7f1098138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.820+0000 7f10977fe700 1 -- 172.21.15.146:0/284010001 >> v1:172.21.15.146:6789/0 conn(0x7f109809e170 legacy=0x7f10981307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.820+0000 7f10977fe700 1 -- 172.21.15.146:0/284010001 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109809b620 con 0x7f109809d860 2023-10-03T10:13:46.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.820+0000 7fc5f37fe700 1 -- 172.21.15.146:0/1140234603 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc604019860 con 0x7fc60c1338e0 2023-10-03T10:13:46.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.820+0000 7f10977fe700 1 --2- 172.21.15.146:0/284010001 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f109809d860 0x7f109809dc30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f108800bbc0 tx=0x7f108800bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9062560c0ea8e15 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.820+0000 7f10967fc700 1 -- 172.21.15.146:0/284010001 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108800dd90 con 0x7f109809d860 2023-10-03T10:13:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.820+0000 7f10967fc700 1 -- 172.21.15.146:0/284010001 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1088010470 con 0x7f109809d860 2023-10-03T10:13:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.820+0000 7f10967fc700 1 -- 172.21.15.146:0/284010001 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088010800 con 0x7f109809d860 2023-10-03T10:13:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.821+0000 7f109e239700 1 -- 172.21.15.146:0/284010001 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f109809d860 msgr2=0x7f109809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.821+0000 7f109e239700 1 --2- 172.21.15.146:0/284010001 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f109809d860 0x7f109809dc30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f108800bbc0 tx=0x7f108800bed0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.821+0000 7f109e239700 1 -- 172.21.15.146:0/284010001 shutdown_connections 2023-10-03T10:13:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.821+0000 7f109e239700 1 --2- 172.21.15.146:0/284010001 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1098130eb0 0x7f1098138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.821+0000 7f109e239700 1 --2- 172.21.15.146:0/284010001 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f109809d860 0x7f109809dc30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.821+0000 7f109e239700 1 -- 172.21.15.146:0/284010001 >> 172.21.15.146:0/284010001 conn(0x7f1098099c40 msgr2=0x7f10980a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.821+0000 7f109e239700 1 -- 172.21.15.146:0/284010001 shutdown_connections 2023-10-03T10:13:46.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.821+0000 7f109e239700 1 -- 172.21.15.146:0/284010001 wait complete. 2023-10-03T10:13:46.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.823+0000 7f109e239700 1 Processor -- start 2023-10-03T10:13:46.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.823+0000 7f109e239700 1 -- start start 2023-10-03T10:13:46.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.824+0000 7f109e239700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f109809d860 0x7f10981c5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.824+0000 7f109e239700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f109809e170 0x7f10981c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.824+0000 7f109e239700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1098130eb0 0x7f10981c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.824+0000 7f109e239700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1098123250 con 0x7f1098130eb0 2023-10-03T10:13:46.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.824+0000 7f109e239700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10981c61a0 con 0x7f109809e170 2023-10-03T10:13:46.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.824+0000 7f109e239700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1098121590 con 0x7f109809d860 2023-10-03T10:13:46.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.824+0000 7f10977fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f109809d860 0x7f10981c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.824+0000 7f10977fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f109809d860 0x7f10981c5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57378/0 (socket says 172.21.15.146:57378) 2023-10-03T10:13:46.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.824+0000 7f10977fe700 1 -- 172.21.15.146:0/3015134884 learned_addr learned my addr 172.21.15.146:0/3015134884 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.824+0000 7f1097fff700 1 --2- 172.21.15.146:0/3015134884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1098130eb0 0x7f10981c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.824+0000 7f1096ffd700 1 --2- 172.21.15.146:0/3015134884 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f109809e170 0x7f10981c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.824+0000 7f1096ffd700 1 -- 172.21.15.146:0/3015134884 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f109809d860 msgr2=0x7f10981c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.824+0000 7f1096ffd700 1 --2- 172.21.15.146:0/3015134884 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f109809d860 0x7f10981c5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.824+0000 7f1096ffd700 1 -- 172.21.15.146:0/3015134884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1098130eb0 msgr2=0x7f10981c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.824+0000 7f1096ffd700 1 --2- 172.21.15.146:0/3015134884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1098130eb0 0x7f10981c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.824+0000 7f1096ffd700 1 -- 172.21.15.146:0/3015134884 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108800b7f0 con 0x7f109809e170 2023-10-03T10:13:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.824+0000 7f10977fe700 1 --2- 172.21.15.146:0/3015134884 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f109809d860 0x7f10981c5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.824+0000 7f1097fff700 1 --2- 172.21.15.146:0/3015134884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1098130eb0 0x7f10981c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.825+0000 7f1096ffd700 1 --2- 172.21.15.146:0/3015134884 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f109809e170 0x7f10981c5c60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f108c000f60 tx=0x7f108c00c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.825+0000 7f107ffff700 1 -- 172.21.15.146:0/3015134884 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c0050d0 con 0x7f109809e170 2023-10-03T10:13:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.825+0000 7f107ffff700 1 -- 172.21.15.146:0/3015134884 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c005230 con 0x7f109809e170 2023-10-03T10:13:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.825+0000 7f109e239700 1 -- 172.21.15.146:0/3015134884 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1098121b40 con 0x7f109809e170 2023-10-03T10:13:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.825+0000 7f107ffff700 1 -- 172.21.15.146:0/3015134884 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c003680 con 0x7f109809e170 2023-10-03T10:13:46.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.825+0000 7f109e239700 1 -- 172.21.15.146:0/3015134884 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f109809c8b0 con 0x7f109809e170 2023-10-03T10:13:46.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.826+0000 7f107ffff700 1 -- 172.21.15.146:0/3015134884 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f108c0037e0 con 0x7f109809e170 2023-10-03T10:13:46.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.826+0000 7f107ffff700 1 -- 172.21.15.146:0/3015134884 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f108c03e930 con 0x7f109809e170 2023-10-03T10:13:46.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.826+0000 7f109e239700 1 -- 172.21.15.146:0/3015134884 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109804f2a0 con 0x7f109809e170 2023-10-03T10:13:46.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.831+0000 7f107ffff700 1 -- 172.21.15.146:0/3015134884 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f108c011590 con 0x7f109809e170 2023-10-03T10:13:46.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.944+0000 7f514cd5c700 1 -- 172.21.15.146:0/1219023761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f514806c3b0 con 0x7f51481309f0 2023-10-03T10:13:46.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.944+0000 7f5136ffd700 1 -- 172.21.15.146:0/1219023761 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f513c017020 con 0x7f51481309f0 2023-10-03T10:13:46.944 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:46.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.948+0000 7f514cd5c700 1 -- 172.21.15.146:0/1219023761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51481309f0 msgr2=0x7f5148071920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.948+0000 7f514cd5c700 1 --2- 172.21.15.146:0/1219023761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51481309f0 0x7f5148071920 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f513c00e870 tx=0x7f513c00eb80 comp rx=0 tx=0).stop 2023-10-03T10:13:46.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.948+0000 7f514cd5c700 1 -- 172.21.15.146:0/1219023761 shutdown_connections 2023-10-03T10:13:46.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.948+0000 7f514cd5c700 1 --2- 172.21.15.146:0/1219023761 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5148133ad0 0x7f5148071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.948+0000 7f514cd5c700 1 --2- 172.21.15.146:0/1219023761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51481300a0 0x7f51480713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.948+0000 7f514cd5c700 1 --2- 172.21.15.146:0/1219023761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51481309f0 0x7f5148071920 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.948+0000 7f514cd5c700 1 -- 172.21.15.146:0/1219023761 >> 172.21.15.146:0/1219023761 conn(0x7f5148099c40 msgr2=0x7f514812e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.948+0000 7f514cd5c700 1 -- 172.21.15.146:0/1219023761 shutdown_connections 2023-10-03T10:13:46.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.948+0000 7f514cd5c700 1 -- 172.21.15.146:0/1219023761 wait complete. 2023-10-03T10:13:46.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:46.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.976+0000 7f6c75036700 1 -- 172.21.15.146:0/3976933679 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6c7009b650 con 0x7f6c700a1230 2023-10-03T10:13:46.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.976+0000 7f6c577fe700 1 -- 172.21.15.146:0/3976933679 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6c6401a420 con 0x7f6c700a1230 2023-10-03T10:13:46.976 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:46.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.978+0000 7f6c75036700 1 -- 172.21.15.146:0/3976933679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c700a1230 msgr2=0x7f6c70135b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.978+0000 7f6c75036700 1 --2- 172.21.15.146:0/3976933679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c700a1230 0x7f6c70135b10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6c64009920 tx=0x7f6c64004750 comp rx=0 tx=0).stop 2023-10-03T10:13:46.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.978+0000 7f6c75036700 1 -- 172.21.15.146:0/3976933679 shutdown_connections 2023-10-03T10:13:46.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.978+0000 7f6c75036700 1 --2- 172.21.15.146:0/3976933679 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c70138040 0x7f6c70136050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.978+0000 7f6c75036700 1 --2- 172.21.15.146:0/3976933679 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c700a08e0 0x7f6c70137330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.978+0000 7f6c75036700 1 --2- 172.21.15.146:0/3976933679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c700a1230 0x7f6c70135b10 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.978+0000 7f6c75036700 1 -- 172.21.15.146:0/3976933679 >> 172.21.15.146:0/3976933679 conn(0x7f6c700a2980 msgr2=0x7f6c700719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.978+0000 7f6c75036700 1 -- 172.21.15.146:0/3976933679 shutdown_connections 2023-10-03T10:13:46.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:46.978+0000 7f6c75036700 1 -- 172.21.15.146:0/3976933679 wait complete. 2023-10-03T10:13:46.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:47.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:47.019+0000 7fc611002700 1 -- 172.21.15.146:0/1140234603 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc60c06b930 con 0x7fc60c1338e0 2023-10-03T10:13:47.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:47.019+0000 7fc5f37fe700 1 -- 172.21.15.146:0/1140234603 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc604018020 con 0x7fc60c1338e0 2023-10-03T10:13:47.019 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:47.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:47.021+0000 7fc611002700 1 -- 172.21.15.146:0/1140234603 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc60c1338e0 msgr2=0x7fc60c1d1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:47.021+0000 7fc611002700 1 --2- 172.21.15.146:0/1140234603 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc60c1338e0 0x7fc60c1d1660 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc60400cc80 tx=0x7fc60400cf90 comp rx=0 tx=0).stop 2023-10-03T10:13:47.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:47.021+0000 7fc611002700 1 -- 172.21.15.146:0/1140234603 shutdown_connections 2023-10-03T10:13:47.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:47.021+0000 7fc611002700 1 --2- 172.21.15.146:0/1140234603 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc60c1338e0 0x7fc60c1d1660 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:47.021+0000 7fc611002700 1 --2- 172.21.15.146:0/1140234603 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc60c099a60 0x7fc60c1d5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:47.021+0000 7fc611002700 1 --2- 172.21.15.146:0/1140234603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc60c09a3d0 0x7fc60c1d56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:47.021+0000 7fc611002700 1 -- 172.21.15.146:0/1140234603 >> 172.21.15.146:0/1140234603 conn(0x7fc60c0a27a0 msgr2=0x7fc60c131cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:47.021+0000 7fc611002700 1 -- 172.21.15.146:0/1140234603 shutdown_connections 2023-10-03T10:13:47.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:47.021+0000 7fc611002700 1 -- 172.21.15.146:0/1140234603 wait complete. 2023-10-03T10:13:47.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:47.028+0000 7f109e239700 1 -- 172.21.15.146:0/3015134884 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f10980a23f0 con 0x7f109809e170 2023-10-03T10:13:47.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:47.029+0000 7f107ffff700 1 -- 172.21.15.146:0/3015134884 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f108c017030 con 0x7f109809e170 2023-10-03T10:13:47.028 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:47.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:47.031+0000 7f109e239700 1 -- 172.21.15.146:0/3015134884 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f109809e170 msgr2=0x7f10981c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:47.031+0000 7f109e239700 1 --2- 172.21.15.146:0/3015134884 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f109809e170 0x7f10981c5c60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f108c000f60 tx=0x7f108c00c730 comp rx=0 tx=0).stop 2023-10-03T10:13:47.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:47.031+0000 7f109e239700 1 -- 172.21.15.146:0/3015134884 shutdown_connections 2023-10-03T10:13:47.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:47.031+0000 7f109e239700 1 --2- 172.21.15.146:0/3015134884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1098130eb0 0x7f10981c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:47.031+0000 7f109e239700 1 --2- 172.21.15.146:0/3015134884 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f109809d860 0x7f10981c5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:47.031+0000 7f109e239700 1 --2- 172.21.15.146:0/3015134884 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f109809e170 0x7f10981c5c60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:47.031+0000 7f109e239700 1 -- 172.21.15.146:0/3015134884 >> 172.21.15.146:0/3015134884 conn(0x7f1098099c40 msgr2=0x7f10981b8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:47.031+0000 7f109e239700 1 -- 172.21.15.146:0/3015134884 shutdown_connections 2023-10-03T10:13:47.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:47.031+0000 7f109e239700 1 -- 172.21.15.146:0/3015134884 wait complete. 2023-10-03T10:13:47.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:47.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:47.961 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:47.991 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:48.034 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:48.044 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:48.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.096+0000 7f2ed4f9e700 1 Processor -- start 2023-10-03T10:13:48.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.096+0000 7f2ed4f9e700 1 -- start start 2023-10-03T10:13:48.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.097+0000 7f2ed4f9e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2ed009a540 0x7f2ed0138920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.097+0000 7f2ed4f9e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ed0138e60 0x7f2ed013b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.097+0000 7f2ed4f9e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed009b750 con 0x7f2ed0099a60 2023-10-03T10:13:48.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.097+0000 7f2ed4f9e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed0070880 con 0x7f2ed009a540 2023-10-03T10:13:48.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.097+0000 7f2ed4f9e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed006f620 con 0x7f2ed0138e60 2023-10-03T10:13:48.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.097+0000 7f2ecf7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2ed0099a60 0x7f2ed0099e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58648/0 (socket says 172.21.15.146:58648) 2023-10-03T10:13:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.097+0000 7f2ecffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ed0138e60 0x7f2ed013b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.097+0000 7f2eceffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2ed009a540 0x7f2ed0138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.097+0000 7f2ecf7fe700 1 -- 172.21.15.146:0/2955522510 learned_addr learned my addr 172.21.15.146:0/2955522510 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.098+0000 7f2ecffff700 1 -- 172.21.15.146:0/2955522510 >> v2:172.21.15.146:3300/0 conn(0x7f2ed009a540 msgr2=0x7f2ed0138920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.098+0000 7f2ecffff700 1 --2- 172.21.15.146:0/2955522510 >> v2:172.21.15.146:3300/0 conn(0x7f2ed009a540 0x7f2ed0138920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.098+0000 7f2ece7fc700 1 -- 172.21.15.146:0/2955522510 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4086058312 0 0) 0x7f2ed009b750 con 0x7f2ed0099a60 2023-10-03T10:13:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.098+0000 7f2ecffff700 1 -- 172.21.15.146:0/2955522510 >> v1:172.21.15.146:6789/0 conn(0x7f2ed0099a60 legacy=0x7f2ed0099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.098+0000 7f2ecffff700 1 -- 172.21.15.146:0/2955522510 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed006fba0 con 0x7f2ed0138e60 2023-10-03T10:13:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.098+0000 7f2ecffff700 1 --2- 172.21.15.146:0/2955522510 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ed0138e60 0x7f2ed013b240 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8009d90 tx=0x7f2ec800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b54b4837edba4f57 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.098+0000 7f2ece7fc700 1 -- 172.21.15.146:0/2955522510 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec800e070 con 0x7f2ed0138e60 2023-10-03T10:13:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.098+0000 7f2ece7fc700 1 -- 172.21.15.146:0/2955522510 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec800bb20 con 0x7f2ed0138e60 2023-10-03T10:13:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.098+0000 7f2ece7fc700 1 -- 172.21.15.146:0/2955522510 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8012430 con 0x7f2ed0138e60 2023-10-03T10:13:48.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.099+0000 7f2ed4f9e700 1 -- 172.21.15.146:0/2955522510 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ed0138e60 msgr2=0x7f2ed013b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.099+0000 7f2ed4f9e700 1 --2- 172.21.15.146:0/2955522510 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ed0138e60 0x7f2ed013b240 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8009d90 tx=0x7f2ec800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:48.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.099+0000 7f2ed4f9e700 1 -- 172.21.15.146:0/2955522510 shutdown_connections 2023-10-03T10:13:48.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.099+0000 7f2ed4f9e700 1 --2- 172.21.15.146:0/2955522510 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ed0138e60 0x7f2ed013b240 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.099+0000 7f2ed4f9e700 1 --2- 172.21.15.146:0/2955522510 >> v2:172.21.15.146:3300/0 conn(0x7f2ed009a540 0x7f2ed0138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.099+0000 7f2ed4f9e700 1 -- 172.21.15.146:0/2955522510 >> 172.21.15.146:0/2955522510 conn(0x7f2ed00a27a0 msgr2=0x7f2ed00a2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:48.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.099+0000 7f2ed4f9e700 1 -- 172.21.15.146:0/2955522510 shutdown_connections 2023-10-03T10:13:48.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.099+0000 7f2ed4f9e700 1 -- 172.21.15.146:0/2955522510 wait complete. 2023-10-03T10:13:48.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.100+0000 7f2ed4f9e700 1 Processor -- start 2023-10-03T10:13:48.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.101+0000 7f2ed4f9e700 1 -- start start 2023-10-03T10:13:48.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.101+0000 7f2ed4f9e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ed0099a60 0x7f2ed01199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.101+0000 7f2ed4f9e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ed009a540 0x7f2ed0119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.101+0000 7f2ed4f9e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ed0138e60 0x7f2ed011a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.101+0000 7f2ed4f9e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed011d1b0 con 0x7f2ed0138e60 2023-10-03T10:13:48.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.101+0000 7f2ed4f9e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed01389c0 con 0x7f2ed009a540 2023-10-03T10:13:48.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.101+0000 7f2ed4f9e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed006f410 con 0x7f2ed0099a60 2023-10-03T10:13:48.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.101+0000 7f2ecf7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ed0099a60 0x7f2ed01199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.101+0000 7f2ecf7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ed0099a60 0x7f2ed01199c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57392/0 (socket says 172.21.15.146:57392) 2023-10-03T10:13:48.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.101+0000 7f2ecf7fe700 1 -- 172.21.15.146:0/4009717248 learned_addr learned my addr 172.21.15.146:0/4009717248 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:48.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.102+0000 7f2ecffff700 1 --2- 172.21.15.146:0/4009717248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ed0138e60 0x7f2ed011a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.102+0000 7f2eceffd700 1 --2- 172.21.15.146:0/4009717248 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ed009a540 0x7f2ed0119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.102+0000 7f2ecf7fe700 1 -- 172.21.15.146:0/4009717248 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ed009a540 msgr2=0x7f2ed0119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.102+0000 7f2ecf7fe700 1 --2- 172.21.15.146:0/4009717248 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ed009a540 0x7f2ed0119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.102+0000 7f2ecf7fe700 1 -- 172.21.15.146:0/4009717248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ed0138e60 msgr2=0x7f2ed011a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.102+0000 7f2ecf7fe700 1 --2- 172.21.15.146:0/4009717248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ed0138e60 0x7f2ed011a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.102+0000 7f2ecf7fe700 1 -- 172.21.15.146:0/4009717248 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec8009a70 con 0x7f2ed0099a60 2023-10-03T10:13:48.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.102+0000 7f2ecffff700 1 --2- 172.21.15.146:0/4009717248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ed0138e60 0x7f2ed011a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:48.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.102+0000 7f2ecf7fe700 1 --2- 172.21.15.146:0/4009717248 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ed0099a60 0x7f2ed01199c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2ec000c520 tx=0x7f2ec000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.102+0000 7f2eb7fff700 1 -- 172.21.15.146:0/4009717248 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0004c80 con 0x7f2ed0099a60 2023-10-03T10:13:48.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.102+0000 7f2eb7fff700 1 -- 172.21.15.146:0/4009717248 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec0004de0 con 0x7f2ed0099a60 2023-10-03T10:13:48.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.102+0000 7f2ed4f9e700 1 -- 172.21.15.146:0/4009717248 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed011bd70 con 0x7f2ed0099a60 2023-10-03T10:13:48.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.102+0000 7f2eb7fff700 1 -- 172.21.15.146:0/4009717248 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0007310 con 0x7f2ed0099a60 2023-10-03T10:13:48.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.102+0000 7f2ed4f9e700 1 -- 172.21.15.146:0/4009717248 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed011d490 con 0x7f2ed0099a60 2023-10-03T10:13:48.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.103+0000 7f2eb7fff700 1 -- 172.21.15.146:0/4009717248 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ec0007470 con 0x7f2ed0099a60 2023-10-03T10:13:48.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.104+0000 7f2ed4f9e700 1 -- 172.21.15.146:0/4009717248 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed011ce50 con 0x7f2ed0099a60 2023-10-03T10:13:48.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.104+0000 7f2eb7fff700 1 -- 172.21.15.146:0/4009717248 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2ec003f430 con 0x7f2ed0099a60 2023-10-03T10:13:48.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.112+0000 7f2eb7fff700 1 -- 172.21.15.146:0/4009717248 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ed011ce50 con 0x7f2ed0099a60 2023-10-03T10:13:48.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.140+0000 7f256e59e700 1 Processor -- start 2023-10-03T10:13:48.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.140+0000 7f256e59e700 1 -- start start 2023-10-03T10:13:48.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.140+0000 7f256e59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2568133ad0 0x7f2568133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.140+0000 7f256e59e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25681300a0 0x7f25681304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.140+0000 7f256e59e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25681309f0 0x7f256813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.140+0000 7f256e59e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f256806b2d0 con 0x7f2568133ad0 2023-10-03T10:13:48.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.140+0000 7f256e59e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2568133610 con 0x7f25681300a0 2023-10-03T10:13:48.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.140+0000 7f256e59e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f256809a500 con 0x7f25681309f0 2023-10-03T10:13:48.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.140+0000 7f2567fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2568133ad0 0x7f2568133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.140+0000 7f256cb3b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25681309f0 0x7f256813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.140+0000 7f256cb3b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25681309f0 0x7f256813a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57396/0 (socket says 172.21.15.146:57396) 2023-10-03T10:13:48.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.140+0000 7f2567fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2568133ad0 0x7f2568133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42958/0 (socket says 172.21.15.146:42958) 2023-10-03T10:13:48.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.140+0000 7f256cb3b700 1 -- 172.21.15.146:0/469625520 learned_addr learned my addr 172.21.15.146:0/469625520 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:48.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.140+0000 7f25677fe700 1 --2- 172.21.15.146:0/469625520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25681300a0 0x7f25681304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.141+0000 7f25677fe700 1 -- 172.21.15.146:0/469625520 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25681309f0 msgr2=0x7f256813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:48.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.141+0000 7f25677fe700 1 --2- 172.21.15.146:0/469625520 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25681309f0 0x7f256813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.141+0000 7f25677fe700 1 -- 172.21.15.146:0/469625520 >> v2:172.21.15.146:3300/0 conn(0x7f2568133ad0 msgr2=0x7f2568133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:48.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.141+0000 7f25677fe700 1 --2- 172.21.15.146:0/469625520 >> v2:172.21.15.146:3300/0 conn(0x7f2568133ad0 0x7f2568133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.141+0000 7f25677fe700 1 -- 172.21.15.146:0/469625520 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25681338b0 con 0x7f25681300a0 2023-10-03T10:13:48.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.141+0000 7f2567fff700 1 --2- 172.21.15.146:0/469625520 >> v2:172.21.15.146:3300/0 conn(0x7f2568133ad0 0x7f2568133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:48.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.141+0000 7f256cb3b700 1 --2- 172.21.15.146:0/469625520 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25681309f0 0x7f256813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:48.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.141+0000 7f25677fe700 1 --2- 172.21.15.146:0/469625520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25681300a0 0x7f25681304b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f255c009840 tx=0x7f255c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a093e400986edb8c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.141+0000 7f2566ffd700 1 -- 172.21.15.146:0/469625520 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c011830 con 0x7f25681300a0 2023-10-03T10:13:48.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.141+0000 7f2566ffd700 1 -- 172.21.15.146:0/469625520 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255c011990 con 0x7f25681300a0 2023-10-03T10:13:48.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.141+0000 7f2566ffd700 1 -- 172.21.15.146:0/469625520 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c011d20 con 0x7f25681300a0 2023-10-03T10:13:48.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.142+0000 7f256e59e700 1 -- 172.21.15.146:0/469625520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25681300a0 msgr2=0x7f25681304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.142+0000 7f256e59e700 1 --2- 172.21.15.146:0/469625520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25681300a0 0x7f25681304b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f255c009840 tx=0x7f255c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:48.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.142+0000 7f256e59e700 1 -- 172.21.15.146:0/469625520 shutdown_connections 2023-10-03T10:13:48.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.142+0000 7f256e59e700 1 --2- 172.21.15.146:0/469625520 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25681309f0 0x7f256813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.142+0000 7f256e59e700 1 --2- 172.21.15.146:0/469625520 >> v2:172.21.15.146:3300/0 conn(0x7f2568133ad0 0x7f2568133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.142+0000 7f256e59e700 1 --2- 172.21.15.146:0/469625520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25681300a0 0x7f25681304b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.142+0000 7f256e59e700 1 -- 172.21.15.146:0/469625520 >> 172.21.15.146:0/469625520 conn(0x7f2568099c40 msgr2=0x7f25680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:48.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.142+0000 7f256e59e700 1 -- 172.21.15.146:0/469625520 shutdown_connections 2023-10-03T10:13:48.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.142+0000 7f256e59e700 1 -- 172.21.15.146:0/469625520 wait complete. 2023-10-03T10:13:48.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.143+0000 7f256e59e700 1 Processor -- start 2023-10-03T10:13:48.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.144+0000 7f256e59e700 1 -- start start 2023-10-03T10:13:48.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.144+0000 7f256e59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25681300a0 0x7f256811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.144+0000 7f256e59e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25681309f0 0x7f256811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.144+0000 7f256e59e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2568133ad0 0x7f256811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.144+0000 7f256e59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25680720e0 con 0x7f25681300a0 2023-10-03T10:13:48.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.144+0000 7f256e59e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256811fa40 con 0x7f25681309f0 2023-10-03T10:13:48.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.144+0000 7f256e59e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f256812dd00 con 0x7f2568133ad0 2023-10-03T10:13:48.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.144+0000 7f2567fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25681300a0 0x7f256811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.144+0000 7f25677fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25681309f0 0x7f256811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.144+0000 7f2567fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25681300a0 0x7f256811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42960/0 (socket says 172.21.15.146:42960) 2023-10-03T10:13:48.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.144+0000 7f25677fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25681309f0 0x7f256811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40348/0 (socket says 172.21.15.146:40348) 2023-10-03T10:13:48.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.144+0000 7f2567fff700 1 -- 172.21.15.146:0/3958067816 learned_addr learned my addr 172.21.15.146:0/3958067816 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:48.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.145+0000 7f256cb3b700 1 --2- 172.21.15.146:0/3958067816 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2568133ad0 0x7f256811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.145+0000 7f2567fff700 1 -- 172.21.15.146:0/3958067816 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2568133ad0 msgr2=0x7f256811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.145+0000 7f2567fff700 1 --2- 172.21.15.146:0/3958067816 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2568133ad0 0x7f256811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.145+0000 7f2567fff700 1 -- 172.21.15.146:0/3958067816 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25681309f0 msgr2=0x7f256811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.145+0000 7f2567fff700 1 --2- 172.21.15.146:0/3958067816 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25681309f0 0x7f256811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.145+0000 7f2567fff700 1 -- 172.21.15.146:0/3958067816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2560009b30 con 0x7f25681300a0 2023-10-03T10:13:48.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.145+0000 7f2567fff700 1 --2- 172.21.15.146:0/3958067816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25681300a0 0x7f256811da40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f255800e810 tx=0x7f255800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.145+0000 7f2564ff9700 1 -- 172.21.15.146:0/3958067816 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558013610 con 0x7f25681300a0 2023-10-03T10:13:48.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.145+0000 7f2564ff9700 1 -- 172.21.15.146:0/3958067816 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2558013770 con 0x7f25681300a0 2023-10-03T10:13:48.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.145+0000 7f256e59e700 1 -- 172.21.15.146:0/3958067816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f255c0094a0 con 0x7f25681300a0 2023-10-03T10:13:48.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.145+0000 7f2564ff9700 1 -- 172.21.15.146:0/3958067816 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558013b20 con 0x7f25681300a0 2023-10-03T10:13:48.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.145+0000 7f256e59e700 1 -- 172.21.15.146:0/3958067816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256811ffe0 con 0x7f25681300a0 2023-10-03T10:13:48.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.146+0000 7f256e59e700 1 -- 172.21.15.146:0/3958067816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256804f2a0 con 0x7f25681300a0 2023-10-03T10:13:48.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.146+0000 7f2564ff9700 1 -- 172.21.15.146:0/3958067816 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2558013c80 con 0x7f25681300a0 2023-10-03T10:13:48.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.147+0000 7f2564ff9700 1 -- 172.21.15.146:0/3958067816 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f255803f420 con 0x7f25681300a0 2023-10-03T10:13:48.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.155+0000 7f2564ff9700 1 -- 172.21.15.146:0/3958067816 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2558012370 con 0x7f25681300a0 2023-10-03T10:13:48.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.199+0000 7fdebfbae700 1 Processor -- start 2023-10-03T10:13:48.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.200+0000 7fdebfbae700 1 -- start start 2023-10-03T10:13:48.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.200+0000 7f254540a700 1 Processor -- start 2023-10-03T10:13:48.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.200+0000 7f254540a700 1 -- start start 2023-10-03T10:13:48.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.200+0000 7fdebfbae700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdeb806a770 0x7fdeb806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.200+0000 7fdebfbae700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb806b080 0x7fdeb81317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.200+0000 7f254540a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25401350d0 0x7f254013ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.200+0000 7f254540a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f254013d210 0x7f254013f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.200+0000 7f254540a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254009eca0 con 0x7f254006a770 2023-10-03T10:13:48.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.200+0000 7f254540a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f254009f720 con 0x7f254013d210 2023-10-03T10:13:48.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.200+0000 7f254540a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254006b480 con 0x7f25401350d0 2023-10-03T10:13:48.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.200+0000 7fdebfbae700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb809da80 con 0x7fdeb8131cf0 2023-10-03T10:13:48.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.200+0000 7fdebfbae700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb809dce0 con 0x7fdeb806a770 2023-10-03T10:13:48.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.200+0000 7fdebfbae700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb809eb20 con 0x7fdeb806b080 2023-10-03T10:13:48.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.201+0000 7fdebd149700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb806b080 0x7fdeb81317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.201+0000 7fdebd149700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb806b080 0x7fdeb81317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57424/0 (socket says 172.21.15.146:57424) 2023-10-03T10:13:48.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.201+0000 7fdebd149700 1 -- 172.21.15.146:0/2015099782 learned_addr learned my addr 172.21.15.146:0/2015099782 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:48.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.201+0000 7fdebd149700 1 -- 172.21.15.146:0/2015099782 >> v2:172.21.15.146:3300/0 conn(0x7fdeb806a770 msgr2=0x7fdeb806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:48.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.201+0000 7fdebd149700 1 --2- 172.21.15.146:0/2015099782 >> v2:172.21.15.146:3300/0 conn(0x7fdeb806a770 0x7fdeb806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.201+0000 7fdebd149700 1 -- 172.21.15.146:0/2015099782 >> v1:172.21.15.146:6789/0 conn(0x7fdeb8131cf0 legacy=0x7fdeb8138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.201+0000 7fdebd149700 1 -- 172.21.15.146:0/2015099782 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb809d860 con 0x7fdeb806b080 2023-10-03T10:13:48.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.201+0000 7fdebd149700 1 --2- 172.21.15.146:0/2015099782 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb806b080 0x7fdeb81317b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdea80098f0 tx=0x7fdea8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a48902b82c01a726 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.201+0000 7fdebc948700 1 -- 172.21.15.146:0/2015099782 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea800b8a0 con 0x7fdeb806b080 2023-10-03T10:13:48.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.201+0000 7fdebc948700 1 -- 172.21.15.146:0/2015099782 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea800ba00 con 0x7fdeb806b080 2023-10-03T10:13:48.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.201+0000 7fdebc948700 1 -- 172.21.15.146:0/2015099782 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea800bd90 con 0x7fdeb806b080 2023-10-03T10:13:48.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.201+0000 7f253effd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f254006a770 0x7f25401349c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58660/0 (socket says 172.21.15.146:58660) 2023-10-03T10:13:48.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.201+0000 7f253effd700 1 -- 172.21.15.146:0/2215798590 learned_addr learned my addr 172.21.15.146:0/2215798590 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:48.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.201+0000 7f253e7fc700 1 --2- 172.21.15.146:0/2215798590 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25401350d0 0x7f254013ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.202+0000 7f253f7fe700 1 --2- 172.21.15.146:0/2215798590 >> v2:172.21.15.146:3300/0 conn(0x7f254013d210 0x7f254013f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.202+0000 7f253e7fc700 1 -- 172.21.15.146:0/2215798590 >> v2:172.21.15.146:3300/0 conn(0x7f254013d210 msgr2=0x7f254013f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:48.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.202+0000 7f253e7fc700 1 --2- 172.21.15.146:0/2215798590 >> v2:172.21.15.146:3300/0 conn(0x7f254013d210 0x7f254013f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.202+0000 7f253e7fc700 1 -- 172.21.15.146:0/2215798590 >> v1:172.21.15.146:6789/0 conn(0x7f254006a770 legacy=0x7f25401349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.202+0000 7f253e7fc700 1 -- 172.21.15.146:0/2215798590 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254009b010 con 0x7f25401350d0 2023-10-03T10:13:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.202+0000 7fdebfbae700 1 -- 172.21.15.146:0/2015099782 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb806b080 msgr2=0x7fdeb81317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.202+0000 7fdebfbae700 1 --2- 172.21.15.146:0/2015099782 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb806b080 0x7fdeb81317b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdea80098f0 tx=0x7fdea8009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.202+0000 7fdebfbae700 1 -- 172.21.15.146:0/2015099782 shutdown_connections 2023-10-03T10:13:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.202+0000 7fdebfbae700 1 --2- 172.21.15.146:0/2015099782 >> v2:172.21.15.146:3300/0 conn(0x7fdeb806a770 0x7fdeb806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.202+0000 7fdebfbae700 1 --2- 172.21.15.146:0/2015099782 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb806b080 0x7fdeb81317b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.202+0000 7fdebfbae700 1 -- 172.21.15.146:0/2015099782 >> 172.21.15.146:0/2015099782 conn(0x7fdeb8099c40 msgr2=0x7fdeb80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.202+0000 7f253e7fc700 1 --2- 172.21.15.146:0/2215798590 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25401350d0 0x7f254013ccd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2534009840 tx=0x7f2534009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f39b80787db49859 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.202+0000 7f253dffb700 1 -- 172.21.15.146:0/2215798590 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2534011830 con 0x7f25401350d0 2023-10-03T10:13:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.202+0000 7fdebfbae700 1 -- 172.21.15.146:0/2015099782 shutdown_connections 2023-10-03T10:13:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.202+0000 7f253dffb700 1 -- 172.21.15.146:0/2215798590 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2534011990 con 0x7f25401350d0 2023-10-03T10:13:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.202+0000 7fdebfbae700 1 -- 172.21.15.146:0/2015099782 wait complete. 2023-10-03T10:13:48.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.202+0000 7f253dffb700 1 -- 172.21.15.146:0/2215798590 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2534011d20 con 0x7f25401350d0 2023-10-03T10:13:48.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.203+0000 7f254540a700 1 -- 172.21.15.146:0/2215798590 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25401350d0 msgr2=0x7f254013ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.203+0000 7f254540a700 1 --2- 172.21.15.146:0/2215798590 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25401350d0 0x7f254013ccd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2534009840 tx=0x7f2534009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.203+0000 7f254540a700 1 -- 172.21.15.146:0/2215798590 shutdown_connections 2023-10-03T10:13:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.204+0000 7f254540a700 1 --2- 172.21.15.146:0/2215798590 >> v2:172.21.15.146:3300/0 conn(0x7f254013d210 0x7f254013f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.204+0000 7f254540a700 1 --2- 172.21.15.146:0/2215798590 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25401350d0 0x7f254013ccd0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.204+0000 7f254540a700 1 -- 172.21.15.146:0/2215798590 >> 172.21.15.146:0/2215798590 conn(0x7f2540099c40 msgr2=0x7f25400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.204+0000 7f254540a700 1 -- 172.21.15.146:0/2215798590 shutdown_connections 2023-10-03T10:13:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.204+0000 7f254540a700 1 -- 172.21.15.146:0/2215798590 wait complete. 2023-10-03T10:13:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.204+0000 7fdebfbae700 1 Processor -- start 2023-10-03T10:13:48.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.204+0000 7fdebfbae700 1 -- start start 2023-10-03T10:13:48.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.204+0000 7fdebfbae700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdeb806a770 0x7fdeb811c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.205+0000 7fdebfbae700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb806b080 0x7fdeb811c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.205+0000 7fdebfbae700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdeb8131cf0 0x7fdeb81c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.205+0000 7fdebfbae700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb811f210 con 0x7fdeb806a770 2023-10-03T10:13:48.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.205+0000 7fdebfbae700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb811f3f0 con 0x7fdeb8131cf0 2023-10-03T10:13:48.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.205+0000 7fdebfbae700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb8130260 con 0x7fdeb806b080 2023-10-03T10:13:48.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.205+0000 7f254540a700 1 Processor -- start 2023-10-03T10:13:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.205+0000 7fdebd149700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb806b080 0x7fdeb811c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.205+0000 7fdebd149700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb806b080 0x7fdeb811c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57436/0 (socket says 172.21.15.146:57436) 2023-10-03T10:13:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.205+0000 7fdebd149700 1 -- 172.21.15.146:0/226698747 learned_addr learned my addr 172.21.15.146:0/226698747 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.205+0000 7fdebe14b700 1 --2- 172.21.15.146:0/226698747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdeb8131cf0 0x7fdeb81c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.205+0000 7f254540a700 1 -- start start 2023-10-03T10:13:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.205+0000 7fdebd149700 1 -- 172.21.15.146:0/226698747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdeb8131cf0 msgr2=0x7fdeb81c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.205+0000 7fdebd149700 1 --2- 172.21.15.146:0/226698747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdeb8131cf0 0x7fdeb81c60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.205+0000 7fdebd149700 1 -- 172.21.15.146:0/226698747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdeb806a770 msgr2=0x7fdeb811c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.205+0000 7fdebd149700 1 --2- 172.21.15.146:0/226698747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdeb806a770 0x7fdeb811c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.205+0000 7fdebd149700 1 -- 172.21.15.146:0/226698747 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea8009550 con 0x7fdeb806b080 2023-10-03T10:13:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.205+0000 7fdebd149700 1 --2- 172.21.15.146:0/226698747 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb806b080 0x7fdeb811c7e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdea800b0e0 tx=0x7fdea8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.205+0000 7f254540a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f254006a770 0x7f25401ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.205+0000 7f254540a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25401350d0 0x7f25401cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.206+0000 7f254540a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f254013d210 0x7f25401cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.206+0000 7f254540a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254013f670 con 0x7f25401350d0 2023-10-03T10:13:48.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.206+0000 7f254540a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254013a6e0 con 0x7f254006a770 2023-10-03T10:13:48.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.206+0000 7f254540a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f254009f220 con 0x7f254013d210 2023-10-03T10:13:48.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.206+0000 7f253e7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25401350d0 0x7f25401cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.206+0000 7f253e7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25401350d0 0x7f25401cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42986/0 (socket says 172.21.15.146:42986) 2023-10-03T10:13:48.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.206+0000 7f253e7fc700 1 -- 172.21.15.146:0/2683139875 learned_addr learned my addr 172.21.15.146:0/2683139875 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:48.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.206+0000 7f253effd700 1 --2- 172.21.15.146:0/2683139875 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f254006a770 0x7f25401ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.206+0000 7f253e7fc700 1 -- 172.21.15.146:0/2683139875 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f254013d210 msgr2=0x7f25401cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.206+0000 7f253e7fc700 1 --2- 172.21.15.146:0/2683139875 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f254013d210 0x7f25401cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.206+0000 7f253e7fc700 1 -- 172.21.15.146:0/2683139875 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f254006a770 msgr2=0x7f25401ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.206+0000 7f253e7fc700 1 --2- 172.21.15.146:0/2683139875 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f254006a770 0x7f25401ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.206+0000 7f253e7fc700 1 -- 172.21.15.146:0/2683139875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25340094a0 con 0x7f25401350d0 2023-10-03T10:13:48.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.206+0000 7fdeae7fc700 1 -- 172.21.15.146:0/226698747 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea80036a0 con 0x7fdeb806b080 2023-10-03T10:13:48.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.206+0000 7fdeae7fc700 1 -- 172.21.15.146:0/226698747 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea8003820 con 0x7fdeb806b080 2023-10-03T10:13:48.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.206+0000 7fdeae7fc700 1 -- 172.21.15.146:0/226698747 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea8003bd0 con 0x7fdeb806b080 2023-10-03T10:13:48.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.207+0000 7fdebfbae700 1 -- 172.21.15.146:0/226698747 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb811cd20 con 0x7fdeb806b080 2023-10-03T10:13:48.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.207+0000 7fdebfbae700 1 -- 172.21.15.146:0/226698747 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb80a0630 con 0x7fdeb806b080 2023-10-03T10:13:48.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.207+0000 7f253e7fc700 1 --2- 172.21.15.146:0/2683139875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25401350d0 0x7f25401cd220 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f25340090b0 tx=0x7f2534004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.208+0000 7f25277fe700 1 -- 172.21.15.146:0/2683139875 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2534004480 con 0x7f25401350d0 2023-10-03T10:13:48.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.208+0000 7f25277fe700 1 -- 172.21.15.146:0/2683139875 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253401f070 con 0x7f25401350d0 2023-10-03T10:13:48.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.208+0000 7f25277fe700 1 -- 172.21.15.146:0/2683139875 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25340038c0 con 0x7f25401350d0 2023-10-03T10:13:48.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.208+0000 7f254540a700 1 -- 172.21.15.146:0/2683139875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f254013a290 con 0x7f25401350d0 2023-10-03T10:13:48.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.208+0000 7f254540a700 1 -- 172.21.15.146:0/2683139875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254013ad00 con 0x7f25401350d0 2023-10-03T10:13:48.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.208+0000 7fdeae7fc700 1 -- 172.21.15.146:0/226698747 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdea8003d30 con 0x7fdeb806b080 2023-10-03T10:13:48.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.208+0000 7fdeae7fc700 1 -- 172.21.15.146:0/226698747 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdea8040a80 con 0x7fdeb806b080 2023-10-03T10:13:48.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.209+0000 7fdebfbae700 1 -- 172.21.15.146:0/226698747 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb811bdb0 con 0x7fdeb806b080 2023-10-03T10:13:48.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.209+0000 7f254540a700 1 -- 172.21.15.146:0/2683139875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25200052e0 con 0x7f25401350d0 2023-10-03T10:13:48.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.211+0000 7f25277fe700 1 -- 172.21.15.146:0/2683139875 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2534021030 con 0x7f25401350d0 2023-10-03T10:13:48.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.211+0000 7f25277fe700 1 -- 172.21.15.146:0/2683139875 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2534041040 con 0x7f25401350d0 2023-10-03T10:13:48.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.216+0000 7f25277fe700 1 -- 172.21.15.146:0/2683139875 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25340199a0 con 0x7f25401350d0 2023-10-03T10:13:48.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.218+0000 7fdeae7fc700 1 -- 172.21.15.146:0/226698747 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdea8028080 con 0x7fdeb806b080 2023-10-03T10:13:48.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.316+0000 7f2ed4f9e700 1 -- 172.21.15.146:0/4009717248 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2ed011ce50 con 0x7f2ed0099a60 2023-10-03T10:13:48.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.316+0000 7f2eb7fff700 1 -- 172.21.15.146:0/4009717248 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2ed011ce50 con 0x7f2ed0099a60 2023-10-03T10:13:48.316 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.319+0000 7f2ed4f9e700 1 -- 172.21.15.146:0/4009717248 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ed0099a60 msgr2=0x7f2ed01199c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.319+0000 7f2ed4f9e700 1 --2- 172.21.15.146:0/4009717248 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ed0099a60 0x7f2ed01199c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2ec000c520 tx=0x7f2ec000c830 comp rx=0 tx=0).stop 2023-10-03T10:13:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.319+0000 7f2ed4f9e700 1 -- 172.21.15.146:0/4009717248 shutdown_connections 2023-10-03T10:13:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.319+0000 7f2ed4f9e700 1 --2- 172.21.15.146:0/4009717248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ed0138e60 0x7f2ed011a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.319+0000 7f2ed4f9e700 1 --2- 172.21.15.146:0/4009717248 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ed0099a60 0x7f2ed01199c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.319+0000 7f2ed4f9e700 1 --2- 172.21.15.146:0/4009717248 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ed009a540 0x7f2ed0119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.319+0000 7f2ed4f9e700 1 -- 172.21.15.146:0/4009717248 >> 172.21.15.146:0/4009717248 conn(0x7f2ed00a27a0 msgr2=0x7f2ed0070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.319+0000 7f2ed4f9e700 1 -- 172.21.15.146:0/4009717248 shutdown_connections 2023-10-03T10:13:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.319+0000 7f2ed4f9e700 1 -- 172.21.15.146:0/4009717248 wait complete. 2023-10-03T10:13:48.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:48.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.362+0000 7f256e59e700 1 -- 172.21.15.146:0/3958067816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f256806c3b0 con 0x7f25681300a0 2023-10-03T10:13:48.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.363+0000 7f2564ff9700 1 -- 172.21.15.146:0/3958067816 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f255801b3b0 con 0x7f25681300a0 2023-10-03T10:13:48.363 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.365+0000 7f256e59e700 1 -- 172.21.15.146:0/3958067816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25681300a0 msgr2=0x7f256811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.365+0000 7f256e59e700 1 --2- 172.21.15.146:0/3958067816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25681300a0 0x7f256811da40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f255800e810 tx=0x7f255800eb20 comp rx=0 tx=0).stop 2023-10-03T10:13:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.365+0000 7f256e59e700 1 -- 172.21.15.146:0/3958067816 shutdown_connections 2023-10-03T10:13:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.365+0000 7f256e59e700 1 --2- 172.21.15.146:0/3958067816 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2568133ad0 0x7f256811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.365+0000 7f256e59e700 1 --2- 172.21.15.146:0/3958067816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25681300a0 0x7f256811da40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.365+0000 7f256e59e700 1 --2- 172.21.15.146:0/3958067816 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25681309f0 0x7f256811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.365+0000 7f256e59e700 1 -- 172.21.15.146:0/3958067816 >> 172.21.15.146:0/3958067816 conn(0x7f2568099c40 msgr2=0x7f256812e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.365+0000 7f256e59e700 1 -- 172.21.15.146:0/3958067816 shutdown_connections 2023-10-03T10:13:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.365+0000 7f256e59e700 1 -- 172.21.15.146:0/3958067816 wait complete. 2023-10-03T10:13:48.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.410+0000 7f254540a700 1 -- 172.21.15.146:0/2683139875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2520005860 con 0x7f25401350d0 2023-10-03T10:13:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.410+0000 7f25277fe700 1 -- 172.21.15.146:0/2683139875 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2534015030 con 0x7f25401350d0 2023-10-03T10:13:48.410 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:48.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.412+0000 7f254540a700 1 -- 172.21.15.146:0/2683139875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25401350d0 msgr2=0x7f25401cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.412+0000 7f254540a700 1 --2- 172.21.15.146:0/2683139875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25401350d0 0x7f25401cd220 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f25340090b0 tx=0x7f2534004750 comp rx=0 tx=0).stop 2023-10-03T10:13:48.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.412+0000 7f254540a700 1 -- 172.21.15.146:0/2683139875 shutdown_connections 2023-10-03T10:13:48.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.412+0000 7f254540a700 1 --2- 172.21.15.146:0/2683139875 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f254013d210 0x7f25401cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.412+0000 7f254540a700 1 --2- 172.21.15.146:0/2683139875 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f254006a770 0x7f25401ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.412+0000 7f254540a700 1 --2- 172.21.15.146:0/2683139875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25401350d0 0x7f25401cd220 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.412+0000 7f254540a700 1 -- 172.21.15.146:0/2683139875 >> 172.21.15.146:0/2683139875 conn(0x7f2540099c40 msgr2=0x7f254013d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:48.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.412+0000 7f254540a700 1 -- 172.21.15.146:0/2683139875 shutdown_connections 2023-10-03T10:13:48.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.412+0000 7f254540a700 1 -- 172.21.15.146:0/2683139875 wait complete. 2023-10-03T10:13:48.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.415+0000 7fdebfbae700 1 -- 172.21.15.146:0/226698747 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdeb804f2a0 con 0x7fdeb806b080 2023-10-03T10:13:48.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.415+0000 7fdeae7fc700 1 -- 172.21.15.146:0/226698747 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdea8015020 con 0x7fdeb806b080 2023-10-03T10:13:48.415 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:48.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.417+0000 7fdebfbae700 1 -- 172.21.15.146:0/226698747 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb806b080 msgr2=0x7fdeb811c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.417+0000 7fdebfbae700 1 --2- 172.21.15.146:0/226698747 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb806b080 0x7fdeb811c7e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdea800b0e0 tx=0x7fdea8004750 comp rx=0 tx=0).stop 2023-10-03T10:13:48.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.417+0000 7fdebfbae700 1 -- 172.21.15.146:0/226698747 shutdown_connections 2023-10-03T10:13:48.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.417+0000 7fdebfbae700 1 --2- 172.21.15.146:0/226698747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdeb8131cf0 0x7fdeb81c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.417+0000 7fdebfbae700 1 --2- 172.21.15.146:0/226698747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdeb806a770 0x7fdeb811c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.417+0000 7fdebfbae700 1 --2- 172.21.15.146:0/226698747 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb806b080 0x7fdeb811c7e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.417+0000 7fdebfbae700 1 -- 172.21.15.146:0/226698747 >> 172.21.15.146:0/226698747 conn(0x7fdeb8099c40 msgr2=0x7fdeb81308a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:48.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.418+0000 7fdebfbae700 1 -- 172.21.15.146:0/226698747 shutdown_connections 2023-10-03T10:13:48.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:48.418+0000 7fdebfbae700 1 -- 172.21.15.146:0/226698747 wait complete. 2023-10-03T10:13:48.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:48.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:49.337 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:49.377 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:49.426 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:49.430 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:49.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.470+0000 7f195b19f700 1 Processor -- start 2023-10-03T10:13:49.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.470+0000 7f195b19f700 1 -- start start 2023-10-03T10:13:49.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.470+0000 7f195b19f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f195409e870 0x7f195409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.470+0000 7f195b19f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f195409f180 0x7f1954131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.470+0000 7f195b19f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195409c970 con 0x7f1954131d70 2023-10-03T10:13:49.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.471+0000 7f195b19f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19540a0920 con 0x7f195409f180 2023-10-03T10:13:49.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.471+0000 7f195b19f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f195409f9c0 con 0x7f195409e870 2023-10-03T10:13:49.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.471+0000 7f1958f3b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f195409e870 0x7f195409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.471+0000 7f1958f3b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f195409e870 0x7f195409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57454/0 (socket says 172.21.15.146:57454) 2023-10-03T10:13:49.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.471+0000 7f1958f3b700 1 -- 172.21.15.146:0/1435556701 learned_addr learned my addr 172.21.15.146:0/1435556701 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:49.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.471+0000 7f1953fff700 1 --2- 172.21.15.146:0/1435556701 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f195409f180 0x7f1954131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.471+0000 7f1958f3b700 1 -- 172.21.15.146:0/1435556701 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f195409f180 msgr2=0x7f1954131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:49.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.471+0000 7f1958f3b700 1 --2- 172.21.15.146:0/1435556701 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f195409f180 0x7f1954131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.471+0000 7f1958f3b700 1 -- 172.21.15.146:0/1435556701 >> v1:172.21.15.146:6789/0 conn(0x7f1954131d70 legacy=0x7f1954138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:49.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.471+0000 7f1958f3b700 1 -- 172.21.15.146:0/1435556701 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195409bab0 con 0x7f195409e870 2023-10-03T10:13:49.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.471+0000 7f1958f3b700 1 --2- 172.21.15.146:0/1435556701 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f195409e870 0x7f195409ec40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1948009920 tx=0x7f1948009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3beb428d3510662a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:49.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.471+0000 7f19537fe700 1 -- 172.21.15.146:0/1435556701 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1948004230 con 0x7f195409e870 2023-10-03T10:13:49.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.471+0000 7f19537fe700 1 -- 172.21.15.146:0/1435556701 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1948004390 con 0x7f195409e870 2023-10-03T10:13:49.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.471+0000 7f19537fe700 1 -- 172.21.15.146:0/1435556701 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19480036a0 con 0x7f195409e870 2023-10-03T10:13:49.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.472+0000 7f195b19f700 1 -- 172.21.15.146:0/1435556701 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f195409e870 msgr2=0x7f195409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.472+0000 7f195b19f700 1 --2- 172.21.15.146:0/1435556701 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f195409e870 0x7f195409ec40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1948009920 tx=0x7f1948009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:49.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.472+0000 7f195b19f700 1 -- 172.21.15.146:0/1435556701 shutdown_connections 2023-10-03T10:13:49.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.472+0000 7f195b19f700 1 --2- 172.21.15.146:0/1435556701 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f195409e870 0x7f195409ec40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.472+0000 7f195b19f700 1 --2- 172.21.15.146:0/1435556701 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f195409f180 0x7f1954131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.472+0000 7f195b19f700 1 -- 172.21.15.146:0/1435556701 >> 172.21.15.146:0/1435556701 conn(0x7f19540a4430 msgr2=0x7f19540a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.472+0000 7f195b19f700 1 -- 172.21.15.146:0/1435556701 shutdown_connections 2023-10-03T10:13:49.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.472+0000 7f195b19f700 1 -- 172.21.15.146:0/1435556701 wait complete. 2023-10-03T10:13:49.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.473+0000 7f195b19f700 1 Processor -- start 2023-10-03T10:13:49.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.473+0000 7f195b19f700 1 -- start start 2023-10-03T10:13:49.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.474+0000 7f195b19f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f195409e870 0x7f195406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.474+0000 7f195b19f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f195409f180 0x7f195406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.474+0000 7f195b19f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1954131d70 0x7f195406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.474+0000 7f195b19f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1954125ce0 con 0x7f195409f180 2023-10-03T10:13:49.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.474+0000 7f195b19f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1954125ec0 con 0x7f1954131d70 2023-10-03T10:13:49.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.474+0000 7f195b19f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f195409dba0 con 0x7f195409e870 2023-10-03T10:13:49.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.474+0000 7f1953fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f195409f180 0x7f195406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.474+0000 7f1953fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f195409f180 0x7f195406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43000/0 (socket says 172.21.15.146:43000) 2023-10-03T10:13:49.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.474+0000 7f1953fff700 1 -- 172.21.15.146:0/2452417122 learned_addr learned my addr 172.21.15.146:0/2452417122 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:49.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.474+0000 7f1958f3b700 1 --2- 172.21.15.146:0/2452417122 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f195409e870 0x7f195406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.474+0000 7f195973c700 1 --2- 172.21.15.146:0/2452417122 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1954131d70 0x7f195406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.474+0000 7f1953fff700 1 -- 172.21.15.146:0/2452417122 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f195409e870 msgr2=0x7f195406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.474+0000 7f1953fff700 1 --2- 172.21.15.146:0/2452417122 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f195409e870 0x7f195406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.474+0000 7f1953fff700 1 -- 172.21.15.146:0/2452417122 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1954131d70 msgr2=0x7f195406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.474+0000 7f1953fff700 1 --2- 172.21.15.146:0/2452417122 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1954131d70 0x7f195406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.474+0000 7f1953fff700 1 -- 172.21.15.146:0/2452417122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1948009550 con 0x7f195409f180 2023-10-03T10:13:49.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.475+0000 7f1953fff700 1 --2- 172.21.15.146:0/2452417122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f195409f180 0x7f195406bdf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f194000e9b0 tx=0x7f194000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:49.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.475+0000 7f19517fa700 1 -- 172.21.15.146:0/2452417122 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940009710 con 0x7f195409f180 2023-10-03T10:13:49.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.475+0000 7f19517fa700 1 -- 172.21.15.146:0/2452417122 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194000ee50 con 0x7f195409f180 2023-10-03T10:13:49.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.475+0000 7f195b19f700 1 -- 172.21.15.146:0/2452417122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195406d4c0 con 0x7f195409f180 2023-10-03T10:13:49.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.475+0000 7f19517fa700 1 -- 172.21.15.146:0/2452417122 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194000ca70 con 0x7f195409f180 2023-10-03T10:13:49.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.475+0000 7f195b19f700 1 -- 172.21.15.146:0/2452417122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1954131720 con 0x7f195409f180 2023-10-03T10:13:49.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.476+0000 7f19517fa700 1 -- 172.21.15.146:0/2452417122 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f194000cbd0 con 0x7f195409f180 2023-10-03T10:13:49.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.476+0000 7f195b19f700 1 -- 172.21.15.146:0/2452417122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195404f2a0 con 0x7f195409f180 2023-10-03T10:13:49.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.476+0000 7f19517fa700 1 -- 172.21.15.146:0/2452417122 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1940011350 con 0x7f195409f180 2023-10-03T10:13:49.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.481+0000 7f19517fa700 1 -- 172.21.15.146:0/2452417122 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1940017070 con 0x7f195409f180 2023-10-03T10:13:49.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.523+0000 7efd57e4a700 1 Processor -- start 2023-10-03T10:13:49.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.523+0000 7efd57e4a700 1 -- start start 2023-10-03T10:13:49.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.524+0000 7efd57e4a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd5009e870 0x7efd5009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.524+0000 7efd57e4a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efd5009f180 0x7efd50131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.524+0000 7efd57e4a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5009c970 con 0x7efd50131d70 2023-10-03T10:13:49.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.524+0000 7efd57e4a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd500a0920 con 0x7efd5009f180 2023-10-03T10:13:49.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.524+0000 7efd55be6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd5009e870 0x7efd5009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.524+0000 7efd553e5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efd5009f180 0x7efd50131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.524+0000 7efd57e4a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd5009f9c0 con 0x7efd5009e870 2023-10-03T10:13:49.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.524+0000 7efd55be6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd5009e870 0x7efd5009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57476/0 (socket says 172.21.15.146:57476) 2023-10-03T10:13:49.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.524+0000 7efd55be6700 1 -- 172.21.15.146:0/3296020067 learned_addr learned my addr 172.21.15.146:0/3296020067 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:49.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.525+0000 7efd55be6700 1 -- 172.21.15.146:0/3296020067 >> v2:172.21.15.146:3300/0 conn(0x7efd5009f180 msgr2=0x7efd50131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:49.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.525+0000 7efd55be6700 1 --2- 172.21.15.146:0/3296020067 >> v2:172.21.15.146:3300/0 conn(0x7efd5009f180 0x7efd50131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.525+0000 7efd55be6700 1 -- 172.21.15.146:0/3296020067 >> v1:172.21.15.146:6789/0 conn(0x7efd50131d70 legacy=0x7efd50138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.525+0000 7efd55be6700 1 -- 172.21.15.146:0/3296020067 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5009bab0 con 0x7efd5009e870 2023-10-03T10:13:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.525+0000 7efd55be6700 1 --2- 172.21.15.146:0/3296020067 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd5009e870 0x7efd5009ec40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efd4c0098f0 tx=0x7efd4c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc9eaff739ee594e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.525+0000 7efd54be4700 1 -- 172.21.15.146:0/3296020067 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4c010a90 con 0x7efd5009e870 2023-10-03T10:13:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.525+0000 7efd54be4700 1 -- 172.21.15.146:0/3296020067 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4c010bf0 con 0x7efd5009e870 2023-10-03T10:13:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.525+0000 7efd54be4700 1 -- 172.21.15.146:0/3296020067 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4c018440 con 0x7efd5009e870 2023-10-03T10:13:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.526+0000 7efd57e4a700 1 -- 172.21.15.146:0/3296020067 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd5009e870 msgr2=0x7efd5009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.526+0000 7efd57e4a700 1 --2- 172.21.15.146:0/3296020067 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd5009e870 0x7efd5009ec40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efd4c0098f0 tx=0x7efd4c009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.526+0000 7efd57e4a700 1 -- 172.21.15.146:0/3296020067 shutdown_connections 2023-10-03T10:13:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.526+0000 7efd57e4a700 1 --2- 172.21.15.146:0/3296020067 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd5009e870 0x7efd5009ec40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.526+0000 7efd57e4a700 1 --2- 172.21.15.146:0/3296020067 >> v2:172.21.15.146:3300/0 conn(0x7efd5009f180 0x7efd50131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.526+0000 7efd57e4a700 1 -- 172.21.15.146:0/3296020067 >> 172.21.15.146:0/3296020067 conn(0x7efd500a4430 msgr2=0x7efd500a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.526+0000 7efd57e4a700 1 -- 172.21.15.146:0/3296020067 shutdown_connections 2023-10-03T10:13:49.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.526+0000 7efd57e4a700 1 -- 172.21.15.146:0/3296020067 wait complete. 2023-10-03T10:13:49.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.527+0000 7efd57e4a700 1 Processor -- start 2023-10-03T10:13:49.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.527+0000 7efd57e4a700 1 -- start start 2023-10-03T10:13:49.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.527+0000 7efd57e4a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd5009e870 0x7efd5011e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.527+0000 7efd57e4a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd5009f180 0x7efd5011e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.527+0000 7efd57e4a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd50131d70 0x7efd5011ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.527+0000 7efd57e4a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd50131590 con 0x7efd50131d70 2023-10-03T10:13:49.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.527+0000 7efd57e4a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd50121000 con 0x7efd5009f180 2023-10-03T10:13:49.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.527+0000 7efd57e4a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd501219e0 con 0x7efd5009e870 2023-10-03T10:13:49.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.528+0000 7efd553e5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd5009f180 0x7efd5011e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.528+0000 7efd553e5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd5009f180 0x7efd5011e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40390/0 (socket says 172.21.15.146:40390) 2023-10-03T10:13:49.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.528+0000 7efd553e5700 1 -- 172.21.15.146:0/4192663729 learned_addr learned my addr 172.21.15.146:0/4192663729 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:49.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.528+0000 7efd563e7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd50131d70 0x7efd5011ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.528+0000 7efd55be6700 1 --2- 172.21.15.146:0/4192663729 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd5009e870 0x7efd5011e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.528+0000 7efd553e5700 1 -- 172.21.15.146:0/4192663729 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd5009e870 msgr2=0x7efd5011e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.528+0000 7efd553e5700 1 --2- 172.21.15.146:0/4192663729 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd5009e870 0x7efd5011e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.528+0000 7efd553e5700 1 -- 172.21.15.146:0/4192663729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd50131d70 msgr2=0x7efd5011ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.528+0000 7efd553e5700 1 --2- 172.21.15.146:0/4192663729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd50131d70 0x7efd5011ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.528+0000 7efd553e5700 1 -- 172.21.15.146:0/4192663729 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c009550 con 0x7efd5009f180 2023-10-03T10:13:49.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.528+0000 7efd553e5700 1 --2- 172.21.15.146:0/4192663729 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd5009f180 0x7efd5011e6e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efd4000e9b0 tx=0x7efd4000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:49.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.528+0000 7efd467fc700 1 -- 172.21.15.146:0/4192663729 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd40009710 con 0x7efd5009f180 2023-10-03T10:13:49.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.528+0000 7efd467fc700 1 -- 172.21.15.146:0/4192663729 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4000c850 con 0x7efd5009f180 2023-10-03T10:13:49.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.528+0000 7efd57e4a700 1 -- 172.21.15.146:0/4192663729 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd50120370 con 0x7efd5009f180 2023-10-03T10:13:49.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.528+0000 7efd467fc700 1 -- 172.21.15.146:0/4192663729 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4000cbe0 con 0x7efd5009f180 2023-10-03T10:13:49.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.528+0000 7efd57e4a700 1 -- 172.21.15.146:0/4192663729 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd500a2d30 con 0x7efd5009f180 2023-10-03T10:13:49.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.529+0000 7efd467fc700 1 -- 172.21.15.146:0/4192663729 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd4000cd40 con 0x7efd5009f180 2023-10-03T10:13:49.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.529+0000 7efd467fc700 1 -- 172.21.15.146:0/4192663729 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efd4003fb10 con 0x7efd5009f180 2023-10-03T10:13:49.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.530+0000 7efd57e4a700 1 -- 172.21.15.146:0/4192663729 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5004f2a0 con 0x7efd5009f180 2023-10-03T10:13:49.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.534+0000 7efd467fc700 1 -- 172.21.15.146:0/4192663729 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd40011800 con 0x7efd5009f180 2023-10-03T10:13:49.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.560+0000 7fd63476e700 1 Processor -- start 2023-10-03T10:13:49.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.560+0000 7fd63476e700 1 -- start start 2023-10-03T10:13:49.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.561+0000 7fd63476e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd62c133b80 0x7fd62c133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.561+0000 7fd63476e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd62c099a60 0x7fd62c0a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.561+0000 7fd63476e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd62c09aa00 con 0x7fd62c0a0e20 2023-10-03T10:13:49.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.561+0000 7fd63476e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62c09a080 con 0x7fd62c099a60 2023-10-03T10:13:49.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.561+0000 7fd63476e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c133750 con 0x7fd62c133b80 2023-10-03T10:13:49.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.561+0000 7fd63250a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd62c133b80 0x7fd62c133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.561+0000 7fd63250a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd62c133b80 0x7fd62c133f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57498/0 (socket says 172.21.15.146:57498) 2023-10-03T10:13:49.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.561+0000 7fd63250a700 1 -- 172.21.15.146:0/239428980 learned_addr learned my addr 172.21.15.146:0/239428980 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:49.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.561+0000 7fd631d09700 1 --2- 172.21.15.146:0/239428980 >> v2:172.21.15.146:3300/0 conn(0x7fd62c099a60 0x7fd62c0a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.562+0000 7fd63250a700 1 -- 172.21.15.146:0/239428980 >> v2:172.21.15.146:3300/0 conn(0x7fd62c099a60 msgr2=0x7fd62c0a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:49.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.562+0000 7fd63250a700 1 --2- 172.21.15.146:0/239428980 >> v2:172.21.15.146:3300/0 conn(0x7fd62c099a60 0x7fd62c0a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.562+0000 7fd63250a700 1 -- 172.21.15.146:0/239428980 >> v1:172.21.15.146:6789/0 conn(0x7fd62c0a0e20 legacy=0x7fd62c13a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.562+0000 7fd63250a700 1 -- 172.21.15.146:0/239428980 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c09a760 con 0x7fd62c133b80 2023-10-03T10:13:49.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.562+0000 7fd63250a700 1 --2- 172.21.15.146:0/239428980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd62c133b80 0x7fd62c133f50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd628006fd0 tx=0x7fd628009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72caff2a8f423fc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:49.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.562+0000 7fd631508700 1 -- 172.21.15.146:0/239428980 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd628005e30 con 0x7fd62c133b80 2023-10-03T10:13:49.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.562+0000 7fd631508700 1 -- 172.21.15.146:0/239428980 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd628004030 con 0x7fd62c133b80 2023-10-03T10:13:49.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.562+0000 7fd631508700 1 -- 172.21.15.146:0/239428980 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6280043e0 con 0x7fd62c133b80 2023-10-03T10:13:49.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.563+0000 7fd63476e700 1 -- 172.21.15.146:0/239428980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd62c133b80 msgr2=0x7fd62c133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.563+0000 7fd63476e700 1 --2- 172.21.15.146:0/239428980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd62c133b80 0x7fd62c133f50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd628006fd0 tx=0x7fd628009bd0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.563+0000 7fd63476e700 1 -- 172.21.15.146:0/239428980 shutdown_connections 2023-10-03T10:13:49.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.563+0000 7fd63476e700 1 --2- 172.21.15.146:0/239428980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd62c133b80 0x7fd62c133f50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.563+0000 7fd63476e700 1 --2- 172.21.15.146:0/239428980 >> v2:172.21.15.146:3300/0 conn(0x7fd62c099a60 0x7fd62c0a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.563+0000 7fd63476e700 1 -- 172.21.15.146:0/239428980 >> 172.21.15.146:0/239428980 conn(0x7fd62c0a2980 msgr2=0x7fd62c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.563+0000 7fd63476e700 1 -- 172.21.15.146:0/239428980 shutdown_connections 2023-10-03T10:13:49.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.563+0000 7fd63476e700 1 -- 172.21.15.146:0/239428980 wait complete. 2023-10-03T10:13:49.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.564+0000 7fd63476e700 1 Processor -- start 2023-10-03T10:13:49.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.564+0000 7fd63476e700 1 -- start start 2023-10-03T10:13:49.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.564+0000 7fd63476e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd62c099a60 0x7fd62c11b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.564+0000 7fd63476e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd62c0a0e20 0x7fd62c11bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.564+0000 7fd63476e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd62c133b80 0x7fd62c11c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.564+0000 7fd63476e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c11eae0 con 0x7fd62c0a0e20 2023-10-03T10:13:49.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.565+0000 7fd63476e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c09c450 con 0x7fd62c133b80 2023-10-03T10:13:49.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.565+0000 7fd63476e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c09a2c0 con 0x7fd62c099a60 2023-10-03T10:13:49.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.565+0000 7fd63250a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd62c099a60 0x7fd62c11b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.565+0000 7fd63250a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd62c099a60 0x7fd62c11b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57514/0 (socket says 172.21.15.146:57514) 2023-10-03T10:13:49.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.565+0000 7fd632d0b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd62c133b80 0x7fd62c11c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.565+0000 7fd63250a700 1 -- 172.21.15.146:0/2221378771 learned_addr learned my addr 172.21.15.146:0/2221378771 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:49.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.565+0000 7fd631d09700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd62c0a0e20 0x7fd62c11bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.565+0000 7fd63250a700 1 -- 172.21.15.146:0/2221378771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd62c133b80 msgr2=0x7fd62c11c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.565+0000 7fd63250a700 1 --2- 172.21.15.146:0/2221378771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd62c133b80 0x7fd62c11c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.565+0000 7fd63250a700 1 -- 172.21.15.146:0/2221378771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd62c0a0e20 msgr2=0x7fd62c11bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.565+0000 7fd63250a700 1 --2- 172.21.15.146:0/2221378771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd62c0a0e20 0x7fd62c11bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.565+0000 7fd63250a700 1 -- 172.21.15.146:0/2221378771 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd628009500 con 0x7fd62c099a60 2023-10-03T10:13:49.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.565+0000 7fd63250a700 1 --2- 172.21.15.146:0/2221378771 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd62c099a60 0x7fd62c11b880 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd628009c10 tx=0x7fd628004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:49.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.565+0000 7fd622ffd700 1 -- 172.21.15.146:0/2221378771 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd628003c70 con 0x7fd62c099a60 2023-10-03T10:13:49.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.565+0000 7fd622ffd700 1 -- 172.21.15.146:0/2221378771 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd628003df0 con 0x7fd62c099a60 2023-10-03T10:13:49.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.565+0000 7fd63476e700 1 -- 172.21.15.146:0/2221378771 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd62c11d440 con 0x7fd62c099a60 2023-10-03T10:13:49.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.565+0000 7fd622ffd700 1 -- 172.21.15.146:0/2221378771 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62801c660 con 0x7fd62c099a60 2023-10-03T10:13:49.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.566+0000 7fd63476e700 1 -- 172.21.15.146:0/2221378771 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd62c11f850 con 0x7fd62c099a60 2023-10-03T10:13:49.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.566+0000 7fd622ffd700 1 -- 172.21.15.146:0/2221378771 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd62801c7c0 con 0x7fd62c099a60 2023-10-03T10:13:49.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.566+0000 7fd63476e700 1 -- 172.21.15.146:0/2221378771 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd62c11ed10 con 0x7fd62c099a60 2023-10-03T10:13:49.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.567+0000 7fd622ffd700 1 -- 172.21.15.146:0/2221378771 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd628040640 con 0x7fd62c099a60 2023-10-03T10:13:49.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.575+0000 7fd622ffd700 1 -- 172.21.15.146:0/2221378771 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd62c11ed10 con 0x7fd62c099a60 2023-10-03T10:13:49.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.606+0000 7f9531ffc700 1 Processor -- start 2023-10-03T10:13:49.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.606+0000 7f9531ffc700 1 -- start start 2023-10-03T10:13:49.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.607+0000 7f9531ffc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f952c09a130 0x7f952c09e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.607+0000 7f9531ffc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f952c09edb0 0x7f952c09f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.607+0000 7f9531ffc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f952c13c410 0x7f952c13e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.607+0000 7f9531ffc700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952c09a500 con 0x7f952c13c410 2023-10-03T10:13:49.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.607+0000 7f9531ffc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c09f720 con 0x7f952c09edb0 2023-10-03T10:13:49.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.607+0000 7f9531ffc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f952c072b30 con 0x7f952c09a130 2023-10-03T10:13:49.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.607+0000 7f952bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f952c13c410 0x7f952c13e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.607+0000 7f952b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f952c09a130 0x7f952c09e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.607+0000 7f952bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f952c13c410 0x7f952c13e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43040/0 (socket says 172.21.15.146:43040) 2023-10-03T10:13:49.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.607+0000 7f952bfff700 1 -- 172.21.15.146:0/1642664869 learned_addr learned my addr 172.21.15.146:0/1642664869 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:49.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.607+0000 7f952b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f952c09a130 0x7f952c09e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57516/0 (socket says 172.21.15.146:57516) 2023-10-03T10:13:49.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.607+0000 7f952affd700 1 --2- 172.21.15.146:0/1642664869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f952c09edb0 0x7f952c09f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.608+0000 7f952affd700 1 -- 172.21.15.146:0/1642664869 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f952c09a130 msgr2=0x7f952c09e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:49.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.608+0000 7f952affd700 1 --2- 172.21.15.146:0/1642664869 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f952c09a130 0x7f952c09e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.608+0000 7f952affd700 1 -- 172.21.15.146:0/1642664869 >> v2:172.21.15.146:3300/0 conn(0x7f952c13c410 msgr2=0x7f952c13e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:49.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.608+0000 7f952affd700 1 --2- 172.21.15.146:0/1642664869 >> v2:172.21.15.146:3300/0 conn(0x7f952c13c410 0x7f952c13e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.608+0000 7f952affd700 1 -- 172.21.15.146:0/1642664869 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c09fe00 con 0x7f952c09edb0 2023-10-03T10:13:49.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.608+0000 7f952b7fe700 1 --2- 172.21.15.146:0/1642664869 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f952c09a130 0x7f952c09e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:49.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.608+0000 7f952affd700 1 --2- 172.21.15.146:0/1642664869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f952c09edb0 0x7f952c09f1e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9520009870 tx=0x7f9520009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d19d5e1f1eaa7976 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:49.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.608+0000 7f952a7fc700 1 -- 172.21.15.146:0/1642664869 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520011830 con 0x7f952c09edb0 2023-10-03T10:13:49.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.608+0000 7f952a7fc700 1 -- 172.21.15.146:0/1642664869 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9520011990 con 0x7f952c09edb0 2023-10-03T10:13:49.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.608+0000 7f952a7fc700 1 -- 172.21.15.146:0/1642664869 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520011d20 con 0x7f952c09edb0 2023-10-03T10:13:49.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.609+0000 7f9531ffc700 1 -- 172.21.15.146:0/1642664869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f952c09edb0 msgr2=0x7f952c09f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.609+0000 7f9531ffc700 1 --2- 172.21.15.146:0/1642664869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f952c09edb0 0x7f952c09f1e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9520009870 tx=0x7f9520009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:49.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.609+0000 7f9531ffc700 1 -- 172.21.15.146:0/1642664869 shutdown_connections 2023-10-03T10:13:49.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.609+0000 7f9531ffc700 1 --2- 172.21.15.146:0/1642664869 >> v2:172.21.15.146:3300/0 conn(0x7f952c13c410 0x7f952c13e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.609+0000 7f9531ffc700 1 --2- 172.21.15.146:0/1642664869 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f952c09a130 0x7f952c09e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.609+0000 7f9531ffc700 1 --2- 172.21.15.146:0/1642664869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f952c09edb0 0x7f952c09f1e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.609+0000 7f9531ffc700 1 -- 172.21.15.146:0/1642664869 >> 172.21.15.146:0/1642664869 conn(0x7f952c0a4430 msgr2=0x7f952c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.609+0000 7f9531ffc700 1 -- 172.21.15.146:0/1642664869 shutdown_connections 2023-10-03T10:13:49.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.609+0000 7f9531ffc700 1 -- 172.21.15.146:0/1642664869 wait complete. 2023-10-03T10:13:49.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.610+0000 7f9531ffc700 1 Processor -- start 2023-10-03T10:13:49.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.610+0000 7f9531ffc700 1 -- start start 2023-10-03T10:13:49.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.610+0000 7f9531ffc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f952c09a130 0x7f952c13a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.610+0000 7f9531ffc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f952c09edb0 0x7f952c13ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.610+0000 7f9531ffc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f952c13c410 0x7f952c13b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.610+0000 7f9531ffc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c11d8c0 con 0x7f952c09a130 2023-10-03T10:13:49.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.610+0000 7f9531ffc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c13c290 con 0x7f952c13c410 2023-10-03T10:13:49.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.610+0000 7f9531ffc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f952c1203b0 con 0x7f952c09edb0 2023-10-03T10:13:49.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.610+0000 7f952bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f952c13c410 0x7f952c13b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.610+0000 7f952affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f952c09edb0 0x7f952c13ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.610+0000 7f952bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f952c13c410 0x7f952c13b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40422/0 (socket says 172.21.15.146:40422) 2023-10-03T10:13:49.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.610+0000 7f952bfff700 1 -- 172.21.15.146:0/140821501 learned_addr learned my addr 172.21.15.146:0/140821501 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:49.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.610+0000 7f952b7fe700 1 --2- 172.21.15.146:0/140821501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f952c09a130 0x7f952c13a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.611+0000 7f952bfff700 1 -- 172.21.15.146:0/140821501 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f952c09edb0 msgr2=0x7f952c13ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.611+0000 7f952bfff700 1 --2- 172.21.15.146:0/140821501 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f952c09edb0 0x7f952c13ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.611+0000 7f952bfff700 1 -- 172.21.15.146:0/140821501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f952c09a130 msgr2=0x7f952c13a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.611+0000 7f952bfff700 1 --2- 172.21.15.146:0/140821501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f952c09a130 0x7f952c13a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.611+0000 7f952bfff700 1 -- 172.21.15.146:0/140821501 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c0094a0 con 0x7f952c13c410 2023-10-03T10:13:49.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.611+0000 7f952b7fe700 1 --2- 172.21.15.146:0/140821501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f952c09a130 0x7f952c13a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:49.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.611+0000 7f952affd700 1 --2- 172.21.15.146:0/140821501 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f952c09edb0 0x7f952c13ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:49.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.611+0000 7f952bfff700 1 --2- 172.21.15.146:0/140821501 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f952c13c410 0x7f952c13b380 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9524009d90 tx=0x7f952400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:49.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.611+0000 7f9513fff700 1 -- 172.21.15.146:0/140821501 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9524003c20 con 0x7f952c13c410 2023-10-03T10:13:49.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.611+0000 7f9513fff700 1 -- 172.21.15.146:0/140821501 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952400f040 con 0x7f952c13c410 2023-10-03T10:13:49.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.611+0000 7f9513fff700 1 -- 172.21.15.146:0/140821501 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952400c880 con 0x7f952c13c410 2023-10-03T10:13:49.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.612+0000 7f9531ffc700 1 -- 172.21.15.146:0/140821501 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95200094a0 con 0x7f952c13c410 2023-10-03T10:13:49.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.612+0000 7f9531ffc700 1 -- 172.21.15.146:0/140821501 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952c11f780 con 0x7f952c13c410 2023-10-03T10:13:49.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.613+0000 7f9513fff700 1 -- 172.21.15.146:0/140821501 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f952400c9e0 con 0x7f952c13c410 2023-10-03T10:13:49.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.613+0000 7f9531ffc700 1 -- 172.21.15.146:0/140821501 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952c11fd70 con 0x7f952c13c410 2023-10-03T10:13:49.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.613+0000 7f9513fff700 1 -- 172.21.15.146:0/140821501 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f952403f900 con 0x7f952c13c410 2023-10-03T10:13:49.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.622+0000 7f9513fff700 1 -- 172.21.15.146:0/140821501 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f952c11fd70 con 0x7f952c13c410 2023-10-03T10:13:49.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.690+0000 7f195b19f700 1 -- 172.21.15.146:0/2452417122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f195406b2a0 con 0x7f195409f180 2023-10-03T10:13:49.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.691+0000 7f19517fa700 1 -- 172.21.15.146:0/2452417122 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1940017030 con 0x7f195409f180 2023-10-03T10:13:49.690 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:49.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.694+0000 7f195b19f700 1 -- 172.21.15.146:0/2452417122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f195409f180 msgr2=0x7f195406bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.694+0000 7f195b19f700 1 --2- 172.21.15.146:0/2452417122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f195409f180 0x7f195406bdf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f194000e9b0 tx=0x7f194000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.694+0000 7f195b19f700 1 -- 172.21.15.146:0/2452417122 shutdown_connections 2023-10-03T10:13:49.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.694+0000 7f195b19f700 1 --2- 172.21.15.146:0/2452417122 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1954131d70 0x7f195406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.694+0000 7f195b19f700 1 --2- 172.21.15.146:0/2452417122 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f195409e870 0x7f195406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.694+0000 7f195b19f700 1 --2- 172.21.15.146:0/2452417122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f195409f180 0x7f195406bdf0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.694+0000 7f195b19f700 1 -- 172.21.15.146:0/2452417122 >> 172.21.15.146:0/2452417122 conn(0x7f19540a4430 msgr2=0x7f195409cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.694+0000 7f195b19f700 1 -- 172.21.15.146:0/2452417122 shutdown_connections 2023-10-03T10:13:49.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.694+0000 7f195b19f700 1 -- 172.21.15.146:0/2452417122 wait complete. 2023-10-03T10:13:49.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:49.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.736+0000 7efd57e4a700 1 -- 172.21.15.146:0/4192663729 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efd500a27b0 con 0x7efd5009f180 2023-10-03T10:13:49.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.736+0000 7efd467fc700 1 -- 172.21.15.146:0/4192663729 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efd40017020 con 0x7efd5009f180 2023-10-03T10:13:49.737 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:49.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.738+0000 7efd57e4a700 1 -- 172.21.15.146:0/4192663729 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd5009f180 msgr2=0x7efd5011e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.738+0000 7efd57e4a700 1 --2- 172.21.15.146:0/4192663729 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd5009f180 0x7efd5011e6e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efd4000e9b0 tx=0x7efd4000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.738+0000 7efd57e4a700 1 -- 172.21.15.146:0/4192663729 shutdown_connections 2023-10-03T10:13:49.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.738+0000 7efd57e4a700 1 --2- 172.21.15.146:0/4192663729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd50131d70 0x7efd5011ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.738+0000 7efd57e4a700 1 --2- 172.21.15.146:0/4192663729 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd5009e870 0x7efd5011e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.738+0000 7efd57e4a700 1 --2- 172.21.15.146:0/4192663729 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd5009f180 0x7efd5011e6e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.738+0000 7efd57e4a700 1 -- 172.21.15.146:0/4192663729 >> 172.21.15.146:0/4192663729 conn(0x7efd500a4430 msgr2=0x7efd5006c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.738+0000 7efd57e4a700 1 -- 172.21.15.146:0/4192663729 shutdown_connections 2023-10-03T10:13:49.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.738+0000 7efd57e4a700 1 -- 172.21.15.146:0/4192663729 wait complete. 2023-10-03T10:13:49.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:49.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.775+0000 7fd63476e700 1 -- 172.21.15.146:0/2221378771 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd62c11ed10 con 0x7fd62c099a60 2023-10-03T10:13:49.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.775+0000 7fd622ffd700 1 -- 172.21.15.146:0/2221378771 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd62c11ed10 con 0x7fd62c099a60 2023-10-03T10:13:49.775 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:49.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.777+0000 7fd63476e700 1 -- 172.21.15.146:0/2221378771 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd62c099a60 msgr2=0x7fd62c11b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.777+0000 7fd63476e700 1 --2- 172.21.15.146:0/2221378771 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd62c099a60 0x7fd62c11b880 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd628009c10 tx=0x7fd628004750 comp rx=0 tx=0).stop 2023-10-03T10:13:49.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.777+0000 7fd63476e700 1 -- 172.21.15.146:0/2221378771 shutdown_connections 2023-10-03T10:13:49.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.777+0000 7fd63476e700 1 --2- 172.21.15.146:0/2221378771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd62c133b80 0x7fd62c11c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.777+0000 7fd63476e700 1 --2- 172.21.15.146:0/2221378771 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd62c099a60 0x7fd62c11b880 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.777+0000 7fd63476e700 1 --2- 172.21.15.146:0/2221378771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd62c0a0e20 0x7fd62c11bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.777+0000 7fd63476e700 1 -- 172.21.15.146:0/2221378771 >> 172.21.15.146:0/2221378771 conn(0x7fd62c0a2980 msgr2=0x7fd62c09ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.777+0000 7fd63476e700 1 -- 172.21.15.146:0/2221378771 shutdown_connections 2023-10-03T10:13:49.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.777+0000 7fd63476e700 1 -- 172.21.15.146:0/2221378771 wait complete. 2023-10-03T10:13:49.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:49.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.818+0000 7f9531ffc700 1 -- 172.21.15.146:0/140821501 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f952c11fd70 con 0x7f952c13c410 2023-10-03T10:13:49.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.819+0000 7f9513fff700 1 -- 172.21.15.146:0/140821501 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f952c11fd70 con 0x7f952c13c410 2023-10-03T10:13:49.819 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:49.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.821+0000 7f9531ffc700 1 -- 172.21.15.146:0/140821501 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f952c13c410 msgr2=0x7f952c13b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.821+0000 7f9531ffc700 1 --2- 172.21.15.146:0/140821501 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f952c13c410 0x7f952c13b380 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9524009d90 tx=0x7f952400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.821+0000 7f9531ffc700 1 -- 172.21.15.146:0/140821501 shutdown_connections 2023-10-03T10:13:49.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.821+0000 7f9531ffc700 1 --2- 172.21.15.146:0/140821501 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f952c13c410 0x7f952c13b380 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.821+0000 7f9531ffc700 1 --2- 172.21.15.146:0/140821501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f952c09a130 0x7f952c13a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.821+0000 7f9531ffc700 1 --2- 172.21.15.146:0/140821501 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f952c09edb0 0x7f952c13ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.821+0000 7f9531ffc700 1 -- 172.21.15.146:0/140821501 >> 172.21.15.146:0/140821501 conn(0x7f952c0a4430 msgr2=0x7f952c0a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.821+0000 7f9531ffc700 1 -- 172.21.15.146:0/140821501 shutdown_connections 2023-10-03T10:13:49.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:49.821+0000 7f9531ffc700 1 -- 172.21.15.146:0/140821501 wait complete. 2023-10-03T10:13:49.832 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:50.707 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:50.753 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:50.790 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:50.833 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:50.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.853+0000 7f9151981700 1 Processor -- start 2023-10-03T10:13:50.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.853+0000 7f9151981700 1 -- start start 2023-10-03T10:13:50.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.853+0000 7f9151981700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f914c09d860 0x7f914c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.853+0000 7f9151981700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f914c09e170 0x7f914c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.853+0000 7f9151981700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f914c130ce0 0x7f914c131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.853+0000 7f9151981700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914c09aaa0 con 0x7f914c09e170 2023-10-03T10:13:50.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.853+0000 7f9151981700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914c09f870 con 0x7f914c09d860 2023-10-03T10:13:50.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.853+0000 7f9151981700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f914c09b360 con 0x7f914c130ce0 2023-10-03T10:13:50.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.854+0000 7f914affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f914c09d860 0x7f914c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.854+0000 7f914affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f914c09d860 0x7f914c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40438/0 (socket says 172.21.15.146:40438) 2023-10-03T10:13:50.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.854+0000 7f914affd700 1 -- 172.21.15.146:0/526503631 learned_addr learned my addr 172.21.15.146:0/526503631 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:50.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.854+0000 7f914a7fc700 1 --2- 172.21.15.146:0/526503631 >> v2:172.21.15.146:3300/0 conn(0x7f914c09e170 0x7f914c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.854+0000 7f914b7fe700 1 --2- 172.21.15.146:0/526503631 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f914c130ce0 0x7f914c131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.854+0000 7f914affd700 1 -- 172.21.15.146:0/526503631 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f914c130ce0 msgr2=0x7f914c131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.854+0000 7f914affd700 1 --2- 172.21.15.146:0/526503631 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f914c130ce0 0x7f914c131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.854+0000 7f914affd700 1 -- 172.21.15.146:0/526503631 >> v2:172.21.15.146:3300/0 conn(0x7f914c09e170 msgr2=0x7f914c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.854+0000 7f914affd700 1 --2- 172.21.15.146:0/526503631 >> v2:172.21.15.146:3300/0 conn(0x7f914c09e170 0x7f914c1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.854+0000 7f914affd700 1 -- 172.21.15.146:0/526503631 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c09b620 con 0x7f914c09d860 2023-10-03T10:13:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.854+0000 7f914a7fc700 1 --2- 172.21.15.146:0/526503631 >> v2:172.21.15.146:3300/0 conn(0x7f914c09e170 0x7f914c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.854+0000 7f914affd700 1 --2- 172.21.15.146:0/526503631 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f914c09d860 0x7f914c09dc30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f913c009920 tx=0x7f913c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69c7bbacc8c73a1c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.854+0000 7f9149ffb700 1 -- 172.21.15.146:0/526503631 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c012b80 con 0x7f914c09d860 2023-10-03T10:13:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.855+0000 7f9149ffb700 1 -- 172.21.15.146:0/526503631 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c012ce0 con 0x7f914c09d860 2023-10-03T10:13:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.855+0000 7f9149ffb700 1 -- 172.21.15.146:0/526503631 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c01b620 con 0x7f914c09d860 2023-10-03T10:13:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.855+0000 7f9151981700 1 -- 172.21.15.146:0/526503631 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f914c09d860 msgr2=0x7f914c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.855+0000 7f9151981700 1 --2- 172.21.15.146:0/526503631 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f914c09d860 0x7f914c09dc30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f913c009920 tx=0x7f913c009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.855+0000 7f9151981700 1 -- 172.21.15.146:0/526503631 shutdown_connections 2023-10-03T10:13:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.855+0000 7f9151981700 1 --2- 172.21.15.146:0/526503631 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f914c09d860 0x7f914c09dc30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.855+0000 7f9151981700 1 --2- 172.21.15.146:0/526503631 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f914c130ce0 0x7f914c131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.855+0000 7f9151981700 1 --2- 172.21.15.146:0/526503631 >> v2:172.21.15.146:3300/0 conn(0x7f914c09e170 0x7f914c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.855+0000 7f9151981700 1 -- 172.21.15.146:0/526503631 >> 172.21.15.146:0/526503631 conn(0x7f914c099c40 msgr2=0x7f914c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.856+0000 7f9151981700 1 -- 172.21.15.146:0/526503631 shutdown_connections 2023-10-03T10:13:50.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.856+0000 7f9151981700 1 -- 172.21.15.146:0/526503631 wait complete. 2023-10-03T10:13:50.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.857+0000 7f9151981700 1 Processor -- start 2023-10-03T10:13:50.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.857+0000 7f9151981700 1 -- start start 2023-10-03T10:13:50.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.857+0000 7f9151981700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f914c09d860 0x7f914c1c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.857+0000 7f9151981700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f914c09e170 0x7f914c1c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.857+0000 7f9151981700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f914c130ce0 0x7f914c1cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.857+0000 7f9151981700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c12a2a0 con 0x7f914c09d860 2023-10-03T10:13:50.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.857+0000 7f9151981700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914c1ca430 con 0x7f914c130ce0 2023-10-03T10:13:50.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.857+0000 7f9151981700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f914c1285e0 con 0x7f914c09e170 2023-10-03T10:13:50.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.858+0000 7f914affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f914c09d860 0x7f914c1c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.858+0000 7f914affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f914c09d860 0x7f914c1c99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43072/0 (socket says 172.21.15.146:43072) 2023-10-03T10:13:50.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.858+0000 7f914affd700 1 -- 172.21.15.146:0/440186808 learned_addr learned my addr 172.21.15.146:0/440186808 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:50.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.858+0000 7f914a7fc700 1 --2- 172.21.15.146:0/440186808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f914c09e170 0x7f914c1c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.858+0000 7f914b7fe700 1 --2- 172.21.15.146:0/440186808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f914c130ce0 0x7f914c1cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.858+0000 7f914a7fc700 1 -- 172.21.15.146:0/440186808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f914c130ce0 msgr2=0x7f914c1cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.858+0000 7f914a7fc700 1 --2- 172.21.15.146:0/440186808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f914c130ce0 0x7f914c1cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.858+0000 7f914a7fc700 1 -- 172.21.15.146:0/440186808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f914c09d860 msgr2=0x7f914c1c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.858+0000 7f914a7fc700 1 --2- 172.21.15.146:0/440186808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f914c09d860 0x7f914c1c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.858+0000 7f914a7fc700 1 -- 172.21.15.146:0/440186808 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91400094a0 con 0x7f914c09e170 2023-10-03T10:13:50.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.858+0000 7f914a7fc700 1 --2- 172.21.15.146:0/440186808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f914c09e170 0x7f914c1c9ef0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f914c09a100 tx=0x7f914000ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.858+0000 7f9133fff700 1 -- 172.21.15.146:0/440186808 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9140004240 con 0x7f914c09e170 2023-10-03T10:13:50.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.858+0000 7f9133fff700 1 -- 172.21.15.146:0/440186808 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91400043a0 con 0x7f914c09e170 2023-10-03T10:13:50.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.858+0000 7f9151981700 1 -- 172.21.15.146:0/440186808 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913c009550 con 0x7f914c09e170 2023-10-03T10:13:50.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.859+0000 7f9133fff700 1 -- 172.21.15.146:0/440186808 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91400036a0 con 0x7f914c09e170 2023-10-03T10:13:50.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.859+0000 7f9151981700 1 -- 172.21.15.146:0/440186808 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914c09c8b0 con 0x7f914c09e170 2023-10-03T10:13:50.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.859+0000 7f9133fff700 1 -- 172.21.15.146:0/440186808 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9140003800 con 0x7f914c09e170 2023-10-03T10:13:50.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.860+0000 7f9133fff700 1 -- 172.21.15.146:0/440186808 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f91400421c0 con 0x7f914c09e170 2023-10-03T10:13:50.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.860+0000 7f9151981700 1 -- 172.21.15.146:0/440186808 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914c04f2a0 con 0x7f914c09e170 2023-10-03T10:13:50.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.865+0000 7f9133fff700 1 -- 172.21.15.146:0/440186808 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9140044060 con 0x7f914c09e170 2023-10-03T10:13:50.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.892+0000 7f2df9f1b700 1 Processor -- start 2023-10-03T10:13:50.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.892+0000 7f2df9f1b700 1 -- start start 2023-10-03T10:13:50.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.893+0000 7f2df9f1b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2df40a1510 0x7f2df41351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.893+0000 7f2df9f1b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2df41356e0 0x7f2df4137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.893+0000 7f2df9f1b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df40a1e70 con 0x7f2df40a0a30 2023-10-03T10:13:50.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.893+0000 7f2df9f1b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df409a720 con 0x7f2df41356e0 2023-10-03T10:13:50.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.893+0000 7f2df9f1b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df409b300 con 0x7f2df40a1510 2023-10-03T10:13:50.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.893+0000 7f2df37fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2df40a0a30 0x7f2df40a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58688/0 (socket says 172.21.15.146:58688) 2023-10-03T10:13:50.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.893+0000 7f2df37fe700 1 -- 172.21.15.146:0/2880684431 learned_addr learned my addr 172.21.15.146:0/2880684431 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:50.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.893+0000 7f2df2ffd700 1 --2- 172.21.15.146:0/2880684431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2df40a1510 0x7f2df41351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.893+0000 7f2df3fff700 1 --2- 172.21.15.146:0/2880684431 >> v2:172.21.15.146:3300/0 conn(0x7f2df41356e0 0x7f2df4137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.894+0000 7f2df2ffd700 1 -- 172.21.15.146:0/2880684431 >> v2:172.21.15.146:3300/0 conn(0x7f2df41356e0 msgr2=0x7f2df4137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.894+0000 7f2df2ffd700 1 --2- 172.21.15.146:0/2880684431 >> v2:172.21.15.146:3300/0 conn(0x7f2df41356e0 0x7f2df4137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.894+0000 7f2df2ffd700 1 -- 172.21.15.146:0/2880684431 >> v1:172.21.15.146:6789/0 conn(0x7f2df40a0a30 legacy=0x7f2df40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.894+0000 7f2df2ffd700 1 -- 172.21.15.146:0/2880684431 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df409abc0 con 0x7f2df40a1510 2023-10-03T10:13:50.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.894+0000 7f2df2ffd700 1 --2- 172.21.15.146:0/2880684431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2df40a1510 0x7f2df41351a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2de800a950 tx=0x7f2de800ac60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57c97a52f9d735a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.894+0000 7f2df27fc700 1 -- 172.21.15.146:0/2880684431 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de800aea0 con 0x7f2df40a1510 2023-10-03T10:13:50.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.894+0000 7f2df27fc700 1 -- 172.21.15.146:0/2880684431 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de8004230 con 0x7f2df40a1510 2023-10-03T10:13:50.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.894+0000 7f2df27fc700 1 -- 172.21.15.146:0/2880684431 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de800c760 con 0x7f2df40a1510 2023-10-03T10:13:50.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.895+0000 7f2df9f1b700 1 -- 172.21.15.146:0/2880684431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2df40a1510 msgr2=0x7f2df41351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.895+0000 7f2df9f1b700 1 --2- 172.21.15.146:0/2880684431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2df40a1510 0x7f2df41351a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2de800a950 tx=0x7f2de800ac60 comp rx=0 tx=0).stop 2023-10-03T10:13:50.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.895+0000 7f2df9f1b700 1 -- 172.21.15.146:0/2880684431 shutdown_connections 2023-10-03T10:13:50.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.895+0000 7f2df9f1b700 1 --2- 172.21.15.146:0/2880684431 >> v2:172.21.15.146:3300/0 conn(0x7f2df41356e0 0x7f2df4137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.895+0000 7f2df9f1b700 1 --2- 172.21.15.146:0/2880684431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2df40a1510 0x7f2df41351a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.895+0000 7f2df9f1b700 1 -- 172.21.15.146:0/2880684431 >> 172.21.15.146:0/2880684431 conn(0x7f2df40a2980 msgr2=0x7f2df40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.895+0000 7f2df9f1b700 1 -- 172.21.15.146:0/2880684431 shutdown_connections 2023-10-03T10:13:50.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.895+0000 7f2df9f1b700 1 -- 172.21.15.146:0/2880684431 wait complete. 2023-10-03T10:13:50.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.896+0000 7f2df9f1b700 1 Processor -- start 2023-10-03T10:13:50.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.897+0000 7f2df9f1b700 1 -- start start 2023-10-03T10:13:50.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.897+0000 7f2df9f1b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2df40a0a30 0x7f2df41c0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.897+0000 7f2df9f1b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2df40a1510 0x7f2df41c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.897+0000 7f2df9f1b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2df41356e0 0x7f2df41c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.897+0000 7f2df9f1b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4120190 con 0x7f2df41356e0 2023-10-03T10:13:50.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.897+0000 7f2df9f1b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df41225b0 con 0x7f2df40a1510 2023-10-03T10:13:50.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.897+0000 7f2df9f1b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4121af0 con 0x7f2df40a0a30 2023-10-03T10:13:50.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.897+0000 7f2df37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2df40a0a30 0x7f2df41c0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.897+0000 7f2df2ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2df40a1510 0x7f2df41c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.898+0000 7f2df37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2df40a0a30 0x7f2df41c0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57544/0 (socket says 172.21.15.146:57544) 2023-10-03T10:13:50.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.898+0000 7f2df2ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2df40a1510 0x7f2df41c13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40458/0 (socket says 172.21.15.146:40458) 2023-10-03T10:13:50.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.898+0000 7f2df37fe700 1 -- 172.21.15.146:0/2874908748 learned_addr learned my addr 172.21.15.146:0/2874908748 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:50.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.898+0000 7f2df3fff700 1 --2- 172.21.15.146:0/2874908748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2df41356e0 0x7f2df41c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.898+0000 7f2df2ffd700 1 -- 172.21.15.146:0/2874908748 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2df40a0a30 msgr2=0x7f2df41c0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.898+0000 7f2df2ffd700 1 --2- 172.21.15.146:0/2874908748 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2df40a0a30 0x7f2df41c0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.898+0000 7f2df2ffd700 1 -- 172.21.15.146:0/2874908748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2df41356e0 msgr2=0x7f2df41c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.898+0000 7f2df2ffd700 1 --2- 172.21.15.146:0/2874908748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2df41356e0 0x7f2df41c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.898+0000 7f2df2ffd700 1 -- 172.21.15.146:0/2874908748 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de800a5b0 con 0x7f2df40a1510 2023-10-03T10:13:50.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.898+0000 7f2df37fe700 1 --2- 172.21.15.146:0/2874908748 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2df40a0a30 0x7f2df41c0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:50.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.898+0000 7f2df2ffd700 1 --2- 172.21.15.146:0/2874908748 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2df40a1510 0x7f2df41c13b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2df409a230 tx=0x7f2de8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.898+0000 7f2ddbfff700 1 -- 172.21.15.146:0/2874908748 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de8006ea0 con 0x7f2df40a1510 2023-10-03T10:13:50.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.898+0000 7f2ddbfff700 1 -- 172.21.15.146:0/2874908748 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de800c970 con 0x7f2df40a1510 2023-10-03T10:13:50.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.898+0000 7f2df9f1b700 1 -- 172.21.15.146:0/2874908748 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df409ae00 con 0x7f2df40a1510 2023-10-03T10:13:50.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.898+0000 7f2ddbfff700 1 -- 172.21.15.146:0/2874908748 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de800cd00 con 0x7f2df40a1510 2023-10-03T10:13:50.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.899+0000 7f2df9f1b700 1 -- 172.21.15.146:0/2874908748 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df409ff10 con 0x7f2df40a1510 2023-10-03T10:13:50.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.899+0000 7f2ddbfff700 1 -- 172.21.15.146:0/2874908748 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2de80036a0 con 0x7f2df40a1510 2023-10-03T10:13:50.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.900+0000 7f2df9f1b700 1 -- 172.21.15.146:0/2874908748 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df404f2a0 con 0x7f2df40a1510 2023-10-03T10:13:50.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.900+0000 7f2ddbfff700 1 -- 172.21.15.146:0/2874908748 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2de8040de0 con 0x7f2df40a1510 2023-10-03T10:13:50.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.905+0000 7f2ddbfff700 1 -- 172.21.15.146:0/2874908748 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2de801a9e0 con 0x7f2df40a1510 2023-10-03T10:13:50.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.936+0000 7f6e49633700 1 Processor -- start 2023-10-03T10:13:50.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.936+0000 7f6e49633700 1 -- start start 2023-10-03T10:13:50.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.937+0000 7f6e49633700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e44131980 0x7f6e44131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.937+0000 7f6e49633700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6e4409bc70 0x7f6e4409c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.937+0000 7f6e49633700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e4409c5c0 0x7f6e44138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.937+0000 7f6e49633700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e4406eb30 con 0x7f6e4409bc70 2023-10-03T10:13:50.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.937+0000 7f6e49633700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e440a1640 con 0x7f6e4409c5c0 2023-10-03T10:13:50.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.937+0000 7f6e49633700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e440a22d0 con 0x7f6e44131980 2023-10-03T10:13:50.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.937+0000 7f6e42ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e44131980 0x7f6e44131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.937+0000 7f6e42ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e44131980 0x7f6e44131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57546/0 (socket says 172.21.15.146:57546) 2023-10-03T10:13:50.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.937+0000 7f6e42ffd700 1 -- 172.21.15.146:0/123180475 learned_addr learned my addr 172.21.15.146:0/123180475 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:50.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.937+0000 7f6e427fc700 1 --2- 172.21.15.146:0/123180475 >> v2:172.21.15.146:3300/0 conn(0x7f6e4409bc70 0x7f6e4409c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.937+0000 7f6e437fe700 1 --2- 172.21.15.146:0/123180475 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e4409c5c0 0x7f6e44138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.938+0000 7f6e42ffd700 1 -- 172.21.15.146:0/123180475 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e4409c5c0 msgr2=0x7f6e44138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.938+0000 7f6e42ffd700 1 --2- 172.21.15.146:0/123180475 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e4409c5c0 0x7f6e44138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.938+0000 7f6e42ffd700 1 -- 172.21.15.146:0/123180475 >> v2:172.21.15.146:3300/0 conn(0x7f6e4409bc70 msgr2=0x7f6e4409c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.938+0000 7f6e42ffd700 1 --2- 172.21.15.146:0/123180475 >> v2:172.21.15.146:3300/0 conn(0x7f6e4409bc70 0x7f6e4409c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.938+0000 7f6e42ffd700 1 -- 172.21.15.146:0/123180475 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e44131550 con 0x7f6e44131980 2023-10-03T10:13:50.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.938+0000 7f6e427fc700 1 --2- 172.21.15.146:0/123180475 >> v2:172.21.15.146:3300/0 conn(0x7f6e4409bc70 0x7f6e4409c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:50.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.938+0000 7f6e42ffd700 1 --2- 172.21.15.146:0/123180475 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e44131980 0x7f6e44131d50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6e340098f0 tx=0x7f6e34009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f57eed8aea429922 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.938+0000 7f6e41ffb700 1 -- 172.21.15.146:0/123180475 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34005e30 con 0x7f6e44131980 2023-10-03T10:13:50.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.938+0000 7f6e41ffb700 1 -- 172.21.15.146:0/123180475 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e34004030 con 0x7f6e44131980 2023-10-03T10:13:50.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.938+0000 7f6e41ffb700 1 -- 172.21.15.146:0/123180475 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e340043e0 con 0x7f6e44131980 2023-10-03T10:13:50.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.939+0000 7f6e49633700 1 -- 172.21.15.146:0/123180475 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e44131980 msgr2=0x7f6e44131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.939+0000 7f6e49633700 1 --2- 172.21.15.146:0/123180475 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e44131980 0x7f6e44131d50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6e340098f0 tx=0x7f6e34009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:50.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.939+0000 7f6e49633700 1 -- 172.21.15.146:0/123180475 shutdown_connections 2023-10-03T10:13:50.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.939+0000 7f6e49633700 1 --2- 172.21.15.146:0/123180475 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e4409c5c0 0x7f6e44138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.939+0000 7f6e49633700 1 --2- 172.21.15.146:0/123180475 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e44131980 0x7f6e44131d50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.939+0000 7f6e49633700 1 --2- 172.21.15.146:0/123180475 >> v2:172.21.15.146:3300/0 conn(0x7f6e4409bc70 0x7f6e4409c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.939+0000 7f6e49633700 1 -- 172.21.15.146:0/123180475 >> 172.21.15.146:0/123180475 conn(0x7f6e440a2980 msgr2=0x7f6e440a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.939+0000 7f6e49633700 1 -- 172.21.15.146:0/123180475 shutdown_connections 2023-10-03T10:13:50.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.939+0000 7f6e49633700 1 -- 172.21.15.146:0/123180475 wait complete. 2023-10-03T10:13:50.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.941+0000 7f6e49633700 1 Processor -- start 2023-10-03T10:13:50.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.941+0000 7f6e49633700 1 -- start start 2023-10-03T10:13:50.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.941+0000 7f6e49633700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e4409bc70 0x7f6e4411b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.941+0000 7f6e49633700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e4409c5c0 0x7f6e4411ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.941+0000 7f6e49633700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e44131980 0x7f6e4411bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.941+0000 7f6e49633700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4412ee70 con 0x7f6e4409bc70 2023-10-03T10:13:50.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.941+0000 7f6e49633700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4411d7b0 con 0x7f6e4409c5c0 2023-10-03T10:13:50.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.941+0000 7f6e49633700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4411f070 con 0x7f6e44131980 2023-10-03T10:13:50.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.942+0000 7f6e437fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e44131980 0x7f6e4411bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.942+0000 7f6e437fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e44131980 0x7f6e4411bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57550/0 (socket says 172.21.15.146:57550) 2023-10-03T10:13:50.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.942+0000 7f6e437fe700 1 -- 172.21.15.146:0/1551526069 learned_addr learned my addr 172.21.15.146:0/1551526069 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:50.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.942+0000 7f6e42ffd700 1 --2- 172.21.15.146:0/1551526069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e4409bc70 0x7f6e4411b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.942+0000 7f6e427fc700 1 --2- 172.21.15.146:0/1551526069 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e4409c5c0 0x7f6e4411ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.942+0000 7f6e437fe700 1 -- 172.21.15.146:0/1551526069 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e4409c5c0 msgr2=0x7f6e4411ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.942+0000 7f6e437fe700 1 --2- 172.21.15.146:0/1551526069 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e4409c5c0 0x7f6e4411ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.942+0000 7f6e437fe700 1 -- 172.21.15.146:0/1551526069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e4409bc70 msgr2=0x7f6e4411b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.942+0000 7f6e437fe700 1 --2- 172.21.15.146:0/1551526069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e4409bc70 0x7f6e4411b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.942+0000 7f6e437fe700 1 -- 172.21.15.146:0/1551526069 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3800d940 con 0x7f6e44131980 2023-10-03T10:13:50.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.942+0000 7f6e427fc700 1 --2- 172.21.15.146:0/1551526069 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e4409c5c0 0x7f6e4411ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:50.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.942+0000 7f6e437fe700 1 --2- 172.21.15.146:0/1551526069 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e44131980 0x7f6e4411bfd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0042a0 tx=0x7f6e3c004660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.942+0000 7f6e2b7fe700 1 -- 172.21.15.146:0/1551526069 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c019040 con 0x7f6e44131980 2023-10-03T10:13:50.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.942+0000 7f6e2b7fe700 1 -- 172.21.15.146:0/1551526069 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c0110d0 con 0x7f6e44131980 2023-10-03T10:13:50.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.942+0000 7f6e2b7fe700 1 -- 172.21.15.146:0/1551526069 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c011460 con 0x7f6e44131980 2023-10-03T10:13:50.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.942+0000 7f6e49633700 1 -- 172.21.15.146:0/1551526069 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e34009500 con 0x7f6e44131980 2023-10-03T10:13:50.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.942+0000 7f6e49633700 1 -- 172.21.15.146:0/1551526069 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e440a1c40 con 0x7f6e44131980 2023-10-03T10:13:50.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.944+0000 7f6e49633700 1 -- 172.21.15.146:0/1551526069 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4404f2a0 con 0x7f6e44131980 2023-10-03T10:13:50.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.944+0000 7f6e2b7fe700 1 -- 172.21.15.146:0/1551526069 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e3c0115c0 con 0x7f6e44131980 2023-10-03T10:13:50.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.944+0000 7f6e2b7fe700 1 -- 172.21.15.146:0/1551526069 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6e3c048fc0 con 0x7f6e44131980 2023-10-03T10:13:50.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.948+0000 7f6e2b7fe700 1 -- 172.21.15.146:0/1551526069 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e3c011870 con 0x7f6e44131980 2023-10-03T10:13:50.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.973+0000 7ff5b5993700 1 Processor -- start 2023-10-03T10:13:50.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.974+0000 7ff5b5993700 1 -- start start 2023-10-03T10:13:50.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.974+0000 7ff5b5993700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5b009e870 0x7ff5b009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.974+0000 7ff5b5993700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff5b0134330 0x7ff5b013be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.974+0000 7ff5b5993700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b009fa00 con 0x7ff5b009f180 2023-10-03T10:13:50.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.974+0000 7ff5b5993700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b00a0370 con 0x7ff5b0134330 2023-10-03T10:13:50.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.974+0000 7ff5b5993700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b006bec0 con 0x7ff5b009e870 2023-10-03T10:13:50.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.974+0000 7ff5af7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff5b0134330 0x7ff5b013be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.974+0000 7ff5aeffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5b009e870 0x7ff5b009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.974+0000 7ff5aeffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5b009e870 0x7ff5b009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57558/0 (socket says 172.21.15.146:57558) 2023-10-03T10:13:50.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.974+0000 7ff5af7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff5b0134330 0x7ff5b013be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43122/0 (socket says 172.21.15.146:43122) 2023-10-03T10:13:50.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.974+0000 7ff5aeffd700 1 -- 172.21.15.146:0/3639487361 learned_addr learned my addr 172.21.15.146:0/3639487361 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:50.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.975+0000 7ff5aeffd700 1 -- 172.21.15.146:0/3639487361 >> v2:172.21.15.146:3300/0 conn(0x7ff5b0134330 msgr2=0x7ff5b013be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.975+0000 7ff5aeffd700 1 --2- 172.21.15.146:0/3639487361 >> v2:172.21.15.146:3300/0 conn(0x7ff5b0134330 0x7ff5b013be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.975+0000 7ff5aeffd700 1 -- 172.21.15.146:0/3639487361 >> v1:172.21.15.146:6789/0 conn(0x7ff5b009f180 legacy=0x7ff5b0133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.975+0000 7ff5aeffd700 1 -- 172.21.15.146:0/3639487361 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b009ada0 con 0x7ff5b009e870 2023-10-03T10:13:50.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.975+0000 7ff5adffb700 1 -- 172.21.15.146:0/3639487361 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137296096 0 0) 0x7ff5b009fa00 con 0x7ff5b009f180 2023-10-03T10:13:50.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.975+0000 7ff5aeffd700 1 --2- 172.21.15.146:0/3639487361 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5b009e870 0x7ff5b009ec40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00098f0 tx=0x7ff5a0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45a6f281905babfa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.975+0000 7ff5adffb700 1 -- 172.21.15.146:0/3639487361 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a000b8a0 con 0x7ff5b009e870 2023-10-03T10:13:50.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.975+0000 7ff5adffb700 1 -- 172.21.15.146:0/3639487361 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a000ba00 con 0x7ff5b009e870 2023-10-03T10:13:50.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.975+0000 7ff5adffb700 1 -- 172.21.15.146:0/3639487361 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a000bd90 con 0x7ff5b009e870 2023-10-03T10:13:50.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.976+0000 7ff5b5993700 1 -- 172.21.15.146:0/3639487361 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5b009e870 msgr2=0x7ff5b009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.976+0000 7ff5b5993700 1 --2- 172.21.15.146:0/3639487361 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5b009e870 0x7ff5b009ec40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00098f0 tx=0x7ff5a0009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:50.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.976+0000 7ff5b5993700 1 -- 172.21.15.146:0/3639487361 shutdown_connections 2023-10-03T10:13:50.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.976+0000 7ff5b5993700 1 --2- 172.21.15.146:0/3639487361 >> v2:172.21.15.146:3300/0 conn(0x7ff5b0134330 0x7ff5b013be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.976+0000 7ff5b5993700 1 --2- 172.21.15.146:0/3639487361 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5b009e870 0x7ff5b009ec40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.976+0000 7ff5b5993700 1 -- 172.21.15.146:0/3639487361 >> 172.21.15.146:0/3639487361 conn(0x7ff5b00a4430 msgr2=0x7ff5b00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.976+0000 7ff5b5993700 1 -- 172.21.15.146:0/3639487361 shutdown_connections 2023-10-03T10:13:50.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.976+0000 7ff5b5993700 1 -- 172.21.15.146:0/3639487361 wait complete. 2023-10-03T10:13:50.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.977+0000 7ff5b5993700 1 Processor -- start 2023-10-03T10:13:50.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.977+0000 7ff5b5993700 1 -- start start 2023-10-03T10:13:50.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.977+0000 7ff5b5993700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5b009e870 0x7ff5b01228a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.977+0000 7ff5b5993700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5b009f180 0x7ff5b0122de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.977+0000 7ff5b5993700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5b0134330 0x7ff5b0123320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.977+0000 7ff5b5993700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b01333b0 con 0x7ff5b009f180 2023-10-03T10:13:50.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.977+0000 7ff5b5993700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b0124460 con 0x7ff5b009e870 2023-10-03T10:13:50.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.977+0000 7ff5b5993700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b0126060 con 0x7ff5b0134330 2023-10-03T10:13:50.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.977+0000 7ff5ae7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5b009f180 0x7ff5b0122de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.977+0000 7ff5ae7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5b009f180 0x7ff5b0122de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43128/0 (socket says 172.21.15.146:43128) 2023-10-03T10:13:50.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.977+0000 7ff5ae7fc700 1 -- 172.21.15.146:0/3172054516 learned_addr learned my addr 172.21.15.146:0/3172054516 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:50.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.977+0000 7ff5aeffd700 1 --2- 172.21.15.146:0/3172054516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5b009e870 0x7ff5b01228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.978+0000 7ff5af7fe700 1 --2- 172.21.15.146:0/3172054516 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5b0134330 0x7ff5b0123320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.978+0000 7ff5ae7fc700 1 -- 172.21.15.146:0/3172054516 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5b0134330 msgr2=0x7ff5b0123320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.978+0000 7ff5ae7fc700 1 --2- 172.21.15.146:0/3172054516 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5b0134330 0x7ff5b0123320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.978+0000 7ff5ae7fc700 1 -- 172.21.15.146:0/3172054516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5b009e870 msgr2=0x7ff5b01228a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.978+0000 7ff5ae7fc700 1 --2- 172.21.15.146:0/3172054516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5b009e870 0x7ff5b01228a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.978+0000 7ff5ae7fc700 1 -- 172.21.15.146:0/3172054516 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a0009550 con 0x7ff5b009f180 2023-10-03T10:13:50.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.978+0000 7ff5ae7fc700 1 --2- 172.21.15.146:0/3172054516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5b009f180 0x7ff5b0122de0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400c580 tx=0x7ff5a400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.978+0000 7ff597fff700 1 -- 172.21.15.146:0/3172054516 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a40054e0 con 0x7ff5b009f180 2023-10-03T10:13:50.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.978+0000 7ff597fff700 1 -- 172.21.15.146:0/3172054516 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a4003680 con 0x7ff5b009f180 2023-10-03T10:13:50.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.978+0000 7ff5b5993700 1 -- 172.21.15.146:0/3172054516 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b0124970 con 0x7ff5b009f180 2023-10-03T10:13:50.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.978+0000 7ff5b5993700 1 -- 172.21.15.146:0/3172054516 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b006cfa0 con 0x7ff5b009f180 2023-10-03T10:13:50.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.978+0000 7ff597fff700 1 -- 172.21.15.146:0/3172054516 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4003a30 con 0x7ff5b009f180 2023-10-03T10:13:50.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.979+0000 7ff597fff700 1 -- 172.21.15.146:0/3172054516 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff5a4003b90 con 0x7ff5b009f180 2023-10-03T10:13:50.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.979+0000 7ff5b5993700 1 -- 172.21.15.146:0/3172054516 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5900052e0 con 0x7ff5b009f180 2023-10-03T10:13:50.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.979+0000 7ff597fff700 1 -- 172.21.15.146:0/3172054516 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff5a403eab0 con 0x7ff5b009f180 2023-10-03T10:13:50.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:50.988+0000 7ff597fff700 1 -- 172.21.15.146:0/3172054516 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff5a4003e40 con 0x7ff5b009f180 2023-10-03T10:13:51.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.072+0000 7f9151981700 1 -- 172.21.15.146:0/440186808 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f914c0a0810 con 0x7f914c09e170 2023-10-03T10:13:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.072+0000 7f9133fff700 1 -- 172.21.15.146:0/440186808 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9140013470 con 0x7f914c09e170 2023-10-03T10:13:51.072 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.075+0000 7f9151981700 1 -- 172.21.15.146:0/440186808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f914c09e170 msgr2=0x7f914c1c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.075+0000 7f9151981700 1 --2- 172.21.15.146:0/440186808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f914c09e170 0x7f914c1c9ef0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f914c09a100 tx=0x7f914000ec60 comp rx=0 tx=0).stop 2023-10-03T10:13:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.075+0000 7f9151981700 1 -- 172.21.15.146:0/440186808 shutdown_connections 2023-10-03T10:13:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.075+0000 7f9151981700 1 --2- 172.21.15.146:0/440186808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f914c130ce0 0x7f914c1cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.075+0000 7f9151981700 1 --2- 172.21.15.146:0/440186808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f914c09d860 0x7f914c1c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.075+0000 7f9151981700 1 --2- 172.21.15.146:0/440186808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f914c09e170 0x7f914c1c9ef0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.075+0000 7f9151981700 1 -- 172.21.15.146:0/440186808 >> 172.21.15.146:0/440186808 conn(0x7f914c099c40 msgr2=0x7f914c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:51.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.075+0000 7f9151981700 1 -- 172.21.15.146:0/440186808 shutdown_connections 2023-10-03T10:13:51.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.075+0000 7f9151981700 1 -- 172.21.15.146:0/440186808 wait complete. 2023-10-03T10:13:51.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.126+0000 7f2df9f1b700 1 -- 172.21.15.146:0/2874908748 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2df406bce0 con 0x7f2df40a1510 2023-10-03T10:13:51.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.126+0000 7f2ddbfff700 1 -- 172.21.15.146:0/2874908748 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2de8032020 con 0x7f2df40a1510 2023-10-03T10:13:51.126 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:51.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.129+0000 7f2df9f1b700 1 -- 172.21.15.146:0/2874908748 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2df40a1510 msgr2=0x7f2df41c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.129+0000 7f2df9f1b700 1 --2- 172.21.15.146:0/2874908748 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2df40a1510 0x7f2df41c13b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2df409a230 tx=0x7f2de8004750 comp rx=0 tx=0).stop 2023-10-03T10:13:51.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.129+0000 7f2df9f1b700 1 -- 172.21.15.146:0/2874908748 shutdown_connections 2023-10-03T10:13:51.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.129+0000 7f2df9f1b700 1 --2- 172.21.15.146:0/2874908748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2df41356e0 0x7f2df41c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.129+0000 7f2df9f1b700 1 --2- 172.21.15.146:0/2874908748 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2df40a0a30 0x7f2df41c0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.129+0000 7f2df9f1b700 1 --2- 172.21.15.146:0/2874908748 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2df40a1510 0x7f2df41c13b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.129+0000 7f2df9f1b700 1 -- 172.21.15.146:0/2874908748 >> 172.21.15.146:0/2874908748 conn(0x7f2df40a2980 msgr2=0x7f2df406f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:51.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.129+0000 7f2df9f1b700 1 -- 172.21.15.146:0/2874908748 shutdown_connections 2023-10-03T10:13:51.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.129+0000 7f2df9f1b700 1 -- 172.21.15.146:0/2874908748 wait complete. 2023-10-03T10:13:51.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:51.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.149+0000 7f6e49633700 1 -- 172.21.15.146:0/1551526069 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6e4406bce0 con 0x7f6e44131980 2023-10-03T10:13:51.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.149+0000 7f6e2b7fe700 1 -- 172.21.15.146:0/1551526069 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e3c02f3e0 con 0x7f6e44131980 2023-10-03T10:13:51.149 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:51.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.151+0000 7f6e49633700 1 -- 172.21.15.146:0/1551526069 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e44131980 msgr2=0x7f6e4411bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.151+0000 7f6e49633700 1 --2- 172.21.15.146:0/1551526069 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e44131980 0x7f6e4411bfd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0042a0 tx=0x7f6e3c004660 comp rx=0 tx=0).stop 2023-10-03T10:13:51.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.151+0000 7f6e49633700 1 -- 172.21.15.146:0/1551526069 shutdown_connections 2023-10-03T10:13:51.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.151+0000 7f6e49633700 1 --2- 172.21.15.146:0/1551526069 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e44131980 0x7f6e4411bfd0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.151+0000 7f6e49633700 1 --2- 172.21.15.146:0/1551526069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e4409bc70 0x7f6e4411b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.151+0000 7f6e49633700 1 --2- 172.21.15.146:0/1551526069 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e4409c5c0 0x7f6e4411ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.151+0000 7f6e49633700 1 -- 172.21.15.146:0/1551526069 >> 172.21.15.146:0/1551526069 conn(0x7f6e440a2980 msgr2=0x7f6e4409f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:51.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.151+0000 7f6e49633700 1 -- 172.21.15.146:0/1551526069 shutdown_connections 2023-10-03T10:13:51.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.151+0000 7f6e49633700 1 -- 172.21.15.146:0/1551526069 wait complete. 2023-10-03T10:13:51.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.209+0000 7ff5b5993700 1 -- 172.21.15.146:0/3172054516 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff590005590 con 0x7ff5b009f180 2023-10-03T10:13:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.209+0000 7ff597fff700 1 -- 172.21.15.146:0/3172054516 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff5a4017030 con 0x7ff5b009f180 2023-10-03T10:13:51.209 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:51.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.211+0000 7ff5b5993700 1 -- 172.21.15.146:0/3172054516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5b009f180 msgr2=0x7ff5b0122de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.211+0000 7ff5b5993700 1 --2- 172.21.15.146:0/3172054516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5b009f180 0x7ff5b0122de0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400c580 tx=0x7ff5a400c890 comp rx=0 tx=0).stop 2023-10-03T10:13:51.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.211+0000 7ff5b5993700 1 -- 172.21.15.146:0/3172054516 shutdown_connections 2023-10-03T10:13:51.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.211+0000 7ff5b5993700 1 --2- 172.21.15.146:0/3172054516 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5b0134330 0x7ff5b0123320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.211+0000 7ff5b5993700 1 --2- 172.21.15.146:0/3172054516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5b009e870 0x7ff5b01228a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.211+0000 7ff5b5993700 1 --2- 172.21.15.146:0/3172054516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5b009f180 0x7ff5b0122de0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.211+0000 7ff5b5993700 1 -- 172.21.15.146:0/3172054516 >> 172.21.15.146:0/3172054516 conn(0x7ff5b00a4430 msgr2=0x7ff5b0070e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:51.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.211+0000 7ff5b5993700 1 -- 172.21.15.146:0/3172054516 shutdown_connections 2023-10-03T10:13:51.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:51.211+0000 7ff5b5993700 1 -- 172.21.15.146:0/3172054516 wait complete. 2023-10-03T10:13:51.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:52.090 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:52.142 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:52.166 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:52.224 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:52.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.237+0000 7fc6bf0f2700 1 Processor -- start 2023-10-03T10:13:52.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.237+0000 7fc6bf0f2700 1 -- start start 2023-10-03T10:13:52.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.238+0000 7fc6bf0f2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6b8133ad0 0x7fc6b8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.238+0000 7fc6bf0f2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6b81300a0 0x7fc6b81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.238+0000 7fc6bf0f2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc6b81309f0 0x7fc6b813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.238+0000 7fc6bf0f2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b806b2d0 con 0x7fc6b81300a0 2023-10-03T10:13:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.238+0000 7fc6bf0f2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b8133610 con 0x7fc6b8133ad0 2023-10-03T10:13:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.238+0000 7fc6bf0f2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b809a500 con 0x7fc6b81309f0 2023-10-03T10:13:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.238+0000 7fc6bce8e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6b8133ad0 0x7fc6b8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.238+0000 7fc6bce8e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6b8133ad0 0x7fc6b8133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40498/0 (socket says 172.21.15.146:40498) 2023-10-03T10:13:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.238+0000 7fc6bce8e700 1 -- 172.21.15.146:0/3516462190 learned_addr learned my addr 172.21.15.146:0/3516462190 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.238+0000 7fc6bd68f700 1 --2- 172.21.15.146:0/3516462190 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc6b81309f0 0x7fc6b813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.238+0000 7fc6b7fff700 1 --2- 172.21.15.146:0/3516462190 >> v2:172.21.15.146:3300/0 conn(0x7fc6b81300a0 0x7fc6b81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.238+0000 7fc6bce8e700 1 -- 172.21.15.146:0/3516462190 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc6b81309f0 msgr2=0x7fc6b813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:52.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.238+0000 7fc6bce8e700 1 --2- 172.21.15.146:0/3516462190 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc6b81309f0 0x7fc6b813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.238+0000 7fc6bce8e700 1 -- 172.21.15.146:0/3516462190 >> v2:172.21.15.146:3300/0 conn(0x7fc6b81300a0 msgr2=0x7fc6b81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:52.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.238+0000 7fc6bce8e700 1 --2- 172.21.15.146:0/3516462190 >> v2:172.21.15.146:3300/0 conn(0x7fc6b81300a0 0x7fc6b81304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.238+0000 7fc6bce8e700 1 -- 172.21.15.146:0/3516462190 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b81338b0 con 0x7fc6b8133ad0 2023-10-03T10:13:52.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.238+0000 7fc6bce8e700 1 --2- 172.21.15.146:0/3516462190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6b8133ad0 0x7fc6b8133ea0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac0098f0 tx=0x7fc6ac009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9aeb344f23edc30 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:52.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.239+0000 7fc6b77fe700 1 -- 172.21.15.146:0/3516462190 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac011830 con 0x7fc6b8133ad0 2023-10-03T10:13:52.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.239+0000 7fc6b77fe700 1 -- 172.21.15.146:0/3516462190 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ac011990 con 0x7fc6b8133ad0 2023-10-03T10:13:52.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.239+0000 7fc6b77fe700 1 -- 172.21.15.146:0/3516462190 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac011d20 con 0x7fc6b8133ad0 2023-10-03T10:13:52.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.240+0000 7fc6bf0f2700 1 -- 172.21.15.146:0/3516462190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6b8133ad0 msgr2=0x7fc6b8133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.240+0000 7fc6bf0f2700 1 --2- 172.21.15.146:0/3516462190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6b8133ad0 0x7fc6b8133ea0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac0098f0 tx=0x7fc6ac009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:52.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.240+0000 7fc6bf0f2700 1 -- 172.21.15.146:0/3516462190 shutdown_connections 2023-10-03T10:13:52.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.240+0000 7fc6bf0f2700 1 --2- 172.21.15.146:0/3516462190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6b8133ad0 0x7fc6b8133ea0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.240+0000 7fc6bf0f2700 1 --2- 172.21.15.146:0/3516462190 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc6b81309f0 0x7fc6b813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.240+0000 7fc6bf0f2700 1 --2- 172.21.15.146:0/3516462190 >> v2:172.21.15.146:3300/0 conn(0x7fc6b81300a0 0x7fc6b81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.240+0000 7fc6bf0f2700 1 -- 172.21.15.146:0/3516462190 >> 172.21.15.146:0/3516462190 conn(0x7fc6b8099c40 msgr2=0x7fc6b80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:52.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.240+0000 7fc6bf0f2700 1 -- 172.21.15.146:0/3516462190 shutdown_connections 2023-10-03T10:13:52.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.240+0000 7fc6bf0f2700 1 -- 172.21.15.146:0/3516462190 wait complete. 2023-10-03T10:13:52.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.241+0000 7fc6bf0f2700 1 Processor -- start 2023-10-03T10:13:52.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.241+0000 7fc6bf0f2700 1 -- start start 2023-10-03T10:13:52.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.242+0000 7fc6bf0f2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc6b81300a0 0x7fc6b80712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.242+0000 7fc6bf0f2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6b81309f0 0x7fc6b8071810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.242+0000 7fc6bf0f2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6b8133ad0 0x7fc6b8071d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.242+0000 7fc6bf0f2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b80727a0 con 0x7fc6b8133ad0 2023-10-03T10:13:52.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.242+0000 7fc6bf0f2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b811fef0 con 0x7fc6b81309f0 2023-10-03T10:13:52.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.242+0000 7fc6bf0f2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b811ee90 con 0x7fc6b81300a0 2023-10-03T10:13:52.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.242+0000 7fc6b7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6b81309f0 0x7fc6b8071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.242+0000 7fc6b7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6b81309f0 0x7fc6b8071810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40502/0 (socket says 172.21.15.146:40502) 2023-10-03T10:13:52.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.242+0000 7fc6b7fff700 1 -- 172.21.15.146:0/1610491643 learned_addr learned my addr 172.21.15.146:0/1610491643 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:52.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.242+0000 7fc6bce8e700 1 --2- 172.21.15.146:0/1610491643 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc6b81300a0 0x7fc6b80712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.242+0000 7fc6bd68f700 1 --2- 172.21.15.146:0/1610491643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6b8133ad0 0x7fc6b8071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.243+0000 7fc6b7fff700 1 -- 172.21.15.146:0/1610491643 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc6b81300a0 msgr2=0x7fc6b80712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.243+0000 7fc6b7fff700 1 --2- 172.21.15.146:0/1610491643 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc6b81300a0 0x7fc6b80712d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.243+0000 7fc6b7fff700 1 -- 172.21.15.146:0/1610491643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6b8133ad0 msgr2=0x7fc6b8071d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.243+0000 7fc6b7fff700 1 --2- 172.21.15.146:0/1610491643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6b8133ad0 0x7fc6b8071d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.243+0000 7fc6b7fff700 1 -- 172.21.15.146:0/1610491643 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ac009550 con 0x7fc6b81309f0 2023-10-03T10:13:52.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.243+0000 7fc6bd68f700 1 --2- 172.21.15.146:0/1610491643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6b8133ad0 0x7fc6b8071d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:52.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.243+0000 7fc6b7fff700 1 --2- 172.21.15.146:0/1610491643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6b81309f0 0x7fc6b8071810 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400e980 tx=0x7fc6a400ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:52.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.243+0000 7fc6b57fa700 1 -- 172.21.15.146:0/1610491643 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4009710 con 0x7fc6b81309f0 2023-10-03T10:13:52.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.243+0000 7fc6b57fa700 1 -- 172.21.15.146:0/1610491643 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a400eed0 con 0x7fc6b81309f0 2023-10-03T10:13:52.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.243+0000 7fc6b57fa700 1 -- 172.21.15.146:0/1610491643 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a400ca70 con 0x7fc6b81309f0 2023-10-03T10:13:52.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.243+0000 7fc6bf0f2700 1 -- 172.21.15.146:0/1610491643 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b80a32e0 con 0x7fc6b81309f0 2023-10-03T10:13:52.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.243+0000 7fc6bf0f2700 1 -- 172.21.15.146:0/1610491643 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b812dd00 con 0x7fc6b81309f0 2023-10-03T10:13:52.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.244+0000 7fc6b57fa700 1 -- 172.21.15.146:0/1610491643 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6a400cbd0 con 0x7fc6b81309f0 2023-10-03T10:13:52.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.244+0000 7fc6b57fa700 1 -- 172.21.15.146:0/1610491643 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc6a401bd00 con 0x7fc6b81309f0 2023-10-03T10:13:52.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.244+0000 7fc6bf0f2700 1 -- 172.21.15.146:0/1610491643 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b809cb20 con 0x7fc6b81309f0 2023-10-03T10:13:52.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.250+0000 7fc6b57fa700 1 -- 172.21.15.146:0/1610491643 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6a40232f0 con 0x7fc6b81309f0 2023-10-03T10:13:52.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.283+0000 7fe5360b8700 1 Processor -- start 2023-10-03T10:13:52.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.283+0000 7fe5360b8700 1 -- start start 2023-10-03T10:13:52.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.284+0000 7fe5360b8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe530133ad0 0x7fe530133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.284+0000 7fe5360b8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe530130bc0 0x7fe53013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.284+0000 7fe5360b8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe53006b2d0 con 0x7fe5301300a0 2023-10-03T10:13:52.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.284+0000 7fe5360b8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe530133610 con 0x7fe530130bc0 2023-10-03T10:13:52.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.284+0000 7fe5360b8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe53009a500 con 0x7fe530133ad0 2023-10-03T10:13:52.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.284+0000 7fe52f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe530133ad0 0x7fe530133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.284+0000 7fe52f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe530133ad0 0x7fe530133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57596/0 (socket says 172.21.15.146:57596) 2023-10-03T10:13:52.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.284+0000 7fe52f7fe700 1 -- 172.21.15.146:0/655278587 learned_addr learned my addr 172.21.15.146:0/655278587 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:52.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.284+0000 7fe52ffff700 1 --2- 172.21.15.146:0/655278587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe530130bc0 0x7fe53013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.284+0000 7fe52f7fe700 1 -- 172.21.15.146:0/655278587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe530130bc0 msgr2=0x7fe53013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:52.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.284+0000 7fe52f7fe700 1 --2- 172.21.15.146:0/655278587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe530130bc0 0x7fe53013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.284+0000 7fe52f7fe700 1 -- 172.21.15.146:0/655278587 >> v1:172.21.15.146:6789/0 conn(0x7fe5301300a0 legacy=0x7fe5301304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.284+0000 7fe52f7fe700 1 -- 172.21.15.146:0/655278587 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5301338b0 con 0x7fe530133ad0 2023-10-03T10:13:52.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.284+0000 7fe52ffff700 1 --2- 172.21.15.146:0/655278587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe530130bc0 0x7fe53013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:52.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.285+0000 7fe52f7fe700 1 --2- 172.21.15.146:0/655278587 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe530133ad0 0x7fe530133ea0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe520009920 tx=0x7fe520009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ef861ab0dc96caf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:52.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.285+0000 7fe52e7fc700 1 -- 172.21.15.146:0/655278587 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52000ba60 con 0x7fe530133ad0 2023-10-03T10:13:52.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.285+0000 7fe52e7fc700 1 -- 172.21.15.146:0/655278587 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52000bbc0 con 0x7fe530133ad0 2023-10-03T10:13:52.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.285+0000 7fe52e7fc700 1 -- 172.21.15.146:0/655278587 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe520009e70 con 0x7fe530133ad0 2023-10-03T10:13:52.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.285+0000 7fe5360b8700 1 -- 172.21.15.146:0/655278587 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe530133ad0 msgr2=0x7fe530133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.286+0000 7fe5360b8700 1 --2- 172.21.15.146:0/655278587 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe530133ad0 0x7fe530133ea0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe520009920 tx=0x7fe520009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:52.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.286+0000 7fe5360b8700 1 -- 172.21.15.146:0/655278587 shutdown_connections 2023-10-03T10:13:52.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.286+0000 7fe5360b8700 1 --2- 172.21.15.146:0/655278587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe530130bc0 0x7fe53013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.286+0000 7fe5360b8700 1 --2- 172.21.15.146:0/655278587 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe530133ad0 0x7fe530133ea0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.286+0000 7fe5360b8700 1 -- 172.21.15.146:0/655278587 >> 172.21.15.146:0/655278587 conn(0x7fe530099c40 msgr2=0x7fe5300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:52.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.286+0000 7fe5360b8700 1 -- 172.21.15.146:0/655278587 shutdown_connections 2023-10-03T10:13:52.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.286+0000 7fe5360b8700 1 -- 172.21.15.146:0/655278587 wait complete. 2023-10-03T10:13:52.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.287+0000 7fe5360b8700 1 Processor -- start 2023-10-03T10:13:52.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.287+0000 7fe5360b8700 1 -- start start 2023-10-03T10:13:52.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.287+0000 7fe5360b8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5301300a0 0x7fe53011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.287+0000 7fe5360b8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe530130bc0 0x7fe53011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.287+0000 7fe5360b8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe530133ad0 0x7fe53011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.287+0000 7fe5360b8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53011fde0 con 0x7fe530130bc0 2023-10-03T10:13:52.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.287+0000 7fe5360b8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe530120a30 con 0x7fe530133ad0 2023-10-03T10:13:52.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.287+0000 7fe5360b8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe53011f850 con 0x7fe5301300a0 2023-10-03T10:13:52.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.287+0000 7fe52f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5301300a0 0x7fe53011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.287+0000 7fe52f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5301300a0 0x7fe53011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57606/0 (socket says 172.21.15.146:57606) 2023-10-03T10:13:52.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.287+0000 7fe52f7fe700 1 -- 172.21.15.146:0/1300012937 learned_addr learned my addr 172.21.15.146:0/1300012937 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:52.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.287+0000 7fe52ffff700 1 --2- 172.21.15.146:0/1300012937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe530133ad0 0x7fe53011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.288+0000 7fe52f7fe700 1 -- 172.21.15.146:0/1300012937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe530133ad0 msgr2=0x7fe53011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.288+0000 7fe52f7fe700 1 --2- 172.21.15.146:0/1300012937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe530133ad0 0x7fe53011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.288+0000 7fe52f7fe700 1 -- 172.21.15.146:0/1300012937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe530130bc0 msgr2=0x7fe53011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.288+0000 7fe52f7fe700 1 --2- 172.21.15.146:0/1300012937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe530130bc0 0x7fe53011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.288+0000 7fe52f7fe700 1 -- 172.21.15.146:0/1300012937 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe520009550 con 0x7fe5301300a0 2023-10-03T10:13:52.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.288+0000 7fe52ffff700 1 --2- 172.21.15.146:0/1300012937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe530133ad0 0x7fe53011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:52.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.288+0000 7fe52f7fe700 1 --2- 172.21.15.146:0/1300012937 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5301300a0 0x7fe53011da40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe520000c00 tx=0x7fe520004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:52.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.288+0000 7fe517fff700 1 -- 172.21.15.146:0/1300012937 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe520004590 con 0x7fe5301300a0 2023-10-03T10:13:52.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.288+0000 7fe517fff700 1 -- 172.21.15.146:0/1300012937 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5200036a0 con 0x7fe5301300a0 2023-10-03T10:13:52.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.288+0000 7fe5360b8700 1 -- 172.21.15.146:0/1300012937 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe53012fcd0 con 0x7fe5301300a0 2023-10-03T10:13:52.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.288+0000 7fe517fff700 1 -- 172.21.15.146:0/1300012937 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe520003a50 con 0x7fe5301300a0 2023-10-03T10:13:52.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.288+0000 7fe5360b8700 1 -- 172.21.15.146:0/1300012937 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5301200c0 con 0x7fe5301300a0 2023-10-03T10:13:52.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.289+0000 7fe517fff700 1 -- 172.21.15.146:0/1300012937 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe520003bb0 con 0x7fe5301300a0 2023-10-03T10:13:52.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.289+0000 7fe5360b8700 1 -- 172.21.15.146:0/1300012937 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe53004f2a0 con 0x7fe5301300a0 2023-10-03T10:13:52.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.290+0000 7fe517fff700 1 -- 172.21.15.146:0/1300012937 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe520040c50 con 0x7fe5301300a0 2023-10-03T10:13:52.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.294+0000 7fe517fff700 1 -- 172.21.15.146:0/1300012937 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe520010380 con 0x7fe5301300a0 2023-10-03T10:13:52.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.321+0000 7f8f9c365700 1 Processor -- start 2023-10-03T10:13:52.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.322+0000 7f8f9c365700 1 -- start start 2023-10-03T10:13:52.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.322+0000 7f8f9c365700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8f94098410 0x7f8f940987e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.322+0000 7f8f9c365700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f9409e440 0x7f8f941397e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.322+0000 7f8f9c365700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9406f970 con 0x7f8f9409d8f0 2023-10-03T10:13:52.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.322+0000 7f8f9c365700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f940720a0 con 0x7f8f94098410 2023-10-03T10:13:52.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.322+0000 7f8f9c365700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f94072290 con 0x7f8f9409e440 2023-10-03T10:13:52.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.322+0000 7f8f9a902700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f9409e440 0x7f8f941397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.322+0000 7f8f9a902700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f9409e440 0x7f8f941397e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57614/0 (socket says 172.21.15.146:57614) 2023-10-03T10:13:52.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.322+0000 7f8f9a902700 1 -- 172.21.15.146:0/3370991108 learned_addr learned my addr 172.21.15.146:0/3370991108 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:52.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.322+0000 7f8f99900700 1 --1- 172.21.15.146:0/3370991108 >> v1:172.21.15.146:6789/0 conn(0x7f8f9409d8f0 0x7f8f9409dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58724/0 (socket says 172.21.15.146:58724) 2023-10-03T10:13:52.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.322+0000 7f8f9a101700 1 --2- 172.21.15.146:0/3370991108 >> v2:172.21.15.146:3300/0 conn(0x7f8f94098410 0x7f8f940987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.323+0000 7f8f9a902700 1 -- 172.21.15.146:0/3370991108 >> v2:172.21.15.146:3300/0 conn(0x7f8f94098410 msgr2=0x7f8f940987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:52.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.323+0000 7f8f9a902700 1 --2- 172.21.15.146:0/3370991108 >> v2:172.21.15.146:3300/0 conn(0x7f8f94098410 0x7f8f940987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.323+0000 7f8f990ff700 1 -- 172.21.15.146:0/3370991108 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699479162 0 0) 0x7f8f9406f970 con 0x7f8f9409d8f0 2023-10-03T10:13:52.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.323+0000 7f8f9a902700 1 -- 172.21.15.146:0/3370991108 >> v1:172.21.15.146:6789/0 conn(0x7f8f9409d8f0 legacy=0x7f8f9409dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.323+0000 7f8f9a902700 1 -- 172.21.15.146:0/3370991108 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f94071530 con 0x7f8f9409e440 2023-10-03T10:13:52.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.323+0000 7f8f9a902700 1 --2- 172.21.15.146:0/3370991108 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f9409e440 0x7f8f941397e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009e50 tx=0x7f8f8c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28fce504424bec7f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:52.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.323+0000 7f8f990ff700 1 -- 172.21.15.146:0/3370991108 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c00e070 con 0x7f8f9409e440 2023-10-03T10:13:52.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.323+0000 7f8f990ff700 1 -- 172.21.15.146:0/3370991108 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c00b910 con 0x7f8f9409e440 2023-10-03T10:13:52.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.323+0000 7f8f990ff700 1 -- 172.21.15.146:0/3370991108 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c00bcc0 con 0x7f8f9409e440 2023-10-03T10:13:52.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.324+0000 7f8f9c365700 1 -- 172.21.15.146:0/3370991108 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f9409e440 msgr2=0x7f8f941397e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.324+0000 7f8f9c365700 1 --2- 172.21.15.146:0/3370991108 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f9409e440 0x7f8f941397e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009e50 tx=0x7f8f8c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:52.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.324+0000 7f8f9c365700 1 -- 172.21.15.146:0/3370991108 shutdown_connections 2023-10-03T10:13:52.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.324+0000 7f8f9c365700 1 --2- 172.21.15.146:0/3370991108 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f9409e440 0x7f8f941397e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.324+0000 7f8f9c365700 1 --2- 172.21.15.146:0/3370991108 >> v2:172.21.15.146:3300/0 conn(0x7f8f94098410 0x7f8f940987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.324+0000 7f8f9c365700 1 -- 172.21.15.146:0/3370991108 >> 172.21.15.146:0/3370991108 conn(0x7f8f940a2b30 msgr2=0x7f8f9409e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:52.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.324+0000 7f8f9c365700 1 -- 172.21.15.146:0/3370991108 shutdown_connections 2023-10-03T10:13:52.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.324+0000 7f8f9c365700 1 -- 172.21.15.146:0/3370991108 wait complete. 2023-10-03T10:13:52.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.325+0000 7f8f9c365700 1 Processor -- start 2023-10-03T10:13:52.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.325+0000 7f8f9c365700 1 -- start start 2023-10-03T10:13:52.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.325+0000 7f8f9c365700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f94098410 0x7f8f9406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.325+0000 7f8f9c365700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f9409d8f0 0x7f8f9406dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.325+0000 7f8f9c365700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f9409e440 0x7f8f9406e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.325+0000 7f8f9c365700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9408bcf0 con 0x7f8f94098410 2023-10-03T10:13:52.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.325+0000 7f8f9c365700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f940708f0 con 0x7f8f9409e440 2023-10-03T10:13:52.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.325+0000 7f8f9c365700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9408b8a0 con 0x7f8f9409d8f0 2023-10-03T10:13:52.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.326+0000 7f8f99900700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f9409d8f0 0x7f8f9406dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.326+0000 7f8f99900700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f9409d8f0 0x7f8f9406dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57626/0 (socket says 172.21.15.146:57626) 2023-10-03T10:13:52.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.326+0000 7f8f99900700 1 -- 172.21.15.146:0/2549593305 learned_addr learned my addr 172.21.15.146:0/2549593305 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:52.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.326+0000 7f8f9a101700 1 --2- 172.21.15.146:0/2549593305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f94098410 0x7f8f9406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.326+0000 7f8f9a902700 1 --2- 172.21.15.146:0/2549593305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f9409e440 0x7f8f9406e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.326+0000 7f8f99900700 1 -- 172.21.15.146:0/2549593305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f9409e440 msgr2=0x7f8f9406e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.326+0000 7f8f99900700 1 --2- 172.21.15.146:0/2549593305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f9409e440 0x7f8f9406e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.326+0000 7f8f99900700 1 -- 172.21.15.146:0/2549593305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f94098410 msgr2=0x7f8f9406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.326+0000 7f8f99900700 1 --2- 172.21.15.146:0/2549593305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f94098410 0x7f8f9406d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.326+0000 7f8f99900700 1 -- 172.21.15.146:0/2549593305 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8c009b30 con 0x7f8f9409d8f0 2023-10-03T10:13:52.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.326+0000 7f8f99900700 1 --2- 172.21.15.146:0/2549593305 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f9409d8f0 0x7f8f9406dbf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8f840011e0 tx=0x7f8f8400ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:52.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.326+0000 7f8f9a902700 1 --2- 172.21.15.146:0/2549593305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f9409e440 0x7f8f9406e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:52.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.326+0000 7f8f8affd700 1 -- 172.21.15.146:0/2549593305 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f84004c80 con 0x7f8f9409d8f0 2023-10-03T10:13:52.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.326+0000 7f8f9c365700 1 -- 172.21.15.146:0/2549593305 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9408ca60 con 0x7f8f9409d8f0 2023-10-03T10:13:52.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.326+0000 7f8f9c365700 1 -- 172.21.15.146:0/2549593305 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f94098060 con 0x7f8f9409d8f0 2023-10-03T10:13:52.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.326+0000 7f8f8affd700 1 -- 172.21.15.146:0/2549593305 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f84004de0 con 0x7f8f9409d8f0 2023-10-03T10:13:52.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.326+0000 7f8f8affd700 1 -- 172.21.15.146:0/2549593305 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f840072d0 con 0x7f8f9409d8f0 2023-10-03T10:13:52.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.327+0000 7f8f9c365700 1 -- 172.21.15.146:0/2549593305 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9404f2a0 con 0x7f8f9409d8f0 2023-10-03T10:13:52.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.328+0000 7f8f8affd700 1 -- 172.21.15.146:0/2549593305 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f84007430 con 0x7f8f9409d8f0 2023-10-03T10:13:52.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.328+0000 7f8f8affd700 1 -- 172.21.15.146:0/2549593305 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8f8403f260 con 0x7f8f9409d8f0 2023-10-03T10:13:52.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.332+0000 7f8f8affd700 1 -- 172.21.15.146:0/2549593305 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f840076e0 con 0x7f8f9409d8f0 2023-10-03T10:13:52.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.385+0000 7fadbfb62700 1 Processor -- start 2023-10-03T10:13:52.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.385+0000 7fadbfb62700 1 -- start start 2023-10-03T10:13:52.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.386+0000 7fadbfb62700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fadb809e340 0x7fadb81359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.386+0000 7fadbfb62700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fadb8135f20 0x7fadb8138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.386+0000 7fadbfb62700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb809aaa0 con 0x7fadb809d860 2023-10-03T10:13:52.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.386+0000 7fadbfb62700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb809e730 con 0x7fadb809e340 2023-10-03T10:13:52.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.386+0000 7fadbfb62700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadb809f870 con 0x7fadb8135f20 2023-10-03T10:13:52.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.386+0000 7fadbd8fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fadb809d860 0x7fadb809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58738/0 (socket says 172.21.15.146:58738) 2023-10-03T10:13:52.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.386+0000 7fadbd8fe700 1 -- 172.21.15.146:0/3951760424 learned_addr learned my addr 172.21.15.146:0/3951760424 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:52.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.386+0000 7fadbd0fd700 1 --2- 172.21.15.146:0/3951760424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fadb809e340 0x7fadb81359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.386+0000 7fadbe0ff700 1 --2- 172.21.15.146:0/3951760424 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fadb8135f20 0x7fadb8138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.387+0000 7fadbd0fd700 1 -- 172.21.15.146:0/3951760424 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fadb8135f20 msgr2=0x7fadb8138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:52.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.387+0000 7fadbd0fd700 1 --2- 172.21.15.146:0/3951760424 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fadb8135f20 0x7fadb8138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.387+0000 7fadbd0fd700 1 -- 172.21.15.146:0/3951760424 >> v1:172.21.15.146:6789/0 conn(0x7fadb809d860 legacy=0x7fadb809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.387+0000 7fadbc8fc700 1 -- 172.21.15.146:0/3951760424 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679826065 0 0) 0x7fadb809aaa0 con 0x7fadb809d860 2023-10-03T10:13:52.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.387+0000 7fadbd0fd700 1 -- 172.21.15.146:0/3951760424 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb809b360 con 0x7fadb809e340 2023-10-03T10:13:52.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.387+0000 7fadbd0fd700 1 --2- 172.21.15.146:0/3951760424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fadb809e340 0x7fadb81359e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fada8009870 tx=0x7fada8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bc8882f05a8beeb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:52.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.387+0000 7fadbc8fc700 1 -- 172.21.15.146:0/3951760424 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada8011830 con 0x7fadb809e340 2023-10-03T10:13:52.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.387+0000 7fadbc8fc700 1 -- 172.21.15.146:0/3951760424 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada8011990 con 0x7fadb809e340 2023-10-03T10:13:52.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.387+0000 7fadbc8fc700 1 -- 172.21.15.146:0/3951760424 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada8011d20 con 0x7fadb809e340 2023-10-03T10:13:52.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.388+0000 7fadbfb62700 1 -- 172.21.15.146:0/3951760424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fadb809e340 msgr2=0x7fadb81359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.388+0000 7fadbfb62700 1 --2- 172.21.15.146:0/3951760424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fadb809e340 0x7fadb81359e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fada8009870 tx=0x7fada8009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:52.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.388+0000 7fadbfb62700 1 -- 172.21.15.146:0/3951760424 shutdown_connections 2023-10-03T10:13:52.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.388+0000 7fadbfb62700 1 --2- 172.21.15.146:0/3951760424 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fadb8135f20 0x7fadb8138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.388+0000 7fadbfb62700 1 --2- 172.21.15.146:0/3951760424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fadb809e340 0x7fadb81359e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.388+0000 7fadbfb62700 1 -- 172.21.15.146:0/3951760424 >> 172.21.15.146:0/3951760424 conn(0x7fadb8099c40 msgr2=0x7fadb80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:52.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.388+0000 7fadbfb62700 1 -- 172.21.15.146:0/3951760424 shutdown_connections 2023-10-03T10:13:52.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.388+0000 7fadbfb62700 1 -- 172.21.15.146:0/3951760424 wait complete. 2023-10-03T10:13:52.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.389+0000 7fadbfb62700 1 Processor -- start 2023-10-03T10:13:52.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.389+0000 7fadbfb62700 1 -- start start 2023-10-03T10:13:52.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.389+0000 7fadbfb62700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fadb809d860 0x7fadb811b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.389+0000 7fadbfb62700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fadb809e340 0x7fadb811bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.389+0000 7fadbfb62700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadb8135f20 0x7fadb811c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:52.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.389+0000 7fadbfb62700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb811ee30 con 0x7fadb8135f20 2023-10-03T10:13:52.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.389+0000 7fadbfb62700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb811f250 con 0x7fadb809d860 2023-10-03T10:13:52.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.389+0000 7fadbfb62700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadb811e880 con 0x7fadb809e340 2023-10-03T10:13:52.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.390+0000 7fadbd8fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fadb809d860 0x7fadb811b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.390+0000 7fadbd8fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fadb809d860 0x7fadb811b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40558/0 (socket says 172.21.15.146:40558) 2023-10-03T10:13:52.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.390+0000 7fadbd8fe700 1 -- 172.21.15.146:0/171844400 learned_addr learned my addr 172.21.15.146:0/171844400 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:52.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.390+0000 7fadbe0ff700 1 --2- 172.21.15.146:0/171844400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadb8135f20 0x7fadb811c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.390+0000 7fadbd0fd700 1 --2- 172.21.15.146:0/171844400 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fadb809e340 0x7fadb811bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:52.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.390+0000 7fadbd8fe700 1 -- 172.21.15.146:0/171844400 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fadb809e340 msgr2=0x7fadb811bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.390+0000 7fadbd8fe700 1 --2- 172.21.15.146:0/171844400 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fadb809e340 0x7fadb811bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.390+0000 7fadbd8fe700 1 -- 172.21.15.146:0/171844400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadb8135f20 msgr2=0x7fadb811c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.390+0000 7fadbd8fe700 1 --2- 172.21.15.146:0/171844400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadb8135f20 0x7fadb811c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.390+0000 7fadbd8fe700 1 -- 172.21.15.146:0/171844400 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada80094a0 con 0x7fadb809d860 2023-10-03T10:13:52.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.390+0000 7fadbe0ff700 1 --2- 172.21.15.146:0/171844400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadb8135f20 0x7fadb811c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:52.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.390+0000 7fadbd8fe700 1 --2- 172.21.15.146:0/171844400 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fadb809d860 0x7fadb811b5f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fadb400c520 tx=0x7fadb400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:52.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.390+0000 7fadae7fc700 1 -- 172.21.15.146:0/171844400 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb4004c80 con 0x7fadb809d860 2023-10-03T10:13:52.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.390+0000 7fadae7fc700 1 -- 172.21.15.146:0/171844400 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb4004de0 con 0x7fadb809d860 2023-10-03T10:13:52.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.390+0000 7fadbfb62700 1 -- 172.21.15.146:0/171844400 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb809a1b0 con 0x7fadb809d860 2023-10-03T10:13:52.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.390+0000 7fadae7fc700 1 -- 172.21.15.146:0/171844400 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb4007310 con 0x7fadb809d860 2023-10-03T10:13:52.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.391+0000 7fadbfb62700 1 -- 172.21.15.146:0/171844400 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb811d9b0 con 0x7fadb809d860 2023-10-03T10:13:52.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.391+0000 7fadae7fc700 1 -- 172.21.15.146:0/171844400 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fadb4007470 con 0x7fadb809d860 2023-10-03T10:13:52.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.392+0000 7fadae7fc700 1 -- 172.21.15.146:0/171844400 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fadb403f360 con 0x7fadb809d860 2023-10-03T10:13:52.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.392+0000 7fadbfb62700 1 -- 172.21.15.146:0/171844400 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb804f2a0 con 0x7fadb809d860 2023-10-03T10:13:52.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.396+0000 7fadae7fc700 1 -- 172.21.15.146:0/171844400 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fadb40123b0 con 0x7fadb809d860 2023-10-03T10:13:52.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.458+0000 7fc6bf0f2700 1 -- 172.21.15.146:0/1610491643 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc6b804f2a0 con 0x7fc6b81309f0 2023-10-03T10:13:52.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.459+0000 7fc6b57fa700 1 -- 172.21.15.146:0/1610491643 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc6a4017020 con 0x7fc6b81309f0 2023-10-03T10:13:52.458 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:52.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.461+0000 7fc6bf0f2700 1 -- 172.21.15.146:0/1610491643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6b81309f0 msgr2=0x7fc6b8071810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.461+0000 7fc6bf0f2700 1 --2- 172.21.15.146:0/1610491643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6b81309f0 0x7fc6b8071810 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400e980 tx=0x7fc6a400ec90 comp rx=0 tx=0).stop 2023-10-03T10:13:52.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.461+0000 7fc6bf0f2700 1 -- 172.21.15.146:0/1610491643 shutdown_connections 2023-10-03T10:13:52.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.461+0000 7fc6bf0f2700 1 --2- 172.21.15.146:0/1610491643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6b8133ad0 0x7fc6b8071d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.461+0000 7fc6bf0f2700 1 --2- 172.21.15.146:0/1610491643 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc6b81300a0 0x7fc6b80712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.461+0000 7fc6bf0f2700 1 --2- 172.21.15.146:0/1610491643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6b81309f0 0x7fc6b8071810 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.461+0000 7fc6bf0f2700 1 -- 172.21.15.146:0/1610491643 >> 172.21.15.146:0/1610491643 conn(0x7fc6b8099c40 msgr2=0x7fc6b8132b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:52.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.461+0000 7fc6bf0f2700 1 -- 172.21.15.146:0/1610491643 shutdown_connections 2023-10-03T10:13:52.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.461+0000 7fc6bf0f2700 1 -- 172.21.15.146:0/1610491643 wait complete. 2023-10-03T10:13:52.474 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:52.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.527+0000 7f8f9c365700 1 -- 172.21.15.146:0/2549593305 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8f9406b2a0 con 0x7f8f9409d8f0 2023-10-03T10:13:52.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.527+0000 7f8f8affd700 1 -- 172.21.15.146:0/2549593305 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f8401c390 con 0x7f8f9409d8f0 2023-10-03T10:13:52.527 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:52.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.530+0000 7f8f9c365700 1 -- 172.21.15.146:0/2549593305 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f9409d8f0 msgr2=0x7f8f9406dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.530+0000 7f8f9c365700 1 --2- 172.21.15.146:0/2549593305 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f9409d8f0 0x7f8f9406dbf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8f840011e0 tx=0x7f8f8400ca30 comp rx=0 tx=0).stop 2023-10-03T10:13:52.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.530+0000 7f8f9c365700 1 -- 172.21.15.146:0/2549593305 shutdown_connections 2023-10-03T10:13:52.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.530+0000 7f8f9c365700 1 --2- 172.21.15.146:0/2549593305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f9409e440 0x7f8f9406e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.530+0000 7f8f9c365700 1 --2- 172.21.15.146:0/2549593305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f94098410 0x7f8f9406d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.530+0000 7f8f9c365700 1 --2- 172.21.15.146:0/2549593305 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f9409d8f0 0x7f8f9406dbf0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.530+0000 7f8f9c365700 1 -- 172.21.15.146:0/2549593305 >> 172.21.15.146:0/2549593305 conn(0x7f8f940a2b30 msgr2=0x7f8f94131ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:52.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.530+0000 7f8f9c365700 1 -- 172.21.15.146:0/2549593305 shutdown_connections 2023-10-03T10:13:52.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.530+0000 7f8f9c365700 1 -- 172.21.15.146:0/2549593305 wait complete. 2023-10-03T10:13:52.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.534+0000 7fe5360b8700 1 -- 172.21.15.146:0/1300012937 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe53006c3b0 con 0x7fe5301300a0 2023-10-03T10:13:52.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.535+0000 7fe517fff700 1 -- 172.21.15.146:0/1300012937 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe520015030 con 0x7fe5301300a0 2023-10-03T10:13:52.534 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:52.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.537+0000 7fe5360b8700 1 -- 172.21.15.146:0/1300012937 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5301300a0 msgr2=0x7fe53011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.537+0000 7fe5360b8700 1 --2- 172.21.15.146:0/1300012937 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5301300a0 0x7fe53011da40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe520000c00 tx=0x7fe520004750 comp rx=0 tx=0).stop 2023-10-03T10:13:52.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.537+0000 7fe5360b8700 1 -- 172.21.15.146:0/1300012937 shutdown_connections 2023-10-03T10:13:52.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.537+0000 7fe5360b8700 1 --2- 172.21.15.146:0/1300012937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe530133ad0 0x7fe53011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.537+0000 7fe5360b8700 1 --2- 172.21.15.146:0/1300012937 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5301300a0 0x7fe53011da40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.537+0000 7fe5360b8700 1 --2- 172.21.15.146:0/1300012937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe530130bc0 0x7fe53011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.537+0000 7fe5360b8700 1 -- 172.21.15.146:0/1300012937 >> 172.21.15.146:0/1300012937 conn(0x7fe530099c40 msgr2=0x7fe5300a2660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:52.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.538+0000 7fe5360b8700 1 -- 172.21.15.146:0/1300012937 shutdown_connections 2023-10-03T10:13:52.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.538+0000 7fe5360b8700 1 -- 172.21.15.146:0/1300012937 wait complete. 2023-10-03T10:13:52.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:52.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:52.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.604+0000 7fadbfb62700 1 -- 172.21.15.146:0/171844400 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fadb806ecd0 con 0x7fadb809d860 2023-10-03T10:13:52.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.604+0000 7fadae7fc700 1 -- 172.21.15.146:0/171844400 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fadb4011360 con 0x7fadb809d860 2023-10-03T10:13:52.604 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:52.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.606+0000 7fadbfb62700 1 -- 172.21.15.146:0/171844400 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fadb809d860 msgr2=0x7fadb811b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.606+0000 7fadbfb62700 1 --2- 172.21.15.146:0/171844400 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fadb809d860 0x7fadb811b5f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fadb400c520 tx=0x7fadb400c830 comp rx=0 tx=0).stop 2023-10-03T10:13:52.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.606+0000 7fadbfb62700 1 -- 172.21.15.146:0/171844400 shutdown_connections 2023-10-03T10:13:52.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.606+0000 7fadbfb62700 1 --2- 172.21.15.146:0/171844400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadb8135f20 0x7fadb811c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.606+0000 7fadbfb62700 1 --2- 172.21.15.146:0/171844400 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fadb809d860 0x7fadb811b5f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.606+0000 7fadbfb62700 1 --2- 172.21.15.146:0/171844400 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fadb809e340 0x7fadb811bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.606+0000 7fadbfb62700 1 -- 172.21.15.146:0/171844400 >> 172.21.15.146:0/171844400 conn(0x7fadb8099c40 msgr2=0x7fadb8134d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:52.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.606+0000 7fadbfb62700 1 -- 172.21.15.146:0/171844400 shutdown_connections 2023-10-03T10:13:52.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:52.606+0000 7fadbfb62700 1 -- 172.21.15.146:0/171844400 wait complete. 2023-10-03T10:13:52.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:53.475 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:53.544 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:53.551 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.614+0000 7fc748307700 1 Processor -- start 2023-10-03T10:13:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.614+0000 7fc748307700 1 -- start start 2023-10-03T10:13:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.614+0000 7fc748307700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc740136960 0x7fc740138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.614+0000 7fc748307700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc740139280 0x7fc74013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.614+0000 7fc748307700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74006b2d0 con 0x7fc740133ad0 2023-10-03T10:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.614+0000 7fc748307700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7401345b0 con 0x7fc740136960 2023-10-03T10:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.614+0000 7fc748307700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc740133610 con 0x7fc740139280 2023-10-03T10:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.615+0000 7fc7458a2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc740136960 0x7fc740138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.615+0000 7fc7458a2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc740136960 0x7fc740138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40568/0 (socket says 172.21.15.146:40568) 2023-10-03T10:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.615+0000 7fc7458a2700 1 -- 172.21.15.146:0/3651918222 learned_addr learned my addr 172.21.15.146:0/3651918222 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.615+0000 7fc7468a4700 1 --2- 172.21.15.146:0/3651918222 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc740139280 0x7fc74013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.615+0000 7fc7458a2700 1 -- 172.21.15.146:0/3651918222 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc740139280 msgr2=0x7fc74013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.615+0000 7fc7458a2700 1 --2- 172.21.15.146:0/3651918222 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc740139280 0x7fc74013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.615+0000 7fc7458a2700 1 -- 172.21.15.146:0/3651918222 >> v1:172.21.15.146:6789/0 conn(0x7fc740133ad0 legacy=0x7fc740133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.615+0000 7fc7458a2700 1 -- 172.21.15.146:0/3651918222 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74009a500 con 0x7fc740136960 2023-10-03T10:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.615+0000 7fc7458a2700 1 --2- 172.21.15.146:0/3651918222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc740136960 0x7fc740138d40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc730009920 tx=0x7fc730009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be880a4d309b7388 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.615+0000 7fc7450a1700 1 -- 172.21.15.146:0/3651918222 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc730011830 con 0x7fc740136960 2023-10-03T10:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.615+0000 7fc7450a1700 1 -- 172.21.15.146:0/3651918222 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc730011990 con 0x7fc740136960 2023-10-03T10:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.615+0000 7fc7450a1700 1 -- 172.21.15.146:0/3651918222 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc730011d20 con 0x7fc740136960 2023-10-03T10:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.616+0000 7fc748307700 1 -- 172.21.15.146:0/3651918222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc740136960 msgr2=0x7fc740138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.616+0000 7fc748307700 1 --2- 172.21.15.146:0/3651918222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc740136960 0x7fc740138d40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc730009920 tx=0x7fc730009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.616+0000 7fc748307700 1 -- 172.21.15.146:0/3651918222 shutdown_connections 2023-10-03T10:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.616+0000 7fc748307700 1 --2- 172.21.15.146:0/3651918222 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc740139280 0x7fc74013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.616+0000 7fc748307700 1 --2- 172.21.15.146:0/3651918222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc740136960 0x7fc740138d40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.616+0000 7fc748307700 1 -- 172.21.15.146:0/3651918222 >> 172.21.15.146:0/3651918222 conn(0x7fc740099c40 msgr2=0x7fc7400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.616+0000 7fc748307700 1 -- 172.21.15.146:0/3651918222 shutdown_connections 2023-10-03T10:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.616+0000 7fc748307700 1 -- 172.21.15.146:0/3651918222 wait complete. 2023-10-03T10:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.617+0000 7fc748307700 1 Processor -- start 2023-10-03T10:13:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.617+0000 7fc748307700 1 -- start start 2023-10-03T10:13:53.620 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:53.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.618+0000 7fc748307700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc740133ad0 0x7fc740071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.618+0000 7fc748307700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc740136960 0x7fc740071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.618+0000 7fc748307700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc740139280 0x7fc7401c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.618+0000 7fc748307700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74006e900 con 0x7fc740139280 2023-10-03T10:13:53.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.618+0000 7fc748307700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74006f490 con 0x7fc740133ad0 2023-10-03T10:13:53.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.618+0000 7fc748307700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7401316a0 con 0x7fc740136960 2023-10-03T10:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.618+0000 7fc7460a3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc740133ad0 0x7fc740071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.618+0000 7fc7468a4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc740139280 0x7fc7401c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.618+0000 7fc7468a4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc740139280 0x7fc7401c84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43198/0 (socket says 172.21.15.146:43198) 2023-10-03T10:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.618+0000 7fc7468a4700 1 -- 172.21.15.146:0/3740490441 learned_addr learned my addr 172.21.15.146:0/3740490441 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.618+0000 7fc7460a3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc740133ad0 0x7fc740071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40582/0 (socket says 172.21.15.146:40582) 2023-10-03T10:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.618+0000 7fc7460a3700 1 -- 172.21.15.146:0/3740490441 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc740136960 msgr2=0x7fc740071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.618+0000 7fc7460a3700 1 --2- 172.21.15.146:0/3740490441 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc740136960 0x7fc740071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.618+0000 7fc7460a3700 1 -- 172.21.15.146:0/3740490441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc740139280 msgr2=0x7fc7401c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.618+0000 7fc7460a3700 1 --2- 172.21.15.146:0/3740490441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc740139280 0x7fc7401c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.618+0000 7fc7460a3700 1 -- 172.21.15.146:0/3740490441 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc730009550 con 0x7fc740133ad0 2023-10-03T10:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.618+0000 7fc7468a4700 1 --2- 172.21.15.146:0/3740490441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc740139280 0x7fc7401c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.618+0000 7fc7460a3700 1 --2- 172.21.15.146:0/3740490441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc740133ad0 0x7fc740071850 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc73c000f60 tx=0x7fc73c00c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.618+0000 7fc736ffd700 1 -- 172.21.15.146:0/3740490441 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c0052d0 con 0x7fc740133ad0 2023-10-03T10:13:53.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.618+0000 7fc736ffd700 1 -- 172.21.15.146:0/3740490441 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c00ce90 con 0x7fc740133ad0 2023-10-03T10:13:53.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.618+0000 7fc748307700 1 -- 172.21.15.146:0/3740490441 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74006f010 con 0x7fc740133ad0 2023-10-03T10:13:53.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.618+0000 7fc736ffd700 1 -- 172.21.15.146:0/3740490441 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c003680 con 0x7fc740133ad0 2023-10-03T10:13:53.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.619+0000 7fc748307700 1 -- 172.21.15.146:0/3740490441 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7400722d0 con 0x7fc740133ad0 2023-10-03T10:13:53.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.619+0000 7fc748307700 1 -- 172.21.15.146:0/3740490441 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc740072520 con 0x7fc740133ad0 2023-10-03T10:13:53.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.620+0000 7fc736ffd700 1 -- 172.21.15.146:0/3740490441 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc73c0037e0 con 0x7fc740133ad0 2023-10-03T10:13:53.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.620+0000 7fc736ffd700 1 -- 172.21.15.146:0/3740490441 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc73c03eea0 con 0x7fc740133ad0 2023-10-03T10:13:53.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.624+0000 7fc736ffd700 1 -- 172.21.15.146:0/3740490441 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc73c011590 con 0x7fc740133ad0 2023-10-03T10:13:53.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.688+0000 7f2bad9a9700 1 Processor -- start 2023-10-03T10:13:53.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.688+0000 7f2bad9a9700 1 -- start start 2023-10-03T10:13:53.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.689+0000 7f2bad9a9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba809a150 0x7f2ba809e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.689+0000 7f2bad9a9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ba809f1a0 0x7f2ba8134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.689+0000 7f2bad9a9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba809af80 con 0x7f2ba809edb0 2023-10-03T10:13:53.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.689+0000 7f2bad9a9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba809a520 con 0x7f2ba809f1a0 2023-10-03T10:13:53.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.689+0000 7f2bad9a9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba809fe00 con 0x7f2ba809a150 2023-10-03T10:13:53.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.689+0000 7f2ba77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ba809f1a0 0x7f2ba8134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.689+0000 7f2ba67fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2ba809edb0 0x7f2ba8133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58760/0 (socket says 172.21.15.146:58760) 2023-10-03T10:13:53.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.689+0000 7f2ba67fc700 1 -- 172.21.15.146:0/2241797596 learned_addr learned my addr 172.21.15.146:0/2241797596 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:53.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.689+0000 7f2ba6ffd700 1 --2- 172.21.15.146:0/2241797596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba809a150 0x7f2ba809e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.689+0000 7f2ba6ffd700 1 -- 172.21.15.146:0/2241797596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ba809f1a0 msgr2=0x7f2ba8134330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:53.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.689+0000 7f2ba6ffd700 1 --2- 172.21.15.146:0/2241797596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ba809f1a0 0x7f2ba8134330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.689+0000 7f2ba6ffd700 1 -- 172.21.15.146:0/2241797596 >> v1:172.21.15.146:6789/0 conn(0x7f2ba809edb0 legacy=0x7f2ba8133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.689+0000 7f2ba6ffd700 1 -- 172.21.15.146:0/2241797596 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba806bc20 con 0x7f2ba809a150 2023-10-03T10:13:53.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.689+0000 7f2ba5ffb700 1 -- 172.21.15.146:0/2241797596 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346445814 0 0) 0x7f2ba809af80 con 0x7f2ba809edb0 2023-10-03T10:13:53.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.690+0000 7f2ba6ffd700 1 --2- 172.21.15.146:0/2241797596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba809a150 0x7f2ba809e870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2b980098a0 tx=0x7f2b98009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54cf9136bb5413a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.690+0000 7f2ba5ffb700 1 -- 172.21.15.146:0/2241797596 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b98011830 con 0x7f2ba809a150 2023-10-03T10:13:53.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.690+0000 7f2ba5ffb700 1 -- 172.21.15.146:0/2241797596 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b98011990 con 0x7f2ba809a150 2023-10-03T10:13:53.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.690+0000 7f2ba5ffb700 1 -- 172.21.15.146:0/2241797596 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b98011d20 con 0x7f2ba809a150 2023-10-03T10:13:53.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.691+0000 7f2bad9a9700 1 -- 172.21.15.146:0/2241797596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba809a150 msgr2=0x7f2ba809e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.691+0000 7f2bad9a9700 1 --2- 172.21.15.146:0/2241797596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba809a150 0x7f2ba809e870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2b980098a0 tx=0x7f2b98009bb0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.691+0000 7f2bad9a9700 1 -- 172.21.15.146:0/2241797596 shutdown_connections 2023-10-03T10:13:53.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.691+0000 7f2bad9a9700 1 --2- 172.21.15.146:0/2241797596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ba809f1a0 0x7f2ba8134330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.691+0000 7f2bad9a9700 1 --2- 172.21.15.146:0/2241797596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba809a150 0x7f2ba809e870 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.691+0000 7f2bad9a9700 1 -- 172.21.15.146:0/2241797596 >> 172.21.15.146:0/2241797596 conn(0x7f2ba80a4430 msgr2=0x7f2ba80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.691+0000 7f2bad9a9700 1 -- 172.21.15.146:0/2241797596 shutdown_connections 2023-10-03T10:13:53.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.691+0000 7f2bad9a9700 1 -- 172.21.15.146:0/2241797596 wait complete. 2023-10-03T10:13:53.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.692+0000 7f2bad9a9700 1 Processor -- start 2023-10-03T10:13:53.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.692+0000 7f2bad9a9700 1 -- start start 2023-10-03T10:13:53.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.692+0000 7f2bad9a9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ba809a150 0x7f2ba81c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.692+0000 7f2bad9a9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ba809edb0 0x7f2ba81c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.692+0000 7f2bad9a9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba809f1a0 0x7f2ba81c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.692+0000 7f2bad9a9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba81aae50 con 0x7f2ba809a150 2023-10-03T10:13:53.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.692+0000 7f2bad9a9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba809bb20 con 0x7f2ba809edb0 2023-10-03T10:13:53.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.692+0000 7f2bad9a9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba80a0440 con 0x7f2ba809f1a0 2023-10-03T10:13:53.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.692+0000 7f2ba77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba809f1a0 0x7f2ba81c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.692+0000 7f2ba6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ba809a150 0x7f2ba81c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.692+0000 7f2ba67fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ba809edb0 0x7f2ba81c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.692+0000 7f2ba77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba809f1a0 0x7f2ba81c4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57682/0 (socket says 172.21.15.146:57682) 2023-10-03T10:13:53.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.692+0000 7f2ba77fe700 1 -- 172.21.15.146:0/570323802 learned_addr learned my addr 172.21.15.146:0/570323802 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:53.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.693+0000 7f2ba6ffd700 1 -- 172.21.15.146:0/570323802 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba809f1a0 msgr2=0x7f2ba81c4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.693+0000 7f2ba6ffd700 1 --2- 172.21.15.146:0/570323802 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba809f1a0 0x7f2ba81c4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.693+0000 7f2ba6ffd700 1 -- 172.21.15.146:0/570323802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ba809edb0 msgr2=0x7f2ba81c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.693+0000 7f2ba6ffd700 1 --2- 172.21.15.146:0/570323802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ba809edb0 0x7f2ba81c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.693+0000 7f2ba6ffd700 1 -- 172.21.15.146:0/570323802 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b980094a0 con 0x7f2ba809a150 2023-10-03T10:13:53.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.693+0000 7f2ba6ffd700 1 --2- 172.21.15.146:0/570323802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ba809a150 0x7f2ba81c8b50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2b98016000 tx=0x7f2b98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.693+0000 7f2b8ffff700 1 -- 172.21.15.146:0/570323802 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b98004450 con 0x7f2ba809a150 2023-10-03T10:13:53.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.693+0000 7f2b8ffff700 1 -- 172.21.15.146:0/570323802 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9801e070 con 0x7f2ba809a150 2023-10-03T10:13:53.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.693+0000 7f2bad9a9700 1 -- 172.21.15.146:0/570323802 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba81aa030 con 0x7f2ba809a150 2023-10-03T10:13:53.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.693+0000 7f2b8ffff700 1 -- 172.21.15.146:0/570323802 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b980038c0 con 0x7f2ba809a150 2023-10-03T10:13:53.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.693+0000 7f2bad9a9700 1 -- 172.21.15.146:0/570323802 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba81ac600 con 0x7f2ba809a150 2023-10-03T10:13:53.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.695+0000 7f2b8ffff700 1 -- 172.21.15.146:0/570323802 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b98003a20 con 0x7f2ba809a150 2023-10-03T10:13:53.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.695+0000 7f2bad9a9700 1 -- 172.21.15.146:0/570323802 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba809fa30 con 0x7f2ba809a150 2023-10-03T10:13:53.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.695+0000 7f2b8ffff700 1 -- 172.21.15.146:0/570323802 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2b98020070 con 0x7f2ba809a150 2023-10-03T10:13:53.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.700+0000 7f2b8ffff700 1 -- 172.21.15.146:0/570323802 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b98003cd0 con 0x7f2ba809a150 2023-10-03T10:13:53.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.738+0000 7f538fae7700 1 Processor -- start 2023-10-03T10:13:53.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.738+0000 7f538fae7700 1 -- start start 2023-10-03T10:13:53.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.739+0000 7f538fae7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5388136960 0x7f5388138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.739+0000 7f538fae7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5388139280 0x7f538813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.739+0000 7f538fae7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f538806b2d0 con 0x7f5388133ad0 2023-10-03T10:13:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.739+0000 7f538fae7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53881345b0 con 0x7f5388139280 2023-10-03T10:13:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.739+0000 7f538fae7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5388133610 con 0x7f5388136960 2023-10-03T10:13:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.739+0000 7f538d082700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5388136960 0x7f5388138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.739+0000 7f538d082700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5388136960 0x7f5388138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57694/0 (socket says 172.21.15.146:57694) 2023-10-03T10:13:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.739+0000 7f538d082700 1 -- 172.21.15.146:0/987823485 learned_addr learned my addr 172.21.15.146:0/987823485 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.739+0000 7f538d082700 1 -- 172.21.15.146:0/987823485 >> v2:172.21.15.146:3300/0 conn(0x7f5388139280 msgr2=0x7f538813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.739+0000 7f538e084700 1 --2- 172.21.15.146:0/987823485 >> v2:172.21.15.146:3300/0 conn(0x7f5388139280 0x7f538813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.739+0000 7f538d082700 1 --2- 172.21.15.146:0/987823485 >> v2:172.21.15.146:3300/0 conn(0x7f5388139280 0x7f538813b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.739+0000 7f538d082700 1 -- 172.21.15.146:0/987823485 >> v1:172.21.15.146:6789/0 conn(0x7f5388133ad0 legacy=0x7f5388133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.739+0000 7f538d082700 1 -- 172.21.15.146:0/987823485 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538809a500 con 0x7f5388136960 2023-10-03T10:13:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.739+0000 7f538e084700 1 --2- 172.21.15.146:0/987823485 >> v2:172.21.15.146:3300/0 conn(0x7f5388139280 0x7f538813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.740+0000 7f538d082700 1 --2- 172.21.15.146:0/987823485 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5388136960 0x7f5388138d40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5378009920 tx=0x7f5378009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d6ccef8cf5ef777 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.740+0000 7f538c881700 1 -- 172.21.15.146:0/987823485 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5378004230 con 0x7f5388136960 2023-10-03T10:13:53.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.740+0000 7f538c881700 1 -- 172.21.15.146:0/987823485 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5378004390 con 0x7f5388136960 2023-10-03T10:13:53.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.740+0000 7f538c881700 1 -- 172.21.15.146:0/987823485 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5378009e70 con 0x7f5388136960 2023-10-03T10:13:53.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.740+0000 7f538fae7700 1 -- 172.21.15.146:0/987823485 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5388136960 msgr2=0x7f5388138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.740+0000 7f538fae7700 1 --2- 172.21.15.146:0/987823485 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5388136960 0x7f5388138d40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5378009920 tx=0x7f5378009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:53.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.740+0000 7f538fae7700 1 -- 172.21.15.146:0/987823485 shutdown_connections 2023-10-03T10:13:53.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.740+0000 7f538fae7700 1 --2- 172.21.15.146:0/987823485 >> v2:172.21.15.146:3300/0 conn(0x7f5388139280 0x7f538813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.740+0000 7f538fae7700 1 --2- 172.21.15.146:0/987823485 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5388136960 0x7f5388138d40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.740+0000 7f538fae7700 1 -- 172.21.15.146:0/987823485 >> 172.21.15.146:0/987823485 conn(0x7f5388099c40 msgr2=0x7f53880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.741+0000 7f538fae7700 1 -- 172.21.15.146:0/987823485 shutdown_connections 2023-10-03T10:13:53.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.741+0000 7f538fae7700 1 -- 172.21.15.146:0/987823485 wait complete. 2023-10-03T10:13:53.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.742+0000 7f538fae7700 1 Processor -- start 2023-10-03T10:13:53.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.742+0000 7f538fae7700 1 -- start start 2023-10-03T10:13:53.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.743+0000 7f538fae7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5388133ad0 0x7f5388071600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.743+0000 7f538fae7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5388136960 0x7f5388071b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.743+0000 7f538fae7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5388139280 0x7f53881c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.743+0000 7f538fae7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5388130c40 con 0x7f5388133ad0 2023-10-03T10:13:53.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.743+0000 7f538fae7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53880724a0 con 0x7f5388136960 2023-10-03T10:13:53.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.743+0000 7f538fae7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53881317a0 con 0x7f5388139280 2023-10-03T10:13:53.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.743+0000 7f538d883700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5388133ad0 0x7f5388071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.743+0000 7f538d883700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5388133ad0 0x7f5388071600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43238/0 (socket says 172.21.15.146:43238) 2023-10-03T10:13:53.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.743+0000 7f538d883700 1 -- 172.21.15.146:0/689698178 learned_addr learned my addr 172.21.15.146:0/689698178 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:53.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.743+0000 7f538d082700 1 --2- 172.21.15.146:0/689698178 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5388136960 0x7f5388071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.743+0000 7f538e084700 1 --2- 172.21.15.146:0/689698178 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5388139280 0x7f53881c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.743+0000 7f538d082700 1 -- 172.21.15.146:0/689698178 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5388139280 msgr2=0x7f53881c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.743+0000 7f538d082700 1 --2- 172.21.15.146:0/689698178 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5388139280 0x7f53881c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.743+0000 7f538d082700 1 -- 172.21.15.146:0/689698178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5388133ad0 msgr2=0x7f5388071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.743+0000 7f538d082700 1 --2- 172.21.15.146:0/689698178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5388133ad0 0x7f5388071600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.743+0000 7f538d082700 1 -- 172.21.15.146:0/689698178 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5378009550 con 0x7f5388136960 2023-10-03T10:13:53.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.743+0000 7f538d883700 1 --2- 172.21.15.146:0/689698178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5388133ad0 0x7f5388071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:53.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.744+0000 7f538d082700 1 --2- 172.21.15.146:0/689698178 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5388136960 0x7f5388071b40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5378015000 tx=0x7f5378004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.744+0000 7f537e7fc700 1 -- 172.21.15.146:0/689698178 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537800be30 con 0x7f5388136960 2023-10-03T10:13:53.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.744+0000 7f537e7fc700 1 -- 172.21.15.146:0/689698178 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53780036a0 con 0x7f5388136960 2023-10-03T10:13:53.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.744+0000 7f538fae7700 1 -- 172.21.15.146:0/689698178 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f538809f390 con 0x7f5388136960 2023-10-03T10:13:53.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.744+0000 7f537e7fc700 1 -- 172.21.15.146:0/689698178 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5378003a30 con 0x7f5388136960 2023-10-03T10:13:53.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.744+0000 7f538fae7700 1 -- 172.21.15.146:0/689698178 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5388070570 con 0x7f5388136960 2023-10-03T10:13:53.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.745+0000 7f537e7fc700 1 -- 172.21.15.146:0/689698178 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5378021070 con 0x7f5388136960 2023-10-03T10:13:53.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.745+0000 7f538fae7700 1 -- 172.21.15.146:0/689698178 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f538804f2a0 con 0x7f5388136960 2023-10-03T10:13:53.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.745+0000 7f537e7fc700 1 -- 172.21.15.146:0/689698178 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5378040e00 con 0x7f5388136960 2023-10-03T10:13:53.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.750+0000 7f537e7fc700 1 -- 172.21.15.146:0/689698178 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5378029020 con 0x7f5388136960 2023-10-03T10:13:53.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.756+0000 7fe45d098700 1 Processor -- start 2023-10-03T10:13:53.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.756+0000 7fe45d098700 1 -- start start 2023-10-03T10:13:53.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.757+0000 7fe45d098700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe458136960 0x7fe458138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.757+0000 7fe45d098700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe458139280 0x7fe45813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.757+0000 7fe45d098700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe45806b2d0 con 0x7fe458133ad0 2023-10-03T10:13:53.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.757+0000 7fe45d098700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4581345b0 con 0x7fe458136960 2023-10-03T10:13:53.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.757+0000 7fe45d098700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe458133610 con 0x7fe458139280 2023-10-03T10:13:53.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.757+0000 7fe45659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe458136960 0x7fe458138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.757+0000 7fe456d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe458133ad0 0x7fe458133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58770/0 (socket says 172.21.15.146:58770) 2023-10-03T10:13:53.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.757+0000 7fe456d9d700 1 -- 172.21.15.146:0/3580072778 learned_addr learned my addr 172.21.15.146:0/3580072778 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:53.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.757+0000 7fe45759e700 1 --2- 172.21.15.146:0/3580072778 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe458139280 0x7fe45813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.757+0000 7fe45659c700 1 -- 172.21.15.146:0/3580072778 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe458139280 msgr2=0x7fe45813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:53.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.757+0000 7fe455d9b700 1 -- 172.21.15.146:0/3580072778 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1961025388 0 0) 0x7fe45806b2d0 con 0x7fe458133ad0 2023-10-03T10:13:53.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.757+0000 7fe45659c700 1 --2- 172.21.15.146:0/3580072778 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe458139280 0x7fe45813b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.757+0000 7fe45659c700 1 -- 172.21.15.146:0/3580072778 >> v1:172.21.15.146:6789/0 conn(0x7fe458133ad0 legacy=0x7fe458133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.757+0000 7fe45659c700 1 -- 172.21.15.146:0/3580072778 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45809a500 con 0x7fe458136960 2023-10-03T10:13:53.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.758+0000 7fe45759e700 1 --2- 172.21.15.146:0/3580072778 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe458139280 0x7fe45813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:53.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.758+0000 7fe45659c700 1 --2- 172.21.15.146:0/3580072778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe458136960 0x7fe458138d40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009840 tx=0x7fe44c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952eb3d685892412 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.758+0000 7fe455d9b700 1 -- 172.21.15.146:0/3580072778 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c011830 con 0x7fe458136960 2023-10-03T10:13:53.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.758+0000 7fe455d9b700 1 -- 172.21.15.146:0/3580072778 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44c011990 con 0x7fe458136960 2023-10-03T10:13:53.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.758+0000 7fe455d9b700 1 -- 172.21.15.146:0/3580072778 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c011d20 con 0x7fe458136960 2023-10-03T10:13:53.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.758+0000 7fe45d098700 1 -- 172.21.15.146:0/3580072778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe458136960 msgr2=0x7fe458138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.758+0000 7fe45d098700 1 --2- 172.21.15.146:0/3580072778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe458136960 0x7fe458138d40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009840 tx=0x7fe44c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:53.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.758+0000 7fe45d098700 1 -- 172.21.15.146:0/3580072778 shutdown_connections 2023-10-03T10:13:53.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.758+0000 7fe45d098700 1 --2- 172.21.15.146:0/3580072778 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe458139280 0x7fe45813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.758+0000 7fe45d098700 1 --2- 172.21.15.146:0/3580072778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe458136960 0x7fe458138d40 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.758+0000 7fe45d098700 1 -- 172.21.15.146:0/3580072778 >> 172.21.15.146:0/3580072778 conn(0x7fe458099c40 msgr2=0x7fe4580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.758+0000 7fe45d098700 1 -- 172.21.15.146:0/3580072778 shutdown_connections 2023-10-03T10:13:53.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.758+0000 7fe45d098700 1 -- 172.21.15.146:0/3580072778 wait complete. 2023-10-03T10:13:53.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.760+0000 7fe45d098700 1 Processor -- start 2023-10-03T10:13:53.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.760+0000 7fe45d098700 1 -- start start 2023-10-03T10:13:53.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.760+0000 7fe45d098700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe458133ad0 0x7fe4580717e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.760+0000 7fe45d098700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe458139280 0x7fe458071d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.760+0000 7fe45d098700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe458072260 0x7fe4581c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.760+0000 7fe45d098700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45806f3b0 con 0x7fe458133ad0 2023-10-03T10:13:53.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.760+0000 7fe45d098700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45806ef30 con 0x7fe458139280 2023-10-03T10:13:53.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.760+0000 7fe45d098700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe458131730 con 0x7fe458072260 2023-10-03T10:13:53.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.760+0000 7fe456d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe458133ad0 0x7fe4580717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.760+0000 7fe456d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe458133ad0 0x7fe4580717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43252/0 (socket says 172.21.15.146:43252) 2023-10-03T10:13:53.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.760+0000 7fe456d9d700 1 -- 172.21.15.146:0/1793350287 learned_addr learned my addr 172.21.15.146:0/1793350287 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:53.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.760+0000 7fe45659c700 1 --2- 172.21.15.146:0/1793350287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe458139280 0x7fe458071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.760+0000 7fe45759e700 1 --2- 172.21.15.146:0/1793350287 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe458072260 0x7fe4581c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.761+0000 7fe456d9d700 1 -- 172.21.15.146:0/1793350287 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe458072260 msgr2=0x7fe4581c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.761+0000 7fe456d9d700 1 --2- 172.21.15.146:0/1793350287 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe458072260 0x7fe4581c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.761+0000 7fe456d9d700 1 -- 172.21.15.146:0/1793350287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe458139280 msgr2=0x7fe458071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.761+0000 7fe456d9d700 1 --2- 172.21.15.146:0/1793350287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe458139280 0x7fe458071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.761+0000 7fe456d9d700 1 -- 172.21.15.146:0/1793350287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44c0094a0 con 0x7fe458133ad0 2023-10-03T10:13:53.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.761+0000 7fe45659c700 1 --2- 172.21.15.146:0/1793350287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe458139280 0x7fe458071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:53.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.761+0000 7fe456d9d700 1 --2- 172.21.15.146:0/1793350287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe458133ad0 0x7fe4580717e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe44800c520 tx=0x7fe44800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.761+0000 7fe43f7fe700 1 -- 172.21.15.146:0/1793350287 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe448004c80 con 0x7fe458133ad0 2023-10-03T10:13:53.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.761+0000 7fe43f7fe700 1 -- 172.21.15.146:0/1793350287 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe448004e00 con 0x7fe458133ad0 2023-10-03T10:13:53.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.761+0000 7fe45d098700 1 -- 172.21.15.146:0/1793350287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45809f390 con 0x7fe458133ad0 2023-10-03T10:13:53.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.761+0000 7fe43f7fe700 1 -- 172.21.15.146:0/1793350287 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe448007310 con 0x7fe458133ad0 2023-10-03T10:13:53.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.761+0000 7fe45d098700 1 -- 172.21.15.146:0/1793350287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe458130af0 con 0x7fe458133ad0 2023-10-03T10:13:53.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.762+0000 7fe43f7fe700 1 -- 172.21.15.146:0/1793350287 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe448007470 con 0x7fe458133ad0 2023-10-03T10:13:53.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.762+0000 7fe43f7fe700 1 -- 172.21.15.146:0/1793350287 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe44803f2d0 con 0x7fe458133ad0 2023-10-03T10:13:53.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.762+0000 7fe45d098700 1 -- 172.21.15.146:0/1793350287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4580700f0 con 0x7fe458133ad0 2023-10-03T10:13:53.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.767+0000 7fe43f7fe700 1 -- 172.21.15.146:0/1793350287 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4580700f0 con 0x7fe458133ad0 2023-10-03T10:13:53.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.830+0000 7fc748307700 1 -- 172.21.15.146:0/3740490441 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc74004f2a0 con 0x7fc740133ad0 2023-10-03T10:13:53.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.831+0000 7fc736ffd700 1 -- 172.21.15.146:0/3740490441 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc73c017030 con 0x7fc740133ad0 2023-10-03T10:13:53.832 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:53.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.833+0000 7fc748307700 1 -- 172.21.15.146:0/3740490441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc740133ad0 msgr2=0x7fc740071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.833+0000 7fc748307700 1 --2- 172.21.15.146:0/3740490441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc740133ad0 0x7fc740071850 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc73c000f60 tx=0x7fc73c00c6e0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.833+0000 7fc748307700 1 -- 172.21.15.146:0/3740490441 shutdown_connections 2023-10-03T10:13:53.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.833+0000 7fc748307700 1 --2- 172.21.15.146:0/3740490441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc740139280 0x7fc7401c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.833+0000 7fc748307700 1 --2- 172.21.15.146:0/3740490441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc740133ad0 0x7fc740071850 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.833+0000 7fc748307700 1 --2- 172.21.15.146:0/3740490441 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc740136960 0x7fc740071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.833+0000 7fc748307700 1 -- 172.21.15.146:0/3740490441 >> 172.21.15.146:0/3740490441 conn(0x7fc740099c40 msgr2=0x7fc740134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.833+0000 7fc748307700 1 -- 172.21.15.146:0/3740490441 shutdown_connections 2023-10-03T10:13:53.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.833+0000 7fc748307700 1 -- 172.21.15.146:0/3740490441 wait complete. 2023-10-03T10:13:53.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:53.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.963+0000 7fe45d098700 1 -- 172.21.15.146:0/1793350287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe4580700f0 con 0x7fe458133ad0 2023-10-03T10:13:53.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.964+0000 7fe43f7fe700 1 -- 172.21.15.146:0/1793350287 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4580700f0 con 0x7fe458133ad0 2023-10-03T10:13:53.963 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.966+0000 7fe45d098700 1 -- 172.21.15.146:0/1793350287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe458133ad0 msgr2=0x7fe4580717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.966+0000 7fe45d098700 1 --2- 172.21.15.146:0/1793350287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe458133ad0 0x7fe4580717e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe44800c520 tx=0x7fe44800c830 comp rx=0 tx=0).stop 2023-10-03T10:13:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.966+0000 7fe45d098700 1 -- 172.21.15.146:0/1793350287 shutdown_connections 2023-10-03T10:13:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.966+0000 7fe45d098700 1 --2- 172.21.15.146:0/1793350287 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe458072260 0x7fe4581c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.966+0000 7fe45d098700 1 --2- 172.21.15.146:0/1793350287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe458133ad0 0x7fe4580717e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.966+0000 7fe45d098700 1 --2- 172.21.15.146:0/1793350287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe458139280 0x7fe458071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.966+0000 7fe45d098700 1 -- 172.21.15.146:0/1793350287 >> 172.21.15.146:0/1793350287 conn(0x7fe458099c40 msgr2=0x7fe458134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.966+0000 7fe45d098700 1 -- 172.21.15.146:0/1793350287 shutdown_connections 2023-10-03T10:13:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.966+0000 7fe45d098700 1 -- 172.21.15.146:0/1793350287 wait complete. 2023-10-03T10:13:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.972+0000 7f2bad9a9700 1 -- 172.21.15.146:0/570323802 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2ba81aa6f0 con 0x7f2ba809a150 2023-10-03T10:13:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.973+0000 7f2b8ffff700 1 -- 172.21.15.146:0/570323802 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b98015030 con 0x7f2ba809a150 2023-10-03T10:13:53.972 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:53.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.975+0000 7f2bad9a9700 1 -- 172.21.15.146:0/570323802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ba809a150 msgr2=0x7f2ba81c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.975+0000 7f2bad9a9700 1 --2- 172.21.15.146:0/570323802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ba809a150 0x7f2ba81c8b50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2b98016000 tx=0x7f2b98004750 comp rx=0 tx=0).stop 2023-10-03T10:13:53.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.975+0000 7f2bad9a9700 1 -- 172.21.15.146:0/570323802 shutdown_connections 2023-10-03T10:13:53.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.975+0000 7f2bad9a9700 1 --2- 172.21.15.146:0/570323802 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba809f1a0 0x7f2ba81c4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.975+0000 7f2bad9a9700 1 --2- 172.21.15.146:0/570323802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ba809a150 0x7f2ba81c8b50 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.975+0000 7f2bad9a9700 1 --2- 172.21.15.146:0/570323802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ba809edb0 0x7f2ba81c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.975+0000 7f2bad9a9700 1 -- 172.21.15.146:0/570323802 >> 172.21.15.146:0/570323802 conn(0x7f2ba80a4430 msgr2=0x7f2ba80724f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.975+0000 7f2bad9a9700 1 -- 172.21.15.146:0/570323802 shutdown_connections 2023-10-03T10:13:53.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:53.975+0000 7f2bad9a9700 1 -- 172.21.15.146:0/570323802 wait complete. 2023-10-03T10:13:53.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:53.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:54.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.007+0000 7f538fae7700 1 -- 172.21.15.146:0/689698178 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f538809f0f0 con 0x7f5388136960 2023-10-03T10:13:54.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.008+0000 7f537e7fc700 1 -- 172.21.15.146:0/689698178 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5378040070 con 0x7f5388136960 2023-10-03T10:13:54.007 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:54.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.010+0000 7f538fae7700 1 -- 172.21.15.146:0/689698178 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5388136960 msgr2=0x7f5388071b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.010+0000 7f538fae7700 1 --2- 172.21.15.146:0/689698178 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5388136960 0x7f5388071b40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5378015000 tx=0x7f5378004750 comp rx=0 tx=0).stop 2023-10-03T10:13:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.010+0000 7f538fae7700 1 -- 172.21.15.146:0/689698178 shutdown_connections 2023-10-03T10:13:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.010+0000 7f538fae7700 1 --2- 172.21.15.146:0/689698178 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5388139280 0x7f53881c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.010+0000 7f538fae7700 1 --2- 172.21.15.146:0/689698178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5388133ad0 0x7f5388071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.010+0000 7f538fae7700 1 --2- 172.21.15.146:0/689698178 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5388136960 0x7f5388071b40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.010+0000 7f538fae7700 1 -- 172.21.15.146:0/689698178 >> 172.21.15.146:0/689698178 conn(0x7f5388099c40 msgr2=0x7f5388134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.010+0000 7f538fae7700 1 -- 172.21.15.146:0/689698178 shutdown_connections 2023-10-03T10:13:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.010+0000 7f538fae7700 1 -- 172.21.15.146:0/689698178 wait complete. 2023-10-03T10:13:54.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:54.846 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:54.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.978+0000 7facd02e0700 1 Processor -- start 2023-10-03T10:13:54.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.978+0000 7facd02e0700 1 -- start start 2023-10-03T10:13:54.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.979+0000 7facd02e0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7facc809e870 0x7facc809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.979+0000 7facd02e0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facc809f180 0x7facc8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.979+0000 7facd02e0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc809c970 con 0x7facc8131d70 2023-10-03T10:13:54.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.979+0000 7facd02e0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc80a0920 con 0x7facc809e870 2023-10-03T10:13:54.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.979+0000 7facd02e0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facc809f9c0 con 0x7facc809f180 2023-10-03T10:13:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.979+0000 7faccd87b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facc809f180 0x7facc8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.979+0000 7facce07c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7facc809e870 0x7facc809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.979+0000 7facce07c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7facc809e870 0x7facc809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37362/0 (socket says 172.21.15.146:37362) 2023-10-03T10:13:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.979+0000 7faccd87b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facc809f180 0x7facc8131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36124/0 (socket says 172.21.15.146:36124) 2023-10-03T10:13:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.979+0000 7facce07c700 1 -- 172.21.15.146:0/1642151631 learned_addr learned my addr 172.21.15.146:0/1642151631 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.979+0000 7facce87d700 1 --1- 172.21.15.146:0/1642151631 >> v1:172.21.15.146:6789/0 conn(0x7facc8131d70 0x7facc8138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45642/0 (socket says 172.21.15.146:45642) 2023-10-03T10:13:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.979+0000 7facce07c700 1 -- 172.21.15.146:0/1642151631 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facc809f180 msgr2=0x7facc8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.979+0000 7facce07c700 1 --2- 172.21.15.146:0/1642151631 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facc809f180 0x7facc8131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.979+0000 7facce07c700 1 -- 172.21.15.146:0/1642151631 >> v1:172.21.15.146:6789/0 conn(0x7facc8131d70 legacy=0x7facc8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.979+0000 7facce07c700 1 -- 172.21.15.146:0/1642151631 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc809bab0 con 0x7facc809e870 2023-10-03T10:13:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.979+0000 7faccd07a700 1 -- 172.21.15.146:0/1642151631 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109634078 0 0) 0x7facc809c970 con 0x7facc8131d70 2023-10-03T10:13:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.979+0000 7faccd87b700 1 --2- 172.21.15.146:0/1642151631 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facc809f180 0x7facc8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:54.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.979+0000 7facce07c700 1 --2- 172.21.15.146:0/1642151631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facc809e870 0x7facc809ec40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7facb80098f0 tx=0x7facb8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ffb63f182da2d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.980+0000 7faccd07a700 1 -- 172.21.15.146:0/1642151631 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb8011830 con 0x7facc809e870 2023-10-03T10:13:54.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.980+0000 7faccd07a700 1 -- 172.21.15.146:0/1642151631 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb8011990 con 0x7facc809e870 2023-10-03T10:13:54.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.980+0000 7faccd07a700 1 -- 172.21.15.146:0/1642151631 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb8011d20 con 0x7facc809e870 2023-10-03T10:13:54.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.980+0000 7facd02e0700 1 -- 172.21.15.146:0/1642151631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facc809e870 msgr2=0x7facc809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.980+0000 7facd02e0700 1 --2- 172.21.15.146:0/1642151631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facc809e870 0x7facc809ec40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7facb80098f0 tx=0x7facb8009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:54.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.980+0000 7facd02e0700 1 -- 172.21.15.146:0/1642151631 shutdown_connections 2023-10-03T10:13:54.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.980+0000 7facd02e0700 1 --2- 172.21.15.146:0/1642151631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facc809e870 0x7facc809ec40 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.980+0000 7facd02e0700 1 --2- 172.21.15.146:0/1642151631 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facc809f180 0x7facc8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.980+0000 7facd02e0700 1 -- 172.21.15.146:0/1642151631 >> 172.21.15.146:0/1642151631 conn(0x7facc80a4430 msgr2=0x7facc80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.980+0000 7facd02e0700 1 -- 172.21.15.146:0/1642151631 shutdown_connections 2023-10-03T10:13:54.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.980+0000 7facd02e0700 1 -- 172.21.15.146:0/1642151631 wait complete. 2023-10-03T10:13:54.983 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:54.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.981+0000 7facd02e0700 1 Processor -- start 2023-10-03T10:13:54.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.981+0000 7facd02e0700 1 -- start start 2023-10-03T10:13:54.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.982+0000 7facd02e0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facc809e870 0x7facc8121590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.982+0000 7facd02e0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facc809f180 0x7facc8121ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.982+0000 7facd02e0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facc8131d70 0x7facc8122010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.982+0000 7facd02e0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc81308b0 con 0x7facc809f180 2023-10-03T10:13:54.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.982+0000 7facd02e0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc8124a80 con 0x7facc809e870 2023-10-03T10:13:54.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.982+0000 7facd02e0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facc8124d40 con 0x7facc8131d70 2023-10-03T10:13:54.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.982+0000 7faccd87b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facc809f180 0x7facc8121ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.982+0000 7facce87d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facc8131d70 0x7facc8122010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.982+0000 7faccd87b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facc809f180 0x7facc8121ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37372/0 (socket says 172.21.15.146:37372) 2023-10-03T10:13:54.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.982+0000 7faccd87b700 1 -- 172.21.15.146:0/3701496606 learned_addr learned my addr 172.21.15.146:0/3701496606 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:54.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.982+0000 7facce07c700 1 --2- 172.21.15.146:0/3701496606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facc809e870 0x7facc8121590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.982+0000 7facce87d700 1 -- 172.21.15.146:0/3701496606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facc809e870 msgr2=0x7facc8121590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.982+0000 7facce87d700 1 --2- 172.21.15.146:0/3701496606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facc809e870 0x7facc8121590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.982+0000 7facce87d700 1 -- 172.21.15.146:0/3701496606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facc809f180 msgr2=0x7facc8121ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.982+0000 7facce87d700 1 --2- 172.21.15.146:0/3701496606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facc809f180 0x7facc8121ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.982+0000 7facce87d700 1 -- 172.21.15.146:0/3701496606 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc40094a0 con 0x7facc8131d70 2023-10-03T10:13:54.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.982+0000 7faccd87b700 1 --2- 172.21.15.146:0/3701496606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facc809f180 0x7facc8121ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:54.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.982+0000 7facce87d700 1 --2- 172.21.15.146:0/3701496606 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facc8131d70 0x7facc8122010 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7facc000cbe0 tx=0x7facc000cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.982+0000 7facbeffd700 1 -- 172.21.15.146:0/3701496606 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc000aa40 con 0x7facc8131d70 2023-10-03T10:13:54.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.982+0000 7facbeffd700 1 -- 172.21.15.146:0/3701496606 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc000abc0 con 0x7facc8131d70 2023-10-03T10:13:54.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.982+0000 7facd02e0700 1 -- 172.21.15.146:0/3701496606 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb8009550 con 0x7facc8131d70 2023-10-03T10:13:54.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.983+0000 7facbeffd700 1 -- 172.21.15.146:0/3701496606 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc00070d0 con 0x7facc8131d70 2023-10-03T10:13:54.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.983+0000 7facd02e0700 1 -- 172.21.15.146:0/3701496606 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc8123990 con 0x7facc8131d70 2023-10-03T10:13:54.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.983+0000 7facbeffd700 1 -- 172.21.15.146:0/3701496606 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7facc0007230 con 0x7facc8131d70 2023-10-03T10:13:54.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.983+0000 7facbeffd700 1 -- 172.21.15.146:0/3701496606 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7facc003f390 con 0x7facc8131d70 2023-10-03T10:13:54.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.983+0000 7facd02e0700 1 -- 172.21.15.146:0/3701496606 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc80727b0 con 0x7facc8131d70 2023-10-03T10:13:54.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:54.988+0000 7facbeffd700 1 -- 172.21.15.146:0/3701496606 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7facc0018080 con 0x7facc8131d70 2023-10-03T10:13:54.988 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:55.022 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:55.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.116+0000 7f6a96a11700 1 Processor -- start 2023-10-03T10:13:55.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.117+0000 7f6a96a11700 1 -- start start 2023-10-03T10:13:55.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.117+0000 7f6a96a11700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a9009e340 0x7f6a901359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.117+0000 7f6a96a11700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a90135f20 0x7f6a90138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.117+0000 7f6a96a11700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9009aaa0 con 0x7f6a9009d860 2023-10-03T10:13:55.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.117+0000 7f6a96a11700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9009e730 con 0x7f6a9009e340 2023-10-03T10:13:55.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.117+0000 7f6a96a11700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9009f870 con 0x7f6a90135f20 2023-10-03T10:13:55.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.117+0000 7f6a8f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a9009e340 0x7f6a901359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.117+0000 7f6a8f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a9009e340 0x7f6a901359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38496/0 (socket says 172.21.15.146:38496) 2023-10-03T10:13:55.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.117+0000 7f6a8f7fe700 1 -- 172.21.15.146:0/4028733167 learned_addr learned my addr 172.21.15.146:0/4028733167 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:55.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.117+0000 7f6a94fae700 1 --2- 172.21.15.146:0/4028733167 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a90135f20 0x7f6a90138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.118+0000 7f6a94fae700 1 -- 172.21.15.146:0/4028733167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a9009e340 msgr2=0x7f6a901359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:55.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.118+0000 7f6a94fae700 1 --2- 172.21.15.146:0/4028733167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a9009e340 0x7f6a901359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.118+0000 7f6a94fae700 1 -- 172.21.15.146:0/4028733167 >> v1:172.21.15.146:6789/0 conn(0x7f6a9009d860 legacy=0x7f6a9009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:55.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.118+0000 7f6a94fae700 1 -- 172.21.15.146:0/4028733167 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9009b360 con 0x7f6a90135f20 2023-10-03T10:13:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.118+0000 7f6a94fae700 1 --2- 172.21.15.146:0/4028733167 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a90135f20 0x7f6a90138300 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009df0 tx=0x7f6a8800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6d5ad39916c3e09 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.118+0000 7f6a8effd700 1 -- 172.21.15.146:0/4028733167 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8800e070 con 0x7f6a90135f20 2023-10-03T10:13:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.118+0000 7f6a8effd700 1 -- 172.21.15.146:0/4028733167 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8800baa0 con 0x7f6a90135f20 2023-10-03T10:13:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.118+0000 7f6a8effd700 1 -- 172.21.15.146:0/4028733167 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8800be50 con 0x7f6a90135f20 2023-10-03T10:13:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.119+0000 7f6a96a11700 1 -- 172.21.15.146:0/4028733167 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a90135f20 msgr2=0x7f6a90138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.119+0000 7f6a96a11700 1 --2- 172.21.15.146:0/4028733167 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a90135f20 0x7f6a90138300 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009df0 tx=0x7f6a8800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.119+0000 7f6a96a11700 1 -- 172.21.15.146:0/4028733167 shutdown_connections 2023-10-03T10:13:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.119+0000 7f6a96a11700 1 --2- 172.21.15.146:0/4028733167 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a90135f20 0x7f6a90138300 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.119+0000 7f6a96a11700 1 --2- 172.21.15.146:0/4028733167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a9009e340 0x7f6a901359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.119+0000 7f6a96a11700 1 -- 172.21.15.146:0/4028733167 >> 172.21.15.146:0/4028733167 conn(0x7f6a90099c40 msgr2=0x7f6a900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.119+0000 7f6a96a11700 1 -- 172.21.15.146:0/4028733167 shutdown_connections 2023-10-03T10:13:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.119+0000 7f6a96a11700 1 -- 172.21.15.146:0/4028733167 wait complete. 2023-10-03T10:13:55.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.120+0000 7f6a96a11700 1 Processor -- start 2023-10-03T10:13:55.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.120+0000 7f6a96a11700 1 -- start start 2023-10-03T10:13:55.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.120+0000 7f6a96a11700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a9009d860 0x7f6a90133f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.120+0000 7f6a96a11700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a9009e340 0x7f6a901344a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.120+0000 7f6a96a11700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a90135f20 0x7f6a901349e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.120+0000 7f6a96a11700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a90135db0 con 0x7f6a90135f20 2023-10-03T10:13:55.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.120+0000 7f6a96a11700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9009c940 con 0x7f6a9009e340 2023-10-03T10:13:55.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.120+0000 7f6a96a11700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9011b590 con 0x7f6a9009d860 2023-10-03T10:13:55.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.121+0000 7f6a8ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a9009d860 0x7f6a90133f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.121+0000 7f6a8ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a9009d860 0x7f6a90133f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36164/0 (socket says 172.21.15.146:36164) 2023-10-03T10:13:55.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.121+0000 7f6a8ffff700 1 -- 172.21.15.146:0/3482333154 learned_addr learned my addr 172.21.15.146:0/3482333154 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:55.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.121+0000 7f6a8f7fe700 1 --2- 172.21.15.146:0/3482333154 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a9009e340 0x7f6a901344a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.121+0000 7f6a94fae700 1 --2- 172.21.15.146:0/3482333154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a90135f20 0x7f6a901349e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.121+0000 7f6a8f7fe700 1 -- 172.21.15.146:0/3482333154 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a9009d860 msgr2=0x7f6a90133f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.121+0000 7f6a8f7fe700 1 --2- 172.21.15.146:0/3482333154 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a9009d860 0x7f6a90133f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.121+0000 7f6a8f7fe700 1 -- 172.21.15.146:0/3482333154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a90135f20 msgr2=0x7f6a901349e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.121+0000 7f6a8f7fe700 1 --2- 172.21.15.146:0/3482333154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a90135f20 0x7f6a901349e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.121+0000 7f6a8f7fe700 1 -- 172.21.15.146:0/3482333154 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a88009a70 con 0x7f6a9009e340 2023-10-03T10:13:55.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.121+0000 7f6a94fae700 1 --2- 172.21.15.146:0/3482333154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a90135f20 0x7f6a901349e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:55.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.121+0000 7f6a8f7fe700 1 --2- 172.21.15.146:0/3482333154 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a9009e340 0x7f6a901344a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400e8e0 tx=0x7f6a8400ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:55.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.121+0000 7f6a8cff9700 1 -- 172.21.15.146:0/3482333154 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a84013680 con 0x7f6a9009e340 2023-10-03T10:13:55.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.122+0000 7f6a8cff9700 1 -- 172.21.15.146:0/3482333154 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a840137e0 con 0x7f6a9009e340 2023-10-03T10:13:55.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.122+0000 7f6a8cff9700 1 -- 172.21.15.146:0/3482333154 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a84013b70 con 0x7f6a9009e340 2023-10-03T10:13:55.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.122+0000 7f6a96a11700 1 -- 172.21.15.146:0/3482333154 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9013b7b0 con 0x7f6a9009e340 2023-10-03T10:13:55.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.122+0000 7f6a96a11700 1 -- 172.21.15.146:0/3482333154 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9011c6f0 con 0x7f6a9009e340 2023-10-03T10:13:55.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.122+0000 7f6a8cff9700 1 -- 172.21.15.146:0/3482333154 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a84013cd0 con 0x7f6a9009e340 2023-10-03T10:13:55.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.123+0000 7f6a8cff9700 1 -- 172.21.15.146:0/3482333154 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6a8403f6c0 con 0x7f6a9009e340 2023-10-03T10:13:55.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.123+0000 7f6a96a11700 1 -- 172.21.15.146:0/3482333154 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9011c880 con 0x7f6a9009e340 2023-10-03T10:13:55.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.127+0000 7f3cbbc30700 1 Processor -- start 2023-10-03T10:13:55.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.127+0000 7f3cbbc30700 1 -- start start 2023-10-03T10:13:55.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.127+0000 7f3cbbc30700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406a770 0x7f3cb41349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.127+0000 7f3cbbc30700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb4134f00 0x7f3cb409d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.127+0000 7f3cbbc30700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3cb409dea0 0x7f3cb409e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.127+0000 7f3cbbc30700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb406b2e0 con 0x7f3cb409dea0 2023-10-03T10:13:55.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.127+0000 7f3cbbc30700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb409eca0 con 0x7f3cb406a770 2023-10-03T10:13:55.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.127+0000 7f3cbbc30700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb409f720 con 0x7f3cb4134f00 2023-10-03T10:13:55.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.128+0000 7f3cb99cc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406a770 0x7f3cb41349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.128+0000 7f3cb91cb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb4134f00 0x7f3cb409d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.128+0000 7f3cb99cc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406a770 0x7f3cb41349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38512/0 (socket says 172.21.15.146:38512) 2023-10-03T10:13:55.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.128+0000 7f3cb91cb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb4134f00 0x7f3cb409d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36180/0 (socket says 172.21.15.146:36180) 2023-10-03T10:13:55.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.128+0000 7f3cb99cc700 1 -- 172.21.15.146:0/3623336617 learned_addr learned my addr 172.21.15.146:0/3623336617 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:55.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.128+0000 7f3cba1cd700 1 --2- 172.21.15.146:0/3623336617 >> v2:172.21.15.146:3300/0 conn(0x7f3cb409dea0 0x7f3cb409e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.128+0000 7f3cb99cc700 1 -- 172.21.15.146:0/3623336617 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb4134f00 msgr2=0x7f3cb409d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:55.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.128+0000 7f3cb99cc700 1 --2- 172.21.15.146:0/3623336617 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb4134f00 0x7f3cb409d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.128+0000 7f3cb99cc700 1 -- 172.21.15.146:0/3623336617 >> v2:172.21.15.146:3300/0 conn(0x7f3cb409dea0 msgr2=0x7f3cb409e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:55.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.128+0000 7f3cb99cc700 1 --2- 172.21.15.146:0/3623336617 >> v2:172.21.15.146:3300/0 conn(0x7f3cb409dea0 0x7f3cb409e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.128+0000 7f3cb99cc700 1 -- 172.21.15.146:0/3623336617 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb406b480 con 0x7f3cb406a770 2023-10-03T10:13:55.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.128+0000 7f3cb91cb700 1 --2- 172.21.15.146:0/3623336617 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb4134f00 0x7f3cb409d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:55.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.128+0000 7f3cb99cc700 1 --2- 172.21.15.146:0/3623336617 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406a770 0x7f3cb41349c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3cb00098f0 tx=0x7f3cb0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65ba524c3ffa5e8f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:55.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.132+0000 7f3cb89ca700 1 -- 172.21.15.146:0/3623336617 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0011830 con 0x7f3cb406a770 2023-10-03T10:13:55.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.132+0000 7f3cb89ca700 1 -- 172.21.15.146:0/3623336617 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb0011990 con 0x7f3cb406a770 2023-10-03T10:13:55.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.132+0000 7f3cb89ca700 1 -- 172.21.15.146:0/3623336617 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0011d20 con 0x7f3cb406a770 2023-10-03T10:13:55.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.132+0000 7f6a8cff9700 1 -- 172.21.15.146:0/3482333154 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a84017080 con 0x7f6a9009e340 2023-10-03T10:13:55.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.133+0000 7f3cbbc30700 1 -- 172.21.15.146:0/3623336617 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406a770 msgr2=0x7f3cb41349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.133+0000 7f3cbbc30700 1 --2- 172.21.15.146:0/3623336617 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406a770 0x7f3cb41349c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3cb00098f0 tx=0x7f3cb0009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:55.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.133+0000 7f3cbbc30700 1 -- 172.21.15.146:0/3623336617 shutdown_connections 2023-10-03T10:13:55.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.133+0000 7f3cbbc30700 1 --2- 172.21.15.146:0/3623336617 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406a770 0x7f3cb41349c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.133+0000 7f3cbbc30700 1 --2- 172.21.15.146:0/3623336617 >> v2:172.21.15.146:3300/0 conn(0x7f3cb409dea0 0x7f3cb409e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.133+0000 7f3cbbc30700 1 --2- 172.21.15.146:0/3623336617 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb4134f00 0x7f3cb409d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.133+0000 7f3cbbc30700 1 -- 172.21.15.146:0/3623336617 >> 172.21.15.146:0/3623336617 conn(0x7f3cb4099c40 msgr2=0x7f3cb40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:55.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.133+0000 7f3cbbc30700 1 -- 172.21.15.146:0/3623336617 shutdown_connections 2023-10-03T10:13:55.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.133+0000 7f3cbbc30700 1 -- 172.21.15.146:0/3623336617 wait complete. 2023-10-03T10:13:55.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.134+0000 7f3cbbc30700 1 Processor -- start 2023-10-03T10:13:55.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.134+0000 7f3cbbc30700 1 -- start start 2023-10-03T10:13:55.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.134+0000 7f3cbbc30700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb409dea0 0x7f3cb411aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.134+0000 7f3cbbc30700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb4134f00 0x7f3cb411afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.134+0000 7f3cbbc30700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb4133d80 0x7f3cb411b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.134+0000 7f3cbbc30700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb411c6e0 con 0x7f3cb4134f00 2023-10-03T10:13:55.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.134+0000 7f3cbbc30700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb4139430 con 0x7f3cb4133d80 2023-10-03T10:13:55.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.134+0000 7f3cbbc30700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb413a040 con 0x7f3cb409dea0 2023-10-03T10:13:55.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.135+0000 7f3cba1cd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb4133d80 0x7f3cb411b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.135+0000 7f3cba1cd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb4133d80 0x7f3cb411b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38522/0 (socket says 172.21.15.146:38522) 2023-10-03T10:13:55.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.135+0000 7f3cba1cd700 1 -- 172.21.15.146:0/1235376208 learned_addr learned my addr 172.21.15.146:0/1235376208 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:55.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.135+0000 7f3cb91cb700 1 --2- 172.21.15.146:0/1235376208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb4134f00 0x7f3cb411afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.135+0000 7f3cb99cc700 1 --2- 172.21.15.146:0/1235376208 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb409dea0 0x7f3cb411aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.135+0000 7f3cba1cd700 1 -- 172.21.15.146:0/1235376208 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb409dea0 msgr2=0x7f3cb411aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.135+0000 7f3cba1cd700 1 --2- 172.21.15.146:0/1235376208 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb409dea0 0x7f3cb411aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.135+0000 7f3cba1cd700 1 -- 172.21.15.146:0/1235376208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb4134f00 msgr2=0x7f3cb411afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.135+0000 7f3cba1cd700 1 --2- 172.21.15.146:0/1235376208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb4134f00 0x7f3cb411afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.135+0000 7f3cba1cd700 1 -- 172.21.15.146:0/1235376208 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca40094a0 con 0x7f3cb4133d80 2023-10-03T10:13:55.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.135+0000 7f3cba1cd700 1 --2- 172.21.15.146:0/1235376208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb4133d80 0x7f3cb411b520 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3cac007e40 tx=0x7f3cac00e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:55.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.135+0000 7f3caa7fc700 1 -- 172.21.15.146:0/1235376208 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac00ed30 con 0x7f3cb4133d80 2023-10-03T10:13:55.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.136+0000 7f3caa7fc700 1 -- 172.21.15.146:0/1235376208 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac00ee90 con 0x7f3cb4133d80 2023-10-03T10:13:55.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.136+0000 7f3caa7fc700 1 -- 172.21.15.146:0/1235376208 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac014660 con 0x7f3cb4133d80 2023-10-03T10:13:55.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.136+0000 7f3cbbc30700 1 -- 172.21.15.146:0/1235376208 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb0009550 con 0x7f3cb4133d80 2023-10-03T10:13:55.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.136+0000 7f3cbbc30700 1 -- 172.21.15.146:0/1235376208 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb411cb50 con 0x7f3cb4133d80 2023-10-03T10:13:55.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.136+0000 7f3caa7fc700 1 -- 172.21.15.146:0/1235376208 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3cac0147c0 con 0x7f3cb4133d80 2023-10-03T10:13:55.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.137+0000 7f3caa7fc700 1 -- 172.21.15.146:0/1235376208 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3cac03fe70 con 0x7f3cb4133d80 2023-10-03T10:13:55.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.141+0000 7f3cbbc30700 1 -- 172.21.15.146:0/1235376208 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb409f220 con 0x7f3cb4133d80 2023-10-03T10:13:55.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.145+0000 7f3caa7fc700 1 -- 172.21.15.146:0/1235376208 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3cac0122e0 con 0x7f3cb4133d80 2023-10-03T10:13:55.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.173+0000 7f37ece89700 1 Processor -- start 2023-10-03T10:13:55.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.173+0000 7f37ece89700 1 -- start start 2023-10-03T10:13:55.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.174+0000 7f37ece89700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f37e809e950 0x7f37e809ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.174+0000 7f37ece89700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37e809f260 0x7f37e8131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.174+0000 7f37ece89700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e809afb0 con 0x7f37e8131dd0 2023-10-03T10:13:55.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.174+0000 7f37ece89700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e80a0970 con 0x7f37e809e950 2023-10-03T10:13:55.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.174+0000 7f37ece89700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37e80a0320 con 0x7f37e809f260 2023-10-03T10:13:55.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.174+0000 7f37e659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f37e809e950 0x7f37e809ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.174+0000 7f37e6d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f37e8131dd0 0x7f37e8138ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45668/0 (socket says 172.21.15.146:45668) 2023-10-03T10:13:55.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.174+0000 7f37e6d9d700 1 -- 172.21.15.146:0/2922042728 learned_addr learned my addr 172.21.15.146:0/2922042728 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:55.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.174+0000 7f37e5d9b700 1 --2- 172.21.15.146:0/2922042728 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37e809f260 0x7f37e8131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.174+0000 7f37e659c700 1 -- 172.21.15.146:0/2922042728 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37e809f260 msgr2=0x7f37e8131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:55.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.174+0000 7f37e659c700 1 --2- 172.21.15.146:0/2922042728 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37e809f260 0x7f37e8131890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.174+0000 7f37e659c700 1 -- 172.21.15.146:0/2922042728 >> v1:172.21.15.146:6789/0 conn(0x7f37e8131dd0 legacy=0x7f37e8138ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.174+0000 7f37e659c700 1 -- 172.21.15.146:0/2922042728 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e80a0750 con 0x7f37e809e950 2023-10-03T10:13:55.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.175+0000 7f37e659c700 1 --2- 172.21.15.146:0/2922042728 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37e809e950 0x7f37e809ed20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f37d8009820 tx=0x7f37d8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50004b1f468b83c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:55.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.175+0000 7f37e559a700 1 -- 172.21.15.146:0/2922042728 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d8005e30 con 0x7f37e809e950 2023-10-03T10:13:55.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.175+0000 7f37e559a700 1 -- 172.21.15.146:0/2922042728 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d8006030 con 0x7f37e809e950 2023-10-03T10:13:55.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.175+0000 7f37e559a700 1 -- 172.21.15.146:0/2922042728 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d80063c0 con 0x7f37e809e950 2023-10-03T10:13:55.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.176+0000 7f37ece89700 1 -- 172.21.15.146:0/2922042728 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37e809e950 msgr2=0x7f37e809ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.176+0000 7f37ece89700 1 --2- 172.21.15.146:0/2922042728 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37e809e950 0x7f37e809ed20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f37d8009820 tx=0x7f37d8009b30 comp rx=0 tx=0).stop 2023-10-03T10:13:55.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.176+0000 7f37ece89700 1 -- 172.21.15.146:0/2922042728 shutdown_connections 2023-10-03T10:13:55.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.176+0000 7f37ece89700 1 --2- 172.21.15.146:0/2922042728 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37e809e950 0x7f37e809ed20 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.176+0000 7f37ece89700 1 --2- 172.21.15.146:0/2922042728 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37e809f260 0x7f37e8131890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.176+0000 7f37ece89700 1 -- 172.21.15.146:0/2922042728 >> 172.21.15.146:0/2922042728 conn(0x7f37e80a0f70 msgr2=0x7f37e80a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:55.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.176+0000 7f37ece89700 1 -- 172.21.15.146:0/2922042728 shutdown_connections 2023-10-03T10:13:55.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.176+0000 7f37ece89700 1 -- 172.21.15.146:0/2922042728 wait complete. 2023-10-03T10:13:55.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.177+0000 7f37ece89700 1 Processor -- start 2023-10-03T10:13:55.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.177+0000 7f37ece89700 1 -- start start 2023-10-03T10:13:55.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.178+0000 7f37ece89700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37e809e950 0x7f37e8135660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.178+0000 7f37ece89700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37e809f260 0x7f37e8135ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.178+0000 7f37ece89700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37e8131dd0 0x7f37e81360e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.178+0000 7f37ece89700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e8138f80 con 0x7f37e809f260 2023-10-03T10:13:55.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.178+0000 7f37ece89700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e8139180 con 0x7f37e809e950 2023-10-03T10:13:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.178+0000 7f37ece89700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37e813a0a0 con 0x7f37e8131dd0 2023-10-03T10:13:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.178+0000 7f37e6d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37e8131dd0 0x7f37e81360e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.178+0000 7f37e6d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37e8131dd0 0x7f37e81360e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36202/0 (socket says 172.21.15.146:36202) 2023-10-03T10:13:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.178+0000 7f37e6d9d700 1 -- 172.21.15.146:0/1436358586 learned_addr learned my addr 172.21.15.146:0/1436358586 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.178+0000 7f37e5d9b700 1 --2- 172.21.15.146:0/1436358586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37e809f260 0x7f37e8135ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.178+0000 7f37e659c700 1 --2- 172.21.15.146:0/1436358586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37e809e950 0x7f37e8135660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.178+0000 7f37e6d9d700 1 -- 172.21.15.146:0/1436358586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37e809e950 msgr2=0x7f37e8135660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.178+0000 7f37e6d9d700 1 --2- 172.21.15.146:0/1436358586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37e809e950 0x7f37e8135660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.178+0000 7f37e6d9d700 1 -- 172.21.15.146:0/1436358586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37e809f260 msgr2=0x7f37e8135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.178+0000 7f37e6d9d700 1 --2- 172.21.15.146:0/1436358586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37e809f260 0x7f37e8135ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.178+0000 7f37e6d9d700 1 -- 172.21.15.146:0/1436358586 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d8009430 con 0x7f37e8131dd0 2023-10-03T10:13:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.179+0000 7f37e5d9b700 1 --2- 172.21.15.146:0/1436358586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37e809f260 0x7f37e8135ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.179+0000 7f37e6d9d700 1 --2- 172.21.15.146:0/1436358586 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37e8131dd0 0x7f37e81360e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f37e000cbc0 tx=0x7f37e000ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:55.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.179+0000 7f37d6ffd700 1 -- 172.21.15.146:0/1436358586 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e000a9e0 con 0x7f37e8131dd0 2023-10-03T10:13:55.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.179+0000 7f37d6ffd700 1 -- 172.21.15.146:0/1436358586 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e000ab40 con 0x7f37e8131dd0 2023-10-03T10:13:55.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.179+0000 7f37ece89700 1 -- 172.21.15.146:0/1436358586 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e809d5d0 con 0x7f37e8131dd0 2023-10-03T10:13:55.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.179+0000 7f37d6ffd700 1 -- 172.21.15.146:0/1436358586 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e0012400 con 0x7f37e8131dd0 2023-10-03T10:13:55.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.179+0000 7f37ece89700 1 -- 172.21.15.146:0/1436358586 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e809da90 con 0x7f37e8131dd0 2023-10-03T10:13:55.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.180+0000 7f37d6ffd700 1 -- 172.21.15.146:0/1436358586 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f37e001b3b0 con 0x7f37e8131dd0 2023-10-03T10:13:55.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.180+0000 7f37ece89700 1 -- 172.21.15.146:0/1436358586 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e8139ec0 con 0x7f37e8131dd0 2023-10-03T10:13:55.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.180+0000 7f37d6ffd700 1 -- 172.21.15.146:0/1436358586 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f37e003f300 con 0x7f37e8131dd0 2023-10-03T10:13:55.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.189+0000 7f37d6ffd700 1 -- 172.21.15.146:0/1436358586 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f37e0017020 con 0x7f37e8131dd0 2023-10-03T10:13:55.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.192+0000 7facd02e0700 1 -- 172.21.15.146:0/3701496606 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7facc804f2a0 con 0x7facc8131d70 2023-10-03T10:13:55.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.192+0000 7facbeffd700 1 -- 172.21.15.146:0/3701496606 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7facc00074e0 con 0x7facc8131d70 2023-10-03T10:13:55.192 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:55.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.195+0000 7facd02e0700 1 -- 172.21.15.146:0/3701496606 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facc8131d70 msgr2=0x7facc8122010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.195+0000 7facd02e0700 1 --2- 172.21.15.146:0/3701496606 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facc8131d70 0x7facc8122010 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7facc000cbe0 tx=0x7facc000cef0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.195+0000 7facd02e0700 1 -- 172.21.15.146:0/3701496606 shutdown_connections 2023-10-03T10:13:55.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.195+0000 7facd02e0700 1 --2- 172.21.15.146:0/3701496606 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7facc8131d70 0x7facc8122010 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.195+0000 7facd02e0700 1 --2- 172.21.15.146:0/3701496606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facc809e870 0x7facc8121590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.195+0000 7facd02e0700 1 --2- 172.21.15.146:0/3701496606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facc809f180 0x7facc8121ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.195+0000 7facd02e0700 1 -- 172.21.15.146:0/3701496606 >> 172.21.15.146:0/3701496606 conn(0x7facc80a4430 msgr2=0x7facc806f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:55.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.195+0000 7facd02e0700 1 -- 172.21.15.146:0/3701496606 shutdown_connections 2023-10-03T10:13:55.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.195+0000 7facd02e0700 1 -- 172.21.15.146:0/3701496606 wait complete. 2023-10-03T10:13:55.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:55.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.349+0000 7f6a96a11700 1 -- 172.21.15.146:0/3482333154 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6a9004f2a0 con 0x7f6a9009e340 2023-10-03T10:13:55.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.349+0000 7f6a8cff9700 1 -- 172.21.15.146:0/3482333154 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a8401c970 con 0x7f6a9009e340 2023-10-03T10:13:55.350 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:55.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.351+0000 7f6a96a11700 1 -- 172.21.15.146:0/3482333154 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a9009e340 msgr2=0x7f6a901344a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.351+0000 7f6a96a11700 1 --2- 172.21.15.146:0/3482333154 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a9009e340 0x7f6a901344a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400e8e0 tx=0x7f6a8400ebf0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.351+0000 7f6a96a11700 1 -- 172.21.15.146:0/3482333154 shutdown_connections 2023-10-03T10:13:55.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.351+0000 7f6a96a11700 1 --2- 172.21.15.146:0/3482333154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a90135f20 0x7f6a901349e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.351+0000 7f6a96a11700 1 --2- 172.21.15.146:0/3482333154 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a9009d860 0x7f6a90133f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.352+0000 7f6a96a11700 1 --2- 172.21.15.146:0/3482333154 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a9009e340 0x7f6a901344a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.352+0000 7f6a96a11700 1 -- 172.21.15.146:0/3482333154 >> 172.21.15.146:0/3482333154 conn(0x7f6a90099c40 msgr2=0x7f6a900a1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:55.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.352+0000 7f6a96a11700 1 -- 172.21.15.146:0/3482333154 shutdown_connections 2023-10-03T10:13:55.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.352+0000 7f6a96a11700 1 -- 172.21.15.146:0/3482333154 wait complete. 2023-10-03T10:13:55.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.358+0000 7f3cbbc30700 1 -- 172.21.15.146:0/1235376208 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3cb404f2a0 con 0x7f3cb4133d80 2023-10-03T10:13:55.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.358+0000 7f3caa7fc700 1 -- 172.21.15.146:0/1235376208 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3cac01bb00 con 0x7f3cb4133d80 2023-10-03T10:13:55.358 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:55.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.360+0000 7f3cbbc30700 1 -- 172.21.15.146:0/1235376208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb4133d80 msgr2=0x7f3cb411b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.360+0000 7f3cbbc30700 1 --2- 172.21.15.146:0/1235376208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb4133d80 0x7f3cb411b520 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3cac007e40 tx=0x7f3cac00e3c0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.360+0000 7f3cbbc30700 1 -- 172.21.15.146:0/1235376208 shutdown_connections 2023-10-03T10:13:55.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.360+0000 7f3cbbc30700 1 --2- 172.21.15.146:0/1235376208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb4133d80 0x7f3cb411b520 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.360+0000 7f3cbbc30700 1 --2- 172.21.15.146:0/1235376208 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb409dea0 0x7f3cb411aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.360+0000 7f3cbbc30700 1 --2- 172.21.15.146:0/1235376208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb4134f00 0x7f3cb411afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.360+0000 7f3cbbc30700 1 -- 172.21.15.146:0/1235376208 >> 172.21.15.146:0/1235376208 conn(0x7f3cb4099c40 msgr2=0x7f3cb409c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:55.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.360+0000 7f3cbbc30700 1 -- 172.21.15.146:0/1235376208 shutdown_connections 2023-10-03T10:13:55.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.360+0000 7f3cbbc30700 1 -- 172.21.15.146:0/1235376208 wait complete. 2023-10-03T10:13:55.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:55.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:55.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.395+0000 7f37ece89700 1 -- 172.21.15.146:0/1436358586 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f37e804f2a0 con 0x7f37e8131dd0 2023-10-03T10:13:55.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.395+0000 7f37d6ffd700 1 -- 172.21.15.146:0/1436358586 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f37e0017020 con 0x7f37e8131dd0 2023-10-03T10:13:55.395 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:55.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.397+0000 7f37ece89700 1 -- 172.21.15.146:0/1436358586 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37e8131dd0 msgr2=0x7f37e81360e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.397+0000 7f37ece89700 1 --2- 172.21.15.146:0/1436358586 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37e8131dd0 0x7f37e81360e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f37e000cbc0 tx=0x7f37e000ced0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.397+0000 7f37ece89700 1 -- 172.21.15.146:0/1436358586 shutdown_connections 2023-10-03T10:13:55.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.397+0000 7f37ece89700 1 --2- 172.21.15.146:0/1436358586 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37e8131dd0 0x7f37e81360e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.397+0000 7f37ece89700 1 --2- 172.21.15.146:0/1436358586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37e809e950 0x7f37e8135660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.397+0000 7f37ece89700 1 --2- 172.21.15.146:0/1436358586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37e809f260 0x7f37e8135ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.397+0000 7f37ece89700 1 -- 172.21.15.146:0/1436358586 >> 172.21.15.146:0/1436358586 conn(0x7f37e80a0f70 msgr2=0x7f37e813a550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:55.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.398+0000 7f37ece89700 1 -- 172.21.15.146:0/1436358586 shutdown_connections 2023-10-03T10:13:55.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:55.398+0000 7f37ece89700 1 -- 172.21.15.146:0/1436358586 wait complete. 2023-10-03T10:13:55.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:56.214 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:56.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.339+0000 7fd3dfb29700 1 Processor -- start 2023-10-03T10:13:56.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.339+0000 7fd3dfb29700 1 -- start start 2023-10-03T10:13:56.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.340+0000 7fd3dfb29700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd3d8133ad0 0x7fd3d8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.340+0000 7fd3dfb29700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3d8130bc0 0x7fd3d813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.340+0000 7fd3dfb29700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d806b2d0 con 0x7fd3d81300a0 2023-10-03T10:13:56.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.340+0000 7fd3dfb29700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d8133610 con 0x7fd3d8133ad0 2023-10-03T10:13:56.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.340+0000 7fd3dfb29700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d809a500 con 0x7fd3d8130bc0 2023-10-03T10:13:56.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.340+0000 7fd3dd8c5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd3d8133ad0 0x7fd3d8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.340+0000 7fd3de0c6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3d8130bc0 0x7fd3d813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.340+0000 7fd3dd0c4700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd3d81300a0 0x7fd3d81304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45670/0 (socket says 172.21.15.146:45670) 2023-10-03T10:13:56.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.340+0000 7fd3dd0c4700 1 -- 172.21.15.146:0/3715022868 learned_addr learned my addr 172.21.15.146:0/3715022868 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:56.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.340+0000 7fd3dd8c5700 1 -- 172.21.15.146:0/3715022868 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3d8130bc0 msgr2=0x7fd3d813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:56.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.340+0000 7fd3dd8c5700 1 --2- 172.21.15.146:0/3715022868 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3d8130bc0 0x7fd3d813b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.340+0000 7fd3dd8c5700 1 -- 172.21.15.146:0/3715022868 >> v1:172.21.15.146:6789/0 conn(0x7fd3d81300a0 legacy=0x7fd3d81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.340+0000 7fd3dc8c3700 1 -- 172.21.15.146:0/3715022868 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950498450 0 0) 0x7fd3d806b2d0 con 0x7fd3d81300a0 2023-10-03T10:13:56.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.340+0000 7fd3dd8c5700 1 -- 172.21.15.146:0/3715022868 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d81338b0 con 0x7fd3d8133ad0 2023-10-03T10:13:56.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.340+0000 7fd3de0c6700 1 --2- 172.21.15.146:0/3715022868 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3d8130bc0 0x7fd3d813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:56.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.340+0000 7fd3dd8c5700 1 --2- 172.21.15.146:0/3715022868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3d8133ad0 0x7fd3d8133ea0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4009840 tx=0x7fd3d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b12a0d1fbaea22f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.341+0000 7fd3dc8c3700 1 -- 172.21.15.146:0/3715022868 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d4011830 con 0x7fd3d8133ad0 2023-10-03T10:13:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.341+0000 7fd3dc8c3700 1 -- 172.21.15.146:0/3715022868 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d4011990 con 0x7fd3d8133ad0 2023-10-03T10:13:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.341+0000 7fd3dc8c3700 1 -- 172.21.15.146:0/3715022868 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d4011d20 con 0x7fd3d8133ad0 2023-10-03T10:13:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.341+0000 7fd3dfb29700 1 -- 172.21.15.146:0/3715022868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3d8133ad0 msgr2=0x7fd3d8133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.341+0000 7fd3dfb29700 1 --2- 172.21.15.146:0/3715022868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3d8133ad0 0x7fd3d8133ea0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4009840 tx=0x7fd3d4009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.341+0000 7fd3dfb29700 1 -- 172.21.15.146:0/3715022868 shutdown_connections 2023-10-03T10:13:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.341+0000 7fd3dfb29700 1 --2- 172.21.15.146:0/3715022868 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3d8130bc0 0x7fd3d813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.341+0000 7fd3dfb29700 1 --2- 172.21.15.146:0/3715022868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3d8133ad0 0x7fd3d8133ea0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.341+0000 7fd3dfb29700 1 -- 172.21.15.146:0/3715022868 >> 172.21.15.146:0/3715022868 conn(0x7fd3d8099c40 msgr2=0x7fd3d80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.341+0000 7fd3dfb29700 1 -- 172.21.15.146:0/3715022868 shutdown_connections 2023-10-03T10:13:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.341+0000 7fd3dfb29700 1 -- 172.21.15.146:0/3715022868 wait complete. 2023-10-03T10:13:56.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.342+0000 7fd3dfb29700 1 Processor -- start 2023-10-03T10:13:56.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.342+0000 7fd3dfb29700 1 -- start start 2023-10-03T10:13:56.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3dfb29700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3d81300a0 0x7fd3d811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3dfb29700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3d8130bc0 0x7fd3d811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3dfb29700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3d8133ad0 0x7fd3d811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3dfb29700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d811fd00 con 0x7fd3d8133ad0 2023-10-03T10:13:56.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3dfb29700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d812dd00 con 0x7fd3d8130bc0 2023-10-03T10:13:56.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3dfb29700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d80720a0 con 0x7fd3d81300a0 2023-10-03T10:13:56.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3dd8c5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3d81300a0 0x7fd3d811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3dd0c4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3d8130bc0 0x7fd3d811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3de0c6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3d8133ad0 0x7fd3d811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3dd8c5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3d81300a0 0x7fd3d811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36214/0 (socket says 172.21.15.146:36214) 2023-10-03T10:13:56.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3dd8c5700 1 -- 172.21.15.146:0/1772528402 learned_addr learned my addr 172.21.15.146:0/1772528402 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:56.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3dd8c5700 1 -- 172.21.15.146:0/1772528402 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3d8130bc0 msgr2=0x7fd3d811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3dd8c5700 1 --2- 172.21.15.146:0/1772528402 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3d8130bc0 0x7fd3d811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3dd8c5700 1 -- 172.21.15.146:0/1772528402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3d8133ad0 msgr2=0x7fd3d811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3dd8c5700 1 --2- 172.21.15.146:0/1772528402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3d8133ad0 0x7fd3d811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3dd8c5700 1 -- 172.21.15.146:0/1772528402 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d0009a70 con 0x7fd3d81300a0 2023-10-03T10:13:56.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3de0c6700 1 --2- 172.21.15.146:0/1772528402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3d8133ad0 0x7fd3d811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:56.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3dd8c5700 1 --2- 172.21.15.146:0/1772528402 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3d81300a0 0x7fd3d811da40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40090b0 tx=0x7fd3d4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3ce7fc700 1 -- 172.21.15.146:0/1772528402 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40043c0 con 0x7fd3d81300a0 2023-10-03T10:13:56.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3ce7fc700 1 -- 172.21.15.146:0/1772528402 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d401f070 con 0x7fd3d81300a0 2023-10-03T10:13:56.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3dfb29700 1 -- 172.21.15.146:0/1772528402 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d40094a0 con 0x7fd3d81300a0 2023-10-03T10:13:56.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3ce7fc700 1 -- 172.21.15.146:0/1772528402 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40036a0 con 0x7fd3d81300a0 2023-10-03T10:13:56.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.343+0000 7fd3dfb29700 1 -- 172.21.15.146:0/1772528402 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d811ffe0 con 0x7fd3d81300a0 2023-10-03T10:13:56.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.344+0000 7fd3ce7fc700 1 -- 172.21.15.146:0/1772528402 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd3d4021030 con 0x7fd3d81300a0 2023-10-03T10:13:56.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.344+0000 7fd3ce7fc700 1 -- 172.21.15.146:0/1772528402 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd3d40407e0 con 0x7fd3d81300a0 2023-10-03T10:13:56.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.344+0000 7fd3dfb29700 1 -- 172.21.15.146:0/1772528402 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d809cb20 con 0x7fd3d81300a0 2023-10-03T10:13:56.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.349+0000 7fd3ce7fc700 1 -- 172.21.15.146:0/1772528402 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3d40199a0 con 0x7fd3d81300a0 2023-10-03T10:13:56.365 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:56.373 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:56.410 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:56.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.508+0000 7fa68d2e1700 1 Processor -- start 2023-10-03T10:13:56.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.508+0000 7fa68d2e1700 1 -- start start 2023-10-03T10:13:56.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.508+0000 7fa68d2e1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa688131980 0x7fa688131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.508+0000 7fa68d2e1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa68809bc70 0x7fa68809c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.508+0000 7fa68d2e1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa68809c5c0 0x7fa688138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.508+0000 7fa68d2e1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68806eb30 con 0x7fa688131980 2023-10-03T10:13:56.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.509+0000 7fa68d2e1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6880a1640 con 0x7fa68809bc70 2023-10-03T10:13:56.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.509+0000 7fa68d2e1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6880a22d0 con 0x7fa68809c5c0 2023-10-03T10:13:56.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.509+0000 7fa686ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa688131980 0x7fa688131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.509+0000 7fa6877fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa68809c5c0 0x7fa688138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.509+0000 7fa6867fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa68809bc70 0x7fa68809c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.509+0000 7fa686ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa688131980 0x7fa688131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37438/0 (socket says 172.21.15.146:37438) 2023-10-03T10:13:56.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.509+0000 7fa686ffd700 1 -- 172.21.15.146:0/2674317455 learned_addr learned my addr 172.21.15.146:0/2674317455 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:56.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.509+0000 7fa6877fe700 1 -- 172.21.15.146:0/2674317455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa68809bc70 msgr2=0x7fa68809c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:56.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.509+0000 7fa6877fe700 1 --2- 172.21.15.146:0/2674317455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa68809bc70 0x7fa68809c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.509+0000 7fa6877fe700 1 -- 172.21.15.146:0/2674317455 >> v2:172.21.15.146:3300/0 conn(0x7fa688131980 msgr2=0x7fa688131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:56.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.509+0000 7fa6877fe700 1 --2- 172.21.15.146:0/2674317455 >> v2:172.21.15.146:3300/0 conn(0x7fa688131980 0x7fa688131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.509+0000 7fa6877fe700 1 -- 172.21.15.146:0/2674317455 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa688131550 con 0x7fa68809c5c0 2023-10-03T10:13:56.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.509+0000 7fa6877fe700 1 --2- 172.21.15.146:0/2674317455 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa68809c5c0 0x7fa688138700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa68000f3a0 tx=0x7fa68000f6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e35ecb14bb55ecc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.509+0000 7fa685ffb700 1 -- 172.21.15.146:0/2674317455 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa680012070 con 0x7fa68809c5c0 2023-10-03T10:13:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.509+0000 7fa685ffb700 1 -- 172.21.15.146:0/2674317455 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68000fe60 con 0x7fa68809c5c0 2023-10-03T10:13:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.510+0000 7fa685ffb700 1 -- 172.21.15.146:0/2674317455 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68000d310 con 0x7fa68809c5c0 2023-10-03T10:13:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.510+0000 7fa68d2e1700 1 -- 172.21.15.146:0/2674317455 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa68809c5c0 msgr2=0x7fa688138700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.510+0000 7fa68d2e1700 1 --2- 172.21.15.146:0/2674317455 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa68809c5c0 0x7fa688138700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa68000f3a0 tx=0x7fa68000f6b0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.510+0000 7fa68d2e1700 1 -- 172.21.15.146:0/2674317455 shutdown_connections 2023-10-03T10:13:56.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.510+0000 7fa68d2e1700 1 --2- 172.21.15.146:0/2674317455 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa68809c5c0 0x7fa688138700 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.510+0000 7fa68d2e1700 1 --2- 172.21.15.146:0/2674317455 >> v2:172.21.15.146:3300/0 conn(0x7fa688131980 0x7fa688131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.510+0000 7fa68d2e1700 1 --2- 172.21.15.146:0/2674317455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa68809bc70 0x7fa68809c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.510+0000 7fa68d2e1700 1 -- 172.21.15.146:0/2674317455 >> 172.21.15.146:0/2674317455 conn(0x7fa6880a2980 msgr2=0x7fa6880a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.511+0000 7fa68d2e1700 1 -- 172.21.15.146:0/2674317455 shutdown_connections 2023-10-03T10:13:56.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.511+0000 7fa68d2e1700 1 -- 172.21.15.146:0/2674317455 wait complete. 2023-10-03T10:13:56.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.512+0000 7fa68d2e1700 1 Processor -- start 2023-10-03T10:13:56.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.512+0000 7fa68d2e1700 1 -- start start 2023-10-03T10:13:56.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.513+0000 7fa68d2e1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa68809bc70 0x7fa68811b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.513+0000 7fa68d2e1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa68809c5c0 0x7fa68811be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.513+0000 7fa68d2e1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa688131980 0x7fa68811c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.513+0000 7fa68d2e1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68811ce00 con 0x7fa688131980 2023-10-03T10:13:56.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.513+0000 7fa68d2e1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68812ed20 con 0x7fa68809c5c0 2023-10-03T10:13:56.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.513+0000 7fa68d2e1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa68811db60 con 0x7fa68809bc70 2023-10-03T10:13:56.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.513+0000 7fa6867fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa68809c5c0 0x7fa68811be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.513+0000 7fa686ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa68809bc70 0x7fa68811b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.513+0000 7fa6867fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa68809c5c0 0x7fa68811be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38558/0 (socket says 172.21.15.146:38558) 2023-10-03T10:13:56.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.513+0000 7fa6867fc700 1 -- 172.21.15.146:0/1510635232 learned_addr learned my addr 172.21.15.146:0/1510635232 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:56.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.513+0000 7fa6877fe700 1 --2- 172.21.15.146:0/1510635232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa688131980 0x7fa68811c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.513+0000 7fa6867fc700 1 -- 172.21.15.146:0/1510635232 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa68809bc70 msgr2=0x7fa68811b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.513+0000 7fa6867fc700 1 --2- 172.21.15.146:0/1510635232 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa68809bc70 0x7fa68811b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.513+0000 7fa6867fc700 1 -- 172.21.15.146:0/1510635232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa688131980 msgr2=0x7fa68811c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.513+0000 7fa6867fc700 1 --2- 172.21.15.146:0/1510635232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa688131980 0x7fa68811c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.513+0000 7fa6867fc700 1 -- 172.21.15.146:0/1510635232 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68000f050 con 0x7fa68809c5c0 2023-10-03T10:13:56.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.514+0000 7fa6867fc700 1 --2- 172.21.15.146:0/1510635232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa68809c5c0 0x7fa68811be70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00e930 tx=0x7fa67c00ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.514+0000 7fa66f7fe700 1 -- 172.21.15.146:0/1510635232 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c013680 con 0x7fa68809c5c0 2023-10-03T10:13:56.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.514+0000 7fa66f7fe700 1 -- 172.21.15.146:0/1510635232 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c0137e0 con 0x7fa68809c5c0 2023-10-03T10:13:56.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.514+0000 7fa68d2e1700 1 -- 172.21.15.146:0/1510635232 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68811e790 con 0x7fa68809c5c0 2023-10-03T10:13:56.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.514+0000 7fa66f7fe700 1 -- 172.21.15.146:0/1510635232 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c013b50 con 0x7fa68809c5c0 2023-10-03T10:13:56.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.514+0000 7fa68d2e1700 1 -- 172.21.15.146:0/1510635232 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa688130e80 con 0x7fa68809c5c0 2023-10-03T10:13:56.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.515+0000 7fa66f7fe700 1 -- 172.21.15.146:0/1510635232 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa67c013cb0 con 0x7fa68809c5c0 2023-10-03T10:13:56.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.515+0000 7fa66f7fe700 1 -- 172.21.15.146:0/1510635232 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa67c03f600 con 0x7fa68809c5c0 2023-10-03T10:13:56.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.515+0000 7fa68d2e1700 1 -- 172.21.15.146:0/1510635232 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6880716f0 con 0x7fa68809c5c0 2023-10-03T10:13:56.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.524+0000 7fa66f7fe700 1 -- 172.21.15.146:0/1510635232 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa67c021080 con 0x7fa68809c5c0 2023-10-03T10:13:56.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.545+0000 7f5792695700 1 Processor -- start 2023-10-03T10:13:56.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.545+0000 7f5792695700 1 -- start start 2023-10-03T10:13:56.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.545+0000 7f4bbdc13700 1 Processor -- start 2023-10-03T10:13:56.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.545+0000 7f4bbdc13700 1 -- start start 2023-10-03T10:13:56.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.545+0000 7f5792695700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f578c09e870 0x7f578c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.545+0000 7f5792695700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f578c09f180 0x7f578c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.545+0000 7f5792695700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f578c09c970 con 0x7f578c131d70 2023-10-03T10:13:56.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.545+0000 7f5792695700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f578c0a0920 con 0x7f578c09f180 2023-10-03T10:13:56.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.545+0000 7f5792695700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c09f9c0 con 0x7f578c09e870 2023-10-03T10:13:56.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.545+0000 7f5790c32700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f578c131d70 0x7f578c138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45672/0 (socket says 172.21.15.146:45672) 2023-10-03T10:13:56.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.545+0000 7f5790c32700 1 -- 172.21.15.146:0/3220451115 learned_addr learned my addr 172.21.15.146:0/3220451115 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:56.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.545+0000 7f4bbdc13700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bb8099e20 0x7f4bb809a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.546+0000 7f578bfff700 1 --2- 172.21.15.146:0/3220451115 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f578c09e870 0x7f578c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.546+0000 7f4bbdc13700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bb8130a60 0x7f4bb8138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.546+0000 7f4bbdc13700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb8099a60 con 0x7f4bb809a730 2023-10-03T10:13:56.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.546+0000 7f4bbdc13700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb809bf50 con 0x7f4bb8099e20 2023-10-03T10:13:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.546+0000 7f4bbdc13700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb809b230 con 0x7f4bb8130a60 2023-10-03T10:13:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.546+0000 7f578b7fe700 1 --2- 172.21.15.146:0/3220451115 >> v2:172.21.15.146:3300/0 conn(0x7f578c09f180 0x7f578c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.546+0000 7f578affd700 1 -- 172.21.15.146:0/3220451115 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1441304899 0 0) 0x7f578c09c970 con 0x7f578c131d70 2023-10-03T10:13:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.546+0000 7f578affd700 1 -- 172.21.15.146:0/3220451115 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57740035b0 con 0x7f578c131d70 2023-10-03T10:13:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.546+0000 7f4bb6ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4bb809a730 0x7f4bb8130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45676/0 (socket says 172.21.15.146:45676) 2023-10-03T10:13:56.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.546+0000 7f4bb6ffd700 1 -- 172.21.15.146:0/1838732732 learned_addr learned my addr 172.21.15.146:0/1838732732 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:56.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.546+0000 7f578b7fe700 1 -- 172.21.15.146:0/3220451115 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f578c09e870 msgr2=0x7f578c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:56.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.546+0000 7f578b7fe700 1 --2- 172.21.15.146:0/3220451115 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f578c09e870 0x7f578c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.546+0000 7f578b7fe700 1 -- 172.21.15.146:0/3220451115 >> v1:172.21.15.146:6789/0 conn(0x7f578c131d70 legacy=0x7f578c138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.546+0000 7f578b7fe700 1 -- 172.21.15.146:0/3220451115 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c09bab0 con 0x7f578c09f180 2023-10-03T10:13:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.546+0000 7f578bfff700 1 --2- 172.21.15.146:0/3220451115 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f578c09e870 0x7f578c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.546+0000 7f4bb77fe700 1 --2- 172.21.15.146:0/1838732732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bb8099e20 0x7f4bb809a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.546+0000 7f4bb67fc700 1 -- 172.21.15.146:0/1838732732 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 725910924 0 0) 0x7f4bb8099a60 con 0x7f4bb809a730 2023-10-03T10:13:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.546+0000 7f4bb67fc700 1 -- 172.21.15.146:0/1838732732 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ba00035b0 con 0x7f4bb809a730 2023-10-03T10:13:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.546+0000 7f578b7fe700 1 --2- 172.21.15.146:0/3220451115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f578c09f180 0x7f578c131830 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5780009840 tx=0x7f5780009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0191dd8218ad9d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.546+0000 7f4bb77fe700 1 -- 172.21.15.146:0/1838732732 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bb8130a60 msgr2=0x7f4bb8138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.546+0000 7f4bb77fe700 1 --2- 172.21.15.146:0/1838732732 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bb8130a60 0x7f4bb8138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.546+0000 7f4bb67fc700 1 -- 172.21.15.146:0/1838732732 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 904236236 0 0) 0x7f4ba00035b0 con 0x7f4bb809a730 2023-10-03T10:13:56.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.547+0000 7f578affd700 1 -- 172.21.15.146:0/3220451115 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5780011830 con 0x7f578c09f180 2023-10-03T10:13:56.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.547+0000 7f578affd700 1 -- 172.21.15.146:0/3220451115 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5780011990 con 0x7f578c09f180 2023-10-03T10:13:56.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.547+0000 7f578affd700 1 -- 172.21.15.146:0/3220451115 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5780011d20 con 0x7f578c09f180 2023-10-03T10:13:56.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.547+0000 7f4bb77fe700 1 -- 172.21.15.146:0/1838732732 >> v1:172.21.15.146:6789/0 conn(0x7f4bb809a730 legacy=0x7f4bb8130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.547+0000 7f4bb77fe700 1 -- 172.21.15.146:0/1838732732 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb809bb90 con 0x7f4bb8099e20 2023-10-03T10:13:56.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.547+0000 7f4bb77fe700 1 --2- 172.21.15.146:0/1838732732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bb8099e20 0x7f4bb809a1f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4bac009850 tx=0x7f4bac009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faf7ac8748e5093c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.547+0000 7f4bb67fc700 1 -- 172.21.15.146:0/1838732732 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8001670 con 0x7f4bb8099e20 2023-10-03T10:13:56.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.547+0000 7f4bb67fc700 1 -- 172.21.15.146:0/1838732732 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bac005c30 con 0x7f4bb8099e20 2023-10-03T10:13:56.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.547+0000 7f4bb67fc700 1 -- 172.21.15.146:0/1838732732 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac004030 con 0x7f4bb8099e20 2023-10-03T10:13:56.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.547+0000 7f5792695700 1 -- 172.21.15.146:0/3220451115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f578c09f180 msgr2=0x7f578c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.547+0000 7f5792695700 1 --2- 172.21.15.146:0/3220451115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f578c09f180 0x7f578c131830 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5780009840 tx=0x7f5780009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:56.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.548+0000 7f4bbdc13700 1 -- 172.21.15.146:0/1838732732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bb8099e20 msgr2=0x7f4bb809a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.548+0000 7f4bbdc13700 1 --2- 172.21.15.146:0/1838732732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bb8099e20 0x7f4bb809a1f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4bac009850 tx=0x7f4bac009b60 comp rx=0 tx=0).stop 2023-10-03T10:13:56.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.548+0000 7f5792695700 1 -- 172.21.15.146:0/3220451115 shutdown_connections 2023-10-03T10:13:56.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.548+0000 7f5792695700 1 --2- 172.21.15.146:0/3220451115 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f578c09e870 0x7f578c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.548+0000 7f5792695700 1 --2- 172.21.15.146:0/3220451115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f578c09f180 0x7f578c131830 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.548+0000 7f5792695700 1 -- 172.21.15.146:0/3220451115 >> 172.21.15.146:0/3220451115 conn(0x7f578c0a4430 msgr2=0x7f578c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.548+0000 7f4bbdc13700 1 -- 172.21.15.146:0/1838732732 shutdown_connections 2023-10-03T10:13:56.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.548+0000 7f4bbdc13700 1 --2- 172.21.15.146:0/1838732732 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bb8130a60 0x7f4bb8138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.548+0000 7f4bbdc13700 1 --2- 172.21.15.146:0/1838732732 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bb8099e20 0x7f4bb809a1f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.548+0000 7f4bbdc13700 1 -- 172.21.15.146:0/1838732732 >> 172.21.15.146:0/1838732732 conn(0x7f4bb80a2980 msgr2=0x7f4bb80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.548+0000 7f5792695700 1 -- 172.21.15.146:0/3220451115 shutdown_connections 2023-10-03T10:13:56.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.548+0000 7f5792695700 1 -- 172.21.15.146:0/3220451115 wait complete. 2023-10-03T10:13:56.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.548+0000 7f4bbdc13700 1 -- 172.21.15.146:0/1838732732 shutdown_connections 2023-10-03T10:13:56.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.548+0000 7f4bbdc13700 1 -- 172.21.15.146:0/1838732732 wait complete. 2023-10-03T10:13:56.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.549+0000 7f4bbdc13700 1 Processor -- start 2023-10-03T10:13:56.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.549+0000 7f4bbdc13700 1 -- start start 2023-10-03T10:13:56.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.549+0000 7f5792695700 1 Processor -- start 2023-10-03T10:13:56.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.549+0000 7f4bbdc13700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bb8099e20 0x7f4bb811a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.549+0000 7f4bbdc13700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bb809a730 0x7f4bb811ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.549+0000 7f4bbdc13700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bb8130a60 0x7f4bb811b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.549+0000 7f4bbdc13700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb809b470 con 0x7f4bb8099e20 2023-10-03T10:13:56.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.549+0000 7f4bbdc13700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb811e130 con 0x7f4bb809a730 2023-10-03T10:13:56.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.549+0000 7f4bbdc13700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb811c2c0 con 0x7f4bb8130a60 2023-10-03T10:13:56.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.549+0000 7f4bb77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bb8099e20 0x7f4bb811a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.549+0000 7f4bb77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bb8099e20 0x7f4bb811a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37464/0 (socket says 172.21.15.146:37464) 2023-10-03T10:13:56.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.549+0000 7f4bb77fe700 1 -- 172.21.15.146:0/3420867980 learned_addr learned my addr 172.21.15.146:0/3420867980 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:56.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.550+0000 7f5792695700 1 -- start start 2023-10-03T10:13:56.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.550+0000 7f4bb6ffd700 1 --2- 172.21.15.146:0/3420867980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bb809a730 0x7f4bb811ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.550+0000 7f4bb7fff700 1 --2- 172.21.15.146:0/3420867980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bb8130a60 0x7f4bb811b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.550+0000 7f4bb77fe700 1 -- 172.21.15.146:0/3420867980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bb8130a60 msgr2=0x7f4bb811b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.550+0000 7f4bb77fe700 1 --2- 172.21.15.146:0/3420867980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bb8130a60 0x7f4bb811b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.550+0000 7f4bb77fe700 1 -- 172.21.15.146:0/3420867980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bb809a730 msgr2=0x7f4bb811ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.550+0000 7f4bb77fe700 1 --2- 172.21.15.146:0/3420867980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bb809a730 0x7f4bb811ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.550+0000 7f4bb77fe700 1 -- 172.21.15.146:0/3420867980 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac009430 con 0x7f4bb8099e20 2023-10-03T10:13:56.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.550+0000 7f4bb6ffd700 1 --2- 172.21.15.146:0/3420867980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bb809a730 0x7f4bb811ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:56.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.550+0000 7f5792695700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f578c09e870 0x7f578c11d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.550+0000 7f5792695700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f578c09f180 0x7f578c11d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.550+0000 7f5792695700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f578c131d70 0x7f578c11db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.550+0000 7f5792695700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578c1318a0 con 0x7f578c09f180 2023-10-03T10:13:56.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.550+0000 7f5792695700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c11edb0 con 0x7f578c09e870 2023-10-03T10:13:56.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.550+0000 7f5792695700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f578c11fe80 con 0x7f578c131d70 2023-10-03T10:13:56.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.550+0000 7f578bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f578c09e870 0x7f578c11d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.550+0000 7f578bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f578c09e870 0x7f578c11d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38582/0 (socket says 172.21.15.146:38582) 2023-10-03T10:13:56.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.550+0000 7f578bfff700 1 -- 172.21.15.146:0/1780901912 learned_addr learned my addr 172.21.15.146:0/1780901912 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:56.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.550+0000 7f5790c32700 1 --2- 172.21.15.146:0/1780901912 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f578c131d70 0x7f578c11db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.551+0000 7f578b7fe700 1 --2- 172.21.15.146:0/1780901912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f578c09f180 0x7f578c11d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.551+0000 7f578bfff700 1 -- 172.21.15.146:0/1780901912 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f578c131d70 msgr2=0x7f578c11db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.551+0000 7f578bfff700 1 --2- 172.21.15.146:0/1780901912 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f578c131d70 0x7f578c11db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.551+0000 7f578bfff700 1 -- 172.21.15.146:0/1780901912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f578c09f180 msgr2=0x7f578c11d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.551+0000 7f578bfff700 1 --2- 172.21.15.146:0/1780901912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f578c09f180 0x7f578c11d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.551+0000 7f578bfff700 1 -- 172.21.15.146:0/1780901912 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577c0094a0 con 0x7f578c09e870 2023-10-03T10:13:56.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.551+0000 7f4bb77fe700 1 --2- 172.21.15.146:0/3420867980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bb8099e20 0x7f4bb811a610 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80a2630 tx=0x7f4bac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.551+0000 7f578bfff700 1 --2- 172.21.15.146:0/1780901912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f578c09e870 0x7f578c11d0c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f577c00ec10 tx=0x7f577c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.551+0000 7f5788ff9700 1 -- 172.21.15.146:0/1780901912 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c00c850 con 0x7f578c09e870 2023-10-03T10:13:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.551+0000 7f5788ff9700 1 -- 172.21.15.146:0/1780901912 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c00c9b0 con 0x7f578c09e870 2023-10-03T10:13:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.551+0000 7f5788ff9700 1 -- 172.21.15.146:0/1780901912 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c00cd40 con 0x7f578c09e870 2023-10-03T10:13:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.552+0000 7f5792695700 1 -- 172.21.15.146:0/1780901912 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57800094a0 con 0x7f578c09e870 2023-10-03T10:13:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.552+0000 7f5792695700 1 -- 172.21.15.146:0/1780901912 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f578c120860 con 0x7f578c09e870 2023-10-03T10:13:56.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.551+0000 7f4b9ffff700 1 -- 172.21.15.146:0/3420867980 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac003dd0 con 0x7f4bb8099e20 2023-10-03T10:13:56.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.551+0000 7f4b9ffff700 1 -- 172.21.15.146:0/3420867980 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bac011420 con 0x7f4bb8099e20 2023-10-03T10:13:56.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.551+0000 7f4b9ffff700 1 -- 172.21.15.146:0/3420867980 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0117d0 con 0x7f4bb8099e20 2023-10-03T10:13:56.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.551+0000 7f4bbdc13700 1 -- 172.21.15.146:0/3420867980 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb811d4e0 con 0x7f4bb8099e20 2023-10-03T10:13:56.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.551+0000 7f4bbdc13700 1 -- 172.21.15.146:0/3420867980 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb811d020 con 0x7f4bb8099e20 2023-10-03T10:13:56.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.552+0000 7f4b9ffff700 1 -- 172.21.15.146:0/3420867980 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4bac011930 con 0x7f4bb8099e20 2023-10-03T10:13:56.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.552+0000 7f4bbdc13700 1 -- 172.21.15.146:0/3420867980 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb811ddb0 con 0x7f4bb8099e20 2023-10-03T10:13:56.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.553+0000 7f4b9ffff700 1 -- 172.21.15.146:0/3420867980 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4bac041240 con 0x7f4bb8099e20 2023-10-03T10:13:56.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.553+0000 7f5792695700 1 -- 172.21.15.146:0/1780901912 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f578c09dba0 con 0x7f578c09e870 2023-10-03T10:13:56.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.554+0000 7f5788ff9700 1 -- 172.21.15.146:0/1780901912 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f577c013470 con 0x7f578c09e870 2023-10-03T10:13:56.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.554+0000 7f5788ff9700 1 -- 172.21.15.146:0/1780901912 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f577c040110 con 0x7f578c09e870 2023-10-03T10:13:56.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.558+0000 7f4b9ffff700 1 -- 172.21.15.146:0/3420867980 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4bac011be0 con 0x7f4bb8099e20 2023-10-03T10:13:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.558+0000 7f5788ff9700 1 -- 172.21.15.146:0/1780901912 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f577c013720 con 0x7f578c09e870 2023-10-03T10:13:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.598+0000 7fd3dfb29700 1 -- 172.21.15.146:0/1772528402 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd3d804f2a0 con 0x7fd3d81300a0 2023-10-03T10:13:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.598+0000 7fd3ce7fc700 1 -- 172.21.15.146:0/1772528402 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd3d4015020 con 0x7fd3d81300a0 2023-10-03T10:13:56.827 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:56.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.601+0000 7fd3dfb29700 1 -- 172.21.15.146:0/1772528402 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3d81300a0 msgr2=0x7fd3d811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.601+0000 7fd3dfb29700 1 --2- 172.21.15.146:0/1772528402 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3d81300a0 0x7fd3d811da40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40090b0 tx=0x7fd3d4004750 comp rx=0 tx=0).stop 2023-10-03T10:13:56.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.601+0000 7fd3dfb29700 1 -- 172.21.15.146:0/1772528402 shutdown_connections 2023-10-03T10:13:56.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.601+0000 7fd3dfb29700 1 --2- 172.21.15.146:0/1772528402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3d8133ad0 0x7fd3d811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.601+0000 7fd3dfb29700 1 --2- 172.21.15.146:0/1772528402 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3d81300a0 0x7fd3d811da40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.601+0000 7fd3dfb29700 1 --2- 172.21.15.146:0/1772528402 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3d8130bc0 0x7fd3d811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.601+0000 7fd3dfb29700 1 -- 172.21.15.146:0/1772528402 >> 172.21.15.146:0/1772528402 conn(0x7fd3d8099c40 msgr2=0x7fd3d8132bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.601+0000 7fd3dfb29700 1 -- 172.21.15.146:0/1772528402 shutdown_connections 2023-10-03T10:13:56.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.601+0000 7fd3dfb29700 1 -- 172.21.15.146:0/1772528402 wait complete. 2023-10-03T10:13:56.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:56.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.753+0000 7f5792695700 1 -- 172.21.15.146:0/1780901912 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f578c04f2a0 con 0x7f578c09e870 2023-10-03T10:13:56.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.753+0000 7f5788ff9700 1 -- 172.21.15.146:0/1780901912 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f577c017090 con 0x7f578c09e870 2023-10-03T10:13:56.830 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:56.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.755+0000 7f5792695700 1 -- 172.21.15.146:0/1780901912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f578c09e870 msgr2=0x7f578c11d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.755+0000 7f5792695700 1 --2- 172.21.15.146:0/1780901912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f578c09e870 0x7f578c11d0c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f577c00ec10 tx=0x7f577c00ef20 comp rx=0 tx=0).stop 2023-10-03T10:13:56.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.755+0000 7f5792695700 1 -- 172.21.15.146:0/1780901912 shutdown_connections 2023-10-03T10:13:56.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.755+0000 7f5792695700 1 --2- 172.21.15.146:0/1780901912 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f578c131d70 0x7f578c11db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.755+0000 7f5792695700 1 --2- 172.21.15.146:0/1780901912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f578c09e870 0x7f578c11d0c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.755+0000 7f5792695700 1 --2- 172.21.15.146:0/1780901912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f578c09f180 0x7f578c11d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.755+0000 7f5792695700 1 -- 172.21.15.146:0/1780901912 >> 172.21.15.146:0/1780901912 conn(0x7f578c0a4430 msgr2=0x7f578c09c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.755+0000 7f5792695700 1 -- 172.21.15.146:0/1780901912 shutdown_connections 2023-10-03T10:13:56.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.755+0000 7f5792695700 1 -- 172.21.15.146:0/1780901912 wait complete. 2023-10-03T10:13:56.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.756+0000 7f4bbdc13700 1 -- 172.21.15.146:0/3420867980 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4bb804f2a0 con 0x7f4bb8099e20 2023-10-03T10:13:56.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.756+0000 7f4b9ffff700 1 -- 172.21.15.146:0/3420867980 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4bac02c020 con 0x7f4bb8099e20 2023-10-03T10:13:56.833 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:56.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.758+0000 7f4bbdc13700 1 -- 172.21.15.146:0/3420867980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bb8099e20 msgr2=0x7f4bb811a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.758+0000 7f4bbdc13700 1 --2- 172.21.15.146:0/3420867980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bb8099e20 0x7f4bb811a610 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80a2630 tx=0x7f4bac004750 comp rx=0 tx=0).stop 2023-10-03T10:13:56.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.759+0000 7f4bbdc13700 1 -- 172.21.15.146:0/3420867980 shutdown_connections 2023-10-03T10:13:56.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.759+0000 7f4bbdc13700 1 --2- 172.21.15.146:0/3420867980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bb8130a60 0x7f4bb811b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.759+0000 7f4bbdc13700 1 --2- 172.21.15.146:0/3420867980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bb8099e20 0x7f4bb811a610 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.759+0000 7f4bbdc13700 1 --2- 172.21.15.146:0/3420867980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bb809a730 0x7f4bb811ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.759+0000 7f4bbdc13700 1 -- 172.21.15.146:0/3420867980 >> 172.21.15.146:0/3420867980 conn(0x7f4bb80a2980 msgr2=0x7f4bb81b89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.759+0000 7f4bbdc13700 1 -- 172.21.15.146:0/3420867980 shutdown_connections 2023-10-03T10:13:56.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.759+0000 7f4bbdc13700 1 -- 172.21.15.146:0/3420867980 wait complete. 2023-10-03T10:13:56.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.760+0000 7fa68d2e1700 1 -- 172.21.15.146:0/1510635232 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa6881324c0 con 0x7fa68809c5c0 2023-10-03T10:13:56.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.761+0000 7fa66f7fe700 1 -- 172.21.15.146:0/1510635232 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa67c00c970 con 0x7fa68809c5c0 2023-10-03T10:13:56.835 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:56.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.764+0000 7fa68d2e1700 1 -- 172.21.15.146:0/1510635232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa68809c5c0 msgr2=0x7fa68811be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.764+0000 7fa68d2e1700 1 --2- 172.21.15.146:0/1510635232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa68809c5c0 0x7fa68811be70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00e930 tx=0x7fa67c00ec40 comp rx=0 tx=0).stop 2023-10-03T10:13:56.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.764+0000 7fa68d2e1700 1 -- 172.21.15.146:0/1510635232 shutdown_connections 2023-10-03T10:13:56.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.764+0000 7fa68d2e1700 1 --2- 172.21.15.146:0/1510635232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa688131980 0x7fa68811c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.764+0000 7fa68d2e1700 1 --2- 172.21.15.146:0/1510635232 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa68809bc70 0x7fa68811b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.764+0000 7fa68d2e1700 1 --2- 172.21.15.146:0/1510635232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa68809c5c0 0x7fa68811be70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.764+0000 7fa68d2e1700 1 -- 172.21.15.146:0/1510635232 >> 172.21.15.146:0/1510635232 conn(0x7fa6880a2980 msgr2=0x7fa68809f300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.764+0000 7fa68d2e1700 1 -- 172.21.15.146:0/1510635232 shutdown_connections 2023-10-03T10:13:56.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:56.764+0000 7fa68d2e1700 1 -- 172.21.15.146:0/1510635232 wait complete. 2023-10-03T10:13:56.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:56.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:56.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:57.830 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:57.839 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:57.839 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:57.839 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:57.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.979+0000 7f85f22de700 1 Processor -- start 2023-10-03T10:13:57.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.979+0000 7f85f22de700 1 -- start start 2023-10-03T10:13:57.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.979+0000 7f85f22de700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85ec131980 0x7f85ec131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.979+0000 7f85f22de700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f85ec09bc70 0x7f85ec09c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.979+0000 7f85f22de700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85ec09c5c0 0x7f85ec138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.980+0000 7f85f22de700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ec06eb30 con 0x7f85ec09bc70 2023-10-03T10:13:57.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.980+0000 7f85f22de700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0a1640 con 0x7f85ec131980 2023-10-03T10:13:57.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.980+0000 7f85f22de700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec0a22d0 con 0x7f85ec09c5c0 2023-10-03T10:13:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.980+0000 7f85eb7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f85ec09bc70 0x7f85ec09c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.980+0000 7f85eb7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f85ec09bc70 0x7f85ec09c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37486/0 (socket says 172.21.15.146:37486) 2023-10-03T10:13:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.980+0000 7f85eb7fe700 1 -- 172.21.15.146:0/1245709552 learned_addr learned my addr 172.21.15.146:0/1245709552 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.980+0000 7f85ebfff700 1 --2- 172.21.15.146:0/1245709552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85ec131980 0x7f85ec131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.980+0000 7f85f087b700 1 --2- 172.21.15.146:0/1245709552 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85ec09c5c0 0x7f85ec138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.980+0000 7f85eb7fe700 1 -- 172.21.15.146:0/1245709552 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85ec09c5c0 msgr2=0x7f85ec138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.980+0000 7f85eb7fe700 1 --2- 172.21.15.146:0/1245709552 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85ec09c5c0 0x7f85ec138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.980+0000 7f85eb7fe700 1 -- 172.21.15.146:0/1245709552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85ec131980 msgr2=0x7f85ec131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.980+0000 7f85eb7fe700 1 --2- 172.21.15.146:0/1245709552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85ec131980 0x7f85ec131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.980+0000 7f85eb7fe700 1 -- 172.21.15.146:0/1245709552 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ec131550 con 0x7f85ec09bc70 2023-10-03T10:13:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.980+0000 7f85f087b700 1 --2- 172.21.15.146:0/1245709552 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85ec09c5c0 0x7f85ec138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.980+0000 7f85ebfff700 1 --2- 172.21.15.146:0/1245709552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85ec131980 0x7f85ec131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.981+0000 7f85eb7fe700 1 --2- 172.21.15.146:0/1245709552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85ec09bc70 0x7f85ec09c080 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009920 tx=0x7f85e0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9033fc384943391 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.981+0000 7f85eaffd700 1 -- 172.21.15.146:0/1245709552 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0011830 con 0x7f85ec09bc70 2023-10-03T10:13:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.981+0000 7f85eaffd700 1 -- 172.21.15.146:0/1245709552 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e0011990 con 0x7f85ec09bc70 2023-10-03T10:13:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.981+0000 7f85eaffd700 1 -- 172.21.15.146:0/1245709552 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0011d20 con 0x7f85ec09bc70 2023-10-03T10:13:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.981+0000 7f85f22de700 1 -- 172.21.15.146:0/1245709552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85ec09bc70 msgr2=0x7f85ec09c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.981+0000 7f85f22de700 1 --2- 172.21.15.146:0/1245709552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85ec09bc70 0x7f85ec09c080 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009920 tx=0x7f85e0009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.982+0000 7f85f22de700 1 -- 172.21.15.146:0/1245709552 shutdown_connections 2023-10-03T10:13:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.982+0000 7f85f22de700 1 --2- 172.21.15.146:0/1245709552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85ec131980 0x7f85ec131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.982+0000 7f85f22de700 1 --2- 172.21.15.146:0/1245709552 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85ec09c5c0 0x7f85ec138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.982+0000 7f85f22de700 1 --2- 172.21.15.146:0/1245709552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85ec09bc70 0x7f85ec09c080 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.982+0000 7f85f22de700 1 -- 172.21.15.146:0/1245709552 >> 172.21.15.146:0/1245709552 conn(0x7f85ec0a2980 msgr2=0x7f85ec0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.982+0000 7f85f22de700 1 -- 172.21.15.146:0/1245709552 shutdown_connections 2023-10-03T10:13:57.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.982+0000 7f85f22de700 1 -- 172.21.15.146:0/1245709552 wait complete. 2023-10-03T10:13:57.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.983+0000 7f85f22de700 1 Processor -- start 2023-10-03T10:13:57.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.983+0000 7f85f22de700 1 -- start start 2023-10-03T10:13:57.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.984+0000 7f85f22de700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85ec09bc70 0x7f85ec099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.984+0000 7f85f22de700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85ec09c5c0 0x7f85ec099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.984+0000 7f85f22de700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85ec131980 0x7f85ec09a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.984+0000 7f85f22de700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec122e10 con 0x7f85ec09bc70 2023-10-03T10:13:57.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.984+0000 7f85f22de700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec123190 con 0x7f85ec131980 2023-10-03T10:13:57.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.984+0000 7f85f22de700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec130f10 con 0x7f85ec09c5c0 2023-10-03T10:13:57.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.984+0000 7f85ebfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85ec09bc70 0x7f85ec099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.984+0000 7f85ebfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85ec09bc70 0x7f85ec099a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37494/0 (socket says 172.21.15.146:37494) 2023-10-03T10:13:57.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.984+0000 7f85ebfff700 1 -- 172.21.15.146:0/2386183428 learned_addr learned my addr 172.21.15.146:0/2386183428 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:57.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.984+0000 7f85f087b700 1 --2- 172.21.15.146:0/2386183428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85ec131980 0x7f85ec09a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.984+0000 7f85eb7fe700 1 --2- 172.21.15.146:0/2386183428 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85ec09c5c0 0x7f85ec099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.984+0000 7f85ebfff700 1 -- 172.21.15.146:0/2386183428 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85ec09c5c0 msgr2=0x7f85ec099fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.984+0000 7f85ebfff700 1 --2- 172.21.15.146:0/2386183428 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85ec09c5c0 0x7f85ec099fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.984+0000 7f85ebfff700 1 -- 172.21.15.146:0/2386183428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85ec131980 msgr2=0x7f85ec09a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.984+0000 7f85ebfff700 1 --2- 172.21.15.146:0/2386183428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85ec131980 0x7f85ec09a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.984+0000 7f85ebfff700 1 -- 172.21.15.146:0/2386183428 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e4009a70 con 0x7f85ec09bc70 2023-10-03T10:13:57.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.985+0000 7f85ebfff700 1 --2- 172.21.15.146:0/2386183428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85ec09bc70 0x7f85ec099a90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f85dc00ebe0 tx=0x7f85dc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.985+0000 7f85e8ff9700 1 -- 172.21.15.146:0/2386183428 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc005a20 con 0x7f85ec09bc70 2023-10-03T10:13:57.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.985+0000 7f85f22de700 1 -- 172.21.15.146:0/2386183428 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85dc009430 con 0x7f85ec09bc70 2023-10-03T10:13:57.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.985+0000 7f85e8ff9700 1 -- 172.21.15.146:0/2386183428 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc005b80 con 0x7f85ec09bc70 2023-10-03T10:13:57.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.985+0000 7f85e8ff9700 1 -- 172.21.15.146:0/2386183428 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc00c850 con 0x7f85ec09bc70 2023-10-03T10:13:57.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.985+0000 7f85f22de700 1 -- 172.21.15.146:0/2386183428 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e0009550 con 0x7f85ec09bc70 2023-10-03T10:13:57.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.986+0000 7f85e8ff9700 1 -- 172.21.15.146:0/2386183428 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f85dc00c9b0 con 0x7f85ec09bc70 2023-10-03T10:13:57.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.986+0000 7f85f22de700 1 -- 172.21.15.146:0/2386183428 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ec04f2a0 con 0x7f85ec09bc70 2023-10-03T10:13:57.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.986+0000 7f85e8ff9700 1 -- 172.21.15.146:0/2386183428 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f85dc03f9b0 con 0x7f85ec09bc70 2023-10-03T10:13:57.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:57.991+0000 7f85e8ff9700 1 -- 172.21.15.146:0/2386183428 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f85dc022300 con 0x7f85ec09bc70 2023-10-03T10:13:58.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.016+0000 7f07538a1700 1 Processor -- start 2023-10-03T10:13:58.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.016+0000 7fc0acb0a700 1 Processor -- start 2023-10-03T10:13:58.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.016+0000 7fc0acb0a700 1 -- start start 2023-10-03T10:13:58.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.017+0000 7f07538a1700 1 -- start start 2023-10-03T10:13:58.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.017+0000 7f6f9b03a700 1 Processor -- start 2023-10-03T10:13:58.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.017+0000 7f6f9b03a700 1 -- start start 2023-10-03T10:13:58.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.017+0000 7fc0acb0a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a809e870 0x7fc0a809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.017+0000 7fc0acb0a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a8131f40 0x7fc0a8139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.017+0000 7fc0acb0a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a809c970 con 0x7fc0a809f180 2023-10-03T10:13:58.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.017+0000 7fc0acb0a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a80a0920 con 0x7fc0a8131f40 2023-10-03T10:13:58.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.017+0000 7fc0acb0a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a809f9c0 con 0x7fc0a809e870 2023-10-03T10:13:58.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.017+0000 7f07538a1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c09f350 0x7f074c138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.017+0000 7f07538a1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1393a0 0x7f074c13b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.017+0000 7f07538a1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074c09fa00 con 0x7f074c09e870 2023-10-03T10:13:58.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7f07538a1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c0a0370 con 0x7f074c1393a0 2023-10-03T10:13:58.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7f07538a1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f074c06bec0 con 0x7f074c09f350 2023-10-03T10:13:58.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7f0751e3e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1393a0 0x7f074c13b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7f0751e3e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1393a0 0x7f074c13b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38618/0 (socket says 172.21.15.146:38618) 2023-10-03T10:13:58.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7f0751e3e700 1 -- 172.21.15.146:0/3048367274 learned_addr learned my addr 172.21.15.146:0/3048367274 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:58.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.017+0000 7fc0a659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a809e870 0x7fc0a809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.017+0000 7fc0a6d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a8131f40 0x7fc0a8139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.017+0000 7fc0a659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a809e870 0x7fc0a809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36280/0 (socket says 172.21.15.146:36280) 2023-10-03T10:13:58.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.017+0000 7fc0a659c700 1 -- 172.21.15.146:0/598840223 learned_addr learned my addr 172.21.15.146:0/598840223 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:58.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7fc0a6d9d700 1 -- 172.21.15.146:0/598840223 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a809e870 msgr2=0x7fc0a809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:58.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7fc0a6d9d700 1 --2- 172.21.15.146:0/598840223 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a809e870 0x7fc0a809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7fc0a6d9d700 1 -- 172.21.15.146:0/598840223 >> v1:172.21.15.146:6789/0 conn(0x7fc0a809f180 legacy=0x7fc0a8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:58.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7fc0a6d9d700 1 -- 172.21.15.146:0/598840223 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a809bab0 con 0x7fc0a8131f40 2023-10-03T10:13:58.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7fc0a659c700 1 --2- 172.21.15.146:0/598840223 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a809e870 0x7fc0a809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:58.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7f6f9b03a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f9409e870 0x7f6f9409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7f6f9b03a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6f9409f180 0x7f6f94131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7f6f9b03a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f9409c970 con 0x7f6f94131d70 2023-10-03T10:13:58.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7f6f9b03a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f940a0920 con 0x7f6f9409f180 2023-10-03T10:13:58.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7f6f9b03a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9409f9c0 con 0x7f6f9409e870 2023-10-03T10:13:58.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7f6f995d7700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6f94131d70 0x7f6f94138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45710/0 (socket says 172.21.15.146:45710) 2023-10-03T10:13:58.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7f6f995d7700 1 -- 172.21.15.146:0/3428965431 learned_addr learned my addr 172.21.15.146:0/3428965431 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:58.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7f6f98dd6700 1 --2- 172.21.15.146:0/3428965431 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f9409e870 0x7f6f9409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7f0751e3e700 1 -- 172.21.15.146:0/3048367274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c09f350 msgr2=0x7f074c138e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:13:58.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7f0751e3e700 1 --2- 172.21.15.146:0/3048367274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c09f350 0x7f074c138e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7f0751e3e700 1 -- 172.21.15.146:0/3048367274 >> v1:172.21.15.146:6789/0 conn(0x7f074c09e870 legacy=0x7f074c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7f0751e3e700 1 -- 172.21.15.146:0/3048367274 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c09ada0 con 0x7f074c1393a0 2023-10-03T10:13:58.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7f6f93fff700 1 --2- 172.21.15.146:0/3428965431 >> v2:172.21.15.146:3300/0 conn(0x7f6f9409f180 0x7f6f94131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7fc0a6d9d700 1 --2- 172.21.15.146:0/598840223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a8131f40 0x7fc0a8139ca0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009dc0 tx=0x7fc0a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=feda005439332d7a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7f0751e3e700 1 --2- 172.21.15.146:0/3048367274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1393a0 0x7f074c13b780 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0744009e80 tx=0x7f074400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=915c8634dd6e4af8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.018+0000 7f6f937fe700 1 -- 172.21.15.146:0/3428965431 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816035473 0 0) 0x7f6f9409c970 con 0x7f6f94131d70 2023-10-03T10:13:58.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.019+0000 7f6f98dd6700 1 -- 172.21.15.146:0/3428965431 >> v2:172.21.15.146:3300/0 conn(0x7f6f9409f180 msgr2=0x7f6f94131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:58.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.019+0000 7f6f98dd6700 1 --2- 172.21.15.146:0/3428965431 >> v2:172.21.15.146:3300/0 conn(0x7f6f9409f180 0x7f6f94131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.019+0000 7f6f98dd6700 1 -- 172.21.15.146:0/3428965431 >> v1:172.21.15.146:6789/0 conn(0x7f6f94131d70 legacy=0x7f6f94138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.019+0000 7f6f98dd6700 1 -- 172.21.15.146:0/3428965431 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9409bab0 con 0x7f6f9409e870 2023-10-03T10:13:58.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.019+0000 7f6f93fff700 1 --2- 172.21.15.146:0/3428965431 >> v2:172.21.15.146:3300/0 conn(0x7f6f9409f180 0x7f6f94131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:58.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.019+0000 7f0743fff700 1 -- 172.21.15.146:0/3048367274 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074400e070 con 0x7f074c1393a0 2023-10-03T10:13:58.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.019+0000 7f0743fff700 1 -- 172.21.15.146:0/3048367274 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074400b9c0 con 0x7f074c1393a0 2023-10-03T10:13:58.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.019+0000 7f0743fff700 1 -- 172.21.15.146:0/3048367274 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074400bd70 con 0x7f074c1393a0 2023-10-03T10:13:58.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.019+0000 7f6f98dd6700 1 --2- 172.21.15.146:0/3428965431 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f9409e870 0x7f6f9409ec40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009840 tx=0x7f6f88009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98ede4eff0ed65c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.019+0000 7fc0a559a700 1 -- 172.21.15.146:0/598840223 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a000e070 con 0x7fc0a8131f40 2023-10-03T10:13:58.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.019+0000 7fc0a559a700 1 -- 172.21.15.146:0/598840223 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a000bae0 con 0x7fc0a8131f40 2023-10-03T10:13:58.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.019+0000 7fc0a559a700 1 -- 172.21.15.146:0/598840223 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a000be90 con 0x7fc0a8131f40 2023-10-03T10:13:58.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.019+0000 7f6f937fe700 1 -- 172.21.15.146:0/3428965431 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88011830 con 0x7f6f9409e870 2023-10-03T10:13:58.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.019+0000 7f6f937fe700 1 -- 172.21.15.146:0/3428965431 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f88011990 con 0x7f6f9409e870 2023-10-03T10:13:58.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.019+0000 7f6f937fe700 1 -- 172.21.15.146:0/3428965431 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88011d20 con 0x7f6f9409e870 2023-10-03T10:13:58.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.020+0000 7fc0acb0a700 1 -- 172.21.15.146:0/598840223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a8131f40 msgr2=0x7fc0a8139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.020+0000 7fc0acb0a700 1 --2- 172.21.15.146:0/598840223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a8131f40 0x7fc0a8139ca0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009dc0 tx=0x7fc0a000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:58.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.020+0000 7f07538a1700 1 -- 172.21.15.146:0/3048367274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1393a0 msgr2=0x7f074c13b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.020+0000 7f07538a1700 1 --2- 172.21.15.146:0/3048367274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1393a0 0x7f074c13b780 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0744009e80 tx=0x7f074400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:58.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.020+0000 7fc0acb0a700 1 -- 172.21.15.146:0/598840223 shutdown_connections 2023-10-03T10:13:58.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.020+0000 7fc0acb0a700 1 --2- 172.21.15.146:0/598840223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a8131f40 0x7fc0a8139ca0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.020+0000 7fc0acb0a700 1 --2- 172.21.15.146:0/598840223 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a809e870 0x7fc0a809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.020+0000 7fc0acb0a700 1 -- 172.21.15.146:0/598840223 >> 172.21.15.146:0/598840223 conn(0x7fc0a80a4430 msgr2=0x7fc0a80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.020+0000 7fc0acb0a700 1 -- 172.21.15.146:0/598840223 shutdown_connections 2023-10-03T10:13:58.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.020+0000 7fc0acb0a700 1 -- 172.21.15.146:0/598840223 wait complete. 2023-10-03T10:13:58.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.020+0000 7f6f9b03a700 1 -- 172.21.15.146:0/3428965431 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f9409e870 msgr2=0x7f6f9409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.020+0000 7f6f9b03a700 1 --2- 172.21.15.146:0/3428965431 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f9409e870 0x7f6f9409ec40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009840 tx=0x7f6f88009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:58.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.020+0000 7f6f9b03a700 1 -- 172.21.15.146:0/3428965431 shutdown_connections 2023-10-03T10:13:58.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.020+0000 7f6f9b03a700 1 --2- 172.21.15.146:0/3428965431 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f9409e870 0x7f6f9409ec40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.020+0000 7f6f9b03a700 1 --2- 172.21.15.146:0/3428965431 >> v2:172.21.15.146:3300/0 conn(0x7f6f9409f180 0x7f6f94131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.020+0000 7f6f9b03a700 1 -- 172.21.15.146:0/3428965431 >> 172.21.15.146:0/3428965431 conn(0x7f6f940a4430 msgr2=0x7f6f940a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.020+0000 7f6f9b03a700 1 -- 172.21.15.146:0/3428965431 shutdown_connections 2023-10-03T10:13:58.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.020+0000 7f6f9b03a700 1 -- 172.21.15.146:0/3428965431 wait complete. 2023-10-03T10:13:58.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.021+0000 7f07538a1700 1 -- 172.21.15.146:0/3048367274 shutdown_connections 2023-10-03T10:13:58.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.021+0000 7f07538a1700 1 --2- 172.21.15.146:0/3048367274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1393a0 0x7f074c13b780 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.021+0000 7f07538a1700 1 --2- 172.21.15.146:0/3048367274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c09f350 0x7f074c138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.021+0000 7f07538a1700 1 -- 172.21.15.146:0/3048367274 >> 172.21.15.146:0/3048367274 conn(0x7f074c0a4430 msgr2=0x7f074c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.021+0000 7fc0acb0a700 1 Processor -- start 2023-10-03T10:13:58.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.021+0000 7f6f9b03a700 1 Processor -- start 2023-10-03T10:13:58.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.021+0000 7f07538a1700 1 -- 172.21.15.146:0/3048367274 shutdown_connections 2023-10-03T10:13:58.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.021+0000 7fc0acb0a700 1 -- start start 2023-10-03T10:13:58.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.021+0000 7f6f9b03a700 1 -- start start 2023-10-03T10:13:58.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7f6f9b03a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f9409e870 0x7f6f94126c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7f6f9b03a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9409f180 0x7f6f94127140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7f6f9b03a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f94131d70 0x7f6f941cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7f6f9b03a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f941298b0 con 0x7f6f94131d70 2023-10-03T10:13:58.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7f6f9b03a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f94129a90 con 0x7f6f9409f180 2023-10-03T10:13:58.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7f6f9b03a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f94129fb0 con 0x7f6f9409e870 2023-10-03T10:13:58.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7fc0acb0a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a809e870 0x7fc0a811c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7fc0acb0a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a809f180 0x7fc0a811c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7fc0acb0a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a8131f40 0x7fc0a811cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7fc0acb0a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a811d4e0 con 0x7fc0a809e870 2023-10-03T10:13:58.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7fc0acb0a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a811dc60 con 0x7fc0a8131f40 2023-10-03T10:13:58.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7fc0acb0a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a811e280 con 0x7fc0a809f180 2023-10-03T10:13:58.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7f6f93fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9409f180 0x7f6f94127140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7f6f93fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9409f180 0x7f6f94127140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38628/0 (socket says 172.21.15.146:38628) 2023-10-03T10:13:58.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7f6f93fff700 1 -- 172.21.15.146:0/2569895453 learned_addr learned my addr 172.21.15.146:0/2569895453 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:58.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7fc0a6d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a8131f40 0x7fc0a811cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7fc0a6d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a8131f40 0x7fc0a811cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38630/0 (socket says 172.21.15.146:38630) 2023-10-03T10:13:58.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7fc0a6d9d700 1 -- 172.21.15.146:0/235425665 learned_addr learned my addr 172.21.15.146:0/235425665 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:58.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7fc0a6d9d700 1 -- 172.21.15.146:0/235425665 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a809f180 msgr2=0x7fc0a811c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7fc0a6d9d700 1 --2- 172.21.15.146:0/235425665 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a809f180 0x7fc0a811c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7fc0a6d9d700 1 -- 172.21.15.146:0/235425665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a809e870 msgr2=0x7fc0a811c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7fc0a6d9d700 1 --2- 172.21.15.146:0/235425665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a809e870 0x7fc0a811c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7fc0a6d9d700 1 -- 172.21.15.146:0/235425665 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc098009550 con 0x7fc0a8131f40 2023-10-03T10:13:58.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7f6f93fff700 1 -- 172.21.15.146:0/2569895453 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f9409e870 msgr2=0x7f6f94126c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7f6f93fff700 1 --2- 172.21.15.146:0/2569895453 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f9409e870 0x7f6f94126c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7f6f93fff700 1 -- 172.21.15.146:0/2569895453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f94131d70 msgr2=0x7f6f941cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7f6f93fff700 1 --2- 172.21.15.146:0/2569895453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f94131d70 0x7f6f941cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7f6f93fff700 1 -- 172.21.15.146:0/2569895453 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f800094a0 con 0x7f6f9409f180 2023-10-03T10:13:58.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.023+0000 7fc0a6d9d700 1 --2- 172.21.15.146:0/235425665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a8131f40 0x7fc0a811cad0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000b680 tx=0x7fc0a0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.023+0000 7f6f93fff700 1 --2- 172.21.15.146:0/2569895453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9409f180 0x7f6f94127140 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000ebe0 tx=0x7f6f80009ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.023+0000 7fc096ffd700 1 -- 172.21.15.146:0/235425665 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a00046f0 con 0x7fc0a8131f40 2023-10-03T10:13:58.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.023+0000 7fc096ffd700 1 -- 172.21.15.146:0/235425665 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a0004850 con 0x7fc0a8131f40 2023-10-03T10:13:58.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.023+0000 7fc096ffd700 1 -- 172.21.15.146:0/235425665 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0012670 con 0x7fc0a8131f40 2023-10-03T10:13:58.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.023+0000 7f6f917fa700 1 -- 172.21.15.146:0/2569895453 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8000c8b0 con 0x7f6f9409f180 2023-10-03T10:13:58.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.023+0000 7f6f917fa700 1 -- 172.21.15.146:0/2569895453 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8000ca10 con 0x7f6f9409f180 2023-10-03T10:13:58.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.023+0000 7f6f917fa700 1 -- 172.21.15.146:0/2569895453 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8000cda0 con 0x7f6f9409f180 2023-10-03T10:13:58.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.023+0000 7f6f9b03a700 1 -- 172.21.15.146:0/2569895453 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f880094a0 con 0x7f6f9409f180 2023-10-03T10:13:58.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.023+0000 7f6f9b03a700 1 -- 172.21.15.146:0/2569895453 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f94129220 con 0x7f6f9409f180 2023-10-03T10:13:58.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.022+0000 7f07538a1700 1 -- 172.21.15.146:0/3048367274 wait complete. 2023-10-03T10:13:58.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.024+0000 7fc0acb0a700 1 -- 172.21.15.146:0/235425665 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a0009a70 con 0x7fc0a8131f40 2023-10-03T10:13:58.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.023+0000 7f07538a1700 1 Processor -- start 2023-10-03T10:13:58.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.024+0000 7f07538a1700 1 -- start start 2023-10-03T10:13:58.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.025+0000 7fc0acb0a700 1 -- 172.21.15.146:0/235425665 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a811f8f0 con 0x7fc0a8131f40 2023-10-03T10:13:58.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.025+0000 7f6f9b03a700 1 -- 172.21.15.146:0/2569895453 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9409d400 con 0x7f6f9409f180 2023-10-03T10:13:58.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.025+0000 7f07538a1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c09e870 0x7f074c12a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.025+0000 7f07538a1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c09f350 0x7f074c12af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.025+0000 7f07538a1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1393a0 0x7f074c12f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.025+0000 7f07538a1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c131850 con 0x7f074c09f350 2023-10-03T10:13:58.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.025+0000 7f07538a1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c130860 con 0x7f074c1393a0 2023-10-03T10:13:58.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.025+0000 7f07538a1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f074c130f80 con 0x7f074c09e870 2023-10-03T10:13:58.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.025+0000 7f0750e3c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c09f350 0x7f074c12af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.025+0000 7f075163d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c09e870 0x7f074c12a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.025+0000 7f0750e3c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c09f350 0x7f074c12af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37528/0 (socket says 172.21.15.146:37528) 2023-10-03T10:13:58.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.025+0000 7f0750e3c700 1 -- 172.21.15.146:0/1419681316 learned_addr learned my addr 172.21.15.146:0/1419681316 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:58.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.026+0000 7fc0acb0a700 1 -- 172.21.15.146:0/235425665 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a809dba0 con 0x7fc0a8131f40 2023-10-03T10:13:58.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.025+0000 7f0750e3c700 1 -- 172.21.15.146:0/1419681316 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c09e870 msgr2=0x7f074c12a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.025+0000 7f0750e3c700 1 --2- 172.21.15.146:0/1419681316 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c09e870 0x7f074c12a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.025+0000 7f0750e3c700 1 -- 172.21.15.146:0/1419681316 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1393a0 msgr2=0x7f074c12f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.025+0000 7f0750e3c700 1 --2- 172.21.15.146:0/1419681316 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1393a0 0x7f074c12f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.025+0000 7f0750e3c700 1 -- 172.21.15.146:0/1419681316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0744009b30 con 0x7f074c09f350 2023-10-03T10:13:58.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.026+0000 7f0750e3c700 1 --2- 172.21.15.146:0/1419681316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c09f350 0x7f074c12af30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f073c00b580 tx=0x7f073c00b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.026+0000 7fc096ffd700 1 -- 172.21.15.146:0/235425665 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc0a00127d0 con 0x7fc0a8131f40 2023-10-03T10:13:58.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.026+0000 7f0741ffb700 1 -- 172.21.15.146:0/1419681316 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c011830 con 0x7f074c09f350 2023-10-03T10:13:58.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.026+0000 7fc096ffd700 1 -- 172.21.15.146:0/235425665 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc0a0041700 con 0x7fc0a8131f40 2023-10-03T10:13:58.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.026+0000 7f6f917fa700 1 -- 172.21.15.146:0/2569895453 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f80013470 con 0x7f6f9409f180 2023-10-03T10:13:58.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.026+0000 7f6f917fa700 1 -- 172.21.15.146:0/2569895453 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6f8003ff20 con 0x7f6f9409f180 2023-10-03T10:13:58.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.026+0000 7f0741ffb700 1 -- 172.21.15.146:0/1419681316 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073c0119b0 con 0x7f074c09f350 2023-10-03T10:13:58.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.026+0000 7f07538a1700 1 -- 172.21.15.146:0/1419681316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074c132f00 con 0x7f074c09f350 2023-10-03T10:13:58.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.026+0000 7f07538a1700 1 -- 172.21.15.146:0/1419681316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074c06cfa0 con 0x7f074c09f350 2023-10-03T10:13:58.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.027+0000 7f0741ffb700 1 -- 172.21.15.146:0/1419681316 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c011d60 con 0x7f074c09f350 2023-10-03T10:13:58.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.027+0000 7f0741ffb700 1 -- 172.21.15.146:0/1419681316 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f073c01a400 con 0x7f074c09f350 2023-10-03T10:13:58.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.027+0000 7f0741ffb700 1 -- 172.21.15.146:0/1419681316 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f073c03f6b0 con 0x7f074c09f350 2023-10-03T10:13:58.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.027+0000 7f07538a1700 1 -- 172.21.15.146:0/1419681316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f072c0052e0 con 0x7f074c09f350 2023-10-03T10:13:58.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.032+0000 7f0741ffb700 1 -- 172.21.15.146:0/1419681316 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f073c015020 con 0x7f074c09f350 2023-10-03T10:13:58.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.032+0000 7f6f917fa700 1 -- 172.21.15.146:0/2569895453 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f80013720 con 0x7f6f9409f180 2023-10-03T10:13:58.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.038+0000 7fc096ffd700 1 -- 172.21.15.146:0/235425665 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc0a0008960 con 0x7fc0a8131f40 2023-10-03T10:13:58.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.191+0000 7f85f22de700 1 -- 172.21.15.146:0/2386183428 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f85ec06bce0 con 0x7f85ec09bc70 2023-10-03T10:13:58.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.191+0000 7f85e8ff9700 1 -- 172.21.15.146:0/2386183428 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f85dc020030 con 0x7f85ec09bc70 2023-10-03T10:13:58.191 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:58.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.194+0000 7f85f22de700 1 -- 172.21.15.146:0/2386183428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85ec09bc70 msgr2=0x7f85ec099a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.194+0000 7f85f22de700 1 --2- 172.21.15.146:0/2386183428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85ec09bc70 0x7f85ec099a90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f85dc00ebe0 tx=0x7f85dc00eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.194+0000 7f85f22de700 1 -- 172.21.15.146:0/2386183428 shutdown_connections 2023-10-03T10:13:58.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.194+0000 7f85f22de700 1 --2- 172.21.15.146:0/2386183428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85ec131980 0x7f85ec09a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.194+0000 7f85f22de700 1 --2- 172.21.15.146:0/2386183428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85ec09bc70 0x7f85ec099a90 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.194+0000 7f85f22de700 1 --2- 172.21.15.146:0/2386183428 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85ec09c5c0 0x7f85ec099fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.194+0000 7f85f22de700 1 -- 172.21.15.146:0/2386183428 >> 172.21.15.146:0/2386183428 conn(0x7f85ec0a2980 msgr2=0x7f85ec06ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.194+0000 7f85f22de700 1 -- 172.21.15.146:0/2386183428 shutdown_connections 2023-10-03T10:13:58.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.194+0000 7f85f22de700 1 -- 172.21.15.146:0/2386183428 wait complete. 2023-10-03T10:13:58.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:58.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.228+0000 7f6f9b03a700 1 -- 172.21.15.146:0/2569895453 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6f94129bd0 con 0x7f6f9409f180 2023-10-03T10:13:58.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.229+0000 7f6f917fa700 1 -- 172.21.15.146:0/2569895453 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f94129bd0 con 0x7f6f9409f180 2023-10-03T10:13:58.229 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:58.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.229+0000 7f07538a1700 1 -- 172.21.15.146:0/1419681316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f072c005590 con 0x7f074c09f350 2023-10-03T10:13:58.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.229+0000 7f0741ffb700 1 -- 172.21.15.146:0/1419681316 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f073c029090 con 0x7f074c09f350 2023-10-03T10:13:58.230 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:58.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.231+0000 7f6f9b03a700 1 -- 172.21.15.146:0/2569895453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9409f180 msgr2=0x7f6f94127140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.231+0000 7f6f9b03a700 1 --2- 172.21.15.146:0/2569895453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9409f180 0x7f6f94127140 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000ebe0 tx=0x7f6f80009ea0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.231+0000 7f6f9b03a700 1 -- 172.21.15.146:0/2569895453 shutdown_connections 2023-10-03T10:13:58.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.231+0000 7f6f9b03a700 1 --2- 172.21.15.146:0/2569895453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f94131d70 0x7f6f941cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.231+0000 7f6f9b03a700 1 --2- 172.21.15.146:0/2569895453 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f9409e870 0x7f6f94126c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.231+0000 7f6f9b03a700 1 --2- 172.21.15.146:0/2569895453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9409f180 0x7f6f94127140 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.231+0000 7f6f9b03a700 1 -- 172.21.15.146:0/2569895453 >> 172.21.15.146:0/2569895453 conn(0x7f6f940a4430 msgr2=0x7f6f9406b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.231+0000 7f6f9b03a700 1 -- 172.21.15.146:0/2569895453 shutdown_connections 2023-10-03T10:13:58.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.231+0000 7f6f9b03a700 1 -- 172.21.15.146:0/2569895453 wait complete. 2023-10-03T10:13:58.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.231+0000 7f07538a1700 1 -- 172.21.15.146:0/1419681316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c09f350 msgr2=0x7f074c12af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.231+0000 7f07538a1700 1 --2- 172.21.15.146:0/1419681316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c09f350 0x7f074c12af30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f073c00b580 tx=0x7f073c00b940 comp rx=0 tx=0).stop 2023-10-03T10:13:58.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.232+0000 7f07538a1700 1 -- 172.21.15.146:0/1419681316 shutdown_connections 2023-10-03T10:13:58.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.232+0000 7f07538a1700 1 --2- 172.21.15.146:0/1419681316 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1393a0 0x7f074c12f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.232+0000 7f07538a1700 1 --2- 172.21.15.146:0/1419681316 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c09e870 0x7f074c12a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.232+0000 7f07538a1700 1 --2- 172.21.15.146:0/1419681316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c09f350 0x7f074c12af30 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.232+0000 7f07538a1700 1 -- 172.21.15.146:0/1419681316 >> 172.21.15.146:0/1419681316 conn(0x7f074c0a4430 msgr2=0x7f074c071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.232+0000 7f07538a1700 1 -- 172.21.15.146:0/1419681316 shutdown_connections 2023-10-03T10:13:58.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.232+0000 7f07538a1700 1 -- 172.21.15.146:0/1419681316 wait complete. 2023-10-03T10:13:58.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.234+0000 7fc0acb0a700 1 -- 172.21.15.146:0/235425665 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc0a804f2a0 con 0x7fc0a8131f40 2023-10-03T10:13:58.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.234+0000 7fc096ffd700 1 -- 172.21.15.146:0/235425665 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc0a0008390 con 0x7fc0a8131f40 2023-10-03T10:13:58.234 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:58.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.236+0000 7fc0acb0a700 1 -- 172.21.15.146:0/235425665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a8131f40 msgr2=0x7fc0a811cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.236+0000 7fc0acb0a700 1 --2- 172.21.15.146:0/235425665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a8131f40 0x7fc0a811cad0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000b680 tx=0x7fc0a0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.236+0000 7fc0acb0a700 1 -- 172.21.15.146:0/235425665 shutdown_connections 2023-10-03T10:13:58.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.236+0000 7fc0acb0a700 1 --2- 172.21.15.146:0/235425665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a8131f40 0x7fc0a811cad0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.236+0000 7fc0acb0a700 1 --2- 172.21.15.146:0/235425665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a809e870 0x7fc0a811c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.236+0000 7fc0acb0a700 1 --2- 172.21.15.146:0/235425665 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a809f180 0x7fc0a811c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.236+0000 7fc0acb0a700 1 -- 172.21.15.146:0/235425665 >> 172.21.15.146:0/235425665 conn(0x7fc0a80a4430 msgr2=0x7fc0a8131010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.236+0000 7fc0acb0a700 1 -- 172.21.15.146:0/235425665 shutdown_connections 2023-10-03T10:13:58.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:58.236+0000 7fc0acb0a700 1 -- 172.21.15.146:0/235425665 wait complete. 2023-10-03T10:13:58.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:13:58.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:58.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:59.207 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:59.248 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:59.249 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:59.251 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:59.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.362+0000 7f8105250700 1 Processor -- start 2023-10-03T10:13:59.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.362+0000 7f8105250700 1 -- start start 2023-10-03T10:13:59.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.362+0000 7f8105250700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f810009ad40 0x7f8100133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.362+0000 7f8105250700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8100133f70 0x7f81001343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.362+0000 7f8105250700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81000a0a70 0x7f81000a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.362+0000 7f8105250700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81000a3b60 con 0x7f8100133f70 2023-10-03T10:13:59.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.363+0000 7f8105250700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81001348e0 con 0x7f81000a0a70 2023-10-03T10:13:59.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.363+0000 7f8105250700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f810009b110 con 0x7f810009ad40 2023-10-03T10:13:59.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.363+0000 7f80fed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f810009ad40 0x7f8100133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.363+0000 7f80ff59e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81000a0a70 0x7f81000a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.363+0000 7f80ff59e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81000a0a70 0x7f81000a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38638/0 (socket says 172.21.15.146:38638) 2023-10-03T10:13:59.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.363+0000 7f80fed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f810009ad40 0x7f8100133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36324/0 (socket says 172.21.15.146:36324) 2023-10-03T10:13:59.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.363+0000 7f80ff59e700 1 -- 172.21.15.146:0/2950809401 learned_addr learned my addr 172.21.15.146:0/2950809401 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:59.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.363+0000 7f80fe59c700 1 --2- 172.21.15.146:0/2950809401 >> v2:172.21.15.146:3300/0 conn(0x7f8100133f70 0x7f81001343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.363+0000 7f80fed9d700 1 -- 172.21.15.146:0/2950809401 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81000a0a70 msgr2=0x7f81000a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:59.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.363+0000 7f80fed9d700 1 --2- 172.21.15.146:0/2950809401 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81000a0a70 0x7f81000a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.363+0000 7f80fed9d700 1 -- 172.21.15.146:0/2950809401 >> v2:172.21.15.146:3300/0 conn(0x7f8100133f70 msgr2=0x7f81001343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:59.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.363+0000 7f80fed9d700 1 --2- 172.21.15.146:0/2950809401 >> v2:172.21.15.146:3300/0 conn(0x7f8100133f70 0x7f81001343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.363+0000 7f80fed9d700 1 -- 172.21.15.146:0/2950809401 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81000a2fa0 con 0x7f810009ad40 2023-10-03T10:13:59.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.363+0000 7f80ff59e700 1 --2- 172.21.15.146:0/2950809401 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81000a0a70 0x7f81000a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:59.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.363+0000 7f80fed9d700 1 --2- 172.21.15.146:0/2950809401 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f810009ad40 0x7f8100133a30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f80f0009870 tx=0x7f80f0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e90b0148feda7b48 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:59.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.364+0000 7f80fdd9b700 1 -- 172.21.15.146:0/2950809401 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0011830 con 0x7f810009ad40 2023-10-03T10:13:59.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.364+0000 7f80fdd9b700 1 -- 172.21.15.146:0/2950809401 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f0011990 con 0x7f810009ad40 2023-10-03T10:13:59.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.364+0000 7f80fdd9b700 1 -- 172.21.15.146:0/2950809401 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0011d20 con 0x7f810009ad40 2023-10-03T10:13:59.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.364+0000 7f8105250700 1 -- 172.21.15.146:0/2950809401 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f810009ad40 msgr2=0x7f8100133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.364+0000 7f8105250700 1 --2- 172.21.15.146:0/2950809401 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f810009ad40 0x7f8100133a30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f80f0009870 tx=0x7f80f0009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:59.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.364+0000 7f8105250700 1 -- 172.21.15.146:0/2950809401 shutdown_connections 2023-10-03T10:13:59.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.364+0000 7f8105250700 1 --2- 172.21.15.146:0/2950809401 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81000a0a70 0x7f81000a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.364+0000 7f8105250700 1 --2- 172.21.15.146:0/2950809401 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f810009ad40 0x7f8100133a30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.364+0000 7f8105250700 1 --2- 172.21.15.146:0/2950809401 >> v2:172.21.15.146:3300/0 conn(0x7f8100133f70 0x7f81001343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.364+0000 7f8105250700 1 -- 172.21.15.146:0/2950809401 >> 172.21.15.146:0/2950809401 conn(0x7f8100099c40 msgr2=0x7f810006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:59.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.364+0000 7f8105250700 1 -- 172.21.15.146:0/2950809401 shutdown_connections 2023-10-03T10:13:59.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.364+0000 7f8105250700 1 -- 172.21.15.146:0/2950809401 wait complete. 2023-10-03T10:13:59.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.366+0000 7f8105250700 1 Processor -- start 2023-10-03T10:13:59.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.366+0000 7f8105250700 1 -- start start 2023-10-03T10:13:59.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.366+0000 7f8105250700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f810009ad40 0x7f8100122520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.366+0000 7f8105250700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81000a0a70 0x7f8100122a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.366+0000 7f8105250700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8100133f70 0x7f8100122fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.366+0000 7f8105250700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8100125f60 con 0x7f8100133f70 2023-10-03T10:13:59.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.366+0000 7f8105250700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8100124ee0 con 0x7f81000a0a70 2023-10-03T10:13:59.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.366+0000 7f8105250700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8100133810 con 0x7f810009ad40 2023-10-03T10:13:59.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.366+0000 7f80fed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f810009ad40 0x7f8100122520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.366+0000 7f80fe59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81000a0a70 0x7f8100122a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.366+0000 7f80fed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f810009ad40 0x7f8100122520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36326/0 (socket says 172.21.15.146:36326) 2023-10-03T10:13:59.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.366+0000 7f80ff59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8100133f70 0x7f8100122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.366+0000 7f80fed9d700 1 -- 172.21.15.146:0/1958337665 learned_addr learned my addr 172.21.15.146:0/1958337665 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:59.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.367+0000 7f80fed9d700 1 -- 172.21.15.146:0/1958337665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81000a0a70 msgr2=0x7f8100122a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.367+0000 7f80fed9d700 1 --2- 172.21.15.146:0/1958337665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81000a0a70 0x7f8100122a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.367+0000 7f80fed9d700 1 -- 172.21.15.146:0/1958337665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8100133f70 msgr2=0x7f8100122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.367+0000 7f80fed9d700 1 --2- 172.21.15.146:0/1958337665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8100133f70 0x7f8100122fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.367+0000 7f80fed9d700 1 -- 172.21.15.146:0/1958337665 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f8009b30 con 0x7f810009ad40 2023-10-03T10:13:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.367+0000 7f80fe59c700 1 --2- 172.21.15.146:0/1958337665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81000a0a70 0x7f8100122a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.367+0000 7f80ff59e700 1 --2- 172.21.15.146:0/1958337665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8100133f70 0x7f8100122fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.367+0000 7f80fed9d700 1 --2- 172.21.15.146:0/1958337665 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f810009ad40 0x7f8100122520 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f80f00097c0 tx=0x7f80f0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.367+0000 7f80e77fe700 1 -- 172.21.15.146:0/1958337665 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0004450 con 0x7f810009ad40 2023-10-03T10:13:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.367+0000 7f80e77fe700 1 -- 172.21.15.146:0/1958337665 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f001e070 con 0x7f810009ad40 2023-10-03T10:13:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.367+0000 7f80e77fe700 1 -- 172.21.15.146:0/1958337665 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f00038e0 con 0x7f810009ad40 2023-10-03T10:13:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.367+0000 7f8105250700 1 -- 172.21.15.146:0/1958337665 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f00094a0 con 0x7f810009ad40 2023-10-03T10:13:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.368+0000 7f8105250700 1 -- 172.21.15.146:0/1958337665 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81001252a0 con 0x7f810009ad40 2023-10-03T10:13:59.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.369+0000 7f8105250700 1 -- 172.21.15.146:0/1958337665 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810004f2a0 con 0x7f810009ad40 2023-10-03T10:13:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.372+0000 7f80e77fe700 1 -- 172.21.15.146:0/1958337665 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f80f0003a40 con 0x7f810009ad40 2023-10-03T10:13:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.372+0000 7f80e77fe700 1 -- 172.21.15.146:0/1958337665 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f80f0040860 con 0x7f810009ad40 2023-10-03T10:13:59.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.379+0000 7f80e77fe700 1 -- 172.21.15.146:0/1958337665 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f80f002d450 con 0x7f810009ad40 2023-10-03T10:13:59.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.389+0000 7ff27f5c6700 1 Processor -- start 2023-10-03T10:13:59.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.389+0000 7ff27f5c6700 1 -- start start 2023-10-03T10:13:59.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.390+0000 7ff27f5c6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff278066410 0x7ff2781319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.390+0000 7ff27f5c6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff278131f30 0x7ff27809c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.390+0000 7ff27f5c6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2780a0f20 con 0x7ff2781314b0 2023-10-03T10:13:59.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.390+0000 7ff27f5c6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2780667e0 con 0x7ff278131f30 2023-10-03T10:13:59.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.390+0000 7ff27f5c6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2780a23c0 con 0x7ff278066410 2023-10-03T10:13:59.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.390+0000 7ff27cb61700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff2781314b0 0x7ff27809bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45722/0 (socket says 172.21.15.146:45722) 2023-10-03T10:13:59.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.390+0000 7ff27cb61700 1 -- 172.21.15.146:0/2392506497 learned_addr learned my addr 172.21.15.146:0/2392506497 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:13:59.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.390+0000 7ff27d362700 1 --2- 172.21.15.146:0/2392506497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff278066410 0x7ff2781319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.390+0000 7ff27db63700 1 --2- 172.21.15.146:0/2392506497 >> v2:172.21.15.146:3300/0 conn(0x7ff278131f30 0x7ff27809c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.390+0000 7ff26ffff700 1 -- 172.21.15.146:0/2392506497 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006891730 0 0) 0x7ff2780a0f20 con 0x7ff2781314b0 2023-10-03T10:13:59.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.390+0000 7ff26ffff700 1 -- 172.21.15.146:0/2392506497 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2640035b0 con 0x7ff2781314b0 2023-10-03T10:13:59.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.391+0000 7ff27db63700 1 -- 172.21.15.146:0/2392506497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff278066410 msgr2=0x7ff2781319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:59.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.391+0000 7ff27db63700 1 --2- 172.21.15.146:0/2392506497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff278066410 0x7ff2781319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.391+0000 7ff27db63700 1 -- 172.21.15.146:0/2392506497 >> v1:172.21.15.146:6789/0 conn(0x7ff2781314b0 legacy=0x7ff27809bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.391+0000 7ff27db63700 1 -- 172.21.15.146:0/2392506497 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2780a16e0 con 0x7ff278131f30 2023-10-03T10:13:59.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.391+0000 7ff27db63700 1 --2- 172.21.15.146:0/2392506497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff278131f30 0x7ff27809c380 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff270009dc0 tx=0x7ff27000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b563ec5290da3b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:59.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.391+0000 7ff26ffff700 1 -- 172.21.15.146:0/2392506497 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27000e070 con 0x7ff278131f30 2023-10-03T10:13:59.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.391+0000 7ff26ffff700 1 -- 172.21.15.146:0/2392506497 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27000bae0 con 0x7ff278131f30 2023-10-03T10:13:59.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.391+0000 7ff26ffff700 1 -- 172.21.15.146:0/2392506497 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27000be90 con 0x7ff278131f30 2023-10-03T10:13:59.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.392+0000 7ff27f5c6700 1 -- 172.21.15.146:0/2392506497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff278131f30 msgr2=0x7ff27809c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.392+0000 7ff27f5c6700 1 --2- 172.21.15.146:0/2392506497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff278131f30 0x7ff27809c380 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff270009dc0 tx=0x7ff27000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:59.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.393+0000 7ff27f5c6700 1 -- 172.21.15.146:0/2392506497 shutdown_connections 2023-10-03T10:13:59.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.393+0000 7ff27f5c6700 1 --2- 172.21.15.146:0/2392506497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff278131f30 0x7ff27809c380 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.393+0000 7ff27f5c6700 1 --2- 172.21.15.146:0/2392506497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff278066410 0x7ff2781319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.393+0000 7ff27f5c6700 1 -- 172.21.15.146:0/2392506497 >> 172.21.15.146:0/2392506497 conn(0x7ff2780a2980 msgr2=0x7ff2780a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:59.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.396+0000 7ff27f5c6700 1 -- 172.21.15.146:0/2392506497 shutdown_connections 2023-10-03T10:13:59.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.396+0000 7ff27f5c6700 1 -- 172.21.15.146:0/2392506497 wait complete. 2023-10-03T10:13:59.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.397+0000 7ff27f5c6700 1 Processor -- start 2023-10-03T10:13:59.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.397+0000 7ff27f5c6700 1 -- start start 2023-10-03T10:13:59.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.398+0000 7ff27f5c6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff278066410 0x7ff27813afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.398+0000 7ff27f5c6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2781314b0 0x7ff27813b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.398+0000 7ff27f5c6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff278131f30 0x7ff27813ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.398+0000 7ff27f5c6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2781333d0 con 0x7ff278131f30 2023-10-03T10:13:59.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.398+0000 7ff27f5c6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2781303c0 con 0x7ff2781314b0 2023-10-03T10:13:59.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.398+0000 7ff27f5c6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff27812da60 con 0x7ff278066410 2023-10-03T10:13:59.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.398+0000 7ff27d362700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff278066410 0x7ff27813afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.398+0000 7ff27d362700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff278066410 0x7ff27813afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36340/0 (socket says 172.21.15.146:36340) 2023-10-03T10:13:59.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.398+0000 7ff27d362700 1 -- 172.21.15.146:0/2641744280 learned_addr learned my addr 172.21.15.146:0/2641744280 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:59.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.398+0000 7ff27db63700 1 --2- 172.21.15.146:0/2641744280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff278131f30 0x7ff27813ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.398+0000 7ff27cb61700 1 --2- 172.21.15.146:0/2641744280 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2781314b0 0x7ff27813b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.399+0000 7ff27db63700 1 -- 172.21.15.146:0/2641744280 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff278066410 msgr2=0x7ff27813afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.399+0000 7ff27db63700 1 --2- 172.21.15.146:0/2641744280 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff278066410 0x7ff27813afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.399+0000 7ff27db63700 1 -- 172.21.15.146:0/2641744280 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2781314b0 msgr2=0x7ff27813b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.399+0000 7ff27db63700 1 --2- 172.21.15.146:0/2641744280 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2781314b0 0x7ff27813b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.399+0000 7ff27db63700 1 -- 172.21.15.146:0/2641744280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff270009a70 con 0x7ff278131f30 2023-10-03T10:13:59.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.399+0000 7ff27db63700 1 --2- 172.21.15.146:0/2641744280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff278131f30 0x7ff27813ba60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff270009dc0 tx=0x7ff270004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:59.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.399+0000 7ff26dffb700 1 -- 172.21.15.146:0/2641744280 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2700044d0 con 0x7ff278131f30 2023-10-03T10:13:59.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.399+0000 7ff27f5c6700 1 -- 172.21.15.146:0/2641744280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff27813cb50 con 0x7ff278131f30 2023-10-03T10:13:59.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.399+0000 7ff27f5c6700 1 -- 172.21.15.146:0/2641744280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27813d340 con 0x7ff278131f30 2023-10-03T10:13:59.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.399+0000 7ff26dffb700 1 -- 172.21.15.146:0/2641744280 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff270020070 con 0x7ff278131f30 2023-10-03T10:13:59.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.399+0000 7ff26dffb700 1 -- 172.21.15.146:0/2641744280 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff270004850 con 0x7ff278131f30 2023-10-03T10:13:59.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.400+0000 7ff26dffb700 1 -- 172.21.15.146:0/2641744280 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff270027480 con 0x7ff278131f30 2023-10-03T10:13:59.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.400+0000 7ff26dffb700 1 -- 172.21.15.146:0/2641744280 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff270022070 con 0x7ff278131f30 2023-10-03T10:13:59.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.401+0000 7ff27f5c6700 1 -- 172.21.15.146:0/2641744280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2580052e0 con 0x7ff278131f30 2023-10-03T10:13:59.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.402+0000 7ffb2ae6e700 1 Processor -- start 2023-10-03T10:13:59.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.402+0000 7ffb2ae6e700 1 -- start start 2023-10-03T10:13:59.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.403+0000 7ffb2ae6e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb2409e340 0x7ffb241359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.403+0000 7ffb2ae6e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffb24135f20 0x7ffb24138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.403+0000 7ffb2ae6e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb2409aaa0 con 0x7ffb2409d860 2023-10-03T10:13:59.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.403+0000 7ffb2ae6e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb2409e730 con 0x7ffb24135f20 2023-10-03T10:13:59.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.403+0000 7ffb2ae6e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2409f870 con 0x7ffb2409e340 2023-10-03T10:13:59.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.403+0000 7ffb2940b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffb24135f20 0x7ffb24138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.403+0000 7ffb2940b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffb24135f20 0x7ffb24138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37574/0 (socket says 172.21.15.146:37574) 2023-10-03T10:13:59.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.403+0000 7ffb2940b700 1 -- 172.21.15.146:0/440440190 learned_addr learned my addr 172.21.15.146:0/440440190 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:59.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.403+0000 7ffb2940b700 1 -- 172.21.15.146:0/440440190 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb2409e340 msgr2=0x7ffb241359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:59.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.403+0000 7ffb2940b700 1 --2- 172.21.15.146:0/440440190 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb2409e340 0x7ffb241359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.403+0000 7ffb2940b700 1 -- 172.21.15.146:0/440440190 >> v1:172.21.15.146:6789/0 conn(0x7ffb2409d860 legacy=0x7ffb2409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:59.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.403+0000 7ffb2940b700 1 -- 172.21.15.146:0/440440190 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2409b360 con 0x7ffb24135f20 2023-10-03T10:13:59.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.403+0000 7ffb2940b700 1 --2- 172.21.15.146:0/440440190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb24135f20 0x7ffb24138300 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c00d150 tx=0x7ffb1c00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be3e88c8fe2728e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:59.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.406+0000 7ffb237fe700 1 -- 172.21.15.146:0/440440190 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c010070 con 0x7ffb24135f20 2023-10-03T10:13:59.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.406+0000 7ffb237fe700 1 -- 172.21.15.146:0/440440190 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1c00dd80 con 0x7ffb24135f20 2023-10-03T10:13:59.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.406+0000 7ffb237fe700 1 -- 172.21.15.146:0/440440190 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c00b310 con 0x7ffb24135f20 2023-10-03T10:13:59.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.406+0000 7ff26dffb700 1 -- 172.21.15.146:0/2641744280 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff27002c080 con 0x7ff278131f30 2023-10-03T10:13:59.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.407+0000 7ffb2ae6e700 1 -- 172.21.15.146:0/440440190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb24135f20 msgr2=0x7ffb24138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.407+0000 7ffb2ae6e700 1 --2- 172.21.15.146:0/440440190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb24135f20 0x7ffb24138300 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c00d150 tx=0x7ffb1c00d460 comp rx=0 tx=0).stop 2023-10-03T10:13:59.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.407+0000 7ffb2ae6e700 1 -- 172.21.15.146:0/440440190 shutdown_connections 2023-10-03T10:13:59.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.407+0000 7ffb2ae6e700 1 --2- 172.21.15.146:0/440440190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb24135f20 0x7ffb24138300 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.407+0000 7ffb2ae6e700 1 --2- 172.21.15.146:0/440440190 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb2409e340 0x7ffb241359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.407+0000 7ffb2ae6e700 1 -- 172.21.15.146:0/440440190 >> 172.21.15.146:0/440440190 conn(0x7ffb24099c40 msgr2=0x7ffb240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:59.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.407+0000 7ffb2ae6e700 1 -- 172.21.15.146:0/440440190 shutdown_connections 2023-10-03T10:13:59.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.407+0000 7ffb2ae6e700 1 -- 172.21.15.146:0/440440190 wait complete. 2023-10-03T10:13:59.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.408+0000 7ffb2ae6e700 1 Processor -- start 2023-10-03T10:13:59.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.408+0000 7ffb2ae6e700 1 -- start start 2023-10-03T10:13:59.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.409+0000 7ffb2ae6e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb2409d860 0x7ffb2411c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.409+0000 7ffb2ae6e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb2409e340 0x7ffb2411cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.409+0000 7ffb2ae6e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb24135f20 0x7ffb2411d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.409+0000 7ffb2ae6e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb240a2320 con 0x7ffb2409d860 2023-10-03T10:13:59.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.409+0000 7ffb2ae6e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb241294a0 con 0x7ffb24135f20 2023-10-03T10:13:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.409+0000 7ffb2ae6e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2409c8b0 con 0x7ffb2409e340 2023-10-03T10:13:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.409+0000 7ffb23fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb2409e340 0x7ffb2411cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.409+0000 7ffb2940b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb24135f20 0x7ffb2411d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.409+0000 7ffb23fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb2409e340 0x7ffb2411cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36372/0 (socket says 172.21.15.146:36372) 2023-10-03T10:13:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.409+0000 7ffb23fff700 1 -- 172.21.15.146:0/1872914447 learned_addr learned my addr 172.21.15.146:0/1872914447 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.409+0000 7ffb28c0a700 1 --2- 172.21.15.146:0/1872914447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb2409d860 0x7ffb2411c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.409+0000 7ffb23fff700 1 -- 172.21.15.146:0/1872914447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb24135f20 msgr2=0x7ffb2411d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.409+0000 7ffb23fff700 1 --2- 172.21.15.146:0/1872914447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb24135f20 0x7ffb2411d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.409+0000 7ffb23fff700 1 -- 172.21.15.146:0/1872914447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb2409d860 msgr2=0x7ffb2411c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.409+0000 7ffb23fff700 1 --2- 172.21.15.146:0/1872914447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb2409d860 0x7ffb2411c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.409+0000 7ffb23fff700 1 -- 172.21.15.146:0/1872914447 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c00bd40 con 0x7ffb2409e340 2023-10-03T10:13:59.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.409+0000 7ffb23fff700 1 --2- 172.21.15.146:0/1872914447 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb2409e340 0x7ffb2411cce0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000b530 tx=0x7ffb1000b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:59.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.410+0000 7ffb217fa700 1 -- 172.21.15.146:0/1872914447 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb100118f0 con 0x7ffb2409e340 2023-10-03T10:13:59.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.410+0000 7ffb2ae6e700 1 -- 172.21.15.146:0/1872914447 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb241202c0 con 0x7ffb2409e340 2023-10-03T10:13:59.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.410+0000 7ffb2ae6e700 1 -- 172.21.15.146:0/1872914447 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2411d9e0 con 0x7ffb2409e340 2023-10-03T10:13:59.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.410+0000 7ffb217fa700 1 -- 172.21.15.146:0/1872914447 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb10011a50 con 0x7ffb2409e340 2023-10-03T10:13:59.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.410+0000 7ffb217fa700 1 -- 172.21.15.146:0/1872914447 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb10011e00 con 0x7ffb2409e340 2023-10-03T10:13:59.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.411+0000 7ffb217fa700 1 -- 172.21.15.146:0/1872914447 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb1001a400 con 0x7ffb2409e340 2023-10-03T10:13:59.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.411+0000 7ffb217fa700 1 -- 172.21.15.146:0/1872914447 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffb1003f780 con 0x7ffb2409e340 2023-10-03T10:13:59.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.416+0000 7ffb2ae6e700 1 -- 172.21.15.146:0/1872914447 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb040052e0 con 0x7ffb2409e340 2023-10-03T10:13:59.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.420+0000 7ffb217fa700 1 -- 172.21.15.146:0/1872914447 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb1000f8d0 con 0x7ffb2409e340 2023-10-03T10:13:59.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.429+0000 7fd274d1f700 1 Processor -- start 2023-10-03T10:13:59.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.429+0000 7fd274d1f700 1 -- start start 2023-10-03T10:13:59.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.430+0000 7fd274d1f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd270133a70 0x7fd270133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.430+0000 7fd274d1f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2700a08e0 0x7fd2700a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.430+0000 7fd274d1f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd2700a1290 0x7fd27013a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.430+0000 7fd274d1f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd270133640 con 0x7fd2700a1290 2023-10-03T10:13:59.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.430+0000 7fd274d1f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2700a1d50 con 0x7fd2700a08e0 2023-10-03T10:13:59.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.430+0000 7fd274d1f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2700a1730 con 0x7fd270133a70 2023-10-03T10:13:59.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.430+0000 7fd26dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2700a08e0 0x7fd2700a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.430+0000 7fd26ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd2700a1290 0x7fd27013a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.430+0000 7fd26dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2700a08e0 0x7fd2700a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38682/0 (socket says 172.21.15.146:38682) 2023-10-03T10:13:59.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.430+0000 7fd26dd9b700 1 -- 172.21.15.146:0/3194410242 learned_addr learned my addr 172.21.15.146:0/3194410242 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:59.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.430+0000 7fd26e59c700 1 --2- 172.21.15.146:0/3194410242 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd270133a70 0x7fd270133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.430+0000 7fd26ed9d700 1 -- 172.21.15.146:0/3194410242 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd270133a70 msgr2=0x7fd270133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:59.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.430+0000 7fd26ed9d700 1 --2- 172.21.15.146:0/3194410242 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd270133a70 0x7fd270133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.430+0000 7fd26ed9d700 1 -- 172.21.15.146:0/3194410242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2700a08e0 msgr2=0x7fd2700a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:59.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.430+0000 7fd26ed9d700 1 --2- 172.21.15.146:0/3194410242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2700a08e0 0x7fd2700a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.430+0000 7fd26ed9d700 1 -- 172.21.15.146:0/3194410242 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27009b620 con 0x7fd2700a1290 2023-10-03T10:13:59.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.430+0000 7fd26dd9b700 1 --2- 172.21.15.146:0/3194410242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2700a08e0 0x7fd2700a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:59.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.431+0000 7fd26ed9d700 1 --2- 172.21.15.146:0/3194410242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2700a1290 0x7fd27013a970 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd268009d90 tx=0x7fd26800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d940c75cf2d62c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:59.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.431+0000 7fd26d59a700 1 -- 172.21.15.146:0/3194410242 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26800e070 con 0x7fd2700a1290 2023-10-03T10:13:59.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.431+0000 7fd26d59a700 1 -- 172.21.15.146:0/3194410242 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26800bb20 con 0x7fd2700a1290 2023-10-03T10:13:59.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.431+0000 7fd26d59a700 1 -- 172.21.15.146:0/3194410242 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268012430 con 0x7fd2700a1290 2023-10-03T10:13:59.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.431+0000 7fd274d1f700 1 -- 172.21.15.146:0/3194410242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2700a1290 msgr2=0x7fd27013a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.431+0000 7fd274d1f700 1 --2- 172.21.15.146:0/3194410242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2700a1290 0x7fd27013a970 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd268009d90 tx=0x7fd26800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:59.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.431+0000 7fd274d1f700 1 -- 172.21.15.146:0/3194410242 shutdown_connections 2023-10-03T10:13:59.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.431+0000 7fd274d1f700 1 --2- 172.21.15.146:0/3194410242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2700a1290 0x7fd27013a970 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.431+0000 7fd274d1f700 1 --2- 172.21.15.146:0/3194410242 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd270133a70 0x7fd270133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.431+0000 7fd274d1f700 1 --2- 172.21.15.146:0/3194410242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2700a08e0 0x7fd2700a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.431+0000 7fd274d1f700 1 -- 172.21.15.146:0/3194410242 >> 172.21.15.146:0/3194410242 conn(0x7fd2700a2980 msgr2=0x7fd2700a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:59.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.432+0000 7fd274d1f700 1 -- 172.21.15.146:0/3194410242 shutdown_connections 2023-10-03T10:13:59.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.432+0000 7fd274d1f700 1 -- 172.21.15.146:0/3194410242 wait complete. 2023-10-03T10:13:59.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.433+0000 7fd274d1f700 1 Processor -- start 2023-10-03T10:13:59.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.433+0000 7fd274d1f700 1 -- start start 2023-10-03T10:13:59.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.433+0000 7fd274d1f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2700a08e0 0x7fd270121600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.433+0000 7fd274d1f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2700a1290 0x7fd270121b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.433+0000 7fd274d1f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd270133a70 0x7fd270122080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.433+0000 7fd274d1f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd270123750 con 0x7fd2700a1290 2023-10-03T10:13:59.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.433+0000 7fd274d1f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd270123d70 con 0x7fd270133a70 2023-10-03T10:13:59.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.433+0000 7fd274d1f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd270071c00 con 0x7fd2700a08e0 2023-10-03T10:13:59.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.433+0000 7fd26dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2700a1290 0x7fd270121b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.433+0000 7fd26dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2700a1290 0x7fd270121b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37598/0 (socket says 172.21.15.146:37598) 2023-10-03T10:13:59.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.433+0000 7fd26dd9b700 1 -- 172.21.15.146:0/3806252676 learned_addr learned my addr 172.21.15.146:0/3806252676 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:13:59.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.433+0000 7fd26ed9d700 1 --2- 172.21.15.146:0/3806252676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd270133a70 0x7fd270122080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.433+0000 7fd26e59c700 1 --2- 172.21.15.146:0/3806252676 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2700a08e0 0x7fd270121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.434+0000 7fd26dd9b700 1 -- 172.21.15.146:0/3806252676 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2700a08e0 msgr2=0x7fd270121600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.434+0000 7fd26dd9b700 1 --2- 172.21.15.146:0/3806252676 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2700a08e0 0x7fd270121600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.434+0000 7fd26dd9b700 1 -- 172.21.15.146:0/3806252676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd270133a70 msgr2=0x7fd270122080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.434+0000 7fd26dd9b700 1 --2- 172.21.15.146:0/3806252676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd270133a70 0x7fd270122080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.434+0000 7fd26dd9b700 1 -- 172.21.15.146:0/3806252676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd264009550 con 0x7fd2700a1290 2023-10-03T10:13:59.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.434+0000 7fd26dd9b700 1 --2- 172.21.15.146:0/3806252676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2700a1290 0x7fd270121b40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd26400ebe0 tx=0x7fd26400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:59.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.434+0000 7fd25effd700 1 -- 172.21.15.146:0/3806252676 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26400c850 con 0x7fd2700a1290 2023-10-03T10:13:59.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.434+0000 7fd25effd700 1 -- 172.21.15.146:0/3806252676 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26400c9b0 con 0x7fd2700a1290 2023-10-03T10:13:59.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.434+0000 7fd25effd700 1 -- 172.21.15.146:0/3806252676 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26400cd20 con 0x7fd2700a1290 2023-10-03T10:13:59.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.434+0000 7fd274d1f700 1 -- 172.21.15.146:0/3806252676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd268009a70 con 0x7fd2700a1290 2023-10-03T10:13:59.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.434+0000 7fd274d1f700 1 -- 172.21.15.146:0/3806252676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27009a350 con 0x7fd2700a1290 2023-10-03T10:13:59.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.435+0000 7fd25effd700 1 -- 172.21.15.146:0/3806252676 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd264013470 con 0x7fd2700a1290 2023-10-03T10:13:59.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.436+0000 7fd25effd700 1 -- 172.21.15.146:0/3806252676 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd26403f940 con 0x7fd2700a1290 2023-10-03T10:13:59.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.436+0000 7fd274d1f700 1 -- 172.21.15.146:0/3806252676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd27004f2a0 con 0x7fd2700a1290 2023-10-03T10:13:59.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.440+0000 7fd25effd700 1 -- 172.21.15.146:0/3806252676 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd264021020 con 0x7fd2700a1290 2023-10-03T10:13:59.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.614+0000 7ffb2ae6e700 1 -- 172.21.15.146:0/1872914447 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffb04005590 con 0x7ffb2409e340 2023-10-03T10:13:59.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.614+0000 7ffb217fa700 1 -- 172.21.15.146:0/1872914447 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ffb10015020 con 0x7ffb2409e340 2023-10-03T10:13:59.614 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:59.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.617+0000 7ffb2ae6e700 1 -- 172.21.15.146:0/1872914447 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb2409e340 msgr2=0x7ffb2411cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.617+0000 7ffb2ae6e700 1 --2- 172.21.15.146:0/1872914447 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb2409e340 0x7ffb2411cce0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000b530 tx=0x7ffb1000b840 comp rx=0 tx=0).stop 2023-10-03T10:13:59.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.618+0000 7ffb2ae6e700 1 -- 172.21.15.146:0/1872914447 shutdown_connections 2023-10-03T10:13:59.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.618+0000 7ffb2ae6e700 1 --2- 172.21.15.146:0/1872914447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb24135f20 0x7ffb2411d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.618+0000 7ffb2ae6e700 1 --2- 172.21.15.146:0/1872914447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb2409d860 0x7ffb2411c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.618+0000 7ffb2ae6e700 1 --2- 172.21.15.146:0/1872914447 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb2409e340 0x7ffb2411cce0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.618+0000 7ffb2ae6e700 1 -- 172.21.15.146:0/1872914447 >> 172.21.15.146:0/1872914447 conn(0x7ffb24099c40 msgr2=0x7ffb2406efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:59.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.618+0000 7ffb2ae6e700 1 -- 172.21.15.146:0/1872914447 shutdown_connections 2023-10-03T10:13:59.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.618+0000 7ffb2ae6e700 1 -- 172.21.15.146:0/1872914447 wait complete. 2023-10-03T10:13:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.626+0000 7f8105250700 1 -- 172.21.15.146:0/1958337665 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8100133d50 con 0x7f810009ad40 2023-10-03T10:13:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.627+0000 7f80e77fe700 1 -- 172.21.15.146:0/1958337665 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f80f0015030 con 0x7f810009ad40 2023-10-03T10:13:59.627 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:13:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.629+0000 7f8105250700 1 -- 172.21.15.146:0/1958337665 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f810009ad40 msgr2=0x7f8100122520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.629+0000 7f8105250700 1 --2- 172.21.15.146:0/1958337665 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f810009ad40 0x7f8100122520 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f80f00097c0 tx=0x7f80f0004750 comp rx=0 tx=0).stop 2023-10-03T10:13:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.629+0000 7f8105250700 1 -- 172.21.15.146:0/1958337665 shutdown_connections 2023-10-03T10:13:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.629+0000 7f8105250700 1 --2- 172.21.15.146:0/1958337665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8100133f70 0x7f8100122fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.629+0000 7f8105250700 1 --2- 172.21.15.146:0/1958337665 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f810009ad40 0x7f8100122520 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.629+0000 7f8105250700 1 --2- 172.21.15.146:0/1958337665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81000a0a70 0x7f8100122a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.629+0000 7f8105250700 1 -- 172.21.15.146:0/1958337665 >> 172.21.15.146:0/1958337665 conn(0x7f8100099c40 msgr2=0x7f81000a4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.629+0000 7f8105250700 1 -- 172.21.15.146:0/1958337665 shutdown_connections 2023-10-03T10:13:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.629+0000 7f8105250700 1 -- 172.21.15.146:0/1958337665 wait complete. 2023-10-03T10:13:59.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:13:59.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.634+0000 7fd274d1f700 1 -- 172.21.15.146:0/3806252676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd2700a0100 con 0x7fd2700a1290 2023-10-03T10:13:59.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.634+0000 7fd25effd700 1 -- 172.21.15.146:0/3806252676 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd26402a090 con 0x7fd2700a1290 2023-10-03T10:13:59.634 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:13:59.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.636+0000 7fd274d1f700 1 -- 172.21.15.146:0/3806252676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2700a1290 msgr2=0x7fd270121b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.636+0000 7fd274d1f700 1 --2- 172.21.15.146:0/3806252676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2700a1290 0x7fd270121b40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd26400ebe0 tx=0x7fd26400eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.636+0000 7fd274d1f700 1 -- 172.21.15.146:0/3806252676 shutdown_connections 2023-10-03T10:13:59.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.636+0000 7fd274d1f700 1 --2- 172.21.15.146:0/3806252676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd270133a70 0x7fd270122080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.636+0000 7fd274d1f700 1 --2- 172.21.15.146:0/3806252676 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2700a08e0 0x7fd270121600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.636+0000 7fd274d1f700 1 --2- 172.21.15.146:0/3806252676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2700a1290 0x7fd270121b40 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.636+0000 7fd274d1f700 1 -- 172.21.15.146:0/3806252676 >> 172.21.15.146:0/3806252676 conn(0x7fd2700a2980 msgr2=0x7fd27009d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:59.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.636+0000 7fd274d1f700 1 -- 172.21.15.146:0/3806252676 shutdown_connections 2023-10-03T10:13:59.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.636+0000 7fd274d1f700 1 -- 172.21.15.146:0/3806252676 wait complete. 2023-10-03T10:13:59.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:13:59.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.648+0000 7ff27f5c6700 1 -- 172.21.15.146:0/2641744280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff258005590 con 0x7ff278131f30 2023-10-03T10:13:59.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.648+0000 7ff26dffb700 1 -- 172.21.15.146:0/2641744280 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff270030990 con 0x7ff278131f30 2023-10-03T10:13:59.648 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:13:59.649 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:13:59.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.650+0000 7ff27f5c6700 1 -- 172.21.15.146:0/2641744280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff278131f30 msgr2=0x7ff27813ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.650+0000 7ff27f5c6700 1 --2- 172.21.15.146:0/2641744280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff278131f30 0x7ff27813ba60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff270009dc0 tx=0x7ff270004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.650+0000 7ff27f5c6700 1 -- 172.21.15.146:0/2641744280 shutdown_connections 2023-10-03T10:13:59.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.650+0000 7ff27f5c6700 1 --2- 172.21.15.146:0/2641744280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff278131f30 0x7ff27813ba60 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.650+0000 7ff27f5c6700 1 --2- 172.21.15.146:0/2641744280 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff278066410 0x7ff27813afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.650+0000 7ff27f5c6700 1 --2- 172.21.15.146:0/2641744280 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2781314b0 0x7ff27813b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.650+0000 7ff27f5c6700 1 -- 172.21.15.146:0/2641744280 >> 172.21.15.146:0/2641744280 conn(0x7ff2780a2980 msgr2=0x7ff27809b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:59.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.651+0000 7ff27f5c6700 1 -- 172.21.15.146:0/2641744280 shutdown_connections 2023-10-03T10:13:59.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:13:59.651+0000 7ff27f5c6700 1 -- 172.21.15.146:0/2641744280 wait complete. 2023-10-03T10:13:59.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:00.632 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:00.644 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:00.650 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:00.663 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:00.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.777+0000 7f6d390ed700 1 Processor -- start 2023-10-03T10:14:00.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.777+0000 7f6d390ed700 1 -- start start 2023-10-03T10:14:00.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.777+0000 7f6d390ed700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d34133ad0 0x7f6d34133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.777+0000 7f6d390ed700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d341300a0 0x7f6d341304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.777+0000 7f6d390ed700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d341309f0 0x7f6d3413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.777+0000 7f6d390ed700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d3406b2d0 con 0x7f6d34133ad0 2023-10-03T10:14:00.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.777+0000 7f6d390ed700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d34133610 con 0x7f6d341300a0 2023-10-03T10:14:00.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.777+0000 7f6d390ed700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3409a500 con 0x7f6d341309f0 2023-10-03T10:14:00.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.778+0000 7f6d3259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d341300a0 0x7f6d341304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.778+0000 7f6d32d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d34133ad0 0x7f6d34133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.778+0000 7f6d3259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d341300a0 0x7f6d341304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38694/0 (socket says 172.21.15.146:38694) 2023-10-03T10:14:00.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.778+0000 7f6d3259c700 1 -- 172.21.15.146:0/4190770221 learned_addr learned my addr 172.21.15.146:0/4190770221 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:00.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.778+0000 7f6d3359e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d341309f0 0x7f6d3413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.778+0000 7f6d3259c700 1 -- 172.21.15.146:0/4190770221 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d341309f0 msgr2=0x7f6d3413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.778+0000 7f6d3259c700 1 --2- 172.21.15.146:0/4190770221 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d341309f0 0x7f6d3413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.778+0000 7f6d3259c700 1 -- 172.21.15.146:0/4190770221 >> v2:172.21.15.146:3300/0 conn(0x7f6d34133ad0 msgr2=0x7f6d34133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.778+0000 7f6d3259c700 1 --2- 172.21.15.146:0/4190770221 >> v2:172.21.15.146:3300/0 conn(0x7f6d34133ad0 0x7f6d34133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.778+0000 7f6d3259c700 1 -- 172.21.15.146:0/4190770221 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d341338b0 con 0x7f6d341300a0 2023-10-03T10:14:00.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.778+0000 7f6d32d9d700 1 --2- 172.21.15.146:0/4190770221 >> v2:172.21.15.146:3300/0 conn(0x7f6d34133ad0 0x7f6d34133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:00.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.778+0000 7f6d3259c700 1 --2- 172.21.15.146:0/4190770221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d341300a0 0x7f6d341304b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6d280098f0 tx=0x7f6d28009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e21c9ced00965d94 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.778+0000 7f6d31d9b700 1 -- 172.21.15.146:0/4190770221 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d28011830 con 0x7f6d341300a0 2023-10-03T10:14:00.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.778+0000 7f6d31d9b700 1 -- 172.21.15.146:0/4190770221 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d28011990 con 0x7f6d341300a0 2023-10-03T10:14:00.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.778+0000 7f6d31d9b700 1 -- 172.21.15.146:0/4190770221 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d28011d20 con 0x7f6d341300a0 2023-10-03T10:14:00.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.779+0000 7f6d390ed700 1 -- 172.21.15.146:0/4190770221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d341300a0 msgr2=0x7f6d341304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.779+0000 7f6d390ed700 1 --2- 172.21.15.146:0/4190770221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d341300a0 0x7f6d341304b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6d280098f0 tx=0x7f6d28009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:00.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.779+0000 7f6d390ed700 1 -- 172.21.15.146:0/4190770221 shutdown_connections 2023-10-03T10:14:00.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.779+0000 7f6d390ed700 1 --2- 172.21.15.146:0/4190770221 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d341309f0 0x7f6d3413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.779+0000 7f6d390ed700 1 --2- 172.21.15.146:0/4190770221 >> v2:172.21.15.146:3300/0 conn(0x7f6d34133ad0 0x7f6d34133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.779+0000 7f6d390ed700 1 --2- 172.21.15.146:0/4190770221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d341300a0 0x7f6d341304b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.779+0000 7f6d390ed700 1 -- 172.21.15.146:0/4190770221 >> 172.21.15.146:0/4190770221 conn(0x7f6d34099c40 msgr2=0x7f6d340a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.779+0000 7f6d390ed700 1 -- 172.21.15.146:0/4190770221 shutdown_connections 2023-10-03T10:14:00.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.779+0000 7f6d390ed700 1 -- 172.21.15.146:0/4190770221 wait complete. 2023-10-03T10:14:00.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.781+0000 7f6d390ed700 1 Processor -- start 2023-10-03T10:14:00.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.781+0000 7f6d390ed700 1 -- start start 2023-10-03T10:14:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.781+0000 7f6d390ed700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d341300a0 0x7f6d3411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.781+0000 7f6d390ed700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d341309f0 0x7f6d3411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.781+0000 7f6d390ed700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d34133ad0 0x7f6d3411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.781+0000 7f6d390ed700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3411fcd0 con 0x7f6d341300a0 2023-10-03T10:14:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.781+0000 7f6d390ed700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3411eeb0 con 0x7f6d34133ad0 2023-10-03T10:14:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.781+0000 7f6d390ed700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d34071f60 con 0x7f6d341309f0 2023-10-03T10:14:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.781+0000 7f6d32d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d341300a0 0x7f6d3411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.781+0000 7f6d32d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d341300a0 0x7f6d3411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37624/0 (socket says 172.21.15.146:37624) 2023-10-03T10:14:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.781+0000 7f6d32d9d700 1 -- 172.21.15.146:0/2183543636 learned_addr learned my addr 172.21.15.146:0/2183543636 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.781+0000 7f6d3359e700 1 --2- 172.21.15.146:0/2183543636 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d34133ad0 0x7f6d3411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.781+0000 7f6d3259c700 1 --2- 172.21.15.146:0/2183543636 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d341309f0 0x7f6d3411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.782+0000 7f6d3359e700 1 -- 172.21.15.146:0/2183543636 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d341309f0 msgr2=0x7f6d3411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.782+0000 7f6d3359e700 1 --2- 172.21.15.146:0/2183543636 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d341309f0 0x7f6d3411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.782+0000 7f6d3359e700 1 -- 172.21.15.146:0/2183543636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d341300a0 msgr2=0x7f6d3411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.782+0000 7f6d3359e700 1 --2- 172.21.15.146:0/2183543636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d341300a0 0x7f6d3411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.782+0000 7f6d3359e700 1 -- 172.21.15.146:0/2183543636 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d240094a0 con 0x7f6d34133ad0 2023-10-03T10:14:00.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.782+0000 7f6d3359e700 1 --2- 172.21.15.146:0/2183543636 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d34133ad0 0x7f6d3411e4c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c009d90 tx=0x7f6d2c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.782+0000 7f6d1b7fe700 1 -- 172.21.15.146:0/2183543636 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c009c00 con 0x7f6d34133ad0 2023-10-03T10:14:00.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.782+0000 7f6d1b7fe700 1 -- 172.21.15.146:0/2183543636 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2c00f040 con 0x7f6d34133ad0 2023-10-03T10:14:00.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.782+0000 7f6d390ed700 1 -- 172.21.15.146:0/2183543636 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d28009550 con 0x7f6d34133ad0 2023-10-03T10:14:00.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.782+0000 7f6d1b7fe700 1 -- 172.21.15.146:0/2183543636 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c014480 con 0x7f6d34133ad0 2023-10-03T10:14:00.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.782+0000 7f6d390ed700 1 -- 172.21.15.146:0/2183543636 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d3411f970 con 0x7f6d34133ad0 2023-10-03T10:14:00.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.783+0000 7f6d1b7fe700 1 -- 172.21.15.146:0/2183543636 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6d2c0145e0 con 0x7f6d34133ad0 2023-10-03T10:14:00.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.783+0000 7f6d1b7fe700 1 -- 172.21.15.146:0/2183543636 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6d2c0402c0 con 0x7f6d34133ad0 2023-10-03T10:14:00.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.783+0000 7f6d390ed700 1 -- 172.21.15.146:0/2183543636 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d3411f250 con 0x7f6d34133ad0 2023-10-03T10:14:00.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.792+0000 7f6d1b7fe700 1 -- 172.21.15.146:0/2183543636 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d2c007900 con 0x7f6d34133ad0 2023-10-03T10:14:00.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.814+0000 7f54a5b86700 1 Processor -- start 2023-10-03T10:14:00.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.815+0000 7f54a5b86700 1 -- start start 2023-10-03T10:14:00.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.815+0000 7f54a5b86700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54a006a770 0x7f54a006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.815+0000 7f54a5b86700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f54a009dec0 0x7f54a006b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.815+0000 7f54a5b86700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54a0131a00 0x7f54a0131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.815+0000 7f54a5b86700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a006b5c0 con 0x7f54a009dec0 2023-10-03T10:14:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.815+0000 7f54a5b86700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a006e900 con 0x7f54a0131a00 2023-10-03T10:14:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.815+0000 7f54a5b86700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54a009d180 con 0x7f54a006a770 2023-10-03T10:14:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.816+0000 7f549f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54a006a770 0x7f54a006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.816+0000 7f5496ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f54a009dec0 0x7f54a006b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.816+0000 7f549f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54a006a770 0x7f54a006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36428/0 (socket says 172.21.15.146:36428) 2023-10-03T10:14:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.816+0000 7f549ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54a0131a00 0x7f54a0131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.816+0000 7f549f7fe700 1 -- 172.21.15.146:0/2947771955 learned_addr learned my addr 172.21.15.146:0/2947771955 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.816+0000 7f5496ffd700 1 --2- 172.21.15.146:0/2947771955 >> v2:172.21.15.146:3300/0 conn(0x7f54a009dec0 0x7f54a006b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37634/0 (socket says 172.21.15.146:37634) 2023-10-03T10:14:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.816+0000 7f5496ffd700 1 -- 172.21.15.146:0/2947771955 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54a006a770 msgr2=0x7f54a006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.816+0000 7f5496ffd700 1 --2- 172.21.15.146:0/2947771955 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54a006a770 0x7f54a006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.816+0000 7f5496ffd700 1 -- 172.21.15.146:0/2947771955 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54a0131a00 msgr2=0x7f54a0131e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.816+0000 7f5496ffd700 1 --2- 172.21.15.146:0/2947771955 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54a0131a00 0x7f54a0131e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.816+0000 7f5496ffd700 1 -- 172.21.15.146:0/2947771955 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a009e780 con 0x7f54a009dec0 2023-10-03T10:14:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.816+0000 7f549ffff700 1 --2- 172.21.15.146:0/2947771955 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54a0131a00 0x7f54a0131e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.816+0000 7f549f7fe700 1 --2- 172.21.15.146:0/2947771955 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54a006a770 0x7f54a006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:00.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.816+0000 7f5496ffd700 1 --2- 172.21.15.146:0/2947771955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54a009dec0 0x7f54a006b080 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f548800dc60 tx=0x7f548800df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b252e60ff7cc130 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.816+0000 7f549effd700 1 -- 172.21.15.146:0/2947771955 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488012070 con 0x7f54a009dec0 2023-10-03T10:14:00.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.816+0000 7f549effd700 1 -- 172.21.15.146:0/2947771955 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548800d2e0 con 0x7f54a009dec0 2023-10-03T10:14:00.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.816+0000 7f549effd700 1 -- 172.21.15.146:0/2947771955 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548800f900 con 0x7f54a009dec0 2023-10-03T10:14:00.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.817+0000 7f54a5b86700 1 -- 172.21.15.146:0/2947771955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54a009dec0 msgr2=0x7f54a006b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.817+0000 7f54a5b86700 1 --2- 172.21.15.146:0/2947771955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54a009dec0 0x7f54a006b080 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f548800dc60 tx=0x7f548800df70 comp rx=0 tx=0).stop 2023-10-03T10:14:00.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.817+0000 7f54a5b86700 1 -- 172.21.15.146:0/2947771955 shutdown_connections 2023-10-03T10:14:00.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.817+0000 7f54a5b86700 1 --2- 172.21.15.146:0/2947771955 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54a0131a00 0x7f54a0131e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.817+0000 7f54a5b86700 1 --2- 172.21.15.146:0/2947771955 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54a006a770 0x7f54a006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.817+0000 7f54a5b86700 1 --2- 172.21.15.146:0/2947771955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54a009dec0 0x7f54a006b080 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.817+0000 7f54a5b86700 1 -- 172.21.15.146:0/2947771955 >> 172.21.15.146:0/2947771955 conn(0x7f54a0099c40 msgr2=0x7f54a00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.818+0000 7f154b6be700 1 Processor -- start 2023-10-03T10:14:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.818+0000 7f154b6be700 1 -- start start 2023-10-03T10:14:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.818+0000 7f54a5b86700 1 -- 172.21.15.146:0/2947771955 shutdown_connections 2023-10-03T10:14:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.818+0000 7f54a5b86700 1 -- 172.21.15.146:0/2947771955 wait complete. 2023-10-03T10:14:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.818+0000 7f154b6be700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1544099e20 0x7f154409a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.818+0000 7f154b6be700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1544130a60 0x7f1544138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.818+0000 7f154b6be700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1544099a60 con 0x7f154409a730 2023-10-03T10:14:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.818+0000 7f154b6be700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f154409bf50 con 0x7f1544099e20 2023-10-03T10:14:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.818+0000 7f154b6be700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154409b230 con 0x7f1544130a60 2023-10-03T10:14:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.818+0000 7f1548c59700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f154409a730 0x7f1544130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45740/0 (socket says 172.21.15.146:45740) 2023-10-03T10:14:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.819+0000 7f1548c59700 1 -- 172.21.15.146:0/1882688387 learned_addr learned my addr 172.21.15.146:0/1882688387 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.819+0000 7f1549c5b700 1 --2- 172.21.15.146:0/1882688387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1544130a60 0x7f1544138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.819+0000 7f154945a700 1 --2- 172.21.15.146:0/1882688387 >> v2:172.21.15.146:3300/0 conn(0x7f1544099e20 0x7f154409a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.819+0000 7f1543fff700 1 -- 172.21.15.146:0/1882688387 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859697775 0 0) 0x7f1544099a60 con 0x7f154409a730 2023-10-03T10:14:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.819+0000 7f1543fff700 1 -- 172.21.15.146:0/1882688387 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f152c0035b0 con 0x7f154409a730 2023-10-03T10:14:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.819+0000 7f1549c5b700 1 -- 172.21.15.146:0/1882688387 >> v2:172.21.15.146:3300/0 conn(0x7f1544099e20 msgr2=0x7f154409a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.819+0000 7f1549c5b700 1 --2- 172.21.15.146:0/1882688387 >> v2:172.21.15.146:3300/0 conn(0x7f1544099e20 0x7f154409a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.819+0000 7f1549c5b700 1 -- 172.21.15.146:0/1882688387 >> v1:172.21.15.146:6789/0 conn(0x7f154409a730 legacy=0x7f1544130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.819+0000 7f1549c5b700 1 -- 172.21.15.146:0/1882688387 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154409bb90 con 0x7f1544130a60 2023-10-03T10:14:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.819+0000 7f154945a700 1 --2- 172.21.15.146:0/1882688387 >> v2:172.21.15.146:3300/0 conn(0x7f1544099e20 0x7f154409a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:00.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.819+0000 7f54a5b86700 1 Processor -- start 2023-10-03T10:14:00.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.819+0000 7f1549c5b700 1 --2- 172.21.15.146:0/1882688387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1544130a60 0x7f1544138690 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f153800b8f0 tx=0x7f153800bc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=425b08d243d54d5d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.819+0000 7f54a5b86700 1 -- start start 2023-10-03T10:14:00.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.820+0000 7f54a5b86700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54a006a770 0x7f54a011a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.820+0000 7f54a5b86700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54a009dec0 0x7f54a011a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.820+0000 7f54a5b86700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54a0131a00 0x7f54a011ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.820+0000 7f54a5b86700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a011b660 con 0x7f54a0131a00 2023-10-03T10:14:00.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.820+0000 7f54a5b86700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a012d580 con 0x7f54a006a770 2023-10-03T10:14:00.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.820+0000 7f54a5b86700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54a011cff0 con 0x7f54a009dec0 2023-10-03T10:14:00.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.820+0000 7f549f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54a006a770 0x7f54a011a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.820+0000 7f1543fff700 1 -- 172.21.15.146:0/1882688387 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153800c9f0 con 0x7f1544130a60 2023-10-03T10:14:00.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.820+0000 7f1543fff700 1 -- 172.21.15.146:0/1882688387 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153800cb50 con 0x7f1544130a60 2023-10-03T10:14:00.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.820+0000 7f1543fff700 1 -- 172.21.15.146:0/1882688387 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153800f460 con 0x7f1544130a60 2023-10-03T10:14:00.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.820+0000 7f549f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54a006a770 0x7f54a011a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38716/0 (socket says 172.21.15.146:38716) 2023-10-03T10:14:00.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.820+0000 7f549f7fe700 1 -- 172.21.15.146:0/2752271003 learned_addr learned my addr 172.21.15.146:0/2752271003 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:00.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.820+0000 7f549ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54a0131a00 0x7f54a011ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.820+0000 7f5496ffd700 1 --2- 172.21.15.146:0/2752271003 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54a009dec0 0x7f54a011a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.821+0000 7f549f7fe700 1 -- 172.21.15.146:0/2752271003 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54a009dec0 msgr2=0x7f54a011a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.821+0000 7f549f7fe700 1 --2- 172.21.15.146:0/2752271003 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54a009dec0 0x7f54a011a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.821+0000 7f549f7fe700 1 -- 172.21.15.146:0/2752271003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54a0131a00 msgr2=0x7f54a011ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.821+0000 7f549f7fe700 1 --2- 172.21.15.146:0/2752271003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54a0131a00 0x7f54a011ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.821+0000 7f549f7fe700 1 -- 172.21.15.146:0/2752271003 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5490009550 con 0x7f54a006a770 2023-10-03T10:14:00.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.821+0000 7f5496ffd700 1 --2- 172.21.15.146:0/2752271003 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54a009dec0 0x7f54a011a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:00.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.821+0000 7f549f7fe700 1 --2- 172.21.15.146:0/2752271003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54a006a770 0x7f54a011a190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f549000ebb0 tx=0x7f549000eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.821+0000 7f549cff9700 1 -- 172.21.15.146:0/2752271003 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5490004030 con 0x7f54a006a770 2023-10-03T10:14:00.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.821+0000 7f549cff9700 1 -- 172.21.15.146:0/2752271003 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5490004190 con 0x7f54a006a770 2023-10-03T10:14:00.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.821+0000 7f549cff9700 1 -- 172.21.15.146:0/2752271003 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5490004520 con 0x7f54a006a770 2023-10-03T10:14:00.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.821+0000 7f154b6be700 1 -- 172.21.15.146:0/1882688387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1544130a60 msgr2=0x7f1544138690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.821+0000 7f154b6be700 1 --2- 172.21.15.146:0/1882688387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1544130a60 0x7f1544138690 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f153800b8f0 tx=0x7f153800bc00 comp rx=0 tx=0).stop 2023-10-03T10:14:00.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.821+0000 7f54a5b86700 1 -- 172.21.15.146:0/2752271003 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548800d940 con 0x7f54a006a770 2023-10-03T10:14:00.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.821+0000 7f54a5b86700 1 -- 172.21.15.146:0/2752271003 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a011d440 con 0x7f54a006a770 2023-10-03T10:14:00.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.821+0000 7f154b6be700 1 -- 172.21.15.146:0/1882688387 shutdown_connections 2023-10-03T10:14:00.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.821+0000 7f154b6be700 1 --2- 172.21.15.146:0/1882688387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1544130a60 0x7f1544138690 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.821+0000 7f154b6be700 1 --2- 172.21.15.146:0/1882688387 >> v2:172.21.15.146:3300/0 conn(0x7f1544099e20 0x7f154409a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.821+0000 7f154b6be700 1 -- 172.21.15.146:0/1882688387 >> 172.21.15.146:0/1882688387 conn(0x7f15440a2980 msgr2=0x7f15440a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.822+0000 7f154b6be700 1 -- 172.21.15.146:0/1882688387 shutdown_connections 2023-10-03T10:14:00.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.822+0000 7f154b6be700 1 -- 172.21.15.146:0/1882688387 wait complete. 2023-10-03T10:14:00.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.822+0000 7f549cff9700 1 -- 172.21.15.146:0/2752271003 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f549000c850 con 0x7f54a006a770 2023-10-03T10:14:00.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.822+0000 7f54a5b86700 1 -- 172.21.15.146:0/2752271003 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a0072250 con 0x7f54a006a770 2023-10-03T10:14:00.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.822+0000 7f549cff9700 1 -- 172.21.15.146:0/2752271003 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f549003f720 con 0x7f54a006a770 2023-10-03T10:14:00.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.823+0000 7f154b6be700 1 Processor -- start 2023-10-03T10:14:00.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.823+0000 7f154b6be700 1 -- start start 2023-10-03T10:14:00.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.823+0000 7f154b6be700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1544099e20 0x7f1544123450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.823+0000 7f154b6be700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f154409a730 0x7f1544123990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.823+0000 7f154b6be700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1544130a60 0x7f1544123ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.823+0000 7f154b6be700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1544124920 con 0x7f1544130a60 2023-10-03T10:14:00.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.823+0000 7f154b6be700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1544126d90 con 0x7f1544099e20 2023-10-03T10:14:00.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.823+0000 7f154b6be700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1544126f70 con 0x7f154409a730 2023-10-03T10:14:00.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.823+0000 7f1548c59700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f154409a730 0x7f1544123990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.823+0000 7f1549c5b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1544130a60 0x7f1544123ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.823+0000 7f1549c5b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1544130a60 0x7f1544123ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37658/0 (socket says 172.21.15.146:37658) 2023-10-03T10:14:00.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.823+0000 7f1549c5b700 1 -- 172.21.15.146:0/1446347198 learned_addr learned my addr 172.21.15.146:0/1446347198 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:00.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.824+0000 7f1548c59700 1 -- 172.21.15.146:0/1446347198 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1544099e20 msgr2=0x7f1544123450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.824+0000 7f1548c59700 1 --2- 172.21.15.146:0/1446347198 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1544099e20 0x7f1544123450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.824+0000 7f1548c59700 1 -- 172.21.15.146:0/1446347198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1544130a60 msgr2=0x7f1544123ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.824+0000 7f1548c59700 1 --2- 172.21.15.146:0/1446347198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1544130a60 0x7f1544123ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.824+0000 7f1548c59700 1 -- 172.21.15.146:0/1446347198 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c00d8d0 con 0x7f154409a730 2023-10-03T10:14:00.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.824+0000 7f1549c5b700 1 --2- 172.21.15.146:0/1446347198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1544130a60 0x7f1544123ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:00.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.824+0000 7f1548c59700 1 --2- 172.21.15.146:0/1446347198 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f154409a730 0x7f1544123990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f153400cbc0 tx=0x7f153400ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.824+0000 7f1541ffb700 1 -- 172.21.15.146:0/1446347198 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153400aa40 con 0x7f154409a730 2023-10-03T10:14:00.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.824+0000 7f1541ffb700 1 -- 172.21.15.146:0/1446347198 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153400aba0 con 0x7f154409a730 2023-10-03T10:14:00.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.824+0000 7f1541ffb700 1 -- 172.21.15.146:0/1446347198 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1534012400 con 0x7f154409a730 2023-10-03T10:14:00.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.824+0000 7f154b6be700 1 -- 172.21.15.146:0/1446347198 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f153800b550 con 0x7f154409a730 2023-10-03T10:14:00.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.825+0000 7f154b6be700 1 -- 172.21.15.146:0/1446347198 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15441269d0 con 0x7f154409a730 2023-10-03T10:14:00.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.825+0000 7f1541ffb700 1 -- 172.21.15.146:0/1446347198 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f153401b3b0 con 0x7f154409a730 2023-10-03T10:14:00.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.825+0000 7f1541ffb700 1 -- 172.21.15.146:0/1446347198 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f153403f2d0 con 0x7f154409a730 2023-10-03T10:14:00.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.826+0000 7f154b6be700 1 -- 172.21.15.146:0/1446347198 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f154404f2a0 con 0x7f154409a730 2023-10-03T10:14:00.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.827+0000 7f0950148700 1 Processor -- start 2023-10-03T10:14:00.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.827+0000 7f0950148700 1 -- start start 2023-10-03T10:14:00.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.828+0000 7f0950148700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09480a0a70 0x7f09480a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.828+0000 7f0950148700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09480a1380 0x7f0948133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.828+0000 7f0950148700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094809dc00 con 0x7f0948133f50 2023-10-03T10:14:00.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.828+0000 7f0950148700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f094809ea60 con 0x7f09480a1380 2023-10-03T10:14:00.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.828+0000 7f0950148700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094809dec0 con 0x7f09480a0a70 2023-10-03T10:14:00.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.828+0000 7f094dee4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09480a0a70 0x7f09480a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.828+0000 7f094dee4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09480a0a70 0x7f09480a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38734/0 (socket says 172.21.15.146:38734) 2023-10-03T10:14:00.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.828+0000 7f094dee4700 1 -- 172.21.15.146:0/2232159391 learned_addr learned my addr 172.21.15.146:0/2232159391 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:00.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.828+0000 7f094d6e3700 1 --2- 172.21.15.146:0/2232159391 >> v2:172.21.15.146:3300/0 conn(0x7f09480a1380 0x7f0948133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.828+0000 7f094dee4700 1 -- 172.21.15.146:0/2232159391 >> v2:172.21.15.146:3300/0 conn(0x7f09480a1380 msgr2=0x7f0948133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.828+0000 7f094dee4700 1 --2- 172.21.15.146:0/2232159391 >> v2:172.21.15.146:3300/0 conn(0x7f09480a1380 0x7f0948133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.828+0000 7f094dee4700 1 -- 172.21.15.146:0/2232159391 >> v1:172.21.15.146:6789/0 conn(0x7f0948133f50 legacy=0x7f094813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.828+0000 7f094cee2700 1 -- 172.21.15.146:0/2232159391 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557857886 0 0) 0x7f094809dc00 con 0x7f0948133f50 2023-10-03T10:14:00.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.828+0000 7f094dee4700 1 -- 172.21.15.146:0/2232159391 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094809e6a0 con 0x7f09480a0a70 2023-10-03T10:14:00.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.828+0000 7f094d6e3700 1 --2- 172.21.15.146:0/2232159391 >> v2:172.21.15.146:3300/0 conn(0x7f09480a1380 0x7f0948133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:00.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.828+0000 7f549cff9700 1 -- 172.21.15.146:0/2752271003 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f54900036a0 con 0x7f54a006a770 2023-10-03T10:14:00.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.829+0000 7f094dee4700 1 --2- 172.21.15.146:0/2232159391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09480a0a70 0x7f09480a0e40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f09440098f0 tx=0x7f0944009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ab238e7aaa4f12a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.829+0000 7f094cee2700 1 -- 172.21.15.146:0/2232159391 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094400b8a0 con 0x7f09480a0a70 2023-10-03T10:14:00.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.829+0000 7f094cee2700 1 -- 172.21.15.146:0/2232159391 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094400ba00 con 0x7f09480a0a70 2023-10-03T10:14:00.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.829+0000 7f094cee2700 1 -- 172.21.15.146:0/2232159391 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094400bd90 con 0x7f09480a0a70 2023-10-03T10:14:00.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.829+0000 7f0950148700 1 -- 172.21.15.146:0/2232159391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09480a0a70 msgr2=0x7f09480a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.829+0000 7f0950148700 1 --2- 172.21.15.146:0/2232159391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09480a0a70 0x7f09480a0e40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f09440098f0 tx=0x7f0944009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:00.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.830+0000 7f0950148700 1 -- 172.21.15.146:0/2232159391 shutdown_connections 2023-10-03T10:14:00.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.830+0000 7f0950148700 1 --2- 172.21.15.146:0/2232159391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09480a0a70 0x7f09480a0e40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.830+0000 7f0950148700 1 --2- 172.21.15.146:0/2232159391 >> v2:172.21.15.146:3300/0 conn(0x7f09480a1380 0x7f0948133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.830+0000 7f0950148700 1 -- 172.21.15.146:0/2232159391 >> 172.21.15.146:0/2232159391 conn(0x7f09480a6610 msgr2=0x7f09480a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.830+0000 7f0950148700 1 -- 172.21.15.146:0/2232159391 shutdown_connections 2023-10-03T10:14:00.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.830+0000 7f0950148700 1 -- 172.21.15.146:0/2232159391 wait complete. 2023-10-03T10:14:00.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.831+0000 7f0950148700 1 Processor -- start 2023-10-03T10:14:00.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.831+0000 7f0950148700 1 -- start start 2023-10-03T10:14:00.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.831+0000 7f0950148700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09480a0a70 0x7f094811f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.831+0000 7f0950148700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09480a1380 0x7f094811f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.831+0000 7f0950148700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0948133f50 0x7f09481c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.831+0000 7f0950148700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094811eec0 con 0x7f09480a0a70 2023-10-03T10:14:00.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.831+0000 7f0950148700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0948133370 con 0x7f0948133f50 2023-10-03T10:14:00.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.831+0000 7f0950148700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0948122220 con 0x7f09480a1380 2023-10-03T10:14:00.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.831+0000 7f094d6e3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09480a1380 0x7f094811f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.831+0000 7f094d6e3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09480a1380 0x7f094811f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36448/0 (socket says 172.21.15.146:36448) 2023-10-03T10:14:00.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.831+0000 7f094d6e3700 1 -- 172.21.15.146:0/3731336596 learned_addr learned my addr 172.21.15.146:0/3731336596 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:00.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.831+0000 7f1541ffb700 1 -- 172.21.15.146:0/1446347198 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15340192c0 con 0x7f154409a730 2023-10-03T10:14:00.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.831+0000 7f094d6e3700 1 -- 172.21.15.146:0/3731336596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0948133f50 msgr2=0x7f09481c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.831+0000 7f094d6e3700 1 --2- 172.21.15.146:0/3731336596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0948133f50 0x7f09481c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.831+0000 7f094d6e3700 1 -- 172.21.15.146:0/3731336596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09480a0a70 msgr2=0x7f094811f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.831+0000 7f094d6e3700 1 --2- 172.21.15.146:0/3731336596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09480a0a70 0x7f094811f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.831+0000 7f094d6e3700 1 -- 172.21.15.146:0/3731336596 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0944009550 con 0x7f09480a1380 2023-10-03T10:14:00.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.832+0000 7f094d6e3700 1 --2- 172.21.15.146:0/3731336596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09480a1380 0x7f094811f7b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f093800c770 tx=0x7f093800cb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.832+0000 7f093e7fc700 1 -- 172.21.15.146:0/3731336596 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938004220 con 0x7f09480a1380 2023-10-03T10:14:00.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.832+0000 7f0950148700 1 -- 172.21.15.146:0/3731336596 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09481205f0 con 0x7f09480a1380 2023-10-03T10:14:00.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.832+0000 7f0950148700 1 -- 172.21.15.146:0/3731336596 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0948120de0 con 0x7f09480a1380 2023-10-03T10:14:00.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.832+0000 7f093e7fc700 1 -- 172.21.15.146:0/3731336596 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0938004380 con 0x7f09480a1380 2023-10-03T10:14:00.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.832+0000 7f093e7fc700 1 -- 172.21.15.146:0/3731336596 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09380036a0 con 0x7f09480a1380 2023-10-03T10:14:00.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.833+0000 7f0950148700 1 -- 172.21.15.146:0/3731336596 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09300052e0 con 0x7f09480a1380 2023-10-03T10:14:00.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.833+0000 7f093e7fc700 1 -- 172.21.15.146:0/3731336596 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0938003820 con 0x7f09480a1380 2023-10-03T10:14:00.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.834+0000 7f093e7fc700 1 -- 172.21.15.146:0/3731336596 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f093803f5e0 con 0x7f09480a1380 2023-10-03T10:14:00.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:00.838+0000 7f093e7fc700 1 -- 172.21.15.146:0/3731336596 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0938020ae0 con 0x7f09480a1380 2023-10-03T10:14:01.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.002+0000 7f6d390ed700 1 -- 172.21.15.146:0/2183543636 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6d3404f2a0 con 0x7f6d34133ad0 2023-10-03T10:14:01.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.003+0000 7f6d1b7fe700 1 -- 172.21.15.146:0/2183543636 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6d2c02c090 con 0x7f6d34133ad0 2023-10-03T10:14:01.003 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.005+0000 7f6d390ed700 1 -- 172.21.15.146:0/2183543636 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d34133ad0 msgr2=0x7f6d3411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.005+0000 7f6d390ed700 1 --2- 172.21.15.146:0/2183543636 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d34133ad0 0x7f6d3411e4c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c009d90 tx=0x7f6d2c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.005+0000 7f6d390ed700 1 -- 172.21.15.146:0/2183543636 shutdown_connections 2023-10-03T10:14:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.005+0000 7f6d390ed700 1 --2- 172.21.15.146:0/2183543636 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d34133ad0 0x7f6d3411e4c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.005+0000 7f6d390ed700 1 --2- 172.21.15.146:0/2183543636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d341300a0 0x7f6d3411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.005+0000 7f6d390ed700 1 --2- 172.21.15.146:0/2183543636 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d341309f0 0x7f6d3411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.005+0000 7f6d390ed700 1 -- 172.21.15.146:0/2183543636 >> 172.21.15.146:0/2183543636 conn(0x7f6d34099c40 msgr2=0x7f6d3412e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.005+0000 7f6d390ed700 1 -- 172.21.15.146:0/2183543636 shutdown_connections 2023-10-03T10:14:01.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.005+0000 7f6d390ed700 1 -- 172.21.15.146:0/2183543636 wait complete. 2023-10-03T10:14:01.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:01.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.036+0000 7f154b6be700 1 -- 172.21.15.146:0/1446347198 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1544072480 con 0x7f154409a730 2023-10-03T10:14:01.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.036+0000 7f1541ffb700 1 -- 172.21.15.146:0/1446347198 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1544072480 con 0x7f154409a730 2023-10-03T10:14:01.036 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:01.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.038+0000 7f54a5b86700 1 -- 172.21.15.146:0/2752271003 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f54a011d910 con 0x7f54a006a770 2023-10-03T10:14:01.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.038+0000 7f549cff9700 1 -- 172.21.15.146:0/2752271003 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5490013e60 con 0x7f54a006a770 2023-10-03T10:14:01.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.038+0000 7f154b6be700 1 -- 172.21.15.146:0/1446347198 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f154409a730 msgr2=0x7f1544123990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.038+0000 7f154b6be700 1 --2- 172.21.15.146:0/1446347198 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f154409a730 0x7f1544123990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f153400cbc0 tx=0x7f153400ced0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.038 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:01.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.038+0000 7f154b6be700 1 -- 172.21.15.146:0/1446347198 shutdown_connections 2023-10-03T10:14:01.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.038+0000 7f154b6be700 1 --2- 172.21.15.146:0/1446347198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1544130a60 0x7f1544123ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.038+0000 7f154b6be700 1 --2- 172.21.15.146:0/1446347198 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1544099e20 0x7f1544123450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.038+0000 7f154b6be700 1 --2- 172.21.15.146:0/1446347198 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f154409a730 0x7f1544123990 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.038+0000 7f154b6be700 1 -- 172.21.15.146:0/1446347198 >> 172.21.15.146:0/1446347198 conn(0x7f15440a2980 msgr2=0x7f154406df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.038+0000 7f154b6be700 1 -- 172.21.15.146:0/1446347198 shutdown_connections 2023-10-03T10:14:01.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.038+0000 7f154b6be700 1 -- 172.21.15.146:0/1446347198 wait complete. 2023-10-03T10:14:01.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.040+0000 7f54a5b86700 1 -- 172.21.15.146:0/2752271003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54a006a770 msgr2=0x7f54a011a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.040+0000 7f54a5b86700 1 --2- 172.21.15.146:0/2752271003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54a006a770 0x7f54a011a190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f549000ebb0 tx=0x7f549000eec0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.041+0000 7f54a5b86700 1 -- 172.21.15.146:0/2752271003 shutdown_connections 2023-10-03T10:14:01.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.041+0000 7f54a5b86700 1 --2- 172.21.15.146:0/2752271003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54a0131a00 0x7f54a011ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.041+0000 7f54a5b86700 1 --2- 172.21.15.146:0/2752271003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54a006a770 0x7f54a011a190 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.041+0000 7f54a5b86700 1 --2- 172.21.15.146:0/2752271003 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54a009dec0 0x7f54a011a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.041+0000 7f54a5b86700 1 -- 172.21.15.146:0/2752271003 >> 172.21.15.146:0/2752271003 conn(0x7f54a0099c40 msgr2=0x7f54a012efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.041+0000 7f54a5b86700 1 -- 172.21.15.146:0/2752271003 shutdown_connections 2023-10-03T10:14:01.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.041+0000 7f54a5b86700 1 -- 172.21.15.146:0/2752271003 wait complete. 2023-10-03T10:14:01.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:01.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:01.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.059+0000 7f0950148700 1 -- 172.21.15.146:0/3731336596 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0930005590 con 0x7f09480a1380 2023-10-03T10:14:01.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.059+0000 7f093e7fc700 1 -- 172.21.15.146:0/3731336596 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0938020300 con 0x7f09480a1380 2023-10-03T10:14:01.059 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:01.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.061+0000 7f0950148700 1 -- 172.21.15.146:0/3731336596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09480a1380 msgr2=0x7f094811f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.061+0000 7f0950148700 1 --2- 172.21.15.146:0/3731336596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09480a1380 0x7f094811f7b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f093800c770 tx=0x7f093800cb30 comp rx=0 tx=0).stop 2023-10-03T10:14:01.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.061+0000 7f0950148700 1 -- 172.21.15.146:0/3731336596 shutdown_connections 2023-10-03T10:14:01.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.061+0000 7f0950148700 1 --2- 172.21.15.146:0/3731336596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0948133f50 0x7f09481c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.061+0000 7f0950148700 1 --2- 172.21.15.146:0/3731336596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09480a0a70 0x7f094811f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.061+0000 7f0950148700 1 --2- 172.21.15.146:0/3731336596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09480a1380 0x7f094811f7b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.061+0000 7f0950148700 1 -- 172.21.15.146:0/3731336596 >> 172.21.15.146:0/3731336596 conn(0x7f09480a6610 msgr2=0x7f09480a5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.062+0000 7f0950148700 1 -- 172.21.15.146:0/3731336596 shutdown_connections 2023-10-03T10:14:01.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:01.062+0000 7f0950148700 1 -- 172.21.15.146:0/3731336596 wait complete. 2023-10-03T10:14:01.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:02.019 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:02.053 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:02.054 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:02.074 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:02.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.168+0000 7f2a8213e700 1 Processor -- start 2023-10-03T10:14:02.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.168+0000 7f2a8213e700 1 -- start start 2023-10-03T10:14:02.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.168+0000 7f2a8213e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a7c133ad0 0x7f2a7c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.168+0000 7f2a8213e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a7c130bc0 0x7f2a7c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.168+0000 7f2a8213e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7c06b2d0 con 0x7f2a7c1300a0 2023-10-03T10:14:02.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.168+0000 7f2a8213e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c133610 con 0x7f2a7c133ad0 2023-10-03T10:14:02.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.168+0000 7f2a8213e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c09a500 con 0x7f2a7c130bc0 2023-10-03T10:14:02.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.168+0000 7f2a7affd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2a7c1300a0 0x7f2a7c1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45762/0 (socket says 172.21.15.146:45762) 2023-10-03T10:14:02.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.168+0000 7f2a7affd700 1 -- 172.21.15.146:0/196526583 learned_addr learned my addr 172.21.15.146:0/196526583 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:02.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.168+0000 7f2a7b7fe700 1 --2- 172.21.15.146:0/196526583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a7c133ad0 0x7f2a7c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.169+0000 7f2a7a7fc700 1 -- 172.21.15.146:0/196526583 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202802006 0 0) 0x7f2a7c06b2d0 con 0x7f2a7c1300a0 2023-10-03T10:14:02.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.169+0000 7f2a7b7fe700 1 -- 172.21.15.146:0/196526583 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a7c130bc0 msgr2=0x7f2a7c13b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:02.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.169+0000 7f2a7b7fe700 1 --2- 172.21.15.146:0/196526583 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a7c130bc0 0x7f2a7c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.169+0000 7f2a7b7fe700 1 -- 172.21.15.146:0/196526583 >> v1:172.21.15.146:6789/0 conn(0x7f2a7c1300a0 legacy=0x7f2a7c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.169+0000 7f2a7b7fe700 1 -- 172.21.15.146:0/196526583 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c1338b0 con 0x7f2a7c133ad0 2023-10-03T10:14:02.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.169+0000 7f2a7b7fe700 1 --2- 172.21.15.146:0/196526583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a7c133ad0 0x7f2a7c133ea0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c009870 tx=0x7f2a6c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eab817900d4a8ad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:02.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.169+0000 7f2a7a7fc700 1 -- 172.21.15.146:0/196526583 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c011830 con 0x7f2a7c133ad0 2023-10-03T10:14:02.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.169+0000 7f2a7a7fc700 1 -- 172.21.15.146:0/196526583 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6c011990 con 0x7f2a7c133ad0 2023-10-03T10:14:02.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.169+0000 7f2a7a7fc700 1 -- 172.21.15.146:0/196526583 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c011d20 con 0x7f2a7c133ad0 2023-10-03T10:14:02.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.170+0000 7f2a8213e700 1 -- 172.21.15.146:0/196526583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a7c133ad0 msgr2=0x7f2a7c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.170+0000 7f2a8213e700 1 --2- 172.21.15.146:0/196526583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a7c133ad0 0x7f2a7c133ea0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c009870 tx=0x7f2a6c009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:02.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.170+0000 7f2a8213e700 1 -- 172.21.15.146:0/196526583 shutdown_connections 2023-10-03T10:14:02.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.170+0000 7f2a8213e700 1 --2- 172.21.15.146:0/196526583 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a7c130bc0 0x7f2a7c13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.170+0000 7f2a8213e700 1 --2- 172.21.15.146:0/196526583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a7c133ad0 0x7f2a7c133ea0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.170+0000 7f2a8213e700 1 -- 172.21.15.146:0/196526583 >> 172.21.15.146:0/196526583 conn(0x7f2a7c099c40 msgr2=0x7f2a7c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:02.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.170+0000 7f2a8213e700 1 -- 172.21.15.146:0/196526583 shutdown_connections 2023-10-03T10:14:02.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.170+0000 7f2a8213e700 1 -- 172.21.15.146:0/196526583 wait complete. 2023-10-03T10:14:02.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.171+0000 7f2a8213e700 1 Processor -- start 2023-10-03T10:14:02.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.172+0000 7f2a8213e700 1 -- start start 2023-10-03T10:14:02.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.172+0000 7f2a8213e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a7c1300a0 0x7f2a7c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.172+0000 7f2a8213e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a7c130bc0 0x7f2a7c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.172+0000 7f2a8213e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7c133ad0 0x7f2a7c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.172+0000 7f2a8213e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c11fde0 con 0x7f2a7c133ad0 2023-10-03T10:14:02.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.172+0000 7f2a8213e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c0a33c0 con 0x7f2a7c130bc0 2023-10-03T10:14:02.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.172+0000 7f2a8213e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c12dd00 con 0x7f2a7c1300a0 2023-10-03T10:14:02.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.173+0000 7f2a7b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a7c1300a0 0x7f2a7c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.173+0000 7f2a7b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a7c1300a0 0x7f2a7c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36464/0 (socket says 172.21.15.146:36464) 2023-10-03T10:14:02.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.173+0000 7f2a7affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a7c130bc0 0x7f2a7c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.173+0000 7f2a7b7fe700 1 -- 172.21.15.146:0/2817495588 learned_addr learned my addr 172.21.15.146:0/2817495588 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:02.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.173+0000 7f2a7bfff700 1 --2- 172.21.15.146:0/2817495588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7c133ad0 0x7f2a7c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.173+0000 7f2a7bfff700 1 -- 172.21.15.146:0/2817495588 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a7c1300a0 msgr2=0x7f2a7c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.173+0000 7f2a7bfff700 1 --2- 172.21.15.146:0/2817495588 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a7c1300a0 0x7f2a7c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.173+0000 7f2a7bfff700 1 -- 172.21.15.146:0/2817495588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a7c130bc0 msgr2=0x7f2a7c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.173+0000 7f2a7bfff700 1 --2- 172.21.15.146:0/2817495588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a7c130bc0 0x7f2a7c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.173+0000 7f2a7bfff700 1 -- 172.21.15.146:0/2817495588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6c0094a0 con 0x7f2a7c133ad0 2023-10-03T10:14:02.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.173+0000 7f2a7affd700 1 --2- 172.21.15.146:0/2817495588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a7c130bc0 0x7f2a7c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.173+0000 7f2a7bfff700 1 --2- 172.21.15.146:0/2817495588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7c133ad0 0x7f2a7c11e4c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2a74013f30 tx=0x7f2a74013f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:02.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.173+0000 7f2a63fff700 1 -- 172.21.15.146:0/2817495588 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7400fcc0 con 0x7f2a7c133ad0 2023-10-03T10:14:02.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.173+0000 7f2a63fff700 1 -- 172.21.15.146:0/2817495588 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7400fe40 con 0x7f2a7c133ad0 2023-10-03T10:14:02.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.173+0000 7f2a8213e700 1 -- 172.21.15.146:0/2817495588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a7c1200c0 con 0x7f2a7c133ad0 2023-10-03T10:14:02.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.173+0000 7f2a63fff700 1 -- 172.21.15.146:0/2817495588 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a74011310 con 0x7f2a7c133ad0 2023-10-03T10:14:02.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.174+0000 7f2a8213e700 1 -- 172.21.15.146:0/2817495588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7c11f850 con 0x7f2a7c133ad0 2023-10-03T10:14:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.175+0000 7f2a63fff700 1 -- 172.21.15.146:0/2817495588 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a74011470 con 0x7f2a7c133ad0 2023-10-03T10:14:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.175+0000 7f2a8213e700 1 -- 172.21.15.146:0/2817495588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a7c04f2a0 con 0x7f2a7c133ad0 2023-10-03T10:14:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.175+0000 7f2a63fff700 1 -- 172.21.15.146:0/2817495588 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2a74006e40 con 0x7f2a7c133ad0 2023-10-03T10:14:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.184+0000 7f2a63fff700 1 -- 172.21.15.146:0/2817495588 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a74011720 con 0x7f2a7c133ad0 2023-10-03T10:14:02.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.204+0000 7f73f1a5e700 1 Processor -- start 2023-10-03T10:14:02.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.204+0000 7f73f1a5e700 1 -- start start 2023-10-03T10:14:02.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.204+0000 7f73f1a5e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73ec09ad40 0x7f73ec133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.204+0000 7f73f1a5e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f73ec133f70 0x7f73ec1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.204+0000 7f73f1a5e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73ec0a0a70 0x7f73ec0a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.204+0000 7f73f1a5e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73ec0a3b60 con 0x7f73ec133f70 2023-10-03T10:14:02.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.204+0000 7f73f1a5e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec1348e0 con 0x7f73ec0a0a70 2023-10-03T10:14:02.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.204+0000 7f73f1a5e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec09b110 con 0x7f73ec09ad40 2023-10-03T10:14:02.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.204+0000 7f73eaffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73ec09ad40 0x7f73ec133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.205+0000 7f73eb7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73ec0a0a70 0x7f73ec0a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.205+0000 7f73eaffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73ec09ad40 0x7f73ec133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36474/0 (socket says 172.21.15.146:36474) 2023-10-03T10:14:02.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.205+0000 7f73eaffd700 1 -- 172.21.15.146:0/3694501814 learned_addr learned my addr 172.21.15.146:0/3694501814 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:02.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.205+0000 7f73ea7fc700 1 --2- 172.21.15.146:0/3694501814 >> v2:172.21.15.146:3300/0 conn(0x7f73ec133f70 0x7f73ec1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.205+0000 7f73eb7fe700 1 -- 172.21.15.146:0/3694501814 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73ec09ad40 msgr2=0x7f73ec133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:02.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.205+0000 7f73eb7fe700 1 --2- 172.21.15.146:0/3694501814 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73ec09ad40 0x7f73ec133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.205+0000 7f73eb7fe700 1 -- 172.21.15.146:0/3694501814 >> v2:172.21.15.146:3300/0 conn(0x7f73ec133f70 msgr2=0x7f73ec1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:02.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.205+0000 7f73eb7fe700 1 --2- 172.21.15.146:0/3694501814 >> v2:172.21.15.146:3300/0 conn(0x7f73ec133f70 0x7f73ec1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.205+0000 7f73eb7fe700 1 -- 172.21.15.146:0/3694501814 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec0a2fa0 con 0x7f73ec0a0a70 2023-10-03T10:14:02.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.205+0000 7f73eaffd700 1 --2- 172.21.15.146:0/3694501814 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73ec09ad40 0x7f73ec133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.205+0000 7f73eb7fe700 1 --2- 172.21.15.146:0/3694501814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73ec0a0a70 0x7f73ec0a0ed0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009d90 tx=0x7f73e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc16ad8cf9601fe1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:02.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.205+0000 7f73e9ffb700 1 -- 172.21.15.146:0/3694501814 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e400e070 con 0x7f73ec0a0a70 2023-10-03T10:14:02.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.205+0000 7f73e9ffb700 1 -- 172.21.15.146:0/3694501814 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e400bb20 con 0x7f73ec0a0a70 2023-10-03T10:14:02.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.205+0000 7f73e9ffb700 1 -- 172.21.15.146:0/3694501814 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e4012430 con 0x7f73ec0a0a70 2023-10-03T10:14:02.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.206+0000 7f73f1a5e700 1 -- 172.21.15.146:0/3694501814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73ec0a0a70 msgr2=0x7f73ec0a0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.206+0000 7f73f1a5e700 1 --2- 172.21.15.146:0/3694501814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73ec0a0a70 0x7f73ec0a0ed0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009d90 tx=0x7f73e400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:02.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.206+0000 7f73f1a5e700 1 -- 172.21.15.146:0/3694501814 shutdown_connections 2023-10-03T10:14:02.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.206+0000 7f73f1a5e700 1 --2- 172.21.15.146:0/3694501814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73ec0a0a70 0x7f73ec0a0ed0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.206+0000 7f73f1a5e700 1 --2- 172.21.15.146:0/3694501814 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73ec09ad40 0x7f73ec133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.206+0000 7f73f1a5e700 1 --2- 172.21.15.146:0/3694501814 >> v2:172.21.15.146:3300/0 conn(0x7f73ec133f70 0x7f73ec1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.206+0000 7f73f1a5e700 1 -- 172.21.15.146:0/3694501814 >> 172.21.15.146:0/3694501814 conn(0x7f73ec099c40 msgr2=0x7f73ec06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:02.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.206+0000 7f73f1a5e700 1 -- 172.21.15.146:0/3694501814 shutdown_connections 2023-10-03T10:14:02.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.206+0000 7f73f1a5e700 1 -- 172.21.15.146:0/3694501814 wait complete. 2023-10-03T10:14:02.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.208+0000 7f73f1a5e700 1 Processor -- start 2023-10-03T10:14:02.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.208+0000 7f73f1a5e700 1 -- start start 2023-10-03T10:14:02.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.208+0000 7f73f1a5e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73ec09ad40 0x7f73ec1213d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.208+0000 7f73f1a5e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73ec0a0a70 0x7f73ec121910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.208+0000 7f73f1a5e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73ec133f70 0x7f73ec121e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.208+0000 7f73f1a5e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec124ef0 con 0x7f73ec09ad40 2023-10-03T10:14:02.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.208+0000 7f73f1a5e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec1249e0 con 0x7f73ec133f70 2023-10-03T10:14:02.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.208+0000 7f73f1a5e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec123e70 con 0x7f73ec0a0a70 2023-10-03T10:14:02.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.209+0000 7f73eb7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73ec133f70 0x7f73ec121e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.209+0000 7f73eb7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73ec133f70 0x7f73ec121e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38782/0 (socket says 172.21.15.146:38782) 2023-10-03T10:14:02.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.209+0000 7f73eb7fe700 1 -- 172.21.15.146:0/13731177 learned_addr learned my addr 172.21.15.146:0/13731177 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:02.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.209+0000 7f73eaffd700 1 --2- 172.21.15.146:0/13731177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73ec09ad40 0x7f73ec1213d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.209+0000 7f73ea7fc700 1 --2- 172.21.15.146:0/13731177 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73ec0a0a70 0x7f73ec121910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.209+0000 7f73eb7fe700 1 -- 172.21.15.146:0/13731177 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73ec0a0a70 msgr2=0x7f73ec121910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.209+0000 7f73eb7fe700 1 --2- 172.21.15.146:0/13731177 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73ec0a0a70 0x7f73ec121910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.209+0000 7f73eb7fe700 1 -- 172.21.15.146:0/13731177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73ec09ad40 msgr2=0x7f73ec1213d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.209+0000 7f73eb7fe700 1 --2- 172.21.15.146:0/13731177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73ec09ad40 0x7f73ec1213d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.209+0000 7f73eb7fe700 1 -- 172.21.15.146:0/13731177 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc009550 con 0x7f73ec133f70 2023-10-03T10:14:02.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.209+0000 7f73ea7fc700 1 --2- 172.21.15.146:0/13731177 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73ec0a0a70 0x7f73ec121910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.209+0000 7f6c72b36700 1 Processor -- start 2023-10-03T10:14:02.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.209+0000 7f6c72b36700 1 -- start start 2023-10-03T10:14:02.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.209+0000 7f73eb7fe700 1 --2- 172.21.15.146:0/13731177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73ec133f70 0x7f73ec121e50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f73e400b680 tx=0x7f73e4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:02.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.210+0000 7f73d3fff700 1 -- 172.21.15.146:0/13731177 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e4012430 con 0x7f73ec133f70 2023-10-03T10:14:02.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.210+0000 7f73d3fff700 1 -- 172.21.15.146:0/13731177 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e4020070 con 0x7f73ec133f70 2023-10-03T10:14:02.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.210+0000 7f73d3fff700 1 -- 172.21.15.146:0/13731177 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e4004280 con 0x7f73ec133f70 2023-10-03T10:14:02.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.210+0000 7f73f1a5e700 1 -- 172.21.15.146:0/13731177 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e4009a70 con 0x7f73ec133f70 2023-10-03T10:14:02.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.210+0000 7f73f1a5e700 1 -- 172.21.15.146:0/13731177 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73ec09c7e0 con 0x7f73ec133f70 2023-10-03T10:14:02.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.210+0000 7f6c72b36700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c6c09d860 0x7f6c6c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.210+0000 7f6c72b36700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6c6c130eb0 0x7f6c6c139c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.210+0000 7f6c72b36700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c6c09aaa0 con 0x7f6c6c09e170 2023-10-03T10:14:02.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.210+0000 7f6c72b36700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6c09f870 con 0x7f6c6c130eb0 2023-10-03T10:14:02.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.210+0000 7f6c72b36700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c09b360 con 0x7f6c6c09d860 2023-10-03T10:14:02.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.210+0000 7f6c710d3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6c6c130eb0 0x7f6c6c139c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.210+0000 7f6c710d3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6c6c130eb0 0x7f6c6c139c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37722/0 (socket says 172.21.15.146:37722) 2023-10-03T10:14:02.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.210+0000 7f6c710d3700 1 -- 172.21.15.146:0/618336612 learned_addr learned my addr 172.21.15.146:0/618336612 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:02.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.210+0000 7f6c708d2700 1 --2- 172.21.15.146:0/618336612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c6c09d860 0x7f6c6c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.211+0000 7f6c708d2700 1 -- 172.21.15.146:0/618336612 >> v2:172.21.15.146:3300/0 conn(0x7f6c6c130eb0 msgr2=0x7f6c6c139c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:02.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.211+0000 7f6c708d2700 1 --2- 172.21.15.146:0/618336612 >> v2:172.21.15.146:3300/0 conn(0x7f6c6c130eb0 0x7f6c6c139c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.211+0000 7f6c708d2700 1 -- 172.21.15.146:0/618336612 >> v1:172.21.15.146:6789/0 conn(0x7f6c6c09e170 legacy=0x7f6c6c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:02.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.211+0000 7f6c708d2700 1 -- 172.21.15.146:0/618336612 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6c09b620 con 0x7f6c6c09d860 2023-10-03T10:14:02.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.211+0000 7f6c708d2700 1 --2- 172.21.15.146:0/618336612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c6c09d860 0x7f6c6c09dc30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6c64009840 tx=0x7f6c64009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed3ae68436fff3a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:02.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.211+0000 7f6c6b7fe700 1 -- 172.21.15.146:0/618336612 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64004230 con 0x7f6c6c09d860 2023-10-03T10:14:02.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.211+0000 7f6c6b7fe700 1 -- 172.21.15.146:0/618336612 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c64004390 con 0x7f6c6c09d860 2023-10-03T10:14:02.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.211+0000 7f6c6b7fe700 1 -- 172.21.15.146:0/618336612 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c640036a0 con 0x7f6c6c09d860 2023-10-03T10:14:02.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.211+0000 7f73d3fff700 1 -- 172.21.15.146:0/13731177 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f73e40043e0 con 0x7f73ec133f70 2023-10-03T10:14:02.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.211+0000 7f73f1a5e700 1 -- 172.21.15.146:0/13731177 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73ec11e060 con 0x7f73ec133f70 2023-10-03T10:14:02.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.211+0000 7f73d3fff700 1 -- 172.21.15.146:0/13731177 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f73e4022070 con 0x7f73ec133f70 2023-10-03T10:14:02.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.212+0000 7f6c72b36700 1 -- 172.21.15.146:0/618336612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c6c09d860 msgr2=0x7f6c6c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.212+0000 7f6c72b36700 1 --2- 172.21.15.146:0/618336612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c6c09d860 0x7f6c6c09dc30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6c64009840 tx=0x7f6c64009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:02.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.212+0000 7f6c72b36700 1 -- 172.21.15.146:0/618336612 shutdown_connections 2023-10-03T10:14:02.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.212+0000 7f6c72b36700 1 --2- 172.21.15.146:0/618336612 >> v2:172.21.15.146:3300/0 conn(0x7f6c6c130eb0 0x7f6c6c139c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.212+0000 7f6c72b36700 1 --2- 172.21.15.146:0/618336612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c6c09d860 0x7f6c6c09dc30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.212+0000 7f6c72b36700 1 -- 172.21.15.146:0/618336612 >> 172.21.15.146:0/618336612 conn(0x7f6c6c099c40 msgr2=0x7f6c6c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.212+0000 7f6c72b36700 1 -- 172.21.15.146:0/618336612 shutdown_connections 2023-10-03T10:14:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.212+0000 7f6c72b36700 1 -- 172.21.15.146:0/618336612 wait complete. 2023-10-03T10:14:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.213+0000 7f6c72b36700 1 Processor -- start 2023-10-03T10:14:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.213+0000 7f6c72b36700 1 -- start start 2023-10-03T10:14:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.213+0000 7f6c72b36700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c6c09d860 0x7f6c6c11e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.213+0000 7f6c72b36700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c6c09e170 0x7f6c6c11ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.213+0000 7f6c72b36700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c6c130eb0 0x7f6c6c11f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.213+0000 7f6c72b36700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c120110 con 0x7f6c6c130eb0 2023-10-03T10:14:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.213+0000 7f6c72b36700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c120730 con 0x7f6c6c09d860 2023-10-03T10:14:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.213+0000 7f6c72b36700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c130460 con 0x7f6c6c09e170 2023-10-03T10:14:02.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.214+0000 7f6c710d3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c6c130eb0 0x7f6c6c11f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.214+0000 7f6c708d2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c6c09d860 0x7f6c6c11e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.214+0000 7f6c710d3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c6c130eb0 0x7f6c6c11f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37726/0 (socket says 172.21.15.146:37726) 2023-10-03T10:14:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.214+0000 7f6c710d3700 1 -- 172.21.15.146:0/241325766 learned_addr learned my addr 172.21.15.146:0/241325766 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.214+0000 7f6c6bfff700 1 --2- 172.21.15.146:0/241325766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c6c09e170 0x7f6c6c11ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.214+0000 7f6c710d3700 1 -- 172.21.15.146:0/241325766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c6c09e170 msgr2=0x7f6c6c11ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.214+0000 7f6c710d3700 1 --2- 172.21.15.146:0/241325766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c6c09e170 0x7f6c6c11ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.214+0000 7f6c710d3700 1 -- 172.21.15.146:0/241325766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c6c09d860 msgr2=0x7f6c6c11e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.214+0000 7f6c710d3700 1 --2- 172.21.15.146:0/241325766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c6c09d860 0x7f6c6c11e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.214+0000 7f6c710d3700 1 -- 172.21.15.146:0/241325766 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c640094a0 con 0x7f6c6c130eb0 2023-10-03T10:14:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.214+0000 7f6c710d3700 1 --2- 172.21.15.146:0/241325766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c6c130eb0 0x7f6c6c11f010 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c004320 tx=0x7f6c5c004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.214+0000 7f6c697fa700 1 -- 172.21.15.146:0/241325766 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c019040 con 0x7f6c6c130eb0 2023-10-03T10:14:02.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.214+0000 7f6c697fa700 1 -- 172.21.15.146:0/241325766 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c0114e0 con 0x7f6c6c130eb0 2023-10-03T10:14:02.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.214+0000 7f6c697fa700 1 -- 172.21.15.146:0/241325766 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c003ad0 con 0x7f6c6c130eb0 2023-10-03T10:14:02.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.214+0000 7f6c72b36700 1 -- 172.21.15.146:0/241325766 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c6c122080 con 0x7f6c6c130eb0 2023-10-03T10:14:02.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.214+0000 7f6c72b36700 1 -- 172.21.15.146:0/241325766 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c6c121d40 con 0x7f6c6c130eb0 2023-10-03T10:14:02.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.215+0000 7f6c697fa700 1 -- 172.21.15.146:0/241325766 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c5c011890 con 0x7f6c6c130eb0 2023-10-03T10:14:02.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.215+0000 7f6c72b36700 1 -- 172.21.15.146:0/241325766 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c6c06be10 con 0x7f6c6c130eb0 2023-10-03T10:14:02.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.216+0000 7f6c697fa700 1 -- 172.21.15.146:0/241325766 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6c5c048260 con 0x7f6c6c130eb0 2023-10-03T10:14:02.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.220+0000 7f6c697fa700 1 -- 172.21.15.146:0/241325766 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c5c024270 con 0x7f6c6c130eb0 2023-10-03T10:14:02.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.220+0000 7f73d3fff700 1 -- 172.21.15.146:0/13731177 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73e4003e10 con 0x7f73ec133f70 2023-10-03T10:14:02.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.246+0000 7f1747ac1700 1 Processor -- start 2023-10-03T10:14:02.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.246+0000 7f1747ac1700 1 -- start start 2023-10-03T10:14:02.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.246+0000 7f1747ac1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1740131980 0x7f1740131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.246+0000 7f1747ac1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f174009bc70 0x7f174009c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.246+0000 7f1747ac1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17400a1640 con 0x7f174009c5c0 2023-10-03T10:14:02.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.246+0000 7f1747ac1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174006eb30 con 0x7f1740131980 2023-10-03T10:14:02.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.246+0000 7f1747ac1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17400a22d0 con 0x7f174009bc70 2023-10-03T10:14:02.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.247+0000 7f174585d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1740131980 0x7f1740131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.247+0000 7f174605e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f174009c5c0 0x7f1740138700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45788/0 (socket says 172.21.15.146:45788) 2023-10-03T10:14:02.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.247+0000 7f174605e700 1 -- 172.21.15.146:0/2446384689 learned_addr learned my addr 172.21.15.146:0/2446384689 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:02.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.247+0000 7f174585d700 1 -- 172.21.15.146:0/2446384689 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f174009bc70 msgr2=0x7f174009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:02.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.247+0000 7f174505c700 1 --2- 172.21.15.146:0/2446384689 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f174009bc70 0x7f174009c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.247+0000 7f174485b700 1 -- 172.21.15.146:0/2446384689 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3661623277 0 0) 0x7f17400a1640 con 0x7f174009c5c0 2023-10-03T10:14:02.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.247+0000 7f174585d700 1 --2- 172.21.15.146:0/2446384689 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f174009bc70 0x7f174009c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.247+0000 7f174585d700 1 -- 172.21.15.146:0/2446384689 >> v1:172.21.15.146:6789/0 conn(0x7f174009c5c0 legacy=0x7f1740138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.247+0000 7f174585d700 1 -- 172.21.15.146:0/2446384689 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1740131550 con 0x7f1740131980 2023-10-03T10:14:02.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.247+0000 7f174505c700 1 --2- 172.21.15.146:0/2446384689 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f174009bc70 0x7f174009c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:02.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.247+0000 7f174585d700 1 --2- 172.21.15.146:0/2446384689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1740131980 0x7f1740131d50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f173c009820 tx=0x7f173c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a19587323c0208 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:02.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.247+0000 7f174485b700 1 -- 172.21.15.146:0/2446384689 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c005e30 con 0x7f1740131980 2023-10-03T10:14:02.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.247+0000 7f174485b700 1 -- 172.21.15.146:0/2446384689 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173c006030 con 0x7f1740131980 2023-10-03T10:14:02.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.247+0000 7f174485b700 1 -- 172.21.15.146:0/2446384689 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c0063e0 con 0x7f1740131980 2023-10-03T10:14:02.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.248+0000 7f1747ac1700 1 -- 172.21.15.146:0/2446384689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1740131980 msgr2=0x7f1740131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.248+0000 7f1747ac1700 1 --2- 172.21.15.146:0/2446384689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1740131980 0x7f1740131d50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f173c009820 tx=0x7f173c009b30 comp rx=0 tx=0).stop 2023-10-03T10:14:02.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.248+0000 7f1747ac1700 1 -- 172.21.15.146:0/2446384689 shutdown_connections 2023-10-03T10:14:02.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.248+0000 7f1747ac1700 1 --2- 172.21.15.146:0/2446384689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1740131980 0x7f1740131d50 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.248+0000 7f1747ac1700 1 --2- 172.21.15.146:0/2446384689 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f174009bc70 0x7f174009c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.248+0000 7f1747ac1700 1 -- 172.21.15.146:0/2446384689 >> 172.21.15.146:0/2446384689 conn(0x7f17400a2980 msgr2=0x7f17400a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:02.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.248+0000 7f1747ac1700 1 -- 172.21.15.146:0/2446384689 shutdown_connections 2023-10-03T10:14:02.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.248+0000 7f1747ac1700 1 -- 172.21.15.146:0/2446384689 wait complete. 2023-10-03T10:14:02.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.249+0000 7f1747ac1700 1 Processor -- start 2023-10-03T10:14:02.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.249+0000 7f1747ac1700 1 -- start start 2023-10-03T10:14:02.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.250+0000 7f1747ac1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f174009bc70 0x7f174012a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.250+0000 7f1747ac1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f174009c5c0 0x7f174012abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.250+0000 7f1747ac1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1740131980 0x7f174012b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.250+0000 7f1747ac1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174007bbe0 con 0x7f174009c5c0 2023-10-03T10:14:02.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.250+0000 7f1747ac1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17400a1cd0 con 0x7f1740131980 2023-10-03T10:14:02.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.250+0000 7f1747ac1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f174007c8e0 con 0x7f174009bc70 2023-10-03T10:14:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.250+0000 7f174605e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1740131980 0x7f174012b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.250+0000 7f174585d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f174009bc70 0x7f174012a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.250+0000 7f174605e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1740131980 0x7f174012b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38822/0 (socket says 172.21.15.146:38822) 2023-10-03T10:14:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.250+0000 7f174585d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f174009bc70 0x7f174012a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36508/0 (socket says 172.21.15.146:36508) 2023-10-03T10:14:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.250+0000 7f174605e700 1 -- 172.21.15.146:0/1264412471 learned_addr learned my addr 172.21.15.146:0/1264412471 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.250+0000 7f174505c700 1 --2- 172.21.15.146:0/1264412471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f174009c5c0 0x7f174012abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.250+0000 7f174585d700 1 -- 172.21.15.146:0/1264412471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1740131980 msgr2=0x7f174012b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.250+0000 7f174585d700 1 --2- 172.21.15.146:0/1264412471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1740131980 0x7f174012b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.250+0000 7f174585d700 1 -- 172.21.15.146:0/1264412471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f174009c5c0 msgr2=0x7f174012abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.250+0000 7f174585d700 1 --2- 172.21.15.146:0/1264412471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f174009c5c0 0x7f174012abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.250+0000 7f174585d700 1 -- 172.21.15.146:0/1264412471 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c009430 con 0x7f174009bc70 2023-10-03T10:14:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.250+0000 7f174505c700 1 --2- 172.21.15.146:0/1264412471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f174009c5c0 0x7f174012abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.250+0000 7f174585d700 1 --2- 172.21.15.146:0/1264412471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f174009bc70 0x7f174012a670 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f173c015000 tx=0x7f173c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:02.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.251+0000 7f17367fc700 1 -- 172.21.15.146:0/1264412471 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c025670 con 0x7f174009bc70 2023-10-03T10:14:02.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.251+0000 7f17367fc700 1 -- 172.21.15.146:0/1264412471 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173c025810 con 0x7f174009bc70 2023-10-03T10:14:02.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.251+0000 7f17367fc700 1 -- 172.21.15.146:0/1264412471 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c025bc0 con 0x7f174009bc70 2023-10-03T10:14:02.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.251+0000 7f1747ac1700 1 -- 172.21.15.146:0/1264412471 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1740130a40 con 0x7f174009bc70 2023-10-03T10:14:02.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.251+0000 7f1747ac1700 1 -- 172.21.15.146:0/1264412471 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174007daf0 con 0x7f174009bc70 2023-10-03T10:14:02.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.252+0000 7f1747ac1700 1 -- 172.21.15.146:0/1264412471 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174004f2a0 con 0x7f174009bc70 2023-10-03T10:14:02.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.252+0000 7f17367fc700 1 -- 172.21.15.146:0/1264412471 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f173c022070 con 0x7f174009bc70 2023-10-03T10:14:02.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.252+0000 7f17367fc700 1 -- 172.21.15.146:0/1264412471 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f173c041310 con 0x7f174009bc70 2023-10-03T10:14:02.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.261+0000 7f17367fc700 1 -- 172.21.15.146:0/1264412471 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f173c00b7f0 con 0x7f174009bc70 2023-10-03T10:14:02.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.387+0000 7f2a8213e700 1 -- 172.21.15.146:0/2817495588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2a7c11f400 con 0x7f2a7c133ad0 2023-10-03T10:14:02.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.388+0000 7f2a63fff700 1 -- 172.21.15.146:0/2817495588 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2a740228d0 con 0x7f2a7c133ad0 2023-10-03T10:14:02.388 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:02.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.391+0000 7f2a8213e700 1 -- 172.21.15.146:0/2817495588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7c133ad0 msgr2=0x7f2a7c11e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.391+0000 7f2a8213e700 1 --2- 172.21.15.146:0/2817495588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7c133ad0 0x7f2a7c11e4c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2a74013f30 tx=0x7f2a74013f60 comp rx=0 tx=0).stop 2023-10-03T10:14:02.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.391+0000 7f2a8213e700 1 -- 172.21.15.146:0/2817495588 shutdown_connections 2023-10-03T10:14:02.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.391+0000 7f2a8213e700 1 --2- 172.21.15.146:0/2817495588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a7c133ad0 0x7f2a7c11e4c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.391+0000 7f2a8213e700 1 --2- 172.21.15.146:0/2817495588 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a7c1300a0 0x7f2a7c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.391+0000 7f2a8213e700 1 --2- 172.21.15.146:0/2817495588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a7c130bc0 0x7f2a7c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.391+0000 7f2a8213e700 1 -- 172.21.15.146:0/2817495588 >> 172.21.15.146:0/2817495588 conn(0x7f2a7c099c40 msgr2=0x7f2a7c132040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:02.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.391+0000 7f2a8213e700 1 -- 172.21.15.146:0/2817495588 shutdown_connections 2023-10-03T10:14:02.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.391+0000 7f2a8213e700 1 -- 172.21.15.146:0/2817495588 wait complete. 2023-10-03T10:14:02.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:02.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.417+0000 7f73f1a5e700 1 -- 172.21.15.146:0/13731177 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f73ec04f2a0 con 0x7f73ec133f70 2023-10-03T10:14:02.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.418+0000 7f73d3fff700 1 -- 172.21.15.146:0/13731177 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f73e401a380 con 0x7f73ec133f70 2023-10-03T10:14:02.417 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:02.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.420+0000 7f73f1a5e700 1 -- 172.21.15.146:0/13731177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73ec133f70 msgr2=0x7f73ec121e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.420+0000 7f73f1a5e700 1 --2- 172.21.15.146:0/13731177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73ec133f70 0x7f73ec121e50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f73e400b680 tx=0x7f73e4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.420+0000 7f73f1a5e700 1 -- 172.21.15.146:0/13731177 shutdown_connections 2023-10-03T10:14:02.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.420+0000 7f73f1a5e700 1 --2- 172.21.15.146:0/13731177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73ec133f70 0x7f73ec121e50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.420+0000 7f73f1a5e700 1 --2- 172.21.15.146:0/13731177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73ec09ad40 0x7f73ec1213d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.420+0000 7f73f1a5e700 1 --2- 172.21.15.146:0/13731177 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73ec0a0a70 0x7f73ec121910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.420+0000 7f73f1a5e700 1 -- 172.21.15.146:0/13731177 >> 172.21.15.146:0/13731177 conn(0x7f73ec099c40 msgr2=0x7f73ec0a6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:02.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.420+0000 7f6c72b36700 1 -- 172.21.15.146:0/241325766 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6c6c04f2a0 con 0x7f6c6c130eb0 2023-10-03T10:14:02.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.420+0000 7f73f1a5e700 1 -- 172.21.15.146:0/13731177 shutdown_connections 2023-10-03T10:14:02.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.420+0000 7f73f1a5e700 1 -- 172.21.15.146:0/13731177 wait complete. 2023-10-03T10:14:02.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.420+0000 7f6c697fa700 1 -- 172.21.15.146:0/241325766 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c5c023030 con 0x7f6c6c130eb0 2023-10-03T10:14:02.422 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:02.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.423+0000 7f6c72b36700 1 -- 172.21.15.146:0/241325766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c6c130eb0 msgr2=0x7f6c6c11f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.423+0000 7f6c72b36700 1 --2- 172.21.15.146:0/241325766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c6c130eb0 0x7f6c6c11f010 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c004320 tx=0x7f6c5c004630 comp rx=0 tx=0).stop 2023-10-03T10:14:02.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.423+0000 7f6c72b36700 1 -- 172.21.15.146:0/241325766 shutdown_connections 2023-10-03T10:14:02.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.423+0000 7f6c72b36700 1 --2- 172.21.15.146:0/241325766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c6c130eb0 0x7f6c6c11f010 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.423+0000 7f6c72b36700 1 --2- 172.21.15.146:0/241325766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c6c09d860 0x7f6c6c11e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.423+0000 7f6c72b36700 1 --2- 172.21.15.146:0/241325766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c6c09e170 0x7f6c6c11ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.423+0000 7f6c72b36700 1 -- 172.21.15.146:0/241325766 >> 172.21.15.146:0/241325766 conn(0x7f6c6c099c40 msgr2=0x7f6c6c070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:02.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.423+0000 7f6c72b36700 1 -- 172.21.15.146:0/241325766 shutdown_connections 2023-10-03T10:14:02.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.423+0000 7f6c72b36700 1 -- 172.21.15.146:0/241325766 wait complete. 2023-10-03T10:14:02.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:02.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:02.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.456+0000 7f1747ac1700 1 -- 172.21.15.146:0/1264412471 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f174006bce0 con 0x7f174009bc70 2023-10-03T10:14:02.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.457+0000 7f17367fc700 1 -- 172.21.15.146:0/1264412471 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f173c034070 con 0x7f174009bc70 2023-10-03T10:14:02.457 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:02.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.459+0000 7f1747ac1700 1 -- 172.21.15.146:0/1264412471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f174009bc70 msgr2=0x7f174012a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.459+0000 7f1747ac1700 1 --2- 172.21.15.146:0/1264412471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f174009bc70 0x7f174012a670 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f173c015000 tx=0x7f173c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:02.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.459+0000 7f1747ac1700 1 -- 172.21.15.146:0/1264412471 shutdown_connections 2023-10-03T10:14:02.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.459+0000 7f1747ac1700 1 --2- 172.21.15.146:0/1264412471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1740131980 0x7f174012b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.459+0000 7f1747ac1700 1 --2- 172.21.15.146:0/1264412471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f174009bc70 0x7f174012a670 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.459+0000 7f1747ac1700 1 --2- 172.21.15.146:0/1264412471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f174009c5c0 0x7f174012abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.459+0000 7f1747ac1700 1 -- 172.21.15.146:0/1264412471 >> 172.21.15.146:0/1264412471 conn(0x7f17400a2980 msgr2=0x7f17401b8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:02.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.459+0000 7f1747ac1700 1 -- 172.21.15.146:0/1264412471 shutdown_connections 2023-10-03T10:14:02.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:02.459+0000 7f1747ac1700 1 -- 172.21.15.146:0/1264412471 wait complete. 2023-10-03T10:14:02.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:03.405 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:03.435 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:03.437 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:03.471 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:03.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.545+0000 7f18ed6a0700 1 Processor -- start 2023-10-03T10:14:03.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.545+0000 7f18ed6a0700 1 -- start start 2023-10-03T10:14:03.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.545+0000 7f18ed6a0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e809e870 0x7f18e809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.545+0000 7f18ed6a0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18e809f180 0x7f18e8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.545+0000 7f18ed6a0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e809c970 con 0x7f18e8131d70 2023-10-03T10:14:03.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.545+0000 7f18ed6a0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e80a0920 con 0x7f18e809e870 2023-10-03T10:14:03.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.545+0000 7f18ed6a0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18e809f9c0 con 0x7f18e809f180 2023-10-03T10:14:03.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.545+0000 7f18e6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e809e870 0x7f18e809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.546+0000 7f18e6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e809e870 0x7f18e809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38828/0 (socket says 172.21.15.146:38828) 2023-10-03T10:14:03.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.546+0000 7f18e6ffd700 1 -- 172.21.15.146:0/4037672681 learned_addr learned my addr 172.21.15.146:0/4037672681 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:03.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.546+0000 7f18e67fc700 1 --2- 172.21.15.146:0/4037672681 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18e809f180 0x7f18e8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.546+0000 7f18e6ffd700 1 -- 172.21.15.146:0/4037672681 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18e809f180 msgr2=0x7f18e8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:03.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.546+0000 7f18e6ffd700 1 --2- 172.21.15.146:0/4037672681 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18e809f180 0x7f18e8131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.546+0000 7f18e6ffd700 1 -- 172.21.15.146:0/4037672681 >> v1:172.21.15.146:6789/0 conn(0x7f18e8131d70 legacy=0x7f18e8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.546+0000 7f18e6ffd700 1 -- 172.21.15.146:0/4037672681 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e809bab0 con 0x7f18e809e870 2023-10-03T10:14:03.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.546+0000 7f18e6ffd700 1 --2- 172.21.15.146:0/4037672681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e809e870 0x7f18e809ec40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f18d8009920 tx=0x7f18d8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb01fa5331ae35b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.546+0000 7f18e5ffb700 1 -- 172.21.15.146:0/4037672681 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d800ba60 con 0x7f18e809e870 2023-10-03T10:14:03.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.546+0000 7f18e5ffb700 1 -- 172.21.15.146:0/4037672681 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d800bbc0 con 0x7f18e809e870 2023-10-03T10:14:03.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.546+0000 7f18e5ffb700 1 -- 172.21.15.146:0/4037672681 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8009e70 con 0x7f18e809e870 2023-10-03T10:14:03.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.547+0000 7f18ed6a0700 1 -- 172.21.15.146:0/4037672681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e809e870 msgr2=0x7f18e809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.547+0000 7f18ed6a0700 1 --2- 172.21.15.146:0/4037672681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e809e870 0x7f18e809ec40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f18d8009920 tx=0x7f18d8009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:03.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.547+0000 7f18ed6a0700 1 -- 172.21.15.146:0/4037672681 shutdown_connections 2023-10-03T10:14:03.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.547+0000 7f18ed6a0700 1 --2- 172.21.15.146:0/4037672681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e809e870 0x7f18e809ec40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.547+0000 7f18ed6a0700 1 --2- 172.21.15.146:0/4037672681 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18e809f180 0x7f18e8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.547+0000 7f18ed6a0700 1 -- 172.21.15.146:0/4037672681 >> 172.21.15.146:0/4037672681 conn(0x7f18e80a4430 msgr2=0x7f18e80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.547+0000 7f18ed6a0700 1 -- 172.21.15.146:0/4037672681 shutdown_connections 2023-10-03T10:14:03.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.547+0000 7f18ed6a0700 1 -- 172.21.15.146:0/4037672681 wait complete. 2023-10-03T10:14:03.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.549+0000 7f18ed6a0700 1 Processor -- start 2023-10-03T10:14:03.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.549+0000 7f18ed6a0700 1 -- start start 2023-10-03T10:14:03.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.549+0000 7f18ed6a0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e809e870 0x7f18e806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.549+0000 7f18ed6a0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e809f180 0x7f18e806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.549+0000 7f18ed6a0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18e8131d70 0x7f18e806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.550+0000 7f18ed6a0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e8125770 con 0x7f18e809f180 2023-10-03T10:14:03.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.550+0000 7f18ed6a0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e806d4c0 con 0x7f18e809e870 2023-10-03T10:14:03.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.550+0000 7f18ed6a0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18e8126070 con 0x7f18e8131d70 2023-10-03T10:14:03.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.550+0000 7f18e6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e809e870 0x7f18e806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.550+0000 7f18e6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e809e870 0x7f18e806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38836/0 (socket says 172.21.15.146:38836) 2023-10-03T10:14:03.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.550+0000 7f18e6ffd700 1 -- 172.21.15.146:0/1671327796 learned_addr learned my addr 172.21.15.146:0/1671327796 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:03.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.550+0000 7f18e67fc700 1 --2- 172.21.15.146:0/1671327796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e809f180 0x7f18e806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.550+0000 7f18e77fe700 1 --2- 172.21.15.146:0/1671327796 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18e8131d70 0x7f18e806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.550+0000 7f18e6ffd700 1 -- 172.21.15.146:0/1671327796 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18e8131d70 msgr2=0x7f18e806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.550+0000 7f18e6ffd700 1 --2- 172.21.15.146:0/1671327796 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18e8131d70 0x7f18e806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.550+0000 7f18e6ffd700 1 -- 172.21.15.146:0/1671327796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e809f180 msgr2=0x7f18e806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.550+0000 7f18e6ffd700 1 --2- 172.21.15.146:0/1671327796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e809f180 0x7f18e806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.550+0000 7f18e6ffd700 1 -- 172.21.15.146:0/1671327796 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d8009550 con 0x7f18e809e870 2023-10-03T10:14:03.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.550+0000 7f18e6ffd700 1 --2- 172.21.15.146:0/1671327796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e809e870 0x7f18e806b8b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f18d8000c00 tx=0x7f18d8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.550+0000 7f18cf7fe700 1 -- 172.21.15.146:0/1671327796 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8004510 con 0x7f18e809e870 2023-10-03T10:14:03.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.551+0000 7f18cf7fe700 1 -- 172.21.15.146:0/1671327796 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d801e070 con 0x7f18e809e870 2023-10-03T10:14:03.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.551+0000 7f18ed6a0700 1 -- 172.21.15.146:0/1671327796 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e8125ad0 con 0x7f18e809e870 2023-10-03T10:14:03.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.551+0000 7f18cf7fe700 1 -- 172.21.15.146:0/1671327796 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d80038e0 con 0x7f18e809e870 2023-10-03T10:14:03.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.551+0000 7f18ed6a0700 1 -- 172.21.15.146:0/1671327796 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e8125d90 con 0x7f18e809e870 2023-10-03T10:14:03.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.552+0000 7f18cf7fe700 1 -- 172.21.15.146:0/1671327796 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f18d8003a40 con 0x7f18e809e870 2023-10-03T10:14:03.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.552+0000 7f18ed6a0700 1 -- 172.21.15.146:0/1671327796 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e804f2a0 con 0x7f18e809e870 2023-10-03T10:14:03.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.552+0000 7f18cf7fe700 1 -- 172.21.15.146:0/1671327796 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f18d8020070 con 0x7f18e809e870 2023-10-03T10:14:03.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.556+0000 7f18cf7fe700 1 -- 172.21.15.146:0/1671327796 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f18d8011420 con 0x7f18e809e870 2023-10-03T10:14:03.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.584+0000 7fedd7b99700 1 Processor -- start 2023-10-03T10:14:03.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.584+0000 7fedd7b99700 1 -- start start 2023-10-03T10:14:03.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.584+0000 7fedd7b99700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fedd009e870 0x7fedd009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.585+0000 7fedd7b99700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fedd009f180 0x7fedd0133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.585+0000 7fedd7b99700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedd0134160 0x7fedd01345e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.585+0000 7fedd7b99700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd00a0370 con 0x7fedd009e870 2023-10-03T10:14:03.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.585+0000 7fedd7b99700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd009fa00 con 0x7fedd0134160 2023-10-03T10:14:03.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.585+0000 7fedd7b99700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedd009ada0 con 0x7fedd009f180 2023-10-03T10:14:03.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.585+0000 7ff0cfd47700 1 Processor -- start 2023-10-03T10:14:03.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.585+0000 7fedd6136700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedd0134160 0x7fedd01345e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.585+0000 7fedd6136700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedd0134160 0x7fedd01345e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38838/0 (socket says 172.21.15.146:38838) 2023-10-03T10:14:03.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.585+0000 7fedd6136700 1 -- 172.21.15.146:0/687820604 learned_addr learned my addr 172.21.15.146:0/687820604 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:03.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.585+0000 7ff0cfd47700 1 -- start start 2023-10-03T10:14:03.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.585+0000 7fedd6136700 1 -- 172.21.15.146:0/687820604 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fedd009f180 msgr2=0x7fedd0133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:03.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.585+0000 7fedd6136700 1 --2- 172.21.15.146:0/687820604 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fedd009f180 0x7fedd0133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.585+0000 7fedd6136700 1 -- 172.21.15.146:0/687820604 >> v2:172.21.15.146:3300/0 conn(0x7fedd009e870 msgr2=0x7fedd009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:03.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.585+0000 7fedd6136700 1 --2- 172.21.15.146:0/687820604 >> v2:172.21.15.146:3300/0 conn(0x7fedd009e870 0x7fedd009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.585+0000 7fedd6136700 1 -- 172.21.15.146:0/687820604 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd006bec0 con 0x7fedd0134160 2023-10-03T10:14:03.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.585+0000 7fedd6136700 1 --2- 172.21.15.146:0/687820604 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedd0134160 0x7fedd01345e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fedc8009e50 tx=0x7fedc800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e19c88b1d136115d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.585+0000 7fedd4933700 1 -- 172.21.15.146:0/687820604 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc800e070 con 0x7fedd0134160 2023-10-03T10:14:03.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.585+0000 7ff0cfd47700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff0c809d860 0x7ff0c809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.585+0000 7ff0cfd47700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c809e170 0x7ff0c81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.586+0000 7fedd4933700 1 -- 172.21.15.146:0/687820604 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc800b9c0 con 0x7fedd0134160 2023-10-03T10:14:03.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.586+0000 7fedd4933700 1 -- 172.21.15.146:0/687820604 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc800bd70 con 0x7fedd0134160 2023-10-03T10:14:03.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.586+0000 7fedd7b99700 1 -- 172.21.15.146:0/687820604 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedd0134160 msgr2=0x7fedd01345e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.586+0000 7fedd7b99700 1 --2- 172.21.15.146:0/687820604 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedd0134160 0x7fedd01345e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fedc8009e50 tx=0x7fedc800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:03.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.586+0000 7fedd7b99700 1 -- 172.21.15.146:0/687820604 shutdown_connections 2023-10-03T10:14:03.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.586+0000 7fedd7b99700 1 --2- 172.21.15.146:0/687820604 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedd0134160 0x7fedd01345e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.586+0000 7fedd7b99700 1 --2- 172.21.15.146:0/687820604 >> v2:172.21.15.146:3300/0 conn(0x7fedd009e870 0x7fedd009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.586+0000 7fedd7b99700 1 --2- 172.21.15.146:0/687820604 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fedd009f180 0x7fedd0133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.586+0000 7fedd7b99700 1 -- 172.21.15.146:0/687820604 >> 172.21.15.146:0/687820604 conn(0x7fedd00a4430 msgr2=0x7fedd00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.586+0000 7ff0cd2e2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c809e170 0x7ff0c81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.586+0000 7ff0cd2e2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c809e170 0x7ff0c81307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36538/0 (socket says 172.21.15.146:36538) 2023-10-03T10:14:03.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.587+0000 7ff0cfd47700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c809aaa0 con 0x7ff0c8130ce0 2023-10-03T10:14:03.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.587+0000 7ff0cfd47700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c809f870 con 0x7ff0c809d860 2023-10-03T10:14:03.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.587+0000 7ff0cfd47700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c809b360 con 0x7ff0c809e170 2023-10-03T10:14:03.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.587+0000 7ff0cdae3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff0c809d860 0x7ff0c809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.587+0000 7ff0cd2e2700 1 -- 172.21.15.146:0/3520916061 learned_addr learned my addr 172.21.15.146:0/3520916061 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:03.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.587+0000 7ff0cd2e2700 1 -- 172.21.15.146:0/3520916061 >> v2:172.21.15.146:3300/0 conn(0x7ff0c809d860 msgr2=0x7ff0c809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:03.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.587+0000 7ff0cd2e2700 1 --2- 172.21.15.146:0/3520916061 >> v2:172.21.15.146:3300/0 conn(0x7ff0c809d860 0x7ff0c809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.587+0000 7ff0cd2e2700 1 -- 172.21.15.146:0/3520916061 >> v1:172.21.15.146:6789/0 conn(0x7ff0c8130ce0 legacy=0x7ff0c81379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.587+0000 7ff0cd2e2700 1 -- 172.21.15.146:0/3520916061 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c809b620 con 0x7ff0c809e170 2023-10-03T10:14:03.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.587+0000 7fedd7b99700 1 -- 172.21.15.146:0/687820604 shutdown_connections 2023-10-03T10:14:03.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.587+0000 7fedd7b99700 1 -- 172.21.15.146:0/687820604 wait complete. 2023-10-03T10:14:03.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.587+0000 7ff0cd2e2700 1 --2- 172.21.15.146:0/3520916061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c809e170 0x7ff0c81307a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80131e0 tx=0x7ff0b80134f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fce3bae9a28e466 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.587+0000 7ff0ccae1700 1 -- 172.21.15.146:0/3520916061 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8016070 con 0x7ff0c809e170 2023-10-03T10:14:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.587+0000 7ff0ccae1700 1 -- 172.21.15.146:0/3520916061 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b8013d80 con 0x7ff0c809e170 2023-10-03T10:14:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.587+0000 7ff0ccae1700 1 -- 172.21.15.146:0/3520916061 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b80112f0 con 0x7ff0c809e170 2023-10-03T10:14:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.588+0000 7ff0cfd47700 1 -- 172.21.15.146:0/3520916061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c809e170 msgr2=0x7ff0c81307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.588+0000 7ff0cfd47700 1 --2- 172.21.15.146:0/3520916061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c809e170 0x7ff0c81307a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80131e0 tx=0x7ff0b80134f0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.588+0000 7ff0cfd47700 1 -- 172.21.15.146:0/3520916061 shutdown_connections 2023-10-03T10:14:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.588+0000 7ff0cfd47700 1 --2- 172.21.15.146:0/3520916061 >> v2:172.21.15.146:3300/0 conn(0x7ff0c809d860 0x7ff0c809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.588+0000 7ff0cfd47700 1 --2- 172.21.15.146:0/3520916061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c809e170 0x7ff0c81307a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.588+0000 7ff0cfd47700 1 -- 172.21.15.146:0/3520916061 >> 172.21.15.146:0/3520916061 conn(0x7ff0c8099c40 msgr2=0x7ff0c80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.588+0000 7fedd7b99700 1 Processor -- start 2023-10-03T10:14:03.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.589+0000 7fedd7b99700 1 -- start start 2023-10-03T10:14:03.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.589+0000 7ff0cfd47700 1 -- 172.21.15.146:0/3520916061 shutdown_connections 2023-10-03T10:14:03.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.589+0000 7ff0cfd47700 1 -- 172.21.15.146:0/3520916061 wait complete. 2023-10-03T10:14:03.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.589+0000 7fedd7b99700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedd009e870 0x7fedd0122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.589+0000 7fedd7b99700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedd009f180 0x7fedd0122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.589+0000 7fedd7b99700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fedd0134160 0x7fedd0123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.589+0000 7fedd7b99700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd00a3d50 con 0x7fedd009f180 2023-10-03T10:14:03.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.589+0000 7fedd7b99700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd006cfa0 con 0x7fedd009e870 2023-10-03T10:14:03.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.589+0000 7fedd7b99700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedd0125170 con 0x7fedd0134160 2023-10-03T10:14:03.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.589+0000 7fedd5134700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedd009f180 0x7fedd0122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.589+0000 7fedd5134700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedd009f180 0x7fedd0122cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37796/0 (socket says 172.21.15.146:37796) 2023-10-03T10:14:03.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.589+0000 7fedd5134700 1 -- 172.21.15.146:0/3262731718 learned_addr learned my addr 172.21.15.146:0/3262731718 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:03.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.590+0000 7fedd5134700 1 -- 172.21.15.146:0/3262731718 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fedd0134160 msgr2=0x7fedd0123210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:03.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.590+0000 7fedd5134700 1 --2- 172.21.15.146:0/3262731718 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fedd0134160 0x7fedd0123210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.590+0000 7fedd5134700 1 -- 172.21.15.146:0/3262731718 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedd009e870 msgr2=0x7fedd0122790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.590+0000 7fedd5134700 1 --2- 172.21.15.146:0/3262731718 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedd009e870 0x7fedd0122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.590+0000 7fedd5134700 1 -- 172.21.15.146:0/3262731718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc8009b30 con 0x7fedd009f180 2023-10-03T10:14:03.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.590+0000 7fedd5134700 1 --2- 172.21.15.146:0/3262731718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedd009f180 0x7fedd0122cd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fedc000b530 tx=0x7fedc000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.590+0000 7ff0cfd47700 1 Processor -- start 2023-10-03T10:14:03.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.590+0000 7fedc67fc700 1 -- 172.21.15.146:0/3262731718 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0011830 con 0x7fedd009f180 2023-10-03T10:14:03.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.590+0000 7fedc67fc700 1 -- 172.21.15.146:0/3262731718 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc00119b0 con 0x7fedd009f180 2023-10-03T10:14:03.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.590+0000 7fedc67fc700 1 -- 172.21.15.146:0/3262731718 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0011d60 con 0x7fedd009f180 2023-10-03T10:14:03.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.590+0000 7ff0cfd47700 1 -- start start 2023-10-03T10:14:03.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.590+0000 7fedd7b99700 1 -- 172.21.15.146:0/3262731718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd01259f0 con 0x7fedd009f180 2023-10-03T10:14:03.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.590+0000 7fedd7b99700 1 -- 172.21.15.146:0/3262731718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd01269f0 con 0x7fedd009f180 2023-10-03T10:14:03.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.591+0000 7ff0cfd47700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c809d860 0x7ff0c811e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.591+0000 7ff0cfd47700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0c809e170 0x7ff0c811ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.591+0000 7ff0cfd47700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0c8130ce0 0x7ff0c811f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.591+0000 7ff0cfd47700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c811fb70 con 0x7ff0c8130ce0 2023-10-03T10:14:03.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.591+0000 7ff0cfd47700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c80a2220 con 0x7ff0c809e170 2023-10-03T10:14:03.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.591+0000 7ff0cfd47700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c81203c0 con 0x7ff0c809d860 2023-10-03T10:14:03.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.591+0000 7ff0cd2e2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0c809e170 0x7ff0c811ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.591+0000 7ff0ce2e4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0c8130ce0 0x7ff0c811f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.591+0000 7ff0cd2e2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0c809e170 0x7ff0c811ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38856/0 (socket says 172.21.15.146:38856) 2023-10-03T10:14:03.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.591+0000 7ff0cd2e2700 1 -- 172.21.15.146:0/1441285754 learned_addr learned my addr 172.21.15.146:0/1441285754 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:03.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.591+0000 7ff0cdae3700 1 --2- 172.21.15.146:0/1441285754 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c809d860 0x7ff0c811e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.591+0000 7ff0ce2e4700 1 -- 172.21.15.146:0/1441285754 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c809d860 msgr2=0x7ff0c811e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.591+0000 7ff0ce2e4700 1 --2- 172.21.15.146:0/1441285754 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c809d860 0x7ff0c811e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.591+0000 7ff0ce2e4700 1 -- 172.21.15.146:0/1441285754 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0c809e170 msgr2=0x7ff0c811ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.591+0000 7ff0ce2e4700 1 --2- 172.21.15.146:0/1441285754 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0c809e170 0x7ff0c811ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.591+0000 7ff0ce2e4700 1 -- 172.21.15.146:0/1441285754 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b8011df0 con 0x7ff0c8130ce0 2023-10-03T10:14:03.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.591+0000 7ff0cd2e2700 1 --2- 172.21.15.146:0/1441285754 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0c809e170 0x7ff0c811ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:03.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.592+0000 7ff0ce2e4700 1 --2- 172.21.15.146:0/1441285754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0c8130ce0 0x7ff0c811f120 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff0c000cb90 tx=0x7ff0c000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.591+0000 7fedc67fc700 1 -- 172.21.15.146:0/3262731718 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fedc001a400 con 0x7fedd009f180 2023-10-03T10:14:03.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.591+0000 7fedd7b99700 1 -- 172.21.15.146:0/3262731718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd004f2a0 con 0x7fedd009f180 2023-10-03T10:14:03.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.592+0000 7fedc67fc700 1 -- 172.21.15.146:0/3262731718 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fedc003f830 con 0x7fedd009f180 2023-10-03T10:14:03.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.596+0000 7ff0be7fc700 1 -- 172.21.15.146:0/1441285754 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0003c00 con 0x7ff0c8130ce0 2023-10-03T10:14:03.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.596+0000 7ff0be7fc700 1 -- 172.21.15.146:0/1441285754 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c0003d60 con 0x7ff0c8130ce0 2023-10-03T10:14:03.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.596+0000 7ff0cfd47700 1 -- 172.21.15.146:0/1441285754 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c8120860 con 0x7ff0c8130ce0 2023-10-03T10:14:03.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.596+0000 7ff0be7fc700 1 -- 172.21.15.146:0/1441285754 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c000aa80 con 0x7ff0c8130ce0 2023-10-03T10:14:03.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.596+0000 7ff0cfd47700 1 -- 172.21.15.146:0/1441285754 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c8120aa0 con 0x7ff0c8130ce0 2023-10-03T10:14:03.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.596+0000 7fedc67fc700 1 -- 172.21.15.146:0/3262731718 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fedc000f8d0 con 0x7fedd009f180 2023-10-03T10:14:03.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.597+0000 7ff0be7fc700 1 -- 172.21.15.146:0/1441285754 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0c000abe0 con 0x7ff0c8130ce0 2023-10-03T10:14:03.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.597+0000 7ff0be7fc700 1 -- 172.21.15.146:0/1441285754 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff0c003f630 con 0x7ff0c8130ce0 2023-10-03T10:14:03.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.597+0000 7ff0cfd47700 1 -- 172.21.15.146:0/1441285754 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c8121d40 con 0x7ff0c8130ce0 2023-10-03T10:14:03.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.602+0000 7ff0be7fc700 1 -- 172.21.15.146:0/1441285754 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0c8121d40 con 0x7ff0c8130ce0 2023-10-03T10:14:03.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.626+0000 7f11899a8700 1 Processor -- start 2023-10-03T10:14:03.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.626+0000 7f11899a8700 1 -- start start 2023-10-03T10:14:03.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.627+0000 7f11899a8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f118409e340 0x7f11841359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.627+0000 7f11899a8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1184135f20 0x7f1184138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.627+0000 7f11899a8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118409aaa0 con 0x7f118409d860 2023-10-03T10:14:03.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.627+0000 7f11899a8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118409e730 con 0x7f1184135f20 2023-10-03T10:14:03.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.627+0000 7f11899a8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f118409f870 con 0x7f118409e340 2023-10-03T10:14:03.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.627+0000 7f11827fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f118409e340 0x7f11841359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.627+0000 7f11827fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f118409e340 0x7f11841359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36562/0 (socket says 172.21.15.146:36562) 2023-10-03T10:14:03.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.627+0000 7f11827fc700 1 -- 172.21.15.146:0/2064051233 learned_addr learned my addr 172.21.15.146:0/2064051233 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:03.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.627+0000 7f11837fe700 1 --2- 172.21.15.146:0/2064051233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1184135f20 0x7f1184138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.627+0000 7f11827fc700 1 -- 172.21.15.146:0/2064051233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1184135f20 msgr2=0x7f1184138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:03.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.627+0000 7f11827fc700 1 --2- 172.21.15.146:0/2064051233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1184135f20 0x7f1184138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.628+0000 7f11827fc700 1 -- 172.21.15.146:0/2064051233 >> v1:172.21.15.146:6789/0 conn(0x7f118409d860 legacy=0x7f118409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.628+0000 7f11827fc700 1 -- 172.21.15.146:0/2064051233 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118409b360 con 0x7f118409e340 2023-10-03T10:14:03.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.628+0000 7f11827fc700 1 --2- 172.21.15.146:0/2064051233 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f118409e340 0x7f11841359e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1178009950 tx=0x7f1178009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ce29dc9704170ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.628+0000 7f1181ffb700 1 -- 172.21.15.146:0/2064051233 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1178011830 con 0x7f118409e340 2023-10-03T10:14:03.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.628+0000 7f1181ffb700 1 -- 172.21.15.146:0/2064051233 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1178011990 con 0x7f118409e340 2023-10-03T10:14:03.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.628+0000 7f1181ffb700 1 -- 172.21.15.146:0/2064051233 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1178011d40 con 0x7f118409e340 2023-10-03T10:14:03.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.629+0000 7f11899a8700 1 -- 172.21.15.146:0/2064051233 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f118409e340 msgr2=0x7f11841359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.629+0000 7f11899a8700 1 --2- 172.21.15.146:0/2064051233 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f118409e340 0x7f11841359e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1178009950 tx=0x7f1178009c60 comp rx=0 tx=0).stop 2023-10-03T10:14:03.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.629+0000 7f11899a8700 1 -- 172.21.15.146:0/2064051233 shutdown_connections 2023-10-03T10:14:03.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.629+0000 7f11899a8700 1 --2- 172.21.15.146:0/2064051233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1184135f20 0x7f1184138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.629+0000 7f11899a8700 1 --2- 172.21.15.146:0/2064051233 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f118409e340 0x7f11841359e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.629+0000 7f11899a8700 1 -- 172.21.15.146:0/2064051233 >> 172.21.15.146:0/2064051233 conn(0x7f1184099c40 msgr2=0x7f11840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.629+0000 7f11899a8700 1 -- 172.21.15.146:0/2064051233 shutdown_connections 2023-10-03T10:14:03.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.629+0000 7f11899a8700 1 -- 172.21.15.146:0/2064051233 wait complete. 2023-10-03T10:14:03.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.630+0000 7f11899a8700 1 Processor -- start 2023-10-03T10:14:03.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.630+0000 7f11899a8700 1 -- start start 2023-10-03T10:14:03.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.631+0000 7f11899a8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f118409d860 0x7f1184139880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.631+0000 7f11899a8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f118409e340 0x7f1184139dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.631+0000 7f11899a8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1184135f20 0x7f118413a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.631+0000 7f11899a8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1184135620 con 0x7f1184135f20 2023-10-03T10:14:03.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.631+0000 7f11899a8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11841217f0 con 0x7f118409e340 2023-10-03T10:14:03.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.631+0000 7f11899a8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1184121250 con 0x7f118409d860 2023-10-03T10:14:03.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.631+0000 7f11827fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f118409e340 0x7f1184139dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.631+0000 7f11827fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f118409e340 0x7f1184139dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38874/0 (socket says 172.21.15.146:38874) 2023-10-03T10:14:03.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.631+0000 7f11827fc700 1 -- 172.21.15.146:0/4214196216 learned_addr learned my addr 172.21.15.146:0/4214196216 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:03.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.631+0000 7f11837fe700 1 --2- 172.21.15.146:0/4214196216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1184135f20 0x7f118413a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.631+0000 7f1182ffd700 1 --2- 172.21.15.146:0/4214196216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f118409d860 0x7f1184139880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.632+0000 7f11827fc700 1 -- 172.21.15.146:0/4214196216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f118409d860 msgr2=0x7f1184139880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.632+0000 7f11827fc700 1 --2- 172.21.15.146:0/4214196216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f118409d860 0x7f1184139880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.632+0000 7f11827fc700 1 -- 172.21.15.146:0/4214196216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1184135f20 msgr2=0x7f118413a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.632+0000 7f11827fc700 1 --2- 172.21.15.146:0/4214196216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1184135f20 0x7f118413a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.632+0000 7f11827fc700 1 -- 172.21.15.146:0/4214196216 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1178009550 con 0x7f118409e340 2023-10-03T10:14:03.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.632+0000 7f1182ffd700 1 --2- 172.21.15.146:0/4214196216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f118409d860 0x7f1184139880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:03.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.632+0000 7f11827fc700 1 --2- 172.21.15.146:0/4214196216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f118409e340 0x7f1184139dc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1178009ca0 tx=0x7f1178004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.632+0000 7f116bfff700 1 -- 172.21.15.146:0/4214196216 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1178004240 con 0x7f118409e340 2023-10-03T10:14:03.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.632+0000 7f116bfff700 1 -- 172.21.15.146:0/4214196216 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117801f070 con 0x7f118409e340 2023-10-03T10:14:03.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.632+0000 7f11899a8700 1 -- 172.21.15.146:0/4214196216 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118413b490 con 0x7f118409e340 2023-10-03T10:14:03.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.632+0000 7f116bfff700 1 -- 172.21.15.146:0/4214196216 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11780036a0 con 0x7f118409e340 2023-10-03T10:14:03.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.632+0000 7f11899a8700 1 -- 172.21.15.146:0/4214196216 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11841200d0 con 0x7f118409e340 2023-10-03T10:14:03.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.634+0000 7f116bfff700 1 -- 172.21.15.146:0/4214196216 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1178021030 con 0x7f118409e340 2023-10-03T10:14:03.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.634+0000 7f11899a8700 1 -- 172.21.15.146:0/4214196216 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118409e160 con 0x7f118409e340 2023-10-03T10:14:03.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.634+0000 7f116bfff700 1 -- 172.21.15.146:0/4214196216 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f11780409a0 con 0x7f118409e340 2023-10-03T10:14:03.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.643+0000 7f116bfff700 1 -- 172.21.15.146:0/4214196216 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11780199a0 con 0x7f118409e340 2023-10-03T10:14:03.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.757+0000 7f18ed6a0700 1 -- 172.21.15.146:0/1671327796 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f18e809b0e0 con 0x7f18e809e870 2023-10-03T10:14:03.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.758+0000 7f18cf7fe700 1 -- 172.21.15.146:0/1671327796 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f18d802eb90 con 0x7f18e809e870 2023-10-03T10:14:03.759 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:03.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.761+0000 7f18ed6a0700 1 -- 172.21.15.146:0/1671327796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e809e870 msgr2=0x7f18e806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.761+0000 7f18ed6a0700 1 --2- 172.21.15.146:0/1671327796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e809e870 0x7f18e806b8b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f18d8000c00 tx=0x7f18d8004750 comp rx=0 tx=0).stop 2023-10-03T10:14:03.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.761+0000 7f18ed6a0700 1 -- 172.21.15.146:0/1671327796 shutdown_connections 2023-10-03T10:14:03.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.761+0000 7f18ed6a0700 1 --2- 172.21.15.146:0/1671327796 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18e8131d70 0x7f18e806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.761+0000 7f18ed6a0700 1 --2- 172.21.15.146:0/1671327796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e809e870 0x7f18e806b8b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.761+0000 7f18ed6a0700 1 --2- 172.21.15.146:0/1671327796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e809f180 0x7f18e806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.761+0000 7f18ed6a0700 1 -- 172.21.15.146:0/1671327796 >> 172.21.15.146:0/1671327796 conn(0x7f18e80a4430 msgr2=0x7f18e806fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.761+0000 7f18ed6a0700 1 -- 172.21.15.146:0/1671327796 shutdown_connections 2023-10-03T10:14:03.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.761+0000 7f18ed6a0700 1 -- 172.21.15.146:0/1671327796 wait complete. 2023-10-03T10:14:03.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:03.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.801+0000 7fedd7b99700 1 -- 172.21.15.146:0/3262731718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fedd009a940 con 0x7fedd009f180 2023-10-03T10:14:03.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.801+0000 7fedc67fc700 1 -- 172.21.15.146:0/3262731718 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fedc0015070 con 0x7fedd009f180 2023-10-03T10:14:03.802 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:03.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.801+0000 7ff0cfd47700 1 -- 172.21.15.146:0/1441285754 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff0c8121d40 con 0x7ff0c8130ce0 2023-10-03T10:14:03.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.802+0000 7ff0be7fc700 1 -- 172.21.15.146:0/1441285754 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff0c8121d40 con 0x7ff0c8130ce0 2023-10-03T10:14:03.803 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.803+0000 7fedd7b99700 1 -- 172.21.15.146:0/3262731718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedd009f180 msgr2=0x7fedd0122cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.803+0000 7fedd7b99700 1 --2- 172.21.15.146:0/3262731718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedd009f180 0x7fedd0122cd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fedc000b530 tx=0x7fedc000b8f0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.803+0000 7fedd7b99700 1 -- 172.21.15.146:0/3262731718 shutdown_connections 2023-10-03T10:14:03.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.803+0000 7fedd7b99700 1 --2- 172.21.15.146:0/3262731718 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fedd0134160 0x7fedd0123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.803+0000 7fedd7b99700 1 --2- 172.21.15.146:0/3262731718 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedd009e870 0x7fedd0122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.803+0000 7fedd7b99700 1 --2- 172.21.15.146:0/3262731718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedd009f180 0x7fedd0122cd0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.803+0000 7fedd7b99700 1 -- 172.21.15.146:0/3262731718 >> 172.21.15.146:0/3262731718 conn(0x7fedd00a4430 msgr2=0x7fedd0072230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.804+0000 7fedd7b99700 1 -- 172.21.15.146:0/3262731718 shutdown_connections 2023-10-03T10:14:03.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.804+0000 7fedd7b99700 1 -- 172.21.15.146:0/3262731718 wait complete. 2023-10-03T10:14:03.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.804+0000 7ff0cfd47700 1 -- 172.21.15.146:0/1441285754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0c8130ce0 msgr2=0x7ff0c811f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.804+0000 7ff0cfd47700 1 --2- 172.21.15.146:0/1441285754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0c8130ce0 0x7ff0c811f120 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff0c000cb90 tx=0x7ff0c000cea0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.804+0000 7ff0cfd47700 1 -- 172.21.15.146:0/1441285754 shutdown_connections 2023-10-03T10:14:03.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.804+0000 7ff0cfd47700 1 --2- 172.21.15.146:0/1441285754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0c8130ce0 0x7ff0c811f120 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.804+0000 7ff0cfd47700 1 --2- 172.21.15.146:0/1441285754 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0c809d860 0x7ff0c811e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.804+0000 7ff0cfd47700 1 --2- 172.21.15.146:0/1441285754 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0c809e170 0x7ff0c811ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.804+0000 7ff0cfd47700 1 -- 172.21.15.146:0/1441285754 >> 172.21.15.146:0/1441285754 conn(0x7ff0c8099c40 msgr2=0x7ff0c80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.805+0000 7ff0cfd47700 1 -- 172.21.15.146:0/1441285754 shutdown_connections 2023-10-03T10:14:03.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.805+0000 7ff0cfd47700 1 -- 172.21.15.146:0/1441285754 wait complete. 2023-10-03T10:14:03.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:03.818 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:03.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.848+0000 7f11899a8700 1 -- 172.21.15.146:0/4214196216 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f118404f2a0 con 0x7f118409e340 2023-10-03T10:14:03.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.849+0000 7f116bfff700 1 -- 172.21.15.146:0/4214196216 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1178015030 con 0x7f118409e340 2023-10-03T10:14:03.850 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:03.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.851+0000 7f11899a8700 1 -- 172.21.15.146:0/4214196216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f118409e340 msgr2=0x7f1184139dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.851+0000 7f11899a8700 1 --2- 172.21.15.146:0/4214196216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f118409e340 0x7f1184139dc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1178009ca0 tx=0x7f1178004750 comp rx=0 tx=0).stop 2023-10-03T10:14:03.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.851+0000 7f11899a8700 1 -- 172.21.15.146:0/4214196216 shutdown_connections 2023-10-03T10:14:03.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.851+0000 7f11899a8700 1 --2- 172.21.15.146:0/4214196216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1184135f20 0x7f118413a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.851+0000 7f11899a8700 1 --2- 172.21.15.146:0/4214196216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f118409d860 0x7f1184139880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.851+0000 7f11899a8700 1 --2- 172.21.15.146:0/4214196216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f118409e340 0x7f1184139dc0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.851+0000 7f11899a8700 1 -- 172.21.15.146:0/4214196216 >> 172.21.15.146:0/4214196216 conn(0x7f1184099c40 msgr2=0x7f118406e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.851+0000 7f11899a8700 1 -- 172.21.15.146:0/4214196216 shutdown_connections 2023-10-03T10:14:03.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:03.851+0000 7f11899a8700 1 -- 172.21.15.146:0/4214196216 wait complete. 2023-10-03T10:14:03.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:04.780 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:04.819 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:04.819 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:04.864 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.921+0000 7fdc72421700 1 Processor -- start 2023-10-03T10:14:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.921+0000 7fdc72421700 1 -- start start 2023-10-03T10:14:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.921+0000 7fdc72421700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc6c133900 0x7fdc6c133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.921+0000 7fdc72421700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc6c134210 0x7fdc6c0a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.921+0000 7fdc72421700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc6c09a760 con 0x7fdc6c0a0ee0 2023-10-03T10:14:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.921+0000 7fdc72421700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c1336e0 con 0x7fdc6c134210 2023-10-03T10:14:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.922+0000 7fdc72421700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c09a080 con 0x7fdc6c133900 2023-10-03T10:14:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.922+0000 7fdc709be700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdc6c0a0ee0 0x7fdc6c13a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39910/0 (socket says 172.21.15.146:39910) 2023-10-03T10:14:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.922+0000 7fdc709be700 1 -- 172.21.15.146:0/2189104082 learned_addr learned my addr 172.21.15.146:0/2189104082 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.922+0000 7fdc6b7fe700 1 --2- 172.21.15.146:0/2189104082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc6c134210 0x7fdc6c0a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.922+0000 7fdc6bfff700 1 --2- 172.21.15.146:0/2189104082 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc6c133900 0x7fdc6c133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.922+0000 7fdc6affd700 1 -- 172.21.15.146:0/2189104082 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138198127 0 0) 0x7fdc6c09a760 con 0x7fdc6c0a0ee0 2023-10-03T10:14:04.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.922+0000 7fdc6b7fe700 1 -- 172.21.15.146:0/2189104082 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc6c133900 msgr2=0x7fdc6c133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.922+0000 7fdc6b7fe700 1 --2- 172.21.15.146:0/2189104082 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc6c133900 0x7fdc6c133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.922+0000 7fdc6b7fe700 1 -- 172.21.15.146:0/2189104082 >> v1:172.21.15.146:6789/0 conn(0x7fdc6c0a0ee0 legacy=0x7fdc6c13a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.922+0000 7fdc6b7fe700 1 -- 172.21.15.146:0/2189104082 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c0a23e0 con 0x7fdc6c134210 2023-10-03T10:14:04.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.922+0000 7fdc6b7fe700 1 --2- 172.21.15.146:0/2189104082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc6c134210 0x7fdc6c0a09a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdc60009870 tx=0x7fdc60009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4b53b42b9b9d50b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.923+0000 7fdc6affd700 1 -- 172.21.15.146:0/2189104082 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc60011830 con 0x7fdc6c134210 2023-10-03T10:14:04.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.923+0000 7fdc6affd700 1 -- 172.21.15.146:0/2189104082 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc60011990 con 0x7fdc6c134210 2023-10-03T10:14:04.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.923+0000 7fdc6affd700 1 -- 172.21.15.146:0/2189104082 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc60011d20 con 0x7fdc6c134210 2023-10-03T10:14:04.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.923+0000 7fdc72421700 1 -- 172.21.15.146:0/2189104082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc6c134210 msgr2=0x7fdc6c0a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.923+0000 7fdc72421700 1 --2- 172.21.15.146:0/2189104082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc6c134210 0x7fdc6c0a09a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdc60009870 tx=0x7fdc60009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:04.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.923+0000 7fdc72421700 1 -- 172.21.15.146:0/2189104082 shutdown_connections 2023-10-03T10:14:04.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.923+0000 7fdc72421700 1 --2- 172.21.15.146:0/2189104082 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc6c133900 0x7fdc6c133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.923+0000 7fdc72421700 1 --2- 172.21.15.146:0/2189104082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc6c134210 0x7fdc6c0a09a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.923+0000 7fdc72421700 1 -- 172.21.15.146:0/2189104082 >> 172.21.15.146:0/2189104082 conn(0x7fdc6c0a2980 msgr2=0x7fdc6c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.923+0000 7fdc72421700 1 -- 172.21.15.146:0/2189104082 shutdown_connections 2023-10-03T10:14:04.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.923+0000 7fdc72421700 1 -- 172.21.15.146:0/2189104082 wait complete. 2023-10-03T10:14:04.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.924+0000 7fdc72421700 1 Processor -- start 2023-10-03T10:14:04.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.925+0000 7fdc72421700 1 -- start start 2023-10-03T10:14:04.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.925+0000 7fdc72421700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc6c0a0ee0 0x7fdc6c11d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.925+0000 7fdc72421700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc6c133900 0x7fdc6c11dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.925+0000 7fdc72421700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc6c134210 0x7fdc6c11e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.925+0000 7fdc72421700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c1209f0 con 0x7fdc6c133900 2023-10-03T10:14:04.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.925+0000 7fdc72421700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c09a2c0 con 0x7fdc6c134210 2023-10-03T10:14:04.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.925+0000 7fdc72421700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6c132ce0 con 0x7fdc6c0a0ee0 2023-10-03T10:14:04.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.925+0000 7fdc6bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc6c0a0ee0 0x7fdc6c11d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.925+0000 7fdc6bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc6c0a0ee0 0x7fdc6c11d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:52626/0 (socket says 172.21.15.146:52626) 2023-10-03T10:14:04.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.925+0000 7fdc6bfff700 1 -- 172.21.15.146:0/3966768207 learned_addr learned my addr 172.21.15.146:0/3966768207 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:04.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.925+0000 7fdc6b7fe700 1 --2- 172.21.15.146:0/3966768207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc6c133900 0x7fdc6c11dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.926+0000 7fdc6b7fe700 1 -- 172.21.15.146:0/3966768207 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc6c0a0ee0 msgr2=0x7fdc6c11d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.926+0000 7fdc6b7fe700 1 --2- 172.21.15.146:0/3966768207 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc6c0a0ee0 0x7fdc6c11d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.926+0000 7fdc6b7fe700 1 -- 172.21.15.146:0/3966768207 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc6c134210 msgr2=0x7fdc6c11e1c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:04.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.926+0000 7fdc6b7fe700 1 --2- 172.21.15.146:0/3966768207 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc6c134210 0x7fdc6c11e1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.926+0000 7fdc6b7fe700 1 -- 172.21.15.146:0/3966768207 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc600094a0 con 0x7fdc6c133900 2023-10-03T10:14:04.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.926+0000 7fdc6bfff700 1 --2- 172.21.15.146:0/3966768207 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc6c0a0ee0 0x7fdc6c11d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:04.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.926+0000 7fdc6b7fe700 1 --2- 172.21.15.146:0/3966768207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc6c133900 0x7fdc6c11dc80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fdc60016000 tx=0x7fdc60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.926+0000 7fdc68ff9700 1 -- 172.21.15.146:0/3966768207 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc60004590 con 0x7fdc6c133900 2023-10-03T10:14:04.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.926+0000 7fdc68ff9700 1 -- 172.21.15.146:0/3966768207 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc600036a0 con 0x7fdc6c133900 2023-10-03T10:14:04.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.926+0000 7fdc72421700 1 -- 172.21.15.146:0/3966768207 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc6c11f350 con 0x7fdc6c133900 2023-10-03T10:14:04.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.926+0000 7fdc68ff9700 1 -- 172.21.15.146:0/3966768207 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc60003a10 con 0x7fdc6c133900 2023-10-03T10:14:04.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.926+0000 7fdc72421700 1 -- 172.21.15.146:0/3966768207 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6c121760 con 0x7fdc6c133900 2023-10-03T10:14:04.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.927+0000 7fdc72421700 1 -- 172.21.15.146:0/3966768207 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc6c11a590 con 0x7fdc6c133900 2023-10-03T10:14:04.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.927+0000 7fdc68ff9700 1 -- 172.21.15.146:0/3966768207 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc60003b70 con 0x7fdc6c133900 2023-10-03T10:14:04.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.928+0000 7fdc68ff9700 1 -- 172.21.15.146:0/3966768207 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdc60040620 con 0x7fdc6c133900 2023-10-03T10:14:04.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.932+0000 7fdc68ff9700 1 -- 172.21.15.146:0/3966768207 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc6001a420 con 0x7fdc6c133900 2023-10-03T10:14:04.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.959+0000 7fa66059a700 1 Processor -- start 2023-10-03T10:14:04.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.960+0000 7fa66059a700 1 -- start start 2023-10-03T10:14:04.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.960+0000 7fb08e1c4700 1 Processor -- start 2023-10-03T10:14:04.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.960+0000 7fb08e1c4700 1 -- start start 2023-10-03T10:14:04.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.960+0000 7fb08e1c4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0880a0a70 0x7fb0880a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.960+0000 7fb08e1c4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb0880a1380 0x7fb088133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.960+0000 7fb08e1c4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb088133f50 0x7fb088134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.960+0000 7fb08e1c4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08809e9d0 con 0x7fb0880a1380 2023-10-03T10:14:04.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.960+0000 7fb08e1c4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08809dc00 con 0x7fb088133f50 2023-10-03T10:14:04.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.960+0000 7fb08e1c4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb08809dec0 con 0x7fb0880a0a70 2023-10-03T10:14:04.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.960+0000 7fa66059a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa6581368e0 0x7fa658138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.960+0000 7fa66059a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa658139200 0x7fa65813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.960+0000 7fa66059a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65809a760 con 0x7fa658133900 2023-10-03T10:14:04.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.960+0000 7fa66059a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6581336e0 con 0x7fa6581368e0 2023-10-03T10:14:04.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.960+0000 7fa66059a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65809a080 con 0x7fa658139200 2023-10-03T10:14:04.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.961+0000 7fa65db35700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa6581368e0 0x7fa658138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.961+0000 7fa65eb37700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa658139200 0x7fa65813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.961+0000 7fa65eb37700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa658139200 0x7fa65813b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55958/0 (socket says 172.21.15.146:55958) 2023-10-03T10:14:04.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.961+0000 7fa65db35700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa6581368e0 0x7fa658138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49238/0 (socket says 172.21.15.146:49238) 2023-10-03T10:14:04.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.961+0000 7fa65eb37700 1 -- 172.21.15.146:0/597297586 learned_addr learned my addr 172.21.15.146:0/597297586 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:04.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.961+0000 7fa65eb37700 1 -- 172.21.15.146:0/597297586 >> v2:172.21.15.146:3300/0 conn(0x7fa6581368e0 msgr2=0x7fa658138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.961+0000 7fa65eb37700 1 --2- 172.21.15.146:0/597297586 >> v2:172.21.15.146:3300/0 conn(0x7fa6581368e0 0x7fa658138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.961+0000 7fa65eb37700 1 -- 172.21.15.146:0/597297586 >> v1:172.21.15.146:6789/0 conn(0x7fa658133900 legacy=0x7fa658133cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:14:04.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.961+0000 7fa65eb37700 1 -- 172.21.15.146:0/597297586 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6580a23e0 con 0x7fa658139200 2023-10-03T10:14:04.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.960+0000 7fb086ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb0880a1380 0x7fb088133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.960+0000 7fb086ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb0880a1380 0x7fb088133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49222/0 (socket says 172.21.15.146:49222) 2023-10-03T10:14:04.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.960+0000 7fb086ffd700 1 -- 172.21.15.146:0/2472060565 learned_addr learned my addr 172.21.15.146:0/2472060565 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:04.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.960+0000 7fb0877fe700 1 --2- 172.21.15.146:0/2472060565 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0880a0a70 0x7fb0880a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.961+0000 7fb087fff700 1 --2- 172.21.15.146:0/2472060565 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb088133f50 0x7fb088134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.961+0000 7fb0877fe700 1 -- 172.21.15.146:0/2472060565 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb088133f50 msgr2=0x7fb088134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.961+0000 7fb0877fe700 1 --2- 172.21.15.146:0/2472060565 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb088133f50 0x7fb088134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.961+0000 7fb0877fe700 1 -- 172.21.15.146:0/2472060565 >> v2:172.21.15.146:3300/0 conn(0x7fb0880a1380 msgr2=0x7fb088133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.961+0000 7fb0877fe700 1 --2- 172.21.15.146:0/2472060565 >> v2:172.21.15.146:3300/0 conn(0x7fb0880a1380 0x7fb088133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.961+0000 7fb0877fe700 1 -- 172.21.15.146:0/2472060565 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08809e6a0 con 0x7fb0880a0a70 2023-10-03T10:14:04.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.961+0000 7fb0877fe700 1 --2- 172.21.15.146:0/2472060565 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0880a0a70 0x7fb0880a0e40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb070009840 tx=0x7fb070009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=461903530fefbd7e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.961+0000 7fa65eb37700 1 --2- 172.21.15.146:0/597297586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa658139200 0x7fa65813b5e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa650009e50 tx=0x7fa65000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b840fd048460ab6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.961+0000 7fa65d334700 1 -- 172.21.15.146:0/597297586 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65000e070 con 0x7fa658139200 2023-10-03T10:14:04.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.961+0000 7fb0867fc700 1 -- 172.21.15.146:0/2472060565 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb070011830 con 0x7fb0880a0a70 2023-10-03T10:14:04.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.961+0000 7fa65d334700 1 -- 172.21.15.146:0/597297586 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa650003a20 con 0x7fa658139200 2023-10-03T10:14:04.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.961+0000 7fa65d334700 1 -- 172.21.15.146:0/597297586 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650003dd0 con 0x7fa658139200 2023-10-03T10:14:04.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.961+0000 7fb0867fc700 1 -- 172.21.15.146:0/2472060565 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb070011990 con 0x7fb0880a0a70 2023-10-03T10:14:04.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.962+0000 7fb0867fc700 1 -- 172.21.15.146:0/2472060565 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb070011d20 con 0x7fb0880a0a70 2023-10-03T10:14:04.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.962+0000 7fa66059a700 1 -- 172.21.15.146:0/597297586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa658139200 msgr2=0x7fa65813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.962+0000 7fa66059a700 1 --2- 172.21.15.146:0/597297586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa658139200 0x7fa65813b5e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa650009e50 tx=0x7fa65000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:04.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.962+0000 7fb08e1c4700 1 -- 172.21.15.146:0/2472060565 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0880a0a70 msgr2=0x7fb0880a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.962+0000 7fb08e1c4700 1 --2- 172.21.15.146:0/2472060565 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0880a0a70 0x7fb0880a0e40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb070009840 tx=0x7fb070009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:04.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.962+0000 7fa66059a700 1 -- 172.21.15.146:0/597297586 shutdown_connections 2023-10-03T10:14:04.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.962+0000 7fa66059a700 1 --2- 172.21.15.146:0/597297586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa658139200 0x7fa65813b5e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.962+0000 7fa66059a700 1 --2- 172.21.15.146:0/597297586 >> v2:172.21.15.146:3300/0 conn(0x7fa6581368e0 0x7fa658138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.962+0000 7fa66059a700 1 -- 172.21.15.146:0/597297586 >> 172.21.15.146:0/597297586 conn(0x7fa6580a2980 msgr2=0x7fa6580a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.962+0000 7fa66059a700 1 -- 172.21.15.146:0/597297586 shutdown_connections 2023-10-03T10:14:04.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.962+0000 7fb08e1c4700 1 -- 172.21.15.146:0/2472060565 shutdown_connections 2023-10-03T10:14:04.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.962+0000 7fb08e1c4700 1 --2- 172.21.15.146:0/2472060565 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb088133f50 0x7fb088134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.962+0000 7fb08e1c4700 1 --2- 172.21.15.146:0/2472060565 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0880a0a70 0x7fb0880a0e40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.962+0000 7fb08e1c4700 1 --2- 172.21.15.146:0/2472060565 >> v2:172.21.15.146:3300/0 conn(0x7fb0880a1380 0x7fb088133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.962+0000 7fb08e1c4700 1 -- 172.21.15.146:0/2472060565 >> 172.21.15.146:0/2472060565 conn(0x7fb0880a6610 msgr2=0x7fb0880a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.962+0000 7fa66059a700 1 -- 172.21.15.146:0/597297586 wait complete. 2023-10-03T10:14:04.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.962+0000 7fb08e1c4700 1 -- 172.21.15.146:0/2472060565 shutdown_connections 2023-10-03T10:14:04.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.962+0000 7fb08e1c4700 1 -- 172.21.15.146:0/2472060565 wait complete. 2023-10-03T10:14:04.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.963+0000 7fa66059a700 1 Processor -- start 2023-10-03T10:14:04.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.964+0000 7fa66059a700 1 -- start start 2023-10-03T10:14:04.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.964+0000 7fa66059a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa658133900 0x7fa658070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.964+0000 7fa66059a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6581368e0 0x7fa658070e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.964+0000 7fa66059a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa658139200 0x7fa6581cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.964+0000 7fa66059a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa658138fd0 con 0x7fa658133900 2023-10-03T10:14:04.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.964+0000 7fa66059a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa658131080 con 0x7fa6581368e0 2023-10-03T10:14:04.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.964+0000 7fa66059a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa658070590 con 0x7fa658139200 2023-10-03T10:14:04.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.964+0000 7fa65eb37700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa658139200 0x7fa6581cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.964+0000 7fa65eb37700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa658139200 0x7fa6581cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:52656/0 (socket says 172.21.15.146:52656) 2023-10-03T10:14:04.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.964+0000 7fa65eb37700 1 -- 172.21.15.146:0/3896972020 learned_addr learned my addr 172.21.15.146:0/3896972020 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:04.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.964+0000 7fa65db35700 1 --2- 172.21.15.146:0/3896972020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6581368e0 0x7fa658070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.965+0000 7fa65eb37700 1 -- 172.21.15.146:0/3896972020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6581368e0 msgr2=0x7fa658070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.965+0000 7fa65eb37700 1 --2- 172.21.15.146:0/3896972020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6581368e0 0x7fa658070e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.965+0000 7fa65eb37700 1 -- 172.21.15.146:0/3896972020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa658133900 msgr2=0x7fa658070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.965+0000 7fa65eb37700 1 --2- 172.21.15.146:0/3896972020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa658133900 0x7fa658070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.965+0000 7fa65eb37700 1 -- 172.21.15.146:0/3896972020 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa650009b30 con 0x7fa658139200 2023-10-03T10:14:04.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.965+0000 7fa65db35700 1 --2- 172.21.15.146:0/3896972020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6581368e0 0x7fa658070e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:04.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.965+0000 7fa65eb37700 1 --2- 172.21.15.146:0/3896972020 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa658139200 0x7fa6581cc6b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa65000b680 tx=0x7fa650004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.963+0000 7fb08e1c4700 1 Processor -- start 2023-10-03T10:14:04.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.963+0000 7fb08e1c4700 1 -- start start 2023-10-03T10:14:04.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.964+0000 7fb08e1c4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0880a0a70 0x7fb088133670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.964+0000 7fb08e1c4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0880a1380 0x7fb08812d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.964+0000 7fb08e1c4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb088133f50 0x7fb08812d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.964+0000 7fb08e1c4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0881bcce0 con 0x7fb0880a1380 2023-10-03T10:14:04.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.964+0000 7fb08e1c4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0881bd280 con 0x7fb0880a0a70 2023-10-03T10:14:04.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.964+0000 7fb08e1c4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0881bb920 con 0x7fb088133f50 2023-10-03T10:14:04.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.964+0000 7fb087fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb088133f50 0x7fb08812d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.964+0000 7fb087fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb088133f50 0x7fb08812d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:52642/0 (socket says 172.21.15.146:52642) 2023-10-03T10:14:04.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.964+0000 7fb087fff700 1 -- 172.21.15.146:0/2461891709 learned_addr learned my addr 172.21.15.146:0/2461891709 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:04.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.964+0000 7fb0877fe700 1 --2- 172.21.15.146:0/2461891709 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0880a0a70 0x7fb088133670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.965+0000 7fb086ffd700 1 --2- 172.21.15.146:0/2461891709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0880a1380 0x7fb08812d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.965+0000 7fb086ffd700 1 -- 172.21.15.146:0/2461891709 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb088133f50 msgr2=0x7fb08812d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.965+0000 7fb086ffd700 1 --2- 172.21.15.146:0/2461891709 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb088133f50 0x7fb08812d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.965+0000 7fb086ffd700 1 -- 172.21.15.146:0/2461891709 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0880a0a70 msgr2=0x7fb088133670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.965+0000 7fb086ffd700 1 --2- 172.21.15.146:0/2461891709 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0880a0a70 0x7fb088133670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.965+0000 7fb086ffd700 1 -- 172.21.15.146:0/2461891709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0700094a0 con 0x7fb0880a1380 2023-10-03T10:14:04.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.965+0000 7fb086ffd700 1 --2- 172.21.15.146:0/2461891709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0880a1380 0x7fb08812d000 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb07800e840 tx=0x7fb07800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.965+0000 7fa64effd700 1 -- 172.21.15.146:0/3896972020 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650004440 con 0x7fa658139200 2023-10-03T10:14:04.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.966+0000 7fa64effd700 1 -- 172.21.15.146:0/3896972020 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6500045a0 con 0x7fa658139200 2023-10-03T10:14:04.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.966+0000 7fa64effd700 1 -- 172.21.15.146:0/3896972020 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650004950 con 0x7fa658139200 2023-10-03T10:14:04.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.966+0000 7fb07ffff700 1 -- 172.21.15.146:0/2461891709 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb078013680 con 0x7fb0880a1380 2023-10-03T10:14:04.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.966+0000 7fb07ffff700 1 -- 172.21.15.146:0/2461891709 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0780137e0 con 0x7fb0880a1380 2023-10-03T10:14:04.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.966+0000 7fb08e1c4700 1 -- 172.21.15.146:0/2461891709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0880a03e0 con 0x7fb0880a1380 2023-10-03T10:14:04.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.966+0000 7fb07ffff700 1 -- 172.21.15.146:0/2461891709 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb078013b50 con 0x7fb0880a1380 2023-10-03T10:14:04.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.966+0000 7fb08e1c4700 1 -- 172.21.15.146:0/2461891709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0881bb370 con 0x7fb0880a1380 2023-10-03T10:14:04.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.967+0000 7fa66059a700 1 -- 172.21.15.146:0/3896972020 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6580713d0 con 0x7fa658139200 2023-10-03T10:14:04.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.967+0000 7fa66059a700 1 -- 172.21.15.146:0/3896972020 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa658122060 con 0x7fa658139200 2023-10-03T10:14:04.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.967+0000 7fb08e1c4700 1 -- 172.21.15.146:0/2461891709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06c0052e0 con 0x7fb0880a1380 2023-10-03T10:14:04.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.967+0000 7fb07ffff700 1 -- 172.21.15.146:0/2461891709 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb078013cb0 con 0x7fb0880a1380 2023-10-03T10:14:04.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.968+0000 7fb07ffff700 1 -- 172.21.15.146:0/2461891709 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb07803f910 con 0x7fb0880a1380 2023-10-03T10:14:04.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.968+0000 7fa66059a700 1 -- 172.21.15.146:0/3896972020 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65804f2a0 con 0x7fa658139200 2023-10-03T10:14:04.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.968+0000 7fa64effd700 1 -- 172.21.15.146:0/3896972020 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa650019030 con 0x7fa658139200 2023-10-03T10:14:04.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.968+0000 7fa64effd700 1 -- 172.21.15.146:0/3896972020 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa6500239b0 con 0x7fa658139200 2023-10-03T10:14:04.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.972+0000 7fb07ffff700 1 -- 172.21.15.146:0/2461891709 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb07801ab90 con 0x7fb0880a1380 2023-10-03T10:14:04.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:04.977+0000 7fa64effd700 1 -- 172.21.15.146:0/3896972020 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa650023bc0 con 0x7fa658139200 2023-10-03T10:14:05.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.009+0000 7fd7e9047700 1 Processor -- start 2023-10-03T10:14:05.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.010+0000 7fd7e9047700 1 -- start start 2023-10-03T10:14:05.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.010+0000 7fd7e9047700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd7e40a1550 0x7fd7e4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.010+0000 7fd7e9047700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7e4139200 0x7fd7e413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.010+0000 7fd7e9047700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e409e9d0 con 0x7fd7e40a0a70 2023-10-03T10:14:05.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.010+0000 7fd7e9047700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e409dc00 con 0x7fd7e40a1550 2023-10-03T10:14:05.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.010+0000 7fd7e9047700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e409dec0 con 0x7fd7e4139200 2023-10-03T10:14:05.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.011+0000 7fd7e359e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7e4139200 0x7fd7e413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.011+0000 7fd7e359e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7e4139200 0x7fd7e413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:52666/0 (socket says 172.21.15.146:52666) 2023-10-03T10:14:05.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.011+0000 7fd7e359e700 1 -- 172.21.15.146:0/2749058555 learned_addr learned my addr 172.21.15.146:0/2749058555 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.011+0000 7fd7e259c700 1 --2- 172.21.15.146:0/2749058555 >> v2:172.21.15.146:3300/0 conn(0x7fd7e40a1550 0x7fd7e4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.011+0000 7fd7e359e700 1 -- 172.21.15.146:0/2749058555 >> v2:172.21.15.146:3300/0 conn(0x7fd7e40a1550 msgr2=0x7fd7e4138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.011+0000 7fd7e359e700 1 --2- 172.21.15.146:0/2749058555 >> v2:172.21.15.146:3300/0 conn(0x7fd7e40a1550 0x7fd7e4138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.011+0000 7fd7e359e700 1 -- 172.21.15.146:0/2749058555 >> v1:172.21.15.146:6789/0 conn(0x7fd7e40a0a70 legacy=0x7fd7e40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.011+0000 7fd7e359e700 1 -- 172.21.15.146:0/2749058555 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e409e6a0 con 0x7fd7e4139200 2023-10-03T10:14:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.011+0000 7fd7e359e700 1 --2- 172.21.15.146:0/2749058555 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7e4139200 0x7fd7e413b5e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009e50 tx=0x7fd7dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80bb78b4a4f79144 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.011+0000 7fd7e1d9b700 1 -- 172.21.15.146:0/2749058555 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc00e070 con 0x7fd7e4139200 2023-10-03T10:14:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.011+0000 7fd7e1d9b700 1 -- 172.21.15.146:0/2749058555 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc003a20 con 0x7fd7e4139200 2023-10-03T10:14:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.011+0000 7fd7e1d9b700 1 -- 172.21.15.146:0/2749058555 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc003dd0 con 0x7fd7e4139200 2023-10-03T10:14:05.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.012+0000 7fd7e9047700 1 -- 172.21.15.146:0/2749058555 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7e4139200 msgr2=0x7fd7e413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.012+0000 7fd7e9047700 1 --2- 172.21.15.146:0/2749058555 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7e4139200 0x7fd7e413b5e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009e50 tx=0x7fd7dc00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.012+0000 7fd7e9047700 1 -- 172.21.15.146:0/2749058555 shutdown_connections 2023-10-03T10:14:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.012+0000 7fd7e9047700 1 --2- 172.21.15.146:0/2749058555 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7e4139200 0x7fd7e413b5e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.012+0000 7fd7e9047700 1 --2- 172.21.15.146:0/2749058555 >> v2:172.21.15.146:3300/0 conn(0x7fd7e40a1550 0x7fd7e4138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.012+0000 7fd7e9047700 1 -- 172.21.15.146:0/2749058555 >> 172.21.15.146:0/2749058555 conn(0x7fd7e40a6610 msgr2=0x7fd7e40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.012+0000 7fd7e9047700 1 -- 172.21.15.146:0/2749058555 shutdown_connections 2023-10-03T10:14:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.012+0000 7fd7e9047700 1 -- 172.21.15.146:0/2749058555 wait complete. 2023-10-03T10:14:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.013+0000 7fd7e9047700 1 Processor -- start 2023-10-03T10:14:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.013+0000 7fd7e9047700 1 -- start start 2023-10-03T10:14:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.014+0000 7fd7e9047700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7e40a0a70 0x7fd7e411f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.014+0000 7fd7e9047700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7e40a1550 0x7fd7e411f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.014+0000 7fd7e9047700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7e4139200 0x7fd7e41c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.014+0000 7fd7e9047700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e411f030 con 0x7fd7e40a1550 2023-10-03T10:14:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.014+0000 7fd7e9047700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e411ff00 con 0x7fd7e40a0a70 2023-10-03T10:14:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.014+0000 7fd7e9047700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e4122350 con 0x7fd7e4139200 2023-10-03T10:14:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.014+0000 7fd7e359e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7e4139200 0x7fd7e41c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.014+0000 7fd7e259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7e40a1550 0x7fd7e411f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.014+0000 7fd7e359e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7e4139200 0x7fd7e41c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:52674/0 (socket says 172.21.15.146:52674) 2023-10-03T10:14:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.014+0000 7fd7e359e700 1 -- 172.21.15.146:0/3447383335 learned_addr learned my addr 172.21.15.146:0/3447383335 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.014+0000 7fd7e2d9d700 1 --2- 172.21.15.146:0/3447383335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7e40a0a70 0x7fd7e411f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.014+0000 7fd7e259c700 1 -- 172.21.15.146:0/3447383335 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7e4139200 msgr2=0x7fd7e41c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.014+0000 7fd7e259c700 1 --2- 172.21.15.146:0/3447383335 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7e4139200 0x7fd7e41c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.014+0000 7fd7e259c700 1 -- 172.21.15.146:0/3447383335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7e40a0a70 msgr2=0x7fd7e411f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.014+0000 7fd7e259c700 1 --2- 172.21.15.146:0/3447383335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7e40a0a70 0x7fd7e411f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.014+0000 7fd7e259c700 1 -- 172.21.15.146:0/3447383335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7dc009b30 con 0x7fd7e40a1550 2023-10-03T10:14:05.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.014+0000 7fd7e259c700 1 --2- 172.21.15.146:0/3447383335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7e40a1550 0x7fd7e411f9c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800e900 tx=0x7fd7d800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.015+0000 7fd7cb7fe700 1 -- 172.21.15.146:0/3447383335 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8013680 con 0x7fd7e40a1550 2023-10-03T10:14:05.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.015+0000 7fd7cb7fe700 1 -- 172.21.15.146:0/3447383335 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d80137e0 con 0x7fd7e40a1550 2023-10-03T10:14:05.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.015+0000 7fd7e9047700 1 -- 172.21.15.146:0/3447383335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e40a03e0 con 0x7fd7e40a1550 2023-10-03T10:14:05.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.015+0000 7fd7cb7fe700 1 -- 172.21.15.146:0/3447383335 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8013b50 con 0x7fd7e40a1550 2023-10-03T10:14:05.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.015+0000 7fd7e9047700 1 -- 172.21.15.146:0/3447383335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e4122d30 con 0x7fd7e40a1550 2023-10-03T10:14:05.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.016+0000 7fd7cb7fe700 1 -- 172.21.15.146:0/3447383335 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd7d8013cb0 con 0x7fd7e40a1550 2023-10-03T10:14:05.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.016+0000 7fd7e9047700 1 -- 172.21.15.146:0/3447383335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e404f2a0 con 0x7fd7e40a1550 2023-10-03T10:14:05.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.016+0000 7fd7cb7fe700 1 -- 172.21.15.146:0/3447383335 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd7d803f690 con 0x7fd7e40a1550 2023-10-03T10:14:05.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.021+0000 7fd7cb7fe700 1 -- 172.21.15.146:0/3447383335 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd7d800c8c0 con 0x7fd7e40a1550 2023-10-03T10:14:05.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.134+0000 7fdc72421700 1 -- 172.21.15.146:0/3966768207 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdc6c120e00 con 0x7fdc6c133900 2023-10-03T10:14:05.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.134+0000 7fdc68ff9700 1 -- 172.21.15.146:0/3966768207 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdc60028070 con 0x7fdc6c133900 2023-10-03T10:14:05.135 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:05.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.136+0000 7fdc72421700 1 -- 172.21.15.146:0/3966768207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc6c133900 msgr2=0x7fdc6c11dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.136+0000 7fdc72421700 1 --2- 172.21.15.146:0/3966768207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc6c133900 0x7fdc6c11dc80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fdc60016000 tx=0x7fdc60004750 comp rx=0 tx=0).stop 2023-10-03T10:14:05.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.136+0000 7fdc72421700 1 -- 172.21.15.146:0/3966768207 shutdown_connections 2023-10-03T10:14:05.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.136+0000 7fdc72421700 1 --2- 172.21.15.146:0/3966768207 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc6c134210 0x7fdc6c11e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.136+0000 7fdc72421700 1 --2- 172.21.15.146:0/3966768207 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc6c0a0ee0 0x7fdc6c11d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.136+0000 7fdc72421700 1 --2- 172.21.15.146:0/3966768207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc6c133900 0x7fdc6c11dc80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.136+0000 7fdc72421700 1 -- 172.21.15.146:0/3966768207 >> 172.21.15.146:0/3966768207 conn(0x7fdc6c0a2980 msgr2=0x7fdc6c1bac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.136+0000 7fdc72421700 1 -- 172.21.15.146:0/3966768207 shutdown_connections 2023-10-03T10:14:05.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.136+0000 7fdc72421700 1 -- 172.21.15.146:0/3966768207 wait complete. 2023-10-03T10:14:05.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:05.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.169+0000 7fb08e1c4700 1 -- 172.21.15.146:0/2461891709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb06c005590 con 0x7fb0880a1380 2023-10-03T10:14:05.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.169+0000 7fb07ffff700 1 -- 172.21.15.146:0/2461891709 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb078017070 con 0x7fb0880a1380 2023-10-03T10:14:05.170 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:05.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.171+0000 7fb08e1c4700 1 -- 172.21.15.146:0/2461891709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0880a1380 msgr2=0x7fb08812d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.171+0000 7fb08e1c4700 1 --2- 172.21.15.146:0/2461891709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0880a1380 0x7fb08812d000 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb07800e840 tx=0x7fb07800eb50 comp rx=0 tx=0).stop 2023-10-03T10:14:05.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.171+0000 7fb08e1c4700 1 -- 172.21.15.146:0/2461891709 shutdown_connections 2023-10-03T10:14:05.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.171+0000 7fb08e1c4700 1 --2- 172.21.15.146:0/2461891709 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb088133f50 0x7fb08812d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.171+0000 7fb08e1c4700 1 --2- 172.21.15.146:0/2461891709 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0880a0a70 0x7fb088133670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.171+0000 7fb08e1c4700 1 --2- 172.21.15.146:0/2461891709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0880a1380 0x7fb08812d000 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.171+0000 7fb08e1c4700 1 -- 172.21.15.146:0/2461891709 >> 172.21.15.146:0/2461891709 conn(0x7fb0880a6610 msgr2=0x7fb08809b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.172+0000 7fb08e1c4700 1 -- 172.21.15.146:0/2461891709 shutdown_connections 2023-10-03T10:14:05.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.172+0000 7fb08e1c4700 1 -- 172.21.15.146:0/2461891709 wait complete. 2023-10-03T10:14:05.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:05.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.204+0000 7fa66059a700 1 -- 172.21.15.146:0/3896972020 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa6580713d0 con 0x7fa658139200 2023-10-03T10:14:05.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.204+0000 7fa64effd700 1 -- 172.21.15.146:0/3896972020 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa6580713d0 con 0x7fa658139200 2023-10-03T10:14:05.205 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:05.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.206+0000 7fa66059a700 1 -- 172.21.15.146:0/3896972020 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa658139200 msgr2=0x7fa6581cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.206+0000 7fa66059a700 1 --2- 172.21.15.146:0/3896972020 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa658139200 0x7fa6581cc6b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa65000b680 tx=0x7fa650004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.206+0000 7fa66059a700 1 -- 172.21.15.146:0/3896972020 shutdown_connections 2023-10-03T10:14:05.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.206+0000 7fa66059a700 1 --2- 172.21.15.146:0/3896972020 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa658139200 0x7fa6581cc6b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.206+0000 7fa66059a700 1 --2- 172.21.15.146:0/3896972020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa658133900 0x7fa658070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.206+0000 7fa66059a700 1 --2- 172.21.15.146:0/3896972020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6581368e0 0x7fa658070e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.206+0000 7fa66059a700 1 -- 172.21.15.146:0/3896972020 >> 172.21.15.146:0/3896972020 conn(0x7fa6580a2980 msgr2=0x7fa6581346c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.206+0000 7fa66059a700 1 -- 172.21.15.146:0/3896972020 shutdown_connections 2023-10-03T10:14:05.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.206+0000 7fa66059a700 1 -- 172.21.15.146:0/3896972020 wait complete. 2023-10-03T10:14:05.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:05.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.233+0000 7fd7e9047700 1 -- 172.21.15.146:0/3447383335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd7e4122490 con 0x7fd7e40a1550 2023-10-03T10:14:05.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.234+0000 7fd7cb7fe700 1 -- 172.21.15.146:0/3447383335 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd7e4122490 con 0x7fd7e40a1550 2023-10-03T10:14:05.235 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.236+0000 7fd7e9047700 1 -- 172.21.15.146:0/3447383335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7e40a1550 msgr2=0x7fd7e411f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.236+0000 7fd7e9047700 1 --2- 172.21.15.146:0/3447383335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7e40a1550 0x7fd7e411f9c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800e900 tx=0x7fd7d800ec10 comp rx=0 tx=0).stop 2023-10-03T10:14:05.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.236+0000 7fd7e9047700 1 -- 172.21.15.146:0/3447383335 shutdown_connections 2023-10-03T10:14:05.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.236+0000 7fd7e9047700 1 --2- 172.21.15.146:0/3447383335 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7e4139200 0x7fd7e41c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.236+0000 7fd7e9047700 1 --2- 172.21.15.146:0/3447383335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7e40a0a70 0x7fd7e411f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.236+0000 7fd7e9047700 1 --2- 172.21.15.146:0/3447383335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7e40a1550 0x7fd7e411f9c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.236+0000 7fd7e9047700 1 -- 172.21.15.146:0/3447383335 >> 172.21.15.146:0/3447383335 conn(0x7fd7e40a6610 msgr2=0x7fd7e4136c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.236+0000 7fd7e9047700 1 -- 172.21.15.146:0/3447383335 shutdown_connections 2023-10-03T10:14:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:05.236+0000 7fd7e9047700 1 -- 172.21.15.146:0/3447383335 wait complete. 2023-10-03T10:14:05.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:06.150 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:06.186 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:06.220 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:06.249 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.300+0000 7fd8d21a0700 1 Processor -- start 2023-10-03T10:14:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.300+0000 7fd8d21a0700 1 -- start start 2023-10-03T10:14:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.301+0000 7fd8d21a0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd8cc136950 0x7fd8cc138d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.301+0000 7fd8d21a0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8cc139270 0x7fd8cc13b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.301+0000 7fd8d21a0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8cc133640 con 0x7fd8cc133a70 2023-10-03T10:14:06.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.301+0000 7fd8d21a0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc0a1d50 con 0x7fd8cc139270 2023-10-03T10:14:06.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.301+0000 7fd8d21a0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc134550 con 0x7fd8cc136950 2023-10-03T10:14:06.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.301+0000 7fd8cbfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8cc139270 0x7fd8cc13b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.301+0000 7fd8caffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd8cc136950 0x7fd8cc138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.301+0000 7fd8caffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd8cc136950 0x7fd8cc138d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:52688/0 (socket says 172.21.15.146:52688) 2023-10-03T10:14:06.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.301+0000 7fd8cb7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd8cc133a70 0x7fd8cc133e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39934/0 (socket says 172.21.15.146:39934) 2023-10-03T10:14:06.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.301+0000 7fd8cbfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8cc139270 0x7fd8cc13b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56008/0 (socket says 172.21.15.146:56008) 2023-10-03T10:14:06.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.301+0000 7fd8caffd700 1 -- 172.21.15.146:0/4177099212 learned_addr learned my addr 172.21.15.146:0/4177099212 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:06.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.302+0000 7fd8caffd700 1 -- 172.21.15.146:0/4177099212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8cc139270 msgr2=0x7fd8cc13b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:06.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.302+0000 7fd8caffd700 1 --2- 172.21.15.146:0/4177099212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8cc139270 0x7fd8cc13b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.302+0000 7fd8caffd700 1 -- 172.21.15.146:0/4177099212 >> v1:172.21.15.146:6789/0 conn(0x7fd8cc133a70 legacy=0x7fd8cc133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.302+0000 7fd8caffd700 1 -- 172.21.15.146:0/4177099212 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8cc09b620 con 0x7fd8cc136950 2023-10-03T10:14:06.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.302+0000 7fd8cbfff700 1 --2- 172.21.15.146:0/4177099212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8cc139270 0x7fd8cc13b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:06.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.302+0000 7fd8caffd700 1 --2- 172.21.15.146:0/4177099212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd8cc136950 0x7fd8cc138d30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0009920 tx=0x7fd8c0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ae807b1630467d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:06.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.302+0000 7fd8ca7fc700 1 -- 172.21.15.146:0/4177099212 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0011830 con 0x7fd8cc136950 2023-10-03T10:14:06.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.302+0000 7fd8ca7fc700 1 -- 172.21.15.146:0/4177099212 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c0011990 con 0x7fd8cc136950 2023-10-03T10:14:06.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.302+0000 7fd8ca7fc700 1 -- 172.21.15.146:0/4177099212 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0011d20 con 0x7fd8cc136950 2023-10-03T10:14:06.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.303+0000 7fd8d21a0700 1 -- 172.21.15.146:0/4177099212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd8cc136950 msgr2=0x7fd8cc138d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.303+0000 7fd8d21a0700 1 --2- 172.21.15.146:0/4177099212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd8cc136950 0x7fd8cc138d30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0009920 tx=0x7fd8c0009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:06.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.303+0000 7fd8d21a0700 1 -- 172.21.15.146:0/4177099212 shutdown_connections 2023-10-03T10:14:06.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.303+0000 7fd8d21a0700 1 --2- 172.21.15.146:0/4177099212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8cc139270 0x7fd8cc13b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.303+0000 7fd8d21a0700 1 --2- 172.21.15.146:0/4177099212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd8cc136950 0x7fd8cc138d30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.303+0000 7fd8d21a0700 1 -- 172.21.15.146:0/4177099212 >> 172.21.15.146:0/4177099212 conn(0x7fd8cc0a2980 msgr2=0x7fd8cc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.303+0000 7fd8d21a0700 1 -- 172.21.15.146:0/4177099212 shutdown_connections 2023-10-03T10:14:06.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.303+0000 7fd8d21a0700 1 -- 172.21.15.146:0/4177099212 wait complete. 2023-10-03T10:14:06.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.304+0000 7fd8d21a0700 1 Processor -- start 2023-10-03T10:14:06.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.304+0000 7fd8d21a0700 1 -- start start 2023-10-03T10:14:06.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.305+0000 7fd8d21a0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8cc133a70 0x7fd8cc11a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.305+0000 7fd8d21a0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8cc136950 0x7fd8cc11a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.305+0000 7fd8d21a0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd8cc139270 0x7fd8cc11ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.305+0000 7fd8d21a0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc09a350 con 0x7fd8cc133a70 2023-10-03T10:14:06.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.305+0000 7fd8d21a0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc11dd40 con 0x7fd8cc136950 2023-10-03T10:14:06.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.305+0000 7fd8d21a0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc11c1b0 con 0x7fd8cc139270 2023-10-03T10:14:06.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.305+0000 7fd8caffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8cc136950 0x7fd8cc11a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.305+0000 7fd8caffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8cc136950 0x7fd8cc11a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56018/0 (socket says 172.21.15.146:56018) 2023-10-03T10:14:06.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.305+0000 7fd8caffd700 1 -- 172.21.15.146:0/3462217938 learned_addr learned my addr 172.21.15.146:0/3462217938 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:06.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.305+0000 7fd8cb7fe700 1 --2- 172.21.15.146:0/3462217938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8cc133a70 0x7fd8cc11a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.305+0000 7fd8cbfff700 1 --2- 172.21.15.146:0/3462217938 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd8cc139270 0x7fd8cc11ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.305+0000 7fd8caffd700 1 -- 172.21.15.146:0/3462217938 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd8cc139270 msgr2=0x7fd8cc11ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.305+0000 7fd8caffd700 1 --2- 172.21.15.146:0/3462217938 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd8cc139270 0x7fd8cc11ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.305+0000 7fd8caffd700 1 -- 172.21.15.146:0/3462217938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8cc133a70 msgr2=0x7fd8cc11a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.305+0000 7fd8caffd700 1 --2- 172.21.15.146:0/3462217938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8cc133a70 0x7fd8cc11a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.305+0000 7fd8caffd700 1 -- 172.21.15.146:0/3462217938 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c4009a70 con 0x7fd8cc136950 2023-10-03T10:14:06.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.305+0000 7fd8cb7fe700 1 --2- 172.21.15.146:0/3462217938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8cc133a70 0x7fd8cc11a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:06.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.305+0000 7fd8caffd700 1 --2- 172.21.15.146:0/3462217938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8cc136950 0x7fd8cc11a5c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0000c00 tx=0x7fd8c0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:06.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.305+0000 7fd8b3fff700 1 -- 172.21.15.146:0/3462217938 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c00044d0 con 0x7fd8cc136950 2023-10-03T10:14:06.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.306+0000 7fd8b3fff700 1 -- 172.21.15.146:0/3462217938 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c00036a0 con 0x7fd8cc136950 2023-10-03T10:14:06.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.306+0000 7fd8d21a0700 1 -- 172.21.15.146:0/3462217938 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c0009550 con 0x7fd8cc136950 2023-10-03T10:14:06.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.306+0000 7fd8b3fff700 1 -- 172.21.15.146:0/3462217938 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0003a10 con 0x7fd8cc136950 2023-10-03T10:14:06.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.306+0000 7fd8d21a0700 1 -- 172.21.15.146:0/3462217938 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8cc11d820 con 0x7fd8cc136950 2023-10-03T10:14:06.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.306+0000 7fd8b3fff700 1 -- 172.21.15.146:0/3462217938 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd8c0021070 con 0x7fd8cc136950 2023-10-03T10:14:06.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.307+0000 7fd8b3fff700 1 -- 172.21.15.146:0/3462217938 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd8c0040640 con 0x7fd8cc136950 2023-10-03T10:14:06.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.307+0000 7fd8d21a0700 1 -- 172.21.15.146:0/3462217938 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8cc04f2a0 con 0x7fd8cc136950 2023-10-03T10:14:06.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.312+0000 7fd8b3fff700 1 -- 172.21.15.146:0/3462217938 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd8c002c990 con 0x7fd8cc136950 2023-10-03T10:14:06.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.345+0000 7f5e3ec54700 1 Processor -- start 2023-10-03T10:14:06.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.345+0000 7f5e3ec54700 1 -- start start 2023-10-03T10:14:06.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.346+0000 7f5e3ec54700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5e380a0a70 0x7f5e380a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.346+0000 7f5e3ec54700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e38134120 0x7f5e3813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.346+0000 7f5e3ec54700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3809dc00 con 0x7f5e380a1380 2023-10-03T10:14:06.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.346+0000 7f5e3ec54700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e3809ea90 con 0x7f5e380a0a70 2023-10-03T10:14:06.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.346+0000 7f5e3ec54700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3809dec0 con 0x7f5e38134120 2023-10-03T10:14:06.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.346+0000 7f5e3d1f1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e38134120 0x7f5e3813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.346+0000 7f5e37fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5e380a1380 0x7f5e38133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39942/0 (socket says 172.21.15.146:39942) 2023-10-03T10:14:06.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.346+0000 7f5e37fff700 1 -- 172.21.15.146:0/2929091630 learned_addr learned my addr 172.21.15.146:0/2929091630 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:06.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.346+0000 7f5e3c9f0700 1 --2- 172.21.15.146:0/2929091630 >> v2:172.21.15.146:3300/0 conn(0x7f5e380a0a70 0x7f5e380a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.346+0000 7f5e3d1f1700 1 -- 172.21.15.146:0/2929091630 >> v2:172.21.15.146:3300/0 conn(0x7f5e380a0a70 msgr2=0x7f5e380a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:06.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.346+0000 7f5e3d1f1700 1 --2- 172.21.15.146:0/2929091630 >> v2:172.21.15.146:3300/0 conn(0x7f5e380a0a70 0x7f5e380a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.346+0000 7f5e3d1f1700 1 -- 172.21.15.146:0/2929091630 >> v1:172.21.15.146:6789/0 conn(0x7f5e380a1380 legacy=0x7f5e38133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.346+0000 7f5e3d1f1700 1 -- 172.21.15.146:0/2929091630 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3809e6a0 con 0x7f5e38134120 2023-10-03T10:14:06.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.347+0000 7f5e3d1f1700 1 --2- 172.21.15.146:0/2929091630 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e38134120 0x7f5e3813bce0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009d90 tx=0x7f5e3000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93312fb5b7a44f23 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:06.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.347+0000 7f5e377fe700 1 -- 172.21.15.146:0/2929091630 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3000e070 con 0x7f5e38134120 2023-10-03T10:14:06.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.347+0000 7f5e377fe700 1 -- 172.21.15.146:0/2929091630 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3000bbd0 con 0x7f5e38134120 2023-10-03T10:14:06.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.347+0000 7f5e377fe700 1 -- 172.21.15.146:0/2929091630 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e30012430 con 0x7f5e38134120 2023-10-03T10:14:06.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.348+0000 7f5e3ec54700 1 -- 172.21.15.146:0/2929091630 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e38134120 msgr2=0x7f5e3813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.348+0000 7f5e3ec54700 1 --2- 172.21.15.146:0/2929091630 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e38134120 0x7f5e3813bce0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009d90 tx=0x7f5e3000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:06.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.348+0000 7f5e3ec54700 1 -- 172.21.15.146:0/2929091630 shutdown_connections 2023-10-03T10:14:06.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.348+0000 7f5e3ec54700 1 --2- 172.21.15.146:0/2929091630 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e38134120 0x7f5e3813bce0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.348+0000 7f5e3ec54700 1 --2- 172.21.15.146:0/2929091630 >> v2:172.21.15.146:3300/0 conn(0x7f5e380a0a70 0x7f5e380a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.348+0000 7f5e3ec54700 1 -- 172.21.15.146:0/2929091630 >> 172.21.15.146:0/2929091630 conn(0x7f5e380a6610 msgr2=0x7f5e380a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.348+0000 7f5e3ec54700 1 -- 172.21.15.146:0/2929091630 shutdown_connections 2023-10-03T10:14:06.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.348+0000 7f5e3ec54700 1 -- 172.21.15.146:0/2929091630 wait complete. 2023-10-03T10:14:06.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.349+0000 7f5e3ec54700 1 Processor -- start 2023-10-03T10:14:06.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.349+0000 7f5e3ec54700 1 -- start start 2023-10-03T10:14:06.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.350+0000 7f5e3ec54700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e380a0a70 0x7f5e381229c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.350+0000 7f5e3ec54700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e380a1380 0x7f5e38122f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.350+0000 7f5e3ec54700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e38134120 0x7f5e38123440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.350+0000 7f5e3ec54700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e381260a0 con 0x7f5e380a1380 2023-10-03T10:14:06.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.350+0000 7f5e3ec54700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380a03e0 con 0x7f5e380a0a70 2023-10-03T10:14:06.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.350+0000 7f5e3ec54700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e38124a40 con 0x7f5e38134120 2023-10-03T10:14:06.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.350+0000 7f5e3c9f0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e380a0a70 0x7f5e381229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.350+0000 7f5e3c9f0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e380a0a70 0x7f5e381229c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56026/0 (socket says 172.21.15.146:56026) 2023-10-03T10:14:06.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.350+0000 7f5e3c9f0700 1 -- 172.21.15.146:0/1386424682 learned_addr learned my addr 172.21.15.146:0/1386424682 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:06.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.350+0000 7f5e37fff700 1 --2- 172.21.15.146:0/1386424682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e380a1380 0x7f5e38122f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.351+0000 7f5e3c9f0700 1 -- 172.21.15.146:0/1386424682 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e38134120 msgr2=0x7f5e38123440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.351+0000 7f5e3c9f0700 1 --2- 172.21.15.146:0/1386424682 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e38134120 0x7f5e38123440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.351+0000 7f5e3c9f0700 1 -- 172.21.15.146:0/1386424682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e380a1380 msgr2=0x7f5e38122f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.351+0000 7f5e3c9f0700 1 --2- 172.21.15.146:0/1386424682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e380a1380 0x7f5e38122f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.351+0000 7f5e3c9f0700 1 -- 172.21.15.146:0/1386424682 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e30009a70 con 0x7f5e380a0a70 2023-10-03T10:14:06.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.351+0000 7f5e3c9f0700 1 --2- 172.21.15.146:0/1386424682 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e380a0a70 0x7f5e381229c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00e810 tx=0x7f5e2c00ebd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:06.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.351+0000 7f5e357fa700 1 -- 172.21.15.146:0/1386424682 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c013610 con 0x7f5e380a0a70 2023-10-03T10:14:06.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.351+0000 7f5e357fa700 1 -- 172.21.15.146:0/1386424682 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c013770 con 0x7f5e380a0a70 2023-10-03T10:14:06.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.351+0000 7f5e3ec54700 1 -- 172.21.15.146:0/1386424682 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e381245e0 con 0x7f5e380a0a70 2023-10-03T10:14:06.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.351+0000 7f5e357fa700 1 -- 172.21.15.146:0/1386424682 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c013b20 con 0x7f5e380a0a70 2023-10-03T10:14:06.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.351+0000 7f5e3ec54700 1 -- 172.21.15.146:0/1386424682 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e38126b10 con 0x7f5e380a0a70 2023-10-03T10:14:06.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.352+0000 7f5e357fa700 1 -- 172.21.15.146:0/1386424682 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e2c013c80 con 0x7f5e380a0a70 2023-10-03T10:14:06.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.353+0000 7f5e357fa700 1 -- 172.21.15.146:0/1386424682 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5e2c040bb0 con 0x7f5e380a0a70 2023-10-03T10:14:06.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.353+0000 7f5e3ec54700 1 -- 172.21.15.146:0/1386424682 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e381261e0 con 0x7f5e380a0a70 2023-10-03T10:14:06.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.357+0000 7f5e357fa700 1 -- 172.21.15.146:0/1386424682 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e381261e0 con 0x7f5e380a0a70 2023-10-03T10:14:06.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.371+0000 7f1e0678f700 1 Processor -- start 2023-10-03T10:14:06.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.371+0000 7f1e0678f700 1 -- start start 2023-10-03T10:14:06.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.372+0000 7f1e0678f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e00138040 0x7f1e00138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.372+0000 7f1e0678f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e000a1400 0x7f1e0013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.372+0000 7f1e0678f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e001379e0 con 0x7f1e000a08e0 2023-10-03T10:14:06.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.372+0000 7f1e0678f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e000a2100 con 0x7f1e000a1400 2023-10-03T10:14:06.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.372+0000 7f1e0678f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e00138950 con 0x7f1e00138040 2023-10-03T10:14:06.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.372+0000 7f1dfffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e00138040 0x7f1e00138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.372+0000 7f1dff7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1e000a08e0 0x7f1e000a0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39954/0 (socket says 172.21.15.146:39954) 2023-10-03T10:14:06.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.372+0000 7f1dff7fe700 1 -- 172.21.15.146:0/1401463691 learned_addr learned my addr 172.21.15.146:0/1401463691 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:06.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.372+0000 7f1e04d2c700 1 --2- 172.21.15.146:0/1401463691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e000a1400 0x7f1e0013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.372+0000 7f1dfeffd700 1 -- 172.21.15.146:0/1401463691 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966991399 0 0) 0x7f1e001379e0 con 0x7f1e000a08e0 2023-10-03T10:14:06.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.372+0000 7f1dfffff700 1 -- 172.21.15.146:0/1401463691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e000a1400 msgr2=0x7f1e0013fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:06.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.372+0000 7f1dfffff700 1 --2- 172.21.15.146:0/1401463691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e000a1400 0x7f1e0013fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.372+0000 7f1dfffff700 1 -- 172.21.15.146:0/1401463691 >> v1:172.21.15.146:6789/0 conn(0x7f1e000a08e0 legacy=0x7f1e000a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.372+0000 7f1dfffff700 1 -- 172.21.15.146:0/1401463691 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0009b9b0 con 0x7f1e00138040 2023-10-03T10:14:06.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.372+0000 7f1e04d2c700 1 --2- 172.21.15.146:0/1401463691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e000a1400 0x7f1e0013fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:06.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.372+0000 7f1dfffff700 1 --2- 172.21.15.146:0/1401463691 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e00138040 0x7f1e00138410 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1df0009880 tx=0x7f1df0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c92b57fb54a0a7f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:06.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.373+0000 7f1dfeffd700 1 -- 172.21.15.146:0/1401463691 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df0005e30 con 0x7f1e00138040 2023-10-03T10:14:06.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.373+0000 7f1dfeffd700 1 -- 172.21.15.146:0/1401463691 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df0006030 con 0x7f1e00138040 2023-10-03T10:14:06.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.373+0000 7f1dfeffd700 1 -- 172.21.15.146:0/1401463691 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df00063c0 con 0x7f1e00138040 2023-10-03T10:14:06.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.373+0000 7f1e0678f700 1 -- 172.21.15.146:0/1401463691 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e00138040 msgr2=0x7f1e00138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.373+0000 7f1e0678f700 1 --2- 172.21.15.146:0/1401463691 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e00138040 0x7f1e00138410 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1df0009880 tx=0x7f1df0009b90 comp rx=0 tx=0).stop 2023-10-03T10:14:06.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.373+0000 7f1e0678f700 1 -- 172.21.15.146:0/1401463691 shutdown_connections 2023-10-03T10:14:06.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.373+0000 7f1e0678f700 1 --2- 172.21.15.146:0/1401463691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e000a1400 0x7f1e0013fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.373+0000 7f1e0678f700 1 --2- 172.21.15.146:0/1401463691 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e00138040 0x7f1e00138410 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.373+0000 7f1e0678f700 1 -- 172.21.15.146:0/1401463691 >> 172.21.15.146:0/1401463691 conn(0x7f1e000a2980 msgr2=0x7f1e000a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.373+0000 7f1e0678f700 1 -- 172.21.15.146:0/1401463691 shutdown_connections 2023-10-03T10:14:06.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.373+0000 7f1e0678f700 1 -- 172.21.15.146:0/1401463691 wait complete. 2023-10-03T10:14:06.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.375+0000 7f1e0678f700 1 Processor -- start 2023-10-03T10:14:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.375+0000 7f1e0678f700 1 -- start start 2023-10-03T10:14:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.375+0000 7f1e0678f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e000a08e0 0x7f1e00126240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.375+0000 7f1e0678f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e000a1400 0x7f1e00126780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.375+0000 7f1e0678f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e00138040 0x7f1e00126cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.375+0000 7f1e0678f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e00137790 con 0x7f1e000a1400 2023-10-03T10:14:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.375+0000 7f1e0678f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e00128ce0 con 0x7f1e00138040 2023-10-03T10:14:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.375+0000 7f1e0678f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0009a240 con 0x7f1e000a08e0 2023-10-03T10:14:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.375+0000 7f1dfffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e000a08e0 0x7f1e00126240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.375+0000 7f1dfffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e000a08e0 0x7f1e00126240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:52714/0 (socket says 172.21.15.146:52714) 2023-10-03T10:14:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.375+0000 7f1dfffff700 1 -- 172.21.15.146:0/2586044867 learned_addr learned my addr 172.21.15.146:0/2586044867 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.376+0000 7f1e04d2c700 1 --2- 172.21.15.146:0/2586044867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e00138040 0x7f1e00126cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.376+0000 7f1dff7fe700 1 --2- 172.21.15.146:0/2586044867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e000a1400 0x7f1e00126780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.376+0000 7f1dfffff700 1 -- 172.21.15.146:0/2586044867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e00138040 msgr2=0x7f1e00126cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.376+0000 7f1dfffff700 1 --2- 172.21.15.146:0/2586044867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e00138040 0x7f1e00126cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.376+0000 7f1dfffff700 1 -- 172.21.15.146:0/2586044867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e000a1400 msgr2=0x7f1e00126780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.376+0000 7f1dfffff700 1 --2- 172.21.15.146:0/2586044867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e000a1400 0x7f1e00126780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.376+0000 7f1dfffff700 1 -- 172.21.15.146:0/2586044867 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df8009a70 con 0x7f1e000a08e0 2023-10-03T10:14:06.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.376+0000 7f1dfffff700 1 --2- 172.21.15.146:0/2586044867 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e000a08e0 0x7f1e00126240 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1df0013040 tx=0x7f1df0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:06.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.376+0000 7f1dfcff9700 1 -- 172.21.15.146:0/2586044867 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df0025430 con 0x7f1e000a08e0 2023-10-03T10:14:06.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.376+0000 7f1dfcff9700 1 -- 172.21.15.146:0/2586044867 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df0020070 con 0x7f1e000a08e0 2023-10-03T10:14:06.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.376+0000 7f1e0678f700 1 -- 172.21.15.146:0/2586044867 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df0009430 con 0x7f1e000a08e0 2023-10-03T10:14:06.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.376+0000 7f1dfcff9700 1 -- 172.21.15.146:0/2586044867 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df00257d0 con 0x7f1e000a08e0 2023-10-03T10:14:06.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.376+0000 7f1e0678f700 1 -- 172.21.15.146:0/2586044867 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e001297c0 con 0x7f1e000a08e0 2023-10-03T10:14:06.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.377+0000 7f1dfcff9700 1 -- 172.21.15.146:0/2586044867 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1df0022030 con 0x7f1e000a08e0 2023-10-03T10:14:06.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.378+0000 7f1dfcff9700 1 -- 172.21.15.146:0/2586044867 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1df0042710 con 0x7f1e000a08e0 2023-10-03T10:14:06.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.378+0000 7f1e0678f700 1 -- 172.21.15.146:0/2586044867 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e0004f2a0 con 0x7f1e000a08e0 2023-10-03T10:14:06.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.382+0000 7f1dfcff9700 1 -- 172.21.15.146:0/2586044867 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1df0046060 con 0x7f1e000a08e0 2023-10-03T10:14:06.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.414+0000 7fd46ef45700 1 Processor -- start 2023-10-03T10:14:06.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.414+0000 7fd46ef45700 1 -- start start 2023-10-03T10:14:06.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.415+0000 7fd46ef45700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd46809ef80 0x7fd46813d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.415+0000 7fd46ef45700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd46809f3b0 0x7fd46813f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.415+0000 7fd46ef45700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd468072b30 con 0x7fd46809a130 2023-10-03T10:14:06.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.415+0000 7fd46ef45700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46809a500 con 0x7fd46809f3b0 2023-10-03T10:14:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.415+0000 7fd46ef45700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46809ada0 con 0x7fd46809ef80 2023-10-03T10:14:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.415+0000 7fd467fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd46809ef80 0x7fd46813d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.415+0000 7fd46d4e2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd46809f3b0 0x7fd46813f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.415+0000 7fd467fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd46809ef80 0x7fd46813d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56052/0 (socket says 172.21.15.146:56052) 2023-10-03T10:14:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.415+0000 7fd46d4e2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd46809f3b0 0x7fd46813f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49292/0 (socket says 172.21.15.146:49292) 2023-10-03T10:14:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.415+0000 7fd46cce1700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd46809a130 0x7fd46809e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39960/0 (socket says 172.21.15.146:39960) 2023-10-03T10:14:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.415+0000 7fd467fff700 1 -- 172.21.15.146:0/1052422344 learned_addr learned my addr 172.21.15.146:0/1052422344 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.415+0000 7fd467fff700 1 -- 172.21.15.146:0/1052422344 >> v2:172.21.15.146:3300/0 conn(0x7fd46809f3b0 msgr2=0x7fd46813f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.415+0000 7fd467fff700 1 --2- 172.21.15.146:0/1052422344 >> v2:172.21.15.146:3300/0 conn(0x7fd46809f3b0 0x7fd46813f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.415+0000 7fd467fff700 1 -- 172.21.15.146:0/1052422344 >> v1:172.21.15.146:6789/0 conn(0x7fd46809a130 legacy=0x7fd46809e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.415+0000 7fd467fff700 1 -- 172.21.15.146:0/1052422344 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46809fe00 con 0x7fd46809ef80 2023-10-03T10:14:06.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.415+0000 7fd46d4e2700 1 --2- 172.21.15.146:0/1052422344 >> v2:172.21.15.146:3300/0 conn(0x7fd46809f3b0 0x7fd46813f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:06.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.416+0000 7fd467fff700 1 --2- 172.21.15.146:0/1052422344 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd46809ef80 0x7fd46813d420 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd4540098f0 tx=0x7fd454009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=507bd5e2a2401420 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.416+0000 7fd4677fe700 1 -- 172.21.15.146:0/1052422344 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd454011830 con 0x7fd46809ef80 2023-10-03T10:14:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.416+0000 7fd4677fe700 1 -- 172.21.15.146:0/1052422344 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd454011990 con 0x7fd46809ef80 2023-10-03T10:14:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.416+0000 7fd4677fe700 1 -- 172.21.15.146:0/1052422344 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd454011d20 con 0x7fd46809ef80 2023-10-03T10:14:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.416+0000 7fd46ef45700 1 -- 172.21.15.146:0/1052422344 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd46809ef80 msgr2=0x7fd46813d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.416+0000 7fd46ef45700 1 --2- 172.21.15.146:0/1052422344 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd46809ef80 0x7fd46813d420 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd4540098f0 tx=0x7fd454009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.416+0000 7fd46ef45700 1 -- 172.21.15.146:0/1052422344 shutdown_connections 2023-10-03T10:14:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.416+0000 7fd46ef45700 1 --2- 172.21.15.146:0/1052422344 >> v2:172.21.15.146:3300/0 conn(0x7fd46809f3b0 0x7fd46813f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.416+0000 7fd46ef45700 1 --2- 172.21.15.146:0/1052422344 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd46809ef80 0x7fd46813d420 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.417+0000 7fd46ef45700 1 -- 172.21.15.146:0/1052422344 >> 172.21.15.146:0/1052422344 conn(0x7fd4680a4430 msgr2=0x7fd4680a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.417+0000 7fd46ef45700 1 -- 172.21.15.146:0/1052422344 shutdown_connections 2023-10-03T10:14:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.417+0000 7fd46ef45700 1 -- 172.21.15.146:0/1052422344 wait complete. 2023-10-03T10:14:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.417+0000 7fd46ef45700 1 Processor -- start 2023-10-03T10:14:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.418+0000 7fd46ef45700 1 -- start start 2023-10-03T10:14:06.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.418+0000 7fd46ef45700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd46809a130 0x7fd46811c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.418+0000 7fd46ef45700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd46809ef80 0x7fd46811ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.418+0000 7fd46ef45700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd46809f3b0 0x7fd46811d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.418+0000 7fd46ef45700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46813ef50 con 0x7fd46809ef80 2023-10-03T10:14:06.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.418+0000 7fd46ef45700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46811b560 con 0x7fd46809a130 2023-10-03T10:14:06.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.418+0000 7fd46ef45700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd46811b7c0 con 0x7fd46809f3b0 2023-10-03T10:14:06.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.418+0000 7fd46cce1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd46809a130 0x7fd46811c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.418+0000 7fd46cce1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd46809a130 0x7fd46811c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56062/0 (socket says 172.21.15.146:56062) 2023-10-03T10:14:06.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.418+0000 7fd46cce1700 1 -- 172.21.15.146:0/3747139032 learned_addr learned my addr 172.21.15.146:0/3747139032 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:06.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.418+0000 7fd46d4e2700 1 --2- 172.21.15.146:0/3747139032 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd46809f3b0 0x7fd46811d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.418+0000 7fd467fff700 1 --2- 172.21.15.146:0/3747139032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd46809ef80 0x7fd46811ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.419+0000 7fd46cce1700 1 -- 172.21.15.146:0/3747139032 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd46809f3b0 msgr2=0x7fd46811d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.419+0000 7fd46cce1700 1 --2- 172.21.15.146:0/3747139032 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd46809f3b0 0x7fd46811d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.419+0000 7fd46cce1700 1 -- 172.21.15.146:0/3747139032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd46809ef80 msgr2=0x7fd46811ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.419+0000 7fd46cce1700 1 --2- 172.21.15.146:0/3747139032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd46809ef80 0x7fd46811ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.419+0000 7fd46cce1700 1 -- 172.21.15.146:0/3747139032 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd460009a70 con 0x7fd46809a130 2023-10-03T10:14:06.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.419+0000 7fd46cce1700 1 --2- 172.21.15.146:0/3747139032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd46809a130 0x7fd46811c940 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd45c00c500 tx=0x7fd45c00c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:06.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.419+0000 7fd4657fa700 1 -- 172.21.15.146:0/3747139032 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c00cea0 con 0x7fd46809a130 2023-10-03T10:14:06.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.419+0000 7fd4657fa700 1 -- 172.21.15.146:0/3747139032 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45c005cb0 con 0x7fd46809a130 2023-10-03T10:14:06.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.419+0000 7fd46ef45700 1 -- 172.21.15.146:0/3747139032 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd454009550 con 0x7fd46809a130 2023-10-03T10:14:06.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.419+0000 7fd4657fa700 1 -- 172.21.15.146:0/3747139032 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c0072d0 con 0x7fd46809a130 2023-10-03T10:14:06.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.419+0000 7fd46ef45700 1 -- 172.21.15.146:0/3747139032 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46811ba80 con 0x7fd46809a130 2023-10-03T10:14:06.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.420+0000 7fd46ef45700 1 -- 172.21.15.146:0/3747139032 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46804f2a0 con 0x7fd46809a130 2023-10-03T10:14:06.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.421+0000 7fd4657fa700 1 -- 172.21.15.146:0/3747139032 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd45c007430 con 0x7fd46809a130 2023-10-03T10:14:06.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.425+0000 7fd4657fa700 1 -- 172.21.15.146:0/3747139032 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd45c005e20 con 0x7fd46809a130 2023-10-03T10:14:06.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.425+0000 7fd4657fa700 1 -- 172.21.15.146:0/3747139032 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd45c044060 con 0x7fd46809a130 2023-10-03T10:14:06.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.570+0000 7fd8d21a0700 1 -- 172.21.15.146:0/3462217938 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd8cc11c3c0 con 0x7fd8cc136950 2023-10-03T10:14:06.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.570+0000 7fd8b3fff700 1 -- 172.21.15.146:0/3462217938 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd8c0015030 con 0x7fd8cc136950 2023-10-03T10:14:06.571 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:06.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.572+0000 7fd8d21a0700 1 -- 172.21.15.146:0/3462217938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8cc136950 msgr2=0x7fd8cc11a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.572+0000 7fd8d21a0700 1 --2- 172.21.15.146:0/3462217938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8cc136950 0x7fd8cc11a5c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0000c00 tx=0x7fd8c0004750 comp rx=0 tx=0).stop 2023-10-03T10:14:06.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.572+0000 7fd8d21a0700 1 -- 172.21.15.146:0/3462217938 shutdown_connections 2023-10-03T10:14:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.572+0000 7fd8d21a0700 1 --2- 172.21.15.146:0/3462217938 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd8cc139270 0x7fd8cc11ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.572+0000 7fd8d21a0700 1 --2- 172.21.15.146:0/3462217938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8cc133a70 0x7fd8cc11a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.572+0000 7fd8d21a0700 1 --2- 172.21.15.146:0/3462217938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8cc136950 0x7fd8cc11a5c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.572+0000 7fd8d21a0700 1 -- 172.21.15.146:0/3462217938 >> 172.21.15.146:0/3462217938 conn(0x7fd8cc0a2980 msgr2=0x7fd8cc0a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.573+0000 7fd8d21a0700 1 -- 172.21.15.146:0/3462217938 shutdown_connections 2023-10-03T10:14:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.573+0000 7fd8d21a0700 1 -- 172.21.15.146:0/3462217938 wait complete. 2023-10-03T10:14:06.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.577+0000 7f1e0678f700 1 -- 172.21.15.146:0/2586044867 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1e00129b40 con 0x7f1e000a08e0 2023-10-03T10:14:06.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.578+0000 7f1dfcff9700 1 -- 172.21.15.146:0/2586044867 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1df001b410 con 0x7f1e000a08e0 2023-10-03T10:14:06.578 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:06.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.580+0000 7f1e0678f700 1 -- 172.21.15.146:0/2586044867 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e000a08e0 msgr2=0x7f1e00126240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.580+0000 7f1e0678f700 1 --2- 172.21.15.146:0/2586044867 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e000a08e0 0x7f1e00126240 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1df0013040 tx=0x7f1df0004750 comp rx=0 tx=0).stop 2023-10-03T10:14:06.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.581+0000 7f1e0678f700 1 -- 172.21.15.146:0/2586044867 shutdown_connections 2023-10-03T10:14:06.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.581+0000 7f1e0678f700 1 --2- 172.21.15.146:0/2586044867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e00138040 0x7f1e00126cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.581+0000 7f1e0678f700 1 --2- 172.21.15.146:0/2586044867 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e000a08e0 0x7f1e00126240 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.581+0000 7f1e0678f700 1 --2- 172.21.15.146:0/2586044867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e000a1400 0x7f1e00126780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.581+0000 7f1e0678f700 1 -- 172.21.15.146:0/2586044867 >> 172.21.15.146:0/2586044867 conn(0x7f1e000a2980 msgr2=0x7f1e0009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.581+0000 7f1e0678f700 1 -- 172.21.15.146:0/2586044867 shutdown_connections 2023-10-03T10:14:06.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.581+0000 7f1e0678f700 1 -- 172.21.15.146:0/2586044867 wait complete. 2023-10-03T10:14:06.586 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:06.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:06.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.610+0000 7f5e3ec54700 1 -- 172.21.15.146:0/1386424682 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5e381261e0 con 0x7f5e380a0a70 2023-10-03T10:14:06.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.610+0000 7f5e357fa700 1 -- 172.21.15.146:0/1386424682 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5e381261e0 con 0x7f5e380a0a70 2023-10-03T10:14:06.611 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:06.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.612+0000 7f5e3ec54700 1 -- 172.21.15.146:0/1386424682 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e380a0a70 msgr2=0x7f5e381229c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.612+0000 7f5e3ec54700 1 --2- 172.21.15.146:0/1386424682 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e380a0a70 0x7f5e381229c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00e810 tx=0x7f5e2c00ebd0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.612+0000 7f5e3ec54700 1 -- 172.21.15.146:0/1386424682 shutdown_connections 2023-10-03T10:14:06.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.612+0000 7f5e3ec54700 1 --2- 172.21.15.146:0/1386424682 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e38134120 0x7f5e38123440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.612+0000 7f5e3ec54700 1 --2- 172.21.15.146:0/1386424682 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e380a0a70 0x7f5e381229c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.612+0000 7f5e3ec54700 1 --2- 172.21.15.146:0/1386424682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e380a1380 0x7f5e38122f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.612+0000 7f5e3ec54700 1 -- 172.21.15.146:0/1386424682 >> 172.21.15.146:0/1386424682 conn(0x7f5e380a6610 msgr2=0x7f5e380a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.612+0000 7f5e3ec54700 1 -- 172.21.15.146:0/1386424682 shutdown_connections 2023-10-03T10:14:06.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.612+0000 7f5e3ec54700 1 -- 172.21.15.146:0/1386424682 wait complete. 2023-10-03T10:14:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.622+0000 7fd46ef45700 1 -- 172.21.15.146:0/3747139032 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd46806be20 con 0x7fd46809a130 2023-10-03T10:14:06.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.622+0000 7fd4657fa700 1 -- 172.21.15.146:0/3747139032 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd45c017070 con 0x7fd46809a130 2023-10-03T10:14:06.623 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:06.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:06.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.624+0000 7fd46ef45700 1 -- 172.21.15.146:0/3747139032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd46809a130 msgr2=0x7fd46811c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.624+0000 7fd46ef45700 1 --2- 172.21.15.146:0/3747139032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd46809a130 0x7fd46811c940 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd45c00c500 tx=0x7fd45c00c810 comp rx=0 tx=0).stop 2023-10-03T10:14:06.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.625+0000 7fd46ef45700 1 -- 172.21.15.146:0/3747139032 shutdown_connections 2023-10-03T10:14:06.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.625+0000 7fd46ef45700 1 --2- 172.21.15.146:0/3747139032 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd46809f3b0 0x7fd46811d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.625+0000 7fd46ef45700 1 --2- 172.21.15.146:0/3747139032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd46809a130 0x7fd46811c940 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.625+0000 7fd46ef45700 1 --2- 172.21.15.146:0/3747139032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd46809ef80 0x7fd46811ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.625+0000 7fd46ef45700 1 -- 172.21.15.146:0/3747139032 >> 172.21.15.146:0/3747139032 conn(0x7fd4680a4430 msgr2=0x7fd4680a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.625+0000 7fd46ef45700 1 -- 172.21.15.146:0/3747139032 shutdown_connections 2023-10-03T10:14:06.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:06.625+0000 7fd46ef45700 1 -- 172.21.15.146:0/3747139032 wait complete. 2023-10-03T10:14:06.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:07.588 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:07.599 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:07.626 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:07.638 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:07.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.742+0000 7f3a0e84b700 1 Processor -- start 2023-10-03T10:14:07.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.742+0000 7f3a0e84b700 1 -- start start 2023-10-03T10:14:07.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.743+0000 7f3a0e84b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a08131980 0x7f3a08131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.743+0000 7f3a0e84b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3a0809bc70 0x7f3a0809c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.743+0000 7f3a0e84b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a080a1640 con 0x7f3a0809c5c0 2023-10-03T10:14:07.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.743+0000 7f3a0e84b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0806eb30 con 0x7f3a0809bc70 2023-10-03T10:14:07.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.743+0000 7f3a0e84b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080a22d0 con 0x7f3a08131980 2023-10-03T10:14:07.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.744+0000 7f3a077fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3a0809bc70 0x7f3a0809c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.744+0000 7f3a07fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a08131980 0x7f3a08131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.744+0000 7f3a0cde8700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3a0809c5c0 0x7f3a08138700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39968/0 (socket says 172.21.15.146:39968) 2023-10-03T10:14:07.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.744+0000 7f3a0cde8700 1 -- 172.21.15.146:0/2785713384 learned_addr learned my addr 172.21.15.146:0/2785713384 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:07.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.744+0000 7f3a077fe700 1 --2- 172.21.15.146:0/2785713384 >> v2:172.21.15.146:3300/0 conn(0x7f3a0809bc70 0x7f3a0809c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49310/0 (socket says 172.21.15.146:49310) 2023-10-03T10:14:07.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.744+0000 7f3a077fe700 1 -- 172.21.15.146:0/2785713384 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a08131980 msgr2=0x7f3a08131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:07.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.744+0000 7f3a077fe700 1 --2- 172.21.15.146:0/2785713384 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a08131980 0x7f3a08131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.744+0000 7f3a077fe700 1 -- 172.21.15.146:0/2785713384 >> v1:172.21.15.146:6789/0 conn(0x7f3a0809c5c0 legacy=0x7f3a08138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.744+0000 7f3a077fe700 1 -- 172.21.15.146:0/2785713384 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a08131550 con 0x7f3a0809bc70 2023-10-03T10:14:07.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.744+0000 7f3a07fff700 1 --2- 172.21.15.146:0/2785713384 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a08131980 0x7f3a08131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:07.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.744+0000 7f3a077fe700 1 --2- 172.21.15.146:0/2785713384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a0809bc70 0x7f3a0809c080 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f39fc009840 tx=0x7f39fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0212fe5c557f57 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.744+0000 7f3a06ffd700 1 -- 172.21.15.146:0/2785713384 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc011830 con 0x7f3a0809bc70 2023-10-03T10:14:07.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.745+0000 7f3a06ffd700 1 -- 172.21.15.146:0/2785713384 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39fc011990 con 0x7f3a0809bc70 2023-10-03T10:14:07.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.745+0000 7f3a06ffd700 1 -- 172.21.15.146:0/2785713384 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc011d20 con 0x7f3a0809bc70 2023-10-03T10:14:07.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.745+0000 7f3a0e84b700 1 -- 172.21.15.146:0/2785713384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a0809bc70 msgr2=0x7f3a0809c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.745+0000 7f3a0e84b700 1 --2- 172.21.15.146:0/2785713384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a0809bc70 0x7f3a0809c080 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f39fc009840 tx=0x7f39fc009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:07.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.745+0000 7f3a0e84b700 1 -- 172.21.15.146:0/2785713384 shutdown_connections 2023-10-03T10:14:07.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.745+0000 7f3a0e84b700 1 --2- 172.21.15.146:0/2785713384 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a08131980 0x7f3a08131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.745+0000 7f3a0e84b700 1 --2- 172.21.15.146:0/2785713384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a0809bc70 0x7f3a0809c080 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.745+0000 7f3a0e84b700 1 -- 172.21.15.146:0/2785713384 >> 172.21.15.146:0/2785713384 conn(0x7f3a080a2980 msgr2=0x7f3a080a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.745+0000 7f3a0e84b700 1 -- 172.21.15.146:0/2785713384 shutdown_connections 2023-10-03T10:14:07.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.745+0000 7f3a0e84b700 1 -- 172.21.15.146:0/2785713384 wait complete. 2023-10-03T10:14:07.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.747+0000 7f3a0e84b700 1 Processor -- start 2023-10-03T10:14:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.747+0000 7f3a0e84b700 1 -- start start 2023-10-03T10:14:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.748+0000 7f3a0e84b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a0809bc70 0x7f3a08099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.748+0000 7f3a0e84b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a0809c5c0 0x7f3a08099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.748+0000 7f3a0e84b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a08131980 0x7f3a0809a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.748+0000 7f3a0e84b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a08124770 con 0x7f3a08131980 2023-10-03T10:14:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.748+0000 7f3a0e84b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a08130f80 con 0x7f3a0809c5c0 2023-10-03T10:14:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.748+0000 7f3a0e84b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080a1c40 con 0x7f3a0809bc70 2023-10-03T10:14:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.748+0000 7f3a07fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a0809bc70 0x7f3a08099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.748+0000 7f3a07fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a0809bc70 0x7f3a08099a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:52724/0 (socket says 172.21.15.146:52724) 2023-10-03T10:14:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.748+0000 7f3a07fff700 1 -- 172.21.15.146:0/1655922644 learned_addr learned my addr 172.21.15.146:0/1655922644 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.748+0000 7f3a0cde8700 1 --2- 172.21.15.146:0/1655922644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a08131980 0x7f3a0809a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.748+0000 7f3a07fff700 1 -- 172.21.15.146:0/1655922644 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a0809c5c0 msgr2=0x7f3a08099fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.748+0000 7f3a07fff700 1 --2- 172.21.15.146:0/1655922644 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a0809c5c0 0x7f3a08099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.748+0000 7f3a07fff700 1 -- 172.21.15.146:0/1655922644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a08131980 msgr2=0x7f3a0809a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.748+0000 7f3a07fff700 1 --2- 172.21.15.146:0/1655922644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a08131980 0x7f3a0809a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.748+0000 7f3a07fff700 1 -- 172.21.15.146:0/1655922644 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f8009430 con 0x7f3a0809bc70 2023-10-03T10:14:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.748+0000 7f3a07fff700 1 --2- 172.21.15.146:0/1655922644 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a0809bc70 0x7f3a08099a90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f39f800ebe0 tx=0x7f39f800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.749+0000 7f3a04ff9700 1 -- 172.21.15.146:0/1655922644 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f8005a20 con 0x7f3a0809bc70 2023-10-03T10:14:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.749+0000 7f3a04ff9700 1 -- 172.21.15.146:0/1655922644 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f8005b80 con 0x7f3a0809bc70 2023-10-03T10:14:07.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.749+0000 7f3a0e84b700 1 -- 172.21.15.146:0/1655922644 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39fc0094a0 con 0x7f3a0809bc70 2023-10-03T10:14:07.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.749+0000 7f3a04ff9700 1 -- 172.21.15.146:0/1655922644 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f800c910 con 0x7f3a0809bc70 2023-10-03T10:14:07.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.749+0000 7f3a0e84b700 1 -- 172.21.15.146:0/1655922644 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a081238c0 con 0x7f3a0809bc70 2023-10-03T10:14:07.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.750+0000 7f3a04ff9700 1 -- 172.21.15.146:0/1655922644 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f39f800ca70 con 0x7f3a0809bc70 2023-10-03T10:14:07.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.750+0000 7f3a04ff9700 1 -- 172.21.15.146:0/1655922644 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f39f803fa70 con 0x7f3a0809bc70 2023-10-03T10:14:07.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.750+0000 7f3a0e84b700 1 -- 172.21.15.146:0/1655922644 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a081234b0 con 0x7f3a0809bc70 2023-10-03T10:14:07.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.755+0000 7f3a04ff9700 1 -- 172.21.15.146:0/1655922644 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a081234b0 con 0x7f3a0809bc70 2023-10-03T10:14:07.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.771+0000 7f1e2879d700 1 Processor -- start 2023-10-03T10:14:07.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.771+0000 7f1e2879d700 1 -- start start 2023-10-03T10:14:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.772+0000 7f1e2879d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e2009e870 0x7f1e2009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.772+0000 7f1e2879d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1e2009f180 0x7f1e20131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.772+0000 7f1e2879d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e2009c970 con 0x7f1e20131d70 2023-10-03T10:14:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.772+0000 7f1e2879d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e200a0920 con 0x7f1e2009f180 2023-10-03T10:14:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.772+0000 7f1e2879d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2009f9c0 con 0x7f1e2009e870 2023-10-03T10:14:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.772+0000 7f1e26539700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e2009e870 0x7f1e2009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.772+0000 7f1e26539700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e2009e870 0x7f1e2009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56080/0 (socket says 172.21.15.146:56080) 2023-10-03T10:14:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.772+0000 7f1e26539700 1 -- 172.21.15.146:0/678611710 learned_addr learned my addr 172.21.15.146:0/678611710 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.772+0000 7f1e25d38700 1 --2- 172.21.15.146:0/678611710 >> v2:172.21.15.146:3300/0 conn(0x7f1e2009f180 0x7f1e20131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.773+0000 7f1e26539700 1 -- 172.21.15.146:0/678611710 >> v2:172.21.15.146:3300/0 conn(0x7f1e2009f180 msgr2=0x7f1e20131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.773+0000 7f1e26539700 1 --2- 172.21.15.146:0/678611710 >> v2:172.21.15.146:3300/0 conn(0x7f1e2009f180 0x7f1e20131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.773+0000 7f1e26539700 1 -- 172.21.15.146:0/678611710 >> v1:172.21.15.146:6789/0 conn(0x7f1e20131d70 legacy=0x7f1e20138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.773+0000 7f1e25537700 1 -- 172.21.15.146:0/678611710 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73392162 0 0) 0x7f1e2009c970 con 0x7f1e20131d70 2023-10-03T10:14:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.773+0000 7f1e26539700 1 -- 172.21.15.146:0/678611710 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2009bab0 con 0x7f1e2009e870 2023-10-03T10:14:07.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.773+0000 7f1e25d38700 1 --2- 172.21.15.146:0/678611710 >> v2:172.21.15.146:3300/0 conn(0x7f1e2009f180 0x7f1e20131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:07.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.773+0000 7f1e26539700 1 --2- 172.21.15.146:0/678611710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e2009e870 0x7f1e2009ec40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0098f0 tx=0x7f1e1c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6069fd0f1b237e7a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.773+0000 7f1e25537700 1 -- 172.21.15.146:0/678611710 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c011830 con 0x7f1e2009e870 2023-10-03T10:14:07.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.773+0000 7f1e25537700 1 -- 172.21.15.146:0/678611710 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c011990 con 0x7f1e2009e870 2023-10-03T10:14:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.773+0000 7f1e25537700 1 -- 172.21.15.146:0/678611710 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c011d20 con 0x7f1e2009e870 2023-10-03T10:14:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.774+0000 7f1e2879d700 1 -- 172.21.15.146:0/678611710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e2009e870 msgr2=0x7f1e2009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.774+0000 7f1e2879d700 1 --2- 172.21.15.146:0/678611710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e2009e870 0x7f1e2009ec40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0098f0 tx=0x7f1e1c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.774+0000 7f1e2879d700 1 -- 172.21.15.146:0/678611710 shutdown_connections 2023-10-03T10:14:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.774+0000 7f1e2879d700 1 --2- 172.21.15.146:0/678611710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e2009e870 0x7f1e2009ec40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.774+0000 7f1e2879d700 1 --2- 172.21.15.146:0/678611710 >> v2:172.21.15.146:3300/0 conn(0x7f1e2009f180 0x7f1e20131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.774+0000 7f1e2879d700 1 -- 172.21.15.146:0/678611710 >> 172.21.15.146:0/678611710 conn(0x7f1e200a4430 msgr2=0x7f1e200a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.774+0000 7f1e2879d700 1 -- 172.21.15.146:0/678611710 shutdown_connections 2023-10-03T10:14:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.774+0000 7f1e2879d700 1 -- 172.21.15.146:0/678611710 wait complete. 2023-10-03T10:14:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.775+0000 7f1e2879d700 1 Processor -- start 2023-10-03T10:14:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.775+0000 7f1e2879d700 1 -- start start 2023-10-03T10:14:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.776+0000 7f1e2879d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e2009e870 0x7f1e20130910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.776+0000 7f1e2879d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e2009f180 0x7f1e20130e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.776+0000 7f1e2879d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e20131d70 0x7f1e201c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.776+0000 7f1e2879d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2011efa0 con 0x7f1e2009f180 2023-10-03T10:14:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.776+0000 7f1e2879d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2011f630 con 0x7f1e2009e870 2023-10-03T10:14:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.776+0000 7f1e2879d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2011e6b0 con 0x7f1e20131d70 2023-10-03T10:14:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.776+0000 7f1e26539700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e2009e870 0x7f1e20130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.776+0000 7f1e25d38700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e2009f180 0x7f1e20130e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.776+0000 7f1e25d38700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e2009f180 0x7f1e20130e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49332/0 (socket says 172.21.15.146:49332) 2023-10-03T10:14:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.776+0000 7f1e26539700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e2009e870 0x7f1e20130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56086/0 (socket says 172.21.15.146:56086) 2023-10-03T10:14:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.776+0000 7f1e25d38700 1 -- 172.21.15.146:0/2055148869 learned_addr learned my addr 172.21.15.146:0/2055148869 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.776+0000 7f1e26539700 1 -- 172.21.15.146:0/2055148869 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e20131d70 msgr2=0x7f1e201c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.776+0000 7f1e26539700 1 --2- 172.21.15.146:0/2055148869 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e20131d70 0x7f1e201c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.776+0000 7f1e26539700 1 -- 172.21.15.146:0/2055148869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e2009f180 msgr2=0x7f1e20130e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.776+0000 7f1e26539700 1 --2- 172.21.15.146:0/2055148869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e2009f180 0x7f1e20130e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.776+0000 7f1e26539700 1 -- 172.21.15.146:0/2055148869 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e100094a0 con 0x7f1e2009e870 2023-10-03T10:14:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.776+0000 7f1e25d38700 1 --2- 172.21.15.146:0/2055148869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e2009f180 0x7f1e20130e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.776+0000 7f1e26539700 1 --2- 172.21.15.146:0/2055148869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e2009e870 0x7f1e20130910 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1e2009afc0 tx=0x7f1e1c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.777+0000 7f1e16ffd700 1 -- 172.21.15.146:0/2055148869 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c004590 con 0x7f1e2009e870 2023-10-03T10:14:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.777+0000 7f1e16ffd700 1 -- 172.21.15.146:0/2055148869 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c022070 con 0x7f1e2009e870 2023-10-03T10:14:07.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.777+0000 7f1e16ffd700 1 -- 172.21.15.146:0/2055148869 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c01ea50 con 0x7f1e2009e870 2023-10-03T10:14:07.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.777+0000 7f1e2879d700 1 -- 172.21.15.146:0/2055148869 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1c009550 con 0x7f1e2009e870 2023-10-03T10:14:07.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.777+0000 7f1e2879d700 1 -- 172.21.15.146:0/2055148869 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2009dba0 con 0x7f1e2009e870 2023-10-03T10:14:07.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.778+0000 7f1e2879d700 1 -- 172.21.15.146:0/2055148869 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2009ec40 con 0x7f1e2009e870 2023-10-03T10:14:07.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.778+0000 7f1e16ffd700 1 -- 172.21.15.146:0/2055148869 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e1c01ebb0 con 0x7f1e2009e870 2023-10-03T10:14:07.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.784+0000 7f1e16ffd700 1 -- 172.21.15.146:0/2055148869 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1e1c028df0 con 0x7f1e2009e870 2023-10-03T10:14:07.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.786+0000 7f1e16ffd700 1 -- 172.21.15.146:0/2055148869 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e1c04a060 con 0x7f1e2009e870 2023-10-03T10:14:07.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.788+0000 7f30818a8700 1 Processor -- start 2023-10-03T10:14:07.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.789+0000 7f30818a8700 1 -- start start 2023-10-03T10:14:07.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.789+0000 7f30818a8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f307c06a770 0x7f307c1349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.789+0000 7f30818a8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f307c09e070 0x7f307c13fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.789+0000 7f30818a8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f307c09eca0 con 0x7f307c134f00 2023-10-03T10:14:07.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.789+0000 7f30818a8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f307c09f720 con 0x7f307c09e070 2023-10-03T10:14:07.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.789+0000 7f30818a8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f307c06b480 con 0x7f307c06a770 2023-10-03T10:14:07.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.789+0000 7f307affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f307c06a770 0x7f307c1349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.789+0000 7f307affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f307c06a770 0x7f307c1349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:52756/0 (socket says 172.21.15.146:52756) 2023-10-03T10:14:07.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.789+0000 7f307affd700 1 -- 172.21.15.146:0/1624302835 learned_addr learned my addr 172.21.15.146:0/1624302835 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:07.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.789+0000 7f307b7fe700 1 --2- 172.21.15.146:0/1624302835 >> v2:172.21.15.146:3300/0 conn(0x7f307c09e070 0x7f307c13fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.790+0000 7f307affd700 1 -- 172.21.15.146:0/1624302835 >> v2:172.21.15.146:3300/0 conn(0x7f307c09e070 msgr2=0x7f307c13fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:07.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.790+0000 7f307affd700 1 --2- 172.21.15.146:0/1624302835 >> v2:172.21.15.146:3300/0 conn(0x7f307c09e070 0x7f307c13fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.790+0000 7f307affd700 1 -- 172.21.15.146:0/1624302835 >> v1:172.21.15.146:6789/0 conn(0x7f307c134f00 legacy=0x7f307c09d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.790+0000 7f307affd700 1 -- 172.21.15.146:0/1624302835 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307c1352d0 con 0x7f307c06a770 2023-10-03T10:14:07.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.790+0000 7f307affd700 1 --2- 172.21.15.146:0/1624302835 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f307c06a770 0x7f307c1349c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f306c0098f0 tx=0x7f306c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5c072fec47d2675 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.790+0000 7f3079ffb700 1 -- 172.21.15.146:0/1624302835 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c011830 con 0x7f307c06a770 2023-10-03T10:14:07.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.790+0000 7f3079ffb700 1 -- 172.21.15.146:0/1624302835 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306c011990 con 0x7f307c06a770 2023-10-03T10:14:07.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.790+0000 7f3079ffb700 1 -- 172.21.15.146:0/1624302835 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c011d20 con 0x7f307c06a770 2023-10-03T10:14:07.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.791+0000 7f30818a8700 1 -- 172.21.15.146:0/1624302835 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f307c06a770 msgr2=0x7f307c1349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.791+0000 7f30818a8700 1 --2- 172.21.15.146:0/1624302835 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f307c06a770 0x7f307c1349c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f306c0098f0 tx=0x7f306c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:07.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.791+0000 7f30818a8700 1 -- 172.21.15.146:0/1624302835 shutdown_connections 2023-10-03T10:14:07.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.791+0000 7f30818a8700 1 --2- 172.21.15.146:0/1624302835 >> v2:172.21.15.146:3300/0 conn(0x7f307c09e070 0x7f307c13fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.791+0000 7f30818a8700 1 --2- 172.21.15.146:0/1624302835 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f307c06a770 0x7f307c1349c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.791+0000 7f30818a8700 1 -- 172.21.15.146:0/1624302835 >> 172.21.15.146:0/1624302835 conn(0x7f307c099c40 msgr2=0x7f307c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.791+0000 7f30818a8700 1 -- 172.21.15.146:0/1624302835 shutdown_connections 2023-10-03T10:14:07.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.791+0000 7f30818a8700 1 -- 172.21.15.146:0/1624302835 wait complete. 2023-10-03T10:14:07.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.792+0000 7f30818a8700 1 Processor -- start 2023-10-03T10:14:07.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.792+0000 7f30818a8700 1 -- start start 2023-10-03T10:14:07.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.792+0000 7f30818a8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f307c06a770 0x7f307c11a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.792+0000 7f30818a8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f307c09e070 0x7f307c11adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.792+0000 7f30818a8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f307c134f00 0x7f307c11b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.793+0000 7f30818a8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307c09f220 con 0x7f307c134f00 2023-10-03T10:14:07.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.793+0000 7f30818a8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307c134120 con 0x7f307c06a770 2023-10-03T10:14:07.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.793+0000 7f30818a8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f307c11c800 con 0x7f307c09e070 2023-10-03T10:14:07.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.793+0000 7f307affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f307c06a770 0x7f307c11a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.793+0000 7f307b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f307c134f00 0x7f307c11b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.793+0000 7f307affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f307c06a770 0x7f307c11a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56088/0 (socket says 172.21.15.146:56088) 2023-10-03T10:14:07.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.793+0000 7f307affd700 1 -- 172.21.15.146:0/1488729387 learned_addr learned my addr 172.21.15.146:0/1488729387 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:07.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.793+0000 7f307a7fc700 1 --2- 172.21.15.146:0/1488729387 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f307c09e070 0x7f307c11adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.793+0000 7f307affd700 1 -- 172.21.15.146:0/1488729387 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f307c09e070 msgr2=0x7f307c11adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.793+0000 7f307affd700 1 --2- 172.21.15.146:0/1488729387 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f307c09e070 0x7f307c11adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.793+0000 7f307affd700 1 -- 172.21.15.146:0/1488729387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f307c134f00 msgr2=0x7f307c11b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.793+0000 7f307affd700 1 --2- 172.21.15.146:0/1488729387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f307c134f00 0x7f307c11b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.793+0000 7f307affd700 1 -- 172.21.15.146:0/1488729387 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c009550 con 0x7f307c06a770 2023-10-03T10:14:07.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.793+0000 7f307affd700 1 --2- 172.21.15.146:0/1488729387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f307c06a770 0x7f307c11a8b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f306c009c40 tx=0x7f306c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.794+0000 7f3063fff700 1 -- 172.21.15.146:0/1488729387 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c004510 con 0x7f307c06a770 2023-10-03T10:14:07.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.794+0000 7f3063fff700 1 -- 172.21.15.146:0/1488729387 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306c01e070 con 0x7f307c06a770 2023-10-03T10:14:07.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.794+0000 7f3063fff700 1 -- 172.21.15.146:0/1488729387 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c0038e0 con 0x7f307c06a770 2023-10-03T10:14:07.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.794+0000 7f30818a8700 1 -- 172.21.15.146:0/1488729387 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f307c09da40 con 0x7f307c06a770 2023-10-03T10:14:07.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.794+0000 7f30818a8700 1 -- 172.21.15.146:0/1488729387 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f307c11c2e0 con 0x7f307c06a770 2023-10-03T10:14:07.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.795+0000 7f3063fff700 1 -- 172.21.15.146:0/1488729387 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f306c003a40 con 0x7f307c06a770 2023-10-03T10:14:07.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.796+0000 7f3063fff700 1 -- 172.21.15.146:0/1488729387 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f306c020070 con 0x7f307c06a770 2023-10-03T10:14:07.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.796+0000 7f30818a8700 1 -- 172.21.15.146:0/1488729387 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f307c1268d0 con 0x7f307c06a770 2023-10-03T10:14:07.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.805+0000 7f3063fff700 1 -- 172.21.15.146:0/1488729387 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f306c015080 con 0x7f307c06a770 2023-10-03T10:14:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.820+0000 7f34a150a700 1 Processor -- start 2023-10-03T10:14:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.820+0000 7f34a150a700 1 -- start start 2023-10-03T10:14:07.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.820+0000 7f34a150a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f349c06a770 0x7f349c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.821+0000 7f34a150a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f349c136cb0 0x7f349c139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.821+0000 7f34a150a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f349c06e900 con 0x7f349c09dec0 2023-10-03T10:14:07.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.821+0000 7f34a150a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349c09d180 con 0x7f349c136cb0 2023-10-03T10:14:07.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.821+0000 7f34a150a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f349c09e780 con 0x7f349c06a770 2023-10-03T10:14:07.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.821+0000 7f349b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f349c136cb0 0x7f349c139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.821+0000 7f349b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f349c136cb0 0x7f349c139090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56094/0 (socket says 172.21.15.146:56094) 2023-10-03T10:14:07.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.821+0000 7f349b7fe700 1 -- 172.21.15.146:0/3646832028 learned_addr learned my addr 172.21.15.146:0/3646832028 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:07.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.821+0000 7f349affd700 1 --2- 172.21.15.146:0/3646832028 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f349c06a770 0x7f349c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.821+0000 7f349b7fe700 1 -- 172.21.15.146:0/3646832028 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f349c06a770 msgr2=0x7f349c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:07.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.821+0000 7f349b7fe700 1 --2- 172.21.15.146:0/3646832028 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f349c06a770 0x7f349c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.821+0000 7f349b7fe700 1 -- 172.21.15.146:0/3646832028 >> v1:172.21.15.146:6789/0 conn(0x7f349c09dec0 legacy=0x7f349c06b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.821+0000 7f349b7fe700 1 -- 172.21.15.146:0/3646832028 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c09d3c0 con 0x7f349c136cb0 2023-10-03T10:14:07.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.821+0000 7f349b7fe700 1 --2- 172.21.15.146:0/3646832028 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f349c136cb0 0x7f349c139090 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3494009e80 tx=0x7f349400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=102fcba6a30763e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.822+0000 7f3499ffb700 1 -- 172.21.15.146:0/3646832028 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400e070 con 0x7f349c136cb0 2023-10-03T10:14:07.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.822+0000 7f3499ffb700 1 -- 172.21.15.146:0/3646832028 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349400b910 con 0x7f349c136cb0 2023-10-03T10:14:07.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.822+0000 7f3499ffb700 1 -- 172.21.15.146:0/3646832028 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400bca0 con 0x7f349c136cb0 2023-10-03T10:14:07.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.822+0000 7f34a150a700 1 -- 172.21.15.146:0/3646832028 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f349c136cb0 msgr2=0x7f349c139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.822+0000 7f34a150a700 1 --2- 172.21.15.146:0/3646832028 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f349c136cb0 0x7f349c139090 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3494009e80 tx=0x7f349400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:07.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.822+0000 7f34a150a700 1 -- 172.21.15.146:0/3646832028 shutdown_connections 2023-10-03T10:14:07.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.822+0000 7f34a150a700 1 --2- 172.21.15.146:0/3646832028 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f349c136cb0 0x7f349c139090 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.822+0000 7f34a150a700 1 --2- 172.21.15.146:0/3646832028 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f349c06a770 0x7f349c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.822+0000 7f34a150a700 1 -- 172.21.15.146:0/3646832028 >> 172.21.15.146:0/3646832028 conn(0x7f349c099c40 msgr2=0x7f349c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.822+0000 7f34a150a700 1 -- 172.21.15.146:0/3646832028 shutdown_connections 2023-10-03T10:14:07.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.822+0000 7f34a150a700 1 -- 172.21.15.146:0/3646832028 wait complete. 2023-10-03T10:14:07.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.823+0000 7f34a150a700 1 Processor -- start 2023-10-03T10:14:07.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.823+0000 7f34a150a700 1 -- start start 2023-10-03T10:14:07.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.824+0000 7f34a150a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f349c06a770 0x7f349c131920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.824+0000 7f34a150a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f349c09dec0 0x7f349c131e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.824+0000 7f34a150a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f349c136cb0 0x7f349c1323a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.824+0000 7f34a150a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c136550 con 0x7f349c06a770 2023-10-03T10:14:07.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.824+0000 7f34a150a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349c0a2ae0 con 0x7f349c09dec0 2023-10-03T10:14:07.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.824+0000 7f34a150a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f349c071ce0 con 0x7f349c136cb0 2023-10-03T10:14:07.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.824+0000 7f349a7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f349c09dec0 0x7f349c131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.824+0000 7f349a7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f349c09dec0 0x7f349c131e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56108/0 (socket says 172.21.15.146:56108) 2023-10-03T10:14:07.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.824+0000 7f349b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f349c136cb0 0x7f349c1323a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.824+0000 7f349a7fc700 1 -- 172.21.15.146:0/946702218 learned_addr learned my addr 172.21.15.146:0/946702218 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:07.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.824+0000 7f349affd700 1 --2- 172.21.15.146:0/946702218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f349c06a770 0x7f349c131920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.824+0000 7f349a7fc700 1 -- 172.21.15.146:0/946702218 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f349c136cb0 msgr2=0x7f349c1323a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.824+0000 7f349a7fc700 1 --2- 172.21.15.146:0/946702218 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f349c136cb0 0x7f349c1323a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.824+0000 7f349a7fc700 1 -- 172.21.15.146:0/946702218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f349c06a770 msgr2=0x7f349c131920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.824+0000 7f349a7fc700 1 --2- 172.21.15.146:0/946702218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f349c06a770 0x7f349c131920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.824+0000 7f349a7fc700 1 -- 172.21.15.146:0/946702218 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3494009b30 con 0x7f349c09dec0 2023-10-03T10:14:07.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.824+0000 7f349a7fc700 1 --2- 172.21.15.146:0/946702218 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f349c09dec0 0x7f349c131e60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f349000c510 tx=0x7f349000c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.825+0000 7f34837fe700 1 -- 172.21.15.146:0/946702218 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34900052d0 con 0x7f349c09dec0 2023-10-03T10:14:07.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.825+0000 7f34837fe700 1 -- 172.21.15.146:0/946702218 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3490005430 con 0x7f349c09dec0 2023-10-03T10:14:07.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.825+0000 7f34837fe700 1 -- 172.21.15.146:0/946702218 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34900038c0 con 0x7f349c09dec0 2023-10-03T10:14:07.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.825+0000 7f34a150a700 1 -- 172.21.15.146:0/946702218 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349c134f00 con 0x7f349c09dec0 2023-10-03T10:14:07.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.825+0000 7f34a150a700 1 -- 172.21.15.146:0/946702218 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349c133a50 con 0x7f349c09dec0 2023-10-03T10:14:07.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.826+0000 7f34a150a700 1 -- 172.21.15.146:0/946702218 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349c04f2a0 con 0x7f349c09dec0 2023-10-03T10:14:07.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.826+0000 7f34837fe700 1 -- 172.21.15.146:0/946702218 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3490003a20 con 0x7f349c09dec0 2023-10-03T10:14:07.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.826+0000 7f34837fe700 1 -- 172.21.15.146:0/946702218 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f349003eb10 con 0x7f349c09dec0 2023-10-03T10:14:07.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.835+0000 7f34837fe700 1 -- 172.21.15.146:0/946702218 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3490019e60 con 0x7f349c09dec0 2023-10-03T10:14:07.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.992+0000 7f1e2879d700 1 -- 172.21.15.146:0/2055148869 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1e2004f2a0 con 0x7f1e2009e870 2023-10-03T10:14:07.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.992+0000 7f1e16ffd700 1 -- 172.21.15.146:0/2055148869 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1e1c015070 con 0x7f1e2009e870 2023-10-03T10:14:07.993 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:07.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.993+0000 7f3a0e84b700 1 -- 172.21.15.146:0/1655922644 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3a0804f2a0 con 0x7f3a0809bc70 2023-10-03T10:14:07.994 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:07.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.993+0000 7f3a04ff9700 1 -- 172.21.15.146:0/1655922644 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f39f8020080 con 0x7f3a0809bc70 2023-10-03T10:14:07.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.995+0000 7f1e2879d700 1 -- 172.21.15.146:0/2055148869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e2009e870 msgr2=0x7f1e20130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.995+0000 7f1e2879d700 1 --2- 172.21.15.146:0/2055148869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e2009e870 0x7f1e20130910 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1e2009afc0 tx=0x7f1e1c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:07.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.995+0000 7f1e2879d700 1 -- 172.21.15.146:0/2055148869 shutdown_connections 2023-10-03T10:14:07.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.995+0000 7f1e2879d700 1 --2- 172.21.15.146:0/2055148869 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e20131d70 0x7f1e201c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.995+0000 7f1e2879d700 1 --2- 172.21.15.146:0/2055148869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e2009e870 0x7f1e20130910 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.995+0000 7f1e2879d700 1 --2- 172.21.15.146:0/2055148869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e2009f180 0x7f1e20130e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.995+0000 7f1e2879d700 1 -- 172.21.15.146:0/2055148869 >> 172.21.15.146:0/2055148869 conn(0x7f1e200a4430 msgr2=0x7f1e201b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.995+0000 7f1e2879d700 1 -- 172.21.15.146:0/2055148869 shutdown_connections 2023-10-03T10:14:07.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.995+0000 7f1e2879d700 1 -- 172.21.15.146:0/2055148869 wait complete. 2023-10-03T10:14:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.995+0000 7f3a0e84b700 1 -- 172.21.15.146:0/1655922644 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a0809bc70 msgr2=0x7f3a08099a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.995+0000 7f3a0e84b700 1 --2- 172.21.15.146:0/1655922644 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a0809bc70 0x7f3a08099a90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f39f800ebe0 tx=0x7f39f800eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.995+0000 7f3a0e84b700 1 -- 172.21.15.146:0/1655922644 shutdown_connections 2023-10-03T10:14:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.995+0000 7f3a0e84b700 1 --2- 172.21.15.146:0/1655922644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a08131980 0x7f3a0809a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.995+0000 7f3a0e84b700 1 --2- 172.21.15.146:0/1655922644 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a0809bc70 0x7f3a08099a90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.995+0000 7f3a0e84b700 1 --2- 172.21.15.146:0/1655922644 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a0809c5c0 0x7f3a08099fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.995+0000 7f3a0e84b700 1 -- 172.21.15.146:0/1655922644 >> 172.21.15.146:0/1655922644 conn(0x7f3a080a2980 msgr2=0x7f3a0806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.995+0000 7f3a0e84b700 1 -- 172.21.15.146:0/1655922644 shutdown_connections 2023-10-03T10:14:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:07.996+0000 7f3a0e84b700 1 -- 172.21.15.146:0/1655922644 wait complete. 2023-10-03T10:14:08.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:08.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:08.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:08.029+0000 7f30818a8700 1 -- 172.21.15.146:0/1488729387 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f307c04f2a0 con 0x7f307c06a770 2023-10-03T10:14:08.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:08.029+0000 7f3063fff700 1 -- 172.21.15.146:0/1488729387 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f306c045060 con 0x7f307c06a770 2023-10-03T10:14:08.030 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:08.032+0000 7f30818a8700 1 -- 172.21.15.146:0/1488729387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f307c06a770 msgr2=0x7f307c11a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:08.032+0000 7f30818a8700 1 --2- 172.21.15.146:0/1488729387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f307c06a770 0x7f307c11a8b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f306c009c40 tx=0x7f306c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:08.032+0000 7f30818a8700 1 -- 172.21.15.146:0/1488729387 shutdown_connections 2023-10-03T10:14:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:08.032+0000 7f30818a8700 1 --2- 172.21.15.146:0/1488729387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f307c134f00 0x7f307c11b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:08.032+0000 7f30818a8700 1 --2- 172.21.15.146:0/1488729387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f307c06a770 0x7f307c11a8b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:08.032+0000 7f30818a8700 1 --2- 172.21.15.146:0/1488729387 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f307c09e070 0x7f307c11adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:08.032+0000 7f30818a8700 1 -- 172.21.15.146:0/1488729387 >> 172.21.15.146:0/1488729387 conn(0x7f307c099c40 msgr2=0x7f307c137860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:08.032+0000 7f30818a8700 1 -- 172.21.15.146:0/1488729387 shutdown_connections 2023-10-03T10:14:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:08.032+0000 7f30818a8700 1 -- 172.21.15.146:0/1488729387 wait complete. 2023-10-03T10:14:08.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:08.038+0000 7f34a150a700 1 -- 172.21.15.146:0/946702218 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f349c09e3a0 con 0x7f349c09dec0 2023-10-03T10:14:08.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:08.038+0000 7f34837fe700 1 -- 172.21.15.146:0/946702218 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3490017030 con 0x7f349c09dec0 2023-10-03T10:14:08.039 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:08.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:08.040+0000 7f34a150a700 1 -- 172.21.15.146:0/946702218 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f349c09dec0 msgr2=0x7f349c131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:08.040+0000 7f34a150a700 1 --2- 172.21.15.146:0/946702218 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f349c09dec0 0x7f349c131e60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f349000c510 tx=0x7f349000c820 comp rx=0 tx=0).stop 2023-10-03T10:14:08.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:08.040+0000 7f34a150a700 1 -- 172.21.15.146:0/946702218 shutdown_connections 2023-10-03T10:14:08.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:08.040+0000 7f34a150a700 1 --2- 172.21.15.146:0/946702218 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f349c136cb0 0x7f349c1323a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:08.040+0000 7f34a150a700 1 --2- 172.21.15.146:0/946702218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f349c06a770 0x7f349c131920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:08.040+0000 7f34a150a700 1 --2- 172.21.15.146:0/946702218 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f349c09dec0 0x7f349c131e60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:08.040+0000 7f34a150a700 1 -- 172.21.15.146:0/946702218 >> 172.21.15.146:0/946702218 conn(0x7f349c099c40 msgr2=0x7f349c12f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:08.040+0000 7f34a150a700 1 -- 172.21.15.146:0/946702218 shutdown_connections 2023-10-03T10:14:08.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:08.041+0000 7f34a150a700 1 -- 172.21.15.146:0/946702218 wait complete. 2023-10-03T10:14:08.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:08.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:09.009 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:09.015 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:09.046 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:09.054 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:09.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.152+0000 7fd49c430700 1 Processor -- start 2023-10-03T10:14:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.153+0000 7fd49c430700 1 -- start start 2023-10-03T10:14:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.153+0000 7fd49c430700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd49409e340 0x7fd4941359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.153+0000 7fd49c430700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd494135f20 0x7fd494138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.154+0000 7fd49c430700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49409aaa0 con 0x7fd49409d860 2023-10-03T10:14:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.154+0000 7fd49c430700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd49409e730 con 0x7fd494135f20 2023-10-03T10:14:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.154+0000 7fd49c430700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd49409f870 con 0x7fd49409e340 2023-10-03T10:14:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.154+0000 7fd4999cb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd49409e340 0x7fd4941359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.154+0000 7fd4999cb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd49409e340 0x7fd4941359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:52790/0 (socket says 172.21.15.146:52790) 2023-10-03T10:14:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.154+0000 7fd4999cb700 1 -- 172.21.15.146:0/2093002340 learned_addr learned my addr 172.21.15.146:0/2093002340 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.154+0000 7fd49a9cd700 1 --2- 172.21.15.146:0/2093002340 >> v2:172.21.15.146:3300/0 conn(0x7fd494135f20 0x7fd494138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.154+0000 7fd4999cb700 1 -- 172.21.15.146:0/2093002340 >> v2:172.21.15.146:3300/0 conn(0x7fd494135f20 msgr2=0x7fd494138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.154+0000 7fd4999cb700 1 --2- 172.21.15.146:0/2093002340 >> v2:172.21.15.146:3300/0 conn(0x7fd494135f20 0x7fd494138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.154+0000 7fd4999cb700 1 -- 172.21.15.146:0/2093002340 >> v1:172.21.15.146:6789/0 conn(0x7fd49409d860 legacy=0x7fd49409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.154+0000 7fd4999cb700 1 -- 172.21.15.146:0/2093002340 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49409b360 con 0x7fd49409e340 2023-10-03T10:14:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.154+0000 7fd49a9cd700 1 --2- 172.21.15.146:0/2093002340 >> v2:172.21.15.146:3300/0 conn(0x7fd494135f20 0x7fd494138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.154+0000 7fd4999cb700 1 --2- 172.21.15.146:0/2093002340 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd49409e340 0x7fd4941359e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd4840098f0 tx=0x7fd484009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=733189e925e5d6c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.154+0000 7fd4991ca700 1 -- 172.21.15.146:0/2093002340 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd484011830 con 0x7fd49409e340 2023-10-03T10:14:09.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.155+0000 7fd4991ca700 1 -- 172.21.15.146:0/2093002340 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd484011990 con 0x7fd49409e340 2023-10-03T10:14:09.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.155+0000 7fd4991ca700 1 -- 172.21.15.146:0/2093002340 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd484011d20 con 0x7fd49409e340 2023-10-03T10:14:09.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.155+0000 7fd49c430700 1 -- 172.21.15.146:0/2093002340 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd49409e340 msgr2=0x7fd4941359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.155+0000 7fd49c430700 1 --2- 172.21.15.146:0/2093002340 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd49409e340 0x7fd4941359e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd4840098f0 tx=0x7fd484009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:09.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.156+0000 7fd49c430700 1 -- 172.21.15.146:0/2093002340 shutdown_connections 2023-10-03T10:14:09.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.156+0000 7fd49c430700 1 --2- 172.21.15.146:0/2093002340 >> v2:172.21.15.146:3300/0 conn(0x7fd494135f20 0x7fd494138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.156+0000 7fd49c430700 1 --2- 172.21.15.146:0/2093002340 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd49409e340 0x7fd4941359e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.156+0000 7fd49c430700 1 -- 172.21.15.146:0/2093002340 >> 172.21.15.146:0/2093002340 conn(0x7fd494099c40 msgr2=0x7fd4940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.156+0000 7fd49c430700 1 -- 172.21.15.146:0/2093002340 shutdown_connections 2023-10-03T10:14:09.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.156+0000 7fd49c430700 1 -- 172.21.15.146:0/2093002340 wait complete. 2023-10-03T10:14:09.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.157+0000 7fd49c430700 1 Processor -- start 2023-10-03T10:14:09.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.157+0000 7fd49c430700 1 -- start start 2023-10-03T10:14:09.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.157+0000 7fd49c430700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd49409d860 0x7fd49411b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.157+0000 7fd49c430700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd49409e340 0x7fd49411b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.157+0000 7fd49c430700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd494135f20 0x7fd49411bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.157+0000 7fd49c430700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49411d660 con 0x7fd494135f20 2023-10-03T10:14:09.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.157+0000 7fd49c430700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49411ef70 con 0x7fd49409e340 2023-10-03T10:14:09.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.157+0000 7fd49c430700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940a2160 con 0x7fd49409d860 2023-10-03T10:14:09.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.157+0000 7fd4999cb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd49409e340 0x7fd49411b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.157+0000 7fd49a9cd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd494135f20 0x7fd49411bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.157+0000 7fd49a1cc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd49409d860 0x7fd49411b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.157+0000 7fd4999cb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd49409e340 0x7fd49411b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56116/0 (socket says 172.21.15.146:56116) 2023-10-03T10:14:09.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.157+0000 7fd4999cb700 1 -- 172.21.15.146:0/293300423 learned_addr learned my addr 172.21.15.146:0/293300423 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:09.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.158+0000 7fd49a9cd700 1 -- 172.21.15.146:0/293300423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd49409d860 msgr2=0x7fd49411b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.158+0000 7fd49a9cd700 1 --2- 172.21.15.146:0/293300423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd49409d860 0x7fd49411b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.158+0000 7fd49a9cd700 1 -- 172.21.15.146:0/293300423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd49409e340 msgr2=0x7fd49411b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.158+0000 7fd49a9cd700 1 --2- 172.21.15.146:0/293300423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd49409e340 0x7fd49411b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.158+0000 7fd49a9cd700 1 -- 172.21.15.146:0/293300423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c009a70 con 0x7fd494135f20 2023-10-03T10:14:09.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.158+0000 7fd49a1cc700 1 --2- 172.21.15.146:0/293300423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd49409d860 0x7fd49411b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:09.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.158+0000 7fd49a9cd700 1 --2- 172.21.15.146:0/293300423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd494135f20 0x7fd49411bed0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd48c00b360 tx=0x7fd48c00b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.158+0000 7fd48affd700 1 -- 172.21.15.146:0/293300423 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c015070 con 0x7fd494135f20 2023-10-03T10:14:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.158+0000 7fd48affd700 1 -- 172.21.15.146:0/293300423 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c00bda0 con 0x7fd494135f20 2023-10-03T10:14:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.158+0000 7fd48affd700 1 -- 172.21.15.146:0/293300423 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c003c60 con 0x7fd494135f20 2023-10-03T10:14:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.159+0000 7fd49c430700 1 -- 172.21.15.146:0/293300423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd484009550 con 0x7fd494135f20 2023-10-03T10:14:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.159+0000 7fd49c430700 1 -- 172.21.15.146:0/293300423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd49411e9d0 con 0x7fd494135f20 2023-10-03T10:14:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.160+0000 7fd49c430700 1 -- 172.21.15.146:0/293300423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd49404f2a0 con 0x7fd494135f20 2023-10-03T10:14:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.160+0000 7fd48affd700 1 -- 172.21.15.146:0/293300423 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd48c019410 con 0x7fd494135f20 2023-10-03T10:14:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.161+0000 7fd48affd700 1 -- 172.21.15.146:0/293300423 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd48c043ca0 con 0x7fd494135f20 2023-10-03T10:14:09.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.169+0000 7fd48affd700 1 -- 172.21.15.146:0/293300423 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd48c020900 con 0x7fd494135f20 2023-10-03T10:14:09.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.193+0000 7f79a54cf700 1 Processor -- start 2023-10-03T10:14:09.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.193+0000 7f79a54cf700 1 -- start start 2023-10-03T10:14:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.194+0000 7f79a54cf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79a00a0a30 0x7f79a00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.194+0000 7f79a54cf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f79a0130670 0x7f79a01381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.194+0000 7f79a54cf700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a00a1e70 con 0x7f79a00a1340 2023-10-03T10:14:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.194+0000 7f79a54cf700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a009a720 con 0x7f79a0130670 2023-10-03T10:14:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.194+0000 7f79a54cf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79a009b300 con 0x7f79a00a0a30 2023-10-03T10:14:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.194+0000 7f799effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79a00a0a30 0x7f79a00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.194+0000 7f799effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79a00a0a30 0x7f79a00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:52806/0 (socket says 172.21.15.146:52806) 2023-10-03T10:14:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.194+0000 7f799effd700 1 -- 172.21.15.146:0/2869645798 learned_addr learned my addr 172.21.15.146:0/2869645798 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.194+0000 7f799f7fe700 1 --2- 172.21.15.146:0/2869645798 >> v2:172.21.15.146:3300/0 conn(0x7f79a0130670 0x7f79a01381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.194+0000 7f799effd700 1 -- 172.21.15.146:0/2869645798 >> v2:172.21.15.146:3300/0 conn(0x7f79a0130670 msgr2=0x7f79a01381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:09.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.195+0000 7f799effd700 1 --2- 172.21.15.146:0/2869645798 >> v2:172.21.15.146:3300/0 conn(0x7f79a0130670 0x7f79a01381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.195+0000 7f799effd700 1 -- 172.21.15.146:0/2869645798 >> v1:172.21.15.146:6789/0 conn(0x7f79a00a1340 legacy=0x7f79a012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.195+0000 7f799effd700 1 -- 172.21.15.146:0/2869645798 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a009abc0 con 0x7f79a00a0a30 2023-10-03T10:14:09.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.195+0000 7f799f7fe700 1 --2- 172.21.15.146:0/2869645798 >> v2:172.21.15.146:3300/0 conn(0x7f79a0130670 0x7f79a01381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:09.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.195+0000 7f799effd700 1 --2- 172.21.15.146:0/2869645798 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79a00a0a30 0x7f79a00a0e00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7990006fd0 tx=0x7f799000be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=243b46face755c5f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.195+0000 7f799dffb700 1 -- 172.21.15.146:0/2869645798 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990005c20 con 0x7f79a00a0a30 2023-10-03T10:14:09.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.195+0000 7f799dffb700 1 -- 172.21.15.146:0/2869645798 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7990005d80 con 0x7f79a00a0a30 2023-10-03T10:14:09.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.195+0000 7f799dffb700 1 -- 172.21.15.146:0/2869645798 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799000dc40 con 0x7f79a00a0a30 2023-10-03T10:14:09.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.196+0000 7f79a54cf700 1 -- 172.21.15.146:0/2869645798 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79a00a0a30 msgr2=0x7f79a00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.196+0000 7f79a54cf700 1 --2- 172.21.15.146:0/2869645798 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79a00a0a30 0x7f79a00a0e00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7990006fd0 tx=0x7f799000be70 comp rx=0 tx=0).stop 2023-10-03T10:14:09.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.196+0000 7f79a54cf700 1 -- 172.21.15.146:0/2869645798 shutdown_connections 2023-10-03T10:14:09.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.196+0000 7f79a54cf700 1 --2- 172.21.15.146:0/2869645798 >> v2:172.21.15.146:3300/0 conn(0x7f79a0130670 0x7f79a01381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.196+0000 7f79a54cf700 1 --2- 172.21.15.146:0/2869645798 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79a00a0a30 0x7f79a00a0e00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.196+0000 7f79a54cf700 1 -- 172.21.15.146:0/2869645798 >> 172.21.15.146:0/2869645798 conn(0x7f79a00a2980 msgr2=0x7f79a00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.196+0000 7f79a54cf700 1 -- 172.21.15.146:0/2869645798 shutdown_connections 2023-10-03T10:14:09.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.196+0000 7f79a54cf700 1 -- 172.21.15.146:0/2869645798 wait complete. 2023-10-03T10:14:09.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.197+0000 7f79a54cf700 1 Processor -- start 2023-10-03T10:14:09.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.198+0000 7f79a54cf700 1 -- start start 2023-10-03T10:14:09.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.198+0000 7f98fd394700 1 Processor -- start 2023-10-03T10:14:09.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.198+0000 7f79a54cf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79a00a0a30 0x7f79a0120d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.198+0000 7f79a54cf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79a00a1340 0x7f79a0121290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.198+0000 7f79a54cf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79a0130670 0x7f79a01217d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.198+0000 7f79a54cf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a01245f0 con 0x7f79a0130670 2023-10-03T10:14:09.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.198+0000 7f79a54cf700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a0122910 con 0x7f79a00a1340 2023-10-03T10:14:09.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.198+0000 7f79a54cf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79a01247f0 con 0x7f79a00a0a30 2023-10-03T10:14:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.198+0000 7f98fd394700 1 -- start start 2023-10-03T10:14:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.198+0000 7f98fd394700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f98f80a0a30 0x7f98f80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.198+0000 7f98fd394700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f98f80a1340 0x7f98f812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.198+0000 7f98fd394700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f81304a0 0x7f98f81308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.198+0000 7f98fd394700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f8130e30 con 0x7f98f80a0a30 2023-10-03T10:14:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.198+0000 7f98fd394700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f80a1e70 con 0x7f98f81304a0 2023-10-03T10:14:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.198+0000 7f98fd394700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98f809a720 con 0x7f98f80a1340 2023-10-03T10:14:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.199+0000 7f98f67fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f98f80a1340 0x7f98f812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.199+0000 7f98f67fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f98f80a1340 0x7f98f812ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:52820/0 (socket says 172.21.15.146:52820) 2023-10-03T10:14:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.199+0000 7f98f67fc700 1 -- 172.21.15.146:0/2609968341 learned_addr learned my addr 172.21.15.146:0/2609968341 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:09.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.199+0000 7f98f6ffd700 1 --2- 172.21.15.146:0/2609968341 >> v2:172.21.15.146:3300/0 conn(0x7f98f80a0a30 0x7f98f80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.199+0000 7f98f77fe700 1 --2- 172.21.15.146:0/2609968341 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f81304a0 0x7f98f81308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.198+0000 7f799e7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79a00a1340 0x7f79a0121290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.199+0000 7f799e7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79a00a1340 0x7f79a0121290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56130/0 (socket says 172.21.15.146:56130) 2023-10-03T10:14:09.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.199+0000 7f799e7fc700 1 -- 172.21.15.146:0/2491921216 learned_addr learned my addr 172.21.15.146:0/2491921216 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:09.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.199+0000 7f799effd700 1 --2- 172.21.15.146:0/2491921216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79a00a0a30 0x7f79a0120d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.199+0000 7f799f7fe700 1 --2- 172.21.15.146:0/2491921216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79a0130670 0x7f79a01217d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.199+0000 7f799effd700 1 -- 172.21.15.146:0/2491921216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79a00a1340 msgr2=0x7f79a0121290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.199+0000 7f799effd700 1 --2- 172.21.15.146:0/2491921216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79a00a1340 0x7f79a0121290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.199+0000 7f799effd700 1 -- 172.21.15.146:0/2491921216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79a0130670 msgr2=0x7f79a01217d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.199+0000 7f799effd700 1 --2- 172.21.15.146:0/2491921216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79a0130670 0x7f79a01217d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.199+0000 7f799effd700 1 -- 172.21.15.146:0/2491921216 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799000b7a0 con 0x7f79a00a0a30 2023-10-03T10:14:09.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.199+0000 7f98f77fe700 1 -- 172.21.15.146:0/2609968341 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f98f80a1340 msgr2=0x7f98f812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:09.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.199+0000 7f98f77fe700 1 --2- 172.21.15.146:0/2609968341 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f98f80a1340 0x7f98f812ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.199+0000 7f98f77fe700 1 -- 172.21.15.146:0/2609968341 >> v2:172.21.15.146:3300/0 conn(0x7f98f80a0a30 msgr2=0x7f98f80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:09.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.199+0000 7f98f77fe700 1 --2- 172.21.15.146:0/2609968341 >> v2:172.21.15.146:3300/0 conn(0x7f98f80a0a30 0x7f98f80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.199+0000 7f98f77fe700 1 -- 172.21.15.146:0/2609968341 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f809b300 con 0x7f98f81304a0 2023-10-03T10:14:09.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.199+0000 7f98f6ffd700 1 --2- 172.21.15.146:0/2609968341 >> v2:172.21.15.146:3300/0 conn(0x7f98f80a0a30 0x7f98f80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:09.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.199+0000 7f98f67fc700 1 --2- 172.21.15.146:0/2609968341 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f98f80a1340 0x7f98f812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:09.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.199+0000 7f98f77fe700 1 --2- 172.21.15.146:0/2609968341 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f81304a0 0x7f98f81308f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f98f0009dc0 tx=0x7f98f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc5c052b09414dd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.200+0000 7f799effd700 1 --2- 172.21.15.146:0/2491921216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79a00a0a30 0x7f79a0120d50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f79a006b6f0 tx=0x7f7990004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.200+0000 7f98f5ffb700 1 -- 172.21.15.146:0/2609968341 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f000e070 con 0x7f98f81304a0 2023-10-03T10:14:09.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.200+0000 7f98f5ffb700 1 -- 172.21.15.146:0/2609968341 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f000bae0 con 0x7f98f81304a0 2023-10-03T10:14:09.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.200+0000 7f98f5ffb700 1 -- 172.21.15.146:0/2609968341 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f000be90 con 0x7f98f81304a0 2023-10-03T10:14:09.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.200+0000 7f79877fe700 1 -- 172.21.15.146:0/2491921216 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799000b040 con 0x7f79a00a0a30 2023-10-03T10:14:09.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.200+0000 7f79877fe700 1 -- 172.21.15.146:0/2491921216 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79900038a0 con 0x7f79a00a0a30 2023-10-03T10:14:09.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.200+0000 7f79877fe700 1 -- 172.21.15.146:0/2491921216 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990003c50 con 0x7f79a00a0a30 2023-10-03T10:14:09.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.200+0000 7f79a54cf700 1 -- 172.21.15.146:0/2491921216 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a009fdd0 con 0x7f79a00a0a30 2023-10-03T10:14:09.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.200+0000 7f79a54cf700 1 -- 172.21.15.146:0/2491921216 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a0122120 con 0x7f79a00a0a30 2023-10-03T10:14:09.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.200+0000 7f98fd394700 1 -- 172.21.15.146:0/2609968341 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f81304a0 msgr2=0x7f98f81308f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.200+0000 7f98fd394700 1 --2- 172.21.15.146:0/2609968341 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f81304a0 0x7f98f81308f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f98f0009dc0 tx=0x7f98f000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:09.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.200+0000 7f98fd394700 1 -- 172.21.15.146:0/2609968341 shutdown_connections 2023-10-03T10:14:09.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.200+0000 7f98fd394700 1 --2- 172.21.15.146:0/2609968341 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f81304a0 0x7f98f81308f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.200+0000 7f98fd394700 1 --2- 172.21.15.146:0/2609968341 >> v2:172.21.15.146:3300/0 conn(0x7f98f80a0a30 0x7f98f80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.201+0000 7f98fd394700 1 --2- 172.21.15.146:0/2609968341 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f98f80a1340 0x7f98f812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.201+0000 7f98fd394700 1 -- 172.21.15.146:0/2609968341 >> 172.21.15.146:0/2609968341 conn(0x7f98f80a2980 msgr2=0x7f98f80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.201+0000 7f98fd394700 1 -- 172.21.15.146:0/2609968341 shutdown_connections 2023-10-03T10:14:09.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.201+0000 7f98fd394700 1 -- 172.21.15.146:0/2609968341 wait complete. 2023-10-03T10:14:09.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.201+0000 7f79877fe700 1 -- 172.21.15.146:0/2491921216 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7990015070 con 0x7f79a00a0a30 2023-10-03T10:14:09.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.201+0000 7f79a54cf700 1 -- 172.21.15.146:0/2491921216 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a004f2a0 con 0x7f79a00a0a30 2023-10-03T10:14:09.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.201+0000 7f79877fe700 1 -- 172.21.15.146:0/2491921216 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f799000a070 con 0x7f79a00a0a30 2023-10-03T10:14:09.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.202+0000 7f98fd394700 1 Processor -- start 2023-10-03T10:14:09.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.202+0000 7f98fd394700 1 -- start start 2023-10-03T10:14:09.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.203+0000 7f98fd394700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f98f80a0a30 0x7f98f812f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.203+0000 7f98fd394700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f80a1340 0x7f98f81b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.203+0000 7f98fd394700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98f81304a0 0x7f98f81b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.203+0000 7f98fd394700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f81b9970 con 0x7f98f81304a0 2023-10-03T10:14:09.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.203+0000 7f98fd394700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f81b9200 con 0x7f98f80a1340 2023-10-03T10:14:09.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.203+0000 7f98fd394700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98f81b7820 con 0x7f98f80a0a30 2023-10-03T10:14:09.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.203+0000 7f98f67fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f80a1340 0x7f98f81b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.203+0000 7f98f67fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f80a1340 0x7f98f81b5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56156/0 (socket says 172.21.15.146:56156) 2023-10-03T10:14:09.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.203+0000 7f98f67fc700 1 -- 172.21.15.146:0/2047250687 learned_addr learned my addr 172.21.15.146:0/2047250687 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:09.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.203+0000 7f98f6ffd700 1 --2- 172.21.15.146:0/2047250687 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f98f80a0a30 0x7f98f812f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.203+0000 7f98f77fe700 1 --2- 172.21.15.146:0/2047250687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98f81304a0 0x7f98f81b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.203+0000 7f98f67fc700 1 -- 172.21.15.146:0/2047250687 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f98f80a0a30 msgr2=0x7f98f812f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.203+0000 7f98f67fc700 1 --2- 172.21.15.146:0/2047250687 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f98f80a0a30 0x7f98f812f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.203+0000 7f98f67fc700 1 -- 172.21.15.146:0/2047250687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98f81304a0 msgr2=0x7f98f81b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.203+0000 7f98f67fc700 1 --2- 172.21.15.146:0/2047250687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98f81304a0 0x7f98f81b61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.203+0000 7f98f67fc700 1 -- 172.21.15.146:0/2047250687 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e800a5d0 con 0x7f98f80a1340 2023-10-03T10:14:09.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.203+0000 7f98f67fc700 1 --2- 172.21.15.146:0/2047250687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f80a1340 0x7f98f81b5c80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f98ec00d7d0 tx=0x7f98ec00dae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.204+0000 7f98df7fe700 1 -- 172.21.15.146:0/2047250687 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec004030 con 0x7f98f80a1340 2023-10-03T10:14:09.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.204+0000 7f98fd394700 1 -- 172.21.15.146:0/2047250687 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f0009a70 con 0x7f98f80a1340 2023-10-03T10:14:09.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.204+0000 7f98df7fe700 1 -- 172.21.15.146:0/2047250687 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ec004190 con 0x7f98f80a1340 2023-10-03T10:14:09.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.204+0000 7f98fd394700 1 -- 172.21.15.146:0/2047250687 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f81b9450 con 0x7f98f80a1340 2023-10-03T10:14:09.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.204+0000 7f98df7fe700 1 -- 172.21.15.146:0/2047250687 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec004540 con 0x7f98f80a1340 2023-10-03T10:14:09.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.205+0000 7f98df7fe700 1 -- 172.21.15.146:0/2047250687 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f98ec0036a0 con 0x7f98f80a1340 2023-10-03T10:14:09.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.205+0000 7f98df7fe700 1 -- 172.21.15.146:0/2047250687 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f98ec03fc70 con 0x7f98f80a1340 2023-10-03T10:14:09.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.207+0000 7f98fd394700 1 -- 172.21.15.146:0/2047250687 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d80052e0 con 0x7f98f80a1340 2023-10-03T10:14:09.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.208+0000 7f79877fe700 1 -- 172.21.15.146:0/2491921216 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f799000b1a0 con 0x7f79a00a0a30 2023-10-03T10:14:09.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.211+0000 7f98df7fe700 1 -- 172.21.15.146:0/2047250687 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f98ec014620 con 0x7f98f80a1340 2023-10-03T10:14:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.234+0000 7f4914882700 1 Processor -- start 2023-10-03T10:14:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.234+0000 7f4914882700 1 -- start start 2023-10-03T10:14:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.235+0000 7f4914882700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49100a1550 0x7f4910138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.235+0000 7f4914882700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4910139200 0x7f491013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.235+0000 7f4914882700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f491009e9d0 con 0x7f49100a0a70 2023-10-03T10:14:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.235+0000 7f4914882700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491009dc00 con 0x7f4910139200 2023-10-03T10:14:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.235+0000 7f4914882700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491009dec0 con 0x7f49100a1550 2023-10-03T10:14:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.235+0000 7f490ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4910139200 0x7f491013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.235+0000 7f490e59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f49100a0a70 0x7f49100a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40026/0 (socket says 172.21.15.146:40026) 2023-10-03T10:14:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.235+0000 7f490e59c700 1 -- 172.21.15.146:0/984277050 learned_addr learned my addr 172.21.15.146:0/984277050 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:09.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.235+0000 7f490dd9b700 1 --2- 172.21.15.146:0/984277050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49100a1550 0x7f4910138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.236+0000 7f490ed9d700 1 -- 172.21.15.146:0/984277050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49100a1550 msgr2=0x7f4910138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.236+0000 7f490ed9d700 1 --2- 172.21.15.146:0/984277050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49100a1550 0x7f4910138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.236+0000 7f490ed9d700 1 -- 172.21.15.146:0/984277050 >> v1:172.21.15.146:6789/0 conn(0x7f49100a0a70 legacy=0x7f49100a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.236+0000 7f490ed9d700 1 -- 172.21.15.146:0/984277050 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491009e6a0 con 0x7f4910139200 2023-10-03T10:14:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.236+0000 7f490dd9b700 1 --2- 172.21.15.146:0/984277050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49100a1550 0x7f4910138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.236+0000 7f490d59a700 1 -- 172.21.15.146:0/984277050 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1178188819 0 0) 0x7f491009e9d0 con 0x7f49100a0a70 2023-10-03T10:14:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.236+0000 7f490ed9d700 1 --2- 172.21.15.146:0/984277050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4910139200 0x7f491013b5e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4908009d90 tx=0x7f490800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d81aad841e94089 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.236+0000 7f490d59a700 1 -- 172.21.15.146:0/984277050 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490800e070 con 0x7f4910139200 2023-10-03T10:14:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.236+0000 7f490d59a700 1 -- 172.21.15.146:0/984277050 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490800bb20 con 0x7f4910139200 2023-10-03T10:14:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.236+0000 7f490d59a700 1 -- 172.21.15.146:0/984277050 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4908012430 con 0x7f4910139200 2023-10-03T10:14:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.237+0000 7f4914882700 1 -- 172.21.15.146:0/984277050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4910139200 msgr2=0x7f491013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.237+0000 7f4914882700 1 --2- 172.21.15.146:0/984277050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4910139200 0x7f491013b5e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4908009d90 tx=0x7f490800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.237+0000 7f4914882700 1 -- 172.21.15.146:0/984277050 shutdown_connections 2023-10-03T10:14:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.237+0000 7f4914882700 1 --2- 172.21.15.146:0/984277050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4910139200 0x7f491013b5e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.237+0000 7f4914882700 1 --2- 172.21.15.146:0/984277050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49100a1550 0x7f4910138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.237+0000 7f4914882700 1 -- 172.21.15.146:0/984277050 >> 172.21.15.146:0/984277050 conn(0x7f49100a6610 msgr2=0x7f49100a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.237+0000 7f4914882700 1 -- 172.21.15.146:0/984277050 shutdown_connections 2023-10-03T10:14:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.237+0000 7f4914882700 1 -- 172.21.15.146:0/984277050 wait complete. 2023-10-03T10:14:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.238+0000 7f4914882700 1 Processor -- start 2023-10-03T10:14:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.238+0000 7f4914882700 1 -- start start 2023-10-03T10:14:09.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.238+0000 7f4914882700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f49100a0a70 0x7f4910120740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.238+0000 7f4914882700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49100a1550 0x7f4910120c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.238+0000 7f4914882700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4910139200 0x7f49101211c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.238+0000 7f4914882700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49101241c0 con 0x7f49100a1550 2023-10-03T10:14:09.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.238+0000 7f4914882700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49101228d0 con 0x7f4910139200 2023-10-03T10:14:09.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.238+0000 7f4914882700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49100a03e0 con 0x7f49100a0a70 2023-10-03T10:14:09.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.239+0000 7f490e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f49100a0a70 0x7f4910120740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.239+0000 7f490dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49100a1550 0x7f4910120c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.239+0000 7f490e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f49100a0a70 0x7f4910120740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:52834/0 (socket says 172.21.15.146:52834) 2023-10-03T10:14:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.239+0000 7f490e59c700 1 -- 172.21.15.146:0/2063291334 learned_addr learned my addr 172.21.15.146:0/2063291334 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.239+0000 7f490ed9d700 1 --2- 172.21.15.146:0/2063291334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4910139200 0x7f49101211c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.239+0000 7f490e59c700 1 -- 172.21.15.146:0/2063291334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4910139200 msgr2=0x7f49101211c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.239+0000 7f490e59c700 1 --2- 172.21.15.146:0/2063291334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4910139200 0x7f49101211c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.239+0000 7f490e59c700 1 -- 172.21.15.146:0/2063291334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49100a1550 msgr2=0x7f4910120c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.239+0000 7f490e59c700 1 --2- 172.21.15.146:0/2063291334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49100a1550 0x7f4910120c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.239+0000 7f490e59c700 1 -- 172.21.15.146:0/2063291334 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49040094a0 con 0x7f49100a0a70 2023-10-03T10:14:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.239+0000 7f490dd9b700 1 --2- 172.21.15.146:0/2063291334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49100a1550 0x7f4910120c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.239+0000 7f490e59c700 1 --2- 172.21.15.146:0/2063291334 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f49100a0a70 0x7f4910120740 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f490000c520 tx=0x7f490000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.239+0000 7f48feffd700 1 -- 172.21.15.146:0/2063291334 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900004c80 con 0x7f49100a0a70 2023-10-03T10:14:09.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.239+0000 7f48feffd700 1 -- 172.21.15.146:0/2063291334 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4900004de0 con 0x7f49100a0a70 2023-10-03T10:14:09.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.239+0000 7f4914882700 1 -- 172.21.15.146:0/2063291334 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4908009a70 con 0x7f49100a0a70 2023-10-03T10:14:09.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.239+0000 7f48feffd700 1 -- 172.21.15.146:0/2063291334 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900007310 con 0x7f49100a0a70 2023-10-03T10:14:09.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.240+0000 7f4914882700 1 -- 172.21.15.146:0/2063291334 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4910123c20 con 0x7f49100a0a70 2023-10-03T10:14:09.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.241+0000 7f48feffd700 1 -- 172.21.15.146:0/2063291334 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4900007470 con 0x7f49100a0a70 2023-10-03T10:14:09.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.241+0000 7f48feffd700 1 -- 172.21.15.146:0/2063291334 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f490003f3d0 con 0x7f49100a0a70 2023-10-03T10:14:09.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.241+0000 7f4914882700 1 -- 172.21.15.146:0/2063291334 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4910136620 con 0x7f49100a0a70 2023-10-03T10:14:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.250+0000 7f48feffd700 1 -- 172.21.15.146:0/2063291334 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49000123b0 con 0x7f49100a0a70 2023-10-03T10:14:09.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.411+0000 7f98fd394700 1 -- 172.21.15.146:0/2047250687 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f98d8005590 con 0x7f98f80a1340 2023-10-03T10:14:09.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.411+0000 7f98df7fe700 1 -- 172.21.15.146:0/2047250687 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f98ec02c090 con 0x7f98f80a1340 2023-10-03T10:14:09.412 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.413+0000 7f98fd394700 1 -- 172.21.15.146:0/2047250687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f80a1340 msgr2=0x7f98f81b5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.413+0000 7f98fd394700 1 --2- 172.21.15.146:0/2047250687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f80a1340 0x7f98f81b5c80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f98ec00d7d0 tx=0x7f98ec00dae0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.414+0000 7f98fd394700 1 -- 172.21.15.146:0/2047250687 shutdown_connections 2023-10-03T10:14:09.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.414+0000 7f98fd394700 1 --2- 172.21.15.146:0/2047250687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98f81304a0 0x7f98f81b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.414+0000 7f98fd394700 1 --2- 172.21.15.146:0/2047250687 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f98f80a0a30 0x7f98f812f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.414+0000 7f98fd394700 1 --2- 172.21.15.146:0/2047250687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f80a1340 0x7f98f81b5c80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.414+0000 7f98fd394700 1 -- 172.21.15.146:0/2047250687 >> 172.21.15.146:0/2047250687 conn(0x7f98f80a2980 msgr2=0x7f98f809deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.414+0000 7f98fd394700 1 -- 172.21.15.146:0/2047250687 shutdown_connections 2023-10-03T10:14:09.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.414+0000 7f98fd394700 1 -- 172.21.15.146:0/2047250687 wait complete. 2023-10-03T10:14:09.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.416+0000 7fd49c430700 1 -- 172.21.15.146:0/293300423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd49411d850 con 0x7fd494135f20 2023-10-03T10:14:09.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.416+0000 7fd48affd700 1 -- 172.21.15.146:0/293300423 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd48c020310 con 0x7fd494135f20 2023-10-03T10:14:09.417 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:09.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.418+0000 7fd49c430700 1 -- 172.21.15.146:0/293300423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd494135f20 msgr2=0x7fd49411bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.418+0000 7fd49c430700 1 --2- 172.21.15.146:0/293300423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd494135f20 0x7fd49411bed0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd48c00b360 tx=0x7fd48c00b670 comp rx=0 tx=0).stop 2023-10-03T10:14:09.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.418+0000 7fd49c430700 1 -- 172.21.15.146:0/293300423 shutdown_connections 2023-10-03T10:14:09.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.418+0000 7fd49c430700 1 --2- 172.21.15.146:0/293300423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd494135f20 0x7fd49411bed0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.418+0000 7fd49c430700 1 --2- 172.21.15.146:0/293300423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd49409d860 0x7fd49411b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.418+0000 7fd49c430700 1 --2- 172.21.15.146:0/293300423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd49409e340 0x7fd49411b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.418+0000 7fd49c430700 1 -- 172.21.15.146:0/293300423 >> 172.21.15.146:0/293300423 conn(0x7fd494099c40 msgr2=0x7fd4940a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.421+0000 7fd49c430700 1 -- 172.21.15.146:0/293300423 shutdown_connections 2023-10-03T10:14:09.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.421+0000 7fd49c430700 1 -- 172.21.15.146:0/293300423 wait complete. 2023-10-03T10:14:09.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:09.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:09.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.445+0000 7f4914882700 1 -- 172.21.15.146:0/2063291334 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4910122b00 con 0x7f49100a0a70 2023-10-03T10:14:09.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.445+0000 7f48feffd700 1 -- 172.21.15.146:0/2063291334 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f49000102c0 con 0x7f49100a0a70 2023-10-03T10:14:09.446 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:09.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.447+0000 7f4914882700 1 -- 172.21.15.146:0/2063291334 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f49100a0a70 msgr2=0x7f4910120740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.447+0000 7f4914882700 1 --2- 172.21.15.146:0/2063291334 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f49100a0a70 0x7f4910120740 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f490000c520 tx=0x7f490000c830 comp rx=0 tx=0).stop 2023-10-03T10:14:09.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.447+0000 7f4914882700 1 -- 172.21.15.146:0/2063291334 shutdown_connections 2023-10-03T10:14:09.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.447+0000 7f4914882700 1 --2- 172.21.15.146:0/2063291334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4910139200 0x7f49101211c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.447+0000 7f4914882700 1 --2- 172.21.15.146:0/2063291334 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f49100a0a70 0x7f4910120740 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.447+0000 7f4914882700 1 --2- 172.21.15.146:0/2063291334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49100a1550 0x7f4910120c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.447+0000 7f4914882700 1 -- 172.21.15.146:0/2063291334 >> 172.21.15.146:0/2063291334 conn(0x7f49100a6610 msgr2=0x7f49100a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.447+0000 7f4914882700 1 -- 172.21.15.146:0/2063291334 shutdown_connections 2023-10-03T10:14:09.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.447+0000 7f4914882700 1 -- 172.21.15.146:0/2063291334 wait complete. 2023-10-03T10:14:09.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.447+0000 7f79a54cf700 1 -- 172.21.15.146:0/2491921216 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f79a01241b0 con 0x7f79a00a0a30 2023-10-03T10:14:09.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.448+0000 7f79877fe700 1 -- 172.21.15.146:0/2491921216 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7990017bc0 con 0x7f79a00a0a30 2023-10-03T10:14:09.449 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:09.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.450+0000 7f79a54cf700 1 -- 172.21.15.146:0/2491921216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79a00a0a30 msgr2=0x7f79a0120d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.450+0000 7f79a54cf700 1 --2- 172.21.15.146:0/2491921216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79a00a0a30 0x7f79a0120d50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f79a006b6f0 tx=0x7f7990004750 comp rx=0 tx=0).stop 2023-10-03T10:14:09.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.450+0000 7f79a54cf700 1 -- 172.21.15.146:0/2491921216 shutdown_connections 2023-10-03T10:14:09.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.450+0000 7f79a54cf700 1 --2- 172.21.15.146:0/2491921216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79a0130670 0x7f79a01217d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.450+0000 7f79a54cf700 1 --2- 172.21.15.146:0/2491921216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79a00a0a30 0x7f79a0120d50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.450+0000 7f79a54cf700 1 --2- 172.21.15.146:0/2491921216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79a00a1340 0x7f79a0121290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.450+0000 7f79a54cf700 1 -- 172.21.15.146:0/2491921216 >> 172.21.15.146:0/2491921216 conn(0x7f79a00a2980 msgr2=0x7f79a009deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.450+0000 7f79a54cf700 1 -- 172.21.15.146:0/2491921216 shutdown_connections 2023-10-03T10:14:09.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:09.450+0000 7f79a54cf700 1 -- 172.21.15.146:0/2491921216 wait complete. 2023-10-03T10:14:09.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:09.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:10.429 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:10.435 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:10.462 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:10.464 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:10.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.584+0000 7f56afd69700 1 Processor -- start 2023-10-03T10:14:10.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.585+0000 7f56afd69700 1 -- start start 2023-10-03T10:14:10.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.585+0000 7f56afd69700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56a80a0a70 0x7f56a80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.585+0000 7f56afd69700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f56a80a1380 0x7f56a8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.585+0000 7f56afd69700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a809dc00 con 0x7f56a8133f50 2023-10-03T10:14:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.585+0000 7f56afd69700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a809ea60 con 0x7f56a80a1380 2023-10-03T10:14:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.586+0000 7f56afd69700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a809dec0 con 0x7f56a80a0a70 2023-10-03T10:14:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.586+0000 7f56adb05700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56a80a0a70 0x7f56a80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.586+0000 7f56ae306700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f56a8133f50 0x7f56a813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40030/0 (socket says 172.21.15.146:40030) 2023-10-03T10:14:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.586+0000 7f56ae306700 1 -- 172.21.15.146:0/3694132311 learned_addr learned my addr 172.21.15.146:0/3694132311 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.586+0000 7f56ad304700 1 --2- 172.21.15.146:0/3694132311 >> v2:172.21.15.146:3300/0 conn(0x7f56a80a1380 0x7f56a8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.586+0000 7f56adb05700 1 -- 172.21.15.146:0/3694132311 >> v2:172.21.15.146:3300/0 conn(0x7f56a80a1380 msgr2=0x7f56a8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.586+0000 7f56adb05700 1 --2- 172.21.15.146:0/3694132311 >> v2:172.21.15.146:3300/0 conn(0x7f56a80a1380 0x7f56a8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.586+0000 7f56adb05700 1 -- 172.21.15.146:0/3694132311 >> v1:172.21.15.146:6789/0 conn(0x7f56a8133f50 legacy=0x7f56a813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.586+0000 7f56acb03700 1 -- 172.21.15.146:0/3694132311 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088494740 0 0) 0x7f56a809dc00 con 0x7f56a8133f50 2023-10-03T10:14:10.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.586+0000 7f56adb05700 1 -- 172.21.15.146:0/3694132311 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a809e6a0 con 0x7f56a80a0a70 2023-10-03T10:14:10.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.586+0000 7f56ad304700 1 --2- 172.21.15.146:0/3694132311 >> v2:172.21.15.146:3300/0 conn(0x7f56a80a1380 0x7f56a8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:10.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.586+0000 7f56adb05700 1 --2- 172.21.15.146:0/3694132311 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56a80a0a70 0x7f56a80a0e40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f56a4009840 tx=0x7f56a4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64a20f5704b3a39e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.587+0000 7f56acb03700 1 -- 172.21.15.146:0/3694132311 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a4011830 con 0x7f56a80a0a70 2023-10-03T10:14:10.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.587+0000 7f56acb03700 1 -- 172.21.15.146:0/3694132311 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a4011990 con 0x7f56a80a0a70 2023-10-03T10:14:10.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.587+0000 7f56acb03700 1 -- 172.21.15.146:0/3694132311 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a4011d20 con 0x7f56a80a0a70 2023-10-03T10:14:10.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.588+0000 7f56afd69700 1 -- 172.21.15.146:0/3694132311 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56a80a0a70 msgr2=0x7f56a80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.588+0000 7f56afd69700 1 --2- 172.21.15.146:0/3694132311 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56a80a0a70 0x7f56a80a0e40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f56a4009840 tx=0x7f56a4009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:10.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.588+0000 7f56afd69700 1 -- 172.21.15.146:0/3694132311 shutdown_connections 2023-10-03T10:14:10.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.588+0000 7f56afd69700 1 --2- 172.21.15.146:0/3694132311 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56a80a0a70 0x7f56a80a0e40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.588+0000 7f56afd69700 1 --2- 172.21.15.146:0/3694132311 >> v2:172.21.15.146:3300/0 conn(0x7f56a80a1380 0x7f56a8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.588+0000 7f56afd69700 1 -- 172.21.15.146:0/3694132311 >> 172.21.15.146:0/3694132311 conn(0x7f56a80a6610 msgr2=0x7f56a80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.588+0000 7f56afd69700 1 -- 172.21.15.146:0/3694132311 shutdown_connections 2023-10-03T10:14:10.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.588+0000 7f56afd69700 1 -- 172.21.15.146:0/3694132311 wait complete. 2023-10-03T10:14:10.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.589+0000 7f56afd69700 1 Processor -- start 2023-10-03T10:14:10.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.589+0000 7f56afd69700 1 -- start start 2023-10-03T10:14:10.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.590+0000 7f56afd69700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f56a80a0a70 0x7f56a8122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.590+0000 7f56afd69700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56a80a1380 0x7f56a8122d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.590+0000 7f56afd69700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a8133f50 0x7f56a81232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.590+0000 7f56afd69700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a8126140 con 0x7f56a8133f50 2023-10-03T10:14:10.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.590+0000 7f56afd69700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a81244d0 con 0x7f56a80a1380 2023-10-03T10:14:10.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.590+0000 7f56afd69700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56a8126340 con 0x7f56a80a0a70 2023-10-03T10:14:10.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.590+0000 7f56ad304700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56a80a1380 0x7f56a8122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.590+0000 7f56ad304700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56a80a1380 0x7f56a8122d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56206/0 (socket says 172.21.15.146:56206) 2023-10-03T10:14:10.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.590+0000 7f56ad304700 1 -- 172.21.15.146:0/2232084009 learned_addr learned my addr 172.21.15.146:0/2232084009 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:10.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.590+0000 7f56ae306700 1 --2- 172.21.15.146:0/2232084009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a8133f50 0x7f56a81232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.591+0000 7f56ad304700 1 -- 172.21.15.146:0/2232084009 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f56a80a0a70 msgr2=0x7f56a8122820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.591+0000 7f56ad304700 1 --2- 172.21.15.146:0/2232084009 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f56a80a0a70 0x7f56a8122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.591+0000 7f56ad304700 1 -- 172.21.15.146:0/2232084009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a8133f50 msgr2=0x7f56a81232a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.591+0000 7f56ad304700 1 --2- 172.21.15.146:0/2232084009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a8133f50 0x7f56a81232a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.591+0000 7f56ad304700 1 -- 172.21.15.146:0/2232084009 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56980094a0 con 0x7f56a80a1380 2023-10-03T10:14:10.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.591+0000 7f56ad304700 1 --2- 172.21.15.146:0/2232084009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56a80a1380 0x7f56a8122d60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f569800ebb0 tx=0x7f569800eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.591+0000 7f569e7fc700 1 -- 172.21.15.146:0/2232084009 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569800c850 con 0x7f56a80a1380 2023-10-03T10:14:10.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.591+0000 7f569e7fc700 1 -- 172.21.15.146:0/2232084009 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569800c9b0 con 0x7f56a80a1380 2023-10-03T10:14:10.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.591+0000 7f56afd69700 1 -- 172.21.15.146:0/2232084009 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a40094a0 con 0x7f56a80a1380 2023-10-03T10:14:10.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.591+0000 7f56afd69700 1 -- 172.21.15.146:0/2232084009 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a8125da0 con 0x7f56a80a1380 2023-10-03T10:14:10.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.591+0000 7f569e7fc700 1 -- 172.21.15.146:0/2232084009 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569800cd40 con 0x7f56a80a1380 2023-10-03T10:14:10.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.592+0000 7f569e7fc700 1 -- 172.21.15.146:0/2232084009 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5698013470 con 0x7f56a80a1380 2023-10-03T10:14:10.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.592+0000 7f569e7fc700 1 -- 172.21.15.146:0/2232084009 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f569803f950 con 0x7f56a80a1380 2023-10-03T10:14:10.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.592+0000 7f56afd69700 1 -- 172.21.15.146:0/2232084009 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56900052e0 con 0x7f56a80a1380 2023-10-03T10:14:10.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.597+0000 7f569e7fc700 1 -- 172.21.15.146:0/2232084009 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5698021080 con 0x7f56a80a1380 2023-10-03T10:14:10.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.617+0000 7f32c0629700 1 Processor -- start 2023-10-03T10:14:10.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.617+0000 7f32c0629700 1 -- start start 2023-10-03T10:14:10.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.618+0000 7f32c0629700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32b8133a70 0x7f32b8133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.618+0000 7f32c0629700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f32b80a08e0 0x7f32b80a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.618+0000 7f32c0629700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32b80a1290 0x7f32b813a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.618+0000 7f32c0629700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b8133640 con 0x7f32b80a08e0 2023-10-03T10:14:10.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.618+0000 7f32c0629700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b80a1d50 con 0x7f32b80a1290 2023-10-03T10:14:10.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.618+0000 7f32c0629700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32b809b620 con 0x7f32b8133a70 2023-10-03T10:14:10.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.618+0000 7f32be3c5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32b8133a70 0x7f32b8133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.618+0000 7f32be3c5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32b8133a70 0x7f32b8133e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:52862/0 (socket says 172.21.15.146:52862) 2023-10-03T10:14:10.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.618+0000 7f32be3c5700 1 -- 172.21.15.146:0/425964480 learned_addr learned my addr 172.21.15.146:0/425964480 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:10.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.618+0000 7f32bebc6700 1 --2- 172.21.15.146:0/425964480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32b80a1290 0x7f32b813a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.618+0000 7f32bdbc4700 1 --2- 172.21.15.146:0/425964480 >> v2:172.21.15.146:3300/0 conn(0x7f32b80a08e0 0x7f32b80a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.618+0000 7f32be3c5700 1 -- 172.21.15.146:0/425964480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32b80a1290 msgr2=0x7f32b813a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:10.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.618+0000 7f32be3c5700 1 --2- 172.21.15.146:0/425964480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32b80a1290 0x7f32b813a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.618+0000 7f32be3c5700 1 -- 172.21.15.146:0/425964480 >> v2:172.21.15.146:3300/0 conn(0x7f32b80a08e0 msgr2=0x7f32b80a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.618+0000 7f32be3c5700 1 --2- 172.21.15.146:0/425964480 >> v2:172.21.15.146:3300/0 conn(0x7f32b80a08e0 0x7f32b80a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.618+0000 7f32be3c5700 1 -- 172.21.15.146:0/425964480 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b8133870 con 0x7f32b8133a70 2023-10-03T10:14:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.618+0000 7f32bebc6700 1 --2- 172.21.15.146:0/425964480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32b80a1290 0x7f32b813a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.618+0000 7f32be3c5700 1 --2- 172.21.15.146:0/425964480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32b8133a70 0x7f32b8133e40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f32b4006fd0 tx=0x7f32b4009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b6c34bc6c4463d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.619+0000 7f32bd3c3700 1 -- 172.21.15.146:0/425964480 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b4005e30 con 0x7f32b8133a70 2023-10-03T10:14:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.619+0000 7f32bd3c3700 1 -- 172.21.15.146:0/425964480 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b4004030 con 0x7f32b8133a70 2023-10-03T10:14:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.619+0000 7f32bd3c3700 1 -- 172.21.15.146:0/425964480 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b40043e0 con 0x7f32b8133a70 2023-10-03T10:14:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.619+0000 7f32c0629700 1 -- 172.21.15.146:0/425964480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32b8133a70 msgr2=0x7f32b8133e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.619+0000 7f32c0629700 1 --2- 172.21.15.146:0/425964480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32b8133a70 0x7f32b8133e40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f32b4006fd0 tx=0x7f32b4009bd0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.619+0000 7f32c0629700 1 -- 172.21.15.146:0/425964480 shutdown_connections 2023-10-03T10:14:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.619+0000 7f32c0629700 1 --2- 172.21.15.146:0/425964480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32b80a1290 0x7f32b813a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.619+0000 7f32c0629700 1 --2- 172.21.15.146:0/425964480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32b8133a70 0x7f32b8133e40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.619+0000 7f32c0629700 1 --2- 172.21.15.146:0/425964480 >> v2:172.21.15.146:3300/0 conn(0x7f32b80a08e0 0x7f32b80a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.619+0000 7f32c0629700 1 -- 172.21.15.146:0/425964480 >> 172.21.15.146:0/425964480 conn(0x7f32b80a2980 msgr2=0x7f32b80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.619+0000 7f32c0629700 1 -- 172.21.15.146:0/425964480 shutdown_connections 2023-10-03T10:14:10.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.620+0000 7f32c0629700 1 -- 172.21.15.146:0/425964480 wait complete. 2023-10-03T10:14:10.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.620+0000 7fd2b9c3a700 1 Processor -- start 2023-10-03T10:14:10.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.620+0000 7fd2b9c3a700 1 -- start start 2023-10-03T10:14:10.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.620+0000 7f32c0629700 1 Processor -- start 2023-10-03T10:14:10.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.620+0000 7f32c0629700 1 -- start start 2023-10-03T10:14:10.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.621+0000 7fd2b9c3a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2b40724f0 0x7fd2b41358e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.621+0000 7fd2b9c3a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2b4130e90 0x7fd2b4137e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.621+0000 7fd2b9c3a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b406d970 con 0x7fd2b41303b0 2023-10-03T10:14:10.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.621+0000 7fd2b9c3a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b409a8a0 con 0x7fd2b4130e90 2023-10-03T10:14:10.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.621+0000 7fd2b9c3a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b409b940 con 0x7fd2b40724f0 2023-10-03T10:14:10.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.621+0000 7fd2b37fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd2b41303b0 0x7fd2b4130780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40038/0 (socket says 172.21.15.146:40038) 2023-10-03T10:14:10.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.621+0000 7fd2b37fe700 1 -- 172.21.15.146:0/1554665487 learned_addr learned my addr 172.21.15.146:0/1554665487 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:10.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.621+0000 7f32c0629700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32b80a08e0 0x7f32b811c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.621+0000 7f32c0629700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32b80a1290 0x7f32b811cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.621+0000 7f32c0629700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32b8133a70 0x7f32b811d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.621+0000 7f32c0629700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b811e400 con 0x7f32b80a08e0 2023-10-03T10:14:10.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.621+0000 7f32c0629700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b811f650 con 0x7f32b8133a70 2023-10-03T10:14:10.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.621+0000 7f32c0629700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32b811e9f0 con 0x7f32b80a1290 2023-10-03T10:14:10.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.621+0000 7f32bebc6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32b8133a70 0x7f32b811d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.621+0000 7f32bebc6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32b8133a70 0x7f32b811d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56236/0 (socket says 172.21.15.146:56236) 2023-10-03T10:14:10.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.621+0000 7f32bebc6700 1 -- 172.21.15.146:0/2906816446 learned_addr learned my addr 172.21.15.146:0/2906816446 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:10.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.621+0000 7fd2b3fff700 1 --2- 172.21.15.146:0/1554665487 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2b4130e90 0x7fd2b4137e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.622+0000 7f32be3c5700 1 --2- 172.21.15.146:0/2906816446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32b80a08e0 0x7f32b811c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.622+0000 7f32bdbc4700 1 --2- 172.21.15.146:0/2906816446 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32b80a1290 0x7f32b811cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.622+0000 7f32bebc6700 1 -- 172.21.15.146:0/2906816446 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32b80a1290 msgr2=0x7f32b811cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.622+0000 7f32bebc6700 1 --2- 172.21.15.146:0/2906816446 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32b80a1290 0x7f32b811cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.622+0000 7f32bebc6700 1 -- 172.21.15.146:0/2906816446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32b80a08e0 msgr2=0x7f32b811c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.622+0000 7f32bebc6700 1 --2- 172.21.15.146:0/2906816446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32b80a08e0 0x7f32b811c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.622+0000 7f32bebc6700 1 -- 172.21.15.146:0/2906816446 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b0009a70 con 0x7f32b8133a70 2023-10-03T10:14:10.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.622+0000 7fd2b2ffd700 1 --2- 172.21.15.146:0/1554665487 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2b40724f0 0x7fd2b41358e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.622+0000 7f32bdbc4700 1 --2- 172.21.15.146:0/2906816446 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32b80a1290 0x7f32b811cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:10.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.622+0000 7f32bebc6700 1 --2- 172.21.15.146:0/2906816446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32b8133a70 0x7f32b811d2c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f32b000efc0 tx=0x7f32b000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.622+0000 7fd2b27fc700 1 -- 172.21.15.146:0/1554665487 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13745793 0 0) 0x7fd2b406d970 con 0x7fd2b41303b0 2023-10-03T10:14:10.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.622+0000 7fd2b3fff700 1 -- 172.21.15.146:0/1554665487 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2b40724f0 msgr2=0x7fd2b41358e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:10.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.622+0000 7fd2b3fff700 1 --2- 172.21.15.146:0/1554665487 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2b40724f0 0x7fd2b41358e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.622+0000 7fd2b3fff700 1 -- 172.21.15.146:0/1554665487 >> v1:172.21.15.146:6789/0 conn(0x7fd2b41303b0 legacy=0x7fd2b4130780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.622+0000 7fd2b3fff700 1 -- 172.21.15.146:0/1554665487 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b409af50 con 0x7fd2b4130e90 2023-10-03T10:14:10.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.622+0000 7f32aeffd700 1 -- 172.21.15.146:0/2906816446 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b000cbe0 con 0x7f32b8133a70 2023-10-03T10:14:10.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.622+0000 7fd2b3fff700 1 --2- 172.21.15.146:0/1554665487 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2b4130e90 0x7fd2b4137e30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009dc0 tx=0x7fd2ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd8a120eb12a5912 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.622+0000 7f32aeffd700 1 -- 172.21.15.146:0/2906816446 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b000f040 con 0x7f32b8133a70 2023-10-03T10:14:10.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.622+0000 7f32aeffd700 1 -- 172.21.15.146:0/2906816446 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0003a20 con 0x7f32b8133a70 2023-10-03T10:14:10.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.622+0000 7f32c0629700 1 -- 172.21.15.146:0/2906816446 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b4009500 con 0x7f32b8133a70 2023-10-03T10:14:10.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.622+0000 7f32c0629700 1 -- 172.21.15.146:0/2906816446 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b809a350 con 0x7f32b8133a70 2023-10-03T10:14:10.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.623+0000 7f32aeffd700 1 -- 172.21.15.146:0/2906816446 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f32b0014480 con 0x7f32b8133a70 2023-10-03T10:14:10.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.623+0000 7fd2b27fc700 1 -- 172.21.15.146:0/1554665487 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac00bd20 con 0x7fd2b4130e90 2023-10-03T10:14:10.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.623+0000 7fd2b27fc700 1 -- 172.21.15.146:0/1554665487 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac00be80 con 0x7fd2b4130e90 2023-10-03T10:14:10.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.623+0000 7fd2b27fc700 1 -- 172.21.15.146:0/1554665487 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac010710 con 0x7fd2b4130e90 2023-10-03T10:14:10.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.623+0000 7f32aeffd700 1 -- 172.21.15.146:0/2906816446 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f32b0040240 con 0x7f32b8133a70 2023-10-03T10:14:10.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.624+0000 7f32c0629700 1 -- 172.21.15.146:0/2906816446 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b804f2a0 con 0x7f32b8133a70 2023-10-03T10:14:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.624+0000 7fd2b9c3a700 1 -- 172.21.15.146:0/1554665487 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2b4130e90 msgr2=0x7fd2b4137e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.624+0000 7fd2b9c3a700 1 --2- 172.21.15.146:0/1554665487 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2b4130e90 0x7fd2b4137e30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009dc0 tx=0x7fd2ac00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.624+0000 7fd2b9c3a700 1 -- 172.21.15.146:0/1554665487 shutdown_connections 2023-10-03T10:14:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.624+0000 7fd2b9c3a700 1 --2- 172.21.15.146:0/1554665487 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2b4130e90 0x7fd2b4137e30 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.624+0000 7fd2b9c3a700 1 --2- 172.21.15.146:0/1554665487 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2b40724f0 0x7fd2b41358e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.624+0000 7fd2b9c3a700 1 -- 172.21.15.146:0/1554665487 >> 172.21.15.146:0/1554665487 conn(0x7fd2b40a1ee0 msgr2=0x7fd2b40a22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.624+0000 7fd2b9c3a700 1 -- 172.21.15.146:0/1554665487 shutdown_connections 2023-10-03T10:14:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.624+0000 7fd2b9c3a700 1 -- 172.21.15.146:0/1554665487 wait complete. 2023-10-03T10:14:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.625+0000 7f66ad8b7700 1 Processor -- start 2023-10-03T10:14:10.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.625+0000 7f66ad8b7700 1 -- start start 2023-10-03T10:14:10.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.626+0000 7f66ad8b7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66a8138040 0x7f66a8138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.626+0000 7f66ad8b7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f66a80a08e0 0x7f66a80a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.626+0000 7f66ad8b7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a81379e0 con 0x7f66a80a1230 2023-10-03T10:14:10.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.626+0000 7f66ad8b7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a80a2100 con 0x7f66a80a08e0 2023-10-03T10:14:10.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.626+0000 7f66ad8b7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a8138950 con 0x7f66a8138040 2023-10-03T10:14:10.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.625+0000 7fd2b9c3a700 1 Processor -- start 2023-10-03T10:14:10.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.626+0000 7fd2b9c3a700 1 -- start start 2023-10-03T10:14:10.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.626+0000 7f66a67fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f66a80a08e0 0x7f66a80a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.626+0000 7f66a67fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f66a80a08e0 0x7f66a80a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49486/0 (socket says 172.21.15.146:49486) 2023-10-03T10:14:10.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.626+0000 7f66a67fc700 1 -- 172.21.15.146:0/4176436018 learned_addr learned my addr 172.21.15.146:0/4176436018 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:10.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.626+0000 7f66a6ffd700 1 --2- 172.21.15.146:0/4176436018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66a8138040 0x7f66a8138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.626+0000 7fd2b9c3a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2b40724f0 0x7fd2b4094a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.626+0000 7fd2b9c3a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2b41303b0 0x7fd2b4094fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.626+0000 7fd2b9c3a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2b4130e90 0x7fd2b40954e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.626+0000 7fd2b9c3a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b4097690 con 0x7fd2b4130e90 2023-10-03T10:14:10.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.626+0000 7fd2b9c3a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b412e880 con 0x7fd2b40724f0 2023-10-03T10:14:10.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.626+0000 7fd2b9c3a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b409b190 con 0x7fd2b41303b0 2023-10-03T10:14:10.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.626+0000 7f66a67fc700 1 -- 172.21.15.146:0/4176436018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66a8138040 msgr2=0x7f66a8138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:10.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.626+0000 7f66a67fc700 1 --2- 172.21.15.146:0/4176436018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66a8138040 0x7f66a8138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.626+0000 7f66a67fc700 1 -- 172.21.15.146:0/4176436018 >> v1:172.21.15.146:6789/0 conn(0x7f66a80a1230 legacy=0x7f66a813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.626+0000 7f66a67fc700 1 -- 172.21.15.146:0/4176436018 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a809b9b0 con 0x7f66a80a08e0 2023-10-03T10:14:10.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.627+0000 7f66a67fc700 1 --2- 172.21.15.146:0/4176436018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66a80a08e0 0x7f66a80a0cf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f669c009920 tx=0x7f669c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55c31bcda1d82fa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.627+0000 7fd2b37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2b40724f0 0x7fd2b4094a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.627+0000 7fd2b37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2b40724f0 0x7fd2b4094a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56258/0 (socket says 172.21.15.146:56258) 2023-10-03T10:14:10.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.627+0000 7fd2b37fe700 1 -- 172.21.15.146:0/1356476796 learned_addr learned my addr 172.21.15.146:0/1356476796 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:10.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.627+0000 7fd2b3fff700 1 --2- 172.21.15.146:0/1356476796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2b4130e90 0x7fd2b40954e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.627+0000 7fd2b2ffd700 1 --2- 172.21.15.146:0/1356476796 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2b41303b0 0x7fd2b4094fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.627+0000 7f66a5ffb700 1 -- 172.21.15.146:0/4176436018 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c011830 con 0x7f66a80a08e0 2023-10-03T10:14:10.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.627+0000 7f66a5ffb700 1 -- 172.21.15.146:0/4176436018 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669c011990 con 0x7f66a80a08e0 2023-10-03T10:14:10.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.627+0000 7f66a5ffb700 1 -- 172.21.15.146:0/4176436018 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c011d20 con 0x7f66a80a08e0 2023-10-03T10:14:10.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.627+0000 7fd2b37fe700 1 -- 172.21.15.146:0/1356476796 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2b41303b0 msgr2=0x7fd2b4094fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.627+0000 7fd2b37fe700 1 --2- 172.21.15.146:0/1356476796 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2b41303b0 0x7fd2b4094fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.627+0000 7fd2b37fe700 1 -- 172.21.15.146:0/1356476796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2b4130e90 msgr2=0x7fd2b40954e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.627+0000 7fd2b37fe700 1 --2- 172.21.15.146:0/1356476796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2b4130e90 0x7fd2b40954e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.627+0000 7fd2b37fe700 1 -- 172.21.15.146:0/1356476796 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ac009a70 con 0x7fd2b40724f0 2023-10-03T10:14:10.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.627+0000 7fd2b2ffd700 1 --2- 172.21.15.146:0/1356476796 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2b41303b0 0x7fd2b4094fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:10.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.627+0000 7fd2b3fff700 1 --2- 172.21.15.146:0/1356476796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2b4130e90 0x7fd2b40954e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:10.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.627+0000 7fd2b37fe700 1 --2- 172.21.15.146:0/1356476796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2b40724f0 0x7fd2b4094a60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400c520 tx=0x7fd2a400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.628+0000 7f66ad8b7700 1 -- 172.21.15.146:0/4176436018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66a80a08e0 msgr2=0x7f66a80a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.628+0000 7f66ad8b7700 1 --2- 172.21.15.146:0/4176436018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66a80a08e0 0x7f66a80a0cf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f669c009920 tx=0x7f669c009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:10.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.628+0000 7f66ad8b7700 1 -- 172.21.15.146:0/4176436018 shutdown_connections 2023-10-03T10:14:10.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.628+0000 7f66ad8b7700 1 --2- 172.21.15.146:0/4176436018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66a8138040 0x7f66a8138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.628+0000 7f66ad8b7700 1 --2- 172.21.15.146:0/4176436018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66a80a08e0 0x7f66a80a0cf0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.628+0000 7f66ad8b7700 1 -- 172.21.15.146:0/4176436018 >> 172.21.15.146:0/4176436018 conn(0x7f66a80a2980 msgr2=0x7f66a80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.628+0000 7f66ad8b7700 1 -- 172.21.15.146:0/4176436018 shutdown_connections 2023-10-03T10:14:10.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.628+0000 7f66ad8b7700 1 -- 172.21.15.146:0/4176436018 wait complete. 2023-10-03T10:14:10.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.630+0000 7f66ad8b7700 1 Processor -- start 2023-10-03T10:14:10.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.630+0000 7fd29bfff700 1 -- 172.21.15.146:0/1356476796 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4004c80 con 0x7fd2b40724f0 2023-10-03T10:14:10.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.630+0000 7f66ad8b7700 1 -- start start 2023-10-03T10:14:10.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.630+0000 7fd29bfff700 1 -- 172.21.15.146:0/1356476796 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a4004e00 con 0x7fd2b40724f0 2023-10-03T10:14:10.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.630+0000 7fd2b9c3a700 1 -- 172.21.15.146:0/1356476796 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b4127210 con 0x7fd2b40724f0 2023-10-03T10:14:10.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.630+0000 7fd29bfff700 1 -- 172.21.15.146:0/1356476796 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4007310 con 0x7fd2b40724f0 2023-10-03T10:14:10.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.630+0000 7fd2b9c3a700 1 -- 172.21.15.146:0/1356476796 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b4096440 con 0x7fd2b40724f0 2023-10-03T10:14:10.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.630+0000 7f66ad8b7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66a80a08e0 0x7f66a8137220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.630+0000 7f66ad8b7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f66a80a1230 0x7f66a8135a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.630+0000 7f66ad8b7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66a8138040 0x7f66a8135f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.630+0000 7f66ad8b7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a809f420 con 0x7f66a8138040 2023-10-03T10:14:10.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.630+0000 7f66ad8b7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a8130160 con 0x7f66a80a08e0 2023-10-03T10:14:10.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.630+0000 7f66ad8b7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66a813f2c0 con 0x7f66a80a1230 2023-10-03T10:14:10.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.630+0000 7f32aeffd700 1 -- 172.21.15.146:0/2906816446 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f32b0012930 con 0x7f32b8133a70 2023-10-03T10:14:10.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.631+0000 7fd29bfff700 1 -- 172.21.15.146:0/1356476796 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd2a4007470 con 0x7fd2b40724f0 2023-10-03T10:14:10.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.631+0000 7f66a77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66a8138040 0x7f66a8135f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.631+0000 7f66a77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66a8138040 0x7f66a8135f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49500/0 (socket says 172.21.15.146:49500) 2023-10-03T10:14:10.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.631+0000 7f66a77fe700 1 -- 172.21.15.146:0/3690653239 learned_addr learned my addr 172.21.15.146:0/3690653239 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:10.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.631+0000 7f66a67fc700 1 --2- 172.21.15.146:0/3690653239 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f66a80a1230 0x7f66a8135a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.631+0000 7fd2b9c3a700 1 -- 172.21.15.146:0/1356476796 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b404f2a0 con 0x7fd2b40724f0 2023-10-03T10:14:10.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.631+0000 7fd29bfff700 1 -- 172.21.15.146:0/1356476796 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd2a403f3c0 con 0x7fd2b40724f0 2023-10-03T10:14:10.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.631+0000 7f66a6ffd700 1 --2- 172.21.15.146:0/3690653239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66a80a08e0 0x7f66a8137220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.631+0000 7f66a77fe700 1 -- 172.21.15.146:0/3690653239 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f66a80a1230 msgr2=0x7f66a8135a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.631+0000 7f66a77fe700 1 --2- 172.21.15.146:0/3690653239 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f66a80a1230 0x7f66a8135a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.631+0000 7f66a77fe700 1 -- 172.21.15.146:0/3690653239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66a80a08e0 msgr2=0x7f66a8137220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.631+0000 7f66a77fe700 1 --2- 172.21.15.146:0/3690653239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66a80a08e0 0x7f66a8137220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.631+0000 7f66a77fe700 1 -- 172.21.15.146:0/3690653239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c009550 con 0x7f66a8138040 2023-10-03T10:14:10.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.632+0000 7f66a77fe700 1 --2- 172.21.15.146:0/3690653239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66a8138040 0x7f66a8135f40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f66a000cb80 tx=0x7f66a000ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.632+0000 7f668ffff700 1 -- 172.21.15.146:0/3690653239 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a0003c00 con 0x7f66a8138040 2023-10-03T10:14:10.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.632+0000 7f668ffff700 1 -- 172.21.15.146:0/3690653239 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a0003d60 con 0x7f66a8138040 2023-10-03T10:14:10.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.632+0000 7f66ad8b7700 1 -- 172.21.15.146:0/3690653239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a8118df0 con 0x7f66a8138040 2023-10-03T10:14:10.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.632+0000 7f668ffff700 1 -- 172.21.15.146:0/3690653239 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a000aaa0 con 0x7f66a8138040 2023-10-03T10:14:10.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.632+0000 7f66ad8b7700 1 -- 172.21.15.146:0/3690653239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a809a240 con 0x7f66a8138040 2023-10-03T10:14:10.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.633+0000 7f668ffff700 1 -- 172.21.15.146:0/3690653239 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66a000ac00 con 0x7f66a8138040 2023-10-03T10:14:10.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.633+0000 7f668ffff700 1 -- 172.21.15.146:0/3690653239 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f66a003f5a0 con 0x7f66a8138040 2023-10-03T10:14:10.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.634+0000 7f66ad8b7700 1 -- 172.21.15.146:0/3690653239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a804f2a0 con 0x7f66a8138040 2023-10-03T10:14:10.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.637+0000 7fd29bfff700 1 -- 172.21.15.146:0/1356476796 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd2a40123b0 con 0x7fd2b40724f0 2023-10-03T10:14:10.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.639+0000 7f668ffff700 1 -- 172.21.15.146:0/3690653239 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66a00198f0 con 0x7f66a8138040 2023-10-03T10:14:10.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.798+0000 7f56afd69700 1 -- 172.21.15.146:0/2232084009 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5690005590 con 0x7f56a80a1380 2023-10-03T10:14:10.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.799+0000 7f569e7fc700 1 -- 172.21.15.146:0/2232084009 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5698017020 con 0x7f56a80a1380 2023-10-03T10:14:10.800 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.801+0000 7f56afd69700 1 -- 172.21.15.146:0/2232084009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56a80a1380 msgr2=0x7f56a8122d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.801+0000 7f56afd69700 1 --2- 172.21.15.146:0/2232084009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56a80a1380 0x7f56a8122d60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f569800ebb0 tx=0x7f569800eec0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.801+0000 7f56afd69700 1 -- 172.21.15.146:0/2232084009 shutdown_connections 2023-10-03T10:14:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.801+0000 7f56afd69700 1 --2- 172.21.15.146:0/2232084009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a8133f50 0x7f56a81232a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.801+0000 7f56afd69700 1 --2- 172.21.15.146:0/2232084009 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f56a80a0a70 0x7f56a8122820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.801+0000 7f56afd69700 1 --2- 172.21.15.146:0/2232084009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56a80a1380 0x7f56a8122d60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.801+0000 7f56afd69700 1 -- 172.21.15.146:0/2232084009 >> 172.21.15.146:0/2232084009 conn(0x7f56a80a6610 msgr2=0x7f56a80a4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.801+0000 7f56afd69700 1 -- 172.21.15.146:0/2232084009 shutdown_connections 2023-10-03T10:14:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.801+0000 7f56afd69700 1 -- 172.21.15.146:0/2232084009 wait complete. 2023-10-03T10:14:10.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.833+0000 7f66ad8b7700 1 -- 172.21.15.146:0/3690653239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f66a8140390 con 0x7f66a8138040 2023-10-03T10:14:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.834+0000 7f668ffff700 1 -- 172.21.15.146:0/3690653239 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f66a0019300 con 0x7f66a8138040 2023-10-03T10:14:10.834 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.836+0000 7f66ad8b7700 1 -- 172.21.15.146:0/3690653239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66a8138040 msgr2=0x7f66a8135f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.836+0000 7f66ad8b7700 1 --2- 172.21.15.146:0/3690653239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66a8138040 0x7f66a8135f40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f66a000cb80 tx=0x7f66a000ce90 comp rx=0 tx=0).stop 2023-10-03T10:14:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.836+0000 7f66ad8b7700 1 -- 172.21.15.146:0/3690653239 shutdown_connections 2023-10-03T10:14:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.836+0000 7f66ad8b7700 1 --2- 172.21.15.146:0/3690653239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66a8138040 0x7f66a8135f40 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.836+0000 7f66ad8b7700 1 --2- 172.21.15.146:0/3690653239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66a80a08e0 0x7f66a8137220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.836+0000 7f66ad8b7700 1 --2- 172.21.15.146:0/3690653239 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f66a80a1230 0x7f66a8135a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.836+0000 7f66ad8b7700 1 -- 172.21.15.146:0/3690653239 >> 172.21.15.146:0/3690653239 conn(0x7f66a80a2980 msgr2=0x7f66a8071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.836+0000 7f66ad8b7700 1 -- 172.21.15.146:0/3690653239 shutdown_connections 2023-10-03T10:14:10.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.836+0000 7f66ad8b7700 1 -- 172.21.15.146:0/3690653239 wait complete. 2023-10-03T10:14:10.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.840+0000 7f32c0629700 1 -- 172.21.15.146:0/2906816446 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f32b806bce0 con 0x7f32b8133a70 2023-10-03T10:14:10.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.840+0000 7f32aeffd700 1 -- 172.21.15.146:0/2906816446 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f32b002c090 con 0x7f32b8133a70 2023-10-03T10:14:10.841 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:10.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.843+0000 7f32c0629700 1 -- 172.21.15.146:0/2906816446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32b8133a70 msgr2=0x7f32b811d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.843+0000 7f32c0629700 1 --2- 172.21.15.146:0/2906816446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32b8133a70 0x7f32b811d2c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f32b000efc0 tx=0x7f32b000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.843+0000 7f32c0629700 1 -- 172.21.15.146:0/2906816446 shutdown_connections 2023-10-03T10:14:10.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.843+0000 7f32c0629700 1 --2- 172.21.15.146:0/2906816446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32b8133a70 0x7f32b811d2c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.843+0000 7f32c0629700 1 --2- 172.21.15.146:0/2906816446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32b80a08e0 0x7f32b811c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.843+0000 7f32c0629700 1 --2- 172.21.15.146:0/2906816446 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32b80a1290 0x7f32b811cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.843+0000 7f32c0629700 1 -- 172.21.15.146:0/2906816446 >> 172.21.15.146:0/2906816446 conn(0x7f32b80a2980 msgr2=0x7f32b81b9650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.843+0000 7f32c0629700 1 -- 172.21.15.146:0/2906816446 shutdown_connections 2023-10-03T10:14:10.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.843+0000 7f32c0629700 1 -- 172.21.15.146:0/2906816446 wait complete. 2023-10-03T10:14:10.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.847+0000 7fd2b9c3a700 1 -- 172.21.15.146:0/1356476796 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd2b409bb60 con 0x7fd2b40724f0 2023-10-03T10:14:10.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.848+0000 7fd29bfff700 1 -- 172.21.15.146:0/1356476796 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd2a4011360 con 0x7fd2b40724f0 2023-10-03T10:14:10.849 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:10.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:10.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.851+0000 7fd2b9c3a700 1 -- 172.21.15.146:0/1356476796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2b40724f0 msgr2=0x7fd2b4094a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.851+0000 7fd2b9c3a700 1 --2- 172.21.15.146:0/1356476796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2b40724f0 0x7fd2b4094a60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400c520 tx=0x7fd2a400c830 comp rx=0 tx=0).stop 2023-10-03T10:14:10.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.851+0000 7fd2b9c3a700 1 -- 172.21.15.146:0/1356476796 shutdown_connections 2023-10-03T10:14:10.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.852+0000 7fd2b9c3a700 1 --2- 172.21.15.146:0/1356476796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2b4130e90 0x7fd2b40954e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.852+0000 7fd2b9c3a700 1 --2- 172.21.15.146:0/1356476796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2b40724f0 0x7fd2b4094a60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.852+0000 7fd2b9c3a700 1 --2- 172.21.15.146:0/1356476796 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2b41303b0 0x7fd2b4094fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.852+0000 7fd2b9c3a700 1 -- 172.21.15.146:0/1356476796 >> 172.21.15.146:0/1356476796 conn(0x7fd2b40a1ee0 msgr2=0x7fd2b409e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.852+0000 7fd2b9c3a700 1 -- 172.21.15.146:0/1356476796 shutdown_connections 2023-10-03T10:14:10.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:10.852+0000 7fd2b9c3a700 1 -- 172.21.15.146:0/1356476796 wait complete. 2023-10-03T10:14:10.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:10.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:11.815 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:11.850 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:11.862 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:11.867 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:11.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.968+0000 7f31f7b6c700 1 Processor -- start 2023-10-03T10:14:11.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.968+0000 7f31f7b6c700 1 -- start start 2023-10-03T10:14:11.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.969+0000 7f31f7b6c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f31f0133660 0x7f31f0135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.969+0000 7f31f7b6c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31f0135f80 0x7f31f0138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.969+0000 7f31f7b6c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f0099a60 con 0x7f31f0099e20 2023-10-03T10:14:11.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.969+0000 7f31f7b6c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f009bf50 con 0x7f31f0133660 2023-10-03T10:14:11.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.969+0000 7f31f7b6c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31f009b230 con 0x7f31f0135f80 2023-10-03T10:14:11.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.969+0000 7f31f5107700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f31f0133660 0x7f31f0135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.969+0000 7f31f6109700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31f0135f80 0x7f31f0138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.969+0000 7f31f5107700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f31f0133660 0x7f31f0135a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49516/0 (socket says 172.21.15.146:49516) 2023-10-03T10:14:11.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.969+0000 7f31f5107700 1 -- 172.21.15.146:0/4163100389 learned_addr learned my addr 172.21.15.146:0/4163100389 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:11.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.969+0000 7f31f5107700 1 -- 172.21.15.146:0/4163100389 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31f0135f80 msgr2=0x7f31f0138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:11.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.969+0000 7f31f5107700 1 --2- 172.21.15.146:0/4163100389 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31f0135f80 0x7f31f0138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.969+0000 7f31f5107700 1 -- 172.21.15.146:0/4163100389 >> v1:172.21.15.146:6789/0 conn(0x7f31f0099e20 legacy=0x7f31f009a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.969+0000 7f31f5107700 1 -- 172.21.15.146:0/4163100389 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f009bb90 con 0x7f31f0133660 2023-10-03T10:14:11.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.969+0000 7f31f5107700 1 --2- 172.21.15.146:0/4163100389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31f0133660 0x7f31f0135a40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f31ec0098f0 tx=0x7f31ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5b70c9c927099d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.970+0000 7f31f4906700 1 -- 172.21.15.146:0/4163100389 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec011830 con 0x7f31f0133660 2023-10-03T10:14:11.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.970+0000 7f31f4906700 1 -- 172.21.15.146:0/4163100389 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec011990 con 0x7f31f0133660 2023-10-03T10:14:11.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.970+0000 7f31f4906700 1 -- 172.21.15.146:0/4163100389 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec011d20 con 0x7f31f0133660 2023-10-03T10:14:11.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.971+0000 7f31f7b6c700 1 -- 172.21.15.146:0/4163100389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31f0133660 msgr2=0x7f31f0135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.971+0000 7f31f7b6c700 1 --2- 172.21.15.146:0/4163100389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31f0133660 0x7f31f0135a40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f31ec0098f0 tx=0x7f31ec009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:11.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.971+0000 7f31f7b6c700 1 -- 172.21.15.146:0/4163100389 shutdown_connections 2023-10-03T10:14:11.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.971+0000 7f31f7b6c700 1 --2- 172.21.15.146:0/4163100389 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31f0135f80 0x7f31f0138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.971+0000 7f31f7b6c700 1 --2- 172.21.15.146:0/4163100389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31f0133660 0x7f31f0135a40 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.971+0000 7f31f7b6c700 1 -- 172.21.15.146:0/4163100389 >> 172.21.15.146:0/4163100389 conn(0x7f31f00a2980 msgr2=0x7f31f00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.971+0000 7f31f7b6c700 1 -- 172.21.15.146:0/4163100389 shutdown_connections 2023-10-03T10:14:11.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.971+0000 7f31f7b6c700 1 -- 172.21.15.146:0/4163100389 wait complete. 2023-10-03T10:14:11.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.972+0000 7f31f7b6c700 1 Processor -- start 2023-10-03T10:14:11.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.972+0000 7f31f7b6c700 1 -- start start 2023-10-03T10:14:11.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.973+0000 7f31f7b6c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31f0099e20 0x7f31f01398b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.973+0000 7f31f7b6c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31f0133660 0x7f31f0139df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.973+0000 7f31f7b6c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31f0135f80 0x7f31f013a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.973+0000 7f31f7b6c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f013ae20 con 0x7f31f0133660 2023-10-03T10:14:11.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.973+0000 7f31f7b6c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f006ee60 con 0x7f31f0135f80 2023-10-03T10:14:11.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.973+0000 7f31f7b6c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31f0139410 con 0x7f31f0099e20 2023-10-03T10:14:11.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.973+0000 7f31f5908700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31f0099e20 0x7f31f01398b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.973+0000 7f31f5908700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31f0099e20 0x7f31f01398b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:52918/0 (socket says 172.21.15.146:52918) 2023-10-03T10:14:11.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.973+0000 7f31f5908700 1 -- 172.21.15.146:0/964122713 learned_addr learned my addr 172.21.15.146:0/964122713 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:11.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.973+0000 7f31f6109700 1 --2- 172.21.15.146:0/964122713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31f0135f80 0x7f31f013a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.973+0000 7f31f5107700 1 --2- 172.21.15.146:0/964122713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31f0133660 0x7f31f0139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.973+0000 7f31f6109700 1 -- 172.21.15.146:0/964122713 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31f0099e20 msgr2=0x7f31f01398b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.973+0000 7f31f6109700 1 --2- 172.21.15.146:0/964122713 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31f0099e20 0x7f31f01398b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.973+0000 7f31f6109700 1 -- 172.21.15.146:0/964122713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31f0133660 msgr2=0x7f31f0139df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.973+0000 7f31f6109700 1 --2- 172.21.15.146:0/964122713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31f0133660 0x7f31f0139df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.973+0000 7f31f6109700 1 -- 172.21.15.146:0/964122713 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec009550 con 0x7f31f0135f80 2023-10-03T10:14:11.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.974+0000 7f31f6109700 1 --2- 172.21.15.146:0/964122713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31f0135f80 0x7f31f013a330 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f31f009ae20 tx=0x7f31e800ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.974+0000 7f31e67fc700 1 -- 172.21.15.146:0/964122713 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e800cc20 con 0x7f31f0135f80 2023-10-03T10:14:11.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.974+0000 7f31e67fc700 1 -- 172.21.15.146:0/964122713 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e800f040 con 0x7f31f0135f80 2023-10-03T10:14:11.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.974+0000 7f31e67fc700 1 -- 172.21.15.146:0/964122713 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e8009e60 con 0x7f31f0135f80 2023-10-03T10:14:11.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.974+0000 7f31f7b6c700 1 -- 172.21.15.146:0/964122713 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f009b470 con 0x7f31f0135f80 2023-10-03T10:14:11.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.974+0000 7f31f7b6c700 1 -- 172.21.15.146:0/964122713 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f00a00a0 con 0x7f31f0135f80 2023-10-03T10:14:11.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.975+0000 7f31e67fc700 1 -- 172.21.15.146:0/964122713 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f31e8014480 con 0x7f31f0135f80 2023-10-03T10:14:11.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.975+0000 7f31e67fc700 1 -- 172.21.15.146:0/964122713 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f31e8040230 con 0x7f31f0135f80 2023-10-03T10:14:11.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.978+0000 7f31f7b6c700 1 -- 172.21.15.146:0/964122713 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f0072480 con 0x7f31f0135f80 2023-10-03T10:14:11.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:11.983+0000 7f31e67fc700 1 -- 172.21.15.146:0/964122713 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f31f0072480 con 0x7f31f0135f80 2023-10-03T10:14:12.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.000+0000 7f833f88b700 1 Processor -- start 2023-10-03T10:14:12.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.000+0000 7f833f88b700 1 -- start start 2023-10-03T10:14:12.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.000+0000 7f833f88b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8338138040 0x7f8338138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.000+0000 7f833f88b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f83380a1400 0x7f833813fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.000+0000 7f833f88b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83381379e0 con 0x7f83380a08e0 2023-10-03T10:14:12.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.000+0000 7f833f88b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83380a2100 con 0x7f83380a1400 2023-10-03T10:14:12.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.000+0000 7f833f88b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8338138950 con 0x7f8338138040 2023-10-03T10:14:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.001+0000 7f833ce26700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f83380a08e0 0x7f83380a0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40068/0 (socket says 172.21.15.146:40068) 2023-10-03T10:14:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.001+0000 7f833ce26700 1 -- 172.21.15.146:0/1768102838 learned_addr learned my addr 172.21.15.146:0/1768102838 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.001+0000 7f833de28700 1 --2- 172.21.15.146:0/1768102838 >> v2:172.21.15.146:3300/0 conn(0x7f83380a1400 0x7f833813fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.001+0000 7f833d627700 1 --2- 172.21.15.146:0/1768102838 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8338138040 0x7f8338138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.001+0000 7f833de28700 1 -- 172.21.15.146:0/1768102838 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8338138040 msgr2=0x7f8338138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.001+0000 7f833de28700 1 --2- 172.21.15.146:0/1768102838 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8338138040 0x7f8338138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.001+0000 7f833de28700 1 -- 172.21.15.146:0/1768102838 >> v1:172.21.15.146:6789/0 conn(0x7f83380a08e0 legacy=0x7f83380a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.001+0000 7f833de28700 1 -- 172.21.15.146:0/1768102838 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833809b9b0 con 0x7f83380a1400 2023-10-03T10:14:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.001+0000 7f833de28700 1 --2- 172.21.15.146:0/1768102838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83380a1400 0x7f833813fd20 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8330009dc0 tx=0x7f833000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0867860767b41b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.001+0000 7f832ffff700 1 -- 172.21.15.146:0/1768102838 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833000e070 con 0x7f83380a1400 2023-10-03T10:14:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.001+0000 7f832ffff700 1 -- 172.21.15.146:0/1768102838 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833000bae0 con 0x7f83380a1400 2023-10-03T10:14:12.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.001+0000 7f832ffff700 1 -- 172.21.15.146:0/1768102838 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833000be90 con 0x7f83380a1400 2023-10-03T10:14:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.002+0000 7f833f88b700 1 -- 172.21.15.146:0/1768102838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83380a1400 msgr2=0x7f833813fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.002+0000 7f833f88b700 1 --2- 172.21.15.146:0/1768102838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83380a1400 0x7f833813fd20 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8330009dc0 tx=0x7f833000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.002+0000 7f833f88b700 1 -- 172.21.15.146:0/1768102838 shutdown_connections 2023-10-03T10:14:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.002+0000 7f833f88b700 1 --2- 172.21.15.146:0/1768102838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83380a1400 0x7f833813fd20 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.002+0000 7f833f88b700 1 --2- 172.21.15.146:0/1768102838 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8338138040 0x7f8338138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.002+0000 7f833f88b700 1 -- 172.21.15.146:0/1768102838 >> 172.21.15.146:0/1768102838 conn(0x7f83380a2980 msgr2=0x7f83380a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.002+0000 7f833f88b700 1 -- 172.21.15.146:0/1768102838 shutdown_connections 2023-10-03T10:14:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.002+0000 7f833f88b700 1 -- 172.21.15.146:0/1768102838 wait complete. 2023-10-03T10:14:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.003+0000 7f833f88b700 1 Processor -- start 2023-10-03T10:14:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.003+0000 7f833f88b700 1 -- start start 2023-10-03T10:14:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.004+0000 7f833f88b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83380a08e0 0x7f833813e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.004+0000 7f833f88b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83380a1400 0x7f83381359c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.004+0000 7f833f88b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8338138040 0x7f8338135f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.004+0000 7f833f88b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83381195a0 con 0x7f83380a08e0 2023-10-03T10:14:12.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.004+0000 7f833f88b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8338119150 con 0x7f83380a1400 2023-10-03T10:14:12.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.004+0000 7f833f88b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8338132220 con 0x7f8338138040 2023-10-03T10:14:12.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.004+0000 7f833de28700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8338138040 0x7f8338135f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.004+0000 7f833de28700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8338138040 0x7f8338135f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:52940/0 (socket says 172.21.15.146:52940) 2023-10-03T10:14:12.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.004+0000 7f833de28700 1 -- 172.21.15.146:0/3775433996 learned_addr learned my addr 172.21.15.146:0/3775433996 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:12.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.004+0000 7f833de28700 1 -- 172.21.15.146:0/3775433996 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83380a1400 msgr2=0x7f83381359c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.004+0000 7f833de28700 1 --2- 172.21.15.146:0/3775433996 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83380a1400 0x7f83381359c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.004+0000 7f833de28700 1 -- 172.21.15.146:0/3775433996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83380a08e0 msgr2=0x7f833813e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.004+0000 7f833de28700 1 --2- 172.21.15.146:0/3775433996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83380a08e0 0x7f833813e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.004+0000 7f833de28700 1 -- 172.21.15.146:0/3775433996 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8330009a70 con 0x7f8338138040 2023-10-03T10:14:12.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.004+0000 7f833de28700 1 --2- 172.21.15.146:0/3775433996 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8338138040 0x7f8338135f00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f833000b680 tx=0x7f8330004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.005+0000 7f832dffb700 1 -- 172.21.15.146:0/3775433996 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8330027680 con 0x7f8338138040 2023-10-03T10:14:12.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.005+0000 7f832dffb700 1 -- 172.21.15.146:0/3775433996 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8330020070 con 0x7f8338138040 2023-10-03T10:14:12.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.005+0000 7f832dffb700 1 -- 172.21.15.146:0/3775433996 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8330027a40 con 0x7f8338138040 2023-10-03T10:14:12.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.005+0000 7f833f88b700 1 -- 172.21.15.146:0/3775433996 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83381404f0 con 0x7f8338138040 2023-10-03T10:14:12.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.005+0000 7f833f88b700 1 -- 172.21.15.146:0/3775433996 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8338140a60 con 0x7f8338138040 2023-10-03T10:14:12.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.006+0000 7f832dffb700 1 -- 172.21.15.146:0/3775433996 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f833001b400 con 0x7f8338138040 2023-10-03T10:14:12.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.006+0000 7f833f88b700 1 -- 172.21.15.146:0/3775433996 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8338118fb0 con 0x7f8338138040 2023-10-03T10:14:12.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.006+0000 7f832dffb700 1 -- 172.21.15.146:0/3775433996 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8330022070 con 0x7f8338138040 2023-10-03T10:14:12.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.015+0000 7f832dffb700 1 -- 172.21.15.146:0/3775433996 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8338118fb0 con 0x7f8338138040 2023-10-03T10:14:12.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.046+0000 7fdebff37700 1 Processor -- start 2023-10-03T10:14:12.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.047+0000 7fdebff37700 1 -- start start 2023-10-03T10:14:12.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.047+0000 7fdebff37700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb80a0a70 0x7fdeb80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.047+0000 7fdebff37700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdeb80a1380 0x7fdeb8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.047+0000 7fdebff37700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb809dc00 con 0x7fdeb8133f50 2023-10-03T10:14:12.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.047+0000 7fdebff37700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb809ea60 con 0x7fdeb80a1380 2023-10-03T10:14:12.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.047+0000 7fdebff37700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb809dec0 con 0x7fdeb80a0a70 2023-10-03T10:14:12.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.047+0000 7fdebdcd3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb80a0a70 0x7fdeb80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.048+0000 7fdebdcd3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb80a0a70 0x7fdeb80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:52956/0 (socket says 172.21.15.146:52956) 2023-10-03T10:14:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.048+0000 7fdebdcd3700 1 -- 172.21.15.146:0/2067217156 learned_addr learned my addr 172.21.15.146:0/2067217156 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.048+0000 7fdebd4d2700 1 --2- 172.21.15.146:0/2067217156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdeb80a1380 0x7fdeb8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.048+0000 7fdebdcd3700 1 -- 172.21.15.146:0/2067217156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdeb80a1380 msgr2=0x7fdeb8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.048+0000 7fdebdcd3700 1 --2- 172.21.15.146:0/2067217156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdeb80a1380 0x7fdeb8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.048+0000 7fdebdcd3700 1 -- 172.21.15.146:0/2067217156 >> v1:172.21.15.146:6789/0 conn(0x7fdeb8133f50 legacy=0x7fdeb813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.048+0000 7fdebdcd3700 1 -- 172.21.15.146:0/2067217156 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb809e6a0 con 0x7fdeb80a0a70 2023-10-03T10:14:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.048+0000 7fdebdcd3700 1 --2- 172.21.15.146:0/2067217156 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb80a0a70 0x7fdeb80a0e40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009920 tx=0x7fdeb4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e20a62c4a78ed44c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.048+0000 7fdebccd1700 1 -- 172.21.15.146:0/2067217156 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4011830 con 0x7fdeb80a0a70 2023-10-03T10:14:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.048+0000 7fdebccd1700 1 -- 172.21.15.146:0/2067217156 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb4011990 con 0x7fdeb80a0a70 2023-10-03T10:14:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.048+0000 7fdebccd1700 1 -- 172.21.15.146:0/2067217156 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4011d20 con 0x7fdeb80a0a70 2023-10-03T10:14:12.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.049+0000 7fdebff37700 1 -- 172.21.15.146:0/2067217156 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb80a0a70 msgr2=0x7fdeb80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.049+0000 7fdebff37700 1 --2- 172.21.15.146:0/2067217156 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb80a0a70 0x7fdeb80a0e40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009920 tx=0x7fdeb4009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:12.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.049+0000 7fdebff37700 1 -- 172.21.15.146:0/2067217156 shutdown_connections 2023-10-03T10:14:12.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.049+0000 7fdebff37700 1 --2- 172.21.15.146:0/2067217156 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb80a0a70 0x7fdeb80a0e40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.049+0000 7fdebff37700 1 --2- 172.21.15.146:0/2067217156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdeb80a1380 0x7fdeb8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.049+0000 7fdebff37700 1 -- 172.21.15.146:0/2067217156 >> 172.21.15.146:0/2067217156 conn(0x7fdeb80a6610 msgr2=0x7fdeb80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.049+0000 7fdebff37700 1 -- 172.21.15.146:0/2067217156 shutdown_connections 2023-10-03T10:14:12.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.049+0000 7fdebff37700 1 -- 172.21.15.146:0/2067217156 wait complete. 2023-10-03T10:14:12.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.050+0000 7f606cda3700 1 Processor -- start 2023-10-03T10:14:12.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.051+0000 7fdebff37700 1 Processor -- start 2023-10-03T10:14:12.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.050+0000 7f606cda3700 1 -- start start 2023-10-03T10:14:12.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.050+0000 7f606cda3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f60680a0a30 0x7f60680a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.050+0000 7f606cda3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6068130670 0x7f60681381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.051+0000 7f606cda3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60680a1e70 con 0x7f60680a1340 2023-10-03T10:14:12.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.051+0000 7f606cda3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f606809a720 con 0x7f60680a0a30 2023-10-03T10:14:12.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.051+0000 7f606cda3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f606809b300 con 0x7f6068130670 2023-10-03T10:14:12.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.051+0000 7fdebff37700 1 -- start start 2023-10-03T10:14:12.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.051+0000 7f606659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f60680a0a30 0x7f60680a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.051+0000 7f606659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f60680a0a30 0x7f60680a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49552/0 (socket says 172.21.15.146:49552) 2023-10-03T10:14:12.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.051+0000 7f6065d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f60680a1340 0x7f606812ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40080/0 (socket says 172.21.15.146:40080) 2023-10-03T10:14:12.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.051+0000 7f606659c700 1 -- 172.21.15.146:0/3857539667 learned_addr learned my addr 172.21.15.146:0/3857539667 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:12.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.051+0000 7f606659c700 1 -- 172.21.15.146:0/3857539667 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6068130670 msgr2=0x7f60681381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:12.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.051+0000 7f606659c700 1 --2- 172.21.15.146:0/3857539667 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6068130670 0x7f60681381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.051+0000 7f606659c700 1 -- 172.21.15.146:0/3857539667 >> v1:172.21.15.146:6789/0 conn(0x7f60680a1340 legacy=0x7f606812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.051+0000 7f606659c700 1 -- 172.21.15.146:0/3857539667 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606809abc0 con 0x7f60680a0a30 2023-10-03T10:14:12.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.051+0000 7f606659c700 1 --2- 172.21.15.146:0/3857539667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60680a0a30 0x7f60680a0e00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6058006fd0 tx=0x7f605800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14fbfb3b0299b2a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.051+0000 7fdebff37700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdeb80a0a70 0x7fdeb811e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.051+0000 7fdebff37700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdeb80a1380 0x7fdeb811ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.051+0000 7fdebff37700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb8133f50 0x7fdeb811f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.051+0000 7fdebff37700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb81331c0 con 0x7fdeb80a0a70 2023-10-03T10:14:12.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.051+0000 7fdebff37700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb80a03e0 con 0x7fdeb80a1380 2023-10-03T10:14:12.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.051+0000 7fdebff37700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb81209f0 con 0x7fdeb8133f50 2023-10-03T10:14:12.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.052+0000 7fdebdcd3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdeb80a0a70 0x7fdeb811e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.052+0000 7fdebdcd3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdeb80a0a70 0x7fdeb811e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49554/0 (socket says 172.21.15.146:49554) 2023-10-03T10:14:12.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.052+0000 7fdebdcd3700 1 -- 172.21.15.146:0/1348632093 learned_addr learned my addr 172.21.15.146:0/1348632093 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:12.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.052+0000 7f606559a700 1 -- 172.21.15.146:0/3857539667 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058005e30 con 0x7f60680a0a30 2023-10-03T10:14:12.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.052+0000 7f606559a700 1 -- 172.21.15.146:0/3857539667 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6058004030 con 0x7f60680a0a30 2023-10-03T10:14:12.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.052+0000 7f606559a700 1 -- 172.21.15.146:0/3857539667 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60580043e0 con 0x7f60680a0a30 2023-10-03T10:14:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.052+0000 7fdebe4d4700 1 --2- 172.21.15.146:0/1348632093 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb8133f50 0x7fdeb811f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.052+0000 7fdebdcd3700 1 -- 172.21.15.146:0/1348632093 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb8133f50 msgr2=0x7fdeb811f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.052+0000 7fdebdcd3700 1 --2- 172.21.15.146:0/1348632093 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb8133f50 0x7fdeb811f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.052+0000 7fdebdcd3700 1 -- 172.21.15.146:0/1348632093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdeb80a1380 msgr2=0x7fdeb811ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.052+0000 7fdebdcd3700 1 --2- 172.21.15.146:0/1348632093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdeb80a1380 0x7fdeb811ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.052+0000 7fdebdcd3700 1 -- 172.21.15.146:0/1348632093 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb4009550 con 0x7fdeb80a0a70 2023-10-03T10:14:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.052+0000 7fdebdcd3700 1 --2- 172.21.15.146:0/1348632093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdeb80a0a70 0x7fdeb811e8c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdeb809e000 tx=0x7fdeb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.053+0000 7f606cda3700 1 -- 172.21.15.146:0/3857539667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60680a0a30 msgr2=0x7f60680a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.053+0000 7f606cda3700 1 --2- 172.21.15.146:0/3857539667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60680a0a30 0x7f60680a0e00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6058006fd0 tx=0x7f605800be70 comp rx=0 tx=0).stop 2023-10-03T10:14:12.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.053+0000 7fdeae7fc700 1 -- 172.21.15.146:0/1348632093 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4004510 con 0x7fdeb80a0a70 2023-10-03T10:14:12.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.053+0000 7fdeae7fc700 1 -- 172.21.15.146:0/1348632093 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb40036a0 con 0x7fdeb80a0a70 2023-10-03T10:14:12.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.053+0000 7fdebff37700 1 -- 172.21.15.146:0/1348632093 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb8133940 con 0x7fdeb80a0a70 2023-10-03T10:14:12.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.053+0000 7f606cda3700 1 -- 172.21.15.146:0/3857539667 shutdown_connections 2023-10-03T10:14:12.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.053+0000 7f606cda3700 1 --2- 172.21.15.146:0/3857539667 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6068130670 0x7f60681381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.053+0000 7f606cda3700 1 --2- 172.21.15.146:0/3857539667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60680a0a30 0x7f60680a0e00 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.053+0000 7f606cda3700 1 -- 172.21.15.146:0/3857539667 >> 172.21.15.146:0/3857539667 conn(0x7f60680a2980 msgr2=0x7f60680a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.053+0000 7fdeae7fc700 1 -- 172.21.15.146:0/1348632093 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4003a30 con 0x7fdeb80a0a70 2023-10-03T10:14:12.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.053+0000 7fdebff37700 1 -- 172.21.15.146:0/1348632093 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb8122a50 con 0x7fdeb80a0a70 2023-10-03T10:14:12.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.054+0000 7f606cda3700 1 -- 172.21.15.146:0/3857539667 shutdown_connections 2023-10-03T10:14:12.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.054+0000 7fdebff37700 1 -- 172.21.15.146:0/1348632093 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb8122be0 con 0x7fdeb80a0a70 2023-10-03T10:14:12.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.054+0000 7f606cda3700 1 -- 172.21.15.146:0/3857539667 wait complete. 2023-10-03T10:14:12.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.054+0000 7fdeae7fc700 1 -- 172.21.15.146:0/1348632093 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdeb4003b90 con 0x7fdeb80a0a70 2023-10-03T10:14:12.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.054+0000 7fdeae7fc700 1 -- 172.21.15.146:0/1348632093 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdeb4021030 con 0x7fdeb80a0a70 2023-10-03T10:14:12.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.055+0000 7f606cda3700 1 Processor -- start 2023-10-03T10:14:12.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.055+0000 7f606cda3700 1 -- start start 2023-10-03T10:14:12.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.056+0000 7f606cda3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60680a0a30 0x7f60681c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.056+0000 7f606cda3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60680a1340 0x7f60681c4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.056+0000 7f606cda3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6068130670 0x7f60681c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.056+0000 7f606cda3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606812e8d0 con 0x7f60680a1340 2023-10-03T10:14:12.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.056+0000 7f606cda3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606811bcd0 con 0x7f6068130670 2023-10-03T10:14:12.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.056+0000 7f606cda3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f606809fd00 con 0x7f60680a0a30 2023-10-03T10:14:12.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.056+0000 7f606659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60680a0a30 0x7f60681c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.056+0000 7f606659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60680a0a30 0x7f60681c3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:52986/0 (socket says 172.21.15.146:52986) 2023-10-03T10:14:12.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.056+0000 7f606659c700 1 -- 172.21.15.146:0/3144732637 learned_addr learned my addr 172.21.15.146:0/3144732637 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:12.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.056+0000 7f6066d9d700 1 --2- 172.21.15.146:0/3144732637 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6068130670 0x7f60681c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.056+0000 7f606659c700 1 -- 172.21.15.146:0/3144732637 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6068130670 msgr2=0x7f60681c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.056+0000 7f606659c700 1 --2- 172.21.15.146:0/3144732637 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6068130670 0x7f60681c4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.056+0000 7f606659c700 1 -- 172.21.15.146:0/3144732637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60680a1340 msgr2=0x7f60681c4410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:12.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.056+0000 7f606659c700 1 --2- 172.21.15.146:0/3144732637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60680a1340 0x7f60681c4410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.056+0000 7f606659c700 1 -- 172.21.15.146:0/3144732637 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605800b7a0 con 0x7f60680a0a30 2023-10-03T10:14:12.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.057+0000 7f606659c700 1 --2- 172.21.15.146:0/3144732637 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60680a0a30 0x7f60681c3ed0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f60680a2000 tx=0x7f6058004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.057+0000 7f6056ffd700 1 -- 172.21.15.146:0/3144732637 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058003c30 con 0x7f60680a0a30 2023-10-03T10:14:12.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.057+0000 7f6056ffd700 1 -- 172.21.15.146:0/3144732637 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6058003db0 con 0x7f60680a0a30 2023-10-03T10:14:12.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.057+0000 7f606cda3700 1 -- 172.21.15.146:0/3144732637 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f606809ae00 con 0x7f60680a0a30 2023-10-03T10:14:12.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.057+0000 7f6056ffd700 1 -- 172.21.15.146:0/3144732637 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60580106b0 con 0x7f60680a0a30 2023-10-03T10:14:12.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.057+0000 7f606cda3700 1 -- 172.21.15.146:0/3144732637 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606811c7c0 con 0x7f60680a0a30 2023-10-03T10:14:12.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.058+0000 7f606cda3700 1 -- 172.21.15.146:0/3144732637 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606811d420 con 0x7f60680a0a30 2023-10-03T10:14:12.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.058+0000 7f6056ffd700 1 -- 172.21.15.146:0/3144732637 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6058024400 con 0x7f60680a0a30 2023-10-03T10:14:12.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.058+0000 7f6056ffd700 1 -- 172.21.15.146:0/3144732637 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f60580432b0 con 0x7f60680a0a30 2023-10-03T10:14:12.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.060+0000 7fdeae7fc700 1 -- 172.21.15.146:0/1348632093 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdeb8122be0 con 0x7fdeb80a0a70 2023-10-03T10:14:12.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.063+0000 7f6056ffd700 1 -- 172.21.15.146:0/3144732637 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f606811d420 con 0x7f60680a0a30 2023-10-03T10:14:12.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.182+0000 7f31f7b6c700 1 -- 172.21.15.146:0/964122713 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f31f0072480 con 0x7f31f0135f80 2023-10-03T10:14:12.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.183+0000 7f31e67fc700 1 -- 172.21.15.146:0/964122713 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f31f0072480 con 0x7f31f0135f80 2023-10-03T10:14:12.184 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.186+0000 7f31f7b6c700 1 -- 172.21.15.146:0/964122713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31f0135f80 msgr2=0x7f31f013a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.186+0000 7f31f7b6c700 1 --2- 172.21.15.146:0/964122713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31f0135f80 0x7f31f013a330 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f31f009ae20 tx=0x7f31e800ef90 comp rx=0 tx=0).stop 2023-10-03T10:14:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.186+0000 7f31f7b6c700 1 -- 172.21.15.146:0/964122713 shutdown_connections 2023-10-03T10:14:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.186+0000 7f31f7b6c700 1 --2- 172.21.15.146:0/964122713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31f0135f80 0x7f31f013a330 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.186+0000 7f31f7b6c700 1 --2- 172.21.15.146:0/964122713 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31f0099e20 0x7f31f01398b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.186+0000 7f31f7b6c700 1 --2- 172.21.15.146:0/964122713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31f0133660 0x7f31f0139df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.186+0000 7f31f7b6c700 1 -- 172.21.15.146:0/964122713 >> 172.21.15.146:0/964122713 conn(0x7f31f00a2980 msgr2=0x7f31f0133a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.186+0000 7f31f7b6c700 1 -- 172.21.15.146:0/964122713 shutdown_connections 2023-10-03T10:14:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.186+0000 7f31f7b6c700 1 -- 172.21.15.146:0/964122713 wait complete. 2023-10-03T10:14:12.199 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:12.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.213+0000 7f833f88b700 1 -- 172.21.15.146:0/3775433996 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8338118fb0 con 0x7f8338138040 2023-10-03T10:14:12.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.213+0000 7f832dffb700 1 -- 172.21.15.146:0/3775433996 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8338118fb0 con 0x7f8338138040 2023-10-03T10:14:12.214 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:12.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.215+0000 7f833f88b700 1 -- 172.21.15.146:0/3775433996 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8338138040 msgr2=0x7f8338135f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.215+0000 7f833f88b700 1 --2- 172.21.15.146:0/3775433996 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8338138040 0x7f8338135f00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f833000b680 tx=0x7f8330004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.215+0000 7f833f88b700 1 -- 172.21.15.146:0/3775433996 shutdown_connections 2023-10-03T10:14:12.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.215+0000 7f833f88b700 1 --2- 172.21.15.146:0/3775433996 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8338138040 0x7f8338135f00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.215+0000 7f833f88b700 1 --2- 172.21.15.146:0/3775433996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83380a08e0 0x7f833813e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.215+0000 7f833f88b700 1 --2- 172.21.15.146:0/3775433996 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83380a1400 0x7f83381359c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.215+0000 7f833f88b700 1 -- 172.21.15.146:0/3775433996 >> 172.21.15.146:0/3775433996 conn(0x7f83380a2980 msgr2=0x7f833809f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.216+0000 7f833f88b700 1 -- 172.21.15.146:0/3775433996 shutdown_connections 2023-10-03T10:14:12.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.216+0000 7f833f88b700 1 -- 172.21.15.146:0/3775433996 wait complete. 2023-10-03T10:14:12.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:12.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.281+0000 7fdebff37700 1 -- 172.21.15.146:0/1348632093 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdeb8122be0 con 0x7fdeb80a0a70 2023-10-03T10:14:12.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.281+0000 7fdeae7fc700 1 -- 172.21.15.146:0/1348632093 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdeb8122be0 con 0x7fdeb80a0a70 2023-10-03T10:14:12.282 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:12.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.283+0000 7fdebff37700 1 -- 172.21.15.146:0/1348632093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdeb80a0a70 msgr2=0x7fdeb811e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.283+0000 7fdebff37700 1 --2- 172.21.15.146:0/1348632093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdeb80a0a70 0x7fdeb811e8c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdeb809e000 tx=0x7fdeb4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:12.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.284+0000 7fdebff37700 1 -- 172.21.15.146:0/1348632093 shutdown_connections 2023-10-03T10:14:12.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.284+0000 7fdebff37700 1 --2- 172.21.15.146:0/1348632093 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdeb8133f50 0x7fdeb811f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.284+0000 7fdebff37700 1 --2- 172.21.15.146:0/1348632093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdeb80a0a70 0x7fdeb811e8c0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.284+0000 7fdebff37700 1 --2- 172.21.15.146:0/1348632093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdeb80a1380 0x7fdeb811ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.284+0000 7fdebff37700 1 -- 172.21.15.146:0/1348632093 >> 172.21.15.146:0/1348632093 conn(0x7fdeb80a6610 msgr2=0x7fdeb80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.284+0000 7fdebff37700 1 -- 172.21.15.146:0/1348632093 shutdown_connections 2023-10-03T10:14:12.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.284+0000 7fdebff37700 1 -- 172.21.15.146:0/1348632093 wait complete. 2023-10-03T10:14:12.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.286+0000 7f606cda3700 1 -- 172.21.15.146:0/3144732637 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f606811d420 con 0x7f60680a0a30 2023-10-03T10:14:12.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.286+0000 7f6056ffd700 1 -- 172.21.15.146:0/3144732637 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f606811d420 con 0x7f60680a0a30 2023-10-03T10:14:12.287 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:12.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.288+0000 7f606cda3700 1 -- 172.21.15.146:0/3144732637 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60680a0a30 msgr2=0x7f60681c3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.288+0000 7f606cda3700 1 --2- 172.21.15.146:0/3144732637 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60680a0a30 0x7f60681c3ed0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f60680a2000 tx=0x7f6058004750 comp rx=0 tx=0).stop 2023-10-03T10:14:12.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.288+0000 7f606cda3700 1 -- 172.21.15.146:0/3144732637 shutdown_connections 2023-10-03T10:14:12.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.288+0000 7f606cda3700 1 --2- 172.21.15.146:0/3144732637 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6068130670 0x7f60681c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.288+0000 7f606cda3700 1 --2- 172.21.15.146:0/3144732637 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60680a0a30 0x7f60681c3ed0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.288+0000 7f606cda3700 1 --2- 172.21.15.146:0/3144732637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60680a1340 0x7f60681c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.288+0000 7f606cda3700 1 -- 172.21.15.146:0/3144732637 >> 172.21.15.146:0/3144732637 conn(0x7f60680a2980 msgr2=0x7f60681b7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.288+0000 7f606cda3700 1 -- 172.21.15.146:0/3144732637 shutdown_connections 2023-10-03T10:14:12.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:12.288+0000 7f606cda3700 1 -- 172.21.15.146:0/3144732637 wait complete. 2023-10-03T10:14:12.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:12.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:13.200 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:13.229 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:13.298 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:13.302 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:13.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.340+0000 7f3c7da48700 1 Processor -- start 2023-10-03T10:14:13.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.340+0000 7f3c7da48700 1 -- start start 2023-10-03T10:14:13.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.341+0000 7f3c7da48700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3c78131a80 0x7f3c78131e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.341+0000 7f3c7da48700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c7809c7d0 0x7f3c78139780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.341+0000 7f3c7da48700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c780a23a0 con 0x7f3c7809bc70 2023-10-03T10:14:13.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.341+0000 7f3c7da48700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c78131440 con 0x7f3c78131a80 2023-10-03T10:14:13.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.341+0000 7f3c7da48700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78132390 con 0x7f3c7809c7d0 2023-10-03T10:14:13.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.341+0000 7f3c777fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c7809c7d0 0x7f3c78139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.341+0000 7f3c767fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3c7809bc70 0x7f3c7809c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40082/0 (socket says 172.21.15.146:40082) 2023-10-03T10:14:13.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.341+0000 7f3c767fc700 1 -- 172.21.15.146:0/2955364881 learned_addr learned my addr 172.21.15.146:0/2955364881 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:13.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.342+0000 7f3c76ffd700 1 --2- 172.21.15.146:0/2955364881 >> v2:172.21.15.146:3300/0 conn(0x7f3c78131a80 0x7f3c78131e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.342+0000 7f3c777fe700 1 -- 172.21.15.146:0/2955364881 >> v2:172.21.15.146:3300/0 conn(0x7f3c78131a80 msgr2=0x7f3c78131e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:13.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.342+0000 7f3c777fe700 1 --2- 172.21.15.146:0/2955364881 >> v2:172.21.15.146:3300/0 conn(0x7f3c78131a80 0x7f3c78131e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.342+0000 7f3c777fe700 1 -- 172.21.15.146:0/2955364881 >> v1:172.21.15.146:6789/0 conn(0x7f3c7809bc70 legacy=0x7f3c7809c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.342+0000 7f3c777fe700 1 -- 172.21.15.146:0/2955364881 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7806eaa0 con 0x7f3c7809c7d0 2023-10-03T10:14:13.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.342+0000 7f3c777fe700 1 --2- 172.21.15.146:0/2955364881 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c7809c7d0 0x7f3c78139780 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009d90 tx=0x7f3c7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=688f587513b52451 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.342+0000 7f3c75ffb700 1 -- 172.21.15.146:0/2955364881 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7000e070 con 0x7f3c7809c7d0 2023-10-03T10:14:13.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.342+0000 7f3c75ffb700 1 -- 172.21.15.146:0/2955364881 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7000bb20 con 0x7f3c7809c7d0 2023-10-03T10:14:13.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.342+0000 7f3c75ffb700 1 -- 172.21.15.146:0/2955364881 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c70012430 con 0x7f3c7809c7d0 2023-10-03T10:14:13.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.343+0000 7f3c7da48700 1 -- 172.21.15.146:0/2955364881 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c7809c7d0 msgr2=0x7f3c78139780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.343+0000 7f3c7da48700 1 --2- 172.21.15.146:0/2955364881 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c7809c7d0 0x7f3c78139780 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009d90 tx=0x7f3c7000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:13.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.343+0000 7f3c7da48700 1 -- 172.21.15.146:0/2955364881 shutdown_connections 2023-10-03T10:14:13.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.343+0000 7f3c7da48700 1 --2- 172.21.15.146:0/2955364881 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c7809c7d0 0x7f3c78139780 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.343+0000 7f3c7da48700 1 --2- 172.21.15.146:0/2955364881 >> v2:172.21.15.146:3300/0 conn(0x7f3c78131a80 0x7f3c78131e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.343+0000 7f3c7da48700 1 -- 172.21.15.146:0/2955364881 >> 172.21.15.146:0/2955364881 conn(0x7f3c780a2980 msgr2=0x7f3c780a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.343+0000 7f3c7da48700 1 -- 172.21.15.146:0/2955364881 shutdown_connections 2023-10-03T10:14:13.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.343+0000 7f3c7da48700 1 -- 172.21.15.146:0/2955364881 wait complete. 2023-10-03T10:14:13.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.344+0000 7f3c7da48700 1 Processor -- start 2023-10-03T10:14:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.345+0000 7f3c7da48700 1 -- start start 2023-10-03T10:14:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.345+0000 7f3c7da48700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c7809bc70 0x7f3c78128380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.345+0000 7f3c7da48700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c7809c7d0 0x7f3c781288c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.345+0000 7f3c7da48700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c78131a80 0x7f3c78128e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.345+0000 7f3c7da48700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7812ba50 con 0x7f3c78131a80 2023-10-03T10:14:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.345+0000 7f3c7da48700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78124d30 con 0x7f3c7809c7d0 2023-10-03T10:14:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.345+0000 7f3c7da48700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78129780 con 0x7f3c7809bc70 2023-10-03T10:14:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.345+0000 7f3c76ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c7809bc70 0x7f3c78128380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.345+0000 7f3c76ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c7809bc70 0x7f3c78128380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:52988/0 (socket says 172.21.15.146:52988) 2023-10-03T10:14:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.345+0000 7f3c76ffd700 1 -- 172.21.15.146:0/1241801969 learned_addr learned my addr 172.21.15.146:0/1241801969 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.345+0000 7f3c767fc700 1 --2- 172.21.15.146:0/1241801969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c7809c7d0 0x7f3c781288c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.345+0000 7f3c777fe700 1 --2- 172.21.15.146:0/1241801969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c78131a80 0x7f3c78128e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.346+0000 7f3c767fc700 1 -- 172.21.15.146:0/1241801969 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c7809bc70 msgr2=0x7f3c78128380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.346+0000 7f3c767fc700 1 --2- 172.21.15.146:0/1241801969 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c7809bc70 0x7f3c78128380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.346+0000 7f3c767fc700 1 -- 172.21.15.146:0/1241801969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c78131a80 msgr2=0x7f3c78128e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.346+0000 7f3c767fc700 1 --2- 172.21.15.146:0/1241801969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c78131a80 0x7f3c78128e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.346+0000 7f3c767fc700 1 -- 172.21.15.146:0/1241801969 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c70009a70 con 0x7f3c7809c7d0 2023-10-03T10:14:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.346+0000 7f3c76ffd700 1 --2- 172.21.15.146:0/1241801969 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c7809bc70 0x7f3c78128380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.346+0000 7f3c767fc700 1 --2- 172.21.15.146:0/1241801969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c7809c7d0 0x7f3c781288c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c00c3c0 tx=0x7f3c6c00c6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.346+0000 7f3c5ffff700 1 -- 172.21.15.146:0/1241801969 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c005b40 con 0x7f3c7809c7d0 2023-10-03T10:14:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.346+0000 7f3c5ffff700 1 -- 172.21.15.146:0/1241801969 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c005ca0 con 0x7f3c7809c7d0 2023-10-03T10:14:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.346+0000 7f3c7da48700 1 -- 172.21.15.146:0/1241801969 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c7813a850 con 0x7f3c7809c7d0 2023-10-03T10:14:13.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.346+0000 7f3c5ffff700 1 -- 172.21.15.146:0/1241801969 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c0072d0 con 0x7f3c7809c7d0 2023-10-03T10:14:13.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.346+0000 7f3c7da48700 1 -- 172.21.15.146:0/1241801969 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c7812a870 con 0x7f3c7809c7d0 2023-10-03T10:14:13.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.348+0000 7f3c7da48700 1 -- 172.21.15.146:0/1241801969 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c78130e50 con 0x7f3c7809c7d0 2023-10-03T10:14:13.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.348+0000 7f3c5ffff700 1 -- 172.21.15.146:0/1241801969 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3c6c007430 con 0x7f3c7809c7d0 2023-10-03T10:14:13.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.349+0000 7f3c5ffff700 1 -- 172.21.15.146:0/1241801969 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3c6c03ed90 con 0x7f3c7809c7d0 2023-10-03T10:14:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.357+0000 7f3c5ffff700 1 -- 172.21.15.146:0/1241801969 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3c6c0076e0 con 0x7f3c7809c7d0 2023-10-03T10:14:13.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.388+0000 7f4ba4984700 1 Processor -- start 2023-10-03T10:14:13.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.388+0000 7f4ba4984700 1 -- start start 2023-10-03T10:14:13.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.389+0000 7f4ba4984700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ba0133ad0 0x7f4ba0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.389+0000 7f4ba4984700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4ba01300a0 0x7f4ba01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.389+0000 7f4ba4984700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ba01309f0 0x7f4ba013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.389+0000 7f4ba4984700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba006b2d0 con 0x7f4ba01300a0 2023-10-03T10:14:13.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.389+0000 7f4ba4984700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba0133610 con 0x7f4ba01309f0 2023-10-03T10:14:13.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.389+0000 7f4ba4984700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba009a500 con 0x7f4ba0133ad0 2023-10-03T10:14:13.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.389+0000 7f4b9e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ba0133ad0 0x7f4ba0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.389+0000 7f4b9dd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4ba01300a0 0x7f4ba01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.389+0000 7f4b9e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ba0133ad0 0x7f4ba0133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:52996/0 (socket says 172.21.15.146:52996) 2023-10-03T10:14:13.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.389+0000 7f4b9dd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4ba01300a0 0x7f4ba01304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49578/0 (socket says 172.21.15.146:49578) 2023-10-03T10:14:13.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.389+0000 7f4b9e59c700 1 -- 172.21.15.146:0/317391983 learned_addr learned my addr 172.21.15.146:0/317391983 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:13.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.389+0000 7f4b9ed9d700 1 --2- 172.21.15.146:0/317391983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ba01309f0 0x7f4ba013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.390+0000 7f4b9dd9b700 1 -- 172.21.15.146:0/317391983 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ba0133ad0 msgr2=0x7f4ba0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:13.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.390+0000 7f4b9dd9b700 1 --2- 172.21.15.146:0/317391983 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ba0133ad0 0x7f4ba0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.390+0000 7f4b9dd9b700 1 -- 172.21.15.146:0/317391983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ba01309f0 msgr2=0x7f4ba013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:13.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.390+0000 7f4b9dd9b700 1 --2- 172.21.15.146:0/317391983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ba01309f0 0x7f4ba013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.390+0000 7f4b9dd9b700 1 -- 172.21.15.146:0/317391983 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba01338b0 con 0x7f4ba01300a0 2023-10-03T10:14:13.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.390+0000 7f4b9dd9b700 1 --2- 172.21.15.146:0/317391983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ba01300a0 0x7f4ba01304b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009840 tx=0x7f4b94009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c15bab39cd32707 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.390+0000 7f4b9d59a700 1 -- 172.21.15.146:0/317391983 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b94011830 con 0x7f4ba01300a0 2023-10-03T10:14:13.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.390+0000 7f4b9d59a700 1 -- 172.21.15.146:0/317391983 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b94011990 con 0x7f4ba01300a0 2023-10-03T10:14:13.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.390+0000 7f4b9d59a700 1 -- 172.21.15.146:0/317391983 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b94011d20 con 0x7f4ba01300a0 2023-10-03T10:14:13.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.391+0000 7f4ba4984700 1 -- 172.21.15.146:0/317391983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ba01300a0 msgr2=0x7f4ba01304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.391+0000 7f4ba4984700 1 --2- 172.21.15.146:0/317391983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ba01300a0 0x7f4ba01304b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009840 tx=0x7f4b94009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:13.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.391+0000 7f4ba4984700 1 -- 172.21.15.146:0/317391983 shutdown_connections 2023-10-03T10:14:13.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.391+0000 7f4ba4984700 1 --2- 172.21.15.146:0/317391983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ba01309f0 0x7f4ba013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.391+0000 7f4ba4984700 1 --2- 172.21.15.146:0/317391983 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ba0133ad0 0x7f4ba0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.391+0000 7f4ba4984700 1 --2- 172.21.15.146:0/317391983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ba01300a0 0x7f4ba01304b0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.391+0000 7f4ba4984700 1 -- 172.21.15.146:0/317391983 >> 172.21.15.146:0/317391983 conn(0x7f4ba0099c40 msgr2=0x7f4ba00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.391+0000 7f4ba4984700 1 -- 172.21.15.146:0/317391983 shutdown_connections 2023-10-03T10:14:13.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.391+0000 7f4ba4984700 1 -- 172.21.15.146:0/317391983 wait complete. 2023-10-03T10:14:13.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.392+0000 7f4ba4984700 1 Processor -- start 2023-10-03T10:14:13.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.392+0000 7f4ba4984700 1 -- start start 2023-10-03T10:14:13.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.392+0000 7f4ba4984700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ba01300a0 0x7f4ba0119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.393+0000 7f4ba4984700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ba01309f0 0x7f4ba0119b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.393+0000 7f4ba4984700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ba0133ad0 0x7f4ba011a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.393+0000 7f4ba4984700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba011b8f0 con 0x7f4ba01309f0 2023-10-03T10:14:13.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.393+0000 7f4ba4984700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba011b340 con 0x7f4ba0133ad0 2023-10-03T10:14:13.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.393+0000 7f4ba4984700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba00720f0 con 0x7f4ba01300a0 2023-10-03T10:14:13.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.393+0000 7f4b9e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ba01300a0 0x7f4ba0119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.393+0000 7f4b9e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ba01300a0 0x7f4ba0119630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53012/0 (socket says 172.21.15.146:53012) 2023-10-03T10:14:13.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.393+0000 7f4b9e59c700 1 -- 172.21.15.146:0/3064272212 learned_addr learned my addr 172.21.15.146:0/3064272212 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:13.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.393+0000 7f4b9ed9d700 1 --2- 172.21.15.146:0/3064272212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ba0133ad0 0x7f4ba011a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.393+0000 7f4b9dd9b700 1 --2- 172.21.15.146:0/3064272212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ba01309f0 0x7f4ba0119b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.393+0000 7f4b9e59c700 1 -- 172.21.15.146:0/3064272212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ba0133ad0 msgr2=0x7f4ba011a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.393+0000 7f4b9e59c700 1 --2- 172.21.15.146:0/3064272212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ba0133ad0 0x7f4ba011a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.393+0000 7f4b9e59c700 1 -- 172.21.15.146:0/3064272212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ba01309f0 msgr2=0x7f4ba0119b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.393+0000 7f4b9e59c700 1 --2- 172.21.15.146:0/3064272212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ba01309f0 0x7f4ba0119b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.393+0000 7f4b9e59c700 1 -- 172.21.15.146:0/3064272212 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b940094a0 con 0x7f4ba01300a0 2023-10-03T10:14:13.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.393+0000 7f4b9dd9b700 1 --2- 172.21.15.146:0/3064272212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ba01309f0 0x7f4ba0119b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:13.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.393+0000 7f4b9e59c700 1 --2- 172.21.15.146:0/3064272212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ba01300a0 0x7f4ba0119630 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000e910 tx=0x7f4b9000ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.393+0000 7f4b8effd700 1 -- 172.21.15.146:0/3064272212 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b900096a0 con 0x7f4ba01300a0 2023-10-03T10:14:13.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.394+0000 7f4b8effd700 1 -- 172.21.15.146:0/3064272212 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9000ee60 con 0x7f4ba01300a0 2023-10-03T10:14:13.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.394+0000 7f4ba4984700 1 -- 172.21.15.146:0/3064272212 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba011b630 con 0x7f4ba01300a0 2023-10-03T10:14:13.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.394+0000 7f4ba4984700 1 -- 172.21.15.146:0/3064272212 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba012dd00 con 0x7f4ba01300a0 2023-10-03T10:14:13.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.394+0000 7f4b8effd700 1 -- 172.21.15.146:0/3064272212 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9000ca90 con 0x7f4ba01300a0 2023-10-03T10:14:13.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.395+0000 7f4b8effd700 1 -- 172.21.15.146:0/3064272212 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b9000cbf0 con 0x7f4ba01300a0 2023-10-03T10:14:13.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.395+0000 7f4b8effd700 1 -- 172.21.15.146:0/3064272212 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4b90012d90 con 0x7f4ba01300a0 2023-10-03T10:14:13.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.395+0000 7f4ba4984700 1 -- 172.21.15.146:0/3064272212 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b840052e0 con 0x7f4ba01300a0 2023-10-03T10:14:13.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.400+0000 7f4b8effd700 1 -- 172.21.15.146:0/3064272212 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b9003de60 con 0x7f4ba01300a0 2023-10-03T10:14:13.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.443+0000 7f1e000d7700 1 Processor -- start 2023-10-03T10:14:13.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.443+0000 7f1e000d7700 1 -- start start 2023-10-03T10:14:13.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.444+0000 7f1e000d7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df8133ad0 0x7f1df8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.444+0000 7f1e000d7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1df81300a0 0x7f1df81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.444+0000 7f1e000d7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df806b2d0 con 0x7f1df81309f0 2023-10-03T10:14:13.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.444+0000 7f1e000d7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df8133610 con 0x7f1df8133ad0 2023-10-03T10:14:13.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.444+0000 7f1e000d7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1df809a500 con 0x7f1df81300a0 2023-10-03T10:14:13.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.444+0000 7f1dfd672700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1df81300a0 0x7f1df81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.444+0000 7f1dfde73700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df8133ad0 0x7f1df8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.444+0000 7f1dfd672700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1df81300a0 0x7f1df81304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53024/0 (socket says 172.21.15.146:53024) 2023-10-03T10:14:13.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.444+0000 7f1dfde73700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df8133ad0 0x7f1df8133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56350/0 (socket says 172.21.15.146:56350) 2023-10-03T10:14:13.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.444+0000 7f1dfd672700 1 -- 172.21.15.146:0/885146200 learned_addr learned my addr 172.21.15.146:0/885146200 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:13.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.444+0000 7f1dfd672700 1 -- 172.21.15.146:0/885146200 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df8133ad0 msgr2=0x7f1df8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:13.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.444+0000 7f1dfd672700 1 --2- 172.21.15.146:0/885146200 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df8133ad0 0x7f1df8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.444+0000 7f1dfd672700 1 -- 172.21.15.146:0/885146200 >> v1:172.21.15.146:6789/0 conn(0x7f1df81309f0 legacy=0x7f1df813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.444+0000 7f1dfd672700 1 -- 172.21.15.146:0/885146200 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df81338b0 con 0x7f1df81300a0 2023-10-03T10:14:13.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.444+0000 7f1dfde73700 1 --2- 172.21.15.146:0/885146200 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df8133ad0 0x7f1df8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:13.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.445+0000 7f1dfd672700 1 --2- 172.21.15.146:0/885146200 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1df81300a0 0x7f1df81304b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1de8009920 tx=0x7f1de8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7f1df3351245733 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.445+0000 7f1dfce71700 1 -- 172.21.15.146:0/885146200 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de8011830 con 0x7f1df81300a0 2023-10-03T10:14:13.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.445+0000 7f1dfce71700 1 -- 172.21.15.146:0/885146200 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de8011990 con 0x7f1df81300a0 2023-10-03T10:14:13.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.445+0000 7f1dfce71700 1 -- 172.21.15.146:0/885146200 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de8011d20 con 0x7f1df81300a0 2023-10-03T10:14:13.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.446+0000 7f1e000d7700 1 -- 172.21.15.146:0/885146200 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1df81300a0 msgr2=0x7f1df81304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.446+0000 7f1e000d7700 1 --2- 172.21.15.146:0/885146200 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1df81300a0 0x7f1df81304b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1de8009920 tx=0x7f1de8009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:13.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.446+0000 7f1e000d7700 1 -- 172.21.15.146:0/885146200 shutdown_connections 2023-10-03T10:14:13.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.446+0000 7f1e000d7700 1 --2- 172.21.15.146:0/885146200 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df8133ad0 0x7f1df8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.446+0000 7f1e000d7700 1 --2- 172.21.15.146:0/885146200 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1df81300a0 0x7f1df81304b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.446+0000 7f1e000d7700 1 -- 172.21.15.146:0/885146200 >> 172.21.15.146:0/885146200 conn(0x7f1df8099c40 msgr2=0x7f1df80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.446+0000 7f1e000d7700 1 -- 172.21.15.146:0/885146200 shutdown_connections 2023-10-03T10:14:13.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.446+0000 7f1e000d7700 1 -- 172.21.15.146:0/885146200 wait complete. 2023-10-03T10:14:13.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.447+0000 7f1e000d7700 1 Processor -- start 2023-10-03T10:14:13.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.447+0000 7f1e000d7700 1 -- start start 2023-10-03T10:14:13.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.447+0000 7f1e000d7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1df81300a0 0x7f1df81c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.447+0000 7f1e000d7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df81309f0 0x7f1df81c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.447+0000 7f1e000d7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1df8133ad0 0x7f1df81c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.447+0000 7f1e000d7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df811f970 con 0x7f1df8133ad0 2023-10-03T10:14:13.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.447+0000 7f1e000d7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df80721a0 con 0x7f1df81309f0 2023-10-03T10:14:13.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.447+0000 7f1e000d7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1df8120220 con 0x7f1df81300a0 2023-10-03T10:14:13.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.447+0000 7f1dfd672700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df81309f0 0x7f1df81c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.447+0000 7f1dfd672700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df81309f0 0x7f1df81c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56366/0 (socket says 172.21.15.146:56366) 2023-10-03T10:14:13.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.447+0000 7f1dfd672700 1 -- 172.21.15.146:0/4000080673 learned_addr learned my addr 172.21.15.146:0/4000080673 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:13.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.448+0000 7f1dfe674700 1 --2- 172.21.15.146:0/4000080673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1df8133ad0 0x7f1df81c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.448+0000 7f1dfde73700 1 --2- 172.21.15.146:0/4000080673 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1df81300a0 0x7f1df81c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.448+0000 7f1dfd672700 1 -- 172.21.15.146:0/4000080673 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1df81300a0 msgr2=0x7f1df81c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.448+0000 7f1dfd672700 1 --2- 172.21.15.146:0/4000080673 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1df81300a0 0x7f1df81c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.448+0000 7f1dfd672700 1 -- 172.21.15.146:0/4000080673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1df8133ad0 msgr2=0x7f1df81c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.448+0000 7f1dfd672700 1 --2- 172.21.15.146:0/4000080673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1df8133ad0 0x7f1df81c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.448+0000 7f1dfd672700 1 -- 172.21.15.146:0/4000080673 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df40094a0 con 0x7f1df81309f0 2023-10-03T10:14:13.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.448+0000 7f1dfd672700 1 --2- 172.21.15.146:0/4000080673 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df81309f0 0x7f1df81c8c90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1de8000c00 tx=0x7f1de8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.448+0000 7f1dee7fc700 1 -- 172.21.15.146:0/4000080673 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de8004450 con 0x7f1df81309f0 2023-10-03T10:14:13.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.448+0000 7f1dee7fc700 1 -- 172.21.15.146:0/4000080673 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de801e070 con 0x7f1df81309f0 2023-10-03T10:14:13.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.448+0000 7f1e000d7700 1 -- 172.21.15.146:0/4000080673 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de8009550 con 0x7f1df81309f0 2023-10-03T10:14:13.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.448+0000 7f1dee7fc700 1 -- 172.21.15.146:0/4000080673 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de80038e0 con 0x7f1df81309f0 2023-10-03T10:14:13.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.448+0000 7f1e000d7700 1 -- 172.21.15.146:0/4000080673 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df812fd80 con 0x7f1df81309f0 2023-10-03T10:14:13.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.449+0000 7f1dee7fc700 1 -- 172.21.15.146:0/4000080673 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1de8003a40 con 0x7f1df81309f0 2023-10-03T10:14:13.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.450+0000 7f1e000d7700 1 -- 172.21.15.146:0/4000080673 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df812dd60 con 0x7f1df81309f0 2023-10-03T10:14:13.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.450+0000 7f1dee7fc700 1 -- 172.21.15.146:0/4000080673 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1de8040380 con 0x7f1df81309f0 2023-10-03T10:14:13.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.454+0000 7f1dee7fc700 1 -- 172.21.15.146:0/4000080673 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1de802d450 con 0x7f1df81309f0 2023-10-03T10:14:13.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.479+0000 7fc0f86c0700 1 Processor -- start 2023-10-03T10:14:13.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.479+0000 7fc0f86c0700 1 -- start start 2023-10-03T10:14:13.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.480+0000 7fc0f86c0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc0f00a0a70 0x7fc0f00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.480+0000 7fc0f86c0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0f0134120 0x7fc0f013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.480+0000 7fc0f86c0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f009dc00 con 0x7fc0f00a1380 2023-10-03T10:14:13.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.480+0000 7fc0f86c0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f009ea90 con 0x7fc0f00a0a70 2023-10-03T10:14:13.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.480+0000 7fc0f86c0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f009dec0 con 0x7fc0f0134120 2023-10-03T10:14:13.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.481+0000 7fc0f645c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc0f00a0a70 0x7fc0f00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.481+0000 7fc0f5c5b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc0f00a1380 0x7fc0f0133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40102/0 (socket says 172.21.15.146:40102) 2023-10-03T10:14:13.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.481+0000 7fc0f5c5b700 1 -- 172.21.15.146:0/1145052562 learned_addr learned my addr 172.21.15.146:0/1145052562 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:13.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.481+0000 7fc0f6c5d700 1 --2- 172.21.15.146:0/1145052562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0f0134120 0x7fc0f013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.481+0000 7fc0f645c700 1 -- 172.21.15.146:0/1145052562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0f0134120 msgr2=0x7fc0f013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:13.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.481+0000 7fc0f645c700 1 --2- 172.21.15.146:0/1145052562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0f0134120 0x7fc0f013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.481+0000 7fc0f645c700 1 -- 172.21.15.146:0/1145052562 >> v1:172.21.15.146:6789/0 conn(0x7fc0f00a1380 legacy=0x7fc0f0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.481+0000 7fc0f645c700 1 -- 172.21.15.146:0/1145052562 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f009e6a0 con 0x7fc0f00a0a70 2023-10-03T10:14:13.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.481+0000 7fc0f545a700 1 -- 172.21.15.146:0/1145052562 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878917117 0 0) 0x7fc0f009dc00 con 0x7fc0f00a1380 2023-10-03T10:14:13.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.481+0000 7fc0f645c700 1 --2- 172.21.15.146:0/1145052562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0f00a0a70 0x7fc0f00a0e40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec009840 tx=0x7fc0ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100841df5c18bb34 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.481+0000 7fc0f545a700 1 -- 172.21.15.146:0/1145052562 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec011830 con 0x7fc0f00a0a70 2023-10-03T10:14:13.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.481+0000 7fc0f545a700 1 -- 172.21.15.146:0/1145052562 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ec011990 con 0x7fc0f00a0a70 2023-10-03T10:14:13.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.481+0000 7fc0f545a700 1 -- 172.21.15.146:0/1145052562 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec011d20 con 0x7fc0f00a0a70 2023-10-03T10:14:13.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.482+0000 7fc0f86c0700 1 -- 172.21.15.146:0/1145052562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0f00a0a70 msgr2=0x7fc0f00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.482+0000 7fc0f86c0700 1 --2- 172.21.15.146:0/1145052562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0f00a0a70 0x7fc0f00a0e40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec009840 tx=0x7fc0ec009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:13.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.482+0000 7fc0f86c0700 1 -- 172.21.15.146:0/1145052562 shutdown_connections 2023-10-03T10:14:13.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.482+0000 7fc0f86c0700 1 --2- 172.21.15.146:0/1145052562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0f0134120 0x7fc0f013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.482+0000 7fc0f86c0700 1 --2- 172.21.15.146:0/1145052562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0f00a0a70 0x7fc0f00a0e40 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.482+0000 7fc0f86c0700 1 -- 172.21.15.146:0/1145052562 >> 172.21.15.146:0/1145052562 conn(0x7fc0f00a6610 msgr2=0x7fc0f00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.482+0000 7fc0f86c0700 1 -- 172.21.15.146:0/1145052562 shutdown_connections 2023-10-03T10:14:13.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.482+0000 7fc0f86c0700 1 -- 172.21.15.146:0/1145052562 wait complete. 2023-10-03T10:14:13.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.483+0000 7fc0f86c0700 1 Processor -- start 2023-10-03T10:14:13.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.484+0000 7fc0f86c0700 1 -- start start 2023-10-03T10:14:13.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.484+0000 7fc0f86c0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0f00a0a70 0x7fc0f0122850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.484+0000 7fc0f86c0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0f00a1380 0x7fc0f0122d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.484+0000 7fc0f86c0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0f0134120 0x7fc0f01232d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.484+0000 7fc0f86c0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f0126f20 con 0x7fc0f00a0a70 2023-10-03T10:14:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.484+0000 7fc0f86c0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f01262a0 con 0x7fc0f0134120 2023-10-03T10:14:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.484+0000 7fc0f86c0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f0124900 con 0x7fc0f00a1380 2023-10-03T10:14:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.484+0000 7fc0f6c5d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0f0134120 0x7fc0f01232d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.484+0000 7fc0f6c5d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0f0134120 0x7fc0f01232d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56394/0 (socket says 172.21.15.146:56394) 2023-10-03T10:14:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.484+0000 7fc0f6c5d700 1 -- 172.21.15.146:0/1087971758 learned_addr learned my addr 172.21.15.146:0/1087971758 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.484+0000 7fc0f645c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0f00a0a70 0x7fc0f0122850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.485+0000 7fc0f5c5b700 1 --2- 172.21.15.146:0/1087971758 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0f00a1380 0x7fc0f0122d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.485+0000 7fc0f6c5d700 1 -- 172.21.15.146:0/1087971758 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0f00a1380 msgr2=0x7fc0f0122d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.485+0000 7fc0f6c5d700 1 --2- 172.21.15.146:0/1087971758 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0f00a1380 0x7fc0f0122d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.485+0000 7fc0f6c5d700 1 -- 172.21.15.146:0/1087971758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0f00a0a70 msgr2=0x7fc0f0122850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.485+0000 7fc0f6c5d700 1 --2- 172.21.15.146:0/1087971758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0f00a0a70 0x7fc0f0122850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.485+0000 7fc0f6c5d700 1 -- 172.21.15.146:0/1087971758 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ec0094a0 con 0x7fc0f0134120 2023-10-03T10:14:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.485+0000 7fc0f6c5d700 1 --2- 172.21.15.146:0/1087971758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0f0134120 0x7fc0f01232d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8009dd0 tx=0x7fc0e800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.485+0000 7fc0e6ffd700 1 -- 172.21.15.146:0/1087971758 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8009c40 con 0x7fc0f0134120 2023-10-03T10:14:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.485+0000 7fc0f86c0700 1 -- 172.21.15.146:0/1087971758 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f0133aa0 con 0x7fc0f0134120 2023-10-03T10:14:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.485+0000 7fc0e6ffd700 1 -- 172.21.15.146:0/1087971758 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e800f040 con 0x7fc0f0134120 2023-10-03T10:14:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.485+0000 7fc0e6ffd700 1 -- 172.21.15.146:0/1087971758 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8014480 con 0x7fc0f0134120 2023-10-03T10:14:13.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.485+0000 7fc0f86c0700 1 -- 172.21.15.146:0/1087971758 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f00a0430 con 0x7fc0f0134120 2023-10-03T10:14:13.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.487+0000 7fc0e6ffd700 1 -- 172.21.15.146:0/1087971758 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc0e80145e0 con 0x7fc0f0134120 2023-10-03T10:14:13.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.487+0000 7fc0f86c0700 1 -- 172.21.15.146:0/1087971758 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f004f2a0 con 0x7fc0f0134120 2023-10-03T10:14:13.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.487+0000 7fc0e6ffd700 1 -- 172.21.15.146:0/1087971758 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc0e8014890 con 0x7fc0f0134120 2023-10-03T10:14:13.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.496+0000 7fc0e6ffd700 1 -- 172.21.15.146:0/1087971758 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc0e80076f0 con 0x7fc0f0134120 2023-10-03T10:14:13.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.592+0000 7f3c7da48700 1 -- 172.21.15.146:0/1241801969 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3c7804f2a0 con 0x7f3c7809c7d0 2023-10-03T10:14:13.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.593+0000 7f3c5ffff700 1 -- 172.21.15.146:0/1241801969 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3c6c0192c0 con 0x7f3c7809c7d0 2023-10-03T10:14:13.594 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:13.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.596+0000 7f3c7da48700 1 -- 172.21.15.146:0/1241801969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c7809c7d0 msgr2=0x7f3c781288c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.596+0000 7f3c7da48700 1 --2- 172.21.15.146:0/1241801969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c7809c7d0 0x7f3c781288c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c00c3c0 tx=0x7f3c6c00c6d0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.596+0000 7f3c7da48700 1 -- 172.21.15.146:0/1241801969 shutdown_connections 2023-10-03T10:14:13.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.596+0000 7f3c7da48700 1 --2- 172.21.15.146:0/1241801969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c78131a80 0x7f3c78128e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.596+0000 7f3c7da48700 1 --2- 172.21.15.146:0/1241801969 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c7809bc70 0x7f3c78128380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.596+0000 7f3c7da48700 1 --2- 172.21.15.146:0/1241801969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c7809c7d0 0x7f3c781288c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.596+0000 7f3c7da48700 1 -- 172.21.15.146:0/1241801969 >> 172.21.15.146:0/1241801969 conn(0x7f3c780a2980 msgr2=0x7f3c78127040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.596+0000 7f3c7da48700 1 -- 172.21.15.146:0/1241801969 shutdown_connections 2023-10-03T10:14:13.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.596+0000 7f3c7da48700 1 -- 172.21.15.146:0/1241801969 wait complete. 2023-10-03T10:14:13.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:13.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.627+0000 7f4ba4984700 1 -- 172.21.15.146:0/3064272212 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4b84005590 con 0x7f4ba01300a0 2023-10-03T10:14:13.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.627+0000 7f4b8effd700 1 -- 172.21.15.146:0/3064272212 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4b90021030 con 0x7f4ba01300a0 2023-10-03T10:14:13.628 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:13.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.630+0000 7f4ba4984700 1 -- 172.21.15.146:0/3064272212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ba01300a0 msgr2=0x7f4ba0119630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.630+0000 7f4ba4984700 1 --2- 172.21.15.146:0/3064272212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ba01300a0 0x7f4ba0119630 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000e910 tx=0x7f4b9000ec20 comp rx=0 tx=0).stop 2023-10-03T10:14:13.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.630+0000 7f4ba4984700 1 -- 172.21.15.146:0/3064272212 shutdown_connections 2023-10-03T10:14:13.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.630+0000 7f4ba4984700 1 --2- 172.21.15.146:0/3064272212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ba0133ad0 0x7f4ba011a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.630+0000 7f4ba4984700 1 --2- 172.21.15.146:0/3064272212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ba01300a0 0x7f4ba0119630 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.630+0000 7f4ba4984700 1 --2- 172.21.15.146:0/3064272212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ba01309f0 0x7f4ba0119b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.630+0000 7f4ba4984700 1 -- 172.21.15.146:0/3064272212 >> 172.21.15.146:0/3064272212 conn(0x7f4ba0099c40 msgr2=0x7f4ba01320e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.630+0000 7f4ba4984700 1 -- 172.21.15.146:0/3064272212 shutdown_connections 2023-10-03T10:14:13.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.630+0000 7f4ba4984700 1 -- 172.21.15.146:0/3064272212 wait complete. 2023-10-03T10:14:13.644 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:13.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.654+0000 7f1e000d7700 1 -- 172.21.15.146:0/4000080673 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1df804f2a0 con 0x7f1df81309f0 2023-10-03T10:14:13.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.654+0000 7f1dee7fc700 1 -- 172.21.15.146:0/4000080673 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1de8015070 con 0x7f1df81309f0 2023-10-03T10:14:13.655 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:13.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.656+0000 7f1e000d7700 1 -- 172.21.15.146:0/4000080673 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df81309f0 msgr2=0x7f1df81c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.656+0000 7f1e000d7700 1 --2- 172.21.15.146:0/4000080673 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df81309f0 0x7f1df81c8c90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1de8000c00 tx=0x7f1de8004750 comp rx=0 tx=0).stop 2023-10-03T10:14:13.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.656+0000 7f1e000d7700 1 -- 172.21.15.146:0/4000080673 shutdown_connections 2023-10-03T10:14:13.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.656+0000 7f1e000d7700 1 --2- 172.21.15.146:0/4000080673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1df8133ad0 0x7f1df81c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.656+0000 7f1e000d7700 1 --2- 172.21.15.146:0/4000080673 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1df81300a0 0x7f1df81c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.656+0000 7f1e000d7700 1 --2- 172.21.15.146:0/4000080673 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df81309f0 0x7f1df81c8c90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.656+0000 7f1e000d7700 1 -- 172.21.15.146:0/4000080673 >> 172.21.15.146:0/4000080673 conn(0x7f1df8099c40 msgr2=0x7f1df809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.656+0000 7f1e000d7700 1 -- 172.21.15.146:0/4000080673 shutdown_connections 2023-10-03T10:14:13.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.656+0000 7f1e000d7700 1 -- 172.21.15.146:0/4000080673 wait complete. 2023-10-03T10:14:13.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:13.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.705+0000 7fc0f86c0700 1 -- 172.21.15.146:0/1087971758 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc0f0125dc0 con 0x7fc0f0134120 2023-10-03T10:14:13.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.706+0000 7fc0e6ffd700 1 -- 172.21.15.146:0/1087971758 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc0e8018020 con 0x7fc0f0134120 2023-10-03T10:14:13.707 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:13.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.708+0000 7fc0f86c0700 1 -- 172.21.15.146:0/1087971758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0f0134120 msgr2=0x7fc0f01232d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.708+0000 7fc0f86c0700 1 --2- 172.21.15.146:0/1087971758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0f0134120 0x7fc0f01232d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8009dd0 tx=0x7fc0e800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.708+0000 7fc0f86c0700 1 -- 172.21.15.146:0/1087971758 shutdown_connections 2023-10-03T10:14:13.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.708+0000 7fc0f86c0700 1 --2- 172.21.15.146:0/1087971758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0f0134120 0x7fc0f01232d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.708+0000 7fc0f86c0700 1 --2- 172.21.15.146:0/1087971758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0f00a0a70 0x7fc0f0122850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.708+0000 7fc0f86c0700 1 --2- 172.21.15.146:0/1087971758 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0f00a1380 0x7fc0f0122d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.708+0000 7fc0f86c0700 1 -- 172.21.15.146:0/1087971758 >> 172.21.15.146:0/1087971758 conn(0x7fc0f00a6610 msgr2=0x7fc0f00a4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.708+0000 7fc0f86c0700 1 -- 172.21.15.146:0/1087971758 shutdown_connections 2023-10-03T10:14:13.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:13.708+0000 7fc0f86c0700 1 -- 172.21.15.146:0/1087971758 wait complete. 2023-10-03T10:14:13.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:14.610 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:14.644 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:14.670 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:14.722 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:14.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.747+0000 7f9012d5c700 1 Processor -- start 2023-10-03T10:14:14.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.747+0000 7f9012d5c700 1 -- start start 2023-10-03T10:14:14.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.748+0000 7f9012d5c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f900c138040 0x7f900c138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.748+0000 7f9012d5c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f900c0a08e0 0x7f900c0a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.748+0000 7f9012d5c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f900c0a1230 0x7f900c13ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.748+0000 7f9012d5c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f900c0a2100 con 0x7f900c138040 2023-10-03T10:14:14.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.748+0000 7f9012d5c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900c138950 con 0x7f900c0a1230 2023-10-03T10:14:14.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.748+0000 7f9012d5c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f900c1379e0 con 0x7f900c0a08e0 2023-10-03T10:14:14.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.748+0000 7f9010af8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f900c138040 0x7f900c138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.748+0000 7f900bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f900c0a08e0 0x7f900c0a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.748+0000 7f9010af8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f900c138040 0x7f900c138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49308/0 (socket says 172.21.15.146:49308) 2023-10-03T10:14:14.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.748+0000 7f9010af8700 1 -- 172.21.15.146:0/2251530534 learned_addr learned my addr 172.21.15.146:0/2251530534 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:14.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.748+0000 7f90112f9700 1 --2- 172.21.15.146:0/2251530534 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f900c0a1230 0x7f900c13ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.749+0000 7f900bfff700 1 -- 172.21.15.146:0/2251530534 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f900c0a1230 msgr2=0x7f900c13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:14.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.749+0000 7f900bfff700 1 --2- 172.21.15.146:0/2251530534 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f900c0a1230 0x7f900c13ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.749+0000 7f900bfff700 1 -- 172.21.15.146:0/2251530534 >> v2:172.21.15.146:3300/0 conn(0x7f900c138040 msgr2=0x7f900c138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:14.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.749+0000 7f900bfff700 1 --2- 172.21.15.146:0/2251530534 >> v2:172.21.15.146:3300/0 conn(0x7f900c138040 0x7f900c138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.749+0000 7f900bfff700 1 -- 172.21.15.146:0/2251530534 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900c09b9b0 con 0x7f900c0a08e0 2023-10-03T10:14:14.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.749+0000 7f9010af8700 1 --2- 172.21.15.146:0/2251530534 >> v2:172.21.15.146:3300/0 conn(0x7f900c138040 0x7f900c138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:14.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.749+0000 7f900bfff700 1 --2- 172.21.15.146:0/2251530534 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f900c0a08e0 0x7f900c0a0cf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80098a0 tx=0x7f8ff8009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2ba5ce4076b5105 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.749+0000 7f900b7fe700 1 -- 172.21.15.146:0/2251530534 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8011830 con 0x7f900c0a08e0 2023-10-03T10:14:14.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.749+0000 7f900b7fe700 1 -- 172.21.15.146:0/2251530534 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff8011990 con 0x7f900c0a08e0 2023-10-03T10:14:14.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.749+0000 7f900b7fe700 1 -- 172.21.15.146:0/2251530534 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8011d20 con 0x7f900c0a08e0 2023-10-03T10:14:14.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.750+0000 7f9012d5c700 1 -- 172.21.15.146:0/2251530534 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f900c0a08e0 msgr2=0x7f900c0a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.750+0000 7f9012d5c700 1 --2- 172.21.15.146:0/2251530534 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f900c0a08e0 0x7f900c0a0cf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80098a0 tx=0x7f8ff8009bb0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.750+0000 7f9012d5c700 1 -- 172.21.15.146:0/2251530534 shutdown_connections 2023-10-03T10:14:14.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.750+0000 7f9012d5c700 1 --2- 172.21.15.146:0/2251530534 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f900c0a1230 0x7f900c13ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.750+0000 7f9012d5c700 1 --2- 172.21.15.146:0/2251530534 >> v2:172.21.15.146:3300/0 conn(0x7f900c138040 0x7f900c138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.750+0000 7f9012d5c700 1 --2- 172.21.15.146:0/2251530534 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f900c0a08e0 0x7f900c0a0cf0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.750+0000 7f9012d5c700 1 -- 172.21.15.146:0/2251530534 >> 172.21.15.146:0/2251530534 conn(0x7f900c0a2980 msgr2=0x7f900c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.750+0000 7f9012d5c700 1 -- 172.21.15.146:0/2251530534 shutdown_connections 2023-10-03T10:14:14.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.750+0000 7f9012d5c700 1 -- 172.21.15.146:0/2251530534 wait complete. 2023-10-03T10:14:14.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.751+0000 7f9012d5c700 1 Processor -- start 2023-10-03T10:14:14.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.751+0000 7f9012d5c700 1 -- start start 2023-10-03T10:14:14.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.752+0000 7f9012d5c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f900c0a08e0 0x7f900c126670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.752+0000 7f9012d5c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f900c0a1230 0x7f900c126bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.752+0000 7f9012d5c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f900c138040 0x7f900c1270f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.752+0000 7f9012d5c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900c09a240 con 0x7f900c0a1230 2023-10-03T10:14:14.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.752+0000 7f9012d5c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900c1282b0 con 0x7f900c0a08e0 2023-10-03T10:14:14.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.752+0000 7f9012d5c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f900c129dd0 con 0x7f900c138040 2023-10-03T10:14:14.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.752+0000 7f9010af8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f900c0a08e0 0x7f900c126670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.752+0000 7f900bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f900c0a1230 0x7f900c126bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.753+0000 7f9010af8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f900c0a08e0 0x7f900c126670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49188/0 (socket says 172.21.15.146:49188) 2023-10-03T10:14:14.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.753+0000 7f9010af8700 1 -- 172.21.15.146:0/2236375044 learned_addr learned my addr 172.21.15.146:0/2236375044 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:14.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.753+0000 7f90112f9700 1 --2- 172.21.15.146:0/2236375044 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f900c138040 0x7f900c1270f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.753+0000 7f900bfff700 1 -- 172.21.15.146:0/2236375044 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f900c138040 msgr2=0x7f900c1270f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.753+0000 7f900bfff700 1 --2- 172.21.15.146:0/2236375044 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f900c138040 0x7f900c1270f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.753+0000 7f900bfff700 1 -- 172.21.15.146:0/2236375044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f900c0a08e0 msgr2=0x7f900c126670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.753+0000 7f900bfff700 1 --2- 172.21.15.146:0/2236375044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f900c0a08e0 0x7f900c126670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.753+0000 7f900bfff700 1 -- 172.21.15.146:0/2236375044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9000009500 con 0x7f900c0a1230 2023-10-03T10:14:14.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.753+0000 7f900bfff700 1 --2- 172.21.15.146:0/2236375044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f900c0a1230 0x7f900c126bb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8016000 tx=0x7f8ff8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.753+0000 7f90097fa700 1 -- 172.21.15.146:0/2236375044 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8004450 con 0x7f900c0a1230 2023-10-03T10:14:14.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.753+0000 7f90097fa700 1 -- 172.21.15.146:0/2236375044 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff801e070 con 0x7f900c0a1230 2023-10-03T10:14:14.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.753+0000 7f9012d5c700 1 -- 172.21.15.146:0/2236375044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff80094a0 con 0x7f900c0a1230 2023-10-03T10:14:14.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.753+0000 7f90097fa700 1 -- 172.21.15.146:0/2236375044 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80038e0 con 0x7f900c0a1230 2023-10-03T10:14:14.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.754+0000 7f9012d5c700 1 -- 172.21.15.146:0/2236375044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f900c1370b0 con 0x7f900c0a1230 2023-10-03T10:14:14.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.754+0000 7f90097fa700 1 -- 172.21.15.146:0/2236375044 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ff8003a40 con 0x7f900c0a1230 2023-10-03T10:14:14.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.754+0000 7f90097fa700 1 -- 172.21.15.146:0/2236375044 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8ff8020070 con 0x7f900c0a1230 2023-10-03T10:14:14.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.756+0000 7f9012d5c700 1 -- 172.21.15.146:0/2236375044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f900c04f2a0 con 0x7f900c0a1230 2023-10-03T10:14:14.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.761+0000 7f90097fa700 1 -- 172.21.15.146:0/2236375044 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ff8015020 con 0x7f900c0a1230 2023-10-03T10:14:14.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.795+0000 7f0e54bdf700 1 Processor -- start 2023-10-03T10:14:14.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.795+0000 7f0e54bdf700 1 -- start start 2023-10-03T10:14:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.796+0000 7f0e54bdf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e5009e870 0x7f0e5009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.796+0000 7f0e54bdf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0e5009f180 0x7f0e50131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.796+0000 7f0e54bdf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0e50131d70 0x7f0e50132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.796+0000 7f0e54bdf700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e500a0920 con 0x7f0e5009f180 2023-10-03T10:14:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.796+0000 7f0e54bdf700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5009c970 con 0x7f0e5009e870 2023-10-03T10:14:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.796+0000 7f0e54bdf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5009bab0 con 0x7f0e50131d70 2023-10-03T10:14:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.796+0000 7f0e4dd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0e5009f180 0x7f0e50131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.796+0000 7f0e4dd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0e5009f180 0x7f0e50131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49334/0 (socket says 172.21.15.146:49334) 2023-10-03T10:14:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.796+0000 7f0e4dd9b700 1 -- 172.21.15.146:0/3287503140 learned_addr learned my addr 172.21.15.146:0/3287503140 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.796+0000 7f0e4ed9d700 1 --2- 172.21.15.146:0/3287503140 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0e50131d70 0x7f0e50132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.796+0000 7f0e4e59c700 1 --2- 172.21.15.146:0/3287503140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e5009e870 0x7f0e5009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.796+0000 7f0e4dd9b700 1 -- 172.21.15.146:0/3287503140 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0e50131d70 msgr2=0x7f0e50132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:14.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.796+0000 7f0e4dd9b700 1 --2- 172.21.15.146:0/3287503140 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0e50131d70 0x7f0e50132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.796+0000 7f0e4dd9b700 1 -- 172.21.15.146:0/3287503140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e5009e870 msgr2=0x7f0e5009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:14.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.796+0000 7f0e4dd9b700 1 --2- 172.21.15.146:0/3287503140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e5009e870 0x7f0e5009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.797+0000 7f0e4dd9b700 1 -- 172.21.15.146:0/3287503140 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5009f9c0 con 0x7f0e5009f180 2023-10-03T10:14:14.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.797+0000 7f0e4ed9d700 1 --2- 172.21.15.146:0/3287503140 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0e50131d70 0x7f0e50132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:14.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.797+0000 7f0e4dd9b700 1 --2- 172.21.15.146:0/3287503140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e5009f180 0x7f0e50131830 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009920 tx=0x7f0e44009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f5c41ffc685f9c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.797+0000 7f0e4d59a700 1 -- 172.21.15.146:0/3287503140 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44011830 con 0x7f0e5009f180 2023-10-03T10:14:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.797+0000 7f0e4d59a700 1 -- 172.21.15.146:0/3287503140 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e44011990 con 0x7f0e5009f180 2023-10-03T10:14:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.797+0000 7f0e4d59a700 1 -- 172.21.15.146:0/3287503140 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44011d20 con 0x7f0e5009f180 2023-10-03T10:14:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.798+0000 7f0e54bdf700 1 -- 172.21.15.146:0/3287503140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e5009f180 msgr2=0x7f0e50131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.798+0000 7f0e54bdf700 1 --2- 172.21.15.146:0/3287503140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e5009f180 0x7f0e50131830 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009920 tx=0x7f0e44009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.798+0000 7f0e54bdf700 1 -- 172.21.15.146:0/3287503140 shutdown_connections 2023-10-03T10:14:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.798+0000 7f0e54bdf700 1 --2- 172.21.15.146:0/3287503140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e5009e870 0x7f0e5009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.798+0000 7f0e54bdf700 1 --2- 172.21.15.146:0/3287503140 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0e50131d70 0x7f0e50132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.798+0000 7f0e54bdf700 1 --2- 172.21.15.146:0/3287503140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e5009f180 0x7f0e50131830 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.798+0000 7f0e54bdf700 1 -- 172.21.15.146:0/3287503140 >> 172.21.15.146:0/3287503140 conn(0x7f0e500a4430 msgr2=0x7f0e500a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.798+0000 7f0e54bdf700 1 -- 172.21.15.146:0/3287503140 shutdown_connections 2023-10-03T10:14:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.798+0000 7f0e54bdf700 1 -- 172.21.15.146:0/3287503140 wait complete. 2023-10-03T10:14:14.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.800+0000 7f0e54bdf700 1 Processor -- start 2023-10-03T10:14:14.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.800+0000 7f0e54bdf700 1 -- start start 2023-10-03T10:14:14.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.800+0000 7f0e54bdf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e5009e870 0x7f0e50136a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.800+0000 7f0e54bdf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0e5009f180 0x7f0e50136f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.800+0000 7f0e54bdf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e50131d70 0x7f0e50137480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.800+0000 7f0e54bdf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5011c0d0 con 0x7f0e50131d70 2023-10-03T10:14:14.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.800+0000 7f0e54bdf700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e50138610 con 0x7f0e5009e870 2023-10-03T10:14:14.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.800+0000 7f0e54bdf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5011aae0 con 0x7f0e5009f180 2023-10-03T10:14:14.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.800+0000 7f0e4ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e50131d70 0x7f0e50137480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.801+0000 7f0e4e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e5009e870 0x7f0e50136a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.801+0000 7f0e4ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e50131d70 0x7f0e50137480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49336/0 (socket says 172.21.15.146:49336) 2023-10-03T10:14:14.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.801+0000 7f0e4ed9d700 1 -- 172.21.15.146:0/2158704011 learned_addr learned my addr 172.21.15.146:0/2158704011 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:14.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.801+0000 7f0e4dd9b700 1 --2- 172.21.15.146:0/2158704011 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0e5009f180 0x7f0e50136f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.801+0000 7f0e4dd9b700 1 -- 172.21.15.146:0/2158704011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e5009e870 msgr2=0x7f0e50136a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.801+0000 7f0e4dd9b700 1 --2- 172.21.15.146:0/2158704011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e5009e870 0x7f0e50136a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.801+0000 7f0e4dd9b700 1 -- 172.21.15.146:0/2158704011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e50131d70 msgr2=0x7f0e50137480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.801+0000 7f0e4dd9b700 1 --2- 172.21.15.146:0/2158704011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e50131d70 0x7f0e50137480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.801+0000 7f0e4dd9b700 1 -- 172.21.15.146:0/2158704011 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e48009a70 con 0x7f0e5009f180 2023-10-03T10:14:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.801+0000 7f0e4e59c700 1 --2- 172.21.15.146:0/2158704011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e5009e870 0x7f0e50136a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.801+0000 7f0e4ed9d700 1 --2- 172.21.15.146:0/2158704011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e50131d70 0x7f0e50137480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.801+0000 7f0e4dd9b700 1 --2- 172.21.15.146:0/2158704011 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0e5009f180 0x7f0e50136f40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0e500673f0 tx=0x7f0e44004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.801+0000 7f0e3effd700 1 -- 172.21.15.146:0/2158704011 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44004240 con 0x7f0e5009f180 2023-10-03T10:14:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.801+0000 7f0e3effd700 1 -- 172.21.15.146:0/2158704011 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4401f070 con 0x7f0e5009f180 2023-10-03T10:14:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.801+0000 7f0e3effd700 1 -- 172.21.15.146:0/2158704011 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e440036a0 con 0x7f0e5009f180 2023-10-03T10:14:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.801+0000 7f0e54bdf700 1 -- 172.21.15.146:0/2158704011 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e44009550 con 0x7f0e5009f180 2023-10-03T10:14:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.801+0000 7f0e54bdf700 1 -- 172.21.15.146:0/2158704011 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e500a2cf0 con 0x7f0e5009f180 2023-10-03T10:14:14.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.802+0000 7f0e3effd700 1 -- 172.21.15.146:0/2158704011 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e44021030 con 0x7f0e5009f180 2023-10-03T10:14:14.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.803+0000 7f0e3effd700 1 -- 172.21.15.146:0/2158704011 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0e4401a450 con 0x7f0e5009f180 2023-10-03T10:14:14.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.803+0000 7f0e54bdf700 1 -- 172.21.15.146:0/2158704011 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e500a0270 con 0x7f0e5009f180 2023-10-03T10:14:14.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.812+0000 7f0e3effd700 1 -- 172.21.15.146:0/2158704011 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0e44015070 con 0x7f0e5009f180 2023-10-03T10:14:14.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.845+0000 7f26bf2b9700 1 Processor -- start 2023-10-03T10:14:14.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.845+0000 7f26bf2b9700 1 -- start start 2023-10-03T10:14:14.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.846+0000 7f26bf2b9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f26b80a0a70 0x7f26b80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.846+0000 7f26bf2b9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26b80a1380 0x7f26b8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.846+0000 7f26bf2b9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b809dc00 con 0x7f26b8133f50 2023-10-03T10:14:14.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.846+0000 7f26bf2b9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b809ea60 con 0x7f26b80a1380 2023-10-03T10:14:14.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.846+0000 7f26bf2b9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26b809dec0 con 0x7f26b80a0a70 2023-10-03T10:14:14.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.846+0000 7f26bd055700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f26b80a0a70 0x7f26b80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.846+0000 7f26bd055700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f26b80a0a70 0x7f26b80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46676/0 (socket says 172.21.15.146:46676) 2023-10-03T10:14:14.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.846+0000 7f26bd055700 1 -- 172.21.15.146:0/1004095031 learned_addr learned my addr 172.21.15.146:0/1004095031 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:14.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.846+0000 7f26bc854700 1 --2- 172.21.15.146:0/1004095031 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26b80a1380 0x7f26b8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.846+0000 7f26bd055700 1 -- 172.21.15.146:0/1004095031 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26b80a1380 msgr2=0x7f26b8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:14.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.846+0000 7f26bd055700 1 --2- 172.21.15.146:0/1004095031 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26b80a1380 0x7f26b8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.846+0000 7f26bd055700 1 -- 172.21.15.146:0/1004095031 >> v1:172.21.15.146:6789/0 conn(0x7f26b8133f50 legacy=0x7f26b813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.846+0000 7f26bd055700 1 -- 172.21.15.146:0/1004095031 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b809e6a0 con 0x7f26b80a0a70 2023-10-03T10:14:14.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.847+0000 7f26bd055700 1 --2- 172.21.15.146:0/1004095031 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f26b80a0a70 0x7f26b80a0e40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009920 tx=0x7f26b4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87430244638a0b97 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.847+0000 7f26affff700 1 -- 172.21.15.146:0/1004095031 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4011830 con 0x7f26b80a0a70 2023-10-03T10:14:14.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.847+0000 7f26affff700 1 -- 172.21.15.146:0/1004095031 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b4011990 con 0x7f26b80a0a70 2023-10-03T10:14:14.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.847+0000 7f26affff700 1 -- 172.21.15.146:0/1004095031 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4011d20 con 0x7f26b80a0a70 2023-10-03T10:14:14.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.848+0000 7f26bf2b9700 1 -- 172.21.15.146:0/1004095031 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f26b80a0a70 msgr2=0x7f26b80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.848+0000 7f26bf2b9700 1 --2- 172.21.15.146:0/1004095031 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f26b80a0a70 0x7f26b80a0e40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009920 tx=0x7f26b4009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:14.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.848+0000 7f26bf2b9700 1 -- 172.21.15.146:0/1004095031 shutdown_connections 2023-10-03T10:14:14.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.848+0000 7f26bf2b9700 1 --2- 172.21.15.146:0/1004095031 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f26b80a0a70 0x7f26b80a0e40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.848+0000 7f26bf2b9700 1 --2- 172.21.15.146:0/1004095031 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26b80a1380 0x7f26b8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.848+0000 7f26bf2b9700 1 -- 172.21.15.146:0/1004095031 >> 172.21.15.146:0/1004095031 conn(0x7f26b80a6610 msgr2=0x7f26b80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.848+0000 7f26bf2b9700 1 -- 172.21.15.146:0/1004095031 shutdown_connections 2023-10-03T10:14:14.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.848+0000 7f26bf2b9700 1 -- 172.21.15.146:0/1004095031 wait complete. 2023-10-03T10:14:14.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.849+0000 7f26bf2b9700 1 Processor -- start 2023-10-03T10:14:14.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.849+0000 7f26bf2b9700 1 -- start start 2023-10-03T10:14:14.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.850+0000 7f26bf2b9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26b80a0a70 0x7f26b81c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.850+0000 7f26bf2b9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f26b80a1380 0x7f26b81c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.850+0000 7f26bf2b9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26b8133f50 0x7f26b811e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.850+0000 7f26bf2b9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b81206b0 con 0x7f26b80a0a70 2023-10-03T10:14:14.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.850+0000 7f26bf2b9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b81204c0 con 0x7f26b8133f50 2023-10-03T10:14:14.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.850+0000 7f26bf2b9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26b81c9270 con 0x7f26b80a1380 2023-10-03T10:14:14.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.850+0000 7f26bd055700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26b80a0a70 0x7f26b81c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.850+0000 7f26bd856700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26b8133f50 0x7f26b811e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.850+0000 7f26bd055700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26b80a0a70 0x7f26b81c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49348/0 (socket says 172.21.15.146:49348) 2023-10-03T10:14:14.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.850+0000 7f26bd055700 1 -- 172.21.15.146:0/2413663445 learned_addr learned my addr 172.21.15.146:0/2413663445 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:14.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.850+0000 7f26bd856700 1 --2- 172.21.15.146:0/2413663445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26b8133f50 0x7f26b811e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49240/0 (socket says 172.21.15.146:49240) 2023-10-03T10:14:14.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.850+0000 7f26bc854700 1 --2- 172.21.15.146:0/2413663445 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f26b80a1380 0x7f26b81c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.850+0000 7f26bd055700 1 -- 172.21.15.146:0/2413663445 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f26b80a1380 msgr2=0x7f26b81c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.850+0000 7f26bd055700 1 --2- 172.21.15.146:0/2413663445 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f26b80a1380 0x7f26b81c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.850+0000 7f26bd055700 1 -- 172.21.15.146:0/2413663445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26b8133f50 msgr2=0x7f26b811e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.850+0000 7f26bd055700 1 --2- 172.21.15.146:0/2413663445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26b8133f50 0x7f26b811e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.850+0000 7f26bd055700 1 -- 172.21.15.146:0/2413663445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b4009550 con 0x7f26b80a0a70 2023-10-03T10:14:14.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.850+0000 7f26bd856700 1 --2- 172.21.15.146:0/2413663445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26b8133f50 0x7f26b811e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:14.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.851+0000 7f26bd055700 1 --2- 172.21.15.146:0/2413663445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26b80a0a70 0x7f26b81c87f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f26b809e000 tx=0x7f26b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.851+0000 7f26adffb700 1 -- 172.21.15.146:0/2413663445 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4004450 con 0x7f26b80a0a70 2023-10-03T10:14:14.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.851+0000 7f26adffb700 1 -- 172.21.15.146:0/2413663445 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b40045b0 con 0x7f26b80a0a70 2023-10-03T10:14:14.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.851+0000 7f26adffb700 1 -- 172.21.15.146:0/2413663445 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b40038c0 con 0x7f26b80a0a70 2023-10-03T10:14:14.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.851+0000 7f26bf2b9700 1 -- 172.21.15.146:0/2413663445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b80a03e0 con 0x7f26b80a0a70 2023-10-03T10:14:14.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.851+0000 7f26bf2b9700 1 -- 172.21.15.146:0/2413663445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b8120aa0 con 0x7f26b80a0a70 2023-10-03T10:14:14.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.852+0000 7f26adffb700 1 -- 172.21.15.146:0/2413663445 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f26b4003a20 con 0x7f26b80a0a70 2023-10-03T10:14:14.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.852+0000 7f26bf2b9700 1 -- 172.21.15.146:0/2413663445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b804f2a0 con 0x7f26b80a0a70 2023-10-03T10:14:14.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.853+0000 7f26adffb700 1 -- 172.21.15.146:0/2413663445 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f26b4021030 con 0x7f26b80a0a70 2023-10-03T10:14:14.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.861+0000 7f26adffb700 1 -- 172.21.15.146:0/2413663445 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f26b401a430 con 0x7f26b80a0a70 2023-10-03T10:14:14.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.876+0000 7f9de65a1700 1 Processor -- start 2023-10-03T10:14:14.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.876+0000 7f9de65a1700 1 -- start start 2023-10-03T10:14:14.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.876+0000 7f9de65a1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9de009eca0 0x7f9de009f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.876+0000 7f9de65a1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9de009f5b0 0x7f9de013c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.876+0000 7f9de65a1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de009d860 con 0x7f9de009fa00 2023-10-03T10:14:14.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.876+0000 7f9de65a1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de009db20 con 0x7f9de009eca0 2023-10-03T10:14:14.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.876+0000 7f9de65a1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9de00a04a0 con 0x7f9de009f5b0 2023-10-03T10:14:14.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.876+0000 7f9de559f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9de009eca0 0x7f9de009f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.877+0000 7f9de559f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9de009eca0 0x7f9de009f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49362/0 (socket says 172.21.15.146:49362) 2023-10-03T10:14:14.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.877+0000 7f9de559f700 1 -- 172.21.15.146:0/2499879398 learned_addr learned my addr 172.21.15.146:0/2499879398 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:14.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.877+0000 7f9de4d9e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9de009f5b0 0x7f9de013c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.877+0000 7f9de4d9e700 1 -- 172.21.15.146:0/2499879398 >> v2:172.21.15.146:3300/0 conn(0x7f9de009eca0 msgr2=0x7f9de009f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:14.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.877+0000 7f9de4d9e700 1 --2- 172.21.15.146:0/2499879398 >> v2:172.21.15.146:3300/0 conn(0x7f9de009eca0 0x7f9de009f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.877+0000 7f9de4d9e700 1 -- 172.21.15.146:0/2499879398 >> v1:172.21.15.146:6789/0 conn(0x7f9de009fa00 legacy=0x7f9de013e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.877+0000 7f9de4d9e700 1 -- 172.21.15.146:0/2499879398 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de009dde0 con 0x7f9de009f5b0 2023-10-03T10:14:14.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.877+0000 7f9dd7fff700 1 -- 172.21.15.146:0/2499879398 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473831781 0 0) 0x7f9de009d860 con 0x7f9de009fa00 2023-10-03T10:14:14.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.877+0000 7f9de4d9e700 1 --2- 172.21.15.146:0/2499879398 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9de009f5b0 0x7f9de013c020 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009840 tx=0x7f9dd0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=612a0627174d682f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.877+0000 7f9dd7fff700 1 -- 172.21.15.146:0/2499879398 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0011830 con 0x7f9de009f5b0 2023-10-03T10:14:14.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.877+0000 7f9dd7fff700 1 -- 172.21.15.146:0/2499879398 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd0011990 con 0x7f9de009f5b0 2023-10-03T10:14:14.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.877+0000 7f9dd7fff700 1 -- 172.21.15.146:0/2499879398 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0011d20 con 0x7f9de009f5b0 2023-10-03T10:14:14.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.878+0000 7f9de65a1700 1 -- 172.21.15.146:0/2499879398 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9de009f5b0 msgr2=0x7f9de013c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.878+0000 7f9de65a1700 1 --2- 172.21.15.146:0/2499879398 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9de009f5b0 0x7f9de013c020 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009840 tx=0x7f9dd0009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:14.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.878+0000 7f9de65a1700 1 -- 172.21.15.146:0/2499879398 shutdown_connections 2023-10-03T10:14:14.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.878+0000 7f9de65a1700 1 --2- 172.21.15.146:0/2499879398 >> v2:172.21.15.146:3300/0 conn(0x7f9de009eca0 0x7f9de009f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.878+0000 7f9de65a1700 1 --2- 172.21.15.146:0/2499879398 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9de009f5b0 0x7f9de013c020 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.878+0000 7f9de65a1700 1 -- 172.21.15.146:0/2499879398 >> 172.21.15.146:0/2499879398 conn(0x7f9de00a6070 msgr2=0x7f9de00a6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.878+0000 7f9de65a1700 1 -- 172.21.15.146:0/2499879398 shutdown_connections 2023-10-03T10:14:14.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.878+0000 7f9de65a1700 1 -- 172.21.15.146:0/2499879398 wait complete. 2023-10-03T10:14:14.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.879+0000 7f9de65a1700 1 Processor -- start 2023-10-03T10:14:14.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.879+0000 7f9de65a1700 1 -- start start 2023-10-03T10:14:14.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.879+0000 7f9de65a1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9de009eca0 0x7f9de0130f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.879+0000 7f9de65a1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9de009f5b0 0x7f9de012f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.879+0000 7f9de65a1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9de009fa00 0x7f9de012fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.879+0000 7f9de65a1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de0134b40 con 0x7f9de009eca0 2023-10-03T10:14:14.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.879+0000 7f9de65a1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de0134200 con 0x7f9de009f5b0 2023-10-03T10:14:14.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.879+0000 7f9de65a1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9de0134910 con 0x7f9de009fa00 2023-10-03T10:14:14.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.879+0000 7f9de4d9e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9de009f5b0 0x7f9de012f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.880+0000 7f9de5da0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9de009fa00 0x7f9de012fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.880+0000 7f9de4d9e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9de009f5b0 0x7f9de012f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49248/0 (socket says 172.21.15.146:49248) 2023-10-03T10:14:14.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.880+0000 7f9de4d9e700 1 -- 172.21.15.146:0/1471624260 learned_addr learned my addr 172.21.15.146:0/1471624260 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:14.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.880+0000 7f9de559f700 1 --2- 172.21.15.146:0/1471624260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9de009eca0 0x7f9de0130f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.880+0000 7f9de5da0700 1 -- 172.21.15.146:0/1471624260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9de009f5b0 msgr2=0x7f9de012f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.880+0000 7f9de5da0700 1 --2- 172.21.15.146:0/1471624260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9de009f5b0 0x7f9de012f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.880+0000 7f9de5da0700 1 -- 172.21.15.146:0/1471624260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9de009eca0 msgr2=0x7f9de0130f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.880+0000 7f9de5da0700 1 --2- 172.21.15.146:0/1471624260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9de009eca0 0x7f9de0130f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.880+0000 7f9de5da0700 1 -- 172.21.15.146:0/1471624260 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd00094a0 con 0x7f9de009fa00 2023-10-03T10:14:14.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.880+0000 7f9de5da0700 1 --2- 172.21.15.146:0/1471624260 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9de009fa00 0x7f9de012fe30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9dd800c730 tx=0x7f9dd800ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.880+0000 7f9dd5ffb700 1 -- 172.21.15.146:0/1471624260 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8003e30 con 0x7f9de009fa00 2023-10-03T10:14:14.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.880+0000 7f9dd5ffb700 1 -- 172.21.15.146:0/1471624260 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd8005070 con 0x7f9de009fa00 2023-10-03T10:14:14.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.880+0000 7f9dd5ffb700 1 -- 172.21.15.146:0/1471624260 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8005420 con 0x7f9de009fa00 2023-10-03T10:14:14.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.881+0000 7f9de65a1700 1 -- 172.21.15.146:0/1471624260 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de00a4200 con 0x7f9de009fa00 2023-10-03T10:14:14.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.881+0000 7f9de65a1700 1 -- 172.21.15.146:0/1471624260 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de0135580 con 0x7f9de009fa00 2023-10-03T10:14:14.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.882+0000 7f9de65a1700 1 -- 172.21.15.146:0/1471624260 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de0136340 con 0x7f9de009fa00 2023-10-03T10:14:14.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.882+0000 7f9dd5ffb700 1 -- 172.21.15.146:0/1471624260 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9dd8005580 con 0x7f9de009fa00 2023-10-03T10:14:14.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.882+0000 7f9dd5ffb700 1 -- 172.21.15.146:0/1471624260 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9dd803f350 con 0x7f9de009fa00 2023-10-03T10:14:14.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.891+0000 7f9dd5ffb700 1 -- 172.21.15.146:0/1471624260 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9dd8005830 con 0x7f9de009fa00 2023-10-03T10:14:14.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.995+0000 7f9012d5c700 1 -- 172.21.15.146:0/2236375044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f900c06bce0 con 0x7f900c0a1230 2023-10-03T10:14:14.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.996+0000 7f90097fa700 1 -- 172.21.15.146:0/2236375044 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8ff8025480 con 0x7f900c0a1230 2023-10-03T10:14:14.996 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.998+0000 7f9012d5c700 1 -- 172.21.15.146:0/2236375044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f900c0a1230 msgr2=0x7f900c126bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.998+0000 7f9012d5c700 1 --2- 172.21.15.146:0/2236375044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f900c0a1230 0x7f900c126bb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8016000 tx=0x7f8ff8004750 comp rx=0 tx=0).stop 2023-10-03T10:14:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.998+0000 7f9012d5c700 1 -- 172.21.15.146:0/2236375044 shutdown_connections 2023-10-03T10:14:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.998+0000 7f9012d5c700 1 --2- 172.21.15.146:0/2236375044 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f900c138040 0x7f900c1270f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.998+0000 7f9012d5c700 1 --2- 172.21.15.146:0/2236375044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f900c0a08e0 0x7f900c126670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.998+0000 7f9012d5c700 1 --2- 172.21.15.146:0/2236375044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f900c0a1230 0x7f900c126bb0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.998+0000 7f9012d5c700 1 -- 172.21.15.146:0/2236375044 >> 172.21.15.146:0/2236375044 conn(0x7f900c0a2980 msgr2=0x7f900c09e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.998+0000 7f9012d5c700 1 -- 172.21.15.146:0/2236375044 shutdown_connections 2023-10-03T10:14:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:14.998+0000 7f9012d5c700 1 -- 172.21.15.146:0/2236375044 wait complete. 2023-10-03T10:14:15.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:15.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.055+0000 7f0e54bdf700 1 -- 172.21.15.146:0/2158704011 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0e5004f2a0 con 0x7f0e5009f180 2023-10-03T10:14:15.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.056+0000 7f0e3effd700 1 -- 172.21.15.146:0/2158704011 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0e44015030 con 0x7f0e5009f180 2023-10-03T10:14:15.056 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:15.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.058+0000 7f0e54bdf700 1 -- 172.21.15.146:0/2158704011 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0e5009f180 msgr2=0x7f0e50136f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.058+0000 7f0e54bdf700 1 --2- 172.21.15.146:0/2158704011 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0e5009f180 0x7f0e50136f40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0e500673f0 tx=0x7f0e44004750 comp rx=0 tx=0).stop 2023-10-03T10:14:15.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.058+0000 7f0e54bdf700 1 -- 172.21.15.146:0/2158704011 shutdown_connections 2023-10-03T10:14:15.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.058+0000 7f0e54bdf700 1 --2- 172.21.15.146:0/2158704011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e50131d70 0x7f0e50137480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.058+0000 7f0e54bdf700 1 --2- 172.21.15.146:0/2158704011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e5009e870 0x7f0e50136a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.058+0000 7f0e54bdf700 1 --2- 172.21.15.146:0/2158704011 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0e5009f180 0x7f0e50136f40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.058+0000 7f0e54bdf700 1 -- 172.21.15.146:0/2158704011 >> 172.21.15.146:0/2158704011 conn(0x7f0e500a4430 msgr2=0x7f0e5009cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.058+0000 7f0e54bdf700 1 -- 172.21.15.146:0/2158704011 shutdown_connections 2023-10-03T10:14:15.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.058+0000 7f0e54bdf700 1 -- 172.21.15.146:0/2158704011 wait complete. 2023-10-03T10:14:15.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:15.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.089+0000 7f9de65a1700 1 -- 172.21.15.146:0/1471624260 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9de004f2a0 con 0x7f9de009fa00 2023-10-03T10:14:15.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.089+0000 7f9dd5ffb700 1 -- 172.21.15.146:0/1471624260 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9dd802a090 con 0x7f9de009fa00 2023-10-03T10:14:15.090 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:15.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.091+0000 7f9de65a1700 1 -- 172.21.15.146:0/1471624260 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9de009fa00 msgr2=0x7f9de012fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.091+0000 7f9de65a1700 1 --2- 172.21.15.146:0/1471624260 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9de009fa00 0x7f9de012fe30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9dd800c730 tx=0x7f9dd800ca40 comp rx=0 tx=0).stop 2023-10-03T10:14:15.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.091+0000 7f9de65a1700 1 -- 172.21.15.146:0/1471624260 shutdown_connections 2023-10-03T10:14:15.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.091+0000 7f9de65a1700 1 --2- 172.21.15.146:0/1471624260 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9de009fa00 0x7f9de012fe30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.091+0000 7f9de65a1700 1 --2- 172.21.15.146:0/1471624260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9de009eca0 0x7f9de0130f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.091+0000 7f9de65a1700 1 --2- 172.21.15.146:0/1471624260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9de009f5b0 0x7f9de012f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.091+0000 7f9de65a1700 1 -- 172.21.15.146:0/1471624260 >> 172.21.15.146:0/1471624260 conn(0x7f9de00a6070 msgr2=0x7f9de009ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.091+0000 7f9de65a1700 1 -- 172.21.15.146:0/1471624260 shutdown_connections 2023-10-03T10:14:15.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.091+0000 7f9de65a1700 1 -- 172.21.15.146:0/1471624260 wait complete. 2023-10-03T10:14:15.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.094+0000 7f26bf2b9700 1 -- 172.21.15.146:0/2413663445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f26b8121ec0 con 0x7f26b80a0a70 2023-10-03T10:14:15.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.094+0000 7f26adffb700 1 -- 172.21.15.146:0/2413663445 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f26b402b020 con 0x7f26b80a0a70 2023-10-03T10:14:15.095 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:15.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.098+0000 7f26bf2b9700 1 -- 172.21.15.146:0/2413663445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26b80a0a70 msgr2=0x7f26b81c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.098+0000 7f26bf2b9700 1 --2- 172.21.15.146:0/2413663445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26b80a0a70 0x7f26b81c87f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f26b809e000 tx=0x7f26b4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:15.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.098+0000 7f26bf2b9700 1 -- 172.21.15.146:0/2413663445 shutdown_connections 2023-10-03T10:14:15.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.098+0000 7f26bf2b9700 1 --2- 172.21.15.146:0/2413663445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26b8133f50 0x7f26b811e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.098+0000 7f26bf2b9700 1 --2- 172.21.15.146:0/2413663445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26b80a0a70 0x7f26b81c87f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.098+0000 7f26bf2b9700 1 --2- 172.21.15.146:0/2413663445 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f26b80a1380 0x7f26b81c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.098+0000 7f26bf2b9700 1 -- 172.21.15.146:0/2413663445 >> 172.21.15.146:0/2413663445 conn(0x7f26b80a6610 msgr2=0x7f26b80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.098+0000 7f26bf2b9700 1 -- 172.21.15.146:0/2413663445 shutdown_connections 2023-10-03T10:14:15.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:15.098+0000 7f26bf2b9700 1 -- 172.21.15.146:0/2413663445 wait complete. 2023-10-03T10:14:15.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:15.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:16.012 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:16.074 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:16.108 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:16.114 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:16.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.150+0000 7f8384c17700 1 Processor -- start 2023-10-03T10:14:16.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.150+0000 7f8384c17700 1 -- start start 2023-10-03T10:14:16.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.151+0000 7f8384c17700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f838006a770 0x7f838006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.151+0000 7f8384c17700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f838009dec0 0x7f838006b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.151+0000 7f8384c17700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838006b5c0 con 0x7f8380131a00 2023-10-03T10:14:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.151+0000 7f8384c17700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838006e900 con 0x7f838006a770 2023-10-03T10:14:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.151+0000 7f8384c17700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f838009d180 con 0x7f838009dec0 2023-10-03T10:14:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.151+0000 7f837dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f838009dec0 0x7f838006b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.151+0000 7f837dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f838009dec0 0x7f838006b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46704/0 (socket says 172.21.15.146:46704) 2023-10-03T10:14:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.151+0000 7f837dd9b700 1 -- 172.21.15.146:0/2821435919 learned_addr learned my addr 172.21.15.146:0/2821435919 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.151+0000 7f837e59c700 1 --2- 172.21.15.146:0/2821435919 >> v2:172.21.15.146:3300/0 conn(0x7f838006a770 0x7f838006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.151+0000 7f837d59a700 1 -- 172.21.15.146:0/2821435919 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742158633 0 0) 0x7f838006b5c0 con 0x7f8380131a00 2023-10-03T10:14:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.151+0000 7f837d59a700 1 -- 172.21.15.146:0/2821435919 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83680035b0 con 0x7f8380131a00 2023-10-03T10:14:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.151+0000 7f837dd9b700 1 -- 172.21.15.146:0/2821435919 >> v2:172.21.15.146:3300/0 conn(0x7f838006a770 msgr2=0x7f838006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.151+0000 7f837dd9b700 1 --2- 172.21.15.146:0/2821435919 >> v2:172.21.15.146:3300/0 conn(0x7f838006a770 0x7f838006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.151+0000 7f837dd9b700 1 -- 172.21.15.146:0/2821435919 >> v1:172.21.15.146:6789/0 conn(0x7f8380131a00 legacy=0x7f8380131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.151+0000 7f837dd9b700 1 -- 172.21.15.146:0/2821435919 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838009e780 con 0x7f838009dec0 2023-10-03T10:14:16.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.152+0000 7f837dd9b700 1 --2- 172.21.15.146:0/2821435919 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f838009dec0 0x7f838006b080 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f83740098f0 tx=0x7f8374009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9340a05ca2c012e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.152+0000 7f837d59a700 1 -- 172.21.15.146:0/2821435919 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374011830 con 0x7f838009dec0 2023-10-03T10:14:16.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.152+0000 7f837d59a700 1 -- 172.21.15.146:0/2821435919 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8374011990 con 0x7f838009dec0 2023-10-03T10:14:16.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.152+0000 7f837d59a700 1 -- 172.21.15.146:0/2821435919 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374011d20 con 0x7f838009dec0 2023-10-03T10:14:16.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.153+0000 7f8384c17700 1 -- 172.21.15.146:0/2821435919 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f838009dec0 msgr2=0x7f838006b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.153+0000 7f8384c17700 1 --2- 172.21.15.146:0/2821435919 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f838009dec0 0x7f838006b080 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f83740098f0 tx=0x7f8374009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:16.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.153+0000 7f8384c17700 1 -- 172.21.15.146:0/2821435919 shutdown_connections 2023-10-03T10:14:16.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.153+0000 7f8384c17700 1 --2- 172.21.15.146:0/2821435919 >> v2:172.21.15.146:3300/0 conn(0x7f838006a770 0x7f838006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.153+0000 7f8384c17700 1 --2- 172.21.15.146:0/2821435919 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f838009dec0 0x7f838006b080 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.153+0000 7f8384c17700 1 -- 172.21.15.146:0/2821435919 >> 172.21.15.146:0/2821435919 conn(0x7f8380099c40 msgr2=0x7f83800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.153+0000 7f8384c17700 1 -- 172.21.15.146:0/2821435919 shutdown_connections 2023-10-03T10:14:16.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.153+0000 7f8384c17700 1 -- 172.21.15.146:0/2821435919 wait complete. 2023-10-03T10:14:16.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.154+0000 7f8384c17700 1 Processor -- start 2023-10-03T10:14:16.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.155+0000 7f8384c17700 1 -- start start 2023-10-03T10:14:16.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.155+0000 7f8384c17700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f838006a770 0x7f838009a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.155+0000 7f8384c17700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f838009dec0 0x7f838009a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.155+0000 7f8384c17700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8380131a00 0x7f838009af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.155+0000 7f8384c17700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8380071ce0 con 0x7f8380131a00 2023-10-03T10:14:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.155+0000 7f8384c17700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8380120ac0 con 0x7f838009dec0 2023-10-03T10:14:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.155+0000 7f8384c17700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f838011f940 con 0x7f838006a770 2023-10-03T10:14:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.155+0000 7f837e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f838006a770 0x7f838009a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.155+0000 7f837e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f838006a770 0x7f838009a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46712/0 (socket says 172.21.15.146:46712) 2023-10-03T10:14:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.155+0000 7f837e59c700 1 -- 172.21.15.146:0/204016840 learned_addr learned my addr 172.21.15.146:0/204016840 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.155+0000 7f837ed9d700 1 --2- 172.21.15.146:0/204016840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8380131a00 0x7f838009af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.156+0000 7f837dd9b700 1 --2- 172.21.15.146:0/204016840 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f838009dec0 0x7f838009a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.156+0000 7f837e59c700 1 -- 172.21.15.146:0/204016840 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f838009dec0 msgr2=0x7f838009a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.156+0000 7f837e59c700 1 --2- 172.21.15.146:0/204016840 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f838009dec0 0x7f838009a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.156+0000 7f837e59c700 1 -- 172.21.15.146:0/204016840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8380131a00 msgr2=0x7f838009af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.156+0000 7f837e59c700 1 --2- 172.21.15.146:0/204016840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8380131a00 0x7f838009af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.156+0000 7f837e59c700 1 -- 172.21.15.146:0/204016840 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8374009550 con 0x7f838006a770 2023-10-03T10:14:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.156+0000 7f837ed9d700 1 --2- 172.21.15.146:0/204016840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8380131a00 0x7f838009af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.156+0000 7f837e59c700 1 --2- 172.21.15.146:0/204016840 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f838006a770 0x7f838009a490 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f837000e9b0 tx=0x7f837000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.156+0000 7f836effd700 1 -- 172.21.15.146:0/204016840 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370009710 con 0x7f838006a770 2023-10-03T10:14:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.156+0000 7f836effd700 1 -- 172.21.15.146:0/204016840 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837000ee50 con 0x7f838006a770 2023-10-03T10:14:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.156+0000 7f836effd700 1 -- 172.21.15.146:0/204016840 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837000ca50 con 0x7f838006a770 2023-10-03T10:14:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.156+0000 7f8384c17700 1 -- 172.21.15.146:0/204016840 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f838009c140 con 0x7f838006a770 2023-10-03T10:14:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.156+0000 7f8384c17700 1 -- 172.21.15.146:0/204016840 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f838011fee0 con 0x7f838006a770 2023-10-03T10:14:16.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.157+0000 7f836effd700 1 -- 172.21.15.146:0/204016840 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f837000cbb0 con 0x7f838006a770 2023-10-03T10:14:16.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.157+0000 7f836effd700 1 -- 172.21.15.146:0/204016840 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f83700421c0 con 0x7f838006a770 2023-10-03T10:14:16.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.158+0000 7f8384c17700 1 -- 172.21.15.146:0/204016840 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83800a31d0 con 0x7f838006a770 2023-10-03T10:14:16.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.162+0000 7f836effd700 1 -- 172.21.15.146:0/204016840 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8370017020 con 0x7f838006a770 2023-10-03T10:14:16.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.217+0000 7fdcaa5c7700 1 Processor -- start 2023-10-03T10:14:16.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.217+0000 7fdcaa5c7700 1 -- start start 2023-10-03T10:14:16.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.218+0000 7fdcaa5c7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdca4133ad0 0x7fdca4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.218+0000 7fdcaa5c7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdca4130bc0 0x7fdca413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.218+0000 7fdcaa5c7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca406b2d0 con 0x7fdca41300a0 2023-10-03T10:14:16.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.218+0000 7fdcaa5c7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca4133610 con 0x7fdca4133ad0 2023-10-03T10:14:16.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.218+0000 7fdcaa5c7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdca409a500 con 0x7fdca4130bc0 2023-10-03T10:14:16.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.218+0000 7fdca8b64700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdca4130bc0 0x7fdca413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.218+0000 7fdca8b64700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdca4130bc0 0x7fdca413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46726/0 (socket says 172.21.15.146:46726) 2023-10-03T10:14:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.218+0000 7fdca3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdca4133ad0 0x7fdca4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.218+0000 7fdca8b64700 1 -- 172.21.15.146:0/2975301925 learned_addr learned my addr 172.21.15.146:0/2975301925 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.219+0000 7fdca8b64700 1 -- 172.21.15.146:0/2975301925 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdca4133ad0 msgr2=0x7fdca4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.219+0000 7fdca8b64700 1 --2- 172.21.15.146:0/2975301925 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdca4133ad0 0x7fdca4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.219+0000 7fdca8b64700 1 -- 172.21.15.146:0/2975301925 >> v1:172.21.15.146:6789/0 conn(0x7fdca41300a0 legacy=0x7fdca41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.219+0000 7fdca8b64700 1 -- 172.21.15.146:0/2975301925 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca41338b0 con 0x7fdca4130bc0 2023-10-03T10:14:16.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.219+0000 7fdca8b64700 1 --2- 172.21.15.146:0/2975301925 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdca4130bc0 0x7fdca413b990 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009e80 tx=0x7fdc9c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=929442b7bd01d316 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.219+0000 7fdca2ffd700 1 -- 172.21.15.146:0/2975301925 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c00e070 con 0x7fdca4130bc0 2023-10-03T10:14:16.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.219+0000 7fdca2ffd700 1 -- 172.21.15.146:0/2975301925 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c00b910 con 0x7fdca4130bc0 2023-10-03T10:14:16.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.219+0000 7fdca2ffd700 1 -- 172.21.15.146:0/2975301925 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c00bcc0 con 0x7fdca4130bc0 2023-10-03T10:14:16.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.220+0000 7fdcaa5c7700 1 -- 172.21.15.146:0/2975301925 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdca4130bc0 msgr2=0x7fdca413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.220+0000 7fdcaa5c7700 1 --2- 172.21.15.146:0/2975301925 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdca4130bc0 0x7fdca413b990 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009e80 tx=0x7fdc9c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:16.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.220+0000 7fdcaa5c7700 1 -- 172.21.15.146:0/2975301925 shutdown_connections 2023-10-03T10:14:16.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.220+0000 7fdcaa5c7700 1 --2- 172.21.15.146:0/2975301925 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdca4130bc0 0x7fdca413b990 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.220+0000 7fdcaa5c7700 1 --2- 172.21.15.146:0/2975301925 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdca4133ad0 0x7fdca4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.220+0000 7fdcaa5c7700 1 -- 172.21.15.146:0/2975301925 >> 172.21.15.146:0/2975301925 conn(0x7fdca4099c40 msgr2=0x7fdca40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.220+0000 7fdcaa5c7700 1 -- 172.21.15.146:0/2975301925 shutdown_connections 2023-10-03T10:14:16.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.220+0000 7fdcaa5c7700 1 -- 172.21.15.146:0/2975301925 wait complete. 2023-10-03T10:14:16.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.221+0000 7fdcaa5c7700 1 Processor -- start 2023-10-03T10:14:16.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.222+0000 7fdcaa5c7700 1 -- start start 2023-10-03T10:14:16.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.222+0000 7fdcaa5c7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdca41300a0 0x7fdca411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.222+0000 7fdcaa5c7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdca4130bc0 0x7fdca411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.222+0000 7fdcaa5c7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdca4133ad0 0x7fdca411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.222+0000 7fdcaa5c7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca412dd00 con 0x7fdca4133ad0 2023-10-03T10:14:16.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.222+0000 7fdcaa5c7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca412fde0 con 0x7fdca41300a0 2023-10-03T10:14:16.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.222+0000 7fdcaa5c7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdca4120280 con 0x7fdca4130bc0 2023-10-03T10:14:16.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.222+0000 7fdca8b64700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdca4133ad0 0x7fdca411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.222+0000 7fdca3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdca41300a0 0x7fdca411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.222+0000 7fdca8b64700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdca4133ad0 0x7fdca411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49406/0 (socket says 172.21.15.146:49406) 2023-10-03T10:14:16.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.222+0000 7fdca8b64700 1 -- 172.21.15.146:0/1835098801 learned_addr learned my addr 172.21.15.146:0/1835098801 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:16.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.223+0000 7fdca37fe700 1 --2- 172.21.15.146:0/1835098801 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdca4130bc0 0x7fdca411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.223+0000 7fdca3fff700 1 -- 172.21.15.146:0/1835098801 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdca4130bc0 msgr2=0x7fdca411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.223+0000 7fdca3fff700 1 --2- 172.21.15.146:0/1835098801 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdca4130bc0 0x7fdca411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.223+0000 7fdca3fff700 1 -- 172.21.15.146:0/1835098801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdca4133ad0 msgr2=0x7fdca411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.223+0000 7fdca3fff700 1 --2- 172.21.15.146:0/1835098801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdca4133ad0 0x7fdca411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.223+0000 7fdca3fff700 1 -- 172.21.15.146:0/1835098801 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9c009b30 con 0x7fdca41300a0 2023-10-03T10:14:16.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.223+0000 7fdca8b64700 1 --2- 172.21.15.146:0/1835098801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdca4133ad0 0x7fdca411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:16.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.223+0000 7fdca3fff700 1 --2- 172.21.15.146:0/1835098801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdca41300a0 0x7fdca411da40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400e930 tx=0x7fdc9400ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.223+0000 7fdca0ff9700 1 -- 172.21.15.146:0/1835098801 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94013680 con 0x7fdca41300a0 2023-10-03T10:14:16.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.223+0000 7fdcaa5c7700 1 -- 172.21.15.146:0/1835098801 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca411f900 con 0x7fdca41300a0 2023-10-03T10:14:16.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.223+0000 7fdcaa5c7700 1 -- 172.21.15.146:0/1835098801 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca411ea00 con 0x7fdca41300a0 2023-10-03T10:14:16.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.224+0000 7fdca0ff9700 1 -- 172.21.15.146:0/1835098801 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc940137e0 con 0x7fdca41300a0 2023-10-03T10:14:16.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.224+0000 7fdca0ff9700 1 -- 172.21.15.146:0/1835098801 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94013b50 con 0x7fdca41300a0 2023-10-03T10:14:16.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.224+0000 7fdca0ff9700 1 -- 172.21.15.146:0/1835098801 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc94013cb0 con 0x7fdca41300a0 2023-10-03T10:14:16.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.225+0000 7fdcaa5c7700 1 -- 172.21.15.146:0/1835098801 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc840052e0 con 0x7fdca41300a0 2023-10-03T10:14:16.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.225+0000 7fdca0ff9700 1 -- 172.21.15.146:0/1835098801 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdc9403fa00 con 0x7fdca41300a0 2023-10-03T10:14:16.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.231+0000 7fdca0ff9700 1 -- 172.21.15.146:0/1835098801 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc9401c970 con 0x7fdca41300a0 2023-10-03T10:14:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.264+0000 7f3affa3c700 1 Processor -- start 2023-10-03T10:14:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.264+0000 7f3affa3c700 1 -- start start 2023-10-03T10:14:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.265+0000 7f3affa3c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3af809d860 0x7f3af809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.265+0000 7f3affa3c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3af8130eb0 0x7f3af8138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.265+0000 7f3affa3c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af809aaa0 con 0x7f3af809e170 2023-10-03T10:14:16.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.265+0000 7f3affa3c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af809f870 con 0x7f3af8130eb0 2023-10-03T10:14:16.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.265+0000 7f3affa3c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af809b360 con 0x7f3af809d860 2023-10-03T10:14:16.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.265+0000 7f3afcfd7700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3af809e170 0x7f3af81307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47238/0 (socket says 172.21.15.146:47238) 2023-10-03T10:14:16.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.265+0000 7f3afcfd7700 1 -- 172.21.15.146:0/1084317730 learned_addr learned my addr 172.21.15.146:0/1084317730 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:16.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.265+0000 7f3afdfd9700 1 --2- 172.21.15.146:0/1084317730 >> v2:172.21.15.146:3300/0 conn(0x7f3af8130eb0 0x7f3af8138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.265+0000 7f3aeffff700 1 -- 172.21.15.146:0/1084317730 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380779727 0 0) 0x7f3af809aaa0 con 0x7f3af809e170 2023-10-03T10:14:16.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.265+0000 7f3aeffff700 1 -- 172.21.15.146:0/1084317730 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ae40035b0 con 0x7f3af809e170 2023-10-03T10:14:16.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.266+0000 7f3afdfd9700 1 -- 172.21.15.146:0/1084317730 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3af809d860 msgr2=0x7f3af809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:16.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.266+0000 7f3afdfd9700 1 --2- 172.21.15.146:0/1084317730 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3af809d860 0x7f3af809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.266+0000 7f3afdfd9700 1 -- 172.21.15.146:0/1084317730 >> v1:172.21.15.146:6789/0 conn(0x7f3af809e170 legacy=0x7f3af81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.266+0000 7f3afdfd9700 1 -- 172.21.15.146:0/1084317730 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af809b620 con 0x7f3af8130eb0 2023-10-03T10:14:16.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.266+0000 7f3afdfd9700 1 --2- 172.21.15.146:0/1084317730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af8130eb0 0x7f3af8138a00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3af0009d90 tx=0x7f3af000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cdb50b1d1b12b2d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.266+0000 7f3aeffff700 1 -- 172.21.15.146:0/1084317730 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af000e070 con 0x7f3af8130eb0 2023-10-03T10:14:16.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.266+0000 7f3aeffff700 1 -- 172.21.15.146:0/1084317730 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af000bb20 con 0x7f3af8130eb0 2023-10-03T10:14:16.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.266+0000 7f3aeffff700 1 -- 172.21.15.146:0/1084317730 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0012430 con 0x7f3af8130eb0 2023-10-03T10:14:16.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.266+0000 7f3affa3c700 1 -- 172.21.15.146:0/1084317730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af8130eb0 msgr2=0x7f3af8138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.266+0000 7f3affa3c700 1 --2- 172.21.15.146:0/1084317730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af8130eb0 0x7f3af8138a00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3af0009d90 tx=0x7f3af000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:16.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.267+0000 7f3affa3c700 1 -- 172.21.15.146:0/1084317730 shutdown_connections 2023-10-03T10:14:16.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.267+0000 7f3affa3c700 1 --2- 172.21.15.146:0/1084317730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af8130eb0 0x7f3af8138a00 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.267+0000 7f3affa3c700 1 --2- 172.21.15.146:0/1084317730 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3af809d860 0x7f3af809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.267+0000 7f3affa3c700 1 -- 172.21.15.146:0/1084317730 >> 172.21.15.146:0/1084317730 conn(0x7f3af8099c40 msgr2=0x7f3af80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.267+0000 7f3affa3c700 1 -- 172.21.15.146:0/1084317730 shutdown_connections 2023-10-03T10:14:16.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.267+0000 7f3affa3c700 1 -- 172.21.15.146:0/1084317730 wait complete. 2023-10-03T10:14:16.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.268+0000 7f3affa3c700 1 Processor -- start 2023-10-03T10:14:16.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.268+0000 7f3affa3c700 1 -- start start 2023-10-03T10:14:16.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.268+0000 7f3affa3c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af809d860 0x7f3af812f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.268+0000 7f3affa3c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3af809e170 0x7f3af812fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.268+0000 7f3affa3c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3af8130eb0 0x7f3af8130210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.268+0000 7f3affa3c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af8136d70 con 0x7f3af809d860 2023-10-03T10:14:16.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.268+0000 7f3affa3c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af813b0c0 con 0x7f3af809e170 2023-10-03T10:14:16.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.268+0000 7f3affa3c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3af8071fc0 con 0x7f3af8130eb0 2023-10-03T10:14:16.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.268+0000 7f3afd7d8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af809d860 0x7f3af812f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.269+0000 7f3afd7d8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af809d860 0x7f3af812f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49428/0 (socket says 172.21.15.146:49428) 2023-10-03T10:14:16.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.269+0000 7f3afdfd9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3af8130eb0 0x7f3af8130210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.269+0000 7f3afd7d8700 1 -- 172.21.15.146:0/439815632 learned_addr learned my addr 172.21.15.146:0/439815632 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:16.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.269+0000 7f3afdfd9700 1 -- 172.21.15.146:0/439815632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3af809e170 msgr2=0x7f3af812fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.269+0000 7f3afdfd9700 1 --2- 172.21.15.146:0/439815632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3af809e170 0x7f3af812fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.269+0000 7f3afdfd9700 1 -- 172.21.15.146:0/439815632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af809d860 msgr2=0x7f3af812f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.269+0000 7f3afdfd9700 1 --2- 172.21.15.146:0/439815632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af809d860 0x7f3af812f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.269+0000 7f3afdfd9700 1 -- 172.21.15.146:0/439815632 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af0009a70 con 0x7f3af8130eb0 2023-10-03T10:14:16.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.269+0000 7f859fd54700 1 Processor -- start 2023-10-03T10:14:16.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.269+0000 7f3afdfd9700 1 --2- 172.21.15.146:0/439815632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3af8130eb0 0x7f3af8130210 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3af0016000 tx=0x7f3af0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.269+0000 7f3aedffb700 1 -- 172.21.15.146:0/439815632 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0012430 con 0x7f3af8130eb0 2023-10-03T10:14:16.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.269+0000 7f3aedffb700 1 -- 172.21.15.146:0/439815632 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af0020070 con 0x7f3af8130eb0 2023-10-03T10:14:16.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.269+0000 7f3affa3c700 1 -- 172.21.15.146:0/439815632 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af809c8b0 con 0x7f3af8130eb0 2023-10-03T10:14:16.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.269+0000 7f3aedffb700 1 -- 172.21.15.146:0/439815632 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0004280 con 0x7f3af8130eb0 2023-10-03T10:14:16.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.269+0000 7f859fd54700 1 -- start start 2023-10-03T10:14:16.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.269+0000 7f3affa3c700 1 -- 172.21.15.146:0/439815632 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af8139b50 con 0x7f3af8130eb0 2023-10-03T10:14:16.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.270+0000 7f859fd54700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859812cb80 0x7f859812cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.270+0000 7f859fd54700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f859812fab0 0x7f859812ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.270+0000 7f859fd54700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f859809b700 con 0x7f8598130460 2023-10-03T10:14:16.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.270+0000 7f859fd54700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859809c350 con 0x7f859812cb80 2023-10-03T10:14:16.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.270+0000 7f859fd54700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85981308d0 con 0x7f859812fab0 2023-10-03T10:14:16.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.270+0000 7f859d2ef700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f859812fab0 0x7f859812ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.270+0000 7f859d2ef700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f859812fab0 0x7f859812ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46744/0 (socket says 172.21.15.146:46744) 2023-10-03T10:14:16.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.270+0000 7f859d2ef700 1 -- 172.21.15.146:0/3220591399 learned_addr learned my addr 172.21.15.146:0/3220591399 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:16.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.270+0000 7f3aedffb700 1 -- 172.21.15.146:0/439815632 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3af00043e0 con 0x7f3af8130eb0 2023-10-03T10:14:16.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.271+0000 7f3aedffb700 1 -- 172.21.15.146:0/439815632 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3af0022070 con 0x7f3af8130eb0 2023-10-03T10:14:16.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.271+0000 7f859daf0700 1 --2- 172.21.15.146:0/3220591399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859812cb80 0x7f859812cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.271+0000 7f859d2ef700 1 -- 172.21.15.146:0/3220591399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859812cb80 msgr2=0x7f859812cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:16.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.271+0000 7f859d2ef700 1 --2- 172.21.15.146:0/3220591399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859812cb80 0x7f859812cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.271+0000 7f859d2ef700 1 -- 172.21.15.146:0/3220591399 >> v1:172.21.15.146:6789/0 conn(0x7f8598130460 legacy=0x7f8598136de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:16.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.271+0000 7f859d2ef700 1 -- 172.21.15.146:0/3220591399 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859809abf0 con 0x7f859812fab0 2023-10-03T10:14:16.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.271+0000 7f859d2ef700 1 --2- 172.21.15.146:0/3220591399 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f859812fab0 0x7f859812ff20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8594009920 tx=0x7f8594009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b416994b1efc7698 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.271+0000 7f859caee700 1 -- 172.21.15.146:0/3220591399 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8594004230 con 0x7f859812fab0 2023-10-03T10:14:16.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.271+0000 7f859caee700 1 -- 172.21.15.146:0/3220591399 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8594004390 con 0x7f859812fab0 2023-10-03T10:14:16.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.271+0000 7f859caee700 1 -- 172.21.15.146:0/3220591399 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8594009e70 con 0x7f859812fab0 2023-10-03T10:14:16.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.271+0000 7f3affa3c700 1 -- 172.21.15.146:0/439815632 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af804f2a0 con 0x7f3af8130eb0 2023-10-03T10:14:16.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.272+0000 7f859fd54700 1 -- 172.21.15.146:0/3220591399 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f859812fab0 msgr2=0x7f859812ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.272+0000 7f859fd54700 1 --2- 172.21.15.146:0/3220591399 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f859812fab0 0x7f859812ff20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8594009920 tx=0x7f8594009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:16.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.272+0000 7f859fd54700 1 -- 172.21.15.146:0/3220591399 shutdown_connections 2023-10-03T10:14:16.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.272+0000 7f859fd54700 1 --2- 172.21.15.146:0/3220591399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859812cb80 0x7f859812cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.272+0000 7f859fd54700 1 --2- 172.21.15.146:0/3220591399 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f859812fab0 0x7f859812ff20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.272+0000 7f859fd54700 1 -- 172.21.15.146:0/3220591399 >> 172.21.15.146:0/3220591399 conn(0x7f85980a2eb0 msgr2=0x7f859809eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.272+0000 7f859fd54700 1 -- 172.21.15.146:0/3220591399 shutdown_connections 2023-10-03T10:14:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.272+0000 7f859fd54700 1 -- 172.21.15.146:0/3220591399 wait complete. 2023-10-03T10:14:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.274+0000 7f859fd54700 1 Processor -- start 2023-10-03T10:14:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.274+0000 7f859fd54700 1 -- start start 2023-10-03T10:14:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.274+0000 7f859fd54700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859812cb80 0x7f85981c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.274+0000 7f859fd54700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f859812fab0 0x7f85981c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.274+0000 7f859fd54700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8598130460 0x7f859806f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.274+0000 7f859fd54700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8598072740 con 0x7f8598130460 2023-10-03T10:14:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.274+0000 7f859fd54700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8598070a30 con 0x7f859812cb80 2023-10-03T10:14:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.274+0000 7f859fd54700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8598070fe0 con 0x7f859812fab0 2023-10-03T10:14:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.274+0000 7f859daf0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859812cb80 0x7f85981c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.275+0000 7f859d2ef700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f859812fab0 0x7f85981c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.275+0000 7f859daf0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859812cb80 0x7f85981c8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49316/0 (socket says 172.21.15.146:49316) 2023-10-03T10:14:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.275+0000 7f859daf0700 1 -- 172.21.15.146:0/324164465 learned_addr learned my addr 172.21.15.146:0/324164465 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.275+0000 7f859e2f1700 1 --2- 172.21.15.146:0/324164465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8598130460 0x7f859806f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.275+0000 7f859d2ef700 1 -- 172.21.15.146:0/324164465 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859812cb80 msgr2=0x7f85981c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.275+0000 7f859d2ef700 1 --2- 172.21.15.146:0/324164465 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859812cb80 0x7f85981c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.275+0000 7f859d2ef700 1 -- 172.21.15.146:0/324164465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8598130460 msgr2=0x7f859806f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.275+0000 7f859d2ef700 1 --2- 172.21.15.146:0/324164465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8598130460 0x7f859806f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.275+0000 7f859d2ef700 1 -- 172.21.15.146:0/324164465 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8594009550 con 0x7f859812fab0 2023-10-03T10:14:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.275+0000 7f859d2ef700 1 --2- 172.21.15.146:0/324164465 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f859812fab0 0x7f85981c8fa0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8594015000 tx=0x7f8594004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.276+0000 7f858e7fc700 1 -- 172.21.15.146:0/324164465 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859400bdf0 con 0x7f859812fab0 2023-10-03T10:14:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.276+0000 7f858e7fc700 1 -- 172.21.15.146:0/324164465 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85940036a0 con 0x7f859812fab0 2023-10-03T10:14:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.276+0000 7f858e7fc700 1 -- 172.21.15.146:0/324164465 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8594003a10 con 0x7f859812fab0 2023-10-03T10:14:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.276+0000 7f859fd54700 1 -- 172.21.15.146:0/324164465 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f859812d510 con 0x7f859812fab0 2023-10-03T10:14:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.276+0000 7f3aedffb700 1 -- 172.21.15.146:0/439815632 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3af001b400 con 0x7f3af8130eb0 2023-10-03T10:14:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.277+0000 7f859fd54700 1 -- 172.21.15.146:0/324164465 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f859809b050 con 0x7f859812fab0 2023-10-03T10:14:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.278+0000 7f859fd54700 1 -- 172.21.15.146:0/324164465 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f859804f2a0 con 0x7f859812fab0 2023-10-03T10:14:16.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.281+0000 7f858e7fc700 1 -- 172.21.15.146:0/324164465 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8594003b70 con 0x7f859812fab0 2023-10-03T10:14:16.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.281+0000 7f858e7fc700 1 -- 172.21.15.146:0/324164465 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8594040c50 con 0x7f859812fab0 2023-10-03T10:14:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.290+0000 7f858e7fc700 1 -- 172.21.15.146:0/324164465 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8594010380 con 0x7f859812fab0 2023-10-03T10:14:16.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.383+0000 7f8384c17700 1 -- 172.21.15.146:0/204016840 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f838004f2a0 con 0x7f838006a770 2023-10-03T10:14:16.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.383+0000 7f836effd700 1 -- 172.21.15.146:0/204016840 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8370044060 con 0x7f838006a770 2023-10-03T10:14:16.384 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:16.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.385+0000 7f8384c17700 1 -- 172.21.15.146:0/204016840 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f838006a770 msgr2=0x7f838009a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.385+0000 7f8384c17700 1 --2- 172.21.15.146:0/204016840 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f838006a770 0x7f838009a490 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f837000e9b0 tx=0x7f837000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.385+0000 7f8384c17700 1 -- 172.21.15.146:0/204016840 shutdown_connections 2023-10-03T10:14:16.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.385+0000 7f8384c17700 1 --2- 172.21.15.146:0/204016840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8380131a00 0x7f838009af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.385+0000 7f8384c17700 1 --2- 172.21.15.146:0/204016840 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f838006a770 0x7f838009a490 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.385+0000 7f8384c17700 1 --2- 172.21.15.146:0/204016840 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f838009dec0 0x7f838009a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.385+0000 7f8384c17700 1 -- 172.21.15.146:0/204016840 >> 172.21.15.146:0/204016840 conn(0x7f8380099c40 msgr2=0x7f838012ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.385+0000 7f8384c17700 1 -- 172.21.15.146:0/204016840 shutdown_connections 2023-10-03T10:14:16.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.385+0000 7f8384c17700 1 -- 172.21.15.146:0/204016840 wait complete. 2023-10-03T10:14:16.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:16.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.471+0000 7fdcaa5c7700 1 -- 172.21.15.146:0/1835098801 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdc84005590 con 0x7fdca41300a0 2023-10-03T10:14:16.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.472+0000 7fdca0ff9700 1 -- 172.21.15.146:0/1835098801 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdc94017070 con 0x7fdca41300a0 2023-10-03T10:14:16.472 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:16.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.474+0000 7fdcaa5c7700 1 -- 172.21.15.146:0/1835098801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdca41300a0 msgr2=0x7fdca411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.474+0000 7fdcaa5c7700 1 --2- 172.21.15.146:0/1835098801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdca41300a0 0x7fdca411da40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400e930 tx=0x7fdc9400ec40 comp rx=0 tx=0).stop 2023-10-03T10:14:16.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.474+0000 7fdcaa5c7700 1 -- 172.21.15.146:0/1835098801 shutdown_connections 2023-10-03T10:14:16.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.474+0000 7fdcaa5c7700 1 --2- 172.21.15.146:0/1835098801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdca4133ad0 0x7fdca411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.474+0000 7fdcaa5c7700 1 --2- 172.21.15.146:0/1835098801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdca41300a0 0x7fdca411da40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.474+0000 7fdcaa5c7700 1 --2- 172.21.15.146:0/1835098801 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdca4130bc0 0x7fdca411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.474+0000 7fdcaa5c7700 1 -- 172.21.15.146:0/1835098801 >> 172.21.15.146:0/1835098801 conn(0x7fdca4099c40 msgr2=0x7fdca412e690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.474+0000 7fdcaa5c7700 1 -- 172.21.15.146:0/1835098801 shutdown_connections 2023-10-03T10:14:16.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.474+0000 7fdcaa5c7700 1 -- 172.21.15.146:0/1835098801 wait complete. 2023-10-03T10:14:16.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.476+0000 7f3affa3c700 1 -- 172.21.15.146:0/439815632 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3af806c3b0 con 0x7f3af8130eb0 2023-10-03T10:14:16.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.476+0000 7f3aedffb700 1 -- 172.21.15.146:0/439815632 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3af002c020 con 0x7f3af8130eb0 2023-10-03T10:14:16.477 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:16.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.480+0000 7f3affa3c700 1 -- 172.21.15.146:0/439815632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3af8130eb0 msgr2=0x7f3af8130210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.480+0000 7f3affa3c700 1 --2- 172.21.15.146:0/439815632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3af8130eb0 0x7f3af8130210 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3af0016000 tx=0x7f3af0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.480+0000 7f3affa3c700 1 -- 172.21.15.146:0/439815632 shutdown_connections 2023-10-03T10:14:16.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.480+0000 7f3affa3c700 1 --2- 172.21.15.146:0/439815632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3af8130eb0 0x7f3af8130210 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.480+0000 7f3affa3c700 1 --2- 172.21.15.146:0/439815632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af809d860 0x7f3af812f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.480+0000 7f3affa3c700 1 --2- 172.21.15.146:0/439815632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3af809e170 0x7f3af812fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.480+0000 7f3affa3c700 1 -- 172.21.15.146:0/439815632 >> 172.21.15.146:0/439815632 conn(0x7f3af8099c40 msgr2=0x7f3af813b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.480+0000 7f3affa3c700 1 -- 172.21.15.146:0/439815632 shutdown_connections 2023-10-03T10:14:16.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.480+0000 7f3affa3c700 1 -- 172.21.15.146:0/439815632 wait complete. 2023-10-03T10:14:16.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:16.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:16.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.506+0000 7f859fd54700 1 -- 172.21.15.146:0/324164465 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f859809a820 con 0x7f859812fab0 2023-10-03T10:14:16.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.507+0000 7f858e7fc700 1 -- 172.21.15.146:0/324164465 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8594028070 con 0x7f859812fab0 2023-10-03T10:14:16.508 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:16.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.509+0000 7f859fd54700 1 -- 172.21.15.146:0/324164465 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f859812fab0 msgr2=0x7f85981c8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.509+0000 7f859fd54700 1 --2- 172.21.15.146:0/324164465 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f859812fab0 0x7f85981c8fa0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8594015000 tx=0x7f8594004750 comp rx=0 tx=0).stop 2023-10-03T10:14:16.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.509+0000 7f859fd54700 1 -- 172.21.15.146:0/324164465 shutdown_connections 2023-10-03T10:14:16.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.509+0000 7f859fd54700 1 --2- 172.21.15.146:0/324164465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8598130460 0x7f859806f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.509+0000 7f859fd54700 1 --2- 172.21.15.146:0/324164465 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859812cb80 0x7f85981c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.509+0000 7f859fd54700 1 --2- 172.21.15.146:0/324164465 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f859812fab0 0x7f85981c8fa0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.509+0000 7f859fd54700 1 -- 172.21.15.146:0/324164465 >> 172.21.15.146:0/324164465 conn(0x7f85980a2eb0 msgr2=0x7f85980a1440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.509+0000 7f859fd54700 1 -- 172.21.15.146:0/324164465 shutdown_connections 2023-10-03T10:14:16.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:16.509+0000 7f859fd54700 1 -- 172.21.15.146:0/324164465 wait complete. 2023-10-03T10:14:16.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:17.404 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:17.492 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:17.497 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:17.522 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:17.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.529+0000 7f50ddb44700 1 Processor -- start 2023-10-03T10:14:17.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.529+0000 7f50ddb44700 1 -- start start 2023-10-03T10:14:17.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.530+0000 7f50ddb44700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50d809e870 0x7f50d809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.530+0000 7f50ddb44700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f50d809f180 0x7f50d8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.530+0000 7f50ddb44700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d809c970 con 0x7f50d8131d70 2023-10-03T10:14:17.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.530+0000 7f50ddb44700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d80a0920 con 0x7f50d809f180 2023-10-03T10:14:17.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.530+0000 7f50ddb44700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d809f9c0 con 0x7f50d809e870 2023-10-03T10:14:17.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.530+0000 7f50d77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50d809e870 0x7f50d809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.530+0000 7f50d7fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f50d8131d70 0x7f50d8138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47268/0 (socket says 172.21.15.146:47268) 2023-10-03T10:14:17.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.530+0000 7f50d6ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f50d809f180 0x7f50d8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.530+0000 7f50d77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50d809e870 0x7f50d809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49328/0 (socket says 172.21.15.146:49328) 2023-10-03T10:14:17.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.530+0000 7f50d7fff700 1 -- 172.21.15.146:0/311044899 learned_addr learned my addr 172.21.15.146:0/311044899 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:17.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.530+0000 7f50d6ffd700 1 -- 172.21.15.146:0/311044899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50d809e870 msgr2=0x7f50d809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.530+0000 7f50d6ffd700 1 --2- 172.21.15.146:0/311044899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50d809e870 0x7f50d809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.530+0000 7f50d6ffd700 1 -- 172.21.15.146:0/311044899 >> v1:172.21.15.146:6789/0 conn(0x7f50d8131d70 legacy=0x7f50d8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.530+0000 7f50d67fc700 1 -- 172.21.15.146:0/311044899 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929703132 0 0) 0x7f50d809c970 con 0x7f50d8131d70 2023-10-03T10:14:17.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.530+0000 7f50d6ffd700 1 -- 172.21.15.146:0/311044899 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d809bab0 con 0x7f50d809f180 2023-10-03T10:14:17.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.530+0000 7f50d77fe700 1 --2- 172.21.15.146:0/311044899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50d809e870 0x7f50d809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.530+0000 7f50d6ffd700 1 --2- 172.21.15.146:0/311044899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50d809f180 0x7f50d8131830 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009840 tx=0x7f50cc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f9ae191e43766b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.531+0000 7f50d67fc700 1 -- 172.21.15.146:0/311044899 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc011830 con 0x7f50d809f180 2023-10-03T10:14:17.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.531+0000 7f50d67fc700 1 -- 172.21.15.146:0/311044899 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50cc011990 con 0x7f50d809f180 2023-10-03T10:14:17.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.531+0000 7f50d67fc700 1 -- 172.21.15.146:0/311044899 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc011d20 con 0x7f50d809f180 2023-10-03T10:14:17.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.531+0000 7f50ddb44700 1 -- 172.21.15.146:0/311044899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50d809f180 msgr2=0x7f50d8131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.531+0000 7f50ddb44700 1 --2- 172.21.15.146:0/311044899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50d809f180 0x7f50d8131830 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009840 tx=0x7f50cc009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:17.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.531+0000 7f50ddb44700 1 -- 172.21.15.146:0/311044899 shutdown_connections 2023-10-03T10:14:17.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.531+0000 7f50ddb44700 1 --2- 172.21.15.146:0/311044899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50d809e870 0x7f50d809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.531+0000 7f50ddb44700 1 --2- 172.21.15.146:0/311044899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50d809f180 0x7f50d8131830 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.531+0000 7f50ddb44700 1 -- 172.21.15.146:0/311044899 >> 172.21.15.146:0/311044899 conn(0x7f50d80a4430 msgr2=0x7f50d80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.531+0000 7f50ddb44700 1 -- 172.21.15.146:0/311044899 shutdown_connections 2023-10-03T10:14:17.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.531+0000 7f50ddb44700 1 -- 172.21.15.146:0/311044899 wait complete. 2023-10-03T10:14:17.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.533+0000 7f50ddb44700 1 Processor -- start 2023-10-03T10:14:17.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.533+0000 7f50ddb44700 1 -- start start 2023-10-03T10:14:17.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.534+0000 7f50ddb44700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50d809e870 0x7f50d806c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.534+0000 7f50ddb44700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50d809f180 0x7f50d806c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.534+0000 7f50ddb44700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50d8131d70 0x7f50d81c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.534+0000 7f50ddb44700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d8122330 con 0x7f50d809f180 2023-10-03T10:14:17.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.534+0000 7f50ddb44700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d8131380 con 0x7f50d8131d70 2023-10-03T10:14:17.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.534+0000 7f50ddb44700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50d809dba0 con 0x7f50d809e870 2023-10-03T10:14:17.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.534+0000 7f50d77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50d809e870 0x7f50d806c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.534+0000 7f50d6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50d809f180 0x7f50d806c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.534+0000 7f50d77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50d809e870 0x7f50d806c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46764/0 (socket says 172.21.15.146:46764) 2023-10-03T10:14:17.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.534+0000 7f50d77fe700 1 -- 172.21.15.146:0/3371470629 learned_addr learned my addr 172.21.15.146:0/3371470629 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:17.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.534+0000 7f50d7fff700 1 --2- 172.21.15.146:0/3371470629 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50d8131d70 0x7f50d81c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.534+0000 7f50d6ffd700 1 -- 172.21.15.146:0/3371470629 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50d809e870 msgr2=0x7f50d806c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.534+0000 7f50d6ffd700 1 --2- 172.21.15.146:0/3371470629 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50d809e870 0x7f50d806c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.534+0000 7f50d6ffd700 1 -- 172.21.15.146:0/3371470629 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50d8131d70 msgr2=0x7f50d81c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.534+0000 7f50d6ffd700 1 --2- 172.21.15.146:0/3371470629 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50d8131d70 0x7f50d81c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.534+0000 7f50d6ffd700 1 -- 172.21.15.146:0/3371470629 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c8009a70 con 0x7f50d809f180 2023-10-03T10:14:17.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.534+0000 7f50d7fff700 1 --2- 172.21.15.146:0/3371470629 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50d8131d70 0x7f50d81c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.534+0000 7f50d77fe700 1 --2- 172.21.15.146:0/3371470629 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50d809e870 0x7f50d806c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.534+0000 7f50d6ffd700 1 --2- 172.21.15.146:0/3371470629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50d809f180 0x7f50d806c850 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f50cc016000 tx=0x7f50cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.535+0000 7f50bffff700 1 -- 172.21.15.146:0/3371470629 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0036a0 con 0x7f50d809f180 2023-10-03T10:14:17.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.535+0000 7f50bffff700 1 -- 172.21.15.146:0/3371470629 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50cc01f070 con 0x7f50d809f180 2023-10-03T10:14:17.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.535+0000 7f50bffff700 1 -- 172.21.15.146:0/3371470629 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc003a40 con 0x7f50d809f180 2023-10-03T10:14:17.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.535+0000 7f50ddb44700 1 -- 172.21.15.146:0/3371470629 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50cc0094a0 con 0x7f50d809f180 2023-10-03T10:14:17.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.535+0000 7f50ddb44700 1 -- 172.21.15.146:0/3371470629 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d8122530 con 0x7f50d809f180 2023-10-03T10:14:17.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.536+0000 7f50bffff700 1 -- 172.21.15.146:0/3371470629 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50cc003ba0 con 0x7f50d809f180 2023-10-03T10:14:17.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.536+0000 7f50bffff700 1 -- 172.21.15.146:0/3371470629 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f50cc021070 con 0x7f50d809f180 2023-10-03T10:14:17.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.536+0000 7f50ddb44700 1 -- 172.21.15.146:0/3371470629 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d80a2b10 con 0x7f50d809f180 2023-10-03T10:14:17.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.542+0000 7f50bffff700 1 -- 172.21.15.146:0/3371470629 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50cc015080 con 0x7f50d809f180 2023-10-03T10:14:17.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.624+0000 7f7db65a9700 1 Processor -- start 2023-10-03T10:14:17.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.624+0000 7f7db65a9700 1 -- start start 2023-10-03T10:14:17.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.625+0000 7f7db65a9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db00a1510 0x7f7db01351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.625+0000 7f7db65a9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7db01356e0 0x7f7db0137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.625+0000 7f7db65a9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db00a1e70 con 0x7f7db00a0a30 2023-10-03T10:14:17.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.625+0000 7f7db65a9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db009a720 con 0x7f7db01356e0 2023-10-03T10:14:17.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.625+0000 7f7db65a9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db009b300 con 0x7f7db00a1510 2023-10-03T10:14:17.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.625+0000 7f7daf7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db00a1510 0x7f7db01351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.625+0000 7f7daf7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db00a1510 0x7f7db01351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49346/0 (socket says 172.21.15.146:49346) 2023-10-03T10:14:17.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.625+0000 7f7daf7fe700 1 -- 172.21.15.146:0/1815328948 learned_addr learned my addr 172.21.15.146:0/1815328948 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:17.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.625+0000 7f7daffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7db00a0a30 0x7f7db00a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47282/0 (socket says 172.21.15.146:47282) 2023-10-03T10:14:17.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.625+0000 7f7db4b46700 1 --2- 172.21.15.146:0/1815328948 >> v2:172.21.15.146:3300/0 conn(0x7f7db01356e0 0x7f7db0137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.626+0000 7f7daf7fe700 1 -- 172.21.15.146:0/1815328948 >> v2:172.21.15.146:3300/0 conn(0x7f7db01356e0 msgr2=0x7f7db0137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.626+0000 7f7daf7fe700 1 --2- 172.21.15.146:0/1815328948 >> v2:172.21.15.146:3300/0 conn(0x7f7db01356e0 0x7f7db0137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.626+0000 7f7daf7fe700 1 -- 172.21.15.146:0/1815328948 >> v1:172.21.15.146:6789/0 conn(0x7f7db00a0a30 legacy=0x7f7db00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.626+0000 7f7daf7fe700 1 -- 172.21.15.146:0/1815328948 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db009abc0 con 0x7f7db00a1510 2023-10-03T10:14:17.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.626+0000 7f7daf7fe700 1 --2- 172.21.15.146:0/1815328948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db00a1510 0x7f7db01351a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7da400aa90 tx=0x7f7da400ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e34085e3352d97db server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.626+0000 7f7daeffd700 1 -- 172.21.15.146:0/1815328948 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da400cb70 con 0x7f7db00a1510 2023-10-03T10:14:17.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.626+0000 7f7daeffd700 1 -- 172.21.15.146:0/1815328948 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da400ccd0 con 0x7f7db00a1510 2023-10-03T10:14:17.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.626+0000 7f7daeffd700 1 -- 172.21.15.146:0/1815328948 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da4018620 con 0x7f7db00a1510 2023-10-03T10:14:17.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.627+0000 7f7db65a9700 1 -- 172.21.15.146:0/1815328948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db00a1510 msgr2=0x7f7db01351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.627+0000 7f7db65a9700 1 --2- 172.21.15.146:0/1815328948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db00a1510 0x7f7db01351a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7da400aa90 tx=0x7f7da400ada0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.627+0000 7f7db65a9700 1 -- 172.21.15.146:0/1815328948 shutdown_connections 2023-10-03T10:14:17.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.627+0000 7f7db65a9700 1 --2- 172.21.15.146:0/1815328948 >> v2:172.21.15.146:3300/0 conn(0x7f7db01356e0 0x7f7db0137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.627+0000 7f7db65a9700 1 --2- 172.21.15.146:0/1815328948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db00a1510 0x7f7db01351a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.627+0000 7f7db65a9700 1 -- 172.21.15.146:0/1815328948 >> 172.21.15.146:0/1815328948 conn(0x7f7db00a2980 msgr2=0x7f7db00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.627+0000 7f7db65a9700 1 -- 172.21.15.146:0/1815328948 shutdown_connections 2023-10-03T10:14:17.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.627+0000 7f7db65a9700 1 -- 172.21.15.146:0/1815328948 wait complete. 2023-10-03T10:14:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.628+0000 7f7db65a9700 1 Processor -- start 2023-10-03T10:14:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.628+0000 7f7db65a9700 1 -- start start 2023-10-03T10:14:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.629+0000 7f7db65a9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7db00a0a30 0x7f7db01c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.629+0000 7f7db65a9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7db00a1510 0x7f7db01c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.629+0000 7f7db65a9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db01356e0 0x7f7db01c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.629+0000 7f7db65a9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db0122490 con 0x7f7db00a1510 2023-10-03T10:14:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.629+0000 7f7db65a9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db009ae00 con 0x7f7db01356e0 2023-10-03T10:14:17.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.629+0000 7f7db65a9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7db009ff30 con 0x7f7db00a0a30 2023-10-03T10:14:17.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.629+0000 7f7daf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7db00a1510 0x7f7db01c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.629+0000 7f7daf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7db00a1510 0x7f7db01c13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49480/0 (socket says 172.21.15.146:49480) 2023-10-03T10:14:17.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.629+0000 7f7daf7fe700 1 -- 172.21.15.146:0/4006096623 learned_addr learned my addr 172.21.15.146:0/4006096623 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:17.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.629+0000 7f7db4b46700 1 --2- 172.21.15.146:0/4006096623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db01356e0 0x7f7db01c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.629+0000 7f7db4b46700 1 -- 172.21.15.146:0/4006096623 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7db00a0a30 msgr2=0x7f7db01c0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.629+0000 7f7db4b46700 1 --2- 172.21.15.146:0/4006096623 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7db00a0a30 0x7f7db01c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.629+0000 7f7db4b46700 1 -- 172.21.15.146:0/4006096623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7db00a1510 msgr2=0x7f7db01c13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.629+0000 7f7db4b46700 1 --2- 172.21.15.146:0/4006096623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7db00a1510 0x7f7db01c13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.629+0000 7f7db4b46700 1 -- 172.21.15.146:0/4006096623 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da400a6f0 con 0x7f7db01356e0 2023-10-03T10:14:17.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.630+0000 7f7db4b46700 1 --2- 172.21.15.146:0/4006096623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db01356e0 0x7f7db01c3e90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7da800ef90 tx=0x7f7da800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.630+0000 7f7dacff9700 1 -- 172.21.15.146:0/4006096623 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da800cd40 con 0x7f7db01356e0 2023-10-03T10:14:17.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.630+0000 7f7dacff9700 1 -- 172.21.15.146:0/4006096623 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da800f040 con 0x7f7db01356e0 2023-10-03T10:14:17.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.630+0000 7f7db65a9700 1 -- 172.21.15.146:0/4006096623 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db0121ab0 con 0x7f7db01356e0 2023-10-03T10:14:17.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.630+0000 7f7db65a9700 1 -- 172.21.15.146:0/4006096623 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db0120070 con 0x7f7db01356e0 2023-10-03T10:14:17.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.630+0000 7f7dacff9700 1 -- 172.21.15.146:0/4006096623 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da80146c0 con 0x7f7db01356e0 2023-10-03T10:14:17.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.631+0000 7f7dacff9700 1 -- 172.21.15.146:0/4006096623 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7da8014820 con 0x7f7db01356e0 2023-10-03T10:14:17.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.631+0000 7f7db65a9700 1 -- 172.21.15.146:0/4006096623 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d900052e0 con 0x7f7db01356e0 2023-10-03T10:14:17.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.631+0000 7f7dacff9700 1 -- 172.21.15.146:0/4006096623 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7da8040330 con 0x7f7db01356e0 2023-10-03T10:14:17.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.636+0000 7f7dacff9700 1 -- 172.21.15.146:0/4006096623 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7da8007920 con 0x7f7db01356e0 2023-10-03T10:14:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.660+0000 7f0b457da700 1 Processor -- start 2023-10-03T10:14:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.660+0000 7f1f3ac1f700 1 Processor -- start 2023-10-03T10:14:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.660+0000 7f0b457da700 1 -- start start 2023-10-03T10:14:17.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.660+0000 7f1f3ac1f700 1 -- start start 2023-10-03T10:14:17.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.660+0000 7f0b457da700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b40136950 0x7f0b40138d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.660+0000 7f0b457da700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b40139270 0x7f0b4013b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.660+0000 7f0b457da700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b40133640 con 0x7f0b40133a70 2023-10-03T10:14:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.660+0000 7f0b457da700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b400a1d50 con 0x7f0b40139270 2023-10-03T10:14:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.660+0000 7f0b457da700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b40134550 con 0x7f0b40136950 2023-10-03T10:14:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f0b3effd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0b40133a70 0x7f0b40133e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47296/0 (socket says 172.21.15.146:47296) 2023-10-03T10:14:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f0b3e7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b40136950 0x7f0b40138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f0b3effd700 1 -- 172.21.15.146:0/4190693108 learned_addr learned my addr 172.21.15.146:0/4190693108 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:17.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f1f3ac1f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1f3409d860 0x7f1f3409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f1f3ac1f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f34130eb0 0x7f1f34138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f1f3ac1f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3409aaa0 con 0x7f1f3409e170 2023-10-03T10:14:17.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f1f3ac1f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3409f870 con 0x7f1f3409d860 2023-10-03T10:14:17.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f1f3ac1f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3409b360 con 0x7f1f34130eb0 2023-10-03T10:14:17.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f1f389bb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1f3409d860 0x7f1f3409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f1f389bb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1f3409d860 0x7f1f3409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49498/0 (socket says 172.21.15.146:49498) 2023-10-03T10:14:17.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f1f389bb700 1 -- 172.21.15.146:0/3529253881 learned_addr learned my addr 172.21.15.146:0/3529253881 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:17.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f0b3e7fc700 1 -- 172.21.15.146:0/4190693108 >> v2:172.21.15.146:3300/0 conn(0x7f0b40139270 msgr2=0x7f0b4013b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f0b3e7fc700 1 --2- 172.21.15.146:0/4190693108 >> v2:172.21.15.146:3300/0 conn(0x7f0b40139270 0x7f0b4013b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f0b3e7fc700 1 -- 172.21.15.146:0/4190693108 >> v1:172.21.15.146:6789/0 conn(0x7f0b40133a70 legacy=0x7f0b40133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f0b3e7fc700 1 -- 172.21.15.146:0/4190693108 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4009b620 con 0x7f0b40136950 2023-10-03T10:14:17.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f0b3e7fc700 1 --2- 172.21.15.146:0/4190693108 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b40136950 0x7f0b40138d30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009840 tx=0x7f0b34009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=539438f181fd66a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f1f389bb700 1 -- 172.21.15.146:0/3529253881 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f34130eb0 msgr2=0x7f1f34138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f1f389bb700 1 --2- 172.21.15.146:0/3529253881 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f34130eb0 0x7f1f34138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f1f389bb700 1 -- 172.21.15.146:0/3529253881 >> v1:172.21.15.146:6789/0 conn(0x7f1f3409e170 legacy=0x7f1f341307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f1f389bb700 1 -- 172.21.15.146:0/3529253881 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3409b620 con 0x7f1f3409d860 2023-10-03T10:14:17.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f0b3dffb700 1 -- 172.21.15.146:0/4190693108 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b34011830 con 0x7f0b40136950 2023-10-03T10:14:17.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f0b3dffb700 1 -- 172.21.15.146:0/4190693108 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b34011990 con 0x7f0b40136950 2023-10-03T10:14:17.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.661+0000 7f0b3dffb700 1 -- 172.21.15.146:0/4190693108 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b34011d00 con 0x7f0b40136950 2023-10-03T10:14:17.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.662+0000 7f1f389bb700 1 --2- 172.21.15.146:0/3529253881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f3409d860 0x7f1f3409dc30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800bb90 tx=0x7f1f2800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b03f72f56a52cc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.662+0000 7f1f337fe700 1 -- 172.21.15.146:0/3529253881 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2800dd50 con 0x7f1f3409d860 2023-10-03T10:14:17.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.662+0000 7f1f337fe700 1 -- 172.21.15.146:0/3529253881 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f28010470 con 0x7f1f3409d860 2023-10-03T10:14:17.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.662+0000 7f1f337fe700 1 -- 172.21.15.146:0/3529253881 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f28010800 con 0x7f1f3409d860 2023-10-03T10:14:17.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.662+0000 7f0b457da700 1 -- 172.21.15.146:0/4190693108 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b40136950 msgr2=0x7f0b40138d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.662+0000 7f0b457da700 1 --2- 172.21.15.146:0/4190693108 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b40136950 0x7f0b40138d30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009840 tx=0x7f0b34009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:17.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.662+0000 7f0b457da700 1 -- 172.21.15.146:0/4190693108 shutdown_connections 2023-10-03T10:14:17.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.662+0000 7f0b457da700 1 --2- 172.21.15.146:0/4190693108 >> v2:172.21.15.146:3300/0 conn(0x7f0b40139270 0x7f0b4013b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.662+0000 7f0b457da700 1 --2- 172.21.15.146:0/4190693108 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b40136950 0x7f0b40138d30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.662+0000 7f0b457da700 1 -- 172.21.15.146:0/4190693108 >> 172.21.15.146:0/4190693108 conn(0x7f0b400a2980 msgr2=0x7f0b400a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.662+0000 7f0b457da700 1 -- 172.21.15.146:0/4190693108 shutdown_connections 2023-10-03T10:14:17.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.662+0000 7f0b457da700 1 -- 172.21.15.146:0/4190693108 wait complete. 2023-10-03T10:14:17.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.663+0000 7f1f3ac1f700 1 -- 172.21.15.146:0/3529253881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f3409d860 msgr2=0x7f1f3409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.663+0000 7f1f3ac1f700 1 --2- 172.21.15.146:0/3529253881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f3409d860 0x7f1f3409dc30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800bb90 tx=0x7f1f2800bea0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.663+0000 7f1f3ac1f700 1 -- 172.21.15.146:0/3529253881 shutdown_connections 2023-10-03T10:14:17.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.663+0000 7f1f3ac1f700 1 --2- 172.21.15.146:0/3529253881 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f34130eb0 0x7f1f34138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.663+0000 7f1f3ac1f700 1 --2- 172.21.15.146:0/3529253881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f3409d860 0x7f1f3409dc30 secure :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800bb90 tx=0x7f1f2800bea0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.663+0000 7f1f3ac1f700 1 -- 172.21.15.146:0/3529253881 >> 172.21.15.146:0/3529253881 conn(0x7f1f34099c40 msgr2=0x7f1f340a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.663+0000 7f1f3ac1f700 1 -- 172.21.15.146:0/3529253881 shutdown_connections 2023-10-03T10:14:17.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.663+0000 7f0b457da700 1 Processor -- start 2023-10-03T10:14:17.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.663+0000 7f1f3ac1f700 1 -- 172.21.15.146:0/3529253881 wait complete. 2023-10-03T10:14:17.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.663+0000 7f0b457da700 1 -- start start 2023-10-03T10:14:17.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.664+0000 7f0b457da700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b40133a70 0x7f0b401cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.664+0000 7f0b457da700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b40136950 0x7f0b401ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.664+0000 7f0b457da700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b40139270 0x7f0b401cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.664+0000 7f0b457da700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4012fb60 con 0x7f0b40139270 2023-10-03T10:14:17.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.664+0000 7f0b457da700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b40121a40 con 0x7f0b40133a70 2023-10-03T10:14:17.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.664+0000 7f0b457da700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b40121d90 con 0x7f0b40136950 2023-10-03T10:14:17.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.664+0000 7f0b3effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b40133a70 0x7f0b401cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.664+0000 7f0b3effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b40133a70 0x7f0b401cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49382/0 (socket says 172.21.15.146:49382) 2023-10-03T10:14:17.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.664+0000 7f0b3effd700 1 -- 172.21.15.146:0/3820774214 learned_addr learned my addr 172.21.15.146:0/3820774214 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:17.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.664+0000 7f1f3ac1f700 1 Processor -- start 2023-10-03T10:14:17.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.664+0000 7f1f3ac1f700 1 -- start start 2023-10-03T10:14:17.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.664+0000 7f0b3effd700 1 -- 172.21.15.146:0/3820774214 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b40136950 msgr2=0x7f0b401ccbf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:17.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.664+0000 7f0b3effd700 1 --2- 172.21.15.146:0/3820774214 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b40136950 0x7f0b401ccbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.664+0000 7f0b3effd700 1 -- 172.21.15.146:0/3820774214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b40139270 msgr2=0x7f0b401cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.664+0000 7f0b3effd700 1 --2- 172.21.15.146:0/3820774214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b40139270 0x7f0b401cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.665+0000 7f0b3effd700 1 -- 172.21.15.146:0/3820774214 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b340094a0 con 0x7f0b40133a70 2023-10-03T10:14:17.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.665+0000 7f0b3effd700 1 --2- 172.21.15.146:0/3820774214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b40133a70 0x7f0b401cc6b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000c700 tx=0x7f0b3000cac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.665+0000 7f0b277fe700 1 -- 172.21.15.146:0/3820774214 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b300074e0 con 0x7f0b40133a70 2023-10-03T10:14:17.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.665+0000 7f1f3ac1f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f3409e170 0x7f1f3411c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.665+0000 7f0b277fe700 1 -- 172.21.15.146:0/3820774214 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b30007640 con 0x7f0b40133a70 2023-10-03T10:14:17.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.665+0000 7f0b277fe700 1 -- 172.21.15.146:0/3820774214 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b30005a30 con 0x7f0b40133a70 2023-10-03T10:14:17.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.665+0000 7f0b457da700 1 -- 172.21.15.146:0/3820774214 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b40070a40 con 0x7f0b40133a70 2023-10-03T10:14:17.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.665+0000 7f0b457da700 1 -- 172.21.15.146:0/3820774214 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b4012fd10 con 0x7f0b40133a70 2023-10-03T10:14:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.665+0000 7f1f3ac1f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f34130eb0 0x7f1f3411cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.665+0000 7f1f3ac1f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f3411d150 0x7f1f3412e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.665+0000 7f1f3ac1f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3412f2c0 con 0x7f1f34130eb0 2023-10-03T10:14:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.665+0000 7f1f3ac1f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f340a1f00 con 0x7f1f3411d150 2023-10-03T10:14:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.665+0000 7f1f3ac1f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3411e460 con 0x7f1f3409e170 2023-10-03T10:14:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.665+0000 7f1f391bc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f3411d150 0x7f1f3412e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.666+0000 7f1f391bc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f3411d150 0x7f1f3412e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49388/0 (socket says 172.21.15.146:49388) 2023-10-03T10:14:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.666+0000 7f1f391bc700 1 -- 172.21.15.146:0/606883071 learned_addr learned my addr 172.21.15.146:0/606883071 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.666+0000 7f1f391bc700 1 -- 172.21.15.146:0/606883071 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f3409e170 msgr2=0x7f1f3411c6d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.666+0000 7f1f391bc700 1 --2- 172.21.15.146:0/606883071 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f3409e170 0x7f1f3411c6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.666+0000 7f1f391bc700 1 -- 172.21.15.146:0/606883071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f34130eb0 msgr2=0x7f1f3411cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.666+0000 7f1f391bc700 1 --2- 172.21.15.146:0/606883071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f34130eb0 0x7f1f3411cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.666+0000 7f1f391bc700 1 -- 172.21.15.146:0/606883071 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2800b7f0 con 0x7f1f3411d150 2023-10-03T10:14:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.666+0000 7f0b277fe700 1 -- 172.21.15.146:0/3820774214 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b30005b90 con 0x7f0b40133a70 2023-10-03T10:14:17.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.666+0000 7f1f391bc700 1 --2- 172.21.15.146:0/606883071 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f3411d150 0x7f1f3412e0c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00b970 tx=0x7f1f2c00bd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.666+0000 7f1f317fa700 1 -- 172.21.15.146:0/606883071 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c00c9b0 con 0x7f1f3411d150 2023-10-03T10:14:17.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.666+0000 7f1f317fa700 1 -- 172.21.15.146:0/606883071 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2c00cb30 con 0x7f1f3411d150 2023-10-03T10:14:17.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.666+0000 7f1f317fa700 1 -- 172.21.15.146:0/606883071 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c014440 con 0x7f1f3411d150 2023-10-03T10:14:17.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.666+0000 7f0b457da700 1 -- 172.21.15.146:0/3820774214 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b400709e0 con 0x7f0b40133a70 2023-10-03T10:14:17.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.667+0000 7f0b277fe700 1 -- 172.21.15.146:0/3820774214 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0b30011720 con 0x7f0b40133a70 2023-10-03T10:14:17.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.666+0000 7f1f3ac1f700 1 -- 172.21.15.146:0/606883071 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3411e890 con 0x7f1f3411d150 2023-10-03T10:14:17.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.666+0000 7f1f3ac1f700 1 -- 172.21.15.146:0/606883071 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3411ff10 con 0x7f1f3411d150 2023-10-03T10:14:17.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.668+0000 7f1f3ac1f700 1 -- 172.21.15.146:0/606883071 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3411eb30 con 0x7f1f3411d150 2023-10-03T10:14:17.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.675+0000 7f0b277fe700 1 -- 172.21.15.146:0/3820774214 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b30017030 con 0x7f0b40133a70 2023-10-03T10:14:17.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.676+0000 7f1f317fa700 1 -- 172.21.15.146:0/606883071 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f2c01e440 con 0x7f1f3411d150 2023-10-03T10:14:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.676+0000 7f1f317fa700 1 -- 172.21.15.146:0/606883071 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1f2c006e40 con 0x7f1f3411d150 2023-10-03T10:14:17.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.684+0000 7f1f317fa700 1 -- 172.21.15.146:0/606883071 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f2c013990 con 0x7f1f3411d150 2023-10-03T10:14:17.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.760+0000 7f50ddb44700 1 -- 172.21.15.146:0/3371470629 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f50d804f2a0 con 0x7f50d809f180 2023-10-03T10:14:17.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.761+0000 7f50bffff700 1 -- 172.21.15.146:0/3371470629 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f50cc034090 con 0x7f50d809f180 2023-10-03T10:14:17.762 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:17.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.763+0000 7f50ddb44700 1 -- 172.21.15.146:0/3371470629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50d809f180 msgr2=0x7f50d806c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.763+0000 7f50ddb44700 1 --2- 172.21.15.146:0/3371470629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50d809f180 0x7f50d806c850 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f50cc016000 tx=0x7f50cc004750 comp rx=0 tx=0).stop 2023-10-03T10:14:17.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.763+0000 7f50ddb44700 1 -- 172.21.15.146:0/3371470629 shutdown_connections 2023-10-03T10:14:17.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.763+0000 7f50ddb44700 1 --2- 172.21.15.146:0/3371470629 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50d8131d70 0x7f50d81c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.763+0000 7f50ddb44700 1 --2- 172.21.15.146:0/3371470629 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50d809e870 0x7f50d806c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.763+0000 7f50ddb44700 1 --2- 172.21.15.146:0/3371470629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50d809f180 0x7f50d806c850 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.763+0000 7f50ddb44700 1 -- 172.21.15.146:0/3371470629 >> 172.21.15.146:0/3371470629 conn(0x7f50d80a4430 msgr2=0x7f50d81b9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.763+0000 7f50ddb44700 1 -- 172.21.15.146:0/3371470629 shutdown_connections 2023-10-03T10:14:17.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.764+0000 7f50ddb44700 1 -- 172.21.15.146:0/3371470629 wait complete. 2023-10-03T10:14:17.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:17.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.840+0000 7f7db65a9700 1 -- 172.21.15.146:0/4006096623 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7d90005590 con 0x7f7db01356e0 2023-10-03T10:14:17.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.841+0000 7f7dacff9700 1 -- 172.21.15.146:0/4006096623 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7da8018030 con 0x7f7db01356e0 2023-10-03T10:14:17.841 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:17.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.843+0000 7f7db65a9700 1 -- 172.21.15.146:0/4006096623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db01356e0 msgr2=0x7f7db01c3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.843+0000 7f7db65a9700 1 --2- 172.21.15.146:0/4006096623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db01356e0 0x7f7db01c3e90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7da800ef90 tx=0x7f7da800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.843+0000 7f7db65a9700 1 -- 172.21.15.146:0/4006096623 shutdown_connections 2023-10-03T10:14:17.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.843+0000 7f7db65a9700 1 --2- 172.21.15.146:0/4006096623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db01356e0 0x7f7db01c3e90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.843+0000 7f7db65a9700 1 --2- 172.21.15.146:0/4006096623 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7db00a0a30 0x7f7db01c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.843+0000 7f7db65a9700 1 --2- 172.21.15.146:0/4006096623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7db00a1510 0x7f7db01c13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.843+0000 7f7db65a9700 1 -- 172.21.15.146:0/4006096623 >> 172.21.15.146:0/4006096623 conn(0x7f7db00a2980 msgr2=0x7f7db009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.843+0000 7f7db65a9700 1 -- 172.21.15.146:0/4006096623 shutdown_connections 2023-10-03T10:14:17.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.843+0000 7f7db65a9700 1 -- 172.21.15.146:0/4006096623 wait complete. 2023-10-03T10:14:17.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:17.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.870+0000 7f0b457da700 1 -- 172.21.15.146:0/3820774214 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0b4004f2a0 con 0x7f0b40133a70 2023-10-03T10:14:17.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.871+0000 7f0b277fe700 1 -- 172.21.15.146:0/3820774214 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b30044060 con 0x7f0b40133a70 2023-10-03T10:14:17.872 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:17.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.873+0000 7f0b457da700 1 -- 172.21.15.146:0/3820774214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b40133a70 msgr2=0x7f0b401cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.873+0000 7f0b457da700 1 --2- 172.21.15.146:0/3820774214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b40133a70 0x7f0b401cc6b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000c700 tx=0x7f0b3000cac0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.873+0000 7f0b457da700 1 -- 172.21.15.146:0/3820774214 shutdown_connections 2023-10-03T10:14:17.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.873+0000 7f0b457da700 1 --2- 172.21.15.146:0/3820774214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b40139270 0x7f0b401cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.873+0000 7f0b457da700 1 --2- 172.21.15.146:0/3820774214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b40133a70 0x7f0b401cc6b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.873+0000 7f0b457da700 1 --2- 172.21.15.146:0/3820774214 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b40136950 0x7f0b401ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.873+0000 7f0b457da700 1 -- 172.21.15.146:0/3820774214 >> 172.21.15.146:0/3820774214 conn(0x7f0b400a2980 msgr2=0x7f0b400a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.873+0000 7f0b457da700 1 -- 172.21.15.146:0/3820774214 shutdown_connections 2023-10-03T10:14:17.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.873+0000 7f0b457da700 1 -- 172.21.15.146:0/3820774214 wait complete. 2023-10-03T10:14:17.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:17.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.892+0000 7f1f3ac1f700 1 -- 172.21.15.146:0/606883071 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1f3404f2a0 con 0x7f1f3411d150 2023-10-03T10:14:17.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.892+0000 7f1f317fa700 1 -- 172.21.15.146:0/606883071 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f2c019030 con 0x7f1f3411d150 2023-10-03T10:14:17.893 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:17.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.894+0000 7f1f3ac1f700 1 -- 172.21.15.146:0/606883071 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f3411d150 msgr2=0x7f1f3412e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.894+0000 7f1f3ac1f700 1 --2- 172.21.15.146:0/606883071 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f3411d150 0x7f1f3412e0c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00b970 tx=0x7f1f2c00bd30 comp rx=0 tx=0).stop 2023-10-03T10:14:17.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.894+0000 7f1f3ac1f700 1 -- 172.21.15.146:0/606883071 shutdown_connections 2023-10-03T10:14:17.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.894+0000 7f1f3ac1f700 1 --2- 172.21.15.146:0/606883071 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f3411d150 0x7f1f3412e0c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.894+0000 7f1f3ac1f700 1 --2- 172.21.15.146:0/606883071 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f3409e170 0x7f1f3411c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.894+0000 7f1f3ac1f700 1 --2- 172.21.15.146:0/606883071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f34130eb0 0x7f1f3411cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.894+0000 7f1f3ac1f700 1 -- 172.21.15.146:0/606883071 >> 172.21.15.146:0/606883071 conn(0x7f1f34099c40 msgr2=0x7f1f340a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.894+0000 7f1f3ac1f700 1 -- 172.21.15.146:0/606883071 shutdown_connections 2023-10-03T10:14:17.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:17.894+0000 7f1f3ac1f700 1 -- 172.21.15.146:0/606883071 wait complete. 2023-10-03T10:14:17.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:18.777 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:18.857 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:18.887 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:18.907 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:18.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.907+0000 7f0038865700 1 Processor -- start 2023-10-03T10:14:18.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.907+0000 7f0038865700 1 -- start start 2023-10-03T10:14:18.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.908+0000 7f0038865700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0034099e20 0x7f003409a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.908+0000 7f0038865700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f003409a730 0x7f0034130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.908+0000 7f0038865700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0034130890 0x7f0034130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.908+0000 7f0038865700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f003409bf50 con 0x7f0034130890 2023-10-03T10:14:18.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.908+0000 7f0038865700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0034099a60 con 0x7f0034099e20 2023-10-03T10:14:18.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.908+0000 7f0038865700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f003409b230 con 0x7f003409a730 2023-10-03T10:14:18.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.908+0000 7f0032d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0034130890 0x7f0034130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.908+0000 7f0031d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f003409a730 0x7f0034130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.908+0000 7f0031d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f003409a730 0x7f0034130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46788/0 (socket says 172.21.15.146:46788) 2023-10-03T10:14:18.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.908+0000 7f0032d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0034130890 0x7f0034130d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49528/0 (socket says 172.21.15.146:49528) 2023-10-03T10:14:18.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.908+0000 7f0031d9b700 1 -- 172.21.15.146:0/573293971 learned_addr learned my addr 172.21.15.146:0/573293971 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:18.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.908+0000 7f003259c700 1 --2- 172.21.15.146:0/573293971 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0034099e20 0x7f003409a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.908+0000 7f0032d9d700 1 -- 172.21.15.146:0/573293971 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f003409a730 msgr2=0x7f0034130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:18.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.908+0000 7f0032d9d700 1 --2- 172.21.15.146:0/573293971 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f003409a730 0x7f0034130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.908+0000 7f0032d9d700 1 -- 172.21.15.146:0/573293971 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0034099e20 msgr2=0x7f003409a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:18.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.909+0000 7f0032d9d700 1 --2- 172.21.15.146:0/573293971 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0034099e20 0x7f003409a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.909+0000 7f0032d9d700 1 -- 172.21.15.146:0/573293971 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003409bb90 con 0x7f0034130890 2023-10-03T10:14:18.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.909+0000 7f0032d9d700 1 --2- 172.21.15.146:0/573293971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0034130890 0x7f0034130d00 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f002c00f370 tx=0x7f002c00f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2cd41849819f07 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.909+0000 7f003159a700 1 -- 172.21.15.146:0/573293971 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c012070 con 0x7f0034130890 2023-10-03T10:14:18.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.909+0000 7f003159a700 1 -- 172.21.15.146:0/573293971 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002c00fe70 con 0x7f0034130890 2023-10-03T10:14:18.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.909+0000 7f003159a700 1 -- 172.21.15.146:0/573293971 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c00d2f0 con 0x7f0034130890 2023-10-03T10:14:18.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.910+0000 7f0038865700 1 -- 172.21.15.146:0/573293971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0034130890 msgr2=0x7f0034130d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.910+0000 7f0038865700 1 --2- 172.21.15.146:0/573293971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0034130890 0x7f0034130d00 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f002c00f370 tx=0x7f002c00f680 comp rx=0 tx=0).stop 2023-10-03T10:14:18.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.910+0000 7f0038865700 1 -- 172.21.15.146:0/573293971 shutdown_connections 2023-10-03T10:14:18.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.910+0000 7f0038865700 1 --2- 172.21.15.146:0/573293971 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0034099e20 0x7f003409a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.910+0000 7f0038865700 1 --2- 172.21.15.146:0/573293971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0034130890 0x7f0034130d00 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.910+0000 7f0038865700 1 --2- 172.21.15.146:0/573293971 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f003409a730 0x7f0034130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.910+0000 7f0038865700 1 -- 172.21.15.146:0/573293971 >> 172.21.15.146:0/573293971 conn(0x7f00340a2980 msgr2=0x7f00340a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.910+0000 7f0038865700 1 -- 172.21.15.146:0/573293971 shutdown_connections 2023-10-03T10:14:18.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.910+0000 7f0038865700 1 -- 172.21.15.146:0/573293971 wait complete. 2023-10-03T10:14:18.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.912+0000 7f0038865700 1 Processor -- start 2023-10-03T10:14:18.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.912+0000 7f0038865700 1 -- start start 2023-10-03T10:14:18.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.912+0000 7f0038865700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0034099e20 0x7f00341196f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.912+0000 7f0038865700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f003409a730 0x7f0034119c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.912+0000 7f0038865700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0034130890 0x7f003411a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.912+0000 7f0038865700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003411b300 con 0x7f0034099e20 2023-10-03T10:14:18.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.912+0000 7f0038865700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003411c550 con 0x7f003409a730 2023-10-03T10:14:18.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.912+0000 7f0038865700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f003411b8f0 con 0x7f0034130890 2023-10-03T10:14:18.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.913+0000 7f003259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0034099e20 0x7f00341196f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.913+0000 7f003259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0034099e20 0x7f00341196f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49544/0 (socket says 172.21.15.146:49544) 2023-10-03T10:14:18.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.913+0000 7f003259c700 1 -- 172.21.15.146:0/3966522229 learned_addr learned my addr 172.21.15.146:0/3966522229 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:18.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.913+0000 7f0031d9b700 1 --2- 172.21.15.146:0/3966522229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f003409a730 0x7f0034119c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.913+0000 7f0032d9d700 1 --2- 172.21.15.146:0/3966522229 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0034130890 0x7f003411a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.913+0000 7f0032d9d700 1 -- 172.21.15.146:0/3966522229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f003409a730 msgr2=0x7f0034119c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.913+0000 7f0032d9d700 1 --2- 172.21.15.146:0/3966522229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f003409a730 0x7f0034119c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.913+0000 7f0032d9d700 1 -- 172.21.15.146:0/3966522229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0034099e20 msgr2=0x7f00341196f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.913+0000 7f0032d9d700 1 --2- 172.21.15.146:0/3966522229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0034099e20 0x7f00341196f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.913+0000 7f0032d9d700 1 -- 172.21.15.146:0/3966522229 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c00f050 con 0x7f0034130890 2023-10-03T10:14:18.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.913+0000 7f003259c700 1 --2- 172.21.15.146:0/3966522229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0034099e20 0x7f00341196f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:18.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.913+0000 7f0032d9d700 1 --2- 172.21.15.146:0/3966522229 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0034130890 0x7f003411a170 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f00340721d0 tx=0x7f002c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.913+0000 7f0022ffd700 1 -- 172.21.15.146:0/3966522229 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c00bb50 con 0x7f0034130890 2023-10-03T10:14:18.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.913+0000 7f0022ffd700 1 -- 172.21.15.146:0/3966522229 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002c00bcb0 con 0x7f0034130890 2023-10-03T10:14:18.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.913+0000 7f0038865700 1 -- 172.21.15.146:0/3966522229 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f003411c9a0 con 0x7f0034130890 2023-10-03T10:14:18.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.914+0000 7f0038865700 1 -- 172.21.15.146:0/3966522229 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003412fe80 con 0x7f0034130890 2023-10-03T10:14:18.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.914+0000 7f0022ffd700 1 -- 172.21.15.146:0/3966522229 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c004280 con 0x7f0034130890 2023-10-03T10:14:18.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.915+0000 7f0038865700 1 -- 172.21.15.146:0/3966522229 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00180052e0 con 0x7f0034130890 2023-10-03T10:14:18.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.916+0000 7f0022ffd700 1 -- 172.21.15.146:0/3966522229 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f002c0043e0 con 0x7f0034130890 2023-10-03T10:14:18.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.916+0000 7f0022ffd700 1 -- 172.21.15.146:0/3966522229 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f002c045ab0 con 0x7f0034130890 2023-10-03T10:14:18.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:18.921+0000 7f0022ffd700 1 -- 172.21.15.146:0/3966522229 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f002c003e10 con 0x7f0034130890 2023-10-03T10:14:19.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.000+0000 7f8705589700 1 Processor -- start 2023-10-03T10:14:19.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.000+0000 7f8705589700 1 -- start start 2023-10-03T10:14:19.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.000+0000 7f8705589700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f870009e870 0x7f870009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.000+0000 7f8705589700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8700134330 0x7f870013be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.000+0000 7f8705589700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f870009fa00 con 0x7f870009f180 2023-10-03T10:14:19.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.000+0000 7f8705589700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87000a0370 con 0x7f8700134330 2023-10-03T10:14:19.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.000+0000 7f8705589700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f870006bec0 con 0x7f870009e870 2023-10-03T10:14:19.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.001+0000 7f86ff7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8700134330 0x7f870013be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.001+0000 7f86feffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f870009e870 0x7f870009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.001+0000 7f86ff7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8700134330 0x7f870013be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49556/0 (socket says 172.21.15.146:49556) 2023-10-03T10:14:19.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.001+0000 7f86ff7fe700 1 -- 172.21.15.146:0/1266758355 learned_addr learned my addr 172.21.15.146:0/1266758355 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:19.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.001+0000 7f86feffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f870009e870 0x7f870009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46802/0 (socket says 172.21.15.146:46802) 2023-10-03T10:14:19.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.001+0000 7f86fe7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f870009f180 0x7f8700133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47310/0 (socket says 172.21.15.146:47310) 2023-10-03T10:14:19.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.001+0000 7f86ff7fe700 1 -- 172.21.15.146:0/1266758355 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f870009e870 msgr2=0x7f870009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:19.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.001+0000 7f86ff7fe700 1 --2- 172.21.15.146:0/1266758355 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f870009e870 0x7f870009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.001+0000 7f86ff7fe700 1 -- 172.21.15.146:0/1266758355 >> v1:172.21.15.146:6789/0 conn(0x7f870009f180 legacy=0x7f8700133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.001+0000 7f86fdffb700 1 -- 172.21.15.146:0/1266758355 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077310350 0 0) 0x7f870009fa00 con 0x7f870009f180 2023-10-03T10:14:19.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.001+0000 7f86ff7fe700 1 -- 172.21.15.146:0/1266758355 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870009ada0 con 0x7f8700134330 2023-10-03T10:14:19.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.001+0000 7f86feffd700 1 --2- 172.21.15.146:0/1266758355 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f870009e870 0x7f870009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:19.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.001+0000 7f86ff7fe700 1 --2- 172.21.15.146:0/1266758355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8700134330 0x7f870013be80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009e50 tx=0x7f86f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86cede07536c18d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:19.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.001+0000 7f86fdffb700 1 -- 172.21.15.146:0/1266758355 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f800e070 con 0x7f8700134330 2023-10-03T10:14:19.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.001+0000 7f86fdffb700 1 -- 172.21.15.146:0/1266758355 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f800b910 con 0x7f8700134330 2023-10-03T10:14:19.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.001+0000 7f86fdffb700 1 -- 172.21.15.146:0/1266758355 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f800bcc0 con 0x7f8700134330 2023-10-03T10:14:19.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.002+0000 7f8705589700 1 -- 172.21.15.146:0/1266758355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8700134330 msgr2=0x7f870013be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.002+0000 7f8705589700 1 --2- 172.21.15.146:0/1266758355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8700134330 0x7f870013be80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009e50 tx=0x7f86f800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:19.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.002+0000 7f8705589700 1 -- 172.21.15.146:0/1266758355 shutdown_connections 2023-10-03T10:14:19.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.002+0000 7f8705589700 1 --2- 172.21.15.146:0/1266758355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8700134330 0x7f870013be80 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.002+0000 7f8705589700 1 --2- 172.21.15.146:0/1266758355 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f870009e870 0x7f870009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.002+0000 7f8705589700 1 -- 172.21.15.146:0/1266758355 >> 172.21.15.146:0/1266758355 conn(0x7f87000a4430 msgr2=0x7f87000a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.003+0000 7f8705589700 1 -- 172.21.15.146:0/1266758355 shutdown_connections 2023-10-03T10:14:19.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.003+0000 7f8705589700 1 -- 172.21.15.146:0/1266758355 wait complete. 2023-10-03T10:14:19.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.004+0000 7f8705589700 1 Processor -- start 2023-10-03T10:14:19.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.004+0000 7f8705589700 1 -- start start 2023-10-03T10:14:19.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.005+0000 7f8705589700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f870009e870 0x7f87001cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.005+0000 7f8705589700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f870009f180 0x7f87001ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.005+0000 7f8705589700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8700134330 0x7f87001cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.005+0000 7f8705589700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87001331c0 con 0x7f8700134330 2023-10-03T10:14:19.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.005+0000 7f8705589700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8700129eb0 con 0x7f870009f180 2023-10-03T10:14:19.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.005+0000 7f8705589700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87001272e0 con 0x7f870009e870 2023-10-03T10:14:19.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.005+0000 7f86feffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f870009e870 0x7f87001cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.005+0000 7f86ff7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8700134330 0x7f87001cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.005+0000 7f86fe7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f870009f180 0x7f87001ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.005+0000 7f86feffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f870009e870 0x7f87001cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46804/0 (socket says 172.21.15.146:46804) 2023-10-03T10:14:19.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.005+0000 7f86ff7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8700134330 0x7f87001cd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49572/0 (socket says 172.21.15.146:49572) 2023-10-03T10:14:19.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.005+0000 7f86feffd700 1 -- 172.21.15.146:0/847291332 learned_addr learned my addr 172.21.15.146:0/847291332 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:19.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.005+0000 7f86ff7fe700 1 -- 172.21.15.146:0/847291332 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f870009e870 msgr2=0x7f87001cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.005+0000 7f86ff7fe700 1 --2- 172.21.15.146:0/847291332 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f870009e870 0x7f87001cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.005+0000 7f86ff7fe700 1 -- 172.21.15.146:0/847291332 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f870009f180 msgr2=0x7f87001ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.005+0000 7f86ff7fe700 1 --2- 172.21.15.146:0/847291332 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f870009f180 0x7f87001ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.005+0000 7f86ff7fe700 1 -- 172.21.15.146:0/847291332 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f00094a0 con 0x7f8700134330 2023-10-03T10:14:19.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.005+0000 7f86ff7fe700 1 --2- 172.21.15.146:0/847291332 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8700134330 0x7f87001cd270 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f86f8015000 tx=0x7f86f8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:19.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.006+0000 7f86e77fe700 1 -- 172.21.15.146:0/847291332 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8004880 con 0x7f8700134330 2023-10-03T10:14:19.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.006+0000 7f86e77fe700 1 -- 172.21.15.146:0/847291332 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f80092e0 con 0x7f8700134330 2023-10-03T10:14:19.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.006+0000 7f86e77fe700 1 -- 172.21.15.146:0/847291332 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f801c630 con 0x7f8700134330 2023-10-03T10:14:19.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.006+0000 7f8705589700 1 -- 172.21.15.146:0/847291332 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f8009b30 con 0x7f8700134330 2023-10-03T10:14:19.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.006+0000 7f8705589700 1 -- 172.21.15.146:0/847291332 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870011dd90 con 0x7f8700134330 2023-10-03T10:14:19.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.007+0000 7f86e77fe700 1 -- 172.21.15.146:0/847291332 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f86f801c790 con 0x7f8700134330 2023-10-03T10:14:19.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.007+0000 7f86e77fe700 1 -- 172.21.15.146:0/847291332 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f86f8041570 con 0x7f8700134330 2023-10-03T10:14:19.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.008+0000 7f8705589700 1 -- 172.21.15.146:0/847291332 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8700129ad0 con 0x7f8700134330 2023-10-03T10:14:19.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.012+0000 7f86e77fe700 1 -- 172.21.15.146:0/847291332 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86f8024400 con 0x7f8700134330 2023-10-03T10:14:19.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.032+0000 7ff0228e7700 1 Processor -- start 2023-10-03T10:14:19.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.032+0000 7ff0228e7700 1 -- start start 2023-10-03T10:14:19.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.032+0000 7ff0228e7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff01c09d860 0x7ff01c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.032+0000 7ff0228e7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff01c130eb0 0x7ff01c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.032+0000 7ff0228e7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01c09aaa0 con 0x7ff01c09e170 2023-10-03T10:14:19.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.032+0000 7ff0228e7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01c09f870 con 0x7ff01c09d860 2023-10-03T10:14:19.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.032+0000 7ff0228e7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c09b360 con 0x7ff01c130eb0 2023-10-03T10:14:19.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.032+0000 7ff020e84700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff01c130eb0 0x7ff01c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.032+0000 7ff020e84700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff01c130eb0 0x7ff01c138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49438/0 (socket says 172.21.15.146:49438) 2023-10-03T10:14:19.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.032+0000 7ff020e84700 1 -- 172.21.15.146:0/119846868 learned_addr learned my addr 172.21.15.146:0/119846868 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:19.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.033+0000 7ff01bfff700 1 --2- 172.21.15.146:0/119846868 >> v2:172.21.15.146:3300/0 conn(0x7ff01c09d860 0x7ff01c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.033+0000 7ff020e84700 1 -- 172.21.15.146:0/119846868 >> v2:172.21.15.146:3300/0 conn(0x7ff01c09d860 msgr2=0x7ff01c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:19.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.033+0000 7ff020e84700 1 --2- 172.21.15.146:0/119846868 >> v2:172.21.15.146:3300/0 conn(0x7ff01c09d860 0x7ff01c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.033+0000 7ff020e84700 1 -- 172.21.15.146:0/119846868 >> v1:172.21.15.146:6789/0 conn(0x7ff01c09e170 legacy=0x7ff01c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:19.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.033+0000 7ff020e84700 1 -- 172.21.15.146:0/119846868 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c09b620 con 0x7ff01c130eb0 2023-10-03T10:14:19.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.033+0000 7ff01bfff700 1 --2- 172.21.15.146:0/119846868 >> v2:172.21.15.146:3300/0 conn(0x7ff01c09d860 0x7ff01c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:19.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.033+0000 7ff020e84700 1 --2- 172.21.15.146:0/119846868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff01c130eb0 0x7ff01c138a00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff01400d150 tx=0x7ff01400d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75bee663b91585ee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:19.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.033+0000 7ff01affd700 1 -- 172.21.15.146:0/119846868 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff014010070 con 0x7ff01c130eb0 2023-10-03T10:14:19.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.033+0000 7ff01affd700 1 -- 172.21.15.146:0/119846868 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01400ddc0 con 0x7ff01c130eb0 2023-10-03T10:14:19.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.033+0000 7ff01affd700 1 -- 172.21.15.146:0/119846868 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01400b310 con 0x7ff01c130eb0 2023-10-03T10:14:19.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.034+0000 7ff0228e7700 1 -- 172.21.15.146:0/119846868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff01c130eb0 msgr2=0x7ff01c138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.034+0000 7ff0228e7700 1 --2- 172.21.15.146:0/119846868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff01c130eb0 0x7ff01c138a00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff01400d150 tx=0x7ff01400d460 comp rx=0 tx=0).stop 2023-10-03T10:14:19.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.034+0000 7ff0228e7700 1 -- 172.21.15.146:0/119846868 shutdown_connections 2023-10-03T10:14:19.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.034+0000 7ff0228e7700 1 --2- 172.21.15.146:0/119846868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff01c130eb0 0x7ff01c138a00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.034+0000 7ff0228e7700 1 --2- 172.21.15.146:0/119846868 >> v2:172.21.15.146:3300/0 conn(0x7ff01c09d860 0x7ff01c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.034+0000 7ff0228e7700 1 -- 172.21.15.146:0/119846868 >> 172.21.15.146:0/119846868 conn(0x7ff01c099c40 msgr2=0x7ff01c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.034+0000 7ff0228e7700 1 -- 172.21.15.146:0/119846868 shutdown_connections 2023-10-03T10:14:19.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.034+0000 7ff0228e7700 1 -- 172.21.15.146:0/119846868 wait complete. 2023-10-03T10:14:19.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.035+0000 7ff0228e7700 1 Processor -- start 2023-10-03T10:14:19.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.035+0000 7ff0228e7700 1 -- start start 2023-10-03T10:14:19.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.036+0000 7ff0228e7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff01c09d860 0x7ff01c1cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.036+0000 7ff0228e7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff01c09e170 0x7ff01c1ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.036+0000 7ff0228e7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff01c130eb0 0x7ff01c1cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.036+0000 7ff0228e7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c129ae0 con 0x7ff01c09e170 2023-10-03T10:14:19.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.036+0000 7ff0228e7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c129640 con 0x7ff01c09d860 2023-10-03T10:14:19.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.036+0000 7ff0228e7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c09c8b0 con 0x7ff01c130eb0 2023-10-03T10:14:19.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.036+0000 7ff01bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff01c09d860 0x7ff01c1cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.036+0000 7ff01bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff01c09d860 0x7ff01c1cc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49446/0 (socket says 172.21.15.146:49446) 2023-10-03T10:14:19.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.036+0000 7ff01bfff700 1 -- 172.21.15.146:0/3191883178 learned_addr learned my addr 172.21.15.146:0/3191883178 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:19.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.036+0000 7ff01b7fe700 1 --2- 172.21.15.146:0/3191883178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff01c09e170 0x7ff01c1ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.036+0000 7ff020e84700 1 --2- 172.21.15.146:0/3191883178 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff01c130eb0 0x7ff01c1cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.036+0000 7ff01bfff700 1 -- 172.21.15.146:0/3191883178 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff01c130eb0 msgr2=0x7ff01c1cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.036+0000 7ff01bfff700 1 --2- 172.21.15.146:0/3191883178 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff01c130eb0 0x7ff01c1cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.036+0000 7ff01bfff700 1 -- 172.21.15.146:0/3191883178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff01c09e170 msgr2=0x7ff01c1ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.036+0000 7ff01bfff700 1 --2- 172.21.15.146:0/3191883178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff01c09e170 0x7ff01c1ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.036+0000 7ff01bfff700 1 -- 172.21.15.146:0/3191883178 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01400bd40 con 0x7ff01c09d860 2023-10-03T10:14:19.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.036+0000 7ff01bfff700 1 --2- 172.21.15.146:0/3191883178 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff01c09d860 0x7ff01c1cc5f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00c750 tx=0x7ff00c00ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:19.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.037+0000 7ff020e84700 1 --2- 172.21.15.146:0/3191883178 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff01c130eb0 0x7ff01c1cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:19.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.037+0000 7ff018ff9700 1 -- 172.21.15.146:0/3191883178 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c011800 con 0x7ff01c09d860 2023-10-03T10:14:19.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.037+0000 7ff018ff9700 1 -- 172.21.15.146:0/3191883178 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00c011960 con 0x7ff01c09d860 2023-10-03T10:14:19.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.037+0000 7ff0228e7700 1 -- 172.21.15.146:0/3191883178 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01c12a340 con 0x7ff01c09d860 2023-10-03T10:14:19.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.037+0000 7ff018ff9700 1 -- 172.21.15.146:0/3191883178 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c011cd0 con 0x7ff01c09d860 2023-10-03T10:14:19.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.037+0000 7ff0228e7700 1 -- 172.21.15.146:0/3191883178 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01c1289d0 con 0x7ff01c09d860 2023-10-03T10:14:19.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.038+0000 7ff018ff9700 1 -- 172.21.15.146:0/3191883178 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff00c010350 con 0x7ff01c09d860 2023-10-03T10:14:19.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.038+0000 7ff0228e7700 1 -- 172.21.15.146:0/3191883178 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01c09ee80 con 0x7ff01c09d860 2023-10-03T10:14:19.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.038+0000 7ff018ff9700 1 -- 172.21.15.146:0/3191883178 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff00c040df0 con 0x7ff01c09d860 2023-10-03T10:14:19.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.043+0000 7ff018ff9700 1 -- 172.21.15.146:0/3191883178 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff00c044060 con 0x7ff01c09d860 2023-10-03T10:14:19.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.049+0000 7f197a5b0700 1 Processor -- start 2023-10-03T10:14:19.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.049+0000 7f197a5b0700 1 -- start start 2023-10-03T10:14:19.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.049+0000 7f197a5b0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f197409d8f0 0x7f197409dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.049+0000 7f197a5b0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19741387c0 0x7f1974140310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.049+0000 7f197a5b0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1974098680 con 0x7f197409e200 2023-10-03T10:14:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.049+0000 7f197a5b0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1974099560 con 0x7f19741387c0 2023-10-03T10:14:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.049+0000 7f197a5b0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1974098bb0 con 0x7f197409d8f0 2023-10-03T10:14:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.049+0000 7f1973fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f197409d8f0 0x7f197409dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.049+0000 7f19737fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f197409e200 0x7f19741380b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47324/0 (socket says 172.21.15.146:47324) 2023-10-03T10:14:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.049+0000 7f1973fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f197409d8f0 0x7f197409dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46814/0 (socket says 172.21.15.146:46814) 2023-10-03T10:14:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.049+0000 7f19737fe700 1 -- 172.21.15.146:0/1156074232 learned_addr learned my addr 172.21.15.146:0/1156074232 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.049+0000 7f1978b4d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19741387c0 0x7f1974140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.050+0000 7f1973fff700 1 -- 172.21.15.146:0/1156074232 >> v2:172.21.15.146:3300/0 conn(0x7f19741387c0 msgr2=0x7f1974140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.050+0000 7f1973fff700 1 --2- 172.21.15.146:0/1156074232 >> v2:172.21.15.146:3300/0 conn(0x7f19741387c0 0x7f1974140310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.050+0000 7f1973fff700 1 -- 172.21.15.146:0/1156074232 >> v1:172.21.15.146:6789/0 conn(0x7f197409e200 legacy=0x7f19741380b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.050+0000 7f1973fff700 1 -- 172.21.15.146:0/1156074232 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19740980f0 con 0x7f197409d8f0 2023-10-03T10:14:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.050+0000 7f1973fff700 1 --2- 172.21.15.146:0/1156074232 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f197409d8f0 0x7f197409dcc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1964009820 tx=0x7f1964009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8bfc99aeb9e58af server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.050+0000 7f1972ffd700 1 -- 172.21.15.146:0/1156074232 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964005e30 con 0x7f197409d8f0 2023-10-03T10:14:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.050+0000 7f1972ffd700 1 -- 172.21.15.146:0/1156074232 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1964004030 con 0x7f197409d8f0 2023-10-03T10:14:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.050+0000 7f1972ffd700 1 -- 172.21.15.146:0/1156074232 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19640043c0 con 0x7f197409d8f0 2023-10-03T10:14:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.051+0000 7f197a5b0700 1 -- 172.21.15.146:0/1156074232 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f197409d8f0 msgr2=0x7f197409dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.051+0000 7f197a5b0700 1 --2- 172.21.15.146:0/1156074232 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f197409d8f0 0x7f197409dcc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1964009820 tx=0x7f1964009b30 comp rx=0 tx=0).stop 2023-10-03T10:14:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.051+0000 7f197a5b0700 1 -- 172.21.15.146:0/1156074232 shutdown_connections 2023-10-03T10:14:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.051+0000 7f197a5b0700 1 --2- 172.21.15.146:0/1156074232 >> v2:172.21.15.146:3300/0 conn(0x7f19741387c0 0x7f1974140310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.051+0000 7f197a5b0700 1 --2- 172.21.15.146:0/1156074232 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f197409d8f0 0x7f197409dcc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.051+0000 7f197a5b0700 1 -- 172.21.15.146:0/1156074232 >> 172.21.15.146:0/1156074232 conn(0x7f19740a2b30 msgr2=0x7f197409e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.051+0000 7f197a5b0700 1 -- 172.21.15.146:0/1156074232 shutdown_connections 2023-10-03T10:14:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.051+0000 7f197a5b0700 1 -- 172.21.15.146:0/1156074232 wait complete. 2023-10-03T10:14:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.052+0000 7f197a5b0700 1 Processor -- start 2023-10-03T10:14:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.052+0000 7f197a5b0700 1 -- start start 2023-10-03T10:14:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.053+0000 7f197a5b0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f197409d8f0 0x7f1974136840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.053+0000 7f197a5b0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f197409e200 0x7f1974136d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.053+0000 7f197a5b0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19741387c0 0x7f197406e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.053+0000 7f197a5b0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1974070130 con 0x7f19741387c0 2023-10-03T10:14:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.053+0000 7f197a5b0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1974137d50 con 0x7f197409e200 2023-10-03T10:14:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.053+0000 7f197a5b0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1974072040 con 0x7f197409d8f0 2023-10-03T10:14:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.053+0000 7f19737fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f197409e200 0x7f1974136d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.053+0000 7f19737fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f197409e200 0x7f1974136d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49454/0 (socket says 172.21.15.146:49454) 2023-10-03T10:14:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.053+0000 7f19737fe700 1 -- 172.21.15.146:0/192093786 learned_addr learned my addr 172.21.15.146:0/192093786 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.053+0000 7f1978b4d700 1 --2- 172.21.15.146:0/192093786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19741387c0 0x7f197406e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.053+0000 7f1973fff700 1 --2- 172.21.15.146:0/192093786 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f197409d8f0 0x7f1974136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.053+0000 7f19737fe700 1 -- 172.21.15.146:0/192093786 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f197409d8f0 msgr2=0x7f1974136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.053+0000 7f19737fe700 1 --2- 172.21.15.146:0/192093786 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f197409d8f0 0x7f1974136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.053+0000 7f19737fe700 1 -- 172.21.15.146:0/192093786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19741387c0 msgr2=0x7f197406e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.053+0000 7f19737fe700 1 --2- 172.21.15.146:0/192093786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19741387c0 0x7f197406e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.053+0000 7f19737fe700 1 -- 172.21.15.146:0/192093786 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1964009430 con 0x7f197409e200 2023-10-03T10:14:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.053+0000 7f19737fe700 1 --2- 172.21.15.146:0/192093786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f197409e200 0x7f1974136d80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f196800c750 tx=0x7f196800ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.054+0000 7f1970ff9700 1 -- 172.21.15.146:0/192093786 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1968004c80 con 0x7f197409e200 2023-10-03T10:14:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.054+0000 7f1970ff9700 1 -- 172.21.15.146:0/192093786 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1968004de0 con 0x7f197409e200 2023-10-03T10:14:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.054+0000 7f1970ff9700 1 -- 172.21.15.146:0/192093786 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1968007310 con 0x7f197409e200 2023-10-03T10:14:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.054+0000 7f197a5b0700 1 -- 172.21.15.146:0/192093786 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1974138140 con 0x7f197409e200 2023-10-03T10:14:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.054+0000 7f197a5b0700 1 -- 172.21.15.146:0/192093786 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1974071d60 con 0x7f197409e200 2023-10-03T10:14:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.055+0000 7f1970ff9700 1 -- 172.21.15.146:0/192093786 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1968007470 con 0x7f197409e200 2023-10-03T10:14:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.055+0000 7f1970ff9700 1 -- 172.21.15.146:0/192093786 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f196803e8a0 con 0x7f197409e200 2023-10-03T10:14:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.055+0000 7f197a5b0700 1 -- 172.21.15.146:0/192093786 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1974097f20 con 0x7f197409e200 2023-10-03T10:14:19.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.064+0000 7f1970ff9700 1 -- 172.21.15.146:0/192093786 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1968018030 con 0x7f197409e200 2023-10-03T10:14:19.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.127+0000 7f0038865700 1 -- 172.21.15.146:0/3966522229 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0018005860 con 0x7f0034130890 2023-10-03T10:14:19.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.127+0000 7f0022ffd700 1 -- 172.21.15.146:0/3966522229 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f002c01f3a0 con 0x7f0034130890 2023-10-03T10:14:19.128 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:19.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.129+0000 7f0038865700 1 -- 172.21.15.146:0/3966522229 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0034130890 msgr2=0x7f003411a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.129+0000 7f0038865700 1 --2- 172.21.15.146:0/3966522229 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0034130890 0x7f003411a170 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f00340721d0 tx=0x7f002c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.130+0000 7f0038865700 1 -- 172.21.15.146:0/3966522229 shutdown_connections 2023-10-03T10:14:19.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.130+0000 7f0038865700 1 --2- 172.21.15.146:0/3966522229 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0034130890 0x7f003411a170 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.130+0000 7f0038865700 1 --2- 172.21.15.146:0/3966522229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0034099e20 0x7f00341196f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.130+0000 7f0038865700 1 --2- 172.21.15.146:0/3966522229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f003409a730 0x7f0034119c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.130+0000 7f0038865700 1 -- 172.21.15.146:0/3966522229 >> 172.21.15.146:0/3966522229 conn(0x7f00340a2980 msgr2=0x7f003412d820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.130+0000 7f0038865700 1 -- 172.21.15.146:0/3966522229 shutdown_connections 2023-10-03T10:14:19.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.130+0000 7f0038865700 1 -- 172.21.15.146:0/3966522229 wait complete. 2023-10-03T10:14:19.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:19.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.212+0000 7f8705589700 1 -- 172.21.15.146:0/847291332 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f870006c9d0 con 0x7f8700134330 2023-10-03T10:14:19.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.212+0000 7f86e77fe700 1 -- 172.21.15.146:0/847291332 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f86f802c800 con 0x7f8700134330 2023-10-03T10:14:19.214 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:19.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.214+0000 7f8705589700 1 -- 172.21.15.146:0/847291332 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8700134330 msgr2=0x7f87001cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.214+0000 7f8705589700 1 --2- 172.21.15.146:0/847291332 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8700134330 0x7f87001cd270 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f86f8015000 tx=0x7f86f8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.214+0000 7f8705589700 1 -- 172.21.15.146:0/847291332 shutdown_connections 2023-10-03T10:14:19.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.214+0000 7f8705589700 1 --2- 172.21.15.146:0/847291332 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8700134330 0x7f87001cd270 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.214+0000 7f8705589700 1 --2- 172.21.15.146:0/847291332 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f870009e870 0x7f87001cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.214+0000 7f8705589700 1 --2- 172.21.15.146:0/847291332 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f870009f180 0x7f87001ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.214+0000 7f8705589700 1 -- 172.21.15.146:0/847291332 >> 172.21.15.146:0/847291332 conn(0x7f87000a4430 msgr2=0x7f8700071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.214+0000 7f8705589700 1 -- 172.21.15.146:0/847291332 shutdown_connections 2023-10-03T10:14:19.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.214+0000 7f8705589700 1 -- 172.21.15.146:0/847291332 wait complete. 2023-10-03T10:14:19.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:19.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.251+0000 7ff0228e7700 1 -- 172.21.15.146:0/3191883178 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff01c04f2a0 con 0x7ff01c09d860 2023-10-03T10:14:19.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.251+0000 7ff018ff9700 1 -- 172.21.15.146:0/3191883178 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff00c00fd30 con 0x7ff01c09d860 2023-10-03T10:14:19.252 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:19.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.253+0000 7ff0228e7700 1 -- 172.21.15.146:0/3191883178 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff01c09d860 msgr2=0x7ff01c1cc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.253+0000 7ff0228e7700 1 --2- 172.21.15.146:0/3191883178 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff01c09d860 0x7ff01c1cc5f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00c750 tx=0x7ff00c00ca60 comp rx=0 tx=0).stop 2023-10-03T10:14:19.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.253+0000 7ff0228e7700 1 -- 172.21.15.146:0/3191883178 shutdown_connections 2023-10-03T10:14:19.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.253+0000 7ff0228e7700 1 --2- 172.21.15.146:0/3191883178 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff01c130eb0 0x7ff01c1cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.253+0000 7ff0228e7700 1 --2- 172.21.15.146:0/3191883178 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff01c09d860 0x7ff01c1cc5f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.253+0000 7ff0228e7700 1 --2- 172.21.15.146:0/3191883178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff01c09e170 0x7ff01c1ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.253+0000 7ff0228e7700 1 -- 172.21.15.146:0/3191883178 >> 172.21.15.146:0/3191883178 conn(0x7ff01c099c40 msgr2=0x7ff01c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.253+0000 7ff0228e7700 1 -- 172.21.15.146:0/3191883178 shutdown_connections 2023-10-03T10:14:19.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.253+0000 7ff0228e7700 1 -- 172.21.15.146:0/3191883178 wait complete. 2023-10-03T10:14:19.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.261+0000 7f197a5b0700 1 -- 172.21.15.146:0/192093786 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f197404f2a0 con 0x7f197409e200 2023-10-03T10:14:19.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.262+0000 7f1970ff9700 1 -- 172.21.15.146:0/192093786 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1968007720 con 0x7f197409e200 2023-10-03T10:14:19.263 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:19.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.264+0000 7f197a5b0700 1 -- 172.21.15.146:0/192093786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f197409e200 msgr2=0x7f1974136d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.264+0000 7f197a5b0700 1 --2- 172.21.15.146:0/192093786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f197409e200 0x7f1974136d80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f196800c750 tx=0x7f196800ca60 comp rx=0 tx=0).stop 2023-10-03T10:14:19.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.264+0000 7f197a5b0700 1 -- 172.21.15.146:0/192093786 shutdown_connections 2023-10-03T10:14:19.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.264+0000 7f197a5b0700 1 --2- 172.21.15.146:0/192093786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19741387c0 0x7f197406e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.264+0000 7f197a5b0700 1 --2- 172.21.15.146:0/192093786 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f197409d8f0 0x7f1974136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.264+0000 7f197a5b0700 1 --2- 172.21.15.146:0/192093786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f197409e200 0x7f1974136d80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.264+0000 7f197a5b0700 1 -- 172.21.15.146:0/192093786 >> 172.21.15.146:0/192093786 conn(0x7f19740a2b30 msgr2=0x7f197409fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.264+0000 7f197a5b0700 1 -- 172.21.15.146:0/192093786 shutdown_connections 2023-10-03T10:14:19.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:19.264+0000 7f197a5b0700 1 -- 172.21.15.146:0/192093786 wait complete. 2023-10-03T10:14:19.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:19.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:20.149 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:20.228 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:20.267 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:20.278 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:20.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.289+0000 7fcd07aa3700 1 Processor -- start 2023-10-03T10:14:20.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.289+0000 7fcd07aa3700 1 -- start start 2023-10-03T10:14:20.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.290+0000 7fcd07aa3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd00133ad0 0x7fcd00133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.290+0000 7fcd07aa3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd001300a0 0x7fcd001304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.290+0000 7fcd07aa3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcd001309f0 0x7fcd0013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.290+0000 7fcd07aa3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd0006b2d0 con 0x7fcd001309f0 2023-10-03T10:14:20.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.290+0000 7fcd07aa3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd00133610 con 0x7fcd00133ad0 2023-10-03T10:14:20.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.290+0000 7fcd07aa3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0009a500 con 0x7fcd001300a0 2023-10-03T10:14:20.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.290+0000 7fcd0583f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd00133ad0 0x7fcd00133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.290+0000 7fcd0503e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd001300a0 0x7fcd001304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.290+0000 7fcd0503e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd001300a0 0x7fcd001304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46832/0 (socket says 172.21.15.146:46832) 2023-10-03T10:14:20.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.290+0000 7fcd0583f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd00133ad0 0x7fcd00133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49464/0 (socket says 172.21.15.146:49464) 2023-10-03T10:14:20.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.290+0000 7fcd0503e700 1 -- 172.21.15.146:0/1680755286 learned_addr learned my addr 172.21.15.146:0/1680755286 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:20.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.290+0000 7fcd06040700 1 --2- 172.21.15.146:0/1680755286 >> v2:172.21.15.146:3300/0 conn(0x7fcd001309f0 0x7fcd0013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.291+0000 7fcd06040700 1 -- 172.21.15.146:0/1680755286 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd001300a0 msgr2=0x7fcd001304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.291+0000 7fcd06040700 1 --2- 172.21.15.146:0/1680755286 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd001300a0 0x7fcd001304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.291+0000 7fcd06040700 1 -- 172.21.15.146:0/1680755286 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd00133ad0 msgr2=0x7fcd00133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.291+0000 7fcd06040700 1 --2- 172.21.15.146:0/1680755286 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd00133ad0 0x7fcd00133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.291+0000 7fcd06040700 1 -- 172.21.15.146:0/1680755286 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd001338b0 con 0x7fcd001309f0 2023-10-03T10:14:20.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.291+0000 7fcd0503e700 1 --2- 172.21.15.146:0/1680755286 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd001300a0 0x7fcd001304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.291+0000 7fcd0583f700 1 --2- 172.21.15.146:0/1680755286 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd00133ad0 0x7fcd00133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.291+0000 7fcd06040700 1 --2- 172.21.15.146:0/1680755286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd001309f0 0x7fcd0013a980 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fccf8009d90 tx=0x7fccf800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d05f3c18f763282 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.291+0000 7fcd0483d700 1 -- 172.21.15.146:0/1680755286 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf800e070 con 0x7fcd001309f0 2023-10-03T10:14:20.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.291+0000 7fcd0483d700 1 -- 172.21.15.146:0/1680755286 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf800bb20 con 0x7fcd001309f0 2023-10-03T10:14:20.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.291+0000 7fcd0483d700 1 -- 172.21.15.146:0/1680755286 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8012430 con 0x7fcd001309f0 2023-10-03T10:14:20.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.292+0000 7fcd07aa3700 1 -- 172.21.15.146:0/1680755286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd001309f0 msgr2=0x7fcd0013a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.292+0000 7fcd07aa3700 1 --2- 172.21.15.146:0/1680755286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd001309f0 0x7fcd0013a980 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fccf8009d90 tx=0x7fccf800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:20.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.292+0000 7fcd07aa3700 1 -- 172.21.15.146:0/1680755286 shutdown_connections 2023-10-03T10:14:20.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.292+0000 7fcd07aa3700 1 --2- 172.21.15.146:0/1680755286 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd00133ad0 0x7fcd00133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.292+0000 7fcd07aa3700 1 --2- 172.21.15.146:0/1680755286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd001309f0 0x7fcd0013a980 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.292+0000 7fcd07aa3700 1 --2- 172.21.15.146:0/1680755286 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd001300a0 0x7fcd001304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.292+0000 7fcd07aa3700 1 -- 172.21.15.146:0/1680755286 >> 172.21.15.146:0/1680755286 conn(0x7fcd00099c40 msgr2=0x7fcd000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.292+0000 7fcd07aa3700 1 -- 172.21.15.146:0/1680755286 shutdown_connections 2023-10-03T10:14:20.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.292+0000 7fcd07aa3700 1 -- 172.21.15.146:0/1680755286 wait complete. 2023-10-03T10:14:20.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.293+0000 7fcd07aa3700 1 Processor -- start 2023-10-03T10:14:20.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.293+0000 7fcd07aa3700 1 -- start start 2023-10-03T10:14:20.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.293+0000 7fcd07aa3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd001300a0 0x7fcd0011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.294+0000 7fcd07aa3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd001309f0 0x7fcd0011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.294+0000 7fcd07aa3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd00133ad0 0x7fcd0011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.294+0000 7fcd07aa3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0011ec00 con 0x7fcd00133ad0 2023-10-03T10:14:20.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.294+0000 7fcd07aa3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0012dd00 con 0x7fcd001309f0 2023-10-03T10:14:20.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.294+0000 7fcd07aa3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0012d9d0 con 0x7fcd001300a0 2023-10-03T10:14:20.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.294+0000 7fcd0503e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd001309f0 0x7fcd0011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.294+0000 7fcd0503e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd001309f0 0x7fcd0011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49466/0 (socket says 172.21.15.146:49466) 2023-10-03T10:14:20.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.294+0000 7fcd0503e700 1 -- 172.21.15.146:0/1783615547 learned_addr learned my addr 172.21.15.146:0/1783615547 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:20.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.294+0000 7fcd06040700 1 --2- 172.21.15.146:0/1783615547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd00133ad0 0x7fcd0011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.294+0000 7fcd0503e700 1 -- 172.21.15.146:0/1783615547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd001300a0 msgr2=0x7fcd0011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.294+0000 7fcd0503e700 1 --2- 172.21.15.146:0/1783615547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd001300a0 0x7fcd0011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.294+0000 7fcd0503e700 1 -- 172.21.15.146:0/1783615547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd00133ad0 msgr2=0x7fcd0011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.294+0000 7fcd0503e700 1 --2- 172.21.15.146:0/1783615547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd00133ad0 0x7fcd0011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.294+0000 7fcd0503e700 1 -- 172.21.15.146:0/1783615547 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf0009550 con 0x7fcd001309f0 2023-10-03T10:14:20.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.294+0000 7fcd0503e700 1 --2- 172.21.15.146:0/1783615547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd001309f0 0x7fcd0011df80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fccf000e990 tx=0x7fccf000eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.294+0000 7fccf67fc700 1 -- 172.21.15.146:0/1783615547 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf000eee0 con 0x7fcd001309f0 2023-10-03T10:14:20.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.295+0000 7fccf67fc700 1 -- 172.21.15.146:0/1783615547 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf000c850 con 0x7fcd001309f0 2023-10-03T10:14:20.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.295+0000 7fcd07aa3700 1 -- 172.21.15.146:0/1783615547 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccfc0094a0 con 0x7fcd001309f0 2023-10-03T10:14:20.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.295+0000 7fccf67fc700 1 -- 172.21.15.146:0/1783615547 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf000cbc0 con 0x7fcd001309f0 2023-10-03T10:14:20.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.295+0000 7fcd07aa3700 1 -- 172.21.15.146:0/1783615547 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf8009a70 con 0x7fcd001309f0 2023-10-03T10:14:20.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.295+0000 7fcd07aa3700 1 -- 172.21.15.146:0/1783615547 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0009cb20 con 0x7fcd001309f0 2023-10-03T10:14:20.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.297+0000 7fccf67fc700 1 -- 172.21.15.146:0/1783615547 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fccf000cd20 con 0x7fcd001309f0 2023-10-03T10:14:20.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.297+0000 7fccf67fc700 1 -- 172.21.15.146:0/1783615547 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fccf003ff30 con 0x7fcd001309f0 2023-10-03T10:14:20.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.302+0000 7fccf67fc700 1 -- 172.21.15.146:0/1783615547 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fccf001a360 con 0x7fcd001309f0 2023-10-03T10:14:20.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.363+0000 7fb08f1de700 1 Processor -- start 2023-10-03T10:14:20.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.364+0000 7fb08f1de700 1 -- start start 2023-10-03T10:14:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.364+0000 7fb08f1de700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb088133900 0x7fb088133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.364+0000 7fb08f1de700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb0880a10b0 0x7fb08813b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.364+0000 7fb08f1de700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08809a760 con 0x7fb088134210 2023-10-03T10:14:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.364+0000 7fb08f1de700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0881336e0 con 0x7fb0880a10b0 2023-10-03T10:14:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.364+0000 7fb08f1de700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb08809a080 con 0x7fb088133900 2023-10-03T10:14:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.364+0000 7fb08d77b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb0880a10b0 0x7fb08813b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.364+0000 7fb08d77b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb0880a10b0 0x7fb08813b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49634/0 (socket says 172.21.15.146:49634) 2023-10-03T10:14:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.364+0000 7fb08d77b700 1 -- 172.21.15.146:0/1404503950 learned_addr learned my addr 172.21.15.146:0/1404503950 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.364+0000 7fb087fff700 1 --1- 172.21.15.146:0/1404503950 >> v1:172.21.15.146:6789/0 conn(0x7fb088134210 0x7fb0880a09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47332/0 (socket says 172.21.15.146:47332) 2023-10-03T10:14:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.364+0000 7fb08cf7a700 1 --2- 172.21.15.146:0/1404503950 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb088133900 0x7fb088133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.365+0000 7fb08d77b700 1 -- 172.21.15.146:0/1404503950 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb088133900 msgr2=0x7fb088133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.365+0000 7fb08d77b700 1 --2- 172.21.15.146:0/1404503950 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb088133900 0x7fb088133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.365+0000 7fb08d77b700 1 -- 172.21.15.146:0/1404503950 >> v1:172.21.15.146:6789/0 conn(0x7fb088134210 legacy=0x7fb0880a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.365+0000 7fb08d77b700 1 -- 172.21.15.146:0/1404503950 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0880a23e0 con 0x7fb0880a10b0 2023-10-03T10:14:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.365+0000 7fb08cf7a700 1 --2- 172.21.15.146:0/1404503950 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb088133900 0x7fb088133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.365+0000 7fb08d77b700 1 --2- 172.21.15.146:0/1404503950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0880a10b0 0x7fb08813b910 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb080009e50 tx=0x7fb08000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a42674e32107bc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.365+0000 7fb0877fe700 1 -- 172.21.15.146:0/1404503950 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08000e070 con 0x7fb0880a10b0 2023-10-03T10:14:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.365+0000 7fb0877fe700 1 -- 172.21.15.146:0/1404503950 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08000b9c0 con 0x7fb0880a10b0 2023-10-03T10:14:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.365+0000 7fb0877fe700 1 -- 172.21.15.146:0/1404503950 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08000bd70 con 0x7fb0880a10b0 2023-10-03T10:14:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.366+0000 7fb08f1de700 1 -- 172.21.15.146:0/1404503950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0880a10b0 msgr2=0x7fb08813b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.366+0000 7fb08f1de700 1 --2- 172.21.15.146:0/1404503950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0880a10b0 0x7fb08813b910 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb080009e50 tx=0x7fb08000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.366+0000 7fb08f1de700 1 -- 172.21.15.146:0/1404503950 shutdown_connections 2023-10-03T10:14:20.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.366+0000 7fb08f1de700 1 --2- 172.21.15.146:0/1404503950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0880a10b0 0x7fb08813b910 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.366+0000 7fb08f1de700 1 --2- 172.21.15.146:0/1404503950 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb088133900 0x7fb088133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.366+0000 7fb08f1de700 1 -- 172.21.15.146:0/1404503950 >> 172.21.15.146:0/1404503950 conn(0x7fb0880a2980 msgr2=0x7fb0880a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.366+0000 7fb08f1de700 1 -- 172.21.15.146:0/1404503950 shutdown_connections 2023-10-03T10:14:20.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.366+0000 7fb08f1de700 1 -- 172.21.15.146:0/1404503950 wait complete. 2023-10-03T10:14:20.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.367+0000 7fb08f1de700 1 Processor -- start 2023-10-03T10:14:20.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.367+0000 7fb08f1de700 1 -- start start 2023-10-03T10:14:20.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.368+0000 7fb08f1de700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0880a10b0 0x7fb088119db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.368+0000 7fb08f1de700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb088133900 0x7fb08811a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.368+0000 7fb08f1de700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb088134210 0x7fb0881d4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.368+0000 7fb08f1de700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08811b3f0 con 0x7fb088133900 2023-10-03T10:14:20.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.368+0000 7fb08f1de700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08811c9f0 con 0x7fb088134210 2023-10-03T10:14:20.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.368+0000 7fb08f1de700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb088119a20 con 0x7fb0880a10b0 2023-10-03T10:14:20.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.368+0000 7fb087fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb088133900 0x7fb08811a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.368+0000 7fb08cf7a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0880a10b0 0x7fb088119db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.368+0000 7fb087fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb088133900 0x7fb08811a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49650/0 (socket says 172.21.15.146:49650) 2023-10-03T10:14:20.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.368+0000 7fb08cf7a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0880a10b0 0x7fb088119db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46874/0 (socket says 172.21.15.146:46874) 2023-10-03T10:14:20.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.368+0000 7fb087fff700 1 -- 172.21.15.146:0/708384005 learned_addr learned my addr 172.21.15.146:0/708384005 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:20.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.368+0000 7fb087fff700 1 -- 172.21.15.146:0/708384005 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0880a10b0 msgr2=0x7fb088119db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.368+0000 7fb087fff700 1 --2- 172.21.15.146:0/708384005 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0880a10b0 0x7fb088119db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.368+0000 7fb087fff700 1 -- 172.21.15.146:0/708384005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb088134210 msgr2=0x7fb0881d4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.368+0000 7fb087fff700 1 --2- 172.21.15.146:0/708384005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb088134210 0x7fb0881d4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.368+0000 7fb087fff700 1 -- 172.21.15.146:0/708384005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb080009b30 con 0x7fb088133900 2023-10-03T10:14:20.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.368+0000 7fb087fff700 1 --2- 172.21.15.146:0/708384005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb088133900 0x7fb08811a2f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb07400c4f0 tx=0x7fb07400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.369+0000 7fb0857fa700 1 -- 172.21.15.146:0/708384005 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074005cb0 con 0x7fb088133900 2023-10-03T10:14:20.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.369+0000 7fb0857fa700 1 -- 172.21.15.146:0/708384005 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb074005e10 con 0x7fb088133900 2023-10-03T10:14:20.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.369+0000 7fb0857fa700 1 -- 172.21.15.146:0/708384005 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0740072d0 con 0x7fb088133900 2023-10-03T10:14:20.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.369+0000 7fb08f1de700 1 -- 172.21.15.146:0/708384005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08811b570 con 0x7fb088133900 2023-10-03T10:14:20.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.369+0000 7fb08f1de700 1 -- 172.21.15.146:0/708384005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08811a830 con 0x7fb088133900 2023-10-03T10:14:20.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.370+0000 7fb0857fa700 1 -- 172.21.15.146:0/708384005 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb074007430 con 0x7fb088133900 2023-10-03T10:14:20.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.370+0000 7fb0857fa700 1 -- 172.21.15.146:0/708384005 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb07403eac0 con 0x7fb088133900 2023-10-03T10:14:20.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.370+0000 7fb08f1de700 1 -- 172.21.15.146:0/708384005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08804f2a0 con 0x7fb088133900 2023-10-03T10:14:20.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.375+0000 7fb0857fa700 1 -- 172.21.15.146:0/708384005 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb074017080 con 0x7fb088133900 2023-10-03T10:14:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.413+0000 7f378e5e1700 1 Processor -- start 2023-10-03T10:14:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.413+0000 7f378e5e1700 1 -- start start 2023-10-03T10:14:20.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.413+0000 7f378e5e1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3788133ad0 0x7f3788133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.413+0000 7f378e5e1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37881300a0 0x7f37881304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.413+0000 7f378e5e1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f378806b2d0 con 0x7f37881309f0 2023-10-03T10:14:20.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.413+0000 7f378e5e1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3788133610 con 0x7f3788133ad0 2023-10-03T10:14:20.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.413+0000 7f378e5e1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f378809a500 con 0x7f37881300a0 2023-10-03T10:14:20.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.414+0000 7f378cb7e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f37881309f0 0x7f378813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47340/0 (socket says 172.21.15.146:47340) 2023-10-03T10:14:20.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.414+0000 7f3787fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3788133ad0 0x7f3788133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.414+0000 7f378cb7e700 1 -- 172.21.15.146:0/11469157 learned_addr learned my addr 172.21.15.146:0/11469157 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:20.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.414+0000 7f37877fe700 1 --2- 172.21.15.146:0/11469157 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37881300a0 0x7f37881304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.414+0000 7f3787fff700 1 -- 172.21.15.146:0/11469157 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37881300a0 msgr2=0x7f37881304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.414+0000 7f3787fff700 1 --2- 172.21.15.146:0/11469157 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37881300a0 0x7f37881304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.414+0000 7f3787fff700 1 -- 172.21.15.146:0/11469157 >> v1:172.21.15.146:6789/0 conn(0x7f37881309f0 legacy=0x7f378813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.414+0000 7f3787fff700 1 -- 172.21.15.146:0/11469157 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37881338b0 con 0x7f3788133ad0 2023-10-03T10:14:20.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.414+0000 7f37877fe700 1 --2- 172.21.15.146:0/11469157 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37881300a0 0x7f37881304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.414+0000 7f3787fff700 1 --2- 172.21.15.146:0/11469157 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3788133ad0 0x7f3788133ea0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3778009870 tx=0x7f3778009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=877a123aa0a0919 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.414+0000 7f3786ffd700 1 -- 172.21.15.146:0/11469157 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778011830 con 0x7f3788133ad0 2023-10-03T10:14:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.414+0000 7f3786ffd700 1 -- 172.21.15.146:0/11469157 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3778011990 con 0x7f3788133ad0 2023-10-03T10:14:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.414+0000 7f3786ffd700 1 -- 172.21.15.146:0/11469157 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778011d20 con 0x7f3788133ad0 2023-10-03T10:14:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.415+0000 7f378e5e1700 1 -- 172.21.15.146:0/11469157 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3788133ad0 msgr2=0x7f3788133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.415+0000 7f378e5e1700 1 --2- 172.21.15.146:0/11469157 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3788133ad0 0x7f3788133ea0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3778009870 tx=0x7f3778009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.415+0000 7f378e5e1700 1 -- 172.21.15.146:0/11469157 shutdown_connections 2023-10-03T10:14:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.415+0000 7f378e5e1700 1 --2- 172.21.15.146:0/11469157 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3788133ad0 0x7f3788133ea0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.415+0000 7f378e5e1700 1 --2- 172.21.15.146:0/11469157 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37881300a0 0x7f37881304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.415+0000 7f378e5e1700 1 -- 172.21.15.146:0/11469157 >> 172.21.15.146:0/11469157 conn(0x7f3788099c40 msgr2=0x7f37880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.415+0000 7f378e5e1700 1 -- 172.21.15.146:0/11469157 shutdown_connections 2023-10-03T10:14:20.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.415+0000 7f378e5e1700 1 -- 172.21.15.146:0/11469157 wait complete. 2023-10-03T10:14:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.416+0000 7f378e5e1700 1 Processor -- start 2023-10-03T10:14:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.417+0000 7f378e5e1700 1 -- start start 2023-10-03T10:14:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.417+0000 7f378e5e1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37881300a0 0x7f37881cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.417+0000 7f378e5e1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37881309f0 0x7f37881cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.417+0000 7f378e5e1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3788133ad0 0x7f37881cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.417+0000 7f378e5e1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378806eba0 con 0x7f37881300a0 2023-10-03T10:14:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.417+0000 7f378e5e1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378812fbd0 con 0x7f3788133ad0 2023-10-03T10:14:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.417+0000 7f378e5e1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f378811d310 con 0x7f37881309f0 2023-10-03T10:14:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.417+0000 7f3787fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37881300a0 0x7f37881cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.417+0000 7f3787fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37881300a0 0x7f37881cc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49656/0 (socket says 172.21.15.146:49656) 2023-10-03T10:14:20.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.417+0000 7f3787fff700 1 -- 172.21.15.146:0/1152465329 learned_addr learned my addr 172.21.15.146:0/1152465329 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:20.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.417+0000 7f37877fe700 1 --2- 172.21.15.146:0/1152465329 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37881309f0 0x7f37881cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.417+0000 7f378cb7e700 1 --2- 172.21.15.146:0/1152465329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3788133ad0 0x7f37881cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.418+0000 7f37877fe700 1 -- 172.21.15.146:0/1152465329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3788133ad0 msgr2=0x7f37881cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.418+0000 7f37877fe700 1 --2- 172.21.15.146:0/1152465329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3788133ad0 0x7f37881cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.418+0000 7f37877fe700 1 -- 172.21.15.146:0/1152465329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37881300a0 msgr2=0x7f37881cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.418+0000 7f37877fe700 1 --2- 172.21.15.146:0/1152465329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37881300a0 0x7f37881cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.418+0000 7f37877fe700 1 -- 172.21.15.146:0/1152465329 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c0094a0 con 0x7f37881309f0 2023-10-03T10:14:20.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.418+0000 7f37877fe700 1 --2- 172.21.15.146:0/1152465329 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37881309f0 0x7f37881cccd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f377c00e8d0 tx=0x7f377c00ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.418+0000 7f3784ff9700 1 -- 172.21.15.146:0/1152465329 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c013680 con 0x7f37881309f0 2023-10-03T10:14:20.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.418+0000 7f3784ff9700 1 -- 172.21.15.146:0/1152465329 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c0137e0 con 0x7f37881309f0 2023-10-03T10:14:20.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.418+0000 7f3784ff9700 1 -- 172.21.15.146:0/1152465329 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c013b70 con 0x7f37881309f0 2023-10-03T10:14:20.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.419+0000 7f378e5e1700 1 -- 172.21.15.146:0/1152465329 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37780094a0 con 0x7f37881309f0 2023-10-03T10:14:20.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.419+0000 7f378e5e1700 1 -- 172.21.15.146:0/1152465329 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378806ede0 con 0x7f37881309f0 2023-10-03T10:14:20.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.420+0000 7f378e5e1700 1 -- 172.21.15.146:0/1152465329 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378804f2a0 con 0x7f37881309f0 2023-10-03T10:14:20.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.421+0000 7f3784ff9700 1 -- 172.21.15.146:0/1152465329 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f377c013cd0 con 0x7f37881309f0 2023-10-03T10:14:20.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.421+0000 7f3784ff9700 1 -- 172.21.15.146:0/1152465329 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f377c03f730 con 0x7f37881309f0 2023-10-03T10:14:20.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.427+0000 7f3784ff9700 1 -- 172.21.15.146:0/1152465329 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f377c01be10 con 0x7f37881309f0 2023-10-03T10:14:20.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.430+0000 7f78058f1700 1 Processor -- start 2023-10-03T10:14:20.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.430+0000 7f78058f1700 1 -- start start 2023-10-03T10:14:20.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.430+0000 7f78058f1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f780009d860 0x7f780009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.430+0000 7f78058f1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7800130eb0 0x7f7800138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.430+0000 7f78058f1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780009aaa0 con 0x7f780009e170 2023-10-03T10:14:20.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.430+0000 7f78058f1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780009f870 con 0x7f780009d860 2023-10-03T10:14:20.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.430+0000 7f78058f1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f780009b360 con 0x7f7800130eb0 2023-10-03T10:14:20.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.430+0000 7f77fe7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f780009e170 0x7f78001307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47352/0 (socket says 172.21.15.146:47352) 2023-10-03T10:14:20.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.430+0000 7f77fe7fc700 1 -- 172.21.15.146:0/4202787906 learned_addr learned my addr 172.21.15.146:0/4202787906 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:20.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.430+0000 7f77ff7fe700 1 --2- 172.21.15.146:0/4202787906 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7800130eb0 0x7f7800138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.431+0000 7f77feffd700 1 --2- 172.21.15.146:0/4202787906 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f780009d860 0x7f780009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.431+0000 7f77ff7fe700 1 -- 172.21.15.146:0/4202787906 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f780009d860 msgr2=0x7f780009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.431+0000 7f77ff7fe700 1 --2- 172.21.15.146:0/4202787906 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f780009d860 0x7f780009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.431+0000 7f77ff7fe700 1 -- 172.21.15.146:0/4202787906 >> v1:172.21.15.146:6789/0 conn(0x7f780009e170 legacy=0x7f78001307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.431+0000 7f77ff7fe700 1 -- 172.21.15.146:0/4202787906 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780009b620 con 0x7f7800130eb0 2023-10-03T10:14:20.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.431+0000 7f77ff7fe700 1 --2- 172.21.15.146:0/4202787906 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7800130eb0 0x7f7800138a00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f77f8009e20 tx=0x7f77f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c1944b94d798b11 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.431+0000 7f77fdffb700 1 -- 172.21.15.146:0/4202787906 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f800bd50 con 0x7f7800130eb0 2023-10-03T10:14:20.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.431+0000 7f77fdffb700 1 -- 172.21.15.146:0/4202787906 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f8003a20 con 0x7f7800130eb0 2023-10-03T10:14:20.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.431+0000 7f77fdffb700 1 -- 172.21.15.146:0/4202787906 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f8003dd0 con 0x7f7800130eb0 2023-10-03T10:14:20.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.432+0000 7f78058f1700 1 -- 172.21.15.146:0/4202787906 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7800130eb0 msgr2=0x7f7800138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.432+0000 7f78058f1700 1 --2- 172.21.15.146:0/4202787906 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7800130eb0 0x7f7800138a00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f77f8009e20 tx=0x7f77f800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:20.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.432+0000 7f78058f1700 1 -- 172.21.15.146:0/4202787906 shutdown_connections 2023-10-03T10:14:20.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.432+0000 7f78058f1700 1 --2- 172.21.15.146:0/4202787906 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7800130eb0 0x7f7800138a00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.432+0000 7f78058f1700 1 --2- 172.21.15.146:0/4202787906 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f780009d860 0x7f780009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.432+0000 7f78058f1700 1 -- 172.21.15.146:0/4202787906 >> 172.21.15.146:0/4202787906 conn(0x7f7800099c40 msgr2=0x7f78000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.432+0000 7f78058f1700 1 -- 172.21.15.146:0/4202787906 shutdown_connections 2023-10-03T10:14:20.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.432+0000 7f78058f1700 1 -- 172.21.15.146:0/4202787906 wait complete. 2023-10-03T10:14:20.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.433+0000 7f78058f1700 1 Processor -- start 2023-10-03T10:14:20.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.433+0000 7f78058f1700 1 -- start start 2023-10-03T10:14:20.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.434+0000 7f78058f1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780009d860 0x7f7800123320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.434+0000 7f78058f1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f780009e170 0x7f7800123860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.434+0000 7f78058f1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7800130eb0 0x7f78001c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.434+0000 7f78058f1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78001255d0 con 0x7f780009d860 2023-10-03T10:14:20.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.434+0000 7f78058f1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7800072100 con 0x7f780009e170 2023-10-03T10:14:20.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.434+0000 7f78058f1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f780009c8b0 con 0x7f7800130eb0 2023-10-03T10:14:20.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.434+0000 7f77fe7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f780009e170 0x7f7800123860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.434+0000 7f77feffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780009d860 0x7f7800123320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.434+0000 7f77fe7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f780009e170 0x7f7800123860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49500/0 (socket says 172.21.15.146:49500) 2023-10-03T10:14:20.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.434+0000 7f77fe7fc700 1 -- 172.21.15.146:0/1066095046 learned_addr learned my addr 172.21.15.146:0/1066095046 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:20.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.434+0000 7f77ff7fe700 1 --2- 172.21.15.146:0/1066095046 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7800130eb0 0x7f78001c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.435+0000 7f77ff7fe700 1 -- 172.21.15.146:0/1066095046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f780009e170 msgr2=0x7f7800123860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.435+0000 7f77ff7fe700 1 --2- 172.21.15.146:0/1066095046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f780009e170 0x7f7800123860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.435+0000 7f77ff7fe700 1 -- 172.21.15.146:0/1066095046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780009d860 msgr2=0x7f7800123320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.435+0000 7f77ff7fe700 1 --2- 172.21.15.146:0/1066095046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780009d860 0x7f7800123320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.435+0000 7f77ff7fe700 1 -- 172.21.15.146:0/1066095046 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f8009a70 con 0x7f7800130eb0 2023-10-03T10:14:20.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.435+0000 7f77ff7fe700 1 --2- 172.21.15.146:0/1066095046 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7800130eb0 0x7f78001c83d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f77f8017000 tx=0x7f77f8004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.435+0000 7f77e7fff700 1 -- 172.21.15.146:0/1066095046 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f8022480 con 0x7f7800130eb0 2023-10-03T10:14:20.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.435+0000 7f77e7fff700 1 -- 172.21.15.146:0/1066095046 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f80225e0 con 0x7f7800130eb0 2023-10-03T10:14:20.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.435+0000 7f78058f1700 1 -- 172.21.15.146:0/1066095046 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7800122ec0 con 0x7f7800130eb0 2023-10-03T10:14:20.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.435+0000 7f77e7fff700 1 -- 172.21.15.146:0/1066095046 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f8022990 con 0x7f7800130eb0 2023-10-03T10:14:20.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.435+0000 7f78058f1700 1 -- 172.21.15.146:0/1066095046 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7800126cf0 con 0x7f7800130eb0 2023-10-03T10:14:20.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.436+0000 7f78058f1700 1 -- 172.21.15.146:0/1066095046 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7800125f20 con 0x7f7800130eb0 2023-10-03T10:14:20.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.437+0000 7f77e7fff700 1 -- 172.21.15.146:0/1066095046 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f77f8019400 con 0x7f7800130eb0 2023-10-03T10:14:20.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.437+0000 7f77e7fff700 1 -- 172.21.15.146:0/1066095046 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f77f80414d0 con 0x7f7800130eb0 2023-10-03T10:14:20.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.441+0000 7f77e7fff700 1 -- 172.21.15.146:0/1066095046 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77f802a360 con 0x7f7800130eb0 2023-10-03T10:14:20.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.510+0000 7fcd07aa3700 1 -- 172.21.15.146:0/1783615547 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcd0004f2a0 con 0x7fcd001309f0 2023-10-03T10:14:20.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.511+0000 7fccf67fc700 1 -- 172.21.15.146:0/1783615547 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fccf0017070 con 0x7fcd001309f0 2023-10-03T10:14:20.512 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:20.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.513+0000 7fcd07aa3700 1 -- 172.21.15.146:0/1783615547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd001309f0 msgr2=0x7fcd0011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.513+0000 7fcd07aa3700 1 --2- 172.21.15.146:0/1783615547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd001309f0 0x7fcd0011df80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fccf000e990 tx=0x7fccf000eca0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.514+0000 7fcd07aa3700 1 -- 172.21.15.146:0/1783615547 shutdown_connections 2023-10-03T10:14:20.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.514+0000 7fcd07aa3700 1 --2- 172.21.15.146:0/1783615547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd00133ad0 0x7fcd0011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.514+0000 7fcd07aa3700 1 --2- 172.21.15.146:0/1783615547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd001300a0 0x7fcd0011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.514+0000 7fcd07aa3700 1 --2- 172.21.15.146:0/1783615547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd001309f0 0x7fcd0011df80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.514+0000 7fcd07aa3700 1 -- 172.21.15.146:0/1783615547 >> 172.21.15.146:0/1783615547 conn(0x7fcd00099c40 msgr2=0x7fcd000a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.514+0000 7fcd07aa3700 1 -- 172.21.15.146:0/1783615547 shutdown_connections 2023-10-03T10:14:20.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.514+0000 7fcd07aa3700 1 -- 172.21.15.146:0/1783615547 wait complete. 2023-10-03T10:14:20.526 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:20.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.574+0000 7fb08f1de700 1 -- 172.21.15.146:0/708384005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb08806bce0 con 0x7fb088133900 2023-10-03T10:14:20.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.575+0000 7fb0857fa700 1 -- 172.21.15.146:0/708384005 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb07401b3b0 con 0x7fb088133900 2023-10-03T10:14:20.575 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:20.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.577+0000 7fb08f1de700 1 -- 172.21.15.146:0/708384005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb088133900 msgr2=0x7fb08811a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.577+0000 7fb08f1de700 1 --2- 172.21.15.146:0/708384005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb088133900 0x7fb08811a2f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb07400c4f0 tx=0x7fb07400c800 comp rx=0 tx=0).stop 2023-10-03T10:14:20.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.577+0000 7fb08f1de700 1 -- 172.21.15.146:0/708384005 shutdown_connections 2023-10-03T10:14:20.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.577+0000 7fb08f1de700 1 --2- 172.21.15.146:0/708384005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb088134210 0x7fb0881d4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.577+0000 7fb08f1de700 1 --2- 172.21.15.146:0/708384005 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0880a10b0 0x7fb088119db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.577+0000 7fb08f1de700 1 --2- 172.21.15.146:0/708384005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb088133900 0x7fb08811a2f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.577+0000 7fb08f1de700 1 -- 172.21.15.146:0/708384005 >> 172.21.15.146:0/708384005 conn(0x7fb0880a2980 msgr2=0x7fb0881baa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.577+0000 7fb08f1de700 1 -- 172.21.15.146:0/708384005 shutdown_connections 2023-10-03T10:14:20.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.577+0000 7fb08f1de700 1 -- 172.21.15.146:0/708384005 wait complete. 2023-10-03T10:14:20.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:20.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.627+0000 7f378e5e1700 1 -- 172.21.15.146:0/1152465329 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f378806c3b0 con 0x7f37881309f0 2023-10-03T10:14:20.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.628+0000 7f3784ff9700 1 -- 172.21.15.146:0/1152465329 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f377c017090 con 0x7f37881309f0 2023-10-03T10:14:20.628 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:20.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.631+0000 7f378e5e1700 1 -- 172.21.15.146:0/1152465329 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37881309f0 msgr2=0x7f37881cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.631+0000 7f378e5e1700 1 --2- 172.21.15.146:0/1152465329 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37881309f0 0x7f37881cccd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f377c00e8d0 tx=0x7f377c00ebe0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.631+0000 7f378e5e1700 1 -- 172.21.15.146:0/1152465329 shutdown_connections 2023-10-03T10:14:20.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.631+0000 7f378e5e1700 1 --2- 172.21.15.146:0/1152465329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3788133ad0 0x7f37881cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.631+0000 7f378e5e1700 1 --2- 172.21.15.146:0/1152465329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37881300a0 0x7f37881cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.631+0000 7f378e5e1700 1 --2- 172.21.15.146:0/1152465329 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37881309f0 0x7f37881cccd0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.631+0000 7f378e5e1700 1 -- 172.21.15.146:0/1152465329 >> 172.21.15.146:0/1152465329 conn(0x7f3788099c40 msgr2=0x7f3788132a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.631+0000 7f378e5e1700 1 -- 172.21.15.146:0/1152465329 shutdown_connections 2023-10-03T10:14:20.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.631+0000 7f378e5e1700 1 -- 172.21.15.146:0/1152465329 wait complete. 2023-10-03T10:14:20.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.642+0000 7f78058f1700 1 -- 172.21.15.146:0/1066095046 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f78001260e0 con 0x7f7800130eb0 2023-10-03T10:14:20.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.642+0000 7f77e7fff700 1 -- 172.21.15.146:0/1066095046 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78001260e0 con 0x7f7800130eb0 2023-10-03T10:14:20.644 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:20.644 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:20.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.644+0000 7f78058f1700 1 -- 172.21.15.146:0/1066095046 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7800130eb0 msgr2=0x7f78001c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.644+0000 7f78058f1700 1 --2- 172.21.15.146:0/1066095046 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7800130eb0 0x7f78001c83d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f77f8017000 tx=0x7f77f8004b40 comp rx=0 tx=0).stop 2023-10-03T10:14:20.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.644+0000 7f78058f1700 1 -- 172.21.15.146:0/1066095046 shutdown_connections 2023-10-03T10:14:20.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.644+0000 7f78058f1700 1 --2- 172.21.15.146:0/1066095046 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7800130eb0 0x7f78001c83d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.644+0000 7f78058f1700 1 --2- 172.21.15.146:0/1066095046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780009d860 0x7f7800123320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.644+0000 7f78058f1700 1 --2- 172.21.15.146:0/1066095046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f780009e170 0x7f7800123860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.644+0000 7f78058f1700 1 -- 172.21.15.146:0/1066095046 >> 172.21.15.146:0/1066095046 conn(0x7f7800099c40 msgr2=0x7f7800070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.644+0000 7f78058f1700 1 -- 172.21.15.146:0/1066095046 shutdown_connections 2023-10-03T10:14:20.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:20.644+0000 7f78058f1700 1 -- 172.21.15.146:0/1066095046 wait complete. 2023-10-03T10:14:20.657 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:21.528 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:21.591 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:21.645 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:21.658 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:21.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.664+0000 7f3f98e59700 1 Processor -- start 2023-10-03T10:14:21.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.664+0000 7f3f98e59700 1 -- start start 2023-10-03T10:14:21.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.664+0000 7f3f98e59700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f941368e0 0x7f3f94138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.664+0000 7f3f98e59700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f94139200 0x7f3f9413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.664+0000 7f3f98e59700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f941336e0 con 0x7f3f94133b10 2023-10-03T10:14:21.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.664+0000 7f3f98e59700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9409a080 con 0x7f3f941368e0 2023-10-03T10:14:21.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.664+0000 7f3f98e59700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9409a760 con 0x7f3f94139200 2023-10-03T10:14:21.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.665+0000 7f3f91d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f941368e0 0x7f3f94138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.665+0000 7f3f91d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f941368e0 0x7f3f94138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49508/0 (socket says 172.21.15.146:49508) 2023-10-03T10:14:21.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.665+0000 7f3f91d9b700 1 -- 172.21.15.146:0/4127391077 learned_addr learned my addr 172.21.15.146:0/4127391077 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:21.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.665+0000 7f3f92d9d700 1 --2- 172.21.15.146:0/4127391077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f94139200 0x7f3f9413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.665+0000 7f3f9159a700 1 -- 172.21.15.146:0/4127391077 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288285170 0 0) 0x7f3f941336e0 con 0x7f3f94133b10 2023-10-03T10:14:21.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.665+0000 7f3f9159a700 1 -- 172.21.15.146:0/4127391077 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f7c0035b0 con 0x7f3f94133b10 2023-10-03T10:14:21.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.665+0000 7f3f92d9d700 1 -- 172.21.15.146:0/4127391077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f941368e0 msgr2=0x7f3f94138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:21.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.665+0000 7f3f92d9d700 1 --2- 172.21.15.146:0/4127391077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f941368e0 0x7f3f94138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.665+0000 7f3f92d9d700 1 -- 172.21.15.146:0/4127391077 >> v1:172.21.15.146:6789/0 conn(0x7f3f94133b10 legacy=0x7f3f94133ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.665+0000 7f3f92d9d700 1 -- 172.21.15.146:0/4127391077 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9409b5c0 con 0x7f3f94139200 2023-10-03T10:14:21.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.665+0000 7f3f91d9b700 1 --2- 172.21.15.146:0/4127391077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f941368e0 0x7f3f94138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:21.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.665+0000 7f3f92d9d700 1 --2- 172.21.15.146:0/4127391077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f94139200 0x7f3f9413b5e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c009dc0 tx=0x7f3f8c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=111a39f5dd3df64e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.665+0000 7f3f9159a700 1 -- 172.21.15.146:0/4127391077 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c00e070 con 0x7f3f94139200 2023-10-03T10:14:21.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.666+0000 7f3f9159a700 1 -- 172.21.15.146:0/4127391077 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c00bb20 con 0x7f3f94139200 2023-10-03T10:14:21.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.666+0000 7f3f9159a700 1 -- 172.21.15.146:0/4127391077 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c00be90 con 0x7f3f94139200 2023-10-03T10:14:21.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.666+0000 7f3f98e59700 1 -- 172.21.15.146:0/4127391077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f94139200 msgr2=0x7f3f9413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.666+0000 7f3f98e59700 1 --2- 172.21.15.146:0/4127391077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f94139200 0x7f3f9413b5e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c009dc0 tx=0x7f3f8c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:21.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.666+0000 7f3f98e59700 1 -- 172.21.15.146:0/4127391077 shutdown_connections 2023-10-03T10:14:21.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.666+0000 7f3f98e59700 1 --2- 172.21.15.146:0/4127391077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f94139200 0x7f3f9413b5e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.666+0000 7f3f98e59700 1 --2- 172.21.15.146:0/4127391077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f941368e0 0x7f3f94138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.666+0000 7f3f98e59700 1 -- 172.21.15.146:0/4127391077 >> 172.21.15.146:0/4127391077 conn(0x7f3f940a2980 msgr2=0x7f3f940a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.667+0000 7f3f98e59700 1 -- 172.21.15.146:0/4127391077 shutdown_connections 2023-10-03T10:14:21.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.667+0000 7f3f98e59700 1 -- 172.21.15.146:0/4127391077 wait complete. 2023-10-03T10:14:21.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.668+0000 7f3f98e59700 1 Processor -- start 2023-10-03T10:14:21.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.668+0000 7f3f98e59700 1 -- start start 2023-10-03T10:14:21.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.668+0000 7f3f98e59700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f94133b10 0x7f3f94119ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.668+0000 7f3f98e59700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f941368e0 0x7f3f9411a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.668+0000 7f3f98e59700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f94139200 0x7f3f9411a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.668+0000 7f3f98e59700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9411d760 con 0x7f3f94133b10 2023-10-03T10:14:21.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.668+0000 7f3f98e59700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9409a2c0 con 0x7f3f941368e0 2023-10-03T10:14:21.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.668+0000 7f3f98e59700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9411be30 con 0x7f3f94139200 2023-10-03T10:14:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.668+0000 7f3f91d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f941368e0 0x7f3f9411a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.668+0000 7f3f91d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f941368e0 0x7f3f9411a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49518/0 (socket says 172.21.15.146:49518) 2023-10-03T10:14:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.668+0000 7f3f91d9b700 1 -- 172.21.15.146:0/584658746 learned_addr learned my addr 172.21.15.146:0/584658746 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.668+0000 7f3f92d9d700 1 --2- 172.21.15.146:0/584658746 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f94139200 0x7f3f9411a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.669+0000 7f3f9259c700 1 --2- 172.21.15.146:0/584658746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f94133b10 0x7f3f94119ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.669+0000 7f3f91d9b700 1 -- 172.21.15.146:0/584658746 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f94139200 msgr2=0x7f3f9411a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.669+0000 7f3f91d9b700 1 --2- 172.21.15.146:0/584658746 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f94139200 0x7f3f9411a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.669+0000 7f3f91d9b700 1 -- 172.21.15.146:0/584658746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f94133b10 msgr2=0x7f3f94119ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.669+0000 7f3f91d9b700 1 --2- 172.21.15.146:0/584658746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f94133b10 0x7f3f94119ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.669+0000 7f3f91d9b700 1 -- 172.21.15.146:0/584658746 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f88009550 con 0x7f3f941368e0 2023-10-03T10:14:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.669+0000 7f3f92d9d700 1 --2- 172.21.15.146:0/584658746 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f94139200 0x7f3f9411a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.669+0000 7f3f91d9b700 1 --2- 172.21.15.146:0/584658746 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f941368e0 0x7f3f9411a220 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800ebe0 tx=0x7f3f8800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.669+0000 7f3f82ffd700 1 -- 172.21.15.146:0/584658746 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8800c850 con 0x7f3f941368e0 2023-10-03T10:14:21.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.669+0000 7f3f82ffd700 1 -- 172.21.15.146:0/584658746 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8800c9b0 con 0x7f3f941368e0 2023-10-03T10:14:21.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.669+0000 7f3f82ffd700 1 -- 172.21.15.146:0/584658746 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8800cd40 con 0x7f3f941368e0 2023-10-03T10:14:21.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.669+0000 7f3f98e59700 1 -- 172.21.15.146:0/584658746 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f8c009a70 con 0x7f3f941368e0 2023-10-03T10:14:21.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.669+0000 7f3f98e59700 1 -- 172.21.15.146:0/584658746 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9411d1c0 con 0x7f3f941368e0 2023-10-03T10:14:21.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.670+0000 7f3f82ffd700 1 -- 172.21.15.146:0/584658746 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f88013470 con 0x7f3f941368e0 2023-10-03T10:14:21.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.670+0000 7f3f98e59700 1 -- 172.21.15.146:0/584658746 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9406b700 con 0x7f3f941368e0 2023-10-03T10:14:21.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.671+0000 7f3f82ffd700 1 -- 172.21.15.146:0/584658746 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3f8803f890 con 0x7f3f941368e0 2023-10-03T10:14:21.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.676+0000 7f3f82ffd700 1 -- 172.21.15.146:0/584658746 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f88017070 con 0x7f3f941368e0 2023-10-03T10:14:21.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.732+0000 7f204fc75700 1 Processor -- start 2023-10-03T10:14:21.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.733+0000 7f204fc75700 1 -- start start 2023-10-03T10:14:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.733+0000 7f204fc75700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f204806b250 0x7f2048136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.733+0000 7f204fc75700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2048137140 0x7f2048139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.733+0000 7f204fc75700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204809da80 con 0x7f204806a770 2023-10-03T10:14:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.733+0000 7f204fc75700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204809dce0 con 0x7f2048137140 2023-10-03T10:14:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.733+0000 7f204fc75700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204806b620 con 0x7f204806b250 2023-10-03T10:14:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.734+0000 7f204da11700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f204806a770 0x7f204806ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47360/0 (socket says 172.21.15.146:47360) 2023-10-03T10:14:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.734+0000 7f204d210700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f204806b250 0x7f2048136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.734+0000 7f204da11700 1 -- 172.21.15.146:0/936334647 learned_addr learned my addr 172.21.15.146:0/936334647 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.734+0000 7f204e212700 1 --2- 172.21.15.146:0/936334647 >> v2:172.21.15.146:3300/0 conn(0x7f2048137140 0x7f2048139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.734+0000 7f204d210700 1 -- 172.21.15.146:0/936334647 >> v2:172.21.15.146:3300/0 conn(0x7f2048137140 msgr2=0x7f2048139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.734+0000 7f204d210700 1 --2- 172.21.15.146:0/936334647 >> v2:172.21.15.146:3300/0 conn(0x7f2048137140 0x7f2048139520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.734+0000 7f204d210700 1 -- 172.21.15.146:0/936334647 >> v1:172.21.15.146:6789/0 conn(0x7f204806a770 legacy=0x7f204806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.734+0000 7f204d210700 1 -- 172.21.15.146:0/936334647 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204809eb20 con 0x7f204806b250 2023-10-03T10:14:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.734+0000 7f204ca0f700 1 -- 172.21.15.146:0/936334647 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684272663 0 0) 0x7f204809da80 con 0x7f204806a770 2023-10-03T10:14:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.734+0000 7f204d210700 1 --2- 172.21.15.146:0/936334647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f204806b250 0x7f2048136c00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2038009840 tx=0x7f2038009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2cb65cf43e867aa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.734+0000 7f204ca0f700 1 -- 172.21.15.146:0/936334647 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2038011830 con 0x7f204806b250 2023-10-03T10:14:21.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.734+0000 7f204ca0f700 1 -- 172.21.15.146:0/936334647 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2038011990 con 0x7f204806b250 2023-10-03T10:14:21.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.735+0000 7f204ca0f700 1 -- 172.21.15.146:0/936334647 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2038011d20 con 0x7f204806b250 2023-10-03T10:14:21.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.735+0000 7f204fc75700 1 -- 172.21.15.146:0/936334647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f204806b250 msgr2=0x7f2048136c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.735+0000 7f204fc75700 1 --2- 172.21.15.146:0/936334647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f204806b250 0x7f2048136c00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2038009840 tx=0x7f2038009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:21.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.736+0000 7f204fc75700 1 -- 172.21.15.146:0/936334647 shutdown_connections 2023-10-03T10:14:21.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.736+0000 7f204fc75700 1 --2- 172.21.15.146:0/936334647 >> v2:172.21.15.146:3300/0 conn(0x7f2048137140 0x7f2048139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.736+0000 7f204fc75700 1 --2- 172.21.15.146:0/936334647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f204806b250 0x7f2048136c00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.736+0000 7f204fc75700 1 -- 172.21.15.146:0/936334647 >> 172.21.15.146:0/936334647 conn(0x7f2048099c40 msgr2=0x7f20480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.736+0000 7f204fc75700 1 -- 172.21.15.146:0/936334647 shutdown_connections 2023-10-03T10:14:21.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.736+0000 7f204fc75700 1 -- 172.21.15.146:0/936334647 wait complete. 2023-10-03T10:14:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.737+0000 7f204fc75700 1 Processor -- start 2023-10-03T10:14:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.737+0000 7f204fc75700 1 -- start start 2023-10-03T10:14:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.738+0000 7f204fc75700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f204806a770 0x7f2048120520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.738+0000 7f204fc75700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f204806b250 0x7f2048120a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.738+0000 7f204fc75700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2048137140 0x7f2048120fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.738+0000 7f204fc75700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2048123cd0 con 0x7f204806a770 2023-10-03T10:14:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.738+0000 7f204fc75700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20480a0640 con 0x7f2048137140 2023-10-03T10:14:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.738+0000 7f204fc75700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2048123fb0 con 0x7f204806b250 2023-10-03T10:14:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.738+0000 7f204d210700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f204806b250 0x7f2048120a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.738+0000 7f204da11700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f204806a770 0x7f2048120520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.738+0000 7f204e212700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2048137140 0x7f2048120fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.738+0000 7f204da11700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f204806a770 0x7f2048120520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49690/0 (socket says 172.21.15.146:49690) 2023-10-03T10:14:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.738+0000 7f204d210700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f204806b250 0x7f2048120a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46930/0 (socket says 172.21.15.146:46930) 2023-10-03T10:14:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.738+0000 7f204da11700 1 -- 172.21.15.146:0/2351872068 learned_addr learned my addr 172.21.15.146:0/2351872068 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.738+0000 7f204e212700 1 -- 172.21.15.146:0/2351872068 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f204806b250 msgr2=0x7f2048120a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.738+0000 7f204e212700 1 --2- 172.21.15.146:0/2351872068 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f204806b250 0x7f2048120a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.738+0000 7f204e212700 1 -- 172.21.15.146:0/2351872068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f204806a770 msgr2=0x7f2048120520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.738+0000 7f204e212700 1 --2- 172.21.15.146:0/2351872068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f204806a770 0x7f2048120520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.738+0000 7f204e212700 1 -- 172.21.15.146:0/2351872068 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20380094a0 con 0x7f2048137140 2023-10-03T10:14:21.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.738+0000 7f204d210700 1 --2- 172.21.15.146:0/2351872068 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f204806b250 0x7f2048120a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:21.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.738+0000 7f204da11700 1 --2- 172.21.15.146:0/2351872068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f204806a770 0x7f2048120520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:21.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.739+0000 7f204e212700 1 --2- 172.21.15.146:0/2351872068 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2048137140 0x7f2048120fa0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f204000efc0 tx=0x7f204000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.739+0000 7f203e7fc700 1 -- 172.21.15.146:0/2351872068 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204000cd40 con 0x7f2048137140 2023-10-03T10:14:21.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.739+0000 7f203e7fc700 1 -- 172.21.15.146:0/2351872068 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204000f040 con 0x7f2048137140 2023-10-03T10:14:21.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.739+0000 7f204fc75700 1 -- 172.21.15.146:0/2351872068 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2048071e10 con 0x7f2048137140 2023-10-03T10:14:21.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.739+0000 7f204fc75700 1 -- 172.21.15.146:0/2351872068 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2048122890 con 0x7f2048137140 2023-10-03T10:14:21.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.739+0000 7f203e7fc700 1 -- 172.21.15.146:0/2351872068 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20400146c0 con 0x7f2048137140 2023-10-03T10:14:21.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.740+0000 7f204fc75700 1 -- 172.21.15.146:0/2351872068 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20300052e0 con 0x7f2048137140 2023-10-03T10:14:21.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.741+0000 7f203e7fc700 1 -- 172.21.15.146:0/2351872068 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2040014820 con 0x7f2048137140 2023-10-03T10:14:21.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.741+0000 7f203e7fc700 1 -- 172.21.15.146:0/2351872068 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2040040270 con 0x7f2048137140 2023-10-03T10:14:21.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.745+0000 7f203e7fc700 1 -- 172.21.15.146:0/2351872068 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2040007900 con 0x7f2048137140 2023-10-03T10:14:21.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.784+0000 7fada7213700 1 Processor -- start 2023-10-03T10:14:21.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.784+0000 7fada7213700 1 -- start start 2023-10-03T10:14:21.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.784+0000 7fada7213700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fada006a770 0x7fada01349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.784+0000 7fada7213700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fada009e070 0x7fada013fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.784+0000 7fada7213700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada009eca0 con 0x7fada0134f00 2023-10-03T10:14:21.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.784+0000 7fada7213700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada009f720 con 0x7fada009e070 2023-10-03T10:14:21.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.784+0000 7fada7213700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada006b480 con 0x7fada006a770 2023-10-03T10:14:21.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.785+0000 7fad9ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fada0134f00 0x7fada009d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47366/0 (socket says 172.21.15.146:47366) 2023-10-03T10:14:21.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.785+0000 7fad9ffff700 1 -- 172.21.15.146:0/1273507437 learned_addr learned my addr 172.21.15.146:0/1273507437 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:21.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.785+0000 7fada4faf700 1 --2- 172.21.15.146:0/1273507437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fada006a770 0x7fada01349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.785+0000 7fada57b0700 1 --2- 172.21.15.146:0/1273507437 >> v2:172.21.15.146:3300/0 conn(0x7fada009e070 0x7fada013fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.785+0000 7fad9f7fe700 1 -- 172.21.15.146:0/1273507437 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3021180292 0 0) 0x7fada009eca0 con 0x7fada0134f00 2023-10-03T10:14:21.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.785+0000 7fad9f7fe700 1 -- 172.21.15.146:0/1273507437 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad900035b0 con 0x7fada0134f00 2023-10-03T10:14:21.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.785+0000 7fada57b0700 1 -- 172.21.15.146:0/1273507437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fada006a770 msgr2=0x7fada01349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:21.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.785+0000 7fada57b0700 1 --2- 172.21.15.146:0/1273507437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fada006a770 0x7fada01349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.785+0000 7fada57b0700 1 -- 172.21.15.146:0/1273507437 >> v1:172.21.15.146:6789/0 conn(0x7fada0134f00 legacy=0x7fada009d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.785+0000 7fada57b0700 1 -- 172.21.15.146:0/1273507437 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada01352d0 con 0x7fada009e070 2023-10-03T10:14:21.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.785+0000 7fada4faf700 1 --2- 172.21.15.146:0/1273507437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fada006a770 0x7fada01349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:21.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.785+0000 7fada57b0700 1 --2- 172.21.15.146:0/1273507437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada009e070 0x7fada013fcf0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fad98009d90 tx=0x7fad9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbef33193a4ea66e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.785+0000 7fad9f7fe700 1 -- 172.21.15.146:0/1273507437 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9800e070 con 0x7fada009e070 2023-10-03T10:14:21.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.785+0000 7fad9f7fe700 1 -- 172.21.15.146:0/1273507437 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9800bb20 con 0x7fada009e070 2023-10-03T10:14:21.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.785+0000 7fad9f7fe700 1 -- 172.21.15.146:0/1273507437 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad98012430 con 0x7fada009e070 2023-10-03T10:14:21.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.786+0000 7fada7213700 1 -- 172.21.15.146:0/1273507437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada009e070 msgr2=0x7fada013fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.786+0000 7fada7213700 1 --2- 172.21.15.146:0/1273507437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada009e070 0x7fada013fcf0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fad98009d90 tx=0x7fad9800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:21.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.786+0000 7fada7213700 1 -- 172.21.15.146:0/1273507437 shutdown_connections 2023-10-03T10:14:21.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.786+0000 7fada7213700 1 --2- 172.21.15.146:0/1273507437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada009e070 0x7fada013fcf0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.786+0000 7fada7213700 1 --2- 172.21.15.146:0/1273507437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fada006a770 0x7fada01349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.786+0000 7fada7213700 1 -- 172.21.15.146:0/1273507437 >> 172.21.15.146:0/1273507437 conn(0x7fada0099c40 msgr2=0x7fada00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.786+0000 7fada7213700 1 -- 172.21.15.146:0/1273507437 shutdown_connections 2023-10-03T10:14:21.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.786+0000 7fada7213700 1 -- 172.21.15.146:0/1273507437 wait complete. 2023-10-03T10:14:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.787+0000 7fada7213700 1 Processor -- start 2023-10-03T10:14:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.788+0000 7fada7213700 1 -- start start 2023-10-03T10:14:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.788+0000 7fada7213700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada006a770 0x7fada0133d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.788+0000 7fada7213700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fada009e070 0x7fada006f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.788+0000 7fada7213700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fada0134f00 0x7fada006fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.788+0000 7fada7213700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada01390e0 con 0x7fada006a770 2023-10-03T10:14:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.788+0000 7fada7213700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada01392c0 con 0x7fada0134f00 2023-10-03T10:14:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.788+0000 7fada7213700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fada0138b50 con 0x7fada009e070 2023-10-03T10:14:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.788+0000 7fada4faf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada006a770 0x7fada0133d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.788+0000 7fada4faf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada006a770 0x7fada0133d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49720/0 (socket says 172.21.15.146:49720) 2023-10-03T10:14:21.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.788+0000 7fada4faf700 1 -- 172.21.15.146:0/1446719942 learned_addr learned my addr 172.21.15.146:0/1446719942 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:21.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.788+0000 7fada57b0700 1 --2- 172.21.15.146:0/1446719942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fada0134f00 0x7fada006fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.789+0000 7fad9ffff700 1 --2- 172.21.15.146:0/1446719942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fada009e070 0x7fada006f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.789+0000 7fada57b0700 1 -- 172.21.15.146:0/1446719942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fada009e070 msgr2=0x7fada006f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.789+0000 7fada57b0700 1 --2- 172.21.15.146:0/1446719942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fada009e070 0x7fada006f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.789+0000 7fada57b0700 1 -- 172.21.15.146:0/1446719942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada006a770 msgr2=0x7fada0133d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.789+0000 7fada57b0700 1 --2- 172.21.15.146:0/1446719942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada006a770 0x7fada0133d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.789+0000 7fada57b0700 1 -- 172.21.15.146:0/1446719942 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad940094a0 con 0x7fada0134f00 2023-10-03T10:14:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.789+0000 7fad9ffff700 1 --2- 172.21.15.146:0/1446719942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fada009e070 0x7fada006f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.789+0000 7fada57b0700 1 --2- 172.21.15.146:0/1446719942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fada0134f00 0x7fada006fd00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fad98016000 tx=0x7fad98004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.789+0000 7fad9d7fa700 1 -- 172.21.15.146:0/1446719942 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad98012430 con 0x7fada0134f00 2023-10-03T10:14:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.789+0000 7fad9d7fa700 1 -- 172.21.15.146:0/1446719942 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad98020070 con 0x7fada0134f00 2023-10-03T10:14:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.789+0000 7fad9d7fa700 1 -- 172.21.15.146:0/1446719942 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad98004280 con 0x7fada0134f00 2023-10-03T10:14:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.789+0000 7fada7213700 1 -- 172.21.15.146:0/1446719942 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad98009a70 con 0x7fada0134f00 2023-10-03T10:14:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.789+0000 7fada7213700 1 -- 172.21.15.146:0/1446719942 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada00725f0 con 0x7fada0134f00 2023-10-03T10:14:21.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.790+0000 7fada7213700 1 -- 172.21.15.146:0/1446719942 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada004f2a0 con 0x7fada0134f00 2023-10-03T10:14:21.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.791+0000 7fad9d7fa700 1 -- 172.21.15.146:0/1446719942 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad980043e0 con 0x7fada0134f00 2023-10-03T10:14:21.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.791+0000 7fad9d7fa700 1 -- 172.21.15.146:0/1446719942 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fad98022070 con 0x7fada0134f00 2023-10-03T10:14:21.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.795+0000 7fad9d7fa700 1 -- 172.21.15.146:0/1446719942 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad98003e30 con 0x7fada0134f00 2023-10-03T10:14:21.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.798+0000 7ff2368a8700 1 Processor -- start 2023-10-03T10:14:21.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.798+0000 7ff2368a8700 1 -- start start 2023-10-03T10:14:21.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.798+0000 7ff2368a8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff230133ad0 0x7ff230133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.798+0000 7ff2368a8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff2301300a0 0x7ff2301304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.798+0000 7ff2368a8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2301309f0 0x7ff23013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.798+0000 7ff2368a8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23006b2d0 con 0x7ff230133ad0 2023-10-03T10:14:21.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.798+0000 7ff2368a8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff230133610 con 0x7ff2301309f0 2023-10-03T10:14:21.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.798+0000 7ff2368a8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff23009a500 con 0x7ff2301300a0 2023-10-03T10:14:21.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.799+0000 7ff22ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff230133ad0 0x7ff230133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.799+0000 7ff22ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff230133ad0 0x7ff230133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49734/0 (socket says 172.21.15.146:49734) 2023-10-03T10:14:21.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.799+0000 7ff22ffff700 1 -- 172.21.15.146:0/2164001110 learned_addr learned my addr 172.21.15.146:0/2164001110 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:21.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.799+0000 7ff22f7fe700 1 --2- 172.21.15.146:0/2164001110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff2301300a0 0x7ff2301304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.799+0000 7ff22f7fe700 1 -- 172.21.15.146:0/2164001110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2301309f0 msgr2=0x7ff23013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:21.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.799+0000 7ff22f7fe700 1 --2- 172.21.15.146:0/2164001110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2301309f0 0x7ff23013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.799+0000 7ff22f7fe700 1 -- 172.21.15.146:0/2164001110 >> v2:172.21.15.146:3300/0 conn(0x7ff230133ad0 msgr2=0x7ff230133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:21.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.799+0000 7ff22f7fe700 1 --2- 172.21.15.146:0/2164001110 >> v2:172.21.15.146:3300/0 conn(0x7ff230133ad0 0x7ff230133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.799+0000 7ff22f7fe700 1 -- 172.21.15.146:0/2164001110 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2301338b0 con 0x7ff2301300a0 2023-10-03T10:14:21.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.799+0000 7ff22ffff700 1 --2- 172.21.15.146:0/2164001110 >> v2:172.21.15.146:3300/0 conn(0x7ff230133ad0 0x7ff230133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:21.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.799+0000 7ff22f7fe700 1 --2- 172.21.15.146:0/2164001110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff2301300a0 0x7ff2301304b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff224009840 tx=0x7ff224009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57a8b821ad000058 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.799+0000 7ff22effd700 1 -- 172.21.15.146:0/2164001110 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224011830 con 0x7ff2301300a0 2023-10-03T10:14:21.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.799+0000 7ff22effd700 1 -- 172.21.15.146:0/2164001110 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff224011990 con 0x7ff2301300a0 2023-10-03T10:14:21.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.799+0000 7ff22effd700 1 -- 172.21.15.146:0/2164001110 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224011d20 con 0x7ff2301300a0 2023-10-03T10:14:21.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.800+0000 7ff2368a8700 1 -- 172.21.15.146:0/2164001110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff2301300a0 msgr2=0x7ff2301304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.800+0000 7ff2368a8700 1 --2- 172.21.15.146:0/2164001110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff2301300a0 0x7ff2301304b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff224009840 tx=0x7ff224009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:21.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.800+0000 7ff2368a8700 1 -- 172.21.15.146:0/2164001110 shutdown_connections 2023-10-03T10:14:21.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.800+0000 7ff2368a8700 1 --2- 172.21.15.146:0/2164001110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2301309f0 0x7ff23013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.800+0000 7ff2368a8700 1 --2- 172.21.15.146:0/2164001110 >> v2:172.21.15.146:3300/0 conn(0x7ff230133ad0 0x7ff230133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.800+0000 7ff2368a8700 1 --2- 172.21.15.146:0/2164001110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff2301300a0 0x7ff2301304b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.800+0000 7ff2368a8700 1 -- 172.21.15.146:0/2164001110 >> 172.21.15.146:0/2164001110 conn(0x7ff230099c40 msgr2=0x7ff2300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.800+0000 7ff2368a8700 1 -- 172.21.15.146:0/2164001110 shutdown_connections 2023-10-03T10:14:21.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.800+0000 7ff2368a8700 1 -- 172.21.15.146:0/2164001110 wait complete. 2023-10-03T10:14:21.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.801+0000 7ff2368a8700 1 Processor -- start 2023-10-03T10:14:21.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.801+0000 7ff2368a8700 1 -- start start 2023-10-03T10:14:21.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.802+0000 7ff2368a8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2301300a0 0x7ff2300711a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.802+0000 7ff2368a8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2301309f0 0x7ff2300716e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.802+0000 7ff2368a8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff230133ad0 0x7ff230071c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.802+0000 7ff2368a8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2301bb3b0 con 0x7ff2301300a0 2023-10-03T10:14:21.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.802+0000 7ff2368a8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2300a3400 con 0x7ff2301309f0 2023-10-03T10:14:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.802+0000 7ff2368a8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2301bc2c0 con 0x7ff230133ad0 2023-10-03T10:14:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.802+0000 7ff22f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2301309f0 0x7ff2300716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.802+0000 7ff22f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2301309f0 0x7ff2300716e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:49556/0 (socket says 172.21.15.146:49556) 2023-10-03T10:14:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.802+0000 7ff22f7fe700 1 -- 172.21.15.146:0/582243194 learned_addr learned my addr 172.21.15.146:0/582243194 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.802+0000 7ff234e45700 1 --2- 172.21.15.146:0/582243194 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff230133ad0 0x7ff230071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.802+0000 7ff22ffff700 1 --2- 172.21.15.146:0/582243194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2301300a0 0x7ff2300711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.802+0000 7ff22f7fe700 1 -- 172.21.15.146:0/582243194 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff230133ad0 msgr2=0x7ff230071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.802+0000 7ff22f7fe700 1 --2- 172.21.15.146:0/582243194 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff230133ad0 0x7ff230071c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.802+0000 7ff22f7fe700 1 -- 172.21.15.146:0/582243194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2301300a0 msgr2=0x7ff2300711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.802+0000 7ff22f7fe700 1 --2- 172.21.15.146:0/582243194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2301300a0 0x7ff2300711a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.802+0000 7ff22f7fe700 1 -- 172.21.15.146:0/582243194 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff220009550 con 0x7ff2301309f0 2023-10-03T10:14:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.803+0000 7ff22f7fe700 1 --2- 172.21.15.146:0/582243194 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2301309f0 0x7ff2300716e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff224009fd0 tx=0x7ff224004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.803+0000 7ff22cff9700 1 -- 172.21.15.146:0/582243194 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224004510 con 0x7ff2301309f0 2023-10-03T10:14:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.803+0000 7ff22cff9700 1 -- 172.21.15.146:0/582243194 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22401f070 con 0x7ff2301309f0 2023-10-03T10:14:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.803+0000 7ff22cff9700 1 -- 172.21.15.146:0/582243194 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2240038e0 con 0x7ff2301309f0 2023-10-03T10:14:21.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.803+0000 7ff2368a8700 1 -- 172.21.15.146:0/582243194 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2240094a0 con 0x7ff2301309f0 2023-10-03T10:14:21.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.803+0000 7ff2368a8700 1 -- 172.21.15.146:0/582243194 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2301b9b50 con 0x7ff2301309f0 2023-10-03T10:14:21.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.804+0000 7ff22cff9700 1 -- 172.21.15.146:0/582243194 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff224003a40 con 0x7ff2301309f0 2023-10-03T10:14:21.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.804+0000 7ff2368a8700 1 -- 172.21.15.146:0/582243194 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23012dd60 con 0x7ff2301309f0 2023-10-03T10:14:21.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.804+0000 7ff22cff9700 1 -- 172.21.15.146:0/582243194 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff224021070 con 0x7ff2301309f0 2023-10-03T10:14:21.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.813+0000 7ff22cff9700 1 -- 172.21.15.146:0/582243194 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff22401a430 con 0x7ff2301309f0 2023-10-03T10:14:21.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.888+0000 7f3f98e59700 1 -- 172.21.15.146:0/584658746 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3f9404f2a0 con 0x7f3f941368e0 2023-10-03T10:14:21.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.889+0000 7f3f82ffd700 1 -- 172.21.15.146:0/584658746 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3f88013720 con 0x7f3f941368e0 2023-10-03T10:14:21.890 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:21.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.891+0000 7f3f98e59700 1 -- 172.21.15.146:0/584658746 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f941368e0 msgr2=0x7f3f9411a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.891+0000 7f3f98e59700 1 --2- 172.21.15.146:0/584658746 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f941368e0 0x7f3f9411a220 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800ebe0 tx=0x7f3f8800eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.891+0000 7f3f98e59700 1 -- 172.21.15.146:0/584658746 shutdown_connections 2023-10-03T10:14:21.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.891+0000 7f3f98e59700 1 --2- 172.21.15.146:0/584658746 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f94139200 0x7f3f9411a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.891+0000 7f3f98e59700 1 --2- 172.21.15.146:0/584658746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f94133b10 0x7f3f94119ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.891+0000 7f3f98e59700 1 --2- 172.21.15.146:0/584658746 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f941368e0 0x7f3f9411a220 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.891+0000 7f3f98e59700 1 -- 172.21.15.146:0/584658746 >> 172.21.15.146:0/584658746 conn(0x7f3f940a2980 msgr2=0x7f3f94136f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.891+0000 7f3f98e59700 1 -- 172.21.15.146:0/584658746 shutdown_connections 2023-10-03T10:14:21.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.891+0000 7f3f98e59700 1 -- 172.21.15.146:0/584658746 wait complete. 2023-10-03T10:14:21.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:21.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.954+0000 7f204fc75700 1 -- 172.21.15.146:0/2351872068 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2030005590 con 0x7f2048137140 2023-10-03T10:14:21.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.954+0000 7f203e7fc700 1 -- 172.21.15.146:0/2351872068 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2040018020 con 0x7f2048137140 2023-10-03T10:14:21.955 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:21.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.956+0000 7f204fc75700 1 -- 172.21.15.146:0/2351872068 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2048137140 msgr2=0x7f2048120fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.956+0000 7f204fc75700 1 --2- 172.21.15.146:0/2351872068 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2048137140 0x7f2048120fa0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f204000efc0 tx=0x7f204000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.956+0000 7f204fc75700 1 -- 172.21.15.146:0/2351872068 shutdown_connections 2023-10-03T10:14:21.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.956+0000 7f204fc75700 1 --2- 172.21.15.146:0/2351872068 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2048137140 0x7f2048120fa0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.956+0000 7f204fc75700 1 --2- 172.21.15.146:0/2351872068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f204806a770 0x7f2048120520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.956+0000 7f204fc75700 1 --2- 172.21.15.146:0/2351872068 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f204806b250 0x7f2048120a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.956+0000 7f204fc75700 1 -- 172.21.15.146:0/2351872068 >> 172.21.15.146:0/2351872068 conn(0x7f2048099c40 msgr2=0x7f204806fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.956+0000 7f204fc75700 1 -- 172.21.15.146:0/2351872068 shutdown_connections 2023-10-03T10:14:21.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:21.956+0000 7f204fc75700 1 -- 172.21.15.146:0/2351872068 wait complete. 2023-10-03T10:14:21.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:22.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:22.016+0000 7fada7213700 1 -- 172.21.15.146:0/1446719942 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fada00725f0 con 0x7fada0134f00 2023-10-03T10:14:22.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:22.016+0000 7fad9d7fa700 1 -- 172.21.15.146:0/1446719942 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fada00725f0 con 0x7fada0134f00 2023-10-03T10:14:22.017 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:22.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:22.018+0000 7fada7213700 1 -- 172.21.15.146:0/1446719942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fada0134f00 msgr2=0x7fada006fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:22.018+0000 7fada7213700 1 --2- 172.21.15.146:0/1446719942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fada0134f00 0x7fada006fd00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fad98016000 tx=0x7fad98004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:22.018+0000 7fada7213700 1 -- 172.21.15.146:0/1446719942 shutdown_connections 2023-10-03T10:14:22.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:22.018+0000 7fada7213700 1 --2- 172.21.15.146:0/1446719942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fada0134f00 0x7fada006fd00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:22.018+0000 7fada7213700 1 --2- 172.21.15.146:0/1446719942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fada006a770 0x7fada0133d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:22.018+0000 7fada7213700 1 --2- 172.21.15.146:0/1446719942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fada009e070 0x7fada006f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:22.018+0000 7fada7213700 1 -- 172.21.15.146:0/1446719942 >> 172.21.15.146:0/1446719942 conn(0x7fada0099c40 msgr2=0x7fada009c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:22.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:22.018+0000 7fada7213700 1 -- 172.21.15.146:0/1446719942 shutdown_connections 2023-10-03T10:14:22.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:22.018+0000 7fada7213700 1 -- 172.21.15.146:0/1446719942 wait complete. 2023-10-03T10:14:22.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:22.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:22.031+0000 7ff2368a8700 1 -- 172.21.15.146:0/582243194 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff23009cb20 con 0x7ff2301309f0 2023-10-03T10:14:22.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:22.031+0000 7ff22cff9700 1 -- 172.21.15.146:0/582243194 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff22402b020 con 0x7ff2301309f0 2023-10-03T10:14:22.032 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:22.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:22.033+0000 7ff2368a8700 1 -- 172.21.15.146:0/582243194 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2301309f0 msgr2=0x7ff2300716e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:22.033+0000 7ff2368a8700 1 --2- 172.21.15.146:0/582243194 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2301309f0 0x7ff2300716e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff224009fd0 tx=0x7ff224004750 comp rx=0 tx=0).stop 2023-10-03T10:14:22.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:22.033+0000 7ff2368a8700 1 -- 172.21.15.146:0/582243194 shutdown_connections 2023-10-03T10:14:22.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:22.033+0000 7ff2368a8700 1 --2- 172.21.15.146:0/582243194 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff230133ad0 0x7ff230071c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:22.033+0000 7ff2368a8700 1 --2- 172.21.15.146:0/582243194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2301300a0 0x7ff2300711a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:22.033+0000 7ff2368a8700 1 --2- 172.21.15.146:0/582243194 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2301309f0 0x7ff2300716e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:22.033+0000 7ff2368a8700 1 -- 172.21.15.146:0/582243194 >> 172.21.15.146:0/582243194 conn(0x7ff230099c40 msgr2=0x7ff23012f010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:22.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:22.033+0000 7ff2368a8700 1 -- 172.21.15.146:0/582243194 shutdown_connections 2023-10-03T10:14:22.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:22.033+0000 7ff2368a8700 1 -- 172.21.15.146:0/582243194 wait complete. 2023-10-03T10:14:22.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:22.910 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:22.970 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:23.032 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:23.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.041+0000 7f815e0c0700 1 Processor -- start 2023-10-03T10:14:23.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.041+0000 7f815e0c0700 1 -- start start 2023-10-03T10:14:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.042+0000 7f815e0c0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f815809dec0 0x7f815806b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.042+0000 7f815e0c0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8158136cb0 0x7f8158139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.042+0000 7f815e0c0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f815806e900 con 0x7f815806a770 2023-10-03T10:14:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.042+0000 7f815e0c0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f815809d180 con 0x7f8158136cb0 2023-10-03T10:14:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.042+0000 7f815e0c0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f815809e780 con 0x7f815809dec0 2023-10-03T10:14:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.042+0000 7f814ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f815809dec0 0x7f815806b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.042+0000 7f8157fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8158136cb0 0x7f8158139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.042+0000 7f814ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f815809dec0 0x7f815806b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46970/0 (socket says 172.21.15.146:46970) 2023-10-03T10:14:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.042+0000 7f814ffff700 1 -- 172.21.15.146:0/3014304517 learned_addr learned my addr 172.21.15.146:0/3014304517 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.042+0000 7f814ffff700 1 -- 172.21.15.146:0/3014304517 >> v2:172.21.15.146:3300/0 conn(0x7f8158136cb0 msgr2=0x7f8158139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.042+0000 7f8156ffd700 1 -- 172.21.15.146:0/3014304517 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801973697 0 0) 0x7f815806e900 con 0x7f815806a770 2023-10-03T10:14:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.042+0000 7f814ffff700 1 --2- 172.21.15.146:0/3014304517 >> v2:172.21.15.146:3300/0 conn(0x7f8158136cb0 0x7f8158139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.042+0000 7f814ffff700 1 -- 172.21.15.146:0/3014304517 >> v1:172.21.15.146:6789/0 conn(0x7f815806a770 legacy=0x7f815806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.042+0000 7f814ffff700 1 -- 172.21.15.146:0/3014304517 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815809d3c0 con 0x7f815809dec0 2023-10-03T10:14:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.042+0000 7f8157fff700 1 --2- 172.21.15.146:0/3014304517 >> v2:172.21.15.146:3300/0 conn(0x7f8158136cb0 0x7f8158139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.042+0000 7f814ffff700 1 --2- 172.21.15.146:0/3014304517 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f815809dec0 0x7f815806b250 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f81400098f0 tx=0x7f8140009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61912248f880aec7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.042+0000 7f8156ffd700 1 -- 172.21.15.146:0/3014304517 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814000b8a0 con 0x7f815809dec0 2023-10-03T10:14:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.043+0000 7f8156ffd700 1 -- 172.21.15.146:0/3014304517 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814000ba00 con 0x7f815809dec0 2023-10-03T10:14:23.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.043+0000 7f8156ffd700 1 -- 172.21.15.146:0/3014304517 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814000bd90 con 0x7f815809dec0 2023-10-03T10:14:23.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.043+0000 7f815e0c0700 1 -- 172.21.15.146:0/3014304517 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f815809dec0 msgr2=0x7f815806b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.043+0000 7f815e0c0700 1 --2- 172.21.15.146:0/3014304517 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f815809dec0 0x7f815806b250 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f81400098f0 tx=0x7f8140009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:23.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.043+0000 7f815e0c0700 1 -- 172.21.15.146:0/3014304517 shutdown_connections 2023-10-03T10:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.043+0000 7f815e0c0700 1 --2- 172.21.15.146:0/3014304517 >> v2:172.21.15.146:3300/0 conn(0x7f8158136cb0 0x7f8158139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.043+0000 7f815e0c0700 1 --2- 172.21.15.146:0/3014304517 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f815809dec0 0x7f815806b250 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.043+0000 7f815e0c0700 1 -- 172.21.15.146:0/3014304517 >> 172.21.15.146:0/3014304517 conn(0x7f8158099c40 msgr2=0x7f81580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.043+0000 7f815e0c0700 1 -- 172.21.15.146:0/3014304517 shutdown_connections 2023-10-03T10:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.043+0000 7f815e0c0700 1 -- 172.21.15.146:0/3014304517 wait complete. 2023-10-03T10:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.044+0000 7f815e0c0700 1 Processor -- start 2023-10-03T10:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.044+0000 7f815e0c0700 1 -- start start 2023-10-03T10:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.045+0000 7f815e0c0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f815806a770 0x7f815809a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.045+0000 7f815e0c0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f815809dec0 0x7f815809a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.045+0000 7f815e0c0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8158136cb0 0x7f815809af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.045+0000 7f815e0c0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8158135110 con 0x7f815809dec0 2023-10-03T10:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.045+0000 7f815e0c0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8158139110 con 0x7f8158136cb0 2023-10-03T10:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.045+0000 7f815e0c0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81581353e0 con 0x7f815806a770 2023-10-03T10:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.045+0000 7f814ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f815809dec0 0x7f815809a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.045+0000 7f81577fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f815806a770 0x7f815809a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.045+0000 7f814ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f815809dec0 0x7f815809a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49756/0 (socket says 172.21.15.146:49756) 2023-10-03T10:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.045+0000 7f814ffff700 1 -- 172.21.15.146:0/3162151969 learned_addr learned my addr 172.21.15.146:0/3162151969 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.045+0000 7f8157fff700 1 --2- 172.21.15.146:0/3162151969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8158136cb0 0x7f815809af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.045+0000 7f81577fe700 1 -- 172.21.15.146:0/3162151969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8158136cb0 msgr2=0x7f815809af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.045+0000 7f81577fe700 1 --2- 172.21.15.146:0/3162151969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8158136cb0 0x7f815809af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.045+0000 7f81577fe700 1 -- 172.21.15.146:0/3162151969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f815809dec0 msgr2=0x7f815809a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.045+0000 7f81577fe700 1 --2- 172.21.15.146:0/3162151969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f815809dec0 0x7f815809a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.045+0000 7f81577fe700 1 -- 172.21.15.146:0/3162151969 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8140009550 con 0x7f815806a770 2023-10-03T10:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.045+0000 7f814ffff700 1 --2- 172.21.15.146:0/3162151969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f815809dec0 0x7f815809a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:23.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.045+0000 7f81577fe700 1 --2- 172.21.15.146:0/3162151969 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f815806a770 0x7f815809a490 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f814800c430 tx=0x7f814800c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.045+0000 7f8154ff9700 1 -- 172.21.15.146:0/3162151969 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81480052d0 con 0x7f815806a770 2023-10-03T10:14:23.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.046+0000 7f8154ff9700 1 -- 172.21.15.146:0/3162151969 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8148005430 con 0x7f815806a770 2023-10-03T10:14:23.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.046+0000 7f815e0c0700 1 -- 172.21.15.146:0/3162151969 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81581356a0 con 0x7f815806a770 2023-10-03T10:14:23.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.046+0000 7f8154ff9700 1 -- 172.21.15.146:0/3162151969 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81480038a0 con 0x7f815806a770 2023-10-03T10:14:23.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.046+0000 7f815e0c0700 1 -- 172.21.15.146:0/3162151969 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8158134d20 con 0x7f815806a770 2023-10-03T10:14:23.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.046+0000 7f8154ff9700 1 -- 172.21.15.146:0/3162151969 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8148003c10 con 0x7f815806a770 2023-10-03T10:14:23.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.046+0000 7f8154ff9700 1 -- 172.21.15.146:0/3162151969 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f814803ed20 con 0x7f815806a770 2023-10-03T10:14:23.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.047+0000 7f815e0c0700 1 -- 172.21.15.146:0/3162151969 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8158071ce0 con 0x7f815806a770 2023-10-03T10:14:23.050 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:23.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.052+0000 7f8154ff9700 1 -- 172.21.15.146:0/3162151969 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8148017080 con 0x7f815806a770 2023-10-03T10:14:23.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.103+0000 7fb265859700 1 Processor -- start 2023-10-03T10:14:23.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.103+0000 7fb265859700 1 -- start start 2023-10-03T10:14:23.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.104+0000 7fb265859700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb260098410 0x7fb2600987e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.104+0000 7fb265859700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb26009e440 0x7fb2601397e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.104+0000 7fb265859700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26006f970 con 0x7fb26009d8f0 2023-10-03T10:14:23.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.104+0000 7fb265859700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2600720a0 con 0x7fb260098410 2023-10-03T10:14:23.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.104+0000 7fb265859700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb260072290 con 0x7fb26009e440 2023-10-03T10:14:23.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.104+0000 7fb25e7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb26009d8f0 0x7fb26009dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47378/0 (socket says 172.21.15.146:47378) 2023-10-03T10:14:23.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.104+0000 7fb25e7fc700 1 -- 172.21.15.146:0/1677786770 learned_addr learned my addr 172.21.15.146:0/1677786770 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:23.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.104+0000 7fb25f7fe700 1 --2- 172.21.15.146:0/1677786770 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb26009e440 0x7fb2601397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.104+0000 7fb25effd700 1 --2- 172.21.15.146:0/1677786770 >> v2:172.21.15.146:3300/0 conn(0x7fb260098410 0x7fb2600987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.104+0000 7fb25dffb700 1 -- 172.21.15.146:0/1677786770 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345659703 0 0) 0x7fb26006f970 con 0x7fb26009d8f0 2023-10-03T10:14:23.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.104+0000 7fb25dffb700 1 -- 172.21.15.146:0/1677786770 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2480035b0 con 0x7fb26009d8f0 2023-10-03T10:14:23.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.105+0000 7fb25f7fe700 1 -- 172.21.15.146:0/1677786770 >> v2:172.21.15.146:3300/0 conn(0x7fb260098410 msgr2=0x7fb2600987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:23.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.105+0000 7fb25f7fe700 1 --2- 172.21.15.146:0/1677786770 >> v2:172.21.15.146:3300/0 conn(0x7fb260098410 0x7fb2600987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.105+0000 7fb25f7fe700 1 -- 172.21.15.146:0/1677786770 >> v1:172.21.15.146:6789/0 conn(0x7fb26009d8f0 legacy=0x7fb26009dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.105+0000 7fb25f7fe700 1 -- 172.21.15.146:0/1677786770 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb260071530 con 0x7fb26009e440 2023-10-03T10:14:23.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.105+0000 7fb25f7fe700 1 --2- 172.21.15.146:0/1677786770 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb26009e440 0x7fb2601397e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb258009d90 tx=0x7fb25800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=792eaac168e024fb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.105+0000 7fb25dffb700 1 -- 172.21.15.146:0/1677786770 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25800e070 con 0x7fb26009e440 2023-10-03T10:14:23.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.105+0000 7fb25dffb700 1 -- 172.21.15.146:0/1677786770 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25800bb20 con 0x7fb26009e440 2023-10-03T10:14:23.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.105+0000 7fb25dffb700 1 -- 172.21.15.146:0/1677786770 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258012430 con 0x7fb26009e440 2023-10-03T10:14:23.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.106+0000 7fb265859700 1 -- 172.21.15.146:0/1677786770 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb26009e440 msgr2=0x7fb2601397e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.106+0000 7fb265859700 1 --2- 172.21.15.146:0/1677786770 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb26009e440 0x7fb2601397e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb258009d90 tx=0x7fb25800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:23.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.106+0000 7fb265859700 1 -- 172.21.15.146:0/1677786770 shutdown_connections 2023-10-03T10:14:23.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.106+0000 7fb265859700 1 --2- 172.21.15.146:0/1677786770 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb26009e440 0x7fb2601397e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.106+0000 7fb265859700 1 --2- 172.21.15.146:0/1677786770 >> v2:172.21.15.146:3300/0 conn(0x7fb260098410 0x7fb2600987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.106+0000 7fb265859700 1 -- 172.21.15.146:0/1677786770 >> 172.21.15.146:0/1677786770 conn(0x7fb2600a2b30 msgr2=0x7fb26009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.106+0000 7fb265859700 1 -- 172.21.15.146:0/1677786770 shutdown_connections 2023-10-03T10:14:23.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.106+0000 7fb265859700 1 -- 172.21.15.146:0/1677786770 wait complete. 2023-10-03T10:14:23.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.107+0000 7fb265859700 1 Processor -- start 2023-10-03T10:14:23.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.107+0000 7fb265859700 1 -- start start 2023-10-03T10:14:23.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.107+0000 7fb265859700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb260098410 0x7fb26006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.107+0000 7fb265859700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb26009d8f0 0x7fb26006dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.107+0000 7fb265859700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb26009e440 0x7fb26006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.107+0000 7fb265859700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26012c1c0 con 0x7fb26009d8f0 2023-10-03T10:14:23.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.107+0000 7fb265859700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26012b4d0 con 0x7fb26009e440 2023-10-03T10:14:23.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.107+0000 7fb265859700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb26012c4a0 con 0x7fb260098410 2023-10-03T10:14:23.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.108+0000 7fb25effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb260098410 0x7fb26006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.108+0000 7fb25effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb260098410 0x7fb26006d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46992/0 (socket says 172.21.15.146:46992) 2023-10-03T10:14:23.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.108+0000 7fb25effd700 1 -- 172.21.15.146:0/3026241409 learned_addr learned my addr 172.21.15.146:0/3026241409 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:23.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.108+0000 7fb25f7fe700 1 --2- 172.21.15.146:0/3026241409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb26009e440 0x7fb26006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.108+0000 7fb25e7fc700 1 --2- 172.21.15.146:0/3026241409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb26009d8f0 0x7fb26006dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.108+0000 7fb25f7fe700 1 -- 172.21.15.146:0/3026241409 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb260098410 msgr2=0x7fb26006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.108+0000 7fb25f7fe700 1 --2- 172.21.15.146:0/3026241409 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb260098410 0x7fb26006d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.108+0000 7fb25f7fe700 1 -- 172.21.15.146:0/3026241409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb26009d8f0 msgr2=0x7fb26006dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.108+0000 7fb25f7fe700 1 --2- 172.21.15.146:0/3026241409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb26009d8f0 0x7fb26006dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.108+0000 7fb25f7fe700 1 -- 172.21.15.146:0/3026241409 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb258009a70 con 0x7fb26009e440 2023-10-03T10:14:23.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.108+0000 7fb25effd700 1 --2- 172.21.15.146:0/3026241409 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb260098410 0x7fb26006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:23.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.108+0000 7fb25e7fc700 1 --2- 172.21.15.146:0/3026241409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb26009d8f0 0x7fb26006dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:23.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.108+0000 7fb25f7fe700 1 --2- 172.21.15.146:0/3026241409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb26009e440 0x7fb26006e130 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb260132560 tx=0x7fb258004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.108+0000 7fb247fff700 1 -- 172.21.15.146:0/3026241409 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258012430 con 0x7fb26009e440 2023-10-03T10:14:23.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.108+0000 7fb247fff700 1 -- 172.21.15.146:0/3026241409 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb258020070 con 0x7fb26009e440 2023-10-03T10:14:23.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.108+0000 7fb265859700 1 -- 172.21.15.146:0/3026241409 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2600a16a0 con 0x7fb26009e440 2023-10-03T10:14:23.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.108+0000 7fb247fff700 1 -- 172.21.15.146:0/3026241409 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258004280 con 0x7fb26009e440 2023-10-03T10:14:23.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.109+0000 7fb265859700 1 -- 172.21.15.146:0/3026241409 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26012b870 con 0x7fb26009e440 2023-10-03T10:14:23.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.109+0000 7fb247fff700 1 -- 172.21.15.146:0/3026241409 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2580043e0 con 0x7fb26009e440 2023-10-03T10:14:23.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.110+0000 7fb247fff700 1 -- 172.21.15.146:0/3026241409 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb258022070 con 0x7fb26009e440 2023-10-03T10:14:23.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.110+0000 7fb265859700 1 -- 172.21.15.146:0/3026241409 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2601305a0 con 0x7fb26009e440 2023-10-03T10:14:23.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.115+0000 7fb247fff700 1 -- 172.21.15.146:0/3026241409 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb258003e30 con 0x7fb26009e440 2023-10-03T10:14:23.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.164+0000 7ff02c503700 1 Processor -- start 2023-10-03T10:14:23.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.164+0000 7ff02c503700 1 -- start start 2023-10-03T10:14:23.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.164+0000 7ff02c503700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff024133ad0 0x7ff024133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.164+0000 7ff02c503700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0241300a0 0x7ff0241304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.164+0000 7ff02c503700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff0241309f0 0x7ff02413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.164+0000 7ff02c503700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff02406b2d0 con 0x7ff0241309f0 2023-10-03T10:14:23.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.164+0000 7ff02c503700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff024133610 con 0x7ff024133ad0 2023-10-03T10:14:23.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.164+0000 7ff02c503700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff02409a500 con 0x7ff0241300a0 2023-10-03T10:14:23.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.164+0000 7ff029a9e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0241300a0 0x7ff0241304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.165+0000 7ff029a9e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0241300a0 0x7ff0241304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:46994/0 (socket says 172.21.15.146:46994) 2023-10-03T10:14:23.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.165+0000 7ff029a9e700 1 -- 172.21.15.146:0/2764712628 learned_addr learned my addr 172.21.15.146:0/2764712628 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:23.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.165+0000 7ff02a29f700 1 --2- 172.21.15.146:0/2764712628 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff024133ad0 0x7ff024133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.165+0000 7ff02aaa0700 1 --2- 172.21.15.146:0/2764712628 >> v2:172.21.15.146:3300/0 conn(0x7ff0241309f0 0x7ff02413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.165+0000 7ff029a9e700 1 -- 172.21.15.146:0/2764712628 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff024133ad0 msgr2=0x7ff024133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:23.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.165+0000 7ff029a9e700 1 --2- 172.21.15.146:0/2764712628 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff024133ad0 0x7ff024133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.165+0000 7ff029a9e700 1 -- 172.21.15.146:0/2764712628 >> v2:172.21.15.146:3300/0 conn(0x7ff0241309f0 msgr2=0x7ff02413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:23.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.165+0000 7ff029a9e700 1 --2- 172.21.15.146:0/2764712628 >> v2:172.21.15.146:3300/0 conn(0x7ff0241309f0 0x7ff02413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.165+0000 7ff029a9e700 1 -- 172.21.15.146:0/2764712628 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0241338b0 con 0x7ff0241300a0 2023-10-03T10:14:23.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.165+0000 7ff029a9e700 1 --2- 172.21.15.146:0/2764712628 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0241300a0 0x7ff0241304b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff0140098f0 tx=0x7ff014009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea2d6a6f6e9b9513 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.165+0000 7ff02929d700 1 -- 172.21.15.146:0/2764712628 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff014011830 con 0x7ff0241300a0 2023-10-03T10:14:23.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.165+0000 7ff02929d700 1 -- 172.21.15.146:0/2764712628 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff014011990 con 0x7ff0241300a0 2023-10-03T10:14:23.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.165+0000 7ff02929d700 1 -- 172.21.15.146:0/2764712628 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff014011d00 con 0x7ff0241300a0 2023-10-03T10:14:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.166+0000 7ff02c503700 1 -- 172.21.15.146:0/2764712628 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0241300a0 msgr2=0x7ff0241304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.166+0000 7ff02c503700 1 --2- 172.21.15.146:0/2764712628 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0241300a0 0x7ff0241304b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff0140098f0 tx=0x7ff014009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.166+0000 7ff02c503700 1 -- 172.21.15.146:0/2764712628 shutdown_connections 2023-10-03T10:14:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.166+0000 7ff02c503700 1 --2- 172.21.15.146:0/2764712628 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff024133ad0 0x7ff024133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.166+0000 7ff02c503700 1 --2- 172.21.15.146:0/2764712628 >> v2:172.21.15.146:3300/0 conn(0x7ff0241309f0 0x7ff02413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.166+0000 7ff02c503700 1 --2- 172.21.15.146:0/2764712628 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0241300a0 0x7ff0241304b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.166+0000 7ff02c503700 1 -- 172.21.15.146:0/2764712628 >> 172.21.15.146:0/2764712628 conn(0x7ff024099c40 msgr2=0x7ff0240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.166+0000 7ff02c503700 1 -- 172.21.15.146:0/2764712628 shutdown_connections 2023-10-03T10:14:23.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.166+0000 7ff02c503700 1 -- 172.21.15.146:0/2764712628 wait complete. 2023-10-03T10:14:23.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.167+0000 7ff02c503700 1 Processor -- start 2023-10-03T10:14:23.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.167+0000 7ff02c503700 1 -- start start 2023-10-03T10:14:23.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.168+0000 7ff02c503700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0241300a0 0x7ff0241c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.168+0000 7ff02c503700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0241309f0 0x7ff0241c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.168+0000 7ff02c503700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff024133ad0 0x7ff0241c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.168+0000 7ff02c503700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0241201e0 con 0x7ff0241300a0 2023-10-03T10:14:23.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.168+0000 7ff02c503700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0240723b0 con 0x7ff0241309f0 2023-10-03T10:14:23.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.168+0000 7ff02c503700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff02411fac0 con 0x7ff024133ad0 2023-10-03T10:14:23.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.168+0000 7ff02a29f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0241300a0 0x7ff0241c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.168+0000 7ff02a29f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0241300a0 0x7ff0241c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49788/0 (socket says 172.21.15.146:49788) 2023-10-03T10:14:23.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.168+0000 7ff02a29f700 1 -- 172.21.15.146:0/3134889283 learned_addr learned my addr 172.21.15.146:0/3134889283 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:23.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.168+0000 7ff02aaa0700 1 --2- 172.21.15.146:0/3134889283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff024133ad0 0x7ff0241c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.168+0000 7ff029a9e700 1 --2- 172.21.15.146:0/3134889283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0241309f0 0x7ff0241c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.169+0000 7ff02aaa0700 1 -- 172.21.15.146:0/3134889283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0241309f0 msgr2=0x7ff0241c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.169+0000 7ff02aaa0700 1 --2- 172.21.15.146:0/3134889283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0241309f0 0x7ff0241c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.169+0000 7ff02aaa0700 1 -- 172.21.15.146:0/3134889283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0241300a0 msgr2=0x7ff0241c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.169+0000 7ff02aaa0700 1 --2- 172.21.15.146:0/3134889283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0241300a0 0x7ff0241c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.169+0000 7ff02aaa0700 1 -- 172.21.15.146:0/3134889283 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff014009550 con 0x7ff024133ad0 2023-10-03T10:14:23.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.169+0000 7ff02aaa0700 1 --2- 172.21.15.146:0/3134889283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff024133ad0 0x7ff0241c91d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff01c007cf0 tx=0x7ff01c00e0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.169+0000 7ff01affd700 1 -- 172.21.15.146:0/3134889283 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c018070 con 0x7ff024133ad0 2023-10-03T10:14:23.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.169+0000 7ff01affd700 1 -- 172.21.15.146:0/3134889283 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01c003a20 con 0x7ff024133ad0 2023-10-03T10:14:23.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.169+0000 7ff01affd700 1 -- 172.21.15.146:0/3134889283 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c003dd0 con 0x7ff024133ad0 2023-10-03T10:14:23.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.170+0000 7ff02c503700 1 -- 172.21.15.146:0/3134889283 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff02411fe40 con 0x7ff024133ad0 2023-10-03T10:14:23.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.170+0000 7ff02c503700 1 -- 172.21.15.146:0/3134889283 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff02412dd00 con 0x7ff024133ad0 2023-10-03T10:14:23.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.171+0000 7ff02c503700 1 -- 172.21.15.146:0/3134889283 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02409e840 con 0x7ff024133ad0 2023-10-03T10:14:23.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.171+0000 7ff01affd700 1 -- 172.21.15.146:0/3134889283 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff01c00e970 con 0x7ff024133ad0 2023-10-03T10:14:23.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.171+0000 7ff01affd700 1 -- 172.21.15.146:0/3134889283 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff01c03f6e0 con 0x7ff024133ad0 2023-10-03T10:14:23.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.176+0000 7ff01affd700 1 -- 172.21.15.146:0/3134889283 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff01c01cd00 con 0x7ff024133ad0 2023-10-03T10:14:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.181+0000 7f026875c700 1 Processor -- start 2023-10-03T10:14:23.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.181+0000 7f026875c700 1 -- start start 2023-10-03T10:14:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.182+0000 7f026875c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f026009e340 0x7f02601359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.182+0000 7f026875c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0260135f20 0x7f0260138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.182+0000 7f026875c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026009aaa0 con 0x7f026009d860 2023-10-03T10:14:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.182+0000 7f026875c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026009e730 con 0x7f026009e340 2023-10-03T10:14:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.182+0000 7f026875c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026009f870 con 0x7f0260135f20 2023-10-03T10:14:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.182+0000 7f02664f8700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f026009d860 0x7f026009dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47388/0 (socket says 172.21.15.146:47388) 2023-10-03T10:14:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.182+0000 7f02664f8700 1 -- 172.21.15.146:0/306808134 learned_addr learned my addr 172.21.15.146:0/306808134 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.182+0000 7f0265cf7700 1 --2- 172.21.15.146:0/306808134 >> v2:172.21.15.146:3300/0 conn(0x7f026009e340 0x7f02601359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.182+0000 7f0266cf9700 1 --2- 172.21.15.146:0/306808134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0260135f20 0x7f0260138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.182+0000 7f0265cf7700 1 -- 172.21.15.146:0/306808134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0260135f20 msgr2=0x7f0260138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.182+0000 7f0265cf7700 1 --2- 172.21.15.146:0/306808134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0260135f20 0x7f0260138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.182+0000 7f0265cf7700 1 -- 172.21.15.146:0/306808134 >> v1:172.21.15.146:6789/0 conn(0x7f026009d860 legacy=0x7f026009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.182+0000 7f0265cf7700 1 -- 172.21.15.146:0/306808134 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026009b360 con 0x7f026009e340 2023-10-03T10:14:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.183+0000 7f0265cf7700 1 --2- 172.21.15.146:0/306808134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f026009e340 0x7f02601359e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f025000bae0 tx=0x7f025000bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c835d6206c25e4c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.183+0000 7f02654f6700 1 -- 172.21.15.146:0/306808134 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025000dc70 con 0x7f026009e340 2023-10-03T10:14:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.183+0000 7f02654f6700 1 -- 172.21.15.146:0/306808134 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025000ddd0 con 0x7f026009e340 2023-10-03T10:14:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.183+0000 7f02654f6700 1 -- 172.21.15.146:0/306808134 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250010690 con 0x7f026009e340 2023-10-03T10:14:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.183+0000 7f026875c700 1 -- 172.21.15.146:0/306808134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f026009e340 msgr2=0x7f02601359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.183+0000 7f026875c700 1 --2- 172.21.15.146:0/306808134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f026009e340 0x7f02601359e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f025000bae0 tx=0x7f025000bdf0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.184+0000 7f026875c700 1 -- 172.21.15.146:0/306808134 shutdown_connections 2023-10-03T10:14:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.184+0000 7f026875c700 1 --2- 172.21.15.146:0/306808134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0260135f20 0x7f0260138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.184+0000 7f026875c700 1 --2- 172.21.15.146:0/306808134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f026009e340 0x7f02601359e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.184+0000 7f026875c700 1 -- 172.21.15.146:0/306808134 >> 172.21.15.146:0/306808134 conn(0x7f0260099c40 msgr2=0x7f02600a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.184+0000 7f026875c700 1 -- 172.21.15.146:0/306808134 shutdown_connections 2023-10-03T10:14:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.184+0000 7f026875c700 1 -- 172.21.15.146:0/306808134 wait complete. 2023-10-03T10:14:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.185+0000 7f026875c700 1 Processor -- start 2023-10-03T10:14:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.185+0000 7f026875c700 1 -- start start 2023-10-03T10:14:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.185+0000 7f026875c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f026009d860 0x7f02601272a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.185+0000 7f026875c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f026009e340 0x7f02601277e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.185+0000 7f026875c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0260135f20 0x7f0260127d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.185+0000 7f026875c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026009c8b0 con 0x7f026009e340 2023-10-03T10:14:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.185+0000 7f026875c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02601294c0 con 0x7f0260135f20 2023-10-03T10:14:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.185+0000 7f026875c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0260129d90 con 0x7f026009d860 2023-10-03T10:14:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.185+0000 7f0265cf7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f026009e340 0x7f02601277e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.185+0000 7f0265cf7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f026009e340 0x7f02601277e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49802/0 (socket says 172.21.15.146:49802) 2023-10-03T10:14:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.185+0000 7f0265cf7700 1 -- 172.21.15.146:0/2550183232 learned_addr learned my addr 172.21.15.146:0/2550183232 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.185+0000 7f0266cf9700 1 --2- 172.21.15.146:0/2550183232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0260135f20 0x7f0260127d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.186+0000 7f0265cf7700 1 -- 172.21.15.146:0/2550183232 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f026009d860 msgr2=0x7f02601272a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.186+0000 7f0265cf7700 1 --2- 172.21.15.146:0/2550183232 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f026009d860 0x7f02601272a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.186+0000 7f0265cf7700 1 -- 172.21.15.146:0/2550183232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0260135f20 msgr2=0x7f0260127d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.186+0000 7f0265cf7700 1 --2- 172.21.15.146:0/2550183232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0260135f20 0x7f0260127d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.186+0000 7f0265cf7700 1 -- 172.21.15.146:0/2550183232 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025000b740 con 0x7f026009e340 2023-10-03T10:14:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.186+0000 7f0266cf9700 1 --2- 172.21.15.146:0/2550183232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0260135f20 0x7f0260127d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.186+0000 7f0265cf7700 1 --2- 172.21.15.146:0/2550183232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f026009e340 0x7f02601277e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f025000b2c0 tx=0x7f0250004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.186+0000 7f0256ffd700 1 -- 172.21.15.146:0/2550183232 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250003c70 con 0x7f026009e340 2023-10-03T10:14:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.186+0000 7f0256ffd700 1 -- 172.21.15.146:0/2550183232 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0250003dd0 con 0x7f026009e340 2023-10-03T10:14:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.186+0000 7f0256ffd700 1 -- 172.21.15.146:0/2550183232 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250010670 con 0x7f026009e340 2023-10-03T10:14:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.186+0000 7f026875c700 1 -- 172.21.15.146:0/2550183232 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026012a3a0 con 0x7f026009e340 2023-10-03T10:14:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.186+0000 7f026875c700 1 -- 172.21.15.146:0/2550183232 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0260128460 con 0x7f026009e340 2023-10-03T10:14:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.187+0000 7f026875c700 1 -- 172.21.15.146:0/2550183232 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0260129f50 con 0x7f026009e340 2023-10-03T10:14:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.187+0000 7f0256ffd700 1 -- 172.21.15.146:0/2550183232 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0250019400 con 0x7f026009e340 2023-10-03T10:14:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.187+0000 7f0256ffd700 1 -- 172.21.15.146:0/2550183232 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0250041260 con 0x7f026009e340 2023-10-03T10:14:23.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.196+0000 7f0256ffd700 1 -- 172.21.15.146:0/2550183232 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f025002a740 con 0x7f026009e340 2023-10-03T10:14:23.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.257+0000 7f815e0c0700 1 -- 172.21.15.146:0/3162151969 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f815809e3a0 con 0x7f815806a770 2023-10-03T10:14:23.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.257+0000 7f8154ff9700 1 -- 172.21.15.146:0/3162151969 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8148019cd0 con 0x7f815806a770 2023-10-03T10:14:23.258 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:23.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.259+0000 7f815e0c0700 1 -- 172.21.15.146:0/3162151969 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f815806a770 msgr2=0x7f815809a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.259+0000 7f815e0c0700 1 --2- 172.21.15.146:0/3162151969 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f815806a770 0x7f815809a490 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f814800c430 tx=0x7f814800c740 comp rx=0 tx=0).stop 2023-10-03T10:14:23.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.259+0000 7f815e0c0700 1 -- 172.21.15.146:0/3162151969 shutdown_connections 2023-10-03T10:14:23.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.259+0000 7f815e0c0700 1 --2- 172.21.15.146:0/3162151969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8158136cb0 0x7f815809af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.259+0000 7f815e0c0700 1 --2- 172.21.15.146:0/3162151969 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f815806a770 0x7f815809a490 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.259+0000 7f815e0c0700 1 --2- 172.21.15.146:0/3162151969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f815809dec0 0x7f815809a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.259+0000 7f815e0c0700 1 -- 172.21.15.146:0/3162151969 >> 172.21.15.146:0/3162151969 conn(0x7f8158099c40 msgr2=0x7f8158138990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.260+0000 7f815e0c0700 1 -- 172.21.15.146:0/3162151969 shutdown_connections 2023-10-03T10:14:23.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.260+0000 7f815e0c0700 1 -- 172.21.15.146:0/3162151969 wait complete. 2023-10-03T10:14:23.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:23.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.318+0000 7fb265859700 1 -- 172.21.15.146:0/3026241409 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb26004f2a0 con 0x7fb26009e440 2023-10-03T10:14:23.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.318+0000 7fb247fff700 1 -- 172.21.15.146:0/3026241409 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb258035090 con 0x7fb26009e440 2023-10-03T10:14:23.319 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:23.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.320+0000 7fb265859700 1 -- 172.21.15.146:0/3026241409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb26009e440 msgr2=0x7fb26006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.320+0000 7fb265859700 1 --2- 172.21.15.146:0/3026241409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb26009e440 0x7fb26006e130 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb260132560 tx=0x7fb258004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.321+0000 7fb265859700 1 -- 172.21.15.146:0/3026241409 shutdown_connections 2023-10-03T10:14:23.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.321+0000 7fb265859700 1 --2- 172.21.15.146:0/3026241409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb26009e440 0x7fb26006e130 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.321+0000 7fb265859700 1 --2- 172.21.15.146:0/3026241409 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb260098410 0x7fb26006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.321+0000 7fb265859700 1 --2- 172.21.15.146:0/3026241409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb26009d8f0 0x7fb26006dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.321+0000 7fb265859700 1 -- 172.21.15.146:0/3026241409 >> 172.21.15.146:0/3026241409 conn(0x7fb2600a2b30 msgr2=0x7fb26009fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.321+0000 7fb265859700 1 -- 172.21.15.146:0/3026241409 shutdown_connections 2023-10-03T10:14:23.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.321+0000 7fb265859700 1 -- 172.21.15.146:0/3026241409 wait complete. 2023-10-03T10:14:23.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:23.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.373+0000 7ff02c503700 1 -- 172.21.15.146:0/3134889283 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff02404f2a0 con 0x7ff024133ad0 2023-10-03T10:14:23.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.373+0000 7ff01affd700 1 -- 172.21.15.146:0/3134889283 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff01c01cb20 con 0x7ff024133ad0 2023-10-03T10:14:23.374 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:23.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.375+0000 7ff02c503700 1 -- 172.21.15.146:0/3134889283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff024133ad0 msgr2=0x7ff0241c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.375+0000 7ff02c503700 1 --2- 172.21.15.146:0/3134889283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff024133ad0 0x7ff0241c91d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff01c007cf0 tx=0x7ff01c00e0e0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.375+0000 7ff02c503700 1 -- 172.21.15.146:0/3134889283 shutdown_connections 2023-10-03T10:14:23.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.375+0000 7ff02c503700 1 --2- 172.21.15.146:0/3134889283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff024133ad0 0x7ff0241c91d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.375+0000 7ff02c503700 1 --2- 172.21.15.146:0/3134889283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0241300a0 0x7ff0241c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.375+0000 7ff02c503700 1 --2- 172.21.15.146:0/3134889283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0241309f0 0x7ff0241c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.375+0000 7ff02c503700 1 -- 172.21.15.146:0/3134889283 >> 172.21.15.146:0/3134889283 conn(0x7ff024099c40 msgr2=0x7ff0240a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.376+0000 7ff02c503700 1 -- 172.21.15.146:0/3134889283 shutdown_connections 2023-10-03T10:14:23.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.376+0000 7ff02c503700 1 -- 172.21.15.146:0/3134889283 wait complete. 2023-10-03T10:14:23.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:23.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.391+0000 7f026875c700 1 -- 172.21.15.146:0/2550183232 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f026004f2a0 con 0x7f026009e340 2023-10-03T10:14:23.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.392+0000 7f0256ffd700 1 -- 172.21.15.146:0/2550183232 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f025002a380 con 0x7f026009e340 2023-10-03T10:14:23.392 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:23.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.394+0000 7f026875c700 1 -- 172.21.15.146:0/2550183232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f026009e340 msgr2=0x7f02601277e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.394+0000 7f026875c700 1 --2- 172.21.15.146:0/2550183232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f026009e340 0x7f02601277e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f025000b2c0 tx=0x7f0250004750 comp rx=0 tx=0).stop 2023-10-03T10:14:23.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.394+0000 7f026875c700 1 -- 172.21.15.146:0/2550183232 shutdown_connections 2023-10-03T10:14:23.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.394+0000 7f026875c700 1 --2- 172.21.15.146:0/2550183232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0260135f20 0x7f0260127d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.394+0000 7f026875c700 1 --2- 172.21.15.146:0/2550183232 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f026009d860 0x7f02601272a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.394+0000 7f026875c700 1 --2- 172.21.15.146:0/2550183232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f026009e340 0x7f02601277e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.394+0000 7f026875c700 1 -- 172.21.15.146:0/2550183232 >> 172.21.15.146:0/2550183232 conn(0x7f0260099c40 msgr2=0x7f0260135550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.394+0000 7f026875c700 1 -- 172.21.15.146:0/2550183232 shutdown_connections 2023-10-03T10:14:23.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:23.394+0000 7f026875c700 1 -- 172.21.15.146:0/2550183232 wait complete. 2023-10-03T10:14:23.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:24.273 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:24.334 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:24.389 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:24.408 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:24.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.412+0000 7f5bd05d3700 1 Processor -- start 2023-10-03T10:14:24.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.412+0000 7f5bd05d3700 1 -- start start 2023-10-03T10:14:24.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.413+0000 7f5bd05d3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bc809e870 0x7f5bc809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.413+0000 7f5bd05d3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5bc8131f40 0x7f5bc8139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.413+0000 7f5bd05d3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc809c970 con 0x7f5bc809f180 2023-10-03T10:14:24.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.413+0000 7f5bd05d3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc80a0920 con 0x7f5bc8131f40 2023-10-03T10:14:24.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.413+0000 7f5bd05d3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc809f9c0 con 0x7f5bc809e870 2023-10-03T10:14:24.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.413+0000 7f5bce36f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bc809e870 0x7f5bc809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.413+0000 7f5bceb70700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5bc8131f40 0x7f5bc8139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.413+0000 7f5bce36f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bc809e870 0x7f5bc809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:41960/0 (socket says 172.21.15.146:41960) 2023-10-03T10:14:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.413+0000 7f5bceb70700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5bc8131f40 0x7f5bc8139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43964/0 (socket says 172.21.15.146:43964) 2023-10-03T10:14:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.413+0000 7f5bce36f700 1 -- 172.21.15.146:0/811979641 learned_addr learned my addr 172.21.15.146:0/811979641 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.414+0000 7f5bce36f700 1 -- 172.21.15.146:0/811979641 >> v2:172.21.15.146:3300/0 conn(0x7f5bc8131f40 msgr2=0x7f5bc8139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.414+0000 7f5bce36f700 1 --2- 172.21.15.146:0/811979641 >> v2:172.21.15.146:3300/0 conn(0x7f5bc8131f40 0x7f5bc8139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.414+0000 7f5bce36f700 1 -- 172.21.15.146:0/811979641 >> v1:172.21.15.146:6789/0 conn(0x7f5bc809f180 legacy=0x7f5bc8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.414+0000 7f5bce36f700 1 -- 172.21.15.146:0/811979641 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc809bab0 con 0x7f5bc809e870 2023-10-03T10:14:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.414+0000 7f5bce36f700 1 --2- 172.21.15.146:0/811979641 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bc809e870 0x7f5bc809ec40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5bc400dd10 tx=0x7f5bc400f330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd92669476d31831 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.414+0000 7f5bcd36d700 1 -- 172.21.15.146:0/811979641 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc400fb10 con 0x7f5bc809e870 2023-10-03T10:14:24.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.414+0000 7f5bcd36d700 1 -- 172.21.15.146:0/811979641 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc400fc70 con 0x7f5bc809e870 2023-10-03T10:14:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.414+0000 7f5bcd36d700 1 -- 172.21.15.146:0/811979641 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc400de60 con 0x7f5bc809e870 2023-10-03T10:14:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.415+0000 7f5bd05d3700 1 -- 172.21.15.146:0/811979641 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bc809e870 msgr2=0x7f5bc809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.415+0000 7f5bd05d3700 1 --2- 172.21.15.146:0/811979641 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bc809e870 0x7f5bc809ec40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5bc400dd10 tx=0x7f5bc400f330 comp rx=0 tx=0).stop 2023-10-03T10:14:24.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.415+0000 7f5bd05d3700 1 -- 172.21.15.146:0/811979641 shutdown_connections 2023-10-03T10:14:24.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.415+0000 7f5bd05d3700 1 --2- 172.21.15.146:0/811979641 >> v2:172.21.15.146:3300/0 conn(0x7f5bc8131f40 0x7f5bc8139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.415+0000 7f5bd05d3700 1 --2- 172.21.15.146:0/811979641 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bc809e870 0x7f5bc809ec40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.415+0000 7f5bd05d3700 1 -- 172.21.15.146:0/811979641 >> 172.21.15.146:0/811979641 conn(0x7f5bc80a4430 msgr2=0x7f5bc80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.415+0000 7f5bd05d3700 1 -- 172.21.15.146:0/811979641 shutdown_connections 2023-10-03T10:14:24.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.415+0000 7f5bd05d3700 1 -- 172.21.15.146:0/811979641 wait complete. 2023-10-03T10:14:24.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.416+0000 7f5bd05d3700 1 Processor -- start 2023-10-03T10:14:24.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.417+0000 7f5bd05d3700 1 -- start start 2023-10-03T10:14:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.417+0000 7f5bd05d3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5bc809e870 0x7f5bc811bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.417+0000 7f5bd05d3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bc809f180 0x7f5bc811c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.417+0000 7f5bd05d3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bc8131f40 0x7f5bc811c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.417+0000 7f5bd05d3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc811db50 con 0x7f5bc8131f40 2023-10-03T10:14:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.417+0000 7f5bd05d3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc811eda0 con 0x7f5bc809f180 2023-10-03T10:14:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.417+0000 7f5bd05d3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc811e130 con 0x7f5bc809e870 2023-10-03T10:14:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.417+0000 7f5bcdb6e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bc809f180 0x7f5bc811c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.417+0000 7f5bceb70700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bc8131f40 0x7f5bc811c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.417+0000 7f5bcdb6e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bc809f180 0x7f5bc811c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:41964/0 (socket says 172.21.15.146:41964) 2023-10-03T10:14:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.417+0000 7f5bcdb6e700 1 -- 172.21.15.146:0/525104533 learned_addr learned my addr 172.21.15.146:0/525104533 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.418+0000 7f5bce36f700 1 --2- 172.21.15.146:0/525104533 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5bc809e870 0x7f5bc811bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.418+0000 7f5bcdb6e700 1 -- 172.21.15.146:0/525104533 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5bc809e870 msgr2=0x7f5bc811bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.418+0000 7f5bcdb6e700 1 --2- 172.21.15.146:0/525104533 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5bc809e870 0x7f5bc811bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.418+0000 7f5bcdb6e700 1 -- 172.21.15.146:0/525104533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bc8131f40 msgr2=0x7f5bc811c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.418+0000 7f5bcdb6e700 1 --2- 172.21.15.146:0/525104533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bc8131f40 0x7f5bc811c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.418+0000 7f5bcdb6e700 1 -- 172.21.15.146:0/525104533 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc400d9f0 con 0x7f5bc809f180 2023-10-03T10:14:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.418+0000 7f5bce36f700 1 --2- 172.21.15.146:0/525104533 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5bc809e870 0x7f5bc811bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.418+0000 7f5bcdb6e700 1 --2- 172.21.15.146:0/525104533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bc809f180 0x7f5bc811c480 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5bb800c4e0 tx=0x7f5bb800c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.418+0000 7f5bbeffd700 1 -- 172.21.15.146:0/525104533 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb80052d0 con 0x7f5bc809f180 2023-10-03T10:14:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.418+0000 7f5bbeffd700 1 -- 172.21.15.146:0/525104533 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb8005430 con 0x7f5bc809f180 2023-10-03T10:14:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.418+0000 7f5bd05d3700 1 -- 172.21.15.146:0/525104533 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc811f780 con 0x7f5bc809f180 2023-10-03T10:14:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.418+0000 7f5bbeffd700 1 -- 172.21.15.146:0/525104533 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb80038c0 con 0x7f5bc809f180 2023-10-03T10:14:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.418+0000 7f5bd05d3700 1 -- 172.21.15.146:0/525104533 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc811f250 con 0x7f5bc809f180 2023-10-03T10:14:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.419+0000 7f5bd05d3700 1 -- 172.21.15.146:0/525104533 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc804f2a0 con 0x7f5bc809f180 2023-10-03T10:14:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.419+0000 7f5bbeffd700 1 -- 172.21.15.146:0/525104533 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5bb8003a20 con 0x7f5bc809f180 2023-10-03T10:14:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.420+0000 7f5bbeffd700 1 -- 172.21.15.146:0/525104533 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5bb8003cd0 con 0x7f5bc809f180 2023-10-03T10:14:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.428+0000 7f5bbeffd700 1 -- 172.21.15.146:0/525104533 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5bb8011590 con 0x7f5bc809f180 2023-10-03T10:14:24.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.477+0000 7f72cbef6700 1 Processor -- start 2023-10-03T10:14:24.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.477+0000 7f72cbef6700 1 -- start start 2023-10-03T10:14:24.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.478+0000 7f72cbef6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72c409e870 0x7f72c409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.478+0000 7f72cbef6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72c4131f40 0x7f72c4139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.478+0000 7f72cbef6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c409c970 con 0x7f72c409f180 2023-10-03T10:14:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.478+0000 7f72cbef6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c40a0920 con 0x7f72c409e870 2023-10-03T10:14:24.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.478+0000 7f72cbef6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72c409f9c0 con 0x7f72c4131f40 2023-10-03T10:14:24.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.478+0000 7f72c9491700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f72c409f180 0x7f72c4131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36742/0 (socket says 172.21.15.146:36742) 2023-10-03T10:14:24.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.478+0000 7f72c9491700 1 -- 172.21.15.146:0/2456923034 learned_addr learned my addr 172.21.15.146:0/2456923034 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:24.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.478+0000 7f72ca493700 1 --2- 172.21.15.146:0/2456923034 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72c4131f40 0x7f72c4139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.478+0000 7f72c9c92700 1 --2- 172.21.15.146:0/2456923034 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72c409e870 0x7f72c409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.478+0000 7f72c8c90700 1 -- 172.21.15.146:0/2456923034 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641359724 0 0) 0x7f72c409c970 con 0x7f72c409f180 2023-10-03T10:14:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.478+0000 7f72ca493700 1 -- 172.21.15.146:0/2456923034 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72c409e870 msgr2=0x7f72c409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.478+0000 7f72ca493700 1 --2- 172.21.15.146:0/2456923034 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72c409e870 0x7f72c409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.478+0000 7f72ca493700 1 -- 172.21.15.146:0/2456923034 >> v1:172.21.15.146:6789/0 conn(0x7f72c409f180 legacy=0x7f72c4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.479+0000 7f72ca493700 1 -- 172.21.15.146:0/2456923034 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c409bab0 con 0x7f72c4131f40 2023-10-03T10:14:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.479+0000 7f72c9c92700 1 --2- 172.21.15.146:0/2456923034 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72c409e870 0x7f72c409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.479+0000 7f72ca493700 1 --2- 172.21.15.146:0/2456923034 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72c4131f40 0x7f72c4139ca0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f72bc009dc0 tx=0x7f72bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfe076a3739b5b7b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.479+0000 7f72c8c90700 1 -- 172.21.15.146:0/2456923034 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc00e070 con 0x7f72c4131f40 2023-10-03T10:14:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.479+0000 7f72c8c90700 1 -- 172.21.15.146:0/2456923034 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72bc00bb20 con 0x7f72c4131f40 2023-10-03T10:14:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.479+0000 7f72c8c90700 1 -- 172.21.15.146:0/2456923034 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc012430 con 0x7f72c4131f40 2023-10-03T10:14:24.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.480+0000 7f72cbef6700 1 -- 172.21.15.146:0/2456923034 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72c4131f40 msgr2=0x7f72c4139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.480+0000 7f72cbef6700 1 --2- 172.21.15.146:0/2456923034 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72c4131f40 0x7f72c4139ca0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f72bc009dc0 tx=0x7f72bc00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:24.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.480+0000 7f72cbef6700 1 -- 172.21.15.146:0/2456923034 shutdown_connections 2023-10-03T10:14:24.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.480+0000 7f72cbef6700 1 --2- 172.21.15.146:0/2456923034 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72c4131f40 0x7f72c4139ca0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.480+0000 7f72cbef6700 1 --2- 172.21.15.146:0/2456923034 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72c409e870 0x7f72c409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.480+0000 7f72cbef6700 1 -- 172.21.15.146:0/2456923034 >> 172.21.15.146:0/2456923034 conn(0x7f72c40a4430 msgr2=0x7f72c40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.480+0000 7f72cbef6700 1 -- 172.21.15.146:0/2456923034 shutdown_connections 2023-10-03T10:14:24.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.480+0000 7f72cbef6700 1 -- 172.21.15.146:0/2456923034 wait complete. 2023-10-03T10:14:24.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.481+0000 7f72cbef6700 1 Processor -- start 2023-10-03T10:14:24.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.481+0000 7f72cbef6700 1 -- start start 2023-10-03T10:14:24.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.482+0000 7f72cbef6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72c409e870 0x7f72c4120040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.482+0000 7f72cbef6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72c409f180 0x7f72c4120580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.482+0000 7f72cbef6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72c4131f40 0x7f72c4120ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.482+0000 7f72cbef6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c4123b60 con 0x7f72c409f180 2023-10-03T10:14:24.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.482+0000 7f72cbef6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c4123650 con 0x7f72c409e870 2023-10-03T10:14:24.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.482+0000 7f72cbef6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72c4122ae0 con 0x7f72c4131f40 2023-10-03T10:14:24.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.482+0000 7f72c9491700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72c409f180 0x7f72c4120580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.482+0000 7f72c9c92700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72c409e870 0x7f72c4120040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.482+0000 7f72c9491700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72c409f180 0x7f72c4120580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43984/0 (socket says 172.21.15.146:43984) 2023-10-03T10:14:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.482+0000 7f72c9491700 1 -- 172.21.15.146:0/815804866 learned_addr learned my addr 172.21.15.146:0/815804866 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.482+0000 7f72ca493700 1 --2- 172.21.15.146:0/815804866 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72c4131f40 0x7f72c4120ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.482+0000 7f72c9491700 1 -- 172.21.15.146:0/815804866 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72c4131f40 msgr2=0x7f72c4120ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.482+0000 7f72c9491700 1 --2- 172.21.15.146:0/815804866 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72c4131f40 0x7f72c4120ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.482+0000 7f72c9491700 1 -- 172.21.15.146:0/815804866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72c409e870 msgr2=0x7f72c4120040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.482+0000 7f72c9491700 1 --2- 172.21.15.146:0/815804866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72c409e870 0x7f72c4120040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.482+0000 7f72c9491700 1 -- 172.21.15.146:0/815804866 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c00094a0 con 0x7f72c409f180 2023-10-03T10:14:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.483+0000 7f72c9491700 1 --2- 172.21.15.146:0/815804866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72c409f180 0x7f72c4120580 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f72b400c450 tx=0x7f72b400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.483+0000 7f72ba7fc700 1 -- 172.21.15.146:0/815804866 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4004c80 con 0x7f72c409f180 2023-10-03T10:14:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.483+0000 7f72ba7fc700 1 -- 172.21.15.146:0/815804866 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b4004e00 con 0x7f72c409f180 2023-10-03T10:14:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.483+0000 7f72cbef6700 1 -- 172.21.15.146:0/815804866 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72bc009a70 con 0x7f72c409f180 2023-10-03T10:14:24.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.483+0000 7f72ba7fc700 1 -- 172.21.15.146:0/815804866 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4007310 con 0x7f72c409f180 2023-10-03T10:14:24.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.483+0000 7f72cbef6700 1 -- 172.21.15.146:0/815804866 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c40a2db0 con 0x7f72c409f180 2023-10-03T10:14:24.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.484+0000 7f72ba7fc700 1 -- 172.21.15.146:0/815804866 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f72b4007470 con 0x7f72c409f180 2023-10-03T10:14:24.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.484+0000 7f72ba7fc700 1 -- 172.21.15.146:0/815804866 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f72b403f270 con 0x7f72c409f180 2023-10-03T10:14:24.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.484+0000 7f72cbef6700 1 -- 172.21.15.146:0/815804866 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c411ce70 con 0x7f72c409f180 2023-10-03T10:14:24.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.489+0000 7f72ba7fc700 1 -- 172.21.15.146:0/815804866 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72b400ce60 con 0x7f72c409f180 2023-10-03T10:14:24.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.547+0000 7fdbe3041700 1 Processor -- start 2023-10-03T10:14:24.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.547+0000 7fdbe3041700 1 -- start start 2023-10-03T10:14:24.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.548+0000 7fdbe3041700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbdc09e340 0x7fdbdc1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.548+0000 7fdbe3041700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdbdc135f20 0x7fdbdc138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.548+0000 7fdbe3041700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbdc09aaa0 con 0x7fdbdc09d860 2023-10-03T10:14:24.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.548+0000 7fdbe3041700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbdc09e730 con 0x7fdbdc135f20 2023-10-03T10:14:24.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.548+0000 7fdbe3041700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc09f870 con 0x7fdbdc09e340 2023-10-03T10:14:24.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.548+0000 7fdbdbfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbdc09e340 0x7fdbdc1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.548+0000 7fdbe15de700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdbdc135f20 0x7fdbdc138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.548+0000 7fdbdbfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbdc09e340 0x7fdbdc1359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:41980/0 (socket says 172.21.15.146:41980) 2023-10-03T10:14:24.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.548+0000 7fdbdbfff700 1 -- 172.21.15.146:0/1827042944 learned_addr learned my addr 172.21.15.146:0/1827042944 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:24.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.548+0000 7fdbe15de700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdbdc135f20 0x7fdbdc138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43998/0 (socket says 172.21.15.146:43998) 2023-10-03T10:14:24.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.548+0000 7fdbdbfff700 1 -- 172.21.15.146:0/1827042944 >> v2:172.21.15.146:3300/0 conn(0x7fdbdc135f20 msgr2=0x7fdbdc138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.548+0000 7fdbdbfff700 1 --2- 172.21.15.146:0/1827042944 >> v2:172.21.15.146:3300/0 conn(0x7fdbdc135f20 0x7fdbdc138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.548+0000 7fdbdbfff700 1 -- 172.21.15.146:0/1827042944 >> v1:172.21.15.146:6789/0 conn(0x7fdbdc09d860 legacy=0x7fdbdc09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.548+0000 7fdbdbfff700 1 -- 172.21.15.146:0/1827042944 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc09b360 con 0x7fdbdc09e340 2023-10-03T10:14:24.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.548+0000 7fdbe15de700 1 --2- 172.21.15.146:0/1827042944 >> v2:172.21.15.146:3300/0 conn(0x7fdbdc135f20 0x7fdbdc138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:24.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.548+0000 7fdbdbfff700 1 --2- 172.21.15.146:0/1827042944 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbdc09e340 0x7fdbdc1359e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800bb90 tx=0x7fdbc800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34b19b571dd5257f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.549+0000 7fdbdb7fe700 1 -- 172.21.15.146:0/1827042944 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc800dcf0 con 0x7fdbdc09e340 2023-10-03T10:14:24.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.549+0000 7fdbdb7fe700 1 -- 172.21.15.146:0/1827042944 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc800de50 con 0x7fdbdc09e340 2023-10-03T10:14:24.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.549+0000 7fdbdb7fe700 1 -- 172.21.15.146:0/1827042944 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8004250 con 0x7fdbdc09e340 2023-10-03T10:14:24.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.549+0000 7fdbe3041700 1 -- 172.21.15.146:0/1827042944 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbdc09e340 msgr2=0x7fdbdc1359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.549+0000 7fdbe3041700 1 --2- 172.21.15.146:0/1827042944 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbdc09e340 0x7fdbdc1359e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800bb90 tx=0x7fdbc800bea0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.550+0000 7fdbe3041700 1 -- 172.21.15.146:0/1827042944 shutdown_connections 2023-10-03T10:14:24.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.550+0000 7fdbe3041700 1 --2- 172.21.15.146:0/1827042944 >> v2:172.21.15.146:3300/0 conn(0x7fdbdc135f20 0x7fdbdc138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.550+0000 7fdbe3041700 1 --2- 172.21.15.146:0/1827042944 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbdc09e340 0x7fdbdc1359e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.550+0000 7fdbe3041700 1 -- 172.21.15.146:0/1827042944 >> 172.21.15.146:0/1827042944 conn(0x7fdbdc099c40 msgr2=0x7fdbdc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.550+0000 7fdbe3041700 1 -- 172.21.15.146:0/1827042944 shutdown_connections 2023-10-03T10:14:24.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.550+0000 7fdbe3041700 1 -- 172.21.15.146:0/1827042944 wait complete. 2023-10-03T10:14:24.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.551+0000 7fdbe3041700 1 Processor -- start 2023-10-03T10:14:24.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.551+0000 7f5b7d2a6700 1 Processor -- start 2023-10-03T10:14:24.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.551+0000 7f5b7d2a6700 1 -- start start 2023-10-03T10:14:24.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.551+0000 7fdbe3041700 1 -- start start 2023-10-03T10:14:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7f5b7d2a6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b7809d860 0x7f5b7809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7f5b7d2a6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b78130eb0 0x7f5b78138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7f5b7d2a6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7809aaa0 con 0x7f5b7809e170 2023-10-03T10:14:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7f5b7d2a6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7809f870 con 0x7f5b78130eb0 2023-10-03T10:14:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7f5b7d2a6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7809b360 con 0x7f5b7809d860 2023-10-03T10:14:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7f5b767fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5b7809e170 0x7f5b781307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36764/0 (socket says 172.21.15.146:36764) 2023-10-03T10:14:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7f5b767fc700 1 -- 172.21.15.146:0/1979348155 learned_addr learned my addr 172.21.15.146:0/1979348155 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7f5b777fe700 1 --2- 172.21.15.146:0/1979348155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b78130eb0 0x7f5b78138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7f5b777fe700 1 -- 172.21.15.146:0/1979348155 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b7809d860 msgr2=0x7f5b7809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7f5b777fe700 1 --2- 172.21.15.146:0/1979348155 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b7809d860 0x7f5b7809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7f5b777fe700 1 -- 172.21.15.146:0/1979348155 >> v1:172.21.15.146:6789/0 conn(0x7f5b7809e170 legacy=0x7f5b781307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7f5b777fe700 1 -- 172.21.15.146:0/1979348155 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7809b620 con 0x7f5b78130eb0 2023-10-03T10:14:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7f5b777fe700 1 --2- 172.21.15.146:0/1979348155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b78130eb0 0x7f5b78138a00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5b70009dc0 tx=0x7f5b7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccafe7592e3ecd2c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.553+0000 7f5b75ffb700 1 -- 172.21.15.146:0/1979348155 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7000e070 con 0x7f5b78130eb0 2023-10-03T10:14:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.553+0000 7f5b75ffb700 1 -- 172.21.15.146:0/1979348155 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7000bbd0 con 0x7f5b78130eb0 2023-10-03T10:14:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.553+0000 7f5b75ffb700 1 -- 172.21.15.146:0/1979348155 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b70012430 con 0x7f5b78130eb0 2023-10-03T10:14:24.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7fdbe3041700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdbdc09d860 0x7fdbdc119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7fdbe3041700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbdc09e340 0x7fdbdc119b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7fdbe3041700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbdc135f20 0x7fdbdc11a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7fdbe3041700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc11caa0 con 0x7fdbdc09e340 2023-10-03T10:14:24.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7fdbe3041700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc09c8b0 con 0x7fdbdc135f20 2023-10-03T10:14:24.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7fdbe3041700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc0a2100 con 0x7fdbdc09d860 2023-10-03T10:14:24.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7fdbe0ddd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdbdc09d860 0x7fdbdc119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7fdbe15de700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbdc135f20 0x7fdbdc11a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7fdbe0ddd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdbdc09d860 0x7fdbdc119630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:50026/0 (socket says 172.21.15.146:50026) 2023-10-03T10:14:24.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7fdbe0ddd700 1 -- 172.21.15.146:0/2262639258 learned_addr learned my addr 172.21.15.146:0/2262639258 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:24.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.552+0000 7fdbdbfff700 1 --2- 172.21.15.146:0/2262639258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbdc09e340 0x7fdbdc119b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.553+0000 7fdbe0ddd700 1 -- 172.21.15.146:0/2262639258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbdc135f20 msgr2=0x7fdbdc11a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.553+0000 7fdbe0ddd700 1 --2- 172.21.15.146:0/2262639258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbdc135f20 0x7fdbdc11a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.553+0000 7fdbe0ddd700 1 -- 172.21.15.146:0/2262639258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbdc09e340 msgr2=0x7fdbdc119b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.553+0000 7fdbe0ddd700 1 --2- 172.21.15.146:0/2262639258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbdc09e340 0x7fdbdc119b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.553+0000 7fdbe0ddd700 1 -- 172.21.15.146:0/2262639258 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd4009a70 con 0x7fdbdc09d860 2023-10-03T10:14:24.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.553+0000 7fdbe0ddd700 1 --2- 172.21.15.146:0/2262639258 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdbdc09d860 0x7fdbdc119630 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdbd000c500 tx=0x7fdbd000c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.553+0000 7fdbd97fa700 1 -- 172.21.15.146:0/2262639258 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0011790 con 0x7fdbdc09d860 2023-10-03T10:14:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.553+0000 7fdbd97fa700 1 -- 172.21.15.146:0/2262639258 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd00118f0 con 0x7fdbdc09d860 2023-10-03T10:14:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.553+0000 7fdbe3041700 1 -- 172.21.15.146:0/2262639258 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc800b7f0 con 0x7fdbdc09d860 2023-10-03T10:14:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.553+0000 7f5b7d2a6700 1 -- 172.21.15.146:0/1979348155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b78130eb0 msgr2=0x7f5b78138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.553+0000 7f5b7d2a6700 1 --2- 172.21.15.146:0/1979348155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b78130eb0 0x7f5b78138a00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5b70009dc0 tx=0x7f5b7000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.553+0000 7f5b7d2a6700 1 -- 172.21.15.146:0/1979348155 shutdown_connections 2023-10-03T10:14:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.553+0000 7f5b7d2a6700 1 --2- 172.21.15.146:0/1979348155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b78130eb0 0x7f5b78138a00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.553+0000 7f5b7d2a6700 1 --2- 172.21.15.146:0/1979348155 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b7809d860 0x7f5b7809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.553+0000 7f5b7d2a6700 1 -- 172.21.15.146:0/1979348155 >> 172.21.15.146:0/1979348155 conn(0x7f5b78099c40 msgr2=0x7f5b780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.553+0000 7fdbe3041700 1 -- 172.21.15.146:0/2262639258 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbdc11cc80 con 0x7fdbdc09d860 2023-10-03T10:14:24.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.553+0000 7fdbd97fa700 1 -- 172.21.15.146:0/2262639258 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0011ca0 con 0x7fdbdc09d860 2023-10-03T10:14:24.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.554+0000 7f5b7d2a6700 1 -- 172.21.15.146:0/1979348155 shutdown_connections 2023-10-03T10:14:24.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.554+0000 7fdbe3041700 1 -- 172.21.15.146:0/2262639258 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbbc0052e0 con 0x7fdbdc09d860 2023-10-03T10:14:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.554+0000 7f5b7d2a6700 1 -- 172.21.15.146:0/1979348155 wait complete. 2023-10-03T10:14:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.555+0000 7f5b7d2a6700 1 Processor -- start 2023-10-03T10:14:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.555+0000 7f5b7d2a6700 1 -- start start 2023-10-03T10:14:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.556+0000 7f5b7d2a6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b7809d860 0x7f5b781cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.556+0000 7f5b7d2a6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b7809e170 0x7f5b781ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.556+0000 7f5b7d2a6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b78130eb0 0x7f5b781cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.556+0000 7f5b7d2a6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7811f970 con 0x7f5b78130eb0 2023-10-03T10:14:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.556+0000 7f5b7d2a6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7812fcc0 con 0x7f5b7809d860 2023-10-03T10:14:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.556+0000 7f5b7d2a6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7811f6b0 con 0x7f5b7809e170 2023-10-03T10:14:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.556+0000 7f5b76ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b7809d860 0x7f5b781cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.556+0000 7f5b767fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b7809e170 0x7f5b781ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.556+0000 7f5b76ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b7809d860 0x7f5b781cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:41998/0 (socket says 172.21.15.146:41998) 2023-10-03T10:14:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.556+0000 7f5b76ffd700 1 -- 172.21.15.146:0/2326285346 learned_addr learned my addr 172.21.15.146:0/2326285346 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.556+0000 7f5b76ffd700 1 -- 172.21.15.146:0/2326285346 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b7809e170 msgr2=0x7f5b781ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.556+0000 7f5b76ffd700 1 --2- 172.21.15.146:0/2326285346 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b7809e170 0x7f5b781ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.556+0000 7f5b76ffd700 1 -- 172.21.15.146:0/2326285346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b78130eb0 msgr2=0x7f5b781cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.556+0000 7f5b777fe700 1 --2- 172.21.15.146:0/2326285346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b78130eb0 0x7f5b781cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.556+0000 7f5b76ffd700 1 --2- 172.21.15.146:0/2326285346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b78130eb0 0x7f5b781cd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.556+0000 7f5b76ffd700 1 -- 172.21.15.146:0/2326285346 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b70009a70 con 0x7f5b7809d860 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.556+0000 7f5b767fc700 1 --2- 172.21.15.146:0/2326285346 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b7809e170 0x7f5b781ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.556+0000 7f5b777fe700 1 --2- 172.21.15.146:0/2326285346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b78130eb0 0x7f5b781cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.557+0000 7f5b76ffd700 1 --2- 172.21.15.146:0/2326285346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b7809d860 0x7f5b781cc660 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800b530 tx=0x7f5b6800b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.558+0000 7f5b5f7fe700 1 -- 172.21.15.146:0/2326285346 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b68011830 con 0x7f5b7809d860 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.558+0000 7f5b5f7fe700 1 -- 172.21.15.146:0/2326285346 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b680119b0 con 0x7f5b7809d860 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.558+0000 7f5b5f7fe700 1 -- 172.21.15.146:0/2326285346 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b68011d60 con 0x7f5b7809d860 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.558+0000 7f5b7d2a6700 1 -- 172.21.15.146:0/2326285346 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b78130740 con 0x7f5b7809d860 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.558+0000 7f5b7d2a6700 1 -- 172.21.15.146:0/2326285346 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7806b400 con 0x7f5b7809d860 2023-10-03T10:14:24.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.559+0000 7f5b5f7fe700 1 -- 172.21.15.146:0/2326285346 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5b6801a400 con 0x7f5b7809d860 2023-10-03T10:14:24.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.559+0000 7f5b5f7fe700 1 -- 172.21.15.146:0/2326285346 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5b6803f830 con 0x7f5b7809d860 2023-10-03T10:14:24.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.559+0000 7f5b7d2a6700 1 -- 172.21.15.146:0/2326285346 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b7804f2a0 con 0x7f5b7809d860 2023-10-03T10:14:24.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.555+0000 7fdbd97fa700 1 -- 172.21.15.146:0/2262639258 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdbd0006860 con 0x7fdbdc09d860 2023-10-03T10:14:24.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.555+0000 7fdbd97fa700 1 -- 172.21.15.146:0/2262639258 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdbd003fef0 con 0x7fdbdc09d860 2023-10-03T10:14:24.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.560+0000 7fdbd97fa700 1 -- 172.21.15.146:0/2262639258 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdbd001a360 con 0x7fdbdc09d860 2023-10-03T10:14:24.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.564+0000 7f5b5f7fe700 1 -- 172.21.15.146:0/2326285346 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b680193b0 con 0x7f5b7809d860 2023-10-03T10:14:24.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.630+0000 7f5bd05d3700 1 -- 172.21.15.146:0/525104533 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5bc811d360 con 0x7f5bc809f180 2023-10-03T10:14:24.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.630+0000 7f5bbeffd700 1 -- 172.21.15.146:0/525104533 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5bc811d360 con 0x7f5bc809f180 2023-10-03T10:14:24.631 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:24.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.633+0000 7f5bd05d3700 1 -- 172.21.15.146:0/525104533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bc809f180 msgr2=0x7f5bc811c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.633+0000 7f5bd05d3700 1 --2- 172.21.15.146:0/525104533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bc809f180 0x7f5bc811c480 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5bb800c4e0 tx=0x7f5bb800c7f0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.634+0000 7f5bd05d3700 1 -- 172.21.15.146:0/525104533 shutdown_connections 2023-10-03T10:14:24.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.634+0000 7f5bd05d3700 1 --2- 172.21.15.146:0/525104533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bc8131f40 0x7f5bc811c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.634+0000 7f5bd05d3700 1 --2- 172.21.15.146:0/525104533 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5bc809e870 0x7f5bc811bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.634+0000 7f5bd05d3700 1 --2- 172.21.15.146:0/525104533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bc809f180 0x7f5bc811c480 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.634+0000 7f5bd05d3700 1 -- 172.21.15.146:0/525104533 >> 172.21.15.146:0/525104533 conn(0x7f5bc80a4430 msgr2=0x7f5bc8130ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.634+0000 7f5bd05d3700 1 -- 172.21.15.146:0/525104533 shutdown_connections 2023-10-03T10:14:24.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.634+0000 7f5bd05d3700 1 -- 172.21.15.146:0/525104533 wait complete. 2023-10-03T10:14:24.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.720+0000 7f72cbef6700 1 -- 172.21.15.146:0/815804866 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f72c404f2a0 con 0x7f72c409f180 2023-10-03T10:14:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.720+0000 7f72ba7fc700 1 -- 172.21.15.146:0/815804866 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f72b4007720 con 0x7f72c409f180 2023-10-03T10:14:24.721 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.722+0000 7f72cbef6700 1 -- 172.21.15.146:0/815804866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72c409f180 msgr2=0x7f72c4120580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.722+0000 7f72cbef6700 1 --2- 172.21.15.146:0/815804866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72c409f180 0x7f72c4120580 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f72b400c450 tx=0x7f72b400c760 comp rx=0 tx=0).stop 2023-10-03T10:14:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.722+0000 7f72cbef6700 1 -- 172.21.15.146:0/815804866 shutdown_connections 2023-10-03T10:14:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.722+0000 7f72cbef6700 1 --2- 172.21.15.146:0/815804866 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72c4131f40 0x7f72c4120ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.722+0000 7f72cbef6700 1 --2- 172.21.15.146:0/815804866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72c409e870 0x7f72c4120040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.722+0000 7f72cbef6700 1 --2- 172.21.15.146:0/815804866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72c409f180 0x7f72c4120580 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.723+0000 7f72cbef6700 1 -- 172.21.15.146:0/815804866 >> 172.21.15.146:0/815804866 conn(0x7f72c40a4430 msgr2=0x7f72c40721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.723+0000 7f72cbef6700 1 -- 172.21.15.146:0/815804866 shutdown_connections 2023-10-03T10:14:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.723+0000 7f72cbef6700 1 -- 172.21.15.146:0/815804866 wait complete. 2023-10-03T10:14:24.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:24.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.754+0000 7fdbe3041700 1 -- 172.21.15.146:0/2262639258 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdbbc005860 con 0x7fdbdc09d860 2023-10-03T10:14:24.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.754+0000 7fdbd97fa700 1 -- 172.21.15.146:0/2262639258 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdbd001bb70 con 0x7fdbdc09d860 2023-10-03T10:14:24.755 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:24.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.756+0000 7fdbe3041700 1 -- 172.21.15.146:0/2262639258 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdbdc09d860 msgr2=0x7fdbdc119630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.756+0000 7fdbe3041700 1 --2- 172.21.15.146:0/2262639258 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdbdc09d860 0x7fdbdc119630 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdbd000c500 tx=0x7fdbd000c810 comp rx=0 tx=0).stop 2023-10-03T10:14:24.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.756+0000 7fdbe3041700 1 -- 172.21.15.146:0/2262639258 shutdown_connections 2023-10-03T10:14:24.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.756+0000 7fdbe3041700 1 --2- 172.21.15.146:0/2262639258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbdc135f20 0x7fdbdc11a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.756+0000 7fdbe3041700 1 --2- 172.21.15.146:0/2262639258 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdbdc09d860 0x7fdbdc119630 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.756+0000 7fdbe3041700 1 --2- 172.21.15.146:0/2262639258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbdc09e340 0x7fdbdc119b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.756+0000 7fdbe3041700 1 -- 172.21.15.146:0/2262639258 >> 172.21.15.146:0/2262639258 conn(0x7fdbdc099c40 msgr2=0x7fdbdc0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.756+0000 7fdbe3041700 1 -- 172.21.15.146:0/2262639258 shutdown_connections 2023-10-03T10:14:24.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.756+0000 7fdbe3041700 1 -- 172.21.15.146:0/2262639258 wait complete. 2023-10-03T10:14:24.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.761+0000 7f5b7d2a6700 1 -- 172.21.15.146:0/2326285346 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5b7811fb90 con 0x7f5b7809d860 2023-10-03T10:14:24.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.761+0000 7f5b5f7fe700 1 -- 172.21.15.146:0/2326285346 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b6800f2e0 con 0x7f5b7809d860 2023-10-03T10:14:24.762 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:24.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.763+0000 7f5b7d2a6700 1 -- 172.21.15.146:0/2326285346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b7809d860 msgr2=0x7f5b781cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.763+0000 7f5b7d2a6700 1 --2- 172.21.15.146:0/2326285346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b7809d860 0x7f5b781cc660 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800b530 tx=0x7f5b6800b840 comp rx=0 tx=0).stop 2023-10-03T10:14:24.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.764+0000 7f5b7d2a6700 1 -- 172.21.15.146:0/2326285346 shutdown_connections 2023-10-03T10:14:24.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.764+0000 7f5b7d2a6700 1 --2- 172.21.15.146:0/2326285346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b78130eb0 0x7f5b781cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.764+0000 7f5b7d2a6700 1 --2- 172.21.15.146:0/2326285346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5b7809d860 0x7f5b781cc660 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.764+0000 7f5b7d2a6700 1 --2- 172.21.15.146:0/2326285346 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5b7809e170 0x7f5b781ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.764+0000 7f5b7d2a6700 1 -- 172.21.15.146:0/2326285346 >> 172.21.15.146:0/2326285346 conn(0x7f5b78099c40 msgr2=0x7f5b780a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.764+0000 7f5b7d2a6700 1 -- 172.21.15.146:0/2326285346 shutdown_connections 2023-10-03T10:14:24.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:24.764+0000 7f5b7d2a6700 1 -- 172.21.15.146:0/2326285346 wait complete. 2023-10-03T10:14:24.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:24.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:25.652 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:25.736 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:25.770 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:25.778 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:25.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.790+0000 7f48f47fa700 1 Processor -- start 2023-10-03T10:14:25.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.790+0000 7f48f47fa700 1 -- start start 2023-10-03T10:14:25.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.791+0000 7f48f47fa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48ec132100 0x7f48ec1367d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.791+0000 7f48f47fa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48ec1314b0 0x7f48ec138d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.791+0000 7f48f47fa700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ec0a0f20 con 0x7f48ec066410 2023-10-03T10:14:25.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.791+0000 7f48f47fa700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec0667e0 con 0x7f48ec1314b0 2023-10-03T10:14:25.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.791+0000 7f48f47fa700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec0a23c0 con 0x7f48ec132100 2023-10-03T10:14:25.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.791+0000 7f48f2596700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f48ec066410 0x7f48ec1319f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36770/0 (socket says 172.21.15.146:36770) 2023-10-03T10:14:25.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.791+0000 7f48f2596700 1 -- 172.21.15.146:0/2642300637 learned_addr learned my addr 172.21.15.146:0/2642300637 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:25.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.791+0000 7f48f2d97700 1 --2- 172.21.15.146:0/2642300637 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48ec1314b0 0x7f48ec138d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.791+0000 7f48f1d95700 1 --2- 172.21.15.146:0/2642300637 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48ec132100 0x7f48ec1367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.791+0000 7f48f2d97700 1 -- 172.21.15.146:0/2642300637 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48ec132100 msgr2=0x7f48ec1367d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.791+0000 7f48f1594700 1 -- 172.21.15.146:0/2642300637 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771387399 0 0) 0x7f48ec0a0f20 con 0x7f48ec066410 2023-10-03T10:14:25.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.792+0000 7f48f2d97700 1 --2- 172.21.15.146:0/2642300637 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48ec132100 0x7f48ec1367d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.792+0000 7f48f2d97700 1 -- 172.21.15.146:0/2642300637 >> v1:172.21.15.146:6789/0 conn(0x7f48ec066410 legacy=0x7f48ec1319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.792+0000 7f48f2d97700 1 -- 172.21.15.146:0/2642300637 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec0a16e0 con 0x7f48ec1314b0 2023-10-03T10:14:25.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.792+0000 7f48f2d97700 1 --2- 172.21.15.146:0/2642300637 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48ec1314b0 0x7f48ec138d20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009df0 tx=0x7f48e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b65e20ec6211521e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.792+0000 7f48f1594700 1 -- 172.21.15.146:0/2642300637 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e400e070 con 0x7f48ec1314b0 2023-10-03T10:14:25.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.792+0000 7f48f1594700 1 -- 172.21.15.146:0/2642300637 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e400bae0 con 0x7f48ec1314b0 2023-10-03T10:14:25.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.792+0000 7f48f1594700 1 -- 172.21.15.146:0/2642300637 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e400be90 con 0x7f48ec1314b0 2023-10-03T10:14:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.793+0000 7f48f47fa700 1 -- 172.21.15.146:0/2642300637 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48ec1314b0 msgr2=0x7f48ec138d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.793+0000 7f48f47fa700 1 --2- 172.21.15.146:0/2642300637 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48ec1314b0 0x7f48ec138d20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009df0 tx=0x7f48e400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.793+0000 7f48f47fa700 1 -- 172.21.15.146:0/2642300637 shutdown_connections 2023-10-03T10:14:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.793+0000 7f48f47fa700 1 --2- 172.21.15.146:0/2642300637 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48ec1314b0 0x7f48ec138d20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.793+0000 7f48f47fa700 1 --2- 172.21.15.146:0/2642300637 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48ec132100 0x7f48ec1367d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.793+0000 7f48f47fa700 1 -- 172.21.15.146:0/2642300637 >> 172.21.15.146:0/2642300637 conn(0x7f48ec0a2980 msgr2=0x7f48ec0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.794+0000 7f48f47fa700 1 -- 172.21.15.146:0/2642300637 shutdown_connections 2023-10-03T10:14:25.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.794+0000 7f48f47fa700 1 -- 172.21.15.146:0/2642300637 wait complete. 2023-10-03T10:14:25.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.795+0000 7f48f47fa700 1 Processor -- start 2023-10-03T10:14:25.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.795+0000 7f48f47fa700 1 -- start start 2023-10-03T10:14:25.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.796+0000 7f48f47fa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48ec066410 0x7f48ec137960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.796+0000 7f48f47fa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48ec1314b0 0x7f48ec137ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.796+0000 7f48f47fa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48ec132100 0x7f48ec099ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.796+0000 7f48f47fa700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec1368c0 con 0x7f48ec066410 2023-10-03T10:14:25.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.796+0000 7f48f47fa700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec1351a0 con 0x7f48ec132100 2023-10-03T10:14:25.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.796+0000 7f48f47fa700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec136ac0 con 0x7f48ec1314b0 2023-10-03T10:14:25.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.796+0000 7f48f2596700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48ec066410 0x7f48ec137960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.796+0000 7f48f2596700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48ec066410 0x7f48ec137960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44012/0 (socket says 172.21.15.146:44012) 2023-10-03T10:14:25.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.796+0000 7f48f2596700 1 -- 172.21.15.146:0/239839485 learned_addr learned my addr 172.21.15.146:0/239839485 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:25.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.796+0000 7f48f1d95700 1 --2- 172.21.15.146:0/239839485 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48ec1314b0 0x7f48ec137ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.796+0000 7f48f2596700 1 -- 172.21.15.146:0/239839485 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48ec1314b0 msgr2=0x7f48ec137ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.796+0000 7f48f2596700 1 --2- 172.21.15.146:0/239839485 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48ec1314b0 0x7f48ec137ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.796+0000 7f48f2596700 1 -- 172.21.15.146:0/239839485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48ec132100 msgr2=0x7f48ec099ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.796+0000 7f48f2596700 1 --2- 172.21.15.146:0/239839485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48ec132100 0x7f48ec099ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.796+0000 7f48f2596700 1 -- 172.21.15.146:0/239839485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e4009a70 con 0x7f48ec066410 2023-10-03T10:14:25.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.797+0000 7f48f2596700 1 --2- 172.21.15.146:0/239839485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48ec066410 0x7f48ec137960 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f48e800c6d0 tx=0x7f48e800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.797+0000 7f48e2ffd700 1 -- 172.21.15.146:0/239839485 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e80074e0 con 0x7f48ec066410 2023-10-03T10:14:25.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.797+0000 7f48e2ffd700 1 -- 172.21.15.146:0/239839485 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e8007660 con 0x7f48ec066410 2023-10-03T10:14:25.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.797+0000 7f48f47fa700 1 -- 172.21.15.146:0/239839485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ec135e90 con 0x7f48ec066410 2023-10-03T10:14:25.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.797+0000 7f48e2ffd700 1 -- 172.21.15.146:0/239839485 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e8005a70 con 0x7f48ec066410 2023-10-03T10:14:25.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.797+0000 7f48f47fa700 1 -- 172.21.15.146:0/239839485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ec0a1d50 con 0x7f48ec066410 2023-10-03T10:14:25.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.798+0000 7f48e2ffd700 1 -- 172.21.15.146:0/239839485 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f48e8005bd0 con 0x7f48ec066410 2023-10-03T10:14:25.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.798+0000 7f48e2ffd700 1 -- 172.21.15.146:0/239839485 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f48e803ec50 con 0x7f48ec066410 2023-10-03T10:14:25.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.798+0000 7f48f47fa700 1 -- 172.21.15.146:0/239839485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48ec04f2a0 con 0x7f48ec066410 2023-10-03T10:14:25.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.803+0000 7f48e2ffd700 1 -- 172.21.15.146:0/239839485 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48e803ee60 con 0x7f48ec066410 2023-10-03T10:14:25.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.891+0000 7f9a900e7700 1 Processor -- start 2023-10-03T10:14:25.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.892+0000 7f9a900e7700 1 -- start start 2023-10-03T10:14:25.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.892+0000 7f9a900e7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a88133ad0 0x7f9a88133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.892+0000 7f9a900e7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9a881300a0 0x7f9a881304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.892+0000 7f9a900e7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a8806b2d0 con 0x7f9a881309f0 2023-10-03T10:14:25.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.892+0000 7f9a900e7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a88133610 con 0x7f9a88133ad0 2023-10-03T10:14:25.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.892+0000 7f9a900e7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8809a500 con 0x7f9a881300a0 2023-10-03T10:14:25.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.892+0000 7f9a8de83700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a88133ad0 0x7f9a88133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.892+0000 7f9a8de83700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a88133ad0 0x7f9a88133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42018/0 (socket says 172.21.15.146:42018) 2023-10-03T10:14:25.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.892+0000 7f9a8de83700 1 -- 172.21.15.146:0/3706234931 learned_addr learned my addr 172.21.15.146:0/3706234931 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:25.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.892+0000 7f9a8d682700 1 --2- 172.21.15.146:0/3706234931 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9a881300a0 0x7f9a881304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.893+0000 7f9a8de83700 1 -- 172.21.15.146:0/3706234931 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9a881300a0 msgr2=0x7f9a881304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.893+0000 7f9a8de83700 1 --2- 172.21.15.146:0/3706234931 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9a881300a0 0x7f9a881304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.893+0000 7f9a8de83700 1 -- 172.21.15.146:0/3706234931 >> v1:172.21.15.146:6789/0 conn(0x7f9a881309f0 legacy=0x7f9a8813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.893+0000 7f9a8ce81700 1 -- 172.21.15.146:0/3706234931 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255602583 0 0) 0x7f9a8806b2d0 con 0x7f9a881309f0 2023-10-03T10:14:25.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.893+0000 7f9a8de83700 1 -- 172.21.15.146:0/3706234931 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a881338b0 con 0x7f9a88133ad0 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.893+0000 7f9a8de83700 1 --2- 172.21.15.146:0/3706234931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a88133ad0 0x7f9a88133ea0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009920 tx=0x7f9a84009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d67b2e4f88517df9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.893+0000 7f9a8ce81700 1 -- 172.21.15.146:0/3706234931 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8400ba60 con 0x7f9a88133ad0 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.893+0000 7f9a8ce81700 1 -- 172.21.15.146:0/3706234931 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8400bbc0 con 0x7f9a88133ad0 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.893+0000 7f9a8ce81700 1 -- 172.21.15.146:0/3706234931 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a84009e70 con 0x7f9a88133ad0 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.894+0000 7f9a900e7700 1 -- 172.21.15.146:0/3706234931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a88133ad0 msgr2=0x7f9a88133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.894+0000 7f9a900e7700 1 --2- 172.21.15.146:0/3706234931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a88133ad0 0x7f9a88133ea0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009920 tx=0x7f9a84009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.894+0000 7f9a900e7700 1 -- 172.21.15.146:0/3706234931 shutdown_connections 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.894+0000 7f9a900e7700 1 --2- 172.21.15.146:0/3706234931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a88133ad0 0x7f9a88133ea0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.894+0000 7f9a900e7700 1 --2- 172.21.15.146:0/3706234931 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9a881300a0 0x7f9a881304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.894+0000 7f9a900e7700 1 -- 172.21.15.146:0/3706234931 >> 172.21.15.146:0/3706234931 conn(0x7f9a88099c40 msgr2=0x7f9a880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.894+0000 7f9a900e7700 1 -- 172.21.15.146:0/3706234931 shutdown_connections 2023-10-03T10:14:25.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.894+0000 7f9a900e7700 1 -- 172.21.15.146:0/3706234931 wait complete. 2023-10-03T10:14:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.895+0000 7f9a900e7700 1 Processor -- start 2023-10-03T10:14:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.895+0000 7f9a900e7700 1 -- start start 2023-10-03T10:14:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.895+0000 7f9a900e7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a881300a0 0x7f9a8811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.895+0000 7f9a900e7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9a881309f0 0x7f9a8811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.895+0000 7f9a900e7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a88133ad0 0x7f9a8811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.895+0000 7f9a900e7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8812d7b0 con 0x7f9a881300a0 2023-10-03T10:14:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.895+0000 7f9a900e7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8811f9d0 con 0x7f9a88133ad0 2023-10-03T10:14:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.895+0000 7f9a900e7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a88120070 con 0x7f9a881309f0 2023-10-03T10:14:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.895+0000 7f9a8d682700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9a881309f0 0x7f9a8811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.895+0000 7f9a8d682700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9a881309f0 0x7f9a8811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:50084/0 (socket says 172.21.15.146:50084) 2023-10-03T10:14:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.895+0000 7f9a8d682700 1 -- 172.21.15.146:0/3511371577 learned_addr learned my addr 172.21.15.146:0/3511371577 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.896+0000 7f9a8e684700 1 --2- 172.21.15.146:0/3511371577 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a88133ad0 0x7f9a8811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.896+0000 7f9a8de83700 1 --2- 172.21.15.146:0/3511371577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a881300a0 0x7f9a8811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.896+0000 7f9a8d682700 1 -- 172.21.15.146:0/3511371577 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a88133ad0 msgr2=0x7f9a8811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.896+0000 7f9a8d682700 1 --2- 172.21.15.146:0/3511371577 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a88133ad0 0x7f9a8811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.896+0000 7f9a8d682700 1 -- 172.21.15.146:0/3511371577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a881300a0 msgr2=0x7f9a8811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.896+0000 7f9a8d682700 1 --2- 172.21.15.146:0/3511371577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a881300a0 0x7f9a8811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.896+0000 7f9a8d682700 1 -- 172.21.15.146:0/3511371577 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a84009550 con 0x7f9a881309f0 2023-10-03T10:14:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.896+0000 7f9a8d682700 1 --2- 172.21.15.146:0/3511371577 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9a881309f0 0x7f9a8811df80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800d800 tx=0x7f9a7800db10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.896+0000 7f9a7e7fc700 1 -- 172.21.15.146:0/3511371577 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a780125f0 con 0x7f9a881309f0 2023-10-03T10:14:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.896+0000 7f9a7e7fc700 1 -- 172.21.15.146:0/3511371577 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a78012750 con 0x7f9a881309f0 2023-10-03T10:14:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.896+0000 7f9a900e7700 1 -- 172.21.15.146:0/3511371577 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a88072780 con 0x7f9a881309f0 2023-10-03T10:14:25.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.896+0000 7f9a7e7fc700 1 -- 172.21.15.146:0/3511371577 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78012ac0 con 0x7f9a881309f0 2023-10-03T10:14:25.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.896+0000 7f9a900e7700 1 -- 172.21.15.146:0/3511371577 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a880716d0 con 0x7f9a881309f0 2023-10-03T10:14:25.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.897+0000 7f9a900e7700 1 -- 172.21.15.146:0/3511371577 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a8804f2a0 con 0x7f9a881309f0 2023-10-03T10:14:25.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.897+0000 7f9a7e7fc700 1 -- 172.21.15.146:0/3511371577 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9a78012c20 con 0x7f9a881309f0 2023-10-03T10:14:25.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.898+0000 7f9a7e7fc700 1 -- 172.21.15.146:0/3511371577 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9a7803f800 con 0x7f9a881309f0 2023-10-03T10:14:25.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.906+0000 7f9a7e7fc700 1 -- 172.21.15.146:0/3511371577 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9a7800f710 con 0x7f9a881309f0 2023-10-03T10:14:25.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.914+0000 7f0892b62700 1 Processor -- start 2023-10-03T10:14:25.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.914+0000 7f0892b62700 1 -- start start 2023-10-03T10:14:25.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.915+0000 7f0892b62700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f088c0a1510 0x7f088c1351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.915+0000 7f0892b62700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f088c1356e0 0x7f088c137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.915+0000 7f0892b62700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f088c0a1e70 con 0x7f088c0a0a30 2023-10-03T10:14:25.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.915+0000 7f0892b62700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088c09a720 con 0x7f088c0a1510 2023-10-03T10:14:25.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.915+0000 7f0892b62700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f088c09b300 con 0x7f088c1356e0 2023-10-03T10:14:25.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.915+0000 7f08908fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f088c0a0a30 0x7f088c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36794/0 (socket says 172.21.15.146:36794) 2023-10-03T10:14:25.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.915+0000 7f08908fe700 1 -- 172.21.15.146:0/968307102 learned_addr learned my addr 172.21.15.146:0/968307102 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:25.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.915+0000 7f08910ff700 1 --2- 172.21.15.146:0/968307102 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f088c1356e0 0x7f088c137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.915+0000 7f088bfff700 1 --2- 172.21.15.146:0/968307102 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f088c0a1510 0x7f088c1351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.915+0000 7f088b7fe700 1 -- 172.21.15.146:0/968307102 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 190417991 0 0) 0x7f088c0a1e70 con 0x7f088c0a0a30 2023-10-03T10:14:25.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.915+0000 7f088b7fe700 1 -- 172.21.15.146:0/968307102 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f087c0046c0 con 0x7f088c0a0a30 2023-10-03T10:14:25.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.916+0000 7f088bfff700 1 -- 172.21.15.146:0/968307102 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f088c1356e0 msgr2=0x7f088c137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.916+0000 7f088bfff700 1 --2- 172.21.15.146:0/968307102 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f088c1356e0 0x7f088c137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.916+0000 7f088bfff700 1 -- 172.21.15.146:0/968307102 >> v1:172.21.15.146:6789/0 conn(0x7f088c0a0a30 legacy=0x7f088c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.916+0000 7f088bfff700 1 -- 172.21.15.146:0/968307102 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088c09abc0 con 0x7f088c0a1510 2023-10-03T10:14:25.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.916+0000 7f088bfff700 1 --2- 172.21.15.146:0/968307102 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f088c0a1510 0x7f088c1351a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0878006da0 tx=0x7f0878009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26e155620bd47f82 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.916+0000 7f088b7fe700 1 -- 172.21.15.146:0/968307102 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0878012b80 con 0x7f088c0a1510 2023-10-03T10:14:25.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.916+0000 7f088b7fe700 1 -- 172.21.15.146:0/968307102 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0878012ce0 con 0x7f088c0a1510 2023-10-03T10:14:25.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.916+0000 7f088b7fe700 1 -- 172.21.15.146:0/968307102 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087801b620 con 0x7f088c0a1510 2023-10-03T10:14:25.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.917+0000 7f9f9cb6e700 1 Processor -- start 2023-10-03T10:14:25.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.917+0000 7f9f9cb6e700 1 -- start start 2023-10-03T10:14:25.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.917+0000 7f0892b62700 1 -- 172.21.15.146:0/968307102 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f088c0a1510 msgr2=0x7f088c1351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.917+0000 7f0892b62700 1 --2- 172.21.15.146:0/968307102 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f088c0a1510 0x7f088c1351a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0878006da0 tx=0x7f0878009bb0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.917+0000 7f0892b62700 1 -- 172.21.15.146:0/968307102 shutdown_connections 2023-10-03T10:14:25.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.917+0000 7f0892b62700 1 --2- 172.21.15.146:0/968307102 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f088c1356e0 0x7f088c137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.917+0000 7f0892b62700 1 --2- 172.21.15.146:0/968307102 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f088c0a1510 0x7f088c1351a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.917+0000 7f0892b62700 1 -- 172.21.15.146:0/968307102 >> 172.21.15.146:0/968307102 conn(0x7f088c0a2980 msgr2=0x7f088c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.917+0000 7f0892b62700 1 -- 172.21.15.146:0/968307102 shutdown_connections 2023-10-03T10:14:25.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.917+0000 7f0892b62700 1 -- 172.21.15.146:0/968307102 wait complete. 2023-10-03T10:14:25.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.917+0000 7f9f9cb6e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f98133ad0 0x7f9f98133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.917+0000 7f9f9cb6e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9f981300a0 0x7f9f981304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.917+0000 7f9f9cb6e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f981309f0 0x7f9f9813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.917+0000 7f9f9cb6e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9806b2d0 con 0x7f9f981300a0 2023-10-03T10:14:25.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.917+0000 7f9f9cb6e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f98133610 con 0x7f9f98133ad0 2023-10-03T10:14:25.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.917+0000 7f9f9cb6e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9809a500 con 0x7f9f981309f0 2023-10-03T10:14:25.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.918+0000 7f9f9659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f98133ad0 0x7f9f98133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.918+0000 7f9f9659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f98133ad0 0x7f9f98133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42058/0 (socket says 172.21.15.146:42058) 2023-10-03T10:14:25.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.918+0000 7f9f9659c700 1 -- 172.21.15.146:0/2599618326 learned_addr learned my addr 172.21.15.146:0/2599618326 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:25.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.918+0000 7f9f95d9b700 1 --2- 172.21.15.146:0/2599618326 >> v2:172.21.15.146:3300/0 conn(0x7f9f981300a0 0x7f9f981304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.918+0000 7f9f9659c700 1 -- 172.21.15.146:0/2599618326 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f981309f0 msgr2=0x7f9f9813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.918+0000 7f9f9659c700 1 --2- 172.21.15.146:0/2599618326 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f981309f0 0x7f9f9813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.918+0000 7f9f9659c700 1 -- 172.21.15.146:0/2599618326 >> v2:172.21.15.146:3300/0 conn(0x7f9f981300a0 msgr2=0x7f9f981304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.918+0000 7f9f9659c700 1 --2- 172.21.15.146:0/2599618326 >> v2:172.21.15.146:3300/0 conn(0x7f9f981300a0 0x7f9f981304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.918+0000 7f9f9659c700 1 -- 172.21.15.146:0/2599618326 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f981338b0 con 0x7f9f98133ad0 2023-10-03T10:14:25.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.918+0000 7f0892b62700 1 Processor -- start 2023-10-03T10:14:25.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.918+0000 7f9f9659c700 1 --2- 172.21.15.146:0/2599618326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f98133ad0 0x7f9f98133ea0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9f880098f0 tx=0x7f9f88009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=805eed562ee5ec14 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.918+0000 7f0892b62700 1 -- start start 2023-10-03T10:14:25.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.918+0000 7f9f9559a700 1 -- 172.21.15.146:0/2599618326 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f88011830 con 0x7f9f98133ad0 2023-10-03T10:14:25.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.918+0000 7f9f9559a700 1 -- 172.21.15.146:0/2599618326 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f88011990 con 0x7f9f98133ad0 2023-10-03T10:14:25.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.918+0000 7f9f9559a700 1 -- 172.21.15.146:0/2599618326 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f88011d20 con 0x7f9f98133ad0 2023-10-03T10:14:25.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.919+0000 7f9f9cb6e700 1 -- 172.21.15.146:0/2599618326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f98133ad0 msgr2=0x7f9f98133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.919+0000 7f9f9cb6e700 1 --2- 172.21.15.146:0/2599618326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f98133ad0 0x7f9f98133ea0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9f880098f0 tx=0x7f9f88009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:25.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.919+0000 7f9f9cb6e700 1 -- 172.21.15.146:0/2599618326 shutdown_connections 2023-10-03T10:14:25.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.919+0000 7f9f9cb6e700 1 --2- 172.21.15.146:0/2599618326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f98133ad0 0x7f9f98133ea0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.919+0000 7f9f9cb6e700 1 --2- 172.21.15.146:0/2599618326 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f981309f0 0x7f9f9813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.919+0000 7f9f9cb6e700 1 --2- 172.21.15.146:0/2599618326 >> v2:172.21.15.146:3300/0 conn(0x7f9f981300a0 0x7f9f981304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.919+0000 7f9f9cb6e700 1 -- 172.21.15.146:0/2599618326 >> 172.21.15.146:0/2599618326 conn(0x7f9f98099c40 msgr2=0x7f9f980a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.919+0000 7f0892b62700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f088c0a0a30 0x7f088c121600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.919+0000 7f0892b62700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f088c0a1510 0x7f088c121b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.919+0000 7f0892b62700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f088c1356e0 0x7f088c122080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.919+0000 7f0892b62700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088c123e60 con 0x7f088c0a0a30 2023-10-03T10:14:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.919+0000 7f0892b62700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088c122870 con 0x7f088c0a1510 2023-10-03T10:14:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.919+0000 7f0892b62700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f088c123100 con 0x7f088c1356e0 2023-10-03T10:14:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.919+0000 7f088bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f088c0a1510 0x7f088c121b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.919+0000 7f088bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f088c0a1510 0x7f088c121b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42072/0 (socket says 172.21.15.146:42072) 2023-10-03T10:14:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.919+0000 7f088bfff700 1 -- 172.21.15.146:0/923771186 learned_addr learned my addr 172.21.15.146:0/923771186 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.919+0000 7f08908fe700 1 --2- 172.21.15.146:0/923771186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f088c0a0a30 0x7f088c121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.919+0000 7f08910ff700 1 --2- 172.21.15.146:0/923771186 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f088c1356e0 0x7f088c122080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.920+0000 7f088bfff700 1 -- 172.21.15.146:0/923771186 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f088c1356e0 msgr2=0x7f088c122080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.920+0000 7f088bfff700 1 --2- 172.21.15.146:0/923771186 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f088c1356e0 0x7f088c122080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.920+0000 7f088bfff700 1 -- 172.21.15.146:0/923771186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f088c0a0a30 msgr2=0x7f088c121600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.920+0000 7f088bfff700 1 --2- 172.21.15.146:0/923771186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f088c0a0a30 0x7f088c121600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.920+0000 7f088bfff700 1 -- 172.21.15.146:0/923771186 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08780094a0 con 0x7f088c0a1510 2023-10-03T10:14:25.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.920+0000 7f088bfff700 1 --2- 172.21.15.146:0/923771186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f088c0a1510 0x7f088c121b40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f08780090b0 tx=0x7f0878004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.920+0000 7f9f9cb6e700 1 -- 172.21.15.146:0/2599618326 shutdown_connections 2023-10-03T10:14:25.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.920+0000 7f9f9cb6e700 1 -- 172.21.15.146:0/2599618326 wait complete. 2023-10-03T10:14:25.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.920+0000 7f08897fa700 1 -- 172.21.15.146:0/923771186 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0878012510 con 0x7f088c0a1510 2023-10-03T10:14:25.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.920+0000 7f0892b62700 1 -- 172.21.15.146:0/923771186 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088c09fd80 con 0x7f088c0a1510 2023-10-03T10:14:25.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.920+0000 7f0892b62700 1 -- 172.21.15.146:0/923771186 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f088c1241e0 con 0x7f088c0a1510 2023-10-03T10:14:25.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.921+0000 7f0892b62700 1 -- 172.21.15.146:0/923771186 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088c04f2a0 con 0x7f088c0a1510 2023-10-03T10:14:25.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.921+0000 7f9f9cb6e700 1 Processor -- start 2023-10-03T10:14:25.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.921+0000 7f08897fa700 1 -- 172.21.15.146:0/923771186 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08780036a0 con 0x7f088c0a1510 2023-10-03T10:14:25.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.921+0000 7f08897fa700 1 -- 172.21.15.146:0/923771186 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0878003a50 con 0x7f088c0a1510 2023-10-03T10:14:25.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.923+0000 7f9f9cb6e700 1 -- start start 2023-10-03T10:14:25.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.923+0000 7f9f9cb6e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f981300a0 0x7f9f9811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.923+0000 7f9f9cb6e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f981309f0 0x7f9f9811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.923+0000 7f9f9cb6e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f98133ad0 0x7f9f9811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.923+0000 7f9f9cb6e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9811f080 con 0x7f9f981300a0 2023-10-03T10:14:25.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.923+0000 7f9f9cb6e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9812fd90 con 0x7f9f981309f0 2023-10-03T10:14:25.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.923+0000 7f9f9cb6e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f98120050 con 0x7f9f98133ad0 2023-10-03T10:14:25.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.923+0000 7f9f9659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f981300a0 0x7f9f9811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.923+0000 7f9f9659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f981300a0 0x7f9f9811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44062/0 (socket says 172.21.15.146:44062) 2023-10-03T10:14:25.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.923+0000 7f9f9659c700 1 -- 172.21.15.146:0/574904987 learned_addr learned my addr 172.21.15.146:0/574904987 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:25.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.924+0000 7f9f9659c700 1 -- 172.21.15.146:0/574904987 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f98133ad0 msgr2=0x7f9f9811e4c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:25.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.924+0000 7f9f9659c700 1 --2- 172.21.15.146:0/574904987 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f98133ad0 0x7f9f9811e4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.924+0000 7f9f9659c700 1 -- 172.21.15.146:0/574904987 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f981309f0 msgr2=0x7f9f9811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.924+0000 7f9f9659c700 1 --2- 172.21.15.146:0/574904987 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f981309f0 0x7f9f9811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.924+0000 7f9f9659c700 1 -- 172.21.15.146:0/574904987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f88009550 con 0x7f9f981300a0 2023-10-03T10:14:25.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.924+0000 7f9f9659c700 1 --2- 172.21.15.146:0/574904987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f981300a0 0x7f9f9811da40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9f88009c40 tx=0x7f9f88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.924+0000 7f9f86ffd700 1 -- 172.21.15.146:0/574904987 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f88004550 con 0x7f9f981300a0 2023-10-03T10:14:25.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.924+0000 7f9f86ffd700 1 -- 172.21.15.146:0/574904987 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f880036a0 con 0x7f9f981300a0 2023-10-03T10:14:25.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.924+0000 7f9f86ffd700 1 -- 172.21.15.146:0/574904987 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f88003a10 con 0x7f9f981300a0 2023-10-03T10:14:25.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.924+0000 7f9f9cb6e700 1 -- 172.21.15.146:0/574904987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9812d990 con 0x7f9f981300a0 2023-10-03T10:14:25.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.924+0000 7f9f9cb6e700 1 -- 172.21.15.146:0/574904987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9811fab0 con 0x7f9f981300a0 2023-10-03T10:14:25.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.926+0000 7f9f86ffd700 1 -- 172.21.15.146:0/574904987 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f88003b70 con 0x7f9f981300a0 2023-10-03T10:14:25.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.926+0000 7f9f86ffd700 1 -- 172.21.15.146:0/574904987 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9f88040ac0 con 0x7f9f981300a0 2023-10-03T10:14:25.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.927+0000 7f9f9cb6e700 1 -- 172.21.15.146:0/574904987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9809cb20 con 0x7f9f981300a0 2023-10-03T10:14:25.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.928+0000 7f08897fa700 1 -- 172.21.15.146:0/923771186 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0878003bb0 con 0x7f088c0a1510 2023-10-03T10:14:25.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.928+0000 7f08897fa700 1 -- 172.21.15.146:0/923771186 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0878041210 con 0x7f088c0a1510 2023-10-03T10:14:25.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.928+0000 7f08897fa700 1 -- 172.21.15.146:0/923771186 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f08780415a0 con 0x7f088c0a1510 2023-10-03T10:14:25.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:25.933+0000 7f9f86ffd700 1 -- 172.21.15.146:0/574904987 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f88015080 con 0x7f9f981300a0 2023-10-03T10:14:26.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.059+0000 7f48f47fa700 1 -- 172.21.15.146:0/239839485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f48ec0a11f0 con 0x7f48ec066410 2023-10-03T10:14:26.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.059+0000 7f48e2ffd700 1 -- 172.21.15.146:0/239839485 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f48e8017080 con 0x7f48ec066410 2023-10-03T10:14:26.060 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.062+0000 7f48f47fa700 1 -- 172.21.15.146:0/239839485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48ec066410 msgr2=0x7f48ec137960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.062+0000 7f48f47fa700 1 --2- 172.21.15.146:0/239839485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48ec066410 0x7f48ec137960 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f48e800c6d0 tx=0x7f48e800c9e0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.062+0000 7f48f47fa700 1 -- 172.21.15.146:0/239839485 shutdown_connections 2023-10-03T10:14:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.062+0000 7f48f47fa700 1 --2- 172.21.15.146:0/239839485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48ec132100 0x7f48ec099ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.062+0000 7f48f47fa700 1 --2- 172.21.15.146:0/239839485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48ec066410 0x7f48ec137960 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.062+0000 7f48f47fa700 1 --2- 172.21.15.146:0/239839485 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48ec1314b0 0x7f48ec137ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.062+0000 7f48f47fa700 1 -- 172.21.15.146:0/239839485 >> 172.21.15.146:0/239839485 conn(0x7f48ec0a2980 msgr2=0x7f48ec138b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.062+0000 7f48f47fa700 1 -- 172.21.15.146:0/239839485 shutdown_connections 2023-10-03T10:14:26.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.062+0000 7f48f47fa700 1 -- 172.21.15.146:0/239839485 wait complete. 2023-10-03T10:14:26.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:26.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.104+0000 7f9a900e7700 1 -- 172.21.15.146:0/3511371577 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9a8806c3b0 con 0x7f9a881309f0 2023-10-03T10:14:26.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.105+0000 7f9a7e7fc700 1 -- 172.21.15.146:0/3511371577 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9a78011340 con 0x7f9a881309f0 2023-10-03T10:14:26.105 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:26.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.107+0000 7f9a900e7700 1 -- 172.21.15.146:0/3511371577 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9a881309f0 msgr2=0x7f9a8811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.107+0000 7f9a900e7700 1 --2- 172.21.15.146:0/3511371577 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9a881309f0 0x7f9a8811df80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800d800 tx=0x7f9a7800db10 comp rx=0 tx=0).stop 2023-10-03T10:14:26.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.107+0000 7f9a900e7700 1 -- 172.21.15.146:0/3511371577 shutdown_connections 2023-10-03T10:14:26.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.107+0000 7f9a900e7700 1 --2- 172.21.15.146:0/3511371577 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a88133ad0 0x7f9a8811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.107+0000 7f9a900e7700 1 --2- 172.21.15.146:0/3511371577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a881300a0 0x7f9a8811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.107+0000 7f9a900e7700 1 --2- 172.21.15.146:0/3511371577 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9a881309f0 0x7f9a8811df80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.107+0000 7f9a900e7700 1 -- 172.21.15.146:0/3511371577 >> 172.21.15.146:0/3511371577 conn(0x7f9a88099c40 msgr2=0x7f9a8812e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:26.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.107+0000 7f9a900e7700 1 -- 172.21.15.146:0/3511371577 shutdown_connections 2023-10-03T10:14:26.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.107+0000 7f9a900e7700 1 -- 172.21.15.146:0/3511371577 wait complete. 2023-10-03T10:14:26.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:26.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.127+0000 7f9f9cb6e700 1 -- 172.21.15.146:0/574904987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9f9804f2a0 con 0x7f9f981300a0 2023-10-03T10:14:26.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.128+0000 7f9f86ffd700 1 -- 172.21.15.146:0/574904987 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f8801a420 con 0x7f9f981300a0 2023-10-03T10:14:26.128 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.130+0000 7f9f9cb6e700 1 -- 172.21.15.146:0/574904987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f981300a0 msgr2=0x7f9f9811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.130+0000 7f9f9cb6e700 1 --2- 172.21.15.146:0/574904987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f981300a0 0x7f9f9811da40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9f88009c40 tx=0x7f9f88004750 comp rx=0 tx=0).stop 2023-10-03T10:14:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.130+0000 7f9f9cb6e700 1 -- 172.21.15.146:0/574904987 shutdown_connections 2023-10-03T10:14:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.130+0000 7f9f9cb6e700 1 --2- 172.21.15.146:0/574904987 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f98133ad0 0x7f9f9811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.130+0000 7f9f9cb6e700 1 --2- 172.21.15.146:0/574904987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f981300a0 0x7f9f9811da40 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.130+0000 7f9f9cb6e700 1 --2- 172.21.15.146:0/574904987 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f981309f0 0x7f9f9811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.130+0000 7f9f9cb6e700 1 -- 172.21.15.146:0/574904987 >> 172.21.15.146:0/574904987 conn(0x7f9f98099c40 msgr2=0x7f9f9812f300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.130+0000 7f9f9cb6e700 1 -- 172.21.15.146:0/574904987 shutdown_connections 2023-10-03T10:14:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.130+0000 7f9f9cb6e700 1 -- 172.21.15.146:0/574904987 wait complete. 2023-10-03T10:14:26.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:26.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.149+0000 7f0892b62700 1 -- 172.21.15.146:0/923771186 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f088c06bce0 con 0x7f088c0a1510 2023-10-03T10:14:26.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.150+0000 7f08897fa700 1 -- 172.21.15.146:0/923771186 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f087802a070 con 0x7f088c0a1510 2023-10-03T10:14:26.150 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:26.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.152+0000 7f0892b62700 1 -- 172.21.15.146:0/923771186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f088c0a1510 msgr2=0x7f088c121b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.152+0000 7f0892b62700 1 --2- 172.21.15.146:0/923771186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f088c0a1510 0x7f088c121b40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f08780090b0 tx=0x7f0878004750 comp rx=0 tx=0).stop 2023-10-03T10:14:26.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.152+0000 7f0892b62700 1 -- 172.21.15.146:0/923771186 shutdown_connections 2023-10-03T10:14:26.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.152+0000 7f0892b62700 1 --2- 172.21.15.146:0/923771186 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f088c1356e0 0x7f088c122080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.152+0000 7f0892b62700 1 --2- 172.21.15.146:0/923771186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f088c0a0a30 0x7f088c121600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.152+0000 7f0892b62700 1 --2- 172.21.15.146:0/923771186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f088c0a1510 0x7f088c121b40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.152+0000 7f0892b62700 1 -- 172.21.15.146:0/923771186 >> 172.21.15.146:0/923771186 conn(0x7f088c0a2980 msgr2=0x7f088c130520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:26.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.152+0000 7f0892b62700 1 -- 172.21.15.146:0/923771186 shutdown_connections 2023-10-03T10:14:26.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:26.152+0000 7f0892b62700 1 -- 172.21.15.146:0/923771186 wait complete. 2023-10-03T10:14:26.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:27.076 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:27.121 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:27.143 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:27.165 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:27.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.230+0000 7f3b40b22700 1 Processor -- start 2023-10-03T10:14:27.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.230+0000 7f3b40b22700 1 -- start start 2023-10-03T10:14:27.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.231+0000 7f3b40b22700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c0a1550 0x7f3b3c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.231+0000 7f3b40b22700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3b3c139200 0x7f3b3c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.231+0000 7f3b40b22700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b3c09e9d0 con 0x7f3b3c0a0a70 2023-10-03T10:14:27.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.231+0000 7f3b40b22700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3c09dc00 con 0x7f3b3c139200 2023-10-03T10:14:27.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.231+0000 7f3b40b22700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c09dec0 con 0x7f3b3c0a1550 2023-10-03T10:14:27.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.231+0000 7f3b39d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c0a1550 0x7f3b3c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.231+0000 7f3b3ad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3b3c139200 0x7f3b3c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.231+0000 7f3b3a59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3b3c0a0a70 0x7f3b3c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36802/0 (socket says 172.21.15.146:36802) 2023-10-03T10:14:27.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.231+0000 7f3b3a59c700 1 -- 172.21.15.146:0/3792904061 learned_addr learned my addr 172.21.15.146:0/3792904061 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:27.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.231+0000 7f3b3ad9d700 1 -- 172.21.15.146:0/3792904061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c0a1550 msgr2=0x7f3b3c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:27.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.231+0000 7f3b3ad9d700 1 --2- 172.21.15.146:0/3792904061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c0a1550 0x7f3b3c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.231+0000 7f3b3ad9d700 1 -- 172.21.15.146:0/3792904061 >> v1:172.21.15.146:6789/0 conn(0x7f3b3c0a0a70 legacy=0x7f3b3c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.231+0000 7f3b3ad9d700 1 -- 172.21.15.146:0/3792904061 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c09e6a0 con 0x7f3b3c139200 2023-10-03T10:14:27.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.231+0000 7f3b39d9b700 1 --2- 172.21.15.146:0/3792904061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c0a1550 0x7f3b3c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:27.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.231+0000 7f3b3ad9d700 1 --2- 172.21.15.146:0/3792904061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b3c139200 0x7f3b3c13b5e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009d90 tx=0x7f3b3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779b3bd88280d903 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.232+0000 7f3b3959a700 1 -- 172.21.15.146:0/3792904061 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3400e070 con 0x7f3b3c139200 2023-10-03T10:14:27.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.232+0000 7f3b3959a700 1 -- 172.21.15.146:0/3792904061 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3400bb20 con 0x7f3b3c139200 2023-10-03T10:14:27.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.232+0000 7f3b3959a700 1 -- 172.21.15.146:0/3792904061 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b34012430 con 0x7f3b3c139200 2023-10-03T10:14:27.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.232+0000 7f3b40b22700 1 -- 172.21.15.146:0/3792904061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b3c139200 msgr2=0x7f3b3c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.232+0000 7f3b40b22700 1 --2- 172.21.15.146:0/3792904061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b3c139200 0x7f3b3c13b5e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009d90 tx=0x7f3b3400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:27.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.232+0000 7f3b40b22700 1 -- 172.21.15.146:0/3792904061 shutdown_connections 2023-10-03T10:14:27.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.232+0000 7f3b40b22700 1 --2- 172.21.15.146:0/3792904061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b3c139200 0x7f3b3c13b5e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.232+0000 7f3b40b22700 1 --2- 172.21.15.146:0/3792904061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c0a1550 0x7f3b3c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.232+0000 7f3b40b22700 1 -- 172.21.15.146:0/3792904061 >> 172.21.15.146:0/3792904061 conn(0x7f3b3c0a6610 msgr2=0x7f3b3c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.232+0000 7f3b40b22700 1 -- 172.21.15.146:0/3792904061 shutdown_connections 2023-10-03T10:14:27.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.233+0000 7f3b40b22700 1 -- 172.21.15.146:0/3792904061 wait complete. 2023-10-03T10:14:27.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.234+0000 7f3b40b22700 1 Processor -- start 2023-10-03T10:14:27.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.234+0000 7f3b40b22700 1 -- start start 2023-10-03T10:14:27.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.235+0000 7f3b40b22700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c0a0a70 0x7f3b3c11e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.235+0000 7f3b40b22700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3b3c0a1550 0x7f3b3c11edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.235+0000 7f3b40b22700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b3c139200 0x7f3b3c11f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.235+0000 7f3b40b22700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c0a03e0 con 0x7f3b3c139200 2023-10-03T10:14:27.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.235+0000 7f3b40b22700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c122020 con 0x7f3b3c0a0a70 2023-10-03T10:14:27.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.235+0000 7f3b40b22700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c120500 con 0x7f3b3c0a1550 2023-10-03T10:14:27.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.235+0000 7f3b3a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c0a0a70 0x7f3b3c11e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.235+0000 7f3b3ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b3c139200 0x7f3b3c11f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.235+0000 7f3b3a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c0a0a70 0x7f3b3c11e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42098/0 (socket says 172.21.15.146:42098) 2023-10-03T10:14:27.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.235+0000 7f3b3a59c700 1 -- 172.21.15.146:0/2614129307 learned_addr learned my addr 172.21.15.146:0/2614129307 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:27.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.235+0000 7f3b3a59c700 1 -- 172.21.15.146:0/2614129307 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3b3c0a1550 msgr2=0x7f3b3c11edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.235+0000 7f3b3a59c700 1 --2- 172.21.15.146:0/2614129307 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3b3c0a1550 0x7f3b3c11edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.235+0000 7f3b3a59c700 1 -- 172.21.15.146:0/2614129307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b3c139200 msgr2=0x7f3b3c11f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.235+0000 7f3b3a59c700 1 --2- 172.21.15.146:0/2614129307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b3c139200 0x7f3b3c11f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.235+0000 7f3b3a59c700 1 -- 172.21.15.146:0/2614129307 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b300094a0 con 0x7f3b3c0a0a70 2023-10-03T10:14:27.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.235+0000 7f3b3ad9d700 1 --2- 172.21.15.146:0/2614129307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b3c139200 0x7f3b3c11f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:27.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.236+0000 7f3b3a59c700 1 --2- 172.21.15.146:0/2614129307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c0a0a70 0x7f3b3c11e870 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c00c520 tx=0x7f3b2c00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.236+0000 7f3b2affd700 1 -- 172.21.15.146:0/2614129307 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c005d70 con 0x7f3b3c0a0a70 2023-10-03T10:14:27.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.236+0000 7f3b2affd700 1 -- 172.21.15.146:0/2614129307 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c0070d0 con 0x7f3b3c0a0a70 2023-10-03T10:14:27.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.236+0000 7f3b40b22700 1 -- 172.21.15.146:0/2614129307 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b34009a70 con 0x7f3b3c0a0a70 2023-10-03T10:14:27.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.236+0000 7f3b2affd700 1 -- 172.21.15.146:0/2614129307 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c007440 con 0x7f3b3c0a0a70 2023-10-03T10:14:27.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.236+0000 7f3b40b22700 1 -- 172.21.15.146:0/2614129307 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3c122a90 con 0x7f3b3c0a0a70 2023-10-03T10:14:27.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.237+0000 7f3b2affd700 1 -- 172.21.15.146:0/2614129307 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b2c0075a0 con 0x7f3b3c0a0a70 2023-10-03T10:14:27.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.237+0000 7f3b40b22700 1 -- 172.21.15.146:0/2614129307 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b3c04f2a0 con 0x7f3b3c0a0a70 2023-10-03T10:14:27.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.237+0000 7f3b2affd700 1 -- 172.21.15.146:0/2614129307 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3b2c03ea80 con 0x7f3b3c0a0a70 2023-10-03T10:14:27.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.242+0000 7f3b2affd700 1 -- 172.21.15.146:0/2614129307 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b2c019b40 con 0x7f3b3c0a0a70 2023-10-03T10:14:27.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.260+0000 7fece5ab0700 1 Processor -- start 2023-10-03T10:14:27.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.260+0000 7fece5ab0700 1 -- start start 2023-10-03T10:14:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.260+0000 7fece5ab0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fece0130350 0x7fece0130720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.260+0000 7fece5ab0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fece012d640 0x7fece01388a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.260+0000 7fece5ab0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece0072520 con 0x7fece0130c60 2023-10-03T10:14:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.260+0000 7fece5ab0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece009cd30 con 0x7fece0130350 2023-10-03T10:14:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.260+0000 7fece5ab0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fece009b250 con 0x7fece012d640 2023-10-03T10:14:27.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.261+0000 7fecdffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fece012d640 0x7fece01388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.261+0000 7fecdf7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fece0130350 0x7fece0130720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.261+0000 7fecdf7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fece0130350 0x7fece0130720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44096/0 (socket says 172.21.15.146:44096) 2023-10-03T10:14:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.261+0000 7fecdffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fece012d640 0x7fece01388a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:50120/0 (socket says 172.21.15.146:50120) 2023-10-03T10:14:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.261+0000 7fecdeffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fece0130c60 0x7fece012cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36804/0 (socket says 172.21.15.146:36804) 2023-10-03T10:14:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.261+0000 7fecdf7fe700 1 -- 172.21.15.146:0/1892948193 learned_addr learned my addr 172.21.15.146:0/1892948193 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:27.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.261+0000 7fecdffff700 1 -- 172.21.15.146:0/1892948193 >> v2:172.21.15.146:3300/0 conn(0x7fece0130350 msgr2=0x7fece0130720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:27.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.261+0000 7fecde7fc700 1 -- 172.21.15.146:0/1892948193 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274189772 0 0) 0x7fece0072520 con 0x7fece0130c60 2023-10-03T10:14:27.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.261+0000 7fecdffff700 1 --2- 172.21.15.146:0/1892948193 >> v2:172.21.15.146:3300/0 conn(0x7fece0130350 0x7fece0130720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.261+0000 7fecdffff700 1 -- 172.21.15.146:0/1892948193 >> v1:172.21.15.146:6789/0 conn(0x7fece0130c60 legacy=0x7fece012cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.261+0000 7fecdffff700 1 -- 172.21.15.146:0/1892948193 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece009bbb0 con 0x7fece012d640 2023-10-03T10:14:27.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.261+0000 7fecdf7fe700 1 --2- 172.21.15.146:0/1892948193 >> v2:172.21.15.146:3300/0 conn(0x7fece0130350 0x7fece0130720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:27.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.261+0000 7fecdffff700 1 --2- 172.21.15.146:0/1892948193 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fece012d640 0x7fece01388a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fecd8009d90 tx=0x7fecd800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa3f2c978a17261d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.261+0000 7fecde7fc700 1 -- 172.21.15.146:0/1892948193 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd800e070 con 0x7fece012d640 2023-10-03T10:14:27.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.261+0000 7fecde7fc700 1 -- 172.21.15.146:0/1892948193 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd800bb20 con 0x7fece012d640 2023-10-03T10:14:27.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.261+0000 7fecde7fc700 1 -- 172.21.15.146:0/1892948193 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8012430 con 0x7fece012d640 2023-10-03T10:14:27.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.262+0000 7fece5ab0700 1 -- 172.21.15.146:0/1892948193 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fece012d640 msgr2=0x7fece01388a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.262+0000 7fece5ab0700 1 --2- 172.21.15.146:0/1892948193 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fece012d640 0x7fece01388a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fecd8009d90 tx=0x7fecd800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:27.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.262+0000 7fece5ab0700 1 -- 172.21.15.146:0/1892948193 shutdown_connections 2023-10-03T10:14:27.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.262+0000 7fece5ab0700 1 --2- 172.21.15.146:0/1892948193 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fece012d640 0x7fece01388a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.262+0000 7fece5ab0700 1 --2- 172.21.15.146:0/1892948193 >> v2:172.21.15.146:3300/0 conn(0x7fece0130350 0x7fece0130720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.262+0000 7fece5ab0700 1 -- 172.21.15.146:0/1892948193 >> 172.21.15.146:0/1892948193 conn(0x7fece00a2980 msgr2=0x7fece00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.262+0000 7fece5ab0700 1 -- 172.21.15.146:0/1892948193 shutdown_connections 2023-10-03T10:14:27.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.262+0000 7fece5ab0700 1 -- 172.21.15.146:0/1892948193 wait complete. 2023-10-03T10:14:27.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.263+0000 7fece5ab0700 1 Processor -- start 2023-10-03T10:14:27.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.263+0000 7fece5ab0700 1 -- start start 2023-10-03T10:14:27.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.264+0000 7fece5ab0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fece012d640 0x7fece0070020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.264+0000 7fece5ab0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fece0130350 0x7fece0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.264+0000 7fece5ab0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fece0130c60 0x7fece0070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.264+0000 7fece5ab0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece009b490 con 0x7fece0130c60 2023-10-03T10:14:27.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.264+0000 7fece5ab0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece0126cd0 con 0x7fece012d640 2023-10-03T10:14:27.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.264+0000 7fece5ab0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fece0071cb0 con 0x7fece0130350 2023-10-03T10:14:27.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.264+0000 7fecdf7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fece012d640 0x7fece0070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.264+0000 7fecdeffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fece0130350 0x7fece0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.264+0000 7fecdeffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fece0130350 0x7fece0070560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:50132/0 (socket says 172.21.15.146:50132) 2023-10-03T10:14:27.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.264+0000 7fecdf7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fece012d640 0x7fece0070020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42110/0 (socket says 172.21.15.146:42110) 2023-10-03T10:14:27.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.264+0000 7fecdeffd700 1 -- 172.21.15.146:0/3729403884 learned_addr learned my addr 172.21.15.146:0/3729403884 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:27.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.264+0000 7fecdffff700 1 --2- 172.21.15.146:0/3729403884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fece0130c60 0x7fece0070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.264+0000 7fecdeffd700 1 -- 172.21.15.146:0/3729403884 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fece012d640 msgr2=0x7fece0070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.264+0000 7fecdeffd700 1 --2- 172.21.15.146:0/3729403884 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fece012d640 0x7fece0070020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.264+0000 7fecdeffd700 1 -- 172.21.15.146:0/3729403884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fece0130c60 msgr2=0x7fece0070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.264+0000 7fecdeffd700 1 --2- 172.21.15.146:0/3729403884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fece0130c60 0x7fece0070aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.264+0000 7fecdeffd700 1 -- 172.21.15.146:0/3729403884 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd0009500 con 0x7fece0130350 2023-10-03T10:14:27.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.264+0000 7fecdf7fe700 1 --2- 172.21.15.146:0/3729403884 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fece012d640 0x7fece0070020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:27.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.264+0000 7fecdffff700 1 --2- 172.21.15.146:0/3729403884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fece0130c60 0x7fece0070aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:27.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.264+0000 7fecdeffd700 1 --2- 172.21.15.146:0/3729403884 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fece0130350 0x7fece0070560 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fecd400c750 tx=0x7fecd400ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.265+0000 7fecc7fff700 1 -- 172.21.15.146:0/3729403884 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4004c80 con 0x7fece0130350 2023-10-03T10:14:27.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.265+0000 7fecc7fff700 1 -- 172.21.15.146:0/3729403884 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd4004de0 con 0x7fece0130350 2023-10-03T10:14:27.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.265+0000 7fecc7fff700 1 -- 172.21.15.146:0/3729403884 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4007310 con 0x7fece0130350 2023-10-03T10:14:27.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.265+0000 7fece5ab0700 1 -- 172.21.15.146:0/3729403884 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd8009a70 con 0x7fece0130350 2023-10-03T10:14:27.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.265+0000 7fece5ab0700 1 -- 172.21.15.146:0/3729403884 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece00a24b0 con 0x7fece0130350 2023-10-03T10:14:27.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.266+0000 7fecc7fff700 1 -- 172.21.15.146:0/3729403884 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fecd4007470 con 0x7fece0130350 2023-10-03T10:14:27.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.266+0000 7fecc7fff700 1 -- 172.21.15.146:0/3729403884 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fecd403f350 con 0x7fece0130350 2023-10-03T10:14:27.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.266+0000 7fece5ab0700 1 -- 172.21.15.146:0/3729403884 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece009cf30 con 0x7fece0130350 2023-10-03T10:14:27.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.271+0000 7fecc7fff700 1 -- 172.21.15.146:0/3729403884 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fece009cf30 con 0x7fece0130350 2023-10-03T10:14:27.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.310+0000 7f7688180700 1 Processor -- start 2023-10-03T10:14:27.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.311+0000 7f7688180700 1 -- start start 2023-10-03T10:14:27.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.311+0000 7f7688180700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7680136960 0x7f7680138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.311+0000 7f7688180700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7680139280 0x7f768013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.311+0000 7f7688180700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768006b2d0 con 0x7f7680133ad0 2023-10-03T10:14:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.311+0000 7f7688180700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76801345b0 con 0x7f7680136960 2023-10-03T10:14:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.311+0000 7f7688180700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7680133610 con 0x7f7680139280 2023-10-03T10:14:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.311+0000 7f768571b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7680136960 0x7f7680138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.311+0000 7f7685f1c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7680133ad0 0x7f7680133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36816/0 (socket says 172.21.15.146:36816) 2023-10-03T10:14:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.311+0000 7f7685f1c700 1 -- 172.21.15.146:0/2888835638 learned_addr learned my addr 172.21.15.146:0/2888835638 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.311+0000 7f768671d700 1 --2- 172.21.15.146:0/2888835638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7680139280 0x7f768013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.312+0000 7f768571b700 1 -- 172.21.15.146:0/2888835638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7680139280 msgr2=0x7f768013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.312+0000 7f768571b700 1 --2- 172.21.15.146:0/2888835638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7680139280 0x7f768013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.312+0000 7f768571b700 1 -- 172.21.15.146:0/2888835638 >> v1:172.21.15.146:6789/0 conn(0x7f7680133ad0 legacy=0x7f7680133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.312+0000 7f768571b700 1 -- 172.21.15.146:0/2888835638 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768009a500 con 0x7f7680136960 2023-10-03T10:14:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.312+0000 7f7684f1a700 1 -- 172.21.15.146:0/2888835638 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674953209 0 0) 0x7f768006b2d0 con 0x7f7680133ad0 2023-10-03T10:14:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.312+0000 7f768571b700 1 --2- 172.21.15.146:0/2888835638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7680136960 0x7f7680138d40 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7670009840 tx=0x7f7670009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7763453a4f20b51e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.312+0000 7f7684f1a700 1 -- 172.21.15.146:0/2888835638 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670011830 con 0x7f7680136960 2023-10-03T10:14:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.312+0000 7f7684f1a700 1 -- 172.21.15.146:0/2888835638 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7670011990 con 0x7f7680136960 2023-10-03T10:14:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.312+0000 7f7684f1a700 1 -- 172.21.15.146:0/2888835638 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670011d20 con 0x7f7680136960 2023-10-03T10:14:27.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.313+0000 7f7688180700 1 -- 172.21.15.146:0/2888835638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7680136960 msgr2=0x7f7680138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.313+0000 7f7688180700 1 --2- 172.21.15.146:0/2888835638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7680136960 0x7f7680138d40 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7670009840 tx=0x7f7670009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:27.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.313+0000 7f7688180700 1 -- 172.21.15.146:0/2888835638 shutdown_connections 2023-10-03T10:14:27.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.313+0000 7f7688180700 1 --2- 172.21.15.146:0/2888835638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7680139280 0x7f768013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.313+0000 7f7688180700 1 --2- 172.21.15.146:0/2888835638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7680136960 0x7f7680138d40 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.313+0000 7f7688180700 1 -- 172.21.15.146:0/2888835638 >> 172.21.15.146:0/2888835638 conn(0x7f7680099c40 msgr2=0x7f76800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.313+0000 7f7688180700 1 -- 172.21.15.146:0/2888835638 shutdown_connections 2023-10-03T10:14:27.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.313+0000 7f7688180700 1 -- 172.21.15.146:0/2888835638 wait complete. 2023-10-03T10:14:27.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.314+0000 7f7688180700 1 Processor -- start 2023-10-03T10:14:27.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.314+0000 7f7688180700 1 -- start start 2023-10-03T10:14:27.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.314+0000 7f7688180700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7680133ad0 0x7f768012cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.314+0000 7f7688180700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7680136960 0x7f768012d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.314+0000 7f7688180700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7680139280 0x7f768012d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.314+0000 7f7688180700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7680130410 con 0x7f7680139280 2023-10-03T10:14:27.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.314+0000 7f7688180700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7680070410 con 0x7f7680136960 2023-10-03T10:14:27.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.314+0000 7f7688180700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7680130ab0 con 0x7f7680133ad0 2023-10-03T10:14:27.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.314+0000 7f7685f1c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7680133ad0 0x7f768012cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.314+0000 7f7685f1c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7680133ad0 0x7f768012cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:50140/0 (socket says 172.21.15.146:50140) 2023-10-03T10:14:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.314+0000 7f7685f1c700 1 -- 172.21.15.146:0/3763826756 learned_addr learned my addr 172.21.15.146:0/3763826756 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.314+0000 7f768571b700 1 --2- 172.21.15.146:0/3763826756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7680136960 0x7f768012d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.314+0000 7f768671d700 1 --2- 172.21.15.146:0/3763826756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7680139280 0x7f768012d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.315+0000 7f7685f1c700 1 -- 172.21.15.146:0/3763826756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7680136960 msgr2=0x7f768012d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.315+0000 7f7685f1c700 1 --2- 172.21.15.146:0/3763826756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7680136960 0x7f768012d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.315+0000 7f7685f1c700 1 -- 172.21.15.146:0/3763826756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7680139280 msgr2=0x7f768012d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.315+0000 7f7685f1c700 1 --2- 172.21.15.146:0/3763826756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7680139280 0x7f768012d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.315+0000 7f7685f1c700 1 -- 172.21.15.146:0/3763826756 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76700094a0 con 0x7f7680133ad0 2023-10-03T10:14:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.315+0000 7f768571b700 1 --2- 172.21.15.146:0/3763826756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7680136960 0x7f768012d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.315+0000 7f768671d700 1 --2- 172.21.15.146:0/3763826756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7680139280 0x7f768012d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:27.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.315+0000 7f7685f1c700 1 --2- 172.21.15.146:0/3763826756 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7680133ad0 0x7f768012cb30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f767c00c550 tx=0x7f767c00c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.315+0000 7f76767fc700 1 -- 172.21.15.146:0/3763826756 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c004c80 con 0x7f7680133ad0 2023-10-03T10:14:27.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.315+0000 7f76767fc700 1 -- 172.21.15.146:0/3763826756 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767c004de0 con 0x7f7680133ad0 2023-10-03T10:14:27.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.315+0000 7f7688180700 1 -- 172.21.15.146:0/3763826756 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7680072600 con 0x7f7680133ad0 2023-10-03T10:14:27.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.315+0000 7f76767fc700 1 -- 172.21.15.146:0/3763826756 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c007310 con 0x7f7680133ad0 2023-10-03T10:14:27.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.315+0000 7f7688180700 1 -- 172.21.15.146:0/3763826756 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768012dd50 con 0x7f7680133ad0 2023-10-03T10:14:27.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.317+0000 7f76767fc700 1 -- 172.21.15.146:0/3763826756 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f767c007470 con 0x7f7680133ad0 2023-10-03T10:14:27.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.317+0000 7f76767fc700 1 -- 172.21.15.146:0/3763826756 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f767c03f240 con 0x7f7680133ad0 2023-10-03T10:14:27.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.317+0000 7f7688180700 1 -- 172.21.15.146:0/3763826756 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7680070250 con 0x7f7680133ad0 2023-10-03T10:14:27.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.322+0000 7f76767fc700 1 -- 172.21.15.146:0/3763826756 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f767c0123b0 con 0x7f7680133ad0 2023-10-03T10:14:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.339+0000 7fdcf6e21700 1 Processor -- start 2023-10-03T10:14:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.339+0000 7fdcf6e21700 1 -- start start 2023-10-03T10:14:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.340+0000 7fdcf6e21700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcf0131980 0x7fdcf0131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.340+0000 7fdcf6e21700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdcf009c790 0x7fdcf0139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.340+0000 7fdcf6e21700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf00a1640 con 0x7fdcf009bc70 2023-10-03T10:14:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.340+0000 7fdcf6e21700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf006eb30 con 0x7fdcf0131980 2023-10-03T10:14:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.340+0000 7fdcf6e21700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf00a22d0 con 0x7fdcf009c790 2023-10-03T10:14:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.340+0000 7fdceffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdcf009bc70 0x7fdcf009c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36820/0 (socket says 172.21.15.146:36820) 2023-10-03T10:14:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.340+0000 7fdceffff700 1 -- 172.21.15.146:0/1020502818 learned_addr learned my addr 172.21.15.146:0/1020502818 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.340+0000 7fdcf53be700 1 --2- 172.21.15.146:0/1020502818 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdcf009c790 0x7fdcf0139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.340+0000 7fdcef7fe700 1 -- 172.21.15.146:0/1020502818 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3798343100 0 0) 0x7fdcf00a1640 con 0x7fdcf009bc70 2023-10-03T10:14:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.340+0000 7fdcef7fe700 1 -- 172.21.15.146:0/1020502818 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdce00035b0 con 0x7fdcf009bc70 2023-10-03T10:14:27.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.340+0000 7fdcf53be700 1 -- 172.21.15.146:0/1020502818 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcf0131980 msgr2=0x7fdcf0131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:27.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.340+0000 7fdcf53be700 1 --2- 172.21.15.146:0/1020502818 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcf0131980 0x7fdcf0131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.341+0000 7fdcf53be700 1 -- 172.21.15.146:0/1020502818 >> v1:172.21.15.146:6789/0 conn(0x7fdcf009bc70 legacy=0x7fdcf009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.341+0000 7fdcf53be700 1 -- 172.21.15.146:0/1020502818 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf0131550 con 0x7fdcf009c790 2023-10-03T10:14:27.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.341+0000 7fdcf53be700 1 --2- 172.21.15.146:0/1020502818 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdcf009c790 0x7fdcf0139710 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdce8009dc0 tx=0x7fdce800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a25c06a20601848f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.341+0000 7fdcef7fe700 1 -- 172.21.15.146:0/1020502818 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce800e070 con 0x7fdcf009c790 2023-10-03T10:14:27.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.341+0000 7fdcef7fe700 1 -- 172.21.15.146:0/1020502818 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce800bb20 con 0x7fdcf009c790 2023-10-03T10:14:27.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.341+0000 7fdcef7fe700 1 -- 172.21.15.146:0/1020502818 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce8012430 con 0x7fdcf009c790 2023-10-03T10:14:27.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.342+0000 7fdcf6e21700 1 -- 172.21.15.146:0/1020502818 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdcf009c790 msgr2=0x7fdcf0139710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.342+0000 7fdcf6e21700 1 --2- 172.21.15.146:0/1020502818 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdcf009c790 0x7fdcf0139710 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdce8009dc0 tx=0x7fdce800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.342+0000 7fdcf6e21700 1 -- 172.21.15.146:0/1020502818 shutdown_connections 2023-10-03T10:14:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.342+0000 7fdcf6e21700 1 --2- 172.21.15.146:0/1020502818 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdcf009c790 0x7fdcf0139710 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.342+0000 7fdcf6e21700 1 --2- 172.21.15.146:0/1020502818 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcf0131980 0x7fdcf0131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.342+0000 7fdcf6e21700 1 -- 172.21.15.146:0/1020502818 >> 172.21.15.146:0/1020502818 conn(0x7fdcf00a2980 msgr2=0x7fdcf00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.342+0000 7fdcf6e21700 1 -- 172.21.15.146:0/1020502818 shutdown_connections 2023-10-03T10:14:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.342+0000 7fdcf6e21700 1 -- 172.21.15.146:0/1020502818 wait complete. 2023-10-03T10:14:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.344+0000 7fdcf6e21700 1 Processor -- start 2023-10-03T10:14:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.344+0000 7fdcf6e21700 1 -- start start 2023-10-03T10:14:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.344+0000 7fdcf6e21700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdcf009bc70 0x7fdcf011b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.345+0000 7fdcf6e21700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcf009c790 0x7fdcf011bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.345+0000 7fdcf6e21700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcf0131980 0x7fdcf011c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.345+0000 7fdcf6e21700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf011fae0 con 0x7fdcf009c790 2023-10-03T10:14:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.345+0000 7fdcf6e21700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf011f120 con 0x7fdcf0131980 2023-10-03T10:14:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.345+0000 7fdcf6e21700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf0130b40 con 0x7fdcf009bc70 2023-10-03T10:14:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.345+0000 7fdceffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcf009c790 0x7fdcf011bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.345+0000 7fdceffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcf009c790 0x7fdcf011bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44124/0 (socket says 172.21.15.146:44124) 2023-10-03T10:14:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.345+0000 7fdceffff700 1 -- 172.21.15.146:0/3724247688 learned_addr learned my addr 172.21.15.146:0/3724247688 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.345+0000 7fdcf53be700 1 --2- 172.21.15.146:0/3724247688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcf0131980 0x7fdcf011c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.345+0000 7fdceffff700 1 -- 172.21.15.146:0/3724247688 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdcf009bc70 msgr2=0x7fdcf011b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.345+0000 7fdceffff700 1 --2- 172.21.15.146:0/3724247688 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdcf009bc70 0x7fdcf011b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.345+0000 7fdceffff700 1 -- 172.21.15.146:0/3724247688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcf0131980 msgr2=0x7fdcf011c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.345+0000 7fdceffff700 1 --2- 172.21.15.146:0/3724247688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcf0131980 0x7fdcf011c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.345+0000 7fdceffff700 1 -- 172.21.15.146:0/3724247688 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce8009a70 con 0x7fdcf009c790 2023-10-03T10:14:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.345+0000 7fdcf53be700 1 --2- 172.21.15.146:0/3724247688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcf0131980 0x7fdcf011c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.345+0000 7fdceffff700 1 --2- 172.21.15.146:0/3724247688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcf009c790 0x7fdcf011bb40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc005910 tx=0x7fdcdc014330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.345+0000 7fdced7fa700 1 -- 172.21.15.146:0/3724247688 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc017070 con 0x7fdcf009c790 2023-10-03T10:14:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.346+0000 7fdced7fa700 1 -- 172.21.15.146:0/3724247688 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc014bd0 con 0x7fdcf009c790 2023-10-03T10:14:27.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.346+0000 7fdcf6e21700 1 -- 172.21.15.146:0/3724247688 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf011e460 con 0x7fdcf009c790 2023-10-03T10:14:27.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.346+0000 7fdcf6e21700 1 -- 172.21.15.146:0/3724247688 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf011d210 con 0x7fdcf009c790 2023-10-03T10:14:27.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.347+0000 7fdced7fa700 1 -- 172.21.15.146:0/3724247688 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc005940 con 0x7fdcf009c790 2023-10-03T10:14:27.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.347+0000 7fdced7fa700 1 -- 172.21.15.146:0/3724247688 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdcdc005ae0 con 0x7fdcf009c790 2023-10-03T10:14:27.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.347+0000 7fdced7fa700 1 -- 172.21.15.146:0/3724247688 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdcdc0473b0 con 0x7fdcf009c790 2023-10-03T10:14:27.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.348+0000 7fdcf6e21700 1 -- 172.21.15.146:0/3724247688 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf011ecc0 con 0x7fdcf009c790 2023-10-03T10:14:27.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.353+0000 7fdced7fa700 1 -- 172.21.15.146:0/3724247688 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdcdc0247b0 con 0x7fdcf009c790 2023-10-03T10:14:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.490+0000 7fece5ab0700 1 -- 172.21.15.146:0/3729403884 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fece009cf30 con 0x7fece0130350 2023-10-03T10:14:27.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.490+0000 7fecc7fff700 1 -- 172.21.15.146:0/3729403884 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fece009cf30 con 0x7fece0130350 2023-10-03T10:14:27.501 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:27.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.493+0000 7fece5ab0700 1 -- 172.21.15.146:0/3729403884 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fece0130350 msgr2=0x7fece0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.493+0000 7fece5ab0700 1 --2- 172.21.15.146:0/3729403884 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fece0130350 0x7fece0070560 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fecd400c750 tx=0x7fecd400ca60 comp rx=0 tx=0).stop 2023-10-03T10:14:27.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.493+0000 7fece5ab0700 1 -- 172.21.15.146:0/3729403884 shutdown_connections 2023-10-03T10:14:27.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.493+0000 7fece5ab0700 1 --2- 172.21.15.146:0/3729403884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fece0130c60 0x7fece0070aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.493+0000 7fece5ab0700 1 --2- 172.21.15.146:0/3729403884 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fece012d640 0x7fece0070020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.493+0000 7fece5ab0700 1 --2- 172.21.15.146:0/3729403884 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fece0130350 0x7fece0070560 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.493+0000 7fece5ab0700 1 -- 172.21.15.146:0/3729403884 >> 172.21.15.146:0/3729403884 conn(0x7fece00a2980 msgr2=0x7fece0124140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.493+0000 7fece5ab0700 1 -- 172.21.15.146:0/3729403884 shutdown_connections 2023-10-03T10:14:27.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.493+0000 7fece5ab0700 1 -- 172.21.15.146:0/3729403884 wait complete. 2023-10-03T10:14:27.508 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:27.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.506+0000 7f3b40b22700 1 -- 172.21.15.146:0/2614129307 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3b3c072980 con 0x7f3b3c0a0a70 2023-10-03T10:14:27.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.506+0000 7f3b2affd700 1 -- 172.21.15.146:0/2614129307 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3b2c017020 con 0x7f3b3c0a0a70 2023-10-03T10:14:27.509 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:27.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.508+0000 7f3b40b22700 1 -- 172.21.15.146:0/2614129307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c0a0a70 msgr2=0x7f3b3c11e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.508+0000 7f3b40b22700 1 --2- 172.21.15.146:0/2614129307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c0a0a70 0x7f3b3c11e870 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c00c520 tx=0x7f3b2c00c830 comp rx=0 tx=0).stop 2023-10-03T10:14:27.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.508+0000 7f3b40b22700 1 -- 172.21.15.146:0/2614129307 shutdown_connections 2023-10-03T10:14:27.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.508+0000 7f3b40b22700 1 --2- 172.21.15.146:0/2614129307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b3c139200 0x7f3b3c11f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.508+0000 7f3b40b22700 1 --2- 172.21.15.146:0/2614129307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c0a0a70 0x7f3b3c11e870 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.508+0000 7f3b40b22700 1 --2- 172.21.15.146:0/2614129307 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3b3c0a1550 0x7f3b3c11edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.508+0000 7f3b40b22700 1 -- 172.21.15.146:0/2614129307 >> 172.21.15.146:0/2614129307 conn(0x7f3b3c0a6610 msgr2=0x7f3b3c138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.508+0000 7f3b40b22700 1 -- 172.21.15.146:0/2614129307 shutdown_connections 2023-10-03T10:14:27.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.508+0000 7f3b40b22700 1 -- 172.21.15.146:0/2614129307 wait complete. 2023-10-03T10:14:27.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:27.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.524+0000 7f7688180700 1 -- 172.21.15.146:0/3763826756 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f768004f2a0 con 0x7f7680133ad0 2023-10-03T10:14:27.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.524+0000 7f76767fc700 1 -- 172.21.15.146:0/3763826756 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f767c011360 con 0x7f7680133ad0 2023-10-03T10:14:27.526 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.526+0000 7f7688180700 1 -- 172.21.15.146:0/3763826756 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7680133ad0 msgr2=0x7f768012cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.526+0000 7f7688180700 1 --2- 172.21.15.146:0/3763826756 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7680133ad0 0x7f768012cb30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f767c00c550 tx=0x7f767c00c860 comp rx=0 tx=0).stop 2023-10-03T10:14:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.526+0000 7f7688180700 1 -- 172.21.15.146:0/3763826756 shutdown_connections 2023-10-03T10:14:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.526+0000 7f7688180700 1 --2- 172.21.15.146:0/3763826756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7680139280 0x7f768012d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.526+0000 7f7688180700 1 --2- 172.21.15.146:0/3763826756 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7680133ad0 0x7f768012cb30 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.526+0000 7f7688180700 1 --2- 172.21.15.146:0/3763826756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7680136960 0x7f768012d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.526+0000 7f7688180700 1 -- 172.21.15.146:0/3763826756 >> 172.21.15.146:0/3763826756 conn(0x7f7680099c40 msgr2=0x7f7680134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.527+0000 7f7688180700 1 -- 172.21.15.146:0/3763826756 shutdown_connections 2023-10-03T10:14:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.527+0000 7f7688180700 1 -- 172.21.15.146:0/3763826756 wait complete. 2023-10-03T10:14:27.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:27.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.573+0000 7fdcf6e21700 1 -- 172.21.15.146:0/3724247688 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdcf004f2a0 con 0x7fdcf009c790 2023-10-03T10:14:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.573+0000 7fdced7fa700 1 -- 172.21.15.146:0/3724247688 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdcdc01b3c0 con 0x7fdcf009c790 2023-10-03T10:14:27.574 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:27.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.575+0000 7fdcf6e21700 1 -- 172.21.15.146:0/3724247688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcf009c790 msgr2=0x7fdcf011bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.575+0000 7fdcf6e21700 1 --2- 172.21.15.146:0/3724247688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcf009c790 0x7fdcf011bb40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc005910 tx=0x7fdcdc014330 comp rx=0 tx=0).stop 2023-10-03T10:14:27.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.575+0000 7fdcf6e21700 1 -- 172.21.15.146:0/3724247688 shutdown_connections 2023-10-03T10:14:27.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.575+0000 7fdcf6e21700 1 --2- 172.21.15.146:0/3724247688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcf0131980 0x7fdcf011c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.575+0000 7fdcf6e21700 1 --2- 172.21.15.146:0/3724247688 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdcf009bc70 0x7fdcf011b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.575+0000 7fdcf6e21700 1 --2- 172.21.15.146:0/3724247688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcf009c790 0x7fdcf011bb40 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.575+0000 7fdcf6e21700 1 -- 172.21.15.146:0/3724247688 >> 172.21.15.146:0/3724247688 conn(0x7fdcf00a2980 msgr2=0x7fdcf01b8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.575+0000 7fdcf6e21700 1 -- 172.21.15.146:0/3724247688 shutdown_connections 2023-10-03T10:14:27.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:27.575+0000 7fdcf6e21700 1 -- 172.21.15.146:0/3724247688 wait complete. 2023-10-03T10:14:27.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:28.509 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:28.522 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:28.540 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:28.589 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:28.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.645+0000 7f09061ec700 1 Processor -- start 2023-10-03T10:14:28.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.646+0000 7f09061ec700 1 -- start start 2023-10-03T10:14:28.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.646+0000 7f09061ec700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f090006a770 0x7f09001349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.646+0000 7f09061ec700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0900134f00 0x7f090009d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.646+0000 7f09061ec700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f090009dea0 0x7f090009e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.646+0000 7f09061ec700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090006b2e0 con 0x7f090009dea0 2023-10-03T10:14:28.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.646+0000 7f09061ec700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090009eca0 con 0x7f0900134f00 2023-10-03T10:14:28.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.646+0000 7f09061ec700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f090009f720 con 0x7f090006a770 2023-10-03T10:14:28.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.646+0000 7f08feffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0900134f00 0x7f090009d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.646+0000 7f08feffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0900134f00 0x7f090009d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42140/0 (socket says 172.21.15.146:42140) 2023-10-03T10:14:28.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.646+0000 7f08feffd700 1 -- 172.21.15.146:0/2207166193 learned_addr learned my addr 172.21.15.146:0/2207166193 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:28.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.646+0000 7f08fffff700 1 --2- 172.21.15.146:0/2207166193 >> v2:172.21.15.146:3300/0 conn(0x7f090009dea0 0x7f090009e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.647+0000 7f08feffd700 1 -- 172.21.15.146:0/2207166193 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f090006a770 msgr2=0x7f09001349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.647+0000 7f08feffd700 1 --2- 172.21.15.146:0/2207166193 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f090006a770 0x7f09001349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.647+0000 7f08feffd700 1 -- 172.21.15.146:0/2207166193 >> v2:172.21.15.146:3300/0 conn(0x7f090009dea0 msgr2=0x7f090009e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.647+0000 7f08feffd700 1 --2- 172.21.15.146:0/2207166193 >> v2:172.21.15.146:3300/0 conn(0x7f090009dea0 0x7f090009e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.647+0000 7f08feffd700 1 -- 172.21.15.146:0/2207166193 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090006b480 con 0x7f0900134f00 2023-10-03T10:14:28.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.647+0000 7f08feffd700 1 --2- 172.21.15.146:0/2207166193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0900134f00 0x7f090009d960 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f08f40098f0 tx=0x7f08f4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1813f98cae79a41c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.647+0000 7f08fe7fc700 1 -- 172.21.15.146:0/2207166193 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4011830 con 0x7f0900134f00 2023-10-03T10:14:28.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.647+0000 7f08fe7fc700 1 -- 172.21.15.146:0/2207166193 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f4011990 con 0x7f0900134f00 2023-10-03T10:14:28.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.647+0000 7f08fe7fc700 1 -- 172.21.15.146:0/2207166193 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4011d20 con 0x7f0900134f00 2023-10-03T10:14:28.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.648+0000 7f09061ec700 1 -- 172.21.15.146:0/2207166193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0900134f00 msgr2=0x7f090009d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.648+0000 7f09061ec700 1 --2- 172.21.15.146:0/2207166193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0900134f00 0x7f090009d960 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f08f40098f0 tx=0x7f08f4009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:28.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.648+0000 7f09061ec700 1 -- 172.21.15.146:0/2207166193 shutdown_connections 2023-10-03T10:14:28.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.648+0000 7f09061ec700 1 --2- 172.21.15.146:0/2207166193 >> v2:172.21.15.146:3300/0 conn(0x7f090009dea0 0x7f090009e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.648+0000 7f09061ec700 1 --2- 172.21.15.146:0/2207166193 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f090006a770 0x7f09001349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.648+0000 7f09061ec700 1 --2- 172.21.15.146:0/2207166193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0900134f00 0x7f090009d960 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.648+0000 7f09061ec700 1 -- 172.21.15.146:0/2207166193 >> 172.21.15.146:0/2207166193 conn(0x7f0900099c40 msgr2=0x7f09000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.648+0000 7f09061ec700 1 -- 172.21.15.146:0/2207166193 shutdown_connections 2023-10-03T10:14:28.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.648+0000 7f09061ec700 1 -- 172.21.15.146:0/2207166193 wait complete. 2023-10-03T10:14:28.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.649+0000 7f09061ec700 1 Processor -- start 2023-10-03T10:14:28.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.649+0000 7f09061ec700 1 -- start start 2023-10-03T10:14:28.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.649+0000 7f09061ec700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f090006a770 0x7f09001340b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.650+0000 7f09061ec700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f090009dea0 0x7f090011aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.650+0000 7f09061ec700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0900134f00 0x7f090011b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.650+0000 7f09061ec700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090009f220 con 0x7f090009dea0 2023-10-03T10:14:28.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.650+0000 7f09061ec700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090011c5d0 con 0x7f0900134f00 2023-10-03T10:14:28.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.650+0000 7f09061ec700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09001390c0 con 0x7f090006a770 2023-10-03T10:14:28.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.650+0000 7f08feffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f090009dea0 0x7f090011aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.650+0000 7f08feffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f090009dea0 0x7f090011aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44144/0 (socket says 172.21.15.146:44144) 2023-10-03T10:14:28.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.650+0000 7f08feffd700 1 -- 172.21.15.146:0/285473432 learned_addr learned my addr 172.21.15.146:0/285473432 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:28.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.650+0000 7f08fffff700 1 --2- 172.21.15.146:0/285473432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0900134f00 0x7f090011b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.650+0000 7f08ff7fe700 1 --2- 172.21.15.146:0/285473432 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f090006a770 0x7f09001340b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.650+0000 7f08fffff700 1 -- 172.21.15.146:0/285473432 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f090006a770 msgr2=0x7f09001340b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.650+0000 7f08fffff700 1 --2- 172.21.15.146:0/285473432 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f090006a770 0x7f09001340b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.650+0000 7f08fffff700 1 -- 172.21.15.146:0/285473432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f090009dea0 msgr2=0x7f090011aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.650+0000 7f08fffff700 1 --2- 172.21.15.146:0/285473432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f090009dea0 0x7f090011aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.650+0000 7f08fffff700 1 -- 172.21.15.146:0/285473432 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f4009550 con 0x7f0900134f00 2023-10-03T10:14:28.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.650+0000 7f08fffff700 1 --2- 172.21.15.146:0/285473432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0900134f00 0x7f090011b000 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f08f800efc0 tx=0x7f08f800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.651+0000 7f08e7fff700 1 -- 172.21.15.146:0/285473432 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f800cc90 con 0x7f0900134f00 2023-10-03T10:14:28.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.651+0000 7f08e7fff700 1 -- 172.21.15.146:0/285473432 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f800f040 con 0x7f0900134f00 2023-10-03T10:14:28.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.651+0000 7f08e7fff700 1 -- 172.21.15.146:0/285473432 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f80146c0 con 0x7f0900134f00 2023-10-03T10:14:28.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.651+0000 7f09061ec700 1 -- 172.21.15.146:0/285473432 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0900139380 con 0x7f0900134f00 2023-10-03T10:14:28.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.651+0000 7f09061ec700 1 -- 172.21.15.146:0/285473432 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0900139b60 con 0x7f0900134f00 2023-10-03T10:14:28.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.652+0000 7f08e7fff700 1 -- 172.21.15.146:0/285473432 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f08f8014820 con 0x7f0900134f00 2023-10-03T10:14:28.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.652+0000 7f09061ec700 1 -- 172.21.15.146:0/285473432 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090004f2a0 con 0x7f0900134f00 2023-10-03T10:14:28.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.652+0000 7f08e7fff700 1 -- 172.21.15.146:0/285473432 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f08f8040270 con 0x7f0900134f00 2023-10-03T10:14:28.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.661+0000 7f08e7fff700 1 -- 172.21.15.146:0/285473432 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f08f8014ad0 con 0x7f0900134f00 2023-10-03T10:14:28.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.686+0000 7f2c76472700 1 Processor -- start 2023-10-03T10:14:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.686+0000 7f2c76472700 1 -- start start 2023-10-03T10:14:28.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.686+0000 7f2c76472700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c7009e870 0x7f2c7009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.686+0000 7f2c76472700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c7009f180 0x7f2c70131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.686+0000 7f2c76472700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2c70131d70 0x7f2c70132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.686+0000 7f2c76472700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c700a0920 con 0x7f2c70131d70 2023-10-03T10:14:28.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.686+0000 7f2c76472700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7009c970 con 0x7f2c7009f180 2023-10-03T10:14:28.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.686+0000 7f2c76472700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7009bab0 con 0x7f2c7009e870 2023-10-03T10:14:28.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.687+0000 7f2c74a0f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2c70131d70 0x7f2c70132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.687+0000 7f2c74a0f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2c70131d70 0x7f2c70132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44154/0 (socket says 172.21.15.146:44154) 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.687+0000 7f2c74a0f700 1 -- 172.21.15.146:0/1911289349 learned_addr learned my addr 172.21.15.146:0/1911289349 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.687+0000 7f2c6ffff700 1 --2- 172.21.15.146:0/1911289349 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c7009e870 0x7f2c7009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.687+0000 7f2c74a0f700 1 -- 172.21.15.146:0/1911289349 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c7009e870 msgr2=0x7f2c7009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.687+0000 7f2c74a0f700 1 --2- 172.21.15.146:0/1911289349 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c7009e870 0x7f2c7009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.687+0000 7f2c74a0f700 1 -- 172.21.15.146:0/1911289349 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c7009f180 msgr2=0x7f2c70131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.687+0000 7f2c74a0f700 1 --2- 172.21.15.146:0/1911289349 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c7009f180 0x7f2c70131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.687+0000 7f2c74a0f700 1 -- 172.21.15.146:0/1911289349 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7009f9c0 con 0x7f2c70131d70 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.687+0000 7f2c74a0f700 1 --2- 172.21.15.146:0/1911289349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c70131d70 0x7f2c70132210 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2c68009eb0 tx=0x7f2c6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1c28667ed2ee3f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.687+0000 7f2c6effd700 1 -- 172.21.15.146:0/1911289349 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68003c20 con 0x7f2c70131d70 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.687+0000 7f2c6effd700 1 -- 172.21.15.146:0/1911289349 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c68003d80 con 0x7f2c70131d70 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.687+0000 7f2c6effd700 1 -- 172.21.15.146:0/1911289349 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6800bab0 con 0x7f2c70131d70 2023-10-03T10:14:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.688+0000 7f2c76472700 1 -- 172.21.15.146:0/1911289349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c70131d70 msgr2=0x7f2c70132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.688+0000 7f2c76472700 1 --2- 172.21.15.146:0/1911289349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c70131d70 0x7f2c70132210 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2c68009eb0 tx=0x7f2c6800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.688+0000 7f2c76472700 1 -- 172.21.15.146:0/1911289349 shutdown_connections 2023-10-03T10:14:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.688+0000 7f2c76472700 1 --2- 172.21.15.146:0/1911289349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c70131d70 0x7f2c70132210 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.688+0000 7f2c76472700 1 --2- 172.21.15.146:0/1911289349 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c7009e870 0x7f2c7009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.688+0000 7f2c76472700 1 --2- 172.21.15.146:0/1911289349 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c7009f180 0x7f2c70131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.688+0000 7f2c76472700 1 -- 172.21.15.146:0/1911289349 >> 172.21.15.146:0/1911289349 conn(0x7f2c700a4430 msgr2=0x7f2c700a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.689+0000 7f2c76472700 1 -- 172.21.15.146:0/1911289349 shutdown_connections 2023-10-03T10:14:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.689+0000 7f2c76472700 1 -- 172.21.15.146:0/1911289349 wait complete. 2023-10-03T10:14:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.689+0000 7f163aea7700 1 Processor -- start 2023-10-03T10:14:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.689+0000 7f163aea7700 1 -- start start 2023-10-03T10:14:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.690+0000 7f2c76472700 1 Processor -- start 2023-10-03T10:14:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.690+0000 7f2c76472700 1 -- start start 2023-10-03T10:14:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.690+0000 7f163aea7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f163409e870 0x7f163409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.690+0000 7f163aea7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f163409f180 0x7f1634131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.690+0000 7f163aea7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1634131d70 0x7f1634132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f2c76472700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c7009e870 0x7f2c701302e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f2c76472700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c7009f180 0x7f2c7011cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f2c76472700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c70131d70 0x7f2c7011d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f2c76472700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c70120a10 con 0x7f2c7009e870 2023-10-03T10:14:28.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f2c76472700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c701201a0 con 0x7f2c70131d70 2023-10-03T10:14:28.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f2c76472700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7011fd50 con 0x7f2c7009f180 2023-10-03T10:14:28.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f2c74a0f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c70131d70 0x7f2c7011d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f2c74a0f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c70131d70 0x7f2c7011d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42180/0 (socket says 172.21.15.146:42180) 2023-10-03T10:14:28.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f2c74a0f700 1 -- 172.21.15.146:0/1676338189 learned_addr learned my addr 172.21.15.146:0/1676338189 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:28.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f2c6ffff700 1 --2- 172.21.15.146:0/1676338189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c7009e870 0x7f2c701302e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f2c6f7fe700 1 --2- 172.21.15.146:0/1676338189 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c7009f180 0x7f2c7011cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.690+0000 7f163aea7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16340a0920 con 0x7f163409f180 2023-10-03T10:14:28.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.690+0000 7f163aea7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163409c970 con 0x7f163409e870 2023-10-03T10:14:28.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.690+0000 7f163aea7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f163409bab0 con 0x7f1634131d70 2023-10-03T10:14:28.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.690+0000 7f1639444700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1634131d70 0x7f1634132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.690+0000 7f1639444700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1634131d70 0x7f1634132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:50190/0 (socket says 172.21.15.146:50190) 2023-10-03T10:14:28.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.690+0000 7f1638c43700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f163409e870 0x7f163409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.690+0000 7f1639444700 1 -- 172.21.15.146:0/1099082599 learned_addr learned my addr 172.21.15.146:0/1099082599 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:28.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.690+0000 7f1633fff700 1 --2- 172.21.15.146:0/1099082599 >> v2:172.21.15.146:3300/0 conn(0x7f163409f180 0x7f1634131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f1633fff700 1 -- 172.21.15.146:0/1099082599 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1634131d70 msgr2=0x7f1634132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f1633fff700 1 --2- 172.21.15.146:0/1099082599 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1634131d70 0x7f1634132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f1633fff700 1 -- 172.21.15.146:0/1099082599 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f163409e870 msgr2=0x7f163409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f1633fff700 1 --2- 172.21.15.146:0/1099082599 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f163409e870 0x7f163409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f1633fff700 1 -- 172.21.15.146:0/1099082599 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163409f9c0 con 0x7f163409f180 2023-10-03T10:14:28.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f1633fff700 1 --2- 172.21.15.146:0/1099082599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f163409f180 0x7f1634131830 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1620013180 tx=0x7f1620013490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9db571e16fee837 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f2c74a0f700 1 -- 172.21.15.146:0/1676338189 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c7009f180 msgr2=0x7f2c7011cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f2c74a0f700 1 --2- 172.21.15.146:0/1676338189 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c7009f180 0x7f2c7011cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f2c74a0f700 1 -- 172.21.15.146:0/1676338189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c7009e870 msgr2=0x7f2c701302e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f2c74a0f700 1 --2- 172.21.15.146:0/1676338189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c7009e870 0x7f2c701302e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f2c74a0f700 1 -- 172.21.15.146:0/1676338189 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c68009b30 con 0x7f2c70131d70 2023-10-03T10:14:28.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f16337fe700 1 -- 172.21.15.146:0/1099082599 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1620016070 con 0x7f163409f180 2023-10-03T10:14:28.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f16337fe700 1 -- 172.21.15.146:0/1099082599 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1620013d00 con 0x7f163409f180 2023-10-03T10:14:28.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f16337fe700 1 -- 172.21.15.146:0/1099082599 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16200112d0 con 0x7f163409f180 2023-10-03T10:14:28.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f2c6ffff700 1 --2- 172.21.15.146:0/1676338189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c7009e870 0x7f2c701302e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:28.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.691+0000 7f2c74a0f700 1 --2- 172.21.15.146:0/1676338189 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c70131d70 0x7f2c7011d4c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2c7009c870 tx=0x7f2c68004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.692+0000 7f2c6cff9700 1 -- 172.21.15.146:0/1676338189 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6800bca0 con 0x7f2c70131d70 2023-10-03T10:14:28.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.692+0000 7f2c6cff9700 1 -- 172.21.15.146:0/1676338189 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6800be00 con 0x7f2c70131d70 2023-10-03T10:14:28.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.692+0000 7f2c6cff9700 1 -- 172.21.15.146:0/1676338189 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6800d2f0 con 0x7f2c70131d70 2023-10-03T10:14:28.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.692+0000 7f2c76472700 1 -- 172.21.15.146:0/1676338189 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c70121340 con 0x7f2c70131d70 2023-10-03T10:14:28.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.692+0000 7f2c76472700 1 -- 172.21.15.146:0/1676338189 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c700a2a90 con 0x7f2c70131d70 2023-10-03T10:14:28.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.692+0000 7f163aea7700 1 -- 172.21.15.146:0/1099082599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f163409f180 msgr2=0x7f1634131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.692+0000 7f163aea7700 1 --2- 172.21.15.146:0/1099082599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f163409f180 0x7f1634131830 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1620013180 tx=0x7f1620013490 comp rx=0 tx=0).stop 2023-10-03T10:14:28.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.693+0000 7f2c76472700 1 -- 172.21.15.146:0/1676338189 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c7004f2a0 con 0x7f2c70131d70 2023-10-03T10:14:28.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.693+0000 7f163aea7700 1 -- 172.21.15.146:0/1099082599 shutdown_connections 2023-10-03T10:14:28.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.693+0000 7f163aea7700 1 --2- 172.21.15.146:0/1099082599 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f163409e870 0x7f163409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.693+0000 7f163aea7700 1 --2- 172.21.15.146:0/1099082599 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1634131d70 0x7f1634132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.693+0000 7f163aea7700 1 --2- 172.21.15.146:0/1099082599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f163409f180 0x7f1634131830 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.693+0000 7f163aea7700 1 -- 172.21.15.146:0/1099082599 >> 172.21.15.146:0/1099082599 conn(0x7f16340a4430 msgr2=0x7f16340a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.693+0000 7f163aea7700 1 -- 172.21.15.146:0/1099082599 shutdown_connections 2023-10-03T10:14:28.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.693+0000 7f2c6cff9700 1 -- 172.21.15.146:0/1676338189 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c6800d450 con 0x7f2c70131d70 2023-10-03T10:14:28.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.693+0000 7f163aea7700 1 -- 172.21.15.146:0/1099082599 wait complete. 2023-10-03T10:14:28.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.693+0000 7f2c6cff9700 1 -- 172.21.15.146:0/1676338189 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2c680406c0 con 0x7f2c70131d70 2023-10-03T10:14:28.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.694+0000 7f163aea7700 1 Processor -- start 2023-10-03T10:14:28.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.694+0000 7f163aea7700 1 -- start start 2023-10-03T10:14:28.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.695+0000 7f163aea7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f163409e870 0x7f163411c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.695+0000 7f163aea7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f163409f180 0x7f163411c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.695+0000 7f163aea7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1634131d70 0x7f163411cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.695+0000 7f163aea7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163411dc60 con 0x7f163409f180 2023-10-03T10:14:28.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.695+0000 7f163aea7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163411eeb0 con 0x7f1634131d70 2023-10-03T10:14:28.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.695+0000 7f163aea7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f163411e240 con 0x7f163409e870 2023-10-03T10:14:28.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.695+0000 7f1639444700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1634131d70 0x7f163411cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.695+0000 7f1639444700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1634131d70 0x7f163411cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42184/0 (socket says 172.21.15.146:42184) 2023-10-03T10:14:28.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.695+0000 7f1639444700 1 -- 172.21.15.146:0/1247138647 learned_addr learned my addr 172.21.15.146:0/1247138647 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:28.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.696+0000 7f1638c43700 1 --2- 172.21.15.146:0/1247138647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f163409e870 0x7f163411c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.696+0000 7f1639444700 1 -- 172.21.15.146:0/1247138647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f163409e870 msgr2=0x7f163411c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.696+0000 7f1639444700 1 --2- 172.21.15.146:0/1247138647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f163409e870 0x7f163411c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.696+0000 7f1639444700 1 -- 172.21.15.146:0/1247138647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f163409f180 msgr2=0x7f163411c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.696+0000 7f1639444700 1 --2- 172.21.15.146:0/1247138647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f163409f180 0x7f163411c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.696+0000 7f1639444700 1 -- 172.21.15.146:0/1247138647 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1620011d40 con 0x7f1634131d70 2023-10-03T10:14:28.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.696+0000 7f1639444700 1 --2- 172.21.15.146:0/1247138647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1634131d70 0x7f163411cad0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f162c008560 tx=0x7f162c008870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.702+0000 7f16317fa700 1 -- 172.21.15.146:0/1247138647 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c00d4e0 con 0x7f1634131d70 2023-10-03T10:14:28.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.702+0000 7f163aea7700 1 -- 172.21.15.146:0/1247138647 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f163411f890 con 0x7f1634131d70 2023-10-03T10:14:28.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.702+0000 7f2c6cff9700 1 -- 172.21.15.146:0/1676338189 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c6801e340 con 0x7f2c70131d70 2023-10-03T10:14:28.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.702+0000 7f163aea7700 1 -- 172.21.15.146:0/1247138647 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16340a0210 con 0x7f1634131d70 2023-10-03T10:14:28.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.702+0000 7f16317fa700 1 -- 172.21.15.146:0/1247138647 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162c00d640 con 0x7f1634131d70 2023-10-03T10:14:28.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.702+0000 7f16317fa700 1 -- 172.21.15.146:0/1247138647 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c003c60 con 0x7f1634131d70 2023-10-03T10:14:28.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.703+0000 7f163aea7700 1 -- 172.21.15.146:0/1247138647 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16140052e0 con 0x7f1634131d70 2023-10-03T10:14:28.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.703+0000 7f16317fa700 1 -- 172.21.15.146:0/1247138647 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f162c00b800 con 0x7f1634131d70 2023-10-03T10:14:28.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.703+0000 7f16317fa700 1 -- 172.21.15.146:0/1247138647 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f162c040080 con 0x7f1634131d70 2023-10-03T10:14:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.712+0000 7f16317fa700 1 -- 172.21.15.146:0/1247138647 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f162c0045b0 con 0x7f1634131d70 2023-10-03T10:14:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.734+0000 7ffaa79aa700 1 Processor -- start 2023-10-03T10:14:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.735+0000 7ffaa79aa700 1 -- start start 2023-10-03T10:14:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.735+0000 7ffaa79aa700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffaa009e870 0x7ffaa009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.735+0000 7ffaa79aa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa009f180 0x7ffaa0131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.735+0000 7ffaa79aa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffaa0131d70 0x7ffaa01321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.735+0000 7ffaa79aa700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa00a0920 con 0x7ffaa009e870 2023-10-03T10:14:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.735+0000 7ffaa79aa700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa009c970 con 0x7ffaa009f180 2023-10-03T10:14:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.735+0000 7ffaa79aa700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa009bab0 con 0x7ffaa0131d70 2023-10-03T10:14:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.736+0000 7ffaa5746700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffaa009e870 0x7ffaa009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.736+0000 7ffaa5746700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffaa009e870 0x7ffaa009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44196/0 (socket says 172.21.15.146:44196) 2023-10-03T10:14:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.736+0000 7ffaa5746700 1 -- 172.21.15.146:0/4110880746 learned_addr learned my addr 172.21.15.146:0/4110880746 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.736+0000 7ffaa5f47700 1 --2- 172.21.15.146:0/4110880746 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffaa0131d70 0x7ffaa01321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.736+0000 7ffaa4f45700 1 --2- 172.21.15.146:0/4110880746 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa009f180 0x7ffaa0131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.736+0000 7ffaa5746700 1 -- 172.21.15.146:0/4110880746 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffaa0131d70 msgr2=0x7ffaa01321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.736+0000 7ffaa5746700 1 --2- 172.21.15.146:0/4110880746 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffaa0131d70 0x7ffaa01321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.736+0000 7ffaa5746700 1 -- 172.21.15.146:0/4110880746 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa009f180 msgr2=0x7ffaa0131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.736+0000 7ffaa5746700 1 --2- 172.21.15.146:0/4110880746 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa009f180 0x7ffaa0131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.736+0000 7ffaa5746700 1 -- 172.21.15.146:0/4110880746 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa009f9c0 con 0x7ffaa009e870 2023-10-03T10:14:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.736+0000 7ffaa5746700 1 --2- 172.21.15.146:0/4110880746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa009e870 0x7ffaa009ec40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009920 tx=0x7ffa9c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cfd6d69f0413ace server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.736+0000 7ffa97fff700 1 -- 172.21.15.146:0/4110880746 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c011830 con 0x7ffaa009e870 2023-10-03T10:14:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.736+0000 7ffa97fff700 1 -- 172.21.15.146:0/4110880746 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c011990 con 0x7ffaa009e870 2023-10-03T10:14:28.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.736+0000 7ffa97fff700 1 -- 172.21.15.146:0/4110880746 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c011d20 con 0x7ffaa009e870 2023-10-03T10:14:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.737+0000 7ffaa79aa700 1 -- 172.21.15.146:0/4110880746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa009e870 msgr2=0x7ffaa009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.737+0000 7ffaa79aa700 1 --2- 172.21.15.146:0/4110880746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa009e870 0x7ffaa009ec40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009920 tx=0x7ffa9c009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.737+0000 7ffaa79aa700 1 -- 172.21.15.146:0/4110880746 shutdown_connections 2023-10-03T10:14:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.737+0000 7ffaa79aa700 1 --2- 172.21.15.146:0/4110880746 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffaa0131d70 0x7ffaa01321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.737+0000 7ffaa79aa700 1 --2- 172.21.15.146:0/4110880746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa009e870 0x7ffaa009ec40 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.737+0000 7ffaa79aa700 1 --2- 172.21.15.146:0/4110880746 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa009f180 0x7ffaa0131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.737+0000 7ffaa79aa700 1 -- 172.21.15.146:0/4110880746 >> 172.21.15.146:0/4110880746 conn(0x7ffaa00a4430 msgr2=0x7ffaa00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.737+0000 7ffaa79aa700 1 -- 172.21.15.146:0/4110880746 shutdown_connections 2023-10-03T10:14:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.737+0000 7ffaa79aa700 1 -- 172.21.15.146:0/4110880746 wait complete. 2023-10-03T10:14:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.739+0000 7ffaa79aa700 1 Processor -- start 2023-10-03T10:14:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.739+0000 7ffaa79aa700 1 -- start start 2023-10-03T10:14:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.739+0000 7ffaa79aa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa009e870 0x7ffaa01c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.739+0000 7ffaa79aa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa009f180 0x7ffaa01c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.739+0000 7ffaa79aa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffaa0131d70 0x7ffaa01c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.739+0000 7ffaa79aa700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa01217c0 con 0x7ffaa009f180 2023-10-03T10:14:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.739+0000 7ffaa79aa700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa006d4c0 con 0x7ffaa009e870 2023-10-03T10:14:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.739+0000 7ffaa79aa700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa009dba0 con 0x7ffaa0131d70 2023-10-03T10:14:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.739+0000 7ffaa5746700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa009e870 0x7ffaa01c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.739+0000 7ffaa5746700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa009e870 0x7ffaa01c82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42206/0 (socket says 172.21.15.146:42206) 2023-10-03T10:14:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.740+0000 7ffaa5746700 1 -- 172.21.15.146:0/2689956740 learned_addr learned my addr 172.21.15.146:0/2689956740 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:28.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.740+0000 7ffaa4f45700 1 --2- 172.21.15.146:0/2689956740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa009f180 0x7ffaa01c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.740+0000 7ffaa5f47700 1 --2- 172.21.15.146:0/2689956740 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffaa0131d70 0x7ffaa01c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.740+0000 7ffaa4f45700 1 -- 172.21.15.146:0/2689956740 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffaa0131d70 msgr2=0x7ffaa01c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.740+0000 7ffaa4f45700 1 --2- 172.21.15.146:0/2689956740 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffaa0131d70 0x7ffaa01c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.740+0000 7ffaa4f45700 1 -- 172.21.15.146:0/2689956740 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa009e870 msgr2=0x7ffaa01c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.740+0000 7ffaa4f45700 1 --2- 172.21.15.146:0/2689956740 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa009e870 0x7ffaa01c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.740+0000 7ffaa4f45700 1 -- 172.21.15.146:0/2689956740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c009550 con 0x7ffaa009f180 2023-10-03T10:14:28.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.740+0000 7ffaa4f45700 1 --2- 172.21.15.146:0/2689956740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa009f180 0x7ffaa01c8800 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000e870 tx=0x7ffa9000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.740+0000 7ffa95ffb700 1 -- 172.21.15.146:0/2689956740 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa90013680 con 0x7ffaa009f180 2023-10-03T10:14:28.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.740+0000 7ffa95ffb700 1 -- 172.21.15.146:0/2689956740 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa900137e0 con 0x7ffaa009f180 2023-10-03T10:14:28.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.740+0000 7ffaa79aa700 1 -- 172.21.15.146:0/2689956740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa0120f80 con 0x7ffaa009f180 2023-10-03T10:14:28.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.740+0000 7ffa95ffb700 1 -- 172.21.15.146:0/2689956740 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa90013b50 con 0x7ffaa009f180 2023-10-03T10:14:28.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.741+0000 7ffaa79aa700 1 -- 172.21.15.146:0/2689956740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa01316c0 con 0x7ffaa009f180 2023-10-03T10:14:28.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.742+0000 7ffaa79aa700 1 -- 172.21.15.146:0/2689956740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa004f2a0 con 0x7ffaa009f180 2023-10-03T10:14:28.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.742+0000 7ffa95ffb700 1 -- 172.21.15.146:0/2689956740 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa90013cb0 con 0x7ffaa009f180 2023-10-03T10:14:28.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.742+0000 7ffa95ffb700 1 -- 172.21.15.146:0/2689956740 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffa9003fa80 con 0x7ffaa009f180 2023-10-03T10:14:28.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.747+0000 7ffa95ffb700 1 -- 172.21.15.146:0/2689956740 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa9001adc0 con 0x7ffaa009f180 2023-10-03T10:14:28.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.862+0000 7f09061ec700 1 -- 172.21.15.146:0/285473432 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0900139570 con 0x7f0900134f00 2023-10-03T10:14:28.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.863+0000 7f08e7fff700 1 -- 172.21.15.146:0/285473432 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f08f8007330 con 0x7f0900134f00 2023-10-03T10:14:28.863 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:28.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.865+0000 7f09061ec700 1 -- 172.21.15.146:0/285473432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0900134f00 msgr2=0x7f090011b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.865+0000 7f09061ec700 1 --2- 172.21.15.146:0/285473432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0900134f00 0x7f090011b000 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f08f800efc0 tx=0x7f08f800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.865+0000 7f09061ec700 1 -- 172.21.15.146:0/285473432 shutdown_connections 2023-10-03T10:14:28.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.865+0000 7f09061ec700 1 --2- 172.21.15.146:0/285473432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0900134f00 0x7f090011b000 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.865+0000 7f09061ec700 1 --2- 172.21.15.146:0/285473432 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f090006a770 0x7f09001340b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.865+0000 7f09061ec700 1 --2- 172.21.15.146:0/285473432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f090009dea0 0x7f090011aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.865+0000 7f09061ec700 1 -- 172.21.15.146:0/285473432 >> 172.21.15.146:0/285473432 conn(0x7f0900099c40 msgr2=0x7f090009c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.865+0000 7f09061ec700 1 -- 172.21.15.146:0/285473432 shutdown_connections 2023-10-03T10:14:28.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.865+0000 7f09061ec700 1 -- 172.21.15.146:0/285473432 wait complete. 2023-10-03T10:14:28.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.903+0000 7f2c76472700 1 -- 172.21.15.146:0/1676338189 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2c7009f660 con 0x7f2c70131d70 2023-10-03T10:14:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.903+0000 7f2c6cff9700 1 -- 172.21.15.146:0/1676338189 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2c68028b50 con 0x7f2c70131d70 2023-10-03T10:14:28.904 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.906+0000 7f2c76472700 1 -- 172.21.15.146:0/1676338189 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c70131d70 msgr2=0x7f2c7011d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.906+0000 7f2c76472700 1 --2- 172.21.15.146:0/1676338189 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c70131d70 0x7f2c7011d4c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2c7009c870 tx=0x7f2c68004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.906+0000 7f2c76472700 1 -- 172.21.15.146:0/1676338189 shutdown_connections 2023-10-03T10:14:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.906+0000 7f2c76472700 1 --2- 172.21.15.146:0/1676338189 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c70131d70 0x7f2c7011d4c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.906+0000 7f2c76472700 1 --2- 172.21.15.146:0/1676338189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c7009e870 0x7f2c701302e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.906+0000 7f2c76472700 1 --2- 172.21.15.146:0/1676338189 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c7009f180 0x7f2c7011cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.906+0000 7f2c76472700 1 -- 172.21.15.146:0/1676338189 >> 172.21.15.146:0/1676338189 conn(0x7f2c700a4430 msgr2=0x7f2c7006d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.906+0000 7f2c76472700 1 -- 172.21.15.146:0/1676338189 shutdown_connections 2023-10-03T10:14:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.906+0000 7f2c76472700 1 -- 172.21.15.146:0/1676338189 wait complete. 2023-10-03T10:14:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.909+0000 7f163aea7700 1 -- 172.21.15.146:0/1247138647 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1614005590 con 0x7f1634131d70 2023-10-03T10:14:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.909+0000 7f16317fa700 1 -- 172.21.15.146:0/1247138647 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f162c0045b0 con 0x7f1634131d70 2023-10-03T10:14:28.910 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.911+0000 7f163aea7700 1 -- 172.21.15.146:0/1247138647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1634131d70 msgr2=0x7f163411cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.911+0000 7f163aea7700 1 --2- 172.21.15.146:0/1247138647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1634131d70 0x7f163411cad0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f162c008560 tx=0x7f162c008870 comp rx=0 tx=0).stop 2023-10-03T10:14:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.911+0000 7f163aea7700 1 -- 172.21.15.146:0/1247138647 shutdown_connections 2023-10-03T10:14:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.911+0000 7f163aea7700 1 --2- 172.21.15.146:0/1247138647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1634131d70 0x7f163411cad0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.911+0000 7f163aea7700 1 --2- 172.21.15.146:0/1247138647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f163409e870 0x7f163411c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.911+0000 7f163aea7700 1 --2- 172.21.15.146:0/1247138647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f163409f180 0x7f163411c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.911+0000 7f163aea7700 1 -- 172.21.15.146:0/1247138647 >> 172.21.15.146:0/1247138647 conn(0x7f16340a4430 msgr2=0x7f1634130f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.911+0000 7f163aea7700 1 -- 172.21.15.146:0/1247138647 shutdown_connections 2023-10-03T10:14:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.911+0000 7f163aea7700 1 -- 172.21.15.146:0/1247138647 wait complete. 2023-10-03T10:14:28.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:28.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:28.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.942+0000 7ffaa79aa700 1 -- 172.21.15.146:0/2689956740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffaa006b2a0 con 0x7ffaa009f180 2023-10-03T10:14:28.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.943+0000 7ffa95ffb700 1 -- 172.21.15.146:0/2689956740 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa90021070 con 0x7ffaa009f180 2023-10-03T10:14:28.944 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:28.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.945+0000 7ffaa79aa700 1 -- 172.21.15.146:0/2689956740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa009f180 msgr2=0x7ffaa01c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.945+0000 7ffaa79aa700 1 --2- 172.21.15.146:0/2689956740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa009f180 0x7ffaa01c8800 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000e870 tx=0x7ffa9000eb80 comp rx=0 tx=0).stop 2023-10-03T10:14:28.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.945+0000 7ffaa79aa700 1 -- 172.21.15.146:0/2689956740 shutdown_connections 2023-10-03T10:14:28.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.945+0000 7ffaa79aa700 1 --2- 172.21.15.146:0/2689956740 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffaa0131d70 0x7ffaa01c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.945+0000 7ffaa79aa700 1 --2- 172.21.15.146:0/2689956740 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa009e870 0x7ffaa01c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.945+0000 7ffaa79aa700 1 --2- 172.21.15.146:0/2689956740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa009f180 0x7ffaa01c8800 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.945+0000 7ffaa79aa700 1 -- 172.21.15.146:0/2689956740 >> 172.21.15.146:0/2689956740 conn(0x7ffaa00a4430 msgr2=0x7ffaa009cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.945+0000 7ffaa79aa700 1 -- 172.21.15.146:0/2689956740 shutdown_connections 2023-10-03T10:14:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:28.945+0000 7ffaa79aa700 1 -- 172.21.15.146:0/2689956740 wait complete. 2023-10-03T10:14:28.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:29.879 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:29.921 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:29.926 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:29.958 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:30.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.030+0000 7fc9b0968700 1 Processor -- start 2023-10-03T10:14:30.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.030+0000 7fc9b0968700 1 -- start start 2023-10-03T10:14:30.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.031+0000 7fc9b0968700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9ac133ad0 0x7fc9ac133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.031+0000 7fc9b0968700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc9ac1300a0 0x7fc9ac1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.031+0000 7fc9b0968700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9ac1309f0 0x7fc9ac13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.031+0000 7fc9b0968700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ac06b2d0 con 0x7fc9ac1300a0 2023-10-03T10:14:30.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.031+0000 7fc9b0968700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac133610 con 0x7fc9ac1309f0 2023-10-03T10:14:30.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.031+0000 7fc9b0968700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac09a500 con 0x7fc9ac133ad0 2023-10-03T10:14:30.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.031+0000 7fc9aa59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9ac133ad0 0x7fc9ac133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.031+0000 7fc9aa59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9ac133ad0 0x7fc9ac133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:50230/0 (socket says 172.21.15.146:50230) 2023-10-03T10:14:30.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.031+0000 7fc9aa59c700 1 -- 172.21.15.146:0/3608066356 learned_addr learned my addr 172.21.15.146:0/3608066356 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:30.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.031+0000 7fc9aad9d700 1 --2- 172.21.15.146:0/3608066356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9ac1309f0 0x7fc9ac13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.031+0000 7fc9a9d9b700 1 --2- 172.21.15.146:0/3608066356 >> v2:172.21.15.146:3300/0 conn(0x7fc9ac1300a0 0x7fc9ac1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.031+0000 7fc9aa59c700 1 -- 172.21.15.146:0/3608066356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9ac1309f0 msgr2=0x7fc9ac13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:30.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.031+0000 7fc9aa59c700 1 --2- 172.21.15.146:0/3608066356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9ac1309f0 0x7fc9ac13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.031+0000 7fc9aa59c700 1 -- 172.21.15.146:0/3608066356 >> v2:172.21.15.146:3300/0 conn(0x7fc9ac1300a0 msgr2=0x7fc9ac1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:30.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.031+0000 7fc9aa59c700 1 --2- 172.21.15.146:0/3608066356 >> v2:172.21.15.146:3300/0 conn(0x7fc9ac1300a0 0x7fc9ac1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.031+0000 7fc9aa59c700 1 -- 172.21.15.146:0/3608066356 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ac1338b0 con 0x7fc9ac133ad0 2023-10-03T10:14:30.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.031+0000 7fc9a9d9b700 1 --2- 172.21.15.146:0/3608066356 >> v2:172.21.15.146:3300/0 conn(0x7fc9ac1300a0 0x7fc9ac1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:30.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.032+0000 7fc9aa59c700 1 --2- 172.21.15.146:0/3608066356 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9ac133ad0 0x7fc9ac133ea0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc99c0098f0 tx=0x7fc99c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bbd91e2e674a8e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.032+0000 7fc9a959a700 1 -- 172.21.15.146:0/3608066356 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c011830 con 0x7fc9ac133ad0 2023-10-03T10:14:30.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.032+0000 7fc9a959a700 1 -- 172.21.15.146:0/3608066356 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99c011990 con 0x7fc9ac133ad0 2023-10-03T10:14:30.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.032+0000 7fc9a959a700 1 -- 172.21.15.146:0/3608066356 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c011d20 con 0x7fc9ac133ad0 2023-10-03T10:14:30.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.033+0000 7fc9b0968700 1 -- 172.21.15.146:0/3608066356 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9ac133ad0 msgr2=0x7fc9ac133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.033+0000 7fc9b0968700 1 --2- 172.21.15.146:0/3608066356 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9ac133ad0 0x7fc9ac133ea0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc99c0098f0 tx=0x7fc99c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:30.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.033+0000 7fc9b0968700 1 -- 172.21.15.146:0/3608066356 shutdown_connections 2023-10-03T10:14:30.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.033+0000 7fc9b0968700 1 --2- 172.21.15.146:0/3608066356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9ac1309f0 0x7fc9ac13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.033+0000 7fc9b0968700 1 --2- 172.21.15.146:0/3608066356 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9ac133ad0 0x7fc9ac133ea0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.033+0000 7fc9b0968700 1 --2- 172.21.15.146:0/3608066356 >> v2:172.21.15.146:3300/0 conn(0x7fc9ac1300a0 0x7fc9ac1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.033+0000 7fc9b0968700 1 -- 172.21.15.146:0/3608066356 >> 172.21.15.146:0/3608066356 conn(0x7fc9ac099c40 msgr2=0x7fc9ac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.033+0000 7fc9b0968700 1 -- 172.21.15.146:0/3608066356 shutdown_connections 2023-10-03T10:14:30.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.033+0000 7fc9b0968700 1 -- 172.21.15.146:0/3608066356 wait complete. 2023-10-03T10:14:30.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.034+0000 7fc9b0968700 1 Processor -- start 2023-10-03T10:14:30.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.035+0000 7fc9b0968700 1 -- start start 2023-10-03T10:14:30.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.035+0000 7fc9b0968700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9ac1300a0 0x7fc9ac071360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.035+0000 7fc9b0968700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9ac1309f0 0x7fc9ac0718a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.035+0000 7fc9b0968700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9ac133ad0 0x7fc9ac071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.035+0000 7fc9b0968700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac11eeb0 con 0x7fc9ac1309f0 2023-10-03T10:14:30.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.035+0000 7fc9b0968700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac11fef0 con 0x7fc9ac133ad0 2023-10-03T10:14:30.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.035+0000 7fc9b0968700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac11f9e0 con 0x7fc9ac1300a0 2023-10-03T10:14:30.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.035+0000 7fc9aad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9ac133ad0 0x7fc9ac071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.036+0000 7fc9aad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9ac133ad0 0x7fc9ac071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42212/0 (socket says 172.21.15.146:42212) 2023-10-03T10:14:30.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.036+0000 7fc9aad9d700 1 -- 172.21.15.146:0/617638980 learned_addr learned my addr 172.21.15.146:0/617638980 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:30.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.036+0000 7fc9aa59c700 1 --2- 172.21.15.146:0/617638980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9ac1300a0 0x7fc9ac071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.036+0000 7fc9a9d9b700 1 --2- 172.21.15.146:0/617638980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9ac1309f0 0x7fc9ac0718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.036+0000 7fc9aad9d700 1 -- 172.21.15.146:0/617638980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9ac1300a0 msgr2=0x7fc9ac071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.036+0000 7fc9aad9d700 1 --2- 172.21.15.146:0/617638980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9ac1300a0 0x7fc9ac071360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.036+0000 7fc9aad9d700 1 -- 172.21.15.146:0/617638980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9ac1309f0 msgr2=0x7fc9ac0718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.036+0000 7fc9aad9d700 1 --2- 172.21.15.146:0/617638980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9ac1309f0 0x7fc9ac0718a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.036+0000 7fc9aad9d700 1 -- 172.21.15.146:0/617638980 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a00094a0 con 0x7fc9ac133ad0 2023-10-03T10:14:30.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.036+0000 7fc9aa59c700 1 --2- 172.21.15.146:0/617638980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9ac1300a0 0x7fc9ac071360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:30.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.036+0000 7fc9a9d9b700 1 --2- 172.21.15.146:0/617638980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9ac1309f0 0x7fc9ac0718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:30.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.036+0000 7fc9aad9d700 1 --2- 172.21.15.146:0/617638980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9ac133ad0 0x7fc9ac071de0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009dd0 tx=0x7fc9a400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.036+0000 7fc99affd700 1 -- 172.21.15.146:0/617638980 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4009c40 con 0x7fc9ac133ad0 2023-10-03T10:14:30.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.036+0000 7fc99affd700 1 -- 172.21.15.146:0/617638980 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a400f040 con 0x7fc9ac133ad0 2023-10-03T10:14:30.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.036+0000 7fc9b0968700 1 -- 172.21.15.146:0/617638980 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99c009550 con 0x7fc9ac133ad0 2023-10-03T10:14:30.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.036+0000 7fc99affd700 1 -- 172.21.15.146:0/617638980 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a400ceb0 con 0x7fc9ac133ad0 2023-10-03T10:14:30.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.037+0000 7fc9b0968700 1 -- 172.21.15.146:0/617638980 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ac0a33e0 con 0x7fc9ac133ad0 2023-10-03T10:14:30.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.037+0000 7fc99affd700 1 -- 172.21.15.146:0/617638980 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc9a4014480 con 0x7fc9ac133ad0 2023-10-03T10:14:30.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.037+0000 7fc99affd700 1 -- 172.21.15.146:0/617638980 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc9a403fe00 con 0x7fc9ac133ad0 2023-10-03T10:14:30.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.038+0000 7fc9b0968700 1 -- 172.21.15.146:0/617638980 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ac12dd60 con 0x7fc9ac133ad0 2023-10-03T10:14:30.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.042+0000 7fc99affd700 1 -- 172.21.15.146:0/617638980 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc9a4018020 con 0x7fc9ac133ad0 2023-10-03T10:14:30.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.080+0000 7fc23ea6d700 1 Processor -- start 2023-10-03T10:14:30.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.080+0000 7fc23ea6d700 1 -- start start 2023-10-03T10:14:30.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.081+0000 7fc23ea6d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2381368e0 0x7fc238138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.081+0000 7fc23ea6d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc238139200 0x7fc23813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.081+0000 7fc23ea6d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23809a760 con 0x7fc238133900 2023-10-03T10:14:30.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.081+0000 7fc23ea6d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2381336e0 con 0x7fc238139200 2023-10-03T10:14:30.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.081+0000 7fc23ea6d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc23809a080 con 0x7fc2381368e0 2023-10-03T10:14:30.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.081+0000 7fc237fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2381368e0 0x7fc238138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.081+0000 7fc237fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2381368e0 0x7fc238138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:50246/0 (socket says 172.21.15.146:50246) 2023-10-03T10:14:30.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.081+0000 7fc237fff700 1 -- 172.21.15.146:0/1641494448 learned_addr learned my addr 172.21.15.146:0/1641494448 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:30.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.081+0000 7fc23d00a700 1 --2- 172.21.15.146:0/1641494448 >> v2:172.21.15.146:3300/0 conn(0x7fc238139200 0x7fc23813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.082+0000 7fc237fff700 1 -- 172.21.15.146:0/1641494448 >> v2:172.21.15.146:3300/0 conn(0x7fc238139200 msgr2=0x7fc23813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:30.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.082+0000 7fc237fff700 1 --2- 172.21.15.146:0/1641494448 >> v2:172.21.15.146:3300/0 conn(0x7fc238139200 0x7fc23813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.082+0000 7fc237fff700 1 -- 172.21.15.146:0/1641494448 >> v1:172.21.15.146:6789/0 conn(0x7fc238133900 legacy=0x7fc238133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:30.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.082+0000 7fc237fff700 1 -- 172.21.15.146:0/1641494448 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2380a23e0 con 0x7fc2381368e0 2023-10-03T10:14:30.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.082+0000 7fc237fff700 1 --2- 172.21.15.146:0/1641494448 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2381368e0 0x7fc238138cc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc2240098f0 tx=0x7fc224009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc88628e09de99bf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.082+0000 7fc2377fe700 1 -- 172.21.15.146:0/1641494448 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc224004230 con 0x7fc2381368e0 2023-10-03T10:14:30.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.082+0000 7fc2377fe700 1 -- 172.21.15.146:0/1641494448 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc224004390 con 0x7fc2381368e0 2023-10-03T10:14:30.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.082+0000 7fc2377fe700 1 -- 172.21.15.146:0/1641494448 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2240036a0 con 0x7fc2381368e0 2023-10-03T10:14:30.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.083+0000 7fc23ea6d700 1 -- 172.21.15.146:0/1641494448 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2381368e0 msgr2=0x7fc238138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.083+0000 7fc23ea6d700 1 --2- 172.21.15.146:0/1641494448 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2381368e0 0x7fc238138cc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc2240098f0 tx=0x7fc224009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:30.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.083+0000 7fc23ea6d700 1 -- 172.21.15.146:0/1641494448 shutdown_connections 2023-10-03T10:14:30.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.083+0000 7fc23ea6d700 1 --2- 172.21.15.146:0/1641494448 >> v2:172.21.15.146:3300/0 conn(0x7fc238139200 0x7fc23813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.083+0000 7fc23ea6d700 1 --2- 172.21.15.146:0/1641494448 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2381368e0 0x7fc238138cc0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.083+0000 7fc23ea6d700 1 -- 172.21.15.146:0/1641494448 >> 172.21.15.146:0/1641494448 conn(0x7fc2380a2980 msgr2=0x7fc2380a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.083+0000 7fc23ea6d700 1 -- 172.21.15.146:0/1641494448 shutdown_connections 2023-10-03T10:14:30.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.083+0000 7fc23ea6d700 1 -- 172.21.15.146:0/1641494448 wait complete. 2023-10-03T10:14:30.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.084+0000 7fc23ea6d700 1 Processor -- start 2023-10-03T10:14:30.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.085+0000 7fc23ea6d700 1 -- start start 2023-10-03T10:14:30.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.085+0000 7fc23ea6d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc238133900 0x7fc238119e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.085+0000 7fc23ea6d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2381368e0 0x7fc23811a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.085+0000 7fc23ea6d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc238139200 0x7fc23811a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.085+0000 7fc23ea6d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23811d110 con 0x7fc238139200 2023-10-03T10:14:30.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.085+0000 7fc23ea6d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23809a2c0 con 0x7fc2381368e0 2023-10-03T10:14:30.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.085+0000 7fc23ea6d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc23811ba30 con 0x7fc238133900 2023-10-03T10:14:30.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.086+0000 7fc23c809700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc238133900 0x7fc238119e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.086+0000 7fc23c809700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc238133900 0x7fc238119e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:50260/0 (socket says 172.21.15.146:50260) 2023-10-03T10:14:30.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.086+0000 7fc23c809700 1 -- 172.21.15.146:0/2137996602 learned_addr learned my addr 172.21.15.146:0/2137996602 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:30.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.086+0000 7fc237fff700 1 --2- 172.21.15.146:0/2137996602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2381368e0 0x7fc23811a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.086+0000 7fc23d00a700 1 --2- 172.21.15.146:0/2137996602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc238139200 0x7fc23811a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.086+0000 7fc23c809700 1 -- 172.21.15.146:0/2137996602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2381368e0 msgr2=0x7fc23811a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.086+0000 7fc23c809700 1 --2- 172.21.15.146:0/2137996602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2381368e0 0x7fc23811a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.086+0000 7fc23c809700 1 -- 172.21.15.146:0/2137996602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc238139200 msgr2=0x7fc23811a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.086+0000 7fc23c809700 1 --2- 172.21.15.146:0/2137996602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc238139200 0x7fc23811a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.086+0000 7fc23c809700 1 -- 172.21.15.146:0/2137996602 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc224009550 con 0x7fc238133900 2023-10-03T10:14:30.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.086+0000 7fc237fff700 1 --2- 172.21.15.146:0/2137996602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2381368e0 0x7fc23811a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:30.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.086+0000 7fc23c809700 1 --2- 172.21.15.146:0/2137996602 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc238133900 0x7fc238119e40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00c4e0 tx=0x7fc22c00c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.086+0000 7fc2357fa700 1 -- 172.21.15.146:0/2137996602 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c0054e0 con 0x7fc238133900 2023-10-03T10:14:30.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.086+0000 7fc2357fa700 1 -- 172.21.15.146:0/2137996602 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22c003680 con 0x7fc238133900 2023-10-03T10:14:30.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.086+0000 7fc2357fa700 1 -- 172.21.15.146:0/2137996602 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c003a30 con 0x7fc238133900 2023-10-03T10:14:30.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.087+0000 7fc23ea6d700 1 -- 172.21.15.146:0/2137996602 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc23811d5c0 con 0x7fc238133900 2023-10-03T10:14:30.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.087+0000 7fc23ea6d700 1 -- 172.21.15.146:0/2137996602 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc238139050 con 0x7fc238133900 2023-10-03T10:14:30.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.089+0000 7fc23ea6d700 1 -- 172.21.15.146:0/2137996602 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc23811e0f0 con 0x7fc238133900 2023-10-03T10:14:30.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.089+0000 7fc2357fa700 1 -- 172.21.15.146:0/2137996602 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc22c003b90 con 0x7fc238133900 2023-10-03T10:14:30.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.089+0000 7fc2357fa700 1 -- 172.21.15.146:0/2137996602 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc22c03eb80 con 0x7fc238133900 2023-10-03T10:14:30.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.098+0000 7fc2357fa700 1 -- 172.21.15.146:0/2137996602 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc22c040e60 con 0x7fc238133900 2023-10-03T10:14:30.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.099+0000 7fbd6a19a700 1 Processor -- start 2023-10-03T10:14:30.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.099+0000 7fbd6a19a700 1 -- start start 2023-10-03T10:14:30.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.100+0000 7fbd6a19a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbd6409e340 0x7fbd641359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.100+0000 7fbd6a19a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd64135f20 0x7fbd64138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.100+0000 7fbd6a19a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6409aaa0 con 0x7fbd6409d860 2023-10-03T10:14:30.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.100+0000 7fbd6a19a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6409e730 con 0x7fbd6409e340 2023-10-03T10:14:30.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.100+0000 7fbd6a19a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6409f870 con 0x7fbd64135f20 2023-10-03T10:14:30.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.100+0000 7fbd637fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbd6409d860 0x7fbd6409dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36844/0 (socket says 172.21.15.146:36844) 2023-10-03T10:14:30.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.100+0000 7fbd637fe700 1 -- 172.21.15.146:0/2762706168 learned_addr learned my addr 172.21.15.146:0/2762706168 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:30.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.100+0000 7fbd63fff700 1 --2- 172.21.15.146:0/2762706168 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd64135f20 0x7fbd64138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.100+0000 7fbd62ffd700 1 --2- 172.21.15.146:0/2762706168 >> v2:172.21.15.146:3300/0 conn(0x7fbd6409e340 0x7fbd641359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.100+0000 7fbd627fc700 1 -- 172.21.15.146:0/2762706168 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385456278 0 0) 0x7fbd6409aaa0 con 0x7fbd6409d860 2023-10-03T10:14:30.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.100+0000 7fbd627fc700 1 -- 172.21.15.146:0/2762706168 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd4c0035b0 con 0x7fbd6409d860 2023-10-03T10:14:30.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.100+0000 7fbd627fc700 1 -- 172.21.15.146:0/2762706168 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 746777974 0 0) 0x7fbd4c0035b0 con 0x7fbd6409d860 2023-10-03T10:14:30.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.100+0000 7fbd627fc700 1 -- 172.21.15.146:0/2762706168 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd64135f20 msgr2=0x7fbd64138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:30.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.100+0000 7fbd627fc700 1 --2- 172.21.15.146:0/2762706168 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd64135f20 0x7fbd64138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.100+0000 7fbd627fc700 1 -- 172.21.15.146:0/2762706168 >> v2:172.21.15.146:3300/0 conn(0x7fbd6409e340 msgr2=0x7fbd641359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.100+0000 7fbd627fc700 1 --2- 172.21.15.146:0/2762706168 >> v2:172.21.15.146:3300/0 conn(0x7fbd6409e340 0x7fbd641359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.100+0000 7fbd627fc700 1 -- 172.21.15.146:0/2762706168 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6409b360 con 0x7fbd6409d860 2023-10-03T10:14:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.100+0000 7fbd627fc700 1 -- 172.21.15.146:0/2762706168 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2532932501 0 0) 0x7fbd54001670 con 0x7fbd6409d860 2023-10-03T10:14:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.101+0000 7fbd627fc700 1 -- 172.21.15.146:0/2762706168 >> v1:172.21.15.146:6789/0 conn(0x7fbd6409d860 legacy=0x7fbd6409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.101+0000 7fbd627fc700 1 --2- 172.21.15.146:0/2762706168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c003aa0 0x7fbd4c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.101+0000 7fbd627fc700 1 --2- 172.21.15.146:0/2762706168 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd64135f20 0x7fbd4c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.101+0000 7fbd627fc700 1 --2- 172.21.15.146:0/2762706168 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd4c004d90 0x7fbd4c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.101+0000 7fbd627fc700 1 -- 172.21.15.146:0/2762706168 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6409e730 con 0x7fbd4c003aa0 2023-10-03T10:14:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.101+0000 7fbd627fc700 1 -- 172.21.15.146:0/2762706168 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6409f870 con 0x7fbd4c004d90 2023-10-03T10:14:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.101+0000 7fbd627fc700 1 -- 172.21.15.146:0/2762706168 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c00bbf0 con 0x7fbd64135f20 2023-10-03T10:14:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.101+0000 7fbd62ffd700 1 --2- 172.21.15.146:0/2762706168 >> v2:172.21.15.146:3300/0 conn(0x7fbd6409e340 0x7fbd641359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.101+0000 7fbd62ffd700 1 --2- 172.21.15.146:0/2762706168 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd64135f20 0x7fbd4c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.101+0000 7fbd637fe700 1 --2- 172.21.15.146:0/2762706168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c003aa0 0x7fbd4c003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.101+0000 7fbd63fff700 1 --2- 172.21.15.146:0/2762706168 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd4c004d90 0x7fbd4c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.101+0000 7fbd62ffd700 1 -- 172.21.15.146:0/2762706168 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd4c004d90 msgr2=0x7fbd4c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.101+0000 7fbd62ffd700 1 --2- 172.21.15.146:0/2762706168 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd4c004d90 0x7fbd4c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.101+0000 7fbd62ffd700 1 -- 172.21.15.146:0/2762706168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c003aa0 msgr2=0x7fbd4c003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.101+0000 7fbd62ffd700 1 --2- 172.21.15.146:0/2762706168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c003aa0 0x7fbd4c003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.101+0000 7fbd62ffd700 1 -- 172.21.15.146:0/2762706168 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c0035b0 con 0x7fbd64135f20 2023-10-03T10:14:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.101+0000 7fbd637fe700 1 --2- 172.21.15.146:0/2762706168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c003aa0 0x7fbd4c003eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.101+0000 7fa427360700 1 Processor -- start 2023-10-03T10:14:30.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.101+0000 7fbd62ffd700 1 --2- 172.21.15.146:0/2762706168 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd64135f20 0x7fbd4c004850 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009d00 tx=0x7fbd4c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80c0a2b5caf43893 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.101+0000 7fa427360700 1 -- start start 2023-10-03T10:14:30.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.102+0000 7fbd627fc700 1 -- 172.21.15.146:0/2762706168 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd58009e50 con 0x7fbd64135f20 2023-10-03T10:14:30.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.102+0000 7fbd627fc700 1 -- 172.21.15.146:0/2762706168 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5800e9a0 con 0x7fbd64135f20 2023-10-03T10:14:30.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.102+0000 7fbd627fc700 1 -- 172.21.15.146:0/2762706168 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5800ed30 con 0x7fbd64135f20 2023-10-03T10:14:30.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.102+0000 7fa427360700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa420099e20 0x7fa42009a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.102+0000 7fa427360700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa420130a60 0x7fa420139890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.102+0000 7fa427360700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa420099a60 con 0x7fa42009a730 2023-10-03T10:14:30.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.102+0000 7fa427360700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42009bf50 con 0x7fa420130a60 2023-10-03T10:14:30.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.102+0000 7fa427360700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa42009b230 con 0x7fa420099e20 2023-10-03T10:14:30.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.102+0000 7fa4248fb700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa42009a730 0x7fa420130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36854/0 (socket says 172.21.15.146:36854) 2023-10-03T10:14:30.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.102+0000 7fa4248fb700 1 -- 172.21.15.146:0/4138263643 learned_addr learned my addr 172.21.15.146:0/4138263643 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:30.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.102+0000 7fa4258fd700 1 --2- 172.21.15.146:0/4138263643 >> v2:172.21.15.146:3300/0 conn(0x7fa420130a60 0x7fa420139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.102+0000 7fa417fff700 1 -- 172.21.15.146:0/4138263643 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734672388 0 0) 0x7fa420099a60 con 0x7fa42009a730 2023-10-03T10:14:30.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.102+0000 7fa417fff700 1 -- 172.21.15.146:0/4138263643 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa40c0035b0 con 0x7fa42009a730 2023-10-03T10:14:30.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.103+0000 7fa4258fd700 1 -- 172.21.15.146:0/4138263643 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa420099e20 msgr2=0x7fa42009a1f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:14:30.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.103+0000 7fa4258fd700 1 --2- 172.21.15.146:0/4138263643 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa420099e20 0x7fa42009a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.103+0000 7fa4258fd700 1 -- 172.21.15.146:0/4138263643 >> v1:172.21.15.146:6789/0 conn(0x7fa42009a730 legacy=0x7fa420130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.103+0000 7fa4258fd700 1 -- 172.21.15.146:0/4138263643 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42009bb90 con 0x7fa420130a60 2023-10-03T10:14:30.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.103+0000 7fbd6a19a700 1 -- 172.21.15.146:0/2762706168 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd64135f20 msgr2=0x7fbd4c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.103+0000 7fbd6a19a700 1 --2- 172.21.15.146:0/2762706168 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd64135f20 0x7fbd4c004850 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009d00 tx=0x7fbd4c005880 comp rx=0 tx=0).stop 2023-10-03T10:14:30.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.103+0000 7fbd63fff700 1 -- 172.21.15.146:0/2762706168 reap_dead start 2023-10-03T10:14:30.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.103+0000 7fbd6a19a700 1 -- 172.21.15.146:0/2762706168 shutdown_connections 2023-10-03T10:14:30.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.103+0000 7fbd6a19a700 1 -- 172.21.15.146:0/2762706168 >> 172.21.15.146:0/2762706168 conn(0x7fbd64099c40 msgr2=0x7fbd640a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.103+0000 7fa4258fd700 1 --2- 172.21.15.146:0/4138263643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa420130a60 0x7fa420139890 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa418009d90 tx=0x7fa41800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460565db00afd0ba server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.103+0000 7fbd6a19a700 1 -- 172.21.15.146:0/2762706168 shutdown_connections 2023-10-03T10:14:30.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.103+0000 7fbd6a19a700 1 -- 172.21.15.146:0/2762706168 wait complete. 2023-10-03T10:14:30.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.103+0000 7fa417fff700 1 -- 172.21.15.146:0/4138263643 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41800e070 con 0x7fa420130a60 2023-10-03T10:14:30.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.103+0000 7fa417fff700 1 -- 172.21.15.146:0/4138263643 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41800bb20 con 0x7fa420130a60 2023-10-03T10:14:30.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.103+0000 7fa417fff700 1 -- 172.21.15.146:0/4138263643 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa418012430 con 0x7fa420130a60 2023-10-03T10:14:30.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.104+0000 7fa427360700 1 -- 172.21.15.146:0/4138263643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa420130a60 msgr2=0x7fa420139890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.104+0000 7fa427360700 1 --2- 172.21.15.146:0/4138263643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa420130a60 0x7fa420139890 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa418009d90 tx=0x7fa41800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:30.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.104+0000 7fa427360700 1 -- 172.21.15.146:0/4138263643 shutdown_connections 2023-10-03T10:14:30.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.104+0000 7fa427360700 1 --2- 172.21.15.146:0/4138263643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa420130a60 0x7fa420139890 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.104+0000 7fa427360700 1 --2- 172.21.15.146:0/4138263643 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa420099e20 0x7fa42009a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.104+0000 7fa427360700 1 -- 172.21.15.146:0/4138263643 >> 172.21.15.146:0/4138263643 conn(0x7fa4200a2980 msgr2=0x7fa4200a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.104+0000 7fbd6a19a700 1 Processor -- start 2023-10-03T10:14:30.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.105+0000 7fa427360700 1 -- 172.21.15.146:0/4138263643 shutdown_connections 2023-10-03T10:14:30.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.105+0000 7fa427360700 1 -- 172.21.15.146:0/4138263643 wait complete. 2023-10-03T10:14:30.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.105+0000 7fbd6a19a700 1 -- start start 2023-10-03T10:14:30.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.105+0000 7fbd6a19a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd64135f20 0x7fbd64126d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.105+0000 7fbd6a19a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd64127250 0x7fbd641cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.105+0000 7fbd6a19a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd64127680 0x7fbd641ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.105+0000 7fbd6a19a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6409c8b0 con 0x7fbd64127250 2023-10-03T10:14:30.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.105+0000 7fbd6a19a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd64129c80 con 0x7fbd64127680 2023-10-03T10:14:30.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.105+0000 7fbd6a19a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd64128600 con 0x7fbd64135f20 2023-10-03T10:14:30.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.105+0000 7fbd637fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd64135f20 0x7fbd64126d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.105+0000 7fbd637fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd64135f20 0x7fbd64126d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:50286/0 (socket says 172.21.15.146:50286) 2023-10-03T10:14:30.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.105+0000 7fbd637fe700 1 -- 172.21.15.146:0/2810236947 learned_addr learned my addr 172.21.15.146:0/2810236947 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:30.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.105+0000 7fa427360700 1 Processor -- start 2023-10-03T10:14:30.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.106+0000 7fa427360700 1 -- start start 2023-10-03T10:14:30.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.106+0000 7fa427360700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa420099e20 0x7fa420133480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.106+0000 7fa427360700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa42009a730 0x7fa4201339c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.106+0000 7fa427360700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa420130a60 0x7fa420133f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.106+0000 7fa427360700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4201301f0 con 0x7fa420130a60 2023-10-03T10:14:30.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.106+0000 7fa427360700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa420135110 con 0x7fa420099e20 2023-10-03T10:14:30.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.106+0000 7fa427360700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa42013d340 con 0x7fa42009a730 2023-10-03T10:14:30.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.106+0000 7fbd63fff700 1 --2- 172.21.15.146:0/2810236947 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd64127680 0x7fbd641ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.106+0000 7fbd62ffd700 1 --2- 172.21.15.146:0/2810236947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd64127250 0x7fbd641cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.106+0000 7fbd637fe700 1 -- 172.21.15.146:0/2810236947 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd64127680 msgr2=0x7fbd641ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.106+0000 7fbd637fe700 1 --2- 172.21.15.146:0/2810236947 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd64127680 0x7fbd641ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.106+0000 7fbd637fe700 1 -- 172.21.15.146:0/2810236947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd64127250 msgr2=0x7fbd641cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.106+0000 7fbd637fe700 1 --2- 172.21.15.146:0/2810236947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd64127250 0x7fbd641cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.106+0000 7fbd637fe700 1 -- 172.21.15.146:0/2810236947 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd640a21e0 con 0x7fbd64135f20 2023-10-03T10:14:30.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.106+0000 7fa4258fd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa420130a60 0x7fa420133f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.106+0000 7fa4258fd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa420130a60 0x7fa420133f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44300/0 (socket says 172.21.15.146:44300) 2023-10-03T10:14:30.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.106+0000 7fa4258fd700 1 -- 172.21.15.146:0/1941088320 learned_addr learned my addr 172.21.15.146:0/1941088320 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.106+0000 7fa4248fb700 1 --2- 172.21.15.146:0/1941088320 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa42009a730 0x7fa4201339c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.106+0000 7fa4250fc700 1 --2- 172.21.15.146:0/1941088320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa420099e20 0x7fa420133480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.107+0000 7fa4258fd700 1 -- 172.21.15.146:0/1941088320 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa42009a730 msgr2=0x7fa4201339c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.107+0000 7fa4258fd700 1 --2- 172.21.15.146:0/1941088320 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa42009a730 0x7fa4201339c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.107+0000 7fa4258fd700 1 -- 172.21.15.146:0/1941088320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa420099e20 msgr2=0x7fa420133480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.107+0000 7fa4258fd700 1 --2- 172.21.15.146:0/1941088320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa420099e20 0x7fa420133480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.107+0000 7fa4258fd700 1 -- 172.21.15.146:0/1941088320 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa418009a70 con 0x7fa420130a60 2023-10-03T10:14:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.107+0000 7fa4250fc700 1 --2- 172.21.15.146:0/1941088320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa420099e20 0x7fa420133480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.107+0000 7fa4258fd700 1 --2- 172.21.15.146:0/1941088320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa420130a60 0x7fa420133f00 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fa41800b370 tx=0x7fa418004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.107+0000 7fbd637fe700 1 --2- 172.21.15.146:0/2810236947 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd64135f20 0x7fbd64126d10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400e7b0 tx=0x7fbd5400eac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.107+0000 7fa415ffb700 1 -- 172.21.15.146:0/1941088320 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa418012430 con 0x7fa420130a60 2023-10-03T10:14:30.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.107+0000 7fa415ffb700 1 -- 172.21.15.146:0/1941088320 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa418020070 con 0x7fa420130a60 2023-10-03T10:14:30.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.107+0000 7fa415ffb700 1 -- 172.21.15.146:0/1941088320 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa418004040 con 0x7fa420130a60 2023-10-03T10:14:30.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.107+0000 7fa427360700 1 -- 172.21.15.146:0/1941088320 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42009b470 con 0x7fa420130a60 2023-10-03T10:14:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.107+0000 7fbd4bfff700 1 -- 172.21.15.146:0/2810236947 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54010510 con 0x7fbd64135f20 2023-10-03T10:14:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.107+0000 7fbd4bfff700 1 -- 172.21.15.146:0/2810236947 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd54010670 con 0x7fbd64135f20 2023-10-03T10:14:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.107+0000 7fbd4bfff700 1 -- 172.21.15.146:0/2810236947 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54010a00 con 0x7fbd64135f20 2023-10-03T10:14:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.107+0000 7fa427360700 1 -- 172.21.15.146:0/1941088320 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4201376a0 con 0x7fa420130a60 2023-10-03T10:14:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.107+0000 7fbd6a19a700 1 -- 172.21.15.146:0/2810236947 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd64128050 con 0x7fbd64135f20 2023-10-03T10:14:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.107+0000 7fbd6a19a700 1 -- 172.21.15.146:0/2810236947 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd64126800 con 0x7fbd64135f20 2023-10-03T10:14:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.108+0000 7fbd6a19a700 1 -- 172.21.15.146:0/2810236947 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd641235e0 con 0x7fbd64135f20 2023-10-03T10:14:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.109+0000 7fa427360700 1 -- 172.21.15.146:0/1941088320 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42004f2a0 con 0x7fa420130a60 2023-10-03T10:14:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.109+0000 7fa415ffb700 1 -- 172.21.15.146:0/1941088320 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4180041a0 con 0x7fa420130a60 2023-10-03T10:14:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.109+0000 7fa415ffb700 1 -- 172.21.15.146:0/1941088320 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa418022070 con 0x7fa420130a60 2023-10-03T10:14:30.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.110+0000 7fbd4bfff700 1 -- 172.21.15.146:0/2810236947 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd54010b60 con 0x7fbd64135f20 2023-10-03T10:14:30.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.110+0000 7fbd4bfff700 1 -- 172.21.15.146:0/2810236947 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbd5403f710 con 0x7fbd64135f20 2023-10-03T10:14:30.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.118+0000 7fbd4bfff700 1 -- 172.21.15.146:0/2810236947 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd54014480 con 0x7fbd64135f20 2023-10-03T10:14:30.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.118+0000 7fa415ffb700 1 -- 172.21.15.146:0/1941088320 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa418004450 con 0x7fa420130a60 2023-10-03T10:14:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.293+0000 7fc9b0968700 1 -- 172.21.15.146:0/617638980 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc9ac09cb20 con 0x7fc9ac133ad0 2023-10-03T10:14:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.293+0000 7fc99affd700 1 -- 172.21.15.146:0/617638980 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc9a40114a0 con 0x7fc9ac133ad0 2023-10-03T10:14:30.294 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:30.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.296+0000 7fc9b0968700 1 -- 172.21.15.146:0/617638980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9ac133ad0 msgr2=0x7fc9ac071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.296+0000 7fc9b0968700 1 --2- 172.21.15.146:0/617638980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9ac133ad0 0x7fc9ac071de0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009dd0 tx=0x7fc9a400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.296+0000 7fc9b0968700 1 -- 172.21.15.146:0/617638980 shutdown_connections 2023-10-03T10:14:30.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.296+0000 7fc9b0968700 1 --2- 172.21.15.146:0/617638980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9ac133ad0 0x7fc9ac071de0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.296+0000 7fc9b0968700 1 --2- 172.21.15.146:0/617638980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9ac1300a0 0x7fc9ac071360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.296+0000 7fc9b0968700 1 --2- 172.21.15.146:0/617638980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9ac1309f0 0x7fc9ac0718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.296+0000 7fc9b0968700 1 -- 172.21.15.146:0/617638980 >> 172.21.15.146:0/617638980 conn(0x7fc9ac099c40 msgr2=0x7fc9ac12f070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.297+0000 7fc9b0968700 1 -- 172.21.15.146:0/617638980 shutdown_connections 2023-10-03T10:14:30.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.297+0000 7fc9b0968700 1 -- 172.21.15.146:0/617638980 wait complete. 2023-10-03T10:14:30.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:30.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.329+0000 7fc23ea6d700 1 -- 172.21.15.146:0/2137996602 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc23804f2a0 con 0x7fc238133900 2023-10-03T10:14:30.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.329+0000 7fc2357fa700 1 -- 172.21.15.146:0/2137996602 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc22c017070 con 0x7fc238133900 2023-10-03T10:14:30.330 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:30.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.333+0000 7fc23ea6d700 1 -- 172.21.15.146:0/2137996602 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc238133900 msgr2=0x7fc238119e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.333+0000 7fc23ea6d700 1 --2- 172.21.15.146:0/2137996602 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc238133900 0x7fc238119e40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00c4e0 tx=0x7fc22c00c7f0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.333+0000 7fc23ea6d700 1 -- 172.21.15.146:0/2137996602 shutdown_connections 2023-10-03T10:14:30.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.333+0000 7fc23ea6d700 1 --2- 172.21.15.146:0/2137996602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc238139200 0x7fc23811a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.333+0000 7fc23ea6d700 1 --2- 172.21.15.146:0/2137996602 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc238133900 0x7fc238119e40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.333+0000 7fc23ea6d700 1 --2- 172.21.15.146:0/2137996602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2381368e0 0x7fc23811a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.333+0000 7fc23ea6d700 1 -- 172.21.15.146:0/2137996602 >> 172.21.15.146:0/2137996602 conn(0x7fc2380a2980 msgr2=0x7fc238130170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.333+0000 7fc23ea6d700 1 -- 172.21.15.146:0/2137996602 shutdown_connections 2023-10-03T10:14:30.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.333+0000 7fc23ea6d700 1 -- 172.21.15.146:0/2137996602 wait complete. 2023-10-03T10:14:30.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:30.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.361+0000 7fbd6a19a700 1 -- 172.21.15.146:0/2810236947 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbd6404f2a0 con 0x7fbd64135f20 2023-10-03T10:14:30.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.362+0000 7fbd4bfff700 1 -- 172.21.15.146:0/2810236947 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd54019020 con 0x7fbd64135f20 2023-10-03T10:14:30.362 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:30.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.363+0000 7fbd6a19a700 1 -- 172.21.15.146:0/2810236947 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd64135f20 msgr2=0x7fbd64126d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.363+0000 7fbd6a19a700 1 --2- 172.21.15.146:0/2810236947 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd64135f20 0x7fbd64126d10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400e7b0 tx=0x7fbd5400eac0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.364+0000 7fbd6a19a700 1 -- 172.21.15.146:0/2810236947 shutdown_connections 2023-10-03T10:14:30.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.364+0000 7fbd6a19a700 1 --2- 172.21.15.146:0/2810236947 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd64127680 0x7fbd641ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.364+0000 7fbd6a19a700 1 --2- 172.21.15.146:0/2810236947 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd64135f20 0x7fbd64126d10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.364+0000 7fbd6a19a700 1 --2- 172.21.15.146:0/2810236947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd64127250 0x7fbd641cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.364+0000 7fbd6a19a700 1 -- 172.21.15.146:0/2810236947 >> 172.21.15.146:0/2810236947 conn(0x7fbd64099c40 msgr2=0x7fbd641353a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.364+0000 7fbd6a19a700 1 -- 172.21.15.146:0/2810236947 shutdown_connections 2023-10-03T10:14:30.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.364+0000 7fbd6a19a700 1 -- 172.21.15.146:0/2810236947 wait complete. 2023-10-03T10:14:30.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.368+0000 7fa427360700 1 -- 172.21.15.146:0/1941088320 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa420136a90 con 0x7fa420130a60 2023-10-03T10:14:30.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.368+0000 7fa415ffb700 1 -- 172.21.15.146:0/1941088320 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa41802c070 con 0x7fa420130a60 2023-10-03T10:14:30.369 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:30.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.370+0000 7fa427360700 1 -- 172.21.15.146:0/1941088320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa420130a60 msgr2=0x7fa420133f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.370+0000 7fa427360700 1 --2- 172.21.15.146:0/1941088320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa420130a60 0x7fa420133f00 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fa41800b370 tx=0x7fa418004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.370+0000 7fa427360700 1 -- 172.21.15.146:0/1941088320 shutdown_connections 2023-10-03T10:14:30.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.370+0000 7fa427360700 1 --2- 172.21.15.146:0/1941088320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa420130a60 0x7fa420133f00 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.370+0000 7fa427360700 1 --2- 172.21.15.146:0/1941088320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa420099e20 0x7fa420133480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.370+0000 7fa427360700 1 --2- 172.21.15.146:0/1941088320 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa42009a730 0x7fa4201339c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.370+0000 7fa427360700 1 -- 172.21.15.146:0/1941088320 >> 172.21.15.146:0/1941088320 conn(0x7fa4200a2980 msgr2=0x7fa42012f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.370+0000 7fa427360700 1 -- 172.21.15.146:0/1941088320 shutdown_connections 2023-10-03T10:14:30.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:30.371+0000 7fa427360700 1 -- 172.21.15.146:0/1941088320 wait complete. 2023-10-03T10:14:30.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:30.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:31.311 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:31.351 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:31.379 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:31.384 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:31.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.464+0000 7f4e28dce700 1 Processor -- start 2023-10-03T10:14:31.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.464+0000 7f4e28dce700 1 -- start start 2023-10-03T10:14:31.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.465+0000 7f4e28dce700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4e24136960 0x7f4e24138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.465+0000 7f4e28dce700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e24139280 0x7f4e2413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.465+0000 7f4e28dce700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e2406b2d0 con 0x7f4e24133ad0 2023-10-03T10:14:31.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.465+0000 7f4e28dce700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e241345b0 con 0x7f4e24136960 2023-10-03T10:14:31.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.465+0000 7f4e28dce700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e24133610 con 0x7f4e24139280 2023-10-03T10:14:31.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.465+0000 7f4e21d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4e24136960 0x7f4e24138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.465+0000 7f4e2259c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4e24133ad0 0x7f4e24133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36864/0 (socket says 172.21.15.146:36864) 2023-10-03T10:14:31.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.466+0000 7f4e2259c700 1 -- 172.21.15.146:0/1464765593 learned_addr learned my addr 172.21.15.146:0/1464765593 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:31.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.466+0000 7f4e22d9d700 1 --2- 172.21.15.146:0/1464765593 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e24139280 0x7f4e2413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.466+0000 7f4e21d9b700 1 -- 172.21.15.146:0/1464765593 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e24139280 msgr2=0x7f4e2413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:31.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.466+0000 7f4e21d9b700 1 --2- 172.21.15.146:0/1464765593 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e24139280 0x7f4e2413b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.466+0000 7f4e21d9b700 1 -- 172.21.15.146:0/1464765593 >> v1:172.21.15.146:6789/0 conn(0x7f4e24133ad0 legacy=0x7f4e24133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.466+0000 7f4e21d9b700 1 -- 172.21.15.146:0/1464765593 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2409a500 con 0x7f4e24136960 2023-10-03T10:14:31.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.466+0000 7f4e21d9b700 1 --2- 172.21.15.146:0/1464765593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e24136960 0x7f4e24138d40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4e18009840 tx=0x7f4e18009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8dc79f3a23b617 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.466+0000 7f4e2159a700 1 -- 172.21.15.146:0/1464765593 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18011830 con 0x7f4e24136960 2023-10-03T10:14:31.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.466+0000 7f4e2159a700 1 -- 172.21.15.146:0/1464765593 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e18011990 con 0x7f4e24136960 2023-10-03T10:14:31.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.466+0000 7f4e2159a700 1 -- 172.21.15.146:0/1464765593 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18011d20 con 0x7f4e24136960 2023-10-03T10:14:31.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.467+0000 7f4e28dce700 1 -- 172.21.15.146:0/1464765593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e24136960 msgr2=0x7f4e24138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.467+0000 7f4e28dce700 1 --2- 172.21.15.146:0/1464765593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e24136960 0x7f4e24138d40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4e18009840 tx=0x7f4e18009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:31.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.467+0000 7f4e28dce700 1 -- 172.21.15.146:0/1464765593 shutdown_connections 2023-10-03T10:14:31.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.467+0000 7f4e28dce700 1 --2- 172.21.15.146:0/1464765593 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e24139280 0x7f4e2413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.467+0000 7f4e28dce700 1 --2- 172.21.15.146:0/1464765593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e24136960 0x7f4e24138d40 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.467+0000 7f4e28dce700 1 -- 172.21.15.146:0/1464765593 >> 172.21.15.146:0/1464765593 conn(0x7f4e24099c40 msgr2=0x7f4e240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.467+0000 7f4e28dce700 1 -- 172.21.15.146:0/1464765593 shutdown_connections 2023-10-03T10:14:31.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.467+0000 7f4e28dce700 1 -- 172.21.15.146:0/1464765593 wait complete. 2023-10-03T10:14:31.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.469+0000 7f4e28dce700 1 Processor -- start 2023-10-03T10:14:31.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.469+0000 7f4e28dce700 1 -- start start 2023-10-03T10:14:31.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.469+0000 7f4e28dce700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e24133ad0 0x7f4e24071830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.469+0000 7f4e28dce700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e24136960 0x7f4e24071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.469+0000 7f4e28dce700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e24139280 0x7f4e241c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.469+0000 7f4e28dce700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e24070350 con 0x7f4e24136960 2023-10-03T10:14:31.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.469+0000 7f4e28dce700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2406ecd0 con 0x7f4e24139280 2023-10-03T10:14:31.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.469+0000 7f4e28dce700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e241315e0 con 0x7f4e24133ad0 2023-10-03T10:14:31.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.469+0000 7f4e2259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e24133ad0 0x7f4e24071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.469+0000 7f4e22d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e24139280 0x7f4e241c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.469+0000 7f4e2259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e24133ad0 0x7f4e24071830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:50306/0 (socket says 172.21.15.146:50306) 2023-10-03T10:14:31.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.469+0000 7f4e21d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e24136960 0x7f4e24071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.469+0000 7f4e22d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e24139280 0x7f4e241c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42246/0 (socket says 172.21.15.146:42246) 2023-10-03T10:14:31.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.469+0000 7f4e2259c700 1 -- 172.21.15.146:0/2706880372 learned_addr learned my addr 172.21.15.146:0/2706880372 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:31.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.470+0000 7f4e21d9b700 1 -- 172.21.15.146:0/2706880372 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e24133ad0 msgr2=0x7f4e24071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.470+0000 7f4e21d9b700 1 --2- 172.21.15.146:0/2706880372 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e24133ad0 0x7f4e24071830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.470+0000 7f4e21d9b700 1 -- 172.21.15.146:0/2706880372 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e24139280 msgr2=0x7f4e241c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.470+0000 7f4e21d9b700 1 --2- 172.21.15.146:0/2706880372 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e24139280 0x7f4e241c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.470+0000 7f4e21d9b700 1 -- 172.21.15.146:0/2706880372 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e180094a0 con 0x7f4e24136960 2023-10-03T10:14:31.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.470+0000 7f4e22d9d700 1 --2- 172.21.15.146:0/2706880372 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e24139280 0x7f4e241c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.470+0000 7f4e21d9b700 1 --2- 172.21.15.146:0/2706880372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e24136960 0x7f4e24071d70 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f4e18016000 tx=0x7f4e18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.470+0000 7f4e12ffd700 1 -- 172.21.15.146:0/2706880372 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18004400 con 0x7f4e24136960 2023-10-03T10:14:31.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.470+0000 7f4e12ffd700 1 -- 172.21.15.146:0/2706880372 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1801f070 con 0x7f4e24136960 2023-10-03T10:14:31.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.470+0000 7f4e28dce700 1 -- 172.21.15.146:0/2706880372 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2406ef10 con 0x7f4e24136960 2023-10-03T10:14:31.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.470+0000 7f4e12ffd700 1 -- 172.21.15.146:0/2706880372 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e180038e0 con 0x7f4e24136960 2023-10-03T10:14:31.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.470+0000 7f4e28dce700 1 -- 172.21.15.146:0/2706880372 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e24070630 con 0x7f4e24136960 2023-10-03T10:14:31.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.471+0000 7f4e12ffd700 1 -- 172.21.15.146:0/2706880372 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e18021030 con 0x7f4e24136960 2023-10-03T10:14:31.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.471+0000 7f4e12ffd700 1 -- 172.21.15.146:0/2706880372 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4e180409d0 con 0x7f4e24136960 2023-10-03T10:14:31.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.473+0000 7f4e28dce700 1 -- 172.21.15.146:0/2706880372 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e2404f2a0 con 0x7f4e24136960 2023-10-03T10:14:31.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.481+0000 7f4e12ffd700 1 -- 172.21.15.146:0/2706880372 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e180239c0 con 0x7f4e24136960 2023-10-03T10:14:31.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.506+0000 7f2c3b2dd700 1 Processor -- start 2023-10-03T10:14:31.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.506+0000 7f2c3b2dd700 1 -- start start 2023-10-03T10:14:31.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.507+0000 7f2c3b2dd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c3409ef80 0x7f2c34138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.507+0000 7f2c3b2dd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2c3409f370 0x7f2c3413b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.507+0000 7f2c3b2dd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c3409af80 con 0x7f2c3409a150 2023-10-03T10:14:31.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.507+0000 7f2c3b2dd700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3409fe00 con 0x7f2c3409f370 2023-10-03T10:14:31.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.507+0000 7f2c3b2dd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3406bec0 con 0x7f2c3409ef80 2023-10-03T10:14:31.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.507+0000 7f2c38878700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c3409ef80 0x7f2c34138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.507+0000 7f2c3987a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2c3409f370 0x7f2c3413b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.507+0000 7f2c3987a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2c3409f370 0x7f2c3413b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44328/0 (socket says 172.21.15.146:44328) 2023-10-03T10:14:31.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.507+0000 7f2c38878700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c3409ef80 0x7f2c34138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42262/0 (socket says 172.21.15.146:42262) 2023-10-03T10:14:31.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.507+0000 7f2c3987a700 1 -- 172.21.15.146:0/712733407 learned_addr learned my addr 172.21.15.146:0/712733407 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:31.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.507+0000 7f2c3987a700 1 -- 172.21.15.146:0/712733407 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c3409ef80 msgr2=0x7f2c34138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:31.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.507+0000 7f2c3987a700 1 --2- 172.21.15.146:0/712733407 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c3409ef80 0x7f2c34138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.507+0000 7f2c3987a700 1 -- 172.21.15.146:0/712733407 >> v1:172.21.15.146:6789/0 conn(0x7f2c3409a150 legacy=0x7f2c3409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.507+0000 7f2c3987a700 1 -- 172.21.15.146:0/712733407 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3406bc20 con 0x7f2c3409f370 2023-10-03T10:14:31.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.507+0000 7f2c38878700 1 --2- 172.21.15.146:0/712733407 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c3409ef80 0x7f2c34138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.508+0000 7f2c3987a700 1 --2- 172.21.15.146:0/712733407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c3409f370 0x7f2c3413b3b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009e50 tx=0x7f2c2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16dbc40690d6567a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.508+0000 7f2c2bfff700 1 -- 172.21.15.146:0/712733407 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c00e070 con 0x7f2c3409f370 2023-10-03T10:14:31.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.508+0000 7f2c2bfff700 1 -- 172.21.15.146:0/712733407 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2c00b910 con 0x7f2c3409f370 2023-10-03T10:14:31.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.508+0000 7f2c2bfff700 1 -- 172.21.15.146:0/712733407 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c00bcc0 con 0x7f2c3409f370 2023-10-03T10:14:31.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.508+0000 7f2c3b2dd700 1 -- 172.21.15.146:0/712733407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c3409f370 msgr2=0x7f2c3413b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.508+0000 7f2c3b2dd700 1 --2- 172.21.15.146:0/712733407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c3409f370 0x7f2c3413b3b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009e50 tx=0x7f2c2c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:31.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.509+0000 7f2c3b2dd700 1 -- 172.21.15.146:0/712733407 shutdown_connections 2023-10-03T10:14:31.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.509+0000 7f2c3b2dd700 1 --2- 172.21.15.146:0/712733407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c3409f370 0x7f2c3413b3b0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.509+0000 7f2c3b2dd700 1 --2- 172.21.15.146:0/712733407 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c3409ef80 0x7f2c34138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.509+0000 7f2c3b2dd700 1 -- 172.21.15.146:0/712733407 >> 172.21.15.146:0/712733407 conn(0x7f2c340a4430 msgr2=0x7f2c340a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.509+0000 7f2c3b2dd700 1 -- 172.21.15.146:0/712733407 shutdown_connections 2023-10-03T10:14:31.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.509+0000 7f2c3b2dd700 1 -- 172.21.15.146:0/712733407 wait complete. 2023-10-03T10:14:31.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.510+0000 7f2c3b2dd700 1 Processor -- start 2023-10-03T10:14:31.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.510+0000 7f2c3b2dd700 1 -- start start 2023-10-03T10:14:31.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.511+0000 7f2c3b2dd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c3409a150 0x7f2c341395a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.511+0000 7f2c3b2dd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c3409ef80 0x7f2c34139ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.511+0000 7f2c3b2dd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c3409f370 0x7f2c3413a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.511+0000 7f2c3b2dd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3411ffd0 con 0x7f2c3409a150 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.511+0000 7f2c3b2dd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3411f080 con 0x7f2c3409ef80 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.511+0000 7f2c3b2dd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3409b890 con 0x7f2c3409f370 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.511+0000 7f2c39079700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c3409a150 0x7f2c341395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.511+0000 7f2c39079700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c3409a150 0x7f2c341395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44332/0 (socket says 172.21.15.146:44332) 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.511+0000 7f2c39079700 1 -- 172.21.15.146:0/695226808 learned_addr learned my addr 172.21.15.146:0/695226808 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.511+0000 7f2c38878700 1 --2- 172.21.15.146:0/695226808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c3409ef80 0x7f2c34139ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.511+0000 7f2c3987a700 1 --2- 172.21.15.146:0/695226808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c3409f370 0x7f2c3413a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.511+0000 7f2c38878700 1 -- 172.21.15.146:0/695226808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c3409f370 msgr2=0x7f2c3413a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.511+0000 7f2c38878700 1 --2- 172.21.15.146:0/695226808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c3409f370 0x7f2c3413a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.511+0000 7f2c38878700 1 -- 172.21.15.146:0/695226808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c3409a150 msgr2=0x7f2c341395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.511+0000 7f2c38878700 1 --2- 172.21.15.146:0/695226808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c3409a150 0x7f2c341395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.511+0000 7f2c38878700 1 -- 172.21.15.146:0/695226808 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c240094a0 con 0x7f2c3409ef80 2023-10-03T10:14:31.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.512+0000 7f2c38878700 1 --2- 172.21.15.146:0/695226808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c3409ef80 0x7f2c34139ae0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400e9b0 tx=0x7f2c2400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.512+0000 7f2c29ffb700 1 -- 172.21.15.146:0/695226808 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2400c850 con 0x7f2c3409ef80 2023-10-03T10:14:31.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.512+0000 7f2c29ffb700 1 -- 172.21.15.146:0/695226808 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2400c9b0 con 0x7f2c3409ef80 2023-10-03T10:14:31.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.512+0000 7f2c3b2dd700 1 -- 172.21.15.146:0/695226808 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2c009b30 con 0x7f2c3409ef80 2023-10-03T10:14:31.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.512+0000 7f2c29ffb700 1 -- 172.21.15.146:0/695226808 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2400cd60 con 0x7f2c3409ef80 2023-10-03T10:14:31.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.512+0000 7f2c3b2dd700 1 -- 172.21.15.146:0/695226808 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c3411fc80 con 0x7f2c3409ef80 2023-10-03T10:14:31.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.513+0000 7f2c3b2dd700 1 -- 172.21.15.146:0/695226808 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c3409fa30 con 0x7f2c3409ef80 2023-10-03T10:14:31.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.514+0000 7f2c29ffb700 1 -- 172.21.15.146:0/695226808 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c24013470 con 0x7f2c3409ef80 2023-10-03T10:14:31.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.514+0000 7f2c29ffb700 1 -- 172.21.15.146:0/695226808 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2c2403f940 con 0x7f2c3409ef80 2023-10-03T10:14:31.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.524+0000 7f2c29ffb700 1 -- 172.21.15.146:0/695226808 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c240232f0 con 0x7f2c3409ef80 2023-10-03T10:14:31.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.531+0000 7f53eb091700 1 Processor -- start 2023-10-03T10:14:31.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.531+0000 7f53eb091700 1 -- start start 2023-10-03T10:14:31.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.532+0000 7f53eb091700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f53e409e870 0x7f53e409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.532+0000 7f53eb091700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53e409f180 0x7f53e4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.532+0000 7f53eb091700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e409c970 con 0x7f53e4131d70 2023-10-03T10:14:31.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.532+0000 7f53eb091700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e40a0920 con 0x7f53e409e870 2023-10-03T10:14:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.532+0000 7f53eb091700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53e409f9c0 con 0x7f53e409f180 2023-10-03T10:14:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.532+0000 7f53e8e2d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f53e409e870 0x7f53e409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.532+0000 7f53e962e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f53e4131d70 0x7f53e4138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36874/0 (socket says 172.21.15.146:36874) 2023-10-03T10:14:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.532+0000 7f53e962e700 1 -- 172.21.15.146:0/2911726077 learned_addr learned my addr 172.21.15.146:0/2911726077 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.532+0000 7f53e3fff700 1 --2- 172.21.15.146:0/2911726077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53e409f180 0x7f53e4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.532+0000 7f53e8e2d700 1 -- 172.21.15.146:0/2911726077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53e409f180 msgr2=0x7f53e4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.532+0000 7f53e8e2d700 1 --2- 172.21.15.146:0/2911726077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53e409f180 0x7f53e4131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.532+0000 7f53e8e2d700 1 -- 172.21.15.146:0/2911726077 >> v1:172.21.15.146:6789/0 conn(0x7f53e4131d70 legacy=0x7f53e4138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.532+0000 7f53e8e2d700 1 -- 172.21.15.146:0/2911726077 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e409bab0 con 0x7f53e409e870 2023-10-03T10:14:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.533+0000 7f53e8e2d700 1 --2- 172.21.15.146:0/2911726077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53e409e870 0x7f53e409ec40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f53d8009840 tx=0x7f53d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec386f55a94cb3a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.533+0000 7f53e37fe700 1 -- 172.21.15.146:0/2911726077 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d8011830 con 0x7f53e409e870 2023-10-03T10:14:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.533+0000 7f53e37fe700 1 -- 172.21.15.146:0/2911726077 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d8011990 con 0x7f53e409e870 2023-10-03T10:14:31.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.533+0000 7f53e37fe700 1 -- 172.21.15.146:0/2911726077 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d8011d20 con 0x7f53e409e870 2023-10-03T10:14:31.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.533+0000 7f53eb091700 1 -- 172.21.15.146:0/2911726077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53e409e870 msgr2=0x7f53e409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.533+0000 7f53eb091700 1 --2- 172.21.15.146:0/2911726077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53e409e870 0x7f53e409ec40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f53d8009840 tx=0x7f53d8009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:31.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.533+0000 7f53eb091700 1 -- 172.21.15.146:0/2911726077 shutdown_connections 2023-10-03T10:14:31.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.533+0000 7f53eb091700 1 --2- 172.21.15.146:0/2911726077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53e409e870 0x7f53e409ec40 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.533+0000 7f53eb091700 1 --2- 172.21.15.146:0/2911726077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53e409f180 0x7f53e4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.533+0000 7f53eb091700 1 -- 172.21.15.146:0/2911726077 >> 172.21.15.146:0/2911726077 conn(0x7f53e40a4430 msgr2=0x7f53e40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.533+0000 7f53eb091700 1 -- 172.21.15.146:0/2911726077 shutdown_connections 2023-10-03T10:14:31.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.534+0000 7f53eb091700 1 -- 172.21.15.146:0/2911726077 wait complete. 2023-10-03T10:14:31.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.535+0000 7f53eb091700 1 Processor -- start 2023-10-03T10:14:31.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.535+0000 7f53eb091700 1 -- start start 2023-10-03T10:14:31.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7f53eb091700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53e409e870 0x7f53e4122990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7fd58d10b700 1 Processor -- start 2023-10-03T10:14:31.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7f53eb091700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53e409f180 0x7f53e4122ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7f53eb091700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53e4131d70 0x7f53e406b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7f53eb091700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e4120890 con 0x7f53e4131d70 2023-10-03T10:14:31.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7f53eb091700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e409dba0 con 0x7f53e409f180 2023-10-03T10:14:31.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7f53eb091700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53e406d4b0 con 0x7f53e409e870 2023-10-03T10:14:31.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7fd58d10b700 1 -- start start 2023-10-03T10:14:31.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7f53e962e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53e4131d70 0x7f53e406b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7f53e962e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53e4131d70 0x7f53e406b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44350/0 (socket says 172.21.15.146:44350) 2023-10-03T10:14:31.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7f53e962e700 1 -- 172.21.15.146:0/2718774166 learned_addr learned my addr 172.21.15.146:0/2718774166 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:31.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7f53e3fff700 1 --2- 172.21.15.146:0/2718774166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53e409f180 0x7f53e4122ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7fd58d10b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd588099e20 0x7fd58809a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7f53e3fff700 1 -- 172.21.15.146:0/2718774166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53e409e870 msgr2=0x7f53e4122990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:31.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7f53e3fff700 1 --2- 172.21.15.146:0/2718774166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53e409e870 0x7f53e4122990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7f53e3fff700 1 -- 172.21.15.146:0/2718774166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53e4131d70 msgr2=0x7f53e406b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7f53e3fff700 1 --2- 172.21.15.146:0/2718774166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53e4131d70 0x7f53e406b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7f53e3fff700 1 -- 172.21.15.146:0/2718774166 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d80094a0 con 0x7f53e409f180 2023-10-03T10:14:31.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7fd58d10b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd588130a60 0x7fd588138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7fd58d10b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd588099a60 con 0x7fd58809a730 2023-10-03T10:14:31.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7fd58d10b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd58809bf50 con 0x7fd588099e20 2023-10-03T10:14:31.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7fd58d10b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd58809b230 con 0x7fd588130a60 2023-10-03T10:14:31.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.536+0000 7fd58659c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd58809a730 0x7fd588130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36878/0 (socket says 172.21.15.146:36878) 2023-10-03T10:14:31.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.537+0000 7fd58659c700 1 -- 172.21.15.146:0/4223592357 learned_addr learned my addr 172.21.15.146:0/4223592357 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:31.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.537+0000 7fd586d9d700 1 --2- 172.21.15.146:0/4223592357 >> v2:172.21.15.146:3300/0 conn(0x7fd588099e20 0x7fd58809a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.537+0000 7fd58759e700 1 --2- 172.21.15.146:0/4223592357 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd588130a60 0x7fd588138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.537+0000 7fd585d9b700 1 -- 172.21.15.146:0/4223592357 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417103192 0 0) 0x7fd588099a60 con 0x7fd58809a730 2023-10-03T10:14:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.537+0000 7fd585d9b700 1 -- 172.21.15.146:0/4223592357 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5700079c0 con 0x7fd58809a730 2023-10-03T10:14:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.537+0000 7fd586d9d700 1 -- 172.21.15.146:0/4223592357 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd588130a60 msgr2=0x7fd588138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.537+0000 7fd586d9d700 1 --2- 172.21.15.146:0/4223592357 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd588130a60 0x7fd588138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.537+0000 7fd586d9d700 1 -- 172.21.15.146:0/4223592357 >> v1:172.21.15.146:6789/0 conn(0x7fd58809a730 legacy=0x7fd588130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.537+0000 7fd586d9d700 1 -- 172.21.15.146:0/4223592357 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58809bb90 con 0x7fd588099e20 2023-10-03T10:14:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.537+0000 7fd58759e700 1 --2- 172.21.15.146:0/4223592357 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd588130a60 0x7fd588138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.537+0000 7f53e3fff700 1 --2- 172.21.15.146:0/2718774166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53e409f180 0x7f53e4122ed0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f53d000e810 tx=0x7f53d000eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.537+0000 7f53e17fa700 1 -- 172.21.15.146:0/2718774166 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d000c070 con 0x7f53e409f180 2023-10-03T10:14:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.537+0000 7f53e17fa700 1 -- 172.21.15.146:0/2718774166 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d0013610 con 0x7f53e409f180 2023-10-03T10:14:31.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.537+0000 7f53e17fa700 1 -- 172.21.15.146:0/2718774166 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0013980 con 0x7f53e409f180 2023-10-03T10:14:31.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.537+0000 7fd586d9d700 1 --2- 172.21.15.146:0/4223592357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd588099e20 0x7fd58809a1f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd578009820 tx=0x7fd578009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ff5154e46fccf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.537+0000 7fd585d9b700 1 -- 172.21.15.146:0/4223592357 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578005e30 con 0x7fd588099e20 2023-10-03T10:14:31.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.537+0000 7fd585d9b700 1 -- 172.21.15.146:0/4223592357 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd578006030 con 0x7fd588099e20 2023-10-03T10:14:31.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.537+0000 7fd585d9b700 1 -- 172.21.15.146:0/4223592357 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5780063c0 con 0x7fd588099e20 2023-10-03T10:14:31.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.538+0000 7fd58d10b700 1 -- 172.21.15.146:0/4223592357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd588099e20 msgr2=0x7fd58809a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.538+0000 7fd58d10b700 1 --2- 172.21.15.146:0/4223592357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd588099e20 0x7fd58809a1f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd578009820 tx=0x7fd578009b30 comp rx=0 tx=0).stop 2023-10-03T10:14:31.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.538+0000 7fd58d10b700 1 -- 172.21.15.146:0/4223592357 shutdown_connections 2023-10-03T10:14:31.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.538+0000 7fd58d10b700 1 --2- 172.21.15.146:0/4223592357 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd588130a60 0x7fd588138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.538+0000 7fd58d10b700 1 --2- 172.21.15.146:0/4223592357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd588099e20 0x7fd58809a1f0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.538+0000 7fd58d10b700 1 -- 172.21.15.146:0/4223592357 >> 172.21.15.146:0/4223592357 conn(0x7fd5880a2980 msgr2=0x7fd5880a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.537+0000 7f53eb091700 1 -- 172.21.15.146:0/2718774166 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e40a2d30 con 0x7f53e409f180 2023-10-03T10:14:31.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.537+0000 7f53eb091700 1 -- 172.21.15.146:0/2718774166 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e4121300 con 0x7f53e409f180 2023-10-03T10:14:31.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.538+0000 7fd58d10b700 1 -- 172.21.15.146:0/4223592357 shutdown_connections 2023-10-03T10:14:31.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.538+0000 7fd58d10b700 1 -- 172.21.15.146:0/4223592357 wait complete. 2023-10-03T10:14:31.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.538+0000 7f53eb091700 1 -- 172.21.15.146:0/2718774166 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e404f2a0 con 0x7f53e409f180 2023-10-03T10:14:31.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.539+0000 7f53e17fa700 1 -- 172.21.15.146:0/2718774166 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f53d0013ae0 con 0x7f53e409f180 2023-10-03T10:14:31.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.539+0000 7f53e17fa700 1 -- 172.21.15.146:0/2718774166 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f53d003f570 con 0x7f53e409f180 2023-10-03T10:14:31.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.540+0000 7fd58d10b700 1 Processor -- start 2023-10-03T10:14:31.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.540+0000 7fd58d10b700 1 -- start start 2023-10-03T10:14:31.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.541+0000 7fd58d10b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd588099e20 0x7fd58811a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.541+0000 7fd58d10b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd58809a730 0x7fd58811acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.541+0000 7fd58d10b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd588130a60 0x7fd58811b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.541+0000 7fd58d10b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58811e210 con 0x7fd588099e20 2023-10-03T10:14:31.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.541+0000 7fd58d10b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58811c8e0 con 0x7fd588130a60 2023-10-03T10:14:31.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.541+0000 7fd58d10b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd58811d9a0 con 0x7fd58809a730 2023-10-03T10:14:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.541+0000 7fd58759e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd588130a60 0x7fd58811b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.541+0000 7fd58759e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd588130a60 0x7fd58811b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42286/0 (socket says 172.21.15.146:42286) 2023-10-03T10:14:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.541+0000 7fd58759e700 1 -- 172.21.15.146:0/1378211299 learned_addr learned my addr 172.21.15.146:0/1378211299 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.541+0000 7fd586d9d700 1 --2- 172.21.15.146:0/1378211299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd588099e20 0x7fd58811a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.541+0000 7fd58659c700 1 --2- 172.21.15.146:0/1378211299 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd58809a730 0x7fd58811acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.541+0000 7fd58759e700 1 -- 172.21.15.146:0/1378211299 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd58809a730 msgr2=0x7fd58811acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.541+0000 7fd58759e700 1 --2- 172.21.15.146:0/1378211299 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd58809a730 0x7fd58811acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.541+0000 7fd58759e700 1 -- 172.21.15.146:0/1378211299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd588099e20 msgr2=0x7fd58811a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.541+0000 7fd58759e700 1 --2- 172.21.15.146:0/1378211299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd588099e20 0x7fd58811a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.541+0000 7fd58759e700 1 -- 172.21.15.146:0/1378211299 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd578009430 con 0x7fd588130a60 2023-10-03T10:14:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.541+0000 7fd586d9d700 1 --2- 172.21.15.146:0/1378211299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd588099e20 0x7fd58811a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.541+0000 7fd58759e700 1 --2- 172.21.15.146:0/1378211299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd588130a60 0x7fd58811b200 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd580009ea0 tx=0x7fd5800084e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.545+0000 7fd56f7fe700 1 -- 172.21.15.146:0/1378211299 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd580010070 con 0x7fd588130a60 2023-10-03T10:14:31.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.545+0000 7fd56f7fe700 1 -- 172.21.15.146:0/1378211299 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58000b350 con 0x7fd588130a60 2023-10-03T10:14:31.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.545+0000 7fd56f7fe700 1 -- 172.21.15.146:0/1378211299 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd580008c60 con 0x7fd588130a60 2023-10-03T10:14:31.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.545+0000 7fd58d10b700 1 -- 172.21.15.146:0/1378211299 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd58809b470 con 0x7fd588130a60 2023-10-03T10:14:31.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.545+0000 7fd58d10b700 1 -- 172.21.15.146:0/1378211299 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd58811c300 con 0x7fd588130a60 2023-10-03T10:14:31.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.545+0000 7f53e17fa700 1 -- 172.21.15.146:0/2718774166 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f53d0010900 con 0x7f53e409f180 2023-10-03T10:14:31.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.546+0000 7fd58d10b700 1 -- 172.21.15.146:0/1378211299 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd58804f2a0 con 0x7fd588130a60 2023-10-03T10:14:31.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.552+0000 7fd56f7fe700 1 -- 172.21.15.146:0/1378211299 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd580014070 con 0x7fd588130a60 2023-10-03T10:14:31.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.552+0000 7fd56f7fe700 1 -- 172.21.15.146:0/1378211299 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd58003f7e0 con 0x7fd588130a60 2023-10-03T10:14:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.559+0000 7fd56f7fe700 1 -- 172.21.15.146:0/1378211299 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd58001db90 con 0x7fd588130a60 2023-10-03T10:14:31.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.694+0000 7f4e28dce700 1 -- 172.21.15.146:0/2706880372 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4e2409f0f0 con 0x7f4e24136960 2023-10-03T10:14:31.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.694+0000 7f4e12ffd700 1 -- 172.21.15.146:0/2706880372 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4e1801b430 con 0x7f4e24136960 2023-10-03T10:14:31.695 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:31.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.696+0000 7f4e28dce700 1 -- 172.21.15.146:0/2706880372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e24136960 msgr2=0x7f4e24071d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.696+0000 7f4e28dce700 1 --2- 172.21.15.146:0/2706880372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e24136960 0x7f4e24071d70 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f4e18016000 tx=0x7f4e18004750 comp rx=0 tx=0).stop 2023-10-03T10:14:31.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.696+0000 7f4e28dce700 1 -- 172.21.15.146:0/2706880372 shutdown_connections 2023-10-03T10:14:31.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.696+0000 7f4e28dce700 1 --2- 172.21.15.146:0/2706880372 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e24139280 0x7f4e241c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.696+0000 7f4e28dce700 1 --2- 172.21.15.146:0/2706880372 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e24133ad0 0x7f4e24071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.696+0000 7f4e28dce700 1 --2- 172.21.15.146:0/2706880372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e24136960 0x7f4e24071d70 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.696+0000 7f4e28dce700 1 -- 172.21.15.146:0/2706880372 >> 172.21.15.146:0/2706880372 conn(0x7f4e24099c40 msgr2=0x7f4e24138700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.697+0000 7f4e28dce700 1 -- 172.21.15.146:0/2706880372 shutdown_connections 2023-10-03T10:14:31.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.697+0000 7f4e28dce700 1 -- 172.21.15.146:0/2706880372 wait complete. 2023-10-03T10:14:31.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:31.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.721+0000 7f2c3b2dd700 1 -- 172.21.15.146:0/695226808 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2c340a0440 con 0x7f2c3409ef80 2023-10-03T10:14:31.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.722+0000 7f2c29ffb700 1 -- 172.21.15.146:0/695226808 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2c24017030 con 0x7f2c3409ef80 2023-10-03T10:14:31.723 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:31.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.724+0000 7f2c3b2dd700 1 -- 172.21.15.146:0/695226808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c3409ef80 msgr2=0x7f2c34139ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.724+0000 7f2c3b2dd700 1 --2- 172.21.15.146:0/695226808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c3409ef80 0x7f2c34139ae0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400e9b0 tx=0x7f2c2400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.724+0000 7f2c3b2dd700 1 -- 172.21.15.146:0/695226808 shutdown_connections 2023-10-03T10:14:31.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.724+0000 7f2c3b2dd700 1 --2- 172.21.15.146:0/695226808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c3409f370 0x7f2c3413a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.724+0000 7f2c3b2dd700 1 --2- 172.21.15.146:0/695226808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c3409a150 0x7f2c341395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.724+0000 7f2c3b2dd700 1 --2- 172.21.15.146:0/695226808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c3409ef80 0x7f2c34139ae0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.724+0000 7f2c3b2dd700 1 -- 172.21.15.146:0/695226808 >> 172.21.15.146:0/695226808 conn(0x7f2c340a4430 msgr2=0x7f2c340a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.724+0000 7f2c3b2dd700 1 -- 172.21.15.146:0/695226808 shutdown_connections 2023-10-03T10:14:31.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.724+0000 7f2c3b2dd700 1 -- 172.21.15.146:0/695226808 wait complete. 2023-10-03T10:14:31.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:31.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.745+0000 7f53eb091700 1 -- 172.21.15.146:0/2718774166 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f53e406b2a0 con 0x7f53e409f180 2023-10-03T10:14:31.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.745+0000 7f53e17fa700 1 -- 172.21.15.146:0/2718774166 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f53d0010310 con 0x7f53e409f180 2023-10-03T10:14:31.746 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:31.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.747+0000 7f53eb091700 1 -- 172.21.15.146:0/2718774166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53e409f180 msgr2=0x7f53e4122ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.747+0000 7f53eb091700 1 --2- 172.21.15.146:0/2718774166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53e409f180 0x7f53e4122ed0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f53d000e810 tx=0x7f53d000eb20 comp rx=0 tx=0).stop 2023-10-03T10:14:31.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.747+0000 7f53eb091700 1 -- 172.21.15.146:0/2718774166 shutdown_connections 2023-10-03T10:14:31.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.747+0000 7f53eb091700 1 --2- 172.21.15.146:0/2718774166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53e4131d70 0x7f53e406b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.747+0000 7f53eb091700 1 --2- 172.21.15.146:0/2718774166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53e409e870 0x7f53e4122990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.747+0000 7f53eb091700 1 --2- 172.21.15.146:0/2718774166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53e409f180 0x7f53e4122ed0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.747+0000 7f53eb091700 1 -- 172.21.15.146:0/2718774166 >> 172.21.15.146:0/2718774166 conn(0x7f53e40a4430 msgr2=0x7f53e41310a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.747+0000 7f53eb091700 1 -- 172.21.15.146:0/2718774166 shutdown_connections 2023-10-03T10:14:31.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.747+0000 7f53eb091700 1 -- 172.21.15.146:0/2718774166 wait complete. 2023-10-03T10:14:31.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.753+0000 7fd58d10b700 1 -- 172.21.15.146:0/1378211299 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd58806bce0 con 0x7fd588130a60 2023-10-03T10:14:31.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.754+0000 7fd56f7fe700 1 -- 172.21.15.146:0/1378211299 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd58001d780 con 0x7fd588130a60 2023-10-03T10:14:31.754 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:31.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.756+0000 7fd58d10b700 1 -- 172.21.15.146:0/1378211299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd588130a60 msgr2=0x7fd58811b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.756+0000 7fd58d10b700 1 --2- 172.21.15.146:0/1378211299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd588130a60 0x7fd58811b200 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd580009ea0 tx=0x7fd5800084e0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.756+0000 7fd58d10b700 1 -- 172.21.15.146:0/1378211299 shutdown_connections 2023-10-03T10:14:31.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.756+0000 7fd58d10b700 1 --2- 172.21.15.146:0/1378211299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd588130a60 0x7fd58811b200 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.756+0000 7fd58d10b700 1 --2- 172.21.15.146:0/1378211299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd588099e20 0x7fd58811a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.756+0000 7fd58d10b700 1 --2- 172.21.15.146:0/1378211299 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd58809a730 0x7fd58811acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.756+0000 7fd58d10b700 1 -- 172.21.15.146:0/1378211299 >> 172.21.15.146:0/1378211299 conn(0x7fd5880a2980 msgr2=0x7fd58812d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.756+0000 7fd58d10b700 1 -- 172.21.15.146:0/1378211299 shutdown_connections 2023-10-03T10:14:31.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:31.756+0000 7fd58d10b700 1 -- 172.21.15.146:0/1378211299 wait complete. 2023-10-03T10:14:31.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:31.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:32.711 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:32.738 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:32.762 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:32.769 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:32.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.851+0000 7f16d1424700 1 Processor -- start 2023-10-03T10:14:32.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.851+0000 7f16d1424700 1 -- start start 2023-10-03T10:14:32.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.851+0000 7f16d1424700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16cc1368e0 0x7f16cc138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.851+0000 7f16d1424700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16cc139200 0x7f16cc13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.851+0000 7f16d1424700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16cc09a760 con 0x7f16cc133900 2023-10-03T10:14:32.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.851+0000 7f16d1424700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16cc1336e0 con 0x7f16cc1368e0 2023-10-03T10:14:32.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.851+0000 7f16d1424700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc09a080 con 0x7f16cc139200 2023-10-03T10:14:32.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.851+0000 7f16caffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f16cc133900 0x7f16cc133cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36886/0 (socket says 172.21.15.146:36886) 2023-10-03T10:14:32.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.851+0000 7f16cb7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16cc139200 0x7f16cc13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.851+0000 7f16caffd700 1 -- 172.21.15.146:0/1231654605 learned_addr learned my addr 172.21.15.146:0/1231654605 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:32.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.852+0000 7f16ca7fc700 1 --2- 172.21.15.146:0/1231654605 >> v2:172.21.15.146:3300/0 conn(0x7f16cc1368e0 0x7f16cc138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.852+0000 7f16cb7fe700 1 -- 172.21.15.146:0/1231654605 >> v2:172.21.15.146:3300/0 conn(0x7f16cc1368e0 msgr2=0x7f16cc138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:32.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.852+0000 7f16cb7fe700 1 --2- 172.21.15.146:0/1231654605 >> v2:172.21.15.146:3300/0 conn(0x7f16cc1368e0 0x7f16cc138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.852+0000 7f16cb7fe700 1 -- 172.21.15.146:0/1231654605 >> v1:172.21.15.146:6789/0 conn(0x7f16cc133900 legacy=0x7f16cc133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.852+0000 7f16cb7fe700 1 -- 172.21.15.146:0/1231654605 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc0a23e0 con 0x7f16cc139200 2023-10-03T10:14:32.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.852+0000 7f16c9ffb700 1 -- 172.21.15.146:0/1231654605 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609024130 0 0) 0x7f16cc09a760 con 0x7f16cc133900 2023-10-03T10:14:32.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.852+0000 7f16cb7fe700 1 --2- 172.21.15.146:0/1231654605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16cc139200 0x7f16cc13b5e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009d90 tx=0x7f16c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af02e0fc8ff8ff32 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.852+0000 7f16c9ffb700 1 -- 172.21.15.146:0/1231654605 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c400e070 con 0x7f16cc139200 2023-10-03T10:14:32.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.852+0000 7f16c9ffb700 1 -- 172.21.15.146:0/1231654605 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c400bbd0 con 0x7f16cc139200 2023-10-03T10:14:32.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.852+0000 7f16c9ffb700 1 -- 172.21.15.146:0/1231654605 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c4012430 con 0x7f16cc139200 2023-10-03T10:14:32.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.853+0000 7f16d1424700 1 -- 172.21.15.146:0/1231654605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16cc139200 msgr2=0x7f16cc13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.853+0000 7f16d1424700 1 --2- 172.21.15.146:0/1231654605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16cc139200 0x7f16cc13b5e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009d90 tx=0x7f16c400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:32.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.853+0000 7f16d1424700 1 -- 172.21.15.146:0/1231654605 shutdown_connections 2023-10-03T10:14:32.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.853+0000 7f16d1424700 1 --2- 172.21.15.146:0/1231654605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16cc139200 0x7f16cc13b5e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.853+0000 7f16d1424700 1 --2- 172.21.15.146:0/1231654605 >> v2:172.21.15.146:3300/0 conn(0x7f16cc1368e0 0x7f16cc138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.853+0000 7f16d1424700 1 -- 172.21.15.146:0/1231654605 >> 172.21.15.146:0/1231654605 conn(0x7f16cc0a2980 msgr2=0x7f16cc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.853+0000 7f16d1424700 1 -- 172.21.15.146:0/1231654605 shutdown_connections 2023-10-03T10:14:32.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.853+0000 7f16d1424700 1 -- 172.21.15.146:0/1231654605 wait complete. 2023-10-03T10:14:32.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.855+0000 7f16d1424700 1 Processor -- start 2023-10-03T10:14:32.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.855+0000 7f16d1424700 1 -- start start 2023-10-03T10:14:32.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.855+0000 7f16d1424700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16cc133900 0x7f16cc11ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.855+0000 7f16d1424700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16cc1368e0 0x7f16cc11b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.855+0000 7f16d1424700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16cc139200 0x7f16cc11b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.855+0000 7f16d1424700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc11ea30 con 0x7f16cc133900 2023-10-03T10:14:32.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.856+0000 7f16d1424700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc09a2c0 con 0x7f16cc139200 2023-10-03T10:14:32.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.856+0000 7f16d1424700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc138fd0 con 0x7f16cc1368e0 2023-10-03T10:14:32.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.856+0000 7f16cb7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16cc139200 0x7f16cc11b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.856+0000 7f16cb7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16cc139200 0x7f16cc11b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42306/0 (socket says 172.21.15.146:42306) 2023-10-03T10:14:32.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.856+0000 7f16cb7fe700 1 -- 172.21.15.146:0/140760849 learned_addr learned my addr 172.21.15.146:0/140760849 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:32.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.856+0000 7f16ca7fc700 1 --2- 172.21.15.146:0/140760849 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16cc1368e0 0x7f16cc11b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.856+0000 7f16caffd700 1 --2- 172.21.15.146:0/140760849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16cc133900 0x7f16cc11ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.856+0000 7f16ca7fc700 1 -- 172.21.15.146:0/140760849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16cc139200 msgr2=0x7f16cc11b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.856+0000 7f16ca7fc700 1 --2- 172.21.15.146:0/140760849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16cc139200 0x7f16cc11b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.856+0000 7f16ca7fc700 1 -- 172.21.15.146:0/140760849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16cc133900 msgr2=0x7f16cc11ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.856+0000 7f16ca7fc700 1 --2- 172.21.15.146:0/140760849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16cc133900 0x7f16cc11ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.856+0000 7f16ca7fc700 1 -- 172.21.15.146:0/140760849 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c4009a70 con 0x7f16cc1368e0 2023-10-03T10:14:32.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.856+0000 7f16ca7fc700 1 --2- 172.21.15.146:0/140760849 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16cc1368e0 0x7f16cc11b3b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f16c000e7e0 tx=0x7f16c000eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.856+0000 7f16b37fe700 1 -- 172.21.15.146:0/140760849 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c000c070 con 0x7f16cc1368e0 2023-10-03T10:14:32.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.857+0000 7f16b37fe700 1 -- 172.21.15.146:0/140760849 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c0013610 con 0x7f16cc1368e0 2023-10-03T10:14:32.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.857+0000 7f16d1424700 1 -- 172.21.15.146:0/140760849 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16cc11e120 con 0x7f16cc1368e0 2023-10-03T10:14:32.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.857+0000 7f16b37fe700 1 -- 172.21.15.146:0/140760849 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c0013980 con 0x7f16cc1368e0 2023-10-03T10:14:32.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.857+0000 7f16d1424700 1 -- 172.21.15.146:0/140760849 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16cc11e6b0 con 0x7f16cc1368e0 2023-10-03T10:14:32.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.858+0000 7f16d1424700 1 -- 172.21.15.146:0/140760849 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16cc04f2a0 con 0x7f16cc1368e0 2023-10-03T10:14:32.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.858+0000 7f16b37fe700 1 -- 172.21.15.146:0/140760849 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f16c0013ae0 con 0x7f16cc1368e0 2023-10-03T10:14:32.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.859+0000 7f16b37fe700 1 -- 172.21.15.146:0/140760849 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f16c003f8b0 con 0x7f16cc1368e0 2023-10-03T10:14:32.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.867+0000 7f16b37fe700 1 -- 172.21.15.146:0/140760849 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16c0024940 con 0x7f16cc1368e0 2023-10-03T10:14:32.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.897+0000 7f07e3797700 1 Processor -- start 2023-10-03T10:14:32.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.897+0000 7f07e3797700 1 -- start start 2023-10-03T10:14:32.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.897+0000 7f07e3797700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07dc099e20 0x7f07dc09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.897+0000 7f07e3797700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f07dc09a730 0x7f07dc130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.897+0000 7f07e3797700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07dc130890 0x7f07dc130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.897+0000 7f07e3797700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07dc09bf50 con 0x7f07dc09a730 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.897+0000 7f07e3797700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc099a60 con 0x7f07dc130890 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.897+0000 7f07e3797700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc09b230 con 0x7f07dc099e20 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.898+0000 7f07e1533700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07dc099e20 0x7f07dc09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.898+0000 7f07e1533700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07dc099e20 0x7f07dc09a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:50340/0 (socket says 172.21.15.146:50340) 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.898+0000 7f07e1533700 1 -- 172.21.15.146:0/2989046897 learned_addr learned my addr 172.21.15.146:0/2989046897 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.898+0000 7f07e0d32700 1 --2- 172.21.15.146:0/2989046897 >> v2:172.21.15.146:3300/0 conn(0x7f07dc09a730 0x7f07dc130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.898+0000 7f07e1d34700 1 --2- 172.21.15.146:0/2989046897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07dc130890 0x7f07dc130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.898+0000 7f07e0d32700 1 -- 172.21.15.146:0/2989046897 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07dc099e20 msgr2=0x7f07dc09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.898+0000 7f07e0d32700 1 --2- 172.21.15.146:0/2989046897 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07dc099e20 0x7f07dc09a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.898+0000 7f07e0d32700 1 -- 172.21.15.146:0/2989046897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07dc130890 msgr2=0x7f07dc130d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:32.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.898+0000 7f07e0d32700 1 --2- 172.21.15.146:0/2989046897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07dc130890 0x7f07dc130d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.898+0000 7f07e0d32700 1 -- 172.21.15.146:0/2989046897 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc09bb90 con 0x7f07dc09a730 2023-10-03T10:14:32.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.898+0000 7f07e1533700 1 --2- 172.21.15.146:0/2989046897 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07dc099e20 0x7f07dc09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:32.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.898+0000 7f07e0d32700 1 --2- 172.21.15.146:0/2989046897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07dc09a730 0x7f07dc130350 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009870 tx=0x7f07cc009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9866d360afb876 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.899+0000 7f07d3fff700 1 -- 172.21.15.146:0/2989046897 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc011830 con 0x7f07dc09a730 2023-10-03T10:14:32.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.899+0000 7f07d3fff700 1 -- 172.21.15.146:0/2989046897 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07cc011990 con 0x7f07dc09a730 2023-10-03T10:14:32.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.899+0000 7f07d3fff700 1 -- 172.21.15.146:0/2989046897 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc011d20 con 0x7f07dc09a730 2023-10-03T10:14:32.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.899+0000 7f07e3797700 1 -- 172.21.15.146:0/2989046897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07dc09a730 msgr2=0x7f07dc130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.899+0000 7f07e3797700 1 --2- 172.21.15.146:0/2989046897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07dc09a730 0x7f07dc130350 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f07cc009870 tx=0x7f07cc009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:32.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.899+0000 7f07e3797700 1 -- 172.21.15.146:0/2989046897 shutdown_connections 2023-10-03T10:14:32.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.899+0000 7f07e3797700 1 --2- 172.21.15.146:0/2989046897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07dc130890 0x7f07dc130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.899+0000 7f07e3797700 1 --2- 172.21.15.146:0/2989046897 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07dc099e20 0x7f07dc09a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.899+0000 7f07e3797700 1 --2- 172.21.15.146:0/2989046897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07dc09a730 0x7f07dc130350 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.899+0000 7f07e3797700 1 -- 172.21.15.146:0/2989046897 >> 172.21.15.146:0/2989046897 conn(0x7f07dc0a2980 msgr2=0x7f07dc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.899+0000 7f07e3797700 1 -- 172.21.15.146:0/2989046897 shutdown_connections 2023-10-03T10:14:32.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.899+0000 7f07e3797700 1 -- 172.21.15.146:0/2989046897 wait complete. 2023-10-03T10:14:32.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.901+0000 7f07e3797700 1 Processor -- start 2023-10-03T10:14:32.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.901+0000 7f07e3797700 1 -- start start 2023-10-03T10:14:32.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.901+0000 7f07e3797700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07dc099e20 0x7f07dc1198b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.902+0000 7f07e3797700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07dc09a730 0x7f07dc119df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.902+0000 7f07e3797700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07dc130890 0x7f07dc11a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.902+0000 7f07e3797700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc09da90 con 0x7f07dc130890 2023-10-03T10:14:32.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.902+0000 7f07e3797700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc11c280 con 0x7f07dc099e20 2023-10-03T10:14:32.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.902+0000 7f07e3797700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc11b4f0 con 0x7f07dc09a730 2023-10-03T10:14:32.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.902+0000 7f07e1533700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07dc099e20 0x7f07dc1198b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.902+0000 7f07e1533700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07dc099e20 0x7f07dc1198b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:42320/0 (socket says 172.21.15.146:42320) 2023-10-03T10:14:32.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.902+0000 7f07e1533700 1 -- 172.21.15.146:0/756109139 learned_addr learned my addr 172.21.15.146:0/756109139 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:32.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.902+0000 7f07e1d34700 1 --2- 172.21.15.146:0/756109139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07dc130890 0x7f07dc11a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.902+0000 7f07e0d32700 1 --2- 172.21.15.146:0/756109139 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07dc09a730 0x7f07dc119df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.902+0000 7f07e1533700 1 -- 172.21.15.146:0/756109139 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07dc09a730 msgr2=0x7f07dc119df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.902+0000 7f07e1533700 1 --2- 172.21.15.146:0/756109139 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07dc09a730 0x7f07dc119df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.902+0000 7f07e1533700 1 -- 172.21.15.146:0/756109139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07dc130890 msgr2=0x7f07dc11a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.902+0000 7f07e1533700 1 --2- 172.21.15.146:0/756109139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07dc130890 0x7f07dc11a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.902+0000 7f07e1533700 1 -- 172.21.15.146:0/756109139 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d8009500 con 0x7f07dc099e20 2023-10-03T10:14:32.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.902+0000 7f07e1d34700 1 --2- 172.21.15.146:0/756109139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07dc130890 0x7f07dc11a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:32.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.902+0000 7f07e1533700 1 --2- 172.21.15.146:0/756109139 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07dc099e20 0x7f07dc1198b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f07d800ebb0 tx=0x7f07d800eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.903+0000 7f07d1ffb700 1 -- 172.21.15.146:0/756109139 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8005a20 con 0x7f07dc099e20 2023-10-03T10:14:32.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.903+0000 7f07d1ffb700 1 -- 172.21.15.146:0/756109139 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d8005b80 con 0x7f07dc099e20 2023-10-03T10:14:32.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.903+0000 7f07d1ffb700 1 -- 172.21.15.146:0/756109139 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d800c850 con 0x7f07dc099e20 2023-10-03T10:14:32.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.903+0000 7f07e3797700 1 -- 172.21.15.146:0/756109139 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07cc0094a0 con 0x7f07dc099e20 2023-10-03T10:14:32.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.903+0000 7f07e3797700 1 -- 172.21.15.146:0/756109139 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07dc09b4c0 con 0x7f07dc099e20 2023-10-03T10:14:32.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.904+0000 7f07e3797700 1 -- 172.21.15.146:0/756109139 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07dc11d410 con 0x7f07dc099e20 2023-10-03T10:14:32.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.904+0000 7f07d1ffb700 1 -- 172.21.15.146:0/756109139 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07d800c9b0 con 0x7f07dc099e20 2023-10-03T10:14:32.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.905+0000 7f07d1ffb700 1 -- 172.21.15.146:0/756109139 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f07d803fe30 con 0x7f07dc099e20 2023-10-03T10:14:32.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.913+0000 7f07d1ffb700 1 -- 172.21.15.146:0/756109139 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07d8023350 con 0x7f07dc099e20 2023-10-03T10:14:32.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.937+0000 7f951f978700 1 Processor -- start 2023-10-03T10:14:32.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.938+0000 7f4cbf9df700 1 Processor -- start 2023-10-03T10:14:32.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.937+0000 7f951f978700 1 -- start start 2023-10-03T10:14:32.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.938+0000 7f951f978700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95180a0a30 0x7f95180a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.938+0000 7f951f978700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95180a1340 0x7f951812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.938+0000 7f951f978700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f95181304a0 0x7f95181308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.938+0000 7f951f978700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9518130e30 con 0x7f95181304a0 2023-10-03T10:14:32.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.938+0000 7f951f978700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95180a1e70 con 0x7f95180a1340 2023-10-03T10:14:32.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.938+0000 7f951f978700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f951809a720 con 0x7f95180a0a30 2023-10-03T10:14:32.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.938+0000 7f951d714700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95180a0a30 0x7f95180a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.938+0000 7f951d714700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95180a0a30 0x7f95180a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:50364/0 (socket says 172.21.15.146:50364) 2023-10-03T10:14:32.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.938+0000 7f951d714700 1 -- 172.21.15.146:0/3752015023 learned_addr learned my addr 172.21.15.146:0/3752015023 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:32.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.938+0000 7f951df15700 1 --2- 172.21.15.146:0/3752015023 >> v2:172.21.15.146:3300/0 conn(0x7f95181304a0 0x7f95181308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.938+0000 7f4cbf9df700 1 -- start start 2023-10-03T10:14:32.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.938+0000 7f951df15700 1 -- 172.21.15.146:0/3752015023 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95180a0a30 msgr2=0x7f95180a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:32.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.938+0000 7f951df15700 1 --2- 172.21.15.146:0/3752015023 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95180a0a30 0x7f95180a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.938+0000 7f951df15700 1 -- 172.21.15.146:0/3752015023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95180a1340 msgr2=0x7f951812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:32.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.938+0000 7f951df15700 1 --2- 172.21.15.146:0/3752015023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95180a1340 0x7f951812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.938+0000 7f951df15700 1 -- 172.21.15.146:0/3752015023 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951809b300 con 0x7f95181304a0 2023-10-03T10:14:32.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.939+0000 7f951df15700 1 --2- 172.21.15.146:0/3752015023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95181304a0 0x7f95181308f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f9510009d90 tx=0x7f951000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4304481b902435ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.939+0000 7f950ffff700 1 -- 172.21.15.146:0/3752015023 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951000e070 con 0x7f95181304a0 2023-10-03T10:14:32.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.939+0000 7f950ffff700 1 -- 172.21.15.146:0/3752015023 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951000bb20 con 0x7f95181304a0 2023-10-03T10:14:32.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.939+0000 7f950ffff700 1 -- 172.21.15.146:0/3752015023 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9510012430 con 0x7f95181304a0 2023-10-03T10:14:32.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.940+0000 7f951f978700 1 -- 172.21.15.146:0/3752015023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95181304a0 msgr2=0x7f95181308f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.940+0000 7f951f978700 1 --2- 172.21.15.146:0/3752015023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95181304a0 0x7f95181308f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f9510009d90 tx=0x7f951000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:32.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.939+0000 7f4cbf9df700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4cb8066410 0x7f4cb80a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.939+0000 7f4cbf9df700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4cb80667e0 0x7f4cb80a0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.939+0000 7f4cbf9df700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4cb80a14b0 0x7f4cb812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.939+0000 7f4cbf9df700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb80a1900 con 0x7f4cb8066410 2023-10-03T10:14:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.939+0000 7f4cbf9df700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb80a1e70 con 0x7f4cb80a14b0 2023-10-03T10:14:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.939+0000 7f4cbf9df700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb809a720 con 0x7f4cb80667e0 2023-10-03T10:14:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.939+0000 7f4cbd77b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4cb8066410 0x7f4cb80a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.939+0000 7f4cbd77b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4cb8066410 0x7f4cb80a0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44450/0 (socket says 172.21.15.146:44450) 2023-10-03T10:14:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.939+0000 7f4cbd77b700 1 -- 172.21.15.146:0/2425009117 learned_addr learned my addr 172.21.15.146:0/2425009117 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.939+0000 7f4cbcf7a700 1 --2- 172.21.15.146:0/2425009117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4cb80667e0 0x7f4cb80a0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.939+0000 7f4cbdf7c700 1 --2- 172.21.15.146:0/2425009117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4cb80a14b0 0x7f4cb812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.939+0000 7f4cbd77b700 1 -- 172.21.15.146:0/2425009117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4cb80667e0 msgr2=0x7f4cb80a0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.939+0000 7f4cbd77b700 1 --2- 172.21.15.146:0/2425009117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4cb80667e0 0x7f4cb80a0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.939+0000 7f4cbd77b700 1 -- 172.21.15.146:0/2425009117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4cb80a14b0 msgr2=0x7f4cb812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.939+0000 7f4cbd77b700 1 --2- 172.21.15.146:0/2425009117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4cb80a14b0 0x7f4cb812ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.939+0000 7f4cbd77b700 1 -- 172.21.15.146:0/2425009117 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb809b300 con 0x7f4cb8066410 2023-10-03T10:14:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.939+0000 7f4cbdf7c700 1 --2- 172.21.15.146:0/2425009117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4cb80a14b0 0x7f4cb812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.940+0000 7f4cbd77b700 1 --2- 172.21.15.146:0/2425009117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cb8066410 0x7f4cb80a0a30 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009e40 tx=0x7f4cb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bb01ed060d8aa5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.940+0000 7f4cabfff700 1 -- 172.21.15.146:0/2425009117 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb000e070 con 0x7f4cb8066410 2023-10-03T10:14:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.940+0000 7f4cabfff700 1 -- 172.21.15.146:0/2425009117 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb000b910 con 0x7f4cb8066410 2023-10-03T10:14:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.940+0000 7f4cabfff700 1 -- 172.21.15.146:0/2425009117 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb000bcc0 con 0x7f4cb8066410 2023-10-03T10:14:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.940+0000 7f951f978700 1 -- 172.21.15.146:0/3752015023 shutdown_connections 2023-10-03T10:14:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.940+0000 7f951f978700 1 --2- 172.21.15.146:0/3752015023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95181304a0 0x7f95181308f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.940+0000 7f951f978700 1 --2- 172.21.15.146:0/3752015023 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95180a0a30 0x7f95180a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.940+0000 7f951f978700 1 --2- 172.21.15.146:0/3752015023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95180a1340 0x7f951812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.940+0000 7f951f978700 1 -- 172.21.15.146:0/3752015023 >> 172.21.15.146:0/3752015023 conn(0x7f95180a2980 msgr2=0x7f95180a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.941+0000 7f951f978700 1 -- 172.21.15.146:0/3752015023 shutdown_connections 2023-10-03T10:14:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.941+0000 7f951f978700 1 -- 172.21.15.146:0/3752015023 wait complete. 2023-10-03T10:14:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.941+0000 7f4cbf9df700 1 -- 172.21.15.146:0/2425009117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cb8066410 msgr2=0x7f4cb80a0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.941+0000 7f4cbf9df700 1 --2- 172.21.15.146:0/2425009117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cb8066410 0x7f4cb80a0a30 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009e40 tx=0x7f4cb000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.941+0000 7f4cbf9df700 1 -- 172.21.15.146:0/2425009117 shutdown_connections 2023-10-03T10:14:32.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.941+0000 7f4cbf9df700 1 --2- 172.21.15.146:0/2425009117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4cb80a14b0 0x7f4cb812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.941+0000 7f4cbf9df700 1 --2- 172.21.15.146:0/2425009117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cb8066410 0x7f4cb80a0a30 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.941+0000 7f4cbf9df700 1 --2- 172.21.15.146:0/2425009117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4cb80667e0 0x7f4cb80a0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.941+0000 7f4cbf9df700 1 -- 172.21.15.146:0/2425009117 >> 172.21.15.146:0/2425009117 conn(0x7f4cb80a2980 msgr2=0x7f4cb80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.941+0000 7f4cbf9df700 1 -- 172.21.15.146:0/2425009117 shutdown_connections 2023-10-03T10:14:32.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.941+0000 7f4cbf9df700 1 -- 172.21.15.146:0/2425009117 wait complete. 2023-10-03T10:14:32.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.942+0000 7f951f978700 1 Processor -- start 2023-10-03T10:14:32.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.942+0000 7f951f978700 1 -- start start 2023-10-03T10:14:32.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.942+0000 7f951f978700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95180a0a30 0x7f951811fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.942+0000 7f951f978700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95180a1340 0x7f951811ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.942+0000 7f951f978700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95181304a0 0x7f95181c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.942+0000 7f951f978700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9518122be0 con 0x7f95181304a0 2023-10-03T10:14:32.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.942+0000 7f951f978700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951811f6b0 con 0x7f95180a0a30 2023-10-03T10:14:32.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.942+0000 7f951f978700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9518121280 con 0x7f95180a1340 2023-10-03T10:14:32.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.942+0000 7f951cf13700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95180a1340 0x7f951811ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.942+0000 7f951cf13700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95180a1340 0x7f951811ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:50378/0 (socket says 172.21.15.146:50378) 2023-10-03T10:14:32.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.942+0000 7f951cf13700 1 -- 172.21.15.146:0/145393316 learned_addr learned my addr 172.21.15.146:0/145393316 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:32.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.942+0000 7f951df15700 1 --2- 172.21.15.146:0/145393316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95181304a0 0x7f95181c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.943+0000 7f4cbf9df700 1 Processor -- start 2023-10-03T10:14:32.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.943+0000 7f951df15700 1 -- 172.21.15.146:0/145393316 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95180a1340 msgr2=0x7f951811ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.943+0000 7f951df15700 1 --2- 172.21.15.146:0/145393316 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95180a1340 0x7f951811ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.943+0000 7f951df15700 1 -- 172.21.15.146:0/145393316 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95180a0a30 msgr2=0x7f951811fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.943+0000 7f951df15700 1 --2- 172.21.15.146:0/145393316 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95180a0a30 0x7f951811fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.943+0000 7f951df15700 1 -- 172.21.15.146:0/145393316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9510009a70 con 0x7f95181304a0 2023-10-03T10:14:32.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.943+0000 7f951cf13700 1 --2- 172.21.15.146:0/145393316 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95180a1340 0x7f951811ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:32.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.943+0000 7f951df15700 1 --2- 172.21.15.146:0/145393316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95181304a0 0x7f95181c8190 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9510016000 tx=0x7f9510004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.943+0000 7f950dffb700 1 -- 172.21.15.146:0/145393316 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95100048b0 con 0x7f95181304a0 2023-10-03T10:14:32.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.943+0000 7f950dffb700 1 -- 172.21.15.146:0/145393316 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9510020070 con 0x7f95181304a0 2023-10-03T10:14:32.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.943+0000 7f950dffb700 1 -- 172.21.15.146:0/145393316 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95100276c0 con 0x7f95181304a0 2023-10-03T10:14:32.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.944+0000 7f951f978700 1 -- 172.21.15.146:0/145393316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f951809f0b0 con 0x7f95181304a0 2023-10-03T10:14:32.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.943+0000 7f4cbf9df700 1 -- start start 2023-10-03T10:14:32.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.944+0000 7f4cbf9df700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4cb8066410 0x7f4cb81a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.944+0000 7f4cbf9df700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4cb80667e0 0x7f4cb81a3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.944+0000 7f4cbf9df700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cb80a14b0 0x7f4cb81a4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.944+0000 7f4cbf9df700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb81a7000 con 0x7f4cb80a14b0 2023-10-03T10:14:32.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.944+0000 7f4cbf9df700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb81a56c0 con 0x7f4cb8066410 2023-10-03T10:14:32.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.944+0000 7f4cbf9df700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb81a7250 con 0x7f4cb80667e0 2023-10-03T10:14:32.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.944+0000 7f4cbdf7c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cb80a14b0 0x7f4cb81a4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.944+0000 7f4cbdf7c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cb80a14b0 0x7f4cb81a4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44472/0 (socket says 172.21.15.146:44472) 2023-10-03T10:14:32.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.944+0000 7f4cbdf7c700 1 -- 172.21.15.146:0/3576563982 learned_addr learned my addr 172.21.15.146:0/3576563982 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:32.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.944+0000 7f4cbcf7a700 1 --2- 172.21.15.146:0/3576563982 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4cb80667e0 0x7f4cb81a3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.944+0000 7f951f978700 1 -- 172.21.15.146:0/145393316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95181204f0 con 0x7f95181304a0 2023-10-03T10:14:32.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.944+0000 7f4cbdf7c700 1 -- 172.21.15.146:0/3576563982 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4cb80667e0 msgr2=0x7f4cb81a3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.944+0000 7f4cbdf7c700 1 --2- 172.21.15.146:0/3576563982 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4cb80667e0 0x7f4cb81a3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.944+0000 7f4cbdf7c700 1 -- 172.21.15.146:0/3576563982 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4cb8066410 msgr2=0x7f4cb81a3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.944+0000 7f4cbdf7c700 1 --2- 172.21.15.146:0/3576563982 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4cb8066410 0x7f4cb81a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.944+0000 7f4cbdf7c700 1 -- 172.21.15.146:0/3576563982 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb0009ad0 con 0x7f4cb80a14b0 2023-10-03T10:14:32.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.945+0000 7f4cbdf7c700 1 --2- 172.21.15.146:0/3576563982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cb80a14b0 0x7f4cb81a4510 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4cac01f810 tx=0x7f4cac01fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.945+0000 7f4ca9ffb700 1 -- 172.21.15.146:0/3576563982 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cac004230 con 0x7f4cb80a14b0 2023-10-03T10:14:32.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.945+0000 7f4ca9ffb700 1 -- 172.21.15.146:0/3576563982 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cac004390 con 0x7f4cb80a14b0 2023-10-03T10:14:32.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.945+0000 7f4ca9ffb700 1 -- 172.21.15.146:0/3576563982 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cac0036a0 con 0x7f4cb80a14b0 2023-10-03T10:14:32.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.945+0000 7f4cbf9df700 1 -- 172.21.15.146:0/3576563982 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb8071380 con 0x7f4cb80a14b0 2023-10-03T10:14:32.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.945+0000 7f4cbf9df700 1 -- 172.21.15.146:0/3576563982 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb81a7cc0 con 0x7f4cb80a14b0 2023-10-03T10:14:32.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.945+0000 7f950dffb700 1 -- 172.21.15.146:0/145393316 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9510012430 con 0x7f95181304a0 2023-10-03T10:14:32.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.945+0000 7f951f978700 1 -- 172.21.15.146:0/145393316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f951804f2a0 con 0x7f95181304a0 2023-10-03T10:14:32.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.946+0000 7f950dffb700 1 -- 172.21.15.146:0/145393316 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9510022070 con 0x7f95181304a0 2023-10-03T10:14:32.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.946+0000 7f4cbf9df700 1 -- 172.21.15.146:0/3576563982 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb804f2a0 con 0x7f4cb80a14b0 2023-10-03T10:14:32.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.951+0000 7f4ca9ffb700 1 -- 172.21.15.146:0/3576563982 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4cac003800 con 0x7f4cb80a14b0 2023-10-03T10:14:32.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.951+0000 7f4ca9ffb700 1 -- 172.21.15.146:0/3576563982 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4cac0502c0 con 0x7f4cb80a14b0 2023-10-03T10:14:32.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.955+0000 7f950dffb700 1 -- 172.21.15.146:0/145393316 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9510012e40 con 0x7f95181304a0 2023-10-03T10:14:32.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:32.963+0000 7f4ca9ffb700 1 -- 172.21.15.146:0/3576563982 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4cac020040 con 0x7f4cb80a14b0 2023-10-03T10:14:33.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.077+0000 7f16d1424700 1 -- 172.21.15.146:0/140760849 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f16cc11f180 con 0x7f16cc1368e0 2023-10-03T10:14:33.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.077+0000 7f16b37fe700 1 -- 172.21.15.146:0/140760849 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f16c002a030 con 0x7f16cc1368e0 2023-10-03T10:14:33.078 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:33.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.080+0000 7f16d1424700 1 -- 172.21.15.146:0/140760849 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16cc1368e0 msgr2=0x7f16cc11b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.080+0000 7f16d1424700 1 --2- 172.21.15.146:0/140760849 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16cc1368e0 0x7f16cc11b3b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f16c000e7e0 tx=0x7f16c000eaf0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.080+0000 7f16d1424700 1 -- 172.21.15.146:0/140760849 shutdown_connections 2023-10-03T10:14:33.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.080+0000 7f16d1424700 1 --2- 172.21.15.146:0/140760849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16cc139200 0x7f16cc11b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.080+0000 7f16d1424700 1 --2- 172.21.15.146:0/140760849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16cc133900 0x7f16cc11ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.080+0000 7f16d1424700 1 --2- 172.21.15.146:0/140760849 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16cc1368e0 0x7f16cc11b3b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.080+0000 7f16d1424700 1 -- 172.21.15.146:0/140760849 >> 172.21.15.146:0/140760849 conn(0x7f16cc0a2980 msgr2=0x7f16cc131a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:33.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.081+0000 7f16d1424700 1 -- 172.21.15.146:0/140760849 shutdown_connections 2023-10-03T10:14:33.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.081+0000 7f16d1424700 1 -- 172.21.15.146:0/140760849 wait complete. 2023-10-03T10:14:33.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:33.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.114+0000 7f07e3797700 1 -- 172.21.15.146:0/756109139 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f07dc04f2a0 con 0x7f07dc099e20 2023-10-03T10:14:33.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.114+0000 7f07d1ffb700 1 -- 172.21.15.146:0/756109139 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f07d8025e40 con 0x7f07dc099e20 2023-10-03T10:14:33.115 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:33.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.117+0000 7f07e3797700 1 -- 172.21.15.146:0/756109139 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07dc099e20 msgr2=0x7f07dc1198b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.117+0000 7f07e3797700 1 --2- 172.21.15.146:0/756109139 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07dc099e20 0x7f07dc1198b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f07d800ebb0 tx=0x7f07d800eec0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.117+0000 7f07e3797700 1 -- 172.21.15.146:0/756109139 shutdown_connections 2023-10-03T10:14:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.117+0000 7f07e3797700 1 --2- 172.21.15.146:0/756109139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07dc130890 0x7f07dc11a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.117+0000 7f07e3797700 1 --2- 172.21.15.146:0/756109139 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07dc099e20 0x7f07dc1198b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.117+0000 7f07e3797700 1 --2- 172.21.15.146:0/756109139 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07dc09a730 0x7f07dc119df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.117+0000 7f07e3797700 1 -- 172.21.15.146:0/756109139 >> 172.21.15.146:0/756109139 conn(0x7f07dc0a2980 msgr2=0x7f07dc12f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.117+0000 7f07e3797700 1 -- 172.21.15.146:0/756109139 shutdown_connections 2023-10-03T10:14:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.117+0000 7f07e3797700 1 -- 172.21.15.146:0/756109139 wait complete. 2023-10-03T10:14:33.130 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:33.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.150+0000 7f951f978700 1 -- 172.21.15.146:0/145393316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f951809ae00 con 0x7f95181304a0 2023-10-03T10:14:33.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.150+0000 7f950dffb700 1 -- 172.21.15.146:0/145393316 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9510026a20 con 0x7f95181304a0 2023-10-03T10:14:33.151 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:33.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.152+0000 7f951f978700 1 -- 172.21.15.146:0/145393316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95181304a0 msgr2=0x7f95181c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.152+0000 7f951f978700 1 --2- 172.21.15.146:0/145393316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95181304a0 0x7f95181c8190 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9510016000 tx=0x7f9510004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.152+0000 7f951f978700 1 -- 172.21.15.146:0/145393316 shutdown_connections 2023-10-03T10:14:33.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.152+0000 7f951f978700 1 --2- 172.21.15.146:0/145393316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95181304a0 0x7f95181c8190 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.152+0000 7f951f978700 1 --2- 172.21.15.146:0/145393316 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95180a0a30 0x7f951811fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.152+0000 7f951f978700 1 --2- 172.21.15.146:0/145393316 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95180a1340 0x7f951811ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.152+0000 7f951f978700 1 -- 172.21.15.146:0/145393316 >> 172.21.15.146:0/145393316 conn(0x7f95180a2980 msgr2=0x7f951809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:33.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.152+0000 7f951f978700 1 -- 172.21.15.146:0/145393316 shutdown_connections 2023-10-03T10:14:33.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.152+0000 7f951f978700 1 -- 172.21.15.146:0/145393316 wait complete. 2023-10-03T10:14:33.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.158+0000 7f4cbf9df700 1 -- 172.21.15.146:0/3576563982 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4cb806bce0 con 0x7f4cb80a14b0 2023-10-03T10:14:33.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.159+0000 7f4ca9ffb700 1 -- 172.21.15.146:0/3576563982 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4cac031020 con 0x7f4cb80a14b0 2023-10-03T10:14:33.159 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:33.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.161+0000 7f4cbf9df700 1 -- 172.21.15.146:0/3576563982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cb80a14b0 msgr2=0x7f4cb81a4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.161+0000 7f4cbf9df700 1 --2- 172.21.15.146:0/3576563982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cb80a14b0 0x7f4cb81a4510 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4cac01f810 tx=0x7f4cac01fb20 comp rx=0 tx=0).stop 2023-10-03T10:14:33.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.161+0000 7f4cbf9df700 1 -- 172.21.15.146:0/3576563982 shutdown_connections 2023-10-03T10:14:33.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.161+0000 7f4cbf9df700 1 --2- 172.21.15.146:0/3576563982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cb80a14b0 0x7f4cb81a4510 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.161+0000 7f4cbf9df700 1 --2- 172.21.15.146:0/3576563982 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4cb8066410 0x7f4cb81a3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.161+0000 7f4cbf9df700 1 --2- 172.21.15.146:0/3576563982 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4cb80667e0 0x7f4cb81a3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.161+0000 7f4cbf9df700 1 -- 172.21.15.146:0/3576563982 >> 172.21.15.146:0/3576563982 conn(0x7f4cb80a2980 msgr2=0x7f4cb819db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:33.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.161+0000 7f4cbf9df700 1 -- 172.21.15.146:0/3576563982 shutdown_connections 2023-10-03T10:14:33.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:33.161+0000 7f4cbf9df700 1 -- 172.21.15.146:0/3576563982 wait complete. 2023-10-03T10:14:33.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:33.174 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:34.095 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:34.131 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:34.166 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:34.175 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:34.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.241+0000 7f5425d03700 1 Processor -- start 2023-10-03T10:14:34.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.241+0000 7f5425d03700 1 -- start start 2023-10-03T10:14:34.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.242+0000 7f5425d03700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5420133a70 0x7f5420133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.242+0000 7f5425d03700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f54200a1460 0x7f542013b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.242+0000 7f5425d03700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5420133640 con 0x7f54200a08e0 2023-10-03T10:14:34.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.242+0000 7f5425d03700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54200a1d50 con 0x7f54200a1460 2023-10-03T10:14:34.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.242+0000 7f5425d03700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542009b620 con 0x7f5420133a70 2023-10-03T10:14:34.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.242+0000 7f5416ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f54200a08e0 0x7f54200a0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36896/0 (socket says 172.21.15.146:36896) 2023-10-03T10:14:34.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.242+0000 7f541f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5420133a70 0x7f5420133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.242+0000 7f5416ffd700 1 -- 172.21.15.146:0/2742191486 learned_addr learned my addr 172.21.15.146:0/2742191486 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:34.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.242+0000 7f541ffff700 1 --2- 172.21.15.146:0/2742191486 >> v2:172.21.15.146:3300/0 conn(0x7f54200a1460 0x7f542013b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.242+0000 7f541effd700 1 -- 172.21.15.146:0/2742191486 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345312398 0 0) 0x7f5420133640 con 0x7f54200a08e0 2023-10-03T10:14:34.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.242+0000 7f541effd700 1 -- 172.21.15.146:0/2742191486 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f540c0035b0 con 0x7f54200a08e0 2023-10-03T10:14:34.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.242+0000 7f541f7fe700 1 -- 172.21.15.146:0/2742191486 >> v2:172.21.15.146:3300/0 conn(0x7f54200a1460 msgr2=0x7f542013b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.242+0000 7f541f7fe700 1 --2- 172.21.15.146:0/2742191486 >> v2:172.21.15.146:3300/0 conn(0x7f54200a1460 0x7f542013b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.242+0000 7f541f7fe700 1 -- 172.21.15.146:0/2742191486 >> v1:172.21.15.146:6789/0 conn(0x7f54200a08e0 legacy=0x7f54200a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.242+0000 7f541f7fe700 1 -- 172.21.15.146:0/2742191486 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5420133870 con 0x7f5420133a70 2023-10-03T10:14:34.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.243+0000 7f541f7fe700 1 --2- 172.21.15.146:0/2742191486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5420133a70 0x7f5420133e40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5410009820 tx=0x7f5410009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc64ae2bfa3eb1bf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.243+0000 7f541effd700 1 -- 172.21.15.146:0/2742191486 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5410005e30 con 0x7f5420133a70 2023-10-03T10:14:34.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.243+0000 7f541effd700 1 -- 172.21.15.146:0/2742191486 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5410006030 con 0x7f5420133a70 2023-10-03T10:14:34.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.243+0000 7f541effd700 1 -- 172.21.15.146:0/2742191486 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54100063c0 con 0x7f5420133a70 2023-10-03T10:14:34.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.244+0000 7f5425d03700 1 -- 172.21.15.146:0/2742191486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5420133a70 msgr2=0x7f5420133e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.244+0000 7f5425d03700 1 --2- 172.21.15.146:0/2742191486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5420133a70 0x7f5420133e40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5410009820 tx=0x7f5410009b30 comp rx=0 tx=0).stop 2023-10-03T10:14:34.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.244+0000 7f5425d03700 1 -- 172.21.15.146:0/2742191486 shutdown_connections 2023-10-03T10:14:34.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.244+0000 7f5425d03700 1 --2- 172.21.15.146:0/2742191486 >> v2:172.21.15.146:3300/0 conn(0x7f54200a1460 0x7f542013b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.244+0000 7f5425d03700 1 --2- 172.21.15.146:0/2742191486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5420133a70 0x7f5420133e40 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.244+0000 7f5425d03700 1 -- 172.21.15.146:0/2742191486 >> 172.21.15.146:0/2742191486 conn(0x7f54200a2980 msgr2=0x7f54200a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.244+0000 7f5425d03700 1 -- 172.21.15.146:0/2742191486 shutdown_connections 2023-10-03T10:14:34.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.244+0000 7f5425d03700 1 -- 172.21.15.146:0/2742191486 wait complete. 2023-10-03T10:14:34.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.245+0000 7f5425d03700 1 Processor -- start 2023-10-03T10:14:34.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.245+0000 7f5425d03700 1 -- start start 2023-10-03T10:14:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.245+0000 7f5425d03700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54200a08e0 0x7f54201ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.245+0000 7f5425d03700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54200a1460 0x7f54201cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.245+0000 7f5425d03700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542006dfc0 0x7f542006e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.245+0000 7f5425d03700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5420071800 con 0x7f542006dfc0 2023-10-03T10:14:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.245+0000 7f5425d03700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54201321a0 con 0x7f54200a1460 2023-10-03T10:14:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.245+0000 7f5425d03700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f542009a350 con 0x7f54200a08e0 2023-10-03T10:14:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.245+0000 7f541ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542006dfc0 0x7f542006e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.246+0000 7f541ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542006dfc0 0x7f542006e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44488/0 (socket says 172.21.15.146:44488) 2023-10-03T10:14:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.246+0000 7f541ffff700 1 -- 172.21.15.146:0/22054000 learned_addr learned my addr 172.21.15.146:0/22054000 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.246+0000 7f5416ffd700 1 --2- 172.21.15.146:0/22054000 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54200a1460 0x7f54201cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.246+0000 7f541f7fe700 1 --2- 172.21.15.146:0/22054000 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54200a08e0 0x7f54201ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.246+0000 7f541ffff700 1 -- 172.21.15.146:0/22054000 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54200a08e0 msgr2=0x7f54201ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.246+0000 7f541ffff700 1 --2- 172.21.15.146:0/22054000 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54200a08e0 0x7f54201ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.246+0000 7f541ffff700 1 -- 172.21.15.146:0/22054000 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54200a1460 msgr2=0x7f54201cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.246+0000 7f541ffff700 1 --2- 172.21.15.146:0/22054000 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54200a1460 0x7f54201cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.246+0000 7f541ffff700 1 -- 172.21.15.146:0/22054000 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5410009430 con 0x7f542006dfc0 2023-10-03T10:14:34.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.246+0000 7f541ffff700 1 --2- 172.21.15.146:0/22054000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542006dfc0 0x7f542006e430 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f541800efc0 tx=0x7f541800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.246+0000 7f541cff9700 1 -- 172.21.15.146:0/22054000 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541800cc90 con 0x7f542006dfc0 2023-10-03T10:14:34.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.246+0000 7f541cff9700 1 -- 172.21.15.146:0/22054000 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541800f040 con 0x7f542006dfc0 2023-10-03T10:14:34.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.246+0000 7f5425d03700 1 -- 172.21.15.146:0/22054000 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54200705c0 con 0x7f542006dfc0 2023-10-03T10:14:34.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.246+0000 7f5425d03700 1 -- 172.21.15.146:0/22054000 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5420071ae0 con 0x7f542006dfc0 2023-10-03T10:14:34.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.246+0000 7f541cff9700 1 -- 172.21.15.146:0/22054000 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54180146c0 con 0x7f542006dfc0 2023-10-03T10:14:34.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.247+0000 7f541cff9700 1 -- 172.21.15.146:0/22054000 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5418014820 con 0x7f542006dfc0 2023-10-03T10:14:34.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.248+0000 7f541cff9700 1 -- 172.21.15.146:0/22054000 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5418040350 con 0x7f542006dfc0 2023-10-03T10:14:34.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.248+0000 7f5425d03700 1 -- 172.21.15.146:0/22054000 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542004f2a0 con 0x7f542006dfc0 2023-10-03T10:14:34.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.253+0000 7f541cff9700 1 -- 172.21.15.146:0/22054000 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5418018020 con 0x7f542006dfc0 2023-10-03T10:14:34.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.277+0000 7f33650b9700 1 Processor -- start 2023-10-03T10:14:34.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.277+0000 7f33650b9700 1 -- start start 2023-10-03T10:14:34.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.278+0000 7f33650b9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3360133ad0 0x7f3360133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.278+0000 7f33650b9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f33601300a0 0x7f33601304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.278+0000 7f33650b9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336006b2d0 con 0x7f33601309f0 2023-10-03T10:14:34.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.278+0000 7f33650b9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3360133610 con 0x7f33601300a0 2023-10-03T10:14:34.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.278+0000 7f33650b9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336009a500 con 0x7f3360133ad0 2023-10-03T10:14:34.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.278+0000 7f335ed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3360133ad0 0x7f3360133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.278+0000 7f335ed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3360133ad0 0x7f3360133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44930/0 (socket says 172.21.15.146:44930) 2023-10-03T10:14:34.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.278+0000 7f335ed9d700 1 -- 172.21.15.146:0/474611077 learned_addr learned my addr 172.21.15.146:0/474611077 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:34.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.278+0000 7f335e59c700 1 --2- 172.21.15.146:0/474611077 >> v2:172.21.15.146:3300/0 conn(0x7f33601300a0 0x7f33601304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.279+0000 7f335ed9d700 1 -- 172.21.15.146:0/474611077 >> v2:172.21.15.146:3300/0 conn(0x7f33601300a0 msgr2=0x7f33601304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.279+0000 7f335ed9d700 1 --2- 172.21.15.146:0/474611077 >> v2:172.21.15.146:3300/0 conn(0x7f33601300a0 0x7f33601304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.279+0000 7f335ed9d700 1 -- 172.21.15.146:0/474611077 >> v1:172.21.15.146:6789/0 conn(0x7f33601309f0 legacy=0x7f336013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.279+0000 7f335ed9d700 1 -- 172.21.15.146:0/474611077 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33601338b0 con 0x7f3360133ad0 2023-10-03T10:14:34.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.279+0000 7f335e59c700 1 --2- 172.21.15.146:0/474611077 >> v2:172.21.15.146:3300/0 conn(0x7f33601300a0 0x7f33601304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.279+0000 7f335ed9d700 1 --2- 172.21.15.146:0/474611077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3360133ad0 0x7f3360133ea0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f33500098f0 tx=0x7f3350009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90b0a2d3b663ab98 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.279+0000 7f335dd9b700 1 -- 172.21.15.146:0/474611077 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3350011830 con 0x7f3360133ad0 2023-10-03T10:14:34.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.279+0000 7f335dd9b700 1 -- 172.21.15.146:0/474611077 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3350011990 con 0x7f3360133ad0 2023-10-03T10:14:34.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.279+0000 7f335dd9b700 1 -- 172.21.15.146:0/474611077 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3350011d20 con 0x7f3360133ad0 2023-10-03T10:14:34.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.280+0000 7f33650b9700 1 -- 172.21.15.146:0/474611077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3360133ad0 msgr2=0x7f3360133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.280+0000 7f33650b9700 1 --2- 172.21.15.146:0/474611077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3360133ad0 0x7f3360133ea0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f33500098f0 tx=0x7f3350009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:34.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.280+0000 7f33650b9700 1 -- 172.21.15.146:0/474611077 shutdown_connections 2023-10-03T10:14:34.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.280+0000 7f33650b9700 1 --2- 172.21.15.146:0/474611077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3360133ad0 0x7f3360133ea0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.280+0000 7f33650b9700 1 --2- 172.21.15.146:0/474611077 >> v2:172.21.15.146:3300/0 conn(0x7f33601300a0 0x7f33601304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.280+0000 7f33650b9700 1 -- 172.21.15.146:0/474611077 >> 172.21.15.146:0/474611077 conn(0x7f3360099c40 msgr2=0x7f33600a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.280+0000 7f33650b9700 1 -- 172.21.15.146:0/474611077 shutdown_connections 2023-10-03T10:14:34.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.280+0000 7f33650b9700 1 -- 172.21.15.146:0/474611077 wait complete. 2023-10-03T10:14:34.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.281+0000 7f33650b9700 1 Processor -- start 2023-10-03T10:14:34.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.282+0000 7f33650b9700 1 -- start start 2023-10-03T10:14:34.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.282+0000 7f33650b9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33601300a0 0x7f336011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.282+0000 7f33650b9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33601309f0 0x7f336011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.282+0000 7f33650b9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3360133ad0 0x7f336011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.282+0000 7f33650b9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336011edb0 con 0x7f3360133ad0 2023-10-03T10:14:34.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.282+0000 7f33650b9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33601200c0 con 0x7f33601309f0 2023-10-03T10:14:34.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.282+0000 7f33650b9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f336012dd00 con 0x7f33601300a0 2023-10-03T10:14:34.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.282+0000 7f335e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33601309f0 0x7f336011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.282+0000 7f335ed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33601300a0 0x7f336011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.282+0000 7f335e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33601309f0 0x7f336011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44938/0 (socket says 172.21.15.146:44938) 2023-10-03T10:14:34.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.282+0000 7f335ed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33601300a0 0x7f336011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:48818/0 (socket says 172.21.15.146:48818) 2023-10-03T10:14:34.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.282+0000 7f335e59c700 1 -- 172.21.15.146:0/1046040925 learned_addr learned my addr 172.21.15.146:0/1046040925 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:34.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.282+0000 7f335f59e700 1 --2- 172.21.15.146:0/1046040925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3360133ad0 0x7f336011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.283+0000 7f335ed9d700 1 -- 172.21.15.146:0/1046040925 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33601309f0 msgr2=0x7f336011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.283+0000 7f335ed9d700 1 --2- 172.21.15.146:0/1046040925 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33601309f0 0x7f336011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.283+0000 7f335ed9d700 1 -- 172.21.15.146:0/1046040925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3360133ad0 msgr2=0x7f336011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.283+0000 7f335ed9d700 1 --2- 172.21.15.146:0/1046040925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3360133ad0 0x7f336011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.283+0000 7f335ed9d700 1 -- 172.21.15.146:0/1046040925 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33540094a0 con 0x7f33601300a0 2023-10-03T10:14:34.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.283+0000 7f335ed9d700 1 --2- 172.21.15.146:0/1046040925 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33601300a0 0x7f336011da40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3350016000 tx=0x7f3350004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.283+0000 7f33477fe700 1 -- 172.21.15.146:0/1046040925 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3350004400 con 0x7f33601300a0 2023-10-03T10:14:34.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.283+0000 7f33477fe700 1 -- 172.21.15.146:0/1046040925 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335001f070 con 0x7f33601300a0 2023-10-03T10:14:34.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.283+0000 7f33477fe700 1 -- 172.21.15.146:0/1046040925 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33500038e0 con 0x7f33601300a0 2023-10-03T10:14:34.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.284+0000 7f33650b9700 1 -- 172.21.15.146:0/1046040925 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3350009550 con 0x7f33601300a0 2023-10-03T10:14:34.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.284+0000 7f33650b9700 1 -- 172.21.15.146:0/1046040925 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336011f870 con 0x7f33601300a0 2023-10-03T10:14:34.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.285+0000 7f33650b9700 1 -- 172.21.15.146:0/1046040925 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f336009cb20 con 0x7f33601300a0 2023-10-03T10:14:34.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.285+0000 7f33477fe700 1 -- 172.21.15.146:0/1046040925 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3350021030 con 0x7f33601300a0 2023-10-03T10:14:34.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.285+0000 7f33477fe700 1 -- 172.21.15.146:0/1046040925 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3350040af0 con 0x7f33601300a0 2023-10-03T10:14:34.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.294+0000 7f33477fe700 1 -- 172.21.15.146:0/1046040925 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33500239c0 con 0x7f33601300a0 2023-10-03T10:14:34.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.318+0000 7f45c9c52700 1 Processor -- start 2023-10-03T10:14:34.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.318+0000 7f45c9c52700 1 -- start start 2023-10-03T10:14:34.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.319+0000 7f45c9c52700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c4134140 0x7f45c4138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.319+0000 7f45c9c52700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f45c4134570 0x7f45c413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.319+0000 7f45c9c52700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c409b110 con 0x7f45c409ad40 2023-10-03T10:14:34.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.319+0000 7f45c9c52700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c40a3b60 con 0x7f45c4134570 2023-10-03T10:14:34.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.319+0000 7f45c9c52700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c40a1a80 con 0x7f45c4134140 2023-10-03T10:14:34.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.319+0000 7f45c2ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c4134140 0x7f45c4138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.319+0000 7f45c2ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c4134140 0x7f45c4138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44952/0 (socket says 172.21.15.146:44952) 2023-10-03T10:14:34.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.319+0000 7f45c2ffd700 1 -- 172.21.15.146:0/1725175270 learned_addr learned my addr 172.21.15.146:0/1725175270 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:34.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.319+0000 7f45c3fff700 1 --2- 172.21.15.146:0/1725175270 >> v2:172.21.15.146:3300/0 conn(0x7f45c4134570 0x7f45c413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.319+0000 7f45c3fff700 1 -- 172.21.15.146:0/1725175270 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c4134140 msgr2=0x7f45c4138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.319+0000 7f45c3fff700 1 --2- 172.21.15.146:0/1725175270 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c4134140 0x7f45c4138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.319+0000 7f45c3fff700 1 -- 172.21.15.146:0/1725175270 >> v1:172.21.15.146:6789/0 conn(0x7f45c409ad40 legacy=0x7f45c4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.319+0000 7f45c3fff700 1 -- 172.21.15.146:0/1725175270 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c40a2fa0 con 0x7f45c4134570 2023-10-03T10:14:34.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.319+0000 7f45c3fff700 1 --2- 172.21.15.146:0/1725175270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45c4134570 0x7f45c413b3d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009d90 tx=0x7f45bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55b5d466d277538 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.320+0000 7f45c27fc700 1 -- 172.21.15.146:0/1725175270 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc00e070 con 0x7f45c4134570 2023-10-03T10:14:34.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.320+0000 7f45c27fc700 1 -- 172.21.15.146:0/1725175270 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc00bb20 con 0x7f45c4134570 2023-10-03T10:14:34.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.320+0000 7f45c27fc700 1 -- 172.21.15.146:0/1725175270 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc012430 con 0x7f45c4134570 2023-10-03T10:14:34.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.320+0000 7f45c9c52700 1 -- 172.21.15.146:0/1725175270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45c4134570 msgr2=0x7f45c413b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.320+0000 7f45c9c52700 1 --2- 172.21.15.146:0/1725175270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45c4134570 0x7f45c413b3d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009d90 tx=0x7f45bc00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:34.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.320+0000 7f45c9c52700 1 -- 172.21.15.146:0/1725175270 shutdown_connections 2023-10-03T10:14:34.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.320+0000 7f45c9c52700 1 --2- 172.21.15.146:0/1725175270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45c4134570 0x7f45c413b3d0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.320+0000 7f45c9c52700 1 --2- 172.21.15.146:0/1725175270 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c4134140 0x7f45c4138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.320+0000 7f45c9c52700 1 -- 172.21.15.146:0/1725175270 >> 172.21.15.146:0/1725175270 conn(0x7f45c4099c40 msgr2=0x7f45c406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.321+0000 7f45c9c52700 1 -- 172.21.15.146:0/1725175270 shutdown_connections 2023-10-03T10:14:34.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.321+0000 7f45c9c52700 1 -- 172.21.15.146:0/1725175270 wait complete. 2023-10-03T10:14:34.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.322+0000 7f45c9c52700 1 Processor -- start 2023-10-03T10:14:34.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.322+0000 7f45c9c52700 1 -- start start 2023-10-03T10:14:34.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.323+0000 7f45c9c52700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c409ad40 0x7f45c411c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.323+0000 7f45c9c52700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45c4134140 0x7f45c411ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.323+0000 7f45c9c52700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45c4134570 0x7f45c411d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.323+0000 7f45c9c52700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c411df30 con 0x7f45c4134570 2023-10-03T10:14:34.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.323+0000 7f45c9c52700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c40a4110 con 0x7f45c409ad40 2023-10-03T10:14:34.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.323+0000 7f45c9c52700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45c409c7e0 con 0x7f45c4134140 2023-10-03T10:14:34.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.323+0000 7f45c37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c409ad40 0x7f45c411c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.323+0000 7f45c3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45c4134570 0x7f45c411d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.323+0000 7f45c37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c409ad40 0x7f45c411c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44958/0 (socket says 172.21.15.146:44958) 2023-10-03T10:14:34.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.323+0000 7f45c37fe700 1 -- 172.21.15.146:0/2475573910 learned_addr learned my addr 172.21.15.146:0/2475573910 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:34.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.323+0000 7f45c2ffd700 1 --2- 172.21.15.146:0/2475573910 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45c4134140 0x7f45c411ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.323+0000 7f45c3fff700 1 -- 172.21.15.146:0/2475573910 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45c4134140 msgr2=0x7f45c411ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.323+0000 7f45c3fff700 1 --2- 172.21.15.146:0/2475573910 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45c4134140 0x7f45c411ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.323+0000 7f45c3fff700 1 -- 172.21.15.146:0/2475573910 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c409ad40 msgr2=0x7f45c411c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.323+0000 7f45c3fff700 1 --2- 172.21.15.146:0/2475573910 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c409ad40 0x7f45c411c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.323+0000 7f45c3fff700 1 -- 172.21.15.146:0/2475573910 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc009a70 con 0x7f45c4134570 2023-10-03T10:14:34.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.323+0000 7f45c37fe700 1 --2- 172.21.15.146:0/2475573910 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c409ad40 0x7f45c411c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.324+0000 7f45c3fff700 1 --2- 172.21.15.146:0/2475573910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45c4134570 0x7f45c411d340 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f45c40a0830 tx=0x7f45bc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.324+0000 7f45abfff700 1 -- 172.21.15.146:0/2475573910 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc012430 con 0x7f45c4134570 2023-10-03T10:14:34.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.324+0000 7f45abfff700 1 -- 172.21.15.146:0/2475573910 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc020070 con 0x7f45c4134570 2023-10-03T10:14:34.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.324+0000 7f45c9c52700 1 -- 172.21.15.146:0/2475573910 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c411e6d0 con 0x7f45c4134570 2023-10-03T10:14:34.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.324+0000 7f45abfff700 1 -- 172.21.15.146:0/2475573910 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc004280 con 0x7f45c4134570 2023-10-03T10:14:34.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.324+0000 7f45c9c52700 1 -- 172.21.15.146:0/2475573910 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c411ec60 con 0x7f45c4134570 2023-10-03T10:14:34.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.325+0000 7f45abfff700 1 -- 172.21.15.146:0/2475573910 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f45bc0043e0 con 0x7f45c4134570 2023-10-03T10:14:34.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.325+0000 7f45abfff700 1 -- 172.21.15.146:0/2475573910 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f45bc022070 con 0x7f45c4134570 2023-10-03T10:14:34.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.325+0000 7f45c9c52700 1 -- 172.21.15.146:0/2475573910 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c404f2a0 con 0x7f45c4134570 2023-10-03T10:14:34.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.327+0000 7fab4171c700 1 Processor -- start 2023-10-03T10:14:34.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.327+0000 7fab4171c700 1 -- start start 2023-10-03T10:14:34.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.328+0000 7fab4171c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab3c09e340 0x7fab3c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.328+0000 7fab4171c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab3c135f20 0x7fab3c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.328+0000 7fab4171c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab3c09aaa0 con 0x7fab3c09d860 2023-10-03T10:14:34.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.328+0000 7fab4171c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c09e730 con 0x7fab3c09e340 2023-10-03T10:14:34.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.328+0000 7fab4171c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c09f870 con 0x7fab3c135f20 2023-10-03T10:14:34.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.328+0000 7fab3b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab3c135f20 0x7fab3c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.328+0000 7fab3b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab3c135f20 0x7fab3c138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:48840/0 (socket says 172.21.15.146:48840) 2023-10-03T10:14:34.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.328+0000 7fab3b7fe700 1 -- 172.21.15.146:0/3589889455 learned_addr learned my addr 172.21.15.146:0/3589889455 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:34.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.328+0000 7fab3b7fe700 1 -- 172.21.15.146:0/3589889455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab3c09e340 msgr2=0x7fab3c1359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.328+0000 7fab3b7fe700 1 --2- 172.21.15.146:0/3589889455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab3c09e340 0x7fab3c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.328+0000 7fab3b7fe700 1 -- 172.21.15.146:0/3589889455 >> v1:172.21.15.146:6789/0 conn(0x7fab3c09d860 legacy=0x7fab3c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.328+0000 7fab3b7fe700 1 -- 172.21.15.146:0/3589889455 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3c09b360 con 0x7fab3c135f20 2023-10-03T10:14:34.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.328+0000 7fab3b7fe700 1 --2- 172.21.15.146:0/3589889455 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab3c135f20 0x7fab3c138300 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fab3400d1b0 tx=0x7fab3400d4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bb3f61518f38761 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.329+0000 7fab39ffb700 1 -- 172.21.15.146:0/3589889455 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34010070 con 0x7fab3c135f20 2023-10-03T10:14:34.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.329+0000 7fab39ffb700 1 -- 172.21.15.146:0/3589889455 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3400dda0 con 0x7fab3c135f20 2023-10-03T10:14:34.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.329+0000 7fab39ffb700 1 -- 172.21.15.146:0/3589889455 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3400b310 con 0x7fab3c135f20 2023-10-03T10:14:34.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.329+0000 7fab4171c700 1 -- 172.21.15.146:0/3589889455 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab3c135f20 msgr2=0x7fab3c138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.329+0000 7fab4171c700 1 --2- 172.21.15.146:0/3589889455 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab3c135f20 0x7fab3c138300 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fab3400d1b0 tx=0x7fab3400d4c0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.329+0000 7fab4171c700 1 -- 172.21.15.146:0/3589889455 shutdown_connections 2023-10-03T10:14:34.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.329+0000 7fab4171c700 1 --2- 172.21.15.146:0/3589889455 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab3c135f20 0x7fab3c138300 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.329+0000 7fab4171c700 1 --2- 172.21.15.146:0/3589889455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab3c09e340 0x7fab3c1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.329+0000 7fab4171c700 1 -- 172.21.15.146:0/3589889455 >> 172.21.15.146:0/3589889455 conn(0x7fab3c099c40 msgr2=0x7fab3c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.329+0000 7fab4171c700 1 -- 172.21.15.146:0/3589889455 shutdown_connections 2023-10-03T10:14:34.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.329+0000 7fab4171c700 1 -- 172.21.15.146:0/3589889455 wait complete. 2023-10-03T10:14:34.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.330+0000 7fab4171c700 1 Processor -- start 2023-10-03T10:14:34.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.330+0000 7fab4171c700 1 -- start start 2023-10-03T10:14:34.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.331+0000 7fab4171c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab3c09d860 0x7fab3c1c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.331+0000 7fab4171c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab3c09e340 0x7fab3c1c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.331+0000 7fab4171c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab3c135f20 0x7fab3c1c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.331+0000 7fab4171c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c1304c0 con 0x7fab3c135f20 2023-10-03T10:14:34.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.331+0000 7fab4171c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c0a1e90 con 0x7fab3c09d860 2023-10-03T10:14:34.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.331+0000 7fab4171c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c11faa0 con 0x7fab3c09e340 2023-10-03T10:14:34.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.331+0000 7fab3affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab3c09d860 0x7fab3c1c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.331+0000 7fab3affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab3c09d860 0x7fab3c1c82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44968/0 (socket says 172.21.15.146:44968) 2023-10-03T10:14:34.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.331+0000 7fab3affd700 1 -- 172.21.15.146:0/4199935572 learned_addr learned my addr 172.21.15.146:0/4199935572 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:34.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.331+0000 7fab3a7fc700 1 --2- 172.21.15.146:0/4199935572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab3c09e340 0x7fab3c1c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.331+0000 7fab3b7fe700 1 --2- 172.21.15.146:0/4199935572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab3c135f20 0x7fab3c1c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.331+0000 7f45abfff700 1 -- 172.21.15.146:0/2475573910 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45bc02c080 con 0x7f45c4134570 2023-10-03T10:14:34.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.331+0000 7fab3affd700 1 -- 172.21.15.146:0/4199935572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab3c09e340 msgr2=0x7fab3c1c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.331+0000 7fab3affd700 1 --2- 172.21.15.146:0/4199935572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab3c09e340 0x7fab3c1c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.331+0000 7fab3affd700 1 -- 172.21.15.146:0/4199935572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab3c135f20 msgr2=0x7fab3c1c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.331+0000 7fab3affd700 1 --2- 172.21.15.146:0/4199935572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab3c135f20 0x7fab3c1c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.331+0000 7fab3affd700 1 -- 172.21.15.146:0/4199935572 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3400bd40 con 0x7fab3c09d860 2023-10-03T10:14:34.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.331+0000 7fab3a7fc700 1 --2- 172.21.15.146:0/4199935572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab3c09e340 0x7fab3c1c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.332+0000 7fab3affd700 1 --2- 172.21.15.146:0/4199935572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab3c09d860 0x7fab3c1c82b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00c4a0 tx=0x7fab2c00c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.332+0000 7fab237fe700 1 -- 172.21.15.146:0/4199935572 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c0054e0 con 0x7fab3c09d860 2023-10-03T10:14:34.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.332+0000 7fab237fe700 1 -- 172.21.15.146:0/4199935572 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2c003680 con 0x7fab3c09d860 2023-10-03T10:14:34.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.332+0000 7fab4171c700 1 -- 172.21.15.146:0/4199935572 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3c121150 con 0x7fab3c09d860 2023-10-03T10:14:34.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.332+0000 7fab237fe700 1 -- 172.21.15.146:0/4199935572 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c003a30 con 0x7fab3c09d860 2023-10-03T10:14:34.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.332+0000 7fab4171c700 1 -- 172.21.15.146:0/4199935572 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3c121bc0 con 0x7fab3c09d860 2023-10-03T10:14:34.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.332+0000 7fab237fe700 1 -- 172.21.15.146:0/4199935572 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab2c003b90 con 0x7fab3c09d860 2023-10-03T10:14:34.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.333+0000 7fab237fe700 1 -- 172.21.15.146:0/4199935572 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fab2c03eca0 con 0x7fab3c09d860 2023-10-03T10:14:34.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.333+0000 7fab4171c700 1 -- 172.21.15.146:0/4199935572 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3c04f2a0 con 0x7fab3c09d860 2023-10-03T10:14:34.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.338+0000 7fab237fe700 1 -- 172.21.15.146:0/4199935572 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab2c017080 con 0x7fab3c09d860 2023-10-03T10:14:34.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.487+0000 7f5425d03700 1 -- 172.21.15.146:0/22054000 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f542006bce0 con 0x7f542006dfc0 2023-10-03T10:14:34.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.487+0000 7f541cff9700 1 -- 172.21.15.146:0/22054000 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f541802b090 con 0x7f542006dfc0 2023-10-03T10:14:34.488 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:34.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.490+0000 7f5425d03700 1 -- 172.21.15.146:0/22054000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542006dfc0 msgr2=0x7f542006e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.490+0000 7f5425d03700 1 --2- 172.21.15.146:0/22054000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542006dfc0 0x7f542006e430 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f541800efc0 tx=0x7f541800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.490+0000 7f5425d03700 1 -- 172.21.15.146:0/22054000 shutdown_connections 2023-10-03T10:14:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.490+0000 7f5425d03700 1 --2- 172.21.15.146:0/22054000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f542006dfc0 0x7f542006e430 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.490+0000 7f5425d03700 1 --2- 172.21.15.146:0/22054000 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54200a08e0 0x7f54201ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.490+0000 7f5425d03700 1 --2- 172.21.15.146:0/22054000 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54200a1460 0x7f54201cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.490+0000 7f5425d03700 1 -- 172.21.15.146:0/22054000 >> 172.21.15.146:0/22054000 conn(0x7f54200a2980 msgr2=0x7f54201baec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.491+0000 7f5425d03700 1 -- 172.21.15.146:0/22054000 shutdown_connections 2023-10-03T10:14:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.491+0000 7f5425d03700 1 -- 172.21.15.146:0/22054000 wait complete. 2023-10-03T10:14:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.502+0000 7f33650b9700 1 -- 172.21.15.146:0/1046040925 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f336004f2a0 con 0x7f33601300a0 2023-10-03T10:14:34.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.502+0000 7f33477fe700 1 -- 172.21.15.146:0/1046040925 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3350040e60 con 0x7f33601300a0 2023-10-03T10:14:34.503 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:34.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.505+0000 7f33650b9700 1 -- 172.21.15.146:0/1046040925 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33601300a0 msgr2=0x7f336011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.505+0000 7f33650b9700 1 --2- 172.21.15.146:0/1046040925 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33601300a0 0x7f336011da40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3350016000 tx=0x7f3350004750 comp rx=0 tx=0).stop 2023-10-03T10:14:34.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.505+0000 7f33650b9700 1 -- 172.21.15.146:0/1046040925 shutdown_connections 2023-10-03T10:14:34.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.505+0000 7f33650b9700 1 --2- 172.21.15.146:0/1046040925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3360133ad0 0x7f336011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.505+0000 7f33650b9700 1 --2- 172.21.15.146:0/1046040925 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33601300a0 0x7f336011da40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.505+0000 7f33650b9700 1 --2- 172.21.15.146:0/1046040925 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33601309f0 0x7f336011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.505+0000 7f33650b9700 1 -- 172.21.15.146:0/1046040925 >> 172.21.15.146:0/1046040925 conn(0x7f3360099c40 msgr2=0x7f336012f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.505+0000 7f33650b9700 1 -- 172.21.15.146:0/1046040925 shutdown_connections 2023-10-03T10:14:34.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.505+0000 7f33650b9700 1 -- 172.21.15.146:0/1046040925 wait complete. 2023-10-03T10:14:34.508 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:34.518 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:34.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.533+0000 7fab4171c700 1 -- 172.21.15.146:0/4199935572 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fab3c06c3b0 con 0x7fab3c09d860 2023-10-03T10:14:34.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.534+0000 7fab237fe700 1 -- 172.21.15.146:0/4199935572 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab2c019b20 con 0x7fab3c09d860 2023-10-03T10:14:34.534 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:34.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.536+0000 7fab4171c700 1 -- 172.21.15.146:0/4199935572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab3c09d860 msgr2=0x7fab3c1c82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.536+0000 7fab4171c700 1 --2- 172.21.15.146:0/4199935572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab3c09d860 0x7fab3c1c82b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00c4a0 tx=0x7fab2c00c7b0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.536+0000 7fab4171c700 1 -- 172.21.15.146:0/4199935572 shutdown_connections 2023-10-03T10:14:34.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.536+0000 7fab4171c700 1 --2- 172.21.15.146:0/4199935572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab3c135f20 0x7fab3c1c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.536+0000 7fab4171c700 1 --2- 172.21.15.146:0/4199935572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab3c09d860 0x7fab3c1c82b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.536+0000 7fab4171c700 1 --2- 172.21.15.146:0/4199935572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab3c09e340 0x7fab3c1c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.536+0000 7fab4171c700 1 -- 172.21.15.146:0/4199935572 >> 172.21.15.146:0/4199935572 conn(0x7fab3c099c40 msgr2=0x7fab3c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.536+0000 7fab4171c700 1 -- 172.21.15.146:0/4199935572 shutdown_connections 2023-10-03T10:14:34.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.536+0000 7fab4171c700 1 -- 172.21.15.146:0/4199935572 wait complete. 2023-10-03T10:14:34.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:34.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.569+0000 7f45c9c52700 1 -- 172.21.15.146:0/2475573910 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f45c411efe0 con 0x7f45c4134570 2023-10-03T10:14:34.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.570+0000 7f45abfff700 1 -- 172.21.15.146:0/2475573910 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f45bc012e60 con 0x7f45c4134570 2023-10-03T10:14:34.570 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:34.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.572+0000 7f45c9c52700 1 -- 172.21.15.146:0/2475573910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45c4134570 msgr2=0x7f45c411d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.572+0000 7f45c9c52700 1 --2- 172.21.15.146:0/2475573910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45c4134570 0x7f45c411d340 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f45c40a0830 tx=0x7f45bc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.572+0000 7f45c9c52700 1 -- 172.21.15.146:0/2475573910 shutdown_connections 2023-10-03T10:14:34.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.572+0000 7f45c9c52700 1 --2- 172.21.15.146:0/2475573910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45c4134570 0x7f45c411d340 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.572+0000 7f45c9c52700 1 --2- 172.21.15.146:0/2475573910 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c409ad40 0x7f45c411c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.572+0000 7f45c9c52700 1 --2- 172.21.15.146:0/2475573910 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45c4134140 0x7f45c411ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.572+0000 7f45c9c52700 1 -- 172.21.15.146:0/2475573910 >> 172.21.15.146:0/2475573910 conn(0x7f45c4099c40 msgr2=0x7f45c40a61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.572+0000 7f45c9c52700 1 -- 172.21.15.146:0/2475573910 shutdown_connections 2023-10-03T10:14:34.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:34.572+0000 7f45c9c52700 1 -- 172.21.15.146:0/2475573910 wait complete. 2023-10-03T10:14:34.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:35.509 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:35.519 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:35.551 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:35.585 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:35.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.653+0000 7f1a6cd1d700 1 Processor -- start 2023-10-03T10:14:35.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.653+0000 7f1a6cd1d700 1 -- start start 2023-10-03T10:14:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.654+0000 7f1a6cd1d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1a6809d860 0x7f1a6809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.654+0000 7f1a6cd1d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a68130eb0 0x7f1a68138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.654+0000 7f1a6cd1d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a6809aaa0 con 0x7f1a6809e170 2023-10-03T10:14:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.654+0000 7f1a6cd1d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a6809f870 con 0x7f1a6809d860 2023-10-03T10:14:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.654+0000 7f1a6cd1d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6809b360 con 0x7f1a68130eb0 2023-10-03T10:14:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.654+0000 7f1a66d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a68130eb0 0x7f1a68138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.654+0000 7f1a6659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1a6809d860 0x7f1a6809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.654+0000 7f1a66d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a68130eb0 0x7f1a68138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44976/0 (socket says 172.21.15.146:44976) 2023-10-03T10:14:35.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.654+0000 7f1a6659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1a6809d860 0x7f1a6809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36958/0 (socket says 172.21.15.146:36958) 2023-10-03T10:14:35.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.654+0000 7f1a66d9d700 1 -- 172.21.15.146:0/2319310342 learned_addr learned my addr 172.21.15.146:0/2319310342 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:35.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.655+0000 7f1a66d9d700 1 -- 172.21.15.146:0/2319310342 >> v2:172.21.15.146:3300/0 conn(0x7f1a6809d860 msgr2=0x7f1a6809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:35.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.655+0000 7f1a66d9d700 1 --2- 172.21.15.146:0/2319310342 >> v2:172.21.15.146:3300/0 conn(0x7f1a6809d860 0x7f1a6809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.655+0000 7f1a66d9d700 1 -- 172.21.15.146:0/2319310342 >> v1:172.21.15.146:6789/0 conn(0x7f1a6809e170 legacy=0x7f1a681307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.655+0000 7f1a66d9d700 1 -- 172.21.15.146:0/2319310342 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6809b620 con 0x7f1a68130eb0 2023-10-03T10:14:35.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.655+0000 7f1a66d9d700 1 --2- 172.21.15.146:0/2319310342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a68130eb0 0x7f1a68138a00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009e50 tx=0x7f1a6000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=113ce256236bc231 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.655+0000 7f1a6559a700 1 -- 172.21.15.146:0/2319310342 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6000e070 con 0x7f1a68130eb0 2023-10-03T10:14:35.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.655+0000 7f1a6559a700 1 -- 172.21.15.146:0/2319310342 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6000b910 con 0x7f1a68130eb0 2023-10-03T10:14:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.655+0000 7f1a6559a700 1 -- 172.21.15.146:0/2319310342 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6000bcc0 con 0x7f1a68130eb0 2023-10-03T10:14:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.656+0000 7f1a6cd1d700 1 -- 172.21.15.146:0/2319310342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a68130eb0 msgr2=0x7f1a68138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.656+0000 7f1a6cd1d700 1 --2- 172.21.15.146:0/2319310342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a68130eb0 0x7f1a68138a00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009e50 tx=0x7f1a6000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.656+0000 7f1a6cd1d700 1 -- 172.21.15.146:0/2319310342 shutdown_connections 2023-10-03T10:14:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.656+0000 7f1a6cd1d700 1 --2- 172.21.15.146:0/2319310342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a68130eb0 0x7f1a68138a00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.656+0000 7f1a6cd1d700 1 --2- 172.21.15.146:0/2319310342 >> v2:172.21.15.146:3300/0 conn(0x7f1a6809d860 0x7f1a6809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.656+0000 7f1a6cd1d700 1 -- 172.21.15.146:0/2319310342 >> 172.21.15.146:0/2319310342 conn(0x7f1a68099c40 msgr2=0x7f1a680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.656+0000 7f1a6cd1d700 1 -- 172.21.15.146:0/2319310342 shutdown_connections 2023-10-03T10:14:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.656+0000 7f1a6cd1d700 1 -- 172.21.15.146:0/2319310342 wait complete. 2023-10-03T10:14:35.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.658+0000 7f1a6cd1d700 1 Processor -- start 2023-10-03T10:14:35.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.658+0000 7f1a6cd1d700 1 -- start start 2023-10-03T10:14:35.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.658+0000 7f1a6cd1d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a6809d860 0x7f1a6812f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.658+0000 7f1a6cd1d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a6809e170 0x7f1a6812fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.658+0000 7f1a6cd1d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a68130eb0 0x7f1a68130210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.658+0000 7f1a6cd1d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a68136e00 con 0x7f1a68130eb0 2023-10-03T10:14:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.658+0000 7f1a6cd1d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a68137540 con 0x7f1a6809e170 2023-10-03T10:14:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.658+0000 7f1a6cd1d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6809c8b0 con 0x7f1a6809d860 2023-10-03T10:14:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.659+0000 7f1a65d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a6809e170 0x7f1a6812fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.659+0000 7f1a6659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a6809d860 0x7f1a6812f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.659+0000 7f1a66d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a68130eb0 0x7f1a68130210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.659+0000 7f1a65d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a6809e170 0x7f1a6812fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44988/0 (socket says 172.21.15.146:44988) 2023-10-03T10:14:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.659+0000 7f1a66d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a68130eb0 0x7f1a68130210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36974/0 (socket says 172.21.15.146:36974) 2023-10-03T10:14:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.659+0000 7f1a6659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a6809d860 0x7f1a6812f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:48866/0 (socket says 172.21.15.146:48866) 2023-10-03T10:14:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.659+0000 7f1a65d9b700 1 -- 172.21.15.146:0/3754604114 learned_addr learned my addr 172.21.15.146:0/3754604114 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.659+0000 7f1a65d9b700 1 -- 172.21.15.146:0/3754604114 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a6809d860 msgr2=0x7f1a6812f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.659+0000 7f1a65d9b700 1 --2- 172.21.15.146:0/3754604114 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a6809d860 0x7f1a6812f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.659+0000 7f1a65d9b700 1 -- 172.21.15.146:0/3754604114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a68130eb0 msgr2=0x7f1a68130210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.659+0000 7f1a65d9b700 1 --2- 172.21.15.146:0/3754604114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a68130eb0 0x7f1a68130210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.659+0000 7f1a65d9b700 1 -- 172.21.15.146:0/3754604114 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a60009b30 con 0x7f1a6809e170 2023-10-03T10:14:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.659+0000 7f1a66d9d700 1 --2- 172.21.15.146:0/3754604114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a68130eb0 0x7f1a68130210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.659+0000 7f1a65d9b700 1 --2- 172.21.15.146:0/3754604114 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a6809e170 0x7f1a6812fcd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00c4b0 tx=0x7f1a5c00c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.659+0000 7f1a56ffd700 1 -- 172.21.15.146:0/3754604114 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c0052d0 con 0x7f1a6809e170 2023-10-03T10:14:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.659+0000 7f1a56ffd700 1 -- 172.21.15.146:0/3754604114 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c005430 con 0x7f1a6809e170 2023-10-03T10:14:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.659+0000 7f1a56ffd700 1 -- 172.21.15.146:0/3754604114 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c0038c0 con 0x7f1a6809e170 2023-10-03T10:14:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.659+0000 7f1a6cd1d700 1 -- 172.21.15.146:0/3754604114 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a680a2140 con 0x7f1a6809e170 2023-10-03T10:14:35.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.660+0000 7f1a6cd1d700 1 -- 172.21.15.146:0/3754604114 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a68137da0 con 0x7f1a6809e170 2023-10-03T10:14:35.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.660+0000 7f1a56ffd700 1 -- 172.21.15.146:0/3754604114 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a5c003a20 con 0x7f1a6809e170 2023-10-03T10:14:35.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.661+0000 7f1a56ffd700 1 -- 172.21.15.146:0/3754604114 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1a5c03eaf0 con 0x7f1a6809e170 2023-10-03T10:14:35.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.661+0000 7f1a6cd1d700 1 -- 172.21.15.146:0/3754604114 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a68137fc0 con 0x7f1a6809e170 2023-10-03T10:14:35.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.665+0000 7f1a56ffd700 1 -- 172.21.15.146:0/3754604114 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a5c018260 con 0x7f1a6809e170 2023-10-03T10:14:35.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.690+0000 7fb784b45700 1 Processor -- start 2023-10-03T10:14:35.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.690+0000 7fb784b45700 1 -- start start 2023-10-03T10:14:35.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.690+0000 7fb784b45700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb780133ad0 0x7fb780133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.690+0000 7fb784b45700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7801300a0 0x7fb7801304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.690+0000 7fb784b45700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb7801309f0 0x7fb78013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.690+0000 7fb784b45700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb78006b2d0 con 0x7fb780133ad0 2023-10-03T10:14:35.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.690+0000 7fb784b45700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb780133610 con 0x7fb7801300a0 2023-10-03T10:14:35.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.690+0000 7fb784b45700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb78009a500 con 0x7fb7801309f0 2023-10-03T10:14:35.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.691+0000 7fb777fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7801300a0 0x7fb7801304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.691+0000 7fb777fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7801300a0 0x7fb7801304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44990/0 (socket says 172.21.15.146:44990) 2023-10-03T10:14:35.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.691+0000 7fb777fff700 1 -- 172.21.15.146:0/3492427987 learned_addr learned my addr 172.21.15.146:0/3492427987 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:35.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.691+0000 7fb77e59c700 1 --2- 172.21.15.146:0/3492427987 >> v2:172.21.15.146:3300/0 conn(0x7fb780133ad0 0x7fb780133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.691+0000 7fb77e59c700 1 -- 172.21.15.146:0/3492427987 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb7801309f0 msgr2=0x7fb78013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.691+0000 7fb77e59c700 1 --2- 172.21.15.146:0/3492427987 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb7801309f0 0x7fb78013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.691+0000 7fb77e59c700 1 -- 172.21.15.146:0/3492427987 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7801300a0 msgr2=0x7fb7801304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.691+0000 7fb77e59c700 1 --2- 172.21.15.146:0/3492427987 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7801300a0 0x7fb7801304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.691+0000 7fb77e59c700 1 -- 172.21.15.146:0/3492427987 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7801338b0 con 0x7fb780133ad0 2023-10-03T10:14:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.691+0000 7fb77e59c700 1 --2- 172.21.15.146:0/3492427987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb780133ad0 0x7fb780133ea0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb770009840 tx=0x7fb770009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca860c41233030 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.691+0000 7fb77dd9b700 1 -- 172.21.15.146:0/3492427987 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb770011830 con 0x7fb780133ad0 2023-10-03T10:14:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.691+0000 7fb77dd9b700 1 -- 172.21.15.146:0/3492427987 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb770011990 con 0x7fb780133ad0 2023-10-03T10:14:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.691+0000 7fb77dd9b700 1 -- 172.21.15.146:0/3492427987 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb770011d20 con 0x7fb780133ad0 2023-10-03T10:14:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.692+0000 7fb784b45700 1 -- 172.21.15.146:0/3492427987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb780133ad0 msgr2=0x7fb780133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.692+0000 7fb784b45700 1 --2- 172.21.15.146:0/3492427987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb780133ad0 0x7fb780133ea0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb770009840 tx=0x7fb770009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:35.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.692+0000 7fb784b45700 1 -- 172.21.15.146:0/3492427987 shutdown_connections 2023-10-03T10:14:35.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.692+0000 7fb784b45700 1 --2- 172.21.15.146:0/3492427987 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb7801309f0 0x7fb78013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.692+0000 7fb784b45700 1 --2- 172.21.15.146:0/3492427987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb780133ad0 0x7fb780133ea0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.692+0000 7fb784b45700 1 --2- 172.21.15.146:0/3492427987 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7801300a0 0x7fb7801304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.692+0000 7fb784b45700 1 -- 172.21.15.146:0/3492427987 >> 172.21.15.146:0/3492427987 conn(0x7fb780099c40 msgr2=0x7fb7800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.692+0000 7fb784b45700 1 -- 172.21.15.146:0/3492427987 shutdown_connections 2023-10-03T10:14:35.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.692+0000 7fb784b45700 1 -- 172.21.15.146:0/3492427987 wait complete. 2023-10-03T10:14:35.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.693+0000 7fb784b45700 1 Processor -- start 2023-10-03T10:14:35.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.694+0000 7fb784b45700 1 -- start start 2023-10-03T10:14:35.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.694+0000 7fb784b45700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7801300a0 0x7fb78011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.694+0000 7fb784b45700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7801309f0 0x7fb78011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.694+0000 7fb784b45700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb780133ad0 0x7fb78011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.694+0000 7fb784b45700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb780120130 con 0x7fb7801300a0 2023-10-03T10:14:35.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.694+0000 7fb784b45700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb78012d900 con 0x7fb7801309f0 2023-10-03T10:14:35.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.694+0000 7fb784b45700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb780120a30 con 0x7fb780133ad0 2023-10-03T10:14:35.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.694+0000 7fb77e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7801300a0 0x7fb78011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.694+0000 7fb77e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7801300a0 0x7fb78011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36992/0 (socket says 172.21.15.146:36992) 2023-10-03T10:14:35.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.694+0000 7fb77e59c700 1 -- 172.21.15.146:0/2299630846 learned_addr learned my addr 172.21.15.146:0/2299630846 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:35.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.694+0000 7fb777fff700 1 --2- 172.21.15.146:0/2299630846 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7801309f0 0x7fb78011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.694+0000 7fb77ed9d700 1 --2- 172.21.15.146:0/2299630846 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb780133ad0 0x7fb78011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.695+0000 7fb77e59c700 1 -- 172.21.15.146:0/2299630846 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb780133ad0 msgr2=0x7fb78011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.695+0000 7fb77e59c700 1 --2- 172.21.15.146:0/2299630846 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb780133ad0 0x7fb78011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.695+0000 7fb77e59c700 1 -- 172.21.15.146:0/2299630846 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7801309f0 msgr2=0x7fb78011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.695+0000 7fb77e59c700 1 --2- 172.21.15.146:0/2299630846 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7801309f0 0x7fb78011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.695+0000 7fb77e59c700 1 -- 172.21.15.146:0/2299630846 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7700094a0 con 0x7fb7801300a0 2023-10-03T10:14:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.695+0000 7f3c160db700 1 Processor -- start 2023-10-03T10:14:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.695+0000 7fb77e59c700 1 --2- 172.21.15.146:0/2299630846 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7801300a0 0x7fb78011da40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb770009fd0 tx=0x7fb770004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.695+0000 7fb776ffd700 1 -- 172.21.15.146:0/2299630846 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb770004450 con 0x7fb7801300a0 2023-10-03T10:14:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.695+0000 7fb776ffd700 1 -- 172.21.15.146:0/2299630846 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77001f070 con 0x7fb7801300a0 2023-10-03T10:14:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.695+0000 7fb784b45700 1 -- 172.21.15.146:0/2299630846 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78012fe30 con 0x7fb7801300a0 2023-10-03T10:14:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.695+0000 7fb776ffd700 1 -- 172.21.15.146:0/2299630846 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7700038e0 con 0x7fb7801300a0 2023-10-03T10:14:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.695+0000 7fb784b45700 1 -- 172.21.15.146:0/2299630846 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb78011ef20 con 0x7fb7801300a0 2023-10-03T10:14:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.696+0000 7fb776ffd700 1 -- 172.21.15.146:0/2299630846 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb770003a40 con 0x7fb7801300a0 2023-10-03T10:14:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.696+0000 7f3c160db700 1 -- start start 2023-10-03T10:14:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.696+0000 7f3c160db700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c10138040 0x7f3c10138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.696+0000 7f3c160db700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c100a1400 0x7f3c1013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.696+0000 7f3c160db700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c101379e0 con 0x7f3c100a08e0 2023-10-03T10:14:35.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.696+0000 7f3c160db700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c100a2100 con 0x7f3c100a1400 2023-10-03T10:14:35.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.696+0000 7f3c160db700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c10138950 con 0x7f3c10138040 2023-10-03T10:14:35.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.696+0000 7f3c0f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c10138040 0x7f3c10138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.696+0000 7fb776ffd700 1 -- 172.21.15.146:0/2299630846 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb770021070 con 0x7fb7801300a0 2023-10-03T10:14:35.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.696+0000 7f3c0f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c10138040 0x7f3c10138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:48898/0 (socket says 172.21.15.146:48898) 2023-10-03T10:14:35.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.696+0000 7f3c0f7fe700 1 -- 172.21.15.146:0/2915036285 learned_addr learned my addr 172.21.15.146:0/2915036285 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:35.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.697+0000 7f3c0f7fe700 1 -- 172.21.15.146:0/2915036285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c100a1400 msgr2=0x7f3c1013fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:35.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.697+0000 7f3c0f7fe700 1 --2- 172.21.15.146:0/2915036285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c100a1400 0x7f3c1013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.697+0000 7f3c0f7fe700 1 -- 172.21.15.146:0/2915036285 >> v1:172.21.15.146:6789/0 conn(0x7f3c100a08e0 legacy=0x7f3c100a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.697+0000 7f3c0f7fe700 1 -- 172.21.15.146:0/2915036285 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1009b9b0 con 0x7f3c10138040 2023-10-03T10:14:35.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.697+0000 7fb784b45700 1 -- 172.21.15.146:0/2299630846 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78004f2a0 con 0x7fb7801300a0 2023-10-03T10:14:35.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.697+0000 7f3c0f7fe700 1 --2- 172.21.15.146:0/2915036285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c10138040 0x7f3c10138410 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009920 tx=0x7f3c00009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=961423e330322fc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.697+0000 7f3c0e7fc700 1 -- 172.21.15.146:0/2915036285 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00005e30 con 0x7f3c10138040 2023-10-03T10:14:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.697+0000 7f3c0e7fc700 1 -- 172.21.15.146:0/2915036285 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c00009e70 con 0x7f3c10138040 2023-10-03T10:14:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.697+0000 7f3c0e7fc700 1 -- 172.21.15.146:0/2915036285 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00004250 con 0x7f3c10138040 2023-10-03T10:14:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.698+0000 7f3c160db700 1 -- 172.21.15.146:0/2915036285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c10138040 msgr2=0x7f3c10138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.698+0000 7f3c160db700 1 --2- 172.21.15.146:0/2915036285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c10138040 0x7f3c10138410 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009920 tx=0x7f3c00009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.698+0000 7f3c160db700 1 -- 172.21.15.146:0/2915036285 shutdown_connections 2023-10-03T10:14:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.698+0000 7f3c160db700 1 --2- 172.21.15.146:0/2915036285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c100a1400 0x7f3c1013fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.698+0000 7f3c160db700 1 --2- 172.21.15.146:0/2915036285 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c10138040 0x7f3c10138410 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.698+0000 7f3c160db700 1 -- 172.21.15.146:0/2915036285 >> 172.21.15.146:0/2915036285 conn(0x7f3c100a2980 msgr2=0x7f3c100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.698+0000 7f3c160db700 1 -- 172.21.15.146:0/2915036285 shutdown_connections 2023-10-03T10:14:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.698+0000 7f3c160db700 1 -- 172.21.15.146:0/2915036285 wait complete. 2023-10-03T10:14:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.700+0000 7f3c160db700 1 Processor -- start 2023-10-03T10:14:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.700+0000 7f3c160db700 1 -- start start 2023-10-03T10:14:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.700+0000 7f3c160db700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c100a08e0 0x7f3c1013e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.700+0000 7f3c160db700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c100a1400 0x7f3c10135b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.700+0000 7f3c160db700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c10138040 0x7f3c10136080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.700+0000 7f3c160db700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c101192f0 con 0x7f3c100a08e0 2023-10-03T10:14:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.700+0000 7f3c160db700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1009a2d0 con 0x7f3c10138040 2023-10-03T10:14:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.700+0000 7f3c160db700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c101302a0 con 0x7f3c100a1400 2023-10-03T10:14:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.701+0000 7f3c0f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c100a08e0 0x7f3c1013e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.701+0000 7f3c0f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c100a08e0 0x7f3c1013e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37000/0 (socket says 172.21.15.146:37000) 2023-10-03T10:14:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.701+0000 7f3c0f7fe700 1 -- 172.21.15.146:0/676922103 learned_addr learned my addr 172.21.15.146:0/676922103 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.701+0000 7f3c0ffff700 1 --2- 172.21.15.146:0/676922103 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c10138040 0x7f3c10136080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.701+0000 7f3c0effd700 1 --2- 172.21.15.146:0/676922103 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c100a1400 0x7f3c10135b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.701+0000 7f3c0f7fe700 1 -- 172.21.15.146:0/676922103 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c100a1400 msgr2=0x7f3c10135b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.701+0000 7f3c0f7fe700 1 --2- 172.21.15.146:0/676922103 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c100a1400 0x7f3c10135b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.701+0000 7f3c0f7fe700 1 -- 172.21.15.146:0/676922103 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c10138040 msgr2=0x7f3c10136080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.701+0000 7f3c0f7fe700 1 --2- 172.21.15.146:0/676922103 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c10138040 0x7f3c10136080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.701+0000 7f3c0f7fe700 1 -- 172.21.15.146:0/676922103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c00009500 con 0x7f3c100a08e0 2023-10-03T10:14:35.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.701+0000 7f3c0f7fe700 1 --2- 172.21.15.146:0/676922103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c100a08e0 0x7f3c1013e720 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3c00014040 tx=0x7f3c00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.702+0000 7f3bf7fff700 1 -- 172.21.15.146:0/676922103 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00005cb0 con 0x7f3c100a08e0 2023-10-03T10:14:35.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.702+0000 7f3bf7fff700 1 -- 172.21.15.146:0/676922103 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c000038b0 con 0x7f3c100a08e0 2023-10-03T10:14:35.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.702+0000 7f3bf7fff700 1 -- 172.21.15.146:0/676922103 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00003c40 con 0x7f3c100a08e0 2023-10-03T10:14:35.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.702+0000 7f3c160db700 1 -- 172.21.15.146:0/676922103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c101194d0 con 0x7f3c100a08e0 2023-10-03T10:14:35.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.702+0000 7fb776ffd700 1 -- 172.21.15.146:0/2299630846 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb770015070 con 0x7fb7801300a0 2023-10-03T10:14:35.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.702+0000 7f3c160db700 1 -- 172.21.15.146:0/676922103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c1013fb10 con 0x7f3c100a08e0 2023-10-03T10:14:35.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.703+0000 7f3bf7fff700 1 -- 172.21.15.146:0/676922103 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3c0000b610 con 0x7f3c100a08e0 2023-10-03T10:14:35.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.703+0000 7f3bf7fff700 1 -- 172.21.15.146:0/676922103 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3c000406b0 con 0x7f3c100a08e0 2023-10-03T10:14:35.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.703+0000 7f3c160db700 1 -- 172.21.15.146:0/676922103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c10119150 con 0x7f3c100a08e0 2023-10-03T10:14:35.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.711+0000 7f3bf7fff700 1 -- 172.21.15.146:0/676922103 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3c10119150 con 0x7f3c100a08e0 2023-10-03T10:14:35.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.740+0000 7f2d18e59700 1 Processor -- start 2023-10-03T10:14:35.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.740+0000 7f2d18e59700 1 -- start start 2023-10-03T10:14:35.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.741+0000 7f2d18e59700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d14138040 0x7f2d14138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.741+0000 7f2d18e59700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2d140a08e0 0x7f2d140a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.741+0000 7f2d18e59700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d141379e0 con 0x7f2d140a1230 2023-10-03T10:14:35.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.741+0000 7f2d18e59700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d140a2100 con 0x7f2d140a08e0 2023-10-03T10:14:35.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.741+0000 7f2d18e59700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d14138950 con 0x7f2d14138040 2023-10-03T10:14:35.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.741+0000 7f2d11d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2d140a08e0 0x7f2d140a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.741+0000 7f2d1259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d14138040 0x7f2d14138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.741+0000 7f2d11d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2d140a08e0 0x7f2d140a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37014/0 (socket says 172.21.15.146:37014) 2023-10-03T10:14:35.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.741+0000 7f2d11d9b700 1 -- 172.21.15.146:0/587103088 learned_addr learned my addr 172.21.15.146:0/587103088 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:35.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.741+0000 7f2d12d9d700 1 --1- 172.21.15.146:0/587103088 >> v1:172.21.15.146:6789/0 conn(0x7f2d140a1230 0x7f2d1413ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46432/0 (socket says 172.21.15.146:46432) 2023-10-03T10:14:35.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.741+0000 7f2d11d9b700 1 -- 172.21.15.146:0/587103088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d14138040 msgr2=0x7f2d14138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:35.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.741+0000 7f2d11d9b700 1 --2- 172.21.15.146:0/587103088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d14138040 0x7f2d14138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.741+0000 7f2d11d9b700 1 -- 172.21.15.146:0/587103088 >> v1:172.21.15.146:6789/0 conn(0x7f2d140a1230 legacy=0x7f2d1413ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.741+0000 7f2d11d9b700 1 -- 172.21.15.146:0/587103088 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1409b9b0 con 0x7f2d140a08e0 2023-10-03T10:14:35.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.741+0000 7f2d1159a700 1 -- 172.21.15.146:0/587103088 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283170651 0 0) 0x7f2d141379e0 con 0x7f2d140a1230 2023-10-03T10:14:35.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.741+0000 7f2d11d9b700 1 --2- 172.21.15.146:0/587103088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d140a08e0 0x7f2d140a0cf0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009920 tx=0x7f2d08009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6d3523cdc37b54 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.741+0000 7f2d1159a700 1 -- 172.21.15.146:0/587103088 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08011830 con 0x7f2d140a08e0 2023-10-03T10:14:35.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.742+0000 7f2d1159a700 1 -- 172.21.15.146:0/587103088 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d08011990 con 0x7f2d140a08e0 2023-10-03T10:14:35.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.742+0000 7f2d1159a700 1 -- 172.21.15.146:0/587103088 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08011d20 con 0x7f2d140a08e0 2023-10-03T10:14:35.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.742+0000 7f2d18e59700 1 -- 172.21.15.146:0/587103088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d140a08e0 msgr2=0x7f2d140a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.742+0000 7f2d18e59700 1 --2- 172.21.15.146:0/587103088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d140a08e0 0x7f2d140a0cf0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009920 tx=0x7f2d08009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:35.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.742+0000 7f2d18e59700 1 -- 172.21.15.146:0/587103088 shutdown_connections 2023-10-03T10:14:35.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.742+0000 7f2d18e59700 1 --2- 172.21.15.146:0/587103088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d14138040 0x7f2d14138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.742+0000 7f2d18e59700 1 --2- 172.21.15.146:0/587103088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d140a08e0 0x7f2d140a0cf0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.742+0000 7f2d18e59700 1 -- 172.21.15.146:0/587103088 >> 172.21.15.146:0/587103088 conn(0x7f2d140a2980 msgr2=0x7f2d140a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.742+0000 7f2d18e59700 1 -- 172.21.15.146:0/587103088 shutdown_connections 2023-10-03T10:14:35.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.742+0000 7f2d18e59700 1 -- 172.21.15.146:0/587103088 wait complete. 2023-10-03T10:14:35.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.743+0000 7f2d18e59700 1 Processor -- start 2023-10-03T10:14:35.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.744+0000 7f2d18e59700 1 -- start start 2023-10-03T10:14:35.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.744+0000 7f2d18e59700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d140a08e0 0x7f2d141234f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.744+0000 7f2d18e59700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d140a1230 0x7f2d14123a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.744+0000 7f2d18e59700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d14138040 0x7f2d14123f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.744+0000 7f2d18e59700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d14127010 con 0x7f2d14138040 2023-10-03T10:14:35.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.744+0000 7f2d18e59700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d14124930 con 0x7f2d140a1230 2023-10-03T10:14:35.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.744+0000 7f2d18e59700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d14125100 con 0x7f2d140a08e0 2023-10-03T10:14:35.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.744+0000 7f2d1259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d140a08e0 0x7f2d141234f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.744+0000 7f2d1259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d140a08e0 0x7f2d141234f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:48920/0 (socket says 172.21.15.146:48920) 2023-10-03T10:14:35.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.744+0000 7f2d1259c700 1 -- 172.21.15.146:0/2559612250 learned_addr learned my addr 172.21.15.146:0/2559612250 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:35.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.744+0000 7f2d11d9b700 1 --2- 172.21.15.146:0/2559612250 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d140a1230 0x7f2d14123a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.744+0000 7f2d12d9d700 1 --2- 172.21.15.146:0/2559612250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d14138040 0x7f2d14123f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.745+0000 7f2d1259c700 1 -- 172.21.15.146:0/2559612250 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d140a1230 msgr2=0x7f2d14123a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.745+0000 7f2d1259c700 1 --2- 172.21.15.146:0/2559612250 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d140a1230 0x7f2d14123a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.745+0000 7f2d1259c700 1 -- 172.21.15.146:0/2559612250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d14138040 msgr2=0x7f2d14123f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.745+0000 7f2d1259c700 1 --2- 172.21.15.146:0/2559612250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d14138040 0x7f2d14123f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.745+0000 7f2d1259c700 1 -- 172.21.15.146:0/2559612250 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d08009550 con 0x7f2d140a08e0 2023-10-03T10:14:35.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.745+0000 7f2d1259c700 1 --2- 172.21.15.146:0/2559612250 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d140a08e0 0x7f2d141234f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400e9c0 tx=0x7f2d0400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.745+0000 7f2d02ffd700 1 -- 172.21.15.146:0/2559612250 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d040096f0 con 0x7f2d140a08e0 2023-10-03T10:14:35.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.745+0000 7f2d02ffd700 1 -- 172.21.15.146:0/2559612250 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0400ee60 con 0x7f2d140a08e0 2023-10-03T10:14:35.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.745+0000 7f2d18e59700 1 -- 172.21.15.146:0/2559612250 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d14125920 con 0x7f2d140a08e0 2023-10-03T10:14:35.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.745+0000 7f2d02ffd700 1 -- 172.21.15.146:0/2559612250 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0400ca50 con 0x7f2d140a08e0 2023-10-03T10:14:35.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.745+0000 7f2d18e59700 1 -- 172.21.15.146:0/2559612250 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d14134010 con 0x7f2d140a08e0 2023-10-03T10:14:35.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.746+0000 7f2d18e59700 1 -- 172.21.15.146:0/2559612250 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1404f2a0 con 0x7f2d140a08e0 2023-10-03T10:14:35.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.747+0000 7f2d02ffd700 1 -- 172.21.15.146:0/2559612250 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d0400cbb0 con 0x7f2d140a08e0 2023-10-03T10:14:35.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.747+0000 7f2d02ffd700 1 -- 172.21.15.146:0/2559612250 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2d0403ff40 con 0x7f2d140a08e0 2023-10-03T10:14:35.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.751+0000 7f2d02ffd700 1 -- 172.21.15.146:0/2559612250 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d0401a360 con 0x7f2d140a08e0 2023-10-03T10:14:35.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.880+0000 7f1a6cd1d700 1 -- 172.21.15.146:0/3754604114 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1a68138f60 con 0x7f1a6809e170 2023-10-03T10:14:35.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.881+0000 7f1a56ffd700 1 -- 172.21.15.146:0/3754604114 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1a5c017020 con 0x7f1a6809e170 2023-10-03T10:14:35.881 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:35.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.883+0000 7f1a6cd1d700 1 -- 172.21.15.146:0/3754604114 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a6809e170 msgr2=0x7f1a6812fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.883+0000 7f1a6cd1d700 1 --2- 172.21.15.146:0/3754604114 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a6809e170 0x7f1a6812fcd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00c4b0 tx=0x7f1a5c00c7c0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.883+0000 7f1a6cd1d700 1 -- 172.21.15.146:0/3754604114 shutdown_connections 2023-10-03T10:14:35.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.883+0000 7f1a6cd1d700 1 --2- 172.21.15.146:0/3754604114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a68130eb0 0x7f1a68130210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.883+0000 7f1a6cd1d700 1 --2- 172.21.15.146:0/3754604114 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a6809d860 0x7f1a6812f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.883+0000 7f1a6cd1d700 1 --2- 172.21.15.146:0/3754604114 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a6809e170 0x7f1a6812fcd0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.883+0000 7f1a6cd1d700 1 -- 172.21.15.146:0/3754604114 >> 172.21.15.146:0/3754604114 conn(0x7f1a68099c40 msgr2=0x7f1a6813b710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.884+0000 7f1a6cd1d700 1 -- 172.21.15.146:0/3754604114 shutdown_connections 2023-10-03T10:14:35.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.884+0000 7f1a6cd1d700 1 -- 172.21.15.146:0/3754604114 wait complete. 2023-10-03T10:14:35.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:35.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.943+0000 7f2d18e59700 1 -- 172.21.15.146:0/2559612250 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2d140712d0 con 0x7f2d140a08e0 2023-10-03T10:14:35.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.944+0000 7f2d02ffd700 1 -- 172.21.15.146:0/2559612250 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d0402b090 con 0x7f2d140a08e0 2023-10-03T10:14:35.944 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:35.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.946+0000 7f2d18e59700 1 -- 172.21.15.146:0/2559612250 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d140a08e0 msgr2=0x7f2d141234f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.946+0000 7f2d18e59700 1 --2- 172.21.15.146:0/2559612250 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d140a08e0 0x7f2d141234f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400e9c0 tx=0x7f2d0400ecd0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.947+0000 7f2d18e59700 1 -- 172.21.15.146:0/2559612250 shutdown_connections 2023-10-03T10:14:35.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.947+0000 7f2d18e59700 1 --2- 172.21.15.146:0/2559612250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d14138040 0x7f2d14123f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.947+0000 7f2d18e59700 1 --2- 172.21.15.146:0/2559612250 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d140a08e0 0x7f2d141234f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.947+0000 7f2d18e59700 1 --2- 172.21.15.146:0/2559612250 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d140a1230 0x7f2d14123a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.947+0000 7f2d18e59700 1 -- 172.21.15.146:0/2559612250 >> 172.21.15.146:0/2559612250 conn(0x7f2d140a2980 msgr2=0x7f2d1409e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.947+0000 7f2d18e59700 1 -- 172.21.15.146:0/2559612250 shutdown_connections 2023-10-03T10:14:35.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.947+0000 7f2d18e59700 1 -- 172.21.15.146:0/2559612250 wait complete. 2023-10-03T10:14:35.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.952+0000 7fb784b45700 1 -- 172.21.15.146:0/2299630846 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb78006c3b0 con 0x7fb7801300a0 2023-10-03T10:14:35.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.952+0000 7fb776ffd700 1 -- 172.21.15.146:0/2299630846 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb7700253e0 con 0x7fb7801300a0 2023-10-03T10:14:35.953 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:35.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.955+0000 7fb784b45700 1 -- 172.21.15.146:0/2299630846 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7801300a0 msgr2=0x7fb78011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.955+0000 7fb784b45700 1 --2- 172.21.15.146:0/2299630846 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7801300a0 0x7fb78011da40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb770009fd0 tx=0x7fb770004750 comp rx=0 tx=0).stop 2023-10-03T10:14:35.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.955+0000 7fb784b45700 1 -- 172.21.15.146:0/2299630846 shutdown_connections 2023-10-03T10:14:35.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.955+0000 7fb784b45700 1 --2- 172.21.15.146:0/2299630846 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb780133ad0 0x7fb78011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.955+0000 7fb784b45700 1 --2- 172.21.15.146:0/2299630846 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7801300a0 0x7fb78011da40 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.955+0000 7f3c160db700 1 -- 172.21.15.146:0/676922103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3c10119150 con 0x7f3c100a08e0 2023-10-03T10:14:35.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.955+0000 7fb784b45700 1 --2- 172.21.15.146:0/2299630846 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7801309f0 0x7fb78011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.955+0000 7fb784b45700 1 -- 172.21.15.146:0/2299630846 >> 172.21.15.146:0/2299630846 conn(0x7fb780099c40 msgr2=0x7fb780132100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.955+0000 7fb784b45700 1 -- 172.21.15.146:0/2299630846 shutdown_connections 2023-10-03T10:14:35.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.955+0000 7fb784b45700 1 -- 172.21.15.146:0/2299630846 wait complete. 2023-10-03T10:14:35.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.955+0000 7f3bf7fff700 1 -- 172.21.15.146:0/676922103 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3c10119150 con 0x7f3c100a08e0 2023-10-03T10:14:35.957 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:35.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.958+0000 7f3c160db700 1 -- 172.21.15.146:0/676922103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c100a08e0 msgr2=0x7f3c1013e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.958+0000 7f3c160db700 1 --2- 172.21.15.146:0/676922103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c100a08e0 0x7f3c1013e720 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3c00014040 tx=0x7f3c00004750 comp rx=0 tx=0).stop 2023-10-03T10:14:35.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.958+0000 7f3c160db700 1 -- 172.21.15.146:0/676922103 shutdown_connections 2023-10-03T10:14:35.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.958+0000 7f3c160db700 1 --2- 172.21.15.146:0/676922103 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c10138040 0x7f3c10136080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.958+0000 7f3c160db700 1 --2- 172.21.15.146:0/676922103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c100a08e0 0x7f3c1013e720 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.958+0000 7f3c160db700 1 --2- 172.21.15.146:0/676922103 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c100a1400 0x7f3c10135b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.958+0000 7f3c160db700 1 -- 172.21.15.146:0/676922103 >> 172.21.15.146:0/676922103 conn(0x7f3c100a2980 msgr2=0x7f3c1009d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.958+0000 7f3c160db700 1 -- 172.21.15.146:0/676922103 shutdown_connections 2023-10-03T10:14:35.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:35.958+0000 7f3c160db700 1 -- 172.21.15.146:0/676922103 wait complete. 2023-10-03T10:14:35.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:35.971 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:35.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:36.898 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:36.963 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:36.972 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:36.972 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:37.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.037+0000 7f7c656c5700 1 Processor -- start 2023-10-03T10:14:37.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.038+0000 7f7c656c5700 1 -- start start 2023-10-03T10:14:37.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.038+0000 7f7c656c5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c60132100 0x7f7c601367d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.038+0000 7f7c656c5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c601314b0 0x7f7c60138d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.038+0000 7f7c656c5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c600a0f20 con 0x7f7c60066410 2023-10-03T10:14:37.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.038+0000 7f7c656c5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c600667e0 con 0x7f7c60132100 2023-10-03T10:14:37.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.038+0000 7f7c656c5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c600a23c0 con 0x7f7c601314b0 2023-10-03T10:14:37.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.038+0000 7f7c5e7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c60132100 0x7f7c601367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.038+0000 7f7c5e7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c60132100 0x7f7c601367d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45044/0 (socket says 172.21.15.146:45044) 2023-10-03T10:14:37.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.038+0000 7f7c5e7fc700 1 -- 172.21.15.146:0/4019378956 learned_addr learned my addr 172.21.15.146:0/4019378956 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:37.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.039+0000 7f7c5f7fe700 1 --2- 172.21.15.146:0/4019378956 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c601314b0 0x7f7c60138d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.039+0000 7f7c5e7fc700 1 -- 172.21.15.146:0/4019378956 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c601314b0 msgr2=0x7f7c60138d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.039+0000 7f7c5e7fc700 1 --2- 172.21.15.146:0/4019378956 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c601314b0 0x7f7c60138d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.039+0000 7f7c5e7fc700 1 -- 172.21.15.146:0/4019378956 >> v1:172.21.15.146:6789/0 conn(0x7f7c60066410 legacy=0x7f7c601319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.039+0000 7f7c5e7fc700 1 -- 172.21.15.146:0/4019378956 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c600a16e0 con 0x7f7c60132100 2023-10-03T10:14:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.039+0000 7f7c5e7fc700 1 --2- 172.21.15.146:0/4019378956 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c60132100 0x7f7c601367d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009950 tx=0x7f7c54009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f913efe333a3c2a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.039+0000 7f7c5dffb700 1 -- 172.21.15.146:0/4019378956 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54011830 con 0x7f7c60132100 2023-10-03T10:14:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.039+0000 7f7c5dffb700 1 -- 172.21.15.146:0/4019378956 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c54011990 con 0x7f7c60132100 2023-10-03T10:14:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.039+0000 7f7c5dffb700 1 -- 172.21.15.146:0/4019378956 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54011d00 con 0x7f7c60132100 2023-10-03T10:14:37.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.040+0000 7f7c656c5700 1 -- 172.21.15.146:0/4019378956 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c60132100 msgr2=0x7f7c601367d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.040+0000 7f7c656c5700 1 --2- 172.21.15.146:0/4019378956 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c60132100 0x7f7c601367d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009950 tx=0x7f7c54009c60 comp rx=0 tx=0).stop 2023-10-03T10:14:37.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.040+0000 7f7c656c5700 1 -- 172.21.15.146:0/4019378956 shutdown_connections 2023-10-03T10:14:37.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.040+0000 7f7c656c5700 1 --2- 172.21.15.146:0/4019378956 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c601314b0 0x7f7c60138d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.040+0000 7f7c656c5700 1 --2- 172.21.15.146:0/4019378956 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c60132100 0x7f7c601367d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.040+0000 7f7c656c5700 1 -- 172.21.15.146:0/4019378956 >> 172.21.15.146:0/4019378956 conn(0x7f7c600a2980 msgr2=0x7f7c600a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.040+0000 7f7c656c5700 1 -- 172.21.15.146:0/4019378956 shutdown_connections 2023-10-03T10:14:37.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.040+0000 7f7c656c5700 1 -- 172.21.15.146:0/4019378956 wait complete. 2023-10-03T10:14:37.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.042+0000 7f7c656c5700 1 Processor -- start 2023-10-03T10:14:37.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.042+0000 7f7c656c5700 1 -- start start 2023-10-03T10:14:37.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.043+0000 7f7c656c5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c60066410 0x7f7c60137920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.043+0000 7f7c656c5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c601314b0 0x7f7c60137e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.043+0000 7f7c656c5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c60132100 0x7f7c60099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.043+0000 7f7c656c5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c60136b10 con 0x7f7c60132100 2023-10-03T10:14:37.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.043+0000 7f7c656c5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6009aef0 con 0x7f7c60066410 2023-10-03T10:14:37.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.043+0000 7f7c656c5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c60135870 con 0x7f7c601314b0 2023-10-03T10:14:37.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.043+0000 7f7c5effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c60066410 0x7f7c60137920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.043+0000 7f7c5effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c60066410 0x7f7c60137920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45052/0 (socket says 172.21.15.146:45052) 2023-10-03T10:14:37.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.043+0000 7f7c5effd700 1 -- 172.21.15.146:0/1060517129 learned_addr learned my addr 172.21.15.146:0/1060517129 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:37.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.043+0000 7f7c5e7fc700 1 --2- 172.21.15.146:0/1060517129 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c601314b0 0x7f7c60137e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.043+0000 7f7c5effd700 1 -- 172.21.15.146:0/1060517129 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c601314b0 msgr2=0x7f7c60137e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.043+0000 7f7c5effd700 1 --2- 172.21.15.146:0/1060517129 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c601314b0 0x7f7c60137e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.043+0000 7f7c5effd700 1 -- 172.21.15.146:0/1060517129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c60132100 msgr2=0x7f7c60099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.043+0000 7f7c5effd700 1 --2- 172.21.15.146:0/1060517129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c60132100 0x7f7c60099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.043+0000 7f7c5effd700 1 -- 172.21.15.146:0/1060517129 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c54009550 con 0x7f7c60066410 2023-10-03T10:14:37.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.043+0000 7f7c5e7fc700 1 --2- 172.21.15.146:0/1060517129 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c601314b0 0x7f7c60137e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:37.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.043+0000 7f7c5effd700 1 --2- 172.21.15.146:0/1060517129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c60066410 0x7f7c60137920 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000c4b0 tx=0x7f7c5000c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.044+0000 7f7c477fe700 1 -- 172.21.15.146:0/1060517129 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c500054e0 con 0x7f7c60066410 2023-10-03T10:14:37.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.044+0000 7f7c656c5700 1 -- 172.21.15.146:0/1060517129 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c60071b90 con 0x7f7c60066410 2023-10-03T10:14:37.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.044+0000 7f7c656c5700 1 -- 172.21.15.146:0/1060517129 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c601353f0 con 0x7f7c60066410 2023-10-03T10:14:37.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.044+0000 7f7c477fe700 1 -- 172.21.15.146:0/1060517129 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c50003680 con 0x7f7c60066410 2023-10-03T10:14:37.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.044+0000 7f7c477fe700 1 -- 172.21.15.146:0/1060517129 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c50003a30 con 0x7f7c60066410 2023-10-03T10:14:37.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.045+0000 7f7c656c5700 1 -- 172.21.15.146:0/1060517129 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c400052e0 con 0x7f7c60066410 2023-10-03T10:14:37.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.046+0000 7f7c477fe700 1 -- 172.21.15.146:0/1060517129 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c50003b90 con 0x7f7c60066410 2023-10-03T10:14:37.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.046+0000 7f7c477fe700 1 -- 172.21.15.146:0/1060517129 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7c5003ef30 con 0x7f7c60066410 2023-10-03T10:14:37.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.054+0000 7f7c477fe700 1 -- 172.21.15.146:0/1060517129 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c50003e40 con 0x7f7c60066410 2023-10-03T10:14:37.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.125+0000 7fbb325e2700 1 Processor -- start 2023-10-03T10:14:37.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.125+0000 7fbb325e2700 1 -- start start 2023-10-03T10:14:37.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.126+0000 7fbb325e2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c136950 0x7fbb2c138d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.126+0000 7fbb325e2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbb2c139270 0x7fbb2c13b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.126+0000 7fbb325e2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2c133640 con 0x7fbb2c133a70 2023-10-03T10:14:37.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.126+0000 7fbb325e2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2c0a1d50 con 0x7fbb2c139270 2023-10-03T10:14:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.126+0000 7fbb325e2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c134550 con 0x7fbb2c136950 2023-10-03T10:14:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.126+0000 7fbb2b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c136950 0x7fbb2c138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.126+0000 7fbb2b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c136950 0x7fbb2c138d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45058/0 (socket says 172.21.15.146:45058) 2023-10-03T10:14:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.126+0000 7fbb2b7fe700 1 -- 172.21.15.146:0/3720952838 learned_addr learned my addr 172.21.15.146:0/3720952838 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.126+0000 7fbb30b7f700 1 --2- 172.21.15.146:0/3720952838 >> v2:172.21.15.146:3300/0 conn(0x7fbb2c139270 0x7fbb2c13b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.126+0000 7fbb30b7f700 1 -- 172.21.15.146:0/3720952838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c136950 msgr2=0x7fbb2c138d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:37.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.126+0000 7fbb30b7f700 1 --2- 172.21.15.146:0/3720952838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c136950 0x7fbb2c138d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.126+0000 7fbb30b7f700 1 -- 172.21.15.146:0/3720952838 >> v1:172.21.15.146:6789/0 conn(0x7fbb2c133a70 legacy=0x7fbb2c133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.126+0000 7fbb30b7f700 1 -- 172.21.15.146:0/3720952838 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c09b620 con 0x7fbb2c139270 2023-10-03T10:14:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.126+0000 7fbb2b7fe700 1 --2- 172.21.15.146:0/3720952838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c136950 0x7fbb2c138d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.126+0000 7fbb30b7f700 1 --2- 172.21.15.146:0/3720952838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2c139270 0x7fbb2c13b650 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009d90 tx=0x7fbb2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6127c5266f631ae2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.126+0000 7fbb2affd700 1 -- 172.21.15.146:0/3720952838 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2400e070 con 0x7fbb2c139270 2023-10-03T10:14:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.127+0000 7fbb2affd700 1 -- 172.21.15.146:0/3720952838 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2400bb20 con 0x7fbb2c139270 2023-10-03T10:14:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.127+0000 7fbb2affd700 1 -- 172.21.15.146:0/3720952838 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb24012430 con 0x7fbb2c139270 2023-10-03T10:14:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.127+0000 7fbb325e2700 1 -- 172.21.15.146:0/3720952838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2c139270 msgr2=0x7fbb2c13b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.127+0000 7fbb325e2700 1 --2- 172.21.15.146:0/3720952838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2c139270 0x7fbb2c13b650 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009d90 tx=0x7fbb2400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.127+0000 7fbb325e2700 1 -- 172.21.15.146:0/3720952838 shutdown_connections 2023-10-03T10:14:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.127+0000 7fbb325e2700 1 --2- 172.21.15.146:0/3720952838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2c139270 0x7fbb2c13b650 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.127+0000 7fbb325e2700 1 --2- 172.21.15.146:0/3720952838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c136950 0x7fbb2c138d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.127+0000 7fbb325e2700 1 -- 172.21.15.146:0/3720952838 >> 172.21.15.146:0/3720952838 conn(0x7fbb2c0a2980 msgr2=0x7fbb2c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.128+0000 7fbb325e2700 1 -- 172.21.15.146:0/3720952838 shutdown_connections 2023-10-03T10:14:37.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.128+0000 7fbb325e2700 1 -- 172.21.15.146:0/3720952838 wait complete. 2023-10-03T10:14:37.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.129+0000 7fbb325e2700 1 Processor -- start 2023-10-03T10:14:37.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.129+0000 7fbb325e2700 1 -- start start 2023-10-03T10:14:37.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.130+0000 7fbb325e2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb2c133a70 0x7fbb2c119e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.130+0000 7fbb325e2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c136950 0x7fbb2c11a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.130+0000 7fbb325e2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2c139270 0x7fbb2c11a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.130+0000 7fbb325e2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c12f780 con 0x7fbb2c139270 2023-10-03T10:14:37.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.130+0000 7fbb325e2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c11d990 con 0x7fbb2c136950 2023-10-03T10:14:37.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.130+0000 7fbb325e2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c09a350 con 0x7fbb2c133a70 2023-10-03T10:14:37.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.130+0000 7fbb30b7f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2c139270 0x7fbb2c11a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.130+0000 7fbb30b7f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2c139270 0x7fbb2c11a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37068/0 (socket says 172.21.15.146:37068) 2023-10-03T10:14:37.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.130+0000 7fbb30b7f700 1 -- 172.21.15.146:0/671862121 learned_addr learned my addr 172.21.15.146:0/671862121 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:37.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.130+0000 7fbb2b7fe700 1 --2- 172.21.15.146:0/671862121 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c136950 0x7fbb2c11a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.130+0000 7fbb30b7f700 1 -- 172.21.15.146:0/671862121 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb2c133a70 msgr2=0x7fbb2c119e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.130+0000 7fbb30b7f700 1 --2- 172.21.15.146:0/671862121 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb2c133a70 0x7fbb2c119e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.130+0000 7fbb30b7f700 1 -- 172.21.15.146:0/671862121 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c136950 msgr2=0x7fbb2c11a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.130+0000 7fbb30b7f700 1 --2- 172.21.15.146:0/671862121 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c136950 0x7fbb2c11a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.130+0000 7fbb30b7f700 1 -- 172.21.15.146:0/671862121 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb20009550 con 0x7fbb2c139270 2023-10-03T10:14:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.130+0000 7fbb2b7fe700 1 --2- 172.21.15.146:0/671862121 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c136950 0x7fbb2c11a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.131+0000 7fbb30b7f700 1 --2- 172.21.15.146:0/671862121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2c139270 0x7fbb2c11a8f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbb24013000 tx=0x7fbb24004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.131+0000 7fbb28ff9700 1 -- 172.21.15.146:0/671862121 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb24012430 con 0x7fbb2c139270 2023-10-03T10:14:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.131+0000 7fbb28ff9700 1 -- 172.21.15.146:0/671862121 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb24020070 con 0x7fbb2c139270 2023-10-03T10:14:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.131+0000 7fbb28ff9700 1 -- 172.21.15.146:0/671862121 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb24003ea0 con 0x7fbb2c139270 2023-10-03T10:14:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.131+0000 7fbb325e2700 1 -- 172.21.15.146:0/671862121 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb24009a70 con 0x7fbb2c139270 2023-10-03T10:14:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.131+0000 7fbb325e2700 1 -- 172.21.15.146:0/671862121 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2c11d3f0 con 0x7fbb2c139270 2023-10-03T10:14:37.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.132+0000 7fbb325e2700 1 -- 172.21.15.146:0/671862121 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2c04f2a0 con 0x7fbb2c139270 2023-10-03T10:14:37.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.132+0000 7fbb28ff9700 1 -- 172.21.15.146:0/671862121 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb24004280 con 0x7fbb2c139270 2023-10-03T10:14:37.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.132+0000 7fbb28ff9700 1 -- 172.21.15.146:0/671862121 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbb24022070 con 0x7fbb2c139270 2023-10-03T10:14:37.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.137+0000 7fbb28ff9700 1 -- 172.21.15.146:0/671862121 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb2401c400 con 0x7fbb2c139270 2023-10-03T10:14:37.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.141+0000 7f55a2863700 1 Processor -- start 2023-10-03T10:14:37.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.141+0000 7f55a2863700 1 -- start start 2023-10-03T10:14:37.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.141+0000 7f55a2863700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f559c06a770 0x7f559c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.141+0000 7f55a2863700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f559c136cb0 0x7f559c139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.141+0000 7f55a2863700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f559c06e900 con 0x7f559c09dec0 2023-10-03T10:14:37.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.141+0000 7f55a2863700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c09d180 con 0x7f559c136cb0 2023-10-03T10:14:37.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.141+0000 7f55a2863700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f559c09e780 con 0x7f559c06a770 2023-10-03T10:14:37.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.142+0000 7f559b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f559c09dec0 0x7f559c06b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46454/0 (socket says 172.21.15.146:46454) 2023-10-03T10:14:37.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.142+0000 7f559b7fe700 1 -- 172.21.15.146:0/3397658216 learned_addr learned my addr 172.21.15.146:0/3397658216 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:37.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.142+0000 7f559bfff700 1 --2- 172.21.15.146:0/3397658216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f559c06a770 0x7f559c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.142+0000 7f559bfff700 1 -- 172.21.15.146:0/3397658216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f559c136cb0 msgr2=0x7f559c139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:37.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.142+0000 7f559bfff700 1 --2- 172.21.15.146:0/3397658216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f559c136cb0 0x7f559c139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.142+0000 7f559bfff700 1 -- 172.21.15.146:0/3397658216 >> v1:172.21.15.146:6789/0 conn(0x7f559c09dec0 legacy=0x7f559c06b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.142+0000 7f559affd700 1 -- 172.21.15.146:0/3397658216 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420626707 0 0) 0x7f559c06e900 con 0x7f559c09dec0 2023-10-03T10:14:37.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.142+0000 7f559bfff700 1 -- 172.21.15.146:0/3397658216 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c09d3c0 con 0x7f559c06a770 2023-10-03T10:14:37.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.142+0000 7f559bfff700 1 --2- 172.21.15.146:0/3397658216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f559c06a770 0x7f559c06ab40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f558c009870 tx=0x7f558c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85198f428dd285 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.142+0000 7f559affd700 1 -- 172.21.15.146:0/3397658216 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c011830 con 0x7f559c06a770 2023-10-03T10:14:37.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.142+0000 7f559affd700 1 -- 172.21.15.146:0/3397658216 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558c011990 con 0x7f559c06a770 2023-10-03T10:14:37.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.142+0000 7f559affd700 1 -- 172.21.15.146:0/3397658216 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c011d20 con 0x7f559c06a770 2023-10-03T10:14:37.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.143+0000 7fface5ca700 1 Processor -- start 2023-10-03T10:14:37.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.143+0000 7fface5ca700 1 -- start start 2023-10-03T10:14:37.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.143+0000 7f55a2863700 1 -- 172.21.15.146:0/3397658216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f559c06a770 msgr2=0x7f559c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.143+0000 7f55a2863700 1 --2- 172.21.15.146:0/3397658216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f559c06a770 0x7f559c06ab40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f558c009870 tx=0x7f558c009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:37.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7fface5ca700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffac809e870 0x7ffac809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7fface5ca700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac8131f40 0x7ffac8139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7fface5ca700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac809c970 con 0x7ffac809f180 2023-10-03T10:14:37.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7fface5ca700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac80a0920 con 0x7ffac809e870 2023-10-03T10:14:37.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7fface5ca700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffac809f9c0 con 0x7ffac8131f40 2023-10-03T10:14:37.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7ffac7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffac809e870 0x7ffac809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7ffac77fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ffac809f180 0x7ffac8131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46466/0 (socket says 172.21.15.146:46466) 2023-10-03T10:14:37.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7ffac77fe700 1 -- 172.21.15.146:0/3833179135 learned_addr learned my addr 172.21.15.146:0/3833179135 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:37.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7ffaccb67700 1 --2- 172.21.15.146:0/3833179135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac8131f40 0x7ffac8139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7f55a2863700 1 -- 172.21.15.146:0/3397658216 shutdown_connections 2023-10-03T10:14:37.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7f55a2863700 1 --2- 172.21.15.146:0/3397658216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f559c136cb0 0x7f559c139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7f55a2863700 1 --2- 172.21.15.146:0/3397658216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f559c06a770 0x7f559c06ab40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7f55a2863700 1 -- 172.21.15.146:0/3397658216 >> 172.21.15.146:0/3397658216 conn(0x7f559c099c40 msgr2=0x7f559c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7ffaccb67700 1 -- 172.21.15.146:0/3833179135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffac809e870 msgr2=0x7ffac809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7ffaccb67700 1 --2- 172.21.15.146:0/3833179135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffac809e870 0x7ffac809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7ffaccb67700 1 -- 172.21.15.146:0/3833179135 >> v1:172.21.15.146:6789/0 conn(0x7ffac809f180 legacy=0x7ffac8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7f55a2863700 1 -- 172.21.15.146:0/3397658216 shutdown_connections 2023-10-03T10:14:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7ffaccb67700 1 -- 172.21.15.146:0/3833179135 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac809bab0 con 0x7ffac8131f40 2023-10-03T10:14:37.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7f55a2863700 1 -- 172.21.15.146:0/3397658216 wait complete. 2023-10-03T10:14:37.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.145+0000 7f55a2863700 1 Processor -- start 2023-10-03T10:14:37.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.145+0000 7f55a2863700 1 -- start start 2023-10-03T10:14:37.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7ffaccb67700 1 --2- 172.21.15.146:0/3833179135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac8131f40 0x7ffac8139ca0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009dc0 tx=0x7ffac000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b7c0c340c1ad2ef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7ffac6ffd700 1 -- 172.21.15.146:0/3833179135 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac000e070 con 0x7ffac8131f40 2023-10-03T10:14:37.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7ffac6ffd700 1 -- 172.21.15.146:0/3833179135 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac0003a20 con 0x7ffac8131f40 2023-10-03T10:14:37.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.144+0000 7ffac6ffd700 1 -- 172.21.15.146:0/3833179135 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0003dd0 con 0x7ffac8131f40 2023-10-03T10:14:37.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.145+0000 7fface5ca700 1 -- 172.21.15.146:0/3833179135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac8131f40 msgr2=0x7ffac8139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.145+0000 7fface5ca700 1 --2- 172.21.15.146:0/3833179135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac8131f40 0x7ffac8139ca0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009dc0 tx=0x7ffac000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:37.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.146+0000 7fface5ca700 1 -- 172.21.15.146:0/3833179135 shutdown_connections 2023-10-03T10:14:37.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.146+0000 7fface5ca700 1 --2- 172.21.15.146:0/3833179135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac8131f40 0x7ffac8139ca0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.146+0000 7fface5ca700 1 --2- 172.21.15.146:0/3833179135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffac809e870 0x7ffac809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.146+0000 7fface5ca700 1 -- 172.21.15.146:0/3833179135 >> 172.21.15.146:0/3833179135 conn(0x7ffac80a4430 msgr2=0x7ffac80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.146+0000 7fface5ca700 1 -- 172.21.15.146:0/3833179135 shutdown_connections 2023-10-03T10:14:37.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.146+0000 7fface5ca700 1 -- 172.21.15.146:0/3833179135 wait complete. 2023-10-03T10:14:37.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.146+0000 7f55a2863700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f559c06a770 0x7f559c12e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.146+0000 7f55a2863700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c09dec0 0x7f559c12ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.146+0000 7f55a2863700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f559c136cb0 0x7f559c12f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.146+0000 7f55a2863700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c071d70 con 0x7f559c09dec0 2023-10-03T10:14:37.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.146+0000 7f55a2863700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c132d30 con 0x7f559c136cb0 2023-10-03T10:14:37.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.146+0000 7f55a2863700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f559c134fc0 con 0x7f559c06a770 2023-10-03T10:14:37.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.146+0000 7f55a0e00700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f559c136cb0 0x7f559c12f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.146+0000 7f55a0e00700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f559c136cb0 0x7f559c12f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45098/0 (socket says 172.21.15.146:45098) 2023-10-03T10:14:37.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.146+0000 7f559b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c09dec0 0x7f559c12ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.146+0000 7f55a0e00700 1 -- 172.21.15.146:0/2071117462 learned_addr learned my addr 172.21.15.146:0/2071117462 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:37.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.146+0000 7f55a0e00700 1 -- 172.21.15.146:0/2071117462 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f559c06a770 msgr2=0x7f559c12e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.146+0000 7f55a0e00700 1 --2- 172.21.15.146:0/2071117462 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f559c06a770 0x7f559c12e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.146+0000 7f55a0e00700 1 -- 172.21.15.146:0/2071117462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c09dec0 msgr2=0x7f559c12ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.146+0000 7f55a0e00700 1 --2- 172.21.15.146:0/2071117462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c09dec0 0x7f559c12ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.146+0000 7f55a0e00700 1 -- 172.21.15.146:0/2071117462 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558c0094a0 con 0x7f559c136cb0 2023-10-03T10:14:37.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.146+0000 7f55a0e00700 1 --2- 172.21.15.146:0/2071117462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f559c136cb0 0x7f559c12f290 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f559400b9e0 tx=0x7f559400bcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.147+0000 7fface5ca700 1 Processor -- start 2023-10-03T10:14:37.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.147+0000 7f5598ff9700 1 -- 172.21.15.146:0/2071117462 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559400c930 con 0x7f559c136cb0 2023-10-03T10:14:37.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.147+0000 7f5598ff9700 1 -- 172.21.15.146:0/2071117462 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559400cad0 con 0x7f559c136cb0 2023-10-03T10:14:37.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.147+0000 7f55a2863700 1 -- 172.21.15.146:0/2071117462 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559c135280 con 0x7f559c136cb0 2023-10-03T10:14:37.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.147+0000 7f55a2863700 1 -- 172.21.15.146:0/2071117462 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559c1335e0 con 0x7f559c136cb0 2023-10-03T10:14:37.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.147+0000 7f5598ff9700 1 -- 172.21.15.146:0/2071117462 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559400ce80 con 0x7f559c136cb0 2023-10-03T10:14:37.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.148+0000 7fface5ca700 1 -- start start 2023-10-03T10:14:37.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.148+0000 7f55a2863700 1 -- 172.21.15.146:0/2071117462 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f557c0052e0 con 0x7f559c136cb0 2023-10-03T10:14:37.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.148+0000 7f5598ff9700 1 -- 172.21.15.146:0/2071117462 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5594014440 con 0x7f559c136cb0 2023-10-03T10:14:37.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.148+0000 7fface5ca700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffac809e870 0x7ffac81ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.148+0000 7f5598ff9700 1 -- 172.21.15.146:0/2071117462 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5594006e40 con 0x7f559c136cb0 2023-10-03T10:14:37.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.148+0000 7fface5ca700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffac809f180 0x7ffac81cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.148+0000 7fface5ca700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac8131f40 0x7ffac81272e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.148+0000 7fface5ca700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac8128610 con 0x7ffac809e870 2023-10-03T10:14:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.148+0000 7fface5ca700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac8129ef0 con 0x7ffac809f180 2023-10-03T10:14:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.148+0000 7fface5ca700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffac809dba0 con 0x7ffac8131f40 2023-10-03T10:14:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.149+0000 7ffaccb67700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac8131f40 0x7ffac81272e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.149+0000 7ffaccb67700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac8131f40 0x7ffac81272e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:48990/0 (socket says 172.21.15.146:48990) 2023-10-03T10:14:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.149+0000 7ffaccb67700 1 -- 172.21.15.146:0/2145065453 learned_addr learned my addr 172.21.15.146:0/2145065453 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.149+0000 7ffac7fff700 1 --2- 172.21.15.146:0/2145065453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffac809e870 0x7ffac81ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.149+0000 7ffaccb67700 1 -- 172.21.15.146:0/2145065453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffac809f180 msgr2=0x7ffac81cd2b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.149+0000 7ffaccb67700 1 --2- 172.21.15.146:0/2145065453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffac809f180 0x7ffac81cd2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.149+0000 7ffaccb67700 1 -- 172.21.15.146:0/2145065453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffac809e870 msgr2=0x7ffac81ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.149+0000 7ffaccb67700 1 --2- 172.21.15.146:0/2145065453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffac809e870 0x7ffac81ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.149+0000 7ffaccb67700 1 -- 172.21.15.146:0/2145065453 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac0009a70 con 0x7ffac8131f40 2023-10-03T10:14:37.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.149+0000 7ffaccb67700 1 --2- 172.21.15.146:0/2145065453 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac8131f40 0x7ffac81272e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ffac809fb50 tx=0x7ffac0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.150+0000 7ffac4ff9700 1 -- 172.21.15.146:0/2145065453 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0004720 con 0x7ffac8131f40 2023-10-03T10:14:37.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.150+0000 7ffac4ff9700 1 -- 172.21.15.146:0/2145065453 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac00048a0 con 0x7ffac8131f40 2023-10-03T10:14:37.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.150+0000 7ffac4ff9700 1 -- 172.21.15.146:0/2145065453 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0012670 con 0x7ffac8131f40 2023-10-03T10:14:37.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.150+0000 7fface5ca700 1 -- 172.21.15.146:0/2145065453 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac80a2b80 con 0x7ffac8131f40 2023-10-03T10:14:37.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.150+0000 7fface5ca700 1 -- 172.21.15.146:0/2145065453 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac81287d0 con 0x7ffac8131f40 2023-10-03T10:14:37.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.152+0000 7ffaae7fc700 1 -- 172.21.15.146:0/2145065453 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa00052e0 con 0x7ffac8131f40 2023-10-03T10:14:37.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.153+0000 7ffac4ff9700 1 -- 172.21.15.146:0/2145065453 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffac00127d0 con 0x7ffac8131f40 2023-10-03T10:14:37.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.153+0000 7ffac4ff9700 1 -- 172.21.15.146:0/2145065453 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffac00414d0 con 0x7ffac8131f40 2023-10-03T10:14:37.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.156+0000 7f5598ff9700 1 -- 172.21.15.146:0/2071117462 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f55940133a0 con 0x7f559c136cb0 2023-10-03T10:14:37.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.161+0000 7ffac4ff9700 1 -- 172.21.15.146:0/2145065453 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffac0012a80 con 0x7ffac8131f40 2023-10-03T10:14:37.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.320+0000 7f7c656c5700 1 -- 172.21.15.146:0/1060517129 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7c40005860 con 0x7f7c60066410 2023-10-03T10:14:37.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.320+0000 7f7c477fe700 1 -- 172.21.15.146:0/1060517129 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7c50017030 con 0x7f7c60066410 2023-10-03T10:14:37.321 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:37.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.323+0000 7f7c656c5700 1 -- 172.21.15.146:0/1060517129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c60066410 msgr2=0x7f7c60137920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.323+0000 7f7c656c5700 1 --2- 172.21.15.146:0/1060517129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c60066410 0x7f7c60137920 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000c4b0 tx=0x7f7c5000c7c0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.323+0000 7f7c656c5700 1 -- 172.21.15.146:0/1060517129 shutdown_connections 2023-10-03T10:14:37.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.323+0000 7f7c656c5700 1 --2- 172.21.15.146:0/1060517129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c60132100 0x7f7c60099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.323+0000 7f7c656c5700 1 --2- 172.21.15.146:0/1060517129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c60066410 0x7f7c60137920 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.323+0000 7f7c656c5700 1 --2- 172.21.15.146:0/1060517129 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c601314b0 0x7f7c60137e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.323+0000 7f7c656c5700 1 -- 172.21.15.146:0/1060517129 >> 172.21.15.146:0/1060517129 conn(0x7f7c600a2980 msgr2=0x7f7c6012f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.323+0000 7f7c656c5700 1 -- 172.21.15.146:0/1060517129 shutdown_connections 2023-10-03T10:14:37.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.324+0000 7f7c656c5700 1 -- 172.21.15.146:0/1060517129 wait complete. 2023-10-03T10:14:37.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:37.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.349+0000 7f55a2863700 1 -- 172.21.15.146:0/2071117462 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f557c005590 con 0x7f559c136cb0 2023-10-03T10:14:37.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.349+0000 7f5598ff9700 1 -- 172.21.15.146:0/2071117462 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5594019030 con 0x7f559c136cb0 2023-10-03T10:14:37.350 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:37.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.351+0000 7f55a2863700 1 -- 172.21.15.146:0/2071117462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f559c136cb0 msgr2=0x7f559c12f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.351+0000 7f55a2863700 1 --2- 172.21.15.146:0/2071117462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f559c136cb0 0x7f559c12f290 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f559400b9e0 tx=0x7f559400bcf0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.351+0000 7f55a2863700 1 -- 172.21.15.146:0/2071117462 shutdown_connections 2023-10-03T10:14:37.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.351+0000 7f55a2863700 1 --2- 172.21.15.146:0/2071117462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f559c136cb0 0x7f559c12f290 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.351+0000 7f55a2863700 1 --2- 172.21.15.146:0/2071117462 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f559c06a770 0x7f559c12e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.351+0000 7f55a2863700 1 --2- 172.21.15.146:0/2071117462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f559c09dec0 0x7f559c12ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.351+0000 7f55a2863700 1 -- 172.21.15.146:0/2071117462 >> 172.21.15.146:0/2071117462 conn(0x7f559c099c40 msgr2=0x7f559c137080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.351+0000 7f55a2863700 1 -- 172.21.15.146:0/2071117462 shutdown_connections 2023-10-03T10:14:37.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.351+0000 7f55a2863700 1 -- 172.21.15.146:0/2071117462 wait complete. 2023-10-03T10:14:37.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.353+0000 7ffaae7fc700 1 -- 172.21.15.146:0/2145065453 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffaa0005590 con 0x7ffac8131f40 2023-10-03T10:14:37.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.354+0000 7ffac4ff9700 1 -- 172.21.15.146:0/2145065453 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ffac0011b80 con 0x7ffac8131f40 2023-10-03T10:14:37.354 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:37.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.356+0000 7ffaae7fc700 1 -- 172.21.15.146:0/2145065453 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac8131f40 msgr2=0x7ffac81272e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.356+0000 7ffaae7fc700 1 --2- 172.21.15.146:0/2145065453 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac8131f40 0x7ffac81272e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ffac809fb50 tx=0x7ffac0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.356+0000 7ffaae7fc700 1 -- 172.21.15.146:0/2145065453 shutdown_connections 2023-10-03T10:14:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.356+0000 7ffaae7fc700 1 --2- 172.21.15.146:0/2145065453 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac8131f40 0x7ffac81272e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.356+0000 7ffaae7fc700 1 --2- 172.21.15.146:0/2145065453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffac809e870 0x7ffac81ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.356+0000 7ffaae7fc700 1 --2- 172.21.15.146:0/2145065453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffac809f180 0x7ffac81cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.356+0000 7ffaae7fc700 1 -- 172.21.15.146:0/2145065453 >> 172.21.15.146:0/2145065453 conn(0x7ffac80a4430 msgr2=0x7ffac806bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.356+0000 7ffaae7fc700 1 -- 172.21.15.146:0/2145065453 shutdown_connections 2023-10-03T10:14:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.356+0000 7ffaae7fc700 1 -- 172.21.15.146:0/2145065453 wait complete. 2023-10-03T10:14:37.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:37.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:37.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.380+0000 7fbb325e2700 1 -- 172.21.15.146:0/671862121 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbb2c11c270 con 0x7fbb2c139270 2023-10-03T10:14:37.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.380+0000 7fbb28ff9700 1 -- 172.21.15.146:0/671862121 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb2401a380 con 0x7fbb2c139270 2023-10-03T10:14:37.381 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:37.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.382+0000 7fbb325e2700 1 -- 172.21.15.146:0/671862121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2c139270 msgr2=0x7fbb2c11a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.382+0000 7fbb325e2700 1 --2- 172.21.15.146:0/671862121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2c139270 0x7fbb2c11a8f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbb24013000 tx=0x7fbb24004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.382+0000 7fbb325e2700 1 -- 172.21.15.146:0/671862121 shutdown_connections 2023-10-03T10:14:37.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.382+0000 7fbb325e2700 1 --2- 172.21.15.146:0/671862121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2c139270 0x7fbb2c11a8f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.382+0000 7fbb325e2700 1 --2- 172.21.15.146:0/671862121 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb2c133a70 0x7fbb2c119e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.382+0000 7fbb325e2700 1 --2- 172.21.15.146:0/671862121 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2c136950 0x7fbb2c11a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.382+0000 7fbb325e2700 1 -- 172.21.15.146:0/671862121 >> 172.21.15.146:0/671862121 conn(0x7fbb2c0a2980 msgr2=0x7fbb2c0a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.382+0000 7fbb325e2700 1 -- 172.21.15.146:0/671862121 shutdown_connections 2023-10-03T10:14:37.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:37.382+0000 7fbb325e2700 1 -- 172.21.15.146:0/671862121 wait complete. 2023-10-03T10:14:37.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:38.341 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:38.367 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:38.370 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:38.396 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:38.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.488+0000 7f0590161700 1 Processor -- start 2023-10-03T10:14:38.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.488+0000 7f0590161700 1 -- start start 2023-10-03T10:14:38.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.488+0000 7f0590161700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0588099a60 0x7f05881388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.488+0000 7f0590161700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0588138e30 0x7f058813b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.488+0000 7f0590161700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058809aa00 con 0x7f0588133b80 2023-10-03T10:14:38.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.489+0000 7f0590161700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058809a080 con 0x7f0588138e30 2023-10-03T10:14:38.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.489+0000 7f0590161700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0588133750 con 0x7f0588099a60 2023-10-03T10:14:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.489+0000 7f058defd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0588133b80 0x7f0588133f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46472/0 (socket says 172.21.15.146:46472) 2023-10-03T10:14:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.489+0000 7f058defd700 1 -- 172.21.15.146:0/793873612 learned_addr learned my addr 172.21.15.146:0/793873612 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.489+0000 7f058d6fc700 1 --2- 172.21.15.146:0/793873612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0588099a60 0x7f05881388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.489+0000 7f058e6fe700 1 --2- 172.21.15.146:0/793873612 >> v2:172.21.15.146:3300/0 conn(0x7f0588138e30 0x7f058813b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.489+0000 7f058e6fe700 1 -- 172.21.15.146:0/793873612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0588099a60 msgr2=0x7f05881388f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.489+0000 7f058e6fe700 1 --2- 172.21.15.146:0/793873612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0588099a60 0x7f05881388f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.489+0000 7f058e6fe700 1 -- 172.21.15.146:0/793873612 >> v1:172.21.15.146:6789/0 conn(0x7f0588133b80 legacy=0x7f0588133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.489+0000 7f058e6fe700 1 -- 172.21.15.146:0/793873612 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058809a760 con 0x7f0588138e30 2023-10-03T10:14:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.489+0000 7f058d6fc700 1 --2- 172.21.15.146:0/793873612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0588099a60 0x7f05881388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.489+0000 7f058e6fe700 1 --2- 172.21.15.146:0/793873612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0588138e30 0x7f058813b210 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0580009d90 tx=0x7f058000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba821f807ff2b7d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.489+0000 7f058cefb700 1 -- 172.21.15.146:0/793873612 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058000e070 con 0x7f0588138e30 2023-10-03T10:14:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.489+0000 7f058cefb700 1 -- 172.21.15.146:0/793873612 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058000bb20 con 0x7f0588138e30 2023-10-03T10:14:38.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.489+0000 7f058cefb700 1 -- 172.21.15.146:0/793873612 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0580012430 con 0x7f0588138e30 2023-10-03T10:14:38.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.490+0000 7f0590161700 1 -- 172.21.15.146:0/793873612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0588138e30 msgr2=0x7f058813b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.490+0000 7f0590161700 1 --2- 172.21.15.146:0/793873612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0588138e30 0x7f058813b210 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0580009d90 tx=0x7f058000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:38.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.490+0000 7f0590161700 1 -- 172.21.15.146:0/793873612 shutdown_connections 2023-10-03T10:14:38.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.490+0000 7f0590161700 1 --2- 172.21.15.146:0/793873612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0588138e30 0x7f058813b210 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.490+0000 7f0590161700 1 --2- 172.21.15.146:0/793873612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0588099a60 0x7f05881388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.490+0000 7f0590161700 1 -- 172.21.15.146:0/793873612 >> 172.21.15.146:0/793873612 conn(0x7f05880a2980 msgr2=0x7f05880a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.490+0000 7f0590161700 1 -- 172.21.15.146:0/793873612 shutdown_connections 2023-10-03T10:14:38.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.490+0000 7f0590161700 1 -- 172.21.15.146:0/793873612 wait complete. 2023-10-03T10:14:38.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.491+0000 7f0590161700 1 Processor -- start 2023-10-03T10:14:38.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.491+0000 7f0590161700 1 -- start start 2023-10-03T10:14:38.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.492+0000 7f0590161700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0588099a60 0x7f0588118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.492+0000 7f0590161700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0588133b80 0x7f0588119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.492+0000 7f0590161700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0588138e30 0x7f0588119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.492+0000 7f0590161700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058811b220 con 0x7f0588133b80 2023-10-03T10:14:38.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.492+0000 7f0590161700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058811a250 con 0x7f0588099a60 2023-10-03T10:14:38.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.492+0000 7f0590161700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f058811c860 con 0x7f0588138e30 2023-10-03T10:14:38.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.492+0000 7f058defd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0588099a60 0x7f0588118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.492+0000 7f058d6fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0588133b80 0x7f0588119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.492+0000 7f058defd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0588099a60 0x7f0588118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45118/0 (socket says 172.21.15.146:45118) 2023-10-03T10:14:38.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.492+0000 7f058defd700 1 -- 172.21.15.146:0/3434617034 learned_addr learned my addr 172.21.15.146:0/3434617034 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:38.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.492+0000 7f058defd700 1 -- 172.21.15.146:0/3434617034 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0588138e30 msgr2=0x7f0588119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.492+0000 7f058defd700 1 --2- 172.21.15.146:0/3434617034 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0588138e30 0x7f0588119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.492+0000 7f058defd700 1 -- 172.21.15.146:0/3434617034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0588133b80 msgr2=0x7f0588119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.492+0000 7f058defd700 1 --2- 172.21.15.146:0/3434617034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0588133b80 0x7f0588119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.492+0000 7f058defd700 1 -- 172.21.15.146:0/3434617034 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05780094a0 con 0x7f0588099a60 2023-10-03T10:14:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.492+0000 7f058d6fc700 1 --2- 172.21.15.146:0/3434617034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0588133b80 0x7f0588119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.492+0000 7f058defd700 1 --2- 172.21.15.146:0/3434617034 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0588099a60 0x7f0588118df0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f058400c700 tx=0x7f058400ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.493+0000 7f057e7fc700 1 -- 172.21.15.146:0/3434617034 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05840074e0 con 0x7f0588099a60 2023-10-03T10:14:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.493+0000 7f057e7fc700 1 -- 172.21.15.146:0/3434617034 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0584007640 con 0x7f0588099a60 2023-10-03T10:14:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.493+0000 7f057e7fc700 1 -- 172.21.15.146:0/3434617034 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0584005a30 con 0x7f0588099a60 2023-10-03T10:14:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.493+0000 7f0590161700 1 -- 172.21.15.146:0/3434617034 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0580009a70 con 0x7f0588099a60 2023-10-03T10:14:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.493+0000 7f0590161700 1 -- 172.21.15.146:0/3434617034 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0588131180 con 0x7f0588099a60 2023-10-03T10:14:38.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.494+0000 7f0590161700 1 -- 172.21.15.146:0/3434617034 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058804f2a0 con 0x7f0588099a60 2023-10-03T10:14:38.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.494+0000 7f057e7fc700 1 -- 172.21.15.146:0/3434617034 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0584005b90 con 0x7f0588099a60 2023-10-03T10:14:38.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.495+0000 7f057e7fc700 1 -- 172.21.15.146:0/3434617034 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f058403f3a0 con 0x7f0588099a60 2023-10-03T10:14:38.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.499+0000 7f057e7fc700 1 -- 172.21.15.146:0/3434617034 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0584012400 con 0x7f0588099a60 2023-10-03T10:14:38.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.529+0000 7f267dfe0700 1 Processor -- start 2023-10-03T10:14:38.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.529+0000 7f267dfe0700 1 -- start start 2023-10-03T10:14:38.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.530+0000 7f267dfe0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f267809ad40 0x7f2678133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.530+0000 7f267dfe0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26781343a0 0x7f26780a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.530+0000 7f267dfe0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f267809b110 con 0x7f2678133f70 2023-10-03T10:14:38.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.530+0000 7f267dfe0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26780a3b60 con 0x7f26781343a0 2023-10-03T10:14:38.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.530+0000 7f267dfe0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26780a2fa0 con 0x7f267809ad40 2023-10-03T10:14:38.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.530+0000 7f26777fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f267809ad40 0x7f2678133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.530+0000 7f26777fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f267809ad40 0x7f2678133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:48994/0 (socket says 172.21.15.146:48994) 2023-10-03T10:14:38.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.530+0000 7f26777fe700 1 -- 172.21.15.146:0/557568477 learned_addr learned my addr 172.21.15.146:0/557568477 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:38.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.530+0000 7f2677fff700 1 --2- 172.21.15.146:0/557568477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26781343a0 0x7f26780a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.531+0000 7f2677fff700 1 -- 172.21.15.146:0/557568477 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f267809ad40 msgr2=0x7f2678133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.531+0000 7f2677fff700 1 --2- 172.21.15.146:0/557568477 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f267809ad40 0x7f2678133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.531+0000 7f2677fff700 1 -- 172.21.15.146:0/557568477 >> v1:172.21.15.146:6789/0 conn(0x7f2678133f70 legacy=0x7f26780a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.531+0000 7f2677fff700 1 -- 172.21.15.146:0/557568477 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267809a280 con 0x7f26781343a0 2023-10-03T10:14:38.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.531+0000 7f061e5d7700 1 Processor -- start 2023-10-03T10:14:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.531+0000 7f26777fe700 1 --2- 172.21.15.146:0/557568477 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f267809ad40 0x7f2678133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.531+0000 7f2677fff700 1 --2- 172.21.15.146:0/557568477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26781343a0 0x7f26780a1180 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2670009dc0 tx=0x7f267000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37ec626ba0b273e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.531+0000 7f061e5d7700 1 -- start start 2023-10-03T10:14:38.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.531+0000 7f26767fc700 1 -- 172.21.15.146:0/557568477 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267000e070 con 0x7f26781343a0 2023-10-03T10:14:38.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.531+0000 7f26767fc700 1 -- 172.21.15.146:0/557568477 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267000bb20 con 0x7f26781343a0 2023-10-03T10:14:38.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.531+0000 7f26767fc700 1 -- 172.21.15.146:0/557568477 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2670012430 con 0x7f26781343a0 2023-10-03T10:14:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.532+0000 7f061e5d7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0618138040 0x7f0618138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.532+0000 7f061e5d7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06180a08e0 0x7f06180a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.532+0000 7f061e5d7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f06180a1230 0x7f061813ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.532+0000 7f061e5d7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06180a2100 con 0x7f06180a1230 2023-10-03T10:14:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.532+0000 7f061e5d7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0618138950 con 0x7f0618138040 2023-10-03T10:14:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.532+0000 7f061e5d7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06181379e0 con 0x7f06180a08e0 2023-10-03T10:14:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.532+0000 7f061cb74700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f06180a1230 0x7f061813ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.532+0000 7f061cb74700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f06180a1230 0x7f061813ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37124/0 (socket says 172.21.15.146:37124) 2023-10-03T10:14:38.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.532+0000 7f061cb74700 1 -- 172.21.15.146:0/3103791261 learned_addr learned my addr 172.21.15.146:0/3103791261 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:38.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.532+0000 7f06177fe700 1 --2- 172.21.15.146:0/3103791261 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06180a08e0 0x7f06180a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.532+0000 7f0617fff700 1 --2- 172.21.15.146:0/3103791261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0618138040 0x7f0618138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.532+0000 7f267dfe0700 1 -- 172.21.15.146:0/557568477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26781343a0 msgr2=0x7f26780a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.532+0000 7f267dfe0700 1 --2- 172.21.15.146:0/557568477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26781343a0 0x7f26780a1180 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2670009dc0 tx=0x7f267000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:38.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.532+0000 7f061cb74700 1 -- 172.21.15.146:0/3103791261 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06180a08e0 msgr2=0x7f06180a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.532+0000 7f061cb74700 1 --2- 172.21.15.146:0/3103791261 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06180a08e0 0x7f06180a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.532+0000 7f061cb74700 1 -- 172.21.15.146:0/3103791261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0618138040 msgr2=0x7f0618138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.532+0000 7f061cb74700 1 --2- 172.21.15.146:0/3103791261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0618138040 0x7f0618138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.532+0000 7f061cb74700 1 -- 172.21.15.146:0/3103791261 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061809b9b0 con 0x7f06180a1230 2023-10-03T10:14:38.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.532+0000 7f267dfe0700 1 -- 172.21.15.146:0/557568477 shutdown_connections 2023-10-03T10:14:38.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.532+0000 7f267dfe0700 1 --2- 172.21.15.146:0/557568477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26781343a0 0x7f26780a1180 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.532+0000 7f267dfe0700 1 --2- 172.21.15.146:0/557568477 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f267809ad40 0x7f2678133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.532+0000 7f267dfe0700 1 -- 172.21.15.146:0/557568477 >> 172.21.15.146:0/557568477 conn(0x7f2678099c40 msgr2=0x7f267806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.533+0000 7f267dfe0700 1 -- 172.21.15.146:0/557568477 shutdown_connections 2023-10-03T10:14:38.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.533+0000 7f267dfe0700 1 -- 172.21.15.146:0/557568477 wait complete. 2023-10-03T10:14:38.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.533+0000 7f061cb74700 1 --2- 172.21.15.146:0/3103791261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06180a1230 0x7f061813ed10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0600009950 tx=0x7f0600009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d887cdac15bcd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.533+0000 7f0616ffd700 1 -- 172.21.15.146:0/3103791261 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0600011830 con 0x7f06180a1230 2023-10-03T10:14:38.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.533+0000 7f0616ffd700 1 -- 172.21.15.146:0/3103791261 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0600011990 con 0x7f06180a1230 2023-10-03T10:14:38.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.533+0000 7f0616ffd700 1 -- 172.21.15.146:0/3103791261 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0600011d40 con 0x7f06180a1230 2023-10-03T10:14:38.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.534+0000 7f061e5d7700 1 -- 172.21.15.146:0/3103791261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06180a1230 msgr2=0x7f061813ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.534+0000 7f061e5d7700 1 --2- 172.21.15.146:0/3103791261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06180a1230 0x7f061813ed10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0600009950 tx=0x7f0600009c60 comp rx=0 tx=0).stop 2023-10-03T10:14:38.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.534+0000 7f267dfe0700 1 Processor -- start 2023-10-03T10:14:38.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.534+0000 7f061e5d7700 1 -- 172.21.15.146:0/3103791261 shutdown_connections 2023-10-03T10:14:38.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.534+0000 7f061e5d7700 1 --2- 172.21.15.146:0/3103791261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0618138040 0x7f0618138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.534+0000 7f061e5d7700 1 --2- 172.21.15.146:0/3103791261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06180a1230 0x7f061813ed10 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.534+0000 7f061e5d7700 1 --2- 172.21.15.146:0/3103791261 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06180a08e0 0x7f06180a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.534+0000 7f061e5d7700 1 -- 172.21.15.146:0/3103791261 >> 172.21.15.146:0/3103791261 conn(0x7f06180a2980 msgr2=0x7f06180a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.534+0000 7f061e5d7700 1 -- 172.21.15.146:0/3103791261 shutdown_connections 2023-10-03T10:14:38.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.534+0000 7f061e5d7700 1 -- 172.21.15.146:0/3103791261 wait complete. 2023-10-03T10:14:38.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.534+0000 7f267dfe0700 1 -- start start 2023-10-03T10:14:38.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.535+0000 7f267dfe0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f267809ad40 0x7f26781250d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.535+0000 7f267dfe0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2678133f70 0x7f2678125610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.535+0000 7f267dfe0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26781343a0 0x7f2678125b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.535+0000 7f267dfe0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2678127140 con 0x7f267809ad40 2023-10-03T10:14:38.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.535+0000 7f267dfe0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26781274e0 con 0x7f26781343a0 2023-10-03T10:14:38.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.535+0000 7f267dfe0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2678071190 con 0x7f2678133f70 2023-10-03T10:14:38.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.535+0000 7f26777fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f267809ad40 0x7f26781250d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.535+0000 7f26777fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f267809ad40 0x7f26781250d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37126/0 (socket says 172.21.15.146:37126) 2023-10-03T10:14:38.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.535+0000 7f26777fe700 1 -- 172.21.15.146:0/2648763313 learned_addr learned my addr 172.21.15.146:0/2648763313 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:38.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.535+0000 7f061e5d7700 1 Processor -- start 2023-10-03T10:14:38.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.535+0000 7f26777fe700 1 -- 172.21.15.146:0/2648763313 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2678133f70 msgr2=0x7f2678125610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:38.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.535+0000 7f26777fe700 1 --2- 172.21.15.146:0/2648763313 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2678133f70 0x7f2678125610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.535+0000 7f26777fe700 1 -- 172.21.15.146:0/2648763313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26781343a0 msgr2=0x7f2678125b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.535+0000 7f26777fe700 1 --2- 172.21.15.146:0/2648763313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26781343a0 0x7f2678125b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.535+0000 7f26777fe700 1 -- 172.21.15.146:0/2648763313 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2668009550 con 0x7f267809ad40 2023-10-03T10:14:38.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.535+0000 7f061e5d7700 1 -- start start 2023-10-03T10:14:38.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.536+0000 7f26777fe700 1 --2- 172.21.15.146:0/2648763313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f267809ad40 0x7f26781250d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f266800e9b0 tx=0x7f266800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.536+0000 7f265ffff700 1 -- 172.21.15.146:0/2648763313 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266800c850 con 0x7f267809ad40 2023-10-03T10:14:38.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.536+0000 7f265ffff700 1 -- 172.21.15.146:0/2648763313 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266800c9b0 con 0x7f267809ad40 2023-10-03T10:14:38.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.536+0000 7f265ffff700 1 -- 172.21.15.146:0/2648763313 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266800cd20 con 0x7f267809ad40 2023-10-03T10:14:38.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.536+0000 7f061e5d7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06180a08e0 0x7f0618126290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.536+0000 7f061e5d7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06180a1230 0x7f06181267d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.536+0000 7f061e5d7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0618138040 0x7f0618126d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.536+0000 7f061e5d7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061809c910 con 0x7f06180a1230 2023-10-03T10:14:38.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.536+0000 7f061e5d7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061809a240 con 0x7f06180a08e0 2023-10-03T10:14:38.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.536+0000 7f061e5d7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0618128cc0 con 0x7f0618138040 2023-10-03T10:14:38.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.536+0000 7f0617fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06180a08e0 0x7f0618126290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.536+0000 7f0617fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06180a08e0 0x7f0618126290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45156/0 (socket says 172.21.15.146:45156) 2023-10-03T10:14:38.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.536+0000 7f0617fff700 1 -- 172.21.15.146:0/3231525270 learned_addr learned my addr 172.21.15.146:0/3231525270 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:38.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.536+0000 7f061cb74700 1 --2- 172.21.15.146:0/3231525270 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0618138040 0x7f0618126d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.537+0000 7f0617fff700 1 -- 172.21.15.146:0/3231525270 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0618138040 msgr2=0x7f0618126d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.537+0000 7f0617fff700 1 --2- 172.21.15.146:0/3231525270 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0618138040 0x7f0618126d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.537+0000 7f06177fe700 1 --2- 172.21.15.146:0/3231525270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06180a1230 0x7f06181267d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.537+0000 7f0617fff700 1 -- 172.21.15.146:0/3231525270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06180a1230 msgr2=0x7f06181267d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.537+0000 7f0617fff700 1 --2- 172.21.15.146:0/3231525270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06180a1230 0x7f06181267d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.537+0000 7f0617fff700 1 -- 172.21.15.146:0/3231525270 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0600009550 con 0x7f06180a08e0 2023-10-03T10:14:38.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.537+0000 7f061cb74700 1 --2- 172.21.15.146:0/3231525270 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0618138040 0x7f0618126d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.537+0000 7f06177fe700 1 --2- 172.21.15.146:0/3231525270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06180a1230 0x7f06181267d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:38.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.537+0000 7f0617fff700 1 --2- 172.21.15.146:0/3231525270 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06180a08e0 0x7f0618126290 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0610009fc0 tx=0x7f061000e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.538+0000 7f0614ff9700 1 -- 172.21.15.146:0/3231525270 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061000eea0 con 0x7f06180a08e0 2023-10-03T10:14:38.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.538+0000 7f0614ff9700 1 -- 172.21.15.146:0/3231525270 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0610014420 con 0x7f06180a08e0 2023-10-03T10:14:38.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.538+0000 7f0614ff9700 1 -- 172.21.15.146:0/3231525270 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06100147d0 con 0x7f06180a08e0 2023-10-03T10:14:38.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.538+0000 7f061e5d7700 1 -- 172.21.15.146:0/3231525270 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0618129540 con 0x7f06180a08e0 2023-10-03T10:14:38.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.538+0000 7f061e5d7700 1 -- 172.21.15.146:0/3231525270 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0618129ad0 con 0x7f06180a08e0 2023-10-03T10:14:38.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.537+0000 7f267dfe0700 1 -- 172.21.15.146:0/2648763313 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2670009a70 con 0x7f267809ad40 2023-10-03T10:14:38.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.537+0000 7f267dfe0700 1 -- 172.21.15.146:0/2648763313 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f267809eb30 con 0x7f267809ad40 2023-10-03T10:14:38.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.538+0000 7f265ffff700 1 -- 172.21.15.146:0/2648763313 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2668013470 con 0x7f267809ad40 2023-10-03T10:14:38.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.538+0000 7f265ffff700 1 -- 172.21.15.146:0/2648763313 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f266803fc80 con 0x7f267809ad40 2023-10-03T10:14:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.539+0000 7f0614ff9700 1 -- 172.21.15.146:0/3231525270 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0610014930 con 0x7f06180a08e0 2023-10-03T10:14:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.539+0000 7f061e5d7700 1 -- 172.21.15.146:0/3231525270 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f061804f2a0 con 0x7f06180a08e0 2023-10-03T10:14:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.539+0000 7f0614ff9700 1 -- 172.21.15.146:0/3231525270 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0610041900 con 0x7f06180a08e0 2023-10-03T10:14:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.544+0000 7f0614ff9700 1 -- 172.21.15.146:0/3231525270 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0610045060 con 0x7f06180a08e0 2023-10-03T10:14:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.544+0000 7f267dfe0700 1 -- 172.21.15.146:0/2648763313 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2678127340 con 0x7f267809ad40 2023-10-03T10:14:38.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.553+0000 7f265ffff700 1 -- 172.21.15.146:0/2648763313 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2678127340 con 0x7f267809ad40 2023-10-03T10:14:38.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.569+0000 7fe41e6e2700 1 Processor -- start 2023-10-03T10:14:38.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.569+0000 7fe41e6e2700 1 -- start start 2023-10-03T10:14:38.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.569+0000 7fe41e6e2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe41809d860 0x7fe41809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.569+0000 7fe41e6e2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe41809e170 0x7fe4181307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.569+0000 7fe41e6e2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe418130ce0 0x7fe418131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.569+0000 7fe41e6e2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41809aaa0 con 0x7fe41809e170 2023-10-03T10:14:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.569+0000 7fe41e6e2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41809f870 con 0x7fe418130ce0 2023-10-03T10:14:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.569+0000 7fe41e6e2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe41809b360 con 0x7fe41809d860 2023-10-03T10:14:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.570+0000 7fe417fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe41809d860 0x7fe41809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.570+0000 7fe4177fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe41809e170 0x7fe4181307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.570+0000 7fe417fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe41809d860 0x7fe41809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49016/0 (socket says 172.21.15.146:49016) 2023-10-03T10:14:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.570+0000 7fe417fff700 1 -- 172.21.15.146:0/3539427499 learned_addr learned my addr 172.21.15.146:0/3539427499 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.570+0000 7fe41cc7f700 1 --2- 172.21.15.146:0/3539427499 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe418130ce0 0x7fe418131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.570+0000 7fe4177fe700 1 -- 172.21.15.146:0/3539427499 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe41809d860 msgr2=0x7fe41809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.570+0000 7fe4177fe700 1 --2- 172.21.15.146:0/3539427499 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe41809d860 0x7fe41809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.570+0000 7fe4177fe700 1 -- 172.21.15.146:0/3539427499 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe418130ce0 msgr2=0x7fe418131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.570+0000 7fe4177fe700 1 --2- 172.21.15.146:0/3539427499 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe418130ce0 0x7fe418131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.570+0000 7fe4177fe700 1 -- 172.21.15.146:0/3539427499 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41809b620 con 0x7fe41809e170 2023-10-03T10:14:38.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.570+0000 7fe417fff700 1 --2- 172.21.15.146:0/3539427499 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe41809d860 0x7fe41809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.570+0000 7fe41cc7f700 1 --2- 172.21.15.146:0/3539427499 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe418130ce0 0x7fe418131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.570+0000 7fe4177fe700 1 --2- 172.21.15.146:0/3539427499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe41809e170 0x7fe4181307a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe40c009840 tx=0x7fe40c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ee78edc8d22efa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.571+0000 7fe416ffd700 1 -- 172.21.15.146:0/3539427499 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c011830 con 0x7fe41809e170 2023-10-03T10:14:38.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.571+0000 7fe416ffd700 1 -- 172.21.15.146:0/3539427499 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c011990 con 0x7fe41809e170 2023-10-03T10:14:38.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.571+0000 7fe416ffd700 1 -- 172.21.15.146:0/3539427499 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c011d20 con 0x7fe41809e170 2023-10-03T10:14:38.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.571+0000 7fe41e6e2700 1 -- 172.21.15.146:0/3539427499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe41809e170 msgr2=0x7fe4181307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.571+0000 7fe41e6e2700 1 --2- 172.21.15.146:0/3539427499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe41809e170 0x7fe4181307a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe40c009840 tx=0x7fe40c009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:38.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.572+0000 7fe41e6e2700 1 -- 172.21.15.146:0/3539427499 shutdown_connections 2023-10-03T10:14:38.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.572+0000 7fe41e6e2700 1 --2- 172.21.15.146:0/3539427499 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe418130ce0 0x7fe418131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.572+0000 7fe41e6e2700 1 --2- 172.21.15.146:0/3539427499 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe41809d860 0x7fe41809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.572+0000 7fe41e6e2700 1 --2- 172.21.15.146:0/3539427499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe41809e170 0x7fe4181307a0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.572+0000 7fe41e6e2700 1 -- 172.21.15.146:0/3539427499 >> 172.21.15.146:0/3539427499 conn(0x7fe418099c40 msgr2=0x7fe4180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.572+0000 7fe41e6e2700 1 -- 172.21.15.146:0/3539427499 shutdown_connections 2023-10-03T10:14:38.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.572+0000 7fe41e6e2700 1 -- 172.21.15.146:0/3539427499 wait complete. 2023-10-03T10:14:38.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.573+0000 7fe41e6e2700 1 Processor -- start 2023-10-03T10:14:38.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.573+0000 7fe41e6e2700 1 -- start start 2023-10-03T10:14:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.574+0000 7fe41e6e2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe41809d860 0x7fe41811b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.574+0000 7fe41e6e2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe41809e170 0x7fe41811b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.574+0000 7fe41e6e2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe418130ce0 0x7fe41811bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.574+0000 7fe41e6e2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41811c620 con 0x7fe41809d860 2023-10-03T10:14:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.574+0000 7fe41e6e2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41812d530 con 0x7fe41809e170 2023-10-03T10:14:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.574+0000 7fe41e6e2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe41811dfb0 con 0x7fe418130ce0 2023-10-03T10:14:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.574+0000 7fe417fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe41809d860 0x7fe41811b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.574+0000 7fe417fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe41809d860 0x7fe41811b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37150/0 (socket says 172.21.15.146:37150) 2023-10-03T10:14:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.574+0000 7fe417fff700 1 -- 172.21.15.146:0/4252320781 learned_addr learned my addr 172.21.15.146:0/4252320781 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.574+0000 7fe41cc7f700 1 --2- 172.21.15.146:0/4252320781 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe418130ce0 0x7fe41811bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.574+0000 7fe4177fe700 1 --2- 172.21.15.146:0/4252320781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe41809e170 0x7fe41811b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.574+0000 7fe417fff700 1 -- 172.21.15.146:0/4252320781 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe418130ce0 msgr2=0x7fe41811bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.575+0000 7fe417fff700 1 --2- 172.21.15.146:0/4252320781 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe418130ce0 0x7fe41811bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.575+0000 7fe417fff700 1 -- 172.21.15.146:0/4252320781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe41809e170 msgr2=0x7fe41811b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.575+0000 7fe417fff700 1 --2- 172.21.15.146:0/4252320781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe41809e170 0x7fe41811b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.575+0000 7fe417fff700 1 -- 172.21.15.146:0/4252320781 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40800b600 con 0x7fe41809d860 2023-10-03T10:14:38.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.575+0000 7fe417fff700 1 --2- 172.21.15.146:0/4252320781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe41809d860 0x7fe41811b150 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe40800fdb0 tx=0x7fe40800d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.575+0000 7fe414ff9700 1 -- 172.21.15.146:0/4252320781 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40800dd90 con 0x7fe41809d860 2023-10-03T10:14:38.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.575+0000 7fe414ff9700 1 -- 172.21.15.146:0/4252320781 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe408004030 con 0x7fe41809d860 2023-10-03T10:14:38.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.575+0000 7fe41e6e2700 1 -- 172.21.15.146:0/4252320781 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41000f050 con 0x7fe41809d860 2023-10-03T10:14:38.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.575+0000 7fe414ff9700 1 -- 172.21.15.146:0/4252320781 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4080043c0 con 0x7fe41809d860 2023-10-03T10:14:38.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.575+0000 7fe41e6e2700 1 -- 172.21.15.146:0/4252320781 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe40c0094a0 con 0x7fe41809d860 2023-10-03T10:14:38.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.576+0000 7fe414ff9700 1 -- 172.21.15.146:0/4252320781 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4080036a0 con 0x7fe41809d860 2023-10-03T10:14:38.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.576+0000 7fe414ff9700 1 -- 172.21.15.146:0/4252320781 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe40803fde0 con 0x7fe41809d860 2023-10-03T10:14:38.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.576+0000 7fe41e6e2700 1 -- 172.21.15.146:0/4252320781 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41811e460 con 0x7fe41809d860 2023-10-03T10:14:38.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.581+0000 7fe414ff9700 1 -- 172.21.15.146:0/4252320781 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe41811e460 con 0x7fe41809d860 2023-10-03T10:14:38.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.708+0000 7f0590161700 1 -- 172.21.15.146:0/3434617034 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f058811bba0 con 0x7f0588099a60 2023-10-03T10:14:38.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.708+0000 7f057e7fc700 1 -- 172.21.15.146:0/3434617034 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0584017030 con 0x7f0588099a60 2023-10-03T10:14:38.709 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:38.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.710+0000 7f0590161700 1 -- 172.21.15.146:0/3434617034 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0588099a60 msgr2=0x7f0588118df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.710+0000 7f0590161700 1 --2- 172.21.15.146:0/3434617034 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0588099a60 0x7f0588118df0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f058400c700 tx=0x7f058400ca10 comp rx=0 tx=0).stop 2023-10-03T10:14:38.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.710+0000 7f0590161700 1 -- 172.21.15.146:0/3434617034 shutdown_connections 2023-10-03T10:14:38.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.710+0000 7f0590161700 1 --2- 172.21.15.146:0/3434617034 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0588138e30 0x7f0588119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.710+0000 7f0590161700 1 --2- 172.21.15.146:0/3434617034 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0588099a60 0x7f0588118df0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.710+0000 7f0590161700 1 --2- 172.21.15.146:0/3434617034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0588133b80 0x7f0588119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.710+0000 7f0590161700 1 -- 172.21.15.146:0/3434617034 >> 172.21.15.146:0/3434617034 conn(0x7f05880a2980 msgr2=0x7f05881314d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.710+0000 7f0590161700 1 -- 172.21.15.146:0/3434617034 shutdown_connections 2023-10-03T10:14:38.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.710+0000 7f0590161700 1 -- 172.21.15.146:0/3434617034 wait complete. 2023-10-03T10:14:38.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:38.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.743+0000 7f061e5d7700 1 -- 172.21.15.146:0/3231525270 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f061806bce0 con 0x7f06180a08e0 2023-10-03T10:14:38.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.743+0000 7f0614ff9700 1 -- 172.21.15.146:0/3231525270 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0610014be0 con 0x7f06180a08e0 2023-10-03T10:14:38.744 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:38.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.745+0000 7f061e5d7700 1 -- 172.21.15.146:0/3231525270 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06180a08e0 msgr2=0x7f0618126290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.745+0000 7f061e5d7700 1 --2- 172.21.15.146:0/3231525270 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06180a08e0 0x7f0618126290 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0610009fc0 tx=0x7f061000e3c0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.745+0000 7f061e5d7700 1 -- 172.21.15.146:0/3231525270 shutdown_connections 2023-10-03T10:14:38.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.745+0000 7f061e5d7700 1 --2- 172.21.15.146:0/3231525270 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0618138040 0x7f0618126d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.745+0000 7f061e5d7700 1 --2- 172.21.15.146:0/3231525270 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06180a08e0 0x7f0618126290 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.745+0000 7f061e5d7700 1 --2- 172.21.15.146:0/3231525270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06180a1230 0x7f06181267d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.745+0000 7f061e5d7700 1 -- 172.21.15.146:0/3231525270 >> 172.21.15.146:0/3231525270 conn(0x7f06180a2980 msgr2=0x7f061809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.746+0000 7f061e5d7700 1 -- 172.21.15.146:0/3231525270 shutdown_connections 2023-10-03T10:14:38.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.746+0000 7f061e5d7700 1 -- 172.21.15.146:0/3231525270 wait complete. 2023-10-03T10:14:38.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.749+0000 7f267dfe0700 1 -- 172.21.15.146:0/2648763313 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2678127340 con 0x7f267809ad40 2023-10-03T10:14:38.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.749+0000 7f265ffff700 1 -- 172.21.15.146:0/2648763313 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2678127340 con 0x7f267809ad40 2023-10-03T10:14:38.750 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:38.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.752+0000 7f267dfe0700 1 -- 172.21.15.146:0/2648763313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f267809ad40 msgr2=0x7f26781250d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.752+0000 7f267dfe0700 1 --2- 172.21.15.146:0/2648763313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f267809ad40 0x7f26781250d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f266800e9b0 tx=0x7f266800ed70 comp rx=0 tx=0).stop 2023-10-03T10:14:38.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.752+0000 7f267dfe0700 1 -- 172.21.15.146:0/2648763313 shutdown_connections 2023-10-03T10:14:38.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.752+0000 7f267dfe0700 1 --2- 172.21.15.146:0/2648763313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26781343a0 0x7f2678125b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.752+0000 7f267dfe0700 1 --2- 172.21.15.146:0/2648763313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f267809ad40 0x7f26781250d0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.752+0000 7f267dfe0700 1 --2- 172.21.15.146:0/2648763313 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2678133f70 0x7f2678125610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.752+0000 7f267dfe0700 1 -- 172.21.15.146:0/2648763313 >> 172.21.15.146:0/2648763313 conn(0x7f2678099c40 msgr2=0x7f26780a4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.752+0000 7f267dfe0700 1 -- 172.21.15.146:0/2648763313 shutdown_connections 2023-10-03T10:14:38.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.752+0000 7f267dfe0700 1 -- 172.21.15.146:0/2648763313 wait complete. 2023-10-03T10:14:38.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:38.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:38.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.785+0000 7fe41e6e2700 1 -- 172.21.15.146:0/4252320781 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe41811e460 con 0x7fe41809d860 2023-10-03T10:14:38.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.785+0000 7fe414ff9700 1 -- 172.21.15.146:0/4252320781 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe41811e460 con 0x7fe41809d860 2023-10-03T10:14:38.786 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:38.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.788+0000 7fe41e6e2700 1 -- 172.21.15.146:0/4252320781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe41809d860 msgr2=0x7fe41811b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.788+0000 7fe41e6e2700 1 --2- 172.21.15.146:0/4252320781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe41809d860 0x7fe41811b150 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe40800fdb0 tx=0x7fe40800d630 comp rx=0 tx=0).stop 2023-10-03T10:14:38.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.788+0000 7fe41e6e2700 1 -- 172.21.15.146:0/4252320781 shutdown_connections 2023-10-03T10:14:38.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.788+0000 7fe41e6e2700 1 --2- 172.21.15.146:0/4252320781 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe418130ce0 0x7fe41811bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.788+0000 7fe41e6e2700 1 --2- 172.21.15.146:0/4252320781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe41809d860 0x7fe41811b150 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.788+0000 7fe41e6e2700 1 --2- 172.21.15.146:0/4252320781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe41809e170 0x7fe41811b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.788+0000 7fe41e6e2700 1 -- 172.21.15.146:0/4252320781 >> 172.21.15.146:0/4252320781 conn(0x7fe418099c40 msgr2=0x7fe41812df60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.788+0000 7fe41e6e2700 1 -- 172.21.15.146:0/4252320781 shutdown_connections 2023-10-03T10:14:38.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:38.788+0000 7fe41e6e2700 1 -- 172.21.15.146:0/4252320781 wait complete. 2023-10-03T10:14:38.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:39.724 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:39.760 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:39.766 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:39.801 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:39.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.869+0000 7efe14d14700 1 Processor -- start 2023-10-03T10:14:39.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.869+0000 7efe14d14700 1 -- start start 2023-10-03T10:14:39.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.870+0000 7efe14d14700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe10138410 0x7efe100a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.870+0000 7efe14d14700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efe1013dd10 0x7efe101400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.870+0000 7efe14d14700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe101379e0 con 0x7efe10138040 2023-10-03T10:14:39.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.870+0000 7efe14d14700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe100a2100 con 0x7efe1013dd10 2023-10-03T10:14:39.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.870+0000 7efe14d14700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe1009b9b0 con 0x7efe10138410 2023-10-03T10:14:39.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.870+0000 7efe0e59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7efe10138040 0x7efe100a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46490/0 (socket says 172.21.15.146:46490) 2023-10-03T10:14:39.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.870+0000 7efe0e59c700 1 -- 172.21.15.146:0/3375199865 learned_addr learned my addr 172.21.15.146:0/3375199865 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:39.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.870+0000 7efe0dd9b700 1 --2- 172.21.15.146:0/3375199865 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe10138410 0x7efe100a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.870+0000 7efe0ed9d700 1 --2- 172.21.15.146:0/3375199865 >> v2:172.21.15.146:3300/0 conn(0x7efe1013dd10 0x7efe101400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.870+0000 7efe0ed9d700 1 -- 172.21.15.146:0/3375199865 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe10138410 msgr2=0x7efe100a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:39.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.870+0000 7efe0ed9d700 1 --2- 172.21.15.146:0/3375199865 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe10138410 0x7efe100a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.870+0000 7efe0ed9d700 1 -- 172.21.15.146:0/3375199865 >> v1:172.21.15.146:6789/0 conn(0x7efe10138040 legacy=0x7efe100a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.870+0000 7efe0ed9d700 1 -- 172.21.15.146:0/3375199865 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe10137c10 con 0x7efe1013dd10 2023-10-03T10:14:39.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.870+0000 7efe0ed9d700 1 --2- 172.21.15.146:0/3375199865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe1013dd10 0x7efe101400f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7efe08009d90 tx=0x7efe0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09dc41448f4f460 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.871+0000 7efe0d59a700 1 -- 172.21.15.146:0/3375199865 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0800e070 con 0x7efe1013dd10 2023-10-03T10:14:39.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.871+0000 7efe0d59a700 1 -- 172.21.15.146:0/3375199865 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0800bb20 con 0x7efe1013dd10 2023-10-03T10:14:39.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.871+0000 7efe0d59a700 1 -- 172.21.15.146:0/3375199865 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe08012430 con 0x7efe1013dd10 2023-10-03T10:14:39.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.872+0000 7efe14d14700 1 -- 172.21.15.146:0/3375199865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe1013dd10 msgr2=0x7efe101400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.872+0000 7efe14d14700 1 --2- 172.21.15.146:0/3375199865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe1013dd10 0x7efe101400f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7efe08009d90 tx=0x7efe0800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:39.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.872+0000 7efe14d14700 1 -- 172.21.15.146:0/3375199865 shutdown_connections 2023-10-03T10:14:39.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.872+0000 7efe14d14700 1 --2- 172.21.15.146:0/3375199865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe1013dd10 0x7efe101400f0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.872+0000 7efe14d14700 1 --2- 172.21.15.146:0/3375199865 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe10138410 0x7efe100a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.872+0000 7efe14d14700 1 -- 172.21.15.146:0/3375199865 >> 172.21.15.146:0/3375199865 conn(0x7efe100a2980 msgr2=0x7efe100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:39.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.872+0000 7efe14d14700 1 -- 172.21.15.146:0/3375199865 shutdown_connections 2023-10-03T10:14:39.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.872+0000 7efe14d14700 1 -- 172.21.15.146:0/3375199865 wait complete. 2023-10-03T10:14:39.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.873+0000 7efe14d14700 1 Processor -- start 2023-10-03T10:14:39.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.873+0000 7efe14d14700 1 -- start start 2023-10-03T10:14:39.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.874+0000 7efe14d14700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe10138040 0x7efe10121600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.874+0000 7efe14d14700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe10138410 0x7efe10121b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.874+0000 7efe14d14700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe1013dd10 0x7efe10122080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.874+0000 7efe14d14700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1009a240 con 0x7efe1013dd10 2023-10-03T10:14:39.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.874+0000 7efe14d14700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe10124460 con 0x7efe10138040 2023-10-03T10:14:39.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.874+0000 7efe14d14700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe1009ed20 con 0x7efe10138410 2023-10-03T10:14:39.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.874+0000 7efe0dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe10138410 0x7efe10121b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.874+0000 7efe0dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe10138410 0x7efe10121b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49052/0 (socket says 172.21.15.146:49052) 2023-10-03T10:14:39.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.874+0000 7efe0dd9b700 1 -- 172.21.15.146:0/427653515 learned_addr learned my addr 172.21.15.146:0/427653515 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:39.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.874+0000 7efe0ed9d700 1 --2- 172.21.15.146:0/427653515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe1013dd10 0x7efe10122080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.874+0000 7efe0e59c700 1 --2- 172.21.15.146:0/427653515 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe10138040 0x7efe10121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.875+0000 7efe0dd9b700 1 -- 172.21.15.146:0/427653515 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe10138040 msgr2=0x7efe10121600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.875+0000 7efe0dd9b700 1 --2- 172.21.15.146:0/427653515 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe10138040 0x7efe10121600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.875+0000 7efe0dd9b700 1 -- 172.21.15.146:0/427653515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe1013dd10 msgr2=0x7efe10122080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.875+0000 7efe0dd9b700 1 --2- 172.21.15.146:0/427653515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe1013dd10 0x7efe10122080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.875+0000 7efe0dd9b700 1 -- 172.21.15.146:0/427653515 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe08009a70 con 0x7efe10138410 2023-10-03T10:14:39.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.875+0000 7efe0dd9b700 1 --2- 172.21.15.146:0/427653515 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe10138410 0x7efe10121b40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efe0400e9b0 tx=0x7efe0400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.875+0000 7efdfeffd700 1 -- 172.21.15.146:0/427653515 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe04009710 con 0x7efe10138410 2023-10-03T10:14:39.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.875+0000 7efdfeffd700 1 -- 172.21.15.146:0/427653515 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0400ee50 con 0x7efe10138410 2023-10-03T10:14:39.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.875+0000 7efe14d14700 1 -- 172.21.15.146:0/427653515 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe10122dc0 con 0x7efe10138410 2023-10-03T10:14:39.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.875+0000 7efdfeffd700 1 -- 172.21.15.146:0/427653515 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0400ca50 con 0x7efe10138410 2023-10-03T10:14:39.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.876+0000 7efe14d14700 1 -- 172.21.15.146:0/427653515 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe10125460 con 0x7efe10138410 2023-10-03T10:14:39.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.876+0000 7efdfeffd700 1 -- 172.21.15.146:0/427653515 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe0400cbb0 con 0x7efe10138410 2023-10-03T10:14:39.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.876+0000 7efdfeffd700 1 -- 172.21.15.146:0/427653515 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efe040421c0 con 0x7efe10138410 2023-10-03T10:14:39.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.877+0000 7efe14d14700 1 -- 172.21.15.146:0/427653515 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe10124870 con 0x7efe10138410 2023-10-03T10:14:39.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.882+0000 7efdfeffd700 1 -- 172.21.15.146:0/427653515 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe04017020 con 0x7efe10138410 2023-10-03T10:14:39.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.905+0000 7f4b0ef56700 1 Processor -- start 2023-10-03T10:14:39.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.905+0000 7f4b0ef56700 1 -- start start 2023-10-03T10:14:39.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.905+0000 7f4b0ef56700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b0809d860 0x7f4b0809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.905+0000 7f4b0ef56700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b08130eb0 0x7f4b08138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.906+0000 7f4b0ef56700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b0809aaa0 con 0x7f4b0809e170 2023-10-03T10:14:39.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.906+0000 7f4b0ef56700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0809f870 con 0x7f4b08130eb0 2023-10-03T10:14:39.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.906+0000 7f4b0ef56700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0809b360 con 0x7f4b0809d860 2023-10-03T10:14:39.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.906+0000 7f4b0ccf2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b0809d860 0x7f4b0809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.906+0000 7f4b0ccf2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b0809d860 0x7f4b0809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49062/0 (socket says 172.21.15.146:49062) 2023-10-03T10:14:39.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.906+0000 7f4b0ccf2700 1 -- 172.21.15.146:0/1197334405 learned_addr learned my addr 172.21.15.146:0/1197334405 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:39.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.906+0000 7f4b0d4f3700 1 --2- 172.21.15.146:0/1197334405 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b08130eb0 0x7f4b08138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.906+0000 7f4b0ccf2700 1 -- 172.21.15.146:0/1197334405 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b08130eb0 msgr2=0x7f4b08138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:39.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.906+0000 7f4b0ccf2700 1 --2- 172.21.15.146:0/1197334405 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b08130eb0 0x7f4b08138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.906+0000 7f4b0ccf2700 1 -- 172.21.15.146:0/1197334405 >> v1:172.21.15.146:6789/0 conn(0x7f4b0809e170 legacy=0x7f4b081307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:39.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.906+0000 7f4b0ccf2700 1 -- 172.21.15.146:0/1197334405 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0809b620 con 0x7f4b0809d860 2023-10-03T10:14:39.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.906+0000 7f4b0d4f3700 1 --2- 172.21.15.146:0/1197334405 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b08130eb0 0x7f4b08138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:39.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.906+0000 7f4b0ccf2700 1 --2- 172.21.15.146:0/1197334405 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b0809d860 0x7f4b0809dc30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4afc00bbc0 tx=0x7f4afc00bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e58c0d338540e8fb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.906+0000 7f95bda32700 1 Processor -- start 2023-10-03T10:14:39.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.906+0000 7f4b077fe700 1 -- 172.21.15.146:0/1197334405 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc00dd50 con 0x7f4b0809d860 2023-10-03T10:14:39.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.906+0000 7f4b077fe700 1 -- 172.21.15.146:0/1197334405 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4afc004030 con 0x7f4b0809d860 2023-10-03T10:14:39.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.906+0000 7f4b077fe700 1 -- 172.21.15.146:0/1197334405 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc0043c0 con 0x7f4b0809d860 2023-10-03T10:14:39.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.906+0000 7f95bda32700 1 -- start start 2023-10-03T10:14:39.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.907+0000 7f95bda32700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95b812f700 0x7f95b812fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.907+0000 7f95bda32700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b809a0a0 0x7f95b8130010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.907+0000 7f95bda32700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b8130550 con 0x7f95b80980c0 2023-10-03T10:14:39.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.907+0000 7f95bda32700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b809a6c0 con 0x7f95b809a0a0 2023-10-03T10:14:39.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.907+0000 7f95bda32700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95b809ac80 con 0x7f95b812f700 2023-10-03T10:14:39.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.907+0000 7f95b77fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f95b80980c0 0x7f95b8098510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46506/0 (socket says 172.21.15.146:46506) 2023-10-03T10:14:39.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.907+0000 7f95b67fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b809a0a0 0x7f95b8130010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.907+0000 7f95b77fe700 1 -- 172.21.15.146:0/1062557307 learned_addr learned my addr 172.21.15.146:0/1062557307 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:39.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.907+0000 7f95b6ffd700 1 --2- 172.21.15.146:0/1062557307 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95b812f700 0x7f95b812fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.907+0000 7f95b67fc700 1 -- 172.21.15.146:0/1062557307 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95b812f700 msgr2=0x7f95b812fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:39.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.907+0000 7f95b67fc700 1 --2- 172.21.15.146:0/1062557307 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95b812f700 0x7f95b812fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.907+0000 7f95b67fc700 1 -- 172.21.15.146:0/1062557307 >> v1:172.21.15.146:6789/0 conn(0x7f95b80980c0 legacy=0x7f95b8098510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.907+0000 7f95b67fc700 1 -- 172.21.15.146:0/1062557307 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b809bff0 con 0x7f95b809a0a0 2023-10-03T10:14:39.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.907+0000 7f4b0ef56700 1 -- 172.21.15.146:0/1197334405 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b0809d860 msgr2=0x7f4b0809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.907+0000 7f4b0ef56700 1 --2- 172.21.15.146:0/1197334405 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b0809d860 0x7f4b0809dc30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4afc00bbc0 tx=0x7f4afc00bed0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.907+0000 7f4b0ef56700 1 -- 172.21.15.146:0/1197334405 shutdown_connections 2023-10-03T10:14:39.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.907+0000 7f4b0ef56700 1 --2- 172.21.15.146:0/1197334405 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b08130eb0 0x7f4b08138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.908+0000 7f4b0ef56700 1 --2- 172.21.15.146:0/1197334405 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b0809d860 0x7f4b0809dc30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.908+0000 7f4b0ef56700 1 -- 172.21.15.146:0/1197334405 >> 172.21.15.146:0/1197334405 conn(0x7f4b08099c40 msgr2=0x7f4b080a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:39.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.908+0000 7f4b0ef56700 1 -- 172.21.15.146:0/1197334405 shutdown_connections 2023-10-03T10:14:39.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.908+0000 7f4b0ef56700 1 -- 172.21.15.146:0/1197334405 wait complete. 2023-10-03T10:14:39.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.908+0000 7f95b67fc700 1 --2- 172.21.15.146:0/1062557307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b809a0a0 0x7f95b8130010 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f95ac00cad0 tx=0x7f95ac00cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb4123c87627c551 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.908+0000 7f95b5ffb700 1 -- 172.21.15.146:0/1062557307 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac011070 con 0x7f95b809a0a0 2023-10-03T10:14:39.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.908+0000 7f95b5ffb700 1 -- 172.21.15.146:0/1062557307 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ac00c2e0 con 0x7f95b809a0a0 2023-10-03T10:14:39.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.908+0000 7f95b5ffb700 1 -- 172.21.15.146:0/1062557307 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac007b30 con 0x7f95b809a0a0 2023-10-03T10:14:39.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.909+0000 7f95bda32700 1 -- 172.21.15.146:0/1062557307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b809a0a0 msgr2=0x7f95b8130010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.909+0000 7f95bda32700 1 --2- 172.21.15.146:0/1062557307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b809a0a0 0x7f95b8130010 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f95ac00cad0 tx=0x7f95ac00cde0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.909+0000 7f95bda32700 1 -- 172.21.15.146:0/1062557307 shutdown_connections 2023-10-03T10:14:39.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.909+0000 7f95bda32700 1 --2- 172.21.15.146:0/1062557307 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95b812f700 0x7f95b812fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.909+0000 7f95bda32700 1 --2- 172.21.15.146:0/1062557307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b809a0a0 0x7f95b8130010 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.909+0000 7f95bda32700 1 -- 172.21.15.146:0/1062557307 >> 172.21.15.146:0/1062557307 conn(0x7f95b80a1ee0 msgr2=0x7f95b80a22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:39.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.909+0000 7f95bda32700 1 -- 172.21.15.146:0/1062557307 shutdown_connections 2023-10-03T10:14:39.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.909+0000 7f4b0ef56700 1 Processor -- start 2023-10-03T10:14:39.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.909+0000 7f4b0ef56700 1 -- start start 2023-10-03T10:14:39.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f4b0ef56700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0809e170 0x7f4b081c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f4b0ef56700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b08130eb0 0x7f4b081c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f4b0ef56700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b0811e730 0x7f4b0811ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f4b0ef56700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b08122db0 con 0x7f4b0811e730 2023-10-03T10:14:39.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f4b0ef56700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b08121f80 con 0x7f4b0809e170 2023-10-03T10:14:39.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f4b0ef56700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b081c5010 con 0x7f4b08130eb0 2023-10-03T10:14:39.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f4b0ccf2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0809e170 0x7f4b081c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f4b0ccf2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0809e170 0x7f4b081c4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45226/0 (socket says 172.21.15.146:45226) 2023-10-03T10:14:39.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f4b0ccf2700 1 -- 172.21.15.146:0/2859570912 learned_addr learned my addr 172.21.15.146:0/2859570912 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:39.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f4b07fff700 1 --2- 172.21.15.146:0/2859570912 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b08130eb0 0x7f4b081c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f4b0ccf2700 1 -- 172.21.15.146:0/2859570912 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b08130eb0 msgr2=0x7f4b081c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f4b0ccf2700 1 --2- 172.21.15.146:0/2859570912 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b08130eb0 0x7f4b081c4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f4b0ccf2700 1 -- 172.21.15.146:0/2859570912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b0811e730 msgr2=0x7f4b0811ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f4b0ccf2700 1 --2- 172.21.15.146:0/2859570912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b0811e730 0x7f4b0811ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f4b0ccf2700 1 -- 172.21.15.146:0/2859570912 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4afc00b7f0 con 0x7f4b0809e170 2023-10-03T10:14:39.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.911+0000 7f4b0ccf2700 1 --2- 172.21.15.146:0/2859570912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0809e170 0x7f4b081c4590 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4afc004000 tx=0x7f4afc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.911+0000 7f4b057fa700 1 -- 172.21.15.146:0/2859570912 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc003d60 con 0x7f4b0809e170 2023-10-03T10:14:39.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.911+0000 7f4b057fa700 1 -- 172.21.15.146:0/2859570912 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4afc0224d0 con 0x7f4b0809e170 2023-10-03T10:14:39.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.911+0000 7f4b057fa700 1 -- 172.21.15.146:0/2859570912 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc022880 con 0x7f4b0809e170 2023-10-03T10:14:39.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.909+0000 7f95bda32700 1 -- 172.21.15.146:0/1062557307 wait complete. 2023-10-03T10:14:39.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f95bda32700 1 Processor -- start 2023-10-03T10:14:39.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f95bda32700 1 -- start start 2023-10-03T10:14:39.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.911+0000 7f4b0ef56700 1 -- 172.21.15.146:0/2859570912 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b081202c0 con 0x7f4b0809e170 2023-10-03T10:14:39.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f95bda32700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b80980c0 0x7f95b8091810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f95bda32700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95b809a0a0 0x7f95b8091d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f95bda32700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95b812f700 0x7f95b8092290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f95bda32700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b806e4c0 con 0x7f95b809a0a0 2023-10-03T10:14:39.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f95bda32700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b812daf0 con 0x7f95b80980c0 2023-10-03T10:14:39.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.910+0000 7f95bda32700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95b812c980 con 0x7f95b812f700 2023-10-03T10:14:39.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.911+0000 7f95b67fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95b809a0a0 0x7f95b8091d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.911+0000 7f95b67fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95b809a0a0 0x7f95b8091d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37192/0 (socket says 172.21.15.146:37192) 2023-10-03T10:14:39.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.911+0000 7f95b67fc700 1 -- 172.21.15.146:0/1134720109 learned_addr learned my addr 172.21.15.146:0/1134720109 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:39.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.911+0000 7f95b6ffd700 1 --2- 172.21.15.146:0/1134720109 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b80980c0 0x7f95b8091810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.911+0000 7f95b6ffd700 1 -- 172.21.15.146:0/1134720109 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95b812f700 msgr2=0x7f95b8092290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:39.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.911+0000 7f95b6ffd700 1 --2- 172.21.15.146:0/1134720109 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95b812f700 0x7f95b8092290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.911+0000 7f95b6ffd700 1 -- 172.21.15.146:0/1134720109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95b809a0a0 msgr2=0x7f95b8091d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.911+0000 7f95b6ffd700 1 --2- 172.21.15.146:0/1134720109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95b809a0a0 0x7f95b8091d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.911+0000 7f95b6ffd700 1 -- 172.21.15.146:0/1134720109 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac00c7b0 con 0x7f95b80980c0 2023-10-03T10:14:39.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.912+0000 7f95b6ffd700 1 --2- 172.21.15.146:0/1134720109 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b80980c0 0x7f95b8091810 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f95a800e810 tx=0x7f95a800eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.911+0000 7f4b0ef56700 1 -- 172.21.15.146:0/2859570912 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b080a1e90 con 0x7f4b0809e170 2023-10-03T10:14:39.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.912+0000 7f4b057fa700 1 -- 172.21.15.146:0/2859570912 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4afc0229e0 con 0x7f4b0809e170 2023-10-03T10:14:39.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.912+0000 7f4b057fa700 1 -- 172.21.15.146:0/2859570912 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4afc044f70 con 0x7f4b0809e170 2023-10-03T10:14:39.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.913+0000 7f4b0ef56700 1 -- 172.21.15.146:0/2859570912 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b08121b70 con 0x7f4b0809e170 2023-10-03T10:14:39.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.912+0000 7f959ffff700 1 -- 172.21.15.146:0/1134720109 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a800c070 con 0x7f95b80980c0 2023-10-03T10:14:39.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.912+0000 7f959ffff700 1 -- 172.21.15.146:0/1134720109 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a8013610 con 0x7f95b80980c0 2023-10-03T10:14:39.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.912+0000 7f959ffff700 1 -- 172.21.15.146:0/1134720109 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8013980 con 0x7f95b80980c0 2023-10-03T10:14:39.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.912+0000 7f95bda32700 1 -- 172.21.15.146:0/1134720109 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b812bf20 con 0x7f95b80980c0 2023-10-03T10:14:39.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.912+0000 7f95bda32700 1 -- 172.21.15.146:0/1134720109 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b812d0a0 con 0x7f95b80980c0 2023-10-03T10:14:39.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.913+0000 7f959ffff700 1 -- 172.21.15.146:0/1134720109 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f95a8013ae0 con 0x7f95b80980c0 2023-10-03T10:14:39.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.913+0000 7f959ffff700 1 -- 172.21.15.146:0/1134720109 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f95a803ee40 con 0x7f95b80980c0 2023-10-03T10:14:39.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.913+0000 7f95bda32700 1 -- 172.21.15.146:0/1134720109 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b809ba30 con 0x7f95b80980c0 2023-10-03T10:14:39.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.921+0000 7f4b057fa700 1 -- 172.21.15.146:0/2859570912 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b08121b70 con 0x7f4b0809e170 2023-10-03T10:14:39.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.922+0000 7f959ffff700 1 -- 172.21.15.146:0/1134720109 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f95a800f040 con 0x7f95b80980c0 2023-10-03T10:14:39.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.966+0000 7f1230c6c700 1 Processor -- start 2023-10-03T10:14:39.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.966+0000 7f1230c6c700 1 -- start start 2023-10-03T10:14:39.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.966+0000 7f1230c6c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f122c09e340 0x7f122c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.966+0000 7f1230c6c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f122c135f20 0x7f122c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.966+0000 7f1230c6c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f122c09aaa0 con 0x7f122c09d860 2023-10-03T10:14:39.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.966+0000 7f1230c6c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f122c09e730 con 0x7f122c09e340 2023-10-03T10:14:39.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.966+0000 7f1230c6c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f122c09f870 con 0x7f122c135f20 2023-10-03T10:14:39.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.967+0000 7f122ad9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f122c135f20 0x7f122c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.967+0000 7f122ad9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f122c135f20 0x7f122c138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49092/0 (socket says 172.21.15.146:49092) 2023-10-03T10:14:39.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.967+0000 7f122ad9d700 1 -- 172.21.15.146:0/662556507 learned_addr learned my addr 172.21.15.146:0/662556507 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:39.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.967+0000 7f1229d9b700 1 --2- 172.21.15.146:0/662556507 >> v2:172.21.15.146:3300/0 conn(0x7f122c09e340 0x7f122c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.967+0000 7f1229d9b700 1 -- 172.21.15.146:0/662556507 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f122c135f20 msgr2=0x7f122c138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:39.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.967+0000 7f1229d9b700 1 --2- 172.21.15.146:0/662556507 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f122c135f20 0x7f122c138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.967+0000 7f1229d9b700 1 -- 172.21.15.146:0/662556507 >> v1:172.21.15.146:6789/0 conn(0x7f122c09d860 legacy=0x7f122c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.967+0000 7f1229d9b700 1 -- 172.21.15.146:0/662556507 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122c09b360 con 0x7f122c09e340 2023-10-03T10:14:39.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.967+0000 7f1229d9b700 1 --2- 172.21.15.146:0/662556507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122c09e340 0x7f122c1359e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f1220009840 tx=0x7f1220009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb19d68f6e46d4cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.967+0000 7f122959a700 1 -- 172.21.15.146:0/662556507 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1220011830 con 0x7f122c09e340 2023-10-03T10:14:39.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.967+0000 7f122959a700 1 -- 172.21.15.146:0/662556507 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1220011990 con 0x7f122c09e340 2023-10-03T10:14:39.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.967+0000 7f122959a700 1 -- 172.21.15.146:0/662556507 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1220011d20 con 0x7f122c09e340 2023-10-03T10:14:39.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.968+0000 7f1230c6c700 1 -- 172.21.15.146:0/662556507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122c09e340 msgr2=0x7f122c1359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.968+0000 7f1230c6c700 1 --2- 172.21.15.146:0/662556507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122c09e340 0x7f122c1359e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f1220009840 tx=0x7f1220009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:39.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.968+0000 7f1230c6c700 1 -- 172.21.15.146:0/662556507 shutdown_connections 2023-10-03T10:14:39.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.968+0000 7f1230c6c700 1 --2- 172.21.15.146:0/662556507 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f122c135f20 0x7f122c138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.968+0000 7f1230c6c700 1 --2- 172.21.15.146:0/662556507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122c09e340 0x7f122c1359e0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.968+0000 7f1230c6c700 1 -- 172.21.15.146:0/662556507 >> 172.21.15.146:0/662556507 conn(0x7f122c099c40 msgr2=0x7f122c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:39.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.968+0000 7f1230c6c700 1 -- 172.21.15.146:0/662556507 shutdown_connections 2023-10-03T10:14:39.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.968+0000 7f1230c6c700 1 -- 172.21.15.146:0/662556507 wait complete. 2023-10-03T10:14:39.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.969+0000 7f1230c6c700 1 Processor -- start 2023-10-03T10:14:39.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.969+0000 7f1230c6c700 1 -- start start 2023-10-03T10:14:39.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.970+0000 7f1230c6c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122c09d860 0x7f122c1c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.970+0000 7f1230c6c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f122c09e340 0x7f122c1c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.970+0000 7f1230c6c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f122c135f20 0x7f122c1c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.970+0000 7f1230c6c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122c1210f0 con 0x7f122c09d860 2023-10-03T10:14:39.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.970+0000 7f1230c6c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122c11f5d0 con 0x7f122c135f20 2023-10-03T10:14:39.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.970+0000 7f1230c6c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f122c11fa70 con 0x7f122c09e340 2023-10-03T10:14:39.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.970+0000 7f122a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122c09d860 0x7f122c1c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.970+0000 7f122a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122c09d860 0x7f122c1c8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37212/0 (socket says 172.21.15.146:37212) 2023-10-03T10:14:39.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.970+0000 7f122a59c700 1 -- 172.21.15.146:0/2552381958 learned_addr learned my addr 172.21.15.146:0/2552381958 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:39.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.970+0000 7f122ad9d700 1 --2- 172.21.15.146:0/2552381958 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f122c135f20 0x7f122c1c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.970+0000 7f1229d9b700 1 --2- 172.21.15.146:0/2552381958 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f122c09e340 0x7f122c1c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.970+0000 7f122a59c700 1 -- 172.21.15.146:0/2552381958 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f122c09e340 msgr2=0x7f122c1c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.970+0000 7f122a59c700 1 --2- 172.21.15.146:0/2552381958 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f122c09e340 0x7f122c1c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.970+0000 7f122a59c700 1 -- 172.21.15.146:0/2552381958 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f122c135f20 msgr2=0x7f122c1c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.970+0000 7f122a59c700 1 --2- 172.21.15.146:0/2552381958 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f122c135f20 0x7f122c1c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.970+0000 7f122a59c700 1 -- 172.21.15.146:0/2552381958 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12200094a0 con 0x7f122c09d860 2023-10-03T10:14:39.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.971+0000 7f122a59c700 1 --2- 172.21.15.146:0/2552381958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122c09d860 0x7f122c1c8240 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f121c00c450 tx=0x7f121c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.971+0000 7f121affd700 1 -- 172.21.15.146:0/2552381958 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c0052d0 con 0x7f122c09d860 2023-10-03T10:14:39.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.971+0000 7f121affd700 1 -- 172.21.15.146:0/2552381958 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121c005430 con 0x7f122c09d860 2023-10-03T10:14:39.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.971+0000 7f121affd700 1 -- 172.21.15.146:0/2552381958 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c0038c0 con 0x7f122c09d860 2023-10-03T10:14:39.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.971+0000 7f1230c6c700 1 -- 172.21.15.146:0/2552381958 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f122c11fcb0 con 0x7f122c09d860 2023-10-03T10:14:39.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.971+0000 7f1230c6c700 1 -- 172.21.15.146:0/2552381958 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f122c1213d0 con 0x7f122c09d860 2023-10-03T10:14:39.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.972+0000 7f121affd700 1 -- 172.21.15.146:0/2552381958 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f121c003a20 con 0x7f122c09d860 2023-10-03T10:14:39.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.972+0000 7f1230c6c700 1 -- 172.21.15.146:0/2552381958 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f122c04f2a0 con 0x7f122c09d860 2023-10-03T10:14:39.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.972+0000 7f121affd700 1 -- 172.21.15.146:0/2552381958 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f121c03ea30 con 0x7f122c09d860 2023-10-03T10:14:39.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:39.981+0000 7f121affd700 1 -- 172.21.15.146:0/2552381958 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f121c011590 con 0x7f122c09d860 2023-10-03T10:14:40.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.120+0000 7f4b0ef56700 1 -- 172.21.15.146:0/2859570912 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4b08121b70 con 0x7f4b0809e170 2023-10-03T10:14:40.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.121+0000 7f4b057fa700 1 -- 172.21.15.146:0/2859570912 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4b08121b70 con 0x7f4b0809e170 2023-10-03T10:14:40.122 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:40.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.123+0000 7f4b0ef56700 1 -- 172.21.15.146:0/2859570912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0809e170 msgr2=0x7f4b081c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.123+0000 7f4b0ef56700 1 --2- 172.21.15.146:0/2859570912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0809e170 0x7f4b081c4590 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4afc004000 tx=0x7f4afc004750 comp rx=0 tx=0).stop 2023-10-03T10:14:40.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.123+0000 7f4b0ef56700 1 -- 172.21.15.146:0/2859570912 shutdown_connections 2023-10-03T10:14:40.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.123+0000 7f4b0ef56700 1 --2- 172.21.15.146:0/2859570912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b0811e730 0x7f4b0811ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.123+0000 7f4b0ef56700 1 --2- 172.21.15.146:0/2859570912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b0809e170 0x7f4b081c4590 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.123+0000 7f4b0ef56700 1 --2- 172.21.15.146:0/2859570912 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4b08130eb0 0x7f4b081c4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.123+0000 7f4b0ef56700 1 -- 172.21.15.146:0/2859570912 >> 172.21.15.146:0/2859570912 conn(0x7f4b08099c40 msgr2=0x7f4b08071040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.123+0000 7f4b0ef56700 1 -- 172.21.15.146:0/2859570912 shutdown_connections 2023-10-03T10:14:40.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.123+0000 7f4b0ef56700 1 -- 172.21.15.146:0/2859570912 wait complete. 2023-10-03T10:14:40.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.125+0000 7efe14d14700 1 -- 172.21.15.146:0/427653515 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efe1004f2a0 con 0x7efe10138410 2023-10-03T10:14:40.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.126+0000 7f95bda32700 1 -- 172.21.15.146:0/1134720109 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f95b806da40 con 0x7f95b80980c0 2023-10-03T10:14:40.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.126+0000 7efdfeffd700 1 -- 172.21.15.146:0/427653515 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efe04044060 con 0x7efe10138410 2023-10-03T10:14:40.127 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:40.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.126+0000 7f959ffff700 1 -- 172.21.15.146:0/1134720109 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f95b806da40 con 0x7f95b80980c0 2023-10-03T10:14:40.127 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:40.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.128+0000 7efe14d14700 1 -- 172.21.15.146:0/427653515 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe10138410 msgr2=0x7efe10121b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.128+0000 7efe14d14700 1 --2- 172.21.15.146:0/427653515 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe10138410 0x7efe10121b40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efe0400e9b0 tx=0x7efe0400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.128+0000 7efe14d14700 1 -- 172.21.15.146:0/427653515 shutdown_connections 2023-10-03T10:14:40.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.128+0000 7efe14d14700 1 --2- 172.21.15.146:0/427653515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe1013dd10 0x7efe10122080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.128+0000 7efe14d14700 1 --2- 172.21.15.146:0/427653515 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe10138040 0x7efe10121600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.128+0000 7efe14d14700 1 --2- 172.21.15.146:0/427653515 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe10138410 0x7efe10121b40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.128+0000 7efe14d14700 1 -- 172.21.15.146:0/427653515 >> 172.21.15.146:0/427653515 conn(0x7efe100a2980 msgr2=0x7efe1009d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.128+0000 7efe14d14700 1 -- 172.21.15.146:0/427653515 shutdown_connections 2023-10-03T10:14:40.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.128+0000 7efe14d14700 1 -- 172.21.15.146:0/427653515 wait complete. 2023-10-03T10:14:40.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.128+0000 7f95bda32700 1 -- 172.21.15.146:0/1134720109 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b80980c0 msgr2=0x7f95b8091810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.128+0000 7f95bda32700 1 --2- 172.21.15.146:0/1134720109 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b80980c0 0x7f95b8091810 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f95a800e810 tx=0x7f95a800eb20 comp rx=0 tx=0).stop 2023-10-03T10:14:40.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.129+0000 7f95bda32700 1 -- 172.21.15.146:0/1134720109 shutdown_connections 2023-10-03T10:14:40.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.129+0000 7f95bda32700 1 --2- 172.21.15.146:0/1134720109 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95b812f700 0x7f95b8092290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.129+0000 7f95bda32700 1 --2- 172.21.15.146:0/1134720109 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b80980c0 0x7f95b8091810 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.129+0000 7f95bda32700 1 --2- 172.21.15.146:0/1134720109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95b809a0a0 0x7f95b8091d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.129+0000 7f95bda32700 1 -- 172.21.15.146:0/1134720109 >> 172.21.15.146:0/1134720109 conn(0x7f95b80a1ee0 msgr2=0x7f95b8097710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.130+0000 7f95bda32700 1 -- 172.21.15.146:0/1134720109 shutdown_connections 2023-10-03T10:14:40.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.130+0000 7f95bda32700 1 -- 172.21.15.146:0/1134720109 wait complete. 2023-10-03T10:14:40.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:40.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:40.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:40.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.199+0000 7f1230c6c700 1 -- 172.21.15.146:0/2552381958 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f122c06c3b0 con 0x7f122c09d860 2023-10-03T10:14:40.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.200+0000 7f121affd700 1 -- 172.21.15.146:0/2552381958 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f121c0192c0 con 0x7f122c09d860 2023-10-03T10:14:40.200 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:40.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.202+0000 7f1230c6c700 1 -- 172.21.15.146:0/2552381958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122c09d860 msgr2=0x7f122c1c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.202+0000 7f1230c6c700 1 --2- 172.21.15.146:0/2552381958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122c09d860 0x7f122c1c8240 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f121c00c450 tx=0x7f121c00c760 comp rx=0 tx=0).stop 2023-10-03T10:14:40.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.202+0000 7f1230c6c700 1 -- 172.21.15.146:0/2552381958 shutdown_connections 2023-10-03T10:14:40.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.202+0000 7f1230c6c700 1 --2- 172.21.15.146:0/2552381958 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f122c135f20 0x7f122c1c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.202+0000 7f1230c6c700 1 --2- 172.21.15.146:0/2552381958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122c09d860 0x7f122c1c8240 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.202+0000 7f1230c6c700 1 --2- 172.21.15.146:0/2552381958 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f122c09e340 0x7f122c1c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.202+0000 7f1230c6c700 1 -- 172.21.15.146:0/2552381958 >> 172.21.15.146:0/2552381958 conn(0x7f122c099c40 msgr2=0x7f122c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.202+0000 7f1230c6c700 1 -- 172.21.15.146:0/2552381958 shutdown_connections 2023-10-03T10:14:40.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:40.202+0000 7f1230c6c700 1 -- 172.21.15.146:0/2552381958 wait complete. 2023-10-03T10:14:40.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:41.141 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:41.145 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:41.151 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:41.215 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:41.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.286+0000 7f374a4a3700 1 Processor -- start 2023-10-03T10:14:41.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.287+0000 7f374a4a3700 1 -- start start 2023-10-03T10:14:41.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.287+0000 7f374a4a3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f374409e870 0x7f374409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.287+0000 7f374a4a3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f374409f180 0x7f3744131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.287+0000 7f374a4a3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3744131d70 0x7f3744132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.287+0000 7f374a4a3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37440a0920 con 0x7f3744131d70 2023-10-03T10:14:41.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.287+0000 7f374a4a3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374409c970 con 0x7f374409e870 2023-10-03T10:14:41.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.287+0000 7f374a4a3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f374409bab0 con 0x7f374409f180 2023-10-03T10:14:41.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.287+0000 7f3743fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f374409e870 0x7f374409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.288+0000 7f3743fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f374409e870 0x7f374409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45244/0 (socket says 172.21.15.146:45244) 2023-10-03T10:14:41.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.288+0000 7f3743fff700 1 -- 172.21.15.146:0/1365257998 learned_addr learned my addr 172.21.15.146:0/1365257998 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:41.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.288+0000 7f37437fe700 1 --2- 172.21.15.146:0/1365257998 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f374409f180 0x7f3744131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.288+0000 7f3748a40700 1 --2- 172.21.15.146:0/1365257998 >> v2:172.21.15.146:3300/0 conn(0x7f3744131d70 0x7f3744132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.288+0000 7f3748a40700 1 -- 172.21.15.146:0/1365257998 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f374409f180 msgr2=0x7f3744131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.288+0000 7f3748a40700 1 --2- 172.21.15.146:0/1365257998 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f374409f180 0x7f3744131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.288+0000 7f3748a40700 1 -- 172.21.15.146:0/1365257998 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f374409e870 msgr2=0x7f374409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.288+0000 7f3748a40700 1 --2- 172.21.15.146:0/1365257998 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f374409e870 0x7f374409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.288+0000 7f3748a40700 1 -- 172.21.15.146:0/1365257998 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374409f9c0 con 0x7f3744131d70 2023-10-03T10:14:41.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.288+0000 7f3743fff700 1 --2- 172.21.15.146:0/1365257998 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f374409e870 0x7f374409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:41.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.288+0000 7f3748a40700 1 --2- 172.21.15.146:0/1365257998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3744131d70 0x7f3744132210 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f373c009d90 tx=0x7f373c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7febb27896a19d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.288+0000 7f3742ffd700 1 -- 172.21.15.146:0/1365257998 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c00bb10 con 0x7f3744131d70 2023-10-03T10:14:41.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.288+0000 7f3742ffd700 1 -- 172.21.15.146:0/1365257998 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373c014070 con 0x7f3744131d70 2023-10-03T10:14:41.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.288+0000 7f3742ffd700 1 -- 172.21.15.146:0/1365257998 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c018380 con 0x7f3744131d70 2023-10-03T10:14:41.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.289+0000 7f374a4a3700 1 -- 172.21.15.146:0/1365257998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3744131d70 msgr2=0x7f3744132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.289+0000 7f374a4a3700 1 --2- 172.21.15.146:0/1365257998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3744131d70 0x7f3744132210 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f373c009d90 tx=0x7f373c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:41.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.289+0000 7f374a4a3700 1 -- 172.21.15.146:0/1365257998 shutdown_connections 2023-10-03T10:14:41.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.289+0000 7f374a4a3700 1 --2- 172.21.15.146:0/1365257998 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f374409e870 0x7f374409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.289+0000 7f374a4a3700 1 --2- 172.21.15.146:0/1365257998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3744131d70 0x7f3744132210 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.289+0000 7f374a4a3700 1 --2- 172.21.15.146:0/1365257998 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f374409f180 0x7f3744131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.289+0000 7f374a4a3700 1 -- 172.21.15.146:0/1365257998 >> 172.21.15.146:0/1365257998 conn(0x7f37440a4430 msgr2=0x7f37440a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.289+0000 7f374a4a3700 1 -- 172.21.15.146:0/1365257998 shutdown_connections 2023-10-03T10:14:41.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.290+0000 7f374a4a3700 1 -- 172.21.15.146:0/1365257998 wait complete. 2023-10-03T10:14:41.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.291+0000 7f374a4a3700 1 Processor -- start 2023-10-03T10:14:41.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.291+0000 7f374a4a3700 1 -- start start 2023-10-03T10:14:41.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.292+0000 7f374a4a3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f374409e870 0x7f37441c1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.292+0000 7f374a4a3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f374409f180 0x7f37441c1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.292+0000 7f374a4a3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3744131d70 0x7f37441c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.292+0000 7f374a4a3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374411d190 con 0x7f3744131d70 2023-10-03T10:14:41.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.292+0000 7f374a4a3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374411daf0 con 0x7f374409f180 2023-10-03T10:14:41.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.292+0000 7f374a4a3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f374411e2e0 con 0x7f374409e870 2023-10-03T10:14:41.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.292+0000 7f37437fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f374409f180 0x7f37441c1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.292+0000 7f37437fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f374409f180 0x7f37441c1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45260/0 (socket says 172.21.15.146:45260) 2023-10-03T10:14:41.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.292+0000 7f37437fe700 1 -- 172.21.15.146:0/613090842 learned_addr learned my addr 172.21.15.146:0/613090842 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:41.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.292+0000 7f3748a40700 1 --2- 172.21.15.146:0/613090842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3744131d70 0x7f37441c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.292+0000 7f37437fe700 1 -- 172.21.15.146:0/613090842 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f374409e870 msgr2=0x7f37441c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.292+0000 7f37437fe700 1 --2- 172.21.15.146:0/613090842 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f374409e870 0x7f37441c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.292+0000 7f37437fe700 1 -- 172.21.15.146:0/613090842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3744131d70 msgr2=0x7f37441c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.292+0000 7f37437fe700 1 --2- 172.21.15.146:0/613090842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3744131d70 0x7f37441c3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.292+0000 7f37437fe700 1 -- 172.21.15.146:0/613090842 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3734009550 con 0x7f374409f180 2023-10-03T10:14:41.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.292+0000 7f37437fe700 1 --2- 172.21.15.146:0/613090842 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f374409f180 0x7f37441c1560 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f373800e980 tx=0x7f373800ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.293+0000 7f3740ff9700 1 -- 172.21.15.146:0/613090842 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3738009710 con 0x7f374409f180 2023-10-03T10:14:41.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.293+0000 7f3740ff9700 1 -- 172.21.15.146:0/613090842 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373800eed0 con 0x7f374409f180 2023-10-03T10:14:41.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.293+0000 7f374a4a3700 1 -- 172.21.15.146:0/613090842 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373c009a70 con 0x7f374409f180 2023-10-03T10:14:41.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.293+0000 7f3740ff9700 1 -- 172.21.15.146:0/613090842 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373800ca70 con 0x7f374409f180 2023-10-03T10:14:41.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.294+0000 7f3740ff9700 1 -- 172.21.15.146:0/613090842 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f373800cbd0 con 0x7f374409f180 2023-10-03T10:14:41.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.294+0000 7f374a4a3700 1 -- 172.21.15.146:0/613090842 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374411d730 con 0x7f374409f180 2023-10-03T10:14:41.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.295+0000 7f3740ff9700 1 -- 172.21.15.146:0/613090842 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f373801bd40 con 0x7f374409f180 2023-10-03T10:14:41.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.295+0000 7f374a4a3700 1 -- 172.21.15.146:0/613090842 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f374404f2a0 con 0x7f374409f180 2023-10-03T10:14:41.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.300+0000 7f3740ff9700 1 -- 172.21.15.146:0/613090842 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3738017070 con 0x7f374409f180 2023-10-03T10:14:41.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.319+0000 7f95c3912700 1 Processor -- start 2023-10-03T10:14:41.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.320+0000 7f95c3912700 1 -- start start 2023-10-03T10:14:41.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.320+0000 7f95c3912700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f95bc133ad0 0x7f95bc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.320+0000 7f95c3912700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95bc1300a0 0x7f95bc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.320+0000 7f95c3912700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95bc06b2d0 con 0x7f95bc1309f0 2023-10-03T10:14:41.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.320+0000 7f95c3912700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95bc133610 con 0x7f95bc133ad0 2023-10-03T10:14:41.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.320+0000 7f95c3912700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc09a500 con 0x7f95bc1300a0 2023-10-03T10:14:41.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.320+0000 7f95c0ead700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95bc1300a0 0x7f95bc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.320+0000 7f95c0ead700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95bc1300a0 0x7f95bc1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45268/0 (socket says 172.21.15.146:45268) 2023-10-03T10:14:41.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.320+0000 7f95c0ead700 1 -- 172.21.15.146:0/3951634038 learned_addr learned my addr 172.21.15.146:0/3951634038 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:41.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.320+0000 7f95c16ae700 1 --2- 172.21.15.146:0/3951634038 >> v2:172.21.15.146:3300/0 conn(0x7f95bc133ad0 0x7f95bc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.321+0000 7f95c16ae700 1 -- 172.21.15.146:0/3951634038 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95bc1300a0 msgr2=0x7f95bc1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.321+0000 7f95c16ae700 1 --2- 172.21.15.146:0/3951634038 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95bc1300a0 0x7f95bc1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.321+0000 7f95c16ae700 1 -- 172.21.15.146:0/3951634038 >> v1:172.21.15.146:6789/0 conn(0x7f95bc1309f0 legacy=0x7f95bc13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.321+0000 7f95c16ae700 1 -- 172.21.15.146:0/3951634038 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc1338b0 con 0x7f95bc133ad0 2023-10-03T10:14:41.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.321+0000 7f95c16ae700 1 --2- 172.21.15.146:0/3951634038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95bc133ad0 0x7f95bc133ea0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009840 tx=0x7f95b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3075c50e4619bc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.321+0000 7f95b3fff700 1 -- 172.21.15.146:0/3951634038 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b8011830 con 0x7f95bc133ad0 2023-10-03T10:14:41.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.321+0000 7f95b3fff700 1 -- 172.21.15.146:0/3951634038 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b8011990 con 0x7f95bc133ad0 2023-10-03T10:14:41.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.321+0000 7f95b3fff700 1 -- 172.21.15.146:0/3951634038 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b8011d20 con 0x7f95bc133ad0 2023-10-03T10:14:41.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.322+0000 7f95c3912700 1 -- 172.21.15.146:0/3951634038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95bc133ad0 msgr2=0x7f95bc133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.322+0000 7f95c3912700 1 --2- 172.21.15.146:0/3951634038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95bc133ad0 0x7f95bc133ea0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009840 tx=0x7f95b8009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:41.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.322+0000 7f95c3912700 1 -- 172.21.15.146:0/3951634038 shutdown_connections 2023-10-03T10:14:41.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.322+0000 7f95c3912700 1 --2- 172.21.15.146:0/3951634038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95bc133ad0 0x7f95bc133ea0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.322+0000 7f95c3912700 1 --2- 172.21.15.146:0/3951634038 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95bc1300a0 0x7f95bc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.322+0000 7f95c3912700 1 -- 172.21.15.146:0/3951634038 >> 172.21.15.146:0/3951634038 conn(0x7f95bc099c40 msgr2=0x7f95bc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.322+0000 7f95c3912700 1 -- 172.21.15.146:0/3951634038 shutdown_connections 2023-10-03T10:14:41.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.322+0000 7f95c3912700 1 -- 172.21.15.146:0/3951634038 wait complete. 2023-10-03T10:14:41.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.323+0000 7f95c3912700 1 Processor -- start 2023-10-03T10:14:41.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.323+0000 7f95c3912700 1 -- start start 2023-10-03T10:14:41.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.324+0000 7f95c3912700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95bc1300a0 0x7f95bc11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.324+0000 7f95c3912700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95bc1309f0 0x7f95bc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.324+0000 7f95c3912700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95bc133ad0 0x7f95bc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.324+0000 7f95c3912700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc11fb00 con 0x7f95bc1309f0 2023-10-03T10:14:41.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.324+0000 7f95c3912700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc120390 con 0x7f95bc133ad0 2023-10-03T10:14:41.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.324+0000 7f95c3912700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc11fdf0 con 0x7f95bc1300a0 2023-10-03T10:14:41.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.324+0000 7f95c1eaf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95bc133ad0 0x7f95bc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.324+0000 7f95c1eaf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95bc133ad0 0x7f95bc11e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45274/0 (socket says 172.21.15.146:45274) 2023-10-03T10:14:41.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.324+0000 7f95c1eaf700 1 -- 172.21.15.146:0/2460523075 learned_addr learned my addr 172.21.15.146:0/2460523075 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:41.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.324+0000 7f95c0ead700 1 --2- 172.21.15.146:0/2460523075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95bc1309f0 0x7f95bc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.324+0000 7f95c1eaf700 1 -- 172.21.15.146:0/2460523075 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95bc1300a0 msgr2=0x7f95bc11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.324+0000 7f95c1eaf700 1 --2- 172.21.15.146:0/2460523075 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95bc1300a0 0x7f95bc11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.324+0000 7f95c1eaf700 1 -- 172.21.15.146:0/2460523075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95bc1309f0 msgr2=0x7f95bc11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.324+0000 7f95c1eaf700 1 --2- 172.21.15.146:0/2460523075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95bc1309f0 0x7f95bc11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.324+0000 7f95c1eaf700 1 -- 172.21.15.146:0/2460523075 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b80094a0 con 0x7f95bc133ad0 2023-10-03T10:14:41.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.324+0000 7f95c1eaf700 1 --2- 172.21.15.146:0/2460523075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95bc133ad0 0x7f95bc11e4c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f95b400cc50 tx=0x7f95b400cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.325+0000 7f95b1ffb700 1 -- 172.21.15.146:0/2460523075 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b4003c00 con 0x7f95bc133ad0 2023-10-03T10:14:41.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.325+0000 7f95b1ffb700 1 -- 172.21.15.146:0/2460523075 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b4003d60 con 0x7f95bc133ad0 2023-10-03T10:14:41.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.325+0000 7f95c3912700 1 -- 172.21.15.146:0/2460523075 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95bc09a1b0 con 0x7f95bc133ad0 2023-10-03T10:14:41.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.325+0000 7f95b1ffb700 1 -- 172.21.15.146:0/2460523075 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b400ab60 con 0x7f95bc133ad0 2023-10-03T10:14:41.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.325+0000 7f95c3912700 1 -- 172.21.15.146:0/2460523075 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95bc1200b0 con 0x7f95bc133ad0 2023-10-03T10:14:41.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.326+0000 7f95b1ffb700 1 -- 172.21.15.146:0/2460523075 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f95b400acc0 con 0x7f95bc133ad0 2023-10-03T10:14:41.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.326+0000 7f95c3912700 1 -- 172.21.15.146:0/2460523075 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95bc04f2a0 con 0x7f95bc133ad0 2023-10-03T10:14:41.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.327+0000 7f95b1ffb700 1 -- 172.21.15.146:0/2460523075 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f95b403f7e0 con 0x7f95bc133ad0 2023-10-03T10:14:41.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.328+0000 7f087f995700 1 Processor -- start 2023-10-03T10:14:41.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.328+0000 7f087f995700 1 -- start start 2023-10-03T10:14:41.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.328+0000 7f087f995700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0878099e20 0x7f087809a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.328+0000 7f087f995700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f087809a730 0x7f0878130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.328+0000 7f087f995700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0878099a60 con 0x7f0878130890 2023-10-03T10:14:41.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.328+0000 7f087f995700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087809bf50 con 0x7f087809a730 2023-10-03T10:14:41.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.328+0000 7f087f995700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f087809b230 con 0x7f0878099e20 2023-10-03T10:14:41.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.328+0000 7f087d731700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0878099e20 0x7f087809a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.329+0000 7f087d731700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0878099e20 0x7f087809a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49132/0 (socket says 172.21.15.146:49132) 2023-10-03T10:14:41.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.329+0000 7f087d731700 1 -- 172.21.15.146:0/1653377639 learned_addr learned my addr 172.21.15.146:0/1653377639 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:41.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.329+0000 7f087cf30700 1 --2- 172.21.15.146:0/1653377639 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f087809a730 0x7f0878130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.329+0000 7f087d731700 1 -- 172.21.15.146:0/1653377639 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f087809a730 msgr2=0x7f0878130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.329+0000 7f087d731700 1 --2- 172.21.15.146:0/1653377639 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f087809a730 0x7f0878130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.329+0000 7f087d731700 1 -- 172.21.15.146:0/1653377639 >> v1:172.21.15.146:6789/0 conn(0x7f0878130890 legacy=0x7f0878137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.329+0000 7f087d731700 1 -- 172.21.15.146:0/1653377639 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087809bb90 con 0x7f0878099e20 2023-10-03T10:14:41.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.329+0000 7f087d731700 1 --2- 172.21.15.146:0/1653377639 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0878099e20 0x7f087809a1f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f087400b9d0 tx=0x7f087400bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d5d6aa96a964354 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.329+0000 7f086ffff700 1 -- 172.21.15.146:0/1653377639 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0874005e30 con 0x7f0878099e20 2023-10-03T10:14:41.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.329+0000 7f086ffff700 1 -- 172.21.15.146:0/1653377639 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087400be70 con 0x7f0878099e20 2023-10-03T10:14:41.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.329+0000 7f086ffff700 1 -- 172.21.15.146:0/1653377639 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0874004250 con 0x7f0878099e20 2023-10-03T10:14:41.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.330+0000 7f087f995700 1 -- 172.21.15.146:0/1653377639 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0878099e20 msgr2=0x7f087809a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.330+0000 7f087f995700 1 --2- 172.21.15.146:0/1653377639 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0878099e20 0x7f087809a1f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f087400b9d0 tx=0x7f087400bce0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.330+0000 7f087f995700 1 -- 172.21.15.146:0/1653377639 shutdown_connections 2023-10-03T10:14:41.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.330+0000 7f087f995700 1 --2- 172.21.15.146:0/1653377639 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0878099e20 0x7f087809a1f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.330+0000 7f087f995700 1 --2- 172.21.15.146:0/1653377639 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f087809a730 0x7f0878130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.330+0000 7f087f995700 1 -- 172.21.15.146:0/1653377639 >> 172.21.15.146:0/1653377639 conn(0x7f08780a2980 msgr2=0x7f08780a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.330+0000 7f087f995700 1 -- 172.21.15.146:0/1653377639 shutdown_connections 2023-10-03T10:14:41.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.330+0000 7f087f995700 1 -- 172.21.15.146:0/1653377639 wait complete. 2023-10-03T10:14:41.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.331+0000 7f087f995700 1 Processor -- start 2023-10-03T10:14:41.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.331+0000 7f087f995700 1 -- start start 2023-10-03T10:14:41.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.331+0000 7f087f995700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0878099e20 0x7f0878118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.331+0000 7f087f995700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f087809a730 0x7f0878119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.331+0000 7f087f995700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0878130890 0x7f0878119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.331+0000 7f087f995700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087811caf0 con 0x7f0878130890 2023-10-03T10:14:41.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.332+0000 7f087f995700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087811b500 con 0x7f087809a730 2023-10-03T10:14:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.332+0000 7f087f995700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f087811bf50 con 0x7f0878099e20 2023-10-03T10:14:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.332+0000 7f087cf30700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f087809a730 0x7f0878119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.332+0000 7f087cf30700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f087809a730 0x7f0878119330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45298/0 (socket says 172.21.15.146:45298) 2023-10-03T10:14:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.332+0000 7f087cf30700 1 -- 172.21.15.146:0/151623339 learned_addr learned my addr 172.21.15.146:0/151623339 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.332+0000 7f087df32700 1 --2- 172.21.15.146:0/151623339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0878130890 0x7f0878119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.332+0000 7f087d731700 1 --2- 172.21.15.146:0/151623339 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0878099e20 0x7f0878118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.332+0000 7f087df32700 1 -- 172.21.15.146:0/151623339 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0878099e20 msgr2=0x7f0878118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.332+0000 7f087df32700 1 --2- 172.21.15.146:0/151623339 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0878099e20 0x7f0878118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.332+0000 7f087df32700 1 -- 172.21.15.146:0/151623339 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f087809a730 msgr2=0x7f0878119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.332+0000 7f087df32700 1 --2- 172.21.15.146:0/151623339 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f087809a730 0x7f0878119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.332+0000 7f087df32700 1 -- 172.21.15.146:0/151623339 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087400b5b0 con 0x7f0878130890 2023-10-03T10:14:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.332+0000 7f087cf30700 1 --2- 172.21.15.146:0/151623339 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f087809a730 0x7f0878119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.332+0000 7f087df32700 1 --2- 172.21.15.146:0/151623339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0878130890 0x7f0878119870 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f087000cb90 tx=0x7f087000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.332+0000 7f086dffb700 1 -- 172.21.15.146:0/151623339 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870003c00 con 0x7f0878130890 2023-10-03T10:14:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.333+0000 7f086dffb700 1 -- 172.21.15.146:0/151623339 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0870003d60 con 0x7f0878130890 2023-10-03T10:14:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.333+0000 7f087f995700 1 -- 172.21.15.146:0/151623339 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f087811b040 con 0x7f0878130890 2023-10-03T10:14:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.333+0000 7f086dffb700 1 -- 172.21.15.146:0/151623339 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087000aa80 con 0x7f0878130890 2023-10-03T10:14:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.333+0000 7f087f995700 1 -- 172.21.15.146:0/151623339 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f087811a330 con 0x7f0878130890 2023-10-03T10:14:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.334+0000 7f086dffb700 1 -- 172.21.15.146:0/151623339 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f087000abe0 con 0x7f0878130890 2023-10-03T10:14:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.334+0000 7f086dffb700 1 -- 172.21.15.146:0/151623339 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f087003f660 con 0x7f0878130890 2023-10-03T10:14:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.334+0000 7f087f995700 1 -- 172.21.15.146:0/151623339 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0878072480 con 0x7f0878130890 2023-10-03T10:14:41.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.335+0000 7f95b1ffb700 1 -- 172.21.15.146:0/2460523075 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f95b40198f0 con 0x7f95bc133ad0 2023-10-03T10:14:41.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.339+0000 7f086dffb700 1 -- 172.21.15.146:0/151623339 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0878072480 con 0x7f0878130890 2023-10-03T10:14:41.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.371+0000 7f7f4cbf0700 1 Processor -- start 2023-10-03T10:14:41.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.371+0000 7f7f4cbf0700 1 -- start start 2023-10-03T10:14:41.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.371+0000 7f7f4cbf0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7f4809f350 0x7f7f48138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.371+0000 7f7f4cbf0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f481393a0 0x7f7f4813b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.371+0000 7f7f4cbf0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f4809fa00 con 0x7f7f4809e870 2023-10-03T10:14:41.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.371+0000 7f7f4cbf0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f480a0370 con 0x7f7f4809f350 2023-10-03T10:14:41.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.372+0000 7f7f4cbf0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4806bec0 con 0x7f7f481393a0 2023-10-03T10:14:41.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.372+0000 7f7f46d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f481393a0 0x7f7f4813b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.372+0000 7f7f45d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7f4809f350 0x7f7f48138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.372+0000 7f7f46d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f481393a0 0x7f7f4813b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49152/0 (socket says 172.21.15.146:49152) 2023-10-03T10:14:41.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.372+0000 7f7f46d9d700 1 -- 172.21.15.146:0/1436026632 learned_addr learned my addr 172.21.15.146:0/1436026632 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:41.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.372+0000 7f7f46d9d700 1 -- 172.21.15.146:0/1436026632 >> v2:172.21.15.146:3300/0 conn(0x7f7f4809f350 msgr2=0x7f7f48138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.372+0000 7f7f46d9d700 1 --2- 172.21.15.146:0/1436026632 >> v2:172.21.15.146:3300/0 conn(0x7f7f4809f350 0x7f7f48138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.372+0000 7f7f46d9d700 1 -- 172.21.15.146:0/1436026632 >> v1:172.21.15.146:6789/0 conn(0x7f7f4809e870 legacy=0x7f7f4809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.372+0000 7f7f46d9d700 1 -- 172.21.15.146:0/1436026632 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f4809ada0 con 0x7f7f481393a0 2023-10-03T10:14:41.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.372+0000 7f7f46d9d700 1 --2- 172.21.15.146:0/1436026632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f481393a0 0x7f7f4813b780 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7f40009e50 tx=0x7f7f4000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5733729788840656 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.372+0000 7f7f4559a700 1 -- 172.21.15.146:0/1436026632 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4000e070 con 0x7f7f481393a0 2023-10-03T10:14:41.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.373+0000 7f7f4559a700 1 -- 172.21.15.146:0/1436026632 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4000b910 con 0x7f7f481393a0 2023-10-03T10:14:41.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.373+0000 7f7f4559a700 1 -- 172.21.15.146:0/1436026632 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4000bcc0 con 0x7f7f481393a0 2023-10-03T10:14:41.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.373+0000 7f7f4cbf0700 1 -- 172.21.15.146:0/1436026632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f481393a0 msgr2=0x7f7f4813b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.373+0000 7f7f4cbf0700 1 --2- 172.21.15.146:0/1436026632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f481393a0 0x7f7f4813b780 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7f40009e50 tx=0x7f7f4000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:41.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.373+0000 7f7f4cbf0700 1 -- 172.21.15.146:0/1436026632 shutdown_connections 2023-10-03T10:14:41.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.373+0000 7f7f4cbf0700 1 --2- 172.21.15.146:0/1436026632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f481393a0 0x7f7f4813b780 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.373+0000 7f7f4cbf0700 1 --2- 172.21.15.146:0/1436026632 >> v2:172.21.15.146:3300/0 conn(0x7f7f4809f350 0x7f7f48138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.373+0000 7f7f4cbf0700 1 -- 172.21.15.146:0/1436026632 >> 172.21.15.146:0/1436026632 conn(0x7f7f480a4430 msgr2=0x7f7f480a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.373+0000 7f7f4cbf0700 1 -- 172.21.15.146:0/1436026632 shutdown_connections 2023-10-03T10:14:41.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.373+0000 7f7f4cbf0700 1 -- 172.21.15.146:0/1436026632 wait complete. 2023-10-03T10:14:41.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.374+0000 7f7f4cbf0700 1 Processor -- start 2023-10-03T10:14:41.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.374+0000 7f7f4cbf0700 1 -- start start 2023-10-03T10:14:41.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.375+0000 7f7f4cbf0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f4809e870 0x7f7f4811ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.375+0000 7f7f4cbf0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f4809f350 0x7f7f4811f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.375+0000 7f7f4cbf0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f481393a0 0x7f7f4811f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.375+0000 7f7f4cbf0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f48121c50 con 0x7f7f4809f350 2023-10-03T10:14:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.375+0000 7f7f4cbf0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f48120df0 con 0x7f7f481393a0 2023-10-03T10:14:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.375+0000 7f7f4cbf0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f481206a0 con 0x7f7f4809e870 2023-10-03T10:14:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.375+0000 7f7f4659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f4809e870 0x7f7f4811ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.375+0000 7f7f45d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f4809f350 0x7f7f4811f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.375+0000 7f7f4659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f4809e870 0x7f7f4811ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49156/0 (socket says 172.21.15.146:49156) 2023-10-03T10:14:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.375+0000 7f7f4659c700 1 -- 172.21.15.146:0/1377288356 learned_addr learned my addr 172.21.15.146:0/1377288356 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.375+0000 7f7f46d9d700 1 --2- 172.21.15.146:0/1377288356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f481393a0 0x7f7f4811f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.375+0000 7f7f4659c700 1 -- 172.21.15.146:0/1377288356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f481393a0 msgr2=0x7f7f4811f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.375+0000 7f7f4659c700 1 --2- 172.21.15.146:0/1377288356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f481393a0 0x7f7f4811f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.375+0000 7f7f4659c700 1 -- 172.21.15.146:0/1377288356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f4809f350 msgr2=0x7f7f4811f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.375+0000 7f7f4659c700 1 --2- 172.21.15.146:0/1377288356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f4809f350 0x7f7f4811f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.375+0000 7f7f4659c700 1 -- 172.21.15.146:0/1377288356 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f40009b30 con 0x7f7f4809e870 2023-10-03T10:14:41.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.376+0000 7f7f4659c700 1 --2- 172.21.15.146:0/1377288356 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f4809e870 0x7f7f4811ead0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800c450 tx=0x7f7f3800c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.376+0000 7f7f36ffd700 1 -- 172.21.15.146:0/1377288356 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f380052d0 con 0x7f7f4809e870 2023-10-03T10:14:41.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.376+0000 7f7f36ffd700 1 -- 172.21.15.146:0/1377288356 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f38005430 con 0x7f7f4809e870 2023-10-03T10:14:41.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.376+0000 7f7f4cbf0700 1 -- 172.21.15.146:0/1377288356 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f481221c0 con 0x7f7f4809e870 2023-10-03T10:14:41.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.376+0000 7f7f36ffd700 1 -- 172.21.15.146:0/1377288356 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f380038a0 con 0x7f7f4809e870 2023-10-03T10:14:41.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.376+0000 7f7f4cbf0700 1 -- 172.21.15.146:0/1377288356 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f48122c30 con 0x7f7f4809e870 2023-10-03T10:14:41.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.377+0000 7f7f36ffd700 1 -- 172.21.15.146:0/1377288356 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f38003a00 con 0x7f7f4809e870 2023-10-03T10:14:41.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.377+0000 7f7f36ffd700 1 -- 172.21.15.146:0/1377288356 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7f3803eb20 con 0x7f7f4809e870 2023-10-03T10:14:41.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.377+0000 7f7f4cbf0700 1 -- 172.21.15.146:0/1377288356 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f4804f2a0 con 0x7f7f4809e870 2023-10-03T10:14:41.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.382+0000 7f7f36ffd700 1 -- 172.21.15.146:0/1377288356 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f38017020 con 0x7f7f4809e870 2023-10-03T10:14:41.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.503+0000 7f374a4a3700 1 -- 172.21.15.146:0/613090842 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f374409f660 con 0x7f374409f180 2023-10-03T10:14:41.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.503+0000 7f3740ff9700 1 -- 172.21.15.146:0/613090842 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f37380102b0 con 0x7f374409f180 2023-10-03T10:14:41.504 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:41.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.505+0000 7f374a4a3700 1 -- 172.21.15.146:0/613090842 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f374409f180 msgr2=0x7f37441c1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.505+0000 7f374a4a3700 1 --2- 172.21.15.146:0/613090842 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f374409f180 0x7f37441c1560 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f373800e980 tx=0x7f373800ec90 comp rx=0 tx=0).stop 2023-10-03T10:14:41.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.505+0000 7f374a4a3700 1 -- 172.21.15.146:0/613090842 shutdown_connections 2023-10-03T10:14:41.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.505+0000 7f374a4a3700 1 --2- 172.21.15.146:0/613090842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3744131d70 0x7f37441c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.505+0000 7f374a4a3700 1 --2- 172.21.15.146:0/613090842 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f374409e870 0x7f37441c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.505+0000 7f374a4a3700 1 --2- 172.21.15.146:0/613090842 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f374409f180 0x7f37441c1560 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.505+0000 7f374a4a3700 1 -- 172.21.15.146:0/613090842 >> 172.21.15.146:0/613090842 conn(0x7f37440a4430 msgr2=0x7f374412fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.505+0000 7f374a4a3700 1 -- 172.21.15.146:0/613090842 shutdown_connections 2023-10-03T10:14:41.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.506+0000 7f374a4a3700 1 -- 172.21.15.146:0/613090842 wait complete. 2023-10-03T10:14:41.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:41.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.534+0000 7f087f995700 1 -- 172.21.15.146:0/151623339 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0878072480 con 0x7f0878130890 2023-10-03T10:14:41.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.535+0000 7f086dffb700 1 -- 172.21.15.146:0/151623339 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0878072480 con 0x7f0878130890 2023-10-03T10:14:41.535 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:41.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.537+0000 7f087f995700 1 -- 172.21.15.146:0/151623339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0878130890 msgr2=0x7f0878119870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.537+0000 7f087f995700 1 --2- 172.21.15.146:0/151623339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0878130890 0x7f0878119870 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f087000cb90 tx=0x7f087000cea0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.537+0000 7f087f995700 1 -- 172.21.15.146:0/151623339 shutdown_connections 2023-10-03T10:14:41.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.537+0000 7f087f995700 1 --2- 172.21.15.146:0/151623339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0878130890 0x7f0878119870 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.537+0000 7f087f995700 1 --2- 172.21.15.146:0/151623339 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0878099e20 0x7f0878118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.537+0000 7f087f995700 1 --2- 172.21.15.146:0/151623339 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f087809a730 0x7f0878119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.537+0000 7f087f995700 1 -- 172.21.15.146:0/151623339 >> 172.21.15.146:0/151623339 conn(0x7f08780a2980 msgr2=0x7f087812d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.537+0000 7f087f995700 1 -- 172.21.15.146:0/151623339 shutdown_connections 2023-10-03T10:14:41.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.537+0000 7f087f995700 1 -- 172.21.15.146:0/151623339 wait complete. 2023-10-03T10:14:41.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.540+0000 7f95c3912700 1 -- 172.21.15.146:0/2460523075 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f95bc12fe80 con 0x7f95bc133ad0 2023-10-03T10:14:41.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.541+0000 7f95b1ffb700 1 -- 172.21.15.146:0/2460523075 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f95b4019300 con 0x7f95bc133ad0 2023-10-03T10:14:41.541 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:41.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.543+0000 7f95c3912700 1 -- 172.21.15.146:0/2460523075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95bc133ad0 msgr2=0x7f95bc11e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.543+0000 7f95c3912700 1 --2- 172.21.15.146:0/2460523075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95bc133ad0 0x7f95bc11e4c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f95b400cc50 tx=0x7f95b400cf60 comp rx=0 tx=0).stop 2023-10-03T10:14:41.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.543+0000 7f95c3912700 1 -- 172.21.15.146:0/2460523075 shutdown_connections 2023-10-03T10:14:41.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.543+0000 7f95c3912700 1 --2- 172.21.15.146:0/2460523075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95bc133ad0 0x7f95bc11e4c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.543+0000 7f95c3912700 1 --2- 172.21.15.146:0/2460523075 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95bc1300a0 0x7f95bc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.543+0000 7f95c3912700 1 --2- 172.21.15.146:0/2460523075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95bc1309f0 0x7f95bc11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.543+0000 7f95c3912700 1 -- 172.21.15.146:0/2460523075 >> 172.21.15.146:0/2460523075 conn(0x7f95bc099c40 msgr2=0x7f95bc09d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.543+0000 7f95c3912700 1 -- 172.21.15.146:0/2460523075 shutdown_connections 2023-10-03T10:14:41.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.543+0000 7f95c3912700 1 -- 172.21.15.146:0/2460523075 wait complete. 2023-10-03T10:14:41.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:41.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:41.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.586+0000 7f7f4cbf0700 1 -- 172.21.15.146:0/1377288356 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7f48072d60 con 0x7f7f4809e870 2023-10-03T10:14:41.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.586+0000 7f7f36ffd700 1 -- 172.21.15.146:0/1377288356 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f38019710 con 0x7f7f4809e870 2023-10-03T10:14:41.587 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:41.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.588+0000 7f7f4cbf0700 1 -- 172.21.15.146:0/1377288356 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f4809e870 msgr2=0x7f7f4811ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.588+0000 7f7f4cbf0700 1 --2- 172.21.15.146:0/1377288356 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f4809e870 0x7f7f4811ead0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800c450 tx=0x7f7f3800c760 comp rx=0 tx=0).stop 2023-10-03T10:14:41.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.588+0000 7f7f4cbf0700 1 -- 172.21.15.146:0/1377288356 shutdown_connections 2023-10-03T10:14:41.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.588+0000 7f7f4cbf0700 1 --2- 172.21.15.146:0/1377288356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f481393a0 0x7f7f4811f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.588+0000 7f7f4cbf0700 1 --2- 172.21.15.146:0/1377288356 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f4809e870 0x7f7f4811ead0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.588+0000 7f7f4cbf0700 1 --2- 172.21.15.146:0/1377288356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f4809f350 0x7f7f4811f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.588+0000 7f7f4cbf0700 1 -- 172.21.15.146:0/1377288356 >> 172.21.15.146:0/1377288356 conn(0x7f7f480a4430 msgr2=0x7f7f48071280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.588+0000 7f7f4cbf0700 1 -- 172.21.15.146:0/1377288356 shutdown_connections 2023-10-03T10:14:41.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:41.588+0000 7f7f4cbf0700 1 -- 172.21.15.146:0/1377288356 wait complete. 2023-10-03T10:14:41.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:42.520 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:42.552 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:42.558 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:42.601 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:42.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.663+0000 7f4df5372700 1 Processor -- start 2023-10-03T10:14:42.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.664+0000 7f4df5372700 1 -- start start 2023-10-03T10:14:42.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.664+0000 7f4df5372700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4df0133ad0 0x7f4df0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.664+0000 7f4df5372700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4df01300a0 0x7f4df01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.664+0000 7f4df5372700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df006b2d0 con 0x7f4df01309f0 2023-10-03T10:14:42.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.664+0000 7f4df5372700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df0133610 con 0x7f4df01300a0 2023-10-03T10:14:42.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.664+0000 7f4df5372700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df009a500 con 0x7f4df0133ad0 2023-10-03T10:14:42.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.664+0000 7f4deeffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4df0133ad0 0x7f4df0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.664+0000 7f4deeffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4df0133ad0 0x7f4df0133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45308/0 (socket says 172.21.15.146:45308) 2023-10-03T10:14:42.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.664+0000 7f4deeffd700 1 -- 172.21.15.146:0/263972845 learned_addr learned my addr 172.21.15.146:0/263972845 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:42.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.664+0000 7f4dee7fc700 1 --2- 172.21.15.146:0/263972845 >> v2:172.21.15.146:3300/0 conn(0x7f4df01300a0 0x7f4df01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.665+0000 7f4deeffd700 1 -- 172.21.15.146:0/263972845 >> v2:172.21.15.146:3300/0 conn(0x7f4df01300a0 msgr2=0x7f4df01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:42.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.665+0000 7f4deeffd700 1 --2- 172.21.15.146:0/263972845 >> v2:172.21.15.146:3300/0 conn(0x7f4df01300a0 0x7f4df01304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.665+0000 7f4deeffd700 1 -- 172.21.15.146:0/263972845 >> v1:172.21.15.146:6789/0 conn(0x7f4df01309f0 legacy=0x7f4df013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.665+0000 7f4deeffd700 1 -- 172.21.15.146:0/263972845 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df01338b0 con 0x7f4df0133ad0 2023-10-03T10:14:42.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.665+0000 7f4deeffd700 1 --2- 172.21.15.146:0/263972845 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4df0133ad0 0x7f4df0133ea0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4de00098f0 tx=0x7f4de0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=541604bc12caef31 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.665+0000 7f4dedffb700 1 -- 172.21.15.146:0/263972845 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de0011830 con 0x7f4df0133ad0 2023-10-03T10:14:42.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.665+0000 7f4dedffb700 1 -- 172.21.15.146:0/263972845 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de0011990 con 0x7f4df0133ad0 2023-10-03T10:14:42.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.665+0000 7f4dedffb700 1 -- 172.21.15.146:0/263972845 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de0011d20 con 0x7f4df0133ad0 2023-10-03T10:14:42.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.666+0000 7f4df5372700 1 -- 172.21.15.146:0/263972845 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4df0133ad0 msgr2=0x7f4df0133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.666+0000 7f4df5372700 1 --2- 172.21.15.146:0/263972845 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4df0133ad0 0x7f4df0133ea0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4de00098f0 tx=0x7f4de0009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:42.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.666+0000 7f4df5372700 1 -- 172.21.15.146:0/263972845 shutdown_connections 2023-10-03T10:14:42.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.666+0000 7f4df5372700 1 --2- 172.21.15.146:0/263972845 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4df0133ad0 0x7f4df0133ea0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.666+0000 7f4df5372700 1 --2- 172.21.15.146:0/263972845 >> v2:172.21.15.146:3300/0 conn(0x7f4df01300a0 0x7f4df01304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.666+0000 7f4df5372700 1 -- 172.21.15.146:0/263972845 >> 172.21.15.146:0/263972845 conn(0x7f4df0099c40 msgr2=0x7f4df00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.666+0000 7f4df5372700 1 -- 172.21.15.146:0/263972845 shutdown_connections 2023-10-03T10:14:42.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.666+0000 7f4df5372700 1 -- 172.21.15.146:0/263972845 wait complete. 2023-10-03T10:14:42.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.668+0000 7f4df5372700 1 Processor -- start 2023-10-03T10:14:42.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.668+0000 7f4df5372700 1 -- start start 2023-10-03T10:14:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.669+0000 7f4df5372700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4df01300a0 0x7f4df011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.669+0000 7f4df5372700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4df01309f0 0x7f4df011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.669+0000 7f4df5372700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4df0133ad0 0x7f4df011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.669+0000 7f4df5372700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df011edb0 con 0x7f4df01300a0 2023-10-03T10:14:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.669+0000 7f4df5372700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df01200c0 con 0x7f4df0133ad0 2023-10-03T10:14:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.669+0000 7f4df5372700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4df012dd00 con 0x7f4df01309f0 2023-10-03T10:14:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.669+0000 7f4deeffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4df01300a0 0x7f4df011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.669+0000 7f4deeffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4df01300a0 0x7f4df011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37300/0 (socket says 172.21.15.146:37300) 2023-10-03T10:14:42.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.669+0000 7f4def7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4df0133ad0 0x7f4df011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.669+0000 7f4deeffd700 1 -- 172.21.15.146:0/980340590 learned_addr learned my addr 172.21.15.146:0/980340590 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:42.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.669+0000 7f4dee7fc700 1 --2- 172.21.15.146:0/980340590 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4df01309f0 0x7f4df011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.669+0000 7f4deeffd700 1 -- 172.21.15.146:0/980340590 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4df01309f0 msgr2=0x7f4df011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.669+0000 7f4deeffd700 1 --2- 172.21.15.146:0/980340590 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4df01309f0 0x7f4df011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.669+0000 7f4deeffd700 1 -- 172.21.15.146:0/980340590 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4df0133ad0 msgr2=0x7f4df011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.669+0000 7f4deeffd700 1 --2- 172.21.15.146:0/980340590 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4df0133ad0 0x7f4df011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.669+0000 7f4deeffd700 1 -- 172.21.15.146:0/980340590 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de0009550 con 0x7f4df01300a0 2023-10-03T10:14:42.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.669+0000 7f4deeffd700 1 --2- 172.21.15.146:0/980340590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4df01300a0 0x7f4df011da40 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009c40 tx=0x7f4de0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.670+0000 7f4dd77fe700 1 -- 172.21.15.146:0/980340590 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de0004400 con 0x7f4df01300a0 2023-10-03T10:14:42.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.670+0000 7f4dd77fe700 1 -- 172.21.15.146:0/980340590 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de001f070 con 0x7f4df01300a0 2023-10-03T10:14:42.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.670+0000 7f4df5372700 1 -- 172.21.15.146:0/980340590 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df012d970 con 0x7f4df01300a0 2023-10-03T10:14:42.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.670+0000 7f4dd77fe700 1 -- 172.21.15.146:0/980340590 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de00038e0 con 0x7f4df01300a0 2023-10-03T10:14:42.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.670+0000 7f4df5372700 1 -- 172.21.15.146:0/980340590 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df011f8c0 con 0x7f4df01300a0 2023-10-03T10:14:42.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.671+0000 7f4dd77fe700 1 -- 172.21.15.146:0/980340590 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4de0021030 con 0x7f4df01300a0 2023-10-03T10:14:42.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.671+0000 7f4df5372700 1 -- 172.21.15.146:0/980340590 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df009cb20 con 0x7f4df01300a0 2023-10-03T10:14:42.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.671+0000 7f4dd77fe700 1 -- 172.21.15.146:0/980340590 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4de0040a30 con 0x7f4df01300a0 2023-10-03T10:14:42.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.680+0000 7f4dd77fe700 1 -- 172.21.15.146:0/980340590 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4de00199a0 con 0x7f4df01300a0 2023-10-03T10:14:42.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.704+0000 7fbb2e541700 1 Processor -- start 2023-10-03T10:14:42.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.704+0000 7fbb2e541700 1 -- start start 2023-10-03T10:14:42.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.705+0000 7f18ef684700 1 Processor -- start 2023-10-03T10:14:42.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.705+0000 7fbb2e541700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb2809ef80 0x7fbb2813d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.705+0000 7fbb2e541700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbb2809f3b0 0x7fbb2813f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.705+0000 7fbb2e541700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb28072b30 con 0x7fbb2809a130 2023-10-03T10:14:42.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.705+0000 7fbb2e541700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2809a500 con 0x7fbb2809f3b0 2023-10-03T10:14:42.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.705+0000 7fbb2e541700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2809ada0 con 0x7fbb2809ef80 2023-10-03T10:14:42.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.705+0000 7fbb27fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbb2809a130 0x7fbb2809e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46554/0 (socket says 172.21.15.146:46554) 2023-10-03T10:14:42.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.705+0000 7fbb27fff700 1 -- 172.21.15.146:0/4233789291 learned_addr learned my addr 172.21.15.146:0/4233789291 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:42.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.705+0000 7fbb2cade700 1 --2- 172.21.15.146:0/4233789291 >> v2:172.21.15.146:3300/0 conn(0x7fbb2809f3b0 0x7fbb2813f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.705+0000 7fbb277fe700 1 --2- 172.21.15.146:0/4233789291 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb2809ef80 0x7fbb2813d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.705+0000 7f18ef684700 1 -- start start 2023-10-03T10:14:42.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.705+0000 7fbb2cade700 1 -- 172.21.15.146:0/4233789291 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb2809ef80 msgr2=0x7fbb2813d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:42.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.706+0000 7fbb2cade700 1 --2- 172.21.15.146:0/4233789291 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb2809ef80 0x7fbb2813d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.706+0000 7fbb2cade700 1 -- 172.21.15.146:0/4233789291 >> v1:172.21.15.146:6789/0 conn(0x7fbb2809a130 legacy=0x7fbb2809e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.706+0000 7fbb2cade700 1 -- 172.21.15.146:0/4233789291 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2809fe00 con 0x7fbb2809f3b0 2023-10-03T10:14:42.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.706+0000 7f18ef684700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18e8138040 0x7f18e8138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.706+0000 7f18ef684700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f18e80a08e0 0x7f18e80a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.706+0000 7f18ef684700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e80a1230 0x7f18e813ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.706+0000 7f18ef684700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e80a2100 con 0x7f18e80a08e0 2023-10-03T10:14:42.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.706+0000 7f18ef684700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e8138950 con 0x7f18e80a1230 2023-10-03T10:14:42.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.706+0000 7f18ef684700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18e81379e0 con 0x7f18e8138040 2023-10-03T10:14:42.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.706+0000 7fbb2cade700 1 --2- 172.21.15.146:0/4233789291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2809f3b0 0x7fbb2813f970 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009d90 tx=0x7fbb2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50a071dd68cdd81 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.706+0000 7f18edc21700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e80a1230 0x7f18e813ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.706+0000 7f18ecc1f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f18e80a08e0 0x7f18e80a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.706+0000 7f18edc21700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e80a1230 0x7f18e813ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45340/0 (socket says 172.21.15.146:45340) 2023-10-03T10:14:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.706+0000 7f18edc21700 1 -- 172.21.15.146:0/3829227694 learned_addr learned my addr 172.21.15.146:0/3829227694 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.706+0000 7f18ecc1f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f18e80a08e0 0x7f18e80a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37308/0 (socket says 172.21.15.146:37308) 2023-10-03T10:14:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.706+0000 7f18edc21700 1 -- 172.21.15.146:0/3829227694 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18e8138040 msgr2=0x7f18e8138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.706+0000 7f18edc21700 1 --2- 172.21.15.146:0/3829227694 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18e8138040 0x7f18e8138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.706+0000 7f18edc21700 1 -- 172.21.15.146:0/3829227694 >> v2:172.21.15.146:3300/0 conn(0x7f18e80a08e0 msgr2=0x7f18e80a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.706+0000 7f18edc21700 1 --2- 172.21.15.146:0/3829227694 >> v2:172.21.15.146:3300/0 conn(0x7f18e80a08e0 0x7f18e80a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.706+0000 7f18edc21700 1 -- 172.21.15.146:0/3829227694 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e809b9b0 con 0x7f18e80a1230 2023-10-03T10:14:42.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.706+0000 7f18edc21700 1 --2- 172.21.15.146:0/3829227694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e80a1230 0x7f18e813ed10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f18e0009e80 tx=0x7f18e000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74bd7727b2bfa98e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.706+0000 7f18dffff700 1 -- 172.21.15.146:0/3829227694 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e000e070 con 0x7f18e80a1230 2023-10-03T10:14:42.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.707+0000 7f18dffff700 1 -- 172.21.15.146:0/3829227694 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e000b8d0 con 0x7f18e80a1230 2023-10-03T10:14:42.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.707+0000 7f18dffff700 1 -- 172.21.15.146:0/3829227694 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e000bc80 con 0x7f18e80a1230 2023-10-03T10:14:42.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.707+0000 7fbb26ffd700 1 -- 172.21.15.146:0/4233789291 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2000e070 con 0x7fbb2809f3b0 2023-10-03T10:14:42.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.707+0000 7fbb26ffd700 1 -- 172.21.15.146:0/4233789291 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2000bb20 con 0x7fbb2809f3b0 2023-10-03T10:14:42.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.707+0000 7fbb26ffd700 1 -- 172.21.15.146:0/4233789291 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb20012430 con 0x7fbb2809f3b0 2023-10-03T10:14:42.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.707+0000 7f18ef684700 1 -- 172.21.15.146:0/3829227694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e80a1230 msgr2=0x7f18e813ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.707+0000 7f18ef684700 1 --2- 172.21.15.146:0/3829227694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e80a1230 0x7f18e813ed10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f18e0009e80 tx=0x7f18e000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:42.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.707+0000 7f18ef684700 1 -- 172.21.15.146:0/3829227694 shutdown_connections 2023-10-03T10:14:42.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.707+0000 7f18ef684700 1 --2- 172.21.15.146:0/3829227694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e80a1230 0x7f18e813ed10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.707+0000 7f18ef684700 1 --2- 172.21.15.146:0/3829227694 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18e8138040 0x7f18e8138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.707+0000 7f18ef684700 1 --2- 172.21.15.146:0/3829227694 >> v2:172.21.15.146:3300/0 conn(0x7f18e80a08e0 0x7f18e80a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.707+0000 7f18ef684700 1 -- 172.21.15.146:0/3829227694 >> 172.21.15.146:0/3829227694 conn(0x7f18e80a2980 msgr2=0x7f18e80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.708+0000 7fbb2e541700 1 -- 172.21.15.146:0/4233789291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2809f3b0 msgr2=0x7fbb2813f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.708+0000 7fbb2e541700 1 --2- 172.21.15.146:0/4233789291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2809f3b0 0x7fbb2813f970 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009d90 tx=0x7fbb2000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:42.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.708+0000 7f18ef684700 1 -- 172.21.15.146:0/3829227694 shutdown_connections 2023-10-03T10:14:42.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.708+0000 7fbb2e541700 1 -- 172.21.15.146:0/4233789291 shutdown_connections 2023-10-03T10:14:42.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.708+0000 7fbb2e541700 1 --2- 172.21.15.146:0/4233789291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2809f3b0 0x7fbb2813f970 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.708+0000 7fbb2e541700 1 --2- 172.21.15.146:0/4233789291 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb2809ef80 0x7fbb2813d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.708+0000 7fbb2e541700 1 -- 172.21.15.146:0/4233789291 >> 172.21.15.146:0/4233789291 conn(0x7fbb280a4430 msgr2=0x7fbb280a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.708+0000 7f18ef684700 1 -- 172.21.15.146:0/3829227694 wait complete. 2023-10-03T10:14:42.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.708+0000 7fbb2e541700 1 -- 172.21.15.146:0/4233789291 shutdown_connections 2023-10-03T10:14:42.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.708+0000 7fbb2e541700 1 -- 172.21.15.146:0/4233789291 wait complete. 2023-10-03T10:14:42.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.709+0000 7f18ef684700 1 Processor -- start 2023-10-03T10:14:42.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.709+0000 7f18ef684700 1 -- start start 2023-10-03T10:14:42.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.709+0000 7fbb2e541700 1 Processor -- start 2023-10-03T10:14:42.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.709+0000 7f18ef684700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e80a08e0 0x7f18e8126560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.709+0000 7f18ef684700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e80a1230 0x7f18e8126aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.709+0000 7f18ef684700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18e8138040 0x7f18e8126fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.709+0000 7f18ef684700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e8129760 con 0x7f18e80a08e0 2023-10-03T10:14:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.709+0000 7f18ef684700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e81370a0 con 0x7f18e80a1230 2023-10-03T10:14:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.709+0000 7f18ef684700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18e8129ae0 con 0x7f18e8138040 2023-10-03T10:14:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.709+0000 7f18edc21700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18e8138040 0x7f18e8126fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.709+0000 7f18edc21700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18e8138040 0x7f18e8126fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49196/0 (socket says 172.21.15.146:49196) 2023-10-03T10:14:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.709+0000 7f18edc21700 1 -- 172.21.15.146:0/319833911 learned_addr learned my addr 172.21.15.146:0/319833911 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.710+0000 7f18edc21700 1 -- 172.21.15.146:0/319833911 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e80a1230 msgr2=0x7f18e8126aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.710+0000 7f18edc21700 1 --2- 172.21.15.146:0/319833911 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e80a1230 0x7f18e8126aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.710+0000 7f18edc21700 1 -- 172.21.15.146:0/319833911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e80a08e0 msgr2=0x7f18e8126560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.710+0000 7f18edc21700 1 --2- 172.21.15.146:0/319833911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e80a08e0 0x7f18e8126560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.710+0000 7f18edc21700 1 -- 172.21.15.146:0/319833911 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e0009b30 con 0x7f18e8138040 2023-10-03T10:14:42.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.709+0000 7fbb2e541700 1 -- start start 2023-10-03T10:14:42.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.710+0000 7f18edc21700 1 --2- 172.21.15.146:0/319833911 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18e8138040 0x7f18e8126fe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f18e00095e0 tx=0x7f18e0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.710+0000 7fbb2e541700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2809a130 0x7fbb281ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.710+0000 7fbb2e541700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb2809ef80 0x7fbb281cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.710+0000 7fbb2e541700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2809f3b0 0x7fbb281cd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.710+0000 7fbb2e541700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2813ef20 con 0x7fbb2809f3b0 2023-10-03T10:14:42.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.710+0000 7fbb2e541700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2809b670 con 0x7fbb2809a130 2023-10-03T10:14:42.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.710+0000 7fbb2e541700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb280a00f0 con 0x7fbb2809ef80 2023-10-03T10:14:42.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.710+0000 7fbb277fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb2809ef80 0x7fbb281cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.710+0000 7fbb277fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb2809ef80 0x7fbb281cd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49208/0 (socket says 172.21.15.146:49208) 2023-10-03T10:14:42.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.710+0000 7fbb277fe700 1 -- 172.21.15.146:0/664678412 learned_addr learned my addr 172.21.15.146:0/664678412 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:42.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.710+0000 7fbb2cade700 1 --2- 172.21.15.146:0/664678412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2809f3b0 0x7fbb281cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.710+0000 7fbb27fff700 1 --2- 172.21.15.146:0/664678412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2809a130 0x7fbb281ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.710+0000 7f18ddffb700 1 -- 172.21.15.146:0/319833911 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e0004250 con 0x7f18e8138040 2023-10-03T10:14:42.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.710+0000 7f18ef684700 1 -- 172.21.15.146:0/319833911 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e8129ff0 con 0x7f18e8138040 2023-10-03T10:14:42.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.710+0000 7f18ddffb700 1 -- 172.21.15.146:0/319833911 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e00043b0 con 0x7f18e8138040 2023-10-03T10:14:42.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.710+0000 7f18ddffb700 1 -- 172.21.15.146:0/319833911 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e0004720 con 0x7f18e8138040 2023-10-03T10:14:42.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.711+0000 7f18ef684700 1 -- 172.21.15.146:0/319833911 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e81280e0 con 0x7f18e8138040 2023-10-03T10:14:42.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.711+0000 7fbb277fe700 1 -- 172.21.15.146:0/664678412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2809a130 msgr2=0x7fbb281ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.711+0000 7fbb277fe700 1 --2- 172.21.15.146:0/664678412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2809a130 0x7fbb281ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.711+0000 7fbb277fe700 1 -- 172.21.15.146:0/664678412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2809f3b0 msgr2=0x7fbb281cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.711+0000 7fbb277fe700 1 --2- 172.21.15.146:0/664678412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2809f3b0 0x7fbb281cd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.711+0000 7fbb277fe700 1 -- 172.21.15.146:0/664678412 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb20009a70 con 0x7fbb2809ef80 2023-10-03T10:14:42.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.711+0000 7fbb2cade700 1 --2- 172.21.15.146:0/664678412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2809f3b0 0x7fbb281cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:42.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.711+0000 7fbb277fe700 1 --2- 172.21.15.146:0/664678412 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb2809ef80 0x7fbb281cd420 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c00e9b0 tx=0x7fbb1c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.711+0000 7fbb24ff9700 1 -- 172.21.15.146:0/664678412 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c009710 con 0x7fbb2809ef80 2023-10-03T10:14:42.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.711+0000 7fbb24ff9700 1 -- 172.21.15.146:0/664678412 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c00c850 con 0x7fbb2809ef80 2023-10-03T10:14:42.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.711+0000 7fbb24ff9700 1 -- 172.21.15.146:0/664678412 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c00cbc0 con 0x7fbb2809ef80 2023-10-03T10:14:42.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.712+0000 7f18ddffb700 1 -- 172.21.15.146:0/319833911 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f18e001b430 con 0x7f18e8138040 2023-10-03T10:14:42.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.711+0000 7fbb2e541700 1 -- 172.21.15.146:0/664678412 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2811b070 con 0x7fbb2809ef80 2023-10-03T10:14:42.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.712+0000 7fbb2e541700 1 -- 172.21.15.146:0/664678412 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2811c430 con 0x7fbb2809ef80 2023-10-03T10:14:42.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.712+0000 7fbb24ff9700 1 -- 172.21.15.146:0/664678412 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb1c00cd20 con 0x7fbb2809ef80 2023-10-03T10:14:42.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.712+0000 7fbb24ff9700 1 -- 172.21.15.146:0/664678412 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbb1c03f710 con 0x7fbb2809ef80 2023-10-03T10:14:42.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.713+0000 7f18ddffb700 1 -- 172.21.15.146:0/319833911 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f18e00409e0 con 0x7f18e8138040 2023-10-03T10:14:42.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.713+0000 7fbb2e541700 1 -- 172.21.15.146:0/664678412 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2811b800 con 0x7fbb2809ef80 2023-10-03T10:14:42.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.714+0000 7f18ef684700 1 -- 172.21.15.146:0/319833911 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c80052e0 con 0x7f18e8138040 2023-10-03T10:14:42.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.718+0000 7fbb24ff9700 1 -- 172.21.15.146:0/664678412 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb1c0232f0 con 0x7fbb2809ef80 2023-10-03T10:14:42.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.726+0000 7f18ddffb700 1 -- 172.21.15.146:0/319833911 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f18e001f020 con 0x7f18e8138040 2023-10-03T10:14:42.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.747+0000 7f24ccec7700 1 Processor -- start 2023-10-03T10:14:42.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.747+0000 7f24ccec7700 1 -- start start 2023-10-03T10:14:42.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.748+0000 7f24ccec7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24c80a1510 0x7f24c81351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.748+0000 7f24ccec7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c81356e0 0x7f24c8137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.748+0000 7f24ccec7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c80a1e70 con 0x7f24c80a0a30 2023-10-03T10:14:42.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.748+0000 7f24ccec7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c809a720 con 0x7f24c81356e0 2023-10-03T10:14:42.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.748+0000 7f24ccec7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24c809b300 con 0x7f24c80a1510 2023-10-03T10:14:42.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.748+0000 7f24c5d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24c80a1510 0x7f24c81351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.748+0000 7f24c5d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24c80a1510 0x7f24c81351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49224/0 (socket says 172.21.15.146:49224) 2023-10-03T10:14:42.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.748+0000 7f24c5d9b700 1 -- 172.21.15.146:0/195331766 learned_addr learned my addr 172.21.15.146:0/195331766 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:42.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.748+0000 7f24c6d9d700 1 --2- 172.21.15.146:0/195331766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c81356e0 0x7f24c8137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.748+0000 7f24c659c700 1 --1- 172.21.15.146:0/195331766 >> v1:172.21.15.146:6789/0 conn(0x7f24c80a0a30 0x7f24c80a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46558/0 (socket says 172.21.15.146:46558) 2023-10-03T10:14:42.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.748+0000 7f24c6d9d700 1 -- 172.21.15.146:0/195331766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24c80a1510 msgr2=0x7f24c81351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:42.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.748+0000 7f24c6d9d700 1 --2- 172.21.15.146:0/195331766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24c80a1510 0x7f24c81351a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.748+0000 7f24c6d9d700 1 -- 172.21.15.146:0/195331766 >> v1:172.21.15.146:6789/0 conn(0x7f24c80a0a30 legacy=0x7f24c80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.748+0000 7f24c6d9d700 1 -- 172.21.15.146:0/195331766 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c809abc0 con 0x7f24c81356e0 2023-10-03T10:14:42.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.748+0000 7f24c5d9b700 1 --2- 172.21.15.146:0/195331766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24c80a1510 0x7f24c81351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:42.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.749+0000 7f24c6d9d700 1 --2- 172.21.15.146:0/195331766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c81356e0 0x7f24c8137ac0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f24c0009dc0 tx=0x7f24c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e456e9a1fab12b2f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.749+0000 7f24c559a700 1 -- 172.21.15.146:0/195331766 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c000e070 con 0x7f24c81356e0 2023-10-03T10:14:42.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.749+0000 7f24c559a700 1 -- 172.21.15.146:0/195331766 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c000bb20 con 0x7f24c81356e0 2023-10-03T10:14:42.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.749+0000 7f24c559a700 1 -- 172.21.15.146:0/195331766 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0012430 con 0x7f24c81356e0 2023-10-03T10:14:42.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.749+0000 7f24ccec7700 1 -- 172.21.15.146:0/195331766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c81356e0 msgr2=0x7f24c8137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.749+0000 7f24ccec7700 1 --2- 172.21.15.146:0/195331766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c81356e0 0x7f24c8137ac0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f24c0009dc0 tx=0x7f24c000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:42.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.749+0000 7f24ccec7700 1 -- 172.21.15.146:0/195331766 shutdown_connections 2023-10-03T10:14:42.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.749+0000 7f24ccec7700 1 --2- 172.21.15.146:0/195331766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c81356e0 0x7f24c8137ac0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.749+0000 7f24ccec7700 1 --2- 172.21.15.146:0/195331766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24c80a1510 0x7f24c81351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.749+0000 7f24ccec7700 1 -- 172.21.15.146:0/195331766 >> 172.21.15.146:0/195331766 conn(0x7f24c80a2980 msgr2=0x7f24c80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.750+0000 7f24ccec7700 1 -- 172.21.15.146:0/195331766 shutdown_connections 2023-10-03T10:14:42.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.750+0000 7f24ccec7700 1 -- 172.21.15.146:0/195331766 wait complete. 2023-10-03T10:14:42.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.751+0000 7f24ccec7700 1 Processor -- start 2023-10-03T10:14:42.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.751+0000 7f24ccec7700 1 -- start start 2023-10-03T10:14:42.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.751+0000 7f24ccec7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24c80a0a30 0x7f24c81c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.751+0000 7f24ccec7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24c80a1510 0x7f24c81c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.751+0000 7f24ccec7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c81356e0 0x7f24c81c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.751+0000 7f24ccec7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c8130d90 con 0x7f24c80a0a30 2023-10-03T10:14:42.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.751+0000 7f24ccec7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c8130f70 con 0x7f24c81356e0 2023-10-03T10:14:42.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.751+0000 7f24ccec7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24c8139940 con 0x7f24c80a1510 2023-10-03T10:14:42.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.751+0000 7f24c659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24c80a0a30 0x7f24c81c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.751+0000 7f24c659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24c80a0a30 0x7f24c81c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37326/0 (socket says 172.21.15.146:37326) 2023-10-03T10:14:42.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.751+0000 7f24c659c700 1 -- 172.21.15.146:0/912006673 learned_addr learned my addr 172.21.15.146:0/912006673 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:42.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.751+0000 7f24c6d9d700 1 --2- 172.21.15.146:0/912006673 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c81356e0 0x7f24c81c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.751+0000 7f24c5d9b700 1 --2- 172.21.15.146:0/912006673 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24c80a1510 0x7f24c81c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.751+0000 7f24c659c700 1 -- 172.21.15.146:0/912006673 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24c80a1510 msgr2=0x7f24c81c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.751+0000 7f24c659c700 1 --2- 172.21.15.146:0/912006673 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24c80a1510 0x7f24c81c6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.752+0000 7f24c659c700 1 -- 172.21.15.146:0/912006673 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c81356e0 msgr2=0x7f24c81c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.752+0000 7f24c659c700 1 --2- 172.21.15.146:0/912006673 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c81356e0 0x7f24c81c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.752+0000 7f24c659c700 1 -- 172.21.15.146:0/912006673 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc009550 con 0x7f24c80a0a30 2023-10-03T10:14:42.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.752+0000 7f24c6d9d700 1 --2- 172.21.15.146:0/912006673 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c81356e0 0x7f24c81c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:42.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.752+0000 7f24c659c700 1 --2- 172.21.15.146:0/912006673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24c80a0a30 0x7f24c81c6100 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f24b800c4e0 tx=0x7f24b800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.752+0000 7f24b6ffd700 1 -- 172.21.15.146:0/912006673 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b80074e0 con 0x7f24c80a0a30 2023-10-03T10:14:42.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.752+0000 7f24b6ffd700 1 -- 172.21.15.146:0/912006673 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b8007640 con 0x7f24c80a0a30 2023-10-03T10:14:42.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.752+0000 7f24ccec7700 1 -- 172.21.15.146:0/912006673 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c0009a70 con 0x7f24c80a0a30 2023-10-03T10:14:42.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.752+0000 7f24b6ffd700 1 -- 172.21.15.146:0/912006673 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8005a70 con 0x7f24c80a0a30 2023-10-03T10:14:42.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.752+0000 7f24ccec7700 1 -- 172.21.15.146:0/912006673 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c812fb30 con 0x7f24c80a0a30 2023-10-03T10:14:42.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.753+0000 7f24b6ffd700 1 -- 172.21.15.146:0/912006673 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f24b8005bd0 con 0x7f24c80a0a30 2023-10-03T10:14:42.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.753+0000 7f24b6ffd700 1 -- 172.21.15.146:0/912006673 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f24b803e9f0 con 0x7f24c80a0a30 2023-10-03T10:14:42.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.753+0000 7f24ccec7700 1 -- 172.21.15.146:0/912006673 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c8131aa0 con 0x7f24c80a0a30 2023-10-03T10:14:42.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.758+0000 7f24b6ffd700 1 -- 172.21.15.146:0/912006673 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f24b8017080 con 0x7f24c80a0a30 2023-10-03T10:14:42.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.879+0000 7f4df5372700 1 -- 172.21.15.146:0/980340590 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4df004f2a0 con 0x7f4df01300a0 2023-10-03T10:14:42.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.879+0000 7f4dd77fe700 1 -- 172.21.15.146:0/980340590 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4de001b430 con 0x7f4df01300a0 2023-10-03T10:14:42.879 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:42.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.881+0000 7f4df5372700 1 -- 172.21.15.146:0/980340590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4df01300a0 msgr2=0x7f4df011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.881+0000 7f4df5372700 1 --2- 172.21.15.146:0/980340590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4df01300a0 0x7f4df011da40 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009c40 tx=0x7f4de0004750 comp rx=0 tx=0).stop 2023-10-03T10:14:42.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.881+0000 7f4df5372700 1 -- 172.21.15.146:0/980340590 shutdown_connections 2023-10-03T10:14:42.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.881+0000 7f4df5372700 1 --2- 172.21.15.146:0/980340590 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4df0133ad0 0x7f4df011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.881+0000 7f4df5372700 1 --2- 172.21.15.146:0/980340590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4df01300a0 0x7f4df011da40 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.881+0000 7f4df5372700 1 --2- 172.21.15.146:0/980340590 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4df01309f0 0x7f4df011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.881+0000 7f4df5372700 1 -- 172.21.15.146:0/980340590 >> 172.21.15.146:0/980340590 conn(0x7f4df0099c40 msgr2=0x7f4df012f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.881+0000 7f4df5372700 1 -- 172.21.15.146:0/980340590 shutdown_connections 2023-10-03T10:14:42.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.881+0000 7f4df5372700 1 -- 172.21.15.146:0/980340590 wait complete. 2023-10-03T10:14:42.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:42.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.916+0000 7fbb2e541700 1 -- 172.21.15.146:0/664678412 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbb2811aa00 con 0x7fbb2809ef80 2023-10-03T10:14:42.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.916+0000 7fbb24ff9700 1 -- 172.21.15.146:0/664678412 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbb1c021020 con 0x7fbb2809ef80 2023-10-03T10:14:42.916 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:42.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.918+0000 7fbb2e541700 1 -- 172.21.15.146:0/664678412 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb2809ef80 msgr2=0x7fbb281cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.918+0000 7fbb2e541700 1 --2- 172.21.15.146:0/664678412 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb2809ef80 0x7fbb281cd420 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c00e9b0 tx=0x7fbb1c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.918+0000 7fbb2e541700 1 -- 172.21.15.146:0/664678412 shutdown_connections 2023-10-03T10:14:42.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.918+0000 7fbb2e541700 1 --2- 172.21.15.146:0/664678412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2809f3b0 0x7fbb281cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.918+0000 7fbb2e541700 1 --2- 172.21.15.146:0/664678412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb2809a130 0x7fbb281ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.918+0000 7fbb2e541700 1 --2- 172.21.15.146:0/664678412 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb2809ef80 0x7fbb281cd420 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.918+0000 7fbb2e541700 1 -- 172.21.15.146:0/664678412 >> 172.21.15.146:0/664678412 conn(0x7fbb280a4430 msgr2=0x7fbb2809cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.918+0000 7fbb2e541700 1 -- 172.21.15.146:0/664678412 shutdown_connections 2023-10-03T10:14:42.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.918+0000 7fbb2e541700 1 -- 172.21.15.146:0/664678412 wait complete. 2023-10-03T10:14:42.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:42.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.936+0000 7f18ef684700 1 -- 172.21.15.146:0/319833911 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f18c8005590 con 0x7f18e8138040 2023-10-03T10:14:42.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.937+0000 7f18ddffb700 1 -- 172.21.15.146:0/319833911 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f18e0019320 con 0x7f18e8138040 2023-10-03T10:14:42.936 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:42.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.940+0000 7f18ef684700 1 -- 172.21.15.146:0/319833911 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18e8138040 msgr2=0x7f18e8126fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.940+0000 7f18ef684700 1 --2- 172.21.15.146:0/319833911 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18e8138040 0x7f18e8126fe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f18e00095e0 tx=0x7f18e0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.940+0000 7f18ef684700 1 -- 172.21.15.146:0/319833911 shutdown_connections 2023-10-03T10:14:42.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.940+0000 7f18ef684700 1 --2- 172.21.15.146:0/319833911 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f18e8138040 0x7f18e8126fe0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.940+0000 7f18ef684700 1 --2- 172.21.15.146:0/319833911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e80a08e0 0x7f18e8126560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.940+0000 7f18ef684700 1 --2- 172.21.15.146:0/319833911 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e80a1230 0x7f18e8126aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.940+0000 7f18ef684700 1 -- 172.21.15.146:0/319833911 >> 172.21.15.146:0/319833911 conn(0x7f18e80a2980 msgr2=0x7f18e809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.940+0000 7f18ef684700 1 -- 172.21.15.146:0/319833911 shutdown_connections 2023-10-03T10:14:42.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.940+0000 7f18ef684700 1 -- 172.21.15.146:0/319833911 wait complete. 2023-10-03T10:14:42.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:42.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.973+0000 7f24ccec7700 1 -- 172.21.15.146:0/912006673 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f24c804f2a0 con 0x7f24c80a0a30 2023-10-03T10:14:42.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.973+0000 7f24b6ffd700 1 -- 172.21.15.146:0/912006673 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f24b800f260 con 0x7f24c80a0a30 2023-10-03T10:14:42.973 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:42.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.975+0000 7f24ccec7700 1 -- 172.21.15.146:0/912006673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24c80a0a30 msgr2=0x7f24c81c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.975+0000 7f24ccec7700 1 --2- 172.21.15.146:0/912006673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24c80a0a30 0x7f24c81c6100 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f24b800c4e0 tx=0x7f24b800c7f0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.975+0000 7f24ccec7700 1 -- 172.21.15.146:0/912006673 shutdown_connections 2023-10-03T10:14:42.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.975+0000 7f24ccec7700 1 --2- 172.21.15.146:0/912006673 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24c81356e0 0x7f24c81c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.975+0000 7f24ccec7700 1 --2- 172.21.15.146:0/912006673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24c80a0a30 0x7f24c81c6100 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.975+0000 7f24ccec7700 1 --2- 172.21.15.146:0/912006673 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24c80a1510 0x7f24c81c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.975+0000 7f24ccec7700 1 -- 172.21.15.146:0/912006673 >> 172.21.15.146:0/912006673 conn(0x7f24c80a2980 msgr2=0x7f24c812e350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.975+0000 7f24ccec7700 1 -- 172.21.15.146:0/912006673 shutdown_connections 2023-10-03T10:14:42.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:42.975+0000 7f24ccec7700 1 -- 172.21.15.146:0/912006673 wait complete. 2023-10-03T10:14:42.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:43.894 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:43.931 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:43.957 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:43.987 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:44.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.035+0000 7f19bdda2700 1 Processor -- start 2023-10-03T10:14:44.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.035+0000 7f19bdda2700 1 -- start start 2023-10-03T10:14:44.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.035+0000 7f19bdda2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19b8131980 0x7f19b8131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.035+0000 7f19bdda2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19b809c790 0x7f19b8139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.035+0000 7f19bdda2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b80a1640 con 0x7f19b809bc70 2023-10-03T10:14:44.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.035+0000 7f19bdda2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b806eb30 con 0x7f19b809c790 2023-10-03T10:14:44.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.035+0000 7f19bdda2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80a22d0 con 0x7f19b8131980 2023-10-03T10:14:44.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.035+0000 7f19b77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19b8131980 0x7f19b8131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.035+0000 7f19b77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19b8131980 0x7f19b8131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49246/0 (socket says 172.21.15.146:49246) 2023-10-03T10:14:44.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.035+0000 7f19b77fe700 1 -- 172.21.15.146:0/1491052763 learned_addr learned my addr 172.21.15.146:0/1491052763 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:44.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.035+0000 7f19b7fff700 1 --2- 172.21.15.146:0/1491052763 >> v2:172.21.15.146:3300/0 conn(0x7f19b809c790 0x7f19b8139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.036+0000 7f19b77fe700 1 -- 172.21.15.146:0/1491052763 >> v2:172.21.15.146:3300/0 conn(0x7f19b809c790 msgr2=0x7f19b8139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:44.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.036+0000 7f19b77fe700 1 --2- 172.21.15.146:0/1491052763 >> v2:172.21.15.146:3300/0 conn(0x7f19b809c790 0x7f19b8139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.036+0000 7f19b77fe700 1 -- 172.21.15.146:0/1491052763 >> v1:172.21.15.146:6789/0 conn(0x7f19b809bc70 legacy=0x7f19b809c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.036+0000 7f19b77fe700 1 -- 172.21.15.146:0/1491052763 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b8131550 con 0x7f19b8131980 2023-10-03T10:14:44.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.036+0000 7f19b77fe700 1 --2- 172.21.15.146:0/1491052763 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19b8131980 0x7f19b8131d50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f19a8006fd0 tx=0x7f19a8009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4f8c3e63c2aad04 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.036+0000 7f19b67fc700 1 -- 172.21.15.146:0/1491052763 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a8005e30 con 0x7f19b8131980 2023-10-03T10:14:44.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.036+0000 7f19b67fc700 1 -- 172.21.15.146:0/1491052763 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a8004030 con 0x7f19b8131980 2023-10-03T10:14:44.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.036+0000 7f19b67fc700 1 -- 172.21.15.146:0/1491052763 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a80043e0 con 0x7f19b8131980 2023-10-03T10:14:44.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.037+0000 7f19bdda2700 1 -- 172.21.15.146:0/1491052763 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19b8131980 msgr2=0x7f19b8131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.037+0000 7f19bdda2700 1 --2- 172.21.15.146:0/1491052763 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19b8131980 0x7f19b8131d50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f19a8006fd0 tx=0x7f19a8009bd0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.037+0000 7f19bdda2700 1 -- 172.21.15.146:0/1491052763 shutdown_connections 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.037+0000 7f19bdda2700 1 --2- 172.21.15.146:0/1491052763 >> v2:172.21.15.146:3300/0 conn(0x7f19b809c790 0x7f19b8139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.037+0000 7f19bdda2700 1 --2- 172.21.15.146:0/1491052763 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19b8131980 0x7f19b8131d50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.037+0000 7f19bdda2700 1 -- 172.21.15.146:0/1491052763 >> 172.21.15.146:0/1491052763 conn(0x7f19b80a2980 msgr2=0x7f19b80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.037+0000 7f19bdda2700 1 -- 172.21.15.146:0/1491052763 shutdown_connections 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.037+0000 7f19bdda2700 1 -- 172.21.15.146:0/1491052763 wait complete. 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.038+0000 7f19bdda2700 1 Processor -- start 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.038+0000 7f19bdda2700 1 -- start start 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.039+0000 7f19bdda2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b809bc70 0x7f19b811b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.039+0000 7f19bdda2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19b809c790 0x7f19b811bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.039+0000 7f19bdda2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19b8131980 0x7f19b811c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.039+0000 7f19bdda2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b811ce70 con 0x7f19b809bc70 2023-10-03T10:14:44.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.039+0000 7f19bdda2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b812ed90 con 0x7f19b809c790 2023-10-03T10:14:44.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.039+0000 7f19bdda2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19b811dbd0 con 0x7f19b8131980 2023-10-03T10:14:44.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.039+0000 7f19b7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19b8131980 0x7f19b811c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.039+0000 7f19b7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19b8131980 0x7f19b811c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49252/0 (socket says 172.21.15.146:49252) 2023-10-03T10:14:44.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.039+0000 7f19b7fff700 1 -- 172.21.15.146:0/1907966152 learned_addr learned my addr 172.21.15.146:0/1907966152 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:44.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.039+0000 7f19b6ffd700 1 --2- 172.21.15.146:0/1907966152 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19b809c790 0x7f19b811bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.039+0000 7f19b77fe700 1 --2- 172.21.15.146:0/1907966152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b809bc70 0x7f19b811b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.039+0000 7f19b7fff700 1 -- 172.21.15.146:0/1907966152 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19b809c790 msgr2=0x7f19b811bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.039+0000 7f19b7fff700 1 --2- 172.21.15.146:0/1907966152 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19b809c790 0x7f19b811bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.039+0000 7f19b7fff700 1 -- 172.21.15.146:0/1907966152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b809bc70 msgr2=0x7f19b811b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.039+0000 7f19b7fff700 1 --2- 172.21.15.146:0/1907966152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b809bc70 0x7f19b811b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.039+0000 7f19b7fff700 1 -- 172.21.15.146:0/1907966152 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a8009500 con 0x7f19b8131980 2023-10-03T10:14:44.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.039+0000 7f19b7fff700 1 --2- 172.21.15.146:0/1907966152 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19b8131980 0x7f19b811c420 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f19b0007360 tx=0x7f19b0007670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.040+0000 7f199ffff700 1 -- 172.21.15.146:0/1907966152 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b0012360 con 0x7f19b8131980 2023-10-03T10:14:44.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.040+0000 7f199ffff700 1 -- 172.21.15.146:0/1907966152 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b000f070 con 0x7f19b8131980 2023-10-03T10:14:44.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.040+0000 7f19bdda2700 1 -- 172.21.15.146:0/1907966152 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b811e800 con 0x7f19b8131980 2023-10-03T10:14:44.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.040+0000 7f199ffff700 1 -- 172.21.15.146:0/1907966152 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b0011560 con 0x7f19b8131980 2023-10-03T10:14:44.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.040+0000 7f19bdda2700 1 -- 172.21.15.146:0/1907966152 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b80a1c40 con 0x7f19b8131980 2023-10-03T10:14:44.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.041+0000 7f199ffff700 1 -- 172.21.15.146:0/1907966152 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19b00116c0 con 0x7f19b8131980 2023-10-03T10:14:44.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.041+0000 7f19bdda2700 1 -- 172.21.15.146:0/1907966152 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b804f2a0 con 0x7f19b8131980 2023-10-03T10:14:44.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.041+0000 7f199ffff700 1 -- 172.21.15.146:0/1907966152 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f19b0010620 con 0x7f19b8131980 2023-10-03T10:14:44.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.046+0000 7f199ffff700 1 -- 172.21.15.146:0/1907966152 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19b0010440 con 0x7f19b8131980 2023-10-03T10:14:44.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.072+0000 7f577f72c700 1 Processor -- start 2023-10-03T10:14:44.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.072+0000 7f577f72c700 1 -- start start 2023-10-03T10:14:44.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.073+0000 7f577f72c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f577809d860 0x7f577809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.073+0000 7f577f72c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5778130eb0 0x7f5778138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.073+0000 7f577f72c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f577809aaa0 con 0x7f577809e170 2023-10-03T10:14:44.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.073+0000 7f577f72c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577809f870 con 0x7f577809d860 2023-10-03T10:14:44.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.073+0000 7f577f72c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f577809b360 con 0x7f5778130eb0 2023-10-03T10:14:44.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.073+0000 7f577d4c8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f577809d860 0x7f577809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.073+0000 7f577d4c8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f577809d860 0x7f577809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45380/0 (socket says 172.21.15.146:45380) 2023-10-03T10:14:44.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.073+0000 7f577d4c8700 1 -- 172.21.15.146:0/1965359110 learned_addr learned my addr 172.21.15.146:0/1965359110 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:44.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.073+0000 7f577dcc9700 1 --2- 172.21.15.146:0/1965359110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5778130eb0 0x7f5778138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.073+0000 7f576ffff700 1 -- 172.21.15.146:0/1965359110 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2902874966 0 0) 0x7f577809aaa0 con 0x7f577809e170 2023-10-03T10:14:44.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.073+0000 7f576ffff700 1 -- 172.21.15.146:0/1965359110 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57640035b0 con 0x7f577809e170 2023-10-03T10:14:44.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.073+0000 7f577d4c8700 1 -- 172.21.15.146:0/1965359110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5778130eb0 msgr2=0x7f5778138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:44.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.073+0000 7f577d4c8700 1 --2- 172.21.15.146:0/1965359110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5778130eb0 0x7f5778138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.073+0000 7f577d4c8700 1 -- 172.21.15.146:0/1965359110 >> v1:172.21.15.146:6789/0 conn(0x7f577809e170 legacy=0x7f57781307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.073+0000 7f577d4c8700 1 -- 172.21.15.146:0/1965359110 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577809b620 con 0x7f577809d860 2023-10-03T10:14:44.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.074+0000 7f577dcc9700 1 --2- 172.21.15.146:0/1965359110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5778130eb0 0x7f5778138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.074+0000 7f577d4c8700 1 --2- 172.21.15.146:0/1965359110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f577809d860 0x7f577809dc30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5774009920 tx=0x7f5774009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c99636f2a38d58dd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.074+0000 7f576ffff700 1 -- 172.21.15.146:0/1965359110 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774011830 con 0x7f577809d860 2023-10-03T10:14:44.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.074+0000 7f576ffff700 1 -- 172.21.15.146:0/1965359110 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5774011990 con 0x7f577809d860 2023-10-03T10:14:44.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.074+0000 7f576ffff700 1 -- 172.21.15.146:0/1965359110 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774011d20 con 0x7f577809d860 2023-10-03T10:14:44.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.075+0000 7f577f72c700 1 -- 172.21.15.146:0/1965359110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f577809d860 msgr2=0x7f577809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.075+0000 7f577f72c700 1 --2- 172.21.15.146:0/1965359110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f577809d860 0x7f577809dc30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5774009920 tx=0x7f5774009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:44.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.075+0000 7f577f72c700 1 -- 172.21.15.146:0/1965359110 shutdown_connections 2023-10-03T10:14:44.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.075+0000 7f577f72c700 1 --2- 172.21.15.146:0/1965359110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5778130eb0 0x7f5778138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.075+0000 7f577f72c700 1 --2- 172.21.15.146:0/1965359110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f577809d860 0x7f577809dc30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.075+0000 7f577f72c700 1 -- 172.21.15.146:0/1965359110 >> 172.21.15.146:0/1965359110 conn(0x7f5778099c40 msgr2=0x7f57780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.075+0000 7f577f72c700 1 -- 172.21.15.146:0/1965359110 shutdown_connections 2023-10-03T10:14:44.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.075+0000 7f577f72c700 1 -- 172.21.15.146:0/1965359110 wait complete. 2023-10-03T10:14:44.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.076+0000 7f577f72c700 1 Processor -- start 2023-10-03T10:14:44.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.076+0000 7f577f72c700 1 -- start start 2023-10-03T10:14:44.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.076+0000 7f577f72c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f577809d860 0x7f57781c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.076+0000 7f577f72c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f577809e170 0x7f57781c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.076+0000 7f577f72c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5778130eb0 0x7f5778122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.076+0000 7f577f72c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5778124360 con 0x7f5778130eb0 2023-10-03T10:14:44.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.076+0000 7f577f72c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57780a2020 con 0x7f577809e170 2023-10-03T10:14:44.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.076+0000 7f577f72c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5778126490 con 0x7f577809d860 2023-10-03T10:14:44.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.076+0000 7f577ccc7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f577809e170 0x7f57781c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.076+0000 7f577ccc7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f577809e170 0x7f57781c8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45390/0 (socket says 172.21.15.146:45390) 2023-10-03T10:14:44.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.076+0000 7f577ccc7700 1 -- 172.21.15.146:0/2735202222 learned_addr learned my addr 172.21.15.146:0/2735202222 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:44.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.077+0000 7f577dcc9700 1 --2- 172.21.15.146:0/2735202222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5778130eb0 0x7f5778122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.077+0000 7f577d4c8700 1 --2- 172.21.15.146:0/2735202222 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f577809d860 0x7f57781c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.077+0000 7f577ccc7700 1 -- 172.21.15.146:0/2735202222 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f577809d860 msgr2=0x7f57781c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.077+0000 7f577ccc7700 1 --2- 172.21.15.146:0/2735202222 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f577809d860 0x7f57781c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.077+0000 7f577ccc7700 1 -- 172.21.15.146:0/2735202222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5778130eb0 msgr2=0x7f5778122750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.077+0000 7f577ccc7700 1 --2- 172.21.15.146:0/2735202222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5778130eb0 0x7f5778122750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.077+0000 7f577ccc7700 1 -- 172.21.15.146:0/2735202222 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577000bc80 con 0x7f577809e170 2023-10-03T10:14:44.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.077+0000 7f577ccc7700 1 --2- 172.21.15.146:0/2735202222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f577809e170 0x7f57781c8a80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f576800c4f0 tx=0x7f576800c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.077+0000 7f576dffb700 1 -- 172.21.15.146:0/2735202222 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57680052d0 con 0x7f577809e170 2023-10-03T10:14:44.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.077+0000 7f576dffb700 1 -- 172.21.15.146:0/2735202222 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5768005430 con 0x7f577809e170 2023-10-03T10:14:44.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.077+0000 7f576dffb700 1 -- 172.21.15.146:0/2735202222 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768003880 con 0x7f577809e170 2023-10-03T10:14:44.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.078+0000 7f577f72c700 1 -- 172.21.15.146:0/2735202222 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5774009550 con 0x7f577809e170 2023-10-03T10:14:44.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.078+0000 7f577f72c700 1 -- 172.21.15.146:0/2735202222 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5778124910 con 0x7f577809e170 2023-10-03T10:14:44.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.079+0000 7f576dffb700 1 -- 172.21.15.146:0/2735202222 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f57680039e0 con 0x7f577809e170 2023-10-03T10:14:44.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.079+0000 7f577f72c700 1 -- 172.21.15.146:0/2735202222 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577809c8b0 con 0x7f577809e170 2023-10-03T10:14:44.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.079+0000 7f576dffb700 1 -- 172.21.15.146:0/2735202222 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f576803ec30 con 0x7f577809e170 2023-10-03T10:14:44.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.089+0000 7f576dffb700 1 -- 172.21.15.146:0/2735202222 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5768019710 con 0x7f577809e170 2023-10-03T10:14:44.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.116+0000 7f6b873a2700 1 Processor -- start 2023-10-03T10:14:44.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.117+0000 7f6b873a2700 1 -- start start 2023-10-03T10:14:44.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.117+0000 7f6b873a2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b8009e340 0x7f6b801359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.117+0000 7f6b873a2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6b80135f20 0x7f6b80138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.117+0000 7f6b873a2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b8009aaa0 con 0x7f6b8009d860 2023-10-03T10:14:44.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.117+0000 7f6b873a2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8009e730 con 0x7f6b80135f20 2023-10-03T10:14:44.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.117+0000 7f6b873a2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8009f870 con 0x7f6b8009e340 2023-10-03T10:14:44.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.118+0000 7f6b8493d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b8009e340 0x7f6b801359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.118+0000 7f6b8493d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b8009e340 0x7f6b801359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45396/0 (socket says 172.21.15.146:45396) 2023-10-03T10:14:44.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.118+0000 7f6b8513e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6b8009d860 0x7f6b8009dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46582/0 (socket says 172.21.15.146:46582) 2023-10-03T10:14:44.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.118+0000 7f6b8493d700 1 -- 172.21.15.146:0/2808164839 learned_addr learned my addr 172.21.15.146:0/2808164839 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:44.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.118+0000 7f6b8593f700 1 --2- 172.21.15.146:0/2808164839 >> v2:172.21.15.146:3300/0 conn(0x7f6b80135f20 0x7f6b80138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.118+0000 7f6b77fff700 1 -- 172.21.15.146:0/2808164839 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437380798 0 0) 0x7f6b8009aaa0 con 0x7f6b8009d860 2023-10-03T10:14:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.118+0000 7f6b77fff700 1 -- 172.21.15.146:0/2808164839 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b6c0035b0 con 0x7f6b8009d860 2023-10-03T10:14:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.118+0000 7f6b8493d700 1 -- 172.21.15.146:0/2808164839 >> v2:172.21.15.146:3300/0 conn(0x7f6b80135f20 msgr2=0x7f6b80138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.118+0000 7f6b8493d700 1 --2- 172.21.15.146:0/2808164839 >> v2:172.21.15.146:3300/0 conn(0x7f6b80135f20 0x7f6b80138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.118+0000 7f6b8493d700 1 -- 172.21.15.146:0/2808164839 >> v1:172.21.15.146:6789/0 conn(0x7f6b8009d860 legacy=0x7f6b8009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.118+0000 7f6b8493d700 1 -- 172.21.15.146:0/2808164839 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8009b360 con 0x7f6b8009e340 2023-10-03T10:14:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.118+0000 7f6b8493d700 1 --2- 172.21.15.146:0/2808164839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b8009e340 0x7f6b801359e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6b700098f0 tx=0x7f6b70009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f8892b2e08e5f84 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.118+0000 7f6b77fff700 1 -- 172.21.15.146:0/2808164839 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70004230 con 0x7f6b8009e340 2023-10-03T10:14:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.118+0000 7f6b77fff700 1 -- 172.21.15.146:0/2808164839 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b70004390 con 0x7f6b8009e340 2023-10-03T10:14:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.118+0000 7f6b77fff700 1 -- 172.21.15.146:0/2808164839 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b700036a0 con 0x7f6b8009e340 2023-10-03T10:14:44.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.119+0000 7f6b873a2700 1 -- 172.21.15.146:0/2808164839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b8009e340 msgr2=0x7f6b801359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.119+0000 7f6b873a2700 1 --2- 172.21.15.146:0/2808164839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b8009e340 0x7f6b801359e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6b700098f0 tx=0x7f6b70009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:44.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.119+0000 7f6b873a2700 1 -- 172.21.15.146:0/2808164839 shutdown_connections 2023-10-03T10:14:44.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.119+0000 7f6b873a2700 1 --2- 172.21.15.146:0/2808164839 >> v2:172.21.15.146:3300/0 conn(0x7f6b80135f20 0x7f6b80138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.119+0000 7f6b873a2700 1 --2- 172.21.15.146:0/2808164839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b8009e340 0x7f6b801359e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.119+0000 7f6b873a2700 1 -- 172.21.15.146:0/2808164839 >> 172.21.15.146:0/2808164839 conn(0x7f6b80099c40 msgr2=0x7f6b800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.120+0000 7f6b873a2700 1 -- 172.21.15.146:0/2808164839 shutdown_connections 2023-10-03T10:14:44.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.120+0000 7f6b873a2700 1 -- 172.21.15.146:0/2808164839 wait complete. 2023-10-03T10:14:44.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.121+0000 7f6b873a2700 1 Processor -- start 2023-10-03T10:14:44.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.121+0000 7f6b873a2700 1 -- start start 2023-10-03T10:14:44.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.122+0000 7f6b873a2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b8009d860 0x7f6b8011bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.122+0000 7f6b873a2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b8009e340 0x7f6b8011c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.122+0000 7f6b873a2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b80135f20 0x7f6b801c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.122+0000 7f6b873a2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8011ecc0 con 0x7f6b8009e340 2023-10-03T10:14:44.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.122+0000 7f6b873a2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8011f1e0 con 0x7f6b80135f20 2023-10-03T10:14:44.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.122+0000 7f6b873a2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8011b9a0 con 0x7f6b8009d860 2023-10-03T10:14:44.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.122+0000 7f6b8593f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b80135f20 0x7f6b801c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.122+0000 7f6b8593f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b80135f20 0x7f6b801c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45398/0 (socket says 172.21.15.146:45398) 2023-10-03T10:14:44.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.122+0000 7f6b8593f700 1 -- 172.21.15.146:0/3088399247 learned_addr learned my addr 172.21.15.146:0/3088399247 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:44.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.122+0000 7f6b8493d700 1 --2- 172.21.15.146:0/3088399247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b8009e340 0x7f6b8011c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.122+0000 7f6b8513e700 1 --2- 172.21.15.146:0/3088399247 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b8009d860 0x7f6b8011bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.122+0000 7f6b8493d700 1 -- 172.21.15.146:0/3088399247 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b8009d860 msgr2=0x7f6b8011bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.122+0000 7f6b8493d700 1 --2- 172.21.15.146:0/3088399247 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b8009d860 0x7f6b8011bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.122+0000 7f6b8493d700 1 -- 172.21.15.146:0/3088399247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b80135f20 msgr2=0x7f6b801c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.122+0000 7f6b8493d700 1 --2- 172.21.15.146:0/3088399247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b80135f20 0x7f6b801c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.122+0000 7f6b8493d700 1 -- 172.21.15.146:0/3088399247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b70009550 con 0x7f6b8009e340 2023-10-03T10:14:44.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.123+0000 7f6b8493d700 1 --2- 172.21.15.146:0/3088399247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b8009e340 0x7f6b8011c2d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6b70015000 tx=0x7f6b70004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.123+0000 7f6b75ffb700 1 -- 172.21.15.146:0/3088399247 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70003ae0 con 0x7f6b8009e340 2023-10-03T10:14:44.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.123+0000 7f6b75ffb700 1 -- 172.21.15.146:0/3088399247 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b70003c60 con 0x7f6b8009e340 2023-10-03T10:14:44.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.123+0000 7f6b75ffb700 1 -- 172.21.15.146:0/3088399247 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70011630 con 0x7f6b8009e340 2023-10-03T10:14:44.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.123+0000 7f6b873a2700 1 -- 172.21.15.146:0/3088399247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b800a2680 con 0x7f6b8009e340 2023-10-03T10:14:44.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.123+0000 7f6b873a2700 1 -- 172.21.15.146:0/3088399247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b8011d090 con 0x7f6b8009e340 2023-10-03T10:14:44.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.124+0000 7f6b75ffb700 1 -- 172.21.15.146:0/3088399247 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b70021070 con 0x7f6b8009e340 2023-10-03T10:14:44.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.124+0000 7f6b75ffb700 1 -- 172.21.15.146:0/3088399247 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6b70040af0 con 0x7f6b8009e340 2023-10-03T10:14:44.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.124+0000 7f6b873a2700 1 -- 172.21.15.146:0/3088399247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b8011ee00 con 0x7f6b8009e340 2023-10-03T10:14:44.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.129+0000 7f6b75ffb700 1 -- 172.21.15.146:0/3088399247 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b8011ee00 con 0x7f6b8009e340 2023-10-03T10:14:44.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.160+0000 7f6206384700 1 Processor -- start 2023-10-03T10:14:44.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.160+0000 7f6206384700 1 -- start start 2023-10-03T10:14:44.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.161+0000 7f6206384700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f620009f430 0x7f6200136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.161+0000 7f6206384700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6200137010 0x7f62001393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.161+0000 7f6206384700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f620009b6d0 con 0x7f620009e950 2023-10-03T10:14:44.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.161+0000 7f6206384700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f620009afb0 con 0x7f6200137010 2023-10-03T10:14:44.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.161+0000 7f6206384700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62000a0970 con 0x7f620009f430 2023-10-03T10:14:44.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.161+0000 7f61ff7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f620009f430 0x7f6200136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.161+0000 7f61ff7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f620009f430 0x7f6200136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49282/0 (socket says 172.21.15.146:49282) 2023-10-03T10:14:44.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.161+0000 7f61ff7fe700 1 -- 172.21.15.146:0/845766864 learned_addr learned my addr 172.21.15.146:0/845766864 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:44.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.161+0000 7f6204921700 1 --2- 172.21.15.146:0/845766864 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6200137010 0x7f62001393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.161+0000 7f61feffd700 1 -- 172.21.15.146:0/845766864 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13581289 0 0) 0x7f620009b6d0 con 0x7f620009e950 2023-10-03T10:14:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.161+0000 7f61feffd700 1 -- 172.21.15.146:0/845766864 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61e80035b0 con 0x7f620009e950 2023-10-03T10:14:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.161+0000 7f61ff7fe700 1 -- 172.21.15.146:0/845766864 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6200137010 msgr2=0x7f62001393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.161+0000 7f61ff7fe700 1 --2- 172.21.15.146:0/845766864 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6200137010 0x7f62001393f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.161+0000 7f61ff7fe700 1 -- 172.21.15.146:0/845766864 >> v1:172.21.15.146:6789/0 conn(0x7f620009e950 legacy=0x7f620009ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.161+0000 7f61ff7fe700 1 -- 172.21.15.146:0/845766864 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62000a0320 con 0x7f620009f430 2023-10-03T10:14:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.162+0000 7f61ff7fe700 1 --2- 172.21.15.146:0/845766864 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f620009f430 0x7f6200136ad0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009950 tx=0x7f61f4009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1fd7c44c9df8be server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.162+0000 7f61feffd700 1 -- 172.21.15.146:0/845766864 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f4011830 con 0x7f620009f430 2023-10-03T10:14:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.162+0000 7f61feffd700 1 -- 172.21.15.146:0/845766864 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f4011990 con 0x7f620009f430 2023-10-03T10:14:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.162+0000 7f61feffd700 1 -- 172.21.15.146:0/845766864 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f4011d40 con 0x7f620009f430 2023-10-03T10:14:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.163+0000 7f6206384700 1 -- 172.21.15.146:0/845766864 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f620009f430 msgr2=0x7f6200136ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.163+0000 7f6206384700 1 --2- 172.21.15.146:0/845766864 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f620009f430 0x7f6200136ad0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009950 tx=0x7f61f4009c60 comp rx=0 tx=0).stop 2023-10-03T10:14:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.163+0000 7f6206384700 1 -- 172.21.15.146:0/845766864 shutdown_connections 2023-10-03T10:14:44.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.163+0000 7f6206384700 1 --2- 172.21.15.146:0/845766864 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6200137010 0x7f62001393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.163+0000 7f6206384700 1 --2- 172.21.15.146:0/845766864 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f620009f430 0x7f6200136ad0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.163+0000 7f6206384700 1 -- 172.21.15.146:0/845766864 >> 172.21.15.146:0/845766864 conn(0x7f62000a0f70 msgr2=0x7f62000a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.163+0000 7f6206384700 1 -- 172.21.15.146:0/845766864 shutdown_connections 2023-10-03T10:14:44.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.163+0000 7f6206384700 1 -- 172.21.15.146:0/845766864 wait complete. 2023-10-03T10:14:44.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.164+0000 7f6206384700 1 Processor -- start 2023-10-03T10:14:44.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.164+0000 7f6206384700 1 -- start start 2023-10-03T10:14:44.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.164+0000 7f6206384700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f620009e950 0x7f62001278f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.164+0000 7f6206384700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f620009f430 0x7f6200127e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.164+0000 7f6206384700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6200137010 0x7f62001cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.164+0000 7f6206384700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620009da40 con 0x7f620009f430 2023-10-03T10:14:44.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.164+0000 7f6206384700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62000a4660 con 0x7f620009e950 2023-10-03T10:14:44.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.164+0000 7f6206384700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f620012aa90 con 0x7f6200137010 2023-10-03T10:14:44.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.164+0000 7f6204921700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6200137010 0x7f62001cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.164+0000 7f6204921700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6200137010 0x7f62001cc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49290/0 (socket says 172.21.15.146:49290) 2023-10-03T10:14:44.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.164+0000 7f6204921700 1 -- 172.21.15.146:0/4239465478 learned_addr learned my addr 172.21.15.146:0/4239465478 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:44.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.165+0000 7f61ff7fe700 1 --2- 172.21.15.146:0/4239465478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f620009f430 0x7f6200127e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.165+0000 7f61fffff700 1 --2- 172.21.15.146:0/4239465478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f620009e950 0x7f62001278f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.165+0000 7f6204921700 1 -- 172.21.15.146:0/4239465478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f620009e950 msgr2=0x7f62001278f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.165+0000 7f6204921700 1 --2- 172.21.15.146:0/4239465478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f620009e950 0x7f62001278f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.165+0000 7f6204921700 1 -- 172.21.15.146:0/4239465478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f620009f430 msgr2=0x7f6200127e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.165+0000 7f6204921700 1 --2- 172.21.15.146:0/4239465478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f620009f430 0x7f6200127e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.165+0000 7f6204921700 1 -- 172.21.15.146:0/4239465478 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f4009550 con 0x7f6200137010 2023-10-03T10:14:44.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.165+0000 7f61fffff700 1 --2- 172.21.15.146:0/4239465478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f620009e950 0x7f62001278f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.165+0000 7f6204921700 1 --2- 172.21.15.146:0/4239465478 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6200137010 0x7f62001cc470 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f61f800ef90 tx=0x7f61f800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.165+0000 7f61fcff9700 1 -- 172.21.15.146:0/4239465478 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f800cc90 con 0x7f6200137010 2023-10-03T10:14:44.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.165+0000 7f61fcff9700 1 -- 172.21.15.146:0/4239465478 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f800f040 con 0x7f6200137010 2023-10-03T10:14:44.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.165+0000 7f61fcff9700 1 -- 172.21.15.146:0/4239465478 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f8014480 con 0x7f6200137010 2023-10-03T10:14:44.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.165+0000 7f6206384700 1 -- 172.21.15.146:0/4239465478 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f620012b560 con 0x7f6200137010 2023-10-03T10:14:44.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.166+0000 7f6206384700 1 -- 172.21.15.146:0/4239465478 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62001296c0 con 0x7f6200137010 2023-10-03T10:14:44.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.167+0000 7f6206384700 1 -- 172.21.15.146:0/4239465478 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f620004f2a0 con 0x7f6200137010 2023-10-03T10:14:44.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.167+0000 7f61fcff9700 1 -- 172.21.15.146:0/4239465478 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f61f80145e0 con 0x7f6200137010 2023-10-03T10:14:44.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.167+0000 7f61fcff9700 1 -- 172.21.15.146:0/4239465478 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f61f80402d0 con 0x7f6200137010 2023-10-03T10:14:44.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.176+0000 7f61fcff9700 1 -- 172.21.15.146:0/4239465478 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61f8007920 con 0x7f6200137010 2023-10-03T10:14:44.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.253+0000 7f19bdda2700 1 -- 172.21.15.146:0/1907966152 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f19b8132270 con 0x7f19b8131980 2023-10-03T10:14:44.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.253+0000 7f199ffff700 1 -- 172.21.15.146:0/1907966152 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f19b8132270 con 0x7f19b8131980 2023-10-03T10:14:44.253 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:44.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.255+0000 7f19bdda2700 1 -- 172.21.15.146:0/1907966152 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19b8131980 msgr2=0x7f19b811c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.255+0000 7f19bdda2700 1 --2- 172.21.15.146:0/1907966152 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19b8131980 0x7f19b811c420 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f19b0007360 tx=0x7f19b0007670 comp rx=0 tx=0).stop 2023-10-03T10:14:44.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.255+0000 7f19bdda2700 1 -- 172.21.15.146:0/1907966152 shutdown_connections 2023-10-03T10:14:44.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.256+0000 7f19bdda2700 1 --2- 172.21.15.146:0/1907966152 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19b8131980 0x7f19b811c420 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.256+0000 7f19bdda2700 1 --2- 172.21.15.146:0/1907966152 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19b809bc70 0x7f19b811b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.256+0000 7f19bdda2700 1 --2- 172.21.15.146:0/1907966152 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19b809c790 0x7f19b811bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.256+0000 7f19bdda2700 1 -- 172.21.15.146:0/1907966152 >> 172.21.15.146:0/1907966152 conn(0x7f19b80a2980 msgr2=0x7f19b8071680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.256+0000 7f19bdda2700 1 -- 172.21.15.146:0/1907966152 shutdown_connections 2023-10-03T10:14:44.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.256+0000 7f19bdda2700 1 -- 172.21.15.146:0/1907966152 wait complete. 2023-10-03T10:14:44.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:44.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.290+0000 7f577f72c700 1 -- 172.21.15.146:0/2735202222 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5778125d90 con 0x7f577809e170 2023-10-03T10:14:44.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.290+0000 7f576dffb700 1 -- 172.21.15.146:0/2735202222 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5768017070 con 0x7f577809e170 2023-10-03T10:14:44.290 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:44.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.292+0000 7f577f72c700 1 -- 172.21.15.146:0/2735202222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f577809e170 msgr2=0x7f57781c8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.293+0000 7f577f72c700 1 --2- 172.21.15.146:0/2735202222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f577809e170 0x7f57781c8a80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f576800c4f0 tx=0x7f576800c800 comp rx=0 tx=0).stop 2023-10-03T10:14:44.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.293+0000 7f577f72c700 1 -- 172.21.15.146:0/2735202222 shutdown_connections 2023-10-03T10:14:44.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.293+0000 7f577f72c700 1 --2- 172.21.15.146:0/2735202222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5778130eb0 0x7f5778122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.293+0000 7f577f72c700 1 --2- 172.21.15.146:0/2735202222 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f577809d860 0x7f57781c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.293+0000 7f577f72c700 1 --2- 172.21.15.146:0/2735202222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f577809e170 0x7f57781c8a80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.293+0000 7f577f72c700 1 -- 172.21.15.146:0/2735202222 >> 172.21.15.146:0/2735202222 conn(0x7f5778099c40 msgr2=0x7f57780a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.293+0000 7f577f72c700 1 -- 172.21.15.146:0/2735202222 shutdown_connections 2023-10-03T10:14:44.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.293+0000 7f577f72c700 1 -- 172.21.15.146:0/2735202222 wait complete. 2023-10-03T10:14:44.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:44.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.333+0000 7f6b873a2700 1 -- 172.21.15.146:0/3088399247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6b8011ee00 con 0x7f6b8009e340 2023-10-03T10:14:44.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.333+0000 7f6b75ffb700 1 -- 172.21.15.146:0/3088399247 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b8011ee00 con 0x7f6b8009e340 2023-10-03T10:14:44.333 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:44.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.335+0000 7f6b873a2700 1 -- 172.21.15.146:0/3088399247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b8009e340 msgr2=0x7f6b8011c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.335+0000 7f6b873a2700 1 --2- 172.21.15.146:0/3088399247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b8009e340 0x7f6b8011c2d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6b70015000 tx=0x7f6b70004750 comp rx=0 tx=0).stop 2023-10-03T10:14:44.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.335+0000 7f6b873a2700 1 -- 172.21.15.146:0/3088399247 shutdown_connections 2023-10-03T10:14:44.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.335+0000 7f6b873a2700 1 --2- 172.21.15.146:0/3088399247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b80135f20 0x7f6b801c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.335+0000 7f6b873a2700 1 --2- 172.21.15.146:0/3088399247 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b8009d860 0x7f6b8011bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.335+0000 7f6b873a2700 1 --2- 172.21.15.146:0/3088399247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b8009e340 0x7f6b8011c2d0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.335+0000 7f6b873a2700 1 -- 172.21.15.146:0/3088399247 >> 172.21.15.146:0/3088399247 conn(0x7f6b80099c40 msgr2=0x7f6b80136ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.335+0000 7f6b873a2700 1 -- 172.21.15.146:0/3088399247 shutdown_connections 2023-10-03T10:14:44.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.335+0000 7f6b873a2700 1 -- 172.21.15.146:0/3088399247 wait complete. 2023-10-03T10:14:44.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:44.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.374+0000 7f6206384700 1 -- 172.21.15.146:0/4239465478 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f620009b8b0 con 0x7f6200137010 2023-10-03T10:14:44.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.374+0000 7f61fcff9700 1 -- 172.21.15.146:0/4239465478 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f61f8018020 con 0x7f6200137010 2023-10-03T10:14:44.374 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:44.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.377+0000 7f6206384700 1 -- 172.21.15.146:0/4239465478 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6200137010 msgr2=0x7f62001cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.377+0000 7f6206384700 1 --2- 172.21.15.146:0/4239465478 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6200137010 0x7f62001cc470 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f61f800ef90 tx=0x7f61f800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.377+0000 7f6206384700 1 -- 172.21.15.146:0/4239465478 shutdown_connections 2023-10-03T10:14:44.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.377+0000 7f6206384700 1 --2- 172.21.15.146:0/4239465478 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6200137010 0x7f62001cc470 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.377+0000 7f6206384700 1 --2- 172.21.15.146:0/4239465478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f620009e950 0x7f62001278f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.377+0000 7f6206384700 1 --2- 172.21.15.146:0/4239465478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f620009f430 0x7f6200127e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.377+0000 7f6206384700 1 -- 172.21.15.146:0/4239465478 >> 172.21.15.146:0/4239465478 conn(0x7f62000a0f70 msgr2=0x7f62000a2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.377+0000 7f6206384700 1 -- 172.21.15.146:0/4239465478 shutdown_connections 2023-10-03T10:14:44.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:44.377+0000 7f6206384700 1 -- 172.21.15.146:0/4239465478 wait complete. 2023-10-03T10:14:44.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:45.269 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:45.305 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:45.348 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:45.389 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:45.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.412+0000 7fe022a97700 1 Processor -- start 2023-10-03T10:14:45.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.412+0000 7fe022a97700 1 -- start start 2023-10-03T10:14:45.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.413+0000 7fe022a97700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01c131980 0x7fe01c131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.413+0000 7fe022a97700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe01c09bc70 0x7fe01c09c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.413+0000 7fe022a97700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01c09c5c0 0x7fe01c138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.413+0000 7fe022a97700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01c06eb30 con 0x7fe01c09bc70 2023-10-03T10:14:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.413+0000 7fe022a97700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c0a1640 con 0x7fe01c131980 2023-10-03T10:14:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.413+0000 7fe022a97700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c0a22d0 con 0x7fe01c09c5c0 2023-10-03T10:14:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.413+0000 7fe020833700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01c131980 0x7fe01c131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.413+0000 7fe020833700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01c131980 0x7fe01c131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:54042/0 (socket says 172.21.15.146:54042) 2023-10-03T10:14:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.413+0000 7fe020833700 1 -- 172.21.15.146:0/1691625120 learned_addr learned my addr 172.21.15.146:0/1691625120 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.413+0000 7fe01bfff700 1 --2- 172.21.15.146:0/1691625120 >> v2:172.21.15.146:3300/0 conn(0x7fe01c09bc70 0x7fe01c09c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.413+0000 7fe021034700 1 --2- 172.21.15.146:0/1691625120 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01c09c5c0 0x7fe01c138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.413+0000 7fe020833700 1 -- 172.21.15.146:0/1691625120 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01c09c5c0 msgr2=0x7fe01c138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.413+0000 7fe020833700 1 --2- 172.21.15.146:0/1691625120 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01c09c5c0 0x7fe01c138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.414+0000 7fe020833700 1 -- 172.21.15.146:0/1691625120 >> v2:172.21.15.146:3300/0 conn(0x7fe01c09bc70 msgr2=0x7fe01c09c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.414+0000 7fe020833700 1 --2- 172.21.15.146:0/1691625120 >> v2:172.21.15.146:3300/0 conn(0x7fe01c09bc70 0x7fe01c09c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.414+0000 7fe020833700 1 -- 172.21.15.146:0/1691625120 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01c131550 con 0x7fe01c131980 2023-10-03T10:14:45.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.414+0000 7fe01bfff700 1 --2- 172.21.15.146:0/1691625120 >> v2:172.21.15.146:3300/0 conn(0x7fe01c09bc70 0x7fe01c09c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:45.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.414+0000 7fe020833700 1 --2- 172.21.15.146:0/1691625120 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01c131980 0x7fe01c131d50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe010006fd0 tx=0x7fe010009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e481b97c6f774b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.414+0000 7fe01b7fe700 1 -- 172.21.15.146:0/1691625120 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe010005e30 con 0x7fe01c131980 2023-10-03T10:14:45.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.414+0000 7fe01b7fe700 1 -- 172.21.15.146:0/1691625120 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe010004030 con 0x7fe01c131980 2023-10-03T10:14:45.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.414+0000 7fe01b7fe700 1 -- 172.21.15.146:0/1691625120 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0100043e0 con 0x7fe01c131980 2023-10-03T10:14:45.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.415+0000 7fe022a97700 1 -- 172.21.15.146:0/1691625120 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01c131980 msgr2=0x7fe01c131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.415+0000 7fe022a97700 1 --2- 172.21.15.146:0/1691625120 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01c131980 0x7fe01c131d50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe010006fd0 tx=0x7fe010009bd0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.415+0000 7fe022a97700 1 -- 172.21.15.146:0/1691625120 shutdown_connections 2023-10-03T10:14:45.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.415+0000 7fe022a97700 1 --2- 172.21.15.146:0/1691625120 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01c131980 0x7fe01c131d50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.415+0000 7fe022a97700 1 --2- 172.21.15.146:0/1691625120 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01c09c5c0 0x7fe01c138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.415+0000 7fe022a97700 1 --2- 172.21.15.146:0/1691625120 >> v2:172.21.15.146:3300/0 conn(0x7fe01c09bc70 0x7fe01c09c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.415+0000 7fe022a97700 1 -- 172.21.15.146:0/1691625120 >> 172.21.15.146:0/1691625120 conn(0x7fe01c0a2980 msgr2=0x7fe01c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.415+0000 7fe022a97700 1 -- 172.21.15.146:0/1691625120 shutdown_connections 2023-10-03T10:14:45.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.415+0000 7fe022a97700 1 -- 172.21.15.146:0/1691625120 wait complete. 2023-10-03T10:14:45.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.416+0000 7fe022a97700 1 Processor -- start 2023-10-03T10:14:45.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.416+0000 7fe022a97700 1 -- start start 2023-10-03T10:14:45.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.417+0000 7fe022a97700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01c09bc70 0x7fe01c1c0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.417+0000 7fe022a97700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01c09c5c0 0x7fe01c1c10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.417+0000 7fe022a97700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe01c131980 0x7fe01c1c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.417+0000 7fe022a97700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c12ee80 con 0x7fe01c131980 2023-10-03T10:14:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.417+0000 7fe022a97700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c11d6c0 con 0x7fe01c09bc70 2023-10-03T10:14:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.417+0000 7fe022a97700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c130a40 con 0x7fe01c09c5c0 2023-10-03T10:14:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.417+0000 7fe020833700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01c09bc70 0x7fe01c1c0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.417+0000 7fe020833700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01c09bc70 0x7fe01c1c0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:54058/0 (socket says 172.21.15.146:54058) 2023-10-03T10:14:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.417+0000 7fe020833700 1 -- 172.21.15.146:0/638188802 learned_addr learned my addr 172.21.15.146:0/638188802 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.418+0000 7fe01bfff700 1 --2- 172.21.15.146:0/638188802 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01c09c5c0 0x7fe01c1c10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.418+0000 7fe021034700 1 --2- 172.21.15.146:0/638188802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe01c131980 0x7fe01c1c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.418+0000 7fe01bfff700 1 -- 172.21.15.146:0/638188802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01c09bc70 msgr2=0x7fe01c1c0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.418+0000 7fe01bfff700 1 --2- 172.21.15.146:0/638188802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01c09bc70 0x7fe01c1c0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.418+0000 7fe01bfff700 1 -- 172.21.15.146:0/638188802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe01c131980 msgr2=0x7fe01c1c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.418+0000 7fe01bfff700 1 --2- 172.21.15.146:0/638188802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe01c131980 0x7fe01c1c3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.418+0000 7fe01bfff700 1 -- 172.21.15.146:0/638188802 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00800d940 con 0x7fe01c09c5c0 2023-10-03T10:14:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.418+0000 7fe020833700 1 --2- 172.21.15.146:0/638188802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01c09bc70 0x7fe01c1c0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.418+0000 7fe01bfff700 1 --2- 172.21.15.146:0/638188802 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01c09c5c0 0x7fe01c1c10f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe008012ea0 tx=0x7fe008012ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.418+0000 7fe0197fa700 1 -- 172.21.15.146:0/638188802 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe008014040 con 0x7fe01c09c5c0 2023-10-03T10:14:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.418+0000 7fe0197fa700 1 -- 172.21.15.146:0/638188802 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00800f860 con 0x7fe01c09c5c0 2023-10-03T10:14:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.418+0000 7fe022a97700 1 -- 172.21.15.146:0/638188802 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe010009500 con 0x7fe01c09c5c0 2023-10-03T10:14:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.418+0000 7fe0197fa700 1 -- 172.21.15.146:0/638188802 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00800fbd0 con 0x7fe01c09c5c0 2023-10-03T10:14:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.418+0000 7fe022a97700 1 -- 172.21.15.146:0/638188802 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01c11ed40 con 0x7fe01c09c5c0 2023-10-03T10:14:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.419+0000 7fe0197fa700 1 -- 172.21.15.146:0/638188802 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe00800fd30 con 0x7fe01c09c5c0 2023-10-03T10:14:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.419+0000 7fe0197fa700 1 -- 172.21.15.146:0/638188802 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe008043240 con 0x7fe01c09c5c0 2023-10-03T10:14:45.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.419+0000 7fe022a97700 1 -- 172.21.15.146:0/638188802 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01c04f2a0 con 0x7fe01c09c5c0 2023-10-03T10:14:45.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.428+0000 7fe0197fa700 1 -- 172.21.15.146:0/638188802 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe008021410 con 0x7fe01c09c5c0 2023-10-03T10:14:45.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.456+0000 7fa7bed06700 1 Processor -- start 2023-10-03T10:14:45.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.456+0000 7fa7bed06700 1 -- start start 2023-10-03T10:14:45.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.457+0000 7fa7bed06700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa7b8131980 0x7fa7b8131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.457+0000 7fa7bed06700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7b809bc70 0x7fa7b809c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.457+0000 7fa7bed06700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7b809c5c0 0x7fa7b8138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.457+0000 7fa7bed06700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b806eb30 con 0x7fa7b8131980 2023-10-03T10:14:45.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.457+0000 7fa7bed06700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b80a1640 con 0x7fa7b809bc70 2023-10-03T10:14:45.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.457+0000 7fa7bed06700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b80a22d0 con 0x7fa7b809c5c0 2023-10-03T10:14:45.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.457+0000 7fa7b7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7b809bc70 0x7fa7b809c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.457+0000 7fa7bd2a3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7b809c5c0 0x7fa7b8138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.457+0000 7fa7b7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7b809bc70 0x7fa7b809c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:54070/0 (socket says 172.21.15.146:54070) 2023-10-03T10:14:45.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.457+0000 7fa7b7fff700 1 -- 172.21.15.146:0/3509400043 learned_addr learned my addr 172.21.15.146:0/3509400043 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:45.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.457+0000 7fa7bcaa2700 1 --2- 172.21.15.146:0/3509400043 >> v2:172.21.15.146:3300/0 conn(0x7fa7b8131980 0x7fa7b8131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.457+0000 7fa7b7fff700 1 -- 172.21.15.146:0/3509400043 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7b809c5c0 msgr2=0x7fa7b8138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.457+0000 7fa7b7fff700 1 --2- 172.21.15.146:0/3509400043 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7b809c5c0 0x7fa7b8138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.457+0000 7fa7b7fff700 1 -- 172.21.15.146:0/3509400043 >> v2:172.21.15.146:3300/0 conn(0x7fa7b8131980 msgr2=0x7fa7b8131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.457+0000 7fa7b7fff700 1 --2- 172.21.15.146:0/3509400043 >> v2:172.21.15.146:3300/0 conn(0x7fa7b8131980 0x7fa7b8131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.457+0000 7fa7b7fff700 1 -- 172.21.15.146:0/3509400043 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b8131550 con 0x7fa7b809bc70 2023-10-03T10:14:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.457+0000 7fa7bd2a3700 1 --2- 172.21.15.146:0/3509400043 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7b809c5c0 0x7fa7b8138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.457+0000 7fa7b7fff700 1 --2- 172.21.15.146:0/3509400043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7b809bc70 0x7fa7b809c080 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa7a40098f0 tx=0x7fa7a4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=144d4474e85dff4c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.458+0000 7fa7b77fe700 1 -- 172.21.15.146:0/3509400043 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4011830 con 0x7fa7b809bc70 2023-10-03T10:14:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.458+0000 7fa7b77fe700 1 -- 172.21.15.146:0/3509400043 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a4011990 con 0x7fa7b809bc70 2023-10-03T10:14:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.458+0000 7fa7b77fe700 1 -- 172.21.15.146:0/3509400043 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4011d20 con 0x7fa7b809bc70 2023-10-03T10:14:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.458+0000 7fa7bed06700 1 -- 172.21.15.146:0/3509400043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7b809bc70 msgr2=0x7fa7b809c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.458+0000 7fa7bed06700 1 --2- 172.21.15.146:0/3509400043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7b809bc70 0x7fa7b809c080 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa7a40098f0 tx=0x7fa7a4009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:45.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.458+0000 7fa7bed06700 1 -- 172.21.15.146:0/3509400043 shutdown_connections 2023-10-03T10:14:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.458+0000 7fa7bed06700 1 --2- 172.21.15.146:0/3509400043 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7b809c5c0 0x7fa7b8138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.458+0000 7fa7bed06700 1 --2- 172.21.15.146:0/3509400043 >> v2:172.21.15.146:3300/0 conn(0x7fa7b8131980 0x7fa7b8131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.458+0000 7fa7bed06700 1 --2- 172.21.15.146:0/3509400043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7b809bc70 0x7fa7b809c080 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.458+0000 7fa7bed06700 1 -- 172.21.15.146:0/3509400043 >> 172.21.15.146:0/3509400043 conn(0x7fa7b80a2980 msgr2=0x7fa7b80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.458+0000 7fa7bed06700 1 -- 172.21.15.146:0/3509400043 shutdown_connections 2023-10-03T10:14:45.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.458+0000 7fa7bed06700 1 -- 172.21.15.146:0/3509400043 wait complete. 2023-10-03T10:14:45.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.459+0000 7fa7bed06700 1 Processor -- start 2023-10-03T10:14:45.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.459+0000 7fa7bed06700 1 -- start start 2023-10-03T10:14:45.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.460+0000 7fa7bed06700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7b809bc70 0x7fa7b8135470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.460+0000 7fa7bed06700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7b809c5c0 0x7fa7b81359b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.460+0000 7fa7bed06700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7b8131980 0x7fa7b81c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.460+0000 7fa7bed06700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b8138290 con 0x7fa7b809bc70 2023-10-03T10:14:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.460+0000 7fa7bed06700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b8135ef0 con 0x7fa7b809c5c0 2023-10-03T10:14:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.460+0000 7fa7bed06700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b8134f10 con 0x7fa7b8131980 2023-10-03T10:14:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.460+0000 7fa7bd2a3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7b8131980 0x7fa7b81c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.460+0000 7fa7bd2a3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7b8131980 0x7fa7b81c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38832/0 (socket says 172.21.15.146:38832) 2023-10-03T10:14:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.460+0000 7fa7bd2a3700 1 -- 172.21.15.146:0/1474579202 learned_addr learned my addr 172.21.15.146:0/1474579202 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.460+0000 7fa7bcaa2700 1 --2- 172.21.15.146:0/1474579202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7b809bc70 0x7fa7b8135470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.460+0000 7fa7b7fff700 1 --2- 172.21.15.146:0/1474579202 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7b809c5c0 0x7fa7b81359b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.461+0000 7fa7bd2a3700 1 -- 172.21.15.146:0/1474579202 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7b809c5c0 msgr2=0x7fa7b81359b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.461+0000 7fa7bd2a3700 1 --2- 172.21.15.146:0/1474579202 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7b809c5c0 0x7fa7b81359b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.461+0000 7fa7bd2a3700 1 -- 172.21.15.146:0/1474579202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7b809bc70 msgr2=0x7fa7b8135470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.461+0000 7fa7bd2a3700 1 --2- 172.21.15.146:0/1474579202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7b809bc70 0x7fa7b8135470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.461+0000 7fa7bd2a3700 1 -- 172.21.15.146:0/1474579202 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b0009a70 con 0x7fa7b8131980 2023-10-03T10:14:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.461+0000 7fa7b7fff700 1 --2- 172.21.15.146:0/1474579202 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7b809c5c0 0x7fa7b81359b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.461+0000 7fa7bd2a3700 1 --2- 172.21.15.146:0/1474579202 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7b8131980 0x7fa7b81c81b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000eed0 tx=0x7fa7b000b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.461+0000 7fa7b57fa700 1 -- 172.21.15.146:0/1474579202 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0010040 con 0x7fa7b8131980 2023-10-03T10:14:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.461+0000 7fa7b57fa700 1 -- 172.21.15.146:0/1474579202 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b000bd50 con 0x7fa7b8131980 2023-10-03T10:14:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.461+0000 7fa7bed06700 1 -- 172.21.15.146:0/1474579202 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a4009550 con 0x7fa7b8131980 2023-10-03T10:14:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.461+0000 7fa7b57fa700 1 -- 172.21.15.146:0/1474579202 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0014640 con 0x7fa7b8131980 2023-10-03T10:14:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.461+0000 7fa7bed06700 1 -- 172.21.15.146:0/1474579202 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b8136e50 con 0x7fa7b8131980 2023-10-03T10:14:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.462+0000 7fa7b57fa700 1 -- 172.21.15.146:0/1474579202 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa7b00147a0 con 0x7fa7b8131980 2023-10-03T10:14:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.462+0000 7fa7b57fa700 1 -- 172.21.15.146:0/1474579202 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa7b0040080 con 0x7fa7b8131980 2023-10-03T10:14:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.463+0000 7fa7bed06700 1 -- 172.21.15.146:0/1474579202 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b81380d0 con 0x7fa7b8131980 2023-10-03T10:14:45.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.471+0000 7fa7b57fa700 1 -- 172.21.15.146:0/1474579202 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa7b0018070 con 0x7fa7b8131980 2023-10-03T10:14:45.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.494+0000 7f473c079700 1 Processor -- start 2023-10-03T10:14:45.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.495+0000 7f473c079700 1 -- start start 2023-10-03T10:14:45.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.495+0000 7f473c079700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f473409d860 0x7f473409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.495+0000 7f473c079700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4734130eb0 0x7f4734138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.495+0000 7f473c079700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f473409aaa0 con 0x7f473409e170 2023-10-03T10:14:45.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.495+0000 7f473c079700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473409f870 con 0x7f4734130eb0 2023-10-03T10:14:45.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.495+0000 7f473c079700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f473409b360 con 0x7f473409d860 2023-10-03T10:14:45.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.495+0000 7f4739614700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f473409e170 0x7f47341307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48656/0 (socket says 172.21.15.146:48656) 2023-10-03T10:14:45.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.495+0000 7f4739614700 1 -- 172.21.15.146:0/828320515 learned_addr learned my addr 172.21.15.146:0/828320515 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:45.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.495+0000 7f473a616700 1 --2- 172.21.15.146:0/828320515 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4734130eb0 0x7f4734138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.495+0000 7f4739e15700 1 --2- 172.21.15.146:0/828320515 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f473409d860 0x7f473409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.496+0000 7f473a616700 1 -- 172.21.15.146:0/828320515 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f473409d860 msgr2=0x7f473409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.496+0000 7f473a616700 1 --2- 172.21.15.146:0/828320515 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f473409d860 0x7f473409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.496+0000 7f473a616700 1 -- 172.21.15.146:0/828320515 >> v1:172.21.15.146:6789/0 conn(0x7f473409e170 legacy=0x7f47341307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.496+0000 7f473a616700 1 -- 172.21.15.146:0/828320515 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473409b620 con 0x7f4734130eb0 2023-10-03T10:14:45.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.496+0000 7f4738e13700 1 -- 172.21.15.146:0/828320515 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876003454 0 0) 0x7f473409aaa0 con 0x7f473409e170 2023-10-03T10:14:45.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.496+0000 7f473a616700 1 --2- 172.21.15.146:0/828320515 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4734130eb0 0x7f4734138a00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f472c009dc0 tx=0x7f472c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=683518d14b10217 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.496+0000 7f4738e13700 1 -- 172.21.15.146:0/828320515 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c00e070 con 0x7f4734130eb0 2023-10-03T10:14:45.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.496+0000 7f4738e13700 1 -- 172.21.15.146:0/828320515 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472c00bb20 con 0x7f4734130eb0 2023-10-03T10:14:45.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.496+0000 7f4738e13700 1 -- 172.21.15.146:0/828320515 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c012430 con 0x7f4734130eb0 2023-10-03T10:14:45.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.497+0000 7f473c079700 1 -- 172.21.15.146:0/828320515 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4734130eb0 msgr2=0x7f4734138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.497+0000 7f473c079700 1 --2- 172.21.15.146:0/828320515 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4734130eb0 0x7f4734138a00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f472c009dc0 tx=0x7f472c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:45.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.497+0000 7f473c079700 1 -- 172.21.15.146:0/828320515 shutdown_connections 2023-10-03T10:14:45.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.497+0000 7f473c079700 1 --2- 172.21.15.146:0/828320515 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4734130eb0 0x7f4734138a00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.497+0000 7f473c079700 1 --2- 172.21.15.146:0/828320515 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f473409d860 0x7f473409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.497+0000 7f473c079700 1 -- 172.21.15.146:0/828320515 >> 172.21.15.146:0/828320515 conn(0x7f4734099c40 msgr2=0x7f47340a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.497+0000 7f473c079700 1 -- 172.21.15.146:0/828320515 shutdown_connections 2023-10-03T10:14:45.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.497+0000 7f473c079700 1 -- 172.21.15.146:0/828320515 wait complete. 2023-10-03T10:14:45.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.498+0000 7f473c079700 1 Processor -- start 2023-10-03T10:14:45.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.498+0000 7f473c079700 1 -- start start 2023-10-03T10:14:45.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.498+0000 7f473c079700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f473409d860 0x7f4734127500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.498+0000 7f473c079700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f473409e170 0x7f4734127a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.498+0000 7f473c079700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4734130eb0 0x7f4734127f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.498+0000 7f473c079700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473412a180 con 0x7f473409d860 2023-10-03T10:14:45.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.498+0000 7f473c079700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4734130a90 con 0x7f473409e170 2023-10-03T10:14:45.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.498+0000 7f473c079700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f473412ab30 con 0x7f4734130eb0 2023-10-03T10:14:45.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.498+0000 7f4739614700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f473409e170 0x7f4734127a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.498+0000 7f4739614700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f473409e170 0x7f4734127a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:54106/0 (socket says 172.21.15.146:54106) 2023-10-03T10:14:45.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.498+0000 7f4739614700 1 -- 172.21.15.146:0/608276943 learned_addr learned my addr 172.21.15.146:0/608276943 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:45.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.498+0000 7f473a616700 1 --2- 172.21.15.146:0/608276943 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4734130eb0 0x7f4734127f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.499+0000 7f4739614700 1 -- 172.21.15.146:0/608276943 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4734130eb0 msgr2=0x7f4734127f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.499+0000 7f4739614700 1 --2- 172.21.15.146:0/608276943 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4734130eb0 0x7f4734127f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.499+0000 7f4739614700 1 -- 172.21.15.146:0/608276943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f473409d860 msgr2=0x7f4734127500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:45.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.499+0000 7f4739614700 1 --2- 172.21.15.146:0/608276943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f473409d860 0x7f4734127500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.499+0000 7f4739614700 1 -- 172.21.15.146:0/608276943 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472c009a70 con 0x7f473409e170 2023-10-03T10:14:45.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.499+0000 7f4739614700 1 --2- 172.21.15.146:0/608276943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f473409e170 0x7f4734127a40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f472400c520 tx=0x7f472400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.499+0000 7f472a7fc700 1 -- 172.21.15.146:0/608276943 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4724004c80 con 0x7f473409e170 2023-10-03T10:14:45.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.499+0000 7f472a7fc700 1 -- 172.21.15.146:0/608276943 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4724004de0 con 0x7f473409e170 2023-10-03T10:14:45.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.499+0000 7f472a7fc700 1 -- 172.21.15.146:0/608276943 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4724007310 con 0x7f473409e170 2023-10-03T10:14:45.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.500+0000 7f473c079700 1 -- 172.21.15.146:0/608276943 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4734129010 con 0x7f473409e170 2023-10-03T10:14:45.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.500+0000 7f473c079700 1 -- 172.21.15.146:0/608276943 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4734129c70 con 0x7f473409e170 2023-10-03T10:14:45.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.501+0000 7f473c079700 1 -- 172.21.15.146:0/608276943 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f473409a9f0 con 0x7f473409e170 2023-10-03T10:14:45.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.501+0000 7f472a7fc700 1 -- 172.21.15.146:0/608276943 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4724007470 con 0x7f473409e170 2023-10-03T10:14:45.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.501+0000 7f472a7fc700 1 -- 172.21.15.146:0/608276943 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f472403f3d0 con 0x7f473409e170 2023-10-03T10:14:45.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.509+0000 7f472a7fc700 1 -- 172.21.15.146:0/608276943 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f47240133c0 con 0x7f473409e170 2023-10-03T10:14:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.550+0000 7fd89b59e700 1 Processor -- start 2023-10-03T10:14:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.550+0000 7fd89b59e700 1 -- start start 2023-10-03T10:14:45.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.551+0000 7fd89b59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd89c099f50 0x7fd89c09a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.551+0000 7fd89b59e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd89c131970 0x7fd89c1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.551+0000 7fd89b59e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c09c5c0 con 0x7fd89c06fb90 2023-10-03T10:14:45.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.551+0000 7fd89b59e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89c09ae10 con 0x7fd89c099f50 2023-10-03T10:14:45.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.551+0000 7fd89b59e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c09b950 con 0x7fd89c131970 2023-10-03T10:14:45.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.551+0000 7fd891d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd89c06fb90 0x7fd89c131260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48666/0 (socket says 172.21.15.146:48666) 2023-10-03T10:14:45.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.551+0000 7fd891d9b700 1 -- 172.21.15.146:0/311252945 learned_addr learned my addr 172.21.15.146:0/311252945 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:45.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.551+0000 7fd89a59c700 1 --2- 172.21.15.146:0/311252945 >> v2:172.21.15.146:3300/0 conn(0x7fd89c099f50 0x7fd89c09a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.551+0000 7fd89ad9d700 1 --2- 172.21.15.146:0/311252945 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd89c131970 0x7fd89c1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.552+0000 7fd899d9b700 1 -- 172.21.15.146:0/311252945 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761978915 0 0) 0x7fd89c09c5c0 con 0x7fd89c06fb90 2023-10-03T10:14:45.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.552+0000 7fd899d9b700 1 -- 172.21.15.146:0/311252945 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8880035b0 con 0x7fd89c06fb90 2023-10-03T10:14:45.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.552+0000 7fd89a59c700 1 -- 172.21.15.146:0/311252945 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd89c131970 msgr2=0x7fd89c1395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.552+0000 7fd89a59c700 1 --2- 172.21.15.146:0/311252945 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd89c131970 0x7fd89c1395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.552+0000 7fd89a59c700 1 -- 172.21.15.146:0/311252945 >> v1:172.21.15.146:6789/0 conn(0x7fd89c06fb90 legacy=0x7fd89c131260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.552+0000 7fd89a59c700 1 -- 172.21.15.146:0/311252945 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c06f5a0 con 0x7fd89c099f50 2023-10-03T10:14:45.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.552+0000 7fd89a59c700 1 --2- 172.21.15.146:0/311252945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd89c099f50 0x7fd89c09a320 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd88c009840 tx=0x7fd88c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27cb1eabf1698dd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.552+0000 7fd899d9b700 1 -- 172.21.15.146:0/311252945 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c011830 con 0x7fd89c099f50 2023-10-03T10:14:45.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.552+0000 7fd899d9b700 1 -- 172.21.15.146:0/311252945 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88c011990 con 0x7fd89c099f50 2023-10-03T10:14:45.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.552+0000 7fd899d9b700 1 -- 172.21.15.146:0/311252945 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c011d20 con 0x7fd89c099f50 2023-10-03T10:14:45.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.553+0000 7fd89b59e700 1 -- 172.21.15.146:0/311252945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd89c099f50 msgr2=0x7fd89c09a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.553+0000 7fd89b59e700 1 --2- 172.21.15.146:0/311252945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd89c099f50 0x7fd89c09a320 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd88c009840 tx=0x7fd88c009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:45.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.553+0000 7fd89b59e700 1 -- 172.21.15.146:0/311252945 shutdown_connections 2023-10-03T10:14:45.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.553+0000 7fd89b59e700 1 --2- 172.21.15.146:0/311252945 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd89c131970 0x7fd89c1395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.553+0000 7fd89b59e700 1 --2- 172.21.15.146:0/311252945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd89c099f50 0x7fd89c09a320 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.553+0000 7fd89b59e700 1 -- 172.21.15.146:0/311252945 >> 172.21.15.146:0/311252945 conn(0x7fd89c0a27a0 msgr2=0x7fd89c0a2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.553+0000 7fd89b59e700 1 -- 172.21.15.146:0/311252945 shutdown_connections 2023-10-03T10:14:45.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.553+0000 7fd89b59e700 1 -- 172.21.15.146:0/311252945 wait complete. 2023-10-03T10:14:45.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.555+0000 7fd89b59e700 1 Processor -- start 2023-10-03T10:14:45.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.555+0000 7fd89b59e700 1 -- start start 2023-10-03T10:14:45.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.555+0000 7fd89b59e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd89c06fb90 0x7fd89c070110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.556+0000 7fd89b59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd89c099f50 0x7fd89c070650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.556+0000 7fd89b59e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd89c131970 0x7fd89c070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.556+0000 7fd89b59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c11eee0 con 0x7fd89c099f50 2023-10-03T10:14:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.556+0000 7fd89b59e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c071d20 con 0x7fd89c06fb90 2023-10-03T10:14:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.556+0000 7fd89b59e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c11eb80 con 0x7fd89c131970 2023-10-03T10:14:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.556+0000 7fd89a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd89c06fb90 0x7fd89c070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.556+0000 7fd89a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd89c06fb90 0x7fd89c070110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:54110/0 (socket says 172.21.15.146:54110) 2023-10-03T10:14:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.556+0000 7fd89ad9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd89c131970 0x7fd89c070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.556+0000 7fd89a59c700 1 -- 172.21.15.146:0/2603616583 learned_addr learned my addr 172.21.15.146:0/2603616583 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.556+0000 7fd891d9b700 1 --2- 172.21.15.146:0/2603616583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd89c099f50 0x7fd89c070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.556+0000 7fd89a59c700 1 -- 172.21.15.146:0/2603616583 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd89c131970 msgr2=0x7fd89c070b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.556+0000 7fd89a59c700 1 --2- 172.21.15.146:0/2603616583 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd89c131970 0x7fd89c070b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.556+0000 7fd89a59c700 1 -- 172.21.15.146:0/2603616583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd89c099f50 msgr2=0x7fd89c070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.556+0000 7fd89a59c700 1 --2- 172.21.15.146:0/2603616583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd89c099f50 0x7fd89c070650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.556+0000 7fd89a59c700 1 -- 172.21.15.146:0/2603616583 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88c0094a0 con 0x7fd89c06fb90 2023-10-03T10:14:45.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.556+0000 7fd89ad9d700 1 --2- 172.21.15.146:0/2603616583 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd89c131970 0x7fd89c070b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:45.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.556+0000 7fd891d9b700 1 --2- 172.21.15.146:0/2603616583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd89c099f50 0x7fd89c070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:45.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.556+0000 7fd89a59c700 1 --2- 172.21.15.146:0/2603616583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd89c06fb90 0x7fd89c070110 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0090b0 tx=0x7fd88c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.557+0000 7fd8937fe700 1 -- 172.21.15.146:0/2603616583 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c0036a0 con 0x7fd89c06fb90 2023-10-03T10:14:45.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.557+0000 7fd8937fe700 1 -- 172.21.15.146:0/2603616583 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88c01f070 con 0x7fd89c06fb90 2023-10-03T10:14:45.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.557+0000 7fd89b59e700 1 -- 172.21.15.146:0/2603616583 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89c0a0020 con 0x7fd89c06fb90 2023-10-03T10:14:45.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.557+0000 7fd8937fe700 1 -- 172.21.15.146:0/2603616583 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c003a60 con 0x7fd89c06fb90 2023-10-03T10:14:45.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.557+0000 7fd89b59e700 1 -- 172.21.15.146:0/2603616583 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd89c06e620 con 0x7fd89c06fb90 2023-10-03T10:14:45.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.558+0000 7fd89b59e700 1 -- 172.21.15.146:0/2603616583 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd89c09b0b0 con 0x7fd89c06fb90 2023-10-03T10:14:45.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.559+0000 7fd8937fe700 1 -- 172.21.15.146:0/2603616583 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd88c003bc0 con 0x7fd89c06fb90 2023-10-03T10:14:45.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.559+0000 7fd8937fe700 1 -- 172.21.15.146:0/2603616583 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd88c021070 con 0x7fd89c06fb90 2023-10-03T10:14:45.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.563+0000 7fd8937fe700 1 -- 172.21.15.146:0/2603616583 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd88c010380 con 0x7fd89c06fb90 2023-10-03T10:14:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.659+0000 7fe022a97700 1 -- 172.21.15.146:0/638188802 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe01c06bce0 con 0x7fe01c09c5c0 2023-10-03T10:14:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.660+0000 7fe0197fa700 1 -- 172.21.15.146:0/638188802 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe008020370 con 0x7fe01c09c5c0 2023-10-03T10:14:45.659 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.662+0000 7fe022a97700 1 -- 172.21.15.146:0/638188802 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01c09c5c0 msgr2=0x7fe01c1c10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.662+0000 7fe022a97700 1 --2- 172.21.15.146:0/638188802 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01c09c5c0 0x7fe01c1c10f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe008012ea0 tx=0x7fe008012ed0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.662+0000 7fe022a97700 1 -- 172.21.15.146:0/638188802 shutdown_connections 2023-10-03T10:14:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.662+0000 7fe022a97700 1 --2- 172.21.15.146:0/638188802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe01c131980 0x7fe01c1c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.662+0000 7fe022a97700 1 --2- 172.21.15.146:0/638188802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe01c09bc70 0x7fe01c1c0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.662+0000 7fe022a97700 1 --2- 172.21.15.146:0/638188802 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe01c09c5c0 0x7fe01c1c10f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.662+0000 7fe022a97700 1 -- 172.21.15.146:0/638188802 >> 172.21.15.146:0/638188802 conn(0x7fe01c0a2980 msgr2=0x7fe01c071470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.662+0000 7fe022a97700 1 -- 172.21.15.146:0/638188802 shutdown_connections 2023-10-03T10:14:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.662+0000 7fe022a97700 1 -- 172.21.15.146:0/638188802 wait complete. 2023-10-03T10:14:45.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.697+0000 7fa7bed06700 1 -- 172.21.15.146:0/1474579202 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa7b8137ef0 con 0x7fa7b8131980 2023-10-03T10:14:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.698+0000 7fa7b57fa700 1 -- 172.21.15.146:0/1474579202 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa7b001d400 con 0x7fa7b8131980 2023-10-03T10:14:45.698 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.700+0000 7fa7bed06700 1 -- 172.21.15.146:0/1474579202 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7b8131980 msgr2=0x7fa7b81c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.700+0000 7fa7bed06700 1 --2- 172.21.15.146:0/1474579202 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7b8131980 0x7fa7b81c81b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000eed0 tx=0x7fa7b000b390 comp rx=0 tx=0).stop 2023-10-03T10:14:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.700+0000 7fa7bed06700 1 -- 172.21.15.146:0/1474579202 shutdown_connections 2023-10-03T10:14:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.700+0000 7fa7bed06700 1 --2- 172.21.15.146:0/1474579202 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7b8131980 0x7fa7b81c81b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.700+0000 7fa7bed06700 1 --2- 172.21.15.146:0/1474579202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7b809bc70 0x7fa7b8135470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.700+0000 7fa7bed06700 1 --2- 172.21.15.146:0/1474579202 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7b809c5c0 0x7fa7b81359b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.700+0000 7fa7bed06700 1 -- 172.21.15.146:0/1474579202 >> 172.21.15.146:0/1474579202 conn(0x7fa7b80a2980 msgr2=0x7fa7b809ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.700+0000 7fa7bed06700 1 -- 172.21.15.146:0/1474579202 shutdown_connections 2023-10-03T10:14:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.700+0000 7fa7bed06700 1 -- 172.21.15.146:0/1474579202 wait complete. 2023-10-03T10:14:45.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:45.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.741+0000 7f473c079700 1 -- 172.21.15.146:0/608276943 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f47340a0730 con 0x7f473409e170 2023-10-03T10:14:45.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.741+0000 7f472a7fc700 1 -- 172.21.15.146:0/608276943 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4724011360 con 0x7f473409e170 2023-10-03T10:14:45.741 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:45.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.743+0000 7f473c079700 1 -- 172.21.15.146:0/608276943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f473409e170 msgr2=0x7f4734127a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.743+0000 7f473c079700 1 --2- 172.21.15.146:0/608276943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f473409e170 0x7f4734127a40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f472400c520 tx=0x7f472400c830 comp rx=0 tx=0).stop 2023-10-03T10:14:45.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.743+0000 7f473c079700 1 -- 172.21.15.146:0/608276943 shutdown_connections 2023-10-03T10:14:45.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.743+0000 7f473c079700 1 --2- 172.21.15.146:0/608276943 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4734130eb0 0x7f4734127f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.743+0000 7f473c079700 1 --2- 172.21.15.146:0/608276943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f473409d860 0x7f4734127500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.743+0000 7f473c079700 1 --2- 172.21.15.146:0/608276943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f473409e170 0x7f4734127a40 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.743+0000 7f473c079700 1 -- 172.21.15.146:0/608276943 >> 172.21.15.146:0/608276943 conn(0x7f4734099c40 msgr2=0x7f4734070d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.743+0000 7f473c079700 1 -- 172.21.15.146:0/608276943 shutdown_connections 2023-10-03T10:14:45.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.743+0000 7f473c079700 1 -- 172.21.15.146:0/608276943 wait complete. 2023-10-03T10:14:45.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:45.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.785+0000 7fd89b59e700 1 -- 172.21.15.146:0/2603616583 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd89c04f2a0 con 0x7fd89c06fb90 2023-10-03T10:14:45.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.786+0000 7fd8937fe700 1 -- 172.21.15.146:0/2603616583 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd88c015020 con 0x7fd89c06fb90 2023-10-03T10:14:45.785 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:45.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.788+0000 7fd89b59e700 1 -- 172.21.15.146:0/2603616583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd89c06fb90 msgr2=0x7fd89c070110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.788+0000 7fd89b59e700 1 --2- 172.21.15.146:0/2603616583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd89c06fb90 0x7fd89c070110 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0090b0 tx=0x7fd88c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.788+0000 7fd89b59e700 1 -- 172.21.15.146:0/2603616583 shutdown_connections 2023-10-03T10:14:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.788+0000 7fd89b59e700 1 --2- 172.21.15.146:0/2603616583 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd89c131970 0x7fd89c070b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.788+0000 7fd89b59e700 1 --2- 172.21.15.146:0/2603616583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd89c06fb90 0x7fd89c070110 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.788+0000 7fd89b59e700 1 --2- 172.21.15.146:0/2603616583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd89c099f50 0x7fd89c070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.788+0000 7fd89b59e700 1 -- 172.21.15.146:0/2603616583 >> 172.21.15.146:0/2603616583 conn(0x7fd89c0a27a0 msgr2=0x7fd89c12e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.788+0000 7fd89b59e700 1 -- 172.21.15.146:0/2603616583 shutdown_connections 2023-10-03T10:14:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:45.788+0000 7fd89b59e700 1 -- 172.21.15.146:0/2603616583 wait complete. 2023-10-03T10:14:45.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:46.676 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:46.713 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:46.755 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:46.800 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:46.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.813+0000 7f3a719db700 1 Processor -- start 2023-10-03T10:14:46.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.813+0000 7f3a719db700 1 -- start start 2023-10-03T10:14:46.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.814+0000 7f3a719db700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a6c09e340 0x7f3a6c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.814+0000 7f3a719db700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a6c135f20 0x7f3a6c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.814+0000 7f3a719db700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6c09aaa0 con 0x7f3a6c09d860 2023-10-03T10:14:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.814+0000 7f3a719db700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c09e730 con 0x7f3a6c09e340 2023-10-03T10:14:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.814+0000 7f3a719db700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c09f870 con 0x7f3a6c135f20 2023-10-03T10:14:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.814+0000 7f3a6affd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3a6c09d860 0x7f3a6c09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48682/0 (socket says 172.21.15.146:48682) 2023-10-03T10:14:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.814+0000 7f3a6affd700 1 -- 172.21.15.146:0/1387654490 learned_addr learned my addr 172.21.15.146:0/1387654490 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.814+0000 7f3a6a7fc700 1 --2- 172.21.15.146:0/1387654490 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a6c09e340 0x7f3a6c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.814+0000 7f3a6b7fe700 1 --2- 172.21.15.146:0/1387654490 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a6c135f20 0x7f3a6c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.814+0000 7f3a69ffb700 1 -- 172.21.15.146:0/1387654490 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108410104 0 0) 0x7f3a6c09aaa0 con 0x7f3a6c09d860 2023-10-03T10:14:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.814+0000 7f3a69ffb700 1 -- 172.21.15.146:0/1387654490 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a540035b0 con 0x7f3a6c09d860 2023-10-03T10:14:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.814+0000 7f3a6a7fc700 1 -- 172.21.15.146:0/1387654490 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a6c135f20 msgr2=0x7f3a6c138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.814+0000 7f3a6a7fc700 1 --2- 172.21.15.146:0/1387654490 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a6c135f20 0x7f3a6c138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.814+0000 7f3a6a7fc700 1 -- 172.21.15.146:0/1387654490 >> v1:172.21.15.146:6789/0 conn(0x7f3a6c09d860 legacy=0x7f3a6c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.815+0000 7f3a6a7fc700 1 -- 172.21.15.146:0/1387654490 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c09b360 con 0x7f3a6c09e340 2023-10-03T10:14:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.815+0000 7f3a6a7fc700 1 --2- 172.21.15.146:0/1387654490 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a6c09e340 0x7f3a6c1359e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009870 tx=0x7f3a60009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce7209c507fa0632 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.815+0000 7f3a69ffb700 1 -- 172.21.15.146:0/1387654490 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6000f8a0 con 0x7f3a6c09e340 2023-10-03T10:14:46.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.815+0000 7f3a69ffb700 1 -- 172.21.15.146:0/1387654490 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6000fa00 con 0x7f3a6c09e340 2023-10-03T10:14:46.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.815+0000 7f3a69ffb700 1 -- 172.21.15.146:0/1387654490 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6000fd90 con 0x7f3a6c09e340 2023-10-03T10:14:46.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.816+0000 7f3a719db700 1 -- 172.21.15.146:0/1387654490 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a6c09e340 msgr2=0x7f3a6c1359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.816+0000 7f3a719db700 1 --2- 172.21.15.146:0/1387654490 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a6c09e340 0x7f3a6c1359e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009870 tx=0x7f3a60009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:46.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.816+0000 7f3a719db700 1 -- 172.21.15.146:0/1387654490 shutdown_connections 2023-10-03T10:14:46.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.816+0000 7f3a719db700 1 --2- 172.21.15.146:0/1387654490 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a6c135f20 0x7f3a6c138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.816+0000 7f3a719db700 1 --2- 172.21.15.146:0/1387654490 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a6c09e340 0x7f3a6c1359e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.816+0000 7f3a719db700 1 -- 172.21.15.146:0/1387654490 >> 172.21.15.146:0/1387654490 conn(0x7f3a6c099c40 msgr2=0x7f3a6c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.816+0000 7f3a719db700 1 -- 172.21.15.146:0/1387654490 shutdown_connections 2023-10-03T10:14:46.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.816+0000 7f3a719db700 1 -- 172.21.15.146:0/1387654490 wait complete. 2023-10-03T10:14:46.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.817+0000 7f3a719db700 1 Processor -- start 2023-10-03T10:14:46.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.817+0000 7f3a719db700 1 -- start start 2023-10-03T10:14:46.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.818+0000 7f3a719db700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a6c09d860 0x7f3a6c11c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.818+0000 7f3a719db700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a6c09e340 0x7f3a6c11c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.818+0000 7f3a719db700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a6c135f20 0x7f3a6c11cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.818+0000 7f3a719db700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c0a1f40 con 0x7f3a6c135f20 2023-10-03T10:14:46.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.818+0000 7f3a719db700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c09c8b0 con 0x7f3a6c09e340 2023-10-03T10:14:46.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.818+0000 7f3a719db700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c11f4f0 con 0x7f3a6c09d860 2023-10-03T10:14:46.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.818+0000 7f3a6affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a6c09d860 0x7f3a6c11c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.818+0000 7f3a6a7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a6c09e340 0x7f3a6c11c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.818+0000 7f3a6affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a6c09d860 0x7f3a6c11c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38900/0 (socket says 172.21.15.146:38900) 2023-10-03T10:14:46.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.818+0000 7f3a6affd700 1 -- 172.21.15.146:0/3699249453 learned_addr learned my addr 172.21.15.146:0/3699249453 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:46.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.818+0000 7f3a6b7fe700 1 --2- 172.21.15.146:0/3699249453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a6c135f20 0x7f3a6c11cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.819+0000 7f3a6affd700 1 -- 172.21.15.146:0/3699249453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a6c09e340 msgr2=0x7f3a6c11c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.819+0000 7f3a6affd700 1 --2- 172.21.15.146:0/3699249453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a6c09e340 0x7f3a6c11c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.819+0000 7f3a6affd700 1 -- 172.21.15.146:0/3699249453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a6c135f20 msgr2=0x7f3a6c11cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.819+0000 7f3a6affd700 1 --2- 172.21.15.146:0/3699249453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a6c135f20 0x7f3a6c11cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.819+0000 7f3a6affd700 1 -- 172.21.15.146:0/3699249453 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a600094a0 con 0x7f3a6c09d860 2023-10-03T10:14:46.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.819+0000 7f3a6affd700 1 --2- 172.21.15.146:0/3699249453 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a6c09d860 0x7f3a6c11c2c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00c700 tx=0x7f3a5c00ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.819+0000 7f3a53fff700 1 -- 172.21.15.146:0/3699249453 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c005d70 con 0x7f3a6c09d860 2023-10-03T10:14:46.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.819+0000 7f3a53fff700 1 -- 172.21.15.146:0/3699249453 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c0070d0 con 0x7f3a6c09d860 2023-10-03T10:14:46.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.819+0000 7f3a53fff700 1 -- 172.21.15.146:0/3699249453 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c007460 con 0x7f3a6c09d860 2023-10-03T10:14:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.819+0000 7f3a719db700 1 -- 172.21.15.146:0/3699249453 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a6c11fe00 con 0x7f3a6c09d860 2023-10-03T10:14:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.819+0000 7f3a719db700 1 -- 172.21.15.146:0/3699249453 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a6c11fa80 con 0x7f3a6c09d860 2023-10-03T10:14:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.820+0000 7f3a53fff700 1 -- 172.21.15.146:0/3699249453 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a5c0075c0 con 0x7f3a6c09d860 2023-10-03T10:14:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.820+0000 7f3a53fff700 1 -- 172.21.15.146:0/3699249453 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3a5c03eb10 con 0x7f3a6c09d860 2023-10-03T10:14:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.820+0000 7f3a719db700 1 -- 172.21.15.146:0/3699249453 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6c071be0 con 0x7f3a6c09d860 2023-10-03T10:14:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.825+0000 7f3a53fff700 1 -- 172.21.15.146:0/3699249453 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a5c017020 con 0x7f3a6c09d860 2023-10-03T10:14:46.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.854+0000 7f6f856d2700 1 Processor -- start 2023-10-03T10:14:46.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.854+0000 7f6f856d2700 1 -- start start 2023-10-03T10:14:46.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.854+0000 7f6f856d2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6f8006a770 0x7f6f8006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.854+0000 7f6f856d2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f80131ec0 0x7f6f80139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.854+0000 7f6f856d2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8009da80 con 0x7f6f8006b080 2023-10-03T10:14:46.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.854+0000 7f6f856d2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8009dce0 con 0x7f6f8006a770 2023-10-03T10:14:46.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.854+0000 7f6f856d2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8009eb20 con 0x7f6f80131ec0 2023-10-03T10:14:46.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.854+0000 7f6f7e7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6f8006b080 0x7f6f801317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48694/0 (socket says 172.21.15.146:48694) 2023-10-03T10:14:46.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.854+0000 7f6f7e7fc700 1 -- 172.21.15.146:0/364827110 learned_addr learned my addr 172.21.15.146:0/364827110 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:46.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.854+0000 7f6f7f7fe700 1 --2- 172.21.15.146:0/364827110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f80131ec0 0x7f6f80139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.854+0000 7f6f7effd700 1 --2- 172.21.15.146:0/364827110 >> v2:172.21.15.146:3300/0 conn(0x7f6f8006a770 0x7f6f8006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.855+0000 7f6f7dffb700 1 -- 172.21.15.146:0/364827110 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088870046 0 0) 0x7f6f8009da80 con 0x7f6f8006b080 2023-10-03T10:14:46.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.855+0000 7f6f7dffb700 1 -- 172.21.15.146:0/364827110 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f680035b0 con 0x7f6f8006b080 2023-10-03T10:14:46.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.855+0000 7f6f7f7fe700 1 -- 172.21.15.146:0/364827110 >> v2:172.21.15.146:3300/0 conn(0x7f6f8006a770 msgr2=0x7f6f8006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:46.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.855+0000 7f6f7f7fe700 1 --2- 172.21.15.146:0/364827110 >> v2:172.21.15.146:3300/0 conn(0x7f6f8006a770 0x7f6f8006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.855+0000 7f6f7f7fe700 1 -- 172.21.15.146:0/364827110 >> v1:172.21.15.146:6789/0 conn(0x7f6f8006b080 legacy=0x7f6f801317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.855+0000 7f6f7f7fe700 1 -- 172.21.15.146:0/364827110 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8009d860 con 0x7f6f80131ec0 2023-10-03T10:14:46.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.855+0000 7f6f7f7fe700 1 --2- 172.21.15.146:0/364827110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f80131ec0 0x7f6f80139c20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6f78009d90 tx=0x7f6f7800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84fdf370e4fd43fa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.855+0000 7f6f7dffb700 1 -- 172.21.15.146:0/364827110 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7800e070 con 0x7f6f80131ec0 2023-10-03T10:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.855+0000 7f6f7dffb700 1 -- 172.21.15.146:0/364827110 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7800bb20 con 0x7f6f80131ec0 2023-10-03T10:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.855+0000 7f6f7dffb700 1 -- 172.21.15.146:0/364827110 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7800be90 con 0x7f6f80131ec0 2023-10-03T10:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.856+0000 7f6f856d2700 1 -- 172.21.15.146:0/364827110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f80131ec0 msgr2=0x7f6f80139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.856+0000 7f6f856d2700 1 --2- 172.21.15.146:0/364827110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f80131ec0 0x7f6f80139c20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6f78009d90 tx=0x7f6f7800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.856+0000 7f6f856d2700 1 -- 172.21.15.146:0/364827110 shutdown_connections 2023-10-03T10:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.856+0000 7f6f856d2700 1 --2- 172.21.15.146:0/364827110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f80131ec0 0x7f6f80139c20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.856+0000 7f6f856d2700 1 --2- 172.21.15.146:0/364827110 >> v2:172.21.15.146:3300/0 conn(0x7f6f8006a770 0x7f6f8006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.856+0000 7f6f856d2700 1 -- 172.21.15.146:0/364827110 >> 172.21.15.146:0/364827110 conn(0x7f6f80099c40 msgr2=0x7f6f800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.856+0000 7f6f856d2700 1 -- 172.21.15.146:0/364827110 shutdown_connections 2023-10-03T10:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.856+0000 7f6f856d2700 1 -- 172.21.15.146:0/364827110 wait complete. 2023-10-03T10:14:46.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.857+0000 7f6f856d2700 1 Processor -- start 2023-10-03T10:14:46.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.858+0000 7f6f856d2700 1 -- start start 2023-10-03T10:14:46.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.858+0000 7f6f856d2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f8006a770 0x7f6f801c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.858+0000 7f6f856d2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f8006b080 0x7f6f801c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.858+0000 7f6f856d2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f80131ec0 0x7f6f801c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.858+0000 7f6f856d2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8011d640 con 0x7f6f80131ec0 2023-10-03T10:14:46.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.858+0000 7f6f856d2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8011d450 con 0x7f6f8006a770 2023-10-03T10:14:46.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.858+0000 7f6f856d2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8011f360 con 0x7f6f8006b080 2023-10-03T10:14:46.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.858+0000 7f6f7f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f80131ec0 0x7f6f801c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.858+0000 7f6f7f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f80131ec0 0x7f6f801c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50890/0 (socket says 172.21.15.146:50890) 2023-10-03T10:14:46.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.858+0000 7f6f7f7fe700 1 -- 172.21.15.146:0/374013578 learned_addr learned my addr 172.21.15.146:0/374013578 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:46.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.858+0000 7f6f7effd700 1 --2- 172.21.15.146:0/374013578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f8006a770 0x7f6f801c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.858+0000 7f6f7e7fc700 1 --2- 172.21.15.146:0/374013578 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f8006b080 0x7f6f801c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.859+0000 7f6f7f7fe700 1 -- 172.21.15.146:0/374013578 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f8006b080 msgr2=0x7f6f801c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.859+0000 7f6f7f7fe700 1 --2- 172.21.15.146:0/374013578 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f8006b080 0x7f6f801c63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.859+0000 7f6f7f7fe700 1 -- 172.21.15.146:0/374013578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f8006a770 msgr2=0x7f6f801c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.859+0000 7f6f7f7fe700 1 --2- 172.21.15.146:0/374013578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f8006a770 0x7f6f801c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.859+0000 7f6f7f7fe700 1 -- 172.21.15.146:0/374013578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f78009a70 con 0x7f6f80131ec0 2023-10-03T10:14:46.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.859+0000 7f6f7f7fe700 1 --2- 172.21.15.146:0/374013578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f80131ec0 0x7f6f801c6920 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800b370 tx=0x7f6f78004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.859+0000 7f6f677fe700 1 -- 172.21.15.146:0/374013578 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7801f7a0 con 0x7f6f80131ec0 2023-10-03T10:14:46.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.859+0000 7f6f677fe700 1 -- 172.21.15.146:0/374013578 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f78023070 con 0x7f6f80131ec0 2023-10-03T10:14:46.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.859+0000 7f6f856d2700 1 -- 172.21.15.146:0/374013578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f800a2a70 con 0x7f6f80131ec0 2023-10-03T10:14:46.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.859+0000 7f6f856d2700 1 -- 172.21.15.146:0/374013578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8011dc40 con 0x7f6f80131ec0 2023-10-03T10:14:46.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.859+0000 7f6f677fe700 1 -- 172.21.15.146:0/374013578 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7801fb40 con 0x7f6f80131ec0 2023-10-03T10:14:46.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.860+0000 7f6f856d2700 1 -- 172.21.15.146:0/374013578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f600052e0 con 0x7f6f80131ec0 2023-10-03T10:14:46.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.861+0000 7f6f677fe700 1 -- 172.21.15.146:0/374013578 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f7801fca0 con 0x7f6f80131ec0 2023-10-03T10:14:46.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.861+0000 7f6f677fe700 1 -- 172.21.15.146:0/374013578 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6f78025070 con 0x7f6f80131ec0 2023-10-03T10:14:46.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.869+0000 7f6f677fe700 1 -- 172.21.15.146:0/374013578 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f780117a0 con 0x7f6f80131ec0 2023-10-03T10:14:46.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.897+0000 7f147065e700 1 Processor -- start 2023-10-03T10:14:46.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.897+0000 7f147065e700 1 -- start start 2023-10-03T10:14:46.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.897+0000 7f147065e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1468134140 0x7f1468138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.897+0000 7f147065e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f14681345a0 0x7f146813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.897+0000 7f147065e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f146809b110 con 0x7f146809ad40 2023-10-03T10:14:46.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.897+0000 7f147065e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14680a3b60 con 0x7f1468134140 2023-10-03T10:14:46.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.897+0000 7f147065e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14680a1a80 con 0x7f14681345a0 2023-10-03T10:14:46.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.897+0000 7f146e3fa700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f146809ad40 0x7f1468133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48696/0 (socket says 172.21.15.146:48696) 2023-10-03T10:14:46.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.897+0000 7f146e3fa700 1 -- 172.21.15.146:0/1114707496 learned_addr learned my addr 172.21.15.146:0/1114707496 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:46.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.897+0000 7f146dbf9700 1 --2- 172.21.15.146:0/1114707496 >> v2:172.21.15.146:3300/0 conn(0x7f1468134140 0x7f1468138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.898+0000 7f146ebfb700 1 --2- 172.21.15.146:0/1114707496 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f14681345a0 0x7f146813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.898+0000 7f146dbf9700 1 -- 172.21.15.146:0/1114707496 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f14681345a0 msgr2=0x7f146813b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:46.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.898+0000 7f146dbf9700 1 --2- 172.21.15.146:0/1114707496 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f14681345a0 0x7f146813b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.898+0000 7f146dbf9700 1 -- 172.21.15.146:0/1114707496 >> v1:172.21.15.146:6789/0 conn(0x7f146809ad40 legacy=0x7f1468133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.898+0000 7f146dbf9700 1 -- 172.21.15.146:0/1114707496 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14680a2fa0 con 0x7f1468134140 2023-10-03T10:14:46.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.898+0000 7f146d3f8700 1 -- 172.21.15.146:0/1114707496 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1924815238 0 0) 0x7f146809b110 con 0x7f146809ad40 2023-10-03T10:14:46.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.898+0000 7f146dbf9700 1 --2- 172.21.15.146:0/1114707496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1468134140 0x7f1468138e80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1458009840 tx=0x7f1458009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61fb78ee8194ad31 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.898+0000 7f146d3f8700 1 -- 172.21.15.146:0/1114707496 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1458011830 con 0x7f1468134140 2023-10-03T10:14:46.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.898+0000 7f146d3f8700 1 -- 172.21.15.146:0/1114707496 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1458011990 con 0x7f1468134140 2023-10-03T10:14:46.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.898+0000 7f146d3f8700 1 -- 172.21.15.146:0/1114707496 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1458011d20 con 0x7f1468134140 2023-10-03T10:14:46.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.899+0000 7f147065e700 1 -- 172.21.15.146:0/1114707496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1468134140 msgr2=0x7f1468138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.899+0000 7f147065e700 1 --2- 172.21.15.146:0/1114707496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1468134140 0x7f1468138e80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1458009840 tx=0x7f1458009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:46.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.899+0000 7f147065e700 1 -- 172.21.15.146:0/1114707496 shutdown_connections 2023-10-03T10:14:46.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.899+0000 7f147065e700 1 --2- 172.21.15.146:0/1114707496 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f14681345a0 0x7f146813b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.899+0000 7f147065e700 1 --2- 172.21.15.146:0/1114707496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1468134140 0x7f1468138e80 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.899+0000 7f147065e700 1 -- 172.21.15.146:0/1114707496 >> 172.21.15.146:0/1114707496 conn(0x7f1468099c40 msgr2=0x7f146806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.899+0000 7f147065e700 1 -- 172.21.15.146:0/1114707496 shutdown_connections 2023-10-03T10:14:46.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.899+0000 7f147065e700 1 -- 172.21.15.146:0/1114707496 wait complete. 2023-10-03T10:14:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.900+0000 7f147065e700 1 Processor -- start 2023-10-03T10:14:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.901+0000 7f147065e700 1 -- start start 2023-10-03T10:14:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.901+0000 7f147065e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f146809ad40 0x7f1468139480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.901+0000 7f147065e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1468134140 0x7f14681399c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.901+0000 7f147065e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f14681345a0 0x7f1468139f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.901+0000 7f147065e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146811ce30 con 0x7f146809ad40 2023-10-03T10:14:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.901+0000 7f147065e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146811e080 con 0x7f1468134140 2023-10-03T10:14:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.901+0000 7f147065e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f146811d690 con 0x7f14681345a0 2023-10-03T10:14:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.901+0000 7f146ebfb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f14681345a0 0x7f1468139f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.901+0000 7f146ebfb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f14681345a0 0x7f1468139f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38934/0 (socket says 172.21.15.146:38934) 2023-10-03T10:14:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.901+0000 7f146ebfb700 1 -- 172.21.15.146:0/516647181 learned_addr learned my addr 172.21.15.146:0/516647181 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.902+0000 7f146dbf9700 1 --2- 172.21.15.146:0/516647181 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1468134140 0x7f14681399c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.902+0000 7f146e3fa700 1 --2- 172.21.15.146:0/516647181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f146809ad40 0x7f1468139480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.902+0000 7f146ebfb700 1 -- 172.21.15.146:0/516647181 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1468134140 msgr2=0x7f14681399c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.902+0000 7f146ebfb700 1 --2- 172.21.15.146:0/516647181 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1468134140 0x7f14681399c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.902+0000 7f146ebfb700 1 -- 172.21.15.146:0/516647181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f146809ad40 msgr2=0x7f1468139480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.902+0000 7f146ebfb700 1 --2- 172.21.15.146:0/516647181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f146809ad40 0x7f1468139480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.902+0000 7f146ebfb700 1 -- 172.21.15.146:0/516647181 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14580094a0 con 0x7f14681345a0 2023-10-03T10:14:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.902+0000 7f146ebfb700 1 --2- 172.21.15.146:0/516647181 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f14681345a0 0x7f1468139f00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1460009dd0 tx=0x7f146000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.902+0000 7f145effd700 1 -- 172.21.15.146:0/516647181 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460009c40 con 0x7f14681345a0 2023-10-03T10:14:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.902+0000 7f145effd700 1 -- 172.21.15.146:0/516647181 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146000f040 con 0x7f14681345a0 2023-10-03T10:14:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.902+0000 7f145effd700 1 -- 172.21.15.146:0/516647181 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146000ceb0 con 0x7f14681345a0 2023-10-03T10:14:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.902+0000 7f147065e700 1 -- 172.21.15.146:0/516647181 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146811e4d0 con 0x7f14681345a0 2023-10-03T10:14:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.902+0000 7f147065e700 1 -- 172.21.15.146:0/516647181 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146811ea60 con 0x7f14681345a0 2023-10-03T10:14:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.903+0000 7f145effd700 1 -- 172.21.15.146:0/516647181 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1460014480 con 0x7f14681345a0 2023-10-03T10:14:46.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.904+0000 7f145effd700 1 -- 172.21.15.146:0/516647181 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1460040180 con 0x7f14681345a0 2023-10-03T10:14:46.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.904+0000 7f147065e700 1 -- 172.21.15.146:0/516647181 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14681361e0 con 0x7f14681345a0 2023-10-03T10:14:46.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.908+0000 7f145effd700 1 -- 172.21.15.146:0/516647181 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1460018020 con 0x7f14681345a0 2023-10-03T10:14:46.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.948+0000 7f3ae6a38700 1 Processor -- start 2023-10-03T10:14:46.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.948+0000 7f3ae6a38700 1 -- start start 2023-10-03T10:14:46.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.949+0000 7f3ae6a38700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ae009e870 0x7f3ae009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.949+0000 7f3ae6a38700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ae009f180 0x7f3ae0131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.949+0000 7f3ae6a38700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae009c970 con 0x7f3ae0131d70 2023-10-03T10:14:46.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.949+0000 7f3ae6a38700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae00a0920 con 0x7f3ae009f180 2023-10-03T10:14:46.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.949+0000 7f3ae6a38700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae009f9c0 con 0x7f3ae009e870 2023-10-03T10:14:46.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.949+0000 7f3adf7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ae009f180 0x7f3ae0131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.949+0000 7f3adf7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ae009f180 0x7f3ae0131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:54154/0 (socket says 172.21.15.146:54154) 2023-10-03T10:14:46.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.949+0000 7f3adf7fe700 1 -- 172.21.15.146:0/3170461803 learned_addr learned my addr 172.21.15.146:0/3170461803 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:46.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.949+0000 7f3adffff700 1 --2- 172.21.15.146:0/3170461803 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ae009e870 0x7f3ae009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.949+0000 7f3adffff700 1 -- 172.21.15.146:0/3170461803 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ae009f180 msgr2=0x7f3ae0131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:46.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.949+0000 7f3adffff700 1 --2- 172.21.15.146:0/3170461803 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ae009f180 0x7f3ae0131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.950+0000 7f3adffff700 1 -- 172.21.15.146:0/3170461803 >> v1:172.21.15.146:6789/0 conn(0x7f3ae0131d70 legacy=0x7f3ae0138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.949+0000 7f3adeffd700 1 -- 172.21.15.146:0/3170461803 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3613173850 0 0) 0x7f3ae009c970 con 0x7f3ae0131d70 2023-10-03T10:14:46.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.950+0000 7f3adffff700 1 -- 172.21.15.146:0/3170461803 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae009bab0 con 0x7f3ae009e870 2023-10-03T10:14:46.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.950+0000 7f3adf7fe700 1 --2- 172.21.15.146:0/3170461803 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ae009f180 0x7f3ae0131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:46.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.950+0000 7f3adffff700 1 --2- 172.21.15.146:0/3170461803 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ae009e870 0x7f3ae009ec40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009870 tx=0x7f3ad0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94f8d4bee4cda090 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.950+0000 7f3adeffd700 1 -- 172.21.15.146:0/3170461803 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0011830 con 0x7f3ae009e870 2023-10-03T10:14:46.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.950+0000 7f3adeffd700 1 -- 172.21.15.146:0/3170461803 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad0011990 con 0x7f3ae009e870 2023-10-03T10:14:46.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.950+0000 7f3adeffd700 1 -- 172.21.15.146:0/3170461803 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0011d20 con 0x7f3ae009e870 2023-10-03T10:14:46.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.950+0000 7f3ae6a38700 1 -- 172.21.15.146:0/3170461803 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ae009e870 msgr2=0x7f3ae009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.951+0000 7f3ae6a38700 1 --2- 172.21.15.146:0/3170461803 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ae009e870 0x7f3ae009ec40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009870 tx=0x7f3ad0009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:46.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.951+0000 7f3ae6a38700 1 -- 172.21.15.146:0/3170461803 shutdown_connections 2023-10-03T10:14:46.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.951+0000 7f3ae6a38700 1 --2- 172.21.15.146:0/3170461803 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ae009e870 0x7f3ae009ec40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.951+0000 7f3ae6a38700 1 --2- 172.21.15.146:0/3170461803 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ae009f180 0x7f3ae0131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.951+0000 7f3ae6a38700 1 -- 172.21.15.146:0/3170461803 >> 172.21.15.146:0/3170461803 conn(0x7f3ae00a4430 msgr2=0x7f3ae00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.951+0000 7f3ae6a38700 1 -- 172.21.15.146:0/3170461803 shutdown_connections 2023-10-03T10:14:46.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.951+0000 7f3ae6a38700 1 -- 172.21.15.146:0/3170461803 wait complete. 2023-10-03T10:14:46.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.952+0000 7f3ae6a38700 1 Processor -- start 2023-10-03T10:14:46.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.952+0000 7f3ae6a38700 1 -- start start 2023-10-03T10:14:46.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.953+0000 7f3ae6a38700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ae009e870 0x7f3ae006c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.953+0000 7f3ae6a38700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ae009f180 0x7f3ae006c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.953+0000 7f3ae6a38700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae0131d70 0x7f3ae01c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.953+0000 7f3ae6a38700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae01220b0 con 0x7f3ae0131d70 2023-10-03T10:14:46.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.953+0000 7f3ae6a38700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae0131410 con 0x7f3ae009f180 2023-10-03T10:14:46.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.953+0000 7f3ae6a38700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae006bd90 con 0x7f3ae009e870 2023-10-03T10:14:46.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.953+0000 7f3ae4fd5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae0131d70 0x7f3ae01c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.953+0000 7f3ae4fd5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae0131d70 0x7f3ae01c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50928/0 (socket says 172.21.15.146:50928) 2023-10-03T10:14:46.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.953+0000 7f3ae4fd5700 1 -- 172.21.15.146:0/1924241991 learned_addr learned my addr 172.21.15.146:0/1924241991 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:46.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.953+0000 7f3adffff700 1 --2- 172.21.15.146:0/1924241991 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ae009e870 0x7f3ae006c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.953+0000 7f3adf7fe700 1 --2- 172.21.15.146:0/1924241991 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ae009f180 0x7f3ae006c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.953+0000 7f3ae4fd5700 1 -- 172.21.15.146:0/1924241991 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ae009e870 msgr2=0x7f3ae006c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.953+0000 7f3ae4fd5700 1 --2- 172.21.15.146:0/1924241991 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ae009e870 0x7f3ae006c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.953+0000 7f3ae4fd5700 1 -- 172.21.15.146:0/1924241991 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ae009f180 msgr2=0x7f3ae006c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.953+0000 7f3ae4fd5700 1 --2- 172.21.15.146:0/1924241991 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ae009f180 0x7f3ae006c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.953+0000 7f3ae4fd5700 1 -- 172.21.15.146:0/1924241991 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad4009550 con 0x7f3ae0131d70 2023-10-03T10:14:46.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.953+0000 7f3ae4fd5700 1 --2- 172.21.15.146:0/1924241991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae0131d70 0x7f3ae01c8230 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800c810 tx=0x7f3ad800cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.954+0000 7f3adcff9700 1 -- 172.21.15.146:0/1924241991 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8003e30 con 0x7f3ae0131d70 2023-10-03T10:14:46.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.954+0000 7f3adcff9700 1 -- 172.21.15.146:0/1924241991 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad8005070 con 0x7f3ae0131d70 2023-10-03T10:14:46.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.954+0000 7f3ae6a38700 1 -- 172.21.15.146:0/1924241991 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad00094a0 con 0x7f3ae0131d70 2023-10-03T10:14:46.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.954+0000 7f3adcff9700 1 -- 172.21.15.146:0/1924241991 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8005420 con 0x7f3ae0131d70 2023-10-03T10:14:46.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.954+0000 7f3ae6a38700 1 -- 172.21.15.146:0/1924241991 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae00a2b90 con 0x7f3ae0131d70 2023-10-03T10:14:46.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.955+0000 7f3ae6a38700 1 -- 172.21.15.146:0/1924241991 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae004f2a0 con 0x7f3ae0131d70 2023-10-03T10:14:46.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.955+0000 7f3adcff9700 1 -- 172.21.15.146:0/1924241991 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ad8005580 con 0x7f3ae0131d70 2023-10-03T10:14:46.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.955+0000 7f3adcff9700 1 -- 172.21.15.146:0/1924241991 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3ad803fee0 con 0x7f3ae0131d70 2023-10-03T10:14:46.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:46.964+0000 7f3adcff9700 1 -- 172.21.15.146:0/1924241991 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ad8005830 con 0x7f3ae0131d70 2023-10-03T10:14:47.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.038+0000 7f3a719db700 1 -- 172.21.15.146:0/3699249453 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3a6c04f2a0 con 0x7f3a6c09d860 2023-10-03T10:14:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.038+0000 7f3a53fff700 1 -- 172.21.15.146:0/3699249453 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3a5c018260 con 0x7f3a6c09d860 2023-10-03T10:14:47.038 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:47.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.040+0000 7f3a719db700 1 -- 172.21.15.146:0/3699249453 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a6c09d860 msgr2=0x7f3a6c11c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.040+0000 7f3a719db700 1 --2- 172.21.15.146:0/3699249453 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a6c09d860 0x7f3a6c11c2c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00c700 tx=0x7f3a5c00ca10 comp rx=0 tx=0).stop 2023-10-03T10:14:47.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.040+0000 7f3a719db700 1 -- 172.21.15.146:0/3699249453 shutdown_connections 2023-10-03T10:14:47.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.040+0000 7f3a719db700 1 --2- 172.21.15.146:0/3699249453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a6c135f20 0x7f3a6c11cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.040+0000 7f3a719db700 1 --2- 172.21.15.146:0/3699249453 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a6c09d860 0x7f3a6c11c2c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.040+0000 7f3a719db700 1 --2- 172.21.15.146:0/3699249453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a6c09e340 0x7f3a6c11c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.040+0000 7f3a719db700 1 -- 172.21.15.146:0/3699249453 >> 172.21.15.146:0/3699249453 conn(0x7f3a6c099c40 msgr2=0x7f3a6c06ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.041+0000 7f3a719db700 1 -- 172.21.15.146:0/3699249453 shutdown_connections 2023-10-03T10:14:47.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.041+0000 7f3a719db700 1 -- 172.21.15.146:0/3699249453 wait complete. 2023-10-03T10:14:47.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:47.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.073+0000 7f6f856d2700 1 -- 172.21.15.146:0/374013578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6f60005860 con 0x7f6f80131ec0 2023-10-03T10:14:47.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.073+0000 7f6f677fe700 1 -- 172.21.15.146:0/374013578 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6f78038070 con 0x7f6f80131ec0 2023-10-03T10:14:47.073 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:47.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.076+0000 7f6f856d2700 1 -- 172.21.15.146:0/374013578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f80131ec0 msgr2=0x7f6f801c6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.076+0000 7f6f856d2700 1 --2- 172.21.15.146:0/374013578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f80131ec0 0x7f6f801c6920 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800b370 tx=0x7f6f78004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.076+0000 7f6f856d2700 1 -- 172.21.15.146:0/374013578 shutdown_connections 2023-10-03T10:14:47.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.076+0000 7f6f856d2700 1 --2- 172.21.15.146:0/374013578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f80131ec0 0x7f6f801c6920 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.076+0000 7f6f856d2700 1 --2- 172.21.15.146:0/374013578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f8006a770 0x7f6f801c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.076+0000 7f6f856d2700 1 --2- 172.21.15.146:0/374013578 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f8006b080 0x7f6f801c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.076+0000 7f6f856d2700 1 -- 172.21.15.146:0/374013578 >> 172.21.15.146:0/374013578 conn(0x7f6f80099c40 msgr2=0x7f6f801308a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.076+0000 7f6f856d2700 1 -- 172.21.15.146:0/374013578 shutdown_connections 2023-10-03T10:14:47.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.076+0000 7f6f856d2700 1 -- 172.21.15.146:0/374013578 wait complete. 2023-10-03T10:14:47.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:47.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.104+0000 7f147065e700 1 -- 172.21.15.146:0/516647181 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f146804f2a0 con 0x7f14681345a0 2023-10-03T10:14:47.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.105+0000 7f145effd700 1 -- 172.21.15.146:0/516647181 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f146002b090 con 0x7f14681345a0 2023-10-03T10:14:47.104 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:47.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.106+0000 7f147065e700 1 -- 172.21.15.146:0/516647181 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f14681345a0 msgr2=0x7f1468139f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.106+0000 7f147065e700 1 --2- 172.21.15.146:0/516647181 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f14681345a0 0x7f1468139f00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1460009dd0 tx=0x7f146000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.107+0000 7f147065e700 1 -- 172.21.15.146:0/516647181 shutdown_connections 2023-10-03T10:14:47.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.107+0000 7f147065e700 1 --2- 172.21.15.146:0/516647181 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f14681345a0 0x7f1468139f00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.107+0000 7f147065e700 1 --2- 172.21.15.146:0/516647181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f146809ad40 0x7f1468139480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.107+0000 7f147065e700 1 --2- 172.21.15.146:0/516647181 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1468134140 0x7f14681399c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.107+0000 7f147065e700 1 -- 172.21.15.146:0/516647181 >> 172.21.15.146:0/516647181 conn(0x7f1468099c40 msgr2=0x7f146813b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.107+0000 7f147065e700 1 -- 172.21.15.146:0/516647181 shutdown_connections 2023-10-03T10:14:47.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.107+0000 7f147065e700 1 -- 172.21.15.146:0/516647181 wait complete. 2023-10-03T10:14:47.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:47.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.157+0000 7f3ae6a38700 1 -- 172.21.15.146:0/1924241991 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3ae0120ea0 con 0x7f3ae0131d70 2023-10-03T10:14:47.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.158+0000 7f3adcff9700 1 -- 172.21.15.146:0/1924241991 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ad80243e0 con 0x7f3ae0131d70 2023-10-03T10:14:47.157 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:47.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.160+0000 7f3ae6a38700 1 -- 172.21.15.146:0/1924241991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae0131d70 msgr2=0x7f3ae01c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.160+0000 7f3ae6a38700 1 --2- 172.21.15.146:0/1924241991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae0131d70 0x7f3ae01c8230 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800c810 tx=0x7f3ad800cb20 comp rx=0 tx=0).stop 2023-10-03T10:14:47.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.160+0000 7f3ae6a38700 1 -- 172.21.15.146:0/1924241991 shutdown_connections 2023-10-03T10:14:47.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.160+0000 7f3ae6a38700 1 --2- 172.21.15.146:0/1924241991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae0131d70 0x7f3ae01c8230 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.160+0000 7f3ae6a38700 1 --2- 172.21.15.146:0/1924241991 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ae009e870 0x7f3ae006c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.160+0000 7f3ae6a38700 1 --2- 172.21.15.146:0/1924241991 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ae009f180 0x7f3ae006c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.160+0000 7f3ae6a38700 1 -- 172.21.15.146:0/1924241991 >> 172.21.15.146:0/1924241991 conn(0x7f3ae00a4430 msgr2=0x7f3ae01b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.160+0000 7f3ae6a38700 1 -- 172.21.15.146:0/1924241991 shutdown_connections 2023-10-03T10:14:47.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:47.160+0000 7f3ae6a38700 1 -- 172.21.15.146:0/1924241991 wait complete. 2023-10-03T10:14:47.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:48.053 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:48.088 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:48.118 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:48.173 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:48.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.202+0000 7ff31b313700 1 Processor -- start 2023-10-03T10:14:48.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.202+0000 7ff31b313700 1 -- start start 2023-10-03T10:14:48.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.203+0000 7ff31b313700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3141368e0 0x7ff314138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.203+0000 7ff31b313700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff314139200 0x7ff31413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.203+0000 7ff31b313700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31409a760 con 0x7ff314133900 2023-10-03T10:14:48.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.203+0000 7ff31b313700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3141336e0 con 0x7ff314139200 2023-10-03T10:14:48.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.203+0000 7ff31b313700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff31409a080 con 0x7ff3141368e0 2023-10-03T10:14:48.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.203+0000 7ff3188ae700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3141368e0 0x7ff314138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.203+0000 7ff3188ae700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3141368e0 0x7ff314138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38972/0 (socket says 172.21.15.146:38972) 2023-10-03T10:14:48.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.203+0000 7ff3188ae700 1 -- 172.21.15.146:0/2577402804 learned_addr learned my addr 172.21.15.146:0/2577402804 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:48.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.204+0000 7ff3198b0700 1 --2- 172.21.15.146:0/2577402804 >> v2:172.21.15.146:3300/0 conn(0x7ff314139200 0x7ff31413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.204+0000 7ff3188ae700 1 -- 172.21.15.146:0/2577402804 >> v2:172.21.15.146:3300/0 conn(0x7ff314139200 msgr2=0x7ff31413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.204+0000 7ff3188ae700 1 --2- 172.21.15.146:0/2577402804 >> v2:172.21.15.146:3300/0 conn(0x7ff314139200 0x7ff31413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.204+0000 7ff3188ae700 1 -- 172.21.15.146:0/2577402804 >> v1:172.21.15.146:6789/0 conn(0x7ff314133900 legacy=0x7ff314133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.204+0000 7ff30bfff700 1 -- 172.21.15.146:0/2577402804 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834670492 0 0) 0x7ff31409a760 con 0x7ff314133900 2023-10-03T10:14:48.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.204+0000 7ff3188ae700 1 -- 172.21.15.146:0/2577402804 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3140a23e0 con 0x7ff3141368e0 2023-10-03T10:14:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.204+0000 7ff3188ae700 1 --2- 172.21.15.146:0/2577402804 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3141368e0 0x7ff314138cc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff3040098f0 tx=0x7ff304009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec231caeb9d75a4b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.204+0000 7ff30bfff700 1 -- 172.21.15.146:0/2577402804 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304011830 con 0x7ff3141368e0 2023-10-03T10:14:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.204+0000 7ff30bfff700 1 -- 172.21.15.146:0/2577402804 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff304011990 con 0x7ff3141368e0 2023-10-03T10:14:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.204+0000 7ff30bfff700 1 -- 172.21.15.146:0/2577402804 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304011d20 con 0x7ff3141368e0 2023-10-03T10:14:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.205+0000 7ff31b313700 1 -- 172.21.15.146:0/2577402804 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3141368e0 msgr2=0x7ff314138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.205+0000 7ff31b313700 1 --2- 172.21.15.146:0/2577402804 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3141368e0 0x7ff314138cc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff3040098f0 tx=0x7ff304009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.205+0000 7ff31b313700 1 -- 172.21.15.146:0/2577402804 shutdown_connections 2023-10-03T10:14:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.205+0000 7ff31b313700 1 --2- 172.21.15.146:0/2577402804 >> v2:172.21.15.146:3300/0 conn(0x7ff314139200 0x7ff31413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.205+0000 7ff31b313700 1 --2- 172.21.15.146:0/2577402804 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3141368e0 0x7ff314138cc0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.205+0000 7ff31b313700 1 -- 172.21.15.146:0/2577402804 >> 172.21.15.146:0/2577402804 conn(0x7ff3140a2980 msgr2=0x7ff3140a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.205+0000 7ff31b313700 1 -- 172.21.15.146:0/2577402804 shutdown_connections 2023-10-03T10:14:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.205+0000 7ff31b313700 1 -- 172.21.15.146:0/2577402804 wait complete. 2023-10-03T10:14:48.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.206+0000 7ff31b313700 1 Processor -- start 2023-10-03T10:14:48.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.206+0000 7ff31b313700 1 -- start start 2023-10-03T10:14:48.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.207+0000 7ff31b313700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff314133900 0x7ff31411ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.207+0000 7ff31b313700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3141368e0 0x7ff31411b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.207+0000 7ff31b313700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff314139200 0x7ff31411b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.207+0000 7ff31b313700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31411e7b0 con 0x7ff314133900 2023-10-03T10:14:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.207+0000 7ff31b313700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31411c2f0 con 0x7ff314139200 2023-10-03T10:14:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.207+0000 7ff31b313700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff31411dd60 con 0x7ff3141368e0 2023-10-03T10:14:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.207+0000 7ff3190af700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff314133900 0x7ff31411ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.207+0000 7ff3190af700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff314133900 0x7ff31411ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50944/0 (socket says 172.21.15.146:50944) 2023-10-03T10:14:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.207+0000 7ff3190af700 1 -- 172.21.15.146:0/3980500146 learned_addr learned my addr 172.21.15.146:0/3980500146 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.207+0000 7ff3188ae700 1 --2- 172.21.15.146:0/3980500146 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3141368e0 0x7ff31411b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.207+0000 7ff3190af700 1 -- 172.21.15.146:0/3980500146 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3141368e0 msgr2=0x7ff31411b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.207+0000 7ff3190af700 1 --2- 172.21.15.146:0/3980500146 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3141368e0 0x7ff31411b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.207+0000 7ff3190af700 1 -- 172.21.15.146:0/3980500146 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff314139200 msgr2=0x7ff31411b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.207+0000 7ff3190af700 1 --2- 172.21.15.146:0/3980500146 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff314139200 0x7ff31411b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.207+0000 7ff3190af700 1 -- 172.21.15.146:0/3980500146 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff304009550 con 0x7ff314133900 2023-10-03T10:14:48.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.207+0000 7ff3190af700 1 --2- 172.21.15.146:0/3980500146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff314133900 0x7ff31411ae90 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff31000c580 tx=0x7ff31000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.208+0000 7ff309ffb700 1 -- 172.21.15.146:0/3980500146 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3100054e0 con 0x7ff314133900 2023-10-03T10:14:48.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.208+0000 7ff31b313700 1 -- 172.21.15.146:0/3980500146 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff31411d8a0 con 0x7ff314133900 2023-10-03T10:14:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.208+0000 7ff309ffb700 1 -- 172.21.15.146:0/3980500146 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff310003680 con 0x7ff314133900 2023-10-03T10:14:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.208+0000 7ff309ffb700 1 -- 172.21.15.146:0/3980500146 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff310003a30 con 0x7ff314133900 2023-10-03T10:14:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.208+0000 7ff31b313700 1 -- 172.21.15.146:0/3980500146 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31411cb90 con 0x7ff314133900 2023-10-03T10:14:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.209+0000 7ff309ffb700 1 -- 172.21.15.146:0/3980500146 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff310003b90 con 0x7ff314133900 2023-10-03T10:14:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.209+0000 7ff309ffb700 1 -- 172.21.15.146:0/3980500146 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff31003ec40 con 0x7ff314133900 2023-10-03T10:14:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.209+0000 7ff31b313700 1 -- 172.21.15.146:0/3980500146 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f40052e0 con 0x7ff314133900 2023-10-03T10:14:48.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.221+0000 7ff309ffb700 1 -- 172.21.15.146:0/3980500146 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff310017070 con 0x7ff314133900 2023-10-03T10:14:48.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.235+0000 7f46b08d2700 1 Processor -- start 2023-10-03T10:14:48.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.235+0000 7f46b08d2700 1 -- start start 2023-10-03T10:14:48.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.235+0000 7f46b08d2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f46ac09a130 0x7f46ac09e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.235+0000 7f46b08d2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46ac09edb0 0x7f46ac09f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.236+0000 7f46b08d2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ac072b30 con 0x7f46ac13c410 2023-10-03T10:14:48.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.236+0000 7f46b08d2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ac09a500 con 0x7f46ac09a130 2023-10-03T10:14:48.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.236+0000 7f46b08d2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac09f720 con 0x7f46ac09edb0 2023-10-03T10:14:48.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.236+0000 7f46a9d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46ac09edb0 0x7f46ac09f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.236+0000 7f46a9d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46ac09edb0 0x7f46ac09f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:54182/0 (socket says 172.21.15.146:54182) 2023-10-03T10:14:48.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.236+0000 7f46a9d9b700 1 -- 172.21.15.146:0/3895873233 learned_addr learned my addr 172.21.15.146:0/3895873233 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:48.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.236+0000 7f46aa59c700 1 --2- 172.21.15.146:0/3895873233 >> v2:172.21.15.146:3300/0 conn(0x7f46ac09a130 0x7f46ac09e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.236+0000 7f46a9d9b700 1 -- 172.21.15.146:0/3895873233 >> v2:172.21.15.146:3300/0 conn(0x7f46ac09a130 msgr2=0x7f46ac09e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.236+0000 7f46a9d9b700 1 --2- 172.21.15.146:0/3895873233 >> v2:172.21.15.146:3300/0 conn(0x7f46ac09a130 0x7f46ac09e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.236+0000 7f46a9d9b700 1 -- 172.21.15.146:0/3895873233 >> v1:172.21.15.146:6789/0 conn(0x7f46ac13c410 legacy=0x7f46ac13e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.236+0000 7f46a9d9b700 1 -- 172.21.15.146:0/3895873233 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac09fe00 con 0x7f46ac09edb0 2023-10-03T10:14:48.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.236+0000 7f46a9d9b700 1 --2- 172.21.15.146:0/3895873233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46ac09edb0 0x7f46ac09f1e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f46a00098f0 tx=0x7f46a0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29300303796c570f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.237+0000 7f46a959a700 1 -- 172.21.15.146:0/3895873233 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a0011830 con 0x7f46ac09edb0 2023-10-03T10:14:48.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.237+0000 7f46a959a700 1 -- 172.21.15.146:0/3895873233 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a0011990 con 0x7f46ac09edb0 2023-10-03T10:14:48.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.237+0000 7f46a959a700 1 -- 172.21.15.146:0/3895873233 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a0011d20 con 0x7f46ac09edb0 2023-10-03T10:14:48.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.237+0000 7f46b08d2700 1 -- 172.21.15.146:0/3895873233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46ac09edb0 msgr2=0x7f46ac09f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.237+0000 7f46b08d2700 1 --2- 172.21.15.146:0/3895873233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46ac09edb0 0x7f46ac09f1e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f46a00098f0 tx=0x7f46a0009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.237+0000 7f46b08d2700 1 -- 172.21.15.146:0/3895873233 shutdown_connections 2023-10-03T10:14:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.237+0000 7f46b08d2700 1 --2- 172.21.15.146:0/3895873233 >> v2:172.21.15.146:3300/0 conn(0x7f46ac09a130 0x7f46ac09e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.237+0000 7f46b08d2700 1 --2- 172.21.15.146:0/3895873233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46ac09edb0 0x7f46ac09f1e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.237+0000 7f46b08d2700 1 -- 172.21.15.146:0/3895873233 >> 172.21.15.146:0/3895873233 conn(0x7f46ac0a4430 msgr2=0x7f46ac0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.238+0000 7f46b08d2700 1 -- 172.21.15.146:0/3895873233 shutdown_connections 2023-10-03T10:14:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.238+0000 7f46b08d2700 1 -- 172.21.15.146:0/3895873233 wait complete. 2023-10-03T10:14:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.239+0000 7f46b08d2700 1 Processor -- start 2023-10-03T10:14:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.239+0000 7f46b08d2700 1 -- start start 2023-10-03T10:14:48.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.239+0000 7f46b08d2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f46ac09a130 0x7f46ac11b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.239+0000 7f46b08d2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46ac09edb0 0x7f46ac13a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.239+0000 7f46b08d2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46ac13c410 0x7f46ac13ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.239+0000 7f46b08d2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac11c3a0 con 0x7f46ac09edb0 2023-10-03T10:14:48.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.239+0000 7f46b08d2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac0a00f0 con 0x7f46ac13c410 2023-10-03T10:14:48.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.239+0000 7f46b08d2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac11df60 con 0x7f46ac09a130 2023-10-03T10:14:48.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.239+0000 7f46aad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46ac13c410 0x7f46ac13ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.239+0000 7f46aad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46ac13c410 0x7f46ac13ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:54188/0 (socket says 172.21.15.146:54188) 2023-10-03T10:14:48.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.239+0000 7f46aad9d700 1 -- 172.21.15.146:0/2706300573 learned_addr learned my addr 172.21.15.146:0/2706300573 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:48.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.239+0000 7f46a9d9b700 1 --2- 172.21.15.146:0/2706300573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46ac09edb0 0x7f46ac13a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.240+0000 7f46aad9d700 1 -- 172.21.15.146:0/2706300573 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f46ac09a130 msgr2=0x7f46ac11b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.240+0000 7f46aad9d700 1 --2- 172.21.15.146:0/2706300573 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f46ac09a130 0x7f46ac11b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.240+0000 7f46aad9d700 1 -- 172.21.15.146:0/2706300573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46ac09edb0 msgr2=0x7f46ac13a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.240+0000 7f46aad9d700 1 --2- 172.21.15.146:0/2706300573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46ac09edb0 0x7f46ac13a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.240+0000 7f46aad9d700 1 -- 172.21.15.146:0/2706300573 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a0009550 con 0x7f46ac13c410 2023-10-03T10:14:48.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.240+0000 7f46aad9d700 1 --2- 172.21.15.146:0/2706300573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46ac13c410 0x7f46ac13ace0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f46a400cb90 tx=0x7f46a400cf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.240+0000 7f469affd700 1 -- 172.21.15.146:0/2706300573 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a4003c00 con 0x7f46ac13c410 2023-10-03T10:14:48.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.240+0000 7f469affd700 1 -- 172.21.15.146:0/2706300573 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a4003d60 con 0x7f46ac13c410 2023-10-03T10:14:48.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.240+0000 7f469affd700 1 -- 172.21.15.146:0/2706300573 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a400abb0 con 0x7f46ac13c410 2023-10-03T10:14:48.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.240+0000 7f46b08d2700 1 -- 172.21.15.146:0/2706300573 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ac11ead0 con 0x7f46ac13c410 2023-10-03T10:14:48.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.240+0000 7f46b08d2700 1 -- 172.21.15.146:0/2706300573 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ac11ce00 con 0x7f46ac13c410 2023-10-03T10:14:48.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.241+0000 7f469affd700 1 -- 172.21.15.146:0/2706300573 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f46a400ad10 con 0x7f46ac13c410 2023-10-03T10:14:48.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.241+0000 7f46b08d2700 1 -- 172.21.15.146:0/2706300573 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ac04f2a0 con 0x7f46ac13c410 2023-10-03T10:14:48.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.241+0000 7f469affd700 1 -- 172.21.15.146:0/2706300573 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f46a403f810 con 0x7f46ac13c410 2023-10-03T10:14:48.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.251+0000 7f469affd700 1 -- 172.21.15.146:0/2706300573 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f46a40196c0 con 0x7f46ac13c410 2023-10-03T10:14:48.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.281+0000 7f12c22fe700 1 Processor -- start 2023-10-03T10:14:48.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.281+0000 7f12c22fe700 1 -- start start 2023-10-03T10:14:48.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.282+0000 7f12c22fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12bc09a090 0x7f12bc09e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.282+0000 7f12c22fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12bc09ee90 0x7f12bc09f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.282+0000 7f12c22fe700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12bc06bc80 con 0x7f12bc13c470 2023-10-03T10:14:48.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.282+0000 7f12c22fe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc09a460 con 0x7f12bc09ee90 2023-10-03T10:14:48.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.282+0000 7f12c22fe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc06c0f0 con 0x7f12bc09a090 2023-10-03T10:14:48.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.282+0000 7f12bbfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12bc09a090 0x7f12bc09e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.282+0000 7f12c089b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f12bc13c470 0x7f12bc13e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48736/0 (socket says 172.21.15.146:48736) 2023-10-03T10:14:48.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.282+0000 7f12c089b700 1 -- 172.21.15.146:0/3354086836 learned_addr learned my addr 172.21.15.146:0/3354086836 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:48.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.282+0000 7f12bb7fe700 1 --2- 172.21.15.146:0/3354086836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12bc09ee90 0x7f12bc09f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.282+0000 7f12bbfff700 1 -- 172.21.15.146:0/3354086836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12bc09ee90 msgr2=0x7f12bc09f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.282+0000 7f12bbfff700 1 --2- 172.21.15.146:0/3354086836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12bc09ee90 0x7f12bc09f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.282+0000 7f12bbfff700 1 -- 172.21.15.146:0/3354086836 >> v1:172.21.15.146:6789/0 conn(0x7f12bc13c470 legacy=0x7f12bc13e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.282+0000 7f12bbfff700 1 -- 172.21.15.146:0/3354086836 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc06d8f0 con 0x7f12bc09a090 2023-10-03T10:14:48.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.282+0000 7f12baffd700 1 -- 172.21.15.146:0/3354086836 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345249934 0 0) 0x7f12bc06bc80 con 0x7f12bc13c470 2023-10-03T10:14:48.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.282+0000 7f12bb7fe700 1 --2- 172.21.15.146:0/3354086836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12bc09ee90 0x7f12bc09f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:48.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.283+0000 7f12bbfff700 1 --2- 172.21.15.146:0/3354086836 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12bc09a090 0x7f12bc09e950 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009850 tx=0x7f12ac009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64dce769b24790b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.283+0000 7f12baffd700 1 -- 172.21.15.146:0/3354086836 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac005e30 con 0x7f12bc09a090 2023-10-03T10:14:48.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.283+0000 7f12baffd700 1 -- 172.21.15.146:0/3354086836 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac006030 con 0x7f12bc09a090 2023-10-03T10:14:48.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.283+0000 7f12baffd700 1 -- 172.21.15.146:0/3354086836 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac0063e0 con 0x7f12bc09a090 2023-10-03T10:14:48.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.283+0000 7f12c22fe700 1 -- 172.21.15.146:0/3354086836 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12bc09a090 msgr2=0x7f12bc09e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.283+0000 7f12c22fe700 1 --2- 172.21.15.146:0/3354086836 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12bc09a090 0x7f12bc09e950 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009850 tx=0x7f12ac009b60 comp rx=0 tx=0).stop 2023-10-03T10:14:48.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.284+0000 7f12c22fe700 1 -- 172.21.15.146:0/3354086836 shutdown_connections 2023-10-03T10:14:48.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.284+0000 7f12c22fe700 1 --2- 172.21.15.146:0/3354086836 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12bc09a090 0x7f12bc09e950 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.284+0000 7f12c22fe700 1 --2- 172.21.15.146:0/3354086836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12bc09ee90 0x7f12bc09f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.284+0000 7f12c22fe700 1 -- 172.21.15.146:0/3354086836 >> 172.21.15.146:0/3354086836 conn(0x7f12bc0a0f70 msgr2=0x7f12bc0a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.284+0000 7f12c22fe700 1 -- 172.21.15.146:0/3354086836 shutdown_connections 2023-10-03T10:14:48.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.284+0000 7f12c22fe700 1 -- 172.21.15.146:0/3354086836 wait complete. 2023-10-03T10:14:48.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.285+0000 7f12c22fe700 1 Processor -- start 2023-10-03T10:14:48.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.285+0000 7f12c22fe700 1 -- start start 2023-10-03T10:14:48.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.286+0000 7f12c22fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12bc09a090 0x7f12bc13a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.286+0000 7f12c22fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12bc09ee90 0x7f12bc13a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.286+0000 7f12c22fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12bc13c470 0x7f12bc1cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.286+0000 7f12c22fe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc128740 con 0x7f12bc09a090 2023-10-03T10:14:48.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.286+0000 7f12c22fe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0a0460 con 0x7f12bc09ee90 2023-10-03T10:14:48.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.286+0000 7f12c22fe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc09e1e0 con 0x7f12bc13c470 2023-10-03T10:14:48.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.286+0000 7f12bbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12bc09a090 0x7f12bc13a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.286+0000 7f12bbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12bc09a090 0x7f12bc13a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50976/0 (socket says 172.21.15.146:50976) 2023-10-03T10:14:48.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.286+0000 7f12bbfff700 1 -- 172.21.15.146:0/3881415774 learned_addr learned my addr 172.21.15.146:0/3881415774 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:48.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.286+0000 7f12bb7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12bc09ee90 0x7f12bc13a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.286+0000 7f12c089b700 1 --2- 172.21.15.146:0/3881415774 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12bc13c470 0x7f12bc1cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.287+0000 7f12bbfff700 1 -- 172.21.15.146:0/3881415774 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12bc13c470 msgr2=0x7f12bc1cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.287+0000 7f12bbfff700 1 --2- 172.21.15.146:0/3881415774 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12bc13c470 0x7f12bc1cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.287+0000 7f12bbfff700 1 -- 172.21.15.146:0/3881415774 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12bc09ee90 msgr2=0x7f12bc13a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.287+0000 7f12bbfff700 1 --2- 172.21.15.146:0/3881415774 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12bc09ee90 0x7f12bc13a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.287+0000 7f12bbfff700 1 -- 172.21.15.146:0/3881415774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b00094a0 con 0x7f12bc09a090 2023-10-03T10:14:48.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.287+0000 7f12bbfff700 1 --2- 172.21.15.146:0/3881415774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12bc09a090 0x7f12bc13a380 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f12ac013040 tx=0x7f12ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.287+0000 7f12b8ff9700 1 -- 172.21.15.146:0/3881415774 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac025470 con 0x7f12bc09a090 2023-10-03T10:14:48.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.287+0000 7f12b8ff9700 1 -- 172.21.15.146:0/3881415774 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac0255d0 con 0x7f12bc09a090 2023-10-03T10:14:48.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.287+0000 7f12c22fe700 1 -- 172.21.15.146:0/3881415774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ac009430 con 0x7f12bc09a090 2023-10-03T10:14:48.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.287+0000 7f12b8ff9700 1 -- 172.21.15.146:0/3881415774 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac025980 con 0x7f12bc09a090 2023-10-03T10:14:48.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.287+0000 7f12c22fe700 1 -- 172.21.15.146:0/3881415774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12bc128910 con 0x7f12bc09a090 2023-10-03T10:14:48.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.288+0000 7f12b8ff9700 1 -- 172.21.15.146:0/3881415774 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12ac022070 con 0x7f12bc09a090 2023-10-03T10:14:48.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.288+0000 7f12c22fe700 1 -- 172.21.15.146:0/3881415774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12bc1299f0 con 0x7f12bc09a090 2023-10-03T10:14:48.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.289+0000 7f12b8ff9700 1 -- 172.21.15.146:0/3881415774 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f12ac041280 con 0x7f12bc09a090 2023-10-03T10:14:48.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.293+0000 7f12b8ff9700 1 -- 172.21.15.146:0/3881415774 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12bc1299f0 con 0x7f12bc09a090 2023-10-03T10:14:48.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.313+0000 7f8449f1a700 1 Processor -- start 2023-10-03T10:14:48.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.313+0000 7f8449f1a700 1 -- start start 2023-10-03T10:14:48.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.314+0000 7f8449f1a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f844409e870 0x7f844409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.314+0000 7f8449f1a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f844409f180 0x7f8444131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.314+0000 7f8449f1a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f844409c970 con 0x7f8444131d70 2023-10-03T10:14:48.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.314+0000 7f8449f1a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84440a0920 con 0x7f844409f180 2023-10-03T10:14:48.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.314+0000 7f8449f1a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f844409f9c0 con 0x7f844409e870 2023-10-03T10:14:48.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.314+0000 7f84437fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f844409e870 0x7f844409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.314+0000 7f84437fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f844409e870 0x7f844409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39010/0 (socket says 172.21.15.146:39010) 2023-10-03T10:14:48.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.314+0000 7f84437fe700 1 -- 172.21.15.146:0/3590192129 learned_addr learned my addr 172.21.15.146:0/3590192129 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:48.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.314+0000 7f8442ffd700 1 --2- 172.21.15.146:0/3590192129 >> v2:172.21.15.146:3300/0 conn(0x7f844409f180 0x7f8444131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.314+0000 7f8442ffd700 1 -- 172.21.15.146:0/3590192129 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f844409e870 msgr2=0x7f844409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.314+0000 7f8442ffd700 1 --2- 172.21.15.146:0/3590192129 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f844409e870 0x7f844409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.314+0000 7f8442ffd700 1 -- 172.21.15.146:0/3590192129 >> v1:172.21.15.146:6789/0 conn(0x7f8444131d70 legacy=0x7f8444138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.314+0000 7f8442ffd700 1 -- 172.21.15.146:0/3590192129 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844409bab0 con 0x7f844409f180 2023-10-03T10:14:48.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.315+0000 7f8442ffd700 1 --2- 172.21.15.146:0/3590192129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f844409f180 0x7f8444131830 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8438009840 tx=0x7f8438009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ed6f7f8cb0d079 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.315+0000 7f84427fc700 1 -- 172.21.15.146:0/3590192129 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8438011830 con 0x7f844409f180 2023-10-03T10:14:48.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.315+0000 7f84427fc700 1 -- 172.21.15.146:0/3590192129 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8438011990 con 0x7f844409f180 2023-10-03T10:14:48.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.315+0000 7f84427fc700 1 -- 172.21.15.146:0/3590192129 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8438011d20 con 0x7f844409f180 2023-10-03T10:14:48.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.315+0000 7f8449f1a700 1 -- 172.21.15.146:0/3590192129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f844409f180 msgr2=0x7f8444131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.315+0000 7f8449f1a700 1 --2- 172.21.15.146:0/3590192129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f844409f180 0x7f8444131830 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8438009840 tx=0x7f8438009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:48.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.315+0000 7f8449f1a700 1 -- 172.21.15.146:0/3590192129 shutdown_connections 2023-10-03T10:14:48.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.315+0000 7f8449f1a700 1 --2- 172.21.15.146:0/3590192129 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f844409e870 0x7f844409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.315+0000 7f8449f1a700 1 --2- 172.21.15.146:0/3590192129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f844409f180 0x7f8444131830 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.315+0000 7f8449f1a700 1 -- 172.21.15.146:0/3590192129 >> 172.21.15.146:0/3590192129 conn(0x7f84440a4430 msgr2=0x7f84440a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.315+0000 7f8449f1a700 1 -- 172.21.15.146:0/3590192129 shutdown_connections 2023-10-03T10:14:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.316+0000 7f8449f1a700 1 -- 172.21.15.146:0/3590192129 wait complete. 2023-10-03T10:14:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.316+0000 7f8449f1a700 1 Processor -- start 2023-10-03T10:14:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.317+0000 7f8449f1a700 1 -- start start 2023-10-03T10:14:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.317+0000 7f8449f1a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f844409e870 0x7f844411e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.317+0000 7f8449f1a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f844409f180 0x7f844411e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.317+0000 7f8449f1a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8444131d70 0x7f844411eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.317+0000 7f8449f1a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844411f530 con 0x7f844409f180 2023-10-03T10:14:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.317+0000 7f8449f1a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844411fbf0 con 0x7f8444131d70 2023-10-03T10:14:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.317+0000 7f8449f1a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8444120e40 con 0x7f844409e870 2023-10-03T10:14:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.317+0000 7f84437fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f844409e870 0x7f844411e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.317+0000 7f84437fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f844409e870 0x7f844411e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39018/0 (socket says 172.21.15.146:39018) 2023-10-03T10:14:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.317+0000 7f84437fe700 1 -- 172.21.15.146:0/1855225420 learned_addr learned my addr 172.21.15.146:0/1855225420 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:48.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.317+0000 7f8442ffd700 1 --2- 172.21.15.146:0/1855225420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f844409f180 0x7f844411e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.317+0000 7f84437fe700 1 -- 172.21.15.146:0/1855225420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8444131d70 msgr2=0x7f844411eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.317+0000 7f84437fe700 1 --2- 172.21.15.146:0/1855225420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8444131d70 0x7f844411eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.317+0000 7f84437fe700 1 -- 172.21.15.146:0/1855225420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f844409f180 msgr2=0x7f844411e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.317+0000 7f84437fe700 1 --2- 172.21.15.146:0/1855225420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f844409f180 0x7f844411e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.317+0000 7f84437fe700 1 -- 172.21.15.146:0/1855225420 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84380094a0 con 0x7f844409e870 2023-10-03T10:14:48.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.317+0000 7f8442ffd700 1 --2- 172.21.15.146:0/1855225420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f844409f180 0x7f844411e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:48.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.318+0000 7f84437fe700 1 --2- 172.21.15.146:0/1855225420 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f844409e870 0x7f844411e080 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f843400dcf0 tx=0x7f84340100c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.318+0000 7f842bfff700 1 -- 172.21.15.146:0/1855225420 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84340109f0 con 0x7f844409e870 2023-10-03T10:14:48.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.318+0000 7f842bfff700 1 -- 172.21.15.146:0/1855225420 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8434013040 con 0x7f844409e870 2023-10-03T10:14:48.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.318+0000 7f8449f1a700 1 -- 172.21.15.146:0/1855225420 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8444121820 con 0x7f844409e870 2023-10-03T10:14:48.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.318+0000 7f842bfff700 1 -- 172.21.15.146:0/1855225420 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8434010d70 con 0x7f844409e870 2023-10-03T10:14:48.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.318+0000 7f8449f1a700 1 -- 172.21.15.146:0/1855225420 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84441212e0 con 0x7f844409e870 2023-10-03T10:14:48.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.319+0000 7f842bfff700 1 -- 172.21.15.146:0/1855225420 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8434018480 con 0x7f844409e870 2023-10-03T10:14:48.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.319+0000 7f842bfff700 1 -- 172.21.15.146:0/1855225420 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8434043a10 con 0x7f844409e870 2023-10-03T10:14:48.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.319+0000 7f8449f1a700 1 -- 172.21.15.146:0/1855225420 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84441201d0 con 0x7f844409e870 2023-10-03T10:14:48.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.324+0000 7f842bfff700 1 -- 172.21.15.146:0/1855225420 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8434016930 con 0x7f844409e870 2023-10-03T10:14:48.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.462+0000 7f46b08d2700 1 -- 172.21.15.146:0/2706300573 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f46ac06be20 con 0x7f46ac13c410 2023-10-03T10:14:48.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.462+0000 7f469affd700 1 -- 172.21.15.146:0/2706300573 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f46a4019300 con 0x7f46ac13c410 2023-10-03T10:14:48.462 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:48.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.464+0000 7f46b08d2700 1 -- 172.21.15.146:0/2706300573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46ac13c410 msgr2=0x7f46ac13ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.464+0000 7f46b08d2700 1 --2- 172.21.15.146:0/2706300573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46ac13c410 0x7f46ac13ace0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f46a400cb90 tx=0x7f46a400cf50 comp rx=0 tx=0).stop 2023-10-03T10:14:48.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.464+0000 7f46b08d2700 1 -- 172.21.15.146:0/2706300573 shutdown_connections 2023-10-03T10:14:48.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.464+0000 7f46b08d2700 1 --2- 172.21.15.146:0/2706300573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46ac13c410 0x7f46ac13ace0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.464+0000 7f46b08d2700 1 --2- 172.21.15.146:0/2706300573 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f46ac09a130 0x7f46ac11b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.464+0000 7f46b08d2700 1 --2- 172.21.15.146:0/2706300573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46ac09edb0 0x7f46ac13a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.464+0000 7f46b08d2700 1 -- 172.21.15.146:0/2706300573 >> 172.21.15.146:0/2706300573 conn(0x7f46ac0a4430 msgr2=0x7f46ac09b370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.465+0000 7f46b08d2700 1 -- 172.21.15.146:0/2706300573 shutdown_connections 2023-10-03T10:14:48.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.465+0000 7f46b08d2700 1 -- 172.21.15.146:0/2706300573 wait complete. 2023-10-03T10:14:48.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.465+0000 7ff31b313700 1 -- 172.21.15.146:0/3980500146 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff2f4005590 con 0x7ff314133900 2023-10-03T10:14:48.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.466+0000 7ff309ffb700 1 -- 172.21.15.146:0/3980500146 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff310003e40 con 0x7ff314133900 2023-10-03T10:14:48.466 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:48.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.469+0000 7ff31b313700 1 -- 172.21.15.146:0/3980500146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff314133900 msgr2=0x7ff31411ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.469+0000 7ff31b313700 1 --2- 172.21.15.146:0/3980500146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff314133900 0x7ff31411ae90 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff31000c580 tx=0x7ff31000c890 comp rx=0 tx=0).stop 2023-10-03T10:14:48.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.469+0000 7ff31b313700 1 -- 172.21.15.146:0/3980500146 shutdown_connections 2023-10-03T10:14:48.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.469+0000 7ff31b313700 1 --2- 172.21.15.146:0/3980500146 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff314139200 0x7ff31411b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.469+0000 7ff31b313700 1 --2- 172.21.15.146:0/3980500146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff314133900 0x7ff31411ae90 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.469+0000 7ff31b313700 1 --2- 172.21.15.146:0/3980500146 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3141368e0 0x7ff31411b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.469+0000 7ff31b313700 1 -- 172.21.15.146:0/3980500146 >> 172.21.15.146:0/3980500146 conn(0x7ff3140a2980 msgr2=0x7ff314131a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.470+0000 7ff31b313700 1 -- 172.21.15.146:0/3980500146 shutdown_connections 2023-10-03T10:14:48.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.470+0000 7ff31b313700 1 -- 172.21.15.146:0/3980500146 wait complete. 2023-10-03T10:14:48.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:48.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:48.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.516+0000 7f12c22fe700 1 -- 172.21.15.146:0/3881415774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f12bc06d8f0 con 0x7f12bc09a090 2023-10-03T10:14:48.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.516+0000 7f12b8ff9700 1 -- 172.21.15.146:0/3881415774 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f12bc06d8f0 con 0x7f12bc09a090 2023-10-03T10:14:48.516 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:48.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.518+0000 7f12c22fe700 1 -- 172.21.15.146:0/3881415774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12bc09a090 msgr2=0x7f12bc13a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.518+0000 7f12c22fe700 1 --2- 172.21.15.146:0/3881415774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12bc09a090 0x7f12bc13a380 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f12ac013040 tx=0x7f12ac004750 comp rx=0 tx=0).stop 2023-10-03T10:14:48.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.518+0000 7f12c22fe700 1 -- 172.21.15.146:0/3881415774 shutdown_connections 2023-10-03T10:14:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.518+0000 7f12c22fe700 1 --2- 172.21.15.146:0/3881415774 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12bc13c470 0x7f12bc1cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.518+0000 7f12c22fe700 1 --2- 172.21.15.146:0/3881415774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12bc09a090 0x7f12bc13a380 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.518+0000 7f12c22fe700 1 --2- 172.21.15.146:0/3881415774 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12bc09ee90 0x7f12bc13a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.518+0000 7f12c22fe700 1 -- 172.21.15.146:0/3881415774 >> 172.21.15.146:0/3881415774 conn(0x7f12bc0a0f70 msgr2=0x7f12bc13b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.519+0000 7f12c22fe700 1 -- 172.21.15.146:0/3881415774 shutdown_connections 2023-10-03T10:14:48.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.519+0000 7f12c22fe700 1 -- 172.21.15.146:0/3881415774 wait complete. 2023-10-03T10:14:48.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:48.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.533+0000 7f8449f1a700 1 -- 172.21.15.146:0/1855225420 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f844404f2a0 con 0x7f844409e870 2023-10-03T10:14:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.533+0000 7f842bfff700 1 -- 172.21.15.146:0/1855225420 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8434016340 con 0x7f844409e870 2023-10-03T10:14:48.533 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.536+0000 7f8449f1a700 1 -- 172.21.15.146:0/1855225420 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f844409e870 msgr2=0x7f844411e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.536+0000 7f8449f1a700 1 --2- 172.21.15.146:0/1855225420 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f844409e870 0x7f844411e080 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f843400dcf0 tx=0x7f84340100c0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.536+0000 7f8449f1a700 1 -- 172.21.15.146:0/1855225420 shutdown_connections 2023-10-03T10:14:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.536+0000 7f8449f1a700 1 --2- 172.21.15.146:0/1855225420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8444131d70 0x7f844411eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.536+0000 7f8449f1a700 1 --2- 172.21.15.146:0/1855225420 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f844409e870 0x7f844411e080 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.536+0000 7f8449f1a700 1 --2- 172.21.15.146:0/1855225420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f844409f180 0x7f844411e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.536+0000 7f8449f1a700 1 -- 172.21.15.146:0/1855225420 >> 172.21.15.146:0/1855225420 conn(0x7f84440a4430 msgr2=0x7f844406d170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.536+0000 7f8449f1a700 1 -- 172.21.15.146:0/1855225420 shutdown_connections 2023-10-03T10:14:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:48.536+0000 7f8449f1a700 1 -- 172.21.15.146:0/1855225420 wait complete. 2023-10-03T10:14:48.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:49.478 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:49.483 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:49.531 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:49.548 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:49.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.621+0000 7fb45bb27700 1 Processor -- start 2023-10-03T10:14:49.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.622+0000 7fb45bb27700 1 -- start start 2023-10-03T10:14:49.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.622+0000 7fb45bb27700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4540a1510 0x7fb4541351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.622+0000 7fb45bb27700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4541356e0 0x7fb454137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.622+0000 7fb45bb27700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4540a1e70 con 0x7fb4540a0a30 2023-10-03T10:14:49.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.622+0000 7fb45bb27700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45409a720 con 0x7fb4540a1510 2023-10-03T10:14:49.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.622+0000 7fb45bb27700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb45409b300 con 0x7fb4541356e0 2023-10-03T10:14:49.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.622+0000 7fb4590c2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4540a1510 0x7fb4541351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.622+0000 7fb4598c3700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb4540a0a30 0x7fb4540a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48748/0 (socket says 172.21.15.146:48748) 2023-10-03T10:14:49.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.622+0000 7fb4598c3700 1 -- 172.21.15.146:0/1399023366 learned_addr learned my addr 172.21.15.146:0/1399023366 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:49.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.622+0000 7fb45a0c4700 1 --2- 172.21.15.146:0/1399023366 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4541356e0 0x7fb454137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.623+0000 7fb45a0c4700 1 -- 172.21.15.146:0/1399023366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4540a1510 msgr2=0x7fb4541351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:49.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.623+0000 7fb45a0c4700 1 --2- 172.21.15.146:0/1399023366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4540a1510 0x7fb4541351a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.623+0000 7fb45a0c4700 1 -- 172.21.15.146:0/1399023366 >> v1:172.21.15.146:6789/0 conn(0x7fb4540a0a30 legacy=0x7fb4540a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.623+0000 7fb4588c1700 1 -- 172.21.15.146:0/1399023366 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 871522813 0 0) 0x7fb4540a1e70 con 0x7fb4540a0a30 2023-10-03T10:14:49.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.623+0000 7fb45a0c4700 1 -- 172.21.15.146:0/1399023366 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45409abc0 con 0x7fb4541356e0 2023-10-03T10:14:49.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.623+0000 7fb4590c2700 1 --2- 172.21.15.146:0/1399023366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4540a1510 0x7fb4541351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:49.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.623+0000 7fb45a0c4700 1 --2- 172.21.15.146:0/1399023366 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4541356e0 0x7fb454137ac0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009dc0 tx=0x7fb44c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23bb9c1355197e71 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.623+0000 7fb4588c1700 1 -- 172.21.15.146:0/1399023366 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c00e070 con 0x7fb4541356e0 2023-10-03T10:14:49.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.623+0000 7fb4588c1700 1 -- 172.21.15.146:0/1399023366 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c00bb20 con 0x7fb4541356e0 2023-10-03T10:14:49.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.623+0000 7fb4588c1700 1 -- 172.21.15.146:0/1399023366 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c012430 con 0x7fb4541356e0 2023-10-03T10:14:49.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.624+0000 7fb45bb27700 1 -- 172.21.15.146:0/1399023366 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4541356e0 msgr2=0x7fb454137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.624+0000 7fb45bb27700 1 --2- 172.21.15.146:0/1399023366 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4541356e0 0x7fb454137ac0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009dc0 tx=0x7fb44c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:49.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.624+0000 7fb45bb27700 1 -- 172.21.15.146:0/1399023366 shutdown_connections 2023-10-03T10:14:49.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.624+0000 7fb45bb27700 1 --2- 172.21.15.146:0/1399023366 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4541356e0 0x7fb454137ac0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.624+0000 7fb45bb27700 1 --2- 172.21.15.146:0/1399023366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4540a1510 0x7fb4541351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.624+0000 7fb45bb27700 1 -- 172.21.15.146:0/1399023366 >> 172.21.15.146:0/1399023366 conn(0x7fb4540a2980 msgr2=0x7fb4540a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.624+0000 7fb45bb27700 1 -- 172.21.15.146:0/1399023366 shutdown_connections 2023-10-03T10:14:49.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.624+0000 7fb45bb27700 1 -- 172.21.15.146:0/1399023366 wait complete. 2023-10-03T10:14:49.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.625+0000 7fb45bb27700 1 Processor -- start 2023-10-03T10:14:49.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.625+0000 7fb45bb27700 1 -- start start 2023-10-03T10:14:49.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.625+0000 7fb45bb27700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4540a0a30 0x7fb454134580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.625+0000 7fb45bb27700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4540a1510 0x7fb454134ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.625+0000 7fb45bb27700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4541356e0 0x7fb4541c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.625+0000 7fb45bb27700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45411ab60 con 0x7fb4540a1510 2023-10-03T10:14:49.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.625+0000 7fb45bb27700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45409ae00 con 0x7fb4540a0a30 2023-10-03T10:14:49.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.625+0000 7fb45bb27700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4541340e0 con 0x7fb4541356e0 2023-10-03T10:14:49.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.626+0000 7fb4598c3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4540a0a30 0x7fb454134580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.626+0000 7fb4598c3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4540a0a30 0x7fb454134580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:54236/0 (socket says 172.21.15.146:54236) 2023-10-03T10:14:49.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.626+0000 7fb4598c3700 1 -- 172.21.15.146:0/1436144027 learned_addr learned my addr 172.21.15.146:0/1436144027 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:49.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.626+0000 7fb4590c2700 1 --2- 172.21.15.146:0/1436144027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4540a1510 0x7fb454134ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.626+0000 7fb45a0c4700 1 --2- 172.21.15.146:0/1436144027 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4541356e0 0x7fb4541c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.626+0000 7fb4590c2700 1 -- 172.21.15.146:0/1436144027 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4541356e0 msgr2=0x7fb4541c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.626+0000 7fb4590c2700 1 --2- 172.21.15.146:0/1436144027 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4541356e0 0x7fb4541c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.626+0000 7fb4590c2700 1 -- 172.21.15.146:0/1436144027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4540a0a30 msgr2=0x7fb454134580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.626+0000 7fb4590c2700 1 --2- 172.21.15.146:0/1436144027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4540a0a30 0x7fb454134580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.626+0000 7fb4590c2700 1 -- 172.21.15.146:0/1436144027 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44400b740 con 0x7fb4540a1510 2023-10-03T10:14:49.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.626+0000 7fb4598c3700 1 --2- 172.21.15.146:0/1436144027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4540a0a30 0x7fb454134580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:49.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.626+0000 7fb4590c2700 1 --2- 172.21.15.146:0/1436144027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4540a1510 0x7fb454134ac0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb444010f40 tx=0x7fb44400e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.626+0000 7fb44a7fc700 1 -- 172.21.15.146:0/1436144027 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb444015860 con 0x7fb4540a1510 2023-10-03T10:14:49.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.627+0000 7fb45bb27700 1 -- 172.21.15.146:0/1436144027 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44c009a70 con 0x7fb4540a1510 2023-10-03T10:14:49.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.627+0000 7fb44a7fc700 1 -- 172.21.15.146:0/1436144027 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4440159c0 con 0x7fb4540a1510 2023-10-03T10:14:49.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.627+0000 7fb44a7fc700 1 -- 172.21.15.146:0/1436144027 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb444015d70 con 0x7fb4540a1510 2023-10-03T10:14:49.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.627+0000 7fb45bb27700 1 -- 172.21.15.146:0/1436144027 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb454135060 con 0x7fb4540a1510 2023-10-03T10:14:49.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.628+0000 7fb45bb27700 1 -- 172.21.15.146:0/1436144027 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45404f2a0 con 0x7fb4540a1510 2023-10-03T10:14:49.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.628+0000 7fb44a7fc700 1 -- 172.21.15.146:0/1436144027 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb44401d360 con 0x7fb4540a1510 2023-10-03T10:14:49.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.628+0000 7fb44a7fc700 1 -- 172.21.15.146:0/1436144027 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb444043f90 con 0x7fb4540a1510 2023-10-03T10:14:49.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.633+0000 7fb44a7fc700 1 -- 172.21.15.146:0/1436144027 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4440252a0 con 0x7fb4540a1510 2023-10-03T10:14:49.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.671+0000 7fbf0889b700 1 Processor -- start 2023-10-03T10:14:49.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.671+0000 7fbf0889b700 1 -- start start 2023-10-03T10:14:49.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.671+0000 7fbf0889b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf0406a770 0x7fbf041349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.671+0000 7fbf0889b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf04134f00 0x7fbf0409d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.671+0000 7fbf0889b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf0409eca0 con 0x7fbf0409dea0 2023-10-03T10:14:49.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.671+0000 7fbf0889b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0406b2e0 con 0x7fbf0406a770 2023-10-03T10:14:49.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.671+0000 7fbf0889b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0409f720 con 0x7fbf04134f00 2023-10-03T10:14:49.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.672+0000 7fbf0259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf0406a770 0x7fbf041349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.672+0000 7fbf02d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbf0409dea0 0x7fbf0413ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48760/0 (socket says 172.21.15.146:48760) 2023-10-03T10:14:49.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.672+0000 7fbf02d9d700 1 -- 172.21.15.146:0/1114703733 learned_addr learned my addr 172.21.15.146:0/1114703733 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:49.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.672+0000 7fbf01d9b700 1 --2- 172.21.15.146:0/1114703733 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf04134f00 0x7fbf0409d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.672+0000 7fbf0259c700 1 -- 172.21.15.146:0/1114703733 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf04134f00 msgr2=0x7fbf0409d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:49.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.672+0000 7fbf0259c700 1 --2- 172.21.15.146:0/1114703733 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf04134f00 0x7fbf0409d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.672+0000 7fbf0259c700 1 -- 172.21.15.146:0/1114703733 >> v1:172.21.15.146:6789/0 conn(0x7fbf0409dea0 legacy=0x7fbf0413ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:49.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.672+0000 7fbf0259c700 1 -- 172.21.15.146:0/1114703733 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0406b480 con 0x7fbf0406a770 2023-10-03T10:14:49.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.672+0000 7fbf0259c700 1 --2- 172.21.15.146:0/1114703733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf0406a770 0x7fbf041349c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbef4009870 tx=0x7fbef4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa0629314cdeb6c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.672+0000 7fbf0159a700 1 -- 172.21.15.146:0/1114703733 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef4004230 con 0x7fbf0406a770 2023-10-03T10:14:49.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.672+0000 7fbf0159a700 1 -- 172.21.15.146:0/1114703733 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef4004390 con 0x7fbf0406a770 2023-10-03T10:14:49.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.672+0000 7fbf0159a700 1 -- 172.21.15.146:0/1114703733 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef40036a0 con 0x7fbf0406a770 2023-10-03T10:14:49.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.673+0000 7fbf0889b700 1 -- 172.21.15.146:0/1114703733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf0406a770 msgr2=0x7fbf041349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.673+0000 7fbf0889b700 1 --2- 172.21.15.146:0/1114703733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf0406a770 0x7fbf041349c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbef4009870 tx=0x7fbef4009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:49.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.673+0000 7fbf0889b700 1 -- 172.21.15.146:0/1114703733 shutdown_connections 2023-10-03T10:14:49.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.673+0000 7fbf0889b700 1 --2- 172.21.15.146:0/1114703733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf0406a770 0x7fbf041349c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.673+0000 7fbf0889b700 1 --2- 172.21.15.146:0/1114703733 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf04134f00 0x7fbf0409d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.673+0000 7fbf0889b700 1 -- 172.21.15.146:0/1114703733 >> 172.21.15.146:0/1114703733 conn(0x7fbf04099c40 msgr2=0x7fbf040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.673+0000 7fbf0889b700 1 -- 172.21.15.146:0/1114703733 shutdown_connections 2023-10-03T10:14:49.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.673+0000 7fbf0889b700 1 -- 172.21.15.146:0/1114703733 wait complete. 2023-10-03T10:14:49.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.675+0000 7fbf0889b700 1 Processor -- start 2023-10-03T10:14:49.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.675+0000 7fbf0889b700 1 -- start start 2023-10-03T10:14:49.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.676+0000 7fbf0889b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf0406a770 0x7fbf0406f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.676+0000 7fbf0889b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf0409dea0 0x7fbf0406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.676+0000 7fbf0889b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf04134f00 0x7fbf040703d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.676+0000 7fbf0889b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf040727c0 con 0x7fbf0406a770 2023-10-03T10:14:49.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.676+0000 7fbf0889b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf04126370 con 0x7fbf0409dea0 2023-10-03T10:14:49.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.676+0000 7fbf0889b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf04126900 con 0x7fbf04134f00 2023-10-03T10:14:49.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.676+0000 7fbf0259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf0406a770 0x7fbf0406f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.676+0000 7fbf0259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf0406a770 0x7fbf0406f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51024/0 (socket says 172.21.15.146:51024) 2023-10-03T10:14:49.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.676+0000 7fbf0259c700 1 -- 172.21.15.146:0/639752175 learned_addr learned my addr 172.21.15.146:0/639752175 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:49.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.676+0000 7fbf02d9d700 1 --2- 172.21.15.146:0/639752175 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf04134f00 0x7fbf040703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.676+0000 7fbf01d9b700 1 --2- 172.21.15.146:0/639752175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf0409dea0 0x7fbf0406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.676+0000 7fbf0259c700 1 -- 172.21.15.146:0/639752175 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf04134f00 msgr2=0x7fbf040703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.676+0000 7fbf0259c700 1 --2- 172.21.15.146:0/639752175 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf04134f00 0x7fbf040703d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.676+0000 7fbf0259c700 1 -- 172.21.15.146:0/639752175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf0409dea0 msgr2=0x7fbf0406fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.676+0000 7fbf0259c700 1 --2- 172.21.15.146:0/639752175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf0409dea0 0x7fbf0406fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.676+0000 7fbf0259c700 1 -- 172.21.15.146:0/639752175 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef40094a0 con 0x7fbf0406a770 2023-10-03T10:14:49.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.676+0000 7fbf01d9b700 1 --2- 172.21.15.146:0/639752175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf0409dea0 0x7fbf0406fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:49.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.676+0000 7fbf0259c700 1 --2- 172.21.15.146:0/639752175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf0406a770 0x7fbf0406f950 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fbef40090b0 tx=0x7fbef40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.677+0000 7fbef2ffd700 1 -- 172.21.15.146:0/639752175 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef4003e20 con 0x7fbf0406a770 2023-10-03T10:14:49.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.677+0000 7fbef2ffd700 1 -- 172.21.15.146:0/639752175 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef4011630 con 0x7fbf0406a770 2023-10-03T10:14:49.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.677+0000 7fbf0889b700 1 -- 172.21.15.146:0/639752175 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf04126c80 con 0x7fbf0406a770 2023-10-03T10:14:49.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.677+0000 7fbef2ffd700 1 -- 172.21.15.146:0/639752175 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef40119e0 con 0x7fbf0406a770 2023-10-03T10:14:49.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.677+0000 7fbf0889b700 1 -- 172.21.15.146:0/639752175 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf04071b10 con 0x7fbf0406a770 2023-10-03T10:14:49.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.677+0000 7fbef2ffd700 1 -- 172.21.15.146:0/639752175 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbef4011b40 con 0x7fbf0406a770 2023-10-03T10:14:49.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.678+0000 7fbef2ffd700 1 -- 172.21.15.146:0/639752175 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbef4040cf0 con 0x7fbf0406a770 2023-10-03T10:14:49.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.678+0000 7fbf0889b700 1 -- 172.21.15.146:0/639752175 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf04071df0 con 0x7fbf0406a770 2023-10-03T10:14:49.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.683+0000 7fbef2ffd700 1 -- 172.21.15.146:0/639752175 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf04071df0 con 0x7fbf0406a770 2023-10-03T10:14:49.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.701+0000 7f39bad0b700 1 Processor -- start 2023-10-03T10:14:49.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.701+0000 7f39bad0b700 1 -- start start 2023-10-03T10:14:49.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.701+0000 7f39bad0b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f39b406a770 0x7f39b41349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.701+0000 7f39bad0b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39b4134f00 0x7f39b409d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.701+0000 7f39bad0b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b409eca0 con 0x7f39b409dea0 2023-10-03T10:14:49.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.701+0000 7f39bad0b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b406b2e0 con 0x7f39b4134f00 2023-10-03T10:14:49.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.701+0000 7f39bad0b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39b409f720 con 0x7f39b406a770 2023-10-03T10:14:49.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.701+0000 7fb88d837700 1 Processor -- start 2023-10-03T10:14:49.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.701+0000 7f39b3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39b4134f00 0x7f39b409d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7f39b3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39b4134f00 0x7f39b409d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:54268/0 (socket says 172.21.15.146:54268) 2023-10-03T10:14:49.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7f39b3fff700 1 -- 172.21.15.146:0/125827850 learned_addr learned my addr 172.21.15.146:0/125827850 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:49.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7fb88d837700 1 -- start start 2023-10-03T10:14:49.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7f39b37fe700 1 -- 172.21.15.146:0/125827850 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165608432 0 0) 0x7f39b409eca0 con 0x7f39b409dea0 2023-10-03T10:14:49.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7f39b37fe700 1 -- 172.21.15.146:0/125827850 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39a40035b0 con 0x7f39b409dea0 2023-10-03T10:14:49.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7f39b8aa7700 1 --2- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f39b406a770 0x7f39b41349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7f39b37fe700 1 -- 172.21.15.146:0/125827850 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3658758201 0 0) 0x7f39a40035b0 con 0x7f39b409dea0 2023-10-03T10:14:49.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7f39b37fe700 1 -- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f39b406a770 msgr2=0x7f39b41349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:49.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7f39b37fe700 1 --2- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f39b406a770 0x7f39b41349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7f39b37fe700 1 -- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39b4134f00 msgr2=0x7f39b409d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7f39b37fe700 1 --2- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39b4134f00 0x7f39b409d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7f39b37fe700 1 -- 172.21.15.146:0/125827850 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b406b480 con 0x7f39b409dea0 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7f39b37fe700 1 -- 172.21.15.146:0/125827850 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2532932501 0 0) 0x7f39ac0019f0 con 0x7f39b409dea0 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7f39b37fe700 1 -- 172.21.15.146:0/125827850 >> v1:172.21.15.146:6789/0 conn(0x7f39b409dea0 legacy=0x7f39b413ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7f39b37fe700 1 --2- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39b4134f00 0x7f39a4003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7f39b37fe700 1 --2- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f39a40040a0 0x7f39a4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7f39b37fe700 1 --2- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a4004d90 0x7f39a4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7f39b37fe700 1 -- 172.21.15.146:0/125827850 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b406b2e0 con 0x7f39a4004d90 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7f39b37fe700 1 -- 172.21.15.146:0/125827850 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b409f720 con 0x7f39b4134f00 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7f39b37fe700 1 -- 172.21.15.146:0/125827850 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39a400bc80 con 0x7f39a40040a0 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7f39b8aa7700 1 --2- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f39b406a770 0x7f39b41349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:49.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7f39b3fff700 1 --2- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f39a40040a0 0x7f39a4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7fb88d837700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8881335f0 0x7fb8881359d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7fb88d837700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb888135f10 0x7fb8881382f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7fb88d837700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb88809bb90 con 0x7fb88812d380 2023-10-03T10:14:49.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7fb88d837700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb88809c210 con 0x7fb888135f10 2023-10-03T10:14:49.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.702+0000 7fb88d837700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb88809ced0 con 0x7fb8881335f0 2023-10-03T10:14:49.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.703+0000 7fb8877fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb888135f10 0x7fb8881382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.703+0000 7fb8877fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb888135f10 0x7fb8881382f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51042/0 (socket says 172.21.15.146:51042) 2023-10-03T10:14:49.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.703+0000 7fb8877fe700 1 -- 172.21.15.146:0/2106763796 learned_addr learned my addr 172.21.15.146:0/2106763796 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:49.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.703+0000 7f39b8aa7700 1 --2- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39b4134f00 0x7f39a4003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.703+0000 7f39b92a8700 1 --2- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a4004d90 0x7f39a4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.703+0000 7f39b3fff700 1 -- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39b4134f00 msgr2=0x7f39a4003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.703+0000 7f39b3fff700 1 --2- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39b4134f00 0x7f39a4003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.703+0000 7f39b3fff700 1 -- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a4004d90 msgr2=0x7f39a4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.703+0000 7f39b3fff700 1 --2- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a4004d90 0x7f39a4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.703+0000 7f39b3fff700 1 -- 172.21.15.146:0/125827850 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a40035b0 con 0x7f39a40040a0 2023-10-03T10:14:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.703+0000 7f39b92a8700 1 --2- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a4004d90 0x7f39a4005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.703+0000 7f39b3fff700 1 --2- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f39a40040a0 0x7f39a4004850 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f39b406d510 tx=0x7f39a4005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de8887c230f33a7a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.703+0000 7fb8867fc700 1 --2- 172.21.15.146:0/2106763796 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8881335f0 0x7fb8881359d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.703+0000 7fb8877fe700 1 -- 172.21.15.146:0/2106763796 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8881335f0 msgr2=0x7fb8881359d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:49.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.703+0000 7fb8877fe700 1 --2- 172.21.15.146:0/2106763796 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8881335f0 0x7fb8881359d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.703+0000 7fb8877fe700 1 -- 172.21.15.146:0/2106763796 >> v1:172.21.15.146:6789/0 conn(0x7fb88812d380 legacy=0x7fb88812d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.703+0000 7fb8877fe700 1 -- 172.21.15.146:0/2106763796 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88809ac30 con 0x7fb888135f10 2023-10-03T10:14:49.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.703+0000 7fb8867fc700 1 --2- 172.21.15.146:0/2106763796 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8881335f0 0x7fb8881359d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:49.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.703+0000 7f39b37fe700 1 -- 172.21.15.146:0/125827850 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0004230 con 0x7f39a40040a0 2023-10-03T10:14:49.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.703+0000 7f39b37fe700 1 -- 172.21.15.146:0/125827850 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a0004390 con 0x7f39a40040a0 2023-10-03T10:14:49.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.703+0000 7f39b37fe700 1 -- 172.21.15.146:0/125827850 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a00036a0 con 0x7f39a40040a0 2023-10-03T10:14:49.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.703+0000 7fb8877fe700 1 --2- 172.21.15.146:0/2106763796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb888135f10 0x7fb8881382f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb880009e50 tx=0x7fb88000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6000afcc9a2a2155 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.704+0000 7f39bad0b700 1 -- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f39a40040a0 msgr2=0x7f39a4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.704+0000 7f39bad0b700 1 --2- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f39a40040a0 0x7f39a4004850 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f39b406d510 tx=0x7f39a4005880 comp rx=0 tx=0).stop 2023-10-03T10:14:49.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.704+0000 7f39bad0b700 1 -- 172.21.15.146:0/125827850 shutdown_connections 2023-10-03T10:14:49.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.704+0000 7f39bad0b700 1 --2- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a4004d90 0x7f39a4005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.704+0000 7f39bad0b700 1 --2- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f39a40040a0 0x7f39a4004850 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.704+0000 7f39bad0b700 1 --2- 172.21.15.146:0/125827850 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39b4134f00 0x7f39a4003a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.704+0000 7fb885ffb700 1 -- 172.21.15.146:0/2106763796 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88000e070 con 0x7fb888135f10 2023-10-03T10:14:49.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.704+0000 7fb885ffb700 1 -- 172.21.15.146:0/2106763796 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88000b9c0 con 0x7fb888135f10 2023-10-03T10:14:49.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.704+0000 7fb885ffb700 1 -- 172.21.15.146:0/2106763796 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88000bd70 con 0x7fb888135f10 2023-10-03T10:14:49.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.704+0000 7f39bad0b700 1 -- 172.21.15.146:0/125827850 >> 172.21.15.146:0/125827850 conn(0x7f39b4099c40 msgr2=0x7f39b40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.704+0000 7f39bad0b700 1 -- 172.21.15.146:0/125827850 shutdown_connections 2023-10-03T10:14:49.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.704+0000 7f39bad0b700 1 -- 172.21.15.146:0/125827850 wait complete. 2023-10-03T10:14:49.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.705+0000 7fb88d837700 1 -- 172.21.15.146:0/2106763796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb888135f10 msgr2=0x7fb8881382f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.705+0000 7fb88d837700 1 --2- 172.21.15.146:0/2106763796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb888135f10 0x7fb8881382f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb880009e50 tx=0x7fb88000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:49.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.705+0000 7f39bad0b700 1 Processor -- start 2023-10-03T10:14:49.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.705+0000 7fb88d837700 1 -- 172.21.15.146:0/2106763796 shutdown_connections 2023-10-03T10:14:49.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.705+0000 7fb88d837700 1 --2- 172.21.15.146:0/2106763796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb888135f10 0x7fb8881382f0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.705+0000 7fb88d837700 1 --2- 172.21.15.146:0/2106763796 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8881335f0 0x7fb8881359d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.705+0000 7fb88d837700 1 -- 172.21.15.146:0/2106763796 >> 172.21.15.146:0/2106763796 conn(0x7fb8880a2980 msgr2=0x7fb8880a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.705+0000 7f39bad0b700 1 -- start start 2023-10-03T10:14:49.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.706+0000 7f39bad0b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a40040a0 0x7f39b411a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.706+0000 7f39bad0b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39a4004d90 0x7f39b411a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.706+0000 7f39bad0b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f39b409dea0 0x7f39b411ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.706+0000 7f39bad0b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b411d640 con 0x7f39a40040a0 2023-10-03T10:14:49.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.706+0000 7f39bad0b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b4134200 con 0x7f39a4004d90 2023-10-03T10:14:49.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.706+0000 7f39bad0b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39b409f220 con 0x7f39b409dea0 2023-10-03T10:14:49.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.706+0000 7fb88d837700 1 -- 172.21.15.146:0/2106763796 shutdown_connections 2023-10-03T10:14:49.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.706+0000 7f39b3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39a4004d90 0x7f39b411a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.706+0000 7f39b3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39a4004d90 0x7f39b411a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:54288/0 (socket says 172.21.15.146:54288) 2023-10-03T10:14:49.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.706+0000 7f39b8aa7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a40040a0 0x7f39b411a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.706+0000 7f39b3fff700 1 -- 172.21.15.146:0/778101409 learned_addr learned my addr 172.21.15.146:0/778101409 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:49.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.706+0000 7f39b92a8700 1 --2- 172.21.15.146:0/778101409 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f39b409dea0 0x7f39b411ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.706+0000 7f39b3fff700 1 -- 172.21.15.146:0/778101409 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f39b409dea0 msgr2=0x7f39b411ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.706+0000 7f39b3fff700 1 --2- 172.21.15.146:0/778101409 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f39b409dea0 0x7f39b411ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.706+0000 7f39b3fff700 1 -- 172.21.15.146:0/778101409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a40040a0 msgr2=0x7f39b411a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.706+0000 7f39b3fff700 1 --2- 172.21.15.146:0/778101409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a40040a0 0x7f39b411a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.706+0000 7f39b3fff700 1 -- 172.21.15.146:0/778101409 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b411d1f0 con 0x7f39a4004d90 2023-10-03T10:14:49.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.706+0000 7f39b92a8700 1 --2- 172.21.15.146:0/778101409 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f39b409dea0 0x7f39b411ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:49.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.706+0000 7fb88d837700 1 -- 172.21.15.146:0/2106763796 wait complete. 2023-10-03T10:14:49.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.706+0000 7f39b3fff700 1 --2- 172.21.15.146:0/778101409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39a4004d90 0x7f39b411a8a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f39a0000c00 tx=0x7f39a00047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.707+0000 7f39b17fa700 1 -- 172.21.15.146:0/778101409 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a00137d0 con 0x7f39a4004d90 2023-10-03T10:14:49.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.707+0000 7f39b17fa700 1 -- 172.21.15.146:0/778101409 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a0013930 con 0x7f39a4004d90 2023-10-03T10:14:49.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.707+0000 7f39b17fa700 1 -- 172.21.15.146:0/778101409 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0013ce0 con 0x7f39a4004d90 2023-10-03T10:14:49.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.707+0000 7f39bad0b700 1 -- 172.21.15.146:0/778101409 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b411cd30 con 0x7f39a4004d90 2023-10-03T10:14:49.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.707+0000 7f39bad0b700 1 -- 172.21.15.146:0/778101409 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b4126820 con 0x7f39a4004d90 2023-10-03T10:14:49.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.707+0000 7fb88d837700 1 Processor -- start 2023-10-03T10:14:49.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.708+0000 7fb88d837700 1 -- start start 2023-10-03T10:14:49.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.708+0000 7f39b17fa700 1 -- 172.21.15.146:0/778101409 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f39a0024070 con 0x7f39a4004d90 2023-10-03T10:14:49.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.708+0000 7f39bad0b700 1 -- 172.21.15.146:0/778101409 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b40700a0 con 0x7f39a4004d90 2023-10-03T10:14:49.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.708+0000 7f39b17fa700 1 -- 172.21.15.146:0/778101409 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f39a001bc60 con 0x7f39a4004d90 2023-10-03T10:14:49.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.708+0000 7fb88d837700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb88812d380 0x7fb888136d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.708+0000 7fb88d837700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8881335f0 0x7fb8881372c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.708+0000 7fb88d837700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb888135f10 0x7fb888137800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.708+0000 7fb88d837700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88806e230 con 0x7fb8881335f0 2023-10-03T10:14:49.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.708+0000 7fb88d837700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb888138aa0 con 0x7fb88812d380 2023-10-03T10:14:49.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.708+0000 7fb88d837700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb88806df90 con 0x7fb888135f10 2023-10-03T10:14:49.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.709+0000 7fb886ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb88812d380 0x7fb888136d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.709+0000 7fb886ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb88812d380 0x7fb888136d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:54300/0 (socket says 172.21.15.146:54300) 2023-10-03T10:14:49.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.709+0000 7fb886ffd700 1 -- 172.21.15.146:0/1285473606 learned_addr learned my addr 172.21.15.146:0/1285473606 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:49.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.709+0000 7fb8877fe700 1 --2- 172.21.15.146:0/1285473606 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb888135f10 0x7fb888137800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.709+0000 7fb886ffd700 1 -- 172.21.15.146:0/1285473606 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb888135f10 msgr2=0x7fb888137800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.709+0000 7fb886ffd700 1 --2- 172.21.15.146:0/1285473606 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb888135f10 0x7fb888137800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.709+0000 7fb886ffd700 1 -- 172.21.15.146:0/1285473606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8881335f0 msgr2=0x7fb8881372c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.709+0000 7fb8867fc700 1 --2- 172.21.15.146:0/1285473606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8881335f0 0x7fb8881372c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.709+0000 7fb886ffd700 1 --2- 172.21.15.146:0/1285473606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8881335f0 0x7fb8881372c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.709+0000 7fb886ffd700 1 -- 172.21.15.146:0/1285473606 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb880009b30 con 0x7fb88812d380 2023-10-03T10:14:49.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.709+0000 7fb8877fe700 1 --2- 172.21.15.146:0/1285473606 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb888135f10 0x7fb888137800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:49.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.709+0000 7fb8867fc700 1 --2- 172.21.15.146:0/1285473606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8881335f0 0x7fb8881372c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:49.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.709+0000 7fb886ffd700 1 --2- 172.21.15.146:0/1285473606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb88812d380 0x7fb888136d80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb87800c450 tx=0x7fb87800c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.713+0000 7fb86ffff700 1 -- 172.21.15.146:0/1285473606 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8780052d0 con 0x7fb88812d380 2023-10-03T10:14:49.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.713+0000 7fb86ffff700 1 -- 172.21.15.146:0/1285473606 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb878005450 con 0x7fb88812d380 2023-10-03T10:14:49.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.713+0000 7fb86ffff700 1 -- 172.21.15.146:0/1285473606 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8780038c0 con 0x7fb88812d380 2023-10-03T10:14:49.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.713+0000 7fb88d837700 1 -- 172.21.15.146:0/1285473606 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb888071f30 con 0x7fb88812d380 2023-10-03T10:14:49.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.713+0000 7f39b17fa700 1 -- 172.21.15.146:0/778101409 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f39a002b080 con 0x7f39a4004d90 2023-10-03T10:14:49.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.713+0000 7fb88d837700 1 -- 172.21.15.146:0/1285473606 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb888139180 con 0x7fb88812d380 2023-10-03T10:14:49.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.715+0000 7fb88d837700 1 -- 172.21.15.146:0/1285473606 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb88804f2a0 con 0x7fb88812d380 2023-10-03T10:14:49.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.715+0000 7fb86ffff700 1 -- 172.21.15.146:0/1285473606 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb878003a20 con 0x7fb88812d380 2023-10-03T10:14:49.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.716+0000 7fb86ffff700 1 -- 172.21.15.146:0/1285473606 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb87803ebc0 con 0x7fb88812d380 2023-10-03T10:14:49.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.720+0000 7fb86ffff700 1 -- 172.21.15.146:0/1285473606 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb878019e60 con 0x7fb88812d380 2023-10-03T10:14:49.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.911+0000 7fb88d837700 1 -- 172.21.15.146:0/1285473606 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb88806e5d0 con 0x7fb88812d380 2023-10-03T10:14:49.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.911+0000 7fb86ffff700 1 -- 172.21.15.146:0/1285473606 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb878019a70 con 0x7fb88812d380 2023-10-03T10:14:49.911 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:49.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.912+0000 7f39bad0b700 1 -- 172.21.15.146:0/778101409 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f39b404f2a0 con 0x7f39a4004d90 2023-10-03T10:14:49.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.912+0000 7f39b17fa700 1 -- 172.21.15.146:0/778101409 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f39a000c020 con 0x7f39a4004d90 2023-10-03T10:14:49.912 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:49.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.914+0000 7fb88d837700 1 -- 172.21.15.146:0/1285473606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb88812d380 msgr2=0x7fb888136d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.914+0000 7fb88d837700 1 --2- 172.21.15.146:0/1285473606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb88812d380 0x7fb888136d80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb87800c450 tx=0x7fb87800c810 comp rx=0 tx=0).stop 2023-10-03T10:14:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.914+0000 7fb88d837700 1 -- 172.21.15.146:0/1285473606 shutdown_connections 2023-10-03T10:14:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.914+0000 7fb88d837700 1 --2- 172.21.15.146:0/1285473606 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb888135f10 0x7fb888137800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.914+0000 7fb88d837700 1 --2- 172.21.15.146:0/1285473606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb88812d380 0x7fb888136d80 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.914+0000 7fb88d837700 1 --2- 172.21.15.146:0/1285473606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8881335f0 0x7fb8881372c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.914+0000 7fb88d837700 1 -- 172.21.15.146:0/1285473606 >> 172.21.15.146:0/1285473606 conn(0x7fb8880a2980 msgr2=0x7fb888135750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.914+0000 7fb88d837700 1 -- 172.21.15.146:0/1285473606 shutdown_connections 2023-10-03T10:14:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.914+0000 7fb88d837700 1 -- 172.21.15.146:0/1285473606 wait complete. 2023-10-03T10:14:49.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.916+0000 7f39bad0b700 1 -- 172.21.15.146:0/778101409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39a4004d90 msgr2=0x7f39b411a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.916+0000 7f39bad0b700 1 --2- 172.21.15.146:0/778101409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39a4004d90 0x7f39b411a8a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f39a0000c00 tx=0x7f39a00047c0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.920+0000 7f39bad0b700 1 -- 172.21.15.146:0/778101409 shutdown_connections 2023-10-03T10:14:49.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.920+0000 7f39bad0b700 1 --2- 172.21.15.146:0/778101409 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f39b409dea0 0x7f39b411ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.920+0000 7f39bad0b700 1 --2- 172.21.15.146:0/778101409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39a40040a0 0x7f39b411a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.920+0000 7f39bad0b700 1 --2- 172.21.15.146:0/778101409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f39a4004d90 0x7f39b411a8a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.920+0000 7f39bad0b700 1 -- 172.21.15.146:0/778101409 >> 172.21.15.146:0/778101409 conn(0x7f39b4099c40 msgr2=0x7f39b4138200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.920+0000 7f39bad0b700 1 -- 172.21.15.146:0/778101409 shutdown_connections 2023-10-03T10:14:49.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.920+0000 7f39bad0b700 1 -- 172.21.15.146:0/778101409 wait complete. 2023-10-03T10:14:49.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:49.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:49.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.959+0000 7fb45bb27700 1 -- 172.21.15.146:0/1436144027 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb454119640 con 0x7fb4540a1510 2023-10-03T10:14:49.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.959+0000 7fb44a7fc700 1 -- 172.21.15.146:0/1436144027 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb44400cad0 con 0x7fb4540a1510 2023-10-03T10:14:49.959 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:49.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.961+0000 7fb45bb27700 1 -- 172.21.15.146:0/1436144027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4540a1510 msgr2=0x7fb454134ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.961+0000 7fb45bb27700 1 --2- 172.21.15.146:0/1436144027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4540a1510 0x7fb454134ac0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb444010f40 tx=0x7fb44400e640 comp rx=0 tx=0).stop 2023-10-03T10:14:49.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.962+0000 7fb45bb27700 1 -- 172.21.15.146:0/1436144027 shutdown_connections 2023-10-03T10:14:49.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.962+0000 7fb45bb27700 1 --2- 172.21.15.146:0/1436144027 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4541356e0 0x7fb4541c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.962+0000 7fb45bb27700 1 --2- 172.21.15.146:0/1436144027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4540a0a30 0x7fb454134580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.962+0000 7fb45bb27700 1 --2- 172.21.15.146:0/1436144027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4540a1510 0x7fb454134ac0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.962+0000 7fb45bb27700 1 -- 172.21.15.146:0/1436144027 >> 172.21.15.146:0/1436144027 conn(0x7fb4540a2980 msgr2=0x7fb454130fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.962+0000 7fb45bb27700 1 -- 172.21.15.146:0/1436144027 shutdown_connections 2023-10-03T10:14:49.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.962+0000 7fb45bb27700 1 -- 172.21.15.146:0/1436144027 wait complete. 2023-10-03T10:14:49.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:49.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.999+0000 7fbf0889b700 1 -- 172.21.15.146:0/639752175 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbf04071df0 con 0x7fbf0406a770 2023-10-03T10:14:49.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:49.999+0000 7fbef2ffd700 1 -- 172.21.15.146:0/639752175 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbf04071df0 con 0x7fbf0406a770 2023-10-03T10:14:49.999 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:50.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:50.001+0000 7fbf0889b700 1 -- 172.21.15.146:0/639752175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf0406a770 msgr2=0x7fbf0406f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:50.001+0000 7fbf0889b700 1 --2- 172.21.15.146:0/639752175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf0406a770 0x7fbf0406f950 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fbef40090b0 tx=0x7fbef40047c0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:50.001+0000 7fbf0889b700 1 -- 172.21.15.146:0/639752175 shutdown_connections 2023-10-03T10:14:50.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:50.001+0000 7fbf0889b700 1 --2- 172.21.15.146:0/639752175 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf04134f00 0x7fbf040703d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:50.001+0000 7fbf0889b700 1 --2- 172.21.15.146:0/639752175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf0406a770 0x7fbf0406f950 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:50.001+0000 7fbf0889b700 1 --2- 172.21.15.146:0/639752175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf0409dea0 0x7fbf0406fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:50.001+0000 7fbf0889b700 1 -- 172.21.15.146:0/639752175 >> 172.21.15.146:0/639752175 conn(0x7fbf04099c40 msgr2=0x7fbf0409c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:50.002+0000 7fbf0889b700 1 -- 172.21.15.146:0/639752175 shutdown_connections 2023-10-03T10:14:50.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:50.002+0000 7fbf0889b700 1 -- 172.21.15.146:0/639752175 wait complete. 2023-10-03T10:14:50.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:50.927 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:50.937 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:50.975 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:51.013 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:51.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.071+0000 7f35a7258700 1 Processor -- start 2023-10-03T10:14:51.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.071+0000 7f35a7258700 1 -- start start 2023-10-03T10:14:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.072+0000 7f35a7258700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35a009ad40 0x7f35a0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.072+0000 7f35a7258700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35a01343a0 0x7f35a00a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.072+0000 7f35a7258700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a009b110 con 0x7f35a0133f70 2023-10-03T10:14:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.072+0000 7f35a7258700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a00a3b60 con 0x7f35a01343a0 2023-10-03T10:14:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.072+0000 7f35a7258700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00a2fa0 con 0x7f35a009ad40 2023-10-03T10:14:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.072+0000 7f35a57f5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35a01343a0 0x7f35a00a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.072+0000 7f35a57f5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35a01343a0 0x7f35a00a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51078/0 (socket says 172.21.15.146:51078) 2023-10-03T10:14:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.072+0000 7f359ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f35a0133f70 0x7f35a00a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48788/0 (socket says 172.21.15.146:48788) 2023-10-03T10:14:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.072+0000 7f35a57f5700 1 -- 172.21.15.146:0/835752888 learned_addr learned my addr 172.21.15.146:0/835752888 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.073+0000 7f35a4ff4700 1 --2- 172.21.15.146:0/835752888 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35a009ad40 0x7f35a0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.073+0000 7f35a57f5700 1 -- 172.21.15.146:0/835752888 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35a009ad40 msgr2=0x7f35a0133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.073+0000 7f35a57f5700 1 --2- 172.21.15.146:0/835752888 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35a009ad40 0x7f35a0133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.073+0000 7f35a57f5700 1 -- 172.21.15.146:0/835752888 >> v1:172.21.15.146:6789/0 conn(0x7f35a0133f70 legacy=0x7f35a00a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.073+0000 7f35a57f5700 1 -- 172.21.15.146:0/835752888 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a009a280 con 0x7f35a01343a0 2023-10-03T10:14:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.073+0000 7f35a57f5700 1 --2- 172.21.15.146:0/835752888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a01343a0 0x7f35a00a1180 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3598009e50 tx=0x7f359800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d396e7136594bb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.073+0000 7f359f7fe700 1 -- 172.21.15.146:0/835752888 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359800e070 con 0x7f35a01343a0 2023-10-03T10:14:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.073+0000 7f359f7fe700 1 -- 172.21.15.146:0/835752888 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359800b9c0 con 0x7f35a01343a0 2023-10-03T10:14:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.073+0000 7f359f7fe700 1 -- 172.21.15.146:0/835752888 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359800bd70 con 0x7f35a01343a0 2023-10-03T10:14:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.074+0000 7f35a7258700 1 -- 172.21.15.146:0/835752888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a01343a0 msgr2=0x7f35a00a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.074+0000 7f35a7258700 1 --2- 172.21.15.146:0/835752888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a01343a0 0x7f35a00a1180 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3598009e50 tx=0x7f359800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.074+0000 7f35a7258700 1 -- 172.21.15.146:0/835752888 shutdown_connections 2023-10-03T10:14:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.074+0000 7f35a7258700 1 --2- 172.21.15.146:0/835752888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a01343a0 0x7f35a00a1180 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.074+0000 7f35a7258700 1 --2- 172.21.15.146:0/835752888 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35a009ad40 0x7f35a0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.074+0000 7f35a7258700 1 -- 172.21.15.146:0/835752888 >> 172.21.15.146:0/835752888 conn(0x7f35a0099c40 msgr2=0x7f35a006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.074+0000 7f35a7258700 1 -- 172.21.15.146:0/835752888 shutdown_connections 2023-10-03T10:14:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.074+0000 7f35a7258700 1 -- 172.21.15.146:0/835752888 wait complete. 2023-10-03T10:14:51.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.075+0000 7f35a7258700 1 Processor -- start 2023-10-03T10:14:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.075+0000 7f35a7258700 1 -- start start 2023-10-03T10:14:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.076+0000 7f35a7258700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35a009ad40 0x7f35a01c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.076+0000 7f35a7258700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35a0133f70 0x7f35a01c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.076+0000 7f35a7258700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a01343a0 0x7f35a01c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.076+0000 7f35a7258700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a01c5cd0 con 0x7f35a01343a0 2023-10-03T10:14:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.076+0000 7f35a7258700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a009c7e0 con 0x7f35a0133f70 2023-10-03T10:14:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.076+0000 7f35a7258700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35a011fc10 con 0x7f35a009ad40 2023-10-03T10:14:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.076+0000 7f359ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35a0133f70 0x7f35a01c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.076+0000 7f359ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35a0133f70 0x7f35a01c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:54316/0 (socket says 172.21.15.146:54316) 2023-10-03T10:14:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.076+0000 7f359ffff700 1 -- 172.21.15.146:0/3557556417 learned_addr learned my addr 172.21.15.146:0/3557556417 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.076+0000 7f35a57f5700 1 --2- 172.21.15.146:0/3557556417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a01343a0 0x7f35a01c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.076+0000 7f359ffff700 1 -- 172.21.15.146:0/3557556417 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35a009ad40 msgr2=0x7f35a01c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.076+0000 7f359ffff700 1 --2- 172.21.15.146:0/3557556417 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35a009ad40 0x7f35a01c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.076+0000 7f359ffff700 1 -- 172.21.15.146:0/3557556417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a01343a0 msgr2=0x7f35a01c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.076+0000 7f359ffff700 1 --2- 172.21.15.146:0/3557556417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a01343a0 0x7f35a01c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.076+0000 7f359ffff700 1 -- 172.21.15.146:0/3557556417 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3598009b30 con 0x7f35a0133f70 2023-10-03T10:14:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.076+0000 7f359ffff700 1 --2- 172.21.15.146:0/3557556417 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35a0133f70 0x7f35a01c5790 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f358c00c4f0 tx=0x7f358c00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.077+0000 7f359d7fa700 1 -- 172.21.15.146:0/3557556417 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c005cb0 con 0x7f35a0133f70 2023-10-03T10:14:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.077+0000 7f35a7258700 1 -- 172.21.15.146:0/3557556417 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a00a4380 con 0x7f35a0133f70 2023-10-03T10:14:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.077+0000 7f359d7fa700 1 -- 172.21.15.146:0/3557556417 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c005e10 con 0x7f35a0133f70 2023-10-03T10:14:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.077+0000 7f359d7fa700 1 -- 172.21.15.146:0/3557556417 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c0072d0 con 0x7f35a0133f70 2023-10-03T10:14:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.077+0000 7f35a7258700 1 -- 172.21.15.146:0/3557556417 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a0121b20 con 0x7f35a0133f70 2023-10-03T10:14:51.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.078+0000 7f359d7fa700 1 -- 172.21.15.146:0/3557556417 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f358c007430 con 0x7f35a0133f70 2023-10-03T10:14:51.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.078+0000 7f359d7fa700 1 -- 172.21.15.146:0/3557556417 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f358c03eaf0 con 0x7f35a0133f70 2023-10-03T10:14:51.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.078+0000 7f35a7258700 1 -- 172.21.15.146:0/3557556417 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a004f2a0 con 0x7f35a0133f70 2023-10-03T10:14:51.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.083+0000 7f359d7fa700 1 -- 172.21.15.146:0/3557556417 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f358c017020 con 0x7f35a0133f70 2023-10-03T10:14:51.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.119+0000 7eff59325700 1 Processor -- start 2023-10-03T10:14:51.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.119+0000 7eff59325700 1 -- start start 2023-10-03T10:14:51.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.120+0000 7eff59325700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7eff5406a770 0x7eff5412ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.120+0000 7eff59325700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff541305d0 0x7eff54130a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.120+0000 7eff59325700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5406b0a0 con 0x7eff541334b0 2023-10-03T10:14:51.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.120+0000 7eff59325700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff5406ab40 con 0x7eff5406a770 2023-10-03T10:14:51.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.120+0000 7eff59325700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff54130f60 con 0x7eff541305d0 2023-10-03T10:14:51.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.120+0000 7eff527fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff541305d0 0x7eff54130a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.120+0000 7eff527fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff541305d0 0x7eff54130a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39144/0 (socket says 172.21.15.146:39144) 2023-10-03T10:14:51.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.120+0000 7eff527fc700 1 -- 172.21.15.146:0/1754670464 learned_addr learned my addr 172.21.15.146:0/1754670464 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:51.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.120+0000 7eff52ffd700 1 --2- 172.21.15.146:0/1754670464 >> v2:172.21.15.146:3300/0 conn(0x7eff5406a770 0x7eff5412ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.120+0000 7eff527fc700 1 -- 172.21.15.146:0/1754670464 >> v2:172.21.15.146:3300/0 conn(0x7eff5406a770 msgr2=0x7eff5412ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:51.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.120+0000 7eff527fc700 1 --2- 172.21.15.146:0/1754670464 >> v2:172.21.15.146:3300/0 conn(0x7eff5406a770 0x7eff5412ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.120+0000 7eff527fc700 1 -- 172.21.15.146:0/1754670464 >> v1:172.21.15.146:6789/0 conn(0x7eff541334b0 legacy=0x7eff541338d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.121+0000 7eff527fc700 1 -- 172.21.15.146:0/1754670464 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5409f670 con 0x7eff541305d0 2023-10-03T10:14:51.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.121+0000 7eff527fc700 1 --2- 172.21.15.146:0/1754670464 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff541305d0 0x7eff54130a20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7eff480098f0 tx=0x7eff48009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e0e890b2056ed7f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.121+0000 7eff51ffb700 1 -- 172.21.15.146:0/1754670464 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4800b8a0 con 0x7eff541305d0 2023-10-03T10:14:51.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.121+0000 7eff51ffb700 1 -- 172.21.15.146:0/1754670464 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4800ba00 con 0x7eff541305d0 2023-10-03T10:14:51.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.121+0000 7eff51ffb700 1 -- 172.21.15.146:0/1754670464 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4800bd90 con 0x7eff541305d0 2023-10-03T10:14:51.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.122+0000 7eff59325700 1 -- 172.21.15.146:0/1754670464 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff541305d0 msgr2=0x7eff54130a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.122+0000 7eff59325700 1 --2- 172.21.15.146:0/1754670464 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff541305d0 0x7eff54130a20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7eff480098f0 tx=0x7eff48009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:51.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.122+0000 7eff59325700 1 -- 172.21.15.146:0/1754670464 shutdown_connections 2023-10-03T10:14:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.122+0000 7eff59325700 1 --2- 172.21.15.146:0/1754670464 >> v2:172.21.15.146:3300/0 conn(0x7eff5406a770 0x7eff5412ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.122+0000 7eff59325700 1 --2- 172.21.15.146:0/1754670464 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff541305d0 0x7eff54130a20 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.122+0000 7eff59325700 1 -- 172.21.15.146:0/1754670464 >> 172.21.15.146:0/1754670464 conn(0x7eff540a2ef0 msgr2=0x7eff540a32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.122+0000 7eff59325700 1 -- 172.21.15.146:0/1754670464 shutdown_connections 2023-10-03T10:14:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.122+0000 7eff59325700 1 -- 172.21.15.146:0/1754670464 wait complete. 2023-10-03T10:14:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.123+0000 7eff59325700 1 Processor -- start 2023-10-03T10:14:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.123+0000 7eff59325700 1 -- start start 2023-10-03T10:14:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.124+0000 7eff59325700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff5406a770 0x7eff54071260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.124+0000 7eff59325700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff541305d0 0x7eff540717a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.124+0000 7eff59325700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff541334b0 0x7eff54071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.124+0000 7eff59325700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff540a0340 con 0x7eff541334b0 2023-10-03T10:14:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.124+0000 7eff59325700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5411b450 con 0x7eff5406a770 2023-10-03T10:14:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.124+0000 7eff52ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff5406a770 0x7eff54071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.124+0000 7eff527fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff541305d0 0x7eff540717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.124+0000 7eff52ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff5406a770 0x7eff54071260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:54322/0 (socket says 172.21.15.146:54322) 2023-10-03T10:14:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.124+0000 7eff52ffd700 1 -- 172.21.15.146:0/1065969127 learned_addr learned my addr 172.21.15.146:0/1065969127 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.124+0000 7eff527fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff541305d0 0x7eff540717a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39150/0 (socket says 172.21.15.146:39150) 2023-10-03T10:14:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.124+0000 7eff59325700 1 -- 172.21.15.146:0/1065969127 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff5412db30 con 0x7eff541305d0 2023-10-03T10:14:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.124+0000 7eff537fe700 1 --2- 172.21.15.146:0/1065969127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff541334b0 0x7eff54071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.125+0000 7eff537fe700 1 -- 172.21.15.146:0/1065969127 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff541305d0 msgr2=0x7eff540717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.125+0000 7eff537fe700 1 --2- 172.21.15.146:0/1065969127 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff541305d0 0x7eff540717a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.125+0000 7eff537fe700 1 -- 172.21.15.146:0/1065969127 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff5406a770 msgr2=0x7eff54071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.125+0000 7eff537fe700 1 --2- 172.21.15.146:0/1065969127 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff5406a770 0x7eff54071260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.125+0000 7eff537fe700 1 -- 172.21.15.146:0/1065969127 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff48009550 con 0x7eff541334b0 2023-10-03T10:14:51.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.125+0000 7eff52ffd700 1 --2- 172.21.15.146:0/1065969127 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff5406a770 0x7eff54071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:51.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.125+0000 7eff537fe700 1 --2- 172.21.15.146:0/1065969127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff541334b0 0x7eff54071ce0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00cb90 tx=0x7eff4c00cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.125+0000 7eff3b7fe700 1 -- 172.21.15.146:0/1065969127 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c003c00 con 0x7eff541334b0 2023-10-03T10:14:51.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.125+0000 7eff3b7fe700 1 -- 172.21.15.146:0/1065969127 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4c003d60 con 0x7eff541334b0 2023-10-03T10:14:51.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.125+0000 7eff3b7fe700 1 -- 172.21.15.146:0/1065969127 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c00aaa0 con 0x7eff541334b0 2023-10-03T10:14:51.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.126+0000 7eff59325700 1 -- 172.21.15.146:0/1065969127 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff5411ada0 con 0x7eff541334b0 2023-10-03T10:14:51.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.126+0000 7eff59325700 1 -- 172.21.15.146:0/1065969127 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5411b9f0 con 0x7eff541334b0 2023-10-03T10:14:51.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.127+0000 7eff3b7fe700 1 -- 172.21.15.146:0/1065969127 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7eff4c00ac00 con 0x7eff541334b0 2023-10-03T10:14:51.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.127+0000 7eff59325700 1 -- 172.21.15.146:0/1065969127 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff54119c50 con 0x7eff541334b0 2023-10-03T10:14:51.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.127+0000 7eff3b7fe700 1 -- 172.21.15.146:0/1065969127 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7eff4c03f770 con 0x7eff541334b0 2023-10-03T10:14:51.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.135+0000 7eff3b7fe700 1 -- 172.21.15.146:0/1065969127 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7eff54119c50 con 0x7eff541334b0 2023-10-03T10:14:51.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.152+0000 7f6726a8c700 1 Processor -- start 2023-10-03T10:14:51.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.152+0000 7f6726a8c700 1 -- start start 2023-10-03T10:14:51.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.153+0000 7f6726a8c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6720136960 0x7f6720138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.153+0000 7f6726a8c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6720139280 0x7f672013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.153+0000 7f6726a8c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672006b2d0 con 0x7f6720133ad0 2023-10-03T10:14:51.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.153+0000 7f6726a8c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67201345b0 con 0x7f6720136960 2023-10-03T10:14:51.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.153+0000 7f6726a8c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6720133610 con 0x7f6720139280 2023-10-03T10:14:51.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.153+0000 7f6725029700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6720139280 0x7f672013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.153+0000 7f6725029700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6720139280 0x7f672013b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39152/0 (socket says 172.21.15.146:39152) 2023-10-03T10:14:51.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.153+0000 7f6725029700 1 -- 172.21.15.146:0/3482208989 learned_addr learned my addr 172.21.15.146:0/3482208989 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:51.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.153+0000 7f671ffff700 1 --2- 172.21.15.146:0/3482208989 >> v2:172.21.15.146:3300/0 conn(0x7f6720136960 0x7f6720138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.153+0000 7f6725029700 1 -- 172.21.15.146:0/3482208989 >> v2:172.21.15.146:3300/0 conn(0x7f6720136960 msgr2=0x7f6720138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:51.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.153+0000 7f6725029700 1 --2- 172.21.15.146:0/3482208989 >> v2:172.21.15.146:3300/0 conn(0x7f6720136960 0x7f6720138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.153+0000 7f6725029700 1 -- 172.21.15.146:0/3482208989 >> v1:172.21.15.146:6789/0 conn(0x7f6720133ad0 legacy=0x7f6720133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.153+0000 7f6725029700 1 -- 172.21.15.146:0/3482208989 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672009a500 con 0x7f6720139280 2023-10-03T10:14:51.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.153+0000 7f6725029700 1 --2- 172.21.15.146:0/3482208989 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6720139280 0x7f672013b660 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6718009e50 tx=0x7f671800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5abdfb3572b0076 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.154+0000 7f671f7fe700 1 -- 172.21.15.146:0/3482208989 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671800e070 con 0x7f6720139280 2023-10-03T10:14:51.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.154+0000 7f671f7fe700 1 -- 172.21.15.146:0/3482208989 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671800b910 con 0x7f6720139280 2023-10-03T10:14:51.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.154+0000 7f671f7fe700 1 -- 172.21.15.146:0/3482208989 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671800bcc0 con 0x7f6720139280 2023-10-03T10:14:51.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.154+0000 7f6726a8c700 1 -- 172.21.15.146:0/3482208989 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6720139280 msgr2=0x7f672013b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.154+0000 7f6726a8c700 1 --2- 172.21.15.146:0/3482208989 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6720139280 0x7f672013b660 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6718009e50 tx=0x7f671800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:51.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.154+0000 7f6726a8c700 1 -- 172.21.15.146:0/3482208989 shutdown_connections 2023-10-03T10:14:51.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.154+0000 7f6726a8c700 1 --2- 172.21.15.146:0/3482208989 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6720139280 0x7f672013b660 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.154+0000 7f6726a8c700 1 --2- 172.21.15.146:0/3482208989 >> v2:172.21.15.146:3300/0 conn(0x7f6720136960 0x7f6720138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.154+0000 7f6726a8c700 1 -- 172.21.15.146:0/3482208989 >> 172.21.15.146:0/3482208989 conn(0x7f6720099c40 msgr2=0x7f67200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.154+0000 7f6726a8c700 1 -- 172.21.15.146:0/3482208989 shutdown_connections 2023-10-03T10:14:51.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.155+0000 7f6726a8c700 1 -- 172.21.15.146:0/3482208989 wait complete. 2023-10-03T10:14:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.156+0000 7f6726a8c700 1 Processor -- start 2023-10-03T10:14:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.156+0000 7f6726a8c700 1 -- start start 2023-10-03T10:14:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.157+0000 7f6726a8c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6720133ad0 0x7f672012fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.157+0000 7f6726a8c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6720136960 0x7f672012ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.157+0000 7f6726a8c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6720139280 0x7f67201c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.157+0000 7f6726a8c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6720070370 con 0x7f6720136960 2023-10-03T10:14:51.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.157+0000 7f6726a8c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67201316a0 con 0x7f6720139280 2023-10-03T10:14:51.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.157+0000 7f6726a8c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f672006fe40 con 0x7f6720133ad0 2023-10-03T10:14:51.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.157+0000 7f671ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6720136960 0x7f672012ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.157+0000 7f671ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6720136960 0x7f672012ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51126/0 (socket says 172.21.15.146:51126) 2023-10-03T10:14:51.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.157+0000 7f671ffff700 1 -- 172.21.15.146:0/1229596041 learned_addr learned my addr 172.21.15.146:0/1229596041 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:51.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.157+0000 7f6724828700 1 --2- 172.21.15.146:0/1229596041 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6720133ad0 0x7f672012fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.157+0000 7f6724828700 1 -- 172.21.15.146:0/1229596041 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6720139280 msgr2=0x7f67201c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.157+0000 7f6724828700 1 --2- 172.21.15.146:0/1229596041 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6720139280 0x7f67201c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.157+0000 7f6724828700 1 -- 172.21.15.146:0/1229596041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6720136960 msgr2=0x7f672012ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.157+0000 7f6724828700 1 --2- 172.21.15.146:0/1229596041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6720136960 0x7f672012ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.157+0000 7f6724828700 1 -- 172.21.15.146:0/1229596041 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6718009b30 con 0x7f6720133ad0 2023-10-03T10:14:51.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.157+0000 7f671ffff700 1 --2- 172.21.15.146:0/1229596041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6720136960 0x7f672012ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:51.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.157+0000 7f6724828700 1 --2- 172.21.15.146:0/1229596041 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6720133ad0 0x7f672012fa30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6714000f60 tx=0x7f671400c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.158+0000 7f671d7fa700 1 -- 172.21.15.146:0/1229596041 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67140052d0 con 0x7f6720133ad0 2023-10-03T10:14:51.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.158+0000 7f671d7fa700 1 -- 172.21.15.146:0/1229596041 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671400ce90 con 0x7f6720133ad0 2023-10-03T10:14:51.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.158+0000 7f6726a8c700 1 -- 172.21.15.146:0/1229596041 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672006ef30 con 0x7f6720133ad0 2023-10-03T10:14:51.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.158+0000 7f671d7fa700 1 -- 172.21.15.146:0/1229596041 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6714003680 con 0x7f6720133ad0 2023-10-03T10:14:51.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.158+0000 7f6726a8c700 1 -- 172.21.15.146:0/1229596041 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67201304b0 con 0x7f6720133ad0 2023-10-03T10:14:51.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.159+0000 7f671d7fa700 1 -- 172.21.15.146:0/1229596041 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f67140037e0 con 0x7f6720133ad0 2023-10-03T10:14:51.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.159+0000 7f671d7fa700 1 -- 172.21.15.146:0/1229596041 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f671403e9c0 con 0x7f6720133ad0 2023-10-03T10:14:51.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.159+0000 7f6726a8c700 1 -- 172.21.15.146:0/1229596041 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f672004f2a0 con 0x7f6720133ad0 2023-10-03T10:14:51.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.159+0000 7f52cd768700 1 Processor -- start 2023-10-03T10:14:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.159+0000 7f52cd768700 1 -- start start 2023-10-03T10:14:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.160+0000 7f52cd768700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c80a0a30 0x7f52c80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.160+0000 7f52cd768700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52c8130670 0x7f52c81381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.160+0000 7f52cd768700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c80a1e70 con 0x7f52c80a1340 2023-10-03T10:14:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.160+0000 7f52cd768700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c809a720 con 0x7f52c8130670 2023-10-03T10:14:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.160+0000 7f52cd768700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52c809b300 con 0x7f52c80a0a30 2023-10-03T10:14:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.160+0000 7f52c6ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c80a0a30 0x7f52c80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.160+0000 7f52c77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52c8130670 0x7f52c81381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.160+0000 7f52c6ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c80a0a30 0x7f52c80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39178/0 (socket says 172.21.15.146:39178) 2023-10-03T10:14:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.160+0000 7f52c6ffd700 1 -- 172.21.15.146:0/2138769127 learned_addr learned my addr 172.21.15.146:0/2138769127 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.161+0000 7f52c77fe700 1 -- 172.21.15.146:0/2138769127 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c80a0a30 msgr2=0x7f52c80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.161+0000 7f52c77fe700 1 --2- 172.21.15.146:0/2138769127 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c80a0a30 0x7f52c80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.161+0000 7f52c77fe700 1 -- 172.21.15.146:0/2138769127 >> v1:172.21.15.146:6789/0 conn(0x7f52c80a1340 legacy=0x7f52c812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:51.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.161+0000 7f52c77fe700 1 -- 172.21.15.146:0/2138769127 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c809abc0 con 0x7f52c8130670 2023-10-03T10:14:51.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.161+0000 7f52c77fe700 1 --2- 172.21.15.146:0/2138769127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c8130670 0x7f52c81381c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f52c0009d90 tx=0x7f52c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5318232b5efac8e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.161+0000 7f52c5ffb700 1 -- 172.21.15.146:0/2138769127 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c000e070 con 0x7f52c8130670 2023-10-03T10:14:51.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.161+0000 7f52c5ffb700 1 -- 172.21.15.146:0/2138769127 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c000bae0 con 0x7f52c8130670 2023-10-03T10:14:51.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.161+0000 7f52c5ffb700 1 -- 172.21.15.146:0/2138769127 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c000be90 con 0x7f52c8130670 2023-10-03T10:14:51.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.162+0000 7f52cd768700 1 -- 172.21.15.146:0/2138769127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c8130670 msgr2=0x7f52c81381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.162+0000 7f52cd768700 1 --2- 172.21.15.146:0/2138769127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c8130670 0x7f52c81381c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f52c0009d90 tx=0x7f52c000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:51.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.162+0000 7f52cd768700 1 -- 172.21.15.146:0/2138769127 shutdown_connections 2023-10-03T10:14:51.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.162+0000 7f52cd768700 1 --2- 172.21.15.146:0/2138769127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c8130670 0x7f52c81381c0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.162+0000 7f52cd768700 1 --2- 172.21.15.146:0/2138769127 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c80a0a30 0x7f52c80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.162+0000 7f52cd768700 1 -- 172.21.15.146:0/2138769127 >> 172.21.15.146:0/2138769127 conn(0x7f52c80a2980 msgr2=0x7f52c80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.162+0000 7f52cd768700 1 -- 172.21.15.146:0/2138769127 shutdown_connections 2023-10-03T10:14:51.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.162+0000 7f52cd768700 1 -- 172.21.15.146:0/2138769127 wait complete. 2023-10-03T10:14:51.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.164+0000 7f52cd768700 1 Processor -- start 2023-10-03T10:14:51.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.164+0000 7f52cd768700 1 -- start start 2023-10-03T10:14:51.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.164+0000 7f52cd768700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c80a0a30 0x7f52c81cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.164+0000 7f52cd768700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c80a1340 0x7f52c81ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.164+0000 7f52cd768700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c8130670 0x7f52c81cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.164+0000 7f52cd768700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c809ae00 con 0x7f52c8130670 2023-10-03T10:14:51.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.164+0000 7f52cd768700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c8122400 con 0x7f52c80a1340 2023-10-03T10:14:51.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.164+0000 7f52cd768700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52c809fdc0 con 0x7f52c80a0a30 2023-10-03T10:14:51.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.165+0000 7f52c77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c8130670 0x7f52c81cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.165+0000 7f52c67fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c80a1340 0x7f52c81ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.165+0000 7f52c6ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c80a0a30 0x7f52c81cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.165+0000 7f52c77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c8130670 0x7f52c81cd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51148/0 (socket says 172.21.15.146:51148) 2023-10-03T10:14:51.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.165+0000 7f52c77fe700 1 -- 172.21.15.146:0/4238155846 learned_addr learned my addr 172.21.15.146:0/4238155846 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:51.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.165+0000 7f52c67fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c80a1340 0x7f52c81ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:54332/0 (socket says 172.21.15.146:54332) 2023-10-03T10:14:51.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.165+0000 7f52c67fc700 1 -- 172.21.15.146:0/4238155846 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c80a0a30 msgr2=0x7f52c81cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.165+0000 7f52c67fc700 1 --2- 172.21.15.146:0/4238155846 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c80a0a30 0x7f52c81cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.165+0000 7f52c67fc700 1 -- 172.21.15.146:0/4238155846 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c8130670 msgr2=0x7f52c81cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.165+0000 7f52c67fc700 1 --2- 172.21.15.146:0/4238155846 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c8130670 0x7f52c81cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.165+0000 7f52c67fc700 1 -- 172.21.15.146:0/4238155846 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c0009a70 con 0x7f52c80a1340 2023-10-03T10:14:51.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.165+0000 7f52c77fe700 1 --2- 172.21.15.146:0/4238155846 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c8130670 0x7f52c81cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:51.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.165+0000 7f52c67fc700 1 --2- 172.21.15.146:0/4238155846 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c80a1340 0x7f52c81ccbb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f52c80a2680 tx=0x7f52bc00c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.165+0000 7f52af7fe700 1 -- 172.21.15.146:0/4238155846 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc0052d0 con 0x7f52c80a1340 2023-10-03T10:14:51.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.165+0000 7f52af7fe700 1 -- 172.21.15.146:0/4238155846 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc005430 con 0x7f52c80a1340 2023-10-03T10:14:51.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.165+0000 7f52af7fe700 1 -- 172.21.15.146:0/4238155846 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc0038c0 con 0x7f52c80a1340 2023-10-03T10:14:51.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.166+0000 7f671d7fa700 1 -- 172.21.15.146:0/1229596041 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6714017020 con 0x7f6720133ad0 2023-10-03T10:14:51.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.166+0000 7f52cd768700 1 -- 172.21.15.146:0/4238155846 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c8134c60 con 0x7f52c80a1340 2023-10-03T10:14:51.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.166+0000 7f52cd768700 1 -- 172.21.15.146:0/4238155846 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c8134050 con 0x7f52c80a1340 2023-10-03T10:14:51.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.167+0000 7f52cd768700 1 -- 172.21.15.146:0/4238155846 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c804f2a0 con 0x7f52c80a1340 2023-10-03T10:14:51.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.167+0000 7f52af7fe700 1 -- 172.21.15.146:0/4238155846 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52bc003c30 con 0x7f52c80a1340 2023-10-03T10:14:51.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.168+0000 7f52af7fe700 1 -- 172.21.15.146:0/4238155846 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f52bc03e8b0 con 0x7f52c80a1340 2023-10-03T10:14:51.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.176+0000 7f52af7fe700 1 -- 172.21.15.146:0/4238155846 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52bc011eb0 con 0x7f52c80a1340 2023-10-03T10:14:51.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.283+0000 7f35a7258700 1 -- 172.21.15.146:0/3557556417 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f35a00729d0 con 0x7f35a0133f70 2023-10-03T10:14:51.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.284+0000 7f359d7fa700 1 -- 172.21.15.146:0/3557556417 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f358c03ce60 con 0x7f35a0133f70 2023-10-03T10:14:51.283 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.287+0000 7f35a7258700 1 -- 172.21.15.146:0/3557556417 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35a0133f70 msgr2=0x7f35a01c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.287+0000 7f35a7258700 1 --2- 172.21.15.146:0/3557556417 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35a0133f70 0x7f35a01c5790 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f358c00c4f0 tx=0x7f358c00c800 comp rx=0 tx=0).stop 2023-10-03T10:14:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.287+0000 7f35a7258700 1 -- 172.21.15.146:0/3557556417 shutdown_connections 2023-10-03T10:14:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.287+0000 7f35a7258700 1 --2- 172.21.15.146:0/3557556417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a01343a0 0x7f35a01c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.287+0000 7f35a7258700 1 --2- 172.21.15.146:0/3557556417 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35a009ad40 0x7f35a01c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.287+0000 7f35a7258700 1 --2- 172.21.15.146:0/3557556417 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35a0133f70 0x7f35a01c5790 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.287+0000 7f35a7258700 1 -- 172.21.15.146:0/3557556417 >> 172.21.15.146:0/3557556417 conn(0x7f35a0099c40 msgr2=0x7f35a0133010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.287+0000 7f35a7258700 1 -- 172.21.15.146:0/3557556417 shutdown_connections 2023-10-03T10:14:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.287+0000 7f35a7258700 1 -- 172.21.15.146:0/3557556417 wait complete. 2023-10-03T10:14:51.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:51.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.334+0000 7eff59325700 1 -- 172.21.15.146:0/1065969127 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7eff5411b5c0 con 0x7eff541334b0 2023-10-03T10:14:51.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.334+0000 7eff3b7fe700 1 -- 172.21.15.146:0/1065969127 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7eff4c02a090 con 0x7eff541334b0 2023-10-03T10:14:51.334 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:51.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.336+0000 7eff59325700 1 -- 172.21.15.146:0/1065969127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff541334b0 msgr2=0x7eff54071ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.336+0000 7eff59325700 1 --2- 172.21.15.146:0/1065969127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff541334b0 0x7eff54071ce0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00cb90 tx=0x7eff4c00cea0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.336+0000 7eff59325700 1 -- 172.21.15.146:0/1065969127 shutdown_connections 2023-10-03T10:14:51.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.336+0000 7eff59325700 1 --2- 172.21.15.146:0/1065969127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff541334b0 0x7eff54071ce0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.336+0000 7eff59325700 1 --2- 172.21.15.146:0/1065969127 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff5406a770 0x7eff54071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.336+0000 7eff59325700 1 --2- 172.21.15.146:0/1065969127 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff541305d0 0x7eff540717a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.336+0000 7eff59325700 1 -- 172.21.15.146:0/1065969127 >> 172.21.15.146:0/1065969127 conn(0x7eff540a2ef0 msgr2=0x7eff5409bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.336+0000 7eff59325700 1 -- 172.21.15.146:0/1065969127 shutdown_connections 2023-10-03T10:14:51.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.336+0000 7eff59325700 1 -- 172.21.15.146:0/1065969127 wait complete. 2023-10-03T10:14:51.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:51.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.369+0000 7f6726a8c700 1 -- 172.21.15.146:0/1229596041 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f672009f390 con 0x7f6720133ad0 2023-10-03T10:14:51.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.369+0000 7f671d7fa700 1 -- 172.21.15.146:0/1229596041 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f67140196d0 con 0x7f6720133ad0 2023-10-03T10:14:51.369 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:51.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.372+0000 7f6726a8c700 1 -- 172.21.15.146:0/1229596041 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6720133ad0 msgr2=0x7f672012fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.372+0000 7f6726a8c700 1 --2- 172.21.15.146:0/1229596041 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6720133ad0 0x7f672012fa30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6714000f60 tx=0x7f671400c6e0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.372+0000 7f6726a8c700 1 -- 172.21.15.146:0/1229596041 shutdown_connections 2023-10-03T10:14:51.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.372+0000 7f6726a8c700 1 --2- 172.21.15.146:0/1229596041 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6720139280 0x7f67201c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.372+0000 7f6726a8c700 1 --2- 172.21.15.146:0/1229596041 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6720133ad0 0x7f672012fa30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.372+0000 7f6726a8c700 1 --2- 172.21.15.146:0/1229596041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6720136960 0x7f672012ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.372+0000 7f6726a8c700 1 -- 172.21.15.146:0/1229596041 >> 172.21.15.146:0/1229596041 conn(0x7f6720099c40 msgr2=0x7f6720134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.372+0000 7f6726a8c700 1 -- 172.21.15.146:0/1229596041 shutdown_connections 2023-10-03T10:14:51.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.372+0000 7f6726a8c700 1 -- 172.21.15.146:0/1229596041 wait complete. 2023-10-03T10:14:51.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.380+0000 7f52cd768700 1 -- 172.21.15.146:0/4238155846 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f52c80a1710 con 0x7f52c80a1340 2023-10-03T10:14:51.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.380+0000 7f52af7fe700 1 -- 172.21.15.146:0/4238155846 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f52bc011ac0 con 0x7f52c80a1340 2023-10-03T10:14:51.380 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:51.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.382+0000 7f52cd768700 1 -- 172.21.15.146:0/4238155846 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c80a1340 msgr2=0x7f52c81ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.382+0000 7f52cd768700 1 --2- 172.21.15.146:0/4238155846 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c80a1340 0x7f52c81ccbb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f52c80a2680 tx=0x7f52bc00c6e0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.382+0000 7f52cd768700 1 -- 172.21.15.146:0/4238155846 shutdown_connections 2023-10-03T10:14:51.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.382+0000 7f52cd768700 1 --2- 172.21.15.146:0/4238155846 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c8130670 0x7f52c81cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.382+0000 7f52cd768700 1 --2- 172.21.15.146:0/4238155846 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c80a0a30 0x7f52c81cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.382+0000 7f52cd768700 1 --2- 172.21.15.146:0/4238155846 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c80a1340 0x7f52c81ccbb0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.382+0000 7f52cd768700 1 -- 172.21.15.146:0/4238155846 >> 172.21.15.146:0/4238155846 conn(0x7f52c80a2980 msgr2=0x7f52c8136e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.383+0000 7f52cd768700 1 -- 172.21.15.146:0/4238155846 shutdown_connections 2023-10-03T10:14:51.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:51.383+0000 7f52cd768700 1 -- 172.21.15.146:0/4238155846 wait complete. 2023-10-03T10:14:51.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:51.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:52.303 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:52.348 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:52.385 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:52.395 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:52.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.434+0000 7fe09cd74700 1 Processor -- start 2023-10-03T10:14:52.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.434+0000 7fe09cd74700 1 -- start start 2023-10-03T10:14:52.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.435+0000 7fe09cd74700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe09809e870 0x7fe09809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.435+0000 7fe09cd74700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe09809f180 0x7fe098133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.435+0000 7fe09cd74700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe09806bec0 con 0x7fe0981341d0 2023-10-03T10:14:52.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.435+0000 7fe09cd74700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09806ce60 con 0x7fe09809f180 2023-10-03T10:14:52.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.435+0000 7fe09cd74700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe09809fa00 con 0x7fe09809e870 2023-10-03T10:14:52.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.435+0000 7fe096d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe0981341d0 0x7fe09813af50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48834/0 (socket says 172.21.15.146:48834) 2023-10-03T10:14:52.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.435+0000 7fe096d9d700 1 -- 172.21.15.146:0/817972849 learned_addr learned my addr 172.21.15.146:0/817972849 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:52.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.435+0000 7fe095d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe09809f180 0x7fe098133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.435+0000 7fe09659c700 1 --2- 172.21.15.146:0/817972849 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe09809e870 0x7fe09809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.435+0000 7fe09659c700 1 -- 172.21.15.146:0/817972849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe09809f180 msgr2=0x7fe098133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:52.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.435+0000 7fe09659c700 1 --2- 172.21.15.146:0/817972849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe09809f180 0x7fe098133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.435+0000 7fe09659c700 1 -- 172.21.15.146:0/817972849 >> v1:172.21.15.146:6789/0 conn(0x7fe0981341d0 legacy=0x7fe09813af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.435+0000 7fe09559a700 1 -- 172.21.15.146:0/817972849 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842742980 0 0) 0x7fe09806bec0 con 0x7fe0981341d0 2023-10-03T10:14:52.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.436+0000 7fe09659c700 1 -- 172.21.15.146:0/817972849 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09809ad80 con 0x7fe09809e870 2023-10-03T10:14:52.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.436+0000 7fe095d9b700 1 --2- 172.21.15.146:0/817972849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe09809f180 0x7fe098133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:52.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.436+0000 7fe09659c700 1 --2- 172.21.15.146:0/817972849 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe09809e870 0x7fe09809ec40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe0880098a0 tx=0x7fe088009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59c235f2d3c053e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.436+0000 7fe09559a700 1 -- 172.21.15.146:0/817972849 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088011830 con 0x7fe09809e870 2023-10-03T10:14:52.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.436+0000 7fe09559a700 1 -- 172.21.15.146:0/817972849 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe088011990 con 0x7fe09809e870 2023-10-03T10:14:52.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.436+0000 7fe09559a700 1 -- 172.21.15.146:0/817972849 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088011d20 con 0x7fe09809e870 2023-10-03T10:14:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.437+0000 7fe09cd74700 1 -- 172.21.15.146:0/817972849 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe09809e870 msgr2=0x7fe09809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.437+0000 7fe09cd74700 1 --2- 172.21.15.146:0/817972849 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe09809e870 0x7fe09809ec40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe0880098a0 tx=0x7fe088009bb0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.437+0000 7fe09cd74700 1 -- 172.21.15.146:0/817972849 shutdown_connections 2023-10-03T10:14:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.437+0000 7fe09cd74700 1 --2- 172.21.15.146:0/817972849 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe09809e870 0x7fe09809ec40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.437+0000 7fe09cd74700 1 --2- 172.21.15.146:0/817972849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe09809f180 0x7fe098133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.437+0000 7fe09cd74700 1 -- 172.21.15.146:0/817972849 >> 172.21.15.146:0/817972849 conn(0x7fe0980a4430 msgr2=0x7fe0980a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.437+0000 7fe09cd74700 1 -- 172.21.15.146:0/817972849 shutdown_connections 2023-10-03T10:14:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.437+0000 7fe09cd74700 1 -- 172.21.15.146:0/817972849 wait complete. 2023-10-03T10:14:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.438+0000 7fe09cd74700 1 Processor -- start 2023-10-03T10:14:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.438+0000 7fe09cd74700 1 -- start start 2023-10-03T10:14:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.439+0000 7fe09cd74700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe09809e870 0x7fe098122b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.439+0000 7fe09cd74700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe09809f180 0x7fe0981230c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.439+0000 7fe09cd74700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0981341d0 0x7fe098123600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.439+0000 7fe09cd74700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0980a1700 con 0x7fe0981341d0 2023-10-03T10:14:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.439+0000 7fe09cd74700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe098124910 con 0x7fe09809f180 2023-10-03T10:14:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.439+0000 7fe09cd74700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe098124d40 con 0x7fe09809e870 2023-10-03T10:14:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.439+0000 7fe095d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe09809f180 0x7fe0981230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.439+0000 7fe095d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe09809f180 0x7fe0981230c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:54346/0 (socket says 172.21.15.146:54346) 2023-10-03T10:14:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.439+0000 7fe095d9b700 1 -- 172.21.15.146:0/676428072 learned_addr learned my addr 172.21.15.146:0/676428072 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.439+0000 7fe095d9b700 1 -- 172.21.15.146:0/676428072 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe09809e870 msgr2=0x7fe098122b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.439+0000 7fe095d9b700 1 --2- 172.21.15.146:0/676428072 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe09809e870 0x7fe098122b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.439+0000 7fe095d9b700 1 -- 172.21.15.146:0/676428072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0981341d0 msgr2=0x7fe098123600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.439+0000 7fe095d9b700 1 --2- 172.21.15.146:0/676428072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0981341d0 0x7fe098123600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.439+0000 7fe095d9b700 1 -- 172.21.15.146:0/676428072 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c0094a0 con 0x7fe09809f180 2023-10-03T10:14:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.439+0000 7fe095d9b700 1 --2- 172.21.15.146:0/676428072 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe09809f180 0x7fe0981230c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00ebb0 tx=0x7fe08c00ef70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.440+0000 7fe086ffd700 1 -- 172.21.15.146:0/676428072 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c00c910 con 0x7fe09809f180 2023-10-03T10:14:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.440+0000 7fe086ffd700 1 -- 172.21.15.146:0/676428072 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c00ca70 con 0x7fe09809f180 2023-10-03T10:14:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.440+0000 7fe086ffd700 1 -- 172.21.15.146:0/676428072 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c00cde0 con 0x7fe09809f180 2023-10-03T10:14:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.440+0000 7fe09cd74700 1 -- 172.21.15.146:0/676428072 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0880094a0 con 0x7fe09809f180 2023-10-03T10:14:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.441+0000 7fe09cd74700 1 -- 172.21.15.146:0/676428072 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0981263c0 con 0x7fe09809f180 2023-10-03T10:14:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.441+0000 7fe086ffd700 1 -- 172.21.15.146:0/676428072 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe08c013470 con 0x7fe09809f180 2023-10-03T10:14:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.441+0000 7fe09cd74700 1 -- 172.21.15.146:0/676428072 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09809b370 con 0x7fe09809f180 2023-10-03T10:14:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.442+0000 7fe086ffd700 1 -- 172.21.15.146:0/676428072 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe08c01a360 con 0x7fe09809f180 2023-10-03T10:14:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.446+0000 7fe086ffd700 1 -- 172.21.15.146:0/676428072 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe08c017070 con 0x7fe09809f180 2023-10-03T10:14:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.489+0000 7f193b78d700 1 Processor -- start 2023-10-03T10:14:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.489+0000 7f193b78d700 1 -- start start 2023-10-03T10:14:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.490+0000 7f193b78d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1934132dc0 0x7f19341351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.490+0000 7f193b78d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19341356e0 0x7f1934137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.490+0000 7f193b78d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193409b700 con 0x7f193412cb80 2023-10-03T10:14:52.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.490+0000 7f193b78d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193409c350 con 0x7f1934132dc0 2023-10-03T10:14:52.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.490+0000 7f193b78d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f193409abf0 con 0x7f19341356e0 2023-10-03T10:14:52.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.490+0000 7f1938d28700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1934132dc0 0x7f19341351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.490+0000 7f1938d28700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1934132dc0 0x7f19341351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:54348/0 (socket says 172.21.15.146:54348) 2023-10-03T10:14:52.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.490+0000 7f1938d28700 1 -- 172.21.15.146:0/3205111061 learned_addr learned my addr 172.21.15.146:0/3205111061 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:52.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.490+0000 7f1938d28700 1 -- 172.21.15.146:0/3205111061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19341356e0 msgr2=0x7f1934137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:52.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.490+0000 7f1938d28700 1 --2- 172.21.15.146:0/3205111061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19341356e0 0x7f1934137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.490+0000 7f1938d28700 1 -- 172.21.15.146:0/3205111061 >> v1:172.21.15.146:6789/0 conn(0x7f193412cb80 legacy=0x7f193412cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:52.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.490+0000 7f1938d28700 1 -- 172.21.15.146:0/3205111061 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193412c730 con 0x7f1934132dc0 2023-10-03T10:14:52.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.490+0000 7f1938d28700 1 --2- 172.21.15.146:0/3205111061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1934132dc0 0x7f19341351a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1924009950 tx=0x7f1924009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6219899b6cf6078 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.491+0000 7f192bfff700 1 -- 172.21.15.146:0/3205111061 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1924009ea0 con 0x7f1934132dc0 2023-10-03T10:14:52.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.491+0000 7f192bfff700 1 -- 172.21.15.146:0/3205111061 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1924004230 con 0x7f1934132dc0 2023-10-03T10:14:52.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.491+0000 7f192bfff700 1 -- 172.21.15.146:0/3205111061 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192400b7e0 con 0x7f1934132dc0 2023-10-03T10:14:52.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.492+0000 7f193b78d700 1 -- 172.21.15.146:0/3205111061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1934132dc0 msgr2=0x7f19341351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.492+0000 7f193b78d700 1 --2- 172.21.15.146:0/3205111061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1934132dc0 0x7f19341351a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1924009950 tx=0x7f1924009c60 comp rx=0 tx=0).stop 2023-10-03T10:14:52.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.492+0000 7f193b78d700 1 -- 172.21.15.146:0/3205111061 shutdown_connections 2023-10-03T10:14:52.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.492+0000 7f193b78d700 1 --2- 172.21.15.146:0/3205111061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19341356e0 0x7f1934137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.492+0000 7f193b78d700 1 --2- 172.21.15.146:0/3205111061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1934132dc0 0x7f19341351a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.492+0000 7f193b78d700 1 -- 172.21.15.146:0/3205111061 >> 172.21.15.146:0/3205111061 conn(0x7f19340a2eb0 msgr2=0x7f193409eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.492+0000 7f193b78d700 1 -- 172.21.15.146:0/3205111061 shutdown_connections 2023-10-03T10:14:52.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.492+0000 7f193b78d700 1 -- 172.21.15.146:0/3205111061 wait complete. 2023-10-03T10:14:52.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.493+0000 7f193b78d700 1 Processor -- start 2023-10-03T10:14:52.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.493+0000 7f193b78d700 1 -- start start 2023-10-03T10:14:52.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.493+0000 7f193b78d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f193412cb80 0x7f1934137410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.493+0000 7f193b78d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1934132dc0 0x7f1934137950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.493+0000 7f193b78d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19341356e0 0x7f1934137e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.493+0000 7f193b78d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19341391b0 con 0x7f19341356e0 2023-10-03T10:14:52.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.493+0000 7f193b78d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19341395c0 con 0x7f193412cb80 2023-10-03T10:14:52.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.493+0000 7f193b78d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1934127b70 con 0x7f1934132dc0 2023-10-03T10:14:52.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.493+0000 7f1938d28700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1934132dc0 0x7f1934137950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.493+0000 7f1938d28700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1934132dc0 0x7f1934137950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39226/0 (socket says 172.21.15.146:39226) 2023-10-03T10:14:52.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.493+0000 7f1938d28700 1 -- 172.21.15.146:0/3497247006 learned_addr learned my addr 172.21.15.146:0/3497247006 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:52.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.494+0000 7f1939529700 1 --2- 172.21.15.146:0/3497247006 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f193412cb80 0x7f1934137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.494+0000 7f1938d28700 1 -- 172.21.15.146:0/3497247006 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f193412cb80 msgr2=0x7f1934137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.494+0000 7f1938d28700 1 --2- 172.21.15.146:0/3497247006 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f193412cb80 0x7f1934137410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.494+0000 7f1938d28700 1 -- 172.21.15.146:0/3497247006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19341356e0 msgr2=0x7f1934137e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.494+0000 7f1938d28700 1 --2- 172.21.15.146:0/3497247006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19341356e0 0x7f1934137e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.494+0000 7f1938d28700 1 -- 172.21.15.146:0/3497247006 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1924009550 con 0x7f1934132dc0 2023-10-03T10:14:52.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.494+0000 7f1938d28700 1 --2- 172.21.15.146:0/3497247006 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1934132dc0 0x7f1934137950 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1924000c00 tx=0x7f1924004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.497+0000 7f1929ffb700 1 -- 172.21.15.146:0/3497247006 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19240038a0 con 0x7f1934132dc0 2023-10-03T10:14:52.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.497+0000 7f1929ffb700 1 -- 172.21.15.146:0/3497247006 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1924003a20 con 0x7f1934132dc0 2023-10-03T10:14:52.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.497+0000 7f1929ffb700 1 -- 172.21.15.146:0/3497247006 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1924003dd0 con 0x7f1934132dc0 2023-10-03T10:14:52.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.497+0000 7f193b78d700 1 -- 172.21.15.146:0/3497247006 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1934128880 con 0x7f1934132dc0 2023-10-03T10:14:52.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.497+0000 7f193b78d700 1 -- 172.21.15.146:0/3497247006 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1934138b30 con 0x7f1934132dc0 2023-10-03T10:14:52.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.498+0000 7f19177fe700 1 -- 172.21.15.146:0/3497247006 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19100052e0 con 0x7f1934132dc0 2023-10-03T10:14:52.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.498+0000 7f1929ffb700 1 -- 172.21.15.146:0/3497247006 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1924021070 con 0x7f1934132dc0 2023-10-03T10:14:52.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.498+0000 7f1929ffb700 1 -- 172.21.15.146:0/3497247006 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1924040e30 con 0x7f1934132dc0 2023-10-03T10:14:52.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.507+0000 7f1929ffb700 1 -- 172.21.15.146:0/3497247006 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1924019d90 con 0x7f1934132dc0 2023-10-03T10:14:52.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.528+0000 7fb916735700 1 Processor -- start 2023-10-03T10:14:52.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.528+0000 7fb916735700 1 -- start start 2023-10-03T10:14:52.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.529+0000 7fb916735700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb910133b80 0x7fb910133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.529+0000 7fb916735700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb9100a0ff0 0x7fb91013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.529+0000 7fb916735700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb91009aa00 con 0x7fb910099a60 2023-10-03T10:14:52.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.529+0000 7fb916735700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb91009a080 con 0x7fb910133b80 2023-10-03T10:14:52.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.529+0000 7fb916735700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb910133750 con 0x7fb9100a0ff0 2023-10-03T10:14:52.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.529+0000 7fb90ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb910133b80 0x7fb910133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.529+0000 7fb90f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb910099a60 0x7fb9100a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48856/0 (socket says 172.21.15.146:48856) 2023-10-03T10:14:52.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.529+0000 7fb90f7fe700 1 -- 172.21.15.146:0/1779855188 learned_addr learned my addr 172.21.15.146:0/1779855188 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:52.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.529+0000 7fb914cd2700 1 --2- 172.21.15.146:0/1779855188 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb9100a0ff0 0x7fb91013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.530+0000 7fb914cd2700 1 -- 172.21.15.146:0/1779855188 >> v2:172.21.15.146:3300/0 conn(0x7fb910133b80 msgr2=0x7fb910133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:52.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.530+0000 7fb914cd2700 1 --2- 172.21.15.146:0/1779855188 >> v2:172.21.15.146:3300/0 conn(0x7fb910133b80 0x7fb910133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.530+0000 7fb914cd2700 1 -- 172.21.15.146:0/1779855188 >> v1:172.21.15.146:6789/0 conn(0x7fb910099a60 legacy=0x7fb9100a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.530+0000 7fb914cd2700 1 -- 172.21.15.146:0/1779855188 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91009a760 con 0x7fb9100a0ff0 2023-10-03T10:14:52.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.530+0000 7fb914cd2700 1 --2- 172.21.15.146:0/1779855188 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb9100a0ff0 0x7fb91013b910 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb908009d90 tx=0x7fb90800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e24b92ec960b381f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.530+0000 7fb90effd700 1 -- 172.21.15.146:0/1779855188 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90800e070 con 0x7fb9100a0ff0 2023-10-03T10:14:52.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.530+0000 7fb90effd700 1 -- 172.21.15.146:0/1779855188 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90800bb20 con 0x7fb9100a0ff0 2023-10-03T10:14:52.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.530+0000 7fb90effd700 1 -- 172.21.15.146:0/1779855188 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb908012430 con 0x7fb9100a0ff0 2023-10-03T10:14:52.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.531+0000 7fb916735700 1 -- 172.21.15.146:0/1779855188 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb9100a0ff0 msgr2=0x7fb91013b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.531+0000 7fb916735700 1 --2- 172.21.15.146:0/1779855188 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb9100a0ff0 0x7fb91013b910 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb908009d90 tx=0x7fb90800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:52.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.531+0000 7fb916735700 1 -- 172.21.15.146:0/1779855188 shutdown_connections 2023-10-03T10:14:52.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.531+0000 7fb916735700 1 --2- 172.21.15.146:0/1779855188 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb9100a0ff0 0x7fb91013b910 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.531+0000 7fb916735700 1 --2- 172.21.15.146:0/1779855188 >> v2:172.21.15.146:3300/0 conn(0x7fb910133b80 0x7fb910133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.531+0000 7fb916735700 1 -- 172.21.15.146:0/1779855188 >> 172.21.15.146:0/1779855188 conn(0x7fb9100a2980 msgr2=0x7fb9100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.531+0000 7fb916735700 1 -- 172.21.15.146:0/1779855188 shutdown_connections 2023-10-03T10:14:52.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.531+0000 7fb916735700 1 -- 172.21.15.146:0/1779855188 wait complete. 2023-10-03T10:14:52.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.532+0000 7fb916735700 1 Processor -- start 2023-10-03T10:14:52.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.533+0000 7fb916735700 1 -- start start 2023-10-03T10:14:52.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.533+0000 7fb916735700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb910099a60 0x7fb91011a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.533+0000 7fb916735700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9100a0ff0 0x7fb91011ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.533+0000 7fb916735700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb910133b80 0x7fb91011b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.533+0000 7fb916735700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91011bbb0 con 0x7fb910099a60 2023-10-03T10:14:52.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.533+0000 7fb916735700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91011c330 con 0x7fb9100a0ff0 2023-10-03T10:14:52.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.533+0000 7fb916735700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb91011c950 con 0x7fb910133b80 2023-10-03T10:14:52.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.533+0000 7fb90ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb910099a60 0x7fb91011a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.533+0000 7fb90ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb910099a60 0x7fb91011a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51172/0 (socket says 172.21.15.146:51172) 2023-10-03T10:14:52.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.534+0000 7fb90ffff700 1 -- 172.21.15.146:0/1073750806 learned_addr learned my addr 172.21.15.146:0/1073750806 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:52.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.534+0000 7fb90f7fe700 1 --2- 172.21.15.146:0/1073750806 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9100a0ff0 0x7fb91011ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.534+0000 7fb914cd2700 1 --2- 172.21.15.146:0/1073750806 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb910133b80 0x7fb91011b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.534+0000 7fb90f7fe700 1 -- 172.21.15.146:0/1073750806 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb910133b80 msgr2=0x7fb91011b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.534+0000 7fb90f7fe700 1 --2- 172.21.15.146:0/1073750806 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb910133b80 0x7fb91011b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.534+0000 7fb90f7fe700 1 -- 172.21.15.146:0/1073750806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb910099a60 msgr2=0x7fb91011a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.534+0000 7fb90f7fe700 1 --2- 172.21.15.146:0/1073750806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb910099a60 0x7fb91011a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.534+0000 7fb90f7fe700 1 -- 172.21.15.146:0/1073750806 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb908009a70 con 0x7fb9100a0ff0 2023-10-03T10:14:52.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.534+0000 7fb90f7fe700 1 --2- 172.21.15.146:0/1073750806 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9100a0ff0 0x7fb91011ac60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb90400c560 tx=0x7fb90400c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.534+0000 7fb90cff9700 1 -- 172.21.15.146:0/1073750806 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904005d70 con 0x7fb9100a0ff0 2023-10-03T10:14:52.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.534+0000 7fb90cff9700 1 -- 172.21.15.146:0/1073750806 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90400ce90 con 0x7fb9100a0ff0 2023-10-03T10:14:52.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.534+0000 7fb916735700 1 -- 172.21.15.146:0/1073750806 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb91011df60 con 0x7fb9100a0ff0 2023-10-03T10:14:52.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.534+0000 7fb90cff9700 1 -- 172.21.15.146:0/1073750806 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9040072d0 con 0x7fb9100a0ff0 2023-10-03T10:14:52.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.534+0000 7fb916735700 1 -- 172.21.15.146:0/1073750806 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91009a2c0 con 0x7fb9100a0ff0 2023-10-03T10:14:52.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.535+0000 7fb90cff9700 1 -- 172.21.15.146:0/1073750806 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb904007430 con 0x7fb9100a0ff0 2023-10-03T10:14:52.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.535+0000 7fb90cff9700 1 -- 172.21.15.146:0/1073750806 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb90403e980 con 0x7fb9100a0ff0 2023-10-03T10:14:52.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.536+0000 7fb916735700 1 -- 172.21.15.146:0/1073750806 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91009e9b0 con 0x7fb9100a0ff0 2023-10-03T10:14:52.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.540+0000 7fb90cff9700 1 -- 172.21.15.146:0/1073750806 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb90401b3b0 con 0x7fb9100a0ff0 2023-10-03T10:14:52.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.580+0000 7f4ed5695700 1 Processor -- start 2023-10-03T10:14:52.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.580+0000 7f4ed5695700 1 -- start start 2023-10-03T10:14:52.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.581+0000 7f4ed5695700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ed0133ad0 0x7f4ed0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.581+0000 7f4ed5695700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ed01300a0 0x7f4ed01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.581+0000 7f4ed5695700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed006b2d0 con 0x7f4ed01309f0 2023-10-03T10:14:52.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.581+0000 7f4ed5695700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed0133610 con 0x7f4ed01300a0 2023-10-03T10:14:52.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.581+0000 7f4ed5695700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed009a500 con 0x7f4ed0133ad0 2023-10-03T10:14:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.581+0000 7f4ecf7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4ed01309f0 0x7f4ed013a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48864/0 (socket says 172.21.15.146:48864) 2023-10-03T10:14:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.581+0000 7f4ecf7fe700 1 -- 172.21.15.146:0/1090135133 learned_addr learned my addr 172.21.15.146:0/1090135133 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.581+0000 7f4ece7fc700 1 --2- 172.21.15.146:0/1090135133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ed01300a0 0x7f4ed01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.581+0000 7f4eceffd700 1 --2- 172.21.15.146:0/1090135133 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ed0133ad0 0x7f4ed0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.581+0000 7f4eceffd700 1 -- 172.21.15.146:0/1090135133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ed01300a0 msgr2=0x7f4ed01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.581+0000 7f4eceffd700 1 --2- 172.21.15.146:0/1090135133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ed01300a0 0x7f4ed01304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.581+0000 7f4eceffd700 1 -- 172.21.15.146:0/1090135133 >> v1:172.21.15.146:6789/0 conn(0x7f4ed01309f0 legacy=0x7f4ed013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.581+0000 7f4ecdffb700 1 -- 172.21.15.146:0/1090135133 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3286310954 0 0) 0x7f4ed006b2d0 con 0x7f4ed01309f0 2023-10-03T10:14:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.581+0000 7f4eceffd700 1 -- 172.21.15.146:0/1090135133 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed01338b0 con 0x7f4ed0133ad0 2023-10-03T10:14:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.581+0000 7f4eceffd700 1 --2- 172.21.15.146:0/1090135133 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ed0133ad0 0x7f4ed0133ea0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0009870 tx=0x7f4ec0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=219ff13190a8b299 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.582+0000 7f4ecdffb700 1 -- 172.21.15.146:0/1090135133 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec0011830 con 0x7f4ed0133ad0 2023-10-03T10:14:52.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.582+0000 7f4ecdffb700 1 -- 172.21.15.146:0/1090135133 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec0011990 con 0x7f4ed0133ad0 2023-10-03T10:14:52.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.582+0000 7f4ecdffb700 1 -- 172.21.15.146:0/1090135133 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec0011d20 con 0x7f4ed0133ad0 2023-10-03T10:14:52.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.582+0000 7f4ed5695700 1 -- 172.21.15.146:0/1090135133 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ed0133ad0 msgr2=0x7f4ed0133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.582+0000 7f4ed5695700 1 --2- 172.21.15.146:0/1090135133 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ed0133ad0 0x7f4ed0133ea0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0009870 tx=0x7f4ec0009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:52.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.582+0000 7f4ed5695700 1 -- 172.21.15.146:0/1090135133 shutdown_connections 2023-10-03T10:14:52.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.582+0000 7f4ed5695700 1 --2- 172.21.15.146:0/1090135133 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ed0133ad0 0x7f4ed0133ea0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.582+0000 7f4ed5695700 1 --2- 172.21.15.146:0/1090135133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ed01300a0 0x7f4ed01304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.582+0000 7f4ed5695700 1 -- 172.21.15.146:0/1090135133 >> 172.21.15.146:0/1090135133 conn(0x7f4ed0099c40 msgr2=0x7f4ed00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.582+0000 7f4ed5695700 1 -- 172.21.15.146:0/1090135133 shutdown_connections 2023-10-03T10:14:52.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.582+0000 7f4ed5695700 1 -- 172.21.15.146:0/1090135133 wait complete. 2023-10-03T10:14:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.584+0000 7f4ed5695700 1 Processor -- start 2023-10-03T10:14:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.584+0000 7f4ed5695700 1 -- start start 2023-10-03T10:14:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.585+0000 7f4ed5695700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ed01300a0 0x7f4ed011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.585+0000 7f4ed5695700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ed01309f0 0x7f4ed011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.585+0000 7f4ed5695700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ed0133ad0 0x7f4ed011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.585+0000 7f4ed5695700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed0120950 con 0x7f4ed01309f0 2023-10-03T10:14:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.585+0000 7f4ed5695700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed012d930 con 0x7f4ed0133ad0 2023-10-03T10:14:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.585+0000 7f4ed5695700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed011fd00 con 0x7f4ed01300a0 2023-10-03T10:14:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.585+0000 7f4eceffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ed01300a0 0x7f4ed011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.585+0000 7f4eceffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ed01300a0 0x7f4ed011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39264/0 (socket says 172.21.15.146:39264) 2023-10-03T10:14:52.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.585+0000 7f4eceffd700 1 -- 172.21.15.146:0/3470453747 learned_addr learned my addr 172.21.15.146:0/3470453747 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:52.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.585+0000 7f4ece7fc700 1 --2- 172.21.15.146:0/3470453747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ed01309f0 0x7f4ed011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.585+0000 7f4ecf7fe700 1 --2- 172.21.15.146:0/3470453747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ed0133ad0 0x7f4ed011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.585+0000 7f4ece7fc700 1 -- 172.21.15.146:0/3470453747 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ed01300a0 msgr2=0x7f4ed011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.585+0000 7f4ece7fc700 1 --2- 172.21.15.146:0/3470453747 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ed01300a0 0x7f4ed011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.585+0000 7f4ece7fc700 1 -- 172.21.15.146:0/3470453747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ed0133ad0 msgr2=0x7f4ed011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.585+0000 7f4ece7fc700 1 --2- 172.21.15.146:0/3470453747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ed0133ad0 0x7f4ed011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.585+0000 7f4ece7fc700 1 -- 172.21.15.146:0/3470453747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec00094a0 con 0x7f4ed01309f0 2023-10-03T10:14:52.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.585+0000 7f4eceffd700 1 --2- 172.21.15.146:0/3470453747 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ed01300a0 0x7f4ed011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:52.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.585+0000 7f4ece7fc700 1 --2- 172.21.15.146:0/3470453747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ed01309f0 0x7f4ed011df80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400e840 tx=0x7f4ec400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.586+0000 7f4eb77fe700 1 -- 172.21.15.146:0/3470453747 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4013680 con 0x7f4ed01309f0 2023-10-03T10:14:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.586+0000 7f4eb77fe700 1 -- 172.21.15.146:0/3470453747 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec40137e0 con 0x7f4ed01309f0 2023-10-03T10:14:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.586+0000 7f4ed5695700 1 -- 172.21.15.146:0/3470453747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed011fa40 con 0x7f4ed01309f0 2023-10-03T10:14:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.586+0000 7f4ed5695700 1 -- 172.21.15.146:0/3470453747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed00a33e0 con 0x7f4ed01309f0 2023-10-03T10:14:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.586+0000 7f4eb77fe700 1 -- 172.21.15.146:0/3470453747 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4013b70 con 0x7f4ed01309f0 2023-10-03T10:14:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.587+0000 7f4eb77fe700 1 -- 172.21.15.146:0/3470453747 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ec4013cd0 con 0x7f4ed01309f0 2023-10-03T10:14:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.587+0000 7f4eb77fe700 1 -- 172.21.15.146:0/3470453747 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4ec403f4f0 con 0x7f4ed01309f0 2023-10-03T10:14:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.587+0000 7f4ed5695700 1 -- 172.21.15.146:0/3470453747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb00052e0 con 0x7f4ed01309f0 2023-10-03T10:14:52.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.592+0000 7f4eb77fe700 1 -- 172.21.15.146:0/3470453747 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ec401be10 con 0x7f4ed01309f0 2023-10-03T10:14:52.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.660+0000 7fe09cd74700 1 -- 172.21.15.146:0/676428072 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe09804f2a0 con 0x7fe09809f180 2023-10-03T10:14:52.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.660+0000 7fe086ffd700 1 -- 172.21.15.146:0/676428072 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe08c017030 con 0x7fe09809f180 2023-10-03T10:14:52.660 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:52.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.662+0000 7fe09cd74700 1 -- 172.21.15.146:0/676428072 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe09809f180 msgr2=0x7fe0981230c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.662+0000 7fe09cd74700 1 --2- 172.21.15.146:0/676428072 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe09809f180 0x7fe0981230c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00ebb0 tx=0x7fe08c00ef70 comp rx=0 tx=0).stop 2023-10-03T10:14:52.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.662+0000 7fe09cd74700 1 -- 172.21.15.146:0/676428072 shutdown_connections 2023-10-03T10:14:52.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.662+0000 7fe09cd74700 1 --2- 172.21.15.146:0/676428072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0981341d0 0x7fe098123600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.663+0000 7fe09cd74700 1 --2- 172.21.15.146:0/676428072 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe09809e870 0x7fe098122b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.663+0000 7fe09cd74700 1 --2- 172.21.15.146:0/676428072 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe09809f180 0x7fe0981230c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.663+0000 7fe09cd74700 1 -- 172.21.15.146:0/676428072 >> 172.21.15.146:0/676428072 conn(0x7fe0980a4430 msgr2=0x7fe098071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.663+0000 7fe09cd74700 1 -- 172.21.15.146:0/676428072 shutdown_connections 2023-10-03T10:14:52.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.663+0000 7fe09cd74700 1 -- 172.21.15.146:0/676428072 wait complete. 2023-10-03T10:14:52.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:52.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.707+0000 7f19177fe700 1 -- 172.21.15.146:0/3497247006 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1910005590 con 0x7f1934132dc0 2023-10-03T10:14:52.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.708+0000 7f1929ffb700 1 -- 172.21.15.146:0/3497247006 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1924029030 con 0x7f1934132dc0 2023-10-03T10:14:52.708 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.711+0000 7f19177fe700 1 -- 172.21.15.146:0/3497247006 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1934132dc0 msgr2=0x7f1934137950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.711+0000 7f19177fe700 1 --2- 172.21.15.146:0/3497247006 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1934132dc0 0x7f1934137950 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1924000c00 tx=0x7f1924004750 comp rx=0 tx=0).stop 2023-10-03T10:14:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.711+0000 7f19177fe700 1 -- 172.21.15.146:0/3497247006 shutdown_connections 2023-10-03T10:14:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.711+0000 7f19177fe700 1 --2- 172.21.15.146:0/3497247006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19341356e0 0x7f1934137e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.711+0000 7f19177fe700 1 --2- 172.21.15.146:0/3497247006 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f193412cb80 0x7f1934137410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.711+0000 7f19177fe700 1 --2- 172.21.15.146:0/3497247006 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1934132dc0 0x7f1934137950 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.711+0000 7f19177fe700 1 -- 172.21.15.146:0/3497247006 >> 172.21.15.146:0/3497247006 conn(0x7f19340a2eb0 msgr2=0x7f193409cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.711+0000 7f19177fe700 1 -- 172.21.15.146:0/3497247006 shutdown_connections 2023-10-03T10:14:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.711+0000 7f19177fe700 1 -- 172.21.15.146:0/3497247006 wait complete. 2023-10-03T10:14:52.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:52.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.755+0000 7fb916735700 1 -- 172.21.15.146:0/1073750806 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb91004f2a0 con 0x7fb9100a0ff0 2023-10-03T10:14:52.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.756+0000 7fb90cff9700 1 -- 172.21.15.146:0/1073750806 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb904017020 con 0x7fb9100a0ff0 2023-10-03T10:14:52.755 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:52.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.757+0000 7fb916735700 1 -- 172.21.15.146:0/1073750806 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9100a0ff0 msgr2=0x7fb91011ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.757+0000 7fb916735700 1 --2- 172.21.15.146:0/1073750806 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9100a0ff0 0x7fb91011ac60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb90400c560 tx=0x7fb90400c870 comp rx=0 tx=0).stop 2023-10-03T10:14:52.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.757+0000 7fb916735700 1 -- 172.21.15.146:0/1073750806 shutdown_connections 2023-10-03T10:14:52.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.757+0000 7fb916735700 1 --2- 172.21.15.146:0/1073750806 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb910133b80 0x7fb91011b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.757+0000 7fb916735700 1 --2- 172.21.15.146:0/1073750806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb910099a60 0x7fb91011a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.757+0000 7fb916735700 1 --2- 172.21.15.146:0/1073750806 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9100a0ff0 0x7fb91011ac60 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.758+0000 7fb916735700 1 -- 172.21.15.146:0/1073750806 >> 172.21.15.146:0/1073750806 conn(0x7fb9100a2980 msgr2=0x7fb91012f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.758+0000 7fb916735700 1 -- 172.21.15.146:0/1073750806 shutdown_connections 2023-10-03T10:14:52.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.758+0000 7fb916735700 1 -- 172.21.15.146:0/1073750806 wait complete. 2023-10-03T10:14:52.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:52.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.795+0000 7f4ed5695700 1 -- 172.21.15.146:0/3470453747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4eb0005590 con 0x7f4ed01309f0 2023-10-03T10:14:52.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.795+0000 7f4eb77fe700 1 -- 172.21.15.146:0/3470453747 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4ec4017020 con 0x7f4ed01309f0 2023-10-03T10:14:52.795 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:52.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.798+0000 7f4ed5695700 1 -- 172.21.15.146:0/3470453747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ed01309f0 msgr2=0x7f4ed011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.798+0000 7f4ed5695700 1 --2- 172.21.15.146:0/3470453747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ed01309f0 0x7f4ed011df80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400e840 tx=0x7f4ec400eb50 comp rx=0 tx=0).stop 2023-10-03T10:14:52.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.798+0000 7f4ed5695700 1 -- 172.21.15.146:0/3470453747 shutdown_connections 2023-10-03T10:14:52.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.798+0000 7f4ed5695700 1 --2- 172.21.15.146:0/3470453747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ed0133ad0 0x7f4ed011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.798+0000 7f4ed5695700 1 --2- 172.21.15.146:0/3470453747 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ed01300a0 0x7f4ed011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.798+0000 7f4ed5695700 1 --2- 172.21.15.146:0/3470453747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ed01309f0 0x7f4ed011df80 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.798+0000 7f4ed5695700 1 -- 172.21.15.146:0/3470453747 >> 172.21.15.146:0/3470453747 conn(0x7f4ed0099c40 msgr2=0x7f4ed012e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.798+0000 7f4ed5695700 1 -- 172.21.15.146:0/3470453747 shutdown_connections 2023-10-03T10:14:52.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:52.798+0000 7f4ed5695700 1 -- 172.21.15.146:0/3470453747 wait complete. 2023-10-03T10:14:52.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:53.675 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:53.728 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:53.774 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:53.810 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.816+0000 7f028e9dd700 1 Processor -- start 2023-10-03T10:14:53.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.817+0000 7f028e9dd700 1 -- start start 2023-10-03T10:14:53.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.817+0000 7f028e9dd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0288133ad0 0x7f0288133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.817+0000 7f028e9dd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0288130bc0 0x7f028813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.817+0000 7f028e9dd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f028806b2d0 con 0x7f02881300a0 2023-10-03T10:14:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.817+0000 7f028e9dd700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0288133610 con 0x7f0288130bc0 2023-10-03T10:14:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.817+0000 7f028e9dd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028809a500 con 0x7f0288133ad0 2023-10-03T10:14:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.817+0000 7f0287fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0288133ad0 0x7f0288133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.817+0000 7f028cf7a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0288130bc0 0x7f028813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.817+0000 7f02877fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f02881300a0 0x7f02881304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48878/0 (socket says 172.21.15.146:48878) 2023-10-03T10:14:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.817+0000 7f02877fe700 1 -- 172.21.15.146:0/2669373091 learned_addr learned my addr 172.21.15.146:0/2669373091 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.817+0000 7f0287fff700 1 -- 172.21.15.146:0/2669373091 >> v2:172.21.15.146:3300/0 conn(0x7f0288130bc0 msgr2=0x7f028813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.817+0000 7f0287fff700 1 --2- 172.21.15.146:0/2669373091 >> v2:172.21.15.146:3300/0 conn(0x7f0288130bc0 0x7f028813b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.817+0000 7f0287fff700 1 -- 172.21.15.146:0/2669373091 >> v1:172.21.15.146:6789/0 conn(0x7f02881300a0 legacy=0x7f02881304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.818+0000 7f0287fff700 1 -- 172.21.15.146:0/2669373091 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02881338b0 con 0x7f0288133ad0 2023-10-03T10:14:53.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.818+0000 7f028cf7a700 1 --2- 172.21.15.146:0/2669373091 >> v2:172.21.15.146:3300/0 conn(0x7f0288130bc0 0x7f028813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:53.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.818+0000 7f0287fff700 1 --2- 172.21.15.146:0/2669373091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0288133ad0 0x7f0288133ea0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0278009840 tx=0x7f0278009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dad263d0e9f9ae8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.818+0000 7f0286ffd700 1 -- 172.21.15.146:0/2669373091 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0278011830 con 0x7f0288133ad0 2023-10-03T10:14:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.818+0000 7f0286ffd700 1 -- 172.21.15.146:0/2669373091 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0278011990 con 0x7f0288133ad0 2023-10-03T10:14:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.818+0000 7f0286ffd700 1 -- 172.21.15.146:0/2669373091 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0278011d20 con 0x7f0288133ad0 2023-10-03T10:14:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.819+0000 7f028e9dd700 1 -- 172.21.15.146:0/2669373091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0288133ad0 msgr2=0x7f0288133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.819+0000 7f028e9dd700 1 --2- 172.21.15.146:0/2669373091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0288133ad0 0x7f0288133ea0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0278009840 tx=0x7f0278009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.819+0000 7f028e9dd700 1 -- 172.21.15.146:0/2669373091 shutdown_connections 2023-10-03T10:14:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.819+0000 7f028e9dd700 1 --2- 172.21.15.146:0/2669373091 >> v2:172.21.15.146:3300/0 conn(0x7f0288130bc0 0x7f028813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.819+0000 7f028e9dd700 1 --2- 172.21.15.146:0/2669373091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0288133ad0 0x7f0288133ea0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.819+0000 7f028e9dd700 1 -- 172.21.15.146:0/2669373091 >> 172.21.15.146:0/2669373091 conn(0x7f0288099c40 msgr2=0x7f02880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.819+0000 7f028e9dd700 1 -- 172.21.15.146:0/2669373091 shutdown_connections 2023-10-03T10:14:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.819+0000 7f028e9dd700 1 -- 172.21.15.146:0/2669373091 wait complete. 2023-10-03T10:14:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.820+0000 7f028e9dd700 1 Processor -- start 2023-10-03T10:14:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.820+0000 7f028e9dd700 1 -- start start 2023-10-03T10:14:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.820+0000 7f028e9dd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02881300a0 0x7f02881c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.820+0000 7f028e9dd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0288130bc0 0x7f02881c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.820+0000 7f028e9dd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0288133ad0 0x7f02881c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.820+0000 7f028e9dd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028812d630 con 0x7f0288130bc0 2023-10-03T10:14:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.820+0000 7f028e9dd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028812fbb0 con 0x7f02881300a0 2023-10-03T10:14:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.820+0000 7f028e9dd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0288072400 con 0x7f0288133ad0 2023-10-03T10:14:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.820+0000 7f02877fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0288130bc0 0x7f02881c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.820+0000 7f0287fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02881300a0 0x7f02881c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.820+0000 7f02877fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0288130bc0 0x7f02881c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51206/0 (socket says 172.21.15.146:51206) 2023-10-03T10:14:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.820+0000 7f02877fe700 1 -- 172.21.15.146:0/2259829470 learned_addr learned my addr 172.21.15.146:0/2259829470 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.820+0000 7f028cf7a700 1 --2- 172.21.15.146:0/2259829470 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0288133ad0 0x7f02881c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.821+0000 7f0287fff700 1 -- 172.21.15.146:0/2259829470 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0288133ad0 msgr2=0x7f02881c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.821+0000 7f0287fff700 1 --2- 172.21.15.146:0/2259829470 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0288133ad0 0x7f02881c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.821+0000 7f0287fff700 1 -- 172.21.15.146:0/2259829470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0288130bc0 msgr2=0x7f02881c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.821+0000 7f0287fff700 1 --2- 172.21.15.146:0/2259829470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0288130bc0 0x7f02881c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.821+0000 7f0287fff700 1 -- 172.21.15.146:0/2259829470 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0280009a70 con 0x7f02881300a0 2023-10-03T10:14:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.821+0000 7f0287fff700 1 --2- 172.21.15.146:0/2259829470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02881300a0 0x7f02881c8750 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0278016000 tx=0x7f0278004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.821+0000 7f0284ff9700 1 -- 172.21.15.146:0/2259829470 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02780043c0 con 0x7f02881300a0 2023-10-03T10:14:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.821+0000 7f0284ff9700 1 -- 172.21.15.146:0/2259829470 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027801f070 con 0x7f02881300a0 2023-10-03T10:14:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.821+0000 7f0284ff9700 1 -- 172.21.15.146:0/2259829470 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02780036a0 con 0x7f02881300a0 2023-10-03T10:14:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.821+0000 7f028e9dd700 1 -- 172.21.15.146:0/2259829470 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02780094a0 con 0x7f02881300a0 2023-10-03T10:14:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.821+0000 7f028e9dd700 1 -- 172.21.15.146:0/2259829470 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028811f950 con 0x7f02881300a0 2023-10-03T10:14:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.822+0000 7f0284ff9700 1 -- 172.21.15.146:0/2259829470 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0278021030 con 0x7f02881300a0 2023-10-03T10:14:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.822+0000 7f0284ff9700 1 -- 172.21.15.146:0/2259829470 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0278044270 con 0x7f02881300a0 2023-10-03T10:14:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.822+0000 7f028e9dd700 1 -- 172.21.15.146:0/2259829470 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f028804f2a0 con 0x7f02881300a0 2023-10-03T10:14:53.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.828+0000 7f0284ff9700 1 -- 172.21.15.146:0/2259829470 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0278015030 con 0x7f02881300a0 2023-10-03T10:14:53.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.879+0000 7f0864fb9700 1 Processor -- start 2023-10-03T10:14:53.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.879+0000 7f0864fb9700 1 -- start start 2023-10-03T10:14:53.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.879+0000 7f0864fb9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f086009e870 0x7f086009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.879+0000 7f0864fb9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f086009f180 0x7f0860131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.879+0000 7f0864fb9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0860131d70 0x7f08601321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.879+0000 7f0864fb9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08600a0920 con 0x7f086009e870 2023-10-03T10:14:53.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.879+0000 7f0864fb9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086009c970 con 0x7f0860131d70 2023-10-03T10:14:53.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.879+0000 7f0864fb9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f086009bab0 con 0x7f086009f180 2023-10-03T10:14:53.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.879+0000 7f085ed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0860131d70 0x7f08601321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.880+0000 7f085ed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0860131d70 0x7f08601321f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:54434/0 (socket says 172.21.15.146:54434) 2023-10-03T10:14:53.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.880+0000 7f085ed9d700 1 -- 172.21.15.146:0/1934382478 learned_addr learned my addr 172.21.15.146:0/1934382478 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:53.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.880+0000 7f085e59c700 1 --2- 172.21.15.146:0/1934382478 >> v2:172.21.15.146:3300/0 conn(0x7f086009e870 0x7f086009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.880+0000 7f085ed9d700 1 -- 172.21.15.146:0/1934382478 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f086009f180 msgr2=0x7f0860131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:53.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.880+0000 7f085ed9d700 1 --2- 172.21.15.146:0/1934382478 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f086009f180 0x7f0860131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.880+0000 7f085ed9d700 1 -- 172.21.15.146:0/1934382478 >> v2:172.21.15.146:3300/0 conn(0x7f086009e870 msgr2=0x7f086009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:53.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.880+0000 7f085ed9d700 1 --2- 172.21.15.146:0/1934382478 >> v2:172.21.15.146:3300/0 conn(0x7f086009e870 0x7f086009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.880+0000 7f085ed9d700 1 -- 172.21.15.146:0/1934382478 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086009f9c0 con 0x7f0860131d70 2023-10-03T10:14:53.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.880+0000 7f085ed9d700 1 --2- 172.21.15.146:0/1934382478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0860131d70 0x7f08601321f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0858009e80 tx=0x7f085800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6e0ab5e94a651b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:53.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.880+0000 7f085d59a700 1 -- 172.21.15.146:0/1934382478 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085800bad0 con 0x7f0860131d70 2023-10-03T10:14:53.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.880+0000 7f085d59a700 1 -- 172.21.15.146:0/1934382478 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085800bc30 con 0x7f0860131d70 2023-10-03T10:14:53.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.880+0000 7f085d59a700 1 -- 172.21.15.146:0/1934382478 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08580104d0 con 0x7f0860131d70 2023-10-03T10:14:53.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.881+0000 7f0864fb9700 1 -- 172.21.15.146:0/1934382478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0860131d70 msgr2=0x7f08601321f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.881+0000 7f0864fb9700 1 --2- 172.21.15.146:0/1934382478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0860131d70 0x7f08601321f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0858009e80 tx=0x7f085800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:53.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.881+0000 7f0864fb9700 1 -- 172.21.15.146:0/1934382478 shutdown_connections 2023-10-03T10:14:53.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.881+0000 7f0864fb9700 1 --2- 172.21.15.146:0/1934382478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0860131d70 0x7f08601321f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.881+0000 7f0864fb9700 1 --2- 172.21.15.146:0/1934382478 >> v2:172.21.15.146:3300/0 conn(0x7f086009e870 0x7f086009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.881+0000 7f0864fb9700 1 --2- 172.21.15.146:0/1934382478 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f086009f180 0x7f0860131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.881+0000 7f0864fb9700 1 -- 172.21.15.146:0/1934382478 >> 172.21.15.146:0/1934382478 conn(0x7f08600a4430 msgr2=0x7f08600a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:53.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.881+0000 7f0864fb9700 1 -- 172.21.15.146:0/1934382478 shutdown_connections 2023-10-03T10:14:53.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.881+0000 7f0864fb9700 1 -- 172.21.15.146:0/1934382478 wait complete. 2023-10-03T10:14:53.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.882+0000 7f0864fb9700 1 Processor -- start 2023-10-03T10:14:53.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.883+0000 7f0864fb9700 1 -- start start 2023-10-03T10:14:53.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.883+0000 7f0864fb9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f086009e870 0x7f08601c0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.883+0000 7f0864fb9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f086009f180 0x7f08601c1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.883+0000 7f0864fb9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0860131d70 0x7f08601c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.883+0000 7f0864fb9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0860072540 con 0x7f086009e870 2023-10-03T10:14:53.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.883+0000 7f0864fb9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086011c8e0 con 0x7f0860131d70 2023-10-03T10:14:53.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.883+0000 7f0864fb9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08601c18c0 con 0x7f086009f180 2023-10-03T10:14:53.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.883+0000 7f085dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f086009f180 0x7f08601c1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.883+0000 7f085dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f086009f180 0x7f08601c1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39282/0 (socket says 172.21.15.146:39282) 2023-10-03T10:14:53.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.883+0000 7f085dd9b700 1 -- 172.21.15.146:0/2584575914 learned_addr learned my addr 172.21.15.146:0/2584575914 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:53.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.883+0000 7f085e59c700 1 --2- 172.21.15.146:0/2584575914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f086009e870 0x7f08601c0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.883+0000 7f085ed9d700 1 --2- 172.21.15.146:0/2584575914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0860131d70 0x7f08601c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.884+0000 7f085dd9b700 1 -- 172.21.15.146:0/2584575914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0860131d70 msgr2=0x7f08601c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.884+0000 7f085dd9b700 1 --2- 172.21.15.146:0/2584575914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0860131d70 0x7f08601c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.884+0000 7f085dd9b700 1 -- 172.21.15.146:0/2584575914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f086009e870 msgr2=0x7f08601c0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.884+0000 7f085dd9b700 1 --2- 172.21.15.146:0/2584575914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f086009e870 0x7f08601c0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.884+0000 7f085dd9b700 1 -- 172.21.15.146:0/2584575914 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0858009b30 con 0x7f086009f180 2023-10-03T10:14:53.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.884+0000 7f085dd9b700 1 --2- 172.21.15.146:0/2584575914 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f086009f180 0x7f08601c1380 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f085400b560 tx=0x7f085400b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:53.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.884+0000 7f084effd700 1 -- 172.21.15.146:0/2584575914 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0854011830 con 0x7f086009f180 2023-10-03T10:14:53.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.884+0000 7f084effd700 1 -- 172.21.15.146:0/2584575914 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0854011990 con 0x7f086009f180 2023-10-03T10:14:53.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.884+0000 7f084effd700 1 -- 172.21.15.146:0/2584575914 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0854011d40 con 0x7f086009f180 2023-10-03T10:14:53.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.885+0000 7f0864fb9700 1 -- 172.21.15.146:0/2584575914 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08600a2bb0 con 0x7f086009f180 2023-10-03T10:14:53.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.885+0000 7f0864fb9700 1 -- 172.21.15.146:0/2584575914 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086011a9f0 con 0x7f086009f180 2023-10-03T10:14:53.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.886+0000 7f084effd700 1 -- 172.21.15.146:0/2584575914 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f085401a400 con 0x7f086009f180 2023-10-03T10:14:53.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.886+0000 7f084effd700 1 -- 172.21.15.146:0/2584575914 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f085403f5e0 con 0x7f086009f180 2023-10-03T10:14:53.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.886+0000 7f0864fb9700 1 -- 172.21.15.146:0/2584575914 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086004f2a0 con 0x7f086009f180 2023-10-03T10:14:53.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.890+0000 7f084effd700 1 -- 172.21.15.146:0/2584575914 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0854015080 con 0x7f086009f180 2023-10-03T10:14:53.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.919+0000 7f819c8f8700 1 Processor -- start 2023-10-03T10:14:53.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.919+0000 7f819c8f8700 1 -- start start 2023-10-03T10:14:53.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.919+0000 7f819c8f8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819809f350 0x7f8198136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.919+0000 7f819c8f8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81981371c0 0x7f81981395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.919+0000 7f819c8f8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819809c970 con 0x7f819809e870 2023-10-03T10:14:53.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.919+0000 7f819c8f8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81980a0920 con 0x7f81981371c0 2023-10-03T10:14:53.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.919+0000 7f819c8f8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819809f9c0 con 0x7f819809f350 2023-10-03T10:14:53.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.920+0000 7f8195d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819809f350 0x7f8198136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.920+0000 7f8195d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819809f350 0x7f8198136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:54452/0 (socket says 172.21.15.146:54452) 2023-10-03T10:14:53.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.920+0000 7f8195d9b700 1 -- 172.21.15.146:0/2828428675 learned_addr learned my addr 172.21.15.146:0/2828428675 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:53.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.920+0000 7f8196d9d700 1 --2- 172.21.15.146:0/2828428675 >> v2:172.21.15.146:3300/0 conn(0x7f81981371c0 0x7f81981395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.920+0000 7f8195d9b700 1 -- 172.21.15.146:0/2828428675 >> v2:172.21.15.146:3300/0 conn(0x7f81981371c0 msgr2=0x7f81981395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:53.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.920+0000 7f8195d9b700 1 --2- 172.21.15.146:0/2828428675 >> v2:172.21.15.146:3300/0 conn(0x7f81981371c0 0x7f81981395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.920+0000 7f8195d9b700 1 -- 172.21.15.146:0/2828428675 >> v1:172.21.15.146:6789/0 conn(0x7f819809e870 legacy=0x7f819809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.920+0000 7f8195d9b700 1 -- 172.21.15.146:0/2828428675 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819809bab0 con 0x7f819809f350 2023-10-03T10:14:53.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.920+0000 7f8195d9b700 1 --2- 172.21.15.146:0/2828428675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819809f350 0x7f8198136c80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f818c0098f0 tx=0x7f818c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6de895c3ca1d99a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:53.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.920+0000 7f819559a700 1 -- 172.21.15.146:0/2828428675 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c00b8a0 con 0x7f819809f350 2023-10-03T10:14:53.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.920+0000 7f819559a700 1 -- 172.21.15.146:0/2828428675 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818c00ba00 con 0x7f819809f350 2023-10-03T10:14:53.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.920+0000 7f819559a700 1 -- 172.21.15.146:0/2828428675 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c00bd90 con 0x7f819809f350 2023-10-03T10:14:53.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.921+0000 7f819c8f8700 1 -- 172.21.15.146:0/2828428675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819809f350 msgr2=0x7f8198136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.921+0000 7f819c8f8700 1 --2- 172.21.15.146:0/2828428675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819809f350 0x7f8198136c80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f818c0098f0 tx=0x7f818c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:53.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.922+0000 7f819c8f8700 1 -- 172.21.15.146:0/2828428675 shutdown_connections 2023-10-03T10:14:53.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.922+0000 7f819c8f8700 1 --2- 172.21.15.146:0/2828428675 >> v2:172.21.15.146:3300/0 conn(0x7f81981371c0 0x7f81981395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.922+0000 7f819c8f8700 1 --2- 172.21.15.146:0/2828428675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819809f350 0x7f8198136c80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.922+0000 7f819c8f8700 1 -- 172.21.15.146:0/2828428675 >> 172.21.15.146:0/2828428675 conn(0x7f81980a4430 msgr2=0x7f81980a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:53.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.922+0000 7f819c8f8700 1 -- 172.21.15.146:0/2828428675 shutdown_connections 2023-10-03T10:14:53.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.922+0000 7f819c8f8700 1 -- 172.21.15.146:0/2828428675 wait complete. 2023-10-03T10:14:53.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.923+0000 7f819c8f8700 1 Processor -- start 2023-10-03T10:14:53.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.923+0000 7f819c8f8700 1 -- start start 2023-10-03T10:14:53.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.924+0000 7f819c8f8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f819809e870 0x7f819811f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.924+0000 7f819c8f8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819809f350 0x7f819811fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.924+0000 7f819c8f8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81981371c0 0x7f8198120150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.924+0000 7f819c8f8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819809dba0 con 0x7f819809e870 2023-10-03T10:14:53.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.924+0000 7f819c8f8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8198136d20 con 0x7f819809f350 2023-10-03T10:14:53.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.924+0000 7f819c8f8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81981212b0 con 0x7f81981371c0 2023-10-03T10:14:53.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.924+0000 7f819659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f819809e870 0x7f819811f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.924+0000 7f819659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f819809e870 0x7f819811f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51246/0 (socket says 172.21.15.146:51246) 2023-10-03T10:14:53.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.924+0000 7f819659c700 1 -- 172.21.15.146:0/1717457062 learned_addr learned my addr 172.21.15.146:0/1717457062 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:53.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.924+0000 7f8196d9d700 1 --2- 172.21.15.146:0/1717457062 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81981371c0 0x7f8198120150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.924+0000 7f8195d9b700 1 --2- 172.21.15.146:0/1717457062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819809f350 0x7f819811fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.924+0000 7f819659c700 1 -- 172.21.15.146:0/1717457062 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81981371c0 msgr2=0x7f8198120150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.925+0000 7f819659c700 1 --2- 172.21.15.146:0/1717457062 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81981371c0 0x7f8198120150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.925+0000 7f819659c700 1 -- 172.21.15.146:0/1717457062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819809f350 msgr2=0x7f819811fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.925+0000 7f819659c700 1 --2- 172.21.15.146:0/1717457062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819809f350 0x7f819811fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.925+0000 7f819659c700 1 -- 172.21.15.146:0/1717457062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c009550 con 0x7f819809e870 2023-10-03T10:14:53.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.925+0000 7f8196d9d700 1 --2- 172.21.15.146:0/1717457062 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81981371c0 0x7f8198120150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:53.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.925+0000 7f819659c700 1 --2- 172.21.15.146:0/1717457062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f819809e870 0x7f819811f6d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f818800c4e0 tx=0x7f818800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:53.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.925+0000 7f8186ffd700 1 -- 172.21.15.146:0/1717457062 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81880052d0 con 0x7f819809e870 2023-10-03T10:14:53.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.925+0000 7f8186ffd700 1 -- 172.21.15.146:0/1717457062 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8188005430 con 0x7f819809e870 2023-10-03T10:14:53.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.925+0000 7f819c8f8700 1 -- 172.21.15.146:0/1717457062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81981354f0 con 0x7f819809e870 2023-10-03T10:14:53.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.925+0000 7f8186ffd700 1 -- 172.21.15.146:0/1717457062 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81880038c0 con 0x7f819809e870 2023-10-03T10:14:53.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.925+0000 7f819c8f8700 1 -- 172.21.15.146:0/1717457062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81981238b0 con 0x7f819809e870 2023-10-03T10:14:53.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.926+0000 7f8186ffd700 1 -- 172.21.15.146:0/1717457062 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8188003a20 con 0x7f819809e870 2023-10-03T10:14:53.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.926+0000 7f8186ffd700 1 -- 172.21.15.146:0/1717457062 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f818803eba0 con 0x7f819809e870 2023-10-03T10:14:53.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.926+0000 7f819c8f8700 1 -- 172.21.15.146:0/1717457062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819804f2a0 con 0x7f819809e870 2023-10-03T10:14:53.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.931+0000 7f8186ffd700 1 -- 172.21.15.146:0/1717457062 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8188017080 con 0x7f819809e870 2023-10-03T10:14:53.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.966+0000 7f67995c8700 1 Processor -- start 2023-10-03T10:14:53.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.966+0000 7f67995c8700 1 -- start start 2023-10-03T10:14:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.966+0000 7f67995c8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f679406a770 0x7f67941349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.966+0000 7f67995c8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6794134f00 0x7f679409d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.966+0000 7f67995c8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f679409eca0 con 0x7f679409dea0 2023-10-03T10:14:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.966+0000 7f67995c8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f679409f720 con 0x7f679406a770 2023-10-03T10:14:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.966+0000 7f67995c8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679406b480 con 0x7f6794134f00 2023-10-03T10:14:53.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.966+0000 7f6792ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f679406a770 0x7f67941349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.966+0000 7f67927fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6794134f00 0x7f679409d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.966+0000 7f6792ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f679406a770 0x7f67941349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51256/0 (socket says 172.21.15.146:51256) 2023-10-03T10:14:53.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.966+0000 7f67937fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f679409dea0 0x7f679413ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48896/0 (socket says 172.21.15.146:48896) 2023-10-03T10:14:53.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.966+0000 7f6792ffd700 1 -- 172.21.15.146:0/1056202186 learned_addr learned my addr 172.21.15.146:0/1056202186 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:53.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.967+0000 7f6791ffb700 1 -- 172.21.15.146:0/1056202186 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213981170 0 0) 0x7f679409eca0 con 0x7f679409dea0 2023-10-03T10:14:53.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.967+0000 7f6791ffb700 1 -- 172.21.15.146:0/1056202186 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f677c0035b0 con 0x7f679409dea0 2023-10-03T10:14:53.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.967+0000 7f6792ffd700 1 -- 172.21.15.146:0/1056202186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6794134f00 msgr2=0x7f679409d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:53.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.967+0000 7f6792ffd700 1 --2- 172.21.15.146:0/1056202186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6794134f00 0x7f679409d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.967+0000 7f6792ffd700 1 -- 172.21.15.146:0/1056202186 >> v1:172.21.15.146:6789/0 conn(0x7f679409dea0 legacy=0x7f679413ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.967+0000 7f6792ffd700 1 -- 172.21.15.146:0/1056202186 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67941352d0 con 0x7f679406a770 2023-10-03T10:14:53.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.967+0000 7f67927fc700 1 --2- 172.21.15.146:0/1056202186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6794134f00 0x7f679409d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:53.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.967+0000 7f6792ffd700 1 --2- 172.21.15.146:0/1056202186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f679406a770 0x7f67941349c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f67840098f0 tx=0x7f6784009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3966f71a4836bb57 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:53.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.967+0000 7f6791ffb700 1 -- 172.21.15.146:0/1056202186 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6784011830 con 0x7f679406a770 2023-10-03T10:14:53.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.967+0000 7f6791ffb700 1 -- 172.21.15.146:0/1056202186 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6784011990 con 0x7f679406a770 2023-10-03T10:14:53.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.967+0000 7f6791ffb700 1 -- 172.21.15.146:0/1056202186 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6784011d20 con 0x7f679406a770 2023-10-03T10:14:53.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.968+0000 7f67995c8700 1 -- 172.21.15.146:0/1056202186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f679406a770 msgr2=0x7f67941349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.968+0000 7f67995c8700 1 --2- 172.21.15.146:0/1056202186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f679406a770 0x7f67941349c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f67840098f0 tx=0x7f6784009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:53.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.968+0000 7f67995c8700 1 -- 172.21.15.146:0/1056202186 shutdown_connections 2023-10-03T10:14:53.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.968+0000 7f67995c8700 1 --2- 172.21.15.146:0/1056202186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f679406a770 0x7f67941349c0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.968+0000 7f67995c8700 1 --2- 172.21.15.146:0/1056202186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6794134f00 0x7f679409d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.968+0000 7f67995c8700 1 -- 172.21.15.146:0/1056202186 >> 172.21.15.146:0/1056202186 conn(0x7f6794099c40 msgr2=0x7f67940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:53.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.968+0000 7f67995c8700 1 -- 172.21.15.146:0/1056202186 shutdown_connections 2023-10-03T10:14:53.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.968+0000 7f67995c8700 1 -- 172.21.15.146:0/1056202186 wait complete. 2023-10-03T10:14:53.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.970+0000 7f67995c8700 1 Processor -- start 2023-10-03T10:14:53.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.970+0000 7f67995c8700 1 -- start start 2023-10-03T10:14:53.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.970+0000 7f67995c8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f679406a770 0x7f679411a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.970+0000 7f67995c8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f679409dea0 0x7f679411abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.970+0000 7f67995c8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6794134f00 0x7f679411b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.970+0000 7f67995c8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67940a0460 con 0x7f679406a770 2023-10-03T10:14:53.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.970+0000 7f67995c8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679411c1f0 con 0x7f679409dea0 2023-10-03T10:14:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.970+0000 7f67995c8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f679409f220 con 0x7f6794134f00 2023-10-03T10:14:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.970+0000 7f6792ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f679406a770 0x7f679411a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.970+0000 7f6792ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f679406a770 0x7f679411a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51268/0 (socket says 172.21.15.146:51268) 2023-10-03T10:14:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.970+0000 7f6792ffd700 1 -- 172.21.15.146:0/2743628983 learned_addr learned my addr 172.21.15.146:0/2743628983 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.971+0000 7f67927fc700 1 --2- 172.21.15.146:0/2743628983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f679409dea0 0x7f679411abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.971+0000 7f67937fe700 1 --2- 172.21.15.146:0/2743628983 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6794134f00 0x7f679411b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.971+0000 7f6792ffd700 1 -- 172.21.15.146:0/2743628983 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6794134f00 msgr2=0x7f679411b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.971+0000 7f6792ffd700 1 --2- 172.21.15.146:0/2743628983 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6794134f00 0x7f679411b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.971+0000 7f6792ffd700 1 -- 172.21.15.146:0/2743628983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f679409dea0 msgr2=0x7f679411abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.971+0000 7f6792ffd700 1 --2- 172.21.15.146:0/2743628983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f679409dea0 0x7f679411abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.971+0000 7f6792ffd700 1 -- 172.21.15.146:0/2743628983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67880094a0 con 0x7f679406a770 2023-10-03T10:14:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.971+0000 7f6792ffd700 1 --2- 172.21.15.146:0/2743628983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f679406a770 0x7f679411a680 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6784009c40 tx=0x7f6784004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.971+0000 7f677b7fe700 1 -- 172.21.15.146:0/2743628983 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6784004510 con 0x7f679406a770 2023-10-03T10:14:53.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.971+0000 7f677b7fe700 1 -- 172.21.15.146:0/2743628983 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678401e070 con 0x7f679406a770 2023-10-03T10:14:53.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.971+0000 7f67995c8700 1 -- 172.21.15.146:0/2743628983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6784009550 con 0x7f679406a770 2023-10-03T10:14:53.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.971+0000 7f677b7fe700 1 -- 172.21.15.146:0/2743628983 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67840038e0 con 0x7f679406a770 2023-10-03T10:14:53.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.971+0000 7f67995c8700 1 -- 172.21.15.146:0/2743628983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67941267b0 con 0x7f679406a770 2023-10-03T10:14:53.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.972+0000 7f677b7fe700 1 -- 172.21.15.146:0/2743628983 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6784003a40 con 0x7f679406a770 2023-10-03T10:14:53.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.972+0000 7f677b7fe700 1 -- 172.21.15.146:0/2743628983 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6784020070 con 0x7f679406a770 2023-10-03T10:14:53.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.972+0000 7f67995c8700 1 -- 172.21.15.146:0/2743628983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f679404f2a0 con 0x7f679406a770 2023-10-03T10:14:53.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:53.977+0000 7f677b7fe700 1 -- 172.21.15.146:0/2743628983 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6784015080 con 0x7f679406a770 2023-10-03T10:14:54.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.093+0000 7f028e9dd700 1 -- 172.21.15.146:0/2259829470 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f028806c3b0 con 0x7f02881300a0 2023-10-03T10:14:54.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.094+0000 7f0284ff9700 1 -- 172.21.15.146:0/2259829470 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f02780239c0 con 0x7f02881300a0 2023-10-03T10:14:54.094 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:54.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.097+0000 7f028e9dd700 1 -- 172.21.15.146:0/2259829470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02881300a0 msgr2=0x7f02881c8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.097+0000 7f028e9dd700 1 --2- 172.21.15.146:0/2259829470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02881300a0 0x7f02881c8750 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0278016000 tx=0x7f0278004750 comp rx=0 tx=0).stop 2023-10-03T10:14:54.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.097+0000 7f028e9dd700 1 -- 172.21.15.146:0/2259829470 shutdown_connections 2023-10-03T10:14:54.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.097+0000 7f028e9dd700 1 --2- 172.21.15.146:0/2259829470 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0288133ad0 0x7f02881c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.097+0000 7f028e9dd700 1 --2- 172.21.15.146:0/2259829470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02881300a0 0x7f02881c8750 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.097+0000 7f028e9dd700 1 --2- 172.21.15.146:0/2259829470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0288130bc0 0x7f02881c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.097+0000 7f028e9dd700 1 -- 172.21.15.146:0/2259829470 >> 172.21.15.146:0/2259829470 conn(0x7f0288099c40 msgr2=0x7f028812e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.098+0000 7f028e9dd700 1 -- 172.21.15.146:0/2259829470 shutdown_connections 2023-10-03T10:14:54.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.098+0000 7f028e9dd700 1 -- 172.21.15.146:0/2259829470 wait complete. 2023-10-03T10:14:54.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:54.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.119+0000 7f0864fb9700 1 -- 172.21.15.146:0/2584575914 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f086006b2a0 con 0x7f086009f180 2023-10-03T10:14:54.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.119+0000 7f084effd700 1 -- 172.21.15.146:0/2584575914 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f085400f8d0 con 0x7f086009f180 2023-10-03T10:14:54.119 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:54.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.121+0000 7f0864fb9700 1 -- 172.21.15.146:0/2584575914 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f086009f180 msgr2=0x7f08601c1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.121+0000 7f0864fb9700 1 --2- 172.21.15.146:0/2584575914 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f086009f180 0x7f08601c1380 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f085400b560 tx=0x7f085400b870 comp rx=0 tx=0).stop 2023-10-03T10:14:54.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.121+0000 7f0864fb9700 1 -- 172.21.15.146:0/2584575914 shutdown_connections 2023-10-03T10:14:54.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.121+0000 7f0864fb9700 1 --2- 172.21.15.146:0/2584575914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0860131d70 0x7f08601c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.121+0000 7f0864fb9700 1 --2- 172.21.15.146:0/2584575914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f086009e870 0x7f08601c0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.121+0000 7f0864fb9700 1 --2- 172.21.15.146:0/2584575914 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f086009f180 0x7f08601c1380 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.121+0000 7f0864fb9700 1 -- 172.21.15.146:0/2584575914 >> 172.21.15.146:0/2584575914 conn(0x7f08600a4430 msgr2=0x7f086012dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.121+0000 7f0864fb9700 1 -- 172.21.15.146:0/2584575914 shutdown_connections 2023-10-03T10:14:54.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.121+0000 7f0864fb9700 1 -- 172.21.15.146:0/2584575914 wait complete. 2023-10-03T10:14:54.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:54.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.137+0000 7f819c8f8700 1 -- 172.21.15.146:0/1717457062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8198122d10 con 0x7f819809e870 2023-10-03T10:14:54.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.138+0000 7f8186ffd700 1 -- 172.21.15.146:0/1717457062 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8188018260 con 0x7f819809e870 2023-10-03T10:14:54.138 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:54.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.140+0000 7f819c8f8700 1 -- 172.21.15.146:0/1717457062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f819809e870 msgr2=0x7f819811f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.140+0000 7f819c8f8700 1 --2- 172.21.15.146:0/1717457062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f819809e870 0x7f819811f6d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f818800c4e0 tx=0x7f818800c7f0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.140+0000 7f819c8f8700 1 -- 172.21.15.146:0/1717457062 shutdown_connections 2023-10-03T10:14:54.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.140+0000 7f819c8f8700 1 --2- 172.21.15.146:0/1717457062 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81981371c0 0x7f8198120150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.140+0000 7f819c8f8700 1 --2- 172.21.15.146:0/1717457062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f819809e870 0x7f819811f6d0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.140+0000 7f819c8f8700 1 --2- 172.21.15.146:0/1717457062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f819809f350 0x7f819811fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.140+0000 7f819c8f8700 1 -- 172.21.15.146:0/1717457062 >> 172.21.15.146:0/1717457062 conn(0x7f81980a4430 msgr2=0x7f81980a36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.140+0000 7f819c8f8700 1 -- 172.21.15.146:0/1717457062 shutdown_connections 2023-10-03T10:14:54.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.140+0000 7f819c8f8700 1 -- 172.21.15.146:0/1717457062 wait complete. 2023-10-03T10:14:54.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:54.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.193+0000 7f67995c8700 1 -- 172.21.15.146:0/2743628983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f679406c3b0 con 0x7f679406a770 2023-10-03T10:14:54.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.193+0000 7f677b7fe700 1 -- 172.21.15.146:0/2743628983 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6784010380 con 0x7f679406a770 2023-10-03T10:14:54.193 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:54.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.195+0000 7f67995c8700 1 -- 172.21.15.146:0/2743628983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f679406a770 msgr2=0x7f679411a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.195+0000 7f67995c8700 1 --2- 172.21.15.146:0/2743628983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f679406a770 0x7f679411a680 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6784009c40 tx=0x7f6784004750 comp rx=0 tx=0).stop 2023-10-03T10:14:54.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.195+0000 7f67995c8700 1 -- 172.21.15.146:0/2743628983 shutdown_connections 2023-10-03T10:14:54.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.195+0000 7f67995c8700 1 --2- 172.21.15.146:0/2743628983 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6794134f00 0x7f679411b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.195+0000 7f67995c8700 1 --2- 172.21.15.146:0/2743628983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f679406a770 0x7f679411a680 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.195+0000 7f67995c8700 1 --2- 172.21.15.146:0/2743628983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f679409dea0 0x7f679411abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.195+0000 7f67995c8700 1 -- 172.21.15.146:0/2743628983 >> 172.21.15.146:0/2743628983 conn(0x7f6794099c40 msgr2=0x7f67940a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.195+0000 7f67995c8700 1 -- 172.21.15.146:0/2743628983 shutdown_connections 2023-10-03T10:14:54.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:54.195+0000 7f67995c8700 1 -- 172.21.15.146:0/2743628983 wait complete. 2023-10-03T10:14:54.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:55.111 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:55.135 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:55.156 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:55.209 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:55.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.255+0000 7f7391ac3700 1 Processor -- start 2023-10-03T10:14:55.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.256+0000 7f7391ac3700 1 -- start start 2023-10-03T10:14:55.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.256+0000 7f7391ac3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f738c136960 0x7f738c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.256+0000 7f7391ac3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f738c139280 0x7f738c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.256+0000 7f7391ac3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738c06b2d0 con 0x7f738c133ad0 2023-10-03T10:14:55.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.256+0000 7f7391ac3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738c1345b0 con 0x7f738c139280 2023-10-03T10:14:55.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.256+0000 7f7391ac3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f738c133610 con 0x7f738c136960 2023-10-03T10:14:55.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.256+0000 7f738affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f738c136960 0x7f738c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.256+0000 7f738affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f738c136960 0x7f738c138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59340/0 (socket says 172.21.15.146:59340) 2023-10-03T10:14:55.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.256+0000 7f738affd700 1 -- 172.21.15.146:0/1125811926 learned_addr learned my addr 172.21.15.146:0/1125811926 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:55.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.257+0000 7f738bfff700 1 --2- 172.21.15.146:0/1125811926 >> v2:172.21.15.146:3300/0 conn(0x7f738c139280 0x7f738c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.257+0000 7f738affd700 1 -- 172.21.15.146:0/1125811926 >> v2:172.21.15.146:3300/0 conn(0x7f738c139280 msgr2=0x7f738c13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.257+0000 7f738affd700 1 --2- 172.21.15.146:0/1125811926 >> v2:172.21.15.146:3300/0 conn(0x7f738c139280 0x7f738c13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.257+0000 7f738affd700 1 -- 172.21.15.146:0/1125811926 >> v1:172.21.15.146:6789/0 conn(0x7f738c133ad0 legacy=0x7f738c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.257+0000 7f738affd700 1 -- 172.21.15.146:0/1125811926 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c09a500 con 0x7f738c136960 2023-10-03T10:14:55.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.257+0000 7f738affd700 1 --2- 172.21.15.146:0/1125811926 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f738c136960 0x7f738c138d40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7380009920 tx=0x7f7380009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9999d6509f25cf84 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.257+0000 7f738a7fc700 1 -- 172.21.15.146:0/1125811926 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7380004230 con 0x7f738c136960 2023-10-03T10:14:55.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.257+0000 7f738a7fc700 1 -- 172.21.15.146:0/1125811926 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7380004390 con 0x7f738c136960 2023-10-03T10:14:55.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.257+0000 7f738a7fc700 1 -- 172.21.15.146:0/1125811926 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7380009e70 con 0x7f738c136960 2023-10-03T10:14:55.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.258+0000 7f7391ac3700 1 -- 172.21.15.146:0/1125811926 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f738c136960 msgr2=0x7f738c138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.258+0000 7f7391ac3700 1 --2- 172.21.15.146:0/1125811926 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f738c136960 0x7f738c138d40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7380009920 tx=0x7f7380009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:55.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.258+0000 7f7391ac3700 1 -- 172.21.15.146:0/1125811926 shutdown_connections 2023-10-03T10:14:55.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.258+0000 7f7391ac3700 1 --2- 172.21.15.146:0/1125811926 >> v2:172.21.15.146:3300/0 conn(0x7f738c139280 0x7f738c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.258+0000 7f7391ac3700 1 --2- 172.21.15.146:0/1125811926 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f738c136960 0x7f738c138d40 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.258+0000 7f7391ac3700 1 -- 172.21.15.146:0/1125811926 >> 172.21.15.146:0/1125811926 conn(0x7f738c099c40 msgr2=0x7f738c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.258+0000 7f7391ac3700 1 -- 172.21.15.146:0/1125811926 shutdown_connections 2023-10-03T10:14:55.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.258+0000 7f7391ac3700 1 -- 172.21.15.146:0/1125811926 wait complete. 2023-10-03T10:14:55.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.259+0000 7f7391ac3700 1 Processor -- start 2023-10-03T10:14:55.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.259+0000 7f7391ac3700 1 -- start start 2023-10-03T10:14:55.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.259+0000 7f7391ac3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f738c133ad0 0x7f738c0716f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.259+0000 7f7391ac3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f738c136960 0x7f738c071c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.259+0000 7f7391ac3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f738c139280 0x7f738c1c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.259+0000 7f7391ac3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c09f390 con 0x7f738c136960 2023-10-03T10:14:55.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.259+0000 7f7391ac3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738c070090 con 0x7f738c133ad0 2023-10-03T10:14:55.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.259+0000 7f7391ac3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f738c130ca0 con 0x7f738c139280 2023-10-03T10:14:55.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.260+0000 7f738affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f738c136960 0x7f738c071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.260+0000 7f738affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f738c136960 0x7f738c071c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33976/0 (socket says 172.21.15.146:33976) 2023-10-03T10:14:55.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.260+0000 7f738affd700 1 -- 172.21.15.146:0/1641928119 learned_addr learned my addr 172.21.15.146:0/1641928119 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:55.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.260+0000 7f738b7fe700 1 --2- 172.21.15.146:0/1641928119 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f738c133ad0 0x7f738c0716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.260+0000 7f738bfff700 1 --2- 172.21.15.146:0/1641928119 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f738c139280 0x7f738c1c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.260+0000 7f738bfff700 1 -- 172.21.15.146:0/1641928119 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f738c133ad0 msgr2=0x7f738c0716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.260+0000 7f738bfff700 1 --2- 172.21.15.146:0/1641928119 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f738c133ad0 0x7f738c0716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.260+0000 7f738bfff700 1 -- 172.21.15.146:0/1641928119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f738c136960 msgr2=0x7f738c071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.260+0000 7f738bfff700 1 --2- 172.21.15.146:0/1641928119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f738c136960 0x7f738c071c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.260+0000 7f738bfff700 1 -- 172.21.15.146:0/1641928119 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7380009550 con 0x7f738c139280 2023-10-03T10:14:55.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.260+0000 7f738affd700 1 --2- 172.21.15.146:0/1641928119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f738c136960 0x7f738c071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.260+0000 7f738bfff700 1 --2- 172.21.15.146:0/1641928119 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f738c139280 0x7f738c1c84e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f738c09f6c0 tx=0x7f738400e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.261+0000 7f7373fff700 1 -- 172.21.15.146:0/1641928119 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384018070 con 0x7f738c139280 2023-10-03T10:14:55.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.261+0000 7f7373fff700 1 -- 172.21.15.146:0/1641928119 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7384007e80 con 0x7f738c139280 2023-10-03T10:14:55.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.261+0000 7f7373fff700 1 -- 172.21.15.146:0/1641928119 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738400ed50 con 0x7f738c139280 2023-10-03T10:14:55.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.261+0000 7f7391ac3700 1 -- 172.21.15.146:0/1641928119 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738c072560 con 0x7f738c139280 2023-10-03T10:14:55.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.261+0000 7f7391ac3700 1 -- 172.21.15.146:0/1641928119 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738c070dc0 con 0x7f738c139280 2023-10-03T10:14:55.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.262+0000 7f7391ac3700 1 -- 172.21.15.146:0/1641928119 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738c04f2a0 con 0x7f738c139280 2023-10-03T10:14:55.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.262+0000 7f7373fff700 1 -- 172.21.15.146:0/1641928119 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7384014420 con 0x7f738c139280 2023-10-03T10:14:55.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.262+0000 7f7373fff700 1 -- 172.21.15.146:0/1641928119 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f738403f450 con 0x7f738c139280 2023-10-03T10:14:55.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.271+0000 7f7373fff700 1 -- 172.21.15.146:0/1641928119 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73840146d0 con 0x7f738c139280 2023-10-03T10:14:55.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.294+0000 7f22e7a15700 1 Processor -- start 2023-10-03T10:14:55.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.294+0000 7f22e7a15700 1 -- start start 2023-10-03T10:14:55.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.295+0000 7f22e7a15700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f22e00a0a70 0x7f22e00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.295+0000 7f22e7a15700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22e00a1380 0x7f22e0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.295+0000 7f22e7a15700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22e0133f50 0x7f22e01343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.295+0000 7f22e7a15700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e009e9d0 con 0x7f22e00a0a70 2023-10-03T10:14:55.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.295+0000 7f22e7a15700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e009dc00 con 0x7f22e00a1380 2023-10-03T10:14:55.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.295+0000 7f22e7a15700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22e009dec0 con 0x7f22e0133f50 2023-10-03T10:14:55.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.295+0000 7f22e5fb2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22e0133f50 0x7f22e01343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.295+0000 7f22e4fb0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22e00a1380 0x7f22e0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.295+0000 7f22e5fb2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22e0133f50 0x7f22e01343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59354/0 (socket says 172.21.15.146:59354) 2023-10-03T10:14:55.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.295+0000 7f22e4fb0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22e00a1380 0x7f22e0133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43210/0 (socket says 172.21.15.146:43210) 2023-10-03T10:14:55.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.295+0000 7f22e5fb2700 1 -- 172.21.15.146:0/1587446855 learned_addr learned my addr 172.21.15.146:0/1587446855 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:55.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.295+0000 7f22e57b1700 1 --2- 172.21.15.146:0/1587446855 >> v2:172.21.15.146:3300/0 conn(0x7f22e00a0a70 0x7f22e00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.295+0000 7f22e5fb2700 1 -- 172.21.15.146:0/1587446855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22e00a1380 msgr2=0x7f22e0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.295+0000 7f22e5fb2700 1 --2- 172.21.15.146:0/1587446855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22e00a1380 0x7f22e0133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.295+0000 7f22e5fb2700 1 -- 172.21.15.146:0/1587446855 >> v2:172.21.15.146:3300/0 conn(0x7f22e00a0a70 msgr2=0x7f22e00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.295+0000 7f22e5fb2700 1 --2- 172.21.15.146:0/1587446855 >> v2:172.21.15.146:3300/0 conn(0x7f22e00a0a70 0x7f22e00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.295+0000 7f22e5fb2700 1 -- 172.21.15.146:0/1587446855 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e009e6a0 con 0x7f22e0133f50 2023-10-03T10:14:55.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.295+0000 7f22e4fb0700 1 --2- 172.21.15.146:0/1587446855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22e00a1380 0x7f22e0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.295+0000 7f22e57b1700 1 --2- 172.21.15.146:0/1587446855 >> v2:172.21.15.146:3300/0 conn(0x7f22e00a0a70 0x7f22e00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.295+0000 7f22e5fb2700 1 --2- 172.21.15.146:0/1587446855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22e0133f50 0x7f22e01343b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f22d8009e50 tx=0x7f22d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25d31c44767de366 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.296+0000 7f22d7fff700 1 -- 172.21.15.146:0/1587446855 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d800e070 con 0x7f22e0133f50 2023-10-03T10:14:55.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.296+0000 7f22d7fff700 1 -- 172.21.15.146:0/1587446855 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d800b910 con 0x7f22e0133f50 2023-10-03T10:14:55.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.296+0000 7f22d7fff700 1 -- 172.21.15.146:0/1587446855 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d800bcc0 con 0x7f22e0133f50 2023-10-03T10:14:55.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.296+0000 7f22e7a15700 1 -- 172.21.15.146:0/1587446855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22e0133f50 msgr2=0x7f22e01343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.297+0000 7f22e7a15700 1 --2- 172.21.15.146:0/1587446855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22e0133f50 0x7f22e01343b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f22d8009e50 tx=0x7f22d800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:55.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.297+0000 7f22e7a15700 1 -- 172.21.15.146:0/1587446855 shutdown_connections 2023-10-03T10:14:55.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.297+0000 7f22e7a15700 1 --2- 172.21.15.146:0/1587446855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22e0133f50 0x7f22e01343b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.297+0000 7f22e7a15700 1 --2- 172.21.15.146:0/1587446855 >> v2:172.21.15.146:3300/0 conn(0x7f22e00a0a70 0x7f22e00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.297+0000 7f22e7a15700 1 --2- 172.21.15.146:0/1587446855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22e00a1380 0x7f22e0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.297+0000 7f22e7a15700 1 -- 172.21.15.146:0/1587446855 >> 172.21.15.146:0/1587446855 conn(0x7f22e00a6610 msgr2=0x7f22e00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.297+0000 7f22e7a15700 1 -- 172.21.15.146:0/1587446855 shutdown_connections 2023-10-03T10:14:55.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.297+0000 7f22e7a15700 1 -- 172.21.15.146:0/1587446855 wait complete. 2023-10-03T10:14:55.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.297+0000 7f3e6d245700 1 Processor -- start 2023-10-03T10:14:55.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.297+0000 7f3e6d245700 1 -- start start 2023-10-03T10:14:55.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f22e7a15700 1 Processor -- start 2023-10-03T10:14:55.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f3e6d245700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3e6809d860 0x7f3e6809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f3e6d245700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e6809e170 0x7f3e681307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f3e6d245700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e68130ce0 0x7f3e68131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f3e6d245700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e68131670 con 0x7f3e6809d860 2023-10-03T10:14:55.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f3e6d245700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6809aaa0 con 0x7f3e68130ce0 2023-10-03T10:14:55.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f3e6d245700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6809f870 con 0x7f3e6809e170 2023-10-03T10:14:55.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f3e66d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3e6809d860 0x7f3e6809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f3e66d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3e6809d860 0x7f3e6809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34000/0 (socket says 172.21.15.146:34000) 2023-10-03T10:14:55.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f3e66d9d700 1 -- 172.21.15.146:0/1101320629 learned_addr learned my addr 172.21.15.146:0/1101320629 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:55.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f3e6659c700 1 --2- 172.21.15.146:0/1101320629 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e6809e170 0x7f3e681307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f22e7a15700 1 -- start start 2023-10-03T10:14:55.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f22e7a15700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22e00a0a70 0x7f22e0126100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f22e7a15700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22e00a1380 0x7f22e0126640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f22e7a15700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22e0133f50 0x7f22e0126b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f22e7a15700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e0133a10 con 0x7f22e00a1380 2023-10-03T10:14:55.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f22e7a15700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e00a03e0 con 0x7f22e0133f50 2023-10-03T10:14:55.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f22e7a15700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22e0129420 con 0x7f22e00a0a70 2023-10-03T10:14:55.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f3e66d9d700 1 -- 172.21.15.146:0/1101320629 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e6809e170 msgr2=0x7f3e681307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f3e66d9d700 1 --2- 172.21.15.146:0/1101320629 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e6809e170 0x7f3e681307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f3e66d9d700 1 -- 172.21.15.146:0/1101320629 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e68130ce0 msgr2=0x7f3e68131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f3e66d9d700 1 --2- 172.21.15.146:0/1101320629 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e68130ce0 0x7f3e68131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.298+0000 7f3e66d9d700 1 -- 172.21.15.146:0/1101320629 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6809b360 con 0x7f3e6809d860 2023-10-03T10:14:55.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.299+0000 7f22e4fb0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22e00a1380 0x7f22e0126640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.299+0000 7f3e66d9d700 1 --2- 172.21.15.146:0/1101320629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e6809d860 0x7f3e6809dc30 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3e58009920 tx=0x7f3e58009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5708310e5d89d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.299+0000 7f22e4fb0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22e00a1380 0x7f22e0126640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34014/0 (socket says 172.21.15.146:34014) 2023-10-03T10:14:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.299+0000 7f22e4fb0700 1 -- 172.21.15.146:0/2255995872 learned_addr learned my addr 172.21.15.146:0/2255995872 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.299+0000 7f22e5fb2700 1 --2- 172.21.15.146:0/2255995872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22e0133f50 0x7f22e0126b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.299+0000 7f22e57b1700 1 --2- 172.21.15.146:0/2255995872 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22e00a0a70 0x7f22e0126100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.299+0000 7f22e5fb2700 1 -- 172.21.15.146:0/2255995872 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22e00a0a70 msgr2=0x7f22e0126100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.299+0000 7f22e5fb2700 1 --2- 172.21.15.146:0/2255995872 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22e00a0a70 0x7f22e0126100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.299+0000 7f22e5fb2700 1 -- 172.21.15.146:0/2255995872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22e00a1380 msgr2=0x7f22e0126640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.299+0000 7f22e5fb2700 1 --2- 172.21.15.146:0/2255995872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22e00a1380 0x7f22e0126640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.299+0000 7f22e5fb2700 1 -- 172.21.15.146:0/2255995872 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc0094a0 con 0x7f22e0133f50 2023-10-03T10:14:55.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.299+0000 7f22e5fb2700 1 --2- 172.21.15.146:0/2255995872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22e0133f50 0x7f22e0126b80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f22d8015000 tx=0x7f22d8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.299+0000 7f3e65d9b700 1 -- 172.21.15.146:0/1101320629 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e58010a90 con 0x7f3e6809d860 2023-10-03T10:14:55.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.299+0000 7f3e65d9b700 1 -- 172.21.15.146:0/1101320629 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e58010bf0 con 0x7f3e6809d860 2023-10-03T10:14:55.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.299+0000 7f3e65d9b700 1 -- 172.21.15.146:0/1101320629 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e58018440 con 0x7f3e6809d860 2023-10-03T10:14:55.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.299+0000 7f22d5ffb700 1 -- 172.21.15.146:0/2255995872 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d8004450 con 0x7f22e0133f50 2023-10-03T10:14:55.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.299+0000 7f22d5ffb700 1 -- 172.21.15.146:0/2255995872 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d80045b0 con 0x7f22e0133f50 2023-10-03T10:14:55.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.299+0000 7f22d5ffb700 1 -- 172.21.15.146:0/2255995872 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d8004960 con 0x7f22e0133f50 2023-10-03T10:14:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.300+0000 7f3e6d245700 1 -- 172.21.15.146:0/1101320629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e6809d860 msgr2=0x7f3e6809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.300+0000 7f3e6d245700 1 --2- 172.21.15.146:0/1101320629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e6809d860 0x7f3e6809dc30 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3e58009920 tx=0x7f3e58009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.300+0000 7f3e6d245700 1 -- 172.21.15.146:0/1101320629 shutdown_connections 2023-10-03T10:14:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.300+0000 7f3e6d245700 1 --2- 172.21.15.146:0/1101320629 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e68130ce0 0x7f3e68131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.300+0000 7f3e6d245700 1 --2- 172.21.15.146:0/1101320629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e6809d860 0x7f3e6809dc30 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.300+0000 7f3e6d245700 1 --2- 172.21.15.146:0/1101320629 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e6809e170 0x7f3e681307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.300+0000 7f3e6d245700 1 -- 172.21.15.146:0/1101320629 >> 172.21.15.146:0/1101320629 conn(0x7f3e68099c40 msgr2=0x7f3e680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.300+0000 7f3e6d245700 1 -- 172.21.15.146:0/1101320629 shutdown_connections 2023-10-03T10:14:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.300+0000 7f3e6d245700 1 -- 172.21.15.146:0/1101320629 wait complete. 2023-10-03T10:14:55.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.300+0000 7f22e7a15700 1 -- 172.21.15.146:0/2255995872 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d00094a0 con 0x7f22e0133f50 2023-10-03T10:14:55.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.300+0000 7f22e7a15700 1 -- 172.21.15.146:0/2255995872 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d8009b30 con 0x7f22e0133f50 2023-10-03T10:14:55.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.301+0000 7f3e6d245700 1 Processor -- start 2023-10-03T10:14:55.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.301+0000 7f22d5ffb700 1 -- 172.21.15.146:0/2255995872 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f22d801c410 con 0x7f22e0133f50 2023-10-03T10:14:55.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.301+0000 7f3e6d245700 1 -- start start 2023-10-03T10:14:55.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.301+0000 7f22d5ffb700 1 -- 172.21.15.146:0/2255995872 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f22d80410e0 con 0x7f22e0133f50 2023-10-03T10:14:55.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.303+0000 7f22e7a15700 1 -- 172.21.15.146:0/2255995872 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e004f2a0 con 0x7f22e0133f50 2023-10-03T10:14:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.302+0000 7f3e6d245700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e6809d860 0x7f3e6811cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.302+0000 7f3e6d245700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e6809e170 0x7f3e6811d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.302+0000 7f3e6d245700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e68130ce0 0x7f3e6811da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.302+0000 7f3e6d245700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e681213a0 con 0x7f3e6809e170 2023-10-03T10:14:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.302+0000 7f3e6d245700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e681209e0 con 0x7f3e6809d860 2023-10-03T10:14:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.302+0000 7f3e6d245700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6811fdb0 con 0x7f3e68130ce0 2023-10-03T10:14:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.303+0000 7f3e66d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e6809d860 0x7f3e6811cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.303+0000 7f3e66d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e6809d860 0x7f3e6811cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43236/0 (socket says 172.21.15.146:43236) 2023-10-03T10:14:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.303+0000 7f3e66d9d700 1 -- 172.21.15.146:0/1762566789 learned_addr learned my addr 172.21.15.146:0/1762566789 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.303+0000 7f3e6759e700 1 --2- 172.21.15.146:0/1762566789 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e68130ce0 0x7f3e6811da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.303+0000 7f3e66d9d700 1 -- 172.21.15.146:0/1762566789 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e68130ce0 msgr2=0x7f3e6811da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.303+0000 7f3e66d9d700 1 --2- 172.21.15.146:0/1762566789 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e68130ce0 0x7f3e6811da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.303+0000 7f3e66d9d700 1 -- 172.21.15.146:0/1762566789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e6809e170 msgr2=0x7f3e6811d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.303+0000 7f3e66d9d700 1 --2- 172.21.15.146:0/1762566789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e6809e170 0x7f3e6811d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.303+0000 7f3e66d9d700 1 -- 172.21.15.146:0/1762566789 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e58009550 con 0x7f3e6809d860 2023-10-03T10:14:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.303+0000 7f3e66d9d700 1 --2- 172.21.15.146:0/1762566789 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e6809d860 0x7f3e6811cf80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3e6809b1a0 tx=0x7f3e58004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.307+0000 7f3e4f7fe700 1 -- 172.21.15.146:0/1762566789 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e580038a0 con 0x7f3e6809d860 2023-10-03T10:14:55.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.307+0000 7f3e6d245700 1 -- 172.21.15.146:0/1762566789 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e6809c8b0 con 0x7f3e6809d860 2023-10-03T10:14:55.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.307+0000 7f3e6d245700 1 -- 172.21.15.146:0/1762566789 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e6811f0b0 con 0x7f3e6809d860 2023-10-03T10:14:55.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.308+0000 7f22d5ffb700 1 -- 172.21.15.146:0/2255995872 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f22d802a080 con 0x7f22e0133f50 2023-10-03T10:14:55.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.308+0000 7f3e4f7fe700 1 -- 172.21.15.146:0/1762566789 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e58003a00 con 0x7f3e6809d860 2023-10-03T10:14:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.308+0000 7f3e4f7fe700 1 -- 172.21.15.146:0/1762566789 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e58003d70 con 0x7f3e6809d860 2023-10-03T10:14:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.308+0000 7f3e4f7fe700 1 -- 172.21.15.146:0/1762566789 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e58018890 con 0x7f3e6809d860 2023-10-03T10:14:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.309+0000 7f3e4f7fe700 1 -- 172.21.15.146:0/1762566789 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3e58045740 con 0x7f3e6809d860 2023-10-03T10:14:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.309+0000 7f3e6d245700 1 -- 172.21.15.146:0/1762566789 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e480052e0 con 0x7f3e6809d860 2023-10-03T10:14:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.314+0000 7f3e4f7fe700 1 -- 172.21.15.146:0/1762566789 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e58028020 con 0x7f3e6809d860 2023-10-03T10:14:55.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.356+0000 7fbe11723700 1 Processor -- start 2023-10-03T10:14:55.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.356+0000 7fbe11723700 1 -- start start 2023-10-03T10:14:55.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.356+0000 7fbe11723700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe0c0a0a70 0x7fbe0c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.356+0000 7fbe11723700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe0c0a1380 0x7fbe0c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.357+0000 7fbe11723700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbe0c133f50 0x7fbe0c1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.357+0000 7fbe11723700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0c09e9d0 con 0x7fbe0c133f50 2023-10-03T10:14:55.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.357+0000 7fbe11723700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c09dc00 con 0x7fbe0c0a0a70 2023-10-03T10:14:55.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.357+0000 7fbe11723700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c09dec0 con 0x7fbe0c0a1380 2023-10-03T10:14:55.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.357+0000 7fbe0b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbe0c133f50 0x7fbe0c1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.357+0000 7fbe0b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbe0c133f50 0x7fbe0c1343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34036/0 (socket says 172.21.15.146:34036) 2023-10-03T10:14:55.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.357+0000 7fbe0b7fe700 1 -- 172.21.15.146:0/3338682488 learned_addr learned my addr 172.21.15.146:0/3338682488 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:55.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.357+0000 7fbe0a7fc700 1 --2- 172.21.15.146:0/3338682488 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe0c0a1380 0x7fbe0c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.357+0000 7fbe0affd700 1 --2- 172.21.15.146:0/3338682488 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe0c0a0a70 0x7fbe0c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.357+0000 7fbe0b7fe700 1 -- 172.21.15.146:0/3338682488 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe0c0a1380 msgr2=0x7fbe0c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.357+0000 7fbe0b7fe700 1 --2- 172.21.15.146:0/3338682488 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe0c0a1380 0x7fbe0c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.357+0000 7fbe0b7fe700 1 -- 172.21.15.146:0/3338682488 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe0c0a0a70 msgr2=0x7fbe0c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.357+0000 7fbe0b7fe700 1 --2- 172.21.15.146:0/3338682488 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe0c0a0a70 0x7fbe0c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.357+0000 7fbe0b7fe700 1 -- 172.21.15.146:0/3338682488 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c09e6a0 con 0x7fbe0c133f50 2023-10-03T10:14:55.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.357+0000 7fbe0a7fc700 1 --2- 172.21.15.146:0/3338682488 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe0c0a1380 0x7fbe0c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.357+0000 7fbe0b7fe700 1 --2- 172.21.15.146:0/3338682488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0c133f50 0x7fbe0c1343f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009e50 tx=0x7fbe0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ae5f4d6132908 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.357+0000 7fbe09ffb700 1 -- 172.21.15.146:0/3338682488 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0400e070 con 0x7fbe0c133f50 2023-10-03T10:14:55.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.358+0000 7fbe09ffb700 1 -- 172.21.15.146:0/3338682488 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0400b910 con 0x7fbe0c133f50 2023-10-03T10:14:55.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.358+0000 7fbe09ffb700 1 -- 172.21.15.146:0/3338682488 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0400bcc0 con 0x7fbe0c133f50 2023-10-03T10:14:55.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.358+0000 7fbe11723700 1 -- 172.21.15.146:0/3338682488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0c133f50 msgr2=0x7fbe0c1343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.358+0000 7fbe11723700 1 --2- 172.21.15.146:0/3338682488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0c133f50 0x7fbe0c1343f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009e50 tx=0x7fbe0400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:55.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.358+0000 7fbe11723700 1 -- 172.21.15.146:0/3338682488 shutdown_connections 2023-10-03T10:14:55.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.358+0000 7fbe11723700 1 --2- 172.21.15.146:0/3338682488 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe0c0a0a70 0x7fbe0c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.358+0000 7fbe11723700 1 --2- 172.21.15.146:0/3338682488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0c133f50 0x7fbe0c1343f0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.358+0000 7fbe11723700 1 --2- 172.21.15.146:0/3338682488 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe0c0a1380 0x7fbe0c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.358+0000 7fbe11723700 1 -- 172.21.15.146:0/3338682488 >> 172.21.15.146:0/3338682488 conn(0x7fbe0c0a6610 msgr2=0x7fbe0c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.358+0000 7fbe11723700 1 -- 172.21.15.146:0/3338682488 shutdown_connections 2023-10-03T10:14:55.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.358+0000 7fbe11723700 1 -- 172.21.15.146:0/3338682488 wait complete. 2023-10-03T10:14:55.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.359+0000 7fbe11723700 1 Processor -- start 2023-10-03T10:14:55.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.359+0000 7fbe11723700 1 -- start start 2023-10-03T10:14:55.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.360+0000 7fbe11723700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe0c0a0a70 0x7fbe0c11f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.360+0000 7fbe11723700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe0c0a1380 0x7fbe0c11fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.360+0000 7fbe11723700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0c133f50 0x7fbe0c1c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.360+0000 7fbe11723700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c122710 con 0x7fbe0c133f50 2023-10-03T10:14:55.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.360+0000 7fbe11723700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c11f3e0 con 0x7fbe0c0a1380 2023-10-03T10:14:55.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.360+0000 7fbe11723700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c120ae0 con 0x7fbe0c0a0a70 2023-10-03T10:14:55.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.360+0000 7fbe0a7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe0c0a1380 0x7fbe0c11fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.360+0000 7fbe0a7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe0c0a1380 0x7fbe0c11fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43258/0 (socket says 172.21.15.146:43258) 2023-10-03T10:14:55.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.360+0000 7fbe0b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0c133f50 0x7fbe0c1c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.360+0000 7fbe0a7fc700 1 -- 172.21.15.146:0/63853008 learned_addr learned my addr 172.21.15.146:0/63853008 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:55.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.360+0000 7fbe0affd700 1 --2- 172.21.15.146:0/63853008 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe0c0a0a70 0x7fbe0c11f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.360+0000 7fbe0b7fe700 1 -- 172.21.15.146:0/63853008 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe0c0a0a70 msgr2=0x7fbe0c11f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.360+0000 7fbe0b7fe700 1 --2- 172.21.15.146:0/63853008 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe0c0a0a70 0x7fbe0c11f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.360+0000 7fbe0b7fe700 1 -- 172.21.15.146:0/63853008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe0c0a1380 msgr2=0x7fbe0c11fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.360+0000 7fbe0b7fe700 1 --2- 172.21.15.146:0/63853008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe0c0a1380 0x7fbe0c11fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.360+0000 7fbe0b7fe700 1 -- 172.21.15.146:0/63853008 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe000094a0 con 0x7fbe0c133f50 2023-10-03T10:14:55.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.360+0000 7fbe0b7fe700 1 --2- 172.21.15.146:0/63853008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0c133f50 0x7fbe0c1c8430 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c09e5c0 tx=0x7fbe04004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.361+0000 7fbdf37fe700 1 -- 172.21.15.146:0/63853008 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe04004450 con 0x7fbe0c133f50 2023-10-03T10:14:55.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.361+0000 7fbdf37fe700 1 -- 172.21.15.146:0/63853008 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe040045b0 con 0x7fbe0c133f50 2023-10-03T10:14:55.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.361+0000 7fbe11723700 1 -- 172.21.15.146:0/63853008 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe04009b30 con 0x7fbe0c133f50 2023-10-03T10:14:55.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.361+0000 7fbdf37fe700 1 -- 172.21.15.146:0/63853008 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe04004960 con 0x7fbe0c133f50 2023-10-03T10:14:55.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.361+0000 7fbe11723700 1 -- 172.21.15.146:0/63853008 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0c1200e0 con 0x7fbe0c133f50 2023-10-03T10:14:55.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.362+0000 7fbdf17fa700 1 -- 172.21.15.146:0/63853008 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde40052e0 con 0x7fbe0c133f50 2023-10-03T10:14:55.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.362+0000 7fbdf37fe700 1 -- 172.21.15.146:0/63853008 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe04025460 con 0x7fbe0c133f50 2023-10-03T10:14:55.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.363+0000 7fbdf37fe700 1 -- 172.21.15.146:0/63853008 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbe040417e0 con 0x7fbe0c133f50 2023-10-03T10:14:55.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.367+0000 7fbdf37fe700 1 -- 172.21.15.146:0/63853008 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe0402d780 con 0x7fbe0c133f50 2023-10-03T10:14:55.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.482+0000 7f7391ac3700 1 -- 172.21.15.146:0/1641928119 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f738c09f0f0 con 0x7f738c139280 2023-10-03T10:14:55.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.482+0000 7f7373fff700 1 -- 172.21.15.146:0/1641928119 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f73840122e0 con 0x7f738c139280 2023-10-03T10:14:55.482 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:55.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.484+0000 7f7391ac3700 1 -- 172.21.15.146:0/1641928119 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f738c139280 msgr2=0x7f738c1c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.484+0000 7f7391ac3700 1 --2- 172.21.15.146:0/1641928119 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f738c139280 0x7f738c1c84e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f738c09f6c0 tx=0x7f738400e3c0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.484+0000 7f7391ac3700 1 -- 172.21.15.146:0/1641928119 shutdown_connections 2023-10-03T10:14:55.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.484+0000 7f7391ac3700 1 --2- 172.21.15.146:0/1641928119 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f738c139280 0x7f738c1c84e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.484+0000 7f7391ac3700 1 --2- 172.21.15.146:0/1641928119 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f738c133ad0 0x7f738c0716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.484+0000 7f7391ac3700 1 --2- 172.21.15.146:0/1641928119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f738c136960 0x7f738c071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.484+0000 7f7391ac3700 1 -- 172.21.15.146:0/1641928119 >> 172.21.15.146:0/1641928119 conn(0x7f738c099c40 msgr2=0x7f738c134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.484+0000 7f7391ac3700 1 -- 172.21.15.146:0/1641928119 shutdown_connections 2023-10-03T10:14:55.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.484+0000 7f7391ac3700 1 -- 172.21.15.146:0/1641928119 wait complete. 2023-10-03T10:14:55.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:55.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.558+0000 7f22e7a15700 1 -- 172.21.15.146:0/2255995872 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f22e01295e0 con 0x7f22e0133f50 2023-10-03T10:14:55.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.558+0000 7f22d5ffb700 1 -- 172.21.15.146:0/2255995872 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f22d801c6c0 con 0x7f22e0133f50 2023-10-03T10:14:55.558 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:55.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.561+0000 7f22e7a15700 1 -- 172.21.15.146:0/2255995872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22e0133f50 msgr2=0x7f22e0126b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.561+0000 7f22e7a15700 1 --2- 172.21.15.146:0/2255995872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22e0133f50 0x7f22e0126b80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f22d8015000 tx=0x7f22d8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.561+0000 7f22e7a15700 1 -- 172.21.15.146:0/2255995872 shutdown_connections 2023-10-03T10:14:55.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.561+0000 7f22e7a15700 1 --2- 172.21.15.146:0/2255995872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22e0133f50 0x7f22e0126b80 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.561+0000 7f22e7a15700 1 --2- 172.21.15.146:0/2255995872 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f22e00a0a70 0x7f22e0126100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.561+0000 7f22e7a15700 1 --2- 172.21.15.146:0/2255995872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22e00a1380 0x7f22e0126640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.561+0000 7f22e7a15700 1 -- 172.21.15.146:0/2255995872 >> 172.21.15.146:0/2255995872 conn(0x7f22e00a6610 msgr2=0x7f22e009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.561+0000 7f22e7a15700 1 -- 172.21.15.146:0/2255995872 shutdown_connections 2023-10-03T10:14:55.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.561+0000 7f22e7a15700 1 -- 172.21.15.146:0/2255995872 wait complete. 2023-10-03T10:14:55.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.563+0000 7f3e6d245700 1 -- 172.21.15.146:0/1762566789 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3e48005590 con 0x7f3e6809d860 2023-10-03T10:14:55.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.564+0000 7fbdf17fa700 1 -- 172.21.15.146:0/63853008 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbde4005860 con 0x7fbe0c133f50 2023-10-03T10:14:55.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.564+0000 7f3e4f7fe700 1 -- 172.21.15.146:0/1762566789 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3e58021970 con 0x7f3e6809d860 2023-10-03T10:14:55.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.564+0000 7fbdf37fe700 1 -- 172.21.15.146:0/63853008 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbe0402d390 con 0x7fbe0c133f50 2023-10-03T10:14:55.564 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:55.564 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:55.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.567+0000 7fbdf17fa700 1 -- 172.21.15.146:0/63853008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0c133f50 msgr2=0x7fbe0c1c8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.567+0000 7fbdf17fa700 1 --2- 172.21.15.146:0/63853008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0c133f50 0x7fbe0c1c8430 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c09e5c0 tx=0x7fbe04004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.567+0000 7f3e6d245700 1 -- 172.21.15.146:0/1762566789 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e6809d860 msgr2=0x7f3e6811cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.567+0000 7f3e6d245700 1 --2- 172.21.15.146:0/1762566789 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e6809d860 0x7f3e6811cf80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3e6809b1a0 tx=0x7f3e58004750 comp rx=0 tx=0).stop 2023-10-03T10:14:55.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.567+0000 7fbdf17fa700 1 -- 172.21.15.146:0/63853008 shutdown_connections 2023-10-03T10:14:55.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.567+0000 7fbdf17fa700 1 --2- 172.21.15.146:0/63853008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0c133f50 0x7fbe0c1c8430 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.567+0000 7fbdf17fa700 1 --2- 172.21.15.146:0/63853008 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe0c0a0a70 0x7fbe0c11f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.567+0000 7fbdf17fa700 1 --2- 172.21.15.146:0/63853008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe0c0a1380 0x7fbe0c11fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.567+0000 7fbdf17fa700 1 -- 172.21.15.146:0/63853008 >> 172.21.15.146:0/63853008 conn(0x7fbe0c0a6610 msgr2=0x7fbe0c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.567+0000 7f3e6d245700 1 -- 172.21.15.146:0/1762566789 shutdown_connections 2023-10-03T10:14:55.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.567+0000 7f3e6d245700 1 --2- 172.21.15.146:0/1762566789 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e68130ce0 0x7f3e6811da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.567+0000 7f3e6d245700 1 --2- 172.21.15.146:0/1762566789 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e6809d860 0x7f3e6811cf80 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.567+0000 7f3e6d245700 1 --2- 172.21.15.146:0/1762566789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e6809e170 0x7f3e6811d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.567+0000 7f3e6d245700 1 -- 172.21.15.146:0/1762566789 >> 172.21.15.146:0/1762566789 conn(0x7f3e68099c40 msgr2=0x7f3e6812ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.567+0000 7f3e6d245700 1 -- 172.21.15.146:0/1762566789 shutdown_connections 2023-10-03T10:14:55.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.567+0000 7f3e6d245700 1 -- 172.21.15.146:0/1762566789 wait complete. 2023-10-03T10:14:55.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.567+0000 7fbdf17fa700 1 -- 172.21.15.146:0/63853008 shutdown_connections 2023-10-03T10:14:55.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:55.567+0000 7fbdf17fa700 1 -- 172.21.15.146:0/63853008 wait complete. 2023-10-03T10:14:55.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:55.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:55.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:56.498 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:56.575 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:56.585 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:56.585 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:56.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.630+0000 7f633ccd4700 1 Processor -- start 2023-10-03T10:14:56.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.630+0000 7f633ccd4700 1 -- start start 2023-10-03T10:14:56.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.630+0000 7f633ccd4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f63381368e0 0x7f6338138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.631+0000 7f633ccd4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6338139200 0x7f633813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.631+0000 7f633ccd4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633809a760 con 0x7f6338133900 2023-10-03T10:14:56.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.631+0000 7f633ccd4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63381336e0 con 0x7f6338139200 2023-10-03T10:14:56.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.631+0000 7f633ccd4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f633809a080 con 0x7f63381368e0 2023-10-03T10:14:56.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.631+0000 7f6335d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f63381368e0 0x7f6338138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.631+0000 7f6335d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f63381368e0 0x7f6338138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59422/0 (socket says 172.21.15.146:59422) 2023-10-03T10:14:56.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.631+0000 7f6335d9b700 1 -- 172.21.15.146:0/2939393450 learned_addr learned my addr 172.21.15.146:0/2939393450 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:56.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.631+0000 7f6335d9b700 1 -- 172.21.15.146:0/2939393450 >> v2:172.21.15.146:3300/0 conn(0x7f6338139200 msgr2=0x7f633813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:56.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.631+0000 7f6335d9b700 1 --2- 172.21.15.146:0/2939393450 >> v2:172.21.15.146:3300/0 conn(0x7f6338139200 0x7f633813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.631+0000 7f6335d9b700 1 -- 172.21.15.146:0/2939393450 >> v1:172.21.15.146:6789/0 conn(0x7f6338133900 legacy=0x7f6338133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:56.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.631+0000 7f6335d9b700 1 -- 172.21.15.146:0/2939393450 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63380a23e0 con 0x7f63381368e0 2023-10-03T10:14:56.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.631+0000 7f6335d9b700 1 --2- 172.21.15.146:0/2939393450 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f63381368e0 0x7f6338138cc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f632c0098f0 tx=0x7f632c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69dea0d706aa37fd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.632+0000 7f633559a700 1 -- 172.21.15.146:0/2939393450 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c004230 con 0x7f63381368e0 2023-10-03T10:14:56.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.632+0000 7f633559a700 1 -- 172.21.15.146:0/2939393450 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c004390 con 0x7f63381368e0 2023-10-03T10:14:56.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.632+0000 7f633559a700 1 -- 172.21.15.146:0/2939393450 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c0036a0 con 0x7f63381368e0 2023-10-03T10:14:56.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.632+0000 7f633ccd4700 1 -- 172.21.15.146:0/2939393450 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f63381368e0 msgr2=0x7f6338138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.632+0000 7f633ccd4700 1 --2- 172.21.15.146:0/2939393450 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f63381368e0 0x7f6338138cc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f632c0098f0 tx=0x7f632c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:56.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.633+0000 7f633ccd4700 1 -- 172.21.15.146:0/2939393450 shutdown_connections 2023-10-03T10:14:56.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.633+0000 7f633ccd4700 1 --2- 172.21.15.146:0/2939393450 >> v2:172.21.15.146:3300/0 conn(0x7f6338139200 0x7f633813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.633+0000 7f633ccd4700 1 --2- 172.21.15.146:0/2939393450 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f63381368e0 0x7f6338138cc0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.633+0000 7f633ccd4700 1 -- 172.21.15.146:0/2939393450 >> 172.21.15.146:0/2939393450 conn(0x7f63380a2980 msgr2=0x7f63380a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.633+0000 7f633ccd4700 1 -- 172.21.15.146:0/2939393450 shutdown_connections 2023-10-03T10:14:56.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.633+0000 7f633ccd4700 1 -- 172.21.15.146:0/2939393450 wait complete. 2023-10-03T10:14:56.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.634+0000 7f633ccd4700 1 Processor -- start 2023-10-03T10:14:56.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.634+0000 7f633ccd4700 1 -- start start 2023-10-03T10:14:56.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.634+0000 7f633ccd4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6338133900 0x7f6338119e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.634+0000 7f633ccd4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63381368e0 0x7f633811a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.634+0000 7f633ccd4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6338139200 0x7f633811a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.634+0000 7f633ccd4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63381358e0 con 0x7f63381368e0 2023-10-03T10:14:56.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.634+0000 7f633ccd4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633811bba0 con 0x7f6338133900 2023-10-03T10:14:56.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.634+0000 7f633ccd4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f633811d400 con 0x7f6338139200 2023-10-03T10:14:56.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.634+0000 7f633659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6338133900 0x7f6338119e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.634+0000 7f633659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6338133900 0x7f6338119e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43262/0 (socket says 172.21.15.146:43262) 2023-10-03T10:14:56.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.634+0000 7f633659c700 1 -- 172.21.15.146:0/1097665777 learned_addr learned my addr 172.21.15.146:0/1097665777 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:56.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.635+0000 7f6336d9d700 1 --2- 172.21.15.146:0/1097665777 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6338139200 0x7f633811a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.635+0000 7f633659c700 1 -- 172.21.15.146:0/1097665777 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6338139200 msgr2=0x7f633811a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.635+0000 7f633659c700 1 --2- 172.21.15.146:0/1097665777 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6338139200 0x7f633811a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.635+0000 7f633659c700 1 -- 172.21.15.146:0/1097665777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63381368e0 msgr2=0x7f633811a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.635+0000 7f633659c700 1 --2- 172.21.15.146:0/1097665777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63381368e0 0x7f633811a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.635+0000 7f633659c700 1 -- 172.21.15.146:0/1097665777 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c009550 con 0x7f6338133900 2023-10-03T10:14:56.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.635+0000 7f633659c700 1 --2- 172.21.15.146:0/1097665777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6338133900 0x7f6338119e80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f632800c520 tx=0x7f632800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.635+0000 7f6326ffd700 1 -- 172.21.15.146:0/1097665777 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63280054e0 con 0x7f6338133900 2023-10-03T10:14:56.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.635+0000 7f6326ffd700 1 -- 172.21.15.146:0/1097665777 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6328003680 con 0x7f6338133900 2023-10-03T10:14:56.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.635+0000 7f633ccd4700 1 -- 172.21.15.146:0/1097665777 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633811d6c0 con 0x7f6338133900 2023-10-03T10:14:56.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.635+0000 7f6326ffd700 1 -- 172.21.15.146:0/1097665777 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6328003a30 con 0x7f6338133900 2023-10-03T10:14:56.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.635+0000 7f633ccd4700 1 -- 172.21.15.146:0/1097665777 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633811bfe0 con 0x7f6338133900 2023-10-03T10:14:56.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.636+0000 7f633ccd4700 1 -- 172.21.15.146:0/1097665777 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633804f2a0 con 0x7f6338133900 2023-10-03T10:14:56.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.636+0000 7f6326ffd700 1 -- 172.21.15.146:0/1097665777 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6328003b90 con 0x7f6338133900 2023-10-03T10:14:56.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.636+0000 7f6326ffd700 1 -- 172.21.15.146:0/1097665777 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f632803eb50 con 0x7f6338133900 2023-10-03T10:14:56.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.641+0000 7f6326ffd700 1 -- 172.21.15.146:0/1097665777 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6328003e40 con 0x7f6338133900 2023-10-03T10:14:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.718+0000 7f253e4b6700 1 Processor -- start 2023-10-03T10:14:56.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.718+0000 7f253e4b6700 1 -- start start 2023-10-03T10:14:56.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.719+0000 7f253e4b6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2538133ad0 0x7f2538133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.719+0000 7f253e4b6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25381300a0 0x7f25381304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.719+0000 7f253e4b6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253806b2d0 con 0x7f25381309f0 2023-10-03T10:14:56.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.719+0000 7f253e4b6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2538133610 con 0x7f25381300a0 2023-10-03T10:14:56.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.719+0000 7f253e4b6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f253809a500 con 0x7f2538133ad0 2023-10-03T10:14:56.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.719+0000 7f25377fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25381300a0 0x7f25381304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.719+0000 7f25377fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25381300a0 0x7f25381304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43272/0 (socket says 172.21.15.146:43272) 2023-10-03T10:14:56.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.719+0000 7f25377fe700 1 -- 172.21.15.146:0/1779666078 learned_addr learned my addr 172.21.15.146:0/1779666078 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:56.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.719+0000 7f25377fe700 1 -- 172.21.15.146:0/1779666078 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2538133ad0 msgr2=0x7f2538133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:56.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.719+0000 7f25377fe700 1 --2- 172.21.15.146:0/1779666078 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2538133ad0 0x7f2538133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.719+0000 7f25377fe700 1 -- 172.21.15.146:0/1779666078 >> v1:172.21.15.146:6789/0 conn(0x7f25381309f0 legacy=0x7f253813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.719+0000 7f25377fe700 1 -- 172.21.15.146:0/1779666078 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25381338b0 con 0x7f25381300a0 2023-10-03T10:14:56.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.720+0000 7f25377fe700 1 --2- 172.21.15.146:0/1779666078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25381300a0 0x7f25381304b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f252c009920 tx=0x7f252c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b358b61c3cdcde4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.720+0000 7f2536ffd700 1 -- 172.21.15.146:0/1779666078 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c00ba60 con 0x7f25381300a0 2023-10-03T10:14:56.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.720+0000 7f2536ffd700 1 -- 172.21.15.146:0/1779666078 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c00bbc0 con 0x7f25381300a0 2023-10-03T10:14:56.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.720+0000 7f2536ffd700 1 -- 172.21.15.146:0/1779666078 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c009e70 con 0x7f25381300a0 2023-10-03T10:14:56.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.721+0000 7f253e4b6700 1 -- 172.21.15.146:0/1779666078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25381300a0 msgr2=0x7f25381304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.721+0000 7f253e4b6700 1 --2- 172.21.15.146:0/1779666078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25381300a0 0x7f25381304b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f252c009920 tx=0x7f252c009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:56.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.721+0000 7f253e4b6700 1 -- 172.21.15.146:0/1779666078 shutdown_connections 2023-10-03T10:14:56.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.721+0000 7f253e4b6700 1 --2- 172.21.15.146:0/1779666078 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2538133ad0 0x7f2538133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.721+0000 7f253e4b6700 1 --2- 172.21.15.146:0/1779666078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25381300a0 0x7f25381304b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.721+0000 7f253e4b6700 1 -- 172.21.15.146:0/1779666078 >> 172.21.15.146:0/1779666078 conn(0x7f2538099c40 msgr2=0x7f25380a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.721+0000 7f253e4b6700 1 -- 172.21.15.146:0/1779666078 shutdown_connections 2023-10-03T10:14:56.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.721+0000 7f253e4b6700 1 -- 172.21.15.146:0/1779666078 wait complete. 2023-10-03T10:14:56.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.722+0000 7f253e4b6700 1 Processor -- start 2023-10-03T10:14:56.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.723+0000 7f253e4b6700 1 -- start start 2023-10-03T10:14:56.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.723+0000 7f253e4b6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25381300a0 0x7f253811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.723+0000 7f253e4b6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25381309f0 0x7f253811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.723+0000 7f253e4b6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2538133ad0 0x7f253811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.723+0000 7f253e4b6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25381202c0 con 0x7f25381300a0 2023-10-03T10:14:56.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.723+0000 7f253e4b6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25380727e0 con 0x7f2538133ad0 2023-10-03T10:14:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.723+0000 7f253e4b6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f253811ec40 con 0x7f25381309f0 2023-10-03T10:14:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.723+0000 7f253ca53700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2538133ad0 0x7f253811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.724+0000 7f25377fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25381309f0 0x7f253811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.724+0000 7f253ca53700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2538133ad0 0x7f253811e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43288/0 (socket says 172.21.15.146:43288) 2023-10-03T10:14:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.724+0000 7f253ca53700 1 -- 172.21.15.146:0/644540196 learned_addr learned my addr 172.21.15.146:0/644540196 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.724+0000 7f25377fe700 1 -- 172.21.15.146:0/644540196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2538133ad0 msgr2=0x7f253811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.724+0000 7f25377fe700 1 --2- 172.21.15.146:0/644540196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2538133ad0 0x7f253811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.724+0000 7f25377fe700 1 -- 172.21.15.146:0/644540196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25381300a0 msgr2=0x7f253811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.724+0000 7f25377fe700 1 --2- 172.21.15.146:0/644540196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25381300a0 0x7f253811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.724+0000 7f25377fe700 1 -- 172.21.15.146:0/644540196 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252c009550 con 0x7f25381309f0 2023-10-03T10:14:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.724+0000 7f25377fe700 1 --2- 172.21.15.146:0/644540196 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25381309f0 0x7f253811df80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f252c016000 tx=0x7f252c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.724+0000 7f2534ff9700 1 -- 172.21.15.146:0/644540196 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c004300 con 0x7f25381309f0 2023-10-03T10:14:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.724+0000 7f2534ff9700 1 -- 172.21.15.146:0/644540196 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c01f070 con 0x7f25381309f0 2023-10-03T10:14:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.724+0000 7f253e4b6700 1 -- 172.21.15.146:0/644540196 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253812d5a0 con 0x7f25381309f0 2023-10-03T10:14:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.724+0000 7f2534ff9700 1 -- 172.21.15.146:0/644540196 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c0036a0 con 0x7f25381309f0 2023-10-03T10:14:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.724+0000 7f253e4b6700 1 -- 172.21.15.146:0/644540196 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253811ee80 con 0x7f25381309f0 2023-10-03T10:14:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.726+0000 7f253e4b6700 1 -- 172.21.15.146:0/644540196 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253804f2a0 con 0x7f25381309f0 2023-10-03T10:14:56.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.726+0000 7f2534ff9700 1 -- 172.21.15.146:0/644540196 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f252c021030 con 0x7f25381309f0 2023-10-03T10:14:56.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.726+0000 7f2534ff9700 1 -- 172.21.15.146:0/644540196 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f252c040bd0 con 0x7f25381309f0 2023-10-03T10:14:56.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.731+0000 7f2534ff9700 1 -- 172.21.15.146:0/644540196 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f252c0199a0 con 0x7f25381309f0 2023-10-03T10:14:56.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.757+0000 7f2ba50b7700 1 Processor -- start 2023-10-03T10:14:56.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.757+0000 7f2ba50b7700 1 -- start start 2023-10-03T10:14:56.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.757+0000 7f2ba50b7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba0138040 0x7f2ba0138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.757+0000 7f2ba50b7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ba00a08e0 0x7f2ba00a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.758+0000 7f2ba50b7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2ba00a1230 0x7f2ba013ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.758+0000 7f2ba50b7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba00a2100 con 0x7f2ba00a1230 2023-10-03T10:14:56.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.758+0000 7f2ba50b7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba0138950 con 0x7f2ba00a08e0 2023-10-03T10:14:56.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.758+0000 7f2ba50b7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba01379e0 con 0x7f2ba0138040 2023-10-03T10:14:56.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.758+0000 7f2b9e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ba00a08e0 0x7f2ba00a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.758+0000 7f2b9e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ba00a08e0 0x7f2ba00a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43290/0 (socket says 172.21.15.146:43290) 2023-10-03T10:14:56.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.758+0000 7f2b9e59c700 1 -- 172.21.15.146:0/4148281572 learned_addr learned my addr 172.21.15.146:0/4148281572 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:56.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.758+0000 7f2b9f59e700 1 --2- 172.21.15.146:0/4148281572 >> v2:172.21.15.146:3300/0 conn(0x7f2ba00a1230 0x7f2ba013ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.758+0000 7f2b9ed9d700 1 --2- 172.21.15.146:0/4148281572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba0138040 0x7f2ba0138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.758+0000 7f2b9e59c700 1 -- 172.21.15.146:0/4148281572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba0138040 msgr2=0x7f2ba0138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:56.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.758+0000 7f2b9e59c700 1 --2- 172.21.15.146:0/4148281572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba0138040 0x7f2ba0138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.758+0000 7f5921c2e700 1 Processor -- start 2023-10-03T10:14:56.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.758+0000 7f2b9e59c700 1 -- 172.21.15.146:0/4148281572 >> v2:172.21.15.146:3300/0 conn(0x7f2ba00a1230 msgr2=0x7f2ba013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:56.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.758+0000 7f2b9e59c700 1 --2- 172.21.15.146:0/4148281572 >> v2:172.21.15.146:3300/0 conn(0x7f2ba00a1230 0x7f2ba013ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.758+0000 7f2b9e59c700 1 -- 172.21.15.146:0/4148281572 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba009b9b0 con 0x7f2ba00a08e0 2023-10-03T10:14:56.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.758+0000 7f2b9f59e700 1 --2- 172.21.15.146:0/4148281572 >> v2:172.21.15.146:3300/0 conn(0x7f2ba00a1230 0x7f2ba013ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:56.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.758+0000 7f2b9e59c700 1 --2- 172.21.15.146:0/4148281572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ba00a08e0 0x7f2ba00a0cf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009950 tx=0x7f2b94009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c081031329e0f271 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.758+0000 7f5921c2e700 1 -- start start 2023-10-03T10:14:56.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f2b9dd9b700 1 -- 172.21.15.146:0/4148281572 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94011830 con 0x7f2ba00a08e0 2023-10-03T10:14:56.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f2b9dd9b700 1 -- 172.21.15.146:0/4148281572 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b94011990 con 0x7f2ba00a08e0 2023-10-03T10:14:56.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f2b9dd9b700 1 -- 172.21.15.146:0/4148281572 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94011d20 con 0x7f2ba00a08e0 2023-10-03T10:14:56.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f5921c2e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f591c06a770 0x7f591c1349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f5921c2e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f591c09e070 0x7f591c13fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f5921c2e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f591c09eca0 con 0x7f591c134f00 2023-10-03T10:14:56.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f5921c2e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f591c06b2e0 con 0x7f591c06a770 2023-10-03T10:14:56.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f5921c2e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591c09f720 con 0x7f591c09e070 2023-10-03T10:14:56.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f591bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f591c09e070 0x7f591c13fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f591bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f591c09e070 0x7f591c13fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43294/0 (socket says 172.21.15.146:43294) 2023-10-03T10:14:56.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f591bfff700 1 -- 172.21.15.146:0/1293022613 learned_addr learned my addr 172.21.15.146:0/1293022613 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:56.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f591b7fe700 1 --2- 172.21.15.146:0/1293022613 >> v2:172.21.15.146:3300/0 conn(0x7f591c06a770 0x7f591c1349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f2ba50b7700 1 -- 172.21.15.146:0/4148281572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ba00a08e0 msgr2=0x7f2ba00a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f2ba50b7700 1 --2- 172.21.15.146:0/4148281572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ba00a08e0 0x7f2ba00a0cf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009950 tx=0x7f2b94009c60 comp rx=0 tx=0).stop 2023-10-03T10:14:56.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f2ba50b7700 1 -- 172.21.15.146:0/4148281572 shutdown_connections 2023-10-03T10:14:56.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f2ba50b7700 1 --2- 172.21.15.146:0/4148281572 >> v2:172.21.15.146:3300/0 conn(0x7f2ba00a1230 0x7f2ba013ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f2ba50b7700 1 --2- 172.21.15.146:0/4148281572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba0138040 0x7f2ba0138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f2ba50b7700 1 --2- 172.21.15.146:0/4148281572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ba00a08e0 0x7f2ba00a0cf0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f2ba50b7700 1 -- 172.21.15.146:0/4148281572 >> 172.21.15.146:0/4148281572 conn(0x7f2ba00a2980 msgr2=0x7f2ba00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f591bfff700 1 -- 172.21.15.146:0/1293022613 >> v2:172.21.15.146:3300/0 conn(0x7f591c06a770 msgr2=0x7f591c1349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:56.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f591bfff700 1 --2- 172.21.15.146:0/1293022613 >> v2:172.21.15.146:3300/0 conn(0x7f591c06a770 0x7f591c1349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f591bfff700 1 -- 172.21.15.146:0/1293022613 >> v1:172.21.15.146:6789/0 conn(0x7f591c134f00 legacy=0x7f591c09d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f591bfff700 1 -- 172.21.15.146:0/1293022613 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591c06b480 con 0x7f591c09e070 2023-10-03T10:14:56.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.759+0000 7f2ba50b7700 1 -- 172.21.15.146:0/4148281572 shutdown_connections 2023-10-03T10:14:56.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.760+0000 7f2ba50b7700 1 -- 172.21.15.146:0/4148281572 wait complete. 2023-10-03T10:14:56.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.760+0000 7f591bfff700 1 --2- 172.21.15.146:0/1293022613 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f591c09e070 0x7f591c13fcf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5914009e50 tx=0x7f591400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43c8a03341f9b3de server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.760+0000 7f591a7fc700 1 -- 172.21.15.146:0/1293022613 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591400e070 con 0x7f591c09e070 2023-10-03T10:14:56.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.760+0000 7f591a7fc700 1 -- 172.21.15.146:0/1293022613 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591400b9c0 con 0x7f591c09e070 2023-10-03T10:14:56.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.760+0000 7f591a7fc700 1 -- 172.21.15.146:0/1293022613 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591400bd50 con 0x7f591c09e070 2023-10-03T10:14:56.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.760+0000 7f5921c2e700 1 -- 172.21.15.146:0/1293022613 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f591c09e070 msgr2=0x7f591c13fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.760+0000 7f5921c2e700 1 --2- 172.21.15.146:0/1293022613 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f591c09e070 0x7f591c13fcf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5914009e50 tx=0x7f591400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:56.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.761+0000 7f5921c2e700 1 -- 172.21.15.146:0/1293022613 shutdown_connections 2023-10-03T10:14:56.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.761+0000 7f5921c2e700 1 --2- 172.21.15.146:0/1293022613 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f591c09e070 0x7f591c13fcf0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.761+0000 7f5921c2e700 1 --2- 172.21.15.146:0/1293022613 >> v2:172.21.15.146:3300/0 conn(0x7f591c06a770 0x7f591c1349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.761+0000 7f5921c2e700 1 -- 172.21.15.146:0/1293022613 >> 172.21.15.146:0/1293022613 conn(0x7f591c099c40 msgr2=0x7f591c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.761+0000 7f5921c2e700 1 -- 172.21.15.146:0/1293022613 shutdown_connections 2023-10-03T10:14:56.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.761+0000 7f5921c2e700 1 -- 172.21.15.146:0/1293022613 wait complete. 2023-10-03T10:14:56.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.761+0000 7f2ba50b7700 1 Processor -- start 2023-10-03T10:14:56.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.761+0000 7f2ba50b7700 1 -- start start 2023-10-03T10:14:56.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.761+0000 7f5921c2e700 1 Processor -- start 2023-10-03T10:14:56.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f2ba50b7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ba00a08e0 0x7f2ba01262d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f2ba50b7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba00a1230 0x7f2ba0126810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f5921c2e700 1 -- start start 2023-10-03T10:14:56.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f2ba50b7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ba0138040 0x7f2ba0126d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f2ba50b7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba01377d0 con 0x7f2ba00a08e0 2023-10-03T10:14:56.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f2ba50b7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba01290e0 con 0x7f2ba0138040 2023-10-03T10:14:56.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f2ba50b7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba0128d20 con 0x7f2ba00a1230 2023-10-03T10:14:56.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f2b9e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba00a1230 0x7f2ba0126810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f2b9e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba00a1230 0x7f2ba0126810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59460/0 (socket says 172.21.15.146:59460) 2023-10-03T10:14:56.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f2b9e59c700 1 -- 172.21.15.146:0/1598495856 learned_addr learned my addr 172.21.15.146:0/1598495856 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:56.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f2b9f59e700 1 --2- 172.21.15.146:0/1598495856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ba0138040 0x7f2ba0126d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f2b9ed9d700 1 --2- 172.21.15.146:0/1598495856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ba00a08e0 0x7f2ba01262d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f5921c2e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f591c06a770 0x7f591c06f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f5921c2e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f591c09e070 0x7f591c06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f5921c2e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f591c134f00 0x7f591c0703d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f5921c2e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c133b20 con 0x7f591c06a770 2023-10-03T10:14:56.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f5921c2e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591c09f220 con 0x7f591c09e070 2023-10-03T10:14:56.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f5921c2e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f591c0a0510 con 0x7f591c134f00 2023-10-03T10:14:56.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f591b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f591c06a770 0x7f591c06f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f591bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f591c134f00 0x7f591c0703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f591b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f591c06a770 0x7f591c06f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34094/0 (socket says 172.21.15.146:34094) 2023-10-03T10:14:56.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f591bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f591c134f00 0x7f591c0703d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59470/0 (socket says 172.21.15.146:59470) 2023-10-03T10:14:56.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.762+0000 7f591b7fe700 1 -- 172.21.15.146:0/1267269011 learned_addr learned my addr 172.21.15.146:0/1267269011 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:56.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.763+0000 7f2b9e59c700 1 -- 172.21.15.146:0/1598495856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ba0138040 msgr2=0x7f2ba0126d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.763+0000 7f2b9e59c700 1 --2- 172.21.15.146:0/1598495856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ba0138040 0x7f2ba0126d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.763+0000 7f2b9e59c700 1 -- 172.21.15.146:0/1598495856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ba00a08e0 msgr2=0x7f2ba01262d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.763+0000 7f2b9e59c700 1 --2- 172.21.15.146:0/1598495856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ba00a08e0 0x7f2ba01262d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.763+0000 7f2b9e59c700 1 -- 172.21.15.146:0/1598495856 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b94009550 con 0x7f2ba00a1230 2023-10-03T10:14:56.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.763+0000 7f591affd700 1 --2- 172.21.15.146:0/1267269011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f591c09e070 0x7f591c06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.763+0000 7f591bfff700 1 -- 172.21.15.146:0/1267269011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f591c09e070 msgr2=0x7f591c06fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.763+0000 7f591bfff700 1 --2- 172.21.15.146:0/1267269011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f591c09e070 0x7f591c06fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.763+0000 7f591bfff700 1 -- 172.21.15.146:0/1267269011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f591c06a770 msgr2=0x7f591c06f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.763+0000 7f591bfff700 1 --2- 172.21.15.146:0/1267269011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f591c06a770 0x7f591c06f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.763+0000 7f591bfff700 1 -- 172.21.15.146:0/1267269011 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5914009b30 con 0x7f591c134f00 2023-10-03T10:14:56.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.763+0000 7f591bfff700 1 --2- 172.21.15.146:0/1267269011 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f591c134f00 0x7f591c0703d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f591c06e0b0 tx=0x7f5914004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.763+0000 7f2b9e59c700 1 --2- 172.21.15.146:0/1598495856 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba00a1230 0x7f2ba0126810 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2b94014040 tx=0x7f2b94004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.763+0000 7f5903fff700 1 -- 172.21.15.146:0/1267269011 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59140047f0 con 0x7f591c134f00 2023-10-03T10:14:56.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.763+0000 7f5903fff700 1 -- 172.21.15.146:0/1267269011 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59140092e0 con 0x7f591c134f00 2023-10-03T10:14:56.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.763+0000 7f5921c2e700 1 -- 172.21.15.146:0/1267269011 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f591c071330 con 0x7f591c134f00 2023-10-03T10:14:56.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.763+0000 7f5903fff700 1 -- 172.21.15.146:0/1267269011 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914004970 con 0x7f591c134f00 2023-10-03T10:14:56.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.763+0000 7f5921c2e700 1 -- 172.21.15.146:0/1267269011 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f591c127220 con 0x7f591c134f00 2023-10-03T10:14:56.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.764+0000 7f2b877fe700 1 -- 172.21.15.146:0/1598495856 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9401a830 con 0x7f2ba00a1230 2023-10-03T10:14:56.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.764+0000 7f2b877fe700 1 -- 172.21.15.146:0/1598495856 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9401e070 con 0x7f2ba00a1230 2023-10-03T10:14:56.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.764+0000 7f2ba50b7700 1 -- 172.21.15.146:0/1598495856 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba009a240 con 0x7f2ba00a1230 2023-10-03T10:14:56.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.764+0000 7f2b877fe700 1 -- 172.21.15.146:0/1598495856 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9401abd0 con 0x7f2ba00a1230 2023-10-03T10:14:56.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.764+0000 7f2ba50b7700 1 -- 172.21.15.146:0/1598495856 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba0129ac0 con 0x7f2ba00a1230 2023-10-03T10:14:56.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.765+0000 7f2ba50b7700 1 -- 172.21.15.146:0/1598495856 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba004f2a0 con 0x7f2ba00a1230 2023-10-03T10:14:56.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.765+0000 7f5903fff700 1 -- 172.21.15.146:0/1267269011 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f591401c680 con 0x7f591c134f00 2023-10-03T10:14:56.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.765+0000 7f5903fff700 1 -- 172.21.15.146:0/1267269011 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5914040e90 con 0x7f591c134f00 2023-10-03T10:14:56.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.766+0000 7f5921c2e700 1 -- 172.21.15.146:0/1267269011 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f591c071840 con 0x7f591c134f00 2023-10-03T10:14:56.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.769+0000 7f2b877fe700 1 -- 172.21.15.146:0/1598495856 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b9401ad30 con 0x7f2ba00a1230 2023-10-03T10:14:56.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.769+0000 7f2b877fe700 1 -- 172.21.15.146:0/1598495856 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2b94040a40 con 0x7f2ba00a1230 2023-10-03T10:14:56.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.771+0000 7f2b877fe700 1 -- 172.21.15.146:0/1598495856 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b9402d450 con 0x7f2ba00a1230 2023-10-03T10:14:56.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.774+0000 7f5903fff700 1 -- 172.21.15.146:0/1267269011 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f591406c750 con 0x7f591c134f00 2023-10-03T10:14:56.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.883+0000 7f633ccd4700 1 -- 172.21.15.146:0/1097665777 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f633806bce0 con 0x7f6338133900 2023-10-03T10:14:56.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.884+0000 7f6326ffd700 1 -- 172.21.15.146:0/1097665777 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6328017070 con 0x7f6338133900 2023-10-03T10:14:56.883 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:56.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.887+0000 7f633ccd4700 1 -- 172.21.15.146:0/1097665777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6338133900 msgr2=0x7f6338119e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.887+0000 7f633ccd4700 1 --2- 172.21.15.146:0/1097665777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6338133900 0x7f6338119e80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f632800c520 tx=0x7f632800c830 comp rx=0 tx=0).stop 2023-10-03T10:14:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.887+0000 7f633ccd4700 1 -- 172.21.15.146:0/1097665777 shutdown_connections 2023-10-03T10:14:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.887+0000 7f633ccd4700 1 --2- 172.21.15.146:0/1097665777 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6338139200 0x7f633811a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.887+0000 7f633ccd4700 1 --2- 172.21.15.146:0/1097665777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6338133900 0x7f6338119e80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.887+0000 7f633ccd4700 1 --2- 172.21.15.146:0/1097665777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63381368e0 0x7f633811a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.887+0000 7f633ccd4700 1 -- 172.21.15.146:0/1097665777 >> 172.21.15.146:0/1097665777 conn(0x7f63380a2980 msgr2=0x7f63381346c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.887+0000 7f633ccd4700 1 -- 172.21.15.146:0/1097665777 shutdown_connections 2023-10-03T10:14:56.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.887+0000 7f633ccd4700 1 -- 172.21.15.146:0/1097665777 wait complete. 2023-10-03T10:14:56.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:56.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.969+0000 7f253e4b6700 1 -- 172.21.15.146:0/644540196 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f25380a3470 con 0x7f25381309f0 2023-10-03T10:14:56.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.969+0000 7f2534ff9700 1 -- 172.21.15.146:0/644540196 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f252c01b430 con 0x7f25381309f0 2023-10-03T10:14:56.969 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:56.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.971+0000 7f253e4b6700 1 -- 172.21.15.146:0/644540196 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25381309f0 msgr2=0x7f253811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.971+0000 7f253e4b6700 1 --2- 172.21.15.146:0/644540196 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25381309f0 0x7f253811df80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f252c016000 tx=0x7f252c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:56.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.971+0000 7f253e4b6700 1 -- 172.21.15.146:0/644540196 shutdown_connections 2023-10-03T10:14:56.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.971+0000 7f253e4b6700 1 --2- 172.21.15.146:0/644540196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2538133ad0 0x7f253811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.971+0000 7f253e4b6700 1 --2- 172.21.15.146:0/644540196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25381300a0 0x7f253811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.971+0000 7f253e4b6700 1 --2- 172.21.15.146:0/644540196 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25381309f0 0x7f253811df80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.971+0000 7f253e4b6700 1 -- 172.21.15.146:0/644540196 >> 172.21.15.146:0/644540196 conn(0x7f2538099c40 msgr2=0x7f253809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.971+0000 7f253e4b6700 1 -- 172.21.15.146:0/644540196 shutdown_connections 2023-10-03T10:14:56.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.971+0000 7f253e4b6700 1 -- 172.21.15.146:0/644540196 wait complete. 2023-10-03T10:14:56.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:56.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.996+0000 7f2ba50b7700 1 -- 172.21.15.146:0/1598495856 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2ba0129ce0 con 0x7f2ba00a1230 2023-10-03T10:14:56.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.996+0000 7f2b877fe700 1 -- 172.21.15.146:0/1598495856 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2b94015030 con 0x7f2ba00a1230 2023-10-03T10:14:56.996 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:56.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.998+0000 7f2ba50b7700 1 -- 172.21.15.146:0/1598495856 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba00a1230 msgr2=0x7f2ba0126810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.998+0000 7f2ba50b7700 1 --2- 172.21.15.146:0/1598495856 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba00a1230 0x7f2ba0126810 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2b94014040 tx=0x7f2b94004750 comp rx=0 tx=0).stop 2023-10-03T10:14:56.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.998+0000 7f2ba50b7700 1 -- 172.21.15.146:0/1598495856 shutdown_connections 2023-10-03T10:14:56.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.998+0000 7f2ba50b7700 1 --2- 172.21.15.146:0/1598495856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ba0138040 0x7f2ba0126d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.998+0000 7f2ba50b7700 1 --2- 172.21.15.146:0/1598495856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ba00a08e0 0x7f2ba01262d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.998+0000 7f2ba50b7700 1 --2- 172.21.15.146:0/1598495856 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ba00a1230 0x7f2ba0126810 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.998+0000 7f2ba50b7700 1 -- 172.21.15.146:0/1598495856 >> 172.21.15.146:0/1598495856 conn(0x7f2ba00a2980 msgr2=0x7f2ba009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.998+0000 7f2ba50b7700 1 -- 172.21.15.146:0/1598495856 shutdown_connections 2023-10-03T10:14:56.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:56.998+0000 7f2ba50b7700 1 -- 172.21.15.146:0/1598495856 wait complete. 2023-10-03T10:14:57.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:57.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:57.014+0000 7f5921c2e700 1 -- 172.21.15.146:0/1267269011 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f591c04f2a0 con 0x7f591c134f00 2023-10-03T10:14:57.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:57.014+0000 7f5903fff700 1 -- 172.21.15.146:0/1267269011 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5914033090 con 0x7f591c134f00 2023-10-03T10:14:57.014 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:57.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:57.016+0000 7f5921c2e700 1 -- 172.21.15.146:0/1267269011 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f591c134f00 msgr2=0x7f591c0703d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:57.016+0000 7f5921c2e700 1 --2- 172.21.15.146:0/1267269011 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f591c134f00 0x7f591c0703d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f591c06e0b0 tx=0x7f5914004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:57.016+0000 7f5921c2e700 1 -- 172.21.15.146:0/1267269011 shutdown_connections 2023-10-03T10:14:57.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:57.017+0000 7f5921c2e700 1 --2- 172.21.15.146:0/1267269011 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f591c134f00 0x7f591c0703d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:57.017+0000 7f5921c2e700 1 --2- 172.21.15.146:0/1267269011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f591c06a770 0x7f591c06f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:57.017+0000 7f5921c2e700 1 --2- 172.21.15.146:0/1267269011 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f591c09e070 0x7f591c06fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:57.017+0000 7f5921c2e700 1 -- 172.21.15.146:0/1267269011 >> 172.21.15.146:0/1267269011 conn(0x7f591c099c40 msgr2=0x7f591c0a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:57.017+0000 7f5921c2e700 1 -- 172.21.15.146:0/1267269011 shutdown_connections 2023-10-03T10:14:57.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:57.017+0000 7f5921c2e700 1 -- 172.21.15.146:0/1267269011 wait complete. 2023-10-03T10:14:57.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:57.904 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:57.984 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:58.011 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:58.029 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:58.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.044+0000 7f44c81ca700 1 Processor -- start 2023-10-03T10:14:58.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.044+0000 7f44c81ca700 1 -- start start 2023-10-03T10:14:58.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.044+0000 7f44c81ca700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f44c006a770 0x7f44c006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.044+0000 7f44c81ca700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c006b080 0x7f44c01317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.044+0000 7f44c81ca700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c009da80 con 0x7f44c0131cf0 2023-10-03T10:14:58.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.044+0000 7f44c81ca700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c009dce0 con 0x7f44c006a770 2023-10-03T10:14:58.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.044+0000 7f44c81ca700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44c009eb20 con 0x7f44c006b080 2023-10-03T10:14:58.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.044+0000 7f44c5f66700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f44c006a770 0x7f44c006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.044+0000 7f44c5765700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c006b080 0x7f44c01317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.044+0000 7f44c5765700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c006b080 0x7f44c01317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59482/0 (socket says 172.21.15.146:59482) 2023-10-03T10:14:58.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.044+0000 7f44c5f66700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f44c006a770 0x7f44c006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34110/0 (socket says 172.21.15.146:34110) 2023-10-03T10:14:58.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.045+0000 7f44c5765700 1 -- 172.21.15.146:0/394094081 learned_addr learned my addr 172.21.15.146:0/394094081 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:58.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.045+0000 7f44c6767700 1 --1- 172.21.15.146:0/394094081 >> v1:172.21.15.146:6789/0 conn(0x7f44c0131cf0 0x7f44c0138c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38244/0 (socket says 172.21.15.146:38244) 2023-10-03T10:14:58.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.045+0000 7f44c5765700 1 -- 172.21.15.146:0/394094081 >> v2:172.21.15.146:3300/0 conn(0x7f44c006a770 msgr2=0x7f44c006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:58.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.045+0000 7f44c5765700 1 --2- 172.21.15.146:0/394094081 >> v2:172.21.15.146:3300/0 conn(0x7f44c006a770 0x7f44c006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.045+0000 7f44c5765700 1 -- 172.21.15.146:0/394094081 >> v1:172.21.15.146:6789/0 conn(0x7f44c0131cf0 legacy=0x7f44c0138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.045+0000 7f44c5765700 1 -- 172.21.15.146:0/394094081 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c009d860 con 0x7f44c006b080 2023-10-03T10:14:58.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.045+0000 7f44c5765700 1 --2- 172.21.15.146:0/394094081 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c006b080 0x7f44c01317b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f44b00098f0 tx=0x7f44b0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeaa3491161c2544 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.045+0000 7f44c4f64700 1 -- 172.21.15.146:0/394094081 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b0011830 con 0x7f44c006b080 2023-10-03T10:14:58.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.045+0000 7f44c4f64700 1 -- 172.21.15.146:0/394094081 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b0011990 con 0x7f44c006b080 2023-10-03T10:14:58.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.045+0000 7f44c4f64700 1 -- 172.21.15.146:0/394094081 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b0011d20 con 0x7f44c006b080 2023-10-03T10:14:58.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.046+0000 7f44c81ca700 1 -- 172.21.15.146:0/394094081 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c006b080 msgr2=0x7f44c01317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.046+0000 7f44c81ca700 1 --2- 172.21.15.146:0/394094081 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c006b080 0x7f44c01317b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f44b00098f0 tx=0x7f44b0009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:58.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.046+0000 7f44c81ca700 1 -- 172.21.15.146:0/394094081 shutdown_connections 2023-10-03T10:14:58.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.046+0000 7f44c81ca700 1 --2- 172.21.15.146:0/394094081 >> v2:172.21.15.146:3300/0 conn(0x7f44c006a770 0x7f44c006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.046+0000 7f44c81ca700 1 --2- 172.21.15.146:0/394094081 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c006b080 0x7f44c01317b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.046+0000 7f44c81ca700 1 -- 172.21.15.146:0/394094081 >> 172.21.15.146:0/394094081 conn(0x7f44c0099c40 msgr2=0x7f44c00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.046+0000 7f44c81ca700 1 -- 172.21.15.146:0/394094081 shutdown_connections 2023-10-03T10:14:58.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.046+0000 7f44c81ca700 1 -- 172.21.15.146:0/394094081 wait complete. 2023-10-03T10:14:58.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.048+0000 7f44c81ca700 1 Processor -- start 2023-10-03T10:14:58.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.048+0000 7f44c81ca700 1 -- start start 2023-10-03T10:14:58.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.048+0000 7f44c81ca700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44c006a770 0x7f44c011e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.048+0000 7f44c81ca700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c006b080 0x7f44c011e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.048+0000 7f44c81ca700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44c0131cf0 0x7f44c011ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.048+0000 7f44c81ca700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c0120de0 con 0x7f44c0131cf0 2023-10-03T10:14:58.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.048+0000 7f44c81ca700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c009a150 con 0x7f44c006a770 2023-10-03T10:14:58.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.048+0000 7f44c81ca700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44c0071e10 con 0x7f44c006b080 2023-10-03T10:14:58.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.048+0000 7f44c5765700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c006b080 0x7f44c011e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.049+0000 7f44c5765700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c006b080 0x7f44c011e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59492/0 (socket says 172.21.15.146:59492) 2023-10-03T10:14:58.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.049+0000 7f44c5765700 1 -- 172.21.15.146:0/3302722224 learned_addr learned my addr 172.21.15.146:0/3302722224 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:58.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.049+0000 7f44c5f66700 1 --2- 172.21.15.146:0/3302722224 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44c006a770 0x7f44c011e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.049+0000 7f44c6767700 1 --2- 172.21.15.146:0/3302722224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44c0131cf0 0x7f44c011ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.049+0000 7f44c6767700 1 -- 172.21.15.146:0/3302722224 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c006b080 msgr2=0x7f44c011e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.049+0000 7f44c6767700 1 --2- 172.21.15.146:0/3302722224 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c006b080 0x7f44c011e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.049+0000 7f44c6767700 1 -- 172.21.15.146:0/3302722224 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44c006a770 msgr2=0x7f44c011e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.049+0000 7f44c6767700 1 --2- 172.21.15.146:0/3302722224 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44c006a770 0x7f44c011e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.049+0000 7f44c6767700 1 -- 172.21.15.146:0/3302722224 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b0009550 con 0x7f44c0131cf0 2023-10-03T10:14:58.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.049+0000 7f44c5f66700 1 --2- 172.21.15.146:0/3302722224 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44c006a770 0x7f44c011e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:58.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.049+0000 7f44c6767700 1 --2- 172.21.15.146:0/3302722224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44c0131cf0 0x7f44c011ed40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f44b800cb10 tx=0x7f44b800ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.049+0000 7f44b67fc700 1 -- 172.21.15.146:0/3302722224 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b800a9e0 con 0x7f44c0131cf0 2023-10-03T10:14:58.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.050+0000 7f44b67fc700 1 -- 172.21.15.146:0/3302722224 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b800ab40 con 0x7f44c0131cf0 2023-10-03T10:14:58.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.050+0000 7f44c81ca700 1 -- 172.21.15.146:0/3302722224 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c01206c0 con 0x7f44c0131cf0 2023-10-03T10:14:58.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.050+0000 7f44b67fc700 1 -- 172.21.15.146:0/3302722224 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8011560 con 0x7f44c0131cf0 2023-10-03T10:14:58.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.050+0000 7f44c81ca700 1 -- 172.21.15.146:0/3302722224 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c0121de0 con 0x7f44c0131cf0 2023-10-03T10:14:58.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.051+0000 7f44b67fc700 1 -- 172.21.15.146:0/3302722224 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f44b8017070 con 0x7f44c0131cf0 2023-10-03T10:14:58.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.051+0000 7f44b67fc700 1 -- 172.21.15.146:0/3302722224 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f44b8011330 con 0x7f44c0131cf0 2023-10-03T10:14:58.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.051+0000 7f44c81ca700 1 -- 172.21.15.146:0/3302722224 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c0121960 con 0x7f44c0131cf0 2023-10-03T10:14:58.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.060+0000 7f44b67fc700 1 -- 172.21.15.146:0/3302722224 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44c0121960 con 0x7f44c0131cf0 2023-10-03T10:14:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.120+0000 7f7a0625f700 1 Processor -- start 2023-10-03T10:14:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.120+0000 7f7a0625f700 1 -- start start 2023-10-03T10:14:58.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.121+0000 7f7a0625f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a0009ad40 0x7f7a00133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.121+0000 7f7a0625f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a001343a0 0x7f7a000a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.121+0000 7f7a0625f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a0009b110 con 0x7f7a00133f70 2023-10-03T10:14:58.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.121+0000 7f7a0625f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a000a3b60 con 0x7f7a0009ad40 2023-10-03T10:14:58.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.121+0000 7f7a0625f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a000a2fa0 con 0x7f7a001343a0 2023-10-03T10:14:58.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.121+0000 7f79ff7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a0009ad40 0x7f7a00133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.121+0000 7f79feffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7a00133f70 0x7f7a000a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38248/0 (socket says 172.21.15.146:38248) 2023-10-03T10:14:58.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.121+0000 7f79feffd700 1 -- 172.21.15.146:0/3953407446 learned_addr learned my addr 172.21.15.146:0/3953407446 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:58.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.121+0000 7f79fffff700 1 --2- 172.21.15.146:0/3953407446 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a001343a0 0x7f7a000a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.121+0000 7f79fe7fc700 1 -- 172.21.15.146:0/3953407446 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1540130345 0 0) 0x7f7a0009b110 con 0x7f7a00133f70 2023-10-03T10:14:58.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.122+0000 7f79fe7fc700 1 -- 172.21.15.146:0/3953407446 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79e80035b0 con 0x7f7a00133f70 2023-10-03T10:14:58.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.122+0000 7f79fffff700 1 -- 172.21.15.146:0/3953407446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a0009ad40 msgr2=0x7f7a00133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:58.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.122+0000 7f79fffff700 1 --2- 172.21.15.146:0/3953407446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a0009ad40 0x7f7a00133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.122+0000 7f79fffff700 1 -- 172.21.15.146:0/3953407446 >> v1:172.21.15.146:6789/0 conn(0x7f7a00133f70 legacy=0x7f7a000a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.122+0000 7f79fffff700 1 -- 172.21.15.146:0/3953407446 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0009a280 con 0x7f7a001343a0 2023-10-03T10:14:58.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.122+0000 7f79ff7fe700 1 --2- 172.21.15.146:0/3953407446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a0009ad40 0x7f7a00133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:58.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.122+0000 7f79fffff700 1 --2- 172.21.15.146:0/3953407446 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a001343a0 0x7f7a000a1180 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f79f8009dc0 tx=0x7f79f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e36c18628dbd2f63 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.122+0000 7f79fe7fc700 1 -- 172.21.15.146:0/3953407446 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f800e070 con 0x7f7a001343a0 2023-10-03T10:14:58.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.122+0000 7f79fe7fc700 1 -- 172.21.15.146:0/3953407446 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f800bb20 con 0x7f7a001343a0 2023-10-03T10:14:58.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.122+0000 7f79fe7fc700 1 -- 172.21.15.146:0/3953407446 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f8012430 con 0x7f7a001343a0 2023-10-03T10:14:58.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.123+0000 7f7a0625f700 1 -- 172.21.15.146:0/3953407446 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a001343a0 msgr2=0x7f7a000a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.123+0000 7f7a0625f700 1 --2- 172.21.15.146:0/3953407446 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a001343a0 0x7f7a000a1180 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f79f8009dc0 tx=0x7f79f800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:58.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.123+0000 7f7a0625f700 1 -- 172.21.15.146:0/3953407446 shutdown_connections 2023-10-03T10:14:58.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.123+0000 7f7a0625f700 1 --2- 172.21.15.146:0/3953407446 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a001343a0 0x7f7a000a1180 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.123+0000 7f7a0625f700 1 --2- 172.21.15.146:0/3953407446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a0009ad40 0x7f7a00133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.123+0000 7f7a0625f700 1 -- 172.21.15.146:0/3953407446 >> 172.21.15.146:0/3953407446 conn(0x7f7a00099c40 msgr2=0x7f7a0006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.123+0000 7f7a0625f700 1 -- 172.21.15.146:0/3953407446 shutdown_connections 2023-10-03T10:14:58.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.123+0000 7f7a0625f700 1 -- 172.21.15.146:0/3953407446 wait complete. 2023-10-03T10:14:58.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.124+0000 7f7a0625f700 1 Processor -- start 2023-10-03T10:14:58.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.124+0000 7f7a0625f700 1 -- start start 2023-10-03T10:14:58.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.125+0000 7f7a0625f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a0009ad40 0x7f7a001c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.125+0000 7f7a0625f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a00133f70 0x7f7a001c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.125+0000 7f7a0625f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a001343a0 0x7f7a0011e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.125+0000 7f7a0625f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a001334c0 con 0x7f7a00133f70 2023-10-03T10:14:58.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.125+0000 7f7a0625f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a00133850 con 0x7f7a001343a0 2023-10-03T10:14:58.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.125+0000 7f7a0625f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a001bd070 con 0x7f7a0009ad40 2023-10-03T10:14:58.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.125+0000 7f79ff7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a0009ad40 0x7f7a001c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.125+0000 7f79ff7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a0009ad40 0x7f7a001c8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59516/0 (socket says 172.21.15.146:59516) 2023-10-03T10:14:58.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.125+0000 7f79ff7fe700 1 -- 172.21.15.146:0/1816435676 learned_addr learned my addr 172.21.15.146:0/1816435676 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:58.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.125+0000 7f79fffff700 1 --2- 172.21.15.146:0/1816435676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a001343a0 0x7f7a0011e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.125+0000 7f79feffd700 1 --2- 172.21.15.146:0/1816435676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a00133f70 0x7f7a001c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.125+0000 7f79ff7fe700 1 -- 172.21.15.146:0/1816435676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a001343a0 msgr2=0x7f7a0011e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.125+0000 7f79ff7fe700 1 --2- 172.21.15.146:0/1816435676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a001343a0 0x7f7a0011e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.125+0000 7f79ff7fe700 1 -- 172.21.15.146:0/1816435676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a00133f70 msgr2=0x7f7a001c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.125+0000 7f79ff7fe700 1 --2- 172.21.15.146:0/1816435676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a00133f70 0x7f7a001c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.125+0000 7f79ff7fe700 1 -- 172.21.15.146:0/1816435676 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f00094a0 con 0x7f7a0009ad40 2023-10-03T10:14:58.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.125+0000 7f79feffd700 1 --2- 172.21.15.146:0/1816435676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a00133f70 0x7f7a001c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:58.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.125+0000 7f79ff7fe700 1 --2- 172.21.15.146:0/1816435676 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a0009ad40 0x7f7a001c8420 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f79f000ebe0 tx=0x7f79f000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.126+0000 7f79e7fff700 1 -- 172.21.15.146:0/1816435676 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f000c850 con 0x7f7a0009ad40 2023-10-03T10:14:58.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.126+0000 7f79e7fff700 1 -- 172.21.15.146:0/1816435676 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f000c9b0 con 0x7f7a0009ad40 2023-10-03T10:14:58.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.126+0000 7f79e7fff700 1 -- 172.21.15.146:0/1816435676 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f000cd20 con 0x7f7a0009ad40 2023-10-03T10:14:58.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.126+0000 7f7a0625f700 1 -- 172.21.15.146:0/1816435676 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f8009a70 con 0x7f7a0009ad40 2023-10-03T10:14:58.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.126+0000 7f7a0625f700 1 -- 172.21.15.146:0/1816435676 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a00122120 con 0x7f7a0009ad40 2023-10-03T10:14:58.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.127+0000 7f79e7fff700 1 -- 172.21.15.146:0/1816435676 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79f0013470 con 0x7f7a0009ad40 2023-10-03T10:14:58.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.127+0000 7f79e7fff700 1 -- 172.21.15.146:0/1816435676 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f79f003f8d0 con 0x7f7a0009ad40 2023-10-03T10:14:58.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.127+0000 7f7a0625f700 1 -- 172.21.15.146:0/1816435676 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a0004f2a0 con 0x7f7a0009ad40 2023-10-03T10:14:58.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.132+0000 7f79e7fff700 1 -- 172.21.15.146:0/1816435676 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79f0021020 con 0x7f7a0009ad40 2023-10-03T10:14:58.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.167+0000 7f6bd5c42700 1 Processor -- start 2023-10-03T10:14:58.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.167+0000 7f6bd5c42700 1 -- start start 2023-10-03T10:14:58.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.168+0000 7f6bd5c42700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd009f350 0x7f6bd0136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.168+0000 7f6bd5c42700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6bd01371c0 0x7f6bd01395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.168+0000 7f6bd5c42700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd009c970 con 0x7f6bd009e870 2023-10-03T10:14:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.168+0000 7f6bd5c42700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd00a0920 con 0x7f6bd01371c0 2023-10-03T10:14:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.168+0000 7f6bd5c42700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd009f9c0 con 0x7f6bd009f350 2023-10-03T10:14:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.168+0000 7f6bceffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd009f350 0x7f6bd0136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.168+0000 7f6bceffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd009f350 0x7f6bd0136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43326/0 (socket says 172.21.15.146:43326) 2023-10-03T10:14:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.168+0000 7f6bceffd700 1 -- 172.21.15.146:0/1513906496 learned_addr learned my addr 172.21.15.146:0/1513906496 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.168+0000 7f6bcffff700 1 --2- 172.21.15.146:0/1513906496 >> v2:172.21.15.146:3300/0 conn(0x7f6bd01371c0 0x7f6bd01395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.168+0000 7f6bceffd700 1 -- 172.21.15.146:0/1513906496 >> v2:172.21.15.146:3300/0 conn(0x7f6bd01371c0 msgr2=0x7f6bd01395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.168+0000 7f6bceffd700 1 --2- 172.21.15.146:0/1513906496 >> v2:172.21.15.146:3300/0 conn(0x7f6bd01371c0 0x7f6bd01395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.168+0000 7f6bceffd700 1 -- 172.21.15.146:0/1513906496 >> v1:172.21.15.146:6789/0 conn(0x7f6bd009e870 legacy=0x7f6bd009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.168+0000 7f6bceffd700 1 -- 172.21.15.146:0/1513906496 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd009bab0 con 0x7f6bd009f350 2023-10-03T10:14:58.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.168+0000 7f6bceffd700 1 --2- 172.21.15.146:0/1513906496 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd009f350 0x7f6bd0136c80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40098f0 tx=0x7f6bc4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f63f052eede25b4f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.169+0000 7f6bce7fc700 1 -- 172.21.15.146:0/1513906496 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc400b8a0 con 0x7f6bd009f350 2023-10-03T10:14:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.169+0000 7f6bce7fc700 1 -- 172.21.15.146:0/1513906496 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc400ba00 con 0x7f6bd009f350 2023-10-03T10:14:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.169+0000 7f6bce7fc700 1 -- 172.21.15.146:0/1513906496 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc400bd90 con 0x7f6bd009f350 2023-10-03T10:14:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.169+0000 7f6bd5c42700 1 -- 172.21.15.146:0/1513906496 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd009f350 msgr2=0x7f6bd0136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.169+0000 7f6bd5c42700 1 --2- 172.21.15.146:0/1513906496 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd009f350 0x7f6bd0136c80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40098f0 tx=0x7f6bc4009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.169+0000 7f6bd5c42700 1 -- 172.21.15.146:0/1513906496 shutdown_connections 2023-10-03T10:14:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.169+0000 7f6bd5c42700 1 --2- 172.21.15.146:0/1513906496 >> v2:172.21.15.146:3300/0 conn(0x7f6bd01371c0 0x7f6bd01395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.169+0000 7f6bd5c42700 1 --2- 172.21.15.146:0/1513906496 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd009f350 0x7f6bd0136c80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.169+0000 7f6bd5c42700 1 -- 172.21.15.146:0/1513906496 >> 172.21.15.146:0/1513906496 conn(0x7f6bd00a4430 msgr2=0x7f6bd00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.169+0000 7f6bd5c42700 1 -- 172.21.15.146:0/1513906496 shutdown_connections 2023-10-03T10:14:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.169+0000 7f6bd5c42700 1 -- 172.21.15.146:0/1513906496 wait complete. 2023-10-03T10:14:58.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.171+0000 7f6bd5c42700 1 Processor -- start 2023-10-03T10:14:58.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.171+0000 7f6bd5c42700 1 -- start start 2023-10-03T10:14:58.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.171+0000 7f6bd5c42700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd009e870 0x7f6bd01209e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.171+0000 7f6bd5c42700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6bd009f350 0x7f6bd0120f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.171+0000 7f6bd5c42700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bd01371c0 0x7f6bd0121460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.171+0000 7f6bd5c42700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd0122550 con 0x7f6bd01371c0 2023-10-03T10:14:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.171+0000 7f6bd5c42700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd0122b70 con 0x7f6bd009e870 2023-10-03T10:14:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.171+0000 7f6bd5c42700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd009dc10 con 0x7f6bd009f350 2023-10-03T10:14:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.172+0000 7f6bceffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6bd009f350 0x7f6bd0120f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.172+0000 7f6bceffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6bd009f350 0x7f6bd0120f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59520/0 (socket says 172.21.15.146:59520) 2023-10-03T10:14:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.172+0000 7f6bceffd700 1 -- 172.21.15.146:0/2945435403 learned_addr learned my addr 172.21.15.146:0/2945435403 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.172+0000 7f6bcffff700 1 --2- 172.21.15.146:0/2945435403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bd01371c0 0x7f6bd0121460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.172+0000 7f6bcf7fe700 1 --2- 172.21.15.146:0/2945435403 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd009e870 0x7f6bd01209e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.172+0000 7f6bceffd700 1 -- 172.21.15.146:0/2945435403 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd009e870 msgr2=0x7f6bd01209e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.172+0000 7f6bceffd700 1 --2- 172.21.15.146:0/2945435403 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd009e870 0x7f6bd01209e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.172+0000 7f6bceffd700 1 -- 172.21.15.146:0/2945435403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bd01371c0 msgr2=0x7f6bd0121460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.172+0000 7f6bceffd700 1 --2- 172.21.15.146:0/2945435403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bd01371c0 0x7f6bd0121460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.172+0000 7f6bceffd700 1 -- 172.21.15.146:0/2945435403 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc4009550 con 0x7f6bd009f350 2023-10-03T10:14:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.172+0000 7f6bceffd700 1 --2- 172.21.15.146:0/2945435403 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6bd009f350 0x7f6bd0120f20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4000c00 tx=0x7f6bc4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.172+0000 7f6bb7fff700 1 -- 172.21.15.146:0/2945435403 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4004510 con 0x7f6bd009f350 2023-10-03T10:14:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.173+0000 7f6bb7fff700 1 -- 172.21.15.146:0/2945435403 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc40036a0 con 0x7f6bd009f350 2023-10-03T10:14:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.173+0000 7f6bd5c42700 1 -- 172.21.15.146:0/2945435403 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd0124180 con 0x7f6bd009f350 2023-10-03T10:14:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.173+0000 7f6bb7fff700 1 -- 172.21.15.146:0/2945435403 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4003a30 con 0x7f6bd009f350 2023-10-03T10:14:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.173+0000 7f6bd5c42700 1 -- 172.21.15.146:0/2945435403 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd0123f10 con 0x7f6bd009f350 2023-10-03T10:14:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.173+0000 7f6bb7fff700 1 -- 172.21.15.146:0/2945435403 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6bc4021070 con 0x7f6bd009f350 2023-10-03T10:14:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.173+0000 7f6bb7fff700 1 -- 172.21.15.146:0/2945435403 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6bc4040ba0 con 0x7f6bd009f350 2023-10-03T10:14:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.175+0000 7f6bd5c42700 1 -- 172.21.15.146:0/2945435403 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd0122da0 con 0x7f6bd009f350 2023-10-03T10:14:58.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.179+0000 7f6bb7fff700 1 -- 172.21.15.146:0/2945435403 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6bc4011420 con 0x7f6bd009f350 2023-10-03T10:14:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.180+0000 7fec0056c700 1 Processor -- start 2023-10-03T10:14:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.180+0000 7fec0056c700 1 -- start start 2023-10-03T10:14:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.181+0000 7fec0056c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7febf8133b80 0x7febf8133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.181+0000 7fec0056c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febf8099a60 0x7febf80a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.181+0000 7fec0056c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7febf80a0e20 0x7febf80a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.181+0000 7fec0056c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf809aa00 con 0x7febf80a0e20 2023-10-03T10:14:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.181+0000 7fec0056c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf809a080 con 0x7febf8099a60 2023-10-03T10:14:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.181+0000 7fec0056c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febf8133750 con 0x7febf8133b80 2023-10-03T10:14:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.181+0000 7febfdb07700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febf8099a60 0x7febf80a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.181+0000 7febfdb07700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febf8099a60 0x7febf80a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43332/0 (socket says 172.21.15.146:43332) 2023-10-03T10:14:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.181+0000 7febfdb07700 1 -- 172.21.15.146:0/2054726706 learned_addr learned my addr 172.21.15.146:0/2054726706 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.181+0000 7febfeb09700 1 --2- 172.21.15.146:0/2054726706 >> v2:172.21.15.146:3300/0 conn(0x7febf80a0e20 0x7febf80a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.181+0000 7febfdb07700 1 -- 172.21.15.146:0/2054726706 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7febf8133b80 msgr2=0x7febf8133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.181+0000 7febfdb07700 1 --2- 172.21.15.146:0/2054726706 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7febf8133b80 0x7febf8133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.181+0000 7febfdb07700 1 -- 172.21.15.146:0/2054726706 >> v2:172.21.15.146:3300/0 conn(0x7febf80a0e20 msgr2=0x7febf80a12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:58.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.181+0000 7febfdb07700 1 --2- 172.21.15.146:0/2054726706 >> v2:172.21.15.146:3300/0 conn(0x7febf80a0e20 0x7febf80a12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.181+0000 7febfdb07700 1 -- 172.21.15.146:0/2054726706 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf809a760 con 0x7febf8099a60 2023-10-03T10:14:58.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.182+0000 7febfdb07700 1 --2- 172.21.15.146:0/2054726706 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febf8099a60 0x7febf80a08e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7febe80098f0 tx=0x7febe8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b39ded37bc30e67 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.182+0000 7febfd306700 1 -- 172.21.15.146:0/2054726706 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe8011830 con 0x7febf8099a60 2023-10-03T10:14:58.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.182+0000 7febfd306700 1 -- 172.21.15.146:0/2054726706 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe8011990 con 0x7febf8099a60 2023-10-03T10:14:58.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.182+0000 7febfd306700 1 -- 172.21.15.146:0/2054726706 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe8011d20 con 0x7febf8099a60 2023-10-03T10:14:58.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.182+0000 7fec0056c700 1 -- 172.21.15.146:0/2054726706 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febf8099a60 msgr2=0x7febf80a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.182+0000 7fec0056c700 1 --2- 172.21.15.146:0/2054726706 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febf8099a60 0x7febf80a08e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7febe80098f0 tx=0x7febe8009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:58.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.183+0000 7fec0056c700 1 -- 172.21.15.146:0/2054726706 shutdown_connections 2023-10-03T10:14:58.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.183+0000 7fec0056c700 1 --2- 172.21.15.146:0/2054726706 >> v2:172.21.15.146:3300/0 conn(0x7febf80a0e20 0x7febf80a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.183+0000 7fec0056c700 1 --2- 172.21.15.146:0/2054726706 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7febf8133b80 0x7febf8133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.183+0000 7fec0056c700 1 --2- 172.21.15.146:0/2054726706 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febf8099a60 0x7febf80a08e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.183+0000 7fec0056c700 1 -- 172.21.15.146:0/2054726706 >> 172.21.15.146:0/2054726706 conn(0x7febf80a2980 msgr2=0x7febf80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.183+0000 7fec0056c700 1 -- 172.21.15.146:0/2054726706 shutdown_connections 2023-10-03T10:14:58.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.183+0000 7fec0056c700 1 -- 172.21.15.146:0/2054726706 wait complete. 2023-10-03T10:14:58.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.184+0000 7fec0056c700 1 Processor -- start 2023-10-03T10:14:58.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.184+0000 7fec0056c700 1 -- start start 2023-10-03T10:14:58.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.184+0000 7fec0056c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febf8099a60 0x7febf811c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.184+0000 7fec0056c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febf80a0e20 0x7febf811cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.184+0000 7fec0056c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7febf8133b80 0x7febf811d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.184+0000 7fec0056c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf811e3e0 con 0x7febf8099a60 2023-10-03T10:14:58.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.184+0000 7fec0056c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf811ea00 con 0x7febf80a0e20 2023-10-03T10:14:58.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.184+0000 7fec0056c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febf811f630 con 0x7febf8133b80 2023-10-03T10:14:58.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.184+0000 7febfe308700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febf8099a60 0x7febf811c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.184+0000 7febfeb09700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7febf8133b80 0x7febf811d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.184+0000 7febfe308700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febf8099a60 0x7febf811c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34156/0 (socket says 172.21.15.146:34156) 2023-10-03T10:14:58.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.184+0000 7febfe308700 1 -- 172.21.15.146:0/3098933466 learned_addr learned my addr 172.21.15.146:0/3098933466 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:58.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.184+0000 7febfdb07700 1 --2- 172.21.15.146:0/3098933466 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febf80a0e20 0x7febf811cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.185+0000 7febfe308700 1 -- 172.21.15.146:0/3098933466 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7febf8133b80 msgr2=0x7febf811d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.185+0000 7febfe308700 1 --2- 172.21.15.146:0/3098933466 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7febf8133b80 0x7febf811d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.185+0000 7febfe308700 1 -- 172.21.15.146:0/3098933466 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febf80a0e20 msgr2=0x7febf811cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.185+0000 7febfe308700 1 --2- 172.21.15.146:0/3098933466 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febf80a0e20 0x7febf811cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.185+0000 7febfe308700 1 -- 172.21.15.146:0/3098933466 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe8009550 con 0x7febf8099a60 2023-10-03T10:14:58.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.185+0000 7febfeb09700 1 --2- 172.21.15.146:0/3098933466 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7febf8133b80 0x7febf811d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:58.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.185+0000 7febfe308700 1 --2- 172.21.15.146:0/3098933466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febf8099a60 0x7febf811c8b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7febf400b550 tx=0x7febf400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.185+0000 7febeeffd700 1 -- 172.21.15.146:0/3098933466 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf4005aa0 con 0x7febf8099a60 2023-10-03T10:14:58.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.185+0000 7febeeffd700 1 -- 172.21.15.146:0/3098933466 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf4005c00 con 0x7febf8099a60 2023-10-03T10:14:58.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.185+0000 7fec0056c700 1 -- 172.21.15.146:0/3098933466 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf8120010 con 0x7febf8099a60 2023-10-03T10:14:58.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.185+0000 7febeeffd700 1 -- 172.21.15.146:0/3098933466 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf4011630 con 0x7febf8099a60 2023-10-03T10:14:58.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.185+0000 7fec0056c700 1 -- 172.21.15.146:0/3098933466 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf809a2c0 con 0x7febf8099a60 2023-10-03T10:14:58.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.186+0000 7fec0056c700 1 -- 172.21.15.146:0/3098933466 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf804f2a0 con 0x7febf8099a60 2023-10-03T10:14:58.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.186+0000 7febeeffd700 1 -- 172.21.15.146:0/3098933466 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7febf4011790 con 0x7febf8099a60 2023-10-03T10:14:58.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.187+0000 7febeeffd700 1 -- 172.21.15.146:0/3098933466 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7febf403f3a0 con 0x7febf8099a60 2023-10-03T10:14:58.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.191+0000 7febeeffd700 1 -- 172.21.15.146:0/3098933466 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7febf40212f0 con 0x7febf8099a60 2023-10-03T10:14:58.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.295+0000 7f44c81ca700 1 -- 172.21.15.146:0/3302722224 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f44c0121960 con 0x7f44c0131cf0 2023-10-03T10:14:58.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.295+0000 7f44b67fc700 1 -- 172.21.15.146:0/3302722224 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f44c0121960 con 0x7f44c0131cf0 2023-10-03T10:14:58.295 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:58.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.299+0000 7f44c81ca700 1 -- 172.21.15.146:0/3302722224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44c0131cf0 msgr2=0x7f44c011ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.299+0000 7f44c81ca700 1 --2- 172.21.15.146:0/3302722224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44c0131cf0 0x7f44c011ed40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f44b800cb10 tx=0x7f44b800ce20 comp rx=0 tx=0).stop 2023-10-03T10:14:58.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.299+0000 7f44c81ca700 1 -- 172.21.15.146:0/3302722224 shutdown_connections 2023-10-03T10:14:58.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.299+0000 7f44c81ca700 1 --2- 172.21.15.146:0/3302722224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44c0131cf0 0x7f44c011ed40 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.299+0000 7f44c81ca700 1 --2- 172.21.15.146:0/3302722224 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44c006a770 0x7f44c011e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.299+0000 7f44c81ca700 1 --2- 172.21.15.146:0/3302722224 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c006b080 0x7f44c011e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.299+0000 7f44c81ca700 1 -- 172.21.15.146:0/3302722224 >> 172.21.15.146:0/3302722224 conn(0x7f44c0099c40 msgr2=0x7f44c0130080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.300+0000 7f44c81ca700 1 -- 172.21.15.146:0/3302722224 shutdown_connections 2023-10-03T10:14:58.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.300+0000 7f44c81ca700 1 -- 172.21.15.146:0/3302722224 wait complete. 2023-10-03T10:14:58.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:58.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.332+0000 7f7a0625f700 1 -- 172.21.15.146:0/1816435676 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7a000729d0 con 0x7f7a0009ad40 2023-10-03T10:14:58.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.332+0000 7f79e7fff700 1 -- 172.21.15.146:0/1816435676 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f79f002a090 con 0x7f7a0009ad40 2023-10-03T10:14:58.332 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:58.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.334+0000 7f7a0625f700 1 -- 172.21.15.146:0/1816435676 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a0009ad40 msgr2=0x7f7a001c8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.334+0000 7f7a0625f700 1 --2- 172.21.15.146:0/1816435676 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a0009ad40 0x7f7a001c8420 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f79f000ebe0 tx=0x7f79f000eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.334+0000 7f7a0625f700 1 -- 172.21.15.146:0/1816435676 shutdown_connections 2023-10-03T10:14:58.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.334+0000 7f7a0625f700 1 --2- 172.21.15.146:0/1816435676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a001343a0 0x7f7a0011e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.335+0000 7f7a0625f700 1 --2- 172.21.15.146:0/1816435676 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a0009ad40 0x7f7a001c8420 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.335+0000 7f7a0625f700 1 --2- 172.21.15.146:0/1816435676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a00133f70 0x7f7a001c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.335+0000 7f7a0625f700 1 -- 172.21.15.146:0/1816435676 >> 172.21.15.146:0/1816435676 conn(0x7f7a00099c40 msgr2=0x7f7a001bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.335+0000 7f7a0625f700 1 -- 172.21.15.146:0/1816435676 shutdown_connections 2023-10-03T10:14:58.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.335+0000 7f7a0625f700 1 -- 172.21.15.146:0/1816435676 wait complete. 2023-10-03T10:14:58.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:58.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.394+0000 7fec0056c700 1 -- 172.21.15.146:0/3098933466 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7febf806bce0 con 0x7febf8099a60 2023-10-03T10:14:58.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.394+0000 7febeeffd700 1 -- 172.21.15.146:0/3098933466 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7febf403f020 con 0x7febf8099a60 2023-10-03T10:14:58.394 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:58.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.396+0000 7fec0056c700 1 -- 172.21.15.146:0/3098933466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febf8099a60 msgr2=0x7febf811c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.396+0000 7fec0056c700 1 --2- 172.21.15.146:0/3098933466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febf8099a60 0x7febf811c8b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7febf400b550 tx=0x7febf400b860 comp rx=0 tx=0).stop 2023-10-03T10:14:58.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.396+0000 7fec0056c700 1 -- 172.21.15.146:0/3098933466 shutdown_connections 2023-10-03T10:14:58.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.396+0000 7fec0056c700 1 --2- 172.21.15.146:0/3098933466 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7febf8133b80 0x7febf811d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.396+0000 7fec0056c700 1 --2- 172.21.15.146:0/3098933466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febf8099a60 0x7febf811c8b0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.396+0000 7fec0056c700 1 --2- 172.21.15.146:0/3098933466 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febf80a0e20 0x7febf811cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.396+0000 7fec0056c700 1 -- 172.21.15.146:0/3098933466 >> 172.21.15.146:0/3098933466 conn(0x7febf80a2980 msgr2=0x7febf81baec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.396+0000 7fec0056c700 1 -- 172.21.15.146:0/3098933466 shutdown_connections 2023-10-03T10:14:58.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.396+0000 7fec0056c700 1 -- 172.21.15.146:0/3098933466 wait complete. 2023-10-03T10:14:58.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.398+0000 7f6bd5c42700 1 -- 172.21.15.146:0/2945435403 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6bd004f2a0 con 0x7f6bd009f350 2023-10-03T10:14:58.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.399+0000 7f6bb7fff700 1 -- 172.21.15.146:0/2945435403 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6bc4032090 con 0x7f6bd009f350 2023-10-03T10:14:58.398 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:58.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.401+0000 7f6bd5c42700 1 -- 172.21.15.146:0/2945435403 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6bd009f350 msgr2=0x7f6bd0120f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.401+0000 7f6bd5c42700 1 --2- 172.21.15.146:0/2945435403 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6bd009f350 0x7f6bd0120f20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4000c00 tx=0x7f6bc4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:58.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.401+0000 7f6bd5c42700 1 -- 172.21.15.146:0/2945435403 shutdown_connections 2023-10-03T10:14:58.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.401+0000 7f6bd5c42700 1 --2- 172.21.15.146:0/2945435403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bd01371c0 0x7f6bd0121460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.401+0000 7f6bd5c42700 1 --2- 172.21.15.146:0/2945435403 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6bd009e870 0x7f6bd01209e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.401+0000 7f6bd5c42700 1 --2- 172.21.15.146:0/2945435403 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6bd009f350 0x7f6bd0120f20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.401+0000 7f6bd5c42700 1 -- 172.21.15.146:0/2945435403 >> 172.21.15.146:0/2945435403 conn(0x7f6bd00a4430 msgr2=0x7f6bd00a2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.401+0000 7f6bd5c42700 1 -- 172.21.15.146:0/2945435403 shutdown_connections 2023-10-03T10:14:58.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:58.401+0000 7f6bd5c42700 1 -- 172.21.15.146:0/2945435403 wait complete. 2023-10-03T10:14:58.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:58.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:14:59.317 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:59.347 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:59.410 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:59.414 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:59.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.448+0000 7ff7dc769700 1 Processor -- start 2023-10-03T10:14:59.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.448+0000 7ff7dc769700 1 -- start start 2023-10-03T10:14:59.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.449+0000 7ff7dc769700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7d41368e0 0x7ff7d4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.449+0000 7ff7dc769700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff7d4139200 0x7ff7d413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.449+0000 7ff7dc769700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d409a760 con 0x7ff7d4133900 2023-10-03T10:14:59.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.449+0000 7ff7dc769700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d41336e0 con 0x7ff7d4139200 2023-10-03T10:14:59.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.449+0000 7ff7dc769700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d409a080 con 0x7ff7d41368e0 2023-10-03T10:14:59.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.449+0000 7ff7dad06700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff7d4139200 0x7ff7d413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.449+0000 7ff7da505700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff7d4133900 0x7ff7d4133cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38272/0 (socket says 172.21.15.146:38272) 2023-10-03T10:14:59.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.449+0000 7ff7da505700 1 -- 172.21.15.146:0/39107359 learned_addr learned my addr 172.21.15.146:0/39107359 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:59.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.449+0000 7ff7d9d04700 1 --2- 172.21.15.146:0/39107359 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7d41368e0 0x7ff7d4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.449+0000 7ff7d9503700 1 -- 172.21.15.146:0/39107359 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107333067 0 0) 0x7ff7d409a760 con 0x7ff7d4133900 2023-10-03T10:14:59.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.450+0000 7ff7d9503700 1 -- 172.21.15.146:0/39107359 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7c00035b0 con 0x7ff7d4133900 2023-10-03T10:14:59.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.450+0000 7ff7dad06700 1 -- 172.21.15.146:0/39107359 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7d41368e0 msgr2=0x7ff7d4138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:59.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.450+0000 7ff7dad06700 1 --2- 172.21.15.146:0/39107359 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7d41368e0 0x7ff7d4138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.450+0000 7ff7dad06700 1 -- 172.21.15.146:0/39107359 >> v1:172.21.15.146:6789/0 conn(0x7ff7d4133900 legacy=0x7ff7d4133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.450+0000 7ff7dad06700 1 -- 172.21.15.146:0/39107359 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d40a23e0 con 0x7ff7d4139200 2023-10-03T10:14:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.450+0000 7ff7dad06700 1 --2- 172.21.15.146:0/39107359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d4139200 0x7ff7d413b5e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009d90 tx=0x7ff7cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba199c20e6712d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.450+0000 7ff7d9503700 1 -- 172.21.15.146:0/39107359 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc00e070 con 0x7ff7d4139200 2023-10-03T10:14:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.450+0000 7ff7d9503700 1 -- 172.21.15.146:0/39107359 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7cc00bb20 con 0x7ff7d4139200 2023-10-03T10:14:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.450+0000 7ff7d9503700 1 -- 172.21.15.146:0/39107359 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc012430 con 0x7ff7d4139200 2023-10-03T10:14:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.451+0000 7ff7dc769700 1 -- 172.21.15.146:0/39107359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d4139200 msgr2=0x7ff7d413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.451+0000 7ff7dc769700 1 --2- 172.21.15.146:0/39107359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d4139200 0x7ff7d413b5e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009d90 tx=0x7ff7cc00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.451+0000 7ff7dc769700 1 -- 172.21.15.146:0/39107359 shutdown_connections 2023-10-03T10:14:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.451+0000 7ff7dc769700 1 --2- 172.21.15.146:0/39107359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d4139200 0x7ff7d413b5e0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.451+0000 7ff7dc769700 1 --2- 172.21.15.146:0/39107359 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7d41368e0 0x7ff7d4138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.451+0000 7ff7dc769700 1 -- 172.21.15.146:0/39107359 >> 172.21.15.146:0/39107359 conn(0x7ff7d40a2980 msgr2=0x7ff7d40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.451+0000 7ff7dc769700 1 -- 172.21.15.146:0/39107359 shutdown_connections 2023-10-03T10:14:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.451+0000 7ff7dc769700 1 -- 172.21.15.146:0/39107359 wait complete. 2023-10-03T10:14:59.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.453+0000 7ff7dc769700 1 Processor -- start 2023-10-03T10:14:59.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.453+0000 7ff7dc769700 1 -- start start 2023-10-03T10:14:59.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.453+0000 7ff7dc769700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7d4133900 0x7ff7d411aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.453+0000 7ff7dc769700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7d41368e0 0x7ff7d411b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.453+0000 7ff7dc769700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d4139200 0x7ff7d411b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.453+0000 7ff7dc769700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d409a350 con 0x7ff7d4139200 2023-10-03T10:14:59.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.453+0000 7ff7dc769700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d411cbe0 con 0x7ff7d41368e0 2023-10-03T10:14:59.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.453+0000 7ff7dc769700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d411e700 con 0x7ff7d4133900 2023-10-03T10:14:59.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.454+0000 7ff7dad06700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d4139200 0x7ff7d411b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.454+0000 7ff7dad06700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d4139200 0x7ff7d411b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34182/0 (socket says 172.21.15.146:34182) 2023-10-03T10:14:59.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.454+0000 7ff7dad06700 1 -- 172.21.15.146:0/2236257651 learned_addr learned my addr 172.21.15.146:0/2236257651 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:59.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.454+0000 7ff7d9d04700 1 --2- 172.21.15.146:0/2236257651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7d41368e0 0x7ff7d411b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.454+0000 7ff7da505700 1 --2- 172.21.15.146:0/2236257651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7d4133900 0x7ff7d411aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.454+0000 7ff7dad06700 1 -- 172.21.15.146:0/2236257651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7d4133900 msgr2=0x7ff7d411aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.454+0000 7ff7dad06700 1 --2- 172.21.15.146:0/2236257651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7d4133900 0x7ff7d411aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.454+0000 7ff7dad06700 1 -- 172.21.15.146:0/2236257651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7d41368e0 msgr2=0x7ff7d411b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.454+0000 7ff7dad06700 1 --2- 172.21.15.146:0/2236257651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7d41368e0 0x7ff7d411b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.454+0000 7ff7dad06700 1 -- 172.21.15.146:0/2236257651 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc009a70 con 0x7ff7d4139200 2023-10-03T10:14:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.454+0000 7ff7d9d04700 1 --2- 172.21.15.146:0/2236257651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7d41368e0 0x7ff7d411b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.454+0000 7ff7dad06700 1 --2- 172.21.15.146:0/2236257651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d4139200 0x7ff7d411b940 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4133820 tx=0x7ff7cc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.454+0000 7ff7caffd700 1 -- 172.21.15.146:0/2236257651 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc0129f0 con 0x7ff7d4139200 2023-10-03T10:14:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.454+0000 7ff7caffd700 1 -- 172.21.15.146:0/2236257651 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7cc020070 con 0x7ff7d4139200 2023-10-03T10:14:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.454+0000 7ff7dc769700 1 -- 172.21.15.146:0/2236257651 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d4138ff0 con 0x7ff7d4139200 2023-10-03T10:14:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.454+0000 7ff7caffd700 1 -- 172.21.15.146:0/2236257651 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc012d90 con 0x7ff7d4139200 2023-10-03T10:14:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.455+0000 7ff7dc769700 1 -- 172.21.15.146:0/2236257651 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d411f170 con 0x7ff7d4139200 2023-10-03T10:14:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.455+0000 7ff7caffd700 1 -- 172.21.15.146:0/2236257651 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff7cc004040 con 0x7ff7d4139200 2023-10-03T10:14:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.456+0000 7ff7caffd700 1 -- 172.21.15.146:0/2236257651 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff7cc022070 con 0x7ff7d4139200 2023-10-03T10:14:59.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.456+0000 7ff7dc769700 1 -- 172.21.15.146:0/2236257651 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d404f2a0 con 0x7ff7d4139200 2023-10-03T10:14:59.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.460+0000 7ff7caffd700 1 -- 172.21.15.146:0/2236257651 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff7cc02f570 con 0x7ff7d4139200 2023-10-03T10:14:59.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.499+0000 7f197e9a6700 1 Processor -- start 2023-10-03T10:14:59.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.499+0000 7f197e9a6700 1 -- start start 2023-10-03T10:14:59.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.499+0000 7f197e9a6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19780a0a30 0x7f19780a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.499+0000 7f197e9a6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19780a1340 0x7f197812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.499+0000 7f197e9a6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19781304a0 0x7f19781308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.499+0000 7f197e9a6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1978130e30 con 0x7f19781304a0 2023-10-03T10:14:59.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.499+0000 7f197e9a6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19780a1e70 con 0x7f19780a0a30 2023-10-03T10:14:59.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.499+0000 7f197e9a6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f197809a720 con 0x7f19780a1340 2023-10-03T10:14:59.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.500+0000 7f1977fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19780a0a30 0x7f19780a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.500+0000 7f19777fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19780a1340 0x7f197812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.500+0000 7f1977fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19780a0a30 0x7f19780a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43366/0 (socket says 172.21.15.146:43366) 2023-10-03T10:14:59.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.500+0000 7f1977fff700 1 -- 172.21.15.146:0/1997880221 learned_addr learned my addr 172.21.15.146:0/1997880221 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:59.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.500+0000 7f19777fe700 1 -- 172.21.15.146:0/1997880221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19780a0a30 msgr2=0x7f19780a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:59.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.500+0000 7f19777fe700 1 --2- 172.21.15.146:0/1997880221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19780a0a30 0x7f19780a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.500+0000 7f19777fe700 1 -- 172.21.15.146:0/1997880221 >> v2:172.21.15.146:3300/0 conn(0x7f19781304a0 msgr2=0x7f19781308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:59.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.500+0000 7f19777fe700 1 --2- 172.21.15.146:0/1997880221 >> v2:172.21.15.146:3300/0 conn(0x7f19781304a0 0x7f19781308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.500+0000 7f19777fe700 1 -- 172.21.15.146:0/1997880221 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197809b300 con 0x7f19780a1340 2023-10-03T10:14:59.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.500+0000 7f1977fff700 1 --2- 172.21.15.146:0/1997880221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19780a0a30 0x7f19780a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:59.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.500+0000 7f19777fe700 1 --2- 172.21.15.146:0/1997880221 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19780a1340 0x7f197812ff60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f196c009840 tx=0x7f196c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdf0a7fc8d8adcc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.500+0000 7f1976ffd700 1 -- 172.21.15.146:0/1997880221 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c011830 con 0x7f19780a1340 2023-10-03T10:14:59.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.500+0000 7f1976ffd700 1 -- 172.21.15.146:0/1997880221 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196c011990 con 0x7f19780a1340 2023-10-03T10:14:59.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.500+0000 7f1976ffd700 1 -- 172.21.15.146:0/1997880221 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c011d20 con 0x7f19780a1340 2023-10-03T10:14:59.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.501+0000 7f197e9a6700 1 -- 172.21.15.146:0/1997880221 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19780a1340 msgr2=0x7f197812ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.501+0000 7f197e9a6700 1 --2- 172.21.15.146:0/1997880221 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19780a1340 0x7f197812ff60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f196c009840 tx=0x7f196c009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:59.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.501+0000 7f197e9a6700 1 -- 172.21.15.146:0/1997880221 shutdown_connections 2023-10-03T10:14:59.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.501+0000 7f197e9a6700 1 --2- 172.21.15.146:0/1997880221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19780a0a30 0x7f19780a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.501+0000 7f197e9a6700 1 --2- 172.21.15.146:0/1997880221 >> v2:172.21.15.146:3300/0 conn(0x7f19781304a0 0x7f19781308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.501+0000 7f197e9a6700 1 --2- 172.21.15.146:0/1997880221 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19780a1340 0x7f197812ff60 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.501+0000 7f197e9a6700 1 -- 172.21.15.146:0/1997880221 >> 172.21.15.146:0/1997880221 conn(0x7f19780a2980 msgr2=0x7f19780a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.501+0000 7f197e9a6700 1 -- 172.21.15.146:0/1997880221 shutdown_connections 2023-10-03T10:14:59.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.501+0000 7f197e9a6700 1 -- 172.21.15.146:0/1997880221 wait complete. 2023-10-03T10:14:59.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.503+0000 7f197e9a6700 1 Processor -- start 2023-10-03T10:14:59.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.503+0000 7f197e9a6700 1 -- start start 2023-10-03T10:14:59.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.504+0000 7f197e9a6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19780a0a30 0x7f197811ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.504+0000 7f197e9a6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19780a1340 0x7f197811b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.504+0000 7f197e9a6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19781304a0 0x7f197811b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.504+0000 7f197e9a6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197811e580 con 0x7f19780a0a30 2023-10-03T10:14:59.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.504+0000 7f197e9a6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197811ca60 con 0x7f19781304a0 2023-10-03T10:14:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.504+0000 7f197e9a6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f197809ae00 con 0x7f19780a1340 2023-10-03T10:14:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.504+0000 7f19777fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19780a1340 0x7f197811b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.504+0000 7f19777fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19780a1340 0x7f197811b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59572/0 (socket says 172.21.15.146:59572) 2023-10-03T10:14:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.504+0000 7f19777fe700 1 -- 172.21.15.146:0/348202666 learned_addr learned my addr 172.21.15.146:0/348202666 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.504+0000 7f197cf43700 1 --2- 172.21.15.146:0/348202666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19781304a0 0x7f197811b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.504+0000 7f19777fe700 1 -- 172.21.15.146:0/348202666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19781304a0 msgr2=0x7f197811b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.504+0000 7f19777fe700 1 --2- 172.21.15.146:0/348202666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19781304a0 0x7f197811b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.504+0000 7f19777fe700 1 -- 172.21.15.146:0/348202666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19780a0a30 msgr2=0x7f197811ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.504+0000 7f19777fe700 1 --2- 172.21.15.146:0/348202666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19780a0a30 0x7f197811ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.504+0000 7f19777fe700 1 -- 172.21.15.146:0/348202666 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196800b7a0 con 0x7f19780a1340 2023-10-03T10:14:59.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.504+0000 7f19777fe700 1 --2- 172.21.15.146:0/348202666 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19780a1340 0x7f197811b2d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f196c0090b0 tx=0x7f196c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.504+0000 7f1974ff9700 1 -- 172.21.15.146:0/348202666 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c004510 con 0x7f19780a1340 2023-10-03T10:14:59.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.504+0000 7f1974ff9700 1 -- 172.21.15.146:0/348202666 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196c01f070 con 0x7f19780a1340 2023-10-03T10:14:59.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.505+0000 7f1974ff9700 1 -- 172.21.15.146:0/348202666 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c0038c0 con 0x7f19780a1340 2023-10-03T10:14:59.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.505+0000 7f197e9a6700 1 -- 172.21.15.146:0/348202666 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196c0094a0 con 0x7f19780a1340 2023-10-03T10:14:59.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.505+0000 7f197e9a6700 1 -- 172.21.15.146:0/348202666 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197811d140 con 0x7f19780a1340 2023-10-03T10:14:59.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.506+0000 7f197e9a6700 1 -- 172.21.15.146:0/348202666 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197812fcd0 con 0x7f19780a1340 2023-10-03T10:14:59.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.506+0000 7f1974ff9700 1 -- 172.21.15.146:0/348202666 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f196c003a20 con 0x7f19780a1340 2023-10-03T10:14:59.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.507+0000 7f1974ff9700 1 -- 172.21.15.146:0/348202666 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f196c021070 con 0x7f19780a1340 2023-10-03T10:14:59.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.511+0000 7f1974ff9700 1 -- 172.21.15.146:0/348202666 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f196c010380 con 0x7f19780a1340 2023-10-03T10:14:59.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.544+0000 7efd84196700 1 Processor -- start 2023-10-03T10:14:59.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.544+0000 7efd84196700 1 -- start start 2023-10-03T10:14:59.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.544+0000 7efd84196700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd7c133660 0x7efd7c135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.544+0000 7efd84196700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd7c135f80 0x7efd7c138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.544+0000 7efd84196700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7c099a60 con 0x7efd7c099e20 2023-10-03T10:14:59.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.545+0000 7efd84196700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c09bf50 con 0x7efd7c133660 2023-10-03T10:14:59.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.545+0000 7efd84196700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c09b230 con 0x7efd7c135f80 2023-10-03T10:14:59.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.545+0000 7efd81f32700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7efd7c099e20 0x7efd7c09a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38284/0 (socket says 172.21.15.146:38284) 2023-10-03T10:14:59.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.545+0000 7efd81f32700 1 -- 172.21.15.146:0/2195589500 learned_addr learned my addr 172.21.15.146:0/2195589500 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:14:59.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.545+0000 7efd82733700 1 --2- 172.21.15.146:0/2195589500 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd7c135f80 0x7efd7c138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.545+0000 7efd81731700 1 --2- 172.21.15.146:0/2195589500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd7c133660 0x7efd7c135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.545+0000 7efd81731700 1 -- 172.21.15.146:0/2195589500 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd7c135f80 msgr2=0x7efd7c138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:59.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.545+0000 7efd80f30700 1 -- 172.21.15.146:0/2195589500 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816715765 0 0) 0x7efd7c099a60 con 0x7efd7c099e20 2023-10-03T10:14:59.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.545+0000 7efd81731700 1 --2- 172.21.15.146:0/2195589500 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd7c135f80 0x7efd7c138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.545+0000 7efd81731700 1 -- 172.21.15.146:0/2195589500 >> v1:172.21.15.146:6789/0 conn(0x7efd7c099e20 legacy=0x7efd7c09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.545+0000 7efd81731700 1 -- 172.21.15.146:0/2195589500 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c09bb90 con 0x7efd7c133660 2023-10-03T10:14:59.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.545+0000 7efd82733700 1 --2- 172.21.15.146:0/2195589500 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd7c135f80 0x7efd7c138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:59.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.545+0000 7efd81731700 1 --2- 172.21.15.146:0/2195589500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd7c133660 0x7efd7c135a40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009870 tx=0x7efd6c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66186b7f0212c0ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.546+0000 7efd80f30700 1 -- 172.21.15.146:0/2195589500 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c010a90 con 0x7efd7c133660 2023-10-03T10:14:59.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.546+0000 7efd80f30700 1 -- 172.21.15.146:0/2195589500 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6c010bf0 con 0x7efd7c133660 2023-10-03T10:14:59.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.546+0000 7efd80f30700 1 -- 172.21.15.146:0/2195589500 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c018440 con 0x7efd7c133660 2023-10-03T10:14:59.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.546+0000 7efd84196700 1 -- 172.21.15.146:0/2195589500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd7c133660 msgr2=0x7efd7c135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.546+0000 7efd84196700 1 --2- 172.21.15.146:0/2195589500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd7c133660 0x7efd7c135a40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009870 tx=0x7efd6c009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:59.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.547+0000 7efd84196700 1 -- 172.21.15.146:0/2195589500 shutdown_connections 2023-10-03T10:14:59.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.547+0000 7efd84196700 1 --2- 172.21.15.146:0/2195589500 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd7c135f80 0x7efd7c138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.547+0000 7efd84196700 1 --2- 172.21.15.146:0/2195589500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd7c133660 0x7efd7c135a40 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.547+0000 7efd84196700 1 -- 172.21.15.146:0/2195589500 >> 172.21.15.146:0/2195589500 conn(0x7efd7c0a2980 msgr2=0x7efd7c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.547+0000 7efd84196700 1 -- 172.21.15.146:0/2195589500 shutdown_connections 2023-10-03T10:14:59.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.547+0000 7efd84196700 1 -- 172.21.15.146:0/2195589500 wait complete. 2023-10-03T10:14:59.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.548+0000 7efd84196700 1 Processor -- start 2023-10-03T10:14:59.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.548+0000 7efd84196700 1 -- start start 2023-10-03T10:14:59.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.549+0000 7efd84196700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd7c099e20 0x7efd7c06ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.549+0000 7efd84196700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd7c133660 0x7efd7c070500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.549+0000 7efd84196700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd7c135f80 0x7efd7c070a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.549+0000 7efd84196700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c1196f0 con 0x7efd7c099e20 2023-10-03T10:14:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.549+0000 7efd84196700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c135730 con 0x7efd7c133660 2023-10-03T10:14:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.549+0000 7efd84196700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c11a590 con 0x7efd7c135f80 2023-10-03T10:14:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.549+0000 7efd82733700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd7c135f80 0x7efd7c070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.549+0000 7efd81731700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd7c133660 0x7efd7c070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.549+0000 7efd81f32700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd7c099e20 0x7efd7c06ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.549+0000 7efd81731700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd7c133660 0x7efd7c070500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43392/0 (socket says 172.21.15.146:43392) 2023-10-03T10:14:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.549+0000 7efd82733700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd7c135f80 0x7efd7c070a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59590/0 (socket says 172.21.15.146:59590) 2023-10-03T10:14:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.549+0000 7efd81731700 1 -- 172.21.15.146:0/2719347065 learned_addr learned my addr 172.21.15.146:0/2719347065 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.549+0000 7efd81f32700 1 -- 172.21.15.146:0/2719347065 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd7c135f80 msgr2=0x7efd7c070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.549+0000 7efd81f32700 1 --2- 172.21.15.146:0/2719347065 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd7c135f80 0x7efd7c070a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.549+0000 7efd81f32700 1 -- 172.21.15.146:0/2719347065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd7c133660 msgr2=0x7efd7c070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.549+0000 7efd81f32700 1 --2- 172.21.15.146:0/2719347065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd7c133660 0x7efd7c070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.549+0000 7efd81f32700 1 -- 172.21.15.146:0/2719347065 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd74009a70 con 0x7efd7c099e20 2023-10-03T10:14:59.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.549+0000 7efd82733700 1 --2- 172.21.15.146:0/2719347065 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd7c135f80 0x7efd7c070a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:59.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.549+0000 7efd81731700 1 --2- 172.21.15.146:0/2719347065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd7c133660 0x7efd7c070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:59.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.550+0000 7efd81f32700 1 --2- 172.21.15.146:0/2719347065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd7c099e20 0x7efd7c06ffc0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7efd7800c3e0 tx=0x7efd7800c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.550+0000 7efd727fc700 1 -- 172.21.15.146:0/2719347065 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd780074e0 con 0x7efd7c099e20 2023-10-03T10:14:59.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.550+0000 7efd727fc700 1 -- 172.21.15.146:0/2719347065 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd78007640 con 0x7efd7c099e20 2023-10-03T10:14:59.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.550+0000 7efd84196700 1 -- 172.21.15.146:0/2719347065 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6c0094a0 con 0x7efd7c099e20 2023-10-03T10:14:59.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.550+0000 7efd727fc700 1 -- 172.21.15.146:0/2719347065 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78005a70 con 0x7efd7c099e20 2023-10-03T10:14:59.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.550+0000 7efd84196700 1 -- 172.21.15.146:0/2719347065 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7c0713b0 con 0x7efd7c099e20 2023-10-03T10:14:59.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.551+0000 7efd84196700 1 -- 172.21.15.146:0/2719347065 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd7c072480 con 0x7efd7c099e20 2023-10-03T10:14:59.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.551+0000 7efd727fc700 1 -- 172.21.15.146:0/2719347065 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd78005bd0 con 0x7efd7c099e20 2023-10-03T10:14:59.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.551+0000 7efd727fc700 1 -- 172.21.15.146:0/2719347065 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efd7803eb90 con 0x7efd7c099e20 2023-10-03T10:14:59.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.560+0000 7efd727fc700 1 -- 172.21.15.146:0/2719347065 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd7c072480 con 0x7efd7c099e20 2023-10-03T10:14:59.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.584+0000 7f49b100c700 1 Processor -- start 2023-10-03T10:14:59.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.584+0000 7f49b100c700 1 -- start start 2023-10-03T10:14:59.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.585+0000 7f49b100c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f49ac06a770 0x7f49ac06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.585+0000 7f49b100c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49ac09dec0 0x7f49ac06b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.585+0000 7f49b100c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ac06b5c0 con 0x7f49ac131a00 2023-10-03T10:14:59.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.585+0000 7f49b100c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac06e900 con 0x7f49ac09dec0 2023-10-03T10:14:59.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.585+0000 7f49b100c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac09d180 con 0x7f49ac06a770 2023-10-03T10:14:59.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.585+0000 7f49aad9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f49ac06a770 0x7f49ac06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.585+0000 7f49aad9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f49ac06a770 0x7f49ac06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59594/0 (socket says 172.21.15.146:59594) 2023-10-03T10:14:59.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.585+0000 7f49aad9d700 1 -- 172.21.15.146:0/403812912 learned_addr learned my addr 172.21.15.146:0/403812912 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:59.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.585+0000 7f49aa59c700 1 --2- 172.21.15.146:0/403812912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49ac09dec0 0x7f49ac06b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.586+0000 7f49aad9d700 1 -- 172.21.15.146:0/403812912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49ac09dec0 msgr2=0x7f49ac06b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.586+0000 7f49aad9d700 1 --2- 172.21.15.146:0/403812912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49ac09dec0 0x7f49ac06b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.586+0000 7f49aad9d700 1 -- 172.21.15.146:0/403812912 >> v1:172.21.15.146:6789/0 conn(0x7f49ac131a00 legacy=0x7f49ac131e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.586+0000 7f49aad9d700 1 -- 172.21.15.146:0/403812912 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac09e780 con 0x7f49ac06a770 2023-10-03T10:14:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.586+0000 7f49aa59c700 1 --2- 172.21.15.146:0/403812912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49ac09dec0 0x7f49ac06b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.586+0000 7f49aad9d700 1 --2- 172.21.15.146:0/403812912 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f49ac06a770 0x7f49ac06ab40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f499c009920 tx=0x7f499c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f84490bb59e5997f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.586+0000 7f49a9d9b700 1 -- 172.21.15.146:0/403812912 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c011830 con 0x7f49ac06a770 2023-10-03T10:14:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.586+0000 7f49a9d9b700 1 -- 172.21.15.146:0/403812912 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c011990 con 0x7f49ac06a770 2023-10-03T10:14:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.586+0000 7f49a9d9b700 1 -- 172.21.15.146:0/403812912 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c011d20 con 0x7f49ac06a770 2023-10-03T10:14:59.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.586+0000 7f49b100c700 1 -- 172.21.15.146:0/403812912 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f49ac06a770 msgr2=0x7f49ac06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.586+0000 7f49b100c700 1 --2- 172.21.15.146:0/403812912 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f49ac06a770 0x7f49ac06ab40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f499c009920 tx=0x7f499c009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:59.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.587+0000 7f49b100c700 1 -- 172.21.15.146:0/403812912 shutdown_connections 2023-10-03T10:14:59.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.587+0000 7f49b100c700 1 --2- 172.21.15.146:0/403812912 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f49ac06a770 0x7f49ac06ab40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.587+0000 7f49b100c700 1 --2- 172.21.15.146:0/403812912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49ac09dec0 0x7f49ac06b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.587+0000 7f49b100c700 1 -- 172.21.15.146:0/403812912 >> 172.21.15.146:0/403812912 conn(0x7f49ac099c40 msgr2=0x7f49ac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.587+0000 7f49b100c700 1 -- 172.21.15.146:0/403812912 shutdown_connections 2023-10-03T10:14:59.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.587+0000 7f49b100c700 1 -- 172.21.15.146:0/403812912 wait complete. 2023-10-03T10:14:59.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.588+0000 7f49b100c700 1 Processor -- start 2023-10-03T10:14:59.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.588+0000 7f49b100c700 1 -- start start 2023-10-03T10:14:59.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.589+0000 7f49b100c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f49ac06a770 0x7f49ac11a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.589+0000 7f49b100c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49ac09dec0 0x7f49ac11a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.589+0000 7f49b100c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49ac131a00 0x7f49ac11aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.589+0000 7f49b100c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac11bc00 con 0x7f49ac09dec0 2023-10-03T10:14:59.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.589+0000 7f49b100c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac11ce50 con 0x7f49ac131a00 2023-10-03T10:14:59.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.589+0000 7f49b100c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac11c1e0 con 0x7f49ac06a770 2023-10-03T10:14:59.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.589+0000 7f49aad9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f49ac06a770 0x7f49ac11a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.589+0000 7f49aad9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f49ac06a770 0x7f49ac11a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59600/0 (socket says 172.21.15.146:59600) 2023-10-03T10:14:59.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.589+0000 7f49aad9d700 1 -- 172.21.15.146:0/405954619 learned_addr learned my addr 172.21.15.146:0/405954619 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:14:59.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.589+0000 7f49aa59c700 1 --2- 172.21.15.146:0/405954619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49ac09dec0 0x7f49ac11a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.589+0000 7f49ab59e700 1 --2- 172.21.15.146:0/405954619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49ac131a00 0x7f49ac11aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.590+0000 7f49aad9d700 1 -- 172.21.15.146:0/405954619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49ac131a00 msgr2=0x7f49ac11aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.590+0000 7f49aad9d700 1 --2- 172.21.15.146:0/405954619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49ac131a00 0x7f49ac11aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.590+0000 7f49aad9d700 1 -- 172.21.15.146:0/405954619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49ac09dec0 msgr2=0x7f49ac11a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.590+0000 7f49aad9d700 1 --2- 172.21.15.146:0/405954619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49ac09dec0 0x7f49ac11a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.590+0000 7f49aad9d700 1 -- 172.21.15.146:0/405954619 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a00094a0 con 0x7f49ac06a770 2023-10-03T10:14:59.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.590+0000 7f49aad9d700 1 --2- 172.21.15.146:0/405954619 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f49ac06a770 0x7f49ac11a040 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f499c000c00 tx=0x7f499c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.590+0000 7f49937fe700 1 -- 172.21.15.146:0/405954619 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c004450 con 0x7f49ac06a770 2023-10-03T10:14:59.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.590+0000 7f49937fe700 1 -- 172.21.15.146:0/405954619 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c0045b0 con 0x7f49ac06a770 2023-10-03T10:14:59.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.590+0000 7f49b100c700 1 -- 172.21.15.146:0/405954619 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499c009550 con 0x7f49ac06a770 2023-10-03T10:14:59.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.590+0000 7f49937fe700 1 -- 172.21.15.146:0/405954619 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c0038a0 con 0x7f49ac06a770 2023-10-03T10:14:59.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.590+0000 7f49b100c700 1 -- 172.21.15.146:0/405954619 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ac131050 con 0x7f49ac06a770 2023-10-03T10:14:59.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.591+0000 7f49937fe700 1 -- 172.21.15.146:0/405954619 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f499c003a00 con 0x7f49ac06a770 2023-10-03T10:14:59.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.591+0000 7f49937fe700 1 -- 172.21.15.146:0/405954619 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f499c021030 con 0x7f49ac06a770 2023-10-03T10:14:59.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.591+0000 7f49b100c700 1 -- 172.21.15.146:0/405954619 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ac071d40 con 0x7f49ac06a770 2023-10-03T10:14:59.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.596+0000 7f49937fe700 1 -- 172.21.15.146:0/405954619 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f499c003cb0 con 0x7f49ac06a770 2023-10-03T10:14:59.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.667+0000 7ff7dc769700 1 -- 172.21.15.146:0/2236257651 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff7d406bce0 con 0x7ff7d4139200 2023-10-03T10:14:59.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.667+0000 7ff7caffd700 1 -- 172.21.15.146:0/2236257651 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff7cc035070 con 0x7ff7d4139200 2023-10-03T10:14:59.667 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:14:59.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.669+0000 7ff7dc769700 1 -- 172.21.15.146:0/2236257651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d4139200 msgr2=0x7ff7d411b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.669+0000 7ff7dc769700 1 --2- 172.21.15.146:0/2236257651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d4139200 0x7ff7d411b940 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4133820 tx=0x7ff7cc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.669+0000 7ff7dc769700 1 -- 172.21.15.146:0/2236257651 shutdown_connections 2023-10-03T10:14:59.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.669+0000 7ff7dc769700 1 --2- 172.21.15.146:0/2236257651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d4139200 0x7ff7d411b940 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.669+0000 7ff7dc769700 1 --2- 172.21.15.146:0/2236257651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7d4133900 0x7ff7d411aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.669+0000 7ff7dc769700 1 --2- 172.21.15.146:0/2236257651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7d41368e0 0x7ff7d411b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.669+0000 7ff7dc769700 1 -- 172.21.15.146:0/2236257651 >> 172.21.15.146:0/2236257651 conn(0x7ff7d40a2980 msgr2=0x7ff7d4131a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.669+0000 7ff7dc769700 1 -- 172.21.15.146:0/2236257651 shutdown_connections 2023-10-03T10:14:59.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.669+0000 7ff7dc769700 1 -- 172.21.15.146:0/2236257651 wait complete. 2023-10-03T10:14:59.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:14:59.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.716+0000 7f197e9a6700 1 -- 172.21.15.146:0/348202666 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f197804f2a0 con 0x7f19780a1340 2023-10-03T10:14:59.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.717+0000 7f1974ff9700 1 -- 172.21.15.146:0/348202666 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f196c015020 con 0x7f19780a1340 2023-10-03T10:14:59.716 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:14:59.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.719+0000 7f197e9a6700 1 -- 172.21.15.146:0/348202666 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19780a1340 msgr2=0x7f197811b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.719+0000 7f197e9a6700 1 --2- 172.21.15.146:0/348202666 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19780a1340 0x7f197811b2d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f196c0090b0 tx=0x7f196c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:59.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.719+0000 7f197e9a6700 1 -- 172.21.15.146:0/348202666 shutdown_connections 2023-10-03T10:14:59.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.719+0000 7f197e9a6700 1 --2- 172.21.15.146:0/348202666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19781304a0 0x7f197811b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.719+0000 7f197e9a6700 1 --2- 172.21.15.146:0/348202666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19780a0a30 0x7f197811ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.719+0000 7f197e9a6700 1 --2- 172.21.15.146:0/348202666 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19780a1340 0x7f197811b2d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.719+0000 7f197e9a6700 1 -- 172.21.15.146:0/348202666 >> 172.21.15.146:0/348202666 conn(0x7f19780a2980 msgr2=0x7f19781b7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.719+0000 7f197e9a6700 1 -- 172.21.15.146:0/348202666 shutdown_connections 2023-10-03T10:14:59.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.719+0000 7f197e9a6700 1 -- 172.21.15.146:0/348202666 wait complete. 2023-10-03T10:14:59.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:14:59.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.779+0000 7efd84196700 1 -- 172.21.15.146:0/2719347065 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efd7c072480 con 0x7efd7c099e20 2023-10-03T10:14:59.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.779+0000 7efd727fc700 1 -- 172.21.15.146:0/2719347065 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efd7c072480 con 0x7efd7c099e20 2023-10-03T10:14:59.779 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:59.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.781+0000 7efd84196700 1 -- 172.21.15.146:0/2719347065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd7c099e20 msgr2=0x7efd7c06ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.781+0000 7efd84196700 1 --2- 172.21.15.146:0/2719347065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd7c099e20 0x7efd7c06ffc0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7efd7800c3e0 tx=0x7efd7800c6f0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.781+0000 7efd84196700 1 -- 172.21.15.146:0/2719347065 shutdown_connections 2023-10-03T10:14:59.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.781+0000 7efd84196700 1 --2- 172.21.15.146:0/2719347065 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efd7c135f80 0x7efd7c070a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.781+0000 7efd84196700 1 --2- 172.21.15.146:0/2719347065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd7c099e20 0x7efd7c06ffc0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.781+0000 7efd84196700 1 --2- 172.21.15.146:0/2719347065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efd7c133660 0x7efd7c070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.781+0000 7efd84196700 1 -- 172.21.15.146:0/2719347065 >> 172.21.15.146:0/2719347065 conn(0x7efd7c0a2980 msgr2=0x7efd7c133a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.781+0000 7efd84196700 1 -- 172.21.15.146:0/2719347065 shutdown_connections 2023-10-03T10:14:59.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.781+0000 7efd84196700 1 -- 172.21.15.146:0/2719347065 wait complete. 2023-10-03T10:14:59.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:14:59.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.810+0000 7f49b100c700 1 -- 172.21.15.146:0/405954619 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f49ac04f2a0 con 0x7f49ac06a770 2023-10-03T10:14:59.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.810+0000 7f49937fe700 1 -- 172.21.15.146:0/405954619 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f499c02b020 con 0x7f49ac06a770 2023-10-03T10:14:59.810 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:14:59.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.812+0000 7f49b100c700 1 -- 172.21.15.146:0/405954619 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f49ac06a770 msgr2=0x7f49ac11a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.812+0000 7f49b100c700 1 --2- 172.21.15.146:0/405954619 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f49ac06a770 0x7f49ac11a040 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f499c000c00 tx=0x7f499c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:59.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.813+0000 7f49b100c700 1 -- 172.21.15.146:0/405954619 shutdown_connections 2023-10-03T10:14:59.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.813+0000 7f49b100c700 1 --2- 172.21.15.146:0/405954619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49ac131a00 0x7f49ac11aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.813+0000 7f49b100c700 1 --2- 172.21.15.146:0/405954619 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f49ac06a770 0x7f49ac11a040 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.813+0000 7f49b100c700 1 --2- 172.21.15.146:0/405954619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49ac09dec0 0x7f49ac11a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.813+0000 7f49b100c700 1 -- 172.21.15.146:0/405954619 >> 172.21.15.146:0/405954619 conn(0x7f49ac099c40 msgr2=0x7f49ac12eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.813+0000 7f49b100c700 1 -- 172.21.15.146:0/405954619 shutdown_connections 2023-10-03T10:14:59.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:14:59.813+0000 7f49b100c700 1 -- 172.21.15.146:0/405954619 wait complete. 2023-10-03T10:14:59.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:00.683 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:00.732 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:00.794 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:00.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.814+0000 7f87cc25b700 1 Processor -- start 2023-10-03T10:15:00.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.815+0000 7f87cc25b700 1 -- start start 2023-10-03T10:15:00.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.815+0000 7f87cc25b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87c4134140 0x7f87c4138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.815+0000 7f87cc25b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f87c4134570 0x7f87c413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.815+0000 7f87cc25b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c409b110 con 0x7f87c409ad40 2023-10-03T10:15:00.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.815+0000 7f87cc25b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c40a3b60 con 0x7f87c4134570 2023-10-03T10:15:00.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.815+0000 7f87cc25b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87c40a1a80 con 0x7f87c4134140 2023-10-03T10:15:00.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.815+0000 7f87c9ff7700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f87c409ad40 0x7f87c4133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38292/0 (socket says 172.21.15.146:38292) 2023-10-03T10:15:00.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.815+0000 7f87c9ff7700 1 -- 172.21.15.146:0/4001522779 learned_addr learned my addr 172.21.15.146:0/4001522779 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:00.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.815+0000 7f87ca7f8700 1 --2- 172.21.15.146:0/4001522779 >> v2:172.21.15.146:3300/0 conn(0x7f87c4134570 0x7f87c413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.815+0000 7f87c97f6700 1 --2- 172.21.15.146:0/4001522779 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87c4134140 0x7f87c4138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.816+0000 7f87c8ff5700 1 -- 172.21.15.146:0/4001522779 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272472021 0 0) 0x7f87c409b110 con 0x7f87c409ad40 2023-10-03T10:15:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.816+0000 7f87c97f6700 1 -- 172.21.15.146:0/4001522779 >> v2:172.21.15.146:3300/0 conn(0x7f87c4134570 msgr2=0x7f87c413b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.816+0000 7f87c97f6700 1 --2- 172.21.15.146:0/4001522779 >> v2:172.21.15.146:3300/0 conn(0x7f87c4134570 0x7f87c413b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.816+0000 7f87c97f6700 1 -- 172.21.15.146:0/4001522779 >> v1:172.21.15.146:6789/0 conn(0x7f87c409ad40 legacy=0x7f87c4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.816+0000 7f87c97f6700 1 -- 172.21.15.146:0/4001522779 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c40a2fa0 con 0x7f87c4134140 2023-10-03T10:15:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.816+0000 7f87c97f6700 1 --2- 172.21.15.146:0/4001522779 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87c4134140 0x7f87c4138e80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009840 tx=0x7f87b4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=295f3683ae6bba3f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.816+0000 7f87c8ff5700 1 -- 172.21.15.146:0/4001522779 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b4011830 con 0x7f87c4134140 2023-10-03T10:15:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.816+0000 7f87c8ff5700 1 -- 172.21.15.146:0/4001522779 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b4011990 con 0x7f87c4134140 2023-10-03T10:15:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.816+0000 7f87c8ff5700 1 -- 172.21.15.146:0/4001522779 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b4011d20 con 0x7f87c4134140 2023-10-03T10:15:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.817+0000 7f87cc25b700 1 -- 172.21.15.146:0/4001522779 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87c4134140 msgr2=0x7f87c4138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.817+0000 7f87cc25b700 1 --2- 172.21.15.146:0/4001522779 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87c4134140 0x7f87c4138e80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009840 tx=0x7f87b4009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.817+0000 7f87cc25b700 1 -- 172.21.15.146:0/4001522779 shutdown_connections 2023-10-03T10:15:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.817+0000 7f87cc25b700 1 --2- 172.21.15.146:0/4001522779 >> v2:172.21.15.146:3300/0 conn(0x7f87c4134570 0x7f87c413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.817+0000 7f87cc25b700 1 --2- 172.21.15.146:0/4001522779 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87c4134140 0x7f87c4138e80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.817+0000 7f87cc25b700 1 -- 172.21.15.146:0/4001522779 >> 172.21.15.146:0/4001522779 conn(0x7f87c4099c40 msgr2=0x7f87c406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.817+0000 7f87cc25b700 1 -- 172.21.15.146:0/4001522779 shutdown_connections 2023-10-03T10:15:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.817+0000 7f87cc25b700 1 -- 172.21.15.146:0/4001522779 wait complete. 2023-10-03T10:15:00.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.818+0000 7f87cc25b700 1 Processor -- start 2023-10-03T10:15:00.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.818+0000 7f87cc25b700 1 -- start start 2023-10-03T10:15:00.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.819+0000 7f87cc25b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87c409ad40 0x7f87c4139400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.819+0000 7f87cc25b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87c4134140 0x7f87c4139940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.819+0000 7f87cc25b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87c4134570 0x7f87c4139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.819+0000 7f87cc25b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c411e860 con 0x7f87c4134140 2023-10-03T10:15:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.819+0000 7f87cc25b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c411cf00 con 0x7f87c4134570 2023-10-03T10:15:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.819+0000 7f87cc25b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87c411ea90 con 0x7f87c409ad40 2023-10-03T10:15:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.819+0000 7f87ca7f8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87c4134570 0x7f87c4139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.819+0000 7f87ca7f8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87c4134570 0x7f87c4139e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43414/0 (socket says 172.21.15.146:43414) 2023-10-03T10:15:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.819+0000 7f87ca7f8700 1 -- 172.21.15.146:0/827642766 learned_addr learned my addr 172.21.15.146:0/827642766 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.819+0000 7f87c9ff7700 1 --2- 172.21.15.146:0/827642766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87c409ad40 0x7f87c4139400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.819+0000 7f87c97f6700 1 --2- 172.21.15.146:0/827642766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87c4134140 0x7f87c4139940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.819+0000 7f87c9ff7700 1 -- 172.21.15.146:0/827642766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87c4134570 msgr2=0x7f87c4139e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.819+0000 7f87c9ff7700 1 --2- 172.21.15.146:0/827642766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87c4134570 0x7f87c4139e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.819+0000 7f87c9ff7700 1 -- 172.21.15.146:0/827642766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87c4134140 msgr2=0x7f87c4139940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.819+0000 7f87c9ff7700 1 --2- 172.21.15.146:0/827642766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87c4134140 0x7f87c4139940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.819+0000 7f87c9ff7700 1 -- 172.21.15.146:0/827642766 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b40094a0 con 0x7f87c409ad40 2023-10-03T10:15:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.819+0000 7f87ca7f8700 1 --2- 172.21.15.146:0/827642766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87c4134570 0x7f87c4139e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.820+0000 7f87c9ff7700 1 --2- 172.21.15.146:0/827642766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87c409ad40 0x7f87c4139400 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f87c000c3c0 tx=0x7f87c000c6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.820+0000 7f87ba7fc700 1 -- 172.21.15.146:0/827642766 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c0004a70 con 0x7f87c409ad40 2023-10-03T10:15:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.820+0000 7f87ba7fc700 1 -- 172.21.15.146:0/827642766 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c0004bd0 con 0x7f87c409ad40 2023-10-03T10:15:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.820+0000 7f87cc25b700 1 -- 172.21.15.146:0/827642766 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c40a43e0 con 0x7f87c409ad40 2023-10-03T10:15:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.820+0000 7f87ba7fc700 1 -- 172.21.15.146:0/827642766 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c00070d0 con 0x7f87c409ad40 2023-10-03T10:15:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.820+0000 7f87cc25b700 1 -- 172.21.15.146:0/827642766 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c411ed70 con 0x7f87c409ad40 2023-10-03T10:15:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.821+0000 7f87ba7fc700 1 -- 172.21.15.146:0/827642766 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f87c0007230 con 0x7f87c409ad40 2023-10-03T10:15:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.821+0000 7f87ba7fc700 1 -- 172.21.15.146:0/827642766 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f87c003f1d0 con 0x7f87c409ad40 2023-10-03T10:15:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.821+0000 7f87cc25b700 1 -- 172.21.15.146:0/827642766 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c41361c0 con 0x7f87c409ad40 2023-10-03T10:15:00.825 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:00.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.830+0000 7f87ba7fc700 1 -- 172.21.15.146:0/827642766 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f87c00074e0 con 0x7f87c409ad40 2023-10-03T10:15:00.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.872+0000 7ff5dc191700 1 Processor -- start 2023-10-03T10:15:00.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.873+0000 7ff5dc191700 1 -- start start 2023-10-03T10:15:00.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.873+0000 7ff5dc191700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff5d4133ad0 0x7ff5d4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.873+0000 7ff5dc191700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5d41300a0 0x7ff5d41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.873+0000 7ff5dc191700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5d41309f0 0x7ff5d413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.873+0000 7ff5dc191700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d406b2d0 con 0x7ff5d4133ad0 2023-10-03T10:15:00.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.874+0000 7ff5dc191700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d4133610 con 0x7ff5d41309f0 2023-10-03T10:15:00.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.874+0000 7ff5dc191700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d409a500 con 0x7ff5d41300a0 2023-10-03T10:15:00.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.874+0000 7ff5d972c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5d41300a0 0x7ff5d41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.874+0000 7ff5d972c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5d41300a0 0x7ff5d41304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59640/0 (socket says 172.21.15.146:59640) 2023-10-03T10:15:00.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.874+0000 7ff5d972c700 1 -- 172.21.15.146:0/3438395439 learned_addr learned my addr 172.21.15.146:0/3438395439 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:00.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.874+0000 7ff5da72e700 1 --2- 172.21.15.146:0/3438395439 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5d41309f0 0x7ff5d413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.874+0000 7ff5d9f2d700 1 --2- 172.21.15.146:0/3438395439 >> v2:172.21.15.146:3300/0 conn(0x7ff5d4133ad0 0x7ff5d4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.874+0000 7ff5d972c700 1 -- 172.21.15.146:0/3438395439 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5d41309f0 msgr2=0x7ff5d413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:00.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.874+0000 7ff5d972c700 1 --2- 172.21.15.146:0/3438395439 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5d41309f0 0x7ff5d413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.874+0000 7ff5d972c700 1 -- 172.21.15.146:0/3438395439 >> v2:172.21.15.146:3300/0 conn(0x7ff5d4133ad0 msgr2=0x7ff5d4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:00.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.874+0000 7ff5d972c700 1 --2- 172.21.15.146:0/3438395439 >> v2:172.21.15.146:3300/0 conn(0x7ff5d4133ad0 0x7ff5d4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.874+0000 7ff5d972c700 1 -- 172.21.15.146:0/3438395439 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d41338b0 con 0x7ff5d41300a0 2023-10-03T10:15:00.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.874+0000 7ff5d972c700 1 --2- 172.21.15.146:0/3438395439 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5d41300a0 0x7ff5d41304b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40098f0 tx=0x7ff5c4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a0ca6d221065d22 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.874+0000 7ff5d8f2b700 1 -- 172.21.15.146:0/3438395439 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4011830 con 0x7ff5d41300a0 2023-10-03T10:15:00.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.875+0000 7ff5d8f2b700 1 -- 172.21.15.146:0/3438395439 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c4011990 con 0x7ff5d41300a0 2023-10-03T10:15:00.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.875+0000 7ff5d8f2b700 1 -- 172.21.15.146:0/3438395439 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4011d20 con 0x7ff5d41300a0 2023-10-03T10:15:00.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.875+0000 7ff5dc191700 1 -- 172.21.15.146:0/3438395439 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5d41300a0 msgr2=0x7ff5d41304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.875+0000 7ff5dc191700 1 --2- 172.21.15.146:0/3438395439 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5d41300a0 0x7ff5d41304b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40098f0 tx=0x7ff5c4009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:00.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.875+0000 7ff5dc191700 1 -- 172.21.15.146:0/3438395439 shutdown_connections 2023-10-03T10:15:00.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.875+0000 7ff5dc191700 1 --2- 172.21.15.146:0/3438395439 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5d41309f0 0x7ff5d413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.875+0000 7ff5dc191700 1 --2- 172.21.15.146:0/3438395439 >> v2:172.21.15.146:3300/0 conn(0x7ff5d4133ad0 0x7ff5d4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.875+0000 7ff5dc191700 1 --2- 172.21.15.146:0/3438395439 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5d41300a0 0x7ff5d41304b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.875+0000 7ff5dc191700 1 -- 172.21.15.146:0/3438395439 >> 172.21.15.146:0/3438395439 conn(0x7ff5d4099c40 msgr2=0x7ff5d40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.875+0000 7ff5dc191700 1 -- 172.21.15.146:0/3438395439 shutdown_connections 2023-10-03T10:15:00.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.875+0000 7ff5dc191700 1 -- 172.21.15.146:0/3438395439 wait complete. 2023-10-03T10:15:00.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.877+0000 7ff5dc191700 1 Processor -- start 2023-10-03T10:15:00.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.877+0000 7ff5dc191700 1 -- start start 2023-10-03T10:15:00.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.877+0000 7ff5dc191700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5d41300a0 0x7ff5d411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.878+0000 7ff5dc191700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5d41309f0 0x7ff5d411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.878+0000 7ff5dc191700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5d4133ad0 0x7ff5d411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.878+0000 7ff5dc191700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d411fcc0 con 0x7ff5d41309f0 2023-10-03T10:15:00.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.878+0000 7ff5dc191700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d4072020 con 0x7ff5d41300a0 2023-10-03T10:15:00.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.878+0000 7ff5dc191700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40a3370 con 0x7ff5d4133ad0 2023-10-03T10:15:00.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.878+0000 7ff5da72e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5d4133ad0 0x7ff5d411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.878+0000 7ff5da72e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5d4133ad0 0x7ff5d411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59656/0 (socket says 172.21.15.146:59656) 2023-10-03T10:15:00.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.878+0000 7ff5da72e700 1 -- 172.21.15.146:0/542694360 learned_addr learned my addr 172.21.15.146:0/542694360 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.878+0000 7ff5d9f2d700 1 --2- 172.21.15.146:0/542694360 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5d41300a0 0x7ff5d411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.878+0000 7ff5d972c700 1 --2- 172.21.15.146:0/542694360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5d41309f0 0x7ff5d411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.878+0000 7ff5da72e700 1 -- 172.21.15.146:0/542694360 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5d41300a0 msgr2=0x7ff5d411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.878+0000 7ff5da72e700 1 --2- 172.21.15.146:0/542694360 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5d41300a0 0x7ff5d411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.878+0000 7ff5da72e700 1 -- 172.21.15.146:0/542694360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5d41309f0 msgr2=0x7ff5d411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.878+0000 7ff5da72e700 1 --2- 172.21.15.146:0/542694360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5d41309f0 0x7ff5d411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.878+0000 7ff5da72e700 1 -- 172.21.15.146:0/542694360 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c4009550 con 0x7ff5d4133ad0 2023-10-03T10:15:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.878+0000 7ff5da72e700 1 --2- 172.21.15.146:0/542694360 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5d4133ad0 0x7ff5d411e4c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc007e40 tx=0x7ff5cc00e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.878+0000 7ff5ca7fc700 1 -- 172.21.15.146:0/542694360 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc00ed30 con 0x7ff5d4133ad0 2023-10-03T10:15:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.879+0000 7ff5ca7fc700 1 -- 172.21.15.146:0/542694360 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc00ee90 con 0x7ff5d4133ad0 2023-10-03T10:15:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.879+0000 7ff5dc191700 1 -- 172.21.15.146:0/542694360 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d4072490 con 0x7ff5d4133ad0 2023-10-03T10:15:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.879+0000 7ff5ca7fc700 1 -- 172.21.15.146:0/542694360 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc014660 con 0x7ff5d4133ad0 2023-10-03T10:15:00.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.879+0000 7ff5dc191700 1 -- 172.21.15.146:0/542694360 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d4071490 con 0x7ff5d4133ad0 2023-10-03T10:15:00.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.880+0000 7ff5dc191700 1 -- 172.21.15.146:0/542694360 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d404f2a0 con 0x7ff5d4133ad0 2023-10-03T10:15:00.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.880+0000 7ff5ca7fc700 1 -- 172.21.15.146:0/542694360 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff5cc0147c0 con 0x7ff5d4133ad0 2023-10-03T10:15:00.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.880+0000 7ff5ca7fc700 1 -- 172.21.15.146:0/542694360 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff5cc03fdb0 con 0x7ff5d4133ad0 2023-10-03T10:15:00.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.884+0000 7ff5ca7fc700 1 -- 172.21.15.146:0/542694360 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff5cc01bce0 con 0x7ff5d4133ad0 2023-10-03T10:15:00.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.926+0000 7f5ef6be5700 1 Processor -- start 2023-10-03T10:15:00.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.926+0000 7f5ef6be5700 1 -- start start 2023-10-03T10:15:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.927+0000 7f5ef6be5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5ef006a770 0x7f5ef006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.927+0000 7f5ef6be5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ef0131ec0 0x7f5ef0139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.927+0000 7f5ef6be5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef009da80 con 0x7f5ef006b080 2023-10-03T10:15:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.927+0000 7f5ef6be5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef009dce0 con 0x7f5ef006a770 2023-10-03T10:15:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.927+0000 7f5ef6be5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef009eb20 con 0x7f5ef0131ec0 2023-10-03T10:15:00.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.927+0000 7f5ef5182700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ef0131ec0 0x7f5ef0139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.927+0000 7f5ef5182700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ef0131ec0 0x7f5ef0139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43450/0 (socket says 172.21.15.146:43450) 2023-10-03T10:15:00.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.927+0000 7f5ef5182700 1 -- 172.21.15.146:0/3294013394 learned_addr learned my addr 172.21.15.146:0/3294013394 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:00.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.927+0000 7f5ef4981700 1 --2- 172.21.15.146:0/3294013394 >> v2:172.21.15.146:3300/0 conn(0x7f5ef006a770 0x7f5ef006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.927+0000 7f5ef5182700 1 -- 172.21.15.146:0/3294013394 >> v2:172.21.15.146:3300/0 conn(0x7f5ef006a770 msgr2=0x7f5ef006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:00.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.927+0000 7f5ef5182700 1 --2- 172.21.15.146:0/3294013394 >> v2:172.21.15.146:3300/0 conn(0x7f5ef006a770 0x7f5ef006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.927+0000 7f5ef5182700 1 -- 172.21.15.146:0/3294013394 >> v1:172.21.15.146:6789/0 conn(0x7f5ef006b080 legacy=0x7f5ef01317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.927+0000 7f5ef5182700 1 -- 172.21.15.146:0/3294013394 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef009d860 con 0x7f5ef0131ec0 2023-10-03T10:15:00.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.928+0000 7f5ef5182700 1 --2- 172.21.15.146:0/3294013394 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ef0131ec0 0x7f5ef0139c20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009e50 tx=0x7f5ee800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc6a1e55443553ac server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.928+0000 7f5eef7fe700 1 -- 172.21.15.146:0/3294013394 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee800e070 con 0x7f5ef0131ec0 2023-10-03T10:15:00.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.928+0000 7f5eef7fe700 1 -- 172.21.15.146:0/3294013394 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee800b910 con 0x7f5ef0131ec0 2023-10-03T10:15:00.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.928+0000 7f5eef7fe700 1 -- 172.21.15.146:0/3294013394 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee800bcc0 con 0x7f5ef0131ec0 2023-10-03T10:15:00.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.928+0000 7f5ef6be5700 1 -- 172.21.15.146:0/3294013394 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ef0131ec0 msgr2=0x7f5ef0139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.928+0000 7f5ef6be5700 1 --2- 172.21.15.146:0/3294013394 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ef0131ec0 0x7f5ef0139c20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009e50 tx=0x7f5ee800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:00.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.928+0000 7f5ef6be5700 1 -- 172.21.15.146:0/3294013394 shutdown_connections 2023-10-03T10:15:00.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.928+0000 7f5ef6be5700 1 --2- 172.21.15.146:0/3294013394 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ef0131ec0 0x7f5ef0139c20 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.928+0000 7f5ef6be5700 1 --2- 172.21.15.146:0/3294013394 >> v2:172.21.15.146:3300/0 conn(0x7f5ef006a770 0x7f5ef006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.928+0000 7f5ef6be5700 1 -- 172.21.15.146:0/3294013394 >> 172.21.15.146:0/3294013394 conn(0x7f5ef0099c40 msgr2=0x7f5ef00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.929+0000 7f5ef6be5700 1 -- 172.21.15.146:0/3294013394 shutdown_connections 2023-10-03T10:15:00.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.929+0000 7f5ef6be5700 1 -- 172.21.15.146:0/3294013394 wait complete. 2023-10-03T10:15:00.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.929+0000 7f5ef6be5700 1 Processor -- start 2023-10-03T10:15:00.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.930+0000 7f5ef6be5700 1 -- start start 2023-10-03T10:15:00.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.930+0000 7f5ef6be5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ef006a770 0x7f5ef01c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.930+0000 7f5ef6be5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ef006b080 0x7f5ef01c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.930+0000 7f5ef6be5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ef0131ec0 0x7f5ef0137040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.930+0000 7f5ef6be5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef01c9180 con 0x7f5ef006b080 2023-10-03T10:15:00.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.930+0000 7f5ef6be5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef01316c0 con 0x7f5ef006a770 2023-10-03T10:15:00.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.930+0000 7f5ef6be5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef0119af0 con 0x7f5ef0131ec0 2023-10-03T10:15:00.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.930+0000 7f5ef4981700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ef006a770 0x7f5ef01c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.930+0000 7f5ef4981700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ef006a770 0x7f5ef01c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43452/0 (socket says 172.21.15.146:43452) 2023-10-03T10:15:00.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.930+0000 7f5ef4981700 1 -- 172.21.15.146:0/3433585138 learned_addr learned my addr 172.21.15.146:0/3433585138 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:00.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.930+0000 7f5ef5182700 1 --2- 172.21.15.146:0/3433585138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ef0131ec0 0x7f5ef0137040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.930+0000 7f5eeffff700 1 --2- 172.21.15.146:0/3433585138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ef006b080 0x7f5ef01c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.931+0000 7f5eeffff700 1 -- 172.21.15.146:0/3433585138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ef0131ec0 msgr2=0x7f5ef0137040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.931+0000 7f5eeffff700 1 --2- 172.21.15.146:0/3433585138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ef0131ec0 0x7f5ef0137040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.931+0000 7f5eeffff700 1 -- 172.21.15.146:0/3433585138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ef006a770 msgr2=0x7f5ef01c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.931+0000 7f5eeffff700 1 --2- 172.21.15.146:0/3433585138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ef006a770 0x7f5ef01c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.931+0000 7f5eeffff700 1 -- 172.21.15.146:0/3433585138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee8009b30 con 0x7f5ef006b080 2023-10-03T10:15:00.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.931+0000 7f5eeffff700 1 --2- 172.21.15.146:0/3433585138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ef006b080 0x7f5ef01c8c40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00c450 tx=0x7f5edc00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.931+0000 7f5eed7fa700 1 -- 172.21.15.146:0/3433585138 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0052d0 con 0x7f5ef006b080 2023-10-03T10:15:00.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.931+0000 7f5eed7fa700 1 -- 172.21.15.146:0/3433585138 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5edc005430 con 0x7f5ef006b080 2023-10-03T10:15:00.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.931+0000 7f5eed7fa700 1 -- 172.21.15.146:0/3433585138 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0038c0 con 0x7f5ef006b080 2023-10-03T10:15:00.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.932+0000 7f5ef6be5700 1 -- 172.21.15.146:0/3433585138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef0071e10 con 0x7f5ef006b080 2023-10-03T10:15:00.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.932+0000 7f5ef6be5700 1 -- 172.21.15.146:0/3433585138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef0139460 con 0x7f5ef006b080 2023-10-03T10:15:00.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.933+0000 7f5eed7fa700 1 -- 172.21.15.146:0/3433585138 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5edc003a20 con 0x7f5ef006b080 2023-10-03T10:15:00.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.933+0000 7f5ef6be5700 1 -- 172.21.15.146:0/3433585138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef004f2a0 con 0x7f5ef006b080 2023-10-03T10:15:00.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.933+0000 7f5eed7fa700 1 -- 172.21.15.146:0/3433585138 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5edc03e9c0 con 0x7f5ef006b080 2023-10-03T10:15:00.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.937+0000 7f5eed7fa700 1 -- 172.21.15.146:0/3433585138 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5edc011590 con 0x7f5ef006b080 2023-10-03T10:15:00.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.959+0000 7f72f031a700 1 Processor -- start 2023-10-03T10:15:00.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.959+0000 7f72f031a700 1 -- start start 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.960+0000 7f72f031a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72e8136960 0x7f72e8138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.960+0000 7f72f031a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f72e8139280 0x7f72e813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.960+0000 7f72f031a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e806b2d0 con 0x7f72e8133ad0 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.960+0000 7f72f031a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e81345b0 con 0x7f72e8139280 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.960+0000 7f72f031a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e8133610 con 0x7f72e8136960 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.960+0000 7f72ed8b5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72e8136960 0x7f72e8138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.960+0000 7f72ee8b7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f72e8139280 0x7f72e813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.960+0000 7f72ed8b5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72e8136960 0x7f72e8138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43464/0 (socket says 172.21.15.146:43464) 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.960+0000 7f72ee8b7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f72e8139280 0x7f72e813b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34264/0 (socket says 172.21.15.146:34264) 2023-10-03T10:15:00.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.960+0000 7f72ed8b5700 1 -- 172.21.15.146:0/3906974359 learned_addr learned my addr 172.21.15.146:0/3906974359 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:00.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.961+0000 7f72ed8b5700 1 -- 172.21.15.146:0/3906974359 >> v2:172.21.15.146:3300/0 conn(0x7f72e8139280 msgr2=0x7f72e813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:00.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.961+0000 7f72ed8b5700 1 --2- 172.21.15.146:0/3906974359 >> v2:172.21.15.146:3300/0 conn(0x7f72e8139280 0x7f72e813b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.961+0000 7f72ed8b5700 1 -- 172.21.15.146:0/3906974359 >> v1:172.21.15.146:6789/0 conn(0x7f72e8133ad0 legacy=0x7f72e8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.961+0000 7f72ed8b5700 1 -- 172.21.15.146:0/3906974359 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e809a500 con 0x7f72e8136960 2023-10-03T10:15:00.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.961+0000 7f72ed8b5700 1 --2- 172.21.15.146:0/3906974359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72e8136960 0x7f72e8138d40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009920 tx=0x7f72d8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9d1fcb88b083237 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.961+0000 7f72ed0b4700 1 -- 172.21.15.146:0/3906974359 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d8011830 con 0x7f72e8136960 2023-10-03T10:15:00.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.961+0000 7f72ed0b4700 1 -- 172.21.15.146:0/3906974359 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d8011990 con 0x7f72e8136960 2023-10-03T10:15:00.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.961+0000 7f72ed0b4700 1 -- 172.21.15.146:0/3906974359 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d8011d20 con 0x7f72e8136960 2023-10-03T10:15:00.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.962+0000 7f72f031a700 1 -- 172.21.15.146:0/3906974359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72e8136960 msgr2=0x7f72e8138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.962+0000 7f72f031a700 1 --2- 172.21.15.146:0/3906974359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72e8136960 0x7f72e8138d40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009920 tx=0x7f72d8009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:00.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.962+0000 7f72f031a700 1 -- 172.21.15.146:0/3906974359 shutdown_connections 2023-10-03T10:15:00.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.962+0000 7f72f031a700 1 --2- 172.21.15.146:0/3906974359 >> v2:172.21.15.146:3300/0 conn(0x7f72e8139280 0x7f72e813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.962+0000 7f72f031a700 1 --2- 172.21.15.146:0/3906974359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72e8136960 0x7f72e8138d40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.962+0000 7f72f031a700 1 -- 172.21.15.146:0/3906974359 >> 172.21.15.146:0/3906974359 conn(0x7f72e8099c40 msgr2=0x7f72e80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.962+0000 7f72f031a700 1 -- 172.21.15.146:0/3906974359 shutdown_connections 2023-10-03T10:15:00.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.962+0000 7f72f031a700 1 -- 172.21.15.146:0/3906974359 wait complete. 2023-10-03T10:15:00.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.963+0000 7f72f031a700 1 Processor -- start 2023-10-03T10:15:00.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.963+0000 7f72f031a700 1 -- start start 2023-10-03T10:15:00.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.964+0000 7f72f031a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72e8133ad0 0x7f72e8071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.964+0000 7f72f031a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72e8136960 0x7f72e8071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.964+0000 7f72f031a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72e8139280 0x7f72e81c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.964+0000 7f72f031a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e806f8e0 con 0x7f72e8139280 2023-10-03T10:15:00.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.964+0000 7f72f031a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e809f390 con 0x7f72e8136960 2023-10-03T10:15:00.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.964+0000 7f72f031a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72e8070310 con 0x7f72e8133ad0 2023-10-03T10:15:00.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.964+0000 7f72ee0b6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72e8133ad0 0x7f72e8071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.964+0000 7f72ee0b6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72e8133ad0 0x7f72e8071ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59666/0 (socket says 172.21.15.146:59666) 2023-10-03T10:15:00.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.964+0000 7f72ee0b6700 1 -- 172.21.15.146:0/1683359167 learned_addr learned my addr 172.21.15.146:0/1683359167 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:00.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.964+0000 7f72ee8b7700 1 --2- 172.21.15.146:0/1683359167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72e8139280 0x7f72e81c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.964+0000 7f72ed8b5700 1 --2- 172.21.15.146:0/1683359167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72e8136960 0x7f72e8071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.964+0000 7f72ee0b6700 1 -- 172.21.15.146:0/1683359167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72e8136960 msgr2=0x7f72e8071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.964+0000 7f72ee0b6700 1 --2- 172.21.15.146:0/1683359167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72e8136960 0x7f72e8071ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.964+0000 7f72ee0b6700 1 -- 172.21.15.146:0/1683359167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72e8139280 msgr2=0x7f72e81c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.964+0000 7f72ee0b6700 1 --2- 172.21.15.146:0/1683359167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72e8139280 0x7f72e81c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.964+0000 7f72ee0b6700 1 -- 172.21.15.146:0/1683359167 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d8009550 con 0x7f72e8133ad0 2023-10-03T10:15:00.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.964+0000 7f72ee8b7700 1 --2- 172.21.15.146:0/1683359167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72e8139280 0x7f72e81c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:00.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.964+0000 7f72ed8b5700 1 --2- 172.21.15.146:0/1683359167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72e8136960 0x7f72e8071ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:00.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.965+0000 7f72ee0b6700 1 --2- 172.21.15.146:0/1683359167 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72e8133ad0 0x7f72e8071ab0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f72e400c480 tx=0x7f72e400c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.965+0000 7f72deffd700 1 -- 172.21.15.146:0/1683359167 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e40052d0 con 0x7f72e8133ad0 2023-10-03T10:15:00.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.965+0000 7f72deffd700 1 -- 172.21.15.146:0/1683359167 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e4005430 con 0x7f72e8133ad0 2023-10-03T10:15:00.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.965+0000 7f72f031a700 1 -- 172.21.15.146:0/1683359167 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e8070920 con 0x7f72e8133ad0 2023-10-03T10:15:00.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.965+0000 7f72deffd700 1 -- 172.21.15.146:0/1683359167 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e40038c0 con 0x7f72e8133ad0 2023-10-03T10:15:00.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.965+0000 7f72f031a700 1 -- 172.21.15.146:0/1683359167 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e806e9a0 con 0x7f72e8133ad0 2023-10-03T10:15:00.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.966+0000 7f72f031a700 1 -- 172.21.15.146:0/1683359167 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e809ad70 con 0x7f72e8133ad0 2023-10-03T10:15:00.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.966+0000 7f72deffd700 1 -- 172.21.15.146:0/1683359167 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f72e4003a20 con 0x7f72e8133ad0 2023-10-03T10:15:00.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.966+0000 7f72deffd700 1 -- 172.21.15.146:0/1683359167 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f72e403ec10 con 0x7f72e8133ad0 2023-10-03T10:15:00.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:00.971+0000 7f72deffd700 1 -- 172.21.15.146:0/1683359167 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72e4018260 con 0x7f72e8133ad0 2023-10-03T10:15:01.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.037+0000 7f87cc25b700 1 -- 172.21.15.146:0/827642766 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f87c404f2a0 con 0x7f87c409ad40 2023-10-03T10:15:01.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.037+0000 7f87ba7fc700 1 -- 172.21.15.146:0/827642766 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f87c001b340 con 0x7f87c409ad40 2023-10-03T10:15:01.037 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:01.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.040+0000 7f87cc25b700 1 -- 172.21.15.146:0/827642766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87c409ad40 msgr2=0x7f87c4139400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.040+0000 7f87cc25b700 1 --2- 172.21.15.146:0/827642766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87c409ad40 0x7f87c4139400 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f87c000c3c0 tx=0x7f87c000c6d0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.040+0000 7f87cc25b700 1 -- 172.21.15.146:0/827642766 shutdown_connections 2023-10-03T10:15:01.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.040+0000 7f87cc25b700 1 --2- 172.21.15.146:0/827642766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87c4134570 0x7f87c4139e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.040+0000 7f87cc25b700 1 --2- 172.21.15.146:0/827642766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87c409ad40 0x7f87c4139400 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.040+0000 7f87cc25b700 1 --2- 172.21.15.146:0/827642766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87c4134140 0x7f87c4139940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.040+0000 7f87cc25b700 1 -- 172.21.15.146:0/827642766 >> 172.21.15.146:0/827642766 conn(0x7f87c4099c40 msgr2=0x7f87c413b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.040+0000 7f87cc25b700 1 -- 172.21.15.146:0/827642766 shutdown_connections 2023-10-03T10:15:01.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.040+0000 7f87cc25b700 1 -- 172.21.15.146:0/827642766 wait complete. 2023-10-03T10:15:01.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:01.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.083+0000 7ff5dc191700 1 -- 172.21.15.146:0/542694360 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff5d406c3b0 con 0x7ff5d4133ad0 2023-10-03T10:15:01.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.083+0000 7ff5ca7fc700 1 -- 172.21.15.146:0/542694360 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff5cc01bb00 con 0x7ff5d4133ad0 2023-10-03T10:15:01.083 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:01.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.085+0000 7ff5dc191700 1 -- 172.21.15.146:0/542694360 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5d4133ad0 msgr2=0x7ff5d411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.085+0000 7ff5dc191700 1 --2- 172.21.15.146:0/542694360 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5d4133ad0 0x7ff5d411e4c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc007e40 tx=0x7ff5cc00e3c0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.085+0000 7ff5dc191700 1 -- 172.21.15.146:0/542694360 shutdown_connections 2023-10-03T10:15:01.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.085+0000 7ff5dc191700 1 --2- 172.21.15.146:0/542694360 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff5d4133ad0 0x7ff5d411e4c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.086+0000 7ff5dc191700 1 --2- 172.21.15.146:0/542694360 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5d41300a0 0x7ff5d411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.086+0000 7ff5dc191700 1 --2- 172.21.15.146:0/542694360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5d41309f0 0x7ff5d411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.086+0000 7ff5dc191700 1 -- 172.21.15.146:0/542694360 >> 172.21.15.146:0/542694360 conn(0x7ff5d4099c40 msgr2=0x7ff5d4132050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.086+0000 7ff5dc191700 1 -- 172.21.15.146:0/542694360 shutdown_connections 2023-10-03T10:15:01.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.086+0000 7ff5dc191700 1 -- 172.21.15.146:0/542694360 wait complete. 2023-10-03T10:15:01.099 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:01.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.136+0000 7f5ef6be5700 1 -- 172.21.15.146:0/3433585138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5ef0138dd0 con 0x7f5ef006b080 2023-10-03T10:15:01.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.136+0000 7f5eed7fa700 1 -- 172.21.15.146:0/3433585138 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5edc017020 con 0x7f5ef006b080 2023-10-03T10:15:01.136 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:01.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.138+0000 7f5ef6be5700 1 -- 172.21.15.146:0/3433585138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ef006b080 msgr2=0x7f5ef01c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.138+0000 7f5ef6be5700 1 --2- 172.21.15.146:0/3433585138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ef006b080 0x7f5ef01c8c40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00c450 tx=0x7f5edc00c760 comp rx=0 tx=0).stop 2023-10-03T10:15:01.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.138+0000 7f5ef6be5700 1 -- 172.21.15.146:0/3433585138 shutdown_connections 2023-10-03T10:15:01.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.138+0000 7f5ef6be5700 1 --2- 172.21.15.146:0/3433585138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ef0131ec0 0x7f5ef0137040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.138+0000 7f5ef6be5700 1 --2- 172.21.15.146:0/3433585138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ef006a770 0x7f5ef01c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.138+0000 7f5ef6be5700 1 --2- 172.21.15.146:0/3433585138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ef006b080 0x7f5ef01c8c40 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.138+0000 7f5ef6be5700 1 -- 172.21.15.146:0/3433585138 >> 172.21.15.146:0/3433585138 conn(0x7f5ef0099c40 msgr2=0x7f5ef009a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.139+0000 7f5ef6be5700 1 -- 172.21.15.146:0/3433585138 shutdown_connections 2023-10-03T10:15:01.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.139+0000 7f5ef6be5700 1 -- 172.21.15.146:0/3433585138 wait complete. 2023-10-03T10:15:01.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:01.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.169+0000 7f72f031a700 1 -- 172.21.15.146:0/1683359167 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f72e804f2a0 con 0x7f72e8133ad0 2023-10-03T10:15:01.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.169+0000 7f72deffd700 1 -- 172.21.15.146:0/1683359167 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f72e4017070 con 0x7f72e8133ad0 2023-10-03T10:15:01.169 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:01.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.171+0000 7f72f031a700 1 -- 172.21.15.146:0/1683359167 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72e8133ad0 msgr2=0x7f72e8071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.171+0000 7f72f031a700 1 --2- 172.21.15.146:0/1683359167 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72e8133ad0 0x7f72e8071ab0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f72e400c480 tx=0x7f72e400c840 comp rx=0 tx=0).stop 2023-10-03T10:15:01.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.171+0000 7f72f031a700 1 -- 172.21.15.146:0/1683359167 shutdown_connections 2023-10-03T10:15:01.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.171+0000 7f72f031a700 1 --2- 172.21.15.146:0/1683359167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72e8139280 0x7f72e81c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.171+0000 7f72f031a700 1 --2- 172.21.15.146:0/1683359167 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72e8133ad0 0x7f72e8071ab0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.171+0000 7f72f031a700 1 --2- 172.21.15.146:0/1683359167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72e8136960 0x7f72e8071ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.171+0000 7f72f031a700 1 -- 172.21.15.146:0/1683359167 >> 172.21.15.146:0/1683359167 conn(0x7f72e8099c40 msgr2=0x7f72e81371c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.171+0000 7f72f031a700 1 -- 172.21.15.146:0/1683359167 shutdown_connections 2023-10-03T10:15:01.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:01.171+0000 7f72f031a700 1 -- 172.21.15.146:0/1683359167 wait complete. 2023-10-03T10:15:01.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:02.053 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:02.100 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:02.151 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:02.183 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:02.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.189+0000 7f4c525d1700 1 Processor -- start 2023-10-03T10:15:02.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.189+0000 7f4c525d1700 1 -- start start 2023-10-03T10:15:02.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.189+0000 7f4c525d1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4c4c133b80 0x7f4c4c133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.189+0000 7f4c525d1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4c0a0ff0 0x7f4c4c13b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.189+0000 7f4c525d1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4c09aa00 con 0x7f4c4c099a60 2023-10-03T10:15:02.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.189+0000 7f4c525d1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c09a080 con 0x7f4c4c0a0ff0 2023-10-03T10:15:02.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.190+0000 7f4c525d1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c133750 con 0x7f4c4c133b80 2023-10-03T10:15:02.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.190+0000 7f4c4bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4c4c133b80 0x7f4c4c133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.190+0000 7f4c4b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4c4c099a60 0x7f4c4c0a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38326/0 (socket says 172.21.15.146:38326) 2023-10-03T10:15:02.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.190+0000 7f4c4b7fe700 1 -- 172.21.15.146:0/1978534969 learned_addr learned my addr 172.21.15.146:0/1978534969 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:02.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.190+0000 7f4c4bfff700 1 --2- 172.21.15.146:0/1978534969 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4c4c133b80 0x7f4c4c133f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59674/0 (socket says 172.21.15.146:59674) 2023-10-03T10:15:02.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.190+0000 7f4c50b6e700 1 --2- 172.21.15.146:0/1978534969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4c0a0ff0 0x7f4c4c13b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.190+0000 7f4c4bfff700 1 -- 172.21.15.146:0/1978534969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4c0a0ff0 msgr2=0x7f4c4c13b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:02.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.190+0000 7f4c4bfff700 1 --2- 172.21.15.146:0/1978534969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4c0a0ff0 0x7f4c4c13b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.190+0000 7f4c4bfff700 1 -- 172.21.15.146:0/1978534969 >> v1:172.21.15.146:6789/0 conn(0x7f4c4c099a60 legacy=0x7f4c4c0a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.190+0000 7f4c4affd700 1 -- 172.21.15.146:0/1978534969 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044974743 0 0) 0x7f4c4c09aa00 con 0x7f4c4c099a60 2023-10-03T10:15:02.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.190+0000 7f4c4bfff700 1 -- 172.21.15.146:0/1978534969 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4c09a760 con 0x7f4c4c133b80 2023-10-03T10:15:02.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.190+0000 7f4c4bfff700 1 --2- 172.21.15.146:0/1978534969 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4c4c133b80 0x7f4c4c133f50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c009850 tx=0x7f4c3c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18d7dba923cd96a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.190+0000 7f4c4affd700 1 -- 172.21.15.146:0/1978534969 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c005e30 con 0x7f4c4c133b80 2023-10-03T10:15:02.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.190+0000 7f4c4affd700 1 -- 172.21.15.146:0/1978534969 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c006030 con 0x7f4c4c133b80 2023-10-03T10:15:02.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.190+0000 7f4c4affd700 1 -- 172.21.15.146:0/1978534969 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c0063e0 con 0x7f4c4c133b80 2023-10-03T10:15:02.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.191+0000 7f4c525d1700 1 -- 172.21.15.146:0/1978534969 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4c4c133b80 msgr2=0x7f4c4c133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.191+0000 7f4c525d1700 1 --2- 172.21.15.146:0/1978534969 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4c4c133b80 0x7f4c4c133f50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c009850 tx=0x7f4c3c009b60 comp rx=0 tx=0).stop 2023-10-03T10:15:02.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.191+0000 7f4c525d1700 1 -- 172.21.15.146:0/1978534969 shutdown_connections 2023-10-03T10:15:02.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.191+0000 7f4c525d1700 1 --2- 172.21.15.146:0/1978534969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4c0a0ff0 0x7f4c4c13b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.191+0000 7f4c525d1700 1 --2- 172.21.15.146:0/1978534969 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4c4c133b80 0x7f4c4c133f50 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.191+0000 7f4c525d1700 1 -- 172.21.15.146:0/1978534969 >> 172.21.15.146:0/1978534969 conn(0x7f4c4c0a2980 msgr2=0x7f4c4c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.191+0000 7f4c525d1700 1 -- 172.21.15.146:0/1978534969 shutdown_connections 2023-10-03T10:15:02.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.191+0000 7f4c525d1700 1 -- 172.21.15.146:0/1978534969 wait complete. 2023-10-03T10:15:02.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.192+0000 7f4c525d1700 1 Processor -- start 2023-10-03T10:15:02.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.193+0000 7f4c525d1700 1 -- start start 2023-10-03T10:15:02.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.193+0000 7f4c525d1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4c099a60 0x7f4c4c11a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.193+0000 7f4c525d1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c4c0a0ff0 0x7f4c4c11ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.193+0000 7f4c525d1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4c4c133b80 0x7f4c4c11b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.193+0000 7f4c525d1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c11bcf0 con 0x7f4c4c0a0ff0 2023-10-03T10:15:02.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.193+0000 7f4c525d1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c11c450 con 0x7f4c4c099a60 2023-10-03T10:15:02.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.193+0000 7f4c525d1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c11d6a0 con 0x7f4c4c133b80 2023-10-03T10:15:02.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.193+0000 7f4c4b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c4c0a0ff0 0x7f4c4c11ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.193+0000 7f4c4b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c4c0a0ff0 0x7f4c4c11ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34284/0 (socket says 172.21.15.146:34284) 2023-10-03T10:15:02.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.193+0000 7f4c4b7fe700 1 -- 172.21.15.146:0/315488042 learned_addr learned my addr 172.21.15.146:0/315488042 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:02.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.194+0000 7f4c50b6e700 1 --2- 172.21.15.146:0/315488042 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4c4c133b80 0x7f4c4c11b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.194+0000 7f4c4bfff700 1 --2- 172.21.15.146:0/315488042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4c099a60 0x7f4c4c11a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.194+0000 7f4c4b7fe700 1 -- 172.21.15.146:0/315488042 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4c4c133b80 msgr2=0x7f4c4c11b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.194+0000 7f4c4b7fe700 1 --2- 172.21.15.146:0/315488042 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4c4c133b80 0x7f4c4c11b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.194+0000 7f4c4b7fe700 1 -- 172.21.15.146:0/315488042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4c099a60 msgr2=0x7f4c4c11a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.194+0000 7f4c4b7fe700 1 --2- 172.21.15.146:0/315488042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4c099a60 0x7f4c4c11a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.194+0000 7f4c4b7fe700 1 -- 172.21.15.146:0/315488042 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3c009430 con 0x7f4c4c0a0ff0 2023-10-03T10:15:02.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.194+0000 7f4c4bfff700 1 --2- 172.21.15.146:0/315488042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4c099a60 0x7f4c4c11a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:02.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.194+0000 7f4c4b7fe700 1 --2- 172.21.15.146:0/315488042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c4c0a0ff0 0x7f4c4c11ad80 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000c4b0 tx=0x7f4c4000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.194+0000 7f4c48ff9700 1 -- 172.21.15.146:0/315488042 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c40004c80 con 0x7f4c4c0a0ff0 2023-10-03T10:15:02.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.194+0000 7f4c48ff9700 1 -- 172.21.15.146:0/315488042 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c40004de0 con 0x7f4c4c0a0ff0 2023-10-03T10:15:02.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.194+0000 7f4c525d1700 1 -- 172.21.15.146:0/315488042 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c4c11e080 con 0x7f4c4c0a0ff0 2023-10-03T10:15:02.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.194+0000 7f4c48ff9700 1 -- 172.21.15.146:0/315488042 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c400072d0 con 0x7f4c4c0a0ff0 2023-10-03T10:15:02.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.194+0000 7f4c525d1700 1 -- 172.21.15.146:0/315488042 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c4c09a2c0 con 0x7f4c4c0a0ff0 2023-10-03T10:15:02.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.195+0000 7f4c48ff9700 1 -- 172.21.15.146:0/315488042 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4c40007430 con 0x7f4c4c0a0ff0 2023-10-03T10:15:02.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.195+0000 7f4c525d1700 1 -- 172.21.15.146:0/315488042 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c4c09e9b0 con 0x7f4c4c0a0ff0 2023-10-03T10:15:02.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.196+0000 7f4c48ff9700 1 -- 172.21.15.146:0/315488042 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4c4003f3e0 con 0x7f4c4c0a0ff0 2023-10-03T10:15:02.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.200+0000 7f4c48ff9700 1 -- 172.21.15.146:0/315488042 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c400076e0 con 0x7f4c4c0a0ff0 2023-10-03T10:15:02.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.234+0000 7f1a1fc11700 1 Processor -- start 2023-10-03T10:15:02.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.234+0000 7f1a1fc11700 1 -- start start 2023-10-03T10:15:02.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.235+0000 7f1a1fc11700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a1809d860 0x7f1a1809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.235+0000 7f1a1fc11700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1a1809e170 0x7f1a181307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.235+0000 7f1a1fc11700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a18130ce0 0x7f1a18131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.235+0000 7f1a1fc11700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a1809aaa0 con 0x7f1a1809e170 2023-10-03T10:15:02.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.235+0000 7f1a1fc11700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1809f870 con 0x7f1a18130ce0 2023-10-03T10:15:02.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.235+0000 7f1a1fc11700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1809b360 con 0x7f1a1809d860 2023-10-03T10:15:02.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.235+0000 7f1a1e1ae700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a18130ce0 0x7f1a18131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.235+0000 7f1a1e1ae700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a18130ce0 0x7f1a18131180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43498/0 (socket says 172.21.15.146:43498) 2023-10-03T10:15:02.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.235+0000 7f1a1e1ae700 1 -- 172.21.15.146:0/485781025 learned_addr learned my addr 172.21.15.146:0/485781025 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:02.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.235+0000 7f1a1d1ac700 1 --2- 172.21.15.146:0/485781025 >> v2:172.21.15.146:3300/0 conn(0x7f1a1809e170 0x7f1a181307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.235+0000 7f1a1e1ae700 1 -- 172.21.15.146:0/485781025 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a1809d860 msgr2=0x7f1a1809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:02.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.235+0000 7f1a1e1ae700 1 --2- 172.21.15.146:0/485781025 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a1809d860 0x7f1a1809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.235+0000 7f1a1e1ae700 1 -- 172.21.15.146:0/485781025 >> v2:172.21.15.146:3300/0 conn(0x7f1a1809e170 msgr2=0x7f1a181307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:02.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.235+0000 7f1a1e1ae700 1 --2- 172.21.15.146:0/485781025 >> v2:172.21.15.146:3300/0 conn(0x7f1a1809e170 0x7f1a181307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.235+0000 7f1a1e1ae700 1 -- 172.21.15.146:0/485781025 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1809b620 con 0x7f1a18130ce0 2023-10-03T10:15:02.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.235+0000 7f1a1e1ae700 1 --2- 172.21.15.146:0/485781025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a18130ce0 0x7f1a18131180 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009e80 tx=0x7f1a1000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a543cba7f6d28d46 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.236+0000 7f1a1c9ab700 1 -- 172.21.15.146:0/485781025 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1000e070 con 0x7f1a18130ce0 2023-10-03T10:15:02.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.236+0000 7f1a1c9ab700 1 -- 172.21.15.146:0/485781025 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1000b8d0 con 0x7f1a18130ce0 2023-10-03T10:15:02.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.236+0000 7f1a1c9ab700 1 -- 172.21.15.146:0/485781025 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1000bc80 con 0x7f1a18130ce0 2023-10-03T10:15:02.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.237+0000 7f1a1fc11700 1 -- 172.21.15.146:0/485781025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a18130ce0 msgr2=0x7f1a18131180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.237+0000 7f1a1fc11700 1 --2- 172.21.15.146:0/485781025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a18130ce0 0x7f1a18131180 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009e80 tx=0x7f1a1000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:02.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.237+0000 7f1a1fc11700 1 -- 172.21.15.146:0/485781025 shutdown_connections 2023-10-03T10:15:02.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.237+0000 7f1a1fc11700 1 --2- 172.21.15.146:0/485781025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a18130ce0 0x7f1a18131180 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.237+0000 7f1a1fc11700 1 --2- 172.21.15.146:0/485781025 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a1809d860 0x7f1a1809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.237+0000 7f1a1fc11700 1 --2- 172.21.15.146:0/485781025 >> v2:172.21.15.146:3300/0 conn(0x7f1a1809e170 0x7f1a181307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.237+0000 7f1a1fc11700 1 -- 172.21.15.146:0/485781025 >> 172.21.15.146:0/485781025 conn(0x7f1a18099c40 msgr2=0x7f1a180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.237+0000 7f1a1fc11700 1 -- 172.21.15.146:0/485781025 shutdown_connections 2023-10-03T10:15:02.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.237+0000 7f1a1fc11700 1 -- 172.21.15.146:0/485781025 wait complete. 2023-10-03T10:15:02.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.238+0000 7f1a1fc11700 1 Processor -- start 2023-10-03T10:15:02.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.238+0000 7f1a1fc11700 1 -- start start 2023-10-03T10:15:02.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.239+0000 7f1a1fc11700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a1809d860 0x7f1a1806e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.239+0000 7f1a1fc11700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1809e170 0x7f1a1806ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.239+0000 7f1a1fc11700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a18130ce0 0x7f1a1806f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.239+0000 7f1a1fc11700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a18126180 con 0x7f1a1809e170 2023-10-03T10:15:02.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.239+0000 7f1a1fc11700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1809c920 con 0x7f1a1809d860 2023-10-03T10:15:02.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.239+0000 7f1a1fc11700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a18070540 con 0x7f1a18130ce0 2023-10-03T10:15:02.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.239+0000 7f1a1d9ad700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a1809d860 0x7f1a1806e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.239+0000 7f1a1d9ad700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a1809d860 0x7f1a1806e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43500/0 (socket says 172.21.15.146:43500) 2023-10-03T10:15:02.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.239+0000 7f1a1d9ad700 1 -- 172.21.15.146:0/714862909 learned_addr learned my addr 172.21.15.146:0/714862909 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:02.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.239+0000 7f1a1d1ac700 1 --2- 172.21.15.146:0/714862909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1809e170 0x7f1a1806ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.239+0000 7f1a1d1ac700 1 -- 172.21.15.146:0/714862909 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a18130ce0 msgr2=0x7f1a1806f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.239+0000 7f1a1d1ac700 1 --2- 172.21.15.146:0/714862909 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a18130ce0 0x7f1a1806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.239+0000 7f1a1d1ac700 1 -- 172.21.15.146:0/714862909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a1809d860 msgr2=0x7f1a1806e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.239+0000 7f1a1d1ac700 1 --2- 172.21.15.146:0/714862909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a1809d860 0x7f1a1806e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.239+0000 7f1a1d1ac700 1 -- 172.21.15.146:0/714862909 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a10009b30 con 0x7f1a1809e170 2023-10-03T10:15:02.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.240+0000 7f1a1d1ac700 1 --2- 172.21.15.146:0/714862909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1809e170 0x7f1a1806ee40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1a0801f850 tx=0x7f1a0801fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.240+0000 7f1a0e7fc700 1 -- 172.21.15.146:0/714862909 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08024890 con 0x7f1a1809e170 2023-10-03T10:15:02.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.240+0000 7f1a0e7fc700 1 -- 172.21.15.146:0/714862909 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a080249f0 con 0x7f1a1809e170 2023-10-03T10:15:02.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.240+0000 7f1a0e7fc700 1 -- 172.21.15.146:0/714862909 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08024d60 con 0x7f1a1809e170 2023-10-03T10:15:02.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.240+0000 7f1a1fc11700 1 -- 172.21.15.146:0/714862909 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a18125a90 con 0x7f1a1809e170 2023-10-03T10:15:02.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.240+0000 7f1a1fc11700 1 -- 172.21.15.146:0/714862909 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a18130490 con 0x7f1a1809e170 2023-10-03T10:15:02.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.241+0000 7f1a0e7fc700 1 -- 172.21.15.146:0/714862909 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a080233e0 con 0x7f1a1809e170 2023-10-03T10:15:02.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.241+0000 7f1a1fc11700 1 -- 172.21.15.146:0/714862909 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1804f2a0 con 0x7f1a1809e170 2023-10-03T10:15:02.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.242+0000 7f1a0e7fc700 1 -- 172.21.15.146:0/714862909 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1a080509e0 con 0x7f1a1809e170 2023-10-03T10:15:02.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.250+0000 7f1a0e7fc700 1 -- 172.21.15.146:0/714862909 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a08023690 con 0x7f1a1809e170 2023-10-03T10:15:02.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.284+0000 7f269f31a700 1 Processor -- start 2023-10-03T10:15:02.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.284+0000 7f269f31a700 1 -- start start 2023-10-03T10:15:02.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.285+0000 7f269f31a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f269806b250 0x7f2698136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.285+0000 7f269f31a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2698137140 0x7f2698139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.285+0000 7f269f31a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f269809da80 con 0x7f269806a770 2023-10-03T10:15:02.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.285+0000 7f269f31a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f269809f770 con 0x7f269806b250 2023-10-03T10:15:02.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.285+0000 7f269f31a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f269809dce0 con 0x7f2698137140 2023-10-03T10:15:02.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.285+0000 7f269d8b7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2698137140 0x7f2698139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.285+0000 7f269c8b5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f269806b250 0x7f2698136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.285+0000 7f269d8b7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2698137140 0x7f2698139520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59724/0 (socket says 172.21.15.146:59724) 2023-10-03T10:15:02.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.285+0000 7f269d8b7700 1 -- 172.21.15.146:0/2804421212 learned_addr learned my addr 172.21.15.146:0/2804421212 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:02.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.286+0000 7f269c8b5700 1 -- 172.21.15.146:0/2804421212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2698137140 msgr2=0x7f2698139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:02.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.286+0000 7f269c8b5700 1 --2- 172.21.15.146:0/2804421212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2698137140 0x7f2698139520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.286+0000 7f269c8b5700 1 -- 172.21.15.146:0/2804421212 >> v1:172.21.15.146:6789/0 conn(0x7f269806a770 legacy=0x7f269806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.286+0000 7f269c8b5700 1 -- 172.21.15.146:0/2804421212 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269809eb20 con 0x7f269806b250 2023-10-03T10:15:02.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.286+0000 7f269c8b5700 1 --2- 172.21.15.146:0/2804421212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f269806b250 0x7f2698136c00 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f2688009840 tx=0x7f2688009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c80769f59d73dad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.286+0000 7f268ffff700 1 -- 172.21.15.146:0/2804421212 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688011830 con 0x7f269806b250 2023-10-03T10:15:02.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.286+0000 7f268ffff700 1 -- 172.21.15.146:0/2804421212 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2688011990 con 0x7f269806b250 2023-10-03T10:15:02.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.286+0000 7f268ffff700 1 -- 172.21.15.146:0/2804421212 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688011d20 con 0x7f269806b250 2023-10-03T10:15:02.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.287+0000 7f269f31a700 1 -- 172.21.15.146:0/2804421212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f269806b250 msgr2=0x7f2698136c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.287+0000 7f269f31a700 1 --2- 172.21.15.146:0/2804421212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f269806b250 0x7f2698136c00 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f2688009840 tx=0x7f2688009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:02.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.287+0000 7f269f31a700 1 -- 172.21.15.146:0/2804421212 shutdown_connections 2023-10-03T10:15:02.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.287+0000 7f269f31a700 1 --2- 172.21.15.146:0/2804421212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2698137140 0x7f2698139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.287+0000 7f269f31a700 1 --2- 172.21.15.146:0/2804421212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f269806b250 0x7f2698136c00 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.287+0000 7f269f31a700 1 -- 172.21.15.146:0/2804421212 >> 172.21.15.146:0/2804421212 conn(0x7f2698099c40 msgr2=0x7f26980a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.287+0000 7f269f31a700 1 -- 172.21.15.146:0/2804421212 shutdown_connections 2023-10-03T10:15:02.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.287+0000 7f269f31a700 1 -- 172.21.15.146:0/2804421212 wait complete. 2023-10-03T10:15:02.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.288+0000 7f269f31a700 1 Processor -- start 2023-10-03T10:15:02.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.288+0000 7f269f31a700 1 -- start start 2023-10-03T10:15:02.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.289+0000 7f269f31a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f269806a770 0x7f2698120670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.289+0000 7f269f31a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f269806b250 0x7f2698120bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.289+0000 7f269f31a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2698137140 0x7f26981210f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.289+0000 7f269f31a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2698123100 con 0x7f2698137140 2023-10-03T10:15:02.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.289+0000 7f269f31a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2698123e20 con 0x7f269806b250 2023-10-03T10:15:02.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.289+0000 7f269f31a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2698071e10 con 0x7f269806a770 2023-10-03T10:15:02.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.289+0000 7f269d0b6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f269806a770 0x7f2698120670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.289+0000 7f269d8b7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2698137140 0x7f26981210f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.289+0000 7f269d0b6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f269806a770 0x7f2698120670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59734/0 (socket says 172.21.15.146:59734) 2023-10-03T10:15:02.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.289+0000 7f269d0b6700 1 -- 172.21.15.146:0/4145102256 learned_addr learned my addr 172.21.15.146:0/4145102256 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:02.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.289+0000 7f269d8b7700 1 -- 172.21.15.146:0/4145102256 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f269806a770 msgr2=0x7f2698120670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.289+0000 7f269d8b7700 1 --2- 172.21.15.146:0/4145102256 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f269806a770 0x7f2698120670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.289+0000 7f269d8b7700 1 -- 172.21.15.146:0/4145102256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f269806b250 msgr2=0x7f2698120bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.289+0000 7f269d8b7700 1 --2- 172.21.15.146:0/4145102256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f269806b250 0x7f2698120bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.289+0000 7f269d8b7700 1 -- 172.21.15.146:0/4145102256 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26880094a0 con 0x7f2698137140 2023-10-03T10:15:02.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.289+0000 7f269d0b6700 1 --2- 172.21.15.146:0/4145102256 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f269806a770 0x7f2698120670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:02.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.289+0000 7f269d8b7700 1 --2- 172.21.15.146:0/4145102256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2698137140 0x7f26981210f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f269000efc0 tx=0x7f269000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.289+0000 7f268dffb700 1 -- 172.21.15.146:0/4145102256 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2690003c20 con 0x7f2698137140 2023-10-03T10:15:02.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.289+0000 7f269f31a700 1 -- 172.21.15.146:0/4145102256 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26980a2c80 con 0x7f2698137140 2023-10-03T10:15:02.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.289+0000 7f268dffb700 1 -- 172.21.15.146:0/4145102256 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269000f040 con 0x7f2698137140 2023-10-03T10:15:02.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.289+0000 7f268dffb700 1 -- 172.21.15.146:0/4145102256 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2690009e60 con 0x7f2698137140 2023-10-03T10:15:02.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.290+0000 7f269f31a700 1 -- 172.21.15.146:0/4145102256 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2698124890 con 0x7f2698137140 2023-10-03T10:15:02.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.290+0000 7f268dffb700 1 -- 172.21.15.146:0/4145102256 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f269000c930 con 0x7f2698137140 2023-10-03T10:15:02.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.291+0000 7f268dffb700 1 -- 172.21.15.146:0/4145102256 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f269003f9c0 con 0x7f2698137140 2023-10-03T10:15:02.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.291+0000 7f269f31a700 1 -- 172.21.15.146:0/4145102256 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f269804f2a0 con 0x7f2698137140 2023-10-03T10:15:02.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.296+0000 7f268dffb700 1 -- 172.21.15.146:0/4145102256 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f269001c360 con 0x7f2698137140 2023-10-03T10:15:02.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.323+0000 7fbdb005d700 1 Processor -- start 2023-10-03T10:15:02.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.323+0000 7fbdb005d700 1 -- start start 2023-10-03T10:15:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.324+0000 7fbdb005d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbda809ad40 0x7fbda8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.324+0000 7fbdb005d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbda8133f70 0x7fbda81343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.324+0000 7fbdb005d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda809b110 con 0x7fbda80a0a70 2023-10-03T10:15:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.324+0000 7fbdb005d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda80a3b60 con 0x7fbda8133f70 2023-10-03T10:15:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.324+0000 7fbdb005d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda81348e0 con 0x7fbda809ad40 2023-10-03T10:15:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.324+0000 7fbdaddf9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbda809ad40 0x7fbda8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.324+0000 7fbdaddf9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbda809ad40 0x7fbda8133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43524/0 (socket says 172.21.15.146:43524) 2023-10-03T10:15:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.324+0000 7fbdaddf9700 1 -- 172.21.15.146:0/1728147663 learned_addr learned my addr 172.21.15.146:0/1728147663 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.324+0000 7fbdaddf9700 1 -- 172.21.15.146:0/1728147663 >> v2:172.21.15.146:3300/0 conn(0x7fbda8133f70 msgr2=0x7fbda81343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.324+0000 7fbdaddf9700 1 --2- 172.21.15.146:0/1728147663 >> v2:172.21.15.146:3300/0 conn(0x7fbda8133f70 0x7fbda81343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.324+0000 7fbdaddf9700 1 -- 172.21.15.146:0/1728147663 >> v1:172.21.15.146:6789/0 conn(0x7fbda80a0a70 legacy=0x7fbda80a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.324+0000 7fbdaddf9700 1 -- 172.21.15.146:0/1728147663 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda80a2fa0 con 0x7fbda809ad40 2023-10-03T10:15:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.324+0000 7fbdaddf9700 1 --2- 172.21.15.146:0/1728147663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbda809ad40 0x7fbda8133a30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbda4009920 tx=0x7fbda4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74f12f4cb8edd375 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.325+0000 7fbdacdf7700 1 -- 172.21.15.146:0/1728147663 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4004230 con 0x7fbda809ad40 2023-10-03T10:15:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.325+0000 7fbdacdf7700 1 -- 172.21.15.146:0/1728147663 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda4004390 con 0x7fbda809ad40 2023-10-03T10:15:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.325+0000 7fbdacdf7700 1 -- 172.21.15.146:0/1728147663 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4009e70 con 0x7fbda809ad40 2023-10-03T10:15:02.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.325+0000 7fbdb005d700 1 -- 172.21.15.146:0/1728147663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbda809ad40 msgr2=0x7fbda8133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.325+0000 7fbdb005d700 1 --2- 172.21.15.146:0/1728147663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbda809ad40 0x7fbda8133a30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbda4009920 tx=0x7fbda4009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:02.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.325+0000 7fbdb005d700 1 -- 172.21.15.146:0/1728147663 shutdown_connections 2023-10-03T10:15:02.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.325+0000 7fbdb005d700 1 --2- 172.21.15.146:0/1728147663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbda809ad40 0x7fbda8133a30 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.325+0000 7fbdb005d700 1 --2- 172.21.15.146:0/1728147663 >> v2:172.21.15.146:3300/0 conn(0x7fbda8133f70 0x7fbda81343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.325+0000 7fbdb005d700 1 -- 172.21.15.146:0/1728147663 >> 172.21.15.146:0/1728147663 conn(0x7fbda8099c40 msgr2=0x7fbda806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.325+0000 7fbdb005d700 1 -- 172.21.15.146:0/1728147663 shutdown_connections 2023-10-03T10:15:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.325+0000 7fbdb005d700 1 -- 172.21.15.146:0/1728147663 wait complete. 2023-10-03T10:15:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.326+0000 7fbdb005d700 1 Processor -- start 2023-10-03T10:15:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.326+0000 7fbdb005d700 1 -- start start 2023-10-03T10:15:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.327+0000 7fbdb005d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbda809ad40 0x7fbda811e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.327+0000 7fbdb005d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbda80a0a70 0x7fbda811e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.327+0000 7fbdb005d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbda8133f70 0x7fbda811ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.327+0000 7fbdb005d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda811f580 con 0x7fbda809ad40 2023-10-03T10:15:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.327+0000 7fbdb005d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda8120f60 con 0x7fbda80a0a70 2023-10-03T10:15:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.327+0000 7fbdb005d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbda811fdb0 con 0x7fbda8133f70 2023-10-03T10:15:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.327+0000 7fbdae5fa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbda8133f70 0x7fbda811ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.327+0000 7fbdad5f8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbda80a0a70 0x7fbda811e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.327+0000 7fbdae5fa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbda8133f70 0x7fbda811ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59744/0 (socket says 172.21.15.146:59744) 2023-10-03T10:15:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.327+0000 7fbdad5f8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbda80a0a70 0x7fbda811e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43532/0 (socket says 172.21.15.146:43532) 2023-10-03T10:15:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.327+0000 7fbdae5fa700 1 -- 172.21.15.146:0/3081408691 learned_addr learned my addr 172.21.15.146:0/3081408691 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.327+0000 7fbdae5fa700 1 -- 172.21.15.146:0/3081408691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbda80a0a70 msgr2=0x7fbda811e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.327+0000 7fbdae5fa700 1 --2- 172.21.15.146:0/3081408691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbda80a0a70 0x7fbda811e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.327+0000 7fbdae5fa700 1 -- 172.21.15.146:0/3081408691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbda809ad40 msgr2=0x7fbda811e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.327+0000 7fbdae5fa700 1 --2- 172.21.15.146:0/3081408691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbda809ad40 0x7fbda811e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.327+0000 7fbdae5fa700 1 -- 172.21.15.146:0/3081408691 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda4009550 con 0x7fbda8133f70 2023-10-03T10:15:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.327+0000 7fbdad5f8700 1 --2- 172.21.15.146:0/3081408691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbda80a0a70 0x7fbda811e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.327+0000 7fbdae5fa700 1 --2- 172.21.15.146:0/3081408691 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbda8133f70 0x7fbda811ebc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbda000c7a0 tx=0x7fbda000cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.328+0000 7fbd9e7fc700 1 -- 172.21.15.146:0/3081408691 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda0003e10 con 0x7fbda8133f70 2023-10-03T10:15:02.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.328+0000 7fbd9e7fc700 1 -- 172.21.15.146:0/3081408691 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda0005070 con 0x7fbda8133f70 2023-10-03T10:15:02.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.328+0000 7fbdb005d700 1 -- 172.21.15.146:0/3081408691 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda8121940 con 0x7fbda8133f70 2023-10-03T10:15:02.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.328+0000 7fbd9e7fc700 1 -- 172.21.15.146:0/3081408691 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda0005420 con 0x7fbda8133f70 2023-10-03T10:15:02.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.328+0000 7fbdb005d700 1 -- 172.21.15.146:0/3081408691 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda80a4630 con 0x7fbda8133f70 2023-10-03T10:15:02.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.329+0000 7fbdb005d700 1 -- 172.21.15.146:0/3081408691 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda809ed10 con 0x7fbda8133f70 2023-10-03T10:15:02.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.329+0000 7fbd9e7fc700 1 -- 172.21.15.146:0/3081408691 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbda0005580 con 0x7fbda8133f70 2023-10-03T10:15:02.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.329+0000 7fbd9e7fc700 1 -- 172.21.15.146:0/3081408691 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbda003ea30 con 0x7fbda8133f70 2023-10-03T10:15:02.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.334+0000 7fbd9e7fc700 1 -- 172.21.15.146:0/3081408691 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbda000ab60 con 0x7fbda8133f70 2023-10-03T10:15:02.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.483+0000 7f4c525d1700 1 -- 172.21.15.146:0/315488042 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4c4c11ca30 con 0x7f4c4c0a0ff0 2023-10-03T10:15:02.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.483+0000 7f4c48ff9700 1 -- 172.21.15.146:0/315488042 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4c40011360 con 0x7f4c4c0a0ff0 2023-10-03T10:15:02.483 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.485+0000 7f4c525d1700 1 -- 172.21.15.146:0/315488042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c4c0a0ff0 msgr2=0x7f4c4c11ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.485+0000 7f4c525d1700 1 --2- 172.21.15.146:0/315488042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c4c0a0ff0 0x7f4c4c11ad80 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000c4b0 tx=0x7f4c4000c7c0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.486+0000 7f4c525d1700 1 -- 172.21.15.146:0/315488042 shutdown_connections 2023-10-03T10:15:02.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.486+0000 7f4c525d1700 1 --2- 172.21.15.146:0/315488042 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4c4c133b80 0x7f4c4c11b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.486+0000 7f4c525d1700 1 --2- 172.21.15.146:0/315488042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c4c099a60 0x7f4c4c11a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.486+0000 7f4c525d1700 1 --2- 172.21.15.146:0/315488042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c4c0a0ff0 0x7f4c4c11ad80 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.486+0000 7f4c525d1700 1 -- 172.21.15.146:0/315488042 >> 172.21.15.146:0/315488042 conn(0x7f4c4c0a2980 msgr2=0x7f4c4c12f840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.486+0000 7f4c525d1700 1 -- 172.21.15.146:0/315488042 shutdown_connections 2023-10-03T10:15:02.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.486+0000 7f4c525d1700 1 -- 172.21.15.146:0/315488042 wait complete. 2023-10-03T10:15:02.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.490+0000 7f269f31a700 1 -- 172.21.15.146:0/4145102256 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f269806c3b0 con 0x7f2698137140 2023-10-03T10:15:02.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.490+0000 7f268dffb700 1 -- 172.21.15.146:0/4145102256 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2690014e00 con 0x7f2698137140 2023-10-03T10:15:02.490 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:02.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.492+0000 7f269f31a700 1 -- 172.21.15.146:0/4145102256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2698137140 msgr2=0x7f26981210f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.492+0000 7f269f31a700 1 --2- 172.21.15.146:0/4145102256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2698137140 0x7f26981210f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f269000efc0 tx=0x7f269000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.492+0000 7f269f31a700 1 -- 172.21.15.146:0/4145102256 shutdown_connections 2023-10-03T10:15:02.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.492+0000 7f269f31a700 1 --2- 172.21.15.146:0/4145102256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2698137140 0x7f26981210f0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.492+0000 7f269f31a700 1 --2- 172.21.15.146:0/4145102256 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f269806a770 0x7f2698120670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.492+0000 7f269f31a700 1 --2- 172.21.15.146:0/4145102256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f269806b250 0x7f2698120bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.492+0000 7f269f31a700 1 -- 172.21.15.146:0/4145102256 >> 172.21.15.146:0/4145102256 conn(0x7f2698099c40 msgr2=0x7f26980a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.492+0000 7f269f31a700 1 -- 172.21.15.146:0/4145102256 shutdown_connections 2023-10-03T10:15:02.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.492+0000 7f269f31a700 1 -- 172.21.15.146:0/4145102256 wait complete. 2023-10-03T10:15:02.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:02.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:02.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.527+0000 7f1a1fc11700 1 -- 172.21.15.146:0/714862909 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1a18130490 con 0x7f1a1809e170 2023-10-03T10:15:02.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.527+0000 7f1a0e7fc700 1 -- 172.21.15.146:0/714862909 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a18130490 con 0x7f1a1809e170 2023-10-03T10:15:02.527 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:02.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.528+0000 7fbdb005d700 1 -- 172.21.15.146:0/3081408691 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbda8121d40 con 0x7fbda8133f70 2023-10-03T10:15:02.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.529+0000 7fbd9e7fc700 1 -- 172.21.15.146:0/3081408691 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbda0017090 con 0x7fbda8133f70 2023-10-03T10:15:02.528 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:02.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.530+0000 7f1a1fc11700 1 -- 172.21.15.146:0/714862909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1809e170 msgr2=0x7f1a1806ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.530+0000 7f1a1fc11700 1 --2- 172.21.15.146:0/714862909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1809e170 0x7f1a1806ee40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1a0801f850 tx=0x7f1a0801fb60 comp rx=0 tx=0).stop 2023-10-03T10:15:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.530+0000 7f1a1fc11700 1 -- 172.21.15.146:0/714862909 shutdown_connections 2023-10-03T10:15:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.530+0000 7f1a1fc11700 1 --2- 172.21.15.146:0/714862909 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a18130ce0 0x7f1a1806f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.530+0000 7f1a1fc11700 1 --2- 172.21.15.146:0/714862909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a1809d860 0x7f1a1806e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.530+0000 7f1a1fc11700 1 --2- 172.21.15.146:0/714862909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1809e170 0x7f1a1806ee40 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.530+0000 7f1a1fc11700 1 -- 172.21.15.146:0/714862909 >> 172.21.15.146:0/714862909 conn(0x7f1a18099c40 msgr2=0x7f1a1806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.530+0000 7f1a1fc11700 1 -- 172.21.15.146:0/714862909 shutdown_connections 2023-10-03T10:15:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.530+0000 7f1a1fc11700 1 -- 172.21.15.146:0/714862909 wait complete. 2023-10-03T10:15:02.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.531+0000 7fbdb005d700 1 -- 172.21.15.146:0/3081408691 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbda8133f70 msgr2=0x7fbda811ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.531+0000 7fbdb005d700 1 --2- 172.21.15.146:0/3081408691 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbda8133f70 0x7fbda811ebc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbda000c7a0 tx=0x7fbda000cab0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.531+0000 7fbdb005d700 1 -- 172.21.15.146:0/3081408691 shutdown_connections 2023-10-03T10:15:02.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.531+0000 7fbdb005d700 1 --2- 172.21.15.146:0/3081408691 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbda8133f70 0x7fbda811ebc0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.531+0000 7fbdb005d700 1 --2- 172.21.15.146:0/3081408691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbda809ad40 0x7fbda811e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.531+0000 7fbdb005d700 1 --2- 172.21.15.146:0/3081408691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbda80a0a70 0x7fbda811e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.531+0000 7fbdb005d700 1 -- 172.21.15.146:0/3081408691 >> 172.21.15.146:0/3081408691 conn(0x7fbda8099c40 msgr2=0x7fbda8132ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.531+0000 7fbdb005d700 1 -- 172.21.15.146:0/3081408691 shutdown_connections 2023-10-03T10:15:02.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:02.531+0000 7fbdb005d700 1 -- 172.21.15.146:0/3081408691 wait complete. 2023-10-03T10:15:02.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:02.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:03.502 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:03.508 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:03.544 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:03.545 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:03.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.647+0000 7fc1a7467700 1 Processor -- start 2023-10-03T10:15:03.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.647+0000 7fc1a7467700 1 -- start start 2023-10-03T10:15:03.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.648+0000 7fc1a7467700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1a0133ad0 0x7fc1a0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.648+0000 7fc1a7467700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc1a01300a0 0x7fc1a01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.648+0000 7fc1a7467700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc1a01309f0 0x7fc1a013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.648+0000 7fc1a7467700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1a006b2d0 con 0x7fc1a01309f0 2023-10-03T10:15:03.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.648+0000 7fc1a7467700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a0133610 con 0x7fc1a0133ad0 2023-10-03T10:15:03.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.648+0000 7fc1a7467700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a009a500 con 0x7fc1a01300a0 2023-10-03T10:15:03.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.648+0000 7fc1a5a04700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc1a01309f0 0x7fc1a013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.648+0000 7fc1a5a04700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc1a01309f0 0x7fc1a013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34336/0 (socket says 172.21.15.146:34336) 2023-10-03T10:15:03.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.648+0000 7fc1a5a04700 1 -- 172.21.15.146:0/469166098 learned_addr learned my addr 172.21.15.146:0/469166098 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:03.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.648+0000 7fc1a4a02700 1 --2- 172.21.15.146:0/469166098 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc1a01300a0 0x7fc1a01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.648+0000 7fc1a5203700 1 --2- 172.21.15.146:0/469166098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1a0133ad0 0x7fc1a0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.648+0000 7fc1a4a02700 1 -- 172.21.15.146:0/469166098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1a0133ad0 msgr2=0x7fc1a0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:03.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.648+0000 7fc1a4a02700 1 --2- 172.21.15.146:0/469166098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1a0133ad0 0x7fc1a0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.648+0000 7fc1a4a02700 1 -- 172.21.15.146:0/469166098 >> v2:172.21.15.146:3300/0 conn(0x7fc1a01309f0 msgr2=0x7fc1a013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:03.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.648+0000 7fc1a4a02700 1 --2- 172.21.15.146:0/469166098 >> v2:172.21.15.146:3300/0 conn(0x7fc1a01309f0 0x7fc1a013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.648+0000 7fc1a4a02700 1 -- 172.21.15.146:0/469166098 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a01338b0 con 0x7fc1a01300a0 2023-10-03T10:15:03.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.648+0000 7fc1a5203700 1 --2- 172.21.15.146:0/469166098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1a0133ad0 0x7fc1a0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:03.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.648+0000 7fc1a5a04700 1 --2- 172.21.15.146:0/469166098 >> v2:172.21.15.146:3300/0 conn(0x7fc1a01309f0 0x7fc1a013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:03.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.649+0000 7fc1a4a02700 1 --2- 172.21.15.146:0/469166098 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc1a01300a0 0x7fc1a01304b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc190009840 tx=0x7fc190009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb4c74de43ea7121 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.649+0000 7fc197fff700 1 -- 172.21.15.146:0/469166098 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc190011830 con 0x7fc1a01300a0 2023-10-03T10:15:03.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.649+0000 7fc197fff700 1 -- 172.21.15.146:0/469166098 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc190011990 con 0x7fc1a01300a0 2023-10-03T10:15:03.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.649+0000 7fc197fff700 1 -- 172.21.15.146:0/469166098 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc190011d20 con 0x7fc1a01300a0 2023-10-03T10:15:03.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.650+0000 7fc1a7467700 1 -- 172.21.15.146:0/469166098 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc1a01300a0 msgr2=0x7fc1a01304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.650+0000 7fc1a7467700 1 --2- 172.21.15.146:0/469166098 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc1a01300a0 0x7fc1a01304b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc190009840 tx=0x7fc190009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:03.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.650+0000 7fc1a7467700 1 -- 172.21.15.146:0/469166098 shutdown_connections 2023-10-03T10:15:03.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.650+0000 7fc1a7467700 1 --2- 172.21.15.146:0/469166098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1a0133ad0 0x7fc1a0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.650+0000 7fc1a7467700 1 --2- 172.21.15.146:0/469166098 >> v2:172.21.15.146:3300/0 conn(0x7fc1a01309f0 0x7fc1a013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.650+0000 7fc1a7467700 1 --2- 172.21.15.146:0/469166098 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc1a01300a0 0x7fc1a01304b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.650+0000 7fc1a7467700 1 -- 172.21.15.146:0/469166098 >> 172.21.15.146:0/469166098 conn(0x7fc1a0099c40 msgr2=0x7fc1a00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.650+0000 7fc1a7467700 1 -- 172.21.15.146:0/469166098 shutdown_connections 2023-10-03T10:15:03.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.650+0000 7fc1a7467700 1 -- 172.21.15.146:0/469166098 wait complete. 2023-10-03T10:15:03.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.651+0000 7fc1a7467700 1 Processor -- start 2023-10-03T10:15:03.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.651+0000 7fc1a7467700 1 -- start start 2023-10-03T10:15:03.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.651+0000 7fc1a7467700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1a01300a0 0x7fc1a01c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.651+0000 7fc1a7467700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1a01309f0 0x7fc1a01c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.651+0000 7fc1a7467700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc1a0133ad0 0x7fc1a006e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.651+0000 7fc1a7467700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a0070cd0 con 0x7fc1a01300a0 2023-10-03T10:15:03.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.651+0000 7fc1a7467700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a0072310 con 0x7fc1a01309f0 2023-10-03T10:15:03.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.651+0000 7fc1a7467700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a012fe40 con 0x7fc1a0133ad0 2023-10-03T10:15:03.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.652+0000 7fc1a5203700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1a01300a0 0x7fc1a01c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.652+0000 7fc1a5203700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1a01300a0 0x7fc1a01c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34350/0 (socket says 172.21.15.146:34350) 2023-10-03T10:15:03.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.652+0000 7fc1a5203700 1 -- 172.21.15.146:0/2284497463 learned_addr learned my addr 172.21.15.146:0/2284497463 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:03.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.652+0000 7fc1a4a02700 1 --2- 172.21.15.146:0/2284497463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1a01309f0 0x7fc1a01c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.652+0000 7fc1a5a04700 1 --2- 172.21.15.146:0/2284497463 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc1a0133ad0 0x7fc1a006e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.652+0000 7fc1a5203700 1 -- 172.21.15.146:0/2284497463 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc1a0133ad0 msgr2=0x7fc1a006e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.652+0000 7fc1a5203700 1 --2- 172.21.15.146:0/2284497463 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc1a0133ad0 0x7fc1a006e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.652+0000 7fc1a5203700 1 -- 172.21.15.146:0/2284497463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1a01309f0 msgr2=0x7fc1a01c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.652+0000 7fc1a5203700 1 --2- 172.21.15.146:0/2284497463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1a01309f0 0x7fc1a01c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.652+0000 7fc1a5203700 1 -- 172.21.15.146:0/2284497463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc198009b30 con 0x7fc1a01300a0 2023-10-03T10:15:03.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.652+0000 7fc1a4a02700 1 --2- 172.21.15.146:0/2284497463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1a01309f0 0x7fc1a01c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:03.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.652+0000 7fc1a5203700 1 --2- 172.21.15.146:0/2284497463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1a01300a0 0x7fc1a01c89c0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00ebe0 tx=0x7fc19c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.652+0000 7fc195ffb700 1 -- 172.21.15.146:0/2284497463 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c009800 con 0x7fc1a01300a0 2023-10-03T10:15:03.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.652+0000 7fc195ffb700 1 -- 172.21.15.146:0/2284497463 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c00c910 con 0x7fc1a01300a0 2023-10-03T10:15:03.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.652+0000 7fc1a7467700 1 -- 172.21.15.146:0/2284497463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc19c0094a0 con 0x7fc1a01300a0 2023-10-03T10:15:03.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.652+0000 7fc195ffb700 1 -- 172.21.15.146:0/2284497463 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c00cc80 con 0x7fc1a01300a0 2023-10-03T10:15:03.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.653+0000 7fc1a7467700 1 -- 172.21.15.146:0/2284497463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1900094a0 con 0x7fc1a01300a0 2023-10-03T10:15:03.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.654+0000 7fc1a7467700 1 -- 172.21.15.146:0/2284497463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a012a810 con 0x7fc1a01300a0 2023-10-03T10:15:03.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.654+0000 7fc195ffb700 1 -- 172.21.15.146:0/2284497463 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc19c013470 con 0x7fc1a01300a0 2023-10-03T10:15:03.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.654+0000 7fc195ffb700 1 -- 172.21.15.146:0/2284497463 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc19c047350 con 0x7fc1a01300a0 2023-10-03T10:15:03.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.659+0000 7fc195ffb700 1 -- 172.21.15.146:0/2284497463 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc19c044060 con 0x7fc1a01300a0 2023-10-03T10:15:03.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.682+0000 7f8650d8a700 1 Processor -- start 2023-10-03T10:15:03.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.682+0000 7f8650d8a700 1 -- start start 2023-10-03T10:15:03.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.683+0000 7f95be42b700 1 Processor -- start 2023-10-03T10:15:03.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.683+0000 7f95be42b700 1 -- start start 2023-10-03T10:15:03.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.683+0000 7f8650d8a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f864c133ad0 0x7f864c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.683+0000 7f8650d8a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f864c130bc0 0x7f864c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.683+0000 7f8650d8a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864c06b2d0 con 0x7f864c1300a0 2023-10-03T10:15:03.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.683+0000 7f8650d8a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f864c133610 con 0x7f864c133ad0 2023-10-03T10:15:03.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.683+0000 7f8650d8a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c09a500 con 0x7f864c130bc0 2023-10-03T10:15:03.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.683+0000 7f95be42b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b8066410 0x7f95b81319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.683+0000 7f95be42b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f95b81314b0 0x7f95b8131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.683+0000 7f95be42b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b80a0f20 con 0x7f95b809bc70 2023-10-03T10:15:03.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.683+0000 7f95be42b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b80667e0 con 0x7f95b81314b0 2023-10-03T10:15:03.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.683+0000 7f95be42b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b80a23c0 con 0x7f95b8066410 2023-10-03T10:15:03.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.683+0000 7f864ad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f864c130bc0 0x7f864c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.683+0000 7f95b7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b8066410 0x7f95b81319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.683+0000 7f95b7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b8066410 0x7f95b81319f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43564/0 (socket says 172.21.15.146:43564) 2023-10-03T10:15:03.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.683+0000 7f95b7fff700 1 -- 172.21.15.146:0/3073168206 learned_addr learned my addr 172.21.15.146:0/3073168206 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:03.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.683+0000 7f864ad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f864c130bc0 0x7f864c13b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43560/0 (socket says 172.21.15.146:43560) 2023-10-03T10:15:03.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.683+0000 7f864ad9d700 1 -- 172.21.15.146:0/470872906 learned_addr learned my addr 172.21.15.146:0/470872906 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:03.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.684+0000 7f95b77fe700 1 --2- 172.21.15.146:0/3073168206 >> v2:172.21.15.146:3300/0 conn(0x7f95b81314b0 0x7f95b8131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.684+0000 7f864a59c700 1 --2- 172.21.15.146:0/470872906 >> v2:172.21.15.146:3300/0 conn(0x7f864c133ad0 0x7f864c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.684+0000 7f95b7fff700 1 -- 172.21.15.146:0/3073168206 >> v2:172.21.15.146:3300/0 conn(0x7f95b81314b0 msgr2=0x7f95b8131f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:03.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.684+0000 7f95b7fff700 1 --2- 172.21.15.146:0/3073168206 >> v2:172.21.15.146:3300/0 conn(0x7f95b81314b0 0x7f95b8131f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.684+0000 7f864ad9d700 1 -- 172.21.15.146:0/470872906 >> v2:172.21.15.146:3300/0 conn(0x7f864c133ad0 msgr2=0x7f864c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:03.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.684+0000 7f864ad9d700 1 --2- 172.21.15.146:0/470872906 >> v2:172.21.15.146:3300/0 conn(0x7f864c133ad0 0x7f864c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.684+0000 7f864ad9d700 1 -- 172.21.15.146:0/470872906 >> v1:172.21.15.146:6789/0 conn(0x7f864c1300a0 legacy=0x7f864c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:03.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.684+0000 7f864ad9d700 1 -- 172.21.15.146:0/470872906 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c1338b0 con 0x7f864c130bc0 2023-10-03T10:15:03.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.684+0000 7f864a59c700 1 --2- 172.21.15.146:0/470872906 >> v2:172.21.15.146:3300/0 conn(0x7f864c133ad0 0x7f864c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:03.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.684+0000 7f95b7fff700 1 -- 172.21.15.146:0/3073168206 >> v1:172.21.15.146:6789/0 conn(0x7f95b809bc70 legacy=0x7f95b809c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.684+0000 7f95b7fff700 1 -- 172.21.15.146:0/3073168206 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b80a16e0 con 0x7f95b8066410 2023-10-03T10:15:03.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.684+0000 7f95b6ffd700 1 -- 172.21.15.146:0/3073168206 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651562450 0 0) 0x7f95b80a0f20 con 0x7f95b809bc70 2023-10-03T10:15:03.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.684+0000 7f864ad9d700 1 --2- 172.21.15.146:0/470872906 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f864c130bc0 0x7f864c13b990 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8644009e50 tx=0x7f864400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c599cae7514c36f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.684+0000 7f95b7fff700 1 --2- 172.21.15.146:0/3073168206 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b8066410 0x7f95b81319f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f95a80098f0 tx=0x7f95a8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bad4c702e35adcb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.684+0000 7f864959a700 1 -- 172.21.15.146:0/470872906 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864400e070 con 0x7f864c130bc0 2023-10-03T10:15:03.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.685+0000 7f864959a700 1 -- 172.21.15.146:0/470872906 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8644003a20 con 0x7f864c130bc0 2023-10-03T10:15:03.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.685+0000 7f864959a700 1 -- 172.21.15.146:0/470872906 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8644003dd0 con 0x7f864c130bc0 2023-10-03T10:15:03.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.685+0000 7f95b6ffd700 1 -- 172.21.15.146:0/3073168206 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8005e30 con 0x7f95b8066410 2023-10-03T10:15:03.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.685+0000 7f95b6ffd700 1 -- 172.21.15.146:0/3073168206 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a8004030 con 0x7f95b8066410 2023-10-03T10:15:03.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.685+0000 7f95b6ffd700 1 -- 172.21.15.146:0/3073168206 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a80043e0 con 0x7f95b8066410 2023-10-03T10:15:03.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.685+0000 7f95be42b700 1 -- 172.21.15.146:0/3073168206 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b8066410 msgr2=0x7f95b81319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.685+0000 7f95be42b700 1 --2- 172.21.15.146:0/3073168206 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b8066410 0x7f95b81319f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f95a80098f0 tx=0x7f95a8009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:03.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.685+0000 7f8650d8a700 1 -- 172.21.15.146:0/470872906 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f864c130bc0 msgr2=0x7f864c13b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.685+0000 7f8650d8a700 1 --2- 172.21.15.146:0/470872906 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f864c130bc0 0x7f864c13b990 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8644009e50 tx=0x7f864400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:03.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.685+0000 7f95be42b700 1 -- 172.21.15.146:0/3073168206 shutdown_connections 2023-10-03T10:15:03.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.685+0000 7f95be42b700 1 --2- 172.21.15.146:0/3073168206 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b8066410 0x7f95b81319f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.685+0000 7f95be42b700 1 --2- 172.21.15.146:0/3073168206 >> v2:172.21.15.146:3300/0 conn(0x7f95b81314b0 0x7f95b8131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.685+0000 7f95be42b700 1 -- 172.21.15.146:0/3073168206 >> 172.21.15.146:0/3073168206 conn(0x7f95b80a2980 msgr2=0x7f95b80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.685+0000 7f8650d8a700 1 -- 172.21.15.146:0/470872906 shutdown_connections 2023-10-03T10:15:03.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.685+0000 7f8650d8a700 1 --2- 172.21.15.146:0/470872906 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f864c130bc0 0x7f864c13b990 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.685+0000 7f8650d8a700 1 --2- 172.21.15.146:0/470872906 >> v2:172.21.15.146:3300/0 conn(0x7f864c133ad0 0x7f864c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.685+0000 7f8650d8a700 1 -- 172.21.15.146:0/470872906 >> 172.21.15.146:0/470872906 conn(0x7f864c099c40 msgr2=0x7f864c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.685+0000 7f95be42b700 1 -- 172.21.15.146:0/3073168206 shutdown_connections 2023-10-03T10:15:03.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.685+0000 7f95be42b700 1 -- 172.21.15.146:0/3073168206 wait complete. 2023-10-03T10:15:03.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.686+0000 7f95be42b700 1 Processor -- start 2023-10-03T10:15:03.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.686+0000 7f8650d8a700 1 -- 172.21.15.146:0/470872906 shutdown_connections 2023-10-03T10:15:03.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.686+0000 7f8650d8a700 1 -- 172.21.15.146:0/470872906 wait complete. 2023-10-03T10:15:03.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.687+0000 7f8650d8a700 1 Processor -- start 2023-10-03T10:15:03.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.687+0000 7f95be42b700 1 -- start start 2023-10-03T10:15:03.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.687+0000 7f8650d8a700 1 -- start start 2023-10-03T10:15:03.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.687+0000 7f8650d8a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f864c130bc0 0x7f864c11cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.687+0000 7f8650d8a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f864c133ad0 0x7f864c11d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.687+0000 7f8650d8a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f864c119630 0x7f864c119aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.687+0000 7f8650d8a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c11ba80 con 0x7f864c119630 2023-10-03T10:15:03.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.687+0000 7f8650d8a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c11bd60 con 0x7f864c130bc0 2023-10-03T10:15:03.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.687+0000 7f8650d8a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f864c11c660 con 0x7f864c133ad0 2023-10-03T10:15:03.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.687+0000 7f95be42b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b8066410 0x7f95b813d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.687+0000 7f95be42b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95b809bc70 0x7f95b813d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.687+0000 7f95be42b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95b81314b0 0x7f95b8134350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.687+0000 7f95be42b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b8137de0 con 0x7f95b809bc70 2023-10-03T10:15:03.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.687+0000 7f95be42b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b80a1d50 con 0x7f95b8066410 2023-10-03T10:15:03.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.687+0000 7f95be42b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95b812dc10 con 0x7f95b81314b0 2023-10-03T10:15:03.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.687+0000 7f864ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f864c119630 0x7f864c119aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.687+0000 7f864a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f864c130bc0 0x7f864c11cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.687+0000 7f864ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f864c119630 0x7f864c119aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34384/0 (socket says 172.21.15.146:34384) 2023-10-03T10:15:03.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.687+0000 7f864ad9d700 1 -- 172.21.15.146:0/2732817009 learned_addr learned my addr 172.21.15.146:0/2732817009 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:03.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.687+0000 7f864a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f864c130bc0 0x7f864c11cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43572/0 (socket says 172.21.15.146:43572) 2023-10-03T10:15:03.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.687+0000 7f95b77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95b809bc70 0x7f95b813d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.688+0000 7f95b77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95b809bc70 0x7f95b813d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34398/0 (socket says 172.21.15.146:34398) 2023-10-03T10:15:03.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.688+0000 7f95b77fe700 1 -- 172.21.15.146:0/1928674450 learned_addr learned my addr 172.21.15.146:0/1928674450 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:03.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.688+0000 7f95b7fff700 1 --2- 172.21.15.146:0/1928674450 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b8066410 0x7f95b813d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.688+0000 7f864ad9d700 1 -- 172.21.15.146:0/2732817009 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f864c133ad0 msgr2=0x7f864c11d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.688+0000 7f864ad9d700 1 --2- 172.21.15.146:0/2732817009 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f864c133ad0 0x7f864c11d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.688+0000 7f864ad9d700 1 -- 172.21.15.146:0/2732817009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f864c130bc0 msgr2=0x7f864c11cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.688+0000 7f864ad9d700 1 --2- 172.21.15.146:0/2732817009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f864c130bc0 0x7f864c11cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.688+0000 7f864ad9d700 1 -- 172.21.15.146:0/2732817009 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863c0094a0 con 0x7f864c119630 2023-10-03T10:15:03.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.688+0000 7f95b77fe700 1 -- 172.21.15.146:0/1928674450 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95b81314b0 msgr2=0x7f95b8134350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.688+0000 7f95b77fe700 1 --2- 172.21.15.146:0/1928674450 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95b81314b0 0x7f95b8134350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.688+0000 7f95b77fe700 1 -- 172.21.15.146:0/1928674450 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b8066410 msgr2=0x7f95b813d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.688+0000 7f95b77fe700 1 --2- 172.21.15.146:0/1928674450 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b8066410 0x7f95b813d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.688+0000 7f95b77fe700 1 -- 172.21.15.146:0/1928674450 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a8009500 con 0x7f95b809bc70 2023-10-03T10:15:03.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.688+0000 7f864ad9d700 1 --2- 172.21.15.146:0/2732817009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f864c119630 0x7f864c119aa0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f864400b680 tx=0x7f8644004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.688+0000 7f95b77fe700 1 --2- 172.21.15.146:0/1928674450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95b809bc70 0x7f95b813d5a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f95ac00e7e0 tx=0x7f95ac00eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.688+0000 7f863affd700 1 -- 172.21.15.146:0/2732817009 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8644004440 con 0x7f864c119630 2023-10-03T10:15:03.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.688+0000 7f863affd700 1 -- 172.21.15.146:0/2732817009 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86440045a0 con 0x7f864c119630 2023-10-03T10:15:03.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.688+0000 7f863affd700 1 -- 172.21.15.146:0/2732817009 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8644004910 con 0x7f864c119630 2023-10-03T10:15:03.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.688+0000 7f8650d8a700 1 -- 172.21.15.146:0/2732817009 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8644009b30 con 0x7f864c119630 2023-10-03T10:15:03.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.688+0000 7f8650d8a700 1 -- 172.21.15.146:0/2732817009 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864c12dd00 con 0x7f864c119630 2023-10-03T10:15:03.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.688+0000 7f95b4ff9700 1 -- 172.21.15.146:0/1928674450 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac013610 con 0x7f95b809bc70 2023-10-03T10:15:03.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.689+0000 7f95b4ff9700 1 -- 172.21.15.146:0/1928674450 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ac013770 con 0x7f95b809bc70 2023-10-03T10:15:03.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.689+0000 7f95b4ff9700 1 -- 172.21.15.146:0/1928674450 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac013ae0 con 0x7f95b809bc70 2023-10-03T10:15:03.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.689+0000 7f95be42b700 1 -- 172.21.15.146:0/1928674450 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b8135f70 con 0x7f95b809bc70 2023-10-03T10:15:03.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.689+0000 7f95be42b700 1 -- 172.21.15.146:0/1928674450 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b8135720 con 0x7f95b809bc70 2023-10-03T10:15:03.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.690+0000 7f95b4ff9700 1 -- 172.21.15.146:0/1928674450 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f95ac013c40 con 0x7f95b809bc70 2023-10-03T10:15:03.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.690+0000 7f95b4ff9700 1 -- 172.21.15.146:0/1928674450 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f95ac03f4c0 con 0x7f95b809bc70 2023-10-03T10:15:03.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.690+0000 7f95be42b700 1 -- 172.21.15.146:0/1928674450 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95980052e0 con 0x7f95b809bc70 2023-10-03T10:15:03.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.690+0000 7f863affd700 1 -- 172.21.15.146:0/2732817009 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8644019070 con 0x7f864c119630 2023-10-03T10:15:03.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.690+0000 7f8650d8a700 1 -- 172.21.15.146:0/2732817009 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f864c11b880 con 0x7f864c119630 2023-10-03T10:15:03.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.691+0000 7f863affd700 1 -- 172.21.15.146:0/2732817009 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f86440407d0 con 0x7f864c119630 2023-10-03T10:15:03.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.693+0000 7f82ebe20700 1 Processor -- start 2023-10-03T10:15:03.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.693+0000 7f82ebe20700 1 -- start start 2023-10-03T10:15:03.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.694+0000 7f82ebe20700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f82e4136960 0x7f82e4138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.694+0000 7f82ebe20700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82e4139280 0x7f82e413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.694+0000 7f82ebe20700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e406b2d0 con 0x7f82e4133ad0 2023-10-03T10:15:03.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.694+0000 7f82ebe20700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e41345b0 con 0x7f82e4136960 2023-10-03T10:15:03.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.694+0000 7f82ebe20700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82e4133610 con 0x7f82e4139280 2023-10-03T10:15:03.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.694+0000 7f82e93bb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f82e4136960 0x7f82e4138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.694+0000 7f82e9bbc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f82e4133ad0 0x7f82e4133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38372/0 (socket says 172.21.15.146:38372) 2023-10-03T10:15:03.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.694+0000 7f82e9bbc700 1 -- 172.21.15.146:0/2268402272 learned_addr learned my addr 172.21.15.146:0/2268402272 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:03.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.694+0000 7f82e93bb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f82e4136960 0x7f82e4138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34408/0 (socket says 172.21.15.146:34408) 2023-10-03T10:15:03.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.694+0000 7f82ea3bd700 1 --2- 172.21.15.146:0/2268402272 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82e4139280 0x7f82e413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.694+0000 7f82e93bb700 1 -- 172.21.15.146:0/2268402272 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82e4139280 msgr2=0x7f82e413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:03.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.694+0000 7f82e93bb700 1 --2- 172.21.15.146:0/2268402272 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82e4139280 0x7f82e413b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.694+0000 7f82e93bb700 1 -- 172.21.15.146:0/2268402272 >> v1:172.21.15.146:6789/0 conn(0x7f82e4133ad0 legacy=0x7f82e4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.694+0000 7f82e93bb700 1 -- 172.21.15.146:0/2268402272 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e409a500 con 0x7f82e4136960 2023-10-03T10:15:03.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.694+0000 7f82e93bb700 1 --2- 172.21.15.146:0/2268402272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82e4136960 0x7f82e4138d40 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009840 tx=0x7f82d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0531ce8ffd55f00 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.696+0000 7f95b4ff9700 1 -- 172.21.15.146:0/1928674450 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f95ac012370 con 0x7f95b809bc70 2023-10-03T10:15:03.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.700+0000 7f82e8bba700 1 -- 172.21.15.146:0/2268402272 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d4011830 con 0x7f82e4136960 2023-10-03T10:15:03.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.700+0000 7f82e8bba700 1 -- 172.21.15.146:0/2268402272 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d4011990 con 0x7f82e4136960 2023-10-03T10:15:03.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.700+0000 7f82e8bba700 1 -- 172.21.15.146:0/2268402272 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d4011d20 con 0x7f82e4136960 2023-10-03T10:15:03.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.700+0000 7f863affd700 1 -- 172.21.15.146:0/2732817009 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f864401bd40 con 0x7f864c119630 2023-10-03T10:15:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.701+0000 7f82ebe20700 1 -- 172.21.15.146:0/2268402272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82e4136960 msgr2=0x7f82e4138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.701+0000 7f82ebe20700 1 --2- 172.21.15.146:0/2268402272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82e4136960 0x7f82e4138d40 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009840 tx=0x7f82d4009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.701+0000 7f82ebe20700 1 -- 172.21.15.146:0/2268402272 shutdown_connections 2023-10-03T10:15:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.701+0000 7f82ebe20700 1 --2- 172.21.15.146:0/2268402272 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82e4139280 0x7f82e413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.701+0000 7f82ebe20700 1 --2- 172.21.15.146:0/2268402272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82e4136960 0x7f82e4138d40 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.701+0000 7f82ebe20700 1 -- 172.21.15.146:0/2268402272 >> 172.21.15.146:0/2268402272 conn(0x7f82e4099c40 msgr2=0x7f82e40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.701+0000 7f82ebe20700 1 -- 172.21.15.146:0/2268402272 shutdown_connections 2023-10-03T10:15:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.701+0000 7f82ebe20700 1 -- 172.21.15.146:0/2268402272 wait complete. 2023-10-03T10:15:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.702+0000 7f82ebe20700 1 Processor -- start 2023-10-03T10:15:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.702+0000 7f82ebe20700 1 -- start start 2023-10-03T10:15:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.703+0000 7f82ebe20700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82e4133ad0 0x7f82e4070e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.703+0000 7f82ebe20700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82e4136960 0x7f82e40713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.703+0000 7f82ebe20700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82e4139280 0x7f82e4071900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.703+0000 7f82ebe20700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e406f830 con 0x7f82e4139280 2023-10-03T10:15:03.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.703+0000 7f82ebe20700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e412dd00 con 0x7f82e4133ad0 2023-10-03T10:15:03.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.703+0000 7f82ebe20700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82e406fd00 con 0x7f82e4136960 2023-10-03T10:15:03.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.703+0000 7f82e93bb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82e4136960 0x7f82e40713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.703+0000 7f82e93bb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82e4136960 0x7f82e40713c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59800/0 (socket says 172.21.15.146:59800) 2023-10-03T10:15:03.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.703+0000 7f82e93bb700 1 -- 172.21.15.146:0/2868371223 learned_addr learned my addr 172.21.15.146:0/2868371223 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:03.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.703+0000 7f82ea3bd700 1 --2- 172.21.15.146:0/2868371223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82e4139280 0x7f82e4071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.704+0000 7f82e93bb700 1 -- 172.21.15.146:0/2868371223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82e4133ad0 msgr2=0x7f82e4070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.704+0000 7f82e93bb700 1 --2- 172.21.15.146:0/2868371223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82e4133ad0 0x7f82e4070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.704+0000 7f82e93bb700 1 -- 172.21.15.146:0/2868371223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82e4139280 msgr2=0x7f82e4071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.704+0000 7f82e93bb700 1 --2- 172.21.15.146:0/2868371223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82e4139280 0x7f82e4071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.704+0000 7f82e93bb700 1 -- 172.21.15.146:0/2868371223 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d40094a0 con 0x7f82e4136960 2023-10-03T10:15:03.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.704+0000 7f82e93bb700 1 --2- 172.21.15.146:0/2868371223 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82e4136960 0x7f82e40713c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009fd0 tx=0x7f82d4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.704+0000 7f82da7fc700 1 -- 172.21.15.146:0/2868371223 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d40036a0 con 0x7f82e4136960 2023-10-03T10:15:03.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.704+0000 7f82da7fc700 1 -- 172.21.15.146:0/2868371223 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d401e070 con 0x7f82e4136960 2023-10-03T10:15:03.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.704+0000 7f82da7fc700 1 -- 172.21.15.146:0/2868371223 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d4003a20 con 0x7f82e4136960 2023-10-03T10:15:03.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.704+0000 7f82ebe20700 1 -- 172.21.15.146:0/2868371223 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e4071e40 con 0x7f82e4136960 2023-10-03T10:15:03.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.704+0000 7f82ebe20700 1 -- 172.21.15.146:0/2868371223 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e40702a0 con 0x7f82e4136960 2023-10-03T10:15:03.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.705+0000 7f82da7fc700 1 -- 172.21.15.146:0/2868371223 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82d4003b80 con 0x7f82e4136960 2023-10-03T10:15:03.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.705+0000 7f82da7fc700 1 -- 172.21.15.146:0/2868371223 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f82d4020070 con 0x7f82e4136960 2023-10-03T10:15:03.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.706+0000 7f82ebe20700 1 -- 172.21.15.146:0/2868371223 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e404f2a0 con 0x7f82e4136960 2023-10-03T10:15:03.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.710+0000 7f82da7fc700 1 -- 172.21.15.146:0/2868371223 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82d4015070 con 0x7f82e4136960 2023-10-03T10:15:03.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.884+0000 7fc1a7467700 1 -- 172.21.15.146:0/2284497463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc1a004f2a0 con 0x7fc1a01300a0 2023-10-03T10:15:03.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.884+0000 7fc195ffb700 1 -- 172.21.15.146:0/2284497463 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc19c017020 con 0x7fc1a01300a0 2023-10-03T10:15:03.886 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:03.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.886+0000 7fc1a7467700 1 -- 172.21.15.146:0/2284497463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1a01300a0 msgr2=0x7fc1a01c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.886+0000 7fc1a7467700 1 --2- 172.21.15.146:0/2284497463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1a01300a0 0x7fc1a01c89c0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00ebe0 tx=0x7fc19c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.886+0000 7fc1a7467700 1 -- 172.21.15.146:0/2284497463 shutdown_connections 2023-10-03T10:15:03.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.886+0000 7fc1a7467700 1 --2- 172.21.15.146:0/2284497463 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc1a0133ad0 0x7fc1a006e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.886+0000 7fc1a7467700 1 --2- 172.21.15.146:0/2284497463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1a01300a0 0x7fc1a01c89c0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.886+0000 7fc1a7467700 1 --2- 172.21.15.146:0/2284497463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc1a01309f0 0x7fc1a01c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.886+0000 7fc1a7467700 1 -- 172.21.15.146:0/2284497463 >> 172.21.15.146:0/2284497463 conn(0x7fc1a0099c40 msgr2=0x7fc1a0131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.887+0000 7fc1a7467700 1 -- 172.21.15.146:0/2284497463 shutdown_connections 2023-10-03T10:15:03.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.887+0000 7fc1a7467700 1 -- 172.21.15.146:0/2284497463 wait complete. 2023-10-03T10:15:03.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.891+0000 7f95be42b700 1 -- 172.21.15.146:0/1928674450 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9598005590 con 0x7f95b809bc70 2023-10-03T10:15:03.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.892+0000 7f95b4ff9700 1 -- 172.21.15.146:0/1928674450 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f95ac02b090 con 0x7f95b809bc70 2023-10-03T10:15:03.891 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:03.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.894+0000 7f95be42b700 1 -- 172.21.15.146:0/1928674450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95b809bc70 msgr2=0x7f95b813d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.894+0000 7f95be42b700 1 --2- 172.21.15.146:0/1928674450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95b809bc70 0x7f95b813d5a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f95ac00e7e0 tx=0x7f95ac00eaf0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.894+0000 7f95be42b700 1 -- 172.21.15.146:0/1928674450 shutdown_connections 2023-10-03T10:15:03.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.894+0000 7f95be42b700 1 --2- 172.21.15.146:0/1928674450 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95b81314b0 0x7f95b8134350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.894+0000 7f95be42b700 1 --2- 172.21.15.146:0/1928674450 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95b8066410 0x7f95b813d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.894+0000 7f95be42b700 1 --2- 172.21.15.146:0/1928674450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95b809bc70 0x7f95b813d5a0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.894+0000 7f95be42b700 1 -- 172.21.15.146:0/1928674450 >> 172.21.15.146:0/1928674450 conn(0x7f95b80a2980 msgr2=0x7f95b812ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.895+0000 7f95be42b700 1 -- 172.21.15.146:0/1928674450 shutdown_connections 2023-10-03T10:15:03.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.895+0000 7f95be42b700 1 -- 172.21.15.146:0/1928674450 wait complete. 2023-10-03T10:15:03.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.896+0000 7f8650d8a700 1 -- 172.21.15.146:0/2732817009 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f864c04f2a0 con 0x7f864c119630 2023-10-03T10:15:03.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.896+0000 7f863affd700 1 -- 172.21.15.146:0/2732817009 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8644020020 con 0x7f864c119630 2023-10-03T10:15:03.896 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:03.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.899+0000 7f8650d8a700 1 -- 172.21.15.146:0/2732817009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f864c119630 msgr2=0x7f864c119aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.899+0000 7f8650d8a700 1 --2- 172.21.15.146:0/2732817009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f864c119630 0x7f864c119aa0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f864400b680 tx=0x7f8644004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.899+0000 7f8650d8a700 1 -- 172.21.15.146:0/2732817009 shutdown_connections 2023-10-03T10:15:03.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.899+0000 7f8650d8a700 1 --2- 172.21.15.146:0/2732817009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f864c119630 0x7f864c119aa0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.899+0000 7f8650d8a700 1 --2- 172.21.15.146:0/2732817009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f864c130bc0 0x7f864c11cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.899+0000 7f8650d8a700 1 --2- 172.21.15.146:0/2732817009 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f864c133ad0 0x7f864c11d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.899+0000 7f8650d8a700 1 -- 172.21.15.146:0/2732817009 >> 172.21.15.146:0/2732817009 conn(0x7f864c099c40 msgr2=0x7f864c131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.899+0000 7f8650d8a700 1 -- 172.21.15.146:0/2732817009 shutdown_connections 2023-10-03T10:15:03.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.899+0000 7f8650d8a700 1 -- 172.21.15.146:0/2732817009 wait complete. 2023-10-03T10:15:03.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:03.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:03.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:03.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.924+0000 7f82ebe20700 1 -- 172.21.15.146:0/2868371223 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f82e411d820 con 0x7f82e4136960 2023-10-03T10:15:03.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.924+0000 7f82da7fc700 1 -- 172.21.15.146:0/2868371223 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f82d4015020 con 0x7f82e4136960 2023-10-03T10:15:03.924 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:03.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.926+0000 7f82ebe20700 1 -- 172.21.15.146:0/2868371223 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82e4136960 msgr2=0x7f82e40713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.926+0000 7f82ebe20700 1 --2- 172.21.15.146:0/2868371223 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82e4136960 0x7f82e40713c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009fd0 tx=0x7f82d4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:03.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.926+0000 7f82ebe20700 1 -- 172.21.15.146:0/2868371223 shutdown_connections 2023-10-03T10:15:03.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.926+0000 7f82ebe20700 1 --2- 172.21.15.146:0/2868371223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82e4139280 0x7f82e4071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.926+0000 7f82ebe20700 1 --2- 172.21.15.146:0/2868371223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82e4133ad0 0x7f82e4070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.926+0000 7f82ebe20700 1 --2- 172.21.15.146:0/2868371223 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82e4136960 0x7f82e40713c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.926+0000 7f82ebe20700 1 -- 172.21.15.146:0/2868371223 >> 172.21.15.146:0/2868371223 conn(0x7f82e4099c40 msgr2=0x7f82e4134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.926+0000 7f82ebe20700 1 -- 172.21.15.146:0/2868371223 shutdown_connections 2023-10-03T10:15:03.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:03.926+0000 7f82ebe20700 1 -- 172.21.15.146:0/2868371223 wait complete. 2023-10-03T10:15:03.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:04.901 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:04.910 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:04.912 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:04.939 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.057+0000 7fc92e1cb700 1 Processor -- start 2023-10-03T10:15:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.058+0000 7fc92e1cb700 1 -- start start 2023-10-03T10:15:05.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.058+0000 7fc92e1cb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc92806b250 0x7fc928136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.058+0000 7fc92e1cb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc928137140 0x7fc928139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.058+0000 7fc92e1cb700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92809da80 con 0x7fc92806a770 2023-10-03T10:15:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.058+0000 7fc92e1cb700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92809f770 con 0x7fc92806b250 2023-10-03T10:15:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.058+0000 7fc92e1cb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc92809dce0 con 0x7fc928137140 2023-10-03T10:15:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.059+0000 7fc927fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc928137140 0x7fc928139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.059+0000 7fc9277fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc92806a770 0x7fc92806ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:57482/0 (socket says 172.21.15.146:57482) 2023-10-03T10:15:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.059+0000 7fc9277fe700 1 -- 172.21.15.146:0/85356579 learned_addr learned my addr 172.21.15.146:0/85356579 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.059+0000 7fc926ffd700 1 --2- 172.21.15.146:0/85356579 >> v2:172.21.15.146:3300/0 conn(0x7fc92806b250 0x7fc928136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.059+0000 7fc927fff700 1 -- 172.21.15.146:0/85356579 >> v2:172.21.15.146:3300/0 conn(0x7fc92806b250 msgr2=0x7fc928136c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.059+0000 7fc927fff700 1 --2- 172.21.15.146:0/85356579 >> v2:172.21.15.146:3300/0 conn(0x7fc92806b250 0x7fc928136c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.059+0000 7fc927fff700 1 -- 172.21.15.146:0/85356579 >> v1:172.21.15.146:6789/0 conn(0x7fc92806a770 legacy=0x7fc92806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.059+0000 7fc927fff700 1 -- 172.21.15.146:0/85356579 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92809eb20 con 0x7fc928137140 2023-10-03T10:15:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.059+0000 7fc927fff700 1 --2- 172.21.15.146:0/85356579 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc928137140 0x7fc928139520 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc920009d90 tx=0x7fc92000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72344e94475671d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.059+0000 7fc9267fc700 1 -- 172.21.15.146:0/85356579 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92000e070 con 0x7fc928137140 2023-10-03T10:15:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.059+0000 7fc9267fc700 1 -- 172.21.15.146:0/85356579 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92000bb20 con 0x7fc928137140 2023-10-03T10:15:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.059+0000 7fc9267fc700 1 -- 172.21.15.146:0/85356579 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920012430 con 0x7fc928137140 2023-10-03T10:15:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.060+0000 7fc92e1cb700 1 -- 172.21.15.146:0/85356579 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc928137140 msgr2=0x7fc928139520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.060+0000 7fc92e1cb700 1 --2- 172.21.15.146:0/85356579 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc928137140 0x7fc928139520 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc920009d90 tx=0x7fc92000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.060+0000 7fc92e1cb700 1 -- 172.21.15.146:0/85356579 shutdown_connections 2023-10-03T10:15:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.060+0000 7fc92e1cb700 1 --2- 172.21.15.146:0/85356579 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc928137140 0x7fc928139520 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.060+0000 7fc92e1cb700 1 --2- 172.21.15.146:0/85356579 >> v2:172.21.15.146:3300/0 conn(0x7fc92806b250 0x7fc928136c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.060+0000 7fc92e1cb700 1 -- 172.21.15.146:0/85356579 >> 172.21.15.146:0/85356579 conn(0x7fc928099c40 msgr2=0x7fc9280a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.060+0000 7fc92e1cb700 1 -- 172.21.15.146:0/85356579 shutdown_connections 2023-10-03T10:15:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.060+0000 7fc92e1cb700 1 -- 172.21.15.146:0/85356579 wait complete. 2023-10-03T10:15:05.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.061+0000 7fc92e1cb700 1 Processor -- start 2023-10-03T10:15:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.061+0000 7fc92e1cb700 1 -- start start 2023-10-03T10:15:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.062+0000 7fc92e1cb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc92806a770 0x7fc92809a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.062+0000 7fc92e1cb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc92806b250 0x7fc92809a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.062+0000 7fc92e1cb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc928137140 0x7fc92809af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.062+0000 7fc92e1cb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc928125e30 con 0x7fc928137140 2023-10-03T10:15:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.062+0000 7fc92e1cb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9280a2570 con 0x7fc92806b250 2023-10-03T10:15:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.062+0000 7fc92e1cb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc92809bff0 con 0x7fc92806a770 2023-10-03T10:15:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.062+0000 7fc9277fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc92806a770 0x7fc92809a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.062+0000 7fc9277fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc92806a770 0x7fc92809a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38564/0 (socket says 172.21.15.146:38564) 2023-10-03T10:15:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.062+0000 7fc9277fe700 1 -- 172.21.15.146:0/1810605471 learned_addr learned my addr 172.21.15.146:0/1810605471 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.062+0000 7fc927fff700 1 --2- 172.21.15.146:0/1810605471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc928137140 0x7fc92809af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.062+0000 7fc926ffd700 1 --2- 172.21.15.146:0/1810605471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc92806b250 0x7fc92809a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.062+0000 7fc927fff700 1 -- 172.21.15.146:0/1810605471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc92806a770 msgr2=0x7fc92809a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.062+0000 7fc927fff700 1 --2- 172.21.15.146:0/1810605471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc92806a770 0x7fc92809a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.062+0000 7fc927fff700 1 -- 172.21.15.146:0/1810605471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc92806b250 msgr2=0x7fc92809a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.062+0000 7fc927fff700 1 --2- 172.21.15.146:0/1810605471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc92806b250 0x7fc92809a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.062+0000 7fc927fff700 1 -- 172.21.15.146:0/1810605471 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc920009a70 con 0x7fc928137140 2023-10-03T10:15:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.062+0000 7fc926ffd700 1 --2- 172.21.15.146:0/1810605471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc92806b250 0x7fc92809a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.062+0000 7fc9277fe700 1 --2- 172.21.15.146:0/1810605471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc92806a770 0x7fc92809a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.063+0000 7fc927fff700 1 --2- 172.21.15.146:0/1810605471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc928137140 0x7fc92809af10 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc920016000 tx=0x7fc920004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.063+0000 7fc90ffff700 1 -- 172.21.15.146:0/1810605471 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920012430 con 0x7fc928137140 2023-10-03T10:15:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.063+0000 7fc90ffff700 1 -- 172.21.15.146:0/1810605471 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc920020070 con 0x7fc928137140 2023-10-03T10:15:05.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.063+0000 7fc92e1cb700 1 -- 172.21.15.146:0/1810605471 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc928126060 con 0x7fc928137140 2023-10-03T10:15:05.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.063+0000 7fc90ffff700 1 -- 172.21.15.146:0/1810605471 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920004280 con 0x7fc928137140 2023-10-03T10:15:05.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.063+0000 7fc92e1cb700 1 -- 172.21.15.146:0/1810605471 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc928071e60 con 0x7fc928137140 2023-10-03T10:15:05.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.064+0000 7fc90ffff700 1 -- 172.21.15.146:0/1810605471 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc9200043e0 con 0x7fc928137140 2023-10-03T10:15:05.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.064+0000 7fc90ffff700 1 -- 172.21.15.146:0/1810605471 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc920022070 con 0x7fc928137140 2023-10-03T10:15:05.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.064+0000 7fc92e1cb700 1 -- 172.21.15.146:0/1810605471 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92804f2a0 con 0x7fc928137140 2023-10-03T10:15:05.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.073+0000 7fc90ffff700 1 -- 172.21.15.146:0/1810605471 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc920009860 con 0x7fc928137140 2023-10-03T10:15:05.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.087+0000 7f6b7ca12700 1 Processor -- start 2023-10-03T10:15:05.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.087+0000 7f6b7ca12700 1 -- start start 2023-10-03T10:15:05.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.088+0000 7f6b7ca12700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6b78133ad0 0x7f6b78133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.088+0000 7f6b7ca12700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b78130bc0 0x7f6b7813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.088+0000 7f6b7ca12700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b7806b2d0 con 0x7f6b781300a0 2023-10-03T10:15:05.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.088+0000 7f6b7ca12700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b78133610 con 0x7f6b78133ad0 2023-10-03T10:15:05.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.088+0000 7f6b7ca12700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7809a500 con 0x7f6b78130bc0 2023-10-03T10:15:05.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.088+0000 7f45cb066700 1 Processor -- start 2023-10-03T10:15:05.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.088+0000 7f6b7659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6b78133ad0 0x7f6b78133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.088+0000 7f6b76d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b78130bc0 0x7f6b7813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.088+0000 7f6b76d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b78130bc0 0x7f6b7813b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50966/0 (socket says 172.21.15.146:50966) 2023-10-03T10:15:05.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.088+0000 7f6b7659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6b78133ad0 0x7f6b78133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35150/0 (socket says 172.21.15.146:35150) 2023-10-03T10:15:05.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.088+0000 7f6b76d9d700 1 -- 172.21.15.146:0/1766983677 learned_addr learned my addr 172.21.15.146:0/1766983677 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:05.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.088+0000 7f45cb066700 1 -- start start 2023-10-03T10:15:05.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.089+0000 7f6b7659c700 1 -- 172.21.15.146:0/1766983677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b78130bc0 msgr2=0x7f6b7813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.089+0000 7f6b7659c700 1 --2- 172.21.15.146:0/1766983677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b78130bc0 0x7f6b7813b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.089+0000 7f6b7659c700 1 -- 172.21.15.146:0/1766983677 >> v1:172.21.15.146:6789/0 conn(0x7f6b781300a0 legacy=0x7f6b781304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.089+0000 7f6b7659c700 1 -- 172.21.15.146:0/1766983677 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b781338b0 con 0x7f6b78133ad0 2023-10-03T10:15:05.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.089+0000 7f6b7659c700 1 --2- 172.21.15.146:0/1766983677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b78133ad0 0x7f6b78133ea0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009840 tx=0x7f6b68009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d2363996837021 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.089+0000 7f45cb066700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f45c409d860 0x7f45c409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.089+0000 7f45cb066700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c409e170 0x7f45c41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.089+0000 7f6b7559a700 1 -- 172.21.15.146:0/1766983677 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68011830 con 0x7f6b78133ad0 2023-10-03T10:15:05.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.089+0000 7f6b7559a700 1 -- 172.21.15.146:0/1766983677 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b68011990 con 0x7f6b78133ad0 2023-10-03T10:15:05.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.089+0000 7f6b7559a700 1 -- 172.21.15.146:0/1766983677 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68011d20 con 0x7f6b78133ad0 2023-10-03T10:15:05.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.089+0000 7f45cb066700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c409aaa0 con 0x7f45c4130ce0 2023-10-03T10:15:05.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.089+0000 7f45cb066700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c409f870 con 0x7f45c409d860 2023-10-03T10:15:05.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.089+0000 7f45cb066700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c409b360 con 0x7f45c409e170 2023-10-03T10:15:05.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.089+0000 7f45c3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c409e170 0x7f45c41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.090+0000 7f45c3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c409e170 0x7f45c41307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50982/0 (socket says 172.21.15.146:50982) 2023-10-03T10:15:05.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.090+0000 7f45c3fff700 1 -- 172.21.15.146:0/1232216249 learned_addr learned my addr 172.21.15.146:0/1232216249 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:05.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.090+0000 7f45c8e02700 1 --2- 172.21.15.146:0/1232216249 >> v2:172.21.15.146:3300/0 conn(0x7f45c409d860 0x7f45c409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.090+0000 7f45c3fff700 1 -- 172.21.15.146:0/1232216249 >> v2:172.21.15.146:3300/0 conn(0x7f45c409d860 msgr2=0x7f45c409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.090+0000 7f45c3fff700 1 --2- 172.21.15.146:0/1232216249 >> v2:172.21.15.146:3300/0 conn(0x7f45c409d860 0x7f45c409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.090+0000 7f45c3fff700 1 -- 172.21.15.146:0/1232216249 >> v1:172.21.15.146:6789/0 conn(0x7f45c4130ce0 legacy=0x7f45c41379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.090+0000 7f45c3fff700 1 -- 172.21.15.146:0/1232216249 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c409b620 con 0x7f45c409e170 2023-10-03T10:15:05.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.090+0000 7f6b7ca12700 1 -- 172.21.15.146:0/1766983677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b78133ad0 msgr2=0x7f6b78133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.090+0000 7f6b7ca12700 1 --2- 172.21.15.146:0/1766983677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b78133ad0 0x7f6b78133ea0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009840 tx=0x7f6b68009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:05.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.090+0000 7f45c3fff700 1 --2- 172.21.15.146:0/1232216249 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c409e170 0x7f45c41307a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f45b80098f0 tx=0x7f45b8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3355c2e739878560 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.090+0000 7f6b7ca12700 1 -- 172.21.15.146:0/1766983677 shutdown_connections 2023-10-03T10:15:05.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.090+0000 7f6b7ca12700 1 --2- 172.21.15.146:0/1766983677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b78130bc0 0x7f6b7813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.090+0000 7f45c37fe700 1 -- 172.21.15.146:0/1232216249 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b8011830 con 0x7f45c409e170 2023-10-03T10:15:05.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.090+0000 7f6b7ca12700 1 --2- 172.21.15.146:0/1766983677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b78133ad0 0x7f6b78133ea0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.090+0000 7f6b7ca12700 1 -- 172.21.15.146:0/1766983677 >> 172.21.15.146:0/1766983677 conn(0x7f6b78099c40 msgr2=0x7f6b780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.090+0000 7f45c37fe700 1 -- 172.21.15.146:0/1232216249 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b8011990 con 0x7f45c409e170 2023-10-03T10:15:05.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.090+0000 7f45c37fe700 1 -- 172.21.15.146:0/1232216249 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b8011d20 con 0x7f45c409e170 2023-10-03T10:15:05.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.090+0000 7f6b7ca12700 1 -- 172.21.15.146:0/1766983677 shutdown_connections 2023-10-03T10:15:05.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.091+0000 7f6b7ca12700 1 -- 172.21.15.146:0/1766983677 wait complete. 2023-10-03T10:15:05.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.091+0000 7f45cb066700 1 -- 172.21.15.146:0/1232216249 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c409e170 msgr2=0x7f45c41307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.091+0000 7f45cb066700 1 --2- 172.21.15.146:0/1232216249 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c409e170 0x7f45c41307a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f45b80098f0 tx=0x7f45b8009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:05.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.091+0000 7f45cb066700 1 -- 172.21.15.146:0/1232216249 shutdown_connections 2023-10-03T10:15:05.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.091+0000 7f45cb066700 1 --2- 172.21.15.146:0/1232216249 >> v2:172.21.15.146:3300/0 conn(0x7f45c409d860 0x7f45c409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.091+0000 7f45cb066700 1 --2- 172.21.15.146:0/1232216249 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c409e170 0x7f45c41307a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.091+0000 7f45cb066700 1 -- 172.21.15.146:0/1232216249 >> 172.21.15.146:0/1232216249 conn(0x7f45c4099c40 msgr2=0x7f45c40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.091+0000 7f45cb066700 1 -- 172.21.15.146:0/1232216249 shutdown_connections 2023-10-03T10:15:05.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.091+0000 7f45cb066700 1 -- 172.21.15.146:0/1232216249 wait complete. 2023-10-03T10:15:05.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.092+0000 7f6b7ca12700 1 Processor -- start 2023-10-03T10:15:05.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.092+0000 7f6b7ca12700 1 -- start start 2023-10-03T10:15:05.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.092+0000 7f45cb066700 1 Processor -- start 2023-10-03T10:15:05.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.092+0000 7f6b7ca12700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b781300a0 0x7f6b7811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.092+0000 7f6b7ca12700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b78130bc0 0x7f6b7811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.092+0000 7f6b7ca12700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b78133ad0 0x7f6b7811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.092+0000 7f6b7ca12700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7812dd00 con 0x7f6b78133ad0 2023-10-03T10:15:05.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.092+0000 7f6b7ca12700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b78072330 con 0x7f6b781300a0 2023-10-03T10:15:05.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.092+0000 7f6b7ca12700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7811ffb0 con 0x7f6b78130bc0 2023-10-03T10:15:05.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.092+0000 7f6b76d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b78133ad0 0x7f6b7811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.092+0000 7f6b7659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b781300a0 0x7f6b7811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.092+0000 7f6b76d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b78133ad0 0x7f6b7811e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35172/0 (socket says 172.21.15.146:35172) 2023-10-03T10:15:05.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.092+0000 7f6b76d9d700 1 -- 172.21.15.146:0/657416808 learned_addr learned my addr 172.21.15.146:0/657416808 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:05.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.093+0000 7f6b76d9d700 1 -- 172.21.15.146:0/657416808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b78130bc0 msgr2=0x7f6b7811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.093+0000 7f6b76d9d700 1 --2- 172.21.15.146:0/657416808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b78130bc0 0x7f6b7811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.093+0000 7f6b76d9d700 1 -- 172.21.15.146:0/657416808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b781300a0 msgr2=0x7f6b7811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.093+0000 7f6b76d9d700 1 --2- 172.21.15.146:0/657416808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b781300a0 0x7f6b7811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.093+0000 7f6b76d9d700 1 -- 172.21.15.146:0/657416808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b680094a0 con 0x7f6b78133ad0 2023-10-03T10:15:05.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.093+0000 7f6b76d9d700 1 --2- 172.21.15.146:0/657416808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b78133ad0 0x7f6b7811e4c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009d90 tx=0x7f6b7000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.093+0000 7f6b66ffd700 1 -- 172.21.15.146:0/657416808 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70003c20 con 0x7f6b78133ad0 2023-10-03T10:15:05.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.093+0000 7f45cb066700 1 -- start start 2023-10-03T10:15:05.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.093+0000 7f45cb066700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45c409d860 0x7f45c412a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.093+0000 7f45cb066700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c409e170 0x7f45c412a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.093+0000 7f45cb066700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45c4130ce0 0x7f45c412aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.093+0000 7f45cb066700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c412c9a0 con 0x7f45c4130ce0 2023-10-03T10:15:05.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.093+0000 7f45cb066700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c409c8b0 con 0x7f45c409e170 2023-10-03T10:15:05.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.093+0000 7f45cb066700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45c412d900 con 0x7f45c409d860 2023-10-03T10:15:05.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.093+0000 7f45c3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c409e170 0x7f45c412a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.093+0000 7f45c3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c409e170 0x7f45c412a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51002/0 (socket says 172.21.15.146:51002) 2023-10-03T10:15:05.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.093+0000 7f45c3fff700 1 -- 172.21.15.146:0/2708246994 learned_addr learned my addr 172.21.15.146:0/2708246994 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:05.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.094+0000 7f45c8e02700 1 --2- 172.21.15.146:0/2708246994 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45c409d860 0x7f45c412a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.094+0000 7f45c3fff700 1 -- 172.21.15.146:0/2708246994 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45c409d860 msgr2=0x7f45c412a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.094+0000 7f45c3fff700 1 --2- 172.21.15.146:0/2708246994 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45c409d860 0x7f45c412a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.094+0000 7f45c3fff700 1 -- 172.21.15.146:0/2708246994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45c4130ce0 msgr2=0x7f45c412aec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:15:05.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.094+0000 7f45c3fff700 1 --2- 172.21.15.146:0/2708246994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45c4130ce0 0x7f45c412aec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.094+0000 7f45c3fff700 1 -- 172.21.15.146:0/2708246994 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b8009550 con 0x7f45c409e170 2023-10-03T10:15:05.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.094+0000 7f45c8e02700 1 --2- 172.21.15.146:0/2708246994 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45c409d860 0x7f45c412a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:05.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.094+0000 7f45c3fff700 1 --2- 172.21.15.146:0/2708246994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c409e170 0x7f45c412a980 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f45b8009c40 tx=0x7f45b8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.093+0000 7f6b66ffd700 1 -- 172.21.15.146:0/657416808 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7000f040 con 0x7f6b78133ad0 2023-10-03T10:15:05.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.093+0000 7f6b7ca12700 1 -- 172.21.15.146:0/657416808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b78120be0 con 0x7f6b78133ad0 2023-10-03T10:15:05.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.093+0000 7f6b66ffd700 1 -- 172.21.15.146:0/657416808 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7000c930 con 0x7f6b78133ad0 2023-10-03T10:15:05.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.093+0000 7f6b7ca12700 1 -- 172.21.15.146:0/657416808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7812d290 con 0x7f6b78133ad0 2023-10-03T10:15:05.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.094+0000 7f6b66ffd700 1 -- 172.21.15.146:0/657416808 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b7000ca90 con 0x7f6b78133ad0 2023-10-03T10:15:05.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.095+0000 7f6b66ffd700 1 -- 172.21.15.146:0/657416808 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6b7003fb40 con 0x7f6b78133ad0 2023-10-03T10:15:05.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.095+0000 7f6b7ca12700 1 -- 172.21.15.146:0/657416808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b5c00daf0 con 0x7f6b78133ad0 2023-10-03T10:15:05.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.095+0000 7f45c17fa700 1 -- 172.21.15.146:0/2708246994 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b80036a0 con 0x7f45c409e170 2023-10-03T10:15:05.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.095+0000 7f45c17fa700 1 -- 172.21.15.146:0/2708246994 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b8003800 con 0x7f45c409e170 2023-10-03T10:15:05.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.095+0000 7f45c17fa700 1 -- 172.21.15.146:0/2708246994 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b8003b90 con 0x7f45c409e170 2023-10-03T10:15:05.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.095+0000 7f45cb066700 1 -- 172.21.15.146:0/2708246994 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c412c1d0 con 0x7f45c409e170 2023-10-03T10:15:05.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.095+0000 7f45cb066700 1 -- 172.21.15.146:0/2708246994 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c412b820 con 0x7f45c409e170 2023-10-03T10:15:05.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.095+0000 7f45c17fa700 1 -- 172.21.15.146:0/2708246994 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f45b8021070 con 0x7f45c409e170 2023-10-03T10:15:05.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.096+0000 7f45c17fa700 1 -- 172.21.15.146:0/2708246994 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f45b8044260 con 0x7f45c409e170 2023-10-03T10:15:05.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.095+0000 7fe93ab74700 1 Processor -- start 2023-10-03T10:15:05.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.095+0000 7fe93ab74700 1 -- start start 2023-10-03T10:15:05.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.096+0000 7fe93ab74700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9340a0a30 0x7fe9340a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.096+0000 7fe93ab74700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe9340a1340 0x7fe93412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.096+0000 7fe93ab74700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9341304a0 0x7fe934130940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.096+0000 7fe93ab74700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9340a1e70 con 0x7fe9340a1340 2023-10-03T10:15:05.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.096+0000 7fe93ab74700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93409a720 con 0x7fe9340a0a30 2023-10-03T10:15:05.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.096+0000 7fe93ab74700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe93409b300 con 0x7fe9341304a0 2023-10-03T10:15:05.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.096+0000 7fe938910700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9340a0a30 0x7fe9340a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.096+0000 7fe938910700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9340a0a30 0x7fe9340a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51012/0 (socket says 172.21.15.146:51012) 2023-10-03T10:15:05.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.096+0000 7fe938910700 1 -- 172.21.15.146:0/1220940141 learned_addr learned my addr 172.21.15.146:0/1220940141 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:05.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.096+0000 7fe939111700 1 --2- 172.21.15.146:0/1220940141 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9341304a0 0x7fe934130940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.096+0000 7fe938910700 1 -- 172.21.15.146:0/1220940141 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9341304a0 msgr2=0x7fe934130940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.096+0000 7fe938910700 1 --2- 172.21.15.146:0/1220940141 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9341304a0 0x7fe934130940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.096+0000 7fe938910700 1 -- 172.21.15.146:0/1220940141 >> v2:172.21.15.146:3300/0 conn(0x7fe9340a1340 msgr2=0x7fe93412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.096+0000 7fe938910700 1 --2- 172.21.15.146:0/1220940141 >> v2:172.21.15.146:3300/0 conn(0x7fe9340a1340 0x7fe93412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.096+0000 7fe938910700 1 -- 172.21.15.146:0/1220940141 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93409abc0 con 0x7fe9340a0a30 2023-10-03T10:15:05.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.096+0000 7fe938910700 1 --2- 172.21.15.146:0/1220940141 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9340a0a30 0x7fe9340a0e00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe920006fd0 tx=0x7fe92000be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a3ef4f24d8b422c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.096+0000 7fe9337fe700 1 -- 172.21.15.146:0/1220940141 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe920005c20 con 0x7fe9340a0a30 2023-10-03T10:15:05.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.096+0000 7fe9337fe700 1 -- 172.21.15.146:0/1220940141 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe920005d80 con 0x7fe9340a0a30 2023-10-03T10:15:05.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.096+0000 7fe9337fe700 1 -- 172.21.15.146:0/1220940141 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92000dc40 con 0x7fe9340a0a30 2023-10-03T10:15:05.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.097+0000 7f45cb066700 1 -- 172.21.15.146:0/2708246994 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c41b8d30 con 0x7f45c409e170 2023-10-03T10:15:05.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.097+0000 7fe93ab74700 1 -- 172.21.15.146:0/1220940141 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9340a0a30 msgr2=0x7fe9340a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.097+0000 7fe93ab74700 1 --2- 172.21.15.146:0/1220940141 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9340a0a30 0x7fe9340a0e00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe920006fd0 tx=0x7fe92000be70 comp rx=0 tx=0).stop 2023-10-03T10:15:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.097+0000 7fe93ab74700 1 -- 172.21.15.146:0/1220940141 shutdown_connections 2023-10-03T10:15:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.097+0000 7fe93ab74700 1 --2- 172.21.15.146:0/1220940141 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9340a0a30 0x7fe9340a0e00 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.097+0000 7fe93ab74700 1 --2- 172.21.15.146:0/1220940141 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9341304a0 0x7fe934130940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.097+0000 7fe93ab74700 1 --2- 172.21.15.146:0/1220940141 >> v2:172.21.15.146:3300/0 conn(0x7fe9340a1340 0x7fe93412ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.097+0000 7fe93ab74700 1 -- 172.21.15.146:0/1220940141 >> 172.21.15.146:0/1220940141 conn(0x7fe9340a2980 msgr2=0x7fe9340a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.097+0000 7fe93ab74700 1 -- 172.21.15.146:0/1220940141 shutdown_connections 2023-10-03T10:15:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.097+0000 7fe93ab74700 1 -- 172.21.15.146:0/1220940141 wait complete. 2023-10-03T10:15:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.098+0000 7fe93ab74700 1 Processor -- start 2023-10-03T10:15:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.099+0000 7fe93ab74700 1 -- start start 2023-10-03T10:15:05.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.099+0000 7fe93ab74700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9340a0a30 0x7fe9341d5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.099+0000 7fe93ab74700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9340a1340 0x7fe9341d5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.099+0000 7fe93ab74700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9341304a0 0x7fe9341d5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.099+0000 7fe93ab74700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93412c740 con 0x7fe9341304a0 2023-10-03T10:15:05.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.099+0000 7fe93ab74700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93412b3c0 con 0x7fe9340a1340 2023-10-03T10:15:05.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.099+0000 7fe93ab74700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe93409fc40 con 0x7fe9340a0a30 2023-10-03T10:15:05.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.099+0000 7fe938910700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9340a0a30 0x7fe9341d5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.099+0000 7fe938910700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9340a0a30 0x7fe9341d5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38622/0 (socket says 172.21.15.146:38622) 2023-10-03T10:15:05.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.100+0000 7fe938910700 1 -- 172.21.15.146:0/187952857 learned_addr learned my addr 172.21.15.146:0/187952857 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:05.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.100+0000 7fe933fff700 1 --2- 172.21.15.146:0/187952857 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9340a1340 0x7fe9341d5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.100+0000 7fe939111700 1 --2- 172.21.15.146:0/187952857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9341304a0 0x7fe9341d5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.100+0000 7fe938910700 1 -- 172.21.15.146:0/187952857 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9340a1340 msgr2=0x7fe9341d5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.100+0000 7fe938910700 1 --2- 172.21.15.146:0/187952857 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9340a1340 0x7fe9341d5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.100+0000 7fe938910700 1 -- 172.21.15.146:0/187952857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9341304a0 msgr2=0x7fe9341d5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.100+0000 7fe938910700 1 --2- 172.21.15.146:0/187952857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9341304a0 0x7fe9341d5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.100+0000 7fe938910700 1 -- 172.21.15.146:0/187952857 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92000b7a0 con 0x7fe9340a0a30 2023-10-03T10:15:05.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.100+0000 7fe938910700 1 --2- 172.21.15.146:0/187952857 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9340a0a30 0x7fe9341d5000 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe92000beb0 tx=0x7fe920004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.100+0000 7fe9317fa700 1 -- 172.21.15.146:0/187952857 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92000b040 con 0x7fe9340a0a30 2023-10-03T10:15:05.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.100+0000 7fe9317fa700 1 -- 172.21.15.146:0/187952857 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9200038c0 con 0x7fe9340a0a30 2023-10-03T10:15:05.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.100+0000 7fe9317fa700 1 -- 172.21.15.146:0/187952857 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe920003c70 con 0x7fe9340a0a30 2023-10-03T10:15:05.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.100+0000 7fe93ab74700 1 -- 172.21.15.146:0/187952857 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93412a170 con 0x7fe9340a0a30 2023-10-03T10:15:05.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.100+0000 7fe93ab74700 1 -- 172.21.15.146:0/187952857 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe934129e00 con 0x7fe9340a0a30 2023-10-03T10:15:05.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.101+0000 7fe9317fa700 1 -- 172.21.15.146:0/187952857 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe920015070 con 0x7fe9340a0a30 2023-10-03T10:15:05.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.101+0000 7fe9317fa700 1 -- 172.21.15.146:0/187952857 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe920040360 con 0x7fe9340a0a30 2023-10-03T10:15:05.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.101+0000 7fe93ab74700 1 -- 172.21.15.146:0/187952857 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9340a1750 con 0x7fe9340a0a30 2023-10-03T10:15:05.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.102+0000 7f45c17fa700 1 -- 172.21.15.146:0/2708246994 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45b8015030 con 0x7f45c409e170 2023-10-03T10:15:05.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.104+0000 7f6b66ffd700 1 -- 172.21.15.146:0/657416808 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b70014440 con 0x7f6b78133ad0 2023-10-03T10:15:05.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.106+0000 7fe9317fa700 1 -- 172.21.15.146:0/187952857 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe9340a1750 con 0x7fe9340a0a30 2023-10-03T10:15:05.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.276+0000 7fc92e1cb700 1 -- 172.21.15.146:0/1810605471 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc928126b30 con 0x7fc928137140 2023-10-03T10:15:05.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.277+0000 7fc90ffff700 1 -- 172.21.15.146:0/1810605471 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc920035090 con 0x7fc928137140 2023-10-03T10:15:05.277 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:05.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.280+0000 7fc92e1cb700 1 -- 172.21.15.146:0/1810605471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc928137140 msgr2=0x7fc92809af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.280+0000 7fc92e1cb700 1 --2- 172.21.15.146:0/1810605471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc928137140 0x7fc92809af10 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc920016000 tx=0x7fc920004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.280+0000 7fc92e1cb700 1 -- 172.21.15.146:0/1810605471 shutdown_connections 2023-10-03T10:15:05.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.280+0000 7fc92e1cb700 1 --2- 172.21.15.146:0/1810605471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc928137140 0x7fc92809af10 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.280+0000 7fc92e1cb700 1 --2- 172.21.15.146:0/1810605471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc92806a770 0x7fc92809a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.280+0000 7fc92e1cb700 1 --2- 172.21.15.146:0/1810605471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc92806b250 0x7fc92809a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.280+0000 7fc92e1cb700 1 -- 172.21.15.146:0/1810605471 >> 172.21.15.146:0/1810605471 conn(0x7fc928099c40 msgr2=0x7fc9280a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.280+0000 7fc92e1cb700 1 -- 172.21.15.146:0/1810605471 shutdown_connections 2023-10-03T10:15:05.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.280+0000 7fc92e1cb700 1 -- 172.21.15.146:0/1810605471 wait complete. 2023-10-03T10:15:05.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:05.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.310+0000 7fe93ab74700 1 -- 172.21.15.146:0/187952857 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe9340a1750 con 0x7fe9340a0a30 2023-10-03T10:15:05.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.310+0000 7fe9317fa700 1 -- 172.21.15.146:0/187952857 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe9340a1750 con 0x7fe9340a0a30 2023-10-03T10:15:05.310 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:05.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.313+0000 7fe93ab74700 1 -- 172.21.15.146:0/187952857 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9340a0a30 msgr2=0x7fe9341d5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.313+0000 7fe93ab74700 1 --2- 172.21.15.146:0/187952857 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9340a0a30 0x7fe9341d5000 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe92000beb0 tx=0x7fe920004750 comp rx=0 tx=0).stop 2023-10-03T10:15:05.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.313+0000 7fe93ab74700 1 -- 172.21.15.146:0/187952857 shutdown_connections 2023-10-03T10:15:05.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.313+0000 7fe93ab74700 1 --2- 172.21.15.146:0/187952857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9341304a0 0x7fe9341d5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.313+0000 7fe93ab74700 1 --2- 172.21.15.146:0/187952857 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9340a0a30 0x7fe9341d5000 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.313+0000 7fe93ab74700 1 --2- 172.21.15.146:0/187952857 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9340a1340 0x7fe9341d5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.313+0000 7fe93ab74700 1 -- 172.21.15.146:0/187952857 >> 172.21.15.146:0/187952857 conn(0x7fe9340a2980 msgr2=0x7fe93409deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.313+0000 7fe93ab74700 1 -- 172.21.15.146:0/187952857 shutdown_connections 2023-10-03T10:15:05.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.313+0000 7fe93ab74700 1 -- 172.21.15.146:0/187952857 wait complete. 2023-10-03T10:15:05.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:05.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.329+0000 7f45cb066700 1 -- 172.21.15.146:0/2708246994 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f45c404f2a0 con 0x7f45c409e170 2023-10-03T10:15:05.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.332+0000 7f6b7ca12700 1 -- 172.21.15.146:0/657416808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6b5c00dda0 con 0x7f6b78133ad0 2023-10-03T10:15:05.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.333+0000 7f6b66ffd700 1 -- 172.21.15.146:0/657416808 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6b700073f0 con 0x7f6b78133ad0 2023-10-03T10:15:05.332 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:05.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.333+0000 7f45c17fa700 1 -- 172.21.15.146:0/2708246994 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f45b8006ce0 con 0x7f45c409e170 2023-10-03T10:15:05.333 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:05.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.335+0000 7f6b7ca12700 1 -- 172.21.15.146:0/657416808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b78133ad0 msgr2=0x7f6b7811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.335+0000 7f6b7ca12700 1 --2- 172.21.15.146:0/657416808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b78133ad0 0x7f6b7811e4c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009d90 tx=0x7f6b7000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.335+0000 7f6b7ca12700 1 -- 172.21.15.146:0/657416808 shutdown_connections 2023-10-03T10:15:05.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.335+0000 7f6b7ca12700 1 --2- 172.21.15.146:0/657416808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b78133ad0 0x7f6b7811e4c0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.335+0000 7f6b7ca12700 1 --2- 172.21.15.146:0/657416808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b781300a0 0x7f6b7811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.335+0000 7f6b7ca12700 1 --2- 172.21.15.146:0/657416808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b78130bc0 0x7f6b7811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.335+0000 7f6b7ca12700 1 -- 172.21.15.146:0/657416808 >> 172.21.15.146:0/657416808 conn(0x7f6b78099c40 msgr2=0x7f6b78131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.335+0000 7f6b7ca12700 1 -- 172.21.15.146:0/657416808 shutdown_connections 2023-10-03T10:15:05.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.335+0000 7f6b7ca12700 1 -- 172.21.15.146:0/657416808 wait complete. 2023-10-03T10:15:05.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.335+0000 7f45cb066700 1 -- 172.21.15.146:0/2708246994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c409e170 msgr2=0x7f45c412a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.335+0000 7f45cb066700 1 --2- 172.21.15.146:0/2708246994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c409e170 0x7f45c412a980 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f45b8009c40 tx=0x7f45b8004750 comp rx=0 tx=0).stop 2023-10-03T10:15:05.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.335+0000 7f45cb066700 1 -- 172.21.15.146:0/2708246994 shutdown_connections 2023-10-03T10:15:05.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.335+0000 7f45cb066700 1 --2- 172.21.15.146:0/2708246994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45c4130ce0 0x7f45c412aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.335+0000 7f45cb066700 1 --2- 172.21.15.146:0/2708246994 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45c409d860 0x7f45c412a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.335+0000 7f45cb066700 1 --2- 172.21.15.146:0/2708246994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45c409e170 0x7f45c412a980 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.335+0000 7f45cb066700 1 -- 172.21.15.146:0/2708246994 >> 172.21.15.146:0/2708246994 conn(0x7f45c4099c40 msgr2=0x7f45c41b5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.335+0000 7f45cb066700 1 -- 172.21.15.146:0/2708246994 shutdown_connections 2023-10-03T10:15:05.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:05.335+0000 7f45cb066700 1 -- 172.21.15.146:0/2708246994 wait complete. 2023-10-03T10:15:05.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:05.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:06.297 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:06.325 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:06.349 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:06.349 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:06.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.442+0000 7f6609f1f700 1 Processor -- start 2023-10-03T10:15:06.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.442+0000 7f6609f1f700 1 -- start start 2023-10-03T10:15:06.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.443+0000 7f6609f1f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6604133900 0x7f6604133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.443+0000 7f6609f1f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6604134210 0x7f66040a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.443+0000 7f6609f1f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f660409a760 con 0x7f66040a0ee0 2023-10-03T10:15:06.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.443+0000 7f6609f1f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66041336e0 con 0x7f6604134210 2023-10-03T10:15:06.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.443+0000 7f6609f1f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660409a080 con 0x7f6604133900 2023-10-03T10:15:06.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.443+0000 7f66037fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6604133900 0x7f6604133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.443+0000 7f66037fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6604133900 0x7f6604133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51034/0 (socket says 172.21.15.146:51034) 2023-10-03T10:15:06.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.443+0000 7f66037fe700 1 -- 172.21.15.146:0/1741536605 learned_addr learned my addr 172.21.15.146:0/1741536605 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:06.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.443+0000 7f6602ffd700 1 --2- 172.21.15.146:0/1741536605 >> v2:172.21.15.146:3300/0 conn(0x7f6604134210 0x7f66040a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.444+0000 7f66027fc700 1 -- 172.21.15.146:0/1741536605 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117976265 0 0) 0x7f660409a760 con 0x7f66040a0ee0 2023-10-03T10:15:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.444+0000 7f66027fc700 1 -- 172.21.15.146:0/1741536605 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65ec0035b0 con 0x7f66040a0ee0 2023-10-03T10:15:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.444+0000 7f6602ffd700 1 -- 172.21.15.146:0/1741536605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6604133900 msgr2=0x7f6604133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.444+0000 7f6602ffd700 1 --2- 172.21.15.146:0/1741536605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6604133900 0x7f6604133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.444+0000 7f6602ffd700 1 -- 172.21.15.146:0/1741536605 >> v1:172.21.15.146:6789/0 conn(0x7f66040a0ee0 legacy=0x7f660413a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.444+0000 7f6602ffd700 1 -- 172.21.15.146:0/1741536605 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66040a23e0 con 0x7f6604134210 2023-10-03T10:15:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.444+0000 7f66037fe700 1 --2- 172.21.15.146:0/1741536605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6604133900 0x7f6604133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.444+0000 7f6602ffd700 1 --2- 172.21.15.146:0/1741536605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6604134210 0x7f66040a09a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009840 tx=0x7f65f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd1bc7cc6184bad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.444+0000 7f66027fc700 1 -- 172.21.15.146:0/1741536605 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8011830 con 0x7f6604134210 2023-10-03T10:15:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.444+0000 7f66027fc700 1 -- 172.21.15.146:0/1741536605 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f8011990 con 0x7f6604134210 2023-10-03T10:15:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.444+0000 7f66027fc700 1 -- 172.21.15.146:0/1741536605 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8011d20 con 0x7f6604134210 2023-10-03T10:15:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.445+0000 7f6609f1f700 1 -- 172.21.15.146:0/1741536605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6604134210 msgr2=0x7f66040a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.445+0000 7f6609f1f700 1 --2- 172.21.15.146:0/1741536605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6604134210 0x7f66040a09a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009840 tx=0x7f65f8009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.445+0000 7f6609f1f700 1 -- 172.21.15.146:0/1741536605 shutdown_connections 2023-10-03T10:15:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.445+0000 7f6609f1f700 1 --2- 172.21.15.146:0/1741536605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6604133900 0x7f6604133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.445+0000 7f6609f1f700 1 --2- 172.21.15.146:0/1741536605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6604134210 0x7f66040a09a0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.445+0000 7f6609f1f700 1 -- 172.21.15.146:0/1741536605 >> 172.21.15.146:0/1741536605 conn(0x7f66040a2980 msgr2=0x7f66040a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.445+0000 7f6609f1f700 1 -- 172.21.15.146:0/1741536605 shutdown_connections 2023-10-03T10:15:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.445+0000 7f6609f1f700 1 -- 172.21.15.146:0/1741536605 wait complete. 2023-10-03T10:15:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.446+0000 7f6609f1f700 1 Processor -- start 2023-10-03T10:15:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.446+0000 7f6609f1f700 1 -- start start 2023-10-03T10:15:06.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.447+0000 7f6609f1f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66040a0ee0 0x7f660411d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.447+0000 7f6609f1f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6604133900 0x7f660411db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.447+0000 7f6609f1f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6604134210 0x7f660411e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.447+0000 7f6609f1f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6604121290 con 0x7f66040a0ee0 2023-10-03T10:15:06.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.447+0000 7f6609f1f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6604121ad0 con 0x7f6604134210 2023-10-03T10:15:06.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.447+0000 7f6609f1f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f660411f200 con 0x7f6604133900 2023-10-03T10:15:06.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.447+0000 7f66037fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66040a0ee0 0x7f660411d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.447+0000 7f66037fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66040a0ee0 0x7f660411d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35202/0 (socket says 172.21.15.146:35202) 2023-10-03T10:15:06.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.447+0000 7f6603fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6604134210 0x7f660411e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.447+0000 7f66037fe700 1 -- 172.21.15.146:0/2012482720 learned_addr learned my addr 172.21.15.146:0/2012482720 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.447+0000 7f6602ffd700 1 --2- 172.21.15.146:0/2012482720 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6604133900 0x7f660411db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.447+0000 7f66037fe700 1 -- 172.21.15.146:0/2012482720 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6604133900 msgr2=0x7f660411db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.447+0000 7f66037fe700 1 --2- 172.21.15.146:0/2012482720 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6604133900 0x7f660411db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.447+0000 7f66037fe700 1 -- 172.21.15.146:0/2012482720 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6604134210 msgr2=0x7f660411e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.447+0000 7f66037fe700 1 --2- 172.21.15.146:0/2012482720 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6604134210 0x7f660411e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.447+0000 7f66037fe700 1 -- 172.21.15.146:0/2012482720 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f4009500 con 0x7f66040a0ee0 2023-10-03T10:15:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.447+0000 7f6602ffd700 1 --2- 172.21.15.146:0/2012482720 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6604133900 0x7f660411db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.448+0000 7f66037fe700 1 --2- 172.21.15.146:0/2012482720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66040a0ee0 0x7f660411d5f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f65f400ebe0 tx=0x7f65f400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.448+0000 7f65ebfff700 1 -- 172.21.15.146:0/2012482720 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4005a20 con 0x7f66040a0ee0 2023-10-03T10:15:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.448+0000 7f6609f1f700 1 -- 172.21.15.146:0/2012482720 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f80094a0 con 0x7f66040a0ee0 2023-10-03T10:15:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.448+0000 7f65ebfff700 1 -- 172.21.15.146:0/2012482720 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f4005b80 con 0x7f66040a0ee0 2023-10-03T10:15:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.448+0000 7f65ebfff700 1 -- 172.21.15.146:0/2012482720 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f400c850 con 0x7f66040a0ee0 2023-10-03T10:15:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.448+0000 7f6609f1f700 1 -- 172.21.15.146:0/2012482720 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660409a2c0 con 0x7f66040a0ee0 2023-10-03T10:15:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.449+0000 7f65ebfff700 1 -- 172.21.15.146:0/2012482720 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f65f400c9b0 con 0x7f66040a0ee0 2023-10-03T10:15:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.449+0000 7f6609f1f700 1 -- 172.21.15.146:0/2012482720 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660411a590 con 0x7f66040a0ee0 2023-10-03T10:15:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.449+0000 7f65ebfff700 1 -- 172.21.15.146:0/2012482720 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f65f403fbb0 con 0x7f66040a0ee0 2023-10-03T10:15:06.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.457+0000 7f65ebfff700 1 -- 172.21.15.146:0/2012482720 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f65f4022300 con 0x7f66040a0ee0 2023-10-03T10:15:06.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.478+0000 7f7f885c8700 1 Processor -- start 2023-10-03T10:15:06.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.478+0000 7f7f885c8700 1 -- start start 2023-10-03T10:15:06.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.479+0000 7f7f885c8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f8009d860 0x7f7f8009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.479+0000 7f7f885c8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7f80130eb0 0x7f7f80138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.479+0000 7f7f885c8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f8009aaa0 con 0x7f7f8009e170 2023-10-03T10:15:06.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.479+0000 7f7f885c8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8009f870 con 0x7f7f80130eb0 2023-10-03T10:15:06.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.479+0000 7f7f885c8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8009b360 con 0x7f7f8009d860 2023-10-03T10:15:06.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.479+0000 7f7f85b63700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7f8009e170 0x7f7f801307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:57530/0 (socket says 172.21.15.146:57530) 2023-10-03T10:15:06.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.479+0000 7f7f85b63700 1 -- 172.21.15.146:0/89034876 learned_addr learned my addr 172.21.15.146:0/89034876 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:06.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.479+0000 7f7f86b65700 1 --2- 172.21.15.146:0/89034876 >> v2:172.21.15.146:3300/0 conn(0x7f7f80130eb0 0x7f7f80138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.480+0000 7f7f86364700 1 --2- 172.21.15.146:0/89034876 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f8009d860 0x7f7f8009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.480+0000 7f7f86364700 1 -- 172.21.15.146:0/89034876 >> v2:172.21.15.146:3300/0 conn(0x7f7f80130eb0 msgr2=0x7f7f80138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:06.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.480+0000 7f7f86364700 1 --2- 172.21.15.146:0/89034876 >> v2:172.21.15.146:3300/0 conn(0x7f7f80130eb0 0x7f7f80138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.480+0000 7f7f86364700 1 -- 172.21.15.146:0/89034876 >> v1:172.21.15.146:6789/0 conn(0x7f7f8009e170 legacy=0x7f7f801307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.480+0000 7f7f86364700 1 -- 172.21.15.146:0/89034876 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8009b620 con 0x7f7f8009d860 2023-10-03T10:15:06.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.480+0000 7f7f86b65700 1 --2- 172.21.15.146:0/89034876 >> v2:172.21.15.146:3300/0 conn(0x7f7f80130eb0 0x7f7f80138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:06.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.480+0000 7f7f86364700 1 --2- 172.21.15.146:0/89034876 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f8009d860 0x7f7f8009dc30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c009840 tx=0x7f7f7c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab314c57b6539495 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:06.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.480+0000 7f7f85362700 1 -- 172.21.15.146:0/89034876 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c011830 con 0x7f7f8009d860 2023-10-03T10:15:06.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.480+0000 7f7f85362700 1 -- 172.21.15.146:0/89034876 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7c011990 con 0x7f7f8009d860 2023-10-03T10:15:06.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.480+0000 7f7f85362700 1 -- 172.21.15.146:0/89034876 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c011d20 con 0x7f7f8009d860 2023-10-03T10:15:06.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.481+0000 7f7f885c8700 1 -- 172.21.15.146:0/89034876 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f8009d860 msgr2=0x7f7f8009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.481+0000 7f7f885c8700 1 --2- 172.21.15.146:0/89034876 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f8009d860 0x7f7f8009dc30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c009840 tx=0x7f7f7c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:06.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.481+0000 7f7f885c8700 1 -- 172.21.15.146:0/89034876 shutdown_connections 2023-10-03T10:15:06.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.481+0000 7f7f885c8700 1 --2- 172.21.15.146:0/89034876 >> v2:172.21.15.146:3300/0 conn(0x7f7f80130eb0 0x7f7f80138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.481+0000 7f7f885c8700 1 --2- 172.21.15.146:0/89034876 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f8009d860 0x7f7f8009dc30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.481+0000 7f7f885c8700 1 -- 172.21.15.146:0/89034876 >> 172.21.15.146:0/89034876 conn(0x7f7f80099c40 msgr2=0x7f7f800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.481+0000 7f7f885c8700 1 -- 172.21.15.146:0/89034876 shutdown_connections 2023-10-03T10:15:06.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.481+0000 7f7f885c8700 1 -- 172.21.15.146:0/89034876 wait complete. 2023-10-03T10:15:06.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.483+0000 7f7f885c8700 1 Processor -- start 2023-10-03T10:15:06.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.483+0000 7f7f885c8700 1 -- start start 2023-10-03T10:15:06.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.483+0000 7f7f885c8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f8009d860 0x7f7f80120650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.483+0000 7f7f885c8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f8009e170 0x7f7f80120b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.483+0000 7f7f885c8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f80130eb0 0x7f7f801210d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.483+0000 7f7f885c8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f80121b20 con 0x7f7f8009e170 2023-10-03T10:15:06.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.483+0000 7f7f885c8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f80130590 con 0x7f7f80130eb0 2023-10-03T10:15:06.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.483+0000 7f7f885c8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f80123e90 con 0x7f7f8009d860 2023-10-03T10:15:06.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.483+0000 7f7f86364700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f8009d860 0x7f7f80120650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.483+0000 7f7f86364700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f8009d860 0x7f7f80120650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38636/0 (socket says 172.21.15.146:38636) 2023-10-03T10:15:06.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.483+0000 7f7f86364700 1 -- 172.21.15.146:0/549796323 learned_addr learned my addr 172.21.15.146:0/549796323 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:06.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.484+0000 7f7f85b63700 1 --2- 172.21.15.146:0/549796323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f8009e170 0x7f7f80120b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.484+0000 7f7f86364700 1 -- 172.21.15.146:0/549796323 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f80130eb0 msgr2=0x7f7f801210d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.484+0000 7f7f86364700 1 --2- 172.21.15.146:0/549796323 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f80130eb0 0x7f7f801210d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.484+0000 7f7f86364700 1 -- 172.21.15.146:0/549796323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f8009e170 msgr2=0x7f7f80120b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.484+0000 7f7f86364700 1 --2- 172.21.15.146:0/549796323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f8009e170 0x7f7f80120b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.484+0000 7f7f86364700 1 -- 172.21.15.146:0/549796323 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f78009a70 con 0x7f7f8009d860 2023-10-03T10:15:06.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.484+0000 7f7f85b63700 1 --2- 172.21.15.146:0/549796323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f8009e170 0x7f7f80120b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:06.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.484+0000 7f7f86364700 1 --2- 172.21.15.146:0/549796323 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f8009d860 0x7f7f80120650 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c009fd0 tx=0x7f7f7c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:06.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.484+0000 7f7f76ffd700 1 -- 172.21.15.146:0/549796323 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c0036a0 con 0x7f7f8009d860 2023-10-03T10:15:06.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.484+0000 7f7f76ffd700 1 -- 172.21.15.146:0/549796323 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7c01f070 con 0x7f7f8009d860 2023-10-03T10:15:06.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.484+0000 7f7f76ffd700 1 -- 172.21.15.146:0/549796323 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c003a60 con 0x7f7f8009d860 2023-10-03T10:15:06.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.484+0000 7f7f885c8700 1 -- 172.21.15.146:0/549796323 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7c0094a0 con 0x7f7f8009d860 2023-10-03T10:15:06.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.485+0000 7f7f885c8700 1 -- 172.21.15.146:0/549796323 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f80122a50 con 0x7f7f8009d860 2023-10-03T10:15:06.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.486+0000 7f7f885c8700 1 -- 172.21.15.146:0/549796323 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f80122370 con 0x7f7f8009d860 2023-10-03T10:15:06.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.486+0000 7f7f76ffd700 1 -- 172.21.15.146:0/549796323 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f7c003bc0 con 0x7f7f8009d860 2023-10-03T10:15:06.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.486+0000 7f7f76ffd700 1 -- 172.21.15.146:0/549796323 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7f7c021070 con 0x7f7f8009d860 2023-10-03T10:15:06.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.490+0000 7f7f76ffd700 1 -- 172.21.15.146:0/549796323 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f7c046060 con 0x7f7f8009d860 2023-10-03T10:15:06.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.515+0000 7fe8b6c14700 1 Processor -- start 2023-10-03T10:15:06.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.515+0000 7fe8b6c14700 1 -- start start 2023-10-03T10:15:06.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.516+0000 7fe8b6c14700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8b00a0a70 0x7fe8b00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.516+0000 7fe8b6c14700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe8b0134120 0x7fe8b013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.516+0000 7fe8b6c14700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b009dc00 con 0x7fe8b00a1380 2023-10-03T10:15:06.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.516+0000 7fe8b6c14700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b009ea60 con 0x7fe8b0134120 2023-10-03T10:15:06.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.516+0000 7fe8b6c14700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b009dec0 con 0x7fe8b00a0a70 2023-10-03T10:15:06.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.517+0000 7fe8b49b0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8b00a0a70 0x7fe8b00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.517+0000 7fe8b49b0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8b00a0a70 0x7fe8b00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38646/0 (socket says 172.21.15.146:38646) 2023-10-03T10:15:06.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.517+0000 7fe8b49b0700 1 -- 172.21.15.146:0/3248687010 learned_addr learned my addr 172.21.15.146:0/3248687010 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:06.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.517+0000 7fe8b51b1700 1 --2- 172.21.15.146:0/3248687010 >> v2:172.21.15.146:3300/0 conn(0x7fe8b0134120 0x7fe8b013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.517+0000 7fe8b51b1700 1 -- 172.21.15.146:0/3248687010 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8b00a0a70 msgr2=0x7fe8b00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:06.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.517+0000 7fe8b51b1700 1 --2- 172.21.15.146:0/3248687010 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8b00a0a70 0x7fe8b00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.517+0000 7fe8b51b1700 1 -- 172.21.15.146:0/3248687010 >> v1:172.21.15.146:6789/0 conn(0x7fe8b00a1380 legacy=0x7fe8b0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.518+0000 7fe8b51b1700 1 -- 172.21.15.146:0/3248687010 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b009e6a0 con 0x7fe8b0134120 2023-10-03T10:15:06.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.518+0000 7fe8b51b1700 1 --2- 172.21.15.146:0/3248687010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8b0134120 0x7fe8b013bce0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8009d90 tx=0x7fe8a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f1b323348b6365 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:06.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.518+0000 7fe8af7fe700 1 -- 172.21.15.146:0/3248687010 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a800e070 con 0x7fe8b0134120 2023-10-03T10:15:06.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.518+0000 7fe8af7fe700 1 -- 172.21.15.146:0/3248687010 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a800bbd0 con 0x7fe8b0134120 2023-10-03T10:15:06.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.518+0000 7fe8af7fe700 1 -- 172.21.15.146:0/3248687010 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8012430 con 0x7fe8b0134120 2023-10-03T10:15:06.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.518+0000 7fd51959f700 1 Processor -- start 2023-10-03T10:15:06.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.518+0000 7fd51959f700 1 -- start start 2023-10-03T10:15:06.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fd51959f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd5140a0a70 0x7fd5140a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fd51959f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5140a1380 0x7fd514133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fd51959f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd514133f50 0x7fd5141343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fd51959f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51409e9d0 con 0x7fd514133f50 2023-10-03T10:15:06.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fd51959f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51409dc00 con 0x7fd5140a1380 2023-10-03T10:15:06.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fd51959f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd51409dec0 con 0x7fd5140a0a70 2023-10-03T10:15:06.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fe8b6c14700 1 -- 172.21.15.146:0/3248687010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8b0134120 msgr2=0x7fe8b013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fe8b6c14700 1 --2- 172.21.15.146:0/3248687010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8b0134120 0x7fe8b013bce0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8009d90 tx=0x7fe8a800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:06.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fd512ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd5140a0a70 0x7fd5140a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fd512ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd5140a0a70 0x7fd5140a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38652/0 (socket says 172.21.15.146:38652) 2023-10-03T10:15:06.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fd512ffd700 1 -- 172.21.15.146:0/328394654 learned_addr learned my addr 172.21.15.146:0/328394654 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:06.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fe8b6c14700 1 -- 172.21.15.146:0/3248687010 shutdown_connections 2023-10-03T10:15:06.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fe8b6c14700 1 --2- 172.21.15.146:0/3248687010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8b0134120 0x7fe8b013bce0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fe8b6c14700 1 --2- 172.21.15.146:0/3248687010 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8b00a0a70 0x7fe8b00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fe8b6c14700 1 -- 172.21.15.146:0/3248687010 >> 172.21.15.146:0/3248687010 conn(0x7fe8b00a6610 msgr2=0x7fe8b00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fd5127fc700 1 --2- 172.21.15.146:0/328394654 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5140a1380 0x7fd514133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fd5137fe700 1 --2- 172.21.15.146:0/328394654 >> v2:172.21.15.146:3300/0 conn(0x7fd514133f50 0x7fd5141343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fd512ffd700 1 -- 172.21.15.146:0/328394654 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5140a1380 msgr2=0x7fd514133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:06.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fd512ffd700 1 --2- 172.21.15.146:0/328394654 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5140a1380 0x7fd514133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fd512ffd700 1 -- 172.21.15.146:0/328394654 >> v2:172.21.15.146:3300/0 conn(0x7fd514133f50 msgr2=0x7fd5141343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:06.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fd512ffd700 1 --2- 172.21.15.146:0/328394654 >> v2:172.21.15.146:3300/0 conn(0x7fd514133f50 0x7fd5141343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fd512ffd700 1 -- 172.21.15.146:0/328394654 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51409e6a0 con 0x7fd5140a0a70 2023-10-03T10:15:06.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fe8b6c14700 1 -- 172.21.15.146:0/3248687010 shutdown_connections 2023-10-03T10:15:06.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.519+0000 7fe8b6c14700 1 -- 172.21.15.146:0/3248687010 wait complete. 2023-10-03T10:15:06.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.520+0000 7fd512ffd700 1 --2- 172.21.15.146:0/328394654 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd5140a0a70 0x7fd5140a0e40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009e50 tx=0x7fd50c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9229c559a04b27d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:06.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.520+0000 7fd511ffb700 1 -- 172.21.15.146:0/328394654 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00e070 con 0x7fd5140a0a70 2023-10-03T10:15:06.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.520+0000 7fd511ffb700 1 -- 172.21.15.146:0/328394654 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c00b910 con 0x7fd5140a0a70 2023-10-03T10:15:06.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.520+0000 7fd511ffb700 1 -- 172.21.15.146:0/328394654 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00bcc0 con 0x7fd5140a0a70 2023-10-03T10:15:06.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.520+0000 7fd51959f700 1 -- 172.21.15.146:0/328394654 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd5140a0a70 msgr2=0x7fd5140a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.520+0000 7fd51959f700 1 --2- 172.21.15.146:0/328394654 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd5140a0a70 0x7fd5140a0e40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009e50 tx=0x7fd50c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:06.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.521+0000 7fd51959f700 1 -- 172.21.15.146:0/328394654 shutdown_connections 2023-10-03T10:15:06.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.521+0000 7fd51959f700 1 --2- 172.21.15.146:0/328394654 >> v2:172.21.15.146:3300/0 conn(0x7fd514133f50 0x7fd5141343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.521+0000 7fd51959f700 1 --2- 172.21.15.146:0/328394654 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd5140a0a70 0x7fd5140a0e40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.521+0000 7fd51959f700 1 --2- 172.21.15.146:0/328394654 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5140a1380 0x7fd514133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.521+0000 7fd51959f700 1 -- 172.21.15.146:0/328394654 >> 172.21.15.146:0/328394654 conn(0x7fd5140a6610 msgr2=0x7fd5140a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.521+0000 7fd51959f700 1 -- 172.21.15.146:0/328394654 shutdown_connections 2023-10-03T10:15:06.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.521+0000 7fd51959f700 1 -- 172.21.15.146:0/328394654 wait complete. 2023-10-03T10:15:06.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.521+0000 7fe8b6c14700 1 Processor -- start 2023-10-03T10:15:06.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.522+0000 7fe8b6c14700 1 -- start start 2023-10-03T10:15:06.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.522+0000 7fd51959f700 1 Processor -- start 2023-10-03T10:15:06.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.522+0000 7fe8b6c14700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8b00a0a70 0x7fe8b011e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.522+0000 7fe8b6c14700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8b00a1380 0x7fe8b011e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.522+0000 7fe8b6c14700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8b0134120 0x7fe8b011ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.522+0000 7fe8b6c14700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b0121a10 con 0x7fe8b00a0a70 2023-10-03T10:15:06.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.522+0000 7fe8b6c14700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b0120220 con 0x7fe8b0134120 2023-10-03T10:15:06.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.522+0000 7fe8b6c14700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b00a03e0 con 0x7fe8b00a1380 2023-10-03T10:15:06.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.522+0000 7fe8b49b0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8b00a0a70 0x7fe8b011e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.522+0000 7fe8affff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8b00a1380 0x7fe8b011e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.522+0000 7fe8b49b0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8b00a0a70 0x7fe8b011e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35250/0 (socket says 172.21.15.146:35250) 2023-10-03T10:15:06.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.522+0000 7fe8b49b0700 1 -- 172.21.15.146:0/3313549239 learned_addr learned my addr 172.21.15.146:0/3313549239 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:06.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.522+0000 7fe8affff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8b00a1380 0x7fe8b011e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38668/0 (socket says 172.21.15.146:38668) 2023-10-03T10:15:06.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.522+0000 7fd51959f700 1 -- start start 2023-10-03T10:15:06.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fd51959f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5140a0a70 0x7fd5141ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fd51959f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd5140a1380 0x7fd5141cd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fd51959f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd514133f50 0x7fd51406dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fd51959f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd514071ae0 con 0x7fd514133f50 2023-10-03T10:15:06.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fd51959f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5140a03e0 con 0x7fd5140a0a70 2023-10-03T10:15:06.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fd51959f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd514071040 con 0x7fd5140a1380 2023-10-03T10:15:06.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fe8affff700 1 -- 172.21.15.146:0/3313549239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8b0134120 msgr2=0x7fe8b011ef10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:15:06.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fe8affff700 1 --2- 172.21.15.146:0/3313549239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8b0134120 0x7fe8b011ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fe8affff700 1 -- 172.21.15.146:0/3313549239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8b00a0a70 msgr2=0x7fe8b011e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fe8affff700 1 --2- 172.21.15.146:0/3313549239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8b00a0a70 0x7fe8b011e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fe8affff700 1 -- 172.21.15.146:0/3313549239 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a8009a70 con 0x7fe8b00a1380 2023-10-03T10:15:06.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fd5137fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd514133f50 0x7fd51406dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fd5137fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd514133f50 0x7fd51406dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35262/0 (socket says 172.21.15.146:35262) 2023-10-03T10:15:06.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fd5137fe700 1 -- 172.21.15.146:0/3837001882 learned_addr learned my addr 172.21.15.146:0/3837001882 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:06.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fe8affff700 1 --2- 172.21.15.146:0/3313549239 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8b00a1380 0x7fe8b011e9d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe89c000f60 tx=0x7fe89c00c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:06.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fd512ffd700 1 --2- 172.21.15.146:0/3837001882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5140a0a70 0x7fd5141ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fe8ad7fa700 1 -- 172.21.15.146:0/3313549239 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c011790 con 0x7fe8b00a1380 2023-10-03T10:15:06.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fd5137fe700 1 -- 172.21.15.146:0/3837001882 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd5140a1380 msgr2=0x7fd5141cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fd5137fe700 1 --2- 172.21.15.146:0/3837001882 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd5140a1380 0x7fd5141cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fd5137fe700 1 -- 172.21.15.146:0/3837001882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5140a0a70 msgr2=0x7fd5141ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fd5137fe700 1 --2- 172.21.15.146:0/3837001882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5140a0a70 0x7fd5141ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fd5137fe700 1 -- 172.21.15.146:0/3837001882 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c009b30 con 0x7fd514133f50 2023-10-03T10:15:06.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fe8ad7fa700 1 -- 172.21.15.146:0/3313549239 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c0118f0 con 0x7fe8b00a1380 2023-10-03T10:15:06.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fe8ad7fa700 1 -- 172.21.15.146:0/3313549239 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c011c60 con 0x7fe8b00a1380 2023-10-03T10:15:06.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fd512ffd700 1 --2- 172.21.15.146:0/3837001882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5140a0a70 0x7fd5141ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:06.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.524+0000 7fd5137fe700 1 --2- 172.21.15.146:0/3837001882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd514133f50 0x7fd51406dac0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd50800e950 tx=0x7fd50800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:06.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.523+0000 7fe8b6c14700 1 -- 172.21.15.146:0/3313549239 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b0120900 con 0x7fe8b00a1380 2023-10-03T10:15:06.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.524+0000 7fd4fb7fe700 1 -- 172.21.15.146:0/3837001882 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50800eea0 con 0x7fd514133f50 2023-10-03T10:15:06.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.524+0000 7fe8b6c14700 1 -- 172.21.15.146:0/3313549239 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b0121cd0 con 0x7fe8b00a1380 2023-10-03T10:15:06.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.524+0000 7fd4fb7fe700 1 -- 172.21.15.146:0/3837001882 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50800c850 con 0x7fd514133f50 2023-10-03T10:15:06.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.524+0000 7fd4fb7fe700 1 -- 172.21.15.146:0/3837001882 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50800cbe0 con 0x7fd514133f50 2023-10-03T10:15:06.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.525+0000 7fd51959f700 1 -- 172.21.15.146:0/3837001882 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5140700c0 con 0x7fd514133f50 2023-10-03T10:15:06.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.525+0000 7fd51959f700 1 -- 172.21.15.146:0/3837001882 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5141cd550 con 0x7fd514133f50 2023-10-03T10:15:06.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.525+0000 7fe8b6c14700 1 -- 172.21.15.146:0/3313549239 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b004f2a0 con 0x7fe8b00a1380 2023-10-03T10:15:06.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.526+0000 7fe8ad7fa700 1 -- 172.21.15.146:0/3313549239 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe89c005080 con 0x7fe8b00a1380 2023-10-03T10:15:06.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.526+0000 7fe8ad7fa700 1 -- 172.21.15.146:0/3313549239 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe89c03efa0 con 0x7fe8b00a1380 2023-10-03T10:15:06.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.526+0000 7fd51959f700 1 -- 172.21.15.146:0/3837001882 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd514071440 con 0x7fd514133f50 2023-10-03T10:15:06.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.530+0000 7fd4fb7fe700 1 -- 172.21.15.146:0/3837001882 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd50800cd40 con 0x7fd514133f50 2023-10-03T10:15:06.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.530+0000 7fd4fb7fe700 1 -- 172.21.15.146:0/3837001882 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd50803f860 con 0x7fd514133f50 2023-10-03T10:15:06.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.533+0000 7fe8ad7fa700 1 -- 172.21.15.146:0/3313549239 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe89c019b70 con 0x7fe8b00a1380 2023-10-03T10:15:06.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.534+0000 7fd4fb7fe700 1 -- 172.21.15.146:0/3837001882 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd514071440 con 0x7fd514133f50 2023-10-03T10:15:06.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.658+0000 7f6609f1f700 1 -- 172.21.15.146:0/2012482720 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f660406bce0 con 0x7f66040a0ee0 2023-10-03T10:15:06.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.658+0000 7f65ebfff700 1 -- 172.21.15.146:0/2012482720 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f65f4013e60 con 0x7f66040a0ee0 2023-10-03T10:15:06.659 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:06.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.660+0000 7f6609f1f700 1 -- 172.21.15.146:0/2012482720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66040a0ee0 msgr2=0x7f660411d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.660+0000 7f6609f1f700 1 --2- 172.21.15.146:0/2012482720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66040a0ee0 0x7f660411d5f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f65f400ebe0 tx=0x7f65f400eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.660+0000 7f6609f1f700 1 -- 172.21.15.146:0/2012482720 shutdown_connections 2023-10-03T10:15:06.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.660+0000 7f6609f1f700 1 --2- 172.21.15.146:0/2012482720 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6604134210 0x7f660411e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.660+0000 7f6609f1f700 1 --2- 172.21.15.146:0/2012482720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66040a0ee0 0x7f660411d5f0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.660+0000 7f6609f1f700 1 --2- 172.21.15.146:0/2012482720 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6604133900 0x7f660411db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.660+0000 7f6609f1f700 1 -- 172.21.15.146:0/2012482720 >> 172.21.15.146:0/2012482720 conn(0x7f66040a2980 msgr2=0x7f66041babe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.660+0000 7f6609f1f700 1 -- 172.21.15.146:0/2012482720 shutdown_connections 2023-10-03T10:15:06.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.660+0000 7f6609f1f700 1 -- 172.21.15.146:0/2012482720 wait complete. 2023-10-03T10:15:06.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:06.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.687+0000 7f7f885c8700 1 -- 172.21.15.146:0/549796323 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7f8004f2a0 con 0x7f7f8009d860 2023-10-03T10:15:06.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.688+0000 7f7f76ffd700 1 -- 172.21.15.146:0/549796323 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7f7c015020 con 0x7f7f8009d860 2023-10-03T10:15:06.688 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:06.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.690+0000 7f7f885c8700 1 -- 172.21.15.146:0/549796323 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f8009d860 msgr2=0x7f7f80120650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.690+0000 7f7f885c8700 1 --2- 172.21.15.146:0/549796323 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f8009d860 0x7f7f80120650 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c009fd0 tx=0x7f7f7c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:06.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.690+0000 7f7f885c8700 1 -- 172.21.15.146:0/549796323 shutdown_connections 2023-10-03T10:15:06.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.690+0000 7f7f885c8700 1 --2- 172.21.15.146:0/549796323 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f80130eb0 0x7f7f801210d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.690+0000 7f7f885c8700 1 --2- 172.21.15.146:0/549796323 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f8009d860 0x7f7f80120650 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.690+0000 7f7f885c8700 1 --2- 172.21.15.146:0/549796323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f8009e170 0x7f7f80120b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.690+0000 7f7f885c8700 1 -- 172.21.15.146:0/549796323 >> 172.21.15.146:0/549796323 conn(0x7f7f80099c40 msgr2=0x7f7f8006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.690+0000 7f7f885c8700 1 -- 172.21.15.146:0/549796323 shutdown_connections 2023-10-03T10:15:06.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.690+0000 7f7f885c8700 1 -- 172.21.15.146:0/549796323 wait complete. 2023-10-03T10:15:06.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:06.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.728+0000 7fe8b6c14700 1 -- 172.21.15.146:0/3313549239 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe8b0072980 con 0x7fe8b00a1380 2023-10-03T10:15:06.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.728+0000 7fe8ad7fa700 1 -- 172.21.15.146:0/3313549239 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe89c019780 con 0x7fe8b00a1380 2023-10-03T10:15:06.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.728+0000 7fd51959f700 1 -- 172.21.15.146:0/3837001882 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd514071440 con 0x7fd514133f50 2023-10-03T10:15:06.729 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:06.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.729+0000 7fd4fb7fe700 1 -- 172.21.15.146:0/3837001882 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd514071440 con 0x7fd514133f50 2023-10-03T10:15:06.730 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:06.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.730+0000 7fe8b6c14700 1 -- 172.21.15.146:0/3313549239 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8b00a1380 msgr2=0x7fe8b011e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.730+0000 7fe8b6c14700 1 --2- 172.21.15.146:0/3313549239 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8b00a1380 0x7fe8b011e9d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe89c000f60 tx=0x7fe89c00c730 comp rx=0 tx=0).stop 2023-10-03T10:15:06.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.731+0000 7fe8b6c14700 1 -- 172.21.15.146:0/3313549239 shutdown_connections 2023-10-03T10:15:06.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.731+0000 7fe8b6c14700 1 --2- 172.21.15.146:0/3313549239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8b0134120 0x7fe8b011ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.731+0000 7fe8b6c14700 1 --2- 172.21.15.146:0/3313549239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8b00a0a70 0x7fe8b011e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.731+0000 7fe8b6c14700 1 --2- 172.21.15.146:0/3313549239 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8b00a1380 0x7fe8b011e9d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.731+0000 7fe8b6c14700 1 -- 172.21.15.146:0/3313549239 >> 172.21.15.146:0/3313549239 conn(0x7fe8b00a6610 msgr2=0x7fe8b00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.731+0000 7fe8b6c14700 1 -- 172.21.15.146:0/3313549239 shutdown_connections 2023-10-03T10:15:06.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.731+0000 7fd51959f700 1 -- 172.21.15.146:0/3837001882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd514133f50 msgr2=0x7fd51406dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.731+0000 7fd51959f700 1 --2- 172.21.15.146:0/3837001882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd514133f50 0x7fd51406dac0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd50800e950 tx=0x7fd50800ec60 comp rx=0 tx=0).stop 2023-10-03T10:15:06.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.731+0000 7fd51959f700 1 -- 172.21.15.146:0/3837001882 shutdown_connections 2023-10-03T10:15:06.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.731+0000 7fe8b6c14700 1 -- 172.21.15.146:0/3313549239 wait complete. 2023-10-03T10:15:06.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.731+0000 7fd51959f700 1 --2- 172.21.15.146:0/3837001882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd514133f50 0x7fd51406dac0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.731+0000 7fd51959f700 1 --2- 172.21.15.146:0/3837001882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5140a0a70 0x7fd5141ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.731+0000 7fd51959f700 1 --2- 172.21.15.146:0/3837001882 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd5140a1380 0x7fd5141cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.731+0000 7fd51959f700 1 -- 172.21.15.146:0/3837001882 >> 172.21.15.146:0/3837001882 conn(0x7fd5140a6610 msgr2=0x7fd51409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.731+0000 7fd51959f700 1 -- 172.21.15.146:0/3837001882 shutdown_connections 2023-10-03T10:15:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:06.731+0000 7fd51959f700 1 -- 172.21.15.146:0/3837001882 wait complete. 2023-10-03T10:15:06.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:06.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:07.674 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:07.703 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:07.747 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:07.747 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:07.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.814+0000 7f0b35e3d700 1 Processor -- start 2023-10-03T10:15:07.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.814+0000 7f0b35e3d700 1 -- start start 2023-10-03T10:15:07.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.815+0000 7f0b35e3d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b300a1510 0x7f0b301351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.815+0000 7f0b35e3d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b301356e0 0x7f0b30137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.815+0000 7f0b35e3d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b300a1e70 con 0x7f0b300a0a30 2023-10-03T10:15:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.815+0000 7f0b35e3d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b3009a720 con 0x7f0b301356e0 2023-10-03T10:15:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.815+0000 7f0b35e3d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3009b300 con 0x7f0b300a1510 2023-10-03T10:15:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.815+0000 7f0b2effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b300a1510 0x7f0b301351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.815+0000 7f0b2ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b301356e0 0x7f0b30137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.815+0000 7f0b2effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b300a1510 0x7f0b301351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51084/0 (socket says 172.21.15.146:51084) 2023-10-03T10:15:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.815+0000 7f0b2effd700 1 -- 172.21.15.146:0/3581443568 learned_addr learned my addr 172.21.15.146:0/3581443568 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.815+0000 7f0b2effd700 1 -- 172.21.15.146:0/3581443568 >> v2:172.21.15.146:3300/0 conn(0x7f0b301356e0 msgr2=0x7f0b30137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.815+0000 7f0b2effd700 1 --2- 172.21.15.146:0/3581443568 >> v2:172.21.15.146:3300/0 conn(0x7f0b301356e0 0x7f0b30137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.815+0000 7f0b2effd700 1 -- 172.21.15.146:0/3581443568 >> v1:172.21.15.146:6789/0 conn(0x7f0b300a0a30 legacy=0x7f0b300a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.815+0000 7f0b2effd700 1 -- 172.21.15.146:0/3581443568 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3009abc0 con 0x7f0b300a1510 2023-10-03T10:15:07.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.815+0000 7f0b2e7fc700 1 -- 172.21.15.146:0/3581443568 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970926300 0 0) 0x7f0b300a1e70 con 0x7f0b300a0a30 2023-10-03T10:15:07.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.815+0000 7f0b2ffff700 1 --2- 172.21.15.146:0/3581443568 >> v2:172.21.15.146:3300/0 conn(0x7f0b301356e0 0x7f0b30137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.816+0000 7f0b2effd700 1 --2- 172.21.15.146:0/3581443568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b300a1510 0x7f0b301351a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0b240098f0 tx=0x7f0b24009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=300fe0fa84b7ec82 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.816+0000 7f0b2e7fc700 1 -- 172.21.15.146:0/3581443568 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b24011830 con 0x7f0b300a1510 2023-10-03T10:15:07.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.816+0000 7f0b2e7fc700 1 -- 172.21.15.146:0/3581443568 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b24011990 con 0x7f0b300a1510 2023-10-03T10:15:07.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.816+0000 7f0b2e7fc700 1 -- 172.21.15.146:0/3581443568 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b24011d20 con 0x7f0b300a1510 2023-10-03T10:15:07.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.817+0000 7f0b35e3d700 1 -- 172.21.15.146:0/3581443568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b300a1510 msgr2=0x7f0b301351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.817+0000 7f0b35e3d700 1 --2- 172.21.15.146:0/3581443568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b300a1510 0x7f0b301351a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0b240098f0 tx=0x7f0b24009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:07.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.817+0000 7f0b35e3d700 1 -- 172.21.15.146:0/3581443568 shutdown_connections 2023-10-03T10:15:07.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.817+0000 7f0b35e3d700 1 --2- 172.21.15.146:0/3581443568 >> v2:172.21.15.146:3300/0 conn(0x7f0b301356e0 0x7f0b30137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.817+0000 7f0b35e3d700 1 --2- 172.21.15.146:0/3581443568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b300a1510 0x7f0b301351a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.817+0000 7f0b35e3d700 1 -- 172.21.15.146:0/3581443568 >> 172.21.15.146:0/3581443568 conn(0x7f0b300a2980 msgr2=0x7f0b300a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.817+0000 7f0b35e3d700 1 -- 172.21.15.146:0/3581443568 shutdown_connections 2023-10-03T10:15:07.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.817+0000 7f0b35e3d700 1 -- 172.21.15.146:0/3581443568 wait complete. 2023-10-03T10:15:07.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.818+0000 7f0b35e3d700 1 Processor -- start 2023-10-03T10:15:07.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.819+0000 7f0b35e3d700 1 -- start start 2023-10-03T10:15:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.819+0000 7f0b35e3d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b300a0a30 0x7f0b301c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.819+0000 7f0b35e3d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b300a1510 0x7f0b301c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.819+0000 7f0b35e3d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b301356e0 0x7f0b30118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.819+0000 7f0b35e3d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3011a850 con 0x7f0b300a1510 2023-10-03T10:15:07.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.819+0000 7f0b35e3d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3009ae00 con 0x7f0b300a0a30 2023-10-03T10:15:07.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.819+0000 7f0b35e3d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b301c3cb0 con 0x7f0b301356e0 2023-10-03T10:15:07.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.819+0000 7f0b2ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b301356e0 0x7f0b30118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.819+0000 7f0b2ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b301356e0 0x7f0b30118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38686/0 (socket says 172.21.15.146:38686) 2023-10-03T10:15:07.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.819+0000 7f0b2ffff700 1 -- 172.21.15.146:0/2313112237 learned_addr learned my addr 172.21.15.146:0/2313112237 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:07.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.819+0000 7f0b2f7fe700 1 --2- 172.21.15.146:0/2313112237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b300a0a30 0x7f0b301c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.820+0000 7f0b2effd700 1 --2- 172.21.15.146:0/2313112237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b300a1510 0x7f0b301c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.820+0000 7f0b2ffff700 1 -- 172.21.15.146:0/2313112237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b300a0a30 msgr2=0x7f0b301c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.820+0000 7f0b2ffff700 1 --2- 172.21.15.146:0/2313112237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b300a0a30 0x7f0b301c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.820+0000 7f0b2ffff700 1 -- 172.21.15.146:0/2313112237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b300a1510 msgr2=0x7f0b301c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.820+0000 7f0b2ffff700 1 --2- 172.21.15.146:0/2313112237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b300a1510 0x7f0b301c4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.820+0000 7f0b2ffff700 1 -- 172.21.15.146:0/2313112237 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2800bc80 con 0x7f0b301356e0 2023-10-03T10:15:07.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.820+0000 7f0b2effd700 1 --2- 172.21.15.146:0/2313112237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b300a1510 0x7f0b301c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.820+0000 7f0b2ffff700 1 --2- 172.21.15.146:0/2313112237 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b301356e0 0x7f0b30118df0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800e170 tx=0x7f0b2800e480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.820+0000 7f0b17fff700 1 -- 172.21.15.146:0/2313112237 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b28010050 con 0x7f0b301356e0 2023-10-03T10:15:07.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.820+0000 7f0b17fff700 1 -- 172.21.15.146:0/2313112237 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b28011040 con 0x7f0b301356e0 2023-10-03T10:15:07.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.820+0000 7f0b35e3d700 1 -- 172.21.15.146:0/2313112237 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b24009550 con 0x7f0b301356e0 2023-10-03T10:15:07.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.820+0000 7f0b17fff700 1 -- 172.21.15.146:0/2313112237 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2800eca0 con 0x7f0b301356e0 2023-10-03T10:15:07.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.820+0000 7f0b35e3d700 1 -- 172.21.15.146:0/2313112237 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b30119fa0 con 0x7f0b301356e0 2023-10-03T10:15:07.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.821+0000 7f0b17fff700 1 -- 172.21.15.146:0/2313112237 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b28009540 con 0x7f0b301356e0 2023-10-03T10:15:07.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.822+0000 7f0b35e3d700 1 -- 172.21.15.146:0/2313112237 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b3004f2a0 con 0x7f0b301356e0 2023-10-03T10:15:07.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.822+0000 7f0b17fff700 1 -- 172.21.15.146:0/2313112237 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0b2801f460 con 0x7f0b301356e0 2023-10-03T10:15:07.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.830+0000 7f0b17fff700 1 -- 172.21.15.146:0/2313112237 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b28014950 con 0x7f0b301356e0 2023-10-03T10:15:07.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.860+0000 7f6abcea8700 1 Processor -- start 2023-10-03T10:15:07.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.860+0000 7f6abcea8700 1 -- start start 2023-10-03T10:15:07.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.861+0000 7f6abcea8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ab809d860 0x7f6ab809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.861+0000 7f6abcea8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6ab809e170 0x7f6ab81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.861+0000 7f6abcea8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab809aaa0 con 0x7f6ab8130ce0 2023-10-03T10:15:07.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.861+0000 7f6abcea8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab809f870 con 0x7f6ab809e170 2023-10-03T10:15:07.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.861+0000 7f6abcea8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab809b360 con 0x7f6ab809d860 2023-10-03T10:15:07.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.861+0000 7f6ab5d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6ab809e170 0x7f6ab81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.861+0000 7f6ab659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ab809d860 0x7f6ab809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.861+0000 7f6ab5d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6ab809e170 0x7f6ab81307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35276/0 (socket says 172.21.15.146:35276) 2023-10-03T10:15:07.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.861+0000 7f6ab659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ab809d860 0x7f6ab809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38690/0 (socket says 172.21.15.146:38690) 2023-10-03T10:15:07.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.861+0000 7f6ab5d9b700 1 -- 172.21.15.146:0/2410168953 learned_addr learned my addr 172.21.15.146:0/2410168953 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:07.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.862+0000 7f6ab5d9b700 1 -- 172.21.15.146:0/2410168953 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ab809d860 msgr2=0x7f6ab809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:07.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.862+0000 7f6ab5d9b700 1 --2- 172.21.15.146:0/2410168953 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ab809d860 0x7f6ab809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.862+0000 7f6ab5d9b700 1 -- 172.21.15.146:0/2410168953 >> v1:172.21.15.146:6789/0 conn(0x7f6ab8130ce0 legacy=0x7f6ab81379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.862+0000 7f6ab5d9b700 1 -- 172.21.15.146:0/2410168953 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab809b620 con 0x7f6ab809e170 2023-10-03T10:15:07.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.862+0000 7f6ab659c700 1 --2- 172.21.15.146:0/2410168953 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ab809d860 0x7f6ab809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.862+0000 7f6ab5d9b700 1 --2- 172.21.15.146:0/2410168953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ab809e170 0x7f6ab81307a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0098f0 tx=0x7f6aac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5800eed96a7fb83d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.862+0000 7f6ab559a700 1 -- 172.21.15.146:0/2410168953 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac010a90 con 0x7f6ab809e170 2023-10-03T10:15:07.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.862+0000 7f6ab559a700 1 -- 172.21.15.146:0/2410168953 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac010bf0 con 0x7f6ab809e170 2023-10-03T10:15:07.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.862+0000 7f6ab559a700 1 -- 172.21.15.146:0/2410168953 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac018440 con 0x7f6ab809e170 2023-10-03T10:15:07.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.863+0000 7f6abcea8700 1 -- 172.21.15.146:0/2410168953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ab809e170 msgr2=0x7f6ab81307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.863+0000 7f6abcea8700 1 --2- 172.21.15.146:0/2410168953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ab809e170 0x7f6ab81307a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0098f0 tx=0x7f6aac009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:07.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.863+0000 7f6abcea8700 1 -- 172.21.15.146:0/2410168953 shutdown_connections 2023-10-03T10:15:07.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.863+0000 7f6abcea8700 1 --2- 172.21.15.146:0/2410168953 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ab809d860 0x7f6ab809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.863+0000 7f6abcea8700 1 --2- 172.21.15.146:0/2410168953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ab809e170 0x7f6ab81307a0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.863+0000 7f6abcea8700 1 -- 172.21.15.146:0/2410168953 >> 172.21.15.146:0/2410168953 conn(0x7f6ab8099c40 msgr2=0x7f6ab80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.863+0000 7f6abcea8700 1 -- 172.21.15.146:0/2410168953 shutdown_connections 2023-10-03T10:15:07.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.863+0000 7f6abcea8700 1 -- 172.21.15.146:0/2410168953 wait complete. 2023-10-03T10:15:07.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.864+0000 7f6abcea8700 1 Processor -- start 2023-10-03T10:15:07.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.864+0000 7f6abcea8700 1 -- start start 2023-10-03T10:15:07.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.865+0000 7f6abcea8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ab809d860 0x7f6ab811e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.865+0000 7f6abcea8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ab809e170 0x7f6ab811ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.865+0000 7f6abcea8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ab8130ce0 0x7f6ab811f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.865+0000 7f6abcea8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab8121ed0 con 0x7f6ab809d860 2023-10-03T10:15:07.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.865+0000 7f6abcea8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab81203b0 con 0x7f6ab8130ce0 2023-10-03T10:15:07.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.865+0000 7f6abcea8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab8120850 con 0x7f6ab809e170 2023-10-03T10:15:07.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.865+0000 7f6ab659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ab809d860 0x7f6ab811e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.865+0000 7f6ab5d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ab809e170 0x7f6ab811ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.865+0000 7f6ab659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ab809d860 0x7f6ab811e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35278/0 (socket says 172.21.15.146:35278) 2023-10-03T10:15:07.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.865+0000 7f6ab659c700 1 -- 172.21.15.146:0/2119123206 learned_addr learned my addr 172.21.15.146:0/2119123206 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:07.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.865+0000 7f6ab6d9d700 1 --2- 172.21.15.146:0/2119123206 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ab8130ce0 0x7f6ab811f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.865+0000 7f6ab5d9b700 1 -- 172.21.15.146:0/2119123206 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ab8130ce0 msgr2=0x7f6ab811f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.865+0000 7f6ab5d9b700 1 --2- 172.21.15.146:0/2119123206 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ab8130ce0 0x7f6ab811f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.865+0000 7f6ab5d9b700 1 -- 172.21.15.146:0/2119123206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ab809d860 msgr2=0x7f6ab811e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.865+0000 7f6ab5d9b700 1 --2- 172.21.15.146:0/2119123206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ab809d860 0x7f6ab811e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.865+0000 7f6ab5d9b700 1 -- 172.21.15.146:0/2119123206 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa80094a0 con 0x7f6ab809e170 2023-10-03T10:15:07.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.866+0000 7f6ab5d9b700 1 --2- 172.21.15.146:0/2119123206 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ab809e170 0x7f6ab811ebd0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6ab809f3d0 tx=0x7f6aac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.866+0000 7f6aa6ffd700 1 -- 172.21.15.146:0/2119123206 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac0038a0 con 0x7f6ab809e170 2023-10-03T10:15:07.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.866+0000 7f6aa6ffd700 1 -- 172.21.15.146:0/2119123206 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac003a00 con 0x7f6ab809e170 2023-10-03T10:15:07.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.866+0000 7f6aa6ffd700 1 -- 172.21.15.146:0/2119123206 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac003d90 con 0x7f6ab809e170 2023-10-03T10:15:07.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.866+0000 7f6abcea8700 1 -- 172.21.15.146:0/2119123206 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aac009550 con 0x7f6ab809e170 2023-10-03T10:15:07.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.866+0000 7f6abcea8700 1 -- 172.21.15.146:0/2119123206 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab81221b0 con 0x7f6ab809e170 2023-10-03T10:15:07.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.867+0000 7f6aa6ffd700 1 -- 172.21.15.146:0/2119123206 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6aac01f070 con 0x7f6ab809e170 2023-10-03T10:15:07.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.867+0000 7f6abcea8700 1 -- 172.21.15.146:0/2119123206 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab804f2a0 con 0x7f6ab809e170 2023-10-03T10:15:07.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.868+0000 7f6aa6ffd700 1 -- 172.21.15.146:0/2119123206 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6aac044f00 con 0x7f6ab809e170 2023-10-03T10:15:07.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.876+0000 7f6aa6ffd700 1 -- 172.21.15.146:0/2119123206 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6aac02c9b0 con 0x7f6ab809e170 2023-10-03T10:15:07.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.908+0000 7feb5ad5e700 1 Processor -- start 2023-10-03T10:15:07.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.908+0000 7feb5ad5e700 1 -- start start 2023-10-03T10:15:07.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.909+0000 7feb5ad5e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feb5409d860 0x7feb5409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.909+0000 7feb5ad5e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb5409e170 0x7feb541307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.909+0000 7feb5ad5e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb5409aaa0 con 0x7feb54130ce0 2023-10-03T10:15:07.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.909+0000 7feb5ad5e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb5409f870 con 0x7feb5409d860 2023-10-03T10:15:07.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.909+0000 7feb5ad5e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb5409b360 con 0x7feb5409e170 2023-10-03T10:15:07.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.909+0000 7feb53fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb5409e170 0x7feb541307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.909+0000 7feb53fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb5409e170 0x7feb541307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38708/0 (socket says 172.21.15.146:38708) 2023-10-03T10:15:07.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.909+0000 7feb592fb700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7feb54130ce0 0x7feb541379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:57554/0 (socket says 172.21.15.146:57554) 2023-10-03T10:15:07.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.909+0000 7feb53fff700 1 -- 172.21.15.146:0/4255356893 learned_addr learned my addr 172.21.15.146:0/4255356893 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:07.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.909+0000 7feb58afa700 1 --2- 172.21.15.146:0/4255356893 >> v2:172.21.15.146:3300/0 conn(0x7feb5409d860 0x7feb5409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.909+0000 7fbce338b700 1 Processor -- start 2023-10-03T10:15:07.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.909+0000 7feb53fff700 1 -- 172.21.15.146:0/4255356893 >> v2:172.21.15.146:3300/0 conn(0x7feb5409d860 msgr2=0x7feb5409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:07.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.909+0000 7feb53fff700 1 --2- 172.21.15.146:0/4255356893 >> v2:172.21.15.146:3300/0 conn(0x7feb5409d860 0x7feb5409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.909+0000 7feb53fff700 1 -- 172.21.15.146:0/4255356893 >> v1:172.21.15.146:6789/0 conn(0x7feb54130ce0 legacy=0x7feb541379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.909+0000 7feb53fff700 1 -- 172.21.15.146:0/4255356893 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5409b620 con 0x7feb5409e170 2023-10-03T10:15:07.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.910+0000 7feb53fff700 1 --2- 172.21.15.146:0/4255356893 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb5409e170 0x7feb541307a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7feb400098f0 tx=0x7feb40009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8c9aaf93ccc356c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.910+0000 7feb537fe700 1 -- 172.21.15.146:0/4255356893 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb40011830 con 0x7feb5409e170 2023-10-03T10:15:07.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.910+0000 7feb537fe700 1 -- 172.21.15.146:0/4255356893 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb40011990 con 0x7feb5409e170 2023-10-03T10:15:07.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.910+0000 7fbce338b700 1 -- start start 2023-10-03T10:15:07.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.910+0000 7feb537fe700 1 -- 172.21.15.146:0/4255356893 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb40011d20 con 0x7feb5409e170 2023-10-03T10:15:07.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.910+0000 7fbce338b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcdc09e340 0x7fbcdc1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.910+0000 7fbce338b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbcdc135f20 0x7fbcdc138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.910+0000 7fbce338b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcdc09aaa0 con 0x7fbcdc09d860 2023-10-03T10:15:07.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.910+0000 7fbce338b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc09e730 con 0x7fbcdc09e340 2023-10-03T10:15:07.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.910+0000 7fbce338b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc09f870 con 0x7fbcdc135f20 2023-10-03T10:15:07.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.910+0000 7fbce0926700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcdc09e340 0x7fbcdc1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.910+0000 7fbce1127700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbcdc09d860 0x7fbcdc09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:57566/0 (socket says 172.21.15.146:57566) 2023-10-03T10:15:07.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.910+0000 7fbce1127700 1 -- 172.21.15.146:0/935718654 learned_addr learned my addr 172.21.15.146:0/935718654 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:07.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.910+0000 7fbce1928700 1 --2- 172.21.15.146:0/935718654 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbcdc135f20 0x7fbcdc138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.911+0000 7feb5ad5e700 1 -- 172.21.15.146:0/4255356893 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb5409e170 msgr2=0x7feb541307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.911+0000 7feb5ad5e700 1 --2- 172.21.15.146:0/4255356893 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb5409e170 0x7feb541307a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7feb400098f0 tx=0x7feb40009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:07.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.911+0000 7feb5ad5e700 1 -- 172.21.15.146:0/4255356893 shutdown_connections 2023-10-03T10:15:07.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.911+0000 7feb5ad5e700 1 --2- 172.21.15.146:0/4255356893 >> v2:172.21.15.146:3300/0 conn(0x7feb5409d860 0x7feb5409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.911+0000 7feb5ad5e700 1 --2- 172.21.15.146:0/4255356893 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb5409e170 0x7feb541307a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.911+0000 7feb5ad5e700 1 -- 172.21.15.146:0/4255356893 >> 172.21.15.146:0/4255356893 conn(0x7feb54099c40 msgr2=0x7feb540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.911+0000 7fbce1928700 1 -- 172.21.15.146:0/935718654 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcdc09e340 msgr2=0x7fbcdc1359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:07.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.911+0000 7fbce1928700 1 --2- 172.21.15.146:0/935718654 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcdc09e340 0x7fbcdc1359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.911+0000 7fbce1928700 1 -- 172.21.15.146:0/935718654 >> v1:172.21.15.146:6789/0 conn(0x7fbcdc09d860 legacy=0x7fbcdc09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.911+0000 7fbce1928700 1 -- 172.21.15.146:0/935718654 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcdc09b360 con 0x7fbcdc135f20 2023-10-03T10:15:07.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.911+0000 7feb5ad5e700 1 -- 172.21.15.146:0/4255356893 shutdown_connections 2023-10-03T10:15:07.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.911+0000 7fbce1928700 1 --2- 172.21.15.146:0/935718654 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbcdc135f20 0x7fbcdc138300 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80098a0 tx=0x7fbcd8009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fe79214d8b2b41a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.911+0000 7feb5ad5e700 1 -- 172.21.15.146:0/4255356893 wait complete. 2023-10-03T10:15:07.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.911+0000 7fbcd3fff700 1 -- 172.21.15.146:0/935718654 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8011830 con 0x7fbcdc135f20 2023-10-03T10:15:07.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.911+0000 7fbcd3fff700 1 -- 172.21.15.146:0/935718654 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd8011990 con 0x7fbcdc135f20 2023-10-03T10:15:07.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.911+0000 7fbcd3fff700 1 -- 172.21.15.146:0/935718654 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8011d20 con 0x7fbcdc135f20 2023-10-03T10:15:07.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.912+0000 7fbce338b700 1 -- 172.21.15.146:0/935718654 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbcdc135f20 msgr2=0x7fbcdc138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.912+0000 7fbce338b700 1 --2- 172.21.15.146:0/935718654 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbcdc135f20 0x7fbcdc138300 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80098a0 tx=0x7fbcd8009bb0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.912+0000 7feb5ad5e700 1 Processor -- start 2023-10-03T10:15:07.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.912+0000 7fbce338b700 1 -- 172.21.15.146:0/935718654 shutdown_connections 2023-10-03T10:15:07.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.912+0000 7fbce338b700 1 --2- 172.21.15.146:0/935718654 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbcdc135f20 0x7fbcdc138300 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.912+0000 7fbce338b700 1 --2- 172.21.15.146:0/935718654 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcdc09e340 0x7fbcdc1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.912+0000 7fbce338b700 1 -- 172.21.15.146:0/935718654 >> 172.21.15.146:0/935718654 conn(0x7fbcdc099c40 msgr2=0x7fbcdc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.912+0000 7feb5ad5e700 1 -- start start 2023-10-03T10:15:07.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.912+0000 7fbce338b700 1 -- 172.21.15.146:0/935718654 shutdown_connections 2023-10-03T10:15:07.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.912+0000 7fbce338b700 1 -- 172.21.15.146:0/935718654 wait complete. 2023-10-03T10:15:07.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.913+0000 7feb5ad5e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb5409d860 0x7feb541c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.913+0000 7feb5ad5e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb5409e170 0x7feb541c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.913+0000 7feb5ad5e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb54130ce0 0x7feb541c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.913+0000 7feb5ad5e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb54121f30 con 0x7feb5409d860 2023-10-03T10:15:07.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.913+0000 7feb5ad5e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5411d630 con 0x7feb5409e170 2023-10-03T10:15:07.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.913+0000 7feb5ad5e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb5411c9a0 con 0x7feb54130ce0 2023-10-03T10:15:07.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.913+0000 7feb592fb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb54130ce0 0x7feb541c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.913+0000 7feb53fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb5409e170 0x7feb541c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.913+0000 7feb53fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb5409e170 0x7feb541c8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51122/0 (socket says 172.21.15.146:51122) 2023-10-03T10:15:07.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.913+0000 7feb53fff700 1 -- 172.21.15.146:0/4082115766 learned_addr learned my addr 172.21.15.146:0/4082115766 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:07.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.913+0000 7feb58afa700 1 --2- 172.21.15.146:0/4082115766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb5409d860 0x7feb541c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.913+0000 7feb53fff700 1 -- 172.21.15.146:0/4082115766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb54130ce0 msgr2=0x7feb541c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.913+0000 7feb53fff700 1 --2- 172.21.15.146:0/4082115766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb54130ce0 0x7feb541c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.913+0000 7feb53fff700 1 -- 172.21.15.146:0/4082115766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb5409d860 msgr2=0x7feb541c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.913+0000 7feb53fff700 1 --2- 172.21.15.146:0/4082115766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb5409d860 0x7feb541c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.913+0000 7feb53fff700 1 -- 172.21.15.146:0/4082115766 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb40009550 con 0x7feb5409e170 2023-10-03T10:15:07.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.913+0000 7fbce338b700 1 Processor -- start 2023-10-03T10:15:07.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.914+0000 7feb53fff700 1 --2- 172.21.15.146:0/4082115766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb5409e170 0x7feb541c8a60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7feb40000c00 tx=0x7feb40004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.913+0000 7fbce338b700 1 -- start start 2023-10-03T10:15:07.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.914+0000 7fbce338b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbcdc09d860 0x7fbcdc1198a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.914+0000 7fbce338b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcdc09e340 0x7fbcdc119de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.914+0000 7fbce338b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcdc135f20 0x7fbcdc1cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.914+0000 7fbce338b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc11caf0 con 0x7fbcdc135f20 2023-10-03T10:15:07.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.914+0000 7fbce338b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc1359d0 con 0x7fbcdc09e340 2023-10-03T10:15:07.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.914+0000 7fbce338b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc11b770 con 0x7fbcdc09d860 2023-10-03T10:15:07.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.914+0000 7feb517fa700 1 -- 172.21.15.146:0/4082115766 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb400036a0 con 0x7feb5409e170 2023-10-03T10:15:07.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.914+0000 7feb517fa700 1 -- 172.21.15.146:0/4082115766 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb40003800 con 0x7feb5409e170 2023-10-03T10:15:07.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.914+0000 7feb517fa700 1 -- 172.21.15.146:0/4082115766 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb40003bd0 con 0x7feb5409e170 2023-10-03T10:15:07.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.914+0000 7fbce0926700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcdc09e340 0x7fbcdc119de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.914+0000 7fbce1928700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcdc135f20 0x7fbcdc1cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.914+0000 7fbce1928700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcdc135f20 0x7fbcdc1cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35314/0 (socket says 172.21.15.146:35314) 2023-10-03T10:15:07.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.914+0000 7fbce0926700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcdc09e340 0x7fbcdc119de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51130/0 (socket says 172.21.15.146:51130) 2023-10-03T10:15:07.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.914+0000 7fbce1928700 1 -- 172.21.15.146:0/2709149858 learned_addr learned my addr 172.21.15.146:0/2709149858 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:07.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.914+0000 7fbce1127700 1 --2- 172.21.15.146:0/2709149858 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbcdc09d860 0x7fbcdc1198a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.915+0000 7fbce0926700 1 -- 172.21.15.146:0/2709149858 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbcdc09d860 msgr2=0x7fbcdc1198a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.915+0000 7fbce0926700 1 --2- 172.21.15.146:0/2709149858 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbcdc09d860 0x7fbcdc1198a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.915+0000 7fbce0926700 1 -- 172.21.15.146:0/2709149858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcdc135f20 msgr2=0x7fbcdc1cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.915+0000 7fbce0926700 1 --2- 172.21.15.146:0/2709149858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcdc135f20 0x7fbcdc1cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.915+0000 7fbce0926700 1 -- 172.21.15.146:0/2709149858 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd80094a0 con 0x7fbcdc09e340 2023-10-03T10:15:07.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.915+0000 7fbce0926700 1 --2- 172.21.15.146:0/2709149858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcdc09e340 0x7fbcdc119de0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00e930 tx=0x7fbccc00ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.915+0000 7feb5ad5e700 1 -- 172.21.15.146:0/4082115766 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb5406a9e0 con 0x7feb5409e170 2023-10-03T10:15:07.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.915+0000 7fbcd1ffb700 1 -- 172.21.15.146:0/2709149858 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc00ee80 con 0x7fbcdc09e340 2023-10-03T10:15:07.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.915+0000 7fbcd1ffb700 1 -- 172.21.15.146:0/2709149858 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbccc00c850 con 0x7fbcdc09e340 2023-10-03T10:15:07.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.915+0000 7fbcd1ffb700 1 -- 172.21.15.146:0/2709149858 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc00cbc0 con 0x7fbcdc09e340 2023-10-03T10:15:07.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.915+0000 7feb5ad5e700 1 -- 172.21.15.146:0/4082115766 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb5406b280 con 0x7feb5409e170 2023-10-03T10:15:07.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.916+0000 7feb517fa700 1 -- 172.21.15.146:0/4082115766 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb40021070 con 0x7feb5409e170 2023-10-03T10:15:07.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.916+0000 7feb5ad5e700 1 -- 172.21.15.146:0/4082115766 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb5404f2a0 con 0x7feb5409e170 2023-10-03T10:15:07.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.916+0000 7feb517fa700 1 -- 172.21.15.146:0/4082115766 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feb40040d40 con 0x7feb5409e170 2023-10-03T10:15:07.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.916+0000 7fbce338b700 1 -- 172.21.15.146:0/2709149858 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcdc09c8b0 con 0x7fbcdc09e340 2023-10-03T10:15:07.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.916+0000 7fbce338b700 1 -- 172.21.15.146:0/2709149858 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcdc11b220 con 0x7fbcdc09e340 2023-10-03T10:15:07.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.917+0000 7fbce338b700 1 -- 172.21.15.146:0/2709149858 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcdc11cc80 con 0x7fbcdc09e340 2023-10-03T10:15:07.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.921+0000 7fbcd1ffb700 1 -- 172.21.15.146:0/2709149858 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbccc00cd20 con 0x7fbcdc09e340 2023-10-03T10:15:07.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.922+0000 7fbcd1ffb700 1 -- 172.21.15.146:0/2709149858 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbccc03ff30 con 0x7fbcdc09e340 2023-10-03T10:15:07.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.922+0000 7feb517fa700 1 -- 172.21.15.146:0/4082115766 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb4000b3e0 con 0x7feb5409e170 2023-10-03T10:15:07.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:07.927+0000 7fbcd1ffb700 1 -- 172.21.15.146:0/2709149858 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbccc013470 con 0x7fbcdc09e340 2023-10-03T10:15:08.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.031+0000 7f0b35e3d700 1 -- 172.21.15.146:0/2313112237 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0b3011bb10 con 0x7f0b301356e0 2023-10-03T10:15:08.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.031+0000 7f0b17fff700 1 -- 172.21.15.146:0/2313112237 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b28014360 con 0x7f0b301356e0 2023-10-03T10:15:08.032 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:08.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.033+0000 7f0b35e3d700 1 -- 172.21.15.146:0/2313112237 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b301356e0 msgr2=0x7f0b30118df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.033+0000 7f0b35e3d700 1 --2- 172.21.15.146:0/2313112237 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b301356e0 0x7f0b30118df0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800e170 tx=0x7f0b2800e480 comp rx=0 tx=0).stop 2023-10-03T10:15:08.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.033+0000 7f0b35e3d700 1 -- 172.21.15.146:0/2313112237 shutdown_connections 2023-10-03T10:15:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.033+0000 7f0b35e3d700 1 --2- 172.21.15.146:0/2313112237 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b301356e0 0x7f0b30118df0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.033+0000 7f0b35e3d700 1 --2- 172.21.15.146:0/2313112237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b300a0a30 0x7f0b301c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.033+0000 7f0b35e3d700 1 --2- 172.21.15.146:0/2313112237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b300a1510 0x7f0b301c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.033+0000 7f0b35e3d700 1 -- 172.21.15.146:0/2313112237 >> 172.21.15.146:0/2313112237 conn(0x7f0b300a2980 msgr2=0x7f0b30130780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.034+0000 7f0b35e3d700 1 -- 172.21.15.146:0/2313112237 shutdown_connections 2023-10-03T10:15:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.034+0000 7f0b35e3d700 1 -- 172.21.15.146:0/2313112237 wait complete. 2023-10-03T10:15:08.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:08.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.085+0000 7f6abcea8700 1 -- 172.21.15.146:0/2119123206 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6ab8122010 con 0x7f6ab809e170 2023-10-03T10:15:08.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.085+0000 7f6aa6ffd700 1 -- 172.21.15.146:0/2119123206 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6ab8122010 con 0x7f6ab809e170 2023-10-03T10:15:08.086 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:08.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.087+0000 7f6abcea8700 1 -- 172.21.15.146:0/2119123206 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ab809e170 msgr2=0x7f6ab811ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.087+0000 7f6abcea8700 1 --2- 172.21.15.146:0/2119123206 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ab809e170 0x7f6ab811ebd0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6ab809f3d0 tx=0x7f6aac004750 comp rx=0 tx=0).stop 2023-10-03T10:15:08.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.087+0000 7f6abcea8700 1 -- 172.21.15.146:0/2119123206 shutdown_connections 2023-10-03T10:15:08.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.087+0000 7f6abcea8700 1 --2- 172.21.15.146:0/2119123206 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ab8130ce0 0x7f6ab811f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.087+0000 7f6abcea8700 1 --2- 172.21.15.146:0/2119123206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ab809d860 0x7f6ab811e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.087+0000 7f6abcea8700 1 --2- 172.21.15.146:0/2119123206 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ab809e170 0x7f6ab811ebd0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.087+0000 7f6abcea8700 1 -- 172.21.15.146:0/2119123206 >> 172.21.15.146:0/2119123206 conn(0x7f6ab8099c40 msgr2=0x7f6ab80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.087+0000 7f6abcea8700 1 -- 172.21.15.146:0/2119123206 shutdown_connections 2023-10-03T10:15:08.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.087+0000 7f6abcea8700 1 -- 172.21.15.146:0/2119123206 wait complete. 2023-10-03T10:15:08.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:08.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.119+0000 7feb5ad5e700 1 -- 172.21.15.146:0/4082115766 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7feb54130ac0 con 0x7feb5409e170 2023-10-03T10:15:08.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.120+0000 7feb517fa700 1 -- 172.21.15.146:0/4082115766 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7feb40015070 con 0x7feb5409e170 2023-10-03T10:15:08.120 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:08.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.122+0000 7feb5ad5e700 1 -- 172.21.15.146:0/4082115766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb5409e170 msgr2=0x7feb541c8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.122+0000 7feb5ad5e700 1 --2- 172.21.15.146:0/4082115766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb5409e170 0x7feb541c8a60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7feb40000c00 tx=0x7feb40004750 comp rx=0 tx=0).stop 2023-10-03T10:15:08.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.122+0000 7feb5ad5e700 1 -- 172.21.15.146:0/4082115766 shutdown_connections 2023-10-03T10:15:08.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.122+0000 7feb5ad5e700 1 --2- 172.21.15.146:0/4082115766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb54130ce0 0x7feb541c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.122+0000 7feb5ad5e700 1 --2- 172.21.15.146:0/4082115766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb5409d860 0x7feb541c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.122+0000 7feb5ad5e700 1 --2- 172.21.15.146:0/4082115766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb5409e170 0x7feb541c8a60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.122+0000 7feb5ad5e700 1 -- 172.21.15.146:0/4082115766 >> 172.21.15.146:0/4082115766 conn(0x7feb54099c40 msgr2=0x7feb541b5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.122+0000 7feb5ad5e700 1 -- 172.21.15.146:0/4082115766 shutdown_connections 2023-10-03T10:15:08.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.122+0000 7feb5ad5e700 1 -- 172.21.15.146:0/4082115766 wait complete. 2023-10-03T10:15:08.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.123+0000 7fbce338b700 1 -- 172.21.15.146:0/2709149858 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbcdc11cc80 con 0x7fbcdc09e340 2023-10-03T10:15:08.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.124+0000 7fbcd1ffb700 1 -- 172.21.15.146:0/2709149858 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbcdc11cc80 con 0x7fbcdc09e340 2023-10-03T10:15:08.124 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:08.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.126+0000 7fbce338b700 1 -- 172.21.15.146:0/2709149858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcdc09e340 msgr2=0x7fbcdc119de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.126+0000 7fbce338b700 1 --2- 172.21.15.146:0/2709149858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcdc09e340 0x7fbcdc119de0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00e930 tx=0x7fbccc00ec40 comp rx=0 tx=0).stop 2023-10-03T10:15:08.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.126+0000 7fbce338b700 1 -- 172.21.15.146:0/2709149858 shutdown_connections 2023-10-03T10:15:08.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.126+0000 7fbce338b700 1 --2- 172.21.15.146:0/2709149858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcdc135f20 0x7fbcdc1cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.126+0000 7fbce338b700 1 --2- 172.21.15.146:0/2709149858 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbcdc09d860 0x7fbcdc1198a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.126+0000 7fbce338b700 1 --2- 172.21.15.146:0/2709149858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcdc09e340 0x7fbcdc119de0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.126+0000 7fbce338b700 1 -- 172.21.15.146:0/2709149858 >> 172.21.15.146:0/2709149858 conn(0x7fbcdc099c40 msgr2=0x7fbcdc0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.126+0000 7fbce338b700 1 -- 172.21.15.146:0/2709149858 shutdown_connections 2023-10-03T10:15:08.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:08.126+0000 7fbce338b700 1 -- 172.21.15.146:0/2709149858 wait complete. 2023-10-03T10:15:08.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:08.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:09.048 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:09.102 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:09.137 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:09.141 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:09.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.184+0000 7fa83d1d0700 1 Processor -- start 2023-10-03T10:15:09.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.184+0000 7fa83d1d0700 1 -- start start 2023-10-03T10:15:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.185+0000 7fa83d1d0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa83809e870 0x7fa83809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.185+0000 7fa83d1d0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa83809f180 0x7fa838133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.185+0000 7fa83d1d0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8381341d0 0x7fa838134650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.185+0000 7fa83d1d0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa83806ce60 con 0x7fa83809e870 2023-10-03T10:15:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.185+0000 7fa83d1d0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83806bec0 con 0x7fa83809f180 2023-10-03T10:15:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.185+0000 7fa83d1d0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa83809fa00 con 0x7fa8381341d0 2023-10-03T10:15:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.185+0000 7fa836d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa83809e870 0x7fa83809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.185+0000 7fa83659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa83809f180 0x7fa838133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.185+0000 7fa836d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa83809e870 0x7fa83809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35330/0 (socket says 172.21.15.146:35330) 2023-10-03T10:15:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.185+0000 7fa83659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa83809f180 0x7fa838133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51136/0 (socket says 172.21.15.146:51136) 2023-10-03T10:15:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.185+0000 7fa836d9d700 1 -- 172.21.15.146:0/4231030908 learned_addr learned my addr 172.21.15.146:0/4231030908 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.185+0000 7fa83759e700 1 --2- 172.21.15.146:0/4231030908 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8381341d0 0x7fa838134650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.185+0000 7fa83659c700 1 -- 172.21.15.146:0/4231030908 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8381341d0 msgr2=0x7fa838134650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.185+0000 7fa83659c700 1 --2- 172.21.15.146:0/4231030908 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8381341d0 0x7fa838134650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.185+0000 7fa83659c700 1 -- 172.21.15.146:0/4231030908 >> v2:172.21.15.146:3300/0 conn(0x7fa83809e870 msgr2=0x7fa83809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.185+0000 7fa83659c700 1 --2- 172.21.15.146:0/4231030908 >> v2:172.21.15.146:3300/0 conn(0x7fa83809e870 0x7fa83809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.185+0000 7fa83659c700 1 -- 172.21.15.146:0/4231030908 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83809ad80 con 0x7fa83809f180 2023-10-03T10:15:09.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.185+0000 7fa83759e700 1 --2- 172.21.15.146:0/4231030908 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8381341d0 0x7fa838134650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:09.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.185+0000 7fa836d9d700 1 --2- 172.21.15.146:0/4231030908 >> v2:172.21.15.146:3300/0 conn(0x7fa83809e870 0x7fa83809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:09.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.186+0000 7fa83659c700 1 --2- 172.21.15.146:0/4231030908 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa83809f180 0x7fa838133c90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa82c009840 tx=0x7fa82c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=802de8e08b72816b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.186+0000 7fa835d9b700 1 -- 172.21.15.146:0/4231030908 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c011830 con 0x7fa83809f180 2023-10-03T10:15:09.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.186+0000 7fa835d9b700 1 -- 172.21.15.146:0/4231030908 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c011990 con 0x7fa83809f180 2023-10-03T10:15:09.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.186+0000 7fa835d9b700 1 -- 172.21.15.146:0/4231030908 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c011d20 con 0x7fa83809f180 2023-10-03T10:15:09.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.186+0000 7fa83d1d0700 1 -- 172.21.15.146:0/4231030908 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa83809f180 msgr2=0x7fa838133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.186+0000 7fa83d1d0700 1 --2- 172.21.15.146:0/4231030908 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa83809f180 0x7fa838133c90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa82c009840 tx=0x7fa82c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:09.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.186+0000 7fa83d1d0700 1 -- 172.21.15.146:0/4231030908 shutdown_connections 2023-10-03T10:15:09.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.187+0000 7fa83d1d0700 1 --2- 172.21.15.146:0/4231030908 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8381341d0 0x7fa838134650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.187+0000 7fa83d1d0700 1 --2- 172.21.15.146:0/4231030908 >> v2:172.21.15.146:3300/0 conn(0x7fa83809e870 0x7fa83809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.187+0000 7fa83d1d0700 1 --2- 172.21.15.146:0/4231030908 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa83809f180 0x7fa838133c90 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.187+0000 7fa83d1d0700 1 -- 172.21.15.146:0/4231030908 >> 172.21.15.146:0/4231030908 conn(0x7fa8380a4430 msgr2=0x7fa8380a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.187+0000 7fa83d1d0700 1 -- 172.21.15.146:0/4231030908 shutdown_connections 2023-10-03T10:15:09.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.187+0000 7fa83d1d0700 1 -- 172.21.15.146:0/4231030908 wait complete. 2023-10-03T10:15:09.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.188+0000 7fa83d1d0700 1 Processor -- start 2023-10-03T10:15:09.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.188+0000 7fa83d1d0700 1 -- start start 2023-10-03T10:15:09.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.188+0000 7fa83d1d0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa83809e870 0x7fa838122600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.188+0000 7fa83d1d0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa83809f180 0x7fa838122b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.188+0000 7fa83d1d0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8381341d0 0x7fa838123080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.188+0000 7fa83d1d0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa838123ad0 con 0x7fa8381341d0 2023-10-03T10:15:09.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.188+0000 7fa83d1d0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8381339d0 con 0x7fa83809e870 2023-10-03T10:15:09.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.188+0000 7fa83d1d0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8381250a0 con 0x7fa83809f180 2023-10-03T10:15:09.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.188+0000 7fa83759e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8381341d0 0x7fa838123080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.189+0000 7fa83759e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8381341d0 0x7fa838123080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35338/0 (socket says 172.21.15.146:35338) 2023-10-03T10:15:09.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.189+0000 7fa83759e700 1 -- 172.21.15.146:0/883993207 learned_addr learned my addr 172.21.15.146:0/883993207 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:09.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.189+0000 7fa836d9d700 1 --2- 172.21.15.146:0/883993207 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa83809e870 0x7fa838122600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.189+0000 7fa836d9d700 1 -- 172.21.15.146:0/883993207 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa83809f180 msgr2=0x7fa838122b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.189+0000 7fa836d9d700 1 --2- 172.21.15.146:0/883993207 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa83809f180 0x7fa838122b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.189+0000 7fa836d9d700 1 -- 172.21.15.146:0/883993207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8381341d0 msgr2=0x7fa838123080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.189+0000 7fa836d9d700 1 --2- 172.21.15.146:0/883993207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8381341d0 0x7fa838123080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.189+0000 7fa836d9d700 1 -- 172.21.15.146:0/883993207 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa828009550 con 0x7fa83809e870 2023-10-03T10:15:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.189+0000 7fa83759e700 1 --2- 172.21.15.146:0/883993207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8381341d0 0x7fa838123080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.189+0000 7fa836d9d700 1 --2- 172.21.15.146:0/883993207 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa83809e870 0x7fa838122600 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa82800e9a0 tx=0x7fa82800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.189+0000 7fa81f7fe700 1 -- 172.21.15.146:0/883993207 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa828004030 con 0x7fa83809e870 2023-10-03T10:15:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.189+0000 7fa83d1d0700 1 -- 172.21.15.146:0/883993207 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82c0094a0 con 0x7fa83809e870 2023-10-03T10:15:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.189+0000 7fa81f7fe700 1 -- 172.21.15.146:0/883993207 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa828004190 con 0x7fa83809e870 2023-10-03T10:15:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.189+0000 7fa81f7fe700 1 -- 172.21.15.146:0/883993207 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa828004520 con 0x7fa83809e870 2023-10-03T10:15:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.189+0000 7fa83d1d0700 1 -- 172.21.15.146:0/883993207 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8381258b0 con 0x7fa83809e870 2023-10-03T10:15:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.190+0000 7fa81f7fe700 1 -- 172.21.15.146:0/883993207 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa82800c850 con 0x7fa83809e870 2023-10-03T10:15:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.191+0000 7fa81f7fe700 1 -- 172.21.15.146:0/883993207 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa82803f760 con 0x7fa83809e870 2023-10-03T10:15:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.191+0000 7fa83d1d0700 1 -- 172.21.15.146:0/883993207 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa838125c40 con 0x7fa83809e870 2023-10-03T10:15:09.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.199+0000 7fa81f7fe700 1 -- 172.21.15.146:0/883993207 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa8280036a0 con 0x7fa83809e870 2023-10-03T10:15:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.234+0000 7efcbd2b8700 1 Processor -- start 2023-10-03T10:15:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.234+0000 7efcbd2b8700 1 -- start start 2023-10-03T10:15:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.235+0000 7efcbd2b8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efcb8138040 0x7efcb8138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.235+0000 7efcbd2b8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcb80a08e0 0x7efcb80a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.235+0000 7efcbd2b8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efcb80a1230 0x7efcb813ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.235+0000 7efcbd2b8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb80a2100 con 0x7efcb8138040 2023-10-03T10:15:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.235+0000 7efcbd2b8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb8138950 con 0x7efcb80a08e0 2023-10-03T10:15:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.235+0000 7efcbd2b8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efcb81379e0 con 0x7efcb80a1230 2023-10-03T10:15:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.235+0000 7efcb67fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcb80a08e0 0x7efcb80a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.235+0000 7efcb67fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcb80a08e0 0x7efcb80a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51150/0 (socket says 172.21.15.146:51150) 2023-10-03T10:15:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.235+0000 7efcb67fc700 1 -- 172.21.15.146:0/3045861324 learned_addr learned my addr 172.21.15.146:0/3045861324 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.235+0000 7efcb6ffd700 1 --2- 172.21.15.146:0/3045861324 >> v2:172.21.15.146:3300/0 conn(0x7efcb8138040 0x7efcb8138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.235+0000 7efcb77fe700 1 --2- 172.21.15.146:0/3045861324 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efcb80a1230 0x7efcb813ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.235+0000 7efcb67fc700 1 -- 172.21.15.146:0/3045861324 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efcb80a1230 msgr2=0x7efcb813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.235+0000 7efcb67fc700 1 --2- 172.21.15.146:0/3045861324 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efcb80a1230 0x7efcb813ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.235+0000 7efcb67fc700 1 -- 172.21.15.146:0/3045861324 >> v2:172.21.15.146:3300/0 conn(0x7efcb8138040 msgr2=0x7efcb8138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.235+0000 7efcb67fc700 1 --2- 172.21.15.146:0/3045861324 >> v2:172.21.15.146:3300/0 conn(0x7efcb8138040 0x7efcb8138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.235+0000 7efcb67fc700 1 -- 172.21.15.146:0/3045861324 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb809b9b0 con 0x7efcb80a08e0 2023-10-03T10:15:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.235+0000 7efcb77fe700 1 --2- 172.21.15.146:0/3045861324 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efcb80a1230 0x7efcb813ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.235+0000 7efcb6ffd700 1 --2- 172.21.15.146:0/3045861324 >> v2:172.21.15.146:3300/0 conn(0x7efcb8138040 0x7efcb8138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.236+0000 7efcb67fc700 1 --2- 172.21.15.146:0/3045861324 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcb80a08e0 0x7efcb80a0cf0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7efcac009920 tx=0x7efcac009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5da79b4bd724995 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.236+0000 7efcb5ffb700 1 -- 172.21.15.146:0/3045861324 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac011830 con 0x7efcb80a08e0 2023-10-03T10:15:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.236+0000 7efcb5ffb700 1 -- 172.21.15.146:0/3045861324 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcac011990 con 0x7efcb80a08e0 2023-10-03T10:15:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.236+0000 7efcb5ffb700 1 -- 172.21.15.146:0/3045861324 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac011d20 con 0x7efcb80a08e0 2023-10-03T10:15:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.237+0000 7efcbd2b8700 1 -- 172.21.15.146:0/3045861324 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcb80a08e0 msgr2=0x7efcb80a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.237+0000 7efcbd2b8700 1 --2- 172.21.15.146:0/3045861324 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcb80a08e0 0x7efcb80a0cf0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7efcac009920 tx=0x7efcac009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.237+0000 7efcbd2b8700 1 -- 172.21.15.146:0/3045861324 shutdown_connections 2023-10-03T10:15:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.237+0000 7efcbd2b8700 1 --2- 172.21.15.146:0/3045861324 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efcb80a1230 0x7efcb813ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.237+0000 7efcbd2b8700 1 --2- 172.21.15.146:0/3045861324 >> v2:172.21.15.146:3300/0 conn(0x7efcb8138040 0x7efcb8138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.237+0000 7efcbd2b8700 1 --2- 172.21.15.146:0/3045861324 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcb80a08e0 0x7efcb80a0cf0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.237+0000 7efcbd2b8700 1 -- 172.21.15.146:0/3045861324 >> 172.21.15.146:0/3045861324 conn(0x7efcb80a2980 msgr2=0x7efcb80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.237+0000 7efcbd2b8700 1 -- 172.21.15.146:0/3045861324 shutdown_connections 2023-10-03T10:15:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.237+0000 7efcbd2b8700 1 -- 172.21.15.146:0/3045861324 wait complete. 2023-10-03T10:15:09.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.238+0000 7efcbd2b8700 1 Processor -- start 2023-10-03T10:15:09.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.238+0000 7efcbd2b8700 1 -- start start 2023-10-03T10:15:09.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.239+0000 7efcbd2b8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcb80a08e0 0x7efcb81d5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.239+0000 7efcbd2b8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efcb80a1230 0x7efcb81d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.239+0000 7efcbd2b8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcb8138040 0x7efcb8118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.239+0000 7efcbd2b8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb81d5ee0 con 0x7efcb8138040 2023-10-03T10:15:09.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.239+0000 7efcbd2b8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb811aed0 con 0x7efcb80a08e0 2023-10-03T10:15:09.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.239+0000 7efcbd2b8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efcb809a240 con 0x7efcb80a1230 2023-10-03T10:15:09.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.239+0000 7efcb6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcb80a08e0 0x7efcb81d5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.239+0000 7efcb6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcb80a08e0 0x7efcb81d5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51156/0 (socket says 172.21.15.146:51156) 2023-10-03T10:15:09.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.239+0000 7efcb6ffd700 1 -- 172.21.15.146:0/3754511513 learned_addr learned my addr 172.21.15.146:0/3754511513 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:09.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.239+0000 7efcb67fc700 1 --2- 172.21.15.146:0/3754511513 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efcb80a1230 0x7efcb81d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.239+0000 7efcb77fe700 1 --2- 172.21.15.146:0/3754511513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcb8138040 0x7efcb8118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.240+0000 7efcb67fc700 1 -- 172.21.15.146:0/3754511513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcb80a08e0 msgr2=0x7efcb81d5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.240+0000 7efcb67fc700 1 --2- 172.21.15.146:0/3754511513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcb80a08e0 0x7efcb81d5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.240+0000 7efcb67fc700 1 -- 172.21.15.146:0/3754511513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcb8138040 msgr2=0x7efcb8118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.240+0000 7efcb67fc700 1 --2- 172.21.15.146:0/3754511513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcb8138040 0x7efcb8118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.240+0000 7efcb67fc700 1 -- 172.21.15.146:0/3754511513 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca8009430 con 0x7efcb80a1230 2023-10-03T10:15:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.240+0000 7efcb67fc700 1 --2- 172.21.15.146:0/3754511513 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efcb80a1230 0x7efcb81d59a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efcac009920 tx=0x7efcac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.240+0000 7efc9f7fe700 1 -- 172.21.15.146:0/3754511513 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac004510 con 0x7efcb80a1230 2023-10-03T10:15:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.240+0000 7efc9f7fe700 1 -- 172.21.15.146:0/3754511513 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcac01e070 con 0x7efcb80a1230 2023-10-03T10:15:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.240+0000 7efcbd2b8700 1 -- 172.21.15.146:0/3754511513 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcac009550 con 0x7efcb80a1230 2023-10-03T10:15:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.240+0000 7efc9f7fe700 1 -- 172.21.15.146:0/3754511513 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac0038e0 con 0x7efcb80a1230 2023-10-03T10:15:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.240+0000 7efcbd2b8700 1 -- 172.21.15.146:0/3754511513 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb811b470 con 0x7efcb80a1230 2023-10-03T10:15:09.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.241+0000 7efc9d7fa700 1 -- 172.21.15.146:0/3754511513 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc900052e0 con 0x7efcb80a1230 2023-10-03T10:15:09.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.242+0000 7efc9f7fe700 1 -- 172.21.15.146:0/3754511513 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efcac003a40 con 0x7efcb80a1230 2023-10-03T10:15:09.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.242+0000 7efc9f7fe700 1 -- 172.21.15.146:0/3754511513 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efcac020070 con 0x7efcb80a1230 2023-10-03T10:15:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.246+0000 7efc9f7fe700 1 -- 172.21.15.146:0/3754511513 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efcac00b3e0 con 0x7efcb80a1230 2023-10-03T10:15:09.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.278+0000 7f77afeed700 1 Processor -- start 2023-10-03T10:15:09.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.278+0000 7f77afeed700 1 -- start start 2023-10-03T10:15:09.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.279+0000 7f77afeed700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f77a809e870 0x7f77a809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.279+0000 7f77afeed700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77a809f180 0x7f77a8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.279+0000 7f77afeed700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a809c970 con 0x7f77a8131d70 2023-10-03T10:15:09.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.279+0000 7f77afeed700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a80a0920 con 0x7f77a809f180 2023-10-03T10:15:09.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.279+0000 7f77afeed700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77a809f9c0 con 0x7f77a809e870 2023-10-03T10:15:09.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.279+0000 7f77ae48a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f77a8131d70 0x7f77a8138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:57578/0 (socket says 172.21.15.146:57578) 2023-10-03T10:15:09.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.279+0000 7f77ae48a700 1 -- 172.21.15.146:0/1342244289 learned_addr learned my addr 172.21.15.146:0/1342244289 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:09.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.279+0000 7f77adc89700 1 --2- 172.21.15.146:0/1342244289 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f77a809e870 0x7f77a809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.280+0000 7f77adc89700 1 -- 172.21.15.146:0/1342244289 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77a809f180 msgr2=0x7f77a8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:09.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.280+0000 7f77acc87700 1 -- 172.21.15.146:0/1342244289 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212477040 0 0) 0x7f77a809c970 con 0x7f77a8131d70 2023-10-03T10:15:09.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.280+0000 7f77adc89700 1 --2- 172.21.15.146:0/1342244289 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77a809f180 0x7f77a8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.280+0000 7f77adc89700 1 -- 172.21.15.146:0/1342244289 >> v1:172.21.15.146:6789/0 conn(0x7f77a8131d70 legacy=0x7f77a8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.280+0000 7f77adc89700 1 -- 172.21.15.146:0/1342244289 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a809bab0 con 0x7f77a809e870 2023-10-03T10:15:09.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.280+0000 7f77adc89700 1 --2- 172.21.15.146:0/1342244289 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f77a809e870 0x7f77a809ec40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f77a4009870 tx=0x7f77a4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ba0475e40dbc3df server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.280+0000 7f77acc87700 1 -- 172.21.15.146:0/1342244289 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a4011830 con 0x7f77a809e870 2023-10-03T10:15:09.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.280+0000 7f77acc87700 1 -- 172.21.15.146:0/1342244289 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a4011990 con 0x7f77a809e870 2023-10-03T10:15:09.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.280+0000 7f77acc87700 1 -- 172.21.15.146:0/1342244289 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a4011d20 con 0x7f77a809e870 2023-10-03T10:15:09.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.281+0000 7f77afeed700 1 -- 172.21.15.146:0/1342244289 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f77a809e870 msgr2=0x7f77a809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.281+0000 7f77afeed700 1 --2- 172.21.15.146:0/1342244289 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f77a809e870 0x7f77a809ec40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f77a4009870 tx=0x7f77a4009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:09.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.281+0000 7f77afeed700 1 -- 172.21.15.146:0/1342244289 shutdown_connections 2023-10-03T10:15:09.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.281+0000 7f77afeed700 1 --2- 172.21.15.146:0/1342244289 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f77a809e870 0x7f77a809ec40 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.281+0000 7f77afeed700 1 --2- 172.21.15.146:0/1342244289 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77a809f180 0x7f77a8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.281+0000 7f77afeed700 1 -- 172.21.15.146:0/1342244289 >> 172.21.15.146:0/1342244289 conn(0x7f77a80a4430 msgr2=0x7f77a80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.281+0000 7f77afeed700 1 -- 172.21.15.146:0/1342244289 shutdown_connections 2023-10-03T10:15:09.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.281+0000 7f77afeed700 1 -- 172.21.15.146:0/1342244289 wait complete. 2023-10-03T10:15:09.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.282+0000 7f77afeed700 1 Processor -- start 2023-10-03T10:15:09.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.282+0000 7f77afeed700 1 -- start start 2023-10-03T10:15:09.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.282+0000 7f77afeed700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77a809e870 0x7f77a806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.282+0000 7f77afeed700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f77a809f180 0x7f77a806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.282+0000 7f77afeed700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77a8131d70 0x7f77a806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.282+0000 7f77afeed700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a8125a10 con 0x7f77a809e870 2023-10-03T10:15:09.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.282+0000 7f77afeed700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a806d640 con 0x7f77a8131d70 2023-10-03T10:15:09.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.282+0000 7f77afeed700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77a809b160 con 0x7f77a809f180 2023-10-03T10:15:09.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.282+0000 7f77adc89700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77a809e870 0x7f77a806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.282+0000 7f77adc89700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77a809e870 0x7f77a806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35360/0 (socket says 172.21.15.146:35360) 2023-10-03T10:15:09.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.282+0000 7f77adc89700 1 -- 172.21.15.146:0/4172727492 learned_addr learned my addr 172.21.15.146:0/4172727492 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:09.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.282+0000 7f77ad488700 1 --2- 172.21.15.146:0/4172727492 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f77a809f180 0x7f77a806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.283+0000 7f77adc89700 1 -- 172.21.15.146:0/4172727492 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f77a809f180 msgr2=0x7f77a806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.283+0000 7f77adc89700 1 --2- 172.21.15.146:0/4172727492 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f77a809f180 0x7f77a806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.283+0000 7f77adc89700 1 -- 172.21.15.146:0/4172727492 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77a8131d70 msgr2=0x7f77a806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.283+0000 7f77adc89700 1 --2- 172.21.15.146:0/4172727492 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77a8131d70 0x7f77a806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.283+0000 7f77adc89700 1 -- 172.21.15.146:0/4172727492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a40094a0 con 0x7f77a809e870 2023-10-03T10:15:09.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.283+0000 7f77ad488700 1 --2- 172.21.15.146:0/4172727492 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f77a809f180 0x7f77a806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:09.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.283+0000 7f77adc89700 1 --2- 172.21.15.146:0/4172727492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77a809e870 0x7f77a806b8b0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f77a40090b0 tx=0x7f77a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.283+0000 7f779e7fc700 1 -- 172.21.15.146:0/4172727492 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a40036a0 con 0x7f77a809e870 2023-10-03T10:15:09.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.283+0000 7f779e7fc700 1 -- 172.21.15.146:0/4172727492 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a401e070 con 0x7f77a809e870 2023-10-03T10:15:09.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.283+0000 7f77afeed700 1 -- 172.21.15.146:0/4172727492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a8125fb0 con 0x7f77a809e870 2023-10-03T10:15:09.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.283+0000 7f779e7fc700 1 -- 172.21.15.146:0/4172727492 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a4003a20 con 0x7f77a809e870 2023-10-03T10:15:09.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.283+0000 7f77afeed700 1 -- 172.21.15.146:0/4172727492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a8125cd0 con 0x7f77a809e870 2023-10-03T10:15:09.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.284+0000 7f77afeed700 1 -- 172.21.15.146:0/4172727492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a809f5b0 con 0x7f77a809e870 2023-10-03T10:15:09.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.284+0000 7f779e7fc700 1 -- 172.21.15.146:0/4172727492 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f77a4003b80 con 0x7f77a809e870 2023-10-03T10:15:09.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.284+0000 7f779e7fc700 1 -- 172.21.15.146:0/4172727492 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f77a40406d0 con 0x7f77a809e870 2023-10-03T10:15:09.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.293+0000 7f779e7fc700 1 -- 172.21.15.146:0/4172727492 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77a809f5b0 con 0x7f77a809e870 2023-10-03T10:15:09.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.295+0000 7fa8bdc30700 1 Processor -- start 2023-10-03T10:15:09.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.295+0000 7fa8bdc30700 1 -- start start 2023-10-03T10:15:09.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.296+0000 7fa8bdc30700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b8133ad0 0x7fa8b8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.296+0000 7fa8bdc30700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b81300a0 0x7fa8b81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.296+0000 7fa8bdc30700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa8b81309f0 0x7fa8b813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.296+0000 7fa8bdc30700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b806b2d0 con 0x7fa8b81309f0 2023-10-03T10:15:09.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.296+0000 7fa8bdc30700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b8133610 con 0x7fa8b81300a0 2023-10-03T10:15:09.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.296+0000 7fa8bdc30700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b809a500 con 0x7fa8b8133ad0 2023-10-03T10:15:09.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.296+0000 7fa8b6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b81300a0 0x7fa8b81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.296+0000 7fa8b6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b81300a0 0x7fa8b81304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51190/0 (socket says 172.21.15.146:51190) 2023-10-03T10:15:09.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.296+0000 7fa8b6ffd700 1 -- 172.21.15.146:0/1838811855 learned_addr learned my addr 172.21.15.146:0/1838811855 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:09.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.296+0000 7fa8b77fe700 1 --2- 172.21.15.146:0/1838811855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b8133ad0 0x7fa8b8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.296+0000 7fa8b7fff700 1 --2- 172.21.15.146:0/1838811855 >> v2:172.21.15.146:3300/0 conn(0x7fa8b81309f0 0x7fa8b813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.296+0000 7fa8b77fe700 1 -- 172.21.15.146:0/1838811855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b81300a0 msgr2=0x7fa8b81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:09.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.296+0000 7fa8b77fe700 1 --2- 172.21.15.146:0/1838811855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b81300a0 0x7fa8b81304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.296+0000 7fa8b77fe700 1 -- 172.21.15.146:0/1838811855 >> v2:172.21.15.146:3300/0 conn(0x7fa8b81309f0 msgr2=0x7fa8b813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:09.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.296+0000 7fa8b77fe700 1 --2- 172.21.15.146:0/1838811855 >> v2:172.21.15.146:3300/0 conn(0x7fa8b81309f0 0x7fa8b813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.296+0000 7fa8b77fe700 1 -- 172.21.15.146:0/1838811855 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b81338b0 con 0x7fa8b8133ad0 2023-10-03T10:15:09.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.296+0000 7fa8b6ffd700 1 --2- 172.21.15.146:0/1838811855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b81300a0 0x7fa8b81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:09.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.297+0000 7fa8b77fe700 1 --2- 172.21.15.146:0/1838811855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b8133ad0 0x7fa8b8133ea0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8009840 tx=0x7fa8a8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ee495f386d0ace1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.297+0000 7fa8b67fc700 1 -- 172.21.15.146:0/1838811855 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8011830 con 0x7fa8b8133ad0 2023-10-03T10:15:09.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.297+0000 7fa8b67fc700 1 -- 172.21.15.146:0/1838811855 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a8011990 con 0x7fa8b8133ad0 2023-10-03T10:15:09.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.297+0000 7fa8b67fc700 1 -- 172.21.15.146:0/1838811855 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8011d20 con 0x7fa8b8133ad0 2023-10-03T10:15:09.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.297+0000 7fa8bdc30700 1 -- 172.21.15.146:0/1838811855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b8133ad0 msgr2=0x7fa8b8133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.297+0000 7fa8bdc30700 1 --2- 172.21.15.146:0/1838811855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b8133ad0 0x7fa8b8133ea0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8009840 tx=0x7fa8a8009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:09.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.298+0000 7fa8bdc30700 1 -- 172.21.15.146:0/1838811855 shutdown_connections 2023-10-03T10:15:09.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.298+0000 7fa8bdc30700 1 --2- 172.21.15.146:0/1838811855 >> v2:172.21.15.146:3300/0 conn(0x7fa8b81309f0 0x7fa8b813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.298+0000 7fa8bdc30700 1 --2- 172.21.15.146:0/1838811855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b8133ad0 0x7fa8b8133ea0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.298+0000 7fa8bdc30700 1 --2- 172.21.15.146:0/1838811855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b81300a0 0x7fa8b81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.298+0000 7fa8bdc30700 1 -- 172.21.15.146:0/1838811855 >> 172.21.15.146:0/1838811855 conn(0x7fa8b8099c40 msgr2=0x7fa8b80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.298+0000 7fa8bdc30700 1 -- 172.21.15.146:0/1838811855 shutdown_connections 2023-10-03T10:15:09.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.298+0000 7fa8bdc30700 1 -- 172.21.15.146:0/1838811855 wait complete. 2023-10-03T10:15:09.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.299+0000 7fa8bdc30700 1 Processor -- start 2023-10-03T10:15:09.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.299+0000 7fa8bdc30700 1 -- start start 2023-10-03T10:15:09.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.300+0000 7fa8bdc30700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b81300a0 0x7fa8b811ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.300+0000 7fa8bdc30700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b81309f0 0x7fa8b811d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.300+0000 7fa8bdc30700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b8133ad0 0x7fa8b8119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.300+0000 7fa8bdc30700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b811d900 con 0x7fa8b81300a0 2023-10-03T10:15:09.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.300+0000 7fa8bdc30700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b811c620 con 0x7fa8b8133ad0 2023-10-03T10:15:09.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.300+0000 7fa8bdc30700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b811bc40 con 0x7fa8b81309f0 2023-10-03T10:15:09.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.300+0000 7fa8b77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b81300a0 0x7fa8b811ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.300+0000 7fa8b77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b81300a0 0x7fa8b811ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35388/0 (socket says 172.21.15.146:35388) 2023-10-03T10:15:09.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.300+0000 7fa8b77fe700 1 -- 172.21.15.146:0/1378923046 learned_addr learned my addr 172.21.15.146:0/1378923046 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:09.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.300+0000 7fa8b6ffd700 1 --2- 172.21.15.146:0/1378923046 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b81309f0 0x7fa8b811d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.300+0000 7fa8b7fff700 1 --2- 172.21.15.146:0/1378923046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b8133ad0 0x7fa8b8119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.300+0000 7fa8b77fe700 1 -- 172.21.15.146:0/1378923046 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b81309f0 msgr2=0x7fa8b811d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.300+0000 7fa8b77fe700 1 --2- 172.21.15.146:0/1378923046 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b81309f0 0x7fa8b811d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.300+0000 7fa8b77fe700 1 -- 172.21.15.146:0/1378923046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b8133ad0 msgr2=0x7fa8b8119630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.300+0000 7fa8b77fe700 1 --2- 172.21.15.146:0/1378923046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b8133ad0 0x7fa8b8119630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.300+0000 7fa8b77fe700 1 -- 172.21.15.146:0/1378923046 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac009550 con 0x7fa8b81300a0 2023-10-03T10:15:09.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.301+0000 7fa8b77fe700 1 --2- 172.21.15.146:0/1378923046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b81300a0 0x7fa8b811ce80 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8009b90 tx=0x7fa8a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.301+0000 7fa89ffff700 1 -- 172.21.15.146:0/1378923046 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8004510 con 0x7fa8b81300a0 2023-10-03T10:15:09.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.301+0000 7fa89ffff700 1 -- 172.21.15.146:0/1378923046 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a80036a0 con 0x7fa8b81300a0 2023-10-03T10:15:09.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.301+0000 7fa89ffff700 1 -- 172.21.15.146:0/1378923046 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8003a10 con 0x7fa8b81300a0 2023-10-03T10:15:09.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.301+0000 7fa8bdc30700 1 -- 172.21.15.146:0/1378923046 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a80094a0 con 0x7fa8b81300a0 2023-10-03T10:15:09.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.302+0000 7fa8bdc30700 1 -- 172.21.15.146:0/1378923046 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b80a2ea0 con 0x7fa8b81300a0 2023-10-03T10:15:09.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.302+0000 7fa89ffff700 1 -- 172.21.15.146:0/1378923046 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa8a8003b70 con 0x7fa8b81300a0 2023-10-03T10:15:09.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.303+0000 7fa8bdc30700 1 -- 172.21.15.146:0/1378923046 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b811b600 con 0x7fa8b81300a0 2023-10-03T10:15:09.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.303+0000 7fa89ffff700 1 -- 172.21.15.146:0/1378923046 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa8a8003e20 con 0x7fa8b81300a0 2023-10-03T10:15:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.312+0000 7fa89ffff700 1 -- 172.21.15.146:0/1378923046 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa8b811b600 con 0x7fa8b81300a0 2023-10-03T10:15:09.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.410+0000 7fa83d1d0700 1 -- 172.21.15.146:0/883993207 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa83806cfa0 con 0x7fa83809e870 2023-10-03T10:15:09.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.410+0000 7fa81f7fe700 1 -- 172.21.15.146:0/883993207 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa828013e60 con 0x7fa83809e870 2023-10-03T10:15:09.411 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.412+0000 7fa83d1d0700 1 -- 172.21.15.146:0/883993207 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa83809e870 msgr2=0x7fa838122600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.412+0000 7fa83d1d0700 1 --2- 172.21.15.146:0/883993207 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa83809e870 0x7fa838122600 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa82800e9a0 tx=0x7fa82800ecb0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.412+0000 7fa83d1d0700 1 -- 172.21.15.146:0/883993207 shutdown_connections 2023-10-03T10:15:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.412+0000 7fa83d1d0700 1 --2- 172.21.15.146:0/883993207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8381341d0 0x7fa838123080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.412+0000 7fa83d1d0700 1 --2- 172.21.15.146:0/883993207 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa83809e870 0x7fa838122600 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.412+0000 7fa83d1d0700 1 --2- 172.21.15.146:0/883993207 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa83809f180 0x7fa838122b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.412+0000 7fa83d1d0700 1 -- 172.21.15.146:0/883993207 >> 172.21.15.146:0/883993207 conn(0x7fa8380a4430 msgr2=0x7fa83809d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.413+0000 7fa83d1d0700 1 -- 172.21.15.146:0/883993207 shutdown_connections 2023-10-03T10:15:09.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.413+0000 7fa83d1d0700 1 -- 172.21.15.146:0/883993207 wait complete. 2023-10-03T10:15:09.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:09.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.446+0000 7efc9d7fa700 1 -- 172.21.15.146:0/3754511513 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efc90005590 con 0x7efcb80a1230 2023-10-03T10:15:09.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.446+0000 7efc9f7fe700 1 -- 172.21.15.146:0/3754511513 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efcac02a030 con 0x7efcb80a1230 2023-10-03T10:15:09.447 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:09.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.449+0000 7efc9d7fa700 1 -- 172.21.15.146:0/3754511513 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efcb80a1230 msgr2=0x7efcb81d59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.449+0000 7efc9d7fa700 1 --2- 172.21.15.146:0/3754511513 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efcb80a1230 0x7efcb81d59a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efcac009920 tx=0x7efcac004750 comp rx=0 tx=0).stop 2023-10-03T10:15:09.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.449+0000 7efc9d7fa700 1 -- 172.21.15.146:0/3754511513 shutdown_connections 2023-10-03T10:15:09.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.449+0000 7efc9d7fa700 1 --2- 172.21.15.146:0/3754511513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcb8138040 0x7efcb8118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.449+0000 7efc9d7fa700 1 --2- 172.21.15.146:0/3754511513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efcb80a08e0 0x7efcb81d5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.449+0000 7efc9d7fa700 1 --2- 172.21.15.146:0/3754511513 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efcb80a1230 0x7efcb81d59a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.449+0000 7efc9d7fa700 1 -- 172.21.15.146:0/3754511513 >> 172.21.15.146:0/3754511513 conn(0x7efcb80a2980 msgr2=0x7efcb806e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.449+0000 7efc9d7fa700 1 -- 172.21.15.146:0/3754511513 shutdown_connections 2023-10-03T10:15:09.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.449+0000 7efc9d7fa700 1 -- 172.21.15.146:0/3754511513 wait complete. 2023-10-03T10:15:09.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:09.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.488+0000 7f77afeed700 1 -- 172.21.15.146:0/4172727492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f77a809f5b0 con 0x7f77a809e870 2023-10-03T10:15:09.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.488+0000 7f779e7fc700 1 -- 172.21.15.146:0/4172727492 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f77a809f5b0 con 0x7f77a809e870 2023-10-03T10:15:09.489 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:09.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.490+0000 7f77afeed700 1 -- 172.21.15.146:0/4172727492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77a809e870 msgr2=0x7f77a806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.490+0000 7f77afeed700 1 --2- 172.21.15.146:0/4172727492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77a809e870 0x7f77a806b8b0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f77a40090b0 tx=0x7f77a4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:09.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.490+0000 7f77afeed700 1 -- 172.21.15.146:0/4172727492 shutdown_connections 2023-10-03T10:15:09.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.490+0000 7f77afeed700 1 --2- 172.21.15.146:0/4172727492 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77a8131d70 0x7f77a806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.490+0000 7f77afeed700 1 --2- 172.21.15.146:0/4172727492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77a809e870 0x7f77a806b8b0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.490+0000 7f77afeed700 1 --2- 172.21.15.146:0/4172727492 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f77a809f180 0x7f77a806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.490+0000 7f77afeed700 1 -- 172.21.15.146:0/4172727492 >> 172.21.15.146:0/4172727492 conn(0x7f77a80a4430 msgr2=0x7f77a806f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.490+0000 7f77afeed700 1 -- 172.21.15.146:0/4172727492 shutdown_connections 2023-10-03T10:15:09.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.490+0000 7f77afeed700 1 -- 172.21.15.146:0/4172727492 wait complete. 2023-10-03T10:15:09.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:09.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.516+0000 7fa8bdc30700 1 -- 172.21.15.146:0/1378923046 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa8b812dd60 con 0x7fa8b81300a0 2023-10-03T10:15:09.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.516+0000 7fa89ffff700 1 -- 172.21.15.146:0/1378923046 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa8a8015080 con 0x7fa8b81300a0 2023-10-03T10:15:09.517 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:09.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.518+0000 7fa8bdc30700 1 -- 172.21.15.146:0/1378923046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b81300a0 msgr2=0x7fa8b811ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.518+0000 7fa8bdc30700 1 --2- 172.21.15.146:0/1378923046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b81300a0 0x7fa8b811ce80 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8009b90 tx=0x7fa8a8004750 comp rx=0 tx=0).stop 2023-10-03T10:15:09.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.518+0000 7fa8bdc30700 1 -- 172.21.15.146:0/1378923046 shutdown_connections 2023-10-03T10:15:09.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.518+0000 7fa8bdc30700 1 --2- 172.21.15.146:0/1378923046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8b8133ad0 0x7fa8b8119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.518+0000 7fa8bdc30700 1 --2- 172.21.15.146:0/1378923046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b81300a0 0x7fa8b811ce80 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.518+0000 7fa8bdc30700 1 --2- 172.21.15.146:0/1378923046 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8b81309f0 0x7fa8b811d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.518+0000 7fa8bdc30700 1 -- 172.21.15.146:0/1378923046 >> 172.21.15.146:0/1378923046 conn(0x7fa8b8099c40 msgr2=0x7fa8b81320c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.518+0000 7fa8bdc30700 1 -- 172.21.15.146:0/1378923046 shutdown_connections 2023-10-03T10:15:09.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:09.518+0000 7fa8bdc30700 1 -- 172.21.15.146:0/1378923046 wait complete. 2023-10-03T10:15:09.531 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:10.427 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:10.468 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:10.504 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:10.532 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:10.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.562+0000 7eff28a2a700 1 Processor -- start 2023-10-03T10:15:10.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.562+0000 7eff28a2a700 1 -- start start 2023-10-03T10:15:10.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.563+0000 7eff28a2a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7eff24130720 0x7eff24130af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.563+0000 7eff28a2a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff240702a0 0x7eff24070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.563+0000 7eff28a2a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff24070bd0 0x7eff24137510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.563+0000 7eff28a2a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff2409ab60 con 0x7eff24130720 2023-10-03T10:15:10.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.563+0000 7eff28a2a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff24071890 con 0x7eff24070bd0 2023-10-03T10:15:10.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.563+0000 7eff28a2a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff2409b440 con 0x7eff240702a0 2023-10-03T10:15:10.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.563+0000 7eff21d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff240702a0 0x7eff24070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.563+0000 7eff21d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff240702a0 0x7eff24070690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38798/0 (socket says 172.21.15.146:38798) 2023-10-03T10:15:10.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.563+0000 7eff21d9b700 1 -- 172.21.15.146:0/1510671262 learned_addr learned my addr 172.21.15.146:0/1510671262 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:10.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.563+0000 7eff2259c700 1 --2- 172.21.15.146:0/1510671262 >> v2:172.21.15.146:3300/0 conn(0x7eff24130720 0x7eff24130af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.563+0000 7eff22d9d700 1 --2- 172.21.15.146:0/1510671262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff24070bd0 0x7eff24137510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.564+0000 7eff21d9b700 1 -- 172.21.15.146:0/1510671262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff24070bd0 msgr2=0x7eff24137510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:10.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.564+0000 7eff21d9b700 1 --2- 172.21.15.146:0/1510671262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff24070bd0 0x7eff24137510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.564+0000 7eff21d9b700 1 -- 172.21.15.146:0/1510671262 >> v2:172.21.15.146:3300/0 conn(0x7eff24130720 msgr2=0x7eff24130af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:10.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.564+0000 7eff21d9b700 1 --2- 172.21.15.146:0/1510671262 >> v2:172.21.15.146:3300/0 conn(0x7eff24130720 0x7eff24130af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.564+0000 7eff21d9b700 1 -- 172.21.15.146:0/1510671262 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff241302f0 con 0x7eff240702a0 2023-10-03T10:15:10.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.564+0000 7eff2259c700 1 --2- 172.21.15.146:0/1510671262 >> v2:172.21.15.146:3300/0 conn(0x7eff24130720 0x7eff24130af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:10.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.564+0000 7eff21d9b700 1 --2- 172.21.15.146:0/1510671262 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff240702a0 0x7eff24070690 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7eff1800bb90 tx=0x7eff1800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1cfc022f562dad2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.564+0000 7eff2159a700 1 -- 172.21.15.146:0/1510671262 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1800dd30 con 0x7eff240702a0 2023-10-03T10:15:10.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.564+0000 7eff2159a700 1 -- 172.21.15.146:0/1510671262 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1800de90 con 0x7eff240702a0 2023-10-03T10:15:10.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.564+0000 7eff2159a700 1 -- 172.21.15.146:0/1510671262 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff18010690 con 0x7eff240702a0 2023-10-03T10:15:10.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.565+0000 7eff28a2a700 1 -- 172.21.15.146:0/1510671262 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff240702a0 msgr2=0x7eff24070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.565+0000 7eff28a2a700 1 --2- 172.21.15.146:0/1510671262 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff240702a0 0x7eff24070690 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7eff1800bb90 tx=0x7eff1800bea0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.565+0000 7eff28a2a700 1 -- 172.21.15.146:0/1510671262 shutdown_connections 2023-10-03T10:15:10.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.565+0000 7eff28a2a700 1 --2- 172.21.15.146:0/1510671262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff24070bd0 0x7eff24137510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.565+0000 7eff28a2a700 1 --2- 172.21.15.146:0/1510671262 >> v2:172.21.15.146:3300/0 conn(0x7eff24130720 0x7eff24130af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.565+0000 7eff28a2a700 1 --2- 172.21.15.146:0/1510671262 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff240702a0 0x7eff24070690 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.565+0000 7eff28a2a700 1 -- 172.21.15.146:0/1510671262 >> 172.21.15.146:0/1510671262 conn(0x7eff240a2810 msgr2=0x7eff240a2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.565+0000 7eff28a2a700 1 -- 172.21.15.146:0/1510671262 shutdown_connections 2023-10-03T10:15:10.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.565+0000 7eff28a2a700 1 -- 172.21.15.146:0/1510671262 wait complete. 2023-10-03T10:15:10.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.567+0000 7eff28a2a700 1 Processor -- start 2023-10-03T10:15:10.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.567+0000 7eff28a2a700 1 -- start start 2023-10-03T10:15:10.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.567+0000 7eff28a2a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff240702a0 0x7eff2411d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.567+0000 7eff28a2a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff24070bd0 0x7eff2411d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.567+0000 7eff28a2a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff24130720 0x7eff2411db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.568+0000 7eff28a2a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2411e630 con 0x7eff24070bd0 2023-10-03T10:15:10.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.568+0000 7eff28a2a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff24120510 con 0x7eff24130720 2023-10-03T10:15:10.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.568+0000 7eff28a2a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff2412e960 con 0x7eff240702a0 2023-10-03T10:15:10.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.568+0000 7eff2259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff240702a0 0x7eff2411d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.568+0000 7eff2259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff240702a0 0x7eff2411d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38800/0 (socket says 172.21.15.146:38800) 2023-10-03T10:15:10.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.568+0000 7eff2259c700 1 -- 172.21.15.146:0/2218899688 learned_addr learned my addr 172.21.15.146:0/2218899688 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:10.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.568+0000 7eff21d9b700 1 --2- 172.21.15.146:0/2218899688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff24070bd0 0x7eff2411d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.568+0000 7eff22d9d700 1 --2- 172.21.15.146:0/2218899688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff24130720 0x7eff2411db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.568+0000 7eff2259c700 1 -- 172.21.15.146:0/2218899688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff24130720 msgr2=0x7eff2411db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.568+0000 7eff2259c700 1 --2- 172.21.15.146:0/2218899688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff24130720 0x7eff2411db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.568+0000 7eff2259c700 1 -- 172.21.15.146:0/2218899688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff24070bd0 msgr2=0x7eff2411d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.568+0000 7eff2259c700 1 --2- 172.21.15.146:0/2218899688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff24070bd0 0x7eff2411d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.568+0000 7eff2259c700 1 -- 172.21.15.146:0/2218899688 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff140094a0 con 0x7eff240702a0 2023-10-03T10:15:10.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.568+0000 7eff2259c700 1 --2- 172.21.15.146:0/2218899688 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff240702a0 0x7eff2411d090 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7eff1400c4c0 tx=0x7eff1400c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.568+0000 7eff12ffd700 1 -- 172.21.15.146:0/2218899688 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14015de0 con 0x7eff240702a0 2023-10-03T10:15:10.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.569+0000 7eff12ffd700 1 -- 172.21.15.146:0/2218899688 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff14016050 con 0x7eff240702a0 2023-10-03T10:15:10.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.569+0000 7eff28a2a700 1 -- 172.21.15.146:0/2218899688 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1800b7f0 con 0x7eff240702a0 2023-10-03T10:15:10.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.569+0000 7eff28a2a700 1 -- 172.21.15.146:0/2218899688 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2411fe90 con 0x7eff240702a0 2023-10-03T10:15:10.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.569+0000 7eff12ffd700 1 -- 172.21.15.146:0/2218899688 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff140163c0 con 0x7eff240702a0 2023-10-03T10:15:10.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.570+0000 7eff12ffd700 1 -- 172.21.15.146:0/2218899688 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7eff14016520 con 0x7eff240702a0 2023-10-03T10:15:10.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.570+0000 7eff28a2a700 1 -- 172.21.15.146:0/2218899688 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff080052e0 con 0x7eff240702a0 2023-10-03T10:15:10.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.570+0000 7eff12ffd700 1 -- 172.21.15.146:0/2218899688 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7eff14047990 con 0x7eff240702a0 2023-10-03T10:15:10.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.575+0000 7eff12ffd700 1 -- 172.21.15.146:0/2218899688 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7eff140256b0 con 0x7eff240702a0 2023-10-03T10:15:10.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.600+0000 7fccc7e69700 1 Processor -- start 2023-10-03T10:15:10.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.600+0000 7fccc7e69700 1 -- start start 2023-10-03T10:15:10.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.601+0000 7fccc7e69700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccc0133900 0x7fccc0133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.601+0000 7fccc7e69700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fccc00a10b0 0x7fccc013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.601+0000 7fccc7e69700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc009a760 con 0x7fccc0134210 2023-10-03T10:15:10.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.601+0000 7fccc7e69700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc01336e0 con 0x7fccc0133900 2023-10-03T10:15:10.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.601+0000 7fccc7e69700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccc009a080 con 0x7fccc00a10b0 2023-10-03T10:15:10.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.601+0000 7fccc5c05700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccc0133900 0x7fccc0133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.601+0000 7fccc5c05700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccc0133900 0x7fccc0133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51212/0 (socket says 172.21.15.146:51212) 2023-10-03T10:15:10.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.601+0000 7fccc5c05700 1 -- 172.21.15.146:0/268816192 learned_addr learned my addr 172.21.15.146:0/268816192 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:10.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.601+0000 7fccc6406700 1 --2- 172.21.15.146:0/268816192 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fccc00a10b0 0x7fccc013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.601+0000 7fccc5c05700 1 -- 172.21.15.146:0/268816192 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fccc00a10b0 msgr2=0x7fccc013b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:10.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.601+0000 7fccc5c05700 1 --2- 172.21.15.146:0/268816192 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fccc00a10b0 0x7fccc013b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.601+0000 7fccc5c05700 1 -- 172.21.15.146:0/268816192 >> v1:172.21.15.146:6789/0 conn(0x7fccc0134210 legacy=0x7fccc00a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.601+0000 7fccc5c05700 1 -- 172.21.15.146:0/268816192 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc00a23e0 con 0x7fccc0133900 2023-10-03T10:15:10.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.602+0000 7fccc6406700 1 --2- 172.21.15.146:0/268816192 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fccc00a10b0 0x7fccc013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:10.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.602+0000 7fccc5c05700 1 --2- 172.21.15.146:0/268816192 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccc0133900 0x7fccc0133cd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fccbc0098f0 tx=0x7fccbc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f48321d5c84ecf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.602+0000 7fccc4c03700 1 -- 172.21.15.146:0/268816192 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc005e30 con 0x7fccc0133900 2023-10-03T10:15:10.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.602+0000 7fccc4c03700 1 -- 172.21.15.146:0/268816192 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccbc004030 con 0x7fccc0133900 2023-10-03T10:15:10.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.602+0000 7fccc4c03700 1 -- 172.21.15.146:0/268816192 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc0043e0 con 0x7fccc0133900 2023-10-03T10:15:10.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.603+0000 7fccc7e69700 1 -- 172.21.15.146:0/268816192 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccc0133900 msgr2=0x7fccc0133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.603+0000 7fccc7e69700 1 --2- 172.21.15.146:0/268816192 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccc0133900 0x7fccc0133cd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fccbc0098f0 tx=0x7fccbc009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:10.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.603+0000 7fccc7e69700 1 -- 172.21.15.146:0/268816192 shutdown_connections 2023-10-03T10:15:10.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.603+0000 7fccc7e69700 1 --2- 172.21.15.146:0/268816192 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fccc00a10b0 0x7fccc013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.603+0000 7fccc7e69700 1 --2- 172.21.15.146:0/268816192 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccc0133900 0x7fccc0133cd0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.603+0000 7fccc7e69700 1 -- 172.21.15.146:0/268816192 >> 172.21.15.146:0/268816192 conn(0x7fccc00a2980 msgr2=0x7fccc00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.603+0000 7fccc7e69700 1 -- 172.21.15.146:0/268816192 shutdown_connections 2023-10-03T10:15:10.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.603+0000 7fccc7e69700 1 -- 172.21.15.146:0/268816192 wait complete. 2023-10-03T10:15:10.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.604+0000 7fccc7e69700 1 Processor -- start 2023-10-03T10:15:10.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.604+0000 7fccc7e69700 1 -- start start 2023-10-03T10:15:10.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.604+0000 7fccc7e69700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccc00a10b0 0x7fccc011c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.604+0000 7fccc7e69700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccc0133900 0x7fccc011cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.604+0000 7fccc7e69700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fccc0134210 0x7fccc011d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.604+0000 7fccc7e69700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc011e3f0 con 0x7fccc0133900 2023-10-03T10:15:10.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.604+0000 7fccc7e69700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc011f640 con 0x7fccc00a10b0 2023-10-03T10:15:10.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.604+0000 7fccc7e69700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccc011e9d0 con 0x7fccc0134210 2023-10-03T10:15:10.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.605+0000 7fccc5404700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccc0133900 0x7fccc011cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.605+0000 7fccc5c05700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccc00a10b0 0x7fccc011c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.605+0000 7fccc5404700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccc0133900 0x7fccc011cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35422/0 (socket says 172.21.15.146:35422) 2023-10-03T10:15:10.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.605+0000 7fccc5404700 1 -- 172.21.15.146:0/686471241 learned_addr learned my addr 172.21.15.146:0/686471241 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.605+0000 7fccc6406700 1 --2- 172.21.15.146:0/686471241 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fccc0134210 0x7fccc011d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.605+0000 7fccc5c05700 1 -- 172.21.15.146:0/686471241 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fccc0134210 msgr2=0x7fccc011d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.605+0000 7fccc5c05700 1 --2- 172.21.15.146:0/686471241 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fccc0134210 0x7fccc011d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.605+0000 7fccc5c05700 1 -- 172.21.15.146:0/686471241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccc0133900 msgr2=0x7fccc011cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.605+0000 7fccc5c05700 1 --2- 172.21.15.146:0/686471241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccc0133900 0x7fccc011cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.605+0000 7fccc5c05700 1 -- 172.21.15.146:0/686471241 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccbc009500 con 0x7fccc00a10b0 2023-10-03T10:15:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.605+0000 7fccc5c05700 1 --2- 172.21.15.146:0/686471241 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccc00a10b0 0x7fccc011c830 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fccbc013000 tx=0x7fccbc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.605+0000 7fccb67fc700 1 -- 172.21.15.146:0/686471241 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc003c30 con 0x7fccc00a10b0 2023-10-03T10:15:10.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.605+0000 7fccb67fc700 1 -- 172.21.15.146:0/686471241 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccbc003db0 con 0x7fccc00a10b0 2023-10-03T10:15:10.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.605+0000 7fccc7e69700 1 -- 172.21.15.146:0/686471241 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc0120020 con 0x7fccc00a10b0 2023-10-03T10:15:10.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.605+0000 7fccb67fc700 1 -- 172.21.15.146:0/686471241 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc00b6d0 con 0x7fccc00a10b0 2023-10-03T10:15:10.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.606+0000 7fccc7e69700 1 -- 172.21.15.146:0/686471241 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc009a2c0 con 0x7fccc00a10b0 2023-10-03T10:15:10.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.607+0000 7fccc7e69700 1 -- 172.21.15.146:0/686471241 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc004f2a0 con 0x7fccc00a10b0 2023-10-03T10:15:10.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.607+0000 7fccb67fc700 1 -- 172.21.15.146:0/686471241 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fccbc00b830 con 0x7fccc00a10b0 2023-10-03T10:15:10.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.607+0000 7fccb67fc700 1 -- 172.21.15.146:0/686471241 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fccbc040ac0 con 0x7fccc00a10b0 2023-10-03T10:15:10.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.612+0000 7fccb67fc700 1 -- 172.21.15.146:0/686471241 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fccbc02f480 con 0x7fccc00a10b0 2023-10-03T10:15:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.666+0000 7fc9d110c700 1 Processor -- start 2023-10-03T10:15:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.666+0000 7fc9d110c700 1 -- start start 2023-10-03T10:15:10.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.666+0000 7fc9d110c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9cc138040 0x7fc9cc138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.666+0000 7fc9d110c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc9cc0a08e0 0x7fc9cc0a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.666+0000 7fc9d110c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9cc0a1230 0x7fc9cc13ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.666+0000 7fc9d110c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9cc0a2100 con 0x7fc9cc0a08e0 2023-10-03T10:15:10.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.666+0000 7fc9d110c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc138950 con 0x7fc9cc0a1230 2023-10-03T10:15:10.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.666+0000 7fc9d110c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc1379e0 con 0x7fc9cc138040 2023-10-03T10:15:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.666+0000 7fc9cad9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9cc138040 0x7fc9cc138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.666+0000 7fc9cb59e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9cc0a1230 0x7fc9cc13ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.666+0000 7fc9cb59e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9cc0a1230 0x7fc9cc13ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51230/0 (socket says 172.21.15.146:51230) 2023-10-03T10:15:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.666+0000 7fc9cad9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9cc138040 0x7fc9cc138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38830/0 (socket says 172.21.15.146:38830) 2023-10-03T10:15:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.666+0000 7fc9cb59e700 1 -- 172.21.15.146:0/939643035 learned_addr learned my addr 172.21.15.146:0/939643035 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.666+0000 7fc9ca59c700 1 --2- 172.21.15.146:0/939643035 >> v2:172.21.15.146:3300/0 conn(0x7fc9cc0a08e0 0x7fc9cc0a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.667+0000 7fc9cb59e700 1 -- 172.21.15.146:0/939643035 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9cc138040 msgr2=0x7fc9cc138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.667+0000 7fc9cb59e700 1 --2- 172.21.15.146:0/939643035 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9cc138040 0x7fc9cc138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.667+0000 7fc9cb59e700 1 -- 172.21.15.146:0/939643035 >> v2:172.21.15.146:3300/0 conn(0x7fc9cc0a08e0 msgr2=0x7fc9cc0a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.667+0000 7fc9cb59e700 1 --2- 172.21.15.146:0/939643035 >> v2:172.21.15.146:3300/0 conn(0x7fc9cc0a08e0 0x7fc9cc0a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.667+0000 7fc9cb59e700 1 -- 172.21.15.146:0/939643035 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9cc09b9b0 con 0x7fc9cc0a1230 2023-10-03T10:15:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.667+0000 7fc9ca59c700 1 --2- 172.21.15.146:0/939643035 >> v2:172.21.15.146:3300/0 conn(0x7fc9cc0a08e0 0x7fc9cc0a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.667+0000 7fc9cad9d700 1 --2- 172.21.15.146:0/939643035 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9cc138040 0x7fc9cc138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.667+0000 7fc9cb59e700 1 --2- 172.21.15.146:0/939643035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9cc0a1230 0x7fc9cc13ed10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009e80 tx=0x7fc9c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54daee7b0f533e31 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.667+0000 7fc9c9d9b700 1 -- 172.21.15.146:0/939643035 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c400e070 con 0x7fc9cc0a1230 2023-10-03T10:15:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.667+0000 7fc9c9d9b700 1 -- 172.21.15.146:0/939643035 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c400b980 con 0x7fc9cc0a1230 2023-10-03T10:15:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.667+0000 7fc9c9d9b700 1 -- 172.21.15.146:0/939643035 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c400bd30 con 0x7fc9cc0a1230 2023-10-03T10:15:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.668+0000 7fc9d110c700 1 -- 172.21.15.146:0/939643035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9cc0a1230 msgr2=0x7fc9cc13ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.668+0000 7fc9d110c700 1 --2- 172.21.15.146:0/939643035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9cc0a1230 0x7fc9cc13ed10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009e80 tx=0x7fc9c400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.668+0000 7fc9d110c700 1 -- 172.21.15.146:0/939643035 shutdown_connections 2023-10-03T10:15:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.668+0000 7fc9d110c700 1 --2- 172.21.15.146:0/939643035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9cc0a1230 0x7fc9cc13ed10 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.668+0000 7fc9d110c700 1 --2- 172.21.15.146:0/939643035 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9cc138040 0x7fc9cc138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.668+0000 7fc9d110c700 1 --2- 172.21.15.146:0/939643035 >> v2:172.21.15.146:3300/0 conn(0x7fc9cc0a08e0 0x7fc9cc0a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.668+0000 7fc9d110c700 1 -- 172.21.15.146:0/939643035 >> 172.21.15.146:0/939643035 conn(0x7fc9cc0a2980 msgr2=0x7fc9cc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.668+0000 7fc9d110c700 1 -- 172.21.15.146:0/939643035 shutdown_connections 2023-10-03T10:15:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.668+0000 7fc9d110c700 1 -- 172.21.15.146:0/939643035 wait complete. 2023-10-03T10:15:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.669+0000 7fc9d110c700 1 Processor -- start 2023-10-03T10:15:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.669+0000 7fc9d110c700 1 -- start start 2023-10-03T10:15:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.670+0000 7fc9d110c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9cc0a08e0 0x7fc9cc1d5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.670+0000 7fc9d110c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9cc0a1230 0x7fc9cc1d5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.670+0000 7fc9d110c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9cc138040 0x7fc9cc1d5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.670+0000 7fc9d110c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc09c690 con 0x7fc9cc0a1230 2023-10-03T10:15:10.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.670+0000 7fc9d110c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc09a240 con 0x7fc9cc0a08e0 2023-10-03T10:15:10.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.670+0000 7fc9d110c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc13e330 con 0x7fc9cc138040 2023-10-03T10:15:10.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.670+0000 7fc9cad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9cc0a08e0 0x7fc9cc1d5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.670+0000 7fc9cad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9cc0a08e0 0x7fc9cc1d5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51238/0 (socket says 172.21.15.146:51238) 2023-10-03T10:15:10.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.670+0000 7fc9cad9d700 1 -- 172.21.15.146:0/1879937373 learned_addr learned my addr 172.21.15.146:0/1879937373 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:10.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.670+0000 7fc9cb59e700 1 --2- 172.21.15.146:0/1879937373 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9cc138040 0x7fc9cc1d5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.670+0000 7fc9ca59c700 1 --2- 172.21.15.146:0/1879937373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9cc0a1230 0x7fc9cc1d5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.671+0000 7fc9cb59e700 1 -- 172.21.15.146:0/1879937373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9cc0a08e0 msgr2=0x7fc9cc1d5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.671+0000 7fc9cb59e700 1 --2- 172.21.15.146:0/1879937373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9cc0a08e0 0x7fc9cc1d5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.671+0000 7fc9cb59e700 1 -- 172.21.15.146:0/1879937373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9cc0a1230 msgr2=0x7fc9cc1d5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.671+0000 7fc9cb59e700 1 --2- 172.21.15.146:0/1879937373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9cc0a1230 0x7fc9cc1d5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.671+0000 7fc9cb59e700 1 -- 172.21.15.146:0/1879937373 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c4009b30 con 0x7fc9cc138040 2023-10-03T10:15:10.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.671+0000 7fc9ca59c700 1 --2- 172.21.15.146:0/1879937373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9cc0a1230 0x7fc9cc1d5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:10.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.671+0000 7fc9cb59e700 1 --2- 172.21.15.146:0/1879937373 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9cc138040 0x7fc9cc1d5a90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4015000 tx=0x7fc9c4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.671+0000 7fc9b37fe700 1 -- 172.21.15.146:0/1879937373 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c40092e0 con 0x7fc9cc138040 2023-10-03T10:15:10.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.671+0000 7fc9b37fe700 1 -- 172.21.15.146:0/1879937373 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c4004250 con 0x7fc9cc138040 2023-10-03T10:15:10.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.671+0000 7fc9b37fe700 1 -- 172.21.15.146:0/1879937373 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c40045e0 con 0x7fc9cc138040 2023-10-03T10:15:10.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.671+0000 7fc9d110c700 1 -- 172.21.15.146:0/1879937373 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9cc13d9b0 con 0x7fc9cc138040 2023-10-03T10:15:10.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.671+0000 7fc9d110c700 1 -- 172.21.15.146:0/1879937373 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9cc118df0 con 0x7fc9cc138040 2023-10-03T10:15:10.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.672+0000 7fc9b37fe700 1 -- 172.21.15.146:0/1879937373 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc9c4004740 con 0x7fc9cc138040 2023-10-03T10:15:10.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.673+0000 7fc9b37fe700 1 -- 172.21.15.146:0/1879937373 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc9c401a390 con 0x7fc9cc138040 2023-10-03T10:15:10.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.673+0000 7fc9d110c700 1 -- 172.21.15.146:0/1879937373 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9cc11ae80 con 0x7fc9cc138040 2023-10-03T10:15:10.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.677+0000 7fc9b37fe700 1 -- 172.21.15.146:0/1879937373 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc9c401f030 con 0x7fc9cc138040 2023-10-03T10:15:10.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.687+0000 7f7722af7700 1 Processor -- start 2023-10-03T10:15:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.687+0000 7f7722af7700 1 -- start start 2023-10-03T10:15:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.687+0000 7f7722af7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f771c0a0a30 0x7f771c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.687+0000 7f7722af7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f771c130670 0x7f771c1381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.687+0000 7f7722af7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f771c0a1e70 con 0x7f771c0a1340 2023-10-03T10:15:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.687+0000 7f7722af7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f771c09a720 con 0x7f771c130670 2023-10-03T10:15:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.687+0000 7f7722af7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f771c09b300 con 0x7f771c0a0a30 2023-10-03T10:15:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.687+0000 7f7721094700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f771c130670 0x7f771c1381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.687+0000 7f771bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f771c0a1340 0x7f771c12ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:57602/0 (socket says 172.21.15.146:57602) 2023-10-03T10:15:10.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.687+0000 7f771bfff700 1 -- 172.21.15.146:0/1119564594 learned_addr learned my addr 172.21.15.146:0/1119564594 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:10.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.688+0000 7f7720893700 1 --2- 172.21.15.146:0/1119564594 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f771c0a0a30 0x7f771c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.688+0000 7f7721094700 1 -- 172.21.15.146:0/1119564594 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f771c0a0a30 msgr2=0x7f771c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:10.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.688+0000 7f7721094700 1 --2- 172.21.15.146:0/1119564594 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f771c0a0a30 0x7f771c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.688+0000 7f7721094700 1 -- 172.21.15.146:0/1119564594 >> v1:172.21.15.146:6789/0 conn(0x7f771c0a1340 legacy=0x7f771c12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.688+0000 7f7721094700 1 -- 172.21.15.146:0/1119564594 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771c09abc0 con 0x7f771c130670 2023-10-03T10:15:10.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.688+0000 7f771b7fe700 1 -- 172.21.15.146:0/1119564594 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236215788 0 0) 0x7f771c0a1e70 con 0x7f771c0a1340 2023-10-03T10:15:10.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.688+0000 7f7721094700 1 --2- 172.21.15.146:0/1119564594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c130670 0x7f771c1381c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f771400bfa0 tx=0x7f771400d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e1845ea7ede7f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.688+0000 7f771b7fe700 1 -- 172.21.15.146:0/1119564594 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771400b2d0 con 0x7f771c130670 2023-10-03T10:15:10.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.688+0000 7f771b7fe700 1 -- 172.21.15.146:0/1119564594 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7714010070 con 0x7f771c130670 2023-10-03T10:15:10.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.688+0000 7f771b7fe700 1 -- 172.21.15.146:0/1119564594 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771400db80 con 0x7f771c130670 2023-10-03T10:15:10.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.689+0000 7f7722af7700 1 -- 172.21.15.146:0/1119564594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c130670 msgr2=0x7f771c1381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.689+0000 7f7722af7700 1 --2- 172.21.15.146:0/1119564594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c130670 0x7f771c1381c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f771400bfa0 tx=0x7f771400d330 comp rx=0 tx=0).stop 2023-10-03T10:15:10.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.689+0000 7f7722af7700 1 -- 172.21.15.146:0/1119564594 shutdown_connections 2023-10-03T10:15:10.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.689+0000 7f7722af7700 1 --2- 172.21.15.146:0/1119564594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c130670 0x7f771c1381c0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.689+0000 7f7722af7700 1 --2- 172.21.15.146:0/1119564594 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f771c0a0a30 0x7f771c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.689+0000 7f7722af7700 1 -- 172.21.15.146:0/1119564594 >> 172.21.15.146:0/1119564594 conn(0x7f771c0a2980 msgr2=0x7f771c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.689+0000 7f7722af7700 1 -- 172.21.15.146:0/1119564594 shutdown_connections 2023-10-03T10:15:10.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.689+0000 7f7722af7700 1 -- 172.21.15.146:0/1119564594 wait complete. 2023-10-03T10:15:10.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.690+0000 7f7722af7700 1 Processor -- start 2023-10-03T10:15:10.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.690+0000 7f7722af7700 1 -- start start 2023-10-03T10:15:10.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.691+0000 7f7722af7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f771c0a0a30 0x7f771c1c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.691+0000 7f7722af7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f771c0a1340 0x7f771c1c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.691+0000 7f7722af7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c130670 0x7f771c1c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.691+0000 7f7722af7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771c11bcc0 con 0x7f771c130670 2023-10-03T10:15:10.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.691+0000 7f7722af7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771c11bad0 con 0x7f771c0a1340 2023-10-03T10:15:10.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.691+0000 7f7722af7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f771c11d9e0 con 0x7f771c0a0a30 2023-10-03T10:15:10.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.691+0000 7f7720893700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f771c0a0a30 0x7f771c1c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.691+0000 7f7720893700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f771c0a0a30 0x7f771c1c3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38862/0 (socket says 172.21.15.146:38862) 2023-10-03T10:15:10.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.691+0000 7f7720893700 1 -- 172.21.15.146:0/3831803121 learned_addr learned my addr 172.21.15.146:0/3831803121 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:10.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.691+0000 7f771bfff700 1 --2- 172.21.15.146:0/3831803121 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f771c0a1340 0x7f771c1c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.691+0000 7f7721094700 1 --2- 172.21.15.146:0/3831803121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c130670 0x7f771c1c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.691+0000 7f7720893700 1 -- 172.21.15.146:0/3831803121 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f771c0a1340 msgr2=0x7f771c1c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.691+0000 7f7720893700 1 --2- 172.21.15.146:0/3831803121 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f771c0a1340 0x7f771c1c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.691+0000 7f7720893700 1 -- 172.21.15.146:0/3831803121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c130670 msgr2=0x7f771c1c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.691+0000 7f7720893700 1 --2- 172.21.15.146:0/3831803121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c130670 0x7f771c1c4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.691+0000 7f7720893700 1 -- 172.21.15.146:0/3831803121 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771400bc80 con 0x7f771c0a0a30 2023-10-03T10:15:10.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.692+0000 7f7720893700 1 --2- 172.21.15.146:0/3831803121 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f771c0a0a30 0x7f771c1c3ca0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7710009cd0 tx=0x7f771000ff20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.692+0000 7f77197fa700 1 -- 172.21.15.146:0/3831803121 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7710013b40 con 0x7f771c0a0a30 2023-10-03T10:15:10.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.692+0000 7f77197fa700 1 -- 172.21.15.146:0/3831803121 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7710015040 con 0x7f771c0a0a30 2023-10-03T10:15:10.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.692+0000 7f7722af7700 1 -- 172.21.15.146:0/3831803121 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771c09fbc0 con 0x7f771c0a0a30 2023-10-03T10:15:10.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.692+0000 7f77197fa700 1 -- 172.21.15.146:0/3831803121 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7710013ea0 con 0x7f771c0a0a30 2023-10-03T10:15:10.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.692+0000 7f7722af7700 1 -- 172.21.15.146:0/3831803121 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f771c11c2c0 con 0x7f771c0a0a30 2023-10-03T10:15:10.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.693+0000 7f7722af7700 1 -- 172.21.15.146:0/3831803121 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f771c04f2a0 con 0x7f771c0a0a30 2023-10-03T10:15:10.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.693+0000 7f77197fa700 1 -- 172.21.15.146:0/3831803121 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f771001b400 con 0x7f771c0a0a30 2023-10-03T10:15:10.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.693+0000 7f77197fa700 1 -- 172.21.15.146:0/3831803121 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7710043f10 con 0x7f771c0a0a30 2023-10-03T10:15:10.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.697+0000 7f77197fa700 1 -- 172.21.15.146:0/3831803121 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f771002c700 con 0x7f771c0a0a30 2023-10-03T10:15:10.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.808+0000 7fccc7e69700 1 -- 172.21.15.146:0/686471241 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fccc006bce0 con 0x7fccc00a10b0 2023-10-03T10:15:10.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.808+0000 7fccb67fc700 1 -- 172.21.15.146:0/686471241 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fccbc016030 con 0x7fccc00a10b0 2023-10-03T10:15:10.809 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:10.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.812+0000 7fccc7e69700 1 -- 172.21.15.146:0/686471241 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccc00a10b0 msgr2=0x7fccc011c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.812+0000 7fccc7e69700 1 --2- 172.21.15.146:0/686471241 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccc00a10b0 0x7fccc011c830 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fccbc013000 tx=0x7fccbc004750 comp rx=0 tx=0).stop 2023-10-03T10:15:10.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.812+0000 7fccc7e69700 1 -- 172.21.15.146:0/686471241 shutdown_connections 2023-10-03T10:15:10.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.812+0000 7fccc7e69700 1 --2- 172.21.15.146:0/686471241 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fccc0134210 0x7fccc011d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.812+0000 7fccc7e69700 1 --2- 172.21.15.146:0/686471241 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccc00a10b0 0x7fccc011c830 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.812+0000 7fccc7e69700 1 --2- 172.21.15.146:0/686471241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccc0133900 0x7fccc011cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.812+0000 7fccc7e69700 1 -- 172.21.15.146:0/686471241 >> 172.21.15.146:0/686471241 conn(0x7fccc00a2980 msgr2=0x7fccc01baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.812+0000 7fccc7e69700 1 -- 172.21.15.146:0/686471241 shutdown_connections 2023-10-03T10:15:10.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.812+0000 7fccc7e69700 1 -- 172.21.15.146:0/686471241 wait complete. 2023-10-03T10:15:10.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.832+0000 7eff28a2a700 1 -- 172.21.15.146:0/2218899688 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7eff08005150 con 0x7eff240702a0 2023-10-03T10:15:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.832+0000 7eff12ffd700 1 -- 172.21.15.146:0/2218899688 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7eff14023070 con 0x7eff240702a0 2023-10-03T10:15:10.833 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:10.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.834+0000 7eff28a2a700 1 -- 172.21.15.146:0/2218899688 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff240702a0 msgr2=0x7eff2411d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.834+0000 7eff28a2a700 1 --2- 172.21.15.146:0/2218899688 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff240702a0 0x7eff2411d090 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7eff1400c4c0 tx=0x7eff1400c7d0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.834+0000 7eff28a2a700 1 -- 172.21.15.146:0/2218899688 shutdown_connections 2023-10-03T10:15:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.834+0000 7eff28a2a700 1 --2- 172.21.15.146:0/2218899688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff24130720 0x7eff2411db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.834+0000 7eff28a2a700 1 --2- 172.21.15.146:0/2218899688 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff240702a0 0x7eff2411d090 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.834+0000 7eff28a2a700 1 --2- 172.21.15.146:0/2218899688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff24070bd0 0x7eff2411d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.834+0000 7eff28a2a700 1 -- 172.21.15.146:0/2218899688 >> 172.21.15.146:0/2218899688 conn(0x7eff240a2810 msgr2=0x7eff2412d520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.835+0000 7eff28a2a700 1 -- 172.21.15.146:0/2218899688 shutdown_connections 2023-10-03T10:15:10.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.835+0000 7eff28a2a700 1 -- 172.21.15.146:0/2218899688 wait complete. 2023-10-03T10:15:10.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:10.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.892+0000 7fc9d110c700 1 -- 172.21.15.146:0/1879937373 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc9cc04f2a0 con 0x7fc9cc138040 2023-10-03T10:15:10.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.893+0000 7fc9b37fe700 1 -- 172.21.15.146:0/1879937373 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc9c4045060 con 0x7fc9cc138040 2023-10-03T10:15:10.893 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:10.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.895+0000 7fc9d110c700 1 -- 172.21.15.146:0/1879937373 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9cc138040 msgr2=0x7fc9cc1d5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.895+0000 7fc9d110c700 1 --2- 172.21.15.146:0/1879937373 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9cc138040 0x7fc9cc1d5a90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4015000 tx=0x7fc9c4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.895+0000 7f7722af7700 1 -- 172.21.15.146:0/3831803121 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f771c06bce0 con 0x7f771c0a0a30 2023-10-03T10:15:10.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.895+0000 7fc9d110c700 1 -- 172.21.15.146:0/1879937373 shutdown_connections 2023-10-03T10:15:10.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.895+0000 7fc9d110c700 1 --2- 172.21.15.146:0/1879937373 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9cc138040 0x7fc9cc1d5a90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.895+0000 7fc9d110c700 1 --2- 172.21.15.146:0/1879937373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9cc0a08e0 0x7fc9cc1d5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.895+0000 7fc9d110c700 1 --2- 172.21.15.146:0/1879937373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9cc0a1230 0x7fc9cc1d5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.895+0000 7fc9d110c700 1 -- 172.21.15.146:0/1879937373 >> 172.21.15.146:0/1879937373 conn(0x7fc9cc0a2980 msgr2=0x7fc9cc09e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.895+0000 7fc9d110c700 1 -- 172.21.15.146:0/1879937373 shutdown_connections 2023-10-03T10:15:10.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.895+0000 7fc9d110c700 1 -- 172.21.15.146:0/1879937373 wait complete. 2023-10-03T10:15:10.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.895+0000 7f77197fa700 1 -- 172.21.15.146:0/3831803121 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7710020020 con 0x7f771c0a0a30 2023-10-03T10:15:10.897 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:10.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.897+0000 7f7722af7700 1 -- 172.21.15.146:0/3831803121 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f771c0a0a30 msgr2=0x7f771c1c3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.897+0000 7f7722af7700 1 --2- 172.21.15.146:0/3831803121 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f771c0a0a30 0x7f771c1c3ca0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7710009cd0 tx=0x7f771000ff20 comp rx=0 tx=0).stop 2023-10-03T10:15:10.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.897+0000 7f7722af7700 1 -- 172.21.15.146:0/3831803121 shutdown_connections 2023-10-03T10:15:10.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.897+0000 7f7722af7700 1 --2- 172.21.15.146:0/3831803121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c130670 0x7f771c1c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.897+0000 7f7722af7700 1 --2- 172.21.15.146:0/3831803121 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f771c0a0a30 0x7f771c1c3ca0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.897+0000 7f7722af7700 1 --2- 172.21.15.146:0/3831803121 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f771c0a1340 0x7f771c1c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.897+0000 7f7722af7700 1 -- 172.21.15.146:0/3831803121 >> 172.21.15.146:0/3831803121 conn(0x7f771c0a2980 msgr2=0x7f771c1b7880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.898+0000 7f7722af7700 1 -- 172.21.15.146:0/3831803121 shutdown_connections 2023-10-03T10:15:10.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:10.898+0000 7f7722af7700 1 -- 172.21.15.146:0/3831803121 wait complete. 2023-10-03T10:15:10.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:10.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:11.831 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:11.848 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:11.910 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:11.912 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:11.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.978+0000 7fac52a88700 1 Processor -- start 2023-10-03T10:15:11.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.978+0000 7fac52a88700 1 -- start start 2023-10-03T10:15:11.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.978+0000 7fac52a88700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fac4c09d860 0x7fac4c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.978+0000 7fac52a88700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac4c09e170 0x7fac4c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.978+0000 7fac52a88700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac4c09aaa0 con 0x7fac4c130ce0 2023-10-03T10:15:11.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.978+0000 7fac52a88700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac4c09f870 con 0x7fac4c09d860 2023-10-03T10:15:11.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.978+0000 7fac52a88700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c09b360 con 0x7fac4c09e170 2023-10-03T10:15:11.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.978+0000 7fac4bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac4c09e170 0x7fac4c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.979+0000 7fac4bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac4c09e170 0x7fac4c1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51260/0 (socket says 172.21.15.146:51260) 2023-10-03T10:15:11.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.979+0000 7fac4bfff700 1 -- 172.21.15.146:0/99027164 learned_addr learned my addr 172.21.15.146:0/99027164 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:11.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.979+0000 7fac51025700 1 --1- 172.21.15.146:0/99027164 >> v1:172.21.15.146:6789/0 conn(0x7fac4c130ce0 0x7fac4c1379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:57614/0 (socket says 172.21.15.146:57614) 2023-10-03T10:15:11.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.979+0000 7fac50824700 1 --2- 172.21.15.146:0/99027164 >> v2:172.21.15.146:3300/0 conn(0x7fac4c09d860 0x7fac4c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.979+0000 7fac4b7fe700 1 -- 172.21.15.146:0/99027164 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167150648 0 0) 0x7fac4c09aaa0 con 0x7fac4c130ce0 2023-10-03T10:15:11.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.979+0000 7fac4bfff700 1 -- 172.21.15.146:0/99027164 >> v2:172.21.15.146:3300/0 conn(0x7fac4c09d860 msgr2=0x7fac4c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:11.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.979+0000 7fac4bfff700 1 --2- 172.21.15.146:0/99027164 >> v2:172.21.15.146:3300/0 conn(0x7fac4c09d860 0x7fac4c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.979+0000 7fac4bfff700 1 -- 172.21.15.146:0/99027164 >> v1:172.21.15.146:6789/0 conn(0x7fac4c130ce0 legacy=0x7fac4c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.979+0000 7fac4bfff700 1 -- 172.21.15.146:0/99027164 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4c09b620 con 0x7fac4c09e170 2023-10-03T10:15:11.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.979+0000 7fac4bfff700 1 --2- 172.21.15.146:0/99027164 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac4c09e170 0x7fac4c1307a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fac380098f0 tx=0x7fac38009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9d0e7de7d0c9d32 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.979+0000 7fac4b7fe700 1 -- 172.21.15.146:0/99027164 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac38011830 con 0x7fac4c09e170 2023-10-03T10:15:11.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.979+0000 7fac4b7fe700 1 -- 172.21.15.146:0/99027164 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac38011990 con 0x7fac4c09e170 2023-10-03T10:15:11.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.979+0000 7fac4b7fe700 1 -- 172.21.15.146:0/99027164 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac38011d20 con 0x7fac4c09e170 2023-10-03T10:15:11.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.980+0000 7fac52a88700 1 -- 172.21.15.146:0/99027164 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac4c09e170 msgr2=0x7fac4c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.980+0000 7fac52a88700 1 --2- 172.21.15.146:0/99027164 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac4c09e170 0x7fac4c1307a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fac380098f0 tx=0x7fac38009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:11.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.980+0000 7fac52a88700 1 -- 172.21.15.146:0/99027164 shutdown_connections 2023-10-03T10:15:11.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.980+0000 7fac52a88700 1 --2- 172.21.15.146:0/99027164 >> v2:172.21.15.146:3300/0 conn(0x7fac4c09d860 0x7fac4c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.980+0000 7fac52a88700 1 --2- 172.21.15.146:0/99027164 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac4c09e170 0x7fac4c1307a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.980+0000 7fac52a88700 1 -- 172.21.15.146:0/99027164 >> 172.21.15.146:0/99027164 conn(0x7fac4c099c40 msgr2=0x7fac4c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.980+0000 7fac52a88700 1 -- 172.21.15.146:0/99027164 shutdown_connections 2023-10-03T10:15:11.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.980+0000 7fac52a88700 1 -- 172.21.15.146:0/99027164 wait complete. 2023-10-03T10:15:11.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.982+0000 7fac52a88700 1 Processor -- start 2023-10-03T10:15:11.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.982+0000 7fac52a88700 1 -- start start 2023-10-03T10:15:11.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.983+0000 7fac52a88700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac4c09d860 0x7fac4c13aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.983+0000 7fac52a88700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac4c09e170 0x7fac4c13b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.983+0000 7fac52a88700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac4c130ce0 0x7fac4c137aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.983+0000 7fac52a88700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c13a700 con 0x7fac4c130ce0 2023-10-03T10:15:11.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.983+0000 7fac52a88700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c136920 con 0x7fac4c09d860 2023-10-03T10:15:11.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.983+0000 7fac52a88700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c13b560 con 0x7fac4c09e170 2023-10-03T10:15:11.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.983+0000 7fac50824700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac4c09d860 0x7fac4c13aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.983+0000 7fac50824700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac4c09d860 0x7fac4c13aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51274/0 (socket says 172.21.15.146:51274) 2023-10-03T10:15:11.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.983+0000 7fac50824700 1 -- 172.21.15.146:0/869033113 learned_addr learned my addr 172.21.15.146:0/869033113 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:11.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.983+0000 7fac4bfff700 1 --2- 172.21.15.146:0/869033113 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac4c09e170 0x7fac4c13b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.983+0000 7fac51025700 1 --2- 172.21.15.146:0/869033113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac4c130ce0 0x7fac4c137aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.983+0000 7fac50824700 1 -- 172.21.15.146:0/869033113 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac4c09e170 msgr2=0x7fac4c13b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.983+0000 7fac50824700 1 --2- 172.21.15.146:0/869033113 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac4c09e170 0x7fac4c13b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.983+0000 7fac50824700 1 -- 172.21.15.146:0/869033113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac4c130ce0 msgr2=0x7fac4c137aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.983+0000 7fac50824700 1 --2- 172.21.15.146:0/869033113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac4c130ce0 0x7fac4c137aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.983+0000 7fac50824700 1 -- 172.21.15.146:0/869033113 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac38009550 con 0x7fac4c09d860 2023-10-03T10:15:11.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.983+0000 7fac50824700 1 --2- 172.21.15.146:0/869033113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac4c09d860 0x7fac4c13aae0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fac4000e9b0 tx=0x7fac4000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.984+0000 7fac497fa700 1 -- 172.21.15.146:0/869033113 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40009710 con 0x7fac4c09d860 2023-10-03T10:15:11.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.984+0000 7fac497fa700 1 -- 172.21.15.146:0/869033113 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4000ee50 con 0x7fac4c09d860 2023-10-03T10:15:11.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.984+0000 7fac497fa700 1 -- 172.21.15.146:0/869033113 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4000ca50 con 0x7fac4c09d860 2023-10-03T10:15:11.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.984+0000 7fac52a88700 1 -- 172.21.15.146:0/869033113 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4c09c8b0 con 0x7fac4c09d860 2023-10-03T10:15:11.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.984+0000 7fac52a88700 1 -- 172.21.15.146:0/869033113 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4c137650 con 0x7fac4c09d860 2023-10-03T10:15:11.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.985+0000 7fac497fa700 1 -- 172.21.15.146:0/869033113 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fac4000cbb0 con 0x7fac4c09d860 2023-10-03T10:15:11.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.985+0000 7fac497fa700 1 -- 172.21.15.146:0/869033113 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fac4003fab0 con 0x7fac4c09d860 2023-10-03T10:15:11.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.985+0000 7fac52a88700 1 -- 172.21.15.146:0/869033113 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac4c04f2a0 con 0x7fac4c09d860 2023-10-03T10:15:11.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:11.994+0000 7fac497fa700 1 -- 172.21.15.146:0/869033113 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac4001b3b0 con 0x7fac4c09d860 2023-10-03T10:15:12.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.025+0000 7ff03e6c0700 1 Processor -- start 2023-10-03T10:15:12.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.025+0000 7ff03e6c0700 1 -- start start 2023-10-03T10:15:12.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.026+0000 7ff03e6c0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0380a1550 0x7ff038138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.026+0000 7ff03e6c0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff038139200 0x7ff03813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.026+0000 7ff03e6c0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff03809e9d0 con 0x7ff0380a0a70 2023-10-03T10:15:12.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.026+0000 7ff03e6c0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff03809dc00 con 0x7ff038139200 2023-10-03T10:15:12.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.026+0000 7ff03e6c0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff03809dec0 con 0x7ff0380a1550 2023-10-03T10:15:12.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.026+0000 7ff03cc5d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff038139200 0x7ff03813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.026+0000 7ff0377fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0380a1550 0x7ff038138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.026+0000 7ff03cc5d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff038139200 0x7ff03813b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35510/0 (socket says 172.21.15.146:35510) 2023-10-03T10:15:12.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.026+0000 7ff037fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff0380a0a70 0x7ff0380a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:57626/0 (socket says 172.21.15.146:57626) 2023-10-03T10:15:12.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.026+0000 7ff03cc5d700 1 -- 172.21.15.146:0/2208994329 learned_addr learned my addr 172.21.15.146:0/2208994329 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:12.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.026+0000 7ff0377fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0380a1550 0x7ff038138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38866/0 (socket says 172.21.15.146:38866) 2023-10-03T10:15:12.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.027+0000 7ff0377fe700 1 -- 172.21.15.146:0/2208994329 >> v2:172.21.15.146:3300/0 conn(0x7ff038139200 msgr2=0x7ff03813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.027+0000 7ff0377fe700 1 --2- 172.21.15.146:0/2208994329 >> v2:172.21.15.146:3300/0 conn(0x7ff038139200 0x7ff03813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.027+0000 7ff0377fe700 1 -- 172.21.15.146:0/2208994329 >> v1:172.21.15.146:6789/0 conn(0x7ff0380a0a70 legacy=0x7ff0380a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.027+0000 7ff0377fe700 1 -- 172.21.15.146:0/2208994329 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03809e6a0 con 0x7ff0380a1550 2023-10-03T10:15:12.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.027+0000 7ff0377fe700 1 --2- 172.21.15.146:0/2208994329 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0380a1550 0x7ff038138cc0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff02c009840 tx=0x7ff02c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe9d014f7111e6c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.027+0000 7ff036ffd700 1 -- 172.21.15.146:0/2208994329 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c011830 con 0x7ff0380a1550 2023-10-03T10:15:12.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.027+0000 7ff036ffd700 1 -- 172.21.15.146:0/2208994329 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c011990 con 0x7ff0380a1550 2023-10-03T10:15:12.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.027+0000 7ff036ffd700 1 -- 172.21.15.146:0/2208994329 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c011d20 con 0x7ff0380a1550 2023-10-03T10:15:12.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.028+0000 7ff03e6c0700 1 -- 172.21.15.146:0/2208994329 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0380a1550 msgr2=0x7ff038138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.028+0000 7ff03e6c0700 1 --2- 172.21.15.146:0/2208994329 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0380a1550 0x7ff038138cc0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff02c009840 tx=0x7ff02c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:12.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.028+0000 7ff03e6c0700 1 -- 172.21.15.146:0/2208994329 shutdown_connections 2023-10-03T10:15:12.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.028+0000 7ff03e6c0700 1 --2- 172.21.15.146:0/2208994329 >> v2:172.21.15.146:3300/0 conn(0x7ff038139200 0x7ff03813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.028+0000 7ff03e6c0700 1 --2- 172.21.15.146:0/2208994329 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0380a1550 0x7ff038138cc0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.028+0000 7ff03e6c0700 1 -- 172.21.15.146:0/2208994329 >> 172.21.15.146:0/2208994329 conn(0x7ff0380a6610 msgr2=0x7ff0380a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.028+0000 7ff03e6c0700 1 -- 172.21.15.146:0/2208994329 shutdown_connections 2023-10-03T10:15:12.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.028+0000 7ff03e6c0700 1 -- 172.21.15.146:0/2208994329 wait complete. 2023-10-03T10:15:12.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.030+0000 7ff03e6c0700 1 Processor -- start 2023-10-03T10:15:12.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.030+0000 7ff03e6c0700 1 -- start start 2023-10-03T10:15:12.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.030+0000 7ff03e6c0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0380a0a70 0x7ff0381207e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.030+0000 7ff03e6c0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0380a1550 0x7ff038120d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.030+0000 7ff03e6c0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff038139200 0x7ff038121260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.031+0000 7ff03e6c0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0380a03e0 con 0x7ff0380a0a70 2023-10-03T10:15:12.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.031+0000 7ff03e6c0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0381223f0 con 0x7ff0380a1550 2023-10-03T10:15:12.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.031+0000 7ff03e6c0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0380a5320 con 0x7ff038139200 2023-10-03T10:15:12.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.031+0000 7ff037fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0380a0a70 0x7ff0381207e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.031+0000 7ff03cc5d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff038139200 0x7ff038121260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.031+0000 7ff037fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0380a0a70 0x7ff0381207e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35512/0 (socket says 172.21.15.146:35512) 2023-10-03T10:15:12.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.031+0000 7ff037fff700 1 -- 172.21.15.146:0/2962212507 learned_addr learned my addr 172.21.15.146:0/2962212507 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:12.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.031+0000 7ff0377fe700 1 --2- 172.21.15.146:0/2962212507 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0380a1550 0x7ff038120d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.031+0000 7ff03cc5d700 1 -- 172.21.15.146:0/2962212507 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0380a1550 msgr2=0x7ff038120d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.031+0000 7ff03cc5d700 1 --2- 172.21.15.146:0/2962212507 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0380a1550 0x7ff038120d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.031+0000 7ff03cc5d700 1 -- 172.21.15.146:0/2962212507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0380a0a70 msgr2=0x7ff0381207e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.031+0000 7ff03cc5d700 1 --2- 172.21.15.146:0/2962212507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0380a0a70 0x7ff0381207e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.031+0000 7ff03cc5d700 1 -- 172.21.15.146:0/2962212507 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c0094a0 con 0x7ff038139200 2023-10-03T10:15:12.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.031+0000 7ff037fff700 1 --2- 172.21.15.146:0/2962212507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0380a0a70 0x7ff0381207e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.031+0000 7ff0377fe700 1 --2- 172.21.15.146:0/2962212507 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0380a1550 0x7ff038120d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.031+0000 7ff03cc5d700 1 --2- 172.21.15.146:0/2962212507 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff038139200 0x7ff038121260 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff030009d90 tx=0x7ff03000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.031+0000 7ff034ff9700 1 -- 172.21.15.146:0/2962212507 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030003c20 con 0x7ff038139200 2023-10-03T10:15:12.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.032+0000 7ff03e6c0700 1 -- 172.21.15.146:0/2962212507 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff038123d60 con 0x7ff038139200 2023-10-03T10:15:12.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.032+0000 7ff034ff9700 1 -- 172.21.15.146:0/2962212507 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03000f040 con 0x7ff038139200 2023-10-03T10:15:12.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.032+0000 7ff034ff9700 1 -- 172.21.15.146:0/2962212507 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03000c880 con 0x7ff038139200 2023-10-03T10:15:12.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.032+0000 7ff03e6c0700 1 -- 172.21.15.146:0/2962212507 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff038124800 con 0x7ff038139200 2023-10-03T10:15:12.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.033+0000 7ff034ff9700 1 -- 172.21.15.146:0/2962212507 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff03000c9e0 con 0x7ff038139200 2023-10-03T10:15:12.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.033+0000 7ff03e6c0700 1 -- 172.21.15.146:0/2962212507 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff038124390 con 0x7ff038139200 2023-10-03T10:15:12.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.033+0000 7ff034ff9700 1 -- 172.21.15.146:0/2962212507 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff03003f990 con 0x7ff038139200 2023-10-03T10:15:12.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.038+0000 7ff034ff9700 1 -- 172.21.15.146:0/2962212507 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff030013d70 con 0x7ff038139200 2023-10-03T10:15:12.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.054+0000 7fa55e4cc700 1 Processor -- start 2023-10-03T10:15:12.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.054+0000 7fa55e4cc700 1 -- start start 2023-10-03T10:15:12.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.054+0000 7fa55e4cc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa55809d860 0x7fa55809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.054+0000 7fa55e4cc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa55809e170 0x7fa5581307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.055+0000 7fa55e4cc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa558130ce0 0x7fa558131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.055+0000 7fa55e4cc700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55809aaa0 con 0x7fa558130ce0 2023-10-03T10:15:12.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.055+0000 7fa55e4cc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55809f870 con 0x7fa55809d860 2023-10-03T10:15:12.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.055+0000 7fa55e4cc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa55809b360 con 0x7fa55809e170 2023-10-03T10:15:12.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.055+0000 7fa557fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa55809d860 0x7fa55809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.055+0000 7fa55ca69700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa558130ce0 0x7fa558131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.055+0000 7fa557fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa55809d860 0x7fa55809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51296/0 (socket says 172.21.15.146:51296) 2023-10-03T10:15:12.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.055+0000 7fa557fff700 1 -- 172.21.15.146:0/2524639561 learned_addr learned my addr 172.21.15.146:0/2524639561 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:12.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.055+0000 7fa5577fe700 1 --2- 172.21.15.146:0/2524639561 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa55809e170 0x7fa5581307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.055+0000 7fa557fff700 1 -- 172.21.15.146:0/2524639561 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa55809e170 msgr2=0x7fa5581307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.055+0000 7fa557fff700 1 --2- 172.21.15.146:0/2524639561 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa55809e170 0x7fa5581307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.055+0000 7fa557fff700 1 -- 172.21.15.146:0/2524639561 >> v2:172.21.15.146:3300/0 conn(0x7fa558130ce0 msgr2=0x7fa558131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.055+0000 7fa557fff700 1 --2- 172.21.15.146:0/2524639561 >> v2:172.21.15.146:3300/0 conn(0x7fa558130ce0 0x7fa558131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.055+0000 7fa557fff700 1 -- 172.21.15.146:0/2524639561 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55809b620 con 0x7fa55809d860 2023-10-03T10:15:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.055+0000 7fa5577fe700 1 --2- 172.21.15.146:0/2524639561 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa55809e170 0x7fa5581307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.055+0000 7fa557fff700 1 --2- 172.21.15.146:0/2524639561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa55809d860 0x7fa55809dc30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa54800b9a0 tx=0x7fa54800bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=629a68e18451705 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.055+0000 7fa556ffd700 1 -- 172.21.15.146:0/2524639561 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54800caa0 con 0x7fa55809d860 2023-10-03T10:15:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.055+0000 7fa556ffd700 1 -- 172.21.15.146:0/2524639561 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54800cc00 con 0x7fa55809d860 2023-10-03T10:15:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.055+0000 7fa556ffd700 1 -- 172.21.15.146:0/2524639561 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54800f460 con 0x7fa55809d860 2023-10-03T10:15:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.056+0000 7fa55e4cc700 1 -- 172.21.15.146:0/2524639561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa55809d860 msgr2=0x7fa55809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.056+0000 7fa55e4cc700 1 --2- 172.21.15.146:0/2524639561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa55809d860 0x7fa55809dc30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa54800b9a0 tx=0x7fa54800bcb0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.056+0000 7fa55e4cc700 1 -- 172.21.15.146:0/2524639561 shutdown_connections 2023-10-03T10:15:12.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.056+0000 7fa55e4cc700 1 --2- 172.21.15.146:0/2524639561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa55809d860 0x7fa55809dc30 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.056+0000 7fa55e4cc700 1 --2- 172.21.15.146:0/2524639561 >> v2:172.21.15.146:3300/0 conn(0x7fa558130ce0 0x7fa558131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.056+0000 7fa55e4cc700 1 --2- 172.21.15.146:0/2524639561 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa55809e170 0x7fa5581307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.056+0000 7fa55e4cc700 1 -- 172.21.15.146:0/2524639561 >> 172.21.15.146:0/2524639561 conn(0x7fa558099c40 msgr2=0x7fa5580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.056+0000 7fa55e4cc700 1 -- 172.21.15.146:0/2524639561 shutdown_connections 2023-10-03T10:15:12.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.056+0000 7fa55e4cc700 1 -- 172.21.15.146:0/2524639561 wait complete. 2023-10-03T10:15:12.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.057+0000 7fa55e4cc700 1 Processor -- start 2023-10-03T10:15:12.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.058+0000 7ff0f3e81700 1 Processor -- start 2023-10-03T10:15:12.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.058+0000 7fa55e4cc700 1 -- start start 2023-10-03T10:15:12.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.058+0000 7ff0f3e81700 1 -- start start 2023-10-03T10:15:12.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.058+0000 7fa55e4cc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa55809d860 0x7fa55811c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.058+0000 7fa55e4cc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa55809e170 0x7fa55811c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.058+0000 7fa55e4cc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa558130ce0 0x7fa55811ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.058+0000 7fa55e4cc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5580a22f0 con 0x7fa55809d860 2023-10-03T10:15:12.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.058+0000 7fa55e4cc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55811f260 con 0x7fa558130ce0 2023-10-03T10:15:12.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.058+0000 7fa55e4cc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa55809c8b0 con 0x7fa55809e170 2023-10-03T10:15:12.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7ff0f3e81700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0ec09dec0 0x7ff0ec06b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7fa5577fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa55809e170 0x7fa55811c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7ff0f3e81700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0ec136cb0 0x7ff0ec139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7ff0f3e81700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0ec06e900 con 0x7ff0ec06a770 2023-10-03T10:15:12.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7ff0f3e81700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec09d180 con 0x7ff0ec136cb0 2023-10-03T10:15:12.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7ff0f3e81700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec09e780 con 0x7ff0ec09dec0 2023-10-03T10:15:12.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7ff0f241e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0ec136cb0 0x7ff0ec139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7ff0f1c1d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff0ec06a770 0x7ff0ec06ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:57628/0 (socket says 172.21.15.146:57628) 2023-10-03T10:15:12.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7ff0f1c1d700 1 -- 172.21.15.146:0/3074778693 learned_addr learned my addr 172.21.15.146:0/3074778693 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:12.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7ff0f141c700 1 --2- 172.21.15.146:0/3074778693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0ec09dec0 0x7ff0ec06b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7fa5577fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa55809e170 0x7fa55811c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38888/0 (socket says 172.21.15.146:38888) 2023-10-03T10:15:12.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7fa5577fe700 1 -- 172.21.15.146:0/2919888473 learned_addr learned my addr 172.21.15.146:0/2919888473 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:12.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7fa557fff700 1 --2- 172.21.15.146:0/2919888473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa55809d860 0x7fa55811c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7fa55ca69700 1 --2- 172.21.15.146:0/2919888473 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa558130ce0 0x7fa55811ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7ff0f241e700 1 -- 172.21.15.146:0/3074778693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0ec09dec0 msgr2=0x7ff0ec06b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7ff0f241e700 1 --2- 172.21.15.146:0/3074778693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0ec09dec0 0x7ff0ec06b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7ff0f241e700 1 -- 172.21.15.146:0/3074778693 >> v1:172.21.15.146:6789/0 conn(0x7ff0ec06a770 legacy=0x7ff0ec06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7ff0f241e700 1 -- 172.21.15.146:0/3074778693 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec09d3c0 con 0x7ff0ec136cb0 2023-10-03T10:15:12.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7fa557fff700 1 -- 172.21.15.146:0/2919888473 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa55809e170 msgr2=0x7fa55811c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7fa557fff700 1 --2- 172.21.15.146:0/2919888473 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa55809e170 0x7fa55811c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7fa557fff700 1 -- 172.21.15.146:0/2919888473 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa558130ce0 msgr2=0x7fa55811ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7fa557fff700 1 --2- 172.21.15.146:0/2919888473 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa558130ce0 0x7fa55811ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7fa557fff700 1 -- 172.21.15.146:0/2919888473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54800b600 con 0x7fa55809d860 2023-10-03T10:15:12.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7fa5577fe700 1 --2- 172.21.15.146:0/2919888473 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa55809e170 0x7fa55811c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.059+0000 7fa557fff700 1 --2- 172.21.15.146:0/2919888473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa55809d860 0x7fa55811c000 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fa548016000 tx=0x7fa548004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.060+0000 7ff0f241e700 1 --2- 172.21.15.146:0/3074778693 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0ec136cb0 0x7ff0ec139090 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009dc0 tx=0x7ff0e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8089f595c08ecd1b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.060+0000 7fa554ff9700 1 -- 172.21.15.146:0/2919888473 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54801c070 con 0x7fa55809d860 2023-10-03T10:15:12.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.060+0000 7fa554ff9700 1 -- 172.21.15.146:0/2919888473 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54800c8a0 con 0x7fa55809d860 2023-10-03T10:15:12.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.060+0000 7fa554ff9700 1 -- 172.21.15.146:0/2919888473 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548004250 con 0x7fa55809d860 2023-10-03T10:15:12.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.060+0000 7fa55e4cc700 1 -- 172.21.15.146:0/2919888473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa55811dbc0 con 0x7fa55809d860 2023-10-03T10:15:12.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.060+0000 7ff0f0c1b700 1 -- 172.21.15.146:0/3074778693 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e400e070 con 0x7ff0ec136cb0 2023-10-03T10:15:12.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.060+0000 7ff0f0c1b700 1 -- 172.21.15.146:0/3074778693 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e400bb20 con 0x7ff0ec136cb0 2023-10-03T10:15:12.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.060+0000 7ff0f0c1b700 1 -- 172.21.15.146:0/3074778693 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4012430 con 0x7ff0ec136cb0 2023-10-03T10:15:12.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.060+0000 7fa55e4cc700 1 -- 172.21.15.146:0/2919888473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55811ffd0 con 0x7fa55809d860 2023-10-03T10:15:12.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.061+0000 7fa554ff9700 1 -- 172.21.15.146:0/2919888473 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa5480043b0 con 0x7fa55809d860 2023-10-03T10:15:12.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.061+0000 7fa554ff9700 1 -- 172.21.15.146:0/2919888473 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa548040620 con 0x7fa55809d860 2023-10-03T10:15:12.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.061+0000 7ff0f3e81700 1 -- 172.21.15.146:0/3074778693 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0ec136cb0 msgr2=0x7ff0ec139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.061+0000 7ff0f3e81700 1 --2- 172.21.15.146:0/3074778693 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0ec136cb0 0x7ff0ec139090 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009dc0 tx=0x7ff0e400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:12.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.061+0000 7ff0f3e81700 1 -- 172.21.15.146:0/3074778693 shutdown_connections 2023-10-03T10:15:12.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.061+0000 7ff0f3e81700 1 --2- 172.21.15.146:0/3074778693 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0ec136cb0 0x7ff0ec139090 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.061+0000 7ff0f3e81700 1 --2- 172.21.15.146:0/3074778693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0ec09dec0 0x7ff0ec06b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.061+0000 7ff0f3e81700 1 -- 172.21.15.146:0/3074778693 >> 172.21.15.146:0/3074778693 conn(0x7ff0ec099c40 msgr2=0x7ff0ec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.061+0000 7fa55e4cc700 1 -- 172.21.15.146:0/2919888473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55811f490 con 0x7fa55809d860 2023-10-03T10:15:12.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.061+0000 7ff0f3e81700 1 -- 172.21.15.146:0/3074778693 shutdown_connections 2023-10-03T10:15:12.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.061+0000 7ff0f3e81700 1 -- 172.21.15.146:0/3074778693 wait complete. 2023-10-03T10:15:12.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.062+0000 7ff0f3e81700 1 Processor -- start 2023-10-03T10:15:12.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.062+0000 7ff0f3e81700 1 -- start start 2023-10-03T10:15:12.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.062+0000 7ff0f3e81700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0ec06a770 0x7ff0ec119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.062+0000 7ff0f3e81700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0ec09dec0 0x7ff0ec119b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.062+0000 7ff0f3e81700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0ec136cb0 0x7ff0ec11a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.062+0000 7ff0f3e81700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec11b4e0 con 0x7ff0ec09dec0 2023-10-03T10:15:12.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.062+0000 7ff0f3e81700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec071ce0 con 0x7ff0ec06a770 2023-10-03T10:15:12.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.062+0000 7ff0f3e81700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec139230 con 0x7ff0ec136cb0 2023-10-03T10:15:12.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.063+0000 7ff0f1c1d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0ec06a770 0x7ff0ec119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.063+0000 7ff0f1c1d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0ec06a770 0x7ff0ec119630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51328/0 (socket says 172.21.15.146:51328) 2023-10-03T10:15:12.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.063+0000 7ff0f1c1d700 1 -- 172.21.15.146:0/2105107081 learned_addr learned my addr 172.21.15.146:0/2105107081 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:12.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.063+0000 7ff0f141c700 1 --2- 172.21.15.146:0/2105107081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0ec09dec0 0x7ff0ec119b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.063+0000 7ff0f241e700 1 --2- 172.21.15.146:0/2105107081 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0ec136cb0 0x7ff0ec11a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.063+0000 7ff0f1c1d700 1 -- 172.21.15.146:0/2105107081 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0ec136cb0 msgr2=0x7ff0ec11a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.063+0000 7ff0f1c1d700 1 --2- 172.21.15.146:0/2105107081 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0ec136cb0 0x7ff0ec11a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.063+0000 7ff0f1c1d700 1 -- 172.21.15.146:0/2105107081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0ec09dec0 msgr2=0x7ff0ec119b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.063+0000 7ff0f1c1d700 1 --2- 172.21.15.146:0/2105107081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0ec09dec0 0x7ff0ec119b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.063+0000 7ff0f1c1d700 1 -- 172.21.15.146:0/2105107081 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e4009a70 con 0x7ff0ec06a770 2023-10-03T10:15:12.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.063+0000 7ff0f1c1d700 1 --2- 172.21.15.146:0/2105107081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0ec06a770 0x7ff0ec119630 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff0e800c520 tx=0x7ff0e800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.063+0000 7ff0e27fc700 1 -- 172.21.15.146:0/2105107081 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8005d70 con 0x7ff0ec06a770 2023-10-03T10:15:12.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.063+0000 7ff0e27fc700 1 -- 172.21.15.146:0/2105107081 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e80070d0 con 0x7ff0ec06a770 2023-10-03T10:15:12.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.063+0000 7ff0f3e81700 1 -- 172.21.15.146:0/2105107081 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0ec11c5a0 con 0x7ff0ec06a770 2023-10-03T10:15:12.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.063+0000 7ff0e27fc700 1 -- 172.21.15.146:0/2105107081 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8007440 con 0x7ff0ec06a770 2023-10-03T10:15:12.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.063+0000 7ff0f3e81700 1 -- 172.21.15.146:0/2105107081 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ec11b6f0 con 0x7ff0ec06a770 2023-10-03T10:15:12.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.064+0000 7ff0e27fc700 1 -- 172.21.15.146:0/2105107081 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0e80075a0 con 0x7ff0ec06a770 2023-10-03T10:15:12.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.065+0000 7ff0e27fc700 1 -- 172.21.15.146:0/2105107081 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff0e803ead0 con 0x7ff0ec06a770 2023-10-03T10:15:12.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.066+0000 7ff0f3e81700 1 -- 172.21.15.146:0/2105107081 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0ec04f2a0 con 0x7ff0ec06a770 2023-10-03T10:15:12.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.067+0000 7fa554ff9700 1 -- 172.21.15.146:0/2919888473 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa55811f490 con 0x7fa55809d860 2023-10-03T10:15:12.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.070+0000 7ff0e27fc700 1 -- 172.21.15.146:0/2105107081 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0e8019b40 con 0x7ff0ec06a770 2023-10-03T10:15:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.230+0000 7fac52a88700 1 -- 172.21.15.146:0/869033113 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fac4c139030 con 0x7fac4c09d860 2023-10-03T10:15:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.230+0000 7fac497fa700 1 -- 172.21.15.146:0/869033113 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fac40017020 con 0x7fac4c09d860 2023-10-03T10:15:12.231 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:12.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.232+0000 7fac52a88700 1 -- 172.21.15.146:0/869033113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac4c09d860 msgr2=0x7fac4c13aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.232+0000 7fac52a88700 1 --2- 172.21.15.146:0/869033113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac4c09d860 0x7fac4c13aae0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fac4000e9b0 tx=0x7fac4000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.233+0000 7fac52a88700 1 -- 172.21.15.146:0/869033113 shutdown_connections 2023-10-03T10:15:12.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.233+0000 7fac52a88700 1 --2- 172.21.15.146:0/869033113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac4c130ce0 0x7fac4c137aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.233+0000 7fac52a88700 1 --2- 172.21.15.146:0/869033113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac4c09d860 0x7fac4c13aae0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.233+0000 7fac52a88700 1 --2- 172.21.15.146:0/869033113 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac4c09e170 0x7fac4c13b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.233+0000 7fac52a88700 1 -- 172.21.15.146:0/869033113 >> 172.21.15.146:0/869033113 conn(0x7fac4c099c40 msgr2=0x7fac4c139480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.233+0000 7fac52a88700 1 -- 172.21.15.146:0/869033113 shutdown_connections 2023-10-03T10:15:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.233+0000 7fac52a88700 1 -- 172.21.15.146:0/869033113 wait complete. 2023-10-03T10:15:12.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:12.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.259+0000 7ff03e6c0700 1 -- 172.21.15.146:0/2962212507 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff038123ef0 con 0x7ff038139200 2023-10-03T10:15:12.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.260+0000 7ff034ff9700 1 -- 172.21.15.146:0/2962212507 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff038123ef0 con 0x7ff038139200 2023-10-03T10:15:12.261 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:12.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.262+0000 7ff03e6c0700 1 -- 172.21.15.146:0/2962212507 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff038139200 msgr2=0x7ff038121260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.262+0000 7ff03e6c0700 1 --2- 172.21.15.146:0/2962212507 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff038139200 0x7ff038121260 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff030009d90 tx=0x7ff03000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.262+0000 7ff03e6c0700 1 -- 172.21.15.146:0/2962212507 shutdown_connections 2023-10-03T10:15:12.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.262+0000 7ff03e6c0700 1 --2- 172.21.15.146:0/2962212507 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff038139200 0x7ff038121260 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.262+0000 7ff03e6c0700 1 --2- 172.21.15.146:0/2962212507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0380a0a70 0x7ff0381207e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.262+0000 7ff03e6c0700 1 --2- 172.21.15.146:0/2962212507 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0380a1550 0x7ff038120d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.262+0000 7ff03e6c0700 1 -- 172.21.15.146:0/2962212507 >> 172.21.15.146:0/2962212507 conn(0x7ff0380a6610 msgr2=0x7ff0380a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.262+0000 7ff03e6c0700 1 -- 172.21.15.146:0/2962212507 shutdown_connections 2023-10-03T10:15:12.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.262+0000 7ff03e6c0700 1 -- 172.21.15.146:0/2962212507 wait complete. 2023-10-03T10:15:12.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.264+0000 7fa55e4cc700 1 -- 172.21.15.146:0/2919888473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa55811f490 con 0x7fa55809d860 2023-10-03T10:15:12.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.265+0000 7fa554ff9700 1 -- 172.21.15.146:0/2919888473 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa548025080 con 0x7fa55809d860 2023-10-03T10:15:12.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.265+0000 7ff0f3e81700 1 -- 172.21.15.146:0/2105107081 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff0ec09e380 con 0x7ff0ec06a770 2023-10-03T10:15:12.266 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:12.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.265+0000 7ff0e27fc700 1 -- 172.21.15.146:0/2105107081 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff0e8017020 con 0x7ff0ec06a770 2023-10-03T10:15:12.266 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:12.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.267+0000 7fa55e4cc700 1 -- 172.21.15.146:0/2919888473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa55809d860 msgr2=0x7fa55811c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.267+0000 7fa55e4cc700 1 --2- 172.21.15.146:0/2919888473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa55809d860 0x7fa55811c000 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fa548016000 tx=0x7fa548004750 comp rx=0 tx=0).stop 2023-10-03T10:15:12.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.267+0000 7fa55e4cc700 1 -- 172.21.15.146:0/2919888473 shutdown_connections 2023-10-03T10:15:12.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.267+0000 7fa55e4cc700 1 --2- 172.21.15.146:0/2919888473 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa558130ce0 0x7fa55811ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.267+0000 7fa55e4cc700 1 --2- 172.21.15.146:0/2919888473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa55809d860 0x7fa55811c000 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.267+0000 7fa55e4cc700 1 --2- 172.21.15.146:0/2919888473 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa55809e170 0x7fa55811c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.267+0000 7fa55e4cc700 1 -- 172.21.15.146:0/2919888473 >> 172.21.15.146:0/2919888473 conn(0x7fa558099c40 msgr2=0x7fa558130080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.267+0000 7fa55e4cc700 1 -- 172.21.15.146:0/2919888473 shutdown_connections 2023-10-03T10:15:12.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.267+0000 7fa55e4cc700 1 -- 172.21.15.146:0/2919888473 wait complete. 2023-10-03T10:15:12.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.267+0000 7ff0f3e81700 1 -- 172.21.15.146:0/2105107081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0ec06a770 msgr2=0x7ff0ec119630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.267+0000 7ff0f3e81700 1 --2- 172.21.15.146:0/2105107081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0ec06a770 0x7ff0ec119630 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff0e800c520 tx=0x7ff0e800c830 comp rx=0 tx=0).stop 2023-10-03T10:15:12.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.267+0000 7ff0f3e81700 1 -- 172.21.15.146:0/2105107081 shutdown_connections 2023-10-03T10:15:12.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.267+0000 7ff0f3e81700 1 --2- 172.21.15.146:0/2105107081 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0ec136cb0 0x7ff0ec11a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.267+0000 7ff0f3e81700 1 --2- 172.21.15.146:0/2105107081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0ec06a770 0x7ff0ec119630 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.267+0000 7ff0f3e81700 1 --2- 172.21.15.146:0/2105107081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0ec09dec0 0x7ff0ec119b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.267+0000 7ff0f3e81700 1 -- 172.21.15.146:0/2105107081 >> 172.21.15.146:0/2105107081 conn(0x7ff0ec099c40 msgr2=0x7ff0ec0a13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.267+0000 7ff0f3e81700 1 -- 172.21.15.146:0/2105107081 shutdown_connections 2023-10-03T10:15:12.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:12.268+0000 7ff0f3e81700 1 -- 172.21.15.146:0/2105107081 wait complete. 2023-10-03T10:15:12.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:12.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:12.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:13.246 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:13.279 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:13.284 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:13.284 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:13.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.397+0000 7fae6b0c8700 1 Processor -- start 2023-10-03T10:15:13.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.398+0000 7fae6b0c8700 1 -- start start 2023-10-03T10:15:13.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.398+0000 7fae6b0c8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae6409a150 0x7fae6409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.398+0000 7fae6b0c8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fae6409f1a0 0x7fae64134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.398+0000 7fae6b0c8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae6409af80 con 0x7fae6409edb0 2023-10-03T10:15:13.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.398+0000 7fae6b0c8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae6409fe00 con 0x7fae6409f1a0 2023-10-03T10:15:13.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.398+0000 7fae6b0c8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6406bec0 con 0x7fae6409a150 2023-10-03T10:15:13.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.398+0000 7fae68e64700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae6409a150 0x7fae6409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.399+0000 7fae68e64700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae6409a150 0x7fae6409e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51340/0 (socket says 172.21.15.146:51340) 2023-10-03T10:15:13.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.399+0000 7fae68e64700 1 -- 172.21.15.146:0/2971159723 learned_addr learned my addr 172.21.15.146:0/2971159723 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:13.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.399+0000 7fae69665700 1 --2- 172.21.15.146:0/2971159723 >> v2:172.21.15.146:3300/0 conn(0x7fae6409f1a0 0x7fae64134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.399+0000 7fae69665700 1 -- 172.21.15.146:0/2971159723 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae6409a150 msgr2=0x7fae6409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:13.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.399+0000 7fae69665700 1 --2- 172.21.15.146:0/2971159723 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae6409a150 0x7fae6409e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.399+0000 7fae69665700 1 -- 172.21.15.146:0/2971159723 >> v1:172.21.15.146:6789/0 conn(0x7fae6409edb0 legacy=0x7fae64133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.399+0000 7fae69665700 1 -- 172.21.15.146:0/2971159723 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6406bc20 con 0x7fae6409f1a0 2023-10-03T10:15:13.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.399+0000 7fae68e64700 1 --2- 172.21.15.146:0/2971159723 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae6409a150 0x7fae6409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:13.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.399+0000 7fae69665700 1 --2- 172.21.15.146:0/2971159723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae6409f1a0 0x7fae64134330 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fae5c009d90 tx=0x7fae5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c42c99c1891324 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:13.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.399+0000 7fae637fe700 1 -- 172.21.15.146:0/2971159723 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c00e070 con 0x7fae6409f1a0 2023-10-03T10:15:13.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.399+0000 7fae637fe700 1 -- 172.21.15.146:0/2971159723 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5c00bb20 con 0x7fae6409f1a0 2023-10-03T10:15:13.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.399+0000 7fae637fe700 1 -- 172.21.15.146:0/2971159723 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c012430 con 0x7fae6409f1a0 2023-10-03T10:15:13.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.400+0000 7fae6b0c8700 1 -- 172.21.15.146:0/2971159723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae6409f1a0 msgr2=0x7fae64134330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.400+0000 7fae6b0c8700 1 --2- 172.21.15.146:0/2971159723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae6409f1a0 0x7fae64134330 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fae5c009d90 tx=0x7fae5c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:13.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.400+0000 7fae6b0c8700 1 -- 172.21.15.146:0/2971159723 shutdown_connections 2023-10-03T10:15:13.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.400+0000 7fae6b0c8700 1 --2- 172.21.15.146:0/2971159723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae6409f1a0 0x7fae64134330 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.400+0000 7fae6b0c8700 1 --2- 172.21.15.146:0/2971159723 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae6409a150 0x7fae6409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.400+0000 7fae6b0c8700 1 -- 172.21.15.146:0/2971159723 >> 172.21.15.146:0/2971159723 conn(0x7fae640a4430 msgr2=0x7fae640a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:13.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.400+0000 7fae6b0c8700 1 -- 172.21.15.146:0/2971159723 shutdown_connections 2023-10-03T10:15:13.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.400+0000 7fae6b0c8700 1 -- 172.21.15.146:0/2971159723 wait complete. 2023-10-03T10:15:13.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.401+0000 7fae6b0c8700 1 Processor -- start 2023-10-03T10:15:13.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.401+0000 7fae6b0c8700 1 -- start start 2023-10-03T10:15:13.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.402+0000 7fae6b0c8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae6409a150 0x7fae64122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.402+0000 7fae6b0c8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae6409edb0 0x7fae64122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.402+0000 7fae6b0c8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae6409f1a0 0x7fae64123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.402+0000 7fae6b0c8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae64124390 con 0x7fae6409edb0 2023-10-03T10:15:13.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.402+0000 7fae6b0c8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae640a04b0 con 0x7fae6409f1a0 2023-10-03T10:15:13.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.402+0000 7fae6b0c8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae64125fc0 con 0x7fae6409a150 2023-10-03T10:15:13.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.402+0000 7fae63fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae6409edb0 0x7fae64122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.402+0000 7fae63fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae6409edb0 0x7fae64122cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35550/0 (socket says 172.21.15.146:35550) 2023-10-03T10:15:13.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.402+0000 7fae63fff700 1 -- 172.21.15.146:0/3836231879 learned_addr learned my addr 172.21.15.146:0/3836231879 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:13.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.402+0000 7fae69665700 1 --2- 172.21.15.146:0/3836231879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae6409f1a0 0x7fae64123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.403+0000 7fae68e64700 1 --2- 172.21.15.146:0/3836231879 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae6409a150 0x7fae64122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.403+0000 7fae63fff700 1 -- 172.21.15.146:0/3836231879 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae6409a150 msgr2=0x7fae64122780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.403+0000 7fae63fff700 1 --2- 172.21.15.146:0/3836231879 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae6409a150 0x7fae64122780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.403+0000 7fae63fff700 1 -- 172.21.15.146:0/3836231879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae6409f1a0 msgr2=0x7fae64123200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.403+0000 7fae63fff700 1 --2- 172.21.15.146:0/3836231879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae6409f1a0 0x7fae64123200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.403+0000 7fae63fff700 1 -- 172.21.15.146:0/3836231879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae58009550 con 0x7fae6409edb0 2023-10-03T10:15:13.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.403+0000 7fae69665700 1 --2- 172.21.15.146:0/3836231879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae6409f1a0 0x7fae64123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:13.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.403+0000 7fae63fff700 1 --2- 172.21.15.146:0/3836231879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae6409edb0 0x7fae64122cc0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fae5000c4b0 tx=0x7fae5000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:13.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.403+0000 7fae617fa700 1 -- 172.21.15.146:0/3836231879 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae500052d0 con 0x7fae6409edb0 2023-10-03T10:15:13.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.403+0000 7fae617fa700 1 -- 172.21.15.146:0/3836231879 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae50005430 con 0x7fae6409edb0 2023-10-03T10:15:13.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.403+0000 7fae6b0c8700 1 -- 172.21.15.146:0/3836231879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5c009a70 con 0x7fae6409edb0 2023-10-03T10:15:13.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.404+0000 7fae617fa700 1 -- 172.21.15.146:0/3836231879 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae500038c0 con 0x7fae6409edb0 2023-10-03T10:15:13.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.404+0000 7fae6b0c8700 1 -- 172.21.15.146:0/3836231879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae641336d0 con 0x7fae6409edb0 2023-10-03T10:15:13.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.404+0000 7fae617fa700 1 -- 172.21.15.146:0/3836231879 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae50003a20 con 0x7fae6409edb0 2023-10-03T10:15:13.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.405+0000 7fae617fa700 1 -- 172.21.15.146:0/3836231879 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fae50011910 con 0x7fae6409edb0 2023-10-03T10:15:13.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.405+0000 7fae6b0c8700 1 -- 172.21.15.146:0/3836231879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6409fa30 con 0x7fae6409edb0 2023-10-03T10:15:13.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.410+0000 7fae617fa700 1 -- 172.21.15.146:0/3836231879 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae50044060 con 0x7fae6409edb0 2023-10-03T10:15:13.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.426+0000 7f473629b700 1 Processor -- start 2023-10-03T10:15:13.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.426+0000 7f473629b700 1 -- start start 2023-10-03T10:15:13.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.427+0000 7f473629b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4730138040 0x7f4730138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.427+0000 7f473629b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f47300a08e0 0x7f47300a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.427+0000 7f473629b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47301379e0 con 0x7f47300a1230 2023-10-03T10:15:13.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.427+0000 7f473629b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47300a2100 con 0x7f47300a08e0 2023-10-03T10:15:13.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.427+0000 7f473629b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4730138950 con 0x7f4730138040 2023-10-03T10:15:13.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.427+0000 7f472ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4730138040 0x7f4730138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.427+0000 7f472ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4730138040 0x7f4730138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38924/0 (socket says 172.21.15.146:38924) 2023-10-03T10:15:13.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.427+0000 7f472ffff700 1 -- 172.21.15.146:0/981384715 learned_addr learned my addr 172.21.15.146:0/981384715 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:13.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.427+0000 7f472f7fe700 1 --2- 172.21.15.146:0/981384715 >> v2:172.21.15.146:3300/0 conn(0x7f47300a08e0 0x7f47300a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.428+0000 7f472f7fe700 1 -- 172.21.15.146:0/981384715 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4730138040 msgr2=0x7f4730138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:13.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.428+0000 7f472f7fe700 1 --2- 172.21.15.146:0/981384715 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4730138040 0x7f4730138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.428+0000 7f472f7fe700 1 -- 172.21.15.146:0/981384715 >> v1:172.21.15.146:6789/0 conn(0x7f47300a1230 legacy=0x7f473013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.428+0000 7f472f7fe700 1 -- 172.21.15.146:0/981384715 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473009b9b0 con 0x7f47300a08e0 2023-10-03T10:15:13.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.428+0000 7f472f7fe700 1 --2- 172.21.15.146:0/981384715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47300a08e0 0x7f47300a0cf0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f4724009870 tx=0x7f4724009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be57ced7f43d22df server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:13.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.428+0000 7f472effd700 1 -- 172.21.15.146:0/981384715 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4724011830 con 0x7f47300a08e0 2023-10-03T10:15:13.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.428+0000 7f472effd700 1 -- 172.21.15.146:0/981384715 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4724011990 con 0x7f47300a08e0 2023-10-03T10:15:13.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.428+0000 7f472effd700 1 -- 172.21.15.146:0/981384715 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4724011d20 con 0x7f47300a08e0 2023-10-03T10:15:13.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.429+0000 7f473629b700 1 -- 172.21.15.146:0/981384715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47300a08e0 msgr2=0x7f47300a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.429+0000 7f473629b700 1 --2- 172.21.15.146:0/981384715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47300a08e0 0x7f47300a0cf0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f4724009870 tx=0x7f4724009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:13.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.429+0000 7f473629b700 1 -- 172.21.15.146:0/981384715 shutdown_connections 2023-10-03T10:15:13.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.429+0000 7f473629b700 1 --2- 172.21.15.146:0/981384715 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4730138040 0x7f4730138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.429+0000 7f473629b700 1 --2- 172.21.15.146:0/981384715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47300a08e0 0x7f47300a0cf0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.429+0000 7f473629b700 1 -- 172.21.15.146:0/981384715 >> 172.21.15.146:0/981384715 conn(0x7f47300a2980 msgr2=0x7f47300a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:13.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.429+0000 7f473629b700 1 -- 172.21.15.146:0/981384715 shutdown_connections 2023-10-03T10:15:13.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.429+0000 7f473629b700 1 -- 172.21.15.146:0/981384715 wait complete. 2023-10-03T10:15:13.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.430+0000 7f473629b700 1 Processor -- start 2023-10-03T10:15:13.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.430+0000 7ffac5329700 1 Processor -- start 2023-10-03T10:15:13.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.430+0000 7ffac5329700 1 -- start start 2023-10-03T10:15:13.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.430+0000 7f473629b700 1 -- start start 2023-10-03T10:15:13.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7ffac5329700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac006a770 0x7ffac006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7f473629b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47300a08e0 0x7f47301263c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7f473629b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47300a1230 0x7f4730126900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7ffac5329700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffac009dec0 0x7ffac006b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7ffac5329700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffac0131a00 0x7ffac0131e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7ffac5329700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac006b5c0 con 0x7ffac0131a00 2023-10-03T10:15:13.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7ffac5329700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac006e900 con 0x7ffac009dec0 2023-10-03T10:15:13.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7ffac5329700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffac009d180 con 0x7ffac006a770 2023-10-03T10:15:13.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7ffabf7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffac0131a00 0x7ffac0131e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7ffabf7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffac0131a00 0x7ffac0131e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35568/0 (socket says 172.21.15.146:35568) 2023-10-03T10:15:13.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7ffabf7fe700 1 -- 172.21.15.146:0/2675669630 learned_addr learned my addr 172.21.15.146:0/2675669630 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:13.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7ffab7fff700 1 --2- 172.21.15.146:0/2675669630 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac006a770 0x7ffac006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7f473629b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4730138040 0x7f4730126e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7f473629b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4730129760 con 0x7f47300a08e0 2023-10-03T10:15:13.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7f473629b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4730129c00 con 0x7f47300a1230 2023-10-03T10:15:13.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7f473629b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4730137380 con 0x7f4730138040 2023-10-03T10:15:13.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7f4734838700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4730138040 0x7f4730126e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7f472ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47300a08e0 0x7f47301263c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7f4734838700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4730138040 0x7f4730126e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38948/0 (socket says 172.21.15.146:38948) 2023-10-03T10:15:13.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7f472ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47300a08e0 0x7f47301263c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35582/0 (socket says 172.21.15.146:35582) 2023-10-03T10:15:13.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7f4734838700 1 -- 172.21.15.146:0/518024445 learned_addr learned my addr 172.21.15.146:0/518024445 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:13.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7f472f7fe700 1 --2- 172.21.15.146:0/518024445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47300a1230 0x7f4730126900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7ffab7fff700 1 -- 172.21.15.146:0/2675669630 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffac009dec0 msgr2=0x7ffac006b080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:15:13.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7ffab7fff700 1 --2- 172.21.15.146:0/2675669630 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffac009dec0 0x7ffac006b080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7ffab7fff700 1 -- 172.21.15.146:0/2675669630 >> v2:172.21.15.146:3300/0 conn(0x7ffac0131a00 msgr2=0x7ffac0131e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:13.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7ffab7fff700 1 --2- 172.21.15.146:0/2675669630 >> v2:172.21.15.146:3300/0 conn(0x7ffac0131a00 0x7ffac0131e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.431+0000 7ffab7fff700 1 -- 172.21.15.146:0/2675669630 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac009e780 con 0x7ffac006a770 2023-10-03T10:15:13.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.432+0000 7f472ffff700 1 -- 172.21.15.146:0/518024445 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4730138040 msgr2=0x7f4730126e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.432+0000 7f472ffff700 1 --2- 172.21.15.146:0/518024445 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4730138040 0x7f4730126e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.432+0000 7f472ffff700 1 -- 172.21.15.146:0/518024445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47300a1230 msgr2=0x7f4730126900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.432+0000 7f472ffff700 1 --2- 172.21.15.146:0/518024445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47300a1230 0x7f4730126900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.432+0000 7f472ffff700 1 -- 172.21.15.146:0/518024445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47240094a0 con 0x7f47300a08e0 2023-10-03T10:15:13.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.432+0000 7ffab7fff700 1 --2- 172.21.15.146:0/2675669630 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac006a770 0x7ffac006ab40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009840 tx=0x7ffab0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a93129f910cb62b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:13.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.432+0000 7ffabe7fc700 1 -- 172.21.15.146:0/2675669630 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab0011830 con 0x7ffac006a770 2023-10-03T10:15:13.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.432+0000 7ffabe7fc700 1 -- 172.21.15.146:0/2675669630 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab0011990 con 0x7ffac006a770 2023-10-03T10:15:13.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.432+0000 7f472ffff700 1 --2- 172.21.15.146:0/518024445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47300a08e0 0x7f47301263c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4720006fd0 tx=0x7f472000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:13.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.432+0000 7ffabe7fc700 1 -- 172.21.15.146:0/2675669630 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab0011d20 con 0x7ffac006a770 2023-10-03T10:15:13.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.432+0000 7ffac5329700 1 -- 172.21.15.146:0/2675669630 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac006a770 msgr2=0x7ffac006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.432+0000 7ffac5329700 1 --2- 172.21.15.146:0/2675669630 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac006a770 0x7ffac006ab40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009840 tx=0x7ffab0009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:13.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.433+0000 7f472cff9700 1 -- 172.21.15.146:0/518024445 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720013680 con 0x7f47300a08e0 2023-10-03T10:15:13.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.433+0000 7ffac5329700 1 -- 172.21.15.146:0/2675669630 shutdown_connections 2023-10-03T10:15:13.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.433+0000 7ffac5329700 1 --2- 172.21.15.146:0/2675669630 >> v2:172.21.15.146:3300/0 conn(0x7ffac0131a00 0x7ffac0131e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.433+0000 7ffac5329700 1 --2- 172.21.15.146:0/2675669630 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac006a770 0x7ffac006ab40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.433+0000 7ffac5329700 1 --2- 172.21.15.146:0/2675669630 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffac009dec0 0x7ffac006b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.433+0000 7ffac5329700 1 -- 172.21.15.146:0/2675669630 >> 172.21.15.146:0/2675669630 conn(0x7ffac0099c40 msgr2=0x7ffac00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:13.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.433+0000 7f472cff9700 1 -- 172.21.15.146:0/518024445 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47200137e0 con 0x7f47300a08e0 2023-10-03T10:15:13.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.433+0000 7f472cff9700 1 -- 172.21.15.146:0/518024445 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720013b50 con 0x7f47300a08e0 2023-10-03T10:15:13.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.433+0000 7f473629b700 1 -- 172.21.15.146:0/518024445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4730129940 con 0x7f47300a08e0 2023-10-03T10:15:13.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.433+0000 7f473629b700 1 -- 172.21.15.146:0/518024445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f473012a670 con 0x7f47300a08e0 2023-10-03T10:15:13.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.433+0000 7ffac5329700 1 -- 172.21.15.146:0/2675669630 shutdown_connections 2023-10-03T10:15:13.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.433+0000 7ffac5329700 1 -- 172.21.15.146:0/2675669630 wait complete. 2023-10-03T10:15:13.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.434+0000 7f472cff9700 1 -- 172.21.15.146:0/518024445 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4720013cb0 con 0x7f47300a08e0 2023-10-03T10:15:13.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.434+0000 7f473629b700 1 -- 172.21.15.146:0/518024445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f473004f2a0 con 0x7f47300a08e0 2023-10-03T10:15:13.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.434+0000 7ffac5329700 1 Processor -- start 2023-10-03T10:15:13.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.434+0000 7ffac5329700 1 -- start start 2023-10-03T10:15:13.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.434+0000 7f472cff9700 1 -- 172.21.15.146:0/518024445 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f472003fa00 con 0x7f47300a08e0 2023-10-03T10:15:13.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.435+0000 7ffac5329700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac006a770 0x7ffac011bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.435+0000 7ffac5329700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffac009dec0 0x7ffac011c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.435+0000 7ffac5329700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffac0131a00 0x7ffac011c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.435+0000 7ffac5329700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac011d300 con 0x7ffac0131a00 2023-10-03T10:15:13.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.435+0000 7ffac5329700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac011ece0 con 0x7ffac009dec0 2023-10-03T10:15:13.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.435+0000 7ffac5329700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffac011db30 con 0x7ffac006a770 2023-10-03T10:15:13.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.435+0000 7ffabf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffac0131a00 0x7ffac011c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.435+0000 7ffabf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffac0131a00 0x7ffac011c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35594/0 (socket says 172.21.15.146:35594) 2023-10-03T10:15:13.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.435+0000 7ffabf7fe700 1 -- 172.21.15.146:0/1871901423 learned_addr learned my addr 172.21.15.146:0/1871901423 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:13.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.435+0000 7ffabf7fe700 1 -- 172.21.15.146:0/1871901423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac006a770 msgr2=0x7ffac011bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.435+0000 7ffab7fff700 1 --2- 172.21.15.146:0/1871901423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac006a770 0x7ffac011bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.435+0000 7ffabf7fe700 1 --2- 172.21.15.146:0/1871901423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac006a770 0x7ffac011bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.435+0000 7ffabf7fe700 1 -- 172.21.15.146:0/1871901423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffac009dec0 msgr2=0x7ffac011c400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:15:13.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.435+0000 7ffabf7fe700 1 --2- 172.21.15.146:0/1871901423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffac009dec0 0x7ffac011c400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.435+0000 7ffabf7fe700 1 -- 172.21.15.146:0/1871901423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab00094a0 con 0x7ffac0131a00 2023-10-03T10:15:13.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.435+0000 7ffab7fff700 1 --2- 172.21.15.146:0/1871901423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac006a770 0x7ffac011bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:13.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.435+0000 7ffabf7fe700 1 --2- 172.21.15.146:0/1871901423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffac0131a00 0x7ffac011c940 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ffab800efc0 tx=0x7ffab800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:13.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.439+0000 7ffab77fe700 1 -- 172.21.15.146:0/1871901423 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab8003c20 con 0x7ffac0131a00 2023-10-03T10:15:13.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.439+0000 7ffab77fe700 1 -- 172.21.15.146:0/1871901423 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab800f040 con 0x7ffac0131a00 2023-10-03T10:15:13.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.439+0000 7ffab77fe700 1 -- 172.21.15.146:0/1871901423 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab800c930 con 0x7ffac0131a00 2023-10-03T10:15:13.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.440+0000 7f472cff9700 1 -- 172.21.15.146:0/518024445 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4720011b80 con 0x7f47300a08e0 2023-10-03T10:15:13.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.440+0000 7ffac5329700 1 -- 172.21.15.146:0/1871901423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac011f6c0 con 0x7ffac0131a00 2023-10-03T10:15:13.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.440+0000 7ffac5329700 1 -- 172.21.15.146:0/1871901423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac0071ce0 con 0x7ffac0131a00 2023-10-03T10:15:13.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.441+0000 7ffac5329700 1 -- 172.21.15.146:0/1871901423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac004f2a0 con 0x7ffac0131a00 2023-10-03T10:15:13.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.441+0000 7ffab77fe700 1 -- 172.21.15.146:0/1871901423 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffab800ca90 con 0x7ffac0131a00 2023-10-03T10:15:13.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.441+0000 7ffab77fe700 1 -- 172.21.15.146:0/1871901423 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffab803fc40 con 0x7ffac0131a00 2023-10-03T10:15:13.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.444+0000 7fd4d90a5700 1 Processor -- start 2023-10-03T10:15:13.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.444+0000 7fd4d90a5700 1 -- start start 2023-10-03T10:15:13.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.444+0000 7fd4d90a5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4d4138040 0x7fd4d4138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.444+0000 7fd4d90a5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4d40a08e0 0x7fd4d40a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.444+0000 7fd4d90a5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd4d40a1230 0x7fd4d413ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.444+0000 7fd4d90a5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d40a2100 con 0x7fd4d40a1230 2023-10-03T10:15:13.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.444+0000 7fd4d90a5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d4138950 con 0x7fd4d4138040 2023-10-03T10:15:13.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.444+0000 7fd4d90a5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d41379e0 con 0x7fd4d40a08e0 2023-10-03T10:15:13.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.444+0000 7fd4d259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4d40a08e0 0x7fd4d40a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.445+0000 7fd4d259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4d40a08e0 0x7fd4d40a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38968/0 (socket says 172.21.15.146:38968) 2023-10-03T10:15:13.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.445+0000 7fd4d259c700 1 -- 172.21.15.146:0/123461934 learned_addr learned my addr 172.21.15.146:0/123461934 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:13.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.445+0000 7fd4d2d9d700 1 --2- 172.21.15.146:0/123461934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4d4138040 0x7fd4d4138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.445+0000 7fd4d259c700 1 -- 172.21.15.146:0/123461934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4d4138040 msgr2=0x7fd4d4138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:13.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.445+0000 7fd4d259c700 1 --2- 172.21.15.146:0/123461934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4d4138040 0x7fd4d4138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.445+0000 7fd4d259c700 1 -- 172.21.15.146:0/123461934 >> v2:172.21.15.146:3300/0 conn(0x7fd4d40a1230 msgr2=0x7fd4d413ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:13.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.445+0000 7fd4d259c700 1 --2- 172.21.15.146:0/123461934 >> v2:172.21.15.146:3300/0 conn(0x7fd4d40a1230 0x7fd4d413ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.445+0000 7fd4d259c700 1 -- 172.21.15.146:0/123461934 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d409b9b0 con 0x7fd4d40a08e0 2023-10-03T10:15:13.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.445+0000 7fd4d2d9d700 1 --2- 172.21.15.146:0/123461934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4d4138040 0x7fd4d4138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:13.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.445+0000 7fd4d259c700 1 --2- 172.21.15.146:0/123461934 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4d40a08e0 0x7fd4d40a0cf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8009950 tx=0x7fd4c8009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aa2ea9ab1258f31 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:13.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.445+0000 7fd4d1d9b700 1 -- 172.21.15.146:0/123461934 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c8009ea0 con 0x7fd4d40a08e0 2023-10-03T10:15:13.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.445+0000 7fd4d1d9b700 1 -- 172.21.15.146:0/123461934 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c800b9e0 con 0x7fd4d40a08e0 2023-10-03T10:15:13.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.445+0000 7fd4d1d9b700 1 -- 172.21.15.146:0/123461934 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c800bd70 con 0x7fd4d40a08e0 2023-10-03T10:15:13.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.446+0000 7fd4d90a5700 1 -- 172.21.15.146:0/123461934 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4d40a08e0 msgr2=0x7fd4d40a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.446+0000 7fd4d90a5700 1 --2- 172.21.15.146:0/123461934 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4d40a08e0 0x7fd4d40a0cf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8009950 tx=0x7fd4c8009c60 comp rx=0 tx=0).stop 2023-10-03T10:15:13.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.446+0000 7fd4d90a5700 1 -- 172.21.15.146:0/123461934 shutdown_connections 2023-10-03T10:15:13.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.446+0000 7fd4d90a5700 1 --2- 172.21.15.146:0/123461934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4d4138040 0x7fd4d4138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.446+0000 7fd4d90a5700 1 --2- 172.21.15.146:0/123461934 >> v2:172.21.15.146:3300/0 conn(0x7fd4d40a1230 0x7fd4d413ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.446+0000 7fd4d90a5700 1 --2- 172.21.15.146:0/123461934 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4d40a08e0 0x7fd4d40a0cf0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.446+0000 7fd4d90a5700 1 -- 172.21.15.146:0/123461934 >> 172.21.15.146:0/123461934 conn(0x7fd4d40a2980 msgr2=0x7fd4d40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:13.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.446+0000 7fd4d90a5700 1 -- 172.21.15.146:0/123461934 shutdown_connections 2023-10-03T10:15:13.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.446+0000 7fd4d90a5700 1 -- 172.21.15.146:0/123461934 wait complete. 2023-10-03T10:15:13.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.446+0000 7ffab77fe700 1 -- 172.21.15.146:0/1871901423 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffab801c770 con 0x7ffac0131a00 2023-10-03T10:15:13.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.447+0000 7fd4d90a5700 1 Processor -- start 2023-10-03T10:15:13.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.451+0000 7fd4d90a5700 1 -- start start 2023-10-03T10:15:13.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.451+0000 7fd4d90a5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4d40a08e0 0x7fd4d41d5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.451+0000 7fd4d90a5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4d40a1230 0x7fd4d41d5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.451+0000 7fd4d90a5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4d4138040 0x7fd4d4118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.451+0000 7fd4d90a5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d411aed0 con 0x7fd4d4138040 2023-10-03T10:15:13.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.451+0000 7fd4d90a5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d4134210 con 0x7fd4d40a1230 2023-10-03T10:15:13.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.451+0000 7fd4d90a5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d411b0b0 con 0x7fd4d40a08e0 2023-10-03T10:15:13.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.452+0000 7fd4d359e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4d4138040 0x7fd4d4118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.452+0000 7fd4d359e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4d4138040 0x7fd4d4118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35618/0 (socket says 172.21.15.146:35618) 2023-10-03T10:15:13.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.452+0000 7fd4d359e700 1 -- 172.21.15.146:0/3949023538 learned_addr learned my addr 172.21.15.146:0/3949023538 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:13.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.452+0000 7fd4d259c700 1 --2- 172.21.15.146:0/3949023538 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4d40a1230 0x7fd4d41d5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.452+0000 7fd4d2d9d700 1 --2- 172.21.15.146:0/3949023538 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4d40a08e0 0x7fd4d41d5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.452+0000 7fd4d359e700 1 -- 172.21.15.146:0/3949023538 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4d40a08e0 msgr2=0x7fd4d41d5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.452+0000 7fd4d359e700 1 --2- 172.21.15.146:0/3949023538 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4d40a08e0 0x7fd4d41d5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.452+0000 7fd4d359e700 1 -- 172.21.15.146:0/3949023538 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4d40a1230 msgr2=0x7fd4d41d5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.452+0000 7fd4d359e700 1 --2- 172.21.15.146:0/3949023538 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4d40a1230 0x7fd4d41d5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.452+0000 7fd4d359e700 1 -- 172.21.15.146:0/3949023538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c8009550 con 0x7fd4d4138040 2023-10-03T10:15:13.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.452+0000 7fd4d359e700 1 --2- 172.21.15.146:0/3949023538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4d4138040 0x7fd4d4118df0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc00b9a0 tx=0x7fd4cc00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:13.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.452+0000 7fd4bb7fe700 1 -- 172.21.15.146:0/3949023538 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc00c930 con 0x7fd4d4138040 2023-10-03T10:15:13.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.452+0000 7fd4bb7fe700 1 -- 172.21.15.146:0/3949023538 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc00cab0 con 0x7fd4d4138040 2023-10-03T10:15:13.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.452+0000 7fd4bb7fe700 1 -- 172.21.15.146:0/3949023538 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc00ce60 con 0x7fd4d4138040 2023-10-03T10:15:13.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.453+0000 7fd4d90a5700 1 -- 172.21.15.146:0/3949023538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d409c690 con 0x7fd4d4138040 2023-10-03T10:15:13.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.453+0000 7fd4d90a5700 1 -- 172.21.15.146:0/3949023538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d4119e70 con 0x7fd4d4138040 2023-10-03T10:15:13.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.454+0000 7fd4bb7fe700 1 -- 172.21.15.146:0/3949023538 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd4cc014440 con 0x7fd4d4138040 2023-10-03T10:15:13.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.454+0000 7fd4bb7fe700 1 -- 172.21.15.146:0/3949023538 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd4cc03f410 con 0x7fd4d4138040 2023-10-03T10:15:13.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.455+0000 7fd4d90a5700 1 -- 172.21.15.146:0/3949023538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d41d4f70 con 0x7fd4d4138040 2023-10-03T10:15:13.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.459+0000 7fd4bb7fe700 1 -- 172.21.15.146:0/3949023538 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd4cc0133a0 con 0x7fd4d4138040 2023-10-03T10:15:13.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.615+0000 7fae6b0c8700 1 -- 172.21.15.146:0/3836231879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fae6404f2a0 con 0x7fae6409edb0 2023-10-03T10:15:13.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.616+0000 7fae617fa700 1 -- 172.21.15.146:0/3836231879 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fae50017030 con 0x7fae6409edb0 2023-10-03T10:15:13.616 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:13.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.618+0000 7fae6b0c8700 1 -- 172.21.15.146:0/3836231879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae6409edb0 msgr2=0x7fae64122cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.618+0000 7fae6b0c8700 1 --2- 172.21.15.146:0/3836231879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae6409edb0 0x7fae64122cc0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fae5000c4b0 tx=0x7fae5000c7c0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.618+0000 7fae6b0c8700 1 -- 172.21.15.146:0/3836231879 shutdown_connections 2023-10-03T10:15:13.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.618+0000 7fae6b0c8700 1 --2- 172.21.15.146:0/3836231879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae6409f1a0 0x7fae64123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.618+0000 7fae6b0c8700 1 --2- 172.21.15.146:0/3836231879 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae6409a150 0x7fae64122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.618+0000 7fae6b0c8700 1 --2- 172.21.15.146:0/3836231879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae6409edb0 0x7fae64122cc0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.618+0000 7fae6b0c8700 1 -- 172.21.15.146:0/3836231879 >> 172.21.15.146:0/3836231879 conn(0x7fae640a4430 msgr2=0x7fae64071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:13.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.619+0000 7fae6b0c8700 1 -- 172.21.15.146:0/3836231879 shutdown_connections 2023-10-03T10:15:13.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.620+0000 7fae6b0c8700 1 -- 172.21.15.146:0/3836231879 wait complete. 2023-10-03T10:15:13.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:13.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.644+0000 7ffac5329700 1 -- 172.21.15.146:0/1871901423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffac011fa60 con 0x7ffac0131a00 2023-10-03T10:15:13.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.644+0000 7ffab77fe700 1 -- 172.21.15.146:0/1871901423 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffab80073f0 con 0x7ffac0131a00 2023-10-03T10:15:13.645 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:13.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.646+0000 7ffac5329700 1 -- 172.21.15.146:0/1871901423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffac0131a00 msgr2=0x7ffac011c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.646+0000 7ffac5329700 1 --2- 172.21.15.146:0/1871901423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffac0131a00 0x7ffac011c940 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ffab800efc0 tx=0x7ffab800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.647+0000 7ffac5329700 1 -- 172.21.15.146:0/1871901423 shutdown_connections 2023-10-03T10:15:13.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.647+0000 7ffac5329700 1 --2- 172.21.15.146:0/1871901423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffac0131a00 0x7ffac011c940 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.647+0000 7ffac5329700 1 --2- 172.21.15.146:0/1871901423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffac006a770 0x7ffac011bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.647+0000 7ffac5329700 1 --2- 172.21.15.146:0/1871901423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffac009dec0 0x7ffac011c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.647+0000 7ffac5329700 1 -- 172.21.15.146:0/1871901423 >> 172.21.15.146:0/1871901423 conn(0x7ffac0099c40 msgr2=0x7ffac01b8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:13.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.647+0000 7ffac5329700 1 -- 172.21.15.146:0/1871901423 shutdown_connections 2023-10-03T10:15:13.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.647+0000 7ffac5329700 1 -- 172.21.15.146:0/1871901423 wait complete. 2023-10-03T10:15:13.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:13.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.680+0000 7f473629b700 1 -- 172.21.15.146:0/518024445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4730129fa0 con 0x7f47300a08e0 2023-10-03T10:15:13.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.680+0000 7f472cff9700 1 -- 172.21.15.146:0/518024445 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4720021020 con 0x7f47300a08e0 2023-10-03T10:15:13.681 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:13.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.682+0000 7f473629b700 1 -- 172.21.15.146:0/518024445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47300a08e0 msgr2=0x7f47301263c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.682+0000 7f473629b700 1 --2- 172.21.15.146:0/518024445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47300a08e0 0x7f47301263c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4720006fd0 tx=0x7f472000eb20 comp rx=0 tx=0).stop 2023-10-03T10:15:13.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.683+0000 7f473629b700 1 -- 172.21.15.146:0/518024445 shutdown_connections 2023-10-03T10:15:13.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.683+0000 7f473629b700 1 --2- 172.21.15.146:0/518024445 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4730138040 0x7f4730126e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.683+0000 7f473629b700 1 --2- 172.21.15.146:0/518024445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47300a08e0 0x7f47301263c0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.683+0000 7f473629b700 1 --2- 172.21.15.146:0/518024445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47300a1230 0x7f4730126900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.683+0000 7f473629b700 1 -- 172.21.15.146:0/518024445 >> 172.21.15.146:0/518024445 conn(0x7f47300a2980 msgr2=0x7f473009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:13.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.683+0000 7f473629b700 1 -- 172.21.15.146:0/518024445 shutdown_connections 2023-10-03T10:15:13.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.683+0000 7f473629b700 1 -- 172.21.15.146:0/518024445 wait complete. 2023-10-03T10:15:13.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:13.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.698+0000 7fd4d90a5700 1 -- 172.21.15.146:0/3949023538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd4d411b1f0 con 0x7fd4d4138040 2023-10-03T10:15:13.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.698+0000 7fd4bb7fe700 1 -- 172.21.15.146:0/3949023538 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd4d411b1f0 con 0x7fd4d4138040 2023-10-03T10:15:13.699 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:13.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.700+0000 7fd4d90a5700 1 -- 172.21.15.146:0/3949023538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4d4138040 msgr2=0x7fd4d4118df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.700+0000 7fd4d90a5700 1 --2- 172.21.15.146:0/3949023538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4d4138040 0x7fd4d4118df0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc00b9a0 tx=0x7fd4cc00bcb0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.700+0000 7fd4d90a5700 1 -- 172.21.15.146:0/3949023538 shutdown_connections 2023-10-03T10:15:13.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.700+0000 7fd4d90a5700 1 --2- 172.21.15.146:0/3949023538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4d4138040 0x7fd4d4118df0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.700+0000 7fd4d90a5700 1 --2- 172.21.15.146:0/3949023538 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4d40a08e0 0x7fd4d41d5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.700+0000 7fd4d90a5700 1 --2- 172.21.15.146:0/3949023538 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4d40a1230 0x7fd4d41d5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.700+0000 7fd4d90a5700 1 -- 172.21.15.146:0/3949023538 >> 172.21.15.146:0/3949023538 conn(0x7fd4d40a2980 msgr2=0x7fd4d409e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:13.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.700+0000 7fd4d90a5700 1 -- 172.21.15.146:0/3949023538 shutdown_connections 2023-10-03T10:15:13.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:13.700+0000 7fd4d90a5700 1 -- 172.21.15.146:0/3949023538 wait complete. 2023-10-03T10:15:13.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:14.635 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:14.660 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:14.696 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:14.713 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:14.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.773+0000 7f0f6988b700 1 Processor -- start 2023-10-03T10:15:14.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.773+0000 7f0f6988b700 1 -- start start 2023-10-03T10:15:14.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.774+0000 7f0f6988b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f64131a80 0x7f0f64131e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.774+0000 7f0f6988b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f6409c7d0 0x7f0f64139780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.774+0000 7f0f6988b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f640a23a0 con 0x7f0f6409bc70 2023-10-03T10:15:14.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.774+0000 7f0f6988b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f64131440 con 0x7f0f64131a80 2023-10-03T10:15:14.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.774+0000 7f0f6988b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f64132390 con 0x7f0f6409c7d0 2023-10-03T10:15:14.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.774+0000 7f0f627fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0f6409bc70 0x7f0f6409c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60248/0 (socket says 172.21.15.146:60248) 2023-10-03T10:15:14.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.774+0000 7f0f627fc700 1 -- 172.21.15.146:0/2104541419 learned_addr learned my addr 172.21.15.146:0/2104541419 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:14.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.774+0000 7f0f637fe700 1 --2- 172.21.15.146:0/2104541419 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f6409c7d0 0x7f0f64139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.774+0000 7f0f62ffd700 1 --2- 172.21.15.146:0/2104541419 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f64131a80 0x7f0f64131e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.774+0000 7f0f637fe700 1 -- 172.21.15.146:0/2104541419 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f64131a80 msgr2=0x7f0f64131e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.774+0000 7f0f637fe700 1 --2- 172.21.15.146:0/2104541419 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f64131a80 0x7f0f64131e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.774+0000 7f0f637fe700 1 -- 172.21.15.146:0/2104541419 >> v1:172.21.15.146:6789/0 conn(0x7f0f6409bc70 legacy=0x7f0f6409c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.774+0000 7f0f61ffb700 1 -- 172.21.15.146:0/2104541419 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063276036 0 0) 0x7f0f640a23a0 con 0x7f0f6409bc70 2023-10-03T10:15:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.774+0000 7f0f637fe700 1 -- 172.21.15.146:0/2104541419 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6406eaa0 con 0x7f0f6409c7d0 2023-10-03T10:15:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.774+0000 7f0f62ffd700 1 --2- 172.21.15.146:0/2104541419 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f64131a80 0x7f0f64131e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.775+0000 7f0f637fe700 1 --2- 172.21.15.146:0/2104541419 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f6409c7d0 0x7f0f64139780 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009dc0 tx=0x7f0f5c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a78ce80d897cb575 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.775+0000 7f0f61ffb700 1 -- 172.21.15.146:0/2104541419 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00e070 con 0x7f0f6409c7d0 2023-10-03T10:15:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.775+0000 7f0f61ffb700 1 -- 172.21.15.146:0/2104541419 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c00bb20 con 0x7f0f6409c7d0 2023-10-03T10:15:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.775+0000 7f0f61ffb700 1 -- 172.21.15.146:0/2104541419 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c012430 con 0x7f0f6409c7d0 2023-10-03T10:15:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.776+0000 7f0f6988b700 1 -- 172.21.15.146:0/2104541419 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f6409c7d0 msgr2=0x7f0f64139780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.776+0000 7f0f6988b700 1 --2- 172.21.15.146:0/2104541419 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f6409c7d0 0x7f0f64139780 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009dc0 tx=0x7f0f5c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.776+0000 7f0f6988b700 1 -- 172.21.15.146:0/2104541419 shutdown_connections 2023-10-03T10:15:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.776+0000 7f0f6988b700 1 --2- 172.21.15.146:0/2104541419 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f6409c7d0 0x7f0f64139780 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.776+0000 7f0f6988b700 1 --2- 172.21.15.146:0/2104541419 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f64131a80 0x7f0f64131e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.776+0000 7f0f6988b700 1 -- 172.21.15.146:0/2104541419 >> 172.21.15.146:0/2104541419 conn(0x7f0f640a2980 msgr2=0x7f0f640a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.776+0000 7f0f6988b700 1 -- 172.21.15.146:0/2104541419 shutdown_connections 2023-10-03T10:15:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.776+0000 7f0f6988b700 1 -- 172.21.15.146:0/2104541419 wait complete. 2023-10-03T10:15:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.777+0000 7f0f6988b700 1 Processor -- start 2023-10-03T10:15:14.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.778+0000 7f0f6988b700 1 -- start start 2023-10-03T10:15:14.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.778+0000 7f0f6988b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f6409bc70 0x7f0f641c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.778+0000 7f0f6988b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f6409c7d0 0x7f0f641c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.778+0000 7f0f6988b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f64131a80 0x7f0f641c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.778+0000 7f0f6988b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6412ddd0 con 0x7f0f6409bc70 2023-10-03T10:15:14.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.778+0000 7f0f6988b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6412d6d0 con 0x7f0f64131a80 2023-10-03T10:15:14.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.778+0000 7f0f6988b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6412ebb0 con 0x7f0f6409c7d0 2023-10-03T10:15:14.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.778+0000 7f0f637fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f64131a80 0x7f0f641c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.778+0000 7f0f637fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f64131a80 0x7f0f641c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43998/0 (socket says 172.21.15.146:43998) 2023-10-03T10:15:14.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.778+0000 7f0f637fe700 1 -- 172.21.15.146:0/1379130307 learned_addr learned my addr 172.21.15.146:0/1379130307 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:14.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.778+0000 7f0f62ffd700 1 --2- 172.21.15.146:0/1379130307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f6409bc70 0x7f0f641c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.779+0000 7f0f627fc700 1 --2- 172.21.15.146:0/1379130307 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f6409c7d0 0x7f0f641c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.779+0000 7f0f62ffd700 1 -- 172.21.15.146:0/1379130307 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f6409c7d0 msgr2=0x7f0f641c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.779+0000 7f0f62ffd700 1 --2- 172.21.15.146:0/1379130307 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f6409c7d0 0x7f0f641c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.779+0000 7f0f62ffd700 1 -- 172.21.15.146:0/1379130307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f64131a80 msgr2=0x7f0f641c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.779+0000 7f0f62ffd700 1 --2- 172.21.15.146:0/1379130307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f64131a80 0x7f0f641c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.779+0000 7f0f62ffd700 1 -- 172.21.15.146:0/1379130307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f54009430 con 0x7f0f6409bc70 2023-10-03T10:15:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.779+0000 7f0f62ffd700 1 --2- 172.21.15.146:0/1379130307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f6409bc70 0x7f0f641c8220 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400e980 tx=0x7f0f5400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.779+0000 7f0f4bfff700 1 -- 172.21.15.146:0/1379130307 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f54005a20 con 0x7f0f6409bc70 2023-10-03T10:15:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.779+0000 7f0f4bfff700 1 -- 172.21.15.146:0/1379130307 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f54005b80 con 0x7f0f6409bc70 2023-10-03T10:15:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.779+0000 7f0f6988b700 1 -- 172.21.15.146:0/1379130307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5c009a70 con 0x7f0f6409bc70 2023-10-03T10:15:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.779+0000 7f0f4bfff700 1 -- 172.21.15.146:0/1379130307 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5400c690 con 0x7f0f6409bc70 2023-10-03T10:15:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.779+0000 7f0f6988b700 1 -- 172.21.15.146:0/1379130307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f64130c80 con 0x7f0f6409bc70 2023-10-03T10:15:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.780+0000 7f0f4bfff700 1 -- 172.21.15.146:0/1379130307 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f5400c7f0 con 0x7f0f6409bc70 2023-10-03T10:15:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.780+0000 7f0f6988b700 1 -- 172.21.15.146:0/1379130307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6412d130 con 0x7f0f6409bc70 2023-10-03T10:15:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.781+0000 7f0f4bfff700 1 -- 172.21.15.146:0/1379130307 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0f5403f820 con 0x7f0f6409bc70 2023-10-03T10:15:14.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.785+0000 7f0f4bfff700 1 -- 172.21.15.146:0/1379130307 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f54006030 con 0x7f0f6409bc70 2023-10-03T10:15:14.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.813+0000 7fe1ec09f700 1 Processor -- start 2023-10-03T10:15:14.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.814+0000 7fe1ec09f700 1 -- start start 2023-10-03T10:15:14.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.814+0000 7fe1ec09f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1e4133900 0x7fe1e4133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.814+0000 7fe1ec09f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe1e4134210 0x7fe1e40a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.814+0000 7fe1ec09f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e40a0ee0 0x7fe1e40a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.814+0000 7fe1ec09f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e409a760 con 0x7fe1e4134210 2023-10-03T10:15:14.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.814+0000 7fe1ec09f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e41336e0 con 0x7fe1e40a0ee0 2023-10-03T10:15:14.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.814+0000 7fe1ec09f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e409a080 con 0x7fe1e4133900 2023-10-03T10:15:14.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.814+0000 7fe1ea63c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e40a0ee0 0x7fe1e40a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.814+0000 7fe1e963a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe1e4134210 0x7fe1e40a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.814+0000 7fe1e963a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe1e4134210 0x7fe1e40a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41258/0 (socket says 172.21.15.146:41258) 2023-10-03T10:15:14.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.814+0000 7fe1e963a700 1 -- 172.21.15.146:0/1499288678 learned_addr learned my addr 172.21.15.146:0/1499288678 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:14.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.814+0000 7fe1ea63c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e40a0ee0 0x7fe1e40a1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44002/0 (socket says 172.21.15.146:44002) 2023-10-03T10:15:14.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.815+0000 7fe1e9e3b700 1 --2- 172.21.15.146:0/1499288678 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1e4133900 0x7fe1e4133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.815+0000 7fe1ea63c700 1 -- 172.21.15.146:0/1499288678 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1e4133900 msgr2=0x7fe1e4133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.815+0000 7fe1ea63c700 1 --2- 172.21.15.146:0/1499288678 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1e4133900 0x7fe1e4133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.815+0000 7fe1ea63c700 1 -- 172.21.15.146:0/1499288678 >> v2:172.21.15.146:3300/0 conn(0x7fe1e4134210 msgr2=0x7fe1e40a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.815+0000 7fe1ea63c700 1 --2- 172.21.15.146:0/1499288678 >> v2:172.21.15.146:3300/0 conn(0x7fe1e4134210 0x7fe1e40a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.815+0000 7fe1ea63c700 1 -- 172.21.15.146:0/1499288678 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e40a23e0 con 0x7fe1e40a0ee0 2023-10-03T10:15:14.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.815+0000 7fe1ea63c700 1 --2- 172.21.15.146:0/1499288678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e40a0ee0 0x7fe1e40a1360 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009d90 tx=0x7fe1dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=618596cf8ccb72c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.815+0000 7fe1e8e39700 1 -- 172.21.15.146:0/1499288678 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc00e070 con 0x7fe1e40a0ee0 2023-10-03T10:15:14.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.815+0000 7fe1e8e39700 1 -- 172.21.15.146:0/1499288678 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc00bb20 con 0x7fe1e40a0ee0 2023-10-03T10:15:14.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.815+0000 7fe1e8e39700 1 -- 172.21.15.146:0/1499288678 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc012430 con 0x7fe1e40a0ee0 2023-10-03T10:15:14.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.816+0000 7fe1ec09f700 1 -- 172.21.15.146:0/1499288678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e40a0ee0 msgr2=0x7fe1e40a1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.816+0000 7fe1ec09f700 1 --2- 172.21.15.146:0/1499288678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e40a0ee0 0x7fe1e40a1360 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009d90 tx=0x7fe1dc00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:14.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.816+0000 7fe1ec09f700 1 -- 172.21.15.146:0/1499288678 shutdown_connections 2023-10-03T10:15:14.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.816+0000 7fe1ec09f700 1 --2- 172.21.15.146:0/1499288678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e40a0ee0 0x7fe1e40a1360 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.816+0000 7fe1ec09f700 1 --2- 172.21.15.146:0/1499288678 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1e4133900 0x7fe1e4133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.816+0000 7fe1ec09f700 1 --2- 172.21.15.146:0/1499288678 >> v2:172.21.15.146:3300/0 conn(0x7fe1e4134210 0x7fe1e40a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.816+0000 7fe1ec09f700 1 -- 172.21.15.146:0/1499288678 >> 172.21.15.146:0/1499288678 conn(0x7fe1e40a2980 msgr2=0x7fe1e40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.816+0000 7fe1ec09f700 1 -- 172.21.15.146:0/1499288678 shutdown_connections 2023-10-03T10:15:14.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.816+0000 7fe1ec09f700 1 -- 172.21.15.146:0/1499288678 wait complete. 2023-10-03T10:15:14.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.817+0000 7fe1ec09f700 1 Processor -- start 2023-10-03T10:15:14.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.817+0000 7fe1ec09f700 1 -- start start 2023-10-03T10:15:14.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.818+0000 7fe1ec09f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e40a0ee0 0x7fe1e406e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.818+0000 7fe1ec09f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e4133900 0x7fe1e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.818+0000 7fe1ec09f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1e4134210 0x7fe1e406ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.818+0000 7fe1ec09f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4071800 con 0x7fe1e4133900 2023-10-03T10:15:14.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.818+0000 7fe1ec09f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e409a2c0 con 0x7fe1e40a0ee0 2023-10-03T10:15:14.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.818+0000 7fe1ec09f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4126020 con 0x7fe1e4134210 2023-10-03T10:15:14.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.818+0000 7fe1e9e3b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e40a0ee0 0x7fe1e406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.818+0000 7fe1e9e3b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e40a0ee0 0x7fe1e406e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44008/0 (socket says 172.21.15.146:44008) 2023-10-03T10:15:14.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.818+0000 7fe1e9e3b700 1 -- 172.21.15.146:0/2201344515 learned_addr learned my addr 172.21.15.146:0/2201344515 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:14.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.818+0000 7fe1e963a700 1 --2- 172.21.15.146:0/2201344515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e4133900 0x7fe1e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.818+0000 7fe1ea63c700 1 --2- 172.21.15.146:0/2201344515 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1e4134210 0x7fe1e406ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.818+0000 7fe1e9e3b700 1 -- 172.21.15.146:0/2201344515 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1e4134210 msgr2=0x7fe1e406ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.818+0000 7fe1e9e3b700 1 --2- 172.21.15.146:0/2201344515 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1e4134210 0x7fe1e406ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.818+0000 7fe1e9e3b700 1 -- 172.21.15.146:0/2201344515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e4133900 msgr2=0x7fe1e406e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.818+0000 7fe1e9e3b700 1 --2- 172.21.15.146:0/2201344515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e4133900 0x7fe1e406e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.818+0000 7fe1e9e3b700 1 -- 172.21.15.146:0/2201344515 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1dc009a70 con 0x7fe1e40a0ee0 2023-10-03T10:15:14.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.818+0000 7fe1ea63c700 1 --2- 172.21.15.146:0/2201344515 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1e4134210 0x7fe1e406ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:14.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.819+0000 7fe1e9e3b700 1 --2- 172.21.15.146:0/2201344515 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e40a0ee0 0x7fe1e406e230 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000e9f0 tx=0x7fe1e000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.819+0000 7fe1da7fc700 1 -- 172.21.15.146:0/2201344515 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e00096f0 con 0x7fe1e40a0ee0 2023-10-03T10:15:14.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.819+0000 7fe1da7fc700 1 -- 172.21.15.146:0/2201344515 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e000ee90 con 0x7fe1e40a0ee0 2023-10-03T10:15:14.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.819+0000 7fe1ec09f700 1 -- 172.21.15.146:0/2201344515 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e40a30d0 con 0x7fe1e40a0ee0 2023-10-03T10:15:14.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.819+0000 7fe1da7fc700 1 -- 172.21.15.146:0/2201344515 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e000ca50 con 0x7fe1e40a0ee0 2023-10-03T10:15:14.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.819+0000 7fe1ec09f700 1 -- 172.21.15.146:0/2201344515 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e406f1f0 con 0x7fe1e40a0ee0 2023-10-03T10:15:14.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.820+0000 7fe1da7fc700 1 -- 172.21.15.146:0/2201344515 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe1e000cbb0 con 0x7fe1e40a0ee0 2023-10-03T10:15:14.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.820+0000 7fe1da7fc700 1 -- 172.21.15.146:0/2201344515 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe1e003fb50 con 0x7fe1e40a0ee0 2023-10-03T10:15:14.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.820+0000 7fe1ec09f700 1 -- 172.21.15.146:0/2201344515 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e4071940 con 0x7fe1e40a0ee0 2023-10-03T10:15:14.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.825+0000 7fe1da7fc700 1 -- 172.21.15.146:0/2201344515 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe1e4071940 con 0x7fe1e40a0ee0 2023-10-03T10:15:14.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.856+0000 7f55e3d2f700 1 Processor -- start 2023-10-03T10:15:14.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.856+0000 7f55e3d2f700 1 -- start start 2023-10-03T10:15:14.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.857+0000 7f55e3d2f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55dc09e950 0x7f55dc09ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.857+0000 7f55e3d2f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55dc09f260 0x7f55dc131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.857+0000 7f55e3d2f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f55dc131dd0 0x7f55dc132250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.857+0000 7f55e3d2f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55dc09b6d0 con 0x7f55dc131dd0 2023-10-03T10:15:14.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.857+0000 7f55e3d2f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc09afb0 con 0x7f55dc09e950 2023-10-03T10:15:14.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.857+0000 7f55e3d2f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc0a0970 con 0x7f55dc09f260 2023-10-03T10:15:14.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.857+0000 7f55e1acb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55dc09e950 0x7f55dc09ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.857+0000 7f55e12ca700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55dc09f260 0x7f55dc131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.857+0000 7f55e12ca700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55dc09f260 0x7f55dc131890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58420/0 (socket says 172.21.15.146:58420) 2023-10-03T10:15:14.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.857+0000 7f55e1acb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55dc09e950 0x7f55dc09ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44024/0 (socket says 172.21.15.146:44024) 2023-10-03T10:15:14.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.857+0000 7f55e12ca700 1 -- 172.21.15.146:0/1066791155 learned_addr learned my addr 172.21.15.146:0/1066791155 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:14.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.857+0000 7f55e22cc700 1 --2- 172.21.15.146:0/1066791155 >> v2:172.21.15.146:3300/0 conn(0x7f55dc131dd0 0x7f55dc132250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.857+0000 7f55e12ca700 1 -- 172.21.15.146:0/1066791155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55dc09e950 msgr2=0x7f55dc09ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.857+0000 7f55e12ca700 1 --2- 172.21.15.146:0/1066791155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55dc09e950 0x7f55dc09ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.857+0000 7f55e12ca700 1 -- 172.21.15.146:0/1066791155 >> v2:172.21.15.146:3300/0 conn(0x7f55dc131dd0 msgr2=0x7f55dc132250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.857+0000 7f55e12ca700 1 --2- 172.21.15.146:0/1066791155 >> v2:172.21.15.146:3300/0 conn(0x7f55dc131dd0 0x7f55dc132250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.857+0000 7f55e12ca700 1 -- 172.21.15.146:0/1066791155 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc0a0320 con 0x7f55dc09f260 2023-10-03T10:15:14.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.857+0000 7f55e1acb700 1 --2- 172.21.15.146:0/1066791155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55dc09e950 0x7f55dc09ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:14.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.857+0000 7f55e12ca700 1 --2- 172.21.15.146:0/1066791155 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55dc09f260 0x7f55dc131890 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00dd10 tx=0x7f55cc00f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fc8020068d82e14 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.858+0000 7f55e0ac9700 1 -- 172.21.15.146:0/1066791155 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc012070 con 0x7f55dc09f260 2023-10-03T10:15:14.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.858+0000 7f55e0ac9700 1 -- 172.21.15.146:0/1066791155 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55cc00d2e0 con 0x7f55dc09f260 2023-10-03T10:15:14.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.858+0000 7f55e0ac9700 1 -- 172.21.15.146:0/1066791155 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc00fb10 con 0x7f55dc09f260 2023-10-03T10:15:14.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.858+0000 7f55e3d2f700 1 -- 172.21.15.146:0/1066791155 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55dc09f260 msgr2=0x7f55dc131890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.858+0000 7f55e3d2f700 1 --2- 172.21.15.146:0/1066791155 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55dc09f260 0x7f55dc131890 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00dd10 tx=0x7f55cc00f330 comp rx=0 tx=0).stop 2023-10-03T10:15:14.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.858+0000 7f55e3d2f700 1 -- 172.21.15.146:0/1066791155 shutdown_connections 2023-10-03T10:15:14.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.858+0000 7f55e3d2f700 1 --2- 172.21.15.146:0/1066791155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55dc09e950 0x7f55dc09ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.858+0000 7f55e3d2f700 1 --2- 172.21.15.146:0/1066791155 >> v2:172.21.15.146:3300/0 conn(0x7f55dc131dd0 0x7f55dc132250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.858+0000 7f55e3d2f700 1 --2- 172.21.15.146:0/1066791155 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55dc09f260 0x7f55dc131890 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.858+0000 7f55e3d2f700 1 -- 172.21.15.146:0/1066791155 >> 172.21.15.146:0/1066791155 conn(0x7f55dc0a0f70 msgr2=0x7f55dc0a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.858+0000 7f55e3d2f700 1 -- 172.21.15.146:0/1066791155 shutdown_connections 2023-10-03T10:15:14.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.858+0000 7f55e3d2f700 1 -- 172.21.15.146:0/1066791155 wait complete. 2023-10-03T10:15:14.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.860+0000 7f55e3d2f700 1 Processor -- start 2023-10-03T10:15:14.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.860+0000 7f55e3d2f700 1 -- start start 2023-10-03T10:15:14.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.861+0000 7f55e3d2f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55dc09e950 0x7f55dc11c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.861+0000 7f55e3d2f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55dc09f260 0x7f55dc11c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.861+0000 7f55e3d2f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55dc131dd0 0x7f55dc11cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.861+0000 7f55e3d2f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc11dd80 con 0x7f55dc09f260 2023-10-03T10:15:14.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.861+0000 7f55e3d2f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc11e3a0 con 0x7f55dc09e950 2023-10-03T10:15:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.861+0000 7f55e3d2f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc11efd0 con 0x7f55dc131dd0 2023-10-03T10:15:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.861+0000 7f55e1acb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55dc09e950 0x7f55dc11c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.861+0000 7f55e1acb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55dc09e950 0x7f55dc11c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44028/0 (socket says 172.21.15.146:44028) 2023-10-03T10:15:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.861+0000 7f55e1acb700 1 -- 172.21.15.146:0/1263018322 learned_addr learned my addr 172.21.15.146:0/1263018322 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.861+0000 7f55e22cc700 1 --2- 172.21.15.146:0/1263018322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55dc131dd0 0x7f55dc11cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.861+0000 7f55e12ca700 1 --2- 172.21.15.146:0/1263018322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55dc09f260 0x7f55dc11c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.861+0000 7f55e1acb700 1 -- 172.21.15.146:0/1263018322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55dc131dd0 msgr2=0x7f55dc11cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.861+0000 7f55e1acb700 1 --2- 172.21.15.146:0/1263018322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55dc131dd0 0x7f55dc11cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.861+0000 7f55e1acb700 1 -- 172.21.15.146:0/1263018322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55dc09f260 msgr2=0x7f55dc11c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.861+0000 7f55e1acb700 1 --2- 172.21.15.146:0/1263018322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55dc09f260 0x7f55dc11c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.861+0000 7f55e1acb700 1 -- 172.21.15.146:0/1263018322 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d8009430 con 0x7f55dc09e950 2023-10-03T10:15:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.861+0000 7f55e1acb700 1 --2- 172.21.15.146:0/1263018322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55dc09e950 0x7f55dc11c170 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f55d800ec10 tx=0x7f55d800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.862+0000 7f55d27fc700 1 -- 172.21.15.146:0/1263018322 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d8005a20 con 0x7f55dc09e950 2023-10-03T10:15:14.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.862+0000 7f55d27fc700 1 -- 172.21.15.146:0/1263018322 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d8005b80 con 0x7f55dc09e950 2023-10-03T10:15:14.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.862+0000 7f55d27fc700 1 -- 172.21.15.146:0/1263018322 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d800c850 con 0x7f55dc09e950 2023-10-03T10:15:14.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.862+0000 7f55e3d2f700 1 -- 172.21.15.146:0/1263018322 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55cc00d9f0 con 0x7f55dc09e950 2023-10-03T10:15:14.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.862+0000 7f55e3d2f700 1 -- 172.21.15.146:0/1263018322 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55dc09d280 con 0x7f55dc09e950 2023-10-03T10:15:14.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.863+0000 7f55e3d2f700 1 -- 172.21.15.146:0/1263018322 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55dc11f910 con 0x7f55dc09e950 2023-10-03T10:15:14.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.864+0000 7f55d27fc700 1 -- 172.21.15.146:0/1263018322 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f55d800c9b0 con 0x7f55dc09e950 2023-10-03T10:15:14.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.864+0000 7f55d27fc700 1 -- 172.21.15.146:0/1263018322 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f55d803fa90 con 0x7f55dc09e950 2023-10-03T10:15:14.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.869+0000 7f55d27fc700 1 -- 172.21.15.146:0/1263018322 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f55d8011b40 con 0x7f55dc09e950 2023-10-03T10:15:14.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.869+0000 7ff9846c3700 1 Processor -- start 2023-10-03T10:15:14.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.869+0000 7ff9846c3700 1 -- start start 2023-10-03T10:15:14.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.870+0000 7ff9846c3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff97c09e870 0x7ff97c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.870+0000 7ff9846c3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff97c131f40 0x7ff97c139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.870+0000 7ff9846c3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff97c09c970 con 0x7ff97c09f180 2023-10-03T10:15:14.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.870+0000 7ff9846c3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff97c0a0920 con 0x7ff97c09e870 2023-10-03T10:15:14.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.870+0000 7ff9846c3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c09f9c0 con 0x7ff97c131f40 2023-10-03T10:15:14.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff98245f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff97c09e870 0x7ff97c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff981c5e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff97c09f180 0x7ff97c131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60250/0 (socket says 172.21.15.146:60250) 2023-10-03T10:15:14.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff981c5e700 1 -- 172.21.15.146:0/2102450632 learned_addr learned my addr 172.21.15.146:0/2102450632 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:14.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff982c60700 1 --2- 172.21.15.146:0/2102450632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff97c131f40 0x7ff97c139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff98145d700 1 -- 172.21.15.146:0/2102450632 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485925986 0 0) 0x7ff97c09c970 con 0x7ff97c09f180 2023-10-03T10:15:14.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff98145d700 1 -- 172.21.15.146:0/2102450632 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9680035b0 con 0x7ff97c09f180 2023-10-03T10:15:14.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff98145d700 1 -- 172.21.15.146:0/2102450632 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 42400182 0 0) 0x7ff9680035b0 con 0x7ff97c09f180 2023-10-03T10:15:14.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff98145d700 1 -- 172.21.15.146:0/2102450632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff97c131f40 msgr2=0x7ff97c139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff98145d700 1 --2- 172.21.15.146:0/2102450632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff97c131f40 0x7ff97c139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff98145d700 1 -- 172.21.15.146:0/2102450632 >> v2:172.21.15.146:3300/0 conn(0x7ff97c09e870 msgr2=0x7ff97c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff98145d700 1 --2- 172.21.15.146:0/2102450632 >> v2:172.21.15.146:3300/0 conn(0x7ff97c09e870 0x7ff97c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff98145d700 1 -- 172.21.15.146:0/2102450632 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c09bab0 con 0x7ff97c09f180 2023-10-03T10:15:14.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff98145d700 1 -- 172.21.15.146:0/2102450632 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2532932501 0 0) 0x7ff96c001670 con 0x7ff97c09f180 2023-10-03T10:15:14.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff98145d700 1 -- 172.21.15.146:0/2102450632 >> v1:172.21.15.146:6789/0 conn(0x7ff97c09f180 legacy=0x7ff97c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff98145d700 1 --2- 172.21.15.146:0/2102450632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff968003a70 0x7ff968003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff98145d700 1 --2- 172.21.15.146:0/2102450632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff97c131f40 0x7ff968004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff98145d700 1 --2- 172.21.15.146:0/2102450632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff968004d90 0x7ff968005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff98145d700 1 -- 172.21.15.146:0/2102450632 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c09f9c0 con 0x7ff968003a70 2023-10-03T10:15:14.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff98145d700 1 -- 172.21.15.146:0/2102450632 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96802da20 con 0x7ff968004d90 2023-10-03T10:15:14.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff98145d700 1 -- 172.21.15.146:0/2102450632 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff96802dbe0 con 0x7ff97c131f40 2023-10-03T10:15:14.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff982c60700 1 --2- 172.21.15.146:0/2102450632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff968004d90 0x7ff968005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff981c5e700 1 --2- 172.21.15.146:0/2102450632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff97c131f40 0x7ff968004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.871+0000 7ff98245f700 1 --2- 172.21.15.146:0/2102450632 >> v2:172.21.15.146:3300/0 conn(0x7ff97c09e870 0x7ff97c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:14.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.872+0000 7ff98245f700 1 --2- 172.21.15.146:0/2102450632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff968003a70 0x7ff968003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.873+0000 7ff982c60700 1 -- 172.21.15.146:0/2102450632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff97c131f40 msgr2=0x7ff968004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.873+0000 7ff982c60700 1 --2- 172.21.15.146:0/2102450632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff97c131f40 0x7ff968004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.873+0000 7ff982c60700 1 -- 172.21.15.146:0/2102450632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff968003a70 msgr2=0x7ff968003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.873+0000 7ff982c60700 1 --2- 172.21.15.146:0/2102450632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff968003a70 0x7ff968003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.873+0000 7ff982c60700 1 -- 172.21.15.146:0/2102450632 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9680035b0 con 0x7ff968004d90 2023-10-03T10:15:14.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.873+0000 7ff982c60700 1 --2- 172.21.15.146:0/2102450632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff968004d90 0x7ff968005200 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff97400e170 tx=0x7ff968005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50c9260ac89df9a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.873+0000 7ff98145d700 1 -- 172.21.15.146:0/2102450632 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97400ec90 con 0x7ff968004d90 2023-10-03T10:15:14.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.873+0000 7ff98145d700 1 -- 172.21.15.146:0/2102450632 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97400f040 con 0x7ff968004d90 2023-10-03T10:15:14.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.873+0000 7ff98145d700 1 -- 172.21.15.146:0/2102450632 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff974014480 con 0x7ff968004d90 2023-10-03T10:15:14.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.874+0000 7ff9846c3700 1 -- 172.21.15.146:0/2102450632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff968004d90 msgr2=0x7ff968005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.874+0000 7ff9846c3700 1 --2- 172.21.15.146:0/2102450632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff968004d90 0x7ff968005200 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff97400e170 tx=0x7ff968005880 comp rx=0 tx=0).stop 2023-10-03T10:15:14.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.874+0000 7ff982c60700 1 -- 172.21.15.146:0/2102450632 reap_dead start 2023-10-03T10:15:14.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.874+0000 7ff9846c3700 1 -- 172.21.15.146:0/2102450632 shutdown_connections 2023-10-03T10:15:14.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.874+0000 7ff9846c3700 1 -- 172.21.15.146:0/2102450632 >> 172.21.15.146:0/2102450632 conn(0x7ff97c0a4430 msgr2=0x7ff97c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.874+0000 7ff9846c3700 1 -- 172.21.15.146:0/2102450632 shutdown_connections 2023-10-03T10:15:14.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.874+0000 7ff9846c3700 1 -- 172.21.15.146:0/2102450632 wait complete. 2023-10-03T10:15:14.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.876+0000 7ff9846c3700 1 Processor -- start 2023-10-03T10:15:14.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.876+0000 7ff9846c3700 1 -- start start 2023-10-03T10:15:14.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.876+0000 7ff9846c3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff968004d90 0x7ff97c085730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.876+0000 7ff9846c3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff97c085c70 0x7ff97c0860a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.876+0000 7ff981c5e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff97c085c70 0x7ff97c0860a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.876+0000 7ff9846c3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff97c130920 0x7ff97c130d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.876+0000 7ff9846c3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c089050 con 0x7ff97c085c70 2023-10-03T10:15:14.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.876+0000 7ff9846c3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c0865e0 con 0x7ff968004d90 2023-10-03T10:15:14.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.876+0000 7ff9846c3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c0a2b20 con 0x7ff97c130920 2023-10-03T10:15:14.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.876+0000 7ff981c5e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff97c085c70 0x7ff97c0860a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41328/0 (socket says 172.21.15.146:41328) 2023-10-03T10:15:14.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.876+0000 7ff981c5e700 1 -- 172.21.15.146:0/1937618620 learned_addr learned my addr 172.21.15.146:0/1937618620 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:14.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.876+0000 7ff98245f700 1 --2- 172.21.15.146:0/1937618620 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff968004d90 0x7ff97c085730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.877+0000 7ff982c60700 1 --2- 172.21.15.146:0/1937618620 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff97c130920 0x7ff97c130d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.877+0000 7ff98245f700 1 -- 172.21.15.146:0/1937618620 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff97c130920 msgr2=0x7ff97c130d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.877+0000 7ff98245f700 1 --2- 172.21.15.146:0/1937618620 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff97c130920 0x7ff97c130d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.877+0000 7ff98245f700 1 -- 172.21.15.146:0/1937618620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff97c085c70 msgr2=0x7ff97c0860a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.877+0000 7ff98245f700 1 --2- 172.21.15.146:0/1937618620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff97c085c70 0x7ff97c0860a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.877+0000 7ff98245f700 1 -- 172.21.15.146:0/1937618620 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c09dba0 con 0x7ff968004d90 2023-10-03T10:15:14.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.877+0000 7ff98245f700 1 --2- 172.21.15.146:0/1937618620 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff968004d90 0x7ff97c085730 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff9780108f0 tx=0x7ff978010c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.877+0000 7ff972ffd700 1 -- 172.21.15.146:0/1937618620 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff978004440 con 0x7ff968004d90 2023-10-03T10:15:14.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.877+0000 7ff972ffd700 1 -- 172.21.15.146:0/1937618620 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9780045a0 con 0x7ff968004d90 2023-10-03T10:15:14.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.877+0000 7ff9846c3700 1 -- 172.21.15.146:0/1937618620 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97c087320 con 0x7ff968004d90 2023-10-03T10:15:14.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.877+0000 7ff972ffd700 1 -- 172.21.15.146:0/1937618620 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9780038c0 con 0x7ff968004d90 2023-10-03T10:15:14.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.877+0000 7ff9846c3700 1 -- 172.21.15.146:0/1937618620 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff97c089e10 con 0x7ff968004d90 2023-10-03T10:15:14.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.879+0000 7ff9846c3700 1 -- 172.21.15.146:0/1937618620 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97c088e70 con 0x7ff968004d90 2023-10-03T10:15:14.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.879+0000 7ff972ffd700 1 -- 172.21.15.146:0/1937618620 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff978003a20 con 0x7ff968004d90 2023-10-03T10:15:14.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.880+0000 7ff972ffd700 1 -- 172.21.15.146:0/1937618620 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff97803f990 con 0x7ff968004d90 2023-10-03T10:15:14.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.884+0000 7ff972ffd700 1 -- 172.21.15.146:0/1937618620 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff9780199a0 con 0x7ff968004d90 2023-10-03T10:15:14.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.987+0000 7f0f6988b700 1 -- 172.21.15.146:0/1379130307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0f6413aa90 con 0x7f0f6409bc70 2023-10-03T10:15:14.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.988+0000 7f0f4bfff700 1 -- 172.21.15.146:0/1379130307 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0f54020020 con 0x7f0f6409bc70 2023-10-03T10:15:14.988 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:14.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.991+0000 7f0f6988b700 1 -- 172.21.15.146:0/1379130307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f6409bc70 msgr2=0x7f0f641c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.991+0000 7f0f6988b700 1 --2- 172.21.15.146:0/1379130307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f6409bc70 0x7f0f641c8220 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400e980 tx=0x7f0f5400ec90 comp rx=0 tx=0).stop 2023-10-03T10:15:14.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.992+0000 7f0f6988b700 1 -- 172.21.15.146:0/1379130307 shutdown_connections 2023-10-03T10:15:14.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.992+0000 7f0f6988b700 1 --2- 172.21.15.146:0/1379130307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f64131a80 0x7f0f641c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.992+0000 7f0f6988b700 1 --2- 172.21.15.146:0/1379130307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f6409bc70 0x7f0f641c8220 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.992+0000 7f0f6988b700 1 --2- 172.21.15.146:0/1379130307 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f6409c7d0 0x7f0f641c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.992+0000 7f0f6988b700 1 -- 172.21.15.146:0/1379130307 >> 172.21.15.146:0/1379130307 conn(0x7f0f640a2980 msgr2=0x7f0f64070d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.992+0000 7f0f6988b700 1 -- 172.21.15.146:0/1379130307 shutdown_connections 2023-10-03T10:15:14.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:14.992+0000 7f0f6988b700 1 -- 172.21.15.146:0/1379130307 wait complete. 2023-10-03T10:15:15.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:15.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.057+0000 7fe1ec09f700 1 -- 172.21.15.146:0/2201344515 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe1e4071940 con 0x7fe1e40a0ee0 2023-10-03T10:15:15.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.057+0000 7fe1da7fc700 1 -- 172.21.15.146:0/2201344515 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe1e4071940 con 0x7fe1e40a0ee0 2023-10-03T10:15:15.058 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:15.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.059+0000 7fe1ec09f700 1 -- 172.21.15.146:0/2201344515 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e40a0ee0 msgr2=0x7fe1e406e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.059+0000 7fe1ec09f700 1 --2- 172.21.15.146:0/2201344515 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e40a0ee0 0x7fe1e406e230 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000e9f0 tx=0x7fe1e000ed00 comp rx=0 tx=0).stop 2023-10-03T10:15:15.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.059+0000 7fe1ec09f700 1 -- 172.21.15.146:0/2201344515 shutdown_connections 2023-10-03T10:15:15.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.059+0000 7fe1ec09f700 1 --2- 172.21.15.146:0/2201344515 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe1e4134210 0x7fe1e406ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.059+0000 7fe1ec09f700 1 --2- 172.21.15.146:0/2201344515 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1e40a0ee0 0x7fe1e406e230 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.059+0000 7fe1ec09f700 1 --2- 172.21.15.146:0/2201344515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e4133900 0x7fe1e406e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.059+0000 7fe1ec09f700 1 -- 172.21.15.146:0/2201344515 >> 172.21.15.146:0/2201344515 conn(0x7fe1e40a2980 msgr2=0x7fe1e41baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.059+0000 7fe1ec09f700 1 -- 172.21.15.146:0/2201344515 shutdown_connections 2023-10-03T10:15:15.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.059+0000 7fe1ec09f700 1 -- 172.21.15.146:0/2201344515 wait complete. 2023-10-03T10:15:15.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.068+0000 7f55e3d2f700 1 -- 172.21.15.146:0/1263018322 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f55dc09da40 con 0x7f55dc09e950 2023-10-03T10:15:15.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.068+0000 7f55d27fc700 1 -- 172.21.15.146:0/1263018322 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f55d8013e60 con 0x7f55dc09e950 2023-10-03T10:15:15.069 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:15.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.070+0000 7f55e3d2f700 1 -- 172.21.15.146:0/1263018322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55dc09e950 msgr2=0x7f55dc11c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.070+0000 7f55e3d2f700 1 --2- 172.21.15.146:0/1263018322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55dc09e950 0x7f55dc11c170 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f55d800ec10 tx=0x7f55d800ef20 comp rx=0 tx=0).stop 2023-10-03T10:15:15.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.070+0000 7f55e3d2f700 1 -- 172.21.15.146:0/1263018322 shutdown_connections 2023-10-03T10:15:15.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.070+0000 7f55e3d2f700 1 --2- 172.21.15.146:0/1263018322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55dc131dd0 0x7f55dc11cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.070+0000 7f55e3d2f700 1 --2- 172.21.15.146:0/1263018322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55dc09e950 0x7f55dc11c170 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.070+0000 7f55e3d2f700 1 --2- 172.21.15.146:0/1263018322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55dc09f260 0x7f55dc11c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.070+0000 7f55e3d2f700 1 -- 172.21.15.146:0/1263018322 >> 172.21.15.146:0/1263018322 conn(0x7f55dc0a0f70 msgr2=0x7f55dc131050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.070+0000 7f55e3d2f700 1 -- 172.21.15.146:0/1263018322 shutdown_connections 2023-10-03T10:15:15.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.070+0000 7f55e3d2f700 1 -- 172.21.15.146:0/1263018322 wait complete. 2023-10-03T10:15:15.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:15.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:15.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.104+0000 7ff9846c3700 1 -- 172.21.15.146:0/1937618620 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff97c088430 con 0x7ff968004d90 2023-10-03T10:15:15.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.104+0000 7ff972ffd700 1 -- 172.21.15.146:0/1937618620 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff978029020 con 0x7ff968004d90 2023-10-03T10:15:15.105 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:15.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.107+0000 7ff9846c3700 1 -- 172.21.15.146:0/1937618620 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff968004d90 msgr2=0x7ff97c085730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.107+0000 7ff9846c3700 1 --2- 172.21.15.146:0/1937618620 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff968004d90 0x7ff97c085730 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff9780108f0 tx=0x7ff978010c00 comp rx=0 tx=0).stop 2023-10-03T10:15:15.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.107+0000 7ff9846c3700 1 -- 172.21.15.146:0/1937618620 shutdown_connections 2023-10-03T10:15:15.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.107+0000 7ff9846c3700 1 --2- 172.21.15.146:0/1937618620 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff97c130920 0x7ff97c130d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.107+0000 7ff9846c3700 1 --2- 172.21.15.146:0/1937618620 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff968004d90 0x7ff97c085730 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.107+0000 7ff9846c3700 1 --2- 172.21.15.146:0/1937618620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff97c085c70 0x7ff97c0860a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.107+0000 7ff9846c3700 1 -- 172.21.15.146:0/1937618620 >> 172.21.15.146:0/1937618620 conn(0x7ff97c0a4430 msgr2=0x7ff97c09c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.107+0000 7ff9846c3700 1 -- 172.21.15.146:0/1937618620 shutdown_connections 2023-10-03T10:15:15.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:15.107+0000 7ff9846c3700 1 -- 172.21.15.146:0/1937618620 wait complete. 2023-10-03T10:15:15.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:16.011 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:16.073 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:16.084 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:16.120 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:16.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.149+0000 7f515acfd700 1 Processor -- start 2023-10-03T10:15:16.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.150+0000 7f515acfd700 1 -- start start 2023-10-03T10:15:16.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.150+0000 7f515acfd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51540a0a30 0x7f51540a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.150+0000 7f515acfd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5154130670 0x7f51541381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.150+0000 7f515acfd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51540a1e70 con 0x7f51540a1340 2023-10-03T10:15:16.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.150+0000 7f515acfd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515409a720 con 0x7f51540a0a30 2023-10-03T10:15:16.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.150+0000 7f515acfd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f515409b300 con 0x7f5154130670 2023-10-03T10:15:16.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.150+0000 7f5153fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f51540a1340 0x7f515412ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60256/0 (socket says 172.21.15.146:60256) 2023-10-03T10:15:16.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.151+0000 7f5153fff700 1 -- 172.21.15.146:0/107332193 learned_addr learned my addr 172.21.15.146:0/107332193 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.151+0000 7f5158a99700 1 --2- 172.21.15.146:0/107332193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51540a0a30 0x7f51540a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.151+0000 7f515929a700 1 --2- 172.21.15.146:0/107332193 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5154130670 0x7f51541381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.151+0000 7f51537fe700 1 -- 172.21.15.146:0/107332193 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332879315 0 0) 0x7f51540a1e70 con 0x7f51540a1340 2023-10-03T10:15:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.151+0000 7f51537fe700 1 -- 172.21.15.146:0/107332193 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51440035b0 con 0x7f51540a1340 2023-10-03T10:15:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.151+0000 7f515929a700 1 -- 172.21.15.146:0/107332193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51540a0a30 msgr2=0x7f51540a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.151+0000 7f515929a700 1 --2- 172.21.15.146:0/107332193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51540a0a30 0x7f51540a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.151+0000 7f515929a700 1 -- 172.21.15.146:0/107332193 >> v1:172.21.15.146:6789/0 conn(0x7f51540a1340 legacy=0x7f515412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.151+0000 7f515929a700 1 -- 172.21.15.146:0/107332193 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515409abc0 con 0x7f5154130670 2023-10-03T10:15:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.151+0000 7f5158a99700 1 --2- 172.21.15.146:0/107332193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51540a0a30 0x7f51540a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:16.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.151+0000 7f515929a700 1 --2- 172.21.15.146:0/107332193 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5154130670 0x7f51541381c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f514c009dc0 tx=0x7f514c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52bdf7ad20a87a7a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.151+0000 7f51537fe700 1 -- 172.21.15.146:0/107332193 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c00e070 con 0x7f5154130670 2023-10-03T10:15:16.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.151+0000 7f51537fe700 1 -- 172.21.15.146:0/107332193 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514c00bb20 con 0x7f5154130670 2023-10-03T10:15:16.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.151+0000 7f51537fe700 1 -- 172.21.15.146:0/107332193 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c00be90 con 0x7f5154130670 2023-10-03T10:15:16.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.152+0000 7f515acfd700 1 -- 172.21.15.146:0/107332193 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5154130670 msgr2=0x7f51541381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.152+0000 7f515acfd700 1 --2- 172.21.15.146:0/107332193 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5154130670 0x7f51541381c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f514c009dc0 tx=0x7f514c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:16.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.152+0000 7f515acfd700 1 -- 172.21.15.146:0/107332193 shutdown_connections 2023-10-03T10:15:16.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.152+0000 7f515acfd700 1 --2- 172.21.15.146:0/107332193 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5154130670 0x7f51541381c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.152+0000 7f515acfd700 1 --2- 172.21.15.146:0/107332193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51540a0a30 0x7f51540a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.152+0000 7f515acfd700 1 -- 172.21.15.146:0/107332193 >> 172.21.15.146:0/107332193 conn(0x7f51540a2980 msgr2=0x7f51540a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.152+0000 7f515acfd700 1 -- 172.21.15.146:0/107332193 shutdown_connections 2023-10-03T10:15:16.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.152+0000 7f515acfd700 1 -- 172.21.15.146:0/107332193 wait complete. 2023-10-03T10:15:16.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.154+0000 7f515acfd700 1 Processor -- start 2023-10-03T10:15:16.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.154+0000 7f515acfd700 1 -- start start 2023-10-03T10:15:16.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.154+0000 7f515acfd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51540a0a30 0x7f5154137db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.154+0000 7f515acfd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f51540a1340 0x7f51541382f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.154+0000 7f515acfd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5154130670 0x7f5154138830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.154+0000 7f515acfd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5154135810 con 0x7f51540a0a30 2023-10-03T10:15:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.154+0000 7f515acfd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5154136f60 con 0x7f5154130670 2023-10-03T10:15:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.154+0000 7f515acfd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51541371d0 con 0x7f51540a1340 2023-10-03T10:15:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.154+0000 7f5153fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f51540a1340 0x7f51541382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.155+0000 7f5153fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f51540a1340 0x7f51541382f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58460/0 (socket says 172.21.15.146:58460) 2023-10-03T10:15:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.155+0000 7f5153fff700 1 -- 172.21.15.146:0/1541058474 learned_addr learned my addr 172.21.15.146:0/1541058474 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.155+0000 7f5158a99700 1 --2- 172.21.15.146:0/1541058474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51540a0a30 0x7f5154137db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.155+0000 7f515929a700 1 --2- 172.21.15.146:0/1541058474 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5154130670 0x7f5154138830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.155+0000 7f5158a99700 1 -- 172.21.15.146:0/1541058474 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f51540a1340 msgr2=0x7f51541382f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.155+0000 7f5158a99700 1 --2- 172.21.15.146:0/1541058474 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f51540a1340 0x7f51541382f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.155+0000 7f5158a99700 1 -- 172.21.15.146:0/1541058474 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5154130670 msgr2=0x7f5154138830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.155+0000 7f5158a99700 1 --2- 172.21.15.146:0/1541058474 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5154130670 0x7f5154138830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.155+0000 7f5158a99700 1 -- 172.21.15.146:0/1541058474 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5148009430 con 0x7f51540a0a30 2023-10-03T10:15:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.155+0000 7f515929a700 1 --2- 172.21.15.146:0/1541058474 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5154130670 0x7f5154138830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.155+0000 7f5158a99700 1 --2- 172.21.15.146:0/1541058474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51540a0a30 0x7f5154137db0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f514800e980 tx=0x7f514800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.155+0000 7f51517fa700 1 -- 172.21.15.146:0/1541058474 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514800eed0 con 0x7f51540a0a30 2023-10-03T10:15:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.155+0000 7f51517fa700 1 -- 172.21.15.146:0/1541058474 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514800c850 con 0x7f51540a0a30 2023-10-03T10:15:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.155+0000 7f51517fa700 1 -- 172.21.15.146:0/1541058474 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514800cbe0 con 0x7f51540a0a30 2023-10-03T10:15:16.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.156+0000 7f515acfd700 1 -- 172.21.15.146:0/1541058474 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514c009a70 con 0x7f51540a0a30 2023-10-03T10:15:16.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.156+0000 7f515acfd700 1 -- 172.21.15.146:0/1541058474 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f515409f850 con 0x7f51540a0a30 2023-10-03T10:15:16.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.157+0000 7f51517fa700 1 -- 172.21.15.146:0/1541058474 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f514800cd40 con 0x7f51540a0a30 2023-10-03T10:15:16.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.157+0000 7f51517fa700 1 -- 172.21.15.146:0/1541058474 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f514803fb60 con 0x7f51540a0a30 2023-10-03T10:15:16.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.157+0000 7f515acfd700 1 -- 172.21.15.146:0/1541058474 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515404f2a0 con 0x7f51540a0a30 2023-10-03T10:15:16.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.163+0000 7f51517fa700 1 -- 172.21.15.146:0/1541058474 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5148017080 con 0x7f51540a0a30 2023-10-03T10:15:16.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.209+0000 7f3aa2942700 1 Processor -- start 2023-10-03T10:15:16.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.209+0000 7f3aa2942700 1 -- start start 2023-10-03T10:15:16.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.209+0000 7f3aa2942700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3a9c136960 0x7f3a9c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.209+0000 7f3aa2942700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a9c139280 0x7f3a9c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.209+0000 7f3aa2942700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a9c06b2d0 con 0x7f3a9c133ad0 2023-10-03T10:15:16.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.209+0000 7f3aa2942700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a9c1345b0 con 0x7f3a9c136960 2023-10-03T10:15:16.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.209+0000 7f3aa2942700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c133610 con 0x7f3a9c139280 2023-10-03T10:15:16.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.210+0000 7f3a9bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3a9c133ad0 0x7f3a9c133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60260/0 (socket says 172.21.15.146:60260) 2023-10-03T10:15:16.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.210+0000 7f3a9bfff700 1 -- 172.21.15.146:0/2053916648 learned_addr learned my addr 172.21.15.146:0/2053916648 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:16.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.210+0000 7f3a9b7fe700 1 --2- 172.21.15.146:0/2053916648 >> v2:172.21.15.146:3300/0 conn(0x7f3a9c136960 0x7f3a9c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.210+0000 7f3aa0edf700 1 --2- 172.21.15.146:0/2053916648 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a9c139280 0x7f3a9c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.210+0000 7f3aa0edf700 1 -- 172.21.15.146:0/2053916648 >> v2:172.21.15.146:3300/0 conn(0x7f3a9c136960 msgr2=0x7f3a9c138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:16.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.210+0000 7f3aa0edf700 1 --2- 172.21.15.146:0/2053916648 >> v2:172.21.15.146:3300/0 conn(0x7f3a9c136960 0x7f3a9c138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.210+0000 7f3aa0edf700 1 -- 172.21.15.146:0/2053916648 >> v1:172.21.15.146:6789/0 conn(0x7f3a9c133ad0 legacy=0x7f3a9c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.210+0000 7f3aa0edf700 1 -- 172.21.15.146:0/2053916648 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9c09a500 con 0x7f3a9c139280 2023-10-03T10:15:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.210+0000 7f3aa0edf700 1 --2- 172.21.15.146:0/2053916648 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a9c139280 0x7f3a9c13b660 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3a94009d90 tx=0x7f3a9400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6827608b41cabc42 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.210+0000 7f3a9affd700 1 -- 172.21.15.146:0/2053916648 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9400e070 con 0x7f3a9c139280 2023-10-03T10:15:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.210+0000 7f3a9affd700 1 -- 172.21.15.146:0/2053916648 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9400bb20 con 0x7f3a9c139280 2023-10-03T10:15:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.210+0000 7f3a9affd700 1 -- 172.21.15.146:0/2053916648 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a94012430 con 0x7f3a9c139280 2023-10-03T10:15:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.211+0000 7f3aa2942700 1 -- 172.21.15.146:0/2053916648 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a9c139280 msgr2=0x7f3a9c13b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.211+0000 7f3aa2942700 1 --2- 172.21.15.146:0/2053916648 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a9c139280 0x7f3a9c13b660 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3a94009d90 tx=0x7f3a9400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.211+0000 7f3aa2942700 1 -- 172.21.15.146:0/2053916648 shutdown_connections 2023-10-03T10:15:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.211+0000 7f3aa2942700 1 --2- 172.21.15.146:0/2053916648 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a9c139280 0x7f3a9c13b660 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.211+0000 7f3aa2942700 1 --2- 172.21.15.146:0/2053916648 >> v2:172.21.15.146:3300/0 conn(0x7f3a9c136960 0x7f3a9c138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.211+0000 7f3aa2942700 1 -- 172.21.15.146:0/2053916648 >> 172.21.15.146:0/2053916648 conn(0x7f3a9c099c40 msgr2=0x7f3a9c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.211+0000 7f3aa2942700 1 -- 172.21.15.146:0/2053916648 shutdown_connections 2023-10-03T10:15:16.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.211+0000 7f3aa2942700 1 -- 172.21.15.146:0/2053916648 wait complete. 2023-10-03T10:15:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.212+0000 7f3aa2942700 1 Processor -- start 2023-10-03T10:15:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.213+0000 7f3aa2942700 1 -- start start 2023-10-03T10:15:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.213+0000 7f3aa2942700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a9c133ad0 0x7f3a9c12cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.213+0000 7f3aa2942700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a9c136960 0x7f3a9c12d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.213+0000 7f3aa2942700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a9c139280 0x7f3a9c12d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.213+0000 7f3aa2942700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c09f420 con 0x7f3a9c133ad0 2023-10-03T10:15:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.213+0000 7f3aa2942700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c072400 con 0x7f3a9c139280 2023-10-03T10:15:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.213+0000 7f3aa2942700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c070300 con 0x7f3a9c136960 2023-10-03T10:15:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.213+0000 7f3a9b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a9c136960 0x7f3a9c12d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.213+0000 7f3a9b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a9c136960 0x7f3a9c12d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58492/0 (socket says 172.21.15.146:58492) 2023-10-03T10:15:16.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.213+0000 7f3a9b7fe700 1 -- 172.21.15.146:0/514757882 learned_addr learned my addr 172.21.15.146:0/514757882 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:16.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.213+0000 7f3a9bfff700 1 --2- 172.21.15.146:0/514757882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a9c133ad0 0x7f3a9c12cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.213+0000 7f3aa0edf700 1 --2- 172.21.15.146:0/514757882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a9c139280 0x7f3a9c12d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.214+0000 7f3a9b7fe700 1 -- 172.21.15.146:0/514757882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a9c139280 msgr2=0x7f3a9c12d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.214+0000 7f3a9b7fe700 1 --2- 172.21.15.146:0/514757882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a9c139280 0x7f3a9c12d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.214+0000 7f3a9b7fe700 1 -- 172.21.15.146:0/514757882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a9c133ad0 msgr2=0x7f3a9c12cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.214+0000 7f3a9b7fe700 1 --2- 172.21.15.146:0/514757882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a9c133ad0 0x7f3a9c12cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.214+0000 7f3a9b7fe700 1 -- 172.21.15.146:0/514757882 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a94009a70 con 0x7f3a9c136960 2023-10-03T10:15:16.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.214+0000 7f3a9b7fe700 1 --2- 172.21.15.146:0/514757882 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a9c136960 0x7f3a9c12d070 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3a9000e9e0 tx=0x7f3a9000eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.214+0000 7f3a98ff9700 1 -- 172.21.15.146:0/514757882 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a90009710 con 0x7f3a9c136960 2023-10-03T10:15:16.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.214+0000 7f3a98ff9700 1 -- 172.21.15.146:0/514757882 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9000c850 con 0x7f3a9c136960 2023-10-03T10:15:16.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.214+0000 7f3a98ff9700 1 -- 172.21.15.146:0/514757882 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9000cbc0 con 0x7f3a9c136960 2023-10-03T10:15:16.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.214+0000 7f3aa2942700 1 -- 172.21.15.146:0/514757882 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a9c070d70 con 0x7f3a9c136960 2023-10-03T10:15:16.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.214+0000 7f3aa2942700 1 -- 172.21.15.146:0/514757882 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a9c131730 con 0x7f3a9c136960 2023-10-03T10:15:16.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.215+0000 7f3a98ff9700 1 -- 172.21.15.146:0/514757882 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a9000cd20 con 0x7f3a9c136960 2023-10-03T10:15:16.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.215+0000 7f3aa2942700 1 -- 172.21.15.146:0/514757882 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a9c130a60 con 0x7f3a9c136960 2023-10-03T10:15:16.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.215+0000 7f3a98ff9700 1 -- 172.21.15.146:0/514757882 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3a9003f860 con 0x7f3a9c136960 2023-10-03T10:15:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.220+0000 7f3a98ff9700 1 -- 172.21.15.146:0/514757882 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a9001bd40 con 0x7f3a9c136960 2023-10-03T10:15:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.256+0000 7fecbd009700 1 Processor -- start 2023-10-03T10:15:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.257+0000 7fecbd009700 1 -- start start 2023-10-03T10:15:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.257+0000 7fecbd009700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb8136960 0x7fecb8138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.257+0000 7fecbd009700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb8139280 0x7fecb813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.257+0000 7fecbd009700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb806b2d0 con 0x7fecb8133ad0 2023-10-03T10:15:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.257+0000 7fecbd009700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb81345b0 con 0x7fecb8136960 2023-10-03T10:15:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.257+0000 7fecbd009700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecb8133610 con 0x7fecb8139280 2023-10-03T10:15:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.257+0000 7fecaffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb8136960 0x7fecb8138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.258+0000 7fecaffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb8136960 0x7fecb8138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44078/0 (socket says 172.21.15.146:44078) 2023-10-03T10:15:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.258+0000 7fecaffff700 1 -- 172.21.15.146:0/1786632093 learned_addr learned my addr 172.21.15.146:0/1786632093 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.258+0000 7fecb759e700 1 --2- 172.21.15.146:0/1786632093 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb8139280 0x7fecb813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.258+0000 7fecaffff700 1 -- 172.21.15.146:0/1786632093 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb8139280 msgr2=0x7fecb813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.258+0000 7fecaffff700 1 --2- 172.21.15.146:0/1786632093 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb8139280 0x7fecb813b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.258+0000 7fecaffff700 1 -- 172.21.15.146:0/1786632093 >> v1:172.21.15.146:6789/0 conn(0x7fecb8133ad0 legacy=0x7fecb8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.258+0000 7fecaffff700 1 -- 172.21.15.146:0/1786632093 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb809a500 con 0x7fecb8136960 2023-10-03T10:15:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.258+0000 7fecaffff700 1 --2- 172.21.15.146:0/1786632093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb8136960 0x7fecb8138d40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7feca0009920 tx=0x7feca0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9310a826091407f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.258+0000 7fecb659c700 1 -- 172.21.15.146:0/1786632093 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca0011830 con 0x7fecb8136960 2023-10-03T10:15:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.258+0000 7fecb659c700 1 -- 172.21.15.146:0/1786632093 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca0011990 con 0x7fecb8136960 2023-10-03T10:15:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.258+0000 7fecb659c700 1 -- 172.21.15.146:0/1786632093 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca0011d20 con 0x7fecb8136960 2023-10-03T10:15:16.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.259+0000 7fecbd009700 1 -- 172.21.15.146:0/1786632093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb8136960 msgr2=0x7fecb8138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.259+0000 7fecbd009700 1 --2- 172.21.15.146:0/1786632093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb8136960 0x7fecb8138d40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7feca0009920 tx=0x7feca0009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.259+0000 7fecbd009700 1 -- 172.21.15.146:0/1786632093 shutdown_connections 2023-10-03T10:15:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.259+0000 7fecbd009700 1 --2- 172.21.15.146:0/1786632093 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb8139280 0x7fecb813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.259+0000 7fecbd009700 1 --2- 172.21.15.146:0/1786632093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb8136960 0x7fecb8138d40 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.259+0000 7fecbd009700 1 -- 172.21.15.146:0/1786632093 >> 172.21.15.146:0/1786632093 conn(0x7fecb8099c40 msgr2=0x7fecb80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.259+0000 7fecbd009700 1 -- 172.21.15.146:0/1786632093 shutdown_connections 2023-10-03T10:15:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.259+0000 7fecbd009700 1 -- 172.21.15.146:0/1786632093 wait complete. 2023-10-03T10:15:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.261+0000 7fecbd009700 1 Processor -- start 2023-10-03T10:15:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.261+0000 7fecbd009700 1 -- start start 2023-10-03T10:15:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.261+0000 7fecbd009700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecb8133ad0 0x7fecb8071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.261+0000 7fecbd009700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb8136960 0x7fecb8071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.261+0000 7fecbd009700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb8139280 0x7fecb81c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.261+0000 7fecbd009700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb806e900 con 0x7fecb8133ad0 2023-10-03T10:15:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.261+0000 7fecbd009700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb806f490 con 0x7fecb8139280 2023-10-03T10:15:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.261+0000 7fecbd009700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecb81316a0 con 0x7fecb8136960 2023-10-03T10:15:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.262+0000 7fecb759e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb8139280 0x7fecb81c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.262+0000 7fecb6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecb8133ad0 0x7fecb8071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.262+0000 7fecb759e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb8139280 0x7fecb81c84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44090/0 (socket says 172.21.15.146:44090) 2023-10-03T10:15:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.262+0000 7fecb759e700 1 -- 172.21.15.146:0/3996961185 learned_addr learned my addr 172.21.15.146:0/3996961185 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.262+0000 7fecaffff700 1 --2- 172.21.15.146:0/3996961185 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb8136960 0x7fecb8071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.262+0000 7fecb759e700 1 -- 172.21.15.146:0/3996961185 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb8136960 msgr2=0x7fecb8071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.262+0000 7fecb759e700 1 --2- 172.21.15.146:0/3996961185 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb8136960 0x7fecb8071d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.262+0000 7fecb759e700 1 -- 172.21.15.146:0/3996961185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecb8133ad0 msgr2=0x7fecb8071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.262+0000 7fecb759e700 1 --2- 172.21.15.146:0/3996961185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecb8133ad0 0x7fecb8071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.262+0000 7fecb759e700 1 -- 172.21.15.146:0/3996961185 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca0009550 con 0x7fecb8139280 2023-10-03T10:15:16.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.262+0000 7fecb759e700 1 --2- 172.21.15.146:0/3996961185 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb8139280 0x7fecb81c84e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fecb000efc0 tx=0x7fecb000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.262+0000 7fecaf7fe700 1 -- 172.21.15.146:0/3996961185 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0009ea0 con 0x7fecb8139280 2023-10-03T10:15:16.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.262+0000 7fecaf7fe700 1 -- 172.21.15.146:0/3996961185 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb000f040 con 0x7fecb8139280 2023-10-03T10:15:16.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.262+0000 7fecbd009700 1 -- 172.21.15.146:0/3996961185 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb806f010 con 0x7fecb8139280 2023-10-03T10:15:16.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.263+0000 7fecaf7fe700 1 -- 172.21.15.146:0/3996961185 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb000ced0 con 0x7fecb8139280 2023-10-03T10:15:16.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.263+0000 7fecbd009700 1 -- 172.21.15.146:0/3996961185 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb80722d0 con 0x7fecb8139280 2023-10-03T10:15:16.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.264+0000 7fecbd009700 1 -- 172.21.15.146:0/3996961185 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb8070080 con 0x7fecb8139280 2023-10-03T10:15:16.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.264+0000 7fecaf7fe700 1 -- 172.21.15.146:0/3996961185 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fecb0014480 con 0x7fecb8139280 2023-10-03T10:15:16.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.265+0000 7fecaf7fe700 1 -- 172.21.15.146:0/3996961185 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fecb00404a0 con 0x7fecb8139280 2023-10-03T10:15:16.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.269+0000 7fecaf7fe700 1 -- 172.21.15.146:0/3996961185 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fecb0012520 con 0x7fecb8139280 2023-10-03T10:15:16.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.286+0000 7f706a5b6700 1 Processor -- start 2023-10-03T10:15:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.287+0000 7f706a5b6700 1 -- start start 2023-10-03T10:15:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.287+0000 7f706a5b6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70640a1510 0x7f70641351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.287+0000 7f706a5b6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70641356e0 0x7f7064137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.287+0000 7f706a5b6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70640a1e70 con 0x7f70640a0a30 2023-10-03T10:15:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.287+0000 7f706a5b6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706409a720 con 0x7f70640a1510 2023-10-03T10:15:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.287+0000 7f706a5b6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f706409b300 con 0x7f70641356e0 2023-10-03T10:15:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.287+0000 7f7068b53700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70641356e0 0x7f7064137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.287+0000 7f7068b53700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70641356e0 0x7f7064137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58516/0 (socket says 172.21.15.146:58516) 2023-10-03T10:15:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.287+0000 7f7068b53700 1 -- 172.21.15.146:0/3670589870 learned_addr learned my addr 172.21.15.146:0/3670589870 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.287+0000 7f70637fe700 1 --2- 172.21.15.146:0/3670589870 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70640a1510 0x7f70641351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.288+0000 7f7068b53700 1 -- 172.21.15.146:0/3670589870 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70640a1510 msgr2=0x7f70641351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.288+0000 7f7068b53700 1 --2- 172.21.15.146:0/3670589870 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70640a1510 0x7f70641351a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.288+0000 7f7068b53700 1 -- 172.21.15.146:0/3670589870 >> v1:172.21.15.146:6789/0 conn(0x7f70640a0a30 legacy=0x7f70640a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.288+0000 7f7068b53700 1 -- 172.21.15.146:0/3670589870 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706409abc0 con 0x7f70641356e0 2023-10-03T10:15:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.288+0000 7f7068b53700 1 --2- 172.21.15.146:0/3670589870 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70641356e0 0x7f7064137ac0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f705c009e80 tx=0x7f705c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac2d64a27fa0fc46 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.288+0000 7f7062ffd700 1 -- 172.21.15.146:0/3670589870 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c003c20 con 0x7f70641356e0 2023-10-03T10:15:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.288+0000 7f7062ffd700 1 -- 172.21.15.146:0/3670589870 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705c003d80 con 0x7f70641356e0 2023-10-03T10:15:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.288+0000 7f7062ffd700 1 -- 172.21.15.146:0/3670589870 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c00bbc0 con 0x7f70641356e0 2023-10-03T10:15:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.289+0000 7f706a5b6700 1 -- 172.21.15.146:0/3670589870 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70641356e0 msgr2=0x7f7064137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.289+0000 7f706a5b6700 1 --2- 172.21.15.146:0/3670589870 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70641356e0 0x7f7064137ac0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f705c009e80 tx=0x7f705c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:16.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.289+0000 7f706a5b6700 1 -- 172.21.15.146:0/3670589870 shutdown_connections 2023-10-03T10:15:16.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.289+0000 7f706a5b6700 1 --2- 172.21.15.146:0/3670589870 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70641356e0 0x7f7064137ac0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.289+0000 7f706a5b6700 1 --2- 172.21.15.146:0/3670589870 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70640a1510 0x7f70641351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.289+0000 7f706a5b6700 1 -- 172.21.15.146:0/3670589870 >> 172.21.15.146:0/3670589870 conn(0x7f70640a2980 msgr2=0x7f70640a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.289+0000 7f706a5b6700 1 -- 172.21.15.146:0/3670589870 shutdown_connections 2023-10-03T10:15:16.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.289+0000 7f706a5b6700 1 -- 172.21.15.146:0/3670589870 wait complete. 2023-10-03T10:15:16.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.290+0000 7f706a5b6700 1 Processor -- start 2023-10-03T10:15:16.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.290+0000 7f706a5b6700 1 -- start start 2023-10-03T10:15:16.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.291+0000 7f706a5b6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70640a0a30 0x7f7064133e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.291+0000 7f706a5b6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70640a1510 0x7f70641343b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.291+0000 7f706a5b6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70641356e0 0x7f70641c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.291+0000 7f706a5b6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706409d430 con 0x7f70641356e0 2023-10-03T10:15:16.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.291+0000 7f706a5b6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706411a990 con 0x7f70640a0a30 2023-10-03T10:15:16.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.291+0000 7f706a5b6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70641192d0 con 0x7f70640a1510 2023-10-03T10:15:16.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.291+0000 7f7068b53700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70641356e0 0x7f70641c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.291+0000 7f7068b53700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70641356e0 0x7f70641c8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41380/0 (socket says 172.21.15.146:41380) 2023-10-03T10:15:16.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.291+0000 7f7068b53700 1 -- 172.21.15.146:0/1790020386 learned_addr learned my addr 172.21.15.146:0/1790020386 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:16.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.291+0000 7f7063fff700 1 --2- 172.21.15.146:0/1790020386 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70640a0a30 0x7f7064133e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.291+0000 7f70637fe700 1 --2- 172.21.15.146:0/1790020386 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70640a1510 0x7f70641343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.292+0000 7f7068b53700 1 -- 172.21.15.146:0/1790020386 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70640a1510 msgr2=0x7f70641343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.292+0000 7f7068b53700 1 --2- 172.21.15.146:0/1790020386 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70640a1510 0x7f70641343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.292+0000 7f7068b53700 1 -- 172.21.15.146:0/1790020386 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70640a0a30 msgr2=0x7f7064133e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.292+0000 7f7068b53700 1 --2- 172.21.15.146:0/1790020386 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70640a0a30 0x7f7064133e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.292+0000 7f7068b53700 1 -- 172.21.15.146:0/1790020386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c009b30 con 0x7f70641356e0 2023-10-03T10:15:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.292+0000 7f7068b53700 1 --2- 172.21.15.146:0/1790020386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70641356e0 0x7f70641c8410 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f705c004000 tx=0x7f705c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.292+0000 7f70637fe700 1 --2- 172.21.15.146:0/1790020386 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70640a1510 0x7f70641343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.292+0000 7f7060ff9700 1 -- 172.21.15.146:0/1790020386 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c01e070 con 0x7f70641356e0 2023-10-03T10:15:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.292+0000 7f7060ff9700 1 -- 172.21.15.146:0/1790020386 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705c0092e0 con 0x7f70641356e0 2023-10-03T10:15:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.292+0000 7f706a5b6700 1 -- 172.21.15.146:0/1790020386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7064119550 con 0x7f70641356e0 2023-10-03T10:15:16.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.292+0000 7f7060ff9700 1 -- 172.21.15.146:0/1790020386 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c007000 con 0x7f70641356e0 2023-10-03T10:15:16.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.292+0000 7f706a5b6700 1 -- 172.21.15.146:0/1790020386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7064133a70 con 0x7f70641356e0 2023-10-03T10:15:16.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.293+0000 7f706a5b6700 1 -- 172.21.15.146:0/1790020386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706411a600 con 0x7f70641356e0 2023-10-03T10:15:16.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.294+0000 7f7060ff9700 1 -- 172.21.15.146:0/1790020386 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f705c022410 con 0x7f70641356e0 2023-10-03T10:15:16.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.294+0000 7f7060ff9700 1 -- 172.21.15.146:0/1790020386 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f705c00e030 con 0x7f70641356e0 2023-10-03T10:15:16.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.298+0000 7f7060ff9700 1 -- 172.21.15.146:0/1790020386 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f705c009470 con 0x7f70641356e0 2023-10-03T10:15:16.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.413+0000 7f515acfd700 1 -- 172.21.15.146:0/1541058474 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f515413c410 con 0x7f51540a0a30 2023-10-03T10:15:16.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.414+0000 7f51517fa700 1 -- 172.21.15.146:0/1541058474 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5148011d90 con 0x7f51540a0a30 2023-10-03T10:15:16.414 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:16.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.417+0000 7f515acfd700 1 -- 172.21.15.146:0/1541058474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51540a0a30 msgr2=0x7f5154137db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.417+0000 7f515acfd700 1 --2- 172.21.15.146:0/1541058474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51540a0a30 0x7f5154137db0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f514800e980 tx=0x7f514800ec90 comp rx=0 tx=0).stop 2023-10-03T10:15:16.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.417+0000 7f515acfd700 1 -- 172.21.15.146:0/1541058474 shutdown_connections 2023-10-03T10:15:16.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.417+0000 7f515acfd700 1 --2- 172.21.15.146:0/1541058474 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5154130670 0x7f5154138830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.417+0000 7f515acfd700 1 --2- 172.21.15.146:0/1541058474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51540a0a30 0x7f5154137db0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.417+0000 7f515acfd700 1 --2- 172.21.15.146:0/1541058474 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f51540a1340 0x7f51541382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.417+0000 7f515acfd700 1 -- 172.21.15.146:0/1541058474 >> 172.21.15.146:0/1541058474 conn(0x7f51540a2980 msgr2=0x7f515409e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.418+0000 7f515acfd700 1 -- 172.21.15.146:0/1541058474 shutdown_connections 2023-10-03T10:15:16.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.420+0000 7f515acfd700 1 -- 172.21.15.146:0/1541058474 wait complete. 2023-10-03T10:15:16.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.423+0000 7f3aa2942700 1 -- 172.21.15.146:0/514757882 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3a9c04f2a0 con 0x7f3a9c136960 2023-10-03T10:15:16.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.423+0000 7f3a98ff9700 1 -- 172.21.15.146:0/514757882 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a90021020 con 0x7f3a9c136960 2023-10-03T10:15:16.424 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:16.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.425+0000 7f3aa2942700 1 -- 172.21.15.146:0/514757882 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a9c136960 msgr2=0x7f3a9c12d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.425+0000 7f3aa2942700 1 --2- 172.21.15.146:0/514757882 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a9c136960 0x7f3a9c12d070 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3a9000e9e0 tx=0x7f3a9000eda0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.426+0000 7f3aa2942700 1 -- 172.21.15.146:0/514757882 shutdown_connections 2023-10-03T10:15:16.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.426+0000 7f3aa2942700 1 --2- 172.21.15.146:0/514757882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a9c139280 0x7f3a9c12d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.426+0000 7f3aa2942700 1 --2- 172.21.15.146:0/514757882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a9c133ad0 0x7f3a9c12cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.426+0000 7f3aa2942700 1 --2- 172.21.15.146:0/514757882 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3a9c136960 0x7f3a9c12d070 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.426+0000 7f3aa2942700 1 -- 172.21.15.146:0/514757882 >> 172.21.15.146:0/514757882 conn(0x7f3a9c099c40 msgr2=0x7f3a9c1371c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.426+0000 7f3aa2942700 1 -- 172.21.15.146:0/514757882 shutdown_connections 2023-10-03T10:15:16.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.426+0000 7f3aa2942700 1 -- 172.21.15.146:0/514757882 wait complete. 2023-10-03T10:15:16.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:16.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:16.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.477+0000 7fecbd009700 1 -- 172.21.15.146:0/3996961185 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fecb8072520 con 0x7fecb8139280 2023-10-03T10:15:16.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.478+0000 7fecaf7fe700 1 -- 172.21.15.146:0/3996961185 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fecb002a090 con 0x7fecb8139280 2023-10-03T10:15:16.479 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:16.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.480+0000 7fecbd009700 1 -- 172.21.15.146:0/3996961185 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb8139280 msgr2=0x7fecb81c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.480+0000 7fecbd009700 1 --2- 172.21.15.146:0/3996961185 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb8139280 0x7fecb81c84e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fecb000efc0 tx=0x7fecb000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.480+0000 7fecbd009700 1 -- 172.21.15.146:0/3996961185 shutdown_connections 2023-10-03T10:15:16.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.480+0000 7fecbd009700 1 --2- 172.21.15.146:0/3996961185 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecb8139280 0x7fecb81c84e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.480+0000 7fecbd009700 1 --2- 172.21.15.146:0/3996961185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecb8133ad0 0x7fecb8071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.480+0000 7fecbd009700 1 --2- 172.21.15.146:0/3996961185 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fecb8136960 0x7fecb8071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.480+0000 7fecbd009700 1 -- 172.21.15.146:0/3996961185 >> 172.21.15.146:0/3996961185 conn(0x7fecb8099c40 msgr2=0x7fecb8134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.480+0000 7fecbd009700 1 -- 172.21.15.146:0/3996961185 shutdown_connections 2023-10-03T10:15:16.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.480+0000 7fecbd009700 1 -- 172.21.15.146:0/3996961185 wait complete. 2023-10-03T10:15:16.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:16.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.530+0000 7f706a5b6700 1 -- 172.21.15.146:0/1790020386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f706404f2a0 con 0x7f70641356e0 2023-10-03T10:15:16.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.531+0000 7f7060ff9700 1 -- 172.21.15.146:0/1790020386 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f705c027030 con 0x7f70641356e0 2023-10-03T10:15:16.531 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:16.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.533+0000 7f706a5b6700 1 -- 172.21.15.146:0/1790020386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70641356e0 msgr2=0x7f70641c8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.533+0000 7f706a5b6700 1 --2- 172.21.15.146:0/1790020386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70641356e0 0x7f70641c8410 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f705c004000 tx=0x7f705c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.533+0000 7f706a5b6700 1 -- 172.21.15.146:0/1790020386 shutdown_connections 2023-10-03T10:15:16.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.533+0000 7f706a5b6700 1 --2- 172.21.15.146:0/1790020386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70641356e0 0x7f70641c8410 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.533+0000 7f706a5b6700 1 --2- 172.21.15.146:0/1790020386 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70640a0a30 0x7f7064133e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.533+0000 7f706a5b6700 1 --2- 172.21.15.146:0/1790020386 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70640a1510 0x7f70641343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.533+0000 7f706a5b6700 1 -- 172.21.15.146:0/1790020386 >> 172.21.15.146:0/1790020386 conn(0x7f70640a2980 msgr2=0x7f7064136940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.533+0000 7f706a5b6700 1 -- 172.21.15.146:0/1790020386 shutdown_connections 2023-10-03T10:15:16.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:16.533+0000 7f706a5b6700 1 -- 172.21.15.146:0/1790020386 wait complete. 2023-10-03T10:15:16.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:17.440 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:17.441 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:17.494 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:17.547 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:17.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.582+0000 7fbfe877a700 1 Processor -- start 2023-10-03T10:15:17.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.583+0000 7fbfe877a700 1 -- start start 2023-10-03T10:15:17.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.583+0000 7f6c77d41700 1 Processor -- start 2023-10-03T10:15:17.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.583+0000 7fbfe877a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbfe0136960 0x7fbfe0138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.583+0000 7fbfe877a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbfe0139280 0x7fbfe013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.583+0000 7fbfe877a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe006b2d0 con 0x7fbfe0133ad0 2023-10-03T10:15:17.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.583+0000 7fbfe877a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe01345b0 con 0x7fbfe0136960 2023-10-03T10:15:17.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.583+0000 7fbfe877a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe0133610 con 0x7fbfe0139280 2023-10-03T10:15:17.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.584+0000 7fbfe6d17700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbfe0139280 0x7fbfe013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.584+0000 7fbfe6d17700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbfe0139280 0x7fbfe013b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44112/0 (socket says 172.21.15.146:44112) 2023-10-03T10:15:17.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.584+0000 7fbfe6516700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbfe0133ad0 0x7fbfe0133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60290/0 (socket says 172.21.15.146:60290) 2023-10-03T10:15:17.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.584+0000 7fbfe6d17700 1 -- 172.21.15.146:0/4292246173 learned_addr learned my addr 172.21.15.146:0/4292246173 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:17.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.584+0000 7fbfe5514700 1 -- 172.21.15.146:0/4292246173 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844311633 0 0) 0x7fbfe006b2d0 con 0x7fbfe0133ad0 2023-10-03T10:15:17.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.584+0000 7fbfe5514700 1 -- 172.21.15.146:0/4292246173 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfcc0035b0 con 0x7fbfe0133ad0 2023-10-03T10:15:17.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.584+0000 7fbfe6d17700 1 -- 172.21.15.146:0/4292246173 >> v2:172.21.15.146:3300/0 conn(0x7fbfe0136960 msgr2=0x7fbfe0138d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:15:17.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.584+0000 7fbfe6d17700 1 --2- 172.21.15.146:0/4292246173 >> v2:172.21.15.146:3300/0 conn(0x7fbfe0136960 0x7fbfe0138d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.584+0000 7fbfe6d17700 1 -- 172.21.15.146:0/4292246173 >> v1:172.21.15.146:6789/0 conn(0x7fbfe0133ad0 legacy=0x7fbfe0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.584+0000 7fbfe6d17700 1 -- 172.21.15.146:0/4292246173 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe009a500 con 0x7fbfe0139280 2023-10-03T10:15:17.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.583+0000 7f6c77d41700 1 -- start start 2023-10-03T10:15:17.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.584+0000 7f6c77d41700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700a1510 0x7f6c701351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.584+0000 7f6c77d41700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6c701356e0 0x7f6c70137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.584+0000 7f6c77d41700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c700a1e70 con 0x7f6c700a0a30 2023-10-03T10:15:17.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.584+0000 7f6c77d41700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7009a720 con 0x7f6c701356e0 2023-10-03T10:15:17.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.584+0000 7f6c77d41700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7009b300 con 0x7f6c700a1510 2023-10-03T10:15:17.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.584+0000 7f6c75add700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6c700a0a30 0x7f6c700a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60302/0 (socket says 172.21.15.146:60302) 2023-10-03T10:15:17.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.584+0000 7f6c75add700 1 -- 172.21.15.146:0/1910702383 learned_addr learned my addr 172.21.15.146:0/1910702383 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:17.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.584+0000 7f6c762de700 1 --2- 172.21.15.146:0/1910702383 >> v2:172.21.15.146:3300/0 conn(0x7f6c701356e0 0x7f6c70137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.584+0000 7f6c752dc700 1 --2- 172.21.15.146:0/1910702383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700a1510 0x7f6c701351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.584+0000 7fbfe6d17700 1 --2- 172.21.15.146:0/4292246173 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbfe0139280 0x7fbfe013b660 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009e50 tx=0x7fbfd800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22c8a50e3a768706 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.585+0000 7f6c752dc700 1 -- 172.21.15.146:0/1910702383 >> v2:172.21.15.146:3300/0 conn(0x7f6c701356e0 msgr2=0x7f6c70137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:17.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.585+0000 7f6c752dc700 1 --2- 172.21.15.146:0/1910702383 >> v2:172.21.15.146:3300/0 conn(0x7f6c701356e0 0x7f6c70137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.585+0000 7fbfe5514700 1 -- 172.21.15.146:0/4292246173 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd800e070 con 0x7fbfe0139280 2023-10-03T10:15:17.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.585+0000 7fbfe5514700 1 -- 172.21.15.146:0/4292246173 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd8003a20 con 0x7fbfe0139280 2023-10-03T10:15:17.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.585+0000 7f6c752dc700 1 -- 172.21.15.146:0/1910702383 >> v1:172.21.15.146:6789/0 conn(0x7f6c700a0a30 legacy=0x7f6c700a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.585+0000 7f6c752dc700 1 -- 172.21.15.146:0/1910702383 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7009abc0 con 0x7f6c700a1510 2023-10-03T10:15:17.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.585+0000 7fbfe5514700 1 -- 172.21.15.146:0/4292246173 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8003dd0 con 0x7fbfe0139280 2023-10-03T10:15:17.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.585+0000 7f6c752dc700 1 --2- 172.21.15.146:0/1910702383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700a1510 0x7f6c701351a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000a9e0 tx=0x7f6c6000acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51ebeffcea0330c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.585+0000 7f6c74adb700 1 -- 172.21.15.146:0/1910702383 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6000cb70 con 0x7f6c700a1510 2023-10-03T10:15:17.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.585+0000 7f6c74adb700 1 -- 172.21.15.146:0/1910702383 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6000ccd0 con 0x7f6c700a1510 2023-10-03T10:15:17.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.585+0000 7f6c74adb700 1 -- 172.21.15.146:0/1910702383 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6000f690 con 0x7f6c700a1510 2023-10-03T10:15:17.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.586+0000 7fbfe877a700 1 -- 172.21.15.146:0/4292246173 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbfe0139280 msgr2=0x7fbfe013b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.586+0000 7fbfe877a700 1 --2- 172.21.15.146:0/4292246173 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbfe0139280 0x7fbfe013b660 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009e50 tx=0x7fbfd800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:17.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.586+0000 7f6c77d41700 1 -- 172.21.15.146:0/1910702383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700a1510 msgr2=0x7f6c701351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.586+0000 7f6c77d41700 1 --2- 172.21.15.146:0/1910702383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700a1510 0x7f6c701351a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000a9e0 tx=0x7f6c6000acf0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.586+0000 7fbfe877a700 1 -- 172.21.15.146:0/4292246173 shutdown_connections 2023-10-03T10:15:17.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.586+0000 7fbfe877a700 1 --2- 172.21.15.146:0/4292246173 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbfe0139280 0x7fbfe013b660 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.586+0000 7fbfe877a700 1 --2- 172.21.15.146:0/4292246173 >> v2:172.21.15.146:3300/0 conn(0x7fbfe0136960 0x7fbfe0138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.586+0000 7fbfe877a700 1 -- 172.21.15.146:0/4292246173 >> 172.21.15.146:0/4292246173 conn(0x7fbfe0099c40 msgr2=0x7fbfe00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.586+0000 7f6c77d41700 1 -- 172.21.15.146:0/1910702383 shutdown_connections 2023-10-03T10:15:17.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.586+0000 7f6c77d41700 1 --2- 172.21.15.146:0/1910702383 >> v2:172.21.15.146:3300/0 conn(0x7f6c701356e0 0x7f6c70137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.586+0000 7f6c77d41700 1 --2- 172.21.15.146:0/1910702383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700a1510 0x7f6c701351a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.586+0000 7f6c77d41700 1 -- 172.21.15.146:0/1910702383 >> 172.21.15.146:0/1910702383 conn(0x7f6c700a2980 msgr2=0x7f6c700a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.586+0000 7fbfe877a700 1 -- 172.21.15.146:0/4292246173 shutdown_connections 2023-10-03T10:15:17.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.586+0000 7fbfe877a700 1 -- 172.21.15.146:0/4292246173 wait complete. 2023-10-03T10:15:17.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.586+0000 7f6c77d41700 1 -- 172.21.15.146:0/1910702383 shutdown_connections 2023-10-03T10:15:17.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.586+0000 7f6c77d41700 1 -- 172.21.15.146:0/1910702383 wait complete. 2023-10-03T10:15:17.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.587+0000 7fbfe877a700 1 Processor -- start 2023-10-03T10:15:17.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.588+0000 7f6c77d41700 1 Processor -- start 2023-10-03T10:15:17.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.588+0000 7f6c77d41700 1 -- start start 2023-10-03T10:15:17.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.587+0000 7fbfe877a700 1 -- start start 2023-10-03T10:15:17.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.588+0000 7fbfe877a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbfe0133ad0 0x7fbfe006f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.588+0000 7fbfe877a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbfe0136960 0x7fbfe0071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.588+0000 7fbfe877a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbfe0139280 0x7fbfe00715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.588+0000 7fbfe877a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe011d790 con 0x7fbfe0139280 2023-10-03T10:15:17.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.588+0000 7fbfe877a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe0070220 con 0x7fbfe0133ad0 2023-10-03T10:15:17.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.588+0000 7fbfe877a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe006fc70 con 0x7fbfe0136960 2023-10-03T10:15:17.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.588+0000 7fbfe6516700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbfe0133ad0 0x7fbfe006f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.588+0000 7fbfe6516700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbfe0133ad0 0x7fbfe006f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44134/0 (socket says 172.21.15.146:44134) 2023-10-03T10:15:17.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.588+0000 7fbfe6516700 1 -- 172.21.15.146:0/479420067 learned_addr learned my addr 172.21.15.146:0/479420067 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:17.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.588+0000 7fbfe6d17700 1 --2- 172.21.15.146:0/479420067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbfe0139280 0x7fbfe00715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.588+0000 7fbfe5d15700 1 --2- 172.21.15.146:0/479420067 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbfe0136960 0x7fbfe0071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.588+0000 7f6c77d41700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c700a0a30 0x7f6c701232c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.588+0000 7f6c77d41700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700a1510 0x7f6c70123800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.588+0000 7f6c77d41700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c701356e0 0x7f6c70123d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.588+0000 7f6c77d41700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c70126b00 con 0x7f6c700a0a30 2023-10-03T10:15:17.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.588+0000 7f6c77d41700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c70071090 con 0x7f6c700a1510 2023-10-03T10:15:17.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.588+0000 7f6c77d41700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c70124700 con 0x7f6c701356e0 2023-10-03T10:15:17.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.588+0000 7f6c762de700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c701356e0 0x7f6c70123d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.588+0000 7f6c762de700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c701356e0 0x7f6c70123d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58552/0 (socket says 172.21.15.146:58552) 2023-10-03T10:15:17.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.588+0000 7f6c762de700 1 -- 172.21.15.146:0/460253283 learned_addr learned my addr 172.21.15.146:0/460253283 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:17.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.589+0000 7f6c752dc700 1 --2- 172.21.15.146:0/460253283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700a1510 0x7f6c70123800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.589+0000 7f6c75add700 1 --2- 172.21.15.146:0/460253283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c700a0a30 0x7f6c701232c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.589+0000 7fbfe5d15700 1 -- 172.21.15.146:0/479420067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbfe0133ad0 msgr2=0x7fbfe006f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.589+0000 7fbfe5d15700 1 --2- 172.21.15.146:0/479420067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbfe0133ad0 0x7fbfe006f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.589+0000 7fbfe5d15700 1 -- 172.21.15.146:0/479420067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbfe0139280 msgr2=0x7fbfe00715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.589+0000 7fbfe5d15700 1 --2- 172.21.15.146:0/479420067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbfe0139280 0x7fbfe00715b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.589+0000 7fbfe5d15700 1 -- 172.21.15.146:0/479420067 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd8009b30 con 0x7fbfe0136960 2023-10-03T10:15:17.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.589+0000 7fbfe6516700 1 --2- 172.21.15.146:0/479420067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbfe0133ad0 0x7fbfe006f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:17.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.589+0000 7fbfe5d15700 1 --2- 172.21.15.146:0/479420067 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbfe0136960 0x7fbfe0071070 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbfd000b450 tx=0x7fbfd000b760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.589+0000 7f6c762de700 1 -- 172.21.15.146:0/460253283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700a1510 msgr2=0x7f6c70123800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.589+0000 7f6c762de700 1 --2- 172.21.15.146:0/460253283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700a1510 0x7f6c70123800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.589+0000 7f6c762de700 1 -- 172.21.15.146:0/460253283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c700a0a30 msgr2=0x7f6c701232c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.589+0000 7f6c762de700 1 --2- 172.21.15.146:0/460253283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c700a0a30 0x7f6c701232c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.589+0000 7f6c762de700 1 -- 172.21.15.146:0/460253283 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6000a640 con 0x7f6c701356e0 2023-10-03T10:15:17.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.589+0000 7f6c762de700 1 --2- 172.21.15.146:0/460253283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c701356e0 0x7f6c70123d40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6c68009e30 tx=0x7f6c6800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.589+0000 7fbfd6ffd700 1 -- 172.21.15.146:0/479420067 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0011830 con 0x7fbfe0136960 2023-10-03T10:15:17.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.589+0000 7fbfd6ffd700 1 -- 172.21.15.146:0/479420067 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd00119b0 con 0x7fbfe0136960 2023-10-03T10:15:17.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.589+0000 7fbfd6ffd700 1 -- 172.21.15.146:0/479420067 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0011da0 con 0x7fbfe0136960 2023-10-03T10:15:17.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.589+0000 7fbfe877a700 1 -- 172.21.15.146:0/479420067 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe0070490 con 0x7fbfe0136960 2023-10-03T10:15:17.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.589+0000 7fbfe877a700 1 -- 172.21.15.146:0/479420067 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe01309b0 con 0x7fbfe0136960 2023-10-03T10:15:17.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.590+0000 7f6c667fc700 1 -- 172.21.15.146:0/460253283 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c68009ca0 con 0x7f6c701356e0 2023-10-03T10:15:17.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.590+0000 7f6c667fc700 1 -- 172.21.15.146:0/460253283 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6800f040 con 0x7f6c701356e0 2023-10-03T10:15:17.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.590+0000 7f6c77d41700 1 -- 172.21.15.146:0/460253283 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c70124fe0 con 0x7f6c701356e0 2023-10-03T10:15:17.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.590+0000 7f6c667fc700 1 -- 172.21.15.146:0/460253283 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c68014480 con 0x7f6c701356e0 2023-10-03T10:15:17.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.590+0000 7f6c77d41700 1 -- 172.21.15.146:0/460253283 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c70127570 con 0x7f6c701356e0 2023-10-03T10:15:17.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.590+0000 7fbfd6ffd700 1 -- 172.21.15.146:0/479420067 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbfd001a400 con 0x7fbfe0136960 2023-10-03T10:15:17.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.591+0000 7fbfd6ffd700 1 -- 172.21.15.146:0/479420067 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbfd003f680 con 0x7fbfe0136960 2023-10-03T10:15:17.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.591+0000 7f6c667fc700 1 -- 172.21.15.146:0/460253283 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c680145e0 con 0x7f6c701356e0 2023-10-03T10:15:17.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.591+0000 7f6c667fc700 1 -- 172.21.15.146:0/460253283 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6c68040330 con 0x7f6c701356e0 2023-10-03T10:15:17.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.591+0000 7fbfe877a700 1 -- 172.21.15.146:0/479420067 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe006be10 con 0x7fbfe0136960 2023-10-03T10:15:17.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.591+0000 7f6c77d41700 1 -- 172.21.15.146:0/460253283 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7004f2a0 con 0x7f6c701356e0 2023-10-03T10:15:17.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.599+0000 7fbfd6ffd700 1 -- 172.21.15.146:0/479420067 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbfd0015020 con 0x7fbfe0136960 2023-10-03T10:15:17.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.608+0000 7f6c667fc700 1 -- 172.21.15.146:0/460253283 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c68007920 con 0x7f6c701356e0 2023-10-03T10:15:17.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.641+0000 7fd450a2d700 1 Processor -- start 2023-10-03T10:15:17.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.641+0000 7fd450a2d700 1 -- start start 2023-10-03T10:15:17.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.641+0000 7fd450a2d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd44c09ad40 0x7fd44c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.641+0000 7fd450a2d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd44c133f70 0x7fd44c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.641+0000 7fd450a2d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44c09b110 con 0x7fd44c0a0a70 2023-10-03T10:15:17.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.641+0000 7fd450a2d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0a3b60 con 0x7fd44c09ad40 2023-10-03T10:15:17.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.641+0000 7fd450a2d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c1348e0 con 0x7fd44c133f70 2023-10-03T10:15:17.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.642+0000 7fd44a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd44c09ad40 0x7fd44c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.642+0000 7fd44ad9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd44c0a0a70 0x7fd44c0a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60304/0 (socket says 172.21.15.146:60304) 2023-10-03T10:15:17.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.642+0000 7fd44ad9d700 1 -- 172.21.15.146:0/2603069432 learned_addr learned my addr 172.21.15.146:0/2603069432 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:17.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.642+0000 7fd44959a700 1 -- 172.21.15.146:0/2603069432 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4107655359 0 0) 0x7fd44c09b110 con 0x7fd44c0a0a70 2023-10-03T10:15:17.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.642+0000 7fd44959a700 1 -- 172.21.15.146:0/2603069432 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4340035b0 con 0x7fd44c0a0a70 2023-10-03T10:15:17.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.642+0000 7fd449d9b700 1 --2- 172.21.15.146:0/2603069432 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd44c133f70 0x7fd44c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.642+0000 7fd44a59c700 1 -- 172.21.15.146:0/2603069432 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd44c133f70 msgr2=0x7fd44c1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:17.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.642+0000 7fd44a59c700 1 --2- 172.21.15.146:0/2603069432 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd44c133f70 0x7fd44c1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.642+0000 7fd44a59c700 1 -- 172.21.15.146:0/2603069432 >> v1:172.21.15.146:6789/0 conn(0x7fd44c0a0a70 legacy=0x7fd44c0a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.642+0000 7fd44959a700 1 -- 172.21.15.146:0/2603069432 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1107941675 0 0) 0x7fd4340035b0 con 0x7fd44c0a0a70 2023-10-03T10:15:17.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.642+0000 7fd44a59c700 1 -- 172.21.15.146:0/2603069432 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c0a2fa0 con 0x7fd44c09ad40 2023-10-03T10:15:17.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.643+0000 7fd44a59c700 1 --2- 172.21.15.146:0/2603069432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd44c09ad40 0x7fd44c133a30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd43c009870 tx=0x7fd43c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a273df944100a1b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.643+0000 7fd44959a700 1 -- 172.21.15.146:0/2603069432 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4440019f0 con 0x7fd44c09ad40 2023-10-03T10:15:17.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.643+0000 7fd44959a700 1 -- 172.21.15.146:0/2603069432 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43c004030 con 0x7fd44c09ad40 2023-10-03T10:15:17.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.643+0000 7fd44959a700 1 -- 172.21.15.146:0/2603069432 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c0043c0 con 0x7fd44c09ad40 2023-10-03T10:15:17.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.643+0000 7fd450a2d700 1 -- 172.21.15.146:0/2603069432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd44c09ad40 msgr2=0x7fd44c133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.643+0000 7fd450a2d700 1 --2- 172.21.15.146:0/2603069432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd44c09ad40 0x7fd44c133a30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd43c009870 tx=0x7fd43c009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:17.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.643+0000 7fd450a2d700 1 -- 172.21.15.146:0/2603069432 shutdown_connections 2023-10-03T10:15:17.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.643+0000 7fd450a2d700 1 --2- 172.21.15.146:0/2603069432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd44c09ad40 0x7fd44c133a30 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.643+0000 7fd450a2d700 1 --2- 172.21.15.146:0/2603069432 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd44c133f70 0x7fd44c1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.643+0000 7fd450a2d700 1 -- 172.21.15.146:0/2603069432 >> 172.21.15.146:0/2603069432 conn(0x7fd44c099c40 msgr2=0x7fd44c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.643+0000 7fd450a2d700 1 -- 172.21.15.146:0/2603069432 shutdown_connections 2023-10-03T10:15:17.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.644+0000 7fd450a2d700 1 -- 172.21.15.146:0/2603069432 wait complete. 2023-10-03T10:15:17.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.645+0000 7fd450a2d700 1 Processor -- start 2023-10-03T10:15:17.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.645+0000 7fd450a2d700 1 -- start start 2023-10-03T10:15:17.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.645+0000 7fd450a2d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd44c09ad40 0x7fd44c06dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.645+0000 7fd450a2d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd44c0a0a70 0x7fd44c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.645+0000 7fd450a2d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd44c133f70 0x7fd44c06e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.645+0000 7fd450a2d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c06ef70 con 0x7fd44c0a0a70 2023-10-03T10:15:17.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.645+0000 7fd450a2d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c071590 con 0x7fd44c133f70 2023-10-03T10:15:17.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.645+0000 7fd450a2d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c070ff0 con 0x7fd44c09ad40 2023-10-03T10:15:17.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.645+0000 7fd449d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd44c0a0a70 0x7fd44c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.645+0000 7fd44a59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd44c09ad40 0x7fd44c06dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.645+0000 7fd449d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd44c0a0a70 0x7fd44c06e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41418/0 (socket says 172.21.15.146:41418) 2023-10-03T10:15:17.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.645+0000 7fd449d9b700 1 -- 172.21.15.146:0/657879292 learned_addr learned my addr 172.21.15.146:0/657879292 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:17.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.645+0000 7fd44ad9d700 1 --2- 172.21.15.146:0/657879292 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd44c133f70 0x7fd44c06e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.646+0000 7fd449d9b700 1 -- 172.21.15.146:0/657879292 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd44c09ad40 msgr2=0x7fd44c06dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.646+0000 7fd449d9b700 1 --2- 172.21.15.146:0/657879292 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd44c09ad40 0x7fd44c06dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.646+0000 7fd449d9b700 1 -- 172.21.15.146:0/657879292 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd44c133f70 msgr2=0x7fd44c06e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.646+0000 7fd449d9b700 1 --2- 172.21.15.146:0/657879292 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd44c133f70 0x7fd44c06e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.646+0000 7fd449d9b700 1 -- 172.21.15.146:0/657879292 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c0094a0 con 0x7fd44c0a0a70 2023-10-03T10:15:17.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.646+0000 7fd44a59c700 1 --2- 172.21.15.146:0/657879292 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd44c09ad40 0x7fd44c06dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:17.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.646+0000 7fd449d9b700 1 --2- 172.21.15.146:0/657879292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd44c0a0a70 0x7fd44c06e000 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fd44000e9b0 tx=0x7fd44000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.646+0000 7fd43affd700 1 -- 172.21.15.146:0/657879292 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440009710 con 0x7fd44c0a0a70 2023-10-03T10:15:17.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.646+0000 7fd43affd700 1 -- 172.21.15.146:0/657879292 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44000ee50 con 0x7fd44c0a0a70 2023-10-03T10:15:17.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.646+0000 7fd450a2d700 1 -- 172.21.15.146:0/657879292 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44c09c7e0 con 0x7fd44c0a0a70 2023-10-03T10:15:17.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.646+0000 7fd43affd700 1 -- 172.21.15.146:0/657879292 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44000ca70 con 0x7fd44c0a0a70 2023-10-03T10:15:17.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.646+0000 7fd450a2d700 1 -- 172.21.15.146:0/657879292 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44c070d20 con 0x7fd44c0a0a70 2023-10-03T10:15:17.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.647+0000 7fd43affd700 1 -- 172.21.15.146:0/657879292 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd44000cbd0 con 0x7fd44c0a0a70 2023-10-03T10:15:17.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.647+0000 7fd43affd700 1 -- 172.21.15.146:0/657879292 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd44003f6c0 con 0x7fd44c0a0a70 2023-10-03T10:15:17.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.648+0000 7fd450a2d700 1 -- 172.21.15.146:0/657879292 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd44c04f2a0 con 0x7fd44c0a0a70 2023-10-03T10:15:17.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.652+0000 7fd43affd700 1 -- 172.21.15.146:0/657879292 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd44001bdf0 con 0x7fd44c0a0a70 2023-10-03T10:15:17.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.684+0000 7f52bffc5700 1 Processor -- start 2023-10-03T10:15:17.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.684+0000 7f52bffc5700 1 -- start start 2023-10-03T10:15:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.685+0000 7f52bffc5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b812d280 0x7f52b812d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.685+0000 7f52bffc5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52b8130eb0 0x7f52b8138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.685+0000 7f52bffc5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b809ae40 con 0x7f52b8130350 2023-10-03T10:15:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.685+0000 7f52bffc5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52b809b9a0 con 0x7f52b8130eb0 2023-10-03T10:15:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.685+0000 7f52bffc5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52b809bbb0 con 0x7f52b812d280 2023-10-03T10:15:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.685+0000 7f52bdd61700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b812d280 0x7f52b812d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.685+0000 7f52bdd61700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b812d280 0x7f52b812d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58578/0 (socket says 172.21.15.146:58578) 2023-10-03T10:15:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.685+0000 7f52bdd61700 1 -- 172.21.15.146:0/3558246967 learned_addr learned my addr 172.21.15.146:0/3558246967 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.685+0000 7f52be562700 1 --2- 172.21.15.146:0/3558246967 >> v2:172.21.15.146:3300/0 conn(0x7f52b8130eb0 0x7f52b8138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.686+0000 7f52bdd61700 1 -- 172.21.15.146:0/3558246967 >> v2:172.21.15.146:3300/0 conn(0x7f52b8130eb0 msgr2=0x7f52b8138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.686+0000 7f52bdd61700 1 --2- 172.21.15.146:0/3558246967 >> v2:172.21.15.146:3300/0 conn(0x7f52b8130eb0 0x7f52b8138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.686+0000 7f52bdd61700 1 -- 172.21.15.146:0/3558246967 >> v1:172.21.15.146:6789/0 conn(0x7f52b8130350 legacy=0x7f52b81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.686+0000 7f52bdd61700 1 -- 172.21.15.146:0/3558246967 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b809b250 con 0x7f52b812d280 2023-10-03T10:15:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.686+0000 7f52bdd61700 1 --2- 172.21.15.146:0/3558246967 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b812d280 0x7f52b812d650 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f52b4006fd0 tx=0x7f52b4009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9beee2b5d113161a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.686+0000 7f52bcd5f700 1 -- 172.21.15.146:0/3558246967 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4005e30 con 0x7f52b812d280 2023-10-03T10:15:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.686+0000 7f52bcd5f700 1 -- 172.21.15.146:0/3558246967 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b4004030 con 0x7f52b812d280 2023-10-03T10:15:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.686+0000 7f52bcd5f700 1 -- 172.21.15.146:0/3558246967 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b40043e0 con 0x7f52b812d280 2023-10-03T10:15:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.687+0000 7f52bffc5700 1 -- 172.21.15.146:0/3558246967 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b812d280 msgr2=0x7f52b812d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.687+0000 7f52bffc5700 1 --2- 172.21.15.146:0/3558246967 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b812d280 0x7f52b812d650 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f52b4006fd0 tx=0x7f52b4009bd0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.687+0000 7f52bffc5700 1 -- 172.21.15.146:0/3558246967 shutdown_connections 2023-10-03T10:15:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.687+0000 7f52bffc5700 1 --2- 172.21.15.146:0/3558246967 >> v2:172.21.15.146:3300/0 conn(0x7f52b8130eb0 0x7f52b8138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.687+0000 7f52bffc5700 1 --2- 172.21.15.146:0/3558246967 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b812d280 0x7f52b812d650 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.687+0000 7f52bffc5700 1 -- 172.21.15.146:0/3558246967 >> 172.21.15.146:0/3558246967 conn(0x7f52b80a2980 msgr2=0x7f52b80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.687+0000 7f52bffc5700 1 -- 172.21.15.146:0/3558246967 shutdown_connections 2023-10-03T10:15:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.687+0000 7f52bffc5700 1 -- 172.21.15.146:0/3558246967 wait complete. 2023-10-03T10:15:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.688+0000 7f52bffc5700 1 Processor -- start 2023-10-03T10:15:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.688+0000 7f52bffc5700 1 -- start start 2023-10-03T10:15:17.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.688+0000 7f52bffc5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52b812d280 0x7f52b813ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.688+0000 7f52bffc5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b8130350 0x7f52b8132cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.688+0000 7f52bffc5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b8130eb0 0x7f52b8133200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.688+0000 7f52bffc5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b81347d0 con 0x7f52b8130350 2023-10-03T10:15:17.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.688+0000 7f52bffc5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b8135270 con 0x7f52b812d280 2023-10-03T10:15:17.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.688+0000 7f52bffc5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52b8135a20 con 0x7f52b8130eb0 2023-10-03T10:15:17.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.688+0000 7f52bd560700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b8130350 0x7f52b8132cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.688+0000 7f52bd560700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b8130350 0x7f52b8132cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41436/0 (socket says 172.21.15.146:41436) 2023-10-03T10:15:17.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.688+0000 7f52bd560700 1 -- 172.21.15.146:0/3517312404 learned_addr learned my addr 172.21.15.146:0/3517312404 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:17.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.688+0000 7f52be562700 1 --2- 172.21.15.146:0/3517312404 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b8130eb0 0x7f52b8133200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.688+0000 7f52bd560700 1 -- 172.21.15.146:0/3517312404 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b8130eb0 msgr2=0x7f52b8133200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.688+0000 7f52bd560700 1 --2- 172.21.15.146:0/3517312404 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b8130eb0 0x7f52b8133200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.689+0000 7f52bd560700 1 -- 172.21.15.146:0/3517312404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52b812d280 msgr2=0x7f52b813ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.689+0000 7f52bd560700 1 --2- 172.21.15.146:0/3517312404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52b812d280 0x7f52b813ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.689+0000 7f52bd560700 1 -- 172.21.15.146:0/3517312404 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b4009500 con 0x7f52b8130350 2023-10-03T10:15:17.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.689+0000 7f52bd560700 1 --2- 172.21.15.146:0/3517312404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b8130350 0x7f52b8132cc0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f52a800c4b0 tx=0x7f52a800c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.689+0000 7f52ae7fc700 1 -- 172.21.15.146:0/3517312404 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a80052d0 con 0x7f52b8130350 2023-10-03T10:15:17.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.689+0000 7f52bffc5700 1 -- 172.21.15.146:0/3517312404 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b813b350 con 0x7f52b8130350 2023-10-03T10:15:17.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.689+0000 7f52ae7fc700 1 -- 172.21.15.146:0/3517312404 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a8005430 con 0x7f52b8130350 2023-10-03T10:15:17.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.689+0000 7f52ae7fc700 1 -- 172.21.15.146:0/3517312404 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a80038c0 con 0x7f52b8130350 2023-10-03T10:15:17.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.690+0000 7f52bffc5700 1 -- 172.21.15.146:0/3517312404 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b8135e70 con 0x7f52b8130350 2023-10-03T10:15:17.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.690+0000 7f52ae7fc700 1 -- 172.21.15.146:0/3517312404 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52a8003a20 con 0x7f52b8130350 2023-10-03T10:15:17.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.691+0000 7f52bffc5700 1 -- 172.21.15.146:0/3517312404 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b804f2a0 con 0x7f52b8130350 2023-10-03T10:15:17.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.691+0000 7f52ae7fc700 1 -- 172.21.15.146:0/3517312404 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f52a8010e00 con 0x7f52b8130350 2023-10-03T10:15:17.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.695+0000 7f52ae7fc700 1 -- 172.21.15.146:0/3517312404 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52a8017070 con 0x7f52b8130350 2023-10-03T10:15:17.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.848+0000 7fd450a2d700 1 -- 172.21.15.146:0/657879292 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd44c133c40 con 0x7fd44c0a0a70 2023-10-03T10:15:17.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.848+0000 7fd43affd700 1 -- 172.21.15.146:0/657879292 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd440017030 con 0x7fd44c0a0a70 2023-10-03T10:15:17.849 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:17.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.851+0000 7fd450a2d700 1 -- 172.21.15.146:0/657879292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd44c0a0a70 msgr2=0x7fd44c06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.851+0000 7fd450a2d700 1 --2- 172.21.15.146:0/657879292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd44c0a0a70 0x7fd44c06e000 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fd44000e9b0 tx=0x7fd44000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.851+0000 7fd450a2d700 1 -- 172.21.15.146:0/657879292 shutdown_connections 2023-10-03T10:15:17.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.851+0000 7fd450a2d700 1 --2- 172.21.15.146:0/657879292 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd44c133f70 0x7fd44c06e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.851+0000 7fd450a2d700 1 --2- 172.21.15.146:0/657879292 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd44c09ad40 0x7fd44c06dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.851+0000 7fd450a2d700 1 --2- 172.21.15.146:0/657879292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd44c0a0a70 0x7fd44c06e000 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.851+0000 7fd450a2d700 1 -- 172.21.15.146:0/657879292 >> 172.21.15.146:0/657879292 conn(0x7fd44c099c40 msgr2=0x7fd44c1bbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.851+0000 7fd450a2d700 1 -- 172.21.15.146:0/657879292 shutdown_connections 2023-10-03T10:15:17.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.851+0000 7fd450a2d700 1 -- 172.21.15.146:0/657879292 wait complete. 2023-10-03T10:15:17.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.857+0000 7fbfe877a700 1 -- 172.21.15.146:0/479420067 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbfe0138810 con 0x7fbfe0136960 2023-10-03T10:15:17.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.858+0000 7fbfd6ffd700 1 -- 172.21.15.146:0/479420067 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbfd0029090 con 0x7fbfe0136960 2023-10-03T10:15:17.858 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:17.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.861+0000 7fbfe877a700 1 -- 172.21.15.146:0/479420067 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbfe0136960 msgr2=0x7fbfe0071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.861+0000 7fbfe877a700 1 --2- 172.21.15.146:0/479420067 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbfe0136960 0x7fbfe0071070 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbfd000b450 tx=0x7fbfd000b760 comp rx=0 tx=0).stop 2023-10-03T10:15:17.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.861+0000 7fbfe877a700 1 -- 172.21.15.146:0/479420067 shutdown_connections 2023-10-03T10:15:17.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.861+0000 7fbfe877a700 1 --2- 172.21.15.146:0/479420067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbfe0139280 0x7fbfe00715b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.861+0000 7fbfe877a700 1 --2- 172.21.15.146:0/479420067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbfe0133ad0 0x7fbfe006f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.861+0000 7fbfe877a700 1 --2- 172.21.15.146:0/479420067 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbfe0136960 0x7fbfe0071070 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.861+0000 7fbfe877a700 1 -- 172.21.15.146:0/479420067 >> 172.21.15.146:0/479420067 conn(0x7fbfe0099c40 msgr2=0x7fbfe00a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.862+0000 7fbfe877a700 1 -- 172.21.15.146:0/479420067 shutdown_connections 2023-10-03T10:15:17.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.862+0000 7fbfe877a700 1 -- 172.21.15.146:0/479420067 wait complete. 2023-10-03T10:15:17.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:17.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.868+0000 7f6c77d41700 1 -- 172.21.15.146:0/460253283 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6c700721f0 con 0x7f6c701356e0 2023-10-03T10:15:17.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.869+0000 7f6c667fc700 1 -- 172.21.15.146:0/460253283 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c6802c090 con 0x7f6c701356e0 2023-10-03T10:15:17.869 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:17.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.871+0000 7f6c77d41700 1 -- 172.21.15.146:0/460253283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c701356e0 msgr2=0x7f6c70123d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.871+0000 7f6c77d41700 1 --2- 172.21.15.146:0/460253283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c701356e0 0x7f6c70123d40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6c68009e30 tx=0x7f6c6800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.871+0000 7f6c77d41700 1 -- 172.21.15.146:0/460253283 shutdown_connections 2023-10-03T10:15:17.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.871+0000 7f6c77d41700 1 --2- 172.21.15.146:0/460253283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c701356e0 0x7f6c70123d40 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.871+0000 7f6c77d41700 1 --2- 172.21.15.146:0/460253283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c700a0a30 0x7f6c701232c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.871+0000 7f6c77d41700 1 --2- 172.21.15.146:0/460253283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c700a1510 0x7f6c70123800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.871+0000 7f6c77d41700 1 -- 172.21.15.146:0/460253283 >> 172.21.15.146:0/460253283 conn(0x7f6c700a2980 msgr2=0x7f6c7009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.871+0000 7f6c77d41700 1 -- 172.21.15.146:0/460253283 shutdown_connections 2023-10-03T10:15:17.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.871+0000 7f6c77d41700 1 -- 172.21.15.146:0/460253283 wait complete. 2023-10-03T10:15:17.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:17.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:17.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.889+0000 7f52bffc5700 1 -- 172.21.15.146:0/3517312404 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f52b806bce0 con 0x7f52b8130350 2023-10-03T10:15:17.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.890+0000 7f52ae7fc700 1 -- 172.21.15.146:0/3517312404 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f52a8017070 con 0x7f52b8130350 2023-10-03T10:15:17.891 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:17.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.892+0000 7f52bffc5700 1 -- 172.21.15.146:0/3517312404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b8130350 msgr2=0x7f52b8132cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.892+0000 7f52bffc5700 1 --2- 172.21.15.146:0/3517312404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b8130350 0x7f52b8132cc0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f52a800c4b0 tx=0x7f52a800c7c0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.892+0000 7f52bffc5700 1 -- 172.21.15.146:0/3517312404 shutdown_connections 2023-10-03T10:15:17.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.892+0000 7f52bffc5700 1 --2- 172.21.15.146:0/3517312404 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b8130eb0 0x7f52b8133200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.892+0000 7f52bffc5700 1 --2- 172.21.15.146:0/3517312404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52b812d280 0x7f52b813ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.892+0000 7f52bffc5700 1 --2- 172.21.15.146:0/3517312404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b8130350 0x7f52b8132cc0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.892+0000 7f52bffc5700 1 -- 172.21.15.146:0/3517312404 >> 172.21.15.146:0/3517312404 conn(0x7f52b80a2980 msgr2=0x7f52b809d300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.892+0000 7f52bffc5700 1 -- 172.21.15.146:0/3517312404 shutdown_connections 2023-10-03T10:15:17.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:17.892+0000 7f52bffc5700 1 -- 172.21.15.146:0/3517312404 wait complete. 2023-10-03T10:15:17.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:18.866 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:18.876 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:18.885 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:18.905 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:19.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.012+0000 7f9395d99700 1 Processor -- start 2023-10-03T10:15:19.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.012+0000 7f9395d99700 1 -- start start 2023-10-03T10:15:19.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.013+0000 7f9395d99700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9390133ad0 0x7f9390133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.013+0000 7f9395d99700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9390130bc0 0x7f939013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.013+0000 7f9395d99700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f939006b2d0 con 0x7f93901300a0 2023-10-03T10:15:19.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.013+0000 7f9395d99700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9390133610 con 0x7f9390133ad0 2023-10-03T10:15:19.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.013+0000 7f9395d99700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f939009a500 con 0x7f9390130bc0 2023-10-03T10:15:19.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.013+0000 7f938f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9390133ad0 0x7f9390133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.013+0000 7f938effd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f93901300a0 0x7f93901304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60332/0 (socket says 172.21.15.146:60332) 2023-10-03T10:15:19.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.013+0000 7f938effd700 1 -- 172.21.15.146:0/1478022585 learned_addr learned my addr 172.21.15.146:0/1478022585 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:19.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.013+0000 7f938ffff700 1 --2- 172.21.15.146:0/1478022585 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9390130bc0 0x7f939013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.013+0000 7f938f7fe700 1 -- 172.21.15.146:0/1478022585 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9390130bc0 msgr2=0x7f939013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.013+0000 7f938f7fe700 1 --2- 172.21.15.146:0/1478022585 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9390130bc0 0x7f939013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.013+0000 7f938f7fe700 1 -- 172.21.15.146:0/1478022585 >> v1:172.21.15.146:6789/0 conn(0x7f93901300a0 legacy=0x7f93901304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.013+0000 7f938f7fe700 1 -- 172.21.15.146:0/1478022585 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93901338b0 con 0x7f9390133ad0 2023-10-03T10:15:19.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.013+0000 7f938f7fe700 1 --2- 172.21.15.146:0/1478022585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9390133ad0 0x7f9390133ea0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f9380009840 tx=0x7f9380009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82d400404d9eafa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.013+0000 7f938e7fc700 1 -- 172.21.15.146:0/1478022585 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9380011830 con 0x7f9390133ad0 2023-10-03T10:15:19.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.014+0000 7f938e7fc700 1 -- 172.21.15.146:0/1478022585 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9380011990 con 0x7f9390133ad0 2023-10-03T10:15:19.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.014+0000 7f938e7fc700 1 -- 172.21.15.146:0/1478022585 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9380011d00 con 0x7f9390133ad0 2023-10-03T10:15:19.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.014+0000 7f9395d99700 1 -- 172.21.15.146:0/1478022585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9390133ad0 msgr2=0x7f9390133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.014+0000 7f9395d99700 1 --2- 172.21.15.146:0/1478022585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9390133ad0 0x7f9390133ea0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f9380009840 tx=0x7f9380009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:19.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.014+0000 7f9395d99700 1 -- 172.21.15.146:0/1478022585 shutdown_connections 2023-10-03T10:15:19.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.014+0000 7f9395d99700 1 --2- 172.21.15.146:0/1478022585 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9390130bc0 0x7f939013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.014+0000 7f9395d99700 1 --2- 172.21.15.146:0/1478022585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9390133ad0 0x7f9390133ea0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.014+0000 7f9395d99700 1 -- 172.21.15.146:0/1478022585 >> 172.21.15.146:0/1478022585 conn(0x7f9390099c40 msgr2=0x7f93900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.014+0000 7f9395d99700 1 -- 172.21.15.146:0/1478022585 shutdown_connections 2023-10-03T10:15:19.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.014+0000 7f9395d99700 1 -- 172.21.15.146:0/1478022585 wait complete. 2023-10-03T10:15:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.016+0000 7f9395d99700 1 Processor -- start 2023-10-03T10:15:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.016+0000 7f9395d99700 1 -- start start 2023-10-03T10:15:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.016+0000 7f9395d99700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93901300a0 0x7f939011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.016+0000 7f9395d99700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9390130bc0 0x7f939011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.016+0000 7f9395d99700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9390133ad0 0x7f939011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.016+0000 7f9395d99700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939012da10 con 0x7f9390130bc0 2023-10-03T10:15:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.016+0000 7f9395d99700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939012dd00 con 0x7f93901300a0 2023-10-03T10:15:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.016+0000 7f9395d99700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f939011fe50 con 0x7f9390133ad0 2023-10-03T10:15:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.017+0000 7f938f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93901300a0 0x7f939011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.017+0000 7f938f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93901300a0 0x7f939011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44200/0 (socket says 172.21.15.146:44200) 2023-10-03T10:15:19.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.017+0000 7f938f7fe700 1 -- 172.21.15.146:0/2708457133 learned_addr learned my addr 172.21.15.146:0/2708457133 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:19.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.017+0000 7f938ffff700 1 --2- 172.21.15.146:0/2708457133 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9390133ad0 0x7f939011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.017+0000 7f938effd700 1 --2- 172.21.15.146:0/2708457133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9390130bc0 0x7f939011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.017+0000 7f938ffff700 1 -- 172.21.15.146:0/2708457133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93901300a0 msgr2=0x7f939011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.017+0000 7f938ffff700 1 --2- 172.21.15.146:0/2708457133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93901300a0 0x7f939011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.017+0000 7f938ffff700 1 -- 172.21.15.146:0/2708457133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9390130bc0 msgr2=0x7f939011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.017+0000 7f938ffff700 1 --2- 172.21.15.146:0/2708457133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9390130bc0 0x7f939011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.017+0000 7f938ffff700 1 -- 172.21.15.146:0/2708457133 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93800094a0 con 0x7f9390133ad0 2023-10-03T10:15:19.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.017+0000 7f938effd700 1 --2- 172.21.15.146:0/2708457133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9390130bc0 0x7f939011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:19.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.017+0000 7f938f7fe700 1 --2- 172.21.15.146:0/2708457133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93901300a0 0x7f939011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:19.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.017+0000 7f938ffff700 1 --2- 172.21.15.146:0/2708457133 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9390133ad0 0x7f939011e4c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f938800efc0 tx=0x7f938800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.018+0000 7f9377fff700 1 -- 172.21.15.146:0/2708457133 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938800cc90 con 0x7f9390133ad0 2023-10-03T10:15:19.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.018+0000 7f9377fff700 1 -- 172.21.15.146:0/2708457133 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938800f040 con 0x7f9390133ad0 2023-10-03T10:15:19.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.018+0000 7f9377fff700 1 -- 172.21.15.146:0/2708457133 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93880146c0 con 0x7f9390133ad0 2023-10-03T10:15:19.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.018+0000 7f9395d99700 1 -- 172.21.15.146:0/2708457133 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f939012fe40 con 0x7f9390133ad0 2023-10-03T10:15:19.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.018+0000 7f9395d99700 1 -- 172.21.15.146:0/2708457133 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9390120a30 con 0x7f9390133ad0 2023-10-03T10:15:19.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.019+0000 7f9395d99700 1 -- 172.21.15.146:0/2708457133 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f939004f2a0 con 0x7f9390133ad0 2023-10-03T10:15:19.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.019+0000 7f9377fff700 1 -- 172.21.15.146:0/2708457133 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9388014820 con 0x7f9390133ad0 2023-10-03T10:15:19.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.019+0000 7f9377fff700 1 -- 172.21.15.146:0/2708457133 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f93880401d0 con 0x7f9390133ad0 2023-10-03T10:15:19.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.024+0000 7f9377fff700 1 -- 172.21.15.146:0/2708457133 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9388007900 con 0x7f9390133ad0 2023-10-03T10:15:19.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.048+0000 7fb0c7b2c700 1 Processor -- start 2023-10-03T10:15:19.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.048+0000 7fb0c7b2c700 1 -- start start 2023-10-03T10:15:19.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.048+0000 7fecebc0a700 1 Processor -- start 2023-10-03T10:15:19.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.048+0000 7fecebc0a700 1 -- start start 2023-10-03T10:15:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.048+0000 7fb0c7b2c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb0c009e870 0x7fb0c009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.048+0000 7fb0c7b2c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c009f180 0x7fb0c0131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.048+0000 7fb0c7b2c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c009c970 con 0x7fb0c0131d70 2023-10-03T10:15:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.048+0000 7fb0c7b2c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c00a0920 con 0x7fb0c009e870 2023-10-03T10:15:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.048+0000 7fb0c7b2c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c009f9c0 con 0x7fb0c009f180 2023-10-03T10:15:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fb0c50c7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c009f180 0x7fb0c0131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fb0c50c7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c009f180 0x7fb0c0131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44208/0 (socket says 172.21.15.146:44208) 2023-10-03T10:15:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fb0c50c7700 1 -- 172.21.15.146:0/1665547394 learned_addr learned my addr 172.21.15.146:0/1665547394 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fb0c58c8700 1 --2- 172.21.15.146:0/1665547394 >> v2:172.21.15.146:3300/0 conn(0x7fb0c009e870 0x7fb0c009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fecebc0a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fece4133a70 0x7fece4133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fecebc0a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fece40a1460 0x7fece413b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fecebc0a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece4133640 con 0x7fece40a08e0 2023-10-03T10:15:19.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fecebc0a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece40a1d50 con 0x7fece40a1460 2023-10-03T10:15:19.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fecebc0a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece409b620 con 0x7fece4133a70 2023-10-03T10:15:19.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fecea1a7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fece40a1460 0x7fece413b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fece99a6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fece4133a70 0x7fece4133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fecea1a7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fece40a1460 0x7fece413b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41478/0 (socket says 172.21.15.146:41478) 2023-10-03T10:15:19.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fece99a6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fece4133a70 0x7fece4133e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44224/0 (socket says 172.21.15.146:44224) 2023-10-03T10:15:19.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fecea1a7700 1 -- 172.21.15.146:0/3026567735 learned_addr learned my addr 172.21.15.146:0/3026567735 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:19.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fb0c48c6700 1 -- 172.21.15.146:0/1665547394 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538263399 0 0) 0x7fb0c009c970 con 0x7fb0c0131d70 2023-10-03T10:15:19.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fb0c48c6700 1 -- 172.21.15.146:0/1665547394 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0ac0035b0 con 0x7fb0c0131d70 2023-10-03T10:15:19.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fb0c50c7700 1 -- 172.21.15.146:0/1665547394 >> v2:172.21.15.146:3300/0 conn(0x7fb0c009e870 msgr2=0x7fb0c009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fb0c50c7700 1 --2- 172.21.15.146:0/1665547394 >> v2:172.21.15.146:3300/0 conn(0x7fb0c009e870 0x7fb0c009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fb0c50c7700 1 -- 172.21.15.146:0/1665547394 >> v1:172.21.15.146:6789/0 conn(0x7fb0c0131d70 legacy=0x7fb0c0138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fb0c50c7700 1 -- 172.21.15.146:0/1665547394 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c009bab0 con 0x7fb0c009f180 2023-10-03T10:15:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fb0c58c8700 1 --2- 172.21.15.146:0/1665547394 >> v2:172.21.15.146:3300/0 conn(0x7fb0c009e870 0x7fb0c009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fece99a6700 1 -- 172.21.15.146:0/3026567735 >> v2:172.21.15.146:3300/0 conn(0x7fece40a1460 msgr2=0x7fece413b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fece99a6700 1 --2- 172.21.15.146:0/3026567735 >> v2:172.21.15.146:3300/0 conn(0x7fece40a1460 0x7fece413b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fece99a6700 1 -- 172.21.15.146:0/3026567735 >> v1:172.21.15.146:6789/0 conn(0x7fece40a08e0 legacy=0x7fece40a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.049+0000 7fece99a6700 1 -- 172.21.15.146:0/3026567735 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece4133870 con 0x7fece4133a70 2023-10-03T10:15:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.050+0000 7fb0c50c7700 1 --2- 172.21.15.146:0/1665547394 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c009f180 0x7fb0c0131830 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00098f0 tx=0x7fb0b0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92572c28e8ce2081 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.050+0000 7fece99a6700 1 --2- 172.21.15.146:0/3026567735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fece4133a70 0x7fece4133e40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fece0009820 tx=0x7fece0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1e2fbcbb27942b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.050+0000 7fb0c48c6700 1 -- 172.21.15.146:0/1665547394 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0011830 con 0x7fb0c009f180 2023-10-03T10:15:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.050+0000 7fece89a4700 1 -- 172.21.15.146:0/3026567735 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece0005e30 con 0x7fece4133a70 2023-10-03T10:15:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.050+0000 7fece89a4700 1 -- 172.21.15.146:0/3026567735 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece0006030 con 0x7fece4133a70 2023-10-03T10:15:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.050+0000 7fece89a4700 1 -- 172.21.15.146:0/3026567735 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece00063c0 con 0x7fece4133a70 2023-10-03T10:15:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.050+0000 7fb0c48c6700 1 -- 172.21.15.146:0/1665547394 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b0011990 con 0x7fb0c009f180 2023-10-03T10:15:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.050+0000 7fb0c48c6700 1 -- 172.21.15.146:0/1665547394 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0011d20 con 0x7fb0c009f180 2023-10-03T10:15:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.050+0000 7fb0c7b2c700 1 -- 172.21.15.146:0/1665547394 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c009f180 msgr2=0x7fb0c0131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.050+0000 7fb0c7b2c700 1 --2- 172.21.15.146:0/1665547394 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c009f180 0x7fb0c0131830 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00098f0 tx=0x7fb0b0009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.051+0000 7fb0c7b2c700 1 -- 172.21.15.146:0/1665547394 shutdown_connections 2023-10-03T10:15:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.051+0000 7fb0c7b2c700 1 --2- 172.21.15.146:0/1665547394 >> v2:172.21.15.146:3300/0 conn(0x7fb0c009e870 0x7fb0c009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.051+0000 7fb0c7b2c700 1 --2- 172.21.15.146:0/1665547394 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c009f180 0x7fb0c0131830 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.051+0000 7fb0c7b2c700 1 -- 172.21.15.146:0/1665547394 >> 172.21.15.146:0/1665547394 conn(0x7fb0c00a4430 msgr2=0x7fb0c00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.051+0000 7fb0c7b2c700 1 -- 172.21.15.146:0/1665547394 shutdown_connections 2023-10-03T10:15:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.051+0000 7fb0c7b2c700 1 -- 172.21.15.146:0/1665547394 wait complete. 2023-10-03T10:15:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.051+0000 7fecebc0a700 1 -- 172.21.15.146:0/3026567735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fece4133a70 msgr2=0x7fece4133e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.051+0000 7fecebc0a700 1 --2- 172.21.15.146:0/3026567735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fece4133a70 0x7fece4133e40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fece0009820 tx=0x7fece0009b30 comp rx=0 tx=0).stop 2023-10-03T10:15:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.051+0000 7fecebc0a700 1 -- 172.21.15.146:0/3026567735 shutdown_connections 2023-10-03T10:15:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.051+0000 7fecebc0a700 1 --2- 172.21.15.146:0/3026567735 >> v2:172.21.15.146:3300/0 conn(0x7fece40a1460 0x7fece413b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.051+0000 7fecebc0a700 1 --2- 172.21.15.146:0/3026567735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fece4133a70 0x7fece4133e40 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.051+0000 7fecebc0a700 1 -- 172.21.15.146:0/3026567735 >> 172.21.15.146:0/3026567735 conn(0x7fece40a2980 msgr2=0x7fece40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.051+0000 7fecebc0a700 1 -- 172.21.15.146:0/3026567735 shutdown_connections 2023-10-03T10:15:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.051+0000 7fecebc0a700 1 -- 172.21.15.146:0/3026567735 wait complete. 2023-10-03T10:15:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.052+0000 7fb0c7b2c700 1 Processor -- start 2023-10-03T10:15:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.052+0000 7fb0c7b2c700 1 -- start start 2023-10-03T10:15:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.052+0000 7fb0c7b2c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c009e870 0x7fb0c011af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.052+0000 7fb0c7b2c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0c009f180 0x7fb0c011b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.052+0000 7fb0c7b2c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0c0131d70 0x7fb0c011b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.052+0000 7fb0c7b2c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c011d1a0 con 0x7fb0c0131d70 2023-10-03T10:15:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.052+0000 7fb0c7b2c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c011de60 con 0x7fb0c009e870 2023-10-03T10:15:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.052+0000 7fb0c7b2c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c00a29c0 con 0x7fb0c009f180 2023-10-03T10:15:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.052+0000 7fecebc0a700 1 Processor -- start 2023-10-03T10:15:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.052+0000 7fecebc0a700 1 -- start start 2023-10-03T10:15:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.052+0000 7fb0c58c8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c009e870 0x7fb0c011af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.052+0000 7fb0c58c8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c009e870 0x7fb0c011af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44238/0 (socket says 172.21.15.146:44238) 2023-10-03T10:15:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.052+0000 7fb0c58c8700 1 -- 172.21.15.146:0/1494634547 learned_addr learned my addr 172.21.15.146:0/1494634547 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.052+0000 7fb0c60c9700 1 --2- 172.21.15.146:0/1494634547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0c0131d70 0x7fb0c011b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.053+0000 7fecebc0a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fece40a08e0 0x7fece40702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.053+0000 7fecebc0a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fece40a1460 0x7fece4070820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.053+0000 7fecebc0a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fece4133a70 0x7fece4070d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.053+0000 7fecebc0a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece4122d60 con 0x7fece4133a70 2023-10-03T10:15:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.053+0000 7fecebc0a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece4122f90 con 0x7fece40a1460 2023-10-03T10:15:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.053+0000 7fecebc0a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fece4071d40 con 0x7fece40a08e0 2023-10-03T10:15:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.053+0000 7fb0c60c9700 1 -- 172.21.15.146:0/1494634547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0c009f180 msgr2=0x7fb0c011b4b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:15:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.053+0000 7fb0c60c9700 1 --2- 172.21.15.146:0/1494634547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0c009f180 0x7fb0c011b4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.053+0000 7fb0c60c9700 1 -- 172.21.15.146:0/1494634547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c009e870 msgr2=0x7fb0c011af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.053+0000 7fb0c60c9700 1 --2- 172.21.15.146:0/1494634547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c009e870 0x7fb0c011af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.053+0000 7fb0c60c9700 1 -- 172.21.15.146:0/1494634547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0bc00f610 con 0x7fb0c0131d70 2023-10-03T10:15:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.053+0000 7fece99a6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fece40a08e0 0x7fece40702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.053+0000 7fece99a6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fece40a08e0 0x7fece40702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58624/0 (socket says 172.21.15.146:58624) 2023-10-03T10:15:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.053+0000 7fece99a6700 1 -- 172.21.15.146:0/2755116248 learned_addr learned my addr 172.21.15.146:0/2755116248 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.053+0000 7fecea1a7700 1 --2- 172.21.15.146:0/2755116248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fece4133a70 0x7fece4070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.053+0000 7fece99a6700 1 -- 172.21.15.146:0/2755116248 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fece40a1460 msgr2=0x7fece4070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.053+0000 7fece99a6700 1 --2- 172.21.15.146:0/2755116248 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fece40a1460 0x7fece4070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.053+0000 7fece99a6700 1 -- 172.21.15.146:0/2755116248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fece4133a70 msgr2=0x7fece4070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.053+0000 7fece99a6700 1 --2- 172.21.15.146:0/2755116248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fece4133a70 0x7fece4070d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.053+0000 7fece99a6700 1 -- 172.21.15.146:0/2755116248 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece0009430 con 0x7fece40a08e0 2023-10-03T10:15:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.053+0000 7fece99a6700 1 --2- 172.21.15.146:0/2755116248 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fece40a08e0 0x7fece40702e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fece0000c00 tx=0x7fece0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.054+0000 7fecda7fc700 1 -- 172.21.15.146:0/2755116248 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece0004040 con 0x7fece40a08e0 2023-10-03T10:15:19.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.054+0000 7fb0c60c9700 1 --2- 172.21.15.146:0/1494634547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0c0131d70 0x7fb0c011b9f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800cbc0 tx=0x7fb0b800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.054+0000 7fecebc0a700 1 -- 172.21.15.146:0/2755116248 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece4121910 con 0x7fece40a08e0 2023-10-03T10:15:19.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.054+0000 7fecebc0a700 1 -- 172.21.15.146:0/2755116248 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece4121b50 con 0x7fece40a08e0 2023-10-03T10:15:19.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.054+0000 7fecda7fc700 1 -- 172.21.15.146:0/2755116248 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece0020070 con 0x7fece40a08e0 2023-10-03T10:15:19.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.054+0000 7fecda7fc700 1 -- 172.21.15.146:0/2755116248 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece00043e0 con 0x7fece40a08e0 2023-10-03T10:15:19.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.054+0000 7fb0b67fc700 1 -- 172.21.15.146:0/1494634547 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8003c00 con 0x7fb0c0131d70 2023-10-03T10:15:19.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.054+0000 7fb0b67fc700 1 -- 172.21.15.146:0/1494634547 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b8003d60 con 0x7fb0c0131d70 2023-10-03T10:15:19.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.054+0000 7fb0c7b2c700 1 -- 172.21.15.146:0/1494634547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b0009550 con 0x7fb0c0131d70 2023-10-03T10:15:19.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.054+0000 7fb0b67fc700 1 -- 172.21.15.146:0/1494634547 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b800aae0 con 0x7fb0c0131d70 2023-10-03T10:15:19.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.054+0000 7fb0c7b2c700 1 -- 172.21.15.146:0/1494634547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c009dba0 con 0x7fb0c0131d70 2023-10-03T10:15:19.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.055+0000 7fecda7fc700 1 -- 172.21.15.146:0/2755116248 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fece0022030 con 0x7fece40a08e0 2023-10-03T10:15:19.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.055+0000 7fecda7fc700 1 -- 172.21.15.146:0/2755116248 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fece0040d80 con 0x7fece40a08e0 2023-10-03T10:15:19.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.055+0000 7fb0c7b2c700 1 -- 172.21.15.146:0/1494634547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c011e450 con 0x7fb0c0131d70 2023-10-03T10:15:19.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.055+0000 7fe43446f700 1 Processor -- start 2023-10-03T10:15:19.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.055+0000 7fe43446f700 1 -- start start 2023-10-03T10:15:19.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.056+0000 7fecebc0a700 1 -- 172.21.15.146:0/2755116248 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feccc0052e0 con 0x7fece40a08e0 2023-10-03T10:15:19.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.056+0000 7fb0b67fc700 1 -- 172.21.15.146:0/1494634547 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb0b800ac40 con 0x7fb0c0131d70 2023-10-03T10:15:19.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.056+0000 7fb0b67fc700 1 -- 172.21.15.146:0/1494634547 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb0b80401e0 con 0x7fb0c0131d70 2023-10-03T10:15:19.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.056+0000 7fe43446f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe42c138040 0x7fe42c138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.056+0000 7fe43446f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe42c0a1400 0x7fe42c13fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.056+0000 7fe43446f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42c1379e0 con 0x7fe42c0a08e0 2023-10-03T10:15:19.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.056+0000 7fe43446f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c0a2100 con 0x7fe42c138040 2023-10-03T10:15:19.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.056+0000 7fe43446f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c138950 con 0x7fe42c0a1400 2023-10-03T10:15:19.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.056+0000 7fe43220b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe42c138040 0x7fe42c138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.056+0000 7fe43220b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe42c138040 0x7fe42c138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44252/0 (socket says 172.21.15.146:44252) 2023-10-03T10:15:19.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.056+0000 7fe43220b700 1 -- 172.21.15.146:0/4270143091 learned_addr learned my addr 172.21.15.146:0/4270143091 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:19.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.057+0000 7fe43220b700 1 -- 172.21.15.146:0/4270143091 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe42c0a1400 msgr2=0x7fe42c13fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.057+0000 7fe43220b700 1 --2- 172.21.15.146:0/4270143091 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe42c0a1400 0x7fe42c13fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.057+0000 7fe43220b700 1 -- 172.21.15.146:0/4270143091 >> v1:172.21.15.146:6789/0 conn(0x7fe42c0a08e0 legacy=0x7fe42c0a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.057+0000 7fe43220b700 1 -- 172.21.15.146:0/4270143091 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c09b9b0 con 0x7fe42c138040 2023-10-03T10:15:19.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.057+0000 7fe43220b700 1 --2- 172.21.15.146:0/4270143091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe42c138040 0x7fe42c138410 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe428009920 tx=0x7fe428009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=731957453cfd88e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.058+0000 7fe431209700 1 -- 172.21.15.146:0/4270143091 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428005e30 con 0x7fe42c138040 2023-10-03T10:15:19.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.058+0000 7fe431209700 1 -- 172.21.15.146:0/4270143091 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe428009e70 con 0x7fe42c138040 2023-10-03T10:15:19.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.058+0000 7fe431209700 1 -- 172.21.15.146:0/4270143091 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428004250 con 0x7fe42c138040 2023-10-03T10:15:19.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.059+0000 7fe43446f700 1 -- 172.21.15.146:0/4270143091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe42c138040 msgr2=0x7fe42c138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.059+0000 7fe43446f700 1 --2- 172.21.15.146:0/4270143091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe42c138040 0x7fe42c138410 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe428009920 tx=0x7fe428009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:19.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.059+0000 7fe43446f700 1 -- 172.21.15.146:0/4270143091 shutdown_connections 2023-10-03T10:15:19.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.059+0000 7fe43446f700 1 --2- 172.21.15.146:0/4270143091 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe42c0a1400 0x7fe42c13fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.059+0000 7fe43446f700 1 --2- 172.21.15.146:0/4270143091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe42c138040 0x7fe42c138410 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.059+0000 7fe43446f700 1 -- 172.21.15.146:0/4270143091 >> 172.21.15.146:0/4270143091 conn(0x7fe42c0a2980 msgr2=0x7fe42c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.061+0000 7fb0b67fc700 1 -- 172.21.15.146:0/1494634547 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0b8011790 con 0x7fb0c0131d70 2023-10-03T10:15:19.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.061+0000 7fe43446f700 1 -- 172.21.15.146:0/4270143091 shutdown_connections 2023-10-03T10:15:19.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.061+0000 7fecda7fc700 1 -- 172.21.15.146:0/2755116248 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fece0019960 con 0x7fece40a08e0 2023-10-03T10:15:19.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.061+0000 7fe43446f700 1 -- 172.21.15.146:0/4270143091 wait complete. 2023-10-03T10:15:19.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.062+0000 7fe43446f700 1 Processor -- start 2023-10-03T10:15:19.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.062+0000 7fe43446f700 1 -- start start 2023-10-03T10:15:19.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.063+0000 7fe43446f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe42c0a08e0 0x7fe42c1264d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.063+0000 7fe43446f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe42c0a1400 0x7fe42c126a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.063+0000 7fe43446f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe42c138040 0x7fe42c126f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.063+0000 7fe43446f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c1280e0 con 0x7fe42c0a1400 2023-10-03T10:15:19.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.063+0000 7fe43446f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c137060 con 0x7fe42c138040 2023-10-03T10:15:19.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.063+0000 7fe43446f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c129a50 con 0x7fe42c0a08e0 2023-10-03T10:15:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.063+0000 7fe43220b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe42c0a08e0 0x7fe42c1264d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.063+0000 7fe43220b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe42c0a08e0 0x7fe42c1264d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58652/0 (socket says 172.21.15.146:58652) 2023-10-03T10:15:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.063+0000 7fe43220b700 1 -- 172.21.15.146:0/2156642526 learned_addr learned my addr 172.21.15.146:0/2156642526 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.063+0000 7fe432a0c700 1 --2- 172.21.15.146:0/2156642526 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe42c138040 0x7fe42c126f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.064+0000 7fe43220b700 1 -- 172.21.15.146:0/2156642526 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe42c138040 msgr2=0x7fe42c126f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.064+0000 7fe43220b700 1 --2- 172.21.15.146:0/2156642526 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe42c138040 0x7fe42c126f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.064+0000 7fe43220b700 1 -- 172.21.15.146:0/2156642526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe42c0a1400 msgr2=0x7fe42c126a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:15:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.064+0000 7fe43220b700 1 --2- 172.21.15.146:0/2156642526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe42c0a1400 0x7fe42c126a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.064+0000 7fe43220b700 1 -- 172.21.15.146:0/2156642526 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe428009500 con 0x7fe42c0a08e0 2023-10-03T10:15:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.064+0000 7fe43220b700 1 --2- 172.21.15.146:0/2156642526 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe42c0a08e0 0x7fe42c1264d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe42800b3c0 tx=0x7fe428004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.064+0000 7fe422ffd700 1 -- 172.21.15.146:0/2156642526 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428003ab0 con 0x7fe42c0a08e0 2023-10-03T10:15:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.064+0000 7fe422ffd700 1 -- 172.21.15.146:0/2156642526 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe428003c30 con 0x7fe42c0a08e0 2023-10-03T10:15:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.064+0000 7fe43446f700 1 -- 172.21.15.146:0/2156642526 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42c12a050 con 0x7fe42c0a08e0 2023-10-03T10:15:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.064+0000 7fe422ffd700 1 -- 172.21.15.146:0/2156642526 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4280045b0 con 0x7fe42c0a08e0 2023-10-03T10:15:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.064+0000 7fe43446f700 1 -- 172.21.15.146:0/2156642526 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42c129d10 con 0x7fe42c0a08e0 2023-10-03T10:15:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.065+0000 7fe43446f700 1 -- 172.21.15.146:0/2156642526 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe42c04f2a0 con 0x7fe42c0a08e0 2023-10-03T10:15:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.066+0000 7fe422ffd700 1 -- 172.21.15.146:0/2156642526 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe428006030 con 0x7fe42c0a08e0 2023-10-03T10:15:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.067+0000 7fe422ffd700 1 -- 172.21.15.146:0/2156642526 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe4280411c0 con 0x7fe42c0a08e0 2023-10-03T10:15:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.070+0000 7fe422ffd700 1 -- 172.21.15.146:0/2156642526 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4280062e0 con 0x7fe42c0a08e0 2023-10-03T10:15:19.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.254+0000 7fb0c7b2c700 1 -- 172.21.15.146:0/1494634547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb0c011e450 con 0x7fb0c0131d70 2023-10-03T10:15:19.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.255+0000 7fb0b67fc700 1 -- 172.21.15.146:0/1494634547 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0c011e450 con 0x7fb0c0131d70 2023-10-03T10:15:19.255 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:19.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.256+0000 7fecebc0a700 1 -- 172.21.15.146:0/2755116248 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7feccc005150 con 0x7fece40a08e0 2023-10-03T10:15:19.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.256+0000 7fecda7fc700 1 -- 172.21.15.146:0/2755116248 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fece0019730 con 0x7fece40a08e0 2023-10-03T10:15:19.257 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:19.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.257+0000 7fb0c7b2c700 1 -- 172.21.15.146:0/1494634547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0c0131d70 msgr2=0x7fb0c011b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.257+0000 7fb0c7b2c700 1 --2- 172.21.15.146:0/1494634547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0c0131d70 0x7fb0c011b9f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800cbc0 tx=0x7fb0b800ced0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.257+0000 7fb0c7b2c700 1 -- 172.21.15.146:0/1494634547 shutdown_connections 2023-10-03T10:15:19.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.257+0000 7fb0c7b2c700 1 --2- 172.21.15.146:0/1494634547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0c0131d70 0x7fb0c011b9f0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.257+0000 7fb0c7b2c700 1 --2- 172.21.15.146:0/1494634547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0c009e870 0x7fb0c011af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.257+0000 7fb0c7b2c700 1 --2- 172.21.15.146:0/1494634547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0c009f180 0x7fb0c011b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.257+0000 7fb0c7b2c700 1 -- 172.21.15.146:0/1494634547 >> 172.21.15.146:0/1494634547 conn(0x7fb0c00a4430 msgr2=0x7fb0c012fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.257+0000 7fb0c7b2c700 1 -- 172.21.15.146:0/1494634547 shutdown_connections 2023-10-03T10:15:19.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.257+0000 7fb0c7b2c700 1 -- 172.21.15.146:0/1494634547 wait complete. 2023-10-03T10:15:19.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.259+0000 7fecebc0a700 1 -- 172.21.15.146:0/2755116248 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fece40a08e0 msgr2=0x7fece40702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.259+0000 7fecebc0a700 1 --2- 172.21.15.146:0/2755116248 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fece40a08e0 0x7fece40702e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fece0000c00 tx=0x7fece0004750 comp rx=0 tx=0).stop 2023-10-03T10:15:19.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.259+0000 7fecebc0a700 1 -- 172.21.15.146:0/2755116248 shutdown_connections 2023-10-03T10:15:19.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.259+0000 7fecebc0a700 1 --2- 172.21.15.146:0/2755116248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fece4133a70 0x7fece4070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.259+0000 7fecebc0a700 1 --2- 172.21.15.146:0/2755116248 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fece40a08e0 0x7fece40702e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.259+0000 7fecebc0a700 1 --2- 172.21.15.146:0/2755116248 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fece40a1460 0x7fece4070820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.259+0000 7fecebc0a700 1 -- 172.21.15.146:0/2755116248 >> 172.21.15.146:0/2755116248 conn(0x7fece40a2980 msgr2=0x7fece4130140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.259+0000 7fecebc0a700 1 -- 172.21.15.146:0/2755116248 shutdown_connections 2023-10-03T10:15:19.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.259+0000 7fecebc0a700 1 -- 172.21.15.146:0/2755116248 wait complete. 2023-10-03T10:15:19.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:19.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:19.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.290+0000 7f9395d99700 1 -- 172.21.15.146:0/2708457133 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f939006c3b0 con 0x7f9390133ad0 2023-10-03T10:15:19.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.290+0000 7f9377fff700 1 -- 172.21.15.146:0/2708457133 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9388018020 con 0x7f9390133ad0 2023-10-03T10:15:19.291 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:19.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.292+0000 7f9395d99700 1 -- 172.21.15.146:0/2708457133 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9390133ad0 msgr2=0x7f939011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.292+0000 7f9395d99700 1 --2- 172.21.15.146:0/2708457133 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9390133ad0 0x7f939011e4c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f938800efc0 tx=0x7f938800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.292+0000 7f9395d99700 1 -- 172.21.15.146:0/2708457133 shutdown_connections 2023-10-03T10:15:19.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.292+0000 7f9395d99700 1 --2- 172.21.15.146:0/2708457133 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9390133ad0 0x7f939011e4c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.292+0000 7f9395d99700 1 --2- 172.21.15.146:0/2708457133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93901300a0 0x7f939011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.292+0000 7f9395d99700 1 --2- 172.21.15.146:0/2708457133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9390130bc0 0x7f939011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.292+0000 7f9395d99700 1 -- 172.21.15.146:0/2708457133 >> 172.21.15.146:0/2708457133 conn(0x7f9390099c40 msgr2=0x7f9390132170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.292+0000 7f9395d99700 1 -- 172.21.15.146:0/2708457133 shutdown_connections 2023-10-03T10:15:19.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.292+0000 7f9395d99700 1 -- 172.21.15.146:0/2708457133 wait complete. 2023-10-03T10:15:19.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:19.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.318+0000 7fe43446f700 1 -- 172.21.15.146:0/2156642526 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe42c12a7e0 con 0x7fe42c0a08e0 2023-10-03T10:15:19.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.318+0000 7fe422ffd700 1 -- 172.21.15.146:0/2156642526 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe42802b090 con 0x7fe42c0a08e0 2023-10-03T10:15:19.319 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:19.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.320+0000 7fe43446f700 1 -- 172.21.15.146:0/2156642526 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe42c0a08e0 msgr2=0x7fe42c1264d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.320+0000 7fe43446f700 1 --2- 172.21.15.146:0/2156642526 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe42c0a08e0 0x7fe42c1264d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe42800b3c0 tx=0x7fe428004750 comp rx=0 tx=0).stop 2023-10-03T10:15:19.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.321+0000 7fe43446f700 1 -- 172.21.15.146:0/2156642526 shutdown_connections 2023-10-03T10:15:19.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.321+0000 7fe43446f700 1 --2- 172.21.15.146:0/2156642526 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe42c138040 0x7fe42c126f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.321+0000 7fe43446f700 1 --2- 172.21.15.146:0/2156642526 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe42c0a08e0 0x7fe42c1264d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.321+0000 7fe43446f700 1 --2- 172.21.15.146:0/2156642526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe42c0a1400 0x7fe42c126a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.321+0000 7fe43446f700 1 -- 172.21.15.146:0/2156642526 >> 172.21.15.146:0/2156642526 conn(0x7fe42c0a2980 msgr2=0x7fe42c09e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.321+0000 7fe43446f700 1 -- 172.21.15.146:0/2156642526 shutdown_connections 2023-10-03T10:15:19.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:19.321+0000 7fe43446f700 1 -- 172.21.15.146:0/2156642526 wait complete. 2023-10-03T10:15:19.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:20.273 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:20.276 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:20.306 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:20.333 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:20.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.416+0000 7f07a14c3700 1 Processor -- start 2023-10-03T10:15:20.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.416+0000 7f07a14c3700 1 -- start start 2023-10-03T10:15:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.417+0000 7f07a14c3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f079c133900 0x7f079c133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.417+0000 7f07a14c3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f079c134210 0x7f079c0a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.417+0000 7f07a14c3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f079c0a0ee0 0x7f079c0a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.417+0000 7f07a14c3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079c09a760 con 0x7f079c0a0ee0 2023-10-03T10:15:20.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.417+0000 7f07a14c3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079c1336e0 con 0x7f079c133900 2023-10-03T10:15:20.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.417+0000 7f07a14c3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f079c09a080 con 0x7f079c134210 2023-10-03T10:15:20.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.417+0000 7f079b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f079c0a0ee0 0x7f079c0a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.417+0000 7f079affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f079c133900 0x7f079c133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.417+0000 7f079b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f079c0a0ee0 0x7f079c0a1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41518/0 (socket says 172.21.15.146:41518) 2023-10-03T10:15:20.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.417+0000 7f079b7fe700 1 -- 172.21.15.146:0/645504245 learned_addr learned my addr 172.21.15.146:0/645504245 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:20.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.417+0000 7f079affd700 1 --2- 172.21.15.146:0/645504245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f079c133900 0x7f079c133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44274/0 (socket says 172.21.15.146:44274) 2023-10-03T10:15:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.417+0000 7f079a7fc700 1 --2- 172.21.15.146:0/645504245 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f079c134210 0x7f079c0a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.418+0000 7f079affd700 1 -- 172.21.15.146:0/645504245 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f079c134210 msgr2=0x7f079c0a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.418+0000 7f079affd700 1 --2- 172.21.15.146:0/645504245 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f079c134210 0x7f079c0a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.418+0000 7f079affd700 1 -- 172.21.15.146:0/645504245 >> v2:172.21.15.146:3300/0 conn(0x7f079c0a0ee0 msgr2=0x7f079c0a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.418+0000 7f079affd700 1 --2- 172.21.15.146:0/645504245 >> v2:172.21.15.146:3300/0 conn(0x7f079c0a0ee0 0x7f079c0a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.418+0000 7f079affd700 1 -- 172.21.15.146:0/645504245 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079c0a23e0 con 0x7f079c133900 2023-10-03T10:15:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.418+0000 7f079b7fe700 1 --2- 172.21.15.146:0/645504245 >> v2:172.21.15.146:3300/0 conn(0x7f079c0a0ee0 0x7f079c0a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.418+0000 7f079affd700 1 --2- 172.21.15.146:0/645504245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f079c133900 0x7f079c133cd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f078c009820 tx=0x7f078c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9496dfca2850d62 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.418+0000 7f0799ffb700 1 -- 172.21.15.146:0/645504245 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c005e30 con 0x7f079c133900 2023-10-03T10:15:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.418+0000 7f0799ffb700 1 -- 172.21.15.146:0/645504245 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078c006030 con 0x7f079c133900 2023-10-03T10:15:20.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.418+0000 7f0799ffb700 1 -- 172.21.15.146:0/645504245 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c0063c0 con 0x7f079c133900 2023-10-03T10:15:20.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.419+0000 7f07a14c3700 1 -- 172.21.15.146:0/645504245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f079c133900 msgr2=0x7f079c133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.419+0000 7f07a14c3700 1 --2- 172.21.15.146:0/645504245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f079c133900 0x7f079c133cd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f078c009820 tx=0x7f078c009b30 comp rx=0 tx=0).stop 2023-10-03T10:15:20.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.419+0000 7f07a14c3700 1 -- 172.21.15.146:0/645504245 shutdown_connections 2023-10-03T10:15:20.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.419+0000 7f07a14c3700 1 --2- 172.21.15.146:0/645504245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f079c133900 0x7f079c133cd0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.419+0000 7f07a14c3700 1 --2- 172.21.15.146:0/645504245 >> v2:172.21.15.146:3300/0 conn(0x7f079c0a0ee0 0x7f079c0a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.419+0000 7f07a14c3700 1 --2- 172.21.15.146:0/645504245 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f079c134210 0x7f079c0a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.419+0000 7f07a14c3700 1 -- 172.21.15.146:0/645504245 >> 172.21.15.146:0/645504245 conn(0x7f079c0a2980 msgr2=0x7f079c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.419+0000 7f07a14c3700 1 -- 172.21.15.146:0/645504245 shutdown_connections 2023-10-03T10:15:20.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.419+0000 7f07a14c3700 1 -- 172.21.15.146:0/645504245 wait complete. 2023-10-03T10:15:20.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.420+0000 7f07a14c3700 1 Processor -- start 2023-10-03T10:15:20.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.420+0000 7f07a14c3700 1 -- start start 2023-10-03T10:15:20.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.421+0000 7f07a14c3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f079c0a0ee0 0x7f079c11d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.421+0000 7f07a14c3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f079c133900 0x7f079c11dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.421+0000 7f07a14c3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f079c134210 0x7f079c11e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.421+0000 7f07a14c3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c11f390 con 0x7f079c0a0ee0 2023-10-03T10:15:20.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.421+0000 7f07a14c3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079c1205e0 con 0x7f079c134210 2023-10-03T10:15:20.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.421+0000 7f07a14c3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f079c11f980 con 0x7f079c133900 2023-10-03T10:15:20.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.421+0000 7f079b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f079c134210 0x7f079c11e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.421+0000 7f079a7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f079c133900 0x7f079c11dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.421+0000 7f079a7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f079c133900 0x7f079c11dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58672/0 (socket says 172.21.15.146:58672) 2023-10-03T10:15:20.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.421+0000 7f079b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f079c134210 0x7f079c11e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44276/0 (socket says 172.21.15.146:44276) 2023-10-03T10:15:20.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.421+0000 7f079a7fc700 1 -- 172.21.15.146:0/2574011443 learned_addr learned my addr 172.21.15.146:0/2574011443 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.421+0000 7f079affd700 1 --2- 172.21.15.146:0/2574011443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f079c0a0ee0 0x7f079c11d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.421+0000 7f079b7fe700 1 -- 172.21.15.146:0/2574011443 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f079c133900 msgr2=0x7f079c11dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.421+0000 7f079b7fe700 1 --2- 172.21.15.146:0/2574011443 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f079c133900 0x7f079c11dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.421+0000 7f079b7fe700 1 -- 172.21.15.146:0/2574011443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f079c0a0ee0 msgr2=0x7f079c11d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.421+0000 7f079b7fe700 1 --2- 172.21.15.146:0/2574011443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f079c0a0ee0 0x7f079c11d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.421+0000 7f079b7fe700 1 -- 172.21.15.146:0/2574011443 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0794009b30 con 0x7f079c134210 2023-10-03T10:15:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.421+0000 7f079b7fe700 1 --2- 172.21.15.146:0/2574011443 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f079c134210 0x7f079c11e200 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0794009e50 tx=0x7f079400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.422+0000 7f07837fe700 1 -- 172.21.15.146:0/2574011443 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0794018070 con 0x7f079c134210 2023-10-03T10:15:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.422+0000 7f07837fe700 1 -- 172.21.15.146:0/2574011443 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079400f040 con 0x7f079c134210 2023-10-03T10:15:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.422+0000 7f07a14c3700 1 -- 172.21.15.146:0/2574011443 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078c009430 con 0x7f079c134210 2023-10-03T10:15:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.422+0000 7f07837fe700 1 -- 172.21.15.146:0/2574011443 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0794003c40 con 0x7f079c134210 2023-10-03T10:15:20.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.422+0000 7f07a14c3700 1 -- 172.21.15.146:0/2574011443 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f079c120a90 con 0x7f079c134210 2023-10-03T10:15:20.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.423+0000 7f07837fe700 1 -- 172.21.15.146:0/2574011443 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f079400c880 con 0x7f079c134210 2023-10-03T10:15:20.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.423+0000 7f07837fe700 1 -- 172.21.15.146:0/2574011443 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f079403f500 con 0x7f079c134210 2023-10-03T10:15:20.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.423+0000 7f07a14c3700 1 -- 172.21.15.146:0/2574011443 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f079c11a590 con 0x7f079c134210 2023-10-03T10:15:20.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.432+0000 7f07837fe700 1 -- 172.21.15.146:0/2574011443 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0794014480 con 0x7f079c134210 2023-10-03T10:15:20.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.455+0000 7f5d1eb16700 1 Processor -- start 2023-10-03T10:15:20.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.455+0000 7f5d1eb16700 1 -- start start 2023-10-03T10:15:20.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.455+0000 7f5d1eb16700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5d18133660 0x7f5d18135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.455+0000 7f5d1eb16700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5d18135f80 0x7f5d18138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.455+0000 7f5d1eb16700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d18099a60 con 0x7f5d18099e20 2023-10-03T10:15:20.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.455+0000 7f5d1eb16700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d1809bf50 con 0x7f5d18133660 2023-10-03T10:15:20.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.455+0000 7f5d1eb16700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1809b230 con 0x7f5d18135f80 2023-10-03T10:15:20.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.455+0000 7f5d17fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5d18133660 0x7f5d18135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.455+0000 7f5d1c8b2700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5d18099e20 0x7f5d1809a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60356/0 (socket says 172.21.15.146:60356) 2023-10-03T10:15:20.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.455+0000 7f5d1c8b2700 1 -- 172.21.15.146:0/1102051563 learned_addr learned my addr 172.21.15.146:0/1102051563 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:20.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.455+0000 7f5d1d0b3700 1 --2- 172.21.15.146:0/1102051563 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5d18135f80 0x7f5d18138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.456+0000 7f5d177fe700 1 -- 172.21.15.146:0/1102051563 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8909951 0 0) 0x7f5d18099a60 con 0x7f5d18099e20 2023-10-03T10:15:20.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.456+0000 7f5d177fe700 1 -- 172.21.15.146:0/1102051563 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d080035b0 con 0x7f5d18099e20 2023-10-03T10:15:20.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.456+0000 7f5d1d0b3700 1 -- 172.21.15.146:0/1102051563 >> v2:172.21.15.146:3300/0 conn(0x7f5d18133660 msgr2=0x7f5d18135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:20.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.456+0000 7f5d1d0b3700 1 --2- 172.21.15.146:0/1102051563 >> v2:172.21.15.146:3300/0 conn(0x7f5d18133660 0x7f5d18135a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.456+0000 7f5d1d0b3700 1 -- 172.21.15.146:0/1102051563 >> v1:172.21.15.146:6789/0 conn(0x7f5d18099e20 legacy=0x7f5d1809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.456+0000 7f5d1d0b3700 1 -- 172.21.15.146:0/1102051563 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1809bb90 con 0x7f5d18135f80 2023-10-03T10:15:20.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.456+0000 7f5d1d0b3700 1 --2- 172.21.15.146:0/1102051563 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5d18135f80 0x7f5d18138360 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5d10009d90 tx=0x7f5d1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4344ea92b5f61172 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:20.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.456+0000 7f5d177fe700 1 -- 172.21.15.146:0/1102051563 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1000e070 con 0x7f5d18135f80 2023-10-03T10:15:20.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.456+0000 7f5d177fe700 1 -- 172.21.15.146:0/1102051563 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1000bb20 con 0x7f5d18135f80 2023-10-03T10:15:20.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.456+0000 7f5d177fe700 1 -- 172.21.15.146:0/1102051563 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d10012430 con 0x7f5d18135f80 2023-10-03T10:15:20.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.457+0000 7f5d1eb16700 1 -- 172.21.15.146:0/1102051563 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5d18135f80 msgr2=0x7f5d18138360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.457+0000 7f5d1eb16700 1 --2- 172.21.15.146:0/1102051563 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5d18135f80 0x7f5d18138360 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5d10009d90 tx=0x7f5d1000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:20.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.457+0000 7f5d1eb16700 1 -- 172.21.15.146:0/1102051563 shutdown_connections 2023-10-03T10:15:20.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.457+0000 7f5d1eb16700 1 --2- 172.21.15.146:0/1102051563 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5d18135f80 0x7f5d18138360 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.457+0000 7f5d1eb16700 1 --2- 172.21.15.146:0/1102051563 >> v2:172.21.15.146:3300/0 conn(0x7f5d18133660 0x7f5d18135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.457+0000 7f5d1eb16700 1 -- 172.21.15.146:0/1102051563 >> 172.21.15.146:0/1102051563 conn(0x7f5d180a2980 msgr2=0x7f5d180a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.457+0000 7f5d1eb16700 1 -- 172.21.15.146:0/1102051563 shutdown_connections 2023-10-03T10:15:20.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.457+0000 7f5d1eb16700 1 -- 172.21.15.146:0/1102051563 wait complete. 2023-10-03T10:15:20.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.458+0000 7f2ed08f2700 1 Processor -- start 2023-10-03T10:15:20.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.458+0000 7f5d1eb16700 1 Processor -- start 2023-10-03T10:15:20.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.458+0000 7f5d1eb16700 1 -- start start 2023-10-03T10:15:20.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.458+0000 7f2ed08f2700 1 -- start start 2023-10-03T10:15:20.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.458+0000 7f2ed08f2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ecc09a0a0 0x7f2ecc134c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.458+0000 7f2ed08f2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ecc1301e0 0x7f2ecc137180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.458+0000 7f2ed08f2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ecc09a6c0 con 0x7f2ecc12f700 2023-10-03T10:15:20.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.458+0000 7f2ed08f2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc09be00 con 0x7f2ecc09a0a0 2023-10-03T10:15:20.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.458+0000 7f2ed08f2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc09ac80 con 0x7f2ecc1301e0 2023-10-03T10:15:20.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.458+0000 7f5d1eb16700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5d18099e20 0x7f5d180709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f5d1eb16700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d18133660 0x7f5d18070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f5d1eb16700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d18135f80 0x7f5d181c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f5d1eb16700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d18071420 con 0x7f5d18135f80 2023-10-03T10:15:20.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f5d1eb16700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1811edf0 con 0x7f5d18133660 2023-10-03T10:15:20.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f5d1eb16700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d18070490 con 0x7f5d18099e20 2023-10-03T10:15:20.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f2ecad9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ecc1301e0 0x7f2ecc137180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f2eca59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2ecc12f700 0x7f2ecc12fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60370/0 (socket says 172.21.15.146:60370) 2023-10-03T10:15:20.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f2eca59c700 1 -- 172.21.15.146:0/4222877650 learned_addr learned my addr 172.21.15.146:0/4222877650 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:20.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f5d17fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d18133660 0x7f5d18070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f5d17fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d18133660 0x7f5d18070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44304/0 (socket says 172.21.15.146:44304) 2023-10-03T10:15:20.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f5d17fff700 1 -- 172.21.15.146:0/148904354 learned_addr learned my addr 172.21.15.146:0/148904354 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:20.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f5d1d0b3700 1 --2- 172.21.15.146:0/148904354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d18135f80 0x7f5d181c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f2ecad9d700 1 -- 172.21.15.146:0/4222877650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ecc09a0a0 msgr2=0x7f2ecc134c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:20.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f2ecad9d700 1 --2- 172.21.15.146:0/4222877650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ecc09a0a0 0x7f2ecc134c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f2ecad9d700 1 -- 172.21.15.146:0/4222877650 >> v1:172.21.15.146:6789/0 conn(0x7f2ecc12f700 legacy=0x7f2ecc12fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:20.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f2ecad9d700 1 -- 172.21.15.146:0/4222877650 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc09bff0 con 0x7f2ecc1301e0 2023-10-03T10:15:20.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f2ecad9d700 1 --2- 172.21.15.146:0/4222877650 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ecc1301e0 0x7f2ecc137180 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400be60 tx=0x7f2ec4010730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99622aaf123a4c76 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:20.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f5d17fff700 1 -- 172.21.15.146:0/148904354 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5d18099e20 msgr2=0x7f5d180709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f5d17fff700 1 --2- 172.21.15.146:0/148904354 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5d18099e20 0x7f5d180709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f5d17fff700 1 -- 172.21.15.146:0/148904354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d18135f80 msgr2=0x7f5d181c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f5d17fff700 1 --2- 172.21.15.146:0/148904354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d18135f80 0x7f5d181c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f5d17fff700 1 -- 172.21.15.146:0/148904354 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d10009a70 con 0x7f5d18133660 2023-10-03T10:15:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.459+0000 7f5d17fff700 1 --2- 172.21.15.146:0/148904354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d18133660 0x7f5d18070ee0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5d0400fae0 tx=0x7f5d0400fdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.460+0000 7f5d157fa700 1 -- 172.21.15.146:0/148904354 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0400c070 con 0x7f5d18133660 2023-10-03T10:15:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.460+0000 7f5d157fa700 1 -- 172.21.15.146:0/148904354 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0400db20 con 0x7f5d18133660 2023-10-03T10:15:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.460+0000 7f5d157fa700 1 -- 172.21.15.146:0/148904354 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d04009710 con 0x7f5d18133660 2023-10-03T10:15:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.460+0000 7f5d1eb16700 1 -- 172.21.15.146:0/148904354 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d180721f0 con 0x7f5d18133660 2023-10-03T10:15:20.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.460+0000 7f5d1eb16700 1 -- 172.21.15.146:0/148904354 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d18071be0 con 0x7f5d18133660 2023-10-03T10:15:20.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.460+0000 7f2ec959a700 1 -- 172.21.15.146:0/4222877650 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec400b2d0 con 0x7f2ecc1301e0 2023-10-03T10:15:20.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.460+0000 7f2ec959a700 1 -- 172.21.15.146:0/4222877650 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec4003a20 con 0x7f2ecc1301e0 2023-10-03T10:15:20.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.460+0000 7f2ec959a700 1 -- 172.21.15.146:0/4222877650 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4003db0 con 0x7f2ecc1301e0 2023-10-03T10:15:20.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.461+0000 7f2ed08f2700 1 -- 172.21.15.146:0/4222877650 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ecc1301e0 msgr2=0x7f2ecc137180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.461+0000 7f2ed08f2700 1 --2- 172.21.15.146:0/4222877650 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ecc1301e0 0x7f2ecc137180 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400be60 tx=0x7f2ec4010730 comp rx=0 tx=0).stop 2023-10-03T10:15:20.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.461+0000 7f5d1eb16700 1 -- 172.21.15.146:0/148904354 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d1804f2a0 con 0x7f5d18133660 2023-10-03T10:15:20.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.461+0000 7f5d157fa700 1 -- 172.21.15.146:0/148904354 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5d04011450 con 0x7f5d18133660 2023-10-03T10:15:20.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.461+0000 7f2ed08f2700 1 -- 172.21.15.146:0/4222877650 shutdown_connections 2023-10-03T10:15:20.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.461+0000 7f2ed08f2700 1 --2- 172.21.15.146:0/4222877650 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ecc1301e0 0x7f2ecc137180 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.461+0000 7f2ed08f2700 1 --2- 172.21.15.146:0/4222877650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ecc09a0a0 0x7f2ecc134c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.461+0000 7f2ed08f2700 1 -- 172.21.15.146:0/4222877650 >> 172.21.15.146:0/4222877650 conn(0x7f2ecc0a1ee0 msgr2=0x7f2ecc0a22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.461+0000 7f5d157fa700 1 -- 172.21.15.146:0/148904354 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5d04015070 con 0x7f5d18133660 2023-10-03T10:15:20.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.464+0000 7f2ed08f2700 1 -- 172.21.15.146:0/4222877650 shutdown_connections 2023-10-03T10:15:20.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.464+0000 7f2ed08f2700 1 -- 172.21.15.146:0/4222877650 wait complete. 2023-10-03T10:15:20.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.465+0000 7f2ed08f2700 1 Processor -- start 2023-10-03T10:15:20.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.465+0000 7f2ed08f2700 1 -- start start 2023-10-03T10:15:20.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.466+0000 7f2ed08f2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ecc09a0a0 0x7f2ecc06f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.466+0000 7f2ed08f2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ecc12f700 0x7f2ecc06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.466+0000 7f2ed08f2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ecc1301e0 0x7f2ecc06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.466+0000 7f2ed08f2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc071730 con 0x7f2ecc09a0a0 2023-10-03T10:15:20.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.466+0000 7f2ed08f2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc12e7c0 con 0x7f2ecc1301e0 2023-10-03T10:15:20.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.466+0000 7f2ed08f2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc071000 con 0x7f2ecc12f700 2023-10-03T10:15:20.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.466+0000 7f2eca59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ecc09a0a0 0x7f2ecc06f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.466+0000 7f2eca59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ecc09a0a0 0x7f2ecc06f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41540/0 (socket says 172.21.15.146:41540) 2023-10-03T10:15:20.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.466+0000 7f2eca59c700 1 -- 172.21.15.146:0/110893458 learned_addr learned my addr 172.21.15.146:0/110893458 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:20.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.466+0000 7f2ecad9d700 1 --2- 172.21.15.146:0/110893458 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ecc1301e0 0x7f2ecc06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.466+0000 7f2ec9d9b700 1 --2- 172.21.15.146:0/110893458 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ecc12f700 0x7f2ecc06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.466+0000 7f2eca59c700 1 -- 172.21.15.146:0/110893458 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ecc12f700 msgr2=0x7f2ecc06fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.466+0000 7f2eca59c700 1 --2- 172.21.15.146:0/110893458 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ecc12f700 0x7f2ecc06fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.466+0000 7f2eca59c700 1 -- 172.21.15.146:0/110893458 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ecc1301e0 msgr2=0x7f2ecc06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.466+0000 7f2eca59c700 1 --2- 172.21.15.146:0/110893458 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ecc1301e0 0x7f2ecc06ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.466+0000 7f2eca59c700 1 -- 172.21.15.146:0/110893458 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec400ba90 con 0x7f2ecc09a0a0 2023-10-03T10:15:20.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.467+0000 7f2eca59c700 1 --2- 172.21.15.146:0/110893458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ecc09a0a0 0x7f2ecc06f4d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00c8d0 tx=0x7f2ebc00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:20.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.467+0000 7f2ebaffd700 1 -- 172.21.15.146:0/110893458 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc010860 con 0x7f2ecc09a0a0 2023-10-03T10:15:20.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.467+0000 7f2ebaffd700 1 -- 172.21.15.146:0/110893458 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ebc0109c0 con 0x7f2ecc09a0a0 2023-10-03T10:15:20.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.467+0000 7f2ebaffd700 1 -- 172.21.15.146:0/110893458 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc010d50 con 0x7f2ecc09a0a0 2023-10-03T10:15:20.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.467+0000 7f2ed08f2700 1 -- 172.21.15.146:0/110893458 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ecc129fd0 con 0x7f2ecc09a0a0 2023-10-03T10:15:20.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.467+0000 7f2ed08f2700 1 -- 172.21.15.146:0/110893458 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ecc131400 con 0x7f2ecc09a0a0 2023-10-03T10:15:20.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.467+0000 7f5d157fa700 1 -- 172.21.15.146:0/148904354 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5d04051750 con 0x7f5d18133660 2023-10-03T10:15:20.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.468+0000 7f2ed08f2700 1 -- 172.21.15.146:0/110893458 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ecc09c8c0 con 0x7f2ecc09a0a0 2023-10-03T10:15:20.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.470+0000 7f2ebaffd700 1 -- 172.21.15.146:0/110893458 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ebc00e3d0 con 0x7f2ecc09a0a0 2023-10-03T10:15:20.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.479+0000 7f2ebaffd700 1 -- 172.21.15.146:0/110893458 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2ebc009030 con 0x7f2ecc09a0a0 2023-10-03T10:15:20.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.483+0000 7f2ebaffd700 1 -- 172.21.15.146:0/110893458 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ecc09c8c0 con 0x7f2ecc09a0a0 2023-10-03T10:15:20.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.526+0000 7f4de4ee7700 1 Processor -- start 2023-10-03T10:15:20.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.527+0000 7f4de4ee7700 1 -- start start 2023-10-03T10:15:20.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.527+0000 7f4de4ee7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4de00a0a70 0x7f4de00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.527+0000 7f4de4ee7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4de00a1380 0x7f4de0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.528+0000 7f4de4ee7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4de0133f50 0x7f4de01343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.528+0000 7f4de4ee7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de009e9d0 con 0x7f4de0133f50 2023-10-03T10:15:20.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.528+0000 7f4de4ee7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de009dc00 con 0x7f4de00a0a70 2023-10-03T10:15:20.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.528+0000 7f4de4ee7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4de009dec0 con 0x7f4de00a1380 2023-10-03T10:15:20.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.528+0000 7f4dde59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4de00a0a70 0x7f4de00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.528+0000 7f4dde59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4de00a0a70 0x7f4de00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44330/0 (socket says 172.21.15.146:44330) 2023-10-03T10:15:20.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.528+0000 7f4dde59c700 1 -- 172.21.15.146:0/3266165051 learned_addr learned my addr 172.21.15.146:0/3266165051 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:20.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.528+0000 7f4dded9d700 1 --2- 172.21.15.146:0/3266165051 >> v2:172.21.15.146:3300/0 conn(0x7f4de0133f50 0x7f4de01343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.528+0000 7f4dddd9b700 1 --2- 172.21.15.146:0/3266165051 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4de00a1380 0x7f4de0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.528+0000 7f4dded9d700 1 -- 172.21.15.146:0/3266165051 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4de00a1380 msgr2=0x7f4de0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:20.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.528+0000 7f4dded9d700 1 --2- 172.21.15.146:0/3266165051 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4de00a1380 0x7f4de0133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.528+0000 7f4dded9d700 1 -- 172.21.15.146:0/3266165051 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4de00a0a70 msgr2=0x7f4de00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:20.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.528+0000 7f4dded9d700 1 --2- 172.21.15.146:0/3266165051 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4de00a0a70 0x7f4de00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.528+0000 7f4dded9d700 1 -- 172.21.15.146:0/3266165051 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de009e6a0 con 0x7f4de0133f50 2023-10-03T10:15:20.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.528+0000 7f4dde59c700 1 --2- 172.21.15.146:0/3266165051 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4de00a0a70 0x7f4de00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:20.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.528+0000 7f4dded9d700 1 --2- 172.21.15.146:0/3266165051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4de0133f50 0x7f4de01343f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009d90 tx=0x7f4dd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf53341181b566b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:20.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.529+0000 7f4ddd59a700 1 -- 172.21.15.146:0/3266165051 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd800e070 con 0x7f4de0133f50 2023-10-03T10:15:20.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.529+0000 7f4ddd59a700 1 -- 172.21.15.146:0/3266165051 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd800bb20 con 0x7f4de0133f50 2023-10-03T10:15:20.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.529+0000 7f4ddd59a700 1 -- 172.21.15.146:0/3266165051 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8012430 con 0x7f4de0133f50 2023-10-03T10:15:20.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.530+0000 7f4de4ee7700 1 -- 172.21.15.146:0/3266165051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4de0133f50 msgr2=0x7f4de01343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.530+0000 7f4de4ee7700 1 --2- 172.21.15.146:0/3266165051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4de0133f50 0x7f4de01343f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009d90 tx=0x7f4dd800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:20.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.530+0000 7f4de4ee7700 1 -- 172.21.15.146:0/3266165051 shutdown_connections 2023-10-03T10:15:20.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.530+0000 7f4de4ee7700 1 --2- 172.21.15.146:0/3266165051 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4de00a0a70 0x7f4de00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.530+0000 7f4de4ee7700 1 --2- 172.21.15.146:0/3266165051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4de0133f50 0x7f4de01343f0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.530+0000 7f4de4ee7700 1 --2- 172.21.15.146:0/3266165051 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4de00a1380 0x7f4de0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.530+0000 7f4de4ee7700 1 -- 172.21.15.146:0/3266165051 >> 172.21.15.146:0/3266165051 conn(0x7f4de00a6610 msgr2=0x7f4de00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.530+0000 7f4de4ee7700 1 -- 172.21.15.146:0/3266165051 shutdown_connections 2023-10-03T10:15:20.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.530+0000 7f4de4ee7700 1 -- 172.21.15.146:0/3266165051 wait complete. 2023-10-03T10:15:20.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.531+0000 7f4de4ee7700 1 Processor -- start 2023-10-03T10:15:20.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.531+0000 7f4de4ee7700 1 -- start start 2023-10-03T10:15:20.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.532+0000 7f4de4ee7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4de00a0a70 0x7f4de0122440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.532+0000 7f4de4ee7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4de00a1380 0x7f4de0122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.532+0000 7f4de4ee7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4de0133f50 0x7f4de0122ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.532+0000 7f4de4ee7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de00a03e0 con 0x7f4de0133f50 2023-10-03T10:15:20.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.532+0000 7f4de4ee7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de009d340 con 0x7f4de00a1380 2023-10-03T10:15:20.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.532+0000 7f4de4ee7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4de0125f60 con 0x7f4de00a0a70 2023-10-03T10:15:20.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.532+0000 7f4dde59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4de00a0a70 0x7f4de0122440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.532+0000 7f4dde59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4de00a0a70 0x7f4de0122440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58728/0 (socket says 172.21.15.146:58728) 2023-10-03T10:15:20.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.532+0000 7f4dde59c700 1 -- 172.21.15.146:0/1773337062 learned_addr learned my addr 172.21.15.146:0/1773337062 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:20.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.532+0000 7f4dddd9b700 1 --2- 172.21.15.146:0/1773337062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4de00a1380 0x7f4de0122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.532+0000 7f4dded9d700 1 --2- 172.21.15.146:0/1773337062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4de0133f50 0x7f4de0122ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.533+0000 7f4dde59c700 1 -- 172.21.15.146:0/1773337062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4de00a1380 msgr2=0x7f4de0122980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.533+0000 7f4dde59c700 1 --2- 172.21.15.146:0/1773337062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4de00a1380 0x7f4de0122980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.533+0000 7f4dde59c700 1 -- 172.21.15.146:0/1773337062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4de0133f50 msgr2=0x7f4de0122ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.533+0000 7f4dde59c700 1 --2- 172.21.15.146:0/1773337062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4de0133f50 0x7f4de0122ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.533+0000 7f4dde59c700 1 -- 172.21.15.146:0/1773337062 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd0009550 con 0x7f4de00a0a70 2023-10-03T10:15:20.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.533+0000 7f4dddd9b700 1 --2- 172.21.15.146:0/1773337062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4de00a1380 0x7f4de0122980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:20.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.533+0000 7f4dded9d700 1 --2- 172.21.15.146:0/1773337062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4de0133f50 0x7f4de0122ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:20.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.533+0000 7f4dde59c700 1 --2- 172.21.15.146:0/1773337062 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4de00a0a70 0x7f4de0122440 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4dd000ebb0 tx=0x7f4dd000eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:20.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.533+0000 7f4dceffd700 1 -- 172.21.15.146:0/1773337062 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0004030 con 0x7f4de00a0a70 2023-10-03T10:15:20.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.533+0000 7f4dceffd700 1 -- 172.21.15.146:0/1773337062 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd0004190 con 0x7f4de00a0a70 2023-10-03T10:15:20.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.533+0000 7f4de4ee7700 1 -- 172.21.15.146:0/1773337062 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd8009a70 con 0x7f4de00a0a70 2023-10-03T10:15:20.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.533+0000 7f4dceffd700 1 -- 172.21.15.146:0/1773337062 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0004520 con 0x7f4de00a0a70 2023-10-03T10:15:20.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.533+0000 7f4de4ee7700 1 -- 172.21.15.146:0/1773337062 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de01256f0 con 0x7f4de00a0a70 2023-10-03T10:15:20.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.534+0000 7f4dceffd700 1 -- 172.21.15.146:0/1773337062 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4dd000c850 con 0x7f4de00a0a70 2023-10-03T10:15:20.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.534+0000 7f4dceffd700 1 -- 172.21.15.146:0/1773337062 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4dd003fa50 con 0x7f4de00a0a70 2023-10-03T10:15:20.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.535+0000 7f4de4ee7700 1 -- 172.21.15.146:0/1773337062 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de011f760 con 0x7f4de00a0a70 2023-10-03T10:15:20.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.539+0000 7f4dceffd700 1 -- 172.21.15.146:0/1773337062 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4dd00036a0 con 0x7f4de00a0a70 2023-10-03T10:15:20.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.667+0000 7f5d1eb16700 1 -- 172.21.15.146:0/148904354 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5d1806bce0 con 0x7f5d18133660 2023-10-03T10:15:20.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.668+0000 7f5d157fa700 1 -- 172.21.15.146:0/148904354 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5d04027030 con 0x7f5d18133660 2023-10-03T10:15:20.669 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:20.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.670+0000 7f5d1eb16700 1 -- 172.21.15.146:0/148904354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d18133660 msgr2=0x7f5d18070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.670+0000 7f5d1eb16700 1 --2- 172.21.15.146:0/148904354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d18133660 0x7f5d18070ee0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5d0400fae0 tx=0x7f5d0400fdf0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.670+0000 7f5d1eb16700 1 -- 172.21.15.146:0/148904354 shutdown_connections 2023-10-03T10:15:20.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.670+0000 7f5d1eb16700 1 --2- 172.21.15.146:0/148904354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d18135f80 0x7f5d181c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.670+0000 7f5d1eb16700 1 --2- 172.21.15.146:0/148904354 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5d18099e20 0x7f5d180709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.670+0000 7f5d1eb16700 1 --2- 172.21.15.146:0/148904354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d18133660 0x7f5d18070ee0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.670+0000 7f5d1eb16700 1 -- 172.21.15.146:0/148904354 >> 172.21.15.146:0/148904354 conn(0x7f5d180a2980 msgr2=0x7f5d181324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.670+0000 7f5d1eb16700 1 -- 172.21.15.146:0/148904354 shutdown_connections 2023-10-03T10:15:20.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.670+0000 7f5d1eb16700 1 -- 172.21.15.146:0/148904354 wait complete. 2023-10-03T10:15:20.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.679+0000 7f2ed08f2700 1 -- 172.21.15.146:0/110893458 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2ecc12b960 con 0x7f2ecc09a0a0 2023-10-03T10:15:20.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.680+0000 7f2ebaffd700 1 -- 172.21.15.146:0/110893458 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ebc044060 con 0x7f2ecc09a0a0 2023-10-03T10:15:20.680 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:20.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.682+0000 7f2ed08f2700 1 -- 172.21.15.146:0/110893458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ecc09a0a0 msgr2=0x7f2ecc06f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.682+0000 7f2ed08f2700 1 --2- 172.21.15.146:0/110893458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ecc09a0a0 0x7f2ecc06f4d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00c8d0 tx=0x7f2ebc00cbe0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.682+0000 7f2ed08f2700 1 -- 172.21.15.146:0/110893458 shutdown_connections 2023-10-03T10:15:20.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.682+0000 7f2ed08f2700 1 --2- 172.21.15.146:0/110893458 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ecc1301e0 0x7f2ecc06ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.682+0000 7f2ed08f2700 1 --2- 172.21.15.146:0/110893458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ecc09a0a0 0x7f2ecc06f4d0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.682+0000 7f2ed08f2700 1 --2- 172.21.15.146:0/110893458 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2ecc12f700 0x7f2ecc06fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.682+0000 7f2ed08f2700 1 -- 172.21.15.146:0/110893458 >> 172.21.15.146:0/110893458 conn(0x7f2ecc0a1ee0 msgr2=0x7f2ecc1297d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.682+0000 7f2ed08f2700 1 -- 172.21.15.146:0/110893458 shutdown_connections 2023-10-03T10:15:20.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.682+0000 7f2ed08f2700 1 -- 172.21.15.146:0/110893458 wait complete. 2023-10-03T10:15:20.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:20.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:20.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.699+0000 7f07a14c3700 1 -- 172.21.15.146:0/2574011443 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f079c120a30 con 0x7f079c134210 2023-10-03T10:15:20.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.699+0000 7f07837fe700 1 -- 172.21.15.146:0/2574011443 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f079401cb60 con 0x7f079c134210 2023-10-03T10:15:20.700 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:20.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.701+0000 7f07a14c3700 1 -- 172.21.15.146:0/2574011443 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f079c134210 msgr2=0x7f079c11e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.701+0000 7f07a14c3700 1 --2- 172.21.15.146:0/2574011443 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f079c134210 0x7f079c11e200 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0794009e50 tx=0x7f079400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.701+0000 7f07a14c3700 1 -- 172.21.15.146:0/2574011443 shutdown_connections 2023-10-03T10:15:20.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.701+0000 7f07a14c3700 1 --2- 172.21.15.146:0/2574011443 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f079c134210 0x7f079c11e200 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.701+0000 7f07a14c3700 1 --2- 172.21.15.146:0/2574011443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f079c0a0ee0 0x7f079c11d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.701+0000 7f07a14c3700 1 --2- 172.21.15.146:0/2574011443 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f079c133900 0x7f079c11dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.701+0000 7f07a14c3700 1 -- 172.21.15.146:0/2574011443 >> 172.21.15.146:0/2574011443 conn(0x7f079c0a2980 msgr2=0x7f079c1bad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.701+0000 7f07a14c3700 1 -- 172.21.15.146:0/2574011443 shutdown_connections 2023-10-03T10:15:20.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.701+0000 7f07a14c3700 1 -- 172.21.15.146:0/2574011443 wait complete. 2023-10-03T10:15:20.714 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:20.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.766+0000 7f4de4ee7700 1 -- 172.21.15.146:0/1773337062 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4de004f2a0 con 0x7f4de00a0a70 2023-10-03T10:15:20.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.766+0000 7f4dceffd700 1 -- 172.21.15.146:0/1773337062 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4dd0029020 con 0x7f4de00a0a70 2023-10-03T10:15:20.767 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:20.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.768+0000 7f4de4ee7700 1 -- 172.21.15.146:0/1773337062 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4de00a0a70 msgr2=0x7f4de0122440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.768+0000 7f4de4ee7700 1 --2- 172.21.15.146:0/1773337062 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4de00a0a70 0x7f4de0122440 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4dd000ebb0 tx=0x7f4dd000eec0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.768+0000 7f4de4ee7700 1 -- 172.21.15.146:0/1773337062 shutdown_connections 2023-10-03T10:15:20.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.768+0000 7f4de4ee7700 1 --2- 172.21.15.146:0/1773337062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4de0133f50 0x7f4de0122ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.768+0000 7f4de4ee7700 1 --2- 172.21.15.146:0/1773337062 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4de00a0a70 0x7f4de0122440 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.768+0000 7f4de4ee7700 1 --2- 172.21.15.146:0/1773337062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4de00a1380 0x7f4de0122980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.768+0000 7f4de4ee7700 1 -- 172.21.15.146:0/1773337062 >> 172.21.15.146:0/1773337062 conn(0x7f4de00a6610 msgr2=0x7f4de011c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.768+0000 7f4de4ee7700 1 -- 172.21.15.146:0/1773337062 shutdown_connections 2023-10-03T10:15:20.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:20.768+0000 7f4de4ee7700 1 -- 172.21.15.146:0/1773337062 wait complete. 2023-10-03T10:15:20.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:21.688 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:21.696 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:21.715 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:21.782 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.831+0000 7fbe2791d700 1 Processor -- start 2023-10-03T10:15:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.831+0000 7fbe2791d700 1 -- start start 2023-10-03T10:15:21.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.832+0000 7fbe2791d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbe20133900 0x7fbe20133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.832+0000 7fbe2791d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe20134210 0x7fbe200a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.832+0000 7fbe2791d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe2009a760 con 0x7fbe200a0ee0 2023-10-03T10:15:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.832+0000 7fbe2791d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe201336e0 con 0x7fbe20133900 2023-10-03T10:15:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.832+0000 7fbe2791d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2009a080 con 0x7fbe20134210 2023-10-03T10:15:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.832+0000 7fbe24eb8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe20134210 0x7fbe200a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.832+0000 7fbe25eba700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbe200a0ee0 0x7fbe2013a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60384/0 (socket says 172.21.15.146:60384) 2023-10-03T10:15:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.832+0000 7fbe25eba700 1 -- 172.21.15.146:0/3169679500 learned_addr learned my addr 172.21.15.146:0/3169679500 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:21.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.832+0000 7fbe256b9700 1 --2- 172.21.15.146:0/3169679500 >> v2:172.21.15.146:3300/0 conn(0x7fbe20133900 0x7fbe20133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.832+0000 7fbe256b9700 1 -- 172.21.15.146:0/3169679500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe20134210 msgr2=0x7fbe200a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:21.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.832+0000 7fbe256b9700 1 --2- 172.21.15.146:0/3169679500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe20134210 0x7fbe200a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.832+0000 7fbe256b9700 1 -- 172.21.15.146:0/3169679500 >> v1:172.21.15.146:6789/0 conn(0x7fbe200a0ee0 legacy=0x7fbe2013a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.832+0000 7fbe256b9700 1 -- 172.21.15.146:0/3169679500 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe200a23e0 con 0x7fbe20133900 2023-10-03T10:15:21.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.832+0000 7fbe256b9700 1 --2- 172.21.15.146:0/3169679500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe20133900 0x7fbe20133cd0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009820 tx=0x7fbe1c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d57cb622874f432 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.833+0000 7fbe17fff700 1 -- 172.21.15.146:0/3169679500 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c005e30 con 0x7fbe20133900 2023-10-03T10:15:21.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.833+0000 7fbe17fff700 1 -- 172.21.15.146:0/3169679500 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1c006030 con 0x7fbe20133900 2023-10-03T10:15:21.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.833+0000 7fbe17fff700 1 -- 172.21.15.146:0/3169679500 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c0063c0 con 0x7fbe20133900 2023-10-03T10:15:21.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.833+0000 7fbe2791d700 1 -- 172.21.15.146:0/3169679500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe20133900 msgr2=0x7fbe20133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.833+0000 7fbe2791d700 1 --2- 172.21.15.146:0/3169679500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe20133900 0x7fbe20133cd0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009820 tx=0x7fbe1c009b30 comp rx=0 tx=0).stop 2023-10-03T10:15:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.834+0000 7fbe2791d700 1 -- 172.21.15.146:0/3169679500 shutdown_connections 2023-10-03T10:15:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.834+0000 7fbe2791d700 1 --2- 172.21.15.146:0/3169679500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe20133900 0x7fbe20133cd0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.834+0000 7fbe2791d700 1 --2- 172.21.15.146:0/3169679500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe20134210 0x7fbe200a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.834+0000 7fbe2791d700 1 -- 172.21.15.146:0/3169679500 >> 172.21.15.146:0/3169679500 conn(0x7fbe200a2980 msgr2=0x7fbe200a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.834+0000 7fbe2791d700 1 -- 172.21.15.146:0/3169679500 shutdown_connections 2023-10-03T10:15:21.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.834+0000 7fbe2791d700 1 -- 172.21.15.146:0/3169679500 wait complete. 2023-10-03T10:15:21.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.835+0000 7fbe2791d700 1 Processor -- start 2023-10-03T10:15:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.835+0000 7fbe2791d700 1 -- start start 2023-10-03T10:15:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.835+0000 7fbe2791d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe200a0ee0 0x7fbe2011d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.835+0000 7fbe2791d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe20133900 0x7fbe2011dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.835+0000 7fbe2791d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe20134210 0x7fbe2011e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.835+0000 7fbe2791d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2011ec30 con 0x7fbe20133900 2023-10-03T10:15:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.835+0000 7fbe2791d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2011f970 con 0x7fbe200a0ee0 2023-10-03T10:15:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.835+0000 7fbe2791d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe20120a30 con 0x7fbe20134210 2023-10-03T10:15:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.835+0000 7fbe256b9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe200a0ee0 0x7fbe2011d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.835+0000 7fbe256b9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe200a0ee0 0x7fbe2011d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44348/0 (socket says 172.21.15.146:44348) 2023-10-03T10:15:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.835+0000 7fbe256b9700 1 -- 172.21.15.146:0/2880379410 learned_addr learned my addr 172.21.15.146:0/2880379410 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.835+0000 7fbe25eba700 1 --2- 172.21.15.146:0/2880379410 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe20134210 0x7fbe2011e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.835+0000 7fbe24eb8700 1 --2- 172.21.15.146:0/2880379410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe20133900 0x7fbe2011dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.836+0000 7fbe256b9700 1 -- 172.21.15.146:0/2880379410 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe20134210 msgr2=0x7fbe2011e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.836+0000 7fbe256b9700 1 --2- 172.21.15.146:0/2880379410 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe20134210 0x7fbe2011e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.836+0000 7fbe256b9700 1 -- 172.21.15.146:0/2880379410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe20133900 msgr2=0x7fbe2011dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.836+0000 7fbe256b9700 1 --2- 172.21.15.146:0/2880379410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe20133900 0x7fbe2011dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.836+0000 7fbe256b9700 1 -- 172.21.15.146:0/2880379410 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c009430 con 0x7fbe200a0ee0 2023-10-03T10:15:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.836+0000 7fbe25eba700 1 --2- 172.21.15.146:0/2880379410 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe20134210 0x7fbe2011e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.836+0000 7fbe256b9700 1 --2- 172.21.15.146:0/2880379410 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe200a0ee0 0x7fbe2011d7d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c000c00 tx=0x7fbe1c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.836+0000 7fbe15ffb700 1 -- 172.21.15.146:0/2880379410 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c0063a0 con 0x7fbe200a0ee0 2023-10-03T10:15:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.836+0000 7fbe15ffb700 1 -- 172.21.15.146:0/2880379410 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1c020070 con 0x7fbe200a0ee0 2023-10-03T10:15:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.836+0000 7fbe2791d700 1 -- 172.21.15.146:0/2880379410 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2009a2c0 con 0x7fbe200a0ee0 2023-10-03T10:15:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.836+0000 7fbe15ffb700 1 -- 172.21.15.146:0/2880379410 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c006760 con 0x7fbe200a0ee0 2023-10-03T10:15:21.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.836+0000 7fbe2791d700 1 -- 172.21.15.146:0/2880379410 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2011f390 con 0x7fbe200a0ee0 2023-10-03T10:15:21.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.837+0000 7fbe15ffb700 1 -- 172.21.15.146:0/2880379410 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe1c022030 con 0x7fbe200a0ee0 2023-10-03T10:15:21.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.838+0000 7fbe2791d700 1 -- 172.21.15.146:0/2880379410 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe20120c60 con 0x7fbe200a0ee0 2023-10-03T10:15:21.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.838+0000 7fbe15ffb700 1 -- 172.21.15.146:0/2880379410 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbe1c040b60 con 0x7fbe200a0ee0 2023-10-03T10:15:21.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.846+0000 7fbe15ffb700 1 -- 172.21.15.146:0/2880379410 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe20120c60 con 0x7fbe200a0ee0 2023-10-03T10:15:21.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.869+0000 7f2d4692a700 1 Processor -- start 2023-10-03T10:15:21.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.869+0000 7f2d4692a700 1 -- start start 2023-10-03T10:15:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.869+0000 7f2d4692a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d40136960 0x7f2d40138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.869+0000 7f2d4692a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2d40139280 0x7f2d4013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.869+0000 7f2d4692a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d4006b2d0 con 0x7f2d40133ad0 2023-10-03T10:15:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.869+0000 7f2d4692a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d401345b0 con 0x7f2d40139280 2023-10-03T10:15:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.869+0000 7f2d4692a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d40133610 con 0x7f2d40136960 2023-10-03T10:15:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.869+0000 7f2d44ec7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2d40139280 0x7f2d4013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.869+0000 7f2d44ec7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2d40139280 0x7f2d4013b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41574/0 (socket says 172.21.15.146:41574) 2023-10-03T10:15:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.869+0000 7f2d44ec7700 1 -- 172.21.15.146:0/4131658182 learned_addr learned my addr 172.21.15.146:0/4131658182 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.869+0000 7f2d3ffff700 1 --1- 172.21.15.146:0/4131658182 >> v1:172.21.15.146:6789/0 conn(0x7f2d40133ad0 0x7f2d40133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60398/0 (socket says 172.21.15.146:60398) 2023-10-03T10:15:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.870+0000 7f2d3f7fe700 1 --2- 172.21.15.146:0/4131658182 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d40136960 0x7f2d40138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.870+0000 7f2d44ec7700 1 -- 172.21.15.146:0/4131658182 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d40136960 msgr2=0x7f2d40138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.870+0000 7f2d44ec7700 1 --2- 172.21.15.146:0/4131658182 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d40136960 0x7f2d40138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.870+0000 7f2d44ec7700 1 -- 172.21.15.146:0/4131658182 >> v1:172.21.15.146:6789/0 conn(0x7f2d40133ad0 legacy=0x7f2d40133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.870+0000 7f2d44ec7700 1 -- 172.21.15.146:0/4131658182 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4009a500 con 0x7f2d40139280 2023-10-03T10:15:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.870+0000 7f2d3effd700 1 -- 172.21.15.146:0/4131658182 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4024938786 0 0) 0x7f2d4006b2d0 con 0x7f2d40133ad0 2023-10-03T10:15:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.870+0000 7f2d3f7fe700 1 --2- 172.21.15.146:0/4131658182 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d40136960 0x7f2d40138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.870+0000 7f2d44ec7700 1 --2- 172.21.15.146:0/4131658182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d40139280 0x7f2d4013b660 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009e80 tx=0x7f2d3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c967ed6466ad9ab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.870+0000 7f2d3effd700 1 -- 172.21.15.146:0/4131658182 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3800e070 con 0x7f2d40139280 2023-10-03T10:15:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.870+0000 7f2d3effd700 1 -- 172.21.15.146:0/4131658182 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3800b980 con 0x7f2d40139280 2023-10-03T10:15:21.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.870+0000 7f2d3effd700 1 -- 172.21.15.146:0/4131658182 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3800bd30 con 0x7f2d40139280 2023-10-03T10:15:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.871+0000 7f2d4692a700 1 -- 172.21.15.146:0/4131658182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d40139280 msgr2=0x7f2d4013b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.871+0000 7f2d4692a700 1 --2- 172.21.15.146:0/4131658182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d40139280 0x7f2d4013b660 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009e80 tx=0x7f2d3800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.871+0000 7f2d4692a700 1 -- 172.21.15.146:0/4131658182 shutdown_connections 2023-10-03T10:15:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.871+0000 7f2d4692a700 1 --2- 172.21.15.146:0/4131658182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d40139280 0x7f2d4013b660 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.871+0000 7f2d4692a700 1 --2- 172.21.15.146:0/4131658182 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d40136960 0x7f2d40138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.871+0000 7f2d4692a700 1 -- 172.21.15.146:0/4131658182 >> 172.21.15.146:0/4131658182 conn(0x7f2d40099c40 msgr2=0x7f2d400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.871+0000 7f2d4692a700 1 -- 172.21.15.146:0/4131658182 shutdown_connections 2023-10-03T10:15:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.871+0000 7f2d4692a700 1 -- 172.21.15.146:0/4131658182 wait complete. 2023-10-03T10:15:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.872+0000 7f2d4692a700 1 Processor -- start 2023-10-03T10:15:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.872+0000 7f2d4692a700 1 -- start start 2023-10-03T10:15:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.873+0000 7f2d4692a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d40133ad0 0x7f2d4012cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.873+0000 7f2d4692a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d40136960 0x7f2d4012d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.873+0000 7f2d4692a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d40139280 0x7f2d4012d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.873+0000 7f2d4692a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d401302c0 con 0x7f2d40139280 2023-10-03T10:15:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.873+0000 7f2d4692a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d401318a0 con 0x7f2d40133ad0 2023-10-03T10:15:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.873+0000 7f2d4692a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4006ff40 con 0x7f2d40136960 2023-10-03T10:15:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.873+0000 7f2d3ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d40133ad0 0x7f2d4012cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.873+0000 7f2d3f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d40136960 0x7f2d4012d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.873+0000 7f2d3ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d40133ad0 0x7f2d4012cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44356/0 (socket says 172.21.15.146:44356) 2023-10-03T10:15:21.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.873+0000 7f2d3ffff700 1 -- 172.21.15.146:0/3217352891 learned_addr learned my addr 172.21.15.146:0/3217352891 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:21.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.874+0000 7f2d3f7fe700 1 -- 172.21.15.146:0/3217352891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d40133ad0 msgr2=0x7f2d4012cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.874+0000 7f2d3f7fe700 1 --2- 172.21.15.146:0/3217352891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d40133ad0 0x7f2d4012cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.874+0000 7f2d3f7fe700 1 -- 172.21.15.146:0/3217352891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d40139280 msgr2=0x7f2d4012d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.874+0000 7f2d3f7fe700 1 --2- 172.21.15.146:0/3217352891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d40139280 0x7f2d4012d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.874+0000 7f2d3f7fe700 1 -- 172.21.15.146:0/3217352891 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d38009b30 con 0x7f2d40136960 2023-10-03T10:15:21.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.874+0000 7f2d3ffff700 1 --2- 172.21.15.146:0/3217352891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d40133ad0 0x7f2d4012cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:21.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.874+0000 7f2d3f7fe700 1 --2- 172.21.15.146:0/3217352891 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d40136960 0x7f2d4012d070 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2d3400e810 tx=0x7f2d3400eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.874+0000 7f2d3cff9700 1 -- 172.21.15.146:0/3217352891 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3400c070 con 0x7f2d40136960 2023-10-03T10:15:21.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.874+0000 7f2d3cff9700 1 -- 172.21.15.146:0/3217352891 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d34013610 con 0x7f2d40136960 2023-10-03T10:15:21.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.874+0000 7f2d4692a700 1 -- 172.21.15.146:0/3217352891 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d4009f390 con 0x7f2d40136960 2023-10-03T10:15:21.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.874+0000 7f2d3cff9700 1 -- 172.21.15.146:0/3217352891 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d34013980 con 0x7f2d40136960 2023-10-03T10:15:21.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.874+0000 7f2d4692a700 1 -- 172.21.15.146:0/3217352891 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d40070c70 con 0x7f2d40136960 2023-10-03T10:15:21.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.875+0000 7f2d3cff9700 1 -- 172.21.15.146:0/3217352891 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d34013ae0 con 0x7f2d40136960 2023-10-03T10:15:21.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.875+0000 7f2d3cff9700 1 -- 172.21.15.146:0/3217352891 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2d3403f340 con 0x7f2d40136960 2023-10-03T10:15:21.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.876+0000 7f2d4692a700 1 -- 172.21.15.146:0/3217352891 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4004f2a0 con 0x7f2d40136960 2023-10-03T10:15:21.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.879+0000 7ff3b5d1a700 1 Processor -- start 2023-10-03T10:15:21.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.879+0000 7ff3b5d1a700 1 -- start start 2023-10-03T10:15:21.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.879+0000 7ff3b5d1a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b009e340 0x7ff3b01359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.879+0000 7ff3b5d1a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3b0135f20 0x7ff3b0138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.879+0000 7ff3b5d1a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b009aaa0 con 0x7ff3b009d860 2023-10-03T10:15:21.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.879+0000 7ff3b5d1a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b009e730 con 0x7ff3b009e340 2023-10-03T10:15:21.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.879+0000 7ff3b5d1a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b009f870 con 0x7ff3b0135f20 2023-10-03T10:15:21.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.880+0000 7ff3affff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3b0135f20 0x7ff3b0138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.880+0000 7ff3af7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff3b009d860 0x7ff3b009dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60414/0 (socket says 172.21.15.146:60414) 2023-10-03T10:15:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.880+0000 7ff3aeffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b009e340 0x7ff3b01359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.880+0000 7ff3af7fe700 1 -- 172.21.15.146:0/4036322138 learned_addr learned my addr 172.21.15.146:0/4036322138 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.880+0000 7ff3ae7fc700 1 -- 172.21.15.146:0/4036322138 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2840917422 0 0) 0x7ff3b009aaa0 con 0x7ff3b009d860 2023-10-03T10:15:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.880+0000 7ff3aeffd700 1 -- 172.21.15.146:0/4036322138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3b0135f20 msgr2=0x7ff3b0138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.880+0000 7ff3aeffd700 1 --2- 172.21.15.146:0/4036322138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3b0135f20 0x7ff3b0138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.880+0000 7ff3aeffd700 1 -- 172.21.15.146:0/4036322138 >> v1:172.21.15.146:6789/0 conn(0x7ff3b009d860 legacy=0x7ff3b009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.880+0000 7ff3aeffd700 1 -- 172.21.15.146:0/4036322138 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b009b360 con 0x7ff3b009e340 2023-10-03T10:15:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.880+0000 7ff3affff700 1 --2- 172.21.15.146:0/4036322138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3b0135f20 0x7ff3b0138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.880+0000 7ff3aeffd700 1 --2- 172.21.15.146:0/4036322138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b009e340 0x7ff3b01359e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4009870 tx=0x7ff3a4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e25328dc79f65f87 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.880+0000 7ff3ae7fc700 1 -- 172.21.15.146:0/4036322138 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4011830 con 0x7ff3b009e340 2023-10-03T10:15:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.880+0000 7ff3ae7fc700 1 -- 172.21.15.146:0/4036322138 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a4011990 con 0x7ff3b009e340 2023-10-03T10:15:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.880+0000 7ff3ae7fc700 1 -- 172.21.15.146:0/4036322138 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4011d20 con 0x7ff3b009e340 2023-10-03T10:15:21.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.881+0000 7ff3b5d1a700 1 -- 172.21.15.146:0/4036322138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b009e340 msgr2=0x7ff3b01359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.881+0000 7ff3b5d1a700 1 --2- 172.21.15.146:0/4036322138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b009e340 0x7ff3b01359e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4009870 tx=0x7ff3a4009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:21.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.881+0000 7ff3b5d1a700 1 -- 172.21.15.146:0/4036322138 shutdown_connections 2023-10-03T10:15:21.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.881+0000 7ff3b5d1a700 1 --2- 172.21.15.146:0/4036322138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3b0135f20 0x7ff3b0138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.881+0000 7ff3b5d1a700 1 --2- 172.21.15.146:0/4036322138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b009e340 0x7ff3b01359e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.881+0000 7ff3b5d1a700 1 -- 172.21.15.146:0/4036322138 >> 172.21.15.146:0/4036322138 conn(0x7ff3b0099c40 msgr2=0x7ff3b00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.881+0000 7ff3b5d1a700 1 -- 172.21.15.146:0/4036322138 shutdown_connections 2023-10-03T10:15:21.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.881+0000 7ff3b5d1a700 1 -- 172.21.15.146:0/4036322138 wait complete. 2023-10-03T10:15:21.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.883+0000 7ff3b5d1a700 1 Processor -- start 2023-10-03T10:15:21.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.883+0000 7ff3b5d1a700 1 -- start start 2023-10-03T10:15:21.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.884+0000 7ff3b5d1a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3b009d860 0x7ff3b01c2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.884+0000 7ff3b5d1a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3b009e340 0x7ff3b01c3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.884+0000 7ff3b5d1a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b0135f20 0x7ff3b01c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.884+0000 7ff3b5d1a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b011c940 con 0x7ff3b009e340 2023-10-03T10:15:21.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.884+0000 7ff3b5d1a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b01c3890 con 0x7ff3b0135f20 2023-10-03T10:15:21.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.884+0000 7ff3b5d1a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b011efb0 con 0x7ff3b009d860 2023-10-03T10:15:21.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.884+0000 7ff3af7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3b009d860 0x7ff3b01c2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.884+0000 7ff3af7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3b009d860 0x7ff3b01c2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58742/0 (socket says 172.21.15.146:58742) 2023-10-03T10:15:21.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.884+0000 7ff3af7fe700 1 -- 172.21.15.146:0/3315745003 learned_addr learned my addr 172.21.15.146:0/3315745003 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:21.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.884+0000 7ff3affff700 1 --2- 172.21.15.146:0/3315745003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b0135f20 0x7ff3b01c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.884+0000 7ff3aeffd700 1 --2- 172.21.15.146:0/3315745003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3b009e340 0x7ff3b01c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.884+0000 7ff3affff700 1 -- 172.21.15.146:0/3315745003 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3b009d860 msgr2=0x7ff3b01c2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.884+0000 7ff3affff700 1 --2- 172.21.15.146:0/3315745003 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3b009d860 0x7ff3b01c2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.884+0000 7ff3affff700 1 -- 172.21.15.146:0/3315745003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3b009e340 msgr2=0x7ff3b01c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.884+0000 7ff3affff700 1 --2- 172.21.15.146:0/3315745003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3b009e340 0x7ff3b01c3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.884+0000 7ff3affff700 1 -- 172.21.15.146:0/3315745003 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a8009a70 con 0x7ff3b0135f20 2023-10-03T10:15:21.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.884+0000 7ff3aeffd700 1 --2- 172.21.15.146:0/3315745003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3b009e340 0x7ff3b01c3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:21.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.884+0000 7ff3affff700 1 --2- 172.21.15.146:0/3315745003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b0135f20 0x7ff3b01c5e00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009e50 tx=0x7ff3a800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.885+0000 7ff397fff700 1 -- 172.21.15.146:0/3315745003 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a800ca90 con 0x7ff3b0135f20 2023-10-03T10:15:21.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.885+0000 7f2d3cff9700 1 -- 172.21.15.146:0/3217352891 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d340108e0 con 0x7f2d40136960 2023-10-03T10:15:21.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.885+0000 7ff3b5d1a700 1 -- 172.21.15.146:0/3315745003 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a40094a0 con 0x7ff3b0135f20 2023-10-03T10:15:21.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.885+0000 7ff3b5d1a700 1 -- 172.21.15.146:0/3315745003 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b011e2f0 con 0x7ff3b0135f20 2023-10-03T10:15:21.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.885+0000 7ff397fff700 1 -- 172.21.15.146:0/3315745003 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a800f040 con 0x7ff3b0135f20 2023-10-03T10:15:21.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.885+0000 7ff397fff700 1 -- 172.21.15.146:0/3315745003 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a800ce50 con 0x7ff3b0135f20 2023-10-03T10:15:21.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.886+0000 7ff3b5d1a700 1 -- 172.21.15.146:0/3315745003 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3900052e0 con 0x7ff3b0135f20 2023-10-03T10:15:21.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.886+0000 7ff397fff700 1 -- 172.21.15.146:0/3315745003 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff3a8014480 con 0x7ff3b0135f20 2023-10-03T10:15:21.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.887+0000 7ff397fff700 1 -- 172.21.15.146:0/3315745003 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff3a803fca0 con 0x7ff3b0135f20 2023-10-03T10:15:21.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.897+0000 7ff397fff700 1 -- 172.21.15.146:0/3315745003 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff3a8012910 con 0x7ff3b0135f20 2023-10-03T10:15:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.929+0000 7fad3e3ea700 1 Processor -- start 2023-10-03T10:15:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.929+0000 7fad3e3ea700 1 -- start start 2023-10-03T10:15:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.930+0000 7fad3e3ea700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad3809a150 0x7fad3809e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.930+0000 7fad3e3ea700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fad3809edb0 0x7fad3809f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.930+0000 7fad3e3ea700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad3809af80 con 0x7fad38133c20 2023-10-03T10:15:21.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.930+0000 7fad3e3ea700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad3809fe00 con 0x7fad3809edb0 2023-10-03T10:15:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.930+0000 7fad3e3ea700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3806bec0 con 0x7fad3809a150 2023-10-03T10:15:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.930+0000 7fad37fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad3809a150 0x7fad3809e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.930+0000 7fad37fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad3809a150 0x7fad3809e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44376/0 (socket says 172.21.15.146:44376) 2023-10-03T10:15:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.930+0000 7fad377fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fad3809edb0 0x7fad3809f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.930+0000 7fad37fff700 1 -- 172.21.15.146:0/1633042744 learned_addr learned my addr 172.21.15.146:0/1633042744 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.930+0000 7fad377fe700 1 -- 172.21.15.146:0/1633042744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad3809a150 msgr2=0x7fad3809e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.930+0000 7fad377fe700 1 --2- 172.21.15.146:0/1633042744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad3809a150 0x7fad3809e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.930+0000 7fad377fe700 1 -- 172.21.15.146:0/1633042744 >> v1:172.21.15.146:6789/0 conn(0x7fad38133c20 legacy=0x7fad38134070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.931+0000 7fad377fe700 1 -- 172.21.15.146:0/1633042744 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3809f6e0 con 0x7fad3809edb0 2023-10-03T10:15:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.930+0000 7fad36ffd700 1 -- 172.21.15.146:0/1633042744 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590444151 0 0) 0x7fad3809af80 con 0x7fad38133c20 2023-10-03T10:15:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.931+0000 7fad377fe700 1 --2- 172.21.15.146:0/1633042744 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad3809edb0 0x7fad3809f1a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009840 tx=0x7fad2c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0515e521acd0258 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.931+0000 7fad36ffd700 1 -- 172.21.15.146:0/1633042744 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2c011830 con 0x7fad3809edb0 2023-10-03T10:15:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.931+0000 7fad36ffd700 1 -- 172.21.15.146:0/1633042744 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2c011990 con 0x7fad3809edb0 2023-10-03T10:15:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.931+0000 7fad36ffd700 1 -- 172.21.15.146:0/1633042744 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2c011d20 con 0x7fad3809edb0 2023-10-03T10:15:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.931+0000 7fad3e3ea700 1 -- 172.21.15.146:0/1633042744 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad3809edb0 msgr2=0x7fad3809f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.931+0000 7fad3e3ea700 1 --2- 172.21.15.146:0/1633042744 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad3809edb0 0x7fad3809f1a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009840 tx=0x7fad2c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.932+0000 7fad3e3ea700 1 -- 172.21.15.146:0/1633042744 shutdown_connections 2023-10-03T10:15:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.932+0000 7fad3e3ea700 1 --2- 172.21.15.146:0/1633042744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad3809a150 0x7fad3809e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.932+0000 7fad3e3ea700 1 --2- 172.21.15.146:0/1633042744 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad3809edb0 0x7fad3809f1a0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.932+0000 7fad3e3ea700 1 -- 172.21.15.146:0/1633042744 >> 172.21.15.146:0/1633042744 conn(0x7fad380a4430 msgr2=0x7fad380a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.932+0000 7fad3e3ea700 1 -- 172.21.15.146:0/1633042744 shutdown_connections 2023-10-03T10:15:21.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.932+0000 7fad3e3ea700 1 -- 172.21.15.146:0/1633042744 wait complete. 2023-10-03T10:15:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.932+0000 7fad3e3ea700 1 Processor -- start 2023-10-03T10:15:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.933+0000 7fad3e3ea700 1 -- start start 2023-10-03T10:15:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.933+0000 7fad3e3ea700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad3809a150 0x7fad381226d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.933+0000 7fad3e3ea700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad3809edb0 0x7fad38122c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.933+0000 7fad3e3ea700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad38133c20 0x7fad38123150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.933+0000 7fad3e3ea700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad38126240 con 0x7fad3809a150 2023-10-03T10:15:21.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.933+0000 7fad3e3ea700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad38124b60 con 0x7fad3809edb0 2023-10-03T10:15:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.933+0000 7fad3e3ea700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad380a1460 con 0x7fad38133c20 2023-10-03T10:15:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.933+0000 7fad377fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad3809edb0 0x7fad38122c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.933+0000 7fad37fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad3809a150 0x7fad381226d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.933+0000 7fad37fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad3809a150 0x7fad381226d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41630/0 (socket says 172.21.15.146:41630) 2023-10-03T10:15:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.933+0000 7fad377fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad3809edb0 0x7fad38122c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44384/0 (socket says 172.21.15.146:44384) 2023-10-03T10:15:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.933+0000 7fad37fff700 1 -- 172.21.15.146:0/964529205 learned_addr learned my addr 172.21.15.146:0/964529205 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.934+0000 7fad377fe700 1 -- 172.21.15.146:0/964529205 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad38133c20 msgr2=0x7fad38123150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.934+0000 7fad377fe700 1 --2- 172.21.15.146:0/964529205 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad38133c20 0x7fad38123150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.934+0000 7fad377fe700 1 -- 172.21.15.146:0/964529205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad3809a150 msgr2=0x7fad381226d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.934+0000 7fad377fe700 1 --2- 172.21.15.146:0/964529205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad3809a150 0x7fad381226d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.934+0000 7fad377fe700 1 -- 172.21.15.146:0/964529205 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2c0094a0 con 0x7fad3809edb0 2023-10-03T10:15:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.934+0000 7fad377fe700 1 --2- 172.21.15.146:0/964529205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad3809edb0 0x7fad38122c10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fad2c016000 tx=0x7fad2c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.934+0000 7fad34ff9700 1 -- 172.21.15.146:0/964529205 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2c0036a0 con 0x7fad3809edb0 2023-10-03T10:15:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.934+0000 7fad34ff9700 1 -- 172.21.15.146:0/964529205 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2c01f070 con 0x7fad3809edb0 2023-10-03T10:15:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.934+0000 7fad34ff9700 1 -- 172.21.15.146:0/964529205 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2c003a20 con 0x7fad3809edb0 2023-10-03T10:15:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.934+0000 7fad3e3ea700 1 -- 172.21.15.146:0/964529205 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad381250b0 con 0x7fad3809edb0 2023-10-03T10:15:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.935+0000 7fad3e3ea700 1 -- 172.21.15.146:0/964529205 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad38125ec0 con 0x7fad3809edb0 2023-10-03T10:15:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.935+0000 7fad34ff9700 1 -- 172.21.15.146:0/964529205 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad2c003b80 con 0x7fad3809edb0 2023-10-03T10:15:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.936+0000 7fad34ff9700 1 -- 172.21.15.146:0/964529205 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fad2c021070 con 0x7fad3809edb0 2023-10-03T10:15:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.936+0000 7fad3e3ea700 1 -- 172.21.15.146:0/964529205 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad3809fa30 con 0x7fad3809edb0 2023-10-03T10:15:21.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:21.941+0000 7fad34ff9700 1 -- 172.21.15.146:0/964529205 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad2c02b080 con 0x7fad3809edb0 2023-10-03T10:15:22.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.052+0000 7fbe2791d700 1 -- 172.21.15.146:0/2880379410 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbe20120c60 con 0x7fbe200a0ee0 2023-10-03T10:15:22.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.052+0000 7fbe15ffb700 1 -- 172.21.15.146:0/2880379410 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbe20120c60 con 0x7fbe200a0ee0 2023-10-03T10:15:22.053 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:22.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.054+0000 7fbe2791d700 1 -- 172.21.15.146:0/2880379410 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe200a0ee0 msgr2=0x7fbe2011d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.054+0000 7fbe2791d700 1 --2- 172.21.15.146:0/2880379410 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe200a0ee0 0x7fbe2011d7d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c000c00 tx=0x7fbe1c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:22.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.054+0000 7fbe2791d700 1 -- 172.21.15.146:0/2880379410 shutdown_connections 2023-10-03T10:15:22.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.054+0000 7fbe2791d700 1 --2- 172.21.15.146:0/2880379410 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe20134210 0x7fbe2011e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.054+0000 7fbe2791d700 1 --2- 172.21.15.146:0/2880379410 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe200a0ee0 0x7fbe2011d7d0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.054+0000 7fbe2791d700 1 --2- 172.21.15.146:0/2880379410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe20133900 0x7fbe2011dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.054+0000 7fbe2791d700 1 -- 172.21.15.146:0/2880379410 >> 172.21.15.146:0/2880379410 conn(0x7fbe200a2980 msgr2=0x7fbe201bada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.054+0000 7fbe2791d700 1 -- 172.21.15.146:0/2880379410 shutdown_connections 2023-10-03T10:15:22.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.054+0000 7fbe2791d700 1 -- 172.21.15.146:0/2880379410 wait complete. 2023-10-03T10:15:22.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:22.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.134+0000 7fad3e3ea700 1 -- 172.21.15.146:0/964529205 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fad3809f6e0 con 0x7fad3809edb0 2023-10-03T10:15:22.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.134+0000 7fad34ff9700 1 -- 172.21.15.146:0/964529205 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad3809f6e0 con 0x7fad3809edb0 2023-10-03T10:15:22.135 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.137+0000 7fad3e3ea700 1 -- 172.21.15.146:0/964529205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad3809edb0 msgr2=0x7fad38122c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.137+0000 7fad3e3ea700 1 --2- 172.21.15.146:0/964529205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad3809edb0 0x7fad38122c10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fad2c016000 tx=0x7fad2c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.137+0000 7fad3e3ea700 1 -- 172.21.15.146:0/964529205 shutdown_connections 2023-10-03T10:15:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.137+0000 7fad3e3ea700 1 --2- 172.21.15.146:0/964529205 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad38133c20 0x7fad38123150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.137+0000 7fad3e3ea700 1 --2- 172.21.15.146:0/964529205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad3809a150 0x7fad381226d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.137+0000 7fad3e3ea700 1 --2- 172.21.15.146:0/964529205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad3809edb0 0x7fad38122c10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.137+0000 7fad3e3ea700 1 -- 172.21.15.146:0/964529205 >> 172.21.15.146:0/964529205 conn(0x7fad380a4430 msgr2=0x7fad380a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.137+0000 7fad3e3ea700 1 -- 172.21.15.146:0/964529205 shutdown_connections 2023-10-03T10:15:22.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.137+0000 7fad3e3ea700 1 -- 172.21.15.146:0/964529205 wait complete. 2023-10-03T10:15:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.141+0000 7f2d4692a700 1 -- 172.21.15.146:0/3217352891 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2d4009f0f0 con 0x7f2d40136960 2023-10-03T10:15:22.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.141+0000 7f2d3cff9700 1 -- 172.21.15.146:0/3217352891 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2d34010310 con 0x7f2d40136960 2023-10-03T10:15:22.142 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:22.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.144+0000 7f2d4692a700 1 -- 172.21.15.146:0/3217352891 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d40136960 msgr2=0x7f2d4012d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.144+0000 7f2d4692a700 1 --2- 172.21.15.146:0/3217352891 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d40136960 0x7f2d4012d070 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2d3400e810 tx=0x7f2d3400eb20 comp rx=0 tx=0).stop 2023-10-03T10:15:22.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.144+0000 7f2d4692a700 1 -- 172.21.15.146:0/3217352891 shutdown_connections 2023-10-03T10:15:22.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.144+0000 7f2d4692a700 1 --2- 172.21.15.146:0/3217352891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d40139280 0x7f2d4012d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.144+0000 7f2d4692a700 1 --2- 172.21.15.146:0/3217352891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d40133ad0 0x7f2d4012cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.144+0000 7f2d4692a700 1 --2- 172.21.15.146:0/3217352891 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d40136960 0x7f2d4012d070 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.144+0000 7f2d4692a700 1 -- 172.21.15.146:0/3217352891 >> 172.21.15.146:0/3217352891 conn(0x7f2d40099c40 msgr2=0x7f2d400a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.144+0000 7f2d4692a700 1 -- 172.21.15.146:0/3217352891 shutdown_connections 2023-10-03T10:15:22.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.144+0000 7f2d4692a700 1 -- 172.21.15.146:0/3217352891 wait complete. 2023-10-03T10:15:22.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:22.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.151+0000 7ff3b5d1a700 1 -- 172.21.15.146:0/3315745003 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff390005590 con 0x7ff3b0135f20 2023-10-03T10:15:22.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.152+0000 7ff397fff700 1 -- 172.21.15.146:0/3315745003 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff3a8012340 con 0x7ff3b0135f20 2023-10-03T10:15:22.153 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.154+0000 7ff3b5d1a700 1 -- 172.21.15.146:0/3315745003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b0135f20 msgr2=0x7ff3b01c5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.154+0000 7ff3b5d1a700 1 --2- 172.21.15.146:0/3315745003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b0135f20 0x7ff3b01c5e00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009e50 tx=0x7ff3a800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.154+0000 7ff3b5d1a700 1 -- 172.21.15.146:0/3315745003 shutdown_connections 2023-10-03T10:15:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.154+0000 7ff3b5d1a700 1 --2- 172.21.15.146:0/3315745003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b0135f20 0x7ff3b01c5e00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.154+0000 7ff3b5d1a700 1 --2- 172.21.15.146:0/3315745003 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3b009d860 0x7ff3b01c2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.154+0000 7ff3b5d1a700 1 --2- 172.21.15.146:0/3315745003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3b009e340 0x7ff3b01c3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.154+0000 7ff3b5d1a700 1 -- 172.21.15.146:0/3315745003 >> 172.21.15.146:0/3315745003 conn(0x7ff3b0099c40 msgr2=0x7ff3b00a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.154+0000 7ff3b5d1a700 1 -- 172.21.15.146:0/3315745003 shutdown_connections 2023-10-03T10:15:22.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:22.154+0000 7ff3b5d1a700 1 -- 172.21.15.146:0/3315745003 wait complete. 2023-10-03T10:15:22.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:22.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:23.068 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:23.152 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:23.163 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:23.169 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:23.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.213+0000 7f02c8a6b700 1 Processor -- start 2023-10-03T10:15:23.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.213+0000 7f02c8a6b700 1 -- start start 2023-10-03T10:15:23.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.214+0000 7f02c8a6b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02c4133ad0 0x7f02c4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.214+0000 7f02c8a6b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02c41300a0 0x7f02c41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.214+0000 7f02c8a6b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c406b2d0 con 0x7f02c41309f0 2023-10-03T10:15:23.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.214+0000 7f02c8a6b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c4133610 con 0x7f02c4133ad0 2023-10-03T10:15:23.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.214+0000 7f02c8a6b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02c409a500 con 0x7f02c41300a0 2023-10-03T10:15:23.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.214+0000 7f02c2d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f02c41309f0 0x7f02c413a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60444/0 (socket says 172.21.15.146:60444) 2023-10-03T10:15:23.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.214+0000 7f02c2d9d700 1 -- 172.21.15.146:0/2264821737 learned_addr learned my addr 172.21.15.146:0/2264821737 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:23.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.214+0000 7f02c1d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02c41300a0 0x7f02c41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.214+0000 7f02c259c700 1 --2- 172.21.15.146:0/2264821737 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02c4133ad0 0x7f02c4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.214+0000 7f02c159a700 1 -- 172.21.15.146:0/2264821737 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313893508 0 0) 0x7f02c406b2d0 con 0x7f02c41309f0 2023-10-03T10:15:23.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.214+0000 7f02c1d9b700 1 -- 172.21.15.146:0/2264821737 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02c4133ad0 msgr2=0x7f02c4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:23.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.214+0000 7f02c1d9b700 1 --2- 172.21.15.146:0/2264821737 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02c4133ad0 0x7f02c4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.214+0000 7f02c1d9b700 1 -- 172.21.15.146:0/2264821737 >> v1:172.21.15.146:6789/0 conn(0x7f02c41309f0 legacy=0x7f02c413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.214+0000 7f02c1d9b700 1 -- 172.21.15.146:0/2264821737 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c41338b0 con 0x7f02c41300a0 2023-10-03T10:15:23.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.215+0000 7f02c1d9b700 1 --2- 172.21.15.146:0/2264821737 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02c41300a0 0x7f02c41304b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009870 tx=0x7f02b8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91acccfa88d9d0e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:23.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.215+0000 7f02c159a700 1 -- 172.21.15.146:0/2264821737 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b8011830 con 0x7f02c41300a0 2023-10-03T10:15:23.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.215+0000 7f02c159a700 1 -- 172.21.15.146:0/2264821737 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b8011990 con 0x7f02c41300a0 2023-10-03T10:15:23.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.215+0000 7f02c159a700 1 -- 172.21.15.146:0/2264821737 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b8011d20 con 0x7f02c41300a0 2023-10-03T10:15:23.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.216+0000 7f02c8a6b700 1 -- 172.21.15.146:0/2264821737 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02c41300a0 msgr2=0x7f02c41304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.216+0000 7f02c8a6b700 1 --2- 172.21.15.146:0/2264821737 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02c41300a0 0x7f02c41304b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009870 tx=0x7f02b8009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:23.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.216+0000 7f02c8a6b700 1 -- 172.21.15.146:0/2264821737 shutdown_connections 2023-10-03T10:15:23.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.216+0000 7f02c8a6b700 1 --2- 172.21.15.146:0/2264821737 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02c4133ad0 0x7f02c4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.216+0000 7f02c8a6b700 1 --2- 172.21.15.146:0/2264821737 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02c41300a0 0x7f02c41304b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.216+0000 7f02c8a6b700 1 -- 172.21.15.146:0/2264821737 >> 172.21.15.146:0/2264821737 conn(0x7f02c4099c40 msgr2=0x7f02c40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:23.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.216+0000 7f02c8a6b700 1 -- 172.21.15.146:0/2264821737 shutdown_connections 2023-10-03T10:15:23.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.216+0000 7f02c8a6b700 1 -- 172.21.15.146:0/2264821737 wait complete. 2023-10-03T10:15:23.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.217+0000 7f02c8a6b700 1 Processor -- start 2023-10-03T10:15:23.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.217+0000 7f02c8a6b700 1 -- start start 2023-10-03T10:15:23.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.218+0000 7f02c8a6b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02c41300a0 0x7f02c411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.218+0000 7f02c8a6b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02c41309f0 0x7f02c411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.218+0000 7f02c8a6b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02c4133ad0 0x7f02c411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.218+0000 7f02c8a6b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c4120950 con 0x7f02c41300a0 2023-10-03T10:15:23.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.218+0000 7f02c8a6b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c412d930 con 0x7f02c4133ad0 2023-10-03T10:15:23.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.218+0000 7f02c8a6b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02c411fd00 con 0x7f02c41309f0 2023-10-03T10:15:23.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.218+0000 7f02c259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02c41300a0 0x7f02c411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.218+0000 7f02c1d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02c41309f0 0x7f02c411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.218+0000 7f02c259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02c41300a0 0x7f02c411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41632/0 (socket says 172.21.15.146:41632) 2023-10-03T10:15:23.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.218+0000 7f02c259c700 1 -- 172.21.15.146:0/1549893284 learned_addr learned my addr 172.21.15.146:0/1549893284 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:23.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.218+0000 7f02c2d9d700 1 --2- 172.21.15.146:0/1549893284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02c4133ad0 0x7f02c411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.218+0000 7f02c259c700 1 -- 172.21.15.146:0/1549893284 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02c41309f0 msgr2=0x7f02c411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.218+0000 7f02c259c700 1 --2- 172.21.15.146:0/1549893284 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02c41309f0 0x7f02c411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.218+0000 7f02c259c700 1 -- 172.21.15.146:0/1549893284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02c4133ad0 msgr2=0x7f02c411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.218+0000 7f02c259c700 1 --2- 172.21.15.146:0/1549893284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02c4133ad0 0x7f02c411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.218+0000 7f02c259c700 1 -- 172.21.15.146:0/1549893284 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b80094a0 con 0x7f02c41300a0 2023-10-03T10:15:23.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.218+0000 7f02c2d9d700 1 --2- 172.21.15.146:0/1549893284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02c4133ad0 0x7f02c411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:23.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.218+0000 7f02c259c700 1 --2- 172.21.15.146:0/1549893284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02c41300a0 0x7f02c411da40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f02b400e9b0 tx=0x7f02b400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:23.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.219+0000 7f02b2ffd700 1 -- 172.21.15.146:0/1549893284 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b4009710 con 0x7f02c41300a0 2023-10-03T10:15:23.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.219+0000 7f02c8a6b700 1 -- 172.21.15.146:0/1549893284 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c411fa40 con 0x7f02c41300a0 2023-10-03T10:15:23.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.219+0000 7f02c8a6b700 1 -- 172.21.15.146:0/1549893284 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c40a3450 con 0x7f02c41300a0 2023-10-03T10:15:23.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.219+0000 7f02b2ffd700 1 -- 172.21.15.146:0/1549893284 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b400ee50 con 0x7f02c41300a0 2023-10-03T10:15:23.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.219+0000 7f02b2ffd700 1 -- 172.21.15.146:0/1549893284 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b400ca50 con 0x7f02c41300a0 2023-10-03T10:15:23.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.220+0000 7f02c8a6b700 1 -- 172.21.15.146:0/1549893284 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a80052e0 con 0x7f02c41300a0 2023-10-03T10:15:23.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.220+0000 7f02b2ffd700 1 -- 172.21.15.146:0/1549893284 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f02b400cbb0 con 0x7f02c41300a0 2023-10-03T10:15:23.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.221+0000 7f02b2ffd700 1 -- 172.21.15.146:0/1549893284 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f02b403ff80 con 0x7f02c41300a0 2023-10-03T10:15:23.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.226+0000 7f02b2ffd700 1 -- 172.21.15.146:0/1549893284 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f02b401a360 con 0x7f02c41300a0 2023-10-03T10:15:23.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.290+0000 7f43574ed700 1 Processor -- start 2023-10-03T10:15:23.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.290+0000 7f43574ed700 1 -- start start 2023-10-03T10:15:23.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.291+0000 7f43574ed700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4350066410 0x7f43501319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.291+0000 7f43574ed700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43501314b0 0x7f4350131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.291+0000 7f43574ed700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f435009bc70 0x7f435009c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.291+0000 7f43574ed700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43500667e0 con 0x7f4350066410 2023-10-03T10:15:23.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.291+0000 7f43574ed700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43500a23c0 con 0x7f435009bc70 2023-10-03T10:15:23.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.291+0000 7f43574ed700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43500a0f20 con 0x7f43501314b0 2023-10-03T10:15:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.291+0000 7f4355289700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4350066410 0x7f43501319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.291+0000 7f4355289700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4350066410 0x7f43501319f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41636/0 (socket says 172.21.15.146:41636) 2023-10-03T10:15:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.291+0000 7f4355289700 1 -- 172.21.15.146:0/177664449 learned_addr learned my addr 172.21.15.146:0/177664449 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.291+0000 7f4354a88700 1 --2- 172.21.15.146:0/177664449 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43501314b0 0x7f4350131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.291+0000 7f4355a8a700 1 --2- 172.21.15.146:0/177664449 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f435009bc70 0x7f435009c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.291+0000 7f4355289700 1 -- 172.21.15.146:0/177664449 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43501314b0 msgr2=0x7f4350131f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.291+0000 7f4355289700 1 --2- 172.21.15.146:0/177664449 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43501314b0 0x7f4350131f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.291+0000 7f4355289700 1 -- 172.21.15.146:0/177664449 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f435009bc70 msgr2=0x7f435009c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.291+0000 7f4355289700 1 --2- 172.21.15.146:0/177664449 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f435009bc70 0x7f435009c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.291+0000 7f4355289700 1 -- 172.21.15.146:0/177664449 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43500a16e0 con 0x7f4350066410 2023-10-03T10:15:23.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.291+0000 7f4354a88700 1 --2- 172.21.15.146:0/177664449 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43501314b0 0x7f4350131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.291+0000 7f4355a8a700 1 --2- 172.21.15.146:0/177664449 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f435009bc70 0x7f435009c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.291+0000 7f4355289700 1 --2- 172.21.15.146:0/177664449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4350066410 0x7f43501319f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f434c0098f0 tx=0x7f434c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dac06e73b42e5eb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.292+0000 7f4347fff700 1 -- 172.21.15.146:0/177664449 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c005e30 con 0x7f4350066410 2023-10-03T10:15:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.292+0000 7f4347fff700 1 -- 172.21.15.146:0/177664449 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c004030 con 0x7f4350066410 2023-10-03T10:15:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.292+0000 7f4347fff700 1 -- 172.21.15.146:0/177664449 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c0043e0 con 0x7f4350066410 2023-10-03T10:15:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.292+0000 7f43574ed700 1 -- 172.21.15.146:0/177664449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4350066410 msgr2=0x7f43501319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.292+0000 7f43574ed700 1 --2- 172.21.15.146:0/177664449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4350066410 0x7f43501319f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f434c0098f0 tx=0x7f434c009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.292+0000 7f43574ed700 1 -- 172.21.15.146:0/177664449 shutdown_connections 2023-10-03T10:15:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.292+0000 7f43574ed700 1 --2- 172.21.15.146:0/177664449 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f435009bc70 0x7f435009c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.292+0000 7f43574ed700 1 --2- 172.21.15.146:0/177664449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4350066410 0x7f43501319f0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.292+0000 7f43574ed700 1 --2- 172.21.15.146:0/177664449 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43501314b0 0x7f4350131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.292+0000 7f43574ed700 1 -- 172.21.15.146:0/177664449 >> 172.21.15.146:0/177664449 conn(0x7f43500a2980 msgr2=0x7f43500a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:23.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.292+0000 7f43574ed700 1 -- 172.21.15.146:0/177664449 shutdown_connections 2023-10-03T10:15:23.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.292+0000 7f43574ed700 1 -- 172.21.15.146:0/177664449 wait complete. 2023-10-03T10:15:23.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.294+0000 7f43574ed700 1 Processor -- start 2023-10-03T10:15:23.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.294+0000 7f43574ed700 1 -- start start 2023-10-03T10:15:23.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.294+0000 7f43574ed700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4350066410 0x7f4350119720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.294+0000 7f43574ed700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f435009bc70 0x7f4350119c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.294+0000 7f43574ed700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43501314b0 0x7f435011a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.294+0000 7f43574ed700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435011c5f0 con 0x7f435009bc70 2023-10-03T10:15:23.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.295+0000 7f43574ed700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435011abd0 con 0x7f4350066410 2023-10-03T10:15:23.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.295+0000 7f43574ed700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f435011d040 con 0x7f43501314b0 2023-10-03T10:15:23.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.295+0000 7f4355289700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4350066410 0x7f4350119720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.295+0000 7f4355289700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4350066410 0x7f4350119720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44410/0 (socket says 172.21.15.146:44410) 2023-10-03T10:15:23.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.295+0000 7f4355289700 1 -- 172.21.15.146:0/1541973587 learned_addr learned my addr 172.21.15.146:0/1541973587 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:23.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.295+0000 7f4354a88700 1 --2- 172.21.15.146:0/1541973587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f435009bc70 0x7f4350119c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.295+0000 7f4355a8a700 1 --2- 172.21.15.146:0/1541973587 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43501314b0 0x7f435011a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.295+0000 7f4355289700 1 -- 172.21.15.146:0/1541973587 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43501314b0 msgr2=0x7f435011a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.295+0000 7f4355289700 1 --2- 172.21.15.146:0/1541973587 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43501314b0 0x7f435011a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.295+0000 7f4355289700 1 -- 172.21.15.146:0/1541973587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f435009bc70 msgr2=0x7f4350119c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.295+0000 7f4355289700 1 --2- 172.21.15.146:0/1541973587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f435009bc70 0x7f4350119c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.295+0000 7f4355289700 1 -- 172.21.15.146:0/1541973587 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43400094a0 con 0x7f4350066410 2023-10-03T10:15:23.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.295+0000 7f4354a88700 1 --2- 172.21.15.146:0/1541973587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f435009bc70 0x7f4350119c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:23.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.295+0000 7f4355289700 1 --2- 172.21.15.146:0/1541973587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4350066410 0x7f4350119720 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f434c004000 tx=0x7f434c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:23.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.295+0000 7f4345ffb700 1 -- 172.21.15.146:0/1541973587 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c003e10 con 0x7f4350066410 2023-10-03T10:15:23.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.295+0000 7f4345ffb700 1 -- 172.21.15.146:0/1541973587 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c01c420 con 0x7f4350066410 2023-10-03T10:15:23.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.295+0000 7f43574ed700 1 -- 172.21.15.146:0/1541973587 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f434c009500 con 0x7f4350066410 2023-10-03T10:15:23.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.295+0000 7f4345ffb700 1 -- 172.21.15.146:0/1541973587 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c01c7d0 con 0x7f4350066410 2023-10-03T10:15:23.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.296+0000 7f43574ed700 1 -- 172.21.15.146:0/1541973587 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435006f6b0 con 0x7f4350066410 2023-10-03T10:15:23.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.297+0000 7f4345ffb700 1 -- 172.21.15.146:0/1541973587 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f434c01c930 con 0x7f4350066410 2023-10-03T10:15:23.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.297+0000 7f43574ed700 1 -- 172.21.15.146:0/1541973587 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43500a1d50 con 0x7f4350066410 2023-10-03T10:15:23.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.297+0000 7f4345ffb700 1 -- 172.21.15.146:0/1541973587 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f434c040950 con 0x7f4350066410 2023-10-03T10:15:23.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.301+0000 7f4345ffb700 1 -- 172.21.15.146:0/1541973587 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f434c01b740 con 0x7f4350066410 2023-10-03T10:15:23.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.327+0000 7fc4b0d9d700 1 Processor -- start 2023-10-03T10:15:23.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.327+0000 7fc4b0d9d700 1 -- start start 2023-10-03T10:15:23.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.328+0000 7fc4b0d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac09d680 0x7fc4ac09e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.328+0000 7fc4b0d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc4ac1348e0 0x7fc4ac13fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.328+0000 7fc4b0d9d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ac06b0a0 con 0x7fc4ac09dde0 2023-10-03T10:15:23.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.328+0000 7fc4b0d9d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ac09eee0 con 0x7fc4ac1348e0 2023-10-03T10:15:23.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.328+0000 7fc4b0d9d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac09aeb0 con 0x7fc4ac09d680 2023-10-03T10:15:23.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.328+0000 7fc4ab7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc4ac09dde0 0x7fc4ac1341d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60450/0 (socket says 172.21.15.146:60450) 2023-10-03T10:15:23.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.328+0000 7fc4aaffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac09d680 0x7fc4ac09e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.328+0000 7fc4ab7fe700 1 -- 172.21.15.146:0/1411450713 learned_addr learned my addr 172.21.15.146:0/1411450713 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:23.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.328+0000 7fc4abfff700 1 --2- 172.21.15.146:0/1411450713 >> v2:172.21.15.146:3300/0 conn(0x7fc4ac1348e0 0x7fc4ac13fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.328+0000 7fc4aaffd700 1 -- 172.21.15.146:0/1411450713 >> v2:172.21.15.146:3300/0 conn(0x7fc4ac1348e0 msgr2=0x7fc4ac13fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:23.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.328+0000 7fc4aaffd700 1 --2- 172.21.15.146:0/1411450713 >> v2:172.21.15.146:3300/0 conn(0x7fc4ac1348e0 0x7fc4ac13fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.328+0000 7fc4aaffd700 1 -- 172.21.15.146:0/1411450713 >> v1:172.21.15.146:6789/0 conn(0x7fc4ac09dde0 legacy=0x7fc4ac1341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.328+0000 7fc4aaffd700 1 -- 172.21.15.146:0/1411450713 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac06b490 con 0x7fc4ac09d680 2023-10-03T10:15:23.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.328+0000 7fc4aaffd700 1 --2- 172.21.15.146:0/1411450713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac09d680 0x7fc4ac09e1b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0009840 tx=0x7fc4a0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b58347db25ba9dae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:23.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.329+0000 7fc4aa7fc700 1 -- 172.21.15.146:0/1411450713 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0011830 con 0x7fc4ac09d680 2023-10-03T10:15:23.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.329+0000 7fc4aa7fc700 1 -- 172.21.15.146:0/1411450713 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a0011990 con 0x7fc4ac09d680 2023-10-03T10:15:23.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.329+0000 7fc4aa7fc700 1 -- 172.21.15.146:0/1411450713 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0011d00 con 0x7fc4ac09d680 2023-10-03T10:15:23.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.329+0000 7fc4b0d9d700 1 -- 172.21.15.146:0/1411450713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac09d680 msgr2=0x7fc4ac09e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.329+0000 7fc4b0d9d700 1 --2- 172.21.15.146:0/1411450713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac09d680 0x7fc4ac09e1b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0009840 tx=0x7fc4a0009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:23.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.329+0000 7fc4b0d9d700 1 -- 172.21.15.146:0/1411450713 shutdown_connections 2023-10-03T10:15:23.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.329+0000 7fc4b0d9d700 1 --2- 172.21.15.146:0/1411450713 >> v2:172.21.15.146:3300/0 conn(0x7fc4ac1348e0 0x7fc4ac13fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.329+0000 7fc4b0d9d700 1 --2- 172.21.15.146:0/1411450713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac09d680 0x7fc4ac09e1b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.329+0000 7fc4b0d9d700 1 -- 172.21.15.146:0/1411450713 >> 172.21.15.146:0/1411450713 conn(0x7fc4ac0a2d80 msgr2=0x7fc4ac0a3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:23.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.330+0000 7fc4b0d9d700 1 -- 172.21.15.146:0/1411450713 shutdown_connections 2023-10-03T10:15:23.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.330+0000 7fc4b0d9d700 1 -- 172.21.15.146:0/1411450713 wait complete. 2023-10-03T10:15:23.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.330+0000 7fc4b0d9d700 1 Processor -- start 2023-10-03T10:15:23.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.331+0000 7fc4b0d9d700 1 -- start start 2023-10-03T10:15:23.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.331+0000 7fc4b0d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc4ac09d680 0x7fc4ac11a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.331+0000 7fc4b0d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4ac09dde0 0x7fc4ac11a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.331+0000 7fc4b0d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac1348e0 0x7fc4ac11ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.331+0000 7fc4b0d9d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac11b7f0 con 0x7fc4ac09dde0 2023-10-03T10:15:23.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.331+0000 7fc4b0d9d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac134000 con 0x7fc4ac1348e0 2023-10-03T10:15:23.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.331+0000 7fc4b0d9d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac11bda0 con 0x7fc4ac09d680 2023-10-03T10:15:23.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.331+0000 7fc4abfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac1348e0 0x7fc4ac11ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.331+0000 7fc4abfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac1348e0 0x7fc4ac11ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44436/0 (socket says 172.21.15.146:44436) 2023-10-03T10:15:23.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.331+0000 7fc4abfff700 1 -- 172.21.15.146:0/960173942 learned_addr learned my addr 172.21.15.146:0/960173942 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:23.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.331+0000 7fc4aaffd700 1 --2- 172.21.15.146:0/960173942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4ac09dde0 0x7fc4ac11a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.331+0000 7fc4ab7fe700 1 --2- 172.21.15.146:0/960173942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc4ac09d680 0x7fc4ac11a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.332+0000 7fc4abfff700 1 -- 172.21.15.146:0/960173942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc4ac09d680 msgr2=0x7fc4ac11a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.332+0000 7fc4abfff700 1 --2- 172.21.15.146:0/960173942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc4ac09d680 0x7fc4ac11a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.332+0000 7fc4abfff700 1 -- 172.21.15.146:0/960173942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4ac09dde0 msgr2=0x7fc4ac11a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.332+0000 7fc4abfff700 1 --2- 172.21.15.146:0/960173942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4ac09dde0 0x7fc4ac11a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.332+0000 7fc4abfff700 1 -- 172.21.15.146:0/960173942 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a00094a0 con 0x7fc4ac1348e0 2023-10-03T10:15:23.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.332+0000 7fc4abfff700 1 --2- 172.21.15.146:0/960173942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac1348e0 0x7fc4ac11ada0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009dd0 tx=0x7fc4a400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:23.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.332+0000 7fc493fff700 1 -- 172.21.15.146:0/960173942 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4009c40 con 0x7fc4ac1348e0 2023-10-03T10:15:23.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.332+0000 7fc493fff700 1 -- 172.21.15.146:0/960173942 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a400f040 con 0x7fc4ac1348e0 2023-10-03T10:15:23.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.332+0000 7fc4b0d9d700 1 -- 172.21.15.146:0/960173942 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4ac126830 con 0x7fc4ac1348e0 2023-10-03T10:15:23.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.332+0000 7fc493fff700 1 -- 172.21.15.146:0/960173942 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a400ceb0 con 0x7fc4ac1348e0 2023-10-03T10:15:23.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.332+0000 7fc4b0d9d700 1 -- 172.21.15.146:0/960173942 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ac126290 con 0x7fc4ac1348e0 2023-10-03T10:15:23.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.333+0000 7fc493fff700 1 -- 172.21.15.146:0/960173942 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc4a4014480 con 0x7fc4ac1348e0 2023-10-03T10:15:23.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.334+0000 7fc493fff700 1 -- 172.21.15.146:0/960173942 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc4a403fd70 con 0x7fc4ac1348e0 2023-10-03T10:15:23.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.334+0000 7fc4b0d9d700 1 -- 172.21.15.146:0/960173942 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4ac04f2a0 con 0x7fc4ac1348e0 2023-10-03T10:15:23.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.343+0000 7fc493fff700 1 -- 172.21.15.146:0/960173942 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc4a401a8b0 con 0x7fc4ac1348e0 2023-10-03T10:15:23.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.357+0000 7ff91d0f6700 1 Processor -- start 2023-10-03T10:15:23.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.357+0000 7ff91d0f6700 1 -- start start 2023-10-03T10:15:23.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.358+0000 7ff91d0f6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9180a0a30 0x7ff9180a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.358+0000 7ff91d0f6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9180a1340 0x7ff91812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.358+0000 7ff91d0f6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff9181304a0 0x7ff9181308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.358+0000 7ff91d0f6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff918130e30 con 0x7ff9181304a0 2023-10-03T10:15:23.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.358+0000 7ff91d0f6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180a1e70 con 0x7ff9180a0a30 2023-10-03T10:15:23.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.358+0000 7ff91d0f6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff91809a720 con 0x7ff9180a1340 2023-10-03T10:15:23.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.358+0000 7ff91759e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff9181304a0 0x7ff9181308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.358+0000 7ff91659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9180a1340 0x7ff91812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.358+0000 7ff91759e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff9181304a0 0x7ff9181308f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41686/0 (socket says 172.21.15.146:41686) 2023-10-03T10:15:23.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.358+0000 7ff91659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9180a1340 0x7ff91812ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58808/0 (socket says 172.21.15.146:58808) 2023-10-03T10:15:23.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.358+0000 7ff91759e700 1 -- 172.21.15.146:0/3464170681 learned_addr learned my addr 172.21.15.146:0/3464170681 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:23.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.358+0000 7ff916d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9180a0a30 0x7ff9180a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.358+0000 7ff91759e700 1 -- 172.21.15.146:0/3464170681 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9180a1340 msgr2=0x7ff91812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:23.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.358+0000 7ff91759e700 1 --2- 172.21.15.146:0/3464170681 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9180a1340 0x7ff91812ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.358+0000 7ff91759e700 1 -- 172.21.15.146:0/3464170681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9180a0a30 msgr2=0x7ff9180a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:23.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.358+0000 7ff91759e700 1 --2- 172.21.15.146:0/3464170681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9180a0a30 0x7ff9180a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.358+0000 7ff91759e700 1 -- 172.21.15.146:0/3464170681 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91809b300 con 0x7ff9181304a0 2023-10-03T10:15:23.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.359+0000 7ff91759e700 1 --2- 172.21.15.146:0/3464170681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9181304a0 0x7ff9181308f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff91000ce20 tx=0x7ff91000a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd0a3fa2e3bb5d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:23.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.359+0000 7ff915d9b700 1 -- 172.21.15.146:0/3464170681 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91000c480 con 0x7ff9181304a0 2023-10-03T10:15:23.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.359+0000 7ff915d9b700 1 -- 172.21.15.146:0/3464170681 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff910007cd0 con 0x7ff9181304a0 2023-10-03T10:15:23.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.359+0000 7ff915d9b700 1 -- 172.21.15.146:0/3464170681 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff910008060 con 0x7ff9181304a0 2023-10-03T10:15:23.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.359+0000 7ff91d0f6700 1 -- 172.21.15.146:0/3464170681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9181304a0 msgr2=0x7ff9181308f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.359+0000 7ff91d0f6700 1 --2- 172.21.15.146:0/3464170681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9181304a0 0x7ff9181308f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff91000ce20 tx=0x7ff91000a480 comp rx=0 tx=0).stop 2023-10-03T10:15:23.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.359+0000 7ff91d0f6700 1 -- 172.21.15.146:0/3464170681 shutdown_connections 2023-10-03T10:15:23.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.359+0000 7ff91d0f6700 1 --2- 172.21.15.146:0/3464170681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9180a0a30 0x7ff9180a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.359+0000 7ff91d0f6700 1 --2- 172.21.15.146:0/3464170681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9181304a0 0x7ff9181308f0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.359+0000 7ff91d0f6700 1 --2- 172.21.15.146:0/3464170681 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9180a1340 0x7ff91812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.359+0000 7ff91d0f6700 1 -- 172.21.15.146:0/3464170681 >> 172.21.15.146:0/3464170681 conn(0x7ff9180a2980 msgr2=0x7ff9180a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:23.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.360+0000 7ff91d0f6700 1 -- 172.21.15.146:0/3464170681 shutdown_connections 2023-10-03T10:15:23.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.360+0000 7ff91d0f6700 1 -- 172.21.15.146:0/3464170681 wait complete. 2023-10-03T10:15:23.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.361+0000 7ff91d0f6700 1 Processor -- start 2023-10-03T10:15:23.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.361+0000 7ff91d0f6700 1 -- start start 2023-10-03T10:15:23.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.362+0000 7ff91d0f6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9180a0a30 0x7ff9181c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.362+0000 7ff91d0f6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9180a1340 0x7ff9181c4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.362+0000 7ff91d0f6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9181304a0 0x7ff91811deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.362+0000 7ff91d0f6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91811fac0 con 0x7ff9180a1340 2023-10-03T10:15:23.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.362+0000 7ff91d0f6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91812fa50 con 0x7ff9181304a0 2023-10-03T10:15:23.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.362+0000 7ff91d0f6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff91809f5f0 con 0x7ff9180a0a30 2023-10-03T10:15:23.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.362+0000 7ff916d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9180a0a30 0x7ff9181c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.362+0000 7ff916d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9180a0a30 0x7ff9181c4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58822/0 (socket says 172.21.15.146:58822) 2023-10-03T10:15:23.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.362+0000 7ff916d9d700 1 -- 172.21.15.146:0/523844555 learned_addr learned my addr 172.21.15.146:0/523844555 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:23.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.362+0000 7ff91759e700 1 --2- 172.21.15.146:0/523844555 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9181304a0 0x7ff91811deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.362+0000 7ff91659c700 1 --2- 172.21.15.146:0/523844555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9180a1340 0x7ff9181c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.362+0000 7ff916d9d700 1 -- 172.21.15.146:0/523844555 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9181304a0 msgr2=0x7ff91811deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.362+0000 7ff916d9d700 1 --2- 172.21.15.146:0/523844555 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9181304a0 0x7ff91811deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.362+0000 7ff916d9d700 1 -- 172.21.15.146:0/523844555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9180a1340 msgr2=0x7ff9181c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.362+0000 7ff916d9d700 1 --2- 172.21.15.146:0/523844555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9180a1340 0x7ff9181c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.362+0000 7ff916d9d700 1 -- 172.21.15.146:0/523844555 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91000ca80 con 0x7ff9180a0a30 2023-10-03T10:15:23.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.362+0000 7ff91759e700 1 --2- 172.21.15.146:0/523844555 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9181304a0 0x7ff91811deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:23.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.362+0000 7ff91659c700 1 --2- 172.21.15.146:0/523844555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9180a1340 0x7ff9181c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:23.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.363+0000 7ff916d9d700 1 --2- 172.21.15.146:0/523844555 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9180a0a30 0x7ff9181c4140 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff90800e870 tx=0x7ff90800eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:23.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.363+0000 7ff8ff7fe700 1 -- 172.21.15.146:0/523844555 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff908005a20 con 0x7ff9180a0a30 2023-10-03T10:15:23.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.363+0000 7ff8ff7fe700 1 -- 172.21.15.146:0/523844555 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff908005b80 con 0x7ff9180a0a30 2023-10-03T10:15:23.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.363+0000 7ff91d0f6700 1 -- 172.21.15.146:0/523844555 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9181216f0 con 0x7ff9180a0a30 2023-10-03T10:15:23.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.363+0000 7ff8ff7fe700 1 -- 172.21.15.146:0/523844555 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff908013680 con 0x7ff9180a0a30 2023-10-03T10:15:23.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.363+0000 7ff91d0f6700 1 -- 172.21.15.146:0/523844555 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff918121430 con 0x7ff9180a0a30 2023-10-03T10:15:23.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.364+0000 7ff8ff7fe700 1 -- 172.21.15.146:0/523844555 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff9080137e0 con 0x7ff9180a0a30 2023-10-03T10:15:23.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.364+0000 7ff8ff7fe700 1 -- 172.21.15.146:0/523844555 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff90803f860 con 0x7ff9180a0a30 2023-10-03T10:15:23.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.365+0000 7ff91d0f6700 1 -- 172.21.15.146:0/523844555 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff91804f2a0 con 0x7ff9180a0a30 2023-10-03T10:15:23.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.374+0000 7ff8ff7fe700 1 -- 172.21.15.146:0/523844555 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff908020080 con 0x7ff9180a0a30 2023-10-03T10:15:23.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.469+0000 7f02c8a6b700 1 -- 172.21.15.146:0/1549893284 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f02a8005860 con 0x7f02c41300a0 2023-10-03T10:15:23.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.469+0000 7f02b2ffd700 1 -- 172.21.15.146:0/1549893284 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f02b4021020 con 0x7f02c41300a0 2023-10-03T10:15:23.470 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:23.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.471+0000 7f02c8a6b700 1 -- 172.21.15.146:0/1549893284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02c41300a0 msgr2=0x7f02c411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.471+0000 7f02c8a6b700 1 --2- 172.21.15.146:0/1549893284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02c41300a0 0x7f02c411da40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f02b400e9b0 tx=0x7f02b400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.471+0000 7f02c8a6b700 1 -- 172.21.15.146:0/1549893284 shutdown_connections 2023-10-03T10:15:23.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.471+0000 7f02c8a6b700 1 --2- 172.21.15.146:0/1549893284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02c4133ad0 0x7f02c411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.471+0000 7f02c8a6b700 1 --2- 172.21.15.146:0/1549893284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02c41300a0 0x7f02c411da40 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.471+0000 7f02c8a6b700 1 --2- 172.21.15.146:0/1549893284 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02c41309f0 0x7f02c411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.471+0000 7f02c8a6b700 1 -- 172.21.15.146:0/1549893284 >> 172.21.15.146:0/1549893284 conn(0x7f02c4099c40 msgr2=0x7f02c412e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:23.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.471+0000 7f02c8a6b700 1 -- 172.21.15.146:0/1549893284 shutdown_connections 2023-10-03T10:15:23.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.471+0000 7f02c8a6b700 1 -- 172.21.15.146:0/1549893284 wait complete. 2023-10-03T10:15:23.485 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:23.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.506+0000 7f43574ed700 1 -- 172.21.15.146:0/1541973587 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f435004f2a0 con 0x7f4350066410 2023-10-03T10:15:23.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.507+0000 7f4345ffb700 1 -- 172.21.15.146:0/1541973587 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f434c020020 con 0x7f4350066410 2023-10-03T10:15:23.507 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:23.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.509+0000 7f43574ed700 1 -- 172.21.15.146:0/1541973587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4350066410 msgr2=0x7f4350119720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.509+0000 7f43574ed700 1 --2- 172.21.15.146:0/1541973587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4350066410 0x7f4350119720 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f434c004000 tx=0x7f434c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:23.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.509+0000 7f43574ed700 1 -- 172.21.15.146:0/1541973587 shutdown_connections 2023-10-03T10:15:23.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.509+0000 7f43574ed700 1 --2- 172.21.15.146:0/1541973587 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43501314b0 0x7f435011a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.509+0000 7f43574ed700 1 --2- 172.21.15.146:0/1541973587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4350066410 0x7f4350119720 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.509+0000 7f43574ed700 1 --2- 172.21.15.146:0/1541973587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f435009bc70 0x7f4350119c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.509+0000 7f43574ed700 1 -- 172.21.15.146:0/1541973587 >> 172.21.15.146:0/1541973587 conn(0x7f43500a2980 msgr2=0x7f435012e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:23.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.509+0000 7f43574ed700 1 -- 172.21.15.146:0/1541973587 shutdown_connections 2023-10-03T10:15:23.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.509+0000 7f43574ed700 1 -- 172.21.15.146:0/1541973587 wait complete. 2023-10-03T10:15:23.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:23.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.563+0000 7fc4b0d9d700 1 -- 172.21.15.146:0/960173942 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc4ac126610 con 0x7fc4ac1348e0 2023-10-03T10:15:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.563+0000 7fc493fff700 1 -- 172.21.15.146:0/960173942 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc4a402b090 con 0x7fc4ac1348e0 2023-10-03T10:15:23.564 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.565+0000 7fc4b0d9d700 1 -- 172.21.15.146:0/960173942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac1348e0 msgr2=0x7fc4ac11ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.565+0000 7fc4b0d9d700 1 --2- 172.21.15.146:0/960173942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac1348e0 0x7fc4ac11ada0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009dd0 tx=0x7fc4a400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.565+0000 7fc4b0d9d700 1 -- 172.21.15.146:0/960173942 shutdown_connections 2023-10-03T10:15:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.565+0000 7fc4b0d9d700 1 --2- 172.21.15.146:0/960173942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc4ac1348e0 0x7fc4ac11ada0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.565+0000 7fc4b0d9d700 1 --2- 172.21.15.146:0/960173942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc4ac09d680 0x7fc4ac11a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.565+0000 7fc4b0d9d700 1 --2- 172.21.15.146:0/960173942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4ac09dde0 0x7fc4ac11a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.565+0000 7fc4b0d9d700 1 -- 172.21.15.146:0/960173942 >> 172.21.15.146:0/960173942 conn(0x7fc4ac0a2d80 msgr2=0x7fc4ac09b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.566+0000 7fc4b0d9d700 1 -- 172.21.15.146:0/960173942 shutdown_connections 2023-10-03T10:15:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.566+0000 7fc4b0d9d700 1 -- 172.21.15.146:0/960173942 wait complete. 2023-10-03T10:15:23.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:23.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.592+0000 7ff91d0f6700 1 -- 172.21.15.146:0/523844555 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff9181202b0 con 0x7ff9180a0a30 2023-10-03T10:15:23.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.592+0000 7ff8ff7fe700 1 -- 172.21.15.146:0/523844555 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff908006030 con 0x7ff9180a0a30 2023-10-03T10:15:23.593 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:23.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.594+0000 7ff91d0f6700 1 -- 172.21.15.146:0/523844555 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9180a0a30 msgr2=0x7ff9181c4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.594+0000 7ff91d0f6700 1 --2- 172.21.15.146:0/523844555 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9180a0a30 0x7ff9181c4140 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff90800e870 tx=0x7ff90800eb80 comp rx=0 tx=0).stop 2023-10-03T10:15:23.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.594+0000 7ff91d0f6700 1 -- 172.21.15.146:0/523844555 shutdown_connections 2023-10-03T10:15:23.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.594+0000 7ff91d0f6700 1 --2- 172.21.15.146:0/523844555 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9181304a0 0x7ff91811deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.594+0000 7ff91d0f6700 1 --2- 172.21.15.146:0/523844555 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9180a0a30 0x7ff9181c4140 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.594+0000 7ff91d0f6700 1 --2- 172.21.15.146:0/523844555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9180a1340 0x7ff9181c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.594+0000 7ff91d0f6700 1 -- 172.21.15.146:0/523844555 >> 172.21.15.146:0/523844555 conn(0x7ff9180a2980 msgr2=0x7ff9180705f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:23.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.594+0000 7ff91d0f6700 1 -- 172.21.15.146:0/523844555 shutdown_connections 2023-10-03T10:15:23.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:23.595+0000 7ff91d0f6700 1 -- 172.21.15.146:0/523844555 wait complete. 2023-10-03T10:15:23.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:24.486 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:24.522 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:24.579 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:24.609 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:24.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.621+0000 7fc18053b700 1 Processor -- start 2023-10-03T10:15:24.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.621+0000 7fc18053b700 1 -- start start 2023-10-03T10:15:24.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.622+0000 7fc18053b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc17809e870 0x7fc17809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.622+0000 7fc18053b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc17809f180 0x7fc178131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.622+0000 7fc18053b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17809c970 con 0x7fc178131d70 2023-10-03T10:15:24.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.622+0000 7fc18053b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1780a0920 con 0x7fc17809f180 2023-10-03T10:15:24.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.622+0000 7fc18053b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc17809f9c0 con 0x7fc17809e870 2023-10-03T10:15:24.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.622+0000 7fc17dad6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc17809f180 0x7fc178131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.622+0000 7fc17ead8700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc178131d70 0x7fc178138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33196/0 (socket says 172.21.15.146:33196) 2023-10-03T10:15:24.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.622+0000 7fc17e2d7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc17809e870 0x7fc17809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.622+0000 7fc17ead8700 1 -- 172.21.15.146:0/467816124 learned_addr learned my addr 172.21.15.146:0/467816124 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:24.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.622+0000 7fc17dad6700 1 -- 172.21.15.146:0/467816124 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc17809e870 msgr2=0x7fc17809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:24.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.622+0000 7fc17dad6700 1 --2- 172.21.15.146:0/467816124 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc17809e870 0x7fc17809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.622+0000 7fc17dad6700 1 -- 172.21.15.146:0/467816124 >> v1:172.21.15.146:6789/0 conn(0x7fc178131d70 legacy=0x7fc178138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.622+0000 7fc17d2d5700 1 -- 172.21.15.146:0/467816124 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142279821 0 0) 0x7fc17809c970 con 0x7fc178131d70 2023-10-03T10:15:24.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.622+0000 7fc17dad6700 1 -- 172.21.15.146:0/467816124 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17809bab0 con 0x7fc17809f180 2023-10-03T10:15:24.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.622+0000 7fc17dad6700 1 --2- 172.21.15.146:0/467816124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc17809f180 0x7fc178131830 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fc168009840 tx=0x7fc168009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecdd8b41d661776 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.622+0000 7fc17d2d5700 1 -- 172.21.15.146:0/467816124 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc168011830 con 0x7fc17809f180 2023-10-03T10:15:24.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.622+0000 7fc17d2d5700 1 -- 172.21.15.146:0/467816124 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc168011990 con 0x7fc17809f180 2023-10-03T10:15:24.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.622+0000 7fc17d2d5700 1 -- 172.21.15.146:0/467816124 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc168011d20 con 0x7fc17809f180 2023-10-03T10:15:24.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.623+0000 7fc18053b700 1 -- 172.21.15.146:0/467816124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc17809f180 msgr2=0x7fc178131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.623+0000 7fc18053b700 1 --2- 172.21.15.146:0/467816124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc17809f180 0x7fc178131830 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fc168009840 tx=0x7fc168009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:24.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.623+0000 7fc18053b700 1 -- 172.21.15.146:0/467816124 shutdown_connections 2023-10-03T10:15:24.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.623+0000 7fc18053b700 1 --2- 172.21.15.146:0/467816124 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc17809e870 0x7fc17809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.623+0000 7fc18053b700 1 --2- 172.21.15.146:0/467816124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc17809f180 0x7fc178131830 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.623+0000 7fc18053b700 1 -- 172.21.15.146:0/467816124 >> 172.21.15.146:0/467816124 conn(0x7fc1780a4430 msgr2=0x7fc1780a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.623+0000 7fc18053b700 1 -- 172.21.15.146:0/467816124 shutdown_connections 2023-10-03T10:15:24.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.623+0000 7fc18053b700 1 -- 172.21.15.146:0/467816124 wait complete. 2023-10-03T10:15:24.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.624+0000 7fc18053b700 1 Processor -- start 2023-10-03T10:15:24.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.624+0000 7fc18053b700 1 -- start start 2023-10-03T10:15:24.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.625+0000 7fc18053b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc17809e870 0x7fc17811d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.625+0000 7fc18053b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc17809f180 0x7fc17811d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.625+0000 7fc18053b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc178131d70 0x7fc17811db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.625+0000 7fc18053b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17811e5c0 con 0x7fc17809e870 2023-10-03T10:15:24.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.625+0000 7fc18053b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17811ec80 con 0x7fc17809f180 2023-10-03T10:15:24.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.625+0000 7fc18053b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc17811fed0 con 0x7fc178131d70 2023-10-03T10:15:24.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.625+0000 7fc17e2d7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc17809e870 0x7fc17811d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.625+0000 7fc17e2d7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc17809e870 0x7fc17811d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40718/0 (socket says 172.21.15.146:40718) 2023-10-03T10:15:24.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.625+0000 7fc17e2d7700 1 -- 172.21.15.146:0/746135236 learned_addr learned my addr 172.21.15.146:0/746135236 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:24.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.625+0000 7fc17ead8700 1 --2- 172.21.15.146:0/746135236 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc178131d70 0x7fc17811db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.625+0000 7fc17e2d7700 1 -- 172.21.15.146:0/746135236 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc178131d70 msgr2=0x7fc17811db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.625+0000 7fc17e2d7700 1 --2- 172.21.15.146:0/746135236 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc178131d70 0x7fc17811db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.625+0000 7fc17e2d7700 1 -- 172.21.15.146:0/746135236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc17809f180 msgr2=0x7fc17811d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.625+0000 7fc17e2d7700 1 --2- 172.21.15.146:0/746135236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc17809f180 0x7fc17811d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.625+0000 7fc17e2d7700 1 -- 172.21.15.146:0/746135236 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1680094a0 con 0x7fc17809e870 2023-10-03T10:15:24.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.626+0000 7fc17e2d7700 1 --2- 172.21.15.146:0/746135236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc17809e870 0x7fc17811d110 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fc174012b80 tx=0x7fc174012e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.626+0000 7fc16effd700 1 -- 172.21.15.146:0/746135236 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17400da30 con 0x7fc17809e870 2023-10-03T10:15:24.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.626+0000 7fc16effd700 1 -- 172.21.15.146:0/746135236 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc174013040 con 0x7fc17809e870 2023-10-03T10:15:24.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.626+0000 7fc16effd700 1 -- 172.21.15.146:0/746135236 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc174010ad0 con 0x7fc17809e870 2023-10-03T10:15:24.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.626+0000 7fc18053b700 1 -- 172.21.15.146:0/746135236 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1781208b0 con 0x7fc17809e870 2023-10-03T10:15:24.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.626+0000 7fc18053b700 1 -- 172.21.15.146:0/746135236 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1780a2a80 con 0x7fc17809e870 2023-10-03T10:15:24.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.627+0000 7fc18053b700 1 -- 172.21.15.146:0/746135236 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1780a2050 con 0x7fc17809e870 2023-10-03T10:15:24.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.627+0000 7fc16effd700 1 -- 172.21.15.146:0/746135236 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc174010c30 con 0x7fc17809e870 2023-10-03T10:15:24.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.627+0000 7fc16effd700 1 -- 172.21.15.146:0/746135236 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc174043550 con 0x7fc17809e870 2023-10-03T10:15:24.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.632+0000 7fc16effd700 1 -- 172.21.15.146:0/746135236 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc174018e60 con 0x7fc17809e870 2023-10-03T10:15:24.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.666+0000 7f4e86d5e700 1 Processor -- start 2023-10-03T10:15:24.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.666+0000 7f4e86d5e700 1 -- start start 2023-10-03T10:15:24.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.666+0000 7f4e86d5e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e80133ad0 0x7f4e80133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.666+0000 7f4e86d5e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4e80130bc0 0x7f4e8013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.666+0000 7f4e86d5e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8006b2d0 con 0x7f4e801300a0 2023-10-03T10:15:24.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.666+0000 7f4e86d5e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e80133610 con 0x7f4e80130bc0 2023-10-03T10:15:24.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.666+0000 7f4e86d5e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8009a500 con 0x7f4e80133ad0 2023-10-03T10:15:24.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.667+0000 7f4e84afa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e80133ad0 0x7f4e80133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.667+0000 7f4e84afa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e80133ad0 0x7f4e80133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34010/0 (socket says 172.21.15.146:34010) 2023-10-03T10:15:24.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.667+0000 7f4e84afa700 1 -- 172.21.15.146:0/927085836 learned_addr learned my addr 172.21.15.146:0/927085836 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:24.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.667+0000 7f4e7ffff700 1 --1- 172.21.15.146:0/927085836 >> v1:172.21.15.146:6789/0 conn(0x7f4e801300a0 0x7f4e801304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33206/0 (socket says 172.21.15.146:33206) 2023-10-03T10:15:24.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.667+0000 7f4e852fb700 1 --2- 172.21.15.146:0/927085836 >> v2:172.21.15.146:3300/0 conn(0x7f4e80130bc0 0x7f4e8013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.667+0000 7f4e7f7fe700 1 -- 172.21.15.146:0/927085836 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3939767086 0 0) 0x7f4e8006b2d0 con 0x7f4e801300a0 2023-10-03T10:15:24.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.667+0000 7f4e7f7fe700 1 -- 172.21.15.146:0/927085836 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e700035b0 con 0x7f4e801300a0 2023-10-03T10:15:24.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.667+0000 7f4e852fb700 1 -- 172.21.15.146:0/927085836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e80133ad0 msgr2=0x7f4e80133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:24.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.667+0000 7f4e852fb700 1 --2- 172.21.15.146:0/927085836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e80133ad0 0x7f4e80133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.667+0000 7f4e852fb700 1 -- 172.21.15.146:0/927085836 >> v1:172.21.15.146:6789/0 conn(0x7f4e801300a0 legacy=0x7f4e801304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.667+0000 7f4e852fb700 1 -- 172.21.15.146:0/927085836 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e801338b0 con 0x7f4e80130bc0 2023-10-03T10:15:24.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.667+0000 7f4e852fb700 1 --2- 172.21.15.146:0/927085836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e80130bc0 0x7f4e8013b990 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f4e78009d90 tx=0x7f4e7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8238a947230294a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.667+0000 7f4e7f7fe700 1 -- 172.21.15.146:0/927085836 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7800e070 con 0x7f4e80130bc0 2023-10-03T10:15:24.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.668+0000 7f4e7f7fe700 1 -- 172.21.15.146:0/927085836 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7800bb20 con 0x7f4e80130bc0 2023-10-03T10:15:24.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.668+0000 7f4e7f7fe700 1 -- 172.21.15.146:0/927085836 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e78012430 con 0x7f4e80130bc0 2023-10-03T10:15:24.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.668+0000 7f4e86d5e700 1 -- 172.21.15.146:0/927085836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e80130bc0 msgr2=0x7f4e8013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.668+0000 7f4e86d5e700 1 --2- 172.21.15.146:0/927085836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e80130bc0 0x7f4e8013b990 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f4e78009d90 tx=0x7f4e7800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:24.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.668+0000 7f4e86d5e700 1 -- 172.21.15.146:0/927085836 shutdown_connections 2023-10-03T10:15:24.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.668+0000 7f4e86d5e700 1 --2- 172.21.15.146:0/927085836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e80130bc0 0x7f4e8013b990 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.668+0000 7f4e86d5e700 1 --2- 172.21.15.146:0/927085836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e80133ad0 0x7f4e80133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.668+0000 7f4e86d5e700 1 -- 172.21.15.146:0/927085836 >> 172.21.15.146:0/927085836 conn(0x7f4e80099c40 msgr2=0x7f4e800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.668+0000 7f4e86d5e700 1 -- 172.21.15.146:0/927085836 shutdown_connections 2023-10-03T10:15:24.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.668+0000 7f4e86d5e700 1 -- 172.21.15.146:0/927085836 wait complete. 2023-10-03T10:15:24.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.670+0000 7f4e86d5e700 1 Processor -- start 2023-10-03T10:15:24.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.670+0000 7f4e86d5e700 1 -- start start 2023-10-03T10:15:24.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.670+0000 7f4e86d5e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e801300a0 0x7f4e8011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.670+0000 7f4e86d5e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e80130bc0 0x7f4e8011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.670+0000 7f4e86d5e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e80133ad0 0x7f4e8011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.670+0000 7f4e86d5e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8011ef00 con 0x7f4e801300a0 2023-10-03T10:15:24.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.670+0000 7f4e86d5e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8011ff10 con 0x7f4e80133ad0 2023-10-03T10:15:24.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.670+0000 7f4e86d5e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8012f660 con 0x7f4e80130bc0 2023-10-03T10:15:24.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.671+0000 7f4e84afa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e801300a0 0x7f4e8011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.671+0000 7f4e84afa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e801300a0 0x7f4e8011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40734/0 (socket says 172.21.15.146:40734) 2023-10-03T10:15:24.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.671+0000 7f4e84afa700 1 -- 172.21.15.146:0/1125269577 learned_addr learned my addr 172.21.15.146:0/1125269577 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:24.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.671+0000 7f4e852fb700 1 --2- 172.21.15.146:0/1125269577 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e80133ad0 0x7f4e8011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.671+0000 7f4e84afa700 1 -- 172.21.15.146:0/1125269577 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e80130bc0 msgr2=0x7f4e8011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.671+0000 7f4e84afa700 1 --2- 172.21.15.146:0/1125269577 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e80130bc0 0x7f4e8011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.671+0000 7f4e84afa700 1 -- 172.21.15.146:0/1125269577 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e80133ad0 msgr2=0x7f4e8011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.671+0000 7f4e84afa700 1 --2- 172.21.15.146:0/1125269577 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e80133ad0 0x7f4e8011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.671+0000 7f4e84afa700 1 -- 172.21.15.146:0/1125269577 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e78009a70 con 0x7f4e801300a0 2023-10-03T10:15:24.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.671+0000 7f4e852fb700 1 --2- 172.21.15.146:0/1125269577 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e80133ad0 0x7f4e8011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:24.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.671+0000 7f4e84afa700 1 --2- 172.21.15.146:0/1125269577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e801300a0 0x7f4e8011da40 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400e910 tx=0x7f4e7400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.671+0000 7f4e7d7fa700 1 -- 172.21.15.146:0/1125269577 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e740096a0 con 0x7f4e801300a0 2023-10-03T10:15:24.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.671+0000 7f4e7d7fa700 1 -- 172.21.15.146:0/1125269577 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7400ee60 con 0x7f4e801300a0 2023-10-03T10:15:24.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.671+0000 7f4e7d7fa700 1 -- 172.21.15.146:0/1125269577 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7400ca90 con 0x7f4e801300a0 2023-10-03T10:15:24.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.671+0000 7f4e86d5e700 1 -- 172.21.15.146:0/1125269577 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e8011f6a0 con 0x7f4e801300a0 2023-10-03T10:15:24.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.672+0000 7f4e86d5e700 1 -- 172.21.15.146:0/1125269577 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8012dd00 con 0x7f4e801300a0 2023-10-03T10:15:24.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.673+0000 7f4e86d5e700 1 -- 172.21.15.146:0/1125269577 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8006be10 con 0x7f4e801300a0 2023-10-03T10:15:24.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.673+0000 7f4e7d7fa700 1 -- 172.21.15.146:0/1125269577 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e7400cbf0 con 0x7f4e801300a0 2023-10-03T10:15:24.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.673+0000 7f4e7d7fa700 1 -- 172.21.15.146:0/1125269577 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4e7403fb50 con 0x7f4e801300a0 2023-10-03T10:15:24.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.678+0000 7f4e7d7fa700 1 -- 172.21.15.146:0/1125269577 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e7401b3b0 con 0x7f4e801300a0 2023-10-03T10:15:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.714+0000 7ff186f76700 1 Processor -- start 2023-10-03T10:15:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.714+0000 7ff186f76700 1 -- start start 2023-10-03T10:15:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.715+0000 7ff186f76700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff18009d860 0x7ff18009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.715+0000 7ff186f76700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff18009e170 0x7ff1801307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.715+0000 7ff186f76700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18009aaa0 con 0x7ff180130ce0 2023-10-03T10:15:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.715+0000 7ff186f76700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18009f870 con 0x7ff18009d860 2023-10-03T10:15:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.715+0000 7ff186f76700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff18009b360 con 0x7ff18009e170 2023-10-03T10:15:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.715+0000 7ff17ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff18009e170 0x7ff1801307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.715+0000 7ff17ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff18009e170 0x7ff1801307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:44958/0 (socket says 172.21.15.146:44958) 2023-10-03T10:15:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.715+0000 7ff17ffff700 1 -- 172.21.15.146:0/369657848 learned_addr learned my addr 172.21.15.146:0/369657848 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.715+0000 7ff184d12700 1 --2- 172.21.15.146:0/369657848 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff18009d860 0x7ff18009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.716+0000 7ff17ffff700 1 -- 172.21.15.146:0/369657848 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff18009d860 msgr2=0x7ff18009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.716+0000 7ff17ffff700 1 --2- 172.21.15.146:0/369657848 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff18009d860 0x7ff18009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.716+0000 7ff17ffff700 1 -- 172.21.15.146:0/369657848 >> v1:172.21.15.146:6789/0 conn(0x7ff180130ce0 legacy=0x7ff1801379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.716+0000 7ff17ffff700 1 -- 172.21.15.146:0/369657848 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18009b620 con 0x7ff18009e170 2023-10-03T10:15:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.716+0000 7ff17ffff700 1 --2- 172.21.15.146:0/369657848 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff18009e170 0x7ff1801307a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009920 tx=0x7ff16c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=101c4c90a35c6572 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.716+0000 7ff17f7fe700 1 -- 172.21.15.146:0/369657848 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c011830 con 0x7ff18009e170 2023-10-03T10:15:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.716+0000 7ff17f7fe700 1 -- 172.21.15.146:0/369657848 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16c011990 con 0x7ff18009e170 2023-10-03T10:15:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.716+0000 7ff17f7fe700 1 -- 172.21.15.146:0/369657848 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c011d20 con 0x7ff18009e170 2023-10-03T10:15:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.717+0000 7ff186f76700 1 -- 172.21.15.146:0/369657848 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff18009e170 msgr2=0x7ff1801307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.717+0000 7ff186f76700 1 --2- 172.21.15.146:0/369657848 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff18009e170 0x7ff1801307a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009920 tx=0x7ff16c009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.717+0000 7ff186f76700 1 -- 172.21.15.146:0/369657848 shutdown_connections 2023-10-03T10:15:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.717+0000 7ff186f76700 1 --2- 172.21.15.146:0/369657848 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff18009d860 0x7ff18009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.717+0000 7ff186f76700 1 --2- 172.21.15.146:0/369657848 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff18009e170 0x7ff1801307a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.717+0000 7ff186f76700 1 -- 172.21.15.146:0/369657848 >> 172.21.15.146:0/369657848 conn(0x7ff180099c40 msgr2=0x7ff1800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.717+0000 7ff186f76700 1 -- 172.21.15.146:0/369657848 shutdown_connections 2023-10-03T10:15:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.717+0000 7ff186f76700 1 -- 172.21.15.146:0/369657848 wait complete. 2023-10-03T10:15:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.718+0000 7ff186f76700 1 Processor -- start 2023-10-03T10:15:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.718+0000 7ff186f76700 1 -- start start 2023-10-03T10:15:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.719+0000 7ff186f76700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff18009d860 0x7ff1801c4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.719+0000 7ff186f76700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff18009e170 0x7ff1801c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.719+0000 7ff186f76700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff180130ce0 0x7ff18011e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.719+0000 7ff186f76700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff180121cf0 con 0x7ff18009d860 2023-10-03T10:15:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.719+0000 7ff186f76700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff180121ed0 con 0x7ff18009e170 2023-10-03T10:15:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.719+0000 7ff186f76700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1801203b0 con 0x7ff180130ce0 2023-10-03T10:15:24.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.719+0000 7ff185513700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff180130ce0 0x7ff18011e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.719+0000 7ff184d12700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff18009d860 0x7ff1801c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.719+0000 7ff185513700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff180130ce0 0x7ff18011e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:44974/0 (socket says 172.21.15.146:44974) 2023-10-03T10:15:24.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.719+0000 7ff185513700 1 -- 172.21.15.146:0/1110449700 learned_addr learned my addr 172.21.15.146:0/1110449700 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:24.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.719+0000 7ff17ffff700 1 --2- 172.21.15.146:0/1110449700 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff18009e170 0x7ff1801c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.719+0000 7ff185513700 1 -- 172.21.15.146:0/1110449700 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff18009e170 msgr2=0x7ff1801c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.719+0000 7ff185513700 1 --2- 172.21.15.146:0/1110449700 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff18009e170 0x7ff1801c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.719+0000 7ff185513700 1 -- 172.21.15.146:0/1110449700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff18009d860 msgr2=0x7ff1801c4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.719+0000 7ff185513700 1 --2- 172.21.15.146:0/1110449700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff18009d860 0x7ff1801c4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.719+0000 7ff185513700 1 -- 172.21.15.146:0/1110449700 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c009550 con 0x7ff180130ce0 2023-10-03T10:15:24.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.719+0000 7ff17ffff700 1 --2- 172.21.15.146:0/1110449700 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff18009e170 0x7ff1801c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:24.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.720+0000 7ff185513700 1 --2- 172.21.15.146:0/1110449700 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff180130ce0 0x7ff18011e690 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff17800cc80 tx=0x7ff17800cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.720+0000 7ff17d7fa700 1 -- 172.21.15.146:0/1110449700 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178003c00 con 0x7ff180130ce0 2023-10-03T10:15:24.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.720+0000 7ff17d7fa700 1 -- 172.21.15.146:0/1110449700 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff178003d60 con 0x7ff180130ce0 2023-10-03T10:15:24.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.720+0000 7ff186f76700 1 -- 172.21.15.146:0/1110449700 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff180120850 con 0x7ff180130ce0 2023-10-03T10:15:24.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.720+0000 7ff17d7fa700 1 -- 172.21.15.146:0/1110449700 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17800aaa0 con 0x7ff180130ce0 2023-10-03T10:15:24.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.720+0000 7ff186f76700 1 -- 172.21.15.146:0/1110449700 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1801c4d10 con 0x7ff180130ce0 2023-10-03T10:15:24.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.721+0000 7ff186f76700 1 -- 172.21.15.146:0/1110449700 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18004f2a0 con 0x7ff180130ce0 2023-10-03T10:15:24.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.723+0000 7ff17d7fa700 1 -- 172.21.15.146:0/1110449700 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff17800ac00 con 0x7ff180130ce0 2023-10-03T10:15:24.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.723+0000 7ff17d7fa700 1 -- 172.21.15.146:0/1110449700 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff178040270 con 0x7ff180130ce0 2023-10-03T10:15:24.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.730+0000 7ff17d7fa700 1 -- 172.21.15.146:0/1110449700 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1780050d0 con 0x7ff180130ce0 2023-10-03T10:15:24.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.756+0000 7fe63e0ac700 1 Processor -- start 2023-10-03T10:15:24.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.756+0000 7fe63e0ac700 1 -- start start 2023-10-03T10:15:24.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.757+0000 7fe63e0ac700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe63809d860 0x7fe63809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.757+0000 7fe63e0ac700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe63809e170 0x7fe6381307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.757+0000 7fe63e0ac700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe638130ce0 0x7fe638131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.757+0000 7fe63e0ac700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63809aaa0 con 0x7fe63809e170 2023-10-03T10:15:24.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.757+0000 7fe63e0ac700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63809f870 con 0x7fe638130ce0 2023-10-03T10:15:24.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.757+0000 7fe63e0ac700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe63809b360 con 0x7fe63809d860 2023-10-03T10:15:24.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.757+0000 7fe6377fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe63809d860 0x7fe63809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.757+0000 7fe636ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe63809e170 0x7fe6381307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.757+0000 7fe637fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe638130ce0 0x7fe638131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.757+0000 7fe6377fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe63809d860 0x7fe63809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:44980/0 (socket says 172.21.15.146:44980) 2023-10-03T10:15:24.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.757+0000 7fe636ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe63809e170 0x7fe6381307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40754/0 (socket says 172.21.15.146:40754) 2023-10-03T10:15:24.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.757+0000 7fe637fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe638130ce0 0x7fe638131180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34042/0 (socket says 172.21.15.146:34042) 2023-10-03T10:15:24.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.757+0000 7fe6377fe700 1 -- 172.21.15.146:0/1609822740 learned_addr learned my addr 172.21.15.146:0/1609822740 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:24.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.758+0000 7fe6377fe700 1 -- 172.21.15.146:0/1609822740 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe638130ce0 msgr2=0x7fe638131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:24.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.758+0000 7fe6377fe700 1 --2- 172.21.15.146:0/1609822740 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe638130ce0 0x7fe638131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.758+0000 7fe6377fe700 1 -- 172.21.15.146:0/1609822740 >> v2:172.21.15.146:3300/0 conn(0x7fe63809e170 msgr2=0x7fe6381307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:24.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.758+0000 7fe6377fe700 1 --2- 172.21.15.146:0/1609822740 >> v2:172.21.15.146:3300/0 conn(0x7fe63809e170 0x7fe6381307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.758+0000 7fe6377fe700 1 -- 172.21.15.146:0/1609822740 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63809b620 con 0x7fe63809d860 2023-10-03T10:15:24.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.758+0000 7fe6377fe700 1 --2- 172.21.15.146:0/1609822740 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe63809d860 0x7fe63809dc30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe62800b9d0 tx=0x7fe62800bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f89ed0672299bda server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.758+0000 7fe6367fc700 1 -- 172.21.15.146:0/1609822740 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62800cc20 con 0x7fe63809d860 2023-10-03T10:15:24.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.758+0000 7fe6367fc700 1 -- 172.21.15.146:0/1609822740 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62800cd80 con 0x7fe63809d860 2023-10-03T10:15:24.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.758+0000 7fe6367fc700 1 -- 172.21.15.146:0/1609822740 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62800f680 con 0x7fe63809d860 2023-10-03T10:15:24.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.759+0000 7fe63e0ac700 1 -- 172.21.15.146:0/1609822740 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe63809d860 msgr2=0x7fe63809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.759+0000 7fe63e0ac700 1 --2- 172.21.15.146:0/1609822740 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe63809d860 0x7fe63809dc30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe62800b9d0 tx=0x7fe62800bce0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.759+0000 7fe63e0ac700 1 -- 172.21.15.146:0/1609822740 shutdown_connections 2023-10-03T10:15:24.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.759+0000 7fe63e0ac700 1 --2- 172.21.15.146:0/1609822740 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe638130ce0 0x7fe638131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.759+0000 7fe63e0ac700 1 --2- 172.21.15.146:0/1609822740 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe63809d860 0x7fe63809dc30 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.759+0000 7fe63e0ac700 1 --2- 172.21.15.146:0/1609822740 >> v2:172.21.15.146:3300/0 conn(0x7fe63809e170 0x7fe6381307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.759+0000 7fe63e0ac700 1 -- 172.21.15.146:0/1609822740 >> 172.21.15.146:0/1609822740 conn(0x7fe638099c40 msgr2=0x7fe6380a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.759+0000 7fe63e0ac700 1 -- 172.21.15.146:0/1609822740 shutdown_connections 2023-10-03T10:15:24.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.759+0000 7fe63e0ac700 1 -- 172.21.15.146:0/1609822740 wait complete. 2023-10-03T10:15:24.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.760+0000 7fe63e0ac700 1 Processor -- start 2023-10-03T10:15:24.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.760+0000 7fe63e0ac700 1 -- start start 2023-10-03T10:15:24.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.760+0000 7fe63e0ac700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe63809d860 0x7fe63811d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.760+0000 7fe63e0ac700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe63809e170 0x7fe63811d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.760+0000 7fe63e0ac700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe638130ce0 0x7fe63811daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.760+0000 7fe63e0ac700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63811e520 con 0x7fe638130ce0 2023-10-03T10:15:24.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.760+0000 7fe63e0ac700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63811ec80 con 0x7fe63809e170 2023-10-03T10:15:24.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.760+0000 7fe63e0ac700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe63811f2a0 con 0x7fe63809d860 2023-10-03T10:15:24.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.760+0000 7fe636ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe63809e170 0x7fe63811d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.760+0000 7fe636ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe63809e170 0x7fe63811d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34058/0 (socket says 172.21.15.146:34058) 2023-10-03T10:15:24.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.760+0000 7fe636ffd700 1 -- 172.21.15.146:0/2961349647 learned_addr learned my addr 172.21.15.146:0/2961349647 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:24.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.761+0000 7fe637fff700 1 --2- 172.21.15.146:0/2961349647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe638130ce0 0x7fe63811daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.761+0000 7fe6377fe700 1 --2- 172.21.15.146:0/2961349647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe63809d860 0x7fe63811d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.761+0000 7fe637fff700 1 -- 172.21.15.146:0/2961349647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe63809d860 msgr2=0x7fe63811d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.761+0000 7fe637fff700 1 --2- 172.21.15.146:0/2961349647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe63809d860 0x7fe63811d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.761+0000 7fe637fff700 1 -- 172.21.15.146:0/2961349647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe63809e170 msgr2=0x7fe63811d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.761+0000 7fe637fff700 1 --2- 172.21.15.146:0/2961349647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe63809e170 0x7fe63811d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.761+0000 7fe637fff700 1 -- 172.21.15.146:0/2961349647 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62800b600 con 0x7fe638130ce0 2023-10-03T10:15:24.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.761+0000 7fe636ffd700 1 --2- 172.21.15.146:0/2961349647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe63809e170 0x7fe63811d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:24.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.761+0000 7fe637fff700 1 --2- 172.21.15.146:0/2961349647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe638130ce0 0x7fe63811daf0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe630009d90 tx=0x7fe63000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.761+0000 7fe61ffff700 1 -- 172.21.15.146:0/2961349647 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630009c00 con 0x7fe638130ce0 2023-10-03T10:15:24.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.761+0000 7fe61ffff700 1 -- 172.21.15.146:0/2961349647 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63000f040 con 0x7fe638130ce0 2023-10-03T10:15:24.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.761+0000 7fe63e0ac700 1 -- 172.21.15.146:0/2961349647 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6381208b0 con 0x7fe638130ce0 2023-10-03T10:15:24.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.761+0000 7fe61ffff700 1 -- 172.21.15.146:0/2961349647 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630014480 con 0x7fe638130ce0 2023-10-03T10:15:24.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.761+0000 7fe63e0ac700 1 -- 172.21.15.146:0/2961349647 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe638120370 con 0x7fe638130ce0 2023-10-03T10:15:24.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.762+0000 7fe63e0ac700 1 -- 172.21.15.146:0/2961349647 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63804f2a0 con 0x7fe638130ce0 2023-10-03T10:15:24.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.762+0000 7fe61ffff700 1 -- 172.21.15.146:0/2961349647 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe6300145e0 con 0x7fe638130ce0 2023-10-03T10:15:24.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.763+0000 7fe61ffff700 1 -- 172.21.15.146:0/2961349647 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe6300402d0 con 0x7fe638130ce0 2023-10-03T10:15:24.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.767+0000 7fe61ffff700 1 -- 172.21.15.146:0/2961349647 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe630007900 con 0x7fe638130ce0 2023-10-03T10:15:24.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.843+0000 7fc18053b700 1 -- 172.21.15.146:0/746135236 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc17804f2a0 con 0x7fc17809e870 2023-10-03T10:15:24.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.843+0000 7fc16effd700 1 -- 172.21.15.146:0/746135236 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc174020370 con 0x7fc17809e870 2023-10-03T10:15:24.844 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:24.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.845+0000 7fc18053b700 1 -- 172.21.15.146:0/746135236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc17809e870 msgr2=0x7fc17811d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.845+0000 7fc18053b700 1 --2- 172.21.15.146:0/746135236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc17809e870 0x7fc17811d110 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fc174012b80 tx=0x7fc174012e90 comp rx=0 tx=0).stop 2023-10-03T10:15:24.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.845+0000 7fc18053b700 1 -- 172.21.15.146:0/746135236 shutdown_connections 2023-10-03T10:15:24.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.845+0000 7fc18053b700 1 --2- 172.21.15.146:0/746135236 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc178131d70 0x7fc17811db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.845+0000 7fc18053b700 1 --2- 172.21.15.146:0/746135236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc17809e870 0x7fc17811d110 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.845+0000 7fc18053b700 1 --2- 172.21.15.146:0/746135236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc17809f180 0x7fc17811d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.845+0000 7fc18053b700 1 -- 172.21.15.146:0/746135236 >> 172.21.15.146:0/746135236 conn(0x7fc1780a4430 msgr2=0x7fc17806d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.845+0000 7fc18053b700 1 -- 172.21.15.146:0/746135236 shutdown_connections 2023-10-03T10:15:24.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.845+0000 7fc18053b700 1 -- 172.21.15.146:0/746135236 wait complete. 2023-10-03T10:15:24.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:24.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.879+0000 7f4e86d5e700 1 -- 172.21.15.146:0/1125269577 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4e8004f2a0 con 0x7f4e801300a0 2023-10-03T10:15:24.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.880+0000 7f4e7d7fa700 1 -- 172.21.15.146:0/1125269577 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e74021030 con 0x7f4e801300a0 2023-10-03T10:15:24.882 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:24.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.882+0000 7f4e86d5e700 1 -- 172.21.15.146:0/1125269577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e801300a0 msgr2=0x7f4e8011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.882+0000 7f4e86d5e700 1 --2- 172.21.15.146:0/1125269577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e801300a0 0x7f4e8011da40 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400e910 tx=0x7f4e7400ec20 comp rx=0 tx=0).stop 2023-10-03T10:15:24.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.882+0000 7f4e86d5e700 1 -- 172.21.15.146:0/1125269577 shutdown_connections 2023-10-03T10:15:24.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.882+0000 7f4e86d5e700 1 --2- 172.21.15.146:0/1125269577 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e80133ad0 0x7f4e8011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.882+0000 7f4e86d5e700 1 --2- 172.21.15.146:0/1125269577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e801300a0 0x7f4e8011da40 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.882+0000 7f4e86d5e700 1 --2- 172.21.15.146:0/1125269577 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e80130bc0 0x7f4e8011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.882+0000 7f4e86d5e700 1 -- 172.21.15.146:0/1125269577 >> 172.21.15.146:0/1125269577 conn(0x7f4e80099c40 msgr2=0x7f4e8012e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.882+0000 7f4e86d5e700 1 -- 172.21.15.146:0/1125269577 shutdown_connections 2023-10-03T10:15:24.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.882+0000 7f4e86d5e700 1 -- 172.21.15.146:0/1125269577 wait complete. 2023-10-03T10:15:24.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:24.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.930+0000 7ff186f76700 1 -- 172.21.15.146:0/1110449700 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff18006c3b0 con 0x7ff180130ce0 2023-10-03T10:15:24.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.930+0000 7ff17d7fa700 1 -- 172.21.15.146:0/1110449700 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff178011380 con 0x7ff180130ce0 2023-10-03T10:15:24.932 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:24.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.932+0000 7ff186f76700 1 -- 172.21.15.146:0/1110449700 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff180130ce0 msgr2=0x7ff18011e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.932+0000 7ff186f76700 1 --2- 172.21.15.146:0/1110449700 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff180130ce0 0x7ff18011e690 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff17800cc80 tx=0x7ff17800cf90 comp rx=0 tx=0).stop 2023-10-03T10:15:24.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.932+0000 7ff186f76700 1 -- 172.21.15.146:0/1110449700 shutdown_connections 2023-10-03T10:15:24.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.932+0000 7ff186f76700 1 --2- 172.21.15.146:0/1110449700 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff180130ce0 0x7ff18011e690 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.932+0000 7ff186f76700 1 --2- 172.21.15.146:0/1110449700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff18009d860 0x7ff1801c4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.932+0000 7ff186f76700 1 --2- 172.21.15.146:0/1110449700 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff18009e170 0x7ff1801c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.932+0000 7ff186f76700 1 -- 172.21.15.146:0/1110449700 >> 172.21.15.146:0/1110449700 conn(0x7ff180099c40 msgr2=0x7ff1800a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.932+0000 7ff186f76700 1 -- 172.21.15.146:0/1110449700 shutdown_connections 2023-10-03T10:15:24.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.932+0000 7ff186f76700 1 -- 172.21.15.146:0/1110449700 wait complete. 2023-10-03T10:15:24.946 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:24.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.964+0000 7fe63e0ac700 1 -- 172.21.15.146:0/2961349647 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe63806c3b0 con 0x7fe638130ce0 2023-10-03T10:15:24.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.964+0000 7fe61ffff700 1 -- 172.21.15.146:0/2961349647 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe630007330 con 0x7fe638130ce0 2023-10-03T10:15:24.965 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:24.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.966+0000 7fe63e0ac700 1 -- 172.21.15.146:0/2961349647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe638130ce0 msgr2=0x7fe63811daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.966+0000 7fe63e0ac700 1 --2- 172.21.15.146:0/2961349647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe638130ce0 0x7fe63811daf0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe630009d90 tx=0x7fe63000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.966+0000 7fe63e0ac700 1 -- 172.21.15.146:0/2961349647 shutdown_connections 2023-10-03T10:15:24.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.966+0000 7fe63e0ac700 1 --2- 172.21.15.146:0/2961349647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe638130ce0 0x7fe63811daf0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.966+0000 7fe63e0ac700 1 --2- 172.21.15.146:0/2961349647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe63809d860 0x7fe63811d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.966+0000 7fe63e0ac700 1 --2- 172.21.15.146:0/2961349647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe63809e170 0x7fe63811d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.966+0000 7fe63e0ac700 1 -- 172.21.15.146:0/2961349647 >> 172.21.15.146:0/2961349647 conn(0x7fe638099c40 msgr2=0x7fe638130010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.966+0000 7fe63e0ac700 1 -- 172.21.15.146:0/2961349647 shutdown_connections 2023-10-03T10:15:24.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:24.966+0000 7fe63e0ac700 1 -- 172.21.15.146:0/2961349647 wait complete. 2023-10-03T10:15:24.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:25.864 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:25.899 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:25.947 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:25.981 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:26.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.002+0000 7f377dc3a700 1 Processor -- start 2023-10-03T10:15:26.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.002+0000 7f377dc3a700 1 -- start start 2023-10-03T10:15:26.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.002+0000 7f377dc3a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f377806a770 0x7f37781349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.002+0000 7f377dc3a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3778134f00 0x7f377809d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.002+0000 7f377dc3a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f377809dea0 0x7f377809e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.002+0000 7f377dc3a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377806b2e0 con 0x7f3778134f00 2023-10-03T10:15:26.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.002+0000 7f377dc3a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377809eca0 con 0x7f377806a770 2023-10-03T10:15:26.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.002+0000 7f377dc3a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f377809f720 con 0x7f377809dea0 2023-10-03T10:15:26.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.002+0000 7f37777fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f377806a770 0x7f37781349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.003+0000 7f37777fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f377806a770 0x7f37781349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34072/0 (socket says 172.21.15.146:34072) 2023-10-03T10:15:26.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.003+0000 7f37777fe700 1 -- 172.21.15.146:0/3086980158 learned_addr learned my addr 172.21.15.146:0/3086980158 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:26.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.003+0000 7f3776ffd700 1 --2- 172.21.15.146:0/3086980158 >> v2:172.21.15.146:3300/0 conn(0x7f3778134f00 0x7f377809d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.003+0000 7f3777fff700 1 --2- 172.21.15.146:0/3086980158 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f377809dea0 0x7f377809e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.003+0000 7f37777fe700 1 -- 172.21.15.146:0/3086980158 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f377809dea0 msgr2=0x7f377809e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:26.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.003+0000 7f37777fe700 1 --2- 172.21.15.146:0/3086980158 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f377809dea0 0x7f377809e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.003+0000 7f37777fe700 1 -- 172.21.15.146:0/3086980158 >> v2:172.21.15.146:3300/0 conn(0x7f3778134f00 msgr2=0x7f377809d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:26.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.003+0000 7f37777fe700 1 --2- 172.21.15.146:0/3086980158 >> v2:172.21.15.146:3300/0 conn(0x7f3778134f00 0x7f377809d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.003+0000 7f37777fe700 1 -- 172.21.15.146:0/3086980158 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377806b480 con 0x7f377806a770 2023-10-03T10:15:26.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.003+0000 7f37777fe700 1 --2- 172.21.15.146:0/3086980158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f377806a770 0x7f37781349c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f37680098f0 tx=0x7f3768009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5bd642352ff9250 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.003+0000 7f37767fc700 1 -- 172.21.15.146:0/3086980158 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768011830 con 0x7f377806a770 2023-10-03T10:15:26.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.003+0000 7f37767fc700 1 -- 172.21.15.146:0/3086980158 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3768011990 con 0x7f377806a770 2023-10-03T10:15:26.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.003+0000 7f37767fc700 1 -- 172.21.15.146:0/3086980158 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768011d20 con 0x7f377806a770 2023-10-03T10:15:26.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.004+0000 7f377dc3a700 1 -- 172.21.15.146:0/3086980158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f377806a770 msgr2=0x7f37781349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.004+0000 7f377dc3a700 1 --2- 172.21.15.146:0/3086980158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f377806a770 0x7f37781349c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f37680098f0 tx=0x7f3768009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:26.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.004+0000 7f377dc3a700 1 -- 172.21.15.146:0/3086980158 shutdown_connections 2023-10-03T10:15:26.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.004+0000 7f377dc3a700 1 --2- 172.21.15.146:0/3086980158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f377806a770 0x7f37781349c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.004+0000 7f377dc3a700 1 --2- 172.21.15.146:0/3086980158 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f377809dea0 0x7f377809e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.004+0000 7f377dc3a700 1 --2- 172.21.15.146:0/3086980158 >> v2:172.21.15.146:3300/0 conn(0x7f3778134f00 0x7f377809d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.004+0000 7f377dc3a700 1 -- 172.21.15.146:0/3086980158 >> 172.21.15.146:0/3086980158 conn(0x7f3778099c40 msgr2=0x7f37780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.005+0000 7f377dc3a700 1 -- 172.21.15.146:0/3086980158 shutdown_connections 2023-10-03T10:15:26.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.005+0000 7f377dc3a700 1 -- 172.21.15.146:0/3086980158 wait complete. 2023-10-03T10:15:26.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.006+0000 7f377dc3a700 1 Processor -- start 2023-10-03T10:15:26.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.006+0000 7f377dc3a700 1 -- start start 2023-10-03T10:15:26.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.007+0000 7f377dc3a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f377806a770 0x7f3778135af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.007+0000 7f377dc3a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f377809dea0 0x7f3778136030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.007+0000 7f377dc3a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3778134f00 0x7f3778136570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.007+0000 7f377dc3a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3778136fa0 con 0x7f377806a770 2023-10-03T10:15:26.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.007+0000 7f377dc3a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3778133fd0 con 0x7f377809dea0 2023-10-03T10:15:26.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.007+0000 7f377dc3a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3778138f80 con 0x7f3778134f00 2023-10-03T10:15:26.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.007+0000 7f37777fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f377806a770 0x7f3778135af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.007+0000 7f37777fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f377806a770 0x7f3778135af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40782/0 (socket says 172.21.15.146:40782) 2023-10-03T10:15:26.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.007+0000 7f37777fe700 1 -- 172.21.15.146:0/1253284428 learned_addr learned my addr 172.21.15.146:0/1253284428 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:26.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.007+0000 7f3776ffd700 1 --2- 172.21.15.146:0/1253284428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f377809dea0 0x7f3778136030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.007+0000 7f37777fe700 1 -- 172.21.15.146:0/1253284428 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3778134f00 msgr2=0x7f3778136570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.007+0000 7f37777fe700 1 --2- 172.21.15.146:0/1253284428 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3778134f00 0x7f3778136570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.007+0000 7f37777fe700 1 -- 172.21.15.146:0/1253284428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f377809dea0 msgr2=0x7f3778136030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.007+0000 7f37777fe700 1 --2- 172.21.15.146:0/1253284428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f377809dea0 0x7f3778136030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.007+0000 7f37777fe700 1 -- 172.21.15.146:0/1253284428 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3768009550 con 0x7f377806a770 2023-10-03T10:15:26.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.008+0000 7f37777fe700 1 --2- 172.21.15.146:0/1253284428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f377806a770 0x7f3778135af0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3768014040 tx=0x7f3768004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.008+0000 7f375ffff700 1 -- 172.21.15.146:0/1253284428 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768004450 con 0x7f377806a770 2023-10-03T10:15:26.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.008+0000 7f375ffff700 1 -- 172.21.15.146:0/1253284428 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376801e070 con 0x7f377806a770 2023-10-03T10:15:26.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.008+0000 7f375ffff700 1 -- 172.21.15.146:0/1253284428 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37680038e0 con 0x7f377806a770 2023-10-03T10:15:26.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.009+0000 7f377dc3a700 1 -- 172.21.15.146:0/1253284428 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377809f220 con 0x7f377806a770 2023-10-03T10:15:26.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.009+0000 7f377dc3a700 1 -- 172.21.15.146:0/1253284428 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3778137610 con 0x7f377806a770 2023-10-03T10:15:26.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.010+0000 7f375ffff700 1 -- 172.21.15.146:0/1253284428 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3768003a40 con 0x7f377806a770 2023-10-03T10:15:26.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.010+0000 7f375ffff700 1 -- 172.21.15.146:0/1253284428 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3768020070 con 0x7f377806a770 2023-10-03T10:15:26.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.010+0000 7f377dc3a700 1 -- 172.21.15.146:0/1253284428 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377804f2a0 con 0x7f377806a770 2023-10-03T10:15:26.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.015+0000 7f375ffff700 1 -- 172.21.15.146:0/1253284428 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3768015080 con 0x7f377806a770 2023-10-03T10:15:26.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.046+0000 7f5fc5eb6700 1 Processor -- start 2023-10-03T10:15:26.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.046+0000 7f5fc5eb6700 1 -- start start 2023-10-03T10:15:26.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.047+0000 7f5fc5eb6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc00a0a30 0x7f5fc00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.047+0000 7f5fc5eb6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5fc0130670 0x7f5fc01381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.047+0000 7f5fc5eb6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc00a1e70 con 0x7f5fc00a1340 2023-10-03T10:15:26.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.047+0000 7f5fc5eb6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc009a720 con 0x7f5fc0130670 2023-10-03T10:15:26.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.047+0000 7f5fc5eb6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc009b300 con 0x7f5fc00a0a30 2023-10-03T10:15:26.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.047+0000 7f5fbf7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc00a0a30 0x7f5fc00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.047+0000 7f5fbf7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc00a0a30 0x7f5fc00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34090/0 (socket says 172.21.15.146:34090) 2023-10-03T10:15:26.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.047+0000 7f5fbf7fe700 1 -- 172.21.15.146:0/860532331 learned_addr learned my addr 172.21.15.146:0/860532331 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:26.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.047+0000 7f5fbffff700 1 --2- 172.21.15.146:0/860532331 >> v2:172.21.15.146:3300/0 conn(0x7f5fc0130670 0x7f5fc01381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.047+0000 7f5fbe7fc700 1 -- 172.21.15.146:0/860532331 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642138606 0 0) 0x7f5fc00a1e70 con 0x7f5fc00a1340 2023-10-03T10:15:26.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.047+0000 7f5fbf7fe700 1 -- 172.21.15.146:0/860532331 >> v2:172.21.15.146:3300/0 conn(0x7f5fc0130670 msgr2=0x7f5fc01381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:26.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.047+0000 7f5fbf7fe700 1 --2- 172.21.15.146:0/860532331 >> v2:172.21.15.146:3300/0 conn(0x7f5fc0130670 0x7f5fc01381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.048+0000 7f5fbf7fe700 1 -- 172.21.15.146:0/860532331 >> v1:172.21.15.146:6789/0 conn(0x7f5fc00a1340 legacy=0x7f5fc012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.048+0000 7f5fbf7fe700 1 -- 172.21.15.146:0/860532331 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc009abc0 con 0x7f5fc00a0a30 2023-10-03T10:15:26.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.048+0000 7f5fbf7fe700 1 --2- 172.21.15.146:0/860532331 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc00a0a30 0x7f5fc00a0e00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0006fd0 tx=0x7f5fb000be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7bf42c67c7abe6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.048+0000 7f5fbe7fc700 1 -- 172.21.15.146:0/860532331 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0005c20 con 0x7f5fc00a0a30 2023-10-03T10:15:26.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.048+0000 7f5fbe7fc700 1 -- 172.21.15.146:0/860532331 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb0005d80 con 0x7f5fc00a0a30 2023-10-03T10:15:26.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.048+0000 7f5fbe7fc700 1 -- 172.21.15.146:0/860532331 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb000db80 con 0x7f5fc00a0a30 2023-10-03T10:15:26.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.049+0000 7f5fc5eb6700 1 -- 172.21.15.146:0/860532331 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc00a0a30 msgr2=0x7f5fc00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.049+0000 7f5fc5eb6700 1 --2- 172.21.15.146:0/860532331 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc00a0a30 0x7f5fc00a0e00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0006fd0 tx=0x7f5fb000be70 comp rx=0 tx=0).stop 2023-10-03T10:15:26.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.049+0000 7f5fc5eb6700 1 -- 172.21.15.146:0/860532331 shutdown_connections 2023-10-03T10:15:26.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.049+0000 7f5fc5eb6700 1 --2- 172.21.15.146:0/860532331 >> v2:172.21.15.146:3300/0 conn(0x7f5fc0130670 0x7f5fc01381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.049+0000 7f5fc5eb6700 1 --2- 172.21.15.146:0/860532331 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc00a0a30 0x7f5fc00a0e00 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.049+0000 7f5fc5eb6700 1 -- 172.21.15.146:0/860532331 >> 172.21.15.146:0/860532331 conn(0x7f5fc00a2980 msgr2=0x7f5fc00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.049+0000 7f5fc5eb6700 1 -- 172.21.15.146:0/860532331 shutdown_connections 2023-10-03T10:15:26.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.049+0000 7f5fc5eb6700 1 -- 172.21.15.146:0/860532331 wait complete. 2023-10-03T10:15:26.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.050+0000 7f5fc5eb6700 1 Processor -- start 2023-10-03T10:15:26.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.050+0000 7f5fc5eb6700 1 -- start start 2023-10-03T10:15:26.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.050+0000 7f5fc5eb6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc00a0a30 0x7f5fc012f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.050+0000 7f5fc5eb6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fc00a1340 0x7f5fc012f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.050+0000 7f5fc5eb6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc0130670 0x7f5fc01c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.050+0000 7f5fc5eb6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc011f060 con 0x7f5fc0130670 2023-10-03T10:15:26.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.050+0000 7f5fc5eb6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc011e9b0 con 0x7f5fc00a0a30 2023-10-03T10:15:26.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.050+0000 7f5fc5eb6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc011d5f0 con 0x7f5fc00a1340 2023-10-03T10:15:26.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.050+0000 7f5fbeffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fc00a1340 0x7f5fc012f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.050+0000 7f5fbeffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fc00a1340 0x7f5fc012f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45026/0 (socket says 172.21.15.146:45026) 2023-10-03T10:15:26.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.050+0000 7f5fbeffd700 1 -- 172.21.15.146:0/198476196 learned_addr learned my addr 172.21.15.146:0/198476196 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:26.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.050+0000 7f5fbffff700 1 --2- 172.21.15.146:0/198476196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc0130670 0x7f5fc01c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.051+0000 7f5fbf7fe700 1 --2- 172.21.15.146:0/198476196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc00a0a30 0x7f5fc012f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.051+0000 7f5fbeffd700 1 -- 172.21.15.146:0/198476196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc00a0a30 msgr2=0x7f5fc012f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.051+0000 7f5fbeffd700 1 --2- 172.21.15.146:0/198476196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc00a0a30 0x7f5fc012f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.051+0000 7f5fbeffd700 1 -- 172.21.15.146:0/198476196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc0130670 msgr2=0x7f5fc01c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.051+0000 7f5fbeffd700 1 --2- 172.21.15.146:0/198476196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc0130670 0x7f5fc01c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.051+0000 7f5fbeffd700 1 -- 172.21.15.146:0/198476196 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb000b7a0 con 0x7f5fc00a1340 2023-10-03T10:15:26.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.051+0000 7f5fbeffd700 1 --2- 172.21.15.146:0/198476196 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fc00a1340 0x7f5fc012f7e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400c550 tx=0x7f5fb400c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.051+0000 7f5fa7fff700 1 -- 172.21.15.146:0/198476196 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb40054e0 con 0x7f5fc00a1340 2023-10-03T10:15:26.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.051+0000 7f5fa7fff700 1 -- 172.21.15.146:0/198476196 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb4003680 con 0x7f5fc00a1340 2023-10-03T10:15:26.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.051+0000 7f5fa7fff700 1 -- 172.21.15.146:0/198476196 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4003a30 con 0x7f5fc00a1340 2023-10-03T10:15:26.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.051+0000 7f5fc5eb6700 1 -- 172.21.15.146:0/198476196 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc012ff90 con 0x7f5fc00a1340 2023-10-03T10:15:26.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.051+0000 7f5fc5eb6700 1 -- 172.21.15.146:0/198476196 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc011d830 con 0x7f5fc00a1340 2023-10-03T10:15:26.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.052+0000 7f5fa7fff700 1 -- 172.21.15.146:0/198476196 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5fb4003b90 con 0x7f5fc00a1340 2023-10-03T10:15:26.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.052+0000 7f5fa7fff700 1 -- 172.21.15.146:0/198476196 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5fb403eae0 con 0x7f5fc00a1340 2023-10-03T10:15:26.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.052+0000 7f5fc5eb6700 1 -- 172.21.15.146:0/198476196 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc004f2a0 con 0x7f5fc00a1340 2023-10-03T10:15:26.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.057+0000 7f5fa7fff700 1 -- 172.21.15.146:0/198476196 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5fb4017070 con 0x7f5fc00a1340 2023-10-03T10:15:26.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.120+0000 7fcb27433700 1 Processor -- start 2023-10-03T10:15:26.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.120+0000 7fcb27433700 1 -- start start 2023-10-03T10:15:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.121+0000 7fcb27433700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb200a1550 0x7fcb20138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.121+0000 7fcb27433700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb20139200 0x7fcb2013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.121+0000 7fcb27433700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb2009e9d0 con 0x7fcb200a0a70 2023-10-03T10:15:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.121+0000 7fcb27433700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2009dc00 con 0x7fcb20139200 2023-10-03T10:15:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.121+0000 7fcb27433700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2009dec0 con 0x7fcb200a1550 2023-10-03T10:15:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.121+0000 7fcb259d0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb20139200 0x7fcb2013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.121+0000 7fcb249ce700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb200a1550 0x7fcb20138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.121+0000 7fcb259d0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb20139200 0x7fcb2013b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34102/0 (socket says 172.21.15.146:34102) 2023-10-03T10:15:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.121+0000 7fcb259d0700 1 -- 172.21.15.146:0/4064386439 learned_addr learned my addr 172.21.15.146:0/4064386439 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:26.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.121+0000 7fcb249ce700 1 -- 172.21.15.146:0/4064386439 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb20139200 msgr2=0x7fcb2013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:26.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.121+0000 7fcb249ce700 1 --2- 172.21.15.146:0/4064386439 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb20139200 0x7fcb2013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.121+0000 7fcb249ce700 1 -- 172.21.15.146:0/4064386439 >> v1:172.21.15.146:6789/0 conn(0x7fcb200a0a70 legacy=0x7fcb200a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.121+0000 7fcb249ce700 1 -- 172.21.15.146:0/4064386439 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2009e6a0 con 0x7fcb200a1550 2023-10-03T10:15:26.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.122+0000 7fcb249ce700 1 --2- 172.21.15.146:0/4064386439 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb200a1550 0x7fcb20138cc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009870 tx=0x7fcb10009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e05184728e5a98d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.122+0000 7fcb17fff700 1 -- 172.21.15.146:0/4064386439 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb10011830 con 0x7fcb200a1550 2023-10-03T10:15:26.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.122+0000 7fcb17fff700 1 -- 172.21.15.146:0/4064386439 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb10011990 con 0x7fcb200a1550 2023-10-03T10:15:26.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.122+0000 7fcb17fff700 1 -- 172.21.15.146:0/4064386439 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb10011d20 con 0x7fcb200a1550 2023-10-03T10:15:26.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.123+0000 7fcb27433700 1 -- 172.21.15.146:0/4064386439 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb200a1550 msgr2=0x7fcb20138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.123+0000 7fcb27433700 1 --2- 172.21.15.146:0/4064386439 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb200a1550 0x7fcb20138cc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009870 tx=0x7fcb10009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:26.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.123+0000 7fcb27433700 1 -- 172.21.15.146:0/4064386439 shutdown_connections 2023-10-03T10:15:26.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.123+0000 7fcb27433700 1 --2- 172.21.15.146:0/4064386439 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb20139200 0x7fcb2013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.123+0000 7fcb27433700 1 --2- 172.21.15.146:0/4064386439 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb200a1550 0x7fcb20138cc0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.123+0000 7fcb27433700 1 -- 172.21.15.146:0/4064386439 >> 172.21.15.146:0/4064386439 conn(0x7fcb200a6610 msgr2=0x7fcb200a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.123+0000 7fcb27433700 1 -- 172.21.15.146:0/4064386439 shutdown_connections 2023-10-03T10:15:26.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.123+0000 7fcb27433700 1 -- 172.21.15.146:0/4064386439 wait complete. 2023-10-03T10:15:26.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.124+0000 7fcb27433700 1 Processor -- start 2023-10-03T10:15:26.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.124+0000 7fcb27433700 1 -- start start 2023-10-03T10:15:26.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.125+0000 7fcb27433700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb200a0a70 0x7fcb2011e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.125+0000 7fcb27433700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb200a1550 0x7fcb2011ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.125+0000 7fcb27433700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb20139200 0x7fcb2011f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.125+0000 7fcb27433700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb201224f0 con 0x7fcb200a0a70 2023-10-03T10:15:26.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.125+0000 7fcb27433700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb201220a0 con 0x7fcb200a1550 2023-10-03T10:15:26.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.125+0000 7fcb27433700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb200a03e0 con 0x7fcb20139200 2023-10-03T10:15:26.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.125+0000 7fcb259d0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb20139200 0x7fcb2011f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.125+0000 7fcb259d0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb20139200 0x7fcb2011f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45044/0 (socket says 172.21.15.146:45044) 2023-10-03T10:15:26.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.125+0000 7fcb259d0700 1 -- 172.21.15.146:0/3599254768 learned_addr learned my addr 172.21.15.146:0/3599254768 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:26.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.125+0000 7fcb249ce700 1 --2- 172.21.15.146:0/3599254768 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb200a1550 0x7fcb2011ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.125+0000 7fcb251cf700 1 --2- 172.21.15.146:0/3599254768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb200a0a70 0x7fcb2011e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.126+0000 7fcb259d0700 1 -- 172.21.15.146:0/3599254768 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb200a1550 msgr2=0x7fcb2011ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.126+0000 7fcb259d0700 1 --2- 172.21.15.146:0/3599254768 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb200a1550 0x7fcb2011ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.126+0000 7fcb259d0700 1 -- 172.21.15.146:0/3599254768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb200a0a70 msgr2=0x7fcb2011e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.126+0000 7fcb259d0700 1 --2- 172.21.15.146:0/3599254768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb200a0a70 0x7fcb2011e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.126+0000 7fcb259d0700 1 -- 172.21.15.146:0/3599254768 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb100094a0 con 0x7fcb20139200 2023-10-03T10:15:26.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.126+0000 7fcb259d0700 1 --2- 172.21.15.146:0/3599254768 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb20139200 0x7fcb2011f440 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800efc0 tx=0x7fcb1800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.126+0000 7fcb15ffb700 1 -- 172.21.15.146:0/3599254768 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18003c20 con 0x7fcb20139200 2023-10-03T10:15:26.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.126+0000 7fcb15ffb700 1 -- 172.21.15.146:0/3599254768 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1800f040 con 0x7fcb20139200 2023-10-03T10:15:26.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.126+0000 7fcb27433700 1 -- 172.21.15.146:0/3599254768 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb20121af0 con 0x7fcb20139200 2023-10-03T10:15:26.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.126+0000 7fcb15ffb700 1 -- 172.21.15.146:0/3599254768 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18009e30 con 0x7fcb20139200 2023-10-03T10:15:26.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.126+0000 7fcb27433700 1 -- 172.21.15.146:0/3599254768 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb20120c60 con 0x7fcb20139200 2023-10-03T10:15:26.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.127+0000 7fcb15ffb700 1 -- 172.21.15.146:0/3599254768 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb1800c880 con 0x7fcb20139200 2023-10-03T10:15:26.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.127+0000 7fcb15ffb700 1 -- 172.21.15.146:0/3599254768 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcb1803f9f0 con 0x7fcb20139200 2023-10-03T10:15:26.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.128+0000 7fcb27433700 1 -- 172.21.15.146:0/3599254768 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb201221e0 con 0x7fcb20139200 2023-10-03T10:15:26.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.129+0000 7f19d6b06700 1 Processor -- start 2023-10-03T10:15:26.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.130+0000 7f19d6b06700 1 -- start start 2023-10-03T10:15:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.130+0000 7f19d6b06700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19d0066410 0x7f19d01319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.130+0000 7f19d6b06700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19d01314b0 0x7f19d0131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.130+0000 7f19d6b06700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d00a0f20 con 0x7f19d009bc70 2023-10-03T10:15:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.130+0000 7f19d6b06700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d00667e0 con 0x7f19d01314b0 2023-10-03T10:15:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.130+0000 7f19d6b06700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00a23c0 con 0x7f19d0066410 2023-10-03T10:15:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.130+0000 7f19cffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19d01314b0 0x7f19d0131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.130+0000 7f19d48a2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19d0066410 0x7f19d01319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.130+0000 7f19cffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19d01314b0 0x7f19d0131f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40810/0 (socket says 172.21.15.146:40810) 2023-10-03T10:15:26.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.130+0000 7f19cffff700 1 -- 172.21.15.146:0/106147806 learned_addr learned my addr 172.21.15.146:0/106147806 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:26.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.131+0000 7f19cffff700 1 -- 172.21.15.146:0/106147806 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19d0066410 msgr2=0x7f19d01319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:26.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.131+0000 7f19cffff700 1 --2- 172.21.15.146:0/106147806 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19d0066410 0x7f19d01319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.131+0000 7f19cffff700 1 -- 172.21.15.146:0/106147806 >> v1:172.21.15.146:6789/0 conn(0x7f19d009bc70 legacy=0x7f19d009c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.131+0000 7f19cffff700 1 -- 172.21.15.146:0/106147806 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d00a16e0 con 0x7f19d01314b0 2023-10-03T10:15:26.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.131+0000 7f19d48a2700 1 --2- 172.21.15.146:0/106147806 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19d0066410 0x7f19d01319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:26.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.131+0000 7f19cffff700 1 --2- 172.21.15.146:0/106147806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d01314b0 0x7f19d0131f30 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f19bc009920 tx=0x7f19bc009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec390a9478ead0de server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.131+0000 7f19cf7fe700 1 -- 172.21.15.146:0/106147806 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc004230 con 0x7f19d01314b0 2023-10-03T10:15:26.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.131+0000 7f19cf7fe700 1 -- 172.21.15.146:0/106147806 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc004390 con 0x7f19d01314b0 2023-10-03T10:15:26.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.131+0000 7f19cf7fe700 1 -- 172.21.15.146:0/106147806 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc0036a0 con 0x7f19d01314b0 2023-10-03T10:15:26.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.132+0000 7f19d6b06700 1 -- 172.21.15.146:0/106147806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d01314b0 msgr2=0x7f19d0131f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.132+0000 7f19d6b06700 1 --2- 172.21.15.146:0/106147806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d01314b0 0x7f19d0131f30 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f19bc009920 tx=0x7f19bc009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:26.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.132+0000 7f19d6b06700 1 -- 172.21.15.146:0/106147806 shutdown_connections 2023-10-03T10:15:26.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.132+0000 7f19d6b06700 1 --2- 172.21.15.146:0/106147806 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19d0066410 0x7f19d01319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.132+0000 7f19d6b06700 1 --2- 172.21.15.146:0/106147806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d01314b0 0x7f19d0131f30 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.132+0000 7f19d6b06700 1 -- 172.21.15.146:0/106147806 >> 172.21.15.146:0/106147806 conn(0x7f19d00a2980 msgr2=0x7f19d00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.132+0000 7f19d6b06700 1 -- 172.21.15.146:0/106147806 shutdown_connections 2023-10-03T10:15:26.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.132+0000 7f19d6b06700 1 -- 172.21.15.146:0/106147806 wait complete. 2023-10-03T10:15:26.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.133+0000 7f19d6b06700 1 Processor -- start 2023-10-03T10:15:26.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.134+0000 7fcb15ffb700 1 -- 172.21.15.146:0/3599254768 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb201221e0 con 0x7fcb20139200 2023-10-03T10:15:26.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.134+0000 7f19d6b06700 1 -- start start 2023-10-03T10:15:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.135+0000 7f19d6b06700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19d0066410 0x7f19d0135150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.135+0000 7f19d6b06700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d009bc70 0x7f19d0135690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.135+0000 7f19d6b06700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19d01314b0 0x7f19d0135bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.135+0000 7f19d6b06700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d0137ad0 con 0x7f19d009bc70 2023-10-03T10:15:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.135+0000 7f19d6b06700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d0119390 con 0x7f19d0066410 2023-10-03T10:15:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.135+0000 7f19d6b06700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19d0130ab0 con 0x7f19d01314b0 2023-10-03T10:15:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.135+0000 7f19cffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d009bc70 0x7f19d0135690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.135+0000 7f19d48a2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19d0066410 0x7f19d0135150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.135+0000 7f19cffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d009bc70 0x7f19d0135690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40824/0 (socket says 172.21.15.146:40824) 2023-10-03T10:15:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.135+0000 7f19cffff700 1 -- 172.21.15.146:0/3000723061 learned_addr learned my addr 172.21.15.146:0/3000723061 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:26.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.135+0000 7f19d50a3700 1 --2- 172.21.15.146:0/3000723061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19d01314b0 0x7f19d0135bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.136+0000 7f19cffff700 1 -- 172.21.15.146:0/3000723061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19d01314b0 msgr2=0x7f19d0135bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.136+0000 7f19cffff700 1 --2- 172.21.15.146:0/3000723061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19d01314b0 0x7f19d0135bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.136+0000 7f19cffff700 1 -- 172.21.15.146:0/3000723061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19d0066410 msgr2=0x7f19d0135150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.136+0000 7f19cffff700 1 --2- 172.21.15.146:0/3000723061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19d0066410 0x7f19d0135150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.136+0000 7f19cffff700 1 -- 172.21.15.146:0/3000723061 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c4009430 con 0x7f19d009bc70 2023-10-03T10:15:26.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.136+0000 7f19cffff700 1 --2- 172.21.15.146:0/3000723061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d009bc70 0x7f19d0135690 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f19bc009130 tx=0x7f19bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.136+0000 7f19cd7fa700 1 -- 172.21.15.146:0/3000723061 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc003ae0 con 0x7f19d009bc70 2023-10-03T10:15:26.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.136+0000 7f19cd7fa700 1 -- 172.21.15.146:0/3000723061 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc01f070 con 0x7f19d009bc70 2023-10-03T10:15:26.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.136+0000 7f19cd7fa700 1 -- 172.21.15.146:0/3000723061 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc003e60 con 0x7f19d009bc70 2023-10-03T10:15:26.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.137+0000 7f19d6b06700 1 -- 172.21.15.146:0/3000723061 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19bc009550 con 0x7f19d009bc70 2023-10-03T10:15:26.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.137+0000 7f19d6b06700 1 -- 172.21.15.146:0/3000723061 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d0137ef0 con 0x7f19d009bc70 2023-10-03T10:15:26.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.137+0000 7f19cd7fa700 1 -- 172.21.15.146:0/3000723061 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19bc021030 con 0x7f19d009bc70 2023-10-03T10:15:26.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.138+0000 7f19cd7fa700 1 -- 172.21.15.146:0/3000723061 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f19bc040910 con 0x7f19d009bc70 2023-10-03T10:15:26.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.139+0000 7f19d6b06700 1 -- 172.21.15.146:0/3000723061 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d004f2a0 con 0x7f19d009bc70 2023-10-03T10:15:26.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.143+0000 7f19cd7fa700 1 -- 172.21.15.146:0/3000723061 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19bc01a460 con 0x7f19d009bc70 2023-10-03T10:15:26.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.255+0000 7f5fc5eb6700 1 -- 172.21.15.146:0/198476196 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5fc012fd20 con 0x7f5fc00a1340 2023-10-03T10:15:26.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.255+0000 7f377dc3a700 1 -- 172.21.15.146:0/1253284428 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f377813e6c0 con 0x7f377806a770 2023-10-03T10:15:26.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.255+0000 7f5fa7fff700 1 -- 172.21.15.146:0/198476196 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5fb4003e40 con 0x7f5fc00a1340 2023-10-03T10:15:26.256 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:26.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.255+0000 7f375ffff700 1 -- 172.21.15.146:0/1253284428 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f376802a020 con 0x7f377806a770 2023-10-03T10:15:26.257 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:26.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.257+0000 7f5fc5eb6700 1 -- 172.21.15.146:0/198476196 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fc00a1340 msgr2=0x7f5fc012f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.257+0000 7f5fc5eb6700 1 --2- 172.21.15.146:0/198476196 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fc00a1340 0x7f5fc012f7e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400c550 tx=0x7f5fb400c860 comp rx=0 tx=0).stop 2023-10-03T10:15:26.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.257+0000 7f5fc5eb6700 1 -- 172.21.15.146:0/198476196 shutdown_connections 2023-10-03T10:15:26.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.257+0000 7f5fc5eb6700 1 --2- 172.21.15.146:0/198476196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc0130670 0x7f5fc01c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.257+0000 7f5fc5eb6700 1 --2- 172.21.15.146:0/198476196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc00a0a30 0x7f5fc012f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.257+0000 7f5fc5eb6700 1 --2- 172.21.15.146:0/198476196 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fc00a1340 0x7f5fc012f7e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.257+0000 7f5fc5eb6700 1 -- 172.21.15.146:0/198476196 >> 172.21.15.146:0/198476196 conn(0x7f5fc00a2980 msgr2=0x7f5fc01bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.258+0000 7f5fc5eb6700 1 -- 172.21.15.146:0/198476196 shutdown_connections 2023-10-03T10:15:26.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.258+0000 7f5fc5eb6700 1 -- 172.21.15.146:0/198476196 wait complete. 2023-10-03T10:15:26.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.258+0000 7f377dc3a700 1 -- 172.21.15.146:0/1253284428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f377806a770 msgr2=0x7f3778135af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.258+0000 7f377dc3a700 1 --2- 172.21.15.146:0/1253284428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f377806a770 0x7f3778135af0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3768014040 tx=0x7f3768004750 comp rx=0 tx=0).stop 2023-10-03T10:15:26.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.258+0000 7f377dc3a700 1 -- 172.21.15.146:0/1253284428 shutdown_connections 2023-10-03T10:15:26.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.258+0000 7f377dc3a700 1 --2- 172.21.15.146:0/1253284428 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3778134f00 0x7f3778136570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.258+0000 7f377dc3a700 1 --2- 172.21.15.146:0/1253284428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f377806a770 0x7f3778135af0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.258+0000 7f377dc3a700 1 --2- 172.21.15.146:0/1253284428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f377809dea0 0x7f3778136030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.258+0000 7f377dc3a700 1 -- 172.21.15.146:0/1253284428 >> 172.21.15.146:0/1253284428 conn(0x7f3778099c40 msgr2=0x7f377809c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.258+0000 7f377dc3a700 1 -- 172.21.15.146:0/1253284428 shutdown_connections 2023-10-03T10:15:26.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.258+0000 7f377dc3a700 1 -- 172.21.15.146:0/1253284428 wait complete. 2023-10-03T10:15:26.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:26.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:26.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.345+0000 7fcb27433700 1 -- 172.21.15.146:0/3599254768 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcb201221e0 con 0x7fcb20139200 2023-10-03T10:15:26.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.346+0000 7fcb15ffb700 1 -- 172.21.15.146:0/3599254768 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb201221e0 con 0x7fcb20139200 2023-10-03T10:15:26.346 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:26.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.348+0000 7fcb27433700 1 -- 172.21.15.146:0/3599254768 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb20139200 msgr2=0x7fcb2011f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.348+0000 7fcb27433700 1 --2- 172.21.15.146:0/3599254768 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb20139200 0x7fcb2011f440 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800efc0 tx=0x7fcb1800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.348+0000 7fcb27433700 1 -- 172.21.15.146:0/3599254768 shutdown_connections 2023-10-03T10:15:26.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.348+0000 7fcb27433700 1 --2- 172.21.15.146:0/3599254768 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb20139200 0x7fcb2011f440 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.348+0000 7fcb27433700 1 --2- 172.21.15.146:0/3599254768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb200a0a70 0x7fcb2011e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.348+0000 7fcb27433700 1 --2- 172.21.15.146:0/3599254768 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb200a1550 0x7fcb2011ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.348+0000 7fcb27433700 1 -- 172.21.15.146:0/3599254768 >> 172.21.15.146:0/3599254768 conn(0x7fcb200a6610 msgr2=0x7fcb200a5980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.348+0000 7fcb27433700 1 -- 172.21.15.146:0/3599254768 shutdown_connections 2023-10-03T10:15:26.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.348+0000 7fcb27433700 1 -- 172.21.15.146:0/3599254768 wait complete. 2023-10-03T10:15:26.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.352+0000 7f19d6b06700 1 -- 172.21.15.146:0/3000723061 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f19d00724c0 con 0x7f19d009bc70 2023-10-03T10:15:26.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.353+0000 7f19cd7fa700 1 -- 172.21.15.146:0/3000723061 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f19bc0193c0 con 0x7f19d009bc70 2023-10-03T10:15:26.353 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:26.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.355+0000 7f19d6b06700 1 -- 172.21.15.146:0/3000723061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d009bc70 msgr2=0x7f19d0135690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.355+0000 7f19d6b06700 1 --2- 172.21.15.146:0/3000723061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d009bc70 0x7f19d0135690 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f19bc009130 tx=0x7f19bc004750 comp rx=0 tx=0).stop 2023-10-03T10:15:26.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.355+0000 7f19d6b06700 1 -- 172.21.15.146:0/3000723061 shutdown_connections 2023-10-03T10:15:26.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.355+0000 7f19d6b06700 1 --2- 172.21.15.146:0/3000723061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19d01314b0 0x7f19d0135bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.355+0000 7f19d6b06700 1 --2- 172.21.15.146:0/3000723061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19d0066410 0x7f19d0135150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.355+0000 7f19d6b06700 1 --2- 172.21.15.146:0/3000723061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d009bc70 0x7f19d0135690 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.355+0000 7f19d6b06700 1 -- 172.21.15.146:0/3000723061 >> 172.21.15.146:0/3000723061 conn(0x7f19d00a2980 msgr2=0x7f19d012f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.355+0000 7f19d6b06700 1 -- 172.21.15.146:0/3000723061 shutdown_connections 2023-10-03T10:15:26.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:26.355+0000 7f19d6b06700 1 -- 172.21.15.146:0/3000723061 wait complete. 2023-10-03T10:15:26.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:26.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:27.273 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:27.274 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:27.362 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:27.369 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:27.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.414+0000 7f50bbab0700 1 Processor -- start 2023-10-03T10:15:27.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.414+0000 7f50bbab0700 1 -- start start 2023-10-03T10:15:27.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.414+0000 7f6c17e1f700 1 Processor -- start 2023-10-03T10:15:27.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.414+0000 7f6c17e1f700 1 -- start start 2023-10-03T10:15:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.414+0000 7f50bbab0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50b4099a60 0x7f50b41388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.414+0000 7f50bbab0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50b4138e30 0x7f50b413b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.414+0000 7f50bbab0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b409aa00 con 0x7f50b4133b80 2023-10-03T10:15:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.414+0000 7f50bbab0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b409a080 con 0x7f50b4138e30 2023-10-03T10:15:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.414+0000 7f50bbab0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50b4133750 con 0x7f50b4099a60 2023-10-03T10:15:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.415+0000 7f50ba04d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50b4138e30 0x7f50b413b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.415+0000 7f50ba04d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50b4138e30 0x7f50b413b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34122/0 (socket says 172.21.15.146:34122) 2023-10-03T10:15:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.415+0000 7f50ba04d700 1 -- 172.21.15.146:0/278767334 learned_addr learned my addr 172.21.15.146:0/278767334 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:27.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.415+0000 7f50b984c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f50b4133b80 0x7f50b4133f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33250/0 (socket says 172.21.15.146:33250) 2023-10-03T10:15:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.415+0000 7f6c17e1f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c10133ad0 0x7f6c10133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.415+0000 7f6c17e1f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c101300a0 0x7f6c101304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.415+0000 7f6c17e1f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6c101309f0 0x7f6c1013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.415+0000 7f6c17e1f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1006b2d0 con 0x7f6c101309f0 2023-10-03T10:15:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.415+0000 7f6c17e1f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c10133610 con 0x7f6c101300a0 2023-10-03T10:15:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.415+0000 7f6c17e1f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1009a500 con 0x7f6c10133ad0 2023-10-03T10:15:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.415+0000 7f6c163bc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6c101309f0 0x7f6c1013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.415+0000 7f6c15bbb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c10133ad0 0x7f6c10133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.415+0000 7f6c163bc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6c101309f0 0x7f6c1013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40836/0 (socket says 172.21.15.146:40836) 2023-10-03T10:15:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.415+0000 7f6c15bbb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c10133ad0 0x7f6c10133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45062/0 (socket says 172.21.15.146:45062) 2023-10-03T10:15:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.415+0000 7f6c163bc700 1 -- 172.21.15.146:0/576693500 learned_addr learned my addr 172.21.15.146:0/576693500 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.415+0000 7f50b904b700 1 --2- 172.21.15.146:0/278767334 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50b4099a60 0x7f50b41388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.415+0000 7f50ba04d700 1 -- 172.21.15.146:0/278767334 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50b4099a60 msgr2=0x7f50b41388f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.415+0000 7f50ba04d700 1 --2- 172.21.15.146:0/278767334 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50b4099a60 0x7f50b41388f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.415+0000 7f50ba04d700 1 -- 172.21.15.146:0/278767334 >> v1:172.21.15.146:6789/0 conn(0x7f50b4133b80 legacy=0x7f50b4133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.415+0000 7f50ba04d700 1 -- 172.21.15.146:0/278767334 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b409a760 con 0x7f50b4138e30 2023-10-03T10:15:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.415+0000 7f6c153ba700 1 --2- 172.21.15.146:0/576693500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c101300a0 0x7f6c101304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.415+0000 7f6c163bc700 1 -- 172.21.15.146:0/576693500 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c10133ad0 msgr2=0x7f6c10133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.416+0000 7f6c163bc700 1 --2- 172.21.15.146:0/576693500 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c10133ad0 0x7f6c10133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.416+0000 7f6c163bc700 1 -- 172.21.15.146:0/576693500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c101300a0 msgr2=0x7f6c101304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.416+0000 7f6c163bc700 1 --2- 172.21.15.146:0/576693500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c101300a0 0x7f6c101304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.416+0000 7f6c163bc700 1 -- 172.21.15.146:0/576693500 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c101338b0 con 0x7f6c101309f0 2023-10-03T10:15:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.416+0000 7f6c163bc700 1 --2- 172.21.15.146:0/576693500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c101309f0 0x7f6c1013a980 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009e50 tx=0x7f6c0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a425f10cde96a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.416+0000 7f50ba04d700 1 --2- 172.21.15.146:0/278767334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50b4138e30 0x7f50b413b210 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f50ac009e80 tx=0x7f50ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ffcbbecf339f227 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.416+0000 7f6c14bb9700 1 -- 172.21.15.146:0/576693500 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800e070 con 0x7f6c101309f0 2023-10-03T10:15:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.416+0000 7f6c14bb9700 1 -- 172.21.15.146:0/576693500 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0800b910 con 0x7f6c101309f0 2023-10-03T10:15:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.416+0000 7f6c14bb9700 1 -- 172.21.15.146:0/576693500 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800bcc0 con 0x7f6c101309f0 2023-10-03T10:15:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.416+0000 7f50b884a700 1 -- 172.21.15.146:0/278767334 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac00e070 con 0x7f50b4138e30 2023-10-03T10:15:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.416+0000 7f50b884a700 1 -- 172.21.15.146:0/278767334 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ac00b910 con 0x7f50b4138e30 2023-10-03T10:15:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.416+0000 7f50b884a700 1 -- 172.21.15.146:0/278767334 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac00bcc0 con 0x7f50b4138e30 2023-10-03T10:15:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.417+0000 7f50bbab0700 1 -- 172.21.15.146:0/278767334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50b4138e30 msgr2=0x7f50b413b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.417+0000 7f50bbab0700 1 --2- 172.21.15.146:0/278767334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50b4138e30 0x7f50b413b210 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f50ac009e80 tx=0x7f50ac00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.417+0000 7f6c17e1f700 1 -- 172.21.15.146:0/576693500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c101309f0 msgr2=0x7f6c1013a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.417+0000 7f6c17e1f700 1 --2- 172.21.15.146:0/576693500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c101309f0 0x7f6c1013a980 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009e50 tx=0x7f6c0800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.417+0000 7f6c17e1f700 1 -- 172.21.15.146:0/576693500 shutdown_connections 2023-10-03T10:15:27.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.417+0000 7f6c17e1f700 1 --2- 172.21.15.146:0/576693500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c101309f0 0x7f6c1013a980 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.417+0000 7f6c17e1f700 1 --2- 172.21.15.146:0/576693500 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c10133ad0 0x7f6c10133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.417+0000 7f50bbab0700 1 -- 172.21.15.146:0/278767334 shutdown_connections 2023-10-03T10:15:27.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.417+0000 7f50bbab0700 1 --2- 172.21.15.146:0/278767334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50b4138e30 0x7f50b413b210 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.417+0000 7f50bbab0700 1 --2- 172.21.15.146:0/278767334 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50b4099a60 0x7f50b41388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.417+0000 7f50bbab0700 1 -- 172.21.15.146:0/278767334 >> 172.21.15.146:0/278767334 conn(0x7f50b40a2980 msgr2=0x7f50b40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.417+0000 7f6c17e1f700 1 --2- 172.21.15.146:0/576693500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c101300a0 0x7f6c101304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.417+0000 7f6c17e1f700 1 -- 172.21.15.146:0/576693500 >> 172.21.15.146:0/576693500 conn(0x7f6c10099c40 msgr2=0x7f6c100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.417+0000 7f50bbab0700 1 -- 172.21.15.146:0/278767334 shutdown_connections 2023-10-03T10:15:27.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.417+0000 7f6c17e1f700 1 -- 172.21.15.146:0/576693500 shutdown_connections 2023-10-03T10:15:27.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.417+0000 7f50bbab0700 1 -- 172.21.15.146:0/278767334 wait complete. 2023-10-03T10:15:27.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.417+0000 7f6c17e1f700 1 -- 172.21.15.146:0/576693500 wait complete. 2023-10-03T10:15:27.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.418+0000 7f50bbab0700 1 Processor -- start 2023-10-03T10:15:27.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.418+0000 7f50bbab0700 1 -- start start 2023-10-03T10:15:27.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f6c17e1f700 1 Processor -- start 2023-10-03T10:15:27.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f6c17e1f700 1 -- start start 2023-10-03T10:15:27.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f50bbab0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50b4099a60 0x7f50b4070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f50bbab0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50b4133b80 0x7f50b4070e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f50bbab0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50b4138e30 0x7f50b4071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f50bbab0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b4136b10 con 0x7f50b4138e30 2023-10-03T10:15:27.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f50bbab0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b4135e50 con 0x7f50b4099a60 2023-10-03T10:15:27.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f50bbab0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50b413b220 con 0x7f50b4133b80 2023-10-03T10:15:27.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f6c17e1f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c101300a0 0x7f6c10071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f6c17e1f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c101309f0 0x7f6c10071560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f6c17e1f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c10133ad0 0x7f6c10071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f6c17e1f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c100728a0 con 0x7f6c101309f0 2023-10-03T10:15:27.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f6c17e1f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1012dd00 con 0x7f6c101300a0 2023-10-03T10:15:27.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f6c17e1f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1006ea90 con 0x7f6c10133ad0 2023-10-03T10:15:27.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f50b984c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50b4099a60 0x7f50b4070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f50b984c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50b4099a60 0x7f50b4070900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34140/0 (socket says 172.21.15.146:34140) 2023-10-03T10:15:27.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f50b984c700 1 -- 172.21.15.146:0/3534856724 learned_addr learned my addr 172.21.15.146:0/3534856724 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:27.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f6c163bc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c10133ad0 0x7f6c10071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f6c163bc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c10133ad0 0x7f6c10071aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45088/0 (socket says 172.21.15.146:45088) 2023-10-03T10:15:27.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f6c163bc700 1 -- 172.21.15.146:0/2356336706 learned_addr learned my addr 172.21.15.146:0/2356336706 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:27.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f6c15bbb700 1 --2- 172.21.15.146:0/2356336706 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c101300a0 0x7f6c10071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.420+0000 7f6c15bbb700 1 -- 172.21.15.146:0/2356336706 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c10133ad0 msgr2=0x7f6c10071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.420+0000 7f6c15bbb700 1 --2- 172.21.15.146:0/2356336706 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c10133ad0 0x7f6c10071aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.420+0000 7f6c15bbb700 1 -- 172.21.15.146:0/2356336706 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c101309f0 msgr2=0x7f6c10071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.420+0000 7f6c15bbb700 1 --2- 172.21.15.146:0/2356336706 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c101309f0 0x7f6c10071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.420+0000 7f6c15bbb700 1 -- 172.21.15.146:0/2356336706 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c08009b30 con 0x7f6c101300a0 2023-10-03T10:15:27.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.420+0000 7f6c163bc700 1 --2- 172.21.15.146:0/2356336706 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c10133ad0 0x7f6c10071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:27.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f50b984c700 1 -- 172.21.15.146:0/3534856724 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50b4133b80 msgr2=0x7f50b4070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f50b984c700 1 --2- 172.21.15.146:0/3534856724 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50b4133b80 0x7f50b4070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f50b984c700 1 -- 172.21.15.146:0/3534856724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50b4138e30 msgr2=0x7f50b4071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f50b984c700 1 --2- 172.21.15.146:0/3534856724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50b4138e30 0x7f50b4071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.419+0000 7f50b984c700 1 -- 172.21.15.146:0/3534856724 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ac009b30 con 0x7f50b4099a60 2023-10-03T10:15:27.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.420+0000 7f50b984c700 1 --2- 172.21.15.146:0/3534856724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50b4099a60 0x7f50b4070900 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f50b000c530 tx=0x7f50b000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.420+0000 7f6c15bbb700 1 --2- 172.21.15.146:0/2356336706 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c101300a0 0x7f6c10071020 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00e7e0 tx=0x7f6c0c00eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.420+0000 7f50aa7fc700 1 -- 172.21.15.146:0/3534856724 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b00074e0 con 0x7f50b4099a60 2023-10-03T10:15:27.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.420+0000 7f50bbab0700 1 -- 172.21.15.146:0/3534856724 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b4135460 con 0x7f50b4099a60 2023-10-03T10:15:27.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.420+0000 7f50aa7fc700 1 -- 172.21.15.146:0/3534856724 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b0007640 con 0x7f50b4099a60 2023-10-03T10:15:27.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.420+0000 7f50aa7fc700 1 -- 172.21.15.146:0/3534856724 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0005a70 con 0x7f50b4099a60 2023-10-03T10:15:27.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.420+0000 7f50bbab0700 1 -- 172.21.15.146:0/3534856724 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b409a310 con 0x7f50b4099a60 2023-10-03T10:15:27.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.420+0000 7f6c067fc700 1 -- 172.21.15.146:0/2356336706 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c00c070 con 0x7f6c101300a0 2023-10-03T10:15:27.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.420+0000 7f6c067fc700 1 -- 172.21.15.146:0/2356336706 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c013610 con 0x7f6c101300a0 2023-10-03T10:15:27.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.420+0000 7f6c067fc700 1 -- 172.21.15.146:0/2356336706 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c0139a0 con 0x7f6c101300a0 2023-10-03T10:15:27.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.421+0000 7f6c17e1f700 1 -- 172.21.15.146:0/2356336706 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c10070160 con 0x7f6c101300a0 2023-10-03T10:15:27.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.421+0000 7f6c17e1f700 1 -- 172.21.15.146:0/2356336706 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c1012fbb0 con 0x7f6c101300a0 2023-10-03T10:15:27.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.422+0000 7f50bbab0700 1 -- 172.21.15.146:0/3534856724 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509c0052e0 con 0x7f50b4099a60 2023-10-03T10:15:27.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.422+0000 7f50aa7fc700 1 -- 172.21.15.146:0/3534856724 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50b0005bd0 con 0x7f50b4099a60 2023-10-03T10:15:27.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.422+0000 7f50aa7fc700 1 -- 172.21.15.146:0/3534856724 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f50b003ec10 con 0x7f50b4099a60 2023-10-03T10:15:27.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.422+0000 7f6c067fc700 1 -- 172.21.15.146:0/2356336706 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c0c013b00 con 0x7f6c101300a0 2023-10-03T10:15:27.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.422+0000 7f6c17e1f700 1 -- 172.21.15.146:0/2356336706 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1004f2a0 con 0x7f6c101300a0 2023-10-03T10:15:27.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.423+0000 7f6c067fc700 1 -- 172.21.15.146:0/2356336706 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6c0c03f4d0 con 0x7f6c101300a0 2023-10-03T10:15:27.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.427+0000 7f50aa7fc700 1 -- 172.21.15.146:0/3534856724 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50b000e280 con 0x7f50b4099a60 2023-10-03T10:15:27.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.431+0000 7f6c067fc700 1 -- 172.21.15.146:0/2356336706 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c0c010900 con 0x7f6c101300a0 2023-10-03T10:15:27.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.524+0000 7f6d8cdc5700 1 Processor -- start 2023-10-03T10:15:27.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.524+0000 7f6d8cdc5700 1 -- start start 2023-10-03T10:15:27.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.524+0000 7f6d8cdc5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d8809a130 0x7f6d8809e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.525+0000 7f6d8cdc5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d8809f1e0 0x7f6d8813fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.525+0000 7f6d8cdc5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d88072b30 con 0x7f6d8809edb0 2023-10-03T10:15:27.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.525+0000 7f6d8cdc5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d8809a500 con 0x7f6d8809f1e0 2023-10-03T10:15:27.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.525+0000 7f6d8cdc5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8809ada0 con 0x7f6d8809a130 2023-10-03T10:15:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.525+0000 7f6d8659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d8809a130 0x7f6d8809e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.525+0000 7f6d8659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d8809a130 0x7f6d8809e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34160/0 (socket says 172.21.15.146:34160) 2023-10-03T10:15:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.525+0000 7f6d8659c700 1 -- 172.21.15.146:0/1878694509 learned_addr learned my addr 172.21.15.146:0/1878694509 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.525+0000 7f6d85d9b700 1 --1- 172.21.15.146:0/1878694509 >> v1:172.21.15.146:6789/0 conn(0x7f6d8809edb0 0x7f6d8813c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33256/0 (socket says 172.21.15.146:33256) 2023-10-03T10:15:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.525+0000 7f6d86d9d700 1 --2- 172.21.15.146:0/1878694509 >> v2:172.21.15.146:3300/0 conn(0x7f6d8809f1e0 0x7f6d8813fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.525+0000 7f6d8659c700 1 -- 172.21.15.146:0/1878694509 >> v2:172.21.15.146:3300/0 conn(0x7f6d8809f1e0 msgr2=0x7f6d8813fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.525+0000 7f6d8659c700 1 --2- 172.21.15.146:0/1878694509 >> v2:172.21.15.146:3300/0 conn(0x7f6d8809f1e0 0x7f6d8813fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.525+0000 7f6d8659c700 1 -- 172.21.15.146:0/1878694509 >> v1:172.21.15.146:6789/0 conn(0x7f6d8809edb0 legacy=0x7f6d8813c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.525+0000 7f6d8659c700 1 -- 172.21.15.146:0/1878694509 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8809fe00 con 0x7f6d8809a130 2023-10-03T10:15:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.525+0000 7f6d8659c700 1 --2- 172.21.15.146:0/1878694509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d8809a130 0x7f6d8809e870 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6d780098f0 tx=0x7f6d78009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd59b1e1a1f7e757 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.525+0000 7f6d8559a700 1 -- 172.21.15.146:0/1878694509 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78011830 con 0x7f6d8809a130 2023-10-03T10:15:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.526+0000 7f6d8559a700 1 -- 172.21.15.146:0/1878694509 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d78011990 con 0x7f6d8809a130 2023-10-03T10:15:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.526+0000 7f6d8559a700 1 -- 172.21.15.146:0/1878694509 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78011d20 con 0x7f6d8809a130 2023-10-03T10:15:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.526+0000 7f6d8cdc5700 1 -- 172.21.15.146:0/1878694509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d8809a130 msgr2=0x7f6d8809e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.526+0000 7f6d8cdc5700 1 --2- 172.21.15.146:0/1878694509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d8809a130 0x7f6d8809e870 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6d780098f0 tx=0x7f6d78009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.526+0000 7f6d8cdc5700 1 -- 172.21.15.146:0/1878694509 shutdown_connections 2023-10-03T10:15:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.526+0000 7f6d8cdc5700 1 --2- 172.21.15.146:0/1878694509 >> v2:172.21.15.146:3300/0 conn(0x7f6d8809f1e0 0x7f6d8813fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.526+0000 7f6d8cdc5700 1 --2- 172.21.15.146:0/1878694509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d8809a130 0x7f6d8809e870 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.526+0000 7f6d8cdc5700 1 -- 172.21.15.146:0/1878694509 >> 172.21.15.146:0/1878694509 conn(0x7f6d880a4430 msgr2=0x7f6d880a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.527+0000 7f6d8cdc5700 1 -- 172.21.15.146:0/1878694509 shutdown_connections 2023-10-03T10:15:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.527+0000 7f6d8cdc5700 1 -- 172.21.15.146:0/1878694509 wait complete. 2023-10-03T10:15:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.528+0000 7f6d8cdc5700 1 Processor -- start 2023-10-03T10:15:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.528+0000 7f6d8cdc5700 1 -- start start 2023-10-03T10:15:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.528+0000 7f6d8cdc5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d8809a130 0x7f6d8812f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.528+0000 7f6d8cdc5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d8809edb0 0x7f6d8812de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.528+0000 7f6d8cdc5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d8809f1e0 0x7f6d8812e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.528+0000 7f6d8cdc5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d880a2f90 con 0x7f6d8809f1e0 2023-10-03T10:15:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.528+0000 7f6d8cdc5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8811bd80 con 0x7f6d8809a130 2023-10-03T10:15:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.528+0000 7f6d8cdc5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8811e0a0 con 0x7f6d8809edb0 2023-10-03T10:15:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.528+0000 7f6d85d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d8809edb0 0x7f6d8812de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.528+0000 7f6d85d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d8809edb0 0x7f6d8812de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45098/0 (socket says 172.21.15.146:45098) 2023-10-03T10:15:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.528+0000 7f6d85d9b700 1 -- 172.21.15.146:0/1077055022 learned_addr learned my addr 172.21.15.146:0/1077055022 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:27.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.528+0000 7f6d86d9d700 1 --2- 172.21.15.146:0/1077055022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d8809f1e0 0x7f6d8812e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.528+0000 7f6d8659c700 1 --2- 172.21.15.146:0/1077055022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d8809a130 0x7f6d8812f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.529+0000 7f6d86d9d700 1 -- 172.21.15.146:0/1077055022 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d8809edb0 msgr2=0x7f6d8812de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.529+0000 7f6d86d9d700 1 --2- 172.21.15.146:0/1077055022 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d8809edb0 0x7f6d8812de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.529+0000 7f6d86d9d700 1 -- 172.21.15.146:0/1077055022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d8809a130 msgr2=0x7f6d8812f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.529+0000 7f6d86d9d700 1 --2- 172.21.15.146:0/1077055022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d8809a130 0x7f6d8812f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.529+0000 7f6d86d9d700 1 -- 172.21.15.146:0/1077055022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d78009550 con 0x7f6d8809f1e0 2023-10-03T10:15:27.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.529+0000 7f6d86d9d700 1 --2- 172.21.15.146:0/1077055022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d8809f1e0 0x7f6d8812e3a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000efc0 tx=0x7f6d8000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.529+0000 7f6d76ffd700 1 -- 172.21.15.146:0/1077055022 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8000cc90 con 0x7f6d8809f1e0 2023-10-03T10:15:27.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.529+0000 7f6d76ffd700 1 -- 172.21.15.146:0/1077055022 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8000f040 con 0x7f6d8809f1e0 2023-10-03T10:15:27.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.529+0000 7f6d8cdc5700 1 -- 172.21.15.146:0/1077055022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d8811c5a0 con 0x7f6d8809f1e0 2023-10-03T10:15:27.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.529+0000 7f6d76ffd700 1 -- 172.21.15.146:0/1077055022 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80009e60 con 0x7f6d8809f1e0 2023-10-03T10:15:27.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.529+0000 7f6d8cdc5700 1 -- 172.21.15.146:0/1077055022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d88133550 con 0x7f6d8809f1e0 2023-10-03T10:15:27.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.530+0000 7f6d76ffd700 1 -- 172.21.15.146:0/1077055022 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6d80014480 con 0x7f6d8809f1e0 2023-10-03T10:15:27.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.530+0000 7f6d76ffd700 1 -- 172.21.15.146:0/1077055022 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6d80040230 con 0x7f6d8809f1e0 2023-10-03T10:15:27.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.530+0000 7f6d8cdc5700 1 -- 172.21.15.146:0/1077055022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d8811ccf0 con 0x7f6d8809f1e0 2023-10-03T10:15:27.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.535+0000 7f6d76ffd700 1 -- 172.21.15.146:0/1077055022 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d80007920 con 0x7f6d8809f1e0 2023-10-03T10:15:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.545+0000 7fdc5c3b4700 1 Processor -- start 2023-10-03T10:15:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.545+0000 7fdc5c3b4700 1 -- start start 2023-10-03T10:15:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.546+0000 7fdc5c3b4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc540a0a70 0x7fdc540a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.546+0000 7fdc5c3b4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdc540a1380 0x7fdc54133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.546+0000 7fdc5c3b4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc54133f50 0x7fdc54134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.546+0000 7fdc5c3b4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc5409e9d0 con 0x7fdc540a1380 2023-10-03T10:15:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.546+0000 7fdc5c3b4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5409dc00 con 0x7fdc54133f50 2023-10-03T10:15:27.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.546+0000 7fdc5c3b4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5409dec0 con 0x7fdc540a0a70 2023-10-03T10:15:27.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.546+0000 7fdc5994f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdc540a1380 0x7fdc54133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.547+0000 7fdc5a951700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc54133f50 0x7fdc54134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.547+0000 7fdc5a150700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc540a0a70 0x7fdc540a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.547+0000 7fdc5994f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdc540a1380 0x7fdc54133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40872/0 (socket says 172.21.15.146:40872) 2023-10-03T10:15:27.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.547+0000 7fdc5994f700 1 -- 172.21.15.146:0/406808763 learned_addr learned my addr 172.21.15.146:0/406808763 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:27.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.547+0000 7fdc5994f700 1 -- 172.21.15.146:0/406808763 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc540a0a70 msgr2=0x7fdc540a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:27.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.547+0000 7fdc5994f700 1 --2- 172.21.15.146:0/406808763 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc540a0a70 0x7fdc540a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.547+0000 7fdc5994f700 1 -- 172.21.15.146:0/406808763 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc54133f50 msgr2=0x7fdc54134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:27.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.547+0000 7fdc5994f700 1 --2- 172.21.15.146:0/406808763 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc54133f50 0x7fdc54134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.547+0000 7fdc5994f700 1 -- 172.21.15.146:0/406808763 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5409e6a0 con 0x7fdc540a1380 2023-10-03T10:15:27.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.547+0000 7fdc5a951700 1 --2- 172.21.15.146:0/406808763 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc54133f50 0x7fdc54134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:27.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.547+0000 7fdc5994f700 1 --2- 172.21.15.146:0/406808763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc540a1380 0x7fdc54133a10 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fdc440098f0 tx=0x7fdc44009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545388a99f159a97 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.547+0000 7fdc5914e700 1 -- 172.21.15.146:0/406808763 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc44014e90 con 0x7fdc540a1380 2023-10-03T10:15:27.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.547+0000 7fdc5914e700 1 -- 172.21.15.146:0/406808763 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4401c440 con 0x7fdc540a1380 2023-10-03T10:15:27.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.547+0000 7fdc5914e700 1 -- 172.21.15.146:0/406808763 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4401c7d0 con 0x7fdc540a1380 2023-10-03T10:15:27.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.548+0000 7fdc5c3b4700 1 -- 172.21.15.146:0/406808763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc540a1380 msgr2=0x7fdc54133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.548+0000 7fdc5c3b4700 1 --2- 172.21.15.146:0/406808763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc540a1380 0x7fdc54133a10 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fdc440098f0 tx=0x7fdc44009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:27.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.548+0000 7fdc5c3b4700 1 -- 172.21.15.146:0/406808763 shutdown_connections 2023-10-03T10:15:27.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.548+0000 7fdc5c3b4700 1 --2- 172.21.15.146:0/406808763 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc54133f50 0x7fdc54134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.548+0000 7fdc5c3b4700 1 --2- 172.21.15.146:0/406808763 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc540a0a70 0x7fdc540a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.548+0000 7fdc5c3b4700 1 --2- 172.21.15.146:0/406808763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc540a1380 0x7fdc54133a10 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.548+0000 7fdc5c3b4700 1 -- 172.21.15.146:0/406808763 >> 172.21.15.146:0/406808763 conn(0x7fdc540a6610 msgr2=0x7fdc540a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.548+0000 7fdc5c3b4700 1 -- 172.21.15.146:0/406808763 shutdown_connections 2023-10-03T10:15:27.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.548+0000 7fdc5c3b4700 1 -- 172.21.15.146:0/406808763 wait complete. 2023-10-03T10:15:27.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.549+0000 7fdc5c3b4700 1 Processor -- start 2023-10-03T10:15:27.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.549+0000 7fdc5c3b4700 1 -- start start 2023-10-03T10:15:27.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.550+0000 7fdc5c3b4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc540a0a70 0x7fdc541c0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.550+0000 7fdc5c3b4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc540a1380 0x7fdc541c1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.550+0000 7fdc5c3b4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc54133f50 0x7fdc541c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.550+0000 7fdc5c3b4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc54121390 con 0x7fdc540a1380 2023-10-03T10:15:27.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.550+0000 7fdc5c3b4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc541204e0 con 0x7fdc54133f50 2023-10-03T10:15:27.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.550+0000 7fdc5c3b4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc541c1870 con 0x7fdc540a0a70 2023-10-03T10:15:27.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.550+0000 7fdc5a150700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc540a0a70 0x7fdc541c0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.550+0000 7fdc5a150700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc540a0a70 0x7fdc541c0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45112/0 (socket says 172.21.15.146:45112) 2023-10-03T10:15:27.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.550+0000 7fdc5a150700 1 -- 172.21.15.146:0/1894777854 learned_addr learned my addr 172.21.15.146:0/1894777854 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:27.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.550+0000 7fdc5a951700 1 --2- 172.21.15.146:0/1894777854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc54133f50 0x7fdc541c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.550+0000 7fdc5994f700 1 --2- 172.21.15.146:0/1894777854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc540a1380 0x7fdc541c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.550+0000 7fdc5a951700 1 -- 172.21.15.146:0/1894777854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc540a0a70 msgr2=0x7fdc541c0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.550+0000 7fdc5a951700 1 --2- 172.21.15.146:0/1894777854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc540a0a70 0x7fdc541c0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.550+0000 7fdc5a951700 1 -- 172.21.15.146:0/1894777854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc540a1380 msgr2=0x7fdc541c1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.550+0000 7fdc5a951700 1 --2- 172.21.15.146:0/1894777854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc540a1380 0x7fdc541c1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.550+0000 7fdc5a951700 1 -- 172.21.15.146:0/1894777854 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c009a70 con 0x7fdc54133f50 2023-10-03T10:15:27.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.550+0000 7fdc5994f700 1 --2- 172.21.15.146:0/1894777854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc540a1380 0x7fdc541c1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:27.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.550+0000 7fdc5a951700 1 --2- 172.21.15.146:0/1894777854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc54133f50 0x7fdc541c3e10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00efc0 tx=0x7fdc4c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.550+0000 7fdc4affd700 1 -- 172.21.15.146:0/1894777854 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c00cb40 con 0x7fdc54133f50 2023-10-03T10:15:27.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.551+0000 7fdc4affd700 1 -- 172.21.15.146:0/1894777854 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c00f040 con 0x7fdc54133f50 2023-10-03T10:15:27.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.551+0000 7fdc5c3b4700 1 -- 172.21.15.146:0/1894777854 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc44009550 con 0x7fdc54133f50 2023-10-03T10:15:27.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.551+0000 7fdc4affd700 1 -- 172.21.15.146:0/1894777854 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c003a20 con 0x7fdc54133f50 2023-10-03T10:15:27.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.551+0000 7fdc5c3b4700 1 -- 172.21.15.146:0/1894777854 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5411fc60 con 0x7fdc54133f50 2023-10-03T10:15:27.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.552+0000 7fdc4affd700 1 -- 172.21.15.146:0/1894777854 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc4c014480 con 0x7fdc54133f50 2023-10-03T10:15:27.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.552+0000 7fdc4affd700 1 -- 172.21.15.146:0/1894777854 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdc4c03ffa0 con 0x7fdc54133f50 2023-10-03T10:15:27.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.552+0000 7fdc5c3b4700 1 -- 172.21.15.146:0/1894777854 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc5404f2a0 con 0x7fdc54133f50 2023-10-03T10:15:27.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.558+0000 7fdc4affd700 1 -- 172.21.15.146:0/1894777854 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc4c012910 con 0x7fdc54133f50 2023-10-03T10:15:27.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.636+0000 7f50bbab0700 1 -- 172.21.15.146:0/3534856724 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f509c005150 con 0x7f50b4099a60 2023-10-03T10:15:27.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.637+0000 7f50aa7fc700 1 -- 172.21.15.146:0/3534856724 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f50b0017030 con 0x7f50b4099a60 2023-10-03T10:15:27.637 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:27.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.639+0000 7f50bbab0700 1 -- 172.21.15.146:0/3534856724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50b4099a60 msgr2=0x7f50b4070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.639+0000 7f50bbab0700 1 --2- 172.21.15.146:0/3534856724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50b4099a60 0x7f50b4070900 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f50b000c530 tx=0x7f50b000c8f0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.639+0000 7f50bbab0700 1 -- 172.21.15.146:0/3534856724 shutdown_connections 2023-10-03T10:15:27.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.639+0000 7f50bbab0700 1 --2- 172.21.15.146:0/3534856724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50b4138e30 0x7f50b4071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.639+0000 7f50bbab0700 1 --2- 172.21.15.146:0/3534856724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50b4099a60 0x7f50b4070900 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.639+0000 7f50bbab0700 1 --2- 172.21.15.146:0/3534856724 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50b4133b80 0x7f50b4070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.639+0000 7f50bbab0700 1 -- 172.21.15.146:0/3534856724 >> 172.21.15.146:0/3534856724 conn(0x7f50b40a2980 msgr2=0x7f50b413aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.639+0000 7f50bbab0700 1 -- 172.21.15.146:0/3534856724 shutdown_connections 2023-10-03T10:15:27.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.639+0000 7f50bbab0700 1 -- 172.21.15.146:0/3534856724 wait complete. 2023-10-03T10:15:27.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:27.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.677+0000 7f6c17e1f700 1 -- 172.21.15.146:0/2356336706 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6c1006c3b0 con 0x7f6c101300a0 2023-10-03T10:15:27.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.677+0000 7f6c067fc700 1 -- 172.21.15.146:0/2356336706 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c0c010310 con 0x7f6c101300a0 2023-10-03T10:15:27.678 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:27.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.680+0000 7f6c17e1f700 1 -- 172.21.15.146:0/2356336706 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c101300a0 msgr2=0x7f6c10071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.680+0000 7f6c17e1f700 1 --2- 172.21.15.146:0/2356336706 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c101300a0 0x7f6c10071020 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00e7e0 tx=0x7f6c0c00eaf0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.680+0000 7f6c17e1f700 1 -- 172.21.15.146:0/2356336706 shutdown_connections 2023-10-03T10:15:27.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.680+0000 7f6c17e1f700 1 --2- 172.21.15.146:0/2356336706 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c10133ad0 0x7f6c10071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.680+0000 7f6c17e1f700 1 --2- 172.21.15.146:0/2356336706 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c101300a0 0x7f6c10071020 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.680+0000 7f6c17e1f700 1 --2- 172.21.15.146:0/2356336706 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c101309f0 0x7f6c10071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.680+0000 7f6c17e1f700 1 -- 172.21.15.146:0/2356336706 >> 172.21.15.146:0/2356336706 conn(0x7f6c10099c40 msgr2=0x7f6c100a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.680+0000 7f6c17e1f700 1 -- 172.21.15.146:0/2356336706 shutdown_connections 2023-10-03T10:15:27.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.680+0000 7f6c17e1f700 1 -- 172.21.15.146:0/2356336706 wait complete. 2023-10-03T10:15:27.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:27.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.753+0000 7f6d8cdc5700 1 -- 172.21.15.146:0/1077055022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6d8804f2a0 con 0x7f6d8809f1e0 2023-10-03T10:15:27.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.754+0000 7f6d76ffd700 1 -- 172.21.15.146:0/1077055022 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6d8002a020 con 0x7f6d8809f1e0 2023-10-03T10:15:27.754 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:27.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.755+0000 7f6d8cdc5700 1 -- 172.21.15.146:0/1077055022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d8809f1e0 msgr2=0x7f6d8812e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.755+0000 7f6d8cdc5700 1 --2- 172.21.15.146:0/1077055022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d8809f1e0 0x7f6d8812e3a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000efc0 tx=0x7f6d8000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.755+0000 7f6d8cdc5700 1 -- 172.21.15.146:0/1077055022 shutdown_connections 2023-10-03T10:15:27.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.755+0000 7f6d8cdc5700 1 --2- 172.21.15.146:0/1077055022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d8809f1e0 0x7f6d8812e3a0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.755+0000 7f6d8cdc5700 1 --2- 172.21.15.146:0/1077055022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d8809a130 0x7f6d8812f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.755+0000 7f6d8cdc5700 1 --2- 172.21.15.146:0/1077055022 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d8809edb0 0x7f6d8812de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.755+0000 7f6d8cdc5700 1 -- 172.21.15.146:0/1077055022 >> 172.21.15.146:0/1077055022 conn(0x7f6d880a4430 msgr2=0x7f6d880a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.756+0000 7f6d8cdc5700 1 -- 172.21.15.146:0/1077055022 shutdown_connections 2023-10-03T10:15:27.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.756+0000 7f6d8cdc5700 1 -- 172.21.15.146:0/1077055022 wait complete. 2023-10-03T10:15:27.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:27.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.782+0000 7fdc5c3b4700 1 -- 172.21.15.146:0/1894777854 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdc54072980 con 0x7fdc54133f50 2023-10-03T10:15:27.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.783+0000 7fdc4affd700 1 -- 172.21.15.146:0/1894777854 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdc4c012340 con 0x7fdc54133f50 2023-10-03T10:15:27.784 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:27.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.785+0000 7fdc5c3b4700 1 -- 172.21.15.146:0/1894777854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc54133f50 msgr2=0x7fdc541c3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.785+0000 7fdc5c3b4700 1 --2- 172.21.15.146:0/1894777854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc54133f50 0x7fdc541c3e10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00efc0 tx=0x7fdc4c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.785+0000 7fdc5c3b4700 1 -- 172.21.15.146:0/1894777854 shutdown_connections 2023-10-03T10:15:27.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.785+0000 7fdc5c3b4700 1 --2- 172.21.15.146:0/1894777854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc54133f50 0x7fdc541c3e10 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.785+0000 7fdc5c3b4700 1 --2- 172.21.15.146:0/1894777854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdc540a0a70 0x7fdc541c0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.785+0000 7fdc5c3b4700 1 --2- 172.21.15.146:0/1894777854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc540a1380 0x7fdc541c1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.785+0000 7fdc5c3b4700 1 -- 172.21.15.146:0/1894777854 >> 172.21.15.146:0/1894777854 conn(0x7fdc540a6610 msgr2=0x7fdc5409b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.785+0000 7fdc5c3b4700 1 -- 172.21.15.146:0/1894777854 shutdown_connections 2023-10-03T10:15:27.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:27.785+0000 7fdc5c3b4700 1 -- 172.21.15.146:0/1894777854 wait complete. 2023-10-03T10:15:27.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:28.657 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:28.698 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:28.769 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:28.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.786+0000 7f06ed10b700 1 Processor -- start 2023-10-03T10:15:28.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.787+0000 7f06ed10b700 1 -- start start 2023-10-03T10:15:28.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.787+0000 7f06ed10b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06e8133660 0x7f06e8135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.787+0000 7f06ed10b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f06e8135f80 0x7f06e8138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.787+0000 7f06ed10b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e8099a60 con 0x7f06e8099e20 2023-10-03T10:15:28.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.787+0000 7f06ed10b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e809bf50 con 0x7f06e8135f80 2023-10-03T10:15:28.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.787+0000 7f06ed10b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06e809b230 con 0x7f06e8133660 2023-10-03T10:15:28.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.787+0000 7f06e759e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f06e8135f80 0x7f06e8138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.787+0000 7f06e6d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f06e8099e20 0x7f06e809a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33264/0 (socket says 172.21.15.146:33264) 2023-10-03T10:15:28.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.787+0000 7f06e6d9d700 1 -- 172.21.15.146:0/4115602113 learned_addr learned my addr 172.21.15.146:0/4115602113 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:28.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.787+0000 7f06e659c700 1 --2- 172.21.15.146:0/4115602113 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06e8133660 0x7f06e8135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.787+0000 7f06e5d9b700 1 -- 172.21.15.146:0/4115602113 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 888737304 0 0) 0x7f06e8099a60 con 0x7f06e8099e20 2023-10-03T10:15:28.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.788+0000 7f06e5d9b700 1 -- 172.21.15.146:0/4115602113 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06d00035b0 con 0x7f06e8099e20 2023-10-03T10:15:28.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.788+0000 7f06e759e700 1 -- 172.21.15.146:0/4115602113 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06e8133660 msgr2=0x7f06e8135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.788+0000 7f06e759e700 1 --2- 172.21.15.146:0/4115602113 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06e8133660 0x7f06e8135a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.788+0000 7f06e759e700 1 -- 172.21.15.146:0/4115602113 >> v1:172.21.15.146:6789/0 conn(0x7f06e8099e20 legacy=0x7f06e809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.788+0000 7f06e759e700 1 -- 172.21.15.146:0/4115602113 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e809bb90 con 0x7f06e8135f80 2023-10-03T10:15:28.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.788+0000 7f06e759e700 1 --2- 172.21.15.146:0/4115602113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e8135f80 0x7f06e8138360 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009d90 tx=0x7f06e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79d47144ed97715 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.788+0000 7f06e5d9b700 1 -- 172.21.15.146:0/4115602113 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e000e070 con 0x7f06e8135f80 2023-10-03T10:15:28.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.788+0000 7f06e5d9b700 1 -- 172.21.15.146:0/4115602113 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e000bae0 con 0x7f06e8135f80 2023-10-03T10:15:28.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.788+0000 7f06e5d9b700 1 -- 172.21.15.146:0/4115602113 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e000be90 con 0x7f06e8135f80 2023-10-03T10:15:28.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.789+0000 7f06ed10b700 1 -- 172.21.15.146:0/4115602113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e8135f80 msgr2=0x7f06e8138360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.789+0000 7f06ed10b700 1 --2- 172.21.15.146:0/4115602113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e8135f80 0x7f06e8138360 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009d90 tx=0x7f06e000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:28.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.789+0000 7f06ed10b700 1 -- 172.21.15.146:0/4115602113 shutdown_connections 2023-10-03T10:15:28.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.789+0000 7f06ed10b700 1 --2- 172.21.15.146:0/4115602113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e8135f80 0x7f06e8138360 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.789+0000 7f06ed10b700 1 --2- 172.21.15.146:0/4115602113 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06e8133660 0x7f06e8135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.789+0000 7f06ed10b700 1 -- 172.21.15.146:0/4115602113 >> 172.21.15.146:0/4115602113 conn(0x7f06e80a2980 msgr2=0x7f06e80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.789+0000 7f06ed10b700 1 -- 172.21.15.146:0/4115602113 shutdown_connections 2023-10-03T10:15:28.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.789+0000 7f06ed10b700 1 -- 172.21.15.146:0/4115602113 wait complete. 2023-10-03T10:15:28.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.790+0000 7f06ed10b700 1 Processor -- start 2023-10-03T10:15:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.790+0000 7f06ed10b700 1 -- start start 2023-10-03T10:15:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.791+0000 7f06ed10b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e8099e20 0x7f06e81388a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.791+0000 7f06ed10b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06e8133660 0x7f06e8138de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.791+0000 7f06ed10b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06e8135f80 0x7f06e8139320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.791+0000 7f06ed10b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e8138370 con 0x7f06e8099e20 2023-10-03T10:15:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.791+0000 7f06ed10b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e809b470 con 0x7f06e8133660 2023-10-03T10:15:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.791+0000 7f06ed10b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06e809fa10 con 0x7f06e8135f80 2023-10-03T10:15:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.791+0000 7f06e6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e8099e20 0x7f06e81388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.791+0000 7f06e759e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06e8135f80 0x7f06e8139320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.791+0000 7f06e6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e8099e20 0x7f06e81388a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40896/0 (socket says 172.21.15.146:40896) 2023-10-03T10:15:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.791+0000 7f06e759e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06e8135f80 0x7f06e8139320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45140/0 (socket says 172.21.15.146:45140) 2023-10-03T10:15:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.791+0000 7f06e6d9d700 1 -- 172.21.15.146:0/3430612131 learned_addr learned my addr 172.21.15.146:0/3430612131 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.791+0000 7f06e659c700 1 --2- 172.21.15.146:0/3430612131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06e8133660 0x7f06e8138de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.791+0000 7f06e659c700 1 -- 172.21.15.146:0/3430612131 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06e8135f80 msgr2=0x7f06e8139320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.791+0000 7f06e659c700 1 --2- 172.21.15.146:0/3430612131 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06e8135f80 0x7f06e8139320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.791+0000 7f06e659c700 1 -- 172.21.15.146:0/3430612131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e8099e20 msgr2=0x7f06e81388a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.791+0000 7f06e659c700 1 --2- 172.21.15.146:0/3430612131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e8099e20 0x7f06e81388a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.791+0000 7f06e659c700 1 -- 172.21.15.146:0/3430612131 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e0009a70 con 0x7f06e8133660 2023-10-03T10:15:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.791+0000 7f06e759e700 1 --2- 172.21.15.146:0/3430612131 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06e8135f80 0x7f06e8139320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.791+0000 7f06e6d9d700 1 --2- 172.21.15.146:0/3430612131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e8099e20 0x7f06e81388a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.791+0000 7f06e659c700 1 --2- 172.21.15.146:0/3430612131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06e8133660 0x7f06e8138de0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00e930 tx=0x7f06dc00ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.791+0000 7f06cf7fe700 1 -- 172.21.15.146:0/3430612131 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc013680 con 0x7f06e8133660 2023-10-03T10:15:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.792+0000 7f06cf7fe700 1 -- 172.21.15.146:0/3430612131 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc0137e0 con 0x7f06e8133660 2023-10-03T10:15:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.792+0000 7f06cf7fe700 1 -- 172.21.15.146:0/3430612131 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc013b50 con 0x7f06e8133660 2023-10-03T10:15:28.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.792+0000 7f06ed10b700 1 -- 172.21.15.146:0/3430612131 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e813a190 con 0x7f06e8133660 2023-10-03T10:15:28.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.792+0000 7f06ed10b700 1 -- 172.21.15.146:0/3430612131 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e8139c80 con 0x7f06e8133660 2023-10-03T10:15:28.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.792+0000 7f06cf7fe700 1 -- 172.21.15.146:0/3430612131 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f06dc013cb0 con 0x7f06e8133660 2023-10-03T10:15:28.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.793+0000 7f06cf7fe700 1 -- 172.21.15.146:0/3430612131 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f06dc03f620 con 0x7f06e8133660 2023-10-03T10:15:28.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.793+0000 7f06ed10b700 1 -- 172.21.15.146:0/3430612131 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e8072480 con 0x7f06e8133660 2023-10-03T10:15:28.798 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:28.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.798+0000 7f06cf7fe700 1 -- 172.21.15.146:0/3430612131 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f06e8072480 con 0x7f06e8133660 2023-10-03T10:15:28.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.831+0000 7ff1348e1700 1 Processor -- start 2023-10-03T10:15:28.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.831+0000 7ff1348e1700 1 -- start start 2023-10-03T10:15:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.832+0000 7ff1348e1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff130131980 0x7ff130131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.832+0000 7ff1348e1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff13009bc70 0x7ff13009c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.832+0000 7ff1348e1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1300a1640 con 0x7ff13009c5c0 2023-10-03T10:15:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.832+0000 7ff1348e1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13006eb30 con 0x7ff13009bc70 2023-10-03T10:15:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.832+0000 7ff1348e1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1300a22d0 con 0x7ff130131980 2023-10-03T10:15:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.832+0000 7ff12dd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff13009bc70 0x7ff13009c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.832+0000 7ff12dd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff13009bc70 0x7ff13009c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40906/0 (socket says 172.21.15.146:40906) 2023-10-03T10:15:28.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.832+0000 7ff12dd9b700 1 -- 172.21.15.146:0/2623578466 learned_addr learned my addr 172.21.15.146:0/2623578466 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:28.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.832+0000 7ff12ed9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff13009c5c0 0x7ff130138700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33266/0 (socket says 172.21.15.146:33266) 2023-10-03T10:15:28.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.832+0000 7ff12e59c700 1 --2- 172.21.15.146:0/2623578466 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff130131980 0x7ff130131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.832+0000 7ff12dd9b700 1 -- 172.21.15.146:0/2623578466 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff130131980 msgr2=0x7ff130131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.832+0000 7ff12dd9b700 1 --2- 172.21.15.146:0/2623578466 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff130131980 0x7ff130131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.832+0000 7ff12dd9b700 1 -- 172.21.15.146:0/2623578466 >> v1:172.21.15.146:6789/0 conn(0x7ff13009c5c0 legacy=0x7ff130138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.832+0000 7ff12dd9b700 1 -- 172.21.15.146:0/2623578466 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff130131550 con 0x7ff13009bc70 2023-10-03T10:15:28.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.833+0000 7ff12dd9b700 1 --2- 172.21.15.146:0/2623578466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13009bc70 0x7ff13009c080 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7ff1240098f0 tx=0x7ff124009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5436e5a16f61622a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.833+0000 7ff12d59a700 1 -- 172.21.15.146:0/2623578466 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12400b8a0 con 0x7ff13009bc70 2023-10-03T10:15:28.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.833+0000 7ff12d59a700 1 -- 172.21.15.146:0/2623578466 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12400ba00 con 0x7ff13009bc70 2023-10-03T10:15:28.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.833+0000 7ff12d59a700 1 -- 172.21.15.146:0/2623578466 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12400bd90 con 0x7ff13009bc70 2023-10-03T10:15:28.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.833+0000 7ff1348e1700 1 -- 172.21.15.146:0/2623578466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13009bc70 msgr2=0x7ff13009c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.834+0000 7ff1348e1700 1 --2- 172.21.15.146:0/2623578466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13009bc70 0x7ff13009c080 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7ff1240098f0 tx=0x7ff124009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:28.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.834+0000 7ff1348e1700 1 -- 172.21.15.146:0/2623578466 shutdown_connections 2023-10-03T10:15:28.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.834+0000 7ff1348e1700 1 --2- 172.21.15.146:0/2623578466 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff130131980 0x7ff130131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.834+0000 7ff1348e1700 1 --2- 172.21.15.146:0/2623578466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13009bc70 0x7ff13009c080 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.834+0000 7ff1348e1700 1 -- 172.21.15.146:0/2623578466 >> 172.21.15.146:0/2623578466 conn(0x7ff1300a2980 msgr2=0x7ff1300a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.834+0000 7ff1348e1700 1 -- 172.21.15.146:0/2623578466 shutdown_connections 2023-10-03T10:15:28.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.834+0000 7ff1348e1700 1 -- 172.21.15.146:0/2623578466 wait complete. 2023-10-03T10:15:28.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.835+0000 7ff1348e1700 1 Processor -- start 2023-10-03T10:15:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.835+0000 7ff1348e1700 1 -- start start 2023-10-03T10:15:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.835+0000 7ff1348e1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13009bc70 0x7ff130121630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.835+0000 7ff1348e1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff13009c5c0 0x7ff13011ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.835+0000 7ff1348e1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff130131980 0x7ff130120500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.835+0000 7ff1348e1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13011df90 con 0x7ff13009bc70 2023-10-03T10:15:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.835+0000 7ff1348e1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13011f3e0 con 0x7ff130131980 2023-10-03T10:15:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.835+0000 7ff1348e1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff130130e10 con 0x7ff13009c5c0 2023-10-03T10:15:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.835+0000 7ff12e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13009bc70 0x7ff130121630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.835+0000 7ff12e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13009bc70 0x7ff130121630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40920/0 (socket says 172.21.15.146:40920) 2023-10-03T10:15:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.835+0000 7ff12e59c700 1 -- 172.21.15.146:0/2278562729 learned_addr learned my addr 172.21.15.146:0/2278562729 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.836+0000 7ff12dd9b700 1 --2- 172.21.15.146:0/2278562729 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff13009c5c0 0x7ff13011ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.836+0000 7ff12ed9d700 1 --2- 172.21.15.146:0/2278562729 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff130131980 0x7ff130120500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.836+0000 7ff12e59c700 1 -- 172.21.15.146:0/2278562729 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff13009c5c0 msgr2=0x7ff13011ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.836+0000 7ff12e59c700 1 --2- 172.21.15.146:0/2278562729 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff13009c5c0 0x7ff13011ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.836+0000 7ff12e59c700 1 -- 172.21.15.146:0/2278562729 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff130131980 msgr2=0x7ff130120500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.836+0000 7ff12e59c700 1 --2- 172.21.15.146:0/2278562729 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff130131980 0x7ff130120500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.836+0000 7ff12e59c700 1 -- 172.21.15.146:0/2278562729 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff124009550 con 0x7ff13009bc70 2023-10-03T10:15:28.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.836+0000 7ff12e59c700 1 --2- 172.21.15.146:0/2278562729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13009bc70 0x7ff130121630 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff12000e730 tx=0x7ff12000ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.836+0000 7ff11effd700 1 -- 172.21.15.146:0/2278562729 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12000c070 con 0x7ff13009bc70 2023-10-03T10:15:28.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.836+0000 7ff11effd700 1 -- 172.21.15.146:0/2278562729 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff120005a20 con 0x7ff13009bc70 2023-10-03T10:15:28.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.836+0000 7ff1348e1700 1 -- 172.21.15.146:0/2278562729 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1300a1c40 con 0x7ff13009bc70 2023-10-03T10:15:28.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.836+0000 7ff1348e1700 1 -- 172.21.15.146:0/2278562729 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13011fb70 con 0x7ff13009bc70 2023-10-03T10:15:28.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.836+0000 7ff11effd700 1 -- 172.21.15.146:0/2278562729 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff120005db0 con 0x7ff13009bc70 2023-10-03T10:15:28.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.837+0000 7ff11effd700 1 -- 172.21.15.146:0/2278562729 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff120006020 con 0x7ff13009bc70 2023-10-03T10:15:28.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.837+0000 7ff11effd700 1 -- 172.21.15.146:0/2278562729 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff12003efd0 con 0x7ff13009bc70 2023-10-03T10:15:28.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.838+0000 7ff1348e1700 1 -- 172.21.15.146:0/2278562729 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1140052e0 con 0x7ff13009bc70 2023-10-03T10:15:28.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.842+0000 7ff11effd700 1 -- 172.21.15.146:0/2278562729 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff12001c410 con 0x7ff13009bc70 2023-10-03T10:15:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.900+0000 7ff5485e8700 1 Processor -- start 2023-10-03T10:15:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.900+0000 7ff5485e8700 1 -- start start 2023-10-03T10:15:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.901+0000 7ff5485e8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff54006a770 0x7ff54006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.901+0000 7ff5485e8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff54009dec0 0x7ff54006b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.901+0000 7ff5485e8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff540131a00 0x7ff540131e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.901+0000 7ff5485e8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff54006b5c0 con 0x7ff540131a00 2023-10-03T10:15:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.901+0000 7ff5485e8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54006e900 con 0x7ff54009dec0 2023-10-03T10:15:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.901+0000 7ff5485e8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff54009d180 con 0x7ff54006a770 2023-10-03T10:15:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.901+0000 7ff546b85700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff540131a00 0x7ff540131e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.901+0000 7ff546b85700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff540131a00 0x7ff540131e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40932/0 (socket says 172.21.15.146:40932) 2023-10-03T10:15:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.901+0000 7ff546b85700 1 -- 172.21.15.146:0/1325687983 learned_addr learned my addr 172.21.15.146:0/1325687983 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.901+0000 7ff545b83700 1 --2- 172.21.15.146:0/1325687983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff54009dec0 0x7ff54006b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.901+0000 7ff546384700 1 --2- 172.21.15.146:0/1325687983 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff54006a770 0x7ff54006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.902+0000 7ff546b85700 1 -- 172.21.15.146:0/1325687983 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff54006a770 msgr2=0x7ff54006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.902+0000 7ff546b85700 1 --2- 172.21.15.146:0/1325687983 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff54006a770 0x7ff54006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.902+0000 7ff546b85700 1 -- 172.21.15.146:0/1325687983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff54009dec0 msgr2=0x7ff54006b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.902+0000 7ff546b85700 1 --2- 172.21.15.146:0/1325687983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff54009dec0 0x7ff54006b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.902+0000 7ff546b85700 1 -- 172.21.15.146:0/1325687983 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54009e780 con 0x7ff540131a00 2023-10-03T10:15:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.902+0000 7ff546384700 1 --2- 172.21.15.146:0/1325687983 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff54006a770 0x7ff54006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.902+0000 7ff545b83700 1 --2- 172.21.15.146:0/1325687983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff54009dec0 0x7ff54006b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.902+0000 7ff546b85700 1 --2- 172.21.15.146:0/1325687983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff540131a00 0x7ff540131e80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff538009e50 tx=0x7ff53800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc7fcada61f9abe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.902+0000 7ff545382700 1 -- 172.21.15.146:0/1325687983 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53800e070 con 0x7ff540131a00 2023-10-03T10:15:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.902+0000 7ff545382700 1 -- 172.21.15.146:0/1325687983 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53800b910 con 0x7ff540131a00 2023-10-03T10:15:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.902+0000 7ff545382700 1 -- 172.21.15.146:0/1325687983 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53800bcc0 con 0x7ff540131a00 2023-10-03T10:15:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.903+0000 7ff5485e8700 1 -- 172.21.15.146:0/1325687983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff540131a00 msgr2=0x7ff540131e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.903+0000 7ff5485e8700 1 --2- 172.21.15.146:0/1325687983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff540131a00 0x7ff540131e80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff538009e50 tx=0x7ff53800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.903+0000 7ff5485e8700 1 -- 172.21.15.146:0/1325687983 shutdown_connections 2023-10-03T10:15:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.903+0000 7ff5485e8700 1 --2- 172.21.15.146:0/1325687983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff540131a00 0x7ff540131e80 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.903+0000 7ff5485e8700 1 --2- 172.21.15.146:0/1325687983 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff54006a770 0x7ff54006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.903+0000 7ff5485e8700 1 --2- 172.21.15.146:0/1325687983 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff54009dec0 0x7ff54006b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.903+0000 7ff5485e8700 1 -- 172.21.15.146:0/1325687983 >> 172.21.15.146:0/1325687983 conn(0x7ff540099c40 msgr2=0x7ff5400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.903+0000 7ff5485e8700 1 -- 172.21.15.146:0/1325687983 shutdown_connections 2023-10-03T10:15:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.903+0000 7ff5485e8700 1 -- 172.21.15.146:0/1325687983 wait complete. 2023-10-03T10:15:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.904+0000 7ff5485e8700 1 Processor -- start 2023-10-03T10:15:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.904+0000 7ff5485e8700 1 -- start start 2023-10-03T10:15:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.905+0000 7ff5485e8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff54006a770 0x7ff540119dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.905+0000 7ff5485e8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff54009dec0 0x7ff54011a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.905+0000 7ff5485e8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff540131a00 0x7ff54011a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.905+0000 7ff5485e8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54011e2b0 con 0x7ff54006a770 2023-10-03T10:15:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.905+0000 7ff5485e8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54011d8f0 con 0x7ff540131a00 2023-10-03T10:15:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.905+0000 7ff5485e8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff54011ccc0 con 0x7ff54009dec0 2023-10-03T10:15:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.905+0000 7ff546384700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff54006a770 0x7ff540119dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.905+0000 7ff545b83700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff54009dec0 0x7ff54011a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.905+0000 7ff546384700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff54006a770 0x7ff540119dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40946/0 (socket says 172.21.15.146:40946) 2023-10-03T10:15:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.905+0000 7ff545b83700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff54009dec0 0x7ff54011a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45160/0 (socket says 172.21.15.146:45160) 2023-10-03T10:15:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.905+0000 7ff546384700 1 -- 172.21.15.146:0/4179699451 learned_addr learned my addr 172.21.15.146:0/4179699451 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.905+0000 7ff546b85700 1 --2- 172.21.15.146:0/4179699451 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff540131a00 0x7ff54011a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.906+0000 7ff546384700 1 -- 172.21.15.146:0/4179699451 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff54009dec0 msgr2=0x7ff54011a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.906+0000 7ff546384700 1 --2- 172.21.15.146:0/4179699451 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff54009dec0 0x7ff54011a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.906+0000 7ff546384700 1 -- 172.21.15.146:0/4179699451 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff540131a00 msgr2=0x7ff54011a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.906+0000 7ff546384700 1 --2- 172.21.15.146:0/4179699451 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff540131a00 0x7ff54011a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.906+0000 7ff546384700 1 -- 172.21.15.146:0/4179699451 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c0094a0 con 0x7ff54006a770 2023-10-03T10:15:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.906+0000 7ff546384700 1 --2- 172.21.15.146:0/4179699451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff54006a770 0x7ff540119dd0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00ebe0 tx=0x7ff53c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.906+0000 7ff536ffd700 1 -- 172.21.15.146:0/4179699451 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c009780 con 0x7ff54006a770 2023-10-03T10:15:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.906+0000 7ff536ffd700 1 -- 172.21.15.146:0/4179699451 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53c00c850 con 0x7ff54006a770 2023-10-03T10:15:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.906+0000 7ff5485e8700 1 -- 172.21.15.146:0/4179699451 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5300094a0 con 0x7ff54006a770 2023-10-03T10:15:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.906+0000 7ff536ffd700 1 -- 172.21.15.146:0/4179699451 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c00cbe0 con 0x7ff54006a770 2023-10-03T10:15:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.906+0000 7ff5485e8700 1 -- 172.21.15.146:0/4179699451 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff538009b30 con 0x7ff54006a770 2023-10-03T10:15:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.907+0000 7ff5485e8700 1 -- 172.21.15.146:0/4179699451 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff54009d380 con 0x7ff54006a770 2023-10-03T10:15:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.908+0000 7ff536ffd700 1 -- 172.21.15.146:0/4179699451 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff53c00cd40 con 0x7ff54006a770 2023-10-03T10:15:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.908+0000 7ff536ffd700 1 -- 172.21.15.146:0/4179699451 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff53c03f7c0 con 0x7ff54006a770 2023-10-03T10:15:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.913+0000 7ff536ffd700 1 -- 172.21.15.146:0/4179699451 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff53c0232f0 con 0x7ff54006a770 2023-10-03T10:15:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.940+0000 7f5c06369700 1 Processor -- start 2023-10-03T10:15:28.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.940+0000 7f5c06369700 1 -- start start 2023-10-03T10:15:28.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.941+0000 7f5c06369700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0009a150 0x7f5c0009e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.941+0000 7f5c06369700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0009edb0 0x7f5c0009f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.941+0000 7f5c06369700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5c00133c20 0x7f5c001340c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.941+0000 7f5c06369700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c0009a520 con 0x7f5c00133c20 2023-10-03T10:15:28.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.941+0000 7f5c06369700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0009fe00 con 0x7f5c0009a150 2023-10-03T10:15:28.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.941+0000 7f5c06369700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0006bec0 con 0x7f5c0009edb0 2023-10-03T10:15:28.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.941+0000 7f5bff7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0009edb0 0x7f5c0009f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.941+0000 7f5c04906700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5c00133c20 0x7f5c001340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.941+0000 7f5c04906700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5c00133c20 0x7f5c001340c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40958/0 (socket says 172.21.15.146:40958) 2023-10-03T10:15:28.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.941+0000 7f5bff7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0009edb0 0x7f5c0009f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45176/0 (socket says 172.21.15.146:45176) 2023-10-03T10:15:28.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.941+0000 7f5c04906700 1 -- 172.21.15.146:0/1117343554 learned_addr learned my addr 172.21.15.146:0/1117343554 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:28.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.941+0000 7f5bfffff700 1 --2- 172.21.15.146:0/1117343554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0009a150 0x7f5c0009e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.941+0000 7f5c04906700 1 -- 172.21.15.146:0/1117343554 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0009edb0 msgr2=0x7f5c0009f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.941+0000 7f5c04906700 1 --2- 172.21.15.146:0/1117343554 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0009edb0 0x7f5c0009f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.941+0000 7f5c04906700 1 -- 172.21.15.146:0/1117343554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0009a150 msgr2=0x7f5c0009e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.941+0000 7f5c04906700 1 --2- 172.21.15.146:0/1117343554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0009a150 0x7f5c0009e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.941+0000 7f5c04906700 1 -- 172.21.15.146:0/1117343554 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0009af80 con 0x7f5c00133c20 2023-10-03T10:15:28.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.941+0000 7f5bff7fe700 1 --2- 172.21.15.146:0/1117343554 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0009edb0 0x7f5c0009f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:28.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.941+0000 7f5bfffff700 1 --2- 172.21.15.146:0/1117343554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0009a150 0x7f5c0009e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:28.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.941+0000 7f5c04906700 1 --2- 172.21.15.146:0/1117343554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c00133c20 0x7f5c001340c0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8009e80 tx=0x7f5bf800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8b63b3a85362cc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.942+0000 7f5bfeffd700 1 -- 172.21.15.146:0/1117343554 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf800e070 con 0x7f5c00133c20 2023-10-03T10:15:28.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.942+0000 7f5bfeffd700 1 -- 172.21.15.146:0/1117343554 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf800b8d0 con 0x7f5c00133c20 2023-10-03T10:15:28.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.942+0000 7f5bfeffd700 1 -- 172.21.15.146:0/1117343554 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf800bc80 con 0x7f5c00133c20 2023-10-03T10:15:28.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.942+0000 7f5c06369700 1 -- 172.21.15.146:0/1117343554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c00133c20 msgr2=0x7f5c001340c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.942+0000 7f5c06369700 1 --2- 172.21.15.146:0/1117343554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c00133c20 0x7f5c001340c0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8009e80 tx=0x7f5bf800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:28.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.942+0000 7f5c06369700 1 -- 172.21.15.146:0/1117343554 shutdown_connections 2023-10-03T10:15:28.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.942+0000 7f5c06369700 1 --2- 172.21.15.146:0/1117343554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0009a150 0x7f5c0009e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.942+0000 7f5c06369700 1 --2- 172.21.15.146:0/1117343554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c00133c20 0x7f5c001340c0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.942+0000 7f5c06369700 1 --2- 172.21.15.146:0/1117343554 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0009edb0 0x7f5c0009f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.942+0000 7f5c06369700 1 -- 172.21.15.146:0/1117343554 >> 172.21.15.146:0/1117343554 conn(0x7f5c000a4430 msgr2=0x7f5c000a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.942+0000 7f5c06369700 1 -- 172.21.15.146:0/1117343554 shutdown_connections 2023-10-03T10:15:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.943+0000 7f5c06369700 1 -- 172.21.15.146:0/1117343554 wait complete. 2023-10-03T10:15:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.943+0000 7f5c06369700 1 Processor -- start 2023-10-03T10:15:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.944+0000 7f5c06369700 1 -- start start 2023-10-03T10:15:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.944+0000 7f5c06369700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0009a150 0x7f5c0011f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.944+0000 7f5c06369700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0009edb0 0x7f5c0011fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.944+0000 7f5c06369700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c00133c20 0x7f5c001c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.944+0000 7f5c06369700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c001335e0 con 0x7f5c00133c20 2023-10-03T10:15:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.944+0000 7f5c06369700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0011f260 con 0x7f5c0009edb0 2023-10-03T10:15:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.944+0000 7f5c06369700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c00120880 con 0x7f5c0009a150 2023-10-03T10:15:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.944+0000 7f5bff7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0009edb0 0x7f5c0011fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.944+0000 7f5c04906700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c00133c20 0x7f5c001c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.944+0000 7f5bff7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0009edb0 0x7f5c0011fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34260/0 (socket says 172.21.15.146:34260) 2023-10-03T10:15:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.944+0000 7f5bff7fe700 1 -- 172.21.15.146:0/1741727280 learned_addr learned my addr 172.21.15.146:0/1741727280 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.944+0000 7f5bfffff700 1 --2- 172.21.15.146:0/1741727280 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0009a150 0x7f5c0011f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.945+0000 7f5c04906700 1 -- 172.21.15.146:0/1741727280 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0009a150 msgr2=0x7f5c0011f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.945+0000 7f5c04906700 1 --2- 172.21.15.146:0/1741727280 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0009a150 0x7f5c0011f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.945+0000 7f5c04906700 1 -- 172.21.15.146:0/1741727280 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0009edb0 msgr2=0x7f5c0011fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.945+0000 7f5c04906700 1 --2- 172.21.15.146:0/1741727280 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0009edb0 0x7f5c0011fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.945+0000 7f5c04906700 1 -- 172.21.15.146:0/1741727280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf00094a0 con 0x7f5c00133c20 2023-10-03T10:15:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.945+0000 7f5c04906700 1 --2- 172.21.15.146:0/1741727280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c00133c20 0x7f5c001c83d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8015000 tx=0x7f5bf8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.945+0000 7f5bfcff9700 1 -- 172.21.15.146:0/1741727280 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8004450 con 0x7f5c00133c20 2023-10-03T10:15:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.945+0000 7f5bfcff9700 1 -- 172.21.15.146:0/1741727280 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf80045b0 con 0x7f5c00133c20 2023-10-03T10:15:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.945+0000 7f5bfcff9700 1 -- 172.21.15.146:0/1741727280 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8004960 con 0x7f5c00133c20 2023-10-03T10:15:28.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.945+0000 7f5c06369700 1 -- 172.21.15.146:0/1741727280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf40094a0 con 0x7f5c00133c20 2023-10-03T10:15:28.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.945+0000 7f5c06369700 1 -- 172.21.15.146:0/1741727280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf8009b30 con 0x7f5c00133c20 2023-10-03T10:15:28.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.946+0000 7f5bfcff9700 1 -- 172.21.15.146:0/1741727280 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5bf8025460 con 0x7f5c00133c20 2023-10-03T10:15:28.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.946+0000 7f5bfcff9700 1 -- 172.21.15.146:0/1741727280 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5bf80411d0 con 0x7f5c00133c20 2023-10-03T10:15:28.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.946+0000 7f5c06369700 1 -- 172.21.15.146:0/1741727280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c0009fa30 con 0x7f5c00133c20 2023-10-03T10:15:28.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:28.955+0000 7f5bfcff9700 1 -- 172.21.15.146:0/1741727280 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5bf802a080 con 0x7f5c00133c20 2023-10-03T10:15:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.006+0000 7f06ed10b700 1 -- 172.21.15.146:0/3430612131 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f06e8072480 con 0x7f06e8133660 2023-10-03T10:15:29.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.006+0000 7f06cf7fe700 1 -- 172.21.15.146:0/3430612131 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f06e8072480 con 0x7f06e8133660 2023-10-03T10:15:29.007 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:29.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.009+0000 7f06ed10b700 1 -- 172.21.15.146:0/3430612131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06e8133660 msgr2=0x7f06e8138de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.009+0000 7f06ed10b700 1 --2- 172.21.15.146:0/3430612131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06e8133660 0x7f06e8138de0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00e930 tx=0x7f06dc00ec40 comp rx=0 tx=0).stop 2023-10-03T10:15:29.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.009+0000 7f06ed10b700 1 -- 172.21.15.146:0/3430612131 shutdown_connections 2023-10-03T10:15:29.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.009+0000 7f06ed10b700 1 --2- 172.21.15.146:0/3430612131 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f06e8135f80 0x7f06e8139320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.009+0000 7f06ed10b700 1 --2- 172.21.15.146:0/3430612131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e8099e20 0x7f06e81388a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.009+0000 7f06ed10b700 1 --2- 172.21.15.146:0/3430612131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06e8133660 0x7f06e8138de0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.009+0000 7f06ed10b700 1 -- 172.21.15.146:0/3430612131 >> 172.21.15.146:0/3430612131 conn(0x7f06e80a2980 msgr2=0x7f06e81324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.011+0000 7f06ed10b700 1 -- 172.21.15.146:0/3430612131 shutdown_connections 2023-10-03T10:15:29.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.011+0000 7f06ed10b700 1 -- 172.21.15.146:0/3430612131 wait complete. 2023-10-03T10:15:29.029 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:29.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.049+0000 7ff1348e1700 1 -- 172.21.15.146:0/2278562729 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff114005590 con 0x7ff13009bc70 2023-10-03T10:15:29.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.049+0000 7ff11effd700 1 -- 172.21.15.146:0/2278562729 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff120012370 con 0x7ff13009bc70 2023-10-03T10:15:29.050 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.051+0000 7ff1348e1700 1 -- 172.21.15.146:0/2278562729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13009bc70 msgr2=0x7ff130121630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.051+0000 7ff1348e1700 1 --2- 172.21.15.146:0/2278562729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13009bc70 0x7ff130121630 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff12000e730 tx=0x7ff12000ea40 comp rx=0 tx=0).stop 2023-10-03T10:15:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.051+0000 7ff1348e1700 1 -- 172.21.15.146:0/2278562729 shutdown_connections 2023-10-03T10:15:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.051+0000 7ff1348e1700 1 --2- 172.21.15.146:0/2278562729 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff130131980 0x7ff130120500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.051+0000 7ff1348e1700 1 --2- 172.21.15.146:0/2278562729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13009bc70 0x7ff130121630 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.051+0000 7ff1348e1700 1 --2- 172.21.15.146:0/2278562729 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff13009c5c0 0x7ff13011ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.051+0000 7ff1348e1700 1 -- 172.21.15.146:0/2278562729 >> 172.21.15.146:0/2278562729 conn(0x7ff1300a2980 msgr2=0x7ff13009d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.051+0000 7ff1348e1700 1 -- 172.21.15.146:0/2278562729 shutdown_connections 2023-10-03T10:15:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.051+0000 7ff1348e1700 1 -- 172.21.15.146:0/2278562729 wait complete. 2023-10-03T10:15:29.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:29.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.123+0000 7ff5485e8700 1 -- 172.21.15.146:0/4179699451 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff54011d490 con 0x7ff54006a770 2023-10-03T10:15:29.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.124+0000 7ff536ffd700 1 -- 172.21.15.146:0/4179699451 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff54011d490 con 0x7ff54006a770 2023-10-03T10:15:29.124 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.126+0000 7ff5485e8700 1 -- 172.21.15.146:0/4179699451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff54006a770 msgr2=0x7ff540119dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.126+0000 7ff5485e8700 1 --2- 172.21.15.146:0/4179699451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff54006a770 0x7ff540119dd0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00ebe0 tx=0x7ff53c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.126+0000 7ff5485e8700 1 -- 172.21.15.146:0/4179699451 shutdown_connections 2023-10-03T10:15:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.126+0000 7ff5485e8700 1 --2- 172.21.15.146:0/4179699451 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff540131a00 0x7ff54011a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.126+0000 7ff5485e8700 1 --2- 172.21.15.146:0/4179699451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff54006a770 0x7ff540119dd0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.126+0000 7ff5485e8700 1 --2- 172.21.15.146:0/4179699451 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff54009dec0 0x7ff54011a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.126+0000 7ff5485e8700 1 -- 172.21.15.146:0/4179699451 >> 172.21.15.146:0/4179699451 conn(0x7ff540099c40 msgr2=0x7ff54012eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.126+0000 7ff5485e8700 1 -- 172.21.15.146:0/4179699451 shutdown_connections 2023-10-03T10:15:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.126+0000 7ff5485e8700 1 -- 172.21.15.146:0/4179699451 wait complete. 2023-10-03T10:15:29.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.154+0000 7f5c06369700 1 -- 172.21.15.146:0/1741727280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5c000a0440 con 0x7f5c00133c20 2023-10-03T10:15:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.155+0000 7f5bfcff9700 1 -- 172.21.15.146:0/1741727280 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5bf8025710 con 0x7f5c00133c20 2023-10-03T10:15:29.155 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:29.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.157+0000 7f5c06369700 1 -- 172.21.15.146:0/1741727280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c00133c20 msgr2=0x7f5c001c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.157+0000 7f5c06369700 1 --2- 172.21.15.146:0/1741727280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c00133c20 0x7f5c001c83d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8015000 tx=0x7f5bf8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.157+0000 7f5c06369700 1 -- 172.21.15.146:0/1741727280 shutdown_connections 2023-10-03T10:15:29.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.157+0000 7f5c06369700 1 --2- 172.21.15.146:0/1741727280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c00133c20 0x7f5c001c83d0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.157+0000 7f5c06369700 1 --2- 172.21.15.146:0/1741727280 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0009a150 0x7f5c0011f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.157+0000 7f5c06369700 1 --2- 172.21.15.146:0/1741727280 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0009edb0 0x7f5c0011fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.157+0000 7f5c06369700 1 -- 172.21.15.146:0/1741727280 >> 172.21.15.146:0/1741727280 conn(0x7f5c000a4430 msgr2=0x7f5c001b8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.157+0000 7f5c06369700 1 -- 172.21.15.146:0/1741727280 shutdown_connections 2023-10-03T10:15:29.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:29.157+0000 7f5c06369700 1 -- 172.21.15.146:0/1741727280 wait complete. 2023-10-03T10:15:29.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:30.030 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:30.066 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:30.140 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:30.170 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:30.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.172+0000 7fc90e447700 1 Processor -- start 2023-10-03T10:15:30.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.172+0000 7fc90e447700 1 -- start start 2023-10-03T10:15:30.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.172+0000 7fc90e447700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc9080a1510 0x7fc9081351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.172+0000 7fc90e447700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9081356e0 0x7fc908137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.172+0000 7fc90e447700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9080a1e70 con 0x7fc9080a0a30 2023-10-03T10:15:30.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.172+0000 7fc90e447700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc90809a720 con 0x7fc9080a1510 2023-10-03T10:15:30.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.172+0000 7fc90e447700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc90809b300 con 0x7fc9081356e0 2023-10-03T10:15:30.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.173+0000 7fc90c9e4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9081356e0 0x7fc908137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.173+0000 7fc90c9e4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9081356e0 0x7fc908137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45196/0 (socket says 172.21.15.146:45196) 2023-10-03T10:15:30.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.173+0000 7fc90c9e4700 1 -- 172.21.15.146:0/890246759 learned_addr learned my addr 172.21.15.146:0/890246759 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:30.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.173+0000 7fc9077fe700 1 --2- 172.21.15.146:0/890246759 >> v2:172.21.15.146:3300/0 conn(0x7fc9080a1510 0x7fc9081351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.173+0000 7fc90c9e4700 1 -- 172.21.15.146:0/890246759 >> v2:172.21.15.146:3300/0 conn(0x7fc9080a1510 msgr2=0x7fc9081351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:30.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.173+0000 7fc90c9e4700 1 --2- 172.21.15.146:0/890246759 >> v2:172.21.15.146:3300/0 conn(0x7fc9080a1510 0x7fc9081351a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.173+0000 7fc90c9e4700 1 -- 172.21.15.146:0/890246759 >> v1:172.21.15.146:6789/0 conn(0x7fc9080a0a30 legacy=0x7fc9080a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.173+0000 7fc90c9e4700 1 -- 172.21.15.146:0/890246759 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90809abc0 con 0x7fc9081356e0 2023-10-03T10:15:30.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.173+0000 7fc90c9e4700 1 --2- 172.21.15.146:0/890246759 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9081356e0 0x7fc908137ac0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc900009e50 tx=0x7fc90000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45a0a4d4d4c9b0f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:30.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.173+0000 7fc906ffd700 1 -- 172.21.15.146:0/890246759 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90000e070 con 0x7fc9081356e0 2023-10-03T10:15:30.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.173+0000 7fc906ffd700 1 -- 172.21.15.146:0/890246759 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90000b9c0 con 0x7fc9081356e0 2023-10-03T10:15:30.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.174+0000 7fc906ffd700 1 -- 172.21.15.146:0/890246759 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90000bd70 con 0x7fc9081356e0 2023-10-03T10:15:30.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.174+0000 7fc90e447700 1 -- 172.21.15.146:0/890246759 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9081356e0 msgr2=0x7fc908137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.174+0000 7fc90e447700 1 --2- 172.21.15.146:0/890246759 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9081356e0 0x7fc908137ac0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc900009e50 tx=0x7fc90000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:30.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.174+0000 7fc90e447700 1 -- 172.21.15.146:0/890246759 shutdown_connections 2023-10-03T10:15:30.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.174+0000 7fc90e447700 1 --2- 172.21.15.146:0/890246759 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9081356e0 0x7fc908137ac0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.174+0000 7fc90e447700 1 --2- 172.21.15.146:0/890246759 >> v2:172.21.15.146:3300/0 conn(0x7fc9080a1510 0x7fc9081351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.174+0000 7fc90e447700 1 -- 172.21.15.146:0/890246759 >> 172.21.15.146:0/890246759 conn(0x7fc9080a2980 msgr2=0x7fc9080a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.175+0000 7fc90e447700 1 -- 172.21.15.146:0/890246759 shutdown_connections 2023-10-03T10:15:30.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.175+0000 7fc90e447700 1 -- 172.21.15.146:0/890246759 wait complete. 2023-10-03T10:15:30.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.176+0000 7fc90e447700 1 Processor -- start 2023-10-03T10:15:30.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.177+0000 7fc90e447700 1 -- start start 2023-10-03T10:15:30.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.177+0000 7fc90e447700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9080a0a30 0x7fc90811d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.177+0000 7fc90e447700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9080a1510 0x7fc90811d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.177+0000 7fc90e447700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9081356e0 0x7fc9081c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.177+0000 7fc90e447700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90811fdb0 con 0x7fc9081356e0 2023-10-03T10:15:30.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.177+0000 7fc90e447700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90809ae00 con 0x7fc9080a0a30 2023-10-03T10:15:30.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.177+0000 7fc90e447700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc90811cd80 con 0x7fc9080a1510 2023-10-03T10:15:30.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.177+0000 7fc9077fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9080a1510 0x7fc90811d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.177+0000 7fc907fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9080a0a30 0x7fc90811d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.177+0000 7fc9077fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9080a1510 0x7fc90811d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45198/0 (socket says 172.21.15.146:45198) 2023-10-03T10:15:30.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.177+0000 7fc9077fe700 1 -- 172.21.15.146:0/1408896274 learned_addr learned my addr 172.21.15.146:0/1408896274 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.178+0000 7fc90c9e4700 1 --2- 172.21.15.146:0/1408896274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9081356e0 0x7fc9081c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.178+0000 7fc9077fe700 1 -- 172.21.15.146:0/1408896274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9080a0a30 msgr2=0x7fc90811d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.178+0000 7fc9077fe700 1 --2- 172.21.15.146:0/1408896274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9080a0a30 0x7fc90811d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.178+0000 7fc9077fe700 1 -- 172.21.15.146:0/1408896274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9081356e0 msgr2=0x7fc9081c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.178+0000 7fc9077fe700 1 --2- 172.21.15.146:0/1408896274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9081356e0 0x7fc9081c6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.178+0000 7fc9077fe700 1 -- 172.21.15.146:0/1408896274 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc900009b30 con 0x7fc9080a1510 2023-10-03T10:15:30.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.178+0000 7fc90c9e4700 1 --2- 172.21.15.146:0/1408896274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9081356e0 0x7fc9081c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:30.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.178+0000 7fc9077fe700 1 --2- 172.21.15.146:0/1408896274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9080a1510 0x7fc90811d840 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc009f70 tx=0x7fc8fc00eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:30.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.178+0000 7fc904ff9700 1 -- 172.21.15.146:0/1408896274 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc013ac0 con 0x7fc9080a1510 2023-10-03T10:15:30.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.178+0000 7fc904ff9700 1 -- 172.21.15.146:0/1408896274 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8fc013c20 con 0x7fc9080a1510 2023-10-03T10:15:30.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.178+0000 7fc90e447700 1 -- 172.21.15.146:0/1408896274 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc90811ea00 con 0x7fc9080a1510 2023-10-03T10:15:30.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.178+0000 7fc904ff9700 1 -- 172.21.15.146:0/1408896274 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc01b440 con 0x7fc9080a1510 2023-10-03T10:15:30.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.178+0000 7fc90e447700 1 -- 172.21.15.146:0/1408896274 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc908120ae0 con 0x7fc9080a1510 2023-10-03T10:15:30.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.179+0000 7fc904ff9700 1 -- 172.21.15.146:0/1408896274 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc8fc01b5a0 con 0x7fc9080a1510 2023-10-03T10:15:30.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.179+0000 7fc90e447700 1 -- 172.21.15.146:0/1408896274 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc90804f2a0 con 0x7fc9080a1510 2023-10-03T10:15:30.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.179+0000 7fc904ff9700 1 -- 172.21.15.146:0/1408896274 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc8fc03f270 con 0x7fc9080a1510 2023-10-03T10:15:30.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.185+0000 7fc904ff9700 1 -- 172.21.15.146:0/1408896274 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8fc01b850 con 0x7fc9080a1510 2023-10-03T10:15:30.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.216+0000 7f20968bf700 1 Processor -- start 2023-10-03T10:15:30.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.216+0000 7f20968bf700 1 -- start start 2023-10-03T10:15:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.217+0000 7f20968bf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2090138040 0x7f2090138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.217+0000 7f20968bf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20900a1400 0x7f209013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.217+0000 7f20968bf700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20901379e0 con 0x7f20900a08e0 2023-10-03T10:15:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.217+0000 7f20968bf700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20900a2100 con 0x7f2090138040 2023-10-03T10:15:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.217+0000 7f20968bf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2090138950 con 0x7f20900a1400 2023-10-03T10:15:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.217+0000 7f2094e5c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20900a1400 0x7f209013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.217+0000 7f208ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2090138040 0x7f2090138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.217+0000 7f2094e5c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20900a1400 0x7f209013fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45210/0 (socket says 172.21.15.146:45210) 2023-10-03T10:15:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.217+0000 7f208f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f20900a08e0 0x7f20900a0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33274/0 (socket says 172.21.15.146:33274) 2023-10-03T10:15:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.217+0000 7f2094e5c700 1 -- 172.21.15.146:0/2861878528 learned_addr learned my addr 172.21.15.146:0/2861878528 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.217+0000 7f208ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2090138040 0x7f2090138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40996/0 (socket says 172.21.15.146:40996) 2023-10-03T10:15:30.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.217+0000 7f2094e5c700 1 -- 172.21.15.146:0/2861878528 >> v2:172.21.15.146:3300/0 conn(0x7f2090138040 msgr2=0x7f2090138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:30.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.217+0000 7f2094e5c700 1 --2- 172.21.15.146:0/2861878528 >> v2:172.21.15.146:3300/0 conn(0x7f2090138040 0x7f2090138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.217+0000 7f2094e5c700 1 -- 172.21.15.146:0/2861878528 >> v1:172.21.15.146:6789/0 conn(0x7f20900a08e0 legacy=0x7f20900a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.217+0000 7f2094e5c700 1 -- 172.21.15.146:0/2861878528 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209009b9b0 con 0x7f20900a1400 2023-10-03T10:15:30.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.217+0000 7f2094e5c700 1 --2- 172.21.15.146:0/2861878528 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20900a1400 0x7f209013fd20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2088009e80 tx=0x7f208800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d82d9f61d5c2a690 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:30.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.217+0000 7f208effd700 1 -- 172.21.15.146:0/2861878528 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208800e070 con 0x7f20900a1400 2023-10-03T10:15:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.218+0000 7f208effd700 1 -- 172.21.15.146:0/2861878528 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208800b980 con 0x7f20900a1400 2023-10-03T10:15:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.218+0000 7f208effd700 1 -- 172.21.15.146:0/2861878528 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208800bd30 con 0x7f20900a1400 2023-10-03T10:15:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.218+0000 7f20968bf700 1 -- 172.21.15.146:0/2861878528 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20900a1400 msgr2=0x7f209013fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.218+0000 7f20968bf700 1 --2- 172.21.15.146:0/2861878528 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20900a1400 0x7f209013fd20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2088009e80 tx=0x7f208800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.218+0000 7f20968bf700 1 -- 172.21.15.146:0/2861878528 shutdown_connections 2023-10-03T10:15:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.218+0000 7f20968bf700 1 --2- 172.21.15.146:0/2861878528 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20900a1400 0x7f209013fd20 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.218+0000 7f20968bf700 1 --2- 172.21.15.146:0/2861878528 >> v2:172.21.15.146:3300/0 conn(0x7f2090138040 0x7f2090138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.218+0000 7f20968bf700 1 -- 172.21.15.146:0/2861878528 >> 172.21.15.146:0/2861878528 conn(0x7f20900a2980 msgr2=0x7f20900a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.218+0000 7f20968bf700 1 -- 172.21.15.146:0/2861878528 shutdown_connections 2023-10-03T10:15:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.218+0000 7f20968bf700 1 -- 172.21.15.146:0/2861878528 wait complete. 2023-10-03T10:15:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.219+0000 7f20968bf700 1 Processor -- start 2023-10-03T10:15:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.219+0000 7f20968bf700 1 -- start start 2023-10-03T10:15:30.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.220+0000 7f20968bf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20900a08e0 0x7f20901264e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.220+0000 7f20968bf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20900a1400 0x7f2090126a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.220+0000 7f20968bf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2090138040 0x7f2090126f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.220+0000 7f20968bf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2090128020 con 0x7f2090138040 2023-10-03T10:15:30.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.220+0000 7f20968bf700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2090129610 con 0x7f20900a1400 2023-10-03T10:15:30.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.220+0000 7f20968bf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f209009c9e0 con 0x7f20900a08e0 2023-10-03T10:15:30.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.220+0000 7f208ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20900a08e0 0x7f20901264e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.220+0000 7f208ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20900a08e0 0x7f20901264e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45216/0 (socket says 172.21.15.146:45216) 2023-10-03T10:15:30.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.220+0000 7f208ffff700 1 -- 172.21.15.146:0/451113595 learned_addr learned my addr 172.21.15.146:0/451113595 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:30.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.220+0000 7f208f7fe700 1 --2- 172.21.15.146:0/451113595 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20900a1400 0x7f2090126a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.220+0000 7f2094e5c700 1 --2- 172.21.15.146:0/451113595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2090138040 0x7f2090126f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.220+0000 7f208ffff700 1 -- 172.21.15.146:0/451113595 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20900a1400 msgr2=0x7f2090126a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.220+0000 7f208ffff700 1 --2- 172.21.15.146:0/451113595 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20900a1400 0x7f2090126a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.220+0000 7f208ffff700 1 -- 172.21.15.146:0/451113595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2090138040 msgr2=0x7f2090126f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.220+0000 7f208ffff700 1 --2- 172.21.15.146:0/451113595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2090138040 0x7f2090126f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.220+0000 7f208ffff700 1 -- 172.21.15.146:0/451113595 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2088009b30 con 0x7f20900a08e0 2023-10-03T10:15:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.221+0000 7f208ffff700 1 --2- 172.21.15.146:0/451113595 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20900a08e0 0x7f20901264e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f208000e760 tx=0x7f208000ea70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.221+0000 7f208cff9700 1 -- 172.21.15.146:0/451113595 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080013610 con 0x7f20900a08e0 2023-10-03T10:15:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.221+0000 7f208cff9700 1 -- 172.21.15.146:0/451113595 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2080013770 con 0x7f20900a08e0 2023-10-03T10:15:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.221+0000 7f20968bf700 1 -- 172.21.15.146:0/451113595 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f209009a240 con 0x7f20900a08e0 2023-10-03T10:15:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.221+0000 7f208cff9700 1 -- 172.21.15.146:0/451113595 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080013b00 con 0x7f20900a08e0 2023-10-03T10:15:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.221+0000 7f20968bf700 1 -- 172.21.15.146:0/451113595 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2090129f30 con 0x7f20900a08e0 2023-10-03T10:15:30.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.222+0000 7f208cff9700 1 -- 172.21.15.146:0/451113595 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2080013c60 con 0x7f20900a08e0 2023-10-03T10:15:30.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.222+0000 7f208cff9700 1 -- 172.21.15.146:0/451113595 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f208003f3b0 con 0x7f20900a08e0 2023-10-03T10:15:30.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.223+0000 7f20968bf700 1 -- 172.21.15.146:0/451113595 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f209004f2a0 con 0x7f20900a08e0 2023-10-03T10:15:30.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.227+0000 7f208cff9700 1 -- 172.21.15.146:0/451113595 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2080012370 con 0x7f20900a08e0 2023-10-03T10:15:30.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.275+0000 7f9202fba700 1 Processor -- start 2023-10-03T10:15:30.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.275+0000 7f9202fba700 1 -- start start 2023-10-03T10:15:30.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.276+0000 7f9202fba700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91fc09d860 0x7f91fc09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.276+0000 7f9202fba700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f91fc09e170 0x7f91fc1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.276+0000 7f9202fba700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f91fc130ce0 0x7f91fc131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.276+0000 7f9202fba700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91fc09aaa0 con 0x7f91fc09e170 2023-10-03T10:15:30.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.276+0000 7f9202fba700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc09f870 con 0x7f91fc09d860 2023-10-03T10:15:30.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.276+0000 7f9202fba700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc09b360 con 0x7f91fc130ce0 2023-10-03T10:15:30.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.276+0000 7f9201557700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f91fc130ce0 0x7f91fc131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.276+0000 7f9201557700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f91fc130ce0 0x7f91fc131180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45222/0 (socket says 172.21.15.146:45222) 2023-10-03T10:15:30.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.276+0000 7f9201557700 1 -- 172.21.15.146:0/1230572909 learned_addr learned my addr 172.21.15.146:0/1230572909 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:30.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.276+0000 7f9200d56700 1 --2- 172.21.15.146:0/1230572909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91fc09d860 0x7f91fc09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.276+0000 7f91fbfff700 1 --2- 172.21.15.146:0/1230572909 >> v2:172.21.15.146:3300/0 conn(0x7f91fc09e170 0x7f91fc1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.276+0000 7f9201557700 1 -- 172.21.15.146:0/1230572909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91fc09d860 msgr2=0x7f91fc09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:30.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.276+0000 7f9201557700 1 --2- 172.21.15.146:0/1230572909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91fc09d860 0x7f91fc09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.276+0000 7f9201557700 1 -- 172.21.15.146:0/1230572909 >> v2:172.21.15.146:3300/0 conn(0x7f91fc09e170 msgr2=0x7f91fc1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:30.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.276+0000 7f9201557700 1 --2- 172.21.15.146:0/1230572909 >> v2:172.21.15.146:3300/0 conn(0x7f91fc09e170 0x7f91fc1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.276+0000 7f9201557700 1 -- 172.21.15.146:0/1230572909 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc09b620 con 0x7f91fc130ce0 2023-10-03T10:15:30.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.276+0000 7f91fbfff700 1 --2- 172.21.15.146:0/1230572909 >> v2:172.21.15.146:3300/0 conn(0x7f91fc09e170 0x7f91fc1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:30.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.276+0000 7f9200d56700 1 --2- 172.21.15.146:0/1230572909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91fc09d860 0x7f91fc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:30.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.276+0000 7f9201557700 1 --2- 172.21.15.146:0/1230572909 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f91fc130ce0 0x7f91fc131180 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009e80 tx=0x7f91f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5266a81e59dc486 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:30.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.277+0000 7f91fb7fe700 1 -- 172.21.15.146:0/1230572909 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f400e070 con 0x7f91fc130ce0 2023-10-03T10:15:30.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.277+0000 7f91fb7fe700 1 -- 172.21.15.146:0/1230572909 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f400b8d0 con 0x7f91fc130ce0 2023-10-03T10:15:30.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.277+0000 7f91fb7fe700 1 -- 172.21.15.146:0/1230572909 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f400bc80 con 0x7f91fc130ce0 2023-10-03T10:15:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.277+0000 7f9202fba700 1 -- 172.21.15.146:0/1230572909 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f91fc130ce0 msgr2=0x7f91fc131180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.277+0000 7f9202fba700 1 --2- 172.21.15.146:0/1230572909 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f91fc130ce0 0x7f91fc131180 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009e80 tx=0x7f91f400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.277+0000 7f9202fba700 1 -- 172.21.15.146:0/1230572909 shutdown_connections 2023-10-03T10:15:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.277+0000 7f9202fba700 1 --2- 172.21.15.146:0/1230572909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91fc09d860 0x7f91fc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.277+0000 7f9202fba700 1 --2- 172.21.15.146:0/1230572909 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f91fc130ce0 0x7f91fc131180 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.277+0000 7f9202fba700 1 --2- 172.21.15.146:0/1230572909 >> v2:172.21.15.146:3300/0 conn(0x7f91fc09e170 0x7f91fc1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.277+0000 7f9202fba700 1 -- 172.21.15.146:0/1230572909 >> 172.21.15.146:0/1230572909 conn(0x7f91fc099c40 msgr2=0x7f91fc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.277+0000 7f9202fba700 1 -- 172.21.15.146:0/1230572909 shutdown_connections 2023-10-03T10:15:30.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.277+0000 7f9202fba700 1 -- 172.21.15.146:0/1230572909 wait complete. 2023-10-03T10:15:30.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.278+0000 7f9202fba700 1 Processor -- start 2023-10-03T10:15:30.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.278+0000 7f9202fba700 1 -- start start 2023-10-03T10:15:30.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.279+0000 7f9202fba700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91fc09d860 0x7f91fc1c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.279+0000 7f9202fba700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f91fc09e170 0x7f91fc1c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.279+0000 7f9202fba700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91fc130ce0 0x7f91fc1c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.279+0000 7f9202fba700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc138060 con 0x7f91fc130ce0 2023-10-03T10:15:30.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.279+0000 7f9202fba700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc137e70 con 0x7f91fc09d860 2023-10-03T10:15:30.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.279+0000 7f9202fba700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc0a1f00 con 0x7f91fc09e170 2023-10-03T10:15:30.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.279+0000 7f91fbfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f91fc09e170 0x7f91fc1c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.279+0000 7f9201557700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91fc130ce0 0x7f91fc1c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.279+0000 7f9201557700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91fc130ce0 0x7f91fc1c8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41014/0 (socket says 172.21.15.146:41014) 2023-10-03T10:15:30.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.279+0000 7f9201557700 1 -- 172.21.15.146:0/3985283772 learned_addr learned my addr 172.21.15.146:0/3985283772 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:30.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.279+0000 7f9200d56700 1 --2- 172.21.15.146:0/3985283772 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91fc09d860 0x7f91fc1c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.280+0000 7f91fbfff700 1 -- 172.21.15.146:0/3985283772 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91fc09d860 msgr2=0x7f91fc1c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.280+0000 7f91fbfff700 1 --2- 172.21.15.146:0/3985283772 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91fc09d860 0x7f91fc1c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.280+0000 7f91fbfff700 1 -- 172.21.15.146:0/3985283772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91fc130ce0 msgr2=0x7f91fc1c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.280+0000 7f91fbfff700 1 --2- 172.21.15.146:0/3985283772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91fc130ce0 0x7f91fc1c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.280+0000 7f91fbfff700 1 -- 172.21.15.146:0/3985283772 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f00094a0 con 0x7f91fc09e170 2023-10-03T10:15:30.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.280+0000 7f9201557700 1 --2- 172.21.15.146:0/3985283772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91fc130ce0 0x7f91fc1c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:30.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.280+0000 7f91fbfff700 1 --2- 172.21.15.146:0/3985283772 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f91fc09e170 0x7f91fc1c8630 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f91e800c7f0 tx=0x7f91e800cb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:30.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.280+0000 7f91f97fa700 1 -- 172.21.15.146:0/3985283772 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e8004230 con 0x7f91fc09e170 2023-10-03T10:15:30.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.280+0000 7f91f97fa700 1 -- 172.21.15.146:0/3985283772 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e8004390 con 0x7f91fc09e170 2023-10-03T10:15:30.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.280+0000 7f9202fba700 1 -- 172.21.15.146:0/3985283772 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f4009b30 con 0x7f91fc09e170 2023-10-03T10:15:30.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.280+0000 7f91f97fa700 1 -- 172.21.15.146:0/3985283772 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e80036a0 con 0x7f91fc09e170 2023-10-03T10:15:30.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.280+0000 7f9202fba700 1 -- 172.21.15.146:0/3985283772 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91fc1197d0 con 0x7f91fc09e170 2023-10-03T10:15:30.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.281+0000 7f9202fba700 1 -- 172.21.15.146:0/3985283772 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91fc04f2a0 con 0x7f91fc09e170 2023-10-03T10:15:30.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.281+0000 7f91f97fa700 1 -- 172.21.15.146:0/3985283772 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f91e8003800 con 0x7f91fc09e170 2023-10-03T10:15:30.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.281+0000 7f91f97fa700 1 -- 172.21.15.146:0/3985283772 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f91e803f380 con 0x7f91fc09e170 2023-10-03T10:15:30.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.290+0000 7f91f97fa700 1 -- 172.21.15.146:0/3985283772 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91e8011600 con 0x7f91fc09e170 2023-10-03T10:15:30.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.316+0000 7f47697e3700 1 Processor -- start 2023-10-03T10:15:30.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.316+0000 7f47697e3700 1 -- start start 2023-10-03T10:15:30.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.316+0000 7f47697e3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4764133a70 0x7f4764133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.316+0000 7f47697e3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47640a08e0 0x7f47640a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.316+0000 7f47697e3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f47640a1290 0x7f476413a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.316+0000 7f47697e3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4764133640 con 0x7f47640a1290 2023-10-03T10:15:30.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.316+0000 7f47697e3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47640a1d50 con 0x7f47640a08e0 2023-10-03T10:15:30.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.316+0000 7f47697e3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47640a1730 con 0x7f4764133a70 2023-10-03T10:15:30.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.317+0000 7f4762ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4764133a70 0x7f4764133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.317+0000 7f475bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47640a08e0 0x7f47640a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.317+0000 7f4762ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4764133a70 0x7f4764133e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45246/0 (socket says 172.21.15.146:45246) 2023-10-03T10:15:30.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.317+0000 7f4762ffd700 1 -- 172.21.15.146:0/3499525234 learned_addr learned my addr 172.21.15.146:0/3499525234 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:30.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.317+0000 7f4762ffd700 1 -- 172.21.15.146:0/3499525234 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47640a08e0 msgr2=0x7f47640a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:30.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.317+0000 7f4762ffd700 1 --2- 172.21.15.146:0/3499525234 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47640a08e0 0x7f47640a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.317+0000 7f4762ffd700 1 -- 172.21.15.146:0/3499525234 >> v2:172.21.15.146:3300/0 conn(0x7f47640a1290 msgr2=0x7f476413a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:30.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.317+0000 7f4762ffd700 1 --2- 172.21.15.146:0/3499525234 >> v2:172.21.15.146:3300/0 conn(0x7f47640a1290 0x7f476413a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.317+0000 7f4762ffd700 1 -- 172.21.15.146:0/3499525234 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476409b620 con 0x7f4764133a70 2023-10-03T10:15:30.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.317+0000 7f475bfff700 1 --2- 172.21.15.146:0/3499525234 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47640a08e0 0x7f47640a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:30.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.317+0000 7f4762ffd700 1 --2- 172.21.15.146:0/3499525234 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4764133a70 0x7f4764133e40 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4754006fd0 tx=0x7f4754009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f12f948f11041f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:30.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.317+0000 7f47627fc700 1 -- 172.21.15.146:0/3499525234 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4754005e30 con 0x7f4764133a70 2023-10-03T10:15:30.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.317+0000 7f47627fc700 1 -- 172.21.15.146:0/3499525234 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4754004030 con 0x7f4764133a70 2023-10-03T10:15:30.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.317+0000 7f47627fc700 1 -- 172.21.15.146:0/3499525234 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47540043e0 con 0x7f4764133a70 2023-10-03T10:15:30.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.318+0000 7f47697e3700 1 -- 172.21.15.146:0/3499525234 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4764133a70 msgr2=0x7f4764133e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.318+0000 7f47697e3700 1 --2- 172.21.15.146:0/3499525234 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4764133a70 0x7f4764133e40 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4754006fd0 tx=0x7f4754009bd0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.318+0000 7f47697e3700 1 -- 172.21.15.146:0/3499525234 shutdown_connections 2023-10-03T10:15:30.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.318+0000 7f47697e3700 1 --2- 172.21.15.146:0/3499525234 >> v2:172.21.15.146:3300/0 conn(0x7f47640a1290 0x7f476413a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.318+0000 7f47697e3700 1 --2- 172.21.15.146:0/3499525234 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4764133a70 0x7f4764133e40 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.318+0000 7f47697e3700 1 --2- 172.21.15.146:0/3499525234 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47640a08e0 0x7f47640a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.318+0000 7f47697e3700 1 -- 172.21.15.146:0/3499525234 >> 172.21.15.146:0/3499525234 conn(0x7f47640a2980 msgr2=0x7f47640a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.318+0000 7f47697e3700 1 -- 172.21.15.146:0/3499525234 shutdown_connections 2023-10-03T10:15:30.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.318+0000 7f47697e3700 1 -- 172.21.15.146:0/3499525234 wait complete. 2023-10-03T10:15:30.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.319+0000 7f47697e3700 1 Processor -- start 2023-10-03T10:15:30.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.319+0000 7f47697e3700 1 -- start start 2023-10-03T10:15:30.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.320+0000 7f47697e3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47640a08e0 0x7f476411b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.320+0000 7f47697e3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f47640a1290 0x7f476411bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.320+0000 7f47697e3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4764133a70 0x7f476411c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.320+0000 7f47697e3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476411f3b0 con 0x7f4764133a70 2023-10-03T10:15:30.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.320+0000 7f47697e3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476411dac0 con 0x7f47640a08e0 2023-10-03T10:15:30.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.320+0000 7f47697e3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f476411e780 con 0x7f47640a1290 2023-10-03T10:15:30.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.320+0000 7f4762ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47640a08e0 0x7f476411b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.320+0000 7f4762ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47640a08e0 0x7f476411b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34322/0 (socket says 172.21.15.146:34322) 2023-10-03T10:15:30.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.320+0000 7f4762ffd700 1 -- 172.21.15.146:0/3098785375 learned_addr learned my addr 172.21.15.146:0/3098785375 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:30.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.320+0000 7f47637fe700 1 --2- 172.21.15.146:0/3098785375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4764133a70 0x7f476411c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.320+0000 7f4762ffd700 1 -- 172.21.15.146:0/3098785375 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f47640a1290 msgr2=0x7f476411bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.320+0000 7f4762ffd700 1 --2- 172.21.15.146:0/3098785375 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f47640a1290 0x7f476411bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.320+0000 7f4762ffd700 1 -- 172.21.15.146:0/3098785375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4764133a70 msgr2=0x7f476411c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.320+0000 7f4762ffd700 1 --2- 172.21.15.146:0/3098785375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4764133a70 0x7f476411c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.320+0000 7f4762ffd700 1 -- 172.21.15.146:0/3098785375 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474c0094a0 con 0x7f47640a08e0 2023-10-03T10:15:30.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.320+0000 7f4762ffd700 1 --2- 172.21.15.146:0/3098785375 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47640a08e0 0x7f476411b890 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4754000c00 tx=0x7f4754004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:30.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.320+0000 7f475b7fe700 1 -- 172.21.15.146:0/3098785375 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4754003ab0 con 0x7f47640a08e0 2023-10-03T10:15:30.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.320+0000 7f475b7fe700 1 -- 172.21.15.146:0/3098785375 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4754003c10 con 0x7f47640a08e0 2023-10-03T10:15:30.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.320+0000 7f47697e3700 1 -- 172.21.15.146:0/3098785375 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4754009500 con 0x7f47640a08e0 2023-10-03T10:15:30.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.320+0000 7f475b7fe700 1 -- 172.21.15.146:0/3098785375 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4754006030 con 0x7f47640a08e0 2023-10-03T10:15:30.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.321+0000 7f47697e3700 1 -- 172.21.15.146:0/3098785375 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4764132060 con 0x7f47640a08e0 2023-10-03T10:15:30.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.321+0000 7f47697e3700 1 -- 172.21.15.146:0/3098785375 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476411ef30 con 0x7f47640a08e0 2023-10-03T10:15:30.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.322+0000 7f475b7fe700 1 -- 172.21.15.146:0/3098785375 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4754006190 con 0x7f47640a08e0 2023-10-03T10:15:30.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.322+0000 7f475b7fe700 1 -- 172.21.15.146:0/3098785375 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4754040600 con 0x7f47640a08e0 2023-10-03T10:15:30.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.330+0000 7f475b7fe700 1 -- 172.21.15.146:0/3098785375 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f476411ef30 con 0x7f47640a08e0 2023-10-03T10:15:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.395+0000 7fc90e447700 1 -- 172.21.15.146:0/1408896274 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc90811f9d0 con 0x7fc9080a1510 2023-10-03T10:15:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.395+0000 7fc904ff9700 1 -- 172.21.15.146:0/1408896274 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc8fc020030 con 0x7fc9080a1510 2023-10-03T10:15:30.396 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:30.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.398+0000 7fc90e447700 1 -- 172.21.15.146:0/1408896274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9080a1510 msgr2=0x7fc90811d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.398+0000 7fc90e447700 1 --2- 172.21.15.146:0/1408896274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9080a1510 0x7fc90811d840 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc009f70 tx=0x7fc8fc00eaf0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.398+0000 7fc90e447700 1 -- 172.21.15.146:0/1408896274 shutdown_connections 2023-10-03T10:15:30.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.398+0000 7fc90e447700 1 --2- 172.21.15.146:0/1408896274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9081356e0 0x7fc9081c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.398+0000 7fc90e447700 1 --2- 172.21.15.146:0/1408896274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9080a0a30 0x7fc90811d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.398+0000 7fc90e447700 1 --2- 172.21.15.146:0/1408896274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc9080a1510 0x7fc90811d840 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.398+0000 7fc90e447700 1 -- 172.21.15.146:0/1408896274 >> 172.21.15.146:0/1408896274 conn(0x7fc9080a2980 msgr2=0x7fc90806df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.399+0000 7fc90e447700 1 -- 172.21.15.146:0/1408896274 shutdown_connections 2023-10-03T10:15:30.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.399+0000 7fc90e447700 1 -- 172.21.15.146:0/1408896274 wait complete. 2023-10-03T10:15:30.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:30.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.435+0000 7f20968bf700 1 -- 172.21.15.146:0/451113595 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f209006bce0 con 0x7f20900a08e0 2023-10-03T10:15:30.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.435+0000 7f208cff9700 1 -- 172.21.15.146:0/451113595 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2080010310 con 0x7f20900a08e0 2023-10-03T10:15:30.436 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:30.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.438+0000 7f20968bf700 1 -- 172.21.15.146:0/451113595 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20900a08e0 msgr2=0x7f20901264e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.438+0000 7f20968bf700 1 --2- 172.21.15.146:0/451113595 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20900a08e0 0x7f20901264e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f208000e760 tx=0x7f208000ea70 comp rx=0 tx=0).stop 2023-10-03T10:15:30.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.438+0000 7f20968bf700 1 -- 172.21.15.146:0/451113595 shutdown_connections 2023-10-03T10:15:30.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.438+0000 7f20968bf700 1 --2- 172.21.15.146:0/451113595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2090138040 0x7f2090126f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.438+0000 7f20968bf700 1 --2- 172.21.15.146:0/451113595 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f20900a08e0 0x7f20901264e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.438+0000 7f20968bf700 1 --2- 172.21.15.146:0/451113595 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20900a1400 0x7f2090126a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.438+0000 7f20968bf700 1 -- 172.21.15.146:0/451113595 >> 172.21.15.146:0/451113595 conn(0x7f20900a2980 msgr2=0x7f20900a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.438+0000 7f20968bf700 1 -- 172.21.15.146:0/451113595 shutdown_connections 2023-10-03T10:15:30.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.438+0000 7f20968bf700 1 -- 172.21.15.146:0/451113595 wait complete. 2023-10-03T10:15:30.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:30.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.494+0000 7f9202fba700 1 -- 172.21.15.146:0/3985283772 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f91fc1199f0 con 0x7f91fc09e170 2023-10-03T10:15:30.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.494+0000 7f91f97fa700 1 -- 172.21.15.146:0/3985283772 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91e801e070 con 0x7f91fc09e170 2023-10-03T10:15:30.495 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:30.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.496+0000 7f9202fba700 1 -- 172.21.15.146:0/3985283772 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f91fc09e170 msgr2=0x7f91fc1c8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.496+0000 7f9202fba700 1 --2- 172.21.15.146:0/3985283772 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f91fc09e170 0x7f91fc1c8630 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f91e800c7f0 tx=0x7f91e800cb00 comp rx=0 tx=0).stop 2023-10-03T10:15:30.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.497+0000 7f9202fba700 1 -- 172.21.15.146:0/3985283772 shutdown_connections 2023-10-03T10:15:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.497+0000 7f9202fba700 1 --2- 172.21.15.146:0/3985283772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91fc130ce0 0x7f91fc1c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.497+0000 7f9202fba700 1 --2- 172.21.15.146:0/3985283772 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91fc09d860 0x7f91fc1c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.497+0000 7f9202fba700 1 --2- 172.21.15.146:0/3985283772 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f91fc09e170 0x7f91fc1c8630 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.497+0000 7f9202fba700 1 -- 172.21.15.146:0/3985283772 >> 172.21.15.146:0/3985283772 conn(0x7f91fc099c40 msgr2=0x7f91fc0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.497+0000 7f9202fba700 1 -- 172.21.15.146:0/3985283772 shutdown_connections 2023-10-03T10:15:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.497+0000 7f9202fba700 1 -- 172.21.15.146:0/3985283772 wait complete. 2023-10-03T10:15:30.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:30.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.535+0000 7f47697e3700 1 -- 172.21.15.146:0/3098785375 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f476411ef30 con 0x7f47640a08e0 2023-10-03T10:15:30.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.536+0000 7f475b7fe700 1 -- 172.21.15.146:0/3098785375 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f476411ef30 con 0x7f47640a08e0 2023-10-03T10:15:30.536 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.538+0000 7f47697e3700 1 -- 172.21.15.146:0/3098785375 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47640a08e0 msgr2=0x7f476411b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.538+0000 7f47697e3700 1 --2- 172.21.15.146:0/3098785375 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47640a08e0 0x7f476411b890 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4754000c00 tx=0x7f4754004750 comp rx=0 tx=0).stop 2023-10-03T10:15:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.538+0000 7f47697e3700 1 -- 172.21.15.146:0/3098785375 shutdown_connections 2023-10-03T10:15:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.538+0000 7f47697e3700 1 --2- 172.21.15.146:0/3098785375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4764133a70 0x7f476411c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.538+0000 7f47697e3700 1 --2- 172.21.15.146:0/3098785375 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47640a08e0 0x7f476411b890 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.538+0000 7f47697e3700 1 --2- 172.21.15.146:0/3098785375 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f47640a1290 0x7f476411bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.538+0000 7f47697e3700 1 -- 172.21.15.146:0/3098785375 >> 172.21.15.146:0/3098785375 conn(0x7f47640a2980 msgr2=0x7f4764130140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.538+0000 7f47697e3700 1 -- 172.21.15.146:0/3098785375 shutdown_connections 2023-10-03T10:15:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:30.538+0000 7f47697e3700 1 -- 172.21.15.146:0/3098785375 wait complete. 2023-10-03T10:15:30.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:31.417 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:31.452 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:31.510 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:31.551 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:31.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.551+0000 7f79d8882700 1 Processor -- start 2023-10-03T10:15:31.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.551+0000 7f79d8882700 1 -- start start 2023-10-03T10:15:31.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.552+0000 7f79d8882700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79d409e340 0x7f79d41359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.552+0000 7f79d8882700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79d4135f20 0x7f79d4138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.552+0000 7f79d8882700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d409aaa0 con 0x7f79d409d860 2023-10-03T10:15:31.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.552+0000 7f79d8882700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d409e730 con 0x7f79d409e340 2023-10-03T10:15:31.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.552+0000 7f79d8882700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79d409f870 con 0x7f79d4135f20 2023-10-03T10:15:31.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.552+0000 7f79d1d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79d409e340 0x7f79d41359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.552+0000 7f79d2d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79d4135f20 0x7f79d4138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.552+0000 7f79d259c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f79d409d860 0x7f79d409dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33282/0 (socket says 172.21.15.146:33282) 2023-10-03T10:15:31.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.552+0000 7f79d1d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79d409e340 0x7f79d41359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34332/0 (socket says 172.21.15.146:34332) 2023-10-03T10:15:31.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.552+0000 7f79d259c700 1 -- 172.21.15.146:0/3416306258 learned_addr learned my addr 172.21.15.146:0/3416306258 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:31.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.552+0000 7f79d2d9d700 1 -- 172.21.15.146:0/3416306258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79d409e340 msgr2=0x7f79d41359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:31.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.552+0000 7f79d2d9d700 1 --2- 172.21.15.146:0/3416306258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79d409e340 0x7f79d41359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.552+0000 7f79d2d9d700 1 -- 172.21.15.146:0/3416306258 >> v1:172.21.15.146:6789/0 conn(0x7f79d409d860 legacy=0x7f79d409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.552+0000 7f79d2d9d700 1 -- 172.21.15.146:0/3416306258 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d409b360 con 0x7f79d4135f20 2023-10-03T10:15:31.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.552+0000 7f79d1d9b700 1 --2- 172.21.15.146:0/3416306258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79d409e340 0x7f79d41359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:31.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.552+0000 7f79d2d9d700 1 --2- 172.21.15.146:0/3416306258 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79d4135f20 0x7f79d4138300 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009df0 tx=0x7f79cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8d0b15957172d33 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.553+0000 7f79d159a700 1 -- 172.21.15.146:0/3416306258 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc00e070 con 0x7f79d4135f20 2023-10-03T10:15:31.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.553+0000 7f79d159a700 1 -- 172.21.15.146:0/3416306258 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79cc003a20 con 0x7f79d4135f20 2023-10-03T10:15:31.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.553+0000 7f79d159a700 1 -- 172.21.15.146:0/3416306258 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc003db0 con 0x7f79d4135f20 2023-10-03T10:15:31.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.553+0000 7f79d8882700 1 -- 172.21.15.146:0/3416306258 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79d4135f20 msgr2=0x7f79d4138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.553+0000 7f79d8882700 1 --2- 172.21.15.146:0/3416306258 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79d4135f20 0x7f79d4138300 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009df0 tx=0x7f79cc00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:31.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.554+0000 7f79d8882700 1 -- 172.21.15.146:0/3416306258 shutdown_connections 2023-10-03T10:15:31.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.554+0000 7f79d8882700 1 --2- 172.21.15.146:0/3416306258 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79d4135f20 0x7f79d4138300 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.554+0000 7f79d8882700 1 --2- 172.21.15.146:0/3416306258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79d409e340 0x7f79d41359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.554+0000 7f79d8882700 1 -- 172.21.15.146:0/3416306258 >> 172.21.15.146:0/3416306258 conn(0x7f79d4099c40 msgr2=0x7f79d40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.554+0000 7f79d8882700 1 -- 172.21.15.146:0/3416306258 shutdown_connections 2023-10-03T10:15:31.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.554+0000 7f79d8882700 1 -- 172.21.15.146:0/3416306258 wait complete. 2023-10-03T10:15:31.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.555+0000 7f79d8882700 1 Processor -- start 2023-10-03T10:15:31.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.555+0000 7f79d8882700 1 -- start start 2023-10-03T10:15:31.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.556+0000 7f79d8882700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79d409d860 0x7f79d41c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.556+0000 7f79d8882700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79d409e340 0x7f79d41c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.556+0000 7f79d8882700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d4135f20 0x7f79d4119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.556+0000 7f79d8882700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d411b200 con 0x7f79d4135f20 2023-10-03T10:15:31.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.556+0000 7f79d8882700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d409c8b0 con 0x7f79d409e340 2023-10-03T10:15:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.556+0000 7f79d8882700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79d411cea0 con 0x7f79d409d860 2023-10-03T10:15:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.556+0000 7f79d1d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79d409e340 0x7f79d41c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.556+0000 7f79d259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79d409d860 0x7f79d41c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.556+0000 7f79d1d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79d409e340 0x7f79d41c4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34338/0 (socket says 172.21.15.146:34338) 2023-10-03T10:15:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.556+0000 7f79d1d9b700 1 -- 172.21.15.146:0/1033669282 learned_addr learned my addr 172.21.15.146:0/1033669282 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.556+0000 7f79d2d9d700 1 --2- 172.21.15.146:0/1033669282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d4135f20 0x7f79d4119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.556+0000 7f79d259c700 1 -- 172.21.15.146:0/1033669282 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79d409e340 msgr2=0x7f79d41c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.556+0000 7f79d259c700 1 --2- 172.21.15.146:0/1033669282 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79d409e340 0x7f79d41c4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.556+0000 7f79d259c700 1 -- 172.21.15.146:0/1033669282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d4135f20 msgr2=0x7f79d4119630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.556+0000 7f79d259c700 1 --2- 172.21.15.146:0/1033669282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d4135f20 0x7f79d4119630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.556+0000 7f79d259c700 1 -- 172.21.15.146:0/1033669282 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c80094a0 con 0x7f79d409d860 2023-10-03T10:15:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.557+0000 7f79d1d9b700 1 --2- 172.21.15.146:0/1033669282 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79d409e340 0x7f79d41c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:31.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.557+0000 7f79d259c700 1 --2- 172.21.15.146:0/1033669282 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79d409d860 0x7f79d41c4530 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f79c4001880 tx=0x7f79c4001b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.557+0000 7f79c2ffd700 1 -- 172.21.15.146:0/1033669282 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c4013070 con 0x7f79d409d860 2023-10-03T10:15:31.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.557+0000 7f79c2ffd700 1 -- 172.21.15.146:0/1033669282 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c4004870 con 0x7f79d409d860 2023-10-03T10:15:31.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.557+0000 7f79c2ffd700 1 -- 172.21.15.146:0/1033669282 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c4004c20 con 0x7f79d409d860 2023-10-03T10:15:31.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.557+0000 7f79d8882700 1 -- 172.21.15.146:0/1033669282 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79cc009a70 con 0x7f79d409d860 2023-10-03T10:15:31.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.557+0000 7f79d8882700 1 -- 172.21.15.146:0/1033669282 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d41303d0 con 0x7f79d409d860 2023-10-03T10:15:31.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.558+0000 7f79d8882700 1 -- 172.21.15.146:0/1033669282 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d411c8a0 con 0x7f79d409d860 2023-10-03T10:15:31.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.559+0000 7f79c2ffd700 1 -- 172.21.15.146:0/1033669282 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79c40070d0 con 0x7f79d409d860 2023-10-03T10:15:31.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.559+0000 7f79c2ffd700 1 -- 172.21.15.146:0/1033669282 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f79c4043110 con 0x7f79d409d860 2023-10-03T10:15:31.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.567+0000 7f79c2ffd700 1 -- 172.21.15.146:0/1033669282 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79c4022990 con 0x7f79d409d860 2023-10-03T10:15:31.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.595+0000 7fa06ce34700 1 Processor -- start 2023-10-03T10:15:31.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.595+0000 7fa06ce34700 1 -- start start 2023-10-03T10:15:31.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.596+0000 7fa06ce34700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0680a0a30 0x7fa0680a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.596+0000 7fa06ce34700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa0680a1340 0x7fa06812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.596+0000 7fa06ce34700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0681304a0 0x7fa068130940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.596+0000 7fa06ce34700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0680a1e70 con 0x7fa0680a1340 2023-10-03T10:15:31.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.596+0000 7fa06ce34700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06809a720 con 0x7fa0681304a0 2023-10-03T10:15:31.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.596+0000 7fa06ce34700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa06809b300 con 0x7fa0680a0a30 2023-10-03T10:15:31.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.596+0000 7fa065d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa0680a1340 0x7fa06812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.596+0000 7fa066d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0681304a0 0x7fa068130940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.596+0000 7fa065d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa0680a1340 0x7fa06812ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41056/0 (socket says 172.21.15.146:41056) 2023-10-03T10:15:31.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.596+0000 7fa065d9b700 1 -- 172.21.15.146:0/3304522438 learned_addr learned my addr 172.21.15.146:0/3304522438 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:31.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.596+0000 7fa06659c700 1 --2- 172.21.15.146:0/3304522438 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0680a0a30 0x7fa0680a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.597+0000 7fa065d9b700 1 -- 172.21.15.146:0/3304522438 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0680a0a30 msgr2=0x7fa0680a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:31.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.597+0000 7fa065d9b700 1 --2- 172.21.15.146:0/3304522438 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0680a0a30 0x7fa0680a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.597+0000 7fa065d9b700 1 -- 172.21.15.146:0/3304522438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0681304a0 msgr2=0x7fa068130940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.597+0000 7fa065d9b700 1 --2- 172.21.15.146:0/3304522438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0681304a0 0x7fa068130940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.597+0000 7fa065d9b700 1 -- 172.21.15.146:0/3304522438 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06809abc0 con 0x7fa0680a1340 2023-10-03T10:15:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.597+0000 7fa06659c700 1 --2- 172.21.15.146:0/3304522438 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0680a0a30 0x7fa0680a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.597+0000 7fa065d9b700 1 --2- 172.21.15.146:0/3304522438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0680a1340 0x7fa06812ff60 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00b9a0 tx=0x7fa05c00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53efba286f8fe5e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.597+0000 7fa06559a700 1 -- 172.21.15.146:0/3304522438 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c009030 con 0x7fa0680a1340 2023-10-03T10:15:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.597+0000 7fa06559a700 1 -- 172.21.15.146:0/3304522438 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05c00cba0 con 0x7fa0680a1340 2023-10-03T10:15:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.597+0000 7fa06559a700 1 -- 172.21.15.146:0/3304522438 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c00d450 con 0x7fa0680a1340 2023-10-03T10:15:31.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.598+0000 7fa06ce34700 1 -- 172.21.15.146:0/3304522438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0680a1340 msgr2=0x7fa06812ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.598+0000 7fa06ce34700 1 --2- 172.21.15.146:0/3304522438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0680a1340 0x7fa06812ff60 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00b9a0 tx=0x7fa05c00bcb0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.598+0000 7fa06ce34700 1 -- 172.21.15.146:0/3304522438 shutdown_connections 2023-10-03T10:15:31.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.598+0000 7fa06ce34700 1 --2- 172.21.15.146:0/3304522438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0681304a0 0x7fa068130940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.598+0000 7fa06ce34700 1 --2- 172.21.15.146:0/3304522438 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0680a0a30 0x7fa0680a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.598+0000 7fa06ce34700 1 --2- 172.21.15.146:0/3304522438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0680a1340 0x7fa06812ff60 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.598+0000 7fa06ce34700 1 -- 172.21.15.146:0/3304522438 >> 172.21.15.146:0/3304522438 conn(0x7fa0680a2980 msgr2=0x7fa0680a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.598+0000 7fa06ce34700 1 -- 172.21.15.146:0/3304522438 shutdown_connections 2023-10-03T10:15:31.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.598+0000 7fa06ce34700 1 -- 172.21.15.146:0/3304522438 wait complete. 2023-10-03T10:15:31.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.599+0000 7fa06ce34700 1 Processor -- start 2023-10-03T10:15:31.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.599+0000 7fa06ce34700 1 -- start start 2023-10-03T10:15:31.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.599+0000 7fa06ce34700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0680a0a30 0x7fa06811ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.599+0000 7fa06ce34700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0680a1340 0x7fa06811b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.599+0000 7fa06ce34700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0681304a0 0x7fa0681c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.599+0000 7fa06ce34700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06811dbd0 con 0x7fa0681304a0 2023-10-03T10:15:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.599+0000 7fa06ce34700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06812ea40 con 0x7fa0680a0a30 2023-10-03T10:15:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.599+0000 7fa06ce34700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa06811a570 con 0x7fa0680a1340 2023-10-03T10:15:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.600+0000 7fa066d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0681304a0 0x7fa0681c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.600+0000 7fa066d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0681304a0 0x7fa0681c3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41070/0 (socket says 172.21.15.146:41070) 2023-10-03T10:15:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.600+0000 7fa066d9d700 1 -- 172.21.15.146:0/2574598283 learned_addr learned my addr 172.21.15.146:0/2574598283 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.600+0000 7fa065d9b700 1 --2- 172.21.15.146:0/2574598283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0680a1340 0x7fa06811b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.600+0000 7fa06659c700 1 --2- 172.21.15.146:0/2574598283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0680a0a30 0x7fa06811ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.600+0000 7fa065d9b700 1 -- 172.21.15.146:0/2574598283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0680a0a30 msgr2=0x7fa06811ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.600+0000 7fa065d9b700 1 --2- 172.21.15.146:0/2574598283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0680a0a30 0x7fa06811ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.600+0000 7fa065d9b700 1 -- 172.21.15.146:0/2574598283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0681304a0 msgr2=0x7fa0681c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.600+0000 7fa065d9b700 1 --2- 172.21.15.146:0/2574598283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0681304a0 0x7fa0681c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.600+0000 7fa065d9b700 1 -- 172.21.15.146:0/2574598283 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa058009430 con 0x7fa0680a1340 2023-10-03T10:15:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.600+0000 7fa065d9b700 1 --2- 172.21.15.146:0/2574598283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0680a1340 0x7fa06811b050 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa06806b6f0 tx=0x7fa05c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.600+0000 7fa056ffd700 1 -- 172.21.15.146:0/2574598283 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c022070 con 0x7fa0680a1340 2023-10-03T10:15:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.600+0000 7fa056ffd700 1 -- 172.21.15.146:0/2574598283 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05c0036a0 con 0x7fa0680a1340 2023-10-03T10:15:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.601+0000 7fa056ffd700 1 -- 172.21.15.146:0/2574598283 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c009040 con 0x7fa0680a1340 2023-10-03T10:15:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.601+0000 7fa06ce34700 1 -- 172.21.15.146:0/2574598283 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa05c00b600 con 0x7fa0680a1340 2023-10-03T10:15:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.601+0000 7fa06ce34700 1 -- 172.21.15.146:0/2574598283 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa06809ae00 con 0x7fa0680a1340 2023-10-03T10:15:31.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.601+0000 7fa056ffd700 1 -- 172.21.15.146:0/2574598283 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa05c01c070 con 0x7fa0680a1340 2023-10-03T10:15:31.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.602+0000 7fa056ffd700 1 -- 172.21.15.146:0/2574598283 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa05c0402a0 con 0x7fa0680a1340 2023-10-03T10:15:31.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.602+0000 7fa06ce34700 1 -- 172.21.15.146:0/2574598283 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa06811b590 con 0x7fa0680a1340 2023-10-03T10:15:31.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.611+0000 7fa056ffd700 1 -- 172.21.15.146:0/2574598283 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa05c01a020 con 0x7fa0680a1340 2023-10-03T10:15:31.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.640+0000 7f941699b700 1 Processor -- start 2023-10-03T10:15:31.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.641+0000 7f941699b700 1 -- start start 2023-10-03T10:15:31.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.641+0000 7f941699b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9410133ad0 0x7f9410133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.641+0000 7f941699b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f94101300a0 0x7f94101304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.641+0000 7f941699b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941006b2d0 con 0x7f94101309f0 2023-10-03T10:15:31.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.641+0000 7f941699b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9410133610 con 0x7f94101300a0 2023-10-03T10:15:31.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.641+0000 7f941699b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941009a500 con 0x7f9410133ad0 2023-10-03T10:15:31.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.641+0000 7f940ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9410133ad0 0x7f9410133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.641+0000 7f940ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9410133ad0 0x7f9410133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34374/0 (socket says 172.21.15.146:34374) 2023-10-03T10:15:31.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.641+0000 7f940ffff700 1 -- 172.21.15.146:0/261276368 learned_addr learned my addr 172.21.15.146:0/261276368 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:31.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.642+0000 7f940f7fe700 1 --2- 172.21.15.146:0/261276368 >> v2:172.21.15.146:3300/0 conn(0x7f94101300a0 0x7f94101304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.642+0000 7f940ffff700 1 -- 172.21.15.146:0/261276368 >> v2:172.21.15.146:3300/0 conn(0x7f94101300a0 msgr2=0x7f94101304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:31.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.642+0000 7f940ffff700 1 --2- 172.21.15.146:0/261276368 >> v2:172.21.15.146:3300/0 conn(0x7f94101300a0 0x7f94101304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.642+0000 7f940ffff700 1 -- 172.21.15.146:0/261276368 >> v1:172.21.15.146:6789/0 conn(0x7f94101309f0 legacy=0x7f941013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.642+0000 7f940ffff700 1 -- 172.21.15.146:0/261276368 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94101338b0 con 0x7f9410133ad0 2023-10-03T10:15:31.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.642+0000 7f940ffff700 1 --2- 172.21.15.146:0/261276368 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9410133ad0 0x7f9410133ea0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f94000098f0 tx=0x7f9400009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d91d3c883870c827 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.642+0000 7f940effd700 1 -- 172.21.15.146:0/261276368 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940000b8a0 con 0x7f9410133ad0 2023-10-03T10:15:31.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.642+0000 7f940effd700 1 -- 172.21.15.146:0/261276368 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940000ba00 con 0x7f9410133ad0 2023-10-03T10:15:31.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.642+0000 7f940effd700 1 -- 172.21.15.146:0/261276368 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940000bd90 con 0x7f9410133ad0 2023-10-03T10:15:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.643+0000 7f941699b700 1 -- 172.21.15.146:0/261276368 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9410133ad0 msgr2=0x7f9410133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.643+0000 7f941699b700 1 --2- 172.21.15.146:0/261276368 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9410133ad0 0x7f9410133ea0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f94000098f0 tx=0x7f9400009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.643+0000 7f941699b700 1 -- 172.21.15.146:0/261276368 shutdown_connections 2023-10-03T10:15:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.643+0000 7f941699b700 1 --2- 172.21.15.146:0/261276368 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9410133ad0 0x7f9410133ea0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.643+0000 7f941699b700 1 --2- 172.21.15.146:0/261276368 >> v2:172.21.15.146:3300/0 conn(0x7f94101300a0 0x7f94101304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.643+0000 7f941699b700 1 -- 172.21.15.146:0/261276368 >> 172.21.15.146:0/261276368 conn(0x7f9410099c40 msgr2=0x7f94100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.643+0000 7f941699b700 1 -- 172.21.15.146:0/261276368 shutdown_connections 2023-10-03T10:15:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.643+0000 7f941699b700 1 -- 172.21.15.146:0/261276368 wait complete. 2023-10-03T10:15:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.644+0000 7f941699b700 1 Processor -- start 2023-10-03T10:15:31.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.645+0000 7f941699b700 1 -- start start 2023-10-03T10:15:31.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.645+0000 7f941699b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94101300a0 0x7f941011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.645+0000 7f941699b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94101309f0 0x7f941011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.645+0000 7f941699b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9410133ad0 0x7f941011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.645+0000 7f941699b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941012d890 con 0x7f94101309f0 2023-10-03T10:15:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.645+0000 7f941699b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941011fab0 con 0x7f94101300a0 2023-10-03T10:15:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.645+0000 7f941699b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9410120950 con 0x7f9410133ad0 2023-10-03T10:15:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.645+0000 7f940ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94101300a0 0x7f941011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.646+0000 7f940ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94101300a0 0x7f941011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34378/0 (socket says 172.21.15.146:34378) 2023-10-03T10:15:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.646+0000 7f940ffff700 1 -- 172.21.15.146:0/958983442 learned_addr learned my addr 172.21.15.146:0/958983442 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.646+0000 7f940f7fe700 1 --2- 172.21.15.146:0/958983442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94101309f0 0x7f941011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.646+0000 7f9414f38700 1 --2- 172.21.15.146:0/958983442 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9410133ad0 0x7f941011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.646+0000 7f9414f38700 1 -- 172.21.15.146:0/958983442 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94101300a0 msgr2=0x7f941011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.646+0000 7f9414f38700 1 --2- 172.21.15.146:0/958983442 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94101300a0 0x7f941011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.646+0000 7f9414f38700 1 -- 172.21.15.146:0/958983442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94101309f0 msgr2=0x7f941011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.646+0000 7f9414f38700 1 --2- 172.21.15.146:0/958983442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94101309f0 0x7f941011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.646+0000 7f9414f38700 1 -- 172.21.15.146:0/958983442 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9400009550 con 0x7f9410133ad0 2023-10-03T10:15:31.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.646+0000 7f940ffff700 1 --2- 172.21.15.146:0/958983442 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94101300a0 0x7f941011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:31.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.646+0000 7f940f7fe700 1 --2- 172.21.15.146:0/958983442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94101309f0 0x7f941011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:31.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.646+0000 7f9414f38700 1 --2- 172.21.15.146:0/958983442 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9410133ad0 0x7f941011e4c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f940800cbc0 tx=0x7f940800ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.646+0000 7f940cff9700 1 -- 172.21.15.146:0/958983442 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9408003c00 con 0x7f9410133ad0 2023-10-03T10:15:31.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.646+0000 7f940cff9700 1 -- 172.21.15.146:0/958983442 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9408003d60 con 0x7f9410133ad0 2023-10-03T10:15:31.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.646+0000 7f940cff9700 1 -- 172.21.15.146:0/958983442 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940800aa40 con 0x7f9410133ad0 2023-10-03T10:15:31.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.646+0000 7f941699b700 1 -- 172.21.15.146:0/958983442 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941012fe40 con 0x7f9410133ad0 2023-10-03T10:15:31.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.647+0000 7f941699b700 1 -- 172.21.15.146:0/958983442 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941011fd70 con 0x7f9410133ad0 2023-10-03T10:15:31.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.648+0000 7f941699b700 1 -- 172.21.15.146:0/958983442 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941004f2a0 con 0x7f9410133ad0 2023-10-03T10:15:31.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.648+0000 7f940cff9700 1 -- 172.21.15.146:0/958983442 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f940800aba0 con 0x7f9410133ad0 2023-10-03T10:15:31.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.648+0000 7f940cff9700 1 -- 172.21.15.146:0/958983442 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f94080401d0 con 0x7f9410133ad0 2023-10-03T10:15:31.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.657+0000 7f940cff9700 1 -- 172.21.15.146:0/958983442 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9408011970 con 0x7f9410133ad0 2023-10-03T10:15:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.683+0000 7f2a2972f700 1 Processor -- start 2023-10-03T10:15:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.683+0000 7f2a2972f700 1 -- start start 2023-10-03T10:15:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.684+0000 7f2a2972f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a2409d860 0x7f2a2409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.684+0000 7f2a2972f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a24130eb0 0x7f2a24138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.684+0000 7f2a2972f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2409aaa0 con 0x7f2a2409e170 2023-10-03T10:15:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.684+0000 7f2a2972f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2409f870 con 0x7f2a2409d860 2023-10-03T10:15:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.684+0000 7f2a2972f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2409b360 con 0x7f2a24130eb0 2023-10-03T10:15:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.684+0000 7f2a227fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2a2409e170 0x7f2a241307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33296/0 (socket says 172.21.15.146:33296) 2023-10-03T10:15:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.684+0000 7f2a227fc700 1 -- 172.21.15.146:0/1769967088 learned_addr learned my addr 172.21.15.146:0/1769967088 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.684+0000 7f2a237fe700 1 --2- 172.21.15.146:0/1769967088 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a24130eb0 0x7f2a24138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.684+0000 7f2a22ffd700 1 --2- 172.21.15.146:0/1769967088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a2409d860 0x7f2a2409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.685+0000 7f2a21ffb700 1 -- 172.21.15.146:0/1769967088 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458769196 0 0) 0x7f2a2409aaa0 con 0x7f2a2409e170 2023-10-03T10:15:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.685+0000 7f2a21ffb700 1 -- 172.21.15.146:0/1769967088 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a0c0035b0 con 0x7f2a2409e170 2023-10-03T10:15:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.685+0000 7f2a237fe700 1 -- 172.21.15.146:0/1769967088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a2409d860 msgr2=0x7f2a2409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.685+0000 7f2a237fe700 1 --2- 172.21.15.146:0/1769967088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a2409d860 0x7f2a2409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.685+0000 7f2a237fe700 1 -- 172.21.15.146:0/1769967088 >> v1:172.21.15.146:6789/0 conn(0x7f2a2409e170 legacy=0x7f2a241307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.685+0000 7f2a237fe700 1 -- 172.21.15.146:0/1769967088 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2409b620 con 0x7f2a24130eb0 2023-10-03T10:15:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.685+0000 7f2a22ffd700 1 --2- 172.21.15.146:0/1769967088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a2409d860 0x7f2a2409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.685+0000 7f2a237fe700 1 --2- 172.21.15.146:0/1769967088 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a24130eb0 0x7f2a24138a00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009dc0 tx=0x7f2a1c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6324bde6f5cdc7b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.685+0000 7f2a21ffb700 1 -- 172.21.15.146:0/1769967088 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00e070 con 0x7f2a24130eb0 2023-10-03T10:15:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.685+0000 7f2a21ffb700 1 -- 172.21.15.146:0/1769967088 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c00bb20 con 0x7f2a24130eb0 2023-10-03T10:15:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.685+0000 7f2a21ffb700 1 -- 172.21.15.146:0/1769967088 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c012430 con 0x7f2a24130eb0 2023-10-03T10:15:31.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.686+0000 7f2a2972f700 1 -- 172.21.15.146:0/1769967088 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a24130eb0 msgr2=0x7f2a24138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.686+0000 7f2a2972f700 1 --2- 172.21.15.146:0/1769967088 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a24130eb0 0x7f2a24138a00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009dc0 tx=0x7f2a1c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:31.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.686+0000 7f2a2972f700 1 -- 172.21.15.146:0/1769967088 shutdown_connections 2023-10-03T10:15:31.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.686+0000 7f2a2972f700 1 --2- 172.21.15.146:0/1769967088 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a24130eb0 0x7f2a24138a00 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.686+0000 7f2a2972f700 1 --2- 172.21.15.146:0/1769967088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a2409d860 0x7f2a2409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.686+0000 7f2a2972f700 1 -- 172.21.15.146:0/1769967088 >> 172.21.15.146:0/1769967088 conn(0x7f2a24099c40 msgr2=0x7f2a240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.686+0000 7f2a2972f700 1 -- 172.21.15.146:0/1769967088 shutdown_connections 2023-10-03T10:15:31.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.686+0000 7f2a2972f700 1 -- 172.21.15.146:0/1769967088 wait complete. 2023-10-03T10:15:31.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.688+0000 7f2a2972f700 1 Processor -- start 2023-10-03T10:15:31.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.688+0000 7f2a2972f700 1 -- start start 2023-10-03T10:15:31.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.688+0000 7f2a2972f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a2409d860 0x7f2a2411e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.688+0000 7f2a2972f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a2409e170 0x7f2a2411e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.688+0000 7f2a2972f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a24130eb0 0x7f2a2411ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.688+0000 7f2a2972f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a24120790 con 0x7f2a24130eb0 2023-10-03T10:15:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.688+0000 7f2a2972f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a24072770 con 0x7f2a2409e170 2023-10-03T10:15:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.688+0000 7f2a2972f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a24120cc0 con 0x7f2a2409d860 2023-10-03T10:15:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.688+0000 7f2a227fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a2409e170 0x7f2a2411e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.688+0000 7f2a237fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a24130eb0 0x7f2a2411ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.689+0000 7f2a237fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a24130eb0 0x7f2a2411ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41092/0 (socket says 172.21.15.146:41092) 2023-10-03T10:15:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.689+0000 7f2a227fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a2409e170 0x7f2a2411e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34410/0 (socket says 172.21.15.146:34410) 2023-10-03T10:15:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.689+0000 7f2a237fe700 1 -- 172.21.15.146:0/2773763081 learned_addr learned my addr 172.21.15.146:0/2773763081 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.689+0000 7f2a22ffd700 1 --2- 172.21.15.146:0/2773763081 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a2409d860 0x7f2a2411e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.689+0000 7f2a237fe700 1 -- 172.21.15.146:0/2773763081 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a2409d860 msgr2=0x7f2a2411e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.689+0000 7f2a237fe700 1 --2- 172.21.15.146:0/2773763081 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a2409d860 0x7f2a2411e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.689+0000 7f2a237fe700 1 -- 172.21.15.146:0/2773763081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a2409e170 msgr2=0x7f2a2411e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.689+0000 7f2a237fe700 1 --2- 172.21.15.146:0/2773763081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a2409e170 0x7f2a2411e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.689+0000 7f2a237fe700 1 -- 172.21.15.146:0/2773763081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a140094a0 con 0x7f2a24130eb0 2023-10-03T10:15:31.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.689+0000 7f2a237fe700 1 --2- 172.21.15.146:0/2773763081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a24130eb0 0x7f2a2411ed10 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c014040 tx=0x7f2a1c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.689+0000 7f2a0b7fe700 1 -- 172.21.15.146:0/2773763081 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c012430 con 0x7f2a24130eb0 2023-10-03T10:15:31.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.689+0000 7f2a0b7fe700 1 -- 172.21.15.146:0/2773763081 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c020070 con 0x7f2a24130eb0 2023-10-03T10:15:31.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.689+0000 7f2a0b7fe700 1 -- 172.21.15.146:0/2773763081 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c003e30 con 0x7f2a24130eb0 2023-10-03T10:15:31.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.689+0000 7f2a2972f700 1 -- 172.21.15.146:0/2773763081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a1c009a70 con 0x7f2a24130eb0 2023-10-03T10:15:31.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.689+0000 7f2a2972f700 1 -- 172.21.15.146:0/2773763081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a24121e50 con 0x7f2a24130eb0 2023-10-03T10:15:31.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.690+0000 7f2a2972f700 1 -- 172.21.15.146:0/2773763081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2404f2a0 con 0x7f2a24130eb0 2023-10-03T10:15:31.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.691+0000 7f2a0b7fe700 1 -- 172.21.15.146:0/2773763081 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a1c004040 con 0x7f2a24130eb0 2023-10-03T10:15:31.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.691+0000 7f2a0b7fe700 1 -- 172.21.15.146:0/2773763081 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2a1c022070 con 0x7f2a24130eb0 2023-10-03T10:15:31.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.699+0000 7f2a0b7fe700 1 -- 172.21.15.146:0/2773763081 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a1c011960 con 0x7f2a24130eb0 2023-10-03T10:15:31.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.786+0000 7f79d8882700 1 -- 172.21.15.146:0/1033669282 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f79d404f2a0 con 0x7f79d409d860 2023-10-03T10:15:31.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.786+0000 7f79c2ffd700 1 -- 172.21.15.146:0/1033669282 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f79c401e020 con 0x7f79d409d860 2023-10-03T10:15:31.787 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:31.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.789+0000 7f79d8882700 1 -- 172.21.15.146:0/1033669282 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79d409d860 msgr2=0x7f79d41c4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.789+0000 7f79d8882700 1 --2- 172.21.15.146:0/1033669282 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79d409d860 0x7f79d41c4530 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f79c4001880 tx=0x7f79c4001b90 comp rx=0 tx=0).stop 2023-10-03T10:15:31.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.789+0000 7f79d8882700 1 -- 172.21.15.146:0/1033669282 shutdown_connections 2023-10-03T10:15:31.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.789+0000 7f79d8882700 1 --2- 172.21.15.146:0/1033669282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d4135f20 0x7f79d4119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.789+0000 7f79d8882700 1 --2- 172.21.15.146:0/1033669282 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79d409d860 0x7f79d41c4530 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.789+0000 7f79d8882700 1 --2- 172.21.15.146:0/1033669282 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79d409e340 0x7f79d41c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.789+0000 7f79d8882700 1 -- 172.21.15.146:0/1033669282 >> 172.21.15.146:0/1033669282 conn(0x7f79d4099c40 msgr2=0x7f79d41329c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.789+0000 7f79d8882700 1 -- 172.21.15.146:0/1033669282 shutdown_connections 2023-10-03T10:15:31.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.789+0000 7f79d8882700 1 -- 172.21.15.146:0/1033669282 wait complete. 2023-10-03T10:15:31.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:31.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.810+0000 7fa06ce34700 1 -- 172.21.15.146:0/2574598283 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa06804f2a0 con 0x7fa0680a1340 2023-10-03T10:15:31.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.810+0000 7fa056ffd700 1 -- 172.21.15.146:0/2574598283 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa05c0265a0 con 0x7fa0680a1340 2023-10-03T10:15:31.811 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:31.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.812+0000 7fa06ce34700 1 -- 172.21.15.146:0/2574598283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0680a1340 msgr2=0x7fa06811b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.812+0000 7fa06ce34700 1 --2- 172.21.15.146:0/2574598283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0680a1340 0x7fa06811b050 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa06806b6f0 tx=0x7fa05c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:31.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.812+0000 7fa06ce34700 1 -- 172.21.15.146:0/2574598283 shutdown_connections 2023-10-03T10:15:31.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.812+0000 7fa06ce34700 1 --2- 172.21.15.146:0/2574598283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0681304a0 0x7fa0681c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.812+0000 7fa06ce34700 1 --2- 172.21.15.146:0/2574598283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0680a0a30 0x7fa06811ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.812+0000 7fa06ce34700 1 --2- 172.21.15.146:0/2574598283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0680a1340 0x7fa06811b050 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.812+0000 7fa06ce34700 1 -- 172.21.15.146:0/2574598283 >> 172.21.15.146:0/2574598283 conn(0x7fa0680a2980 msgr2=0x7fa06809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.812+0000 7fa06ce34700 1 -- 172.21.15.146:0/2574598283 shutdown_connections 2023-10-03T10:15:31.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.812+0000 7fa06ce34700 1 -- 172.21.15.146:0/2574598283 wait complete. 2023-10-03T10:15:31.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.854+0000 7f941699b700 1 -- 172.21.15.146:0/958983442 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f941006c3b0 con 0x7f9410133ad0 2023-10-03T10:15:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.854+0000 7f940cff9700 1 -- 172.21.15.146:0/958983442 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9408011380 con 0x7f9410133ad0 2023-10-03T10:15:31.855 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:31.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.856+0000 7f941699b700 1 -- 172.21.15.146:0/958983442 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9410133ad0 msgr2=0x7f941011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.856+0000 7f941699b700 1 --2- 172.21.15.146:0/958983442 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9410133ad0 0x7f941011e4c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f940800cbc0 tx=0x7f940800ced0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.856+0000 7f941699b700 1 -- 172.21.15.146:0/958983442 shutdown_connections 2023-10-03T10:15:31.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.856+0000 7f941699b700 1 --2- 172.21.15.146:0/958983442 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9410133ad0 0x7f941011e4c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.856+0000 7f941699b700 1 --2- 172.21.15.146:0/958983442 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94101300a0 0x7f941011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.856+0000 7f941699b700 1 --2- 172.21.15.146:0/958983442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94101309f0 0x7f941011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.856+0000 7f941699b700 1 -- 172.21.15.146:0/958983442 >> 172.21.15.146:0/958983442 conn(0x7f9410099c40 msgr2=0x7f941012f290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.856+0000 7f941699b700 1 -- 172.21.15.146:0/958983442 shutdown_connections 2023-10-03T10:15:31.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.856+0000 7f941699b700 1 -- 172.21.15.146:0/958983442 wait complete. 2023-10-03T10:15:31.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:31.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.896+0000 7f2a2972f700 1 -- 172.21.15.146:0/2773763081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2a2406c3b0 con 0x7f2a24130eb0 2023-10-03T10:15:31.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.896+0000 7f2a0b7fe700 1 -- 172.21.15.146:0/2773763081 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2a1c011390 con 0x7f2a24130eb0 2023-10-03T10:15:31.897 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:31.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.898+0000 7f2a2972f700 1 -- 172.21.15.146:0/2773763081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a24130eb0 msgr2=0x7f2a2411ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.898+0000 7f2a2972f700 1 --2- 172.21.15.146:0/2773763081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a24130eb0 0x7f2a2411ed10 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c014040 tx=0x7f2a1c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.898+0000 7f2a2972f700 1 -- 172.21.15.146:0/2773763081 shutdown_connections 2023-10-03T10:15:31.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.898+0000 7f2a2972f700 1 --2- 172.21.15.146:0/2773763081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a24130eb0 0x7f2a2411ed10 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.898+0000 7f2a2972f700 1 --2- 172.21.15.146:0/2773763081 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a2409d860 0x7f2a2411e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.898+0000 7f2a2972f700 1 --2- 172.21.15.146:0/2773763081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a2409e170 0x7f2a2411e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.898+0000 7f2a2972f700 1 -- 172.21.15.146:0/2773763081 >> 172.21.15.146:0/2773763081 conn(0x7f2a24099c40 msgr2=0x7f2a240a2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.898+0000 7f2a2972f700 1 -- 172.21.15.146:0/2773763081 shutdown_connections 2023-10-03T10:15:31.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:31.898+0000 7f2a2972f700 1 -- 172.21.15.146:0/2773763081 wait complete. 2023-10-03T10:15:31.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:32.803 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:32.825 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:32.870 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:32.912 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:32.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.935+0000 7f075f485700 1 Processor -- start 2023-10-03T10:15:32.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.935+0000 7f075f485700 1 -- start start 2023-10-03T10:15:32.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.936+0000 7f075f485700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0758099e20 0x7f075809a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.936+0000 7f075f485700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f075809a730 0x7f0758130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.936+0000 7f075f485700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0758130890 0x7f0758130d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.936+0000 7f075f485700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f075809bf50 con 0x7f075809a730 2023-10-03T10:15:32.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.936+0000 7f075f485700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0758099a60 con 0x7f0758130890 2023-10-03T10:15:32.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.936+0000 7f075f485700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f075809b230 con 0x7f0758099e20 2023-10-03T10:15:32.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.936+0000 7f075d221700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0758099e20 0x7f075809a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.936+0000 7f075d221700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0758099e20 0x7f075809a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45322/0 (socket says 172.21.15.146:45322) 2023-10-03T10:15:32.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.936+0000 7f075d221700 1 -- 172.21.15.146:0/4185053309 learned_addr learned my addr 172.21.15.146:0/4185053309 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:32.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.936+0000 7f075ca20700 1 --2- 172.21.15.146:0/4185053309 >> v2:172.21.15.146:3300/0 conn(0x7f075809a730 0x7f0758130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.936+0000 7f075da22700 1 --2- 172.21.15.146:0/4185053309 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0758130890 0x7f0758130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.936+0000 7f075d221700 1 -- 172.21.15.146:0/4185053309 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0758130890 msgr2=0x7f0758130d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:32.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.936+0000 7f075d221700 1 --2- 172.21.15.146:0/4185053309 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0758130890 0x7f0758130d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.936+0000 7f075d221700 1 -- 172.21.15.146:0/4185053309 >> v2:172.21.15.146:3300/0 conn(0x7f075809a730 msgr2=0x7f0758130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:32.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.936+0000 7f075d221700 1 --2- 172.21.15.146:0/4185053309 >> v2:172.21.15.146:3300/0 conn(0x7f075809a730 0x7f0758130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.936+0000 7f075d221700 1 -- 172.21.15.146:0/4185053309 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075809bb90 con 0x7f0758099e20 2023-10-03T10:15:32.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.936+0000 7f075ca20700 1 --2- 172.21.15.146:0/4185053309 >> v2:172.21.15.146:3300/0 conn(0x7f075809a730 0x7f0758130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:32.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.936+0000 7f075da22700 1 --2- 172.21.15.146:0/4185053309 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0758130890 0x7f0758130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:32.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.937+0000 7f075d221700 1 --2- 172.21.15.146:0/4185053309 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0758099e20 0x7f075809a1f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f075400b9a0 tx=0x7f075400bcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aced8da18c3e268 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.937+0000 7f074ffff700 1 -- 172.21.15.146:0/4185053309 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0754005e30 con 0x7f0758099e20 2023-10-03T10:15:32.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.937+0000 7f074ffff700 1 -- 172.21.15.146:0/4185053309 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0754004030 con 0x7f0758099e20 2023-10-03T10:15:32.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.937+0000 7f074ffff700 1 -- 172.21.15.146:0/4185053309 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07540043e0 con 0x7f0758099e20 2023-10-03T10:15:32.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.938+0000 7f075f485700 1 -- 172.21.15.146:0/4185053309 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0758099e20 msgr2=0x7f075809a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.938+0000 7f075f485700 1 --2- 172.21.15.146:0/4185053309 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0758099e20 0x7f075809a1f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f075400b9a0 tx=0x7f075400bcb0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.938+0000 7f075f485700 1 -- 172.21.15.146:0/4185053309 shutdown_connections 2023-10-03T10:15:32.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.938+0000 7f075f485700 1 --2- 172.21.15.146:0/4185053309 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0758130890 0x7f0758130d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.938+0000 7f075f485700 1 --2- 172.21.15.146:0/4185053309 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0758099e20 0x7f075809a1f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.938+0000 7f075f485700 1 --2- 172.21.15.146:0/4185053309 >> v2:172.21.15.146:3300/0 conn(0x7f075809a730 0x7f0758130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.938+0000 7f075f485700 1 -- 172.21.15.146:0/4185053309 >> 172.21.15.146:0/4185053309 conn(0x7f07580a2980 msgr2=0x7f07580a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.938+0000 7f075f485700 1 -- 172.21.15.146:0/4185053309 shutdown_connections 2023-10-03T10:15:32.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.938+0000 7f075f485700 1 -- 172.21.15.146:0/4185053309 wait complete. 2023-10-03T10:15:32.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.939+0000 7f075f485700 1 Processor -- start 2023-10-03T10:15:32.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.940+0000 7f075f485700 1 -- start start 2023-10-03T10:15:32.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.940+0000 7f075f485700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0758099e20 0x7f075811b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.940+0000 7f075f485700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f075809a730 0x7f075811bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.940+0000 7f075f485700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0758130890 0x7f075811c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.940+0000 7f075f485700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075811cc20 con 0x7f0758099e20 2023-10-03T10:15:32.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.940+0000 7f075f485700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075811d380 con 0x7f0758130890 2023-10-03T10:15:32.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.940+0000 7f075f485700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f075811e5d0 con 0x7f075809a730 2023-10-03T10:15:32.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.940+0000 7f075d221700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0758099e20 0x7f075811b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.940+0000 7f075ca20700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f075809a730 0x7f075811bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.940+0000 7f075d221700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0758099e20 0x7f075811b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41116/0 (socket says 172.21.15.146:41116) 2023-10-03T10:15:32.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.940+0000 7f075d221700 1 -- 172.21.15.146:0/4043864370 learned_addr learned my addr 172.21.15.146:0/4043864370 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:32.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.940+0000 7f075da22700 1 --2- 172.21.15.146:0/4043864370 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0758130890 0x7f075811c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.941+0000 7f075d221700 1 -- 172.21.15.146:0/4043864370 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f075809a730 msgr2=0x7f075811bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.941+0000 7f075d221700 1 --2- 172.21.15.146:0/4043864370 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f075809a730 0x7f075811bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.941+0000 7f075d221700 1 -- 172.21.15.146:0/4043864370 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0758130890 msgr2=0x7f075811c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.941+0000 7f075d221700 1 --2- 172.21.15.146:0/4043864370 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0758130890 0x7f075811c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.941+0000 7f075d221700 1 -- 172.21.15.146:0/4043864370 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074800d940 con 0x7f0758099e20 2023-10-03T10:15:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.941+0000 7f075ca20700 1 --2- 172.21.15.146:0/4043864370 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f075809a730 0x7f075811bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.941+0000 7f075d221700 1 --2- 172.21.15.146:0/4043864370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0758099e20 0x7f075811b770 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f075400bcf0 tx=0x7f0754004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.941+0000 7f074dffb700 1 -- 172.21.15.146:0/4043864370 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075400c850 con 0x7f0758099e20 2023-10-03T10:15:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.941+0000 7f074dffb700 1 -- 172.21.15.146:0/4043864370 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075400c9d0 con 0x7f0758099e20 2023-10-03T10:15:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.941+0000 7f074dffb700 1 -- 172.21.15.146:0/4043864370 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075400cd80 con 0x7f0758099e20 2023-10-03T10:15:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.941+0000 7f075f485700 1 -- 172.21.15.146:0/4043864370 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075400b5b0 con 0x7f0758099e20 2023-10-03T10:15:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.941+0000 7f075f485700 1 -- 172.21.15.146:0/4043864370 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075811f000 con 0x7f0758099e20 2023-10-03T10:15:32.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.942+0000 7f075f485700 1 -- 172.21.15.146:0/4043864370 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07580a13f0 con 0x7f0758099e20 2023-10-03T10:15:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.943+0000 7f074dffb700 1 -- 172.21.15.146:0/4043864370 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f075400f460 con 0x7f0758099e20 2023-10-03T10:15:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.944+0000 7f074dffb700 1 -- 172.21.15.146:0/4043864370 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0754041540 con 0x7f0758099e20 2023-10-03T10:15:32.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.948+0000 7f074dffb700 1 -- 172.21.15.146:0/4043864370 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0754022950 con 0x7f0758099e20 2023-10-03T10:15:32.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.985+0000 7f3dd7d1c700 1 Processor -- start 2023-10-03T10:15:32.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.986+0000 7f3dd7d1c700 1 -- start start 2023-10-03T10:15:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.986+0000 7f3dd7d1c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3dd0133ad0 0x7f3dd0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.986+0000 7f3dd7d1c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3dd0130bc0 0x7f3dd013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.986+0000 7f3dd7d1c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd006b2d0 con 0x7f3dd01300a0 2023-10-03T10:15:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.986+0000 7f3dd7d1c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd0133610 con 0x7f3dd0130bc0 2023-10-03T10:15:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.986+0000 7f3dd7d1c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd009a500 con 0x7f3dd0133ad0 2023-10-03T10:15:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.986+0000 7f3dd5ab8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3dd0133ad0 0x7f3dd0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.986+0000 7f3dd5ab8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3dd0133ad0 0x7f3dd0133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45340/0 (socket says 172.21.15.146:45340) 2023-10-03T10:15:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.986+0000 7f3dd5ab8700 1 -- 172.21.15.146:0/2290572968 learned_addr learned my addr 172.21.15.146:0/2290572968 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:32.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.986+0000 7f3dd62b9700 1 --2- 172.21.15.146:0/2290572968 >> v2:172.21.15.146:3300/0 conn(0x7f3dd0130bc0 0x7f3dd013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.987+0000 7f3dd62b9700 1 -- 172.21.15.146:0/2290572968 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3dd0133ad0 msgr2=0x7f3dd0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:32.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.987+0000 7f3dd62b9700 1 --2- 172.21.15.146:0/2290572968 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3dd0133ad0 0x7f3dd0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.987+0000 7f3dd62b9700 1 -- 172.21.15.146:0/2290572968 >> v1:172.21.15.146:6789/0 conn(0x7f3dd01300a0 legacy=0x7f3dd01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.987+0000 7f3dd4ab6700 1 -- 172.21.15.146:0/2290572968 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2061809091 0 0) 0x7f3dd006b2d0 con 0x7f3dd01300a0 2023-10-03T10:15:32.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.987+0000 7f3dd62b9700 1 -- 172.21.15.146:0/2290572968 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd01338b0 con 0x7f3dd0130bc0 2023-10-03T10:15:32.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.987+0000 7f3dd5ab8700 1 --2- 172.21.15.146:0/2290572968 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3dd0133ad0 0x7f3dd0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:32.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.987+0000 7f3dd62b9700 1 --2- 172.21.15.146:0/2290572968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dd0130bc0 0x7f3dd013b990 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009d90 tx=0x7f3dc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16cab3a1d0842bdc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.987+0000 7f3dd4ab6700 1 -- 172.21.15.146:0/2290572968 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc800e070 con 0x7f3dd0130bc0 2023-10-03T10:15:32.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.987+0000 7f3dd4ab6700 1 -- 172.21.15.146:0/2290572968 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc800bb20 con 0x7f3dd0130bc0 2023-10-03T10:15:32.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.987+0000 7f3dd4ab6700 1 -- 172.21.15.146:0/2290572968 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8012430 con 0x7f3dd0130bc0 2023-10-03T10:15:32.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.988+0000 7f3dd7d1c700 1 -- 172.21.15.146:0/2290572968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dd0130bc0 msgr2=0x7f3dd013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.988+0000 7f3dd7d1c700 1 --2- 172.21.15.146:0/2290572968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dd0130bc0 0x7f3dd013b990 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009d90 tx=0x7f3dc800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:32.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.988+0000 7f3dd7d1c700 1 -- 172.21.15.146:0/2290572968 shutdown_connections 2023-10-03T10:15:32.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.988+0000 7f3dd7d1c700 1 --2- 172.21.15.146:0/2290572968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dd0130bc0 0x7f3dd013b990 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.988+0000 7f3dd7d1c700 1 --2- 172.21.15.146:0/2290572968 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3dd0133ad0 0x7f3dd0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.988+0000 7f3dd7d1c700 1 -- 172.21.15.146:0/2290572968 >> 172.21.15.146:0/2290572968 conn(0x7f3dd0099c40 msgr2=0x7f3dd00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.988+0000 7f3dd7d1c700 1 -- 172.21.15.146:0/2290572968 shutdown_connections 2023-10-03T10:15:32.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.988+0000 7f3dd7d1c700 1 -- 172.21.15.146:0/2290572968 wait complete. 2023-10-03T10:15:32.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.989+0000 7f3dd7d1c700 1 Processor -- start 2023-10-03T10:15:32.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.989+0000 7f3dd7d1c700 1 -- start start 2023-10-03T10:15:32.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.990+0000 7f3dd7d1c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3dd01300a0 0x7f3dd011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.990+0000 7f3dd7d1c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dd0130bc0 0x7f3dd011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.990+0000 7f3dd7d1c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3dd0133ad0 0x7f3dd011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.990+0000 7f3dd7d1c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd01208e0 con 0x7f3dd0130bc0 2023-10-03T10:15:32.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.990+0000 7f3dd7d1c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd011f9d0 con 0x7f3dd0133ad0 2023-10-03T10:15:32.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.990+0000 7f3dd7d1c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd0120070 con 0x7f3dd01300a0 2023-10-03T10:15:32.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.990+0000 7f3dd62b9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3dd0133ad0 0x7f3dd011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.990+0000 7f3dd5ab8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3dd01300a0 0x7f3dd011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.990+0000 7f3dd62b9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3dd0133ad0 0x7f3dd011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34446/0 (socket says 172.21.15.146:34446) 2023-10-03T10:15:32.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.990+0000 7f3dd62b9700 1 -- 172.21.15.146:0/2593379162 learned_addr learned my addr 172.21.15.146:0/2593379162 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:32.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.990+0000 7f3dd52b7700 1 --2- 172.21.15.146:0/2593379162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dd0130bc0 0x7f3dd011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.990+0000 7f3dd5ab8700 1 -- 172.21.15.146:0/2593379162 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3dd0133ad0 msgr2=0x7f3dd011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.990+0000 7f3dd5ab8700 1 --2- 172.21.15.146:0/2593379162 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3dd0133ad0 0x7f3dd011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.991+0000 7f3dd5ab8700 1 -- 172.21.15.146:0/2593379162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dd0130bc0 msgr2=0x7f3dd011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.991+0000 7f3dd5ab8700 1 --2- 172.21.15.146:0/2593379162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dd0130bc0 0x7f3dd011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.991+0000 7f3dd5ab8700 1 -- 172.21.15.146:0/2593379162 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc009550 con 0x7f3dd01300a0 2023-10-03T10:15:32.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.991+0000 7f3dd5ab8700 1 --2- 172.21.15.146:0/2593379162 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3dd01300a0 0x7f3dd011da40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00e9a0 tx=0x7f3dcc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.991+0000 7f3dc67fc700 1 -- 172.21.15.146:0/2593379162 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc004030 con 0x7f3dd01300a0 2023-10-03T10:15:32.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.991+0000 7f3dd7d1c700 1 -- 172.21.15.146:0/2593379162 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc8009a70 con 0x7f3dd01300a0 2023-10-03T10:15:32.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.991+0000 7f3dc67fc700 1 -- 172.21.15.146:0/2593379162 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc004190 con 0x7f3dd01300a0 2023-10-03T10:15:32.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.991+0000 7f3dc67fc700 1 -- 172.21.15.146:0/2593379162 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc004520 con 0x7f3dd01300a0 2023-10-03T10:15:32.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.991+0000 7f3dd7d1c700 1 -- 172.21.15.146:0/2593379162 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd011eeb0 con 0x7f3dd01300a0 2023-10-03T10:15:32.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.992+0000 7f3dc67fc700 1 -- 172.21.15.146:0/2593379162 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3dcc0036a0 con 0x7f3dd01300a0 2023-10-03T10:15:32.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.992+0000 7f3dd7d1c700 1 -- 172.21.15.146:0/2593379162 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd011feb0 con 0x7f3dd01300a0 2023-10-03T10:15:32.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.992+0000 7f3dc67fc700 1 -- 172.21.15.146:0/2593379162 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3dcc03f600 con 0x7f3dd01300a0 2023-10-03T10:15:32.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:32.997+0000 7f3dc67fc700 1 -- 172.21.15.146:0/2593379162 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3dd011feb0 con 0x7f3dd01300a0 2023-10-03T10:15:33.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.041+0000 7faa426bd700 1 Processor -- start 2023-10-03T10:15:33.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.041+0000 7faa426bd700 1 -- start start 2023-10-03T10:15:33.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.042+0000 7faa426bd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faa3c09ad40 0x7faa3c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.042+0000 7faa426bd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa3c1343d0 0x7faa3c0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.042+0000 7faa426bd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa3c09b110 con 0x7faa3c133f70 2023-10-03T10:15:33.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.042+0000 7faa426bd700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa3c0a3b60 con 0x7faa3c09ad40 2023-10-03T10:15:33.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.042+0000 7faa426bd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c134850 con 0x7faa3c1343d0 2023-10-03T10:15:33.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.042+0000 7faa3bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faa3c09ad40 0x7faa3c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.042+0000 7faa3bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faa3c09ad40 0x7faa3c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41144/0 (socket says 172.21.15.146:41144) 2023-10-03T10:15:33.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.042+0000 7faa3bfff700 1 -- 172.21.15.146:0/2156516775 learned_addr learned my addr 172.21.15.146:0/2156516775 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:33.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.042+0000 7faa40c5a700 1 --2- 172.21.15.146:0/2156516775 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa3c1343d0 0x7faa3c0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.042+0000 7faa3bfff700 1 -- 172.21.15.146:0/2156516775 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa3c1343d0 msgr2=0x7faa3c0a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:33.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.042+0000 7faa3bfff700 1 --2- 172.21.15.146:0/2156516775 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa3c1343d0 0x7faa3c0a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.042+0000 7faa3bfff700 1 -- 172.21.15.146:0/2156516775 >> v1:172.21.15.146:6789/0 conn(0x7faa3c133f70 legacy=0x7faa3c0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.042+0000 7faa3affd700 1 -- 172.21.15.146:0/2156516775 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457905888 0 0) 0x7faa3c09b110 con 0x7faa3c133f70 2023-10-03T10:15:33.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.043+0000 7faa3bfff700 1 -- 172.21.15.146:0/2156516775 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3c0a2fa0 con 0x7faa3c09ad40 2023-10-03T10:15:33.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.043+0000 7faa3bfff700 1 --2- 172.21.15.146:0/2156516775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa3c09ad40 0x7faa3c133a30 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7faa2c0098f0 tx=0x7faa2c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5982a48d39f95bd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:33.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.043+0000 7faa3affd700 1 -- 172.21.15.146:0/2156516775 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2c011830 con 0x7faa3c09ad40 2023-10-03T10:15:33.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.043+0000 7faa3affd700 1 -- 172.21.15.146:0/2156516775 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2c011990 con 0x7faa3c09ad40 2023-10-03T10:15:33.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.043+0000 7faa3affd700 1 -- 172.21.15.146:0/2156516775 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2c011d20 con 0x7faa3c09ad40 2023-10-03T10:15:33.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.044+0000 7faa426bd700 1 -- 172.21.15.146:0/2156516775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa3c09ad40 msgr2=0x7faa3c133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.044+0000 7faa426bd700 1 --2- 172.21.15.146:0/2156516775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa3c09ad40 0x7faa3c133a30 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7faa2c0098f0 tx=0x7faa2c009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:33.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.044+0000 7faa426bd700 1 -- 172.21.15.146:0/2156516775 shutdown_connections 2023-10-03T10:15:33.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.044+0000 7faa426bd700 1 --2- 172.21.15.146:0/2156516775 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa3c1343d0 0x7faa3c0a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.044+0000 7faa426bd700 1 --2- 172.21.15.146:0/2156516775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa3c09ad40 0x7faa3c133a30 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.044+0000 7faa426bd700 1 -- 172.21.15.146:0/2156516775 >> 172.21.15.146:0/2156516775 conn(0x7faa3c099c40 msgr2=0x7faa3c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:33.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.044+0000 7faa426bd700 1 -- 172.21.15.146:0/2156516775 shutdown_connections 2023-10-03T10:15:33.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.044+0000 7faa426bd700 1 -- 172.21.15.146:0/2156516775 wait complete. 2023-10-03T10:15:33.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.045+0000 7faa426bd700 1 Processor -- start 2023-10-03T10:15:33.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.045+0000 7faa426bd700 1 -- start start 2023-10-03T10:15:33.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.045+0000 7faa426bd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faa3c09ad40 0x7faa3c11e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.045+0000 7faa426bd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa3c133f70 0x7faa3c11e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.045+0000 7faa426bd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa3c1343d0 0x7faa3c11ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.045+0000 7faa426bd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c121700 con 0x7faa3c1343d0 2023-10-03T10:15:33.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.045+0000 7faa426bd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c1219c0 con 0x7faa3c133f70 2023-10-03T10:15:33.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.045+0000 7faa426bd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c11fea0 con 0x7faa3c09ad40 2023-10-03T10:15:33.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.045+0000 7faa40c5a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa3c1343d0 0x7faa3c11ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.045+0000 7faa40c5a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa3c1343d0 0x7faa3c11ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41146/0 (socket says 172.21.15.146:41146) 2023-10-03T10:15:33.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.045+0000 7faa40c5a700 1 -- 172.21.15.146:0/652044165 learned_addr learned my addr 172.21.15.146:0/652044165 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:33.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.046+0000 7faa40c5a700 1 -- 172.21.15.146:0/652044165 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faa3c09ad40 msgr2=0x7faa3c11e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.046+0000 7faa3bfff700 1 --2- 172.21.15.146:0/652044165 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faa3c09ad40 0x7faa3c11e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.046+0000 7faa40c5a700 1 --2- 172.21.15.146:0/652044165 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faa3c09ad40 0x7faa3c11e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.046+0000 7faa40c5a700 1 -- 172.21.15.146:0/652044165 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa3c133f70 msgr2=0x7faa3c11e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.046+0000 7faa3b7fe700 1 --2- 172.21.15.146:0/652044165 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa3c133f70 0x7faa3c11e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.046+0000 7faa40c5a700 1 --2- 172.21.15.146:0/652044165 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa3c133f70 0x7faa3c11e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.046+0000 7faa40c5a700 1 -- 172.21.15.146:0/652044165 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2c009550 con 0x7faa3c1343d0 2023-10-03T10:15:33.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.046+0000 7faa3bfff700 1 --2- 172.21.15.146:0/652044165 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faa3c09ad40 0x7faa3c11e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:33.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.046+0000 7faa3b7fe700 1 --2- 172.21.15.146:0/652044165 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa3c133f70 0x7faa3c11e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:33.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.046+0000 7faa40c5a700 1 --2- 172.21.15.146:0/652044165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa3c1343d0 0x7faa3c11ec00 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7faa34009dd0 tx=0x7faa3400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:33.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.046+0000 7faa38ff9700 1 -- 172.21.15.146:0/652044165 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3400cd40 con 0x7faa3c1343d0 2023-10-03T10:15:33.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.046+0000 7faa38ff9700 1 -- 172.21.15.146:0/652044165 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3400f040 con 0x7faa3c1343d0 2023-10-03T10:15:33.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.046+0000 7faa38ff9700 1 -- 172.21.15.146:0/652044165 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa340146c0 con 0x7faa3c1343d0 2023-10-03T10:15:33.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.046+0000 7faa426bd700 1 -- 172.21.15.146:0/652044165 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa3c0a5dc0 con 0x7faa3c1343d0 2023-10-03T10:15:33.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.046+0000 7faa426bd700 1 -- 172.21.15.146:0/652044165 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa3c121ca0 con 0x7faa3c1343d0 2023-10-03T10:15:33.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.048+0000 7faa38ff9700 1 -- 172.21.15.146:0/652044165 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa34014820 con 0x7faa3c1343d0 2023-10-03T10:15:33.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.048+0000 7faa38ff9700 1 -- 172.21.15.146:0/652044165 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faa34040040 con 0x7faa3c1343d0 2023-10-03T10:15:33.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.048+0000 7faa426bd700 1 -- 172.21.15.146:0/652044165 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa3c121b00 con 0x7faa3c1343d0 2023-10-03T10:15:33.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.053+0000 7faa38ff9700 1 -- 172.21.15.146:0/652044165 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa3c121b00 con 0x7faa3c1343d0 2023-10-03T10:15:33.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.064+0000 7fc87a1e5700 1 Processor -- start 2023-10-03T10:15:33.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.064+0000 7fc87a1e5700 1 -- start start 2023-10-03T10:15:33.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.065+0000 7fc87a1e5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc87409e950 0x7fc87409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.065+0000 7fc87a1e5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc874131fa0 0x7fc874139af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.065+0000 7fc87a1e5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc87409afb0 con 0x7fc87409f260 2023-10-03T10:15:33.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.065+0000 7fc87a1e5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8740a0970 con 0x7fc87409e950 2023-10-03T10:15:33.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.065+0000 7fc87a1e5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8740a0320 con 0x7fc874131fa0 2023-10-03T10:15:33.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.065+0000 7fc873fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc874131fa0 0x7fc874139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.065+0000 7fc873fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc874131fa0 0x7fc874139af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:45364/0 (socket says 172.21.15.146:45364) 2023-10-03T10:15:33.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.065+0000 7fc873fff700 1 -- 172.21.15.146:0/2597871982 learned_addr learned my addr 172.21.15.146:0/2597871982 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:33.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.065+0000 7fc8737fe700 1 --2- 172.21.15.146:0/2597871982 >> v2:172.21.15.146:3300/0 conn(0x7fc87409e950 0x7fc87409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.066+0000 7fc8737fe700 1 -- 172.21.15.146:0/2597871982 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc874131fa0 msgr2=0x7fc874139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:33.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.066+0000 7fc8737fe700 1 --2- 172.21.15.146:0/2597871982 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc874131fa0 0x7fc874139af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.066+0000 7fc8737fe700 1 -- 172.21.15.146:0/2597871982 >> v1:172.21.15.146:6789/0 conn(0x7fc87409f260 legacy=0x7fc874131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.066+0000 7fc8737fe700 1 -- 172.21.15.146:0/2597871982 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8740a0750 con 0x7fc87409e950 2023-10-03T10:15:33.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.066+0000 7fc8737fe700 1 --2- 172.21.15.146:0/2597871982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc87409e950 0x7fc87409ed20 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fc864009820 tx=0x7fc864009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c4d34e3709be6b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:33.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.066+0000 7fc8727fc700 1 -- 172.21.15.146:0/2597871982 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc864005c30 con 0x7fc87409e950 2023-10-03T10:15:33.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.066+0000 7fc8727fc700 1 -- 172.21.15.146:0/2597871982 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc864005d90 con 0x7fc87409e950 2023-10-03T10:15:33.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.066+0000 7fc8727fc700 1 -- 172.21.15.146:0/2597871982 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc864006250 con 0x7fc87409e950 2023-10-03T10:15:33.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.066+0000 7fc87a1e5700 1 -- 172.21.15.146:0/2597871982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc87409e950 msgr2=0x7fc87409ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.066+0000 7fc87a1e5700 1 --2- 172.21.15.146:0/2597871982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc87409e950 0x7fc87409ed20 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fc864009820 tx=0x7fc864009b30 comp rx=0 tx=0).stop 2023-10-03T10:15:33.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.067+0000 7fc87a1e5700 1 -- 172.21.15.146:0/2597871982 shutdown_connections 2023-10-03T10:15:33.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.067+0000 7fc87a1e5700 1 --2- 172.21.15.146:0/2597871982 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc874131fa0 0x7fc874139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.067+0000 7fc87a1e5700 1 --2- 172.21.15.146:0/2597871982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc87409e950 0x7fc87409ed20 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.067+0000 7fc87a1e5700 1 -- 172.21.15.146:0/2597871982 >> 172.21.15.146:0/2597871982 conn(0x7fc8740a0f70 msgr2=0x7fc8740a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:33.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.067+0000 7fc87a1e5700 1 -- 172.21.15.146:0/2597871982 shutdown_connections 2023-10-03T10:15:33.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.067+0000 7fc87a1e5700 1 -- 172.21.15.146:0/2597871982 wait complete. 2023-10-03T10:15:33.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.068+0000 7fc87a1e5700 1 Processor -- start 2023-10-03T10:15:33.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.068+0000 7fc87a1e5700 1 -- start start 2023-10-03T10:15:33.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.069+0000 7fc87a1e5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc87409e950 0x7fc87411e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.069+0000 7fc87a1e5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc87409f260 0x7fc87411ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.069+0000 7fc87a1e5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc874131fa0 0x7fc87411ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.069+0000 7fc87a1e5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc874121f50 con 0x7fc874131fa0 2023-10-03T10:15:33.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.069+0000 7fc87a1e5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc874120040 con 0x7fc87409e950 2023-10-03T10:15:33.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.069+0000 7fc87a1e5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8741205f0 con 0x7fc87409f260 2023-10-03T10:15:33.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.069+0000 7fc873fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc874131fa0 0x7fc87411ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.069+0000 7fc873fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc874131fa0 0x7fc87411ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41162/0 (socket says 172.21.15.146:41162) 2023-10-03T10:15:33.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.069+0000 7fc873fff700 1 -- 172.21.15.146:0/4156920569 learned_addr learned my addr 172.21.15.146:0/4156920569 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:33.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.069+0000 7fc872ffd700 1 --2- 172.21.15.146:0/4156920569 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc87409f260 0x7fc87411ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.069+0000 7fc8737fe700 1 --2- 172.21.15.146:0/4156920569 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc87409e950 0x7fc87411e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.069+0000 7fc873fff700 1 -- 172.21.15.146:0/4156920569 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc87409f260 msgr2=0x7fc87411ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.069+0000 7fc873fff700 1 --2- 172.21.15.146:0/4156920569 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc87409f260 0x7fc87411ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.069+0000 7fc873fff700 1 -- 172.21.15.146:0/4156920569 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc87409e950 msgr2=0x7fc87411e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.069+0000 7fc873fff700 1 --2- 172.21.15.146:0/4156920569 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc87409e950 0x7fc87411e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.069+0000 7fc873fff700 1 -- 172.21.15.146:0/4156920569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc864009430 con 0x7fc874131fa0 2023-10-03T10:15:33.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.069+0000 7fc872ffd700 1 --2- 172.21.15.146:0/4156920569 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc87409f260 0x7fc87411ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:33.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.070+0000 7fc873fff700 1 --2- 172.21.15.146:0/4156920569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc874131fa0 0x7fc87411ef50 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fc86c004400 tx=0x7fc86c004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:33.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.070+0000 7fc85bfff700 1 -- 172.21.15.146:0/4156920569 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00f4e0 con 0x7fc874131fa0 2023-10-03T10:15:33.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.070+0000 7fc85bfff700 1 -- 172.21.15.146:0/4156920569 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86c018020 con 0x7fc874131fa0 2023-10-03T10:15:33.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.070+0000 7fc87a1e5700 1 -- 172.21.15.146:0/4156920569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8740a4d50 con 0x7fc874131fa0 2023-10-03T10:15:33.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.070+0000 7fc85bfff700 1 -- 172.21.15.146:0/4156920569 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00f880 con 0x7fc874131fa0 2023-10-03T10:15:33.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.070+0000 7fc87a1e5700 1 -- 172.21.15.146:0/4156920569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8741226e0 con 0x7fc874131fa0 2023-10-03T10:15:33.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.071+0000 7fc87a1e5700 1 -- 172.21.15.146:0/4156920569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc87404f2a0 con 0x7fc874131fa0 2023-10-03T10:15:33.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.071+0000 7fc85bfff700 1 -- 172.21.15.146:0/4156920569 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc86c011110 con 0x7fc874131fa0 2023-10-03T10:15:33.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.071+0000 7fc85bfff700 1 -- 172.21.15.146:0/4156920569 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc86c019030 con 0x7fc874131fa0 2023-10-03T10:15:33.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.076+0000 7fc85bfff700 1 -- 172.21.15.146:0/4156920569 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc86c0113c0 con 0x7fc874131fa0 2023-10-03T10:15:33.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.151+0000 7f075f485700 1 -- 172.21.15.146:0/4043864370 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f075811f000 con 0x7f0758099e20 2023-10-03T10:15:33.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.151+0000 7f074dffb700 1 -- 172.21.15.146:0/4043864370 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f075811f000 con 0x7f0758099e20 2023-10-03T10:15:33.152 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:33.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.155+0000 7f075f485700 1 -- 172.21.15.146:0/4043864370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0758099e20 msgr2=0x7f075811b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.155+0000 7f075f485700 1 --2- 172.21.15.146:0/4043864370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0758099e20 0x7f075811b770 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f075400bcf0 tx=0x7f0754004750 comp rx=0 tx=0).stop 2023-10-03T10:15:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.155+0000 7f075f485700 1 -- 172.21.15.146:0/4043864370 shutdown_connections 2023-10-03T10:15:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.155+0000 7f075f485700 1 --2- 172.21.15.146:0/4043864370 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0758130890 0x7f075811c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.155+0000 7f075f485700 1 --2- 172.21.15.146:0/4043864370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0758099e20 0x7f075811b770 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.155+0000 7f075f485700 1 --2- 172.21.15.146:0/4043864370 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f075809a730 0x7f075811bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.155+0000 7f075f485700 1 -- 172.21.15.146:0/4043864370 >> 172.21.15.146:0/4043864370 conn(0x7f07580a2980 msgr2=0x7f075809f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.155+0000 7f075f485700 1 -- 172.21.15.146:0/4043864370 shutdown_connections 2023-10-03T10:15:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.155+0000 7f075f485700 1 -- 172.21.15.146:0/4043864370 wait complete. 2023-10-03T10:15:33.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:33.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.234+0000 7f3dd7d1c700 1 -- 172.21.15.146:0/2593379162 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3dd009cb20 con 0x7f3dd01300a0 2023-10-03T10:15:33.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.234+0000 7f3dc67fc700 1 -- 172.21.15.146:0/2593379162 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3dcc019d60 con 0x7f3dd01300a0 2023-10-03T10:15:33.235 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:33.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.236+0000 7f3dd7d1c700 1 -- 172.21.15.146:0/2593379162 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3dd01300a0 msgr2=0x7f3dd011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.236+0000 7f3dd7d1c700 1 --2- 172.21.15.146:0/2593379162 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3dd01300a0 0x7f3dd011da40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00e9a0 tx=0x7f3dcc00ecb0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.237+0000 7f3dd7d1c700 1 -- 172.21.15.146:0/2593379162 shutdown_connections 2023-10-03T10:15:33.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.237+0000 7f3dd7d1c700 1 --2- 172.21.15.146:0/2593379162 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3dd0133ad0 0x7f3dd011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.237+0000 7f3dd7d1c700 1 --2- 172.21.15.146:0/2593379162 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3dd01300a0 0x7f3dd011da40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.237+0000 7f3dd7d1c700 1 --2- 172.21.15.146:0/2593379162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dd0130bc0 0x7f3dd011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.237+0000 7f3dd7d1c700 1 -- 172.21.15.146:0/2593379162 >> 172.21.15.146:0/2593379162 conn(0x7f3dd0099c40 msgr2=0x7f3dd0132950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:33.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.237+0000 7f3dd7d1c700 1 -- 172.21.15.146:0/2593379162 shutdown_connections 2023-10-03T10:15:33.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.237+0000 7f3dd7d1c700 1 -- 172.21.15.146:0/2593379162 wait complete. 2023-10-03T10:15:33.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:33.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.272+0000 7faa426bd700 1 -- 172.21.15.146:0/652044165 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faa3c121b00 con 0x7faa3c1343d0 2023-10-03T10:15:33.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.272+0000 7fc87a1e5700 1 -- 172.21.15.146:0/4156920569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc87409da40 con 0x7fc874131fa0 2023-10-03T10:15:33.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.272+0000 7faa38ff9700 1 -- 172.21.15.146:0/652044165 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa3c121b00 con 0x7faa3c1343d0 2023-10-03T10:15:33.273 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:33.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.272+0000 7fc85bfff700 1 -- 172.21.15.146:0/4156920569 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc86c00b370 con 0x7fc874131fa0 2023-10-03T10:15:33.274 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:33.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.274+0000 7faa426bd700 1 -- 172.21.15.146:0/652044165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa3c1343d0 msgr2=0x7faa3c11ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.274+0000 7faa426bd700 1 --2- 172.21.15.146:0/652044165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa3c1343d0 0x7faa3c11ec00 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7faa34009dd0 tx=0x7faa3400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.274+0000 7fc87a1e5700 1 -- 172.21.15.146:0/4156920569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc874131fa0 msgr2=0x7fc87411ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.274+0000 7fc87a1e5700 1 --2- 172.21.15.146:0/4156920569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc874131fa0 0x7fc87411ef50 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fc86c004400 tx=0x7fc86c004710 comp rx=0 tx=0).stop 2023-10-03T10:15:33.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.274+0000 7faa426bd700 1 -- 172.21.15.146:0/652044165 shutdown_connections 2023-10-03T10:15:33.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.274+0000 7faa426bd700 1 --2- 172.21.15.146:0/652044165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa3c1343d0 0x7faa3c11ec00 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.274+0000 7fc87a1e5700 1 -- 172.21.15.146:0/4156920569 shutdown_connections 2023-10-03T10:15:33.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.274+0000 7faa426bd700 1 --2- 172.21.15.146:0/652044165 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faa3c09ad40 0x7faa3c11e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.274+0000 7faa426bd700 1 --2- 172.21.15.146:0/652044165 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa3c133f70 0x7faa3c11e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.274+0000 7faa426bd700 1 -- 172.21.15.146:0/652044165 >> 172.21.15.146:0/652044165 conn(0x7faa3c099c40 msgr2=0x7faa3c0a4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:33.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.274+0000 7fc87a1e5700 1 --2- 172.21.15.146:0/4156920569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc874131fa0 0x7fc87411ef50 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.274+0000 7fc87a1e5700 1 --2- 172.21.15.146:0/4156920569 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc87409e950 0x7fc87411e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.274+0000 7fc87a1e5700 1 --2- 172.21.15.146:0/4156920569 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc87409f260 0x7fc87411ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.274+0000 7fc87a1e5700 1 -- 172.21.15.146:0/4156920569 >> 172.21.15.146:0/4156920569 conn(0x7fc8740a0f70 msgr2=0x7fc874071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:33.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.274+0000 7faa426bd700 1 -- 172.21.15.146:0/652044165 shutdown_connections 2023-10-03T10:15:33.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.274+0000 7fc87a1e5700 1 -- 172.21.15.146:0/4156920569 shutdown_connections 2023-10-03T10:15:33.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.274+0000 7fc87a1e5700 1 -- 172.21.15.146:0/4156920569 wait complete. 2023-10-03T10:15:33.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:33.274+0000 7faa426bd700 1 -- 172.21.15.146:0/652044165 wait complete. 2023-10-03T10:15:33.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:33.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:34.169 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:34.250 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:34.291 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:34.291 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.311+0000 7fc032d6b700 1 Processor -- start 2023-10-03T10:15:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.311+0000 7fc032d6b700 1 -- start start 2023-10-03T10:15:34.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.311+0000 7fc032d6b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc02c133900 0x7fc02c133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.311+0000 7fc032d6b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc02c0a10b0 0x7fc02c13b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.311+0000 7fc032d6b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc02c09a760 con 0x7fc02c134210 2023-10-03T10:15:34.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.311+0000 7fc032d6b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc02c1336e0 con 0x7fc02c133900 2023-10-03T10:15:34.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.311+0000 7fc032d6b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c09a080 con 0x7fc02c0a10b0 2023-10-03T10:15:34.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.311+0000 7fc02bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc02c134210 0x7fc02c0a09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35992/0 (socket says 172.21.15.146:35992) 2023-10-03T10:15:34.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.311+0000 7fc030b07700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc02c133900 0x7fc02c133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.311+0000 7fc02bfff700 1 -- 172.21.15.146:0/1275720420 learned_addr learned my addr 172.21.15.146:0/1275720420 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:34.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.311+0000 7fc031308700 1 --2- 172.21.15.146:0/1275720420 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc02c0a10b0 0x7fc02c13b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.312+0000 7fc02b7fe700 1 -- 172.21.15.146:0/1275720420 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692500187 0 0) 0x7fc02c09a760 con 0x7fc02c134210 2023-10-03T10:15:34.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.312+0000 7fc02b7fe700 1 -- 172.21.15.146:0/1275720420 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc01c0035b0 con 0x7fc02c134210 2023-10-03T10:15:34.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.312+0000 7fc030b07700 1 -- 172.21.15.146:0/1275720420 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc02c0a10b0 msgr2=0x7fc02c13b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.312+0000 7fc030b07700 1 --2- 172.21.15.146:0/1275720420 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc02c0a10b0 0x7fc02c13b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.312+0000 7fc030b07700 1 -- 172.21.15.146:0/1275720420 >> v1:172.21.15.146:6789/0 conn(0x7fc02c134210 legacy=0x7fc02c0a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.312+0000 7fc030b07700 1 -- 172.21.15.146:0/1275720420 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02c0a23e0 con 0x7fc02c133900 2023-10-03T10:15:34.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.312+0000 7fc030b07700 1 --2- 172.21.15.146:0/1275720420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc02c133900 0x7fc02c133cd0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc020009820 tx=0x7fc020009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30c08feea18e227 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.312+0000 7fc02b7fe700 1 -- 172.21.15.146:0/1275720420 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc020005e30 con 0x7fc02c133900 2023-10-03T10:15:34.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.312+0000 7fc02b7fe700 1 -- 172.21.15.146:0/1275720420 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc020006030 con 0x7fc02c133900 2023-10-03T10:15:34.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.312+0000 7fc02b7fe700 1 -- 172.21.15.146:0/1275720420 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0200063c0 con 0x7fc02c133900 2023-10-03T10:15:34.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.313+0000 7fc032d6b700 1 -- 172.21.15.146:0/1275720420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc02c133900 msgr2=0x7fc02c133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.313+0000 7fc032d6b700 1 --2- 172.21.15.146:0/1275720420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc02c133900 0x7fc02c133cd0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc020009820 tx=0x7fc020009b30 comp rx=0 tx=0).stop 2023-10-03T10:15:34.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.314+0000 7fc032d6b700 1 -- 172.21.15.146:0/1275720420 shutdown_connections 2023-10-03T10:15:34.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.314+0000 7fc032d6b700 1 --2- 172.21.15.146:0/1275720420 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc02c0a10b0 0x7fc02c13b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.314+0000 7fc032d6b700 1 --2- 172.21.15.146:0/1275720420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc02c133900 0x7fc02c133cd0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.314+0000 7fc032d6b700 1 -- 172.21.15.146:0/1275720420 >> 172.21.15.146:0/1275720420 conn(0x7fc02c0a2980 msgr2=0x7fc02c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.314+0000 7fc032d6b700 1 -- 172.21.15.146:0/1275720420 shutdown_connections 2023-10-03T10:15:34.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.314+0000 7fc032d6b700 1 -- 172.21.15.146:0/1275720420 wait complete. 2023-10-03T10:15:34.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.315+0000 7fc032d6b700 1 Processor -- start 2023-10-03T10:15:34.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.315+0000 7fc032d6b700 1 -- start start 2023-10-03T10:15:34.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.316+0000 7fc032d6b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc02c0a10b0 0x7fc02c11d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.316+0000 7fc032d6b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc02c133900 0x7fc02c11de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.316+0000 7fc032d6b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc02c134210 0x7fc02c11e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.316+0000 7fc032d6b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c121380 con 0x7fc02c133900 2023-10-03T10:15:34.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.316+0000 7fc032d6b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c11fa90 con 0x7fc02c0a10b0 2023-10-03T10:15:34.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.316+0000 7fc032d6b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c120b10 con 0x7fc02c134210 2023-10-03T10:15:34.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.316+0000 7fc030b07700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc02c0a10b0 0x7fc02c11d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.316+0000 7fc030b07700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc02c0a10b0 0x7fc02c11d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50256/0 (socket says 172.21.15.146:50256) 2023-10-03T10:15:34.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.316+0000 7fc030b07700 1 -- 172.21.15.146:0/920905187 learned_addr learned my addr 172.21.15.146:0/920905187 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:34.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.316+0000 7fc02bfff700 1 --2- 172.21.15.146:0/920905187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc02c133900 0x7fc02c11de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.316+0000 7fc031308700 1 --2- 172.21.15.146:0/920905187 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc02c134210 0x7fc02c11e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.316+0000 7fc030b07700 1 -- 172.21.15.146:0/920905187 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc02c134210 msgr2=0x7fc02c11e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.316+0000 7fc030b07700 1 --2- 172.21.15.146:0/920905187 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc02c134210 0x7fc02c11e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.316+0000 7fc030b07700 1 -- 172.21.15.146:0/920905187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc02c133900 msgr2=0x7fc02c11de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.316+0000 7fc030b07700 1 --2- 172.21.15.146:0/920905187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc02c133900 0x7fc02c11de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.316+0000 7fc030b07700 1 -- 172.21.15.146:0/920905187 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc020009430 con 0x7fc02c0a10b0 2023-10-03T10:15:34.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.316+0000 7fc02bfff700 1 --2- 172.21.15.146:0/920905187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc02c133900 0x7fc02c11de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.317+0000 7fc030b07700 1 --2- 172.21.15.146:0/920905187 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc02c0a10b0 0x7fc02c11d900 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc020009b70 tx=0x7fc020004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.317+0000 7fc0297fa700 1 -- 172.21.15.146:0/920905187 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0200061a0 con 0x7fc02c0a10b0 2023-10-03T10:15:34.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.317+0000 7fc0297fa700 1 -- 172.21.15.146:0/920905187 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc020020070 con 0x7fc02c0a10b0 2023-10-03T10:15:34.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.317+0000 7fc0297fa700 1 -- 172.21.15.146:0/920905187 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc020006560 con 0x7fc02c0a10b0 2023-10-03T10:15:34.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.317+0000 7fc032d6b700 1 -- 172.21.15.146:0/920905187 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc02c09a2c0 con 0x7fc02c0a10b0 2023-10-03T10:15:34.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.317+0000 7fc032d6b700 1 -- 172.21.15.146:0/920905187 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02c130c50 con 0x7fc02c0a10b0 2023-10-03T10:15:34.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.318+0000 7fc032d6b700 1 -- 172.21.15.146:0/920905187 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc02c11a590 con 0x7fc02c0a10b0 2023-10-03T10:15:34.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.320+0000 7fc0297fa700 1 -- 172.21.15.146:0/920905187 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc020022030 con 0x7fc02c0a10b0 2023-10-03T10:15:34.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.321+0000 7fc0297fa700 1 -- 172.21.15.146:0/920905187 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc0200427f0 con 0x7fc02c0a10b0 2023-10-03T10:15:34.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.326+0000 7fc0297fa700 1 -- 172.21.15.146:0/920905187 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc020046060 con 0x7fc02c0a10b0 2023-10-03T10:15:34.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.388+0000 7f97a50e7700 1 Processor -- start 2023-10-03T10:15:34.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.388+0000 7f97a50e7700 1 -- start start 2023-10-03T10:15:34.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.388+0000 7f97a50e7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97a0131980 0x7f97a0131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.388+0000 7f97a50e7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97a009c790 0x7f97a0139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.388+0000 7f97a50e7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a00a1640 con 0x7f97a009bc70 2023-10-03T10:15:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.388+0000 7f97a50e7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a006eb30 con 0x7f97a009c790 2023-10-03T10:15:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.388+0000 7f97a50e7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97a00a22d0 con 0x7f97a0131980 2023-10-03T10:15:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.388+0000 7f979f59e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97a009c790 0x7f97a0139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.388+0000 7f979f59e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97a009c790 0x7f97a0139710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50262/0 (socket says 172.21.15.146:50262) 2023-10-03T10:15:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.388+0000 7f979f59e700 1 -- 172.21.15.146:0/3615085025 learned_addr learned my addr 172.21.15.146:0/3615085025 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.388+0000 7f979ed9d700 1 --2- 172.21.15.146:0/3615085025 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97a0131980 0x7f97a0131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.389+0000 7f979f59e700 1 -- 172.21.15.146:0/3615085025 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97a0131980 msgr2=0x7f97a0131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.389+0000 7f979f59e700 1 --2- 172.21.15.146:0/3615085025 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97a0131980 0x7f97a0131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.389+0000 7f979f59e700 1 -- 172.21.15.146:0/3615085025 >> v1:172.21.15.146:6789/0 conn(0x7f97a009bc70 legacy=0x7f97a009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.389+0000 7f979f59e700 1 -- 172.21.15.146:0/3615085025 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a0131550 con 0x7f97a009c790 2023-10-03T10:15:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.389+0000 7f979f59e700 1 --2- 172.21.15.146:0/3615085025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97a009c790 0x7f97a0139710 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9798009e80 tx=0x7f979800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe4370608203b457 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.389+0000 7f979dd9b700 1 -- 172.21.15.146:0/3615085025 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979800e070 con 0x7f97a009c790 2023-10-03T10:15:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.389+0000 7f979dd9b700 1 -- 172.21.15.146:0/3615085025 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979800b910 con 0x7f97a009c790 2023-10-03T10:15:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.389+0000 7f979dd9b700 1 -- 172.21.15.146:0/3615085025 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979800bc80 con 0x7f97a009c790 2023-10-03T10:15:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.390+0000 7f97a50e7700 1 -- 172.21.15.146:0/3615085025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97a009c790 msgr2=0x7f97a0139710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.390+0000 7f97a50e7700 1 --2- 172.21.15.146:0/3615085025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97a009c790 0x7f97a0139710 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9798009e80 tx=0x7f979800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.390+0000 7f97a50e7700 1 -- 172.21.15.146:0/3615085025 shutdown_connections 2023-10-03T10:15:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.390+0000 7f97a50e7700 1 --2- 172.21.15.146:0/3615085025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97a009c790 0x7f97a0139710 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.390+0000 7f97a50e7700 1 --2- 172.21.15.146:0/3615085025 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97a0131980 0x7f97a0131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.390+0000 7f97a50e7700 1 -- 172.21.15.146:0/3615085025 >> 172.21.15.146:0/3615085025 conn(0x7f97a00a2980 msgr2=0x7f97a00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.390+0000 7f97a50e7700 1 -- 172.21.15.146:0/3615085025 shutdown_connections 2023-10-03T10:15:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.390+0000 7f97a50e7700 1 -- 172.21.15.146:0/3615085025 wait complete. 2023-10-03T10:15:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.391+0000 7f97a50e7700 1 Processor -- start 2023-10-03T10:15:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.391+0000 7f97a50e7700 1 -- start start 2023-10-03T10:15:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.392+0000 7f97a50e7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97a009bc70 0x7f97a0099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.392+0000 7f97a50e7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97a009c790 0x7f97a0099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.392+0000 7f97a50e7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97a0131980 0x7f97a009a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.392+0000 7f97a50e7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a0120bd0 con 0x7f97a009c790 2023-10-03T10:15:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.392+0000 7f97a50e7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a0130e10 con 0x7f97a009bc70 2023-10-03T10:15:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.392+0000 7f97a50e7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97a012ed00 con 0x7f97a0131980 2023-10-03T10:15:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.392+0000 7f979f59e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97a0131980 0x7f97a009a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.392+0000 7f979f59e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97a0131980 0x7f97a009a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59418/0 (socket says 172.21.15.146:59418) 2023-10-03T10:15:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.392+0000 7f979f59e700 1 -- 172.21.15.146:0/3267421135 learned_addr learned my addr 172.21.15.146:0/3267421135 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.392+0000 7f979e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97a009c790 0x7f97a0099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.392+0000 7f979ed9d700 1 --2- 172.21.15.146:0/3267421135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97a009bc70 0x7f97a0099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.392+0000 7f979f59e700 1 -- 172.21.15.146:0/3267421135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97a009bc70 msgr2=0x7f97a0099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.392+0000 7f979f59e700 1 --2- 172.21.15.146:0/3267421135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97a009bc70 0x7f97a0099a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.392+0000 7f979f59e700 1 -- 172.21.15.146:0/3267421135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97a009c790 msgr2=0x7f97a0099fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.392+0000 7f979f59e700 1 --2- 172.21.15.146:0/3267421135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97a009c790 0x7f97a0099fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.392+0000 7f979f59e700 1 -- 172.21.15.146:0/3267421135 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9798009b30 con 0x7f97a0131980 2023-10-03T10:15:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.392+0000 7f979f59e700 1 --2- 172.21.15.146:0/3267421135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97a0131980 0x7f97a009a510 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f97a006e020 tx=0x7f9798004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.393+0000 7f97877fe700 1 -- 172.21.15.146:0/3267421135 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97980092e0 con 0x7f97a0131980 2023-10-03T10:15:34.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.393+0000 7f97877fe700 1 -- 172.21.15.146:0/3267421135 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9798007160 con 0x7f97a0131980 2023-10-03T10:15:34.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.393+0000 7f97877fe700 1 -- 172.21.15.146:0/3267421135 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798004470 con 0x7f97a0131980 2023-10-03T10:15:34.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.393+0000 7f97a50e7700 1 -- 172.21.15.146:0/3267421135 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a01210d0 con 0x7f97a0131980 2023-10-03T10:15:34.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.393+0000 7f97a50e7700 1 -- 172.21.15.146:0/3267421135 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a0120e10 con 0x7f97a0131980 2023-10-03T10:15:34.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.394+0000 7f97877fe700 1 -- 172.21.15.146:0/3267421135 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f97980045d0 con 0x7f97a0131980 2023-10-03T10:15:34.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.394+0000 7f97877fe700 1 -- 172.21.15.146:0/3267421135 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f97980409c0 con 0x7f97a0131980 2023-10-03T10:15:34.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.394+0000 7f97a50e7700 1 -- 172.21.15.146:0/3267421135 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a01206f0 con 0x7f97a0131980 2023-10-03T10:15:34.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.403+0000 7f97877fe700 1 -- 172.21.15.146:0/3267421135 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9798019350 con 0x7f97a0131980 2023-10-03T10:15:34.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.429+0000 7fcaf6a9e700 1 Processor -- start 2023-10-03T10:15:34.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.430+0000 7fcaf6a9e700 1 -- start start 2023-10-03T10:15:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.430+0000 7fcaf6a9e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcaf009e950 0x7fcaf009ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.430+0000 7fcaf6a9e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaf0131fa0 0x7fcaf0139af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.430+0000 7fcaf6a9e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaf009afb0 con 0x7fcaf009f260 2023-10-03T10:15:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.430+0000 7fcaf6a9e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf00a0970 con 0x7fcaf009e950 2023-10-03T10:15:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.430+0000 7fcaf6a9e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf00a0320 con 0x7fcaf0131fa0 2023-10-03T10:15:34.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.431+0000 7fcaf483a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcaf009e950 0x7fcaf009ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.431+0000 7fcaeffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcaf009f260 0x7fcaf0131890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36014/0 (socket says 172.21.15.146:36014) 2023-10-03T10:15:34.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.431+0000 7fcaeffff700 1 -- 172.21.15.146:0/2745158358 learned_addr learned my addr 172.21.15.146:0/2745158358 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:34.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.431+0000 7fcaf503b700 1 --2- 172.21.15.146:0/2745158358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaf0131fa0 0x7fcaf0139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.431+0000 7fcaf483a700 1 -- 172.21.15.146:0/2745158358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaf0131fa0 msgr2=0x7fcaf0139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.431+0000 7fcaf483a700 1 --2- 172.21.15.146:0/2745158358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaf0131fa0 0x7fcaf0139af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.431+0000 7fcaf483a700 1 -- 172.21.15.146:0/2745158358 >> v1:172.21.15.146:6789/0 conn(0x7fcaf009f260 legacy=0x7fcaf0131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.431+0000 7fcaef7fe700 1 -- 172.21.15.146:0/2745158358 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 626423099 0 0) 0x7fcaf009afb0 con 0x7fcaf009f260 2023-10-03T10:15:34.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.431+0000 7fcaf483a700 1 -- 172.21.15.146:0/2745158358 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf00a0750 con 0x7fcaf009e950 2023-10-03T10:15:34.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.431+0000 7fcaf483a700 1 --2- 172.21.15.146:0/2745158358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaf009e950 0x7fcaf009ed20 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fcae4009820 tx=0x7fcae4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745896baf6c04af server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.431+0000 7fcaef7fe700 1 -- 172.21.15.146:0/2745158358 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4005e30 con 0x7fcaf009e950 2023-10-03T10:15:34.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.431+0000 7fcaef7fe700 1 -- 172.21.15.146:0/2745158358 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae4006030 con 0x7fcaf009e950 2023-10-03T10:15:34.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.431+0000 7fcaef7fe700 1 -- 172.21.15.146:0/2745158358 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae40063c0 con 0x7fcaf009e950 2023-10-03T10:15:34.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.432+0000 7fcaf6a9e700 1 -- 172.21.15.146:0/2745158358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaf009e950 msgr2=0x7fcaf009ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.432+0000 7fcaf6a9e700 1 --2- 172.21.15.146:0/2745158358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaf009e950 0x7fcaf009ed20 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fcae4009820 tx=0x7fcae4009b30 comp rx=0 tx=0).stop 2023-10-03T10:15:34.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.432+0000 7fcaf6a9e700 1 -- 172.21.15.146:0/2745158358 shutdown_connections 2023-10-03T10:15:34.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.432+0000 7fcaf6a9e700 1 --2- 172.21.15.146:0/2745158358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaf0131fa0 0x7fcaf0139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.432+0000 7fcaf6a9e700 1 --2- 172.21.15.146:0/2745158358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaf009e950 0x7fcaf009ed20 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.432+0000 7fcaf6a9e700 1 -- 172.21.15.146:0/2745158358 >> 172.21.15.146:0/2745158358 conn(0x7fcaf00a0f70 msgr2=0x7fcaf00a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.432+0000 7fcaf6a9e700 1 -- 172.21.15.146:0/2745158358 shutdown_connections 2023-10-03T10:15:34.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.432+0000 7fcaf6a9e700 1 -- 172.21.15.146:0/2745158358 wait complete. 2023-10-03T10:15:34.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.433+0000 7fe5bc8bf700 1 Processor -- start 2023-10-03T10:15:34.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.433+0000 7fe5bc8bf700 1 -- start start 2023-10-03T10:15:34.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.433+0000 7fe5bc8bf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5b812d380 0x7fe5b812d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.433+0000 7fe5bc8bf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5b8099a60 0x7fe5b8099e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.433+0000 7fe5bc8bf700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b809bb90 con 0x7fe5b809a3d0 2023-10-03T10:15:34.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.433+0000 7fe5bc8bf700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b809c210 con 0x7fe5b8099a60 2023-10-03T10:15:34.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.433+0000 7fe5bc8bf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b809a870 con 0x7fe5b812d380 2023-10-03T10:15:34.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.434+0000 7fe5b6d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe5b809a3d0 0x7fe5b8137610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36030/0 (socket says 172.21.15.146:36030) 2023-10-03T10:15:34.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.434+0000 7fe5b6d9d700 1 -- 172.21.15.146:0/1651311543 learned_addr learned my addr 172.21.15.146:0/1651311543 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:34.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.434+0000 7fe5b659c700 1 --2- 172.21.15.146:0/1651311543 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5b812d380 0x7fe5b812d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.434+0000 7fe5b5d9b700 1 --2- 172.21.15.146:0/1651311543 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5b8099a60 0x7fe5b8099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.434+0000 7fcaf6a9e700 1 Processor -- start 2023-10-03T10:15:34.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.434+0000 7fe5b559a700 1 -- 172.21.15.146:0/1651311543 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3057153976 0 0) 0x7fe5b809bb90 con 0x7fe5b809a3d0 2023-10-03T10:15:34.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.434+0000 7fe5b559a700 1 -- 172.21.15.146:0/1651311543 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5a00035b0 con 0x7fe5b809a3d0 2023-10-03T10:15:34.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.434+0000 7fe5b659c700 1 -- 172.21.15.146:0/1651311543 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5b8099a60 msgr2=0x7fe5b8099e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.434+0000 7fe5b659c700 1 --2- 172.21.15.146:0/1651311543 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5b8099a60 0x7fe5b8099e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.434+0000 7fe5b659c700 1 -- 172.21.15.146:0/1651311543 >> v1:172.21.15.146:6789/0 conn(0x7fe5b809a3d0 legacy=0x7fe5b8137610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.434+0000 7fe5b659c700 1 -- 172.21.15.146:0/1651311543 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b809ced0 con 0x7fe5b812d380 2023-10-03T10:15:34.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.434+0000 7fe5b5d9b700 1 --2- 172.21.15.146:0/1651311543 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5b8099a60 0x7fe5b8099e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.434+0000 7fcaf6a9e700 1 -- start start 2023-10-03T10:15:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.435+0000 7fcaf6a9e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaf009e950 0x7fcaf0135a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.435+0000 7fcaf6a9e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaf009f260 0x7fcaf0135fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.435+0000 7fcaf6a9e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcaf0131fa0 0x7fcaf0136510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.435+0000 7fcaf6a9e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf0138410 con 0x7fcaf009e950 2023-10-03T10:15:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.435+0000 7fcaf6a9e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf01395b0 con 0x7fcaf009f260 2023-10-03T10:15:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.435+0000 7fcaf6a9e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf009d410 con 0x7fcaf0131fa0 2023-10-03T10:15:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.435+0000 7fcaf483a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaf009e950 0x7fcaf0135a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.435+0000 7fcaf483a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaf009e950 0x7fcaf0135a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39466/0 (socket says 172.21.15.146:39466) 2023-10-03T10:15:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.435+0000 7fcaf483a700 1 -- 172.21.15.146:0/2183830132 learned_addr learned my addr 172.21.15.146:0/2183830132 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.435+0000 7fcaf503b700 1 --2- 172.21.15.146:0/2183830132 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcaf0131fa0 0x7fcaf0136510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.435+0000 7fcaeffff700 1 --2- 172.21.15.146:0/2183830132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaf009f260 0x7fcaf0135fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.435+0000 7fcaf483a700 1 -- 172.21.15.146:0/2183830132 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcaf0131fa0 msgr2=0x7fcaf0136510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.435+0000 7fcaf483a700 1 --2- 172.21.15.146:0/2183830132 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcaf0131fa0 0x7fcaf0136510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.435+0000 7fcaf483a700 1 -- 172.21.15.146:0/2183830132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaf009f260 msgr2=0x7fcaf0135fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.435+0000 7fcaf483a700 1 --2- 172.21.15.146:0/2183830132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaf009f260 0x7fcaf0135fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.435+0000 7fcaf483a700 1 -- 172.21.15.146:0/2183830132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae4009430 con 0x7fcaf009e950 2023-10-03T10:15:34.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.436+0000 7fcaf483a700 1 --2- 172.21.15.146:0/2183830132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaf009e950 0x7fcaf0135a90 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fcae4009b70 tx=0x7fcae4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.435+0000 7fe5b659c700 1 --2- 172.21.15.146:0/1651311543 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5b812d380 0x7fe5b812d750 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8009850 tx=0x7fe5a8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3885cc3cce30fde9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.436+0000 7fe5b559a700 1 -- 172.21.15.146:0/1651311543 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8005e30 con 0x7fe5b812d380 2023-10-03T10:15:34.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.436+0000 7fe5b559a700 1 -- 172.21.15.146:0/1651311543 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a8006030 con 0x7fe5b812d380 2023-10-03T10:15:34.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.436+0000 7fe5b559a700 1 -- 172.21.15.146:0/1651311543 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a80063e0 con 0x7fe5b812d380 2023-10-03T10:15:34.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.436+0000 7fcaed7fa700 1 -- 172.21.15.146:0/2183830132 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4004040 con 0x7fcaf009e950 2023-10-03T10:15:34.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.436+0000 7fcaed7fa700 1 -- 172.21.15.146:0/2183830132 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae40041a0 con 0x7fcaf009e950 2023-10-03T10:15:34.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.436+0000 7fcaf6a9e700 1 -- 172.21.15.146:0/2183830132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf009da40 con 0x7fcaf009e950 2023-10-03T10:15:34.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.436+0000 7fcaed7fa700 1 -- 172.21.15.146:0/2183830132 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4004550 con 0x7fcaf009e950 2023-10-03T10:15:34.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.436+0000 7fcaf6a9e700 1 -- 172.21.15.146:0/2183830132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf0137eb0 con 0x7fcaf009e950 2023-10-03T10:15:34.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.437+0000 7fe5bc8bf700 1 -- 172.21.15.146:0/1651311543 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5b812d380 msgr2=0x7fe5b812d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.437+0000 7fe5bc8bf700 1 --2- 172.21.15.146:0/1651311543 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5b812d380 0x7fe5b812d750 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8009850 tx=0x7fe5a8009b60 comp rx=0 tx=0).stop 2023-10-03T10:15:34.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.437+0000 7fe5bc8bf700 1 -- 172.21.15.146:0/1651311543 shutdown_connections 2023-10-03T10:15:34.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.437+0000 7fe5bc8bf700 1 --2- 172.21.15.146:0/1651311543 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5b812d380 0x7fe5b812d750 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.437+0000 7fe5bc8bf700 1 --2- 172.21.15.146:0/1651311543 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5b8099a60 0x7fe5b8099e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.437+0000 7fe5bc8bf700 1 -- 172.21.15.146:0/1651311543 >> 172.21.15.146:0/1651311543 conn(0x7fe5b80a2980 msgr2=0x7fe5b80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.437+0000 7fcaed7fa700 1 -- 172.21.15.146:0/2183830132 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcae4022070 con 0x7fcaf009e950 2023-10-03T10:15:34.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.437+0000 7fe5bc8bf700 1 -- 172.21.15.146:0/1651311543 shutdown_connections 2023-10-03T10:15:34.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.437+0000 7fe5bc8bf700 1 -- 172.21.15.146:0/1651311543 wait complete. 2023-10-03T10:15:34.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.437+0000 7fcaed7fa700 1 -- 172.21.15.146:0/2183830132 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcae4041570 con 0x7fcaf009e950 2023-10-03T10:15:34.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.437+0000 7fcaf6a9e700 1 -- 172.21.15.146:0/2183830132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf004f2a0 con 0x7fcaf009e950 2023-10-03T10:15:34.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.438+0000 7fe5bc8bf700 1 Processor -- start 2023-10-03T10:15:34.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.439+0000 7fe5bc8bf700 1 -- start start 2023-10-03T10:15:34.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.439+0000 7fe5bc8bf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5b8099a60 0x7fe5b811aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.439+0000 7fe5bc8bf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5b809a3d0 0x7fe5b811afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.439+0000 7fe5bc8bf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5b812d380 0x7fe5b811b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.439+0000 7fe5bc8bf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b811e580 con 0x7fe5b809a3d0 2023-10-03T10:15:34.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.439+0000 7fe5bc8bf700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b80a1730 con 0x7fe5b812d380 2023-10-03T10:15:34.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.439+0000 7fe5bc8bf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b809af90 con 0x7fe5b8099a60 2023-10-03T10:15:34.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.439+0000 7fe5b6d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5b812d380 0x7fe5b811b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.439+0000 7fe5b6d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5b812d380 0x7fe5b811b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50290/0 (socket says 172.21.15.146:50290) 2023-10-03T10:15:34.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.439+0000 7fe5b6d9d700 1 -- 172.21.15.146:0/1963697618 learned_addr learned my addr 172.21.15.146:0/1963697618 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:34.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.440+0000 7fe5b6d9d700 1 -- 172.21.15.146:0/1963697618 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5b8099a60 msgr2=0x7fe5b811aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.440+0000 7fe5b6d9d700 1 --2- 172.21.15.146:0/1963697618 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5b8099a60 0x7fe5b811aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.440+0000 7fe5b6d9d700 1 -- 172.21.15.146:0/1963697618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5b809a3d0 msgr2=0x7fe5b811afa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:15:34.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.440+0000 7fe5b6d9d700 1 --2- 172.21.15.146:0/1963697618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5b809a3d0 0x7fe5b811afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.440+0000 7fe5b6d9d700 1 -- 172.21.15.146:0/1963697618 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac0094a0 con 0x7fe5b812d380 2023-10-03T10:15:34.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.440+0000 7fe5b6d9d700 1 --2- 172.21.15.146:0/1963697618 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5b812d380 0x7fe5b811b4e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe5b000cb40 tx=0x7fe5b000cf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.440+0000 7fe5a6ffd700 1 -- 172.21.15.146:0/1963697618 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b000ab50 con 0x7fe5b812d380 2023-10-03T10:15:34.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.440+0000 7fe5a6ffd700 1 -- 172.21.15.146:0/1963697618 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b000acb0 con 0x7fe5b812d380 2023-10-03T10:15:34.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.440+0000 7fe5bc8bf700 1 -- 172.21.15.146:0/1963697618 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a8009430 con 0x7fe5b812d380 2023-10-03T10:15:34.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.440+0000 7fe5a6ffd700 1 -- 172.21.15.146:0/1963697618 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0012620 con 0x7fe5b812d380 2023-10-03T10:15:34.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.440+0000 7fe5bc8bf700 1 -- 172.21.15.146:0/1963697618 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b811dd10 con 0x7fe5b812d380 2023-10-03T10:15:34.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.441+0000 7fe5a6ffd700 1 -- 172.21.15.146:0/1963697618 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe5b001b3b0 con 0x7fe5b812d380 2023-10-03T10:15:34.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.441+0000 7fe5a6ffd700 1 -- 172.21.15.146:0/1963697618 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe5b003f4c0 con 0x7fe5b812d380 2023-10-03T10:15:34.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.444+0000 7fcaed7fa700 1 -- 172.21.15.146:0/2183830132 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcae40199a0 con 0x7fcaf009e950 2023-10-03T10:15:34.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.444+0000 7fe5bc8bf700 1 -- 172.21.15.146:0/1963697618 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b811cc20 con 0x7fe5b812d380 2023-10-03T10:15:34.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.453+0000 7fe5a6ffd700 1 -- 172.21.15.146:0/1963697618 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5b0017080 con 0x7fe5b812d380 2023-10-03T10:15:34.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.528+0000 7fc032d6b700 1 -- 172.21.15.146:0/920905187 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc02c120720 con 0x7fc02c0a10b0 2023-10-03T10:15:34.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.529+0000 7fc0297fa700 1 -- 172.21.15.146:0/920905187 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc020046070 con 0x7fc02c0a10b0 2023-10-03T10:15:34.529 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:34.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.531+0000 7fc032d6b700 1 -- 172.21.15.146:0/920905187 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc02c0a10b0 msgr2=0x7fc02c11d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.531+0000 7fc032d6b700 1 --2- 172.21.15.146:0/920905187 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc02c0a10b0 0x7fc02c11d900 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc020009b70 tx=0x7fc020004750 comp rx=0 tx=0).stop 2023-10-03T10:15:34.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.531+0000 7fc032d6b700 1 -- 172.21.15.146:0/920905187 shutdown_connections 2023-10-03T10:15:34.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.531+0000 7fc032d6b700 1 --2- 172.21.15.146:0/920905187 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc02c134210 0x7fc02c11e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.531+0000 7fc032d6b700 1 --2- 172.21.15.146:0/920905187 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc02c0a10b0 0x7fc02c11d900 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.531+0000 7fc032d6b700 1 --2- 172.21.15.146:0/920905187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc02c133900 0x7fc02c11de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.531+0000 7fc032d6b700 1 -- 172.21.15.146:0/920905187 >> 172.21.15.146:0/920905187 conn(0x7fc02c0a2980 msgr2=0x7fc02c1bac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.532+0000 7fc032d6b700 1 -- 172.21.15.146:0/920905187 shutdown_connections 2023-10-03T10:15:34.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.532+0000 7fc032d6b700 1 -- 172.21.15.146:0/920905187 wait complete. 2023-10-03T10:15:34.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:34.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.601+0000 7f97a50e7700 1 -- 172.21.15.146:0/3267421135 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f97a0132240 con 0x7f97a0131980 2023-10-03T10:15:34.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.602+0000 7f97877fe700 1 -- 172.21.15.146:0/3267421135 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9798011b80 con 0x7f97a0131980 2023-10-03T10:15:34.602 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:34.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.604+0000 7f97a50e7700 1 -- 172.21.15.146:0/3267421135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97a0131980 msgr2=0x7f97a009a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.604+0000 7f97a50e7700 1 --2- 172.21.15.146:0/3267421135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97a0131980 0x7f97a009a510 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f97a006e020 tx=0x7f9798004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.604+0000 7f97a50e7700 1 -- 172.21.15.146:0/3267421135 shutdown_connections 2023-10-03T10:15:34.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.604+0000 7f97a50e7700 1 --2- 172.21.15.146:0/3267421135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97a0131980 0x7f97a009a510 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.604+0000 7f97a50e7700 1 --2- 172.21.15.146:0/3267421135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97a009bc70 0x7f97a0099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.604+0000 7f97a50e7700 1 --2- 172.21.15.146:0/3267421135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97a009c790 0x7f97a0099fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.604+0000 7f97a50e7700 1 -- 172.21.15.146:0/3267421135 >> 172.21.15.146:0/3267421135 conn(0x7f97a00a2980 msgr2=0x7f97a006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.604+0000 7f97a50e7700 1 -- 172.21.15.146:0/3267421135 shutdown_connections 2023-10-03T10:15:34.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.604+0000 7f97a50e7700 1 -- 172.21.15.146:0/3267421135 wait complete. 2023-10-03T10:15:34.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:34.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.644+0000 7fcaf6a9e700 1 -- 172.21.15.146:0/2183830132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcaf009b8b0 con 0x7fcaf009e950 2023-10-03T10:15:34.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.645+0000 7fcaed7fa700 1 -- 172.21.15.146:0/2183830132 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcae401b410 con 0x7fcaf009e950 2023-10-03T10:15:34.645 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:34.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.647+0000 7fcaf6a9e700 1 -- 172.21.15.146:0/2183830132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaf009e950 msgr2=0x7fcaf0135a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.647+0000 7fcaf6a9e700 1 --2- 172.21.15.146:0/2183830132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaf009e950 0x7fcaf0135a90 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fcae4009b70 tx=0x7fcae4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:34.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.647+0000 7fe5bc8bf700 1 -- 172.21.15.146:0/1963697618 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe5b804f2a0 con 0x7fe5b812d380 2023-10-03T10:15:34.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.647+0000 7fcaf6a9e700 1 -- 172.21.15.146:0/2183830132 shutdown_connections 2023-10-03T10:15:34.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.647+0000 7fcaf6a9e700 1 --2- 172.21.15.146:0/2183830132 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcaf0131fa0 0x7fcaf0136510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.647+0000 7fcaf6a9e700 1 --2- 172.21.15.146:0/2183830132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaf009e950 0x7fcaf0135a90 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.647+0000 7fcaf6a9e700 1 --2- 172.21.15.146:0/2183830132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaf009f260 0x7fcaf0135fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.647+0000 7fcaf6a9e700 1 -- 172.21.15.146:0/2183830132 >> 172.21.15.146:0/2183830132 conn(0x7fcaf00a0f70 msgr2=0x7fcaf013a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.647+0000 7fcaf6a9e700 1 -- 172.21.15.146:0/2183830132 shutdown_connections 2023-10-03T10:15:34.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.647+0000 7fcaf6a9e700 1 -- 172.21.15.146:0/2183830132 wait complete. 2023-10-03T10:15:34.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.647+0000 7fe5a6ffd700 1 -- 172.21.15.146:0/1963697618 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe5b00192c0 con 0x7fe5b812d380 2023-10-03T10:15:34.649 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:34.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.650+0000 7fe5bc8bf700 1 -- 172.21.15.146:0/1963697618 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5b812d380 msgr2=0x7fe5b811b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.650+0000 7fe5bc8bf700 1 --2- 172.21.15.146:0/1963697618 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5b812d380 0x7fe5b811b4e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe5b000cb40 tx=0x7fe5b000cf00 comp rx=0 tx=0).stop 2023-10-03T10:15:34.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.650+0000 7fe5bc8bf700 1 -- 172.21.15.146:0/1963697618 shutdown_connections 2023-10-03T10:15:34.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.650+0000 7fe5bc8bf700 1 --2- 172.21.15.146:0/1963697618 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5b812d380 0x7fe5b811b4e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.650+0000 7fe5bc8bf700 1 --2- 172.21.15.146:0/1963697618 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5b8099a60 0x7fe5b811aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.650+0000 7fe5bc8bf700 1 --2- 172.21.15.146:0/1963697618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5b809a3d0 0x7fe5b811afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.650+0000 7fe5bc8bf700 1 -- 172.21.15.146:0/1963697618 >> 172.21.15.146:0/1963697618 conn(0x7fe5b80a2980 msgr2=0x7fe5b812e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.650+0000 7fe5bc8bf700 1 -- 172.21.15.146:0/1963697618 shutdown_connections 2023-10-03T10:15:34.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:34.650+0000 7fe5bc8bf700 1 -- 172.21.15.146:0/1963697618 wait complete. 2023-10-03T10:15:34.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:34.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:35.545 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:35.617 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:35.662 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:35.664 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:35.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.683+0000 7f4bd5448700 1 Processor -- start 2023-10-03T10:15:35.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.683+0000 7f4bd5448700 1 -- start start 2023-10-03T10:15:35.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.684+0000 7f4bd5448700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4bd009e870 0x7f4bd009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.684+0000 7f4bd5448700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bd0134330 0x7f4bd013be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.684+0000 7f4bd5448700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd009fa00 con 0x7f4bd009f180 2023-10-03T10:15:35.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.684+0000 7f4bd5448700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd00a0370 con 0x7f4bd009e870 2023-10-03T10:15:35.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.684+0000 7f4bd5448700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd006bec0 con 0x7f4bd0134330 2023-10-03T10:15:35.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.684+0000 7f4bcf7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bd0134330 0x7f4bd013be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.684+0000 7f4bcf7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bd0134330 0x7f4bd013be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50294/0 (socket says 172.21.15.146:50294) 2023-10-03T10:15:35.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.684+0000 7f4bcf7fe700 1 -- 172.21.15.146:0/2061348219 learned_addr learned my addr 172.21.15.146:0/2061348219 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:35.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.684+0000 7f4bcf7fe700 1 -- 172.21.15.146:0/2061348219 >> v2:172.21.15.146:3300/0 conn(0x7f4bd009e870 msgr2=0x7f4bd009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:35.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.684+0000 7f4bcf7fe700 1 --2- 172.21.15.146:0/2061348219 >> v2:172.21.15.146:3300/0 conn(0x7f4bd009e870 0x7f4bd009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.684+0000 7f4bcf7fe700 1 -- 172.21.15.146:0/2061348219 >> v1:172.21.15.146:6789/0 conn(0x7f4bd009f180 legacy=0x7f4bd0133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.684+0000 7f4bcdffb700 1 -- 172.21.15.146:0/2061348219 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501822079 0 0) 0x7f4bd009fa00 con 0x7f4bd009f180 2023-10-03T10:15:35.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.684+0000 7f4bcf7fe700 1 -- 172.21.15.146:0/2061348219 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd009ada0 con 0x7f4bd0134330 2023-10-03T10:15:35.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.685+0000 7f4bcf7fe700 1 --2- 172.21.15.146:0/2061348219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bd0134330 0x7f4bd013be80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8009e50 tx=0x7f4bc800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eb94d5bf427343b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.685+0000 7f4bcdffb700 1 -- 172.21.15.146:0/2061348219 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc800e070 con 0x7f4bd0134330 2023-10-03T10:15:35.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.685+0000 7f4bcdffb700 1 -- 172.21.15.146:0/2061348219 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc800b9c0 con 0x7f4bd0134330 2023-10-03T10:15:35.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.685+0000 7f4bcdffb700 1 -- 172.21.15.146:0/2061348219 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc800bd50 con 0x7f4bd0134330 2023-10-03T10:15:35.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.686+0000 7f4bd5448700 1 -- 172.21.15.146:0/2061348219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bd0134330 msgr2=0x7f4bd013be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.686+0000 7f4bd5448700 1 --2- 172.21.15.146:0/2061348219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bd0134330 0x7f4bd013be80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8009e50 tx=0x7f4bc800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:35.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.686+0000 7f4bd5448700 1 -- 172.21.15.146:0/2061348219 shutdown_connections 2023-10-03T10:15:35.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.686+0000 7f4bd5448700 1 --2- 172.21.15.146:0/2061348219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bd0134330 0x7f4bd013be80 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.686+0000 7f4bd5448700 1 --2- 172.21.15.146:0/2061348219 >> v2:172.21.15.146:3300/0 conn(0x7f4bd009e870 0x7f4bd009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.686+0000 7f4bd5448700 1 -- 172.21.15.146:0/2061348219 >> 172.21.15.146:0/2061348219 conn(0x7f4bd00a4430 msgr2=0x7f4bd00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.686+0000 7f4bd5448700 1 -- 172.21.15.146:0/2061348219 shutdown_connections 2023-10-03T10:15:35.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.686+0000 7f4bd5448700 1 -- 172.21.15.146:0/2061348219 wait complete. 2023-10-03T10:15:35.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.687+0000 7f4bd5448700 1 Processor -- start 2023-10-03T10:15:35.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.687+0000 7f4bd5448700 1 -- start start 2023-10-03T10:15:35.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.688+0000 7f4bd5448700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bd009e870 0x7f4bd0122a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.688+0000 7f4bd5448700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bd009f180 0x7f4bd0122f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.688+0000 7f4bd5448700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bd0134330 0x7f4bd01234b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.688+0000 7f4bd5448700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd0126270 con 0x7f4bd009f180 2023-10-03T10:15:35.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.688+0000 7f4bd5448700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd0124750 con 0x7f4bd009e870 2023-10-03T10:15:35.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.688+0000 7f4bd5448700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd006cfa0 con 0x7f4bd0134330 2023-10-03T10:15:35.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.688+0000 7f4bceffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bd009e870 0x7f4bd0122a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.688+0000 7f4bce7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bd009f180 0x7f4bd0122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.688+0000 7f4bceffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bd009e870 0x7f4bd0122a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50310/0 (socket says 172.21.15.146:50310) 2023-10-03T10:15:35.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.688+0000 7f4bce7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bd009f180 0x7f4bd0122f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39482/0 (socket says 172.21.15.146:39482) 2023-10-03T10:15:35.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.688+0000 7f4bceffd700 1 -- 172.21.15.146:0/4046751821 learned_addr learned my addr 172.21.15.146:0/4046751821 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:35.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.688+0000 7f4bcf7fe700 1 --2- 172.21.15.146:0/4046751821 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bd0134330 0x7f4bd01234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.688+0000 7f4bce7fc700 1 -- 172.21.15.146:0/4046751821 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bd0134330 msgr2=0x7f4bd01234b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.688+0000 7f4bce7fc700 1 --2- 172.21.15.146:0/4046751821 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bd0134330 0x7f4bd01234b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.688+0000 7f4bce7fc700 1 -- 172.21.15.146:0/4046751821 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bd009e870 msgr2=0x7f4bd0122a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.688+0000 7f4bce7fc700 1 --2- 172.21.15.146:0/4046751821 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bd009e870 0x7f4bd0122a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.688+0000 7f4bce7fc700 1 -- 172.21.15.146:0/4046751821 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc8009b30 con 0x7f4bd009f180 2023-10-03T10:15:35.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.688+0000 7f4bce7fc700 1 --2- 172.21.15.146:0/4046751821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bd009f180 0x7f4bd0122f70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f4bc400c430 tx=0x7f4bc400c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.689+0000 7f4bb77fe700 1 -- 172.21.15.146:0/4046751821 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc40054e0 con 0x7f4bd009f180 2023-10-03T10:15:35.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.689+0000 7f4bb77fe700 1 -- 172.21.15.146:0/4046751821 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc400ce40 con 0x7f4bd009f180 2023-10-03T10:15:35.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.689+0000 7f4bd5448700 1 -- 172.21.15.146:0/4046751821 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd00a16d0 con 0x7f4bd009f180 2023-10-03T10:15:35.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.689+0000 7f4bd5448700 1 -- 172.21.15.146:0/4046751821 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd0126ce0 con 0x7f4bd009f180 2023-10-03T10:15:35.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.689+0000 7f4bb77fe700 1 -- 172.21.15.146:0/4046751821 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc40038c0 con 0x7f4bd009f180 2023-10-03T10:15:35.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.690+0000 7f4bb77fe700 1 -- 172.21.15.146:0/4046751821 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4bc4003a20 con 0x7f4bd009f180 2023-10-03T10:15:35.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.690+0000 7f4bb77fe700 1 -- 172.21.15.146:0/4046751821 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4bc403eab0 con 0x7f4bd009f180 2023-10-03T10:15:35.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.690+0000 7f4bd5448700 1 -- 172.21.15.146:0/4046751821 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd004f2a0 con 0x7f4bd009f180 2023-10-03T10:15:35.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.696+0000 7f4bb77fe700 1 -- 172.21.15.146:0/4046751821 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4bc4017070 con 0x7f4bd009f180 2023-10-03T10:15:35.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.759+0000 7fbce9bb0700 1 Processor -- start 2023-10-03T10:15:35.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.759+0000 7fbce9bb0700 1 -- start start 2023-10-03T10:15:35.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.760+0000 7fbce9bb0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbce40a1550 0x7fbce4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.760+0000 7fbce9bb0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbce4139200 0x7fbce413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.760+0000 7fbce9bb0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce409e9d0 con 0x7fbce40a0a70 2023-10-03T10:15:35.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.760+0000 7fbce9bb0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce409dc00 con 0x7fbce4139200 2023-10-03T10:15:35.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.760+0000 7fbce9bb0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbce409dec0 con 0x7fbce40a1550 2023-10-03T10:15:35.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.760+0000 7fbce3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbce4139200 0x7fbce413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.760+0000 7fbce37fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbce40a0a70 0x7fbce40a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36060/0 (socket says 172.21.15.146:36060) 2023-10-03T10:15:35.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.760+0000 7fbce37fe700 1 -- 172.21.15.146:0/3743502475 learned_addr learned my addr 172.21.15.146:0/3743502475 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:35.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.761+0000 7fbce2ffd700 1 --2- 172.21.15.146:0/3743502475 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbce40a1550 0x7fbce4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.761+0000 7fbce3fff700 1 -- 172.21.15.146:0/3743502475 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbce40a1550 msgr2=0x7fbce4138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:35.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.761+0000 7fbce3fff700 1 --2- 172.21.15.146:0/3743502475 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbce40a1550 0x7fbce4138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.761+0000 7fbce3fff700 1 -- 172.21.15.146:0/3743502475 >> v1:172.21.15.146:6789/0 conn(0x7fbce40a0a70 legacy=0x7fbce40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.761+0000 7fbce3fff700 1 -- 172.21.15.146:0/3743502475 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce409e6a0 con 0x7fbce4139200 2023-10-03T10:15:35.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.761+0000 7fbce3fff700 1 --2- 172.21.15.146:0/3743502475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce4139200 0x7fbce413b5e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009d90 tx=0x7fbcdc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f547eb94b7a404 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.761+0000 7fbce27fc700 1 -- 172.21.15.146:0/3743502475 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc00e070 con 0x7fbce4139200 2023-10-03T10:15:35.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.761+0000 7fbce27fc700 1 -- 172.21.15.146:0/3743502475 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc00bb20 con 0x7fbce4139200 2023-10-03T10:15:35.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.761+0000 7fbce27fc700 1 -- 172.21.15.146:0/3743502475 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc012430 con 0x7fbce4139200 2023-10-03T10:15:35.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.762+0000 7fbce9bb0700 1 -- 172.21.15.146:0/3743502475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce4139200 msgr2=0x7fbce413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.762+0000 7fbce9bb0700 1 --2- 172.21.15.146:0/3743502475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce4139200 0x7fbce413b5e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009d90 tx=0x7fbcdc00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:35.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.762+0000 7fbce9bb0700 1 -- 172.21.15.146:0/3743502475 shutdown_connections 2023-10-03T10:15:35.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.762+0000 7fbce9bb0700 1 --2- 172.21.15.146:0/3743502475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce4139200 0x7fbce413b5e0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.762+0000 7fbce9bb0700 1 --2- 172.21.15.146:0/3743502475 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbce40a1550 0x7fbce4138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.762+0000 7fbce9bb0700 1 -- 172.21.15.146:0/3743502475 >> 172.21.15.146:0/3743502475 conn(0x7fbce40a6610 msgr2=0x7fbce40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.762+0000 7fbce9bb0700 1 -- 172.21.15.146:0/3743502475 shutdown_connections 2023-10-03T10:15:35.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.763+0000 7fbce9bb0700 1 -- 172.21.15.146:0/3743502475 wait complete. 2023-10-03T10:15:35.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.764+0000 7fbce9bb0700 1 Processor -- start 2023-10-03T10:15:35.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.764+0000 7fbce9bb0700 1 -- start start 2023-10-03T10:15:35.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.765+0000 7fbce9bb0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbce40a0a70 0x7fbce411e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.765+0000 7fbce9bb0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce40a1550 0x7fbce411ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.765+0000 7fbce9bb0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbce4139200 0x7fbce411f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.765+0000 7fbce9bb0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce4134150 con 0x7fbce40a1550 2023-10-03T10:15:35.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.765+0000 7fbce9bb0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce4134730 con 0x7fbce4139200 2023-10-03T10:15:35.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.765+0000 7fbce9bb0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbce41204f0 con 0x7fbce40a0a70 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.765+0000 7fbce37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbce40a0a70 0x7fbce411e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.765+0000 7fbce37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbce40a0a70 0x7fbce411e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59478/0 (socket says 172.21.15.146:59478) 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.765+0000 7fbce37fe700 1 -- 172.21.15.146:0/843159535 learned_addr learned my addr 172.21.15.146:0/843159535 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.765+0000 7fbce3fff700 1 --2- 172.21.15.146:0/843159535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbce4139200 0x7fbce411f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.765+0000 7fbce2ffd700 1 --2- 172.21.15.146:0/843159535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce40a1550 0x7fbce411ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.765+0000 7fbce37fe700 1 -- 172.21.15.146:0/843159535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbce4139200 msgr2=0x7fbce411f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.765+0000 7fbce37fe700 1 --2- 172.21.15.146:0/843159535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbce4139200 0x7fbce411f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.765+0000 7fbce37fe700 1 -- 172.21.15.146:0/843159535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce40a1550 msgr2=0x7fbce411ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.765+0000 7fbce37fe700 1 --2- 172.21.15.146:0/843159535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce40a1550 0x7fbce411ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.765+0000 7fbce37fe700 1 -- 172.21.15.146:0/843159535 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcdc009a70 con 0x7fbce40a0a70 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.765+0000 7fbce3fff700 1 --2- 172.21.15.146:0/843159535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbce4139200 0x7fbce411f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.766+0000 7fbce37fe700 1 --2- 172.21.15.146:0/843159535 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbce40a0a70 0x7fbce411e8d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400c550 tx=0x7fbcd400c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.766+0000 7fbccbfff700 1 -- 172.21.15.146:0/843159535 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4005d70 con 0x7fbce40a0a70 2023-10-03T10:15:35.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.766+0000 7fbccbfff700 1 -- 172.21.15.146:0/843159535 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd40070d0 con 0x7fbce40a0a70 2023-10-03T10:15:35.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.766+0000 7fbccbfff700 1 -- 172.21.15.146:0/843159535 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4007440 con 0x7fbce40a0a70 2023-10-03T10:15:35.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.766+0000 7fbce9bb0700 1 -- 172.21.15.146:0/843159535 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce4122080 con 0x7fbce40a0a70 2023-10-03T10:15:35.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.766+0000 7fbce9bb0700 1 -- 172.21.15.146:0/843159535 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce40a51f0 con 0x7fbce40a0a70 2023-10-03T10:15:35.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.767+0000 7fbccbfff700 1 -- 172.21.15.146:0/843159535 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbcd40075a0 con 0x7fbce40a0a70 2023-10-03T10:15:35.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.767+0000 7fbccbfff700 1 -- 172.21.15.146:0/843159535 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbcd403e9e0 con 0x7fbce40a0a70 2023-10-03T10:15:35.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.767+0000 7fbce9bb0700 1 -- 172.21.15.146:0/843159535 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce4122470 con 0x7fbce40a0a70 2023-10-03T10:15:35.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.775+0000 7fbccbfff700 1 -- 172.21.15.146:0/843159535 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbcd4019b40 con 0x7fbce40a0a70 2023-10-03T10:15:35.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.794+0000 7fa5be479700 1 Processor -- start 2023-10-03T10:15:35.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.794+0000 7fa5be479700 1 -- start start 2023-10-03T10:15:35.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.794+0000 7fa5be479700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5b8138040 0x7fa5b8138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.794+0000 7fa5be479700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5b80a08e0 0x7fa5b80a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.794+0000 7fa5be479700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b81379e0 con 0x7fa5b80a1230 2023-10-03T10:15:35.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.794+0000 7fa5be479700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b80a2100 con 0x7fa5b80a08e0 2023-10-03T10:15:35.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.794+0000 7fa5be479700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b8138950 con 0x7fa5b8138040 2023-10-03T10:15:35.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.794+0000 7fa5b77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5b80a08e0 0x7fa5b80a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.794+0000 7fa5b77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5b80a08e0 0x7fa5b80a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50334/0 (socket says 172.21.15.146:50334) 2023-10-03T10:15:35.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.794+0000 7fa5b77fe700 1 -- 172.21.15.146:0/2963271692 learned_addr learned my addr 172.21.15.146:0/2963271692 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:35.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.794+0000 7fa5b7fff700 1 --2- 172.21.15.146:0/2963271692 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5b8138040 0x7fa5b8138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.795+0000 7fa5b6ffd700 1 -- 172.21.15.146:0/2963271692 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707640986 0 0) 0x7fa5b81379e0 con 0x7fa5b80a1230 2023-10-03T10:15:35.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.795+0000 7fa5b6ffd700 1 -- 172.21.15.146:0/2963271692 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5a00035b0 con 0x7fa5b80a1230 2023-10-03T10:15:35.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.795+0000 7fa5b7fff700 1 -- 172.21.15.146:0/2963271692 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5b80a08e0 msgr2=0x7fa5b80a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:35.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.795+0000 7fa5b7fff700 1 --2- 172.21.15.146:0/2963271692 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5b80a08e0 0x7fa5b80a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.795+0000 7fa5b7fff700 1 -- 172.21.15.146:0/2963271692 >> v1:172.21.15.146:6789/0 conn(0x7fa5b80a1230 legacy=0x7fa5b813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.795+0000 7fa5b7fff700 1 -- 172.21.15.146:0/2963271692 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b809b9b0 con 0x7fa5b8138040 2023-10-03T10:15:35.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.795+0000 7fa5b77fe700 1 --2- 172.21.15.146:0/2963271692 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5b80a08e0 0x7fa5b80a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.795+0000 7fa5b7fff700 1 --2- 172.21.15.146:0/2963271692 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5b8138040 0x7fa5b8138410 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8009880 tx=0x7fa5a8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=397da66eea7da75b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.795+0000 7fa5b6ffd700 1 -- 172.21.15.146:0/2963271692 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8005e30 con 0x7fa5b8138040 2023-10-03T10:15:35.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.795+0000 7fa5b6ffd700 1 -- 172.21.15.146:0/2963271692 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a8006030 con 0x7fa5b8138040 2023-10-03T10:15:35.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.795+0000 7fa5b6ffd700 1 -- 172.21.15.146:0/2963271692 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a80063a0 con 0x7fa5b8138040 2023-10-03T10:15:35.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.796+0000 7fa5be479700 1 -- 172.21.15.146:0/2963271692 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5b8138040 msgr2=0x7fa5b8138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.796+0000 7fa5be479700 1 --2- 172.21.15.146:0/2963271692 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5b8138040 0x7fa5b8138410 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8009880 tx=0x7fa5a8009b90 comp rx=0 tx=0).stop 2023-10-03T10:15:35.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.796+0000 7fa5be479700 1 -- 172.21.15.146:0/2963271692 shutdown_connections 2023-10-03T10:15:35.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.796+0000 7fa5be479700 1 --2- 172.21.15.146:0/2963271692 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5b8138040 0x7fa5b8138410 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.796+0000 7fa5be479700 1 --2- 172.21.15.146:0/2963271692 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5b80a08e0 0x7fa5b80a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.796+0000 7fa5be479700 1 -- 172.21.15.146:0/2963271692 >> 172.21.15.146:0/2963271692 conn(0x7fa5b80a2980 msgr2=0x7fa5b80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.796+0000 7fa5be479700 1 -- 172.21.15.146:0/2963271692 shutdown_connections 2023-10-03T10:15:35.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.796+0000 7fa5be479700 1 -- 172.21.15.146:0/2963271692 wait complete. 2023-10-03T10:15:35.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.797+0000 7fa5be479700 1 Processor -- start 2023-10-03T10:15:35.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.797+0000 7fa5be479700 1 -- start start 2023-10-03T10:15:35.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.797+0000 7fa5be479700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5b80a08e0 0x7fa5b8135c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.797+0000 7fa5be479700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5b80a1230 0x7fa5b81361c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.797+0000 7fa5be479700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5b8138040 0x7fa5b8136ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.798+0000 7fa5be479700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b8136700 con 0x7fa5b80a1230 2023-10-03T10:15:35.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.798+0000 7fa5be479700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b812fed0 con 0x7fa5b8138040 2023-10-03T10:15:35.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.798+0000 7fa5be479700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b8140d70 con 0x7fa5b80a08e0 2023-10-03T10:15:35.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.798+0000 7fa5b7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5b80a08e0 0x7fa5b8135c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.798+0000 7fa5b7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5b80a08e0 0x7fa5b8135c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59490/0 (socket says 172.21.15.146:59490) 2023-10-03T10:15:35.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.798+0000 7fa5bca16700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5b8138040 0x7fa5b8136ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.798+0000 7fa5b7fff700 1 -- 172.21.15.146:0/14187910 learned_addr learned my addr 172.21.15.146:0/14187910 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:35.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.798+0000 7fa5bca16700 1 -- 172.21.15.146:0/14187910 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5b80a08e0 msgr2=0x7fa5b8135c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.798+0000 7fa5bca16700 1 --2- 172.21.15.146:0/14187910 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5b80a08e0 0x7fa5b8135c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.798+0000 7fa5bca16700 1 -- 172.21.15.146:0/14187910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5b80a1230 msgr2=0x7fa5b81361c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.798+0000 7fa5bca16700 1 --2- 172.21.15.146:0/14187910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5b80a1230 0x7fa5b81361c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.798+0000 7fa5bca16700 1 -- 172.21.15.146:0/14187910 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac009550 con 0x7fa5b8138040 2023-10-03T10:15:35.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.798+0000 7fa5bca16700 1 --2- 172.21.15.146:0/14187910 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5b8138040 0x7fa5b8136ab0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000cb40 tx=0x7fa5b000ce50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.798+0000 7fa5b4ff9700 1 -- 172.21.15.146:0/14187910 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0003c00 con 0x7fa5b8138040 2023-10-03T10:15:35.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.798+0000 7fa5b4ff9700 1 -- 172.21.15.146:0/14187910 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b0003d60 con 0x7fa5b8138040 2023-10-03T10:15:35.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.798+0000 7fa5be479700 1 -- 172.21.15.146:0/14187910 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a8009430 con 0x7fa5b8138040 2023-10-03T10:15:35.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.798+0000 7fa5be479700 1 -- 172.21.15.146:0/14187910 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b8140800 con 0x7fa5b8138040 2023-10-03T10:15:35.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.799+0000 7fa5b4ff9700 1 -- 172.21.15.146:0/14187910 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b000aaa0 con 0x7fa5b8138040 2023-10-03T10:15:35.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.799+0000 7fa5be479700 1 -- 172.21.15.146:0/14187910 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5980052e0 con 0x7fa5b8138040 2023-10-03T10:15:35.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.800+0000 7fa5b4ff9700 1 -- 172.21.15.146:0/14187910 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa5b000ac00 con 0x7fa5b8138040 2023-10-03T10:15:35.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.800+0000 7fa5b4ff9700 1 -- 172.21.15.146:0/14187910 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa5b0047350 con 0x7fa5b8138040 2023-10-03T10:15:35.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.804+0000 7fa5b4ff9700 1 -- 172.21.15.146:0/14187910 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa5b0044060 con 0x7fa5b8138040 2023-10-03T10:15:35.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.817+0000 7f2faaabd700 1 Processor -- start 2023-10-03T10:15:35.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.817+0000 7f2faaabd700 1 -- start start 2023-10-03T10:15:35.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.818+0000 7f2faaabd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2fa40a0a30 0x7f2fa40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.818+0000 7f2faaabd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2fa40a1340 0x7f2fa412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.818+0000 7f2faaabd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa40a1e70 con 0x7f2fa41304a0 2023-10-03T10:15:35.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.818+0000 7f2faaabd700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa409a720 con 0x7f2fa40a0a30 2023-10-03T10:15:35.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.818+0000 7f2faaabd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa409b300 con 0x7f2fa40a1340 2023-10-03T10:15:35.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.818+0000 7f2fa3fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2fa40a1340 0x7f2fa412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.818+0000 7f2fa3fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2fa40a1340 0x7f2fa412ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59500/0 (socket says 172.21.15.146:59500) 2023-10-03T10:15:35.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.818+0000 7f2fa3fff700 1 -- 172.21.15.146:0/2623933884 learned_addr learned my addr 172.21.15.146:0/2623933884 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:35.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.818+0000 7f2fa8859700 1 --2- 172.21.15.146:0/2623933884 >> v2:172.21.15.146:3300/0 conn(0x7f2fa40a0a30 0x7f2fa40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.818+0000 7f2fa3fff700 1 -- 172.21.15.146:0/2623933884 >> v2:172.21.15.146:3300/0 conn(0x7f2fa40a0a30 msgr2=0x7f2fa40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:35.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.818+0000 7f2fa3fff700 1 --2- 172.21.15.146:0/2623933884 >> v2:172.21.15.146:3300/0 conn(0x7f2fa40a0a30 0x7f2fa40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.818+0000 7f2fa3fff700 1 -- 172.21.15.146:0/2623933884 >> v1:172.21.15.146:6789/0 conn(0x7f2fa41304a0 legacy=0x7f2fa41371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.818+0000 7f2fa3fff700 1 -- 172.21.15.146:0/2623933884 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa409abc0 con 0x7f2fa40a1340 2023-10-03T10:15:35.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.819+0000 7f2fa3fff700 1 --2- 172.21.15.146:0/2623933884 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2fa40a1340 0x7f2fa412ff60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2f9000bb90 tx=0x7f2f9000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=922dd2bf341909b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.819+0000 7f2fa37fe700 1 -- 172.21.15.146:0/2623933884 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9000dc40 con 0x7f2fa40a1340 2023-10-03T10:15:35.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.819+0000 7f2fa37fe700 1 -- 172.21.15.146:0/2623933884 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9000dda0 con 0x7f2fa40a1340 2023-10-03T10:15:35.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.819+0000 7f2fa37fe700 1 -- 172.21.15.146:0/2623933884 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f90017630 con 0x7f2fa40a1340 2023-10-03T10:15:35.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.819+0000 7f2faaabd700 1 -- 172.21.15.146:0/2623933884 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2fa40a1340 msgr2=0x7f2fa412ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.819+0000 7f2faaabd700 1 --2- 172.21.15.146:0/2623933884 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2fa40a1340 0x7f2fa412ff60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2f9000bb90 tx=0x7f2f9000bea0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.820+0000 7f2faaabd700 1 -- 172.21.15.146:0/2623933884 shutdown_connections 2023-10-03T10:15:35.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.820+0000 7f2faaabd700 1 --2- 172.21.15.146:0/2623933884 >> v2:172.21.15.146:3300/0 conn(0x7f2fa40a0a30 0x7f2fa40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.820+0000 7f2faaabd700 1 --2- 172.21.15.146:0/2623933884 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2fa40a1340 0x7f2fa412ff60 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.820+0000 7f2faaabd700 1 -- 172.21.15.146:0/2623933884 >> 172.21.15.146:0/2623933884 conn(0x7f2fa40a2980 msgr2=0x7f2fa40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.820+0000 7f2faaabd700 1 -- 172.21.15.146:0/2623933884 shutdown_connections 2023-10-03T10:15:35.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.820+0000 7f2faaabd700 1 -- 172.21.15.146:0/2623933884 wait complete. 2023-10-03T10:15:35.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.821+0000 7f2faaabd700 1 Processor -- start 2023-10-03T10:15:35.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.821+0000 7f2faaabd700 1 -- start start 2023-10-03T10:15:35.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.821+0000 7f2faaabd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2fa40a0a30 0x7f2fa4120bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.821+0000 7f2faaabd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fa40a1340 0x7f2fa41210f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.822+0000 7f2faaabd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fa41304a0 0x7f2fa4121630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.822+0000 7f2faaabd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa409fd80 con 0x7f2fa40a1340 2023-10-03T10:15:35.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.822+0000 7f2faaabd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa4123df0 con 0x7f2fa41304a0 2023-10-03T10:15:35.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.822+0000 7f2faaabd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa4124700 con 0x7f2fa40a0a30 2023-10-03T10:15:35.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.822+0000 7f2fa8859700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2fa40a0a30 0x7f2fa4120bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.822+0000 7f2fa8859700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2fa40a0a30 0x7f2fa4120bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59506/0 (socket says 172.21.15.146:59506) 2023-10-03T10:15:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.822+0000 7f2fa8859700 1 -- 172.21.15.146:0/1082772230 learned_addr learned my addr 172.21.15.146:0/1082772230 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.822+0000 7f2fa3fff700 1 --2- 172.21.15.146:0/1082772230 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fa40a1340 0x7f2fa41210f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.822+0000 7f2fa905a700 1 --2- 172.21.15.146:0/1082772230 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fa41304a0 0x7f2fa4121630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.822+0000 7f2fa8859700 1 -- 172.21.15.146:0/1082772230 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fa41304a0 msgr2=0x7f2fa4121630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.822+0000 7f2fa8859700 1 --2- 172.21.15.146:0/1082772230 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fa41304a0 0x7f2fa4121630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.822+0000 7f2fa8859700 1 -- 172.21.15.146:0/1082772230 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fa40a1340 msgr2=0x7f2fa41210f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.822+0000 7f2fa8859700 1 --2- 172.21.15.146:0/1082772230 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fa40a1340 0x7f2fa41210f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.822+0000 7f2fa8859700 1 -- 172.21.15.146:0/1082772230 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9000b7f0 con 0x7f2fa40a0a30 2023-10-03T10:15:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.822+0000 7f2fa8859700 1 --2- 172.21.15.146:0/1082772230 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2fa40a0a30 0x7f2fa4120bb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2f98014fd0 tx=0x7f2f98016330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.822+0000 7f2fa17fa700 1 -- 172.21.15.146:0/1082772230 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f98019070 con 0x7f2fa40a0a30 2023-10-03T10:15:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.822+0000 7f2fa17fa700 1 -- 172.21.15.146:0/1082772230 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f98016b50 con 0x7f2fa40a0a30 2023-10-03T10:15:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.822+0000 7f2fa17fa700 1 -- 172.21.15.146:0/1082772230 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f980128e0 con 0x7f2fa40a0a30 2023-10-03T10:15:35.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.823+0000 7f2faaabd700 1 -- 172.21.15.146:0/1082772230 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa4122f40 con 0x7f2fa40a0a30 2023-10-03T10:15:35.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.823+0000 7f2faaabd700 1 -- 172.21.15.146:0/1082772230 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa4124df0 con 0x7f2fa40a0a30 2023-10-03T10:15:35.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.823+0000 7f2faaabd700 1 -- 172.21.15.146:0/1082772230 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa4122d70 con 0x7f2fa40a0a30 2023-10-03T10:15:35.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.824+0000 7f2fa17fa700 1 -- 172.21.15.146:0/1082772230 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f98012a40 con 0x7f2fa40a0a30 2023-10-03T10:15:35.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.824+0000 7f2fa17fa700 1 -- 172.21.15.146:0/1082772230 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2f980482e0 con 0x7f2fa40a0a30 2023-10-03T10:15:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.828+0000 7f2fa17fa700 1 -- 172.21.15.146:0/1082772230 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f9802fdb0 con 0x7f2fa40a0a30 2023-10-03T10:15:35.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.957+0000 7f4bd5448700 1 -- 172.21.15.146:0/4046751821 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4bd0072d60 con 0x7f4bd009f180 2023-10-03T10:15:35.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.957+0000 7f4bb77fe700 1 -- 172.21.15.146:0/4046751821 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4bc4019cd0 con 0x7f4bd009f180 2023-10-03T10:15:35.958 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:35.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.961+0000 7f4bd5448700 1 -- 172.21.15.146:0/4046751821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bd009f180 msgr2=0x7f4bd0122f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.961+0000 7f4bd5448700 1 --2- 172.21.15.146:0/4046751821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bd009f180 0x7f4bd0122f70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f4bc400c430 tx=0x7f4bc400c740 comp rx=0 tx=0).stop 2023-10-03T10:15:35.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.961+0000 7f4bd5448700 1 -- 172.21.15.146:0/4046751821 shutdown_connections 2023-10-03T10:15:35.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.961+0000 7f4bd5448700 1 --2- 172.21.15.146:0/4046751821 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4bd0134330 0x7f4bd01234b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.961+0000 7f4bd5448700 1 --2- 172.21.15.146:0/4046751821 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bd009e870 0x7f4bd0122a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.961+0000 7f4bd5448700 1 --2- 172.21.15.146:0/4046751821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bd009f180 0x7f4bd0122f70 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.961+0000 7f4bd5448700 1 -- 172.21.15.146:0/4046751821 >> 172.21.15.146:0/4046751821 conn(0x7f4bd00a4430 msgr2=0x7f4bd00a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.961+0000 7f4bd5448700 1 -- 172.21.15.146:0/4046751821 shutdown_connections 2023-10-03T10:15:35.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:35.961+0000 7f4bd5448700 1 -- 172.21.15.146:0/4046751821 wait complete. 2023-10-03T10:15:35.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:36.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.010+0000 7fa5be479700 1 -- 172.21.15.146:0/14187910 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa598005590 con 0x7fa5b8138040 2023-10-03T10:15:36.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.010+0000 7fa5b4ff9700 1 -- 172.21.15.146:0/14187910 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa5b0044030 con 0x7fa5b8138040 2023-10-03T10:15:36.011 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:36.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.012+0000 7fa5be479700 1 -- 172.21.15.146:0/14187910 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5b8138040 msgr2=0x7fa5b8136ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.012+0000 7fa5be479700 1 --2- 172.21.15.146:0/14187910 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5b8138040 0x7fa5b8136ab0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000cb40 tx=0x7fa5b000ce50 comp rx=0 tx=0).stop 2023-10-03T10:15:36.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.012+0000 7fa5be479700 1 -- 172.21.15.146:0/14187910 shutdown_connections 2023-10-03T10:15:36.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.012+0000 7fa5be479700 1 --2- 172.21.15.146:0/14187910 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5b8138040 0x7fa5b8136ab0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.012+0000 7fa5be479700 1 --2- 172.21.15.146:0/14187910 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5b80a08e0 0x7fa5b8135c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.012+0000 7fa5be479700 1 --2- 172.21.15.146:0/14187910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5b80a1230 0x7fa5b81361c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.012+0000 7fa5be479700 1 -- 172.21.15.146:0/14187910 >> 172.21.15.146:0/14187910 conn(0x7fa5b80a2980 msgr2=0x7fa5b8071ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:36.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.012+0000 7fa5be479700 1 -- 172.21.15.146:0/14187910 shutdown_connections 2023-10-03T10:15:36.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.012+0000 7fa5be479700 1 -- 172.21.15.146:0/14187910 wait complete. 2023-10-03T10:15:36.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.021+0000 7fbce9bb0700 1 -- 172.21.15.146:0/843159535 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbce404f2a0 con 0x7fbce40a0a70 2023-10-03T10:15:36.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.022+0000 7fbccbfff700 1 -- 172.21.15.146:0/843159535 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbcd4017020 con 0x7fbce40a0a70 2023-10-03T10:15:36.022 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:36.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.024+0000 7fbce9bb0700 1 -- 172.21.15.146:0/843159535 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbce40a0a70 msgr2=0x7fbce411e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.024+0000 7fbce9bb0700 1 --2- 172.21.15.146:0/843159535 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbce40a0a70 0x7fbce411e8d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400c550 tx=0x7fbcd400c860 comp rx=0 tx=0).stop 2023-10-03T10:15:36.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:36.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.024+0000 7fbce9bb0700 1 -- 172.21.15.146:0/843159535 shutdown_connections 2023-10-03T10:15:36.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.024+0000 7fbce9bb0700 1 --2- 172.21.15.146:0/843159535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbce4139200 0x7fbce411f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.024+0000 7fbce9bb0700 1 --2- 172.21.15.146:0/843159535 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbce40a0a70 0x7fbce411e8d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.024+0000 7fbce9bb0700 1 --2- 172.21.15.146:0/843159535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce40a1550 0x7fbce411ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.024+0000 7fbce9bb0700 1 -- 172.21.15.146:0/843159535 >> 172.21.15.146:0/843159535 conn(0x7fbce40a6610 msgr2=0x7fbce4138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:36.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.024+0000 7fbce9bb0700 1 -- 172.21.15.146:0/843159535 shutdown_connections 2023-10-03T10:15:36.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.024+0000 7fbce9bb0700 1 -- 172.21.15.146:0/843159535 wait complete. 2023-10-03T10:15:36.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:36.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.045+0000 7f2faaabd700 1 -- 172.21.15.146:0/1082772230 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2fa404f2a0 con 0x7f2fa40a0a30 2023-10-03T10:15:36.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.045+0000 7f2fa17fa700 1 -- 172.21.15.146:0/1082772230 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2f9802fbd0 con 0x7f2fa40a0a30 2023-10-03T10:15:36.046 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:36.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.047+0000 7f2faaabd700 1 -- 172.21.15.146:0/1082772230 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2fa40a0a30 msgr2=0x7f2fa4120bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.047+0000 7f2faaabd700 1 --2- 172.21.15.146:0/1082772230 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2fa40a0a30 0x7f2fa4120bb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2f98014fd0 tx=0x7f2f98016330 comp rx=0 tx=0).stop 2023-10-03T10:15:36.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.047+0000 7f2faaabd700 1 -- 172.21.15.146:0/1082772230 shutdown_connections 2023-10-03T10:15:36.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.047+0000 7f2faaabd700 1 --2- 172.21.15.146:0/1082772230 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2fa41304a0 0x7f2fa4121630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.047+0000 7f2faaabd700 1 --2- 172.21.15.146:0/1082772230 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2fa40a0a30 0x7f2fa4120bb0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.047+0000 7f2faaabd700 1 --2- 172.21.15.146:0/1082772230 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fa40a1340 0x7f2fa41210f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.047+0000 7f2faaabd700 1 -- 172.21.15.146:0/1082772230 >> 172.21.15.146:0/1082772230 conn(0x7f2fa40a2980 msgr2=0x7f2fa412e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:36.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.047+0000 7f2faaabd700 1 -- 172.21.15.146:0/1082772230 shutdown_connections 2023-10-03T10:15:36.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:36.047+0000 7f2faaabd700 1 -- 172.21.15.146:0/1082772230 wait complete. 2023-10-03T10:15:36.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:36.979 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:37.026 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:37.038 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:37.060 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:37.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.126+0000 7fa220cb4700 1 Processor -- start 2023-10-03T10:15:37.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.126+0000 7fa220cb4700 1 -- start start 2023-10-03T10:15:37.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.126+0000 7fa220cb4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c09d860 0x7fa21c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.126+0000 7fa220cb4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa21c09e170 0x7fa21c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.127+0000 7fa220cb4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c130ce0 0x7fa21c131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.127+0000 7fa220cb4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa21c09aaa0 con 0x7fa21c09e170 2023-10-03T10:15:37.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.127+0000 7fa220cb4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c09f870 con 0x7fa21c09d860 2023-10-03T10:15:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.127+0000 7fa220cb4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c09b360 con 0x7fa21c130ce0 2023-10-03T10:15:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.127+0000 7fa21a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c09d860 0x7fa21c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.127+0000 7fa21ad9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c130ce0 0x7fa21c131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.127+0000 7fa21a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c09d860 0x7fa21c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50354/0 (socket says 172.21.15.146:50354) 2023-10-03T10:15:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.127+0000 7fa21a59c700 1 -- 172.21.15.146:0/933437106 learned_addr learned my addr 172.21.15.146:0/933437106 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.127+0000 7fa21a59c700 1 -- 172.21.15.146:0/933437106 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c130ce0 msgr2=0x7fa21c131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.127+0000 7fa21a59c700 1 --2- 172.21.15.146:0/933437106 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c130ce0 0x7fa21c131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.127+0000 7fa21a59c700 1 -- 172.21.15.146:0/933437106 >> v2:172.21.15.146:3300/0 conn(0x7fa21c09e170 msgr2=0x7fa21c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.127+0000 7fa21a59c700 1 --2- 172.21.15.146:0/933437106 >> v2:172.21.15.146:3300/0 conn(0x7fa21c09e170 0x7fa21c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.127+0000 7fa21a59c700 1 -- 172.21.15.146:0/933437106 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21c09b620 con 0x7fa21c09d860 2023-10-03T10:15:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.127+0000 7fa21ad9d700 1 --2- 172.21.15.146:0/933437106 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c130ce0 0x7fa21c131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.127+0000 7fa21a59c700 1 --2- 172.21.15.146:0/933437106 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c09d860 0x7fa21c09dc30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009920 tx=0x7fa20c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b597b12d1d8ba9c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.127+0000 7fa219d9b700 1 -- 172.21.15.146:0/933437106 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c011830 con 0x7fa21c09d860 2023-10-03T10:15:37.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.128+0000 7fa219d9b700 1 -- 172.21.15.146:0/933437106 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20c011990 con 0x7fa21c09d860 2023-10-03T10:15:37.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.128+0000 7fa219d9b700 1 -- 172.21.15.146:0/933437106 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c011d20 con 0x7fa21c09d860 2023-10-03T10:15:37.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.128+0000 7fa220cb4700 1 -- 172.21.15.146:0/933437106 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c09d860 msgr2=0x7fa21c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.128+0000 7fa220cb4700 1 --2- 172.21.15.146:0/933437106 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c09d860 0x7fa21c09dc30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009920 tx=0x7fa20c009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:37.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.129+0000 7fa220cb4700 1 -- 172.21.15.146:0/933437106 shutdown_connections 2023-10-03T10:15:37.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.129+0000 7fa220cb4700 1 --2- 172.21.15.146:0/933437106 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c09d860 0x7fa21c09dc30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.129+0000 7fa220cb4700 1 --2- 172.21.15.146:0/933437106 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c130ce0 0x7fa21c131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.129+0000 7fa220cb4700 1 --2- 172.21.15.146:0/933437106 >> v2:172.21.15.146:3300/0 conn(0x7fa21c09e170 0x7fa21c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.129+0000 7fa220cb4700 1 -- 172.21.15.146:0/933437106 >> 172.21.15.146:0/933437106 conn(0x7fa21c099c40 msgr2=0x7fa21c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.129+0000 7fa220cb4700 1 -- 172.21.15.146:0/933437106 shutdown_connections 2023-10-03T10:15:37.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.129+0000 7fa220cb4700 1 -- 172.21.15.146:0/933437106 wait complete. 2023-10-03T10:15:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.130+0000 7fa220cb4700 1 Processor -- start 2023-10-03T10:15:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.130+0000 7fa220cb4700 1 -- start start 2023-10-03T10:15:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.131+0000 7fa220cb4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c09d860 0x7fa21c1c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.131+0000 7fa220cb4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa21c09e170 0x7fa21c1c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.131+0000 7fa220cb4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c130ce0 0x7fa21c1c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.131+0000 7fa220cb4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c125de0 con 0x7fa21c09e170 2023-10-03T10:15:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.131+0000 7fa220cb4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c120260 con 0x7fa21c09d860 2023-10-03T10:15:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.131+0000 7fa220cb4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c125fc0 con 0x7fa21c130ce0 2023-10-03T10:15:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.131+0000 7fa21a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c09d860 0x7fa21c1c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.131+0000 7fa21a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c09d860 0x7fa21c1c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50368/0 (socket says 172.21.15.146:50368) 2023-10-03T10:15:37.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.131+0000 7fa21a59c700 1 -- 172.21.15.146:0/1539141777 learned_addr learned my addr 172.21.15.146:0/1539141777 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:37.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.131+0000 7fa21ad9d700 1 --2- 172.21.15.146:0/1539141777 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c130ce0 0x7fa21c1c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.131+0000 7fa213fff700 1 --2- 172.21.15.146:0/1539141777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa21c09e170 0x7fa21c1c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.132+0000 7fa21ad9d700 1 -- 172.21.15.146:0/1539141777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c09d860 msgr2=0x7fa21c1c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.132+0000 7fa21ad9d700 1 --2- 172.21.15.146:0/1539141777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c09d860 0x7fa21c1c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.132+0000 7fa21ad9d700 1 -- 172.21.15.146:0/1539141777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa21c09e170 msgr2=0x7fa21c1c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.132+0000 7fa21ad9d700 1 --2- 172.21.15.146:0/1539141777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa21c09e170 0x7fa21c1c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.132+0000 7fa21ad9d700 1 -- 172.21.15.146:0/1539141777 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa214009a70 con 0x7fa21c130ce0 2023-10-03T10:15:37.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.132+0000 7fa21ad9d700 1 --2- 172.21.15.146:0/1539141777 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c130ce0 0x7fa21c1c9060 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa21400efc0 tx=0x7fa21400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.132+0000 7fa212ffd700 1 -- 172.21.15.146:0/1539141777 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21400ca90 con 0x7fa21c130ce0 2023-10-03T10:15:37.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.132+0000 7fa212ffd700 1 -- 172.21.15.146:0/1539141777 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21400f040 con 0x7fa21c130ce0 2023-10-03T10:15:37.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.132+0000 7fa220cb4700 1 -- 172.21.15.146:0/1539141777 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20c009550 con 0x7fa21c130ce0 2023-10-03T10:15:37.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.132+0000 7fa212ffd700 1 -- 172.21.15.146:0/1539141777 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21400ce30 con 0x7fa21c130ce0 2023-10-03T10:15:37.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.132+0000 7fa220cb4700 1 -- 172.21.15.146:0/1539141777 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa21c09c8b0 con 0x7fa21c130ce0 2023-10-03T10:15:37.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.133+0000 7fa212ffd700 1 -- 172.21.15.146:0/1539141777 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa214014480 con 0x7fa21c130ce0 2023-10-03T10:15:37.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.133+0000 7fa212ffd700 1 -- 172.21.15.146:0/1539141777 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa21403fbf0 con 0x7fa21c130ce0 2023-10-03T10:15:37.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.133+0000 7fa220cb4700 1 -- 172.21.15.146:0/1539141777 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa21c120500 con 0x7fa21c130ce0 2023-10-03T10:15:37.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.138+0000 7fa212ffd700 1 -- 172.21.15.146:0/1539141777 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa21c120500 con 0x7fa21c130ce0 2023-10-03T10:15:37.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.166+0000 7f624d508700 1 Processor -- start 2023-10-03T10:15:37.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.166+0000 7f624d508700 1 -- start start 2023-10-03T10:15:37.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.166+0000 7f624d508700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f624809d860 0x7f624809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.166+0000 7f624d508700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f624809e170 0x7f62481307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.166+0000 7f624d508700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624809aaa0 con 0x7f6248130ce0 2023-10-03T10:15:37.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.166+0000 7f624d508700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624809f870 con 0x7f624809d860 2023-10-03T10:15:37.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.167+0000 7f624d508700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f624809b360 con 0x7f624809e170 2023-10-03T10:15:37.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.167+0000 7f62467fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f624809e170 0x7f62481307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.167+0000 7f6246ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f624809d860 0x7f624809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.167+0000 7f62467fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f624809e170 0x7f62481307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59536/0 (socket says 172.21.15.146:59536) 2023-10-03T10:15:37.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.167+0000 7f62467fc700 1 -- 172.21.15.146:0/1309445529 learned_addr learned my addr 172.21.15.146:0/1309445529 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:37.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.167+0000 7f62467fc700 1 -- 172.21.15.146:0/1309445529 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f624809d860 msgr2=0x7f624809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:37.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.167+0000 7f62467fc700 1 --2- 172.21.15.146:0/1309445529 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f624809d860 0x7f624809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.167+0000 7f62467fc700 1 -- 172.21.15.146:0/1309445529 >> v1:172.21.15.146:6789/0 conn(0x7f6248130ce0 legacy=0x7f62481379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.167+0000 7f62467fc700 1 -- 172.21.15.146:0/1309445529 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624809b620 con 0x7f624809e170 2023-10-03T10:15:37.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.167+0000 7f62467fc700 1 --2- 172.21.15.146:0/1309445529 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f624809e170 0x7f62481307a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f623c009920 tx=0x7f623c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8738411f5f980634 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.168+0000 7f6245ffb700 1 -- 172.21.15.146:0/1309445529 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c011830 con 0x7f624809e170 2023-10-03T10:15:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.168+0000 7f6245ffb700 1 -- 172.21.15.146:0/1309445529 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623c011990 con 0x7f624809e170 2023-10-03T10:15:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.168+0000 7f6245ffb700 1 -- 172.21.15.146:0/1309445529 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c011d20 con 0x7f624809e170 2023-10-03T10:15:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.168+0000 7f624d508700 1 -- 172.21.15.146:0/1309445529 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f624809e170 msgr2=0x7f62481307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.168+0000 7f624d508700 1 --2- 172.21.15.146:0/1309445529 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f624809e170 0x7f62481307a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f623c009920 tx=0x7f623c009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.168+0000 7f624d508700 1 -- 172.21.15.146:0/1309445529 shutdown_connections 2023-10-03T10:15:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.168+0000 7f624d508700 1 --2- 172.21.15.146:0/1309445529 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f624809d860 0x7f624809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.168+0000 7f624d508700 1 --2- 172.21.15.146:0/1309445529 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f624809e170 0x7f62481307a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.168+0000 7f624d508700 1 -- 172.21.15.146:0/1309445529 >> 172.21.15.146:0/1309445529 conn(0x7f6248099c40 msgr2=0x7f62480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.168+0000 7f624d508700 1 -- 172.21.15.146:0/1309445529 shutdown_connections 2023-10-03T10:15:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.168+0000 7f624d508700 1 -- 172.21.15.146:0/1309445529 wait complete. 2023-10-03T10:15:37.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.169+0000 7f624d508700 1 Processor -- start 2023-10-03T10:15:37.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.170+0000 7f624d508700 1 -- start start 2023-10-03T10:15:37.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.170+0000 7f624d508700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f624809d860 0x7f624811e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.170+0000 7f624d508700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f624809e170 0x7f624811eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.170+0000 7f624d508700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6248130ce0 0x7f624811f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.170+0000 7f624d508700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624809c8b0 con 0x7f624809e170 2023-10-03T10:15:37.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.170+0000 7f624d508700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624811fa50 con 0x7f624809d860 2023-10-03T10:15:37.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.170+0000 7f624d508700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6248120330 con 0x7f6248130ce0 2023-10-03T10:15:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.170+0000 7f62467fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f624809e170 0x7f624811eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.170+0000 7f62467fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f624809e170 0x7f624811eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39554/0 (socket says 172.21.15.146:39554) 2023-10-03T10:15:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.170+0000 7f62467fc700 1 -- 172.21.15.146:0/2750577608 learned_addr learned my addr 172.21.15.146:0/2750577608 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.170+0000 7f62477fe700 1 --2- 172.21.15.146:0/2750577608 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6248130ce0 0x7f624811f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.170+0000 7f6246ffd700 1 --2- 172.21.15.146:0/2750577608 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f624809d860 0x7f624811e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.171+0000 7f62467fc700 1 -- 172.21.15.146:0/2750577608 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6248130ce0 msgr2=0x7f624811f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.171+0000 7f62467fc700 1 --2- 172.21.15.146:0/2750577608 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6248130ce0 0x7f624811f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.171+0000 7f62467fc700 1 -- 172.21.15.146:0/2750577608 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f624809d860 msgr2=0x7f624811e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.171+0000 7f62467fc700 1 --2- 172.21.15.146:0/2750577608 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f624809d860 0x7f624811e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.171+0000 7f62467fc700 1 -- 172.21.15.146:0/2750577608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623c009550 con 0x7f624809e170 2023-10-03T10:15:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.171+0000 7f62477fe700 1 --2- 172.21.15.146:0/2750577608 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6248130ce0 0x7f624811f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.171+0000 7f62467fc700 1 --2- 172.21.15.146:0/2750577608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f624809e170 0x7f624811eb50 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f623c000c00 tx=0x7f623c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.171+0000 7f622f7fe700 1 -- 172.21.15.146:0/2750577608 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c004240 con 0x7f624809e170 2023-10-03T10:15:37.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.171+0000 7f624d508700 1 -- 172.21.15.146:0/2750577608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6248121e50 con 0x7f624809e170 2023-10-03T10:15:37.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.171+0000 7f622f7fe700 1 -- 172.21.15.146:0/2750577608 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623c01f070 con 0x7f624809e170 2023-10-03T10:15:37.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.171+0000 7f622f7fe700 1 -- 172.21.15.146:0/2750577608 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c0045c0 con 0x7f624809e170 2023-10-03T10:15:37.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.171+0000 7f624d508700 1 -- 172.21.15.146:0/2750577608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62481228c0 con 0x7f624809e170 2023-10-03T10:15:37.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.172+0000 7f622f7fe700 1 -- 172.21.15.146:0/2750577608 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f623c021030 con 0x7f624809e170 2023-10-03T10:15:37.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.172+0000 7f622f7fe700 1 -- 172.21.15.146:0/2750577608 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f623c040680 con 0x7f624809e170 2023-10-03T10:15:37.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.172+0000 7f624d508700 1 -- 172.21.15.146:0/2750577608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624804f2a0 con 0x7f624809e170 2023-10-03T10:15:37.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.181+0000 7f622f7fe700 1 -- 172.21.15.146:0/2750577608 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f623c015020 con 0x7f624809e170 2023-10-03T10:15:37.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.209+0000 7f78e8181700 1 Processor -- start 2023-10-03T10:15:37.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.209+0000 7f78e8181700 1 -- start start 2023-10-03T10:15:37.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.210+0000 7f78e8181700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78e009e870 0x7f78e009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.210+0000 7f78e8181700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f78e009f180 0x7f78e0131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.210+0000 7f78e8181700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e009c970 con 0x7f78e0131d70 2023-10-03T10:15:37.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.210+0000 7f78e8181700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e00a0920 con 0x7f78e009f180 2023-10-03T10:15:37.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.210+0000 7f78e8181700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78e009f9c0 con 0x7f78e009e870 2023-10-03T10:15:37.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.210+0000 7f78e5f1d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78e009e870 0x7f78e009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.210+0000 7f78e5f1d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78e009e870 0x7f78e009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59566/0 (socket says 172.21.15.146:59566) 2023-10-03T10:15:37.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.210+0000 7f78e5f1d700 1 -- 172.21.15.146:0/4054687770 learned_addr learned my addr 172.21.15.146:0/4054687770 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:37.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.210+0000 7f78e571c700 1 --2- 172.21.15.146:0/4054687770 >> v2:172.21.15.146:3300/0 conn(0x7f78e009f180 0x7f78e0131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.210+0000 7f78e571c700 1 -- 172.21.15.146:0/4054687770 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78e009e870 msgr2=0x7f78e009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:37.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.210+0000 7f78e571c700 1 --2- 172.21.15.146:0/4054687770 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78e009e870 0x7f78e009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.210+0000 7f78e571c700 1 -- 172.21.15.146:0/4054687770 >> v1:172.21.15.146:6789/0 conn(0x7f78e0131d70 legacy=0x7f78e0138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.210+0000 7f78e571c700 1 -- 172.21.15.146:0/4054687770 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e009bab0 con 0x7f78e009f180 2023-10-03T10:15:37.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.210+0000 7f78e4f1b700 1 -- 172.21.15.146:0/4054687770 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478664745 0 0) 0x7f78e009c970 con 0x7f78e0131d70 2023-10-03T10:15:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.210+0000 7f78e571c700 1 --2- 172.21.15.146:0/4054687770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78e009f180 0x7f78e0131830 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009840 tx=0x7f78d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba65a4b164ab3c32 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.210+0000 7f78e4f1b700 1 -- 172.21.15.146:0/4054687770 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d0011830 con 0x7f78e009f180 2023-10-03T10:15:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.211+0000 7f78e4f1b700 1 -- 172.21.15.146:0/4054687770 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d0011990 con 0x7f78e009f180 2023-10-03T10:15:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.211+0000 7f78e4f1b700 1 -- 172.21.15.146:0/4054687770 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d0011d20 con 0x7f78e009f180 2023-10-03T10:15:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.211+0000 7f78e8181700 1 -- 172.21.15.146:0/4054687770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78e009f180 msgr2=0x7f78e0131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.211+0000 7f78e8181700 1 --2- 172.21.15.146:0/4054687770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78e009f180 0x7f78e0131830 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009840 tx=0x7f78d0009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.211+0000 7f78e8181700 1 -- 172.21.15.146:0/4054687770 shutdown_connections 2023-10-03T10:15:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.211+0000 7f78e8181700 1 --2- 172.21.15.146:0/4054687770 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78e009e870 0x7f78e009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.211+0000 7f78e8181700 1 --2- 172.21.15.146:0/4054687770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78e009f180 0x7f78e0131830 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.211+0000 7f78e8181700 1 -- 172.21.15.146:0/4054687770 >> 172.21.15.146:0/4054687770 conn(0x7f78e00a4430 msgr2=0x7f78e00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.211+0000 7f78e8181700 1 -- 172.21.15.146:0/4054687770 shutdown_connections 2023-10-03T10:15:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.211+0000 7f78e8181700 1 -- 172.21.15.146:0/4054687770 wait complete. 2023-10-03T10:15:37.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.212+0000 7f78e8181700 1 Processor -- start 2023-10-03T10:15:37.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.212+0000 7f78e8181700 1 -- start start 2023-10-03T10:15:37.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.213+0000 7f78e8181700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78e009e870 0x7f78e011f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.213+0000 7f78e8181700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78e009f180 0x7f78e011f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.213+0000 7f78e8181700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78e0131d70 0x7f78e011fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.213+0000 7f78e8181700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e0120cb0 con 0x7f78e009f180 2023-10-03T10:15:37.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.213+0000 7f78e8181700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e0122980 con 0x7f78e0131d70 2023-10-03T10:15:37.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.213+0000 7f78e8181700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78e0121b40 con 0x7f78e009e870 2023-10-03T10:15:37.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.213+0000 7f78e571c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78e009f180 0x7f78e011f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.213+0000 7f78e571c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78e009f180 0x7f78e011f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39564/0 (socket says 172.21.15.146:39564) 2023-10-03T10:15:37.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.213+0000 7f78e571c700 1 -- 172.21.15.146:0/954954191 learned_addr learned my addr 172.21.15.146:0/954954191 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:37.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.213+0000 7f78e671e700 1 --2- 172.21.15.146:0/954954191 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78e0131d70 0x7f78e011fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.213+0000 7f78e5f1d700 1 --2- 172.21.15.146:0/954954191 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78e009e870 0x7f78e011f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.213+0000 7f78e571c700 1 -- 172.21.15.146:0/954954191 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78e009e870 msgr2=0x7f78e011f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.213+0000 7f78e571c700 1 --2- 172.21.15.146:0/954954191 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78e009e870 0x7f78e011f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.213+0000 7f78e571c700 1 -- 172.21.15.146:0/954954191 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78e0131d70 msgr2=0x7f78e011fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.213+0000 7f78e571c700 1 --2- 172.21.15.146:0/954954191 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78e0131d70 0x7f78e011fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.213+0000 7f78e571c700 1 -- 172.21.15.146:0/954954191 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d00094a0 con 0x7f78e009f180 2023-10-03T10:15:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.213+0000 7f78e5f1d700 1 --2- 172.21.15.146:0/954954191 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78e009e870 0x7f78e011f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.213+0000 7f78e571c700 1 --2- 172.21.15.146:0/954954191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78e009f180 0x7f78e011f5e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009fd0 tx=0x7f78d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.214+0000 7f78d67fc700 1 -- 172.21.15.146:0/954954191 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d00036a0 con 0x7f78e009f180 2023-10-03T10:15:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.214+0000 7f78d67fc700 1 -- 172.21.15.146:0/954954191 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d001f070 con 0x7f78e009f180 2023-10-03T10:15:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.214+0000 7f78e8181700 1 -- 172.21.15.146:0/954954191 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e0122620 con 0x7f78e009f180 2023-10-03T10:15:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.214+0000 7f78d67fc700 1 -- 172.21.15.146:0/954954191 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d0003a00 con 0x7f78e009f180 2023-10-03T10:15:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.214+0000 7f78e8181700 1 -- 172.21.15.146:0/954954191 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e009dba0 con 0x7f78e009f180 2023-10-03T10:15:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.214+0000 7f78e8181700 1 -- 172.21.15.146:0/954954191 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e011be60 con 0x7f78e009f180 2023-10-03T10:15:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.215+0000 7f78d67fc700 1 -- 172.21.15.146:0/954954191 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78d0003b60 con 0x7f78e009f180 2023-10-03T10:15:37.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.215+0000 7f78d67fc700 1 -- 172.21.15.146:0/954954191 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f78d0021070 con 0x7f78e009f180 2023-10-03T10:15:37.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.219+0000 7f997f28e700 1 Processor -- start 2023-10-03T10:15:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.219+0000 7f997f28e700 1 -- start start 2023-10-03T10:15:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.220+0000 7f997f28e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f997806a770 0x7f997806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.220+0000 7f997f28e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f997809dec0 0x7f997806b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.220+0000 7f997f28e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9978131a00 0x7f9978131e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.220+0000 7f997f28e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f997806b5c0 con 0x7f9978131a00 2023-10-03T10:15:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.220+0000 7f997f28e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997806e900 con 0x7f997806a770 2023-10-03T10:15:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.220+0000 7f997f28e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f997809d180 con 0x7f997809dec0 2023-10-03T10:15:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.220+0000 7f997d02a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f997806a770 0x7f997806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.220+0000 7f997d02a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f997806a770 0x7f997806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50408/0 (socket says 172.21.15.146:50408) 2023-10-03T10:15:37.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.220+0000 7f997d02a700 1 -- 172.21.15.146:0/3911875354 learned_addr learned my addr 172.21.15.146:0/3911875354 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:37.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.220+0000 7f997c829700 1 --2- 172.21.15.146:0/3911875354 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f997809dec0 0x7f997806b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.220+0000 7f997d82b700 1 --2- 172.21.15.146:0/3911875354 >> v2:172.21.15.146:3300/0 conn(0x7f9978131a00 0x7f9978131e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.220+0000 7f997d02a700 1 -- 172.21.15.146:0/3911875354 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f997809dec0 msgr2=0x7f997806b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:37.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.220+0000 7f997d02a700 1 --2- 172.21.15.146:0/3911875354 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f997809dec0 0x7f997806b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.220+0000 7f997d02a700 1 -- 172.21.15.146:0/3911875354 >> v2:172.21.15.146:3300/0 conn(0x7f9978131a00 msgr2=0x7f9978131e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:37.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.220+0000 7f997d02a700 1 --2- 172.21.15.146:0/3911875354 >> v2:172.21.15.146:3300/0 conn(0x7f9978131a00 0x7f9978131e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.220+0000 7f997d02a700 1 -- 172.21.15.146:0/3911875354 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997809e780 con 0x7f997806a770 2023-10-03T10:15:37.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.221+0000 7f78d67fc700 1 -- 172.21.15.146:0/954954191 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78d0003e10 con 0x7f78e009f180 2023-10-03T10:15:37.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.221+0000 7f997d02a700 1 --2- 172.21.15.146:0/3911875354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f997806a770 0x7f997806ab40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f99740098f0 tx=0x7f9974009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31202630a6d69135 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.221+0000 7f996ffff700 1 -- 172.21.15.146:0/3911875354 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974011830 con 0x7f997806a770 2023-10-03T10:15:37.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.221+0000 7f996ffff700 1 -- 172.21.15.146:0/3911875354 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9974011990 con 0x7f997806a770 2023-10-03T10:15:37.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.221+0000 7f996ffff700 1 -- 172.21.15.146:0/3911875354 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974011d20 con 0x7f997806a770 2023-10-03T10:15:37.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.222+0000 7f997f28e700 1 -- 172.21.15.146:0/3911875354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f997806a770 msgr2=0x7f997806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.222+0000 7f997f28e700 1 --2- 172.21.15.146:0/3911875354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f997806a770 0x7f997806ab40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f99740098f0 tx=0x7f9974009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:37.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.222+0000 7f997f28e700 1 -- 172.21.15.146:0/3911875354 shutdown_connections 2023-10-03T10:15:37.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.222+0000 7f997f28e700 1 --2- 172.21.15.146:0/3911875354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f997806a770 0x7f997806ab40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.222+0000 7f997f28e700 1 --2- 172.21.15.146:0/3911875354 >> v2:172.21.15.146:3300/0 conn(0x7f9978131a00 0x7f9978131e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.222+0000 7f997f28e700 1 --2- 172.21.15.146:0/3911875354 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f997809dec0 0x7f997806b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.222+0000 7f997f28e700 1 -- 172.21.15.146:0/3911875354 >> 172.21.15.146:0/3911875354 conn(0x7f9978099c40 msgr2=0x7f99780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.222+0000 7f997f28e700 1 -- 172.21.15.146:0/3911875354 shutdown_connections 2023-10-03T10:15:37.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.222+0000 7f997f28e700 1 -- 172.21.15.146:0/3911875354 wait complete. 2023-10-03T10:15:37.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.223+0000 7f997f28e700 1 Processor -- start 2023-10-03T10:15:37.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.224+0000 7f997f28e700 1 -- start start 2023-10-03T10:15:37.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.224+0000 7f997f28e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f997806a770 0x7f9978119e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.224+0000 7f997f28e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f997809dec0 0x7f997811a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.224+0000 7f997f28e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9978131a00 0x7f997811a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.224+0000 7f997f28e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997811d1a0 con 0x7f997806a770 2023-10-03T10:15:37.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.224+0000 7f997f28e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99781310b0 con 0x7f997809dec0 2023-10-03T10:15:37.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.224+0000 7f997f28e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9978071ce0 con 0x7f9978131a00 2023-10-03T10:15:37.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.225+0000 7f997d82b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9978131a00 0x7f997811a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.225+0000 7f997d82b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9978131a00 0x7f997811a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59602/0 (socket says 172.21.15.146:59602) 2023-10-03T10:15:37.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.225+0000 7f997d82b700 1 -- 172.21.15.146:0/3677238761 learned_addr learned my addr 172.21.15.146:0/3677238761 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.225+0000 7f997d02a700 1 --2- 172.21.15.146:0/3677238761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f997806a770 0x7f9978119e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.225+0000 7f997c829700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f997809dec0 0x7f997811a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.225+0000 7f997d82b700 1 -- 172.21.15.146:0/3677238761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f997809dec0 msgr2=0x7f997811a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.225+0000 7f997d82b700 1 --2- 172.21.15.146:0/3677238761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f997809dec0 0x7f997811a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.225+0000 7f997d82b700 1 -- 172.21.15.146:0/3677238761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f997806a770 msgr2=0x7f9978119e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.225+0000 7f997d82b700 1 --2- 172.21.15.146:0/3677238761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f997806a770 0x7f9978119e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.225+0000 7f997d82b700 1 -- 172.21.15.146:0/3677238761 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9974009550 con 0x7f9978131a00 2023-10-03T10:15:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.225+0000 7f997d82b700 1 --2- 172.21.15.146:0/3677238761 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9978131a00 0x7f997811a910 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f997000efc0 tx=0x7f997000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.225+0000 7f996dffb700 1 -- 172.21.15.146:0/3677238761 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9970009ea0 con 0x7f9978131a00 2023-10-03T10:15:37.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.225+0000 7f997f28e700 1 -- 172.21.15.146:0/3677238761 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f997811bac0 con 0x7f9978131a00 2023-10-03T10:15:37.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.225+0000 7f996dffb700 1 -- 172.21.15.146:0/3677238761 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997000f040 con 0x7f9978131a00 2023-10-03T10:15:37.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.225+0000 7f996dffb700 1 -- 172.21.15.146:0/3677238761 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997000ceb0 con 0x7f9978131a00 2023-10-03T10:15:37.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.226+0000 7f997f28e700 1 -- 172.21.15.146:0/3677238761 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f997811d650 con 0x7f9978131a00 2023-10-03T10:15:37.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.227+0000 7f996dffb700 1 -- 172.21.15.146:0/3677238761 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9970014480 con 0x7f9978131a00 2023-10-03T10:15:37.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.227+0000 7f997f28e700 1 -- 172.21.15.146:0/3677238761 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f997804f2a0 con 0x7f9978131a00 2023-10-03T10:15:37.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.227+0000 7f996dffb700 1 -- 172.21.15.146:0/3677238761 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f99700417b0 con 0x7f9978131a00 2023-10-03T10:15:37.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.232+0000 7f996dffb700 1 -- 172.21.15.146:0/3677238761 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9970045060 con 0x7f9978131a00 2023-10-03T10:15:37.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.365+0000 7fa220cb4700 1 -- 172.21.15.146:0/1539141777 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa21c120500 con 0x7fa21c130ce0 2023-10-03T10:15:37.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.365+0000 7fa212ffd700 1 -- 172.21.15.146:0/1539141777 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa21c120500 con 0x7fa21c130ce0 2023-10-03T10:15:37.366 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:37.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.368+0000 7fa220cb4700 1 -- 172.21.15.146:0/1539141777 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c130ce0 msgr2=0x7fa21c1c9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.368+0000 7fa220cb4700 1 --2- 172.21.15.146:0/1539141777 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c130ce0 0x7fa21c1c9060 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa21400efc0 tx=0x7fa21400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.368+0000 7fa220cb4700 1 -- 172.21.15.146:0/1539141777 shutdown_connections 2023-10-03T10:15:37.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.368+0000 7fa220cb4700 1 --2- 172.21.15.146:0/1539141777 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c130ce0 0x7fa21c1c9060 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.368+0000 7fa220cb4700 1 --2- 172.21.15.146:0/1539141777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c09d860 0x7fa21c1c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.368+0000 7fa220cb4700 1 --2- 172.21.15.146:0/1539141777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa21c09e170 0x7fa21c1c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.368+0000 7fa220cb4700 1 -- 172.21.15.146:0/1539141777 >> 172.21.15.146:0/1539141777 conn(0x7fa21c099c40 msgr2=0x7fa21c0a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.369+0000 7fa220cb4700 1 -- 172.21.15.146:0/1539141777 shutdown_connections 2023-10-03T10:15:37.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.369+0000 7fa220cb4700 1 -- 172.21.15.146:0/1539141777 wait complete. 2023-10-03T10:15:37.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.380+0000 7f624d508700 1 -- 172.21.15.146:0/2750577608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f624806c3b0 con 0x7f624809e170 2023-10-03T10:15:37.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.380+0000 7f622f7fe700 1 -- 172.21.15.146:0/2750577608 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f623c0199a0 con 0x7f624809e170 2023-10-03T10:15:37.381 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:37.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.382+0000 7f624d508700 1 -- 172.21.15.146:0/2750577608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f624809e170 msgr2=0x7f624811eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.382+0000 7f624d508700 1 --2- 172.21.15.146:0/2750577608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f624809e170 0x7f624811eb50 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f623c000c00 tx=0x7f623c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:37.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.382+0000 7f624d508700 1 -- 172.21.15.146:0/2750577608 shutdown_connections 2023-10-03T10:15:37.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.382+0000 7f624d508700 1 --2- 172.21.15.146:0/2750577608 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6248130ce0 0x7f624811f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.382+0000 7f624d508700 1 --2- 172.21.15.146:0/2750577608 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f624809d860 0x7f624811e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.382+0000 7f624d508700 1 --2- 172.21.15.146:0/2750577608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f624809e170 0x7f624811eb50 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.382+0000 7f624d508700 1 -- 172.21.15.146:0/2750577608 >> 172.21.15.146:0/2750577608 conn(0x7f6248099c40 msgr2=0x7f62480a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.383+0000 7f624d508700 1 -- 172.21.15.146:0/2750577608 shutdown_connections 2023-10-03T10:15:37.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.383+0000 7f624d508700 1 -- 172.21.15.146:0/2750577608 wait complete. 2023-10-03T10:15:37.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:37.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.419+0000 7f78e8181700 1 -- 172.21.15.146:0/954954191 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f78e004f2a0 con 0x7f78e009f180 2023-10-03T10:15:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.419+0000 7f78d67fc700 1 -- 172.21.15.146:0/954954191 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f78d0015020 con 0x7f78e009f180 2023-10-03T10:15:37.420 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:37.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.421+0000 7f78e8181700 1 -- 172.21.15.146:0/954954191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78e009f180 msgr2=0x7f78e011f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.421+0000 7f78e8181700 1 --2- 172.21.15.146:0/954954191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78e009f180 0x7f78e011f5e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009fd0 tx=0x7f78d0004750 comp rx=0 tx=0).stop 2023-10-03T10:15:37.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.421+0000 7f78e8181700 1 -- 172.21.15.146:0/954954191 shutdown_connections 2023-10-03T10:15:37.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.421+0000 7f78e8181700 1 --2- 172.21.15.146:0/954954191 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78e0131d70 0x7f78e011fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.421+0000 7f78e8181700 1 --2- 172.21.15.146:0/954954191 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f78e009e870 0x7f78e011f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.421+0000 7f78e8181700 1 --2- 172.21.15.146:0/954954191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78e009f180 0x7f78e011f5e0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.421+0000 7f78e8181700 1 -- 172.21.15.146:0/954954191 >> 172.21.15.146:0/954954191 conn(0x7f78e00a4430 msgr2=0x7f78e0131110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.421+0000 7f78e8181700 1 -- 172.21.15.146:0/954954191 shutdown_connections 2023-10-03T10:15:37.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.421+0000 7f78e8181700 1 -- 172.21.15.146:0/954954191 wait complete. 2023-10-03T10:15:37.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:37.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.448+0000 7f997f28e700 1 -- 172.21.15.146:0/3677238761 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f997811d2f0 con 0x7f9978131a00 2023-10-03T10:15:37.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.448+0000 7f996dffb700 1 -- 172.21.15.146:0/3677238761 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9970018020 con 0x7f9978131a00 2023-10-03T10:15:37.449 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:37.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.450+0000 7f997f28e700 1 -- 172.21.15.146:0/3677238761 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9978131a00 msgr2=0x7f997811a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.450+0000 7f997f28e700 1 --2- 172.21.15.146:0/3677238761 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9978131a00 0x7f997811a910 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f997000efc0 tx=0x7f997000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.450+0000 7f997f28e700 1 -- 172.21.15.146:0/3677238761 shutdown_connections 2023-10-03T10:15:37.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.450+0000 7f997f28e700 1 --2- 172.21.15.146:0/3677238761 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9978131a00 0x7f997811a910 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.450+0000 7f997f28e700 1 --2- 172.21.15.146:0/3677238761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f997806a770 0x7f9978119e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.450+0000 7f997f28e700 1 --2- 172.21.15.146:0/3677238761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f997809dec0 0x7f997811a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.450+0000 7f997f28e700 1 -- 172.21.15.146:0/3677238761 >> 172.21.15.146:0/3677238761 conn(0x7f9978099c40 msgr2=0x7f997812eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.450+0000 7f997f28e700 1 -- 172.21.15.146:0/3677238761 shutdown_connections 2023-10-03T10:15:37.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:37.450+0000 7f997f28e700 1 -- 172.21.15.146:0/3677238761 wait complete. 2023-10-03T10:15:37.463 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:38.387 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:38.396 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:38.435 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:38.464 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:38.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.540+0000 7fea23b1e700 1 Processor -- start 2023-10-03T10:15:38.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.540+0000 7fea23b1e700 1 -- start start 2023-10-03T10:15:38.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.541+0000 7fea23b1e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fea1c09d860 0x7fea1c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.541+0000 7fea23b1e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea1c09e170 0x7fea1c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.541+0000 7fea23b1e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1c09aaa0 con 0x7fea1c130ce0 2023-10-03T10:15:38.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.541+0000 7fea23b1e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1c09f870 con 0x7fea1c09d860 2023-10-03T10:15:38.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.541+0000 7fea23b1e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c09b360 con 0x7fea1c09e170 2023-10-03T10:15:38.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.541+0000 7fea210b9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea1c09e170 0x7fea1c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.541+0000 7fea218ba700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fea1c09d860 0x7fea1c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.541+0000 7fea218ba700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fea1c09d860 0x7fea1c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39580/0 (socket says 172.21.15.146:39580) 2023-10-03T10:15:38.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.541+0000 7fea210b9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea1c09e170 0x7fea1c1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59616/0 (socket says 172.21.15.146:59616) 2023-10-03T10:15:38.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.541+0000 7fea218ba700 1 -- 172.21.15.146:0/2325962276 learned_addr learned my addr 172.21.15.146:0/2325962276 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:38.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.541+0000 7fea208b8700 1 -- 172.21.15.146:0/2325962276 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130999828 0 0) 0x7fea1c09aaa0 con 0x7fea1c130ce0 2023-10-03T10:15:38.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.541+0000 7fea210b9700 1 -- 172.21.15.146:0/2325962276 >> v2:172.21.15.146:3300/0 conn(0x7fea1c09d860 msgr2=0x7fea1c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.541+0000 7fea210b9700 1 --2- 172.21.15.146:0/2325962276 >> v2:172.21.15.146:3300/0 conn(0x7fea1c09d860 0x7fea1c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.541+0000 7fea210b9700 1 -- 172.21.15.146:0/2325962276 >> v1:172.21.15.146:6789/0 conn(0x7fea1c130ce0 legacy=0x7fea1c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.541+0000 7fea210b9700 1 -- 172.21.15.146:0/2325962276 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c09b620 con 0x7fea1c09e170 2023-10-03T10:15:38.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.542+0000 7fea210b9700 1 --2- 172.21.15.146:0/2325962276 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea1c09e170 0x7fea1c1307a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fea0c009840 tx=0x7fea0c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71250896281af9a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.542+0000 7fea208b8700 1 -- 172.21.15.146:0/2325962276 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c011830 con 0x7fea1c09e170 2023-10-03T10:15:38.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.542+0000 7fea208b8700 1 -- 172.21.15.146:0/2325962276 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c011990 con 0x7fea1c09e170 2023-10-03T10:15:38.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.542+0000 7fea208b8700 1 -- 172.21.15.146:0/2325962276 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c011d20 con 0x7fea1c09e170 2023-10-03T10:15:38.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.543+0000 7fea23b1e700 1 -- 172.21.15.146:0/2325962276 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea1c09e170 msgr2=0x7fea1c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.543+0000 7fea23b1e700 1 --2- 172.21.15.146:0/2325962276 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea1c09e170 0x7fea1c1307a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fea0c009840 tx=0x7fea0c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:38.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.543+0000 7fea23b1e700 1 -- 172.21.15.146:0/2325962276 shutdown_connections 2023-10-03T10:15:38.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.543+0000 7fea23b1e700 1 --2- 172.21.15.146:0/2325962276 >> v2:172.21.15.146:3300/0 conn(0x7fea1c09d860 0x7fea1c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.543+0000 7fea23b1e700 1 --2- 172.21.15.146:0/2325962276 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea1c09e170 0x7fea1c1307a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.543+0000 7fea23b1e700 1 -- 172.21.15.146:0/2325962276 >> 172.21.15.146:0/2325962276 conn(0x7fea1c099c40 msgr2=0x7fea1c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.543+0000 7fea23b1e700 1 -- 172.21.15.146:0/2325962276 shutdown_connections 2023-10-03T10:15:38.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.543+0000 7fea23b1e700 1 -- 172.21.15.146:0/2325962276 wait complete. 2023-10-03T10:15:38.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.544+0000 7fea23b1e700 1 Processor -- start 2023-10-03T10:15:38.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.544+0000 7fea23b1e700 1 -- start start 2023-10-03T10:15:38.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.545+0000 7fea23b1e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea1c09d860 0x7fea1c1355b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.545+0000 7fea23b1e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea1c09e170 0x7fea1c135af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.545+0000 7fea23b1e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea1c130ce0 0x7fea1c136030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.545+0000 7fea23b1e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c072740 con 0x7fea1c09d860 2023-10-03T10:15:38.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.545+0000 7fea23b1e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c137770 con 0x7fea1c130ce0 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.545+0000 7fea23b1e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c138b30 con 0x7fea1c09e170 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.545+0000 7fea218ba700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea1c09d860 0x7fea1c1355b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.545+0000 7fea218ba700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea1c09d860 0x7fea1c1355b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39586/0 (socket says 172.21.15.146:39586) 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.545+0000 7fea218ba700 1 -- 172.21.15.146:0/3610425844 learned_addr learned my addr 172.21.15.146:0/3610425844 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.545+0000 7fea210b9700 1 --2- 172.21.15.146:0/3610425844 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea1c09e170 0x7fea1c135af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.545+0000 7fea218ba700 1 -- 172.21.15.146:0/3610425844 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea1c09e170 msgr2=0x7fea1c135af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.545+0000 7fea218ba700 1 --2- 172.21.15.146:0/3610425844 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea1c09e170 0x7fea1c135af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.545+0000 7fea218ba700 1 -- 172.21.15.146:0/3610425844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea1c130ce0 msgr2=0x7fea1c136030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.545+0000 7fea218ba700 1 --2- 172.21.15.146:0/3610425844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea1c130ce0 0x7fea1c136030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.545+0000 7fea218ba700 1 -- 172.21.15.146:0/3610425844 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0c0094a0 con 0x7fea1c09d860 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.545+0000 7fea210b9700 1 --2- 172.21.15.146:0/3610425844 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea1c09e170 0x7fea1c135af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.546+0000 7fea218ba700 1 --2- 172.21.15.146:0/3610425844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea1c09d860 0x7fea1c1355b0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fea1800e910 tx=0x7fea1800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.546+0000 7fea127fc700 1 -- 172.21.15.146:0/3610425844 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea180096a0 con 0x7fea1c09d860 2023-10-03T10:15:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.546+0000 7fea127fc700 1 -- 172.21.15.146:0/3610425844 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1800c850 con 0x7fea1c09d860 2023-10-03T10:15:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.546+0000 7fea23b1e700 1 -- 172.21.15.146:0/3610425844 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1c138860 con 0x7fea1c09d860 2023-10-03T10:15:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.546+0000 7fea127fc700 1 -- 172.21.15.146:0/3610425844 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1800cc00 con 0x7fea1c09d860 2023-10-03T10:15:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.546+0000 7fea23b1e700 1 -- 172.21.15.146:0/3610425844 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1c119c40 con 0x7fea1c09d860 2023-10-03T10:15:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.547+0000 7fea127fc700 1 -- 172.21.15.146:0/3610425844 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea1800cd60 con 0x7fea1c09d860 2023-10-03T10:15:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.547+0000 7fea127fc700 1 -- 172.21.15.146:0/3610425844 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fea1803f7b0 con 0x7fea1c09d860 2023-10-03T10:15:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.547+0000 7fea23b1e700 1 -- 172.21.15.146:0/3610425844 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1c138f00 con 0x7fea1c09d860 2023-10-03T10:15:38.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.552+0000 7fea127fc700 1 -- 172.21.15.146:0/3610425844 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea180232f0 con 0x7fea1c09d860 2023-10-03T10:15:38.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.569+0000 7f6d57dbe700 1 Processor -- start 2023-10-03T10:15:38.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.569+0000 7f6d57dbe700 1 -- start start 2023-10-03T10:15:38.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.570+0000 7f6d57dbe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d500a0a70 0x7f6d500a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.570+0000 7f6d57dbe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d500a1380 0x7f6d50133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.570+0000 7f6d57dbe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d50133f50 0x7f6d50134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.570+0000 7f6d57dbe700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d5009e9d0 con 0x7f6d500a1380 2023-10-03T10:15:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.570+0000 7f6d57dbe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5009dc00 con 0x7f6d50133f50 2023-10-03T10:15:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.570+0000 7f6d57dbe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5009dec0 con 0x7f6d500a0a70 2023-10-03T10:15:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.570+0000 7f6d55359700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d500a1380 0x7f6d50133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.570+0000 7f6d55359700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d500a1380 0x7f6d50133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39596/0 (socket says 172.21.15.146:39596) 2023-10-03T10:15:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.570+0000 7f6d55359700 1 -- 172.21.15.146:0/2546127111 learned_addr learned my addr 172.21.15.146:0/2546127111 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.570+0000 7f6d5635b700 1 --2- 172.21.15.146:0/2546127111 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d50133f50 0x7f6d50134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.570+0000 7f6d55b5a700 1 --2- 172.21.15.146:0/2546127111 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d500a0a70 0x7f6d500a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.570+0000 7f6d55359700 1 -- 172.21.15.146:0/2546127111 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d500a0a70 msgr2=0x7f6d500a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.570+0000 7f6d55359700 1 --2- 172.21.15.146:0/2546127111 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d500a0a70 0x7f6d500a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.570+0000 7f6d55359700 1 -- 172.21.15.146:0/2546127111 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d50133f50 msgr2=0x7f6d50134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.570+0000 7f6d55359700 1 --2- 172.21.15.146:0/2546127111 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d50133f50 0x7f6d50134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.570+0000 7f6d55359700 1 -- 172.21.15.146:0/2546127111 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5009e6a0 con 0x7f6d500a1380 2023-10-03T10:15:38.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.570+0000 7f6d55359700 1 --2- 172.21.15.146:0/2546127111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d500a1380 0x7f6d50133a10 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6d400098f0 tx=0x7f6d40009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5da67d95486e66 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.570+0000 7f6d54b58700 1 -- 172.21.15.146:0/2546127111 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40011830 con 0x7f6d500a1380 2023-10-03T10:15:38.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.571+0000 7f6d54b58700 1 -- 172.21.15.146:0/2546127111 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d40011990 con 0x7f6d500a1380 2023-10-03T10:15:38.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.571+0000 7f6d54b58700 1 -- 172.21.15.146:0/2546127111 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40011d20 con 0x7f6d500a1380 2023-10-03T10:15:38.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.571+0000 7f6d57dbe700 1 -- 172.21.15.146:0/2546127111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d500a1380 msgr2=0x7f6d50133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.571+0000 7f6d57dbe700 1 --2- 172.21.15.146:0/2546127111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d500a1380 0x7f6d50133a10 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6d400098f0 tx=0x7f6d40009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:38.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.571+0000 7f6d57dbe700 1 -- 172.21.15.146:0/2546127111 shutdown_connections 2023-10-03T10:15:38.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.571+0000 7f6d57dbe700 1 --2- 172.21.15.146:0/2546127111 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d50133f50 0x7f6d50134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.571+0000 7f6d57dbe700 1 --2- 172.21.15.146:0/2546127111 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d500a0a70 0x7f6d500a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.571+0000 7f6d57dbe700 1 --2- 172.21.15.146:0/2546127111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d500a1380 0x7f6d50133a10 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.571+0000 7f6d57dbe700 1 -- 172.21.15.146:0/2546127111 >> 172.21.15.146:0/2546127111 conn(0x7f6d500a6610 msgr2=0x7f6d500a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.571+0000 7f6d57dbe700 1 -- 172.21.15.146:0/2546127111 shutdown_connections 2023-10-03T10:15:38.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.571+0000 7f6d57dbe700 1 -- 172.21.15.146:0/2546127111 wait complete. 2023-10-03T10:15:38.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.572+0000 7f6d57dbe700 1 Processor -- start 2023-10-03T10:15:38.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.572+0000 7f6d57dbe700 1 -- start start 2023-10-03T10:15:38.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.573+0000 7f6d57dbe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d500a0a70 0x7f6d501ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.573+0000 7f6d57dbe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d500a1380 0x7f6d501cd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.573+0000 7f6d57dbe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d50133f50 0x7f6d5006dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.573+0000 7f6d57dbe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50070d50 con 0x7f6d50133f50 2023-10-03T10:15:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.573+0000 7f6d57dbe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d500715e0 con 0x7f6d500a1380 2023-10-03T10:15:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.573+0000 7f6d57dbe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d500a5180 con 0x7f6d500a0a70 2023-10-03T10:15:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.573+0000 7f6d5635b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d50133f50 0x7f6d5006dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.573+0000 7f6d5635b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d50133f50 0x7f6d5006dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39606/0 (socket says 172.21.15.146:39606) 2023-10-03T10:15:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.573+0000 7f6d5635b700 1 -- 172.21.15.146:0/1075053746 learned_addr learned my addr 172.21.15.146:0/1075053746 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.573+0000 7f6d55359700 1 --2- 172.21.15.146:0/1075053746 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d500a1380 0x7f6d501cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.573+0000 7f6d55b5a700 1 --2- 172.21.15.146:0/1075053746 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d500a0a70 0x7f6d501ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.573+0000 7f6d5635b700 1 -- 172.21.15.146:0/1075053746 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d500a0a70 msgr2=0x7f6d501ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.573+0000 7f6d5635b700 1 --2- 172.21.15.146:0/1075053746 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d500a0a70 0x7f6d501ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.573+0000 7f6d5635b700 1 -- 172.21.15.146:0/1075053746 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d500a1380 msgr2=0x7f6d501cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.573+0000 7f6d5635b700 1 --2- 172.21.15.146:0/1075053746 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d500a1380 0x7f6d501cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.573+0000 7f6d5635b700 1 -- 172.21.15.146:0/1075053746 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d40009550 con 0x7f6d50133f50 2023-10-03T10:15:38.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.573+0000 7f6d55b5a700 1 --2- 172.21.15.146:0/1075053746 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d500a0a70 0x7f6d501ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:38.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.574+0000 7f6d5635b700 1 --2- 172.21.15.146:0/1075053746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d50133f50 0x7f6d5006dac0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800efc0 tx=0x7f6d4800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.574+0000 7f6d467fc700 1 -- 172.21.15.146:0/1075053746 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48009ea0 con 0x7f6d50133f50 2023-10-03T10:15:38.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.574+0000 7f6d467fc700 1 -- 172.21.15.146:0/1075053746 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4800f040 con 0x7f6d50133f50 2023-10-03T10:15:38.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.574+0000 7f6d467fc700 1 -- 172.21.15.146:0/1075053746 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48014480 con 0x7f6d50133f50 2023-10-03T10:15:38.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.574+0000 7f6d57dbe700 1 -- 172.21.15.146:0/1075053746 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d500a03e0 con 0x7f6d50133f50 2023-10-03T10:15:38.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.574+0000 7f6d57dbe700 1 -- 172.21.15.146:0/1075053746 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d50071300 con 0x7f6d50133f50 2023-10-03T10:15:38.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.575+0000 7f6d467fc700 1 -- 172.21.15.146:0/1075053746 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6d480145e0 con 0x7f6d50133f50 2023-10-03T10:15:38.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.575+0000 7f6d57dbe700 1 -- 172.21.15.146:0/1075053746 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5004f2a0 con 0x7f6d50133f50 2023-10-03T10:15:38.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.575+0000 7f6d467fc700 1 -- 172.21.15.146:0/1075053746 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6d48040360 con 0x7f6d50133f50 2023-10-03T10:15:38.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.580+0000 7f6d467fc700 1 -- 172.21.15.146:0/1075053746 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d4801d400 con 0x7f6d50133f50 2023-10-03T10:15:38.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.610+0000 7f8f88b41700 1 Processor -- start 2023-10-03T10:15:38.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.610+0000 7f8f88b41700 1 -- start start 2023-10-03T10:15:38.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.611+0000 7f8f88b41700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f8409d860 0x7f8f8409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.611+0000 7f8f88b41700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f84130eb0 0x7f8f84138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.611+0000 7f8f88b41700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f8409aaa0 con 0x7f8f8409e170 2023-10-03T10:15:38.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.611+0000 7f8f88b41700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8409f870 con 0x7f8f84130eb0 2023-10-03T10:15:38.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.611+0000 7f8f88b41700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8409b360 con 0x7f8f8409d860 2023-10-03T10:15:38.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.611+0000 7f8f8259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f8409d860 0x7f8f8409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.611+0000 7f8f8259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f8409d860 0x7f8f8409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59662/0 (socket says 172.21.15.146:59662) 2023-10-03T10:15:38.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.611+0000 7f8f8259c700 1 -- 172.21.15.146:0/712448016 learned_addr learned my addr 172.21.15.146:0/712448016 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:38.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.611+0000 7f8f81d9b700 1 --1- 172.21.15.146:0/712448016 >> v1:172.21.15.146:6789/0 conn(0x7f8f8409e170 0x7f8f841307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36088/0 (socket says 172.21.15.146:36088) 2023-10-03T10:15:38.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.611+0000 7f8f82d9d700 1 --2- 172.21.15.146:0/712448016 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f84130eb0 0x7f8f84138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.611+0000 7f8f8259c700 1 -- 172.21.15.146:0/712448016 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f84130eb0 msgr2=0x7f8f84138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.611+0000 7f8f8259c700 1 --2- 172.21.15.146:0/712448016 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f84130eb0 0x7f8f84138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.611+0000 7f8f8259c700 1 -- 172.21.15.146:0/712448016 >> v1:172.21.15.146:6789/0 conn(0x7f8f8409e170 legacy=0x7f8f841307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.612+0000 7f8f8259c700 1 -- 172.21.15.146:0/712448016 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8409b620 con 0x7f8f8409d860 2023-10-03T10:15:38.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.612+0000 7f8f8259c700 1 --2- 172.21.15.146:0/712448016 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f8409d860 0x7f8f8409dc30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009920 tx=0x7f8f74009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8184eb5074d84585 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.612+0000 7f8f8159a700 1 -- 172.21.15.146:0/712448016 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74011830 con 0x7f8f8409d860 2023-10-03T10:15:38.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.612+0000 7f8f8159a700 1 -- 172.21.15.146:0/712448016 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f74011990 con 0x7f8f8409d860 2023-10-03T10:15:38.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.612+0000 7f8f8159a700 1 -- 172.21.15.146:0/712448016 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74011d20 con 0x7f8f8409d860 2023-10-03T10:15:38.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.612+0000 7f8f88b41700 1 -- 172.21.15.146:0/712448016 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f8409d860 msgr2=0x7f8f8409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.612+0000 7f8f88b41700 1 --2- 172.21.15.146:0/712448016 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f8409d860 0x7f8f8409dc30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009920 tx=0x7f8f74009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:38.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.613+0000 7f8f88b41700 1 -- 172.21.15.146:0/712448016 shutdown_connections 2023-10-03T10:15:38.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.613+0000 7f8f88b41700 1 --2- 172.21.15.146:0/712448016 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f84130eb0 0x7f8f84138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.613+0000 7f8f88b41700 1 --2- 172.21.15.146:0/712448016 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f8409d860 0x7f8f8409dc30 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.613+0000 7f8f88b41700 1 -- 172.21.15.146:0/712448016 >> 172.21.15.146:0/712448016 conn(0x7f8f84099c40 msgr2=0x7f8f840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.613+0000 7f8f88b41700 1 -- 172.21.15.146:0/712448016 shutdown_connections 2023-10-03T10:15:38.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.613+0000 7f8f88b41700 1 -- 172.21.15.146:0/712448016 wait complete. 2023-10-03T10:15:38.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.614+0000 7f8f88b41700 1 Processor -- start 2023-10-03T10:15:38.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.614+0000 7f8f88b41700 1 -- start start 2023-10-03T10:15:38.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.614+0000 7f8f88b41700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f8409d860 0x7f8f8413aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.614+0000 7f8f88b41700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f8409e170 0x7f8f8413afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.614+0000 7f8f88b41700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f84130eb0 0x7f8f84135c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.614+0000 7f8f88b41700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f84138a60 con 0x7f8f84130eb0 2023-10-03T10:15:38.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.614+0000 7f8f88b41700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f84137060 con 0x7f8f8409e170 2023-10-03T10:15:38.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.614+0000 7f8f88b41700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f840a2220 con 0x7f8f8409d860 2023-10-03T10:15:38.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.614+0000 7f8f8259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f8409d860 0x7f8f8413aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.614+0000 7f8f82d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f84130eb0 0x7f8f84135c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.614+0000 7f8f8259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f8409d860 0x7f8f8413aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59670/0 (socket says 172.21.15.146:59670) 2023-10-03T10:15:38.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.614+0000 7f8f8259c700 1 -- 172.21.15.146:0/2455132704 learned_addr learned my addr 172.21.15.146:0/2455132704 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:38.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.614+0000 7f8f81d9b700 1 --2- 172.21.15.146:0/2455132704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f8409e170 0x7f8f8413afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.615+0000 7f8f8259c700 1 -- 172.21.15.146:0/2455132704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f8409e170 msgr2=0x7f8f8413afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.615+0000 7f8f8259c700 1 --2- 172.21.15.146:0/2455132704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f8409e170 0x7f8f8413afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.615+0000 7f8f8259c700 1 -- 172.21.15.146:0/2455132704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f84130eb0 msgr2=0x7f8f84135c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.615+0000 7f8f8259c700 1 --2- 172.21.15.146:0/2455132704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f84130eb0 0x7f8f84135c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.615+0000 7f8f8259c700 1 -- 172.21.15.146:0/2455132704 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f74009550 con 0x7f8f8409d860 2023-10-03T10:15:38.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.615+0000 7f8f82d9d700 1 --2- 172.21.15.146:0/2455132704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f84130eb0 0x7f8f84135c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.615+0000 7f8f81d9b700 1 --2- 172.21.15.146:0/2455132704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f8409e170 0x7f8f8413afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:38.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.615+0000 7f8f8259c700 1 --2- 172.21.15.146:0/2455132704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f8409d860 0x7f8f8413aa60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8f74000c00 tx=0x7f8f74004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.615+0000 7f8f72ffd700 1 -- 172.21.15.146:0/2455132704 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74004510 con 0x7f8f8409d860 2023-10-03T10:15:38.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.615+0000 7f8f72ffd700 1 -- 172.21.15.146:0/2455132704 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f740036a0 con 0x7f8f8409d860 2023-10-03T10:15:38.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.615+0000 7f8f72ffd700 1 -- 172.21.15.146:0/2455132704 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74003a10 con 0x7f8f8409d860 2023-10-03T10:15:38.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.615+0000 7f8f88b41700 1 -- 172.21.15.146:0/2455132704 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f84138070 con 0x7f8f8409d860 2023-10-03T10:15:38.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.615+0000 7f8f88b41700 1 -- 172.21.15.146:0/2455132704 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f84138eb0 con 0x7f8f8409d860 2023-10-03T10:15:38.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.616+0000 7f8f72ffd700 1 -- 172.21.15.146:0/2455132704 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f74003b70 con 0x7f8f8409d860 2023-10-03T10:15:38.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.616+0000 7f8f72ffd700 1 -- 172.21.15.146:0/2455132704 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8f74021030 con 0x7f8f8409d860 2023-10-03T10:15:38.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.616+0000 7f8f88b41700 1 -- 172.21.15.146:0/2455132704 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f8404f2a0 con 0x7f8f8409d860 2023-10-03T10:15:38.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.621+0000 7f8f72ffd700 1 -- 172.21.15.146:0/2455132704 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f74015080 con 0x7f8f8409d860 2023-10-03T10:15:38.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.650+0000 7f62ae2ba700 1 Processor -- start 2023-10-03T10:15:38.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.650+0000 7f62ae2ba700 1 -- start start 2023-10-03T10:15:38.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.650+0000 7f62ae2ba700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62a809e870 0x7f62a809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.650+0000 7f62ae2ba700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f62a809f180 0x7f62a8133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.650+0000 7f62ae2ba700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a809fa00 con 0x7f62a8134160 2023-10-03T10:15:38.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.650+0000 7f62ae2ba700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a80a0370 con 0x7f62a809f180 2023-10-03T10:15:38.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.651+0000 7f62ae2ba700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62a806bec0 con 0x7f62a809e870 2023-10-03T10:15:38.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.651+0000 7f62a77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f62a809f180 0x7f62a8133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.651+0000 7f62a77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f62a809f180 0x7f62a8133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39620/0 (socket says 172.21.15.146:39620) 2023-10-03T10:15:38.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.651+0000 7f62a77fe700 1 -- 172.21.15.146:0/1580808842 learned_addr learned my addr 172.21.15.146:0/1580808842 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:38.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.651+0000 7f62a7fff700 1 --2- 172.21.15.146:0/1580808842 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62a809e870 0x7f62a809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.651+0000 7f62a7fff700 1 -- 172.21.15.146:0/1580808842 >> v2:172.21.15.146:3300/0 conn(0x7f62a809f180 msgr2=0x7f62a8133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.651+0000 7f62a7fff700 1 --2- 172.21.15.146:0/1580808842 >> v2:172.21.15.146:3300/0 conn(0x7f62a809f180 0x7f62a8133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.651+0000 7f62a7fff700 1 -- 172.21.15.146:0/1580808842 >> v1:172.21.15.146:6789/0 conn(0x7f62a8134160 legacy=0x7f62a813ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.651+0000 7f62a7fff700 1 -- 172.21.15.146:0/1580808842 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a809ada0 con 0x7f62a809e870 2023-10-03T10:15:38.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.651+0000 7f62a77fe700 1 --2- 172.21.15.146:0/1580808842 >> v2:172.21.15.146:3300/0 conn(0x7f62a809f180 0x7f62a8133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.651+0000 7f62a7fff700 1 --2- 172.21.15.146:0/1580808842 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62a809e870 0x7f62a809ec40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6298009840 tx=0x7f6298009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ff848d66b0b8602 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.652+0000 7f62a6ffd700 1 -- 172.21.15.146:0/1580808842 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6298011830 con 0x7f62a809e870 2023-10-03T10:15:38.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.652+0000 7f62a6ffd700 1 -- 172.21.15.146:0/1580808842 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6298011990 con 0x7f62a809e870 2023-10-03T10:15:38.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.652+0000 7f62a6ffd700 1 -- 172.21.15.146:0/1580808842 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6298011d20 con 0x7f62a809e870 2023-10-03T10:15:38.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.652+0000 7f62ae2ba700 1 -- 172.21.15.146:0/1580808842 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62a809e870 msgr2=0x7f62a809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.652+0000 7f62ae2ba700 1 --2- 172.21.15.146:0/1580808842 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62a809e870 0x7f62a809ec40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6298009840 tx=0x7f6298009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:38.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.652+0000 7f62ae2ba700 1 -- 172.21.15.146:0/1580808842 shutdown_connections 2023-10-03T10:15:38.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.652+0000 7f62ae2ba700 1 --2- 172.21.15.146:0/1580808842 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62a809e870 0x7f62a809ec40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.652+0000 7f62ae2ba700 1 --2- 172.21.15.146:0/1580808842 >> v2:172.21.15.146:3300/0 conn(0x7f62a809f180 0x7f62a8133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.652+0000 7f62ae2ba700 1 -- 172.21.15.146:0/1580808842 >> 172.21.15.146:0/1580808842 conn(0x7f62a80a4430 msgr2=0x7f62a80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.652+0000 7f62ae2ba700 1 -- 172.21.15.146:0/1580808842 shutdown_connections 2023-10-03T10:15:38.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.652+0000 7f62ae2ba700 1 -- 172.21.15.146:0/1580808842 wait complete. 2023-10-03T10:15:38.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.653+0000 7f62ae2ba700 1 Processor -- start 2023-10-03T10:15:38.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.653+0000 7f62ae2ba700 1 -- start start 2023-10-03T10:15:38.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.654+0000 7f62ae2ba700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a809e870 0x7f62a8122b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.654+0000 7f62ae2ba700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62a809f180 0x7f62a81230d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.654+0000 7f62ae2ba700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62a8134160 0x7f62a8123610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.654+0000 7f62ae2ba700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a8124060 con 0x7f62a809e870 2023-10-03T10:15:38.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.654+0000 7f62ae2ba700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a8126330 con 0x7f62a809f180 2023-10-03T10:15:38.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.654+0000 7f62ae2ba700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62a8124810 con 0x7f62a8134160 2023-10-03T10:15:38.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.654+0000 7f62ac857700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62a8134160 0x7f62a8123610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.654+0000 7f62ac857700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62a8134160 0x7f62a8123610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59692/0 (socket says 172.21.15.146:59692) 2023-10-03T10:15:38.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.654+0000 7f62ac857700 1 -- 172.21.15.146:0/2408083813 learned_addr learned my addr 172.21.15.146:0/2408083813 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:38.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.654+0000 7f62a7fff700 1 --2- 172.21.15.146:0/2408083813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a809e870 0x7f62a8122b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.654+0000 7f62a77fe700 1 --2- 172.21.15.146:0/2408083813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62a809f180 0x7f62a81230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.654+0000 7f62ac857700 1 -- 172.21.15.146:0/2408083813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62a809f180 msgr2=0x7f62a81230d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.654+0000 7f62ac857700 1 --2- 172.21.15.146:0/2408083813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62a809f180 0x7f62a81230d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.654+0000 7f62ac857700 1 -- 172.21.15.146:0/2408083813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a809e870 msgr2=0x7f62a8122b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.654+0000 7f62ac857700 1 --2- 172.21.15.146:0/2408083813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a809e870 0x7f62a8122b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.654+0000 7f62ac857700 1 -- 172.21.15.146:0/2408083813 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c009550 con 0x7f62a8134160 2023-10-03T10:15:38.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.654+0000 7f62a77fe700 1 --2- 172.21.15.146:0/2408083813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62a809f180 0x7f62a81230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:38.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.655+0000 7f62ac857700 1 --2- 172.21.15.146:0/2408083813 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62a8134160 0x7f62a8123610 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f62a000cc50 tx=0x7f62a000cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.655+0000 7f62a4ff9700 1 -- 172.21.15.146:0/2408083813 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a0003c00 con 0x7f62a8134160 2023-10-03T10:15:38.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.655+0000 7f62a4ff9700 1 -- 172.21.15.146:0/2408083813 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a0003d60 con 0x7f62a8134160 2023-10-03T10:15:38.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.655+0000 7f62a4ff9700 1 -- 172.21.15.146:0/2408083813 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a000ab60 con 0x7f62a8134160 2023-10-03T10:15:38.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.655+0000 7f62ae2ba700 1 -- 172.21.15.146:0/2408083813 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62980094a0 con 0x7f62a8134160 2023-10-03T10:15:38.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.655+0000 7f62ae2ba700 1 -- 172.21.15.146:0/2408083813 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a8133610 con 0x7f62a8134160 2023-10-03T10:15:38.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.656+0000 7f62a4ff9700 1 -- 172.21.15.146:0/2408083813 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f62a000acc0 con 0x7f62a8134160 2023-10-03T10:15:38.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.656+0000 7f62a4ff9700 1 -- 172.21.15.146:0/2408083813 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f62a003f800 con 0x7f62a8134160 2023-10-03T10:15:38.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.656+0000 7f62ae2ba700 1 -- 172.21.15.146:0/2408083813 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a8126190 con 0x7f62a8134160 2023-10-03T10:15:38.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.661+0000 7f62a4ff9700 1 -- 172.21.15.146:0/2408083813 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62a8126190 con 0x7f62a8134160 2023-10-03T10:15:38.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.776+0000 7f6d57dbe700 1 -- 172.21.15.146:0/1075053746 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6d50072980 con 0x7f6d50133f50 2023-10-03T10:15:38.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.777+0000 7f6d467fc700 1 -- 172.21.15.146:0/1075053746 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6d48040020 con 0x7f6d50133f50 2023-10-03T10:15:38.777 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:38.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.779+0000 7f6d57dbe700 1 -- 172.21.15.146:0/1075053746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d50133f50 msgr2=0x7f6d5006dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.779+0000 7f6d57dbe700 1 --2- 172.21.15.146:0/1075053746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d50133f50 0x7f6d5006dac0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800efc0 tx=0x7f6d4800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.779+0000 7f6d57dbe700 1 -- 172.21.15.146:0/1075053746 shutdown_connections 2023-10-03T10:15:38.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.779+0000 7f6d57dbe700 1 --2- 172.21.15.146:0/1075053746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d50133f50 0x7f6d5006dac0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.779+0000 7f6d57dbe700 1 --2- 172.21.15.146:0/1075053746 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d500a0a70 0x7f6d501ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.779+0000 7f6d57dbe700 1 --2- 172.21.15.146:0/1075053746 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d500a1380 0x7f6d501cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.779+0000 7f6d57dbe700 1 -- 172.21.15.146:0/1075053746 >> 172.21.15.146:0/1075053746 conn(0x7f6d500a6610 msgr2=0x7f6d5011c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.779+0000 7f6d57dbe700 1 -- 172.21.15.146:0/1075053746 shutdown_connections 2023-10-03T10:15:38.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.779+0000 7f6d57dbe700 1 -- 172.21.15.146:0/1075053746 wait complete. 2023-10-03T10:15:38.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:38.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.812+0000 7fea23b1e700 1 -- 172.21.15.146:0/3610425844 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fea1c04f2a0 con 0x7fea1c09d860 2023-10-03T10:15:38.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.812+0000 7fea127fc700 1 -- 172.21.15.146:0/3610425844 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fea18011350 con 0x7fea1c09d860 2023-10-03T10:15:38.813 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:38.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.814+0000 7fea23b1e700 1 -- 172.21.15.146:0/3610425844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea1c09d860 msgr2=0x7fea1c1355b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.814+0000 7fea23b1e700 1 --2- 172.21.15.146:0/3610425844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea1c09d860 0x7fea1c1355b0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fea1800e910 tx=0x7fea1800ecd0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.814+0000 7fea23b1e700 1 -- 172.21.15.146:0/3610425844 shutdown_connections 2023-10-03T10:15:38.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.814+0000 7fea23b1e700 1 --2- 172.21.15.146:0/3610425844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea1c130ce0 0x7fea1c136030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.814+0000 7fea23b1e700 1 --2- 172.21.15.146:0/3610425844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea1c09d860 0x7fea1c1355b0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.814+0000 7fea23b1e700 1 --2- 172.21.15.146:0/3610425844 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea1c09e170 0x7fea1c135af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.814+0000 7fea23b1e700 1 -- 172.21.15.146:0/3610425844 >> 172.21.15.146:0/3610425844 conn(0x7fea1c099c40 msgr2=0x7fea1c139480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.814+0000 7fea23b1e700 1 -- 172.21.15.146:0/3610425844 shutdown_connections 2023-10-03T10:15:38.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.814+0000 7fea23b1e700 1 -- 172.21.15.146:0/3610425844 wait complete. 2023-10-03T10:15:38.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.816+0000 7f8f88b41700 1 -- 172.21.15.146:0/2455132704 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8f8413a300 con 0x7f8f8409d860 2023-10-03T10:15:38.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.817+0000 7f8f72ffd700 1 -- 172.21.15.146:0/2455132704 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f7401a430 con 0x7f8f8409d860 2023-10-03T10:15:38.817 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:38.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.819+0000 7f8f88b41700 1 -- 172.21.15.146:0/2455132704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f8409d860 msgr2=0x7f8f8413aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.819+0000 7f8f88b41700 1 --2- 172.21.15.146:0/2455132704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f8409d860 0x7f8f8413aa60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8f74000c00 tx=0x7f8f74004750 comp rx=0 tx=0).stop 2023-10-03T10:15:38.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.819+0000 7f8f88b41700 1 -- 172.21.15.146:0/2455132704 shutdown_connections 2023-10-03T10:15:38.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.819+0000 7f8f88b41700 1 --2- 172.21.15.146:0/2455132704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f84130eb0 0x7f8f84135c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.819+0000 7f8f88b41700 1 --2- 172.21.15.146:0/2455132704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f8409d860 0x7f8f8413aa60 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.819+0000 7f8f88b41700 1 --2- 172.21.15.146:0/2455132704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f8409e170 0x7f8f8413afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.819+0000 7f8f88b41700 1 -- 172.21.15.146:0/2455132704 >> 172.21.15.146:0/2455132704 conn(0x7f8f84099c40 msgr2=0x7f8f8413b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.819+0000 7f8f88b41700 1 -- 172.21.15.146:0/2455132704 shutdown_connections 2023-10-03T10:15:38.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.819+0000 7f8f88b41700 1 -- 172.21.15.146:0/2455132704 wait complete. 2023-10-03T10:15:38.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:38.832 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:38.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.873+0000 7f62ae2ba700 1 -- 172.21.15.146:0/2408083813 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f62a8126190 con 0x7f62a8134160 2023-10-03T10:15:38.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.874+0000 7f62a4ff9700 1 -- 172.21.15.146:0/2408083813 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f62a8126190 con 0x7f62a8134160 2023-10-03T10:15:38.874 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:38.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.876+0000 7f62ae2ba700 1 -- 172.21.15.146:0/2408083813 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62a8134160 msgr2=0x7f62a8123610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.876+0000 7f62ae2ba700 1 --2- 172.21.15.146:0/2408083813 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62a8134160 0x7f62a8123610 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f62a000cc50 tx=0x7f62a000cf60 comp rx=0 tx=0).stop 2023-10-03T10:15:38.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.876+0000 7f62ae2ba700 1 -- 172.21.15.146:0/2408083813 shutdown_connections 2023-10-03T10:15:38.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.876+0000 7f62ae2ba700 1 --2- 172.21.15.146:0/2408083813 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62a8134160 0x7f62a8123610 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.876+0000 7f62ae2ba700 1 --2- 172.21.15.146:0/2408083813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62a809e870 0x7f62a8122b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.876+0000 7f62ae2ba700 1 --2- 172.21.15.146:0/2408083813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f62a809f180 0x7f62a81230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.876+0000 7f62ae2ba700 1 -- 172.21.15.146:0/2408083813 >> 172.21.15.146:0/2408083813 conn(0x7f62a80a4430 msgr2=0x7f62a8071070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.876+0000 7f62ae2ba700 1 -- 172.21.15.146:0/2408083813 shutdown_connections 2023-10-03T10:15:38.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:38.876+0000 7f62ae2ba700 1 -- 172.21.15.146:0/2408083813 wait complete. 2023-10-03T10:15:38.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:39.793 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:39.829 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:39.833 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:39.890 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:39.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.946+0000 7fb889150700 1 Processor -- start 2023-10-03T10:15:39.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.946+0000 7fb889150700 1 -- start start 2023-10-03T10:15:39.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.947+0000 7fb889150700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8840a0a70 0x7fb8840a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.947+0000 7fb889150700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8840a1380 0x7fb884133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.947+0000 7fb889150700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb88409dc00 con 0x7fb884133f50 2023-10-03T10:15:39.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.947+0000 7fb889150700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb88409ea60 con 0x7fb8840a0a70 2023-10-03T10:15:39.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.947+0000 7fb889150700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb88409dec0 con 0x7fb8840a1380 2023-10-03T10:15:39.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.947+0000 7fb882d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8840a0a70 0x7fb8840a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.947+0000 7fb88359e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb884133f50 0x7fb88413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36106/0 (socket says 172.21.15.146:36106) 2023-10-03T10:15:39.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.947+0000 7fb88359e700 1 -- 172.21.15.146:0/64109291 learned_addr learned my addr 172.21.15.146:0/64109291 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:39.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.947+0000 7fb88259c700 1 --2- 172.21.15.146:0/64109291 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8840a1380 0x7fb884133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.948+0000 7fb882d9d700 1 -- 172.21.15.146:0/64109291 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8840a1380 msgr2=0x7fb884133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:39.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.948+0000 7fb882d9d700 1 --2- 172.21.15.146:0/64109291 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8840a1380 0x7fb884133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.948+0000 7fb882d9d700 1 -- 172.21.15.146:0/64109291 >> v1:172.21.15.146:6789/0 conn(0x7fb884133f50 legacy=0x7fb88413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.948+0000 7fb882d9d700 1 -- 172.21.15.146:0/64109291 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88409e6a0 con 0x7fb8840a0a70 2023-10-03T10:15:39.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.948+0000 7fb882d9d700 1 --2- 172.21.15.146:0/64109291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8840a0a70 0x7fb8840a0e40 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb874009840 tx=0x7fb874009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729bf95671af144f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.948+0000 7fb881d9b700 1 -- 172.21.15.146:0/64109291 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874011830 con 0x7fb8840a0a70 2023-10-03T10:15:39.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.948+0000 7fb881d9b700 1 -- 172.21.15.146:0/64109291 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb874011990 con 0x7fb8840a0a70 2023-10-03T10:15:39.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.948+0000 7fb881d9b700 1 -- 172.21.15.146:0/64109291 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874011d20 con 0x7fb8840a0a70 2023-10-03T10:15:39.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.949+0000 7fb889150700 1 -- 172.21.15.146:0/64109291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8840a0a70 msgr2=0x7fb8840a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.949+0000 7fb889150700 1 --2- 172.21.15.146:0/64109291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8840a0a70 0x7fb8840a0e40 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb874009840 tx=0x7fb874009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:39.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.949+0000 7fb889150700 1 -- 172.21.15.146:0/64109291 shutdown_connections 2023-10-03T10:15:39.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.949+0000 7fb889150700 1 --2- 172.21.15.146:0/64109291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8840a0a70 0x7fb8840a0e40 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.949+0000 7fb889150700 1 --2- 172.21.15.146:0/64109291 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8840a1380 0x7fb884133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.949+0000 7fb889150700 1 -- 172.21.15.146:0/64109291 >> 172.21.15.146:0/64109291 conn(0x7fb8840a6610 msgr2=0x7fb8840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.949+0000 7fb889150700 1 -- 172.21.15.146:0/64109291 shutdown_connections 2023-10-03T10:15:39.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.949+0000 7fb889150700 1 -- 172.21.15.146:0/64109291 wait complete. 2023-10-03T10:15:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.950+0000 7fb889150700 1 Processor -- start 2023-10-03T10:15:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.951+0000 7fb889150700 1 -- start start 2023-10-03T10:15:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.951+0000 7fb889150700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8840a0a70 0x7fb88411e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.951+0000 7fb889150700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8840a1380 0x7fb88411ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.951+0000 7fb889150700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb884133f50 0x7fb88411f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.951+0000 7fb889150700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8841220b0 con 0x7fb8840a0a70 2023-10-03T10:15:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.951+0000 7fb889150700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb884120490 con 0x7fb884133f50 2023-10-03T10:15:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.951+0000 7fb889150700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb884122300 con 0x7fb8840a1380 2023-10-03T10:15:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.951+0000 7fb88359e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb884133f50 0x7fb88411f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.951+0000 7fb88259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8840a1380 0x7fb88411ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.951+0000 7fb88359e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb884133f50 0x7fb88411f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50484/0 (socket says 172.21.15.146:50484) 2023-10-03T10:15:39.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.951+0000 7fb88259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8840a1380 0x7fb88411ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59714/0 (socket says 172.21.15.146:59714) 2023-10-03T10:15:39.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.951+0000 7fb88359e700 1 -- 172.21.15.146:0/3658718438 learned_addr learned my addr 172.21.15.146:0/3658718438 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:39.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.951+0000 7fb882d9d700 1 --2- 172.21.15.146:0/3658718438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8840a0a70 0x7fb88411e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.952+0000 7fb88259c700 1 -- 172.21.15.146:0/3658718438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb884133f50 msgr2=0x7fb88411f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.952+0000 7fb88259c700 1 --2- 172.21.15.146:0/3658718438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb884133f50 0x7fb88411f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.952+0000 7fb88259c700 1 -- 172.21.15.146:0/3658718438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8840a0a70 msgr2=0x7fb88411e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.952+0000 7fb88259c700 1 --2- 172.21.15.146:0/3658718438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8840a0a70 0x7fb88411e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.952+0000 7fb88259c700 1 -- 172.21.15.146:0/3658718438 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8740094a0 con 0x7fb8840a1380 2023-10-03T10:15:39.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.952+0000 7fb88359e700 1 --2- 172.21.15.146:0/3658718438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb884133f50 0x7fb88411f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.952+0000 7fb88259c700 1 --2- 172.21.15.146:0/3658718438 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8840a1380 0x7fb88411ee00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb87800e930 tx=0x7fb87800ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.952+0000 7fb86b7fe700 1 -- 172.21.15.146:0/3658718438 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87800ee80 con 0x7fb8840a1380 2023-10-03T10:15:39.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.952+0000 7fb889150700 1 -- 172.21.15.146:0/3658718438 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8840a03e0 con 0x7fb8840a1380 2023-10-03T10:15:39.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.952+0000 7fb889150700 1 -- 172.21.15.146:0/3658718438 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb884120ba0 con 0x7fb8840a1380 2023-10-03T10:15:39.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.952+0000 7fb86b7fe700 1 -- 172.21.15.146:0/3658718438 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87800c850 con 0x7fb8840a1380 2023-10-03T10:15:39.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.952+0000 7fb86b7fe700 1 -- 172.21.15.146:0/3658718438 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87800cbc0 con 0x7fb8840a1380 2023-10-03T10:15:39.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.953+0000 7fb86b7fe700 1 -- 172.21.15.146:0/3658718438 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb87800cd20 con 0x7fb8840a1380 2023-10-03T10:15:39.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.953+0000 7fb86b7fe700 1 -- 172.21.15.146:0/3658718438 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb87803f810 con 0x7fb8840a1380 2023-10-03T10:15:39.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.953+0000 7fb889150700 1 -- 172.21.15.146:0/3658718438 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8640052e0 con 0x7fb8840a1380 2023-10-03T10:15:39.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.958+0000 7fb86b7fe700 1 -- 172.21.15.146:0/3658718438 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8780232f0 con 0x7fb8840a1380 2023-10-03T10:15:39.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.975+0000 7fee77436700 1 Processor -- start 2023-10-03T10:15:39.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.975+0000 7fee77436700 1 -- start start 2023-10-03T10:15:39.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.975+0000 7fee77436700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee700a0a30 0x7fee700a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.975+0000 7fee77436700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fee700a1340 0x7fee7012ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.975+0000 7fee77436700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee701304a0 0x7fee70130940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.975+0000 7fee77436700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee700a1e70 con 0x7fee700a1340 2023-10-03T10:15:39.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.975+0000 7fee77436700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7009a720 con 0x7fee701304a0 2023-10-03T10:15:39.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.975+0000 7fee77436700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee7009b300 con 0x7fee700a0a30 2023-10-03T10:15:39.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.975+0000 7fee759d3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee701304a0 0x7fee70130940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.976+0000 7fee759d3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee701304a0 0x7fee70130940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50490/0 (socket says 172.21.15.146:50490) 2023-10-03T10:15:39.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.976+0000 7fee759d3700 1 -- 172.21.15.146:0/635978609 learned_addr learned my addr 172.21.15.146:0/635978609 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:39.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.976+0000 7fee751d2700 1 --2- 172.21.15.146:0/635978609 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee700a0a30 0x7fee700a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.976+0000 7fee749d1700 1 --2- 172.21.15.146:0/635978609 >> v2:172.21.15.146:3300/0 conn(0x7fee700a1340 0x7fee7012ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.976+0000 7fee759d3700 1 -- 172.21.15.146:0/635978609 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee700a0a30 msgr2=0x7fee700a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:39.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.976+0000 7fee759d3700 1 --2- 172.21.15.146:0/635978609 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee700a0a30 0x7fee700a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.976+0000 7fee759d3700 1 -- 172.21.15.146:0/635978609 >> v2:172.21.15.146:3300/0 conn(0x7fee700a1340 msgr2=0x7fee7012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:39.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.976+0000 7fee759d3700 1 --2- 172.21.15.146:0/635978609 >> v2:172.21.15.146:3300/0 conn(0x7fee700a1340 0x7fee7012ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.976+0000 7fee759d3700 1 -- 172.21.15.146:0/635978609 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7009abc0 con 0x7fee701304a0 2023-10-03T10:15:39.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.976+0000 7fee749d1700 1 --2- 172.21.15.146:0/635978609 >> v2:172.21.15.146:3300/0 conn(0x7fee700a1340 0x7fee7012ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.976+0000 7fee751d2700 1 --2- 172.21.15.146:0/635978609 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee700a0a30 0x7fee700a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.976+0000 7fee759d3700 1 --2- 172.21.15.146:0/635978609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee701304a0 0x7fee70130940 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fee6800d150 tx=0x7fee6800d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f60ee1dabe09db3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.976+0000 7fee67fff700 1 -- 172.21.15.146:0/635978609 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68010070 con 0x7fee701304a0 2023-10-03T10:15:39.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.976+0000 7fee67fff700 1 -- 172.21.15.146:0/635978609 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6800db00 con 0x7fee701304a0 2023-10-03T10:15:39.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.976+0000 7fee67fff700 1 -- 172.21.15.146:0/635978609 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68016400 con 0x7fee701304a0 2023-10-03T10:15:39.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.977+0000 7fee77436700 1 -- 172.21.15.146:0/635978609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee701304a0 msgr2=0x7fee70130940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.977+0000 7fee77436700 1 --2- 172.21.15.146:0/635978609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee701304a0 0x7fee70130940 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fee6800d150 tx=0x7fee6800d460 comp rx=0 tx=0).stop 2023-10-03T10:15:39.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.977+0000 7fee77436700 1 -- 172.21.15.146:0/635978609 shutdown_connections 2023-10-03T10:15:39.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.977+0000 7fee77436700 1 --2- 172.21.15.146:0/635978609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee701304a0 0x7fee70130940 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.977+0000 7fee77436700 1 --2- 172.21.15.146:0/635978609 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee700a0a30 0x7fee700a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.977+0000 7fee77436700 1 --2- 172.21.15.146:0/635978609 >> v2:172.21.15.146:3300/0 conn(0x7fee700a1340 0x7fee7012ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.977+0000 7fee77436700 1 -- 172.21.15.146:0/635978609 >> 172.21.15.146:0/635978609 conn(0x7fee700a2980 msgr2=0x7fee700a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.977+0000 7fee77436700 1 -- 172.21.15.146:0/635978609 shutdown_connections 2023-10-03T10:15:39.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.977+0000 7fee77436700 1 -- 172.21.15.146:0/635978609 wait complete. 2023-10-03T10:15:39.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.978+0000 7fee77436700 1 Processor -- start 2023-10-03T10:15:39.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.978+0000 7fee77436700 1 -- start start 2023-10-03T10:15:39.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.979+0000 7fee77436700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee700a0a30 0x7fee7011bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.979+0000 7fee77436700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee700a1340 0x7fee7011c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.979+0000 7fee77436700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee701304a0 0x7fee701c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.979+0000 7fee77436700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7011ea30 con 0x7fee700a0a30 2023-10-03T10:15:39.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.979+0000 7fee77436700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7011ec10 con 0x7fee701304a0 2023-10-03T10:15:39.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.979+0000 7fee77436700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee7012fa80 con 0x7fee700a1340 2023-10-03T10:15:39.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.979+0000 7fee749d1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee700a1340 0x7fee7011c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.979+0000 7fee749d1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee700a1340 0x7fee7011c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59728/0 (socket says 172.21.15.146:59728) 2023-10-03T10:15:39.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.979+0000 7fee749d1700 1 -- 172.21.15.146:0/2162491854 learned_addr learned my addr 172.21.15.146:0/2162491854 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:39.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.979+0000 7fee759d3700 1 --2- 172.21.15.146:0/2162491854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee701304a0 0x7fee701c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.979+0000 7fee749d1700 1 -- 172.21.15.146:0/2162491854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee701304a0 msgr2=0x7fee701c3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.979+0000 7fee749d1700 1 --2- 172.21.15.146:0/2162491854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee701304a0 0x7fee701c3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.979+0000 7fee749d1700 1 -- 172.21.15.146:0/2162491854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee700a0a30 msgr2=0x7fee7011bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.979+0000 7fee749d1700 1 --2- 172.21.15.146:0/2162491854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee700a0a30 0x7fee7011bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.979+0000 7fee749d1700 1 -- 172.21.15.146:0/2162491854 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c009430 con 0x7fee700a1340 2023-10-03T10:15:39.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.979+0000 7fee749d1700 1 --2- 172.21.15.146:0/2162491854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee700a1340 0x7fee7011c120 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fee6000ebe0 tx=0x7fee6000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.979+0000 7fee65ffb700 1 -- 172.21.15.146:0/2162491854 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6000c910 con 0x7fee700a1340 2023-10-03T10:15:39.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.980+0000 7fee65ffb700 1 -- 172.21.15.146:0/2162491854 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6000ca70 con 0x7fee700a1340 2023-10-03T10:15:39.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.980+0000 7fee65ffb700 1 -- 172.21.15.146:0/2162491854 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6000ce00 con 0x7fee700a1340 2023-10-03T10:15:39.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.980+0000 7fee77436700 1 -- 172.21.15.146:0/2162491854 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee600094a0 con 0x7fee700a1340 2023-10-03T10:15:39.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.980+0000 7fee77436700 1 -- 172.21.15.146:0/2162491854 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee6800bd40 con 0x7fee700a1340 2023-10-03T10:15:39.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.981+0000 7fee77436700 1 -- 172.21.15.146:0/2162491854 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7009ae00 con 0x7fee700a1340 2023-10-03T10:15:39.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.981+0000 7fee65ffb700 1 -- 172.21.15.146:0/2162491854 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee60013470 con 0x7fee700a1340 2023-10-03T10:15:39.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.981+0000 7fee65ffb700 1 -- 172.21.15.146:0/2162491854 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fee60011350 con 0x7fee700a1340 2023-10-03T10:15:39.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.986+0000 7fee65ffb700 1 -- 172.21.15.146:0/2162491854 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee600102b0 con 0x7fee700a1340 2023-10-03T10:15:39.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.992+0000 7f58378d3700 1 Processor -- start 2023-10-03T10:15:39.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.993+0000 7f58378d3700 1 -- start start 2023-10-03T10:15:39.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.993+0000 7f58378d3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f583009ef80 0x7f5830138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.993+0000 7f58378d3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f583009f370 0x7f583013b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.993+0000 7f58378d3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f583009af80 con 0x7f583009a150 2023-10-03T10:15:39.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.994+0000 7f58378d3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f583009fe00 con 0x7f583009f370 2023-10-03T10:15:39.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.994+0000 7f58378d3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583006bec0 con 0x7f583009ef80 2023-10-03T10:15:39.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.994+0000 7f583566f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f583009a150 0x7f583009e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36122/0 (socket says 172.21.15.146:36122) 2023-10-03T10:15:39.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.994+0000 7f583566f700 1 -- 172.21.15.146:0/569622256 learned_addr learned my addr 172.21.15.146:0/569622256 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:39.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.994+0000 7f5835e70700 1 --2- 172.21.15.146:0/569622256 >> v2:172.21.15.146:3300/0 conn(0x7f583009f370 0x7f583013b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.994+0000 7f5834e6e700 1 --2- 172.21.15.146:0/569622256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f583009ef80 0x7f5830138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.994+0000 7f5827fff700 1 -- 172.21.15.146:0/569622256 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046855863 0 0) 0x7f583009af80 con 0x7f583009a150 2023-10-03T10:15:39.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.994+0000 7f5827fff700 1 -- 172.21.15.146:0/569622256 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f581c0035b0 con 0x7f583009a150 2023-10-03T10:15:39.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.994+0000 7f5834e6e700 1 -- 172.21.15.146:0/569622256 >> v2:172.21.15.146:3300/0 conn(0x7f583009f370 msgr2=0x7f583013b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:39.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.994+0000 7f5834e6e700 1 --2- 172.21.15.146:0/569622256 >> v2:172.21.15.146:3300/0 conn(0x7f583009f370 0x7f583013b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.994+0000 7f5834e6e700 1 -- 172.21.15.146:0/569622256 >> v1:172.21.15.146:6789/0 conn(0x7f583009a150 legacy=0x7f583009e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.994+0000 7f5834e6e700 1 -- 172.21.15.146:0/569622256 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583006bc20 con 0x7f583009ef80 2023-10-03T10:15:39.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.994+0000 7f5834e6e700 1 --2- 172.21.15.146:0/569622256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f583009ef80 0x7f5830138e60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5820009840 tx=0x7f5820009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49308f6b816ec93f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.995+0000 7f5827fff700 1 -- 172.21.15.146:0/569622256 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820011830 con 0x7f583009ef80 2023-10-03T10:15:39.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.995+0000 7f5827fff700 1 -- 172.21.15.146:0/569622256 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5820011990 con 0x7f583009ef80 2023-10-03T10:15:39.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.995+0000 7f5827fff700 1 -- 172.21.15.146:0/569622256 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820011d20 con 0x7f583009ef80 2023-10-03T10:15:39.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.995+0000 7f58378d3700 1 -- 172.21.15.146:0/569622256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f583009ef80 msgr2=0x7f5830138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.995+0000 7f58378d3700 1 --2- 172.21.15.146:0/569622256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f583009ef80 0x7f5830138e60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5820009840 tx=0x7f5820009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:39.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.995+0000 7f58378d3700 1 -- 172.21.15.146:0/569622256 shutdown_connections 2023-10-03T10:15:39.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.995+0000 7f58378d3700 1 --2- 172.21.15.146:0/569622256 >> v2:172.21.15.146:3300/0 conn(0x7f583009f370 0x7f583013b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.995+0000 7f58378d3700 1 --2- 172.21.15.146:0/569622256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f583009ef80 0x7f5830138e60 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.995+0000 7f58378d3700 1 -- 172.21.15.146:0/569622256 >> 172.21.15.146:0/569622256 conn(0x7f58300a4430 msgr2=0x7f58300a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.995+0000 7f58378d3700 1 -- 172.21.15.146:0/569622256 shutdown_connections 2023-10-03T10:15:39.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.996+0000 7f58378d3700 1 -- 172.21.15.146:0/569622256 wait complete. 2023-10-03T10:15:39.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.997+0000 7f58378d3700 1 Processor -- start 2023-10-03T10:15:39.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.997+0000 7f58378d3700 1 -- start start 2023-10-03T10:15:39.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.998+0000 7f58378d3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f583009a150 0x7f58301d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.998+0000 7f58378d3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f583009ef80 0x7f58301d5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.998+0000 7f58378d3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f583009f370 0x7f58301d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.998+0000 7f58378d3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58301c53c0 con 0x7f583009f370 2023-10-03T10:15:40.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.998+0000 7f58378d3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58301c55a0 con 0x7f583009ef80 2023-10-03T10:15:40.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.998+0000 7f58378d3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58301c3730 con 0x7f583009a150 2023-10-03T10:15:40.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.998+0000 7f5835e70700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f583009f370 0x7f58301d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.998+0000 7f5835e70700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f583009f370 0x7f58301d59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39682/0 (socket says 172.21.15.146:39682) 2023-10-03T10:15:40.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.998+0000 7f5835e70700 1 -- 172.21.15.146:0/3117013490 learned_addr learned my addr 172.21.15.146:0/3117013490 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:40.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.998+0000 7f5834e6e700 1 --2- 172.21.15.146:0/3117013490 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f583009ef80 0x7f58301d5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.998+0000 7f5835e70700 1 -- 172.21.15.146:0/3117013490 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f583009a150 msgr2=0x7f58301d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.998+0000 7f5835e70700 1 --2- 172.21.15.146:0/3117013490 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f583009a150 0x7f58301d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.998+0000 7f5835e70700 1 -- 172.21.15.146:0/3117013490 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f583009ef80 msgr2=0x7f58301d5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.998+0000 7f5835e70700 1 --2- 172.21.15.146:0/3117013490 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f583009ef80 0x7f58301d5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.998+0000 7f5835e70700 1 -- 172.21.15.146:0/3117013490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58200094a0 con 0x7f583009f370 2023-10-03T10:15:40.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.998+0000 7f5834e6e700 1 --2- 172.21.15.146:0/3117013490 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f583009ef80 0x7f58301d5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:40.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.998+0000 7f5835e70700 1 --2- 172.21.15.146:0/3117013490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f583009f370 0x7f58301d59a0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f582800efc0 tx=0x7f582800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:40.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.999+0000 7f5825ffb700 1 -- 172.21.15.146:0/3117013490 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582800cd40 con 0x7f583009f370 2023-10-03T10:15:40.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.999+0000 7f5825ffb700 1 -- 172.21.15.146:0/3117013490 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582800f040 con 0x7f583009f370 2023-10-03T10:15:40.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.999+0000 7f5825ffb700 1 -- 172.21.15.146:0/3117013490 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58280146c0 con 0x7f583009f370 2023-10-03T10:15:40.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.999+0000 7f58378d3700 1 -- 172.21.15.146:0/3117013490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58300a0440 con 0x7f583009f370 2023-10-03T10:15:40.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:39.999+0000 7f58378d3700 1 -- 172.21.15.146:0/3117013490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58301c6180 con 0x7f583009f370 2023-10-03T10:15:40.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.000+0000 7f58378d3700 1 -- 172.21.15.146:0/3117013490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583009fa30 con 0x7f583009f370 2023-10-03T10:15:40.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.001+0000 7f5825ffb700 1 -- 172.21.15.146:0/3117013490 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5828014820 con 0x7f583009f370 2023-10-03T10:15:40.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.001+0000 7f5825ffb700 1 -- 172.21.15.146:0/3117013490 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f58280409c0 con 0x7f583009f370 2023-10-03T10:15:40.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.009+0000 7f5825ffb700 1 -- 172.21.15.146:0/3117013490 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5828012930 con 0x7f583009f370 2023-10-03T10:15:40.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.034+0000 7f450cfb6700 1 Processor -- start 2023-10-03T10:15:40.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.034+0000 7f450cfb6700 1 -- start start 2023-10-03T10:15:40.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.035+0000 7f450cfb6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f450809e870 0x7f450809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.035+0000 7f450cfb6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f450809f180 0x7f4508133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.035+0000 7f450cfb6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450809fa00 con 0x7f4508134160 2023-10-03T10:15:40.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.035+0000 7f450cfb6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45080a0370 con 0x7f450809e870 2023-10-03T10:15:40.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.035+0000 7f450cfb6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f450806bec0 con 0x7f450809f180 2023-10-03T10:15:40.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.035+0000 7f4506d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4508134160 0x7f450813ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36138/0 (socket says 172.21.15.146:36138) 2023-10-03T10:15:40.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.035+0000 7f4506d9d700 1 -- 172.21.15.146:0/1864084879 learned_addr learned my addr 172.21.15.146:0/1864084879 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.035+0000 7f450659c700 1 --2- 172.21.15.146:0/1864084879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f450809e870 0x7f450809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.035+0000 7f44fffff700 1 --2- 172.21.15.146:0/1864084879 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f450809f180 0x7f4508133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.035+0000 7f4505d9b700 1 -- 172.21.15.146:0/1864084879 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569607164 0 0) 0x7f450809fa00 con 0x7f4508134160 2023-10-03T10:15:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.035+0000 7f4505d9b700 1 -- 172.21.15.146:0/1864084879 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44f40035b0 con 0x7f4508134160 2023-10-03T10:15:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.035+0000 7f44fffff700 1 -- 172.21.15.146:0/1864084879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f450809e870 msgr2=0x7f450809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.035+0000 7f44fffff700 1 --2- 172.21.15.146:0/1864084879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f450809e870 0x7f450809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.035+0000 7f44fffff700 1 -- 172.21.15.146:0/1864084879 >> v1:172.21.15.146:6789/0 conn(0x7f4508134160 legacy=0x7f450813ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.035+0000 7f44fffff700 1 -- 172.21.15.146:0/1864084879 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450809ada0 con 0x7f450809f180 2023-10-03T10:15:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.035+0000 7f450659c700 1 --2- 172.21.15.146:0/1864084879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f450809e870 0x7f450809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.036+0000 7f44fffff700 1 --2- 172.21.15.146:0/1864084879 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f450809f180 0x7f4508133c20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f44f00098a0 tx=0x7f44f0009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d864f7cf38023ef0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.036+0000 7f4505d9b700 1 -- 172.21.15.146:0/1864084879 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f0011830 con 0x7f450809f180 2023-10-03T10:15:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.036+0000 7f4505d9b700 1 -- 172.21.15.146:0/1864084879 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f0011990 con 0x7f450809f180 2023-10-03T10:15:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.036+0000 7f4505d9b700 1 -- 172.21.15.146:0/1864084879 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f0011d00 con 0x7f450809f180 2023-10-03T10:15:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.036+0000 7f450cfb6700 1 -- 172.21.15.146:0/1864084879 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f450809f180 msgr2=0x7f4508133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.036+0000 7f450cfb6700 1 --2- 172.21.15.146:0/1864084879 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f450809f180 0x7f4508133c20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f44f00098a0 tx=0x7f44f0009bb0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.036+0000 7f450cfb6700 1 -- 172.21.15.146:0/1864084879 shutdown_connections 2023-10-03T10:15:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.036+0000 7f450cfb6700 1 --2- 172.21.15.146:0/1864084879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f450809e870 0x7f450809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.036+0000 7f450cfb6700 1 --2- 172.21.15.146:0/1864084879 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f450809f180 0x7f4508133c20 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.037+0000 7f450cfb6700 1 -- 172.21.15.146:0/1864084879 >> 172.21.15.146:0/1864084879 conn(0x7f45080a4430 msgr2=0x7f45080a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.037+0000 7f450cfb6700 1 -- 172.21.15.146:0/1864084879 shutdown_connections 2023-10-03T10:15:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.037+0000 7f450cfb6700 1 -- 172.21.15.146:0/1864084879 wait complete. 2023-10-03T10:15:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.038+0000 7f450cfb6700 1 Processor -- start 2023-10-03T10:15:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.038+0000 7f450cfb6700 1 -- start start 2023-10-03T10:15:40.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.039+0000 7f450cfb6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f450809e870 0x7f450811e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.039+0000 7f450cfb6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f450809f180 0x7f450811e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.039+0000 7f450cfb6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4508134160 0x7f450811ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.039+0000 7f450cfb6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4508121f20 con 0x7f4508134160 2023-10-03T10:15:40.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.039+0000 7f450cfb6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4508120630 con 0x7f450809f180 2023-10-03T10:15:40.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.039+0000 7f450cfb6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f450806cfa0 con 0x7f450809e870 2023-10-03T10:15:40.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.039+0000 7f450659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f450809e870 0x7f450811e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.039+0000 7f450659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f450809e870 0x7f450811e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59754/0 (socket says 172.21.15.146:59754) 2023-10-03T10:15:40.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.039+0000 7f450659c700 1 -- 172.21.15.146:0/3196655527 learned_addr learned my addr 172.21.15.146:0/3196655527 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:40.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.039+0000 7f4506d9d700 1 --2- 172.21.15.146:0/3196655527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4508134160 0x7f450811ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.039+0000 7f450659c700 1 -- 172.21.15.146:0/3196655527 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f450809f180 msgr2=0x7f450811e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.039+0000 7f450659c700 1 --2- 172.21.15.146:0/3196655527 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f450809f180 0x7f450811e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.039+0000 7f450659c700 1 -- 172.21.15.146:0/3196655527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4508134160 msgr2=0x7f450811ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.039+0000 7f450659c700 1 --2- 172.21.15.146:0/3196655527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4508134160 0x7f450811ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.039+0000 7f450659c700 1 -- 172.21.15.146:0/3196655527 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f80094a0 con 0x7f450809e870 2023-10-03T10:15:40.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.039+0000 7f450659c700 1 --2- 172.21.15.146:0/3196655527 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f450809e870 0x7f450811e400 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f44f800ebe0 tx=0x7f44f800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:40.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.040+0000 7f44feffd700 1 -- 172.21.15.146:0/3196655527 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f800c910 con 0x7f450809e870 2023-10-03T10:15:40.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.040+0000 7f450cfb6700 1 -- 172.21.15.146:0/3196655527 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f00094a0 con 0x7f450809e870 2023-10-03T10:15:40.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.040+0000 7f44feffd700 1 -- 172.21.15.146:0/3196655527 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f800ca70 con 0x7f450809e870 2023-10-03T10:15:40.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.040+0000 7f44feffd700 1 -- 172.21.15.146:0/3196655527 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f800cde0 con 0x7f450809e870 2023-10-03T10:15:40.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.040+0000 7f450cfb6700 1 -- 172.21.15.146:0/3196655527 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4508121980 con 0x7f450809e870 2023-10-03T10:15:40.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.041+0000 7f450cfb6700 1 -- 172.21.15.146:0/3196655527 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f450804f2a0 con 0x7f450809e870 2023-10-03T10:15:40.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.042+0000 7f44feffd700 1 -- 172.21.15.146:0/3196655527 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f44f8013470 con 0x7f450809e870 2023-10-03T10:15:40.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.043+0000 7f44feffd700 1 -- 172.21.15.146:0/3196655527 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f44f8043070 con 0x7f450809e870 2023-10-03T10:15:40.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.050+0000 7f44feffd700 1 -- 172.21.15.146:0/3196655527 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44f80102b0 con 0x7f450809e870 2023-10-03T10:15:40.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.178+0000 7fb889150700 1 -- 172.21.15.146:0/3658718438 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb864005590 con 0x7fb8840a1380 2023-10-03T10:15:40.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.178+0000 7fb86b7fe700 1 -- 172.21.15.146:0/3658718438 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb87801ae80 con 0x7fb8840a1380 2023-10-03T10:15:40.179 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.180+0000 7fb889150700 1 -- 172.21.15.146:0/3658718438 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8840a1380 msgr2=0x7fb88411ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.180+0000 7fb889150700 1 --2- 172.21.15.146:0/3658718438 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8840a1380 0x7fb88411ee00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb87800e930 tx=0x7fb87800ec40 comp rx=0 tx=0).stop 2023-10-03T10:15:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.180+0000 7fb889150700 1 -- 172.21.15.146:0/3658718438 shutdown_connections 2023-10-03T10:15:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.180+0000 7fb889150700 1 --2- 172.21.15.146:0/3658718438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb884133f50 0x7fb88411f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.180+0000 7fb889150700 1 --2- 172.21.15.146:0/3658718438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8840a0a70 0x7fb88411e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.180+0000 7fb889150700 1 --2- 172.21.15.146:0/3658718438 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8840a1380 0x7fb88411ee00 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.180+0000 7fb889150700 1 -- 172.21.15.146:0/3658718438 >> 172.21.15.146:0/3658718438 conn(0x7fb8840a6610 msgr2=0x7fb8840a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.181+0000 7fb889150700 1 -- 172.21.15.146:0/3658718438 shutdown_connections 2023-10-03T10:15:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.181+0000 7fb889150700 1 -- 172.21.15.146:0/3658718438 wait complete. 2023-10-03T10:15:40.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.191+0000 7fee77436700 1 -- 172.21.15.146:0/2162491854 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fee7004f2a0 con 0x7fee700a1340 2023-10-03T10:15:40.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.192+0000 7fee65ffb700 1 -- 172.21.15.146:0/2162491854 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fee60017070 con 0x7fee700a1340 2023-10-03T10:15:40.192 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:40.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:40.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.194+0000 7fee77436700 1 -- 172.21.15.146:0/2162491854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee700a1340 msgr2=0x7fee7011c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.194+0000 7fee77436700 1 --2- 172.21.15.146:0/2162491854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee700a1340 0x7fee7011c120 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fee6000ebe0 tx=0x7fee6000eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.195+0000 7fee77436700 1 -- 172.21.15.146:0/2162491854 shutdown_connections 2023-10-03T10:15:40.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.195+0000 7fee77436700 1 --2- 172.21.15.146:0/2162491854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee701304a0 0x7fee701c3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.195+0000 7fee77436700 1 --2- 172.21.15.146:0/2162491854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee700a0a30 0x7fee7011bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.195+0000 7fee77436700 1 --2- 172.21.15.146:0/2162491854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee700a1340 0x7fee7011c120 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.195+0000 7fee77436700 1 -- 172.21.15.146:0/2162491854 >> 172.21.15.146:0/2162491854 conn(0x7fee700a2980 msgr2=0x7fee701b77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:40.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.195+0000 7fee77436700 1 -- 172.21.15.146:0/2162491854 shutdown_connections 2023-10-03T10:15:40.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.195+0000 7fee77436700 1 -- 172.21.15.146:0/2162491854 wait complete. 2023-10-03T10:15:40.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:40.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.208+0000 7f58378d3700 1 -- 172.21.15.146:0/3117013490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f583004f2a0 con 0x7f583009f370 2023-10-03T10:15:40.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.208+0000 7f5825ffb700 1 -- 172.21.15.146:0/3117013490 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f582802a030 con 0x7f583009f370 2023-10-03T10:15:40.209 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:40.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.210+0000 7f58378d3700 1 -- 172.21.15.146:0/3117013490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f583009f370 msgr2=0x7f58301d59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.210+0000 7f58378d3700 1 --2- 172.21.15.146:0/3117013490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f583009f370 0x7f58301d59a0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f582800efc0 tx=0x7f582800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.210+0000 7f58378d3700 1 -- 172.21.15.146:0/3117013490 shutdown_connections 2023-10-03T10:15:40.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.210+0000 7f58378d3700 1 --2- 172.21.15.146:0/3117013490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f583009f370 0x7f58301d59a0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.210+0000 7f58378d3700 1 --2- 172.21.15.146:0/3117013490 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f583009a150 0x7f58301d4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.210+0000 7f58378d3700 1 --2- 172.21.15.146:0/3117013490 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f583009ef80 0x7f58301d5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.210+0000 7f58378d3700 1 -- 172.21.15.146:0/3117013490 >> 172.21.15.146:0/3117013490 conn(0x7f58300a4430 msgr2=0x7f583009d070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:40.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.210+0000 7f58378d3700 1 -- 172.21.15.146:0/3117013490 shutdown_connections 2023-10-03T10:15:40.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.210+0000 7f58378d3700 1 -- 172.21.15.146:0/3117013490 wait complete. 2023-10-03T10:15:40.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:40.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.247+0000 7f450cfb6700 1 -- 172.21.15.146:0/3196655527 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4508072d60 con 0x7f450809e870 2023-10-03T10:15:40.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.247+0000 7f44feffd700 1 -- 172.21.15.146:0/3196655527 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f44f8017030 con 0x7f450809e870 2023-10-03T10:15:40.248 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:40.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.250+0000 7f450cfb6700 1 -- 172.21.15.146:0/3196655527 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f450809e870 msgr2=0x7f450811e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.250+0000 7f450cfb6700 1 --2- 172.21.15.146:0/3196655527 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f450809e870 0x7f450811e400 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f44f800ebe0 tx=0x7f44f800eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.250+0000 7f450cfb6700 1 -- 172.21.15.146:0/3196655527 shutdown_connections 2023-10-03T10:15:40.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.250+0000 7f450cfb6700 1 --2- 172.21.15.146:0/3196655527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4508134160 0x7f450811ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.250+0000 7f450cfb6700 1 --2- 172.21.15.146:0/3196655527 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f450809e870 0x7f450811e400 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.250+0000 7f450cfb6700 1 --2- 172.21.15.146:0/3196655527 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f450809f180 0x7f450811e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.250+0000 7f450cfb6700 1 -- 172.21.15.146:0/3196655527 >> 172.21.15.146:0/3196655527 conn(0x7f45080a4430 msgr2=0x7f4508070d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:40.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.250+0000 7f450cfb6700 1 -- 172.21.15.146:0/3196655527 shutdown_connections 2023-10-03T10:15:40.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:40.250+0000 7f450cfb6700 1 -- 172.21.15.146:0/3196655527 wait complete. 2023-10-03T10:15:40.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:41.195 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:41.208 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:41.224 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:41.263 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:41.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.338+0000 7fab6735e700 1 Processor -- start 2023-10-03T10:15:41.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.338+0000 7fab6735e700 1 -- start start 2023-10-03T10:15:41.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.339+0000 7fab6735e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab60134750 0x7fab60136b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.339+0000 7fab6735e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fab60137070 0x7fab60139450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.339+0000 7fab6735e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab600a2590 con 0x7fab601317c0 2023-10-03T10:15:41.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.339+0000 7fab6735e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab601315c0 con 0x7fab60137070 2023-10-03T10:15:41.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.339+0000 7fab6735e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab600a1640 con 0x7fab60134750 2023-10-03T10:15:41.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.339+0000 7fab648f9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab60134750 0x7fab60136b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.339+0000 7fab648f9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab60134750 0x7fab60136b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50552/0 (socket says 172.21.15.146:50552) 2023-10-03T10:15:41.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.339+0000 7fab650fa700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fab601317c0 0x7fab60131b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36154/0 (socket says 172.21.15.146:36154) 2023-10-03T10:15:41.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.339+0000 7fab648f9700 1 -- 172.21.15.146:0/4162793695 learned_addr learned my addr 172.21.15.146:0/4162793695 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:41.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.339+0000 7fab658fb700 1 --2- 172.21.15.146:0/4162793695 >> v2:172.21.15.146:3300/0 conn(0x7fab60137070 0x7fab60139450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.339+0000 7fab648f9700 1 -- 172.21.15.146:0/4162793695 >> v2:172.21.15.146:3300/0 conn(0x7fab60137070 msgr2=0x7fab60139450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.339+0000 7fab648f9700 1 --2- 172.21.15.146:0/4162793695 >> v2:172.21.15.146:3300/0 conn(0x7fab60137070 0x7fab60139450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.339+0000 7fab648f9700 1 -- 172.21.15.146:0/4162793695 >> v1:172.21.15.146:6789/0 conn(0x7fab601317c0 legacy=0x7fab60131b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.339+0000 7fab648f9700 1 -- 172.21.15.146:0/4162793695 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab600a22d0 con 0x7fab60134750 2023-10-03T10:15:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.340+0000 7fab648f9700 1 --2- 172.21.15.146:0/4162793695 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab60134750 0x7fab60136b30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fab500098f0 tx=0x7fab50009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5f0869f6c6df48b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.340+0000 7fab57fff700 1 -- 172.21.15.146:0/4162793695 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab50011830 con 0x7fab60134750 2023-10-03T10:15:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.340+0000 7fab57fff700 1 -- 172.21.15.146:0/4162793695 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab50011990 con 0x7fab60134750 2023-10-03T10:15:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.340+0000 7fab57fff700 1 -- 172.21.15.146:0/4162793695 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab50011d20 con 0x7fab60134750 2023-10-03T10:15:41.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.341+0000 7fab6735e700 1 -- 172.21.15.146:0/4162793695 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab60134750 msgr2=0x7fab60136b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.341+0000 7fab6735e700 1 --2- 172.21.15.146:0/4162793695 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab60134750 0x7fab60136b30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fab500098f0 tx=0x7fab50009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:41.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.341+0000 7fab6735e700 1 -- 172.21.15.146:0/4162793695 shutdown_connections 2023-10-03T10:15:41.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.341+0000 7fab6735e700 1 --2- 172.21.15.146:0/4162793695 >> v2:172.21.15.146:3300/0 conn(0x7fab60137070 0x7fab60139450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.341+0000 7fab6735e700 1 --2- 172.21.15.146:0/4162793695 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab60134750 0x7fab60136b30 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.341+0000 7fab6735e700 1 -- 172.21.15.146:0/4162793695 >> 172.21.15.146:0/4162793695 conn(0x7fab600a2980 msgr2=0x7fab600a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.341+0000 7fab6735e700 1 -- 172.21.15.146:0/4162793695 shutdown_connections 2023-10-03T10:15:41.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.341+0000 7fab6735e700 1 -- 172.21.15.146:0/4162793695 wait complete. 2023-10-03T10:15:41.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.343+0000 7fab6735e700 1 Processor -- start 2023-10-03T10:15:41.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.343+0000 7fab6735e700 1 -- start start 2023-10-03T10:15:41.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.343+0000 7fab6735e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab601317c0 0x7fab60118e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.343+0000 7fab6735e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab60134750 0x7fab601193a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.343+0000 7fab6735e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab60137070 0x7fab601198e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.343+0000 7fab6735e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6011c3b0 con 0x7fab60134750 2023-10-03T10:15:41.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.343+0000 7fab6735e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6012e6d0 con 0x7fab601317c0 2023-10-03T10:15:41.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.343+0000 7fab6735e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab6011c600 con 0x7fab60137070 2023-10-03T10:15:41.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.343+0000 7fab650fa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab601317c0 0x7fab60118e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.343+0000 7fab650fa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab601317c0 0x7fab60118e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50560/0 (socket says 172.21.15.146:50560) 2023-10-03T10:15:41.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.343+0000 7fab650fa700 1 -- 172.21.15.146:0/3978622824 learned_addr learned my addr 172.21.15.146:0/3978622824 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:41.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.344+0000 7fab658fb700 1 --2- 172.21.15.146:0/3978622824 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab60137070 0x7fab601198e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.344+0000 7fab648f9700 1 --2- 172.21.15.146:0/3978622824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab60134750 0x7fab601193a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.344+0000 7fab650fa700 1 -- 172.21.15.146:0/3978622824 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab60137070 msgr2=0x7fab601198e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.344+0000 7fab650fa700 1 --2- 172.21.15.146:0/3978622824 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab60137070 0x7fab601198e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.344+0000 7fab650fa700 1 -- 172.21.15.146:0/3978622824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab60134750 msgr2=0x7fab601193a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.344+0000 7fab650fa700 1 --2- 172.21.15.146:0/3978622824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab60134750 0x7fab601193a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.344+0000 7fab650fa700 1 -- 172.21.15.146:0/3978622824 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab50009550 con 0x7fab601317c0 2023-10-03T10:15:41.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.344+0000 7fab650fa700 1 --2- 172.21.15.146:0/3978622824 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab601317c0 0x7fab60118e60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00c500 tx=0x7fab5c00c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.344+0000 7fab55ffb700 1 -- 172.21.15.146:0/3978622824 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c0074e0 con 0x7fab601317c0 2023-10-03T10:15:41.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.344+0000 7fab55ffb700 1 -- 172.21.15.146:0/3978622824 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5c007640 con 0x7fab601317c0 2023-10-03T10:15:41.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.344+0000 7fab6735e700 1 -- 172.21.15.146:0/3978622824 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6011aa60 con 0x7fab601317c0 2023-10-03T10:15:41.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.344+0000 7fab55ffb700 1 -- 172.21.15.146:0/3978622824 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c005a70 con 0x7fab601317c0 2023-10-03T10:15:41.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.345+0000 7fab6735e700 1 -- 172.21.15.146:0/3978622824 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6011c070 con 0x7fab601317c0 2023-10-03T10:15:41.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.345+0000 7fab55ffb700 1 -- 172.21.15.146:0/3978622824 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab5c005bd0 con 0x7fab601317c0 2023-10-03T10:15:41.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.346+0000 7fab55ffb700 1 -- 172.21.15.146:0/3978622824 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fab5c040990 con 0x7fab601317c0 2023-10-03T10:15:41.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.346+0000 7fab6735e700 1 -- 172.21.15.146:0/3978622824 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6011aa00 con 0x7fab601317c0 2023-10-03T10:15:41.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.351+0000 7fab55ffb700 1 -- 172.21.15.146:0/3978622824 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab5c017020 con 0x7fab601317c0 2023-10-03T10:15:41.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.379+0000 7f05e1a7e700 1 Processor -- start 2023-10-03T10:15:41.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.379+0000 7f05e1a7e700 1 -- start start 2023-10-03T10:15:41.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.380+0000 7f05e1a7e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05dc133ad0 0x7f05dc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.380+0000 7f05e1a7e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05dc1300a0 0x7f05dc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.380+0000 7f05e1a7e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05dc06b2d0 con 0x7f05dc1309f0 2023-10-03T10:15:41.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.380+0000 7f05e1a7e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc133610 con 0x7f05dc1300a0 2023-10-03T10:15:41.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.380+0000 7f05e1a7e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc09a500 con 0x7f05dc133ad0 2023-10-03T10:15:41.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.380+0000 7f05db7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05dc133ad0 0x7f05dc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.380+0000 7f05db7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05dc133ad0 0x7f05dc133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59766/0 (socket says 172.21.15.146:59766) 2023-10-03T10:15:41.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.380+0000 7f05db7fe700 1 -- 172.21.15.146:0/732492593 learned_addr learned my addr 172.21.15.146:0/732492593 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:41.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.380+0000 7f05daffd700 1 --2- 172.21.15.146:0/732492593 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05dc1300a0 0x7f05dc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.381+0000 7f05db7fe700 1 -- 172.21.15.146:0/732492593 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05dc1300a0 msgr2=0x7f05dc1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.381+0000 7f05db7fe700 1 --2- 172.21.15.146:0/732492593 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05dc1300a0 0x7f05dc1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.381+0000 7f05db7fe700 1 -- 172.21.15.146:0/732492593 >> v1:172.21.15.146:6789/0 conn(0x7f05dc1309f0 legacy=0x7f05dc13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.381+0000 7f05db7fe700 1 -- 172.21.15.146:0/732492593 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc1338b0 con 0x7f05dc133ad0 2023-10-03T10:15:41.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.381+0000 7f05daffd700 1 --2- 172.21.15.146:0/732492593 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05dc1300a0 0x7f05dc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:41.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.381+0000 7f05db7fe700 1 --2- 172.21.15.146:0/732492593 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05dc133ad0 0x7f05dc133ea0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f05cc009920 tx=0x7f05cc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c824b424a2cd58f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.381+0000 7f05da7fc700 1 -- 172.21.15.146:0/732492593 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc004230 con 0x7f05dc133ad0 2023-10-03T10:15:41.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.381+0000 7f05da7fc700 1 -- 172.21.15.146:0/732492593 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc004390 con 0x7f05dc133ad0 2023-10-03T10:15:41.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.381+0000 7f05da7fc700 1 -- 172.21.15.146:0/732492593 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc009e70 con 0x7f05dc133ad0 2023-10-03T10:15:41.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.382+0000 7f05e1a7e700 1 -- 172.21.15.146:0/732492593 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05dc133ad0 msgr2=0x7f05dc133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.382+0000 7f05e1a7e700 1 --2- 172.21.15.146:0/732492593 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05dc133ad0 0x7f05dc133ea0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f05cc009920 tx=0x7f05cc009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:41.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.382+0000 7f9a19eb9700 1 Processor -- start 2023-10-03T10:15:41.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.382+0000 7f05e1a7e700 1 -- 172.21.15.146:0/732492593 shutdown_connections 2023-10-03T10:15:41.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.382+0000 7f05e1a7e700 1 --2- 172.21.15.146:0/732492593 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05dc133ad0 0x7f05dc133ea0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.382+0000 7f05e1a7e700 1 --2- 172.21.15.146:0/732492593 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05dc1300a0 0x7f05dc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.382+0000 7f05e1a7e700 1 -- 172.21.15.146:0/732492593 >> 172.21.15.146:0/732492593 conn(0x7f05dc099c40 msgr2=0x7f05dc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.382+0000 7f9a19eb9700 1 -- start start 2023-10-03T10:15:41.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.382+0000 7f05e1a7e700 1 -- 172.21.15.146:0/732492593 shutdown_connections 2023-10-03T10:15:41.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.382+0000 7f05e1a7e700 1 -- 172.21.15.146:0/732492593 wait complete. 2023-10-03T10:15:41.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.383+0000 7f9a19eb9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9a14066410 0x7f9a141319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.383+0000 7f9a19eb9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a14131f30 0x7f9a1409c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.383+0000 7f9a19eb9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a140a0f20 con 0x7f9a141314b0 2023-10-03T10:15:41.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.383+0000 7f9a19eb9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a140667e0 con 0x7f9a14066410 2023-10-03T10:15:41.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.383+0000 7f9a19eb9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a140a23c0 con 0x7f9a14131f30 2023-10-03T10:15:41.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.383+0000 7f9a12ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9a141314b0 0x7f9a1409bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36164/0 (socket says 172.21.15.146:36164) 2023-10-03T10:15:41.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.383+0000 7f9a13fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a14131f30 0x7f9a1409c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.383+0000 7f9a12ffd700 1 -- 172.21.15.146:0/526968972 learned_addr learned my addr 172.21.15.146:0/526968972 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:41.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.383+0000 7f9a137fe700 1 --2- 172.21.15.146:0/526968972 >> v2:172.21.15.146:3300/0 conn(0x7f9a14066410 0x7f9a141319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.383+0000 7f9a13fff700 1 -- 172.21.15.146:0/526968972 >> v2:172.21.15.146:3300/0 conn(0x7f9a14066410 msgr2=0x7f9a141319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.383+0000 7f9a127fc700 1 -- 172.21.15.146:0/526968972 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1535243343 0 0) 0x7f9a140a0f20 con 0x7f9a141314b0 2023-10-03T10:15:41.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.383+0000 7f9a13fff700 1 --2- 172.21.15.146:0/526968972 >> v2:172.21.15.146:3300/0 conn(0x7f9a14066410 0x7f9a141319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.383+0000 7f9a13fff700 1 -- 172.21.15.146:0/526968972 >> v1:172.21.15.146:6789/0 conn(0x7f9a141314b0 legacy=0x7f9a1409bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.383+0000 7f9a13fff700 1 -- 172.21.15.146:0/526968972 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a140a16e0 con 0x7f9a14131f30 2023-10-03T10:15:41.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.383+0000 7f9a13fff700 1 --2- 172.21.15.146:0/526968972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a14131f30 0x7f9a1409c380 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c009dc0 tx=0x7f9a0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=321df47e50c61ec6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.384+0000 7f9a127fc700 1 -- 172.21.15.146:0/526968972 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c00e070 con 0x7f9a14131f30 2023-10-03T10:15:41.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.384+0000 7f9a127fc700 1 -- 172.21.15.146:0/526968972 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0c00bae0 con 0x7f9a14131f30 2023-10-03T10:15:41.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.384+0000 7f9a127fc700 1 -- 172.21.15.146:0/526968972 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c00be90 con 0x7f9a14131f30 2023-10-03T10:15:41.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.384+0000 7f05e1a7e700 1 Processor -- start 2023-10-03T10:15:41.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.384+0000 7f05e1a7e700 1 -- start start 2023-10-03T10:15:41.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.384+0000 7f9a19eb9700 1 -- 172.21.15.146:0/526968972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a14131f30 msgr2=0x7f9a1409c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.384+0000 7f9a19eb9700 1 --2- 172.21.15.146:0/526968972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a14131f30 0x7f9a1409c380 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c009dc0 tx=0x7f9a0c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:41.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f9a19eb9700 1 -- 172.21.15.146:0/526968972 shutdown_connections 2023-10-03T10:15:41.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f9a19eb9700 1 --2- 172.21.15.146:0/526968972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a14131f30 0x7f9a1409c380 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f9a19eb9700 1 --2- 172.21.15.146:0/526968972 >> v2:172.21.15.146:3300/0 conn(0x7f9a14066410 0x7f9a141319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f9a19eb9700 1 -- 172.21.15.146:0/526968972 >> 172.21.15.146:0/526968972 conn(0x7f9a140a2980 msgr2=0x7f9a140a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f05e1a7e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05dc1300a0 0x7f05dc071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f05e1a7e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05dc1309f0 0x7f05dc071740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f05e1a7e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05dc133ad0 0x7f05dc071c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f05e1a7e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc11b980 con 0x7f05dc1300a0 2023-10-03T10:15:41.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f05e1a7e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc11ad50 con 0x7f05dc133ad0 2023-10-03T10:15:41.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f05e1a7e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc11a300 con 0x7f05dc1309f0 2023-10-03T10:15:41.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f05db7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05dc1300a0 0x7f05dc071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f05db7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05dc1300a0 0x7f05dc071200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39708/0 (socket says 172.21.15.146:39708) 2023-10-03T10:15:41.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f05db7fe700 1 -- 172.21.15.146:0/2540874995 learned_addr learned my addr 172.21.15.146:0/2540874995 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:41.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f05daffd700 1 --2- 172.21.15.146:0/2540874995 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05dc1309f0 0x7f05dc071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f05dbfff700 1 --2- 172.21.15.146:0/2540874995 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05dc133ad0 0x7f05dc071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f05db7fe700 1 -- 172.21.15.146:0/2540874995 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05dc1309f0 msgr2=0x7f05dc071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f05db7fe700 1 --2- 172.21.15.146:0/2540874995 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05dc1309f0 0x7f05dc071740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f05db7fe700 1 -- 172.21.15.146:0/2540874995 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05dc133ad0 msgr2=0x7f05dc071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f05db7fe700 1 --2- 172.21.15.146:0/2540874995 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05dc133ad0 0x7f05dc071c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f05db7fe700 1 -- 172.21.15.146:0/2540874995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc009550 con 0x7f05dc1300a0 2023-10-03T10:15:41.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f9a19eb9700 1 -- 172.21.15.146:0/526968972 shutdown_connections 2023-10-03T10:15:41.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f9a19eb9700 1 -- 172.21.15.146:0/526968972 wait complete. 2023-10-03T10:15:41.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.385+0000 7f05db7fe700 1 --2- 172.21.15.146:0/2540874995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05dc1300a0 0x7f05dc071200 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f05dc09a640 tx=0x7f05cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.386+0000 7f05c3fff700 1 -- 172.21.15.146:0/2540874995 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc00bcb0 con 0x7f05dc1300a0 2023-10-03T10:15:41.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.386+0000 7f05c3fff700 1 -- 172.21.15.146:0/2540874995 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc00be50 con 0x7f05dc1300a0 2023-10-03T10:15:41.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.386+0000 7f05c3fff700 1 -- 172.21.15.146:0/2540874995 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc0038e0 con 0x7f05dc1300a0 2023-10-03T10:15:41.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.386+0000 7f05e1a7e700 1 -- 172.21.15.146:0/2540874995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05dc11b110 con 0x7f05dc1300a0 2023-10-03T10:15:41.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.386+0000 7f05e1a7e700 1 -- 172.21.15.146:0/2540874995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05dc12dd00 con 0x7f05dc1300a0 2023-10-03T10:15:41.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.386+0000 7f9a19eb9700 1 Processor -- start 2023-10-03T10:15:41.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.386+0000 7f9a19eb9700 1 -- start start 2023-10-03T10:15:41.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.387+0000 7f05e1a7e700 1 -- 172.21.15.146:0/2540874995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05dc11b500 con 0x7f05dc1300a0 2023-10-03T10:15:41.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.387+0000 7f9a19eb9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a14066410 0x7f9a14136450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.387+0000 7f9a19eb9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a141314b0 0x7f9a14136990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.387+0000 7f9a19eb9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9a14131f30 0x7f9a14136ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.387+0000 7f9a19eb9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a140a1d50 con 0x7f9a141314b0 2023-10-03T10:15:41.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.387+0000 7f9a19eb9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a14137ea0 con 0x7f9a14066410 2023-10-03T10:15:41.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.387+0000 7f9a19eb9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1412eea0 con 0x7f9a14131f30 2023-10-03T10:15:41.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.387+0000 7f9a12ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a141314b0 0x7f9a14136990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.387+0000 7f9a12ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a141314b0 0x7f9a14136990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39722/0 (socket says 172.21.15.146:39722) 2023-10-03T10:15:41.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.387+0000 7f9a12ffd700 1 -- 172.21.15.146:0/2928383438 learned_addr learned my addr 172.21.15.146:0/2928383438 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:41.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.387+0000 7f9a13fff700 1 --2- 172.21.15.146:0/2928383438 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9a14131f30 0x7f9a14136ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.387+0000 7f9a137fe700 1 --2- 172.21.15.146:0/2928383438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a14066410 0x7f9a14136450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.387+0000 7f05c3fff700 1 -- 172.21.15.146:0/2540874995 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f05cc021070 con 0x7f05dc1300a0 2023-10-03T10:15:41.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.388+0000 7f05c3fff700 1 -- 172.21.15.146:0/2540874995 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f05cc040e50 con 0x7f05dc1300a0 2023-10-03T10:15:41.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.388+0000 7f9a12ffd700 1 -- 172.21.15.146:0/2928383438 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9a14131f30 msgr2=0x7f9a14136ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.388+0000 7f9a12ffd700 1 --2- 172.21.15.146:0/2928383438 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9a14131f30 0x7f9a14136ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.388+0000 7f9a12ffd700 1 -- 172.21.15.146:0/2928383438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a14066410 msgr2=0x7f9a14136450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.388+0000 7f9a12ffd700 1 --2- 172.21.15.146:0/2928383438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a14066410 0x7f9a14136450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.388+0000 7f9a12ffd700 1 -- 172.21.15.146:0/2928383438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c009a70 con 0x7f9a141314b0 2023-10-03T10:15:41.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.388+0000 7f9a12ffd700 1 --2- 172.21.15.146:0/2928383438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a141314b0 0x7f9a14136990 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00c750 tx=0x7f99fc00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.396+0000 7f9a0bfff700 1 -- 172.21.15.146:0/2928383438 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc004c80 con 0x7f9a141314b0 2023-10-03T10:15:41.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.396+0000 7f9a0bfff700 1 -- 172.21.15.146:0/2928383438 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc004e00 con 0x7f9a141314b0 2023-10-03T10:15:41.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.396+0000 7f9a19eb9700 1 -- 172.21.15.146:0/2928383438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a1409d510 con 0x7f9a141314b0 2023-10-03T10:15:41.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.396+0000 7f9a0bfff700 1 -- 172.21.15.146:0/2928383438 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc007310 con 0x7f9a141314b0 2023-10-03T10:15:41.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.396+0000 7f9a19eb9700 1 -- 172.21.15.146:0/2928383438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a1411a330 con 0x7f9a141314b0 2023-10-03T10:15:41.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.396+0000 7f05c3fff700 1 -- 172.21.15.146:0/2540874995 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f05cc019780 con 0x7f05dc1300a0 2023-10-03T10:15:41.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.397+0000 7f9a0bfff700 1 -- 172.21.15.146:0/2928383438 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f99fc007470 con 0x7f9a141314b0 2023-10-03T10:15:41.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.398+0000 7f9a19eb9700 1 -- 172.21.15.146:0/2928383438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a1406e190 con 0x7f9a141314b0 2023-10-03T10:15:41.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.398+0000 7f9a0bfff700 1 -- 172.21.15.146:0/2928383438 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f99fc03f3e0 con 0x7f9a141314b0 2023-10-03T10:15:41.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.407+0000 7f9a0bfff700 1 -- 172.21.15.146:0/2928383438 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99fc0133c0 con 0x7f9a141314b0 2023-10-03T10:15:41.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.419+0000 7ff425ca2700 1 Processor -- start 2023-10-03T10:15:41.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.419+0000 7ff425ca2700 1 -- start start 2023-10-03T10:15:41.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.420+0000 7ff425ca2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4200a1550 0x7ff420138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.420+0000 7ff425ca2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff420139200 0x7ff42013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.420+0000 7ff425ca2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42009e9d0 con 0x7ff4200a0a70 2023-10-03T10:15:41.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.420+0000 7ff425ca2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42009dc00 con 0x7ff420139200 2023-10-03T10:15:41.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.420+0000 7ff425ca2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42009dec0 con 0x7ff4200a1550 2023-10-03T10:15:41.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.420+0000 7ff41ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff420139200 0x7ff42013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.420+0000 7ff41f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff4200a0a70 0x7ff4200a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36180/0 (socket says 172.21.15.146:36180) 2023-10-03T10:15:41.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.420+0000 7ff41f7fe700 1 -- 172.21.15.146:0/806243076 learned_addr learned my addr 172.21.15.146:0/806243076 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:41.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.420+0000 7ff41effd700 1 --2- 172.21.15.146:0/806243076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4200a1550 0x7ff420138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.420+0000 7ff41ffff700 1 -- 172.21.15.146:0/806243076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4200a1550 msgr2=0x7ff420138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.420+0000 7ff41ffff700 1 --2- 172.21.15.146:0/806243076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4200a1550 0x7ff420138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.420+0000 7ff41ffff700 1 -- 172.21.15.146:0/806243076 >> v1:172.21.15.146:6789/0 conn(0x7ff4200a0a70 legacy=0x7ff4200a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.420+0000 7ff41ffff700 1 -- 172.21.15.146:0/806243076 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42009e6a0 con 0x7ff420139200 2023-10-03T10:15:41.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.420+0000 7ff41effd700 1 --2- 172.21.15.146:0/806243076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4200a1550 0x7ff420138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.420+0000 7ff41ffff700 1 --2- 172.21.15.146:0/806243076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff420139200 0x7ff42013b5e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7ff418009d90 tx=0x7ff41800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14693be3c011527f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.421+0000 7ff41e7fc700 1 -- 172.21.15.146:0/806243076 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41800e070 con 0x7ff420139200 2023-10-03T10:15:41.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.421+0000 7ff41e7fc700 1 -- 172.21.15.146:0/806243076 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41800bb20 con 0x7ff420139200 2023-10-03T10:15:41.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.421+0000 7ff41e7fc700 1 -- 172.21.15.146:0/806243076 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff418012430 con 0x7ff420139200 2023-10-03T10:15:41.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.421+0000 7ff425ca2700 1 -- 172.21.15.146:0/806243076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff420139200 msgr2=0x7ff42013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.421+0000 7ff425ca2700 1 --2- 172.21.15.146:0/806243076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff420139200 0x7ff42013b5e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7ff418009d90 tx=0x7ff41800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:41.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.421+0000 7ff425ca2700 1 -- 172.21.15.146:0/806243076 shutdown_connections 2023-10-03T10:15:41.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.421+0000 7ff425ca2700 1 --2- 172.21.15.146:0/806243076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff420139200 0x7ff42013b5e0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.421+0000 7ff425ca2700 1 --2- 172.21.15.146:0/806243076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4200a1550 0x7ff420138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.421+0000 7ff425ca2700 1 -- 172.21.15.146:0/806243076 >> 172.21.15.146:0/806243076 conn(0x7ff4200a6610 msgr2=0x7ff4200a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.422+0000 7ff425ca2700 1 -- 172.21.15.146:0/806243076 shutdown_connections 2023-10-03T10:15:41.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.422+0000 7ff425ca2700 1 -- 172.21.15.146:0/806243076 wait complete. 2023-10-03T10:15:41.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.423+0000 7ff425ca2700 1 Processor -- start 2023-10-03T10:15:41.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.423+0000 7ff425ca2700 1 -- start start 2023-10-03T10:15:41.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.424+0000 7ff425ca2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4200a0a70 0x7ff42011e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.424+0000 7ff425ca2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4200a1550 0x7ff42011ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.424+0000 7ff425ca2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff420139200 0x7ff42011f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.424+0000 7ff425ca2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff420122290 con 0x7ff4200a1550 2023-10-03T10:15:41.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.424+0000 7ff425ca2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff420121a40 con 0x7ff4200a0a70 2023-10-03T10:15:41.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.424+0000 7ff425ca2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4200a5100 con 0x7ff420139200 2023-10-03T10:15:41.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.424+0000 7ff41f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4200a0a70 0x7ff42011e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.424+0000 7ff41f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4200a0a70 0x7ff42011e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50606/0 (socket says 172.21.15.146:50606) 2023-10-03T10:15:41.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.424+0000 7ff41f7fe700 1 -- 172.21.15.146:0/1974090260 learned_addr learned my addr 172.21.15.146:0/1974090260 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:41.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.424+0000 7ff41effd700 1 --2- 172.21.15.146:0/1974090260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4200a1550 0x7ff42011ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.424+0000 7ff41f7fe700 1 -- 172.21.15.146:0/1974090260 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff420139200 msgr2=0x7ff42011f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.424+0000 7ff41f7fe700 1 --2- 172.21.15.146:0/1974090260 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff420139200 0x7ff42011f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.424+0000 7ff41f7fe700 1 -- 172.21.15.146:0/1974090260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4200a1550 msgr2=0x7ff42011ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.424+0000 7ff41f7fe700 1 --2- 172.21.15.146:0/1974090260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4200a1550 0x7ff42011ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.424+0000 7ff41f7fe700 1 -- 172.21.15.146:0/1974090260 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4140094a0 con 0x7ff4200a0a70 2023-10-03T10:15:41.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.425+0000 7ff41f7fe700 1 --2- 172.21.15.146:0/1974090260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4200a0a70 0x7ff42011e7c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff41000c520 tx=0x7ff41000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.425+0000 7ff407fff700 1 -- 172.21.15.146:0/1974090260 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff410005d70 con 0x7ff4200a0a70 2023-10-03T10:15:41.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.425+0000 7ff407fff700 1 -- 172.21.15.146:0/1974090260 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4100070d0 con 0x7ff4200a0a70 2023-10-03T10:15:41.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.425+0000 7ff407fff700 1 -- 172.21.15.146:0/1974090260 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff410007440 con 0x7ff4200a0a70 2023-10-03T10:15:41.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.425+0000 7ff425ca2700 1 -- 172.21.15.146:0/1974090260 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff418009a70 con 0x7ff4200a0a70 2023-10-03T10:15:41.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.425+0000 7ff425ca2700 1 -- 172.21.15.146:0/1974090260 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff420120be0 con 0x7ff4200a0a70 2023-10-03T10:15:41.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.426+0000 7ff425ca2700 1 -- 172.21.15.146:0/1974090260 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff42004f2a0 con 0x7ff4200a0a70 2023-10-03T10:15:41.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.427+0000 7ff407fff700 1 -- 172.21.15.146:0/1974090260 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff4100075a0 con 0x7ff4200a0a70 2023-10-03T10:15:41.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.427+0000 7ff407fff700 1 -- 172.21.15.146:0/1974090260 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff41003ead0 con 0x7ff4200a0a70 2023-10-03T10:15:41.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.436+0000 7ff407fff700 1 -- 172.21.15.146:0/1974090260 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff410019b40 con 0x7ff4200a0a70 2023-10-03T10:15:41.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.565+0000 7fab6735e700 1 -- 172.21.15.146:0/3978622824 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fab6004f2a0 con 0x7fab601317c0 2023-10-03T10:15:41.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.566+0000 7fab55ffb700 1 -- 172.21.15.146:0/3978622824 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab5c044060 con 0x7fab601317c0 2023-10-03T10:15:41.566 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:41.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.568+0000 7fab6735e700 1 -- 172.21.15.146:0/3978622824 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab601317c0 msgr2=0x7fab60118e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.568+0000 7fab6735e700 1 --2- 172.21.15.146:0/3978622824 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab601317c0 0x7fab60118e60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00c500 tx=0x7fab5c00c810 comp rx=0 tx=0).stop 2023-10-03T10:15:41.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.568+0000 7fab6735e700 1 -- 172.21.15.146:0/3978622824 shutdown_connections 2023-10-03T10:15:41.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.568+0000 7fab6735e700 1 --2- 172.21.15.146:0/3978622824 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab60137070 0x7fab601198e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.568+0000 7fab6735e700 1 --2- 172.21.15.146:0/3978622824 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab601317c0 0x7fab60118e60 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.568+0000 7fab6735e700 1 --2- 172.21.15.146:0/3978622824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab60134750 0x7fab601193a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.568+0000 7fab6735e700 1 -- 172.21.15.146:0/3978622824 >> 172.21.15.146:0/3978622824 conn(0x7fab600a2980 msgr2=0x7fab601335d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.568+0000 7fab6735e700 1 -- 172.21.15.146:0/3978622824 shutdown_connections 2023-10-03T10:15:41.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.568+0000 7fab6735e700 1 -- 172.21.15.146:0/3978622824 wait complete. 2023-10-03T10:15:41.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:41.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.593+0000 7f05e1a7e700 1 -- 172.21.15.146:0/2540874995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f05dc11b500 con 0x7f05dc1300a0 2023-10-03T10:15:41.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.594+0000 7f05c3fff700 1 -- 172.21.15.146:0/2540874995 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f05dc11b500 con 0x7f05dc1300a0 2023-10-03T10:15:41.594 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:41.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.596+0000 7f05e1a7e700 1 -- 172.21.15.146:0/2540874995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05dc1300a0 msgr2=0x7f05dc071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.596+0000 7f05e1a7e700 1 --2- 172.21.15.146:0/2540874995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05dc1300a0 0x7f05dc071200 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f05dc09a640 tx=0x7f05cc004750 comp rx=0 tx=0).stop 2023-10-03T10:15:41.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.596+0000 7f05e1a7e700 1 -- 172.21.15.146:0/2540874995 shutdown_connections 2023-10-03T10:15:41.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.596+0000 7f05e1a7e700 1 --2- 172.21.15.146:0/2540874995 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05dc133ad0 0x7f05dc071c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.596+0000 7f05e1a7e700 1 --2- 172.21.15.146:0/2540874995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05dc1300a0 0x7f05dc071200 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.596+0000 7f05e1a7e700 1 --2- 172.21.15.146:0/2540874995 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05dc1309f0 0x7f05dc071740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.596+0000 7f05e1a7e700 1 -- 172.21.15.146:0/2540874995 >> 172.21.15.146:0/2540874995 conn(0x7f05dc099c40 msgr2=0x7f05dc0a25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.596+0000 7f05e1a7e700 1 -- 172.21.15.146:0/2540874995 shutdown_connections 2023-10-03T10:15:41.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.596+0000 7f05e1a7e700 1 -- 172.21.15.146:0/2540874995 wait complete. 2023-10-03T10:15:41.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.602+0000 7f9a19eb9700 1 -- 172.21.15.146:0/2928383438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9a1411a550 con 0x7f9a141314b0 2023-10-03T10:15:41.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.603+0000 7f9a0bfff700 1 -- 172.21.15.146:0/2928383438 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f99fc011360 con 0x7f9a141314b0 2023-10-03T10:15:41.603 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:41.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.606+0000 7f9a19eb9700 1 -- 172.21.15.146:0/2928383438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a141314b0 msgr2=0x7f9a14136990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.606+0000 7f9a19eb9700 1 --2- 172.21.15.146:0/2928383438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a141314b0 0x7f9a14136990 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00c750 tx=0x7f99fc00ca60 comp rx=0 tx=0).stop 2023-10-03T10:15:41.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.606+0000 7f9a19eb9700 1 -- 172.21.15.146:0/2928383438 shutdown_connections 2023-10-03T10:15:41.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.606+0000 7f9a19eb9700 1 --2- 172.21.15.146:0/2928383438 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9a14131f30 0x7f9a14136ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.606+0000 7f9a19eb9700 1 --2- 172.21.15.146:0/2928383438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a14066410 0x7f9a14136450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.606+0000 7f9a19eb9700 1 --2- 172.21.15.146:0/2928383438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a141314b0 0x7f9a14136990 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.606+0000 7f9a19eb9700 1 -- 172.21.15.146:0/2928383438 >> 172.21.15.146:0/2928383438 conn(0x7f9a140a2980 msgr2=0x7f9a14138f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.607+0000 7f9a19eb9700 1 -- 172.21.15.146:0/2928383438 shutdown_connections 2023-10-03T10:15:41.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.607+0000 7f9a19eb9700 1 -- 172.21.15.146:0/2928383438 wait complete. 2023-10-03T10:15:41.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:41.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:41.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.633+0000 7ff425ca2700 1 -- 172.21.15.146:0/1974090260 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff420072980 con 0x7ff4200a0a70 2023-10-03T10:15:41.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.633+0000 7ff407fff700 1 -- 172.21.15.146:0/1974090260 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff410017030 con 0x7ff4200a0a70 2023-10-03T10:15:41.634 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:41.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.635+0000 7ff425ca2700 1 -- 172.21.15.146:0/1974090260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4200a0a70 msgr2=0x7ff42011e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.635+0000 7ff425ca2700 1 --2- 172.21.15.146:0/1974090260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4200a0a70 0x7ff42011e7c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff41000c520 tx=0x7ff41000c830 comp rx=0 tx=0).stop 2023-10-03T10:15:41.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.635+0000 7ff425ca2700 1 -- 172.21.15.146:0/1974090260 shutdown_connections 2023-10-03T10:15:41.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.635+0000 7ff425ca2700 1 --2- 172.21.15.146:0/1974090260 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff420139200 0x7ff42011f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.635+0000 7ff425ca2700 1 --2- 172.21.15.146:0/1974090260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4200a0a70 0x7ff42011e7c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.635+0000 7ff425ca2700 1 --2- 172.21.15.146:0/1974090260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4200a1550 0x7ff42011ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.635+0000 7ff425ca2700 1 -- 172.21.15.146:0/1974090260 >> 172.21.15.146:0/1974090260 conn(0x7ff4200a6610 msgr2=0x7ff4200a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.635+0000 7ff425ca2700 1 -- 172.21.15.146:0/1974090260 shutdown_connections 2023-10-03T10:15:41.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:41.635+0000 7ff425ca2700 1 -- 172.21.15.146:0/1974090260 wait complete. 2023-10-03T10:15:41.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:42.582 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:42.611 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:42.620 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:42.649 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:42.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.726+0000 7f9e8b282700 1 Processor -- start 2023-10-03T10:15:42.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.726+0000 7f9e8b282700 1 -- start start 2023-10-03T10:15:42.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.727+0000 7f9e8b282700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9e840a0a30 0x7f9e840a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.727+0000 7f9e8b282700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9e840a1340 0x7f9e8412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.727+0000 7f9e8b282700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9e841304a0 0x7f9e841308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.727+0000 7f9e8b282700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e84130e30 con 0x7f9e840a0a30 2023-10-03T10:15:42.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.727+0000 7f9e8b282700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e840a1e70 con 0x7f9e841304a0 2023-10-03T10:15:42.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.727+0000 7f9e8b282700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8409a720 con 0x7f9e840a1340 2023-10-03T10:15:42.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.727+0000 7f9e8981f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9e841304a0 0x7f9e841308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.727+0000 7f9e8981f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9e841304a0 0x7f9e841308f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50620/0 (socket says 172.21.15.146:50620) 2023-10-03T10:15:42.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.727+0000 7f9e8981f700 1 -- 172.21.15.146:0/2369252984 learned_addr learned my addr 172.21.15.146:0/2369252984 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:42.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.727+0000 7f9e8881d700 1 --2- 172.21.15.146:0/2369252984 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9e840a1340 0x7f9e8412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.727+0000 7f9e8901e700 1 --2- 172.21.15.146:0/2369252984 >> v2:172.21.15.146:3300/0 conn(0x7f9e840a0a30 0x7f9e840a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.727+0000 7f9e8981f700 1 -- 172.21.15.146:0/2369252984 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9e840a1340 msgr2=0x7f9e8412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.727+0000 7f9e8981f700 1 --2- 172.21.15.146:0/2369252984 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9e840a1340 0x7f9e8412ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.727+0000 7f9e8981f700 1 -- 172.21.15.146:0/2369252984 >> v2:172.21.15.146:3300/0 conn(0x7f9e840a0a30 msgr2=0x7f9e840a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.727+0000 7f9e8981f700 1 --2- 172.21.15.146:0/2369252984 >> v2:172.21.15.146:3300/0 conn(0x7f9e840a0a30 0x7f9e840a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.727+0000 7f9e8981f700 1 -- 172.21.15.146:0/2369252984 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8409b300 con 0x7f9e841304a0 2023-10-03T10:15:42.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.728+0000 7f9e8981f700 1 --2- 172.21.15.146:0/2369252984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9e841304a0 0x7f9e841308f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00ce50 tx=0x7f9e7c00a480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adffc7e8af3e8260 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.728+0000 7f9e7bfff700 1 -- 172.21.15.146:0/2369252984 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c00c480 con 0x7f9e841304a0 2023-10-03T10:15:42.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.728+0000 7f9e7bfff700 1 -- 172.21.15.146:0/2369252984 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7c007c90 con 0x7f9e841304a0 2023-10-03T10:15:42.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.728+0000 7f9e7bfff700 1 -- 172.21.15.146:0/2369252984 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c008020 con 0x7f9e841304a0 2023-10-03T10:15:42.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.729+0000 7f9e8b282700 1 -- 172.21.15.146:0/2369252984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9e841304a0 msgr2=0x7f9e841308f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.729+0000 7f9e8b282700 1 --2- 172.21.15.146:0/2369252984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9e841304a0 0x7f9e841308f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00ce50 tx=0x7f9e7c00a480 comp rx=0 tx=0).stop 2023-10-03T10:15:42.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.729+0000 7f9e8b282700 1 -- 172.21.15.146:0/2369252984 shutdown_connections 2023-10-03T10:15:42.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.729+0000 7f9e8b282700 1 --2- 172.21.15.146:0/2369252984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9e841304a0 0x7f9e841308f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.729+0000 7f9e8b282700 1 --2- 172.21.15.146:0/2369252984 >> v2:172.21.15.146:3300/0 conn(0x7f9e840a0a30 0x7f9e840a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.729+0000 7f9e8b282700 1 --2- 172.21.15.146:0/2369252984 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9e840a1340 0x7f9e8412ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.729+0000 7f9e8b282700 1 -- 172.21.15.146:0/2369252984 >> 172.21.15.146:0/2369252984 conn(0x7f9e840a2980 msgr2=0x7f9e840a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.729+0000 7f9e8b282700 1 -- 172.21.15.146:0/2369252984 shutdown_connections 2023-10-03T10:15:42.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.729+0000 7f9e8b282700 1 -- 172.21.15.146:0/2369252984 wait complete. 2023-10-03T10:15:42.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.730+0000 7f9e8b282700 1 Processor -- start 2023-10-03T10:15:42.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.730+0000 7f9e8b282700 1 -- start start 2023-10-03T10:15:42.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.731+0000 7f9e8b282700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9e840a0a30 0x7f9e8411eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.731+0000 7f9e8b282700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9e840a1340 0x7f9e8411f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.731+0000 7f9e8b282700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e841304a0 0x7f9e841c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.731+0000 7f9e8b282700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8411e4b0 con 0x7f9e841304a0 2023-10-03T10:15:42.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.731+0000 7f9e8b282700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e841218c0 con 0x7f9e840a0a30 2023-10-03T10:15:42.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.731+0000 7f9e8b282700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e84120990 con 0x7f9e840a1340 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.731+0000 7f9e8901e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9e840a0a30 0x7f9e8411eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.731+0000 7f9e8901e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9e840a0a30 0x7f9e8411eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50632/0 (socket says 172.21.15.146:50632) 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.731+0000 7f9e8901e700 1 -- 172.21.15.146:0/2201611755 learned_addr learned my addr 172.21.15.146:0/2201611755 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.731+0000 7f9e8881d700 1 --2- 172.21.15.146:0/2201611755 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9e840a1340 0x7f9e8411f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.731+0000 7f9e8981f700 1 --2- 172.21.15.146:0/2201611755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e841304a0 0x7f9e841c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.731+0000 7f9e8901e700 1 -- 172.21.15.146:0/2201611755 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9e840a1340 msgr2=0x7f9e8411f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.731+0000 7f9e8901e700 1 --2- 172.21.15.146:0/2201611755 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9e840a1340 0x7f9e8411f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.731+0000 7f9e8901e700 1 -- 172.21.15.146:0/2201611755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e841304a0 msgr2=0x7f9e841c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.731+0000 7f9e8901e700 1 --2- 172.21.15.146:0/2201611755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e841304a0 0x7f9e841c3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.731+0000 7f9e8901e700 1 -- 172.21.15.146:0/2201611755 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c00ca80 con 0x7f9e840a0a30 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.732+0000 7f9e8901e700 1 --2- 172.21.15.146:0/2201611755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9e840a0a30 0x7f9e8411eaf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000e9b0 tx=0x7f9e8000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.732+0000 7f9e79ffb700 1 -- 172.21.15.146:0/2201611755 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e80005a20 con 0x7f9e840a0a30 2023-10-03T10:15:42.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.732+0000 7f9e79ffb700 1 -- 172.21.15.146:0/2201611755 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e80005b80 con 0x7f9e840a0a30 2023-10-03T10:15:42.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.732+0000 7f9e79ffb700 1 -- 172.21.15.146:0/2201611755 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8000c640 con 0x7f9e840a0a30 2023-10-03T10:15:42.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.732+0000 7f9e8b282700 1 -- 172.21.15.146:0/2201611755 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e84121600 con 0x7f9e840a0a30 2023-10-03T10:15:42.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.732+0000 7f9e8b282700 1 -- 172.21.15.146:0/2201611755 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e84122330 con 0x7f9e840a0a30 2023-10-03T10:15:42.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.733+0000 7f9e8b282700 1 -- 172.21.15.146:0/2201611755 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8404f2a0 con 0x7f9e840a0a30 2023-10-03T10:15:42.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.734+0000 7f9e79ffb700 1 -- 172.21.15.146:0/2201611755 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e8000c7a0 con 0x7f9e840a0a30 2023-10-03T10:15:42.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.734+0000 7f9e79ffb700 1 -- 172.21.15.146:0/2201611755 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9e8003fc50 con 0x7f9e840a0a30 2023-10-03T10:15:42.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.738+0000 7f9e79ffb700 1 -- 172.21.15.146:0/2201611755 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e8003fe60 con 0x7f9e840a0a30 2023-10-03T10:15:42.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.762+0000 7fe48e918700 1 Processor -- start 2023-10-03T10:15:42.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.762+0000 7fae808e6700 1 Processor -- start 2023-10-03T10:15:42.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.762+0000 7fe48e918700 1 -- start start 2023-10-03T10:15:42.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.762+0000 7fae808e6700 1 -- start start 2023-10-03T10:15:42.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.762+0000 7fe48e918700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4881335f0 0x7fe4881359d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.762+0000 7fe48e918700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe488135f10 0x7fe4881382f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.762+0000 7fe48e918700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48809bb90 con 0x7fe48812d380 2023-10-03T10:15:42.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.762+0000 7fe48e918700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48809c210 con 0x7fe488135f10 2023-10-03T10:15:42.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.762+0000 7fe48e918700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe48809ced0 con 0x7fe4881335f0 2023-10-03T10:15:42.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fe4877fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4881335f0 0x7fe4881359d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fe48ceb5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe488135f10 0x7fe4881382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fe4877fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4881335f0 0x7fe4881359d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59824/0 (socket says 172.21.15.146:59824) 2023-10-03T10:15:42.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fae808e6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae7c133900 0x7fae7c133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fae808e6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fae7c0a10b0 0x7fae7c13b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fae808e6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae7c09a760 con 0x7fae7c134210 2023-10-03T10:15:42.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fae808e6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c1336e0 con 0x7fae7c0a10b0 2023-10-03T10:15:42.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fae808e6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c09a080 con 0x7fae7c133900 2023-10-03T10:15:42.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fe4877fe700 1 -- 172.21.15.146:0/1438714818 learned_addr learned my addr 172.21.15.146:0/1438714818 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:42.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fae7a59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae7c133900 0x7fae7c133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fae7a59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae7c133900 0x7fae7c133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59840/0 (socket says 172.21.15.146:59840) 2023-10-03T10:15:42.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fae7a59c700 1 -- 172.21.15.146:0/2209187206 learned_addr learned my addr 172.21.15.146:0/2209187206 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:42.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fe48ceb5700 1 -- 172.21.15.146:0/1438714818 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4881335f0 msgr2=0x7fe4881359d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fe48ceb5700 1 --2- 172.21.15.146:0/1438714818 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4881335f0 0x7fe4881359d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fe48ceb5700 1 -- 172.21.15.146:0/1438714818 >> v1:172.21.15.146:6789/0 conn(0x7fe48812d380 legacy=0x7fe48812d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fe48ceb5700 1 -- 172.21.15.146:0/1438714818 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48809ac30 con 0x7fe488135f10 2023-10-03T10:15:42.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fe4877fe700 1 --2- 172.21.15.146:0/1438714818 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4881335f0 0x7fe4881359d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fae7a59c700 1 -- 172.21.15.146:0/2209187206 >> v2:172.21.15.146:3300/0 conn(0x7fae7c0a10b0 msgr2=0x7fae7c13b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fae7a59c700 1 --2- 172.21.15.146:0/2209187206 >> v2:172.21.15.146:3300/0 conn(0x7fae7c0a10b0 0x7fae7c13b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fae7a59c700 1 -- 172.21.15.146:0/2209187206 >> v1:172.21.15.146:6789/0 conn(0x7fae7c134210 legacy=0x7fae7c0a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fae7a59c700 1 -- 172.21.15.146:0/2209187206 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c0a23e0 con 0x7fae7c133900 2023-10-03T10:15:42.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fe48ceb5700 1 --2- 172.21.15.146:0/1438714818 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe488135f10 0x7fe4881382f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe48000f3a0 tx=0x7fe48000f6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90cc6a9175a1a2a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.763+0000 7fae7a59c700 1 --2- 172.21.15.146:0/2209187206 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae7c133900 0x7fae7c133cd0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fae6c006fd0 tx=0x7fae6c009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46c1d71ba51c8fa0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.764+0000 7fae7959a700 1 -- 172.21.15.146:0/2209187206 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c005e30 con 0x7fae7c133900 2023-10-03T10:15:42.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.764+0000 7fae7959a700 1 -- 172.21.15.146:0/2209187206 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c006030 con 0x7fae7c133900 2023-10-03T10:15:42.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.764+0000 7fae7959a700 1 -- 172.21.15.146:0/2209187206 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c0063c0 con 0x7fae7c133900 2023-10-03T10:15:42.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.764+0000 7fe486ffd700 1 -- 172.21.15.146:0/1438714818 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe480012070 con 0x7fe488135f10 2023-10-03T10:15:42.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.764+0000 7fe486ffd700 1 -- 172.21.15.146:0/1438714818 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48000fe60 con 0x7fe488135f10 2023-10-03T10:15:42.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.764+0000 7fe486ffd700 1 -- 172.21.15.146:0/1438714818 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe480003c60 con 0x7fe488135f10 2023-10-03T10:15:42.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.764+0000 7fae808e6700 1 -- 172.21.15.146:0/2209187206 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae7c133900 msgr2=0x7fae7c133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.764+0000 7fae808e6700 1 --2- 172.21.15.146:0/2209187206 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae7c133900 0x7fae7c133cd0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fae6c006fd0 tx=0x7fae6c009bd0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.764+0000 7fe48e918700 1 -- 172.21.15.146:0/1438714818 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe488135f10 msgr2=0x7fe4881382f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.764+0000 7fe48e918700 1 --2- 172.21.15.146:0/1438714818 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe488135f10 0x7fe4881382f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe48000f3a0 tx=0x7fe48000f6b0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.764+0000 7fe48e918700 1 -- 172.21.15.146:0/1438714818 shutdown_connections 2023-10-03T10:15:42.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.764+0000 7fe48e918700 1 --2- 172.21.15.146:0/1438714818 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe488135f10 0x7fe4881382f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.764+0000 7fe48e918700 1 --2- 172.21.15.146:0/1438714818 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4881335f0 0x7fe4881359d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.764+0000 7fe48e918700 1 -- 172.21.15.146:0/1438714818 >> 172.21.15.146:0/1438714818 conn(0x7fe4880a2980 msgr2=0x7fe4880a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.765+0000 7fe48e918700 1 -- 172.21.15.146:0/1438714818 shutdown_connections 2023-10-03T10:15:42.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.765+0000 7fe48e918700 1 -- 172.21.15.146:0/1438714818 wait complete. 2023-10-03T10:15:42.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.765+0000 7fe48e918700 1 Processor -- start 2023-10-03T10:15:42.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.766+0000 7fae808e6700 1 -- 172.21.15.146:0/2209187206 shutdown_connections 2023-10-03T10:15:42.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.766+0000 7fae808e6700 1 --2- 172.21.15.146:0/2209187206 >> v2:172.21.15.146:3300/0 conn(0x7fae7c0a10b0 0x7fae7c13b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.766+0000 7fae808e6700 1 --2- 172.21.15.146:0/2209187206 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae7c133900 0x7fae7c133cd0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.766+0000 7fae808e6700 1 -- 172.21.15.146:0/2209187206 >> 172.21.15.146:0/2209187206 conn(0x7fae7c0a2980 msgr2=0x7fae7c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.766+0000 7fe48e918700 1 -- start start 2023-10-03T10:15:42.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.766+0000 7fe48e918700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe48812d380 0x7fe48812f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.766+0000 7fe48e918700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4881335f0 0x7fe48812f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.766+0000 7fe48e918700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe488135f10 0x7fe48812fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.766+0000 7fe48e918700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe488131330 con 0x7fe4881335f0 2023-10-03T10:15:42.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.766+0000 7fe48e918700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe488119af0 con 0x7fe488135f10 2023-10-03T10:15:42.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.766+0000 7fe48e918700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4881195f0 con 0x7fe48812d380 2023-10-03T10:15:42.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.766+0000 7fae808e6700 1 -- 172.21.15.146:0/2209187206 shutdown_connections 2023-10-03T10:15:42.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.767+0000 7fe487fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe48812d380 0x7fe48812f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.767+0000 7fe487fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe48812d380 0x7fe48812f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59854/0 (socket says 172.21.15.146:59854) 2023-10-03T10:15:42.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.767+0000 7fe487fff700 1 -- 172.21.15.146:0/2341719142 learned_addr learned my addr 172.21.15.146:0/2341719142 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:42.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.767+0000 7fe48ceb5700 1 --2- 172.21.15.146:0/2341719142 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe488135f10 0x7fe48812fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.767+0000 7fae808e6700 1 -- 172.21.15.146:0/2209187206 wait complete. 2023-10-03T10:15:42.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.767+0000 7fe4877fe700 1 --2- 172.21.15.146:0/2341719142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4881335f0 0x7fe48812f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.767+0000 7fe487fff700 1 -- 172.21.15.146:0/2341719142 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe488135f10 msgr2=0x7fe48812fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.767+0000 7fe487fff700 1 --2- 172.21.15.146:0/2341719142 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe488135f10 0x7fe48812fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.767+0000 7fe487fff700 1 -- 172.21.15.146:0/2341719142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4881335f0 msgr2=0x7fe48812f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.767+0000 7fe487fff700 1 --2- 172.21.15.146:0/2341719142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4881335f0 0x7fe48812f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.767+0000 7fe487fff700 1 -- 172.21.15.146:0/2341719142 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c00b600 con 0x7fe48812d380 2023-10-03T10:15:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.767+0000 7fe48ceb5700 1 --2- 172.21.15.146:0/2341719142 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe488135f10 0x7fe48812fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.767+0000 7fe487fff700 1 --2- 172.21.15.146:0/2341719142 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe48812d380 0x7fe48812f350 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe47800c450 tx=0x7fe47800c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.767+0000 7fe484ff9700 1 -- 172.21.15.146:0/2341719142 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4780052e0 con 0x7fe48812d380 2023-10-03T10:15:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.767+0000 7fe484ff9700 1 -- 172.21.15.146:0/2341719142 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe478005460 con 0x7fe48812d380 2023-10-03T10:15:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.767+0000 7fe48e918700 1 -- 172.21.15.146:0/2341719142 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48000f050 con 0x7fe48812d380 2023-10-03T10:15:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.767+0000 7fe484ff9700 1 -- 172.21.15.146:0/2341719142 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4780038c0 con 0x7fe48812d380 2023-10-03T10:15:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.767+0000 7fe48e918700 1 -- 172.21.15.146:0/2341719142 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe48809b3e0 con 0x7fe48812d380 2023-10-03T10:15:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.768+0000 7fae808e6700 1 Processor -- start 2023-10-03T10:15:42.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.768+0000 7fe484ff9700 1 -- 172.21.15.146:0/2341719142 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe478003a20 con 0x7fe48812d380 2023-10-03T10:15:42.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.768+0000 7fe484ff9700 1 -- 172.21.15.146:0/2341719142 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe47803ea10 con 0x7fe48812d380 2023-10-03T10:15:42.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.768+0000 7fae808e6700 1 -- start start 2023-10-03T10:15:42.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.769+0000 7fae808e6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae7c0a10b0 0x7fae7c06dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.769+0000 7fae808e6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae7c133900 0x7fae7c06e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.769+0000 7fae808e6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae7c134210 0x7fae7c06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.769+0000 7fae808e6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c06fbd0 con 0x7fae7c0a10b0 2023-10-03T10:15:42.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.769+0000 7fae808e6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c071890 con 0x7fae7c133900 2023-10-03T10:15:42.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.769+0000 7fae808e6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c127380 con 0x7fae7c134210 2023-10-03T10:15:42.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.769+0000 7fe48e918700 1 -- 172.21.15.146:0/2341719142 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48804f2a0 con 0x7fe48812d380 2023-10-03T10:15:42.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.769+0000 7fae7a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae7c0a10b0 0x7fae7c06dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.769+0000 7fae7a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae7c0a10b0 0x7fae7c06dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39782/0 (socket says 172.21.15.146:39782) 2023-10-03T10:15:42.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.769+0000 7fae7a59c700 1 -- 172.21.15.146:0/669927444 learned_addr learned my addr 172.21.15.146:0/669927444 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:42.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.769+0000 7fae7ad9d700 1 --2- 172.21.15.146:0/669927444 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae7c134210 0x7fae7c06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.769+0000 7fae79d9b700 1 --2- 172.21.15.146:0/669927444 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae7c133900 0x7fae7c06e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.769+0000 7fae7a59c700 1 -- 172.21.15.146:0/669927444 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae7c134210 msgr2=0x7fae7c06ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.769+0000 7fae7a59c700 1 --2- 172.21.15.146:0/669927444 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae7c134210 0x7fae7c06ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.769+0000 7fae7a59c700 1 -- 172.21.15.146:0/669927444 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae7c133900 msgr2=0x7fae7c06e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.769+0000 7fae7a59c700 1 --2- 172.21.15.146:0/669927444 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae7c133900 0x7fae7c06e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.769+0000 7fae7a59c700 1 -- 172.21.15.146:0/669927444 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c009500 con 0x7fae7c0a10b0 2023-10-03T10:15:42.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.769+0000 7fae7a59c700 1 --2- 172.21.15.146:0/669927444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae7c0a10b0 0x7fae7c06dfc0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fae6c009c10 tx=0x7fae6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.770+0000 7fae6affd700 1 -- 172.21.15.146:0/669927444 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c011420 con 0x7fae7c0a10b0 2023-10-03T10:15:42.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.770+0000 7fae6affd700 1 -- 172.21.15.146:0/669927444 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c0115a0 con 0x7fae7c0a10b0 2023-10-03T10:15:42.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.770+0000 7fae6affd700 1 -- 172.21.15.146:0/669927444 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c011950 con 0x7fae7c0a10b0 2023-10-03T10:15:42.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.770+0000 7fae808e6700 1 -- 172.21.15.146:0/669927444 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7c071540 con 0x7fae7c0a10b0 2023-10-03T10:15:42.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.770+0000 7fae808e6700 1 -- 172.21.15.146:0/669927444 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7c0705c0 con 0x7fae7c0a10b0 2023-10-03T10:15:42.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.771+0000 7fae6affd700 1 -- 172.21.15.146:0/669927444 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae6c011ab0 con 0x7fae7c0a10b0 2023-10-03T10:15:42.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.772+0000 7fae6affd700 1 -- 172.21.15.146:0/669927444 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fae6c040ca0 con 0x7fae7c0a10b0 2023-10-03T10:15:42.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.773+0000 7fae808e6700 1 -- 172.21.15.146:0/669927444 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7c04f2a0 con 0x7fae7c0a10b0 2023-10-03T10:15:42.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.774+0000 7fe484ff9700 1 -- 172.21.15.146:0/2341719142 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe478017080 con 0x7fe48812d380 2023-10-03T10:15:42.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.778+0000 7fae6affd700 1 -- 172.21.15.146:0/669927444 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae6c0237a0 con 0x7fae7c0a10b0 2023-10-03T10:15:42.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.816+0000 7fe92674f700 1 Processor -- start 2023-10-03T10:15:42.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.816+0000 7fe92674f700 1 -- start start 2023-10-03T10:15:42.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.817+0000 7fe92674f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9201350d0 0x7fe92013ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.817+0000 7fe92674f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe92013d210 0x7fe92013f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.817+0000 7fe92674f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe92009eca0 con 0x7fe92006a770 2023-10-03T10:15:42.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.817+0000 7fe92674f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92006b2e0 con 0x7fe92013d210 2023-10-03T10:15:42.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.817+0000 7fe92674f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe92009f720 con 0x7fe9201350d0 2023-10-03T10:15:42.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.817+0000 7fe924cec700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe92013d210 0x7fe92013f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.817+0000 7fe91f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9201350d0 0x7fe92013ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.817+0000 7fe924cec700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe92013d210 0x7fe92013f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50662/0 (socket says 172.21.15.146:50662) 2023-10-03T10:15:42.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.817+0000 7fe924cec700 1 -- 172.21.15.146:0/3660927864 learned_addr learned my addr 172.21.15.146:0/3660927864 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:42.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.817+0000 7fe91f7fe700 1 -- 172.21.15.146:0/3660927864 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe92013d210 msgr2=0x7fe92013f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.817+0000 7fe91f7fe700 1 --2- 172.21.15.146:0/3660927864 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe92013d210 0x7fe92013f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.817+0000 7fe91f7fe700 1 -- 172.21.15.146:0/3660927864 >> v1:172.21.15.146:6789/0 conn(0x7fe92006a770 legacy=0x7fe9201349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.817+0000 7fe91f7fe700 1 -- 172.21.15.146:0/3660927864 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92006b480 con 0x7fe9201350d0 2023-10-03T10:15:42.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.818+0000 7fe91f7fe700 1 --2- 172.21.15.146:0/3660927864 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9201350d0 0x7fe92013ccd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe9140098a0 tx=0x7fe914009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12c21146baf0a86b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.818+0000 7fe91effd700 1 -- 172.21.15.146:0/3660927864 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe914011830 con 0x7fe9201350d0 2023-10-03T10:15:42.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.818+0000 7fe91effd700 1 -- 172.21.15.146:0/3660927864 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe914011990 con 0x7fe9201350d0 2023-10-03T10:15:42.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.818+0000 7fe91effd700 1 -- 172.21.15.146:0/3660927864 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe914011d20 con 0x7fe9201350d0 2023-10-03T10:15:42.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.818+0000 7fe92674f700 1 -- 172.21.15.146:0/3660927864 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9201350d0 msgr2=0x7fe92013ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.818+0000 7fe92674f700 1 --2- 172.21.15.146:0/3660927864 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9201350d0 0x7fe92013ccd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe9140098a0 tx=0x7fe914009bb0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.819+0000 7fe92674f700 1 -- 172.21.15.146:0/3660927864 shutdown_connections 2023-10-03T10:15:42.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.819+0000 7fe92674f700 1 --2- 172.21.15.146:0/3660927864 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe92013d210 0x7fe92013f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.819+0000 7fe92674f700 1 --2- 172.21.15.146:0/3660927864 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9201350d0 0x7fe92013ccd0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.819+0000 7fe92674f700 1 -- 172.21.15.146:0/3660927864 >> 172.21.15.146:0/3660927864 conn(0x7fe920099c40 msgr2=0x7fe9200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.819+0000 7fe92674f700 1 -- 172.21.15.146:0/3660927864 shutdown_connections 2023-10-03T10:15:42.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.819+0000 7fe92674f700 1 -- 172.21.15.146:0/3660927864 wait complete. 2023-10-03T10:15:42.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.820+0000 7fe92674f700 1 Processor -- start 2023-10-03T10:15:42.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.820+0000 7fe92674f700 1 -- start start 2023-10-03T10:15:42.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.820+0000 7fe92674f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe92006a770 0x7fe920133320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.820+0000 7fe92674f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9201350d0 0x7fe920133860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.820+0000 7fe92674f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe92013d210 0x7fe920133da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.820+0000 7fe92674f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9200a2d20 con 0x7fe92006a770 2023-10-03T10:15:42.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.820+0000 7fe92674f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92013c4d0 con 0x7fe9201350d0 2023-10-03T10:15:42.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.820+0000 7fe92674f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe920071ff0 con 0x7fe92013d210 2023-10-03T10:15:42.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.820+0000 7fe91ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe92006a770 0x7fe920133320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.820+0000 7fe91f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9201350d0 0x7fe920133860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.820+0000 7fe91ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe92006a770 0x7fe920133320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39792/0 (socket says 172.21.15.146:39792) 2023-10-03T10:15:42.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.820+0000 7fe91f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9201350d0 0x7fe920133860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50676/0 (socket says 172.21.15.146:50676) 2023-10-03T10:15:42.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.820+0000 7fe91ffff700 1 -- 172.21.15.146:0/1357253210 learned_addr learned my addr 172.21.15.146:0/1357253210 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:42.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.820+0000 7fe924cec700 1 --2- 172.21.15.146:0/1357253210 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe92013d210 0x7fe920133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.821+0000 7fe91f7fe700 1 -- 172.21.15.146:0/1357253210 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe92013d210 msgr2=0x7fe920133da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.821+0000 7fe91f7fe700 1 --2- 172.21.15.146:0/1357253210 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe92013d210 0x7fe920133da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.821+0000 7fe91f7fe700 1 -- 172.21.15.146:0/1357253210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe92006a770 msgr2=0x7fe920133320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.821+0000 7fe91f7fe700 1 --2- 172.21.15.146:0/1357253210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe92006a770 0x7fe920133320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.821+0000 7fe91f7fe700 1 -- 172.21.15.146:0/1357253210 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9140094a0 con 0x7fe9201350d0 2023-10-03T10:15:42.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.821+0000 7fe91ffff700 1 --2- 172.21.15.146:0/1357253210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe92006a770 0x7fe920133320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.821+0000 7fe91f7fe700 1 --2- 172.21.15.146:0/1357253210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9201350d0 0x7fe920133860 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe914016000 tx=0x7fe914004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.821+0000 7fe91cff9700 1 -- 172.21.15.146:0/1357253210 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe914004240 con 0x7fe9201350d0 2023-10-03T10:15:42.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.821+0000 7fe91cff9700 1 -- 172.21.15.146:0/1357253210 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91401f070 con 0x7fe9201350d0 2023-10-03T10:15:42.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.821+0000 7fe92674f700 1 -- 172.21.15.146:0/1357253210 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92009b0f0 con 0x7fe9201350d0 2023-10-03T10:15:42.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.821+0000 7fe91cff9700 1 -- 172.21.15.146:0/1357253210 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9140045c0 con 0x7fe9201350d0 2023-10-03T10:15:42.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.821+0000 7fe92674f700 1 -- 172.21.15.146:0/1357253210 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9201390b0 con 0x7fe9201350d0 2023-10-03T10:15:42.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.822+0000 7fe91cff9700 1 -- 172.21.15.146:0/1357253210 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe914021030 con 0x7fe9201350d0 2023-10-03T10:15:42.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.822+0000 7fe92674f700 1 -- 172.21.15.146:0/1357253210 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92013a170 con 0x7fe9201350d0 2023-10-03T10:15:42.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.822+0000 7fe91cff9700 1 -- 172.21.15.146:0/1357253210 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe9140408b0 con 0x7fe9201350d0 2023-10-03T10:15:42.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.831+0000 7fe91cff9700 1 -- 172.21.15.146:0/1357253210 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe92013a170 con 0x7fe9201350d0 2023-10-03T10:15:42.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.946+0000 7f9e8b282700 1 -- 172.21.15.146:0/2201611755 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9e8409ae00 con 0x7f9e840a0a30 2023-10-03T10:15:42.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.946+0000 7f9e79ffb700 1 -- 172.21.15.146:0/2201611755 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e8002a090 con 0x7f9e840a0a30 2023-10-03T10:15:42.947 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:42.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.948+0000 7f9e8b282700 1 -- 172.21.15.146:0/2201611755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9e840a0a30 msgr2=0x7f9e8411eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.948+0000 7f9e8b282700 1 --2- 172.21.15.146:0/2201611755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9e840a0a30 0x7f9e8411eaf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000e9b0 tx=0x7f9e8000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.948+0000 7f9e8b282700 1 -- 172.21.15.146:0/2201611755 shutdown_connections 2023-10-03T10:15:42.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.948+0000 7f9e8b282700 1 --2- 172.21.15.146:0/2201611755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e841304a0 0x7f9e841c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.948+0000 7f9e8b282700 1 --2- 172.21.15.146:0/2201611755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9e840a0a30 0x7f9e8411eaf0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.948+0000 7f9e8b282700 1 --2- 172.21.15.146:0/2201611755 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9e840a1340 0x7f9e8411f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.948+0000 7f9e8b282700 1 -- 172.21.15.146:0/2201611755 >> 172.21.15.146:0/2201611755 conn(0x7f9e840a2980 msgr2=0x7f9e8409deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.948+0000 7f9e8b282700 1 -- 172.21.15.146:0/2201611755 shutdown_connections 2023-10-03T10:15:42.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.948+0000 7f9e8b282700 1 -- 172.21.15.146:0/2201611755 wait complete. 2023-10-03T10:15:42.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:42.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.971+0000 7fe48e918700 1 -- 172.21.15.146:0/2341719142 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe488118f30 con 0x7fe48812d380 2023-10-03T10:15:42.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.971+0000 7fe484ff9700 1 -- 172.21.15.146:0/2341719142 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe478019b40 con 0x7fe48812d380 2023-10-03T10:15:42.972 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:42.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.973+0000 7fe48e918700 1 -- 172.21.15.146:0/2341719142 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe48812d380 msgr2=0x7fe48812f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.973+0000 7fe48e918700 1 --2- 172.21.15.146:0/2341719142 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe48812d380 0x7fe48812f350 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe47800c450 tx=0x7fe47800c760 comp rx=0 tx=0).stop 2023-10-03T10:15:42.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.973+0000 7fe48e918700 1 -- 172.21.15.146:0/2341719142 shutdown_connections 2023-10-03T10:15:42.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.973+0000 7fe48e918700 1 --2- 172.21.15.146:0/2341719142 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe488135f10 0x7fe48812fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.973+0000 7fe48e918700 1 --2- 172.21.15.146:0/2341719142 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe48812d380 0x7fe48812f350 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.973+0000 7fe48e918700 1 --2- 172.21.15.146:0/2341719142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4881335f0 0x7fe48812f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.973+0000 7fe48e918700 1 -- 172.21.15.146:0/2341719142 >> 172.21.15.146:0/2341719142 conn(0x7fe4880a2980 msgr2=0x7fe4881342a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.973+0000 7fe48e918700 1 -- 172.21.15.146:0/2341719142 shutdown_connections 2023-10-03T10:15:42.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.973+0000 7fe48e918700 1 -- 172.21.15.146:0/2341719142 wait complete. 2023-10-03T10:15:42.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.977+0000 7fae808e6700 1 -- 172.21.15.146:0/669927444 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fae7c06bce0 con 0x7fae7c0a10b0 2023-10-03T10:15:42.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.978+0000 7fae6affd700 1 -- 172.21.15.146:0/669927444 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fae6c035090 con 0x7fae7c0a10b0 2023-10-03T10:15:42.978 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.980+0000 7fae808e6700 1 -- 172.21.15.146:0/669927444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae7c0a10b0 msgr2=0x7fae7c06dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.980+0000 7fae808e6700 1 --2- 172.21.15.146:0/669927444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae7c0a10b0 0x7fae7c06dfc0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fae6c009c10 tx=0x7fae6c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.980+0000 7fae808e6700 1 -- 172.21.15.146:0/669927444 shutdown_connections 2023-10-03T10:15:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.980+0000 7fae808e6700 1 --2- 172.21.15.146:0/669927444 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fae7c134210 0x7fae7c06ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.980+0000 7fae808e6700 1 --2- 172.21.15.146:0/669927444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae7c0a10b0 0x7fae7c06dfc0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.980+0000 7fae808e6700 1 --2- 172.21.15.146:0/669927444 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fae7c133900 0x7fae7c06e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.980+0000 7fae808e6700 1 -- 172.21.15.146:0/669927444 >> 172.21.15.146:0/669927444 conn(0x7fae7c0a2980 msgr2=0x7fae7c1314d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.980+0000 7fae808e6700 1 -- 172.21.15.146:0/669927444 shutdown_connections 2023-10-03T10:15:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:42.980+0000 7fae808e6700 1 -- 172.21.15.146:0/669927444 wait complete. 2023-10-03T10:15:42.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:42.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:43.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:43.026+0000 7fe92674f700 1 -- 172.21.15.146:0/1357253210 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe9200a0e80 con 0x7fe9201350d0 2023-10-03T10:15:43.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:43.027+0000 7fe91cff9700 1 -- 172.21.15.146:0/1357253210 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe914015070 con 0x7fe9201350d0 2023-10-03T10:15:43.027 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:43.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:43.029+0000 7fe92674f700 1 -- 172.21.15.146:0/1357253210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9201350d0 msgr2=0x7fe920133860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:43.029+0000 7fe92674f700 1 --2- 172.21.15.146:0/1357253210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9201350d0 0x7fe920133860 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe914016000 tx=0x7fe914004750 comp rx=0 tx=0).stop 2023-10-03T10:15:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:43.029+0000 7fe92674f700 1 -- 172.21.15.146:0/1357253210 shutdown_connections 2023-10-03T10:15:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:43.029+0000 7fe92674f700 1 --2- 172.21.15.146:0/1357253210 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe92013d210 0x7fe920133da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:43.029+0000 7fe92674f700 1 --2- 172.21.15.146:0/1357253210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe92006a770 0x7fe920133320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:43.029+0000 7fe92674f700 1 --2- 172.21.15.146:0/1357253210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9201350d0 0x7fe920133860 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:43.029+0000 7fe92674f700 1 -- 172.21.15.146:0/1357253210 >> 172.21.15.146:0/1357253210 conn(0x7fe920099c40 msgr2=0x7fe92013d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:43.029+0000 7fe92674f700 1 -- 172.21.15.146:0/1357253210 shutdown_connections 2023-10-03T10:15:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:43.029+0000 7fe92674f700 1 -- 172.21.15.146:0/1357253210 wait complete. 2023-10-03T10:15:43.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:43.962 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:43.988 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:43.995 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:44.042 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:44.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.112+0000 7f08d22f8700 1 Processor -- start 2023-10-03T10:15:44.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.112+0000 7f08d22f8700 1 -- start start 2023-10-03T10:15:44.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.112+0000 7f08d22f8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08cc131980 0x7f08cc131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.112+0000 7f08d22f8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f08cc09bc70 0x7f08cc09c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.112+0000 7f08d22f8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08cc09c5c0 0x7f08cc138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.112+0000 7f08d22f8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08cc06eb30 con 0x7f08cc09bc70 2023-10-03T10:15:44.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.112+0000 7f08d22f8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc0a1640 con 0x7f08cc131980 2023-10-03T10:15:44.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.112+0000 7f08d22f8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc0a22d0 con 0x7f08cc09c5c0 2023-10-03T10:15:44.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.112+0000 7f08cbfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08cc131980 0x7f08cc131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.112+0000 7f08cbfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08cc131980 0x7f08cc131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50690/0 (socket says 172.21.15.146:50690) 2023-10-03T10:15:44.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.112+0000 7f08cbfff700 1 -- 172.21.15.146:0/2657452680 learned_addr learned my addr 172.21.15.146:0/2657452680 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:44.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.112+0000 7f08d0895700 1 --2- 172.21.15.146:0/2657452680 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08cc09c5c0 0x7f08cc138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.112+0000 7f08cb7fe700 1 --2- 172.21.15.146:0/2657452680 >> v2:172.21.15.146:3300/0 conn(0x7f08cc09bc70 0x7f08cc09c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.112+0000 7f08d0895700 1 -- 172.21.15.146:0/2657452680 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08cc131980 msgr2=0x7f08cc131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.112+0000 7f08d0895700 1 --2- 172.21.15.146:0/2657452680 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08cc131980 0x7f08cc131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.112+0000 7f08d0895700 1 -- 172.21.15.146:0/2657452680 >> v2:172.21.15.146:3300/0 conn(0x7f08cc09bc70 msgr2=0x7f08cc09c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.112+0000 7f08d0895700 1 --2- 172.21.15.146:0/2657452680 >> v2:172.21.15.146:3300/0 conn(0x7f08cc09bc70 0x7f08cc09c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.112+0000 7f08d0895700 1 -- 172.21.15.146:0/2657452680 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc131550 con 0x7f08cc09c5c0 2023-10-03T10:15:44.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.113+0000 7f08cbfff700 1 --2- 172.21.15.146:0/2657452680 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08cc131980 0x7f08cc131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:44.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.113+0000 7f08d0895700 1 --2- 172.21.15.146:0/2657452680 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08cc09c5c0 0x7f08cc138700 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f08c4009dc0 tx=0x7f08c400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8144d7e798642f8f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.113+0000 7f08caffd700 1 -- 172.21.15.146:0/2657452680 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c400e070 con 0x7f08cc09c5c0 2023-10-03T10:15:44.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.113+0000 7f08caffd700 1 -- 172.21.15.146:0/2657452680 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c400bae0 con 0x7f08cc09c5c0 2023-10-03T10:15:44.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.113+0000 7f08caffd700 1 -- 172.21.15.146:0/2657452680 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c400be90 con 0x7f08cc09c5c0 2023-10-03T10:15:44.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.114+0000 7f08d22f8700 1 -- 172.21.15.146:0/2657452680 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08cc09c5c0 msgr2=0x7f08cc138700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.114+0000 7f08d22f8700 1 --2- 172.21.15.146:0/2657452680 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08cc09c5c0 0x7f08cc138700 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f08c4009dc0 tx=0x7f08c400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:44.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.114+0000 7f08d22f8700 1 -- 172.21.15.146:0/2657452680 shutdown_connections 2023-10-03T10:15:44.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.114+0000 7f08d22f8700 1 --2- 172.21.15.146:0/2657452680 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08cc131980 0x7f08cc131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.114+0000 7f08d22f8700 1 --2- 172.21.15.146:0/2657452680 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08cc09c5c0 0x7f08cc138700 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.114+0000 7f08d22f8700 1 --2- 172.21.15.146:0/2657452680 >> v2:172.21.15.146:3300/0 conn(0x7f08cc09bc70 0x7f08cc09c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.114+0000 7f08d22f8700 1 -- 172.21.15.146:0/2657452680 >> 172.21.15.146:0/2657452680 conn(0x7f08cc0a2980 msgr2=0x7f08cc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.114+0000 7f08d22f8700 1 -- 172.21.15.146:0/2657452680 shutdown_connections 2023-10-03T10:15:44.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.114+0000 7f08d22f8700 1 -- 172.21.15.146:0/2657452680 wait complete. 2023-10-03T10:15:44.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.115+0000 7f08d22f8700 1 Processor -- start 2023-10-03T10:15:44.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.116+0000 7f08d22f8700 1 -- start start 2023-10-03T10:15:44.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.116+0000 7f08d22f8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08cc09bc70 0x7f08cc1c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.116+0000 7f08d22f8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08cc09c5c0 0x7f08cc1c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.116+0000 7f08d22f8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08cc131980 0x7f08cc1c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.116+0000 7f08d22f8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc12d2e0 con 0x7f08cc09c5c0 2023-10-03T10:15:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.116+0000 7f08d22f8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc12d0f0 con 0x7f08cc131980 2023-10-03T10:15:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.116+0000 7f08d22f8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc1387d0 con 0x7f08cc09bc70 2023-10-03T10:15:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.117+0000 7f08d0895700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08cc131980 0x7f08cc1c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.117+0000 7f08cbfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08cc09bc70 0x7f08cc1c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.117+0000 7f08d0895700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08cc131980 0x7f08cc1c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50702/0 (socket says 172.21.15.146:50702) 2023-10-03T10:15:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.117+0000 7f08d0895700 1 -- 172.21.15.146:0/1956314705 learned_addr learned my addr 172.21.15.146:0/1956314705 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.117+0000 7f08cb7fe700 1 --2- 172.21.15.146:0/1956314705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08cc09c5c0 0x7f08cc1c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.117+0000 7f08d0895700 1 -- 172.21.15.146:0/1956314705 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08cc09bc70 msgr2=0x7f08cc1c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.117+0000 7f08d0895700 1 --2- 172.21.15.146:0/1956314705 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08cc09bc70 0x7f08cc1c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.117+0000 7f08d0895700 1 -- 172.21.15.146:0/1956314705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08cc09c5c0 msgr2=0x7f08cc1c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.117+0000 7f08d0895700 1 --2- 172.21.15.146:0/1956314705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08cc09c5c0 0x7f08cc1c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.117+0000 7f08d0895700 1 -- 172.21.15.146:0/1956314705 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc009500 con 0x7f08cc131980 2023-10-03T10:15:44.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.117+0000 7f08cbfff700 1 --2- 172.21.15.146:0/1956314705 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08cc09bc70 0x7f08cc1c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:44.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.117+0000 7f08d0895700 1 --2- 172.21.15.146:0/1956314705 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08cc131980 0x7f08cc1c8b30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f08cc0a2410 tx=0x7f08c4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.117+0000 7f08c8ff9700 1 -- 172.21.15.146:0/1956314705 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c40045d0 con 0x7f08cc131980 2023-10-03T10:15:44.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.117+0000 7f08c8ff9700 1 -- 172.21.15.146:0/1956314705 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c4020070 con 0x7f08cc131980 2023-10-03T10:15:44.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.117+0000 7f08c8ff9700 1 -- 172.21.15.146:0/1956314705 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c4027480 con 0x7f08cc131980 2023-10-03T10:15:44.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.117+0000 7f08d22f8700 1 -- 172.21.15.146:0/1956314705 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c4009a70 con 0x7f08cc131980 2023-10-03T10:15:44.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.118+0000 7f08d22f8700 1 -- 172.21.15.146:0/1956314705 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08cc12d8e0 con 0x7f08cc131980 2023-10-03T10:15:44.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.118+0000 7f08c8ff9700 1 -- 172.21.15.146:0/1956314705 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f08c4012430 con 0x7f08cc131980 2023-10-03T10:15:44.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.118+0000 7f08d22f8700 1 -- 172.21.15.146:0/1956314705 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08cc04f2a0 con 0x7f08cc131980 2023-10-03T10:15:44.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.119+0000 7f08c8ff9700 1 -- 172.21.15.146:0/1956314705 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f08c4022070 con 0x7f08cc131980 2023-10-03T10:15:44.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.123+0000 7f08c8ff9700 1 -- 172.21.15.146:0/1956314705 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f08c401a790 con 0x7f08cc131980 2023-10-03T10:15:44.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.144+0000 7f0b3ae31700 1 Processor -- start 2023-10-03T10:15:44.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.144+0000 7f0b3ae31700 1 -- start start 2023-10-03T10:15:44.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.145+0000 7f0b3ae31700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b34134140 0x7f0b34138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.145+0000 7f0b3ae31700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b34134570 0x7f0b3413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.145+0000 7f0b3ae31700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3409b110 con 0x7f0b3409ad40 2023-10-03T10:15:44.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.145+0000 7f0b3ae31700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b340a3b60 con 0x7f0b34134570 2023-10-03T10:15:44.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.145+0000 7f0b3ae31700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b340a1a80 con 0x7f0b34134140 2023-10-03T10:15:44.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.145+0000 7f0b393ce700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b34134570 0x7f0b3413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.145+0000 7f0b38bcd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0b3409ad40 0x7f0b34133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36226/0 (socket says 172.21.15.146:36226) 2023-10-03T10:15:44.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.145+0000 7f0b38bcd700 1 -- 172.21.15.146:0/910424853 learned_addr learned my addr 172.21.15.146:0/910424853 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:44.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.146+0000 7f0b33fff700 1 --2- 172.21.15.146:0/910424853 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b34134140 0x7f0b34138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.146+0000 7f0b337fe700 1 -- 172.21.15.146:0/910424853 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1610827847 0 0) 0x7f0b3409b110 con 0x7f0b3409ad40 2023-10-03T10:15:44.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.146+0000 7f0b393ce700 1 -- 172.21.15.146:0/910424853 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b34134140 msgr2=0x7f0b34138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.146+0000 7f0b393ce700 1 --2- 172.21.15.146:0/910424853 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b34134140 0x7f0b34138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.146+0000 7f0b393ce700 1 -- 172.21.15.146:0/910424853 >> v1:172.21.15.146:6789/0 conn(0x7f0b3409ad40 legacy=0x7f0b34133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.146+0000 7f0b393ce700 1 -- 172.21.15.146:0/910424853 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b340a2fa0 con 0x7f0b34134570 2023-10-03T10:15:44.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.146+0000 7f0b33fff700 1 --2- 172.21.15.146:0/910424853 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b34134140 0x7f0b34138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:44.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.146+0000 7f0b393ce700 1 --2- 172.21.15.146:0/910424853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b34134570 0x7f0b3413b3d0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009d90 tx=0x7f0b2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd443d47414cbee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.146+0000 7f0b337fe700 1 -- 172.21.15.146:0/910424853 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c00e070 con 0x7f0b34134570 2023-10-03T10:15:44.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.146+0000 7f0b337fe700 1 -- 172.21.15.146:0/910424853 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2c00bbd0 con 0x7f0b34134570 2023-10-03T10:15:44.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.146+0000 7f0b337fe700 1 -- 172.21.15.146:0/910424853 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c012430 con 0x7f0b34134570 2023-10-03T10:15:44.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.147+0000 7f0b3ae31700 1 -- 172.21.15.146:0/910424853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b34134570 msgr2=0x7f0b3413b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.147+0000 7f0b3ae31700 1 --2- 172.21.15.146:0/910424853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b34134570 0x7f0b3413b3d0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009d90 tx=0x7f0b2c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:44.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.147+0000 7f0b3ae31700 1 -- 172.21.15.146:0/910424853 shutdown_connections 2023-10-03T10:15:44.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.147+0000 7f0b3ae31700 1 --2- 172.21.15.146:0/910424853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b34134570 0x7f0b3413b3d0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.147+0000 7f0b3ae31700 1 --2- 172.21.15.146:0/910424853 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b34134140 0x7f0b34138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.147+0000 7f0b3ae31700 1 -- 172.21.15.146:0/910424853 >> 172.21.15.146:0/910424853 conn(0x7f0b34099c40 msgr2=0x7f0b3406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.147+0000 7f0b3ae31700 1 -- 172.21.15.146:0/910424853 shutdown_connections 2023-10-03T10:15:44.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.147+0000 7f0b3ae31700 1 -- 172.21.15.146:0/910424853 wait complete. 2023-10-03T10:15:44.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.149+0000 7f0b3ae31700 1 Processor -- start 2023-10-03T10:15:44.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.149+0000 7f0b3ae31700 1 -- start start 2023-10-03T10:15:44.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.149+0000 7f0b3ae31700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b3409ad40 0x7f0b34139390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.151+0000 7f0b3ae31700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b34134140 0x7f0b341398d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.151+0000 7f0b3ae31700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b34134570 0x7f0b34139e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.151+0000 7f0b3ae31700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3411ec40 con 0x7f0b34134140 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.151+0000 7f0b3ae31700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3411e3d0 con 0x7f0b3409ad40 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.151+0000 7f0b3ae31700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3409c7e0 con 0x7f0b34134570 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.151+0000 7f0b33fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b34134140 0x7f0b341398d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.151+0000 7f0b33fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b34134140 0x7f0b341398d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39832/0 (socket says 172.21.15.146:39832) 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.151+0000 7f0b33fff700 1 -- 172.21.15.146:0/2305908283 learned_addr learned my addr 172.21.15.146:0/2305908283 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.151+0000 7f0b38bcd700 1 --2- 172.21.15.146:0/2305908283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b3409ad40 0x7f0b34139390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.151+0000 7f0b393ce700 1 --2- 172.21.15.146:0/2305908283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b34134570 0x7f0b34139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.151+0000 7f0b393ce700 1 -- 172.21.15.146:0/2305908283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b3409ad40 msgr2=0x7f0b34139390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.151+0000 7f0b393ce700 1 --2- 172.21.15.146:0/2305908283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b3409ad40 0x7f0b34139390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.151+0000 7f0b393ce700 1 -- 172.21.15.146:0/2305908283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b34134140 msgr2=0x7f0b341398d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.151+0000 7f0b393ce700 1 --2- 172.21.15.146:0/2305908283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b34134140 0x7f0b341398d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.151+0000 7f0b393ce700 1 -- 172.21.15.146:0/2305908283 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2c009a70 con 0x7f0b34134570 2023-10-03T10:15:44.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.151+0000 7f0b393ce700 1 --2- 172.21.15.146:0/2305908283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b34134570 0x7f0b34139e10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c016000 tx=0x7f0b2c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.151+0000 7f0b317fa700 1 -- 172.21.15.146:0/2305908283 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c012430 con 0x7f0b34134570 2023-10-03T10:15:44.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.151+0000 7f0b317fa700 1 -- 172.21.15.146:0/2305908283 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2c020070 con 0x7f0b34134570 2023-10-03T10:15:44.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.151+0000 7f0b317fa700 1 -- 172.21.15.146:0/2305908283 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c004280 con 0x7f0b34134570 2023-10-03T10:15:44.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.152+0000 7f0b3ae31700 1 -- 172.21.15.146:0/2305908283 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b340a4d00 con 0x7f0b34134570 2023-10-03T10:15:44.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.152+0000 7f0b3ae31700 1 -- 172.21.15.146:0/2305908283 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3411d530 con 0x7f0b34134570 2023-10-03T10:15:44.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.153+0000 7f0b317fa700 1 -- 172.21.15.146:0/2305908283 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b2c0043e0 con 0x7f0b34134570 2023-10-03T10:15:44.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.153+0000 7f0b3ae31700 1 -- 172.21.15.146:0/2305908283 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b341361e0 con 0x7f0b34134570 2023-10-03T10:15:44.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.153+0000 7f0b317fa700 1 -- 172.21.15.146:0/2305908283 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0b2c022070 con 0x7f0b34134570 2023-10-03T10:15:44.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.155+0000 7fba86e85700 1 Processor -- start 2023-10-03T10:15:44.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.155+0000 7fba86e85700 1 -- start start 2023-10-03T10:15:44.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.156+0000 7fba86e85700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba8006a770 0x7fba8006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.156+0000 7fba86e85700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fba80136cb0 0x7fba80139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.156+0000 7fba86e85700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba8006e900 con 0x7fba8009dec0 2023-10-03T10:15:44.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.156+0000 7fba86e85700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8009d180 con 0x7fba80136cb0 2023-10-03T10:15:44.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.156+0000 7fba86e85700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba8009e780 con 0x7fba8006a770 2023-10-03T10:15:44.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.156+0000 7fba85422700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fba80136cb0 0x7fba80139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.156+0000 7fba85422700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fba80136cb0 0x7fba80139090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39840/0 (socket says 172.21.15.146:39840) 2023-10-03T10:15:44.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.156+0000 7fba85422700 1 -- 172.21.15.146:0/2097008874 learned_addr learned my addr 172.21.15.146:0/2097008874 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:44.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.156+0000 7fba84c21700 1 --2- 172.21.15.146:0/2097008874 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba8006a770 0x7fba8006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.156+0000 7fba85422700 1 -- 172.21.15.146:0/2097008874 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba8006a770 msgr2=0x7fba8006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.156+0000 7fba85422700 1 --2- 172.21.15.146:0/2097008874 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba8006a770 0x7fba8006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.156+0000 7fba85422700 1 -- 172.21.15.146:0/2097008874 >> v1:172.21.15.146:6789/0 conn(0x7fba8009dec0 legacy=0x7fba8006b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.156+0000 7fba85422700 1 -- 172.21.15.146:0/2097008874 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8009d3c0 con 0x7fba80136cb0 2023-10-03T10:15:44.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.156+0000 7fba85422700 1 --2- 172.21.15.146:0/2097008874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba80136cb0 0x7fba80139090 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fba78009e50 tx=0x7fba7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1783bf1a36e026ef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.159+0000 7fba7f7fe700 1 -- 172.21.15.146:0/2097008874 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7800e070 con 0x7fba80136cb0 2023-10-03T10:15:44.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.159+0000 7fba7f7fe700 1 -- 172.21.15.146:0/2097008874 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba78003a20 con 0x7fba80136cb0 2023-10-03T10:15:44.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.159+0000 7fba7f7fe700 1 -- 172.21.15.146:0/2097008874 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78003db0 con 0x7fba80136cb0 2023-10-03T10:15:44.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.159+0000 7fba86e85700 1 -- 172.21.15.146:0/2097008874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba80136cb0 msgr2=0x7fba80139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.159+0000 7fba86e85700 1 --2- 172.21.15.146:0/2097008874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba80136cb0 0x7fba80139090 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fba78009e50 tx=0x7fba7800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:44.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.160+0000 7fba86e85700 1 -- 172.21.15.146:0/2097008874 shutdown_connections 2023-10-03T10:15:44.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.160+0000 7fba86e85700 1 --2- 172.21.15.146:0/2097008874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba80136cb0 0x7fba80139090 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.160+0000 7fba86e85700 1 --2- 172.21.15.146:0/2097008874 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba8006a770 0x7fba8006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.160+0000 7fba86e85700 1 -- 172.21.15.146:0/2097008874 >> 172.21.15.146:0/2097008874 conn(0x7fba80099c40 msgr2=0x7fba800a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.160+0000 7fba86e85700 1 -- 172.21.15.146:0/2097008874 shutdown_connections 2023-10-03T10:15:44.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.160+0000 7fba86e85700 1 -- 172.21.15.146:0/2097008874 wait complete. 2023-10-03T10:15:44.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.161+0000 7fba86e85700 1 Processor -- start 2023-10-03T10:15:44.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.161+0000 7fba86e85700 1 -- start start 2023-10-03T10:15:44.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.161+0000 7fba86e85700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba8006a770 0x7fba80136090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.161+0000 7fba86e85700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba8009dec0 0x7fba8013a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.161+0000 7fba86e85700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba80136cb0 0x7fba8013ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.161+0000 7fba86e85700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8013dd20 con 0x7fba80136cb0 2023-10-03T10:15:44.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.161+0000 7fba86e85700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8013c2b0 con 0x7fba8006a770 2023-10-03T10:15:44.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.161+0000 7fba86e85700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba800a2ea0 con 0x7fba8009dec0 2023-10-03T10:15:44.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.161+0000 7fba7ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba8009dec0 0x7fba8013a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.161+0000 7fba7ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba8009dec0 0x7fba8013a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59914/0 (socket says 172.21.15.146:59914) 2023-10-03T10:15:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.161+0000 7fba7ffff700 1 -- 172.21.15.146:0/1326710825 learned_addr learned my addr 172.21.15.146:0/1326710825 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.161+0000 7fba84c21700 1 --2- 172.21.15.146:0/1326710825 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba8006a770 0x7fba80136090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.161+0000 7fba85422700 1 --2- 172.21.15.146:0/1326710825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba80136cb0 0x7fba8013ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.162+0000 7fba7ffff700 1 -- 172.21.15.146:0/1326710825 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba8006a770 msgr2=0x7fba80136090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.162+0000 7fba7ffff700 1 --2- 172.21.15.146:0/1326710825 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba8006a770 0x7fba80136090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.162+0000 7fba7ffff700 1 -- 172.21.15.146:0/1326710825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba80136cb0 msgr2=0x7fba8013ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.162+0000 7fba7ffff700 1 --2- 172.21.15.146:0/1326710825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba80136cb0 0x7fba8013ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.162+0000 7fba7ffff700 1 -- 172.21.15.146:0/1326710825 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba78009b30 con 0x7fba8009dec0 2023-10-03T10:15:44.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.162+0000 7fba84c21700 1 --2- 172.21.15.146:0/1326710825 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba8006a770 0x7fba80136090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:44.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.162+0000 7f0b317fa700 1 -- 172.21.15.146:0/2305908283 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b2c01b400 con 0x7f0b34134570 2023-10-03T10:15:44.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.162+0000 7fba7ffff700 1 --2- 172.21.15.146:0/1326710825 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba8009dec0 0x7fba8013a5e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fba6c00c4a0 tx=0x7fba6c00c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.167+0000 7fba7d7fa700 1 -- 172.21.15.146:0/1326710825 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c0054e0 con 0x7fba8009dec0 2023-10-03T10:15:44.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.167+0000 7fba7d7fa700 1 -- 172.21.15.146:0/1326710825 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c003680 con 0x7fba8009dec0 2023-10-03T10:15:44.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.167+0000 7fba7d7fa700 1 -- 172.21.15.146:0/1326710825 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c003a30 con 0x7fba8009dec0 2023-10-03T10:15:44.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.167+0000 7fba86e85700 1 -- 172.21.15.146:0/1326710825 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba80071ce0 con 0x7fba8009dec0 2023-10-03T10:15:44.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.167+0000 7fba86e85700 1 -- 172.21.15.146:0/1326710825 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8013d930 con 0x7fba8009dec0 2023-10-03T10:15:44.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.168+0000 7fba7d7fa700 1 -- 172.21.15.146:0/1326710825 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba6c003b90 con 0x7fba8009dec0 2023-10-03T10:15:44.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.168+0000 7fba7d7fa700 1 -- 172.21.15.146:0/1326710825 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fba6c03e7b0 con 0x7fba8009dec0 2023-10-03T10:15:44.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.168+0000 7fba86e85700 1 -- 172.21.15.146:0/1326710825 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba80138820 con 0x7fba8009dec0 2023-10-03T10:15:44.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.176+0000 7fba7d7fa700 1 -- 172.21.15.146:0/1326710825 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba6c017080 con 0x7fba8009dec0 2023-10-03T10:15:44.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.192+0000 7f6a1d559700 1 Processor -- start 2023-10-03T10:15:44.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.192+0000 7f6a1d559700 1 -- start start 2023-10-03T10:15:44.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.193+0000 7f6a1d559700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a180a0a70 0x7f6a180a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.193+0000 7f6a1d559700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6a180a1380 0x7f6a18133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.193+0000 7f6a1d559700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a18133f50 0x7f6a18134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.193+0000 7f6a1d559700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1809e9d0 con 0x7f6a180a1380 2023-10-03T10:15:44.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.193+0000 7f6a1d559700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1809dc00 con 0x7f6a180a0a70 2023-10-03T10:15:44.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.193+0000 7f6a1d559700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1809dec0 con 0x7f6a18133f50 2023-10-03T10:15:44.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.193+0000 7f6a16ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a180a0a70 0x7f6a180a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.193+0000 7f6a16ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a180a0a70 0x7f6a180a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50732/0 (socket says 172.21.15.146:50732) 2023-10-03T10:15:44.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.193+0000 7f6a16ffd700 1 -- 172.21.15.146:0/2070587996 learned_addr learned my addr 172.21.15.146:0/2070587996 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:44.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.193+0000 7f6a167fc700 1 --2- 172.21.15.146:0/2070587996 >> v2:172.21.15.146:3300/0 conn(0x7f6a180a1380 0x7f6a18133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.194+0000 7f6a177fe700 1 --2- 172.21.15.146:0/2070587996 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a18133f50 0x7f6a18134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.194+0000 7f6a16ffd700 1 -- 172.21.15.146:0/2070587996 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a18133f50 msgr2=0x7f6a18134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.194+0000 7f6a16ffd700 1 --2- 172.21.15.146:0/2070587996 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a18133f50 0x7f6a18134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.194+0000 7f6a16ffd700 1 -- 172.21.15.146:0/2070587996 >> v2:172.21.15.146:3300/0 conn(0x7f6a180a1380 msgr2=0x7f6a18133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.194+0000 7f6a16ffd700 1 --2- 172.21.15.146:0/2070587996 >> v2:172.21.15.146:3300/0 conn(0x7f6a180a1380 0x7f6a18133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.194+0000 7f6a16ffd700 1 -- 172.21.15.146:0/2070587996 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1809e6a0 con 0x7f6a180a0a70 2023-10-03T10:15:44.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.194+0000 7f6a177fe700 1 --2- 172.21.15.146:0/2070587996 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a18133f50 0x7f6a18134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:44.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.194+0000 7f6a16ffd700 1 --2- 172.21.15.146:0/2070587996 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a180a0a70 0x7f6a180a0e40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6a080098f0 tx=0x7f6a08009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58b22af0cf7b1e3e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.194+0000 7f6a15ffb700 1 -- 172.21.15.146:0/2070587996 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08011830 con 0x7f6a180a0a70 2023-10-03T10:15:44.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.194+0000 7f6a15ffb700 1 -- 172.21.15.146:0/2070587996 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a08011990 con 0x7f6a180a0a70 2023-10-03T10:15:44.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.194+0000 7f6a15ffb700 1 -- 172.21.15.146:0/2070587996 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08011d20 con 0x7f6a180a0a70 2023-10-03T10:15:44.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.195+0000 7f6a1d559700 1 -- 172.21.15.146:0/2070587996 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a180a0a70 msgr2=0x7f6a180a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.195+0000 7f6a1d559700 1 --2- 172.21.15.146:0/2070587996 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a180a0a70 0x7f6a180a0e40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6a080098f0 tx=0x7f6a08009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:44.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.195+0000 7f6a1d559700 1 -- 172.21.15.146:0/2070587996 shutdown_connections 2023-10-03T10:15:44.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.195+0000 7f6a1d559700 1 --2- 172.21.15.146:0/2070587996 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a180a0a70 0x7f6a180a0e40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.195+0000 7f6a1d559700 1 --2- 172.21.15.146:0/2070587996 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a18133f50 0x7f6a18134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.195+0000 7f6a1d559700 1 --2- 172.21.15.146:0/2070587996 >> v2:172.21.15.146:3300/0 conn(0x7f6a180a1380 0x7f6a18133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.195+0000 7f6a1d559700 1 -- 172.21.15.146:0/2070587996 >> 172.21.15.146:0/2070587996 conn(0x7f6a180a6610 msgr2=0x7f6a180a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.195+0000 7f6a1d559700 1 -- 172.21.15.146:0/2070587996 shutdown_connections 2023-10-03T10:15:44.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.195+0000 7f6a1d559700 1 -- 172.21.15.146:0/2070587996 wait complete. 2023-10-03T10:15:44.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.196+0000 7f6a1d559700 1 Processor -- start 2023-10-03T10:15:44.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.196+0000 7f6a1d559700 1 -- start start 2023-10-03T10:15:44.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.196+0000 7f6a1d559700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a180a0a70 0x7f6a181222b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.196+0000 7f6a1d559700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a180a1380 0x7f6a181227f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.196+0000 7f6a1d559700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a18133f50 0x7f6a18122d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.196+0000 7f6a1d559700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a181258c0 con 0x7f6a180a1380 2023-10-03T10:15:44.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.196+0000 7f6a1d559700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a18124d50 con 0x7f6a18133f50 2023-10-03T10:15:44.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.196+0000 7f6a1d559700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a180a03e0 con 0x7f6a180a0a70 2023-10-03T10:15:44.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.197+0000 7f6a167fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a180a1380 0x7f6a181227f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.197+0000 7f6a167fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a180a1380 0x7f6a181227f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39878/0 (socket says 172.21.15.146:39878) 2023-10-03T10:15:44.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.197+0000 7f6a167fc700 1 -- 172.21.15.146:0/3127189605 learned_addr learned my addr 172.21.15.146:0/3127189605 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:44.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.197+0000 7f6a16ffd700 1 --2- 172.21.15.146:0/3127189605 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a180a0a70 0x7f6a181222b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.197+0000 7f6a177fe700 1 --2- 172.21.15.146:0/3127189605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a18133f50 0x7f6a18122d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.197+0000 7f6a167fc700 1 -- 172.21.15.146:0/3127189605 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a180a0a70 msgr2=0x7f6a181222b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.197+0000 7f6a167fc700 1 --2- 172.21.15.146:0/3127189605 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a180a0a70 0x7f6a181222b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.197+0000 7f6a167fc700 1 -- 172.21.15.146:0/3127189605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a18133f50 msgr2=0x7f6a18122d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.197+0000 7f6a167fc700 1 --2- 172.21.15.146:0/3127189605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a18133f50 0x7f6a18122d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.197+0000 7f6a167fc700 1 -- 172.21.15.146:0/3127189605 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a08009550 con 0x7f6a180a1380 2023-10-03T10:15:44.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.197+0000 7f6a167fc700 1 --2- 172.21.15.146:0/3127189605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a180a1380 0x7f6a181227f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00e930 tx=0x7f6a0c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.197+0000 7f69ff7fe700 1 -- 172.21.15.146:0/3127189605 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c00ee80 con 0x7f6a180a1380 2023-10-03T10:15:44.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.197+0000 7f6a1d559700 1 -- 172.21.15.146:0/3127189605 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a180a51f0 con 0x7f6a180a1380 2023-10-03T10:15:44.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.197+0000 7f69ff7fe700 1 -- 172.21.15.146:0/3127189605 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0c017c60 con 0x7f6a180a1380 2023-10-03T10:15:44.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.197+0000 7f69ff7fe700 1 -- 172.21.15.146:0/3127189605 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c00c640 con 0x7f6a180a1380 2023-10-03T10:15:44.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.197+0000 7f6a1d559700 1 -- 172.21.15.146:0/3127189605 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a18123f10 con 0x7f6a180a1380 2023-10-03T10:15:44.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.198+0000 7f69ff7fe700 1 -- 172.21.15.146:0/3127189605 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a0c00c7c0 con 0x7f6a180a1380 2023-10-03T10:15:44.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.199+0000 7f69ff7fe700 1 -- 172.21.15.146:0/3127189605 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6a0c047a20 con 0x7f6a180a1380 2023-10-03T10:15:44.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.198+0000 7f6a1d559700 1 -- 172.21.15.146:0/3127189605 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a1811f760 con 0x7f6a180a1380 2023-10-03T10:15:44.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.208+0000 7f69ff7fe700 1 -- 172.21.15.146:0/3127189605 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a0c01f440 con 0x7f6a180a1380 2023-10-03T10:15:44.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.363+0000 7f0b3ae31700 1 -- 172.21.15.146:0/2305908283 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0b3411e600 con 0x7f0b34134570 2023-10-03T10:15:44.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.363+0000 7f0b317fa700 1 -- 172.21.15.146:0/2305908283 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b3411e600 con 0x7f0b34134570 2023-10-03T10:15:44.363 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:44.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.364+0000 7f08d22f8700 1 -- 172.21.15.146:0/1956314705 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f08cc132d50 con 0x7f08cc131980 2023-10-03T10:15:44.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.364+0000 7f08c8ff9700 1 -- 172.21.15.146:0/1956314705 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f08c402c030 con 0x7f08cc131980 2023-10-03T10:15:44.366 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:44.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.366+0000 7f08d22f8700 1 -- 172.21.15.146:0/1956314705 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08cc131980 msgr2=0x7f08cc1c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.366+0000 7f08d22f8700 1 --2- 172.21.15.146:0/1956314705 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08cc131980 0x7f08cc1c8b30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f08cc0a2410 tx=0x7f08c4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.366+0000 7f08d22f8700 1 -- 172.21.15.146:0/1956314705 shutdown_connections 2023-10-03T10:15:44.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.366+0000 7f08d22f8700 1 --2- 172.21.15.146:0/1956314705 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08cc131980 0x7f08cc1c8b30 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.366+0000 7f08d22f8700 1 --2- 172.21.15.146:0/1956314705 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08cc09bc70 0x7f08cc1c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.366+0000 7f08d22f8700 1 --2- 172.21.15.146:0/1956314705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08cc09c5c0 0x7f08cc1c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.366+0000 7f08d22f8700 1 -- 172.21.15.146:0/1956314705 >> 172.21.15.146:0/1956314705 conn(0x7f08cc0a2980 msgr2=0x7f08cc09f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.367+0000 7f08d22f8700 1 -- 172.21.15.146:0/1956314705 shutdown_connections 2023-10-03T10:15:44.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.367+0000 7f08d22f8700 1 -- 172.21.15.146:0/1956314705 wait complete. 2023-10-03T10:15:44.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.367+0000 7f0b3ae31700 1 -- 172.21.15.146:0/2305908283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b34134570 msgr2=0x7f0b34139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.367+0000 7f0b3ae31700 1 --2- 172.21.15.146:0/2305908283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b34134570 0x7f0b34139e10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c016000 tx=0x7f0b2c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.367+0000 7f0b3ae31700 1 -- 172.21.15.146:0/2305908283 shutdown_connections 2023-10-03T10:15:44.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.367+0000 7f0b3ae31700 1 --2- 172.21.15.146:0/2305908283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b34134570 0x7f0b34139e10 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.367+0000 7f0b3ae31700 1 --2- 172.21.15.146:0/2305908283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b3409ad40 0x7f0b34139390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.367+0000 7f0b3ae31700 1 --2- 172.21.15.146:0/2305908283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b34134140 0x7f0b341398d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.367+0000 7f0b3ae31700 1 -- 172.21.15.146:0/2305908283 >> 172.21.15.146:0/2305908283 conn(0x7f0b34099c40 msgr2=0x7f0b3413af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.367+0000 7f0b3ae31700 1 -- 172.21.15.146:0/2305908283 shutdown_connections 2023-10-03T10:15:44.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.367+0000 7f0b3ae31700 1 -- 172.21.15.146:0/2305908283 wait complete. 2023-10-03T10:15:44.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:44.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:44.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.404+0000 7f6a1d559700 1 -- 172.21.15.146:0/3127189605 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6a1804f2a0 con 0x7f6a180a1380 2023-10-03T10:15:44.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.404+0000 7f69ff7fe700 1 -- 172.21.15.146:0/3127189605 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6a0c024030 con 0x7f6a180a1380 2023-10-03T10:15:44.404 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:44.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.406+0000 7f6a1d559700 1 -- 172.21.15.146:0/3127189605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a180a1380 msgr2=0x7f6a181227f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.406+0000 7f6a1d559700 1 --2- 172.21.15.146:0/3127189605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a180a1380 0x7f6a181227f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00e930 tx=0x7f6a0c00ec40 comp rx=0 tx=0).stop 2023-10-03T10:15:44.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.406+0000 7f6a1d559700 1 -- 172.21.15.146:0/3127189605 shutdown_connections 2023-10-03T10:15:44.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.406+0000 7f6a1d559700 1 --2- 172.21.15.146:0/3127189605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a18133f50 0x7f6a18122d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.406+0000 7f6a1d559700 1 --2- 172.21.15.146:0/3127189605 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a180a0a70 0x7f6a181222b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.406+0000 7f6a1d559700 1 --2- 172.21.15.146:0/3127189605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a180a1380 0x7f6a181227f0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.406+0000 7f6a1d559700 1 -- 172.21.15.146:0/3127189605 >> 172.21.15.146:0/3127189605 conn(0x7f6a180a6610 msgr2=0x7f6a1811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.406+0000 7f6a1d559700 1 -- 172.21.15.146:0/3127189605 shutdown_connections 2023-10-03T10:15:44.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.406+0000 7f6a1d559700 1 -- 172.21.15.146:0/3127189605 wait complete. 2023-10-03T10:15:44.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.417+0000 7fba86e85700 1 -- 172.21.15.146:0/1326710825 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fba8004f2a0 con 0x7fba8009dec0 2023-10-03T10:15:44.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.418+0000 7fba7d7fa700 1 -- 172.21.15.146:0/1326710825 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fba6c003e40 con 0x7fba8009dec0 2023-10-03T10:15:44.418 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:44.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:44.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.420+0000 7fba86e85700 1 -- 172.21.15.146:0/1326710825 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba8009dec0 msgr2=0x7fba8013a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.420+0000 7fba86e85700 1 --2- 172.21.15.146:0/1326710825 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba8009dec0 0x7fba8013a5e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fba6c00c4a0 tx=0x7fba6c00c7b0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.420+0000 7fba86e85700 1 -- 172.21.15.146:0/1326710825 shutdown_connections 2023-10-03T10:15:44.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.420+0000 7fba86e85700 1 --2- 172.21.15.146:0/1326710825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba80136cb0 0x7fba8013ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.420+0000 7fba86e85700 1 --2- 172.21.15.146:0/1326710825 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba8006a770 0x7fba80136090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.420+0000 7fba86e85700 1 --2- 172.21.15.146:0/1326710825 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba8009dec0 0x7fba8013a5e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.420+0000 7fba86e85700 1 -- 172.21.15.146:0/1326710825 >> 172.21.15.146:0/1326710825 conn(0x7fba80099c40 msgr2=0x7fba80130570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.420+0000 7fba86e85700 1 -- 172.21.15.146:0/1326710825 shutdown_connections 2023-10-03T10:15:44.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:44.420+0000 7fba86e85700 1 -- 172.21.15.146:0/1326710825 wait complete. 2023-10-03T10:15:44.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:45.381 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:45.386 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:45.419 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:45.433 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:45.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.526+0000 7f749d31b700 1 Processor -- start 2023-10-03T10:15:45.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.526+0000 7f749d31b700 1 -- start start 2023-10-03T10:15:45.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.526+0000 7f749d31b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f74981346e0 0x7f7498136ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.526+0000 7f749d31b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7498137000 0x7f74981393e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.526+0000 7f749d31b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74980a1640 con 0x7f7498131980 2023-10-03T10:15:45.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.526+0000 7f749d31b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f749806eb30 con 0x7f7498137000 2023-10-03T10:15:45.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.526+0000 7f749d31b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74980a22d0 con 0x7f74981346e0 2023-10-03T10:15:45.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.526+0000 7f74967fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f74981346e0 0x7f7498136ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.527+0000 7f74967fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f74981346e0 0x7f7498136ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43764/0 (socket says 172.21.15.146:43764) 2023-10-03T10:15:45.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.527+0000 7f74967fc700 1 -- 172.21.15.146:0/3443141452 learned_addr learned my addr 172.21.15.146:0/3443141452 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:45.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.527+0000 7f74977fe700 1 --2- 172.21.15.146:0/3443141452 >> v2:172.21.15.146:3300/0 conn(0x7f7498137000 0x7f74981393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.527+0000 7f74967fc700 1 -- 172.21.15.146:0/3443141452 >> v2:172.21.15.146:3300/0 conn(0x7f7498137000 msgr2=0x7f74981393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.527+0000 7f74967fc700 1 --2- 172.21.15.146:0/3443141452 >> v2:172.21.15.146:3300/0 conn(0x7f7498137000 0x7f74981393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.527+0000 7f74967fc700 1 -- 172.21.15.146:0/3443141452 >> v1:172.21.15.146:6789/0 conn(0x7f7498131980 legacy=0x7f7498131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.527+0000 7f74967fc700 1 -- 172.21.15.146:0/3443141452 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7498131550 con 0x7f74981346e0 2023-10-03T10:15:45.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.527+0000 7f74967fc700 1 --2- 172.21.15.146:0/3443141452 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f74981346e0 0x7f7498136ac0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f748c009920 tx=0x7f748c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2120e0a2e674bbc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.527+0000 7f7495ffb700 1 -- 172.21.15.146:0/3443141452 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c011830 con 0x7f74981346e0 2023-10-03T10:15:45.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.527+0000 7f7495ffb700 1 -- 172.21.15.146:0/3443141452 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c011990 con 0x7f74981346e0 2023-10-03T10:15:45.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.527+0000 7f7495ffb700 1 -- 172.21.15.146:0/3443141452 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c011d20 con 0x7f74981346e0 2023-10-03T10:15:45.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.528+0000 7f749d31b700 1 -- 172.21.15.146:0/3443141452 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f74981346e0 msgr2=0x7f7498136ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.528+0000 7f749d31b700 1 --2- 172.21.15.146:0/3443141452 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f74981346e0 0x7f7498136ac0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f748c009920 tx=0x7f748c009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:45.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.528+0000 7f749d31b700 1 -- 172.21.15.146:0/3443141452 shutdown_connections 2023-10-03T10:15:45.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.528+0000 7f749d31b700 1 --2- 172.21.15.146:0/3443141452 >> v2:172.21.15.146:3300/0 conn(0x7f7498137000 0x7f74981393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.528+0000 7f749d31b700 1 --2- 172.21.15.146:0/3443141452 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f74981346e0 0x7f7498136ac0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.528+0000 7f749d31b700 1 -- 172.21.15.146:0/3443141452 >> 172.21.15.146:0/3443141452 conn(0x7f74980a2980 msgr2=0x7f74980a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.528+0000 7f749d31b700 1 -- 172.21.15.146:0/3443141452 shutdown_connections 2023-10-03T10:15:45.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.528+0000 7f749d31b700 1 -- 172.21.15.146:0/3443141452 wait complete. 2023-10-03T10:15:45.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.529+0000 7f749d31b700 1 Processor -- start 2023-10-03T10:15:45.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.529+0000 7f749d31b700 1 -- start start 2023-10-03T10:15:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.530+0000 7f749d31b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7498131980 0x7f7498118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.530+0000 7f749d31b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74981346e0 0x7f7498119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.530+0000 7f749d31b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7498137000 0x7f7498119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.530+0000 7f749d31b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749811b1a0 con 0x7f74981346e0 2023-10-03T10:15:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.530+0000 7f749d31b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749812dd00 con 0x7f7498137000 2023-10-03T10:15:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.530+0000 7f749d31b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74980a1c40 con 0x7f7498131980 2023-10-03T10:15:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.530+0000 7f74967fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74981346e0 0x7f7498119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.530+0000 7f74967fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74981346e0 0x7f7498119330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60270/0 (socket says 172.21.15.146:60270) 2023-10-03T10:15:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.530+0000 7f74967fc700 1 -- 172.21.15.146:0/336493415 learned_addr learned my addr 172.21.15.146:0/336493415 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.530+0000 7f7496ffd700 1 --2- 172.21.15.146:0/336493415 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7498131980 0x7f7498118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.530+0000 7f74967fc700 1 -- 172.21.15.146:0/336493415 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7498131980 msgr2=0x7f7498118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.530+0000 7f74967fc700 1 --2- 172.21.15.146:0/336493415 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7498131980 0x7f7498118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.530+0000 7f74967fc700 1 -- 172.21.15.146:0/336493415 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7498137000 msgr2=0x7f7498119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.530+0000 7f74967fc700 1 --2- 172.21.15.146:0/336493415 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7498137000 0x7f7498119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.530+0000 7f74967fc700 1 -- 172.21.15.146:0/336493415 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c009550 con 0x7f74981346e0 2023-10-03T10:15:45.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.530+0000 7f74967fc700 1 --2- 172.21.15.146:0/336493415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74981346e0 0x7f7498119330 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f748c009870 tx=0x7f748c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.531+0000 7f747f7fe700 1 -- 172.21.15.146:0/336493415 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c004590 con 0x7f74981346e0 2023-10-03T10:15:45.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.531+0000 7f749d31b700 1 -- 172.21.15.146:0/336493415 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7498071ab0 con 0x7f74981346e0 2023-10-03T10:15:45.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.531+0000 7f747f7fe700 1 -- 172.21.15.146:0/336493415 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c0036a0 con 0x7f74981346e0 2023-10-03T10:15:45.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.531+0000 7f747f7fe700 1 -- 172.21.15.146:0/336493415 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c003a50 con 0x7f74981346e0 2023-10-03T10:15:45.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.531+0000 7f749d31b700 1 -- 172.21.15.146:0/336493415 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7498071080 con 0x7f74981346e0 2023-10-03T10:15:45.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.532+0000 7f747f7fe700 1 -- 172.21.15.146:0/336493415 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f748c021070 con 0x7f74981346e0 2023-10-03T10:15:45.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.532+0000 7f747f7fe700 1 -- 172.21.15.146:0/336493415 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f748c0409a0 con 0x7f74981346e0 2023-10-03T10:15:45.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.532+0000 7f749d31b700 1 -- 172.21.15.146:0/336493415 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f749804f2a0 con 0x7f74981346e0 2023-10-03T10:15:45.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.537+0000 7f747f7fe700 1 -- 172.21.15.146:0/336493415 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f748c015080 con 0x7f74981346e0 2023-10-03T10:15:45.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.566+0000 7ff525381700 1 Processor -- start 2023-10-03T10:15:45.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.566+0000 7ff525381700 1 -- start start 2023-10-03T10:15:45.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.566+0000 7ff525381700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff52009e340 0x7ff5201359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.566+0000 7ff525381700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff520135f20 0x7ff520138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.566+0000 7ff525381700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52009aaa0 con 0x7ff52009d860 2023-10-03T10:15:45.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.566+0000 7ff525381700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52009e730 con 0x7ff52009e340 2023-10-03T10:15:45.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.566+0000 7ff525381700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff52009f870 con 0x7ff520135f20 2023-10-03T10:15:45.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.567+0000 7ff51effd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff52009d860 0x7ff52009dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40206/0 (socket says 172.21.15.146:40206) 2023-10-03T10:15:45.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.567+0000 7ff51effd700 1 -- 172.21.15.146:0/1636612449 learned_addr learned my addr 172.21.15.146:0/1636612449 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:45.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.567+0000 7ff51e7fc700 1 --2- 172.21.15.146:0/1636612449 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff52009e340 0x7ff5201359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.567+0000 7ff51dffb700 1 -- 172.21.15.146:0/1636612449 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068095458 0 0) 0x7ff52009aaa0 con 0x7ff52009d860 2023-10-03T10:15:45.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.567+0000 7ff51e7fc700 1 -- 172.21.15.146:0/1636612449 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff520135f20 msgr2=0x7ff520138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.567+0000 7ff51e7fc700 1 --2- 172.21.15.146:0/1636612449 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff520135f20 0x7ff520138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.567+0000 7ff51e7fc700 1 -- 172.21.15.146:0/1636612449 >> v1:172.21.15.146:6789/0 conn(0x7ff52009d860 legacy=0x7ff52009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.567+0000 7ff51e7fc700 1 -- 172.21.15.146:0/1636612449 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52009b360 con 0x7ff52009e340 2023-10-03T10:15:45.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.567+0000 7ff51e7fc700 1 --2- 172.21.15.146:0/1636612449 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff52009e340 0x7ff5201359e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff514009870 tx=0x7ff514009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb2096e044a34b88 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.567+0000 7ff51dffb700 1 -- 172.21.15.146:0/1636612449 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff514011830 con 0x7ff52009e340 2023-10-03T10:15:45.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.568+0000 7ff51dffb700 1 -- 172.21.15.146:0/1636612449 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff514011990 con 0x7ff52009e340 2023-10-03T10:15:45.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.568+0000 7ff51dffb700 1 -- 172.21.15.146:0/1636612449 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff514011d20 con 0x7ff52009e340 2023-10-03T10:15:45.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.568+0000 7ff525381700 1 -- 172.21.15.146:0/1636612449 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff52009e340 msgr2=0x7ff5201359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.568+0000 7ff525381700 1 --2- 172.21.15.146:0/1636612449 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff52009e340 0x7ff5201359e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff514009870 tx=0x7ff514009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:45.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.568+0000 7ff525381700 1 -- 172.21.15.146:0/1636612449 shutdown_connections 2023-10-03T10:15:45.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.568+0000 7ff525381700 1 --2- 172.21.15.146:0/1636612449 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff520135f20 0x7ff520138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.568+0000 7ff525381700 1 --2- 172.21.15.146:0/1636612449 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff52009e340 0x7ff5201359e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.568+0000 7ff525381700 1 -- 172.21.15.146:0/1636612449 >> 172.21.15.146:0/1636612449 conn(0x7ff520099c40 msgr2=0x7ff5200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.568+0000 7ff525381700 1 -- 172.21.15.146:0/1636612449 shutdown_connections 2023-10-03T10:15:45.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.568+0000 7ff525381700 1 -- 172.21.15.146:0/1636612449 wait complete. 2023-10-03T10:15:45.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.569+0000 7ff525381700 1 Processor -- start 2023-10-03T10:15:45.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.569+0000 7ff525381700 1 -- start start 2023-10-03T10:15:45.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.570+0000 7ff525381700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff52009d860 0x7ff52006e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.570+0000 7ff525381700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff52009e340 0x7ff52006ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.570+0000 7ff525381700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff520135f20 0x7ff52006f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.570+0000 7ff525381700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff520122df0 con 0x7ff52009e340 2023-10-03T10:15:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.570+0000 7ff525381700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5200705c0 con 0x7ff520135f20 2023-10-03T10:15:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.570+0000 7ff525381700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5200a23c0 con 0x7ff52009d860 2023-10-03T10:15:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.570+0000 7ff51f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff520135f20 0x7ff52006f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.570+0000 7ff51f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff520135f20 0x7ff52006f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34602/0 (socket says 172.21.15.146:34602) 2023-10-03T10:15:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.570+0000 7ff51f7fe700 1 -- 172.21.15.146:0/3319601980 learned_addr learned my addr 172.21.15.146:0/3319601980 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.570+0000 7ff51effd700 1 --2- 172.21.15.146:0/3319601980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff52009d860 0x7ff52006e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.570+0000 7ff51f7fe700 1 -- 172.21.15.146:0/3319601980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff52009d860 msgr2=0x7ff52006e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.570+0000 7ff51f7fe700 1 --2- 172.21.15.146:0/3319601980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff52009d860 0x7ff52006e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.570+0000 7ff51e7fc700 1 --2- 172.21.15.146:0/3319601980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff52009e340 0x7ff52006ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.570+0000 7ff51f7fe700 1 -- 172.21.15.146:0/3319601980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff52009e340 msgr2=0x7ff52006ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.570+0000 7ff51f7fe700 1 --2- 172.21.15.146:0/3319601980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff52009e340 0x7ff52006ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.570+0000 7ff51f7fe700 1 -- 172.21.15.146:0/3319601980 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5140094a0 con 0x7ff520135f20 2023-10-03T10:15:45.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.570+0000 7ff51e7fc700 1 --2- 172.21.15.146:0/3319601980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff52009e340 0x7ff52006ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:45.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.571+0000 7ff51f7fe700 1 --2- 172.21.15.146:0/3319601980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff520135f20 0x7ff52006f3b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff51800b9a0 tx=0x7ff51800bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.571+0000 7ff5077fe700 1 -- 172.21.15.146:0/3319601980 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51800c930 con 0x7ff520135f20 2023-10-03T10:15:45.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.571+0000 7ff5077fe700 1 -- 172.21.15.146:0/3319601980 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51800cab0 con 0x7ff520135f20 2023-10-03T10:15:45.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.571+0000 7ff525381700 1 -- 172.21.15.146:0/3319601980 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff52009c8b0 con 0x7ff520135f20 2023-10-03T10:15:45.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.571+0000 7ff5077fe700 1 -- 172.21.15.146:0/3319601980 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51800ce60 con 0x7ff520135f20 2023-10-03T10:15:45.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.571+0000 7ff525381700 1 -- 172.21.15.146:0/3319601980 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff520123860 con 0x7ff520135f20 2023-10-03T10:15:45.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.572+0000 7ff5077fe700 1 -- 172.21.15.146:0/3319601980 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff51801d3b0 con 0x7ff520135f20 2023-10-03T10:15:45.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.572+0000 7ff5077fe700 1 -- 172.21.15.146:0/3319601980 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff518006e40 con 0x7ff520135f20 2023-10-03T10:15:45.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.572+0000 7ff525381700 1 -- 172.21.15.146:0/3319601980 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff52004f2a0 con 0x7ff520135f20 2023-10-03T10:15:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.574+0000 7fd1bc82a700 1 Processor -- start 2023-10-03T10:15:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.574+0000 7fd1bc82a700 1 -- start start 2023-10-03T10:15:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.574+0000 7fd1bc82a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1b809e870 0x7fd1b809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.574+0000 7fd1bc82a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd1b809f180 0x7fd1b8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.575+0000 7fd1bc82a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b809c970 con 0x7fd1b8131d70 2023-10-03T10:15:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.575+0000 7fd1bc82a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b80a0920 con 0x7fd1b809f180 2023-10-03T10:15:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.575+0000 7fd1bc82a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b809f9c0 con 0x7fd1b809e870 2023-10-03T10:15:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.575+0000 7fd1b659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1b809e870 0x7fd1b809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.575+0000 7fd1b659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1b809e870 0x7fd1b809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43802/0 (socket says 172.21.15.146:43802) 2023-10-03T10:15:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.575+0000 7fd1b659c700 1 -- 172.21.15.146:0/977084835 learned_addr learned my addr 172.21.15.146:0/977084835 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.575+0000 7fd1b659c700 1 -- 172.21.15.146:0/977084835 >> v2:172.21.15.146:3300/0 conn(0x7fd1b809f180 msgr2=0x7fd1b8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.575+0000 7fd1b659c700 1 --2- 172.21.15.146:0/977084835 >> v2:172.21.15.146:3300/0 conn(0x7fd1b809f180 0x7fd1b8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.575+0000 7fd1b659c700 1 -- 172.21.15.146:0/977084835 >> v1:172.21.15.146:6789/0 conn(0x7fd1b8131d70 legacy=0x7fd1b8138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.575+0000 7fd1b659c700 1 -- 172.21.15.146:0/977084835 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b809bab0 con 0x7fd1b809e870 2023-10-03T10:15:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.575+0000 7fd1b659c700 1 --2- 172.21.15.146:0/977084835 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1b809e870 0x7fd1b809ec40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80098f0 tx=0x7fd1a8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aa0efab2d2a7774 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.575+0000 7fd1b559a700 1 -- 172.21.15.146:0/977084835 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a8004230 con 0x7fd1b809e870 2023-10-03T10:15:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.575+0000 7fd1b559a700 1 -- 172.21.15.146:0/977084835 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a8004390 con 0x7fd1b809e870 2023-10-03T10:15:45.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.575+0000 7fd1b559a700 1 -- 172.21.15.146:0/977084835 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a80036a0 con 0x7fd1b809e870 2023-10-03T10:15:45.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.576+0000 7fd1bc82a700 1 -- 172.21.15.146:0/977084835 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1b809e870 msgr2=0x7fd1b809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.576+0000 7fd1bc82a700 1 --2- 172.21.15.146:0/977084835 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1b809e870 0x7fd1b809ec40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80098f0 tx=0x7fd1a8009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:45.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.576+0000 7fd1bc82a700 1 -- 172.21.15.146:0/977084835 shutdown_connections 2023-10-03T10:15:45.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.576+0000 7fd1bc82a700 1 --2- 172.21.15.146:0/977084835 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1b809e870 0x7fd1b809ec40 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.576+0000 7fd1bc82a700 1 --2- 172.21.15.146:0/977084835 >> v2:172.21.15.146:3300/0 conn(0x7fd1b809f180 0x7fd1b8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.576+0000 7fd1bc82a700 1 -- 172.21.15.146:0/977084835 >> 172.21.15.146:0/977084835 conn(0x7fd1b80a4430 msgr2=0x7fd1b80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.576+0000 7fd1bc82a700 1 -- 172.21.15.146:0/977084835 shutdown_connections 2023-10-03T10:15:45.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.576+0000 7fd1bc82a700 1 -- 172.21.15.146:0/977084835 wait complete. 2023-10-03T10:15:45.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.577+0000 7fd1bc82a700 1 Processor -- start 2023-10-03T10:15:45.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.577+0000 7fd1bc82a700 1 -- start start 2023-10-03T10:15:45.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.578+0000 7fd1bc82a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1b809e870 0x7fd1b811e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.578+0000 7fd1bc82a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1b809f180 0x7fd1b811e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.578+0000 7fd1bc82a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1b8131d70 0x7fd1b811eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.578+0000 7fd1bc82a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b811fcb0 con 0x7fd1b809f180 2023-10-03T10:15:45.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.578+0000 7fd1bc82a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b81202d0 con 0x7fd1b809e870 2023-10-03T10:15:45.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.578+0000 7fd1bc82a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b8120f00 con 0x7fd1b8131d70 2023-10-03T10:15:45.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.578+0000 7fd1b659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1b809e870 0x7fd1b811e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.578+0000 7fd1b6d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1b8131d70 0x7fd1b811eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.578+0000 7fd1b659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1b809e870 0x7fd1b811e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34606/0 (socket says 172.21.15.146:34606) 2023-10-03T10:15:45.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.578+0000 7fd1b659c700 1 -- 172.21.15.146:0/3783024341 learned_addr learned my addr 172.21.15.146:0/3783024341 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:45.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.578+0000 7fd1b5d9b700 1 --2- 172.21.15.146:0/3783024341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1b809f180 0x7fd1b811e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.578+0000 7fd1b659c700 1 -- 172.21.15.146:0/3783024341 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1b8131d70 msgr2=0x7fd1b811eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.578+0000 7fd1b659c700 1 --2- 172.21.15.146:0/3783024341 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1b8131d70 0x7fd1b811eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.578+0000 7fd1b659c700 1 -- 172.21.15.146:0/3783024341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1b809f180 msgr2=0x7fd1b811e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.578+0000 7fd1b659c700 1 --2- 172.21.15.146:0/3783024341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1b809f180 0x7fd1b811e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.578+0000 7fd1b659c700 1 -- 172.21.15.146:0/3783024341 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a8009550 con 0x7fd1b809e870 2023-10-03T10:15:45.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.578+0000 7fd1b6d9d700 1 --2- 172.21.15.146:0/3783024341 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1b8131d70 0x7fd1b811eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.578+0000 7fd1b659c700 1 --2- 172.21.15.146:0/3783024341 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1b809e870 0x7fd1b811e0a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8009130 tx=0x7fd1a8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.581+0000 7fd1a6ffd700 1 -- 172.21.15.146:0/3783024341 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a8003dc0 con 0x7fd1b809e870 2023-10-03T10:15:45.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.581+0000 7fd1a6ffd700 1 -- 172.21.15.146:0/3783024341 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a801f070 con 0x7fd1b809e870 2023-10-03T10:15:45.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.581+0000 7fd1a6ffd700 1 -- 172.21.15.146:0/3783024341 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a800b8a0 con 0x7fd1b809e870 2023-10-03T10:15:45.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.582+0000 7ff5077fe700 1 -- 172.21.15.146:0/3319601980 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff518019020 con 0x7ff520135f20 2023-10-03T10:15:45.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.582+0000 7fd1bc82a700 1 -- 172.21.15.146:0/3783024341 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b81218e0 con 0x7fd1b809e870 2023-10-03T10:15:45.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.582+0000 7fd1bc82a700 1 -- 172.21.15.146:0/3783024341 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b809dba0 con 0x7fd1b809e870 2023-10-03T10:15:45.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.583+0000 7fd1a6ffd700 1 -- 172.21.15.146:0/3783024341 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd1a8021030 con 0x7fd1b809e870 2023-10-03T10:15:45.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.584+0000 7fd1a6ffd700 1 -- 172.21.15.146:0/3783024341 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd1a8040e10 con 0x7fd1b809e870 2023-10-03T10:15:45.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.584+0000 7fd1bc82a700 1 -- 172.21.15.146:0/3783024341 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b809f5b0 con 0x7fd1b809e870 2023-10-03T10:15:45.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.593+0000 7fd1a6ffd700 1 -- 172.21.15.146:0/3783024341 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1b809f5b0 con 0x7fd1b809e870 2023-10-03T10:15:45.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.608+0000 7fab4eec6700 1 Processor -- start 2023-10-03T10:15:45.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.608+0000 7fab4eec6700 1 -- start start 2023-10-03T10:15:45.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.609+0000 7fab4eec6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab4809e340 0x7fab481359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.609+0000 7fab4eec6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab48135f20 0x7fab48138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.609+0000 7fab4eec6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4809aaa0 con 0x7fab4809d860 2023-10-03T10:15:45.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.609+0000 7fab4eec6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4809e730 con 0x7fab4809e340 2023-10-03T10:15:45.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.609+0000 7fab4eec6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab4809f870 con 0x7fab48135f20 2023-10-03T10:15:45.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.609+0000 7fab47fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab4809e340 0x7fab481359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.609+0000 7fab47fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab4809e340 0x7fab481359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34622/0 (socket says 172.21.15.146:34622) 2023-10-03T10:15:45.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.609+0000 7fab47fff700 1 -- 172.21.15.146:0/2817985110 learned_addr learned my addr 172.21.15.146:0/2817985110 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:45.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.609+0000 7fab4cc62700 1 --1- 172.21.15.146:0/2817985110 >> v1:172.21.15.146:6789/0 conn(0x7fab4809d860 0x7fab4809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40226/0 (socket says 172.21.15.146:40226) 2023-10-03T10:15:45.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.609+0000 7fab4d463700 1 --2- 172.21.15.146:0/2817985110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab48135f20 0x7fab48138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.609+0000 7fab47fff700 1 -- 172.21.15.146:0/2817985110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab48135f20 msgr2=0x7fab48138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.609+0000 7fab47fff700 1 --2- 172.21.15.146:0/2817985110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab48135f20 0x7fab48138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.609+0000 7fab47fff700 1 -- 172.21.15.146:0/2817985110 >> v1:172.21.15.146:6789/0 conn(0x7fab4809d860 legacy=0x7fab4809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.609+0000 7fab477fe700 1 -- 172.21.15.146:0/2817985110 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345082791 0 0) 0x7fab4809aaa0 con 0x7fab4809d860 2023-10-03T10:15:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.609+0000 7fab47fff700 1 -- 172.21.15.146:0/2817985110 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4809b360 con 0x7fab4809e340 2023-10-03T10:15:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.610+0000 7fab47fff700 1 --2- 172.21.15.146:0/2817985110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab4809e340 0x7fab481359e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fab34009920 tx=0x7fab34009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b43ef0304f1ed13 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.610+0000 7fab477fe700 1 -- 172.21.15.146:0/2817985110 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34011830 con 0x7fab4809e340 2023-10-03T10:15:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.610+0000 7fab477fe700 1 -- 172.21.15.146:0/2817985110 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab34011990 con 0x7fab4809e340 2023-10-03T10:15:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.610+0000 7fab477fe700 1 -- 172.21.15.146:0/2817985110 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34011d20 con 0x7fab4809e340 2023-10-03T10:15:45.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.611+0000 7fab4eec6700 1 -- 172.21.15.146:0/2817985110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab4809e340 msgr2=0x7fab481359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.611+0000 7fab4eec6700 1 --2- 172.21.15.146:0/2817985110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab4809e340 0x7fab481359e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fab34009920 tx=0x7fab34009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:45.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.611+0000 7fab4eec6700 1 -- 172.21.15.146:0/2817985110 shutdown_connections 2023-10-03T10:15:45.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.611+0000 7fab4eec6700 1 --2- 172.21.15.146:0/2817985110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab48135f20 0x7fab48138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.611+0000 7fab4eec6700 1 --2- 172.21.15.146:0/2817985110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab4809e340 0x7fab481359e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.611+0000 7fab4eec6700 1 -- 172.21.15.146:0/2817985110 >> 172.21.15.146:0/2817985110 conn(0x7fab48099c40 msgr2=0x7fab480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.611+0000 7fab4eec6700 1 -- 172.21.15.146:0/2817985110 shutdown_connections 2023-10-03T10:15:45.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.611+0000 7fab4eec6700 1 -- 172.21.15.146:0/2817985110 wait complete. 2023-10-03T10:15:45.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.612+0000 7fab4eec6700 1 Processor -- start 2023-10-03T10:15:45.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.612+0000 7fab4eec6700 1 -- start start 2023-10-03T10:15:45.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.613+0000 7fab4eec6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab4809d860 0x7fab48132770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.613+0000 7fab4eec6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab4809e340 0x7fab48132cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.613+0000 7fab4eec6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab48135f20 0x7fab481331f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.613+0000 7fab4eec6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab48135a70 con 0x7fab4809d860 2023-10-03T10:15:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.613+0000 7fab4eec6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab48135540 con 0x7fab48135f20 2023-10-03T10:15:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.613+0000 7fab4eec6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab48134390 con 0x7fab4809e340 2023-10-03T10:15:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.613+0000 7fab47fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab4809e340 0x7fab48132cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.613+0000 7fab47fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab4809e340 0x7fab48132cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43830/0 (socket says 172.21.15.146:43830) 2023-10-03T10:15:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.613+0000 7fab47fff700 1 -- 172.21.15.146:0/3062962221 learned_addr learned my addr 172.21.15.146:0/3062962221 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.613+0000 7fab4d463700 1 --2- 172.21.15.146:0/3062962221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab48135f20 0x7fab481331f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.613+0000 7fab4cc62700 1 --2- 172.21.15.146:0/3062962221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab4809d860 0x7fab48132770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.614+0000 7fab47fff700 1 -- 172.21.15.146:0/3062962221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab48135f20 msgr2=0x7fab481331f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.614+0000 7fab47fff700 1 --2- 172.21.15.146:0/3062962221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab48135f20 0x7fab481331f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.614+0000 7fab47fff700 1 -- 172.21.15.146:0/3062962221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab4809d860 msgr2=0x7fab48132770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.614+0000 7fab47fff700 1 --2- 172.21.15.146:0/3062962221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab4809d860 0x7fab48132770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.614+0000 7fab47fff700 1 -- 172.21.15.146:0/3062962221 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab34009550 con 0x7fab4809e340 2023-10-03T10:15:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.614+0000 7fab4d463700 1 --2- 172.21.15.146:0/3062962221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab48135f20 0x7fab481331f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.614+0000 7fab47fff700 1 --2- 172.21.15.146:0/3062962221 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab4809e340 0x7fab48132cb0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fab34009c70 tx=0x7fab34004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.614+0000 7fab457fa700 1 -- 172.21.15.146:0/3062962221 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34004240 con 0x7fab4809e340 2023-10-03T10:15:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.614+0000 7fab457fa700 1 -- 172.21.15.146:0/3062962221 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3401f070 con 0x7fab4809e340 2023-10-03T10:15:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.614+0000 7fab457fa700 1 -- 172.21.15.146:0/3062962221 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340045a0 con 0x7fab4809e340 2023-10-03T10:15:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.614+0000 7fab4eec6700 1 -- 172.21.15.146:0/3062962221 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab48119630 con 0x7fab4809e340 2023-10-03T10:15:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.614+0000 7fab4eec6700 1 -- 172.21.15.146:0/3062962221 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4809c8b0 con 0x7fab4809e340 2023-10-03T10:15:45.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.615+0000 7fab457fa700 1 -- 172.21.15.146:0/3062962221 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab34021030 con 0x7fab4809e340 2023-10-03T10:15:45.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.615+0000 7fab4eec6700 1 -- 172.21.15.146:0/3062962221 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4804f2a0 con 0x7fab4809e340 2023-10-03T10:15:45.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.615+0000 7fab457fa700 1 -- 172.21.15.146:0/3062962221 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fab34040a00 con 0x7fab4809e340 2023-10-03T10:15:45.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.624+0000 7fab457fa700 1 -- 172.21.15.146:0/3062962221 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab34003e00 con 0x7fab4809e340 2023-10-03T10:15:45.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.756+0000 7f749d31b700 1 -- 172.21.15.146:0/336493415 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f74980a1020 con 0x7f74981346e0 2023-10-03T10:15:45.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.756+0000 7f747f7fe700 1 -- 172.21.15.146:0/336493415 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f748c029020 con 0x7f74981346e0 2023-10-03T10:15:45.756 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:45.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.759+0000 7f749d31b700 1 -- 172.21.15.146:0/336493415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74981346e0 msgr2=0x7f7498119330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.759+0000 7f749d31b700 1 --2- 172.21.15.146:0/336493415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74981346e0 0x7f7498119330 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f748c009870 tx=0x7f748c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:45.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.759+0000 7f749d31b700 1 -- 172.21.15.146:0/336493415 shutdown_connections 2023-10-03T10:15:45.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.760+0000 7f749d31b700 1 --2- 172.21.15.146:0/336493415 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7498137000 0x7f7498119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.760+0000 7f749d31b700 1 --2- 172.21.15.146:0/336493415 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7498131980 0x7f7498118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.760+0000 7f749d31b700 1 --2- 172.21.15.146:0/336493415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74981346e0 0x7f7498119330 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.760+0000 7f749d31b700 1 -- 172.21.15.146:0/336493415 >> 172.21.15.146:0/336493415 conn(0x7f74980a2980 msgr2=0x7f749812e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.760+0000 7f749d31b700 1 -- 172.21.15.146:0/336493415 shutdown_connections 2023-10-03T10:15:45.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.760+0000 7f749d31b700 1 -- 172.21.15.146:0/336493415 wait complete. 2023-10-03T10:15:45.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:45.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.787+0000 7ff525381700 1 -- 172.21.15.146:0/3319601980 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff52006c3b0 con 0x7ff520135f20 2023-10-03T10:15:45.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.787+0000 7ff5077fe700 1 -- 172.21.15.146:0/3319601980 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff518007370 con 0x7ff520135f20 2023-10-03T10:15:45.787 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:45.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.789+0000 7ff525381700 1 -- 172.21.15.146:0/3319601980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff520135f20 msgr2=0x7ff52006f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.790+0000 7ff525381700 1 --2- 172.21.15.146:0/3319601980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff520135f20 0x7ff52006f3b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff51800b9a0 tx=0x7ff51800bcb0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.790+0000 7ff525381700 1 -- 172.21.15.146:0/3319601980 shutdown_connections 2023-10-03T10:15:45.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.790+0000 7ff525381700 1 --2- 172.21.15.146:0/3319601980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff520135f20 0x7ff52006f3b0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.790+0000 7ff525381700 1 --2- 172.21.15.146:0/3319601980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff52009d860 0x7ff52006e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.790+0000 7ff525381700 1 --2- 172.21.15.146:0/3319601980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff52009e340 0x7ff52006ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.790+0000 7ff525381700 1 -- 172.21.15.146:0/3319601980 >> 172.21.15.146:0/3319601980 conn(0x7ff520099c40 msgr2=0x7ff520134c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.790+0000 7ff525381700 1 -- 172.21.15.146:0/3319601980 shutdown_connections 2023-10-03T10:15:45.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.790+0000 7ff525381700 1 -- 172.21.15.146:0/3319601980 wait complete. 2023-10-03T10:15:45.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.792+0000 7fd1bc82a700 1 -- 172.21.15.146:0/3783024341 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd1b809f5b0 con 0x7fd1b809e870 2023-10-03T10:15:45.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.792+0000 7fd1a6ffd700 1 -- 172.21.15.146:0/3783024341 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd1b809f5b0 con 0x7fd1b809e870 2023-10-03T10:15:45.792 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:45.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.795+0000 7fd1bc82a700 1 -- 172.21.15.146:0/3783024341 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1b809e870 msgr2=0x7fd1b811e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.795+0000 7fd1bc82a700 1 --2- 172.21.15.146:0/3783024341 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1b809e870 0x7fd1b811e0a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8009130 tx=0x7fd1a8004750 comp rx=0 tx=0).stop 2023-10-03T10:15:45.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.795+0000 7fd1bc82a700 1 -- 172.21.15.146:0/3783024341 shutdown_connections 2023-10-03T10:15:45.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.795+0000 7fd1bc82a700 1 --2- 172.21.15.146:0/3783024341 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1b8131d70 0x7fd1b811eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.795+0000 7fd1bc82a700 1 --2- 172.21.15.146:0/3783024341 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1b809e870 0x7fd1b811e0a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.795+0000 7fd1bc82a700 1 --2- 172.21.15.146:0/3783024341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1b809f180 0x7fd1b811e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.795+0000 7fd1bc82a700 1 -- 172.21.15.146:0/3783024341 >> 172.21.15.146:0/3783024341 conn(0x7fd1b80a4430 msgr2=0x7fd1b806d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.797+0000 7fd1bc82a700 1 -- 172.21.15.146:0/3783024341 shutdown_connections 2023-10-03T10:15:45.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.797+0000 7fd1bc82a700 1 -- 172.21.15.146:0/3783024341 wait complete. 2023-10-03T10:15:45.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:45.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:45.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.818+0000 7fab4eec6700 1 -- 172.21.15.146:0/3062962221 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fab48119970 con 0x7fab4809e340 2023-10-03T10:15:45.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.819+0000 7fab457fa700 1 -- 172.21.15.146:0/3062962221 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fab34015020 con 0x7fab4809e340 2023-10-03T10:15:45.818 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.821+0000 7fab4eec6700 1 -- 172.21.15.146:0/3062962221 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab4809e340 msgr2=0x7fab48132cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.821+0000 7fab4eec6700 1 --2- 172.21.15.146:0/3062962221 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab4809e340 0x7fab48132cb0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fab34009c70 tx=0x7fab34004750 comp rx=0 tx=0).stop 2023-10-03T10:15:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.821+0000 7fab4eec6700 1 -- 172.21.15.146:0/3062962221 shutdown_connections 2023-10-03T10:15:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.821+0000 7fab4eec6700 1 --2- 172.21.15.146:0/3062962221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab48135f20 0x7fab481331f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.821+0000 7fab4eec6700 1 --2- 172.21.15.146:0/3062962221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab4809d860 0x7fab48132770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.821+0000 7fab4eec6700 1 --2- 172.21.15.146:0/3062962221 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab4809e340 0x7fab48132cb0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.821+0000 7fab4eec6700 1 -- 172.21.15.146:0/3062962221 >> 172.21.15.146:0/3062962221 conn(0x7fab48099c40 msgr2=0x7fab480a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.821+0000 7fab4eec6700 1 -- 172.21.15.146:0/3062962221 shutdown_connections 2023-10-03T10:15:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:45.821+0000 7fab4eec6700 1 -- 172.21.15.146:0/3062962221 wait complete. 2023-10-03T10:15:45.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:46.777 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:46.803 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:46.809 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:46.834 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:46.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.923+0000 7efdb8162700 1 Processor -- start 2023-10-03T10:15:46.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.923+0000 7efdb8162700 1 -- start start 2023-10-03T10:15:46.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.924+0000 7efdb8162700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efdb009d860 0x7efdb009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.924+0000 7efdb8162700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efdb0130eb0 0x7efdb0138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.924+0000 7efdb8162700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb009aaa0 con 0x7efdb009e170 2023-10-03T10:15:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.924+0000 7efdb8162700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb009f870 con 0x7efdb009d860 2023-10-03T10:15:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.924+0000 7efdb8162700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdb009b360 con 0x7efdb0130eb0 2023-10-03T10:15:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.924+0000 7efdb56fd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7efdb009e170 0x7efdb01307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40242/0 (socket says 172.21.15.146:40242) 2023-10-03T10:15:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.924+0000 7efdb56fd700 1 -- 172.21.15.146:0/1372153607 learned_addr learned my addr 172.21.15.146:0/1372153607 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.924+0000 7efdb66ff700 1 --2- 172.21.15.146:0/1372153607 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efdb0130eb0 0x7efdb0138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.924+0000 7efdb5efe700 1 --2- 172.21.15.146:0/1372153607 >> v2:172.21.15.146:3300/0 conn(0x7efdb009d860 0x7efdb009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.925+0000 7efdb4efc700 1 -- 172.21.15.146:0/1372153607 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699167166 0 0) 0x7efdb009aaa0 con 0x7efdb009e170 2023-10-03T10:15:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.925+0000 7efdb66ff700 1 -- 172.21.15.146:0/1372153607 >> v2:172.21.15.146:3300/0 conn(0x7efdb009d860 msgr2=0x7efdb009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.925+0000 7efdb66ff700 1 --2- 172.21.15.146:0/1372153607 >> v2:172.21.15.146:3300/0 conn(0x7efdb009d860 0x7efdb009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.925+0000 7efdb66ff700 1 -- 172.21.15.146:0/1372153607 >> v1:172.21.15.146:6789/0 conn(0x7efdb009e170 legacy=0x7efdb01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.925+0000 7efdb66ff700 1 -- 172.21.15.146:0/1372153607 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb009b620 con 0x7efdb0130eb0 2023-10-03T10:15:46.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.925+0000 7efdb66ff700 1 --2- 172.21.15.146:0/1372153607 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efdb0130eb0 0x7efdb0138a00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7efda8009d90 tx=0x7efda800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9ad92fa5e656726 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.925+0000 7efdb4efc700 1 -- 172.21.15.146:0/1372153607 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda800e070 con 0x7efdb0130eb0 2023-10-03T10:15:46.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.925+0000 7efdb4efc700 1 -- 172.21.15.146:0/1372153607 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda800bb20 con 0x7efdb0130eb0 2023-10-03T10:15:46.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.925+0000 7efdb4efc700 1 -- 172.21.15.146:0/1372153607 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda8012430 con 0x7efdb0130eb0 2023-10-03T10:15:46.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.926+0000 7efdb8162700 1 -- 172.21.15.146:0/1372153607 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efdb0130eb0 msgr2=0x7efdb0138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.926+0000 7efdb8162700 1 --2- 172.21.15.146:0/1372153607 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efdb0130eb0 0x7efdb0138a00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7efda8009d90 tx=0x7efda800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:46.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.926+0000 7efdb8162700 1 -- 172.21.15.146:0/1372153607 shutdown_connections 2023-10-03T10:15:46.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.926+0000 7efdb8162700 1 --2- 172.21.15.146:0/1372153607 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efdb0130eb0 0x7efdb0138a00 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.926+0000 7efdb8162700 1 --2- 172.21.15.146:0/1372153607 >> v2:172.21.15.146:3300/0 conn(0x7efdb009d860 0x7efdb009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.926+0000 7efdb8162700 1 -- 172.21.15.146:0/1372153607 >> 172.21.15.146:0/1372153607 conn(0x7efdb0099c40 msgr2=0x7efdb00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.926+0000 7efdb8162700 1 -- 172.21.15.146:0/1372153607 shutdown_connections 2023-10-03T10:15:46.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.926+0000 7efdb8162700 1 -- 172.21.15.146:0/1372153607 wait complete. 2023-10-03T10:15:46.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.927+0000 7efdb8162700 1 Processor -- start 2023-10-03T10:15:46.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.927+0000 7efdb8162700 1 -- start start 2023-10-03T10:15:46.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.927+0000 7efdb8162700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdb009d860 0x7efdb0120470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.927+0000 7efdb8162700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efdb009e170 0x7efdb01209b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.927+0000 7efdb8162700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efdb0130eb0 0x7efdb0120ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.927+0000 7efdb8162700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb0123810 con 0x7efdb009d860 2023-10-03T10:15:46.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.927+0000 7efdb8162700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb01239f0 con 0x7efdb0130eb0 2023-10-03T10:15:46.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.927+0000 7efdb8162700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdb00a20c0 con 0x7efdb009e170 2023-10-03T10:15:46.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.928+0000 7efdb5efe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdb009d860 0x7efdb0120470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.928+0000 7efdb5efe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdb009d860 0x7efdb0120470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60328/0 (socket says 172.21.15.146:60328) 2023-10-03T10:15:46.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.928+0000 7efdb5efe700 1 -- 172.21.15.146:0/1063955347 learned_addr learned my addr 172.21.15.146:0/1063955347 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:46.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.928+0000 7efdb66ff700 1 --2- 172.21.15.146:0/1063955347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efdb0130eb0 0x7efdb0120ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.928+0000 7efdb56fd700 1 --2- 172.21.15.146:0/1063955347 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efdb009e170 0x7efdb01209b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.928+0000 7efdb66ff700 1 -- 172.21.15.146:0/1063955347 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efdb009e170 msgr2=0x7efdb01209b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.928+0000 7efdb66ff700 1 --2- 172.21.15.146:0/1063955347 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efdb009e170 0x7efdb01209b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.928+0000 7efdb66ff700 1 -- 172.21.15.146:0/1063955347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdb009d860 msgr2=0x7efdb0120470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.928+0000 7efdb66ff700 1 --2- 172.21.15.146:0/1063955347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdb009d860 0x7efdb0120470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.928+0000 7efdb66ff700 1 -- 172.21.15.146:0/1063955347 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda8009a70 con 0x7efdb0130eb0 2023-10-03T10:15:46.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.928+0000 7efdb66ff700 1 --2- 172.21.15.146:0/1063955347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efdb0130eb0 0x7efdb0120ef0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7efda8016000 tx=0x7efda8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.928+0000 7efda67fc700 1 -- 172.21.15.146:0/1063955347 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda8012430 con 0x7efdb0130eb0 2023-10-03T10:15:46.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.928+0000 7efda67fc700 1 -- 172.21.15.146:0/1063955347 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda8020070 con 0x7efdb0130eb0 2023-10-03T10:15:46.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.928+0000 7efda67fc700 1 -- 172.21.15.146:0/1063955347 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda8004280 con 0x7efdb0130eb0 2023-10-03T10:15:46.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.928+0000 7efdb8162700 1 -- 172.21.15.146:0/1063955347 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb0123f90 con 0x7efdb0130eb0 2023-10-03T10:15:46.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.929+0000 7efdb8162700 1 -- 172.21.15.146:0/1063955347 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb0123cb0 con 0x7efdb0130eb0 2023-10-03T10:15:46.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.929+0000 7efda67fc700 1 -- 172.21.15.146:0/1063955347 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efda80043e0 con 0x7efdb0130eb0 2023-10-03T10:15:46.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.930+0000 7efda67fc700 1 -- 172.21.15.146:0/1063955347 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efda8022070 con 0x7efdb0130eb0 2023-10-03T10:15:46.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.930+0000 7efdb8162700 1 -- 172.21.15.146:0/1063955347 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb01303b0 con 0x7efdb0130eb0 2023-10-03T10:15:46.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.935+0000 7efda67fc700 1 -- 172.21.15.146:0/1063955347 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efda801a970 con 0x7efdb0130eb0 2023-10-03T10:15:46.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.963+0000 7f433d78f700 1 Processor -- start 2023-10-03T10:15:46.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.963+0000 7f433d78f700 1 -- start start 2023-10-03T10:15:46.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.963+0000 7f433d78f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f433806a770 0x7f43381349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.963+0000 7f433d78f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4338134f00 0x7f433809d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.963+0000 7f433d78f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f433809dea0 0x7f433809e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.963+0000 7f433d78f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433806b2e0 con 0x7f433806a770 2023-10-03T10:15:46.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.963+0000 7f433d78f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433809eca0 con 0x7f433809dea0 2023-10-03T10:15:46.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.963+0000 7f433d78f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f433809f720 con 0x7f4338134f00 2023-10-03T10:15:46.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.963+0000 7f4336ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f433806a770 0x7f43381349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.963+0000 7f4336ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f433806a770 0x7f43381349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60342/0 (socket says 172.21.15.146:60342) 2023-10-03T10:15:46.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.963+0000 7f4336ffd700 1 -- 172.21.15.146:0/2612181322 learned_addr learned my addr 172.21.15.146:0/2612181322 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.963+0000 7f43377fe700 1 --2- 172.21.15.146:0/2612181322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f433809dea0 0x7f433809e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.964+0000 7f4336ffd700 1 -- 172.21.15.146:0/2612181322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4338134f00 msgr2=0x7f433809d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.964+0000 7f43367fc700 1 --2- 172.21.15.146:0/2612181322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4338134f00 0x7f433809d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.964+0000 7f4336ffd700 1 --2- 172.21.15.146:0/2612181322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4338134f00 0x7f433809d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.964+0000 7f4336ffd700 1 -- 172.21.15.146:0/2612181322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f433809dea0 msgr2=0x7f433809e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.964+0000 7f4336ffd700 1 --2- 172.21.15.146:0/2612181322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f433809dea0 0x7f433809e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.964+0000 7f4336ffd700 1 -- 172.21.15.146:0/2612181322 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433806b480 con 0x7f433806a770 2023-10-03T10:15:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.964+0000 7f43377fe700 1 --2- 172.21.15.146:0/2612181322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f433809dea0 0x7f433809e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.964+0000 7f43367fc700 1 --2- 172.21.15.146:0/2612181322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4338134f00 0x7f433809d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.964+0000 7f4336ffd700 1 --2- 172.21.15.146:0/2612181322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f433806a770 0x7f43381349c0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f43280098f0 tx=0x7f4328009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f294f49c583e95b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.964+0000 7f4335ffb700 1 -- 172.21.15.146:0/2612181322 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328011830 con 0x7f433806a770 2023-10-03T10:15:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.964+0000 7f4335ffb700 1 -- 172.21.15.146:0/2612181322 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4328011990 con 0x7f433806a770 2023-10-03T10:15:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.964+0000 7f4335ffb700 1 -- 172.21.15.146:0/2612181322 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328011d20 con 0x7f433806a770 2023-10-03T10:15:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.965+0000 7f433d78f700 1 -- 172.21.15.146:0/2612181322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f433806a770 msgr2=0x7f43381349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.965+0000 7f433d78f700 1 --2- 172.21.15.146:0/2612181322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f433806a770 0x7f43381349c0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f43280098f0 tx=0x7f4328009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.965+0000 7f433d78f700 1 -- 172.21.15.146:0/2612181322 shutdown_connections 2023-10-03T10:15:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.965+0000 7f433d78f700 1 --2- 172.21.15.146:0/2612181322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f433809dea0 0x7f433809e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.965+0000 7f433d78f700 1 --2- 172.21.15.146:0/2612181322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f433806a770 0x7f43381349c0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.965+0000 7f433d78f700 1 --2- 172.21.15.146:0/2612181322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4338134f00 0x7f433809d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.965+0000 7f433d78f700 1 -- 172.21.15.146:0/2612181322 >> 172.21.15.146:0/2612181322 conn(0x7f4338099c40 msgr2=0x7f43380a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.965+0000 7f433d78f700 1 -- 172.21.15.146:0/2612181322 shutdown_connections 2023-10-03T10:15:46.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.965+0000 7f433d78f700 1 -- 172.21.15.146:0/2612181322 wait complete. 2023-10-03T10:15:46.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.966+0000 7f433d78f700 1 Processor -- start 2023-10-03T10:15:46.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.966+0000 7f433d78f700 1 -- start start 2023-10-03T10:15:46.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.966+0000 7f433d78f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f433806a770 0x7f4338134150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.966+0000 7f433d78f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f433809dea0 0x7f433811a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.966+0000 7f433d78f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4338134f00 0x7f433811ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.966+0000 7f433d78f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4338139810 con 0x7f4338134f00 2023-10-03T10:15:46.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.966+0000 7f433d78f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433811d590 con 0x7f433809dea0 2023-10-03T10:15:46.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.966+0000 7f433d78f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4338139050 con 0x7f433806a770 2023-10-03T10:15:46.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.967+0000 7f43367fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f433809dea0 0x7f433811a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.967+0000 7f43367fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f433809dea0 0x7f433811a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34656/0 (socket says 172.21.15.146:34656) 2023-10-03T10:15:46.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.967+0000 7f43367fc700 1 -- 172.21.15.146:0/2378505667 learned_addr learned my addr 172.21.15.146:0/2378505667 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:46.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.967+0000 7f43377fe700 1 --2- 172.21.15.146:0/2378505667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4338134f00 0x7f433811ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.967+0000 7f43367fc700 1 -- 172.21.15.146:0/2378505667 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f433806a770 msgr2=0x7f4338134150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.967+0000 7f43367fc700 1 --2- 172.21.15.146:0/2378505667 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f433806a770 0x7f4338134150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.967+0000 7f43367fc700 1 -- 172.21.15.146:0/2378505667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4338134f00 msgr2=0x7f433811ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.967+0000 7f43367fc700 1 --2- 172.21.15.146:0/2378505667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4338134f00 0x7f433811ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.967+0000 7f43367fc700 1 -- 172.21.15.146:0/2378505667 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4330009a70 con 0x7f433809dea0 2023-10-03T10:15:46.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.967+0000 7f43377fe700 1 --2- 172.21.15.146:0/2378505667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4338134f00 0x7f433811ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.967+0000 7f43367fc700 1 --2- 172.21.15.146:0/2378505667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f433809dea0 0x7f433811a8e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f432c00c750 tx=0x7f432c00cb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.967+0000 7f431f7fe700 1 -- 172.21.15.146:0/2378505667 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c011800 con 0x7f433809dea0 2023-10-03T10:15:46.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.967+0000 7f431f7fe700 1 -- 172.21.15.146:0/2378505667 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432c011960 con 0x7f433809dea0 2023-10-03T10:15:46.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.967+0000 7f433d78f700 1 -- 172.21.15.146:0/2378505667 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4328009550 con 0x7f433809dea0 2023-10-03T10:15:46.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.967+0000 7f431f7fe700 1 -- 172.21.15.146:0/2378505667 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c011cd0 con 0x7f433809dea0 2023-10-03T10:15:46.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.967+0000 7f433d78f700 1 -- 172.21.15.146:0/2378505667 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43381392f0 con 0x7f433809dea0 2023-10-03T10:15:46.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.969+0000 7f433d78f700 1 -- 172.21.15.146:0/2378505667 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f433804f2a0 con 0x7f433809dea0 2023-10-03T10:15:46.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.969+0000 7f431f7fe700 1 -- 172.21.15.146:0/2378505667 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f432c021350 con 0x7f433809dea0 2023-10-03T10:15:46.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.969+0000 7f431f7fe700 1 -- 172.21.15.146:0/2378505667 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f432c03f600 con 0x7f433809dea0 2023-10-03T10:15:46.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.971+0000 7fb80f07b700 1 Processor -- start 2023-10-03T10:15:46.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.971+0000 7fb80f07b700 1 -- start start 2023-10-03T10:15:46.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.971+0000 7fb80f07b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb80809d860 0x7fb80809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.971+0000 7fb80f07b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb808130eb0 0x7fb808138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.971+0000 7fb80f07b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb80809aaa0 con 0x7fb80809e170 2023-10-03T10:15:46.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.971+0000 7fb80f07b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80809f870 con 0x7fb80809d860 2023-10-03T10:15:46.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.971+0000 7fb80f07b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb80809b360 con 0x7fb808130eb0 2023-10-03T10:15:46.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.972+0000 7fb80ce17700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb80809d860 0x7fb80809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.972+0000 7fb807fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb80809e170 0x7fb8081307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40252/0 (socket says 172.21.15.146:40252) 2023-10-03T10:15:46.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.972+0000 7fb807fff700 1 -- 172.21.15.146:0/1285872775 learned_addr learned my addr 172.21.15.146:0/1285872775 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:46.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.972+0000 7fb80d618700 1 --2- 172.21.15.146:0/1285872775 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb808130eb0 0x7fb808138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.972+0000 7fb80ce17700 1 -- 172.21.15.146:0/1285872775 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb808130eb0 msgr2=0x7fb808138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:46.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.972+0000 7fb80ce17700 1 --2- 172.21.15.146:0/1285872775 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb808130eb0 0x7fb808138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.972+0000 7fb80ce17700 1 -- 172.21.15.146:0/1285872775 >> v1:172.21.15.146:6789/0 conn(0x7fb80809e170 legacy=0x7fb8081307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.972+0000 7fb80ce17700 1 -- 172.21.15.146:0/1285872775 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80809b620 con 0x7fb80809d860 2023-10-03T10:15:46.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.972+0000 7fb80ce17700 1 --2- 172.21.15.146:0/1285872775 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb80809d860 0x7fb80809dc30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00bb10 tx=0x7fb7fc00be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a035ed2fe8020cc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.978+0000 7fb8077fe700 1 -- 172.21.15.146:0/1285872775 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc00dc70 con 0x7fb80809d860 2023-10-03T10:15:46.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.978+0000 7fb8077fe700 1 -- 172.21.15.146:0/1285872775 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc00ddd0 con 0x7fb80809d860 2023-10-03T10:15:46.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.978+0000 7fb8077fe700 1 -- 172.21.15.146:0/1285872775 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc010690 con 0x7fb80809d860 2023-10-03T10:15:46.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.978+0000 7f431f7fe700 1 -- 172.21.15.146:0/2378505667 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f432c011e30 con 0x7f433809dea0 2023-10-03T10:15:46.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.979+0000 7fb80f07b700 1 -- 172.21.15.146:0/1285872775 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb80809d860 msgr2=0x7fb80809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.979+0000 7fb80f07b700 1 --2- 172.21.15.146:0/1285872775 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb80809d860 0x7fb80809dc30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00bb10 tx=0x7fb7fc00be20 comp rx=0 tx=0).stop 2023-10-03T10:15:46.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.981+0000 7fb80f07b700 1 -- 172.21.15.146:0/1285872775 shutdown_connections 2023-10-03T10:15:46.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.981+0000 7fb80f07b700 1 --2- 172.21.15.146:0/1285872775 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb808130eb0 0x7fb808138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.981+0000 7fb80f07b700 1 --2- 172.21.15.146:0/1285872775 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb80809d860 0x7fb80809dc30 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.981+0000 7fb80f07b700 1 -- 172.21.15.146:0/1285872775 >> 172.21.15.146:0/1285872775 conn(0x7fb808099c40 msgr2=0x7fb8080a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.981+0000 7fb80f07b700 1 -- 172.21.15.146:0/1285872775 shutdown_connections 2023-10-03T10:15:46.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.981+0000 7fb80f07b700 1 -- 172.21.15.146:0/1285872775 wait complete. 2023-10-03T10:15:46.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.982+0000 7fb80f07b700 1 Processor -- start 2023-10-03T10:15:46.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.983+0000 7fb80f07b700 1 -- start start 2023-10-03T10:15:46.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.983+0000 7fb80f07b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb80809d860 0x7fb80811b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.983+0000 7fb80f07b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb80809e170 0x7fb80811bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.983+0000 7fb80f07b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb808130eb0 0x7fb80811bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.983+0000 7fb80f07b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80809c920 con 0x7fb80809e170 2023-10-03T10:15:46.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.983+0000 7fb80f07b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80811d780 con 0x7fb80809d860 2023-10-03T10:15:46.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.983+0000 7fb80f07b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb80809a150 con 0x7fb808130eb0 2023-10-03T10:15:46.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.984+0000 7fb80ce17700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb80809d860 0x7fb80811b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.984+0000 7fb80ce17700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb80809d860 0x7fb80811b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34670/0 (socket says 172.21.15.146:34670) 2023-10-03T10:15:46.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.984+0000 7fb80ce17700 1 -- 172.21.15.146:0/1980118522 learned_addr learned my addr 172.21.15.146:0/1980118522 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:46.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.984+0000 7fb807fff700 1 --2- 172.21.15.146:0/1980118522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb80809e170 0x7fb80811bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.984+0000 7fb80d618700 1 --2- 172.21.15.146:0/1980118522 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb808130eb0 0x7fb80811bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.984+0000 7fb80ce17700 1 -- 172.21.15.146:0/1980118522 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb808130eb0 msgr2=0x7fb80811bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.984+0000 7fb80ce17700 1 --2- 172.21.15.146:0/1980118522 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb808130eb0 0x7fb80811bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.984+0000 7fb80ce17700 1 -- 172.21.15.146:0/1980118522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb80809e170 msgr2=0x7fb80811bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.984+0000 7fb80ce17700 1 --2- 172.21.15.146:0/1980118522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb80809e170 0x7fb80811bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.984+0000 7fb80ce17700 1 -- 172.21.15.146:0/1980118522 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc00b740 con 0x7fb80809d860 2023-10-03T10:15:46.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.984+0000 7fb80ce17700 1 --2- 172.21.15.146:0/1980118522 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb80809d860 0x7fb80811b570 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00bfd0 tx=0x7fb7fc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.984+0000 7fb8057fa700 1 -- 172.21.15.146:0/1980118522 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc003970 con 0x7fb80809d860 2023-10-03T10:15:46.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.985+0000 7fb8057fa700 1 -- 172.21.15.146:0/1980118522 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc003ad0 con 0x7fb80809d860 2023-10-03T10:15:46.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.985+0000 7fb80f07b700 1 -- 172.21.15.146:0/1980118522 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb80811eaf0 con 0x7fb80809d860 2023-10-03T10:15:46.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.985+0000 7fb8057fa700 1 -- 172.21.15.146:0/1980118522 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc003e60 con 0x7fb80809d860 2023-10-03T10:15:46.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.985+0000 7fb80f07b700 1 -- 172.21.15.146:0/1980118522 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb80811d970 con 0x7fb80809d860 2023-10-03T10:15:46.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.985+0000 7fb8057fa700 1 -- 172.21.15.146:0/1980118522 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7fc0214d0 con 0x7fb80809d860 2023-10-03T10:15:46.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.985+0000 7fb8057fa700 1 -- 172.21.15.146:0/1980118522 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb7fc044750 con 0x7fb80809d860 2023-10-03T10:15:46.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.986+0000 7fb80f07b700 1 -- 172.21.15.146:0/1980118522 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80804f2a0 con 0x7fb80809d860 2023-10-03T10:15:46.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:46.995+0000 7fb8057fa700 1 -- 172.21.15.146:0/1980118522 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7fc0178f0 con 0x7fb80809d860 2023-10-03T10:15:47.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.006+0000 7fe733114700 1 Processor -- start 2023-10-03T10:15:47.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.006+0000 7fe733114700 1 -- start start 2023-10-03T10:15:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.006+0000 7fe733114700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe72c133ad0 0x7fe72c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.006+0000 7fe733114700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe72c1300a0 0x7fe72c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.006+0000 7fe733114700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe72c06b2d0 con 0x7fe72c1309f0 2023-10-03T10:15:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.006+0000 7fe733114700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe72c133610 con 0x7fe72c133ad0 2023-10-03T10:15:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.006+0000 7fe733114700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c09a500 con 0x7fe72c1300a0 2023-10-03T10:15:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.006+0000 7fe730eb0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe72c133ad0 0x7fe72c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.006+0000 7fe730eb0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe72c133ad0 0x7fe72c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60378/0 (socket says 172.21.15.146:60378) 2023-10-03T10:15:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.006+0000 7fe730eb0700 1 -- 172.21.15.146:0/971897137 learned_addr learned my addr 172.21.15.146:0/971897137 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.007+0000 7fe72bfff700 1 --2- 172.21.15.146:0/971897137 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe72c1300a0 0x7fe72c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.007+0000 7fe730eb0700 1 -- 172.21.15.146:0/971897137 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe72c1300a0 msgr2=0x7fe72c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:47.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.007+0000 7fe730eb0700 1 --2- 172.21.15.146:0/971897137 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe72c1300a0 0x7fe72c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.007+0000 7fe730eb0700 1 -- 172.21.15.146:0/971897137 >> v1:172.21.15.146:6789/0 conn(0x7fe72c1309f0 legacy=0x7fe72c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.007+0000 7fe730eb0700 1 -- 172.21.15.146:0/971897137 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72c1338b0 con 0x7fe72c133ad0 2023-10-03T10:15:47.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.007+0000 7fe730eb0700 1 --2- 172.21.15.146:0/971897137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe72c133ad0 0x7fe72c133ea0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fe7200098f0 tx=0x7fe720009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38240484a8f17e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:47.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.007+0000 7fe72b7fe700 1 -- 172.21.15.146:0/971897137 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe720011830 con 0x7fe72c133ad0 2023-10-03T10:15:47.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.007+0000 7fe72b7fe700 1 -- 172.21.15.146:0/971897137 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe720011990 con 0x7fe72c133ad0 2023-10-03T10:15:47.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.007+0000 7fe72b7fe700 1 -- 172.21.15.146:0/971897137 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe720011d20 con 0x7fe72c133ad0 2023-10-03T10:15:47.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.008+0000 7fe733114700 1 -- 172.21.15.146:0/971897137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe72c133ad0 msgr2=0x7fe72c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.008+0000 7fe733114700 1 --2- 172.21.15.146:0/971897137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe72c133ad0 0x7fe72c133ea0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fe7200098f0 tx=0x7fe720009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:47.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.008+0000 7fe733114700 1 -- 172.21.15.146:0/971897137 shutdown_connections 2023-10-03T10:15:47.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.008+0000 7fe733114700 1 --2- 172.21.15.146:0/971897137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe72c133ad0 0x7fe72c133ea0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.008+0000 7fe733114700 1 --2- 172.21.15.146:0/971897137 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe72c1300a0 0x7fe72c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.008+0000 7fe733114700 1 -- 172.21.15.146:0/971897137 >> 172.21.15.146:0/971897137 conn(0x7fe72c099c40 msgr2=0x7fe72c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.008+0000 7fe733114700 1 -- 172.21.15.146:0/971897137 shutdown_connections 2023-10-03T10:15:47.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.008+0000 7fe733114700 1 -- 172.21.15.146:0/971897137 wait complete. 2023-10-03T10:15:47.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.009+0000 7fe733114700 1 Processor -- start 2023-10-03T10:15:47.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.009+0000 7fe733114700 1 -- start start 2023-10-03T10:15:47.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.010+0000 7fe733114700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe72c1300a0 0x7fe72c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.010+0000 7fe733114700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe72c1309f0 0x7fe72c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.010+0000 7fe733114700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe72c133ad0 0x7fe72c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.010+0000 7fe733114700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c12d300 con 0x7fe72c1309f0 2023-10-03T10:15:47.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.010+0000 7fe733114700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c11ff40 con 0x7fe72c1300a0 2023-10-03T10:15:47.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.010+0000 7fe733114700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c12fe00 con 0x7fe72c133ad0 2023-10-03T10:15:47.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.010+0000 7fe72bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe72c1309f0 0x7fe72c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.010+0000 7fe730eb0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe72c1300a0 0x7fe72c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.010+0000 7fe7316b1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe72c133ad0 0x7fe72c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.010+0000 7fe72bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe72c1309f0 0x7fe72c11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60382/0 (socket says 172.21.15.146:60382) 2023-10-03T10:15:47.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.010+0000 7fe730eb0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe72c1300a0 0x7fe72c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34686/0 (socket says 172.21.15.146:34686) 2023-10-03T10:15:47.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.010+0000 7fe72bfff700 1 -- 172.21.15.146:0/1642483204 learned_addr learned my addr 172.21.15.146:0/1642483204 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:47.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.011+0000 7fe72bfff700 1 -- 172.21.15.146:0/1642483204 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe72c133ad0 msgr2=0x7fe72c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.011+0000 7fe72bfff700 1 --2- 172.21.15.146:0/1642483204 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe72c133ad0 0x7fe72c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.011+0000 7fe72bfff700 1 -- 172.21.15.146:0/1642483204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe72c1300a0 msgr2=0x7fe72c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.011+0000 7fe72bfff700 1 --2- 172.21.15.146:0/1642483204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe72c1300a0 0x7fe72c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.011+0000 7fe72bfff700 1 -- 172.21.15.146:0/1642483204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe720009550 con 0x7fe72c1309f0 2023-10-03T10:15:47.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.011+0000 7fe730eb0700 1 --2- 172.21.15.146:0/1642483204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe72c1300a0 0x7fe72c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:47.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.011+0000 7fe7316b1700 1 --2- 172.21.15.146:0/1642483204 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe72c133ad0 0x7fe72c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:47.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.011+0000 7fe72bfff700 1 --2- 172.21.15.146:0/1642483204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe72c1309f0 0x7fe72c11df80 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fe71800e870 tx=0x7fe71800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:47.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.011+0000 7fe7297fa700 1 -- 172.21.15.146:0/1642483204 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718009590 con 0x7fe72c1309f0 2023-10-03T10:15:47.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.011+0000 7fe7297fa700 1 -- 172.21.15.146:0/1642483204 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe718013680 con 0x7fe72c1309f0 2023-10-03T10:15:47.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.011+0000 7fe7297fa700 1 -- 172.21.15.146:0/1642483204 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7180139f0 con 0x7fe72c1309f0 2023-10-03T10:15:47.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.012+0000 7fe733114700 1 -- 172.21.15.146:0/1642483204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe72c12dd00 con 0x7fe72c1309f0 2023-10-03T10:15:47.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.012+0000 7fe733114700 1 -- 172.21.15.146:0/1642483204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe72c071980 con 0x7fe72c1309f0 2023-10-03T10:15:47.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.012+0000 7fe7297fa700 1 -- 172.21.15.146:0/1642483204 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe718013b50 con 0x7fe72c1309f0 2023-10-03T10:15:47.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.013+0000 7fe733114700 1 -- 172.21.15.146:0/1642483204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe72c072390 con 0x7fe72c1309f0 2023-10-03T10:15:47.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.013+0000 7fe7297fa700 1 -- 172.21.15.146:0/1642483204 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe71803f6b0 con 0x7fe72c1309f0 2023-10-03T10:15:47.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.022+0000 7fe7297fa700 1 -- 172.21.15.146:0/1642483204 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe718017080 con 0x7fe72c1309f0 2023-10-03T10:15:47.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.156+0000 7efdb8162700 1 -- 172.21.15.146:0/1063955347 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efdb004f2a0 con 0x7efdb0130eb0 2023-10-03T10:15:47.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.156+0000 7efda67fc700 1 -- 172.21.15.146:0/1063955347 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efda802c030 con 0x7efdb0130eb0 2023-10-03T10:15:47.156 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:47.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.158+0000 7efdb8162700 1 -- 172.21.15.146:0/1063955347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efdb0130eb0 msgr2=0x7efdb0120ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.158+0000 7efdb8162700 1 --2- 172.21.15.146:0/1063955347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efdb0130eb0 0x7efdb0120ef0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7efda8016000 tx=0x7efda8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.159+0000 7efdb8162700 1 -- 172.21.15.146:0/1063955347 shutdown_connections 2023-10-03T10:15:47.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.159+0000 7efdb8162700 1 --2- 172.21.15.146:0/1063955347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efdb0130eb0 0x7efdb0120ef0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.159+0000 7efdb8162700 1 --2- 172.21.15.146:0/1063955347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efdb009d860 0x7efdb0120470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.159+0000 7efdb8162700 1 --2- 172.21.15.146:0/1063955347 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efdb009e170 0x7efdb01209b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.159+0000 7efdb8162700 1 -- 172.21.15.146:0/1063955347 >> 172.21.15.146:0/1063955347 conn(0x7efdb0099c40 msgr2=0x7efdb0070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.159+0000 7efdb8162700 1 -- 172.21.15.146:0/1063955347 shutdown_connections 2023-10-03T10:15:47.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.159+0000 7efdb8162700 1 -- 172.21.15.146:0/1063955347 wait complete. 2023-10-03T10:15:47.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:47.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.194+0000 7f433d78f700 1 -- 172.21.15.146:0/2378505667 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f433811cbf0 con 0x7f433809dea0 2023-10-03T10:15:47.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.194+0000 7f431f7fe700 1 -- 172.21.15.146:0/2378505667 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f432c01e030 con 0x7f433809dea0 2023-10-03T10:15:47.194 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:47.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.197+0000 7f433d78f700 1 -- 172.21.15.146:0/2378505667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f433809dea0 msgr2=0x7f433811a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.197+0000 7f433d78f700 1 --2- 172.21.15.146:0/2378505667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f433809dea0 0x7f433811a8e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f432c00c750 tx=0x7f432c00cb10 comp rx=0 tx=0).stop 2023-10-03T10:15:47.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.197+0000 7f433d78f700 1 -- 172.21.15.146:0/2378505667 shutdown_connections 2023-10-03T10:15:47.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.197+0000 7f433d78f700 1 --2- 172.21.15.146:0/2378505667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4338134f00 0x7f433811ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.197+0000 7f433d78f700 1 --2- 172.21.15.146:0/2378505667 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f433806a770 0x7f4338134150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.197+0000 7f433d78f700 1 --2- 172.21.15.146:0/2378505667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f433809dea0 0x7f433811a8e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.197+0000 7f433d78f700 1 -- 172.21.15.146:0/2378505667 >> 172.21.15.146:0/2378505667 conn(0x7f4338099c40 msgr2=0x7f433809c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.197+0000 7f433d78f700 1 -- 172.21.15.146:0/2378505667 shutdown_connections 2023-10-03T10:15:47.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.197+0000 7f433d78f700 1 -- 172.21.15.146:0/2378505667 wait complete. 2023-10-03T10:15:47.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:47.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.210+0000 7fb80f07b700 1 -- 172.21.15.146:0/1980118522 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb8080a23f0 con 0x7fb80809d860 2023-10-03T10:15:47.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.211+0000 7fb8057fa700 1 -- 172.21.15.146:0/1980118522 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb7fc0293c0 con 0x7fb80809d860 2023-10-03T10:15:47.210 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:47.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.213+0000 7fb80f07b700 1 -- 172.21.15.146:0/1980118522 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb80809d860 msgr2=0x7fb80811b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.213+0000 7fb80f07b700 1 --2- 172.21.15.146:0/1980118522 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb80809d860 0x7fb80811b570 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00bfd0 tx=0x7fb7fc004750 comp rx=0 tx=0).stop 2023-10-03T10:15:47.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.213+0000 7fb80f07b700 1 -- 172.21.15.146:0/1980118522 shutdown_connections 2023-10-03T10:15:47.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.213+0000 7fb80f07b700 1 --2- 172.21.15.146:0/1980118522 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb808130eb0 0x7fb80811bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.213+0000 7fb80f07b700 1 --2- 172.21.15.146:0/1980118522 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb80809d860 0x7fb80811b570 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.213+0000 7fb80f07b700 1 --2- 172.21.15.146:0/1980118522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb80809e170 0x7fb80811bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.213+0000 7fb80f07b700 1 -- 172.21.15.146:0/1980118522 >> 172.21.15.146:0/1980118522 conn(0x7fb808099c40 msgr2=0x7fb8081b8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.213+0000 7fb80f07b700 1 -- 172.21.15.146:0/1980118522 shutdown_connections 2023-10-03T10:15:47.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.213+0000 7fb80f07b700 1 -- 172.21.15.146:0/1980118522 wait complete. 2023-10-03T10:15:47.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.216+0000 7fe733114700 1 -- 172.21.15.146:0/1642483204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe72c04f2a0 con 0x7fe72c1309f0 2023-10-03T10:15:47.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.217+0000 7fe7297fa700 1 -- 172.21.15.146:0/1642483204 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe718021030 con 0x7fe72c1309f0 2023-10-03T10:15:47.216 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:47.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.219+0000 7fe733114700 1 -- 172.21.15.146:0/1642483204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe72c1309f0 msgr2=0x7fe72c11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.219+0000 7fe733114700 1 --2- 172.21.15.146:0/1642483204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe72c1309f0 0x7fe72c11df80 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fe71800e870 tx=0x7fe71800eb80 comp rx=0 tx=0).stop 2023-10-03T10:15:47.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.219+0000 7fe733114700 1 -- 172.21.15.146:0/1642483204 shutdown_connections 2023-10-03T10:15:47.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.219+0000 7fe733114700 1 --2- 172.21.15.146:0/1642483204 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe72c133ad0 0x7fe72c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.219+0000 7fe733114700 1 --2- 172.21.15.146:0/1642483204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe72c1300a0 0x7fe72c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.219+0000 7fe733114700 1 --2- 172.21.15.146:0/1642483204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe72c1309f0 0x7fe72c11df80 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.219+0000 7fe733114700 1 -- 172.21.15.146:0/1642483204 >> 172.21.15.146:0/1642483204 conn(0x7fe72c099c40 msgr2=0x7fe72c09d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.219+0000 7fe733114700 1 -- 172.21.15.146:0/1642483204 shutdown_connections 2023-10-03T10:15:47.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:47.219+0000 7fe733114700 1 -- 172.21.15.146:0/1642483204 wait complete. 2023-10-03T10:15:47.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:47.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:48.171 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:48.210 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:48.227 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:48.231 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:48.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.311+0000 7ff8a7a76700 1 Processor -- start 2023-10-03T10:15:48.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.311+0000 7ff8a7a76700 1 -- start start 2023-10-03T10:15:48.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.311+0000 7ff8a7a76700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8a00a0a30 0x7ff8a00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.311+0000 7ff8a7a76700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8a0130670 0x7ff8a01381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.311+0000 7ff8a7a76700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a00a1e70 con 0x7ff8a00a1340 2023-10-03T10:15:48.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.311+0000 7ff8a7a76700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a009a720 con 0x7ff8a0130670 2023-10-03T10:15:48.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.311+0000 7ff8a7a76700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a009b300 con 0x7ff8a00a0a30 2023-10-03T10:15:48.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.312+0000 7ff8a6013700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8a0130670 0x7ff8a01381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.312+0000 7ff8a6013700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8a0130670 0x7ff8a01381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34694/0 (socket says 172.21.15.146:34694) 2023-10-03T10:15:48.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.312+0000 7ff8a6013700 1 -- 172.21.15.146:0/1904835158 learned_addr learned my addr 172.21.15.146:0/1904835158 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:48.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.312+0000 7ff8a5011700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff8a00a1340 0x7ff8a012ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40270/0 (socket says 172.21.15.146:40270) 2023-10-03T10:15:48.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.312+0000 7ff8a5812700 1 --2- 172.21.15.146:0/1904835158 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8a00a0a30 0x7ff8a00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.312+0000 7ff8a6013700 1 -- 172.21.15.146:0/1904835158 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8a00a0a30 msgr2=0x7ff8a00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.312+0000 7ff8a6013700 1 --2- 172.21.15.146:0/1904835158 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8a00a0a30 0x7ff8a00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.312+0000 7ff8a6013700 1 -- 172.21.15.146:0/1904835158 >> v1:172.21.15.146:6789/0 conn(0x7ff8a00a1340 legacy=0x7ff8a012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.312+0000 7ff8a6013700 1 -- 172.21.15.146:0/1904835158 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a009abc0 con 0x7ff8a0130670 2023-10-03T10:15:48.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.312+0000 7ff8a4810700 1 -- 172.21.15.146:0/1904835158 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555906963 0 0) 0x7ff8a00a1e70 con 0x7ff8a00a1340 2023-10-03T10:15:48.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.312+0000 7ff8a5812700 1 --2- 172.21.15.146:0/1904835158 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8a00a0a30 0x7ff8a00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:48.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.312+0000 7ff8a6013700 1 --2- 172.21.15.146:0/1904835158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8a0130670 0x7ff8a01381c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff89800cfc0 tx=0x7ff898007760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2a4ea1ce77af5c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.312+0000 7ff8a4810700 1 -- 172.21.15.146:0/1904835158 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff898011070 con 0x7ff8a0130670 2023-10-03T10:15:48.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.312+0000 7ff8a4810700 1 -- 172.21.15.146:0/1904835158 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff898008120 con 0x7ff8a0130670 2023-10-03T10:15:48.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.312+0000 7ff8a4810700 1 -- 172.21.15.146:0/1904835158 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89800c2f0 con 0x7ff8a0130670 2023-10-03T10:15:48.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.313+0000 7ff8a7a76700 1 -- 172.21.15.146:0/1904835158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8a0130670 msgr2=0x7ff8a01381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.313+0000 7ff8a7a76700 1 --2- 172.21.15.146:0/1904835158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8a0130670 0x7ff8a01381c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff89800cfc0 tx=0x7ff898007760 comp rx=0 tx=0).stop 2023-10-03T10:15:48.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.314+0000 7ff8a7a76700 1 -- 172.21.15.146:0/1904835158 shutdown_connections 2023-10-03T10:15:48.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.314+0000 7ff8a7a76700 1 --2- 172.21.15.146:0/1904835158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8a0130670 0x7ff8a01381c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.314+0000 7ff8a7a76700 1 --2- 172.21.15.146:0/1904835158 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8a00a0a30 0x7ff8a00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.314+0000 7ff8a7a76700 1 -- 172.21.15.146:0/1904835158 >> 172.21.15.146:0/1904835158 conn(0x7ff8a00a2980 msgr2=0x7ff8a00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.314+0000 7ff8a7a76700 1 -- 172.21.15.146:0/1904835158 shutdown_connections 2023-10-03T10:15:48.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.314+0000 7ff8a7a76700 1 -- 172.21.15.146:0/1904835158 wait complete. 2023-10-03T10:15:48.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.315+0000 7ff8a7a76700 1 Processor -- start 2023-10-03T10:15:48.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.315+0000 7ff8a7a76700 1 -- start start 2023-10-03T10:15:48.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.315+0000 7ff8a7a76700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8a00a0a30 0x7ff8a011ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.315+0000 7ff8a7a76700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8a00a1340 0x7ff8a011b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.315+0000 7ff8a7a76700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8a0130670 0x7ff8a011b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.315+0000 7ff8a7a76700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a012fde0 con 0x7ff8a00a0a30 2023-10-03T10:15:48.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.315+0000 7ff8a7a76700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a011cb70 con 0x7ff8a0130670 2023-10-03T10:15:48.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.315+0000 7ff8a7a76700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a011e3d0 con 0x7ff8a00a1340 2023-10-03T10:15:48.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.315+0000 7ff8a6013700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8a0130670 0x7ff8a011b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.315+0000 7ff8a6013700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8a0130670 0x7ff8a011b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34698/0 (socket says 172.21.15.146:34698) 2023-10-03T10:15:48.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.315+0000 7ff8a6013700 1 -- 172.21.15.146:0/2195160061 learned_addr learned my addr 172.21.15.146:0/2195160061 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:48.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.315+0000 7ff8a5812700 1 --2- 172.21.15.146:0/2195160061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8a00a0a30 0x7ff8a011ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.316+0000 7ff8a5011700 1 --2- 172.21.15.146:0/2195160061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8a00a1340 0x7ff8a011b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.316+0000 7ff8a6013700 1 -- 172.21.15.146:0/2195160061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8a00a1340 msgr2=0x7ff8a011b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.316+0000 7ff8a6013700 1 --2- 172.21.15.146:0/2195160061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8a00a1340 0x7ff8a011b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.316+0000 7ff8a6013700 1 -- 172.21.15.146:0/2195160061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8a00a0a30 msgr2=0x7ff8a011ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.316+0000 7ff8a6013700 1 --2- 172.21.15.146:0/2195160061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8a00a0a30 0x7ff8a011ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.316+0000 7ff8a6013700 1 -- 172.21.15.146:0/2195160061 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89800cc70 con 0x7ff8a0130670 2023-10-03T10:15:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.316+0000 7ff8a5812700 1 --2- 172.21.15.146:0/2195160061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8a00a0a30 0x7ff8a011ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.316+0000 7ff8a6013700 1 --2- 172.21.15.146:0/2195160061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8a0130670 0x7ff8a011b8d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff89800cf90 tx=0x7ff898004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.316+0000 7ff8967fc700 1 -- 172.21.15.146:0/2195160061 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff898003c20 con 0x7ff8a0130670 2023-10-03T10:15:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.316+0000 7ff8967fc700 1 -- 172.21.15.146:0/2195160061 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89800c4c0 con 0x7ff8a0130670 2023-10-03T10:15:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.316+0000 7ff8a7a76700 1 -- 172.21.15.146:0/2195160061 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a011e690 con 0x7ff8a0130670 2023-10-03T10:15:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.316+0000 7ff8967fc700 1 -- 172.21.15.146:0/2195160061 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89800caf0 con 0x7ff8a0130670 2023-10-03T10:15:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.316+0000 7ff8a7a76700 1 -- 172.21.15.146:0/2195160061 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a011cfb0 con 0x7ff8a0130670 2023-10-03T10:15:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.317+0000 7ff8a7a76700 1 -- 172.21.15.146:0/2195160061 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a004f2a0 con 0x7ff8a0130670 2023-10-03T10:15:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.317+0000 7ff8967fc700 1 -- 172.21.15.146:0/2195160061 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff898004030 con 0x7ff8a0130670 2023-10-03T10:15:48.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.318+0000 7ff8967fc700 1 -- 172.21.15.146:0/2195160061 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff898042ed0 con 0x7ff8a0130670 2023-10-03T10:15:48.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.322+0000 7ff8967fc700 1 -- 172.21.15.146:0/2195160061 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff89801f970 con 0x7ff8a0130670 2023-10-03T10:15:48.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.352+0000 7ffb6dd3c700 1 Processor -- start 2023-10-03T10:15:48.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.352+0000 7ffb6dd3c700 1 -- start start 2023-10-03T10:15:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.352+0000 7ffb6dd3c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb6809e340 0x7ffb681359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.352+0000 7ffb6dd3c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffb68135f20 0x7ffb68138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.352+0000 7ffb6dd3c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb6809aaa0 con 0x7ffb6809d860 2023-10-03T10:15:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.352+0000 7ffb6dd3c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb6809e730 con 0x7ffb68135f20 2023-10-03T10:15:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.352+0000 7ffb6dd3c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6809f870 con 0x7ffb6809e340 2023-10-03T10:15:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.352+0000 7ffb67fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffb68135f20 0x7ffb68138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.352+0000 7ffb677fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ffb6809d860 0x7ffb6809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40280/0 (socket says 172.21.15.146:40280) 2023-10-03T10:15:48.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.352+0000 7ffb677fe700 1 -- 172.21.15.146:0/1148728976 learned_addr learned my addr 172.21.15.146:0/1148728976 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:48.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.353+0000 7ffb66ffd700 1 --2- 172.21.15.146:0/1148728976 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb6809e340 0x7ffb681359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.353+0000 7ffb67fff700 1 -- 172.21.15.146:0/1148728976 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb6809e340 msgr2=0x7ffb681359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.353+0000 7ffb67fff700 1 --2- 172.21.15.146:0/1148728976 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb6809e340 0x7ffb681359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.353+0000 7ffb67fff700 1 -- 172.21.15.146:0/1148728976 >> v1:172.21.15.146:6789/0 conn(0x7ffb6809d860 legacy=0x7ffb6809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.353+0000 7ffb67fff700 1 -- 172.21.15.146:0/1148728976 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6809b360 con 0x7ffb68135f20 2023-10-03T10:15:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.353+0000 7ffb67fff700 1 --2- 172.21.15.146:0/1148728976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb68135f20 0x7ffb68138300 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ffb6000bfa0 tx=0x7ffb6000d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3109eea1c1fc966e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.353+0000 7ffb667fc700 1 -- 172.21.15.146:0/1148728976 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6000d940 con 0x7ffb68135f20 2023-10-03T10:15:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.353+0000 7ffb667fc700 1 -- 172.21.15.146:0/1148728976 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6000daa0 con 0x7ffb68135f20 2023-10-03T10:15:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.353+0000 7ffb667fc700 1 -- 172.21.15.146:0/1148728976 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6000de30 con 0x7ffb68135f20 2023-10-03T10:15:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.354+0000 7ffb6dd3c700 1 -- 172.21.15.146:0/1148728976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb68135f20 msgr2=0x7ffb68138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.354+0000 7ffb6dd3c700 1 --2- 172.21.15.146:0/1148728976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb68135f20 0x7ffb68138300 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ffb6000bfa0 tx=0x7ffb6000d330 comp rx=0 tx=0).stop 2023-10-03T10:15:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.354+0000 7ffb6dd3c700 1 -- 172.21.15.146:0/1148728976 shutdown_connections 2023-10-03T10:15:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.354+0000 7ffb6dd3c700 1 --2- 172.21.15.146:0/1148728976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb68135f20 0x7ffb68138300 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.354+0000 7ffb6dd3c700 1 --2- 172.21.15.146:0/1148728976 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb6809e340 0x7ffb681359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.354+0000 7ffb6dd3c700 1 -- 172.21.15.146:0/1148728976 >> 172.21.15.146:0/1148728976 conn(0x7ffb68099c40 msgr2=0x7ffb680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.354+0000 7ffb6dd3c700 1 -- 172.21.15.146:0/1148728976 shutdown_connections 2023-10-03T10:15:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.354+0000 7ffb6dd3c700 1 -- 172.21.15.146:0/1148728976 wait complete. 2023-10-03T10:15:48.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.355+0000 7ffb6dd3c700 1 Processor -- start 2023-10-03T10:15:48.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.356+0000 7ffb6dd3c700 1 -- start start 2023-10-03T10:15:48.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.356+0000 7ffb6dd3c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb6809d860 0x7ffb681c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.356+0000 7ffb6dd3c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb6809e340 0x7ffb681c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.356+0000 7ffb6dd3c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb68135f20 0x7ffb68119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.356+0000 7ffb6dd3c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6811b1a0 con 0x7ffb68135f20 2023-10-03T10:15:48.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.356+0000 7ffb6dd3c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb681c4f20 con 0x7ffb6809d860 2023-10-03T10:15:48.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.356+0000 7ffb6dd3c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6809c8b0 con 0x7ffb6809e340 2023-10-03T10:15:48.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.356+0000 7ffb677fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb6809d860 0x7ffb681c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.356+0000 7ffb66ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb6809e340 0x7ffb681c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.356+0000 7ffb677fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb6809d860 0x7ffb681c44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34718/0 (socket says 172.21.15.146:34718) 2023-10-03T10:15:48.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.356+0000 7ffb66ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb6809e340 0x7ffb681c49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43958/0 (socket says 172.21.15.146:43958) 2023-10-03T10:15:48.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.356+0000 7ffb677fe700 1 -- 172.21.15.146:0/3679910910 learned_addr learned my addr 172.21.15.146:0/3679910910 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:48.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.357+0000 7ffb67fff700 1 --2- 172.21.15.146:0/3679910910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb68135f20 0x7ffb68119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.357+0000 7ffb677fe700 1 -- 172.21.15.146:0/3679910910 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb6809e340 msgr2=0x7ffb681c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.357+0000 7ffb677fe700 1 --2- 172.21.15.146:0/3679910910 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb6809e340 0x7ffb681c49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.357+0000 7ffb677fe700 1 -- 172.21.15.146:0/3679910910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb68135f20 msgr2=0x7ffb68119630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.357+0000 7ffb677fe700 1 --2- 172.21.15.146:0/3679910910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb68135f20 0x7ffb68119630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.357+0000 7ffb677fe700 1 -- 172.21.15.146:0/3679910910 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6000bc80 con 0x7ffb6809d860 2023-10-03T10:15:48.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.357+0000 7ffb677fe700 1 --2- 172.21.15.146:0/3679910910 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb6809d860 0x7ffb681c44a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800c520 tx=0x7ffb5800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.357+0000 7ffb4ffff700 1 -- 172.21.15.146:0/3679910910 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb58005d70 con 0x7ffb6809d860 2023-10-03T10:15:48.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.357+0000 7ffb4ffff700 1 -- 172.21.15.146:0/3679910910 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb580070d0 con 0x7ffb6809d860 2023-10-03T10:15:48.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.357+0000 7ffb6dd3c700 1 -- 172.21.15.146:0/3679910910 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb6811d1c0 con 0x7ffb6809d860 2023-10-03T10:15:48.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.357+0000 7ffb4ffff700 1 -- 172.21.15.146:0/3679910910 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb58007440 con 0x7ffb6809d860 2023-10-03T10:15:48.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.357+0000 7ffb6dd3c700 1 -- 172.21.15.146:0/3679910910 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6811cb60 con 0x7ffb6809d860 2023-10-03T10:15:48.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.359+0000 7ffb4ffff700 1 -- 172.21.15.146:0/3679910910 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb580075a0 con 0x7ffb6809d860 2023-10-03T10:15:48.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.359+0000 7ffb6dd3c700 1 -- 172.21.15.146:0/3679910910 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb6804f2a0 con 0x7ffb6809d860 2023-10-03T10:15:48.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.359+0000 7ffb4ffff700 1 -- 172.21.15.146:0/3679910910 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffb5803eb10 con 0x7ffb6809d860 2023-10-03T10:15:48.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.363+0000 7ffb4ffff700 1 -- 172.21.15.146:0/3679910910 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb58011d70 con 0x7ffb6809d860 2023-10-03T10:15:48.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.393+0000 7f11182c3700 1 Processor -- start 2023-10-03T10:15:48.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.393+0000 7f4208a29700 1 Processor -- start 2023-10-03T10:15:48.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.393+0000 7f11182c3700 1 -- start start 2023-10-03T10:15:48.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.393+0000 7f4208a29700 1 -- start start 2023-10-03T10:15:48.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.394+0000 7f11182c3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11100a0a70 0x7f11100a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.394+0000 7f11182c3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11100a1380 0x7f1110133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.394+0000 7f11182c3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f111009dc00 con 0x7f1110133f50 2023-10-03T10:15:48.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.394+0000 7f11182c3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111009ea60 con 0x7f11100a1380 2023-10-03T10:15:48.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.394+0000 7f11182c3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111009dec0 con 0x7f11100a0a70 2023-10-03T10:15:48.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.394+0000 7f4208a29700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42041350d0 0x7f420413ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.394+0000 7f4208a29700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f420413d210 0x7f420413f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.394+0000 7f4208a29700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420409eca0 con 0x7f420406a770 2023-10-03T10:15:48.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.394+0000 7f4208a29700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420406b2e0 con 0x7f42041350d0 2023-10-03T10:15:48.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.394+0000 7f4208a29700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f420409f720 con 0x7f420413d210 2023-10-03T10:15:48.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.394+0000 7f111585e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11100a1380 0x7f1110133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.394+0000 7f111585e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11100a1380 0x7f1110133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60408/0 (socket says 172.21.15.146:60408) 2023-10-03T10:15:48.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.394+0000 7f111585e700 1 -- 172.21.15.146:0/2085681502 learned_addr learned my addr 172.21.15.146:0/2085681502 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:48.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.394+0000 7f420259c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f420406a770 0x7f42041349c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40282/0 (socket says 172.21.15.146:40282) 2023-10-03T10:15:48.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.394+0000 7f420259c700 1 -- 172.21.15.146:0/1500835693 learned_addr learned my addr 172.21.15.146:0/1500835693 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:48.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f111605f700 1 --2- 172.21.15.146:0/2085681502 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11100a0a70 0x7f11100a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f420159a700 1 -- 172.21.15.146:0/1500835693 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455102010 0 0) 0x7f420409eca0 con 0x7f420406a770 2023-10-03T10:15:48.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f420159a700 1 -- 172.21.15.146:0/1500835693 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41f00035b0 con 0x7f420406a770 2023-10-03T10:15:48.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f111585e700 1 -- 172.21.15.146:0/2085681502 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11100a0a70 msgr2=0x7f11100a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f111585e700 1 --2- 172.21.15.146:0/2085681502 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11100a0a70 0x7f11100a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f111585e700 1 -- 172.21.15.146:0/2085681502 >> v1:172.21.15.146:6789/0 conn(0x7f1110133f50 legacy=0x7f111013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f111585e700 1 -- 172.21.15.146:0/2085681502 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111009e6a0 con 0x7f11100a1380 2023-10-03T10:15:48.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f420159a700 1 -- 172.21.15.146:0/1500835693 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2583050497 0 0) 0x7f41f00035b0 con 0x7f420406a770 2023-10-03T10:15:48.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f4201d9b700 1 --2- 172.21.15.146:0/1500835693 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42041350d0 0x7f420413ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f420159a700 1 -- 172.21.15.146:0/1500835693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f420413d210 msgr2=0x7f420413f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f420159a700 1 --2- 172.21.15.146:0/1500835693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f420413d210 0x7f420413f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f420159a700 1 -- 172.21.15.146:0/1500835693 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42041350d0 msgr2=0x7f420413ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f420159a700 1 --2- 172.21.15.146:0/1500835693 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42041350d0 0x7f420413ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f111585e700 1 --2- 172.21.15.146:0/2085681502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11100a1380 0x7f1110133a10 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f11000098f0 tx=0x7f1100009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533eedffc3fc27fd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f420159a700 1 -- 172.21.15.146:0/1500835693 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420406b480 con 0x7f420406a770 2023-10-03T10:15:48.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f420159a700 1 -- 172.21.15.146:0/1500835693 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2532932501 0 0) 0x7f41f4001670 con 0x7f420406a770 2023-10-03T10:15:48.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f420159a700 1 -- 172.21.15.146:0/1500835693 >> v1:172.21.15.146:6789/0 conn(0x7f420406a770 legacy=0x7f42041349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f420159a700 1 --2- 172.21.15.146:0/1500835693 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41f0003aa0 0x7f41f0003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f420159a700 1 --2- 172.21.15.146:0/1500835693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41f0004850 0x7f41f0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f420159a700 1 --2- 172.21.15.146:0/1500835693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f420413d210 0x7f41f000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f420159a700 1 -- 172.21.15.146:0/1500835693 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420406b2e0 con 0x7f41f0004850 2023-10-03T10:15:48.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f420159a700 1 -- 172.21.15.146:0/1500835693 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420409f720 con 0x7f41f0003aa0 2023-10-03T10:15:48.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f420159a700 1 -- 172.21.15.146:0/1500835693 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41f0005720 con 0x7f420413d210 2023-10-03T10:15:48.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f4201d9b700 1 --2- 172.21.15.146:0/1500835693 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42041350d0 0x7f420413ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:48.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f4202d9d700 1 --2- 172.21.15.146:0/1500835693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f420413d210 0x7f41f000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f4201d9b700 1 --2- 172.21.15.146:0/1500835693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41f0004850 0x7f41f0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f420259c700 1 --2- 172.21.15.146:0/1500835693 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41f0003aa0 0x7f41f0003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.395+0000 7f111505d700 1 -- 172.21.15.146:0/2085681502 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1100011830 con 0x7f11100a1380 2023-10-03T10:15:48.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.396+0000 7f111505d700 1 -- 172.21.15.146:0/2085681502 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1100011990 con 0x7f11100a1380 2023-10-03T10:15:48.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.396+0000 7f111505d700 1 -- 172.21.15.146:0/2085681502 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1100011d20 con 0x7f11100a1380 2023-10-03T10:15:48.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.396+0000 7f4202d9d700 1 -- 172.21.15.146:0/1500835693 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41f0003aa0 msgr2=0x7f41f0003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.396+0000 7f4202d9d700 1 --2- 172.21.15.146:0/1500835693 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41f0003aa0 0x7f41f0003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.396+0000 7f4202d9d700 1 -- 172.21.15.146:0/1500835693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41f0004850 msgr2=0x7f41f0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.396+0000 7f4202d9d700 1 --2- 172.21.15.146:0/1500835693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41f0004850 0x7f41f0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.396+0000 7f4202d9d700 1 -- 172.21.15.146:0/1500835693 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420406b480 con 0x7f420413d210 2023-10-03T10:15:48.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.396+0000 7f4202d9d700 1 --2- 172.21.15.146:0/1500835693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f420413d210 0x7f41f000ba10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f41fc009e40 tx=0x7f41f0005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b08702441d3235eb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.396+0000 7f420159a700 1 -- 172.21.15.146:0/1500835693 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc0098b0 con 0x7f420413d210 2023-10-03T10:15:48.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.396+0000 7f420159a700 1 -- 172.21.15.146:0/1500835693 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41fc00baa0 con 0x7f420413d210 2023-10-03T10:15:48.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.396+0000 7f420159a700 1 -- 172.21.15.146:0/1500835693 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc00be50 con 0x7f420413d210 2023-10-03T10:15:48.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.396+0000 7f11182c3700 1 -- 172.21.15.146:0/2085681502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11100a1380 msgr2=0x7f1110133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.396+0000 7f11182c3700 1 --2- 172.21.15.146:0/2085681502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11100a1380 0x7f1110133a10 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f11000098f0 tx=0x7f1100009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:48.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.397+0000 7f11182c3700 1 -- 172.21.15.146:0/2085681502 shutdown_connections 2023-10-03T10:15:48.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.397+0000 7f11182c3700 1 --2- 172.21.15.146:0/2085681502 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11100a0a70 0x7f11100a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.397+0000 7f11182c3700 1 --2- 172.21.15.146:0/2085681502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11100a1380 0x7f1110133a10 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.397+0000 7f11182c3700 1 -- 172.21.15.146:0/2085681502 >> 172.21.15.146:0/2085681502 conn(0x7f11100a6610 msgr2=0x7f11100a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.397+0000 7f4208a29700 1 -- 172.21.15.146:0/1500835693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f420413d210 msgr2=0x7f41f000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.397+0000 7f4208a29700 1 --2- 172.21.15.146:0/1500835693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f420413d210 0x7f41f000ba10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f41fc009e40 tx=0x7f41f0005880 comp rx=0 tx=0).stop 2023-10-03T10:15:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.397+0000 7f11182c3700 1 -- 172.21.15.146:0/2085681502 shutdown_connections 2023-10-03T10:15:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.397+0000 7f11182c3700 1 -- 172.21.15.146:0/2085681502 wait complete. 2023-10-03T10:15:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.397+0000 7f4208a29700 1 -- 172.21.15.146:0/1500835693 shutdown_connections 2023-10-03T10:15:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.397+0000 7f4208a29700 1 --2- 172.21.15.146:0/1500835693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f420413d210 0x7f41f000ba10 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.397+0000 7f4208a29700 1 --2- 172.21.15.146:0/1500835693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41f0004850 0x7f41f0004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.397+0000 7f4208a29700 1 --2- 172.21.15.146:0/1500835693 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41f0003aa0 0x7f41f0003eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.397+0000 7f4208a29700 1 -- 172.21.15.146:0/1500835693 >> 172.21.15.146:0/1500835693 conn(0x7f4204099c40 msgr2=0x7f42040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.398+0000 7f11182c3700 1 Processor -- start 2023-10-03T10:15:48.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.398+0000 7f4208a29700 1 -- 172.21.15.146:0/1500835693 shutdown_connections 2023-10-03T10:15:48.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.398+0000 7f11182c3700 1 -- start start 2023-10-03T10:15:48.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.398+0000 7f4208a29700 1 -- 172.21.15.146:0/1500835693 wait complete. 2023-10-03T10:15:48.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.398+0000 7f11182c3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11100a0a70 0x7f11101232f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.398+0000 7f11182c3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11100a1380 0x7f1110123830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.398+0000 7f11182c3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1110133f50 0x7f11101c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.398+0000 7f11182c3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1110126030 con 0x7f11100a0a70 2023-10-03T10:15:48.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.398+0000 7f11182c3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1110124ec0 con 0x7f11100a1380 2023-10-03T10:15:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.398+0000 7f11182c3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1110122f00 con 0x7f1110133f50 2023-10-03T10:15:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.398+0000 7f111605f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11100a0a70 0x7f11101232f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.398+0000 7f111585e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11100a1380 0x7f1110123830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.398+0000 7f111585e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11100a1380 0x7f1110123830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34764/0 (socket says 172.21.15.146:34764) 2023-10-03T10:15:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.398+0000 7f111605f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11100a0a70 0x7f11101232f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60422/0 (socket says 172.21.15.146:60422) 2023-10-03T10:15:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.398+0000 7f111585e700 1 -- 172.21.15.146:0/457055455 learned_addr learned my addr 172.21.15.146:0/457055455 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.399+0000 7f111585e700 1 -- 172.21.15.146:0/457055455 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1110133f50 msgr2=0x7f11101c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.399+0000 7f111585e700 1 --2- 172.21.15.146:0/457055455 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1110133f50 0x7f11101c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.399+0000 7f111585e700 1 -- 172.21.15.146:0/457055455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11100a0a70 msgr2=0x7f11101232f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.399+0000 7f111585e700 1 --2- 172.21.15.146:0/457055455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11100a0a70 0x7f11101232f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.399+0000 7f111585e700 1 -- 172.21.15.146:0/457055455 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1100009550 con 0x7f11100a1380 2023-10-03T10:15:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.399+0000 7f111605f700 1 --2- 172.21.15.146:0/457055455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11100a0a70 0x7f11101232f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:48.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.399+0000 7f111585e700 1 --2- 172.21.15.146:0/457055455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11100a1380 0x7f1110123830 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1100000c00 tx=0x7f1100004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.399+0000 7f4208a29700 1 Processor -- start 2023-10-03T10:15:48.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.399+0000 7f1106ffd700 1 -- 172.21.15.146:0/457055455 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1100004480 con 0x7f11100a1380 2023-10-03T10:15:48.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.399+0000 7f1106ffd700 1 -- 172.21.15.146:0/457055455 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110001f070 con 0x7f11100a1380 2023-10-03T10:15:48.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.399+0000 7f1106ffd700 1 -- 172.21.15.146:0/457055455 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11000038c0 con 0x7f11100a1380 2023-10-03T10:15:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.399+0000 7f11182c3700 1 -- 172.21.15.146:0/457055455 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1110126260 con 0x7f11100a1380 2023-10-03T10:15:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.399+0000 7f11182c3700 1 -- 172.21.15.146:0/457055455 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11101252a0 con 0x7f11100a1380 2023-10-03T10:15:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.400+0000 7f4208a29700 1 -- start start 2023-10-03T10:15:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.400+0000 7f4208a29700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f41f0003aa0 0x7f420406e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.400+0000 7f4208a29700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41f0004850 0x7f420406ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.400+0000 7f4208a29700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f420406a770 0x7f420406f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.400+0000 7f4208a29700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420406f9a0 con 0x7f420406a770 2023-10-03T10:15:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.400+0000 7f4208a29700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42040724d0 con 0x7f41f0004850 2023-10-03T10:15:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.400+0000 7f4208a29700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42040a31c0 con 0x7f41f0003aa0 2023-10-03T10:15:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.400+0000 7f11182c3700 1 -- 172.21.15.146:0/457055455 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1110125e80 con 0x7f11100a1380 2023-10-03T10:15:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.400+0000 7f420259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f41f0003aa0 0x7f420406e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.400+0000 7f4201d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41f0004850 0x7f420406ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.400+0000 7f420259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f41f0003aa0 0x7f420406e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43996/0 (socket says 172.21.15.146:43996) 2023-10-03T10:15:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.400+0000 7f420259c700 1 -- 172.21.15.146:0/1750237310 learned_addr learned my addr 172.21.15.146:0/1750237310 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.401+0000 7f4202d9d700 1 --2- 172.21.15.146:0/1750237310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f420406a770 0x7f420406f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.401+0000 7f4201d9b700 1 -- 172.21.15.146:0/1750237310 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f41f0003aa0 msgr2=0x7f420406e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.401+0000 7f4201d9b700 1 --2- 172.21.15.146:0/1750237310 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f41f0003aa0 0x7f420406e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.401+0000 7f4201d9b700 1 -- 172.21.15.146:0/1750237310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f420406a770 msgr2=0x7f420406f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.401+0000 7f4201d9b700 1 --2- 172.21.15.146:0/1750237310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f420406a770 0x7f420406f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.401+0000 7f4201d9b700 1 -- 172.21.15.146:0/1750237310 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42040718f0 con 0x7f41f0004850 2023-10-03T10:15:48.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.401+0000 7f1106ffd700 1 -- 172.21.15.146:0/457055455 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1100021030 con 0x7f11100a1380 2023-10-03T10:15:48.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.401+0000 7f4202d9d700 1 --2- 172.21.15.146:0/1750237310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f420406a770 0x7f420406f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:48.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.401+0000 7f420259c700 1 --2- 172.21.15.146:0/1750237310 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f41f0003aa0 0x7f420406e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:48.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.401+0000 7f4201d9b700 1 --2- 172.21.15.146:0/1750237310 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41f0004850 0x7f420406ee40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f420406e0b0 tx=0x7f41ec00fbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.404+0000 7f1106ffd700 1 -- 172.21.15.146:0/457055455 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f110001b830 con 0x7f11100a1380 2023-10-03T10:15:48.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.405+0000 7f41faffd700 1 -- 172.21.15.146:0/1750237310 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec013850 con 0x7f41f0004850 2023-10-03T10:15:48.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.405+0000 7f41faffd700 1 -- 172.21.15.146:0/1750237310 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ec00c040 con 0x7f41f0004850 2023-10-03T10:15:48.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.405+0000 7f41faffd700 1 -- 172.21.15.146:0/1750237310 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec013bf0 con 0x7f41f0004850 2023-10-03T10:15:48.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.406+0000 7f4208a29700 1 -- 172.21.15.146:0/1750237310 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420409f220 con 0x7f41f0004850 2023-10-03T10:15:48.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.406+0000 7f4208a29700 1 -- 172.21.15.146:0/1750237310 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4204138170 con 0x7f41f0004850 2023-10-03T10:15:48.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.406+0000 7f1106ffd700 1 -- 172.21.15.146:0/457055455 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1100003a20 con 0x7f11100a1380 2023-10-03T10:15:48.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.406+0000 7f41faffd700 1 -- 172.21.15.146:0/1750237310 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f41ec013d50 con 0x7f41f0004850 2023-10-03T10:15:48.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.407+0000 7f41faffd700 1 -- 172.21.15.146:0/1750237310 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f41ec03fb50 con 0x7f41f0004850 2023-10-03T10:15:48.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.407+0000 7f4208a29700 1 -- 172.21.15.146:0/1750237310 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f420409bbc0 con 0x7f41f0004850 2023-10-03T10:15:48.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.415+0000 7f41faffd700 1 -- 172.21.15.146:0/1750237310 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f41ec0243f0 con 0x7f41f0004850 2023-10-03T10:15:48.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.558+0000 7ff8a7a76700 1 -- 172.21.15.146:0/2195160061 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff8a006bce0 con 0x7ff8a0130670 2023-10-03T10:15:48.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.558+0000 7ff8967fc700 1 -- 172.21.15.146:0/2195160061 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff898015410 con 0x7ff8a0130670 2023-10-03T10:15:48.558 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:48.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.560+0000 7ff8a7a76700 1 -- 172.21.15.146:0/2195160061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8a0130670 msgr2=0x7ff8a011b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.560+0000 7ff8a7a76700 1 --2- 172.21.15.146:0/2195160061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8a0130670 0x7ff8a011b8d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff89800cf90 tx=0x7ff898004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.560+0000 7ff8a7a76700 1 -- 172.21.15.146:0/2195160061 shutdown_connections 2023-10-03T10:15:48.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.560+0000 7ff8a7a76700 1 --2- 172.21.15.146:0/2195160061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8a0130670 0x7ff8a011b8d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.560+0000 7ff8a7a76700 1 --2- 172.21.15.146:0/2195160061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8a00a0a30 0x7ff8a011ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.560+0000 7ff8a7a76700 1 --2- 172.21.15.146:0/2195160061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8a00a1340 0x7ff8a011b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.560+0000 7ff8a7a76700 1 -- 172.21.15.146:0/2195160061 >> 172.21.15.146:0/2195160061 conn(0x7ff8a00a2980 msgr2=0x7ff8a01b7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.561+0000 7ff8a7a76700 1 -- 172.21.15.146:0/2195160061 shutdown_connections 2023-10-03T10:15:48.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.561+0000 7ff8a7a76700 1 -- 172.21.15.146:0/2195160061 wait complete. 2023-10-03T10:15:48.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:48.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.596+0000 7ffb6dd3c700 1 -- 172.21.15.146:0/3679910910 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffb6811cf70 con 0x7ffb6809d860 2023-10-03T10:15:48.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.597+0000 7ffb4ffff700 1 -- 172.21.15.146:0/3679910910 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb58017020 con 0x7ffb6809d860 2023-10-03T10:15:48.596 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:48.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.599+0000 7ffb6dd3c700 1 -- 172.21.15.146:0/3679910910 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb6809d860 msgr2=0x7ffb681c44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.599+0000 7ffb6dd3c700 1 --2- 172.21.15.146:0/3679910910 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb6809d860 0x7ffb681c44a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800c520 tx=0x7ffb5800c830 comp rx=0 tx=0).stop 2023-10-03T10:15:48.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.599+0000 7ffb6dd3c700 1 -- 172.21.15.146:0/3679910910 shutdown_connections 2023-10-03T10:15:48.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.599+0000 7ffb6dd3c700 1 --2- 172.21.15.146:0/3679910910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb68135f20 0x7ffb68119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.599+0000 7ffb6dd3c700 1 --2- 172.21.15.146:0/3679910910 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffb6809d860 0x7ffb681c44a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.599+0000 7ffb6dd3c700 1 --2- 172.21.15.146:0/3679910910 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffb6809e340 0x7ffb681c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.599+0000 7ffb6dd3c700 1 -- 172.21.15.146:0/3679910910 >> 172.21.15.146:0/3679910910 conn(0x7ffb68099c40 msgr2=0x7ffb681309b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.600+0000 7ffb6dd3c700 1 -- 172.21.15.146:0/3679910910 shutdown_connections 2023-10-03T10:15:48.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.600+0000 7ffb6dd3c700 1 -- 172.21.15.146:0/3679910910 wait complete. 2023-10-03T10:15:48.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:48.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.612+0000 7f11182c3700 1 -- 172.21.15.146:0/457055455 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1110133ad0 con 0x7f11100a1380 2023-10-03T10:15:48.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.613+0000 7f1106ffd700 1 -- 172.21.15.146:0/457055455 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1100015030 con 0x7f11100a1380 2023-10-03T10:15:48.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.613+0000 7f4208a29700 1 -- 172.21.15.146:0/1750237310 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4204134de0 con 0x7f41f0004850 2023-10-03T10:15:48.613 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:48.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.613+0000 7f41faffd700 1 -- 172.21.15.146:0/1750237310 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f41ec006c60 con 0x7f41f0004850 2023-10-03T10:15:48.613 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:48.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.615+0000 7f11182c3700 1 -- 172.21.15.146:0/457055455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11100a1380 msgr2=0x7f1110123830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.615+0000 7f11182c3700 1 --2- 172.21.15.146:0/457055455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11100a1380 0x7f1110123830 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1100000c00 tx=0x7f1100004750 comp rx=0 tx=0).stop 2023-10-03T10:15:48.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.615+0000 7f11182c3700 1 -- 172.21.15.146:0/457055455 shutdown_connections 2023-10-03T10:15:48.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.615+0000 7f11182c3700 1 --2- 172.21.15.146:0/457055455 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1110133f50 0x7f11101c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.615+0000 7f11182c3700 1 --2- 172.21.15.146:0/457055455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11100a0a70 0x7f11101232f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.615+0000 7f11182c3700 1 --2- 172.21.15.146:0/457055455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11100a1380 0x7f1110123830 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.615+0000 7f11182c3700 1 -- 172.21.15.146:0/457055455 >> 172.21.15.146:0/457055455 conn(0x7f11100a6610 msgr2=0x7f11100a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.615+0000 7f11182c3700 1 -- 172.21.15.146:0/457055455 shutdown_connections 2023-10-03T10:15:48.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.615+0000 7f11182c3700 1 -- 172.21.15.146:0/457055455 wait complete. 2023-10-03T10:15:48.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.615+0000 7f4208a29700 1 -- 172.21.15.146:0/1750237310 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41f0004850 msgr2=0x7f420406ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.615+0000 7f4208a29700 1 --2- 172.21.15.146:0/1750237310 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41f0004850 0x7f420406ee40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f420406e0b0 tx=0x7f41ec00fbf0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.615+0000 7f4208a29700 1 -- 172.21.15.146:0/1750237310 shutdown_connections 2023-10-03T10:15:48.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.615+0000 7f4208a29700 1 --2- 172.21.15.146:0/1750237310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f420406a770 0x7f420406f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.615+0000 7f4208a29700 1 --2- 172.21.15.146:0/1750237310 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f41f0003aa0 0x7f420406e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.615+0000 7f4208a29700 1 --2- 172.21.15.146:0/1750237310 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41f0004850 0x7f420406ee40 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.615+0000 7f4208a29700 1 -- 172.21.15.146:0/1750237310 >> 172.21.15.146:0/1750237310 conn(0x7f4204099c40 msgr2=0x7f4204133530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.616+0000 7f4208a29700 1 -- 172.21.15.146:0/1750237310 shutdown_connections 2023-10-03T10:15:48.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:48.616+0000 7f4208a29700 1 -- 172.21.15.146:0/1750237310 wait complete. 2023-10-03T10:15:48.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:48.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:49.573 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:49.612 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:49.629 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:49.629 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:49.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.719+0000 7f956c15c700 1 Processor -- start 2023-10-03T10:15:49.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.719+0000 7f956c15c700 1 -- start start 2023-10-03T10:15:49.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.719+0000 7f956c15c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f956409e340 0x7f95641359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.719+0000 7f956c15c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9564135f20 0x7f9564138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.719+0000 7f956c15c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f956409aaa0 con 0x7f956409d860 2023-10-03T10:15:49.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.719+0000 7f956c15c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f956409e730 con 0x7f9564135f20 2023-10-03T10:15:49.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.719+0000 7f956c15c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f956409f870 con 0x7f956409e340 2023-10-03T10:15:49.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.720+0000 7f95696f7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f956409e340 0x7f95641359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.720+0000 7f956a6f9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9564135f20 0x7f9564138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.720+0000 7f95696f7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f956409e340 0x7f95641359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34794/0 (socket says 172.21.15.146:34794) 2023-10-03T10:15:49.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.720+0000 7f95696f7700 1 -- 172.21.15.146:0/3541397551 learned_addr learned my addr 172.21.15.146:0/3541397551 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:49.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.720+0000 7f95696f7700 1 -- 172.21.15.146:0/3541397551 >> v2:172.21.15.146:3300/0 conn(0x7f9564135f20 msgr2=0x7f9564138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.720+0000 7f95696f7700 1 --2- 172.21.15.146:0/3541397551 >> v2:172.21.15.146:3300/0 conn(0x7f9564135f20 0x7f9564138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.720+0000 7f9568ef6700 1 -- 172.21.15.146:0/3541397551 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368656163 0 0) 0x7f956409aaa0 con 0x7f956409d860 2023-10-03T10:15:49.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.720+0000 7f95696f7700 1 -- 172.21.15.146:0/3541397551 >> v1:172.21.15.146:6789/0 conn(0x7f956409d860 legacy=0x7f956409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.720+0000 7f95696f7700 1 -- 172.21.15.146:0/3541397551 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956409b360 con 0x7f956409e340 2023-10-03T10:15:49.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.720+0000 7f956a6f9700 1 --2- 172.21.15.146:0/3541397551 >> v2:172.21.15.146:3300/0 conn(0x7f9564135f20 0x7f9564138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.720+0000 7f95696f7700 1 --2- 172.21.15.146:0/3541397551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f956409e340 0x7f95641359e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f95540098f0 tx=0x7f9554009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73e926a2502c119d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.720+0000 7f9568ef6700 1 -- 172.21.15.146:0/3541397551 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9554011830 con 0x7f956409e340 2023-10-03T10:15:49.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.721+0000 7f9568ef6700 1 -- 172.21.15.146:0/3541397551 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9554011990 con 0x7f956409e340 2023-10-03T10:15:49.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.721+0000 7f9568ef6700 1 -- 172.21.15.146:0/3541397551 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9554011d20 con 0x7f956409e340 2023-10-03T10:15:49.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.721+0000 7f956c15c700 1 -- 172.21.15.146:0/3541397551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f956409e340 msgr2=0x7f95641359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.721+0000 7f956c15c700 1 --2- 172.21.15.146:0/3541397551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f956409e340 0x7f95641359e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f95540098f0 tx=0x7f9554009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:49.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.722+0000 7f956c15c700 1 -- 172.21.15.146:0/3541397551 shutdown_connections 2023-10-03T10:15:49.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.722+0000 7f956c15c700 1 --2- 172.21.15.146:0/3541397551 >> v2:172.21.15.146:3300/0 conn(0x7f9564135f20 0x7f9564138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.722+0000 7f956c15c700 1 --2- 172.21.15.146:0/3541397551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f956409e340 0x7f95641359e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.722+0000 7f956c15c700 1 -- 172.21.15.146:0/3541397551 >> 172.21.15.146:0/3541397551 conn(0x7f9564099c40 msgr2=0x7f95640a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.722+0000 7f956c15c700 1 -- 172.21.15.146:0/3541397551 shutdown_connections 2023-10-03T10:15:49.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.722+0000 7f956c15c700 1 -- 172.21.15.146:0/3541397551 wait complete. 2023-10-03T10:15:49.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.723+0000 7f956c15c700 1 Processor -- start 2023-10-03T10:15:49.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.723+0000 7f956c15c700 1 -- start start 2023-10-03T10:15:49.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.723+0000 7f956c15c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f956409d860 0x7f956411f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.723+0000 7f956c15c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f956409e340 0x7f956411fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.723+0000 7f956c15c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9564135f20 0x7f956411ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.723+0000 7f956c15c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95641226b0 con 0x7f956409e340 2023-10-03T10:15:49.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.723+0000 7f956c15c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95641210a0 con 0x7f9564135f20 2023-10-03T10:15:49.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.723+0000 7f956c15c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9564121910 con 0x7f956409d860 2023-10-03T10:15:49.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.723+0000 7f956a6f9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9564135f20 0x7f956411ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.723+0000 7f956a6f9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9564135f20 0x7f956411ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34806/0 (socket says 172.21.15.146:34806) 2023-10-03T10:15:49.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.723+0000 7f956a6f9700 1 -- 172.21.15.146:0/2694704061 learned_addr learned my addr 172.21.15.146:0/2694704061 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:49.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.723+0000 7f95696f7700 1 --2- 172.21.15.146:0/2694704061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f956409e340 0x7f956411fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.724+0000 7f9569ef8700 1 --2- 172.21.15.146:0/2694704061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f956409d860 0x7f956411f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.724+0000 7f956a6f9700 1 -- 172.21.15.146:0/2694704061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f956409d860 msgr2=0x7f956411f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.724+0000 7f956a6f9700 1 --2- 172.21.15.146:0/2694704061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f956409d860 0x7f956411f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.724+0000 7f956a6f9700 1 -- 172.21.15.146:0/2694704061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f956409e340 msgr2=0x7f956411fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.724+0000 7f956a6f9700 1 --2- 172.21.15.146:0/2694704061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f956409e340 0x7f956411fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.724+0000 7f956a6f9700 1 -- 172.21.15.146:0/2694704061 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955c009a70 con 0x7f9564135f20 2023-10-03T10:15:49.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.724+0000 7f9569ef8700 1 --2- 172.21.15.146:0/2694704061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f956409d860 0x7f956411f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:49.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.724+0000 7f956a6f9700 1 --2- 172.21.15.146:0/2694704061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9564135f20 0x7f956411ff60 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f955c00efc0 tx=0x7f955c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.724+0000 7f955a7fc700 1 -- 172.21.15.146:0/2694704061 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c00cb40 con 0x7f9564135f20 2023-10-03T10:15:49.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.724+0000 7f955a7fc700 1 -- 172.21.15.146:0/2694704061 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955c00f040 con 0x7f9564135f20 2023-10-03T10:15:49.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.724+0000 7f956c15c700 1 -- 172.21.15.146:0/2694704061 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9554009550 con 0x7f9564135f20 2023-10-03T10:15:49.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.724+0000 7f955a7fc700 1 -- 172.21.15.146:0/2694704061 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c003a20 con 0x7f9564135f20 2023-10-03T10:15:49.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.724+0000 7f956c15c700 1 -- 172.21.15.146:0/2694704061 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f956409c8b0 con 0x7f9564135f20 2023-10-03T10:15:49.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.725+0000 7f956c15c700 1 -- 172.21.15.146:0/2694704061 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f956404f2a0 con 0x7f9564135f20 2023-10-03T10:15:49.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.725+0000 7f955a7fc700 1 -- 172.21.15.146:0/2694704061 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f955c014480 con 0x7f9564135f20 2023-10-03T10:15:49.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.726+0000 7f955a7fc700 1 -- 172.21.15.146:0/2694704061 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f955c02d9a0 con 0x7f9564135f20 2023-10-03T10:15:49.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.734+0000 7f955a7fc700 1 -- 172.21.15.146:0/2694704061 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f955c045060 con 0x7f9564135f20 2023-10-03T10:15:49.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.761+0000 7f2502627700 1 Processor -- start 2023-10-03T10:15:49.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.761+0000 7f2502627700 1 -- start start 2023-10-03T10:15:49.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.762+0000 7f2502627700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24fc133ad0 0x7f24fc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.762+0000 7f2502627700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24fc1300a0 0x7f24fc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.762+0000 7f2502627700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f24fc1309f0 0x7f24fc13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.762+0000 7f2502627700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24fc06b2d0 con 0x7f24fc1309f0 2023-10-03T10:15:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.762+0000 7f2502627700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc133610 con 0x7f24fc1300a0 2023-10-03T10:15:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.762+0000 7f2502627700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc09a500 con 0x7f24fc133ad0 2023-10-03T10:15:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.762+0000 7f24fb7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24fc1300a0 0x7f24fc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.762+0000 7f24fbfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24fc133ad0 0x7f24fc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.762+0000 7f24fb7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24fc1300a0 0x7f24fc1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34816/0 (socket says 172.21.15.146:34816) 2023-10-03T10:15:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.762+0000 7f24fbfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24fc133ad0 0x7f24fc133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:44020/0 (socket says 172.21.15.146:44020) 2023-10-03T10:15:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.762+0000 7f24fb7fe700 1 -- 172.21.15.146:0/4031950859 learned_addr learned my addr 172.21.15.146:0/4031950859 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:49.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.762+0000 7f2500bc4700 1 --2- 172.21.15.146:0/4031950859 >> v2:172.21.15.146:3300/0 conn(0x7f24fc1309f0 0x7f24fc13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.762+0000 7f2500bc4700 1 -- 172.21.15.146:0/4031950859 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24fc133ad0 msgr2=0x7f24fc133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.763+0000 7f2500bc4700 1 --2- 172.21.15.146:0/4031950859 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24fc133ad0 0x7f24fc133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.763+0000 7f2500bc4700 1 -- 172.21.15.146:0/4031950859 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24fc1300a0 msgr2=0x7f24fc1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.763+0000 7f2500bc4700 1 --2- 172.21.15.146:0/4031950859 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24fc1300a0 0x7f24fc1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.763+0000 7f2500bc4700 1 -- 172.21.15.146:0/4031950859 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24fc1338b0 con 0x7f24fc1309f0 2023-10-03T10:15:49.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.763+0000 7f24fb7fe700 1 --2- 172.21.15.146:0/4031950859 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24fc1300a0 0x7f24fc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.763+0000 7f2500bc4700 1 --2- 172.21.15.146:0/4031950859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24fc1309f0 0x7f24fc13a980 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009d90 tx=0x7f24f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e51b3ca129ef8ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.763+0000 7f24faffd700 1 -- 172.21.15.146:0/4031950859 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f400e070 con 0x7f24fc1309f0 2023-10-03T10:15:49.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.763+0000 7f24faffd700 1 -- 172.21.15.146:0/4031950859 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f400bb20 con 0x7f24fc1309f0 2023-10-03T10:15:49.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.763+0000 7f24faffd700 1 -- 172.21.15.146:0/4031950859 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f4012430 con 0x7f24fc1309f0 2023-10-03T10:15:49.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.764+0000 7f2502627700 1 -- 172.21.15.146:0/4031950859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24fc1309f0 msgr2=0x7f24fc13a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.764+0000 7f2502627700 1 --2- 172.21.15.146:0/4031950859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24fc1309f0 0x7f24fc13a980 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009d90 tx=0x7f24f400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:49.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.764+0000 7f2502627700 1 -- 172.21.15.146:0/4031950859 shutdown_connections 2023-10-03T10:15:49.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.764+0000 7f2502627700 1 --2- 172.21.15.146:0/4031950859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24fc1309f0 0x7f24fc13a980 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.764+0000 7f2502627700 1 --2- 172.21.15.146:0/4031950859 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24fc133ad0 0x7f24fc133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.764+0000 7f2502627700 1 --2- 172.21.15.146:0/4031950859 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24fc1300a0 0x7f24fc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.764+0000 7f2502627700 1 -- 172.21.15.146:0/4031950859 >> 172.21.15.146:0/4031950859 conn(0x7f24fc099c40 msgr2=0x7f24fc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.764+0000 7f2502627700 1 -- 172.21.15.146:0/4031950859 shutdown_connections 2023-10-03T10:15:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.764+0000 7f2502627700 1 -- 172.21.15.146:0/4031950859 wait complete. 2023-10-03T10:15:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.765+0000 7f2502627700 1 Processor -- start 2023-10-03T10:15:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.765+0000 7f2502627700 1 -- start start 2023-10-03T10:15:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.765+0000 7f2502627700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24fc1300a0 0x7f24fc11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.765+0000 7f2502627700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24fc1309f0 0x7f24fc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.765+0000 7f2502627700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24fc133ad0 0x7f24fc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.765+0000 7f2502627700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc1200c0 con 0x7f24fc1300a0 2023-10-03T10:15:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.765+0000 7f2502627700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc11f040 con 0x7f24fc133ad0 2023-10-03T10:15:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.765+0000 7f2502627700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc11fb20 con 0x7f24fc1309f0 2023-10-03T10:15:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.765+0000 7f24fbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24fc1300a0 0x7f24fc11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.765+0000 7f24fbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24fc1300a0 0x7f24fc11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60454/0 (socket says 172.21.15.146:60454) 2023-10-03T10:15:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.765+0000 7f24fbfff700 1 -- 172.21.15.146:0/1861470402 learned_addr learned my addr 172.21.15.146:0/1861470402 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.766+0000 7f24fb7fe700 1 --2- 172.21.15.146:0/1861470402 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24fc1309f0 0x7f24fc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.766+0000 7f2500bc4700 1 --2- 172.21.15.146:0/1861470402 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24fc133ad0 0x7f24fc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.766+0000 7f24fbfff700 1 -- 172.21.15.146:0/1861470402 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24fc1309f0 msgr2=0x7f24fc11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.766+0000 7f24fbfff700 1 --2- 172.21.15.146:0/1861470402 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24fc1309f0 0x7f24fc11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.766+0000 7f24fbfff700 1 -- 172.21.15.146:0/1861470402 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24fc133ad0 msgr2=0x7f24fc11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.766+0000 7f24fbfff700 1 --2- 172.21.15.146:0/1861470402 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24fc133ad0 0x7f24fc11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.766+0000 7f24fbfff700 1 -- 172.21.15.146:0/1861470402 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f0009550 con 0x7f24fc1300a0 2023-10-03T10:15:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.766+0000 7f24fb7fe700 1 --2- 172.21.15.146:0/1861470402 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24fc1309f0 0x7f24fc11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.766+0000 7f24fbfff700 1 --2- 172.21.15.146:0/1861470402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24fc1300a0 0x7f24fc11da40 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00e9e0 tx=0x7f24ec00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.766+0000 7f24f8ff9700 1 -- 172.21.15.146:0/1861470402 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec009710 con 0x7f24fc1300a0 2023-10-03T10:15:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.766+0000 7f24f8ff9700 1 -- 172.21.15.146:0/1861470402 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ec00c850 con 0x7f24fc1300a0 2023-10-03T10:15:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.766+0000 7f24f8ff9700 1 -- 172.21.15.146:0/1861470402 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec00cbc0 con 0x7f24fc1300a0 2023-10-03T10:15:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.766+0000 7f2502627700 1 -- 172.21.15.146:0/1861470402 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f4009a70 con 0x7f24fc1300a0 2023-10-03T10:15:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.766+0000 7f2502627700 1 -- 172.21.15.146:0/1861470402 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24fc12dd00 con 0x7f24fc1300a0 2023-10-03T10:15:49.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.767+0000 7f24f8ff9700 1 -- 172.21.15.146:0/1861470402 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f24ec00cd20 con 0x7f24fc1300a0 2023-10-03T10:15:49.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.767+0000 7f2502627700 1 -- 172.21.15.146:0/1861470402 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24fc04f2a0 con 0x7f24fc1300a0 2023-10-03T10:15:49.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.768+0000 7f24f8ff9700 1 -- 172.21.15.146:0/1861470402 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f24ec03f770 con 0x7f24fc1300a0 2023-10-03T10:15:49.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.772+0000 7f24f8ff9700 1 -- 172.21.15.146:0/1861470402 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f24ec01be10 con 0x7f24fc1300a0 2023-10-03T10:15:49.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.802+0000 7f740c1be700 1 Processor -- start 2023-10-03T10:15:49.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.802+0000 7f740c1be700 1 -- start start 2023-10-03T10:15:49.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.803+0000 7f740c1be700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74041368e0 0x7f7404138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.803+0000 7f740c1be700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7404139200 0x7f740413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.803+0000 7f740c1be700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f740409a760 con 0x7f7404133900 2023-10-03T10:15:49.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.803+0000 7f740c1be700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74041336e0 con 0x7f7404139200 2023-10-03T10:15:49.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.803+0000 7f740c1be700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740409a080 con 0x7f74041368e0 2023-10-03T10:15:49.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.803+0000 7f7409759700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74041368e0 0x7f7404138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.803+0000 7f7409759700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74041368e0 0x7f7404138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34824/0 (socket says 172.21.15.146:34824) 2023-10-03T10:15:49.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.803+0000 7f7409759700 1 -- 172.21.15.146:0/2512945520 learned_addr learned my addr 172.21.15.146:0/2512945520 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:49.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.803+0000 7f740a75b700 1 --2- 172.21.15.146:0/2512945520 >> v2:172.21.15.146:3300/0 conn(0x7f7404139200 0x7f740413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.803+0000 7f7409759700 1 -- 172.21.15.146:0/2512945520 >> v2:172.21.15.146:3300/0 conn(0x7f7404139200 msgr2=0x7f740413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.803+0000 7f7409759700 1 --2- 172.21.15.146:0/2512945520 >> v2:172.21.15.146:3300/0 conn(0x7f7404139200 0x7f740413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.803+0000 7f7409759700 1 -- 172.21.15.146:0/2512945520 >> v1:172.21.15.146:6789/0 conn(0x7f7404133900 legacy=0x7f7404133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.803+0000 7f7409759700 1 -- 172.21.15.146:0/2512945520 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74040a23e0 con 0x7f74041368e0 2023-10-03T10:15:49.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.804+0000 7f7409759700 1 --2- 172.21.15.146:0/2512945520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74041368e0 0x7f7404138cc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f73f40098f0 tx=0x7f73f4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1e7cac2e9c5dda server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.804+0000 7f7408f58700 1 -- 172.21.15.146:0/2512945520 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f4011830 con 0x7f74041368e0 2023-10-03T10:15:49.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.804+0000 7f7408f58700 1 -- 172.21.15.146:0/2512945520 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f4011990 con 0x7f74041368e0 2023-10-03T10:15:49.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.804+0000 7f7408f58700 1 -- 172.21.15.146:0/2512945520 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f4011d20 con 0x7f74041368e0 2023-10-03T10:15:49.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.804+0000 7f740c1be700 1 -- 172.21.15.146:0/2512945520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74041368e0 msgr2=0x7f7404138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.804+0000 7f740c1be700 1 --2- 172.21.15.146:0/2512945520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74041368e0 0x7f7404138cc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f73f40098f0 tx=0x7f73f4009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:49.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.805+0000 7f740c1be700 1 -- 172.21.15.146:0/2512945520 shutdown_connections 2023-10-03T10:15:49.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.805+0000 7f740c1be700 1 --2- 172.21.15.146:0/2512945520 >> v2:172.21.15.146:3300/0 conn(0x7f7404139200 0x7f740413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.805+0000 7f740c1be700 1 --2- 172.21.15.146:0/2512945520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f74041368e0 0x7f7404138cc0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.805+0000 7f740c1be700 1 -- 172.21.15.146:0/2512945520 >> 172.21.15.146:0/2512945520 conn(0x7f74040a2980 msgr2=0x7f74040a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.805+0000 7f740c1be700 1 -- 172.21.15.146:0/2512945520 shutdown_connections 2023-10-03T10:15:49.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.805+0000 7f740c1be700 1 -- 172.21.15.146:0/2512945520 wait complete. 2023-10-03T10:15:49.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.806+0000 7f740c1be700 1 Processor -- start 2023-10-03T10:15:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.806+0000 7f740c1be700 1 -- start start 2023-10-03T10:15:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.806+0000 7f740c1be700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7404133900 0x7f740411a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.806+0000 7f740c1be700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7404139200 0x7f740411ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.806+0000 7f740c1be700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f74041c83f0 0x7f74041c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.806+0000 7f740c1be700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740411bb60 con 0x7f7404139200 2023-10-03T10:15:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.806+0000 7f740c1be700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740411c430 con 0x7f7404133900 2023-10-03T10:15:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.806+0000 7f740c1be700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7404132f70 con 0x7f74041c83f0 2023-10-03T10:15:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.806+0000 7f7409759700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7404139200 0x7f740411ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.806+0000 7f7409759700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7404139200 0x7f740411ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60462/0 (socket says 172.21.15.146:60462) 2023-10-03T10:15:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.806+0000 7f7409759700 1 -- 172.21.15.146:0/19172875 learned_addr learned my addr 172.21.15.146:0/19172875 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.806+0000 7f7409f5a700 1 --2- 172.21.15.146:0/19172875 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7404133900 0x7f740411a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.806+0000 7f740a75b700 1 --2- 172.21.15.146:0/19172875 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f74041c83f0 0x7f74041c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.807+0000 7f7409759700 1 -- 172.21.15.146:0/19172875 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f74041c83f0 msgr2=0x7f74041c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.807+0000 7f7409759700 1 --2- 172.21.15.146:0/19172875 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f74041c83f0 0x7f74041c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.807+0000 7f7409759700 1 -- 172.21.15.146:0/19172875 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7404133900 msgr2=0x7f740411a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.807+0000 7f7409759700 1 --2- 172.21.15.146:0/19172875 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7404133900 0x7f740411a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.807+0000 7f7409759700 1 -- 172.21.15.146:0/19172875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f4009550 con 0x7f7404139200 2023-10-03T10:15:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.807+0000 7f7409759700 1 --2- 172.21.15.146:0/19172875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7404139200 0x7f740411ae90 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f73f4013000 tx=0x7f73f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.807+0000 7f73fa7fc700 1 -- 172.21.15.146:0/19172875 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f4022e50 con 0x7f7404139200 2023-10-03T10:15:49.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.807+0000 7f73fa7fc700 1 -- 172.21.15.146:0/19172875 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f4004040 con 0x7f7404139200 2023-10-03T10:15:49.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.807+0000 7f740c1be700 1 -- 172.21.15.146:0/19172875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740409a2c0 con 0x7f7404139200 2023-10-03T10:15:49.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.807+0000 7f73fa7fc700 1 -- 172.21.15.146:0/19172875 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f40043f0 con 0x7f7404139200 2023-10-03T10:15:49.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.807+0000 7f740c1be700 1 -- 172.21.15.146:0/19172875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740411e200 con 0x7f7404139200 2023-10-03T10:15:49.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.808+0000 7f740c1be700 1 -- 172.21.15.146:0/19172875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f740411d430 con 0x7f7404139200 2023-10-03T10:15:49.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.809+0000 7f73fa7fc700 1 -- 172.21.15.146:0/19172875 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f73f402a030 con 0x7f7404139200 2023-10-03T10:15:49.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.809+0000 7f73fa7fc700 1 -- 172.21.15.146:0/19172875 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f73f40491c0 con 0x7f7404139200 2023-10-03T10:15:49.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.813+0000 7f73fa7fc700 1 -- 172.21.15.146:0/19172875 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73f4004550 con 0x7f7404139200 2023-10-03T10:15:49.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.817+0000 7fe4ae363700 1 Processor -- start 2023-10-03T10:15:49.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.817+0000 7fe4ae363700 1 -- start start 2023-10-03T10:15:49.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.817+0000 7fe4ae363700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4a80a0a70 0x7fe4a80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.817+0000 7fe4ae363700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe4a80a1380 0x7fe4a8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.817+0000 7fe4ae363700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a8133f50 0x7fe4a8134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.817+0000 7fe4ae363700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a809e9d0 con 0x7fe4a80a1380 2023-10-03T10:15:49.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.817+0000 7fe4ae363700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a809dc00 con 0x7fe4a8133f50 2023-10-03T10:15:49.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.817+0000 7fe4ae363700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a809dec0 con 0x7fe4a80a0a70 2023-10-03T10:15:49.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.817+0000 7fe4ac900700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a8133f50 0x7fe4a8134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.818+0000 7fe4ac900700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a8133f50 0x7fe4a8134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34846/0 (socket says 172.21.15.146:34846) 2023-10-03T10:15:49.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.818+0000 7fe4ac900700 1 -- 172.21.15.146:0/2865308136 learned_addr learned my addr 172.21.15.146:0/2865308136 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:49.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.818+0000 7fe4ac900700 1 -- 172.21.15.146:0/2865308136 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4a80a0a70 msgr2=0x7fe4a80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.818+0000 7fe4ac900700 1 --2- 172.21.15.146:0/2865308136 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4a80a0a70 0x7fe4a80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.818+0000 7fe4ac900700 1 -- 172.21.15.146:0/2865308136 >> v2:172.21.15.146:3300/0 conn(0x7fe4a80a1380 msgr2=0x7fe4a8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.818+0000 7fe4ac900700 1 --2- 172.21.15.146:0/2865308136 >> v2:172.21.15.146:3300/0 conn(0x7fe4a80a1380 0x7fe4a8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.818+0000 7fe4ac900700 1 -- 172.21.15.146:0/2865308136 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a809e6a0 con 0x7fe4a8133f50 2023-10-03T10:15:49.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.818+0000 7fe4ac900700 1 --2- 172.21.15.146:0/2865308136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a8133f50 0x7fe4a8134380 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009e50 tx=0x7fe4a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3285221ebb2ef62 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.818+0000 7fe4a6ffd700 1 -- 172.21.15.146:0/2865308136 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a000e070 con 0x7fe4a8133f50 2023-10-03T10:15:49.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.818+0000 7fe4a6ffd700 1 -- 172.21.15.146:0/2865308136 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a000b9c0 con 0x7fe4a8133f50 2023-10-03T10:15:49.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.818+0000 7fe4a6ffd700 1 -- 172.21.15.146:0/2865308136 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a000bd70 con 0x7fe4a8133f50 2023-10-03T10:15:49.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.819+0000 7fe4ae363700 1 -- 172.21.15.146:0/2865308136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a8133f50 msgr2=0x7fe4a8134380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.819+0000 7fe4ae363700 1 --2- 172.21.15.146:0/2865308136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a8133f50 0x7fe4a8134380 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009e50 tx=0x7fe4a000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:49.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.819+0000 7fe4ae363700 1 -- 172.21.15.146:0/2865308136 shutdown_connections 2023-10-03T10:15:49.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.819+0000 7fe4ae363700 1 --2- 172.21.15.146:0/2865308136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a8133f50 0x7fe4a8134380 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.819+0000 7fe4ae363700 1 --2- 172.21.15.146:0/2865308136 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4a80a0a70 0x7fe4a80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.819+0000 7fe4ae363700 1 --2- 172.21.15.146:0/2865308136 >> v2:172.21.15.146:3300/0 conn(0x7fe4a80a1380 0x7fe4a8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.819+0000 7fe4ae363700 1 -- 172.21.15.146:0/2865308136 >> 172.21.15.146:0/2865308136 conn(0x7fe4a80a6610 msgr2=0x7fe4a80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.819+0000 7fe4ae363700 1 -- 172.21.15.146:0/2865308136 shutdown_connections 2023-10-03T10:15:49.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.819+0000 7fe4ae363700 1 -- 172.21.15.146:0/2865308136 wait complete. 2023-10-03T10:15:49.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.820+0000 7fe4ae363700 1 Processor -- start 2023-10-03T10:15:49.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.820+0000 7fe4ae363700 1 -- start start 2023-10-03T10:15:49.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.820+0000 7fe4ae363700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a80a0a70 0x7fe4a8122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.820+0000 7fe4ae363700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4a80a1380 0x7fe4a8122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.820+0000 7fe4ae363700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4a8133f50 0x7fe4a81231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.820+0000 7fe4ae363700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a8124270 con 0x7fe4a8133f50 2023-10-03T10:15:49.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.820+0000 7fe4ae363700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a8125c50 con 0x7fe4a80a0a70 2023-10-03T10:15:49.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.820+0000 7fe4ae363700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a80a03e0 con 0x7fe4a80a1380 2023-10-03T10:15:49.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.821+0000 7fe4a7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a80a0a70 0x7fe4a8122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.821+0000 7fe4a7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a80a0a70 0x7fe4a8122750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34852/0 (socket says 172.21.15.146:34852) 2023-10-03T10:15:49.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.821+0000 7fe4a7fff700 1 -- 172.21.15.146:0/1576847562 learned_addr learned my addr 172.21.15.146:0/1576847562 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:49.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.821+0000 7fe4ac900700 1 --2- 172.21.15.146:0/1576847562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4a8133f50 0x7fe4a81231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.821+0000 7fe4a7fff700 1 -- 172.21.15.146:0/1576847562 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4a80a1380 msgr2=0x7fe4a8122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.821+0000 7fe4a7fff700 1 --2- 172.21.15.146:0/1576847562 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4a80a1380 0x7fe4a8122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.821+0000 7fe4a7fff700 1 -- 172.21.15.146:0/1576847562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4a8133f50 msgr2=0x7fe4a81231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.821+0000 7fe4a7fff700 1 --2- 172.21.15.146:0/1576847562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4a8133f50 0x7fe4a81231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.821+0000 7fe4a7fff700 1 -- 172.21.15.146:0/1576847562 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a0009b30 con 0x7fe4a80a0a70 2023-10-03T10:15:49.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.821+0000 7fe4a7fff700 1 --2- 172.21.15.146:0/1576847562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a80a0a70 0x7fe4a8122750 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe49800b4d0 tx=0x7fe49800b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.821+0000 7fe4a4ff9700 1 -- 172.21.15.146:0/1576847562 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498011830 con 0x7fe4a80a0a70 2023-10-03T10:15:49.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.821+0000 7fe4a4ff9700 1 -- 172.21.15.146:0/1576847562 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe498011990 con 0x7fe4a80a0a70 2023-10-03T10:15:49.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.821+0000 7fe4ae363700 1 -- 172.21.15.146:0/1576847562 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a8125f10 con 0x7fe4a80a0a70 2023-10-03T10:15:49.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.821+0000 7fe4a4ff9700 1 -- 172.21.15.146:0/1576847562 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498011d40 con 0x7fe4a80a0a70 2023-10-03T10:15:49.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.821+0000 7fe4ae363700 1 -- 172.21.15.146:0/1576847562 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a81261f0 con 0x7fe4a80a0a70 2023-10-03T10:15:49.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.822+0000 7fe4a4ff9700 1 -- 172.21.15.146:0/1576847562 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe49801a400 con 0x7fe4a80a0a70 2023-10-03T10:15:49.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.822+0000 7fe4ae363700 1 -- 172.21.15.146:0/1576847562 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a804f2a0 con 0x7fe4a80a0a70 2023-10-03T10:15:49.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.823+0000 7fe4a4ff9700 1 -- 172.21.15.146:0/1576847562 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe49800f4a0 con 0x7fe4a80a0a70 2023-10-03T10:15:49.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.832+0000 7fe4a4ff9700 1 -- 172.21.15.146:0/1576847562 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe498015020 con 0x7fe4a80a0a70 2023-10-03T10:15:49.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.963+0000 7f956c15c700 1 -- 172.21.15.146:0/2694704061 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f956406c3b0 con 0x7f9564135f20 2023-10-03T10:15:49.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.963+0000 7f955a7fc700 1 -- 172.21.15.146:0/2694704061 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f955c045030 con 0x7f9564135f20 2023-10-03T10:15:49.963 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:49.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.966+0000 7f956c15c700 1 -- 172.21.15.146:0/2694704061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9564135f20 msgr2=0x7f956411ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.966+0000 7f956c15c700 1 --2- 172.21.15.146:0/2694704061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9564135f20 0x7f956411ff60 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f955c00efc0 tx=0x7f955c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.966+0000 7f956c15c700 1 -- 172.21.15.146:0/2694704061 shutdown_connections 2023-10-03T10:15:49.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.966+0000 7f956c15c700 1 --2- 172.21.15.146:0/2694704061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9564135f20 0x7f956411ff60 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.966+0000 7f956c15c700 1 --2- 172.21.15.146:0/2694704061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f956409d860 0x7f956411f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.966+0000 7f956c15c700 1 --2- 172.21.15.146:0/2694704061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f956409e340 0x7f956411fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.966+0000 7f956c15c700 1 -- 172.21.15.146:0/2694704061 >> 172.21.15.146:0/2694704061 conn(0x7f9564099c40 msgr2=0x7f956406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.966+0000 7f956c15c700 1 -- 172.21.15.146:0/2694704061 shutdown_connections 2023-10-03T10:15:49.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:49.966+0000 7f956c15c700 1 -- 172.21.15.146:0/2694704061 wait complete. 2023-10-03T10:15:49.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:50.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.013+0000 7f2502627700 1 -- 172.21.15.146:0/1861470402 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f24fc12d970 con 0x7f24fc1300a0 2023-10-03T10:15:50.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.013+0000 7f24f8ff9700 1 -- 172.21.15.146:0/1861470402 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f24ec017090 con 0x7f24fc1300a0 2023-10-03T10:15:50.013 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:50.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.015+0000 7f2502627700 1 -- 172.21.15.146:0/1861470402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24fc1300a0 msgr2=0x7f24fc11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.015+0000 7f2502627700 1 --2- 172.21.15.146:0/1861470402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24fc1300a0 0x7f24fc11da40 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00e9e0 tx=0x7f24ec00ecf0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.015+0000 7f2502627700 1 -- 172.21.15.146:0/1861470402 shutdown_connections 2023-10-03T10:15:50.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.015+0000 7f2502627700 1 --2- 172.21.15.146:0/1861470402 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24fc133ad0 0x7f24fc11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.015+0000 7f2502627700 1 --2- 172.21.15.146:0/1861470402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24fc1300a0 0x7f24fc11da40 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.015+0000 7f2502627700 1 --2- 172.21.15.146:0/1861470402 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24fc1309f0 0x7f24fc11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.015+0000 7f2502627700 1 -- 172.21.15.146:0/1861470402 >> 172.21.15.146:0/1861470402 conn(0x7f24fc099c40 msgr2=0x7f24fc131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.015+0000 7f2502627700 1 -- 172.21.15.146:0/1861470402 shutdown_connections 2023-10-03T10:15:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.015+0000 7f2502627700 1 -- 172.21.15.146:0/1861470402 wait complete. 2023-10-03T10:15:50.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.026+0000 7fe4ae363700 1 -- 172.21.15.146:0/1576847562 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe4a80a4c70 con 0x7fe4a80a0a70 2023-10-03T10:15:50.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.027+0000 7fe4a4ff9700 1 -- 172.21.15.146:0/1576847562 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe498044060 con 0x7fe4a80a0a70 2023-10-03T10:15:50.027 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:50.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:50.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.029+0000 7fe4ae363700 1 -- 172.21.15.146:0/1576847562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a80a0a70 msgr2=0x7fe4a8122750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.029+0000 7fe4ae363700 1 --2- 172.21.15.146:0/1576847562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a80a0a70 0x7fe4a8122750 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe49800b4d0 tx=0x7fe49800b7e0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.029+0000 7fe4ae363700 1 -- 172.21.15.146:0/1576847562 shutdown_connections 2023-10-03T10:15:50.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.029+0000 7fe4ae363700 1 --2- 172.21.15.146:0/1576847562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4a8133f50 0x7fe4a81231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.029+0000 7fe4ae363700 1 --2- 172.21.15.146:0/1576847562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a80a0a70 0x7fe4a8122750 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.029+0000 7fe4ae363700 1 --2- 172.21.15.146:0/1576847562 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4a80a1380 0x7fe4a8122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.029+0000 7fe4ae363700 1 -- 172.21.15.146:0/1576847562 >> 172.21.15.146:0/1576847562 conn(0x7fe4a80a6610 msgr2=0x7fe4a809ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:50.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.029+0000 7fe4ae363700 1 -- 172.21.15.146:0/1576847562 shutdown_connections 2023-10-03T10:15:50.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.029+0000 7fe4ae363700 1 -- 172.21.15.146:0/1576847562 wait complete. 2023-10-03T10:15:50.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:50.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.043+0000 7f740c1be700 1 -- 172.21.15.146:0/19172875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f740411d430 con 0x7f7404139200 2023-10-03T10:15:50.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.043+0000 7f73fa7fc700 1 -- 172.21.15.146:0/19172875 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f740411d430 con 0x7f7404139200 2023-10-03T10:15:50.043 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:50.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.045+0000 7f740c1be700 1 -- 172.21.15.146:0/19172875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7404139200 msgr2=0x7f740411ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.045+0000 7f740c1be700 1 --2- 172.21.15.146:0/19172875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7404139200 0x7f740411ae90 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f73f4013000 tx=0x7f73f4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:50.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.045+0000 7f740c1be700 1 -- 172.21.15.146:0/19172875 shutdown_connections 2023-10-03T10:15:50.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.045+0000 7f740c1be700 1 --2- 172.21.15.146:0/19172875 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f74041c83f0 0x7f74041c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.045+0000 7f740c1be700 1 --2- 172.21.15.146:0/19172875 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7404133900 0x7f740411a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.045+0000 7f740c1be700 1 --2- 172.21.15.146:0/19172875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7404139200 0x7f740411ae90 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.045+0000 7f740c1be700 1 -- 172.21.15.146:0/19172875 >> 172.21.15.146:0/19172875 conn(0x7f74040a2980 msgr2=0x7f7404130170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:50.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.045+0000 7f740c1be700 1 -- 172.21.15.146:0/19172875 shutdown_connections 2023-10-03T10:15:50.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:50.045+0000 7f740c1be700 1 -- 172.21.15.146:0/19172875 wait complete. 2023-10-03T10:15:50.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:50.979 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:51.029 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:51.042 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:51.058 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:51.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.121+0000 7f986b9e3700 1 Processor -- start 2023-10-03T10:15:51.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.121+0000 7f986b9e3700 1 -- start start 2023-10-03T10:15:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.122+0000 7f986b9e3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f986409e340 0x7f98641359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.122+0000 7f986b9e3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9864135f20 0x7f9864138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.122+0000 7f986b9e3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986409aaa0 con 0x7f986409d860 2023-10-03T10:15:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.122+0000 7f986b9e3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986409e730 con 0x7f9864135f20 2023-10-03T10:15:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.122+0000 7f986b9e3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f986409f870 con 0x7f986409e340 2023-10-03T10:15:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.122+0000 7f986977f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f986409d860 0x7f986409dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40316/0 (socket says 172.21.15.146:40316) 2023-10-03T10:15:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.122+0000 7f986977f700 1 -- 172.21.15.146:0/3463860707 learned_addr learned my addr 172.21.15.146:0/3463860707 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.122+0000 7f9868f7e700 1 --2- 172.21.15.146:0/3463860707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f986409e340 0x7f98641359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.122+0000 7f9869f80700 1 --2- 172.21.15.146:0/3463860707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9864135f20 0x7f9864138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.123+0000 7f985bfff700 1 -- 172.21.15.146:0/3463860707 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014234039 0 0) 0x7f986409aaa0 con 0x7f986409d860 2023-10-03T10:15:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.123+0000 7f985bfff700 1 -- 172.21.15.146:0/3463860707 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98500057c0 con 0x7f986409d860 2023-10-03T10:15:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.123+0000 7f9868f7e700 1 -- 172.21.15.146:0/3463860707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9864135f20 msgr2=0x7f9864138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.123+0000 7f9868f7e700 1 --2- 172.21.15.146:0/3463860707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9864135f20 0x7f9864138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.123+0000 7f9868f7e700 1 -- 172.21.15.146:0/3463860707 >> v1:172.21.15.146:6789/0 conn(0x7f986409d860 legacy=0x7f986409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.123+0000 7f9868f7e700 1 -- 172.21.15.146:0/3463860707 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986409b360 con 0x7f986409e340 2023-10-03T10:15:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.123+0000 7f9869f80700 1 --2- 172.21.15.146:0/3463860707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9864135f20 0x7f9864138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.123+0000 7f9868f7e700 1 --2- 172.21.15.146:0/3463860707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f986409e340 0x7f98641359e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f98540098a0 tx=0x7f9854009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b5776bc490c3cb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.123+0000 7f985bfff700 1 -- 172.21.15.146:0/3463860707 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854011830 con 0x7f986409e340 2023-10-03T10:15:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.123+0000 7f985bfff700 1 -- 172.21.15.146:0/3463860707 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9854011990 con 0x7f986409e340 2023-10-03T10:15:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.123+0000 7f985bfff700 1 -- 172.21.15.146:0/3463860707 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854011d20 con 0x7f986409e340 2023-10-03T10:15:51.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.124+0000 7f986b9e3700 1 -- 172.21.15.146:0/3463860707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f986409e340 msgr2=0x7f98641359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.124+0000 7f986b9e3700 1 --2- 172.21.15.146:0/3463860707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f986409e340 0x7f98641359e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f98540098a0 tx=0x7f9854009bb0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.124+0000 7f986b9e3700 1 -- 172.21.15.146:0/3463860707 shutdown_connections 2023-10-03T10:15:51.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.124+0000 7f986b9e3700 1 --2- 172.21.15.146:0/3463860707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9864135f20 0x7f9864138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.124+0000 7f986b9e3700 1 --2- 172.21.15.146:0/3463860707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f986409e340 0x7f98641359e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.124+0000 7f986b9e3700 1 -- 172.21.15.146:0/3463860707 >> 172.21.15.146:0/3463860707 conn(0x7f9864099c40 msgr2=0x7f98640a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.124+0000 7f986b9e3700 1 -- 172.21.15.146:0/3463860707 shutdown_connections 2023-10-03T10:15:51.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.124+0000 7f986b9e3700 1 -- 172.21.15.146:0/3463860707 wait complete. 2023-10-03T10:15:51.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.125+0000 7f986b9e3700 1 Processor -- start 2023-10-03T10:15:51.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.125+0000 7f986b9e3700 1 -- start start 2023-10-03T10:15:51.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.126+0000 7f986b9e3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f986409d860 0x7f986411b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.126+0000 7f986b9e3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f986409e340 0x7f986411b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.126+0000 7f986b9e3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9864135f20 0x7f986411bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.126+0000 7f986b9e3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986411c800 con 0x7f986409e340 2023-10-03T10:15:51.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.126+0000 7f986b9e3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986411e940 con 0x7f9864135f20 2023-10-03T10:15:51.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.126+0000 7f986b9e3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98640a2020 con 0x7f986409d860 2023-10-03T10:15:51.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.126+0000 7f9869f80700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9864135f20 0x7f986411bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.126+0000 7f9869f80700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9864135f20 0x7f986411bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34866/0 (socket says 172.21.15.146:34866) 2023-10-03T10:15:51.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.126+0000 7f9869f80700 1 -- 172.21.15.146:0/38265272 learned_addr learned my addr 172.21.15.146:0/38265272 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:51.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.126+0000 7f9868f7e700 1 --2- 172.21.15.146:0/38265272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f986409e340 0x7f986411b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.126+0000 7f986977f700 1 --2- 172.21.15.146:0/38265272 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f986409d860 0x7f986411b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.126+0000 7f9869f80700 1 -- 172.21.15.146:0/38265272 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f986409d860 msgr2=0x7f986411b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.126+0000 7f9869f80700 1 --2- 172.21.15.146:0/38265272 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f986409d860 0x7f986411b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.126+0000 7f9869f80700 1 -- 172.21.15.146:0/38265272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f986409e340 msgr2=0x7f986411b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.126+0000 7f9869f80700 1 --2- 172.21.15.146:0/38265272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f986409e340 0x7f986411b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.126+0000 7f9869f80700 1 -- 172.21.15.146:0/38265272 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c009a70 con 0x7f9864135f20 2023-10-03T10:15:51.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.126+0000 7f9868f7e700 1 --2- 172.21.15.146:0/38265272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f986409e340 0x7f986411b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:51.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.126+0000 7f9869f80700 1 --2- 172.21.15.146:0/38265272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9864135f20 0x7f986411bdb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f985c009f00 tx=0x7f985c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.127+0000 7f9859ffb700 1 -- 172.21.15.146:0/38265272 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c009d70 con 0x7f9864135f20 2023-10-03T10:15:51.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.127+0000 7f9859ffb700 1 -- 172.21.15.146:0/38265272 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c00f040 con 0x7f9864135f20 2023-10-03T10:15:51.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.127+0000 7f9859ffb700 1 -- 172.21.15.146:0/38265272 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c00ce20 con 0x7f9864135f20 2023-10-03T10:15:51.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.127+0000 7f986b9e3700 1 -- 172.21.15.146:0/38265272 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98540094a0 con 0x7f9864135f20 2023-10-03T10:15:51.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.127+0000 7f986b9e3700 1 -- 172.21.15.146:0/38265272 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986409c910 con 0x7f9864135f20 2023-10-03T10:15:51.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.128+0000 7f986b9e3700 1 -- 172.21.15.146:0/38265272 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f986411e1a0 con 0x7f9864135f20 2023-10-03T10:15:51.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.129+0000 7f9859ffb700 1 -- 172.21.15.146:0/38265272 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f985c003a20 con 0x7f9864135f20 2023-10-03T10:15:51.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.129+0000 7f9859ffb700 1 -- 172.21.15.146:0/38265272 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f985c040650 con 0x7f9864135f20 2023-10-03T10:15:51.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.137+0000 7f9859ffb700 1 -- 172.21.15.146:0/38265272 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f985c01c3b0 con 0x7f9864135f20 2023-10-03T10:15:51.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.171+0000 7fcfc0b4e700 1 Processor -- start 2023-10-03T10:15:51.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.171+0000 7fcfc0b4e700 1 -- start start 2023-10-03T10:15:51.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.172+0000 7fcfc0b4e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfbc0a0a30 0x7fcfbc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.172+0000 7fcfc0b4e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcfbc0a1340 0x7fcfbc12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.172+0000 7fcfc0b4e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfbc0a1e70 con 0x7fcfbc1304a0 2023-10-03T10:15:51.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.172+0000 7fcfc0b4e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfbc09a720 con 0x7fcfbc0a1340 2023-10-03T10:15:51.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.172+0000 7fcfc0b4e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc09b300 con 0x7fcfbc0a0a30 2023-10-03T10:15:51.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.172+0000 7fcfbad9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcfbc1304a0 0x7fcfbc1371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40324/0 (socket says 172.21.15.146:40324) 2023-10-03T10:15:51.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.172+0000 7fcfbad9d700 1 -- 172.21.15.146:0/2319636476 learned_addr learned my addr 172.21.15.146:0/2319636476 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:51.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.172+0000 7fcfb9d9b700 1 --2- 172.21.15.146:0/2319636476 >> v2:172.21.15.146:3300/0 conn(0x7fcfbc0a1340 0x7fcfbc12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.172+0000 7fcfba59c700 1 --2- 172.21.15.146:0/2319636476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfbc0a0a30 0x7fcfbc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.172+0000 7fcfb959a700 1 -- 172.21.15.146:0/2319636476 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119416400 0 0) 0x7fcfbc0a1e70 con 0x7fcfbc1304a0 2023-10-03T10:15:51.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.172+0000 7fcfb9d9b700 1 -- 172.21.15.146:0/2319636476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfbc0a0a30 msgr2=0x7fcfbc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:51.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.172+0000 7fcfb9d9b700 1 --2- 172.21.15.146:0/2319636476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfbc0a0a30 0x7fcfbc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.172+0000 7fcfb9d9b700 1 -- 172.21.15.146:0/2319636476 >> v1:172.21.15.146:6789/0 conn(0x7fcfbc1304a0 legacy=0x7fcfbc1371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.172+0000 7fcfb9d9b700 1 -- 172.21.15.146:0/2319636476 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc09abc0 con 0x7fcfbc0a1340 2023-10-03T10:15:51.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.173+0000 7fcfb9d9b700 1 --2- 172.21.15.146:0/2319636476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfbc0a1340 0x7fcfbc12ff60 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000a950 tx=0x7fcfb000ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10bdf3a28a94e74c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.173+0000 7fcfb959a700 1 -- 172.21.15.146:0/2319636476 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb000c870 con 0x7fcfbc0a1340 2023-10-03T10:15:51.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.173+0000 7fcfb959a700 1 -- 172.21.15.146:0/2319636476 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb000c9d0 con 0x7fcfbc0a1340 2023-10-03T10:15:51.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.173+0000 7fcfb959a700 1 -- 172.21.15.146:0/2319636476 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb000cd80 con 0x7fcfbc0a1340 2023-10-03T10:15:51.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.173+0000 7fcfc0b4e700 1 -- 172.21.15.146:0/2319636476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfbc0a1340 msgr2=0x7fcfbc12ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.173+0000 7fcfc0b4e700 1 --2- 172.21.15.146:0/2319636476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfbc0a1340 0x7fcfbc12ff60 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000a950 tx=0x7fcfb000ac60 comp rx=0 tx=0).stop 2023-10-03T10:15:51.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.174+0000 7fcfc0b4e700 1 -- 172.21.15.146:0/2319636476 shutdown_connections 2023-10-03T10:15:51.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.174+0000 7fcfc0b4e700 1 --2- 172.21.15.146:0/2319636476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfbc0a0a30 0x7fcfbc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.174+0000 7fcfc0b4e700 1 --2- 172.21.15.146:0/2319636476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfbc0a1340 0x7fcfbc12ff60 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.174+0000 7fcfc0b4e700 1 -- 172.21.15.146:0/2319636476 >> 172.21.15.146:0/2319636476 conn(0x7fcfbc0a2980 msgr2=0x7fcfbc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.174+0000 7fcfc0b4e700 1 -- 172.21.15.146:0/2319636476 shutdown_connections 2023-10-03T10:15:51.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.174+0000 7fcfc0b4e700 1 -- 172.21.15.146:0/2319636476 wait complete. 2023-10-03T10:15:51.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.175+0000 7fcfc0b4e700 1 Processor -- start 2023-10-03T10:15:51.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.175+0000 7fcfc0b4e700 1 -- start start 2023-10-03T10:15:51.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.176+0000 7fcfc0b4e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfbc0a0a30 0x7fcfbc11aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.176+0000 7fcfc0b4e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfbc0a1340 0x7fcfbc11b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.176+0000 7fcfc0b4e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfbc1304a0 0x7fcfbc11b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.176+0000 7fcfc0b4e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc12fdc0 con 0x7fcfbc1304a0 2023-10-03T10:15:51.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.176+0000 7fcfc0b4e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc12fa10 con 0x7fcfbc0a0a30 2023-10-03T10:15:51.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.176+0000 7fcfc0b4e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc11e670 con 0x7fcfbc0a1340 2023-10-03T10:15:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.176+0000 7fcfba59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfbc0a0a30 0x7fcfbc11aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.176+0000 7fcfba59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfbc0a0a30 0x7fcfbc11aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34898/0 (socket says 172.21.15.146:34898) 2023-10-03T10:15:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.176+0000 7fcfba59c700 1 -- 172.21.15.146:0/670274358 learned_addr learned my addr 172.21.15.146:0/670274358 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.176+0000 7fcfbad9d700 1 --2- 172.21.15.146:0/670274358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfbc1304a0 0x7fcfbc11b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.176+0000 7fcfb9d9b700 1 --2- 172.21.15.146:0/670274358 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfbc0a1340 0x7fcfbc11b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.177+0000 7fcfba59c700 1 -- 172.21.15.146:0/670274358 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfbc0a1340 msgr2=0x7fcfbc11b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.177+0000 7fcfba59c700 1 --2- 172.21.15.146:0/670274358 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfbc0a1340 0x7fcfbc11b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.177+0000 7fcfba59c700 1 -- 172.21.15.146:0/670274358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfbc1304a0 msgr2=0x7fcfbc11b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.177+0000 7fcfba59c700 1 --2- 172.21.15.146:0/670274358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfbc1304a0 0x7fcfbc11b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.177+0000 7fcfba59c700 1 -- 172.21.15.146:0/670274358 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb000a5b0 con 0x7fcfbc0a0a30 2023-10-03T10:15:51.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.177+0000 7fcfba59c700 1 --2- 172.21.15.146:0/670274358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfbc0a0a30 0x7fcfbc11aec0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcfac010bd0 tx=0x7fcfac010ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.177+0000 7fcfaaffd700 1 -- 172.21.15.146:0/670274358 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac0096f0 con 0x7fcfbc0a0a30 2023-10-03T10:15:51.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.177+0000 7fcfc0b4e700 1 -- 172.21.15.146:0/670274358 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfbc11cb50 con 0x7fcfbc0a0a30 2023-10-03T10:15:51.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.177+0000 7fcfaaffd700 1 -- 172.21.15.146:0/670274358 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac00ed20 con 0x7fcfbc0a0a30 2023-10-03T10:15:51.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.177+0000 7fcfaaffd700 1 -- 172.21.15.146:0/670274358 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac011650 con 0x7fcfbc0a0a30 2023-10-03T10:15:51.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.177+0000 7fcfc0b4e700 1 -- 172.21.15.146:0/670274358 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfbc11cf90 con 0x7fcfbc0a0a30 2023-10-03T10:15:51.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.178+0000 7fcfc0b4e700 1 -- 172.21.15.146:0/670274358 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfbc11e460 con 0x7fcfbc0a0a30 2023-10-03T10:15:51.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.179+0000 7fcfaaffd700 1 -- 172.21.15.146:0/670274358 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcfac0117b0 con 0x7fcfbc0a0a30 2023-10-03T10:15:51.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.179+0000 7fcfaaffd700 1 -- 172.21.15.146:0/670274358 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcfac042240 con 0x7fcfbc0a0a30 2023-10-03T10:15:51.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.187+0000 7fcfaaffd700 1 -- 172.21.15.146:0/670274358 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcfac018990 con 0x7fcfbc0a0a30 2023-10-03T10:15:51.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.208+0000 7fe15bb33700 1 Processor -- start 2023-10-03T10:15:51.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.208+0000 7fe15bb33700 1 -- start start 2023-10-03T10:15:51.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.209+0000 7fe15bb33700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe15409e870 0x7fe15409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.209+0000 7fe15bb33700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe154131f40 0x7fe154139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.209+0000 7fe15bb33700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15409c970 con 0x7fe15409f180 2023-10-03T10:15:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.209+0000 7fe15bb33700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1540a0920 con 0x7fe154131f40 2023-10-03T10:15:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.209+0000 7fe15bb33700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe15409f9c0 con 0x7fe15409e870 2023-10-03T10:15:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.209+0000 7fe1590ce700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe15409f180 0x7fe154131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40330/0 (socket says 172.21.15.146:40330) 2023-10-03T10:15:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.209+0000 7fe1598cf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe15409e870 0x7fe15409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.209+0000 7fe1590ce700 1 -- 172.21.15.146:0/3870829198 learned_addr learned my addr 172.21.15.146:0/3870829198 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.209+0000 7fe15a0d0700 1 --2- 172.21.15.146:0/3870829198 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe154131f40 0x7fe154139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.209+0000 7fe1598cf700 1 -- 172.21.15.146:0/3870829198 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe154131f40 msgr2=0x7fe154139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:51.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.209+0000 7fe1598cf700 1 --2- 172.21.15.146:0/3870829198 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe154131f40 0x7fe154139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.209+0000 7fe1598cf700 1 -- 172.21.15.146:0/3870829198 >> v1:172.21.15.146:6789/0 conn(0x7fe15409f180 legacy=0x7fe154131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.209+0000 7fe1588cd700 1 -- 172.21.15.146:0/3870829198 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065760506 0 0) 0x7fe15409c970 con 0x7fe15409f180 2023-10-03T10:15:51.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.209+0000 7fe1598cf700 1 -- 172.21.15.146:0/3870829198 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15409bab0 con 0x7fe15409e870 2023-10-03T10:15:51.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.210+0000 7fe1598cf700 1 --2- 172.21.15.146:0/3870829198 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe15409e870 0x7fe15409ec40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe150009870 tx=0x7fe150009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2141223e715a4554 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.210+0000 7fe1588cd700 1 -- 172.21.15.146:0/3870829198 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150011830 con 0x7fe15409e870 2023-10-03T10:15:51.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.210+0000 7fe1588cd700 1 -- 172.21.15.146:0/3870829198 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe150011990 con 0x7fe15409e870 2023-10-03T10:15:51.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.210+0000 7fe1588cd700 1 -- 172.21.15.146:0/3870829198 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150011d20 con 0x7fe15409e870 2023-10-03T10:15:51.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.210+0000 7fe15bb33700 1 -- 172.21.15.146:0/3870829198 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe15409e870 msgr2=0x7fe15409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.210+0000 7fe15bb33700 1 --2- 172.21.15.146:0/3870829198 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe15409e870 0x7fe15409ec40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe150009870 tx=0x7fe150009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:51.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.210+0000 7fe15bb33700 1 -- 172.21.15.146:0/3870829198 shutdown_connections 2023-10-03T10:15:51.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.210+0000 7fe15bb33700 1 --2- 172.21.15.146:0/3870829198 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe154131f40 0x7fe154139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.210+0000 7fe15bb33700 1 --2- 172.21.15.146:0/3870829198 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe15409e870 0x7fe15409ec40 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.210+0000 7fe15bb33700 1 -- 172.21.15.146:0/3870829198 >> 172.21.15.146:0/3870829198 conn(0x7fe1540a4430 msgr2=0x7fe1540a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.211+0000 7fe15bb33700 1 -- 172.21.15.146:0/3870829198 shutdown_connections 2023-10-03T10:15:51.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.211+0000 7fe15bb33700 1 -- 172.21.15.146:0/3870829198 wait complete. 2023-10-03T10:15:51.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.212+0000 7fe15bb33700 1 Processor -- start 2023-10-03T10:15:51.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.212+0000 7fe15bb33700 1 -- start start 2023-10-03T10:15:51.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.212+0000 7fe15bb33700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe15409e870 0x7fe1541c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.212+0000 7fe15bb33700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe15409f180 0x7fe1541c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.212+0000 7fe15bb33700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe154131f40 0x7fe1541c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.212+0000 7fe15bb33700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15411e6d0 con 0x7fe15409e870 2023-10-03T10:15:51.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.212+0000 7fe15bb33700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15411e4e0 con 0x7fe154131f40 2023-10-03T10:15:51.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.212+0000 7fe15bb33700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1541203f0 con 0x7fe15409f180 2023-10-03T10:15:51.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.213+0000 7fe15a0d0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe154131f40 0x7fe1541c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.213+0000 7fe15a0d0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe154131f40 0x7fe1541c6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34928/0 (socket says 172.21.15.146:34928) 2023-10-03T10:15:51.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.213+0000 7fe15a0d0700 1 -- 172.21.15.146:0/535728894 learned_addr learned my addr 172.21.15.146:0/535728894 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:51.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.213+0000 7fe1598cf700 1 --2- 172.21.15.146:0/535728894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe15409e870 0x7fe1541c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.213+0000 7fe1590ce700 1 --2- 172.21.15.146:0/535728894 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe15409f180 0x7fe1541c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.213+0000 7fe15a0d0700 1 -- 172.21.15.146:0/535728894 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe15409f180 msgr2=0x7fe1541c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.213+0000 7fe15a0d0700 1 --2- 172.21.15.146:0/535728894 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe15409f180 0x7fe1541c65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.213+0000 7fe15a0d0700 1 -- 172.21.15.146:0/535728894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe15409e870 msgr2=0x7fe1541c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.213+0000 7fe15a0d0700 1 --2- 172.21.15.146:0/535728894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe15409e870 0x7fe1541c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.213+0000 7fe15a0d0700 1 -- 172.21.15.146:0/535728894 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1500094a0 con 0x7fe154131f40 2023-10-03T10:15:51.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.213+0000 7fe15a0d0700 1 --2- 172.21.15.146:0/535728894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe154131f40 0x7fe1541c6b10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe14c00efc0 tx=0x7fe14c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.213+0000 7fe14a7fc700 1 -- 172.21.15.146:0/535728894 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c009ea0 con 0x7fe154131f40 2023-10-03T10:15:51.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.214+0000 7fe14a7fc700 1 -- 172.21.15.146:0/535728894 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c00f040 con 0x7fe154131f40 2023-10-03T10:15:51.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.214+0000 7fe15bb33700 1 -- 172.21.15.146:0/535728894 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1540a2de0 con 0x7fe154131f40 2023-10-03T10:15:51.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.214+0000 7fe15bb33700 1 -- 172.21.15.146:0/535728894 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15411ecd0 con 0x7fe154131f40 2023-10-03T10:15:51.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.214+0000 7fe14a7fc700 1 -- 172.21.15.146:0/535728894 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c00ced0 con 0x7fe154131f40 2023-10-03T10:15:51.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.215+0000 7fb8dd21c700 1 Processor -- start 2023-10-03T10:15:51.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.215+0000 7fe15bb33700 1 -- 172.21.15.146:0/535728894 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe13c0052e0 con 0x7fe154131f40 2023-10-03T10:15:51.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.215+0000 7fe14a7fc700 1 -- 172.21.15.146:0/535728894 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe14c014480 con 0x7fe154131f40 2023-10-03T10:15:51.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.215+0000 7fe14a7fc700 1 -- 172.21.15.146:0/535728894 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe14c0407b0 con 0x7fe154131f40 2023-10-03T10:15:51.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.215+0000 7fb8dd21c700 1 -- start start 2023-10-03T10:15:51.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.215+0000 7fb8dd21c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8d812f700 0x7fb8d812fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.215+0000 7fb8dd21c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8d809a0a0 0x7fb8d8130010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.215+0000 7fb8dd21c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8d80980c0 0x7fb8d8098540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.215+0000 7fb8dd21c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d8130550 con 0x7fb8d812f700 2023-10-03T10:15:51.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.215+0000 7fb8dd21c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d809a6c0 con 0x7fb8d80980c0 2023-10-03T10:15:51.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.215+0000 7fb8dd21c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d809ac80 con 0x7fb8d809a0a0 2023-10-03T10:15:51.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.216+0000 7fb8d659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8d809a0a0 0x7fb8d8130010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.216+0000 7fb8d659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8d809a0a0 0x7fb8d8130010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:44120/0 (socket says 172.21.15.146:44120) 2023-10-03T10:15:51.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.216+0000 7fb8d659c700 1 -- 172.21.15.146:0/887568538 learned_addr learned my addr 172.21.15.146:0/887568538 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:51.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.216+0000 7fb8d6d9d700 1 --2- 172.21.15.146:0/887568538 >> v2:172.21.15.146:3300/0 conn(0x7fb8d812f700 0x7fb8d812fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.216+0000 7fb8d659c700 1 -- 172.21.15.146:0/887568538 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8d80980c0 msgr2=0x7fb8d8098540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:51.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.216+0000 7fb8d659c700 1 --2- 172.21.15.146:0/887568538 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8d80980c0 0x7fb8d8098540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.216+0000 7fb8d659c700 1 -- 172.21.15.146:0/887568538 >> v2:172.21.15.146:3300/0 conn(0x7fb8d812f700 msgr2=0x7fb8d812fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:51.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.216+0000 7fb8d659c700 1 --2- 172.21.15.146:0/887568538 >> v2:172.21.15.146:3300/0 conn(0x7fb8d812f700 0x7fb8d812fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.216+0000 7fb8d659c700 1 -- 172.21.15.146:0/887568538 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d809bff0 con 0x7fb8d809a0a0 2023-10-03T10:15:51.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.216+0000 7fb8d6d9d700 1 --2- 172.21.15.146:0/887568538 >> v2:172.21.15.146:3300/0 conn(0x7fb8d812f700 0x7fb8d812fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:51.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.216+0000 7fb8d659c700 1 --2- 172.21.15.146:0/887568538 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8d809a0a0 0x7fb8d8130010 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0088f0 tx=0x7fb8cc008c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d1ae8e9cefa53c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.216+0000 7fb8d5d9b700 1 -- 172.21.15.146:0/887568538 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc00b590 con 0x7fb8d809a0a0 2023-10-03T10:15:51.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.216+0000 7fb8d5d9b700 1 -- 172.21.15.146:0/887568538 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8cc00b6f0 con 0x7fb8d809a0a0 2023-10-03T10:15:51.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.216+0000 7fb8d5d9b700 1 -- 172.21.15.146:0/887568538 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc00ba80 con 0x7fb8d809a0a0 2023-10-03T10:15:51.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.217+0000 7fb8dd21c700 1 -- 172.21.15.146:0/887568538 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8d809a0a0 msgr2=0x7fb8d8130010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.217+0000 7fb8dd21c700 1 --2- 172.21.15.146:0/887568538 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8d809a0a0 0x7fb8d8130010 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0088f0 tx=0x7fb8cc008c00 comp rx=0 tx=0).stop 2023-10-03T10:15:51.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.217+0000 7fb8dd21c700 1 -- 172.21.15.146:0/887568538 shutdown_connections 2023-10-03T10:15:51.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.217+0000 7fb8dd21c700 1 --2- 172.21.15.146:0/887568538 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8d80980c0 0x7fb8d8098540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.217+0000 7fb8dd21c700 1 --2- 172.21.15.146:0/887568538 >> v2:172.21.15.146:3300/0 conn(0x7fb8d812f700 0x7fb8d812fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.217+0000 7fb8dd21c700 1 --2- 172.21.15.146:0/887568538 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8d809a0a0 0x7fb8d8130010 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.217+0000 7fb8dd21c700 1 -- 172.21.15.146:0/887568538 >> 172.21.15.146:0/887568538 conn(0x7fb8d80a1ee0 msgr2=0x7fb8d80a22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.217+0000 7fb8dd21c700 1 -- 172.21.15.146:0/887568538 shutdown_connections 2023-10-03T10:15:51.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.217+0000 7fb8dd21c700 1 -- 172.21.15.146:0/887568538 wait complete. 2023-10-03T10:15:51.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.219+0000 7fb8dd21c700 1 Processor -- start 2023-10-03T10:15:51.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.219+0000 7fb8dd21c700 1 -- start start 2023-10-03T10:15:51.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.220+0000 7fe14a7fc700 1 -- 172.21.15.146:0/535728894 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe14c012930 con 0x7fe154131f40 2023-10-03T10:15:51.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.220+0000 7fb8dd21c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8d80980c0 0x7fb8d81cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.220+0000 7fb8dd21c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8d809a0a0 0x7fb8d81ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.220+0000 7fb8dd21c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8d812f700 0x7fb8d81cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.220+0000 7fb8dd21c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d8097170 con 0x7fb8d80980c0 2023-10-03T10:15:51.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.220+0000 7fb8dd21c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d8095500 con 0x7fb8d812f700 2023-10-03T10:15:51.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.220+0000 7fb8dd21c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d8129fd0 con 0x7fb8d809a0a0 2023-10-03T10:15:51.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.220+0000 7fb8d759e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8d812f700 0x7fb8d81cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.220+0000 7fb8d759e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8d812f700 0x7fb8d81cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34946/0 (socket says 172.21.15.146:34946) 2023-10-03T10:15:51.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.220+0000 7fb8d759e700 1 -- 172.21.15.146:0/698397535 learned_addr learned my addr 172.21.15.146:0/698397535 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:51.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.220+0000 7fb8d659c700 1 --2- 172.21.15.146:0/698397535 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8d809a0a0 0x7fb8d81ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.220+0000 7fb8d759e700 1 -- 172.21.15.146:0/698397535 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8d809a0a0 msgr2=0x7fb8d81ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.220+0000 7fb8d759e700 1 --2- 172.21.15.146:0/698397535 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8d809a0a0 0x7fb8d81ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.220+0000 7fb8d759e700 1 -- 172.21.15.146:0/698397535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8d80980c0 msgr2=0x7fb8d81cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.220+0000 7fb8d759e700 1 --2- 172.21.15.146:0/698397535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8d80980c0 0x7fb8d81cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.220+0000 7fb8d759e700 1 -- 172.21.15.146:0/698397535 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c80094a0 con 0x7fb8d812f700 2023-10-03T10:15:51.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.220+0000 7fb8d759e700 1 --2- 172.21.15.146:0/698397535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8d812f700 0x7fb8d81cd300 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000b970 tx=0x7fb8d000bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.221+0000 7fb8bf7fe700 1 -- 172.21.15.146:0/698397535 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d000c930 con 0x7fb8d812f700 2023-10-03T10:15:51.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.221+0000 7fb8dd21c700 1 -- 172.21.15.146:0/698397535 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8cc0085d0 con 0x7fb8d812f700 2023-10-03T10:15:51.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.221+0000 7fb8dd21c700 1 -- 172.21.15.146:0/698397535 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d806dad0 con 0x7fb8d812f700 2023-10-03T10:15:51.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.222+0000 7fb8bf7fe700 1 -- 172.21.15.146:0/698397535 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d000cab0 con 0x7fb8d812f700 2023-10-03T10:15:51.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.222+0000 7fb8dd21c700 1 -- 172.21.15.146:0/698397535 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d8096fb0 con 0x7fb8d812f700 2023-10-03T10:15:51.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.222+0000 7fb8bf7fe700 1 -- 172.21.15.146:0/698397535 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d000ce60 con 0x7fb8d812f700 2023-10-03T10:15:51.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.222+0000 7fb8bf7fe700 1 -- 172.21.15.146:0/698397535 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8d0014440 con 0x7fb8d812f700 2023-10-03T10:15:51.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.223+0000 7fb8bf7fe700 1 -- 172.21.15.146:0/698397535 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb8d0006e40 con 0x7fb8d812f700 2023-10-03T10:15:51.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.231+0000 7fb8bf7fe700 1 -- 172.21.15.146:0/698397535 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8d00133a0 con 0x7fb8d812f700 2023-10-03T10:15:51.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.343+0000 7f986b9e3700 1 -- 172.21.15.146:0/38265272 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f986411e1a0 con 0x7f9864135f20 2023-10-03T10:15:51.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.343+0000 7f9859ffb700 1 -- 172.21.15.146:0/38265272 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f986411e1a0 con 0x7f9864135f20 2023-10-03T10:15:51.343 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:51.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.345+0000 7f986b9e3700 1 -- 172.21.15.146:0/38265272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9864135f20 msgr2=0x7f986411bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.345+0000 7f986b9e3700 1 --2- 172.21.15.146:0/38265272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9864135f20 0x7f986411bdb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f985c009f00 tx=0x7f985c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.346+0000 7f986b9e3700 1 -- 172.21.15.146:0/38265272 shutdown_connections 2023-10-03T10:15:51.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.346+0000 7f986b9e3700 1 --2- 172.21.15.146:0/38265272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9864135f20 0x7f986411bdb0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.346+0000 7f986b9e3700 1 --2- 172.21.15.146:0/38265272 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f986409d860 0x7f986411b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.346+0000 7f986b9e3700 1 --2- 172.21.15.146:0/38265272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f986409e340 0x7f986411b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.346+0000 7f986b9e3700 1 -- 172.21.15.146:0/38265272 >> 172.21.15.146:0/38265272 conn(0x7f9864099c40 msgr2=0x7f98640a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.346+0000 7f986b9e3700 1 -- 172.21.15.146:0/38265272 shutdown_connections 2023-10-03T10:15:51.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.346+0000 7f986b9e3700 1 -- 172.21.15.146:0/38265272 wait complete. 2023-10-03T10:15:51.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:51.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.386+0000 7fcfc0b4e700 1 -- 172.21.15.146:0/670274358 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcfbc04f2a0 con 0x7fcfbc0a0a30 2023-10-03T10:15:51.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.387+0000 7fcfaaffd700 1 -- 172.21.15.146:0/670274358 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcfac01e020 con 0x7fcfbc0a0a30 2023-10-03T10:15:51.386 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:51.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.389+0000 7fcfc0b4e700 1 -- 172.21.15.146:0/670274358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfbc0a0a30 msgr2=0x7fcfbc11aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.389+0000 7fcfc0b4e700 1 --2- 172.21.15.146:0/670274358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfbc0a0a30 0x7fcfbc11aec0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcfac010bd0 tx=0x7fcfac010ee0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.389+0000 7fcfc0b4e700 1 -- 172.21.15.146:0/670274358 shutdown_connections 2023-10-03T10:15:51.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.389+0000 7fcfc0b4e700 1 --2- 172.21.15.146:0/670274358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfbc1304a0 0x7fcfbc11b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.389+0000 7fcfc0b4e700 1 --2- 172.21.15.146:0/670274358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfbc0a0a30 0x7fcfbc11aec0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.389+0000 7fcfc0b4e700 1 --2- 172.21.15.146:0/670274358 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfbc0a1340 0x7fcfbc11b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.389+0000 7fcfc0b4e700 1 -- 172.21.15.146:0/670274358 >> 172.21.15.146:0/670274358 conn(0x7fcfbc0a2980 msgr2=0x7fcfbc1b7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.389+0000 7fcfc0b4e700 1 -- 172.21.15.146:0/670274358 shutdown_connections 2023-10-03T10:15:51.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.389+0000 7fcfc0b4e700 1 -- 172.21.15.146:0/670274358 wait complete. 2023-10-03T10:15:51.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:51.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.420+0000 7fe15bb33700 1 -- 172.21.15.146:0/535728894 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe13c005860 con 0x7fe154131f40 2023-10-03T10:15:51.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.420+0000 7fe14a7fc700 1 -- 172.21.15.146:0/535728894 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe14c012340 con 0x7fe154131f40 2023-10-03T10:15:51.420 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.424+0000 7fe15bb33700 1 -- 172.21.15.146:0/535728894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe154131f40 msgr2=0x7fe1541c6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.424+0000 7fe15bb33700 1 --2- 172.21.15.146:0/535728894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe154131f40 0x7fe1541c6b10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe14c00efc0 tx=0x7fe14c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.424+0000 7fe15bb33700 1 -- 172.21.15.146:0/535728894 shutdown_connections 2023-10-03T10:15:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.424+0000 7fe15bb33700 1 --2- 172.21.15.146:0/535728894 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe154131f40 0x7fe1541c6b10 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.424+0000 7fe15bb33700 1 --2- 172.21.15.146:0/535728894 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe15409e870 0x7fe1541c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.424+0000 7fe15bb33700 1 --2- 172.21.15.146:0/535728894 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe15409f180 0x7fe1541c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.424+0000 7fe15bb33700 1 -- 172.21.15.146:0/535728894 >> 172.21.15.146:0/535728894 conn(0x7fe1540a4430 msgr2=0x7fe1541b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.424+0000 7fe15bb33700 1 -- 172.21.15.146:0/535728894 shutdown_connections 2023-10-03T10:15:51.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.424+0000 7fe15bb33700 1 -- 172.21.15.146:0/535728894 wait complete. 2023-10-03T10:15:51.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.431+0000 7fb8dd21c700 1 -- 172.21.15.146:0/698397535 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb8d804f2a0 con 0x7fb8d812f700 2023-10-03T10:15:51.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.431+0000 7fb8bf7fe700 1 -- 172.21.15.146:0/698397535 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb8d0019030 con 0x7fb8d812f700 2023-10-03T10:15:51.431 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:51.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.435+0000 7fb8dd21c700 1 -- 172.21.15.146:0/698397535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8d812f700 msgr2=0x7fb8d81cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.435+0000 7fb8dd21c700 1 --2- 172.21.15.146:0/698397535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8d812f700 0x7fb8d81cd300 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000b970 tx=0x7fb8d000bc80 comp rx=0 tx=0).stop 2023-10-03T10:15:51.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.435+0000 7fb8dd21c700 1 -- 172.21.15.146:0/698397535 shutdown_connections 2023-10-03T10:15:51.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.435+0000 7fb8dd21c700 1 --2- 172.21.15.146:0/698397535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8d812f700 0x7fb8d81cd300 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.435+0000 7fb8dd21c700 1 --2- 172.21.15.146:0/698397535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8d80980c0 0x7fb8d81cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.435+0000 7fb8dd21c700 1 --2- 172.21.15.146:0/698397535 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8d809a0a0 0x7fb8d81ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.435+0000 7fb8dd21c700 1 -- 172.21.15.146:0/698397535 >> 172.21.15.146:0/698397535 conn(0x7fb8d80a1ee0 msgr2=0x7fb8d809cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.435+0000 7fb8dd21c700 1 -- 172.21.15.146:0/698397535 shutdown_connections 2023-10-03T10:15:51.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:51.435+0000 7fb8dd21c700 1 -- 172.21.15.146:0/698397535 wait complete. 2023-10-03T10:15:51.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:51.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:52.358 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:52.401 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:52.440 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:52.448 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:52.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.509+0000 7f0897328700 1 Processor -- start 2023-10-03T10:15:52.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.509+0000 7f0897328700 1 -- start start 2023-10-03T10:15:52.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.510+0000 7f0897328700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f089009d860 0x7f089009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.510+0000 7f0897328700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f089009e170 0x7f08901307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.510+0000 7f0897328700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0890130ce0 0x7f0890131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.510+0000 7f0897328700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0890131670 con 0x7f089009d860 2023-10-03T10:15:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.510+0000 7f0897328700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089009aaa0 con 0x7f0890130ce0 2023-10-03T10:15:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.510+0000 7f0897328700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f089009f870 con 0x7f089009e170 2023-10-03T10:15:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.510+0000 7f08958c5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0890130ce0 0x7f0890131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.510+0000 7f08958c5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0890130ce0 0x7f0890131130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34960/0 (socket says 172.21.15.146:34960) 2023-10-03T10:15:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.510+0000 7f08958c5700 1 -- 172.21.15.146:0/1243525023 learned_addr learned my addr 172.21.15.146:0/1243525023 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.510+0000 7f08950c4700 1 --2- 172.21.15.146:0/1243525023 >> v2:172.21.15.146:3300/0 conn(0x7f089009d860 0x7f089009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.511+0000 7f08948c3700 1 --2- 172.21.15.146:0/1243525023 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f089009e170 0x7f08901307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.511+0000 7f08950c4700 1 -- 172.21.15.146:0/1243525023 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f089009e170 msgr2=0x7f08901307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.511+0000 7f08950c4700 1 --2- 172.21.15.146:0/1243525023 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f089009e170 0x7f08901307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.511+0000 7f08950c4700 1 -- 172.21.15.146:0/1243525023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0890130ce0 msgr2=0x7f0890131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.511+0000 7f08950c4700 1 --2- 172.21.15.146:0/1243525023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0890130ce0 0x7f0890131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.511+0000 7f08950c4700 1 -- 172.21.15.146:0/1243525023 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089009b360 con 0x7f089009d860 2023-10-03T10:15:52.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.511+0000 7f08948c3700 1 --2- 172.21.15.146:0/1243525023 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f089009e170 0x7f08901307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:52.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.511+0000 7f08950c4700 1 --2- 172.21.15.146:0/1243525023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f089009d860 0x7f089009dc30 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f088c009870 tx=0x7f088c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec93c41a001f4c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.511+0000 7f0887fff700 1 -- 172.21.15.146:0/1243525023 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c011830 con 0x7f089009d860 2023-10-03T10:15:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.511+0000 7f0887fff700 1 -- 172.21.15.146:0/1243525023 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088c011990 con 0x7f089009d860 2023-10-03T10:15:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.511+0000 7f0887fff700 1 -- 172.21.15.146:0/1243525023 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c011d20 con 0x7f089009d860 2023-10-03T10:15:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.512+0000 7f0897328700 1 -- 172.21.15.146:0/1243525023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f089009d860 msgr2=0x7f089009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.512+0000 7f0897328700 1 --2- 172.21.15.146:0/1243525023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f089009d860 0x7f089009dc30 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f088c009870 tx=0x7f088c009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.512+0000 7f0897328700 1 -- 172.21.15.146:0/1243525023 shutdown_connections 2023-10-03T10:15:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.512+0000 7f0897328700 1 --2- 172.21.15.146:0/1243525023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0890130ce0 0x7f0890131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.512+0000 7f0897328700 1 --2- 172.21.15.146:0/1243525023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f089009d860 0x7f089009dc30 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.512+0000 7f0897328700 1 --2- 172.21.15.146:0/1243525023 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f089009e170 0x7f08901307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.512+0000 7f0897328700 1 -- 172.21.15.146:0/1243525023 >> 172.21.15.146:0/1243525023 conn(0x7f0890099c40 msgr2=0x7f08900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.512+0000 7f0897328700 1 -- 172.21.15.146:0/1243525023 shutdown_connections 2023-10-03T10:15:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.512+0000 7f0897328700 1 -- 172.21.15.146:0/1243525023 wait complete. 2023-10-03T10:15:52.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.513+0000 7f0897328700 1 Processor -- start 2023-10-03T10:15:52.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.513+0000 7f0897328700 1 -- start start 2023-10-03T10:15:52.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.513+0000 7f0897328700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f089009d860 0x7f08901b7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.513+0000 7f0897328700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f089009e170 0x7f08901b84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.513+0000 7f0897328700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0890130ce0 0x7f08901b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.514+0000 7f0897328700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089012d9e0 con 0x7f0890130ce0 2023-10-03T10:15:52.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.514+0000 7f0897328700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089011dad0 con 0x7f089009d860 2023-10-03T10:15:52.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.514+0000 7f0897328700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f089011dd00 con 0x7f089009e170 2023-10-03T10:15:52.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.514+0000 7f08958c5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0890130ce0 0x7f08901b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.514+0000 7f08958c5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0890130ce0 0x7f08901b89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60562/0 (socket says 172.21.15.146:60562) 2023-10-03T10:15:52.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.514+0000 7f08958c5700 1 -- 172.21.15.146:0/3551725942 learned_addr learned my addr 172.21.15.146:0/3551725942 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:52.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.514+0000 7f08958c5700 1 -- 172.21.15.146:0/3551725942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f089009e170 msgr2=0x7f08901b84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.514+0000 7f08958c5700 1 --2- 172.21.15.146:0/3551725942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f089009e170 0x7f08901b84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.514+0000 7f08958c5700 1 -- 172.21.15.146:0/3551725942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f089009d860 msgr2=0x7f08901b7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.514+0000 7f08958c5700 1 --2- 172.21.15.146:0/3551725942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f089009d860 0x7f08901b7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.514+0000 7f08958c5700 1 -- 172.21.15.146:0/3551725942 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088c0094a0 con 0x7f0890130ce0 2023-10-03T10:15:52.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.514+0000 7f08958c5700 1 --2- 172.21.15.146:0/3551725942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0890130ce0 0x7f08901b89e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f088800efc0 tx=0x7f088800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.514+0000 7f0885ffb700 1 -- 172.21.15.146:0/3551725942 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0888003c20 con 0x7f0890130ce0 2023-10-03T10:15:52.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.514+0000 7f0885ffb700 1 -- 172.21.15.146:0/3551725942 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088800f040 con 0x7f0890130ce0 2023-10-03T10:15:52.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.514+0000 7f0885ffb700 1 -- 172.21.15.146:0/3551725942 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088800c930 con 0x7f0890130ce0 2023-10-03T10:15:52.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.515+0000 7f0897328700 1 -- 172.21.15.146:0/3551725942 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08900a0580 con 0x7f0890130ce0 2023-10-03T10:15:52.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.516+0000 7f0897328700 1 -- 172.21.15.146:0/3551725942 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08901bae50 con 0x7f0890130ce0 2023-10-03T10:15:52.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.516+0000 7f0885ffb700 1 -- 172.21.15.146:0/3551725942 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f088800ca90 con 0x7f0890130ce0 2023-10-03T10:15:52.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.516+0000 7f0885ffb700 1 -- 172.21.15.146:0/3551725942 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f088803fb80 con 0x7f0890130ce0 2023-10-03T10:15:52.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.517+0000 7f0897328700 1 -- 172.21.15.146:0/3551725942 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f089011e830 con 0x7f0890130ce0 2023-10-03T10:15:52.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.522+0000 7f0885ffb700 1 -- 172.21.15.146:0/3551725942 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f088803fe60 con 0x7f0890130ce0 2023-10-03T10:15:52.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.559+0000 7f7d38724700 1 Processor -- start 2023-10-03T10:15:52.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.559+0000 7f7d38724700 1 -- start start 2023-10-03T10:15:52.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.560+0000 7f7d38724700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d30133900 0x7f7d30133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.560+0000 7f7d38724700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7d30134210 0x7f7d300a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.560+0000 7f7d38724700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d3009a760 con 0x7f7d300a0ee0 2023-10-03T10:15:52.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.560+0000 7f7d38724700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d301336e0 con 0x7f7d30134210 2023-10-03T10:15:52.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.560+0000 7f7d38724700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3009a080 con 0x7f7d30133900 2023-10-03T10:15:52.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.560+0000 7f7d35cbf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7d30134210 0x7f7d300a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.560+0000 7f7d36cc1700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7d300a0ee0 0x7f7d3013a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40340/0 (socket says 172.21.15.146:40340) 2023-10-03T10:15:52.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.560+0000 7f7d36cc1700 1 -- 172.21.15.146:0/3718686525 learned_addr learned my addr 172.21.15.146:0/3718686525 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:52.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.560+0000 7f7d364c0700 1 --2- 172.21.15.146:0/3718686525 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d30133900 0x7f7d30133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.561+0000 7f7d35cbf700 1 -- 172.21.15.146:0/3718686525 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d30133900 msgr2=0x7f7d30133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.561+0000 7f7d35cbf700 1 --2- 172.21.15.146:0/3718686525 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d30133900 0x7f7d30133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.561+0000 7f7d35cbf700 1 -- 172.21.15.146:0/3718686525 >> v1:172.21.15.146:6789/0 conn(0x7f7d300a0ee0 legacy=0x7f7d3013a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.561+0000 7f7d35cbf700 1 -- 172.21.15.146:0/3718686525 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d300a23e0 con 0x7f7d30134210 2023-10-03T10:15:52.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.561+0000 7f7d35cbf700 1 --2- 172.21.15.146:0/3718686525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d30134210 0x7f7d300a09a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f7d20009840 tx=0x7f7d20009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c409136bcf92f925 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.561+0000 7f7d354be700 1 -- 172.21.15.146:0/3718686525 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d20011830 con 0x7f7d30134210 2023-10-03T10:15:52.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.561+0000 7f7d354be700 1 -- 172.21.15.146:0/3718686525 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d20011990 con 0x7f7d30134210 2023-10-03T10:15:52.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.561+0000 7f7d354be700 1 -- 172.21.15.146:0/3718686525 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d20011d20 con 0x7f7d30134210 2023-10-03T10:15:52.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.562+0000 7f7d38724700 1 -- 172.21.15.146:0/3718686525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d30134210 msgr2=0x7f7d300a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.562+0000 7f7d38724700 1 --2- 172.21.15.146:0/3718686525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d30134210 0x7f7d300a09a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f7d20009840 tx=0x7f7d20009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:52.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.562+0000 7f7d38724700 1 -- 172.21.15.146:0/3718686525 shutdown_connections 2023-10-03T10:15:52.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.562+0000 7f7d38724700 1 --2- 172.21.15.146:0/3718686525 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d30133900 0x7f7d30133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.562+0000 7f7d38724700 1 --2- 172.21.15.146:0/3718686525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d30134210 0x7f7d300a09a0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.562+0000 7f7d38724700 1 -- 172.21.15.146:0/3718686525 >> 172.21.15.146:0/3718686525 conn(0x7f7d300a2980 msgr2=0x7f7d300a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.562+0000 7f7d38724700 1 -- 172.21.15.146:0/3718686525 shutdown_connections 2023-10-03T10:15:52.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.562+0000 7f7d38724700 1 -- 172.21.15.146:0/3718686525 wait complete. 2023-10-03T10:15:52.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.563+0000 7f7d38724700 1 Processor -- start 2023-10-03T10:15:52.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.563+0000 7f7d38724700 1 -- start start 2023-10-03T10:15:52.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.564+0000 7f7d38724700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d300a0ee0 0x7f7d3011b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.564+0000 7f7d38724700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d30133900 0x7f7d3011bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.564+0000 7f7d38724700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d30134210 0x7f7d3011c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.564+0000 7f7d38724700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3011f2d0 con 0x7f7d30134210 2023-10-03T10:15:52.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.564+0000 7f7d38724700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3011d9a0 con 0x7f7d300a0ee0 2023-10-03T10:15:52.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.564+0000 7f7d38724700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3011ea60 con 0x7f7d30133900 2023-10-03T10:15:52.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.564+0000 7f7d364c0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d300a0ee0 0x7f7d3011b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.564+0000 7f7d364c0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d300a0ee0 0x7f7d3011b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:34992/0 (socket says 172.21.15.146:34992) 2023-10-03T10:15:52.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.564+0000 7f7d364c0700 1 -- 172.21.15.146:0/2862386772 learned_addr learned my addr 172.21.15.146:0/2862386772 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:52.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.564+0000 7f7d35cbf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d30133900 0x7f7d3011bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.564+0000 7f7d36cc1700 1 --2- 172.21.15.146:0/2862386772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d30134210 0x7f7d3011c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.565+0000 7f7d364c0700 1 -- 172.21.15.146:0/2862386772 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d30133900 msgr2=0x7f7d3011bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.565+0000 7f7d364c0700 1 --2- 172.21.15.146:0/2862386772 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d30133900 0x7f7d3011bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.565+0000 7f7d364c0700 1 -- 172.21.15.146:0/2862386772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d30134210 msgr2=0x7f7d3011c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.565+0000 7f7d364c0700 1 --2- 172.21.15.146:0/2862386772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d30134210 0x7f7d3011c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.565+0000 7f7d364c0700 1 -- 172.21.15.146:0/2862386772 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d200094a0 con 0x7f7d300a0ee0 2023-10-03T10:15:52.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.565+0000 7f7d36cc1700 1 --2- 172.21.15.146:0/2862386772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d30134210 0x7f7d3011c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:52.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.565+0000 7f7d35cbf700 1 --2- 172.21.15.146:0/2862386772 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d30133900 0x7f7d3011bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:52.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.565+0000 7f7d364c0700 1 --2- 172.21.15.146:0/2862386772 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d300a0ee0 0x7f7d3011b800 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c00e990 tx=0x7f7d2c00eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.566+0000 7f7d26ffd700 1 -- 172.21.15.146:0/2862386772 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c00eee0 con 0x7f7d300a0ee0 2023-10-03T10:15:52.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.566+0000 7f7d26ffd700 1 -- 172.21.15.146:0/2862386772 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2c00c850 con 0x7f7d300a0ee0 2023-10-03T10:15:52.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.566+0000 7f7d38724700 1 -- 172.21.15.146:0/2862386772 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d3009a2c0 con 0x7f7d300a0ee0 2023-10-03T10:15:52.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.566+0000 7f7d26ffd700 1 -- 172.21.15.146:0/2862386772 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c0096f0 con 0x7f7d300a0ee0 2023-10-03T10:15:52.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.566+0000 7f7d38724700 1 -- 172.21.15.146:0/2862386772 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d3011d3c0 con 0x7f7d300a0ee0 2023-10-03T10:15:52.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.566+0000 7f7d26ffd700 1 -- 172.21.15.146:0/2862386772 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d2c00cbc0 con 0x7f7d300a0ee0 2023-10-03T10:15:52.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.567+0000 7f7d26ffd700 1 -- 172.21.15.146:0/2862386772 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7d2c03fb30 con 0x7f7d300a0ee0 2023-10-03T10:15:52.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.567+0000 7f7d38724700 1 -- 172.21.15.146:0/2862386772 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d3011ec90 con 0x7f7d300a0ee0 2023-10-03T10:15:52.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.572+0000 7f7d26ffd700 1 -- 172.21.15.146:0/2862386772 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d3011ec90 con 0x7f7d300a0ee0 2023-10-03T10:15:52.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.585+0000 7f8822ac4700 1 Processor -- start 2023-10-03T10:15:52.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.585+0000 7f8822ac4700 1 -- start start 2023-10-03T10:15:52.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.585+0000 7f8822ac4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f881c09d860 0x7f881c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.585+0000 7f8822ac4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f881c09e170 0x7f881c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.586+0000 7f8822ac4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f881c130ce0 0x7f881c131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.586+0000 7f8822ac4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881c09aaa0 con 0x7f881c130ce0 2023-10-03T10:15:52.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.586+0000 7f8822ac4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881c09f870 con 0x7f881c09d860 2023-10-03T10:15:52.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.586+0000 7f8822ac4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f881c09b360 con 0x7f881c09e170 2023-10-03T10:15:52.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.586+0000 7f8821061700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f881c130ce0 0x7f881c131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.586+0000 7f8821061700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f881c130ce0 0x7f881c131150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60594/0 (socket says 172.21.15.146:60594) 2023-10-03T10:15:52.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.586+0000 7f8821061700 1 -- 172.21.15.146:0/1490516525 learned_addr learned my addr 172.21.15.146:0/1490516525 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:52.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.586+0000 7f8820860700 1 --2- 172.21.15.146:0/1490516525 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f881c09d860 0x7f881c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.586+0000 7f881bfff700 1 --2- 172.21.15.146:0/1490516525 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f881c09e170 0x7f881c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.586+0000 7f8820860700 1 -- 172.21.15.146:0/1490516525 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f881c09e170 msgr2=0x7f881c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.586+0000 7f8820860700 1 --2- 172.21.15.146:0/1490516525 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f881c09e170 0x7f881c1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.586+0000 7f8820860700 1 -- 172.21.15.146:0/1490516525 >> v2:172.21.15.146:3300/0 conn(0x7f881c130ce0 msgr2=0x7f881c131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.586+0000 7f8820860700 1 --2- 172.21.15.146:0/1490516525 >> v2:172.21.15.146:3300/0 conn(0x7f881c130ce0 0x7f881c131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.586+0000 7f8820860700 1 -- 172.21.15.146:0/1490516525 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c09b620 con 0x7f881c09d860 2023-10-03T10:15:52.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.586+0000 7f8820860700 1 --2- 172.21.15.146:0/1490516525 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f881c09d860 0x7f881c09dc30 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8810009840 tx=0x7f8810009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=616d6bfaa7e41217 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.587+0000 7f881b7fe700 1 -- 172.21.15.146:0/1490516525 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8810011830 con 0x7f881c09d860 2023-10-03T10:15:52.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.587+0000 7f881b7fe700 1 -- 172.21.15.146:0/1490516525 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8810011990 con 0x7f881c09d860 2023-10-03T10:15:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.587+0000 7f881b7fe700 1 -- 172.21.15.146:0/1490516525 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8810011d20 con 0x7f881c09d860 2023-10-03T10:15:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.587+0000 7f8822ac4700 1 -- 172.21.15.146:0/1490516525 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f881c09d860 msgr2=0x7f881c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.587+0000 7f8822ac4700 1 --2- 172.21.15.146:0/1490516525 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f881c09d860 0x7f881c09dc30 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8810009840 tx=0x7f8810009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.587+0000 7f8822ac4700 1 -- 172.21.15.146:0/1490516525 shutdown_connections 2023-10-03T10:15:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.587+0000 7f8822ac4700 1 --2- 172.21.15.146:0/1490516525 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f881c09d860 0x7f881c09dc30 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.587+0000 7f8822ac4700 1 --2- 172.21.15.146:0/1490516525 >> v2:172.21.15.146:3300/0 conn(0x7f881c130ce0 0x7f881c131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.587+0000 7f8822ac4700 1 --2- 172.21.15.146:0/1490516525 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f881c09e170 0x7f881c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.587+0000 7f8822ac4700 1 -- 172.21.15.146:0/1490516525 >> 172.21.15.146:0/1490516525 conn(0x7f881c099c40 msgr2=0x7f881c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.587+0000 7f8822ac4700 1 -- 172.21.15.146:0/1490516525 shutdown_connections 2023-10-03T10:15:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.588+0000 7f8822ac4700 1 -- 172.21.15.146:0/1490516525 wait complete. 2023-10-03T10:15:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.588+0000 7f8822ac4700 1 Processor -- start 2023-10-03T10:15:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.588+0000 7f8822ac4700 1 -- start start 2023-10-03T10:15:52.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.589+0000 7f8822ac4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f881c09d860 0x7f881c1327b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.589+0000 7f8822ac4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f881c09e170 0x7f881c132cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.589+0000 7f8822ac4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f881c130ce0 0x7f881c133230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.589+0000 7f8822ac4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c09c8b0 con 0x7f881c09e170 2023-10-03T10:15:52.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.589+0000 7f8822ac4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881c135e90 con 0x7f881c09d860 2023-10-03T10:15:52.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.589+0000 7f8822ac4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f881c135330 con 0x7f881c130ce0 2023-10-03T10:15:52.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.589+0000 7f8820860700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f881c09d860 0x7f881c1327b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.590+0000 7f8820860700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f881c09d860 0x7f881c1327b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35012/0 (socket says 172.21.15.146:35012) 2023-10-03T10:15:52.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.590+0000 7f8820860700 1 -- 172.21.15.146:0/1665516315 learned_addr learned my addr 172.21.15.146:0/1665516315 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:52.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.590+0000 7f8821061700 1 --2- 172.21.15.146:0/1665516315 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f881c130ce0 0x7f881c133230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.590+0000 7f8820860700 1 -- 172.21.15.146:0/1665516315 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f881c130ce0 msgr2=0x7f881c133230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.590+0000 7f881bfff700 1 --2- 172.21.15.146:0/1665516315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f881c09e170 0x7f881c132cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.590+0000 7f8820860700 1 --2- 172.21.15.146:0/1665516315 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f881c130ce0 0x7f881c133230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.590+0000 7f8820860700 1 -- 172.21.15.146:0/1665516315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f881c09e170 msgr2=0x7f881c132cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.590+0000 7f8820860700 1 --2- 172.21.15.146:0/1665516315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f881c09e170 0x7f881c132cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.590+0000 7f8820860700 1 -- 172.21.15.146:0/1665516315 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88100094a0 con 0x7f881c09d860 2023-10-03T10:15:52.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.590+0000 7f8821061700 1 --2- 172.21.15.146:0/1665516315 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f881c130ce0 0x7f881c133230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:52.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.590+0000 7f881bfff700 1 --2- 172.21.15.146:0/1665516315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f881c09e170 0x7f881c132cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:52.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.590+0000 7f8820860700 1 --2- 172.21.15.146:0/1665516315 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f881c09d860 0x7f881c1327b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f88100090b0 tx=0x7f8810004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.590+0000 7f88197fa700 1 -- 172.21.15.146:0/1665516315 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8810004590 con 0x7f881c09d860 2023-10-03T10:15:52.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.590+0000 7f8822ac4700 1 -- 172.21.15.146:0/1665516315 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881c134ad0 con 0x7f881c09d860 2023-10-03T10:15:52.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.590+0000 7f8822ac4700 1 -- 172.21.15.146:0/1665516315 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881c133a20 con 0x7f881c09d860 2023-10-03T10:15:52.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.591+0000 7f88197fa700 1 -- 172.21.15.146:0/1665516315 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881001f070 con 0x7f881c09d860 2023-10-03T10:15:52.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.591+0000 7f88197fa700 1 -- 172.21.15.146:0/1665516315 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88100038e0 con 0x7f881c09d860 2023-10-03T10:15:52.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.592+0000 7f8822ac4700 1 -- 172.21.15.146:0/1665516315 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87fc0052e0 con 0x7f881c09d860 2023-10-03T10:15:52.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.592+0000 7f88197fa700 1 -- 172.21.15.146:0/1665516315 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8810003a40 con 0x7f881c09d860 2023-10-03T10:15:52.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.592+0000 7f88197fa700 1 -- 172.21.15.146:0/1665516315 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8810021070 con 0x7f881c09d860 2023-10-03T10:15:52.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.597+0000 7f88197fa700 1 -- 172.21.15.146:0/1665516315 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8810010380 con 0x7f881c09d860 2023-10-03T10:15:52.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.625+0000 7f70fcb7e700 1 Processor -- start 2023-10-03T10:15:52.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.625+0000 7f70fcb7e700 1 -- start start 2023-10-03T10:15:52.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.626+0000 7f70fcb7e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70f8133ad0 0x7f70f8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.626+0000 7f70fcb7e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f81300a0 0x7f70f81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.626+0000 7f70fcb7e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f806b2d0 con 0x7f70f81309f0 2023-10-03T10:15:52.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.626+0000 7f70fcb7e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f8133610 con 0x7f70f81300a0 2023-10-03T10:15:52.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.626+0000 7f70fcb7e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70f809a500 con 0x7f70f8133ad0 2023-10-03T10:15:52.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.626+0000 7f70f5d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f81300a0 0x7f70f81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.626+0000 7f70f5d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f81300a0 0x7f70f81304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35020/0 (socket says 172.21.15.146:35020) 2023-10-03T10:15:52.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.626+0000 7f70f5d9b700 1 -- 172.21.15.146:0/3078080649 learned_addr learned my addr 172.21.15.146:0/3078080649 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:52.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.626+0000 7f70f659c700 1 --2- 172.21.15.146:0/3078080649 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70f8133ad0 0x7f70f8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.626+0000 7f70f5d9b700 1 -- 172.21.15.146:0/3078080649 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70f8133ad0 msgr2=0x7f70f8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.626+0000 7f70f5d9b700 1 --2- 172.21.15.146:0/3078080649 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70f8133ad0 0x7f70f8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.626+0000 7f70f5d9b700 1 -- 172.21.15.146:0/3078080649 >> v1:172.21.15.146:6789/0 conn(0x7f70f81309f0 legacy=0x7f70f813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.626+0000 7f70f5d9b700 1 -- 172.21.15.146:0/3078080649 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f81338b0 con 0x7f70f81300a0 2023-10-03T10:15:52.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.626+0000 7f70f5d9b700 1 --2- 172.21.15.146:0/3078080649 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f81300a0 0x7f70f81304b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009920 tx=0x7f70ec009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73259cdd88266ef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.627+0000 7f70f559a700 1 -- 172.21.15.146:0/3078080649 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec00ba60 con 0x7f70f81300a0 2023-10-03T10:15:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.627+0000 7f70f559a700 1 -- 172.21.15.146:0/3078080649 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec00bbc0 con 0x7f70f81300a0 2023-10-03T10:15:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.627+0000 7f70f559a700 1 -- 172.21.15.146:0/3078080649 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec009e70 con 0x7f70f81300a0 2023-10-03T10:15:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.627+0000 7f70fcb7e700 1 -- 172.21.15.146:0/3078080649 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f81300a0 msgr2=0x7f70f81304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.627+0000 7f70fcb7e700 1 --2- 172.21.15.146:0/3078080649 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f81300a0 0x7f70f81304b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009920 tx=0x7f70ec009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.627+0000 7f70fcb7e700 1 -- 172.21.15.146:0/3078080649 shutdown_connections 2023-10-03T10:15:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.627+0000 7f70fcb7e700 1 --2- 172.21.15.146:0/3078080649 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70f8133ad0 0x7f70f8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.627+0000 7f70fcb7e700 1 --2- 172.21.15.146:0/3078080649 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f81300a0 0x7f70f81304b0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.627+0000 7f70fcb7e700 1 -- 172.21.15.146:0/3078080649 >> 172.21.15.146:0/3078080649 conn(0x7f70f8099c40 msgr2=0x7f70f80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.627+0000 7f70fcb7e700 1 -- 172.21.15.146:0/3078080649 shutdown_connections 2023-10-03T10:15:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.627+0000 7f70fcb7e700 1 -- 172.21.15.146:0/3078080649 wait complete. 2023-10-03T10:15:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.629+0000 7f70fcb7e700 1 Processor -- start 2023-10-03T10:15:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.629+0000 7f70fcb7e700 1 -- start start 2023-10-03T10:15:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.629+0000 7f70fcb7e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70f81300a0 0x7f70f811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.629+0000 7f70fcb7e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f81309f0 0x7f70f811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.629+0000 7f70fcb7e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f8133ad0 0x7f70f811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.629+0000 7f70fcb7e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f812d710 con 0x7f70f8133ad0 2023-10-03T10:15:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.629+0000 7f70fcb7e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f811ff40 con 0x7f70f81309f0 2023-10-03T10:15:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.629+0000 7f70fcb7e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70f812dd00 con 0x7f70f81300a0 2023-10-03T10:15:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.629+0000 7f70f5d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f81309f0 0x7f70f811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.629+0000 7f70f5d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f81309f0 0x7f70f811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35036/0 (socket says 172.21.15.146:35036) 2023-10-03T10:15:52.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.629+0000 7f70f5d9b700 1 -- 172.21.15.146:0/2139559549 learned_addr learned my addr 172.21.15.146:0/2139559549 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:52.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.629+0000 7f70f6d9d700 1 --2- 172.21.15.146:0/2139559549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f8133ad0 0x7f70f811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.629+0000 7f70f659c700 1 --2- 172.21.15.146:0/2139559549 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70f81300a0 0x7f70f811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.629+0000 7f70f5d9b700 1 -- 172.21.15.146:0/2139559549 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70f81300a0 msgr2=0x7f70f811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.629+0000 7f70f5d9b700 1 --2- 172.21.15.146:0/2139559549 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70f81300a0 0x7f70f811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.629+0000 7f70f5d9b700 1 -- 172.21.15.146:0/2139559549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f8133ad0 msgr2=0x7f70f811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.629+0000 7f70f5d9b700 1 --2- 172.21.15.146:0/2139559549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f8133ad0 0x7f70f811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.629+0000 7f70f5d9b700 1 -- 172.21.15.146:0/2139559549 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec009550 con 0x7f70f81309f0 2023-10-03T10:15:52.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.630+0000 7f70f5d9b700 1 --2- 172.21.15.146:0/2139559549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f81309f0 0x7f70f811df80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f70ec014040 tx=0x7f70ec004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.630+0000 7f70e6ffd700 1 -- 172.21.15.146:0/2139559549 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec004300 con 0x7f70f81309f0 2023-10-03T10:15:52.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.630+0000 7f70e6ffd700 1 -- 172.21.15.146:0/2139559549 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec01e070 con 0x7f70f81309f0 2023-10-03T10:15:52.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.630+0000 7f70fcb7e700 1 -- 172.21.15.146:0/2139559549 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f80723b0 con 0x7f70f81309f0 2023-10-03T10:15:52.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.630+0000 7f70fcb7e700 1 -- 172.21.15.146:0/2139559549 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f8071910 con 0x7f70f81309f0 2023-10-03T10:15:52.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.630+0000 7f70e6ffd700 1 -- 172.21.15.146:0/2139559549 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec0036a0 con 0x7f70f81309f0 2023-10-03T10:15:52.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.631+0000 7f70fcb7e700 1 -- 172.21.15.146:0/2139559549 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70dc0052e0 con 0x7f70f81309f0 2023-10-03T10:15:52.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.631+0000 7f70e6ffd700 1 -- 172.21.15.146:0/2139559549 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f70ec020030 con 0x7f70f81309f0 2023-10-03T10:15:52.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.631+0000 7f70e6ffd700 1 -- 172.21.15.146:0/2139559549 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f70ec040310 con 0x7f70f81309f0 2023-10-03T10:15:52.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.640+0000 7f70e6ffd700 1 -- 172.21.15.146:0/2139559549 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70ec0229c0 con 0x7f70f81309f0 2023-10-03T10:15:52.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.766+0000 7f0897328700 1 -- 172.21.15.146:0/3551725942 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f089004f2a0 con 0x7f0890130ce0 2023-10-03T10:15:52.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.766+0000 7f0885ffb700 1 -- 172.21.15.146:0/3551725942 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0888014440 con 0x7f0890130ce0 2023-10-03T10:15:52.766 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:52.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.769+0000 7f0897328700 1 -- 172.21.15.146:0/3551725942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0890130ce0 msgr2=0x7f08901b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.769+0000 7f0897328700 1 --2- 172.21.15.146:0/3551725942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0890130ce0 0x7f08901b89e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f088800efc0 tx=0x7f088800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.769+0000 7f0897328700 1 -- 172.21.15.146:0/3551725942 shutdown_connections 2023-10-03T10:15:52.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.769+0000 7f0897328700 1 --2- 172.21.15.146:0/3551725942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0890130ce0 0x7f08901b89e0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.769+0000 7f0897328700 1 --2- 172.21.15.146:0/3551725942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f089009d860 0x7f08901b7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.769+0000 7f0897328700 1 --2- 172.21.15.146:0/3551725942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f089009e170 0x7f08901b84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.769+0000 7f0897328700 1 -- 172.21.15.146:0/3551725942 >> 172.21.15.146:0/3551725942 conn(0x7f0890099c40 msgr2=0x7f0890130450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.769+0000 7f0897328700 1 -- 172.21.15.146:0/3551725942 shutdown_connections 2023-10-03T10:15:52.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.769+0000 7f0897328700 1 -- 172.21.15.146:0/3551725942 wait complete. 2023-10-03T10:15:52.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.771+0000 7f7d38724700 1 -- 172.21.15.146:0/2862386772 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7d3011ec90 con 0x7f7d300a0ee0 2023-10-03T10:15:52.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.771+0000 7f7d26ffd700 1 -- 172.21.15.146:0/2862386772 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d3011ec90 con 0x7f7d300a0ee0 2023-10-03T10:15:52.771 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:52.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.773+0000 7f7d38724700 1 -- 172.21.15.146:0/2862386772 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d300a0ee0 msgr2=0x7f7d3011b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.773+0000 7f7d38724700 1 --2- 172.21.15.146:0/2862386772 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d300a0ee0 0x7f7d3011b800 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c00e990 tx=0x7f7d2c00eca0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.773+0000 7f7d38724700 1 -- 172.21.15.146:0/2862386772 shutdown_connections 2023-10-03T10:15:52.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.773+0000 7f7d38724700 1 --2- 172.21.15.146:0/2862386772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d30134210 0x7f7d3011c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.773+0000 7f7d38724700 1 --2- 172.21.15.146:0/2862386772 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d300a0ee0 0x7f7d3011b800 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.774+0000 7f7d38724700 1 --2- 172.21.15.146:0/2862386772 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d30133900 0x7f7d3011bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.774+0000 7f7d38724700 1 -- 172.21.15.146:0/2862386772 >> 172.21.15.146:0/2862386772 conn(0x7f7d300a2980 msgr2=0x7f7d30130630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.774+0000 7f7d38724700 1 -- 172.21.15.146:0/2862386772 shutdown_connections 2023-10-03T10:15:52.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.774+0000 7f7d38724700 1 -- 172.21.15.146:0/2862386772 wait complete. 2023-10-03T10:15:52.782 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:52.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:52.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.796+0000 7f8822ac4700 1 -- 172.21.15.146:0/1665516315 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f87fc005590 con 0x7f881c09d860 2023-10-03T10:15:52.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.796+0000 7f88197fa700 1 -- 172.21.15.146:0/1665516315 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8810015020 con 0x7f881c09d860 2023-10-03T10:15:52.796 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:52.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.798+0000 7f8822ac4700 1 -- 172.21.15.146:0/1665516315 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f881c09d860 msgr2=0x7f881c1327b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.798+0000 7f8822ac4700 1 --2- 172.21.15.146:0/1665516315 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f881c09d860 0x7f881c1327b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f88100090b0 tx=0x7f8810004750 comp rx=0 tx=0).stop 2023-10-03T10:15:52.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.798+0000 7f8822ac4700 1 -- 172.21.15.146:0/1665516315 shutdown_connections 2023-10-03T10:15:52.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.798+0000 7f8822ac4700 1 --2- 172.21.15.146:0/1665516315 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f881c130ce0 0x7f881c133230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.798+0000 7f8822ac4700 1 --2- 172.21.15.146:0/1665516315 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f881c09d860 0x7f881c1327b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.798+0000 7f8822ac4700 1 --2- 172.21.15.146:0/1665516315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f881c09e170 0x7f881c132cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.798+0000 7f8822ac4700 1 -- 172.21.15.146:0/1665516315 >> 172.21.15.146:0/1665516315 conn(0x7f881c099c40 msgr2=0x7f881c0711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.798+0000 7f8822ac4700 1 -- 172.21.15.146:0/1665516315 shutdown_connections 2023-10-03T10:15:52.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.798+0000 7f8822ac4700 1 -- 172.21.15.146:0/1665516315 wait complete. 2023-10-03T10:15:52.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:52.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.856+0000 7f70fcb7e700 1 -- 172.21.15.146:0/2139559549 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f70dc005590 con 0x7f70f81309f0 2023-10-03T10:15:52.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.856+0000 7f70e6ffd700 1 -- 172.21.15.146:0/2139559549 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f70ec015070 con 0x7f70f81309f0 2023-10-03T10:15:52.856 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:52.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.858+0000 7f70fcb7e700 1 -- 172.21.15.146:0/2139559549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f81309f0 msgr2=0x7f70f811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.858+0000 7f70fcb7e700 1 --2- 172.21.15.146:0/2139559549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f81309f0 0x7f70f811df80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f70ec014040 tx=0x7f70ec004750 comp rx=0 tx=0).stop 2023-10-03T10:15:52.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.858+0000 7f70fcb7e700 1 -- 172.21.15.146:0/2139559549 shutdown_connections 2023-10-03T10:15:52.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.858+0000 7f70fcb7e700 1 --2- 172.21.15.146:0/2139559549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70f8133ad0 0x7f70f811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.858+0000 7f70fcb7e700 1 --2- 172.21.15.146:0/2139559549 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f70f81300a0 0x7f70f811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.858+0000 7f70fcb7e700 1 --2- 172.21.15.146:0/2139559549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f70f81309f0 0x7f70f811df80 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.858+0000 7f70fcb7e700 1 -- 172.21.15.146:0/2139559549 >> 172.21.15.146:0/2139559549 conn(0x7f70f8099c40 msgr2=0x7f70f8131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.858+0000 7f70fcb7e700 1 -- 172.21.15.146:0/2139559549 shutdown_connections 2023-10-03T10:15:52.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:52.858+0000 7f70fcb7e700 1 -- 172.21.15.146:0/2139559549 wait complete. 2023-10-03T10:15:52.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:53.783 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:53.787 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:53.811 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:53.871 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:53.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.922+0000 7f5a25a02700 1 Processor -- start 2023-10-03T10:15:53.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.922+0000 7f5a25a02700 1 -- start start 2023-10-03T10:15:53.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.923+0000 7f5a25a02700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5a20137d30 0x7f5a20138100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.923+0000 7f5a25a02700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a2006f780 0x7f5a2013faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.923+0000 7f5a25a02700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a200a0020 con 0x7f5a2009a060 2023-10-03T10:15:53.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.923+0000 7f5a25a02700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a200708c0 con 0x7f5a2006f780 2023-10-03T10:15:53.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.923+0000 7f5a25a02700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a20138640 con 0x7f5a20137d30 2023-10-03T10:15:53.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.923+0000 7f5a1f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a2006f780 0x7f5a2013faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.923+0000 7f5a1e7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5a2009a060 0x7f5a2006f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40362/0 (socket says 172.21.15.146:40362) 2023-10-03T10:15:53.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.923+0000 7f5a1e7fc700 1 -- 172.21.15.146:0/3099190827 learned_addr learned my addr 172.21.15.146:0/3099190827 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:53.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.923+0000 7f5a1effd700 1 --2- 172.21.15.146:0/3099190827 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5a20137d30 0x7f5a20138100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.923+0000 7f5a1f7fe700 1 -- 172.21.15.146:0/3099190827 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5a20137d30 msgr2=0x7f5a20138100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.923+0000 7f5a1f7fe700 1 --2- 172.21.15.146:0/3099190827 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5a20137d30 0x7f5a20138100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.923+0000 7f5a1dffb700 1 -- 172.21.15.146:0/3099190827 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2949857699 0 0) 0x7f5a200a0020 con 0x7f5a2009a060 2023-10-03T10:15:53.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.923+0000 7f5a1f7fe700 1 -- 172.21.15.146:0/3099190827 >> v1:172.21.15.146:6789/0 conn(0x7f5a2009a060 legacy=0x7f5a2006f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.923+0000 7f5a1f7fe700 1 -- 172.21.15.146:0/3099190827 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a201378e0 con 0x7f5a2006f780 2023-10-03T10:15:53.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.924+0000 7f5a1f7fe700 1 --2- 172.21.15.146:0/3099190827 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a2006f780 0x7f5a2013faa0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5a18009dc0 tx=0x7f5a1800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f868206d96b53917 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.924+0000 7f5a1dffb700 1 -- 172.21.15.146:0/3099190827 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1800e070 con 0x7f5a2006f780 2023-10-03T10:15:53.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.924+0000 7f5a1dffb700 1 -- 172.21.15.146:0/3099190827 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1800bb20 con 0x7f5a2006f780 2023-10-03T10:15:53.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.924+0000 7f5a1dffb700 1 -- 172.21.15.146:0/3099190827 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18012430 con 0x7f5a2006f780 2023-10-03T10:15:53.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.925+0000 7f5a25a02700 1 -- 172.21.15.146:0/3099190827 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a2006f780 msgr2=0x7f5a2013faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.925+0000 7f5a25a02700 1 --2- 172.21.15.146:0/3099190827 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a2006f780 0x7f5a2013faa0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5a18009dc0 tx=0x7f5a1800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:53.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.925+0000 7f5a25a02700 1 -- 172.21.15.146:0/3099190827 shutdown_connections 2023-10-03T10:15:53.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.925+0000 7f5a25a02700 1 --2- 172.21.15.146:0/3099190827 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a2006f780 0x7f5a2013faa0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.925+0000 7f5a25a02700 1 --2- 172.21.15.146:0/3099190827 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5a20137d30 0x7f5a20138100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.925+0000 7f5a25a02700 1 -- 172.21.15.146:0/3099190827 >> 172.21.15.146:0/3099190827 conn(0x7f5a200a27a0 msgr2=0x7f5a200a2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.925+0000 7f5a25a02700 1 -- 172.21.15.146:0/3099190827 shutdown_connections 2023-10-03T10:15:53.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.925+0000 7f5a25a02700 1 -- 172.21.15.146:0/3099190827 wait complete. 2023-10-03T10:15:53.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.926+0000 7f5a25a02700 1 Processor -- start 2023-10-03T10:15:53.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.927+0000 7f5a25a02700 1 -- start start 2023-10-03T10:15:53.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.927+0000 7f5a25a02700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5a2006f780 0x7f5a201263d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.927+0000 7f5a25a02700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a2009a060 0x7f5a20124d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.927+0000 7f5a25a02700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a20137d30 0x7f5a20125280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.927+0000 7f5a25a02700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2013b830 con 0x7f5a20137d30 2023-10-03T10:15:53.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.927+0000 7f5a25a02700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2013c100 con 0x7f5a2009a060 2023-10-03T10:15:53.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.927+0000 7f5a25a02700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2013d740 con 0x7f5a2006f780 2023-10-03T10:15:53.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.927+0000 7f5a1effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5a2006f780 0x7f5a201263d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.927+0000 7f5a1effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5a2006f780 0x7f5a201263d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:44182/0 (socket says 172.21.15.146:44182) 2023-10-03T10:15:53.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.927+0000 7f5a1effd700 1 -- 172.21.15.146:0/3976684822 learned_addr learned my addr 172.21.15.146:0/3976684822 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:53.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.927+0000 7f5a1e7fc700 1 --2- 172.21.15.146:0/3976684822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a2009a060 0x7f5a20124d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.927+0000 7f5a1f7fe700 1 --2- 172.21.15.146:0/3976684822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a20137d30 0x7f5a20125280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.928+0000 7f5a1e7fc700 1 -- 172.21.15.146:0/3976684822 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5a2006f780 msgr2=0x7f5a201263d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.928+0000 7f5a1e7fc700 1 --2- 172.21.15.146:0/3976684822 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5a2006f780 0x7f5a201263d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.928+0000 7f5a1e7fc700 1 -- 172.21.15.146:0/3976684822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a20137d30 msgr2=0x7f5a20125280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.928+0000 7f5a1e7fc700 1 --2- 172.21.15.146:0/3976684822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a20137d30 0x7f5a20125280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.928+0000 7f5a1e7fc700 1 -- 172.21.15.146:0/3976684822 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a18009a70 con 0x7f5a2009a060 2023-10-03T10:15:53.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.928+0000 7f5a1e7fc700 1 --2- 172.21.15.146:0/3976684822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a2009a060 0x7f5a20124d40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5a1400c470 tx=0x7f5a1400c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.928+0000 7f5a07fff700 1 -- 172.21.15.146:0/3976684822 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14004c80 con 0x7f5a2009a060 2023-10-03T10:15:53.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.928+0000 7f5a07fff700 1 -- 172.21.15.146:0/3976684822 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a14004de0 con 0x7f5a2009a060 2023-10-03T10:15:53.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.928+0000 7f5a25a02700 1 -- 172.21.15.146:0/3976684822 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a20071380 con 0x7f5a2009a060 2023-10-03T10:15:53.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.928+0000 7f5a07fff700 1 -- 172.21.15.146:0/3976684822 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14007310 con 0x7f5a2009a060 2023-10-03T10:15:53.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.928+0000 7f5a25a02700 1 -- 172.21.15.146:0/3976684822 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a2013bda0 con 0x7f5a2009a060 2023-10-03T10:15:53.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.929+0000 7f5a07fff700 1 -- 172.21.15.146:0/3976684822 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5a14007470 con 0x7f5a2009a060 2023-10-03T10:15:53.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.929+0000 7f5a25a02700 1 -- 172.21.15.146:0/3976684822 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a2013d2c0 con 0x7f5a2009a060 2023-10-03T10:15:53.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.929+0000 7f5a07fff700 1 -- 172.21.15.146:0/3976684822 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5a1403f280 con 0x7f5a2009a060 2023-10-03T10:15:53.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.934+0000 7f5a07fff700 1 -- 172.21.15.146:0/3976684822 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a2013d2c0 con 0x7f5a2009a060 2023-10-03T10:15:53.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.961+0000 7f6d8f94e700 1 Processor -- start 2023-10-03T10:15:53.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.962+0000 7f2c4ad8a700 1 Processor -- start 2023-10-03T10:15:53.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.962+0000 7f2c4ad8a700 1 -- start start 2023-10-03T10:15:53.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.962+0000 7f2c4ad8a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c440a0a90 0x7f2c440a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.962+0000 7f6d8f94e700 1 -- start start 2023-10-03T10:15:53.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.962+0000 7f2c4ad8a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c44134140 0x7f2c4413bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.962+0000 7f2c4ad8a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c440a1fe0 con 0x7f2c440a13a0 2023-10-03T10:15:53.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.962+0000 7f2c4ad8a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c440a3aa0 con 0x7f2c440a0a90 2023-10-03T10:15:53.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.962+0000 7f2c4ad8a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4409a540 con 0x7f2c44134140 2023-10-03T10:15:53.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.962+0000 7f2c43fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2c440a13a0 0x7f2c44133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40376/0 (socket says 172.21.15.146:40376) 2023-10-03T10:15:53.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.962+0000 7f2c43fff700 1 -- 172.21.15.146:0/2001150125 learned_addr learned my addr 172.21.15.146:0/2001150125 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:53.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.962+0000 7f6d8f94e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d8809e340 0x7f6d881359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.962+0000 7f6d8f94e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d88135f20 0x7f6d88138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.962+0000 7f6d8f94e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d8809aaa0 con 0x7f6d8809d860 2023-10-03T10:15:53.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.963+0000 7f6d8f94e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8809e730 con 0x7f6d88135f20 2023-10-03T10:15:53.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.963+0000 7f6d8f94e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8809f870 con 0x7f6d8809e340 2023-10-03T10:15:53.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.963+0000 7f6d8d6ea700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6d8809d860 0x7f6d8809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40390/0 (socket says 172.21.15.146:40390) 2023-10-03T10:15:53.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.963+0000 7f6d8d6ea700 1 -- 172.21.15.146:0/1475962154 learned_addr learned my addr 172.21.15.146:0/1475962154 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:53.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.963+0000 7f2c48b26700 1 --2- 172.21.15.146:0/2001150125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c440a0a90 0x7f2c440a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.963+0000 7f2c437fe700 1 -- 172.21.15.146:0/2001150125 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828312798 0 0) 0x7f2c440a1fe0 con 0x7f2c440a13a0 2023-10-03T10:15:53.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.963+0000 7f2c49327700 1 --2- 172.21.15.146:0/2001150125 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c44134140 0x7f2c4413bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.963+0000 7f2c437fe700 1 -- 172.21.15.146:0/2001150125 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c340035b0 con 0x7f2c440a13a0 2023-10-03T10:15:53.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.963+0000 7f6d8cee9700 1 --2- 172.21.15.146:0/1475962154 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d8809e340 0x7f6d881359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.963+0000 7f6d8deeb700 1 --2- 172.21.15.146:0/1475962154 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d88135f20 0x7f6d88138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.963+0000 7f2c48b26700 1 -- 172.21.15.146:0/2001150125 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c44134140 msgr2=0x7f2c4413bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.963+0000 7f2c48b26700 1 --2- 172.21.15.146:0/2001150125 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c44134140 0x7f2c4413bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.963+0000 7f2c48b26700 1 -- 172.21.15.146:0/2001150125 >> v1:172.21.15.146:6789/0 conn(0x7f2c440a13a0 legacy=0x7f2c44133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.963+0000 7f2c48b26700 1 -- 172.21.15.146:0/2001150125 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4409a280 con 0x7f2c440a0a90 2023-10-03T10:15:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.963+0000 7f6d8cee9700 1 -- 172.21.15.146:0/1475962154 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d88135f20 msgr2=0x7f6d88138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.963+0000 7f6d8cee9700 1 --2- 172.21.15.146:0/1475962154 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d88135f20 0x7f6d88138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.963+0000 7f6d7bfff700 1 -- 172.21.15.146:0/1475962154 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669076536 0 0) 0x7f6d8809aaa0 con 0x7f6d8809d860 2023-10-03T10:15:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.963+0000 7f6d8cee9700 1 -- 172.21.15.146:0/1475962154 >> v1:172.21.15.146:6789/0 conn(0x7f6d8809d860 legacy=0x7f6d8809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.963+0000 7f6d8cee9700 1 -- 172.21.15.146:0/1475962154 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8809b360 con 0x7f6d8809e340 2023-10-03T10:15:53.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.963+0000 7f6d8cee9700 1 --2- 172.21.15.146:0/1475962154 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d8809e340 0x7f6d881359e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400b950 tx=0x7f6d8400bc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34b2f951d151c10f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.963+0000 7f2c48b26700 1 --2- 172.21.15.146:0/2001150125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c440a0a90 0x7f2c440a0e60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2c380098a0 tx=0x7f2c38009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a38d20f9feae2b38 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.964+0000 7f2c437fe700 1 -- 172.21.15.146:0/2001150125 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c38011830 con 0x7f2c440a0a90 2023-10-03T10:15:53.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.964+0000 7f6d7bfff700 1 -- 172.21.15.146:0/1475962154 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8400bea0 con 0x7f6d8809e340 2023-10-03T10:15:53.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.964+0000 7f6d7bfff700 1 -- 172.21.15.146:0/1475962154 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8400cc20 con 0x7f6d8809e340 2023-10-03T10:15:53.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.964+0000 7f6d7bfff700 1 -- 172.21.15.146:0/1475962154 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8400f460 con 0x7f6d8809e340 2023-10-03T10:15:53.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.964+0000 7f2c437fe700 1 -- 172.21.15.146:0/2001150125 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c38011990 con 0x7f2c440a0a90 2023-10-03T10:15:53.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.964+0000 7f2c437fe700 1 -- 172.21.15.146:0/2001150125 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c38011d00 con 0x7f2c440a0a90 2023-10-03T10:15:53.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.964+0000 7f2c4ad8a700 1 -- 172.21.15.146:0/2001150125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c440a0a90 msgr2=0x7f2c440a0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.964+0000 7f2c4ad8a700 1 --2- 172.21.15.146:0/2001150125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c440a0a90 0x7f2c440a0e60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2c380098a0 tx=0x7f2c38009bb0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.964+0000 7f2c4ad8a700 1 -- 172.21.15.146:0/2001150125 shutdown_connections 2023-10-03T10:15:53.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.964+0000 7f2c4ad8a700 1 --2- 172.21.15.146:0/2001150125 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c44134140 0x7f2c4413bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.964+0000 7f2c4ad8a700 1 --2- 172.21.15.146:0/2001150125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c440a0a90 0x7f2c440a0e60 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.964+0000 7f2c4ad8a700 1 -- 172.21.15.146:0/2001150125 >> 172.21.15.146:0/2001150125 conn(0x7f2c44099c40 msgr2=0x7f2c4406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.964+0000 7f2c4ad8a700 1 -- 172.21.15.146:0/2001150125 shutdown_connections 2023-10-03T10:15:53.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.964+0000 7f2c4ad8a700 1 -- 172.21.15.146:0/2001150125 wait complete. 2023-10-03T10:15:53.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.965+0000 7f6d8f94e700 1 -- 172.21.15.146:0/1475962154 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d8809e340 msgr2=0x7f6d881359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.965+0000 7f6d8f94e700 1 --2- 172.21.15.146:0/1475962154 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d8809e340 0x7f6d881359e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400b950 tx=0x7f6d8400bc60 comp rx=0 tx=0).stop 2023-10-03T10:15:53.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.965+0000 7f6d8f94e700 1 -- 172.21.15.146:0/1475962154 shutdown_connections 2023-10-03T10:15:53.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.965+0000 7f6d8f94e700 1 --2- 172.21.15.146:0/1475962154 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d88135f20 0x7f6d88138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.965+0000 7f6d8f94e700 1 --2- 172.21.15.146:0/1475962154 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d8809e340 0x7f6d881359e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.965+0000 7f6d8f94e700 1 -- 172.21.15.146:0/1475962154 >> 172.21.15.146:0/1475962154 conn(0x7f6d88099c40 msgr2=0x7f6d880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.965+0000 7f2c4ad8a700 1 Processor -- start 2023-10-03T10:15:53.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.965+0000 7f2c4ad8a700 1 -- start start 2023-10-03T10:15:53.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.966+0000 7f6d8f94e700 1 -- 172.21.15.146:0/1475962154 shutdown_connections 2023-10-03T10:15:53.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.966+0000 7f6d8f94e700 1 -- 172.21.15.146:0/1475962154 wait complete. 2023-10-03T10:15:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.966+0000 7f2c4ad8a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c440a0a90 0x7f2c441c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.966+0000 7f2c4ad8a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c440a13a0 0x7f2c441c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.966+0000 7f2c4ad8a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c44134140 0x7f2c441c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.966+0000 7f2c4ad8a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c44122810 con 0x7f2c440a13a0 2023-10-03T10:15:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.966+0000 7f2c4ad8a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c44120aa0 con 0x7f2c440a0a90 2023-10-03T10:15:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.966+0000 7f2c4ad8a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c44120870 con 0x7f2c44134140 2023-10-03T10:15:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.966+0000 7f2c48b26700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c440a0a90 0x7f2c441c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.966+0000 7f2c48b26700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c440a0a90 0x7f2c441c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35088/0 (socket says 172.21.15.146:35088) 2023-10-03T10:15:53.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.966+0000 7f2c48b26700 1 -- 172.21.15.146:0/2969500683 learned_addr learned my addr 172.21.15.146:0/2969500683 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:53.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.967+0000 7f2c49327700 1 --2- 172.21.15.146:0/2969500683 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c44134140 0x7f2c441c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.967+0000 7f2c43fff700 1 --2- 172.21.15.146:0/2969500683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c440a13a0 0x7f2c441c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.967+0000 7f6d8f94e700 1 Processor -- start 2023-10-03T10:15:53.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.967+0000 7f6d8f94e700 1 -- start start 2023-10-03T10:15:53.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.967+0000 7f2c48b26700 1 -- 172.21.15.146:0/2969500683 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c44134140 msgr2=0x7f2c441c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.967+0000 7f2c48b26700 1 --2- 172.21.15.146:0/2969500683 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c44134140 0x7f2c441c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.967+0000 7f2c48b26700 1 -- 172.21.15.146:0/2969500683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c440a13a0 msgr2=0x7f2c441c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.967+0000 7f2c48b26700 1 --2- 172.21.15.146:0/2969500683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c440a13a0 0x7f2c441c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.967+0000 7f2c48b26700 1 -- 172.21.15.146:0/2969500683 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c380094a0 con 0x7f2c440a0a90 2023-10-03T10:15:53.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.967+0000 7f2c48b26700 1 --2- 172.21.15.146:0/2969500683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c440a0a90 0x7f2c441c82a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2c4409cca0 tx=0x7f2c38004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.967+0000 7f2c417fa700 1 -- 172.21.15.146:0/2969500683 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3801a6a0 con 0x7f2c440a0a90 2023-10-03T10:15:53.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.968+0000 7f2c417fa700 1 -- 172.21.15.146:0/2969500683 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3801a800 con 0x7f2c440a0a90 2023-10-03T10:15:53.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.968+0000 7f2c417fa700 1 -- 172.21.15.146:0/2969500683 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3801ab90 con 0x7f2c440a0a90 2023-10-03T10:15:53.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.968+0000 7f6d8f94e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d8809d860 0x7f6d8811b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.968+0000 7f6d8f94e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d8809e340 0x7f6d8811b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.968+0000 7f6d8f94e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d88135f20 0x7f6d8811bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.968+0000 7f6d8f94e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d88072740 con 0x7f6d8809d860 2023-10-03T10:15:53.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.968+0000 7f6d8f94e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8811d4d0 con 0x7f6d8809e340 2023-10-03T10:15:53.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.968+0000 7f6d8f94e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8811e5b0 con 0x7f6d88135f20 2023-10-03T10:15:53.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.968+0000 7f6d8deeb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d88135f20 0x7f6d8811bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.968+0000 7f6d8deeb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d88135f20 0x7f6d8811bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:44226/0 (socket says 172.21.15.146:44226) 2023-10-03T10:15:53.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.968+0000 7f6d8deeb700 1 -- 172.21.15.146:0/783384921 learned_addr learned my addr 172.21.15.146:0/783384921 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:53.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.968+0000 7f6d8deeb700 1 -- 172.21.15.146:0/783384921 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d8809e340 msgr2=0x7f6d8811b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.968+0000 7f6d8deeb700 1 --2- 172.21.15.146:0/783384921 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d8809e340 0x7f6d8811b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.968+0000 7f6d8deeb700 1 -- 172.21.15.146:0/783384921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d8809d860 msgr2=0x7f6d8811b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.968+0000 7f6d8deeb700 1 --2- 172.21.15.146:0/783384921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d8809d860 0x7f6d8811b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.968+0000 7f6d8deeb700 1 -- 172.21.15.146:0/783384921 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8400b550 con 0x7f6d88135f20 2023-10-03T10:15:53.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.968+0000 7f6d8deeb700 1 --2- 172.21.15.146:0/783384921 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d88135f20 0x7f6d8811bd80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6d80011400 tx=0x7f6d800117c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.968+0000 7f2c4ad8a700 1 -- 172.21.15.146:0/2969500683 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c441221e0 con 0x7f2c440a0a90 2023-10-03T10:15:53.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.968+0000 7f2c4ad8a700 1 -- 172.21.15.146:0/2969500683 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c44122f10 con 0x7f2c440a0a90 2023-10-03T10:15:53.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.969+0000 7f6d79ffb700 1 -- 172.21.15.146:0/783384921 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80019600 con 0x7f6d88135f20 2023-10-03T10:15:53.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.969+0000 7f6d79ffb700 1 -- 172.21.15.146:0/783384921 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d80013040 con 0x7f6d88135f20 2023-10-03T10:15:53.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.969+0000 7f6d79ffb700 1 -- 172.21.15.146:0/783384921 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80019960 con 0x7f6d88135f20 2023-10-03T10:15:53.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.969+0000 7f2c2effd700 1 -- 172.21.15.146:0/2969500683 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c4404f2a0 con 0x7f2c440a0a90 2023-10-03T10:15:53.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.969+0000 7f6d8f94e700 1 -- 172.21.15.146:0/783384921 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d8811eec0 con 0x7f6d88135f20 2023-10-03T10:15:53.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.969+0000 7f6d8f94e700 1 -- 172.21.15.146:0/783384921 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d8811eb40 con 0x7f6d88135f20 2023-10-03T10:15:53.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.969+0000 7f2c417fa700 1 -- 172.21.15.146:0/2969500683 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c38022070 con 0x7f2c440a0a90 2023-10-03T10:15:53.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.970+0000 7f2c417fa700 1 -- 172.21.15.146:0/2969500683 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2c380408d0 con 0x7f2c440a0a90 2023-10-03T10:15:53.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.970+0000 7f6d8f94e700 1 -- 172.21.15.146:0/783384921 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d8811e980 con 0x7f6d88135f20 2023-10-03T10:15:53.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.973+0000 7f6d79ffb700 1 -- 172.21.15.146:0/783384921 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6d800223b0 con 0x7f6d88135f20 2023-10-03T10:15:53.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.974+0000 7f6d79ffb700 1 -- 172.21.15.146:0/783384921 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6d80044140 con 0x7f6d88135f20 2023-10-03T10:15:53.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.978+0000 7f6d79ffb700 1 -- 172.21.15.146:0/783384921 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d80022660 con 0x7f6d88135f20 2023-10-03T10:15:53.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:53.978+0000 7f2c417fa700 1 -- 172.21.15.146:0/2969500683 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c380193b0 con 0x7f2c440a0a90 2023-10-03T10:15:54.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.006+0000 7f167b20e700 1 Processor -- start 2023-10-03T10:15:54.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.007+0000 7f167b20e700 1 -- start start 2023-10-03T10:15:54.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.007+0000 7f167b20e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1674133900 0x7f1674133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.007+0000 7f167b20e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1674134210 0x7f16740a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.007+0000 7f167b20e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16740a0ee0 0x7f16740a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.007+0000 7f167b20e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f167409a760 con 0x7f16740a0ee0 2023-10-03T10:15:54.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.007+0000 7f167b20e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16741336e0 con 0x7f1674133900 2023-10-03T10:15:54.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.007+0000 7f167b20e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f167409a080 con 0x7f1674134210 2023-10-03T10:15:54.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.007+0000 7f16797ab700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16740a0ee0 0x7f16740a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.007+0000 7f16797ab700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16740a0ee0 0x7f16740a1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60650/0 (socket says 172.21.15.146:60650) 2023-10-03T10:15:54.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.007+0000 7f16797ab700 1 -- 172.21.15.146:0/3536434288 learned_addr learned my addr 172.21.15.146:0/3536434288 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:54.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.007+0000 7f1678faa700 1 --2- 172.21.15.146:0/3536434288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1674133900 0x7f1674133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.008+0000 7f1673fff700 1 --2- 172.21.15.146:0/3536434288 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1674134210 0x7f16740a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.008+0000 7f16797ab700 1 -- 172.21.15.146:0/3536434288 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1674134210 msgr2=0x7f16740a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:54.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.008+0000 7f16797ab700 1 --2- 172.21.15.146:0/3536434288 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1674134210 0x7f16740a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.008+0000 7f16797ab700 1 -- 172.21.15.146:0/3536434288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1674133900 msgr2=0x7f1674133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:54.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.008+0000 7f16797ab700 1 --2- 172.21.15.146:0/3536434288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1674133900 0x7f1674133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.008+0000 7f16797ab700 1 -- 172.21.15.146:0/3536434288 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16740a23e0 con 0x7f16740a0ee0 2023-10-03T10:15:54.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.008+0000 7f16797ab700 1 --2- 172.21.15.146:0/3536434288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16740a0ee0 0x7f16740a1360 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f166c009e50 tx=0x7f166c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1df90f4d1d5adc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:54.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.008+0000 7f16737fe700 1 -- 172.21.15.146:0/3536434288 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c00bb10 con 0x7f16740a0ee0 2023-10-03T10:15:54.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.008+0000 7f16737fe700 1 -- 172.21.15.146:0/3536434288 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166c00bc70 con 0x7f16740a0ee0 2023-10-03T10:15:54.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.008+0000 7f16737fe700 1 -- 172.21.15.146:0/3536434288 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c0148d0 con 0x7f16740a0ee0 2023-10-03T10:15:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.009+0000 7f167b20e700 1 -- 172.21.15.146:0/3536434288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16740a0ee0 msgr2=0x7f16740a1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.009+0000 7f167b20e700 1 --2- 172.21.15.146:0/3536434288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16740a0ee0 0x7f16740a1360 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f166c009e50 tx=0x7f166c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:54.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.009+0000 7f167b20e700 1 -- 172.21.15.146:0/3536434288 shutdown_connections 2023-10-03T10:15:54.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.009+0000 7f167b20e700 1 --2- 172.21.15.146:0/3536434288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1674133900 0x7f1674133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.009+0000 7f167b20e700 1 --2- 172.21.15.146:0/3536434288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16740a0ee0 0x7f16740a1360 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.009+0000 7f167b20e700 1 --2- 172.21.15.146:0/3536434288 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1674134210 0x7f16740a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.009+0000 7f167b20e700 1 -- 172.21.15.146:0/3536434288 >> 172.21.15.146:0/3536434288 conn(0x7f16740a2980 msgr2=0x7f16740a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.009+0000 7f167b20e700 1 -- 172.21.15.146:0/3536434288 shutdown_connections 2023-10-03T10:15:54.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.009+0000 7f167b20e700 1 -- 172.21.15.146:0/3536434288 wait complete. 2023-10-03T10:15:54.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.011+0000 7f167b20e700 1 Processor -- start 2023-10-03T10:15:54.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.011+0000 7f167b20e700 1 -- start start 2023-10-03T10:15:54.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.011+0000 7f167b20e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16740a0ee0 0x7f1674119530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.011+0000 7f167b20e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1674133900 0x7f1674119a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.011+0000 7f167b20e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1674134210 0x7f1674119fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.012+0000 7f167b20e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167411da10 con 0x7f16740a0ee0 2023-10-03T10:15:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.012+0000 7f167b20e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167411b140 con 0x7f1674134210 2023-10-03T10:15:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.012+0000 7f167b20e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f167411c390 con 0x7f1674133900 2023-10-03T10:15:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.012+0000 7f1673fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1674133900 0x7f1674119a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.012+0000 7f1673fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1674133900 0x7f1674119a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:44248/0 (socket says 172.21.15.146:44248) 2023-10-03T10:15:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.012+0000 7f1673fff700 1 -- 172.21.15.146:0/106836681 learned_addr learned my addr 172.21.15.146:0/106836681 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.012+0000 7f1678faa700 1 --2- 172.21.15.146:0/106836681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16740a0ee0 0x7f1674119530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.012+0000 7f16797ab700 1 --2- 172.21.15.146:0/106836681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1674134210 0x7f1674119fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.012+0000 7f1673fff700 1 -- 172.21.15.146:0/106836681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1674134210 msgr2=0x7f1674119fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.012+0000 7f1673fff700 1 --2- 172.21.15.146:0/106836681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1674134210 0x7f1674119fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.012+0000 7f1673fff700 1 -- 172.21.15.146:0/106836681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16740a0ee0 msgr2=0x7f1674119530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.012+0000 7f1673fff700 1 --2- 172.21.15.146:0/106836681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16740a0ee0 0x7f1674119530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.012+0000 7f1673fff700 1 -- 172.21.15.146:0/106836681 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166c009b30 con 0x7f1674133900 2023-10-03T10:15:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.012+0000 7f1673fff700 1 --2- 172.21.15.146:0/106836681 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1674133900 0x7f1674119a70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f166000e9e0 tx=0x7f166000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.012+0000 7f16717fa700 1 -- 172.21.15.146:0/106836681 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1660009710 con 0x7f1674133900 2023-10-03T10:15:54.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.013+0000 7f16717fa700 1 -- 172.21.15.146:0/106836681 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166000ee80 con 0x7f1674133900 2023-10-03T10:15:54.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.013+0000 7f167b20e700 1 -- 172.21.15.146:0/106836681 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f167411b9a0 con 0x7f1674133900 2023-10-03T10:15:54.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.013+0000 7f16717fa700 1 -- 172.21.15.146:0/106836681 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166000ca50 con 0x7f1674133900 2023-10-03T10:15:54.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.013+0000 7f167b20e700 1 -- 172.21.15.146:0/106836681 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16740a2e00 con 0x7f1674133900 2023-10-03T10:15:54.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.013+0000 7f16717fa700 1 -- 172.21.15.146:0/106836681 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f166000cbb0 con 0x7f1674133900 2023-10-03T10:15:54.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.013+0000 7f16717fa700 1 -- 172.21.15.146:0/106836681 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f166003f6a0 con 0x7f1674133900 2023-10-03T10:15:54.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.014+0000 7f167b20e700 1 -- 172.21.15.146:0/106836681 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f167406f730 con 0x7f1674133900 2023-10-03T10:15:54.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.018+0000 7f16717fa700 1 -- 172.21.15.146:0/106836681 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f166001be10 con 0x7f1674133900 2023-10-03T10:15:54.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.137+0000 7f5a25a02700 1 -- 172.21.15.146:0/3976684822 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5a2013d2c0 con 0x7f5a2009a060 2023-10-03T10:15:54.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.137+0000 7f5a07fff700 1 -- 172.21.15.146:0/3976684822 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a2013d2c0 con 0x7f5a2009a060 2023-10-03T10:15:54.137 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:54.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.139+0000 7f5a25a02700 1 -- 172.21.15.146:0/3976684822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a2009a060 msgr2=0x7f5a20124d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.139+0000 7f5a25a02700 1 --2- 172.21.15.146:0/3976684822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a2009a060 0x7f5a20124d40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5a1400c470 tx=0x7f5a1400c780 comp rx=0 tx=0).stop 2023-10-03T10:15:54.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.140+0000 7f5a25a02700 1 -- 172.21.15.146:0/3976684822 shutdown_connections 2023-10-03T10:15:54.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.140+0000 7f5a25a02700 1 --2- 172.21.15.146:0/3976684822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a20137d30 0x7f5a20125280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.140+0000 7f5a25a02700 1 --2- 172.21.15.146:0/3976684822 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5a2006f780 0x7f5a201263d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.140+0000 7f5a25a02700 1 --2- 172.21.15.146:0/3976684822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a2009a060 0x7f5a20124d40 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.140+0000 7f5a25a02700 1 -- 172.21.15.146:0/3976684822 >> 172.21.15.146:0/3976684822 conn(0x7f5a200a27a0 msgr2=0x7f5a200a1300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.140+0000 7f5a25a02700 1 -- 172.21.15.146:0/3976684822 shutdown_connections 2023-10-03T10:15:54.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.140+0000 7f5a25a02700 1 -- 172.21.15.146:0/3976684822 wait complete. 2023-10-03T10:15:54.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:54.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.175+0000 7f6d8f94e700 1 -- 172.21.15.146:0/783384921 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6d8811e770 con 0x7f6d88135f20 2023-10-03T10:15:54.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.175+0000 7f6d79ffb700 1 -- 172.21.15.146:0/783384921 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6d80017300 con 0x7f6d88135f20 2023-10-03T10:15:54.175 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:54.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.178+0000 7f6d8f94e700 1 -- 172.21.15.146:0/783384921 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d88135f20 msgr2=0x7f6d8811bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.178+0000 7f6d8f94e700 1 --2- 172.21.15.146:0/783384921 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d88135f20 0x7f6d8811bd80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6d80011400 tx=0x7f6d800117c0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.178+0000 7f6d8f94e700 1 -- 172.21.15.146:0/783384921 shutdown_connections 2023-10-03T10:15:54.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.178+0000 7f6d8f94e700 1 --2- 172.21.15.146:0/783384921 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d88135f20 0x7f6d8811bd80 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.178+0000 7f6d8f94e700 1 --2- 172.21.15.146:0/783384921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d8809d860 0x7f6d8811b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.178+0000 7f6d8f94e700 1 --2- 172.21.15.146:0/783384921 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d8809e340 0x7f6d8811b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.178+0000 7f6d8f94e700 1 -- 172.21.15.146:0/783384921 >> 172.21.15.146:0/783384921 conn(0x7f6d88099c40 msgr2=0x7f6d881328c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.178+0000 7f6d8f94e700 1 -- 172.21.15.146:0/783384921 shutdown_connections 2023-10-03T10:15:54.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.178+0000 7f6d8f94e700 1 -- 172.21.15.146:0/783384921 wait complete. 2023-10-03T10:15:54.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:54.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.203+0000 7f2c2effd700 1 -- 172.21.15.146:0/2969500683 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2c440729d0 con 0x7f2c440a0a90 2023-10-03T10:15:54.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.204+0000 7f2c417fa700 1 -- 172.21.15.146:0/2969500683 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c38029030 con 0x7f2c440a0a90 2023-10-03T10:15:54.203 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:54.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.206+0000 7f2c2effd700 1 -- 172.21.15.146:0/2969500683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c440a0a90 msgr2=0x7f2c441c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.206+0000 7f2c2effd700 1 --2- 172.21.15.146:0/2969500683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c440a0a90 0x7f2c441c82a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2c4409cca0 tx=0x7f2c38004750 comp rx=0 tx=0).stop 2023-10-03T10:15:54.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.206+0000 7f2c2effd700 1 -- 172.21.15.146:0/2969500683 shutdown_connections 2023-10-03T10:15:54.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.206+0000 7f2c2effd700 1 --2- 172.21.15.146:0/2969500683 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c44134140 0x7f2c441c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.206+0000 7f2c2effd700 1 --2- 172.21.15.146:0/2969500683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c440a0a90 0x7f2c441c82a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.206+0000 7f2c2effd700 1 --2- 172.21.15.146:0/2969500683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c440a13a0 0x7f2c441c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.206+0000 7f2c2effd700 1 -- 172.21.15.146:0/2969500683 >> 172.21.15.146:0/2969500683 conn(0x7f2c44099c40 msgr2=0x7f2c441bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.206+0000 7f2c2effd700 1 -- 172.21.15.146:0/2969500683 shutdown_connections 2023-10-03T10:15:54.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.206+0000 7f2c2effd700 1 -- 172.21.15.146:0/2969500683 wait complete. 2023-10-03T10:15:54.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:54.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.237+0000 7f167b20e700 1 -- 172.21.15.146:0/106836681 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f167409a2c0 con 0x7f1674133900 2023-10-03T10:15:54.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.237+0000 7f16717fa700 1 -- 172.21.15.146:0/106836681 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f166001b3b0 con 0x7f1674133900 2023-10-03T10:15:54.237 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:54.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.239+0000 7f167b20e700 1 -- 172.21.15.146:0/106836681 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1674133900 msgr2=0x7f1674119a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.239+0000 7f167b20e700 1 --2- 172.21.15.146:0/106836681 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1674133900 0x7f1674119a70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f166000e9e0 tx=0x7f166000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.239+0000 7f167b20e700 1 -- 172.21.15.146:0/106836681 shutdown_connections 2023-10-03T10:15:54.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.239+0000 7f167b20e700 1 --2- 172.21.15.146:0/106836681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1674134210 0x7f1674119fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.239+0000 7f167b20e700 1 --2- 172.21.15.146:0/106836681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16740a0ee0 0x7f1674119530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.239+0000 7f167b20e700 1 --2- 172.21.15.146:0/106836681 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1674133900 0x7f1674119a70 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.239+0000 7f167b20e700 1 -- 172.21.15.146:0/106836681 >> 172.21.15.146:0/106836681 conn(0x7f16740a2980 msgr2=0x7f16741306f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.239+0000 7f167b20e700 1 -- 172.21.15.146:0/106836681 shutdown_connections 2023-10-03T10:15:54.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:54.239+0000 7f167b20e700 1 -- 172.21.15.146:0/106836681 wait complete. 2023-10-03T10:15:54.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:55.153 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:55.191 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:55.219 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:55.251 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:55.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.305+0000 7f81976f3700 1 Processor -- start 2023-10-03T10:15:55.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.306+0000 7f81976f3700 1 -- start start 2023-10-03T10:15:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.306+0000 7f81976f3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81900a1510 0x7f81901351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.306+0000 7f81976f3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81901356e0 0x7f8190137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.306+0000 7f81976f3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81900a1e70 con 0x7f81900a0a30 2023-10-03T10:15:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.306+0000 7f81976f3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f819009a720 con 0x7f81900a1510 2023-10-03T10:15:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.306+0000 7f81976f3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f819009b300 con 0x7f81901356e0 2023-10-03T10:15:55.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.307+0000 7f819548f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f81900a0a30 0x7f81900a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36594/0 (socket says 172.21.15.146:36594) 2023-10-03T10:15:55.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.307+0000 7f819548f700 1 -- 172.21.15.146:0/3642112737 learned_addr learned my addr 172.21.15.146:0/3642112737 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:55.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.307+0000 7f8194c8e700 1 --2- 172.21.15.146:0/3642112737 >> v2:172.21.15.146:3300/0 conn(0x7f81900a1510 0x7f81901351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.307+0000 7f8195c90700 1 --2- 172.21.15.146:0/3642112737 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81901356e0 0x7f8190137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.307+0000 7f8187fff700 1 -- 172.21.15.146:0/3642112737 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793183024 0 0) 0x7f81900a1e70 con 0x7f81900a0a30 2023-10-03T10:15:55.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.307+0000 7f8187fff700 1 -- 172.21.15.146:0/3642112737 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f817c0035b0 con 0x7f81900a0a30 2023-10-03T10:15:55.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.307+0000 7f8194c8e700 1 -- 172.21.15.146:0/3642112737 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81901356e0 msgr2=0x7f8190137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:55.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.307+0000 7f8194c8e700 1 --2- 172.21.15.146:0/3642112737 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81901356e0 0x7f8190137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.307+0000 7f8194c8e700 1 -- 172.21.15.146:0/3642112737 >> v1:172.21.15.146:6789/0 conn(0x7f81900a0a30 legacy=0x7f81900a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.307+0000 7f8194c8e700 1 -- 172.21.15.146:0/3642112737 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819009abc0 con 0x7f81900a1510 2023-10-03T10:15:55.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.307+0000 7f8194c8e700 1 --2- 172.21.15.146:0/3642112737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81900a1510 0x7f81901351a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f8180009840 tx=0x7f8180009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c33ac4b1832a84 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.307+0000 7f8187fff700 1 -- 172.21.15.146:0/3642112737 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8180004230 con 0x7f81900a1510 2023-10-03T10:15:55.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.307+0000 7f8187fff700 1 -- 172.21.15.146:0/3642112737 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8180004390 con 0x7f81900a1510 2023-10-03T10:15:55.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.307+0000 7f8187fff700 1 -- 172.21.15.146:0/3642112737 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81800036a0 con 0x7f81900a1510 2023-10-03T10:15:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.308+0000 7f81976f3700 1 -- 172.21.15.146:0/3642112737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81900a1510 msgr2=0x7f81901351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.308+0000 7f81976f3700 1 --2- 172.21.15.146:0/3642112737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81900a1510 0x7f81901351a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f8180009840 tx=0x7f8180009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.308+0000 7f81976f3700 1 -- 172.21.15.146:0/3642112737 shutdown_connections 2023-10-03T10:15:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.308+0000 7f81976f3700 1 --2- 172.21.15.146:0/3642112737 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81901356e0 0x7f8190137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.308+0000 7f81976f3700 1 --2- 172.21.15.146:0/3642112737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81900a1510 0x7f81901351a0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.308+0000 7f81976f3700 1 -- 172.21.15.146:0/3642112737 >> 172.21.15.146:0/3642112737 conn(0x7f81900a2980 msgr2=0x7f81900a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.309+0000 7f81976f3700 1 -- 172.21.15.146:0/3642112737 shutdown_connections 2023-10-03T10:15:55.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.309+0000 7f81976f3700 1 -- 172.21.15.146:0/3642112737 wait complete. 2023-10-03T10:15:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.310+0000 7f81976f3700 1 Processor -- start 2023-10-03T10:15:55.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.310+0000 7f81976f3700 1 -- start start 2023-10-03T10:15:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.311+0000 7f81976f3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81900a0a30 0x7f8190122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.311+0000 7f81976f3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81900a1510 0x7f8190123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.311+0000 7f81976f3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81901356e0 0x7f8190123750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.311+0000 7f81976f3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8190124890 con 0x7f81901356e0 2023-10-03T10:15:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.311+0000 7f81976f3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8190124eb0 con 0x7f81900a0a30 2023-10-03T10:15:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.311+0000 7f81976f3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8190125ae0 con 0x7f81900a1510 2023-10-03T10:15:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.311+0000 7f819548f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81900a0a30 0x7f8190122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.311+0000 7f819548f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81900a0a30 0x7f8190122cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53126/0 (socket says 172.21.15.146:53126) 2023-10-03T10:15:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.311+0000 7f819548f700 1 -- 172.21.15.146:0/3961470284 learned_addr learned my addr 172.21.15.146:0/3961470284 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.311+0000 7f8195c90700 1 --2- 172.21.15.146:0/3961470284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81901356e0 0x7f8190123750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.311+0000 7f8194c8e700 1 --2- 172.21.15.146:0/3961470284 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81900a1510 0x7f8190123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.311+0000 7f819548f700 1 -- 172.21.15.146:0/3961470284 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81900a1510 msgr2=0x7f8190123210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.311+0000 7f819548f700 1 --2- 172.21.15.146:0/3961470284 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81900a1510 0x7f8190123210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.311+0000 7f819548f700 1 -- 172.21.15.146:0/3961470284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81901356e0 msgr2=0x7f8190123750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.311+0000 7f819548f700 1 --2- 172.21.15.146:0/3961470284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81901356e0 0x7f8190123750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.311+0000 7f819548f700 1 -- 172.21.15.146:0/3961470284 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81800094a0 con 0x7f81900a0a30 2023-10-03T10:15:55.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.311+0000 7f8195c90700 1 --2- 172.21.15.146:0/3961470284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81901356e0 0x7f8190123750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:55.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.312+0000 7f819548f700 1 --2- 172.21.15.146:0/3961470284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81900a0a30 0x7f8190122cd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f818c00c730 tx=0x7f818c00ca40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.312+0000 7f8185ffb700 1 -- 172.21.15.146:0/3961470284 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c0074e0 con 0x7f81900a0a30 2023-10-03T10:15:55.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.312+0000 7f8185ffb700 1 -- 172.21.15.146:0/3961470284 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818c007640 con 0x7f81900a0a30 2023-10-03T10:15:55.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.312+0000 7f8185ffb700 1 -- 172.21.15.146:0/3961470284 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c005a30 con 0x7f81900a0a30 2023-10-03T10:15:55.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.312+0000 7f81976f3700 1 -- 172.21.15.146:0/3961470284 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8190124130 con 0x7f81900a0a30 2023-10-03T10:15:55.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.312+0000 7f81976f3700 1 -- 172.21.15.146:0/3961470284 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8190125f30 con 0x7f81900a0a30 2023-10-03T10:15:55.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.313+0000 7f8185ffb700 1 -- 172.21.15.146:0/3961470284 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f818c005b90 con 0x7f81900a0a30 2023-10-03T10:15:55.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.313+0000 7f8185ffb700 1 -- 172.21.15.146:0/3961470284 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f818c03eb60 con 0x7f81900a0a30 2023-10-03T10:15:55.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.314+0000 7f81976f3700 1 -- 172.21.15.146:0/3961470284 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819009ae00 con 0x7f81900a0a30 2023-10-03T10:15:55.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.319+0000 7f8185ffb700 1 -- 172.21.15.146:0/3961470284 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f818c01b3b0 con 0x7f81900a0a30 2023-10-03T10:15:55.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.335+0000 7fad9e27d700 1 Processor -- start 2023-10-03T10:15:55.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.335+0000 7fad9e27d700 1 -- start start 2023-10-03T10:15:55.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.336+0000 7fad9e27d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad98131980 0x7fad98131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.336+0000 7fad9e27d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fad9809bc70 0x7fad9809c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.336+0000 7fad9e27d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad980a1640 con 0x7fad9809c5c0 2023-10-03T10:15:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.336+0000 7fad9e27d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad9806eb30 con 0x7fad9809bc70 2023-10-03T10:15:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.336+0000 7fad9e27d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad980a22d0 con 0x7fad98131980 2023-10-03T10:15:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.336+0000 7fad977fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fad9809bc70 0x7fad9809c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.336+0000 7fad977fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fad9809bc70 0x7fad9809c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60616/0 (socket says 172.21.15.146:60616) 2023-10-03T10:15:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.336+0000 7fad9c81a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fad9809c5c0 0x7fad98138700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36610/0 (socket says 172.21.15.146:36610) 2023-10-03T10:15:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.336+0000 7fad977fe700 1 -- 172.21.15.146:0/4199870181 learned_addr learned my addr 172.21.15.146:0/4199870181 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.336+0000 7fad97fff700 1 --2- 172.21.15.146:0/4199870181 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad98131980 0x7fad98131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.336+0000 7fad97fff700 1 -- 172.21.15.146:0/4199870181 >> v2:172.21.15.146:3300/0 conn(0x7fad9809bc70 msgr2=0x7fad9809c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.336+0000 7fad97fff700 1 --2- 172.21.15.146:0/4199870181 >> v2:172.21.15.146:3300/0 conn(0x7fad9809bc70 0x7fad9809c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.336+0000 7fad97fff700 1 -- 172.21.15.146:0/4199870181 >> v1:172.21.15.146:6789/0 conn(0x7fad9809c5c0 legacy=0x7fad98138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.336+0000 7fad96ffd700 1 -- 172.21.15.146:0/4199870181 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054904133 0 0) 0x7fad980a1640 con 0x7fad9809c5c0 2023-10-03T10:15:55.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.336+0000 7fad97fff700 1 -- 172.21.15.146:0/4199870181 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad98131550 con 0x7fad98131980 2023-10-03T10:15:55.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.336+0000 7fad977fe700 1 --2- 172.21.15.146:0/4199870181 >> v2:172.21.15.146:3300/0 conn(0x7fad9809bc70 0x7fad9809c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:55.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.337+0000 7fad97fff700 1 --2- 172.21.15.146:0/4199870181 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad98131980 0x7fad98131d50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fad88009820 tx=0x7fad88009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=241ce299384e7391 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.337+0000 7fad96ffd700 1 -- 172.21.15.146:0/4199870181 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88005e30 con 0x7fad98131980 2023-10-03T10:15:55.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.337+0000 7fad96ffd700 1 -- 172.21.15.146:0/4199870181 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad88006030 con 0x7fad98131980 2023-10-03T10:15:55.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.337+0000 7fad96ffd700 1 -- 172.21.15.146:0/4199870181 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad880063c0 con 0x7fad98131980 2023-10-03T10:15:55.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.338+0000 7fad9e27d700 1 -- 172.21.15.146:0/4199870181 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad98131980 msgr2=0x7fad98131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.338+0000 7fad9e27d700 1 --2- 172.21.15.146:0/4199870181 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad98131980 0x7fad98131d50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fad88009820 tx=0x7fad88009b30 comp rx=0 tx=0).stop 2023-10-03T10:15:55.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.338+0000 7fad9e27d700 1 -- 172.21.15.146:0/4199870181 shutdown_connections 2023-10-03T10:15:55.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.338+0000 7fad9e27d700 1 --2- 172.21.15.146:0/4199870181 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad98131980 0x7fad98131d50 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.338+0000 7fad9e27d700 1 --2- 172.21.15.146:0/4199870181 >> v2:172.21.15.146:3300/0 conn(0x7fad9809bc70 0x7fad9809c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.338+0000 7fad9e27d700 1 -- 172.21.15.146:0/4199870181 >> 172.21.15.146:0/4199870181 conn(0x7fad980a2980 msgr2=0x7fad980a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.338+0000 7fad9e27d700 1 -- 172.21.15.146:0/4199870181 shutdown_connections 2023-10-03T10:15:55.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.338+0000 7fad9e27d700 1 -- 172.21.15.146:0/4199870181 wait complete. 2023-10-03T10:15:55.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.339+0000 7fad9e27d700 1 Processor -- start 2023-10-03T10:15:55.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.339+0000 7fad9e27d700 1 -- start start 2023-10-03T10:15:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.340+0000 7fad9e27d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad9809bc70 0x7fad9811b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.340+0000 7fad9e27d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad9809c5c0 0x7fad9811bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.340+0000 7fad9e27d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad98131980 0x7fad9811c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.340+0000 7fad9e27d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9811d8b0 con 0x7fad98131980 2023-10-03T10:15:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.340+0000 7fad9e27d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9811f170 con 0x7fad9809bc70 2023-10-03T10:15:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.340+0000 7fad9e27d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad9811e540 con 0x7fad9809c5c0 2023-10-03T10:15:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.340+0000 7fad97fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad9809bc70 0x7fad9811b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.340+0000 7fad97fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad9809bc70 0x7fad9811b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53140/0 (socket says 172.21.15.146:53140) 2023-10-03T10:15:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.340+0000 7fad97fff700 1 -- 172.21.15.146:0/2726007653 learned_addr learned my addr 172.21.15.146:0/2726007653 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.340+0000 7fad977fe700 1 --2- 172.21.15.146:0/2726007653 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad9809c5c0 0x7fad9811bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.340+0000 7fad9c81a700 1 --2- 172.21.15.146:0/2726007653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad98131980 0x7fad9811c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.341+0000 7fad97fff700 1 -- 172.21.15.146:0/2726007653 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad9809c5c0 msgr2=0x7fad9811bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.341+0000 7fad97fff700 1 --2- 172.21.15.146:0/2726007653 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad9809c5c0 0x7fad9811bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.341+0000 7fad97fff700 1 -- 172.21.15.146:0/2726007653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad98131980 msgr2=0x7fad9811c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.341+0000 7fad97fff700 1 --2- 172.21.15.146:0/2726007653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad98131980 0x7fad9811c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.341+0000 7fad97fff700 1 -- 172.21.15.146:0/2726007653 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c009550 con 0x7fad9809bc70 2023-10-03T10:15:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.341+0000 7fad9c81a700 1 --2- 172.21.15.146:0/2726007653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad98131980 0x7fad9811c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.341+0000 7fad977fe700 1 --2- 172.21.15.146:0/2726007653 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad9809c5c0 0x7fad9811bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.341+0000 7fad97fff700 1 --2- 172.21.15.146:0/2726007653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad9809bc70 0x7fad9811b6e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fad88000c00 tx=0x7fad88004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.341+0000 7fad94ff9700 1 -- 172.21.15.146:0/2726007653 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88004040 con 0x7fad9809bc70 2023-10-03T10:15:55.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.341+0000 7fad94ff9700 1 -- 172.21.15.146:0/2726007653 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad88020070 con 0x7fad9809bc70 2023-10-03T10:15:55.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.341+0000 7fad9e27d700 1 -- 172.21.15.146:0/2726007653 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad88009430 con 0x7fad9809bc70 2023-10-03T10:15:55.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.341+0000 7fad94ff9700 1 -- 172.21.15.146:0/2726007653 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88004400 con 0x7fad9809bc70 2023-10-03T10:15:55.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.341+0000 7fad9e27d700 1 -- 172.21.15.146:0/2726007653 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9811d260 con 0x7fad9809bc70 2023-10-03T10:15:55.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.342+0000 7fad94ff9700 1 -- 172.21.15.146:0/2726007653 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad88022030 con 0x7fad9809bc70 2023-10-03T10:15:55.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.342+0000 7fad94ff9700 1 -- 172.21.15.146:0/2726007653 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fad88040c90 con 0x7fad9809bc70 2023-10-03T10:15:55.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.342+0000 7fad9e27d700 1 -- 172.21.15.146:0/2726007653 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9804f2a0 con 0x7fad9809bc70 2023-10-03T10:15:55.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.347+0000 7fad94ff9700 1 -- 172.21.15.146:0/2726007653 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad8802e440 con 0x7fad9809bc70 2023-10-03T10:15:55.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.411+0000 7f17f398a700 1 Processor -- start 2023-10-03T10:15:55.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.412+0000 7f17f398a700 1 -- start start 2023-10-03T10:15:55.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.412+0000 7f17f398a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f17ec0a1550 0x7f17ec138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.412+0000 7f17f398a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f17ec139200 0x7f17ec13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.412+0000 7f17f398a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ec09e9d0 con 0x7f17ec0a0a70 2023-10-03T10:15:55.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.412+0000 7f17f398a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17ec09dc00 con 0x7f17ec139200 2023-10-03T10:15:55.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.412+0000 7f17f398a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec09dec0 con 0x7f17ec0a1550 2023-10-03T10:15:55.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.413+0000 7f17f1f27700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f17ec139200 0x7f17ec13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.413+0000 7f17f0f25700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f17ec0a1550 0x7f17ec138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.413+0000 7f17f1f27700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f17ec139200 0x7f17ec13b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60636/0 (socket says 172.21.15.146:60636) 2023-10-03T10:15:55.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.413+0000 7f17f1f27700 1 -- 172.21.15.146:0/2035643446 learned_addr learned my addr 172.21.15.146:0/2035643446 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.413+0000 7f17f0f25700 1 -- 172.21.15.146:0/2035643446 >> v2:172.21.15.146:3300/0 conn(0x7f17ec139200 msgr2=0x7f17ec13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.413+0000 7f17f0f25700 1 --2- 172.21.15.146:0/2035643446 >> v2:172.21.15.146:3300/0 conn(0x7f17ec139200 0x7f17ec13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.413+0000 7f17f0f25700 1 -- 172.21.15.146:0/2035643446 >> v1:172.21.15.146:6789/0 conn(0x7f17ec0a0a70 legacy=0x7f17ec0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.413+0000 7f17f0f25700 1 -- 172.21.15.146:0/2035643446 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec09e6a0 con 0x7f17ec0a1550 2023-10-03T10:15:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.413+0000 7f17f0f25700 1 --2- 172.21.15.146:0/2035643446 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f17ec0a1550 0x7f17ec138cc0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f17dc009840 tx=0x7f17dc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f20ec9d409919db5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.413+0000 7f17e3fff700 1 -- 172.21.15.146:0/2035643446 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc011830 con 0x7f17ec0a1550 2023-10-03T10:15:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.413+0000 7f17e3fff700 1 -- 172.21.15.146:0/2035643446 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc011990 con 0x7f17ec0a1550 2023-10-03T10:15:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.413+0000 7f17e3fff700 1 -- 172.21.15.146:0/2035643446 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc011d20 con 0x7f17ec0a1550 2023-10-03T10:15:55.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.414+0000 7f17f398a700 1 -- 172.21.15.146:0/2035643446 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f17ec0a1550 msgr2=0x7f17ec138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.414+0000 7f17f398a700 1 --2- 172.21.15.146:0/2035643446 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f17ec0a1550 0x7f17ec138cc0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f17dc009840 tx=0x7f17dc009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.414+0000 7f17f398a700 1 -- 172.21.15.146:0/2035643446 shutdown_connections 2023-10-03T10:15:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.414+0000 7f17f398a700 1 --2- 172.21.15.146:0/2035643446 >> v2:172.21.15.146:3300/0 conn(0x7f17ec139200 0x7f17ec13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.414+0000 7f17f398a700 1 --2- 172.21.15.146:0/2035643446 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f17ec0a1550 0x7f17ec138cc0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.414+0000 7f17f398a700 1 -- 172.21.15.146:0/2035643446 >> 172.21.15.146:0/2035643446 conn(0x7f17ec0a6610 msgr2=0x7f17ec0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.414+0000 7f17f398a700 1 -- 172.21.15.146:0/2035643446 shutdown_connections 2023-10-03T10:15:55.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.414+0000 7f17f398a700 1 -- 172.21.15.146:0/2035643446 wait complete. 2023-10-03T10:15:55.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.415+0000 7f17f398a700 1 Processor -- start 2023-10-03T10:15:55.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.415+0000 7f17f398a700 1 -- start start 2023-10-03T10:15:55.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.415+0000 7f17f398a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17ec0a0a70 0x7f17ec1c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.415+0000 7f17f398a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f17ec0a1550 0x7f17ec1c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.416+0000 7f17f398a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17ec139200 0x7f17ec1c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.416+0000 7f17f398a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec120900 con 0x7f17ec139200 2023-10-03T10:15:55.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.416+0000 7f17f398a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec1346a0 con 0x7f17ec0a0a70 2023-10-03T10:15:55.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.416+0000 7f17f398a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec120da0 con 0x7f17ec0a1550 2023-10-03T10:15:55.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.416+0000 7f17f1726700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17ec0a0a70 0x7f17ec1c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.416+0000 7f17f1726700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17ec0a0a70 0x7f17ec1c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53146/0 (socket says 172.21.15.146:53146) 2023-10-03T10:15:55.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.416+0000 7f17f1726700 1 -- 172.21.15.146:0/811377481 learned_addr learned my addr 172.21.15.146:0/811377481 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:55.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.416+0000 7f17f1f27700 1 --2- 172.21.15.146:0/811377481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17ec139200 0x7f17ec1c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.416+0000 7f17f1726700 1 -- 172.21.15.146:0/811377481 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f17ec0a1550 msgr2=0x7f17ec1c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.416+0000 7f17f1726700 1 --2- 172.21.15.146:0/811377481 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f17ec0a1550 0x7f17ec1c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.416+0000 7f17f1726700 1 -- 172.21.15.146:0/811377481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17ec139200 msgr2=0x7f17ec1c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.416+0000 7f17f1726700 1 --2- 172.21.15.146:0/811377481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17ec139200 0x7f17ec1c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.416+0000 7f17f1726700 1 -- 172.21.15.146:0/811377481 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17dc0094a0 con 0x7f17ec0a0a70 2023-10-03T10:15:55.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.416+0000 7f17f1f27700 1 --2- 172.21.15.146:0/811377481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17ec139200 0x7f17ec1c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:55.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.416+0000 7f17f1726700 1 --2- 172.21.15.146:0/811377481 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17ec0a0a70 0x7f17ec1c8600 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f17e800c4e0 tx=0x7f17e800c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.416+0000 7f17e1ffb700 1 -- 172.21.15.146:0/811377481 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80052d0 con 0x7f17ec0a0a70 2023-10-03T10:15:55.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.416+0000 7f17e1ffb700 1 -- 172.21.15.146:0/811377481 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e8005430 con 0x7f17ec0a0a70 2023-10-03T10:15:55.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.416+0000 7f17e1ffb700 1 -- 172.21.15.146:0/811377481 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80038c0 con 0x7f17ec0a0a70 2023-10-03T10:15:55.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.416+0000 7f17f398a700 1 -- 172.21.15.146:0/811377481 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ec122160 con 0x7f17ec0a0a70 2023-10-03T10:15:55.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.417+0000 7f17f398a700 1 -- 172.21.15.146:0/811377481 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ec120fe0 con 0x7f17ec0a0a70 2023-10-03T10:15:55.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.418+0000 7f17f398a700 1 -- 172.21.15.146:0/811377481 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17ec09c7d0 con 0x7f17ec0a0a70 2023-10-03T10:15:55.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.418+0000 7f17e1ffb700 1 -- 172.21.15.146:0/811377481 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f17e8003a20 con 0x7f17ec0a0a70 2023-10-03T10:15:55.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.418+0000 7f17e1ffb700 1 -- 172.21.15.146:0/811377481 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f17e803eba0 con 0x7f17ec0a0a70 2023-10-03T10:15:55.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.421+0000 7fb87d48c700 1 Processor -- start 2023-10-03T10:15:55.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.421+0000 7fb87d48c700 1 -- start start 2023-10-03T10:15:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.421+0000 7fb87d48c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb87809d860 0x7fb87809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.421+0000 7fb87d48c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87809e170 0x7fb8781307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.421+0000 7fb87d48c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb87809aaa0 con 0x7fb878130ce0 2023-10-03T10:15:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.421+0000 7fb87d48c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87809f870 con 0x7fb87809d860 2023-10-03T10:15:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.421+0000 7fb87d48c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb87809b360 con 0x7fb87809e170 2023-10-03T10:15:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.421+0000 7fb8767fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87809e170 0x7fb8781307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.421+0000 7fb8767fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87809e170 0x7fb8781307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57410/0 (socket says 172.21.15.146:57410) 2023-10-03T10:15:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.421+0000 7fb8767fc700 1 -- 172.21.15.146:0/1274971316 learned_addr learned my addr 172.21.15.146:0/1274971316 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.421+0000 7fb876ffd700 1 --2- 172.21.15.146:0/1274971316 >> v2:172.21.15.146:3300/0 conn(0x7fb87809d860 0x7fb87809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.422+0000 7fb8767fc700 1 -- 172.21.15.146:0/1274971316 >> v2:172.21.15.146:3300/0 conn(0x7fb87809d860 msgr2=0x7fb87809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:55.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.422+0000 7fb8767fc700 1 --2- 172.21.15.146:0/1274971316 >> v2:172.21.15.146:3300/0 conn(0x7fb87809d860 0x7fb87809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.422+0000 7fb8767fc700 1 -- 172.21.15.146:0/1274971316 >> v1:172.21.15.146:6789/0 conn(0x7fb878130ce0 legacy=0x7fb8781379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.422+0000 7fb8767fc700 1 -- 172.21.15.146:0/1274971316 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87809b620 con 0x7fb87809e170 2023-10-03T10:15:55.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.422+0000 7fb8767fc700 1 --2- 172.21.15.146:0/1274971316 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87809e170 0x7fb8781307a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb86c0098f0 tx=0x7fb86c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=790a886560d9223e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.422+0000 7fb875ffb700 1 -- 172.21.15.146:0/1274971316 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c011830 con 0x7fb87809e170 2023-10-03T10:15:55.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.422+0000 7fb875ffb700 1 -- 172.21.15.146:0/1274971316 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c011990 con 0x7fb87809e170 2023-10-03T10:15:55.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.422+0000 7fb875ffb700 1 -- 172.21.15.146:0/1274971316 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c011d20 con 0x7fb87809e170 2023-10-03T10:15:55.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.423+0000 7fb87d48c700 1 -- 172.21.15.146:0/1274971316 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87809e170 msgr2=0x7fb8781307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.423+0000 7fb87d48c700 1 --2- 172.21.15.146:0/1274971316 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87809e170 0x7fb8781307a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb86c0098f0 tx=0x7fb86c009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:55.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.423+0000 7fb87d48c700 1 -- 172.21.15.146:0/1274971316 shutdown_connections 2023-10-03T10:15:55.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.423+0000 7fb87d48c700 1 --2- 172.21.15.146:0/1274971316 >> v2:172.21.15.146:3300/0 conn(0x7fb87809d860 0x7fb87809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.423+0000 7fb87d48c700 1 --2- 172.21.15.146:0/1274971316 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87809e170 0x7fb8781307a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.423+0000 7fb87d48c700 1 -- 172.21.15.146:0/1274971316 >> 172.21.15.146:0/1274971316 conn(0x7fb878099c40 msgr2=0x7fb8780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.423+0000 7fb87d48c700 1 -- 172.21.15.146:0/1274971316 shutdown_connections 2023-10-03T10:15:55.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.423+0000 7fb87d48c700 1 -- 172.21.15.146:0/1274971316 wait complete. 2023-10-03T10:15:55.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.424+0000 7f17e1ffb700 1 -- 172.21.15.146:0/811377481 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17e8018260 con 0x7f17ec0a0a70 2023-10-03T10:15:55.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.424+0000 7fb87d48c700 1 Processor -- start 2023-10-03T10:15:55.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.424+0000 7fb87d48c700 1 -- start start 2023-10-03T10:15:55.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.425+0000 7fb87d48c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb87809d860 0x7fb878136300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.425+0000 7fb87d48c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87809e170 0x7fb878136840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.425+0000 7fb87d48c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb878130ce0 0x7fb8781c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.425+0000 7fb87d48c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8781196d0 con 0x7fb87809d860 2023-10-03T10:15:55.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.425+0000 7fb87d48c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8780a21b0 con 0x7fb878130ce0 2023-10-03T10:15:55.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.425+0000 7fb87d48c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb878135ef0 con 0x7fb87809e170 2023-10-03T10:15:55.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.425+0000 7fb876ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb87809d860 0x7fb878136300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.425+0000 7fb876ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb87809d860 0x7fb878136300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60666/0 (socket says 172.21.15.146:60666) 2023-10-03T10:15:55.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.425+0000 7fb876ffd700 1 -- 172.21.15.146:0/1559863976 learned_addr learned my addr 172.21.15.146:0/1559863976 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:55.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.425+0000 7fb8767fc700 1 --2- 172.21.15.146:0/1559863976 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87809e170 0x7fb878136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.425+0000 7fb876ffd700 1 -- 172.21.15.146:0/1559863976 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87809e170 msgr2=0x7fb878136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.425+0000 7fb876ffd700 1 --2- 172.21.15.146:0/1559863976 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87809e170 0x7fb878136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.425+0000 7fb876ffd700 1 -- 172.21.15.146:0/1559863976 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb878130ce0 msgr2=0x7fb8781c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.425+0000 7fb876ffd700 1 --2- 172.21.15.146:0/1559863976 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb878130ce0 0x7fb8781c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.425+0000 7fb876ffd700 1 -- 172.21.15.146:0/1559863976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c009550 con 0x7fb87809d860 2023-10-03T10:15:55.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.425+0000 7fb876ffd700 1 --2- 172.21.15.146:0/1559863976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb87809d860 0x7fb878136300 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fb86800e9e0 tx=0x7fb86800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.426+0000 7fb85f7fe700 1 -- 172.21.15.146:0/1559863976 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb868009710 con 0x7fb87809d860 2023-10-03T10:15:55.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.426+0000 7fb85f7fe700 1 -- 172.21.15.146:0/1559863976 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86800c7f0 con 0x7fb87809d860 2023-10-03T10:15:55.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.426+0000 7fb87d48c700 1 -- 172.21.15.146:0/1559863976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8781375b0 con 0x7fb87809d860 2023-10-03T10:15:55.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.426+0000 7fb87d48c700 1 -- 172.21.15.146:0/1559863976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb878138f20 con 0x7fb87809d860 2023-10-03T10:15:55.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.426+0000 7fb85f7fe700 1 -- 172.21.15.146:0/1559863976 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86800cb60 con 0x7fb87809d860 2023-10-03T10:15:55.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.427+0000 7fb85f7fe700 1 -- 172.21.15.146:0/1559863976 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb86800ccc0 con 0x7fb87809d860 2023-10-03T10:15:55.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.427+0000 7fb87d48c700 1 -- 172.21.15.146:0/1559863976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8580052e0 con 0x7fb87809d860 2023-10-03T10:15:55.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.431+0000 7fb85f7fe700 1 -- 172.21.15.146:0/1559863976 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb86803f7b0 con 0x7fb87809d860 2023-10-03T10:15:55.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.436+0000 7fb85f7fe700 1 -- 172.21.15.146:0/1559863976 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8680232f0 con 0x7fb87809d860 2023-10-03T10:15:55.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.546+0000 7fad9e27d700 1 -- 172.21.15.146:0/2726007653 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fad9806bce0 con 0x7fad9809bc70 2023-10-03T10:15:55.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.546+0000 7fad94ff9700 1 -- 172.21.15.146:0/2726007653 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fad8801b410 con 0x7fad9809bc70 2023-10-03T10:15:55.546 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:55.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.549+0000 7fad9e27d700 1 -- 172.21.15.146:0/2726007653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad9809bc70 msgr2=0x7fad9811b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.549+0000 7fad9e27d700 1 --2- 172.21.15.146:0/2726007653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad9809bc70 0x7fad9811b6e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fad88000c00 tx=0x7fad88004750 comp rx=0 tx=0).stop 2023-10-03T10:15:55.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.549+0000 7fad9e27d700 1 -- 172.21.15.146:0/2726007653 shutdown_connections 2023-10-03T10:15:55.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.549+0000 7fad9e27d700 1 --2- 172.21.15.146:0/2726007653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad98131980 0x7fad9811c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.549+0000 7fad9e27d700 1 --2- 172.21.15.146:0/2726007653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad9809bc70 0x7fad9811b6e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.549+0000 7fad9e27d700 1 --2- 172.21.15.146:0/2726007653 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad9809c5c0 0x7fad9811bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.549+0000 7fad9e27d700 1 -- 172.21.15.146:0/2726007653 >> 172.21.15.146:0/2726007653 conn(0x7fad980a2980 msgr2=0x7fad981b8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.550+0000 7fad9e27d700 1 -- 172.21.15.146:0/2726007653 shutdown_connections 2023-10-03T10:15:55.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.550+0000 7fad9e27d700 1 -- 172.21.15.146:0/2726007653 wait complete. 2023-10-03T10:15:55.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.560+0000 7f81976f3700 1 -- 172.21.15.146:0/3961470284 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f819004f2a0 con 0x7f81900a0a30 2023-10-03T10:15:55.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.560+0000 7f8185ffb700 1 -- 172.21.15.146:0/3961470284 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f818c017020 con 0x7f81900a0a30 2023-10-03T10:15:55.560 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:55.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.562+0000 7f81976f3700 1 -- 172.21.15.146:0/3961470284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81900a0a30 msgr2=0x7f8190122cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.562+0000 7f81976f3700 1 --2- 172.21.15.146:0/3961470284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81900a0a30 0x7f8190122cd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f818c00c730 tx=0x7f818c00ca40 comp rx=0 tx=0).stop 2023-10-03T10:15:55.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.563+0000 7f81976f3700 1 -- 172.21.15.146:0/3961470284 shutdown_connections 2023-10-03T10:15:55.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.563+0000 7f81976f3700 1 --2- 172.21.15.146:0/3961470284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81901356e0 0x7f8190123750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.563+0000 7f81976f3700 1 --2- 172.21.15.146:0/3961470284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81900a0a30 0x7f8190122cd0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.563+0000 7f81976f3700 1 --2- 172.21.15.146:0/3961470284 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81900a1510 0x7f8190123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.563+0000 7f81976f3700 1 -- 172.21.15.146:0/3961470284 >> 172.21.15.146:0/3961470284 conn(0x7f81900a2980 msgr2=0x7f819009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.563+0000 7f81976f3700 1 -- 172.21.15.146:0/3961470284 shutdown_connections 2023-10-03T10:15:55.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.563+0000 7f81976f3700 1 -- 172.21.15.146:0/3961470284 wait complete. 2023-10-03T10:15:55.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:55.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:55.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.630+0000 7f17f398a700 1 -- 172.21.15.146:0/811377481 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f17ec09d100 con 0x7f17ec0a0a70 2023-10-03T10:15:55.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.631+0000 7f17e1ffb700 1 -- 172.21.15.146:0/811377481 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f17e8017030 con 0x7f17ec0a0a70 2023-10-03T10:15:55.631 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:55.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.634+0000 7f17f398a700 1 -- 172.21.15.146:0/811377481 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17ec0a0a70 msgr2=0x7f17ec1c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.634+0000 7f17f398a700 1 --2- 172.21.15.146:0/811377481 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17ec0a0a70 0x7f17ec1c8600 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f17e800c4e0 tx=0x7f17e800c7f0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.634+0000 7f17f398a700 1 -- 172.21.15.146:0/811377481 shutdown_connections 2023-10-03T10:15:55.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.634+0000 7f17f398a700 1 --2- 172.21.15.146:0/811377481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17ec139200 0x7f17ec1c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.634+0000 7f17f398a700 1 --2- 172.21.15.146:0/811377481 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17ec0a0a70 0x7f17ec1c8600 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.634+0000 7f17f398a700 1 --2- 172.21.15.146:0/811377481 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f17ec0a1550 0x7f17ec1c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.634+0000 7f17f398a700 1 -- 172.21.15.146:0/811377481 >> 172.21.15.146:0/811377481 conn(0x7f17ec0a6610 msgr2=0x7f17ec136ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.634+0000 7f17f398a700 1 -- 172.21.15.146:0/811377481 shutdown_connections 2023-10-03T10:15:55.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.634+0000 7f17f398a700 1 -- 172.21.15.146:0/811377481 wait complete. 2023-10-03T10:15:55.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.635+0000 7fb87d48c700 1 -- 172.21.15.146:0/1559863976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb858005590 con 0x7fb87809d860 2023-10-03T10:15:55.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.636+0000 7fb85f7fe700 1 -- 172.21.15.146:0/1559863976 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb868021070 con 0x7fb87809d860 2023-10-03T10:15:55.635 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:55.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.638+0000 7fb87d48c700 1 -- 172.21.15.146:0/1559863976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb87809d860 msgr2=0x7fb878136300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.638+0000 7fb87d48c700 1 --2- 172.21.15.146:0/1559863976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb87809d860 0x7fb878136300 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fb86800e9e0 tx=0x7fb86800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.638+0000 7fb87d48c700 1 -- 172.21.15.146:0/1559863976 shutdown_connections 2023-10-03T10:15:55.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.638+0000 7fb87d48c700 1 --2- 172.21.15.146:0/1559863976 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb878130ce0 0x7fb8781c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.638+0000 7fb87d48c700 1 --2- 172.21.15.146:0/1559863976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb87809d860 0x7fb878136300 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.638+0000 7fb87d48c700 1 --2- 172.21.15.146:0/1559863976 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb87809e170 0x7fb878136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.638+0000 7fb87d48c700 1 -- 172.21.15.146:0/1559863976 >> 172.21.15.146:0/1559863976 conn(0x7fb878099c40 msgr2=0x7fb878139790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.638+0000 7fb87d48c700 1 -- 172.21.15.146:0/1559863976 shutdown_connections 2023-10-03T10:15:55.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:55.638+0000 7fb87d48c700 1 -- 172.21.15.146:0/1559863976 wait complete. 2023-10-03T10:15:55.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:55.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:56.567 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:56.576 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:56.648 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:56.651 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:56.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.718+0000 7f6f50ffe700 1 Processor -- start 2023-10-03T10:15:56.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.718+0000 7f6f50ffe700 1 -- start start 2023-10-03T10:15:56.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.719+0000 7f6f50ffe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f4c136960 0x7f6f4c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.719+0000 7f6f50ffe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f4c139280 0x7f6f4c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.719+0000 7f6f50ffe700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4c06b2d0 con 0x7f6f4c133ad0 2023-10-03T10:15:56.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.719+0000 7f6f50ffe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c1345b0 con 0x7f6f4c139280 2023-10-03T10:15:56.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.719+0000 7f6f50ffe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c133610 con 0x7f6f4c136960 2023-10-03T10:15:56.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.719+0000 7f6f49d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f4c136960 0x7f6f4c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.719+0000 7f6f49d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f4c136960 0x7f6f4c138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57438/0 (socket says 172.21.15.146:57438) 2023-10-03T10:15:56.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.719+0000 7f6f49d9b700 1 -- 172.21.15.146:0/2883103238 learned_addr learned my addr 172.21.15.146:0/2883103238 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:56.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.719+0000 7f6f4ad9d700 1 --2- 172.21.15.146:0/2883103238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f4c139280 0x7f6f4c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.720+0000 7f6f49d9b700 1 -- 172.21.15.146:0/2883103238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f4c139280 msgr2=0x7f6f4c13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.720+0000 7f6f49d9b700 1 --2- 172.21.15.146:0/2883103238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f4c139280 0x7f6f4c13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.720+0000 7f6f49d9b700 1 -- 172.21.15.146:0/2883103238 >> v1:172.21.15.146:6789/0 conn(0x7f6f4c133ad0 legacy=0x7f6f4c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.720+0000 7f6f49d9b700 1 -- 172.21.15.146:0/2883103238 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c09a500 con 0x7f6f4c136960 2023-10-03T10:15:56.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.720+0000 7f6f4959a700 1 -- 172.21.15.146:0/2883103238 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074446944 0 0) 0x7f6f4c06b2d0 con 0x7f6f4c133ad0 2023-10-03T10:15:56.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.720+0000 7f6f4ad9d700 1 --2- 172.21.15.146:0/2883103238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f4c139280 0x7f6f4c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.720+0000 7f6f49d9b700 1 --2- 172.21.15.146:0/2883103238 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f4c136960 0x7f6f4c138d40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009920 tx=0x7f6f40009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d59de6d68cc7e91c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.720+0000 7f6f4959a700 1 -- 172.21.15.146:0/2883103238 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40011830 con 0x7f6f4c136960 2023-10-03T10:15:56.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.720+0000 7f6f4959a700 1 -- 172.21.15.146:0/2883103238 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f40011990 con 0x7f6f4c136960 2023-10-03T10:15:56.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.720+0000 7f6f4959a700 1 -- 172.21.15.146:0/2883103238 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40011d20 con 0x7f6f4c136960 2023-10-03T10:15:56.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.721+0000 7f6f50ffe700 1 -- 172.21.15.146:0/2883103238 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f4c136960 msgr2=0x7f6f4c138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.721+0000 7f6f50ffe700 1 --2- 172.21.15.146:0/2883103238 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f4c136960 0x7f6f4c138d40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009920 tx=0x7f6f40009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:56.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.721+0000 7f6f50ffe700 1 -- 172.21.15.146:0/2883103238 shutdown_connections 2023-10-03T10:15:56.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.721+0000 7f6f50ffe700 1 --2- 172.21.15.146:0/2883103238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f4c139280 0x7f6f4c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.721+0000 7f6f50ffe700 1 --2- 172.21.15.146:0/2883103238 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f4c136960 0x7f6f4c138d40 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.721+0000 7f6f50ffe700 1 -- 172.21.15.146:0/2883103238 >> 172.21.15.146:0/2883103238 conn(0x7f6f4c099c40 msgr2=0x7f6f4c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.721+0000 7f6f50ffe700 1 -- 172.21.15.146:0/2883103238 shutdown_connections 2023-10-03T10:15:56.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.721+0000 7f6f50ffe700 1 -- 172.21.15.146:0/2883103238 wait complete. 2023-10-03T10:15:56.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.723+0000 7f6f50ffe700 1 Processor -- start 2023-10-03T10:15:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.723+0000 7f6f50ffe700 1 -- start start 2023-10-03T10:15:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.723+0000 7f6f50ffe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c133ad0 0x7f6f4c071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.723+0000 7f6f50ffe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f4c136960 0x7f6f4c071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.723+0000 7f6f50ffe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f4c139280 0x7f6f4c1c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.723+0000 7f6f50ffe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c06e900 con 0x7f6f4c133ad0 2023-10-03T10:15:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.723+0000 7f6f50ffe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c06f490 con 0x7f6f4c139280 2023-10-03T10:15:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.723+0000 7f6f50ffe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c131730 con 0x7f6f4c136960 2023-10-03T10:15:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.724+0000 7f6f4a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c133ad0 0x7f6f4c071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.724+0000 7f6f4a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c133ad0 0x7f6f4c071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60682/0 (socket says 172.21.15.146:60682) 2023-10-03T10:15:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.724+0000 7f6f4a59c700 1 -- 172.21.15.146:0/1677821062 learned_addr learned my addr 172.21.15.146:0/1677821062 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.724+0000 7f6f4ad9d700 1 --2- 172.21.15.146:0/1677821062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f4c139280 0x7f6f4c1c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.724+0000 7f6f49d9b700 1 --2- 172.21.15.146:0/1677821062 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f4c136960 0x7f6f4c071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.724+0000 7f6f4a59c700 1 -- 172.21.15.146:0/1677821062 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f4c136960 msgr2=0x7f6f4c071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.724+0000 7f6f4a59c700 1 --2- 172.21.15.146:0/1677821062 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f4c136960 0x7f6f4c071d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.724+0000 7f6f4a59c700 1 -- 172.21.15.146:0/1677821062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f4c139280 msgr2=0x7f6f4c1c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.724+0000 7f6f4a59c700 1 --2- 172.21.15.146:0/1677821062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f4c139280 0x7f6f4c1c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.724+0000 7f6f4a59c700 1 -- 172.21.15.146:0/1677821062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f44009a70 con 0x7f6f4c133ad0 2023-10-03T10:15:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.724+0000 7f6f49d9b700 1 --2- 172.21.15.146:0/1677821062 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f4c136960 0x7f6f4c071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.724+0000 7f6f4a59c700 1 --2- 172.21.15.146:0/1677821062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c133ad0 0x7f6f4c071850 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00c480 tx=0x7f6f3c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.724+0000 7f6f3affd700 1 -- 172.21.15.146:0/1677821062 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0054e0 con 0x7f6f4c133ad0 2023-10-03T10:15:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.724+0000 7f6f50ffe700 1 -- 172.21.15.146:0/1677821062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f40009550 con 0x7f6f4c133ad0 2023-10-03T10:15:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.724+0000 7f6f50ffe700 1 -- 172.21.15.146:0/1677821062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f4c0722d0 con 0x7f6f4c133ad0 2023-10-03T10:15:56.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.724+0000 7f6f3affd700 1 -- 172.21.15.146:0/1677821062 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3c003680 con 0x7f6f4c133ad0 2023-10-03T10:15:56.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.724+0000 7f6f3affd700 1 -- 172.21.15.146:0/1677821062 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0039f0 con 0x7f6f4c133ad0 2023-10-03T10:15:56.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.727+0000 7f6f50ffe700 1 -- 172.21.15.146:0/1677821062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f300052e0 con 0x7f6f4c133ad0 2023-10-03T10:15:56.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.727+0000 7f6f3affd700 1 -- 172.21.15.146:0/1677821062 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f3c003b50 con 0x7f6f4c133ad0 2023-10-03T10:15:56.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.727+0000 7f6f3affd700 1 -- 172.21.15.146:0/1677821062 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6f3c03ec30 con 0x7f6f4c133ad0 2023-10-03T10:15:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.735+0000 7f6f3affd700 1 -- 172.21.15.146:0/1677821062 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f3c012400 con 0x7f6f4c133ad0 2023-10-03T10:15:56.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.747+0000 7f32de3ac700 1 Processor -- start 2023-10-03T10:15:56.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.747+0000 7f32de3ac700 1 -- start start 2023-10-03T10:15:56.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.748+0000 7f32de3ac700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d8130350 0x7f32d8130720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.748+0000 7f32de3ac700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d8130c60 0x7f32d812cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.748+0000 7f32de3ac700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d8072520 con 0x7f32d812d470 2023-10-03T10:15:56.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.748+0000 7f32de3ac700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d809cd30 con 0x7f32d8130350 2023-10-03T10:15:56.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.748+0000 7f32de3ac700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32d809b250 con 0x7f32d8130c60 2023-10-03T10:15:56.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.748+0000 7f32d77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d8130c60 0x7f32d812cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.748+0000 7f32d77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d8130c60 0x7f32d812cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57448/0 (socket says 172.21.15.146:57448) 2023-10-03T10:15:56.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.748+0000 7f32dc949700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f32d812d470 0x7f32d8137890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36642/0 (socket says 172.21.15.146:36642) 2023-10-03T10:15:56.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.748+0000 7f32d77fe700 1 -- 172.21.15.146:0/4227534912 learned_addr learned my addr 172.21.15.146:0/4227534912 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:56.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.748+0000 7f32d7fff700 1 --2- 172.21.15.146:0/4227534912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d8130350 0x7f32d8130720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.749+0000 7f32d7fff700 1 -- 172.21.15.146:0/4227534912 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d8130c60 msgr2=0x7f32d812cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.749+0000 7f32d7fff700 1 --2- 172.21.15.146:0/4227534912 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d8130c60 0x7f32d812cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.749+0000 7f32d7fff700 1 -- 172.21.15.146:0/4227534912 >> v1:172.21.15.146:6789/0 conn(0x7f32d812d470 legacy=0x7f32d8137890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.749+0000 7f32d7fff700 1 -- 172.21.15.146:0/4227534912 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d809bbb0 con 0x7f32d8130350 2023-10-03T10:15:56.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.749+0000 7f32d77fe700 1 --2- 172.21.15.146:0/4227534912 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d8130c60 0x7f32d812cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.749+0000 7f32d7fff700 1 --2- 172.21.15.146:0/4227534912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d8130350 0x7f32d8130720 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f32c8009880 tx=0x7f32c8009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa8c5d95a07949d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.749+0000 7f32d6ffd700 1 -- 172.21.15.146:0/4227534912 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8005e30 con 0x7f32d8130350 2023-10-03T10:15:56.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.749+0000 7f32d6ffd700 1 -- 172.21.15.146:0/4227534912 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c8006030 con 0x7f32d8130350 2023-10-03T10:15:56.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.749+0000 7f32d6ffd700 1 -- 172.21.15.146:0/4227534912 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c80063c0 con 0x7f32d8130350 2023-10-03T10:15:56.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.750+0000 7f32de3ac700 1 -- 172.21.15.146:0/4227534912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d8130350 msgr2=0x7f32d8130720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.750+0000 7f32de3ac700 1 --2- 172.21.15.146:0/4227534912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d8130350 0x7f32d8130720 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f32c8009880 tx=0x7f32c8009b90 comp rx=0 tx=0).stop 2023-10-03T10:15:56.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.750+0000 7f32de3ac700 1 -- 172.21.15.146:0/4227534912 shutdown_connections 2023-10-03T10:15:56.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.750+0000 7f32de3ac700 1 --2- 172.21.15.146:0/4227534912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d8130350 0x7f32d8130720 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.750+0000 7f32de3ac700 1 --2- 172.21.15.146:0/4227534912 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d8130c60 0x7f32d812cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.750+0000 7f32de3ac700 1 -- 172.21.15.146:0/4227534912 >> 172.21.15.146:0/4227534912 conn(0x7f32d80a2980 msgr2=0x7f32d80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.750+0000 7f32de3ac700 1 -- 172.21.15.146:0/4227534912 shutdown_connections 2023-10-03T10:15:56.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.750+0000 7f32de3ac700 1 -- 172.21.15.146:0/4227534912 wait complete. 2023-10-03T10:15:56.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.751+0000 7f32de3ac700 1 Processor -- start 2023-10-03T10:15:56.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.751+0000 7f32de3ac700 1 -- start start 2023-10-03T10:15:56.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.752+0000 7f32de3ac700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d812d470 0x7f32d8138c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.752+0000 7f32de3ac700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d8130350 0x7f32d81372d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.752+0000 7f32de3ac700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32d8130c60 0x7f32d8137810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.752+0000 7f32de3ac700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d8134da0 con 0x7f32d8130c60 2023-10-03T10:15:56.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.752+0000 7f32de3ac700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d8136150 con 0x7f32d812d470 2023-10-03T10:15:56.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.752+0000 7f32de3ac700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32d812ea50 con 0x7f32d8130350 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.752+0000 7f32dc949700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32d8130c60 0x7f32d8137810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.752+0000 7f32d77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d8130350 0x7f32d81372d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.752+0000 7f32dc949700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32d8130c60 0x7f32d8137810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60698/0 (socket says 172.21.15.146:60698) 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.752+0000 7f32dc949700 1 -- 172.21.15.146:0/4189505674 learned_addr learned my addr 172.21.15.146:0/4189505674 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.752+0000 7f32d7fff700 1 --2- 172.21.15.146:0/4189505674 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d812d470 0x7f32d8138c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.752+0000 7f32d77fe700 1 -- 172.21.15.146:0/4189505674 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d812d470 msgr2=0x7f32d8138c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.752+0000 7f32d77fe700 1 --2- 172.21.15.146:0/4189505674 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d812d470 0x7f32d8138c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.752+0000 7f32d77fe700 1 -- 172.21.15.146:0/4189505674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32d8130c60 msgr2=0x7f32d8137810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.752+0000 7f32d77fe700 1 --2- 172.21.15.146:0/4189505674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32d8130c60 0x7f32d8137810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.752+0000 7f32d77fe700 1 -- 172.21.15.146:0/4189505674 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32cc009550 con 0x7f32d8130350 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.752+0000 7f32dc949700 1 --2- 172.21.15.146:0/4189505674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32d8130c60 0x7f32d8137810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.753+0000 7f32d77fe700 1 --2- 172.21.15.146:0/4189505674 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d8130350 0x7f32d81372d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f32d809c300 tx=0x7f32cc00ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.753+0000 7f32d4ff9700 1 -- 172.21.15.146:0/4189505674 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc004240 con 0x7f32d8130350 2023-10-03T10:15:56.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.753+0000 7f32d4ff9700 1 -- 172.21.15.146:0/4189505674 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32cc0043a0 con 0x7f32d8130350 2023-10-03T10:15:56.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.753+0000 7f32de3ac700 1 -- 172.21.15.146:0/4189505674 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c8009430 con 0x7f32d8130350 2023-10-03T10:15:56.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.753+0000 7f32d4ff9700 1 -- 172.21.15.146:0/4189505674 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc0036a0 con 0x7f32d8130350 2023-10-03T10:15:56.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.753+0000 7f32de3ac700 1 -- 172.21.15.146:0/4189505674 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d80a24b0 con 0x7f32d8130350 2023-10-03T10:15:56.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.754+0000 7f32d4ff9700 1 -- 172.21.15.146:0/4189505674 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f32cc003800 con 0x7f32d8130350 2023-10-03T10:15:56.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.754+0000 7f32d4ff9700 1 -- 172.21.15.146:0/4189505674 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f32cc0123d0 con 0x7f32d8130350 2023-10-03T10:15:56.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.754+0000 7f32de3ac700 1 -- 172.21.15.146:0/4189505674 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32d809cf30 con 0x7f32d8130350 2023-10-03T10:15:56.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.759+0000 7f32d4ff9700 1 -- 172.21.15.146:0/4189505674 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f32d809cf30 con 0x7f32d8130350 2023-10-03T10:15:56.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.799+0000 7f29168b3700 1 Processor -- start 2023-10-03T10:15:56.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.800+0000 7f29168b3700 1 -- start start 2023-10-03T10:15:56.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.800+0000 7f29168b3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f291009d860 0x7f291009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.800+0000 7f29168b3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f291009e170 0x7f29101307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.800+0000 7f29168b3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f291009aaa0 con 0x7f2910130ce0 2023-10-03T10:15:56.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.800+0000 7f29168b3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f291009f870 con 0x7f291009d860 2023-10-03T10:15:56.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.800+0000 7f29168b3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f291009b360 con 0x7f291009e170 2023-10-03T10:15:56.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.800+0000 7f290f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f291009e170 0x7f29101307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.800+0000 7f290f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f291009e170 0x7f29101307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57462/0 (socket says 172.21.15.146:57462) 2023-10-03T10:15:56.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.800+0000 7f290f7fe700 1 -- 172.21.15.146:0/245368895 learned_addr learned my addr 172.21.15.146:0/245368895 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:56.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.801+0000 7f290ffff700 1 --2- 172.21.15.146:0/245368895 >> v2:172.21.15.146:3300/0 conn(0x7f291009d860 0x7f291009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.801+0000 7f290f7fe700 1 -- 172.21.15.146:0/245368895 >> v2:172.21.15.146:3300/0 conn(0x7f291009d860 msgr2=0x7f291009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.801+0000 7f290f7fe700 1 --2- 172.21.15.146:0/245368895 >> v2:172.21.15.146:3300/0 conn(0x7f291009d860 0x7f291009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.801+0000 7f290f7fe700 1 -- 172.21.15.146:0/245368895 >> v1:172.21.15.146:6789/0 conn(0x7f2910130ce0 legacy=0x7f29101379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.801+0000 7f290effd700 1 -- 172.21.15.146:0/245368895 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917273792 0 0) 0x7f291009aaa0 con 0x7f2910130ce0 2023-10-03T10:15:56.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.801+0000 7f290f7fe700 1 -- 172.21.15.146:0/245368895 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291009b620 con 0x7f291009e170 2023-10-03T10:15:56.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.801+0000 7f290f7fe700 1 --2- 172.21.15.146:0/245368895 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f291009e170 0x7f29101307a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f29040098f0 tx=0x7f2904009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8b4de4d520d6a17 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.801+0000 7f290effd700 1 -- 172.21.15.146:0/245368895 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2904011830 con 0x7f291009e170 2023-10-03T10:15:56.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.801+0000 7f290effd700 1 -- 172.21.15.146:0/245368895 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2904011990 con 0x7f291009e170 2023-10-03T10:15:56.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.801+0000 7f290effd700 1 -- 172.21.15.146:0/245368895 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2904011d20 con 0x7f291009e170 2023-10-03T10:15:56.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.802+0000 7f29168b3700 1 -- 172.21.15.146:0/245368895 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f291009e170 msgr2=0x7f29101307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.802+0000 7f29168b3700 1 --2- 172.21.15.146:0/245368895 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f291009e170 0x7f29101307a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f29040098f0 tx=0x7f2904009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:56.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.802+0000 7f29168b3700 1 -- 172.21.15.146:0/245368895 shutdown_connections 2023-10-03T10:15:56.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.802+0000 7f29168b3700 1 --2- 172.21.15.146:0/245368895 >> v2:172.21.15.146:3300/0 conn(0x7f291009d860 0x7f291009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.802+0000 7f29168b3700 1 --2- 172.21.15.146:0/245368895 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f291009e170 0x7f29101307a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.802+0000 7f29168b3700 1 -- 172.21.15.146:0/245368895 >> 172.21.15.146:0/245368895 conn(0x7f2910099c40 msgr2=0x7f29100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.802+0000 7f29168b3700 1 -- 172.21.15.146:0/245368895 shutdown_connections 2023-10-03T10:15:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.802+0000 7f29168b3700 1 -- 172.21.15.146:0/245368895 wait complete. 2023-10-03T10:15:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.803+0000 7f29168b3700 1 Processor -- start 2023-10-03T10:15:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.803+0000 7f29168b3700 1 -- start start 2023-10-03T10:15:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.804+0000 7f29168b3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f291009d860 0x7f2910135690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.804+0000 7f29168b3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f291009e170 0x7f2910135bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.804+0000 7f29168b3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2910130ce0 0x7f2910136110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.804+0000 7f29168b3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2910138bc0 con 0x7f291009e170 2023-10-03T10:15:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.804+0000 7f29168b3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29101388f0 con 0x7f2910130ce0 2023-10-03T10:15:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.804+0000 7f29168b3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29100a1fb0 con 0x7f291009d860 2023-10-03T10:15:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.804+0000 7f290f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f291009e170 0x7f2910135bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.804+0000 7f290f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f291009e170 0x7f2910135bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60706/0 (socket says 172.21.15.146:60706) 2023-10-03T10:15:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.804+0000 7f290f7fe700 1 -- 172.21.15.146:0/2973491263 learned_addr learned my addr 172.21.15.146:0/2973491263 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.804+0000 7f290ffff700 1 --2- 172.21.15.146:0/2973491263 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f291009d860 0x7f2910135690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.804+0000 7f2914e50700 1 --2- 172.21.15.146:0/2973491263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2910130ce0 0x7f2910136110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.804+0000 7f290f7fe700 1 -- 172.21.15.146:0/2973491263 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f291009d860 msgr2=0x7f2910135690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.804+0000 7f290f7fe700 1 --2- 172.21.15.146:0/2973491263 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f291009d860 0x7f2910135690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.804+0000 7f290f7fe700 1 -- 172.21.15.146:0/2973491263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2910130ce0 msgr2=0x7f2910136110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.804+0000 7f290f7fe700 1 --2- 172.21.15.146:0/2973491263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2910130ce0 0x7f2910136110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.804+0000 7f290f7fe700 1 -- 172.21.15.146:0/2973491263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2904009550 con 0x7f291009e170 2023-10-03T10:15:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.804+0000 7f290f7fe700 1 --2- 172.21.15.146:0/2973491263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f291009e170 0x7f2910135bd0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f2904009c40 tx=0x7f2904004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.805+0000 7f290cff9700 1 -- 172.21.15.146:0/2973491263 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2904004510 con 0x7f291009e170 2023-10-03T10:15:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.805+0000 7f290cff9700 1 -- 172.21.15.146:0/2973491263 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29040036a0 con 0x7f291009e170 2023-10-03T10:15:56.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.805+0000 7f290cff9700 1 -- 172.21.15.146:0/2973491263 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2904003a10 con 0x7f291009e170 2023-10-03T10:15:56.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.805+0000 7f29168b3700 1 -- 172.21.15.146:0/2973491263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2910119bb0 con 0x7f291009e170 2023-10-03T10:15:56.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.805+0000 7f29168b3700 1 -- 172.21.15.146:0/2973491263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2910137990 con 0x7f291009e170 2023-10-03T10:15:56.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.806+0000 7f290cff9700 1 -- 172.21.15.146:0/2973491263 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2904021070 con 0x7f291009e170 2023-10-03T10:15:56.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.806+0000 7f290cff9700 1 -- 172.21.15.146:0/2973491263 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2904040c20 con 0x7f291009e170 2023-10-03T10:15:56.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.806+0000 7f29168b3700 1 -- 172.21.15.146:0/2973491263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f291004f2a0 con 0x7f291009e170 2023-10-03T10:15:56.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.811+0000 7f290cff9700 1 -- 172.21.15.146:0/2973491263 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2904015080 con 0x7f291009e170 2023-10-03T10:15:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.826+0000 7f9270110700 1 Processor -- start 2023-10-03T10:15:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.827+0000 7f9270110700 1 -- start start 2023-10-03T10:15:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.827+0000 7f9270110700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f926806b250 0x7f9268136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.827+0000 7f9270110700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9268137140 0x7f9268139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.827+0000 7f9270110700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926809da80 con 0x7f926806a770 2023-10-03T10:15:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.827+0000 7f9270110700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f926809f770 con 0x7f926806b250 2023-10-03T10:15:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.827+0000 7f9270110700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f926809dce0 con 0x7f9268137140 2023-10-03T10:15:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.827+0000 7f926e6ad700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9268137140 0x7f9268139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.827+0000 7f926deac700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f926806a770 0x7f926806ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36656/0 (socket says 172.21.15.146:36656) 2023-10-03T10:15:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.827+0000 7f926deac700 1 -- 172.21.15.146:0/696563069 learned_addr learned my addr 172.21.15.146:0/696563069 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:15:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.827+0000 7f926d6ab700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f926806b250 0x7f9268136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.828+0000 7f926d6ab700 1 -- 172.21.15.146:0/696563069 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9268137140 msgr2=0x7f9268139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.828+0000 7f926d6ab700 1 --2- 172.21.15.146:0/696563069 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9268137140 0x7f9268139520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.828+0000 7f926d6ab700 1 -- 172.21.15.146:0/696563069 >> v1:172.21.15.146:6789/0 conn(0x7f926806a770 legacy=0x7f926806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.828+0000 7f926d6ab700 1 -- 172.21.15.146:0/696563069 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926809eb20 con 0x7f926806b250 2023-10-03T10:15:56.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.828+0000 7f926ceaa700 1 -- 172.21.15.146:0/696563069 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253260906 0 0) 0x7f926809da80 con 0x7f926806a770 2023-10-03T10:15:56.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.828+0000 7f926d6ab700 1 --2- 172.21.15.146:0/696563069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f926806b250 0x7f9268136c00 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f9258009840 tx=0x7f9258009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4e7a19772d15ce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.828+0000 7f926ceaa700 1 -- 172.21.15.146:0/696563069 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9258011830 con 0x7f926806b250 2023-10-03T10:15:56.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.828+0000 7f926ceaa700 1 -- 172.21.15.146:0/696563069 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9258011990 con 0x7f926806b250 2023-10-03T10:15:56.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.828+0000 7f926ceaa700 1 -- 172.21.15.146:0/696563069 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9258011d20 con 0x7f926806b250 2023-10-03T10:15:56.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.829+0000 7f9270110700 1 -- 172.21.15.146:0/696563069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f926806b250 msgr2=0x7f9268136c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.829+0000 7f9270110700 1 --2- 172.21.15.146:0/696563069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f926806b250 0x7f9268136c00 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f9258009840 tx=0x7f9258009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:56.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.829+0000 7f9270110700 1 -- 172.21.15.146:0/696563069 shutdown_connections 2023-10-03T10:15:56.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.829+0000 7f9270110700 1 --2- 172.21.15.146:0/696563069 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9268137140 0x7f9268139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.829+0000 7f9270110700 1 --2- 172.21.15.146:0/696563069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f926806b250 0x7f9268136c00 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.829+0000 7f9270110700 1 -- 172.21.15.146:0/696563069 >> 172.21.15.146:0/696563069 conn(0x7f9268099c40 msgr2=0x7f92680a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.829+0000 7f9270110700 1 -- 172.21.15.146:0/696563069 shutdown_connections 2023-10-03T10:15:56.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.829+0000 7f9270110700 1 -- 172.21.15.146:0/696563069 wait complete. 2023-10-03T10:15:56.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.830+0000 7f9270110700 1 Processor -- start 2023-10-03T10:15:56.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.830+0000 7f9270110700 1 -- start start 2023-10-03T10:15:56.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.830+0000 7f9270110700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f926806a770 0x7f926811e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.830+0000 7f9270110700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f926806b250 0x7f926811ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.830+0000 7f9270110700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9268137140 0x7f926811efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.830+0000 7f9270110700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92681216a0 con 0x7f9268137140 2023-10-03T10:15:56.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.830+0000 7f9270110700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9268120090 con 0x7f926806b250 2023-10-03T10:15:56.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.830+0000 7f9270110700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92680a06f0 con 0x7f926806a770 2023-10-03T10:15:56.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.830+0000 7f926e6ad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9268137140 0x7f926811efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.830+0000 7f926e6ad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9268137140 0x7f926811efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60724/0 (socket says 172.21.15.146:60724) 2023-10-03T10:15:56.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.830+0000 7f926e6ad700 1 -- 172.21.15.146:0/1293712123 learned_addr learned my addr 172.21.15.146:0/1293712123 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:56.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.830+0000 7f926deac700 1 --2- 172.21.15.146:0/1293712123 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f926806a770 0x7f926811e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.831+0000 7f926e6ad700 1 -- 172.21.15.146:0/1293712123 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f926806a770 msgr2=0x7f926811e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.831+0000 7f926e6ad700 1 --2- 172.21.15.146:0/1293712123 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f926806a770 0x7f926811e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.831+0000 7f926e6ad700 1 -- 172.21.15.146:0/1293712123 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f926806b250 msgr2=0x7f926811ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.830+0000 7f926d6ab700 1 --2- 172.21.15.146:0/1293712123 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f926806b250 0x7f926811ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.831+0000 7f926e6ad700 1 --2- 172.21.15.146:0/1293712123 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f926806b250 0x7f926811ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.831+0000 7f926e6ad700 1 -- 172.21.15.146:0/1293712123 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92580094a0 con 0x7f9268137140 2023-10-03T10:15:56.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.831+0000 7f926d6ab700 1 --2- 172.21.15.146:0/1293712123 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f926806b250 0x7f926811ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:56.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.831+0000 7f926e6ad700 1 --2- 172.21.15.146:0/1293712123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9268137140 0x7f926811efa0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f926000efc0 tx=0x7f926000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.831+0000 7f925e7fc700 1 -- 172.21.15.146:0/1293712123 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9260009ca0 con 0x7f9268137140 2023-10-03T10:15:56.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.831+0000 7f925e7fc700 1 -- 172.21.15.146:0/1293712123 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926000f040 con 0x7f9268137140 2023-10-03T10:15:56.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.831+0000 7f9270110700 1 -- 172.21.15.146:0/1293712123 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9268121fa0 con 0x7f9268137140 2023-10-03T10:15:56.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.831+0000 7f925e7fc700 1 -- 172.21.15.146:0/1293712123 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9260014480 con 0x7f9268137140 2023-10-03T10:15:56.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.831+0000 7f9270110700 1 -- 172.21.15.146:0/1293712123 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9268121cc0 con 0x7f9268137140 2023-10-03T10:15:56.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.832+0000 7f9270110700 1 -- 172.21.15.146:0/1293712123 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926804f2a0 con 0x7f9268137140 2023-10-03T10:15:56.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.833+0000 7f925e7fc700 1 -- 172.21.15.146:0/1293712123 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f92600145e0 con 0x7f9268137140 2023-10-03T10:15:56.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.833+0000 7f925e7fc700 1 -- 172.21.15.146:0/1293712123 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f92600403b0 con 0x7f9268137140 2023-10-03T10:15:56.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:56.838+0000 7f925e7fc700 1 -- 172.21.15.146:0/1293712123 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9260007920 con 0x7f9268137140 2023-10-03T10:15:57.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.001+0000 7f6f50ffe700 1 -- 172.21.15.146:0/1677821062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6f30005590 con 0x7f6f4c133ad0 2023-10-03T10:15:57.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.002+0000 7f6f3affd700 1 -- 172.21.15.146:0/1677821062 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6f3c017030 con 0x7f6f4c133ad0 2023-10-03T10:15:57.001 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:57.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.004+0000 7f32de3ac700 1 -- 172.21.15.146:0/4189505674 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f32d809cf30 con 0x7f32d8130350 2023-10-03T10:15:57.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.004+0000 7f6f50ffe700 1 -- 172.21.15.146:0/1677821062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c133ad0 msgr2=0x7f6f4c071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.004+0000 7f6f50ffe700 1 --2- 172.21.15.146:0/1677821062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c133ad0 0x7f6f4c071850 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00c480 tx=0x7f6f3c00c840 comp rx=0 tx=0).stop 2023-10-03T10:15:57.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.005+0000 7f6f50ffe700 1 -- 172.21.15.146:0/1677821062 shutdown_connections 2023-10-03T10:15:57.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.005+0000 7f6f50ffe700 1 --2- 172.21.15.146:0/1677821062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f4c139280 0x7f6f4c1c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.005+0000 7f6f50ffe700 1 --2- 172.21.15.146:0/1677821062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c133ad0 0x7f6f4c071850 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.005+0000 7f6f50ffe700 1 --2- 172.21.15.146:0/1677821062 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f4c136960 0x7f6f4c071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.005+0000 7f6f50ffe700 1 -- 172.21.15.146:0/1677821062 >> 172.21.15.146:0/1677821062 conn(0x7f6f4c099c40 msgr2=0x7f6f4c0a30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:57.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.005+0000 7f6f50ffe700 1 -- 172.21.15.146:0/1677821062 shutdown_connections 2023-10-03T10:15:57.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.005+0000 7f6f50ffe700 1 -- 172.21.15.146:0/1677821062 wait complete. 2023-10-03T10:15:57.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.005+0000 7f32d4ff9700 1 -- 172.21.15.146:0/4189505674 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f32d809cf30 con 0x7f32d8130350 2023-10-03T10:15:57.006 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:57.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.007+0000 7f32de3ac700 1 -- 172.21.15.146:0/4189505674 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d8130350 msgr2=0x7f32d81372d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.007+0000 7f32de3ac700 1 --2- 172.21.15.146:0/4189505674 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d8130350 0x7f32d81372d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f32d809c300 tx=0x7f32cc00ec80 comp rx=0 tx=0).stop 2023-10-03T10:15:57.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.008+0000 7f32de3ac700 1 -- 172.21.15.146:0/4189505674 shutdown_connections 2023-10-03T10:15:57.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.008+0000 7f32de3ac700 1 --2- 172.21.15.146:0/4189505674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32d8130c60 0x7f32d8137810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.008+0000 7f32de3ac700 1 --2- 172.21.15.146:0/4189505674 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d812d470 0x7f32d8138c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.008+0000 7f32de3ac700 1 --2- 172.21.15.146:0/4189505674 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d8130350 0x7f32d81372d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.008+0000 7f32de3ac700 1 -- 172.21.15.146:0/4189505674 >> 172.21.15.146:0/4189505674 conn(0x7f32d80a2980 msgr2=0x7f32d809f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:57.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.008+0000 7f32de3ac700 1 -- 172.21.15.146:0/4189505674 shutdown_connections 2023-10-03T10:15:57.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.008+0000 7f32de3ac700 1 -- 172.21.15.146:0/4189505674 wait complete. 2023-10-03T10:15:57.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:57.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:57.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.055+0000 7f29168b3700 1 -- 172.21.15.146:0/2973491263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f291006c3b0 con 0x7f291009e170 2023-10-03T10:15:57.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.055+0000 7f290cff9700 1 -- 172.21.15.146:0/2973491263 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2904029020 con 0x7f291009e170 2023-10-03T10:15:57.055 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:57.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.057+0000 7f29168b3700 1 -- 172.21.15.146:0/2973491263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f291009e170 msgr2=0x7f2910135bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.057+0000 7f29168b3700 1 --2- 172.21.15.146:0/2973491263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f291009e170 0x7f2910135bd0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f2904009c40 tx=0x7f2904004750 comp rx=0 tx=0).stop 2023-10-03T10:15:57.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.057+0000 7f29168b3700 1 -- 172.21.15.146:0/2973491263 shutdown_connections 2023-10-03T10:15:57.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.057+0000 7f29168b3700 1 --2- 172.21.15.146:0/2973491263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2910130ce0 0x7f2910136110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.057+0000 7f29168b3700 1 --2- 172.21.15.146:0/2973491263 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f291009d860 0x7f2910135690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.057+0000 7f29168b3700 1 --2- 172.21.15.146:0/2973491263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f291009e170 0x7f2910135bd0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.057+0000 7f29168b3700 1 -- 172.21.15.146:0/2973491263 >> 172.21.15.146:0/2973491263 conn(0x7f2910099c40 msgr2=0x7f2910139510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:57.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.057+0000 7f29168b3700 1 -- 172.21.15.146:0/2973491263 shutdown_connections 2023-10-03T10:15:57.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.057+0000 7f29168b3700 1 -- 172.21.15.146:0/2973491263 wait complete. 2023-10-03T10:15:57.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.063+0000 7f9270110700 1 -- 172.21.15.146:0/1293712123 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f926806c3b0 con 0x7f9268137140 2023-10-03T10:15:57.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.064+0000 7f925e7fc700 1 -- 172.21.15.146:0/1293712123 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9260018020 con 0x7f9268137140 2023-10-03T10:15:57.063 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:57.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.066+0000 7f9270110700 1 -- 172.21.15.146:0/1293712123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9268137140 msgr2=0x7f926811efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.066+0000 7f9270110700 1 --2- 172.21.15.146:0/1293712123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9268137140 0x7f926811efa0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f926000efc0 tx=0x7f926000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.066+0000 7f9270110700 1 -- 172.21.15.146:0/1293712123 shutdown_connections 2023-10-03T10:15:57.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.066+0000 7f9270110700 1 --2- 172.21.15.146:0/1293712123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9268137140 0x7f926811efa0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.066+0000 7f9270110700 1 --2- 172.21.15.146:0/1293712123 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f926806a770 0x7f926811e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.066+0000 7f9270110700 1 --2- 172.21.15.146:0/1293712123 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f926806b250 0x7f926811ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.066+0000 7f9270110700 1 -- 172.21.15.146:0/1293712123 >> 172.21.15.146:0/1293712123 conn(0x7f9268099c40 msgr2=0x7f92680a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:57.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.066+0000 7f9270110700 1 -- 172.21.15.146:0/1293712123 shutdown_connections 2023-10-03T10:15:57.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:57.066+0000 7f9270110700 1 -- 172.21.15.146:0/1293712123 wait complete. 2023-10-03T10:15:57.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:57.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:58.021 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:58.024 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:58.069 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:58.078 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:58.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.164+0000 7fbf9420b700 1 Processor -- start 2023-10-03T10:15:58.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.164+0000 7f437eeac700 1 Processor -- start 2023-10-03T10:15:58.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.165+0000 7fbf9420b700 1 -- start start 2023-10-03T10:15:58.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.165+0000 7fbf9420b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbf8c09d860 0x7fbf8c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.165+0000 7fbf9420b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf8c09e170 0x7fbf8c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.165+0000 7f437eeac700 1 -- start start 2023-10-03T10:15:58.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.165+0000 7f437eeac700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43780a0a90 0x7f43780a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.165+0000 7f437eeac700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f43780a13a0 0x7f4378133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.165+0000 7f437eeac700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4378133f70 0x7f43781343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.165+0000 7f437eeac700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43780a3aa0 con 0x7f43780a13a0 2023-10-03T10:15:58.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.165+0000 7f437eeac700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437809a540 con 0x7f4378133f70 2023-10-03T10:15:58.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.165+0000 7f437eeac700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43780a1fe0 con 0x7f43780a0a90 2023-10-03T10:15:58.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.165+0000 7fbf9420b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8c09aaa0 con 0x7fbf8c130ce0 2023-10-03T10:15:58.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.165+0000 7fbf9420b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8c09f870 con 0x7fbf8c09d860 2023-10-03T10:15:58.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.165+0000 7fbf9420b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c09b360 con 0x7fbf8c09e170 2023-10-03T10:15:58.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.165+0000 7fbf917a6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf8c09e170 0x7fbf8c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.165+0000 7fbf917a6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf8c09e170 0x7fbf8c1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57494/0 (socket says 172.21.15.146:57494) 2023-10-03T10:15:58.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.165+0000 7fbf917a6700 1 -- 172.21.15.146:0/1946596851 learned_addr learned my addr 172.21.15.146:0/1946596851 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:58.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.165+0000 7f4377fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f43780a13a0 0x7f4378133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.165+0000 7f437d449700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4378133f70 0x7f43781343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.165+0000 7f4377fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f43780a13a0 0x7f4378133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60730/0 (socket says 172.21.15.146:60730) 2023-10-03T10:15:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.165+0000 7f437d449700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4378133f70 0x7f43781343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53214/0 (socket says 172.21.15.146:53214) 2023-10-03T10:15:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.165+0000 7f4377fff700 1 -- 172.21.15.146:0/1419259531 learned_addr learned my addr 172.21.15.146:0/1419259531 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.166+0000 7fbf91fa7700 1 --2- 172.21.15.146:0/1946596851 >> v2:172.21.15.146:3300/0 conn(0x7fbf8c09d860 0x7fbf8c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.166+0000 7f437d449700 1 -- 172.21.15.146:0/1419259531 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43780a0a90 msgr2=0x7f43780a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.166+0000 7f437cc48700 1 --2- 172.21.15.146:0/1419259531 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43780a0a90 0x7f43780a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.166+0000 7f437d449700 1 --2- 172.21.15.146:0/1419259531 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43780a0a90 0x7f43780a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.166+0000 7f437d449700 1 -- 172.21.15.146:0/1419259531 >> v2:172.21.15.146:3300/0 conn(0x7f43780a13a0 msgr2=0x7f4378133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.166+0000 7f437d449700 1 --2- 172.21.15.146:0/1419259531 >> v2:172.21.15.146:3300/0 conn(0x7f43780a13a0 0x7f4378133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.166+0000 7f437d449700 1 -- 172.21.15.146:0/1419259531 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437809a280 con 0x7f4378133f70 2023-10-03T10:15:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.166+0000 7f437cc48700 1 --2- 172.21.15.146:0/1419259531 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43780a0a90 0x7f43780a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.166+0000 7f437d449700 1 --2- 172.21.15.146:0/1419259531 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4378133f70 0x7f43781343f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4370009d90 tx=0x7f437000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24b5ee3d3580bd96 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.166+0000 7f43777fe700 1 -- 172.21.15.146:0/1419259531 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437000e070 con 0x7f4378133f70 2023-10-03T10:15:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.166+0000 7f43777fe700 1 -- 172.21.15.146:0/1419259531 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437000bb20 con 0x7f4378133f70 2023-10-03T10:15:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.166+0000 7f43777fe700 1 -- 172.21.15.146:0/1419259531 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4370012430 con 0x7f4378133f70 2023-10-03T10:15:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.167+0000 7f437eeac700 1 -- 172.21.15.146:0/1419259531 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4378133f70 msgr2=0x7f43781343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.167+0000 7f437eeac700 1 --2- 172.21.15.146:0/1419259531 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4378133f70 0x7f43781343f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4370009d90 tx=0x7f437000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.167+0000 7f437eeac700 1 -- 172.21.15.146:0/1419259531 shutdown_connections 2023-10-03T10:15:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.167+0000 7f437eeac700 1 --2- 172.21.15.146:0/1419259531 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4378133f70 0x7f43781343f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.167+0000 7f437eeac700 1 --2- 172.21.15.146:0/1419259531 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43780a0a90 0x7f43780a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.167+0000 7f437eeac700 1 --2- 172.21.15.146:0/1419259531 >> v2:172.21.15.146:3300/0 conn(0x7f43780a13a0 0x7f4378133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.167+0000 7f437eeac700 1 -- 172.21.15.146:0/1419259531 >> 172.21.15.146:0/1419259531 conn(0x7f4378099c40 msgr2=0x7f437806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.167+0000 7f437eeac700 1 -- 172.21.15.146:0/1419259531 shutdown_connections 2023-10-03T10:15:58.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.167+0000 7f437eeac700 1 -- 172.21.15.146:0/1419259531 wait complete. 2023-10-03T10:15:58.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.166+0000 7fbf917a6700 1 -- 172.21.15.146:0/1946596851 >> v2:172.21.15.146:3300/0 conn(0x7fbf8c09d860 msgr2=0x7fbf8c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:58.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.166+0000 7fbf917a6700 1 --2- 172.21.15.146:0/1946596851 >> v2:172.21.15.146:3300/0 conn(0x7fbf8c09d860 0x7fbf8c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.166+0000 7fbf917a6700 1 -- 172.21.15.146:0/1946596851 >> v1:172.21.15.146:6789/0 conn(0x7fbf8c130ce0 legacy=0x7fbf8c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.166+0000 7fbf917a6700 1 -- 172.21.15.146:0/1946596851 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c09b620 con 0x7fbf8c09e170 2023-10-03T10:15:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.166+0000 7fbf917a6700 1 --2- 172.21.15.146:0/1946596851 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf8c09e170 0x7fbf8c1307a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00de50 tx=0x7fbf7c00f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93f0bceff447d0ab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.166+0000 7fbf90fa5700 1 -- 172.21.15.146:0/1946596851 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c012070 con 0x7fbf8c09e170 2023-10-03T10:15:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.166+0000 7fbf90fa5700 1 -- 172.21.15.146:0/1946596851 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7c004030 con 0x7fbf8c09e170 2023-10-03T10:15:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.166+0000 7fbf90fa5700 1 -- 172.21.15.146:0/1946596851 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c0043e0 con 0x7fbf8c09e170 2023-10-03T10:15:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.167+0000 7fbf9420b700 1 -- 172.21.15.146:0/1946596851 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf8c09e170 msgr2=0x7fbf8c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.167+0000 7fbf9420b700 1 --2- 172.21.15.146:0/1946596851 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf8c09e170 0x7fbf8c1307a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00de50 tx=0x7fbf7c00f330 comp rx=0 tx=0).stop 2023-10-03T10:15:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.167+0000 7fbf9420b700 1 -- 172.21.15.146:0/1946596851 shutdown_connections 2023-10-03T10:15:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.167+0000 7fbf9420b700 1 --2- 172.21.15.146:0/1946596851 >> v2:172.21.15.146:3300/0 conn(0x7fbf8c09d860 0x7fbf8c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.167+0000 7fbf9420b700 1 --2- 172.21.15.146:0/1946596851 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf8c09e170 0x7fbf8c1307a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.167+0000 7fbf9420b700 1 -- 172.21.15.146:0/1946596851 >> 172.21.15.146:0/1946596851 conn(0x7fbf8c099c40 msgr2=0x7fbf8c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.167+0000 7fbf9420b700 1 -- 172.21.15.146:0/1946596851 shutdown_connections 2023-10-03T10:15:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.167+0000 7fbf9420b700 1 -- 172.21.15.146:0/1946596851 wait complete. 2023-10-03T10:15:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.168+0000 7f437eeac700 1 Processor -- start 2023-10-03T10:15:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.168+0000 7f437eeac700 1 -- start start 2023-10-03T10:15:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.168+0000 7fbf9420b700 1 Processor -- start 2023-10-03T10:15:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.168+0000 7fbf9420b700 1 -- start start 2023-10-03T10:15:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7fbf9420b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf8c09d860 0x7fbf8c135760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7fbf9420b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf8c09e170 0x7fbf8c135ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7fbf9420b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf8c130ce0 0x7fbf8c1361e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7fbf9420b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c1199f0 con 0x7fbf8c130ce0 2023-10-03T10:15:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7fbf9420b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c137370 con 0x7fbf8c09d860 2023-10-03T10:15:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7fbf9420b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c11a050 con 0x7fbf8c09e170 2023-10-03T10:15:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7fbf917a6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf8c09e170 0x7fbf8c135ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7fbf917a6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf8c09e170 0x7fbf8c135ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57508/0 (socket says 172.21.15.146:57508) 2023-10-03T10:15:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7fbf917a6700 1 -- 172.21.15.146:0/2732633101 learned_addr learned my addr 172.21.15.146:0/2732633101 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7f437eeac700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43780a0a90 0x7f43781c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7f437eeac700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43780a13a0 0x7f43781c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7f437eeac700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4378133f70 0x7f43781c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7f437eeac700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4378122350 con 0x7f43780a0a90 2023-10-03T10:15:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7f437eeac700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4378133840 con 0x7f4378133f70 2023-10-03T10:15:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7f437eeac700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4378122090 con 0x7f43780a13a0 2023-10-03T10:15:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7f437cc48700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43780a0a90 0x7f43781c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7f437cc48700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43780a0a90 0x7f43781c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60756/0 (socket says 172.21.15.146:60756) 2023-10-03T10:15:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7f437cc48700 1 -- 172.21.15.146:0/1212666420 learned_addr learned my addr 172.21.15.146:0/1212666420 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7f4377fff700 1 --2- 172.21.15.146:0/1212666420 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43780a13a0 0x7f43781c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7f437d449700 1 --2- 172.21.15.146:0/1212666420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4378133f70 0x7f43781c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7f437cc48700 1 -- 172.21.15.146:0/1212666420 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43780a13a0 msgr2=0x7f43781c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7f437cc48700 1 --2- 172.21.15.146:0/1212666420 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43780a13a0 0x7f43781c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7f437cc48700 1 -- 172.21.15.146:0/1212666420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4378133f70 msgr2=0x7f43781c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7f437cc48700 1 --2- 172.21.15.146:0/1212666420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4378133f70 0x7f43781c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7f437cc48700 1 -- 172.21.15.146:0/1212666420 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4370009a70 con 0x7f43780a0a90 2023-10-03T10:15:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7fbf91fa7700 1 --2- 172.21.15.146:0/2732633101 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf8c09d860 0x7fbf8c135760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7fbf917a6700 1 -- 172.21.15.146:0/2732633101 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf8c09d860 msgr2=0x7fbf8c135760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7fbf917a6700 1 --2- 172.21.15.146:0/2732633101 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf8c09d860 0x7fbf8c135760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7fbf917a6700 1 -- 172.21.15.146:0/2732633101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf8c130ce0 msgr2=0x7fbf8c1361e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7fbf917a6700 1 --2- 172.21.15.146:0/2732633101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf8c130ce0 0x7fbf8c1361e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.169+0000 7fbf917a6700 1 -- 172.21.15.146:0/2732633101 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c00db30 con 0x7fbf8c09e170 2023-10-03T10:15:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.170+0000 7fbf917a6700 1 --2- 172.21.15.146:0/2732633101 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf8c09e170 0x7fbf8c135ca0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00f680 tx=0x7fbf7c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.170+0000 7fbf827fc700 1 -- 172.21.15.146:0/2732633101 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c00fce0 con 0x7fbf8c09e170 2023-10-03T10:15:58.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.170+0000 7f437cc48700 1 --2- 172.21.15.146:0/1212666420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43780a0a90 0x7f43781c8220 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f436c00c7f0 tx=0x7f436c00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.170+0000 7fbf9420b700 1 -- 172.21.15.146:0/2732633101 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8c137880 con 0x7fbf8c09e170 2023-10-03T10:15:58.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.170+0000 7fbf827fc700 1 -- 172.21.15.146:0/2732633101 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7c00fe40 con 0x7fbf8c09e170 2023-10-03T10:15:58.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.170+0000 7fbf827fc700 1 -- 172.21.15.146:0/2732633101 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c0038e0 con 0x7fbf8c09e170 2023-10-03T10:15:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.170+0000 7f43757fa700 1 -- 172.21.15.146:0/1212666420 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c011800 con 0x7f43780a0a90 2023-10-03T10:15:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.170+0000 7f43757fa700 1 -- 172.21.15.146:0/1212666420 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c011960 con 0x7f43780a0a90 2023-10-03T10:15:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.170+0000 7f43757fa700 1 -- 172.21.15.146:0/1212666420 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c011d10 con 0x7f43780a0a90 2023-10-03T10:15:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.170+0000 7f437eeac700 1 -- 172.21.15.146:0/1212666420 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f437809c7e0 con 0x7f43780a0a90 2023-10-03T10:15:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.170+0000 7f437eeac700 1 -- 172.21.15.146:0/1212666420 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4378122dc0 con 0x7f43780a0a90 2023-10-03T10:15:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.170+0000 7fbf9420b700 1 -- 172.21.15.146:0/2732633101 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8c137ac0 con 0x7fbf8c09e170 2023-10-03T10:15:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.171+0000 7f437eeac700 1 -- 172.21.15.146:0/1212666420 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4378122590 con 0x7f43780a0a90 2023-10-03T10:15:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.171+0000 7fbf6ffff700 1 -- 172.21.15.146:0/2732633101 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf680052e0 con 0x7fbf8c09e170 2023-10-03T10:15:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.172+0000 7fbf827fc700 1 -- 172.21.15.146:0/2732633101 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf7c003a40 con 0x7fbf8c09e170 2023-10-03T10:15:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.172+0000 7f43757fa700 1 -- 172.21.15.146:0/1212666420 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f436c024480 con 0x7f43780a0a90 2023-10-03T10:15:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.172+0000 7f43757fa700 1 -- 172.21.15.146:0/1212666420 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f436c03fbf0 con 0x7f43780a0a90 2023-10-03T10:15:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.172+0000 7fbf827fc700 1 -- 172.21.15.146:0/2732633101 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbf7c040780 con 0x7fbf8c09e170 2023-10-03T10:15:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.180+0000 7f43757fa700 1 -- 172.21.15.146:0/1212666420 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f436c0193b0 con 0x7f43780a0a90 2023-10-03T10:15:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.181+0000 7fbf827fc700 1 -- 172.21.15.146:0/2732633101 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf7c004590 con 0x7fbf8c09e170 2023-10-03T10:15:58.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.216+0000 7f151389f700 1 Processor -- start 2023-10-03T10:15:58.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.216+0000 7f151389f700 1 -- start start 2023-10-03T10:15:58.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.217+0000 7f151389f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f150c0a0a70 0x7f150c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.217+0000 7f151389f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f150c0a1380 0x7f150c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.217+0000 7f151389f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f150c09dc00 con 0x7f150c133f50 2023-10-03T10:15:58.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.217+0000 7f151389f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f150c09ea60 con 0x7f150c0a1380 2023-10-03T10:15:58.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.217+0000 7f151389f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150c09dec0 con 0x7f150c0a0a70 2023-10-03T10:15:58.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.217+0000 7f151163b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f150c0a0a70 0x7f150c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.217+0000 7f151163b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f150c0a0a70 0x7f150c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53240/0 (socket says 172.21.15.146:53240) 2023-10-03T10:15:58.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.217+0000 7f151163b700 1 -- 172.21.15.146:0/509945613 learned_addr learned my addr 172.21.15.146:0/509945613 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:58.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.217+0000 7f1510e3a700 1 --2- 172.21.15.146:0/509945613 >> v2:172.21.15.146:3300/0 conn(0x7f150c0a1380 0x7f150c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.218+0000 7f1510e3a700 1 -- 172.21.15.146:0/509945613 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f150c0a0a70 msgr2=0x7f150c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:58.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.218+0000 7f1510e3a700 1 --2- 172.21.15.146:0/509945613 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f150c0a0a70 0x7f150c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.218+0000 7f1510e3a700 1 -- 172.21.15.146:0/509945613 >> v1:172.21.15.146:6789/0 conn(0x7f150c133f50 legacy=0x7f150c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.218+0000 7f1510e3a700 1 -- 172.21.15.146:0/509945613 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c09e6a0 con 0x7f150c0a1380 2023-10-03T10:15:58.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.218+0000 7f151163b700 1 --2- 172.21.15.146:0/509945613 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f150c0a0a70 0x7f150c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:58.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.218+0000 7f1510e3a700 1 --2- 172.21.15.146:0/509945613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f150c0a1380 0x7f150c133a10 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f14fc009840 tx=0x7f14fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d21861bb359bcd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.218+0000 7f1503fff700 1 -- 172.21.15.146:0/509945613 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc014e90 con 0x7f150c0a1380 2023-10-03T10:15:58.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.218+0000 7f1503fff700 1 -- 172.21.15.146:0/509945613 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14fc01c440 con 0x7f150c0a1380 2023-10-03T10:15:58.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.218+0000 7f1503fff700 1 -- 172.21.15.146:0/509945613 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc01c7d0 con 0x7f150c0a1380 2023-10-03T10:15:58.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.219+0000 7f151389f700 1 -- 172.21.15.146:0/509945613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f150c0a1380 msgr2=0x7f150c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.219+0000 7f151389f700 1 --2- 172.21.15.146:0/509945613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f150c0a1380 0x7f150c133a10 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f14fc009840 tx=0x7f14fc009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:58.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.219+0000 7f151389f700 1 -- 172.21.15.146:0/509945613 shutdown_connections 2023-10-03T10:15:58.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.219+0000 7f151389f700 1 --2- 172.21.15.146:0/509945613 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f150c0a0a70 0x7f150c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.219+0000 7f151389f700 1 --2- 172.21.15.146:0/509945613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f150c0a1380 0x7f150c133a10 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.219+0000 7f151389f700 1 -- 172.21.15.146:0/509945613 >> 172.21.15.146:0/509945613 conn(0x7f150c0a6610 msgr2=0x7f150c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.219+0000 7f151389f700 1 -- 172.21.15.146:0/509945613 shutdown_connections 2023-10-03T10:15:58.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.219+0000 7f151389f700 1 -- 172.21.15.146:0/509945613 wait complete. 2023-10-03T10:15:58.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.220+0000 7f151389f700 1 Processor -- start 2023-10-03T10:15:58.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.220+0000 7f151389f700 1 -- start start 2023-10-03T10:15:58.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.220+0000 7f151389f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f150c0a0a70 0x7f150c11e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.220+0000 7f151389f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f150c0a1380 0x7f150c11ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.220+0000 7f151389f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f150c133f50 0x7f150c11f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.220+0000 7f151389f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c1218e0 con 0x7f150c0a1380 2023-10-03T10:15:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.220+0000 7f151389f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150c1202d0 con 0x7f150c133f50 2023-10-03T10:15:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.220+0000 7f151389f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f150c120ba0 con 0x7f150c0a0a70 2023-10-03T10:15:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.220+0000 7f1511e3c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f150c133f50 0x7f150c11f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.220+0000 7f1511e3c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f150c133f50 0x7f150c11f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53252/0 (socket says 172.21.15.146:53252) 2023-10-03T10:15:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.220+0000 7f1511e3c700 1 -- 172.21.15.146:0/1458521055 learned_addr learned my addr 172.21.15.146:0/1458521055 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.220+0000 7f1510e3a700 1 --2- 172.21.15.146:0/1458521055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f150c0a1380 0x7f150c11ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.221+0000 7f151163b700 1 --2- 172.21.15.146:0/1458521055 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f150c0a0a70 0x7f150c11e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.221+0000 7f1511e3c700 1 -- 172.21.15.146:0/1458521055 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f150c0a0a70 msgr2=0x7f150c11e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.221+0000 7f1511e3c700 1 --2- 172.21.15.146:0/1458521055 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f150c0a0a70 0x7f150c11e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.221+0000 7f1511e3c700 1 -- 172.21.15.146:0/1458521055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f150c0a1380 msgr2=0x7f150c11ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.221+0000 7f1511e3c700 1 --2- 172.21.15.146:0/1458521055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f150c0a1380 0x7f150c11ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.221+0000 7f1511e3c700 1 -- 172.21.15.146:0/1458521055 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1508009550 con 0x7f150c133f50 2023-10-03T10:15:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.221+0000 7f1510e3a700 1 --2- 172.21.15.146:0/1458521055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f150c0a1380 0x7f150c11ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.221+0000 7f1511e3c700 1 --2- 172.21.15.146:0/1458521055 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f150c133f50 0x7f150c11f140 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f150400cc50 tx=0x7f150400cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.221+0000 7f1501ffb700 1 -- 172.21.15.146:0/1458521055 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1504003c00 con 0x7f150c133f50 2023-10-03T10:15:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.221+0000 7f1501ffb700 1 -- 172.21.15.146:0/1458521055 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1504003d60 con 0x7f150c133f50 2023-10-03T10:15:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.221+0000 7f1501ffb700 1 -- 172.21.15.146:0/1458521055 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150400ab60 con 0x7f150c133f50 2023-10-03T10:15:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.221+0000 7f151389f700 1 -- 172.21.15.146:0/1458521055 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14fc0094a0 con 0x7f150c133f50 2023-10-03T10:15:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.221+0000 7f151389f700 1 -- 172.21.15.146:0/1458521055 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150c133650 con 0x7f150c133f50 2023-10-03T10:15:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.222+0000 7f1501ffb700 1 -- 172.21.15.146:0/1458521055 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f150400acc0 con 0x7f150c133f50 2023-10-03T10:15:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.223+0000 7f1501ffb700 1 -- 172.21.15.146:0/1458521055 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f150403f670 con 0x7f150c133f50 2023-10-03T10:15:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.223+0000 7f151389f700 1 -- 172.21.15.146:0/1458521055 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150c04f2a0 con 0x7f150c133f50 2023-10-03T10:15:58.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.228+0000 7f1501ffb700 1 -- 172.21.15.146:0/1458521055 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15040198f0 con 0x7f150c133f50 2023-10-03T10:15:58.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.251+0000 7f6dd8112700 1 Processor -- start 2023-10-03T10:15:58.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.251+0000 7f6dd8112700 1 -- start start 2023-10-03T10:15:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.252+0000 7f6dd8112700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd009d860 0x7f6dd009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.252+0000 7f6dd8112700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6dd0130eb0 0x7f6dd0138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.252+0000 7f6dd8112700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd009aaa0 con 0x7f6dd009e170 2023-10-03T10:15:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.252+0000 7f6dd8112700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd009f870 con 0x7f6dd009d860 2023-10-03T10:15:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.252+0000 7f6dd8112700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd009b360 con 0x7f6dd0130eb0 2023-10-03T10:15:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.252+0000 7f6dd5eae700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd009d860 0x7f6dd009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.252+0000 7f6dd66af700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6dd0130eb0 0x7f6dd0138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.252+0000 7f6dd5eae700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd009d860 0x7f6dd009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53264/0 (socket says 172.21.15.146:53264) 2023-10-03T10:15:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.252+0000 7f6dd66af700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6dd0130eb0 0x7f6dd0138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57544/0 (socket says 172.21.15.146:57544) 2023-10-03T10:15:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.252+0000 7f6dd5eae700 1 -- 172.21.15.146:0/1228312832 learned_addr learned my addr 172.21.15.146:0/1228312832 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.252+0000 7f6dd66af700 1 -- 172.21.15.146:0/1228312832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd009d860 msgr2=0x7f6dd009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.252+0000 7f6dd66af700 1 --2- 172.21.15.146:0/1228312832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd009d860 0x7f6dd009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.252+0000 7f6dd66af700 1 -- 172.21.15.146:0/1228312832 >> v1:172.21.15.146:6789/0 conn(0x7f6dd009e170 legacy=0x7f6dd01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.252+0000 7f6dd66af700 1 -- 172.21.15.146:0/1228312832 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd009b620 con 0x7f6dd0130eb0 2023-10-03T10:15:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.252+0000 7f6dd5eae700 1 --2- 172.21.15.146:0/1228312832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd009d860 0x7f6dd009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.252+0000 7f6dd66af700 1 --2- 172.21.15.146:0/1228312832 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6dd0130eb0 0x7f6dd0138a00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009dc0 tx=0x7f6dc800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab4b59b212b0c059 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.253+0000 7f6dd4eac700 1 -- 172.21.15.146:0/1228312832 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc800e070 con 0x7f6dd0130eb0 2023-10-03T10:15:58.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.253+0000 7f6dd4eac700 1 -- 172.21.15.146:0/1228312832 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc800bae0 con 0x7f6dd0130eb0 2023-10-03T10:15:58.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.253+0000 7f6dd4eac700 1 -- 172.21.15.146:0/1228312832 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc800be90 con 0x7f6dd0130eb0 2023-10-03T10:15:58.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.253+0000 7f6dd8112700 1 -- 172.21.15.146:0/1228312832 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6dd0130eb0 msgr2=0x7f6dd0138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.253+0000 7f6dd8112700 1 --2- 172.21.15.146:0/1228312832 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6dd0130eb0 0x7f6dd0138a00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009dc0 tx=0x7f6dc800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:58.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.253+0000 7f6dd8112700 1 -- 172.21.15.146:0/1228312832 shutdown_connections 2023-10-03T10:15:58.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.253+0000 7f6dd8112700 1 --2- 172.21.15.146:0/1228312832 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6dd0130eb0 0x7f6dd0138a00 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.253+0000 7f6dd8112700 1 --2- 172.21.15.146:0/1228312832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd009d860 0x7f6dd009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.253+0000 7f6dd8112700 1 -- 172.21.15.146:0/1228312832 >> 172.21.15.146:0/1228312832 conn(0x7f6dd0099c40 msgr2=0x7f6dd00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.253+0000 7f6dd8112700 1 -- 172.21.15.146:0/1228312832 shutdown_connections 2023-10-03T10:15:58.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.253+0000 7f6dd8112700 1 -- 172.21.15.146:0/1228312832 wait complete. 2023-10-03T10:15:58.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.255+0000 7f6dd8112700 1 Processor -- start 2023-10-03T10:15:58.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.255+0000 7f6dd8112700 1 -- start start 2023-10-03T10:15:58.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.255+0000 7f6dd8112700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd009d860 0x7f6dd01c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.255+0000 7f6dd8112700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd009e170 0x7f6dd01c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.255+0000 7f6dd8112700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6dd0130eb0 0x7f6dd01c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.255+0000 7f6dd8112700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd00a21b0 con 0x7f6dd009d860 2023-10-03T10:15:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.255+0000 7f6dd8112700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd0137880 con 0x7f6dd009e170 2023-10-03T10:15:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.255+0000 7f6dd8112700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd009c8b0 con 0x7f6dd0130eb0 2023-10-03T10:15:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.255+0000 7f6dd5eae700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd009d860 0x7f6dd01c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.255+0000 7f6dd5eae700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd009d860 0x7f6dd01c60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60790/0 (socket says 172.21.15.146:60790) 2023-10-03T10:15:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.256+0000 7f6dd5eae700 1 -- 172.21.15.146:0/1387321224 learned_addr learned my addr 172.21.15.146:0/1387321224 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.256+0000 7f6dd56ad700 1 --2- 172.21.15.146:0/1387321224 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd009e170 0x7f6dd01c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.256+0000 7f6dd66af700 1 --2- 172.21.15.146:0/1387321224 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6dd0130eb0 0x7f6dd01c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.256+0000 7f6dd5eae700 1 -- 172.21.15.146:0/1387321224 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6dd0130eb0 msgr2=0x7f6dd01c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.256+0000 7f6dd5eae700 1 --2- 172.21.15.146:0/1387321224 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6dd0130eb0 0x7f6dd01c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.256+0000 7f6dd5eae700 1 -- 172.21.15.146:0/1387321224 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd009e170 msgr2=0x7f6dd01c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.256+0000 7f6dd5eae700 1 --2- 172.21.15.146:0/1387321224 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd009e170 0x7f6dd01c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.256+0000 7f6dd5eae700 1 -- 172.21.15.146:0/1387321224 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc009550 con 0x7f6dd009d860 2023-10-03T10:15:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.256+0000 7f6dd5eae700 1 --2- 172.21.15.146:0/1387321224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd009d860 0x7f6dd01c60a0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00ebe0 tx=0x7f6dcc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.256+0000 7f6dc67fc700 1 -- 172.21.15.146:0/1387321224 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc00c850 con 0x7f6dd009d860 2023-10-03T10:15:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.256+0000 7f6dc67fc700 1 -- 172.21.15.146:0/1387321224 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dcc00c9b0 con 0x7f6dd009d860 2023-10-03T10:15:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.256+0000 7f6dd8112700 1 -- 172.21.15.146:0/1387321224 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc8009a70 con 0x7f6dd009d860 2023-10-03T10:15:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.256+0000 7f6dc67fc700 1 -- 172.21.15.146:0/1387321224 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc00cd20 con 0x7f6dd009d860 2023-10-03T10:15:58.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.256+0000 7f6dd8112700 1 -- 172.21.15.146:0/1387321224 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd0137f60 con 0x7f6dd009d860 2023-10-03T10:15:58.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.257+0000 7f6dc67fc700 1 -- 172.21.15.146:0/1387321224 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6dcc013470 con 0x7f6dd009d860 2023-10-03T10:15:58.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.257+0000 7f6dd8112700 1 -- 172.21.15.146:0/1387321224 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd01383e0 con 0x7f6dd009d860 2023-10-03T10:15:58.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.258+0000 7f6dc67fc700 1 -- 172.21.15.146:0/1387321224 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6dcc03f9f0 con 0x7f6dd009d860 2023-10-03T10:15:58.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.262+0000 7f6dc67fc700 1 -- 172.21.15.146:0/1387321224 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6dcc0232f0 con 0x7f6dd009d860 2023-10-03T10:15:58.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.380+0000 7f437eeac700 1 -- 172.21.15.146:0/1212666420 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f437804f2a0 con 0x7f43780a0a90 2023-10-03T10:15:58.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.380+0000 7f43757fa700 1 -- 172.21.15.146:0/1212666420 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f436c01f070 con 0x7f43780a0a90 2023-10-03T10:15:58.380 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:58.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.382+0000 7f437eeac700 1 -- 172.21.15.146:0/1212666420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43780a0a90 msgr2=0x7f43781c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.382+0000 7f437eeac700 1 --2- 172.21.15.146:0/1212666420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43780a0a90 0x7f43781c8220 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f436c00c7f0 tx=0x7f436c00cb00 comp rx=0 tx=0).stop 2023-10-03T10:15:58.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.382+0000 7f437eeac700 1 -- 172.21.15.146:0/1212666420 shutdown_connections 2023-10-03T10:15:58.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.382+0000 7f437eeac700 1 --2- 172.21.15.146:0/1212666420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4378133f70 0x7f43781c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.382+0000 7f437eeac700 1 --2- 172.21.15.146:0/1212666420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43780a0a90 0x7f43781c8220 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.382+0000 7f437eeac700 1 --2- 172.21.15.146:0/1212666420 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43780a13a0 0x7f43781c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.382+0000 7f437eeac700 1 -- 172.21.15.146:0/1212666420 >> 172.21.15.146:0/1212666420 conn(0x7f4378099c40 msgr2=0x7f43781bbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.382+0000 7f437eeac700 1 -- 172.21.15.146:0/1212666420 shutdown_connections 2023-10-03T10:15:58.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.382+0000 7f437eeac700 1 -- 172.21.15.146:0/1212666420 wait complete. 2023-10-03T10:15:58.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:58.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.423+0000 7fbf6ffff700 1 -- 172.21.15.146:0/2732633101 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbf68005860 con 0x7fbf8c09e170 2023-10-03T10:15:58.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.423+0000 7fbf827fc700 1 -- 172.21.15.146:0/2732633101 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbf7c01b030 con 0x7fbf8c09e170 2023-10-03T10:15:58.424 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:58.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.425+0000 7fbf6ffff700 1 -- 172.21.15.146:0/2732633101 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf8c09e170 msgr2=0x7fbf8c135ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.425+0000 7fbf6ffff700 1 --2- 172.21.15.146:0/2732633101 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf8c09e170 0x7fbf8c135ca0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00f680 tx=0x7fbf7c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:58.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.425+0000 7fbf6ffff700 1 -- 172.21.15.146:0/2732633101 shutdown_connections 2023-10-03T10:15:58.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.425+0000 7fbf6ffff700 1 --2- 172.21.15.146:0/2732633101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf8c130ce0 0x7fbf8c1361e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.425+0000 7fbf6ffff700 1 --2- 172.21.15.146:0/2732633101 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf8c09d860 0x7fbf8c135760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.425+0000 7fbf6ffff700 1 --2- 172.21.15.146:0/2732633101 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf8c09e170 0x7fbf8c135ca0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.425+0000 7fbf6ffff700 1 -- 172.21.15.146:0/2732633101 >> 172.21.15.146:0/2732633101 conn(0x7fbf8c099c40 msgr2=0x7fbf8c1385c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.425+0000 7fbf6ffff700 1 -- 172.21.15.146:0/2732633101 shutdown_connections 2023-10-03T10:15:58.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.425+0000 7fbf6ffff700 1 -- 172.21.15.146:0/2732633101 wait complete. 2023-10-03T10:15:58.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.457+0000 7f6dd8112700 1 -- 172.21.15.146:0/1387321224 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6dd004f2a0 con 0x7f6dd009d860 2023-10-03T10:15:58.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.458+0000 7f6dc67fc700 1 -- 172.21.15.146:0/1387321224 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6dcc017020 con 0x7f6dd009d860 2023-10-03T10:15:58.457 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:58.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.458+0000 7f151389f700 1 -- 172.21.15.146:0/1458521055 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f150c072980 con 0x7f150c133f50 2023-10-03T10:15:58.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.459+0000 7f1501ffb700 1 -- 172.21.15.146:0/1458521055 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1504011380 con 0x7f150c133f50 2023-10-03T10:15:58.458 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.460+0000 7f6dd8112700 1 -- 172.21.15.146:0/1387321224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd009d860 msgr2=0x7f6dd01c60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.460+0000 7f6dd8112700 1 --2- 172.21.15.146:0/1387321224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd009d860 0x7f6dd01c60a0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00ebe0 tx=0x7f6dcc00eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.460+0000 7f6dd8112700 1 -- 172.21.15.146:0/1387321224 shutdown_connections 2023-10-03T10:15:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.460+0000 7f6dd8112700 1 --2- 172.21.15.146:0/1387321224 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6dd0130eb0 0x7f6dd01c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.460+0000 7f6dd8112700 1 --2- 172.21.15.146:0/1387321224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd009d860 0x7f6dd01c60a0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.460+0000 7f6dd8112700 1 --2- 172.21.15.146:0/1387321224 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd009e170 0x7f6dd01c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.460+0000 7f6dd8112700 1 -- 172.21.15.146:0/1387321224 >> 172.21.15.146:0/1387321224 conn(0x7f6dd0099c40 msgr2=0x7f6dd01396d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.460+0000 7f6dd8112700 1 -- 172.21.15.146:0/1387321224 shutdown_connections 2023-10-03T10:15:58.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.460+0000 7f6dd8112700 1 -- 172.21.15.146:0/1387321224 wait complete. 2023-10-03T10:15:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.461+0000 7f151389f700 1 -- 172.21.15.146:0/1458521055 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f150c133f50 msgr2=0x7f150c11f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.461+0000 7f151389f700 1 --2- 172.21.15.146:0/1458521055 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f150c133f50 0x7f150c11f140 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f150400cc50 tx=0x7f150400cf60 comp rx=0 tx=0).stop 2023-10-03T10:15:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.461+0000 7f151389f700 1 -- 172.21.15.146:0/1458521055 shutdown_connections 2023-10-03T10:15:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.461+0000 7f151389f700 1 --2- 172.21.15.146:0/1458521055 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f150c133f50 0x7f150c11f140 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.461+0000 7f151389f700 1 --2- 172.21.15.146:0/1458521055 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f150c0a0a70 0x7f150c11e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.461+0000 7f151389f700 1 --2- 172.21.15.146:0/1458521055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f150c0a1380 0x7f150c11ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.461+0000 7f151389f700 1 -- 172.21.15.146:0/1458521055 >> 172.21.15.146:0/1458521055 conn(0x7f150c0a6610 msgr2=0x7f150c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.461+0000 7f151389f700 1 -- 172.21.15.146:0/1458521055 shutdown_connections 2023-10-03T10:15:58.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:58.461+0000 7f151389f700 1 -- 172.21.15.146:0/1458521055 wait complete. 2023-10-03T10:15:58.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:15:58.474 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:59.395 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:59.438 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:59.474 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:59.474 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.540+0000 7fcc36a83700 1 Processor -- start 2023-10-03T10:15:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.540+0000 7fcc36a83700 1 -- start start 2023-10-03T10:15:59.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.540+0000 7fcc36a83700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc30133ad0 0x7fcc30133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.540+0000 7fcc36a83700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc301300a0 0x7fcc301304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.540+0000 7fcc36a83700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc3006b2d0 con 0x7fcc301309f0 2023-10-03T10:15:59.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.540+0000 7fcc36a83700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc30133610 con 0x7fcc30133ad0 2023-10-03T10:15:59.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.540+0000 7fcc36a83700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3009a500 con 0x7fcc301300a0 2023-10-03T10:15:59.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.540+0000 7fcc3481f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc30133ad0 0x7fcc30133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.540+0000 7fcc2ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc301300a0 0x7fcc301304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.540+0000 7fcc2ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc301300a0 0x7fcc301304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57566/0 (socket says 172.21.15.146:57566) 2023-10-03T10:15:59.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.540+0000 7fcc2ffff700 1 -- 172.21.15.146:0/1475631445 learned_addr learned my addr 172.21.15.146:0/1475631445 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:59.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.540+0000 7fcc3481f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc30133ad0 0x7fcc30133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53286/0 (socket says 172.21.15.146:53286) 2023-10-03T10:15:59.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.541+0000 7fcc3481f700 1 -- 172.21.15.146:0/1475631445 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc301300a0 msgr2=0x7fcc301304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:59.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.541+0000 7fcc3481f700 1 --2- 172.21.15.146:0/1475631445 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc301300a0 0x7fcc301304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.541+0000 7fcc3481f700 1 -- 172.21.15.146:0/1475631445 >> v1:172.21.15.146:6789/0 conn(0x7fcc301309f0 legacy=0x7fcc3013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.541+0000 7fcc3481f700 1 -- 172.21.15.146:0/1475631445 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc301338b0 con 0x7fcc30133ad0 2023-10-03T10:15:59.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.541+0000 7fcc2ffff700 1 --2- 172.21.15.146:0/1475631445 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc301300a0 0x7fcc301304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:59.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.541+0000 7fcc3481f700 1 --2- 172.21.15.146:0/1475631445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc30133ad0 0x7fcc30133ea0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009870 tx=0x7fcc24009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb81f3a43344830 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.541+0000 7fcc2f7fe700 1 -- 172.21.15.146:0/1475631445 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc24011830 con 0x7fcc30133ad0 2023-10-03T10:15:59.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.541+0000 7fcc2f7fe700 1 -- 172.21.15.146:0/1475631445 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc24011990 con 0x7fcc30133ad0 2023-10-03T10:15:59.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.541+0000 7fcc2f7fe700 1 -- 172.21.15.146:0/1475631445 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc24011d20 con 0x7fcc30133ad0 2023-10-03T10:15:59.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.542+0000 7fcc36a83700 1 -- 172.21.15.146:0/1475631445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc30133ad0 msgr2=0x7fcc30133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.542+0000 7fcc36a83700 1 --2- 172.21.15.146:0/1475631445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc30133ad0 0x7fcc30133ea0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009870 tx=0x7fcc24009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:59.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.542+0000 7fcc36a83700 1 -- 172.21.15.146:0/1475631445 shutdown_connections 2023-10-03T10:15:59.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.542+0000 7fcc36a83700 1 --2- 172.21.15.146:0/1475631445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc30133ad0 0x7fcc30133ea0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.542+0000 7fcc36a83700 1 --2- 172.21.15.146:0/1475631445 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc301300a0 0x7fcc301304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.542+0000 7fcc36a83700 1 -- 172.21.15.146:0/1475631445 >> 172.21.15.146:0/1475631445 conn(0x7fcc30099c40 msgr2=0x7fcc300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.542+0000 7fcc36a83700 1 -- 172.21.15.146:0/1475631445 shutdown_connections 2023-10-03T10:15:59.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.542+0000 7fcc36a83700 1 -- 172.21.15.146:0/1475631445 wait complete. 2023-10-03T10:15:59.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.544+0000 7fcc36a83700 1 Processor -- start 2023-10-03T10:15:59.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.544+0000 7fcc36a83700 1 -- start start 2023-10-03T10:15:59.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.545+0000 7fcc36a83700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc301300a0 0x7fcc3011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.545+0000 7fcc36a83700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc301309f0 0x7fcc3011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.545+0000 7fcc36a83700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc30133ad0 0x7fcc3011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.545+0000 7fcc36a83700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc30120aa0 con 0x7fcc30133ad0 2023-10-03T10:15:59.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.545+0000 7fcc36a83700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3012dd00 con 0x7fcc301300a0 2023-10-03T10:15:59.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.545+0000 7fcc36a83700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3012fbd0 con 0x7fcc301309f0 2023-10-03T10:15:59.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.545+0000 7fcc3481f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc301300a0 0x7fcc3011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.545+0000 7fcc3481f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc301300a0 0x7fcc3011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53300/0 (socket says 172.21.15.146:53300) 2023-10-03T10:15:59.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.545+0000 7fcc3481f700 1 -- 172.21.15.146:0/1374173840 learned_addr learned my addr 172.21.15.146:0/1374173840 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:59.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.545+0000 7fcc35020700 1 --2- 172.21.15.146:0/1374173840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc30133ad0 0x7fcc3011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.545+0000 7fcc2ffff700 1 --2- 172.21.15.146:0/1374173840 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc301309f0 0x7fcc3011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.545+0000 7fcc35020700 1 -- 172.21.15.146:0/1374173840 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc301309f0 msgr2=0x7fcc3011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.545+0000 7fcc35020700 1 --2- 172.21.15.146:0/1374173840 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc301309f0 0x7fcc3011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.545+0000 7fcc35020700 1 -- 172.21.15.146:0/1374173840 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc301300a0 msgr2=0x7fcc3011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.545+0000 7fcc35020700 1 --2- 172.21.15.146:0/1374173840 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc301300a0 0x7fcc3011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.545+0000 7fcc35020700 1 -- 172.21.15.146:0/1374173840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c009550 con 0x7fcc30133ad0 2023-10-03T10:15:59.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.545+0000 7fcc35020700 1 --2- 172.21.15.146:0/1374173840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc30133ad0 0x7fcc3011e4c0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800cb90 tx=0x7fcc2800cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.546+0000 7fcc2d7fa700 1 -- 172.21.15.146:0/1374173840 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc28003c00 con 0x7fcc30133ad0 2023-10-03T10:15:59.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.546+0000 7fcc2d7fa700 1 -- 172.21.15.146:0/1374173840 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc28003d60 con 0x7fcc30133ad0 2023-10-03T10:15:59.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.546+0000 7fcc2d7fa700 1 -- 172.21.15.146:0/1374173840 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2800aa80 con 0x7fcc30133ad0 2023-10-03T10:15:59.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.546+0000 7fcc36a83700 1 -- 172.21.15.146:0/1374173840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc240094a0 con 0x7fcc30133ad0 2023-10-03T10:15:59.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.546+0000 7fcc36a83700 1 -- 172.21.15.146:0/1374173840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc3011f8c0 con 0x7fcc30133ad0 2023-10-03T10:15:59.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.547+0000 7fcc36a83700 1 -- 172.21.15.146:0/1374173840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc3004f2a0 con 0x7fcc30133ad0 2023-10-03T10:15:59.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.547+0000 7fcc2d7fa700 1 -- 172.21.15.146:0/1374173840 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcc2800abe0 con 0x7fcc30133ad0 2023-10-03T10:15:59.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.547+0000 7fcc2d7fa700 1 -- 172.21.15.146:0/1374173840 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcc2803f570 con 0x7fcc30133ad0 2023-10-03T10:15:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.552+0000 7fcc2d7fa700 1 -- 172.21.15.146:0/1374173840 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcc280196c0 con 0x7fcc30133ad0 2023-10-03T10:15:59.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.580+0000 7fe610319700 1 Processor -- start 2023-10-03T10:15:59.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.580+0000 7fe610319700 1 -- start start 2023-10-03T10:15:59.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.581+0000 7fe610319700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe60809d860 0x7fe60809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.581+0000 7fe610319700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe60809e170 0x7fe6081307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.581+0000 7fe610319700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60809aaa0 con 0x7fe608130ce0 2023-10-03T10:15:59.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.581+0000 7fe610319700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe60809f870 con 0x7fe60809e170 2023-10-03T10:15:59.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.581+0000 7fe610319700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe60809b360 con 0x7fe60809d860 2023-10-03T10:15:59.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.581+0000 7fe60e0b5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe60809d860 0x7fe60809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.581+0000 7fe60e0b5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe60809d860 0x7fe60809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57592/0 (socket says 172.21.15.146:57592) 2023-10-03T10:15:59.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.581+0000 7fe60e0b5700 1 -- 172.21.15.146:0/1187805534 learned_addr learned my addr 172.21.15.146:0/1187805534 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:59.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.581+0000 7fe60d8b4700 1 --2- 172.21.15.146:0/1187805534 >> v2:172.21.15.146:3300/0 conn(0x7fe60809e170 0x7fe6081307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.581+0000 7fe60e0b5700 1 -- 172.21.15.146:0/1187805534 >> v2:172.21.15.146:3300/0 conn(0x7fe60809e170 msgr2=0x7fe6081307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:59.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.581+0000 7fe60e0b5700 1 --2- 172.21.15.146:0/1187805534 >> v2:172.21.15.146:3300/0 conn(0x7fe60809e170 0x7fe6081307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.581+0000 7fe60e0b5700 1 -- 172.21.15.146:0/1187805534 >> v1:172.21.15.146:6789/0 conn(0x7fe608130ce0 legacy=0x7fe6081379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.581+0000 7fe60e0b5700 1 -- 172.21.15.146:0/1187805534 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60809b620 con 0x7fe60809d860 2023-10-03T10:15:59.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.581+0000 7fe60d0b3700 1 -- 172.21.15.146:0/1187805534 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1072297920 0 0) 0x7fe60809aaa0 con 0x7fe608130ce0 2023-10-03T10:15:59.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.581+0000 7fe60d8b4700 1 --2- 172.21.15.146:0/1187805534 >> v2:172.21.15.146:3300/0 conn(0x7fe60809e170 0x7fe6081307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:59.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.582+0000 7fe60e0b5700 1 --2- 172.21.15.146:0/1187805534 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe60809d860 0x7fe60809dc30 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe60400bb90 tx=0x7fe60400bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c82e8791acd60262 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.582+0000 7fe60d0b3700 1 -- 172.21.15.146:0/1187805534 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60400dd30 con 0x7fe60809d860 2023-10-03T10:15:59.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.582+0000 7fe60d0b3700 1 -- 172.21.15.146:0/1187805534 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60400de90 con 0x7fe60809d860 2023-10-03T10:15:59.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.582+0000 7fe60d0b3700 1 -- 172.21.15.146:0/1187805534 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe604010690 con 0x7fe60809d860 2023-10-03T10:15:59.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.582+0000 7fe610319700 1 -- 172.21.15.146:0/1187805534 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe60809d860 msgr2=0x7fe60809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.582+0000 7fe610319700 1 --2- 172.21.15.146:0/1187805534 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe60809d860 0x7fe60809dc30 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe60400bb90 tx=0x7fe60400bea0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.583+0000 7fe610319700 1 -- 172.21.15.146:0/1187805534 shutdown_connections 2023-10-03T10:15:59.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.583+0000 7fe610319700 1 --2- 172.21.15.146:0/1187805534 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe60809d860 0x7fe60809dc30 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.583+0000 7fe610319700 1 --2- 172.21.15.146:0/1187805534 >> v2:172.21.15.146:3300/0 conn(0x7fe60809e170 0x7fe6081307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.583+0000 7fe610319700 1 -- 172.21.15.146:0/1187805534 >> 172.21.15.146:0/1187805534 conn(0x7fe608099c40 msgr2=0x7fe6080a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.583+0000 7fe610319700 1 -- 172.21.15.146:0/1187805534 shutdown_connections 2023-10-03T10:15:59.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.583+0000 7fe610319700 1 -- 172.21.15.146:0/1187805534 wait complete. 2023-10-03T10:15:59.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.584+0000 7fe610319700 1 Processor -- start 2023-10-03T10:15:59.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.584+0000 7fe610319700 1 -- start start 2023-10-03T10:15:59.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.584+0000 7fe610319700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe60809d860 0x7fe6081c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.584+0000 7fe610319700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe60809e170 0x7fe6081c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.584+0000 7fe610319700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe608130ce0 0x7fe6081c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.584+0000 7fe610319700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe608122be0 con 0x7fe608130ce0 2023-10-03T10:15:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.584+0000 7fe610319700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6080a0690 con 0x7fe60809e170 2023-10-03T10:15:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.584+0000 7fe610319700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe60809c8b0 con 0x7fe60809d860 2023-10-03T10:15:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.584+0000 7fe60e0b5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe60809d860 0x7fe6081c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.584+0000 7fe60e0b5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe60809d860 0x7fe6081c8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57606/0 (socket says 172.21.15.146:57606) 2023-10-03T10:15:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.584+0000 7fe60e0b5700 1 -- 172.21.15.146:0/1384351687 learned_addr learned my addr 172.21.15.146:0/1384351687 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.584+0000 7fe60e8b6700 1 --2- 172.21.15.146:0/1384351687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe608130ce0 0x7fe6081c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.584+0000 7fe60d8b4700 1 --2- 172.21.15.146:0/1384351687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe60809e170 0x7fe6081c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.585+0000 7fe60e0b5700 1 -- 172.21.15.146:0/1384351687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe60809e170 msgr2=0x7fe6081c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.585+0000 7fe60e0b5700 1 --2- 172.21.15.146:0/1384351687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe60809e170 0x7fe6081c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.585+0000 7fe60e0b5700 1 -- 172.21.15.146:0/1384351687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe608130ce0 msgr2=0x7fe6081c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.585+0000 7fe60e0b5700 1 --2- 172.21.15.146:0/1384351687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe608130ce0 0x7fe6081c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.585+0000 7fe60e0b5700 1 -- 172.21.15.146:0/1384351687 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f80094a0 con 0x7fe60809d860 2023-10-03T10:15:59.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.585+0000 7fe60d8b4700 1 --2- 172.21.15.146:0/1384351687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe60809e170 0x7fe6081c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:59.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.585+0000 7fe60e0b5700 1 --2- 172.21.15.146:0/1384351687 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe60809d860 0x7fe6081c8060 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe60400bee0 tx=0x7fe604004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.585+0000 7fe5feffd700 1 -- 172.21.15.146:0/1384351687 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe604003b70 con 0x7fe60809d860 2023-10-03T10:15:59.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.585+0000 7fe610319700 1 -- 172.21.15.146:0/1384351687 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60400b7f0 con 0x7fe60809d860 2023-10-03T10:15:59.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.585+0000 7fe5feffd700 1 -- 172.21.15.146:0/1384351687 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe604003cd0 con 0x7fe60809d860 2023-10-03T10:15:59.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.585+0000 7fe5feffd700 1 -- 172.21.15.146:0/1384351687 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6040106b0 con 0x7fe60809d860 2023-10-03T10:15:59.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.585+0000 7fe610319700 1 -- 172.21.15.146:0/1384351687 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6081250a0 con 0x7fe60809d860 2023-10-03T10:15:59.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.586+0000 7fe5feffd700 1 -- 172.21.15.146:0/1384351687 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe604019400 con 0x7fe60809d860 2023-10-03T10:15:59.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.586+0000 7fe610319700 1 -- 172.21.15.146:0/1384351687 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe608125f80 con 0x7fe60809d860 2023-10-03T10:15:59.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.587+0000 7fe5feffd700 1 -- 172.21.15.146:0/1384351687 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe604041040 con 0x7fe60809d860 2023-10-03T10:15:59.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.596+0000 7fe5feffd700 1 -- 172.21.15.146:0/1384351687 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe604021980 con 0x7fe60809d860 2023-10-03T10:15:59.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.619+0000 7fc58073c700 1 Processor -- start 2023-10-03T10:15:59.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.619+0000 7fc58073c700 1 -- start start 2023-10-03T10:15:59.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.619+0000 7fbf0dfa2700 1 Processor -- start 2023-10-03T10:15:59.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.619+0000 7fbf0dfa2700 1 -- start start 2023-10-03T10:15:59.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.619+0000 7fc58073c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc57809e340 0x7fc5781359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.619+0000 7fc58073c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc578135f20 0x7fc578138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.619+0000 7fc58073c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57809aaa0 con 0x7fc57809d860 2023-10-03T10:15:59.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.619+0000 7fc58073c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57809e730 con 0x7fc578135f20 2023-10-03T10:15:59.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.619+0000 7fc58073c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc57809f870 con 0x7fc57809e340 2023-10-03T10:15:59.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.619+0000 7fbf0dfa2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf08130c30 0x7fbf0812ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.619+0000 7fbf0dfa2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf08138790 0x7fbf0813ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.619+0000 7fbf0dfa2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf0809f590 con 0x7fbf0806a770 2023-10-03T10:15:59.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.619+0000 7fbf0dfa2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0809af90 con 0x7fbf08138790 2023-10-03T10:15:59.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.619+0000 7fbf0dfa2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0809a5d0 con 0x7fbf08130c30 2023-10-03T10:15:59.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.620+0000 7fbf0d7a1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf08138790 0x7fbf0813ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.620+0000 7fbf0d7a1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf08138790 0x7fbf0813ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53330/0 (socket says 172.21.15.146:53330) 2023-10-03T10:15:59.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.620+0000 7fbf0d7a1700 1 -- 172.21.15.146:0/2674770932 learned_addr learned my addr 172.21.15.146:0/2674770932 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:59.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.620+0000 7fc57dcd7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc57809e340 0x7fc5781359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.620+0000 7fc57ecd9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc578135f20 0x7fc578138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.620+0000 7fc57dcd7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc57809e340 0x7fc5781359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57620/0 (socket says 172.21.15.146:57620) 2023-10-03T10:15:59.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.620+0000 7fc57dcd7700 1 -- 172.21.15.146:0/1728892709 learned_addr learned my addr 172.21.15.146:0/1728892709 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:59.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.620+0000 7fc57dcd7700 1 -- 172.21.15.146:0/1728892709 >> v2:172.21.15.146:3300/0 conn(0x7fc578135f20 msgr2=0x7fc578138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:59.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.620+0000 7fc57dcd7700 1 --2- 172.21.15.146:0/1728892709 >> v2:172.21.15.146:3300/0 conn(0x7fc578135f20 0x7fc578138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.620+0000 7fc57dcd7700 1 -- 172.21.15.146:0/1728892709 >> v1:172.21.15.146:6789/0 conn(0x7fc57809d860 legacy=0x7fc57809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.620+0000 7fc57dcd7700 1 -- 172.21.15.146:0/1728892709 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57809b360 con 0x7fc57809e340 2023-10-03T10:15:59.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.620+0000 7fbf0d7a1700 1 -- 172.21.15.146:0/2674770932 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf08130c30 msgr2=0x7fbf0812ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:59.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.620+0000 7fbf0d7a1700 1 --2- 172.21.15.146:0/2674770932 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf08130c30 0x7fbf0812ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.620+0000 7fbf0d7a1700 1 -- 172.21.15.146:0/2674770932 >> v1:172.21.15.146:6789/0 conn(0x7fbf0806a770 legacy=0x7fbf08130520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.620+0000 7fbf0d7a1700 1 -- 172.21.15.146:0/2674770932 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0809ed60 con 0x7fbf08138790 2023-10-03T10:15:59.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.620+0000 7fc57dcd7700 1 --2- 172.21.15.146:0/1728892709 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc57809e340 0x7fc5781359e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc56800b9a0 tx=0x7fc56800bcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccd9adca9ade3ea6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.620+0000 7fbf0d7a1700 1 --2- 172.21.15.146:0/2674770932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf08138790 0x7fbf0813ab70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009e80 tx=0x7fbf0000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3062700ddbcc42fa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.621+0000 7fc57d4d6700 1 -- 172.21.15.146:0/1728892709 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56800caa0 con 0x7fc57809e340 2023-10-03T10:15:59.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.621+0000 7fbf077fe700 1 -- 172.21.15.146:0/2674770932 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0000e070 con 0x7fbf08138790 2023-10-03T10:15:59.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.621+0000 7fc57d4d6700 1 -- 172.21.15.146:0/1728892709 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56800cc00 con 0x7fc57809e340 2023-10-03T10:15:59.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.621+0000 7fbf077fe700 1 -- 172.21.15.146:0/2674770932 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0000b9c0 con 0x7fbf08138790 2023-10-03T10:15:59.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.621+0000 7fbf077fe700 1 -- 172.21.15.146:0/2674770932 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0000bd70 con 0x7fbf08138790 2023-10-03T10:15:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.621+0000 7fc57d4d6700 1 -- 172.21.15.146:0/1728892709 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56800f460 con 0x7fc57809e340 2023-10-03T10:15:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.621+0000 7fc58073c700 1 -- 172.21.15.146:0/1728892709 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc57809e340 msgr2=0x7fc5781359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.621+0000 7fc58073c700 1 --2- 172.21.15.146:0/1728892709 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc57809e340 0x7fc5781359e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc56800b9a0 tx=0x7fc56800bcb0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.621+0000 7fbf0dfa2700 1 -- 172.21.15.146:0/2674770932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf08138790 msgr2=0x7fbf0813ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.621+0000 7fbf0dfa2700 1 --2- 172.21.15.146:0/2674770932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf08138790 0x7fbf0813ab70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009e80 tx=0x7fbf0000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.621+0000 7fbf0dfa2700 1 -- 172.21.15.146:0/2674770932 shutdown_connections 2023-10-03T10:15:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.621+0000 7fbf0dfa2700 1 --2- 172.21.15.146:0/2674770932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf08138790 0x7fbf0813ab70 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.621+0000 7fbf0dfa2700 1 --2- 172.21.15.146:0/2674770932 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf08130c30 0x7fbf0812ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.621+0000 7fbf0dfa2700 1 -- 172.21.15.146:0/2674770932 >> 172.21.15.146:0/2674770932 conn(0x7fbf080a2d80 msgr2=0x7fbf080a3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.621+0000 7fbf0dfa2700 1 -- 172.21.15.146:0/2674770932 shutdown_connections 2023-10-03T10:15:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.622+0000 7fbf0dfa2700 1 -- 172.21.15.146:0/2674770932 wait complete. 2023-10-03T10:15:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.621+0000 7fc58073c700 1 -- 172.21.15.146:0/1728892709 shutdown_connections 2023-10-03T10:15:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.621+0000 7fc58073c700 1 --2- 172.21.15.146:0/1728892709 >> v2:172.21.15.146:3300/0 conn(0x7fc578135f20 0x7fc578138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.621+0000 7fc58073c700 1 --2- 172.21.15.146:0/1728892709 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc57809e340 0x7fc5781359e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.622+0000 7fc58073c700 1 -- 172.21.15.146:0/1728892709 >> 172.21.15.146:0/1728892709 conn(0x7fc578099c40 msgr2=0x7fc5780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.622+0000 7fc58073c700 1 -- 172.21.15.146:0/1728892709 shutdown_connections 2023-10-03T10:15:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.622+0000 7fc58073c700 1 -- 172.21.15.146:0/1728892709 wait complete. 2023-10-03T10:15:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.622+0000 7fc58073c700 1 Processor -- start 2023-10-03T10:15:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.623+0000 7fc58073c700 1 -- start start 2023-10-03T10:15:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.623+0000 7fbf0dfa2700 1 Processor -- start 2023-10-03T10:15:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.623+0000 7fbf0dfa2700 1 -- start start 2023-10-03T10:15:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.623+0000 7fc58073c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc57809d860 0x7fc57811b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.623+0000 7fc58073c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc57809e340 0x7fc57811b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.623+0000 7fc58073c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc578135f20 0x7fc57811be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.623+0000 7fc58073c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57811e250 con 0x7fc57809d860 2023-10-03T10:15:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.623+0000 7fc58073c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57811d860 con 0x7fc578135f20 2023-10-03T10:15:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.623+0000 7fc58073c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5780a20c0 con 0x7fc57809e340 2023-10-03T10:15:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.623+0000 7fc57ecd9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc578135f20 0x7fc57811be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.623+0000 7fc57ecd9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc578135f20 0x7fc57811be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53346/0 (socket says 172.21.15.146:53346) 2023-10-03T10:15:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.623+0000 7fc57ecd9700 1 -- 172.21.15.146:0/1961464707 learned_addr learned my addr 172.21.15.146:0/1961464707 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.623+0000 7fc57e4d8700 1 --2- 172.21.15.146:0/1961464707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc57809d860 0x7fc57811b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fc57e4d8700 1 -- 172.21.15.146:0/1961464707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc57809e340 msgr2=0x7fc57811b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fc57e4d8700 1 --2- 172.21.15.146:0/1961464707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc57809e340 0x7fc57811b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fc57e4d8700 1 -- 172.21.15.146:0/1961464707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc578135f20 msgr2=0x7fc57811be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fc57e4d8700 1 --2- 172.21.15.146:0/1961464707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc578135f20 0x7fc57811be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fc57e4d8700 1 -- 172.21.15.146:0/1961464707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56800b600 con 0x7fc57809d860 2023-10-03T10:15:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fc57e4d8700 1 --2- 172.21.15.146:0/1961464707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc57809d860 0x7fc57811b3f0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fc57400c400 tx=0x7fc57400c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fbf0dfa2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf0806a770 0x7fbf08134450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fbf0dfa2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf08130c30 0x7fbf08134990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fbf0dfa2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf08138790 0x7fbf08134ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fbf0dfa2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf081358b0 con 0x7fbf0806a770 2023-10-03T10:15:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fbf0dfa2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0812db60 con 0x7fbf08130c30 2023-10-03T10:15:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fbf0dfa2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf08072080 con 0x7fbf08138790 2023-10-03T10:15:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fbf0d7a1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf08138790 0x7fbf08134ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fbf07fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf08130c30 0x7fbf08134990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fbf0d7a1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf08138790 0x7fbf08134ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57628/0 (socket says 172.21.15.146:57628) 2023-10-03T10:15:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fbf0d7a1700 1 -- 172.21.15.146:0/3302163015 learned_addr learned my addr 172.21.15.146:0/3302163015 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:15:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fc56effd700 1 -- 172.21.15.146:0/1961464707 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5740052d0 con 0x7fc57809d860 2023-10-03T10:15:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fc56effd700 1 -- 172.21.15.146:0/1961464707 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc574005430 con 0x7fc57809d860 2023-10-03T10:15:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fc56effd700 1 -- 172.21.15.146:0/1961464707 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5740038c0 con 0x7fc57809d860 2023-10-03T10:15:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fbf0d7a1700 1 -- 172.21.15.146:0/3302163015 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf08130c30 msgr2=0x7fbf08134990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fbf0d7a1700 1 --2- 172.21.15.146:0/3302163015 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf08130c30 0x7fbf08134990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fbf0d7a1700 1 -- 172.21.15.146:0/3302163015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf0806a770 msgr2=0x7fbf08134450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fbf0d7a1700 1 --2- 172.21.15.146:0/3302163015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf0806a770 0x7fbf08134450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fbf0d7a1700 1 -- 172.21.15.146:0/3302163015 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf00009b30 con 0x7fbf08138790 2023-10-03T10:15:59.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fc58073c700 1 -- 172.21.15.146:0/1961464707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc57809c8b0 con 0x7fc57809d860 2023-10-03T10:15:59.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.624+0000 7fc58073c700 1 -- 172.21.15.146:0/1961464707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57811e6a0 con 0x7fc57809d860 2023-10-03T10:15:59.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.625+0000 7fc58073c700 1 -- 172.21.15.146:0/1961464707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57804f2a0 con 0x7fc57809d860 2023-10-03T10:15:59.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.625+0000 7fbf0d7a1700 1 --2- 172.21.15.146:0/3302163015 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf08138790 0x7fbf08134ed0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbf0000b370 tx=0x7fbf00004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.625+0000 7fc56effd700 1 -- 172.21.15.146:0/1961464707 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc574003a20 con 0x7fc57809d860 2023-10-03T10:15:59.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.626+0000 7fc56effd700 1 -- 172.21.15.146:0/1961464707 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc57403eb40 con 0x7fc57809d860 2023-10-03T10:15:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.628+0000 7fbf057fa700 1 -- 172.21.15.146:0/3302163015 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf00004450 con 0x7fbf08138790 2023-10-03T10:15:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.628+0000 7fbf057fa700 1 -- 172.21.15.146:0/3302163015 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf000045d0 con 0x7fbf08138790 2023-10-03T10:15:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.628+0000 7fbf0dfa2700 1 -- 172.21.15.146:0/3302163015 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf081367e0 con 0x7fbf08138790 2023-10-03T10:15:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.628+0000 7fbf057fa700 1 -- 172.21.15.146:0/3302163015 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf00025460 con 0x7fbf08138790 2023-10-03T10:15:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.628+0000 7fbf0dfa2700 1 -- 172.21.15.146:0/3302163015 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf08137bb0 con 0x7fbf08138790 2023-10-03T10:15:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.628+0000 7fbf057fa700 1 -- 172.21.15.146:0/3302163015 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf0001c410 con 0x7fbf08138790 2023-10-03T10:15:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.628+0000 7fbf0dfa2700 1 -- 172.21.15.146:0/3302163015 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf0804f2a0 con 0x7fbf08138790 2023-10-03T10:15:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.628+0000 7fbf057fa700 1 -- 172.21.15.146:0/3302163015 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbf00041550 con 0x7fbf08138790 2023-10-03T10:15:59.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.633+0000 7fbf057fa700 1 -- 172.21.15.146:0/3302163015 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf00011780 con 0x7fbf08138790 2023-10-03T10:15:59.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.634+0000 7fc56effd700 1 -- 172.21.15.146:0/1961464707 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc574019e60 con 0x7fc57809d860 2023-10-03T10:15:59.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.761+0000 7fcc36a83700 1 -- 172.21.15.146:0/1374173840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcc3006c3b0 con 0x7fcc30133ad0 2023-10-03T10:15:59.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.761+0000 7fcc2d7fa700 1 -- 172.21.15.146:0/1374173840 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcc28011380 con 0x7fcc30133ad0 2023-10-03T10:15:59.761 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:15:59.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.763+0000 7fcc36a83700 1 -- 172.21.15.146:0/1374173840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc30133ad0 msgr2=0x7fcc3011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.763+0000 7fcc36a83700 1 --2- 172.21.15.146:0/1374173840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc30133ad0 0x7fcc3011e4c0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800cb90 tx=0x7fcc2800cea0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.763+0000 7fcc36a83700 1 -- 172.21.15.146:0/1374173840 shutdown_connections 2023-10-03T10:15:59.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.763+0000 7fcc36a83700 1 --2- 172.21.15.146:0/1374173840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc30133ad0 0x7fcc3011e4c0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.763+0000 7fcc36a83700 1 --2- 172.21.15.146:0/1374173840 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc301300a0 0x7fcc3011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.763+0000 7fcc36a83700 1 --2- 172.21.15.146:0/1374173840 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc301309f0 0x7fcc3011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.763+0000 7fcc36a83700 1 -- 172.21.15.146:0/1374173840 >> 172.21.15.146:0/1374173840 conn(0x7fcc30099c40 msgr2=0x7fcc30131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.763+0000 7fcc36a83700 1 -- 172.21.15.146:0/1374173840 shutdown_connections 2023-10-03T10:15:59.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.763+0000 7fcc36a83700 1 -- 172.21.15.146:0/1374173840 wait complete. 2023-10-03T10:15:59.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:15:59.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.794+0000 7fe610319700 1 -- 172.21.15.146:0/1384351687 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe60804f2a0 con 0x7fe60809d860 2023-10-03T10:15:59.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.794+0000 7fe5feffd700 1 -- 172.21.15.146:0/1384351687 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe604007d30 con 0x7fe60809d860 2023-10-03T10:15:59.794 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.797+0000 7fe610319700 1 -- 172.21.15.146:0/1384351687 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe60809d860 msgr2=0x7fe6081c8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.797+0000 7fe610319700 1 --2- 172.21.15.146:0/1384351687 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe60809d860 0x7fe6081c8060 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe60400bee0 tx=0x7fe604004750 comp rx=0 tx=0).stop 2023-10-03T10:15:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.797+0000 7fe610319700 1 -- 172.21.15.146:0/1384351687 shutdown_connections 2023-10-03T10:15:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.797+0000 7fe610319700 1 --2- 172.21.15.146:0/1384351687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe608130ce0 0x7fe6081c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.797+0000 7fe610319700 1 --2- 172.21.15.146:0/1384351687 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe60809d860 0x7fe6081c8060 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.797+0000 7fe610319700 1 --2- 172.21.15.146:0/1384351687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe60809e170 0x7fe6081c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.797+0000 7fe610319700 1 -- 172.21.15.146:0/1384351687 >> 172.21.15.146:0/1384351687 conn(0x7fe608099c40 msgr2=0x7fe6080a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.797+0000 7fe610319700 1 -- 172.21.15.146:0/1384351687 shutdown_connections 2023-10-03T10:15:59.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.797+0000 7fe610319700 1 -- 172.21.15.146:0/1384351687 wait complete. 2023-10-03T10:15:59.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:15:59.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.826+0000 7fbf0dfa2700 1 -- 172.21.15.146:0/3302163015 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbf0806c1e0 con 0x7fbf08138790 2023-10-03T10:15:59.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.827+0000 7fbf057fa700 1 -- 172.21.15.146:0/3302163015 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbf00011390 con 0x7fbf08138790 2023-10-03T10:15:59.826 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:15:59.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.829+0000 7fbf0dfa2700 1 -- 172.21.15.146:0/3302163015 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf08138790 msgr2=0x7fbf08134ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.829+0000 7fbf0dfa2700 1 --2- 172.21.15.146:0/3302163015 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf08138790 0x7fbf08134ed0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbf0000b370 tx=0x7fbf00004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.829+0000 7fbf0dfa2700 1 -- 172.21.15.146:0/3302163015 shutdown_connections 2023-10-03T10:15:59.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.829+0000 7fbf0dfa2700 1 --2- 172.21.15.146:0/3302163015 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf08138790 0x7fbf08134ed0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.829+0000 7fbf0dfa2700 1 --2- 172.21.15.146:0/3302163015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf0806a770 0x7fbf08134450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.829+0000 7fbf0dfa2700 1 --2- 172.21.15.146:0/3302163015 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf08130c30 0x7fbf08134990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.829+0000 7fbf0dfa2700 1 -- 172.21.15.146:0/3302163015 >> 172.21.15.146:0/3302163015 conn(0x7fbf080a2d80 msgr2=0x7fbf0809f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.829+0000 7fbf0dfa2700 1 -- 172.21.15.146:0/3302163015 shutdown_connections 2023-10-03T10:15:59.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.829+0000 7fbf0dfa2700 1 -- 172.21.15.146:0/3302163015 wait complete. 2023-10-03T10:15:59.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:15:59.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.841+0000 7fc58073c700 1 -- 172.21.15.146:0/1961464707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc57806c3b0 con 0x7fc57809d860 2023-10-03T10:15:59.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.842+0000 7fc56effd700 1 -- 172.21.15.146:0/1961464707 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc57403ee60 con 0x7fc57809d860 2023-10-03T10:15:59.842 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:15:59.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.844+0000 7fc58073c700 1 -- 172.21.15.146:0/1961464707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc57809d860 msgr2=0x7fc57811b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.844+0000 7fc58073c700 1 --2- 172.21.15.146:0/1961464707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc57809d860 0x7fc57811b3f0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fc57400c400 tx=0x7fc57400c710 comp rx=0 tx=0).stop 2023-10-03T10:15:59.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.844+0000 7fc58073c700 1 -- 172.21.15.146:0/1961464707 shutdown_connections 2023-10-03T10:15:59.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.844+0000 7fc58073c700 1 --2- 172.21.15.146:0/1961464707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc578135f20 0x7fc57811be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.844+0000 7fc58073c700 1 --2- 172.21.15.146:0/1961464707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc57809d860 0x7fc57811b3f0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.844+0000 7fc58073c700 1 --2- 172.21.15.146:0/1961464707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc57809e340 0x7fc57811b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.844+0000 7fc58073c700 1 -- 172.21.15.146:0/1961464707 >> 172.21.15.146:0/1961464707 conn(0x7fc578099c40 msgr2=0x7fc5780a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.844+0000 7fc58073c700 1 -- 172.21.15.146:0/1961464707 shutdown_connections 2023-10-03T10:15:59.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:15:59.844+0000 7fc58073c700 1 -- 172.21.15.146:0/1961464707 wait complete. 2023-10-03T10:15:59.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:00.775 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:00.815 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:00.842 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:00.856 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:00.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.922+0000 7f7177e40700 1 Processor -- start 2023-10-03T10:16:00.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.922+0000 7f7177e40700 1 -- start start 2023-10-03T10:16:00.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.923+0000 7f7177e40700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f717009ad40 0x7f7170133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.923+0000 7f7177e40700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7170133f70 0x7f71701343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.923+0000 7f7177e40700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71700a0a70 0x7f71700a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.923+0000 7f7177e40700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71700a3b60 con 0x7f7170133f70 2023-10-03T10:16:00.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.923+0000 7f7177e40700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71701348e0 con 0x7f717009ad40 2023-10-03T10:16:00.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.923+0000 7f7177e40700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f717009b110 con 0x7f71700a0a70 2023-10-03T10:16:00.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.923+0000 7f7175bdc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f717009ad40 0x7f7170133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.923+0000 7f7175bdc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f717009ad40 0x7f7170133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53370/0 (socket says 172.21.15.146:53370) 2023-10-03T10:16:00.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.923+0000 7f7175bdc700 1 -- 172.21.15.146:0/452789282 learned_addr learned my addr 172.21.15.146:0/452789282 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:00.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.923+0000 7f71763dd700 1 --2- 172.21.15.146:0/452789282 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71700a0a70 0x7f71700a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.923+0000 7f71753db700 1 --2- 172.21.15.146:0/452789282 >> v2:172.21.15.146:3300/0 conn(0x7f7170133f70 0x7f71701343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.924+0000 7f7175bdc700 1 -- 172.21.15.146:0/452789282 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71700a0a70 msgr2=0x7f71700a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:00.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.924+0000 7f7175bdc700 1 --2- 172.21.15.146:0/452789282 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71700a0a70 0x7f71700a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.924+0000 7f7175bdc700 1 -- 172.21.15.146:0/452789282 >> v2:172.21.15.146:3300/0 conn(0x7f7170133f70 msgr2=0x7f71701343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:00.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.924+0000 7f7175bdc700 1 --2- 172.21.15.146:0/452789282 >> v2:172.21.15.146:3300/0 conn(0x7f7170133f70 0x7f71701343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.924+0000 7f7175bdc700 1 -- 172.21.15.146:0/452789282 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71700a2fa0 con 0x7f717009ad40 2023-10-03T10:16:00.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.924+0000 7f7175bdc700 1 --2- 172.21.15.146:0/452789282 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f717009ad40 0x7f7170133a30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f716c0098f0 tx=0x7f716c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3cbefa5349769e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.924+0000 7f7174bda700 1 -- 172.21.15.146:0/452789282 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c011830 con 0x7f717009ad40 2023-10-03T10:16:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.924+0000 7f7174bda700 1 -- 172.21.15.146:0/452789282 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c011990 con 0x7f717009ad40 2023-10-03T10:16:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.924+0000 7f7174bda700 1 -- 172.21.15.146:0/452789282 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c011d20 con 0x7f717009ad40 2023-10-03T10:16:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.925+0000 7f7177e40700 1 -- 172.21.15.146:0/452789282 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f717009ad40 msgr2=0x7f7170133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.925+0000 7f7177e40700 1 --2- 172.21.15.146:0/452789282 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f717009ad40 0x7f7170133a30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f716c0098f0 tx=0x7f716c009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.925+0000 7f7177e40700 1 -- 172.21.15.146:0/452789282 shutdown_connections 2023-10-03T10:16:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.925+0000 7f7177e40700 1 --2- 172.21.15.146:0/452789282 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f717009ad40 0x7f7170133a30 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.925+0000 7f7177e40700 1 --2- 172.21.15.146:0/452789282 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71700a0a70 0x7f71700a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.925+0000 7f7177e40700 1 --2- 172.21.15.146:0/452789282 >> v2:172.21.15.146:3300/0 conn(0x7f7170133f70 0x7f71701343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.925+0000 7f7177e40700 1 -- 172.21.15.146:0/452789282 >> 172.21.15.146:0/452789282 conn(0x7f7170099c40 msgr2=0x7f717006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.925+0000 7f7177e40700 1 -- 172.21.15.146:0/452789282 shutdown_connections 2023-10-03T10:16:00.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.925+0000 7f7177e40700 1 -- 172.21.15.146:0/452789282 wait complete. 2023-10-03T10:16:00.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.926+0000 7f7177e40700 1 Processor -- start 2023-10-03T10:16:00.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.926+0000 7f7177e40700 1 -- start start 2023-10-03T10:16:00.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.926+0000 7f7177e40700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71700a0a70 0x7f717011f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.926+0000 7f7177e40700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7170133f70 0x7f717011fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.926+0000 7f7177e40700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71701c8410 0x7f71701c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.926+0000 7f7177e40700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7170121830 con 0x7f71701c8410 2023-10-03T10:16:00.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.926+0000 7f7177e40700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7170133650 con 0x7f71700a0a70 2023-10-03T10:16:00.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.926+0000 7f7177e40700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f717011f270 con 0x7f7170133f70 2023-10-03T10:16:00.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.927+0000 7f71763dd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71701c8410 0x7f71701c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.927+0000 7f71763dd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71701c8410 0x7f71701c8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60870/0 (socket says 172.21.15.146:60870) 2023-10-03T10:16:00.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.927+0000 7f71763dd700 1 -- 172.21.15.146:0/3819161868 learned_addr learned my addr 172.21.15.146:0/3819161868 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:00.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.927+0000 7f7175bdc700 1 --2- 172.21.15.146:0/3819161868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71700a0a70 0x7f717011f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.927+0000 7f71753db700 1 --2- 172.21.15.146:0/3819161868 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7170133f70 0x7f717011fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.927+0000 7f7175bdc700 1 -- 172.21.15.146:0/3819161868 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7170133f70 msgr2=0x7f717011fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.927+0000 7f7175bdc700 1 --2- 172.21.15.146:0/3819161868 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7170133f70 0x7f717011fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.927+0000 7f7175bdc700 1 -- 172.21.15.146:0/3819161868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71701c8410 msgr2=0x7f71701c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.927+0000 7f7175bdc700 1 --2- 172.21.15.146:0/3819161868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71701c8410 0x7f71701c8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.927+0000 7f7175bdc700 1 -- 172.21.15.146:0/3819161868 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c009550 con 0x7f71700a0a70 2023-10-03T10:16:00.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.927+0000 7f7175bdc700 1 --2- 172.21.15.146:0/3819161868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71700a0a70 0x7f717011f760 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f716c016000 tx=0x7f716c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.927+0000 7f71667fc700 1 -- 172.21.15.146:0/3819161868 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c004240 con 0x7f71700a0a70 2023-10-03T10:16:00.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.927+0000 7f71667fc700 1 -- 172.21.15.146:0/3819161868 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c01f070 con 0x7f71700a0a70 2023-10-03T10:16:00.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.927+0000 7f71667fc700 1 -- 172.21.15.146:0/3819161868 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c0036a0 con 0x7f71700a0a70 2023-10-03T10:16:00.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.927+0000 7f7177e40700 1 -- 172.21.15.146:0/3819161868 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71701201e0 con 0x7f71700a0a70 2023-10-03T10:16:00.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.928+0000 7f7177e40700 1 -- 172.21.15.146:0/3819161868 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7170122560 con 0x7f71700a0a70 2023-10-03T10:16:00.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.929+0000 7f71667fc700 1 -- 172.21.15.146:0/3819161868 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f716c021030 con 0x7f71700a0a70 2023-10-03T10:16:00.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.929+0000 7f71667fc700 1 -- 172.21.15.146:0/3819161868 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f716c0405f0 con 0x7f71700a0a70 2023-10-03T10:16:00.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.929+0000 7f7153fff700 1 -- 172.21.15.146:0/3819161868 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f714c0052e0 con 0x7f71700a0a70 2023-10-03T10:16:00.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.938+0000 7f71667fc700 1 -- 172.21.15.146:0/3819161868 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f716c015080 con 0x7f71700a0a70 2023-10-03T10:16:00.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.968+0000 7f098c09a700 1 Processor -- start 2023-10-03T10:16:00.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.969+0000 7f098c09a700 1 -- start start 2023-10-03T10:16:00.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.969+0000 7f098c09a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f098409e870 0x7f098409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.969+0000 7f098c09a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f098409f180 0x7f0984133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.969+0000 7f098c09a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098409fa00 con 0x7f0984134160 2023-10-03T10:16:00.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.969+0000 7f098c09a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09840a0370 con 0x7f098409e870 2023-10-03T10:16:00.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.969+0000 7f098c09a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098406bec0 con 0x7f098409f180 2023-10-03T10:16:00.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.970+0000 7f0989e36700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f098409e870 0x7f098409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.970+0000 7f098a637700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0984134160 0x7f098413ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36732/0 (socket says 172.21.15.146:36732) 2023-10-03T10:16:00.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.970+0000 7f098a637700 1 -- 172.21.15.146:0/2418311929 learned_addr learned my addr 172.21.15.146:0/2418311929 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:00.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.970+0000 7f0989635700 1 --2- 172.21.15.146:0/2418311929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f098409f180 0x7f0984133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.970+0000 7f0989635700 1 -- 172.21.15.146:0/2418311929 >> v2:172.21.15.146:3300/0 conn(0x7f098409e870 msgr2=0x7f098409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:00.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.970+0000 7f0989635700 1 --2- 172.21.15.146:0/2418311929 >> v2:172.21.15.146:3300/0 conn(0x7f098409e870 0x7f098409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.970+0000 7f0989635700 1 -- 172.21.15.146:0/2418311929 >> v1:172.21.15.146:6789/0 conn(0x7f0984134160 legacy=0x7f098413ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.970+0000 7f0989635700 1 -- 172.21.15.146:0/2418311929 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098409ada0 con 0x7f098409f180 2023-10-03T10:16:00.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.970+0000 7f0989635700 1 --2- 172.21.15.146:0/2418311929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f098409f180 0x7f0984133c20 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0974009840 tx=0x7f0974009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d863d1dba141ac0c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.970+0000 7f0988e34700 1 -- 172.21.15.146:0/2418311929 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974011830 con 0x7f098409f180 2023-10-03T10:16:00.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.970+0000 7f0988e34700 1 -- 172.21.15.146:0/2418311929 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0974011990 con 0x7f098409f180 2023-10-03T10:16:00.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.970+0000 7f0988e34700 1 -- 172.21.15.146:0/2418311929 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974011d20 con 0x7f098409f180 2023-10-03T10:16:00.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.971+0000 7f098c09a700 1 -- 172.21.15.146:0/2418311929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f098409f180 msgr2=0x7f0984133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.971+0000 7f098c09a700 1 --2- 172.21.15.146:0/2418311929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f098409f180 0x7f0984133c20 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0974009840 tx=0x7f0974009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:00.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.971+0000 7f098c09a700 1 -- 172.21.15.146:0/2418311929 shutdown_connections 2023-10-03T10:16:00.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.972+0000 7f098c09a700 1 --2- 172.21.15.146:0/2418311929 >> v2:172.21.15.146:3300/0 conn(0x7f098409e870 0x7f098409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.972+0000 7f098c09a700 1 --2- 172.21.15.146:0/2418311929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f098409f180 0x7f0984133c20 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.972+0000 7f098c09a700 1 -- 172.21.15.146:0/2418311929 >> 172.21.15.146:0/2418311929 conn(0x7f09840a4430 msgr2=0x7f09840a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:00.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.972+0000 7f098c09a700 1 -- 172.21.15.146:0/2418311929 shutdown_connections 2023-10-03T10:16:00.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.972+0000 7f098c09a700 1 -- 172.21.15.146:0/2418311929 wait complete. 2023-10-03T10:16:00.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.973+0000 7f098c09a700 1 Processor -- start 2023-10-03T10:16:00.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.973+0000 7f098c09a700 1 -- start start 2023-10-03T10:16:00.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.974+0000 7f098c09a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f098409e870 0x7f0984122aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.974+0000 7f098c09a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f098409f180 0x7f0984122fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.974+0000 7f098c09a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0984134160 0x7f0984123520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.974+0000 7f098c09a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09841262e0 con 0x7f098409f180 2023-10-03T10:16:00.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.974+0000 7f098c09a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09841247c0 con 0x7f0984134160 2023-10-03T10:16:00.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.974+0000 7f098c09a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f098406fba0 con 0x7f098409e870 2023-10-03T10:16:00.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.974+0000 7f098a637700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0984134160 0x7f0984123520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.974+0000 7f098a637700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0984134160 0x7f0984123520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53402/0 (socket says 172.21.15.146:53402) 2023-10-03T10:16:00.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.974+0000 7f098a637700 1 -- 172.21.15.146:0/3654293067 learned_addr learned my addr 172.21.15.146:0/3654293067 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.974+0000 7f0989e36700 1 --2- 172.21.15.146:0/3654293067 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f098409e870 0x7f0984122aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.974+0000 7f0989635700 1 --2- 172.21.15.146:0/3654293067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f098409f180 0x7f0984122fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.974+0000 7f098a637700 1 -- 172.21.15.146:0/3654293067 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f098409e870 msgr2=0x7f0984122aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.974+0000 7f098a637700 1 --2- 172.21.15.146:0/3654293067 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f098409e870 0x7f0984122aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.974+0000 7f098a637700 1 -- 172.21.15.146:0/3654293067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f098409f180 msgr2=0x7f0984122fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.974+0000 7f098a637700 1 --2- 172.21.15.146:0/3654293067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f098409f180 0x7f0984122fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.974+0000 7f098a637700 1 -- 172.21.15.146:0/3654293067 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09740094a0 con 0x7f0984134160 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.974+0000 7f0989635700 1 --2- 172.21.15.146:0/3654293067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f098409f180 0x7f0984122fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.974+0000 7f098a637700 1 --2- 172.21.15.146:0/3654293067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0984134160 0x7f0984123520 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f097c00cbc0 tx=0x7f097c00ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.975+0000 7f097a7fc700 1 -- 172.21.15.146:0/3654293067 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c00a9e0 con 0x7f0984134160 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.975+0000 7f098c09a700 1 -- 172.21.15.146:0/3654293067 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098406cfa0 con 0x7f0984134160 2023-10-03T10:16:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.975+0000 7f097a7fc700 1 -- 172.21.15.146:0/3654293067 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097c00ab40 con 0x7f0984134160 2023-10-03T10:16:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.975+0000 7f097a7fc700 1 -- 172.21.15.146:0/3654293067 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c012400 con 0x7f0984134160 2023-10-03T10:16:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.975+0000 7f098c09a700 1 -- 172.21.15.146:0/3654293067 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0984126cc0 con 0x7f0984134160 2023-10-03T10:16:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.975+0000 7f097a7fc700 1 -- 172.21.15.146:0/3654293067 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f097c01b3b0 con 0x7f0984134160 2023-10-03T10:16:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.976+0000 7f097a7fc700 1 -- 172.21.15.146:0/3654293067 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f097c03f430 con 0x7f0984134160 2023-10-03T10:16:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.976+0000 7f098c09a700 1 -- 172.21.15.146:0/3654293067 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098404f2a0 con 0x7f0984134160 2023-10-03T10:16:00.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.981+0000 7f097a7fc700 1 -- 172.21.15.146:0/3654293067 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f097c017080 con 0x7f0984134160 2023-10-03T10:16:00.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.998+0000 7f134d44a700 1 Processor -- start 2023-10-03T10:16:00.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.998+0000 7f134d44a700 1 -- start start 2023-10-03T10:16:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.998+0000 7f134d44a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1348138040 0x7f1348138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.998+0000 7f134d44a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f13480a1400 0x7f134813fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.998+0000 7f134d44a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13481379e0 con 0x7f13480a08e0 2023-10-03T10:16:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.998+0000 7f134d44a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13480a2100 con 0x7f1348138040 2023-10-03T10:16:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.998+0000 7f134d44a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1348138950 con 0x7f13480a1400 2023-10-03T10:16:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.998+0000 7f1346ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1348138040 0x7f1348138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.999+0000 7f1346ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1348138040 0x7f1348138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53416/0 (socket says 172.21.15.146:53416) 2023-10-03T10:16:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.999+0000 7f1346ffd700 1 -- 172.21.15.146:0/3900339812 learned_addr learned my addr 172.21.15.146:0/3900339812 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.999+0000 7f13477fe700 1 --2- 172.21.15.146:0/3900339812 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f13480a1400 0x7f134813fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.999+0000 7f1346ffd700 1 -- 172.21.15.146:0/3900339812 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f13480a1400 msgr2=0x7f134813fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.999+0000 7f1346ffd700 1 --2- 172.21.15.146:0/3900339812 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f13480a1400 0x7f134813fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.999+0000 7f1346ffd700 1 -- 172.21.15.146:0/3900339812 >> v1:172.21.15.146:6789/0 conn(0x7f13480a08e0 legacy=0x7f13480a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.999+0000 7f1345ffb700 1 -- 172.21.15.146:0/3900339812 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167865540 0 0) 0x7f13481379e0 con 0x7f13480a08e0 2023-10-03T10:16:01.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.999+0000 7f1346ffd700 1 -- 172.21.15.146:0/3900339812 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134809b9b0 con 0x7f1348138040 2023-10-03T10:16:01.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.999+0000 7f1346ffd700 1 --2- 172.21.15.146:0/3900339812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1348138040 0x7f1348138410 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1338009920 tx=0x7f1338009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b90b60fc500979e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.999+0000 7f1345ffb700 1 -- 172.21.15.146:0/3900339812 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1338005e30 con 0x7f1348138040 2023-10-03T10:16:01.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.999+0000 7f1345ffb700 1 -- 172.21.15.146:0/3900339812 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1338004030 con 0x7f1348138040 2023-10-03T10:16:01.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:00.999+0000 7f1345ffb700 1 -- 172.21.15.146:0/3900339812 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380043e0 con 0x7f1348138040 2023-10-03T10:16:01.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.000+0000 7f134d44a700 1 -- 172.21.15.146:0/3900339812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1348138040 msgr2=0x7f1348138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.000+0000 7f134d44a700 1 --2- 172.21.15.146:0/3900339812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1348138040 0x7f1348138410 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1338009920 tx=0x7f1338009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:01.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.000+0000 7f134d44a700 1 -- 172.21.15.146:0/3900339812 shutdown_connections 2023-10-03T10:16:01.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.000+0000 7f134d44a700 1 --2- 172.21.15.146:0/3900339812 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f13480a1400 0x7f134813fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.000+0000 7f134d44a700 1 --2- 172.21.15.146:0/3900339812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1348138040 0x7f1348138410 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.000+0000 7f134d44a700 1 -- 172.21.15.146:0/3900339812 >> 172.21.15.146:0/3900339812 conn(0x7f13480a2980 msgr2=0x7f13480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.000+0000 7f134d44a700 1 -- 172.21.15.146:0/3900339812 shutdown_connections 2023-10-03T10:16:01.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.001+0000 7f134d44a700 1 -- 172.21.15.146:0/3900339812 wait complete. 2023-10-03T10:16:01.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.002+0000 7f134d44a700 1 Processor -- start 2023-10-03T10:16:01.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.002+0000 7f134d44a700 1 -- start start 2023-10-03T10:16:01.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.003+0000 7f134d44a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13480a08e0 0x7f13481373d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.003+0000 7f134d44a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f13480a1400 0x7f1348135b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.003+0000 7f134d44a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1348138040 0x7f13481360c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.003+0000 7f134d44a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1348119310 con 0x7f13480a08e0 2023-10-03T10:16:01.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.003+0000 7f134d44a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13481302c0 con 0x7f1348138040 2023-10-03T10:16:01.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.003+0000 7f134d44a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f134809c7e0 con 0x7f13480a1400 2023-10-03T10:16:01.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.003+0000 7f13477fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1348138040 0x7f13481360c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.003+0000 7f1346ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13480a08e0 0x7f13481373d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.003+0000 7f13477fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1348138040 0x7f13481360c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53422/0 (socket says 172.21.15.146:53422) 2023-10-03T10:16:01.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.003+0000 7f13477fe700 1 -- 172.21.15.146:0/3780262936 learned_addr learned my addr 172.21.15.146:0/3780262936 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:01.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.003+0000 7f13467fc700 1 --2- 172.21.15.146:0/3780262936 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f13480a1400 0x7f1348135b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.003+0000 7f1346ffd700 1 -- 172.21.15.146:0/3780262936 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f13480a1400 msgr2=0x7f1348135b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.003+0000 7f1346ffd700 1 --2- 172.21.15.146:0/3780262936 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f13480a1400 0x7f1348135b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.003+0000 7f1346ffd700 1 -- 172.21.15.146:0/3780262936 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1348138040 msgr2=0x7f13481360c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.003+0000 7f1346ffd700 1 --2- 172.21.15.146:0/3780262936 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1348138040 0x7f13481360c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.003+0000 7f1346ffd700 1 -- 172.21.15.146:0/3780262936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1338009500 con 0x7f13480a08e0 2023-10-03T10:16:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.003+0000 7f13467fc700 1 --2- 172.21.15.146:0/3780262936 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f13480a1400 0x7f1348135b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.003+0000 7f13477fe700 1 --2- 172.21.15.146:0/3780262936 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1348138040 0x7f13481360c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.003+0000 7f1346ffd700 1 --2- 172.21.15.146:0/3780262936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13480a08e0 0x7f13481373d0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f1338009920 tx=0x7f1338004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.004+0000 7f132f7fe700 1 -- 172.21.15.146:0/3780262936 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380038b0 con 0x7f13480a08e0 2023-10-03T10:16:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.004+0000 7f132f7fe700 1 -- 172.21.15.146:0/3780262936 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1338003a50 con 0x7f13480a08e0 2023-10-03T10:16:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.004+0000 7f134d44a700 1 -- 172.21.15.146:0/3780262936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134813fd60 con 0x7f13480a08e0 2023-10-03T10:16:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.004+0000 7f132f7fe700 1 -- 172.21.15.146:0/3780262936 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1338003e00 con 0x7f13480a08e0 2023-10-03T10:16:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.004+0000 7f134d44a700 1 -- 172.21.15.146:0/3780262936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134809a240 con 0x7f13480a08e0 2023-10-03T10:16:01.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.005+0000 7f132f7fe700 1 -- 172.21.15.146:0/3780262936 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1338018070 con 0x7f13480a08e0 2023-10-03T10:16:01.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.005+0000 7f132f7fe700 1 -- 172.21.15.146:0/3780262936 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f13380433f0 con 0x7f13480a08e0 2023-10-03T10:16:01.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.005+0000 7f134d44a700 1 -- 172.21.15.146:0/3780262936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f134804f2a0 con 0x7f13480a08e0 2023-10-03T10:16:01.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.010+0000 7f132f7fe700 1 -- 172.21.15.146:0/3780262936 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1338016070 con 0x7f13480a08e0 2023-10-03T10:16:01.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.013+0000 7f112c209700 1 Processor -- start 2023-10-03T10:16:01.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.013+0000 7f112c209700 1 -- start start 2023-10-03T10:16:01.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.013+0000 7f112c209700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1124138040 0x7f1124138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.013+0000 7f112c209700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f11240a08e0 0x7f11240a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.013+0000 7f112c209700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11240a1230 0x7f112413ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.013+0000 7f112c209700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11240a2100 con 0x7f11240a1230 2023-10-03T10:16:01.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.013+0000 7f112c209700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1124138950 con 0x7f1124138040 2023-10-03T10:16:01.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.013+0000 7f112c209700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11241379e0 con 0x7f11240a08e0 2023-10-03T10:16:01.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.014+0000 7f112a7a6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11240a1230 0x7f112413ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.014+0000 7f11297a4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f11240a08e0 0x7f11240a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.014+0000 7f1129fa5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1124138040 0x7f1124138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.014+0000 7f112a7a6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11240a1230 0x7f112413ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60904/0 (socket says 172.21.15.146:60904) 2023-10-03T10:16:01.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.014+0000 7f112a7a6700 1 -- 172.21.15.146:0/449182643 learned_addr learned my addr 172.21.15.146:0/449182643 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:01.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.014+0000 7f11297a4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f11240a08e0 0x7f11240a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57694/0 (socket says 172.21.15.146:57694) 2023-10-03T10:16:01.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.014+0000 7f1129fa5700 1 -- 172.21.15.146:0/449182643 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f11240a08e0 msgr2=0x7f11240a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:01.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.014+0000 7f1129fa5700 1 --2- 172.21.15.146:0/449182643 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f11240a08e0 0x7f11240a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.014+0000 7f1129fa5700 1 -- 172.21.15.146:0/449182643 >> v2:172.21.15.146:3300/0 conn(0x7f11240a1230 msgr2=0x7f112413ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:01.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.014+0000 7f1129fa5700 1 --2- 172.21.15.146:0/449182643 >> v2:172.21.15.146:3300/0 conn(0x7f11240a1230 0x7f112413ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.014+0000 7f1129fa5700 1 -- 172.21.15.146:0/449182643 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112409b9b0 con 0x7f1124138040 2023-10-03T10:16:01.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.014+0000 7f11297a4700 1 --2- 172.21.15.146:0/449182643 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f11240a08e0 0x7f11240a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.014+0000 7f1129fa5700 1 --2- 172.21.15.146:0/449182643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1124138040 0x7f1124138410 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1120009880 tx=0x7f1120009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ebcee8990adf313 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.014+0000 7f1128fa3700 1 -- 172.21.15.146:0/449182643 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1120005e30 con 0x7f1124138040 2023-10-03T10:16:01.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.014+0000 7f1128fa3700 1 -- 172.21.15.146:0/449182643 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1120006030 con 0x7f1124138040 2023-10-03T10:16:01.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.014+0000 7f1128fa3700 1 -- 172.21.15.146:0/449182643 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11200063c0 con 0x7f1124138040 2023-10-03T10:16:01.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.015+0000 7f112c209700 1 -- 172.21.15.146:0/449182643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1124138040 msgr2=0x7f1124138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.015+0000 7f112c209700 1 --2- 172.21.15.146:0/449182643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1124138040 0x7f1124138410 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1120009880 tx=0x7f1120009b90 comp rx=0 tx=0).stop 2023-10-03T10:16:01.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.015+0000 7f112c209700 1 -- 172.21.15.146:0/449182643 shutdown_connections 2023-10-03T10:16:01.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.015+0000 7f112c209700 1 --2- 172.21.15.146:0/449182643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1124138040 0x7f1124138410 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.015+0000 7f112c209700 1 --2- 172.21.15.146:0/449182643 >> v2:172.21.15.146:3300/0 conn(0x7f11240a1230 0x7f112413ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.015+0000 7f112c209700 1 --2- 172.21.15.146:0/449182643 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f11240a08e0 0x7f11240a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.015+0000 7f112c209700 1 -- 172.21.15.146:0/449182643 >> 172.21.15.146:0/449182643 conn(0x7f11240a2980 msgr2=0x7f11240a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.015+0000 7f112c209700 1 -- 172.21.15.146:0/449182643 shutdown_connections 2023-10-03T10:16:01.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.015+0000 7f112c209700 1 -- 172.21.15.146:0/449182643 wait complete. 2023-10-03T10:16:01.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.016+0000 7f112c209700 1 Processor -- start 2023-10-03T10:16:01.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.016+0000 7f112c209700 1 -- start start 2023-10-03T10:16:01.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.017+0000 7f112c209700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11240a08e0 0x7f11241348c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.017+0000 7f112c209700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11240a1230 0x7f1124134e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.017+0000 7f112c209700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1124138040 0x7f11241d4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.017+0000 7f112c209700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112411b120 con 0x7f11240a1230 2023-10-03T10:16:01.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.017+0000 7f112c209700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112411ad60 con 0x7f11240a08e0 2023-10-03T10:16:01.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.017+0000 7f112c209700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f112411b300 con 0x7f1124138040 2023-10-03T10:16:01.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.017+0000 7f1129fa5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11240a08e0 0x7f11241348c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.017+0000 7f112a7a6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1124138040 0x7f11241d4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.017+0000 7f1129fa5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11240a08e0 0x7f11241348c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53448/0 (socket says 172.21.15.146:53448) 2023-10-03T10:16:01.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.017+0000 7f112a7a6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1124138040 0x7f11241d4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57706/0 (socket says 172.21.15.146:57706) 2023-10-03T10:16:01.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.017+0000 7f1129fa5700 1 -- 172.21.15.146:0/3052896310 learned_addr learned my addr 172.21.15.146:0/3052896310 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:01.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.017+0000 7f11297a4700 1 --2- 172.21.15.146:0/3052896310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11240a1230 0x7f1124134e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.017+0000 7f112a7a6700 1 -- 172.21.15.146:0/3052896310 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11240a08e0 msgr2=0x7f11241348c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.017+0000 7f112a7a6700 1 --2- 172.21.15.146:0/3052896310 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11240a08e0 0x7f11241348c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.017+0000 7f112a7a6700 1 -- 172.21.15.146:0/3052896310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11240a1230 msgr2=0x7f1124134e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.017+0000 7f112a7a6700 1 --2- 172.21.15.146:0/3052896310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11240a1230 0x7f1124134e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.017+0000 7f112a7a6700 1 -- 172.21.15.146:0/3052896310 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11140094a0 con 0x7f1124138040 2023-10-03T10:16:01.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.017+0000 7f1129fa5700 1 --2- 172.21.15.146:0/3052896310 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11240a08e0 0x7f11241348c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.017+0000 7f112a7a6700 1 --2- 172.21.15.146:0/3052896310 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1124138040 0x7f11241d4f70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f111c00ebd0 tx=0x7f111c00eee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.017+0000 7f111a7fc700 1 -- 172.21.15.146:0/3052896310 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c003c20 con 0x7f1124138040 2023-10-03T10:16:01.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.018+0000 7f111a7fc700 1 -- 172.21.15.146:0/3052896310 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111c00f040 con 0x7f1124138040 2023-10-03T10:16:01.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.018+0000 7f112c209700 1 -- 172.21.15.146:0/3052896310 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1120009430 con 0x7f1124138040 2023-10-03T10:16:01.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.018+0000 7f111a7fc700 1 -- 172.21.15.146:0/3052896310 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c00c5f0 con 0x7f1124138040 2023-10-03T10:16:01.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.018+0000 7f112c209700 1 -- 172.21.15.146:0/3052896310 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112411a640 con 0x7f1124138040 2023-10-03T10:16:01.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.019+0000 7f112c209700 1 -- 172.21.15.146:0/3052896310 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f112411af80 con 0x7f1124138040 2023-10-03T10:16:01.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.019+0000 7f111a7fc700 1 -- 172.21.15.146:0/3052896310 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f111c00c750 con 0x7f1124138040 2023-10-03T10:16:01.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.019+0000 7f111a7fc700 1 -- 172.21.15.146:0/3052896310 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f111c03f8a0 con 0x7f1124138040 2023-10-03T10:16:01.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.023+0000 7f111a7fc700 1 -- 172.21.15.146:0/3052896310 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f112411af80 con 0x7f1124138040 2023-10-03T10:16:01.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.159+0000 7f7153fff700 1 -- 172.21.15.146:0/3819161868 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f714c005590 con 0x7f71700a0a70 2023-10-03T10:16:01.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.160+0000 7f71667fc700 1 -- 172.21.15.146:0/3819161868 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f716c00b9d0 con 0x7f71700a0a70 2023-10-03T10:16:01.160 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.162+0000 7f7153fff700 1 -- 172.21.15.146:0/3819161868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71700a0a70 msgr2=0x7f717011f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.162+0000 7f7153fff700 1 --2- 172.21.15.146:0/3819161868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71700a0a70 0x7f717011f760 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f716c016000 tx=0x7f716c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.162+0000 7f7153fff700 1 -- 172.21.15.146:0/3819161868 shutdown_connections 2023-10-03T10:16:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.162+0000 7f7153fff700 1 --2- 172.21.15.146:0/3819161868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71701c8410 0x7f71701c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.162+0000 7f7153fff700 1 --2- 172.21.15.146:0/3819161868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71700a0a70 0x7f717011f760 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.162+0000 7f7153fff700 1 --2- 172.21.15.146:0/3819161868 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7170133f70 0x7f717011fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.162+0000 7f7153fff700 1 -- 172.21.15.146:0/3819161868 >> 172.21.15.146:0/3819161868 conn(0x7f7170099c40 msgr2=0x7f71701bbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.162+0000 7f7153fff700 1 -- 172.21.15.146:0/3819161868 shutdown_connections 2023-10-03T10:16:01.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.162+0000 7f7153fff700 1 -- 172.21.15.146:0/3819161868 wait complete. 2023-10-03T10:16:01.174 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:01.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.184+0000 7f098c09a700 1 -- 172.21.15.146:0/3654293067 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f098406c9d0 con 0x7f0984134160 2023-10-03T10:16:01.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.184+0000 7f097a7fc700 1 -- 172.21.15.146:0/3654293067 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f097c0192c0 con 0x7f0984134160 2023-10-03T10:16:01.184 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:01.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.187+0000 7f098c09a700 1 -- 172.21.15.146:0/3654293067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0984134160 msgr2=0x7f0984123520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.187+0000 7f098c09a700 1 --2- 172.21.15.146:0/3654293067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0984134160 0x7f0984123520 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f097c00cbc0 tx=0x7f097c00ced0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.187+0000 7f098c09a700 1 -- 172.21.15.146:0/3654293067 shutdown_connections 2023-10-03T10:16:01.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.187+0000 7f098c09a700 1 --2- 172.21.15.146:0/3654293067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0984134160 0x7f0984123520 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.187+0000 7f098c09a700 1 --2- 172.21.15.146:0/3654293067 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f098409e870 0x7f0984122aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.187+0000 7f098c09a700 1 --2- 172.21.15.146:0/3654293067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f098409f180 0x7f0984122fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.187+0000 7f098c09a700 1 -- 172.21.15.146:0/3654293067 >> 172.21.15.146:0/3654293067 conn(0x7f09840a4430 msgr2=0x7f0984071010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.187+0000 7f098c09a700 1 -- 172.21.15.146:0/3654293067 shutdown_connections 2023-10-03T10:16:01.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.187+0000 7f098c09a700 1 -- 172.21.15.146:0/3654293067 wait complete. 2023-10-03T10:16:01.199 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:01.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.217+0000 7f112c209700 1 -- 172.21.15.146:0/3052896310 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f112411af80 con 0x7f1124138040 2023-10-03T10:16:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.217+0000 7f111a7fc700 1 -- 172.21.15.146:0/3052896310 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f112411af80 con 0x7f1124138040 2023-10-03T10:16:01.217 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.219+0000 7f112c209700 1 -- 172.21.15.146:0/3052896310 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1124138040 msgr2=0x7f11241d4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.219+0000 7f112c209700 1 --2- 172.21.15.146:0/3052896310 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1124138040 0x7f11241d4f70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f111c00ebd0 tx=0x7f111c00eee0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.219+0000 7f112c209700 1 -- 172.21.15.146:0/3052896310 shutdown_connections 2023-10-03T10:16:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.219+0000 7f112c209700 1 --2- 172.21.15.146:0/3052896310 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1124138040 0x7f11241d4f70 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.219+0000 7f112c209700 1 --2- 172.21.15.146:0/3052896310 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11240a08e0 0x7f11241348c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.219+0000 7f112c209700 1 --2- 172.21.15.146:0/3052896310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11240a1230 0x7f1124134e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.219+0000 7f112c209700 1 -- 172.21.15.146:0/3052896310 >> 172.21.15.146:0/3052896310 conn(0x7f11240a2980 msgr2=0x7f1124070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.219+0000 7f112c209700 1 -- 172.21.15.146:0/3052896310 shutdown_connections 2023-10-03T10:16:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.219+0000 7f112c209700 1 -- 172.21.15.146:0/3052896310 wait complete. 2023-10-03T10:16:01.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.228+0000 7f134d44a700 1 -- 172.21.15.146:0/3780262936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1348140750 con 0x7f13480a08e0 2023-10-03T10:16:01.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.228+0000 7f132f7fe700 1 -- 172.21.15.146:0/3780262936 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1338016030 con 0x7f13480a08e0 2023-10-03T10:16:01.228 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:01.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.231+0000 7f134d44a700 1 -- 172.21.15.146:0/3780262936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13480a08e0 msgr2=0x7f13481373d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.231+0000 7f134d44a700 1 --2- 172.21.15.146:0/3780262936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13480a08e0 0x7f13481373d0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f1338009920 tx=0x7f1338004750 comp rx=0 tx=0).stop 2023-10-03T10:16:01.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.231+0000 7f134d44a700 1 -- 172.21.15.146:0/3780262936 shutdown_connections 2023-10-03T10:16:01.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.231+0000 7f134d44a700 1 --2- 172.21.15.146:0/3780262936 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1348138040 0x7f13481360c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.231+0000 7f134d44a700 1 --2- 172.21.15.146:0/3780262936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13480a08e0 0x7f13481373d0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.231+0000 7f134d44a700 1 --2- 172.21.15.146:0/3780262936 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f13480a1400 0x7f1348135b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.231+0000 7f134d44a700 1 -- 172.21.15.146:0/3780262936 >> 172.21.15.146:0/3780262936 conn(0x7f13480a2980 msgr2=0x7f134809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.231+0000 7f134d44a700 1 -- 172.21.15.146:0/3780262936 shutdown_connections 2023-10-03T10:16:01.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:01.231+0000 7f134d44a700 1 -- 172.21.15.146:0/3780262936 wait complete. 2023-10-03T10:16:01.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:01.242 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:02.175 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:02.200 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:02.233 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:02.243 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:02.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.320+0000 7f086632f700 1 Processor -- start 2023-10-03T10:16:02.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.320+0000 7f086632f700 1 -- start start 2023-10-03T10:16:02.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.321+0000 7f086632f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0860099e20 0x7f086009a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.321+0000 7f086632f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0860130a60 0x7f0860138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.321+0000 7f086632f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0860099a60 con 0x7f086009a730 2023-10-03T10:16:02.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.321+0000 7f086632f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086009bf50 con 0x7f0860099e20 2023-10-03T10:16:02.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.321+0000 7f086632f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086009b230 con 0x7f0860130a60 2023-10-03T10:16:02.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.321+0000 7f08648cc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0860130a60 0x7f0860138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.321+0000 7f08648cc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0860130a60 0x7f0860138690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53464/0 (socket says 172.21.15.146:53464) 2023-10-03T10:16:02.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.321+0000 7f08648cc700 1 -- 172.21.15.146:0/1171778549 learned_addr learned my addr 172.21.15.146:0/1171778549 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:02.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.321+0000 7f085ffff700 1 --2- 172.21.15.146:0/1171778549 >> v2:172.21.15.146:3300/0 conn(0x7f0860099e20 0x7f086009a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.321+0000 7f08648cc700 1 -- 172.21.15.146:0/1171778549 >> v2:172.21.15.146:3300/0 conn(0x7f0860099e20 msgr2=0x7f086009a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:02.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.321+0000 7f08648cc700 1 --2- 172.21.15.146:0/1171778549 >> v2:172.21.15.146:3300/0 conn(0x7f0860099e20 0x7f086009a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.321+0000 7f08648cc700 1 -- 172.21.15.146:0/1171778549 >> v1:172.21.15.146:6789/0 conn(0x7f086009a730 legacy=0x7f0860130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.321+0000 7f085effd700 1 -- 172.21.15.146:0/1171778549 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1370133524 0 0) 0x7f0860099a60 con 0x7f086009a730 2023-10-03T10:16:02.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.321+0000 7f08648cc700 1 -- 172.21.15.146:0/1171778549 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086009bb90 con 0x7f0860130a60 2023-10-03T10:16:02.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.321+0000 7f085ffff700 1 --2- 172.21.15.146:0/1171778549 >> v2:172.21.15.146:3300/0 conn(0x7f0860099e20 0x7f086009a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:02.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.322+0000 7f08648cc700 1 --2- 172.21.15.146:0/1171778549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0860130a60 0x7f0860138690 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0858009e50 tx=0x7f085800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23f216d3c5a97bce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.322+0000 7f085effd700 1 -- 172.21.15.146:0/1171778549 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085800e070 con 0x7f0860130a60 2023-10-03T10:16:02.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.322+0000 7f085effd700 1 -- 172.21.15.146:0/1171778549 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085800b9c0 con 0x7f0860130a60 2023-10-03T10:16:02.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.322+0000 7f085effd700 1 -- 172.21.15.146:0/1171778549 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085800bd70 con 0x7f0860130a60 2023-10-03T10:16:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.322+0000 7f086632f700 1 -- 172.21.15.146:0/1171778549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0860130a60 msgr2=0x7f0860138690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.322+0000 7f086632f700 1 --2- 172.21.15.146:0/1171778549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0860130a60 0x7f0860138690 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0858009e50 tx=0x7f085800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.323+0000 7f086632f700 1 -- 172.21.15.146:0/1171778549 shutdown_connections 2023-10-03T10:16:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.323+0000 7f086632f700 1 --2- 172.21.15.146:0/1171778549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0860130a60 0x7f0860138690 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.323+0000 7f086632f700 1 --2- 172.21.15.146:0/1171778549 >> v2:172.21.15.146:3300/0 conn(0x7f0860099e20 0x7f086009a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.323+0000 7f086632f700 1 -- 172.21.15.146:0/1171778549 >> 172.21.15.146:0/1171778549 conn(0x7f08600a2980 msgr2=0x7f08600a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.323+0000 7f086632f700 1 -- 172.21.15.146:0/1171778549 shutdown_connections 2023-10-03T10:16:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.323+0000 7f086632f700 1 -- 172.21.15.146:0/1171778549 wait complete. 2023-10-03T10:16:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.324+0000 7f086632f700 1 Processor -- start 2023-10-03T10:16:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.324+0000 7f086632f700 1 -- start start 2023-10-03T10:16:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.324+0000 7f086632f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0860099e20 0x7f086013be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.324+0000 7f086632f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f086009a730 0x7f086013c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.324+0000 7f086632f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0860130a60 0x7f086013c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.324+0000 7f086632f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086013f8f0 con 0x7f0860130a60 2023-10-03T10:16:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.324+0000 7f086632f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086013b1e0 con 0x7f086009a730 2023-10-03T10:16:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.324+0000 7f086632f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08601336f0 con 0x7f0860099e20 2023-10-03T10:16:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.324+0000 7f08648cc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0860130a60 0x7f086013c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.324+0000 7f085f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f086009a730 0x7f086013c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.324+0000 7f08648cc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0860130a60 0x7f086013c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60936/0 (socket says 172.21.15.146:60936) 2023-10-03T10:16:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.324+0000 7f08648cc700 1 -- 172.21.15.146:0/1030575309 learned_addr learned my addr 172.21.15.146:0/1030575309 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.324+0000 7f085ffff700 1 --2- 172.21.15.146:0/1030575309 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0860099e20 0x7f086013be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.325+0000 7f085ffff700 1 -- 172.21.15.146:0/1030575309 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f086009a730 msgr2=0x7f086013c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.325+0000 7f085ffff700 1 --2- 172.21.15.146:0/1030575309 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f086009a730 0x7f086013c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.325+0000 7f085ffff700 1 -- 172.21.15.146:0/1030575309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0860130a60 msgr2=0x7f086013c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.325+0000 7f085ffff700 1 --2- 172.21.15.146:0/1030575309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0860130a60 0x7f086013c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.325+0000 7f085ffff700 1 -- 172.21.15.146:0/1030575309 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0858009b30 con 0x7f0860099e20 2023-10-03T10:16:02.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.325+0000 7f08648cc700 1 --2- 172.21.15.146:0/1030575309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0860130a60 0x7f086013c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.325+0000 7f085ffff700 1 --2- 172.21.15.146:0/1030575309 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0860099e20 0x7f086013be20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f085000e870 tx=0x7f085000eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.326+0000 7f085cff9700 1 -- 172.21.15.146:0/1030575309 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085000c070 con 0x7f0860099e20 2023-10-03T10:16:02.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.326+0000 7f085cff9700 1 -- 172.21.15.146:0/1030575309 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0850005c40 con 0x7f0860099e20 2023-10-03T10:16:02.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.326+0000 7f086632f700 1 -- 172.21.15.146:0/1030575309 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08601302f0 con 0x7f0860099e20 2023-10-03T10:16:02.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.326+0000 7f085cff9700 1 -- 172.21.15.146:0/1030575309 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0850006030 con 0x7f0860099e20 2023-10-03T10:16:02.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.326+0000 7f086632f700 1 -- 172.21.15.146:0/1030575309 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086013e8d0 con 0x7f0860099e20 2023-10-03T10:16:02.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.327+0000 7f086632f700 1 -- 172.21.15.146:0/1030575309 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0860072480 con 0x7f0860099e20 2023-10-03T10:16:02.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.327+0000 7f085cff9700 1 -- 172.21.15.146:0/1030575309 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0850004020 con 0x7f0860099e20 2023-10-03T10:16:02.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.327+0000 7f085cff9700 1 -- 172.21.15.146:0/1030575309 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f085003f900 con 0x7f0860099e20 2023-10-03T10:16:02.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.336+0000 7f085cff9700 1 -- 172.21.15.146:0/1030575309 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f085001b3a0 con 0x7f0860099e20 2023-10-03T10:16:02.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.369+0000 7f7c17117700 1 Processor -- start 2023-10-03T10:16:02.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.369+0000 7f7c17117700 1 -- start start 2023-10-03T10:16:02.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.370+0000 7f7c17117700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7c1009e870 0x7f7c1009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.370+0000 7f7c17117700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c1009f180 0x7f7c10131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.370+0000 7f7c17117700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1009c970 con 0x7f7c10131d70 2023-10-03T10:16:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.370+0000 7f7c17117700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c100a0920 con 0x7f7c1009e870 2023-10-03T10:16:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.370+0000 7f7c17117700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1009f9c0 con 0x7f7c1009f180 2023-10-03T10:16:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.370+0000 7f7c14eb3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7c1009e870 0x7f7c1009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.370+0000 7f7c14eb3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7c1009e870 0x7f7c1009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60944/0 (socket says 172.21.15.146:60944) 2023-10-03T10:16:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.370+0000 7f7c14eb3700 1 -- 172.21.15.146:0/676243446 learned_addr learned my addr 172.21.15.146:0/676243446 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.370+0000 7f7c0ffff700 1 --2- 172.21.15.146:0/676243446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c1009f180 0x7f7c10131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.371+0000 7f7c0f7fe700 1 -- 172.21.15.146:0/676243446 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050349654 0 0) 0x7f7c1009c970 con 0x7f7c10131d70 2023-10-03T10:16:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.371+0000 7f7c0f7fe700 1 -- 172.21.15.146:0/676243446 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c000035b0 con 0x7f7c10131d70 2023-10-03T10:16:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.371+0000 7f7c0ffff700 1 -- 172.21.15.146:0/676243446 >> v2:172.21.15.146:3300/0 conn(0x7f7c1009e870 msgr2=0x7f7c1009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.371+0000 7f7c0ffff700 1 --2- 172.21.15.146:0/676243446 >> v2:172.21.15.146:3300/0 conn(0x7f7c1009e870 0x7f7c1009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.371+0000 7f7c0ffff700 1 -- 172.21.15.146:0/676243446 >> v1:172.21.15.146:6789/0 conn(0x7f7c10131d70 legacy=0x7f7c10138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.371+0000 7f7c0ffff700 1 -- 172.21.15.146:0/676243446 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1009bab0 con 0x7f7c1009f180 2023-10-03T10:16:02.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.371+0000 7f7c0ffff700 1 --2- 172.21.15.146:0/676243446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c1009f180 0x7f7c10131830 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009840 tx=0x7f7bfc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79d3c49c94d4aff2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.371+0000 7f7c0f7fe700 1 -- 172.21.15.146:0/676243446 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc011830 con 0x7f7c1009f180 2023-10-03T10:16:02.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.371+0000 7f7c0f7fe700 1 -- 172.21.15.146:0/676243446 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc011990 con 0x7f7c1009f180 2023-10-03T10:16:02.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.371+0000 7f7c0f7fe700 1 -- 172.21.15.146:0/676243446 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc011d00 con 0x7f7c1009f180 2023-10-03T10:16:02.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.372+0000 7f7c17117700 1 -- 172.21.15.146:0/676243446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c1009f180 msgr2=0x7f7c10131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.372+0000 7f7c17117700 1 --2- 172.21.15.146:0/676243446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c1009f180 0x7f7c10131830 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009840 tx=0x7f7bfc009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:02.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.372+0000 7f7c17117700 1 -- 172.21.15.146:0/676243446 shutdown_connections 2023-10-03T10:16:02.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.372+0000 7f7c17117700 1 --2- 172.21.15.146:0/676243446 >> v2:172.21.15.146:3300/0 conn(0x7f7c1009e870 0x7f7c1009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.372+0000 7f7c17117700 1 --2- 172.21.15.146:0/676243446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c1009f180 0x7f7c10131830 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.372+0000 7f7c17117700 1 -- 172.21.15.146:0/676243446 >> 172.21.15.146:0/676243446 conn(0x7f7c100a4430 msgr2=0x7f7c100a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.372+0000 7f7c17117700 1 -- 172.21.15.146:0/676243446 shutdown_connections 2023-10-03T10:16:02.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.372+0000 7f7c17117700 1 -- 172.21.15.146:0/676243446 wait complete. 2023-10-03T10:16:02.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.374+0000 7f7c17117700 1 Processor -- start 2023-10-03T10:16:02.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.374+0000 7f7c17117700 1 -- start start 2023-10-03T10:16:02.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.375+0000 7f7c17117700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c1009e870 0x7f7c1011f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.375+0000 7f7c17117700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c1009f180 0x7f7c1011f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.375+0000 7f7c17117700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c10131d70 0x7f7c1011fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.375+0000 7f7c17117700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c10120550 con 0x7f7c1009f180 2023-10-03T10:16:02.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.375+0000 7f7c17117700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c10122bc0 con 0x7f7c10131d70 2023-10-03T10:16:02.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.375+0000 7f7c17117700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c101226b0 con 0x7f7c1009e870 2023-10-03T10:16:02.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.375+0000 7f7c14eb3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c1009e870 0x7f7c1011f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.375+0000 7f7c0ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c1009f180 0x7f7c1011f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.375+0000 7f7c14eb3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c1009e870 0x7f7c1011f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57736/0 (socket says 172.21.15.146:57736) 2023-10-03T10:16:02.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.375+0000 7f7c14eb3700 1 -- 172.21.15.146:0/2451361682 learned_addr learned my addr 172.21.15.146:0/2451361682 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:02.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.375+0000 7f7c156b4700 1 --2- 172.21.15.146:0/2451361682 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c10131d70 0x7f7c1011fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.375+0000 7f7c14eb3700 1 -- 172.21.15.146:0/2451361682 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c10131d70 msgr2=0x7f7c1011fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.375+0000 7f7c14eb3700 1 --2- 172.21.15.146:0/2451361682 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c10131d70 0x7f7c1011fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.375+0000 7f7c14eb3700 1 -- 172.21.15.146:0/2451361682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c1009f180 msgr2=0x7f7c1011f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.375+0000 7f7c14eb3700 1 --2- 172.21.15.146:0/2451361682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c1009f180 0x7f7c1011f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.375+0000 7f7c14eb3700 1 -- 172.21.15.146:0/2451361682 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bfc0094a0 con 0x7f7c1009e870 2023-10-03T10:16:02.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.375+0000 7f7c0ffff700 1 --2- 172.21.15.146:0/2451361682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c1009f180 0x7f7c1011f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.376+0000 7f7c14eb3700 1 --2- 172.21.15.146:0/2451361682 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c1009e870 0x7f7c1011f0a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400e810 tx=0x7f7c0400eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.376+0000 7f7c0d7fa700 1 -- 172.21.15.146:0/2451361682 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04013610 con 0x7f7c1009e870 2023-10-03T10:16:02.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.376+0000 7f7c0d7fa700 1 -- 172.21.15.146:0/2451361682 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c04013770 con 0x7f7c1009e870 2023-10-03T10:16:02.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.376+0000 7f7c0d7fa700 1 -- 172.21.15.146:0/2451361682 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04013b20 con 0x7f7c1009e870 2023-10-03T10:16:02.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.376+0000 7f7c17117700 1 -- 172.21.15.146:0/2451361682 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c1009dba0 con 0x7f7c1009e870 2023-10-03T10:16:02.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.376+0000 7f7c17117700 1 -- 172.21.15.146:0/2451361682 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c10120cb0 con 0x7f7c1009e870 2023-10-03T10:16:02.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.377+0000 7f7c17117700 1 -- 172.21.15.146:0/2451361682 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c1011be60 con 0x7f7c1009e870 2023-10-03T10:16:02.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.377+0000 7f7c0d7fa700 1 -- 172.21.15.146:0/2451361682 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c04013c80 con 0x7f7c1009e870 2023-10-03T10:16:02.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.378+0000 7f7c0d7fa700 1 -- 172.21.15.146:0/2451361682 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7c0403f220 con 0x7f7c1009e870 2023-10-03T10:16:02.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.387+0000 7f7c0d7fa700 1 -- 172.21.15.146:0/2451361682 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c04012370 con 0x7f7c1009e870 2023-10-03T10:16:02.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.397+0000 7f9b0d386700 1 Processor -- start 2023-10-03T10:16:02.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.397+0000 7f9b0d386700 1 -- start start 2023-10-03T10:16:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.397+0000 7f9b0d386700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b0806a770 0x7f9b0806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.397+0000 7f9b0d386700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b08131ec0 0x7f9b08139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.397+0000 7f9b0d386700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b0809da80 con 0x7f9b0806b080 2023-10-03T10:16:02.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.397+0000 7f9b0d386700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0809dce0 con 0x7f9b08131ec0 2023-10-03T10:16:02.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.397+0000 7f9b0d386700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0809eb20 con 0x7f9b0806a770 2023-10-03T10:16:02.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.397+0000 7f9b077fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b08131ec0 0x7f9b08139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.397+0000 7f9b077fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b08131ec0 0x7f9b08139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53506/0 (socket says 172.21.15.146:53506) 2023-10-03T10:16:02.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.397+0000 7f9b077fe700 1 -- 172.21.15.146:0/4184341331 learned_addr learned my addr 172.21.15.146:0/4184341331 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:02.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.397+0000 7f9b067fc700 1 --1- 172.21.15.146:0/4184341331 >> v1:172.21.15.146:6789/0 conn(0x7f9b0806b080 0x7f9b081317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36772/0 (socket says 172.21.15.146:36772) 2023-10-03T10:16:02.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.397+0000 7f9b06ffd700 1 --2- 172.21.15.146:0/4184341331 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b0806a770 0x7f9b0806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.398+0000 7f9b05ffb700 1 -- 172.21.15.146:0/4184341331 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123664128 0 0) 0x7f9b0809da80 con 0x7f9b0806b080 2023-10-03T10:16:02.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.398+0000 7f9b05ffb700 1 -- 172.21.15.146:0/4184341331 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9af00035b0 con 0x7f9b0806b080 2023-10-03T10:16:02.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.398+0000 7f9b05ffb700 1 -- 172.21.15.146:0/4184341331 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2166927376 0 0) 0x7f9af00035b0 con 0x7f9b0806b080 2023-10-03T10:16:02.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.398+0000 7f9b06ffd700 1 -- 172.21.15.146:0/4184341331 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b08131ec0 msgr2=0x7f9b08139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:02.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.398+0000 7f9b06ffd700 1 --2- 172.21.15.146:0/4184341331 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b08131ec0 0x7f9b08139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.398+0000 7f9b06ffd700 1 -- 172.21.15.146:0/4184341331 >> v1:172.21.15.146:6789/0 conn(0x7f9b0806b080 legacy=0x7f9b081317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.398+0000 7f9b06ffd700 1 -- 172.21.15.146:0/4184341331 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0809d860 con 0x7f9b0806a770 2023-10-03T10:16:02.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.398+0000 7f9b06ffd700 1 --2- 172.21.15.146:0/4184341331 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b0806a770 0x7f9b0806ab40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009870 tx=0x7f9af8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0ec98a53683515d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.398+0000 7f9b05ffb700 1 -- 172.21.15.146:0/4184341331 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc001670 con 0x7f9b0806a770 2023-10-03T10:16:02.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.398+0000 7f9b05ffb700 1 -- 172.21.15.146:0/4184341331 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af8004030 con 0x7f9b0806a770 2023-10-03T10:16:02.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.398+0000 7f9b05ffb700 1 -- 172.21.15.146:0/4184341331 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af80043a0 con 0x7f9b0806a770 2023-10-03T10:16:02.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.399+0000 7f9b0d386700 1 -- 172.21.15.146:0/4184341331 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b0806a770 msgr2=0x7f9b0806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.399+0000 7f9b0d386700 1 --2- 172.21.15.146:0/4184341331 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b0806a770 0x7f9b0806ab40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009870 tx=0x7f9af8009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:02.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.399+0000 7f9b0d386700 1 -- 172.21.15.146:0/4184341331 shutdown_connections 2023-10-03T10:16:02.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.399+0000 7f9b0d386700 1 --2- 172.21.15.146:0/4184341331 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b08131ec0 0x7f9b08139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.399+0000 7f9b0d386700 1 --2- 172.21.15.146:0/4184341331 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b0806a770 0x7f9b0806ab40 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.399+0000 7f9b0d386700 1 -- 172.21.15.146:0/4184341331 >> 172.21.15.146:0/4184341331 conn(0x7f9b08099c40 msgr2=0x7f9b080a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.399+0000 7f9b0d386700 1 -- 172.21.15.146:0/4184341331 shutdown_connections 2023-10-03T10:16:02.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.399+0000 7f9b0d386700 1 -- 172.21.15.146:0/4184341331 wait complete. 2023-10-03T10:16:02.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.400+0000 7f9b0d386700 1 Processor -- start 2023-10-03T10:16:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.400+0000 7f9b0d386700 1 -- start start 2023-10-03T10:16:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.401+0000 7f9b0d386700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b0806a770 0x7f9b081c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.401+0000 7f9b0d386700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b0806b080 0x7f9b081c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.401+0000 7f9b0d386700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b08131ec0 0x7f9b081c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.401+0000 7f9b0d386700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0811ed50 con 0x7f9b0806a770 2023-10-03T10:16:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.401+0000 7f9b0d386700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b08071e10 con 0x7f9b0806b080 2023-10-03T10:16:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.401+0000 7f9b0d386700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b08130310 con 0x7f9b08131ec0 2023-10-03T10:16:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.401+0000 7f9b067fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b0806b080 0x7f9b081c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.401+0000 7f9b067fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b0806b080 0x7f9b081c63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:53508/0 (socket says 172.21.15.146:53508) 2023-10-03T10:16:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.401+0000 7f9b067fc700 1 -- 172.21.15.146:0/2732867572 learned_addr learned my addr 172.21.15.146:0/2732867572 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.401+0000 7f9b077fe700 1 --2- 172.21.15.146:0/2732867572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b08131ec0 0x7f9b081c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.401+0000 7f9b06ffd700 1 --2- 172.21.15.146:0/2732867572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b0806a770 0x7f9b081c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.401+0000 7f9b067fc700 1 -- 172.21.15.146:0/2732867572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b08131ec0 msgr2=0x7f9b081c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.401+0000 7f9b067fc700 1 --2- 172.21.15.146:0/2732867572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b08131ec0 0x7f9b081c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.401+0000 7f9b067fc700 1 -- 172.21.15.146:0/2732867572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b0806a770 msgr2=0x7f9b081c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.401+0000 7f9b067fc700 1 --2- 172.21.15.146:0/2732867572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b0806a770 0x7f9b081c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.401+0000 7f9b067fc700 1 -- 172.21.15.146:0/2732867572 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af80094a0 con 0x7f9b0806b080 2023-10-03T10:16:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.401+0000 7f9b067fc700 1 --2- 172.21.15.146:0/2732867572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b0806b080 0x7f9b081c63e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00c750 tx=0x7f9afc00ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.402+0000 7f9aef7fe700 1 -- 172.21.15.146:0/2732867572 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc004c80 con 0x7f9b0806b080 2023-10-03T10:16:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.402+0000 7f9aef7fe700 1 -- 172.21.15.146:0/2732867572 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9afc004de0 con 0x7f9b0806b080 2023-10-03T10:16:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.402+0000 7f9aef7fe700 1 -- 172.21.15.146:0/2732867572 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc007310 con 0x7f9b0806b080 2023-10-03T10:16:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.402+0000 7f9b0d386700 1 -- 172.21.15.146:0/2732867572 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0811d4f0 con 0x7f9b0806b080 2023-10-03T10:16:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.402+0000 7f9b0d386700 1 -- 172.21.15.146:0/2732867572 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b0811fa80 con 0x7f9b0806b080 2023-10-03T10:16:02.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.403+0000 7f9aef7fe700 1 -- 172.21.15.146:0/2732867572 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9afc007470 con 0x7f9b0806b080 2023-10-03T10:16:02.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.403+0000 7f9b0d386700 1 -- 172.21.15.146:0/2732867572 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b0809e510 con 0x7f9b0806b080 2023-10-03T10:16:02.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.403+0000 7f9aef7fe700 1 -- 172.21.15.146:0/2732867572 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9afc03f410 con 0x7f9b0806b080 2023-10-03T10:16:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.404+0000 7f6c5b377700 1 Processor -- start 2023-10-03T10:16:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.404+0000 7f6c5b377700 1 -- start start 2023-10-03T10:16:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.405+0000 7f6c5b377700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c54130ba0 0x7f6c54070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.405+0000 7f6c5b377700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6c54136430 0x7f6c54138810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.405+0000 7f6c5b377700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c5409a530 con 0x7f6c541307d0 2023-10-03T10:16:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.405+0000 7f6c5b377700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c5409fe50 con 0x7f6c54136430 2023-10-03T10:16:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.405+0000 7f6c5b377700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5409aad0 con 0x7f6c54130ba0 2023-10-03T10:16:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.405+0000 7f6c59914700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6c54136430 0x7f6c54138810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.405+0000 7f6c58912700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c54130ba0 0x7f6c54070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.405+0000 7f6c59914700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6c54136430 0x7f6c54138810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60976/0 (socket says 172.21.15.146:60976) 2023-10-03T10:16:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.405+0000 7f6c59914700 1 -- 172.21.15.146:0/20042463 learned_addr learned my addr 172.21.15.146:0/20042463 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.405+0000 7f6c59113700 1 --1- 172.21.15.146:0/20042463 >> v1:172.21.15.146:6789/0 conn(0x7f6c541307d0 0x7f6c54070280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36780/0 (socket says 172.21.15.146:36780) 2023-10-03T10:16:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.405+0000 7f6c58912700 1 -- 172.21.15.146:0/20042463 >> v2:172.21.15.146:3300/0 conn(0x7f6c54136430 msgr2=0x7f6c54138810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.405+0000 7f6c58912700 1 --2- 172.21.15.146:0/20042463 >> v2:172.21.15.146:3300/0 conn(0x7f6c54136430 0x7f6c54138810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.405+0000 7f6c4bfff700 1 -- 172.21.15.146:0/20042463 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4057858429 0 0) 0x7f6c5409a530 con 0x7f6c541307d0 2023-10-03T10:16:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.405+0000 7f6c58912700 1 -- 172.21.15.146:0/20042463 >> v1:172.21.15.146:6789/0 conn(0x7f6c541307d0 legacy=0x7f6c54070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.405+0000 7f6c58912700 1 -- 172.21.15.146:0/20042463 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c54130180 con 0x7f6c54130ba0 2023-10-03T10:16:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.405+0000 7f6c58912700 1 --2- 172.21.15.146:0/20042463 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c54130ba0 0x7f6c54070990 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009840 tx=0x7f6c44009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9add41797c788404 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.406+0000 7f6c4bfff700 1 -- 172.21.15.146:0/20042463 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4400f8a0 con 0x7f6c54130ba0 2023-10-03T10:16:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.406+0000 7f6c4bfff700 1 -- 172.21.15.146:0/20042463 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4400fa00 con 0x7f6c54130ba0 2023-10-03T10:16:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.406+0000 7f6c4bfff700 1 -- 172.21.15.146:0/20042463 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4400fd90 con 0x7f6c54130ba0 2023-10-03T10:16:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.407+0000 7f6c5b377700 1 -- 172.21.15.146:0/20042463 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c54130ba0 msgr2=0x7f6c54070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.407+0000 7f6c5b377700 1 --2- 172.21.15.146:0/20042463 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c54130ba0 0x7f6c54070990 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009840 tx=0x7f6c44009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.407+0000 7f6c5b377700 1 -- 172.21.15.146:0/20042463 shutdown_connections 2023-10-03T10:16:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.407+0000 7f6c5b377700 1 --2- 172.21.15.146:0/20042463 >> v2:172.21.15.146:3300/0 conn(0x7f6c54136430 0x7f6c54138810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.407+0000 7f6c5b377700 1 --2- 172.21.15.146:0/20042463 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c54130ba0 0x7f6c54070990 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.407+0000 7f6c5b377700 1 -- 172.21.15.146:0/20042463 >> 172.21.15.146:0/20042463 conn(0x7f6c540a2810 msgr2=0x7f6c540a2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.407+0000 7f6c5b377700 1 -- 172.21.15.146:0/20042463 shutdown_connections 2023-10-03T10:16:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.407+0000 7f6c5b377700 1 -- 172.21.15.146:0/20042463 wait complete. 2023-10-03T10:16:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.408+0000 7f9aef7fe700 1 -- 172.21.15.146:0/2732867572 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9afc0133c0 con 0x7f9b0806b080 2023-10-03T10:16:02.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.408+0000 7f6c5b377700 1 Processor -- start 2023-10-03T10:16:02.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.408+0000 7f6c5b377700 1 -- start start 2023-10-03T10:16:02.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.409+0000 7f6c5b377700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c541307d0 0x7f6c54118c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.409+0000 7f6c5b377700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c54130ba0 0x7f6c541191c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.409+0000 7f6c5b377700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c54136430 0x7f6c54119700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.409+0000 7f6c5b377700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5411c6d0 con 0x7f6c54136430 2023-10-03T10:16:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.409+0000 7f6c5b377700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5411ad70 con 0x7f6c54130ba0 2023-10-03T10:16:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.409+0000 7f6c5b377700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54099cc0 con 0x7f6c541307d0 2023-10-03T10:16:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.409+0000 7f6c59113700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c541307d0 0x7f6c54118c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.409+0000 7f6c59113700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c541307d0 0x7f6c54118c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57766/0 (socket says 172.21.15.146:57766) 2023-10-03T10:16:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.409+0000 7f6c59113700 1 -- 172.21.15.146:0/2532023022 learned_addr learned my addr 172.21.15.146:0/2532023022 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.409+0000 7f6c59914700 1 --2- 172.21.15.146:0/2532023022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c54136430 0x7f6c54119700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.410+0000 7f6c59113700 1 -- 172.21.15.146:0/2532023022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c54130ba0 msgr2=0x7f6c541191c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:16:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.410+0000 7f6c59113700 1 --2- 172.21.15.146:0/2532023022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c54130ba0 0x7f6c541191c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.410+0000 7f6c59113700 1 -- 172.21.15.146:0/2532023022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c54136430 msgr2=0x7f6c54119700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.410+0000 7f6c59113700 1 --2- 172.21.15.146:0/2532023022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c54136430 0x7f6c54119700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.410+0000 7f6c59113700 1 -- 172.21.15.146:0/2532023022 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c440094a0 con 0x7f6c541307d0 2023-10-03T10:16:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.410+0000 7f6c59113700 1 --2- 172.21.15.146:0/2532023022 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c541307d0 0x7f6c54118c80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6c5000c550 tx=0x7f6c5000c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.410+0000 7f6c49ffb700 1 -- 172.21.15.146:0/2532023022 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c50004c80 con 0x7f6c541307d0 2023-10-03T10:16:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.410+0000 7f6c49ffb700 1 -- 172.21.15.146:0/2532023022 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c50004de0 con 0x7f6c541307d0 2023-10-03T10:16:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.410+0000 7f6c5b377700 1 -- 172.21.15.146:0/2532023022 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c540a0e70 con 0x7f6c541307d0 2023-10-03T10:16:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.410+0000 7f6c49ffb700 1 -- 172.21.15.146:0/2532023022 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c50007310 con 0x7f6c541307d0 2023-10-03T10:16:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.410+0000 7f6c5b377700 1 -- 172.21.15.146:0/2532023022 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c5411c350 con 0x7f6c541307d0 2023-10-03T10:16:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.411+0000 7f6c49ffb700 1 -- 172.21.15.146:0/2532023022 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c50007470 con 0x7f6c541307d0 2023-10-03T10:16:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.411+0000 7f6c49ffb700 1 -- 172.21.15.146:0/2532023022 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6c5003f430 con 0x7f6c541307d0 2023-10-03T10:16:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.412+0000 7f6c5b377700 1 -- 172.21.15.146:0/2532023022 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c5404f2a0 con 0x7f6c541307d0 2023-10-03T10:16:02.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.421+0000 7f6c49ffb700 1 -- 172.21.15.146:0/2532023022 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c500123b0 con 0x7f6c541307d0 2023-10-03T10:16:02.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.579+0000 7f086632f700 1 -- 172.21.15.146:0/1030575309 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0860072480 con 0x7f0860099e20 2023-10-03T10:16:02.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.579+0000 7f085cff9700 1 -- 172.21.15.146:0/1030575309 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0860072480 con 0x7f0860099e20 2023-10-03T10:16:02.579 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:02.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.582+0000 7f086632f700 1 -- 172.21.15.146:0/1030575309 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0860099e20 msgr2=0x7f086013be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.582+0000 7f086632f700 1 --2- 172.21.15.146:0/1030575309 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0860099e20 0x7f086013be20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f085000e870 tx=0x7f085000eb80 comp rx=0 tx=0).stop 2023-10-03T10:16:02.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.583+0000 7f086632f700 1 -- 172.21.15.146:0/1030575309 shutdown_connections 2023-10-03T10:16:02.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.583+0000 7f086632f700 1 --2- 172.21.15.146:0/1030575309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0860130a60 0x7f086013c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.583+0000 7f086632f700 1 --2- 172.21.15.146:0/1030575309 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0860099e20 0x7f086013be20 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.583+0000 7f086632f700 1 --2- 172.21.15.146:0/1030575309 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f086009a730 0x7f086013c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.583+0000 7f086632f700 1 -- 172.21.15.146:0/1030575309 >> 172.21.15.146:0/1030575309 conn(0x7f08600a2980 msgr2=0x7f086009f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.583+0000 7f086632f700 1 -- 172.21.15.146:0/1030575309 shutdown_connections 2023-10-03T10:16:02.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.583+0000 7f086632f700 1 -- 172.21.15.146:0/1030575309 wait complete. 2023-10-03T10:16:02.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.593+0000 7f7c17117700 1 -- 172.21.15.146:0/2451361682 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7c1004f2a0 con 0x7f7c1009e870 2023-10-03T10:16:02.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.594+0000 7f7c0d7fa700 1 -- 172.21.15.146:0/2451361682 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7c04021070 con 0x7f7c1009e870 2023-10-03T10:16:02.593 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:02.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.596+0000 7f7c17117700 1 -- 172.21.15.146:0/2451361682 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c1009e870 msgr2=0x7f7c1011f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.596+0000 7f7c17117700 1 --2- 172.21.15.146:0/2451361682 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c1009e870 0x7f7c1011f0a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400e810 tx=0x7f7c0400eb20 comp rx=0 tx=0).stop 2023-10-03T10:16:02.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.596+0000 7f7c17117700 1 -- 172.21.15.146:0/2451361682 shutdown_connections 2023-10-03T10:16:02.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.596+0000 7f7c17117700 1 --2- 172.21.15.146:0/2451361682 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c10131d70 0x7f7c1011fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.596+0000 7f7c17117700 1 --2- 172.21.15.146:0/2451361682 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c1009e870 0x7f7c1011f0a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.596+0000 7f7c17117700 1 --2- 172.21.15.146:0/2451361682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c1009f180 0x7f7c1011f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.596+0000 7f7c17117700 1 -- 172.21.15.146:0/2451361682 >> 172.21.15.146:0/2451361682 conn(0x7f7c100a4430 msgr2=0x7f7c101310a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.596+0000 7f7c17117700 1 -- 172.21.15.146:0/2451361682 shutdown_connections 2023-10-03T10:16:02.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.596+0000 7f7c17117700 1 -- 172.21.15.146:0/2451361682 wait complete. 2023-10-03T10:16:02.599 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:02.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:02.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.613+0000 7f9b0d386700 1 -- 172.21.15.146:0/2732867572 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9b0804f2a0 con 0x7f9b0806b080 2023-10-03T10:16:02.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.614+0000 7f9aef7fe700 1 -- 172.21.15.146:0/2732867572 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9afc01a2b0 con 0x7f9b0806b080 2023-10-03T10:16:02.614 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:02.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.616+0000 7f9b0d386700 1 -- 172.21.15.146:0/2732867572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b0806b080 msgr2=0x7f9b081c63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.616+0000 7f9b0d386700 1 --2- 172.21.15.146:0/2732867572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b0806b080 0x7f9b081c63e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00c750 tx=0x7f9afc00ca60 comp rx=0 tx=0).stop 2023-10-03T10:16:02.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.616+0000 7f9b0d386700 1 -- 172.21.15.146:0/2732867572 shutdown_connections 2023-10-03T10:16:02.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.616+0000 7f9b0d386700 1 --2- 172.21.15.146:0/2732867572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b08131ec0 0x7f9b081c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.616+0000 7f9b0d386700 1 --2- 172.21.15.146:0/2732867572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b0806a770 0x7f9b081c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.616+0000 7f9b0d386700 1 --2- 172.21.15.146:0/2732867572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b0806b080 0x7f9b081c63e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.616+0000 7f9b0d386700 1 -- 172.21.15.146:0/2732867572 >> 172.21.15.146:0/2732867572 conn(0x7f9b08099c40 msgr2=0x7f9b080a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.616+0000 7f9b0d386700 1 -- 172.21.15.146:0/2732867572 shutdown_connections 2023-10-03T10:16:02.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.616+0000 7f9b0d386700 1 -- 172.21.15.146:0/2732867572 wait complete. 2023-10-03T10:16:02.627 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:02.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.641+0000 7f6c5b377700 1 -- 172.21.15.146:0/2532023022 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6c540a3010 con 0x7f6c541307d0 2023-10-03T10:16:02.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.642+0000 7f6c49ffb700 1 -- 172.21.15.146:0/2532023022 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c50011360 con 0x7f6c541307d0 2023-10-03T10:16:02.641 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:02.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.644+0000 7f6c5b377700 1 -- 172.21.15.146:0/2532023022 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c541307d0 msgr2=0x7f6c54118c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.644+0000 7f6c5b377700 1 --2- 172.21.15.146:0/2532023022 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c541307d0 0x7f6c54118c80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6c5000c550 tx=0x7f6c5000c910 comp rx=0 tx=0).stop 2023-10-03T10:16:02.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.644+0000 7f6c5b377700 1 -- 172.21.15.146:0/2532023022 shutdown_connections 2023-10-03T10:16:02.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.644+0000 7f6c5b377700 1 --2- 172.21.15.146:0/2532023022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c54136430 0x7f6c54119700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.644+0000 7f6c5b377700 1 --2- 172.21.15.146:0/2532023022 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c541307d0 0x7f6c54118c80 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.644+0000 7f6c5b377700 1 --2- 172.21.15.146:0/2532023022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c54130ba0 0x7f6c541191c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.644+0000 7f6c5b377700 1 -- 172.21.15.146:0/2532023022 >> 172.21.15.146:0/2532023022 conn(0x7f6c540a2810 msgr2=0x7f6c54070210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.644+0000 7f6c5b377700 1 -- 172.21.15.146:0/2532023022 shutdown_connections 2023-10-03T10:16:02.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:02.644+0000 7f6c5b377700 1 -- 172.21.15.146:0/2532023022 wait complete. 2023-10-03T10:16:02.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:03.601 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:03.609 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:03.629 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:03.657 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:03.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.750+0000 7f82c3614700 1 Processor -- start 2023-10-03T10:16:03.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.750+0000 7f82c3614700 1 -- start start 2023-10-03T10:16:03.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.750+0000 7f82c3614700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f82bc133ad0 0x7f82bc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.751+0000 7f82c3614700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82bc1300a0 0x7f82bc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.751+0000 7f82c3614700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82bc06b2d0 con 0x7f82bc1309f0 2023-10-03T10:16:03.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.751+0000 7f82c3614700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82bc133610 con 0x7f82bc133ad0 2023-10-03T10:16:03.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.751+0000 7f82c3614700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc09a500 con 0x7f82bc1300a0 2023-10-03T10:16:03.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.751+0000 7f82c13b0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f82bc133ad0 0x7f82bc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.751+0000 7f82c1bb1700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f82bc1309f0 0x7f82bc13a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36794/0 (socket says 172.21.15.146:36794) 2023-10-03T10:16:03.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.751+0000 7f82c13b0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f82bc133ad0 0x7f82bc133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32768/0 (socket says 172.21.15.146:32768) 2023-10-03T10:16:03.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.751+0000 7f82c1bb1700 1 -- 172.21.15.146:0/1141306144 learned_addr learned my addr 172.21.15.146:0/1141306144 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:03.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.751+0000 7f82c0baf700 1 --2- 172.21.15.146:0/1141306144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82bc1300a0 0x7f82bc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.751+0000 7f82c13b0700 1 -- 172.21.15.146:0/1141306144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82bc1300a0 msgr2=0x7f82bc1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.751+0000 7f82c13b0700 1 --2- 172.21.15.146:0/1141306144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82bc1300a0 0x7f82bc1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.751+0000 7f82c13b0700 1 -- 172.21.15.146:0/1141306144 >> v1:172.21.15.146:6789/0 conn(0x7f82bc1309f0 legacy=0x7f82bc13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.751+0000 7f82c13b0700 1 -- 172.21.15.146:0/1141306144 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc1338b0 con 0x7f82bc133ad0 2023-10-03T10:16:03.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.751+0000 7f82c13b0700 1 --2- 172.21.15.146:0/1141306144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82bc133ad0 0x7f82bc133ea0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009840 tx=0x7f82b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363b42580014f05d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.751+0000 7f82b3fff700 1 -- 172.21.15.146:0/1141306144 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8011830 con 0x7f82bc133ad0 2023-10-03T10:16:03.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.752+0000 7f82b3fff700 1 -- 172.21.15.146:0/1141306144 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b8011990 con 0x7f82bc133ad0 2023-10-03T10:16:03.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.752+0000 7f82b3fff700 1 -- 172.21.15.146:0/1141306144 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8011d20 con 0x7f82bc133ad0 2023-10-03T10:16:03.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.752+0000 7f82c3614700 1 -- 172.21.15.146:0/1141306144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82bc133ad0 msgr2=0x7f82bc133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.752+0000 7f82c3614700 1 --2- 172.21.15.146:0/1141306144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82bc133ad0 0x7f82bc133ea0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009840 tx=0x7f82b8009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:03.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.752+0000 7f82c3614700 1 -- 172.21.15.146:0/1141306144 shutdown_connections 2023-10-03T10:16:03.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.752+0000 7f82c3614700 1 --2- 172.21.15.146:0/1141306144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82bc133ad0 0x7f82bc133ea0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.752+0000 7f82c3614700 1 --2- 172.21.15.146:0/1141306144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82bc1300a0 0x7f82bc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.752+0000 7f82c3614700 1 -- 172.21.15.146:0/1141306144 >> 172.21.15.146:0/1141306144 conn(0x7f82bc099c40 msgr2=0x7f82bc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.752+0000 7f82c3614700 1 -- 172.21.15.146:0/1141306144 shutdown_connections 2023-10-03T10:16:03.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.753+0000 7f82c3614700 1 -- 172.21.15.146:0/1141306144 wait complete. 2023-10-03T10:16:03.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.753+0000 7f82c3614700 1 Processor -- start 2023-10-03T10:16:03.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.753+0000 7f82c3614700 1 -- start start 2023-10-03T10:16:03.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.754+0000 7f82c3614700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82bc1300a0 0x7f82bc11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.754+0000 7f82c3614700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82bc1309f0 0x7f82bc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.754+0000 7f82c3614700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82bc133ad0 0x7f82bc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.754+0000 7f82c3614700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc11ff70 con 0x7f82bc1309f0 2023-10-03T10:16:03.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.754+0000 7f82c3614700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc072160 con 0x7f82bc1300a0 2023-10-03T10:16:03.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.754+0000 7f82c3614700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc11fc10 con 0x7f82bc133ad0 2023-10-03T10:16:03.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.754+0000 7f82c0baf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82bc1309f0 0x7f82bc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.754+0000 7f82c0baf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82bc1309f0 0x7f82bc11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32776/0 (socket says 172.21.15.146:32776) 2023-10-03T10:16:03.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.754+0000 7f82c0baf700 1 -- 172.21.15.146:0/175699557 learned_addr learned my addr 172.21.15.146:0/175699557 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:03.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.754+0000 7f82c13b0700 1 --2- 172.21.15.146:0/175699557 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82bc1300a0 0x7f82bc11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.754+0000 7f82c0baf700 1 -- 172.21.15.146:0/175699557 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82bc133ad0 msgr2=0x7f82bc11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.754+0000 7f82c0baf700 1 --2- 172.21.15.146:0/175699557 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82bc133ad0 0x7f82bc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.754+0000 7f82c0baf700 1 -- 172.21.15.146:0/175699557 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82bc1300a0 msgr2=0x7f82bc11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.754+0000 7f82c0baf700 1 --2- 172.21.15.146:0/175699557 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82bc1300a0 0x7f82bc11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.754+0000 7f82c0baf700 1 -- 172.21.15.146:0/175699557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b80094a0 con 0x7f82bc1309f0 2023-10-03T10:16:03.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.754+0000 7f82c13b0700 1 --2- 172.21.15.146:0/175699557 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82bc1300a0 0x7f82bc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:03.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.755+0000 7f82c0baf700 1 --2- 172.21.15.146:0/175699557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82bc1309f0 0x7f82bc11df80 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f82ac00e8a0 tx=0x7f82ac00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.755+0000 7f82b1ffb700 1 -- 172.21.15.146:0/175699557 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac009590 con 0x7f82bc1309f0 2023-10-03T10:16:03.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.755+0000 7f82b1ffb700 1 -- 172.21.15.146:0/175699557 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ac00eea0 con 0x7f82bc1309f0 2023-10-03T10:16:03.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.755+0000 7f82c3614700 1 -- 172.21.15.146:0/175699557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82bc12d220 con 0x7f82bc1309f0 2023-10-03T10:16:03.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.755+0000 7f82b1ffb700 1 -- 172.21.15.146:0/175699557 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac00ca50 con 0x7f82bc1309f0 2023-10-03T10:16:03.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.755+0000 7f82c3614700 1 -- 172.21.15.146:0/175699557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82bc12dd00 con 0x7f82bc1309f0 2023-10-03T10:16:03.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.756+0000 7f82c3614700 1 -- 172.21.15.146:0/175699557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82bc04f2a0 con 0x7f82bc1309f0 2023-10-03T10:16:03.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.757+0000 7f82b1ffb700 1 -- 172.21.15.146:0/175699557 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82ac00cbb0 con 0x7f82bc1309f0 2023-10-03T10:16:03.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.757+0000 7f82b1ffb700 1 -- 172.21.15.146:0/175699557 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f82ac03fff0 con 0x7f82bc1309f0 2023-10-03T10:16:03.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.765+0000 7f82b1ffb700 1 -- 172.21.15.146:0/175699557 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82ac01a360 con 0x7f82bc1309f0 2023-10-03T10:16:03.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.788+0000 7f9795e8a700 1 Processor -- start 2023-10-03T10:16:03.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.789+0000 7f9795e8a700 1 -- start start 2023-10-03T10:16:03.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.789+0000 7f9795e8a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f979009e950 0x7f979009ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.789+0000 7f9795e8a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9790131fa0 0x7f9790139af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.789+0000 7f9795e8a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979009afb0 con 0x7f979009f260 2023-10-03T10:16:03.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.789+0000 7f9795e8a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97900a0970 con 0x7f979009e950 2023-10-03T10:16:03.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.789+0000 7f9795e8a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97900a0320 con 0x7f9790131fa0 2023-10-03T10:16:03.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.789+0000 7f978f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f979009e950 0x7f979009ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.789+0000 7f978effd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f979009f260 0x7f9790131890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36804/0 (socket says 172.21.15.146:36804) 2023-10-03T10:16:03.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.789+0000 7f978effd700 1 -- 172.21.15.146:0/743717549 learned_addr learned my addr 172.21.15.146:0/743717549 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:03.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.790+0000 7f978ffff700 1 --2- 172.21.15.146:0/743717549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9790131fa0 0x7f9790139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.790+0000 7f978f7fe700 1 -- 172.21.15.146:0/743717549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9790131fa0 msgr2=0x7f9790139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.790+0000 7f978f7fe700 1 --2- 172.21.15.146:0/743717549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9790131fa0 0x7f9790139af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.790+0000 7f978f7fe700 1 -- 172.21.15.146:0/743717549 >> v1:172.21.15.146:6789/0 conn(0x7f979009f260 legacy=0x7f9790131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.790+0000 7f978f7fe700 1 -- 172.21.15.146:0/743717549 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97900a0750 con 0x7f979009e950 2023-10-03T10:16:03.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.790+0000 7f978f7fe700 1 --2- 172.21.15.146:0/743717549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f979009e950 0x7f979009ed20 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f9780009820 tx=0x7f9780009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706b137749ee967 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.790+0000 7f978e7fc700 1 -- 172.21.15.146:0/743717549 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780005e30 con 0x7f979009e950 2023-10-03T10:16:03.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.790+0000 7f978e7fc700 1 -- 172.21.15.146:0/743717549 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9780006030 con 0x7f979009e950 2023-10-03T10:16:03.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.790+0000 7f978e7fc700 1 -- 172.21.15.146:0/743717549 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97800063e0 con 0x7f979009e950 2023-10-03T10:16:03.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.791+0000 7f9795e8a700 1 -- 172.21.15.146:0/743717549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f979009e950 msgr2=0x7f979009ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.791+0000 7f9795e8a700 1 --2- 172.21.15.146:0/743717549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f979009e950 0x7f979009ed20 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f9780009820 tx=0x7f9780009b30 comp rx=0 tx=0).stop 2023-10-03T10:16:03.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.791+0000 7f9795e8a700 1 -- 172.21.15.146:0/743717549 shutdown_connections 2023-10-03T10:16:03.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.791+0000 7f9795e8a700 1 --2- 172.21.15.146:0/743717549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9790131fa0 0x7f9790139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.791+0000 7f9795e8a700 1 --2- 172.21.15.146:0/743717549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f979009e950 0x7f979009ed20 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.791+0000 7f9795e8a700 1 -- 172.21.15.146:0/743717549 >> 172.21.15.146:0/743717549 conn(0x7f97900a0f70 msgr2=0x7f97900a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.791+0000 7f9795e8a700 1 -- 172.21.15.146:0/743717549 shutdown_connections 2023-10-03T10:16:03.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.791+0000 7f9795e8a700 1 -- 172.21.15.146:0/743717549 wait complete. 2023-10-03T10:16:03.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.792+0000 7f9795e8a700 1 Processor -- start 2023-10-03T10:16:03.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.792+0000 7f9795e8a700 1 -- start start 2023-10-03T10:16:03.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.792+0000 7f9795e8a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f979009e950 0x7f979011e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.792+0000 7f9795e8a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f979009f260 0x7f979011eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.792+0000 7f9795e8a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9790131fa0 0x7f979011f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.792+0000 7f9795e8a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979011faf0 con 0x7f979009f260 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.792+0000 7f9795e8a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979009da00 con 0x7f9790131fa0 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.792+0000 7f9795e8a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9790122140 con 0x7f979009e950 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.793+0000 7f978effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f979009f260 0x7f979011eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.793+0000 7f978effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f979009f260 0x7f979011eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32802/0 (socket says 172.21.15.146:32802) 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.793+0000 7f978effd700 1 -- 172.21.15.146:0/931573065 learned_addr learned my addr 172.21.15.146:0/931573065 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.793+0000 7f978ffff700 1 --2- 172.21.15.146:0/931573065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9790131fa0 0x7f979011f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.793+0000 7f978f7fe700 1 --2- 172.21.15.146:0/931573065 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f979009e950 0x7f979011e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.793+0000 7f978ffff700 1 -- 172.21.15.146:0/931573065 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f979009e950 msgr2=0x7f979011e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.793+0000 7f978ffff700 1 --2- 172.21.15.146:0/931573065 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f979009e950 0x7f979011e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.793+0000 7f978ffff700 1 -- 172.21.15.146:0/931573065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f979009f260 msgr2=0x7f979011eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.793+0000 7f978ffff700 1 --2- 172.21.15.146:0/931573065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f979009f260 0x7f979011eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.793+0000 7f978ffff700 1 -- 172.21.15.146:0/931573065 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9780009430 con 0x7f9790131fa0 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.793+0000 7f978effd700 1 --2- 172.21.15.146:0/931573065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f979009f260 0x7f979011eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.793+0000 7f978ffff700 1 --2- 172.21.15.146:0/931573065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9790131fa0 0x7f979011f0a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9788007d90 tx=0x7f978800e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.793+0000 7f9777fff700 1 -- 172.21.15.146:0/931573065 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9788018070 con 0x7f9790131fa0 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.793+0000 7f9777fff700 1 -- 172.21.15.146:0/931573065 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978800eb30 con 0x7f9790131fa0 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.794+0000 7f9795e8a700 1 -- 172.21.15.146:0/931573065 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9790120290 con 0x7f9790131fa0 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.794+0000 7f9795e8a700 1 -- 172.21.15.146:0/931573065 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9790131590 con 0x7f9790131fa0 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.794+0000 7f9777fff700 1 -- 172.21.15.146:0/931573065 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9788003a20 con 0x7f9790131fa0 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.795+0000 7f9777fff700 1 -- 172.21.15.146:0/931573065 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9788014420 con 0x7f9790131fa0 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.795+0000 7f9795e8a700 1 -- 172.21.15.146:0/931573065 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97700052e0 con 0x7f9790131fa0 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.795+0000 7f9777fff700 1 -- 172.21.15.146:0/931573065 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f978803f4a0 con 0x7f9790131fa0 2023-10-03T10:16:03.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.798+0000 7fa3e9bea700 1 Processor -- start 2023-10-03T10:16:03.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.798+0000 7fa3e9bea700 1 -- start start 2023-10-03T10:16:03.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.798+0000 7fa3e9bea700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e4138410 0x7fa3e40a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.798+0000 7fa3e9bea700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa3e413dd10 0x7fa3e41400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.798+0000 7fa3e9bea700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e41379e0 con 0x7fa3e4138040 2023-10-03T10:16:03.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.798+0000 7fa3e9bea700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e40a2100 con 0x7fa3e413dd10 2023-10-03T10:16:03.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.798+0000 7fa3e9bea700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e409b9b0 con 0x7fa3e4138410 2023-10-03T10:16:03.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.799+0000 7fa3e2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e4138410 0x7fa3e40a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.799+0000 7fa3e2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e4138410 0x7fa3e40a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57788/0 (socket says 172.21.15.146:57788) 2023-10-03T10:16:03.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.799+0000 7fa3e2ffd700 1 -- 172.21.15.146:0/4239372855 learned_addr learned my addr 172.21.15.146:0/4239372855 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:03.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.799+0000 7fa3e2ffd700 1 -- 172.21.15.146:0/4239372855 >> v2:172.21.15.146:3300/0 conn(0x7fa3e413dd10 msgr2=0x7fa3e41400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.799+0000 7fa3e2ffd700 1 --2- 172.21.15.146:0/4239372855 >> v2:172.21.15.146:3300/0 conn(0x7fa3e413dd10 0x7fa3e41400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.799+0000 7fa3e2ffd700 1 -- 172.21.15.146:0/4239372855 >> v1:172.21.15.146:6789/0 conn(0x7fa3e4138040 legacy=0x7fa3e40a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.799+0000 7fa3e2ffd700 1 -- 172.21.15.146:0/4239372855 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e4137c10 con 0x7fa3e4138410 2023-10-03T10:16:03.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.799+0000 7fa3e2ffd700 1 --2- 172.21.15.146:0/4239372855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e4138410 0x7fa3e40a0ff0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009920 tx=0x7fa3d8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b79cd89b5630f8fb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.799+0000 7fa3e27fc700 1 -- 172.21.15.146:0/4239372855 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8004230 con 0x7fa3e4138410 2023-10-03T10:16:03.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.799+0000 7fa3e27fc700 1 -- 172.21.15.146:0/4239372855 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d8004390 con 0x7fa3e4138410 2023-10-03T10:16:03.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.799+0000 7fa3e27fc700 1 -- 172.21.15.146:0/4239372855 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8009e70 con 0x7fa3e4138410 2023-10-03T10:16:03.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.800+0000 7fa3e9bea700 1 -- 172.21.15.146:0/4239372855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e4138410 msgr2=0x7fa3e40a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.800+0000 7fa3e9bea700 1 --2- 172.21.15.146:0/4239372855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e4138410 0x7fa3e40a0ff0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009920 tx=0x7fa3d8009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:03.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.800+0000 7fa3e9bea700 1 -- 172.21.15.146:0/4239372855 shutdown_connections 2023-10-03T10:16:03.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.800+0000 7fa3e9bea700 1 --2- 172.21.15.146:0/4239372855 >> v2:172.21.15.146:3300/0 conn(0x7fa3e413dd10 0x7fa3e41400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.800+0000 7fa3e9bea700 1 --2- 172.21.15.146:0/4239372855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e4138410 0x7fa3e40a0ff0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.800+0000 7fa3e9bea700 1 -- 172.21.15.146:0/4239372855 >> 172.21.15.146:0/4239372855 conn(0x7fa3e40a2980 msgr2=0x7fa3e40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.800+0000 7fa3e9bea700 1 -- 172.21.15.146:0/4239372855 shutdown_connections 2023-10-03T10:16:03.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.800+0000 7fa3e9bea700 1 -- 172.21.15.146:0/4239372855 wait complete. 2023-10-03T10:16:03.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.801+0000 7fa3e9bea700 1 Processor -- start 2023-10-03T10:16:03.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.801+0000 7fa3e9bea700 1 -- start start 2023-10-03T10:16:03.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.802+0000 7fa3e9bea700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e4138040 0x7fa3e413b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.802+0000 7fa3e9bea700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3e4138410 0x7fa3e4135ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.802+0000 7fa3e9bea700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3e413dd10 0x7fa3e4136000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.802+0000 7fa3e9bea700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e4130200 con 0x7fa3e413dd10 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.802+0000 7fa3e9bea700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e413c380 con 0x7fa3e4138410 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.802+0000 7fa3e9bea700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e413d640 con 0x7fa3e4138040 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.802+0000 7fa3e37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e4138040 0x7fa3e413b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.802+0000 7fa3e37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e4138040 0x7fa3e413b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57792/0 (socket says 172.21.15.146:57792) 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.802+0000 7fa3e37fe700 1 -- 172.21.15.146:0/3131140749 learned_addr learned my addr 172.21.15.146:0/3131140749 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.802+0000 7fa3e3fff700 1 --2- 172.21.15.146:0/3131140749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3e413dd10 0x7fa3e4136000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.803+0000 7fa3e2ffd700 1 --2- 172.21.15.146:0/3131140749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3e4138410 0x7fa3e4135ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.803+0000 7fa3e37fe700 1 -- 172.21.15.146:0/3131140749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3e4138410 msgr2=0x7fa3e4135ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.803+0000 7fa3e37fe700 1 --2- 172.21.15.146:0/3131140749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3e4138410 0x7fa3e4135ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.803+0000 7fa3e37fe700 1 -- 172.21.15.146:0/3131140749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3e413dd10 msgr2=0x7fa3e4136000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.803+0000 7fa3e37fe700 1 --2- 172.21.15.146:0/3131140749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3e413dd10 0x7fa3e4136000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.803+0000 7fa3e37fe700 1 -- 172.21.15.146:0/3131140749 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d8009550 con 0x7fa3e4138040 2023-10-03T10:16:03.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.803+0000 7fa3e37fe700 1 --2- 172.21.15.146:0/3131140749 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e4138040 0x7fa3e413b810 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400c450 tx=0x7fa3d400c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.803+0000 7fa3cbfff700 1 -- 172.21.15.146:0/3131140749 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d40052e0 con 0x7fa3e4138040 2023-10-03T10:16:03.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.803+0000 7fa3cbfff700 1 -- 172.21.15.146:0/3131140749 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d4005460 con 0x7fa3e4138040 2023-10-03T10:16:03.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.803+0000 7fa3cbfff700 1 -- 172.21.15.146:0/3131140749 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d40038c0 con 0x7fa3e4138040 2023-10-03T10:16:03.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.803+0000 7fa3e9bea700 1 -- 172.21.15.146:0/3131140749 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e4119510 con 0x7fa3e4138040 2023-10-03T10:16:03.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.803+0000 7fa3e9bea700 1 -- 172.21.15.146:0/3131140749 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e413da90 con 0x7fa3e4138040 2023-10-03T10:16:03.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.804+0000 7f9777fff700 1 -- 172.21.15.146:0/931573065 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97880128d0 con 0x7f9790131fa0 2023-10-03T10:16:03.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.805+0000 7fa3e9bea700 1 -- 172.21.15.146:0/3131140749 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e404f2a0 con 0x7fa3e4138040 2023-10-03T10:16:03.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.805+0000 7fa3cbfff700 1 -- 172.21.15.146:0/3131140749 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa3d4003a20 con 0x7fa3e4138040 2023-10-03T10:16:03.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.805+0000 7fa3cbfff700 1 -- 172.21.15.146:0/3131140749 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa3d403e540 con 0x7fa3e4138040 2023-10-03T10:16:03.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.817+0000 7fa3cbfff700 1 -- 172.21.15.146:0/3131140749 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3d4018af0 con 0x7fa3e4138040 2023-10-03T10:16:03.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.821+0000 7f66a1078700 1 Processor -- start 2023-10-03T10:16:03.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.821+0000 7f66a1078700 1 -- start start 2023-10-03T10:16:03.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.822+0000 7f66a1078700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f669c0a0a70 0x7f669c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.822+0000 7f66a1078700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f669c0a1380 0x7f669c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.822+0000 7f66a1078700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f669c133f50 0x7f669c1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.822+0000 7f66a1078700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669c09e9d0 con 0x7f669c133f50 2023-10-03T10:16:03.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.822+0000 7f66a1078700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c09dc00 con 0x7f669c0a1380 2023-10-03T10:16:03.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.822+0000 7f66a1078700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f669c09dec0 con 0x7f669c0a0a70 2023-10-03T10:16:03.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.822+0000 7f669b59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f669c133f50 0x7f669c1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.822+0000 7f669ad9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f669c0a0a70 0x7f669c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.822+0000 7f669b59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f669c133f50 0x7f669c1343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32814/0 (socket says 172.21.15.146:32814) 2023-10-03T10:16:03.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.822+0000 7f669b59e700 1 -- 172.21.15.146:0/3643761093 learned_addr learned my addr 172.21.15.146:0/3643761093 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:03.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.822+0000 7f669a59c700 1 --2- 172.21.15.146:0/3643761093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f669c0a1380 0x7f669c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.822+0000 7f669b59e700 1 -- 172.21.15.146:0/3643761093 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f669c0a0a70 msgr2=0x7f669c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.822+0000 7f669b59e700 1 --2- 172.21.15.146:0/3643761093 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f669c0a0a70 0x7f669c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.822+0000 7f669b59e700 1 -- 172.21.15.146:0/3643761093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f669c0a1380 msgr2=0x7f669c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.822+0000 7f669b59e700 1 --2- 172.21.15.146:0/3643761093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f669c0a1380 0x7f669c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.822+0000 7f669b59e700 1 -- 172.21.15.146:0/3643761093 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c09e6a0 con 0x7f669c133f50 2023-10-03T10:16:03.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.822+0000 7f669b59e700 1 --2- 172.21.15.146:0/3643761093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f669c133f50 0x7f669c1343f0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f6694009e50 tx=0x7f669400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc803f9f5dc81a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.823+0000 7f6699d9b700 1 -- 172.21.15.146:0/3643761093 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400e070 con 0x7f669c133f50 2023-10-03T10:16:03.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.823+0000 7f6699d9b700 1 -- 172.21.15.146:0/3643761093 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669400b910 con 0x7f669c133f50 2023-10-03T10:16:03.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.823+0000 7f6699d9b700 1 -- 172.21.15.146:0/3643761093 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400bcc0 con 0x7f669c133f50 2023-10-03T10:16:03.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.823+0000 7f66a1078700 1 -- 172.21.15.146:0/3643761093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f669c133f50 msgr2=0x7f669c1343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.823+0000 7f66a1078700 1 --2- 172.21.15.146:0/3643761093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f669c133f50 0x7f669c1343f0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f6694009e50 tx=0x7f669400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:03.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.823+0000 7f66a1078700 1 -- 172.21.15.146:0/3643761093 shutdown_connections 2023-10-03T10:16:03.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.823+0000 7f66a1078700 1 --2- 172.21.15.146:0/3643761093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f669c133f50 0x7f669c1343f0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.823+0000 7f66a1078700 1 --2- 172.21.15.146:0/3643761093 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f669c0a0a70 0x7f669c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.823+0000 7f66a1078700 1 --2- 172.21.15.146:0/3643761093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f669c0a1380 0x7f669c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.823+0000 7f66a1078700 1 -- 172.21.15.146:0/3643761093 >> 172.21.15.146:0/3643761093 conn(0x7f669c0a6610 msgr2=0x7f669c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.823+0000 7f66a1078700 1 -- 172.21.15.146:0/3643761093 shutdown_connections 2023-10-03T10:16:03.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.823+0000 7f66a1078700 1 -- 172.21.15.146:0/3643761093 wait complete. 2023-10-03T10:16:03.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.825+0000 7f66a1078700 1 Processor -- start 2023-10-03T10:16:03.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.825+0000 7f66a1078700 1 -- start start 2023-10-03T10:16:03.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.825+0000 7f66a1078700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f669c0a0a70 0x7f669c1ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.825+0000 7f66a1078700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f669c0a1380 0x7f669c1cd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.825+0000 7f66a1078700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f669c133f50 0x7f669c06dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.825+0000 7f66a1078700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c1326b0 con 0x7f669c133f50 2023-10-03T10:16:03.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.825+0000 7f66a1078700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c0714e0 con 0x7f669c0a1380 2023-10-03T10:16:03.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.825+0000 7f66a1078700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f669c0a50b0 con 0x7f669c0a0a70 2023-10-03T10:16:03.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.825+0000 7f669b59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f669c133f50 0x7f669c06dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.825+0000 7f669b59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f669c133f50 0x7f669c06dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32826/0 (socket says 172.21.15.146:32826) 2023-10-03T10:16:03.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.825+0000 7f669b59e700 1 -- 172.21.15.146:0/1359676824 learned_addr learned my addr 172.21.15.146:0/1359676824 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:03.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.826+0000 7f669a59c700 1 --2- 172.21.15.146:0/1359676824 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f669c0a1380 0x7f669c1cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.826+0000 7f669ad9d700 1 --2- 172.21.15.146:0/1359676824 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f669c0a0a70 0x7f669c1ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.826+0000 7f669b59e700 1 -- 172.21.15.146:0/1359676824 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f669c0a0a70 msgr2=0x7f669c1ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.826+0000 7f669b59e700 1 --2- 172.21.15.146:0/1359676824 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f669c0a0a70 0x7f669c1ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.826+0000 7f669b59e700 1 -- 172.21.15.146:0/1359676824 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f669c0a1380 msgr2=0x7f669c1cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.826+0000 7f669b59e700 1 --2- 172.21.15.146:0/1359676824 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f669c0a1380 0x7f669c1cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.826+0000 7f669b59e700 1 -- 172.21.15.146:0/1359676824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6694009b30 con 0x7f669c133f50 2023-10-03T10:16:03.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.826+0000 7f669b59e700 1 --2- 172.21.15.146:0/1359676824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f669c133f50 0x7f669c06dac0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f669c09eb10 tx=0x7f6694004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.826+0000 7f66837fe700 1 -- 172.21.15.146:0/1359676824 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6694004450 con 0x7f669c133f50 2023-10-03T10:16:03.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.826+0000 7f66837fe700 1 -- 172.21.15.146:0/1359676824 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66940045b0 con 0x7f669c133f50 2023-10-03T10:16:03.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.826+0000 7f66a1078700 1 -- 172.21.15.146:0/1359676824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669c0a03e0 con 0x7f669c133f50 2023-10-03T10:16:03.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.826+0000 7f66837fe700 1 -- 172.21.15.146:0/1359676824 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6694004960 con 0x7f669c133f50 2023-10-03T10:16:03.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.826+0000 7f66a1078700 1 -- 172.21.15.146:0/1359676824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669c06fdc0 con 0x7f669c133f50 2023-10-03T10:16:03.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.827+0000 7f66837fe700 1 -- 172.21.15.146:0/1359676824 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6694025460 con 0x7f669c133f50 2023-10-03T10:16:03.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.827+0000 7f66a1078700 1 -- 172.21.15.146:0/1359676824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669c04f2a0 con 0x7f669c133f50 2023-10-03T10:16:03.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.828+0000 7f66837fe700 1 -- 172.21.15.146:0/1359676824 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f66940412d0 con 0x7f669c133f50 2023-10-03T10:16:03.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.837+0000 7f66837fe700 1 -- 172.21.15.146:0/1359676824 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f669401b7b0 con 0x7f669c133f50 2023-10-03T10:16:03.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.977+0000 7f82c3614700 1 -- 172.21.15.146:0/175699557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f82bc06c3b0 con 0x7f82bc1309f0 2023-10-03T10:16:03.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.977+0000 7f82b1ffb700 1 -- 172.21.15.146:0/175699557 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82ac017020 con 0x7f82bc1309f0 2023-10-03T10:16:03.977 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:03.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.979+0000 7f82c3614700 1 -- 172.21.15.146:0/175699557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82bc1309f0 msgr2=0x7f82bc11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.979+0000 7f82c3614700 1 --2- 172.21.15.146:0/175699557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82bc1309f0 0x7f82bc11df80 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f82ac00e8a0 tx=0x7f82ac00ec60 comp rx=0 tx=0).stop 2023-10-03T10:16:03.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.979+0000 7f82c3614700 1 -- 172.21.15.146:0/175699557 shutdown_connections 2023-10-03T10:16:03.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.979+0000 7f82c3614700 1 --2- 172.21.15.146:0/175699557 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82bc133ad0 0x7f82bc11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.979+0000 7f82c3614700 1 --2- 172.21.15.146:0/175699557 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82bc1300a0 0x7f82bc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.979+0000 7f82c3614700 1 --2- 172.21.15.146:0/175699557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82bc1309f0 0x7f82bc11df80 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.979+0000 7f82c3614700 1 -- 172.21.15.146:0/175699557 >> 172.21.15.146:0/175699557 conn(0x7f82bc099c40 msgr2=0x7f82bc12e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.980+0000 7f82c3614700 1 -- 172.21.15.146:0/175699557 shutdown_connections 2023-10-03T10:16:03.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:03.980+0000 7f82c3614700 1 -- 172.21.15.146:0/175699557 wait complete. 2023-10-03T10:16:03.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:04.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.006+0000 7f9795e8a700 1 -- 172.21.15.146:0/931573065 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9770005590 con 0x7f9790131fa0 2023-10-03T10:16:04.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.007+0000 7f9777fff700 1 -- 172.21.15.146:0/931573065 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9788009950 con 0x7f9790131fa0 2023-10-03T10:16:04.007 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:04.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.009+0000 7f9795e8a700 1 -- 172.21.15.146:0/931573065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9790131fa0 msgr2=0x7f979011f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.009+0000 7f9795e8a700 1 --2- 172.21.15.146:0/931573065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9790131fa0 0x7f979011f0a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9788007d90 tx=0x7f978800e3c0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.009+0000 7f9795e8a700 1 -- 172.21.15.146:0/931573065 shutdown_connections 2023-10-03T10:16:04.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.009+0000 7f9795e8a700 1 --2- 172.21.15.146:0/931573065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9790131fa0 0x7f979011f0a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.009+0000 7f9795e8a700 1 --2- 172.21.15.146:0/931573065 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f979009e950 0x7f979011e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.009+0000 7f9795e8a700 1 --2- 172.21.15.146:0/931573065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f979009f260 0x7f979011eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.009+0000 7f9795e8a700 1 -- 172.21.15.146:0/931573065 >> 172.21.15.146:0/931573065 conn(0x7f97900a0f70 msgr2=0x7f9790071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.009+0000 7f9795e8a700 1 -- 172.21.15.146:0/931573065 shutdown_connections 2023-10-03T10:16:04.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.009+0000 7f9795e8a700 1 -- 172.21.15.146:0/931573065 wait complete. 2023-10-03T10:16:04.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.017+0000 7fa3e9bea700 1 -- 172.21.15.146:0/3131140749 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa3e41413c0 con 0x7fa3e4138040 2023-10-03T10:16:04.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.017+0000 7fa3cbfff700 1 -- 172.21.15.146:0/3131140749 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa3d4017020 con 0x7fa3e4138040 2023-10-03T10:16:04.017 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:04.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.019+0000 7fa3e9bea700 1 -- 172.21.15.146:0/3131140749 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e4138040 msgr2=0x7fa3e413b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.019+0000 7fa3e9bea700 1 --2- 172.21.15.146:0/3131140749 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e4138040 0x7fa3e413b810 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400c450 tx=0x7fa3d400c760 comp rx=0 tx=0).stop 2023-10-03T10:16:04.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.020+0000 7fa3e9bea700 1 -- 172.21.15.146:0/3131140749 shutdown_connections 2023-10-03T10:16:04.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.020+0000 7fa3e9bea700 1 --2- 172.21.15.146:0/3131140749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3e413dd10 0x7fa3e4136000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.020+0000 7fa3e9bea700 1 --2- 172.21.15.146:0/3131140749 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e4138040 0x7fa3e413b810 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.020+0000 7fa3e9bea700 1 --2- 172.21.15.146:0/3131140749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3e4138410 0x7fa3e4135ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.020+0000 7fa3e9bea700 1 -- 172.21.15.146:0/3131140749 >> 172.21.15.146:0/3131140749 conn(0x7fa3e40a2980 msgr2=0x7fa3e409f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.020+0000 7fa3e9bea700 1 -- 172.21.15.146:0/3131140749 shutdown_connections 2023-10-03T10:16:04.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.020+0000 7fa3e9bea700 1 -- 172.21.15.146:0/3131140749 wait complete. 2023-10-03T10:16:04.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:04.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.030+0000 7f66a1078700 1 -- 172.21.15.146:0/1359676824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f669c070ea0 con 0x7f669c133f50 2023-10-03T10:16:04.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.030+0000 7f66837fe700 1 -- 172.21.15.146:0/1359676824 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f669402a070 con 0x7f669c133f50 2023-10-03T10:16:04.029 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:04.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:04.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.032+0000 7f66a1078700 1 -- 172.21.15.146:0/1359676824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f669c133f50 msgr2=0x7f669c06dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.032+0000 7f66a1078700 1 --2- 172.21.15.146:0/1359676824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f669c133f50 0x7f669c06dac0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f669c09eb10 tx=0x7f6694004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.032+0000 7f66a1078700 1 -- 172.21.15.146:0/1359676824 shutdown_connections 2023-10-03T10:16:04.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.032+0000 7f66a1078700 1 --2- 172.21.15.146:0/1359676824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f669c133f50 0x7f669c06dac0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.032+0000 7f66a1078700 1 --2- 172.21.15.146:0/1359676824 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f669c0a0a70 0x7f669c1ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.032+0000 7f66a1078700 1 --2- 172.21.15.146:0/1359676824 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f669c0a1380 0x7f669c1cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.032+0000 7f66a1078700 1 -- 172.21.15.146:0/1359676824 >> 172.21.15.146:0/1359676824 conn(0x7f669c0a6610 msgr2=0x7f669c09bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.032+0000 7f66a1078700 1 -- 172.21.15.146:0/1359676824 shutdown_connections 2023-10-03T10:16:04.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:04.032+0000 7f66a1078700 1 -- 172.21.15.146:0/1359676824 wait complete. 2023-10-03T10:16:04.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:04.992 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:05.021 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:05.033 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:05.045 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:05.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.137+0000 7ffaa56f9700 1 Processor -- start 2023-10-03T10:16:05.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.137+0000 7ffaa56f9700 1 -- start start 2023-10-03T10:16:05.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.138+0000 7ffaa56f9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa0138410 0x7ffaa00a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.138+0000 7ffaa56f9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffaa013dd10 0x7ffaa01400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.138+0000 7ffaa56f9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa01379e0 con 0x7ffaa0138040 2023-10-03T10:16:05.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.138+0000 7ffaa56f9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa00a2100 con 0x7ffaa0138410 2023-10-03T10:16:05.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.138+0000 7ffaa56f9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa009b9b0 con 0x7ffaa013dd10 2023-10-03T10:16:05.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.138+0000 7ffa9e7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa0138410 0x7ffaa00a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.138+0000 7ffa9e7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa0138410 0x7ffaa00a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40060/0 (socket says 172.21.15.146:40060) 2023-10-03T10:16:05.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.138+0000 7ffa9e7fc700 1 -- 172.21.15.146:0/2922516808 learned_addr learned my addr 172.21.15.146:0/2922516808 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:05.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.138+0000 7ffa9f7fe700 1 --2- 172.21.15.146:0/2922516808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffaa013dd10 0x7ffaa01400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.138+0000 7ffa9e7fc700 1 -- 172.21.15.146:0/2922516808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffaa013dd10 msgr2=0x7ffaa01400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.138+0000 7ffa9e7fc700 1 --2- 172.21.15.146:0/2922516808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffaa013dd10 0x7ffaa01400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.138+0000 7ffa9e7fc700 1 -- 172.21.15.146:0/2922516808 >> v1:172.21.15.146:6789/0 conn(0x7ffaa0138040 legacy=0x7ffaa00a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.138+0000 7ffa9e7fc700 1 -- 172.21.15.146:0/2922516808 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa0137c10 con 0x7ffaa0138410 2023-10-03T10:16:05.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.139+0000 7ffa9e7fc700 1 --2- 172.21.15.146:0/2922516808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa0138410 0x7ffaa00a0ff0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009920 tx=0x7ffa94009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d534bd6b9e3a30 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.139+0000 7ffa9dffb700 1 -- 172.21.15.146:0/2922516808 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94011830 con 0x7ffaa0138410 2023-10-03T10:16:05.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.139+0000 7ffa9dffb700 1 -- 172.21.15.146:0/2922516808 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa94011990 con 0x7ffaa0138410 2023-10-03T10:16:05.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.139+0000 7ffa9dffb700 1 -- 172.21.15.146:0/2922516808 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94011d20 con 0x7ffaa0138410 2023-10-03T10:16:05.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.140+0000 7ffaa56f9700 1 -- 172.21.15.146:0/2922516808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa0138410 msgr2=0x7ffaa00a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.140+0000 7ffaa56f9700 1 --2- 172.21.15.146:0/2922516808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa0138410 0x7ffaa00a0ff0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009920 tx=0x7ffa94009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:05.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.140+0000 7ffaa56f9700 1 -- 172.21.15.146:0/2922516808 shutdown_connections 2023-10-03T10:16:05.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.140+0000 7ffaa56f9700 1 --2- 172.21.15.146:0/2922516808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffaa013dd10 0x7ffaa01400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.140+0000 7ffaa56f9700 1 --2- 172.21.15.146:0/2922516808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa0138410 0x7ffaa00a0ff0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.140+0000 7ffaa56f9700 1 -- 172.21.15.146:0/2922516808 >> 172.21.15.146:0/2922516808 conn(0x7ffaa00a2980 msgr2=0x7ffaa00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.140+0000 7ffaa56f9700 1 -- 172.21.15.146:0/2922516808 shutdown_connections 2023-10-03T10:16:05.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.140+0000 7ffaa56f9700 1 -- 172.21.15.146:0/2922516808 wait complete. 2023-10-03T10:16:05.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.141+0000 7ffaa56f9700 1 Processor -- start 2023-10-03T10:16:05.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.141+0000 7ffaa56f9700 1 -- start start 2023-10-03T10:16:05.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.141+0000 7ffaa56f9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffaa0138040 0x7ffaa0136bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.141+0000 7ffaa56f9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa0138410 0x7ffaa01370f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.141+0000 7ffaa56f9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa013dd10 0x7ffaa0135870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.141+0000 7ffaa56f9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa00710f0 con 0x7ffaa0138410 2023-10-03T10:16:05.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.141+0000 7ffaa56f9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa009ec60 con 0x7ffaa013dd10 2023-10-03T10:16:05.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.141+0000 7ffaa56f9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa0119170 con 0x7ffaa0138040 2023-10-03T10:16:05.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.142+0000 7ffa9effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffaa0138040 0x7ffaa0136bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.142+0000 7ffa9effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffaa0138040 0x7ffaa0136bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38890/0 (socket says 172.21.15.146:38890) 2023-10-03T10:16:05.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.142+0000 7ffa9effd700 1 -- 172.21.15.146:0/1756704809 learned_addr learned my addr 172.21.15.146:0/1756704809 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:05.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.142+0000 7ffa9f7fe700 1 --2- 172.21.15.146:0/1756704809 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa013dd10 0x7ffaa0135870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.142+0000 7ffa9e7fc700 1 --2- 172.21.15.146:0/1756704809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa0138410 0x7ffaa01370f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.142+0000 7ffa9effd700 1 -- 172.21.15.146:0/1756704809 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa013dd10 msgr2=0x7ffaa0135870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.142+0000 7ffa9effd700 1 --2- 172.21.15.146:0/1756704809 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa013dd10 0x7ffaa0135870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.142+0000 7ffa9effd700 1 -- 172.21.15.146:0/1756704809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa0138410 msgr2=0x7ffaa01370f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.142+0000 7ffa9effd700 1 --2- 172.21.15.146:0/1756704809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa0138410 0x7ffaa01370f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.142+0000 7ffa9effd700 1 -- 172.21.15.146:0/1756704809 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa94009550 con 0x7ffaa0138040 2023-10-03T10:16:05.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.142+0000 7ffa9e7fc700 1 --2- 172.21.15.146:0/1756704809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa0138410 0x7ffaa01370f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:05.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.142+0000 7ffa9effd700 1 --2- 172.21.15.146:0/1756704809 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffaa0138040 0x7ffaa0136bb0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000c430 tx=0x7ffa9000c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.142+0000 7ffa877fe700 1 -- 172.21.15.146:0/1756704809 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa900054e0 con 0x7ffaa0138040 2023-10-03T10:16:05.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.142+0000 7ffa877fe700 1 -- 172.21.15.146:0/1756704809 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa90003680 con 0x7ffaa0138040 2023-10-03T10:16:05.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.142+0000 7ffaa56f9700 1 -- 172.21.15.146:0/1756704809 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa0071760 con 0x7ffaa0138040 2023-10-03T10:16:05.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.142+0000 7ffa877fe700 1 -- 172.21.15.146:0/1756704809 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa90003a30 con 0x7ffaa0138040 2023-10-03T10:16:05.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.143+0000 7ffaa56f9700 1 -- 172.21.15.146:0/1756704809 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa009a290 con 0x7ffaa0138040 2023-10-03T10:16:05.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.144+0000 7ffa877fe700 1 -- 172.21.15.146:0/1756704809 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa90003b90 con 0x7ffaa0138040 2023-10-03T10:16:05.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.144+0000 7ffaa56f9700 1 -- 172.21.15.146:0/1756704809 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa004f2a0 con 0x7ffaa0138040 2023-10-03T10:16:05.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.144+0000 7ffa877fe700 1 -- 172.21.15.146:0/1756704809 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffa90019d70 con 0x7ffaa0138040 2023-10-03T10:16:05.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.149+0000 7ffa877fe700 1 -- 172.21.15.146:0/1756704809 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa90017070 con 0x7ffaa0138040 2023-10-03T10:16:05.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.174+0000 7fa0ebb03700 1 Processor -- start 2023-10-03T10:16:05.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.174+0000 7fb4761fb700 1 Processor -- start 2023-10-03T10:16:05.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.174+0000 7fa0ebb03700 1 -- start start 2023-10-03T10:16:05.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.174+0000 7fb4761fb700 1 -- start start 2023-10-03T10:16:05.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.175+0000 7fa0ebb03700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0e409a150 0x7fa0e409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.175+0000 7fa0ebb03700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0e409edb0 0x7fa0e409f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.175+0000 7fa0ebb03700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa0e4133c20 0x7fa0e41340c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.175+0000 7fa0ebb03700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e409a520 con 0x7fa0e4133c20 2023-10-03T10:16:05.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.175+0000 7fa0ebb03700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e409fe00 con 0x7fa0e409a150 2023-10-03T10:16:05.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.175+0000 7fa0ebb03700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e406bec0 con 0x7fa0e409edb0 2023-10-03T10:16:05.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.175+0000 7fa0e989f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0e409a150 0x7fa0e409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.175+0000 7fa0e989f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0e409a150 0x7fa0e409e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40084/0 (socket says 172.21.15.146:40084) 2023-10-03T10:16:05.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.175+0000 7fa0e989f700 1 -- 172.21.15.146:0/2372845470 learned_addr learned my addr 172.21.15.146:0/2372845470 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:05.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.175+0000 7fb4761fb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb47012feb0 0x7fb470130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.175+0000 7fb4761fb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4701307c0 0x7fb4700993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.175+0000 7fb4761fb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb470099920 0x7fb470099d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.175+0000 7fb4761fb700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb47009a540 con 0x7fb470099920 2023-10-03T10:16:05.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.175+0000 7fb4761fb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47009ad40 con 0x7fb4701307c0 2023-10-03T10:16:05.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.175+0000 7fb4761fb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb47009e640 con 0x7fb47012feb0 2023-10-03T10:16:05.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.175+0000 7fb46effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4701307c0 0x7fb4700993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.175+0000 7fb46effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4701307c0 0x7fb4700993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40098/0 (socket says 172.21.15.146:40098) 2023-10-03T10:16:05.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.175+0000 7fb46effd700 1 -- 172.21.15.146:0/1425633417 learned_addr learned my addr 172.21.15.146:0/1425633417 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:05.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.175+0000 7fb46f7fe700 1 --2- 172.21.15.146:0/1425633417 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb47012feb0 0x7fb470130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.175+0000 7fa0e909e700 1 --2- 172.21.15.146:0/2372845470 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0e409edb0 0x7fa0e409f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.175+0000 7fa0e989f700 1 -- 172.21.15.146:0/2372845470 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0e409edb0 msgr2=0x7fa0e409f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.175+0000 7fa0e989f700 1 --2- 172.21.15.146:0/2372845470 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0e409edb0 0x7fa0e409f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.176+0000 7fa0e989f700 1 -- 172.21.15.146:0/2372845470 >> v2:172.21.15.146:3300/0 conn(0x7fa0e4133c20 msgr2=0x7fa0e41340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.176+0000 7fa0e989f700 1 --2- 172.21.15.146:0/2372845470 >> v2:172.21.15.146:3300/0 conn(0x7fa0e4133c20 0x7fa0e41340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.176+0000 7fa0e989f700 1 -- 172.21.15.146:0/2372845470 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e409af80 con 0x7fa0e409a150 2023-10-03T10:16:05.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.176+0000 7fb46effd700 1 -- 172.21.15.146:0/1425633417 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb47012feb0 msgr2=0x7fb470130280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.176+0000 7fb46effd700 1 --2- 172.21.15.146:0/1425633417 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb47012feb0 0x7fb470130280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.176+0000 7fb46effd700 1 -- 172.21.15.146:0/1425633417 >> v2:172.21.15.146:3300/0 conn(0x7fb470099920 msgr2=0x7fb470099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.176+0000 7fb46effd700 1 --2- 172.21.15.146:0/1425633417 >> v2:172.21.15.146:3300/0 conn(0x7fb470099920 0x7fb470099d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.176+0000 7fb46effd700 1 -- 172.21.15.146:0/1425633417 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47009e3c0 con 0x7fb4701307c0 2023-10-03T10:16:05.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.176+0000 7fa0e989f700 1 --2- 172.21.15.146:0/2372845470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0e409a150 0x7fa0e409e870 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa0e00098f0 tx=0x7fa0e0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70d6f7d91ef96bb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.176+0000 7fb46effd700 1 --2- 172.21.15.146:0/1425633417 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4701307c0 0x7fb4700993e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb4640098f0 tx=0x7fb464009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b05bafc9e58960a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.176+0000 7fb46e7fc700 1 -- 172.21.15.146:0/1425633417 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb464011830 con 0x7fb4701307c0 2023-10-03T10:16:05.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.176+0000 7fa0e889d700 1 -- 172.21.15.146:0/2372845470 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e000b8a0 con 0x7fa0e409a150 2023-10-03T10:16:05.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.176+0000 7fa0e889d700 1 -- 172.21.15.146:0/2372845470 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e000ba00 con 0x7fa0e409a150 2023-10-03T10:16:05.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.176+0000 7fa0e889d700 1 -- 172.21.15.146:0/2372845470 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e000bd90 con 0x7fa0e409a150 2023-10-03T10:16:05.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.176+0000 7fb46e7fc700 1 -- 172.21.15.146:0/1425633417 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb464011990 con 0x7fb4701307c0 2023-10-03T10:16:05.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.176+0000 7fb46e7fc700 1 -- 172.21.15.146:0/1425633417 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb464011d20 con 0x7fb4701307c0 2023-10-03T10:16:05.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.177+0000 7fa0ebb03700 1 -- 172.21.15.146:0/2372845470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0e409a150 msgr2=0x7fa0e409e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.177+0000 7fa0ebb03700 1 --2- 172.21.15.146:0/2372845470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0e409a150 0x7fa0e409e870 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa0e00098f0 tx=0x7fa0e0009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:05.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.177+0000 7fa0ebb03700 1 -- 172.21.15.146:0/2372845470 shutdown_connections 2023-10-03T10:16:05.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.177+0000 7fa0ebb03700 1 --2- 172.21.15.146:0/2372845470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0e409a150 0x7fa0e409e870 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.177+0000 7fa0ebb03700 1 --2- 172.21.15.146:0/2372845470 >> v2:172.21.15.146:3300/0 conn(0x7fa0e4133c20 0x7fa0e41340c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.177+0000 7fa0ebb03700 1 --2- 172.21.15.146:0/2372845470 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0e409edb0 0x7fa0e409f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.177+0000 7fa0ebb03700 1 -- 172.21.15.146:0/2372845470 >> 172.21.15.146:0/2372845470 conn(0x7fa0e40a4430 msgr2=0x7fa0e40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.177+0000 7fb4761fb700 1 -- 172.21.15.146:0/1425633417 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4701307c0 msgr2=0x7fb4700993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.177+0000 7fb4761fb700 1 --2- 172.21.15.146:0/1425633417 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4701307c0 0x7fb4700993e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb4640098f0 tx=0x7fb464009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:05.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.177+0000 7fa0ebb03700 1 -- 172.21.15.146:0/2372845470 shutdown_connections 2023-10-03T10:16:05.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.177+0000 7fa0ebb03700 1 -- 172.21.15.146:0/2372845470 wait complete. 2023-10-03T10:16:05.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.177+0000 7fb4761fb700 1 -- 172.21.15.146:0/1425633417 shutdown_connections 2023-10-03T10:16:05.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.177+0000 7fb4761fb700 1 --2- 172.21.15.146:0/1425633417 >> v2:172.21.15.146:3300/0 conn(0x7fb470099920 0x7fb470099d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.177+0000 7fb4761fb700 1 --2- 172.21.15.146:0/1425633417 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb47012feb0 0x7fb470130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.177+0000 7fb4761fb700 1 --2- 172.21.15.146:0/1425633417 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4701307c0 0x7fb4700993e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.177+0000 7fb4761fb700 1 -- 172.21.15.146:0/1425633417 >> 172.21.15.146:0/1425633417 conn(0x7fb4700a2b30 msgr2=0x7fb47009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.178+0000 7fa0ebb03700 1 Processor -- start 2023-10-03T10:16:05.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.178+0000 7fa0ebb03700 1 -- start start 2023-10-03T10:16:05.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.178+0000 7fa0ebb03700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0e409a150 0x7fa0e41c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.178+0000 7fa0ebb03700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0e409edb0 0x7fa0e41c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.178+0000 7fa0ebb03700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0e4133c20 0x7fa0e411ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fa0ebb03700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e41bd480 con 0x7fa0e4133c20 2023-10-03T10:16:05.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fa0ebb03700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e41228c0 con 0x7fa0e409edb0 2023-10-03T10:16:05.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fa0ebb03700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e4133720 con 0x7fa0e409a150 2023-10-03T10:16:05.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fa0e989f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0e409a150 0x7fa0e41c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fa0e989f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0e409a150 0x7fa0e41c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38920/0 (socket says 172.21.15.146:38920) 2023-10-03T10:16:05.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fa0e989f700 1 -- 172.21.15.146:0/2887813854 learned_addr learned my addr 172.21.15.146:0/2887813854 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:05.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fa0e909e700 1 --2- 172.21.15.146:0/2887813854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0e409edb0 0x7fa0e41c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fa0e989f700 1 -- 172.21.15.146:0/2887813854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0e409edb0 msgr2=0x7fa0e41c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fa0e989f700 1 --2- 172.21.15.146:0/2887813854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0e409edb0 0x7fa0e41c8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fa0e989f700 1 -- 172.21.15.146:0/2887813854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0e4133c20 msgr2=0x7fa0e411ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fa0e989f700 1 --2- 172.21.15.146:0/2887813854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0e4133c20 0x7fa0e411ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fa0e989f700 1 -- 172.21.15.146:0/2887813854 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e0009550 con 0x7fa0e409a150 2023-10-03T10:16:05.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fa0e989f700 1 --2- 172.21.15.146:0/2887813854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0e409a150 0x7fa0e41c89b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0000c00 tx=0x7fa0e0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fa0da7fc700 1 -- 172.21.15.146:0/2887813854 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0004400 con 0x7fa0e409a150 2023-10-03T10:16:05.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fa0da7fc700 1 -- 172.21.15.146:0/2887813854 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e001e070 con 0x7fa0e409a150 2023-10-03T10:16:05.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fa0ebb03700 1 -- 172.21.15.146:0/2887813854 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e41c9430 con 0x7fa0e409a150 2023-10-03T10:16:05.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fa0da7fc700 1 -- 172.21.15.146:0/2887813854 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e00038e0 con 0x7fa0e409a150 2023-10-03T10:16:05.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fa0ebb03700 1 -- 172.21.15.146:0/2887813854 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e4120770 con 0x7fa0e409a150 2023-10-03T10:16:05.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.177+0000 7fb4761fb700 1 -- 172.21.15.146:0/1425633417 shutdown_connections 2023-10-03T10:16:05.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.177+0000 7fb4761fb700 1 -- 172.21.15.146:0/1425633417 wait complete. 2023-10-03T10:16:05.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.178+0000 7fb4761fb700 1 Processor -- start 2023-10-03T10:16:05.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fb4761fb700 1 -- start start 2023-10-03T10:16:05.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fb4761fb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb470099920 0x7fb4701c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fb4761fb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb47012feb0 0x7fb4701c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fb4761fb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4701307c0 0x7fb47006e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fb4761fb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb470070ed0 con 0x7fb470099920 2023-10-03T10:16:05.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fb4761fb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb470071da0 con 0x7fb47012feb0 2023-10-03T10:16:05.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.179+0000 7fb4761fb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb47012fba0 con 0x7fb4701307c0 2023-10-03T10:16:05.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.180+0000 7fb46f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb470099920 0x7fb4701c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.180+0000 7fb46f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb470099920 0x7fb4701c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59434/0 (socket says 172.21.15.146:59434) 2023-10-03T10:16:05.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.180+0000 7fb46f7fe700 1 -- 172.21.15.146:0/3353128161 learned_addr learned my addr 172.21.15.146:0/3353128161 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:05.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.180+0000 7fb46f7fe700 1 -- 172.21.15.146:0/3353128161 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4701307c0 msgr2=0x7fb47006e960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:16:05.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.180+0000 7fb46f7fe700 1 --2- 172.21.15.146:0/3353128161 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4701307c0 0x7fb47006e960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.180+0000 7fb46f7fe700 1 -- 172.21.15.146:0/3353128161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb47012feb0 msgr2=0x7fb4701c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.180+0000 7fb46f7fe700 1 --2- 172.21.15.146:0/3353128161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb47012feb0 0x7fb4701c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.180+0000 7fb46f7fe700 1 -- 172.21.15.146:0/3353128161 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb464009550 con 0x7fb470099920 2023-10-03T10:16:05.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.180+0000 7fa0da7fc700 1 -- 172.21.15.146:0/2887813854 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa0e0020030 con 0x7fa0e409a150 2023-10-03T10:16:05.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.180+0000 7fb46f7fe700 1 --2- 172.21.15.146:0/3353128161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb470099920 0x7fb4701c8520 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fb46000e990 tx=0x7fb46000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.181+0000 7fa0da7fc700 1 -- 172.21.15.146:0/2887813854 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa0e00406a0 con 0x7fa0e409a150 2023-10-03T10:16:05.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.181+0000 7fb457fff700 1 -- 172.21.15.146:0/3353128161 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4600096f0 con 0x7fb470099920 2023-10-03T10:16:05.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.181+0000 7fb457fff700 1 -- 172.21.15.146:0/3353128161 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46000c850 con 0x7fb470099920 2023-10-03T10:16:05.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.181+0000 7fb457fff700 1 -- 172.21.15.146:0/3353128161 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46000cbc0 con 0x7fb470099920 2023-10-03T10:16:05.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.181+0000 7fb4761fb700 1 -- 172.21.15.146:0/3353128161 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4701c3330 con 0x7fb470099920 2023-10-03T10:16:05.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.181+0000 7fb4761fb700 1 -- 172.21.15.146:0/3353128161 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb470131070 con 0x7fb470099920 2023-10-03T10:16:05.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.181+0000 7fa0c7fff700 1 -- 172.21.15.146:0/2887813854 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e409fa30 con 0x7fa0e409a150 2023-10-03T10:16:05.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.182+0000 7fb4761fb700 1 -- 172.21.15.146:0/3353128161 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb47004f2a0 con 0x7fb470099920 2023-10-03T10:16:05.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.186+0000 7fa0da7fc700 1 -- 172.21.15.146:0/2887813854 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa0e0015070 con 0x7fa0e409a150 2023-10-03T10:16:05.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.186+0000 7fb457fff700 1 -- 172.21.15.146:0/3353128161 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb46000cd20 con 0x7fb470099920 2023-10-03T10:16:05.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.186+0000 7fb457fff700 1 -- 172.21.15.146:0/3353128161 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb46003fc00 con 0x7fb470099920 2023-10-03T10:16:05.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.191+0000 7fb457fff700 1 -- 172.21.15.146:0/3353128161 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb460013560 con 0x7fb470099920 2023-10-03T10:16:05.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.228+0000 7fdde12f9700 1 Processor -- start 2023-10-03T10:16:05.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.228+0000 7fdde12f9700 1 -- start start 2023-10-03T10:16:05.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.229+0000 7fdde12f9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdddc0a1550 0x7fdddc138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.229+0000 7fdde12f9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdddc139200 0x7fdddc13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.229+0000 7fdde12f9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdddc09e9d0 con 0x7fdddc0a0a70 2023-10-03T10:16:05.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.229+0000 7fdde12f9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdddc09dc00 con 0x7fdddc0a1550 2023-10-03T10:16:05.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.229+0000 7fdde12f9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc09dec0 con 0x7fdddc139200 2023-10-03T10:16:05.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.229+0000 7fdddb7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdddc139200 0x7fdddc13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.229+0000 7fdddb7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdddc139200 0x7fdddc13b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38936/0 (socket says 172.21.15.146:38936) 2023-10-03T10:16:05.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.229+0000 7fdddb7fe700 1 -- 172.21.15.146:0/2649129 learned_addr learned my addr 172.21.15.146:0/2649129 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:05.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.230+0000 7fdddb7fe700 1 -- 172.21.15.146:0/2649129 >> v2:172.21.15.146:3300/0 conn(0x7fdddc0a1550 msgr2=0x7fdddc138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.230+0000 7fdddb7fe700 1 --2- 172.21.15.146:0/2649129 >> v2:172.21.15.146:3300/0 conn(0x7fdddc0a1550 0x7fdddc138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.230+0000 7fdddb7fe700 1 -- 172.21.15.146:0/2649129 >> v1:172.21.15.146:6789/0 conn(0x7fdddc0a0a70 legacy=0x7fdddc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.230+0000 7fdddb7fe700 1 -- 172.21.15.146:0/2649129 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc09e6a0 con 0x7fdddc139200 2023-10-03T10:16:05.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.230+0000 7fdddb7fe700 1 --2- 172.21.15.146:0/2649129 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdddc139200 0x7fdddc13b5e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009e50 tx=0x7fddd400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15a002572173cbb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.230+0000 7fddd9ffb700 1 -- 172.21.15.146:0/2649129 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd400e070 con 0x7fdddc139200 2023-10-03T10:16:05.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.230+0000 7fddd9ffb700 1 -- 172.21.15.146:0/2649129 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd4003a20 con 0x7fdddc139200 2023-10-03T10:16:05.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.230+0000 7fddd9ffb700 1 -- 172.21.15.146:0/2649129 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd4003dd0 con 0x7fdddc139200 2023-10-03T10:16:05.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.230+0000 7fdde12f9700 1 -- 172.21.15.146:0/2649129 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdddc139200 msgr2=0x7fdddc13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.230+0000 7fdde12f9700 1 --2- 172.21.15.146:0/2649129 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdddc139200 0x7fdddc13b5e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009e50 tx=0x7fddd400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:05.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.230+0000 7fdde12f9700 1 -- 172.21.15.146:0/2649129 shutdown_connections 2023-10-03T10:16:05.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.230+0000 7fdde12f9700 1 --2- 172.21.15.146:0/2649129 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdddc139200 0x7fdddc13b5e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.230+0000 7fdde12f9700 1 --2- 172.21.15.146:0/2649129 >> v2:172.21.15.146:3300/0 conn(0x7fdddc0a1550 0x7fdddc138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.231+0000 7fdde12f9700 1 -- 172.21.15.146:0/2649129 >> 172.21.15.146:0/2649129 conn(0x7fdddc0a6610 msgr2=0x7fdddc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.231+0000 7fdde12f9700 1 -- 172.21.15.146:0/2649129 shutdown_connections 2023-10-03T10:16:05.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.231+0000 7fdde12f9700 1 -- 172.21.15.146:0/2649129 wait complete. 2023-10-03T10:16:05.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.232+0000 7fdde12f9700 1 Processor -- start 2023-10-03T10:16:05.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.232+0000 7fdde12f9700 1 -- start start 2023-10-03T10:16:05.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.233+0000 7fdde12f9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdddc0a0a70 0x7fdddc1c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.233+0000 7fdde12f9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdddc0a1550 0x7fdddc1c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.233+0000 7fdde12f9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdddc139200 0x7fdddc1c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.233+0000 7fdde12f9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc120750 con 0x7fdddc0a0a70 2023-10-03T10:16:05.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.233+0000 7fdde12f9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc120e30 con 0x7fdddc0a1550 2023-10-03T10:16:05.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.233+0000 7fdde12f9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0a5320 con 0x7fdddc139200 2023-10-03T10:16:05.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.233+0000 7fddda7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdddc0a1550 0x7fdddc1c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.233+0000 7fddda7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdddc0a1550 0x7fdddc1c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40130/0 (socket says 172.21.15.146:40130) 2023-10-03T10:16:05.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.233+0000 7fddda7fc700 1 -- 172.21.15.146:0/3087972556 learned_addr learned my addr 172.21.15.146:0/3087972556 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:05.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.233+0000 7fdddb7fe700 1 --2- 172.21.15.146:0/3087972556 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdddc139200 0x7fdddc1c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.233+0000 7fddda7fc700 1 -- 172.21.15.146:0/3087972556 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdddc139200 msgr2=0x7fdddc1c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.233+0000 7fddda7fc700 1 --2- 172.21.15.146:0/3087972556 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdddc139200 0x7fdddc1c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.233+0000 7fddda7fc700 1 -- 172.21.15.146:0/3087972556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdddc0a0a70 msgr2=0x7fdddc1c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.233+0000 7fddda7fc700 1 --2- 172.21.15.146:0/3087972556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdddc0a0a70 0x7fdddc1c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.233+0000 7fddda7fc700 1 -- 172.21.15.146:0/3087972556 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd4009b30 con 0x7fdddc0a1550 2023-10-03T10:16:05.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.233+0000 7fddda7fc700 1 --2- 172.21.15.146:0/3087972556 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdddc0a1550 0x7fdddc1c8930 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fddd000b530 tx=0x7fddd000b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.236+0000 7fddc37fe700 1 -- 172.21.15.146:0/3087972556 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0011830 con 0x7fdddc0a1550 2023-10-03T10:16:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.236+0000 7fddc37fe700 1 -- 172.21.15.146:0/3087972556 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd0011990 con 0x7fdddc0a1550 2023-10-03T10:16:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.236+0000 7fddc37fe700 1 -- 172.21.15.146:0/3087972556 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0011d20 con 0x7fdddc0a1550 2023-10-03T10:16:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.236+0000 7fdde12f9700 1 -- 172.21.15.146:0/3087972556 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdddc0a03e0 con 0x7fdddc0a1550 2023-10-03T10:16:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.236+0000 7fdde12f9700 1 -- 172.21.15.146:0/3087972556 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdddc122c70 con 0x7fdddc0a1550 2023-10-03T10:16:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.237+0000 7fddc37fe700 1 -- 172.21.15.146:0/3087972556 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fddd001a400 con 0x7fdddc0a1550 2023-10-03T10:16:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.237+0000 7fddc37fe700 1 -- 172.21.15.146:0/3087972556 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fddd003f8c0 con 0x7fdddc0a1550 2023-10-03T10:16:05.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.237+0000 7fdde12f9700 1 -- 172.21.15.146:0/3087972556 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdddc04f2a0 con 0x7fdddc0a1550 2023-10-03T10:16:05.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.246+0000 7fddc37fe700 1 -- 172.21.15.146:0/3087972556 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fddd0015020 con 0x7fdddc0a1550 2023-10-03T10:16:05.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.350+0000 7ffaa56f9700 1 -- 172.21.15.146:0/1756704809 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffaa0071d20 con 0x7ffaa0138040 2023-10-03T10:16:05.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.351+0000 7ffa877fe700 1 -- 172.21.15.146:0/1756704809 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa90003e40 con 0x7ffaa0138040 2023-10-03T10:16:05.350 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:05.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.353+0000 7ffaa56f9700 1 -- 172.21.15.146:0/1756704809 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffaa0138040 msgr2=0x7ffaa0136bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.353+0000 7ffaa56f9700 1 --2- 172.21.15.146:0/1756704809 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffaa0138040 0x7ffaa0136bb0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000c430 tx=0x7ffa9000c740 comp rx=0 tx=0).stop 2023-10-03T10:16:05.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.353+0000 7ffaa56f9700 1 -- 172.21.15.146:0/1756704809 shutdown_connections 2023-10-03T10:16:05.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.353+0000 7ffaa56f9700 1 --2- 172.21.15.146:0/1756704809 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa013dd10 0x7ffaa0135870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.353+0000 7ffaa56f9700 1 --2- 172.21.15.146:0/1756704809 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffaa0138040 0x7ffaa0136bb0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.353+0000 7ffaa56f9700 1 --2- 172.21.15.146:0/1756704809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa0138410 0x7ffaa01370f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.353+0000 7ffaa56f9700 1 -- 172.21.15.146:0/1756704809 >> 172.21.15.146:0/1756704809 conn(0x7ffaa00a2980 msgr2=0x7ffaa013d010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.353+0000 7ffaa56f9700 1 -- 172.21.15.146:0/1756704809 shutdown_connections 2023-10-03T10:16:05.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.353+0000 7ffaa56f9700 1 -- 172.21.15.146:0/1756704809 wait complete. 2023-10-03T10:16:05.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:05.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.386+0000 7fb4761fb700 1 -- 172.21.15.146:0/3353128161 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb4701c32d0 con 0x7fb470099920 2023-10-03T10:16:05.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.386+0000 7fb457fff700 1 -- 172.21.15.146:0/3353128161 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb46003fe60 con 0x7fb470099920 2023-10-03T10:16:05.386 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:05.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.388+0000 7fb4761fb700 1 -- 172.21.15.146:0/3353128161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb470099920 msgr2=0x7fb4701c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.388+0000 7fb4761fb700 1 --2- 172.21.15.146:0/3353128161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb470099920 0x7fb4701c8520 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fb46000e990 tx=0x7fb46000ed50 comp rx=0 tx=0).stop 2023-10-03T10:16:05.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.388+0000 7fb4761fb700 1 -- 172.21.15.146:0/3353128161 shutdown_connections 2023-10-03T10:16:05.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.388+0000 7fb4761fb700 1 --2- 172.21.15.146:0/3353128161 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4701307c0 0x7fb47006e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.388+0000 7fb4761fb700 1 --2- 172.21.15.146:0/3353128161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb470099920 0x7fb4701c8520 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.388+0000 7fb4761fb700 1 --2- 172.21.15.146:0/3353128161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb47012feb0 0x7fb4701c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.388+0000 7fb4761fb700 1 -- 172.21.15.146:0/3353128161 >> 172.21.15.146:0/3353128161 conn(0x7fb4700a2b30 msgr2=0x7fb47012c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.388+0000 7fb4761fb700 1 -- 172.21.15.146:0/3353128161 shutdown_connections 2023-10-03T10:16:05.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.388+0000 7fb4761fb700 1 -- 172.21.15.146:0/3353128161 wait complete. 2023-10-03T10:16:05.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.399+0000 7fa0c7fff700 1 -- 172.21.15.146:0/2887813854 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa0e404f2a0 con 0x7fa0e409a150 2023-10-03T10:16:05.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.399+0000 7fa0da7fc700 1 -- 172.21.15.146:0/2887813854 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa0e0019980 con 0x7fa0e409a150 2023-10-03T10:16:05.399 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:05.400 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:05.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.402+0000 7fa0c7fff700 1 -- 172.21.15.146:0/2887813854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0e409a150 msgr2=0x7fa0e41c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.402+0000 7fa0c7fff700 1 --2- 172.21.15.146:0/2887813854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0e409a150 0x7fa0e41c89b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0000c00 tx=0x7fa0e0004750 comp rx=0 tx=0).stop 2023-10-03T10:16:05.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.402+0000 7fa0c7fff700 1 -- 172.21.15.146:0/2887813854 shutdown_connections 2023-10-03T10:16:05.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.402+0000 7fa0c7fff700 1 --2- 172.21.15.146:0/2887813854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0e4133c20 0x7fa0e411ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.402+0000 7fa0c7fff700 1 --2- 172.21.15.146:0/2887813854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa0e409a150 0x7fa0e41c89b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.402+0000 7fa0c7fff700 1 --2- 172.21.15.146:0/2887813854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0e409edb0 0x7fa0e41c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.402+0000 7fa0c7fff700 1 -- 172.21.15.146:0/2887813854 >> 172.21.15.146:0/2887813854 conn(0x7fa0e40a4430 msgr2=0x7fa0e41b8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.402+0000 7fa0c7fff700 1 -- 172.21.15.146:0/2887813854 shutdown_connections 2023-10-03T10:16:05.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.402+0000 7fa0c7fff700 1 -- 172.21.15.146:0/2887813854 wait complete. 2023-10-03T10:16:05.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:05.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.442+0000 7fdde12f9700 1 -- 172.21.15.146:0/3087972556 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdddc072980 con 0x7fdddc0a1550 2023-10-03T10:16:05.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.442+0000 7fddc37fe700 1 -- 172.21.15.146:0/3087972556 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fddd000f8d0 con 0x7fdddc0a1550 2023-10-03T10:16:05.442 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:05.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.444+0000 7fdde12f9700 1 -- 172.21.15.146:0/3087972556 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdddc0a1550 msgr2=0x7fdddc1c8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.444+0000 7fdde12f9700 1 --2- 172.21.15.146:0/3087972556 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdddc0a1550 0x7fdddc1c8930 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fddd000b530 tx=0x7fddd000b840 comp rx=0 tx=0).stop 2023-10-03T10:16:05.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.444+0000 7fdde12f9700 1 -- 172.21.15.146:0/3087972556 shutdown_connections 2023-10-03T10:16:05.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.444+0000 7fdde12f9700 1 --2- 172.21.15.146:0/3087972556 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdddc139200 0x7fdddc1c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.444+0000 7fdde12f9700 1 --2- 172.21.15.146:0/3087972556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdddc0a0a70 0x7fdddc1c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.444+0000 7fdde12f9700 1 --2- 172.21.15.146:0/3087972556 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdddc0a1550 0x7fdddc1c8930 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.444+0000 7fdde12f9700 1 -- 172.21.15.146:0/3087972556 >> 172.21.15.146:0/3087972556 conn(0x7fdddc0a6610 msgr2=0x7fdddc138140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.444+0000 7fdde12f9700 1 -- 172.21.15.146:0/3087972556 shutdown_connections 2023-10-03T10:16:05.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:05.444+0000 7fdde12f9700 1 -- 172.21.15.146:0/3087972556 wait complete. 2023-10-03T10:16:05.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:06.366 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:06.401 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:06.415 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:06.457 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:06.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.509+0000 7f4a14fd6700 1 Processor -- start 2023-10-03T10:16:06.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.509+0000 7f4a14fd6700 1 -- start start 2023-10-03T10:16:06.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.509+0000 7f4a14fd6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a10138410 0x7f4a100a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.509+0000 7f4a14fd6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4a1013dd10 0x7f4a101400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.509+0000 7f4a14fd6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a101379e0 con 0x7f4a10138040 2023-10-03T10:16:06.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.509+0000 7f4a14fd6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a100a2100 con 0x7f4a1013dd10 2023-10-03T10:16:06.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.509+0000 7f4a14fd6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1009b9b0 con 0x7f4a10138410 2023-10-03T10:16:06.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.510+0000 7f4a0ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4a1013dd10 0x7f4a101400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.510+0000 7f4a0e59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4a10138040 0x7f4a100a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45954/0 (socket says 172.21.15.146:45954) 2023-10-03T10:16:06.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.510+0000 7f4a0ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4a1013dd10 0x7f4a101400f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59470/0 (socket says 172.21.15.146:59470) 2023-10-03T10:16:06.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.510+0000 7f4a0e59c700 1 -- 172.21.15.146:0/170764353 learned_addr learned my addr 172.21.15.146:0/170764353 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:06.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.510+0000 7f4a0dd9b700 1 --2- 172.21.15.146:0/170764353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a10138410 0x7f4a100a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.510+0000 7f4a0ed9d700 1 -- 172.21.15.146:0/170764353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a10138410 msgr2=0x7f4a100a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.510+0000 7f4a0ed9d700 1 --2- 172.21.15.146:0/170764353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a10138410 0x7f4a100a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.510+0000 7f4a0ed9d700 1 -- 172.21.15.146:0/170764353 >> v1:172.21.15.146:6789/0 conn(0x7f4a10138040 legacy=0x7f4a100a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.510+0000 7f4a0ed9d700 1 -- 172.21.15.146:0/170764353 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a10137c10 con 0x7f4a1013dd10 2023-10-03T10:16:06.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.510+0000 7f4a0ed9d700 1 --2- 172.21.15.146:0/170764353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a1013dd10 0x7f4a101400f0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f4a08009d90 tx=0x7f4a0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec1eb7d5f91150b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.511+0000 7f4a0d59a700 1 -- 172.21.15.146:0/170764353 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0800e070 con 0x7f4a1013dd10 2023-10-03T10:16:06.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.511+0000 7f4a0d59a700 1 -- 172.21.15.146:0/170764353 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0800bb20 con 0x7f4a1013dd10 2023-10-03T10:16:06.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.511+0000 7f4a0d59a700 1 -- 172.21.15.146:0/170764353 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a08012430 con 0x7f4a1013dd10 2023-10-03T10:16:06.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.512+0000 7f4a14fd6700 1 -- 172.21.15.146:0/170764353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a1013dd10 msgr2=0x7f4a101400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.512+0000 7f4a14fd6700 1 --2- 172.21.15.146:0/170764353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a1013dd10 0x7f4a101400f0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f4a08009d90 tx=0x7f4a0800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:06.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.512+0000 7f4a14fd6700 1 -- 172.21.15.146:0/170764353 shutdown_connections 2023-10-03T10:16:06.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.512+0000 7f4a14fd6700 1 --2- 172.21.15.146:0/170764353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a1013dd10 0x7f4a101400f0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.512+0000 7f4a14fd6700 1 --2- 172.21.15.146:0/170764353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a10138410 0x7f4a100a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.512+0000 7f4a14fd6700 1 -- 172.21.15.146:0/170764353 >> 172.21.15.146:0/170764353 conn(0x7f4a100a2980 msgr2=0x7f4a100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.512+0000 7f4a14fd6700 1 -- 172.21.15.146:0/170764353 shutdown_connections 2023-10-03T10:16:06.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.512+0000 7f4a14fd6700 1 -- 172.21.15.146:0/170764353 wait complete. 2023-10-03T10:16:06.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.513+0000 7f4a14fd6700 1 Processor -- start 2023-10-03T10:16:06.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.513+0000 7f4a14fd6700 1 -- start start 2023-10-03T10:16:06.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.513+0000 7f4a14fd6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a10138040 0x7f4a10121600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.513+0000 7f4a14fd6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a10138410 0x7f4a10121b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.513+0000 7f4a14fd6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a1013dd10 0x7f4a10122080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.513+0000 7f4a14fd6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1009ede0 con 0x7f4a1013dd10 2023-10-03T10:16:06.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.513+0000 7f4a14fd6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1009a240 con 0x7f4a10138410 2023-10-03T10:16:06.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.513+0000 7f4a14fd6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a10122fc0 con 0x7f4a10138040 2023-10-03T10:16:06.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.514+0000 7f4a0e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a10138040 0x7f4a10121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.514+0000 7f4a0e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a10138040 0x7f4a10121600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38958/0 (socket says 172.21.15.146:38958) 2023-10-03T10:16:06.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.514+0000 7f4a0e59c700 1 -- 172.21.15.146:0/2459131215 learned_addr learned my addr 172.21.15.146:0/2459131215 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:06.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.514+0000 7f4a0dd9b700 1 --2- 172.21.15.146:0/2459131215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a10138410 0x7f4a10121b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.514+0000 7f4a0e59c700 1 -- 172.21.15.146:0/2459131215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a10138410 msgr2=0x7f4a10121b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.514+0000 7f4a0e59c700 1 --2- 172.21.15.146:0/2459131215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a10138410 0x7f4a10121b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.514+0000 7f4a0e59c700 1 -- 172.21.15.146:0/2459131215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a1013dd10 msgr2=0x7f4a10122080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.514+0000 7f4a0e59c700 1 --2- 172.21.15.146:0/2459131215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a1013dd10 0x7f4a10122080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.514+0000 7f4a0e59c700 1 -- 172.21.15.146:0/2459131215 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a08009a70 con 0x7f4a10138040 2023-10-03T10:16:06.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.514+0000 7f4a0e59c700 1 --2- 172.21.15.146:0/2459131215 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a10138040 0x7f4a10121600 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000c4d0 tx=0x7f4a0000c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.514+0000 7f49feffd700 1 -- 172.21.15.146:0/2459131215 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a000074e0 con 0x7f4a10138040 2023-10-03T10:16:06.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.514+0000 7f49feffd700 1 -- 172.21.15.146:0/2459131215 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a00007640 con 0x7f4a10138040 2023-10-03T10:16:06.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.514+0000 7f4a14fd6700 1 -- 172.21.15.146:0/2459131215 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a10124b30 con 0x7f4a10138040 2023-10-03T10:16:06.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.514+0000 7f49feffd700 1 -- 172.21.15.146:0/2459131215 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a00005a30 con 0x7f4a10138040 2023-10-03T10:16:06.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.514+0000 7f4a14fd6700 1 -- 172.21.15.146:0/2459131215 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a10124e10 con 0x7f4a10138040 2023-10-03T10:16:06.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.515+0000 7f49feffd700 1 -- 172.21.15.146:0/2459131215 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4a00005b90 con 0x7f4a10138040 2023-10-03T10:16:06.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.516+0000 7f49feffd700 1 -- 172.21.15.146:0/2459131215 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4a0003eb40 con 0x7f4a10138040 2023-10-03T10:16:06.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.516+0000 7f4a14fd6700 1 -- 172.21.15.146:0/2459131215 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1004f2a0 con 0x7f4a10138040 2023-10-03T10:16:06.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.521+0000 7f49feffd700 1 -- 172.21.15.146:0/2459131215 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4a00017080 con 0x7f4a10138040 2023-10-03T10:16:06.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.548+0000 7fa7f578b700 1 Processor -- start 2023-10-03T10:16:06.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.548+0000 7fa7f578b700 1 -- start start 2023-10-03T10:16:06.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.548+0000 7fa7f578b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7f0133b80 0x7fa7f0133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.548+0000 7fa7f578b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7f00a0ff0 0x7fa7f013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.548+0000 7fa7f578b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f009aa00 con 0x7fa7f0099a60 2023-10-03T10:16:06.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.548+0000 7fa7f578b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f009a080 con 0x7fa7f0133b80 2023-10-03T10:16:06.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.548+0000 7fa7f578b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f0133750 con 0x7fa7f00a0ff0 2023-10-03T10:16:06.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.549+0000 7fa7eeffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7f0133b80 0x7fa7f0133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.549+0000 7fa7eeffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7f0133b80 0x7fa7f0133f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40160/0 (socket says 172.21.15.146:40160) 2023-10-03T10:16:06.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.549+0000 7fa7eeffd700 1 -- 172.21.15.146:0/520974050 learned_addr learned my addr 172.21.15.146:0/520974050 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:06.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.549+0000 7fa7ef7fe700 1 --2- 172.21.15.146:0/520974050 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7f00a0ff0 0x7fa7f013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.549+0000 7fa7eeffd700 1 -- 172.21.15.146:0/520974050 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7f00a0ff0 msgr2=0x7fa7f013b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.549+0000 7fa7eeffd700 1 --2- 172.21.15.146:0/520974050 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7f00a0ff0 0x7fa7f013b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.549+0000 7fa7eeffd700 1 -- 172.21.15.146:0/520974050 >> v1:172.21.15.146:6789/0 conn(0x7fa7f0099a60 legacy=0x7fa7f00a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.549+0000 7fa7eeffd700 1 -- 172.21.15.146:0/520974050 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f009a760 con 0x7fa7f0133b80 2023-10-03T10:16:06.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.549+0000 7fa7eeffd700 1 --2- 172.21.15.146:0/520974050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7f0133b80 0x7fa7f0133f50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00098f0 tx=0x7fa7e0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c49610a99debaca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.549+0000 7fa7edffb700 1 -- 172.21.15.146:0/520974050 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0005e30 con 0x7fa7f0133b80 2023-10-03T10:16:06.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.550+0000 7fa7edffb700 1 -- 172.21.15.146:0/520974050 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e0006030 con 0x7fa7f0133b80 2023-10-03T10:16:06.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.550+0000 7fa7edffb700 1 -- 172.21.15.146:0/520974050 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e00063c0 con 0x7fa7f0133b80 2023-10-03T10:16:06.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.550+0000 7fa7f578b700 1 -- 172.21.15.146:0/520974050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7f0133b80 msgr2=0x7fa7f0133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.550+0000 7fa7f578b700 1 --2- 172.21.15.146:0/520974050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7f0133b80 0x7fa7f0133f50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00098f0 tx=0x7fa7e0009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:06.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.551+0000 7fa7f578b700 1 -- 172.21.15.146:0/520974050 shutdown_connections 2023-10-03T10:16:06.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.551+0000 7fa7f578b700 1 --2- 172.21.15.146:0/520974050 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7f00a0ff0 0x7fa7f013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.551+0000 7fa7f578b700 1 --2- 172.21.15.146:0/520974050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7f0133b80 0x7fa7f0133f50 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.551+0000 7fa7f578b700 1 -- 172.21.15.146:0/520974050 >> 172.21.15.146:0/520974050 conn(0x7fa7f00a2980 msgr2=0x7fa7f00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.551+0000 7fa7f578b700 1 -- 172.21.15.146:0/520974050 shutdown_connections 2023-10-03T10:16:06.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.551+0000 7fa7f578b700 1 -- 172.21.15.146:0/520974050 wait complete. 2023-10-03T10:16:06.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.552+0000 7fa7f578b700 1 Processor -- start 2023-10-03T10:16:06.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.552+0000 7fa7f578b700 1 -- start start 2023-10-03T10:16:06.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.553+0000 7fa7f578b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7f0099a60 0x7fa7f011b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.553+0000 7fa7f578b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7f00a0ff0 0x7fa7f011bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.553+0000 7fa7f578b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7f0133b80 0x7fa7f011c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.553+0000 7fa7f578b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f011f300 con 0x7fa7f0099a60 2023-10-03T10:16:06.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.553+0000 7fa7f578b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f011d9d0 con 0x7fa7f0133b80 2023-10-03T10:16:06.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.553+0000 7fa7f578b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f011ea90 con 0x7fa7f00a0ff0 2023-10-03T10:16:06.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.553+0000 7fa7ee7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7f00a0ff0 0x7fa7f011bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.553+0000 7fa7ef7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7f0133b80 0x7fa7f011c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.553+0000 7fa7eeffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7f0099a60 0x7fa7f011b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.553+0000 7fa7ee7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7f00a0ff0 0x7fa7f011bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38972/0 (socket says 172.21.15.146:38972) 2023-10-03T10:16:06.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.553+0000 7fa7ef7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7f0133b80 0x7fa7f011c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40172/0 (socket says 172.21.15.146:40172) 2023-10-03T10:16:06.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.553+0000 7fa7ee7fc700 1 -- 172.21.15.146:0/4130014779 learned_addr learned my addr 172.21.15.146:0/4130014779 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:06.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.553+0000 7fa7eeffd700 1 -- 172.21.15.146:0/4130014779 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7f00a0ff0 msgr2=0x7fa7f011bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.553+0000 7fa7eeffd700 1 --2- 172.21.15.146:0/4130014779 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7f00a0ff0 0x7fa7f011bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.553+0000 7fa7eeffd700 1 -- 172.21.15.146:0/4130014779 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7f0133b80 msgr2=0x7fa7f011c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.553+0000 7fa7eeffd700 1 --2- 172.21.15.146:0/4130014779 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7f0133b80 0x7fa7f011c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.553+0000 7fa7eeffd700 1 -- 172.21.15.146:0/4130014779 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e0009500 con 0x7fa7f0099a60 2023-10-03T10:16:06.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.554+0000 7fa7eeffd700 1 --2- 172.21.15.146:0/4130014779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7f0099a60 0x7fa7f011b830 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00724b0 tx=0x7fa7e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.554+0000 7fa7d77fe700 1 -- 172.21.15.146:0/4130014779 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0026480 con 0x7fa7f0099a60 2023-10-03T10:16:06.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.554+0000 7fa7d77fe700 1 -- 172.21.15.146:0/4130014779 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e001f070 con 0x7fa7f0099a60 2023-10-03T10:16:06.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.554+0000 7fa7d77fe700 1 -- 172.21.15.146:0/4130014779 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0026820 con 0x7fa7f0099a60 2023-10-03T10:16:06.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.554+0000 7fa7f578b700 1 -- 172.21.15.146:0/4130014779 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f009a2c0 con 0x7fa7f0099a60 2023-10-03T10:16:06.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.554+0000 7fa7f578b700 1 -- 172.21.15.146:0/4130014779 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f012ebd0 con 0x7fa7f0099a60 2023-10-03T10:16:06.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.555+0000 7fa7f578b700 1 -- 172.21.15.146:0/4130014779 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f011eea0 con 0x7fa7f0099a60 2023-10-03T10:16:06.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.555+0000 7fa7d77fe700 1 -- 172.21.15.146:0/4130014779 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa7e0011420 con 0x7fa7f0099a60 2023-10-03T10:16:06.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.555+0000 7fa7d77fe700 1 -- 172.21.15.146:0/4130014779 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa7e0021070 con 0x7fa7f0099a60 2023-10-03T10:16:06.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.560+0000 7fa7d77fe700 1 -- 172.21.15.146:0/4130014779 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa7e0011e30 con 0x7fa7f0099a60 2023-10-03T10:16:06.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.596+0000 7ff3b93c5700 1 Processor -- start 2023-10-03T10:16:06.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.596+0000 7ff3b93c5700 1 -- start start 2023-10-03T10:16:06.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.597+0000 7ff3b93c5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b409e340 0x7ff3b41359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.597+0000 7ff3b93c5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff3b4135f20 0x7ff3b4138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.597+0000 7ff3b93c5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b409aaa0 con 0x7ff3b409d860 2023-10-03T10:16:06.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.597+0000 7ff3b93c5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b409e730 con 0x7ff3b4135f20 2023-10-03T10:16:06.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.597+0000 7ff3b93c5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b409f870 con 0x7ff3b409e340 2023-10-03T10:16:06.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.597+0000 7ff3b27fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b409e340 0x7ff3b41359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.597+0000 7ff3b2ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff3b409d860 0x7ff3b409dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45966/0 (socket says 172.21.15.146:45966) 2023-10-03T10:16:06.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.597+0000 7ff3b2ffd700 1 -- 172.21.15.146:0/1529774535 learned_addr learned my addr 172.21.15.146:0/1529774535 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:06.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.597+0000 7ff3b37fe700 1 --2- 172.21.15.146:0/1529774535 >> v2:172.21.15.146:3300/0 conn(0x7ff3b4135f20 0x7ff3b4138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.597+0000 7ff3b37fe700 1 -- 172.21.15.146:0/1529774535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b409e340 msgr2=0x7ff3b41359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.597+0000 7ff3b37fe700 1 --2- 172.21.15.146:0/1529774535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b409e340 0x7ff3b41359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.597+0000 7ff3b37fe700 1 -- 172.21.15.146:0/1529774535 >> v1:172.21.15.146:6789/0 conn(0x7ff3b409d860 legacy=0x7ff3b409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.597+0000 7ff3b1ffb700 1 -- 172.21.15.146:0/1529774535 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228632944 0 0) 0x7ff3b409aaa0 con 0x7ff3b409d860 2023-10-03T10:16:06.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.597+0000 7ff3b37fe700 1 -- 172.21.15.146:0/1529774535 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b409b360 con 0x7ff3b4135f20 2023-10-03T10:16:06.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.597+0000 7ff3b37fe700 1 --2- 172.21.15.146:0/1529774535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3b4135f20 0x7ff3b4138300 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac009d90 tx=0x7ff3ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f9e55cd89ca838 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.598+0000 7ff3b1ffb700 1 -- 172.21.15.146:0/1529774535 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac00e070 con 0x7ff3b4135f20 2023-10-03T10:16:06.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.598+0000 7ff3b1ffb700 1 -- 172.21.15.146:0/1529774535 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ac00bb20 con 0x7ff3b4135f20 2023-10-03T10:16:06.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.598+0000 7ff3b1ffb700 1 -- 172.21.15.146:0/1529774535 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac012430 con 0x7ff3b4135f20 2023-10-03T10:16:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.599+0000 7ff3b93c5700 1 -- 172.21.15.146:0/1529774535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3b4135f20 msgr2=0x7ff3b4138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.599+0000 7ff3b93c5700 1 --2- 172.21.15.146:0/1529774535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3b4135f20 0x7ff3b4138300 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac009d90 tx=0x7ff3ac00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.599+0000 7ff3b93c5700 1 -- 172.21.15.146:0/1529774535 shutdown_connections 2023-10-03T10:16:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.599+0000 7ff3b93c5700 1 --2- 172.21.15.146:0/1529774535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3b4135f20 0x7ff3b4138300 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.599+0000 7ff3b93c5700 1 --2- 172.21.15.146:0/1529774535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b409e340 0x7ff3b41359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.599+0000 7ff3b93c5700 1 -- 172.21.15.146:0/1529774535 >> 172.21.15.146:0/1529774535 conn(0x7ff3b4099c40 msgr2=0x7ff3b40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.599+0000 7ff3b93c5700 1 -- 172.21.15.146:0/1529774535 shutdown_connections 2023-10-03T10:16:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.599+0000 7ff3b93c5700 1 -- 172.21.15.146:0/1529774535 wait complete. 2023-10-03T10:16:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.600+0000 7ff3b93c5700 1 Processor -- start 2023-10-03T10:16:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.600+0000 7ff3b93c5700 1 -- start start 2023-10-03T10:16:06.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.601+0000 7ff3b93c5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3b409d860 0x7ff3b411c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.601+0000 7ff3b93c5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b409e340 0x7ff3b411c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.601+0000 7ff3b93c5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3b4135f20 0x7ff3b411cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.601+0000 7ff3b93c5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b411fa10 con 0x7ff3b409d860 2023-10-03T10:16:06.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.601+0000 7ff3b93c5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b411e640 con 0x7ff3b409e340 2023-10-03T10:16:06.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.601+0000 7ff3b93c5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b411f480 con 0x7ff3b4135f20 2023-10-03T10:16:06.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.601+0000 7ff3b2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3b409d860 0x7ff3b411c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.601+0000 7ff3b2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3b409d860 0x7ff3b411c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59494/0 (socket says 172.21.15.146:59494) 2023-10-03T10:16:06.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.601+0000 7ff3b2ffd700 1 -- 172.21.15.146:0/3396380573 learned_addr learned my addr 172.21.15.146:0/3396380573 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:06.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.601+0000 7ff3b27fc700 1 --2- 172.21.15.146:0/3396380573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b409e340 0x7ff3b411c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.601+0000 7ff3b37fe700 1 --2- 172.21.15.146:0/3396380573 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3b4135f20 0x7ff3b411cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.601+0000 7ff3b2ffd700 1 -- 172.21.15.146:0/3396380573 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3b4135f20 msgr2=0x7ff3b411cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.601+0000 7ff3b2ffd700 1 --2- 172.21.15.146:0/3396380573 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3b4135f20 0x7ff3b411cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.601+0000 7ff3b2ffd700 1 -- 172.21.15.146:0/3396380573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b409e340 msgr2=0x7ff3b411c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.601+0000 7ff3b2ffd700 1 --2- 172.21.15.146:0/3396380573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b409e340 0x7ff3b411c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.601+0000 7ff3b2ffd700 1 -- 172.21.15.146:0/3396380573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ac009a70 con 0x7ff3b409d860 2023-10-03T10:16:06.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.601+0000 7ff3b2ffd700 1 --2- 172.21.15.146:0/3396380573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3b409d860 0x7ff3b411c1d0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4010ef0 tx=0x7ff3a4001c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.601+0000 7ff39b7fe700 1 -- 172.21.15.146:0/3396380573 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a401e070 con 0x7ff3b409d860 2023-10-03T10:16:06.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.602+0000 7ff39b7fe700 1 -- 172.21.15.146:0/3396380573 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a400d070 con 0x7ff3b409d860 2023-10-03T10:16:06.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.602+0000 7ff3b93c5700 1 -- 172.21.15.146:0/3396380573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b409c8b0 con 0x7ff3b409d860 2023-10-03T10:16:06.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.602+0000 7ff39b7fe700 1 -- 172.21.15.146:0/3396380573 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4004a90 con 0x7ff3b409d860 2023-10-03T10:16:06.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.602+0000 7ff3b93c5700 1 -- 172.21.15.146:0/3396380573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b411f030 con 0x7ff3b409d860 2023-10-03T10:16:06.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.602+0000 7ff39b7fe700 1 -- 172.21.15.146:0/3396380573 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff3a400f070 con 0x7ff3b409d860 2023-10-03T10:16:06.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.602+0000 7ff39b7fe700 1 -- 172.21.15.146:0/3396380573 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff3a40468a0 con 0x7ff3b409d860 2023-10-03T10:16:06.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.604+0000 7ff3b93c5700 1 -- 172.21.15.146:0/3396380573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b411f6b0 con 0x7ff3b409d860 2023-10-03T10:16:06.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.608+0000 7ff39b7fe700 1 -- 172.21.15.146:0/3396380573 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff3b411f6b0 con 0x7ff3b409d860 2023-10-03T10:16:06.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.633+0000 7fe3e75bf700 1 Processor -- start 2023-10-03T10:16:06.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.633+0000 7fe3e75bf700 1 -- start start 2023-10-03T10:16:06.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.633+0000 7fe3e75bf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe3e006a770 0x7fe3e006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.633+0000 7fe3e75bf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3e006b080 0x7fe3e01317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.633+0000 7fe3e75bf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe3e0131cf0 0x7fe3e0132170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.633+0000 7fe3e75bf700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e009f770 con 0x7fe3e006a770 2023-10-03T10:16:06.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.633+0000 7fe3e75bf700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e009dce0 con 0x7fe3e006b080 2023-10-03T10:16:06.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.633+0000 7fe3e75bf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e009da80 con 0x7fe3e0131cf0 2023-10-03T10:16:06.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.634+0000 7fe3e5b5c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe3e0131cf0 0x7fe3e0132170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.634+0000 7fe3e5b5c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe3e0131cf0 0x7fe3e0132170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38982/0 (socket says 172.21.15.146:38982) 2023-10-03T10:16:06.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.634+0000 7fe3e535b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe3e006a770 0x7fe3e006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.634+0000 7fe3e5b5c700 1 -- 172.21.15.146:0/2128061153 learned_addr learned my addr 172.21.15.146:0/2128061153 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:06.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.634+0000 7fe3e4b5a700 1 --2- 172.21.15.146:0/2128061153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3e006b080 0x7fe3e01317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.634+0000 7fe3e535b700 1 -- 172.21.15.146:0/2128061153 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe3e0131cf0 msgr2=0x7fe3e0132170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.634+0000 7fe3e535b700 1 --2- 172.21.15.146:0/2128061153 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe3e0131cf0 0x7fe3e0132170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.634+0000 7fe3e535b700 1 -- 172.21.15.146:0/2128061153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3e006b080 msgr2=0x7fe3e01317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.634+0000 7fe3e535b700 1 --2- 172.21.15.146:0/2128061153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3e006b080 0x7fe3e01317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.634+0000 7fe3e535b700 1 -- 172.21.15.146:0/2128061153 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e009eb20 con 0x7fe3e006a770 2023-10-03T10:16:06.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.634+0000 7fe3e4b5a700 1 --2- 172.21.15.146:0/2128061153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3e006b080 0x7fe3e01317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:06.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.634+0000 7fe3e535b700 1 --2- 172.21.15.146:0/2128061153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3e006a770 0x7fe3e006ab40 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009840 tx=0x7fe3dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ace9106d3ed92b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.634+0000 7fe3d7fff700 1 -- 172.21.15.146:0/2128061153 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc010a90 con 0x7fe3e006a770 2023-10-03T10:16:06.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.634+0000 7fe3d7fff700 1 -- 172.21.15.146:0/2128061153 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3dc010bf0 con 0x7fe3e006a770 2023-10-03T10:16:06.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.634+0000 7fe3d7fff700 1 -- 172.21.15.146:0/2128061153 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc018440 con 0x7fe3e006a770 2023-10-03T10:16:06.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.635+0000 7fe3e75bf700 1 -- 172.21.15.146:0/2128061153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3e006a770 msgr2=0x7fe3e006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.635+0000 7fe3e75bf700 1 --2- 172.21.15.146:0/2128061153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3e006a770 0x7fe3e006ab40 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009840 tx=0x7fe3dc009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:06.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.635+0000 7fe3e75bf700 1 -- 172.21.15.146:0/2128061153 shutdown_connections 2023-10-03T10:16:06.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.635+0000 7fe3e75bf700 1 --2- 172.21.15.146:0/2128061153 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe3e0131cf0 0x7fe3e0132170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.635+0000 7fe3e75bf700 1 --2- 172.21.15.146:0/2128061153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3e006a770 0x7fe3e006ab40 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.635+0000 7fe3e75bf700 1 --2- 172.21.15.146:0/2128061153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3e006b080 0x7fe3e01317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.635+0000 7fe3e75bf700 1 -- 172.21.15.146:0/2128061153 >> 172.21.15.146:0/2128061153 conn(0x7fe3e0099c40 msgr2=0x7fe3e00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.635+0000 7fe3e75bf700 1 -- 172.21.15.146:0/2128061153 shutdown_connections 2023-10-03T10:16:06.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.635+0000 7fe3e75bf700 1 -- 172.21.15.146:0/2128061153 wait complete. 2023-10-03T10:16:06.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.636+0000 7fe3e75bf700 1 Processor -- start 2023-10-03T10:16:06.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.637+0000 7fe3e75bf700 1 -- start start 2023-10-03T10:16:06.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.637+0000 7fe3e75bf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3e006a770 0x7fe3e011c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.637+0000 7fe3e75bf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3e006b080 0x7fe3e011cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.637+0000 7fe3e75bf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe3e0131cf0 0x7fe3e01c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.637+0000 7fe3e75bf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e012f5d0 con 0x7fe3e006a770 2023-10-03T10:16:06.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.637+0000 7fe3e75bf700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e011f990 con 0x7fe3e006b080 2023-10-03T10:16:06.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.637+0000 7fe3e75bf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e011d110 con 0x7fe3e0131cf0 2023-10-03T10:16:06.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.637+0000 7fe3e4b5a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3e006b080 0x7fe3e011cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.637+0000 7fe3e4b5a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3e006b080 0x7fe3e011cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40200/0 (socket says 172.21.15.146:40200) 2023-10-03T10:16:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.637+0000 7fe3e4b5a700 1 -- 172.21.15.146:0/3361278373 learned_addr learned my addr 172.21.15.146:0/3361278373 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.637+0000 7fe3e535b700 1 --2- 172.21.15.146:0/3361278373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3e006a770 0x7fe3e011c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.637+0000 7fe3e5b5c700 1 --2- 172.21.15.146:0/3361278373 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe3e0131cf0 0x7fe3e01c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.638+0000 7fe3e4b5a700 1 -- 172.21.15.146:0/3361278373 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe3e0131cf0 msgr2=0x7fe3e01c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.638+0000 7fe3e4b5a700 1 --2- 172.21.15.146:0/3361278373 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe3e0131cf0 0x7fe3e01c3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.638+0000 7fe3e4b5a700 1 -- 172.21.15.146:0/3361278373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3e006a770 msgr2=0x7fe3e011c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.638+0000 7fe3e4b5a700 1 --2- 172.21.15.146:0/3361278373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3e006a770 0x7fe3e011c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.638+0000 7fe3e4b5a700 1 -- 172.21.15.146:0/3361278373 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d00094a0 con 0x7fe3e006b080 2023-10-03T10:16:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.638+0000 7fe3e535b700 1 --2- 172.21.15.146:0/3361278373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3e006a770 0x7fe3e011c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.638+0000 7fe3e4b5a700 1 --2- 172.21.15.146:0/3361278373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3e006b080 0x7fe3e011cbd0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000ebe0 tx=0x7fe3d000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.638+0000 7fe3d5ffb700 1 -- 172.21.15.146:0/3361278373 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d000c850 con 0x7fe3e006b080 2023-10-03T10:16:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.638+0000 7fe3d5ffb700 1 -- 172.21.15.146:0/3361278373 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d000c9b0 con 0x7fe3e006b080 2023-10-03T10:16:06.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.638+0000 7fe3d5ffb700 1 -- 172.21.15.146:0/3361278373 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d000cd40 con 0x7fe3e006b080 2023-10-03T10:16:06.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.638+0000 7fe3e75bf700 1 -- 172.21.15.146:0/3361278373 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3dc0094a0 con 0x7fe3e006b080 2023-10-03T10:16:06.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.638+0000 7fe3e75bf700 1 -- 172.21.15.146:0/3361278373 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e011c1a0 con 0x7fe3e006b080 2023-10-03T10:16:06.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.639+0000 7fe3e75bf700 1 -- 172.21.15.146:0/3361278373 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e004f2a0 con 0x7fe3e006b080 2023-10-03T10:16:06.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.639+0000 7fe3d5ffb700 1 -- 172.21.15.146:0/3361278373 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe3d0013470 con 0x7fe3e006b080 2023-10-03T10:16:06.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.639+0000 7fe3d5ffb700 1 -- 172.21.15.146:0/3361278373 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe3d003fba0 con 0x7fe3e006b080 2023-10-03T10:16:06.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.644+0000 7fe3d5ffb700 1 -- 172.21.15.146:0/3361278373 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe3d0013720 con 0x7fe3e006b080 2023-10-03T10:16:06.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.724+0000 7f4a14fd6700 1 -- 172.21.15.146:0/2459131215 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4a101247d0 con 0x7f4a10138040 2023-10-03T10:16:06.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.724+0000 7f49feffd700 1 -- 172.21.15.146:0/2459131215 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4a101247d0 con 0x7f4a10138040 2023-10-03T10:16:06.724 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:06.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.728+0000 7f4a14fd6700 1 -- 172.21.15.146:0/2459131215 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a10138040 msgr2=0x7f4a10121600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.728+0000 7f4a14fd6700 1 --2- 172.21.15.146:0/2459131215 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a10138040 0x7f4a10121600 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000c4d0 tx=0x7f4a0000c7e0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.728+0000 7f4a14fd6700 1 -- 172.21.15.146:0/2459131215 shutdown_connections 2023-10-03T10:16:06.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.728+0000 7f4a14fd6700 1 --2- 172.21.15.146:0/2459131215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a1013dd10 0x7f4a10122080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.728+0000 7f4a14fd6700 1 --2- 172.21.15.146:0/2459131215 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a10138040 0x7f4a10121600 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.728+0000 7f4a14fd6700 1 --2- 172.21.15.146:0/2459131215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a10138410 0x7f4a10121b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.728+0000 7f4a14fd6700 1 -- 172.21.15.146:0/2459131215 >> 172.21.15.146:0/2459131215 conn(0x7f4a100a2980 msgr2=0x7f4a1009d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.728+0000 7f4a14fd6700 1 -- 172.21.15.146:0/2459131215 shutdown_connections 2023-10-03T10:16:06.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.728+0000 7f4a14fd6700 1 -- 172.21.15.146:0/2459131215 wait complete. 2023-10-03T10:16:06.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:06.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.806+0000 7fa7f578b700 1 -- 172.21.15.146:0/4130014779 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa7f004f2a0 con 0x7fa7f0099a60 2023-10-03T10:16:06.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.807+0000 7fa7d77fe700 1 -- 172.21.15.146:0/4130014779 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa7e002b030 con 0x7fa7f0099a60 2023-10-03T10:16:06.807 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:06.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.809+0000 7fa7f578b700 1 -- 172.21.15.146:0/4130014779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7f0099a60 msgr2=0x7fa7f011b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.809+0000 7fa7f578b700 1 --2- 172.21.15.146:0/4130014779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7f0099a60 0x7fa7f011b830 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00724b0 tx=0x7fa7e0004750 comp rx=0 tx=0).stop 2023-10-03T10:16:06.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.809+0000 7fa7f578b700 1 -- 172.21.15.146:0/4130014779 shutdown_connections 2023-10-03T10:16:06.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.809+0000 7fa7f578b700 1 --2- 172.21.15.146:0/4130014779 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7f0133b80 0x7fa7f011c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.809+0000 7fa7f578b700 1 --2- 172.21.15.146:0/4130014779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7f0099a60 0x7fa7f011b830 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.809+0000 7fa7f578b700 1 --2- 172.21.15.146:0/4130014779 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7f00a0ff0 0x7fa7f011bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.809+0000 7fa7f578b700 1 -- 172.21.15.146:0/4130014779 >> 172.21.15.146:0/4130014779 conn(0x7fa7f00a2980 msgr2=0x7fa7f01baf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.809+0000 7fa7f578b700 1 -- 172.21.15.146:0/4130014779 shutdown_connections 2023-10-03T10:16:06.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.809+0000 7fa7f578b700 1 -- 172.21.15.146:0/4130014779 wait complete. 2023-10-03T10:16:06.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:06.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.837+0000 7ff3b93c5700 1 -- 172.21.15.146:0/3396380573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff3b411f6b0 con 0x7ff3b409d860 2023-10-03T10:16:06.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.837+0000 7ff39b7fe700 1 -- 172.21.15.146:0/3396380573 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff3a40070d0 con 0x7ff3b409d860 2023-10-03T10:16:06.837 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:06.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.839+0000 7ff3b93c5700 1 -- 172.21.15.146:0/3396380573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3b409d860 msgr2=0x7ff3b411c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.839+0000 7ff3b93c5700 1 --2- 172.21.15.146:0/3396380573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3b409d860 0x7ff3b411c1d0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4010ef0 tx=0x7ff3a4001c30 comp rx=0 tx=0).stop 2023-10-03T10:16:06.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.839+0000 7ff3b93c5700 1 -- 172.21.15.146:0/3396380573 shutdown_connections 2023-10-03T10:16:06.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.839+0000 7ff3b93c5700 1 --2- 172.21.15.146:0/3396380573 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff3b4135f20 0x7ff3b411cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.839+0000 7ff3b93c5700 1 --2- 172.21.15.146:0/3396380573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3b409d860 0x7ff3b411c1d0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.839+0000 7ff3b93c5700 1 --2- 172.21.15.146:0/3396380573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3b409e340 0x7ff3b411c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.839+0000 7ff3b93c5700 1 -- 172.21.15.146:0/3396380573 >> 172.21.15.146:0/3396380573 conn(0x7ff3b4099c40 msgr2=0x7ff3b40a1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.839+0000 7ff3b93c5700 1 -- 172.21.15.146:0/3396380573 shutdown_connections 2023-10-03T10:16:06.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.839+0000 7ff3b93c5700 1 -- 172.21.15.146:0/3396380573 wait complete. 2023-10-03T10:16:06.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.844+0000 7fe3e75bf700 1 -- 172.21.15.146:0/3361278373 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe3e011e4d0 con 0x7fe3e006b080 2023-10-03T10:16:06.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.845+0000 7fe3d5ffb700 1 -- 172.21.15.146:0/3361278373 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe3d0021070 con 0x7fe3e006b080 2023-10-03T10:16:06.844 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:06.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.847+0000 7fe3e75bf700 1 -- 172.21.15.146:0/3361278373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3e006b080 msgr2=0x7fe3e011cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.847+0000 7fe3e75bf700 1 --2- 172.21.15.146:0/3361278373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3e006b080 0x7fe3e011cbd0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000ebe0 tx=0x7fe3d000eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.847+0000 7fe3e75bf700 1 -- 172.21.15.146:0/3361278373 shutdown_connections 2023-10-03T10:16:06.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.847+0000 7fe3e75bf700 1 --2- 172.21.15.146:0/3361278373 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe3e0131cf0 0x7fe3e01c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.847+0000 7fe3e75bf700 1 --2- 172.21.15.146:0/3361278373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3e006a770 0x7fe3e011c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.847+0000 7fe3e75bf700 1 --2- 172.21.15.146:0/3361278373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3e006b080 0x7fe3e011cbd0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.847+0000 7fe3e75bf700 1 -- 172.21.15.146:0/3361278373 >> 172.21.15.146:0/3361278373 conn(0x7fe3e0099c40 msgr2=0x7fe3e0130d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.847+0000 7fe3e75bf700 1 -- 172.21.15.146:0/3361278373 shutdown_connections 2023-10-03T10:16:06.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:06.847+0000 7fe3e75bf700 1 -- 172.21.15.146:0/3361278373 wait complete. 2023-10-03T10:16:06.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:06.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:07.745 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:07.825 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:07.852 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:07.860 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:07.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.878+0000 7f8477d3f700 1 Processor -- start 2023-10-03T10:16:07.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.879+0000 7f8477d3f700 1 -- start start 2023-10-03T10:16:07.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.879+0000 7f8477d3f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8470099e20 0x7f847009a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.879+0000 7f8477d3f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8470130a60 0x7f8470138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.879+0000 7f8477d3f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8470099a60 con 0x7f847009a730 2023-10-03T10:16:07.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.879+0000 7f8477d3f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f847009bf50 con 0x7f8470099e20 2023-10-03T10:16:07.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.879+0000 7f8477d3f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847009b230 con 0x7f8470130a60 2023-10-03T10:16:07.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.879+0000 7f8475adb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8470099e20 0x7f847009a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.879+0000 7f8475adb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8470099e20 0x7f847009a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59520/0 (socket says 172.21.15.146:59520) 2023-10-03T10:16:07.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.879+0000 7f84762dc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8470130a60 0x7f8470138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.879+0000 7f8475adb700 1 -- 172.21.15.146:0/1685705453 learned_addr learned my addr 172.21.15.146:0/1685705453 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:07.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.880+0000 7f84762dc700 1 -- 172.21.15.146:0/1685705453 >> v2:172.21.15.146:3300/0 conn(0x7f8470099e20 msgr2=0x7f847009a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:07.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.880+0000 7f84762dc700 1 --2- 172.21.15.146:0/1685705453 >> v2:172.21.15.146:3300/0 conn(0x7f8470099e20 0x7f847009a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.880+0000 7f84762dc700 1 -- 172.21.15.146:0/1685705453 >> v1:172.21.15.146:6789/0 conn(0x7f847009a730 legacy=0x7f8470130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.880+0000 7f84762dc700 1 -- 172.21.15.146:0/1685705453 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847009bb90 con 0x7f8470130a60 2023-10-03T10:16:07.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.880+0000 7f8475adb700 1 --2- 172.21.15.146:0/1685705453 >> v2:172.21.15.146:3300/0 conn(0x7f8470099e20 0x7f847009a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:07.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.880+0000 7f84762dc700 1 --2- 172.21.15.146:0/1685705453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8470130a60 0x7f8470138690 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8468009d90 tx=0x7f846800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c23c4c7a0093e0fe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:07.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.880+0000 7f8474ad9700 1 -- 172.21.15.146:0/1685705453 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846800e070 con 0x7f8470130a60 2023-10-03T10:16:07.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.880+0000 7f8474ad9700 1 -- 172.21.15.146:0/1685705453 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846800bb20 con 0x7f8470130a60 2023-10-03T10:16:07.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.880+0000 7f8474ad9700 1 -- 172.21.15.146:0/1685705453 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468012430 con 0x7f8470130a60 2023-10-03T10:16:07.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.881+0000 7f8477d3f700 1 -- 172.21.15.146:0/1685705453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8470130a60 msgr2=0x7f8470138690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.881+0000 7f8477d3f700 1 --2- 172.21.15.146:0/1685705453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8470130a60 0x7f8470138690 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8468009d90 tx=0x7f846800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:07.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.881+0000 7f8477d3f700 1 -- 172.21.15.146:0/1685705453 shutdown_connections 2023-10-03T10:16:07.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.881+0000 7f8477d3f700 1 --2- 172.21.15.146:0/1685705453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8470130a60 0x7f8470138690 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.881+0000 7f8477d3f700 1 --2- 172.21.15.146:0/1685705453 >> v2:172.21.15.146:3300/0 conn(0x7f8470099e20 0x7f847009a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.881+0000 7f8477d3f700 1 -- 172.21.15.146:0/1685705453 >> 172.21.15.146:0/1685705453 conn(0x7f84700a2980 msgr2=0x7f84700a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:07.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.881+0000 7f8477d3f700 1 -- 172.21.15.146:0/1685705453 shutdown_connections 2023-10-03T10:16:07.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.881+0000 7f8477d3f700 1 -- 172.21.15.146:0/1685705453 wait complete. 2023-10-03T10:16:07.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.882+0000 7f8477d3f700 1 Processor -- start 2023-10-03T10:16:07.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.883+0000 7f8477d3f700 1 -- start start 2023-10-03T10:16:07.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.883+0000 7f8477d3f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8470099e20 0x7f847011b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.883+0000 7f8477d3f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f847009a730 0x7f847011bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.883+0000 7f8477d3f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8470130a60 0x7f847011c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.883+0000 7f8477d3f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847012dbd0 con 0x7f847009a730 2023-10-03T10:16:07.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.883+0000 7f8477d3f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847011f2f0 con 0x7f8470099e20 2023-10-03T10:16:07.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.883+0000 7f8477d3f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f847011e6a0 con 0x7f8470130a60 2023-10-03T10:16:07.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.883+0000 7f8475adb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8470099e20 0x7f847011b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.883+0000 7f8475adb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8470099e20 0x7f847011b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40224/0 (socket says 172.21.15.146:40224) 2023-10-03T10:16:07.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.883+0000 7f8475adb700 1 -- 172.21.15.146:0/824496753 learned_addr learned my addr 172.21.15.146:0/824496753 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:07.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.883+0000 7f8475adb700 1 -- 172.21.15.146:0/824496753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8470130a60 msgr2=0x7f847011c2e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:16:07.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.883+0000 7f8475adb700 1 --2- 172.21.15.146:0/824496753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8470130a60 0x7f847011c2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.883+0000 7f8475adb700 1 -- 172.21.15.146:0/824496753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f847009a730 msgr2=0x7f847011bda0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:16:07.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.884+0000 7f8475adb700 1 --2- 172.21.15.146:0/824496753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f847009a730 0x7f847011bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.884+0000 7f8475adb700 1 -- 172.21.15.146:0/824496753 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c00d9a0 con 0x7f8470099e20 2023-10-03T10:16:07.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.884+0000 7f8475adb700 1 --2- 172.21.15.146:0/824496753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8470099e20 0x7f847011b860 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f846c012f90 tx=0x7f846c0103a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:07.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.884+0000 7f84667fc700 1 -- 172.21.15.146:0/824496753 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c005c20 con 0x7f8470099e20 2023-10-03T10:16:07.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.884+0000 7f84667fc700 1 -- 172.21.15.146:0/824496753 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846c013040 con 0x7f8470099e20 2023-10-03T10:16:07.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.884+0000 7f84667fc700 1 -- 172.21.15.146:0/824496753 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c00d2e0 con 0x7f8470099e20 2023-10-03T10:16:07.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.884+0000 7f8477d3f700 1 -- 172.21.15.146:0/824496753 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8468009a70 con 0x7f8470099e20 2023-10-03T10:16:07.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.884+0000 7f8477d3f700 1 -- 172.21.15.146:0/824496753 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f847009b470 con 0x7f8470099e20 2023-10-03T10:16:07.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.885+0000 7f84667fc700 1 -- 172.21.15.146:0/824496753 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f846c0109b0 con 0x7f8470099e20 2023-10-03T10:16:07.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.885+0000 7f84667fc700 1 -- 172.21.15.146:0/824496753 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f846c043c30 con 0x7f8470099e20 2023-10-03T10:16:07.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.885+0000 7f8477d3f700 1 -- 172.21.15.146:0/824496753 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f847004f2a0 con 0x7f8470099e20 2023-10-03T10:16:07.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.890+0000 7f84667fc700 1 -- 172.21.15.146:0/824496753 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f846c010c60 con 0x7f8470099e20 2023-10-03T10:16:07.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.970+0000 7fdfb81f4700 1 Processor -- start 2023-10-03T10:16:07.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.970+0000 7fdfb81f4700 1 -- start start 2023-10-03T10:16:07.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.971+0000 7fdfb81f4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfb0133ad0 0x7fdfb0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.971+0000 7fdfb81f4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfb0130bc0 0x7fdfb013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.971+0000 7fdfb81f4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb006b2d0 con 0x7fdfb01300a0 2023-10-03T10:16:07.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.971+0000 7fdfb81f4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb0133610 con 0x7fdfb0130bc0 2023-10-03T10:16:07.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.971+0000 7fdfb81f4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb009a500 con 0x7fdfb0133ad0 2023-10-03T10:16:07.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.971+0000 7fdfb578f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdfb01300a0 0x7fdfb01304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45988/0 (socket says 172.21.15.146:45988) 2023-10-03T10:16:07.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.971+0000 7fdfb6791700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfb0130bc0 0x7fdfb013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.971+0000 7fdfb578f700 1 -- 172.21.15.146:0/3475481763 learned_addr learned my addr 172.21.15.146:0/3475481763 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:07.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.972+0000 7fdfb5f90700 1 --2- 172.21.15.146:0/3475481763 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfb0133ad0 0x7fdfb0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.972+0000 7fdfb4f8e700 1 -- 172.21.15.146:0/3475481763 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 346777537 0 0) 0x7fdfb006b2d0 con 0x7fdfb01300a0 2023-10-03T10:16:07.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.972+0000 7fdfb6791700 1 -- 172.21.15.146:0/3475481763 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfb0133ad0 msgr2=0x7fdfb0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:07.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.972+0000 7fdfb6791700 1 --2- 172.21.15.146:0/3475481763 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfb0133ad0 0x7fdfb0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.972+0000 7fdfb6791700 1 -- 172.21.15.146:0/3475481763 >> v1:172.21.15.146:6789/0 conn(0x7fdfb01300a0 legacy=0x7fdfb01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.972+0000 7fdfb6791700 1 -- 172.21.15.146:0/3475481763 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb01338b0 con 0x7fdfb0130bc0 2023-10-03T10:16:07.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.972+0000 7fdfb6791700 1 --2- 172.21.15.146:0/3475481763 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfb0130bc0 0x7fdfb013b990 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009dc0 tx=0x7fdfa800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e380dc76b438001 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:07.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.972+0000 7fdfb4f8e700 1 -- 172.21.15.146:0/3475481763 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa800e070 con 0x7fdfb0130bc0 2023-10-03T10:16:07.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.972+0000 7fdfb4f8e700 1 -- 172.21.15.146:0/3475481763 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa800bb20 con 0x7fdfb0130bc0 2023-10-03T10:16:07.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.972+0000 7fdfb4f8e700 1 -- 172.21.15.146:0/3475481763 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8012430 con 0x7fdfb0130bc0 2023-10-03T10:16:07.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.973+0000 7fdfb81f4700 1 -- 172.21.15.146:0/3475481763 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfb0130bc0 msgr2=0x7fdfb013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.973+0000 7fdfb81f4700 1 --2- 172.21.15.146:0/3475481763 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfb0130bc0 0x7fdfb013b990 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009dc0 tx=0x7fdfa800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:07.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.973+0000 7fdfb81f4700 1 -- 172.21.15.146:0/3475481763 shutdown_connections 2023-10-03T10:16:07.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.973+0000 7fdfb81f4700 1 --2- 172.21.15.146:0/3475481763 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfb0130bc0 0x7fdfb013b990 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.973+0000 7fdfb81f4700 1 --2- 172.21.15.146:0/3475481763 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfb0133ad0 0x7fdfb0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.973+0000 7fdfb81f4700 1 -- 172.21.15.146:0/3475481763 >> 172.21.15.146:0/3475481763 conn(0x7fdfb0099c40 msgr2=0x7fdfb00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:07.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.973+0000 7fdfb81f4700 1 -- 172.21.15.146:0/3475481763 shutdown_connections 2023-10-03T10:16:07.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.973+0000 7fdfb81f4700 1 -- 172.21.15.146:0/3475481763 wait complete. 2023-10-03T10:16:07.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.974+0000 7fdfb81f4700 1 Processor -- start 2023-10-03T10:16:07.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.974+0000 7fdfb81f4700 1 -- start start 2023-10-03T10:16:07.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.975+0000 7fdfb81f4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfb01300a0 0x7fdfb011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.975+0000 7fdfb81f4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfb0130bc0 0x7fdfb011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.975+0000 7fdfb81f4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfb0133ad0 0x7fdfb011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.975+0000 7fdfb81f4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb011feb0 con 0x7fdfb01300a0 2023-10-03T10:16:07.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.975+0000 7fdfb81f4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb011f9a0 con 0x7fdfb0133ad0 2023-10-03T10:16:07.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.975+0000 7fdfb81f4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb0120820 con 0x7fdfb0130bc0 2023-10-03T10:16:07.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.975+0000 7fdfb578f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfb0130bc0 0x7fdfb011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.975+0000 7fdfb578f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfb0130bc0 0x7fdfb011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38992/0 (socket says 172.21.15.146:38992) 2023-10-03T10:16:07.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.975+0000 7fdfb578f700 1 -- 172.21.15.146:0/336464727 learned_addr learned my addr 172.21.15.146:0/336464727 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:07.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.975+0000 7fdfb578f700 1 -- 172.21.15.146:0/336464727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfb0133ad0 msgr2=0x7fdfb011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.975+0000 7fdfb578f700 1 --2- 172.21.15.146:0/336464727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfb0133ad0 0x7fdfb011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.975+0000 7fdfb578f700 1 -- 172.21.15.146:0/336464727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfb01300a0 msgr2=0x7fdfb011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.975+0000 7fdfb578f700 1 --2- 172.21.15.146:0/336464727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfb01300a0 0x7fdfb011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.975+0000 7fdfb578f700 1 -- 172.21.15.146:0/336464727 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa8009a70 con 0x7fdfb0130bc0 2023-10-03T10:16:07.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.975+0000 7fdfb578f700 1 --2- 172.21.15.146:0/336464727 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfb0130bc0 0x7fdfb011df80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000c450 tx=0x7fdfa000c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:07.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.976+0000 7fdfa67fc700 1 -- 172.21.15.146:0/336464727 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0004c80 con 0x7fdfb0130bc0 2023-10-03T10:16:07.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.976+0000 7fdfa67fc700 1 -- 172.21.15.146:0/336464727 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa0004e00 con 0x7fdfb0130bc0 2023-10-03T10:16:07.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.976+0000 7fdfb81f4700 1 -- 172.21.15.146:0/336464727 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb011f640 con 0x7fdfb0130bc0 2023-10-03T10:16:07.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.976+0000 7fdfa67fc700 1 -- 172.21.15.146:0/336464727 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0007310 con 0x7fdfb0130bc0 2023-10-03T10:16:07.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.976+0000 7fdfb81f4700 1 -- 172.21.15.146:0/336464727 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb0071f00 con 0x7fdfb0130bc0 2023-10-03T10:16:07.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.977+0000 7fdfa67fc700 1 -- 172.21.15.146:0/336464727 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdfa0007470 con 0x7fdfb0130bc0 2023-10-03T10:16:07.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.977+0000 7fdfb81f4700 1 -- 172.21.15.146:0/336464727 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb00a2620 con 0x7fdfb0130bc0 2023-10-03T10:16:07.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.977+0000 7fdfa67fc700 1 -- 172.21.15.146:0/336464727 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdfa003f520 con 0x7fdfb0130bc0 2023-10-03T10:16:07.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:07.986+0000 7fdfa67fc700 1 -- 172.21.15.146:0/336464727 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdfa0007720 con 0x7fdfb0130bc0 2023-10-03T10:16:08.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.006+0000 7fca264fa700 1 Processor -- start 2023-10-03T10:16:08.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.006+0000 7fca264fa700 1 -- start start 2023-10-03T10:16:08.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.006+0000 7fca264fa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca20138040 0x7fca20138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.007+0000 7fca264fa700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca200a1400 0x7fca2013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.007+0000 7fca264fa700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca201379e0 con 0x7fca200a08e0 2023-10-03T10:16:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.007+0000 7fca264fa700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca200a2100 con 0x7fca200a1400 2023-10-03T10:16:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.007+0000 7fca264fa700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca20138950 con 0x7fca20138040 2023-10-03T10:16:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.007+0000 7fca1ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca20138040 0x7fca20138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.007+0000 7fca1ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca20138040 0x7fca20138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40254/0 (socket says 172.21.15.146:40254) 2023-10-03T10:16:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.007+0000 7fca24a97700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca200a1400 0x7fca2013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.007+0000 7fca1ffff700 1 -- 172.21.15.146:0/2225554317 learned_addr learned my addr 172.21.15.146:0/2225554317 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.007+0000 7fca24a97700 1 -- 172.21.15.146:0/2225554317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca20138040 msgr2=0x7fca20138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.007+0000 7fca24a97700 1 --2- 172.21.15.146:0/2225554317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca20138040 0x7fca20138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.007+0000 7fca24a97700 1 -- 172.21.15.146:0/2225554317 >> v1:172.21.15.146:6789/0 conn(0x7fca200a08e0 legacy=0x7fca200a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.007+0000 7fca24a97700 1 -- 172.21.15.146:0/2225554317 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2009b9b0 con 0x7fca200a1400 2023-10-03T10:16:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.007+0000 7fca24a97700 1 --2- 172.21.15.146:0/2225554317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca200a1400 0x7fca2013fd20 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fca18009dc0 tx=0x7fca1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b68de4e56143506 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.007+0000 7fca1effd700 1 -- 172.21.15.146:0/2225554317 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1800e070 con 0x7fca200a1400 2023-10-03T10:16:08.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.008+0000 7fca1effd700 1 -- 172.21.15.146:0/2225554317 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1800bae0 con 0x7fca200a1400 2023-10-03T10:16:08.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.008+0000 7fca1effd700 1 -- 172.21.15.146:0/2225554317 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1800be90 con 0x7fca200a1400 2023-10-03T10:16:08.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.008+0000 7fca264fa700 1 -- 172.21.15.146:0/2225554317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca200a1400 msgr2=0x7fca2013fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.008+0000 7fca264fa700 1 --2- 172.21.15.146:0/2225554317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca200a1400 0x7fca2013fd20 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fca18009dc0 tx=0x7fca1800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:08.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.008+0000 7fca264fa700 1 -- 172.21.15.146:0/2225554317 shutdown_connections 2023-10-03T10:16:08.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.008+0000 7fca264fa700 1 --2- 172.21.15.146:0/2225554317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca200a1400 0x7fca2013fd20 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.008+0000 7fca264fa700 1 --2- 172.21.15.146:0/2225554317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca20138040 0x7fca20138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.008+0000 7fca264fa700 1 -- 172.21.15.146:0/2225554317 >> 172.21.15.146:0/2225554317 conn(0x7fca200a2980 msgr2=0x7fca200a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.009+0000 7fca264fa700 1 -- 172.21.15.146:0/2225554317 shutdown_connections 2023-10-03T10:16:08.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.009+0000 7fca264fa700 1 -- 172.21.15.146:0/2225554317 wait complete. 2023-10-03T10:16:08.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.010+0000 7fca264fa700 1 Processor -- start 2023-10-03T10:16:08.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.010+0000 7fca264fa700 1 -- start start 2023-10-03T10:16:08.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.011+0000 7fca264fa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca200a08e0 0x7fca201265d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.011+0000 7fca264fa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca200a1400 0x7fca20126b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.011+0000 7fca264fa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fca20138040 0x7fca20127050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.011+0000 7fca264fa700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca20129e10 con 0x7fca200a08e0 2023-10-03T10:16:08.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.011+0000 7fca264fa700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca201282f0 con 0x7fca200a1400 2023-10-03T10:16:08.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.011+0000 7fca264fa700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca20137760 con 0x7fca20138040 2023-10-03T10:16:08.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.011+0000 7fca1ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca200a08e0 0x7fca201265d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.011+0000 7fca24a97700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fca20138040 0x7fca20127050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.011+0000 7fca1ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca200a08e0 0x7fca201265d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59568/0 (socket says 172.21.15.146:59568) 2023-10-03T10:16:08.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.011+0000 7fca24a97700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fca20138040 0x7fca20127050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39006/0 (socket says 172.21.15.146:39006) 2023-10-03T10:16:08.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.011+0000 7fca1ffff700 1 -- 172.21.15.146:0/3729987599 learned_addr learned my addr 172.21.15.146:0/3729987599 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:08.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.011+0000 7fca1f7fe700 1 --2- 172.21.15.146:0/3729987599 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca200a1400 0x7fca20126b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.011+0000 7fca1ffff700 1 -- 172.21.15.146:0/3729987599 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fca20138040 msgr2=0x7fca20127050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.011+0000 7fca1ffff700 1 --2- 172.21.15.146:0/3729987599 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fca20138040 0x7fca20127050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.011+0000 7fca1ffff700 1 -- 172.21.15.146:0/3729987599 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca200a1400 msgr2=0x7fca20126b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.011+0000 7fca1ffff700 1 --2- 172.21.15.146:0/3729987599 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca200a1400 0x7fca20126b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.011+0000 7fca1ffff700 1 -- 172.21.15.146:0/3729987599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca18009a70 con 0x7fca200a08e0 2023-10-03T10:16:08.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.011+0000 7fca1f7fe700 1 --2- 172.21.15.146:0/3729987599 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca200a1400 0x7fca20126b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:08.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.012+0000 7fca1ffff700 1 --2- 172.21.15.146:0/3729987599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca200a08e0 0x7fca201265d0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fca1000e8c0 tx=0x7fca1000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.012+0000 7fca1cff9700 1 -- 172.21.15.146:0/3729987599 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10013680 con 0x7fca200a08e0 2023-10-03T10:16:08.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.012+0000 7fca1cff9700 1 -- 172.21.15.146:0/3729987599 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca100137e0 con 0x7fca200a08e0 2023-10-03T10:16:08.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.012+0000 7fca1cff9700 1 -- 172.21.15.146:0/3729987599 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10013b90 con 0x7fca200a08e0 2023-10-03T10:16:08.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.012+0000 7fca264fa700 1 -- 172.21.15.146:0/3729987599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2009a240 con 0x7fca200a08e0 2023-10-03T10:16:08.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.012+0000 7fca264fa700 1 -- 172.21.15.146:0/3729987599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2012a880 con 0x7fca200a08e0 2023-10-03T10:16:08.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.013+0000 7fca1cff9700 1 -- 172.21.15.146:0/3729987599 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fca10013cf0 con 0x7fca200a08e0 2023-10-03T10:16:08.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.013+0000 7fca264fa700 1 -- 172.21.15.146:0/3729987599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca20138ad0 con 0x7fca200a08e0 2023-10-03T10:16:08.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.013+0000 7fca1cff9700 1 -- 172.21.15.146:0/3729987599 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fca1003fb40 con 0x7fca200a08e0 2023-10-03T10:16:08.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.018+0000 7fca1cff9700 1 -- 172.21.15.146:0/3729987599 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca10011db0 con 0x7fca200a08e0 2023-10-03T10:16:08.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.022+0000 7f90cf4fc700 1 Processor -- start 2023-10-03T10:16:08.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.022+0000 7f90cf4fc700 1 -- start start 2023-10-03T10:16:08.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.022+0000 7f90cf4fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90c809d860 0x7f90c809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.022+0000 7f90cf4fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f90c809e170 0x7f90c81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.022+0000 7f90cf4fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90c8130ce0 0x7f90c8131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.022+0000 7f90cf4fc700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c809aaa0 con 0x7f90c809e170 2023-10-03T10:16:08.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.022+0000 7f90cf4fc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c809f870 con 0x7f90c809d860 2023-10-03T10:16:08.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.022+0000 7f90cf4fc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90c809b360 con 0x7f90c8130ce0 2023-10-03T10:16:08.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.022+0000 7f90cd298700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90c809d860 0x7f90c809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.022+0000 7f90cca97700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f90c809e170 0x7f90c81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.022+0000 7f90cca97700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f90c809e170 0x7f90c81307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59572/0 (socket says 172.21.15.146:59572) 2023-10-03T10:16:08.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.023+0000 7f90cca97700 1 -- 172.21.15.146:0/2808648907 learned_addr learned my addr 172.21.15.146:0/2808648907 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:08.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.023+0000 7f90cd298700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90c809d860 0x7f90c809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40274/0 (socket says 172.21.15.146:40274) 2023-10-03T10:16:08.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.023+0000 7f90cda99700 1 --2- 172.21.15.146:0/2808648907 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90c8130ce0 0x7f90c8131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.023+0000 7f90cca97700 1 -- 172.21.15.146:0/2808648907 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90c8130ce0 msgr2=0x7f90c8131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.023+0000 7f90cca97700 1 --2- 172.21.15.146:0/2808648907 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90c8130ce0 0x7f90c8131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.023+0000 7f90cca97700 1 -- 172.21.15.146:0/2808648907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90c809d860 msgr2=0x7f90c809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.023+0000 7f90cca97700 1 --2- 172.21.15.146:0/2808648907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90c809d860 0x7f90c809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.023+0000 7f90cca97700 1 -- 172.21.15.146:0/2808648907 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c809b620 con 0x7f90c809e170 2023-10-03T10:16:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.023+0000 7f90cd298700 1 --2- 172.21.15.146:0/2808648907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90c809d860 0x7f90c809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:08.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.023+0000 7f90cca97700 1 --2- 172.21.15.146:0/2808648907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90c809e170 0x7f90c81307a0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f90b800dd10 tx=0x7f90b800f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eebdd88a28d9329 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.023+0000 7f90bffff700 1 -- 172.21.15.146:0/2808648907 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b8012070 con 0x7f90c809e170 2023-10-03T10:16:08.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.023+0000 7f90bffff700 1 -- 172.21.15.146:0/2808648907 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b800d2e0 con 0x7f90c809e170 2023-10-03T10:16:08.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.023+0000 7f90bffff700 1 -- 172.21.15.146:0/2808648907 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b800fb10 con 0x7f90c809e170 2023-10-03T10:16:08.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.024+0000 7f90cf4fc700 1 -- 172.21.15.146:0/2808648907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90c809e170 msgr2=0x7f90c81307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.024+0000 7f90cf4fc700 1 --2- 172.21.15.146:0/2808648907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90c809e170 0x7f90c81307a0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f90b800dd10 tx=0x7f90b800f330 comp rx=0 tx=0).stop 2023-10-03T10:16:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.024+0000 7f90cf4fc700 1 -- 172.21.15.146:0/2808648907 shutdown_connections 2023-10-03T10:16:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.024+0000 7f90cf4fc700 1 --2- 172.21.15.146:0/2808648907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90c809d860 0x7f90c809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.024+0000 7f90cf4fc700 1 --2- 172.21.15.146:0/2808648907 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90c8130ce0 0x7f90c8131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.024+0000 7f90cf4fc700 1 --2- 172.21.15.146:0/2808648907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90c809e170 0x7f90c81307a0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.024+0000 7f90cf4fc700 1 -- 172.21.15.146:0/2808648907 >> 172.21.15.146:0/2808648907 conn(0x7f90c8099c40 msgr2=0x7f90c80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.024+0000 7f90cf4fc700 1 -- 172.21.15.146:0/2808648907 shutdown_connections 2023-10-03T10:16:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.024+0000 7f90cf4fc700 1 -- 172.21.15.146:0/2808648907 wait complete. 2023-10-03T10:16:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.025+0000 7f90cf4fc700 1 Processor -- start 2023-10-03T10:16:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.025+0000 7f90cf4fc700 1 -- start start 2023-10-03T10:16:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.026+0000 7f90cf4fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90c809d860 0x7f90c8122740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.026+0000 7f90cf4fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90c809e170 0x7f90c8122c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.026+0000 7f90cf4fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90c8130ce0 0x7f90c81231c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.026+0000 7f90cf4fc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c8124350 con 0x7f90c809d860 2023-10-03T10:16:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.026+0000 7f90cf4fc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c8124bc0 con 0x7f90c809e170 2023-10-03T10:16:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.026+0000 7f90cf4fc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90c80a23d0 con 0x7f90c8130ce0 2023-10-03T10:16:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.026+0000 7f90cca97700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90c809e170 0x7f90c8122c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.026+0000 7f90cda99700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90c8130ce0 0x7f90c81231c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.026+0000 7f90cda99700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90c8130ce0 0x7f90c81231c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39014/0 (socket says 172.21.15.146:39014) 2023-10-03T10:16:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.026+0000 7f90cda99700 1 -- 172.21.15.146:0/2258272404 learned_addr learned my addr 172.21.15.146:0/2258272404 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.026+0000 7f90cd298700 1 --2- 172.21.15.146:0/2258272404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90c809d860 0x7f90c8122740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.026+0000 7f90cda99700 1 -- 172.21.15.146:0/2258272404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90c809e170 msgr2=0x7f90c8122c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.026+0000 7f90cda99700 1 --2- 172.21.15.146:0/2258272404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90c809e170 0x7f90c8122c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.026+0000 7f90cda99700 1 -- 172.21.15.146:0/2258272404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90c809d860 msgr2=0x7f90c8122740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.026+0000 7f90cda99700 1 --2- 172.21.15.146:0/2258272404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90c809d860 0x7f90c8122740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.026+0000 7f90cda99700 1 -- 172.21.15.146:0/2258272404 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c40094a0 con 0x7f90c8130ce0 2023-10-03T10:16:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.026+0000 7f90cda99700 1 --2- 172.21.15.146:0/2258272404 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90c8130ce0 0x7f90c81231c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f90c000efc0 tx=0x7f90c000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.026+0000 7f90bdffb700 1 -- 172.21.15.146:0/2258272404 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c0009ea0 con 0x7f90c8130ce0 2023-10-03T10:16:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.027+0000 7f90bdffb700 1 -- 172.21.15.146:0/2258272404 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c000f040 con 0x7f90c8130ce0 2023-10-03T10:16:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.027+0000 7f90bdffb700 1 -- 172.21.15.146:0/2258272404 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c0014480 con 0x7f90c8130ce0 2023-10-03T10:16:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.027+0000 7f90cf4fc700 1 -- 172.21.15.146:0/2258272404 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b800d9f0 con 0x7f90c8130ce0 2023-10-03T10:16:08.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.027+0000 7f90cf4fc700 1 -- 172.21.15.146:0/2258272404 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c8125cc0 con 0x7f90c8130ce0 2023-10-03T10:16:08.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.028+0000 7f90cf4fc700 1 -- 172.21.15.146:0/2258272404 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c804f2a0 con 0x7f90c8130ce0 2023-10-03T10:16:08.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.028+0000 7f90bdffb700 1 -- 172.21.15.146:0/2258272404 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f90c00145e0 con 0x7f90c8130ce0 2023-10-03T10:16:08.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.028+0000 7f90bdffb700 1 -- 172.21.15.146:0/2258272404 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f90c00407b0 con 0x7f90c8130ce0 2023-10-03T10:16:08.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.032+0000 7f90bdffb700 1 -- 172.21.15.146:0/2258272404 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f90c0012910 con 0x7f90c8130ce0 2023-10-03T10:16:08.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.097+0000 7f8477d3f700 1 -- 172.21.15.146:0/824496753 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f847011f0d0 con 0x7f8470099e20 2023-10-03T10:16:08.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.097+0000 7f84667fc700 1 -- 172.21.15.146:0/824496753 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f846c018e40 con 0x7f8470099e20 2023-10-03T10:16:08.098 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:08.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.099+0000 7f8477d3f700 1 -- 172.21.15.146:0/824496753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8470099e20 msgr2=0x7f847011b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.099+0000 7f8477d3f700 1 --2- 172.21.15.146:0/824496753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8470099e20 0x7f847011b860 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f846c012f90 tx=0x7f846c0103a0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.099+0000 7f8477d3f700 1 -- 172.21.15.146:0/824496753 shutdown_connections 2023-10-03T10:16:08.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.099+0000 7f8477d3f700 1 --2- 172.21.15.146:0/824496753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8470130a60 0x7f847011c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.099+0000 7f8477d3f700 1 --2- 172.21.15.146:0/824496753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8470099e20 0x7f847011b860 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.099+0000 7f8477d3f700 1 --2- 172.21.15.146:0/824496753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f847009a730 0x7f847011bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.099+0000 7f8477d3f700 1 -- 172.21.15.146:0/824496753 >> 172.21.15.146:0/824496753 conn(0x7f84700a2980 msgr2=0x7f847009df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.100+0000 7f8477d3f700 1 -- 172.21.15.146:0/824496753 shutdown_connections 2023-10-03T10:16:08.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.100+0000 7f8477d3f700 1 -- 172.21.15.146:0/824496753 wait complete. 2023-10-03T10:16:08.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:08.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.218+0000 7fdfb81f4700 1 -- 172.21.15.146:0/336464727 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdfb004f2a0 con 0x7fdfb0130bc0 2023-10-03T10:16:08.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.219+0000 7fdfa67fc700 1 -- 172.21.15.146:0/336464727 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdfa0011360 con 0x7fdfb0130bc0 2023-10-03T10:16:08.220 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:08.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.221+0000 7fdfb81f4700 1 -- 172.21.15.146:0/336464727 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfb0130bc0 msgr2=0x7fdfb011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.221+0000 7fdfb81f4700 1 --2- 172.21.15.146:0/336464727 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfb0130bc0 0x7fdfb011df80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000c450 tx=0x7fdfa000c810 comp rx=0 tx=0).stop 2023-10-03T10:16:08.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.221+0000 7fdfb81f4700 1 -- 172.21.15.146:0/336464727 shutdown_connections 2023-10-03T10:16:08.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.221+0000 7fdfb81f4700 1 --2- 172.21.15.146:0/336464727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfb0133ad0 0x7fdfb011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.221+0000 7fdfb81f4700 1 --2- 172.21.15.146:0/336464727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfb01300a0 0x7fdfb011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.221+0000 7fdfb81f4700 1 --2- 172.21.15.146:0/336464727 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfb0130bc0 0x7fdfb011df80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.221+0000 7fdfb81f4700 1 -- 172.21.15.146:0/336464727 >> 172.21.15.146:0/336464727 conn(0x7fdfb0099c40 msgr2=0x7fdfb0132b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.221+0000 7fdfb81f4700 1 -- 172.21.15.146:0/336464727 shutdown_connections 2023-10-03T10:16:08.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.221+0000 7fdfb81f4700 1 -- 172.21.15.146:0/336464727 wait complete. 2023-10-03T10:16:08.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.228+0000 7f90cf4fc700 1 -- 172.21.15.146:0/2258272404 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f90c8125eb0 con 0x7f90c8130ce0 2023-10-03T10:16:08.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.229+0000 7f90bdffb700 1 -- 172.21.15.146:0/2258272404 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f90c0012340 con 0x7f90c8130ce0 2023-10-03T10:16:08.229 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:08.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.231+0000 7f90cf4fc700 1 -- 172.21.15.146:0/2258272404 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90c8130ce0 msgr2=0x7f90c81231c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.231+0000 7f90cf4fc700 1 --2- 172.21.15.146:0/2258272404 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90c8130ce0 0x7f90c81231c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f90c000efc0 tx=0x7f90c000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.231+0000 7f90cf4fc700 1 -- 172.21.15.146:0/2258272404 shutdown_connections 2023-10-03T10:16:08.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.231+0000 7f90cf4fc700 1 --2- 172.21.15.146:0/2258272404 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90c8130ce0 0x7f90c81231c0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.231+0000 7f90cf4fc700 1 --2- 172.21.15.146:0/2258272404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90c809d860 0x7f90c8122740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.231+0000 7f90cf4fc700 1 --2- 172.21.15.146:0/2258272404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90c809e170 0x7f90c8122c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.231+0000 7f90cf4fc700 1 -- 172.21.15.146:0/2258272404 >> 172.21.15.146:0/2258272404 conn(0x7f90c8099c40 msgr2=0x7f90c80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.231+0000 7f90cf4fc700 1 -- 172.21.15.146:0/2258272404 shutdown_connections 2023-10-03T10:16:08.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.231+0000 7f90cf4fc700 1 -- 172.21.15.146:0/2258272404 wait complete. 2023-10-03T10:16:08.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:08.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.237+0000 7fca264fa700 1 -- 172.21.15.146:0/3729987599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fca2004f2a0 con 0x7fca200a08e0 2023-10-03T10:16:08.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.237+0000 7fca1cff9700 1 -- 172.21.15.146:0/3729987599 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca1003fe60 con 0x7fca200a08e0 2023-10-03T10:16:08.238 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:08.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.239+0000 7fca264fa700 1 -- 172.21.15.146:0/3729987599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca200a08e0 msgr2=0x7fca201265d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.239+0000 7fca264fa700 1 --2- 172.21.15.146:0/3729987599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca200a08e0 0x7fca201265d0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fca1000e8c0 tx=0x7fca1000ebd0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.239+0000 7fca264fa700 1 -- 172.21.15.146:0/3729987599 shutdown_connections 2023-10-03T10:16:08.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.239+0000 7fca264fa700 1 --2- 172.21.15.146:0/3729987599 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fca20138040 0x7fca20127050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.239+0000 7fca264fa700 1 --2- 172.21.15.146:0/3729987599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca200a08e0 0x7fca201265d0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.239+0000 7fca264fa700 1 --2- 172.21.15.146:0/3729987599 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca200a1400 0x7fca20126b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.239+0000 7fca264fa700 1 -- 172.21.15.146:0/3729987599 >> 172.21.15.146:0/3729987599 conn(0x7fca200a2980 msgr2=0x7fca2009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.240+0000 7fca264fa700 1 -- 172.21.15.146:0/3729987599 shutdown_connections 2023-10-03T10:16:08.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:08.240+0000 7fca264fa700 1 -- 172.21.15.146:0/3729987599 wait complete. 2023-10-03T10:16:08.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:08.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:09.113 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:09.235 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:09.246 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.250+0000 7fa709895700 1 Processor -- start 2023-10-03T10:16:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.250+0000 7fa709895700 1 -- start start 2023-10-03T10:16:09.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.250+0000 7fa709895700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7040a0a70 0x7fa7040a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.250+0000 7fa709895700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7040a1380 0x7fa704133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.250+0000 7fa709895700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa704133f50 0x7fa7041343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.250+0000 7fa709895700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa70409e9d0 con 0x7fa704133f50 2023-10-03T10:16:09.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.250+0000 7fa709895700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70409dc00 con 0x7fa7040a1380 2023-10-03T10:16:09.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.250+0000 7fa709895700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa70409dec0 con 0x7fa7040a0a70 2023-10-03T10:16:09.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.251+0000 7fa702ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7040a0a70 0x7fa7040a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.251+0000 7fa7027fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7040a1380 0x7fa704133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.251+0000 7fa7037fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa704133f50 0x7fa7041343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.251+0000 7fa702ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7040a0a70 0x7fa7040a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39030/0 (socket says 172.21.15.146:39030) 2023-10-03T10:16:09.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.251+0000 7fa702ffd700 1 -- 172.21.15.146:0/2067454693 learned_addr learned my addr 172.21.15.146:0/2067454693 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:09.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.251+0000 7fa7037fe700 1 -- 172.21.15.146:0/2067454693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7040a0a70 msgr2=0x7fa7040a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:09.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.251+0000 7fa7037fe700 1 --2- 172.21.15.146:0/2067454693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7040a0a70 0x7fa7040a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.251+0000 7fa7037fe700 1 -- 172.21.15.146:0/2067454693 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7040a1380 msgr2=0x7fa704133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:09.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.251+0000 7fa7037fe700 1 --2- 172.21.15.146:0/2067454693 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7040a1380 0x7fa704133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.251+0000 7fa7037fe700 1 -- 172.21.15.146:0/2067454693 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70409e6a0 con 0x7fa704133f50 2023-10-03T10:16:09.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.251+0000 7fa7027fc700 1 --2- 172.21.15.146:0/2067454693 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7040a1380 0x7fa704133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.251+0000 7fa7037fe700 1 --2- 172.21.15.146:0/2067454693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa704133f50 0x7fa7041343f0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc009d90 tx=0x7fa6fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b04983689491d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.251+0000 7fa701ffb700 1 -- 172.21.15.146:0/2067454693 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc00e070 con 0x7fa704133f50 2023-10-03T10:16:09.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.251+0000 7fa701ffb700 1 -- 172.21.15.146:0/2067454693 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6fc00bb20 con 0x7fa704133f50 2023-10-03T10:16:09.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.251+0000 7fa701ffb700 1 -- 172.21.15.146:0/2067454693 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc012430 con 0x7fa704133f50 2023-10-03T10:16:09.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.252+0000 7fa709895700 1 -- 172.21.15.146:0/2067454693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa704133f50 msgr2=0x7fa7041343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.252+0000 7fa709895700 1 --2- 172.21.15.146:0/2067454693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa704133f50 0x7fa7041343f0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc009d90 tx=0x7fa6fc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:09.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.252+0000 7fa709895700 1 -- 172.21.15.146:0/2067454693 shutdown_connections 2023-10-03T10:16:09.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.252+0000 7fa709895700 1 --2- 172.21.15.146:0/2067454693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa704133f50 0x7fa7041343f0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.252+0000 7fa709895700 1 --2- 172.21.15.146:0/2067454693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7040a0a70 0x7fa7040a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.252+0000 7fa709895700 1 --2- 172.21.15.146:0/2067454693 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7040a1380 0x7fa704133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.252+0000 7fa709895700 1 -- 172.21.15.146:0/2067454693 >> 172.21.15.146:0/2067454693 conn(0x7fa7040a6610 msgr2=0x7fa7040a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.253+0000 7fa709895700 1 -- 172.21.15.146:0/2067454693 shutdown_connections 2023-10-03T10:16:09.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.253+0000 7fa709895700 1 -- 172.21.15.146:0/2067454693 wait complete. 2023-10-03T10:16:09.255 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:09.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.254+0000 7fa709895700 1 Processor -- start 2023-10-03T10:16:09.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.254+0000 7fa709895700 1 -- start start 2023-10-03T10:16:09.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.255+0000 7fa709895700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7040a0a70 0x7fa70411e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.255+0000 7fa709895700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7040a1380 0x7fa70411e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.255+0000 7fa709895700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa704133f50 0x7fa70411eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.255+0000 7fa709895700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa704122580 con 0x7fa7040a0a70 2023-10-03T10:16:09.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.255+0000 7fa709895700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7041218e0 con 0x7fa704133f50 2023-10-03T10:16:09.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.255+0000 7fa709895700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7040a4d20 con 0x7fa7040a1380 2023-10-03T10:16:09.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.255+0000 7fa702ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7040a0a70 0x7fa70411e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.255+0000 7fa7027fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7040a1380 0x7fa70411e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.255+0000 7fa702ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7040a0a70 0x7fa70411e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59594/0 (socket says 172.21.15.146:59594) 2023-10-03T10:16:09.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.255+0000 7fa702ffd700 1 -- 172.21.15.146:0/249623432 learned_addr learned my addr 172.21.15.146:0/249623432 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:09.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.255+0000 7fa7037fe700 1 --2- 172.21.15.146:0/249623432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa704133f50 0x7fa70411eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.256+0000 7fa7037fe700 1 -- 172.21.15.146:0/249623432 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7040a1380 msgr2=0x7fa70411e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.256+0000 7fa7037fe700 1 --2- 172.21.15.146:0/249623432 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7040a1380 0x7fa70411e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.256+0000 7fa7037fe700 1 -- 172.21.15.146:0/249623432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7040a0a70 msgr2=0x7fa70411e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.256+0000 7fa7037fe700 1 --2- 172.21.15.146:0/249623432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7040a0a70 0x7fa70411e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.256+0000 7fa7037fe700 1 -- 172.21.15.146:0/249623432 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f8011d40 con 0x7fa704133f50 2023-10-03T10:16:09.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.256+0000 7fa7037fe700 1 --2- 172.21.15.146:0/249623432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa704133f50 0x7fa70411eb60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa70409e5c0 tx=0x7fa6fc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.256+0000 7fa6ebfff700 1 -- 172.21.15.146:0/249623432 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc004800 con 0x7fa704133f50 2023-10-03T10:16:09.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.256+0000 7fa6ebfff700 1 -- 172.21.15.146:0/249623432 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6fc020070 con 0x7fa704133f50 2023-10-03T10:16:09.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.256+0000 7fa709895700 1 -- 172.21.15.146:0/249623432 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6fc009a70 con 0x7fa704133f50 2023-10-03T10:16:09.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.256+0000 7fa6ebfff700 1 -- 172.21.15.146:0/249623432 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc0276c0 con 0x7fa704133f50 2023-10-03T10:16:09.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.256+0000 7fa709895700 1 -- 172.21.15.146:0/249623432 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa704120f00 con 0x7fa704133f50 2023-10-03T10:16:09.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.257+0000 7fa6ebfff700 1 -- 172.21.15.146:0/249623432 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa6fc012430 con 0x7fa704133f50 2023-10-03T10:16:09.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.257+0000 7fa709895700 1 -- 172.21.15.146:0/249623432 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70404f2a0 con 0x7fa704133f50 2023-10-03T10:16:09.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.257+0000 7fa6ebfff700 1 -- 172.21.15.146:0/249623432 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa6fc022070 con 0x7fa704133f50 2023-10-03T10:16:09.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.264+0000 7fa6ebfff700 1 -- 172.21.15.146:0/249623432 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa6fc012e40 con 0x7fa704133f50 2023-10-03T10:16:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.375+0000 7f8d43f1f700 1 Processor -- start 2023-10-03T10:16:09.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.375+0000 7f8d43f1f700 1 -- start start 2023-10-03T10:16:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.375+0000 7f8d43f1f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8d3c1309f0 0x7f8d3c130dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.376+0000 7f8d43f1f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c09e450 0x7f8d3c138760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.376+0000 7f8d43f1f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d3c09c1f0 con 0x7f8d3c09d8f0 2023-10-03T10:16:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.376+0000 7f8d43f1f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d3c09b1f0 con 0x7f8d3c1309f0 2023-10-03T10:16:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.376+0000 7f8d43f1f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c131300 con 0x7f8d3c09e450 2023-10-03T10:16:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.376+0000 7f8d414ba700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8d3c09d8f0 0x7f8d3c09dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46012/0 (socket says 172.21.15.146:46012) 2023-10-03T10:16:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.376+0000 7f8d414ba700 1 -- 172.21.15.146:0/872305408 learned_addr learned my addr 172.21.15.146:0/872305408 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.376+0000 7f8d424bc700 1 --2- 172.21.15.146:0/872305408 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c09e450 0x7f8d3c138760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.376+0000 7f8d41cbb700 1 --2- 172.21.15.146:0/872305408 >> v2:172.21.15.146:3300/0 conn(0x7f8d3c1309f0 0x7f8d3c130dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.376+0000 7f8d424bc700 1 -- 172.21.15.146:0/872305408 >> v2:172.21.15.146:3300/0 conn(0x7f8d3c1309f0 msgr2=0x7f8d3c130dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.376+0000 7f8d424bc700 1 --2- 172.21.15.146:0/872305408 >> v2:172.21.15.146:3300/0 conn(0x7f8d3c1309f0 0x7f8d3c130dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.376+0000 7f8d424bc700 1 -- 172.21.15.146:0/872305408 >> v1:172.21.15.146:6789/0 conn(0x7f8d3c09d8f0 legacy=0x7f8d3c09dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.376+0000 7f8d424bc700 1 -- 172.21.15.146:0/872305408 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3c1305a0 con 0x7f8d3c09e450 2023-10-03T10:16:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.376+0000 7f8d40cb9700 1 -- 172.21.15.146:0/872305408 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886623661 0 0) 0x7f8d3c09c1f0 con 0x7f8d3c09d8f0 2023-10-03T10:16:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.376+0000 7f8d41cbb700 1 --2- 172.21.15.146:0/872305408 >> v2:172.21.15.146:3300/0 conn(0x7f8d3c1309f0 0x7f8d3c130dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.376+0000 7f8d424bc700 1 --2- 172.21.15.146:0/872305408 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c09e450 0x7f8d3c138760 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8d34009d90 tx=0x7f8d3400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9efb7e58a65c7f59 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.376+0000 7f8d40cb9700 1 -- 172.21.15.146:0/872305408 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3400e070 con 0x7f8d3c09e450 2023-10-03T10:16:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.377+0000 7f8d40cb9700 1 -- 172.21.15.146:0/872305408 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3400bb20 con 0x7f8d3c09e450 2023-10-03T10:16:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.377+0000 7f8d40cb9700 1 -- 172.21.15.146:0/872305408 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d34012430 con 0x7f8d3c09e450 2023-10-03T10:16:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.377+0000 7f8d43f1f700 1 -- 172.21.15.146:0/872305408 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c09e450 msgr2=0x7f8d3c138760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.377+0000 7f8d43f1f700 1 --2- 172.21.15.146:0/872305408 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c09e450 0x7f8d3c138760 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8d34009d90 tx=0x7f8d3400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.378+0000 7f8d43f1f700 1 -- 172.21.15.146:0/872305408 shutdown_connections 2023-10-03T10:16:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.378+0000 7f8d43f1f700 1 --2- 172.21.15.146:0/872305408 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c09e450 0x7f8d3c138760 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.378+0000 7f8d43f1f700 1 --2- 172.21.15.146:0/872305408 >> v2:172.21.15.146:3300/0 conn(0x7f8d3c1309f0 0x7f8d3c130dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.378+0000 7f8d43f1f700 1 -- 172.21.15.146:0/872305408 >> 172.21.15.146:0/872305408 conn(0x7f8d3c0a2b30 msgr2=0x7f8d3c09e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.378+0000 7f8d43f1f700 1 -- 172.21.15.146:0/872305408 shutdown_connections 2023-10-03T10:16:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.378+0000 7f8d43f1f700 1 -- 172.21.15.146:0/872305408 wait complete. 2023-10-03T10:16:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.378+0000 7f8d43f1f700 1 Processor -- start 2023-10-03T10:16:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.379+0000 7f8d43f1f700 1 -- start start 2023-10-03T10:16:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.379+0000 7f8d43f1f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c09d8f0 0x7f8d3c1c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.379+0000 7f8d43f1f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d3c09e450 0x7f8d3c1c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.379+0000 7f8d43f1f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d3c1309f0 0x7f8d3c1c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.379+0000 7f8d43f1f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c12dcf0 con 0x7f8d3c09e450 2023-10-03T10:16:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.379+0000 7f8d43f1f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c12d020 con 0x7f8d3c09d8f0 2023-10-03T10:16:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.379+0000 7f8d43f1f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c13b9e0 con 0x7f8d3c1309f0 2023-10-03T10:16:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.379+0000 7f8d41cbb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c09d8f0 0x7f8d3c1c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.379+0000 7f8d41cbb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c09d8f0 0x7f8d3c1c4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40298/0 (socket says 172.21.15.146:40298) 2023-10-03T10:16:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.379+0000 7f8d41cbb700 1 -- 172.21.15.146:0/1234959141 learned_addr learned my addr 172.21.15.146:0/1234959141 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.379+0000 7f8d424bc700 1 --2- 172.21.15.146:0/1234959141 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d3c1309f0 0x7f8d3c1c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.379+0000 7f8d414ba700 1 --2- 172.21.15.146:0/1234959141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d3c09e450 0x7f8d3c1c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.379+0000 7f8d41cbb700 1 -- 172.21.15.146:0/1234959141 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d3c1309f0 msgr2=0x7f8d3c1c5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.379+0000 7f8d41cbb700 1 --2- 172.21.15.146:0/1234959141 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d3c1309f0 0x7f8d3c1c5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.379+0000 7f8d41cbb700 1 -- 172.21.15.146:0/1234959141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d3c09e450 msgr2=0x7f8d3c1c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.379+0000 7f8d41cbb700 1 --2- 172.21.15.146:0/1234959141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d3c09e450 0x7f8d3c1c5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.379+0000 7f8d41cbb700 1 -- 172.21.15.146:0/1234959141 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d38009430 con 0x7f8d3c09d8f0 2023-10-03T10:16:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.380+0000 7f8d424bc700 1 --2- 172.21.15.146:0/1234959141 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d3c1309f0 0x7f8d3c1c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.380+0000 7f8d41cbb700 1 --2- 172.21.15.146:0/1234959141 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c09d8f0 0x7f8d3c1c4fe0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800ec10 tx=0x7f8d38009ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.380+0000 7f8d327fc700 1 -- 172.21.15.146:0/1234959141 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d38005a20 con 0x7f8d3c09d8f0 2023-10-03T10:16:09.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.380+0000 7f8d327fc700 1 -- 172.21.15.146:0/1234959141 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d38005b80 con 0x7f8d3c09d8f0 2023-10-03T10:16:09.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.380+0000 7f8d43f1f700 1 -- 172.21.15.146:0/1234959141 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d34009a70 con 0x7f8d3c09d8f0 2023-10-03T10:16:09.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.380+0000 7f8d327fc700 1 -- 172.21.15.146:0/1234959141 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3800c940 con 0x7f8d3c09d8f0 2023-10-03T10:16:09.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.380+0000 7f8d43f1f700 1 -- 172.21.15.146:0/1234959141 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d3c12d6d0 con 0x7f8d3c09d8f0 2023-10-03T10:16:09.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.381+0000 7f8d327fc700 1 -- 172.21.15.146:0/1234959141 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d3800caa0 con 0x7f8d3c09d8f0 2023-10-03T10:16:09.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.381+0000 7f8d327fc700 1 -- 172.21.15.146:0/1234959141 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8d3803faa0 con 0x7f8d3c09d8f0 2023-10-03T10:16:09.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.381+0000 7f8d43f1f700 1 -- 172.21.15.146:0/1234959141 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d3c04f2a0 con 0x7f8d3c09d8f0 2023-10-03T10:16:09.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.386+0000 7f8d327fc700 1 -- 172.21.15.146:0/1234959141 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d38020080 con 0x7f8d3c09d8f0 2023-10-03T10:16:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.387+0000 7f40723f2700 1 Processor -- start 2023-10-03T10:16:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.387+0000 7f40723f2700 1 -- start start 2023-10-03T10:16:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.388+0000 7f40723f2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f406c133ad0 0x7f406c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.388+0000 7f40723f2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f406c1300a0 0x7f406c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.388+0000 7f40723f2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f406c1309f0 0x7f406c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.388+0000 7f40723f2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f406c06b2d0 con 0x7f406c1309f0 2023-10-03T10:16:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.388+0000 7f40723f2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406c133610 con 0x7f406c133ad0 2023-10-03T10:16:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.388+0000 7f40723f2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f406c09a500 con 0x7f406c1300a0 2023-10-03T10:16:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.388+0000 7f407098f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f406c1309f0 0x7f406c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.388+0000 7f407098f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f406c1309f0 0x7f406c13a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59618/0 (socket says 172.21.15.146:59618) 2023-10-03T10:16:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.388+0000 7f407098f700 1 -- 172.21.15.146:0/2320306755 learned_addr learned my addr 172.21.15.146:0/2320306755 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.388+0000 7f406bfff700 1 --2- 172.21.15.146:0/2320306755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f406c133ad0 0x7f406c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.389+0000 7f406b7fe700 1 --2- 172.21.15.146:0/2320306755 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f406c1300a0 0x7f406c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.389+0000 7f407098f700 1 -- 172.21.15.146:0/2320306755 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f406c1300a0 msgr2=0x7f406c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.389+0000 7f407098f700 1 --2- 172.21.15.146:0/2320306755 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f406c1300a0 0x7f406c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.389+0000 7f407098f700 1 -- 172.21.15.146:0/2320306755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f406c133ad0 msgr2=0x7f406c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.389+0000 7f407098f700 1 --2- 172.21.15.146:0/2320306755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f406c133ad0 0x7f406c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.389+0000 7f407098f700 1 -- 172.21.15.146:0/2320306755 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c1338b0 con 0x7f406c1309f0 2023-10-03T10:16:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.389+0000 7f407098f700 1 --2- 172.21.15.146:0/2320306755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406c1309f0 0x7f406c13a980 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f4064009e50 tx=0x7f406400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c931a322928d4a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.389+0000 7f406affd700 1 -- 172.21.15.146:0/2320306755 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406400e070 con 0x7f406c1309f0 2023-10-03T10:16:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.389+0000 7f406affd700 1 -- 172.21.15.146:0/2320306755 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406400b910 con 0x7f406c1309f0 2023-10-03T10:16:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.389+0000 7f406affd700 1 -- 172.21.15.146:0/2320306755 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406400bcc0 con 0x7f406c1309f0 2023-10-03T10:16:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.390+0000 7f40723f2700 1 -- 172.21.15.146:0/2320306755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406c1309f0 msgr2=0x7f406c13a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.390+0000 7f40723f2700 1 --2- 172.21.15.146:0/2320306755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406c1309f0 0x7f406c13a980 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f4064009e50 tx=0x7f406400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.390+0000 7f40723f2700 1 -- 172.21.15.146:0/2320306755 shutdown_connections 2023-10-03T10:16:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.390+0000 7f40723f2700 1 --2- 172.21.15.146:0/2320306755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f406c133ad0 0x7f406c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.390+0000 7f40723f2700 1 --2- 172.21.15.146:0/2320306755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406c1309f0 0x7f406c13a980 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.390+0000 7f40723f2700 1 --2- 172.21.15.146:0/2320306755 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f406c1300a0 0x7f406c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.390+0000 7f40723f2700 1 -- 172.21.15.146:0/2320306755 >> 172.21.15.146:0/2320306755 conn(0x7f406c099c40 msgr2=0x7f406c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.390+0000 7f40723f2700 1 -- 172.21.15.146:0/2320306755 shutdown_connections 2023-10-03T10:16:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.390+0000 7f40723f2700 1 -- 172.21.15.146:0/2320306755 wait complete. 2023-10-03T10:16:09.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.391+0000 7f422df0a700 1 Processor -- start 2023-10-03T10:16:09.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.391+0000 7f422df0a700 1 -- start start 2023-10-03T10:16:09.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.391+0000 7f422df0a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f422806a770 0x7f42281349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.391+0000 7f422df0a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4228134f00 0x7f422809d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.391+0000 7f422df0a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422809eca0 con 0x7f422809dea0 2023-10-03T10:16:09.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.391+0000 7f422df0a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f422809f720 con 0x7f422806a770 2023-10-03T10:16:09.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.391+0000 7f422df0a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422806b480 con 0x7f4228134f00 2023-10-03T10:16:09.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.391+0000 7f4227fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f422809dea0 0x7f422813ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46026/0 (socket says 172.21.15.146:46026) 2023-10-03T10:16:09.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.391+0000 7f4227fff700 1 -- 172.21.15.146:0/706246042 learned_addr learned my addr 172.21.15.146:0/706246042 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:09.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.391+0000 7f42277fe700 1 --2- 172.21.15.146:0/706246042 >> v2:172.21.15.146:3300/0 conn(0x7f422806a770 0x7f42281349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.392+0000 7f4226ffd700 1 --2- 172.21.15.146:0/706246042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4228134f00 0x7f422809d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.392+0000 7f40723f2700 1 Processor -- start 2023-10-03T10:16:09.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.392+0000 7f42267fc700 1 -- 172.21.15.146:0/706246042 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924945886 0 0) 0x7f422809eca0 con 0x7f422809dea0 2023-10-03T10:16:09.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.392+0000 7f42267fc700 1 -- 172.21.15.146:0/706246042 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42100035b0 con 0x7f422809dea0 2023-10-03T10:16:09.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.392+0000 7f40723f2700 1 -- start start 2023-10-03T10:16:09.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.392+0000 7f42277fe700 1 -- 172.21.15.146:0/706246042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4228134f00 msgr2=0x7f422809d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:09.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.392+0000 7f42277fe700 1 --2- 172.21.15.146:0/706246042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4228134f00 0x7f422809d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.392+0000 7f42267fc700 1 -- 172.21.15.146:0/706246042 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3127886405 0 0) 0x7f42100035b0 con 0x7f422809dea0 2023-10-03T10:16:09.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.392+0000 7f42277fe700 1 -- 172.21.15.146:0/706246042 >> v1:172.21.15.146:6789/0 conn(0x7f422809dea0 legacy=0x7f422813ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.392+0000 7f42277fe700 1 -- 172.21.15.146:0/706246042 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42281352d0 con 0x7f422806a770 2023-10-03T10:16:09.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.392+0000 7f42277fe700 1 --2- 172.21.15.146:0/706246042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f422806a770 0x7f42281349c0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f4218009840 tx=0x7f4218009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c51ae0dbbc5914 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.392+0000 7f42267fc700 1 -- 172.21.15.146:0/706246042 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42200019f0 con 0x7f422806a770 2023-10-03T10:16:09.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.392+0000 7f42267fc700 1 -- 172.21.15.146:0/706246042 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4218004030 con 0x7f422806a770 2023-10-03T10:16:09.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.392+0000 7f42267fc700 1 -- 172.21.15.146:0/706246042 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42180043c0 con 0x7f422806a770 2023-10-03T10:16:09.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f40723f2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f406c1300a0 0x7f406c11cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f40723f2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f406c1309f0 0x7f406c11d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f40723f2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406c133ad0 0x7f406c119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f40723f2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c11be10 con 0x7f406c133ad0 2023-10-03T10:16:09.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f40723f2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406c12fad0 con 0x7f406c1309f0 2023-10-03T10:16:09.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f40723f2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f406c12dd00 con 0x7f406c1300a0 2023-10-03T10:16:09.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f406bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f406c1300a0 0x7f406c11cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f406bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f406c1300a0 0x7f406c11cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39062/0 (socket says 172.21.15.146:39062) 2023-10-03T10:16:09.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f406bfff700 1 -- 172.21.15.146:0/1437643866 learned_addr learned my addr 172.21.15.146:0/1437643866 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:09.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f406b7fe700 1 --2- 172.21.15.146:0/1437643866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f406c1309f0 0x7f406c11d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f406bfff700 1 -- 172.21.15.146:0/1437643866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f406c1309f0 msgr2=0x7f406c11d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f406bfff700 1 --2- 172.21.15.146:0/1437643866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f406c1309f0 0x7f406c11d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f406bfff700 1 -- 172.21.15.146:0/1437643866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406c133ad0 msgr2=0x7f406c119630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:16:09.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f406bfff700 1 --2- 172.21.15.146:0/1437643866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406c133ad0 0x7f406c119630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f406bfff700 1 -- 172.21.15.146:0/1437643866 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4064009b30 con 0x7f406c1300a0 2023-10-03T10:16:09.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f406bfff700 1 --2- 172.21.15.146:0/1437643866 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f406c1300a0 0x7f406c11cf40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f405c00e9b0 tx=0x7f405c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f422df0a700 1 -- 172.21.15.146:0/706246042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f422806a770 msgr2=0x7f42281349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f422df0a700 1 --2- 172.21.15.146:0/706246042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f422806a770 0x7f42281349c0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f4218009840 tx=0x7f4218009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:09.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f422df0a700 1 -- 172.21.15.146:0/706246042 shutdown_connections 2023-10-03T10:16:09.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f422df0a700 1 --2- 172.21.15.146:0/706246042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f422806a770 0x7f42281349c0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f422df0a700 1 --2- 172.21.15.146:0/706246042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4228134f00 0x7f422809d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f422df0a700 1 -- 172.21.15.146:0/706246042 >> 172.21.15.146:0/706246042 conn(0x7f4228099c40 msgr2=0x7f42280a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.393+0000 7f4068ff9700 1 -- 172.21.15.146:0/1437643866 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c009710 con 0x7f406c1300a0 2023-10-03T10:16:09.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.394+0000 7f4068ff9700 1 -- 172.21.15.146:0/1437643866 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405c00c850 con 0x7f406c1300a0 2023-10-03T10:16:09.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.394+0000 7f4068ff9700 1 -- 172.21.15.146:0/1437643866 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c00cbc0 con 0x7f406c1300a0 2023-10-03T10:16:09.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.394+0000 7f422df0a700 1 -- 172.21.15.146:0/706246042 shutdown_connections 2023-10-03T10:16:09.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.394+0000 7f422df0a700 1 -- 172.21.15.146:0/706246042 wait complete. 2023-10-03T10:16:09.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.394+0000 7f40723f2700 1 -- 172.21.15.146:0/1437643866 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f406c12d830 con 0x7f406c1300a0 2023-10-03T10:16:09.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.394+0000 7f40723f2700 1 -- 172.21.15.146:0/1437643866 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406c11ba20 con 0x7f406c1300a0 2023-10-03T10:16:09.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.395+0000 7f422df0a700 1 Processor -- start 2023-10-03T10:16:09.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.395+0000 7f422df0a700 1 -- start start 2023-10-03T10:16:09.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.395+0000 7f40723f2700 1 -- 172.21.15.146:0/1437643866 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f406c04f2a0 con 0x7f406c1300a0 2023-10-03T10:16:09.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.395+0000 7f422df0a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f422806a770 0x7f42281339c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.395+0000 7f422df0a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f422809dea0 0x7f4228133f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.395+0000 7f422df0a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4228134f00 0x7f42281321c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.395+0000 7f422df0a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4228138e40 con 0x7f422809dea0 2023-10-03T10:16:09.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.395+0000 7f422df0a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4228141200 con 0x7f422806a770 2023-10-03T10:16:09.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.395+0000 7f422df0a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f422809f220 con 0x7f4228134f00 2023-10-03T10:16:09.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.396+0000 7f4227fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4228134f00 0x7f42281321c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.396+0000 7f4227fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4228134f00 0x7f42281321c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39076/0 (socket says 172.21.15.146:39076) 2023-10-03T10:16:09.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.396+0000 7f4227fff700 1 -- 172.21.15.146:0/722306898 learned_addr learned my addr 172.21.15.146:0/722306898 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:09.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.396+0000 7f4226ffd700 1 --2- 172.21.15.146:0/722306898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f422809dea0 0x7f4228133f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.396+0000 7f42277fe700 1 --2- 172.21.15.146:0/722306898 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f422806a770 0x7f42281339c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.396+0000 7f4068ff9700 1 -- 172.21.15.146:0/1437643866 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f405c00cd20 con 0x7f406c1300a0 2023-10-03T10:16:09.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.396+0000 7f4068ff9700 1 -- 172.21.15.146:0/1437643866 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f405c040090 con 0x7f406c1300a0 2023-10-03T10:16:09.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.396+0000 7f42277fe700 1 -- 172.21.15.146:0/722306898 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4228134f00 msgr2=0x7f42281321c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.396+0000 7f42277fe700 1 --2- 172.21.15.146:0/722306898 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4228134f00 0x7f42281321c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.396+0000 7f42277fe700 1 -- 172.21.15.146:0/722306898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f422809dea0 msgr2=0x7f4228133f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.396+0000 7f42277fe700 1 --2- 172.21.15.146:0/722306898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f422809dea0 0x7f4228133f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.396+0000 7f42277fe700 1 -- 172.21.15.146:0/722306898 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42180094a0 con 0x7f422806a770 2023-10-03T10:16:09.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.396+0000 7f42277fe700 1 --2- 172.21.15.146:0/722306898 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f422806a770 0x7f42281339c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f422806ac00 tx=0x7f4218004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.396+0000 7f420ffff700 1 -- 172.21.15.146:0/722306898 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218003cf0 con 0x7f422806a770 2023-10-03T10:16:09.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.396+0000 7f420ffff700 1 -- 172.21.15.146:0/722306898 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4218003e70 con 0x7f422806a770 2023-10-03T10:16:09.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.397+0000 7f422df0a700 1 -- 172.21.15.146:0/722306898 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422811cda0 con 0x7f422806a770 2023-10-03T10:16:09.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.397+0000 7f422df0a700 1 -- 172.21.15.146:0/722306898 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422811c8e0 con 0x7f422806a770 2023-10-03T10:16:09.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.397+0000 7f420ffff700 1 -- 172.21.15.146:0/722306898 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218011850 con 0x7f422806a770 2023-10-03T10:16:09.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.398+0000 7f420ffff700 1 -- 172.21.15.146:0/722306898 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4218021070 con 0x7f422806a770 2023-10-03T10:16:09.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.398+0000 7f422df0a700 1 -- 172.21.15.146:0/722306898 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42080052e0 con 0x7f422806a770 2023-10-03T10:16:09.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.398+0000 7f420ffff700 1 -- 172.21.15.146:0/722306898 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f42180409e0 con 0x7f422806a770 2023-10-03T10:16:09.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.400+0000 7f4068ff9700 1 -- 172.21.15.146:0/1437643866 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f405c01a360 con 0x7f406c1300a0 2023-10-03T10:16:09.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.402+0000 7f420ffff700 1 -- 172.21.15.146:0/722306898 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4218010950 con 0x7f422806a770 2023-10-03T10:16:09.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.466+0000 7fa709895700 1 -- 172.21.15.146:0/249623432 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa704121450 con 0x7fa704133f50 2023-10-03T10:16:09.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.466+0000 7fa6ebfff700 1 -- 172.21.15.146:0/249623432 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa6fc025380 con 0x7fa704133f50 2023-10-03T10:16:09.467 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:09.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.469+0000 7fa709895700 1 -- 172.21.15.146:0/249623432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa704133f50 msgr2=0x7fa70411eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.469+0000 7fa709895700 1 --2- 172.21.15.146:0/249623432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa704133f50 0x7fa70411eb60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa70409e5c0 tx=0x7fa6fc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.470+0000 7fa709895700 1 -- 172.21.15.146:0/249623432 shutdown_connections 2023-10-03T10:16:09.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.470+0000 7fa709895700 1 --2- 172.21.15.146:0/249623432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa704133f50 0x7fa70411eb60 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.470+0000 7fa709895700 1 --2- 172.21.15.146:0/249623432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7040a0a70 0x7fa70411e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.470+0000 7fa709895700 1 --2- 172.21.15.146:0/249623432 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7040a1380 0x7fa70411e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.470+0000 7fa709895700 1 -- 172.21.15.146:0/249623432 >> 172.21.15.146:0/249623432 conn(0x7fa7040a6610 msgr2=0x7fa70409b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.471+0000 7fa709895700 1 -- 172.21.15.146:0/249623432 shutdown_connections 2023-10-03T10:16:09.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.471+0000 7fa709895700 1 -- 172.21.15.146:0/249623432 wait complete. 2023-10-03T10:16:09.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:09.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.595+0000 7f8d43f1f700 1 -- 172.21.15.146:0/1234959141 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8d3c06b2a0 con 0x7f8d3c09d8f0 2023-10-03T10:16:09.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.595+0000 7f8d327fc700 1 -- 172.21.15.146:0/1234959141 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8d38022300 con 0x7f8d3c09d8f0 2023-10-03T10:16:09.596 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:09.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.597+0000 7f40723f2700 1 -- 172.21.15.146:0/1437643866 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f406c11b690 con 0x7f406c1300a0 2023-10-03T10:16:09.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.597+0000 7f4068ff9700 1 -- 172.21.15.146:0/1437643866 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f405c021070 con 0x7f406c1300a0 2023-10-03T10:16:09.598 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:09.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.598+0000 7f8d43f1f700 1 -- 172.21.15.146:0/1234959141 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c09d8f0 msgr2=0x7f8d3c1c4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.598+0000 7f8d43f1f700 1 --2- 172.21.15.146:0/1234959141 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c09d8f0 0x7f8d3c1c4fe0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800ec10 tx=0x7f8d38009ea0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.598+0000 7f8d43f1f700 1 -- 172.21.15.146:0/1234959141 shutdown_connections 2023-10-03T10:16:09.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.598+0000 7f8d43f1f700 1 --2- 172.21.15.146:0/1234959141 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d3c1309f0 0x7f8d3c1c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.598+0000 7f8d43f1f700 1 --2- 172.21.15.146:0/1234959141 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d3c09d8f0 0x7f8d3c1c4fe0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.598+0000 7f8d43f1f700 1 --2- 172.21.15.146:0/1234959141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d3c09e450 0x7f8d3c1c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.598+0000 7f8d43f1f700 1 -- 172.21.15.146:0/1234959141 >> 172.21.15.146:0/1234959141 conn(0x7f8d3c0a2b30 msgr2=0x7f8d3c0993e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.598+0000 7f8d43f1f700 1 -- 172.21.15.146:0/1234959141 shutdown_connections 2023-10-03T10:16:09.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.598+0000 7f8d43f1f700 1 -- 172.21.15.146:0/1234959141 wait complete. 2023-10-03T10:16:09.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.599+0000 7f40723f2700 1 -- 172.21.15.146:0/1437643866 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f406c1300a0 msgr2=0x7f406c11cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.599+0000 7f40723f2700 1 --2- 172.21.15.146:0/1437643866 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f406c1300a0 0x7f406c11cf40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f405c00e9b0 tx=0x7f405c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.599+0000 7f40723f2700 1 -- 172.21.15.146:0/1437643866 shutdown_connections 2023-10-03T10:16:09.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.599+0000 7f40723f2700 1 --2- 172.21.15.146:0/1437643866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406c133ad0 0x7f406c119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.599+0000 7f40723f2700 1 --2- 172.21.15.146:0/1437643866 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f406c1300a0 0x7f406c11cf40 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.599+0000 7f40723f2700 1 --2- 172.21.15.146:0/1437643866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f406c1309f0 0x7f406c11d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.599+0000 7f40723f2700 1 -- 172.21.15.146:0/1437643866 >> 172.21.15.146:0/1437643866 conn(0x7f406c099c40 msgr2=0x7f406c131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.600+0000 7f40723f2700 1 -- 172.21.15.146:0/1437643866 shutdown_connections 2023-10-03T10:16:09.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.600+0000 7f40723f2700 1 -- 172.21.15.146:0/1437643866 wait complete. 2023-10-03T10:16:09.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.600+0000 7f422df0a700 1 -- 172.21.15.146:0/722306898 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4208005590 con 0x7f422806a770 2023-10-03T10:16:09.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.600+0000 7f420ffff700 1 -- 172.21.15.146:0/722306898 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4218029030 con 0x7f422806a770 2023-10-03T10:16:09.602 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:09.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.602+0000 7f422df0a700 1 -- 172.21.15.146:0/722306898 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f422806a770 msgr2=0x7f42281339c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.602+0000 7f422df0a700 1 --2- 172.21.15.146:0/722306898 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f422806a770 0x7f42281339c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f422806ac00 tx=0x7f4218004750 comp rx=0 tx=0).stop 2023-10-03T10:16:09.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.603+0000 7f422df0a700 1 -- 172.21.15.146:0/722306898 shutdown_connections 2023-10-03T10:16:09.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.603+0000 7f422df0a700 1 --2- 172.21.15.146:0/722306898 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4228134f00 0x7f42281321c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.603+0000 7f422df0a700 1 --2- 172.21.15.146:0/722306898 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f422806a770 0x7f42281339c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.603+0000 7f422df0a700 1 --2- 172.21.15.146:0/722306898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f422809dea0 0x7f4228133f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.603+0000 7f422df0a700 1 -- 172.21.15.146:0/722306898 >> 172.21.15.146:0/722306898 conn(0x7f4228099c40 msgr2=0x7f4228137ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.603+0000 7f422df0a700 1 -- 172.21.15.146:0/722306898 shutdown_connections 2023-10-03T10:16:09.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:09.603+0000 7f422df0a700 1 -- 172.21.15.146:0/722306898 wait complete. 2023-10-03T10:16:09.614 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:09.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:09.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:10.489 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:10.615 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:10.616 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:10.618 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:10.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.618+0000 7f39448f6700 1 Processor -- start 2023-10-03T10:16:10.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.618+0000 7f39448f6700 1 -- start start 2023-10-03T10:16:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.619+0000 7f39448f6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3940136960 0x7f3940138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.619+0000 7f39448f6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3940139280 0x7f394013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.619+0000 7f39448f6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f394006b2d0 con 0x7f3940133ad0 2023-10-03T10:16:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.619+0000 7f39448f6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39401345b0 con 0x7f3940139280 2023-10-03T10:16:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.619+0000 7f39448f6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3940133610 con 0x7f3940136960 2023-10-03T10:16:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.619+0000 7f393dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3940136960 0x7f3940138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.619+0000 7f393dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3940136960 0x7f3940138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40354/0 (socket says 172.21.15.146:40354) 2023-10-03T10:16:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.619+0000 7f393dd9b700 1 -- 172.21.15.146:0/2130289370 learned_addr learned my addr 172.21.15.146:0/2130289370 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.619+0000 7f393ed9d700 1 --2- 172.21.15.146:0/2130289370 >> v2:172.21.15.146:3300/0 conn(0x7f3940139280 0x7f394013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.619+0000 7f393dd9b700 1 -- 172.21.15.146:0/2130289370 >> v2:172.21.15.146:3300/0 conn(0x7f3940139280 msgr2=0x7f394013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.619+0000 7f393dd9b700 1 --2- 172.21.15.146:0/2130289370 >> v2:172.21.15.146:3300/0 conn(0x7f3940139280 0x7f394013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.619+0000 7f393dd9b700 1 -- 172.21.15.146:0/2130289370 >> v1:172.21.15.146:6789/0 conn(0x7f3940133ad0 legacy=0x7f3940133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.619+0000 7f393dd9b700 1 -- 172.21.15.146:0/2130289370 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394009a500 con 0x7f3940136960 2023-10-03T10:16:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.619+0000 7f393ed9d700 1 --2- 172.21.15.146:0/2130289370 >> v2:172.21.15.146:3300/0 conn(0x7f3940139280 0x7f394013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.619+0000 7f393dd9b700 1 --2- 172.21.15.146:0/2130289370 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3940136960 0x7f3940138d40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3934009920 tx=0x7f3934009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad05b14e6d632adc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.619+0000 7f393d59a700 1 -- 172.21.15.146:0/2130289370 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3934004230 con 0x7f3940136960 2023-10-03T10:16:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.619+0000 7f393d59a700 1 -- 172.21.15.146:0/2130289370 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3934004390 con 0x7f3940136960 2023-10-03T10:16:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.619+0000 7f393d59a700 1 -- 172.21.15.146:0/2130289370 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39340036a0 con 0x7f3940136960 2023-10-03T10:16:10.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.620+0000 7f39448f6700 1 -- 172.21.15.146:0/2130289370 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3940136960 msgr2=0x7f3940138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.620+0000 7f39448f6700 1 --2- 172.21.15.146:0/2130289370 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3940136960 0x7f3940138d40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3934009920 tx=0x7f3934009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:10.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.620+0000 7f39448f6700 1 -- 172.21.15.146:0/2130289370 shutdown_connections 2023-10-03T10:16:10.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.620+0000 7f39448f6700 1 --2- 172.21.15.146:0/2130289370 >> v2:172.21.15.146:3300/0 conn(0x7f3940139280 0x7f394013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.620+0000 7f39448f6700 1 --2- 172.21.15.146:0/2130289370 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3940136960 0x7f3940138d40 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.620+0000 7f39448f6700 1 -- 172.21.15.146:0/2130289370 >> 172.21.15.146:0/2130289370 conn(0x7f3940099c40 msgr2=0x7f39400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.620+0000 7f39448f6700 1 -- 172.21.15.146:0/2130289370 shutdown_connections 2023-10-03T10:16:10.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.620+0000 7f39448f6700 1 -- 172.21.15.146:0/2130289370 wait complete. 2023-10-03T10:16:10.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.622+0000 7f39448f6700 1 Processor -- start 2023-10-03T10:16:10.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.622+0000 7f39448f6700 1 -- start start 2023-10-03T10:16:10.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.623+0000 7f39448f6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3940133ad0 0x7f394006fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.623+0000 7f39448f6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3940136960 0x7f3940071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.623+0000 7f39448f6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3940139280 0x7f3940071790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.623+0000 7f39448f6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394006efe0 con 0x7f3940133ad0 2023-10-03T10:16:10.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.623+0000 7f39448f6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39400727a0 con 0x7f3940139280 2023-10-03T10:16:10.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.623+0000 7f39448f6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f394011d840 con 0x7f3940136960 2023-10-03T10:16:10.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.623+0000 7f393dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3940136960 0x7f3940071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.623+0000 7f393dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3940136960 0x7f3940071250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39092/0 (socket says 172.21.15.146:39092) 2023-10-03T10:16:10.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.623+0000 7f393dd9b700 1 -- 172.21.15.146:0/3265653441 learned_addr learned my addr 172.21.15.146:0/3265653441 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:10.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.623+0000 7f393ed9d700 1 --2- 172.21.15.146:0/3265653441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3940139280 0x7f3940071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.623+0000 7f393dd9b700 1 -- 172.21.15.146:0/3265653441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3940139280 msgr2=0x7f3940071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.623+0000 7f393dd9b700 1 --2- 172.21.15.146:0/3265653441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3940139280 0x7f3940071790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.623+0000 7f393dd9b700 1 -- 172.21.15.146:0/3265653441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3940133ad0 msgr2=0x7f394006fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.623+0000 7f393dd9b700 1 --2- 172.21.15.146:0/3265653441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3940133ad0 0x7f394006fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.623+0000 7f393dd9b700 1 -- 172.21.15.146:0/3265653441 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3938009a70 con 0x7f3940136960 2023-10-03T10:16:10.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.624+0000 7f393dd9b700 1 --2- 172.21.15.146:0/3265653441 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3940136960 0x7f3940071250 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3934009130 tx=0x7f3934004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.624+0000 7f392effd700 1 -- 172.21.15.146:0/3265653441 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3934003c00 con 0x7f3940136960 2023-10-03T10:16:10.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.624+0000 7f392effd700 1 -- 172.21.15.146:0/3265653441 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393401f070 con 0x7f3940136960 2023-10-03T10:16:10.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.624+0000 7f39448f6700 1 -- 172.21.15.146:0/3265653441 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3934009550 con 0x7f3940136960 2023-10-03T10:16:10.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.624+0000 7f392effd700 1 -- 172.21.15.146:0/3265653441 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3934011630 con 0x7f3940136960 2023-10-03T10:16:10.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.624+0000 7f39448f6700 1 -- 172.21.15.146:0/3265653441 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3940070390 con 0x7f3940136960 2023-10-03T10:16:10.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.625+0000 7f39448f6700 1 -- 172.21.15.146:0/3265653441 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39401317a0 con 0x7f3940136960 2023-10-03T10:16:10.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.626+0000 7f392effd700 1 -- 172.21.15.146:0/3265653441 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3934021030 con 0x7f3940136960 2023-10-03T10:16:10.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.626+0000 7f392effd700 1 -- 172.21.15.146:0/3265653441 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3934040ac0 con 0x7f3940136960 2023-10-03T10:16:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.632+0000 7f392effd700 1 -- 172.21.15.146:0/3265653441 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3934023790 con 0x7f3940136960 2023-10-03T10:16:10.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.745+0000 7f8f4ee4b700 1 Processor -- start 2023-10-03T10:16:10.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.745+0000 7f214dbc6700 1 Processor -- start 2023-10-03T10:16:10.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.745+0000 7f214dbc6700 1 -- start start 2023-10-03T10:16:10.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.745+0000 7f8f4ee4b700 1 -- start start 2023-10-03T10:16:10.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f214dbc6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f21480a0a90 0x7f21480a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f214dbc6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21480a13a0 0x7f2148133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f8f4ee4b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f48138040 0x7f8f48138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f8f4ee4b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8f480a08e0 0x7f8f480a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f8f4ee4b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f480a1230 0x7f8f4813ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f8f4ee4b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f480a2100 con 0x7f8f480a08e0 2023-10-03T10:16:10.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f8f4ee4b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f48138950 con 0x7f8f48138040 2023-10-03T10:16:10.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f8f4ee4b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f481379e0 con 0x7f8f480a1230 2023-10-03T10:16:10.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f8f47fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8f480a08e0 0x7f8f480a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f8f4d3e8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f480a1230 0x7f8f4813ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f8f4d3e8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f480a1230 0x7f8f4813ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39116/0 (socket says 172.21.15.146:39116) 2023-10-03T10:16:10.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f8f4d3e8700 1 -- 172.21.15.146:0/2288801315 learned_addr learned my addr 172.21.15.146:0/2288801315 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:10.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.745+0000 7f7eea478700 1 Processor -- start 2023-10-03T10:16:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.745+0000 7f7eea478700 1 -- start start 2023-10-03T10:16:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f7eea478700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ee409f350 0x7f7ee4136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f7eea478700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7ee41371c0 0x7f7ee41395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f7eea478700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee409c970 con 0x7f7ee409e870 2023-10-03T10:16:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f7eea478700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee40a0920 con 0x7f7ee41371c0 2023-10-03T10:16:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f7eea478700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee409f9c0 con 0x7f7ee409f350 2023-10-03T10:16:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f7ee37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ee409f350 0x7f7ee4136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f7ee37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ee409f350 0x7f7ee4136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39100/0 (socket says 172.21.15.146:39100) 2023-10-03T10:16:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f7ee37fe700 1 -- 172.21.15.146:0/2065021774 learned_addr learned my addr 172.21.15.146:0/2065021774 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f7ee8a15700 1 --2- 172.21.15.146:0/2065021774 >> v2:172.21.15.146:3300/0 conn(0x7f7ee41371c0 0x7f7ee41395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f7ee37fe700 1 -- 172.21.15.146:0/2065021774 >> v2:172.21.15.146:3300/0 conn(0x7f7ee41371c0 msgr2=0x7f7ee41395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f7ee37fe700 1 --2- 172.21.15.146:0/2065021774 >> v2:172.21.15.146:3300/0 conn(0x7f7ee41371c0 0x7f7ee41395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f7ee37fe700 1 -- 172.21.15.146:0/2065021774 >> v1:172.21.15.146:6789/0 conn(0x7f7ee409e870 legacy=0x7f7ee409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f7ee37fe700 1 -- 172.21.15.146:0/2065021774 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee409bab0 con 0x7f7ee409f350 2023-10-03T10:16:10.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f214dbc6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2148133f70 0x7f21481343d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f214dbc6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21480a3aa0 con 0x7f21480a0a90 2023-10-03T10:16:10.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f214dbc6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214809a540 con 0x7f2148133f70 2023-10-03T10:16:10.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f214dbc6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21480a1fe0 con 0x7f21480a13a0 2023-10-03T10:16:10.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f2147fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2148133f70 0x7f21481343d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f2147fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2148133f70 0x7f21481343d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40380/0 (socket says 172.21.15.146:40380) 2023-10-03T10:16:10.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f2147fff700 1 -- 172.21.15.146:0/2164902429 learned_addr learned my addr 172.21.15.146:0/2164902429 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:10.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f2146ffd700 1 --2- 172.21.15.146:0/2164902429 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21480a13a0 0x7f2148133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.746+0000 7f21477fe700 1 --2- 172.21.15.146:0/2164902429 >> v2:172.21.15.146:3300/0 conn(0x7f21480a0a90 0x7f21480a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.747+0000 7f7ee37fe700 1 --2- 172.21.15.146:0/2065021774 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ee409f350 0x7f7ee4136c80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7ed40098f0 tx=0x7f7ed4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68c58e8a610dc740 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.747+0000 7f2146ffd700 1 -- 172.21.15.146:0/2164902429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2148133f70 msgr2=0x7f21481343d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.747+0000 7f2146ffd700 1 --2- 172.21.15.146:0/2164902429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2148133f70 0x7f21481343d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.747+0000 7f2146ffd700 1 -- 172.21.15.146:0/2164902429 >> v2:172.21.15.146:3300/0 conn(0x7f21480a0a90 msgr2=0x7f21480a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.747+0000 7f2146ffd700 1 --2- 172.21.15.146:0/2164902429 >> v2:172.21.15.146:3300/0 conn(0x7f21480a0a90 0x7f21480a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.747+0000 7f2146ffd700 1 -- 172.21.15.146:0/2164902429 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214809a280 con 0x7f21480a13a0 2023-10-03T10:16:10.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.747+0000 7f8f4d3e8700 1 -- 172.21.15.146:0/2288801315 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f48138040 msgr2=0x7f8f48138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.747+0000 7f8f4d3e8700 1 --2- 172.21.15.146:0/2288801315 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f48138040 0x7f8f48138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.747+0000 7f8f4d3e8700 1 -- 172.21.15.146:0/2288801315 >> v2:172.21.15.146:3300/0 conn(0x7f8f480a08e0 msgr2=0x7f8f480a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.747+0000 7f8f4d3e8700 1 --2- 172.21.15.146:0/2288801315 >> v2:172.21.15.146:3300/0 conn(0x7f8f480a08e0 0x7f8f480a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.747+0000 7f8f4d3e8700 1 -- 172.21.15.146:0/2288801315 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4809b9b0 con 0x7f8f480a1230 2023-10-03T10:16:10.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.747+0000 7f2146ffd700 1 --2- 172.21.15.146:0/2164902429 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21480a13a0 0x7f2148133a30 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f213c009870 tx=0x7f213c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36c8fcfdaf8fd6eb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.747+0000 7f8f4d3e8700 1 --2- 172.21.15.146:0/2288801315 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f480a1230 0x7f8f4813ed10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009eb0 tx=0x7f8f4000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dae502e776b2be70 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.747+0000 7f7ee2ffd700 1 -- 172.21.15.146:0/2065021774 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4011830 con 0x7f7ee409f350 2023-10-03T10:16:10.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.747+0000 7f7ee2ffd700 1 -- 172.21.15.146:0/2065021774 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed4011990 con 0x7f7ee409f350 2023-10-03T10:16:10.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.747+0000 7f7ee2ffd700 1 -- 172.21.15.146:0/2065021774 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4011d00 con 0x7f7ee409f350 2023-10-03T10:16:10.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.747+0000 7f21467fc700 1 -- 172.21.15.146:0/2164902429 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c011830 con 0x7f21480a13a0 2023-10-03T10:16:10.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.747+0000 7f21467fc700 1 -- 172.21.15.146:0/2164902429 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c011990 con 0x7f21480a13a0 2023-10-03T10:16:10.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.747+0000 7f21467fc700 1 -- 172.21.15.146:0/2164902429 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c011d20 con 0x7f21480a13a0 2023-10-03T10:16:10.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.748+0000 7f7eea478700 1 -- 172.21.15.146:0/2065021774 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ee409f350 msgr2=0x7f7ee4136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.748+0000 7f7eea478700 1 --2- 172.21.15.146:0/2065021774 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ee409f350 0x7f7ee4136c80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7ed40098f0 tx=0x7f7ed4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:10.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.748+0000 7f8f477fe700 1 -- 172.21.15.146:0/2288801315 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4000e070 con 0x7f8f480a1230 2023-10-03T10:16:10.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.748+0000 7f214dbc6700 1 -- 172.21.15.146:0/2164902429 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21480a13a0 msgr2=0x7f2148133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.748+0000 7f214dbc6700 1 --2- 172.21.15.146:0/2164902429 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21480a13a0 0x7f2148133a30 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f213c009870 tx=0x7f213c009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:10.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.748+0000 7f214dbc6700 1 -- 172.21.15.146:0/2164902429 shutdown_connections 2023-10-03T10:16:10.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.748+0000 7f214dbc6700 1 --2- 172.21.15.146:0/2164902429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2148133f70 0x7f21481343d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.748+0000 7f214dbc6700 1 --2- 172.21.15.146:0/2164902429 >> v2:172.21.15.146:3300/0 conn(0x7f21480a0a90 0x7f21480a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.748+0000 7f214dbc6700 1 --2- 172.21.15.146:0/2164902429 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21480a13a0 0x7f2148133a30 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.748+0000 7f214dbc6700 1 -- 172.21.15.146:0/2164902429 >> 172.21.15.146:0/2164902429 conn(0x7f2148099c40 msgr2=0x7f214806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.748+0000 7f214dbc6700 1 -- 172.21.15.146:0/2164902429 shutdown_connections 2023-10-03T10:16:10.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.748+0000 7f8f477fe700 1 -- 172.21.15.146:0/2288801315 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4000b940 con 0x7f8f480a1230 2023-10-03T10:16:10.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.748+0000 7f8f477fe700 1 -- 172.21.15.146:0/2288801315 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4000bcf0 con 0x7f8f480a1230 2023-10-03T10:16:10.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.749+0000 7f8f4ee4b700 1 -- 172.21.15.146:0/2288801315 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f480a1230 msgr2=0x7f8f4813ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.749+0000 7f8f4ee4b700 1 --2- 172.21.15.146:0/2288801315 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f480a1230 0x7f8f4813ed10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009eb0 tx=0x7f8f4000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:10.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.748+0000 7f7eea478700 1 -- 172.21.15.146:0/2065021774 shutdown_connections 2023-10-03T10:16:10.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.748+0000 7f7eea478700 1 --2- 172.21.15.146:0/2065021774 >> v2:172.21.15.146:3300/0 conn(0x7f7ee41371c0 0x7f7ee41395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.748+0000 7f7eea478700 1 --2- 172.21.15.146:0/2065021774 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ee409f350 0x7f7ee4136c80 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.748+0000 7f7eea478700 1 -- 172.21.15.146:0/2065021774 >> 172.21.15.146:0/2065021774 conn(0x7f7ee40a4430 msgr2=0x7f7ee40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.748+0000 7f7eea478700 1 -- 172.21.15.146:0/2065021774 shutdown_connections 2023-10-03T10:16:10.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.748+0000 7f7eea478700 1 -- 172.21.15.146:0/2065021774 wait complete. 2023-10-03T10:16:10.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.748+0000 7f214dbc6700 1 -- 172.21.15.146:0/2164902429 wait complete. 2023-10-03T10:16:10.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.749+0000 7f8f4ee4b700 1 -- 172.21.15.146:0/2288801315 shutdown_connections 2023-10-03T10:16:10.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.749+0000 7f8f4ee4b700 1 --2- 172.21.15.146:0/2288801315 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f48138040 0x7f8f48138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.749+0000 7f8f4ee4b700 1 --2- 172.21.15.146:0/2288801315 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f480a1230 0x7f8f4813ed10 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.749+0000 7f8f4ee4b700 1 --2- 172.21.15.146:0/2288801315 >> v2:172.21.15.146:3300/0 conn(0x7f8f480a08e0 0x7f8f480a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.749+0000 7f8f4ee4b700 1 -- 172.21.15.146:0/2288801315 >> 172.21.15.146:0/2288801315 conn(0x7f8f480a2980 msgr2=0x7f8f480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.749+0000 7f214dbc6700 1 Processor -- start 2023-10-03T10:16:10.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.750+0000 7f8f4ee4b700 1 -- 172.21.15.146:0/2288801315 shutdown_connections 2023-10-03T10:16:10.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.750+0000 7f7eea478700 1 Processor -- start 2023-10-03T10:16:10.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.750+0000 7f214dbc6700 1 -- start start 2023-10-03T10:16:10.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.750+0000 7f214dbc6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21480a0a90 0x7f21481d4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.750+0000 7f214dbc6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21480a13a0 0x7f21481d5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.750+0000 7f214dbc6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2148133f70 0x7f21481d5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.750+0000 7f214dbc6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2148131350 con 0x7f21480a0a90 2023-10-03T10:16:10.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.750+0000 7f214dbc6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214812ff60 con 0x7f2148133f70 2023-10-03T10:16:10.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.750+0000 7f214dbc6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2148132210 con 0x7f21480a13a0 2023-10-03T10:16:10.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.750+0000 7f8f4ee4b700 1 -- 172.21.15.146:0/2288801315 wait complete. 2023-10-03T10:16:10.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.751+0000 7f8f4ee4b700 1 Processor -- start 2023-10-03T10:16:10.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.750+0000 7f7eea478700 1 -- start start 2023-10-03T10:16:10.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.750+0000 7f7eea478700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ee409e870 0x7f7ee4122ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.750+0000 7f7eea478700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ee409f350 0x7f7ee4123410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.750+0000 7f7eea478700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ee41371c0 0x7f7ee4123950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.750+0000 7f7eea478700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee4125d20 con 0x7f7ee41371c0 2023-10-03T10:16:10.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.751+0000 7f7eea478700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee4125f20 con 0x7f7ee409e870 2023-10-03T10:16:10.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.751+0000 7f7eea478700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee4124010 con 0x7f7ee409f350 2023-10-03T10:16:10.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.751+0000 7f2146ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21480a13a0 0x7f21481d5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.751+0000 7f21477fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21480a0a90 0x7f21481d4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.751+0000 7f2146ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21480a13a0 0x7f21481d5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39132/0 (socket says 172.21.15.146:39132) 2023-10-03T10:16:10.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.751+0000 7f21477fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21480a0a90 0x7f21481d4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59688/0 (socket says 172.21.15.146:59688) 2023-10-03T10:16:10.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.751+0000 7f2146ffd700 1 -- 172.21.15.146:0/2353895031 learned_addr learned my addr 172.21.15.146:0/2353895031 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:10.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.751+0000 7f2147fff700 1 --2- 172.21.15.146:0/2353895031 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2148133f70 0x7f21481d5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.751+0000 7f7ee3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ee409e870 0x7f7ee4122ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.751+0000 7f7ee37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ee409f350 0x7f7ee4123410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.751+0000 7f7ee37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ee409f350 0x7f7ee4123410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39148/0 (socket says 172.21.15.146:39148) 2023-10-03T10:16:10.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.751+0000 7f7ee3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ee409e870 0x7f7ee4122ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40392/0 (socket says 172.21.15.146:40392) 2023-10-03T10:16:10.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.751+0000 7f7ee37fe700 1 -- 172.21.15.146:0/2924746334 learned_addr learned my addr 172.21.15.146:0/2924746334 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:10.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.751+0000 7f7ee8a15700 1 --2- 172.21.15.146:0/2924746334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ee41371c0 0x7f7ee4123950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.751+0000 7f7ee8a15700 1 -- 172.21.15.146:0/2924746334 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ee409f350 msgr2=0x7f7ee4123410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.751+0000 7f7ee8a15700 1 --2- 172.21.15.146:0/2924746334 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ee409f350 0x7f7ee4123410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.751+0000 7f7ee8a15700 1 -- 172.21.15.146:0/2924746334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ee409e870 msgr2=0x7f7ee4122ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.751+0000 7f7ee8a15700 1 --2- 172.21.15.146:0/2924746334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ee409e870 0x7f7ee4122ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.751+0000 7f7ee8a15700 1 -- 172.21.15.146:0/2924746334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed4009550 con 0x7f7ee41371c0 2023-10-03T10:16:10.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.752+0000 7f2147fff700 1 -- 172.21.15.146:0/2353895031 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21480a13a0 msgr2=0x7f21481d5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.752+0000 7f2147fff700 1 --2- 172.21.15.146:0/2353895031 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21480a13a0 0x7f21481d5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.752+0000 7f2147fff700 1 -- 172.21.15.146:0/2353895031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21480a0a90 msgr2=0x7f21481d4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.751+0000 7f8f4ee4b700 1 -- start start 2023-10-03T10:16:10.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.752+0000 7f7ee8a15700 1 --2- 172.21.15.146:0/2924746334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ee41371c0 0x7f7ee4123950 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00ef90 tx=0x7f7edc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.752+0000 7f8f4ee4b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f480a08e0 0x7f8f481263d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.752+0000 7f8f4ee4b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f480a1230 0x7f8f48126910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.752+0000 7f8f4ee4b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f48138040 0x7f8f48126e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.752+0000 7f8f4ee4b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f48129e50 con 0x7f8f48138040 2023-10-03T10:16:10.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.752+0000 7f8f4ee4b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f48127f40 con 0x7f8f480a08e0 2023-10-03T10:16:10.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.752+0000 7f8f4ee4b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4809c990 con 0x7f8f480a1230 2023-10-03T10:16:10.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.752+0000 7f2147fff700 1 --2- 172.21.15.146:0/2353895031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21480a0a90 0x7f21481d4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.752+0000 7f2147fff700 1 -- 172.21.15.146:0/2353895031 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213c0094a0 con 0x7f2148133f70 2023-10-03T10:16:10.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.752+0000 7f2146ffd700 1 --2- 172.21.15.146:0/2353895031 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21480a13a0 0x7f21481d5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:10.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.752+0000 7f21477fe700 1 --2- 172.21.15.146:0/2353895031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21480a0a90 0x7f21481d4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:10.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.752+0000 7f8f4d3e8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f48138040 0x7f8f48126e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.752+0000 7f8f4d3e8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f48138040 0x7f8f48126e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59706/0 (socket says 172.21.15.146:59706) 2023-10-03T10:16:10.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.752+0000 7f8f4d3e8700 1 -- 172.21.15.146:0/3183679358 learned_addr learned my addr 172.21.15.146:0/3183679358 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:10.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.752+0000 7f8f47fff700 1 --2- 172.21.15.146:0/3183679358 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f480a1230 0x7f8f48126910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.752+0000 7f8f4cbe7700 1 --2- 172.21.15.146:0/3183679358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f480a08e0 0x7f8f481263d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.753+0000 7f8f4d3e8700 1 -- 172.21.15.146:0/3183679358 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f480a1230 msgr2=0x7f8f48126910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.753+0000 7f8f4d3e8700 1 --2- 172.21.15.146:0/3183679358 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f480a1230 0x7f8f48126910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.753+0000 7f8f4d3e8700 1 -- 172.21.15.146:0/3183679358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f480a08e0 msgr2=0x7f8f481263d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.753+0000 7f8f4d3e8700 1 --2- 172.21.15.146:0/3183679358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f480a08e0 0x7f8f481263d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.753+0000 7f8f4d3e8700 1 -- 172.21.15.146:0/3183679358 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f40009b30 con 0x7f8f48138040 2023-10-03T10:16:10.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.753+0000 7f2147fff700 1 --2- 172.21.15.146:0/2353895031 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2148133f70 0x7f21481d5a60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f214000efc0 tx=0x7f214000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.753+0000 7f8f4d3e8700 1 --2- 172.21.15.146:0/3183679358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f48138040 0x7f8f48126e50 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f8f48137b20 tx=0x7f8f40004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.753+0000 7f8f457fa700 1 -- 172.21.15.146:0/3183679358 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40004450 con 0x7f8f48138040 2023-10-03T10:16:10.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.753+0000 7f8f457fa700 1 -- 172.21.15.146:0/3183679358 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f400045f0 con 0x7f8f48138040 2023-10-03T10:16:10.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.753+0000 7f8f457fa700 1 -- 172.21.15.146:0/3183679358 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f400092e0 con 0x7f8f48138040 2023-10-03T10:16:10.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.753+0000 7f7ee0ff9700 1 -- 172.21.15.146:0/2924746334 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc00cc90 con 0x7f7ee41371c0 2023-10-03T10:16:10.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.753+0000 7f7ee0ff9700 1 -- 172.21.15.146:0/2924746334 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc00f040 con 0x7f7ee41371c0 2023-10-03T10:16:10.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.753+0000 7f7ee0ff9700 1 -- 172.21.15.146:0/2924746334 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc009e60 con 0x7f7ee41371c0 2023-10-03T10:16:10.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.753+0000 7f8f4ee4b700 1 -- 172.21.15.146:0/3183679358 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f4809a240 con 0x7f8f48138040 2023-10-03T10:16:10.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.753+0000 7f8f4ee4b700 1 -- 172.21.15.146:0/3183679358 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f481372e0 con 0x7f8f48138040 2023-10-03T10:16:10.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.754+0000 7f8f4ee4b700 1 -- 172.21.15.146:0/3183679358 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f481297f0 con 0x7f8f48138040 2023-10-03T10:16:10.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.754+0000 7f8f457fa700 1 -- 172.21.15.146:0/3183679358 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f4001b430 con 0x7f8f48138040 2023-10-03T10:16:10.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.754+0000 7f8f457fa700 1 -- 172.21.15.146:0/3183679358 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8f40040ca0 con 0x7f8f48138040 2023-10-03T10:16:10.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.753+0000 7f7eea478700 1 -- 172.21.15.146:0/2924746334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee406d3e0 con 0x7f7ee41371c0 2023-10-03T10:16:10.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.753+0000 7f7eea478700 1 -- 172.21.15.146:0/2924746334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee4135a50 con 0x7f7ee41371c0 2023-10-03T10:16:10.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.754+0000 7f7eea478700 1 -- 172.21.15.146:0/2924746334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee404f2a0 con 0x7f7ee41371c0 2023-10-03T10:16:10.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.753+0000 7f212ffff700 1 -- 172.21.15.146:0/2353895031 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2140003c20 con 0x7f2148133f70 2023-10-03T10:16:10.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.753+0000 7f212ffff700 1 -- 172.21.15.146:0/2353895031 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214000f040 con 0x7f2148133f70 2023-10-03T10:16:10.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.753+0000 7f212ffff700 1 -- 172.21.15.146:0/2353895031 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2140009e60 con 0x7f2148133f70 2023-10-03T10:16:10.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.754+0000 7f214dbc6700 1 -- 172.21.15.146:0/2353895031 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2148131da0 con 0x7f2148133f70 2023-10-03T10:16:10.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.754+0000 7f214dbc6700 1 -- 172.21.15.146:0/2353895031 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2148132520 con 0x7f2148133f70 2023-10-03T10:16:10.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.755+0000 7f212ffff700 1 -- 172.21.15.146:0/2353895031 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f214000c880 con 0x7f2148133f70 2023-10-03T10:16:10.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.755+0000 7f214dbc6700 1 -- 172.21.15.146:0/2353895031 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214812fdb0 con 0x7f2148133f70 2023-10-03T10:16:10.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.756+0000 7f212ffff700 1 -- 172.21.15.146:0/2353895031 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f214003f9d0 con 0x7f2148133f70 2023-10-03T10:16:10.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.759+0000 7f7ee0ff9700 1 -- 172.21.15.146:0/2924746334 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7edc014480 con 0x7f7ee41371c0 2023-10-03T10:16:10.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.760+0000 7f7ee0ff9700 1 -- 172.21.15.146:0/2924746334 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7edc040a40 con 0x7f7ee41371c0 2023-10-03T10:16:10.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.760+0000 7f7ee0ff9700 1 -- 172.21.15.146:0/2924746334 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7edc025390 con 0x7f7ee41371c0 2023-10-03T10:16:10.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.764+0000 7f8f457fa700 1 -- 172.21.15.146:0/3183679358 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f4001f070 con 0x7f8f48138040 2023-10-03T10:16:10.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.764+0000 7f212ffff700 1 -- 172.21.15.146:0/2353895031 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2140013bd0 con 0x7f2148133f70 2023-10-03T10:16:10.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.839+0000 7f39448f6700 1 -- 172.21.15.146:0/3265653441 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f39401317a0 con 0x7f3940136960 2023-10-03T10:16:10.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.839+0000 7f392effd700 1 -- 172.21.15.146:0/3265653441 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f39340233d0 con 0x7f3940136960 2023-10-03T10:16:10.840 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:10.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.842+0000 7f39448f6700 1 -- 172.21.15.146:0/3265653441 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3940136960 msgr2=0x7f3940071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.842+0000 7f39448f6700 1 --2- 172.21.15.146:0/3265653441 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3940136960 0x7f3940071250 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3934009130 tx=0x7f3934004750 comp rx=0 tx=0).stop 2023-10-03T10:16:10.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.843+0000 7f39448f6700 1 -- 172.21.15.146:0/3265653441 shutdown_connections 2023-10-03T10:16:10.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.843+0000 7f39448f6700 1 --2- 172.21.15.146:0/3265653441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3940139280 0x7f3940071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.843+0000 7f39448f6700 1 --2- 172.21.15.146:0/3265653441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3940133ad0 0x7f394006fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.843+0000 7f39448f6700 1 --2- 172.21.15.146:0/3265653441 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3940136960 0x7f3940071250 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.843+0000 7f39448f6700 1 -- 172.21.15.146:0/3265653441 >> 172.21.15.146:0/3265653441 conn(0x7f3940099c40 msgr2=0x7f3940134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.843+0000 7f39448f6700 1 -- 172.21.15.146:0/3265653441 shutdown_connections 2023-10-03T10:16:10.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.843+0000 7f39448f6700 1 -- 172.21.15.146:0/3265653441 wait complete. 2023-10-03T10:16:10.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:10.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.969+0000 7f214dbc6700 1 -- 172.21.15.146:0/2353895031 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2148130120 con 0x7f2148133f70 2023-10-03T10:16:10.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.969+0000 7f212ffff700 1 -- 172.21.15.146:0/2353895031 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2140014e00 con 0x7f2148133f70 2023-10-03T10:16:10.970 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.971+0000 7f214dbc6700 1 -- 172.21.15.146:0/2353895031 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2148133f70 msgr2=0x7f21481d5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.971+0000 7f214dbc6700 1 --2- 172.21.15.146:0/2353895031 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2148133f70 0x7f21481d5a60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f214000efc0 tx=0x7f214000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.971+0000 7f214dbc6700 1 -- 172.21.15.146:0/2353895031 shutdown_connections 2023-10-03T10:16:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.971+0000 7f214dbc6700 1 --2- 172.21.15.146:0/2353895031 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2148133f70 0x7f21481d5a60 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.971+0000 7f214dbc6700 1 --2- 172.21.15.146:0/2353895031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21480a0a90 0x7f21481d4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.971+0000 7f214dbc6700 1 --2- 172.21.15.146:0/2353895031 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21480a13a0 0x7f21481d5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.971+0000 7f214dbc6700 1 -- 172.21.15.146:0/2353895031 >> 172.21.15.146:0/2353895031 conn(0x7f2148099c40 msgr2=0x7f21481c8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.971+0000 7f214dbc6700 1 -- 172.21.15.146:0/2353895031 shutdown_connections 2023-10-03T10:16:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.971+0000 7f214dbc6700 1 -- 172.21.15.146:0/2353895031 wait complete. 2023-10-03T10:16:10.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.975+0000 7f7eea478700 1 -- 172.21.15.146:0/2924746334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7ee406b2a0 con 0x7f7ee41371c0 2023-10-03T10:16:10.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.975+0000 7f7ee0ff9700 1 -- 172.21.15.146:0/2924746334 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7edc025560 con 0x7f7ee41371c0 2023-10-03T10:16:10.976 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:10.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.978+0000 7f8f4ee4b700 1 -- 172.21.15.146:0/3183679358 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8f4804f2a0 con 0x7f8f48138040 2023-10-03T10:16:10.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.978+0000 7f7eea478700 1 -- 172.21.15.146:0/2924746334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ee41371c0 msgr2=0x7f7ee4123950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.978+0000 7f7eea478700 1 --2- 172.21.15.146:0/2924746334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ee41371c0 0x7f7ee4123950 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00ef90 tx=0x7f7edc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.978+0000 7f7eea478700 1 -- 172.21.15.146:0/2924746334 shutdown_connections 2023-10-03T10:16:10.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.978+0000 7f7eea478700 1 --2- 172.21.15.146:0/2924746334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ee41371c0 0x7f7ee4123950 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.978+0000 7f7eea478700 1 --2- 172.21.15.146:0/2924746334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ee409e870 0x7f7ee4122ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.978+0000 7f7eea478700 1 --2- 172.21.15.146:0/2924746334 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ee409f350 0x7f7ee4123410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.978+0000 7f7eea478700 1 -- 172.21.15.146:0/2924746334 >> 172.21.15.146:0/2924746334 conn(0x7f7ee40a4430 msgr2=0x7f7ee40a3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.978+0000 7f8f457fa700 1 -- 172.21.15.146:0/3183679358 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8f4002cb40 con 0x7f8f48138040 2023-10-03T10:16:10.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.978+0000 7f7eea478700 1 -- 172.21.15.146:0/2924746334 shutdown_connections 2023-10-03T10:16:10.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.978+0000 7f7eea478700 1 -- 172.21.15.146:0/2924746334 wait complete. 2023-10-03T10:16:10.980 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:10.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.982+0000 7f8f4ee4b700 1 -- 172.21.15.146:0/3183679358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f48138040 msgr2=0x7f8f48126e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.982+0000 7f8f4ee4b700 1 --2- 172.21.15.146:0/3183679358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f48138040 0x7f8f48126e50 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f8f48137b20 tx=0x7f8f40004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.982+0000 7f8f4ee4b700 1 -- 172.21.15.146:0/3183679358 shutdown_connections 2023-10-03T10:16:10.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.982+0000 7f8f4ee4b700 1 --2- 172.21.15.146:0/3183679358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f48138040 0x7f8f48126e50 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.982+0000 7f8f4ee4b700 1 --2- 172.21.15.146:0/3183679358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f480a08e0 0x7f8f481263d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.982+0000 7f8f4ee4b700 1 --2- 172.21.15.146:0/3183679358 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f480a1230 0x7f8f48126910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.982+0000 7f8f4ee4b700 1 -- 172.21.15.146:0/3183679358 >> 172.21.15.146:0/3183679358 conn(0x7f8f480a2980 msgr2=0x7f8f4809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.982+0000 7f8f4ee4b700 1 -- 172.21.15.146:0/3183679358 shutdown_connections 2023-10-03T10:16:10.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:10.982+0000 7f8f4ee4b700 1 -- 172.21.15.146:0/3183679358 wait complete. 2023-10-03T10:16:10.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:10.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:10.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:11.861 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:11.988 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:11.993 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:11.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.996+0000 7f4fb5173700 1 Processor -- start 2023-10-03T10:16:11.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.996+0000 7f4fb5173700 1 -- start start 2023-10-03T10:16:11.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.997+0000 7f4fb5173700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4fb0133b10 0x7f4fb0133ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.997+0000 7f4fb5173700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fb00a0980 0x7f4fb00a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.997+0000 7f4fb5173700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb01336e0 con 0x7f4fb00a1310 2023-10-03T10:16:11.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.997+0000 7f4fb5173700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb009a080 con 0x7f4fb0133b10 2023-10-03T10:16:11.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.997+0000 7f4fb5173700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb009a760 con 0x7f4fb00a0980 2023-10-03T10:16:11.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.997+0000 7f4fae59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fb00a0980 0x7f4fb00a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.997+0000 7f4faed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4fb0133b10 0x7f4fb0133ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.997+0000 7f4fae59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fb00a0980 0x7f4fb00a0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40404/0 (socket says 172.21.15.146:40404) 2023-10-03T10:16:11.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.997+0000 7f4fae59c700 1 -- 172.21.15.146:0/1040246856 learned_addr learned my addr 172.21.15.146:0/1040246856 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:11.999 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:12.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.997+0000 7f4fae59c700 1 -- 172.21.15.146:0/1040246856 >> v2:172.21.15.146:3300/0 conn(0x7f4fb0133b10 msgr2=0x7f4fb0133ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:12.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.997+0000 7f4fae59c700 1 --2- 172.21.15.146:0/1040246856 >> v2:172.21.15.146:3300/0 conn(0x7f4fb0133b10 0x7f4fb0133ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.997+0000 7f4fae59c700 1 -- 172.21.15.146:0/1040246856 >> v1:172.21.15.146:6789/0 conn(0x7f4fb00a1310 legacy=0x7f4fb013a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.997+0000 7f4fae59c700 1 -- 172.21.15.146:0/1040246856 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb00a1790 con 0x7f4fb00a0980 2023-10-03T10:16:12.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.998+0000 7f4fae59c700 1 --2- 172.21.15.146:0/1040246856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fb00a0980 0x7f4fb00a0dd0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40098f0 tx=0x7f4fa4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d0444a3d25d8be3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.998+0000 7f4fadd9b700 1 -- 172.21.15.146:0/1040246856 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4004230 con 0x7f4fb00a0980 2023-10-03T10:16:12.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.998+0000 7f4fadd9b700 1 -- 172.21.15.146:0/1040246856 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa4004390 con 0x7f4fb00a0980 2023-10-03T10:16:12.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.998+0000 7f4fadd9b700 1 -- 172.21.15.146:0/1040246856 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa40036a0 con 0x7f4fb00a0980 2023-10-03T10:16:12.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.998+0000 7f4fb5173700 1 -- 172.21.15.146:0/1040246856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fb00a0980 msgr2=0x7f4fb00a0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.998+0000 7f4fb5173700 1 --2- 172.21.15.146:0/1040246856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fb00a0980 0x7f4fb00a0dd0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40098f0 tx=0x7f4fa4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.998+0000 7f4fb5173700 1 -- 172.21.15.146:0/1040246856 shutdown_connections 2023-10-03T10:16:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.998+0000 7f4fb5173700 1 --2- 172.21.15.146:0/1040246856 >> v2:172.21.15.146:3300/0 conn(0x7f4fb0133b10 0x7f4fb0133ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.998+0000 7f4fb5173700 1 --2- 172.21.15.146:0/1040246856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fb00a0980 0x7f4fb00a0dd0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.999+0000 7f4fb5173700 1 -- 172.21.15.146:0/1040246856 >> 172.21.15.146:0/1040246856 conn(0x7f4fb00a2980 msgr2=0x7f4fb00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.999+0000 7f4fb5173700 1 -- 172.21.15.146:0/1040246856 shutdown_connections 2023-10-03T10:16:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:11.999+0000 7f4fb5173700 1 -- 172.21.15.146:0/1040246856 wait complete. 2023-10-03T10:16:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.000+0000 7f4fb5173700 1 Processor -- start 2023-10-03T10:16:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.000+0000 7f4fb5173700 1 -- start start 2023-10-03T10:16:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.000+0000 7f4fb5173700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4fb00a0980 0x7f4fb011b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.000+0000 7f4fb5173700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fb00a1310 0x7f4fb011bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.001+0000 7f4fb5173700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fb0133b10 0x7f4fb011c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.001+0000 7f4fb5173700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb011f040 con 0x7f4fb00a1310 2023-10-03T10:16:12.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.001+0000 7f4fb5173700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb011d3b0 con 0x7f4fb0133b10 2023-10-03T10:16:12.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.001+0000 7f4fb5173700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb011f290 con 0x7f4fb00a0980 2023-10-03T10:16:12.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.001+0000 7f4faed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4fb00a0980 0x7f4fb011b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.001+0000 7f4faed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4fb00a0980 0x7f4fb011b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39178/0 (socket says 172.21.15.146:39178) 2023-10-03T10:16:12.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.001+0000 7f4faf59e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fb0133b10 0x7f4fb011c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.001+0000 7f4faed9d700 1 -- 172.21.15.146:0/2698567471 learned_addr learned my addr 172.21.15.146:0/2698567471 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:12.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.001+0000 7f4fae59c700 1 --2- 172.21.15.146:0/2698567471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fb00a1310 0x7f4fb011bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.001+0000 7f4faed9d700 1 -- 172.21.15.146:0/2698567471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fb0133b10 msgr2=0x7f4fb011c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.001+0000 7f4faed9d700 1 --2- 172.21.15.146:0/2698567471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fb0133b10 0x7f4fb011c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.001+0000 7f4faed9d700 1 -- 172.21.15.146:0/2698567471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fb00a1310 msgr2=0x7f4fb011bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.001+0000 7f4faed9d700 1 --2- 172.21.15.146:0/2698567471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fb00a1310 0x7f4fb011bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.001+0000 7f4faed9d700 1 -- 172.21.15.146:0/2698567471 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa4009550 con 0x7f4fb00a0980 2023-10-03T10:16:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.001+0000 7f4fae59c700 1 --2- 172.21.15.146:0/2698567471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fb00a1310 0x7f4fb011bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.001+0000 7f4faf59e700 1 --2- 172.21.15.146:0/2698567471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fb0133b10 0x7f4fb011c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.001+0000 7f4faed9d700 1 --2- 172.21.15.146:0/2698567471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4fb00a0980 0x7f4fb011b9d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000e9c0 tx=0x7f4fa000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.002+0000 7f4f977fe700 1 -- 172.21.15.146:0/2698567471 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa00096f0 con 0x7f4fb00a0980 2023-10-03T10:16:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.002+0000 7f4f977fe700 1 -- 172.21.15.146:0/2698567471 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa000ee60 con 0x7f4fb00a0980 2023-10-03T10:16:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.002+0000 7f4fb5173700 1 -- 172.21.15.146:0/2698567471 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb011cd30 con 0x7f4fb00a0980 2023-10-03T10:16:12.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.002+0000 7f4f977fe700 1 -- 172.21.15.146:0/2698567471 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa000ca50 con 0x7f4fb00a0980 2023-10-03T10:16:12.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.002+0000 7f4fb5173700 1 -- 172.21.15.146:0/2698567471 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb0132040 con 0x7f4fb00a0980 2023-10-03T10:16:12.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.003+0000 7f4f977fe700 1 -- 172.21.15.146:0/2698567471 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4fa000cbb0 con 0x7f4fb00a0980 2023-10-03T10:16:12.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.003+0000 7f4fb5173700 1 -- 172.21.15.146:0/2698567471 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb006b700 con 0x7f4fb00a0980 2023-10-03T10:16:12.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.003+0000 7f4f977fe700 1 -- 172.21.15.146:0/2698567471 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4fa003fae0 con 0x7f4fb00a0980 2023-10-03T10:16:12.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.008+0000 7f4f977fe700 1 -- 172.21.15.146:0/2698567471 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4fa001b3b0 con 0x7f4fb00a0980 2023-10-03T10:16:12.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.130+0000 7f7125ba2700 1 Processor -- start 2023-10-03T10:16:12.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.130+0000 7f7125ba2700 1 -- start start 2023-10-03T10:16:12.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.131+0000 7f7125ba2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71200a0a70 0x7f71200a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.131+0000 7f7125ba2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71200a1380 0x7f7120133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.131+0000 7f7125ba2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7120133f50 0x7f71201343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.131+0000 7f7125ba2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712009e9d0 con 0x7f7120133f50 2023-10-03T10:16:12.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.131+0000 7f7125ba2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712009dc00 con 0x7f71200a1380 2023-10-03T10:16:12.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.131+0000 7f7125ba2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f712009dec0 con 0x7f71200a0a70 2023-10-03T10:16:12.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.131+0000 7f711effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71200a1380 0x7f7120133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.131+0000 7f711effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71200a1380 0x7f7120133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40418/0 (socket says 172.21.15.146:40418) 2023-10-03T10:16:12.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.131+0000 7f711effd700 1 -- 172.21.15.146:0/1449457248 learned_addr learned my addr 172.21.15.146:0/1449457248 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:12.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.131+0000 7f711f7fe700 1 --2- 172.21.15.146:0/1449457248 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71200a0a70 0x7f71200a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.131+0000 7f711ffff700 1 --2- 172.21.15.146:0/1449457248 >> v2:172.21.15.146:3300/0 conn(0x7f7120133f50 0x7f71201343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.131+0000 7f711effd700 1 -- 172.21.15.146:0/1449457248 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71200a0a70 msgr2=0x7f71200a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:12.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.131+0000 7f711effd700 1 --2- 172.21.15.146:0/1449457248 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71200a0a70 0x7f71200a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.131+0000 7f711effd700 1 -- 172.21.15.146:0/1449457248 >> v2:172.21.15.146:3300/0 conn(0x7f7120133f50 msgr2=0x7f71201343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:12.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.131+0000 7f711effd700 1 --2- 172.21.15.146:0/1449457248 >> v2:172.21.15.146:3300/0 conn(0x7f7120133f50 0x7f71201343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.131+0000 7f711effd700 1 -- 172.21.15.146:0/1449457248 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712009e6a0 con 0x7f71200a1380 2023-10-03T10:16:12.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.131+0000 7f711effd700 1 --2- 172.21.15.146:0/1449457248 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71200a1380 0x7f7120133a10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f71140098f0 tx=0x7f7114009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eaadd14748599661 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.132+0000 7f711e7fc700 1 -- 172.21.15.146:0/1449457248 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114011830 con 0x7f71200a1380 2023-10-03T10:16:12.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.132+0000 7f711e7fc700 1 -- 172.21.15.146:0/1449457248 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7114011990 con 0x7f71200a1380 2023-10-03T10:16:12.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.132+0000 7f711e7fc700 1 -- 172.21.15.146:0/1449457248 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114011d20 con 0x7f71200a1380 2023-10-03T10:16:12.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.132+0000 7f7125ba2700 1 -- 172.21.15.146:0/1449457248 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71200a1380 msgr2=0x7f7120133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.132+0000 7f7125ba2700 1 --2- 172.21.15.146:0/1449457248 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71200a1380 0x7f7120133a10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f71140098f0 tx=0x7f7114009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:12.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.132+0000 7f7125ba2700 1 -- 172.21.15.146:0/1449457248 shutdown_connections 2023-10-03T10:16:12.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.132+0000 7f7125ba2700 1 --2- 172.21.15.146:0/1449457248 >> v2:172.21.15.146:3300/0 conn(0x7f7120133f50 0x7f71201343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.132+0000 7f7125ba2700 1 --2- 172.21.15.146:0/1449457248 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71200a0a70 0x7f71200a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.132+0000 7f7125ba2700 1 --2- 172.21.15.146:0/1449457248 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71200a1380 0x7f7120133a10 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.132+0000 7f7125ba2700 1 -- 172.21.15.146:0/1449457248 >> 172.21.15.146:0/1449457248 conn(0x7f71200a6610 msgr2=0x7f71200a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.132+0000 7f7125ba2700 1 -- 172.21.15.146:0/1449457248 shutdown_connections 2023-10-03T10:16:12.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.133+0000 7f0489e35700 1 Processor -- start 2023-10-03T10:16:12.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.133+0000 7f0489e35700 1 -- start start 2023-10-03T10:16:12.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.133+0000 7fbd9b5c5700 1 Processor -- start 2023-10-03T10:16:12.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.133+0000 7f0489e35700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f048409a150 0x7f048409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.133+0000 7f0489e35700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f048409edb0 0x7f048409f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.133+0000 7f0489e35700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f048409af80 con 0x7f0484133c20 2023-10-03T10:16:12.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.133+0000 7f0489e35700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048409a520 con 0x7f048409edb0 2023-10-03T10:16:12.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.133+0000 7f0489e35700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f048409fe00 con 0x7f048409a150 2023-10-03T10:16:12.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.133+0000 7f0482ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f048409edb0 0x7f048409f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.133+0000 7f0482ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f048409edb0 0x7f048409f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40428/0 (socket says 172.21.15.146:40428) 2023-10-03T10:16:12.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.133+0000 7f0482ffd700 1 -- 172.21.15.146:0/1888595704 learned_addr learned my addr 172.21.15.146:0/1888595704 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:12.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.133+0000 7f0483fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0484133c20 0x7f04841340c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46070/0 (socket says 172.21.15.146:46070) 2023-10-03T10:16:12.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.133+0000 7f04837fe700 1 --2- 172.21.15.146:0/1888595704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f048409a150 0x7f048409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.134+0000 7f0482ffd700 1 -- 172.21.15.146:0/1888595704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f048409a150 msgr2=0x7f048409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:12.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.134+0000 7f0482ffd700 1 --2- 172.21.15.146:0/1888595704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f048409a150 0x7f048409e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.134+0000 7f0482ffd700 1 -- 172.21.15.146:0/1888595704 >> v1:172.21.15.146:6789/0 conn(0x7f0484133c20 legacy=0x7f04841340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.134+0000 7f0482ffd700 1 -- 172.21.15.146:0/1888595704 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048409f6e0 con 0x7f048409edb0 2023-10-03T10:16:12.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.134+0000 7f0482ffd700 1 --2- 172.21.15.146:0/1888595704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f048409edb0 0x7f048409f1a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0478009950 tx=0x7f0478009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8b35252e6f9b3c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.133+0000 7fbd9b5c5700 1 -- start start 2023-10-03T10:16:12.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.134+0000 7fbd9b5c5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbd9406cc70 0x7fbd940a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.134+0000 7fbd9b5c5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd940a0fb0 0x7fbd940a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.134+0000 7fbd9b5c5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd9409df50 con 0x7fbd9413c200 2023-10-03T10:16:12.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.134+0000 7fbd9b5c5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd940a1920 con 0x7fbd9406cc70 2023-10-03T10:16:12.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.134+0000 7fbd9b5c5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9409cf30 con 0x7fbd940a0fb0 2023-10-03T10:16:12.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.134+0000 7fbd98b60700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd940a0fb0 0x7fbd940a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.134+0000 7fbd99361700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbd9406cc70 0x7fbd940a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.134+0000 7fbd98b60700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd940a0fb0 0x7fbd940a13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39216/0 (socket says 172.21.15.146:39216) 2023-10-03T10:16:12.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.134+0000 7fbd98b60700 1 -- 172.21.15.146:0/7539782 learned_addr learned my addr 172.21.15.146:0/7539782 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:12.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.134+0000 7f04827fc700 1 -- 172.21.15.146:0/1888595704 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478009ea0 con 0x7f048409edb0 2023-10-03T10:16:12.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.134+0000 7f04827fc700 1 -- 172.21.15.146:0/1888595704 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047800ba20 con 0x7f048409edb0 2023-10-03T10:16:12.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.134+0000 7f04827fc700 1 -- 172.21.15.146:0/1888595704 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047800bdb0 con 0x7f048409edb0 2023-10-03T10:16:12.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.134+0000 7fbd98b60700 1 -- 172.21.15.146:0/7539782 >> v2:172.21.15.146:3300/0 conn(0x7fbd9406cc70 msgr2=0x7fbd940a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:12.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.134+0000 7fbd98b60700 1 --2- 172.21.15.146:0/7539782 >> v2:172.21.15.146:3300/0 conn(0x7fbd9406cc70 0x7fbd940a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.134+0000 7fbd98b60700 1 -- 172.21.15.146:0/7539782 >> v1:172.21.15.146:6789/0 conn(0x7fbd9413c200 legacy=0x7fbd9413e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.134+0000 7fbd98b60700 1 -- 172.21.15.146:0/7539782 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd940a24a0 con 0x7fbd940a0fb0 2023-10-03T10:16:12.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.134+0000 7fbd98b60700 1 --2- 172.21.15.146:0/7539782 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd940a0fb0 0x7fbd940a13e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009920 tx=0x7fbd84009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f5d917a127e2f26 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.135+0000 7f7125ba2700 1 -- 172.21.15.146:0/1449457248 wait complete. 2023-10-03T10:16:12.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.135+0000 7fbd8bfff700 1 -- 172.21.15.146:0/7539782 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8400ba20 con 0x7fbd940a0fb0 2023-10-03T10:16:12.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.135+0000 7fbd8bfff700 1 -- 172.21.15.146:0/7539782 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8400bb80 con 0x7fbd940a0fb0 2023-10-03T10:16:12.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.135+0000 7fbd8bfff700 1 -- 172.21.15.146:0/7539782 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd84009e70 con 0x7fbd940a0fb0 2023-10-03T10:16:12.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.135+0000 7f0489e35700 1 -- 172.21.15.146:0/1888595704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f048409edb0 msgr2=0x7f048409f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.135+0000 7f0489e35700 1 --2- 172.21.15.146:0/1888595704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f048409edb0 0x7f048409f1a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0478009950 tx=0x7f0478009c60 comp rx=0 tx=0).stop 2023-10-03T10:16:12.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.135+0000 7f0489e35700 1 -- 172.21.15.146:0/1888595704 shutdown_connections 2023-10-03T10:16:12.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.135+0000 7f0489e35700 1 --2- 172.21.15.146:0/1888595704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f048409a150 0x7f048409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.135+0000 7f0489e35700 1 --2- 172.21.15.146:0/1888595704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f048409edb0 0x7f048409f1a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.135+0000 7f0489e35700 1 -- 172.21.15.146:0/1888595704 >> 172.21.15.146:0/1888595704 conn(0x7f04840a4430 msgr2=0x7f04840a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.135+0000 7f0489e35700 1 -- 172.21.15.146:0/1888595704 shutdown_connections 2023-10-03T10:16:12.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.135+0000 7f0489e35700 1 -- 172.21.15.146:0/1888595704 wait complete. 2023-10-03T10:16:12.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.135+0000 7fbd9b5c5700 1 -- 172.21.15.146:0/7539782 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd940a0fb0 msgr2=0x7fbd940a13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.135+0000 7fbd9b5c5700 1 --2- 172.21.15.146:0/7539782 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd940a0fb0 0x7fbd940a13e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009920 tx=0x7fbd84009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:12.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.135+0000 7fbd9b5c5700 1 -- 172.21.15.146:0/7539782 shutdown_connections 2023-10-03T10:16:12.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.135+0000 7fbd9b5c5700 1 --2- 172.21.15.146:0/7539782 >> v2:172.21.15.146:3300/0 conn(0x7fbd9406cc70 0x7fbd940a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.135+0000 7fbd9b5c5700 1 --2- 172.21.15.146:0/7539782 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd940a0fb0 0x7fbd940a13e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.135+0000 7fbd9b5c5700 1 -- 172.21.15.146:0/7539782 >> 172.21.15.146:0/7539782 conn(0x7fbd940a6610 msgr2=0x7fbd940a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.136+0000 7f7125ba2700 1 Processor -- start 2023-10-03T10:16:12.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.136+0000 7fbd9b5c5700 1 -- 172.21.15.146:0/7539782 shutdown_connections 2023-10-03T10:16:12.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.136+0000 7f7125ba2700 1 -- start start 2023-10-03T10:16:12.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.136+0000 7f0489e35700 1 Processor -- start 2023-10-03T10:16:12.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.136+0000 7f7125ba2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71200a0a70 0x7f7120126100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.136+0000 7f7125ba2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71200a1380 0x7f7120126640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.136+0000 7f7125ba2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7120133f50 0x7f7120126b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.136+0000 7f7125ba2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7120129400 con 0x7f71200a0a70 2023-10-03T10:16:12.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.136+0000 7f7125ba2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71200a5050 con 0x7f7120133f50 2023-10-03T10:16:12.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.136+0000 7f7125ba2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71200a03e0 con 0x7f71200a1380 2023-10-03T10:16:12.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.136+0000 7f0489e35700 1 -- start start 2023-10-03T10:16:12.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.136+0000 7f711f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71200a0a70 0x7f7120126100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.136+0000 7f711ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7120133f50 0x7f7120126b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.136+0000 7f711f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71200a0a70 0x7f7120126100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59750/0 (socket says 172.21.15.146:59750) 2023-10-03T10:16:12.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.136+0000 7f711f7fe700 1 -- 172.21.15.146:0/702040247 learned_addr learned my addr 172.21.15.146:0/702040247 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:12.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.136+0000 7fbd9b5c5700 1 -- 172.21.15.146:0/7539782 wait complete. 2023-10-03T10:16:12.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.137+0000 7f711f7fe700 1 -- 172.21.15.146:0/702040247 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71200a1380 msgr2=0x7f7120126640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.137+0000 7f0489e35700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f048409a150 0x7f04841272e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.137+0000 7f711f7fe700 1 --2- 172.21.15.146:0/702040247 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71200a1380 0x7f7120126640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.137+0000 7f711f7fe700 1 -- 172.21.15.146:0/702040247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7120133f50 msgr2=0x7f7120126b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.137+0000 7f711f7fe700 1 --2- 172.21.15.146:0/702040247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7120133f50 0x7f7120126b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.137+0000 7f711f7fe700 1 -- 172.21.15.146:0/702040247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7114009550 con 0x7f71200a0a70 2023-10-03T10:16:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.137+0000 7f711ffff700 1 --2- 172.21.15.146:0/702040247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7120133f50 0x7f7120126b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.137+0000 7f0489e35700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f048409edb0 0x7f0484127820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.137+0000 7f0489e35700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0484133c20 0x7f0484127d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.137+0000 7f0489e35700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0484129940 con 0x7f048409a150 2023-10-03T10:16:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.137+0000 7f0489e35700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048412a0d0 con 0x7f048409edb0 2023-10-03T10:16:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.137+0000 7f0489e35700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04840a0440 con 0x7f0484133c20 2023-10-03T10:16:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.137+0000 7f04837fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f048409a150 0x7f04841272e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.137+0000 7f04837fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f048409a150 0x7f04841272e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59758/0 (socket says 172.21.15.146:59758) 2023-10-03T10:16:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.137+0000 7f04837fe700 1 -- 172.21.15.146:0/1754627943 learned_addr learned my addr 172.21.15.146:0/1754627943 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.137+0000 7f0482ffd700 1 --2- 172.21.15.146:0/1754627943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f048409edb0 0x7f0484127820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.137+0000 7f04837fe700 1 -- 172.21.15.146:0/1754627943 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0484133c20 msgr2=0x7f0484127d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.137+0000 7f04837fe700 1 --2- 172.21.15.146:0/1754627943 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0484133c20 0x7f0484127d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.137+0000 7f04837fe700 1 -- 172.21.15.146:0/1754627943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f048409edb0 msgr2=0x7f0484127820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.137+0000 7f04837fe700 1 --2- 172.21.15.146:0/1754627943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f048409edb0 0x7f0484127820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.138+0000 7f04837fe700 1 -- 172.21.15.146:0/1754627943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0478009550 con 0x7f048409a150 2023-10-03T10:16:12.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.138+0000 7fbd9b5c5700 1 Processor -- start 2023-10-03T10:16:12.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.138+0000 7f711f7fe700 1 --2- 172.21.15.146:0/702040247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71200a0a70 0x7f7120126100 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f711000e930 tx=0x7f711000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.138+0000 7f04837fe700 1 --2- 172.21.15.146:0/1754627943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f048409a150 0x7f04841272e0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f047400d800 tx=0x7f047400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.138+0000 7fbd9b5c5700 1 -- start start 2023-10-03T10:16:12.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.138+0000 7fbd9b5c5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd9406cc70 0x7fbd94070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.138+0000 7fbd9b5c5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd940a0fb0 0x7fbd94135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.138+0000 7fbd9b5c5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9413c200 0x7fbd94136210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.138+0000 7fbd9b5c5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9411e010 con 0x7fbd9413c200 2023-10-03T10:16:12.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.138+0000 7fbd9b5c5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd940a0020 con 0x7fbd9406cc70 2023-10-03T10:16:12.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.139+0000 7fbd99361700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd9406cc70 0x7fbd94070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.139+0000 7fbd99361700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd9406cc70 0x7fbd94070770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40460/0 (socket says 172.21.15.146:40460) 2023-10-03T10:16:12.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.139+0000 7fbd99361700 1 -- 172.21.15.146:0/2497510197 learned_addr learned my addr 172.21.15.146:0/2497510197 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:12.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.139+0000 7f046bfff700 1 -- 172.21.15.146:0/1754627943 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04740125f0 con 0x7f048409a150 2023-10-03T10:16:12.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.139+0000 7fbd98b60700 1 --2- 172.21.15.146:0/2497510197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd940a0fb0 0x7fbd94135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.139+0000 7fbd99b62700 1 --2- 172.21.15.146:0/2497510197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9413c200 0x7fbd94136210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.139+0000 7f0489e35700 1 -- 172.21.15.146:0/1754627943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04840a38c0 con 0x7f048409a150 2023-10-03T10:16:12.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.139+0000 7f0489e35700 1 -- 172.21.15.146:0/1754627943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f048411e040 con 0x7f048409a150 2023-10-03T10:16:12.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.139+0000 7f7107fff700 1 -- 172.21.15.146:0/702040247 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711000ee80 con 0x7f71200a0a70 2023-10-03T10:16:12.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.139+0000 7fbd9b5c5700 1 -- 172.21.15.146:0/2497510197 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9413bee0 con 0x7fbd940a0fb0 2023-10-03T10:16:12.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.139+0000 7fbd99361700 1 -- 172.21.15.146:0/2497510197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd940a0fb0 msgr2=0x7fbd94135cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.139+0000 7fbd99361700 1 --2- 172.21.15.146:0/2497510197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd940a0fb0 0x7fbd94135cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.139+0000 7fbd99361700 1 -- 172.21.15.146:0/2497510197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9413c200 msgr2=0x7fbd94136210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.139+0000 7fbd99361700 1 --2- 172.21.15.146:0/2497510197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9413c200 0x7fbd94136210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.139+0000 7fbd99361700 1 -- 172.21.15.146:0/2497510197 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd84009550 con 0x7fbd9406cc70 2023-10-03T10:16:12.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.139+0000 7fbd99361700 1 --2- 172.21.15.146:0/2497510197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd9406cc70 0x7fbd94070770 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbd9000e810 tx=0x7fbd9000eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.140+0000 7fbd89ffb700 1 -- 172.21.15.146:0/2497510197 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90013610 con 0x7fbd9406cc70 2023-10-03T10:16:12.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.140+0000 7fbd9b5c5700 1 -- 172.21.15.146:0/2497510197 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd9411ce90 con 0x7fbd9406cc70 2023-10-03T10:16:12.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.140+0000 7fbd89ffb700 1 -- 172.21.15.146:0/2497510197 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd90013770 con 0x7fbd9406cc70 2023-10-03T10:16:12.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.140+0000 7fbd89ffb700 1 -- 172.21.15.146:0/2497510197 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90013b20 con 0x7fbd9406cc70 2023-10-03T10:16:12.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.140+0000 7f046bfff700 1 -- 172.21.15.146:0/1754627943 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0474012750 con 0x7f048409a150 2023-10-03T10:16:12.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.140+0000 7f046bfff700 1 -- 172.21.15.146:0/1754627943 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0474012ac0 con 0x7f048409a150 2023-10-03T10:16:12.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.139+0000 7f7107fff700 1 -- 172.21.15.146:0/702040247 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711000c850 con 0x7f71200a0a70 2023-10-03T10:16:12.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.139+0000 7f7107fff700 1 -- 172.21.15.146:0/702040247 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711000cbe0 con 0x7f71200a0a70 2023-10-03T10:16:12.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.139+0000 7f7125ba2700 1 -- 172.21.15.146:0/702040247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71201299a0 con 0x7f71200a0a70 2023-10-03T10:16:12.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.140+0000 7fbd9b5c5700 1 -- 172.21.15.146:0/2497510197 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd9411e710 con 0x7fbd9406cc70 2023-10-03T10:16:12.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.140+0000 7f7125ba2700 1 -- 172.21.15.146:0/702040247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71201296c0 con 0x7f71200a0a70 2023-10-03T10:16:12.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.141+0000 7f7107fff700 1 -- 172.21.15.146:0/702040247 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f711000cd40 con 0x7f71200a0a70 2023-10-03T10:16:12.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.142+0000 7f7107fff700 1 -- 172.21.15.146:0/702040247 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f711003f7a0 con 0x7f71200a0a70 2023-10-03T10:16:12.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.141+0000 7fbd89ffb700 1 -- 172.21.15.146:0/2497510197 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd90013c80 con 0x7fbd9406cc70 2023-10-03T10:16:12.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.141+0000 7fbd89ffb700 1 -- 172.21.15.146:0/2497510197 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbd9003f510 con 0x7fbd9406cc70 2023-10-03T10:16:12.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.141+0000 7fbd9b5c5700 1 -- 172.21.15.146:0/2497510197 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd94071e20 con 0x7fbd9406cc70 2023-10-03T10:16:12.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.141+0000 7f046bfff700 1 -- 172.21.15.146:0/1754627943 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0474012c20 con 0x7f048409a150 2023-10-03T10:16:12.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.141+0000 7f0489e35700 1 -- 172.21.15.146:0/1754627943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f048409fa30 con 0x7f048409a150 2023-10-03T10:16:12.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.141+0000 7f046bfff700 1 -- 172.21.15.146:0/1754627943 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f047403f970 con 0x7f048409a150 2023-10-03T10:16:12.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.142+0000 7f7125ba2700 1 -- 172.21.15.146:0/702040247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712004f2a0 con 0x7f71200a0a70 2023-10-03T10:16:12.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.147+0000 7fbd89ffb700 1 -- 172.21.15.146:0/2497510197 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd90012370 con 0x7fbd9406cc70 2023-10-03T10:16:12.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.151+0000 7f7107fff700 1 -- 172.21.15.146:0/702040247 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7110017080 con 0x7f71200a0a70 2023-10-03T10:16:12.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.160+0000 7f046bfff700 1 -- 172.21.15.146:0/1754627943 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f047401e460 con 0x7f048409a150 2023-10-03T10:16:12.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.221+0000 7f4fb5173700 1 -- 172.21.15.146:0/2698567471 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4fb011ee80 con 0x7f4fb00a0980 2023-10-03T10:16:12.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.222+0000 7f4f977fe700 1 -- 172.21.15.146:0/2698567471 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4fb011ee80 con 0x7f4fb00a0980 2023-10-03T10:16:12.222 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:12.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.224+0000 7f4fb5173700 1 -- 172.21.15.146:0/2698567471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4fb00a0980 msgr2=0x7f4fb011b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.224+0000 7f4fb5173700 1 --2- 172.21.15.146:0/2698567471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4fb00a0980 0x7f4fb011b9d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000e9c0 tx=0x7f4fa000ecd0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.224+0000 7f4fb5173700 1 -- 172.21.15.146:0/2698567471 shutdown_connections 2023-10-03T10:16:12.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.224+0000 7f4fb5173700 1 --2- 172.21.15.146:0/2698567471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fb0133b10 0x7f4fb011c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.224+0000 7f4fb5173700 1 --2- 172.21.15.146:0/2698567471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4fb00a0980 0x7f4fb011b9d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.224+0000 7f4fb5173700 1 --2- 172.21.15.146:0/2698567471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fb00a1310 0x7f4fb011bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.224+0000 7f4fb5173700 1 -- 172.21.15.146:0/2698567471 >> 172.21.15.146:0/2698567471 conn(0x7f4fb00a2980 msgr2=0x7f4fb01307e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.224+0000 7f4fb5173700 1 -- 172.21.15.146:0/2698567471 shutdown_connections 2023-10-03T10:16:12.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.224+0000 7f4fb5173700 1 -- 172.21.15.146:0/2698567471 wait complete. 2023-10-03T10:16:12.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:12.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.340+0000 7fbd9b5c5700 1 -- 172.21.15.146:0/2497510197 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbd9404f2a0 con 0x7fbd9406cc70 2023-10-03T10:16:12.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.341+0000 7fbd89ffb700 1 -- 172.21.15.146:0/2497510197 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd9002b090 con 0x7fbd9406cc70 2023-10-03T10:16:12.341 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:12.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.343+0000 7fbd9b5c5700 1 -- 172.21.15.146:0/2497510197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd9406cc70 msgr2=0x7fbd94070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.343+0000 7fbd9b5c5700 1 --2- 172.21.15.146:0/2497510197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd9406cc70 0x7fbd94070770 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbd9000e810 tx=0x7fbd9000eb20 comp rx=0 tx=0).stop 2023-10-03T10:16:12.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.343+0000 7fbd9b5c5700 1 -- 172.21.15.146:0/2497510197 shutdown_connections 2023-10-03T10:16:12.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.343+0000 7fbd9b5c5700 1 --2- 172.21.15.146:0/2497510197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9413c200 0x7fbd94136210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.343+0000 7fbd9b5c5700 1 --2- 172.21.15.146:0/2497510197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd9406cc70 0x7fbd94070770 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.343+0000 7fbd9b5c5700 1 --2- 172.21.15.146:0/2497510197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd940a0fb0 0x7fbd94135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.343+0000 7fbd9b5c5700 1 -- 172.21.15.146:0/2497510197 >> 172.21.15.146:0/2497510197 conn(0x7fbd940a6610 msgr2=0x7fbd940a2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.343+0000 7fbd9b5c5700 1 -- 172.21.15.146:0/2497510197 shutdown_connections 2023-10-03T10:16:12.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.343+0000 7fbd9b5c5700 1 -- 172.21.15.146:0/2497510197 wait complete. 2023-10-03T10:16:12.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.348+0000 7f7125ba2700 1 -- 172.21.15.146:0/702040247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7120072980 con 0x7f71200a0a70 2023-10-03T10:16:12.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.348+0000 7f7107fff700 1 -- 172.21.15.146:0/702040247 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f711001bdf0 con 0x7f71200a0a70 2023-10-03T10:16:12.349 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:12.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.350+0000 7f7125ba2700 1 -- 172.21.15.146:0/702040247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71200a0a70 msgr2=0x7f7120126100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.350+0000 7f7125ba2700 1 --2- 172.21.15.146:0/702040247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71200a0a70 0x7f7120126100 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f711000e930 tx=0x7f711000ec40 comp rx=0 tx=0).stop 2023-10-03T10:16:12.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.351+0000 7f7125ba2700 1 -- 172.21.15.146:0/702040247 shutdown_connections 2023-10-03T10:16:12.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.351+0000 7f7125ba2700 1 --2- 172.21.15.146:0/702040247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7120133f50 0x7f7120126b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.351+0000 7f7125ba2700 1 --2- 172.21.15.146:0/702040247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71200a0a70 0x7f7120126100 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.351+0000 7f7125ba2700 1 --2- 172.21.15.146:0/702040247 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f71200a1380 0x7f7120126640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.351+0000 7f7125ba2700 1 -- 172.21.15.146:0/702040247 >> 172.21.15.146:0/702040247 conn(0x7f71200a6610 msgr2=0x7f712009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.351+0000 7f7125ba2700 1 -- 172.21.15.146:0/702040247 shutdown_connections 2023-10-03T10:16:12.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.351+0000 7f7125ba2700 1 -- 172.21.15.146:0/702040247 wait complete. 2023-10-03T10:16:12.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.354+0000 7f0489e35700 1 -- 172.21.15.146:0/1754627943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f048404f2a0 con 0x7f048409a150 2023-10-03T10:16:12.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.355+0000 7f046bfff700 1 -- 172.21.15.146:0/1754627943 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0474011340 con 0x7f048409a150 2023-10-03T10:16:12.355 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:12.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:12.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.357+0000 7f0489e35700 1 -- 172.21.15.146:0/1754627943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f048409a150 msgr2=0x7f04841272e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.357+0000 7f0489e35700 1 --2- 172.21.15.146:0/1754627943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f048409a150 0x7f04841272e0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f047400d800 tx=0x7f047400db10 comp rx=0 tx=0).stop 2023-10-03T10:16:12.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.357+0000 7f0489e35700 1 -- 172.21.15.146:0/1754627943 shutdown_connections 2023-10-03T10:16:12.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.357+0000 7f0489e35700 1 --2- 172.21.15.146:0/1754627943 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0484133c20 0x7f0484127d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.357+0000 7f0489e35700 1 --2- 172.21.15.146:0/1754627943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f048409a150 0x7f04841272e0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.357+0000 7f0489e35700 1 --2- 172.21.15.146:0/1754627943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f048409edb0 0x7f0484127820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.357+0000 7f0489e35700 1 -- 172.21.15.146:0/1754627943 >> 172.21.15.146:0/1754627943 conn(0x7f04840a4430 msgr2=0x7f048409ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.357+0000 7f0489e35700 1 -- 172.21.15.146:0/1754627943 shutdown_connections 2023-10-03T10:16:12.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:12.357+0000 7f0489e35700 1 -- 172.21.15.146:0/1754627943 wait complete. 2023-10-03T10:16:12.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:12.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:13.239 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:13.358 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:13.366 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:13.371 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:13.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.372+0000 7fb3981d5700 1 Processor -- start 2023-10-03T10:16:13.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.372+0000 7fb3981d5700 1 -- start start 2023-10-03T10:16:13.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.373+0000 7fb3981d5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb39006a770 0x7fb39006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.373+0000 7fb3981d5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb39009dec0 0x7fb39006b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.373+0000 7fb3981d5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb39006b5c0 con 0x7fb390131a00 2023-10-03T10:16:13.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.373+0000 7fb3981d5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39006e900 con 0x7fb39009dec0 2023-10-03T10:16:13.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.373+0000 7fb3981d5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb39009d180 con 0x7fb39006a770 2023-10-03T10:16:13.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.373+0000 7fb395f71700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb39006a770 0x7fb39006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.373+0000 7fb396772700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb390131a00 0x7fb390131e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46086/0 (socket says 172.21.15.146:46086) 2023-10-03T10:16:13.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.373+0000 7fb396772700 1 -- 172.21.15.146:0/1150082991 learned_addr learned my addr 172.21.15.146:0/1150082991 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:13.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.373+0000 7fb395770700 1 --2- 172.21.15.146:0/1150082991 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb39009dec0 0x7fb39006b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.373+0000 7fb395f71700 1 -- 172.21.15.146:0/1150082991 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb39009dec0 msgr2=0x7fb39006b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:13.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.373+0000 7fb395f71700 1 --2- 172.21.15.146:0/1150082991 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb39009dec0 0x7fb39006b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.373+0000 7fb394f6f700 1 -- 172.21.15.146:0/1150082991 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302723397 0 0) 0x7fb39006b5c0 con 0x7fb390131a00 2023-10-03T10:16:13.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.373+0000 7fb395f71700 1 -- 172.21.15.146:0/1150082991 >> v1:172.21.15.146:6789/0 conn(0x7fb390131a00 legacy=0x7fb390131e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.373+0000 7fb395f71700 1 -- 172.21.15.146:0/1150082991 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39009e780 con 0x7fb39006a770 2023-10-03T10:16:13.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.374+0000 7fb395f71700 1 --2- 172.21.15.146:0/1150082991 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb39006a770 0x7fb39006ab40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb38c009870 tx=0x7fb38c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad01d419f21462d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.374+0000 7fb394f6f700 1 -- 172.21.15.146:0/1150082991 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c011830 con 0x7fb39006a770 2023-10-03T10:16:13.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.374+0000 7fb394f6f700 1 -- 172.21.15.146:0/1150082991 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38c011990 con 0x7fb39006a770 2023-10-03T10:16:13.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.374+0000 7fb394f6f700 1 -- 172.21.15.146:0/1150082991 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c011d20 con 0x7fb39006a770 2023-10-03T10:16:13.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.375+0000 7fb3981d5700 1 -- 172.21.15.146:0/1150082991 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb39006a770 msgr2=0x7fb39006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.375+0000 7fb3981d5700 1 --2- 172.21.15.146:0/1150082991 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb39006a770 0x7fb39006ab40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb38c009870 tx=0x7fb38c009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:13.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.375+0000 7fb3981d5700 1 -- 172.21.15.146:0/1150082991 shutdown_connections 2023-10-03T10:16:13.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.375+0000 7fb3981d5700 1 --2- 172.21.15.146:0/1150082991 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb39006a770 0x7fb39006ab40 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.375+0000 7fb3981d5700 1 --2- 172.21.15.146:0/1150082991 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb39009dec0 0x7fb39006b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.375+0000 7fb3981d5700 1 -- 172.21.15.146:0/1150082991 >> 172.21.15.146:0/1150082991 conn(0x7fb390099c40 msgr2=0x7fb3900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.375+0000 7fb3981d5700 1 -- 172.21.15.146:0/1150082991 shutdown_connections 2023-10-03T10:16:13.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.375+0000 7fb3981d5700 1 -- 172.21.15.146:0/1150082991 wait complete. 2023-10-03T10:16:13.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.376+0000 7fb3981d5700 1 Processor -- start 2023-10-03T10:16:13.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.376+0000 7fb3981d5700 1 -- start start 2023-10-03T10:16:13.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.376+0000 7fb3981d5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb39006a770 0x7fb39009a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.376+0000 7fb3981d5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb39009dec0 0x7fb39009a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.376+0000 7fb3981d5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb390131a00 0x7fb39009af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.376+0000 7fb3981d5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39011f910 con 0x7fb39006a770 2023-10-03T10:16:13.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.376+0000 7fb3981d5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39011eba0 con 0x7fb390131a00 2023-10-03T10:16:13.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.376+0000 7fb3981d5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb39012d490 con 0x7fb39009dec0 2023-10-03T10:16:13.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.377+0000 7fb395f71700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb39006a770 0x7fb39009a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.377+0000 7fb395f71700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb39006a770 0x7fb39009a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59764/0 (socket says 172.21.15.146:59764) 2023-10-03T10:16:13.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.377+0000 7fb395f71700 1 -- 172.21.15.146:0/1500589717 learned_addr learned my addr 172.21.15.146:0/1500589717 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:13.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.377+0000 7fb395f71700 1 -- 172.21.15.146:0/1500589717 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb39009dec0 msgr2=0x7fb39009a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.377+0000 7fb395f71700 1 --2- 172.21.15.146:0/1500589717 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb39009dec0 0x7fb39009a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.377+0000 7fb396772700 1 --2- 172.21.15.146:0/1500589717 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb390131a00 0x7fb39009af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.377+0000 7fb395f71700 1 -- 172.21.15.146:0/1500589717 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb390131a00 msgr2=0x7fb39009af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.377+0000 7fb395f71700 1 --2- 172.21.15.146:0/1500589717 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb390131a00 0x7fb39009af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.377+0000 7fb395f71700 1 -- 172.21.15.146:0/1500589717 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38c0094a0 con 0x7fb39006a770 2023-10-03T10:16:13.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.377+0000 7fb396772700 1 --2- 172.21.15.146:0/1500589717 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb390131a00 0x7fb39009af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:13.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.377+0000 7fb395f71700 1 --2- 172.21.15.146:0/1500589717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb39006a770 0x7fb39009a490 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fb39009d2c0 tx=0x7fb38c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.377+0000 7fb3867fc700 1 -- 172.21.15.146:0/1500589717 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c0036a0 con 0x7fb39006a770 2023-10-03T10:16:13.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.377+0000 7fb3867fc700 1 -- 172.21.15.146:0/1500589717 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38c01f070 con 0x7fb39006a770 2023-10-03T10:16:13.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.378+0000 7fb3981d5700 1 -- 172.21.15.146:0/1500589717 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39011e8b0 con 0x7fb39006a770 2023-10-03T10:16:13.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.378+0000 7fb3867fc700 1 -- 172.21.15.146:0/1500589717 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38c003a20 con 0x7fb39006a770 2023-10-03T10:16:13.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.378+0000 7fb3981d5700 1 -- 172.21.15.146:0/1500589717 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb39011ef20 con 0x7fb39006a770 2023-10-03T10:16:13.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.379+0000 7fb3867fc700 1 -- 172.21.15.146:0/1500589717 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb38c003b80 con 0x7fb39006a770 2023-10-03T10:16:13.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.379+0000 7fb3981d5700 1 -- 172.21.15.146:0/1500589717 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb39004f2a0 con 0x7fb39006a770 2023-10-03T10:16:13.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.379+0000 7fb3867fc700 1 -- 172.21.15.146:0/1500589717 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb38c021070 con 0x7fb39006a770 2023-10-03T10:16:13.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.384+0000 7fb3867fc700 1 -- 172.21.15.146:0/1500589717 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb38c024380 con 0x7fb39006a770 2023-10-03T10:16:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.489+0000 7ff1b8569700 1 Processor -- start 2023-10-03T10:16:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.489+0000 7ff1b8569700 1 -- start start 2023-10-03T10:16:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.490+0000 7ff1b8569700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1b009e870 0x7ff1b009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.490+0000 7ff1b8569700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1b0134330 0x7ff1b013be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.490+0000 7ff1b8569700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b009fa00 con 0x7ff1b009f180 2023-10-03T10:16:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.490+0000 7ff1b8569700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b00a0370 con 0x7ff1b0134330 2023-10-03T10:16:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.490+0000 7ff1b8569700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b006bec0 con 0x7ff1b009e870 2023-10-03T10:16:13.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.490+0000 7ff1b6305700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1b009e870 0x7ff1b009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.490+0000 7ff1b5b04700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff1b009f180 0x7ff1b0133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46096/0 (socket says 172.21.15.146:46096) 2023-10-03T10:16:13.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.490+0000 7ff1b5b04700 1 -- 172.21.15.146:0/870022844 learned_addr learned my addr 172.21.15.146:0/870022844 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:13.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.490+0000 7ff1b6b06700 1 --2- 172.21.15.146:0/870022844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1b0134330 0x7ff1b013be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.490+0000 7ff1b6305700 1 -- 172.21.15.146:0/870022844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1b0134330 msgr2=0x7ff1b013be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:13.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.490+0000 7ff1b6305700 1 --2- 172.21.15.146:0/870022844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1b0134330 0x7ff1b013be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.490+0000 7ff1b6305700 1 -- 172.21.15.146:0/870022844 >> v1:172.21.15.146:6789/0 conn(0x7ff1b009f180 legacy=0x7ff1b0133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.490+0000 7ff1b6305700 1 -- 172.21.15.146:0/870022844 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b009ada0 con 0x7ff1b009e870 2023-10-03T10:16:13.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.490+0000 7ff1b5303700 1 -- 172.21.15.146:0/870022844 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1452118013 0 0) 0x7ff1b009fa00 con 0x7ff1b009f180 2023-10-03T10:16:13.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.490+0000 7ff1b6b06700 1 --2- 172.21.15.146:0/870022844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1b0134330 0x7ff1b013be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:13.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.490+0000 7ff1b6305700 1 --2- 172.21.15.146:0/870022844 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1b009e870 0x7ff1b009ec40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac009870 tx=0x7ff1ac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db53610210c1820a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.491+0000 7ff1b5303700 1 -- 172.21.15.146:0/870022844 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac011830 con 0x7ff1b009e870 2023-10-03T10:16:13.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.491+0000 7ff1b5303700 1 -- 172.21.15.146:0/870022844 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ac011990 con 0x7ff1b009e870 2023-10-03T10:16:13.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.491+0000 7ff1b5303700 1 -- 172.21.15.146:0/870022844 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac011d20 con 0x7ff1b009e870 2023-10-03T10:16:13.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.491+0000 7ff1b8569700 1 -- 172.21.15.146:0/870022844 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1b009e870 msgr2=0x7ff1b009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.491+0000 7ff1b8569700 1 --2- 172.21.15.146:0/870022844 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1b009e870 0x7ff1b009ec40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac009870 tx=0x7ff1ac009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:13.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.491+0000 7ff1b8569700 1 -- 172.21.15.146:0/870022844 shutdown_connections 2023-10-03T10:16:13.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.491+0000 7ff1b8569700 1 --2- 172.21.15.146:0/870022844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1b0134330 0x7ff1b013be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.491+0000 7ff1b8569700 1 --2- 172.21.15.146:0/870022844 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1b009e870 0x7ff1b009ec40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.491+0000 7ff1b8569700 1 -- 172.21.15.146:0/870022844 >> 172.21.15.146:0/870022844 conn(0x7ff1b00a4430 msgr2=0x7ff1b00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.491+0000 7ff1b8569700 1 -- 172.21.15.146:0/870022844 shutdown_connections 2023-10-03T10:16:13.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.491+0000 7ff1b8569700 1 -- 172.21.15.146:0/870022844 wait complete. 2023-10-03T10:16:13.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.493+0000 7ff1b8569700 1 Processor -- start 2023-10-03T10:16:13.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.493+0000 7ff1b8569700 1 -- start start 2023-10-03T10:16:13.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.493+0000 7ff1b8569700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1b009e870 0x7ff1b0122720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.493+0000 7ff1b8569700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1b009f180 0x7ff1b0122c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.493+0000 7ff1b8569700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1b0134330 0x7ff1b01231a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.493+0000 7ff1b8569700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b006cfa0 con 0x7ff1b009f180 2023-10-03T10:16:13.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.493+0000 7ff1b8569700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b00a16a0 con 0x7ff1b009e870 2023-10-03T10:16:13.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.493+0000 7ff1b8569700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b0125150 con 0x7ff1b0134330 2023-10-03T10:16:13.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.493+0000 7ff1b6305700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1b009e870 0x7ff1b0122720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.493+0000 7ff1b6305700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1b009e870 0x7ff1b0122720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:40496/0 (socket says 172.21.15.146:40496) 2023-10-03T10:16:13.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.493+0000 7ff1b6305700 1 -- 172.21.15.146:0/1292900712 learned_addr learned my addr 172.21.15.146:0/1292900712 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:13.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.494+0000 7ff1b5b04700 1 --2- 172.21.15.146:0/1292900712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1b009f180 0x7ff1b0122c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.494+0000 7ff1b6b06700 1 --2- 172.21.15.146:0/1292900712 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1b0134330 0x7ff1b01231a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.494+0000 7ff1b6305700 1 -- 172.21.15.146:0/1292900712 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1b0134330 msgr2=0x7ff1b01231a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.494+0000 7ff1b6305700 1 --2- 172.21.15.146:0/1292900712 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1b0134330 0x7ff1b01231a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.494+0000 7ff1b6305700 1 -- 172.21.15.146:0/1292900712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1b009f180 msgr2=0x7ff1b0122c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.494+0000 7ff1b6305700 1 --2- 172.21.15.146:0/1292900712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1b009f180 0x7ff1b0122c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.494+0000 7ff1b6305700 1 -- 172.21.15.146:0/1292900712 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac0094a0 con 0x7ff1b009e870 2023-10-03T10:16:13.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.494+0000 7ff1b6305700 1 --2- 172.21.15.146:0/1292900712 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1b009e870 0x7ff1b0122720 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac000c00 tx=0x7ff1ac004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.494+0000 7ff1a6ffd700 1 -- 172.21.15.146:0/1292900712 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac0044d0 con 0x7ff1b009e870 2023-10-03T10:16:13.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.494+0000 7ff1a6ffd700 1 -- 172.21.15.146:0/1292900712 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ac01f070 con 0x7ff1b009e870 2023-10-03T10:16:13.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.494+0000 7ff1a6ffd700 1 -- 172.21.15.146:0/1292900712 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac0038e0 con 0x7ff1b009e870 2023-10-03T10:16:13.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.494+0000 7ff1b8569700 1 -- 172.21.15.146:0/1292900712 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b01259d0 con 0x7ff1b009e870 2023-10-03T10:16:13.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.494+0000 7ff1b8569700 1 -- 172.21.15.146:0/1292900712 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b01269d0 con 0x7ff1b009e870 2023-10-03T10:16:13.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.496+0000 7ff1a6ffd700 1 -- 172.21.15.146:0/1292900712 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff1ac003a40 con 0x7ff1b009e870 2023-10-03T10:16:13.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.496+0000 7ff1b8569700 1 -- 172.21.15.146:0/1292900712 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b004f2a0 con 0x7ff1b009e870 2023-10-03T10:16:13.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.496+0000 7ff1a6ffd700 1 -- 172.21.15.146:0/1292900712 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff1ac021070 con 0x7ff1b009e870 2023-10-03T10:16:13.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.501+0000 7ff1a6ffd700 1 -- 172.21.15.146:0/1292900712 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1ac01a7b0 con 0x7ff1b009e870 2023-10-03T10:16:13.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.506+0000 7fe260d2d700 1 Processor -- start 2023-10-03T10:16:13.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.506+0000 7fe260d2d700 1 -- start start 2023-10-03T10:16:13.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.507+0000 7fe260d2d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe25c06a770 0x7fe25c1349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.507+0000 7fe260d2d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe25c134f00 0x7fe25c09d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.507+0000 7fe260d2d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe25c09dea0 0x7fe25c09e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.507+0000 7fe260d2d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe25c06b2e0 con 0x7fe25c09dea0 2023-10-03T10:16:13.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.507+0000 7fe260d2d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c09eca0 con 0x7fe25c06a770 2023-10-03T10:16:13.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.507+0000 7fe260d2d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c09f720 con 0x7fe25c134f00 2023-10-03T10:16:13.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.507+0000 7fe25ad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe25c09dea0 0x7fe25c09e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.507+0000 7fe259d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe25c134f00 0x7fe25c09d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.507+0000 7fe25ad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe25c09dea0 0x7fe25c09e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59794/0 (socket says 172.21.15.146:59794) 2023-10-03T10:16:13.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.507+0000 7fe259d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe25c134f00 0x7fe25c09d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39288/0 (socket says 172.21.15.146:39288) 2023-10-03T10:16:13.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.507+0000 7fe25ad9d700 1 -- 172.21.15.146:0/3832052420 learned_addr learned my addr 172.21.15.146:0/3832052420 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.507+0000 7fe259d9b700 1 -- 172.21.15.146:0/3832052420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe25c06a770 msgr2=0x7fe25c1349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.507+0000 7fe259d9b700 1 --2- 172.21.15.146:0/3832052420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe25c06a770 0x7fe25c1349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.507+0000 7fe259d9b700 1 -- 172.21.15.146:0/3832052420 >> v2:172.21.15.146:3300/0 conn(0x7fe25c09dea0 msgr2=0x7fe25c09e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.507+0000 7fe259d9b700 1 --2- 172.21.15.146:0/3832052420 >> v2:172.21.15.146:3300/0 conn(0x7fe25c09dea0 0x7fe25c09e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.507+0000 7fe259d9b700 1 -- 172.21.15.146:0/3832052420 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c06b480 con 0x7fe25c134f00 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.508+0000 7fe259d9b700 1 --2- 172.21.15.146:0/3832052420 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe25c134f00 0x7fe25c09d960 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe250009840 tx=0x7fe250009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30f083a138e22509 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.508+0000 7fe25959a700 1 -- 172.21.15.146:0/3832052420 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe250011830 con 0x7fe25c134f00 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.508+0000 7fe25959a700 1 -- 172.21.15.146:0/3832052420 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe250011990 con 0x7fe25c134f00 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.508+0000 7fe25959a700 1 -- 172.21.15.146:0/3832052420 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe250011d20 con 0x7fe25c134f00 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.508+0000 7fe260d2d700 1 -- 172.21.15.146:0/3832052420 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe25c134f00 msgr2=0x7fe25c09d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.508+0000 7fe260d2d700 1 --2- 172.21.15.146:0/3832052420 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe25c134f00 0x7fe25c09d960 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe250009840 tx=0x7fe250009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.509+0000 7fe260d2d700 1 -- 172.21.15.146:0/3832052420 shutdown_connections 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.509+0000 7fe260d2d700 1 --2- 172.21.15.146:0/3832052420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe25c06a770 0x7fe25c1349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.509+0000 7fe260d2d700 1 --2- 172.21.15.146:0/3832052420 >> v2:172.21.15.146:3300/0 conn(0x7fe25c09dea0 0x7fe25c09e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.509+0000 7fe260d2d700 1 --2- 172.21.15.146:0/3832052420 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe25c134f00 0x7fe25c09d960 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.509+0000 7fe260d2d700 1 -- 172.21.15.146:0/3832052420 >> 172.21.15.146:0/3832052420 conn(0x7fe25c099c40 msgr2=0x7fe25c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.509+0000 7fe260d2d700 1 -- 172.21.15.146:0/3832052420 shutdown_connections 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.509+0000 7fe260d2d700 1 -- 172.21.15.146:0/3832052420 wait complete. 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.510+0000 7fe260d2d700 1 Processor -- start 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.510+0000 7fe260d2d700 1 -- start start 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.510+0000 7fe260d2d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe25c06a770 0x7fe25c132d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.510+0000 7fe260d2d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe25c09dea0 0x7fe25c133240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.510+0000 7fe260d2d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe25c134f00 0x7fe25c133780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.510+0000 7fe260d2d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c071b20 con 0x7fe25c134f00 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.510+0000 7fe260d2d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c0a01b0 con 0x7fe25c06a770 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.510+0000 7fe260d2d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c09f220 con 0x7fe25c09dea0 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.510+0000 7fe259d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe25c09dea0 0x7fe25c133240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.510+0000 7fe259d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe25c09dea0 0x7fe25c133240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39294/0 (socket says 172.21.15.146:39294) 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.510+0000 7fe25ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe25c134f00 0x7fe25c133780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.510+0000 7fe259d9b700 1 -- 172.21.15.146:0/939554622 learned_addr learned my addr 172.21.15.146:0/939554622 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:13.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.511+0000 7fe25a59c700 1 --2- 172.21.15.146:0/939554622 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe25c06a770 0x7fe25c132d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.511+0000 7fe259d9b700 1 -- 172.21.15.146:0/939554622 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe25c06a770 msgr2=0x7fe25c132d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.511+0000 7fe259d9b700 1 --2- 172.21.15.146:0/939554622 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe25c06a770 0x7fe25c132d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.511+0000 7fe259d9b700 1 -- 172.21.15.146:0/939554622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe25c134f00 msgr2=0x7fe25c133780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.511+0000 7fe259d9b700 1 --2- 172.21.15.146:0/939554622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe25c134f00 0x7fe25c133780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.511+0000 7fe259d9b700 1 -- 172.21.15.146:0/939554622 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2500094a0 con 0x7fe25c09dea0 2023-10-03T10:16:13.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.511+0000 7fe25a59c700 1 --2- 172.21.15.146:0/939554622 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe25c06a770 0x7fe25c132d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:13.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.511+0000 7fe259d9b700 1 --2- 172.21.15.146:0/939554622 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe25c09dea0 0x7fe25c133240 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe2500090b0 tx=0x7fe250004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.511+0000 7fe24affd700 1 -- 172.21.15.146:0/939554622 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe250004590 con 0x7fe25c09dea0 2023-10-03T10:16:13.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.511+0000 7fe24affd700 1 -- 172.21.15.146:0/939554622 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2500036a0 con 0x7fe25c09dea0 2023-10-03T10:16:13.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.511+0000 7fe260d2d700 1 -- 172.21.15.146:0/939554622 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25c072200 con 0x7fe25c09dea0 2023-10-03T10:16:13.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.511+0000 7fe24affd700 1 -- 172.21.15.146:0/939554622 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe250003a30 con 0x7fe25c09dea0 2023-10-03T10:16:13.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.511+0000 7fe260d2d700 1 -- 172.21.15.146:0/939554622 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25c1340d0 con 0x7fe25c09dea0 2023-10-03T10:16:13.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.512+0000 7fe260d2d700 1 -- 172.21.15.146:0/939554622 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25c09a360 con 0x7fe25c09dea0 2023-10-03T10:16:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.513+0000 7fb405343700 1 Processor -- start 2023-10-03T10:16:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.513+0000 7fb405343700 1 -- start start 2023-10-03T10:16:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.513+0000 7fb405343700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb40009e870 0x7fb40009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.513+0000 7fb405343700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb40009f180 0x7fb400131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.513+0000 7fb405343700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb40009c970 con 0x7fb400131d70 2023-10-03T10:16:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.513+0000 7fb405343700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4000a0920 con 0x7fb40009e870 2023-10-03T10:16:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.513+0000 7fb405343700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb40009f9c0 con 0x7fb40009f180 2023-10-03T10:16:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.513+0000 7fb3feffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb40009e870 0x7fb40009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.513+0000 7fb3feffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb40009e870 0x7fb40009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59806/0 (socket says 172.21.15.146:59806) 2023-10-03T10:16:13.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.513+0000 7fb3feffd700 1 -- 172.21.15.146:0/2324373751 learned_addr learned my addr 172.21.15.146:0/2324373751 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:13.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.513+0000 7fe24affd700 1 -- 172.21.15.146:0/939554622 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe250003b90 con 0x7fe25c09dea0 2023-10-03T10:16:13.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.513+0000 7fe24affd700 1 -- 172.21.15.146:0/939554622 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe250040da0 con 0x7fe25c09dea0 2023-10-03T10:16:13.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.514+0000 7fb3feffd700 1 -- 172.21.15.146:0/2324373751 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb40009f180 msgr2=0x7fb400131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:13.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.514+0000 7fb3feffd700 1 --2- 172.21.15.146:0/2324373751 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb40009f180 0x7fb400131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.514+0000 7fb3feffd700 1 -- 172.21.15.146:0/2324373751 >> v1:172.21.15.146:6789/0 conn(0x7fb400131d70 legacy=0x7fb400138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:13.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.514+0000 7fb3feffd700 1 -- 172.21.15.146:0/2324373751 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40009bab0 con 0x7fb40009e870 2023-10-03T10:16:13.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.514+0000 7fb3feffd700 1 --2- 172.21.15.146:0/2324373751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb40009e870 0x7fb40009ec40 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fb3f00098f0 tx=0x7fb3f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b49705d97bb033a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.514+0000 7fb3fdffb700 1 -- 172.21.15.146:0/2324373751 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f000b8a0 con 0x7fb40009e870 2023-10-03T10:16:13.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.514+0000 7fb3fdffb700 1 -- 172.21.15.146:0/2324373751 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f000ba00 con 0x7fb40009e870 2023-10-03T10:16:13.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.514+0000 7fb3fdffb700 1 -- 172.21.15.146:0/2324373751 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f000bd90 con 0x7fb40009e870 2023-10-03T10:16:13.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.515+0000 7fb405343700 1 -- 172.21.15.146:0/2324373751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb40009e870 msgr2=0x7fb40009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.515+0000 7fb405343700 1 --2- 172.21.15.146:0/2324373751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb40009e870 0x7fb40009ec40 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fb3f00098f0 tx=0x7fb3f0009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:13.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.515+0000 7fb405343700 1 -- 172.21.15.146:0/2324373751 shutdown_connections 2023-10-03T10:16:13.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.515+0000 7fb405343700 1 --2- 172.21.15.146:0/2324373751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb40009e870 0x7fb40009ec40 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.515+0000 7fb405343700 1 --2- 172.21.15.146:0/2324373751 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb40009f180 0x7fb400131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.515+0000 7fb405343700 1 -- 172.21.15.146:0/2324373751 >> 172.21.15.146:0/2324373751 conn(0x7fb4000a4430 msgr2=0x7fb4000a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.515+0000 7fb405343700 1 -- 172.21.15.146:0/2324373751 shutdown_connections 2023-10-03T10:16:13.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.515+0000 7fb405343700 1 -- 172.21.15.146:0/2324373751 wait complete. 2023-10-03T10:16:13.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.516+0000 7fb405343700 1 Processor -- start 2023-10-03T10:16:13.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.516+0000 7fb405343700 1 -- start start 2023-10-03T10:16:13.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.516+0000 7fb405343700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb40009e870 0x7fb40011e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.516+0000 7fb405343700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb40009f180 0x7fb40011e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.516+0000 7fb405343700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb400131d70 0x7fb40011eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.516+0000 7fb405343700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb400121bb0 con 0x7fb400131d70 2023-10-03T10:16:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.516+0000 7fb405343700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb400120280 con 0x7fb40009f180 2023-10-03T10:16:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.516+0000 7fb405343700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb400121340 con 0x7fb40009e870 2023-10-03T10:16:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.517+0000 7fb3feffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb40009e870 0x7fb40011e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.517+0000 7fb3feffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb40009e870 0x7fb40011e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:39312/0 (socket says 172.21.15.146:39312) 2023-10-03T10:16:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.517+0000 7fb3feffd700 1 -- 172.21.15.146:0/1534107329 learned_addr learned my addr 172.21.15.146:0/1534107329 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.517+0000 7fb3ff7fe700 1 --2- 172.21.15.146:0/1534107329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb400131d70 0x7fb40011eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.517+0000 7fb3feffd700 1 -- 172.21.15.146:0/1534107329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb40009f180 msgr2=0x7fb40011e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.517+0000 7fb3fe7fc700 1 --2- 172.21.15.146:0/1534107329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb40009f180 0x7fb40011e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.517+0000 7fb3feffd700 1 --2- 172.21.15.146:0/1534107329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb40009f180 0x7fb40011e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.517+0000 7fb3feffd700 1 -- 172.21.15.146:0/1534107329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb400131d70 msgr2=0x7fb40011eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.517+0000 7fb3feffd700 1 --2- 172.21.15.146:0/1534107329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb400131d70 0x7fb40011eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.517+0000 7fb3feffd700 1 -- 172.21.15.146:0/1534107329 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f0009550 con 0x7fb40009e870 2023-10-03T10:16:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.517+0000 7fb3fe7fc700 1 --2- 172.21.15.146:0/1534107329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb40009f180 0x7fb40011e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:13.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.517+0000 7fb3ff7fe700 1 --2- 172.21.15.146:0/1534107329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb400131d70 0x7fb40011eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:13.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.517+0000 7fb3feffd700 1 --2- 172.21.15.146:0/1534107329 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb40009e870 0x7fb40011e090 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb40009c8a0 tx=0x7fb3f0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.518+0000 7fb3e77fe700 1 -- 172.21.15.146:0/1534107329 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f00038a0 con 0x7fb40009e870 2023-10-03T10:16:13.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.518+0000 7fb405343700 1 -- 172.21.15.146:0/1534107329 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb40009dba0 con 0x7fb40009e870 2023-10-03T10:16:13.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.518+0000 7fe24affd700 1 -- 172.21.15.146:0/939554622 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe250003e40 con 0x7fe25c09dea0 2023-10-03T10:16:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.518+0000 7fb405343700 1 -- 172.21.15.146:0/1534107329 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40011fca0 con 0x7fb40009e870 2023-10-03T10:16:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.518+0000 7fb3e77fe700 1 -- 172.21.15.146:0/1534107329 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f001e070 con 0x7fb40009e870 2023-10-03T10:16:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.518+0000 7fb3e77fe700 1 -- 172.21.15.146:0/1534107329 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0003c00 con 0x7fb40009e870 2023-10-03T10:16:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.519+0000 7fb3e77fe700 1 -- 172.21.15.146:0/1534107329 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3f0011420 con 0x7fb40009e870 2023-10-03T10:16:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.519+0000 7fb3e77fe700 1 -- 172.21.15.146:0/1534107329 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb3f0020070 con 0x7fb40009e870 2023-10-03T10:16:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.521+0000 7fb405343700 1 -- 172.21.15.146:0/1534107329 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e00052e0 con 0x7fb40009e870 2023-10-03T10:16:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.525+0000 7fb3e77fe700 1 -- 172.21.15.146:0/1534107329 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3f00116d0 con 0x7fb40009e870 2023-10-03T10:16:13.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.622+0000 7fb3981d5700 1 -- 172.21.15.146:0/1500589717 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb39009e3a0 con 0x7fb39006a770 2023-10-03T10:16:13.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.623+0000 7fb3867fc700 1 -- 172.21.15.146:0/1500589717 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb38c02b070 con 0x7fb39006a770 2023-10-03T10:16:13.623 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:13.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.625+0000 7fb3981d5700 1 -- 172.21.15.146:0/1500589717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb39006a770 msgr2=0x7fb39009a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.625+0000 7fb3981d5700 1 --2- 172.21.15.146:0/1500589717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb39006a770 0x7fb39009a490 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fb39009d2c0 tx=0x7fb38c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:13.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.625+0000 7fb3981d5700 1 -- 172.21.15.146:0/1500589717 shutdown_connections 2023-10-03T10:16:13.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.625+0000 7fb3981d5700 1 --2- 172.21.15.146:0/1500589717 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb390131a00 0x7fb39009af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.625+0000 7fb3981d5700 1 --2- 172.21.15.146:0/1500589717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb39006a770 0x7fb39009a490 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.625+0000 7fb3981d5700 1 --2- 172.21.15.146:0/1500589717 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb39009dec0 0x7fb39009a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.625+0000 7fb3981d5700 1 -- 172.21.15.146:0/1500589717 >> 172.21.15.146:0/1500589717 conn(0x7fb390099c40 msgr2=0x7fb39012ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.625+0000 7fb3981d5700 1 -- 172.21.15.146:0/1500589717 shutdown_connections 2023-10-03T10:16:13.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.625+0000 7fb3981d5700 1 -- 172.21.15.146:0/1500589717 wait complete. 2023-10-03T10:16:13.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:13.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.699+0000 7ff1b8569700 1 -- 172.21.15.146:0/1292900712 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff1b0125c00 con 0x7ff1b009e870 2023-10-03T10:16:13.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.700+0000 7ff1a6ffd700 1 -- 172.21.15.146:0/1292900712 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff1ac015030 con 0x7ff1b009e870 2023-10-03T10:16:13.700 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:13.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.703+0000 7ff1b8569700 1 -- 172.21.15.146:0/1292900712 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1b009e870 msgr2=0x7ff1b0122720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.703+0000 7ff1b8569700 1 --2- 172.21.15.146:0/1292900712 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1b009e870 0x7ff1b0122720 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac000c00 tx=0x7ff1ac004750 comp rx=0 tx=0).stop 2023-10-03T10:16:13.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.703+0000 7ff1b8569700 1 -- 172.21.15.146:0/1292900712 shutdown_connections 2023-10-03T10:16:13.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.703+0000 7ff1b8569700 1 --2- 172.21.15.146:0/1292900712 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1b0134330 0x7ff1b01231a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.703+0000 7ff1b8569700 1 --2- 172.21.15.146:0/1292900712 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1b009e870 0x7ff1b0122720 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.703+0000 7ff1b8569700 1 --2- 172.21.15.146:0/1292900712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1b009f180 0x7ff1b0122c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.703+0000 7ff1b8569700 1 -- 172.21.15.146:0/1292900712 >> 172.21.15.146:0/1292900712 conn(0x7ff1b00a4430 msgr2=0x7ff1b0070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.703+0000 7ff1b8569700 1 -- 172.21.15.146:0/1292900712 shutdown_connections 2023-10-03T10:16:13.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.703+0000 7ff1b8569700 1 -- 172.21.15.146:0/1292900712 wait complete. 2023-10-03T10:16:13.720 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:13.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.730+0000 7fb405343700 1 -- 172.21.15.146:0/1534107329 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb3e0005590 con 0x7fb40009e870 2023-10-03T10:16:13.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.730+0000 7fb3e77fe700 1 -- 172.21.15.146:0/1534107329 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb3f0033090 con 0x7fb40009e870 2023-10-03T10:16:13.731 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:13.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.732+0000 7fb405343700 1 -- 172.21.15.146:0/1534107329 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb40009e870 msgr2=0x7fb40011e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.732+0000 7fb405343700 1 --2- 172.21.15.146:0/1534107329 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb40009e870 0x7fb40011e090 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb40009c8a0 tx=0x7fb3f0004750 comp rx=0 tx=0).stop 2023-10-03T10:16:13.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.732+0000 7fb405343700 1 -- 172.21.15.146:0/1534107329 shutdown_connections 2023-10-03T10:16:13.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.732+0000 7fb405343700 1 --2- 172.21.15.146:0/1534107329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb400131d70 0x7fb40011eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.732+0000 7fb405343700 1 --2- 172.21.15.146:0/1534107329 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb40009e870 0x7fb40011e090 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.732+0000 7fb405343700 1 --2- 172.21.15.146:0/1534107329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb40009f180 0x7fb40011e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.732+0000 7fb405343700 1 -- 172.21.15.146:0/1534107329 >> 172.21.15.146:0/1534107329 conn(0x7fb4000a4430 msgr2=0x7fb40006c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.733+0000 7fb405343700 1 -- 172.21.15.146:0/1534107329 shutdown_connections 2023-10-03T10:16:13.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.733+0000 7fb405343700 1 -- 172.21.15.146:0/1534107329 wait complete. 2023-10-03T10:16:13.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:13.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.750+0000 7fe260d2d700 1 -- 172.21.15.146:0/939554622 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe25c04f2a0 con 0x7fe25c09dea0 2023-10-03T10:16:13.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.751+0000 7fe24affd700 1 -- 172.21.15.146:0/939554622 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe250015070 con 0x7fe25c09dea0 2023-10-03T10:16:13.751 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:13.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.753+0000 7fe260d2d700 1 -- 172.21.15.146:0/939554622 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe25c09dea0 msgr2=0x7fe25c133240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.753+0000 7fe260d2d700 1 --2- 172.21.15.146:0/939554622 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe25c09dea0 0x7fe25c133240 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe2500090b0 tx=0x7fe250004750 comp rx=0 tx=0).stop 2023-10-03T10:16:13.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.753+0000 7fe260d2d700 1 -- 172.21.15.146:0/939554622 shutdown_connections 2023-10-03T10:16:13.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.753+0000 7fe260d2d700 1 --2- 172.21.15.146:0/939554622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe25c134f00 0x7fe25c133780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.753+0000 7fe260d2d700 1 --2- 172.21.15.146:0/939554622 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe25c06a770 0x7fe25c132d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.753+0000 7fe260d2d700 1 --2- 172.21.15.146:0/939554622 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe25c09dea0 0x7fe25c133240 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.753+0000 7fe260d2d700 1 -- 172.21.15.146:0/939554622 >> 172.21.15.146:0/939554622 conn(0x7fe25c099c40 msgr2=0x7fe25c09c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.753+0000 7fe260d2d700 1 -- 172.21.15.146:0/939554622 shutdown_connections 2023-10-03T10:16:13.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:13.753+0000 7fe260d2d700 1 -- 172.21.15.146:0/939554622 wait complete. 2023-10-03T10:16:13.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:14.644 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:14.720 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:14.745 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:14.767 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.775+0000 7f43db1a8700 1 Processor -- start 2023-10-03T10:16:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.775+0000 7f43db1a8700 1 -- start start 2023-10-03T10:16:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.776+0000 7f43db1a8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43d409e870 0x7f43d409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.776+0000 7f43db1a8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43d4131f40 0x7f43d4139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.776+0000 7f43db1a8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d409c970 con 0x7f43d409f180 2023-10-03T10:16:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.776+0000 7f43db1a8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d40a0920 con 0x7f43d4131f40 2023-10-03T10:16:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.776+0000 7f43db1a8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43d409f9c0 con 0x7f43d409e870 2023-10-03T10:16:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.776+0000 7f43d9745700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43d4131f40 0x7f43d4139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.776+0000 7f43d8f44700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43d409e870 0x7f43d409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.776+0000 7f43d9745700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43d4131f40 0x7f43d4139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43570/0 (socket says 172.21.15.146:43570) 2023-10-03T10:16:14.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.776+0000 7f43d9745700 1 -- 172.21.15.146:0/1258589820 learned_addr learned my addr 172.21.15.146:0/1258589820 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.776+0000 7f43d9745700 1 -- 172.21.15.146:0/1258589820 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43d409e870 msgr2=0x7f43d409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:14.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.776+0000 7f43d9745700 1 --2- 172.21.15.146:0/1258589820 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43d409e870 0x7f43d409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.776+0000 7f43d9745700 1 -- 172.21.15.146:0/1258589820 >> v1:172.21.15.146:6789/0 conn(0x7f43d409f180 legacy=0x7f43d4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.776+0000 7f43d9745700 1 -- 172.21.15.146:0/1258589820 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d409bab0 con 0x7f43d4131f40 2023-10-03T10:16:14.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.777+0000 7f43d9745700 1 --2- 172.21.15.146:0/1258589820 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43d4131f40 0x7f43d4139ca0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009e80 tx=0x7f43cc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53864c91de02347a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.777+0000 7f43d37fe700 1 -- 172.21.15.146:0/1258589820 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc00e070 con 0x7f43d4131f40 2023-10-03T10:16:14.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.777+0000 7f43d37fe700 1 -- 172.21.15.146:0/1258589820 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc00b910 con 0x7f43d4131f40 2023-10-03T10:16:14.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.777+0000 7f43d37fe700 1 -- 172.21.15.146:0/1258589820 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc00bcc0 con 0x7f43d4131f40 2023-10-03T10:16:14.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.778+0000 7f43db1a8700 1 -- 172.21.15.146:0/1258589820 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43d4131f40 msgr2=0x7f43d4139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.778+0000 7f43db1a8700 1 --2- 172.21.15.146:0/1258589820 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43d4131f40 0x7f43d4139ca0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009e80 tx=0x7f43cc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:14.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.778+0000 7f43db1a8700 1 -- 172.21.15.146:0/1258589820 shutdown_connections 2023-10-03T10:16:14.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.778+0000 7f43db1a8700 1 --2- 172.21.15.146:0/1258589820 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43d4131f40 0x7f43d4139ca0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.778+0000 7f43db1a8700 1 --2- 172.21.15.146:0/1258589820 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43d409e870 0x7f43d409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.778+0000 7f43db1a8700 1 -- 172.21.15.146:0/1258589820 >> 172.21.15.146:0/1258589820 conn(0x7f43d40a4430 msgr2=0x7f43d40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.778+0000 7f43db1a8700 1 -- 172.21.15.146:0/1258589820 shutdown_connections 2023-10-03T10:16:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.778+0000 7f43db1a8700 1 -- 172.21.15.146:0/1258589820 wait complete. 2023-10-03T10:16:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.779+0000 7f43db1a8700 1 Processor -- start 2023-10-03T10:16:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.779+0000 7f43db1a8700 1 -- start start 2023-10-03T10:16:14.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.780+0000 7f43db1a8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43d409e870 0x7f43d411bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.780+0000 7f43db1a8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43d409f180 0x7f43d411c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.780+0000 7f43db1a8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43d4131f40 0x7f43d411c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.780+0000 7f43db1a8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d411db50 con 0x7f43d4131f40 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.780+0000 7f43db1a8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d411eda0 con 0x7f43d409e870 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.780+0000 7f43db1a8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43d411e130 con 0x7f43d409f180 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.780+0000 7f43d8f44700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43d409e870 0x7f43d411bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.780+0000 7f43d8f44700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43d409e870 0x7f43d411bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43582/0 (socket says 172.21.15.146:43582) 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.780+0000 7f43d8f44700 1 -- 172.21.15.146:0/1925080907 learned_addr learned my addr 172.21.15.146:0/1925080907 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.780+0000 7f43d3fff700 1 --2- 172.21.15.146:0/1925080907 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43d409f180 0x7f43d411c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.780+0000 7f43d3fff700 1 -- 172.21.15.146:0/1925080907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43d409e870 msgr2=0x7f43d411bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.780+0000 7f43d3fff700 1 --2- 172.21.15.146:0/1925080907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43d409e870 0x7f43d411bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.780+0000 7f43d3fff700 1 -- 172.21.15.146:0/1925080907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43d4131f40 msgr2=0x7f43d411c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.780+0000 7f43d3fff700 1 --2- 172.21.15.146:0/1925080907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43d4131f40 0x7f43d411c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.780+0000 7f43d3fff700 1 -- 172.21.15.146:0/1925080907 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc009b30 con 0x7f43d409f180 2023-10-03T10:16:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.780+0000 7f43d3fff700 1 --2- 172.21.15.146:0/1925080907 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43d409f180 0x7f43d411c480 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f43c0000f60 tx=0x7f43c000c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.781+0000 7f43d17fa700 1 -- 172.21.15.146:0/1925080907 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c00052d0 con 0x7f43d409f180 2023-10-03T10:16:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.781+0000 7f43d17fa700 1 -- 172.21.15.146:0/1925080907 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c0005430 con 0x7f43d409f180 2023-10-03T10:16:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.781+0000 7f43db1a8700 1 -- 172.21.15.146:0/1925080907 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d411f780 con 0x7f43d409f180 2023-10-03T10:16:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.781+0000 7f43d17fa700 1 -- 172.21.15.146:0/1925080907 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c00038c0 con 0x7f43d409f180 2023-10-03T10:16:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.781+0000 7f43db1a8700 1 -- 172.21.15.146:0/1925080907 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d411f250 con 0x7f43d409f180 2023-10-03T10:16:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.782+0000 7f43db1a8700 1 -- 172.21.15.146:0/1925080907 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d404f2a0 con 0x7f43d409f180 2023-10-03T10:16:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.782+0000 7f43d17fa700 1 -- 172.21.15.146:0/1925080907 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f43c0003a20 con 0x7f43d409f180 2023-10-03T10:16:14.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.782+0000 7f43d17fa700 1 -- 172.21.15.146:0/1925080907 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f43c003e770 con 0x7f43d409f180 2023-10-03T10:16:14.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.788+0000 7f43d17fa700 1 -- 172.21.15.146:0/1925080907 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f43c0011590 con 0x7f43d409f180 2023-10-03T10:16:14.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.862+0000 7fa892ac0700 1 Processor -- start 2023-10-03T10:16:14.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.862+0000 7fa892ac0700 1 -- start start 2023-10-03T10:16:14.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.863+0000 7fa892ac0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa88c0a1550 0x7fa88c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.863+0000 7fa892ac0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa88c139200 0x7fa88c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.863+0000 7fa892ac0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88c09e9d0 con 0x7fa88c0a0a70 2023-10-03T10:16:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.863+0000 7fa892ac0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88c09dc00 con 0x7fa88c0a1550 2023-10-03T10:16:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.863+0000 7fa892ac0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c09dec0 con 0x7fa88c139200 2023-10-03T10:16:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.863+0000 7fa88bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa88c0a1550 0x7fa88c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.863+0000 7fa89105d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa88c139200 0x7fa88c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.863+0000 7fa89085c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa88c0a0a70 0x7fa88c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50268/0 (socket says 172.21.15.146:50268) 2023-10-03T10:16:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.863+0000 7fa88bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa88c0a1550 0x7fa88c138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56140/0 (socket says 172.21.15.146:56140) 2023-10-03T10:16:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.863+0000 7fa89105d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa88c139200 0x7fa88c13b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57400/0 (socket says 172.21.15.146:57400) 2023-10-03T10:16:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.863+0000 7fa89085c700 1 -- 172.21.15.146:0/3554019825 learned_addr learned my addr 172.21.15.146:0/3554019825 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:14.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.863+0000 7fa89105d700 1 -- 172.21.15.146:0/3554019825 >> v2:172.21.15.146:3300/0 conn(0x7fa88c0a1550 msgr2=0x7fa88c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:14.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.863+0000 7fa89105d700 1 --2- 172.21.15.146:0/3554019825 >> v2:172.21.15.146:3300/0 conn(0x7fa88c0a1550 0x7fa88c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.863+0000 7fa89105d700 1 -- 172.21.15.146:0/3554019825 >> v1:172.21.15.146:6789/0 conn(0x7fa88c0a0a70 legacy=0x7fa88c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.863+0000 7fa89105d700 1 -- 172.21.15.146:0/3554019825 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c09e6a0 con 0x7fa88c139200 2023-10-03T10:16:14.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.863+0000 7fa88bfff700 1 --2- 172.21.15.146:0/3554019825 >> v2:172.21.15.146:3300/0 conn(0x7fa88c0a1550 0x7fa88c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.864+0000 7fa89105d700 1 --2- 172.21.15.146:0/3554019825 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa88c139200 0x7fa88c13b5e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa884009d90 tx=0x7fa88400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8dbaf26fa24f4cb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.864+0000 7fa88b7fe700 1 -- 172.21.15.146:0/3554019825 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88400e070 con 0x7fa88c139200 2023-10-03T10:16:14.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.864+0000 7fa88b7fe700 1 -- 172.21.15.146:0/3554019825 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88400bb20 con 0x7fa88c139200 2023-10-03T10:16:14.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.864+0000 7fa88b7fe700 1 -- 172.21.15.146:0/3554019825 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884012430 con 0x7fa88c139200 2023-10-03T10:16:14.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.864+0000 7fa892ac0700 1 -- 172.21.15.146:0/3554019825 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa88c139200 msgr2=0x7fa88c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.864+0000 7fa892ac0700 1 --2- 172.21.15.146:0/3554019825 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa88c139200 0x7fa88c13b5e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa884009d90 tx=0x7fa88400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:14.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.865+0000 7fa892ac0700 1 -- 172.21.15.146:0/3554019825 shutdown_connections 2023-10-03T10:16:14.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.865+0000 7fa892ac0700 1 --2- 172.21.15.146:0/3554019825 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa88c139200 0x7fa88c13b5e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.865+0000 7fa892ac0700 1 --2- 172.21.15.146:0/3554019825 >> v2:172.21.15.146:3300/0 conn(0x7fa88c0a1550 0x7fa88c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.865+0000 7fa892ac0700 1 -- 172.21.15.146:0/3554019825 >> 172.21.15.146:0/3554019825 conn(0x7fa88c0a6610 msgr2=0x7fa88c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:14.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.865+0000 7fa892ac0700 1 -- 172.21.15.146:0/3554019825 shutdown_connections 2023-10-03T10:16:14.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.865+0000 7fa892ac0700 1 -- 172.21.15.146:0/3554019825 wait complete. 2023-10-03T10:16:14.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.866+0000 7fa892ac0700 1 Processor -- start 2023-10-03T10:16:14.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.866+0000 7fa892ac0700 1 -- start start 2023-10-03T10:16:14.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.867+0000 7fa892ac0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa88c0a0a70 0x7fa88c11e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.867+0000 7fa892ac0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa88c0a1550 0x7fa88c11ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.867+0000 7fa892ac0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa88c139200 0x7fa88c11f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.867+0000 7fa892ac0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c0a0470 con 0x7fa88c0a0a70 2023-10-03T10:16:14.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.867+0000 7fa892ac0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c122050 con 0x7fa88c139200 2023-10-03T10:16:14.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.867+0000 7fa892ac0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c121aa0 con 0x7fa88c0a1550 2023-10-03T10:16:14.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.867+0000 7fa89085c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa88c0a0a70 0x7fa88c11e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.867+0000 7fa89085c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa88c0a0a70 0x7fa88c11e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56156/0 (socket says 172.21.15.146:56156) 2023-10-03T10:16:14.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.867+0000 7fa89085c700 1 -- 172.21.15.146:0/3628913733 learned_addr learned my addr 172.21.15.146:0/3628913733 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:14.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.867+0000 7fa88bfff700 1 --2- 172.21.15.146:0/3628913733 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa88c0a1550 0x7fa88c11ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.867+0000 7fa89105d700 1 --2- 172.21.15.146:0/3628913733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa88c139200 0x7fa88c11f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.867+0000 7fa89105d700 1 -- 172.21.15.146:0/3628913733 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa88c0a1550 msgr2=0x7fa88c11ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.867+0000 7fa89105d700 1 --2- 172.21.15.146:0/3628913733 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa88c0a1550 0x7fa88c11ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.868+0000 7fa89105d700 1 -- 172.21.15.146:0/3628913733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa88c0a0a70 msgr2=0x7fa88c11e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.868+0000 7fa89105d700 1 --2- 172.21.15.146:0/3628913733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa88c0a0a70 0x7fa88c11e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.868+0000 7fa89105d700 1 -- 172.21.15.146:0/3628913733 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8780094a0 con 0x7fa88c139200 2023-10-03T10:16:14.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.868+0000 7fa88bfff700 1 --2- 172.21.15.146:0/3628913733 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa88c0a1550 0x7fa88c11ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.868+0000 7fa89085c700 1 --2- 172.21.15.146:0/3628913733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa88c0a0a70 0x7fa88c11e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:14.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.868+0000 7fa89105d700 1 --2- 172.21.15.146:0/3628913733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa88c139200 0x7fa88c11f320 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0a72d0 tx=0x7fa884004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.868+0000 7fa8897fa700 1 -- 172.21.15.146:0/3628913733 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884012430 con 0x7fa88c139200 2023-10-03T10:16:14.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.868+0000 7fa8897fa700 1 -- 172.21.15.146:0/3628913733 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa884020070 con 0x7fa88c139200 2023-10-03T10:16:14.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.868+0000 7fa8897fa700 1 -- 172.21.15.146:0/3628913733 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884004280 con 0x7fa88c139200 2023-10-03T10:16:14.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.868+0000 7fa892ac0700 1 -- 172.21.15.146:0/3628913733 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa884009a70 con 0x7fa88c139200 2023-10-03T10:16:14.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.868+0000 7fa892ac0700 1 -- 172.21.15.146:0/3628913733 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88c120530 con 0x7fa88c139200 2023-10-03T10:16:14.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.869+0000 7fa8897fa700 1 -- 172.21.15.146:0/3628913733 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa8840043e0 con 0x7fa88c139200 2023-10-03T10:16:14.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.869+0000 7fa8897fa700 1 -- 172.21.15.146:0/3628913733 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa884022070 con 0x7fa88c139200 2023-10-03T10:16:14.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.870+0000 7fa892ac0700 1 -- 172.21.15.146:0/3628913733 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88c121cf0 con 0x7fa88c139200 2023-10-03T10:16:14.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.874+0000 7fa8897fa700 1 -- 172.21.15.146:0/3628913733 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa88401c400 con 0x7fa88c139200 2023-10-03T10:16:14.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.894+0000 7f84efa8a700 1 Processor -- start 2023-10-03T10:16:14.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.894+0000 7f84efa8a700 1 -- start start 2023-10-03T10:16:14.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.895+0000 7f84efa8a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f84e8133ad0 0x7f84e8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.895+0000 7f84efa8a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f84e81300a0 0x7f84e81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.895+0000 7f84efa8a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84e81309f0 0x7f84e813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.895+0000 7f84efa8a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e806b2d0 con 0x7f84e8133ad0 2023-10-03T10:16:14.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.895+0000 7f84efa8a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e8133610 con 0x7f84e81309f0 2023-10-03T10:16:14.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.895+0000 7f84efa8a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84e809a500 con 0x7f84e81300a0 2023-10-03T10:16:14.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.895+0000 7f84ed025700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f84e81300a0 0x7f84e81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.895+0000 7f84ed025700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f84e81300a0 0x7f84e81304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57416/0 (socket says 172.21.15.146:57416) 2023-10-03T10:16:14.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.895+0000 7f84ed025700 1 -- 172.21.15.146:0/4004831229 learned_addr learned my addr 172.21.15.146:0/4004831229 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:14.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.895+0000 7f84ee027700 1 --2- 172.21.15.146:0/4004831229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84e81309f0 0x7f84e813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.895+0000 7f84ed826700 1 --2- 172.21.15.146:0/4004831229 >> v2:172.21.15.146:3300/0 conn(0x7f84e8133ad0 0x7f84e8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.895+0000 7f84ee027700 1 -- 172.21.15.146:0/4004831229 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f84e81300a0 msgr2=0x7f84e81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:14.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.895+0000 7f84ee027700 1 --2- 172.21.15.146:0/4004831229 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f84e81300a0 0x7f84e81304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.896+0000 7f84ee027700 1 -- 172.21.15.146:0/4004831229 >> v2:172.21.15.146:3300/0 conn(0x7f84e8133ad0 msgr2=0x7f84e8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:14.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.896+0000 7f84ee027700 1 --2- 172.21.15.146:0/4004831229 >> v2:172.21.15.146:3300/0 conn(0x7f84e8133ad0 0x7f84e8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.896+0000 7f84ee027700 1 -- 172.21.15.146:0/4004831229 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e81338b0 con 0x7f84e81309f0 2023-10-03T10:16:14.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.896+0000 7f84ed826700 1 --2- 172.21.15.146:0/4004831229 >> v2:172.21.15.146:3300/0 conn(0x7f84e8133ad0 0x7f84e8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.896+0000 7f84ee027700 1 --2- 172.21.15.146:0/4004831229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84e81309f0 0x7f84e813a980 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009d90 tx=0x7f84e000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c908d6ada285989 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.896+0000 7f84ec824700 1 -- 172.21.15.146:0/4004831229 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e000e070 con 0x7f84e81309f0 2023-10-03T10:16:14.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.896+0000 7f84ec824700 1 -- 172.21.15.146:0/4004831229 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e000bb20 con 0x7f84e81309f0 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.896+0000 7f84ec824700 1 -- 172.21.15.146:0/4004831229 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0012430 con 0x7f84e81309f0 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.897+0000 7f84efa8a700 1 -- 172.21.15.146:0/4004831229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84e81309f0 msgr2=0x7f84e813a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.897+0000 7f84efa8a700 1 --2- 172.21.15.146:0/4004831229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84e81309f0 0x7f84e813a980 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009d90 tx=0x7f84e000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.897+0000 7f84efa8a700 1 -- 172.21.15.146:0/4004831229 shutdown_connections 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.897+0000 7f84efa8a700 1 --2- 172.21.15.146:0/4004831229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84e81309f0 0x7f84e813a980 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.897+0000 7f84efa8a700 1 --2- 172.21.15.146:0/4004831229 >> v2:172.21.15.146:3300/0 conn(0x7f84e8133ad0 0x7f84e8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.897+0000 7f84efa8a700 1 --2- 172.21.15.146:0/4004831229 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f84e81300a0 0x7f84e81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.897+0000 7f84efa8a700 1 -- 172.21.15.146:0/4004831229 >> 172.21.15.146:0/4004831229 conn(0x7f84e8099c40 msgr2=0x7f84e80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.897+0000 7f84efa8a700 1 -- 172.21.15.146:0/4004831229 shutdown_connections 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.897+0000 7f84efa8a700 1 -- 172.21.15.146:0/4004831229 wait complete. 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.898+0000 7f84efa8a700 1 Processor -- start 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.898+0000 7f84efa8a700 1 -- start start 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.898+0000 7f84efa8a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84e81300a0 0x7f84e811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.898+0000 7f84efa8a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84e81309f0 0x7f84e811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.898+0000 7f84efa8a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f84e8133ad0 0x7f84e811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.898+0000 7f84efa8a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e811f2a0 con 0x7f84e81300a0 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.898+0000 7f84efa8a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e81208a0 con 0x7f84e81309f0 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.898+0000 7f84efa8a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84e811fc50 con 0x7f84e8133ad0 2023-10-03T10:16:14.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.898+0000 7f84ee027700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f84e8133ad0 0x7f84e811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.898+0000 7f84ed025700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84e81309f0 0x7f84e811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.898+0000 7f84ee027700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f84e8133ad0 0x7f84e811e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57424/0 (socket says 172.21.15.146:57424) 2023-10-03T10:16:14.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.898+0000 7f84ee027700 1 -- 172.21.15.146:0/1843528672 learned_addr learned my addr 172.21.15.146:0/1843528672 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:14.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.898+0000 7f84ed826700 1 --2- 172.21.15.146:0/1843528672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84e81300a0 0x7f84e811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.899+0000 7f84ed025700 1 -- 172.21.15.146:0/1843528672 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f84e8133ad0 msgr2=0x7f84e811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.899+0000 7f84ed025700 1 --2- 172.21.15.146:0/1843528672 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f84e8133ad0 0x7f84e811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.899+0000 7f84ed025700 1 -- 172.21.15.146:0/1843528672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84e81300a0 msgr2=0x7f84e811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.899+0000 7f84ed025700 1 --2- 172.21.15.146:0/1843528672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84e81300a0 0x7f84e811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.899+0000 7f84ed025700 1 -- 172.21.15.146:0/1843528672 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e40094a0 con 0x7f84e81309f0 2023-10-03T10:16:14.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.899+0000 7f84ee027700 1 --2- 172.21.15.146:0/1843528672 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f84e8133ad0 0x7f84e811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.899+0000 7f84ed025700 1 --2- 172.21.15.146:0/1843528672 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84e81309f0 0x7f84e811df80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f84d800c2b0 tx=0x7f84d800c5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.899+0000 7f84de7fc700 1 -- 172.21.15.146:0/1843528672 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8016460 con 0x7f84e81309f0 2023-10-03T10:16:14.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.899+0000 7f84de7fc700 1 -- 172.21.15.146:0/1843528672 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d80165c0 con 0x7f84e81309f0 2023-10-03T10:16:14.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.899+0000 7f84de7fc700 1 -- 172.21.15.146:0/1843528672 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8016950 con 0x7f84e81309f0 2023-10-03T10:16:14.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.899+0000 7f84efa8a700 1 -- 172.21.15.146:0/1843528672 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e0009a70 con 0x7f84e81309f0 2023-10-03T10:16:14.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.899+0000 7f84efa8a700 1 -- 172.21.15.146:0/1843528672 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e812f790 con 0x7f84e81309f0 2023-10-03T10:16:14.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.900+0000 7f84de7fc700 1 -- 172.21.15.146:0/1843528672 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f84d80113f0 con 0x7f84e81309f0 2023-10-03T10:16:14.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.900+0000 7f84de7fc700 1 -- 172.21.15.146:0/1843528672 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f84d8050470 con 0x7f84e81309f0 2023-10-03T10:16:14.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.900+0000 7f84efa8a700 1 -- 172.21.15.146:0/1843528672 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e809cb20 con 0x7f84e81309f0 2023-10-03T10:16:14.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.905+0000 7f84de7fc700 1 -- 172.21.15.146:0/1843528672 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f84d80116a0 con 0x7f84e81309f0 2023-10-03T10:16:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.908+0000 7f0a81bd7700 1 Processor -- start 2023-10-03T10:16:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.908+0000 7f0a81bd7700 1 -- start start 2023-10-03T10:16:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.909+0000 7f0a81bd7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0a7c09d860 0x7f0a7c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.909+0000 7f0a81bd7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0a7c09e170 0x7f0a7c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.909+0000 7f0a81bd7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a7c09aaa0 con 0x7f0a7c130ce0 2023-10-03T10:16:14.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.909+0000 7f0a81bd7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a7c09f870 con 0x7f0a7c09e170 2023-10-03T10:16:14.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.909+0000 7f0a81bd7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c09b360 con 0x7f0a7c09d860 2023-10-03T10:16:14.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.909+0000 7f0a7b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0a7c09d860 0x7f0a7c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.909+0000 7f0a7bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0a7c130ce0 0x7f0a7c1379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50276/0 (socket says 172.21.15.146:50276) 2023-10-03T10:16:14.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.909+0000 7f0a7bfff700 1 -- 172.21.15.146:0/700525978 learned_addr learned my addr 172.21.15.146:0/700525978 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:14.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.909+0000 7f0a7affd700 1 --2- 172.21.15.146:0/700525978 >> v2:172.21.15.146:3300/0 conn(0x7f0a7c09e170 0x7f0a7c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.909+0000 7f0a7affd700 1 -- 172.21.15.146:0/700525978 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0a7c09d860 msgr2=0x7f0a7c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:14.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.909+0000 7f0a7affd700 1 --2- 172.21.15.146:0/700525978 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0a7c09d860 0x7f0a7c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.909+0000 7f0a7affd700 1 -- 172.21.15.146:0/700525978 >> v1:172.21.15.146:6789/0 conn(0x7f0a7c130ce0 legacy=0x7f0a7c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.909+0000 7f0a7a7fc700 1 -- 172.21.15.146:0/700525978 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573731110 0 0) 0x7f0a7c09aaa0 con 0x7f0a7c130ce0 2023-10-03T10:16:14.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.909+0000 7f0a7affd700 1 -- 172.21.15.146:0/700525978 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7c09b620 con 0x7f0a7c09e170 2023-10-03T10:16:14.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.909+0000 7f0a7affd700 1 --2- 172.21.15.146:0/700525978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a7c09e170 0x7f0a7c1307a0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f0a70009840 tx=0x7f0a70009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02230c968dbf89b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.910+0000 7f0a7a7fc700 1 -- 172.21.15.146:0/700525978 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a70011830 con 0x7f0a7c09e170 2023-10-03T10:16:14.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.910+0000 7f0a7a7fc700 1 -- 172.21.15.146:0/700525978 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a70011990 con 0x7f0a7c09e170 2023-10-03T10:16:14.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.910+0000 7f0a7a7fc700 1 -- 172.21.15.146:0/700525978 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a70011d20 con 0x7f0a7c09e170 2023-10-03T10:16:14.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.910+0000 7f0a81bd7700 1 -- 172.21.15.146:0/700525978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a7c09e170 msgr2=0x7f0a7c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.910+0000 7f0a81bd7700 1 --2- 172.21.15.146:0/700525978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a7c09e170 0x7f0a7c1307a0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f0a70009840 tx=0x7f0a70009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:14.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.910+0000 7f0a81bd7700 1 -- 172.21.15.146:0/700525978 shutdown_connections 2023-10-03T10:16:14.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.910+0000 7f0a81bd7700 1 --2- 172.21.15.146:0/700525978 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0a7c09d860 0x7f0a7c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.910+0000 7f0a81bd7700 1 --2- 172.21.15.146:0/700525978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a7c09e170 0x7f0a7c1307a0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.910+0000 7f0a81bd7700 1 -- 172.21.15.146:0/700525978 >> 172.21.15.146:0/700525978 conn(0x7f0a7c099c40 msgr2=0x7f0a7c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:14.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.910+0000 7f0a81bd7700 1 -- 172.21.15.146:0/700525978 shutdown_connections 2023-10-03T10:16:14.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.910+0000 7f0a81bd7700 1 -- 172.21.15.146:0/700525978 wait complete. 2023-10-03T10:16:14.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.912+0000 7f0a81bd7700 1 Processor -- start 2023-10-03T10:16:14.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.912+0000 7f0a81bd7700 1 -- start start 2023-10-03T10:16:14.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.912+0000 7f0a81bd7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0a7c09d860 0x7f0a7c135560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.912+0000 7f0a81bd7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a7c09e170 0x7f0a7c135aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.912+0000 7f0a81bd7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a7c130ce0 0x7f0a7c135fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.912+0000 7f0a81bd7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c130250 con 0x7f0a7c130ce0 2023-10-03T10:16:14.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.912+0000 7f0a81bd7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c138450 con 0x7f0a7c09e170 2023-10-03T10:16:14.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.912+0000 7f0a81bd7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c138e40 con 0x7f0a7c09d860 2023-10-03T10:16:14.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.913+0000 7f0a7b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0a7c09d860 0x7f0a7c135560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.913+0000 7f0a7b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0a7c09d860 0x7f0a7c135560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57440/0 (socket says 172.21.15.146:57440) 2023-10-03T10:16:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.913+0000 7f0a7b7fe700 1 -- 172.21.15.146:0/3868627616 learned_addr learned my addr 172.21.15.146:0/3868627616 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.913+0000 7f0a7bfff700 1 --2- 172.21.15.146:0/3868627616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a7c130ce0 0x7f0a7c135fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.913+0000 7f0a7affd700 1 --2- 172.21.15.146:0/3868627616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a7c09e170 0x7f0a7c135aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.913+0000 7f0a7b7fe700 1 -- 172.21.15.146:0/3868627616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a7c09e170 msgr2=0x7f0a7c135aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.913+0000 7f0a7b7fe700 1 --2- 172.21.15.146:0/3868627616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a7c09e170 0x7f0a7c135aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.913+0000 7f0a7b7fe700 1 -- 172.21.15.146:0/3868627616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a7c130ce0 msgr2=0x7f0a7c135fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.913+0000 7f0a7b7fe700 1 --2- 172.21.15.146:0/3868627616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a7c130ce0 0x7f0a7c135fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.913+0000 7f0a7b7fe700 1 -- 172.21.15.146:0/3868627616 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a700094a0 con 0x7f0a7c09d860 2023-10-03T10:16:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.913+0000 7f0a7affd700 1 --2- 172.21.15.146:0/3868627616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a7c09e170 0x7f0a7c135aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.913+0000 7f0a7b7fe700 1 --2- 172.21.15.146:0/3868627616 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0a7c09d860 0x7f0a7c135560 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00e9b0 tx=0x7f0a6c00ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.913+0000 7f0a63fff700 1 -- 172.21.15.146:0/3868627616 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c009710 con 0x7f0a7c09d860 2023-10-03T10:16:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.913+0000 7f0a63fff700 1 -- 172.21.15.146:0/3868627616 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c00c850 con 0x7f0a7c09d860 2023-10-03T10:16:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.913+0000 7f0a63fff700 1 -- 172.21.15.146:0/3868627616 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c00cbc0 con 0x7f0a7c09d860 2023-10-03T10:16:14.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.914+0000 7f0a81bd7700 1 -- 172.21.15.146:0/3868627616 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a7c138ae0 con 0x7f0a7c09d860 2023-10-03T10:16:14.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.914+0000 7f0a81bd7700 1 -- 172.21.15.146:0/3868627616 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7c138870 con 0x7f0a7c09d860 2023-10-03T10:16:14.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.915+0000 7f0a81bd7700 1 -- 172.21.15.146:0/3868627616 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a7c04f2a0 con 0x7f0a7c09d860 2023-10-03T10:16:14.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.915+0000 7f0a63fff700 1 -- 172.21.15.146:0/3868627616 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a6c00cd20 con 0x7f0a7c09d860 2023-10-03T10:16:14.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.915+0000 7f0a63fff700 1 -- 172.21.15.146:0/3868627616 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0a6c03faf0 con 0x7f0a7c09d860 2023-10-03T10:16:14.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:14.919+0000 7f0a63fff700 1 -- 172.21.15.146:0/3868627616 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a6c0135b0 con 0x7f0a7c09d860 2023-10-03T10:16:15.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.046+0000 7f43db1a8700 1 -- 172.21.15.146:0/1925080907 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f43d411f250 con 0x7f43d409f180 2023-10-03T10:16:15.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.046+0000 7f43d17fa700 1 -- 172.21.15.146:0/1925080907 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f43d411f250 con 0x7f43d409f180 2023-10-03T10:16:15.047 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:15.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.048+0000 7f43db1a8700 1 -- 172.21.15.146:0/1925080907 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43d409f180 msgr2=0x7f43d411c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.048+0000 7f43db1a8700 1 --2- 172.21.15.146:0/1925080907 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43d409f180 0x7f43d411c480 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f43c0000f60 tx=0x7f43c000c730 comp rx=0 tx=0).stop 2023-10-03T10:16:15.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.048+0000 7f43db1a8700 1 -- 172.21.15.146:0/1925080907 shutdown_connections 2023-10-03T10:16:15.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.048+0000 7f43db1a8700 1 --2- 172.21.15.146:0/1925080907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43d4131f40 0x7f43d411c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.048+0000 7f43db1a8700 1 --2- 172.21.15.146:0/1925080907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43d409e870 0x7f43d411bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.048+0000 7f43db1a8700 1 --2- 172.21.15.146:0/1925080907 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43d409f180 0x7f43d411c480 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.048+0000 7f43db1a8700 1 -- 172.21.15.146:0/1925080907 >> 172.21.15.146:0/1925080907 conn(0x7f43d40a4430 msgr2=0x7f43d4130f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.049+0000 7f43db1a8700 1 -- 172.21.15.146:0/1925080907 shutdown_connections 2023-10-03T10:16:15.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.049+0000 7f43db1a8700 1 -- 172.21.15.146:0/1925080907 wait complete. 2023-10-03T10:16:15.062 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:15.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.116+0000 7f0a81bd7700 1 -- 172.21.15.146:0/3868627616 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0a7c138870 con 0x7f0a7c09d860 2023-10-03T10:16:15.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.116+0000 7f0a63fff700 1 -- 172.21.15.146:0/3868627616 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0a7c138870 con 0x7f0a7c09d860 2023-10-03T10:16:15.117 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:15.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.118+0000 7f0a81bd7700 1 -- 172.21.15.146:0/3868627616 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0a7c09d860 msgr2=0x7f0a7c135560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.118+0000 7f0a81bd7700 1 --2- 172.21.15.146:0/3868627616 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0a7c09d860 0x7f0a7c135560 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00e9b0 tx=0x7f0a6c00ed70 comp rx=0 tx=0).stop 2023-10-03T10:16:15.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.118+0000 7f0a81bd7700 1 -- 172.21.15.146:0/3868627616 shutdown_connections 2023-10-03T10:16:15.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.118+0000 7f0a81bd7700 1 --2- 172.21.15.146:0/3868627616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a7c130ce0 0x7f0a7c135fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.118+0000 7f0a81bd7700 1 --2- 172.21.15.146:0/3868627616 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0a7c09d860 0x7f0a7c135560 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.118+0000 7f0a81bd7700 1 --2- 172.21.15.146:0/3868627616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a7c09e170 0x7f0a7c135aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.118+0000 7f0a81bd7700 1 -- 172.21.15.146:0/3868627616 >> 172.21.15.146:0/3868627616 conn(0x7f0a7c099c40 msgr2=0x7f0a7c139470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.119+0000 7f0a81bd7700 1 -- 172.21.15.146:0/3868627616 shutdown_connections 2023-10-03T10:16:15.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.119+0000 7f0a81bd7700 1 -- 172.21.15.146:0/3868627616 wait complete. 2023-10-03T10:16:15.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.123+0000 7fa892ac0700 1 -- 172.21.15.146:0/3628913733 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa88c04f2a0 con 0x7fa88c139200 2023-10-03T10:16:15.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.123+0000 7fa8897fa700 1 -- 172.21.15.146:0/3628913733 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa88402c020 con 0x7fa88c139200 2023-10-03T10:16:15.124 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:15.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.126+0000 7fa892ac0700 1 -- 172.21.15.146:0/3628913733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa88c139200 msgr2=0x7fa88c11f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.126+0000 7fa892ac0700 1 --2- 172.21.15.146:0/3628913733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa88c139200 0x7fa88c11f320 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0a72d0 tx=0x7fa884004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.127+0000 7fa892ac0700 1 -- 172.21.15.146:0/3628913733 shutdown_connections 2023-10-03T10:16:15.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.127+0000 7fa892ac0700 1 --2- 172.21.15.146:0/3628913733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa88c139200 0x7fa88c11f320 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.127+0000 7fa892ac0700 1 --2- 172.21.15.146:0/3628913733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa88c0a0a70 0x7fa88c11e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.127+0000 7fa892ac0700 1 --2- 172.21.15.146:0/3628913733 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa88c0a1550 0x7fa88c11ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.127+0000 7fa892ac0700 1 -- 172.21.15.146:0/3628913733 >> 172.21.15.146:0/3628913733 conn(0x7fa88c0a6610 msgr2=0x7fa88c138120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.127+0000 7fa892ac0700 1 -- 172.21.15.146:0/3628913733 shutdown_connections 2023-10-03T10:16:15.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.127+0000 7fa892ac0700 1 -- 172.21.15.146:0/3628913733 wait complete. 2023-10-03T10:16:15.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.127+0000 7f84efa8a700 1 -- 172.21.15.146:0/1843528672 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f84e804f2a0 con 0x7f84e81309f0 2023-10-03T10:16:15.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.127+0000 7f84de7fc700 1 -- 172.21.15.146:0/1843528672 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f84d802eae0 con 0x7f84e81309f0 2023-10-03T10:16:15.129 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:15.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.129+0000 7f84efa8a700 1 -- 172.21.15.146:0/1843528672 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84e81309f0 msgr2=0x7f84e811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.129+0000 7f84efa8a700 1 --2- 172.21.15.146:0/1843528672 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84e81309f0 0x7f84e811df80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f84d800c2b0 tx=0x7f84d800c5c0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.130+0000 7f84efa8a700 1 -- 172.21.15.146:0/1843528672 shutdown_connections 2023-10-03T10:16:15.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.130+0000 7f84efa8a700 1 --2- 172.21.15.146:0/1843528672 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f84e8133ad0 0x7f84e811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.130+0000 7f84efa8a700 1 --2- 172.21.15.146:0/1843528672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84e81300a0 0x7f84e811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.130+0000 7f84efa8a700 1 --2- 172.21.15.146:0/1843528672 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84e81309f0 0x7f84e811df80 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.130+0000 7f84efa8a700 1 -- 172.21.15.146:0/1843528672 >> 172.21.15.146:0/1843528672 conn(0x7f84e8099c40 msgr2=0x7f84e8132c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.130+0000 7f84efa8a700 1 -- 172.21.15.146:0/1843528672 shutdown_connections 2023-10-03T10:16:15.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:15.130+0000 7f84efa8a700 1 -- 172.21.15.146:0/1843528672 wait complete. 2023-10-03T10:16:15.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:15.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:15.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:16.062 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:16.134 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:16.143 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:16.144 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:16.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.205+0000 7fd6795a9700 1 Processor -- start 2023-10-03T10:16:16.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.205+0000 7fd6795a9700 1 -- start start 2023-10-03T10:16:16.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.205+0000 7fd6795a9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd674133ad0 0x7fd674133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.205+0000 7fd6795a9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd6741300a0 0x7fd6741304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.205+0000 7fd6795a9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd6741309f0 0x7fd67413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.205+0000 7fd6795a9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd67406b2d0 con 0x7fd6741309f0 2023-10-03T10:16:16.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.205+0000 7fd6795a9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd674133610 con 0x7fd6741300a0 2023-10-03T10:16:16.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.205+0000 7fd6795a9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd67409a500 con 0x7fd674133ad0 2023-10-03T10:16:16.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.206+0000 7fd6727fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd6741300a0 0x7fd6741304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.206+0000 7fd6727fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd6741300a0 0x7fd6741304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43634/0 (socket says 172.21.15.146:43634) 2023-10-03T10:16:16.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.206+0000 7fd6727fc700 1 -- 172.21.15.146:0/1151437153 learned_addr learned my addr 172.21.15.146:0/1151437153 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:16.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.206+0000 7fd672ffd700 1 --2- 172.21.15.146:0/1151437153 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd674133ad0 0x7fd674133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.206+0000 7fd6727fc700 1 -- 172.21.15.146:0/1151437153 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd674133ad0 msgr2=0x7fd674133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.206+0000 7fd6727fc700 1 --2- 172.21.15.146:0/1151437153 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd674133ad0 0x7fd674133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.206+0000 7fd6727fc700 1 -- 172.21.15.146:0/1151437153 >> v2:172.21.15.146:3300/0 conn(0x7fd6741309f0 msgr2=0x7fd67413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.206+0000 7fd6727fc700 1 --2- 172.21.15.146:0/1151437153 >> v2:172.21.15.146:3300/0 conn(0x7fd6741309f0 0x7fd67413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.206+0000 7fd6727fc700 1 -- 172.21.15.146:0/1151437153 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6741338b0 con 0x7fd6741300a0 2023-10-03T10:16:16.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.206+0000 7fd6727fc700 1 --2- 172.21.15.146:0/1151437153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd6741300a0 0x7fd6741304b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd6680098f0 tx=0x7fd668009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1919185d18f6ca9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.206+0000 7fd672ffd700 1 --2- 172.21.15.146:0/1151437153 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd674133ad0 0x7fd674133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:16.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.206+0000 7fd671ffb700 1 -- 172.21.15.146:0/1151437153 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668011830 con 0x7fd6741300a0 2023-10-03T10:16:16.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.207+0000 7fd671ffb700 1 -- 172.21.15.146:0/1151437153 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd668011990 con 0x7fd6741300a0 2023-10-03T10:16:16.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.207+0000 7fd671ffb700 1 -- 172.21.15.146:0/1151437153 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668011d00 con 0x7fd6741300a0 2023-10-03T10:16:16.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.207+0000 7fd6795a9700 1 -- 172.21.15.146:0/1151437153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd6741300a0 msgr2=0x7fd6741304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.207+0000 7fd6795a9700 1 --2- 172.21.15.146:0/1151437153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd6741300a0 0x7fd6741304b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd6680098f0 tx=0x7fd668009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:16.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.207+0000 7fd6795a9700 1 -- 172.21.15.146:0/1151437153 shutdown_connections 2023-10-03T10:16:16.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.207+0000 7fd6795a9700 1 --2- 172.21.15.146:0/1151437153 >> v2:172.21.15.146:3300/0 conn(0x7fd6741309f0 0x7fd67413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.207+0000 7fd6795a9700 1 --2- 172.21.15.146:0/1151437153 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd674133ad0 0x7fd674133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.207+0000 7fd6795a9700 1 --2- 172.21.15.146:0/1151437153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd6741300a0 0x7fd6741304b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.207+0000 7fd6795a9700 1 -- 172.21.15.146:0/1151437153 >> 172.21.15.146:0/1151437153 conn(0x7fd674099c40 msgr2=0x7fd6740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.208+0000 7fd6795a9700 1 -- 172.21.15.146:0/1151437153 shutdown_connections 2023-10-03T10:16:16.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.208+0000 7fd6795a9700 1 -- 172.21.15.146:0/1151437153 wait complete. 2023-10-03T10:16:16.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.209+0000 7fd6795a9700 1 Processor -- start 2023-10-03T10:16:16.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.209+0000 7fd6795a9700 1 -- start start 2023-10-03T10:16:16.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.209+0000 7fd6795a9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6741300a0 0x7fd67411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.209+0000 7fd6795a9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6741309f0 0x7fd67411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.209+0000 7fd6795a9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd674133ad0 0x7fd67411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.209+0000 7fd6795a9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6741201f0 con 0x7fd6741300a0 2023-10-03T10:16:16.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.209+0000 7fd6795a9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6740a2ea0 con 0x7fd674133ad0 2023-10-03T10:16:16.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.209+0000 7fd6795a9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd67412dd00 con 0x7fd6741309f0 2023-10-03T10:16:16.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.209+0000 7fd672ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6741300a0 0x7fd67411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.209+0000 7fd672ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6741300a0 0x7fd67411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56200/0 (socket says 172.21.15.146:56200) 2023-10-03T10:16:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.209+0000 7fd672ffd700 1 -- 172.21.15.146:0/958346441 learned_addr learned my addr 172.21.15.146:0/958346441 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.209+0000 7fd6737fe700 1 --2- 172.21.15.146:0/958346441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd674133ad0 0x7fd67411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.210+0000 7fd6737fe700 1 -- 172.21.15.146:0/958346441 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6741309f0 msgr2=0x7fd67411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.210+0000 7fd6737fe700 1 --2- 172.21.15.146:0/958346441 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6741309f0 0x7fd67411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.210+0000 7fd6737fe700 1 -- 172.21.15.146:0/958346441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6741300a0 msgr2=0x7fd67411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.210+0000 7fd6737fe700 1 --2- 172.21.15.146:0/958346441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6741300a0 0x7fd67411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.210+0000 7fd6737fe700 1 -- 172.21.15.146:0/958346441 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6640094a0 con 0x7fd674133ad0 2023-10-03T10:16:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.210+0000 7fd672ffd700 1 --2- 172.21.15.146:0/958346441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6741300a0 0x7fd67411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.210+0000 7fd6737fe700 1 --2- 172.21.15.146:0/958346441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd674133ad0 0x7fd67411e4c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd66c00be20 tx=0x7fd66c009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.210+0000 7fd65b7fe700 1 -- 172.21.15.146:0/958346441 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c00cc10 con 0x7fd674133ad0 2023-10-03T10:16:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.210+0000 7fd65b7fe700 1 -- 172.21.15.146:0/958346441 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66c00cd90 con 0x7fd674133ad0 2023-10-03T10:16:16.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.210+0000 7fd6795a9700 1 -- 172.21.15.146:0/958346441 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd668009550 con 0x7fd674133ad0 2023-10-03T10:16:16.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.210+0000 7fd65b7fe700 1 -- 172.21.15.146:0/958346441 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c014680 con 0x7fd674133ad0 2023-10-03T10:16:16.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.210+0000 7fd6795a9700 1 -- 172.21.15.146:0/958346441 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67411f8e0 con 0x7fd674133ad0 2023-10-03T10:16:16.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.211+0000 7fd65b7fe700 1 -- 172.21.15.146:0/958346441 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd66c01d3b0 con 0x7fd674133ad0 2023-10-03T10:16:16.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.211+0000 7fd6795a9700 1 -- 172.21.15.146:0/958346441 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd67411f490 con 0x7fd674133ad0 2023-10-03T10:16:16.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.211+0000 7fd65b7fe700 1 -- 172.21.15.146:0/958346441 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd66c006e40 con 0x7fd674133ad0 2023-10-03T10:16:16.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.216+0000 7fd65b7fe700 1 -- 172.21.15.146:0/958346441 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd66c019070 con 0x7fd674133ad0 2023-10-03T10:16:16.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.280+0000 7fb48b898700 1 Processor -- start 2023-10-03T10:16:16.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.280+0000 7fb48b898700 1 -- start start 2023-10-03T10:16:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.281+0000 7fb48b898700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb48409f350 0x7fb484136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.281+0000 7fb48b898700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4841371c0 0x7fb4841395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.281+0000 7fb48b898700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb48409c970 con 0x7fb48409e870 2023-10-03T10:16:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.281+0000 7fb48b898700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4840a0920 con 0x7fb48409f350 2023-10-03T10:16:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.281+0000 7fb48b898700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48409f9c0 con 0x7fb4841371c0 2023-10-03T10:16:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.281+0000 7fb488e33700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb48409f350 0x7fb484136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.281+0000 7fb489634700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb48409e870 0x7fb48409ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50288/0 (socket says 172.21.15.146:50288) 2023-10-03T10:16:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.281+0000 7fb489634700 1 -- 172.21.15.146:0/4067906322 learned_addr learned my addr 172.21.15.146:0/4067906322 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.281+0000 7fb489e35700 1 --2- 172.21.15.146:0/4067906322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4841371c0 0x7fb4841395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.282+0000 7fb488e33700 1 -- 172.21.15.146:0/4067906322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4841371c0 msgr2=0x7fb4841395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.282+0000 7fb488e33700 1 --2- 172.21.15.146:0/4067906322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4841371c0 0x7fb4841395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.282+0000 7fb488e33700 1 -- 172.21.15.146:0/4067906322 >> v1:172.21.15.146:6789/0 conn(0x7fb48409e870 legacy=0x7fb48409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.282+0000 7fb488e33700 1 -- 172.21.15.146:0/4067906322 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48409bab0 con 0x7fb48409f350 2023-10-03T10:16:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.282+0000 7fb47bfff700 1 -- 172.21.15.146:0/4067906322 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3946825727 0 0) 0x7fb48409c970 con 0x7fb48409e870 2023-10-03T10:16:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.282+0000 7fb488e33700 1 --2- 172.21.15.146:0/4067906322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb48409f350 0x7fb484136c80 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fb474009840 tx=0x7fb474009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1030c387a25d8b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.282+0000 7fb47bfff700 1 -- 172.21.15.146:0/4067906322 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb474011830 con 0x7fb48409f350 2023-10-03T10:16:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.282+0000 7fb47bfff700 1 -- 172.21.15.146:0/4067906322 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb474011990 con 0x7fb48409f350 2023-10-03T10:16:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.282+0000 7fb47bfff700 1 -- 172.21.15.146:0/4067906322 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb474011d20 con 0x7fb48409f350 2023-10-03T10:16:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.283+0000 7fb48b898700 1 -- 172.21.15.146:0/4067906322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb48409f350 msgr2=0x7fb484136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.283+0000 7fb48b898700 1 --2- 172.21.15.146:0/4067906322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb48409f350 0x7fb484136c80 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fb474009840 tx=0x7fb474009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:16.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.283+0000 7fb48b898700 1 -- 172.21.15.146:0/4067906322 shutdown_connections 2023-10-03T10:16:16.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.283+0000 7fb48b898700 1 --2- 172.21.15.146:0/4067906322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4841371c0 0x7fb4841395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.283+0000 7fb48b898700 1 --2- 172.21.15.146:0/4067906322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb48409f350 0x7fb484136c80 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.283+0000 7fb48b898700 1 -- 172.21.15.146:0/4067906322 >> 172.21.15.146:0/4067906322 conn(0x7fb4840a4430 msgr2=0x7fb4840a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.283+0000 7fb48b898700 1 -- 172.21.15.146:0/4067906322 shutdown_connections 2023-10-03T10:16:16.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.283+0000 7fb48b898700 1 -- 172.21.15.146:0/4067906322 wait complete. 2023-10-03T10:16:16.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.285+0000 7fb48b898700 1 Processor -- start 2023-10-03T10:16:16.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.285+0000 7fb48b898700 1 -- start start 2023-10-03T10:16:16.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.285+0000 7fb48b898700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb48409e870 0x7fb4841c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.285+0000 7fb48b898700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb48409f350 0x7fb4841c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.285+0000 7fb48b898700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4841371c0 0x7fb48411e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.285+0000 7fb48b898700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb484120430 con 0x7fb4841371c0 2023-10-03T10:16:16.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.285+0000 7fb48b898700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb484132250 con 0x7fb48409f350 2023-10-03T10:16:16.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.285+0000 7fb48b898700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4840a2e10 con 0x7fb48409e870 2023-10-03T10:16:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.286+0000 7fb489634700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb48409e870 0x7fb4841c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.286+0000 7fb488e33700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb48409f350 0x7fb4841c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.286+0000 7fb489634700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb48409e870 0x7fb4841c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57472/0 (socket says 172.21.15.146:57472) 2023-10-03T10:16:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.286+0000 7fb489634700 1 -- 172.21.15.146:0/2301246263 learned_addr learned my addr 172.21.15.146:0/2301246263 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:16.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.286+0000 7fb489e35700 1 --2- 172.21.15.146:0/2301246263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4841371c0 0x7fb48411e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.286+0000 7fb489634700 1 -- 172.21.15.146:0/2301246263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb48409f350 msgr2=0x7fb4841c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.286+0000 7fb489634700 1 --2- 172.21.15.146:0/2301246263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb48409f350 0x7fb4841c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.286+0000 7fb489634700 1 -- 172.21.15.146:0/2301246263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4841371c0 msgr2=0x7fb48411e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.286+0000 7fb489634700 1 --2- 172.21.15.146:0/2301246263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4841371c0 0x7fb48411e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.286+0000 7fb489634700 1 -- 172.21.15.146:0/2301246263 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4740094a0 con 0x7fb48409e870 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.286+0000 7fb488e33700 1 --2- 172.21.15.146:0/2301246263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb48409f350 0x7fb4841c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.286+0000 7fb489634700 1 --2- 172.21.15.146:0/2301246263 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb48409e870 0x7fb4841c8690 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb48000c520 tx=0x7fb48000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.286+0000 7fb479ffb700 1 -- 172.21.15.146:0/2301246263 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480004c80 con 0x7fb48409e870 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.286+0000 7fb479ffb700 1 -- 172.21.15.146:0/2301246263 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb480004de0 con 0x7fb48409e870 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.286+0000 7fb48b898700 1 -- 172.21.15.146:0/2301246263 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48409dba0 con 0x7fb48409e870 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.286+0000 7fb479ffb700 1 -- 172.21.15.146:0/2301246263 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480007310 con 0x7fb48409e870 2023-10-03T10:16:16.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.287+0000 7fb48b898700 1 -- 172.21.15.146:0/2301246263 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb484132620 con 0x7fb48409e870 2023-10-03T10:16:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.287+0000 7fb479ffb700 1 -- 172.21.15.146:0/2301246263 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb480007470 con 0x7fb48409e870 2023-10-03T10:16:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.288+0000 7fb479ffb700 1 -- 172.21.15.146:0/2301246263 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb48003f3b0 con 0x7fb48409e870 2023-10-03T10:16:16.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.288+0000 7fb48b898700 1 -- 172.21.15.146:0/2301246263 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48404f2a0 con 0x7fb48409e870 2023-10-03T10:16:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.296+0000 7fb479ffb700 1 -- 172.21.15.146:0/2301246263 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4800123b0 con 0x7fb48409e870 2023-10-03T10:16:16.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.312+0000 7fa8d7504700 1 Processor -- start 2023-10-03T10:16:16.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.312+0000 7fa8d7504700 1 -- start start 2023-10-03T10:16:16.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.313+0000 7fa8d7504700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8d0133a70 0x7fa8d0133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.313+0000 7fa8d7504700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa8d00a08e0 0x7fa8d00a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.313+0000 7fa8d7504700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8d00a1290 0x7fa8d013a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.313+0000 7fa8d7504700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d0133640 con 0x7fa8d00a08e0 2023-10-03T10:16:16.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.313+0000 7fa8d7504700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d00a1d50 con 0x7fa8d0133a70 2023-10-03T10:16:16.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.313+0000 7fa8d7504700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d009b620 con 0x7fa8d00a1290 2023-10-03T10:16:16.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.313+0000 7fa8d5aa1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8d00a1290 0x7fa8d013a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.313+0000 7fa8d52a0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8d0133a70 0x7fa8d0133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.313+0000 7fa8d5aa1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8d00a1290 0x7fa8d013a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57478/0 (socket says 172.21.15.146:57478) 2023-10-03T10:16:16.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.313+0000 7fa8d5aa1700 1 -- 172.21.15.146:0/4147898312 learned_addr learned my addr 172.21.15.146:0/4147898312 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:16.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.314+0000 7fa8d52a0700 1 -- 172.21.15.146:0/4147898312 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8d00a1290 msgr2=0x7fa8d013a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.314+0000 7fa8d52a0700 1 --2- 172.21.15.146:0/4147898312 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8d00a1290 0x7fa8d013a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.314+0000 7fa8d52a0700 1 -- 172.21.15.146:0/4147898312 >> v2:172.21.15.146:3300/0 conn(0x7fa8d00a08e0 msgr2=0x7fa8d00a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.314+0000 7fa8d52a0700 1 --2- 172.21.15.146:0/4147898312 >> v2:172.21.15.146:3300/0 conn(0x7fa8d00a08e0 0x7fa8d00a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.314+0000 7fa8d52a0700 1 -- 172.21.15.146:0/4147898312 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d0133870 con 0x7fa8d0133a70 2023-10-03T10:16:16.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.314+0000 7fa8d5aa1700 1 --2- 172.21.15.146:0/4147898312 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8d00a1290 0x7fa8d013a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:16.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.314+0000 7fa8d52a0700 1 --2- 172.21.15.146:0/4147898312 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8d0133a70 0x7fa8d0133e40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009820 tx=0x7fa8cc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ccc25c32a641cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.314+0000 7fa8c7fff700 1 -- 172.21.15.146:0/4147898312 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc005e30 con 0x7fa8d0133a70 2023-10-03T10:16:16.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.314+0000 7fa8c7fff700 1 -- 172.21.15.146:0/4147898312 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8cc006030 con 0x7fa8d0133a70 2023-10-03T10:16:16.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.314+0000 7fa8c7fff700 1 -- 172.21.15.146:0/4147898312 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc0063c0 con 0x7fa8d0133a70 2023-10-03T10:16:16.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.315+0000 7fa8d7504700 1 -- 172.21.15.146:0/4147898312 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8d0133a70 msgr2=0x7fa8d0133e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.315+0000 7fa8d7504700 1 --2- 172.21.15.146:0/4147898312 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8d0133a70 0x7fa8d0133e40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009820 tx=0x7fa8cc009b30 comp rx=0 tx=0).stop 2023-10-03T10:16:16.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.315+0000 7fa8d7504700 1 -- 172.21.15.146:0/4147898312 shutdown_connections 2023-10-03T10:16:16.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.315+0000 7fa8d7504700 1 --2- 172.21.15.146:0/4147898312 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8d0133a70 0x7fa8d0133e40 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.315+0000 7fa8d7504700 1 --2- 172.21.15.146:0/4147898312 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8d00a1290 0x7fa8d013a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.315+0000 7fa8d7504700 1 --2- 172.21.15.146:0/4147898312 >> v2:172.21.15.146:3300/0 conn(0x7fa8d00a08e0 0x7fa8d00a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.315+0000 7fa8d7504700 1 -- 172.21.15.146:0/4147898312 >> 172.21.15.146:0/4147898312 conn(0x7fa8d00a2980 msgr2=0x7fa8d00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.315+0000 7fa8d7504700 1 -- 172.21.15.146:0/4147898312 shutdown_connections 2023-10-03T10:16:16.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.315+0000 7fa8d7504700 1 -- 172.21.15.146:0/4147898312 wait complete. 2023-10-03T10:16:16.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.316+0000 7fa8d7504700 1 Processor -- start 2023-10-03T10:16:16.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.316+0000 7fa8d7504700 1 -- start start 2023-10-03T10:16:16.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.317+0000 7fa8d7504700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8d00a08e0 0x7fa8d011fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.317+0000 7fa8d7504700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8d00a1290 0x7fa8d011ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.317+0000 7fa8d7504700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8d0133a70 0x7fa8d0120490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.317+0000 7fa8d7504700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d01217a0 con 0x7fa8d00a08e0 2023-10-03T10:16:16.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.317+0000 7fa8d7504700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d01224b0 con 0x7fa8d0133a70 2023-10-03T10:16:16.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.317+0000 7fa8d7504700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d009a350 con 0x7fa8d00a1290 2023-10-03T10:16:16.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.317+0000 7fa8d5aa1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8d0133a70 0x7fa8d0120490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.317+0000 7fa8d4a9f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8d00a1290 0x7fa8d011ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.317+0000 7fa8d5aa1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8d0133a70 0x7fa8d0120490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43694/0 (socket says 172.21.15.146:43694) 2023-10-03T10:16:16.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.317+0000 7fa8d5aa1700 1 -- 172.21.15.146:0/294021924 learned_addr learned my addr 172.21.15.146:0/294021924 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:16.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.317+0000 7fa8d52a0700 1 --2- 172.21.15.146:0/294021924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8d00a08e0 0x7fa8d011fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.317+0000 7fa8d5aa1700 1 -- 172.21.15.146:0/294021924 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8d00a1290 msgr2=0x7fa8d011ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.317+0000 7fa8d5aa1700 1 --2- 172.21.15.146:0/294021924 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8d00a1290 0x7fa8d011ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.317+0000 7fa8d5aa1700 1 -- 172.21.15.146:0/294021924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8d00a08e0 msgr2=0x7fa8d011fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.317+0000 7fa8d5aa1700 1 --2- 172.21.15.146:0/294021924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8d00a08e0 0x7fa8d011fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.317+0000 7fa8d5aa1700 1 -- 172.21.15.146:0/294021924 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c8009b30 con 0x7fa8d0133a70 2023-10-03T10:16:16.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.317+0000 7fa8d52a0700 1 --2- 172.21.15.146:0/294021924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8d00a08e0 0x7fa8d011fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:16.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.318+0000 7fa8d5aa1700 1 --2- 172.21.15.146:0/294021924 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8d0133a70 0x7fa8d0120490 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800b6f0 tx=0x7fa8c800ba00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.318+0000 7fa8c5ffb700 1 -- 172.21.15.146:0/294021924 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8019070 con 0x7fa8d0133a70 2023-10-03T10:16:16.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.318+0000 7fa8c5ffb700 1 -- 172.21.15.146:0/294021924 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c80092e0 con 0x7fa8d0133a70 2023-10-03T10:16:16.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.318+0000 7fa8c5ffb700 1 -- 172.21.15.146:0/294021924 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8003c20 con 0x7fa8d0133a70 2023-10-03T10:16:16.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.318+0000 7fa8d7504700 1 -- 172.21.15.146:0/294021924 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8cc009430 con 0x7fa8d0133a70 2023-10-03T10:16:16.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.319+0000 7fa8d7504700 1 -- 172.21.15.146:0/294021924 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d0122f90 con 0x7fa8d0133a70 2023-10-03T10:16:16.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.320+0000 7fa8c5ffb700 1 -- 172.21.15.146:0/294021924 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa8c801d410 con 0x7fa8d0133a70 2023-10-03T10:16:16.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.320+0000 7fa8d7504700 1 -- 172.21.15.146:0/294021924 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d004f2a0 con 0x7fa8d0133a70 2023-10-03T10:16:16.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.320+0000 7fa8c5ffb700 1 -- 172.21.15.146:0/294021924 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa8c8047750 con 0x7fa8d0133a70 2023-10-03T10:16:16.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.326+0000 7fbacb72a700 1 Processor -- start 2023-10-03T10:16:16.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.326+0000 7fbacb72a700 1 -- start start 2023-10-03T10:16:16.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.327+0000 7fbacb72a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbac4138040 0x7fbac4138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.327+0000 7fbacb72a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbac40a08e0 0x7fbac40a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.327+0000 7fbacb72a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac41379e0 con 0x7fbac40a1230 2023-10-03T10:16:16.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.327+0000 7fbacb72a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac40a2100 con 0x7fbac4138040 2023-10-03T10:16:16.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.327+0000 7fbacb72a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbac4138950 con 0x7fbac40a08e0 2023-10-03T10:16:16.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.327+0000 7fbac8cc5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbac40a08e0 0x7fbac40a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.327+0000 7fbac8cc5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbac40a08e0 0x7fbac40a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57502/0 (socket says 172.21.15.146:57502) 2023-10-03T10:16:16.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.327+0000 7fbac8cc5700 1 -- 172.21.15.146:0/1969603176 learned_addr learned my addr 172.21.15.146:0/1969603176 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:16.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.327+0000 7fbac94c6700 1 --2- 172.21.15.146:0/1969603176 >> v2:172.21.15.146:3300/0 conn(0x7fbac4138040 0x7fbac4138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.327+0000 7fbac8cc5700 1 -- 172.21.15.146:0/1969603176 >> v2:172.21.15.146:3300/0 conn(0x7fbac4138040 msgr2=0x7fbac4138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.327+0000 7fbac8cc5700 1 --2- 172.21.15.146:0/1969603176 >> v2:172.21.15.146:3300/0 conn(0x7fbac4138040 0x7fbac4138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.327+0000 7fbac8cc5700 1 -- 172.21.15.146:0/1969603176 >> v1:172.21.15.146:6789/0 conn(0x7fbac40a1230 legacy=0x7fbac413ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.327+0000 7fbac8cc5700 1 -- 172.21.15.146:0/1969603176 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac409b9b0 con 0x7fbac40a08e0 2023-10-03T10:16:16.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.327+0000 7fbac8cc5700 1 --2- 172.21.15.146:0/1969603176 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbac40a08e0 0x7fbac40a0cf0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009920 tx=0x7fbab4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6aa6b9742550cfa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.328+0000 7fbabbfff700 1 -- 172.21.15.146:0/1969603176 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab400ba20 con 0x7fbac40a08e0 2023-10-03T10:16:16.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.328+0000 7fbabbfff700 1 -- 172.21.15.146:0/1969603176 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab400bb80 con 0x7fbac40a08e0 2023-10-03T10:16:16.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.328+0000 7fbabbfff700 1 -- 172.21.15.146:0/1969603176 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab4009e70 con 0x7fbac40a08e0 2023-10-03T10:16:16.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.328+0000 7fbacb72a700 1 -- 172.21.15.146:0/1969603176 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbac40a08e0 msgr2=0x7fbac40a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.328+0000 7fbacb72a700 1 --2- 172.21.15.146:0/1969603176 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbac40a08e0 0x7fbac40a0cf0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009920 tx=0x7fbab4009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:16.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.328+0000 7fbacb72a700 1 -- 172.21.15.146:0/1969603176 shutdown_connections 2023-10-03T10:16:16.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.328+0000 7fbacb72a700 1 --2- 172.21.15.146:0/1969603176 >> v2:172.21.15.146:3300/0 conn(0x7fbac4138040 0x7fbac4138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.328+0000 7fbacb72a700 1 --2- 172.21.15.146:0/1969603176 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbac40a08e0 0x7fbac40a0cf0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.328+0000 7fbacb72a700 1 -- 172.21.15.146:0/1969603176 >> 172.21.15.146:0/1969603176 conn(0x7fbac40a2980 msgr2=0x7fbac40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.328+0000 7fbacb72a700 1 -- 172.21.15.146:0/1969603176 shutdown_connections 2023-10-03T10:16:16.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.328+0000 7fbacb72a700 1 -- 172.21.15.146:0/1969603176 wait complete. 2023-10-03T10:16:16.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.329+0000 7fa8c5ffb700 1 -- 172.21.15.146:0/294021924 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa8c801b900 con 0x7fa8d0133a70 2023-10-03T10:16:16.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.329+0000 7fbacb72a700 1 Processor -- start 2023-10-03T10:16:16.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.329+0000 7fbacb72a700 1 -- start start 2023-10-03T10:16:16.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.330+0000 7fbacb72a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbac40a08e0 0x7fbac4126640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.330+0000 7fbacb72a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbac40a1230 0x7fbac4126b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.330+0000 7fbacb72a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbac4138040 0x7fbac41270c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.330+0000 7fbacb72a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac409a240 con 0x7fbac40a08e0 2023-10-03T10:16:16.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.330+0000 7fbacb72a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac41298a0 con 0x7fbac40a1230 2023-10-03T10:16:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.330+0000 7fbacb72a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbac4127ff0 con 0x7fbac4138040 2023-10-03T10:16:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.330+0000 7fbac9cc7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbac4138040 0x7fbac41270c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.330+0000 7fbac9cc7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbac4138040 0x7fbac41270c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57512/0 (socket says 172.21.15.146:57512) 2023-10-03T10:16:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.330+0000 7fbac9cc7700 1 -- 172.21.15.146:0/233224212 learned_addr learned my addr 172.21.15.146:0/233224212 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.330+0000 7fbac9cc7700 1 -- 172.21.15.146:0/233224212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbac40a1230 msgr2=0x7fbac4126b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.330+0000 7fbac9cc7700 1 --2- 172.21.15.146:0/233224212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbac40a1230 0x7fbac4126b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.330+0000 7fbac9cc7700 1 -- 172.21.15.146:0/233224212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbac40a08e0 msgr2=0x7fbac4126640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:16:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.330+0000 7fbac9cc7700 1 --2- 172.21.15.146:0/233224212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbac40a08e0 0x7fbac4126640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.330+0000 7fbac9cc7700 1 -- 172.21.15.146:0/233224212 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab4009550 con 0x7fbac4138040 2023-10-03T10:16:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.330+0000 7fbac9cc7700 1 --2- 172.21.15.146:0/233224212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbac4138040 0x7fbac41270c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbabc00cb50 tx=0x7fbabc00cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.331+0000 7fbab9ffb700 1 -- 172.21.15.146:0/233224212 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc003c00 con 0x7fbac4138040 2023-10-03T10:16:16.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.331+0000 7fbab9ffb700 1 -- 172.21.15.146:0/233224212 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbabc003d60 con 0x7fbac4138040 2023-10-03T10:16:16.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.331+0000 7fbab9ffb700 1 -- 172.21.15.146:0/233224212 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc00ab70 con 0x7fbac4138040 2023-10-03T10:16:16.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.331+0000 7fbacb72a700 1 -- 172.21.15.146:0/233224212 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac4129e40 con 0x7fbac4138040 2023-10-03T10:16:16.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.331+0000 7fbacb72a700 1 -- 172.21.15.146:0/233224212 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac412a5d0 con 0x7fbac4138040 2023-10-03T10:16:16.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.332+0000 7fbacb72a700 1 -- 172.21.15.146:0/233224212 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac4122da0 con 0x7fbac4138040 2023-10-03T10:16:16.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.332+0000 7fbab9ffb700 1 -- 172.21.15.146:0/233224212 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbabc00acd0 con 0x7fbac4138040 2023-10-03T10:16:16.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.332+0000 7fbab9ffb700 1 -- 172.21.15.146:0/233224212 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbabc03f8b0 con 0x7fbac4138040 2023-10-03T10:16:16.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.337+0000 7fbab9ffb700 1 -- 172.21.15.146:0/233224212 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbabc0196c0 con 0x7fbac4138040 2023-10-03T10:16:16.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.418+0000 7fd6795a9700 1 -- 172.21.15.146:0/958346441 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd67404f2a0 con 0x7fd674133ad0 2023-10-03T10:16:16.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.419+0000 7fd65b7fe700 1 -- 172.21.15.146:0/958346441 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd66c01c360 con 0x7fd674133ad0 2023-10-03T10:16:16.419 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:16.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.421+0000 7fd6795a9700 1 -- 172.21.15.146:0/958346441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd674133ad0 msgr2=0x7fd67411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.421+0000 7fd6795a9700 1 --2- 172.21.15.146:0/958346441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd674133ad0 0x7fd67411e4c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd66c00be20 tx=0x7fd66c009ed0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.421+0000 7fd6795a9700 1 -- 172.21.15.146:0/958346441 shutdown_connections 2023-10-03T10:16:16.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.421+0000 7fd6795a9700 1 --2- 172.21.15.146:0/958346441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd674133ad0 0x7fd67411e4c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.421+0000 7fd6795a9700 1 --2- 172.21.15.146:0/958346441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6741300a0 0x7fd67411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.421+0000 7fd6795a9700 1 --2- 172.21.15.146:0/958346441 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6741309f0 0x7fd67411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.421+0000 7fd6795a9700 1 -- 172.21.15.146:0/958346441 >> 172.21.15.146:0/958346441 conn(0x7fd674099c40 msgr2=0x7fd674132140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.421+0000 7fd6795a9700 1 -- 172.21.15.146:0/958346441 shutdown_connections 2023-10-03T10:16:16.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.421+0000 7fd6795a9700 1 -- 172.21.15.146:0/958346441 wait complete. 2023-10-03T10:16:16.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:16.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.523+0000 7fb48b898700 1 -- 172.21.15.146:0/2301246263 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb48406b2a0 con 0x7fb48409e870 2023-10-03T10:16:16.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.524+0000 7fb479ffb700 1 -- 172.21.15.146:0/2301246263 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb4800102c0 con 0x7fb48409e870 2023-10-03T10:16:16.524 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:16.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.526+0000 7fb48b898700 1 -- 172.21.15.146:0/2301246263 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb48409e870 msgr2=0x7fb4841c8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.526+0000 7fb48b898700 1 --2- 172.21.15.146:0/2301246263 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb48409e870 0x7fb4841c8690 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb48000c520 tx=0x7fb48000c830 comp rx=0 tx=0).stop 2023-10-03T10:16:16.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.526+0000 7fb48b898700 1 -- 172.21.15.146:0/2301246263 shutdown_connections 2023-10-03T10:16:16.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.526+0000 7fb48b898700 1 --2- 172.21.15.146:0/2301246263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4841371c0 0x7fb48411e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.526+0000 7fb48b898700 1 --2- 172.21.15.146:0/2301246263 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb48409e870 0x7fb4841c8690 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.526+0000 7fb48b898700 1 --2- 172.21.15.146:0/2301246263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb48409f350 0x7fb4841c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.526+0000 7fb48b898700 1 -- 172.21.15.146:0/2301246263 >> 172.21.15.146:0/2301246263 conn(0x7fb4840a4430 msgr2=0x7fb48409c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.526+0000 7fb48b898700 1 -- 172.21.15.146:0/2301246263 shutdown_connections 2023-10-03T10:16:16.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.526+0000 7fb48b898700 1 -- 172.21.15.146:0/2301246263 wait complete. 2023-10-03T10:16:16.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.530+0000 7fbacb72a700 1 -- 172.21.15.146:0/233224212 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbac404f2a0 con 0x7fbac4138040 2023-10-03T10:16:16.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.530+0000 7fbab9ffb700 1 -- 172.21.15.146:0/233224212 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbabc011380 con 0x7fbac4138040 2023-10-03T10:16:16.531 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:16.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.533+0000 7fbacb72a700 1 -- 172.21.15.146:0/233224212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbac4138040 msgr2=0x7fbac41270c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.533+0000 7fbacb72a700 1 --2- 172.21.15.146:0/233224212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbac4138040 0x7fbac41270c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbabc00cb50 tx=0x7fbabc00cf10 comp rx=0 tx=0).stop 2023-10-03T10:16:16.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.533+0000 7fbacb72a700 1 -- 172.21.15.146:0/233224212 shutdown_connections 2023-10-03T10:16:16.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.533+0000 7fbacb72a700 1 --2- 172.21.15.146:0/233224212 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbac4138040 0x7fbac41270c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.533+0000 7fbacb72a700 1 --2- 172.21.15.146:0/233224212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbac40a08e0 0x7fbac4126640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.533+0000 7fbacb72a700 1 --2- 172.21.15.146:0/233224212 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbac40a1230 0x7fbac4126b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.533+0000 7fbacb72a700 1 -- 172.21.15.146:0/233224212 >> 172.21.15.146:0/233224212 conn(0x7fbac40a2980 msgr2=0x7fbac4071890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.533+0000 7fbacb72a700 1 -- 172.21.15.146:0/233224212 shutdown_connections 2023-10-03T10:16:16.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.533+0000 7fbacb72a700 1 -- 172.21.15.146:0/233224212 wait complete. 2023-10-03T10:16:16.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:16.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.546+0000 7fa8d7504700 1 -- 172.21.15.146:0/294021924 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa8d006bce0 con 0x7fa8d0133a70 2023-10-03T10:16:16.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.546+0000 7fa8c5ffb700 1 -- 172.21.15.146:0/294021924 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa8c8024310 con 0x7fa8d0133a70 2023-10-03T10:16:16.547 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:16.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:16.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.548+0000 7fa8d7504700 1 -- 172.21.15.146:0/294021924 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8d0133a70 msgr2=0x7fa8d0120490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.548+0000 7fa8d7504700 1 --2- 172.21.15.146:0/294021924 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8d0133a70 0x7fa8d0120490 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800b6f0 tx=0x7fa8c800ba00 comp rx=0 tx=0).stop 2023-10-03T10:16:16.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.548+0000 7fa8d7504700 1 -- 172.21.15.146:0/294021924 shutdown_connections 2023-10-03T10:16:16.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.548+0000 7fa8d7504700 1 --2- 172.21.15.146:0/294021924 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8d0133a70 0x7fa8d0120490 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.548+0000 7fa8d7504700 1 --2- 172.21.15.146:0/294021924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8d00a08e0 0x7fa8d011fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.548+0000 7fa8d7504700 1 --2- 172.21.15.146:0/294021924 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8d00a1290 0x7fa8d011ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.548+0000 7fa8d7504700 1 -- 172.21.15.146:0/294021924 >> 172.21.15.146:0/294021924 conn(0x7fa8d00a2980 msgr2=0x7fa8d009e320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.548+0000 7fa8d7504700 1 -- 172.21.15.146:0/294021924 shutdown_connections 2023-10-03T10:16:16.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:16.548+0000 7fa8d7504700 1 -- 172.21.15.146:0/294021924 wait complete. 2023-10-03T10:16:16.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:17.435 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:17.541 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:17.549 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:17.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.558+0000 7f8b819d1700 1 Processor -- start 2023-10-03T10:16:17.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.558+0000 7f8b819d1700 1 -- start start 2023-10-03T10:16:17.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.559+0000 7f8b819d1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8b7c09e870 0x7f8b7c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.559+0000 7f8b819d1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b7c09f180 0x7f8b7c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.559+0000 7f8b819d1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b7c09c970 con 0x7f8b7c131d70 2023-10-03T10:16:17.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.559+0000 7f8b819d1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b7c0a0920 con 0x7f8b7c09e870 2023-10-03T10:16:17.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.559+0000 7f8b819d1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c09f9c0 con 0x7f8b7c09f180 2023-10-03T10:16:17.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.559+0000 7f8b7affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8b7c09e870 0x7f8b7c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.559+0000 7f8b7a7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b7c09f180 0x7f8b7c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.559+0000 7f8b7b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8b7c131d70 0x7f8b7c138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50310/0 (socket says 172.21.15.146:50310) 2023-10-03T10:16:17.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.559+0000 7f8b7b7fe700 1 -- 172.21.15.146:0/2890593583 learned_addr learned my addr 172.21.15.146:0/2890593583 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:17.561 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:17.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.560+0000 7f8b7affd700 1 -- 172.21.15.146:0/2890593583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b7c09f180 msgr2=0x7f8b7c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.560+0000 7f8b7affd700 1 --2- 172.21.15.146:0/2890593583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b7c09f180 0x7f8b7c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.560+0000 7f8b7affd700 1 -- 172.21.15.146:0/2890593583 >> v1:172.21.15.146:6789/0 conn(0x7f8b7c131d70 legacy=0x7f8b7c138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.560+0000 7f8b79ffb700 1 -- 172.21.15.146:0/2890593583 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1422016144 0 0) 0x7f8b7c09c970 con 0x7f8b7c131d70 2023-10-03T10:16:17.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.560+0000 7f8b7affd700 1 -- 172.21.15.146:0/2890593583 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7c09bab0 con 0x7f8b7c09e870 2023-10-03T10:16:17.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.560+0000 7f8b7affd700 1 --2- 172.21.15.146:0/2890593583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b7c09e870 0x7f8b7c09ec40 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c009840 tx=0x7f8b6c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6d3d50c9f5f23d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.560+0000 7f8b79ffb700 1 -- 172.21.15.146:0/2890593583 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c011830 con 0x7f8b7c09e870 2023-10-03T10:16:17.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.560+0000 7f8b79ffb700 1 -- 172.21.15.146:0/2890593583 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6c011990 con 0x7f8b7c09e870 2023-10-03T10:16:17.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.560+0000 7f8b79ffb700 1 -- 172.21.15.146:0/2890593583 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c011d20 con 0x7f8b7c09e870 2023-10-03T10:16:17.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.561+0000 7f8b819d1700 1 -- 172.21.15.146:0/2890593583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b7c09e870 msgr2=0x7f8b7c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.561+0000 7f8b819d1700 1 --2- 172.21.15.146:0/2890593583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b7c09e870 0x7f8b7c09ec40 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c009840 tx=0x7f8b6c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:17.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.561+0000 7f8b819d1700 1 -- 172.21.15.146:0/2890593583 shutdown_connections 2023-10-03T10:16:17.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.561+0000 7f8b819d1700 1 --2- 172.21.15.146:0/2890593583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b7c09e870 0x7f8b7c09ec40 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.561+0000 7f8b819d1700 1 --2- 172.21.15.146:0/2890593583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b7c09f180 0x7f8b7c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.561+0000 7f8b819d1700 1 -- 172.21.15.146:0/2890593583 >> 172.21.15.146:0/2890593583 conn(0x7f8b7c0a4430 msgr2=0x7f8b7c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.561+0000 7f8b819d1700 1 -- 172.21.15.146:0/2890593583 shutdown_connections 2023-10-03T10:16:17.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.561+0000 7f8b819d1700 1 -- 172.21.15.146:0/2890593583 wait complete. 2023-10-03T10:16:17.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.562+0000 7f8b819d1700 1 Processor -- start 2023-10-03T10:16:17.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.562+0000 7f8b819d1700 1 -- start start 2023-10-03T10:16:17.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.562+0000 7f8b819d1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b7c09e870 0x7f8b7c1b8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.562+0000 7f8b819d1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b7c09f180 0x7f8b7c1b94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.562+0000 7f8b819d1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b7c131d70 0x7f8b7c1b9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.562+0000 7f8b819d1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c1ba480 con 0x7f8b7c09f180 2023-10-03T10:16:17.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.562+0000 7f8b819d1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c1207c0 con 0x7f8b7c131d70 2023-10-03T10:16:17.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.562+0000 7f8b819d1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c11fb20 con 0x7f8b7c09e870 2023-10-03T10:16:17.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.563+0000 7f8b7a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b7c09f180 0x7f8b7c1b94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.563+0000 7f8b7b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b7c131d70 0x7f8b7c1b9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.563+0000 7f8b7a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b7c09f180 0x7f8b7c1b94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56242/0 (socket says 172.21.15.146:56242) 2023-10-03T10:16:17.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.563+0000 7f8b7a7fc700 1 -- 172.21.15.146:0/2357834326 learned_addr learned my addr 172.21.15.146:0/2357834326 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:17.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.563+0000 7f8b7affd700 1 --2- 172.21.15.146:0/2357834326 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b7c09e870 0x7f8b7c1b8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.563+0000 7f8b7a7fc700 1 -- 172.21.15.146:0/2357834326 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b7c09e870 msgr2=0x7f8b7c1b8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.563+0000 7f8b7a7fc700 1 --2- 172.21.15.146:0/2357834326 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b7c09e870 0x7f8b7c1b8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.563+0000 7f8b7a7fc700 1 -- 172.21.15.146:0/2357834326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b7c131d70 msgr2=0x7f8b7c1b9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.563+0000 7f8b7a7fc700 1 --2- 172.21.15.146:0/2357834326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b7c131d70 0x7f8b7c1b9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.563+0000 7f8b7a7fc700 1 -- 172.21.15.146:0/2357834326 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c0094a0 con 0x7f8b7c09f180 2023-10-03T10:16:17.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.563+0000 7f8b7b7fe700 1 --2- 172.21.15.146:0/2357834326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b7c131d70 0x7f8b7c1b9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.563+0000 7f8b7a7fc700 1 --2- 172.21.15.146:0/2357834326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b7c09f180 0x7f8b7c1b94f0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000e9e0 tx=0x7f8b7000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.563+0000 7f8b63fff700 1 -- 172.21.15.146:0/2357834326 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b70009710 con 0x7f8b7c09f180 2023-10-03T10:16:17.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.563+0000 7f8b63fff700 1 -- 172.21.15.146:0/2357834326 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7000ee80 con 0x7f8b7c09f180 2023-10-03T10:16:17.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.563+0000 7f8b819d1700 1 -- 172.21.15.146:0/2357834326 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b7c1bacd0 con 0x7f8b7c09f180 2023-10-03T10:16:17.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.563+0000 7f8b63fff700 1 -- 172.21.15.146:0/2357834326 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7000ca50 con 0x7f8b7c09f180 2023-10-03T10:16:17.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.564+0000 7f8b819d1700 1 -- 172.21.15.146:0/2357834326 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7c11fe00 con 0x7f8b7c09f180 2023-10-03T10:16:17.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.564+0000 7f8b63fff700 1 -- 172.21.15.146:0/2357834326 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8b7000cbb0 con 0x7f8b7c09f180 2023-10-03T10:16:17.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.564+0000 7f8b63fff700 1 -- 172.21.15.146:0/2357834326 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8b7003f720 con 0x7f8b7c09f180 2023-10-03T10:16:17.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.565+0000 7f8b819d1700 1 -- 172.21.15.146:0/2357834326 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b7c11fc60 con 0x7f8b7c09f180 2023-10-03T10:16:17.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.571+0000 7f8b63fff700 1 -- 172.21.15.146:0/2357834326 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b7c11fc60 con 0x7f8b7c09f180 2023-10-03T10:16:17.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.673+0000 7f9319777700 1 Processor -- start 2023-10-03T10:16:17.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.673+0000 7f9319777700 1 -- start start 2023-10-03T10:16:17.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.674+0000 7f9319777700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9314133b80 0x7f9314133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.674+0000 7f9319777700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f93140a0ff0 0x7f931413b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.674+0000 7f9319777700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f931409aa00 con 0x7f9314099a60 2023-10-03T10:16:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.674+0000 7f9319777700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931409a080 con 0x7f9314133b80 2023-10-03T10:16:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.674+0000 7f9319777700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9314133750 con 0x7f93140a0ff0 2023-10-03T10:16:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.674+0000 7f93127fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9314099a60 0x7f93140a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50322/0 (socket says 172.21.15.146:50322) 2023-10-03T10:16:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.674+0000 7f93127fc700 1 -- 172.21.15.146:0/2239803236 learned_addr learned my addr 172.21.15.146:0/2239803236 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.674+0000 7f9312ffd700 1 --2- 172.21.15.146:0/2239803236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9314133b80 0x7f9314133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.674+0000 7f93137fe700 1 --2- 172.21.15.146:0/2239803236 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f93140a0ff0 0x7f931413b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.674+0000 7f9311ffb700 1 -- 172.21.15.146:0/2239803236 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1897824813 0 0) 0x7f931409aa00 con 0x7f9314099a60 2023-10-03T10:16:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.674+0000 7f9311ffb700 1 -- 172.21.15.146:0/2239803236 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92fc0035b0 con 0x7f9314099a60 2023-10-03T10:16:17.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.674+0000 7f9312ffd700 1 -- 172.21.15.146:0/2239803236 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f93140a0ff0 msgr2=0x7f931413b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.674+0000 7f9312ffd700 1 --2- 172.21.15.146:0/2239803236 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f93140a0ff0 0x7f931413b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.674+0000 7f9312ffd700 1 -- 172.21.15.146:0/2239803236 >> v1:172.21.15.146:6789/0 conn(0x7f9314099a60 legacy=0x7f93140a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.675+0000 7f9312ffd700 1 -- 172.21.15.146:0/2239803236 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931409a760 con 0x7f9314133b80 2023-10-03T10:16:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.675+0000 7f93137fe700 1 --2- 172.21.15.146:0/2239803236 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f93140a0ff0 0x7f931413b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.675+0000 7f9312ffd700 1 --2- 172.21.15.146:0/2239803236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9314133b80 0x7f9314133f50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9304009850 tx=0x7f9304009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bad545dd2472d46 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.675+0000 7f9311ffb700 1 -- 172.21.15.146:0/2239803236 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9304005e30 con 0x7f9314133b80 2023-10-03T10:16:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.675+0000 7f9311ffb700 1 -- 172.21.15.146:0/2239803236 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9304006030 con 0x7f9314133b80 2023-10-03T10:16:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.675+0000 7f9311ffb700 1 -- 172.21.15.146:0/2239803236 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93040063e0 con 0x7f9314133b80 2023-10-03T10:16:17.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.676+0000 7f9319777700 1 -- 172.21.15.146:0/2239803236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9314133b80 msgr2=0x7f9314133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.676+0000 7f9319777700 1 --2- 172.21.15.146:0/2239803236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9314133b80 0x7f9314133f50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9304009850 tx=0x7f9304009b60 comp rx=0 tx=0).stop 2023-10-03T10:16:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.676+0000 7f9319777700 1 -- 172.21.15.146:0/2239803236 shutdown_connections 2023-10-03T10:16:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.676+0000 7f9319777700 1 --2- 172.21.15.146:0/2239803236 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f93140a0ff0 0x7f931413b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.676+0000 7f9319777700 1 --2- 172.21.15.146:0/2239803236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9314133b80 0x7f9314133f50 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.676+0000 7f9319777700 1 -- 172.21.15.146:0/2239803236 >> 172.21.15.146:0/2239803236 conn(0x7f93140a2980 msgr2=0x7f93140a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.676+0000 7f9319777700 1 -- 172.21.15.146:0/2239803236 shutdown_connections 2023-10-03T10:16:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.676+0000 7f9319777700 1 -- 172.21.15.146:0/2239803236 wait complete. 2023-10-03T10:16:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.677+0000 7f9319777700 1 Processor -- start 2023-10-03T10:16:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.677+0000 7f9319777700 1 -- start start 2023-10-03T10:16:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.677+0000 7f9319777700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9314099a60 0x7f931411c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.677+0000 7f9319777700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93140a0ff0 0x7f931411cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.677+0000 7f9319777700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9314133b80 0x7f931411d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.677+0000 7f9319777700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9314120350 con 0x7f93140a0ff0 2023-10-03T10:16:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.677+0000 7f9319777700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93141309b0 con 0x7f9314133b80 2023-10-03T10:16:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.677+0000 7f9319777700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f931411dcc0 con 0x7f9314099a60 2023-10-03T10:16:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.677+0000 7f93127fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93140a0ff0 0x7f931411cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.677+0000 7f93127fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93140a0ff0 0x7f931411cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56256/0 (socket says 172.21.15.146:56256) 2023-10-03T10:16:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.677+0000 7f93127fc700 1 -- 172.21.15.146:0/2700731521 learned_addr learned my addr 172.21.15.146:0/2700731521 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.677+0000 7f93137fe700 1 --2- 172.21.15.146:0/2700731521 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9314133b80 0x7f931411d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.678+0000 7f9312ffd700 1 --2- 172.21.15.146:0/2700731521 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9314099a60 0x7f931411c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.678+0000 7f93127fc700 1 -- 172.21.15.146:0/2700731521 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9314099a60 msgr2=0x7f931411c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.678+0000 7f93127fc700 1 --2- 172.21.15.146:0/2700731521 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9314099a60 0x7f931411c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.678+0000 7f93127fc700 1 -- 172.21.15.146:0/2700731521 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9314133b80 msgr2=0x7f931411d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.678+0000 7f93127fc700 1 --2- 172.21.15.146:0/2700731521 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9314133b80 0x7f931411d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.678+0000 7f93127fc700 1 -- 172.21.15.146:0/2700731521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c009a70 con 0x7f93140a0ff0 2023-10-03T10:16:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.678+0000 7f93137fe700 1 --2- 172.21.15.146:0/2700731521 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9314133b80 0x7f931411d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.678+0000 7f93127fc700 1 --2- 172.21.15.146:0/2700731521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93140a0ff0 0x7f931411cdc0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f930800c460 tx=0x7f930800c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.678+0000 7f92fb7fe700 1 -- 172.21.15.146:0/2700731521 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930800cea0 con 0x7f93140a0ff0 2023-10-03T10:16:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.678+0000 7f92fb7fe700 1 -- 172.21.15.146:0/2700731521 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9308005d70 con 0x7f93140a0ff0 2023-10-03T10:16:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.678+0000 7f9319777700 1 -- 172.21.15.146:0/2700731521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9304009430 con 0x7f93140a0ff0 2023-10-03T10:16:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.678+0000 7f92fb7fe700 1 -- 172.21.15.146:0/2700731521 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93080072f0 con 0x7f93140a0ff0 2023-10-03T10:16:17.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.678+0000 7f9319777700 1 -- 172.21.15.146:0/2700731521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f931409a2c0 con 0x7f93140a0ff0 2023-10-03T10:16:17.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.679+0000 7f92fb7fe700 1 -- 172.21.15.146:0/2700731521 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9308007450 con 0x7f93140a0ff0 2023-10-03T10:16:17.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.680+0000 7f92fb7fe700 1 -- 172.21.15.146:0/2700731521 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f930803e6f0 con 0x7f93140a0ff0 2023-10-03T10:16:17.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.680+0000 7f9319777700 1 -- 172.21.15.146:0/2700731521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f931411e4a0 con 0x7f93140a0ff0 2023-10-03T10:16:17.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.684+0000 7f92fb7fe700 1 -- 172.21.15.146:0/2700731521 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9308017080 con 0x7f93140a0ff0 2023-10-03T10:16:17.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.691+0000 7fdb19587700 1 Processor -- start 2023-10-03T10:16:17.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.691+0000 7f0987950700 1 Processor -- start 2023-10-03T10:16:17.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.691+0000 7fdb19587700 1 -- start start 2023-10-03T10:16:17.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.692+0000 7f0987950700 1 -- start start 2023-10-03T10:16:17.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.692+0000 7fdb19587700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdb14098410 0x7fdb140987e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.692+0000 7fdb19587700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb1409e440 0x7fdb141397e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.692+0000 7fdb19587700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1406f970 con 0x7fdb1409d8f0 2023-10-03T10:16:17.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.692+0000 7fdb19587700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb140720a0 con 0x7fdb14098410 2023-10-03T10:16:17.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.692+0000 7fdb19587700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb14072290 con 0x7fdb1409e440 2023-10-03T10:16:17.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.692+0000 7fdb127fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdb1409d8f0 0x7fdb1409dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50330/0 (socket says 172.21.15.146:50330) 2023-10-03T10:16:17.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.692+0000 7fdb127fc700 1 -- 172.21.15.146:0/3753537714 learned_addr learned my addr 172.21.15.146:0/3753537714 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:17.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.692+0000 7fdb137fe700 1 --2- 172.21.15.146:0/3753537714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb1409e440 0x7fdb141397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.692+0000 7f0987950700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09801309f0 0x7f0980130dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.692+0000 7f0987950700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f098009e450 0x7f0980138760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.692+0000 7f0987950700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098009c1f0 con 0x7f098009d8f0 2023-10-03T10:16:17.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.692+0000 7f0987950700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098009b1f0 con 0x7f09801309f0 2023-10-03T10:16:17.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.692+0000 7f0987950700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0980131300 con 0x7f098009e450 2023-10-03T10:16:17.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.693+0000 7fdb137fe700 1 -- 172.21.15.146:0/3753537714 >> v2:172.21.15.146:3300/0 conn(0x7fdb14098410 msgr2=0x7fdb140987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.693+0000 7fdb137fe700 1 --2- 172.21.15.146:0/3753537714 >> v2:172.21.15.146:3300/0 conn(0x7fdb14098410 0x7fdb140987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.693+0000 7fdb137fe700 1 -- 172.21.15.146:0/3753537714 >> v1:172.21.15.146:6789/0 conn(0x7fdb1409d8f0 legacy=0x7fdb1409dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.693+0000 7fdb137fe700 1 -- 172.21.15.146:0/3753537714 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb14071530 con 0x7fdb1409e440 2023-10-03T10:16:17.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.693+0000 7f09856ec700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09801309f0 0x7f0980130dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.693+0000 7f09856ec700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09801309f0 0x7f0980130dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43750/0 (socket says 172.21.15.146:43750) 2023-10-03T10:16:17.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.693+0000 7f09856ec700 1 -- 172.21.15.146:0/1236733183 learned_addr learned my addr 172.21.15.146:0/1236733183 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:17.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.693+0000 7f0985eed700 1 --2- 172.21.15.146:0/1236733183 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f098009e450 0x7f0980138760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.693+0000 7f09856ec700 1 -- 172.21.15.146:0/1236733183 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f098009e450 msgr2=0x7f0980138760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.693+0000 7f09856ec700 1 --2- 172.21.15.146:0/1236733183 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f098009e450 0x7f0980138760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.693+0000 7f09856ec700 1 -- 172.21.15.146:0/1236733183 >> v1:172.21.15.146:6789/0 conn(0x7f098009d8f0 legacy=0x7f098009dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.693+0000 7f09856ec700 1 -- 172.21.15.146:0/1236733183 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09801305a0 con 0x7f09801309f0 2023-10-03T10:16:17.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.693+0000 7f09856ec700 1 --2- 172.21.15.146:0/1236733183 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09801309f0 0x7f0980130dc0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f097c00bb90 tx=0x7f097c00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb6a3d246a031daa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.693+0000 7fdb137fe700 1 --2- 172.21.15.146:0/3753537714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb1409e440 0x7fdb141397e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c009d90 tx=0x7fdb0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85a4fd8c8f7284be server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.693+0000 7f0977fff700 1 -- 172.21.15.146:0/1236733183 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c005e30 con 0x7f09801309f0 2023-10-03T10:16:17.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.693+0000 7f0977fff700 1 -- 172.21.15.146:0/1236733183 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097c00d900 con 0x7f09801309f0 2023-10-03T10:16:17.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.693+0000 7f0977fff700 1 -- 172.21.15.146:0/1236733183 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c00dc90 con 0x7f09801309f0 2023-10-03T10:16:17.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.694+0000 7fdb11ffb700 1 -- 172.21.15.146:0/3753537714 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c00e070 con 0x7fdb1409e440 2023-10-03T10:16:17.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.694+0000 7fdb11ffb700 1 -- 172.21.15.146:0/3753537714 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0c00bbd0 con 0x7fdb1409e440 2023-10-03T10:16:17.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.694+0000 7fdb11ffb700 1 -- 172.21.15.146:0/3753537714 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c012430 con 0x7fdb1409e440 2023-10-03T10:16:17.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.694+0000 7f0987950700 1 -- 172.21.15.146:0/1236733183 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09801309f0 msgr2=0x7f0980130dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.694+0000 7f0987950700 1 --2- 172.21.15.146:0/1236733183 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09801309f0 0x7f0980130dc0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f097c00bb90 tx=0x7f097c00bea0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.694+0000 7f0987950700 1 -- 172.21.15.146:0/1236733183 shutdown_connections 2023-10-03T10:16:17.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.694+0000 7f0987950700 1 --2- 172.21.15.146:0/1236733183 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f098009e450 0x7f0980138760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.694+0000 7f0987950700 1 --2- 172.21.15.146:0/1236733183 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09801309f0 0x7f0980130dc0 secure :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f097c00bb90 tx=0x7f097c00bea0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.694+0000 7f0987950700 1 -- 172.21.15.146:0/1236733183 >> 172.21.15.146:0/1236733183 conn(0x7f09800a2b30 msgr2=0x7f098009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.694+0000 7fdb19587700 1 -- 172.21.15.146:0/3753537714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb1409e440 msgr2=0x7fdb141397e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.694+0000 7fdb19587700 1 --2- 172.21.15.146:0/3753537714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb1409e440 0x7fdb141397e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c009d90 tx=0x7fdb0c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:17.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.694+0000 7fdb19587700 1 -- 172.21.15.146:0/3753537714 shutdown_connections 2023-10-03T10:16:17.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.694+0000 7fdb19587700 1 --2- 172.21.15.146:0/3753537714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb1409e440 0x7fdb141397e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.694+0000 7fdb19587700 1 --2- 172.21.15.146:0/3753537714 >> v2:172.21.15.146:3300/0 conn(0x7fdb14098410 0x7fdb140987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.694+0000 7fdb19587700 1 -- 172.21.15.146:0/3753537714 >> 172.21.15.146:0/3753537714 conn(0x7fdb140a2b30 msgr2=0x7fdb1409e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.694+0000 7fdb19587700 1 -- 172.21.15.146:0/3753537714 shutdown_connections 2023-10-03T10:16:17.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.694+0000 7f0987950700 1 -- 172.21.15.146:0/1236733183 shutdown_connections 2023-10-03T10:16:17.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.694+0000 7f0987950700 1 -- 172.21.15.146:0/1236733183 wait complete. 2023-10-03T10:16:17.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.694+0000 7fdb19587700 1 -- 172.21.15.146:0/3753537714 wait complete. 2023-10-03T10:16:17.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.695+0000 7fdb19587700 1 Processor -- start 2023-10-03T10:16:17.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.696+0000 7fdb19587700 1 -- start start 2023-10-03T10:16:17.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.696+0000 7fdb19587700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb14098410 0x7fdb1412afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.696+0000 7fdb19587700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb1409d8f0 0x7fdb1412b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.696+0000 7fdb19587700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb1409e440 0x7fdb1412ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.696+0000 7fdb19587700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb140981c0 con 0x7fdb1409e440 2023-10-03T10:16:17.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.696+0000 7fdb19587700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1412dca0 con 0x7fdb14098410 2023-10-03T10:16:17.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.696+0000 7fdb19587700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb14070880 con 0x7fdb1409d8f0 2023-10-03T10:16:17.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.696+0000 7f0987950700 1 Processor -- start 2023-10-03T10:16:17.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.696+0000 7fdb137fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb1409e440 0x7fdb1412ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.696+0000 7fdb137fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb1409e440 0x7fdb1412ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56262/0 (socket says 172.21.15.146:56262) 2023-10-03T10:16:17.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.696+0000 7fdb137fe700 1 -- 172.21.15.146:0/958894270 learned_addr learned my addr 172.21.15.146:0/958894270 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:17.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.696+0000 7fdb12ffd700 1 --2- 172.21.15.146:0/958894270 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb14098410 0x7fdb1412afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.696+0000 7fdb127fc700 1 --2- 172.21.15.146:0/958894270 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb1409d8f0 0x7fdb1412b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.696+0000 7f0987950700 1 -- start start 2023-10-03T10:16:17.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.697+0000 7fdb127fc700 1 -- 172.21.15.146:0/958894270 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb14098410 msgr2=0x7fdb1412afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.697+0000 7fdb127fc700 1 --2- 172.21.15.146:0/958894270 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb14098410 0x7fdb1412afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.697+0000 7fdb127fc700 1 -- 172.21.15.146:0/958894270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb1409e440 msgr2=0x7fdb1412ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.697+0000 7fdb127fc700 1 --2- 172.21.15.146:0/958894270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb1409e440 0x7fdb1412ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.697+0000 7fdb127fc700 1 -- 172.21.15.146:0/958894270 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c009a70 con 0x7fdb1409d8f0 2023-10-03T10:16:17.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.697+0000 7fdb127fc700 1 --2- 172.21.15.146:0/958894270 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb1409d8f0 0x7fdb1412b510 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800c530 tx=0x7fdb0800c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.698+0000 7fdafb7fe700 1 -- 172.21.15.146:0/958894270 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0800cea0 con 0x7fdb1409d8f0 2023-10-03T10:16:17.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.698+0000 7fdafb7fe700 1 -- 172.21.15.146:0/958894270 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb08005d70 con 0x7fdb1409d8f0 2023-10-03T10:16:17.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.698+0000 7fdafb7fe700 1 -- 172.21.15.146:0/958894270 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb080072d0 con 0x7fdb1409d8f0 2023-10-03T10:16:17.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.698+0000 7f0987950700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f098009d8f0 0x7f098008bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.698+0000 7f0987950700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f098009e450 0x7f098008c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.698+0000 7f0987950700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09801c85c0 0x7f09801c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.698+0000 7f0987950700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098009b430 con 0x7f09801c85c0 2023-10-03T10:16:17.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.698+0000 7f0987950700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098008b7e0 con 0x7f098009d8f0 2023-10-03T10:16:17.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.698+0000 7f0987950700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f098008e730 con 0x7f098009e450 2023-10-03T10:16:17.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.698+0000 7f0984eeb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f098009e450 0x7f098008c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.698+0000 7f0984eeb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f098009e450 0x7f098008c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57572/0 (socket says 172.21.15.146:57572) 2023-10-03T10:16:17.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.698+0000 7f0984eeb700 1 -- 172.21.15.146:0/4124815166 learned_addr learned my addr 172.21.15.146:0/4124815166 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:17.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.698+0000 7f0984eeb700 1 -- 172.21.15.146:0/4124815166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f098009d8f0 msgr2=0x7f098008bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.698+0000 7f0984eeb700 1 --2- 172.21.15.146:0/4124815166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f098009d8f0 0x7f098008bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.698+0000 7f0984eeb700 1 -- 172.21.15.146:0/4124815166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09801c85c0 msgr2=0x7f09801c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.698+0000 7f0984eeb700 1 --2- 172.21.15.146:0/4124815166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09801c85c0 0x7f09801c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.698+0000 7f0984eeb700 1 -- 172.21.15.146:0/4124815166 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c00b7a0 con 0x7f098009e450 2023-10-03T10:16:17.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.698+0000 7f0984eeb700 1 --2- 172.21.15.146:0/4124815166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f098009e450 0x7f098008c170 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0970001b10 tx=0x7f0970014050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.699+0000 7fdb19587700 1 -- 172.21.15.146:0/958894270 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1412e3c0 con 0x7fdb1409d8f0 2023-10-03T10:16:17.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.699+0000 7fdb19587700 1 -- 172.21.15.146:0/958894270 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1412cd00 con 0x7fdb1409d8f0 2023-10-03T10:16:17.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.699+0000 7f0975ffb700 1 -- 172.21.15.146:0/4124815166 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09700052e0 con 0x7f098009e450 2023-10-03T10:16:17.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.699+0000 7f0975ffb700 1 -- 172.21.15.146:0/4124815166 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0970005440 con 0x7f098009e450 2023-10-03T10:16:17.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.699+0000 7f0975ffb700 1 -- 172.21.15.146:0/4124815166 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0970012340 con 0x7f098009e450 2023-10-03T10:16:17.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.699+0000 7f0987950700 1 -- 172.21.15.146:0/4124815166 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098008da30 con 0x7f098009e450 2023-10-03T10:16:17.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.700+0000 7fdb19587700 1 -- 172.21.15.146:0/958894270 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1404f2a0 con 0x7fdb1409d8f0 2023-10-03T10:16:17.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.700+0000 7f0987950700 1 -- 172.21.15.146:0/4124815166 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098008c6b0 con 0x7f098009e450 2023-10-03T10:16:17.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.700+0000 7fdafb7fe700 1 -- 172.21.15.146:0/958894270 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb08007430 con 0x7fdb1409d8f0 2023-10-03T10:16:17.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.701+0000 7f0987950700 1 -- 172.21.15.146:0/4124815166 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098004f2a0 con 0x7f098009e450 2023-10-03T10:16:17.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.702+0000 7fdafb7fe700 1 -- 172.21.15.146:0/958894270 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdb08010910 con 0x7fdb1409d8f0 2023-10-03T10:16:17.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.704+0000 7fdafb7fe700 1 -- 172.21.15.146:0/958894270 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb0801b3b0 con 0x7fdb1409d8f0 2023-10-03T10:16:17.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.705+0000 7f0975ffb700 1 -- 172.21.15.146:0/4124815166 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09700124a0 con 0x7f098009e450 2023-10-03T10:16:17.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.705+0000 7f0975ffb700 1 -- 172.21.15.146:0/4124815166 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f097004fc60 con 0x7f098009e450 2023-10-03T10:16:17.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.713+0000 7f0975ffb700 1 -- 172.21.15.146:0/4124815166 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f097002b900 con 0x7f098009e450 2023-10-03T10:16:17.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.801+0000 7f8b819d1700 1 -- 172.21.15.146:0/2357834326 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8b7c11fc60 con 0x7f8b7c09f180 2023-10-03T10:16:17.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.801+0000 7f8b63fff700 1 -- 172.21.15.146:0/2357834326 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8b7c11fc60 con 0x7f8b7c09f180 2023-10-03T10:16:17.802 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:17.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.804+0000 7f8b819d1700 1 -- 172.21.15.146:0/2357834326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b7c09f180 msgr2=0x7f8b7c1b94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.804+0000 7f8b819d1700 1 --2- 172.21.15.146:0/2357834326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b7c09f180 0x7f8b7c1b94f0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000e9e0 tx=0x7f8b7000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.804+0000 7f8b819d1700 1 -- 172.21.15.146:0/2357834326 shutdown_connections 2023-10-03T10:16:17.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.804+0000 7f8b819d1700 1 --2- 172.21.15.146:0/2357834326 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b7c131d70 0x7f8b7c1b9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.804+0000 7f8b819d1700 1 --2- 172.21.15.146:0/2357834326 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b7c09e870 0x7f8b7c1b8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.804+0000 7f8b819d1700 1 --2- 172.21.15.146:0/2357834326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b7c09f180 0x7f8b7c1b94f0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.804+0000 7f8b819d1700 1 -- 172.21.15.146:0/2357834326 >> 172.21.15.146:0/2357834326 conn(0x7f8b7c0a4430 msgr2=0x7f8b7c131350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.804+0000 7f8b819d1700 1 -- 172.21.15.146:0/2357834326 shutdown_connections 2023-10-03T10:16:17.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.804+0000 7f8b819d1700 1 -- 172.21.15.146:0/2357834326 wait complete. 2023-10-03T10:16:17.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:17.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.901+0000 7fdb19587700 1 -- 172.21.15.146:0/958894270 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdb1406b2a0 con 0x7fdb1409d8f0 2023-10-03T10:16:17.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.901+0000 7fdafb7fe700 1 -- 172.21.15.146:0/958894270 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb080192c0 con 0x7fdb1409d8f0 2023-10-03T10:16:17.902 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:17.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.903+0000 7fdb19587700 1 -- 172.21.15.146:0/958894270 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb1409d8f0 msgr2=0x7fdb1412b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.903+0000 7fdb19587700 1 --2- 172.21.15.146:0/958894270 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb1409d8f0 0x7fdb1412b510 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800c530 tx=0x7fdb0800c840 comp rx=0 tx=0).stop 2023-10-03T10:16:17.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.903+0000 7fdb19587700 1 -- 172.21.15.146:0/958894270 shutdown_connections 2023-10-03T10:16:17.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.903+0000 7fdb19587700 1 --2- 172.21.15.146:0/958894270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb1409e440 0x7fdb1412ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.903+0000 7fdb19587700 1 --2- 172.21.15.146:0/958894270 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb14098410 0x7fdb1412afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.903+0000 7fdb19587700 1 --2- 172.21.15.146:0/958894270 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb1409d8f0 0x7fdb1412b510 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.903+0000 7fdb19587700 1 -- 172.21.15.146:0/958894270 >> 172.21.15.146:0/958894270 conn(0x7fdb140a2b30 msgr2=0x7fdb141307d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.903+0000 7fdb19587700 1 -- 172.21.15.146:0/958894270 shutdown_connections 2023-10-03T10:16:17.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.903+0000 7fdb19587700 1 -- 172.21.15.146:0/958894270 wait complete. 2023-10-03T10:16:17.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.908+0000 7f0987950700 1 -- 172.21.15.146:0/4124815166 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f098006b2a0 con 0x7f098009e450 2023-10-03T10:16:17.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.908+0000 7f0975ffb700 1 -- 172.21.15.146:0/4124815166 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f097000f410 con 0x7f098009e450 2023-10-03T10:16:17.909 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:17.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.909+0000 7f9319777700 1 -- 172.21.15.146:0/2700731521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f931404f2a0 con 0x7f93140a0ff0 2023-10-03T10:16:17.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.910+0000 7f92fb7fe700 1 -- 172.21.15.146:0/2700731521 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9308018ad0 con 0x7f93140a0ff0 2023-10-03T10:16:17.910 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:17.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.911+0000 7f0987950700 1 -- 172.21.15.146:0/4124815166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f098009e450 msgr2=0x7f098008c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.911+0000 7f0987950700 1 --2- 172.21.15.146:0/4124815166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f098009e450 0x7f098008c170 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0970001b10 tx=0x7f0970014050 comp rx=0 tx=0).stop 2023-10-03T10:16:17.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.911+0000 7f0987950700 1 -- 172.21.15.146:0/4124815166 shutdown_connections 2023-10-03T10:16:17.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.911+0000 7f0987950700 1 --2- 172.21.15.146:0/4124815166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09801c85c0 0x7f09801c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.911+0000 7f0987950700 1 --2- 172.21.15.146:0/4124815166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f098009d8f0 0x7f098008bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.911+0000 7f0987950700 1 --2- 172.21.15.146:0/4124815166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f098009e450 0x7f098008c170 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.911+0000 7f0987950700 1 -- 172.21.15.146:0/4124815166 >> 172.21.15.146:0/4124815166 conn(0x7f09800a2b30 msgr2=0x7f098009fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.912+0000 7f0987950700 1 -- 172.21.15.146:0/4124815166 shutdown_connections 2023-10-03T10:16:17.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.912+0000 7f0987950700 1 -- 172.21.15.146:0/4124815166 wait complete. 2023-10-03T10:16:17.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.912+0000 7f9319777700 1 -- 172.21.15.146:0/2700731521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93140a0ff0 msgr2=0x7f931411cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.912+0000 7f9319777700 1 --2- 172.21.15.146:0/2700731521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93140a0ff0 0x7f931411cdc0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f930800c460 tx=0x7f930800c770 comp rx=0 tx=0).stop 2023-10-03T10:16:17.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.913+0000 7f9319777700 1 -- 172.21.15.146:0/2700731521 shutdown_connections 2023-10-03T10:16:17.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.913+0000 7f9319777700 1 --2- 172.21.15.146:0/2700731521 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9314133b80 0x7f931411d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.913+0000 7f9319777700 1 --2- 172.21.15.146:0/2700731521 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9314099a60 0x7f931411c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.913+0000 7f9319777700 1 --2- 172.21.15.146:0/2700731521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93140a0ff0 0x7f931411cdc0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.913+0000 7f9319777700 1 -- 172.21.15.146:0/2700731521 >> 172.21.15.146:0/2700731521 conn(0x7f93140a2980 msgr2=0x7f93141baee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.915+0000 7f9319777700 1 -- 172.21.15.146:0/2700731521 shutdown_connections 2023-10-03T10:16:17.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:17.915+0000 7f9319777700 1 -- 172.21.15.146:0/2700731521 wait complete. 2023-10-03T10:16:17.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:17.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:17.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:18.818 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:18.918 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:18.927 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:18.930 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:18.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.955+0000 7ff12e9d3700 1 Processor -- start 2023-10-03T10:16:18.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.955+0000 7ff12e9d3700 1 -- start start 2023-10-03T10:16:18.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.956+0000 7ff12e9d3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff12812d2f0 0x7ff12812d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.956+0000 7ff12e9d3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff128130350 0x7ff128130760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.956+0000 7ff12e9d3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff128130ca0 0x7ff128137680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.956+0000 7ff12e9d3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1280a24b0 con 0x7ff12812d2f0 2023-10-03T10:16:18.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.956+0000 7ff12e9d3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12809bbb0 con 0x7ff128130350 2023-10-03T10:16:18.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.956+0000 7ff12e9d3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff128072520 con 0x7ff128130ca0 2023-10-03T10:16:18.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.956+0000 7ff127fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff12812d2f0 0x7ff12812d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.956+0000 7ff1277fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff128130350 0x7ff128130760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.956+0000 7ff127fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff12812d2f0 0x7ff12812d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56286/0 (socket says 172.21.15.146:56286) 2023-10-03T10:16:18.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.956+0000 7ff127fff700 1 -- 172.21.15.146:0/3690046829 learned_addr learned my addr 172.21.15.146:0/3690046829 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:18.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.956+0000 7ff12cf70700 1 --2- 172.21.15.146:0/3690046829 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff128130ca0 0x7ff128137680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.956+0000 7ff127fff700 1 -- 172.21.15.146:0/3690046829 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff128130ca0 msgr2=0x7ff128137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.956+0000 7ff127fff700 1 --2- 172.21.15.146:0/3690046829 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff128130ca0 0x7ff128137680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.956+0000 7ff127fff700 1 -- 172.21.15.146:0/3690046829 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff128130350 msgr2=0x7ff128130760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.956+0000 7ff127fff700 1 --2- 172.21.15.146:0/3690046829 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff128130350 0x7ff128130760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.956+0000 7ff127fff700 1 -- 172.21.15.146:0/3690046829 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12809cd30 con 0x7ff12812d2f0 2023-10-03T10:16:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.956+0000 7ff12cf70700 1 --2- 172.21.15.146:0/3690046829 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff128130ca0 0x7ff128137680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.957+0000 7ff127fff700 1 --2- 172.21.15.146:0/3690046829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff12812d2f0 0x7ff12812d6c0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7ff118006fd0 tx=0x7ff118009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c269de465f6f6ac server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.957+0000 7ff126ffd700 1 -- 172.21.15.146:0/3690046829 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff118005e30 con 0x7ff12812d2f0 2023-10-03T10:16:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.957+0000 7ff126ffd700 1 -- 172.21.15.146:0/3690046829 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff118004030 con 0x7ff12812d2f0 2023-10-03T10:16:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.957+0000 7ff126ffd700 1 -- 172.21.15.146:0/3690046829 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1180043e0 con 0x7ff12812d2f0 2023-10-03T10:16:18.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.957+0000 7ff12e9d3700 1 -- 172.21.15.146:0/3690046829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff12812d2f0 msgr2=0x7ff12812d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.957+0000 7ff12e9d3700 1 --2- 172.21.15.146:0/3690046829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff12812d2f0 0x7ff12812d6c0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7ff118006fd0 tx=0x7ff118009bd0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.957+0000 7ff12e9d3700 1 -- 172.21.15.146:0/3690046829 shutdown_connections 2023-10-03T10:16:18.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.957+0000 7ff12e9d3700 1 --2- 172.21.15.146:0/3690046829 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff128130ca0 0x7ff128137680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.957+0000 7ff12e9d3700 1 --2- 172.21.15.146:0/3690046829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff12812d2f0 0x7ff12812d6c0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.957+0000 7ff12e9d3700 1 --2- 172.21.15.146:0/3690046829 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff128130350 0x7ff128130760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.957+0000 7ff12e9d3700 1 -- 172.21.15.146:0/3690046829 >> 172.21.15.146:0/3690046829 conn(0x7ff1280a2980 msgr2=0x7ff1280a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:18.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.957+0000 7ff12e9d3700 1 -- 172.21.15.146:0/3690046829 shutdown_connections 2023-10-03T10:16:18.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.958+0000 7ff12e9d3700 1 -- 172.21.15.146:0/3690046829 wait complete. 2023-10-03T10:16:18.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.959+0000 7ff12e9d3700 1 Processor -- start 2023-10-03T10:16:18.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.959+0000 7ff12e9d3700 1 -- start start 2023-10-03T10:16:18.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.960+0000 7ff12e9d3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff12812d2f0 0x7ff12811a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.960+0000 7ff12e9d3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff128130350 0x7ff12811adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.960+0000 7ff12e9d3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff128130ca0 0x7ff12811b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.960+0000 7ff12e9d3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12811e150 con 0x7ff12812d2f0 2023-10-03T10:16:18.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.960+0000 7ff12e9d3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12812cc50 con 0x7ff128130350 2023-10-03T10:16:18.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.960+0000 7ff12e9d3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff12811d6d0 con 0x7ff128130ca0 2023-10-03T10:16:18.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.960+0000 7ff1277fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff128130350 0x7ff12811adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.960+0000 7ff1277fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff128130350 0x7ff12811adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43786/0 (socket says 172.21.15.146:43786) 2023-10-03T10:16:18.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.960+0000 7ff1277fe700 1 -- 172.21.15.146:0/255302287 learned_addr learned my addr 172.21.15.146:0/255302287 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:18.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.960+0000 7ff127fff700 1 --2- 172.21.15.146:0/255302287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff12812d2f0 0x7ff12811a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.960+0000 7ff12cf70700 1 --2- 172.21.15.146:0/255302287 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff128130ca0 0x7ff12811b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.961+0000 7ff1277fe700 1 -- 172.21.15.146:0/255302287 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff128130ca0 msgr2=0x7ff12811b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.961+0000 7ff1277fe700 1 --2- 172.21.15.146:0/255302287 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff128130ca0 0x7ff12811b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.961+0000 7ff1277fe700 1 -- 172.21.15.146:0/255302287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff12812d2f0 msgr2=0x7ff12811a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.961+0000 7ff1277fe700 1 --2- 172.21.15.146:0/255302287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff12812d2f0 0x7ff12811a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.961+0000 7ff1277fe700 1 -- 172.21.15.146:0/255302287 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff120009a70 con 0x7ff128130350 2023-10-03T10:16:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.961+0000 7ff127fff700 1 --2- 172.21.15.146:0/255302287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff12812d2f0 0x7ff12811a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.961+0000 7ff1277fe700 1 --2- 172.21.15.146:0/255302287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff128130350 0x7ff12811adb0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff11c012fc0 tx=0x7ff11c0100c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.961+0000 7ff124ff9700 1 -- 172.21.15.146:0/255302287 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c00dbb0 con 0x7ff128130350 2023-10-03T10:16:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.961+0000 7ff124ff9700 1 -- 172.21.15.146:0/255302287 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11c013040 con 0x7ff128130350 2023-10-03T10:16:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.961+0000 7ff124ff9700 1 -- 172.21.15.146:0/255302287 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c010b30 con 0x7ff128130350 2023-10-03T10:16:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.961+0000 7ff12e9d3700 1 -- 172.21.15.146:0/255302287 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff118009500 con 0x7ff128130350 2023-10-03T10:16:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.961+0000 7ff12e9d3700 1 -- 172.21.15.146:0/255302287 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12812ea60 con 0x7ff128130350 2023-10-03T10:16:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.962+0000 7ff124ff9700 1 -- 172.21.15.146:0/255302287 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff11c010c90 con 0x7ff128130350 2023-10-03T10:16:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.962+0000 7ff12e9d3700 1 -- 172.21.15.146:0/255302287 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff12809b4f0 con 0x7ff128130350 2023-10-03T10:16:18.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.963+0000 7ff124ff9700 1 -- 172.21.15.146:0/255302287 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff11c043990 con 0x7ff128130350 2023-10-03T10:16:18.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:18.969+0000 7ff124ff9700 1 -- 172.21.15.146:0/255302287 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff11c020950 con 0x7ff128130350 2023-10-03T10:16:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.052+0000 7f81cd93e700 1 Processor -- start 2023-10-03T10:16:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.052+0000 7f81cd93e700 1 -- start start 2023-10-03T10:16:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.052+0000 7f81cd93e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81c806a770 0x7f81c806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.052+0000 7f81cd93e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81c806b080 0x7f81c81317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.053+0000 7f81cd93e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c809da80 con 0x7f81c8131cf0 2023-10-03T10:16:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.053+0000 7f81cd93e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c809dce0 con 0x7f81c806a770 2023-10-03T10:16:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.053+0000 7f81cd93e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81c809eb20 con 0x7f81c806b080 2023-10-03T10:16:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.053+0000 7f81c6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81c806a770 0x7f81c806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.053+0000 7f81c6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81c806a770 0x7f81c806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43802/0 (socket says 172.21.15.146:43802) 2023-10-03T10:16:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.053+0000 7f81c6ffd700 1 -- 172.21.15.146:0/4194760246 learned_addr learned my addr 172.21.15.146:0/4194760246 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.053+0000 7f81c77fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f81c8131cf0 0x7f81c8138c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50356/0 (socket says 172.21.15.146:50356) 2023-10-03T10:16:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.053+0000 7f81c67fc700 1 --2- 172.21.15.146:0/4194760246 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81c806b080 0x7f81c81317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.053+0000 7f81c6ffd700 1 -- 172.21.15.146:0/4194760246 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81c806b080 msgr2=0x7f81c81317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.053+0000 7f81c6ffd700 1 --2- 172.21.15.146:0/4194760246 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81c806b080 0x7f81c81317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.053+0000 7f81c6ffd700 1 -- 172.21.15.146:0/4194760246 >> v1:172.21.15.146:6789/0 conn(0x7f81c8131cf0 legacy=0x7f81c8138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.053+0000 7f81c6ffd700 1 -- 172.21.15.146:0/4194760246 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c809d860 con 0x7f81c806a770 2023-10-03T10:16:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.053+0000 7f81c6ffd700 1 --2- 172.21.15.146:0/4194760246 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81c806a770 0x7f81c806ab40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f81b8009950 tx=0x7f81b8009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cba195468c2e53a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.054+0000 7f81c5ffb700 1 -- 172.21.15.146:0/4194760246 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b8011830 con 0x7f81c806a770 2023-10-03T10:16:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.054+0000 7f81c5ffb700 1 -- 172.21.15.146:0/4194760246 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b8011990 con 0x7f81c806a770 2023-10-03T10:16:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.054+0000 7f81c5ffb700 1 -- 172.21.15.146:0/4194760246 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b8011d40 con 0x7f81c806a770 2023-10-03T10:16:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.054+0000 7f81cd93e700 1 -- 172.21.15.146:0/4194760246 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81c806a770 msgr2=0x7f81c806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.054+0000 7f81cd93e700 1 --2- 172.21.15.146:0/4194760246 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81c806a770 0x7f81c806ab40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f81b8009950 tx=0x7f81b8009c60 comp rx=0 tx=0).stop 2023-10-03T10:16:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.054+0000 7f81cd93e700 1 -- 172.21.15.146:0/4194760246 shutdown_connections 2023-10-03T10:16:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.054+0000 7f81cd93e700 1 --2- 172.21.15.146:0/4194760246 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81c806a770 0x7f81c806ab40 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.054+0000 7f81cd93e700 1 --2- 172.21.15.146:0/4194760246 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81c806b080 0x7f81c81317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.054+0000 7f81cd93e700 1 -- 172.21.15.146:0/4194760246 >> 172.21.15.146:0/4194760246 conn(0x7f81c8099c40 msgr2=0x7f81c80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.054+0000 7f81cd93e700 1 -- 172.21.15.146:0/4194760246 shutdown_connections 2023-10-03T10:16:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.054+0000 7f81cd93e700 1 -- 172.21.15.146:0/4194760246 wait complete. 2023-10-03T10:16:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.055+0000 7f81cd93e700 1 Processor -- start 2023-10-03T10:16:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.055+0000 7f81cd93e700 1 -- start start 2023-10-03T10:16:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.056+0000 7f81cd93e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81c806a770 0x7f81c81b90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.056+0000 7f81cd93e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81c806b080 0x7f81c81b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.056+0000 7f81cd93e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81c8131cf0 0x7f81c81b9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.056+0000 7f81cd93e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c81bacd0 con 0x7f81c806a770 2023-10-03T10:16:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.056+0000 7f81cd93e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c811eb90 con 0x7f81c8131cf0 2023-10-03T10:16:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.056+0000 7f81cd93e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81c80a2fd0 con 0x7f81c806b080 2023-10-03T10:16:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.056+0000 7f81c6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81c806a770 0x7f81c81b90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.056+0000 7f81c6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81c806a770 0x7f81c81b90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56308/0 (socket says 172.21.15.146:56308) 2023-10-03T10:16:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.056+0000 7f81c6ffd700 1 -- 172.21.15.146:0/4027964237 learned_addr learned my addr 172.21.15.146:0/4027964237 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.056+0000 7f81c77fe700 1 --2- 172.21.15.146:0/4027964237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81c8131cf0 0x7f81c81b9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.056+0000 7f81c67fc700 1 --2- 172.21.15.146:0/4027964237 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81c806b080 0x7f81c81b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.056+0000 7f81c77fe700 1 -- 172.21.15.146:0/4027964237 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81c806b080 msgr2=0x7f81c81b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.056+0000 7f81c77fe700 1 --2- 172.21.15.146:0/4027964237 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81c806b080 0x7f81c81b95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.056+0000 7f81c77fe700 1 -- 172.21.15.146:0/4027964237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81c806a770 msgr2=0x7f81c81b90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.056+0000 7f81c77fe700 1 --2- 172.21.15.146:0/4027964237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81c806a770 0x7f81c81b90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.056+0000 7f81c77fe700 1 -- 172.21.15.146:0/4027964237 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b8009550 con 0x7f81c8131cf0 2023-10-03T10:16:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.057+0000 7f81c77fe700 1 --2- 172.21.15.146:0/4027964237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81c8131cf0 0x7f81c81b9b30 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f81c000cb10 tx=0x7f81c000ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.057+0000 7f81affff700 1 -- 172.21.15.146:0/4027964237 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c000aaa0 con 0x7f81c8131cf0 2023-10-03T10:16:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.057+0000 7f81cd93e700 1 -- 172.21.15.146:0/4027964237 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c8071e10 con 0x7f81c8131cf0 2023-10-03T10:16:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.057+0000 7f81affff700 1 -- 172.21.15.146:0/4027964237 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c000ac00 con 0x7f81c8131cf0 2023-10-03T10:16:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.057+0000 7f81affff700 1 -- 172.21.15.146:0/4027964237 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0007070 con 0x7f81c8131cf0 2023-10-03T10:16:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.057+0000 7f81cd93e700 1 -- 172.21.15.146:0/4027964237 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c811ee70 con 0x7f81c8131cf0 2023-10-03T10:16:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.058+0000 7f81affff700 1 -- 172.21.15.146:0/4027964237 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81c00071d0 con 0x7f81c8131cf0 2023-10-03T10:16:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.058+0000 7f81affff700 1 -- 172.21.15.146:0/4027964237 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f81c003f3c0 con 0x7f81c8131cf0 2023-10-03T10:16:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.058+0000 7f81cd93e700 1 -- 172.21.15.146:0/4027964237 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c806be10 con 0x7f81c8131cf0 2023-10-03T10:16:19.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.067+0000 7f81affff700 1 -- 172.21.15.146:0/4027964237 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81c0012400 con 0x7f81c8131cf0 2023-10-03T10:16:19.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.086+0000 7f5fd7eed700 1 Processor -- start 2023-10-03T10:16:19.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.086+0000 7fd96af11700 1 Processor -- start 2023-10-03T10:16:19.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.086+0000 7f5fd7eed700 1 -- start start 2023-10-03T10:16:19.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.086+0000 7fd96af11700 1 -- start start 2023-10-03T10:16:19.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.087+0000 7fd96af11700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd96409a130 0x7fd96409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.087+0000 7fd96af11700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd96409f1e0 0x7fd96413fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.087+0000 7fd96af11700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd964072b30 con 0x7fd96409edb0 2023-10-03T10:16:19.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.087+0000 7fd96af11700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96409a500 con 0x7fd96409f1e0 2023-10-03T10:16:19.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.087+0000 7fd96af11700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96409ada0 con 0x7fd96409a130 2023-10-03T10:16:19.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.087+0000 7f5fd7eed700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fd009ad40 0x7f5fd0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.087+0000 7f5fd7eed700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5fd0133f70 0x7f5fd01343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.087+0000 7f5fd7eed700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fd00a0a70 0x7f5fd00a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.087+0000 7f5fd7eed700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd00a3b60 con 0x7f5fd0133f70 2023-10-03T10:16:19.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.087+0000 7f5fd7eed700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd01348e0 con 0x7f5fd009ad40 2023-10-03T10:16:19.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.087+0000 7f5fd7eed700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd009b110 con 0x7f5fd00a0a70 2023-10-03T10:16:19.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.087+0000 7fd968cad700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd96409a130 0x7fd96409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.087+0000 7f5fd5c89700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fd009ad40 0x7f5fd0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.087+0000 7f5fd5c89700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fd009ad40 0x7f5fd0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43828/0 (socket says 172.21.15.146:43828) 2023-10-03T10:16:19.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.087+0000 7f5fd5c89700 1 -- 172.21.15.146:0/2452883081 learned_addr learned my addr 172.21.15.146:0/2452883081 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:19.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.087+0000 7fd968cad700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd96409a130 0x7fd96409e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43820/0 (socket says 172.21.15.146:43820) 2023-10-03T10:16:19.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.087+0000 7fd968cad700 1 -- 172.21.15.146:0/498802934 learned_addr learned my addr 172.21.15.146:0/498802934 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:19.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.087+0000 7fd9694ae700 1 --2- 172.21.15.146:0/498802934 >> v2:172.21.15.146:3300/0 conn(0x7fd96409f1e0 0x7fd96413fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.088+0000 7fd968cad700 1 -- 172.21.15.146:0/498802934 >> v2:172.21.15.146:3300/0 conn(0x7fd96409f1e0 msgr2=0x7fd96413fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.088+0000 7fd968cad700 1 --2- 172.21.15.146:0/498802934 >> v2:172.21.15.146:3300/0 conn(0x7fd96409f1e0 0x7fd96413fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.088+0000 7fd968cad700 1 -- 172.21.15.146:0/498802934 >> v1:172.21.15.146:6789/0 conn(0x7fd96409edb0 legacy=0x7fd96413c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.088+0000 7fd968cad700 1 -- 172.21.15.146:0/498802934 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96409fe00 con 0x7fd96409a130 2023-10-03T10:16:19.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.088+0000 7fd9694ae700 1 --2- 172.21.15.146:0/498802934 >> v2:172.21.15.146:3300/0 conn(0x7fd96409f1e0 0x7fd96413fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:19.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.088+0000 7f5fd5488700 1 --2- 172.21.15.146:0/2452883081 >> v2:172.21.15.146:3300/0 conn(0x7f5fd0133f70 0x7f5fd01343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.088+0000 7f5fd5c89700 1 -- 172.21.15.146:0/2452883081 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fd00a0a70 msgr2=0x7f5fd00a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.088+0000 7f5fd5c89700 1 --2- 172.21.15.146:0/2452883081 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fd00a0a70 0x7f5fd00a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.088+0000 7f5fd5c89700 1 -- 172.21.15.146:0/2452883081 >> v2:172.21.15.146:3300/0 conn(0x7f5fd0133f70 msgr2=0x7f5fd01343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.088+0000 7f5fd5c89700 1 --2- 172.21.15.146:0/2452883081 >> v2:172.21.15.146:3300/0 conn(0x7f5fd0133f70 0x7f5fd01343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.088+0000 7f5fd5c89700 1 -- 172.21.15.146:0/2452883081 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd00a2fa0 con 0x7f5fd009ad40 2023-10-03T10:16:19.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.088+0000 7f5fd5488700 1 --2- 172.21.15.146:0/2452883081 >> v2:172.21.15.146:3300/0 conn(0x7f5fd0133f70 0x7f5fd01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:19.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.088+0000 7fd968cad700 1 --2- 172.21.15.146:0/498802934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd96409a130 0x7fd96409e870 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd9580098f0 tx=0x7fd958009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=883c1d7f247adaff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.088+0000 7f5fd5c89700 1 --2- 172.21.15.146:0/2452883081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fd009ad40 0x7f5fd0133a30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0098f0 tx=0x7f5fcc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e01e6df7db152811 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.088+0000 7fd9637fe700 1 -- 172.21.15.146:0/498802934 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd958004230 con 0x7fd96409a130 2023-10-03T10:16:19.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.088+0000 7fd9637fe700 1 -- 172.21.15.146:0/498802934 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd958004390 con 0x7fd96409a130 2023-10-03T10:16:19.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.088+0000 7fd9637fe700 1 -- 172.21.15.146:0/498802934 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9580036a0 con 0x7fd96409a130 2023-10-03T10:16:19.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.088+0000 7f5fd4c87700 1 -- 172.21.15.146:0/2452883081 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc00b8a0 con 0x7f5fd009ad40 2023-10-03T10:16:19.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.088+0000 7f5fd4c87700 1 -- 172.21.15.146:0/2452883081 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc00ba00 con 0x7f5fd009ad40 2023-10-03T10:16:19.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.088+0000 7f5fd4c87700 1 -- 172.21.15.146:0/2452883081 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc00bd90 con 0x7f5fd009ad40 2023-10-03T10:16:19.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.089+0000 7fd96af11700 1 -- 172.21.15.146:0/498802934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd96409a130 msgr2=0x7fd96409e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.089+0000 7fd96af11700 1 --2- 172.21.15.146:0/498802934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd96409a130 0x7fd96409e870 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd9580098f0 tx=0x7fd958009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:19.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.089+0000 7fd96af11700 1 -- 172.21.15.146:0/498802934 shutdown_connections 2023-10-03T10:16:19.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.089+0000 7fd96af11700 1 --2- 172.21.15.146:0/498802934 >> v2:172.21.15.146:3300/0 conn(0x7fd96409f1e0 0x7fd96413fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.089+0000 7fd96af11700 1 --2- 172.21.15.146:0/498802934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd96409a130 0x7fd96409e870 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.089+0000 7fd96af11700 1 -- 172.21.15.146:0/498802934 >> 172.21.15.146:0/498802934 conn(0x7fd9640a4430 msgr2=0x7fd9640a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.089+0000 7fd96af11700 1 -- 172.21.15.146:0/498802934 shutdown_connections 2023-10-03T10:16:19.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.089+0000 7f5fd7eed700 1 -- 172.21.15.146:0/2452883081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fd009ad40 msgr2=0x7f5fd0133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.089+0000 7f5fd7eed700 1 --2- 172.21.15.146:0/2452883081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fd009ad40 0x7f5fd0133a30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0098f0 tx=0x7f5fcc009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:19.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.089+0000 7fd96af11700 1 -- 172.21.15.146:0/498802934 wait complete. 2023-10-03T10:16:19.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.089+0000 7f5fd7eed700 1 -- 172.21.15.146:0/2452883081 shutdown_connections 2023-10-03T10:16:19.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.089+0000 7f5fd7eed700 1 --2- 172.21.15.146:0/2452883081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fd009ad40 0x7f5fd0133a30 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.089+0000 7f5fd7eed700 1 --2- 172.21.15.146:0/2452883081 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fd00a0a70 0x7f5fd00a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.089+0000 7f5fd7eed700 1 --2- 172.21.15.146:0/2452883081 >> v2:172.21.15.146:3300/0 conn(0x7f5fd0133f70 0x7f5fd01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.089+0000 7f5fd7eed700 1 -- 172.21.15.146:0/2452883081 >> 172.21.15.146:0/2452883081 conn(0x7f5fd0099c40 msgr2=0x7f5fd006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.090+0000 7f5fd7eed700 1 -- 172.21.15.146:0/2452883081 shutdown_connections 2023-10-03T10:16:19.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.090+0000 7fd96af11700 1 Processor -- start 2023-10-03T10:16:19.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.090+0000 7fd96af11700 1 -- start start 2023-10-03T10:16:19.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.090+0000 7f5fd7eed700 1 -- 172.21.15.146:0/2452883081 wait complete. 2023-10-03T10:16:19.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.090+0000 7f5fd7eed700 1 Processor -- start 2023-10-03T10:16:19.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7f5fd7eed700 1 -- start start 2023-10-03T10:16:19.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7fd96af11700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd96409a130 0x7fd96413f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7fd96af11700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd96409edb0 0x7fd96411ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7fd96af11700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd96409f1e0 0x7fd96411f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7fd96af11700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd964121a90 con 0x7fd96409a130 2023-10-03T10:16:19.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7fd96af11700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96413fed0 con 0x7fd96409f1e0 2023-10-03T10:16:19.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7fd96af11700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd96411fd10 con 0x7fd96409edb0 2023-10-03T10:16:19.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7fd9694ae700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd96409f1e0 0x7fd96411f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7fd9694ae700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd96409f1e0 0x7fd96411f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43830/0 (socket says 172.21.15.146:43830) 2023-10-03T10:16:19.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7fd9694ae700 1 -- 172.21.15.146:0/2315896594 learned_addr learned my addr 172.21.15.146:0/2315896594 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:19.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7fd963fff700 1 --2- 172.21.15.146:0/2315896594 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd96409edb0 0x7fd96411ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7f5fd7eed700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fd009ad40 0x7f5fd0132820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7f5fd7eed700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fd00a0a70 0x7f5fd0132d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7f5fd5c89700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fd009ad40 0x7f5fd0132820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7f5fd5c89700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fd009ad40 0x7f5fd0132820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56344/0 (socket says 172.21.15.146:56344) 2023-10-03T10:16:19.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7f5fd5488700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fd00a0a70 0x7f5fd0132d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7f5fd5488700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fd00a0a70 0x7f5fd0132d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57624/0 (socket says 172.21.15.146:57624) 2023-10-03T10:16:19.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7fd9694ae700 1 -- 172.21.15.146:0/2315896594 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd96409edb0 msgr2=0x7fd96411ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7fd9694ae700 1 --2- 172.21.15.146:0/2315896594 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd96409edb0 0x7fd96411ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7fd9694ae700 1 -- 172.21.15.146:0/2315896594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd96409a130 msgr2=0x7fd96413f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7fd968cad700 1 --2- 172.21.15.146:0/2315896594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd96409a130 0x7fd96413f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7fd9694ae700 1 --2- 172.21.15.146:0/2315896594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd96409a130 0x7fd96413f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7fd9694ae700 1 -- 172.21.15.146:0/2315896594 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c009a70 con 0x7fd96409f1e0 2023-10-03T10:16:19.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7fd968cad700 1 --2- 172.21.15.146:0/2315896594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd96409a130 0x7fd96413f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:19.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.091+0000 7fd9694ae700 1 --2- 172.21.15.146:0/2315896594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd96409f1e0 0x7fd96411f010 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009f00 tx=0x7fd95c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.092+0000 7fd9617fa700 1 -- 172.21.15.146:0/2315896594 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c00cc00 con 0x7fd96409f1e0 2023-10-03T10:16:19.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.092+0000 7fd9617fa700 1 -- 172.21.15.146:0/2315896594 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c00f040 con 0x7fd96409f1e0 2023-10-03T10:16:19.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.092+0000 7fd9617fa700 1 -- 172.21.15.146:0/2315896594 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c003a20 con 0x7fd96409f1e0 2023-10-03T10:16:19.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.092+0000 7fd96af11700 1 -- 172.21.15.146:0/2315896594 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd958009550 con 0x7fd96409f1e0 2023-10-03T10:16:19.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.092+0000 7f5fd7eed700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fd0133f70 0x7f5fd01332a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.092+0000 7f5fd5c89700 1 -- 172.21.15.146:0/3084889329 learned_addr learned my addr 172.21.15.146:0/3084889329 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:19.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.092+0000 7f5fd7eed700 1 -- 172.21.15.146:0/3084889329 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd0133a10 con 0x7f5fd009ad40 2023-10-03T10:16:19.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.092+0000 7f5fd7eed700 1 -- 172.21.15.146:0/3084889329 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd012fda0 con 0x7f5fd0133f70 2023-10-03T10:16:19.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.092+0000 7f5fd7eed700 1 -- 172.21.15.146:0/3084889329 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd009c7e0 con 0x7f5fd00a0a70 2023-10-03T10:16:19.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.093+0000 7f5fd5c89700 1 -- 172.21.15.146:0/3084889329 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fd00a0a70 msgr2=0x7f5fd0132d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.093+0000 7f5fd5c89700 1 --2- 172.21.15.146:0/3084889329 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fd00a0a70 0x7f5fd0132d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.093+0000 7f5fd5c89700 1 -- 172.21.15.146:0/3084889329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fd0133f70 msgr2=0x7f5fd01332a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.093+0000 7f5fd5c89700 1 --2- 172.21.15.146:0/3084889329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fd0133f70 0x7f5fd01332a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.093+0000 7f5fd5c89700 1 -- 172.21.15.146:0/3084889329 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc009550 con 0x7f5fd009ad40 2023-10-03T10:16:19.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.093+0000 7f5fd5c89700 1 --2- 172.21.15.146:0/3084889329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fd009ad40 0x7f5fd0132820 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc014040 tx=0x7f5fcc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.092+0000 7fd96af11700 1 -- 172.21.15.146:0/2315896594 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96413aae0 con 0x7fd96409f1e0 2023-10-03T10:16:19.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.093+0000 7fd9617fa700 1 -- 172.21.15.146:0/2315896594 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd95c003b80 con 0x7fd96409f1e0 2023-10-03T10:16:19.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.093+0000 7fd96af11700 1 -- 172.21.15.146:0/2315896594 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96404f2a0 con 0x7fd96409f1e0 2023-10-03T10:16:19.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.093+0000 7fd9617fa700 1 -- 172.21.15.146:0/2315896594 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd95c03ff70 con 0x7fd96409f1e0 2023-10-03T10:16:19.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.093+0000 7f5fc67fc700 1 -- 172.21.15.146:0/3084889329 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc0036a0 con 0x7f5fd009ad40 2023-10-03T10:16:19.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.093+0000 7f5fc67fc700 1 -- 172.21.15.146:0/3084889329 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc01e070 con 0x7f5fd009ad40 2023-10-03T10:16:19.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.093+0000 7f5fd7eed700 1 -- 172.21.15.146:0/3084889329 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd01310f0 con 0x7f5fd009ad40 2023-10-03T10:16:19.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.093+0000 7f5fc67fc700 1 -- 172.21.15.146:0/3084889329 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc003a60 con 0x7f5fd009ad40 2023-10-03T10:16:19.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.093+0000 7f5fd7eed700 1 -- 172.21.15.146:0/3084889329 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd012f7a0 con 0x7f5fd009ad40 2023-10-03T10:16:19.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.095+0000 7f5fc67fc700 1 -- 172.21.15.146:0/3084889329 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5fcc003bc0 con 0x7f5fd009ad40 2023-10-03T10:16:19.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.095+0000 7f5fd7eed700 1 -- 172.21.15.146:0/3084889329 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb80052e0 con 0x7f5fd009ad40 2023-10-03T10:16:19.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.095+0000 7f5fc67fc700 1 -- 172.21.15.146:0/3084889329 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5fcc020070 con 0x7f5fd009ad40 2023-10-03T10:16:19.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.098+0000 7fd9617fa700 1 -- 172.21.15.146:0/2315896594 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd95c004020 con 0x7fd96409f1e0 2023-10-03T10:16:19.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.099+0000 7f5fc67fc700 1 -- 172.21.15.146:0/3084889329 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5fcc023d50 con 0x7f5fd009ad40 2023-10-03T10:16:19.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.193+0000 7ff12e9d3700 1 -- 172.21.15.146:0/255302287 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff12804f2a0 con 0x7ff128130350 2023-10-03T10:16:19.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.194+0000 7ff124ff9700 1 -- 172.21.15.146:0/255302287 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff11c020360 con 0x7ff128130350 2023-10-03T10:16:19.195 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:19.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.196+0000 7ff12e9d3700 1 -- 172.21.15.146:0/255302287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff128130350 msgr2=0x7ff12811adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.196+0000 7ff12e9d3700 1 --2- 172.21.15.146:0/255302287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff128130350 0x7ff12811adb0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff11c012fc0 tx=0x7ff11c0100c0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.196+0000 7ff12e9d3700 1 -- 172.21.15.146:0/255302287 shutdown_connections 2023-10-03T10:16:19.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.196+0000 7ff12e9d3700 1 --2- 172.21.15.146:0/255302287 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff128130ca0 0x7ff12811b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.196+0000 7ff12e9d3700 1 --2- 172.21.15.146:0/255302287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff12812d2f0 0x7ff12811a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.196+0000 7ff12e9d3700 1 --2- 172.21.15.146:0/255302287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff128130350 0x7ff12811adb0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.196+0000 7ff12e9d3700 1 -- 172.21.15.146:0/255302287 >> 172.21.15.146:0/255302287 conn(0x7ff1280a2980 msgr2=0x7ff1280a0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.196+0000 7ff12e9d3700 1 -- 172.21.15.146:0/255302287 shutdown_connections 2023-10-03T10:16:19.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.196+0000 7ff12e9d3700 1 -- 172.21.15.146:0/255302287 wait complete. 2023-10-03T10:16:19.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:19.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.286+0000 7f81cd93e700 1 -- 172.21.15.146:0/4027964237 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f81c804f2a0 con 0x7f81c8131cf0 2023-10-03T10:16:19.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.286+0000 7f81affff700 1 -- 172.21.15.146:0/4027964237 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f81c0010300 con 0x7f81c8131cf0 2023-10-03T10:16:19.287 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:19.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.288+0000 7f81cd93e700 1 -- 172.21.15.146:0/4027964237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81c8131cf0 msgr2=0x7f81c81b9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.288+0000 7f81cd93e700 1 --2- 172.21.15.146:0/4027964237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81c8131cf0 0x7f81c81b9b30 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f81c000cb10 tx=0x7f81c000ce20 comp rx=0 tx=0).stop 2023-10-03T10:16:19.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.288+0000 7f81cd93e700 1 -- 172.21.15.146:0/4027964237 shutdown_connections 2023-10-03T10:16:19.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.288+0000 7f81cd93e700 1 --2- 172.21.15.146:0/4027964237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81c8131cf0 0x7f81c81b9b30 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.288+0000 7f81cd93e700 1 --2- 172.21.15.146:0/4027964237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81c806a770 0x7f81c81b90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.288+0000 7f81cd93e700 1 --2- 172.21.15.146:0/4027964237 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81c806b080 0x7f81c81b95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.288+0000 7f81cd93e700 1 -- 172.21.15.146:0/4027964237 >> 172.21.15.146:0/4027964237 conn(0x7f81c8099c40 msgr2=0x7f81c8131400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.288+0000 7f81cd93e700 1 -- 172.21.15.146:0/4027964237 shutdown_connections 2023-10-03T10:16:19.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.288+0000 7f81cd93e700 1 -- 172.21.15.146:0/4027964237 wait complete. 2023-10-03T10:16:19.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:19.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.309+0000 7fd96af11700 1 -- 172.21.15.146:0/2315896594 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd964120b30 con 0x7fd96409f1e0 2023-10-03T10:16:19.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.310+0000 7fd9617fa700 1 -- 172.21.15.146:0/2315896594 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd95c01cba0 con 0x7fd96409f1e0 2023-10-03T10:16:19.311 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:19.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.312+0000 7f5fd7eed700 1 -- 172.21.15.146:0/3084889329 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5fb8005590 con 0x7f5fd009ad40 2023-10-03T10:16:19.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.312+0000 7fd96af11700 1 -- 172.21.15.146:0/2315896594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd96409f1e0 msgr2=0x7fd96411f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.312+0000 7fd96af11700 1 --2- 172.21.15.146:0/2315896594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd96409f1e0 0x7fd96411f010 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009f00 tx=0x7fd95c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.312+0000 7fd96af11700 1 -- 172.21.15.146:0/2315896594 shutdown_connections 2023-10-03T10:16:19.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.312+0000 7fd96af11700 1 --2- 172.21.15.146:0/2315896594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd96409f1e0 0x7fd96411f010 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.312+0000 7fd96af11700 1 --2- 172.21.15.146:0/2315896594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd96409a130 0x7fd96413f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.312+0000 7fd96af11700 1 --2- 172.21.15.146:0/2315896594 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd96409edb0 0x7fd96411ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.312+0000 7fd96af11700 1 -- 172.21.15.146:0/2315896594 >> 172.21.15.146:0/2315896594 conn(0x7fd9640a4430 msgr2=0x7fd96409dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.312+0000 7f5fc67fc700 1 -- 172.21.15.146:0/3084889329 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5fcc02a030 con 0x7f5fd009ad40 2023-10-03T10:16:19.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.312+0000 7fd96af11700 1 -- 172.21.15.146:0/2315896594 shutdown_connections 2023-10-03T10:16:19.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.312+0000 7fd96af11700 1 -- 172.21.15.146:0/2315896594 wait complete. 2023-10-03T10:16:19.314 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:19.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.314+0000 7f5fd7eed700 1 -- 172.21.15.146:0/3084889329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fd009ad40 msgr2=0x7f5fd0132820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.314+0000 7f5fd7eed700 1 --2- 172.21.15.146:0/3084889329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fd009ad40 0x7f5fd0132820 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc014040 tx=0x7f5fcc004750 comp rx=0 tx=0).stop 2023-10-03T10:16:19.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.314+0000 7f5fd7eed700 1 -- 172.21.15.146:0/3084889329 shutdown_connections 2023-10-03T10:16:19.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.314+0000 7f5fd7eed700 1 --2- 172.21.15.146:0/3084889329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fd0133f70 0x7f5fd01332a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.314+0000 7f5fd7eed700 1 --2- 172.21.15.146:0/3084889329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fd009ad40 0x7f5fd0132820 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.314+0000 7f5fd7eed700 1 --2- 172.21.15.146:0/3084889329 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5fd00a0a70 0x7f5fd0132d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.314+0000 7f5fd7eed700 1 -- 172.21.15.146:0/3084889329 >> 172.21.15.146:0/3084889329 conn(0x7f5fd0099c40 msgr2=0x7f5fd009e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.314+0000 7f5fd7eed700 1 -- 172.21.15.146:0/3084889329 shutdown_connections 2023-10-03T10:16:19.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:19.314+0000 7f5fd7eed700 1 -- 172.21.15.146:0/3084889329 wait complete. 2023-10-03T10:16:19.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:19.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:20.210 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:20.302 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:20.326 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:20.328 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:20.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.347+0000 7fa826905700 1 Processor -- start 2023-10-03T10:16:20.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.347+0000 7fa826905700 1 -- start start 2023-10-03T10:16:20.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.347+0000 7fa826905700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa82009f350 0x7fa820136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.347+0000 7fa826905700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8201371c0 0x7fa8201395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.347+0000 7fa826905700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82009c970 con 0x7fa82009e870 2023-10-03T10:16:20.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.347+0000 7fa826905700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8200a0920 con 0x7fa8201371c0 2023-10-03T10:16:20.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.347+0000 7fa826905700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa82009f9c0 con 0x7fa82009f350 2023-10-03T10:16:20.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.347+0000 7fa824ea2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8201371c0 0x7fa8201395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.347+0000 7fa81f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa82009f350 0x7fa820136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.347+0000 7fa824ea2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8201371c0 0x7fa8201395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43852/0 (socket says 172.21.15.146:43852) 2023-10-03T10:16:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.347+0000 7fa824ea2700 1 -- 172.21.15.146:0/2650145694 learned_addr learned my addr 172.21.15.146:0/2650145694 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.348+0000 7fa81f7fe700 1 -- 172.21.15.146:0/2650145694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8201371c0 msgr2=0x7fa8201395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.348+0000 7fa81f7fe700 1 --2- 172.21.15.146:0/2650145694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8201371c0 0x7fa8201395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.348+0000 7fa81f7fe700 1 -- 172.21.15.146:0/2650145694 >> v1:172.21.15.146:6789/0 conn(0x7fa82009e870 legacy=0x7fa82009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.348+0000 7fa81f7fe700 1 -- 172.21.15.146:0/2650145694 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82009bab0 con 0x7fa82009f350 2023-10-03T10:16:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.348+0000 7fa81f7fe700 1 --2- 172.21.15.146:0/2650145694 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa82009f350 0x7fa820136c80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa814009870 tx=0x7fa814009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f18919f6f9f07be server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.348+0000 7fa81effd700 1 -- 172.21.15.146:0/2650145694 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814011830 con 0x7fa82009f350 2023-10-03T10:16:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.348+0000 7fa81effd700 1 -- 172.21.15.146:0/2650145694 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa814011990 con 0x7fa82009f350 2023-10-03T10:16:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.348+0000 7fa81effd700 1 -- 172.21.15.146:0/2650145694 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814011d20 con 0x7fa82009f350 2023-10-03T10:16:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.349+0000 7fa826905700 1 -- 172.21.15.146:0/2650145694 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa82009f350 msgr2=0x7fa820136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.349+0000 7fa826905700 1 --2- 172.21.15.146:0/2650145694 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa82009f350 0x7fa820136c80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa814009870 tx=0x7fa814009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.349+0000 7fa826905700 1 -- 172.21.15.146:0/2650145694 shutdown_connections 2023-10-03T10:16:20.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.349+0000 7fa826905700 1 --2- 172.21.15.146:0/2650145694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8201371c0 0x7fa8201395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.349+0000 7fa826905700 1 --2- 172.21.15.146:0/2650145694 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa82009f350 0x7fa820136c80 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.349+0000 7fa826905700 1 -- 172.21.15.146:0/2650145694 >> 172.21.15.146:0/2650145694 conn(0x7fa8200a4430 msgr2=0x7fa8200a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.350+0000 7fa826905700 1 -- 172.21.15.146:0/2650145694 shutdown_connections 2023-10-03T10:16:20.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.350+0000 7fa826905700 1 -- 172.21.15.146:0/2650145694 wait complete. 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.351+0000 7fa826905700 1 Processor -- start 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.351+0000 7fa826905700 1 -- start start 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.352+0000 7fa826905700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa82009e870 0x7fa82006c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.352+0000 7fa826905700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa82009f350 0x7fa82006c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.352+0000 7fa826905700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8201371c0 0x7fa8201c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.352+0000 7fa826905700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa820126420 con 0x7fa82009e870 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.352+0000 7fa826905700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82009dba0 con 0x7fa82009f350 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.352+0000 7fa826905700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa82006cd50 con 0x7fa8201371c0 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.352+0000 7fa81ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa82009e870 0x7fa82006c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.352+0000 7fa81ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa82009e870 0x7fa82006c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56352/0 (socket says 172.21.15.146:56352) 2023-10-03T10:16:20.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.352+0000 7fa81ffff700 1 -- 172.21.15.146:0/907519544 learned_addr learned my addr 172.21.15.146:0/907519544 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:20.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.352+0000 7fa824ea2700 1 --2- 172.21.15.146:0/907519544 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8201371c0 0x7fa8201c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.352+0000 7fa81f7fe700 1 --2- 172.21.15.146:0/907519544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa82009f350 0x7fa82006c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.352+0000 7fa81ffff700 1 -- 172.21.15.146:0/907519544 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8201371c0 msgr2=0x7fa8201c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.352+0000 7fa81ffff700 1 --2- 172.21.15.146:0/907519544 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8201371c0 0x7fa8201c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.352+0000 7fa81ffff700 1 -- 172.21.15.146:0/907519544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa82009f350 msgr2=0x7fa82006c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.352+0000 7fa81ffff700 1 --2- 172.21.15.146:0/907519544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa82009f350 0x7fa82006c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.352+0000 7fa81ffff700 1 -- 172.21.15.146:0/907519544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8140094a0 con 0x7fa82009e870 2023-10-03T10:16:20.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.352+0000 7fa824ea2700 1 --2- 172.21.15.146:0/907519544 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8201371c0 0x7fa8201c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.353+0000 7fa81ffff700 1 --2- 172.21.15.146:0/907519544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa82009e870 0x7fa82006c2d0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fa81000c730 tx=0x7fa81000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.353+0000 7fa81cff9700 1 -- 172.21.15.146:0/907519544 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa810015d70 con 0x7fa82009e870 2023-10-03T10:16:20.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.353+0000 7fa81cff9700 1 -- 172.21.15.146:0/907519544 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8100050d0 con 0x7fa82009e870 2023-10-03T10:16:20.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.353+0000 7fa826905700 1 -- 172.21.15.146:0/907519544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa820136460 con 0x7fa82009e870 2023-10-03T10:16:20.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.353+0000 7fa81cff9700 1 -- 172.21.15.146:0/907519544 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa810005480 con 0x7fa82009e870 2023-10-03T10:16:20.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.353+0000 7fa826905700 1 -- 172.21.15.146:0/907519544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa820124ee0 con 0x7fa82009e870 2023-10-03T10:16:20.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.354+0000 7fa81cff9700 1 -- 172.21.15.146:0/907519544 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa810003680 con 0x7fa82009e870 2023-10-03T10:16:20.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.354+0000 7fa81cff9700 1 -- 172.21.15.146:0/907519544 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa8100470a0 con 0x7fa82009e870 2023-10-03T10:16:20.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.354+0000 7fa826905700 1 -- 172.21.15.146:0/907519544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa82006bd70 con 0x7fa82009e870 2023-10-03T10:16:20.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.361+0000 7fa81cff9700 1 -- 172.21.15.146:0/907519544 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa82006bd70 con 0x7fa82009e870 2023-10-03T10:16:20.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.434+0000 7fbe6acb5700 1 Processor -- start 2023-10-03T10:16:20.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.434+0000 7fbe6acb5700 1 -- start start 2023-10-03T10:16:20.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.435+0000 7fbe6acb5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbe640a0a30 0x7fbe640a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.435+0000 7fbe6acb5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe640a1340 0x7fbe6412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.435+0000 7fbe6acb5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe640a1e70 con 0x7fbe641304a0 2023-10-03T10:16:20.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.435+0000 7fbe6acb5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe6409a720 con 0x7fbe640a0a30 2023-10-03T10:16:20.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.435+0000 7fbe6acb5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6409b300 con 0x7fbe640a1340 2023-10-03T10:16:20.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.435+0000 7fbe63fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe640a1340 0x7fbe6412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.435+0000 7fbe63fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe640a1340 0x7fbe6412ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43878/0 (socket says 172.21.15.146:43878) 2023-10-03T10:16:20.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.435+0000 7fbe63fff700 1 -- 172.21.15.146:0/997648283 learned_addr learned my addr 172.21.15.146:0/997648283 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:20.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.435+0000 7fbe68a51700 1 --2- 172.21.15.146:0/997648283 >> v2:172.21.15.146:3300/0 conn(0x7fbe640a0a30 0x7fbe640a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.435+0000 7fbe63fff700 1 -- 172.21.15.146:0/997648283 >> v2:172.21.15.146:3300/0 conn(0x7fbe640a0a30 msgr2=0x7fbe640a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.435+0000 7fbe63fff700 1 --2- 172.21.15.146:0/997648283 >> v2:172.21.15.146:3300/0 conn(0x7fbe640a0a30 0x7fbe640a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.435+0000 7fbe63fff700 1 -- 172.21.15.146:0/997648283 >> v1:172.21.15.146:6789/0 conn(0x7fbe641304a0 legacy=0x7fbe641371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.435+0000 7fbe63fff700 1 -- 172.21.15.146:0/997648283 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6409abc0 con 0x7fbe640a1340 2023-10-03T10:16:20.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.436+0000 7fbe63fff700 1 --2- 172.21.15.146:0/997648283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe640a1340 0x7fbe6412ff60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fbe500098f0 tx=0x7fbe50009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22985bd2f7082ac7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.436+0000 7fbe637fe700 1 -- 172.21.15.146:0/997648283 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50011830 con 0x7fbe640a1340 2023-10-03T10:16:20.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.436+0000 7fbe637fe700 1 -- 172.21.15.146:0/997648283 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe50011990 con 0x7fbe640a1340 2023-10-03T10:16:20.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.436+0000 7fbe637fe700 1 -- 172.21.15.146:0/997648283 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50011d20 con 0x7fbe640a1340 2023-10-03T10:16:20.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.436+0000 7fbe6acb5700 1 -- 172.21.15.146:0/997648283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe640a1340 msgr2=0x7fbe6412ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.436+0000 7fbe6acb5700 1 --2- 172.21.15.146:0/997648283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe640a1340 0x7fbe6412ff60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fbe500098f0 tx=0x7fbe50009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:20.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.437+0000 7fbe6acb5700 1 -- 172.21.15.146:0/997648283 shutdown_connections 2023-10-03T10:16:20.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.437+0000 7fbe6acb5700 1 --2- 172.21.15.146:0/997648283 >> v2:172.21.15.146:3300/0 conn(0x7fbe640a0a30 0x7fbe640a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.437+0000 7fbe6acb5700 1 --2- 172.21.15.146:0/997648283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe640a1340 0x7fbe6412ff60 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.437+0000 7fbe6acb5700 1 -- 172.21.15.146:0/997648283 >> 172.21.15.146:0/997648283 conn(0x7fbe640a2980 msgr2=0x7fbe640a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.437+0000 7fbe6acb5700 1 -- 172.21.15.146:0/997648283 shutdown_connections 2023-10-03T10:16:20.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.437+0000 7fbe6acb5700 1 -- 172.21.15.146:0/997648283 wait complete. 2023-10-03T10:16:20.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.437+0000 7fbe6acb5700 1 Processor -- start 2023-10-03T10:16:20.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.438+0000 7fbe6acb5700 1 -- start start 2023-10-03T10:16:20.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.438+0000 7fbe6acb5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe640a0a30 0x7fbe6413a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.438+0000 7fbe6acb5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe640a1340 0x7fbe6413af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.438+0000 7fbe6acb5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe641304a0 0x7fbe6413b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.438+0000 7fbe6acb5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6412fd10 con 0x7fbe640a0a30 2023-10-03T10:16:20.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.438+0000 7fbe6acb5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6413bf20 con 0x7fbe640a1340 2023-10-03T10:16:20.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.438+0000 7fbe6acb5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6409fda0 con 0x7fbe641304a0 2023-10-03T10:16:20.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.438+0000 7fbe63fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe640a1340 0x7fbe6413af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.438+0000 7fbe68a51700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe640a0a30 0x7fbe6413a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.438+0000 7fbe63fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe640a1340 0x7fbe6413af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43890/0 (socket says 172.21.15.146:43890) 2023-10-03T10:16:20.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.438+0000 7fbe63fff700 1 -- 172.21.15.146:0/1101849801 learned_addr learned my addr 172.21.15.146:0/1101849801 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:20.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.438+0000 7fbe69252700 1 --2- 172.21.15.146:0/1101849801 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe641304a0 0x7fbe6413b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.439+0000 7fbe63fff700 1 -- 172.21.15.146:0/1101849801 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe641304a0 msgr2=0x7fbe6413b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.439+0000 7fbe63fff700 1 --2- 172.21.15.146:0/1101849801 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe641304a0 0x7fbe6413b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.439+0000 7fbe63fff700 1 -- 172.21.15.146:0/1101849801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe640a0a30 msgr2=0x7fbe6413a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.439+0000 7fbe63fff700 1 --2- 172.21.15.146:0/1101849801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe640a0a30 0x7fbe6413a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.439+0000 7fbe63fff700 1 -- 172.21.15.146:0/1101849801 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe50009550 con 0x7fbe640a1340 2023-10-03T10:16:20.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.439+0000 7fbe68a51700 1 --2- 172.21.15.146:0/1101849801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe640a0a30 0x7fbe6413a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.439+0000 7fbe69252700 1 --2- 172.21.15.146:0/1101849801 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe641304a0 0x7fbe6413b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.439+0000 7fbe63fff700 1 --2- 172.21.15.146:0/1101849801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe640a1340 0x7fbe6413af30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbe50000c00 tx=0x7fbe50004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.439+0000 7fbe617fa700 1 -- 172.21.15.146:0/1101849801 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50004400 con 0x7fbe640a1340 2023-10-03T10:16:20.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.439+0000 7fbe617fa700 1 -- 172.21.15.146:0/1101849801 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5001f070 con 0x7fbe640a1340 2023-10-03T10:16:20.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.439+0000 7fbe6acb5700 1 -- 172.21.15.146:0/1101849801 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6409ae00 con 0x7fbe640a1340 2023-10-03T10:16:20.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.439+0000 7fbe617fa700 1 -- 172.21.15.146:0/1101849801 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe500038e0 con 0x7fbe640a1340 2023-10-03T10:16:20.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.439+0000 7fbe6acb5700 1 -- 172.21.15.146:0/1101849801 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe64130da0 con 0x7fbe640a1340 2023-10-03T10:16:20.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.440+0000 7fbe617fa700 1 -- 172.21.15.146:0/1101849801 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe50021030 con 0x7fbe640a1340 2023-10-03T10:16:20.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.440+0000 7fbe617fa700 1 -- 172.21.15.146:0/1101849801 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbe50040a40 con 0x7fbe640a1340 2023-10-03T10:16:20.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.440+0000 7fbe6acb5700 1 -- 172.21.15.146:0/1101849801 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe6413c300 con 0x7fbe640a1340 2023-10-03T10:16:20.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.449+0000 7fbe617fa700 1 -- 172.21.15.146:0/1101849801 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe50015080 con 0x7fbe640a1340 2023-10-03T10:16:20.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.477+0000 7f89a668d700 1 Processor -- start 2023-10-03T10:16:20.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.477+0000 7f89a668d700 1 -- start start 2023-10-03T10:16:20.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.478+0000 7f89a668d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f89a009f350 0x7f89a0138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.478+0000 7f89a668d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f89a01393a0 0x7f89a013b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.478+0000 7f89a668d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a009fa00 con 0x7f89a009e870 2023-10-03T10:16:20.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.478+0000 7f89a668d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a00a0370 con 0x7f89a01393a0 2023-10-03T10:16:20.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.478+0000 7f89a668d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89a006bec0 con 0x7f89a009f350 2023-10-03T10:16:20.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.478+0000 7f899ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f89a009e870 0x7f89a009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50398/0 (socket says 172.21.15.146:50398) 2023-10-03T10:16:20.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.478+0000 7f899ffff700 1 -- 172.21.15.146:0/469248563 learned_addr learned my addr 172.21.15.146:0/469248563 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:20.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.478+0000 7f899f7fe700 1 --2- 172.21.15.146:0/469248563 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f89a009f350 0x7f89a0138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.478+0000 7f89a4c2a700 1 --2- 172.21.15.146:0/469248563 >> v2:172.21.15.146:3300/0 conn(0x7f89a01393a0 0x7f89a013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.478+0000 7f899effd700 1 -- 172.21.15.146:0/469248563 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623875004 0 0) 0x7f89a009fa00 con 0x7f89a009e870 2023-10-03T10:16:20.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.478+0000 7f899effd700 1 -- 172.21.15.146:0/469248563 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f898800bdc0 con 0x7f89a009e870 2023-10-03T10:16:20.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.479+0000 7f899f7fe700 1 -- 172.21.15.146:0/469248563 >> v2:172.21.15.146:3300/0 conn(0x7f89a01393a0 msgr2=0x7f89a013b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.479+0000 7f899f7fe700 1 --2- 172.21.15.146:0/469248563 >> v2:172.21.15.146:3300/0 conn(0x7f89a01393a0 0x7f89a013b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.479+0000 7f899f7fe700 1 -- 172.21.15.146:0/469248563 >> v1:172.21.15.146:6789/0 conn(0x7f89a009e870 legacy=0x7f89a009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.479+0000 7f899f7fe700 1 -- 172.21.15.146:0/469248563 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a009ada0 con 0x7f89a009f350 2023-10-03T10:16:20.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.479+0000 7f89a4c2a700 1 --2- 172.21.15.146:0/469248563 >> v2:172.21.15.146:3300/0 conn(0x7f89a01393a0 0x7f89a013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.479+0000 7f899f7fe700 1 --2- 172.21.15.146:0/469248563 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f89a009f350 0x7f89a0138e60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8994009840 tx=0x7f8994009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=780de0974df235af server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.479+0000 7f899effd700 1 -- 172.21.15.146:0/469248563 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994004230 con 0x7f89a009f350 2023-10-03T10:16:20.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.479+0000 7f899effd700 1 -- 172.21.15.146:0/469248563 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8994004390 con 0x7f89a009f350 2023-10-03T10:16:20.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.479+0000 7f899effd700 1 -- 172.21.15.146:0/469248563 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89940036a0 con 0x7f89a009f350 2023-10-03T10:16:20.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.480+0000 7f89a668d700 1 -- 172.21.15.146:0/469248563 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f89a009f350 msgr2=0x7f89a0138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.480+0000 7f89a668d700 1 --2- 172.21.15.146:0/469248563 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f89a009f350 0x7f89a0138e60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8994009840 tx=0x7f8994009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:20.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.480+0000 7f89a668d700 1 -- 172.21.15.146:0/469248563 shutdown_connections 2023-10-03T10:16:20.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.480+0000 7f89a668d700 1 --2- 172.21.15.146:0/469248563 >> v2:172.21.15.146:3300/0 conn(0x7f89a01393a0 0x7f89a013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.480+0000 7f89a668d700 1 --2- 172.21.15.146:0/469248563 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f89a009f350 0x7f89a0138e60 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.480+0000 7f89a668d700 1 -- 172.21.15.146:0/469248563 >> 172.21.15.146:0/469248563 conn(0x7f89a00a4430 msgr2=0x7f89a00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.480+0000 7f89a668d700 1 -- 172.21.15.146:0/469248563 shutdown_connections 2023-10-03T10:16:20.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.480+0000 7f89a668d700 1 -- 172.21.15.146:0/469248563 wait complete. 2023-10-03T10:16:20.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.481+0000 7f89a668d700 1 Processor -- start 2023-10-03T10:16:20.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.482+0000 7f89a668d700 1 -- start start 2023-10-03T10:16:20.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.482+0000 7f9e02760700 1 Processor -- start 2023-10-03T10:16:20.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.482+0000 7f9e02760700 1 -- start start 2023-10-03T10:16:20.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.482+0000 7f89a668d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89a009e870 0x7f89a01351b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.482+0000 7f89a668d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89a009f350 0x7f89a01356f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.482+0000 7f89a668d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f89a01393a0 0x7f89a0135c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.482+0000 7f89a668d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a01377f0 con 0x7f89a009f350 2023-10-03T10:16:20.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.482+0000 7f89a668d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a01389e0 con 0x7f89a009e870 2023-10-03T10:16:20.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.482+0000 7f89a668d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89a006cfa0 con 0x7f89a01393a0 2023-10-03T10:16:20.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.483+0000 7f89a4c2a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f89a01393a0 0x7f89a0135c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.483+0000 7f89a4c2a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f89a01393a0 0x7f89a0135c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57672/0 (socket says 172.21.15.146:57672) 2023-10-03T10:16:20.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.483+0000 7f89a4c2a700 1 -- 172.21.15.146:0/3891889254 learned_addr learned my addr 172.21.15.146:0/3891889254 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:20.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.483+0000 7f9e02760700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9dfc133900 0x7f9dfc133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.483+0000 7f9e02760700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9dfc134210 0x7f9dfc0a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.483+0000 7f9e02760700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9dfc0a0ee0 0x7f9dfc0a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.483+0000 7f9e02760700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dfc09a760 con 0x7f9dfc134210 2023-10-03T10:16:20.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.483+0000 7f9e02760700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc1336e0 con 0x7f9dfc0a0ee0 2023-10-03T10:16:20.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.483+0000 7f9e02760700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc09a080 con 0x7f9dfc133900 2023-10-03T10:16:20.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.483+0000 7f899ffff700 1 --2- 172.21.15.146:0/3891889254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89a009e870 0x7f89a01351b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.483+0000 7f899f7fe700 1 --2- 172.21.15.146:0/3891889254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89a009f350 0x7f89a01356f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.483+0000 7f9dfbfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9dfc133900 0x7f9dfc133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.483+0000 7f9dfbfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9dfc133900 0x7f9dfc133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57684/0 (socket says 172.21.15.146:57684) 2023-10-03T10:16:20.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.483+0000 7f9dfbfff700 1 -- 172.21.15.146:0/3151012613 learned_addr learned my addr 172.21.15.146:0/3151012613 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:20.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.483+0000 7f9dfb7fe700 1 --2- 172.21.15.146:0/3151012613 >> v2:172.21.15.146:3300/0 conn(0x7f9dfc134210 0x7f9dfc0a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.483+0000 7f89a4c2a700 1 -- 172.21.15.146:0/3891889254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89a009e870 msgr2=0x7f89a01351b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.483+0000 7f89a4c2a700 1 --2- 172.21.15.146:0/3891889254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89a009e870 0x7f89a01351b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.483+0000 7f89a4c2a700 1 -- 172.21.15.146:0/3891889254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89a009f350 msgr2=0x7f89a01356f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.483+0000 7f89a4c2a700 1 --2- 172.21.15.146:0/3891889254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89a009f350 0x7f89a01356f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.483+0000 7f89a4c2a700 1 -- 172.21.15.146:0/3891889254 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8998009a70 con 0x7f89a01393a0 2023-10-03T10:16:20.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.483+0000 7f9e00cfd700 1 --2- 172.21.15.146:0/3151012613 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9dfc0a0ee0 0x7f9dfc0a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.484+0000 7f9e00cfd700 1 -- 172.21.15.146:0/3151012613 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9dfc133900 msgr2=0x7f9dfc133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.484+0000 7f9e00cfd700 1 --2- 172.21.15.146:0/3151012613 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9dfc133900 0x7f9dfc133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.484+0000 7f9e00cfd700 1 -- 172.21.15.146:0/3151012613 >> v2:172.21.15.146:3300/0 conn(0x7f9dfc134210 msgr2=0x7f9dfc0a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.484+0000 7f9e00cfd700 1 --2- 172.21.15.146:0/3151012613 >> v2:172.21.15.146:3300/0 conn(0x7f9dfc134210 0x7f9dfc0a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.484+0000 7f9e00cfd700 1 -- 172.21.15.146:0/3151012613 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc0a23e0 con 0x7f9dfc0a0ee0 2023-10-03T10:16:20.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.484+0000 7f89a4c2a700 1 --2- 172.21.15.146:0/3891889254 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f89a01393a0 0x7f89a0135c30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f899800ef90 tx=0x7f899800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.484+0000 7f9e00cfd700 1 --2- 172.21.15.146:0/3151012613 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9dfc0a0ee0 0x7f9dfc0a1360 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9de4009840 tx=0x7f9de4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e0b6510a4035acc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.484+0000 7f899cff9700 1 -- 172.21.15.146:0/3891889254 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899800cd40 con 0x7f89a01393a0 2023-10-03T10:16:20.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.485+0000 7f9dfaffd700 1 -- 172.21.15.146:0/3151012613 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4011830 con 0x7f9dfc0a0ee0 2023-10-03T10:16:20.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.485+0000 7f9dfaffd700 1 -- 172.21.15.146:0/3151012613 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de4011990 con 0x7f9dfc0a0ee0 2023-10-03T10:16:20.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.485+0000 7f9dfaffd700 1 -- 172.21.15.146:0/3151012613 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4011d00 con 0x7f9dfc0a0ee0 2023-10-03T10:16:20.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.485+0000 7f899cff9700 1 -- 172.21.15.146:0/3891889254 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899800f040 con 0x7f89a01393a0 2023-10-03T10:16:20.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.485+0000 7f899cff9700 1 -- 172.21.15.146:0/3891889254 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89980146c0 con 0x7f89a01393a0 2023-10-03T10:16:20.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.485+0000 7f89a668d700 1 -- 172.21.15.146:0/3891889254 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89940094a0 con 0x7f89a01393a0 2023-10-03T10:16:20.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.485+0000 7f89a668d700 1 -- 172.21.15.146:0/3891889254 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a006fbe0 con 0x7f89a01393a0 2023-10-03T10:16:20.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.485+0000 7f9e02760700 1 -- 172.21.15.146:0/3151012613 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9dfc0a0ee0 msgr2=0x7f9dfc0a1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.485+0000 7f9e02760700 1 --2- 172.21.15.146:0/3151012613 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9dfc0a0ee0 0x7f9dfc0a1360 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9de4009840 tx=0x7f9de4009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:20.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.486+0000 7f9e02760700 1 -- 172.21.15.146:0/3151012613 shutdown_connections 2023-10-03T10:16:20.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.486+0000 7f9e02760700 1 --2- 172.21.15.146:0/3151012613 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9dfc0a0ee0 0x7f9dfc0a1360 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.486+0000 7f9e02760700 1 --2- 172.21.15.146:0/3151012613 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9dfc133900 0x7f9dfc133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.486+0000 7f9e02760700 1 --2- 172.21.15.146:0/3151012613 >> v2:172.21.15.146:3300/0 conn(0x7f9dfc134210 0x7f9dfc0a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.486+0000 7f9e02760700 1 -- 172.21.15.146:0/3151012613 >> 172.21.15.146:0/3151012613 conn(0x7f9dfc0a2980 msgr2=0x7f9dfc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.486+0000 7f89a668d700 1 -- 172.21.15.146:0/3891889254 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a01383a0 con 0x7f89a01393a0 2023-10-03T10:16:20.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.486+0000 7f9e02760700 1 -- 172.21.15.146:0/3151012613 shutdown_connections 2023-10-03T10:16:20.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.487+0000 7f899cff9700 1 -- 172.21.15.146:0/3891889254 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8998014820 con 0x7f89a01393a0 2023-10-03T10:16:20.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.487+0000 7f9e02760700 1 -- 172.21.15.146:0/3151012613 wait complete. 2023-10-03T10:16:20.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.487+0000 7f899cff9700 1 -- 172.21.15.146:0/3891889254 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8998040950 con 0x7f89a01393a0 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.488+0000 7f9e02760700 1 Processor -- start 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.488+0000 7f9e02760700 1 -- start start 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.488+0000 7f9e02760700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9dfc0a0ee0 0x7f9dfc137030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.488+0000 7f9e02760700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9dfc133900 0x7f9dfc137570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.488+0000 7f9e02760700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dfc134210 0x7f9dfc137ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.488+0000 7f9e02760700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc119020 con 0x7f9dfc134210 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.488+0000 7f9e02760700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc119200 con 0x7f9dfc0a0ee0 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.488+0000 7f9e02760700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc09c2f0 con 0x7f9dfc133900 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.489+0000 7f9dfbfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9dfc0a0ee0 0x7f9dfc137030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.489+0000 7f9e00cfd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dfc134210 0x7f9dfc137ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.489+0000 7f9dfb7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9dfc133900 0x7f9dfc137570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.489+0000 7f9dfbfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9dfc0a0ee0 0x7f9dfc137030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43910/0 (socket says 172.21.15.146:43910) 2023-10-03T10:16:20.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.489+0000 7f9dfbfff700 1 -- 172.21.15.146:0/2904254121 learned_addr learned my addr 172.21.15.146:0/2904254121 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:20.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.489+0000 7f9e00cfd700 1 -- 172.21.15.146:0/2904254121 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9dfc133900 msgr2=0x7f9dfc137570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.489+0000 7f9e00cfd700 1 --2- 172.21.15.146:0/2904254121 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9dfc133900 0x7f9dfc137570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.489+0000 7f9e00cfd700 1 -- 172.21.15.146:0/2904254121 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9dfc0a0ee0 msgr2=0x7f9dfc137030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.489+0000 7f9e00cfd700 1 --2- 172.21.15.146:0/2904254121 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9dfc0a0ee0 0x7f9dfc137030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.489+0000 7f9e00cfd700 1 -- 172.21.15.146:0/2904254121 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de40094a0 con 0x7f9dfc134210 2023-10-03T10:16:20.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.489+0000 7f9dfbfff700 1 --2- 172.21.15.146:0/2904254121 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9dfc0a0ee0 0x7f9dfc137030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.489+0000 7f9e00cfd700 1 --2- 172.21.15.146:0/2904254121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dfc134210 0x7f9dfc137ab0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f9de4016000 tx=0x7f9de4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.489+0000 7f9df8ff9700 1 -- 172.21.15.146:0/2904254121 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4004510 con 0x7f9dfc134210 2023-10-03T10:16:20.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.490+0000 7f9df8ff9700 1 -- 172.21.15.146:0/2904254121 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de401f070 con 0x7f9dfc134210 2023-10-03T10:16:20.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.490+0000 7f9df8ff9700 1 -- 172.21.15.146:0/2904254121 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de40038e0 con 0x7f9dfc134210 2023-10-03T10:16:20.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.490+0000 7f9e02760700 1 -- 172.21.15.146:0/2904254121 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dfc138ce0 con 0x7f9dfc134210 2023-10-03T10:16:20.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.490+0000 7f9e02760700 1 -- 172.21.15.146:0/2904254121 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dfc139430 con 0x7f9dfc134210 2023-10-03T10:16:20.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.491+0000 7f9e02760700 1 -- 172.21.15.146:0/2904254121 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dfc04f2a0 con 0x7f9dfc134210 2023-10-03T10:16:20.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.491+0000 7f9df8ff9700 1 -- 172.21.15.146:0/2904254121 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9de4003a40 con 0x7f9dfc134210 2023-10-03T10:16:20.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.491+0000 7f9df8ff9700 1 -- 172.21.15.146:0/2904254121 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9de4021070 con 0x7f9dfc134210 2023-10-03T10:16:20.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.494+0000 7f899cff9700 1 -- 172.21.15.146:0/3891889254 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8998012700 con 0x7f89a01393a0 2023-10-03T10:16:20.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.497+0000 7f9df8ff9700 1 -- 172.21.15.146:0/2904254121 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9de4006c60 con 0x7f9dfc134210 2023-10-03T10:16:20.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.597+0000 7fa826905700 1 -- 172.21.15.146:0/907519544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa82006bd70 con 0x7fa82009e870 2023-10-03T10:16:20.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.597+0000 7fa81cff9700 1 -- 172.21.15.146:0/907519544 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa82006bd70 con 0x7fa82009e870 2023-10-03T10:16:20.598 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:20.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.599+0000 7fa826905700 1 -- 172.21.15.146:0/907519544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa82009e870 msgr2=0x7fa82006c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.599+0000 7fa826905700 1 --2- 172.21.15.146:0/907519544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa82009e870 0x7fa82006c2d0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fa81000c730 tx=0x7fa81000ca40 comp rx=0 tx=0).stop 2023-10-03T10:16:20.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.599+0000 7fa826905700 1 -- 172.21.15.146:0/907519544 shutdown_connections 2023-10-03T10:16:20.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.599+0000 7fa826905700 1 --2- 172.21.15.146:0/907519544 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa8201371c0 0x7fa8201c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.599+0000 7fa826905700 1 --2- 172.21.15.146:0/907519544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa82009e870 0x7fa82006c2d0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.599+0000 7fa826905700 1 --2- 172.21.15.146:0/907519544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa82009f350 0x7fa82006c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.599+0000 7fa826905700 1 -- 172.21.15.146:0/907519544 >> 172.21.15.146:0/907519544 conn(0x7fa8200a4430 msgr2=0x7fa8200a2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.599+0000 7fa826905700 1 -- 172.21.15.146:0/907519544 shutdown_connections 2023-10-03T10:16:20.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.599+0000 7fa826905700 1 -- 172.21.15.146:0/907519544 wait complete. 2023-10-03T10:16:20.612 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:20.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.681+0000 7fbe6acb5700 1 -- 172.21.15.146:0/1101849801 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbe6404f2a0 con 0x7fbe640a1340 2023-10-03T10:16:20.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.681+0000 7fbe617fa700 1 -- 172.21.15.146:0/1101849801 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe500199a0 con 0x7fbe640a1340 2023-10-03T10:16:20.682 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:20.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.684+0000 7fbe6acb5700 1 -- 172.21.15.146:0/1101849801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe640a1340 msgr2=0x7fbe6413af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.684+0000 7fbe6acb5700 1 --2- 172.21.15.146:0/1101849801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe640a1340 0x7fbe6413af30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbe50000c00 tx=0x7fbe50004750 comp rx=0 tx=0).stop 2023-10-03T10:16:20.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.684+0000 7fbe6acb5700 1 -- 172.21.15.146:0/1101849801 shutdown_connections 2023-10-03T10:16:20.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.684+0000 7fbe6acb5700 1 --2- 172.21.15.146:0/1101849801 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe641304a0 0x7fbe6413b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.684+0000 7fbe6acb5700 1 --2- 172.21.15.146:0/1101849801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe640a0a30 0x7fbe6413a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.684+0000 7fbe6acb5700 1 --2- 172.21.15.146:0/1101849801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe640a1340 0x7fbe6413af30 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.684+0000 7fbe6acb5700 1 -- 172.21.15.146:0/1101849801 >> 172.21.15.146:0/1101849801 conn(0x7fbe640a2980 msgr2=0x7fbe64127040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.684+0000 7fbe6acb5700 1 -- 172.21.15.146:0/1101849801 shutdown_connections 2023-10-03T10:16:20.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.684+0000 7fbe6acb5700 1 -- 172.21.15.146:0/1101849801 wait complete. 2023-10-03T10:16:20.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:20.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.734+0000 7f9e02760700 1 -- 172.21.15.146:0/2904254121 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9dfc139aa0 con 0x7f9dfc134210 2023-10-03T10:16:20.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.734+0000 7f9df8ff9700 1 -- 172.21.15.146:0/2904254121 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9de402b030 con 0x7f9dfc134210 2023-10-03T10:16:20.735 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:20.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.736+0000 7f9e02760700 1 -- 172.21.15.146:0/2904254121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dfc134210 msgr2=0x7f9dfc137ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.736+0000 7f9e02760700 1 --2- 172.21.15.146:0/2904254121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dfc134210 0x7f9dfc137ab0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f9de4016000 tx=0x7f9de4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:20.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.736+0000 7f9e02760700 1 -- 172.21.15.146:0/2904254121 shutdown_connections 2023-10-03T10:16:20.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.736+0000 7f9e02760700 1 --2- 172.21.15.146:0/2904254121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dfc134210 0x7f9dfc137ab0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.736+0000 7f9e02760700 1 --2- 172.21.15.146:0/2904254121 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9dfc0a0ee0 0x7f9dfc137030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.736+0000 7f9e02760700 1 --2- 172.21.15.146:0/2904254121 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9dfc133900 0x7f9dfc137570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.736+0000 7f9e02760700 1 -- 172.21.15.146:0/2904254121 >> 172.21.15.146:0/2904254121 conn(0x7f9dfc0a2980 msgr2=0x7f9dfc09df60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.736+0000 7f9e02760700 1 -- 172.21.15.146:0/2904254121 shutdown_connections 2023-10-03T10:16:20.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.736+0000 7f9e02760700 1 -- 172.21.15.146:0/2904254121 wait complete. 2023-10-03T10:16:20.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.740+0000 7f89a668d700 1 -- 172.21.15.146:0/3891889254 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f89a01383a0 con 0x7f89a01393a0 2023-10-03T10:16:20.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.741+0000 7f899cff9700 1 -- 172.21.15.146:0/3891889254 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f89a01383a0 con 0x7f89a01393a0 2023-10-03T10:16:20.741 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:20.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.743+0000 7f89a668d700 1 -- 172.21.15.146:0/3891889254 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f89a01393a0 msgr2=0x7f89a0135c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.743+0000 7f89a668d700 1 --2- 172.21.15.146:0/3891889254 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f89a01393a0 0x7f89a0135c30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f899800ef90 tx=0x7f899800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.743+0000 7f89a668d700 1 -- 172.21.15.146:0/3891889254 shutdown_connections 2023-10-03T10:16:20.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.743+0000 7f89a668d700 1 --2- 172.21.15.146:0/3891889254 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f89a01393a0 0x7f89a0135c30 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.743+0000 7f89a668d700 1 --2- 172.21.15.146:0/3891889254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89a009e870 0x7f89a01351b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.743+0000 7f89a668d700 1 --2- 172.21.15.146:0/3891889254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89a009f350 0x7f89a01356f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.743+0000 7f89a668d700 1 -- 172.21.15.146:0/3891889254 >> 172.21.15.146:0/3891889254 conn(0x7f89a00a4430 msgr2=0x7f89a01329b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.743+0000 7f89a668d700 1 -- 172.21.15.146:0/3891889254 shutdown_connections 2023-10-03T10:16:20.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:20.743+0000 7f89a668d700 1 -- 172.21.15.146:0/3891889254 wait complete. 2023-10-03T10:16:20.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:20.756 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:21.613 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:21.702 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:21.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.748+0000 7f43cc2d8700 1 Processor -- start 2023-10-03T10:16:21.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.749+0000 7f43cc2d8700 1 -- start start 2023-10-03T10:16:21.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.749+0000 7f43cc2d8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43c40a0a70 0x7f43c40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.749+0000 7f43cc2d8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43c40a1380 0x7f43c4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.749+0000 7f43cc2d8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c409dc00 con 0x7f43c4133f50 2023-10-03T10:16:21.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.749+0000 7f43cc2d8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c409ea60 con 0x7f43c40a1380 2023-10-03T10:16:21.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.749+0000 7f43cc2d8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43c409dec0 con 0x7f43c40a0a70 2023-10-03T10:16:21.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.749+0000 7f43ca074700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43c40a0a70 0x7f43c40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.749+0000 7f43c9873700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43c40a1380 0x7f43c4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.749+0000 7f43ca875700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f43c4133f50 0x7f43c413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50402/0 (socket says 172.21.15.146:50402) 2023-10-03T10:16:21.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.749+0000 7f43c9873700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43c40a1380 0x7f43c4133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43914/0 (socket says 172.21.15.146:43914) 2023-10-03T10:16:21.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.749+0000 7f43ca875700 1 -- 172.21.15.146:0/1319698625 learned_addr learned my addr 172.21.15.146:0/1319698625 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:21.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.749+0000 7f43ca074700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43c40a0a70 0x7f43c40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57704/0 (socket says 172.21.15.146:57704) 2023-10-03T10:16:21.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.750+0000 7f43c9072700 1 -- 172.21.15.146:0/1319698625 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083798294 0 0) 0x7f43c409dc00 con 0x7f43c4133f50 2023-10-03T10:16:21.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.750+0000 7f43ca074700 1 -- 172.21.15.146:0/1319698625 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43c40a1380 msgr2=0x7f43c4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:21.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.750+0000 7f43ca074700 1 --2- 172.21.15.146:0/1319698625 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43c40a1380 0x7f43c4133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.750+0000 7f43ca074700 1 -- 172.21.15.146:0/1319698625 >> v1:172.21.15.146:6789/0 conn(0x7f43c4133f50 legacy=0x7f43c413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.750+0000 7f43ca074700 1 -- 172.21.15.146:0/1319698625 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c409e6a0 con 0x7f43c40a0a70 2023-10-03T10:16:21.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.750+0000 7f43ca074700 1 --2- 172.21.15.146:0/1319698625 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43c40a0a70 0x7f43c40a0e40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009870 tx=0x7f43c0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3192f5e08888641 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.750+0000 7f43c9072700 1 -- 172.21.15.146:0/1319698625 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0011830 con 0x7f43c40a0a70 2023-10-03T10:16:21.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.750+0000 7f43c9072700 1 -- 172.21.15.146:0/1319698625 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c0011990 con 0x7f43c40a0a70 2023-10-03T10:16:21.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.750+0000 7f43c9072700 1 -- 172.21.15.146:0/1319698625 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0011d20 con 0x7f43c40a0a70 2023-10-03T10:16:21.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.750+0000 7f43cc2d8700 1 -- 172.21.15.146:0/1319698625 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43c40a0a70 msgr2=0x7f43c40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.751+0000 7f43cc2d8700 1 --2- 172.21.15.146:0/1319698625 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43c40a0a70 0x7f43c40a0e40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009870 tx=0x7f43c0009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:21.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.751+0000 7f43cc2d8700 1 -- 172.21.15.146:0/1319698625 shutdown_connections 2023-10-03T10:16:21.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.751+0000 7f43cc2d8700 1 --2- 172.21.15.146:0/1319698625 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43c40a0a70 0x7f43c40a0e40 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.751+0000 7f43cc2d8700 1 --2- 172.21.15.146:0/1319698625 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43c40a1380 0x7f43c4133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.751+0000 7f43cc2d8700 1 -- 172.21.15.146:0/1319698625 >> 172.21.15.146:0/1319698625 conn(0x7f43c40a6610 msgr2=0x7f43c40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.751+0000 7f43cc2d8700 1 -- 172.21.15.146:0/1319698625 shutdown_connections 2023-10-03T10:16:21.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.751+0000 7f43cc2d8700 1 -- 172.21.15.146:0/1319698625 wait complete. 2023-10-03T10:16:21.754 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.752+0000 7f43cc2d8700 1 Processor -- start 2023-10-03T10:16:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.752+0000 7f43cc2d8700 1 -- start start 2023-10-03T10:16:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.752+0000 7f43cc2d8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43c40a0a70 0x7f43c4122870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.752+0000 7f43cc2d8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43c40a1380 0x7f43c4122db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.752+0000 7f43cc2d8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43c4133f50 0x7f43c41232f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.752+0000 7f43cc2d8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c41260b0 con 0x7f43c40a1380 2023-10-03T10:16:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.752+0000 7f43cc2d8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c4123cd0 con 0x7f43c40a0a70 2023-10-03T10:16:21.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.752+0000 7f43cc2d8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43c4133970 con 0x7f43c4133f50 2023-10-03T10:16:21.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.752+0000 7f43c9873700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43c40a1380 0x7f43c4122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.752+0000 7f43c9873700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43c40a1380 0x7f43c4122db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56426/0 (socket says 172.21.15.146:56426) 2023-10-03T10:16:21.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.752+0000 7f43c9873700 1 -- 172.21.15.146:0/709133261 learned_addr learned my addr 172.21.15.146:0/709133261 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:21.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.752+0000 7f43ca875700 1 --2- 172.21.15.146:0/709133261 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43c4133f50 0x7f43c41232f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.752+0000 7f43ca074700 1 --2- 172.21.15.146:0/709133261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43c40a0a70 0x7f43c4122870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.752+0000 7f43c9873700 1 -- 172.21.15.146:0/709133261 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43c4133f50 msgr2=0x7f43c41232f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.752+0000 7f43c9873700 1 --2- 172.21.15.146:0/709133261 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43c4133f50 0x7f43c41232f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.752+0000 7f43c9873700 1 -- 172.21.15.146:0/709133261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43c40a0a70 msgr2=0x7f43c4122870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.752+0000 7f43c9873700 1 --2- 172.21.15.146:0/709133261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43c40a0a70 0x7f43c4122870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.752+0000 7f43c9873700 1 -- 172.21.15.146:0/709133261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c00094a0 con 0x7f43c40a1380 2023-10-03T10:16:21.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.752+0000 7f43ca875700 1 --2- 172.21.15.146:0/709133261 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43c4133f50 0x7f43c41232f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:21.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.752+0000 7f43ca074700 1 --2- 172.21.15.146:0/709133261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43c40a0a70 0x7f43c4122870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:21.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.753+0000 7f43c9873700 1 --2- 172.21.15.146:0/709133261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43c40a1380 0x7f43c4122db0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f43b400e980 tx=0x7f43b400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.753+0000 7f43baffd700 1 -- 172.21.15.146:0/709133261 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b4009710 con 0x7f43c40a1380 2023-10-03T10:16:21.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.753+0000 7f43baffd700 1 -- 172.21.15.146:0/709133261 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b400c690 con 0x7f43c40a1380 2023-10-03T10:16:21.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.753+0000 7f43cc2d8700 1 -- 172.21.15.146:0/709133261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c40a03e0 con 0x7f43c40a1380 2023-10-03T10:16:21.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.753+0000 7f43baffd700 1 -- 172.21.15.146:0/709133261 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b400ca20 con 0x7f43c40a1380 2023-10-03T10:16:21.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.753+0000 7f43cc2d8700 1 -- 172.21.15.146:0/709133261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c4125d60 con 0x7f43c40a1380 2023-10-03T10:16:21.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.753+0000 7f43baffd700 1 -- 172.21.15.146:0/709133261 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f43b400cb80 con 0x7f43c40a1380 2023-10-03T10:16:21.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.754+0000 7f43baffd700 1 -- 172.21.15.146:0/709133261 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f43b403f6f0 con 0x7f43c40a1380 2023-10-03T10:16:21.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.754+0000 7f43cc2d8700 1 -- 172.21.15.146:0/709133261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c404f2a0 con 0x7f43c40a1380 2023-10-03T10:16:21.759 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:21.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.758+0000 7f43baffd700 1 -- 172.21.15.146:0/709133261 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f43b40232f0 con 0x7f43c40a1380 2023-10-03T10:16:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.838+0000 7f21cfb40700 1 Processor -- start 2023-10-03T10:16:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.838+0000 7f21cfb40700 1 -- start start 2023-10-03T10:16:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.839+0000 7f21cfb40700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21c809e870 0x7f21c809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.839+0000 7f21cfb40700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21c809f180 0x7f21c8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.839+0000 7f21cfb40700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f21c8131d70 0x7f21c8132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.839+0000 7f21cfb40700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c80a0920 con 0x7f21c8131d70 2023-10-03T10:16:21.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.839+0000 7f21cfb40700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c809c970 con 0x7f21c809f180 2023-10-03T10:16:21.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.839+0000 7f21cfb40700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21c809bab0 con 0x7f21c809e870 2023-10-03T10:16:21.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.839+0000 7f21ce0dd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f21c8131d70 0x7f21c8132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.839+0000 7f21cd0db700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21c809f180 0x7f21c8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.839+0000 7f21ce0dd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f21c8131d70 0x7f21c8132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56440/0 (socket says 172.21.15.146:56440) 2023-10-03T10:16:21.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.839+0000 7f21ce0dd700 1 -- 172.21.15.146:0/1842333580 learned_addr learned my addr 172.21.15.146:0/1842333580 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:21.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.839+0000 7f21cd8dc700 1 --2- 172.21.15.146:0/1842333580 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21c809e870 0x7f21c809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.839+0000 7f21cd0db700 1 -- 172.21.15.146:0/1842333580 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21c809e870 msgr2=0x7f21c809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:21.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.839+0000 7f21cd0db700 1 --2- 172.21.15.146:0/1842333580 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21c809e870 0x7f21c809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.839+0000 7f21cd0db700 1 -- 172.21.15.146:0/1842333580 >> v2:172.21.15.146:3300/0 conn(0x7f21c8131d70 msgr2=0x7f21c8132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:21.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.839+0000 7f21cd0db700 1 --2- 172.21.15.146:0/1842333580 >> v2:172.21.15.146:3300/0 conn(0x7f21c8131d70 0x7f21c8132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.839+0000 7f21cd0db700 1 -- 172.21.15.146:0/1842333580 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c809f9c0 con 0x7f21c809f180 2023-10-03T10:16:21.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.839+0000 7f21ce0dd700 1 --2- 172.21.15.146:0/1842333580 >> v2:172.21.15.146:3300/0 conn(0x7f21c8131d70 0x7f21c8132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:21.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.840+0000 7f21cd0db700 1 --2- 172.21.15.146:0/1842333580 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21c809f180 0x7f21c8131830 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f21b8009840 tx=0x7f21b8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7902b0b75b36bfea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.840+0000 7f21cc8da700 1 -- 172.21.15.146:0/1842333580 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8011830 con 0x7f21c809f180 2023-10-03T10:16:21.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.840+0000 7f21cc8da700 1 -- 172.21.15.146:0/1842333580 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b8011990 con 0x7f21c809f180 2023-10-03T10:16:21.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.840+0000 7f21cc8da700 1 -- 172.21.15.146:0/1842333580 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8011d20 con 0x7f21c809f180 2023-10-03T10:16:21.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.840+0000 7f21cfb40700 1 -- 172.21.15.146:0/1842333580 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21c809f180 msgr2=0x7f21c8131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.840+0000 7f21cfb40700 1 --2- 172.21.15.146:0/1842333580 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21c809f180 0x7f21c8131830 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f21b8009840 tx=0x7f21b8009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:21.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.840+0000 7f21cfb40700 1 -- 172.21.15.146:0/1842333580 shutdown_connections 2023-10-03T10:16:21.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.840+0000 7f21cfb40700 1 --2- 172.21.15.146:0/1842333580 >> v2:172.21.15.146:3300/0 conn(0x7f21c8131d70 0x7f21c8132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.840+0000 7f21cfb40700 1 --2- 172.21.15.146:0/1842333580 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21c809e870 0x7f21c809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.840+0000 7f21cfb40700 1 --2- 172.21.15.146:0/1842333580 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21c809f180 0x7f21c8131830 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.840+0000 7f21cfb40700 1 -- 172.21.15.146:0/1842333580 >> 172.21.15.146:0/1842333580 conn(0x7f21c80a4430 msgr2=0x7f21c80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.841+0000 7f21cfb40700 1 -- 172.21.15.146:0/1842333580 shutdown_connections 2023-10-03T10:16:21.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.841+0000 7f21cfb40700 1 -- 172.21.15.146:0/1842333580 wait complete. 2023-10-03T10:16:21.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.842+0000 7f21cfb40700 1 Processor -- start 2023-10-03T10:16:21.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.842+0000 7f21cfb40700 1 -- start start 2023-10-03T10:16:21.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.842+0000 7f21cfb40700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21c809e870 0x7f21c811d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.842+0000 7f21cfb40700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21c809f180 0x7f21c811d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.842+0000 7f21cfb40700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21c8131d70 0x7f21c81c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.842+0000 7f21cfb40700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c8131310 con 0x7f21c8131d70 2023-10-03T10:16:21.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.842+0000 7f21cfb40700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c811ce40 con 0x7f21c809e870 2023-10-03T10:16:21.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.842+0000 7f21cfb40700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21c81201c0 con 0x7f21c809f180 2023-10-03T10:16:21.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.843+0000 7f21ce0dd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21c8131d70 0x7f21c81c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.843+0000 7f21cd8dc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21c809e870 0x7f21c811d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.843+0000 7f21ce0dd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21c8131d70 0x7f21c81c6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56454/0 (socket says 172.21.15.146:56454) 2023-10-03T10:16:21.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.843+0000 7f21cd8dc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21c809e870 0x7f21c811d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43930/0 (socket says 172.21.15.146:43930) 2023-10-03T10:16:21.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.843+0000 7f21ce0dd700 1 -- 172.21.15.146:0/1611849274 learned_addr learned my addr 172.21.15.146:0/1611849274 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:21.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.843+0000 7f21cd0db700 1 --2- 172.21.15.146:0/1611849274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21c809f180 0x7f21c811d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.843+0000 7f21cd8dc700 1 -- 172.21.15.146:0/1611849274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21c809f180 msgr2=0x7f21c811d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.843+0000 7f21cd8dc700 1 --2- 172.21.15.146:0/1611849274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21c809f180 0x7f21c811d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.843+0000 7f21cd8dc700 1 -- 172.21.15.146:0/1611849274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21c8131d70 msgr2=0x7f21c81c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.843+0000 7f21cd8dc700 1 --2- 172.21.15.146:0/1611849274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21c8131d70 0x7f21c81c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.843+0000 7f21cd8dc700 1 -- 172.21.15.146:0/1611849274 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c0009b30 con 0x7f21c809e870 2023-10-03T10:16:21.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.843+0000 7f21cd8dc700 1 --2- 172.21.15.146:0/1611849274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21c809e870 0x7f21c811d2e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f21c400e870 tx=0x7f21c400eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.843+0000 7f21be7fc700 1 -- 172.21.15.146:0/1611849274 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4013680 con 0x7f21c809e870 2023-10-03T10:16:21.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.844+0000 7f21be7fc700 1 -- 172.21.15.146:0/1611849274 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c40137e0 con 0x7f21c809e870 2023-10-03T10:16:21.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.844+0000 7f21cfb40700 1 -- 172.21.15.146:0/1611849274 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b80094a0 con 0x7f21c809e870 2023-10-03T10:16:21.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.844+0000 7f21cfb40700 1 -- 172.21.15.146:0/1611849274 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c811dd60 con 0x7f21c809e870 2023-10-03T10:16:21.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.845+0000 7f21be7fc700 1 -- 172.21.15.146:0/1611849274 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4013b50 con 0x7f21c809e870 2023-10-03T10:16:21.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.845+0000 7f21be7fc700 1 -- 172.21.15.146:0/1611849274 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f21c4013cb0 con 0x7f21c809e870 2023-10-03T10:16:21.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.845+0000 7f21be7fc700 1 -- 172.21.15.146:0/1611849274 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f21c403f5c0 con 0x7f21c809e870 2023-10-03T10:16:21.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.845+0000 7f21cfb40700 1 -- 172.21.15.146:0/1611849274 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b00052e0 con 0x7f21c809e870 2023-10-03T10:16:21.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.854+0000 7f21be7fc700 1 -- 172.21.15.146:0/1611849274 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21c401be10 con 0x7f21c809e870 2023-10-03T10:16:21.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.888+0000 7fdeaa29a700 1 Processor -- start 2023-10-03T10:16:21.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.888+0000 7fdeaa29a700 1 -- start start 2023-10-03T10:16:21.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.888+0000 7fdeaa29a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea4133ad0 0x7fdea4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.888+0000 7fdeaa29a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdea41300a0 0x7fdea41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.888+0000 7fdeaa29a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea406b2d0 con 0x7fdea41309f0 2023-10-03T10:16:21.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.888+0000 7fdeaa29a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea4133610 con 0x7fdea41300a0 2023-10-03T10:16:21.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.888+0000 7fdeaa29a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea409a500 con 0x7fdea4133ad0 2023-10-03T10:16:21.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.888+0000 7fdea37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdea41300a0 0x7fdea41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.888+0000 7fdea8837700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdea41309f0 0x7fdea413a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50414/0 (socket says 172.21.15.146:50414) 2023-10-03T10:16:21.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.888+0000 7fdea8837700 1 -- 172.21.15.146:0/2854965929 learned_addr learned my addr 172.21.15.146:0/2854965929 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:21.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.889+0000 7fdea3fff700 1 --2- 172.21.15.146:0/2854965929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea4133ad0 0x7fdea4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.889+0000 7fdea37fe700 1 -- 172.21.15.146:0/2854965929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea4133ad0 msgr2=0x7fdea4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:21.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.889+0000 7fdea37fe700 1 --2- 172.21.15.146:0/2854965929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea4133ad0 0x7fdea4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.889+0000 7fdea37fe700 1 -- 172.21.15.146:0/2854965929 >> v1:172.21.15.146:6789/0 conn(0x7fdea41309f0 legacy=0x7fdea413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.889+0000 7fdea37fe700 1 -- 172.21.15.146:0/2854965929 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea41338b0 con 0x7fdea41300a0 2023-10-03T10:16:21.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.889+0000 7fdea2ffd700 1 -- 172.21.15.146:0/2854965929 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47746107 0 0) 0x7fdea406b2d0 con 0x7fdea41309f0 2023-10-03T10:16:21.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.889+0000 7fdea37fe700 1 --2- 172.21.15.146:0/2854965929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdea41300a0 0x7fdea41304b0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fde98009840 tx=0x7fde98009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f418f0ff52d380 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.889+0000 7fdea2ffd700 1 -- 172.21.15.146:0/2854965929 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98011830 con 0x7fdea41300a0 2023-10-03T10:16:21.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.889+0000 7fdea2ffd700 1 -- 172.21.15.146:0/2854965929 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde98011990 con 0x7fdea41300a0 2023-10-03T10:16:21.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.889+0000 7fdea2ffd700 1 -- 172.21.15.146:0/2854965929 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98011d20 con 0x7fdea41300a0 2023-10-03T10:16:21.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.890+0000 7fdeaa29a700 1 -- 172.21.15.146:0/2854965929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdea41300a0 msgr2=0x7fdea41304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.890+0000 7fdeaa29a700 1 --2- 172.21.15.146:0/2854965929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdea41300a0 0x7fdea41304b0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fde98009840 tx=0x7fde98009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:21.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.890+0000 7fdeaa29a700 1 -- 172.21.15.146:0/2854965929 shutdown_connections 2023-10-03T10:16:21.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.890+0000 7fdeaa29a700 1 --2- 172.21.15.146:0/2854965929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea4133ad0 0x7fdea4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.890+0000 7fdeaa29a700 1 --2- 172.21.15.146:0/2854965929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdea41300a0 0x7fdea41304b0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.890+0000 7fdeaa29a700 1 -- 172.21.15.146:0/2854965929 >> 172.21.15.146:0/2854965929 conn(0x7fdea4099c40 msgr2=0x7fdea40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.890+0000 7fdeaa29a700 1 -- 172.21.15.146:0/2854965929 shutdown_connections 2023-10-03T10:16:21.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.890+0000 7fdeaa29a700 1 -- 172.21.15.146:0/2854965929 wait complete. 2023-10-03T10:16:21.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.892+0000 7fdeaa29a700 1 Processor -- start 2023-10-03T10:16:21.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.892+0000 7fdeaa29a700 1 -- start start 2023-10-03T10:16:21.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.893+0000 7fdeaa29a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdea41300a0 0x7fdea41cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.893+0000 7fdeaa29a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdea41309f0 0x7fdea41cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.893+0000 7fdeaa29a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea4133ad0 0x7fdea41cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.893+0000 7fdeaa29a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea4119ca0 con 0x7fdea41300a0 2023-10-03T10:16:21.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.893+0000 7fdeaa29a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea411a6a0 con 0x7fdea4133ad0 2023-10-03T10:16:21.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.893+0000 7fdeaa29a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdea411b570 con 0x7fdea41309f0 2023-10-03T10:16:21.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.893+0000 7fdea8837700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea4133ad0 0x7fdea41cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.893+0000 7fdea8837700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea4133ad0 0x7fdea41cd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43946/0 (socket says 172.21.15.146:43946) 2023-10-03T10:16:21.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.893+0000 7fdea8837700 1 -- 172.21.15.146:0/2230715063 learned_addr learned my addr 172.21.15.146:0/2230715063 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:21.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.893+0000 7fdea37fe700 1 --2- 172.21.15.146:0/2230715063 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdea41309f0 0x7fdea41cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.893+0000 7fdea3fff700 1 --2- 172.21.15.146:0/2230715063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdea41300a0 0x7fdea41cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.893+0000 7fdea8837700 1 -- 172.21.15.146:0/2230715063 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdea41309f0 msgr2=0x7fdea41cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.893+0000 7fdea8837700 1 --2- 172.21.15.146:0/2230715063 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdea41309f0 0x7fdea41cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.893+0000 7fdea8837700 1 -- 172.21.15.146:0/2230715063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdea41300a0 msgr2=0x7fdea41cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.893+0000 7fdea8837700 1 --2- 172.21.15.146:0/2230715063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdea41300a0 0x7fdea41cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.893+0000 7fdea8837700 1 -- 172.21.15.146:0/2230715063 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde980094a0 con 0x7fdea4133ad0 2023-10-03T10:16:21.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.893+0000 7fdea3fff700 1 --2- 172.21.15.146:0/2230715063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdea41300a0 0x7fdea41cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:21.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.893+0000 7fdea37fe700 1 --2- 172.21.15.146:0/2230715063 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdea41309f0 0x7fdea41cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:21.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.893+0000 7fdea8837700 1 --2- 172.21.15.146:0/2230715063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea4133ad0 0x7fdea41cd210 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fde9c00ccd0 tx=0x7fde9c00a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.897+0000 7fdea0ff9700 1 -- 172.21.15.146:0/2230715063 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c00ada0 con 0x7fdea4133ad0 2023-10-03T10:16:21.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.897+0000 7fdea0ff9700 1 -- 172.21.15.146:0/2230715063 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c0070d0 con 0x7fdea4133ad0 2023-10-03T10:16:21.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.897+0000 7fdeaa29a700 1 -- 172.21.15.146:0/2230715063 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea40a3400 con 0x7fdea4133ad0 2023-10-03T10:16:21.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.897+0000 7fdea0ff9700 1 -- 172.21.15.146:0/2230715063 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c007480 con 0x7fdea4133ad0 2023-10-03T10:16:21.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.898+0000 7fdeaa29a700 1 -- 172.21.15.146:0/2230715063 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea411c2a0 con 0x7fdea4133ad0 2023-10-03T10:16:21.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.899+0000 7fdea0ff9700 1 -- 172.21.15.146:0/2230715063 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde9c0075e0 con 0x7fdea4133ad0 2023-10-03T10:16:21.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.899+0000 7fdea0ff9700 1 -- 172.21.15.146:0/2230715063 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fde9c03f860 con 0x7fdea4133ad0 2023-10-03T10:16:21.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.899+0000 7fdeaa29a700 1 -- 172.21.15.146:0/2230715063 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde840052e0 con 0x7fdea4133ad0 2023-10-03T10:16:21.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.901+0000 7f48f92a6700 1 Processor -- start 2023-10-03T10:16:21.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.901+0000 7f48f92a6700 1 -- start start 2023-10-03T10:16:21.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.901+0000 7f48f92a6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f48f40a0a70 0x7f48f40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.901+0000 7f48f92a6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48f40a1380 0x7f48f4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.901+0000 7f48f92a6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48f4133f50 0x7f48f41343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.901+0000 7f48f92a6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f409e9d0 con 0x7f48f40a0a70 2023-10-03T10:16:21.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.901+0000 7f48f92a6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f409dc00 con 0x7f48f40a1380 2023-10-03T10:16:21.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.901+0000 7f48f92a6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48f409dec0 con 0x7f48f4133f50 2023-10-03T10:16:21.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.901+0000 7f48f2ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f48f40a0a70 0x7f48f40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.901+0000 7f48f2ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f48f40a0a70 0x7f48f40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56462/0 (socket says 172.21.15.146:56462) 2023-10-03T10:16:21.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.901+0000 7f48f2ffd700 1 -- 172.21.15.146:0/3236283510 learned_addr learned my addr 172.21.15.146:0/3236283510 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:21.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.901+0000 7f48f27fc700 1 --2- 172.21.15.146:0/3236283510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48f40a1380 0x7f48f4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.901+0000 7f48f37fe700 1 --2- 172.21.15.146:0/3236283510 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48f4133f50 0x7f48f41343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.902+0000 7f48f2ffd700 1 -- 172.21.15.146:0/3236283510 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48f4133f50 msgr2=0x7f48f41343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:21.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.902+0000 7f48f2ffd700 1 --2- 172.21.15.146:0/3236283510 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48f4133f50 0x7f48f41343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.902+0000 7f48f2ffd700 1 -- 172.21.15.146:0/3236283510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48f40a1380 msgr2=0x7f48f4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:21.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.902+0000 7f48f2ffd700 1 --2- 172.21.15.146:0/3236283510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48f40a1380 0x7f48f4133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.902+0000 7f48f2ffd700 1 -- 172.21.15.146:0/3236283510 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f409e6a0 con 0x7f48f40a0a70 2023-10-03T10:16:21.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.902+0000 7f48f2ffd700 1 --2- 172.21.15.146:0/3236283510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48f40a0a70 0x7f48f40a0e40 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f48e40098f0 tx=0x7f48e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447602422d45b9e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.903+0000 7f48f1ffb700 1 -- 172.21.15.146:0/3236283510 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e4011830 con 0x7f48f40a0a70 2023-10-03T10:16:21.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.903+0000 7f48f1ffb700 1 -- 172.21.15.146:0/3236283510 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e4011990 con 0x7f48f40a0a70 2023-10-03T10:16:21.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.903+0000 7f48f1ffb700 1 -- 172.21.15.146:0/3236283510 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e4011d20 con 0x7f48f40a0a70 2023-10-03T10:16:21.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.903+0000 7f48f92a6700 1 -- 172.21.15.146:0/3236283510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48f40a0a70 msgr2=0x7f48f40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.903+0000 7f48f92a6700 1 --2- 172.21.15.146:0/3236283510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48f40a0a70 0x7f48f40a0e40 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f48e40098f0 tx=0x7f48e4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:21.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.903+0000 7f48f92a6700 1 -- 172.21.15.146:0/3236283510 shutdown_connections 2023-10-03T10:16:21.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.903+0000 7f48f92a6700 1 --2- 172.21.15.146:0/3236283510 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48f4133f50 0x7f48f41343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.903+0000 7f48f92a6700 1 --2- 172.21.15.146:0/3236283510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48f40a0a70 0x7f48f40a0e40 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.903+0000 7f48f92a6700 1 --2- 172.21.15.146:0/3236283510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48f40a1380 0x7f48f4133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.903+0000 7f48f92a6700 1 -- 172.21.15.146:0/3236283510 >> 172.21.15.146:0/3236283510 conn(0x7f48f40a6610 msgr2=0x7f48f40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.903+0000 7f48f92a6700 1 -- 172.21.15.146:0/3236283510 shutdown_connections 2023-10-03T10:16:21.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.904+0000 7f48f92a6700 1 -- 172.21.15.146:0/3236283510 wait complete. 2023-10-03T10:16:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.905+0000 7f48f92a6700 1 Processor -- start 2023-10-03T10:16:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.905+0000 7f48f92a6700 1 -- start start 2023-10-03T10:16:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.906+0000 7f48f92a6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48f40a0a70 0x7f48f4121370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.906+0000 7f48f92a6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48f40a1380 0x7f48f41218b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.906+0000 7f48f92a6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48f4133f50 0x7f48f4121df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.906+0000 7f48f92a6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f4122840 con 0x7f48f4133f50 2023-10-03T10:16:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.906+0000 7f48f92a6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f41326f0 con 0x7f48f40a1380 2023-10-03T10:16:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.906+0000 7f48f92a6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48f4123dc0 con 0x7f48f40a0a70 2023-10-03T10:16:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.906+0000 7f48f2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48f40a0a70 0x7f48f4121370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.906+0000 7f48f37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48f4133f50 0x7f48f4121df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.906+0000 7f48f37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48f4133f50 0x7f48f4121df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56464/0 (socket says 172.21.15.146:56464) 2023-10-03T10:16:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.906+0000 7f48f37fe700 1 -- 172.21.15.146:0/3236164679 learned_addr learned my addr 172.21.15.146:0/3236164679 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.906+0000 7f48f2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48f40a0a70 0x7f48f4121370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57744/0 (socket says 172.21.15.146:57744) 2023-10-03T10:16:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.906+0000 7f48f27fc700 1 --2- 172.21.15.146:0/3236164679 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48f40a1380 0x7f48f41218b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.906+0000 7f48f37fe700 1 -- 172.21.15.146:0/3236164679 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48f40a0a70 msgr2=0x7f48f4121370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.906+0000 7f48f37fe700 1 --2- 172.21.15.146:0/3236164679 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48f40a0a70 0x7f48f4121370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.906+0000 7f48f37fe700 1 -- 172.21.15.146:0/3236164679 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48f40a1380 msgr2=0x7f48f41218b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.906+0000 7f48f37fe700 1 --2- 172.21.15.146:0/3236164679 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48f40a1380 0x7f48f41218b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.906+0000 7f48f37fe700 1 -- 172.21.15.146:0/3236164679 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e4009550 con 0x7f48f4133f50 2023-10-03T10:16:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.907+0000 7f48f37fe700 1 --2- 172.21.15.146:0/3236164679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48f4133f50 0x7f48f4121df0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009dd0 tx=0x7f48ec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.907+0000 7f48db7fe700 1 -- 172.21.15.146:0/3236164679 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec009c40 con 0x7f48f4133f50 2023-10-03T10:16:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.907+0000 7f48db7fe700 1 -- 172.21.15.146:0/3236164679 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ec00f040 con 0x7f48f4133f50 2023-10-03T10:16:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.907+0000 7f48db7fe700 1 -- 172.21.15.146:0/3236164679 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec014480 con 0x7f48f4133f50 2023-10-03T10:16:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.907+0000 7f48f92a6700 1 -- 172.21.15.146:0/3236164679 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f41248a0 con 0x7f48f4133f50 2023-10-03T10:16:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.907+0000 7f48f92a6700 1 -- 172.21.15.146:0/3236164679 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f40a03e0 con 0x7f48f4133f50 2023-10-03T10:16:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.908+0000 7f48db7fe700 1 -- 172.21.15.146:0/3236164679 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f48ec0145e0 con 0x7f48f4133f50 2023-10-03T10:16:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.909+0000 7fdea0ff9700 1 -- 172.21.15.146:0/2230715063 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde9c018030 con 0x7fdea4133ad0 2023-10-03T10:16:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.909+0000 7f48db7fe700 1 -- 172.21.15.146:0/3236164679 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f48ec040360 con 0x7f48f4133f50 2023-10-03T10:16:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.909+0000 7f48f92a6700 1 -- 172.21.15.146:0/3236164679 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f411e040 con 0x7f48f4133f50 2023-10-03T10:16:21.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.918+0000 7f48db7fe700 1 -- 172.21.15.146:0/3236164679 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48ec014890 con 0x7f48f4133f50 2023-10-03T10:16:21.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.966+0000 7f43cc2d8700 1 -- 172.21.15.146:0/709133261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f43c4072980 con 0x7f43c40a1380 2023-10-03T10:16:21.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.966+0000 7f43baffd700 1 -- 172.21.15.146:0/709133261 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f43b401bb60 con 0x7f43c40a1380 2023-10-03T10:16:21.967 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:21.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.969+0000 7f43cc2d8700 1 -- 172.21.15.146:0/709133261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43c40a1380 msgr2=0x7f43c4122db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.969+0000 7f43cc2d8700 1 --2- 172.21.15.146:0/709133261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43c40a1380 0x7f43c4122db0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f43b400e980 tx=0x7f43b400ec90 comp rx=0 tx=0).stop 2023-10-03T10:16:21.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.969+0000 7f43cc2d8700 1 -- 172.21.15.146:0/709133261 shutdown_connections 2023-10-03T10:16:21.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.969+0000 7f43cc2d8700 1 --2- 172.21.15.146:0/709133261 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43c4133f50 0x7f43c41232f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.969+0000 7f43cc2d8700 1 --2- 172.21.15.146:0/709133261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43c40a0a70 0x7f43c4122870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.969+0000 7f43cc2d8700 1 --2- 172.21.15.146:0/709133261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43c40a1380 0x7f43c4122db0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.969+0000 7f43cc2d8700 1 -- 172.21.15.146:0/709133261 >> 172.21.15.146:0/709133261 conn(0x7f43c40a6610 msgr2=0x7f43c40a4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.969+0000 7f43cc2d8700 1 -- 172.21.15.146:0/709133261 shutdown_connections 2023-10-03T10:16:21.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:21.969+0000 7f43cc2d8700 1 -- 172.21.15.146:0/709133261 wait complete. 2023-10-03T10:16:21.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:22.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.071+0000 7f21cfb40700 1 -- 172.21.15.146:0/1611849274 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f21b0005150 con 0x7f21c809e870 2023-10-03T10:16:22.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.072+0000 7f21be7fc700 1 -- 172.21.15.146:0/1611849274 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f21c401b3b0 con 0x7f21c809e870 2023-10-03T10:16:22.072 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:22.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.074+0000 7f21cfb40700 1 -- 172.21.15.146:0/1611849274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21c809e870 msgr2=0x7f21c811d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.074+0000 7f21cfb40700 1 --2- 172.21.15.146:0/1611849274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21c809e870 0x7f21c811d2e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f21c400e870 tx=0x7f21c400eb80 comp rx=0 tx=0).stop 2023-10-03T10:16:22.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.074+0000 7f21cfb40700 1 -- 172.21.15.146:0/1611849274 shutdown_connections 2023-10-03T10:16:22.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.074+0000 7f21cfb40700 1 --2- 172.21.15.146:0/1611849274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21c8131d70 0x7f21c81c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.074+0000 7f21cfb40700 1 --2- 172.21.15.146:0/1611849274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21c809e870 0x7f21c811d2e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.074+0000 7f21cfb40700 1 --2- 172.21.15.146:0/1611849274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f21c809f180 0x7f21c811d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.074+0000 7f21cfb40700 1 -- 172.21.15.146:0/1611849274 >> 172.21.15.146:0/1611849274 conn(0x7f21c80a4430 msgr2=0x7f21c81b9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:22.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.074+0000 7f21cfb40700 1 -- 172.21.15.146:0/1611849274 shutdown_connections 2023-10-03T10:16:22.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.074+0000 7f21cfb40700 1 -- 172.21.15.146:0/1611849274 wait complete. 2023-10-03T10:16:22.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.103+0000 7fdeaa29a700 1 -- 172.21.15.146:0/2230715063 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fde84005590 con 0x7fdea4133ad0 2023-10-03T10:16:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.103+0000 7fdea0ff9700 1 -- 172.21.15.146:0/2230715063 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fde9c01acd0 con 0x7fdea4133ad0 2023-10-03T10:16:22.104 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.106+0000 7fdeaa29a700 1 -- 172.21.15.146:0/2230715063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea4133ad0 msgr2=0x7fdea41cd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.106+0000 7fdeaa29a700 1 --2- 172.21.15.146:0/2230715063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea4133ad0 0x7fdea41cd210 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fde9c00ccd0 tx=0x7fde9c00a340 comp rx=0 tx=0).stop 2023-10-03T10:16:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.106+0000 7fdeaa29a700 1 -- 172.21.15.146:0/2230715063 shutdown_connections 2023-10-03T10:16:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.106+0000 7fdeaa29a700 1 --2- 172.21.15.146:0/2230715063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea4133ad0 0x7fdea41cd210 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.106+0000 7fdeaa29a700 1 --2- 172.21.15.146:0/2230715063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdea41300a0 0x7fdea41cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.106+0000 7fdeaa29a700 1 --2- 172.21.15.146:0/2230715063 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdea41309f0 0x7fdea41cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.106+0000 7fdeaa29a700 1 -- 172.21.15.146:0/2230715063 >> 172.21.15.146:0/2230715063 conn(0x7fdea4099c40 msgr2=0x7fdea4132960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.106+0000 7fdeaa29a700 1 -- 172.21.15.146:0/2230715063 shutdown_connections 2023-10-03T10:16:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.106+0000 7fdeaa29a700 1 -- 172.21.15.146:0/2230715063 wait complete. 2023-10-03T10:16:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.113+0000 7f48f92a6700 1 -- 172.21.15.146:0/3236164679 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f48f404f2a0 con 0x7f48f4133f50 2023-10-03T10:16:22.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.113+0000 7f48db7fe700 1 -- 172.21.15.146:0/3236164679 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f48ec02c090 con 0x7f48f4133f50 2023-10-03T10:16:22.114 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.115+0000 7f48f92a6700 1 -- 172.21.15.146:0/3236164679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48f4133f50 msgr2=0x7f48f4121df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.115+0000 7f48f92a6700 1 --2- 172.21.15.146:0/3236164679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48f4133f50 0x7f48f4121df0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009dd0 tx=0x7f48ec00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.115+0000 7f48f92a6700 1 -- 172.21.15.146:0/3236164679 shutdown_connections 2023-10-03T10:16:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.115+0000 7f48f92a6700 1 --2- 172.21.15.146:0/3236164679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48f4133f50 0x7f48f4121df0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.115+0000 7f48f92a6700 1 --2- 172.21.15.146:0/3236164679 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48f40a0a70 0x7f48f4121370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.115+0000 7f48f92a6700 1 --2- 172.21.15.146:0/3236164679 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48f40a1380 0x7f48f41218b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.116+0000 7f48f92a6700 1 -- 172.21.15.146:0/3236164679 >> 172.21.15.146:0/3236164679 conn(0x7f48f40a6610 msgr2=0x7f48f4133290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.116+0000 7f48f92a6700 1 -- 172.21.15.146:0/3236164679 shutdown_connections 2023-10-03T10:16:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:22.116+0000 7f48f92a6700 1 -- 172.21.15.146:0/3236164679 wait complete. 2023-10-03T10:16:22.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:22.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:22.984 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:23.087 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:23.120 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:23.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.122+0000 7f0f1c5d3700 1 Processor -- start 2023-10-03T10:16:23.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.122+0000 7f0f1c5d3700 1 -- start start 2023-10-03T10:16:23.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.123+0000 7f0f1c5d3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f1406a770 0x7f0f1406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.123+0000 7f0f1c5d3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0f1409dec0 0x7f0f1406b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.123+0000 7f0f1c5d3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f1406b5c0 con 0x7f0f14131a00 2023-10-03T10:16:23.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.123+0000 7f0f1c5d3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f1406e900 con 0x7f0f1409dec0 2023-10-03T10:16:23.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.123+0000 7f0f1c5d3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1409d180 con 0x7f0f1406a770 2023-10-03T10:16:23.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.123+0000 7f0f1a36f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f1406a770 0x7f0f1406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.123+0000 7f0f19b6e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0f1409dec0 0x7f0f1406b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.123+0000 7f0f1ab70700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0f14131a00 0x7f0f14131e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50430/0 (socket says 172.21.15.146:50430) 2023-10-03T10:16:23.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.123+0000 7f0f1ab70700 1 -- 172.21.15.146:0/3488060919 learned_addr learned my addr 172.21.15.146:0/3488060919 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:23.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.123+0000 7f0f1936d700 1 -- 172.21.15.146:0/3488060919 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651940122 0 0) 0x7f0f1406b5c0 con 0x7f0f14131a00 2023-10-03T10:16:23.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.123+0000 7f0f1936d700 1 -- 172.21.15.146:0/3488060919 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f000035b0 con 0x7f0f14131a00 2023-10-03T10:16:23.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.123+0000 7f0f19b6e700 1 -- 172.21.15.146:0/3488060919 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f1406a770 msgr2=0x7f0f1406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:23.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.123+0000 7f0f19b6e700 1 --2- 172.21.15.146:0/3488060919 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f1406a770 0x7f0f1406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.123+0000 7f0f19b6e700 1 -- 172.21.15.146:0/3488060919 >> v1:172.21.15.146:6789/0 conn(0x7f0f14131a00 legacy=0x7f0f14131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.123+0000 7f0f19b6e700 1 -- 172.21.15.146:0/3488060919 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1409e780 con 0x7f0f1409dec0 2023-10-03T10:16:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.124+0000 7f0f19b6e700 1 --2- 172.21.15.146:0/3488060919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f1409dec0 0x7f0f1406b080 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009840 tx=0x7f0f04009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac58c3a63dc93df5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.124+0000 7f0f1936d700 1 -- 172.21.15.146:0/3488060919 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f04011830 con 0x7f0f1409dec0 2023-10-03T10:16:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.124+0000 7f0f1936d700 1 -- 172.21.15.146:0/3488060919 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f04011990 con 0x7f0f1409dec0 2023-10-03T10:16:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.124+0000 7f0f1936d700 1 -- 172.21.15.146:0/3488060919 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f04011d20 con 0x7f0f1409dec0 2023-10-03T10:16:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.124+0000 7f0f1c5d3700 1 -- 172.21.15.146:0/3488060919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f1409dec0 msgr2=0x7f0f1406b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.124+0000 7f0f1c5d3700 1 --2- 172.21.15.146:0/3488060919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f1409dec0 0x7f0f1406b080 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009840 tx=0x7f0f04009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.125+0000 7f0f1c5d3700 1 -- 172.21.15.146:0/3488060919 shutdown_connections 2023-10-03T10:16:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.125+0000 7f0f1c5d3700 1 --2- 172.21.15.146:0/3488060919 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f1406a770 0x7f0f1406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.125+0000 7f0f1c5d3700 1 --2- 172.21.15.146:0/3488060919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f1409dec0 0x7f0f1406b080 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.125+0000 7f0f1c5d3700 1 -- 172.21.15.146:0/3488060919 >> 172.21.15.146:0/3488060919 conn(0x7f0f14099c40 msgr2=0x7f0f140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.125+0000 7f0f1c5d3700 1 -- 172.21.15.146:0/3488060919 shutdown_connections 2023-10-03T10:16:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.125+0000 7f0f1c5d3700 1 -- 172.21.15.146:0/3488060919 wait complete. 2023-10-03T10:16:23.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.126+0000 7f0f1c5d3700 1 Processor -- start 2023-10-03T10:16:23.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.126+0000 7f0f1c5d3700 1 -- start start 2023-10-03T10:16:23.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.126+0000 7f0f1c5d3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f1406a770 0x7f0f1409a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.126+0000 7f0f1c5d3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f1409dec0 0x7f0f1409a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.126+0000 7f0f1c5d3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f14131a00 0x7f0f1409af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.126+0000 7f0f1c5d3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1409b8f0 con 0x7f0f1406a770 2023-10-03T10:16:23.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.126+0000 7f0f1c5d3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1411f300 con 0x7f0f14131a00 2023-10-03T10:16:23.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.126+0000 7f0f1c5d3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f14130f50 con 0x7f0f1409dec0 2023-10-03T10:16:23.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.126+0000 7f0f1ab70700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f14131a00 0x7f0f1409af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.126+0000 7f0f1ab70700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f14131a00 0x7f0f1409af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43980/0 (socket says 172.21.15.146:43980) 2023-10-03T10:16:23.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.126+0000 7f0f1ab70700 1 -- 172.21.15.146:0/2202648328 learned_addr learned my addr 172.21.15.146:0/2202648328 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:23.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.126+0000 7f0f1a36f700 1 --2- 172.21.15.146:0/2202648328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f1406a770 0x7f0f1409a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.126+0000 7f0f19b6e700 1 --2- 172.21.15.146:0/2202648328 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f1409dec0 0x7f0f1409a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.127+0000 7f0f1ab70700 1 -- 172.21.15.146:0/2202648328 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f1409dec0 msgr2=0x7f0f1409a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.127+0000 7f0f1ab70700 1 --2- 172.21.15.146:0/2202648328 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f1409dec0 0x7f0f1409a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.127+0000 7f0f1ab70700 1 -- 172.21.15.146:0/2202648328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f1406a770 msgr2=0x7f0f1409a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.127+0000 7f0f1ab70700 1 --2- 172.21.15.146:0/2202648328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f1406a770 0x7f0f1409a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.127+0000 7f0f1ab70700 1 -- 172.21.15.146:0/2202648328 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f040094a0 con 0x7f0f14131a00 2023-10-03T10:16:23.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.127+0000 7f0f1a36f700 1 --2- 172.21.15.146:0/2202648328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f1406a770 0x7f0f1409a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.127+0000 7f0f1ab70700 1 --2- 172.21.15.146:0/2202648328 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f14131a00 0x7f0f1409af10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00cb40 tx=0x7f0f0c00ce50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.127+0000 7f0f0affd700 1 -- 172.21.15.146:0/2202648328 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c00aaa0 con 0x7f0f14131a00 2023-10-03T10:16:23.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.127+0000 7f0f0affd700 1 -- 172.21.15.146:0/2202648328 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0c00ac00 con 0x7f0f14131a00 2023-10-03T10:16:23.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.127+0000 7f0f1c5d3700 1 -- 172.21.15.146:0/2202648328 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f14071ce0 con 0x7f0f14131a00 2023-10-03T10:16:23.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.127+0000 7f0f0affd700 1 -- 172.21.15.146:0/2202648328 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c012400 con 0x7f0f14131a00 2023-10-03T10:16:23.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.127+0000 7f0f1c5d3700 1 -- 172.21.15.146:0/2202648328 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1411f820 con 0x7f0f14131a00 2023-10-03T10:16:23.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.128+0000 7f0f0affd700 1 -- 172.21.15.146:0/2202648328 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f0c01b3b0 con 0x7f0f14131a00 2023-10-03T10:16:23.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.128+0000 7f0f0affd700 1 -- 172.21.15.146:0/2202648328 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0f0c03f4a0 con 0x7f0f14131a00 2023-10-03T10:16:23.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.128+0000 7f0f1c5d3700 1 -- 172.21.15.146:0/2202648328 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f1404f2a0 con 0x7f0f14131a00 2023-10-03T10:16:23.132 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:23.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.133+0000 7f0f0affd700 1 -- 172.21.15.146:0/2202648328 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f0c0113a0 con 0x7f0f14131a00 2023-10-03T10:16:23.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.229+0000 7f23dc14d700 1 Processor -- start 2023-10-03T10:16:23.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.229+0000 7f23dc14d700 1 -- start start 2023-10-03T10:16:23.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.230+0000 7f23dc14d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d41347b0 0x7f23d4136b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.230+0000 7f23dc14d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d41370d0 0x7f23d41394b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.230+0000 7f23dc14d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d406f970 con 0x7f23d4098410 2023-10-03T10:16:23.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.230+0000 7f23dc14d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d40720a0 con 0x7f23d41347b0 2023-10-03T10:16:23.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.230+0000 7f23dc14d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23d4098ef0 con 0x7f23d41370d0 2023-10-03T10:16:23.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.230+0000 7f23d96e8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d41347b0 0x7f23d4136b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.230+0000 7f23d96e8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d41347b0 0x7f23d4136b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43988/0 (socket says 172.21.15.146:43988) 2023-10-03T10:16:23.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.230+0000 7f23d96e8700 1 -- 172.21.15.146:0/349039042 learned_addr learned my addr 172.21.15.146:0/349039042 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:23.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.230+0000 7f23da6ea700 1 --2- 172.21.15.146:0/349039042 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d41370d0 0x7f23d41394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.230+0000 7f23da6ea700 1 -- 172.21.15.146:0/349039042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d41347b0 msgr2=0x7f23d4136b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:23.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.230+0000 7f23da6ea700 1 --2- 172.21.15.146:0/349039042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d41347b0 0x7f23d4136b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.230+0000 7f23da6ea700 1 -- 172.21.15.146:0/349039042 >> v1:172.21.15.146:6789/0 conn(0x7f23d4098410 legacy=0x7f23d40987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.230+0000 7f23da6ea700 1 -- 172.21.15.146:0/349039042 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d4072290 con 0x7f23d41370d0 2023-10-03T10:16:23.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.230+0000 7f23d96e8700 1 --2- 172.21.15.146:0/349039042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d41347b0 0x7f23d4136b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.231+0000 7f23da6ea700 1 --2- 172.21.15.146:0/349039042 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d41370d0 0x7f23d41394b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009dc0 tx=0x7f23cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64fdb5a9854def55 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.231+0000 7f23d8ee7700 1 -- 172.21.15.146:0/349039042 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc00e070 con 0x7f23d41370d0 2023-10-03T10:16:23.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.231+0000 7f23d8ee7700 1 -- 172.21.15.146:0/349039042 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc00bac0 con 0x7f23d41370d0 2023-10-03T10:16:23.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.231+0000 7f23d8ee7700 1 -- 172.21.15.146:0/349039042 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc00be70 con 0x7f23d41370d0 2023-10-03T10:16:23.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.232+0000 7f23dc14d700 1 -- 172.21.15.146:0/349039042 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d41370d0 msgr2=0x7f23d41394b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.232+0000 7f23dc14d700 1 --2- 172.21.15.146:0/349039042 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d41370d0 0x7f23d41394b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009dc0 tx=0x7f23cc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:23.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.232+0000 7f23dc14d700 1 -- 172.21.15.146:0/349039042 shutdown_connections 2023-10-03T10:16:23.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.232+0000 7f23dc14d700 1 --2- 172.21.15.146:0/349039042 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d41370d0 0x7f23d41394b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.232+0000 7f23dc14d700 1 --2- 172.21.15.146:0/349039042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d41347b0 0x7f23d4136b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.232+0000 7f23dc14d700 1 -- 172.21.15.146:0/349039042 >> 172.21.15.146:0/349039042 conn(0x7f23d40a2b30 msgr2=0x7f23d409e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.232+0000 7f23dc14d700 1 -- 172.21.15.146:0/349039042 shutdown_connections 2023-10-03T10:16:23.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.232+0000 7f23dc14d700 1 -- 172.21.15.146:0/349039042 wait complete. 2023-10-03T10:16:23.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.233+0000 7f23dc14d700 1 Processor -- start 2023-10-03T10:16:23.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.233+0000 7f23dc14d700 1 -- start start 2023-10-03T10:16:23.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.233+0000 7f23dc14d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d4098410 0x7f23d41c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.233+0000 7f23dc14d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d41347b0 0x7f23d41c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.233+0000 7f23dc14d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d41370d0 0x7f23d406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.233+0000 7f23dc14d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d4136ba0 con 0x7f23d41370d0 2023-10-03T10:16:23.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.233+0000 7f23dc14d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d412bc20 con 0x7f23d4098410 2023-10-03T10:16:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.233+0000 7f23dc14d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23d409c220 con 0x7f23d41347b0 2023-10-03T10:16:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.234+0000 7f23d96e8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d41347b0 0x7f23d41c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.234+0000 7f23d9ee9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d4098410 0x7f23d41c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.234+0000 7f23d96e8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d41347b0 0x7f23d41c8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57782/0 (socket says 172.21.15.146:57782) 2023-10-03T10:16:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.234+0000 7f23d9ee9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d4098410 0x7f23d41c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43996/0 (socket says 172.21.15.146:43996) 2023-10-03T10:16:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.234+0000 7f23d96e8700 1 -- 172.21.15.146:0/452219745 learned_addr learned my addr 172.21.15.146:0/452219745 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.234+0000 7f23d96e8700 1 -- 172.21.15.146:0/452219745 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d4098410 msgr2=0x7f23d41c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.234+0000 7f23d96e8700 1 --2- 172.21.15.146:0/452219745 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d4098410 0x7f23d41c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.234+0000 7f23d96e8700 1 -- 172.21.15.146:0/452219745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d41370d0 msgr2=0x7f23d406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.234+0000 7f23d96e8700 1 --2- 172.21.15.146:0/452219745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d41370d0 0x7f23d406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.234+0000 7f23d96e8700 1 -- 172.21.15.146:0/452219745 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c4009550 con 0x7f23d41347b0 2023-10-03T10:16:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.234+0000 7f23d9ee9700 1 --2- 172.21.15.146:0/452219745 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d4098410 0x7f23d41c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.234+0000 7f23d96e8700 1 --2- 172.21.15.146:0/452219745 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d41347b0 0x7f23d41c8be0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f23c400ec10 tx=0x7f23c400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.234+0000 7f23ca7fc700 1 -- 172.21.15.146:0/452219745 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c400c850 con 0x7f23d41347b0 2023-10-03T10:16:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.234+0000 7f23ca7fc700 1 -- 172.21.15.146:0/452219745 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c400c9b0 con 0x7f23d41347b0 2023-10-03T10:16:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.234+0000 7f23dc14d700 1 -- 172.21.15.146:0/452219745 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23cc009a70 con 0x7f23d41347b0 2023-10-03T10:16:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.234+0000 7f23ca7fc700 1 -- 172.21.15.146:0/452219745 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c400cd20 con 0x7f23d41347b0 2023-10-03T10:16:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.234+0000 7f23dc14d700 1 -- 172.21.15.146:0/452219745 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d406f640 con 0x7f23d41347b0 2023-10-03T10:16:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.235+0000 7f23ca7fc700 1 -- 172.21.15.146:0/452219745 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23c4013470 con 0x7f23d41347b0 2023-10-03T10:16:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.235+0000 7f23dc14d700 1 -- 172.21.15.146:0/452219745 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d404f2a0 con 0x7f23d41347b0 2023-10-03T10:16:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.236+0000 7f23ca7fc700 1 -- 172.21.15.146:0/452219745 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f23c403f6b0 con 0x7f23d41347b0 2023-10-03T10:16:23.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.244+0000 7f23ca7fc700 1 -- 172.21.15.146:0/452219745 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23c400ce80 con 0x7f23d41347b0 2023-10-03T10:16:23.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.263+0000 7fd3d97c0700 1 Processor -- start 2023-10-03T10:16:23.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.263+0000 7fd3d97c0700 1 -- start start 2023-10-03T10:16:23.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.264+0000 7fd3d97c0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd3d4131980 0x7fd3d4131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.264+0000 7fd3d97c0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3d409c790 0x7fd3d4139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.264+0000 7fd3d97c0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d40a1640 con 0x7fd3d409bc70 2023-10-03T10:16:23.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.264+0000 7fd3d97c0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d406eb30 con 0x7fd3d4131980 2023-10-03T10:16:23.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.264+0000 7fd3d97c0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d40a22d0 con 0x7fd3d409c790 2023-10-03T10:16:23.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.264+0000 7fd3d27fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd3d409bc70 0x7fd3d409c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50450/0 (socket says 172.21.15.146:50450) 2023-10-03T10:16:23.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.264+0000 7fd3d27fc700 1 -- 172.21.15.146:0/2808022460 learned_addr learned my addr 172.21.15.146:0/2808022460 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:23.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.264+0000 7fd3d37fe700 1 --2- 172.21.15.146:0/2808022460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3d409c790 0x7fd3d4139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.264+0000 7fd3d2ffd700 1 --2- 172.21.15.146:0/2808022460 >> v2:172.21.15.146:3300/0 conn(0x7fd3d4131980 0x7fd3d4131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.264+0000 7fd3d1ffb700 1 -- 172.21.15.146:0/2808022460 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161350153 0 0) 0x7fd3d40a1640 con 0x7fd3d409bc70 2023-10-03T10:16:23.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.264+0000 7fd3d1ffb700 1 -- 172.21.15.146:0/2808022460 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3bc0035b0 con 0x7fd3d409bc70 2023-10-03T10:16:23.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.264+0000 7fd3d2ffd700 1 -- 172.21.15.146:0/2808022460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3d409c790 msgr2=0x7fd3d4139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:23.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.264+0000 7fd3d2ffd700 1 --2- 172.21.15.146:0/2808022460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3d409c790 0x7fd3d4139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.264+0000 7fd3d2ffd700 1 -- 172.21.15.146:0/2808022460 >> v1:172.21.15.146:6789/0 conn(0x7fd3d409bc70 legacy=0x7fd3d409c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.264+0000 7fd3d2ffd700 1 -- 172.21.15.146:0/2808022460 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d4131550 con 0x7fd3d4131980 2023-10-03T10:16:23.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.265+0000 7fd3d2ffd700 1 --2- 172.21.15.146:0/2808022460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3d4131980 0x7fd3d4131d50 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4009820 tx=0x7fd3c4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d44420a63baa34 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.265+0000 7fd3d1ffb700 1 -- 172.21.15.146:0/2808022460 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4005e30 con 0x7fd3d4131980 2023-10-03T10:16:23.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.265+0000 7fd3d1ffb700 1 -- 172.21.15.146:0/2808022460 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c4006030 con 0x7fd3d4131980 2023-10-03T10:16:23.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.265+0000 7fd3d1ffb700 1 -- 172.21.15.146:0/2808022460 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c40063c0 con 0x7fd3d4131980 2023-10-03T10:16:23.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.266+0000 7fd3d97c0700 1 -- 172.21.15.146:0/2808022460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3d4131980 msgr2=0x7fd3d4131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.266+0000 7fd3d97c0700 1 --2- 172.21.15.146:0/2808022460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3d4131980 0x7fd3d4131d50 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4009820 tx=0x7fd3c4009b30 comp rx=0 tx=0).stop 2023-10-03T10:16:23.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.266+0000 7fd3d97c0700 1 -- 172.21.15.146:0/2808022460 shutdown_connections 2023-10-03T10:16:23.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.266+0000 7fd3d97c0700 1 --2- 172.21.15.146:0/2808022460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3d409c790 0x7fd3d4139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.266+0000 7fd3d97c0700 1 --2- 172.21.15.146:0/2808022460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3d4131980 0x7fd3d4131d50 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.266+0000 7fd3d97c0700 1 -- 172.21.15.146:0/2808022460 >> 172.21.15.146:0/2808022460 conn(0x7fd3d40a2980 msgr2=0x7fd3d40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.266+0000 7fd3d97c0700 1 -- 172.21.15.146:0/2808022460 shutdown_connections 2023-10-03T10:16:23.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.266+0000 7fd3d97c0700 1 -- 172.21.15.146:0/2808022460 wait complete. 2023-10-03T10:16:23.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.267+0000 7fd3d97c0700 1 Processor -- start 2023-10-03T10:16:23.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.267+0000 7fd3d97c0700 1 -- start start 2023-10-03T10:16:23.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.268+0000 7fd3d97c0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3d409bc70 0x7fd3d4119680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.268+0000 7fd3d97c0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3d409c790 0x7fd3d4119bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.268+0000 7fd3d97c0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3d4131980 0x7fd3d411a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.268+0000 7fd3d97c0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d411ab30 con 0x7fd3d409c790 2023-10-03T10:16:23.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.268+0000 7fd3d97c0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d411b290 con 0x7fd3d4131980 2023-10-03T10:16:23.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.268+0000 7fd3d97c0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d411c4e0 con 0x7fd3d409bc70 2023-10-03T10:16:23.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.268+0000 7fd3d2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3d409bc70 0x7fd3d4119680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.268+0000 7fd3d2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3d409bc70 0x7fd3d4119680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57794/0 (socket says 172.21.15.146:57794) 2023-10-03T10:16:23.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.268+0000 7fd3d2ffd700 1 -- 172.21.15.146:0/174478002 learned_addr learned my addr 172.21.15.146:0/174478002 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:23.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.268+0000 7fd3d37fe700 1 --2- 172.21.15.146:0/174478002 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3d4131980 0x7fd3d411a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.268+0000 7fd3d27fc700 1 --2- 172.21.15.146:0/174478002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3d409c790 0x7fd3d4119bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.269+0000 7fd3d2ffd700 1 -- 172.21.15.146:0/174478002 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3d4131980 msgr2=0x7fd3d411a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.269+0000 7fd3d2ffd700 1 --2- 172.21.15.146:0/174478002 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3d4131980 0x7fd3d411a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.269+0000 7fd3d2ffd700 1 -- 172.21.15.146:0/174478002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3d409c790 msgr2=0x7fd3d4119bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.269+0000 7fd3d2ffd700 1 --2- 172.21.15.146:0/174478002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3d409c790 0x7fd3d4119bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.269+0000 7fd3d2ffd700 1 -- 172.21.15.146:0/174478002 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c4009430 con 0x7fd3d409bc70 2023-10-03T10:16:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.269+0000 7fd3d27fc700 1 --2- 172.21.15.146:0/174478002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3d409c790 0x7fd3d4119bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.269+0000 7fd3d2ffd700 1 --2- 172.21.15.146:0/174478002 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3d409bc70 0x7fd3d4119680 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4131460 tx=0x7fd3c4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.269+0000 7fd3bb7fe700 1 -- 172.21.15.146:0/174478002 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4004040 con 0x7fd3d409bc70 2023-10-03T10:16:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.269+0000 7fd3bb7fe700 1 -- 172.21.15.146:0/174478002 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c4028070 con 0x7fd3d409bc70 2023-10-03T10:16:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.269+0000 7fd3d97c0700 1 -- 172.21.15.146:0/174478002 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d411cec0 con 0x7fd3d409bc70 2023-10-03T10:16:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.269+0000 7fd3bb7fe700 1 -- 172.21.15.146:0/174478002 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4004400 con 0x7fd3d409bc70 2023-10-03T10:16:23.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.269+0000 7fd3d97c0700 1 -- 172.21.15.146:0/174478002 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d40a1c40 con 0x7fd3d409bc70 2023-10-03T10:16:23.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.270+0000 7fd3bb7fe700 1 -- 172.21.15.146:0/174478002 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd3c402a030 con 0x7fd3d409bc70 2023-10-03T10:16:23.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.270+0000 7fd3d97c0700 1 -- 172.21.15.146:0/174478002 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d404f2a0 con 0x7fd3d409bc70 2023-10-03T10:16:23.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.270+0000 7fd3bb7fe700 1 -- 172.21.15.146:0/174478002 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd3c4049a80 con 0x7fd3d409bc70 2023-10-03T10:16:23.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.279+0000 7fd3bb7fe700 1 -- 172.21.15.146:0/174478002 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3c40197c0 con 0x7fd3d409bc70 2023-10-03T10:16:23.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.279+0000 7f851b0ee700 1 Processor -- start 2023-10-03T10:16:23.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.279+0000 7f851b0ee700 1 -- start start 2023-10-03T10:16:23.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.280+0000 7f851b0ee700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f851406a770 0x7f85141349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.280+0000 7f851b0ee700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8514134f00 0x7f851409d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.280+0000 7f851b0ee700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f851409eca0 con 0x7f851409dea0 2023-10-03T10:16:23.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.280+0000 7f851b0ee700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851409f720 con 0x7f8514134f00 2023-10-03T10:16:23.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.280+0000 7f851b0ee700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f851406b480 con 0x7f851406a770 2023-10-03T10:16:23.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.280+0000 7f8518e8a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f851406a770 0x7f85141349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.280+0000 7f8518e8a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f851406a770 0x7f85141349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57796/0 (socket says 172.21.15.146:57796) 2023-10-03T10:16:23.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.280+0000 7f8518e8a700 1 -- 172.21.15.146:0/2629255140 learned_addr learned my addr 172.21.15.146:0/2629255140 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:23.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.280+0000 7f8513fff700 1 --2- 172.21.15.146:0/2629255140 >> v2:172.21.15.146:3300/0 conn(0x7f8514134f00 0x7f851409d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.280+0000 7f85137fe700 1 -- 172.21.15.146:0/2629255140 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654426657 0 0) 0x7f851409eca0 con 0x7f851409dea0 2023-10-03T10:16:23.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.280+0000 7f8518e8a700 1 -- 172.21.15.146:0/2629255140 >> v2:172.21.15.146:3300/0 conn(0x7f8514134f00 msgr2=0x7f851409d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:23.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.280+0000 7f8518e8a700 1 --2- 172.21.15.146:0/2629255140 >> v2:172.21.15.146:3300/0 conn(0x7f8514134f00 0x7f851409d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.280+0000 7f8518e8a700 1 -- 172.21.15.146:0/2629255140 >> v1:172.21.15.146:6789/0 conn(0x7f851409dea0 legacy=0x7f851413ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.280+0000 7f8518e8a700 1 -- 172.21.15.146:0/2629255140 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85141352d0 con 0x7f851406a770 2023-10-03T10:16:23.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.280+0000 7f8518e8a700 1 --2- 172.21.15.146:0/2629255140 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f851406a770 0x7f85141349c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f85080098f0 tx=0x7f8508009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f517d8710caa3134 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.281+0000 7f85137fe700 1 -- 172.21.15.146:0/2629255140 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8508011830 con 0x7f851406a770 2023-10-03T10:16:23.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.281+0000 7f85137fe700 1 -- 172.21.15.146:0/2629255140 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8508011990 con 0x7f851406a770 2023-10-03T10:16:23.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.281+0000 7f85137fe700 1 -- 172.21.15.146:0/2629255140 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8508011d20 con 0x7f851406a770 2023-10-03T10:16:23.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.281+0000 7f851b0ee700 1 -- 172.21.15.146:0/2629255140 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f851406a770 msgr2=0x7f85141349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.281+0000 7f851b0ee700 1 --2- 172.21.15.146:0/2629255140 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f851406a770 0x7f85141349c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f85080098f0 tx=0x7f8508009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:23.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.281+0000 7f851b0ee700 1 -- 172.21.15.146:0/2629255140 shutdown_connections 2023-10-03T10:16:23.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.281+0000 7f851b0ee700 1 --2- 172.21.15.146:0/2629255140 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f851406a770 0x7f85141349c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.281+0000 7f851b0ee700 1 --2- 172.21.15.146:0/2629255140 >> v2:172.21.15.146:3300/0 conn(0x7f8514134f00 0x7f851409d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.281+0000 7f851b0ee700 1 -- 172.21.15.146:0/2629255140 >> 172.21.15.146:0/2629255140 conn(0x7f8514099c40 msgr2=0x7f85140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.282+0000 7f851b0ee700 1 -- 172.21.15.146:0/2629255140 shutdown_connections 2023-10-03T10:16:23.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.282+0000 7f851b0ee700 1 -- 172.21.15.146:0/2629255140 wait complete. 2023-10-03T10:16:23.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.282+0000 7f851b0ee700 1 Processor -- start 2023-10-03T10:16:23.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.282+0000 7f851b0ee700 1 -- start start 2023-10-03T10:16:23.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.283+0000 7f851b0ee700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f851406a770 0x7f851406f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.283+0000 7f851b0ee700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f851409dea0 0x7f851406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.283+0000 7f851b0ee700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8514134f00 0x7f85140703d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.283+0000 7f851b0ee700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8514071460 con 0x7f851409dea0 2023-10-03T10:16:23.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.283+0000 7f851b0ee700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8514071270 con 0x7f851406a770 2023-10-03T10:16:23.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.283+0000 7f851b0ee700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85140a0460 con 0x7f8514134f00 2023-10-03T10:16:23.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.283+0000 7f851968b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8514134f00 0x7f85140703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.283+0000 7f851968b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8514134f00 0x7f85140703d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57804/0 (socket says 172.21.15.146:57804) 2023-10-03T10:16:23.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.283+0000 7f851968b700 1 -- 172.21.15.146:0/1988207425 learned_addr learned my addr 172.21.15.146:0/1988207425 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:23.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.283+0000 7f8518e8a700 1 --2- 172.21.15.146:0/1988207425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f851406a770 0x7f851406f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.283+0000 7f8513fff700 1 --2- 172.21.15.146:0/1988207425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f851409dea0 0x7f851406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.284+0000 7f851968b700 1 -- 172.21.15.146:0/1988207425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f851406a770 msgr2=0x7f851406f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.284+0000 7f851968b700 1 --2- 172.21.15.146:0/1988207425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f851406a770 0x7f851406f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.284+0000 7f851968b700 1 -- 172.21.15.146:0/1988207425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f851409dea0 msgr2=0x7f851406fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.284+0000 7f851968b700 1 --2- 172.21.15.146:0/1988207425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f851409dea0 0x7f851406fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.284+0000 7f851968b700 1 -- 172.21.15.146:0/1988207425 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8508009550 con 0x7f8514134f00 2023-10-03T10:16:23.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.284+0000 7f8513fff700 1 --2- 172.21.15.146:0/1988207425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f851409dea0 0x7f851406fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.284+0000 7f851968b700 1 --2- 172.21.15.146:0/1988207425 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8514134f00 0x7f85140703d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f850c00c810 tx=0x7f850c00cb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.284+0000 7f85117fa700 1 -- 172.21.15.146:0/1988207425 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c003e30 con 0x7f8514134f00 2023-10-03T10:16:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.284+0000 7f85117fa700 1 -- 172.21.15.146:0/1988207425 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c005070 con 0x7f8514134f00 2023-10-03T10:16:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.284+0000 7f85117fa700 1 -- 172.21.15.146:0/1988207425 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c005420 con 0x7f8514134f00 2023-10-03T10:16:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.285+0000 7f851b0ee700 1 -- 172.21.15.146:0/1988207425 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8514126a20 con 0x7f8514134f00 2023-10-03T10:16:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.285+0000 7f851b0ee700 1 -- 172.21.15.146:0/1988207425 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8514126740 con 0x7f8514134f00 2023-10-03T10:16:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.286+0000 7f85117fa700 1 -- 172.21.15.146:0/1988207425 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f850c005580 con 0x7f8514134f00 2023-10-03T10:16:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.286+0000 7f851b0ee700 1 -- 172.21.15.146:0/1988207425 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85141263e0 con 0x7f8514134f00 2023-10-03T10:16:23.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.286+0000 7f85117fa700 1 -- 172.21.15.146:0/1988207425 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f850c03f3b0 con 0x7f8514134f00 2023-10-03T10:16:23.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.291+0000 7f85117fa700 1 -- 172.21.15.146:0/1988207425 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f85141263e0 con 0x7f8514134f00 2023-10-03T10:16:23.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.348+0000 7f0f1c5d3700 1 -- 172.21.15.146:0/2202648328 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0f1409e3a0 con 0x7f0f14131a00 2023-10-03T10:16:23.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.348+0000 7f0f0affd700 1 -- 172.21.15.146:0/2202648328 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f0c017020 con 0x7f0f14131a00 2023-10-03T10:16:23.349 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:23.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.350+0000 7f0f1c5d3700 1 -- 172.21.15.146:0/2202648328 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f14131a00 msgr2=0x7f0f1409af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.350+0000 7f0f1c5d3700 1 --2- 172.21.15.146:0/2202648328 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f14131a00 0x7f0f1409af10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00cb40 tx=0x7f0f0c00ce50 comp rx=0 tx=0).stop 2023-10-03T10:16:23.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.350+0000 7f0f1c5d3700 1 -- 172.21.15.146:0/2202648328 shutdown_connections 2023-10-03T10:16:23.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.350+0000 7f0f1c5d3700 1 --2- 172.21.15.146:0/2202648328 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f14131a00 0x7f0f1409af10 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.350+0000 7f0f1c5d3700 1 --2- 172.21.15.146:0/2202648328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f1406a770 0x7f0f1409a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.350+0000 7f0f1c5d3700 1 --2- 172.21.15.146:0/2202648328 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f1409dec0 0x7f0f1409a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.350+0000 7f0f1c5d3700 1 -- 172.21.15.146:0/2202648328 >> 172.21.15.146:0/2202648328 conn(0x7f0f14099c40 msgr2=0x7f0f1412eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.351+0000 7f0f1c5d3700 1 -- 172.21.15.146:0/2202648328 shutdown_connections 2023-10-03T10:16:23.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.351+0000 7f0f1c5d3700 1 -- 172.21.15.146:0/2202648328 wait complete. 2023-10-03T10:16:23.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:23.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.444+0000 7f23dc14d700 1 -- 172.21.15.146:0/452219745 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f23d406f620 con 0x7f23d41347b0 2023-10-03T10:16:23.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.444+0000 7f23ca7fc700 1 -- 172.21.15.146:0/452219745 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23c4021020 con 0x7f23d41347b0 2023-10-03T10:16:23.445 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:23.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.446+0000 7f23dc14d700 1 -- 172.21.15.146:0/452219745 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d41347b0 msgr2=0x7f23d41c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.446+0000 7f23dc14d700 1 --2- 172.21.15.146:0/452219745 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d41347b0 0x7f23d41c8be0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f23c400ec10 tx=0x7f23c400ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:23.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.446+0000 7f23dc14d700 1 -- 172.21.15.146:0/452219745 shutdown_connections 2023-10-03T10:16:23.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.446+0000 7f23dc14d700 1 --2- 172.21.15.146:0/452219745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d41370d0 0x7f23d406d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.446+0000 7f23dc14d700 1 --2- 172.21.15.146:0/452219745 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d4098410 0x7f23d41c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.446+0000 7f23dc14d700 1 --2- 172.21.15.146:0/452219745 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d41347b0 0x7f23d41c8be0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.446+0000 7f23dc14d700 1 -- 172.21.15.146:0/452219745 >> 172.21.15.146:0/452219745 conn(0x7f23d40a2b30 msgr2=0x7f23d409c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.446+0000 7f23dc14d700 1 -- 172.21.15.146:0/452219745 shutdown_connections 2023-10-03T10:16:23.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.446+0000 7f23dc14d700 1 -- 172.21.15.146:0/452219745 wait complete. 2023-10-03T10:16:23.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:23.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.475+0000 7fd3d97c0700 1 -- 172.21.15.146:0/174478002 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd3d411b870 con 0x7fd3d409bc70 2023-10-03T10:16:23.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.475+0000 7fd3bb7fe700 1 -- 172.21.15.146:0/174478002 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd3c401b410 con 0x7fd3d409bc70 2023-10-03T10:16:23.476 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:23.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.477+0000 7fd3d97c0700 1 -- 172.21.15.146:0/174478002 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3d409bc70 msgr2=0x7fd3d4119680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.477+0000 7fd3d97c0700 1 --2- 172.21.15.146:0/174478002 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3d409bc70 0x7fd3d4119680 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4131460 tx=0x7fd3c4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:23.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.477+0000 7fd3d97c0700 1 -- 172.21.15.146:0/174478002 shutdown_connections 2023-10-03T10:16:23.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.477+0000 7fd3d97c0700 1 --2- 172.21.15.146:0/174478002 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3d4131980 0x7fd3d411a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.477+0000 7fd3d97c0700 1 --2- 172.21.15.146:0/174478002 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3d409bc70 0x7fd3d4119680 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.477+0000 7fd3d97c0700 1 --2- 172.21.15.146:0/174478002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3d409c790 0x7fd3d4119bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.477+0000 7fd3d97c0700 1 -- 172.21.15.146:0/174478002 >> 172.21.15.146:0/174478002 conn(0x7fd3d40a2980 msgr2=0x7fd3d412e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.477+0000 7fd3d97c0700 1 -- 172.21.15.146:0/174478002 shutdown_connections 2023-10-03T10:16:23.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.477+0000 7fd3d97c0700 1 -- 172.21.15.146:0/174478002 wait complete. 2023-10-03T10:16:23.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:23.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.489+0000 7f851b0ee700 1 -- 172.21.15.146:0/1988207425 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f85141263e0 con 0x7f8514134f00 2023-10-03T10:16:23.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.490+0000 7f85117fa700 1 -- 172.21.15.146:0/1988207425 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f85141263e0 con 0x7f8514134f00 2023-10-03T10:16:23.491 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:23.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.492+0000 7f851b0ee700 1 -- 172.21.15.146:0/1988207425 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8514134f00 msgr2=0x7f85140703d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.492+0000 7f851b0ee700 1 --2- 172.21.15.146:0/1988207425 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8514134f00 0x7f85140703d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f850c00c810 tx=0x7f850c00cb20 comp rx=0 tx=0).stop 2023-10-03T10:16:23.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.492+0000 7f851b0ee700 1 -- 172.21.15.146:0/1988207425 shutdown_connections 2023-10-03T10:16:23.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.492+0000 7f851b0ee700 1 --2- 172.21.15.146:0/1988207425 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8514134f00 0x7f85140703d0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.492+0000 7f851b0ee700 1 --2- 172.21.15.146:0/1988207425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f851406a770 0x7f851406f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.492+0000 7f851b0ee700 1 --2- 172.21.15.146:0/1988207425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f851409dea0 0x7f851406fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.492+0000 7f851b0ee700 1 -- 172.21.15.146:0/1988207425 >> 172.21.15.146:0/1988207425 conn(0x7f8514099c40 msgr2=0x7f851409c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.492+0000 7f851b0ee700 1 -- 172.21.15.146:0/1988207425 shutdown_connections 2023-10-03T10:16:23.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:23.492+0000 7f851b0ee700 1 -- 172.21.15.146:0/1988207425 wait complete. 2023-10-03T10:16:23.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:24.365 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:24.460 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:24.491 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:24.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.502+0000 7f113717c700 1 Processor -- start 2023-10-03T10:16:24.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.502+0000 7f113717c700 1 -- start start 2023-10-03T10:16:24.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.502+0000 7f113717c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f113009d860 0x7f113009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.502+0000 7f113717c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f113009e170 0x7f11301307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.502+0000 7f113717c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1130130ce0 0x7f1130131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.502+0000 7f113717c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1130131670 con 0x7f113009d860 2023-10-03T10:16:24.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.502+0000 7f113717c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113009aaa0 con 0x7f113009e170 2023-10-03T10:16:24.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.502+0000 7f113717c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f113009f870 con 0x7f1130130ce0 2023-10-03T10:16:24.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.502+0000 7f112ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f113009e170 0x7f11301307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.502+0000 7f1134f18700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f113009d860 0x7f113009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.502+0000 7f112ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f113009e170 0x7f11301307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59284/0 (socket says 172.21.15.146:59284) 2023-10-03T10:16:24.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.502+0000 7f112ffff700 1 -- 172.21.15.146:0/3804386927 learned_addr learned my addr 172.21.15.146:0/3804386927 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:24.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.502+0000 7f1135719700 1 --2- 172.21.15.146:0/3804386927 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1130130ce0 0x7f1130131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.503+0000 7f112ffff700 1 -- 172.21.15.146:0/3804386927 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1130130ce0 msgr2=0x7f1130131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:24.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.503+0000 7f112ffff700 1 --2- 172.21.15.146:0/3804386927 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1130130ce0 0x7f1130131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.503+0000 7f112ffff700 1 -- 172.21.15.146:0/3804386927 >> v2:172.21.15.146:3300/0 conn(0x7f113009d860 msgr2=0x7f113009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:24.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.503+0000 7f112ffff700 1 --2- 172.21.15.146:0/3804386927 >> v2:172.21.15.146:3300/0 conn(0x7f113009d860 0x7f113009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.503+0000 7f112ffff700 1 -- 172.21.15.146:0/3804386927 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113009b360 con 0x7f113009e170 2023-10-03T10:16:24.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.503+0000 7f1134f18700 1 --2- 172.21.15.146:0/3804386927 >> v2:172.21.15.146:3300/0 conn(0x7f113009d860 0x7f113009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.503+0000 7f112ffff700 1 --2- 172.21.15.146:0/3804386927 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f113009e170 0x7f11301307a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f111c00bb90 tx=0x7f111c00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b89c416552a7f7e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.503+0000 7f112f7fe700 1 -- 172.21.15.146:0/3804386927 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c00dd30 con 0x7f113009e170 2023-10-03T10:16:24.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.503+0000 7f112f7fe700 1 -- 172.21.15.146:0/3804386927 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111c00de90 con 0x7f113009e170 2023-10-03T10:16:24.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.503+0000 7f112f7fe700 1 -- 172.21.15.146:0/3804386927 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c010690 con 0x7f113009e170 2023-10-03T10:16:24.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.504+0000 7f113717c700 1 -- 172.21.15.146:0/3804386927 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f113009e170 msgr2=0x7f11301307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.504+0000 7f113717c700 1 --2- 172.21.15.146:0/3804386927 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f113009e170 0x7f11301307a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f111c00bb90 tx=0x7f111c00bea0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.504+0000 7f113717c700 1 -- 172.21.15.146:0/3804386927 shutdown_connections 2023-10-03T10:16:24.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.504+0000 7f113717c700 1 --2- 172.21.15.146:0/3804386927 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1130130ce0 0x7f1130131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.504+0000 7f113717c700 1 --2- 172.21.15.146:0/3804386927 >> v2:172.21.15.146:3300/0 conn(0x7f113009d860 0x7f113009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.504+0000 7f113717c700 1 --2- 172.21.15.146:0/3804386927 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f113009e170 0x7f11301307a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.504+0000 7f113717c700 1 -- 172.21.15.146:0/3804386927 >> 172.21.15.146:0/3804386927 conn(0x7f1130099c40 msgr2=0x7f11300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.504+0000 7f113717c700 1 -- 172.21.15.146:0/3804386927 shutdown_connections 2023-10-03T10:16:24.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.504+0000 7f113717c700 1 -- 172.21.15.146:0/3804386927 wait complete. 2023-10-03T10:16:24.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.505+0000 7f113717c700 1 Processor -- start 2023-10-03T10:16:24.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.505+0000 7f113717c700 1 -- start start 2023-10-03T10:16:24.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f113717c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f113009d860 0x7f113011cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f113717c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f113009e170 0x7f113011d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f113717c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1130130ce0 0x7f113011da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f113717c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1130121480 con 0x7f113009e170 2023-10-03T10:16:24.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f113717c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1130120ac0 con 0x7f113009d860 2023-10-03T10:16:24.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f113717c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f113011fe00 con 0x7f1130130ce0 2023-10-03T10:16:24.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f1134f18700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f113009d860 0x7f113011cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f1135719700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1130130ce0 0x7f113011da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f1134f18700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f113009d860 0x7f113011cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59300/0 (socket says 172.21.15.146:59300) 2023-10-03T10:16:24.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f1135719700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1130130ce0 0x7f113011da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36140/0 (socket says 172.21.15.146:36140) 2023-10-03T10:16:24.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f1134f18700 1 -- 172.21.15.146:0/851106883 learned_addr learned my addr 172.21.15.146:0/851106883 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:24.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f112ffff700 1 --2- 172.21.15.146:0/851106883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f113009e170 0x7f113011d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f1135719700 1 -- 172.21.15.146:0/851106883 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f113009d860 msgr2=0x7f113011cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f1135719700 1 --2- 172.21.15.146:0/851106883 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f113009d860 0x7f113011cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f1135719700 1 -- 172.21.15.146:0/851106883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f113009e170 msgr2=0x7f113011d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f1135719700 1 --2- 172.21.15.146:0/851106883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f113009e170 0x7f113011d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f1135719700 1 -- 172.21.15.146:0/851106883 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11240094a0 con 0x7f1130130ce0 2023-10-03T10:16:24.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f112ffff700 1 --2- 172.21.15.146:0/851106883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f113009e170 0x7f113011d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f1135719700 1 --2- 172.21.15.146:0/851106883 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1130130ce0 0x7f113011da20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1128009d90 tx=0x7f112800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f112d7fa700 1 -- 172.21.15.146:0/851106883 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1128009c00 con 0x7f1130130ce0 2023-10-03T10:16:24.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f112d7fa700 1 -- 172.21.15.146:0/851106883 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112800f040 con 0x7f1130130ce0 2023-10-03T10:16:24.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f113717c700 1 -- 172.21.15.146:0/851106883 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111c00b7f0 con 0x7f1130130ce0 2023-10-03T10:16:24.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.506+0000 7f112d7fa700 1 -- 172.21.15.146:0/851106883 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1128014480 con 0x7f1130130ce0 2023-10-03T10:16:24.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.507+0000 7f113717c700 1 -- 172.21.15.146:0/851106883 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1130071a60 con 0x7f1130130ce0 2023-10-03T10:16:24.511 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:24.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.507+0000 7f112d7fa700 1 -- 172.21.15.146:0/851106883 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f11280145e0 con 0x7f1130130ce0 2023-10-03T10:16:24.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.508+0000 7f112d7fa700 1 -- 172.21.15.146:0/851106883 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1128040310 con 0x7f1130130ce0 2023-10-03T10:16:24.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.508+0000 7f113717c700 1 -- 172.21.15.146:0/851106883 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1130120660 con 0x7f1130130ce0 2023-10-03T10:16:24.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.513+0000 7f112d7fa700 1 -- 172.21.15.146:0/851106883 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1128012520 con 0x7f1130130ce0 2023-10-03T10:16:24.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.601+0000 7fd63c7b3700 1 Processor -- start 2023-10-03T10:16:24.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.601+0000 7fd63c7b3700 1 -- start start 2023-10-03T10:16:24.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.602+0000 7fd63c7b3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd6340a0a70 0x7fd6340a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.602+0000 7fd63c7b3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6340a1380 0x7fd634133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.602+0000 7fd63c7b3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63409dc00 con 0x7fd634133f50 2023-10-03T10:16:24.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.602+0000 7fd63c7b3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63409ea60 con 0x7fd6340a0a70 2023-10-03T10:16:24.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.602+0000 7fd63c7b3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd63409dec0 con 0x7fd6340a1380 2023-10-03T10:16:24.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.602+0000 7fd63ad50700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd634133f50 0x7fd63413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47134/0 (socket says 172.21.15.146:47134) 2023-10-03T10:16:24.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.602+0000 7fd63ad50700 1 -- 172.21.15.146:0/14319668 learned_addr learned my addr 172.21.15.146:0/14319668 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:24.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.602+0000 7fd63a54f700 1 --2- 172.21.15.146:0/14319668 >> v2:172.21.15.146:3300/0 conn(0x7fd6340a0a70 0x7fd6340a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.602+0000 7fd639d4e700 1 --2- 172.21.15.146:0/14319668 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6340a1380 0x7fd634133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.602+0000 7fd63954d700 1 -- 172.21.15.146:0/14319668 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855330092 0 0) 0x7fd63409dc00 con 0x7fd634133f50 2023-10-03T10:16:24.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.603+0000 7fd63954d700 1 -- 172.21.15.146:0/14319668 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6200035b0 con 0x7fd634133f50 2023-10-03T10:16:24.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.603+0000 7fd639d4e700 1 -- 172.21.15.146:0/14319668 >> v2:172.21.15.146:3300/0 conn(0x7fd6340a0a70 msgr2=0x7fd6340a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:24.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.603+0000 7fd639d4e700 1 --2- 172.21.15.146:0/14319668 >> v2:172.21.15.146:3300/0 conn(0x7fd6340a0a70 0x7fd6340a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.603+0000 7fd639d4e700 1 -- 172.21.15.146:0/14319668 >> v1:172.21.15.146:6789/0 conn(0x7fd634133f50 legacy=0x7fd63413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.603+0000 7fd639d4e700 1 -- 172.21.15.146:0/14319668 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63409e6a0 con 0x7fd6340a1380 2023-10-03T10:16:24.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.603+0000 7fd639d4e700 1 --2- 172.21.15.146:0/14319668 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6340a1380 0x7fd634133a10 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd624009840 tx=0x7fd624009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57a0c18e1784fd87 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.603+0000 7fd63954d700 1 -- 172.21.15.146:0/14319668 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd624011830 con 0x7fd6340a1380 2023-10-03T10:16:24.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.603+0000 7fd63954d700 1 -- 172.21.15.146:0/14319668 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd624011990 con 0x7fd6340a1380 2023-10-03T10:16:24.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.603+0000 7fd63954d700 1 -- 172.21.15.146:0/14319668 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd624011d20 con 0x7fd6340a1380 2023-10-03T10:16:24.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.604+0000 7fd63c7b3700 1 -- 172.21.15.146:0/14319668 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6340a1380 msgr2=0x7fd634133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.604+0000 7fd63c7b3700 1 --2- 172.21.15.146:0/14319668 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6340a1380 0x7fd634133a10 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd624009840 tx=0x7fd624009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:24.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.604+0000 7fd63c7b3700 1 -- 172.21.15.146:0/14319668 shutdown_connections 2023-10-03T10:16:24.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.604+0000 7fd63c7b3700 1 --2- 172.21.15.146:0/14319668 >> v2:172.21.15.146:3300/0 conn(0x7fd6340a0a70 0x7fd6340a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.604+0000 7fd63c7b3700 1 --2- 172.21.15.146:0/14319668 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6340a1380 0x7fd634133a10 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.604+0000 7fd63c7b3700 1 -- 172.21.15.146:0/14319668 >> 172.21.15.146:0/14319668 conn(0x7fd6340a6610 msgr2=0x7fd6340a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.604+0000 7fd63c7b3700 1 -- 172.21.15.146:0/14319668 shutdown_connections 2023-10-03T10:16:24.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.604+0000 7fd63c7b3700 1 -- 172.21.15.146:0/14319668 wait complete. 2023-10-03T10:16:24.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.605+0000 7fd63c7b3700 1 Processor -- start 2023-10-03T10:16:24.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.605+0000 7fd63c7b3700 1 -- start start 2023-10-03T10:16:24.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.605+0000 7fd63c7b3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd6340a0a70 0x7fd634122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.605+0000 7fd63c7b3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6340a1380 0x7fd634122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.605+0000 7fd63c7b3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd634133f50 0x7fd634123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.605+0000 7fd63c7b3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd634126f90 con 0x7fd634133f50 2023-10-03T10:16:24.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.605+0000 7fd63c7b3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6340a03e0 con 0x7fd6340a0a70 2023-10-03T10:16:24.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.605+0000 7fd63c7b3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd634125e10 con 0x7fd6340a1380 2023-10-03T10:16:24.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.605+0000 7fd63a54f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd6340a0a70 0x7fd634122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.606+0000 7fd63a54f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd6340a0a70 0x7fd634122890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59316/0 (socket says 172.21.15.146:59316) 2023-10-03T10:16:24.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.606+0000 7fd63a54f700 1 -- 172.21.15.146:0/3858625869 learned_addr learned my addr 172.21.15.146:0/3858625869 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:24.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.606+0000 7fd63ad50700 1 --2- 172.21.15.146:0/3858625869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd634133f50 0x7fd634123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.606+0000 7fd639d4e700 1 --2- 172.21.15.146:0/3858625869 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6340a1380 0x7fd634122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.606+0000 7fd63ad50700 1 -- 172.21.15.146:0/3858625869 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6340a1380 msgr2=0x7fd634122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.606+0000 7fd63ad50700 1 --2- 172.21.15.146:0/3858625869 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6340a1380 0x7fd634122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.606+0000 7fd63ad50700 1 -- 172.21.15.146:0/3858625869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd6340a0a70 msgr2=0x7fd634122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.606+0000 7fd63ad50700 1 --2- 172.21.15.146:0/3858625869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd6340a0a70 0x7fd634122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.606+0000 7fd63ad50700 1 -- 172.21.15.146:0/3858625869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6240094a0 con 0x7fd634133f50 2023-10-03T10:16:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.606+0000 7fd63a54f700 1 --2- 172.21.15.146:0/3858625869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd6340a0a70 0x7fd634122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.606+0000 7fd639d4e700 1 --2- 172.21.15.146:0/3858625869 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6340a1380 0x7fd634122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.606+0000 7fd63ad50700 1 --2- 172.21.15.146:0/3858625869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd634133f50 0x7fd634123310 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00ca80 tx=0x7fd62c00cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.606+0000 7fd62affd700 1 -- 172.21.15.146:0/3858625869 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c00a9e0 con 0x7fd634133f50 2023-10-03T10:16:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.606+0000 7fd62affd700 1 -- 172.21.15.146:0/3858625869 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c00ab40 con 0x7fd634133f50 2023-10-03T10:16:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.606+0000 7fd63c7b3700 1 -- 172.21.15.146:0/3858625869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6341260d0 con 0x7fd634133f50 2023-10-03T10:16:24.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.606+0000 7fd62affd700 1 -- 172.21.15.146:0/3858625869 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c012400 con 0x7fd634133f50 2023-10-03T10:16:24.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.606+0000 7fd63c7b3700 1 -- 172.21.15.146:0/3858625869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd634126b40 con 0x7fd634133f50 2023-10-03T10:16:24.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.607+0000 7fd62affd700 1 -- 172.21.15.146:0/3858625869 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd62c01b3b0 con 0x7fd634133f50 2023-10-03T10:16:24.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.608+0000 7fd63c7b3700 1 -- 172.21.15.146:0/3858625869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63404f2a0 con 0x7fd634133f50 2023-10-03T10:16:24.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.608+0000 7fd62affd700 1 -- 172.21.15.146:0/3858625869 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd62c03f420 con 0x7fd634133f50 2023-10-03T10:16:24.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.612+0000 7fd62affd700 1 -- 172.21.15.146:0/3858625869 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd62c0192c0 con 0x7fd634133f50 2023-10-03T10:16:24.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.633+0000 7fdbadfca700 1 Processor -- start 2023-10-03T10:16:24.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.633+0000 7fdbadfca700 1 -- start start 2023-10-03T10:16:24.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.633+0000 7fdbadfca700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdba80a0a30 0x7fdba80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.633+0000 7fdbadfca700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdba80a1340 0x7fdba812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.633+0000 7fdbadfca700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdba81304a0 0x7fdba81308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.634+0000 7fdbadfca700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba8130e30 con 0x7fdba81304a0 2023-10-03T10:16:24.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.634+0000 7fdbadfca700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba80a1e70 con 0x7fdba80a0a30 2023-10-03T10:16:24.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.634+0000 7fdbadfca700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdba809a720 con 0x7fdba80a1340 2023-10-03T10:16:24.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.634+0000 7fdba77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdba80a0a30 0x7fdba80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.634+0000 7fdba77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdba80a0a30 0x7fdba80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59320/0 (socket says 172.21.15.146:59320) 2023-10-03T10:16:24.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.634+0000 7fdba77fe700 1 -- 172.21.15.146:0/757149330 learned_addr learned my addr 172.21.15.146:0/757149330 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:24.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.634+0000 7fdba7fff700 1 --2- 172.21.15.146:0/757149330 >> v2:172.21.15.146:3300/0 conn(0x7fdba81304a0 0x7fdba81308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.634+0000 7fdba6ffd700 1 --2- 172.21.15.146:0/757149330 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdba80a1340 0x7fdba812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.634+0000 7fdba77fe700 1 -- 172.21.15.146:0/757149330 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdba80a1340 msgr2=0x7fdba812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:24.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.634+0000 7fdba77fe700 1 --2- 172.21.15.146:0/757149330 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdba80a1340 0x7fdba812ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.634+0000 7fdba77fe700 1 -- 172.21.15.146:0/757149330 >> v2:172.21.15.146:3300/0 conn(0x7fdba81304a0 msgr2=0x7fdba81308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:24.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.634+0000 7fdba77fe700 1 --2- 172.21.15.146:0/757149330 >> v2:172.21.15.146:3300/0 conn(0x7fdba81304a0 0x7fdba81308f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.634+0000 7fdba77fe700 1 -- 172.21.15.146:0/757149330 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba809b300 con 0x7fdba80a0a30 2023-10-03T10:16:24.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.634+0000 7fdba7fff700 1 --2- 172.21.15.146:0/757149330 >> v2:172.21.15.146:3300/0 conn(0x7fdba81304a0 0x7fdba81308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.634+0000 7fdba77fe700 1 --2- 172.21.15.146:0/757149330 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdba80a0a30 0x7fdba80a0e00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800b930 tx=0x7fdb9800bc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bbd368d579d921a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.634+0000 7fdba67fc700 1 -- 172.21.15.146:0/757149330 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb98005c30 con 0x7fdba80a0a30 2023-10-03T10:16:24.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.634+0000 7fdba67fc700 1 -- 172.21.15.146:0/757149330 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb98005d90 con 0x7fdba80a0a30 2023-10-03T10:16:24.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.634+0000 7fdba67fc700 1 -- 172.21.15.146:0/757149330 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9800c940 con 0x7fdba80a0a30 2023-10-03T10:16:24.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.635+0000 7fdbadfca700 1 -- 172.21.15.146:0/757149330 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdba80a0a30 msgr2=0x7fdba80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.635+0000 7fdbadfca700 1 --2- 172.21.15.146:0/757149330 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdba80a0a30 0x7fdba80a0e00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800b930 tx=0x7fdb9800bc40 comp rx=0 tx=0).stop 2023-10-03T10:16:24.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.635+0000 7fdbadfca700 1 -- 172.21.15.146:0/757149330 shutdown_connections 2023-10-03T10:16:24.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.635+0000 7fdbadfca700 1 --2- 172.21.15.146:0/757149330 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdba80a0a30 0x7fdba80a0e00 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.635+0000 7fdbadfca700 1 --2- 172.21.15.146:0/757149330 >> v2:172.21.15.146:3300/0 conn(0x7fdba81304a0 0x7fdba81308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.635+0000 7fdbadfca700 1 --2- 172.21.15.146:0/757149330 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdba80a1340 0x7fdba812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.635+0000 7fdbadfca700 1 -- 172.21.15.146:0/757149330 >> 172.21.15.146:0/757149330 conn(0x7fdba80a2980 msgr2=0x7fdba80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.635+0000 7fdbadfca700 1 -- 172.21.15.146:0/757149330 shutdown_connections 2023-10-03T10:16:24.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.635+0000 7fdbadfca700 1 -- 172.21.15.146:0/757149330 wait complete. 2023-10-03T10:16:24.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.636+0000 7fdbadfca700 1 Processor -- start 2023-10-03T10:16:24.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.636+0000 7fdbadfca700 1 -- start start 2023-10-03T10:16:24.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.637+0000 7fdbadfca700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdba80a0a30 0x7fdba81c4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.637+0000 7fdbadfca700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdba80a1340 0x7fdba81c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.637+0000 7fdbadfca700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdba81304a0 0x7fdba81c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.637+0000 7fdbadfca700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba811cdd0 con 0x7fdba81304a0 2023-10-03T10:16:24.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.637+0000 7fdbadfca700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba811cba0 con 0x7fdba80a0a30 2023-10-03T10:16:24.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.637+0000 7fdbadfca700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdba811d810 con 0x7fdba80a1340 2023-10-03T10:16:24.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.637+0000 7fdba77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdba80a0a30 0x7fdba81c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.637+0000 7fdba77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdba80a0a30 0x7fdba81c4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59330/0 (socket says 172.21.15.146:59330) 2023-10-03T10:16:24.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.637+0000 7fdba77fe700 1 -- 172.21.15.146:0/1955867132 learned_addr learned my addr 172.21.15.146:0/1955867132 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:24.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.637+0000 7fdba6ffd700 1 --2- 172.21.15.146:0/1955867132 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdba80a1340 0x7fdba81c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.637+0000 7fdba6ffd700 1 -- 172.21.15.146:0/1955867132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdba80a0a30 msgr2=0x7fdba81c4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.637+0000 7fdba6ffd700 1 --2- 172.21.15.146:0/1955867132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdba80a0a30 0x7fdba81c4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.637+0000 7fdba6ffd700 1 -- 172.21.15.146:0/1955867132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdba81304a0 msgr2=0x7fdba81c4ad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:16:24.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.637+0000 7fdba6ffd700 1 --2- 172.21.15.146:0/1955867132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdba81304a0 0x7fdba81c4ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.637+0000 7fdba6ffd700 1 -- 172.21.15.146:0/1955867132 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba0009a70 con 0x7fdba80a1340 2023-10-03T10:16:24.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.637+0000 7fdba77fe700 1 --2- 172.21.15.146:0/1955867132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdba80a0a30 0x7fdba81c4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.637+0000 7fdba6ffd700 1 --2- 172.21.15.146:0/1955867132 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdba80a1340 0x7fdba81c4590 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c012ed0 tx=0x7fdb9c00f390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.638+0000 7fdb8ffff700 1 -- 172.21.15.146:0/1955867132 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c014040 con 0x7fdba80a1340 2023-10-03T10:16:24.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.638+0000 7fdb8ffff700 1 -- 172.21.15.146:0/1955867132 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c00fdb0 con 0x7fdba80a1340 2023-10-03T10:16:24.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.638+0000 7fdbadfca700 1 -- 172.21.15.146:0/1955867132 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb9800b540 con 0x7fdba80a1340 2023-10-03T10:16:24.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.638+0000 7fdb8ffff700 1 -- 172.21.15.146:0/1955867132 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c018600 con 0x7fdba80a1340 2023-10-03T10:16:24.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.638+0000 7fdbadfca700 1 -- 172.21.15.146:0/1955867132 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba809ae00 con 0x7fdba80a1340 2023-10-03T10:16:24.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.639+0000 7fdbadfca700 1 -- 172.21.15.146:0/1955867132 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba811e730 con 0x7fdba80a1340 2023-10-03T10:16:24.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.639+0000 7fdb8ffff700 1 -- 172.21.15.146:0/1955867132 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb9c018760 con 0x7fdba80a1340 2023-10-03T10:16:24.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.639+0000 7fdb8ffff700 1 -- 172.21.15.146:0/1955867132 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdb9c044070 con 0x7fdba80a1340 2023-10-03T10:16:24.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.643+0000 7fa12ce8d700 1 Processor -- start 2023-10-03T10:16:24.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.644+0000 7fa12ce8d700 1 -- start start 2023-10-03T10:16:24.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.644+0000 7fdb8ffff700 1 -- 172.21.15.146:0/1955867132 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb9c075750 con 0x7fdba80a1340 2023-10-03T10:16:24.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.644+0000 7fa12ce8d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa128133a70 0x7fa128133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.644+0000 7fa12ce8d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1280a08e0 0x7fa1280a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.644+0000 7fa12ce8d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa128133640 con 0x7fa1280a1290 2023-10-03T10:16:24.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.644+0000 7fa12ce8d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1280a1d50 con 0x7fa1280a08e0 2023-10-03T10:16:24.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.644+0000 7fa12ce8d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1280a1730 con 0x7fa128133a70 2023-10-03T10:16:24.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.645+0000 7fa12659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa128133a70 0x7fa128133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.645+0000 7fa126d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa1280a1290 0x7fa12813a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47138/0 (socket says 172.21.15.146:47138) 2023-10-03T10:16:24.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.645+0000 7fa126d9d700 1 -- 172.21.15.146:0/2020743557 learned_addr learned my addr 172.21.15.146:0/2020743557 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:24.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.645+0000 7fa12659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa128133a70 0x7fa128133e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36200/0 (socket says 172.21.15.146:36200) 2023-10-03T10:16:24.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.645+0000 7fa125d9b700 1 --2- 172.21.15.146:0/2020743557 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1280a08e0 0x7fa1280a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.645+0000 7fa12659c700 1 -- 172.21.15.146:0/2020743557 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1280a08e0 msgr2=0x7fa1280a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:24.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.645+0000 7fa12659c700 1 --2- 172.21.15.146:0/2020743557 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1280a08e0 0x7fa1280a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.645+0000 7fa12659c700 1 -- 172.21.15.146:0/2020743557 >> v1:172.21.15.146:6789/0 conn(0x7fa1280a1290 legacy=0x7fa12813a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.645+0000 7fa12559a700 1 -- 172.21.15.146:0/2020743557 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680795021 0 0) 0x7fa128133640 con 0x7fa1280a1290 2023-10-03T10:16:24.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.645+0000 7fa12659c700 1 -- 172.21.15.146:0/2020743557 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12809b620 con 0x7fa128133a70 2023-10-03T10:16:24.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.645+0000 7fa12659c700 1 --2- 172.21.15.146:0/2020743557 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa128133a70 0x7fa128133e40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa118009e10 tx=0x7fa11800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cdb9c58d87d6e0a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.645+0000 7fa12559a700 1 -- 172.21.15.146:0/2020743557 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11800e070 con 0x7fa128133a70 2023-10-03T10:16:24.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.645+0000 7fa12559a700 1 -- 172.21.15.146:0/2020743557 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11800bb20 con 0x7fa128133a70 2023-10-03T10:16:24.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.645+0000 7fa12559a700 1 -- 172.21.15.146:0/2020743557 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118012430 con 0x7fa128133a70 2023-10-03T10:16:24.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.646+0000 7fa12ce8d700 1 -- 172.21.15.146:0/2020743557 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa128133a70 msgr2=0x7fa128133e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.646+0000 7fa12ce8d700 1 --2- 172.21.15.146:0/2020743557 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa128133a70 0x7fa128133e40 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa118009e10 tx=0x7fa11800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:24.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.646+0000 7fa12ce8d700 1 -- 172.21.15.146:0/2020743557 shutdown_connections 2023-10-03T10:16:24.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.646+0000 7fa12ce8d700 1 --2- 172.21.15.146:0/2020743557 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa128133a70 0x7fa128133e40 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.646+0000 7fa12ce8d700 1 --2- 172.21.15.146:0/2020743557 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1280a08e0 0x7fa1280a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.646+0000 7fa12ce8d700 1 -- 172.21.15.146:0/2020743557 >> 172.21.15.146:0/2020743557 conn(0x7fa1280a2980 msgr2=0x7fa1280a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.646+0000 7fa12ce8d700 1 -- 172.21.15.146:0/2020743557 shutdown_connections 2023-10-03T10:16:24.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.646+0000 7fa12ce8d700 1 -- 172.21.15.146:0/2020743557 wait complete. 2023-10-03T10:16:24.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.647+0000 7fa12ce8d700 1 Processor -- start 2023-10-03T10:16:24.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.647+0000 7fa12ce8d700 1 -- start start 2023-10-03T10:16:24.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.648+0000 7fa12ce8d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1280a08e0 0x7fa1281c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.648+0000 7fa12ce8d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1280a1290 0x7fa1281c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.648+0000 7fa12ce8d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa128133a70 0x7fa1281c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.648+0000 7fa12ce8d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12811e630 con 0x7fa1280a1290 2023-10-03T10:16:24.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.648+0000 7fa12ce8d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa128131c10 con 0x7fa1280a08e0 2023-10-03T10:16:24.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.648+0000 7fa12ce8d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa12809a350 con 0x7fa128133a70 2023-10-03T10:16:24.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.648+0000 7fa12659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1280a08e0 0x7fa1281c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.648+0000 7fa12659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1280a08e0 0x7fa1281c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59344/0 (socket says 172.21.15.146:59344) 2023-10-03T10:16:24.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.648+0000 7fa12659c700 1 -- 172.21.15.146:0/1369350042 learned_addr learned my addr 172.21.15.146:0/1369350042 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:24.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.648+0000 7fa126d9d700 1 --2- 172.21.15.146:0/1369350042 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa128133a70 0x7fa1281c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.648+0000 7fa125d9b700 1 --2- 172.21.15.146:0/1369350042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1280a1290 0x7fa1281c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.648+0000 7fa12659c700 1 -- 172.21.15.146:0/1369350042 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa128133a70 msgr2=0x7fa1281c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.648+0000 7fa12659c700 1 --2- 172.21.15.146:0/1369350042 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa128133a70 0x7fa1281c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.648+0000 7fa12659c700 1 -- 172.21.15.146:0/1369350042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1280a1290 msgr2=0x7fa1281c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.648+0000 7fa12659c700 1 --2- 172.21.15.146:0/1369350042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1280a1290 0x7fa1281c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.648+0000 7fa12659c700 1 -- 172.21.15.146:0/1369350042 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa118009a70 con 0x7fa1280a08e0 2023-10-03T10:16:24.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.648+0000 7fa125d9b700 1 --2- 172.21.15.146:0/1369350042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1280a1290 0x7fa1281c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:24.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.648+0000 7fa12659c700 1 --2- 172.21.15.146:0/1369350042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1280a08e0 0x7fa1281c7f80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa118014040 tx=0x7fa118004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.649+0000 7fa116ffd700 1 -- 172.21.15.146:0/1369350042 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118012430 con 0x7fa1280a08e0 2023-10-03T10:16:24.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.649+0000 7fa116ffd700 1 -- 172.21.15.146:0/1369350042 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa118020070 con 0x7fa1280a08e0 2023-10-03T10:16:24.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.649+0000 7fa116ffd700 1 -- 172.21.15.146:0/1369350042 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118004280 con 0x7fa1280a08e0 2023-10-03T10:16:24.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.649+0000 7fa12ce8d700 1 -- 172.21.15.146:0/1369350042 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa12811cd10 con 0x7fa1280a08e0 2023-10-03T10:16:24.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.649+0000 7fa12ce8d700 1 -- 172.21.15.146:0/1369350042 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12811f2a0 con 0x7fa1280a08e0 2023-10-03T10:16:24.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.649+0000 7fa116ffd700 1 -- 172.21.15.146:0/1369350042 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa1180043e0 con 0x7fa1280a08e0 2023-10-03T10:16:24.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.650+0000 7fa116ffd700 1 -- 172.21.15.146:0/1369350042 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa118022070 con 0x7fa1280a08e0 2023-10-03T10:16:24.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.651+0000 7fa12ce8d700 1 -- 172.21.15.146:0/1369350042 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12811e930 con 0x7fa1280a08e0 2023-10-03T10:16:24.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.655+0000 7fa116ffd700 1 -- 172.21.15.146:0/1369350042 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa11802c020 con 0x7fa1280a08e0 2023-10-03T10:16:24.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.764+0000 7f113717c700 1 -- 172.21.15.146:0/851106883 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f113004f2a0 con 0x7f1130130ce0 2023-10-03T10:16:24.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.765+0000 7f112d7fa700 1 -- 172.21.15.146:0/851106883 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f112802c090 con 0x7f1130130ce0 2023-10-03T10:16:24.765 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.768+0000 7f113717c700 1 -- 172.21.15.146:0/851106883 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1130130ce0 msgr2=0x7f113011da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.768+0000 7f113717c700 1 --2- 172.21.15.146:0/851106883 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1130130ce0 0x7f113011da20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1128009d90 tx=0x7f112800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.768+0000 7f113717c700 1 -- 172.21.15.146:0/851106883 shutdown_connections 2023-10-03T10:16:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.768+0000 7f113717c700 1 --2- 172.21.15.146:0/851106883 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1130130ce0 0x7f113011da20 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.768+0000 7f113717c700 1 --2- 172.21.15.146:0/851106883 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f113009d860 0x7f113011cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.768+0000 7f113717c700 1 --2- 172.21.15.146:0/851106883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f113009e170 0x7f113011d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.768+0000 7f113717c700 1 -- 172.21.15.146:0/851106883 >> 172.21.15.146:0/851106883 conn(0x7f1130099c40 msgr2=0x7f1130130010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.768+0000 7f113717c700 1 -- 172.21.15.146:0/851106883 shutdown_connections 2023-10-03T10:16:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.768+0000 7f113717c700 1 -- 172.21.15.146:0/851106883 wait complete. 2023-10-03T10:16:24.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:24.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.858+0000 7fd63c7b3700 1 -- 172.21.15.146:0/3858625869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd634072980 con 0x7fd634133f50 2023-10-03T10:16:24.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.859+0000 7fd62affd700 1 -- 172.21.15.146:0/3858625869 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd62c017020 con 0x7fd634133f50 2023-10-03T10:16:24.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.859+0000 7fdbadfca700 1 -- 172.21.15.146:0/1955867132 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdba804f2a0 con 0x7fdba80a1340 2023-10-03T10:16:24.859 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:24.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.859+0000 7fdb8ffff700 1 -- 172.21.15.146:0/1955867132 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdb9c00b920 con 0x7fdba80a1340 2023-10-03T10:16:24.860 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:24.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.862+0000 7fd63c7b3700 1 -- 172.21.15.146:0/3858625869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd634133f50 msgr2=0x7fd634123310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.862+0000 7fd63c7b3700 1 --2- 172.21.15.146:0/3858625869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd634133f50 0x7fd634123310 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00ca80 tx=0x7fd62c00cd90 comp rx=0 tx=0).stop 2023-10-03T10:16:24.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.862+0000 7fd63c7b3700 1 -- 172.21.15.146:0/3858625869 shutdown_connections 2023-10-03T10:16:24.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.862+0000 7fd63c7b3700 1 --2- 172.21.15.146:0/3858625869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd634133f50 0x7fd634123310 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.862+0000 7fd63c7b3700 1 --2- 172.21.15.146:0/3858625869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd6340a0a70 0x7fd634122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.862+0000 7fd63c7b3700 1 --2- 172.21.15.146:0/3858625869 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6340a1380 0x7fd634122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.862+0000 7fd63c7b3700 1 -- 172.21.15.146:0/3858625869 >> 172.21.15.146:0/3858625869 conn(0x7fd6340a6610 msgr2=0x7fd6340a4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.862+0000 7fd63c7b3700 1 -- 172.21.15.146:0/3858625869 shutdown_connections 2023-10-03T10:16:24.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.862+0000 7fd63c7b3700 1 -- 172.21.15.146:0/3858625869 wait complete. 2023-10-03T10:16:24.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.862+0000 7fdbadfca700 1 -- 172.21.15.146:0/1955867132 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdba80a1340 msgr2=0x7fdba81c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.862+0000 7fdbadfca700 1 --2- 172.21.15.146:0/1955867132 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdba80a1340 0x7fdba81c4590 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c012ed0 tx=0x7fdb9c00f390 comp rx=0 tx=0).stop 2023-10-03T10:16:24.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.862+0000 7fdbadfca700 1 -- 172.21.15.146:0/1955867132 shutdown_connections 2023-10-03T10:16:24.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.862+0000 7fdbadfca700 1 --2- 172.21.15.146:0/1955867132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdba81304a0 0x7fdba81c4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.862+0000 7fdbadfca700 1 --2- 172.21.15.146:0/1955867132 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdba80a0a30 0x7fdba81c4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.862+0000 7fdbadfca700 1 --2- 172.21.15.146:0/1955867132 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdba80a1340 0x7fdba81c4590 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.862+0000 7fdbadfca700 1 -- 172.21.15.146:0/1955867132 >> 172.21.15.146:0/1955867132 conn(0x7fdba80a2980 msgr2=0x7fdba81b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.862+0000 7fdbadfca700 1 -- 172.21.15.146:0/1955867132 shutdown_connections 2023-10-03T10:16:24.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.862+0000 7fdbadfca700 1 -- 172.21.15.146:0/1955867132 wait complete. 2023-10-03T10:16:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.868+0000 7fa12ce8d700 1 -- 172.21.15.146:0/1369350042 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa12804f2a0 con 0x7fa1280a08e0 2023-10-03T10:16:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.868+0000 7fa116ffd700 1 -- 172.21.15.146:0/1369350042 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa118027480 con 0x7fa1280a08e0 2023-10-03T10:16:24.869 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:24.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.870+0000 7fa12ce8d700 1 -- 172.21.15.146:0/1369350042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1280a08e0 msgr2=0x7fa1281c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.870+0000 7fa12ce8d700 1 --2- 172.21.15.146:0/1369350042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1280a08e0 0x7fa1281c7f80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa118014040 tx=0x7fa118004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.870+0000 7fa12ce8d700 1 -- 172.21.15.146:0/1369350042 shutdown_connections 2023-10-03T10:16:24.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.870+0000 7fa12ce8d700 1 --2- 172.21.15.146:0/1369350042 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa128133a70 0x7fa1281c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.870+0000 7fa12ce8d700 1 --2- 172.21.15.146:0/1369350042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1280a08e0 0x7fa1281c7f80 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.870+0000 7fa12ce8d700 1 --2- 172.21.15.146:0/1369350042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1280a1290 0x7fa1281c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.870+0000 7fa12ce8d700 1 -- 172.21.15.146:0/1369350042 >> 172.21.15.146:0/1369350042 conn(0x7fa1280a2980 msgr2=0x7fa1281bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.870+0000 7fa12ce8d700 1 -- 172.21.15.146:0/1369350042 shutdown_connections 2023-10-03T10:16:24.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:24.870+0000 7fa12ce8d700 1 -- 172.21.15.146:0/1369350042 wait complete. 2023-10-03T10:16:24.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:24.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:24.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:25.786 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:25.883 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:25.883 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:25.885 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:25.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.917+0000 7fea4b92a700 1 Processor -- start 2023-10-03T10:16:25.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.917+0000 7fea4b92a700 1 -- start start 2023-10-03T10:16:25.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.918+0000 7fea4b92a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea44133ad0 0x7fea44133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.918+0000 7fea4b92a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fea441300a0 0x7fea441304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.918+0000 7fea4b92a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea4406b2d0 con 0x7fea441309f0 2023-10-03T10:16:25.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.918+0000 7fea4b92a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea44133610 con 0x7fea441300a0 2023-10-03T10:16:25.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.918+0000 7fea4b92a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea4409a500 con 0x7fea44133ad0 2023-10-03T10:16:25.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.918+0000 7fea49ec7700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fea441309f0 0x7fea4413a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47144/0 (socket says 172.21.15.146:47144) 2023-10-03T10:16:25.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.918+0000 7fea49ec7700 1 -- 172.21.15.146:0/1458262340 learned_addr learned my addr 172.21.15.146:0/1458262340 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:25.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.918+0000 7fea496c6700 1 --2- 172.21.15.146:0/1458262340 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea44133ad0 0x7fea44133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.918+0000 7fea48ec5700 1 --2- 172.21.15.146:0/1458262340 >> v2:172.21.15.146:3300/0 conn(0x7fea441300a0 0x7fea441304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.919+0000 7fea3bfff700 1 -- 172.21.15.146:0/1458262340 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1856464646 0 0) 0x7fea4406b2d0 con 0x7fea441309f0 2023-10-03T10:16:25.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.919+0000 7fea496c6700 1 -- 172.21.15.146:0/1458262340 >> v2:172.21.15.146:3300/0 conn(0x7fea441300a0 msgr2=0x7fea441304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:25.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.919+0000 7fea496c6700 1 --2- 172.21.15.146:0/1458262340 >> v2:172.21.15.146:3300/0 conn(0x7fea441300a0 0x7fea441304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.919+0000 7fea496c6700 1 -- 172.21.15.146:0/1458262340 >> v1:172.21.15.146:6789/0 conn(0x7fea441309f0 legacy=0x7fea4413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.919+0000 7fea496c6700 1 -- 172.21.15.146:0/1458262340 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea441338b0 con 0x7fea44133ad0 2023-10-03T10:16:25.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.919+0000 7fea496c6700 1 --2- 172.21.15.146:0/1458262340 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea44133ad0 0x7fea44133ea0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fea40009840 tx=0x7fea40009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35752fcceb567264 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.919+0000 7fea3bfff700 1 -- 172.21.15.146:0/1458262340 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea40011830 con 0x7fea44133ad0 2023-10-03T10:16:25.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.919+0000 7fea3bfff700 1 -- 172.21.15.146:0/1458262340 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea40011990 con 0x7fea44133ad0 2023-10-03T10:16:25.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.919+0000 7fea3bfff700 1 -- 172.21.15.146:0/1458262340 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea40011d20 con 0x7fea44133ad0 2023-10-03T10:16:25.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.920+0000 7fea4b92a700 1 -- 172.21.15.146:0/1458262340 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea44133ad0 msgr2=0x7fea44133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.920+0000 7fea4b92a700 1 --2- 172.21.15.146:0/1458262340 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea44133ad0 0x7fea44133ea0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fea40009840 tx=0x7fea40009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:25.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.920+0000 7fea4b92a700 1 -- 172.21.15.146:0/1458262340 shutdown_connections 2023-10-03T10:16:25.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.920+0000 7fea4b92a700 1 --2- 172.21.15.146:0/1458262340 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea44133ad0 0x7fea44133ea0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.920+0000 7fea4b92a700 1 --2- 172.21.15.146:0/1458262340 >> v2:172.21.15.146:3300/0 conn(0x7fea441300a0 0x7fea441304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.920+0000 7fea4b92a700 1 -- 172.21.15.146:0/1458262340 >> 172.21.15.146:0/1458262340 conn(0x7fea44099c40 msgr2=0x7fea440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.920+0000 7fea4b92a700 1 -- 172.21.15.146:0/1458262340 shutdown_connections 2023-10-03T10:16:25.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.920+0000 7fea4b92a700 1 -- 172.21.15.146:0/1458262340 wait complete. 2023-10-03T10:16:25.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.921+0000 7fea4b92a700 1 Processor -- start 2023-10-03T10:16:25.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.921+0000 7fea4b92a700 1 -- start start 2023-10-03T10:16:25.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.922+0000 7fea4b92a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea441300a0 0x7fea4412d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.922+0000 7fea4b92a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea441309f0 0x7fea44071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.922+0000 7fea4b92a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea44133ad0 0x7fea440718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.922+0000 7fea4b92a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4411e180 con 0x7fea44133ad0 2023-10-03T10:16:25.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.922+0000 7fea4b92a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4411df90 con 0x7fea441309f0 2023-10-03T10:16:25.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.922+0000 7fea4b92a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea4411ff20 con 0x7fea441300a0 2023-10-03T10:16:25.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.922+0000 7fea49ec7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea44133ad0 0x7fea440718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.922+0000 7fea49ec7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea44133ad0 0x7fea440718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49550/0 (socket says 172.21.15.146:49550) 2023-10-03T10:16:25.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.922+0000 7fea496c6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea441300a0 0x7fea4412d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.922+0000 7fea49ec7700 1 -- 172.21.15.146:0/1609265075 learned_addr learned my addr 172.21.15.146:0/1609265075 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:25.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.922+0000 7fea48ec5700 1 --2- 172.21.15.146:0/1609265075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea441309f0 0x7fea44071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.923+0000 7fea49ec7700 1 -- 172.21.15.146:0/1609265075 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea441300a0 msgr2=0x7fea4412d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.923+0000 7fea49ec7700 1 --2- 172.21.15.146:0/1609265075 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea441300a0 0x7fea4412d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.923+0000 7fea49ec7700 1 -- 172.21.15.146:0/1609265075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea441309f0 msgr2=0x7fea44071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.923+0000 7fea49ec7700 1 --2- 172.21.15.146:0/1609265075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea441309f0 0x7fea44071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.923+0000 7fea49ec7700 1 -- 172.21.15.146:0/1609265075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea400094a0 con 0x7fea44133ad0 2023-10-03T10:16:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.923+0000 7fea49ec7700 1 --2- 172.21.15.146:0/1609265075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea44133ad0 0x7fea440718b0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fea3c002230 tx=0x7fea3c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.923+0000 7fea39ffb700 1 -- 172.21.15.146:0/1609265075 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c00ab70 con 0x7fea44133ad0 2023-10-03T10:16:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.923+0000 7fea4b92a700 1 -- 172.21.15.146:0/1609265075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea4412dd00 con 0x7fea44133ad0 2023-10-03T10:16:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.923+0000 7fea39ffb700 1 -- 172.21.15.146:0/1609265075 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3c00acd0 con 0x7fea44133ad0 2023-10-03T10:16:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.923+0000 7fea39ffb700 1 -- 172.21.15.146:0/1609265075 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c007310 con 0x7fea44133ad0 2023-10-03T10:16:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.923+0000 7fea4b92a700 1 -- 172.21.15.146:0/1609265075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea44071df0 con 0x7fea44133ad0 2023-10-03T10:16:25.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.925+0000 7fea4b92a700 1 -- 172.21.15.146:0/1609265075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea440a2620 con 0x7fea44133ad0 2023-10-03T10:16:25.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.925+0000 7fea39ffb700 1 -- 172.21.15.146:0/1609265075 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea3c007470 con 0x7fea44133ad0 2023-10-03T10:16:25.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.925+0000 7fea39ffb700 1 -- 172.21.15.146:0/1609265075 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fea3c03f760 con 0x7fea44133ad0 2023-10-03T10:16:25.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:25.930+0000 7fea39ffb700 1 -- 172.21.15.146:0/1609265075 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea3c00ae40 con 0x7fea44133ad0 2023-10-03T10:16:26.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.015+0000 7fb0b562e700 1 Processor -- start 2023-10-03T10:16:26.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.015+0000 7fb0b562e700 1 -- start start 2023-10-03T10:16:26.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.015+0000 7fb0b562e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0b009d860 0x7fb0b009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.015+0000 7fb0b562e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0b0130eb0 0x7fb0b0138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.015+0000 7fb0b562e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b009aaa0 con 0x7fb0b009e170 2023-10-03T10:16:26.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.015+0000 7fb0b562e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b009f870 con 0x7fb0b0130eb0 2023-10-03T10:16:26.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.015+0000 7fb0b562e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b009b360 con 0x7fb0b009d860 2023-10-03T10:16:26.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.016+0000 7fb0af7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0b0130eb0 0x7fb0b0138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.016+0000 7fb0ae7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb0b009e170 0x7fb0b01307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47148/0 (socket says 172.21.15.146:47148) 2023-10-03T10:16:26.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.016+0000 7fb0af7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0b0130eb0 0x7fb0b0138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59352/0 (socket says 172.21.15.146:59352) 2023-10-03T10:16:26.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.016+0000 7fb0ae7fc700 1 -- 172.21.15.146:0/3860664973 learned_addr learned my addr 172.21.15.146:0/3860664973 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:26.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.016+0000 7fb0aeffd700 1 --2- 172.21.15.146:0/3860664973 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0b009d860 0x7fb0b009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.016+0000 7fb0adffb700 1 -- 172.21.15.146:0/3860664973 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050397660 0 0) 0x7fb0b009aaa0 con 0x7fb0b009e170 2023-10-03T10:16:26.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.016+0000 7fb0adffb700 1 -- 172.21.15.146:0/3860664973 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0980035b0 con 0x7fb0b009e170 2023-10-03T10:16:26.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.016+0000 7fb0aeffd700 1 -- 172.21.15.146:0/3860664973 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0b0130eb0 msgr2=0x7fb0b0138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:26.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.016+0000 7fb0aeffd700 1 --2- 172.21.15.146:0/3860664973 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0b0130eb0 0x7fb0b0138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.016+0000 7fb0aeffd700 1 -- 172.21.15.146:0/3860664973 >> v1:172.21.15.146:6789/0 conn(0x7fb0b009e170 legacy=0x7fb0b01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.016+0000 7fb0aeffd700 1 -- 172.21.15.146:0/3860664973 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b009b620 con 0x7fb0b009d860 2023-10-03T10:16:26.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.016+0000 7fb0aeffd700 1 --2- 172.21.15.146:0/3860664973 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0b009d860 0x7fb0b009dc30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009870 tx=0x7fb0a0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69f5eadaf845a93d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.017+0000 7fb0adffb700 1 -- 172.21.15.146:0/3860664973 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0011830 con 0x7fb0b009d860 2023-10-03T10:16:26.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.017+0000 7fb0adffb700 1 -- 172.21.15.146:0/3860664973 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a0011990 con 0x7fb0b009d860 2023-10-03T10:16:26.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.017+0000 7fb0adffb700 1 -- 172.21.15.146:0/3860664973 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0011d00 con 0x7fb0b009d860 2023-10-03T10:16:26.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.018+0000 7fb0b562e700 1 -- 172.21.15.146:0/3860664973 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0b009d860 msgr2=0x7fb0b009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.018+0000 7fb0b562e700 1 --2- 172.21.15.146:0/3860664973 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0b009d860 0x7fb0b009dc30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009870 tx=0x7fb0a0009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:26.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.018+0000 7fb0b562e700 1 -- 172.21.15.146:0/3860664973 shutdown_connections 2023-10-03T10:16:26.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.018+0000 7fb0b562e700 1 --2- 172.21.15.146:0/3860664973 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0b0130eb0 0x7fb0b0138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.018+0000 7fb0b562e700 1 --2- 172.21.15.146:0/3860664973 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0b009d860 0x7fb0b009dc30 secure :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009870 tx=0x7fb0a0009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:26.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.018+0000 7fb0b562e700 1 -- 172.21.15.146:0/3860664973 >> 172.21.15.146:0/3860664973 conn(0x7fb0b0099c40 msgr2=0x7fb0b00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.018+0000 7fb0b562e700 1 -- 172.21.15.146:0/3860664973 shutdown_connections 2023-10-03T10:16:26.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.018+0000 7fb0b562e700 1 -- 172.21.15.146:0/3860664973 wait complete. 2023-10-03T10:16:26.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.019+0000 7fb0b562e700 1 Processor -- start 2023-10-03T10:16:26.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.019+0000 7fb0b562e700 1 -- start start 2023-10-03T10:16:26.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.020+0000 7fb0b562e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b009e170 0x7fb0b01217c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.020+0000 7fb0b562e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0b0130eb0 0x7fb0b0121d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.020+0000 7fb0b562e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0b0122240 0x7fb0b01c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.020+0000 7fb0b562e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b0123520 con 0x7fb0b009e170 2023-10-03T10:16:26.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.020+0000 7fb0b562e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b0122b30 con 0x7fb0b0122240 2023-10-03T10:16:26.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.020+0000 7fb0b562e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b0124490 con 0x7fb0b0130eb0 2023-10-03T10:16:26.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.020+0000 7fb0aeffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b009e170 0x7fb0b01217c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.020+0000 7fb0aeffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b009e170 0x7fb0b01217c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49560/0 (socket says 172.21.15.146:49560) 2023-10-03T10:16:26.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.020+0000 7fb0aeffd700 1 -- 172.21.15.146:0/3219262051 learned_addr learned my addr 172.21.15.146:0/3219262051 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:26.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.020+0000 7fb0af7fe700 1 --2- 172.21.15.146:0/3219262051 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0b0122240 0x7fb0b01c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.020+0000 7fb0ae7fc700 1 --2- 172.21.15.146:0/3219262051 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0b0130eb0 0x7fb0b0121d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.020+0000 7fb0aeffd700 1 -- 172.21.15.146:0/3219262051 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0b0130eb0 msgr2=0x7fb0b0121d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.020+0000 7fb0aeffd700 1 --2- 172.21.15.146:0/3219262051 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0b0130eb0 0x7fb0b0121d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.020+0000 7fb0aeffd700 1 -- 172.21.15.146:0/3219262051 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0b0122240 msgr2=0x7fb0b01c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.020+0000 7fb0aeffd700 1 --2- 172.21.15.146:0/3219262051 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0b0122240 0x7fb0b01c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.020+0000 7fb0aeffd700 1 -- 172.21.15.146:0/3219262051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a00094a0 con 0x7fb0b009e170 2023-10-03T10:16:26.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.021+0000 7fb0aeffd700 1 --2- 172.21.15.146:0/3219262051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b009e170 0x7fb0b01217c0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009840 tx=0x7fb0a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.022+0000 7fb0977fe700 1 -- 172.21.15.146:0/3219262051 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0004550 con 0x7fb0b009e170 2023-10-03T10:16:26.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.022+0000 7fb0977fe700 1 -- 172.21.15.146:0/3219262051 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a001f070 con 0x7fb0b009e170 2023-10-03T10:16:26.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.022+0000 7fb0977fe700 1 -- 172.21.15.146:0/3219262051 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a00038e0 con 0x7fb0b009e170 2023-10-03T10:16:26.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.022+0000 7fb0b562e700 1 -- 172.21.15.146:0/3219262051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b0123f70 con 0x7fb0b009e170 2023-10-03T10:16:26.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.022+0000 7fb0b562e700 1 -- 172.21.15.146:0/3219262051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b01228f0 con 0x7fb0b009e170 2023-10-03T10:16:26.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.023+0000 7fb0977fe700 1 -- 172.21.15.146:0/3219262051 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb0a0003a40 con 0x7fb0b009e170 2023-10-03T10:16:26.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.023+0000 7fb0977fe700 1 -- 172.21.15.146:0/3219262051 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb0a0021070 con 0x7fb0b009e170 2023-10-03T10:16:26.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.025+0000 7fb0b562e700 1 -- 172.21.15.146:0/3219262051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b004f2a0 con 0x7fb0b009e170 2023-10-03T10:16:26.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.025+0000 7fa1457b8700 1 Processor -- start 2023-10-03T10:16:26.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.025+0000 7fa1457b8700 1 -- start start 2023-10-03T10:16:26.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.026+0000 7fa1457b8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1400a1550 0x7fa140138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.026+0000 7fa1457b8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa140139200 0x7fa14013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.026+0000 7fa1457b8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa14009e9d0 con 0x7fa1400a0a70 2023-10-03T10:16:26.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.026+0000 7fa1457b8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa14009dc00 con 0x7fa140139200 2023-10-03T10:16:26.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.026+0000 7fa1457b8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14009dec0 con 0x7fa1400a1550 2023-10-03T10:16:26.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.026+0000 7fa13effd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa1400a0a70 0x7fa1400a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47156/0 (socket says 172.21.15.146:47156) 2023-10-03T10:16:26.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.026+0000 7fa13effd700 1 -- 172.21.15.146:0/542370867 learned_addr learned my addr 172.21.15.146:0/542370867 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:26.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.026+0000 7fa137fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1400a1550 0x7fa140138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.026+0000 7fa13f7fe700 1 --2- 172.21.15.146:0/542370867 >> v2:172.21.15.146:3300/0 conn(0x7fa140139200 0x7fa14013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.027+0000 7fa137fff700 1 -- 172.21.15.146:0/542370867 >> v2:172.21.15.146:3300/0 conn(0x7fa140139200 msgr2=0x7fa14013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:26.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.027+0000 7fa137fff700 1 --2- 172.21.15.146:0/542370867 >> v2:172.21.15.146:3300/0 conn(0x7fa140139200 0x7fa14013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.027+0000 7fa137fff700 1 -- 172.21.15.146:0/542370867 >> v1:172.21.15.146:6789/0 conn(0x7fa1400a0a70 legacy=0x7fa1400a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.027+0000 7fa137fff700 1 -- 172.21.15.146:0/542370867 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14009e6a0 con 0x7fa1400a1550 2023-10-03T10:16:26.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.027+0000 7fa13f7fe700 1 --2- 172.21.15.146:0/542370867 >> v2:172.21.15.146:3300/0 conn(0x7fa140139200 0x7fa14013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:26.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.027+0000 7fa137fff700 1 --2- 172.21.15.146:0/542370867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1400a1550 0x7fa140138cc0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa128009840 tx=0x7fa128009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=389a88ca70abe765 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.027+0000 7fa13e7fc700 1 -- 172.21.15.146:0/542370867 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128011830 con 0x7fa1400a1550 2023-10-03T10:16:26.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.027+0000 7fa13e7fc700 1 -- 172.21.15.146:0/542370867 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa128011990 con 0x7fa1400a1550 2023-10-03T10:16:26.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.027+0000 7fa13e7fc700 1 -- 172.21.15.146:0/542370867 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128011d20 con 0x7fa1400a1550 2023-10-03T10:16:26.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.028+0000 7fa1457b8700 1 -- 172.21.15.146:0/542370867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1400a1550 msgr2=0x7fa140138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.028+0000 7fa1457b8700 1 --2- 172.21.15.146:0/542370867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1400a1550 0x7fa140138cc0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa128009840 tx=0x7fa128009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:26.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.028+0000 7fa1457b8700 1 -- 172.21.15.146:0/542370867 shutdown_connections 2023-10-03T10:16:26.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.028+0000 7fa1457b8700 1 --2- 172.21.15.146:0/542370867 >> v2:172.21.15.146:3300/0 conn(0x7fa140139200 0x7fa14013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.028+0000 7fa1457b8700 1 --2- 172.21.15.146:0/542370867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1400a1550 0x7fa140138cc0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.028+0000 7fa1457b8700 1 -- 172.21.15.146:0/542370867 >> 172.21.15.146:0/542370867 conn(0x7fa1400a6610 msgr2=0x7fa1400a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.028+0000 7fa1457b8700 1 -- 172.21.15.146:0/542370867 shutdown_connections 2023-10-03T10:16:26.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.028+0000 7fa1457b8700 1 -- 172.21.15.146:0/542370867 wait complete. 2023-10-03T10:16:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.029+0000 7fa1457b8700 1 Processor -- start 2023-10-03T10:16:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.029+0000 7fa1457b8700 1 -- start start 2023-10-03T10:16:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.030+0000 7fa1457b8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa1400a0a70 0x7fa14011e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.030+0000 7fa1457b8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1400a1550 0x7fa14011eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.030+0000 7fa1457b8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa140139200 0x7fa14011f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.030+0000 7fa1457b8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1401224a0 con 0x7fa140139200 2023-10-03T10:16:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.030+0000 7fa1457b8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1401220a0 con 0x7fa1400a1550 2023-10-03T10:16:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.030+0000 7fa1457b8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa140121af0 con 0x7fa1400a0a70 2023-10-03T10:16:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.030+0000 7fa13f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa140139200 0x7fa14011f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.030+0000 7fa13f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa140139200 0x7fa14011f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49576/0 (socket says 172.21.15.146:49576) 2023-10-03T10:16:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.030+0000 7fa13f7fe700 1 -- 172.21.15.146:0/2427214885 learned_addr learned my addr 172.21.15.146:0/2427214885 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.030+0000 7fa13effd700 1 --2- 172.21.15.146:0/2427214885 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa1400a0a70 0x7fa14011e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.030+0000 7fa137fff700 1 --2- 172.21.15.146:0/2427214885 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1400a1550 0x7fa14011eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.031+0000 7fa13effd700 1 -- 172.21.15.146:0/2427214885 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1400a1550 msgr2=0x7fa14011eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.031+0000 7fa13effd700 1 --2- 172.21.15.146:0/2427214885 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1400a1550 0x7fa14011eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.031+0000 7fa13effd700 1 -- 172.21.15.146:0/2427214885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa140139200 msgr2=0x7fa14011f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.031+0000 7fa13effd700 1 --2- 172.21.15.146:0/2427214885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa140139200 0x7fa14011f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.031+0000 7fa13effd700 1 -- 172.21.15.146:0/2427214885 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa138009a70 con 0x7fa1400a0a70 2023-10-03T10:16:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.031+0000 7fa137fff700 1 --2- 172.21.15.146:0/2427214885 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1400a1550 0x7fa14011eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.031+0000 7fa13effd700 1 --2- 172.21.15.146:0/2427214885 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa1400a0a70 0x7fa14011e860 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa13000c500 tx=0x7fa13000c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.031+0000 7fb0977fe700 1 -- 172.21.15.146:0/3219262051 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0a00253e0 con 0x7fb0b009e170 2023-10-03T10:16:26.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.031+0000 7fa1377fe700 1 -- 172.21.15.146:0/2427214885 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa130005d70 con 0x7fa1400a0a70 2023-10-03T10:16:26.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.031+0000 7fa1377fe700 1 -- 172.21.15.146:0/2427214885 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1300070d0 con 0x7fa1400a0a70 2023-10-03T10:16:26.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.031+0000 7fa1377fe700 1 -- 172.21.15.146:0/2427214885 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa130007440 con 0x7fa1400a0a70 2023-10-03T10:16:26.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.032+0000 7fa1457b8700 1 -- 172.21.15.146:0/2427214885 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1280094a0 con 0x7fa1400a0a70 2023-10-03T10:16:26.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.032+0000 7fa1457b8700 1 -- 172.21.15.146:0/2427214885 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1400a52f0 con 0x7fa1400a0a70 2023-10-03T10:16:26.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.033+0000 7fa1377fe700 1 -- 172.21.15.146:0/2427214885 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa1300075a0 con 0x7fa1400a0a70 2023-10-03T10:16:26.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.033+0000 7fa1457b8700 1 -- 172.21.15.146:0/2427214885 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa14004f2a0 con 0x7fa1400a0a70 2023-10-03T10:16:26.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.033+0000 7fa1377fe700 1 -- 172.21.15.146:0/2427214885 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa13003ea40 con 0x7fa1400a0a70 2023-10-03T10:16:26.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.038+0000 7fa1377fe700 1 -- 172.21.15.146:0/2427214885 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa130017020 con 0x7fa1400a0a70 2023-10-03T10:16:26.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.065+0000 7f7dbc5e1700 1 Processor -- start 2023-10-03T10:16:26.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.065+0000 7f7dbc5e1700 1 -- start start 2023-10-03T10:16:26.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.065+0000 7f7dbc5e1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7db40a1550 0x7f7db4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.065+0000 7f7dbc5e1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db4139200 0x7f7db413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.066+0000 7f7dbc5e1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db409e9d0 con 0x7f7db40a0a70 2023-10-03T10:16:26.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.066+0000 7f7dbc5e1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db409dc00 con 0x7f7db4139200 2023-10-03T10:16:26.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.066+0000 7f7dbc5e1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7db409dec0 con 0x7f7db40a1550 2023-10-03T10:16:26.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.066+0000 7f7db9b7c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7db40a1550 0x7f7db4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.066+0000 7f7dbab7e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db4139200 0x7f7db413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.066+0000 7f7dbab7e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db4139200 0x7f7db413b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59388/0 (socket says 172.21.15.146:59388) 2023-10-03T10:16:26.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.066+0000 7f7db9b7c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7db40a1550 0x7f7db4138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36266/0 (socket says 172.21.15.146:36266) 2023-10-03T10:16:26.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.066+0000 7f7dbab7e700 1 -- 172.21.15.146:0/3567083364 learned_addr learned my addr 172.21.15.146:0/3567083364 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:26.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.066+0000 7f7db9b7c700 1 -- 172.21.15.146:0/3567083364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db4139200 msgr2=0x7f7db413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:26.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.066+0000 7f7db937b700 1 -- 172.21.15.146:0/3567083364 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576532527 0 0) 0x7f7db409e9d0 con 0x7f7db40a0a70 2023-10-03T10:16:26.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.066+0000 7f7db9b7c700 1 --2- 172.21.15.146:0/3567083364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db4139200 0x7f7db413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.066+0000 7f7db9b7c700 1 -- 172.21.15.146:0/3567083364 >> v1:172.21.15.146:6789/0 conn(0x7f7db40a0a70 legacy=0x7f7db40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.066+0000 7f7db9b7c700 1 -- 172.21.15.146:0/3567083364 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db409e6a0 con 0x7f7db40a1550 2023-10-03T10:16:26.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.066+0000 7f7dbab7e700 1 --2- 172.21.15.146:0/3567083364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db4139200 0x7f7db413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:26.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.066+0000 7f7db9b7c700 1 --2- 172.21.15.146:0/3567083364 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7db40a1550 0x7f7db4138cc0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7da4009870 tx=0x7f7da4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11f5ba1fef468153 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.067+0000 7f7db937b700 1 -- 172.21.15.146:0/3567083364 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da4011830 con 0x7f7db40a1550 2023-10-03T10:16:26.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.067+0000 7f7db937b700 1 -- 172.21.15.146:0/3567083364 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da4011990 con 0x7f7db40a1550 2023-10-03T10:16:26.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.067+0000 7f7db937b700 1 -- 172.21.15.146:0/3567083364 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da4011d20 con 0x7f7db40a1550 2023-10-03T10:16:26.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.067+0000 7f7dbc5e1700 1 -- 172.21.15.146:0/3567083364 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7db40a1550 msgr2=0x7f7db4138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.067+0000 7f7dbc5e1700 1 --2- 172.21.15.146:0/3567083364 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7db40a1550 0x7f7db4138cc0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7da4009870 tx=0x7f7da4009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:26.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.068+0000 7f7dbc5e1700 1 -- 172.21.15.146:0/3567083364 shutdown_connections 2023-10-03T10:16:26.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.068+0000 7f7dbc5e1700 1 --2- 172.21.15.146:0/3567083364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db4139200 0x7f7db413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.068+0000 7f7dbc5e1700 1 --2- 172.21.15.146:0/3567083364 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7db40a1550 0x7f7db4138cc0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.068+0000 7f7dbc5e1700 1 -- 172.21.15.146:0/3567083364 >> 172.21.15.146:0/3567083364 conn(0x7f7db40a6610 msgr2=0x7f7db40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.068+0000 7f7dbc5e1700 1 -- 172.21.15.146:0/3567083364 shutdown_connections 2023-10-03T10:16:26.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.068+0000 7f7dbc5e1700 1 -- 172.21.15.146:0/3567083364 wait complete. 2023-10-03T10:16:26.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.069+0000 7f7dbc5e1700 1 Processor -- start 2023-10-03T10:16:26.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.069+0000 7f7dbc5e1700 1 -- start start 2023-10-03T10:16:26.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.070+0000 7f7dbc5e1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7db40a0a70 0x7f7db4120750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.070+0000 7f7dbc5e1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7db40a1550 0x7f7db4120c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.070+0000 7f7dbc5e1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db4139200 0x7f7db41211d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.070+0000 7f7dbc5e1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db4122360 con 0x7f7db40a1550 2023-10-03T10:16:26.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.070+0000 7f7dbc5e1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db4136640 con 0x7f7db4139200 2023-10-03T10:16:26.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.070+0000 7f7dbc5e1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7db4123f90 con 0x7f7db40a0a70 2023-10-03T10:16:26.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.070+0000 7f7dbab7e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db4139200 0x7f7db41211d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.070+0000 7f7dbab7e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db4139200 0x7f7db41211d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59392/0 (socket says 172.21.15.146:59392) 2023-10-03T10:16:26.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.070+0000 7f7dbab7e700 1 -- 172.21.15.146:0/3147520994 learned_addr learned my addr 172.21.15.146:0/3147520994 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:26.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.070+0000 7f7dba37d700 1 --2- 172.21.15.146:0/3147520994 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7db40a0a70 0x7f7db4120750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.070+0000 7f7db9b7c700 1 --2- 172.21.15.146:0/3147520994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7db40a1550 0x7f7db4120c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.070+0000 7f7dbab7e700 1 -- 172.21.15.146:0/3147520994 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7db40a0a70 msgr2=0x7f7db4120750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.070+0000 7f7dbab7e700 1 --2- 172.21.15.146:0/3147520994 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7db40a0a70 0x7f7db4120750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.070+0000 7f7dbab7e700 1 -- 172.21.15.146:0/3147520994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7db40a1550 msgr2=0x7f7db4120c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.070+0000 7f7dbab7e700 1 --2- 172.21.15.146:0/3147520994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7db40a1550 0x7f7db4120c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.070+0000 7f7dbab7e700 1 -- 172.21.15.146:0/3147520994 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac009b30 con 0x7f7db4139200 2023-10-03T10:16:26.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.071+0000 7f7dbab7e700 1 --2- 172.21.15.146:0/3147520994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db4139200 0x7f7db41211d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7dac00efc0 tx=0x7f7dac00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.071+0000 7f7daaffd700 1 -- 172.21.15.146:0/3147520994 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac018070 con 0x7f7db4139200 2023-10-03T10:16:26.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.071+0000 7f7daaffd700 1 -- 172.21.15.146:0/3147520994 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dac00f040 con 0x7f7db4139200 2023-10-03T10:16:26.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.071+0000 7f7daaffd700 1 -- 172.21.15.146:0/3147520994 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac003c60 con 0x7f7db4139200 2023-10-03T10:16:26.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.072+0000 7f7dbc5e1700 1 -- 172.21.15.146:0/3147520994 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da40094a0 con 0x7f7db4139200 2023-10-03T10:16:26.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.072+0000 7f7dbc5e1700 1 -- 172.21.15.146:0/3147520994 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db4122b80 con 0x7f7db4139200 2023-10-03T10:16:26.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.073+0000 7f7daaffd700 1 -- 172.21.15.146:0/3147520994 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7dac00c930 con 0x7f7db4139200 2023-10-03T10:16:26.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.073+0000 7f7daaffd700 1 -- 172.21.15.146:0/3147520994 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7dac03f960 con 0x7f7db4139200 2023-10-03T10:16:26.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.073+0000 7f7dbc5e1700 1 -- 172.21.15.146:0/3147520994 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db40a5100 con 0x7f7db4139200 2023-10-03T10:16:26.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.082+0000 7f7daaffd700 1 -- 172.21.15.146:0/3147520994 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7dac003dc0 con 0x7f7db4139200 2023-10-03T10:16:26.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.132+0000 7fea4b92a700 1 -- 172.21.15.146:0/1609265075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fea4411f9b0 con 0x7fea44133ad0 2023-10-03T10:16:26.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.132+0000 7fea39ffb700 1 -- 172.21.15.146:0/1609265075 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea3c018030 con 0x7fea44133ad0 2023-10-03T10:16:26.133 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.136+0000 7fea4b92a700 1 -- 172.21.15.146:0/1609265075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea44133ad0 msgr2=0x7fea440718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.136+0000 7fea4b92a700 1 --2- 172.21.15.146:0/1609265075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea44133ad0 0x7fea440718b0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fea3c002230 tx=0x7fea3c00cf50 comp rx=0 tx=0).stop 2023-10-03T10:16:26.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.136+0000 7fea4b92a700 1 -- 172.21.15.146:0/1609265075 shutdown_connections 2023-10-03T10:16:26.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.136+0000 7fea4b92a700 1 --2- 172.21.15.146:0/1609265075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea44133ad0 0x7fea440718b0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.136+0000 7fea4b92a700 1 --2- 172.21.15.146:0/1609265075 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea441300a0 0x7fea4412d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.136+0000 7fea4b92a700 1 --2- 172.21.15.146:0/1609265075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea441309f0 0x7fea44071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.136+0000 7fea4b92a700 1 -- 172.21.15.146:0/1609265075 >> 172.21.15.146:0/1609265075 conn(0x7fea44099c40 msgr2=0x7fea44132930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.136+0000 7fea4b92a700 1 -- 172.21.15.146:0/1609265075 shutdown_connections 2023-10-03T10:16:26.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.136+0000 7fea4b92a700 1 -- 172.21.15.146:0/1609265075 wait complete. 2023-10-03T10:16:26.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:26.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.232+0000 7fb0b562e700 1 -- 172.21.15.146:0/3219262051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb0b009c8b0 con 0x7fb0b009e170 2023-10-03T10:16:26.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.232+0000 7fb0977fe700 1 -- 172.21.15.146:0/3219262051 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0a0015020 con 0x7fb0b009e170 2023-10-03T10:16:26.233 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:26.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.234+0000 7fb0b562e700 1 -- 172.21.15.146:0/3219262051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b009e170 msgr2=0x7fb0b01217c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.234+0000 7fb0b562e700 1 --2- 172.21.15.146:0/3219262051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b009e170 0x7fb0b01217c0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009840 tx=0x7fb0a0004750 comp rx=0 tx=0).stop 2023-10-03T10:16:26.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.234+0000 7fb0b562e700 1 -- 172.21.15.146:0/3219262051 shutdown_connections 2023-10-03T10:16:26.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.234+0000 7fb0b562e700 1 --2- 172.21.15.146:0/3219262051 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0b0122240 0x7fb0b01c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.234+0000 7fb0b562e700 1 --2- 172.21.15.146:0/3219262051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b009e170 0x7fb0b01217c0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.234+0000 7fb0b562e700 1 --2- 172.21.15.146:0/3219262051 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0b0130eb0 0x7fb0b0121d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.234+0000 7fb0b562e700 1 -- 172.21.15.146:0/3219262051 >> 172.21.15.146:0/3219262051 conn(0x7fb0b0099c40 msgr2=0x7fb0b0119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.234+0000 7fb0b562e700 1 -- 172.21.15.146:0/3219262051 shutdown_connections 2023-10-03T10:16:26.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.234+0000 7fb0b562e700 1 -- 172.21.15.146:0/3219262051 wait complete. 2023-10-03T10:16:26.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:26.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.261+0000 7fa1457b8700 1 -- 172.21.15.146:0/2427214885 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa140121d40 con 0x7fa1400a0a70 2023-10-03T10:16:26.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.261+0000 7fa1377fe700 1 -- 172.21.15.146:0/2427214885 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa140121d40 con 0x7fa1400a0a70 2023-10-03T10:16:26.262 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:26.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.263+0000 7fa1457b8700 1 -- 172.21.15.146:0/2427214885 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa1400a0a70 msgr2=0x7fa14011e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.263+0000 7fa1457b8700 1 --2- 172.21.15.146:0/2427214885 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa1400a0a70 0x7fa14011e860 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa13000c500 tx=0x7fa13000c810 comp rx=0 tx=0).stop 2023-10-03T10:16:26.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.263+0000 7fa1457b8700 1 -- 172.21.15.146:0/2427214885 shutdown_connections 2023-10-03T10:16:26.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.263+0000 7fa1457b8700 1 --2- 172.21.15.146:0/2427214885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa140139200 0x7fa14011f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.263+0000 7fa1457b8700 1 --2- 172.21.15.146:0/2427214885 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa1400a0a70 0x7fa14011e860 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.263+0000 7fa1457b8700 1 --2- 172.21.15.146:0/2427214885 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa1400a1550 0x7fa14011eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.263+0000 7fa1457b8700 1 -- 172.21.15.146:0/2427214885 >> 172.21.15.146:0/2427214885 conn(0x7fa1400a6610 msgr2=0x7fa1401381b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.263+0000 7fa1457b8700 1 -- 172.21.15.146:0/2427214885 shutdown_connections 2023-10-03T10:16:26.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.264+0000 7fa1457b8700 1 -- 172.21.15.146:0/2427214885 wait complete. 2023-10-03T10:16:26.280 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:26.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.300+0000 7f7dbc5e1700 1 -- 172.21.15.146:0/3147520994 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7db40a03e0 con 0x7f7db4139200 2023-10-03T10:16:26.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.300+0000 7f7daaffd700 1 -- 172.21.15.146:0/3147520994 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7dac02b090 con 0x7f7db4139200 2023-10-03T10:16:26.301 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:26.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.303+0000 7f7dbc5e1700 1 -- 172.21.15.146:0/3147520994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db4139200 msgr2=0x7f7db41211d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.303+0000 7f7dbc5e1700 1 --2- 172.21.15.146:0/3147520994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db4139200 0x7f7db41211d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7dac00efc0 tx=0x7f7dac00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.303+0000 7f7dbc5e1700 1 -- 172.21.15.146:0/3147520994 shutdown_connections 2023-10-03T10:16:26.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.303+0000 7f7dbc5e1700 1 --2- 172.21.15.146:0/3147520994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db4139200 0x7f7db41211d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.303+0000 7f7dbc5e1700 1 --2- 172.21.15.146:0/3147520994 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7db40a0a70 0x7f7db4120750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.303+0000 7f7dbc5e1700 1 --2- 172.21.15.146:0/3147520994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7db40a1550 0x7f7db4120c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.303+0000 7f7dbc5e1700 1 -- 172.21.15.146:0/3147520994 >> 172.21.15.146:0/3147520994 conn(0x7f7db40a6610 msgr2=0x7f7db40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.303+0000 7f7dbc5e1700 1 -- 172.21.15.146:0/3147520994 shutdown_connections 2023-10-03T10:16:26.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:26.303+0000 7f7dbc5e1700 1 -- 172.21.15.146:0/3147520994 wait complete. 2023-10-03T10:16:26.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:27.150 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:27.247 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:27.281 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:27.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.286+0000 7f99b6774700 1 Processor -- start 2023-10-03T10:16:27.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.286+0000 7f99b6774700 1 -- start start 2023-10-03T10:16:27.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.287+0000 7f99b6774700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b009ef80 0x7f99b0138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.287+0000 7f99b6774700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f99b009f370 0x7f99b013b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.287+0000 7f99b6774700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b009af80 con 0x7f99b009a150 2023-10-03T10:16:27.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.287+0000 7f99b6774700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b009fe00 con 0x7f99b009f370 2023-10-03T10:16:27.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.287+0000 7f99b6774700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b006bec0 con 0x7f99b009ef80 2023-10-03T10:16:27.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.287+0000 7f99af7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b009ef80 0x7f99b0138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.287+0000 7f99b4d11700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f99b009f370 0x7f99b013b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.287+0000 7f99affff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f99b009a150 0x7f99b009e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47182/0 (socket says 172.21.15.146:47182) 2023-10-03T10:16:27.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.287+0000 7f99af7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b009ef80 0x7f99b0138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59394/0 (socket says 172.21.15.146:59394) 2023-10-03T10:16:27.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.287+0000 7f99b4d11700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f99b009f370 0x7f99b013b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49598/0 (socket says 172.21.15.146:49598) 2023-10-03T10:16:27.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.287+0000 7f99affff700 1 -- 172.21.15.146:0/2643809911 learned_addr learned my addr 172.21.15.146:0/2643809911 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:27.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.287+0000 7f99af7fe700 1 -- 172.21.15.146:0/2643809911 >> v2:172.21.15.146:3300/0 conn(0x7f99b009f370 msgr2=0x7f99b013b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:27.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.287+0000 7f99af7fe700 1 --2- 172.21.15.146:0/2643809911 >> v2:172.21.15.146:3300/0 conn(0x7f99b009f370 0x7f99b013b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.287+0000 7f99af7fe700 1 -- 172.21.15.146:0/2643809911 >> v1:172.21.15.146:6789/0 conn(0x7f99b009a150 legacy=0x7f99b009e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.287+0000 7f99af7fe700 1 -- 172.21.15.146:0/2643809911 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b006bc20 con 0x7f99b009ef80 2023-10-03T10:16:27.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.287+0000 7f99b4d11700 1 --2- 172.21.15.146:0/2643809911 >> v2:172.21.15.146:3300/0 conn(0x7f99b009f370 0x7f99b013b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.288+0000 7f99af7fe700 1 --2- 172.21.15.146:0/2643809911 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b009ef80 0x7f99b0138e60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009840 tx=0x7f99a4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca8218d59c53ce6d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.288+0000 7f99aeffd700 1 -- 172.21.15.146:0/2643809911 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a4011830 con 0x7f99b009ef80 2023-10-03T10:16:27.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.288+0000 7f99aeffd700 1 -- 172.21.15.146:0/2643809911 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a4011990 con 0x7f99b009ef80 2023-10-03T10:16:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.288+0000 7f99aeffd700 1 -- 172.21.15.146:0/2643809911 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a4011d20 con 0x7f99b009ef80 2023-10-03T10:16:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.288+0000 7f99b6774700 1 -- 172.21.15.146:0/2643809911 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b009ef80 msgr2=0x7f99b0138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.288+0000 7f99b6774700 1 --2- 172.21.15.146:0/2643809911 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b009ef80 0x7f99b0138e60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009840 tx=0x7f99a4009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.289+0000 7f99b6774700 1 -- 172.21.15.146:0/2643809911 shutdown_connections 2023-10-03T10:16:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.289+0000 7f99b6774700 1 --2- 172.21.15.146:0/2643809911 >> v2:172.21.15.146:3300/0 conn(0x7f99b009f370 0x7f99b013b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.289+0000 7f99b6774700 1 --2- 172.21.15.146:0/2643809911 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b009ef80 0x7f99b0138e60 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.289+0000 7f99b6774700 1 -- 172.21.15.146:0/2643809911 >> 172.21.15.146:0/2643809911 conn(0x7f99b00a4430 msgr2=0x7f99b00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.289+0000 7f99b6774700 1 -- 172.21.15.146:0/2643809911 shutdown_connections 2023-10-03T10:16:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.289+0000 7f99b6774700 1 -- 172.21.15.146:0/2643809911 wait complete. 2023-10-03T10:16:27.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.289+0000 7f99b6774700 1 Processor -- start 2023-10-03T10:16:27.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.290+0000 7f99b6774700 1 -- start start 2023-10-03T10:16:27.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.290+0000 7f99b6774700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b009a150 0x7f99b01397c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.290+0000 7f99b6774700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b009ef80 0x7f99b0139d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.290+0000 7f99b6774700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99b009f370 0x7f99b013a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.290+0000 7f99b6774700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b00a0440 con 0x7f99b009ef80 2023-10-03T10:16:27.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.290+0000 7f99b6774700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b01341d0 con 0x7f99b009a150 2023-10-03T10:16:27.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.290+0000 7f99b6774700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99b009ba00 con 0x7f99b009f370 2023-10-03T10:16:27.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.290+0000 7f99affff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b009a150 0x7f99b01397c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.290+0000 7f99affff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b009a150 0x7f99b01397c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59400/0 (socket says 172.21.15.146:59400) 2023-10-03T10:16:27.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.290+0000 7f99affff700 1 -- 172.21.15.146:0/145006479 learned_addr learned my addr 172.21.15.146:0/145006479 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:27.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.290+0000 7f99b4d11700 1 --2- 172.21.15.146:0/145006479 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99b009f370 0x7f99b013a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.291+0000 7f99af7fe700 1 --2- 172.21.15.146:0/145006479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b009ef80 0x7f99b0139d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.291+0000 7f99b4d11700 1 -- 172.21.15.146:0/145006479 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b009a150 msgr2=0x7f99b01397c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.291+0000 7f99b4d11700 1 --2- 172.21.15.146:0/145006479 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b009a150 0x7f99b01397c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.291+0000 7f99b4d11700 1 -- 172.21.15.146:0/145006479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b009ef80 msgr2=0x7f99b0139d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.291+0000 7f99b4d11700 1 --2- 172.21.15.146:0/145006479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b009ef80 0x7f99b0139d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.291+0000 7f99b4d11700 1 -- 172.21.15.146:0/145006479 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a8009a70 con 0x7f99b009f370 2023-10-03T10:16:27.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.291+0000 7f99affff700 1 --2- 172.21.15.146:0/145006479 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b009a150 0x7f99b01397c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.291+0000 7f99af7fe700 1 --2- 172.21.15.146:0/145006479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b009ef80 0x7f99b0139d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:27.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.291+0000 7f99b4d11700 1 --2- 172.21.15.146:0/145006479 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99b009f370 0x7f99b013a240 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f99a8009e50 tx=0x7f99a800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.291+0000 7f99acff9700 1 -- 172.21.15.146:0/145006479 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a800cb40 con 0x7f99b009f370 2023-10-03T10:16:27.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.291+0000 7f99acff9700 1 -- 172.21.15.146:0/145006479 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a800f040 con 0x7f99b009f370 2023-10-03T10:16:27.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.291+0000 7f99acff9700 1 -- 172.21.15.146:0/145006479 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8003a20 con 0x7f99b009f370 2023-10-03T10:16:27.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.291+0000 7f99b6774700 1 -- 172.21.15.146:0/145006479 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a40094a0 con 0x7f99b009f370 2023-10-03T10:16:27.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.291+0000 7f99b6774700 1 -- 172.21.15.146:0/145006479 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b01204d0 con 0x7f99b009f370 2023-10-03T10:16:27.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.292+0000 7f99b6774700 1 -- 172.21.15.146:0/145006479 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b009fa30 con 0x7f99b009f370 2023-10-03T10:16:27.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.293+0000 7f99acff9700 1 -- 172.21.15.146:0/145006479 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f99a8014480 con 0x7f99b009f370 2023-10-03T10:16:27.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.293+0000 7f99acff9700 1 -- 172.21.15.146:0/145006479 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f99a8040640 con 0x7f99b009f370 2023-10-03T10:16:27.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.301+0000 7f99acff9700 1 -- 172.21.15.146:0/145006479 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99a801b930 con 0x7f99b009f370 2023-10-03T10:16:27.316 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.381+0000 7f6fbfe9f700 1 Processor -- start 2023-10-03T10:16:27.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.382+0000 7f6fbfe9f700 1 -- start start 2023-10-03T10:16:27.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.382+0000 7f6fbfe9f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6fb809d860 0x7f6fb809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.382+0000 7f6fbfe9f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6fb809e170 0x7f6fb81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.382+0000 7f6fbfe9f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb809aaa0 con 0x7f6fb8130ce0 2023-10-03T10:16:27.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.382+0000 7f6fbfe9f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb809f870 con 0x7f6fb809e170 2023-10-03T10:16:27.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.382+0000 7f6fbfe9f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb809b360 con 0x7f6fb809d860 2023-10-03T10:16:27.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.382+0000 7f6fbd43a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6fb809e170 0x7f6fb81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.382+0000 7f6fbe43c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6fb8130ce0 0x7f6fb81379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47196/0 (socket says 172.21.15.146:47196) 2023-10-03T10:16:27.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.382+0000 7f6fbd43a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6fb809e170 0x7f6fb81307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49614/0 (socket says 172.21.15.146:49614) 2023-10-03T10:16:27.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.382+0000 7f6fbe43c700 1 -- 172.21.15.146:0/1420252479 learned_addr learned my addr 172.21.15.146:0/1420252479 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:27.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.383+0000 7f6fbd43a700 1 -- 172.21.15.146:0/1420252479 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6fb809d860 msgr2=0x7f6fb809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:27.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.383+0000 7f6fbd43a700 1 --2- 172.21.15.146:0/1420252479 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6fb809d860 0x7f6fb809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.383+0000 7f6fbd43a700 1 -- 172.21.15.146:0/1420252479 >> v1:172.21.15.146:6789/0 conn(0x7f6fb8130ce0 legacy=0x7f6fb81379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.383+0000 7f6fbd43a700 1 -- 172.21.15.146:0/1420252479 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb809b620 con 0x7f6fb809e170 2023-10-03T10:16:27.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.383+0000 7f6fbcc39700 1 -- 172.21.15.146:0/1420252479 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476547058 0 0) 0x7f6fb809aaa0 con 0x7f6fb8130ce0 2023-10-03T10:16:27.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.383+0000 7f6fbd43a700 1 --2- 172.21.15.146:0/1420252479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fb809e170 0x7f6fb81307a0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800bae0 tx=0x7f6fa800bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725534aba696b998 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.383+0000 7f6fbcc39700 1 -- 172.21.15.146:0/1420252479 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa800dd30 con 0x7f6fb809e170 2023-10-03T10:16:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.383+0000 7f6fbcc39700 1 -- 172.21.15.146:0/1420252479 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa800de90 con 0x7f6fb809e170 2023-10-03T10:16:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.383+0000 7f6fbcc39700 1 -- 172.21.15.146:0/1420252479 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8010690 con 0x7f6fb809e170 2023-10-03T10:16:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.384+0000 7f6fbfe9f700 1 -- 172.21.15.146:0/1420252479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fb809e170 msgr2=0x7f6fb81307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.384+0000 7f6fbfe9f700 1 --2- 172.21.15.146:0/1420252479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fb809e170 0x7f6fb81307a0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800bae0 tx=0x7f6fa800bdf0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.384+0000 7f6fbfe9f700 1 -- 172.21.15.146:0/1420252479 shutdown_connections 2023-10-03T10:16:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.384+0000 7f6fbfe9f700 1 --2- 172.21.15.146:0/1420252479 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6fb809d860 0x7f6fb809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.384+0000 7f6fbfe9f700 1 --2- 172.21.15.146:0/1420252479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fb809e170 0x7f6fb81307a0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.384+0000 7f6fbfe9f700 1 -- 172.21.15.146:0/1420252479 >> 172.21.15.146:0/1420252479 conn(0x7f6fb8099c40 msgr2=0x7f6fb80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.384+0000 7f6fbfe9f700 1 -- 172.21.15.146:0/1420252479 shutdown_connections 2023-10-03T10:16:27.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.384+0000 7f6fbfe9f700 1 -- 172.21.15.146:0/1420252479 wait complete. 2023-10-03T10:16:27.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.385+0000 7f6fbfe9f700 1 Processor -- start 2023-10-03T10:16:27.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.385+0000 7f6fbfe9f700 1 -- start start 2023-10-03T10:16:27.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.385+0000 7f6fbfe9f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6fb809d860 0x7f6fb811e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.385+0000 7f6fbfe9f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6fb809e170 0x7f6fb811eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.385+0000 7f6fbfe9f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fb8130ce0 0x7f6fb811f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.385+0000 7f6fbfe9f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb8122070 con 0x7f6fb8130ce0 2023-10-03T10:16:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.385+0000 7f6fbfe9f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb809c8b0 con 0x7f6fb809d860 2023-10-03T10:16:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.385+0000 7f6fbfe9f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb81209c0 con 0x7f6fb809e170 2023-10-03T10:16:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.386+0000 7f6fbdc3b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6fb809d860 0x7f6fb811e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.386+0000 7f6fbdc3b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6fb809d860 0x7f6fb811e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59408/0 (socket says 172.21.15.146:59408) 2023-10-03T10:16:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.386+0000 7f6fbdc3b700 1 -- 172.21.15.146:0/986677963 learned_addr learned my addr 172.21.15.146:0/986677963 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.386+0000 7f6fbd43a700 1 --2- 172.21.15.146:0/986677963 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6fb809e170 0x7f6fb811eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.386+0000 7f6fbe43c700 1 --2- 172.21.15.146:0/986677963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fb8130ce0 0x7f6fb811f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.386+0000 7f6fbdc3b700 1 -- 172.21.15.146:0/986677963 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6fb809e170 msgr2=0x7f6fb811eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.386+0000 7f6fbdc3b700 1 --2- 172.21.15.146:0/986677963 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6fb809e170 0x7f6fb811eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.386+0000 7f6fbdc3b700 1 -- 172.21.15.146:0/986677963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fb8130ce0 msgr2=0x7f6fb811f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.386+0000 7f6fbdc3b700 1 --2- 172.21.15.146:0/986677963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fb8130ce0 0x7f6fb811f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.386+0000 7f6fbdc3b700 1 -- 172.21.15.146:0/986677963 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa800b740 con 0x7f6fb809d860 2023-10-03T10:16:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.386+0000 7f6fbdc3b700 1 --2- 172.21.15.146:0/986677963 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6fb809d860 0x7f6fb811e5a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6fb400b560 tx=0x7f6fb400b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.386+0000 7f6fae7fc700 1 -- 172.21.15.146:0/986677963 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4011830 con 0x7f6fb809d860 2023-10-03T10:16:27.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.386+0000 7f6fae7fc700 1 -- 172.21.15.146:0/986677963 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb4011990 con 0x7f6fb809d860 2023-10-03T10:16:27.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.386+0000 7f6fbfe9f700 1 -- 172.21.15.146:0/986677963 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb8120710 con 0x7f6fb809d860 2023-10-03T10:16:27.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.386+0000 7f6fbfe9f700 1 -- 172.21.15.146:0/986677963 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb8122800 con 0x7f6fb809d860 2023-10-03T10:16:27.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.387+0000 7f6fae7fc700 1 -- 172.21.15.146:0/986677963 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4011d40 con 0x7f6fb809d860 2023-10-03T10:16:27.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.387+0000 7f6fae7fc700 1 -- 172.21.15.146:0/986677963 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6fb401a400 con 0x7f6fb809d860 2023-10-03T10:16:27.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.388+0000 7f6fae7fc700 1 -- 172.21.15.146:0/986677963 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6fb403f5b0 con 0x7f6fb809d860 2023-10-03T10:16:27.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.388+0000 7f6fbfe9f700 1 -- 172.21.15.146:0/986677963 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb804f2a0 con 0x7f6fb809d860 2023-10-03T10:16:27.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.393+0000 7f6fae7fc700 1 -- 172.21.15.146:0/986677963 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6fb4015080 con 0x7f6fb809d860 2023-10-03T10:16:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.417+0000 7f17a47b3700 1 Processor -- start 2023-10-03T10:16:27.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.417+0000 7f17a47b3700 1 -- start start 2023-10-03T10:16:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.418+0000 7f17a47b3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f179c09e950 0x7f179c09ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.418+0000 7f17a47b3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f179c1393c0 0x7f179c13b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.418+0000 7f17a47b3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f179c09ac20 con 0x7f179c09f260 2023-10-03T10:16:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.418+0000 7f17a47b3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179c0a06c0 con 0x7f179c09e950 2023-10-03T10:16:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.418+0000 7f17a47b3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f179c09ae90 con 0x7f179c1393c0 2023-10-03T10:16:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.418+0000 7f17a1d4e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f179c09f260 0x7f179c137ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47202/0 (socket says 172.21.15.146:47202) 2023-10-03T10:16:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.418+0000 7f17a254f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f179c09e950 0x7f179c09ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.418+0000 7f17a1d4e700 1 -- 172.21.15.146:0/110647756 learned_addr learned my addr 172.21.15.146:0/110647756 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:27.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.418+0000 7f17a2d50700 1 --2- 172.21.15.146:0/110647756 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f179c1393c0 0x7f179c13b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.419+0000 7f17a154d700 1 -- 172.21.15.146:0/110647756 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129275446 0 0) 0x7f179c09ac20 con 0x7f179c09f260 2023-10-03T10:16:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.419+0000 7f17a154d700 1 -- 172.21.15.146:0/110647756 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17880035b0 con 0x7f179c09f260 2023-10-03T10:16:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.419+0000 7f17a2d50700 1 -- 172.21.15.146:0/110647756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f179c09e950 msgr2=0x7f179c09ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.419+0000 7f17a2d50700 1 --2- 172.21.15.146:0/110647756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f179c09e950 0x7f179c09ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.419+0000 7f17a2d50700 1 -- 172.21.15.146:0/110647756 >> v1:172.21.15.146:6789/0 conn(0x7f179c09f260 legacy=0x7f179c137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.419+0000 7f17a2d50700 1 -- 172.21.15.146:0/110647756 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c06ba00 con 0x7f179c1393c0 2023-10-03T10:16:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.419+0000 7f17a2d50700 1 --2- 172.21.15.146:0/110647756 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f179c1393c0 0x7f179c13b7a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1794009dc0 tx=0x7f179400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4128130dd756b3d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.419+0000 7f17a154d700 1 -- 172.21.15.146:0/110647756 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179400e070 con 0x7f179c1393c0 2023-10-03T10:16:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.419+0000 7f17a154d700 1 -- 172.21.15.146:0/110647756 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179400bb20 con 0x7f179c1393c0 2023-10-03T10:16:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.419+0000 7f17a154d700 1 -- 172.21.15.146:0/110647756 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1794012430 con 0x7f179c1393c0 2023-10-03T10:16:27.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.420+0000 7f17a47b3700 1 -- 172.21.15.146:0/110647756 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f179c1393c0 msgr2=0x7f179c13b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.420+0000 7f17a47b3700 1 --2- 172.21.15.146:0/110647756 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f179c1393c0 0x7f179c13b7a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1794009dc0 tx=0x7f179400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.420+0000 7f17a47b3700 1 -- 172.21.15.146:0/110647756 shutdown_connections 2023-10-03T10:16:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.420+0000 7f17a47b3700 1 --2- 172.21.15.146:0/110647756 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f179c1393c0 0x7f179c13b7a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.420+0000 7f17a47b3700 1 --2- 172.21.15.146:0/110647756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f179c09e950 0x7f179c09ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.420+0000 7f17a47b3700 1 -- 172.21.15.146:0/110647756 >> 172.21.15.146:0/110647756 conn(0x7f179c0a0f70 msgr2=0x7f179c0a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.420+0000 7f17a47b3700 1 -- 172.21.15.146:0/110647756 shutdown_connections 2023-10-03T10:16:27.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.420+0000 7f17a47b3700 1 -- 172.21.15.146:0/110647756 wait complete. 2023-10-03T10:16:27.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.421+0000 7f17a47b3700 1 Processor -- start 2023-10-03T10:16:27.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.421+0000 7f17a47b3700 1 -- start start 2023-10-03T10:16:27.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.421+0000 7f17a47b3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f179c09e950 0x7f179c121850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.421+0000 7f17a47b3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f179c09f260 0x7f179c121d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.421+0000 7f17a47b3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f179c1393c0 0x7f179c1222d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.421+0000 7f17a47b3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c09e190 con 0x7f179c1393c0 2023-10-03T10:16:27.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.421+0000 7f17a47b3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179c124ab0 con 0x7f179c09f260 2023-10-03T10:16:27.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.421+0000 7f17a47b3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f179c125040 con 0x7f179c09e950 2023-10-03T10:16:27.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.421+0000 7f17a254f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f179c09e950 0x7f179c121850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.421+0000 7f17a254f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f179c09e950 0x7f179c121850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36320/0 (socket says 172.21.15.146:36320) 2023-10-03T10:16:27.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.421+0000 7f17a254f700 1 -- 172.21.15.146:0/3889794639 learned_addr learned my addr 172.21.15.146:0/3889794639 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:27.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.421+0000 7f17a2d50700 1 --2- 172.21.15.146:0/3889794639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f179c1393c0 0x7f179c1222d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.422+0000 7f17a1d4e700 1 --2- 172.21.15.146:0/3889794639 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f179c09f260 0x7f179c121d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.422+0000 7f17a254f700 1 -- 172.21.15.146:0/3889794639 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f179c09f260 msgr2=0x7f179c121d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.422+0000 7f17a254f700 1 --2- 172.21.15.146:0/3889794639 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f179c09f260 0x7f179c121d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.422+0000 7f17a254f700 1 -- 172.21.15.146:0/3889794639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f179c1393c0 msgr2=0x7f179c1222d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.422+0000 7f17a254f700 1 --2- 172.21.15.146:0/3889794639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f179c1393c0 0x7f179c1222d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.422+0000 7f17a254f700 1 -- 172.21.15.146:0/3889794639 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1794009a70 con 0x7f179c09e950 2023-10-03T10:16:27.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.422+0000 7f17a1d4e700 1 --2- 172.21.15.146:0/3889794639 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f179c09f260 0x7f179c121d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:27.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.422+0000 7f17a254f700 1 --2- 172.21.15.146:0/3889794639 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f179c09e950 0x7f179c121850 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f179800e990 tx=0x7f179800eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.422+0000 7f1792ffd700 1 -- 172.21.15.146:0/3889794639 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17980096f0 con 0x7f179c09e950 2023-10-03T10:16:27.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.422+0000 7f1792ffd700 1 -- 172.21.15.146:0/3889794639 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179800c850 con 0x7f179c09e950 2023-10-03T10:16:27.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.422+0000 7f17a47b3700 1 -- 172.21.15.146:0/3889794639 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179c123c00 con 0x7f179c09e950 2023-10-03T10:16:27.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.422+0000 7f1792ffd700 1 -- 172.21.15.146:0/3889794639 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179800eee0 con 0x7f179c09e950 2023-10-03T10:16:27.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.422+0000 7f17a47b3700 1 -- 172.21.15.146:0/3889794639 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179c1ce570 con 0x7f179c09e950 2023-10-03T10:16:27.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.423+0000 7f1792ffd700 1 -- 172.21.15.146:0/3889794639 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f179800cbc0 con 0x7f179c09e950 2023-10-03T10:16:27.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.423+0000 7f1792ffd700 1 -- 172.21.15.146:0/3889794639 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f179803fb30 con 0x7f179c09e950 2023-10-03T10:16:27.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.424+0000 7f17a47b3700 1 -- 172.21.15.146:0/3889794639 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179c124c70 con 0x7f179c09e950 2023-10-03T10:16:27.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.429+0000 7f1792ffd700 1 -- 172.21.15.146:0/3889794639 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1798017080 con 0x7f179c09e950 2023-10-03T10:16:27.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.445+0000 7f55719d4700 1 Processor -- start 2023-10-03T10:16:27.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.445+0000 7f55719d4700 1 -- start start 2023-10-03T10:16:27.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.446+0000 7f55719d4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f556c09d860 0x7f556c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.446+0000 7f55719d4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f556c09e170 0x7f556c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.446+0000 7f55719d4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f556c130ce0 0x7f556c131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.446+0000 7f55719d4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f556c131670 con 0x7f556c09d860 2023-10-03T10:16:27.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.446+0000 7f55719d4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556c09aaa0 con 0x7f556c130ce0 2023-10-03T10:16:27.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.446+0000 7f55719d4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f556c09f870 con 0x7f556c09e170 2023-10-03T10:16:27.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.446+0000 7f556affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f556c09d860 0x7f556c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.446+0000 7f556a7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f556c09e170 0x7f556c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.446+0000 7f556affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f556c09d860 0x7f556c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49648/0 (socket says 172.21.15.146:49648) 2023-10-03T10:16:27.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.446+0000 7f556a7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f556c09e170 0x7f556c1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36334/0 (socket says 172.21.15.146:36334) 2023-10-03T10:16:27.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.446+0000 7f556affd700 1 -- 172.21.15.146:0/1397056662 learned_addr learned my addr 172.21.15.146:0/1397056662 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:27.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.446+0000 7f556b7fe700 1 --2- 172.21.15.146:0/1397056662 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f556c130ce0 0x7f556c131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.446+0000 7f556a7fc700 1 -- 172.21.15.146:0/1397056662 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f556c130ce0 msgr2=0x7f556c131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:27.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.446+0000 7f556a7fc700 1 --2- 172.21.15.146:0/1397056662 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f556c130ce0 0x7f556c131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.446+0000 7f556a7fc700 1 -- 172.21.15.146:0/1397056662 >> v2:172.21.15.146:3300/0 conn(0x7f556c09d860 msgr2=0x7f556c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:27.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.446+0000 7f556a7fc700 1 --2- 172.21.15.146:0/1397056662 >> v2:172.21.15.146:3300/0 conn(0x7f556c09d860 0x7f556c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.446+0000 7f556a7fc700 1 -- 172.21.15.146:0/1397056662 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c09b360 con 0x7f556c09e170 2023-10-03T10:16:27.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.446+0000 7f556affd700 1 --2- 172.21.15.146:0/1397056662 >> v2:172.21.15.146:3300/0 conn(0x7f556c09d860 0x7f556c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.446+0000 7f556a7fc700 1 --2- 172.21.15.146:0/1397056662 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f556c09e170 0x7f556c1307a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5560009870 tx=0x7f5560009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23bf1a061f8f3fb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.447+0000 7f5569ffb700 1 -- 172.21.15.146:0/1397056662 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5560010a90 con 0x7f556c09e170 2023-10-03T10:16:27.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.447+0000 7f5569ffb700 1 -- 172.21.15.146:0/1397056662 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5560010bf0 con 0x7f556c09e170 2023-10-03T10:16:27.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.447+0000 7f5569ffb700 1 -- 172.21.15.146:0/1397056662 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5560018440 con 0x7f556c09e170 2023-10-03T10:16:27.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.447+0000 7f55719d4700 1 -- 172.21.15.146:0/1397056662 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f556c09e170 msgr2=0x7f556c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.447+0000 7f55719d4700 1 --2- 172.21.15.146:0/1397056662 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f556c09e170 0x7f556c1307a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5560009870 tx=0x7f5560009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:27.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.447+0000 7f55719d4700 1 -- 172.21.15.146:0/1397056662 shutdown_connections 2023-10-03T10:16:27.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.447+0000 7f55719d4700 1 --2- 172.21.15.146:0/1397056662 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f556c130ce0 0x7f556c131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.447+0000 7f55719d4700 1 --2- 172.21.15.146:0/1397056662 >> v2:172.21.15.146:3300/0 conn(0x7f556c09d860 0x7f556c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.447+0000 7f55719d4700 1 --2- 172.21.15.146:0/1397056662 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f556c09e170 0x7f556c1307a0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.447+0000 7f55719d4700 1 -- 172.21.15.146:0/1397056662 >> 172.21.15.146:0/1397056662 conn(0x7f556c099c40 msgr2=0x7f556c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.447+0000 7f55719d4700 1 -- 172.21.15.146:0/1397056662 shutdown_connections 2023-10-03T10:16:27.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.447+0000 7f55719d4700 1 -- 172.21.15.146:0/1397056662 wait complete. 2023-10-03T10:16:27.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.449+0000 7f55719d4700 1 Processor -- start 2023-10-03T10:16:27.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.449+0000 7f55719d4700 1 -- start start 2023-10-03T10:16:27.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.450+0000 7f55719d4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f556c09d860 0x7f556c11a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.450+0000 7f55719d4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f556c09e170 0x7f556c11a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.450+0000 7f55719d4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f556c130ce0 0x7f556c11ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.450+0000 7f55719d4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c11d430 con 0x7f556c130ce0 2023-10-03T10:16:27.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.450+0000 7f55719d4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556c09c8b0 con 0x7f556c09e170 2023-10-03T10:16:27.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.450+0000 7f55719d4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f556c11bd50 con 0x7f556c09d860 2023-10-03T10:16:27.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.450+0000 7f556affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f556c09d860 0x7f556c11a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.450+0000 7f556affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f556c09d860 0x7f556c11a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36346/0 (socket says 172.21.15.146:36346) 2023-10-03T10:16:27.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.450+0000 7f556affd700 1 -- 172.21.15.146:0/1988549197 learned_addr learned my addr 172.21.15.146:0/1988549197 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:27.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.450+0000 7f556a7fc700 1 --2- 172.21.15.146:0/1988549197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f556c09e170 0x7f556c11a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.450+0000 7f556b7fe700 1 --2- 172.21.15.146:0/1988549197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f556c130ce0 0x7f556c11ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.450+0000 7f556affd700 1 -- 172.21.15.146:0/1988549197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f556c09e170 msgr2=0x7f556c11a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.450+0000 7f556affd700 1 --2- 172.21.15.146:0/1988549197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f556c09e170 0x7f556c11a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.450+0000 7f556affd700 1 -- 172.21.15.146:0/1988549197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f556c130ce0 msgr2=0x7f556c11ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.450+0000 7f556affd700 1 --2- 172.21.15.146:0/1988549197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f556c130ce0 0x7f556c11ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.450+0000 7f556affd700 1 -- 172.21.15.146:0/1988549197 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555c009550 con 0x7f556c09d860 2023-10-03T10:16:27.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.450+0000 7f556affd700 1 --2- 172.21.15.146:0/1988549197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f556c09d860 0x7f556c11a0e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f555c00e930 tx=0x7f555c00ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.451+0000 7f5553fff700 1 -- 172.21.15.146:0/1988549197 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c00ee80 con 0x7f556c09d860 2023-10-03T10:16:27.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.451+0000 7f55719d4700 1 -- 172.21.15.146:0/1988549197 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55600094a0 con 0x7f556c09d860 2023-10-03T10:16:27.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.451+0000 7f5553fff700 1 -- 172.21.15.146:0/1988549197 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555c004030 con 0x7f556c09d860 2023-10-03T10:16:27.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.451+0000 7f5553fff700 1 -- 172.21.15.146:0/1988549197 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c0043a0 con 0x7f556c09d860 2023-10-03T10:16:27.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.451+0000 7f55719d4700 1 -- 172.21.15.146:0/1988549197 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f556c0a2350 con 0x7f556c09d860 2023-10-03T10:16:27.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.451+0000 7f5553fff700 1 -- 172.21.15.146:0/1988549197 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f555c00c850 con 0x7f556c09d860 2023-10-03T10:16:27.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.452+0000 7f5553fff700 1 -- 172.21.15.146:0/1988549197 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f555c03f6a0 con 0x7f556c09d860 2023-10-03T10:16:27.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.452+0000 7f55719d4700 1 -- 172.21.15.146:0/1988549197 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554c0052e0 con 0x7f556c09d860 2023-10-03T10:16:27.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.456+0000 7f5553fff700 1 -- 172.21.15.146:0/1988549197 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f555c004500 con 0x7f556c09d860 2023-10-03T10:16:27.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.565+0000 7f99b6774700 1 -- 172.21.15.146:0/145006479 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f99b011fda0 con 0x7f99b009f370 2023-10-03T10:16:27.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.565+0000 7f99acff9700 1 -- 172.21.15.146:0/145006479 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f99a801b360 con 0x7f99b009f370 2023-10-03T10:16:27.566 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.568+0000 7f99b6774700 1 -- 172.21.15.146:0/145006479 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99b009f370 msgr2=0x7f99b013a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.568+0000 7f99b6774700 1 --2- 172.21.15.146:0/145006479 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99b009f370 0x7f99b013a240 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f99a8009e50 tx=0x7f99a800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.568+0000 7f99b6774700 1 -- 172.21.15.146:0/145006479 shutdown_connections 2023-10-03T10:16:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.568+0000 7f99b6774700 1 --2- 172.21.15.146:0/145006479 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99b009f370 0x7f99b013a240 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.568+0000 7f99b6774700 1 --2- 172.21.15.146:0/145006479 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b009a150 0x7f99b01397c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.568+0000 7f99b6774700 1 --2- 172.21.15.146:0/145006479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b009ef80 0x7f99b0139d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.568+0000 7f99b6774700 1 -- 172.21.15.146:0/145006479 >> 172.21.15.146:0/145006479 conn(0x7f99b00a4430 msgr2=0x7f99b009c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.569+0000 7f99b6774700 1 -- 172.21.15.146:0/145006479 shutdown_connections 2023-10-03T10:16:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.569+0000 7f99b6774700 1 -- 172.21.15.146:0/145006479 wait complete. 2023-10-03T10:16:27.586 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:27.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.628+0000 7f17a47b3700 1 -- 172.21.15.146:0/3889794639 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f179c04f2a0 con 0x7f179c09e950 2023-10-03T10:16:27.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.628+0000 7f1792ffd700 1 -- 172.21.15.146:0/3889794639 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f179801b3b0 con 0x7f179c09e950 2023-10-03T10:16:27.629 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:27.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.631+0000 7f17a47b3700 1 -- 172.21.15.146:0/3889794639 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f179c09e950 msgr2=0x7f179c121850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.631+0000 7f17a47b3700 1 --2- 172.21.15.146:0/3889794639 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f179c09e950 0x7f179c121850 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f179800e990 tx=0x7f179800eca0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.631+0000 7f17a47b3700 1 -- 172.21.15.146:0/3889794639 shutdown_connections 2023-10-03T10:16:27.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.631+0000 7f17a47b3700 1 --2- 172.21.15.146:0/3889794639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f179c1393c0 0x7f179c1222d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.631+0000 7f17a47b3700 1 --2- 172.21.15.146:0/3889794639 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f179c09e950 0x7f179c121850 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.631+0000 7f17a47b3700 1 --2- 172.21.15.146:0/3889794639 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f179c09f260 0x7f179c121d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.631+0000 7f17a47b3700 1 -- 172.21.15.146:0/3889794639 >> 172.21.15.146:0/3889794639 conn(0x7f179c0a0f70 msgr2=0x7f179c0a3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.631+0000 7f17a47b3700 1 -- 172.21.15.146:0/3889794639 shutdown_connections 2023-10-03T10:16:27.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.631+0000 7f17a47b3700 1 -- 172.21.15.146:0/3889794639 wait complete. 2023-10-03T10:16:27.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:27.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.652+0000 7f55719d4700 1 -- 172.21.15.146:0/1988549197 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f554c005150 con 0x7f556c09d860 2023-10-03T10:16:27.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.652+0000 7f5553fff700 1 -- 172.21.15.146:0/1988549197 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f555c0222f0 con 0x7f556c09d860 2023-10-03T10:16:27.653 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:27.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.655+0000 7f55719d4700 1 -- 172.21.15.146:0/1988549197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f556c09d860 msgr2=0x7f556c11a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.655+0000 7f55719d4700 1 --2- 172.21.15.146:0/1988549197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f556c09d860 0x7f556c11a0e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f555c00e930 tx=0x7f555c00ec40 comp rx=0 tx=0).stop 2023-10-03T10:16:27.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.655+0000 7f55719d4700 1 -- 172.21.15.146:0/1988549197 shutdown_connections 2023-10-03T10:16:27.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.655+0000 7f55719d4700 1 --2- 172.21.15.146:0/1988549197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f556c130ce0 0x7f556c11ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.655+0000 7f55719d4700 1 --2- 172.21.15.146:0/1988549197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f556c09d860 0x7f556c11a0e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.655+0000 7f55719d4700 1 --2- 172.21.15.146:0/1988549197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f556c09e170 0x7f556c11a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.655+0000 7f55719d4700 1 -- 172.21.15.146:0/1988549197 >> 172.21.15.146:0/1988549197 conn(0x7f556c099c40 msgr2=0x7f556c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.655+0000 7f55719d4700 1 -- 172.21.15.146:0/1988549197 shutdown_connections 2023-10-03T10:16:27.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.655+0000 7f55719d4700 1 -- 172.21.15.146:0/1988549197 wait complete. 2023-10-03T10:16:27.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.660+0000 7f6fbfe9f700 1 -- 172.21.15.146:0/986677963 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6fb806c3b0 con 0x7f6fb809d860 2023-10-03T10:16:27.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.661+0000 7f6fae7fc700 1 -- 172.21.15.146:0/986677963 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6fb400f8d0 con 0x7f6fb809d860 2023-10-03T10:16:27.661 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:27.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.663+0000 7f6fbfe9f700 1 -- 172.21.15.146:0/986677963 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6fb809d860 msgr2=0x7f6fb811e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.663+0000 7f6fbfe9f700 1 --2- 172.21.15.146:0/986677963 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6fb809d860 0x7f6fb811e5a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6fb400b560 tx=0x7f6fb400b870 comp rx=0 tx=0).stop 2023-10-03T10:16:27.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.663+0000 7f6fbfe9f700 1 -- 172.21.15.146:0/986677963 shutdown_connections 2023-10-03T10:16:27.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.663+0000 7f6fbfe9f700 1 --2- 172.21.15.146:0/986677963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fb8130ce0 0x7f6fb811f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.663+0000 7f6fbfe9f700 1 --2- 172.21.15.146:0/986677963 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6fb809d860 0x7f6fb811e5a0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.663+0000 7f6fbfe9f700 1 --2- 172.21.15.146:0/986677963 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6fb809e170 0x7f6fb811eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.663+0000 7f6fbfe9f700 1 -- 172.21.15.146:0/986677963 >> 172.21.15.146:0/986677963 conn(0x7f6fb8099c40 msgr2=0x7f6fb80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.663+0000 7f6fbfe9f700 1 -- 172.21.15.146:0/986677963 shutdown_connections 2023-10-03T10:16:27.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:27.663+0000 7f6fbfe9f700 1 -- 172.21.15.146:0/986677963 wait complete. 2023-10-03T10:16:27.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:27.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:28.587 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:28.644 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:28.669 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:28.677 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.733+0000 7f3ce290e700 1 Processor -- start 2023-10-03T10:16:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.733+0000 7f3ce290e700 1 -- start start 2023-10-03T10:16:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.734+0000 7f3ce290e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cdc131980 0x7f3cdc131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.734+0000 7f3ce290e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cdc09bc70 0x7f3cdc09c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.734+0000 7f3ce290e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3cdc09c5c0 0x7f3cdc138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.734+0000 7f3ce290e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cdc06eb30 con 0x7f3cdc09c5c0 2023-10-03T10:16:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.734+0000 7f3ce290e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0a1640 con 0x7f3cdc09bc70 2023-10-03T10:16:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.734+0000 7f3ce290e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0a22d0 con 0x7f3cdc131980 2023-10-03T10:16:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.734+0000 7f3cdbfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cdc131980 0x7f3cdc131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.734+0000 7f3cdbfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cdc131980 0x7f3cdc131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36360/0 (socket says 172.21.15.146:36360) 2023-10-03T10:16:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.734+0000 7f3cdbfff700 1 -- 172.21.15.146:0/289145867 learned_addr learned my addr 172.21.15.146:0/289145867 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.734+0000 7f3cdb7fe700 1 --2- 172.21.15.146:0/289145867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cdc09bc70 0x7f3cdc09c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.734+0000 7f3ce0eab700 1 --2- 172.21.15.146:0/289145867 >> v2:172.21.15.146:3300/0 conn(0x7f3cdc09c5c0 0x7f3cdc138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.734+0000 7f3cdb7fe700 1 -- 172.21.15.146:0/289145867 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cdc131980 msgr2=0x7f3cdc131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.734+0000 7f3cdb7fe700 1 --2- 172.21.15.146:0/289145867 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cdc131980 0x7f3cdc131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.734+0000 7f3cdb7fe700 1 -- 172.21.15.146:0/289145867 >> v2:172.21.15.146:3300/0 conn(0x7f3cdc09c5c0 msgr2=0x7f3cdc138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.734+0000 7f3cdb7fe700 1 --2- 172.21.15.146:0/289145867 >> v2:172.21.15.146:3300/0 conn(0x7f3cdc09c5c0 0x7f3cdc138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.734+0000 7f3cdb7fe700 1 -- 172.21.15.146:0/289145867 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc131550 con 0x7f3cdc09bc70 2023-10-03T10:16:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.735+0000 7f3cdb7fe700 1 --2- 172.21.15.146:0/289145867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cdc09bc70 0x7f3cdc09c080 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009840 tx=0x7f3cd0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17c0d5a98b13d983 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.735+0000 7f3cdaffd700 1 -- 172.21.15.146:0/289145867 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0011830 con 0x7f3cdc09bc70 2023-10-03T10:16:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.735+0000 7f3cdaffd700 1 -- 172.21.15.146:0/289145867 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd0011990 con 0x7f3cdc09bc70 2023-10-03T10:16:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.735+0000 7f3cdaffd700 1 -- 172.21.15.146:0/289145867 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0011d20 con 0x7f3cdc09bc70 2023-10-03T10:16:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.736+0000 7f3ce290e700 1 -- 172.21.15.146:0/289145867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cdc09bc70 msgr2=0x7f3cdc09c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.736+0000 7f3ce290e700 1 --2- 172.21.15.146:0/289145867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cdc09bc70 0x7f3cdc09c080 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009840 tx=0x7f3cd0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.736+0000 7f3ce290e700 1 -- 172.21.15.146:0/289145867 shutdown_connections 2023-10-03T10:16:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.736+0000 7f3ce290e700 1 --2- 172.21.15.146:0/289145867 >> v2:172.21.15.146:3300/0 conn(0x7f3cdc09c5c0 0x7f3cdc138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.736+0000 7f3ce290e700 1 --2- 172.21.15.146:0/289145867 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cdc131980 0x7f3cdc131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.736+0000 7f3ce290e700 1 --2- 172.21.15.146:0/289145867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cdc09bc70 0x7f3cdc09c080 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.736+0000 7f3ce290e700 1 -- 172.21.15.146:0/289145867 >> 172.21.15.146:0/289145867 conn(0x7f3cdc0a2980 msgr2=0x7f3cdc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.736+0000 7f3ce290e700 1 -- 172.21.15.146:0/289145867 shutdown_connections 2023-10-03T10:16:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.736+0000 7f3ce290e700 1 -- 172.21.15.146:0/289145867 wait complete. 2023-10-03T10:16:28.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.737+0000 7f3ce290e700 1 Processor -- start 2023-10-03T10:16:28.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.738+0000 7f3ce290e700 1 -- start start 2023-10-03T10:16:28.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.738+0000 7f3ce290e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cdc09bc70 0x7f3cdc118e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.738+0000 7f3ce290e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cdc09c5c0 0x7f3cdc119360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.738+0000 7f3ce290e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cdc131980 0x7f3cdc1198a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.738+0000 7f3ce290e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc11a2d0 con 0x7f3cdc131980 2023-10-03T10:16:28.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.738+0000 7f3ce290e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc127760 con 0x7f3cdc09bc70 2023-10-03T10:16:28.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.738+0000 7f3ce290e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc11b6a0 con 0x7f3cdc09c5c0 2023-10-03T10:16:28.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.738+0000 7f3cdb7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cdc09c5c0 0x7f3cdc119360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.739+0000 7f3cdb7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cdc09c5c0 0x7f3cdc119360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36362/0 (socket says 172.21.15.146:36362) 2023-10-03T10:16:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.739+0000 7f3cdb7fe700 1 -- 172.21.15.146:0/516022936 learned_addr learned my addr 172.21.15.146:0/516022936 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.739+0000 7f3ce0eab700 1 --2- 172.21.15.146:0/516022936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cdc131980 0x7f3cdc1198a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.739+0000 7f3cdbfff700 1 --2- 172.21.15.146:0/516022936 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cdc09bc70 0x7f3cdc118e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.739+0000 7f3cdb7fe700 1 -- 172.21.15.146:0/516022936 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cdc09bc70 msgr2=0x7f3cdc118e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.739+0000 7f3cdb7fe700 1 --2- 172.21.15.146:0/516022936 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cdc09bc70 0x7f3cdc118e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.739+0000 7f3cdb7fe700 1 -- 172.21.15.146:0/516022936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cdc131980 msgr2=0x7f3cdc1198a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.739+0000 7f3cdb7fe700 1 --2- 172.21.15.146:0/516022936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cdc131980 0x7f3cdc1198a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.739+0000 7f3cdb7fe700 1 -- 172.21.15.146:0/516022936 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd00094a0 con 0x7f3cdc09c5c0 2023-10-03T10:16:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.739+0000 7f3cdb7fe700 1 --2- 172.21.15.146:0/516022936 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cdc09c5c0 0x7f3cdc119360 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0000c00 tx=0x7f3cd0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.739+0000 7f3cd8ff9700 1 -- 172.21.15.146:0/516022936 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0004450 con 0x7f3cdc09c5c0 2023-10-03T10:16:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.739+0000 7f3cd8ff9700 1 -- 172.21.15.146:0/516022936 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd001f070 con 0x7f3cdc09c5c0 2023-10-03T10:16:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.739+0000 7f3ce290e700 1 -- 172.21.15.146:0/516022936 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cdc11c3a0 con 0x7f3cdc09c5c0 2023-10-03T10:16:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.739+0000 7f3cd8ff9700 1 -- 172.21.15.146:0/516022936 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd00038e0 con 0x7f3cdc09c5c0 2023-10-03T10:16:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.739+0000 7f3ce290e700 1 -- 172.21.15.146:0/516022936 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cdc11b420 con 0x7f3cdc09c5c0 2023-10-03T10:16:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.741+0000 7f3ce290e700 1 -- 172.21.15.146:0/516022936 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cdc130940 con 0x7f3cdc09c5c0 2023-10-03T10:16:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.741+0000 7f3cd8ff9700 1 -- 172.21.15.146:0/516022936 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3cd0003a40 con 0x7f3cdc09c5c0 2023-10-03T10:16:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.742+0000 7f3cd8ff9700 1 -- 172.21.15.146:0/516022936 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3cd0021070 con 0x7f3cdc09c5c0 2023-10-03T10:16:28.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.746+0000 7f3cd8ff9700 1 -- 172.21.15.146:0/516022936 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3cd001a430 con 0x7f3cdc09c5c0 2023-10-03T10:16:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.780+0000 7f5108c28700 1 Processor -- start 2023-10-03T10:16:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.780+0000 7f5108c28700 1 -- start start 2023-10-03T10:16:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.780+0000 7f5108c28700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f510409e870 0x7f510409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.780+0000 7f5108c28700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5104131f40 0x7f5104139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.781+0000 7f5108c28700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f510409c970 con 0x7f510409f180 2023-10-03T10:16:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.781+0000 7f5108c28700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51040a0920 con 0x7f510409e870 2023-10-03T10:16:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.781+0000 7f5108c28700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f510409f9c0 con 0x7f5104131f40 2023-10-03T10:16:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.781+0000 7f5102d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5104131f40 0x7f5104139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.781+0000 7f510259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f510409e870 0x7f510409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.781+0000 7f5102d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5104131f40 0x7f5104139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36374/0 (socket says 172.21.15.146:36374) 2023-10-03T10:16:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.781+0000 7f510259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f510409e870 0x7f510409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59466/0 (socket says 172.21.15.146:59466) 2023-10-03T10:16:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.781+0000 7f5102d9d700 1 -- 172.21.15.146:0/662707748 learned_addr learned my addr 172.21.15.146:0/662707748 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.781+0000 7f5102d9d700 1 -- 172.21.15.146:0/662707748 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f510409e870 msgr2=0x7f510409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.781+0000 7f5102d9d700 1 --2- 172.21.15.146:0/662707748 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f510409e870 0x7f510409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.781+0000 7f5102d9d700 1 -- 172.21.15.146:0/662707748 >> v1:172.21.15.146:6789/0 conn(0x7f510409f180 legacy=0x7f5104131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.781+0000 7f510159a700 1 -- 172.21.15.146:0/662707748 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 423500192 0 0) 0x7f510409c970 con 0x7f510409f180 2023-10-03T10:16:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.781+0000 7f5102d9d700 1 -- 172.21.15.146:0/662707748 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510409bab0 con 0x7f5104131f40 2023-10-03T10:16:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.781+0000 7f5102d9d700 1 --2- 172.21.15.146:0/662707748 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5104131f40 0x7f5104139ca0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009e80 tx=0x7f50fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76fa36d06e624c0e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.781+0000 7f510159a700 1 -- 172.21.15.146:0/662707748 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc00e070 con 0x7f5104131f40 2023-10-03T10:16:28.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.782+0000 7f510159a700 1 -- 172.21.15.146:0/662707748 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc00b910 con 0x7f5104131f40 2023-10-03T10:16:28.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.782+0000 7f510159a700 1 -- 172.21.15.146:0/662707748 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc00bcc0 con 0x7f5104131f40 2023-10-03T10:16:28.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.782+0000 7f5108c28700 1 -- 172.21.15.146:0/662707748 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5104131f40 msgr2=0x7f5104139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.782+0000 7f5108c28700 1 --2- 172.21.15.146:0/662707748 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5104131f40 0x7f5104139ca0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009e80 tx=0x7f50fc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:28.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.782+0000 7f5108c28700 1 -- 172.21.15.146:0/662707748 shutdown_connections 2023-10-03T10:16:28.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.782+0000 7f5108c28700 1 --2- 172.21.15.146:0/662707748 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5104131f40 0x7f5104139ca0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.782+0000 7f5108c28700 1 --2- 172.21.15.146:0/662707748 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f510409e870 0x7f510409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.782+0000 7f5108c28700 1 -- 172.21.15.146:0/662707748 >> 172.21.15.146:0/662707748 conn(0x7f51040a4430 msgr2=0x7f51040a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.782+0000 7f5108c28700 1 -- 172.21.15.146:0/662707748 shutdown_connections 2023-10-03T10:16:28.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.782+0000 7f5108c28700 1 -- 172.21.15.146:0/662707748 wait complete. 2023-10-03T10:16:28.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.783+0000 7f5108c28700 1 Processor -- start 2023-10-03T10:16:28.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.784+0000 7f5108c28700 1 -- start start 2023-10-03T10:16:28.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.784+0000 7f5108c28700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f510409e870 0x7f510406c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.784+0000 7f5108c28700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f510409f180 0x7f510406c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.784+0000 7f5108c28700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5104131f40 0x7f51041c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.784+0000 7f5108c28700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51040a2c70 con 0x7f510409e870 2023-10-03T10:16:28.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.784+0000 7f5108c28700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5104131420 con 0x7f510409f180 2023-10-03T10:16:28.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.784+0000 7f5108c28700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f510406bd70 con 0x7f5104131f40 2023-10-03T10:16:28.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.784+0000 7f5102d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5104131f40 0x7f51041c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.784+0000 7f5102d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5104131f40 0x7f51041c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36376/0 (socket says 172.21.15.146:36376) 2023-10-03T10:16:28.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.784+0000 7f5102d9d700 1 -- 172.21.15.146:0/3539561986 learned_addr learned my addr 172.21.15.146:0/3539561986 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:28.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.784+0000 7f510259c700 1 --2- 172.21.15.146:0/3539561986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f510409e870 0x7f510406c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.784+0000 7f5101d9b700 1 --2- 172.21.15.146:0/3539561986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f510409f180 0x7f510406c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.784+0000 7f5102d9d700 1 -- 172.21.15.146:0/3539561986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f510409f180 msgr2=0x7f510406c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.784+0000 7f5102d9d700 1 --2- 172.21.15.146:0/3539561986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f510409f180 0x7f510406c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.784+0000 7f5102d9d700 1 -- 172.21.15.146:0/3539561986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f510409e870 msgr2=0x7f510406c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.784+0000 7f5102d9d700 1 --2- 172.21.15.146:0/3539561986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f510409e870 0x7f510406c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.785+0000 7f5102d9d700 1 -- 172.21.15.146:0/3539561986 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc009b30 con 0x7f5104131f40 2023-10-03T10:16:28.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.785+0000 7f5101d9b700 1 --2- 172.21.15.146:0/3539561986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f510409f180 0x7f510406c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:28.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.785+0000 7f5102d9d700 1 --2- 172.21.15.146:0/3539561986 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5104131f40 0x7f51041c8230 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f50fc003f50 tx=0x7f50fc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.785+0000 7f50f2ffd700 1 -- 172.21.15.146:0/3539561986 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc004450 con 0x7f5104131f40 2023-10-03T10:16:28.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.785+0000 7f50f2ffd700 1 -- 172.21.15.146:0/3539561986 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc0045b0 con 0x7f5104131f40 2023-10-03T10:16:28.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.785+0000 7f50f2ffd700 1 -- 172.21.15.146:0/3539561986 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc004940 con 0x7f5104131f40 2023-10-03T10:16:28.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.785+0000 7f5108c28700 1 -- 172.21.15.146:0/3539561986 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51041222f0 con 0x7f5104131f40 2023-10-03T10:16:28.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.785+0000 7f5108c28700 1 -- 172.21.15.146:0/3539561986 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5104120eb0 con 0x7f5104131f40 2023-10-03T10:16:28.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.786+0000 7f50f2ffd700 1 -- 172.21.15.146:0/3539561986 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50fc01c410 con 0x7f5104131f40 2023-10-03T10:16:28.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.786+0000 7f50f2ffd700 1 -- 172.21.15.146:0/3539561986 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f50fc041360 con 0x7f5104131f40 2023-10-03T10:16:28.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.786+0000 7f5108c28700 1 -- 172.21.15.146:0/3539561986 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5104121f40 con 0x7f5104131f40 2023-10-03T10:16:28.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.791+0000 7f50f2ffd700 1 -- 172.21.15.146:0/3539561986 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50fc01c6c0 con 0x7f5104131f40 2023-10-03T10:16:28.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.829+0000 7f073292a700 1 Processor -- start 2023-10-03T10:16:28.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.829+0000 7f073292a700 1 -- start start 2023-10-03T10:16:28.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.830+0000 7f073292a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f072c06b250 0x7f072c136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.830+0000 7f073292a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f072c137140 0x7f072c139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.830+0000 7f073292a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f072c09da80 con 0x7f072c06a770 2023-10-03T10:16:28.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.830+0000 7f073292a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072c09f770 con 0x7f072c06b250 2023-10-03T10:16:28.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.830+0000 7f073292a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072c09dce0 con 0x7f072c137140 2023-10-03T10:16:28.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.830+0000 7f072b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f072c06b250 0x7f072c136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.830+0000 7f0730ec7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f072c137140 0x7f072c139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.830+0000 7f072b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f072c06b250 0x7f072c136c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49702/0 (socket says 172.21.15.146:49702) 2023-10-03T10:16:28.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.830+0000 7f0730ec7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f072c137140 0x7f072c139520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59486/0 (socket says 172.21.15.146:59486) 2023-10-03T10:16:28.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.830+0000 7f072b7fe700 1 -- 172.21.15.146:0/1312773678 learned_addr learned my addr 172.21.15.146:0/1312773678 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:28.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.830+0000 7f072b7fe700 1 -- 172.21.15.146:0/1312773678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f072c137140 msgr2=0x7f072c139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:28.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.830+0000 7f072b7fe700 1 --2- 172.21.15.146:0/1312773678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f072c137140 0x7f072c139520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.830+0000 7f072b7fe700 1 -- 172.21.15.146:0/1312773678 >> v1:172.21.15.146:6789/0 conn(0x7f072c06a770 legacy=0x7f072c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.830+0000 7f072b7fe700 1 -- 172.21.15.146:0/1312773678 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072c09eb20 con 0x7f072c06b250 2023-10-03T10:16:28.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.830+0000 7f072affd700 1 -- 172.21.15.146:0/1312773678 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333980474 0 0) 0x7f072c09da80 con 0x7f072c06a770 2023-10-03T10:16:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.830+0000 7f072b7fe700 1 --2- 172.21.15.146:0/1312773678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f072c06b250 0x7f072c136c00 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f07200098f0 tx=0x7f0720009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8fc39628a70887 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.831+0000 7f072affd700 1 -- 172.21.15.146:0/1312773678 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072000b8a0 con 0x7f072c06b250 2023-10-03T10:16:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.831+0000 7f072affd700 1 -- 172.21.15.146:0/1312773678 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072000ba00 con 0x7f072c06b250 2023-10-03T10:16:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.831+0000 7f072affd700 1 -- 172.21.15.146:0/1312773678 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072000bd90 con 0x7f072c06b250 2023-10-03T10:16:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.831+0000 7f073292a700 1 -- 172.21.15.146:0/1312773678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f072c06b250 msgr2=0x7f072c136c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.831+0000 7f073292a700 1 --2- 172.21.15.146:0/1312773678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f072c06b250 0x7f072c136c00 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f07200098f0 tx=0x7f0720009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.832+0000 7f073292a700 1 -- 172.21.15.146:0/1312773678 shutdown_connections 2023-10-03T10:16:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.832+0000 7f073292a700 1 --2- 172.21.15.146:0/1312773678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f072c137140 0x7f072c139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.832+0000 7f073292a700 1 --2- 172.21.15.146:0/1312773678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f072c06b250 0x7f072c136c00 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.832+0000 7f073292a700 1 -- 172.21.15.146:0/1312773678 >> 172.21.15.146:0/1312773678 conn(0x7f072c099c40 msgr2=0x7f072c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.832+0000 7f073292a700 1 -- 172.21.15.146:0/1312773678 shutdown_connections 2023-10-03T10:16:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.832+0000 7f073292a700 1 -- 172.21.15.146:0/1312773678 wait complete. 2023-10-03T10:16:28.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.833+0000 7f073292a700 1 Processor -- start 2023-10-03T10:16:28.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.833+0000 7f073292a700 1 -- start start 2023-10-03T10:16:28.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.834+0000 7f073292a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f072c06a770 0x7f072c09a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.834+0000 7f073292a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f072c06b250 0x7f072c09a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.834+0000 7f073292a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f072c137140 0x7f072c09af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.834+0000 7f073292a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c09c0a0 con 0x7f072c06a770 2023-10-03T10:16:28.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.834+0000 7f073292a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072c136690 con 0x7f072c137140 2023-10-03T10:16:28.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.834+0000 7f073292a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f072c071e10 con 0x7f072c06b250 2023-10-03T10:16:28.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.834+0000 7f072bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f072c06a770 0x7f072c09a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.834+0000 7f072bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f072c06a770 0x7f072c09a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49704/0 (socket says 172.21.15.146:49704) 2023-10-03T10:16:28.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.834+0000 7f072bfff700 1 -- 172.21.15.146:0/1337217158 learned_addr learned my addr 172.21.15.146:0/1337217158 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:28.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.834+0000 7f0730ec7700 1 --2- 172.21.15.146:0/1337217158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f072c137140 0x7f072c09af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.834+0000 7f072bfff700 1 -- 172.21.15.146:0/1337217158 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f072c06b250 msgr2=0x7f072c09a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.834+0000 7f072bfff700 1 --2- 172.21.15.146:0/1337217158 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f072c06b250 0x7f072c09a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.834+0000 7f072bfff700 1 -- 172.21.15.146:0/1337217158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f072c137140 msgr2=0x7f072c09af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.834+0000 7f072bfff700 1 --2- 172.21.15.146:0/1337217158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f072c137140 0x7f072c09af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.834+0000 7f072bfff700 1 -- 172.21.15.146:0/1337217158 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0720009550 con 0x7f072c06a770 2023-10-03T10:16:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.834+0000 7f0730ec7700 1 --2- 172.21.15.146:0/1337217158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f072c137140 0x7f072c09af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.835+0000 7f072bfff700 1 --2- 172.21.15.146:0/1337217158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f072c06a770 0x7f072c09a490 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f071c001eb0 tx=0x7f071c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.835+0000 7f0728ff9700 1 -- 172.21.15.146:0/1337217158 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c0054e0 con 0x7f072c06a770 2023-10-03T10:16:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.835+0000 7f0728ff9700 1 -- 172.21.15.146:0/1337217158 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071c003680 con 0x7f072c06a770 2023-10-03T10:16:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.835+0000 7f073292a700 1 -- 172.21.15.146:0/1337217158 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f072c125c90 con 0x7f072c06a770 2023-10-03T10:16:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.835+0000 7f073292a700 1 -- 172.21.15.146:0/1337217158 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072c1269c0 con 0x7f072c06a770 2023-10-03T10:16:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.835+0000 7f0728ff9700 1 -- 172.21.15.146:0/1337217158 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c0039f0 con 0x7f072c06a770 2023-10-03T10:16:28.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.836+0000 7f0728ff9700 1 -- 172.21.15.146:0/1337217158 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f071c003b50 con 0x7f072c06a770 2023-10-03T10:16:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.836+0000 7f0728ff9700 1 -- 172.21.15.146:0/1337217158 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f071c03ec50 con 0x7f072c06a770 2023-10-03T10:16:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.836+0000 7f073292a700 1 -- 172.21.15.146:0/1337217158 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f070c0052e0 con 0x7f072c06a770 2023-10-03T10:16:28.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.840+0000 7fee98ec3700 1 Processor -- start 2023-10-03T10:16:28.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.840+0000 7fee98ec3700 1 -- start start 2023-10-03T10:16:28.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.841+0000 7fee98ec3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee9409d860 0x7fee9409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.841+0000 7fee98ec3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee9409e170 0x7fee941307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.841+0000 7fee98ec3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9409aaa0 con 0x7fee94130ce0 2023-10-03T10:16:28.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.841+0000 7fee98ec3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9409f870 con 0x7fee9409d860 2023-10-03T10:16:28.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.841+0000 7fee98ec3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee9409b360 con 0x7fee9409e170 2023-10-03T10:16:28.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.841+0000 7fee92d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fee94130ce0 0x7fee941379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47222/0 (socket says 172.21.15.146:47222) 2023-10-03T10:16:28.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.841+0000 7fee92d9d700 1 -- 172.21.15.146:0/1289587545 learned_addr learned my addr 172.21.15.146:0/1289587545 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:28.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.841+0000 7fee91d9b700 1 --2- 172.21.15.146:0/1289587545 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee9409e170 0x7fee941307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.841+0000 7fee9259c700 1 --2- 172.21.15.146:0/1289587545 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee9409d860 0x7fee9409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.841+0000 7fee91d9b700 1 -- 172.21.15.146:0/1289587545 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee9409d860 msgr2=0x7fee9409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:28.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.841+0000 7fee91d9b700 1 --2- 172.21.15.146:0/1289587545 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee9409d860 0x7fee9409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.841+0000 7fee91d9b700 1 -- 172.21.15.146:0/1289587545 >> v1:172.21.15.146:6789/0 conn(0x7fee94130ce0 legacy=0x7fee941379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.841+0000 7fee91d9b700 1 -- 172.21.15.146:0/1289587545 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9409b620 con 0x7fee9409e170 2023-10-03T10:16:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.842+0000 7fee91d9b700 1 --2- 172.21.15.146:0/1289587545 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee9409e170 0x7fee941307a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fee88009870 tx=0x7fee88009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b63057136691577 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.842+0000 7fee9159a700 1 -- 172.21.15.146:0/1289587545 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee88011830 con 0x7fee9409e170 2023-10-03T10:16:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.842+0000 7fee9159a700 1 -- 172.21.15.146:0/1289587545 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee88011990 con 0x7fee9409e170 2023-10-03T10:16:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.842+0000 7fee9159a700 1 -- 172.21.15.146:0/1289587545 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee88011d20 con 0x7fee9409e170 2023-10-03T10:16:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.842+0000 7fee98ec3700 1 -- 172.21.15.146:0/1289587545 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee9409e170 msgr2=0x7fee941307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.842+0000 7fee98ec3700 1 --2- 172.21.15.146:0/1289587545 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee9409e170 0x7fee941307a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fee88009870 tx=0x7fee88009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.842+0000 7fee98ec3700 1 -- 172.21.15.146:0/1289587545 shutdown_connections 2023-10-03T10:16:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.842+0000 7fee98ec3700 1 --2- 172.21.15.146:0/1289587545 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee9409d860 0x7fee9409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.842+0000 7fee98ec3700 1 --2- 172.21.15.146:0/1289587545 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee9409e170 0x7fee941307a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.843+0000 7fee98ec3700 1 -- 172.21.15.146:0/1289587545 >> 172.21.15.146:0/1289587545 conn(0x7fee94099c40 msgr2=0x7fee940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.843+0000 7fee98ec3700 1 -- 172.21.15.146:0/1289587545 shutdown_connections 2023-10-03T10:16:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.843+0000 7fee98ec3700 1 -- 172.21.15.146:0/1289587545 wait complete. 2023-10-03T10:16:28.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.844+0000 7fee98ec3700 1 Processor -- start 2023-10-03T10:16:28.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.844+0000 7fee98ec3700 1 -- start start 2023-10-03T10:16:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.844+0000 7fee98ec3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee9409d860 0x7fee9412f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.844+0000 7fee98ec3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee9409e170 0x7fee9412fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.844+0000 7fee98ec3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee94130ce0 0x7fee9411b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.844+0000 7fee98ec3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9409a150 con 0x7fee94130ce0 2023-10-03T10:16:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.844+0000 7fee98ec3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9409c8b0 con 0x7fee9409e170 2023-10-03T10:16:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.844+0000 7fee98ec3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee9411ef10 con 0x7fee9409d860 2023-10-03T10:16:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.844+0000 7fee92d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee94130ce0 0x7fee9411b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.844+0000 7fee92d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee94130ce0 0x7fee9411b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49718/0 (socket says 172.21.15.146:49718) 2023-10-03T10:16:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.844+0000 7fee92d9d700 1 -- 172.21.15.146:0/1943032431 learned_addr learned my addr 172.21.15.146:0/1943032431 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.845+0000 7fee91d9b700 1 --2- 172.21.15.146:0/1943032431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee9409e170 0x7fee9412fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.845+0000 7fee92d9d700 1 -- 172.21.15.146:0/1943032431 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee9409d860 msgr2=0x7fee9412f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.845+0000 7fee92d9d700 1 --2- 172.21.15.146:0/1943032431 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee9409d860 0x7fee9412f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.845+0000 7fee92d9d700 1 -- 172.21.15.146:0/1943032431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee9409e170 msgr2=0x7fee9412fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.845+0000 7fee92d9d700 1 --2- 172.21.15.146:0/1943032431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee9409e170 0x7fee9412fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.845+0000 7fee92d9d700 1 -- 172.21.15.146:0/1943032431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee880094a0 con 0x7fee94130ce0 2023-10-03T10:16:28.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.845+0000 7fee92d9d700 1 --2- 172.21.15.146:0/1943032431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee94130ce0 0x7fee9411b760 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00ee60 tx=0x7fee8c00c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.845+0000 7fee82ffd700 1 -- 172.21.15.146:0/1943032431 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c013770 con 0x7fee94130ce0 2023-10-03T10:16:28.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.846+0000 7fee82ffd700 1 -- 172.21.15.146:0/1943032431 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8c0138d0 con 0x7fee94130ce0 2023-10-03T10:16:28.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.846+0000 7fee82ffd700 1 -- 172.21.15.146:0/1943032431 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c013c40 con 0x7fee94130ce0 2023-10-03T10:16:28.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.846+0000 7f0728ff9700 1 -- 172.21.15.146:0/1337217158 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f071c03ee60 con 0x7f072c06a770 2023-10-03T10:16:28.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.846+0000 7fee98ec3700 1 -- 172.21.15.146:0/1943032431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9411dad0 con 0x7fee94130ce0 2023-10-03T10:16:28.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.846+0000 7fee98ec3700 1 -- 172.21.15.146:0/1943032431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee9412ff50 con 0x7fee94130ce0 2023-10-03T10:16:28.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.846+0000 7fee98ec3700 1 -- 172.21.15.146:0/1943032431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9411ed70 con 0x7fee94130ce0 2023-10-03T10:16:28.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.847+0000 7fee82ffd700 1 -- 172.21.15.146:0/1943032431 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee8c026480 con 0x7fee94130ce0 2023-10-03T10:16:28.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.847+0000 7fee82ffd700 1 -- 172.21.15.146:0/1943032431 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fee8c044270 con 0x7fee94130ce0 2023-10-03T10:16:28.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.856+0000 7fee82ffd700 1 -- 172.21.15.146:0/1943032431 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee8c013da0 con 0x7fee94130ce0 2023-10-03T10:16:28.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.981+0000 7f3ce290e700 1 -- 172.21.15.146:0/516022936 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3cdc130940 con 0x7f3cdc09c5c0 2023-10-03T10:16:28.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.981+0000 7f3cd8ff9700 1 -- 172.21.15.146:0/516022936 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3cdc130940 con 0x7f3cdc09c5c0 2023-10-03T10:16:28.982 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.983+0000 7f3ce290e700 1 -- 172.21.15.146:0/516022936 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cdc09c5c0 msgr2=0x7f3cdc119360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.983+0000 7f3ce290e700 1 --2- 172.21.15.146:0/516022936 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cdc09c5c0 0x7f3cdc119360 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0000c00 tx=0x7f3cd0004750 comp rx=0 tx=0).stop 2023-10-03T10:16:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.983+0000 7f3ce290e700 1 -- 172.21.15.146:0/516022936 shutdown_connections 2023-10-03T10:16:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.983+0000 7f3ce290e700 1 --2- 172.21.15.146:0/516022936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cdc131980 0x7f3cdc1198a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.983+0000 7f3ce290e700 1 --2- 172.21.15.146:0/516022936 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cdc09bc70 0x7f3cdc118e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.983+0000 7f3ce290e700 1 --2- 172.21.15.146:0/516022936 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cdc09c5c0 0x7f3cdc119360 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.983+0000 7f3ce290e700 1 -- 172.21.15.146:0/516022936 >> 172.21.15.146:0/516022936 conn(0x7f3cdc0a2980 msgr2=0x7f3cdc099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.983+0000 7f3ce290e700 1 -- 172.21.15.146:0/516022936 shutdown_connections 2023-10-03T10:16:28.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.983+0000 7f3ce290e700 1 -- 172.21.15.146:0/516022936 wait complete. 2023-10-03T10:16:28.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:28.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.995+0000 7f5108c28700 1 -- 172.21.15.146:0/3539561986 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f510404f2a0 con 0x7f5104131f40 2023-10-03T10:16:28.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.996+0000 7f50f2ffd700 1 -- 172.21.15.146:0/3539561986 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f50fc034090 con 0x7f5104131f40 2023-10-03T10:16:28.997 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.998+0000 7f5108c28700 1 -- 172.21.15.146:0/3539561986 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5104131f40 msgr2=0x7f51041c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.998+0000 7f5108c28700 1 --2- 172.21.15.146:0/3539561986 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5104131f40 0x7f51041c8230 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f50fc003f50 tx=0x7f50fc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.998+0000 7f5108c28700 1 -- 172.21.15.146:0/3539561986 shutdown_connections 2023-10-03T10:16:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.998+0000 7f5108c28700 1 --2- 172.21.15.146:0/3539561986 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5104131f40 0x7f51041c8230 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.998+0000 7f5108c28700 1 --2- 172.21.15.146:0/3539561986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f510409e870 0x7f510406c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.998+0000 7f5108c28700 1 --2- 172.21.15.146:0/3539561986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f510409f180 0x7f510406c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.998+0000 7f5108c28700 1 -- 172.21.15.146:0/3539561986 >> 172.21.15.146:0/3539561986 conn(0x7f51040a4430 msgr2=0x7f510409c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.998+0000 7f5108c28700 1 -- 172.21.15.146:0/3539561986 shutdown_connections 2023-10-03T10:16:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:28.998+0000 7f5108c28700 1 -- 172.21.15.146:0/3539561986 wait complete. 2023-10-03T10:16:29.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:29.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:29.047+0000 7f073292a700 1 -- 172.21.15.146:0/1337217158 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f070c005590 con 0x7f072c06a770 2023-10-03T10:16:29.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:29.048+0000 7f0728ff9700 1 -- 172.21.15.146:0/1337217158 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f071c017080 con 0x7f072c06a770 2023-10-03T10:16:29.048 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:29.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:29.050+0000 7f073292a700 1 -- 172.21.15.146:0/1337217158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f072c06a770 msgr2=0x7f072c09a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:29.050+0000 7f073292a700 1 --2- 172.21.15.146:0/1337217158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f072c06a770 0x7f072c09a490 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f071c001eb0 tx=0x7f071c00c800 comp rx=0 tx=0).stop 2023-10-03T10:16:29.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:29.050+0000 7f073292a700 1 -- 172.21.15.146:0/1337217158 shutdown_connections 2023-10-03T10:16:29.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:29.050+0000 7f073292a700 1 --2- 172.21.15.146:0/1337217158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f072c137140 0x7f072c09af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:29.050+0000 7f073292a700 1 --2- 172.21.15.146:0/1337217158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f072c06a770 0x7f072c09a490 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:29.050+0000 7f073292a700 1 --2- 172.21.15.146:0/1337217158 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f072c06b250 0x7f072c09a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:29.050+0000 7f073292a700 1 -- 172.21.15.146:0/1337217158 >> 172.21.15.146:0/1337217158 conn(0x7f072c099c40 msgr2=0x7f072c0a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:29.050+0000 7f073292a700 1 -- 172.21.15.146:0/1337217158 shutdown_connections 2023-10-03T10:16:29.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:29.050+0000 7f073292a700 1 -- 172.21.15.146:0/1337217158 wait complete. 2023-10-03T10:16:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:29.051+0000 7fee98ec3700 1 -- 172.21.15.146:0/1943032431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fee9411ed70 con 0x7fee94130ce0 2023-10-03T10:16:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:29.051+0000 7fee82ffd700 1 -- 172.21.15.146:0/1943032431 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee9411ed70 con 0x7fee94130ce0 2023-10-03T10:16:29.052 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:29.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:29.053+0000 7fee98ec3700 1 -- 172.21.15.146:0/1943032431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee94130ce0 msgr2=0x7fee9411b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:29.053+0000 7fee98ec3700 1 --2- 172.21.15.146:0/1943032431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee94130ce0 0x7fee9411b760 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00ee60 tx=0x7fee8c00c550 comp rx=0 tx=0).stop 2023-10-03T10:16:29.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:29.053+0000 7fee98ec3700 1 -- 172.21.15.146:0/1943032431 shutdown_connections 2023-10-03T10:16:29.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:29.053+0000 7fee98ec3700 1 --2- 172.21.15.146:0/1943032431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee94130ce0 0x7fee9411b760 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:29.053+0000 7fee98ec3700 1 --2- 172.21.15.146:0/1943032431 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee9409d860 0x7fee9412f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:29.053+0000 7fee98ec3700 1 --2- 172.21.15.146:0/1943032431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee9409e170 0x7fee9412fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:29.053+0000 7fee98ec3700 1 -- 172.21.15.146:0/1943032431 >> 172.21.15.146:0/1943032431 conn(0x7fee94099c40 msgr2=0x7fee94070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:29.053+0000 7fee98ec3700 1 -- 172.21.15.146:0/1943032431 shutdown_connections 2023-10-03T10:16:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:29.053+0000 7fee98ec3700 1 -- 172.21.15.146:0/1943032431 wait complete. 2023-10-03T10:16:29.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:29.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:29.997 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:30.012 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:30.065 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:30.067 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:30.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.146+0000 7f2f014d5700 1 Processor -- start 2023-10-03T10:16:30.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.147+0000 7f2f014d5700 1 -- start start 2023-10-03T10:16:30.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.147+0000 7f2f014d5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2efc1368e0 0x7f2efc138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.147+0000 7f2f014d5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2efc139200 0x7f2efc13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.147+0000 7f2f014d5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2efc09a760 con 0x7f2efc133900 2023-10-03T10:16:30.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.147+0000 7f2f014d5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2efc1336e0 con 0x7f2efc1368e0 2023-10-03T10:16:30.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.147+0000 7f2f014d5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc09a080 con 0x7f2efc139200 2023-10-03T10:16:30.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.148+0000 7f2efaffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2efc133900 0x7f2efc133cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47234/0 (socket says 172.21.15.146:47234) 2023-10-03T10:16:30.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.148+0000 7f2efaffd700 1 -- 172.21.15.146:0/3714890071 learned_addr learned my addr 172.21.15.146:0/3714890071 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:30.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.148+0000 7f2ef27fc700 1 --2- 172.21.15.146:0/3714890071 >> v2:172.21.15.146:3300/0 conn(0x7f2efc1368e0 0x7f2efc138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.148+0000 7f2efb7fe700 1 --2- 172.21.15.146:0/3714890071 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2efc139200 0x7f2efc13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.148+0000 7f2ef27fc700 1 -- 172.21.15.146:0/3714890071 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2efc139200 msgr2=0x7f2efc13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:30.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.148+0000 7f2ef27fc700 1 --2- 172.21.15.146:0/3714890071 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2efc139200 0x7f2efc13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.148+0000 7f2ef27fc700 1 -- 172.21.15.146:0/3714890071 >> v1:172.21.15.146:6789/0 conn(0x7f2efc133900 legacy=0x7f2efc133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.148+0000 7f2ef27fc700 1 -- 172.21.15.146:0/3714890071 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc0a23e0 con 0x7f2efc1368e0 2023-10-03T10:16:30.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.148+0000 7f2ef27fc700 1 --2- 172.21.15.146:0/3714890071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2efc1368e0 0x7f2efc138cc0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009840 tx=0x7f2ee4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebbdfb505c889ab8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.148+0000 7f2efa7fc700 1 -- 172.21.15.146:0/3714890071 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4011830 con 0x7f2efc1368e0 2023-10-03T10:16:30.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.148+0000 7f2efa7fc700 1 -- 172.21.15.146:0/3714890071 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee4011990 con 0x7f2efc1368e0 2023-10-03T10:16:30.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.148+0000 7f2efa7fc700 1 -- 172.21.15.146:0/3714890071 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4011d20 con 0x7f2efc1368e0 2023-10-03T10:16:30.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.149+0000 7f2f014d5700 1 -- 172.21.15.146:0/3714890071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2efc1368e0 msgr2=0x7f2efc138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.149+0000 7f2f014d5700 1 --2- 172.21.15.146:0/3714890071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2efc1368e0 0x7f2efc138cc0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009840 tx=0x7f2ee4009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:30.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.149+0000 7f2f014d5700 1 -- 172.21.15.146:0/3714890071 shutdown_connections 2023-10-03T10:16:30.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.149+0000 7f2f014d5700 1 --2- 172.21.15.146:0/3714890071 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2efc139200 0x7f2efc13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.149+0000 7f2f014d5700 1 --2- 172.21.15.146:0/3714890071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2efc1368e0 0x7f2efc138cc0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.149+0000 7f2f014d5700 1 -- 172.21.15.146:0/3714890071 >> 172.21.15.146:0/3714890071 conn(0x7f2efc0a2980 msgr2=0x7f2efc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.149+0000 7f2f014d5700 1 -- 172.21.15.146:0/3714890071 shutdown_connections 2023-10-03T10:16:30.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.150+0000 7f2f014d5700 1 -- 172.21.15.146:0/3714890071 wait complete. 2023-10-03T10:16:30.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.151+0000 7f2f014d5700 1 Processor -- start 2023-10-03T10:16:30.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.151+0000 7f2f014d5700 1 -- start start 2023-10-03T10:16:30.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.152+0000 7f2f014d5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2efc133900 0x7f2efc1c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.152+0000 7f2f014d5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2efc1368e0 0x7f2efc1c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.152+0000 7f2f014d5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2efc139200 0x7f2efc11af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.152+0000 7f2f014d5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc11ca80 con 0x7f2efc133900 2023-10-03T10:16:30.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.152+0000 7f2f014d5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc11c3d0 con 0x7f2efc1368e0 2023-10-03T10:16:30.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.152+0000 7f2f014d5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc11cc70 con 0x7f2efc139200 2023-10-03T10:16:30.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.152+0000 7f2ef27fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2efc1368e0 0x7f2efc1c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.152+0000 7f2ef27fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2efc1368e0 0x7f2efc1c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59506/0 (socket says 172.21.15.146:59506) 2023-10-03T10:16:30.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.152+0000 7f2ef27fc700 1 -- 172.21.15.146:0/1514891486 learned_addr learned my addr 172.21.15.146:0/1514891486 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:30.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.152+0000 7f2efaffd700 1 --2- 172.21.15.146:0/1514891486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2efc133900 0x7f2efc1c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.152+0000 7f2ef27fc700 1 -- 172.21.15.146:0/1514891486 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2efc139200 msgr2=0x7f2efc11af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.152+0000 7f2ef27fc700 1 --2- 172.21.15.146:0/1514891486 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2efc139200 0x7f2efc11af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.152+0000 7f2ef27fc700 1 -- 172.21.15.146:0/1514891486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2efc133900 msgr2=0x7f2efc1c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.152+0000 7f2ef27fc700 1 --2- 172.21.15.146:0/1514891486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2efc133900 0x7f2efc1c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.152+0000 7f2ef27fc700 1 -- 172.21.15.146:0/1514891486 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee40094a0 con 0x7f2efc1368e0 2023-10-03T10:16:30.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.152+0000 7f2ef27fc700 1 --2- 172.21.15.146:0/1514891486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2efc1368e0 0x7f2efc1c8b60 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009fd0 tx=0x7f2ee4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.153+0000 7f2ef3fff700 1 -- 172.21.15.146:0/1514891486 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee40036a0 con 0x7f2efc1368e0 2023-10-03T10:16:30.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.153+0000 7f2ef3fff700 1 -- 172.21.15.146:0/1514891486 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee401f070 con 0x7f2efc1368e0 2023-10-03T10:16:30.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.153+0000 7f2ef3fff700 1 -- 172.21.15.146:0/1514891486 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4003a20 con 0x7f2efc1368e0 2023-10-03T10:16:30.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.154+0000 7f2f014d5700 1 -- 172.21.15.146:0/1514891486 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2efc11e9f0 con 0x7f2efc1368e0 2023-10-03T10:16:30.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.154+0000 7f2f014d5700 1 -- 172.21.15.146:0/1514891486 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2efc09a2c0 con 0x7f2efc1368e0 2023-10-03T10:16:30.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.155+0000 7f2f014d5700 1 -- 172.21.15.146:0/1514891486 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2efc04f2a0 con 0x7f2efc1368e0 2023-10-03T10:16:30.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.155+0000 7f2ef3fff700 1 -- 172.21.15.146:0/1514891486 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ee4003b80 con 0x7f2efc1368e0 2023-10-03T10:16:30.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.155+0000 7f2ef3fff700 1 -- 172.21.15.146:0/1514891486 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2ee4021070 con 0x7f2efc1368e0 2023-10-03T10:16:30.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.163+0000 7f2ef3fff700 1 -- 172.21.15.146:0/1514891486 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ee4010380 con 0x7f2efc1368e0 2023-10-03T10:16:30.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.183+0000 7fc026de4700 1 Processor -- start 2023-10-03T10:16:30.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.183+0000 7fc026de4700 1 -- start start 2023-10-03T10:16:30.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.184+0000 7fc026de4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc02009e870 0x7fc02009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.184+0000 7fc026de4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc02009f180 0x7fc020131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.184+0000 7fc026de4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc020131d70 0x7fc020132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.184+0000 7fc026de4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0200a0920 con 0x7fc02009f180 2023-10-03T10:16:30.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.184+0000 7fc026de4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02009c970 con 0x7fc02009e870 2023-10-03T10:16:30.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.184+0000 7fc026de4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc02009bab0 con 0x7fc020131d70 2023-10-03T10:16:30.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.184+0000 7fc024b80700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc02009e870 0x7fc02009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.184+0000 7fc01ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc02009f180 0x7fc020131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.184+0000 7fc01ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc02009f180 0x7fc020131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49732/0 (socket says 172.21.15.146:49732) 2023-10-03T10:16:30.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.184+0000 7fc024b80700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc02009e870 0x7fc02009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59520/0 (socket says 172.21.15.146:59520) 2023-10-03T10:16:30.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.184+0000 7fc01ffff700 1 -- 172.21.15.146:0/2505564023 learned_addr learned my addr 172.21.15.146:0/2505564023 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:30.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.184+0000 7fc025381700 1 --2- 172.21.15.146:0/2505564023 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc020131d70 0x7fc020132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.184+0000 7fc024b80700 1 -- 172.21.15.146:0/2505564023 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc020131d70 msgr2=0x7fc020132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:30.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.184+0000 7fc024b80700 1 --2- 172.21.15.146:0/2505564023 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc020131d70 0x7fc020132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.184+0000 7fc024b80700 1 -- 172.21.15.146:0/2505564023 >> v2:172.21.15.146:3300/0 conn(0x7fc02009f180 msgr2=0x7fc020131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:30.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.184+0000 7fc024b80700 1 --2- 172.21.15.146:0/2505564023 >> v2:172.21.15.146:3300/0 conn(0x7fc02009f180 0x7fc020131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.184+0000 7fc024b80700 1 -- 172.21.15.146:0/2505564023 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02009f9c0 con 0x7fc02009e870 2023-10-03T10:16:30.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.184+0000 7fc024b80700 1 --2- 172.21.15.146:0/2505564023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc02009e870 0x7fc02009ec40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc014009870 tx=0x7fc014009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c8689fa9781bfa8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.185+0000 7fc01f7fe700 1 -- 172.21.15.146:0/2505564023 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc014011830 con 0x7fc02009e870 2023-10-03T10:16:30.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.185+0000 7fc01f7fe700 1 -- 172.21.15.146:0/2505564023 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc014011990 con 0x7fc02009e870 2023-10-03T10:16:30.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.185+0000 7fc01f7fe700 1 -- 172.21.15.146:0/2505564023 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc014011d20 con 0x7fc02009e870 2023-10-03T10:16:30.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.185+0000 7fc026de4700 1 -- 172.21.15.146:0/2505564023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc02009e870 msgr2=0x7fc02009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.185+0000 7fc026de4700 1 --2- 172.21.15.146:0/2505564023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc02009e870 0x7fc02009ec40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc014009870 tx=0x7fc014009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:30.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.185+0000 7fc026de4700 1 -- 172.21.15.146:0/2505564023 shutdown_connections 2023-10-03T10:16:30.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.185+0000 7fc026de4700 1 --2- 172.21.15.146:0/2505564023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc02009e870 0x7fc02009ec40 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.185+0000 7fc026de4700 1 --2- 172.21.15.146:0/2505564023 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc020131d70 0x7fc020132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.185+0000 7fc026de4700 1 --2- 172.21.15.146:0/2505564023 >> v2:172.21.15.146:3300/0 conn(0x7fc02009f180 0x7fc020131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.185+0000 7fc026de4700 1 -- 172.21.15.146:0/2505564023 >> 172.21.15.146:0/2505564023 conn(0x7fc0200a4430 msgr2=0x7fc0200a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.185+0000 7fc026de4700 1 -- 172.21.15.146:0/2505564023 shutdown_connections 2023-10-03T10:16:30.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.185+0000 7fc026de4700 1 -- 172.21.15.146:0/2505564023 wait complete. 2023-10-03T10:16:30.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.186+0000 7fc026de4700 1 Processor -- start 2023-10-03T10:16:30.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.186+0000 7fc026de4700 1 -- start start 2023-10-03T10:16:30.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.187+0000 7fc026de4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc02009e870 0x7fc0201c1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.187+0000 7fc026de4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc02009f180 0x7fc0201c1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.187+0000 7fc026de4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc020131d70 0x7fc0201c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.187+0000 7fc026de4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02011e130 con 0x7fc020131d70 2023-10-03T10:16:30.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.187+0000 7fc026de4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02011c250 con 0x7fc02009e870 2023-10-03T10:16:30.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.187+0000 7fc026de4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0201c1ad0 con 0x7fc02009f180 2023-10-03T10:16:30.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.187+0000 7fc024b80700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc02009e870 0x7fc0201c1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.187+0000 7fc024b80700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc02009e870 0x7fc0201c1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59534/0 (socket says 172.21.15.146:59534) 2023-10-03T10:16:30.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.187+0000 7fc024b80700 1 -- 172.21.15.146:0/3213553371 learned_addr learned my addr 172.21.15.146:0/3213553371 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:30.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.187+0000 7fc025381700 1 --2- 172.21.15.146:0/3213553371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc020131d70 0x7fc0201c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.187+0000 7fc01ffff700 1 --2- 172.21.15.146:0/3213553371 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc02009f180 0x7fc0201c1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.188+0000 7fc024b80700 1 -- 172.21.15.146:0/3213553371 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc02009f180 msgr2=0x7fc0201c1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.188+0000 7fc024b80700 1 --2- 172.21.15.146:0/3213553371 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc02009f180 0x7fc0201c1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.188+0000 7fc024b80700 1 -- 172.21.15.146:0/3213553371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc020131d70 msgr2=0x7fc0201c4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.188+0000 7fc024b80700 1 --2- 172.21.15.146:0/3213553371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc020131d70 0x7fc0201c4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.188+0000 7fc024b80700 1 -- 172.21.15.146:0/3213553371 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0140094a0 con 0x7fc02009e870 2023-10-03T10:16:30.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.188+0000 7fc01ffff700 1 --2- 172.21.15.146:0/3213553371 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc02009f180 0x7fc0201c1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:30.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.188+0000 7fc024b80700 1 --2- 172.21.15.146:0/3213553371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc02009e870 0x7fc0201c1050 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc014000c00 tx=0x7fc014004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.188+0000 7fc01d7fa700 1 -- 172.21.15.146:0/3213553371 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc014004450 con 0x7fc02009e870 2023-10-03T10:16:30.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.188+0000 7fc026de4700 1 -- 172.21.15.146:0/3213553371 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc02011c9b0 con 0x7fc02009e870 2023-10-03T10:16:30.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.188+0000 7fc01d7fa700 1 -- 172.21.15.146:0/3213553371 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01401f070 con 0x7fc02009e870 2023-10-03T10:16:30.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.188+0000 7fc01d7fa700 1 -- 172.21.15.146:0/3213553371 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0140038a0 con 0x7fc02009e870 2023-10-03T10:16:30.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.188+0000 7fc026de4700 1 -- 172.21.15.146:0/3213553371 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0200a2c20 con 0x7fc02009e870 2023-10-03T10:16:30.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.189+0000 7fc01d7fa700 1 -- 172.21.15.146:0/3213553371 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc014003a00 con 0x7fc02009e870 2023-10-03T10:16:30.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.189+0000 7fc01d7fa700 1 -- 172.21.15.146:0/3213553371 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc014021070 con 0x7fc02009e870 2023-10-03T10:16:30.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.190+0000 7fc026de4700 1 -- 172.21.15.146:0/3213553371 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0200a0210 con 0x7fc02009e870 2023-10-03T10:16:30.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.194+0000 7fc01d7fa700 1 -- 172.21.15.146:0/3213553371 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc014015080 con 0x7fc02009e870 2023-10-03T10:16:30.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.216+0000 7f33da272700 1 Processor -- start 2023-10-03T10:16:30.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.217+0000 7f33da272700 1 -- start start 2023-10-03T10:16:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.217+0000 7f33da272700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33d409e870 0x7f33d409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.217+0000 7f33da272700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f33d409f180 0x7f33d4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.217+0000 7f33da272700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d4131d70 0x7f33d4132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.217+0000 7f33da272700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d40a0920 con 0x7f33d409f180 2023-10-03T10:16:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.217+0000 7f33da272700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d409c970 con 0x7f33d4131d70 2023-10-03T10:16:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.217+0000 7f33da272700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33d409bab0 con 0x7f33d409e870 2023-10-03T10:16:30.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.217+0000 7f33d880f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d4131d70 0x7f33d4132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.217+0000 7f33d880f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d4131d70 0x7f33d4132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59546/0 (socket says 172.21.15.146:59546) 2023-10-03T10:16:30.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.217+0000 7f33d880f700 1 -- 172.21.15.146:0/223411575 learned_addr learned my addr 172.21.15.146:0/223411575 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:30.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.217+0000 7f33d3fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33d409e870 0x7f33d409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.218+0000 7f33d37fe700 1 --2- 172.21.15.146:0/223411575 >> v2:172.21.15.146:3300/0 conn(0x7f33d409f180 0x7f33d4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.218+0000 7f33d3fff700 1 -- 172.21.15.146:0/223411575 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d4131d70 msgr2=0x7f33d4132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:30.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.218+0000 7f33d3fff700 1 --2- 172.21.15.146:0/223411575 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d4131d70 0x7f33d4132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.218+0000 7f33d3fff700 1 -- 172.21.15.146:0/223411575 >> v2:172.21.15.146:3300/0 conn(0x7f33d409f180 msgr2=0x7f33d4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.218+0000 7f33d3fff700 1 --2- 172.21.15.146:0/223411575 >> v2:172.21.15.146:3300/0 conn(0x7f33d409f180 0x7f33d4131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.218+0000 7f33d3fff700 1 -- 172.21.15.146:0/223411575 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d409f9c0 con 0x7f33d409e870 2023-10-03T10:16:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.218+0000 7f33d880f700 1 --2- 172.21.15.146:0/223411575 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d4131d70 0x7f33d4132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.218+0000 7f33d3fff700 1 --2- 172.21.15.146:0/223411575 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33d409e870 0x7f33d409ec40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f33c4009840 tx=0x7f33c4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61eda936ec4b79f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.218+0000 7f33d2ffd700 1 -- 172.21.15.146:0/223411575 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c4010a90 con 0x7f33d409e870 2023-10-03T10:16:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.218+0000 7f33d2ffd700 1 -- 172.21.15.146:0/223411575 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c4010bf0 con 0x7f33d409e870 2023-10-03T10:16:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.218+0000 7f33d2ffd700 1 -- 172.21.15.146:0/223411575 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c4018440 con 0x7f33d409e870 2023-10-03T10:16:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.219+0000 7f33da272700 1 -- 172.21.15.146:0/223411575 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33d409e870 msgr2=0x7f33d409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.219+0000 7f33da272700 1 --2- 172.21.15.146:0/223411575 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33d409e870 0x7f33d409ec40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f33c4009840 tx=0x7f33c4009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.219+0000 7f33da272700 1 -- 172.21.15.146:0/223411575 shutdown_connections 2023-10-03T10:16:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.219+0000 7f33da272700 1 --2- 172.21.15.146:0/223411575 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d4131d70 0x7f33d4132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.219+0000 7f33da272700 1 --2- 172.21.15.146:0/223411575 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33d409e870 0x7f33d409ec40 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.219+0000 7f33da272700 1 --2- 172.21.15.146:0/223411575 >> v2:172.21.15.146:3300/0 conn(0x7f33d409f180 0x7f33d4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.219+0000 7f33da272700 1 -- 172.21.15.146:0/223411575 >> 172.21.15.146:0/223411575 conn(0x7f33d40a4430 msgr2=0x7f33d40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.219+0000 7f33da272700 1 -- 172.21.15.146:0/223411575 shutdown_connections 2023-10-03T10:16:30.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.219+0000 7f33da272700 1 -- 172.21.15.146:0/223411575 wait complete. 2023-10-03T10:16:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.220+0000 7f33da272700 1 Processor -- start 2023-10-03T10:16:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.220+0000 7f33da272700 1 -- start start 2023-10-03T10:16:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.221+0000 7f33da272700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d409e870 0x7f33d41c1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.221+0000 7f33da272700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d409f180 0x7f33d41c15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.221+0000 7f33da272700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33d4131d70 0x7f33d41c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.221+0000 7f33da272700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d4072710 con 0x7f33d409f180 2023-10-03T10:16:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.221+0000 7f33da272700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d41c1b00 con 0x7f33d409e870 2023-10-03T10:16:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.221+0000 7f33da272700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33d411c8e0 con 0x7f33d4131d70 2023-10-03T10:16:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.221+0000 7f33d880f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33d4131d70 0x7f33d41c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.221+0000 7f33d880f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33d4131d70 0x7f33d41c4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36444/0 (socket says 172.21.15.146:36444) 2023-10-03T10:16:30.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.221+0000 7f33d880f700 1 -- 172.21.15.146:0/1189537602 learned_addr learned my addr 172.21.15.146:0/1189537602 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:30.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.221+0000 7f33d3fff700 1 --2- 172.21.15.146:0/1189537602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d409e870 0x7f33d41c1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.221+0000 7f33d37fe700 1 --2- 172.21.15.146:0/1189537602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d409f180 0x7f33d41c15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.221+0000 7f33d880f700 1 -- 172.21.15.146:0/1189537602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d409e870 msgr2=0x7f33d41c1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.221+0000 7f33d880f700 1 --2- 172.21.15.146:0/1189537602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d409e870 0x7f33d41c1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.221+0000 7f33d880f700 1 -- 172.21.15.146:0/1189537602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d409f180 msgr2=0x7f33d41c15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.221+0000 7f33d880f700 1 --2- 172.21.15.146:0/1189537602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d409f180 0x7f33d41c15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.221+0000 7f33d880f700 1 -- 172.21.15.146:0/1189537602 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33cc009b30 con 0x7f33d4131d70 2023-10-03T10:16:30.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.221+0000 7f33d3fff700 1 --2- 172.21.15.146:0/1189537602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d409e870 0x7f33d41c1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:30.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.222+0000 7f33d880f700 1 --2- 172.21.15.146:0/1189537602 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33d4131d70 0x7f33d41c4070 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009f10 tx=0x7f33cc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.222+0000 7f33d0ff9700 1 -- 172.21.15.146:0/1189537602 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc018070 con 0x7f33d4131d70 2023-10-03T10:16:30.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.222+0000 7f33d0ff9700 1 -- 172.21.15.146:0/1189537602 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33cc00f040 con 0x7f33d4131d70 2023-10-03T10:16:30.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.222+0000 7f33da272700 1 -- 172.21.15.146:0/1189537602 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c40094a0 con 0x7f33d4131d70 2023-10-03T10:16:30.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.222+0000 7f33d0ff9700 1 -- 172.21.15.146:0/1189537602 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc003c40 con 0x7f33d4131d70 2023-10-03T10:16:30.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.222+0000 7f33da272700 1 -- 172.21.15.146:0/1189537602 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d411bc20 con 0x7f33d4131d70 2023-10-03T10:16:30.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.223+0000 7f33d0ff9700 1 -- 172.21.15.146:0/1189537602 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f33cc00c940 con 0x7f33d4131d70 2023-10-03T10:16:30.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.223+0000 7f33d0ff9700 1 -- 172.21.15.146:0/1189537602 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f33cc03f7f0 con 0x7f33d4131d70 2023-10-03T10:16:30.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.223+0000 7f33da272700 1 -- 172.21.15.146:0/1189537602 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d404f2a0 con 0x7f33d4131d70 2023-10-03T10:16:30.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.227+0000 7f33d0ff9700 1 -- 172.21.15.146:0/1189537602 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33cc014480 con 0x7f33d4131d70 2023-10-03T10:16:30.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.245+0000 7f5e7f0fc700 1 Processor -- start 2023-10-03T10:16:30.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.245+0000 7f5e7f0fc700 1 -- start start 2023-10-03T10:16:30.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.245+0000 7f5e7f0fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e7809e340 0x7f5e781359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.245+0000 7f5e7f0fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e78135f20 0x7f5e78138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.245+0000 7f5e7f0fc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e7809aaa0 con 0x7f5e7809d860 2023-10-03T10:16:30.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.245+0000 7f5e7f0fc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7809e730 con 0x7f5e78135f20 2023-10-03T10:16:30.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.245+0000 7f5e7f0fc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7809f870 con 0x7f5e7809e340 2023-10-03T10:16:30.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.246+0000 7f5e77fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e7809e340 0x7f5e781359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.246+0000 7f5e77fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e7809e340 0x7f5e781359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36446/0 (socket says 172.21.15.146:36446) 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.246+0000 7f5e77fff700 1 -- 172.21.15.146:0/2895705541 learned_addr learned my addr 172.21.15.146:0/2895705541 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.246+0000 7f5e7d699700 1 --2- 172.21.15.146:0/2895705541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e78135f20 0x7f5e78138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.246+0000 7f5e777fe700 1 -- 172.21.15.146:0/2895705541 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436975689 0 0) 0x7f5e7809aaa0 con 0x7f5e7809d860 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.246+0000 7f5e777fe700 1 -- 172.21.15.146:0/2895705541 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e680035b0 con 0x7f5e7809d860 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.246+0000 7f5e7d699700 1 -- 172.21.15.146:0/2895705541 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e7809e340 msgr2=0x7f5e781359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.246+0000 7f5e7d699700 1 --2- 172.21.15.146:0/2895705541 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e7809e340 0x7f5e781359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.246+0000 7f5e7d699700 1 -- 172.21.15.146:0/2895705541 >> v1:172.21.15.146:6789/0 conn(0x7f5e7809d860 legacy=0x7f5e7809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.246+0000 7f5e7d699700 1 -- 172.21.15.146:0/2895705541 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7809b360 con 0x7f5e78135f20 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.246+0000 7f5e77fff700 1 --2- 172.21.15.146:0/2895705541 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e7809e340 0x7f5e781359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.246+0000 7f5e7d699700 1 --2- 172.21.15.146:0/2895705541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e78135f20 0x7f5e78138300 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5e70009dc0 tx=0x7f5e7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=413146b38f6d93db server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.247+0000 7f5e777fe700 1 -- 172.21.15.146:0/2895705541 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7000e070 con 0x7f5e78135f20 2023-10-03T10:16:30.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.247+0000 7f5e777fe700 1 -- 172.21.15.146:0/2895705541 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7000bb20 con 0x7f5e78135f20 2023-10-03T10:16:30.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.247+0000 7f5e777fe700 1 -- 172.21.15.146:0/2895705541 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e70012430 con 0x7f5e78135f20 2023-10-03T10:16:30.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.247+0000 7f5e7f0fc700 1 -- 172.21.15.146:0/2895705541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e78135f20 msgr2=0x7f5e78138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.247+0000 7f5e7f0fc700 1 --2- 172.21.15.146:0/2895705541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e78135f20 0x7f5e78138300 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5e70009dc0 tx=0x7f5e7000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:30.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.247+0000 7f5e7f0fc700 1 -- 172.21.15.146:0/2895705541 shutdown_connections 2023-10-03T10:16:30.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.247+0000 7f5e7f0fc700 1 --2- 172.21.15.146:0/2895705541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e78135f20 0x7f5e78138300 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.247+0000 7f5e7f0fc700 1 --2- 172.21.15.146:0/2895705541 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e7809e340 0x7f5e781359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.247+0000 7f5e7f0fc700 1 -- 172.21.15.146:0/2895705541 >> 172.21.15.146:0/2895705541 conn(0x7f5e78099c40 msgr2=0x7f5e780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.247+0000 7f5e7f0fc700 1 -- 172.21.15.146:0/2895705541 shutdown_connections 2023-10-03T10:16:30.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.247+0000 7f5e7f0fc700 1 -- 172.21.15.146:0/2895705541 wait complete. 2023-10-03T10:16:30.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.249+0000 7f5e7f0fc700 1 Processor -- start 2023-10-03T10:16:30.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.249+0000 7f5e7f0fc700 1 -- start start 2023-10-03T10:16:30.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.250+0000 7f5e7f0fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e7809d860 0x7f5e781c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.250+0000 7f5e7f0fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e7809e340 0x7f5e781c3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.250+0000 7f5e7f0fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e78135f20 0x7f5e781c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.250+0000 7f5e7f0fc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7811c9b0 con 0x7f5e7809e340 2023-10-03T10:16:30.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.250+0000 7f5e7f0fc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7811ef90 con 0x7f5e78135f20 2023-10-03T10:16:30.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.250+0000 7f5e7f0fc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e781c3860 con 0x7f5e7809d860 2023-10-03T10:16:30.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.250+0000 7f5e7ce98700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e7809d860 0x7f5e781c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.250+0000 7f5e7ce98700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e7809d860 0x7f5e781c2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36456/0 (socket says 172.21.15.146:36456) 2023-10-03T10:16:30.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.250+0000 7f5e7ce98700 1 -- 172.21.15.146:0/3770156806 learned_addr learned my addr 172.21.15.146:0/3770156806 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:30.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.250+0000 7f5e7d699700 1 --2- 172.21.15.146:0/3770156806 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e78135f20 0x7f5e781c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.250+0000 7f5e77fff700 1 --2- 172.21.15.146:0/3770156806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e7809e340 0x7f5e781c3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.250+0000 7f5e7ce98700 1 -- 172.21.15.146:0/3770156806 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e78135f20 msgr2=0x7f5e781c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.250+0000 7f5e7ce98700 1 --2- 172.21.15.146:0/3770156806 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e78135f20 0x7f5e781c5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.250+0000 7f5e7ce98700 1 -- 172.21.15.146:0/3770156806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e7809e340 msgr2=0x7f5e781c3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.250+0000 7f5e7ce98700 1 --2- 172.21.15.146:0/3770156806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e7809e340 0x7f5e781c3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.250+0000 7f5e7ce98700 1 -- 172.21.15.146:0/3770156806 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e70009a70 con 0x7f5e7809d860 2023-10-03T10:16:30.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.251+0000 7f5e7ce98700 1 --2- 172.21.15.146:0/3770156806 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e7809d860 0x7f5e781c2de0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00c500 tx=0x7f5e6c00c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.251+0000 7f5e757fa700 1 -- 172.21.15.146:0/3770156806 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c0052d0 con 0x7f5e7809d860 2023-10-03T10:16:30.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.251+0000 7f5e757fa700 1 -- 172.21.15.146:0/3770156806 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c005430 con 0x7f5e7809d860 2023-10-03T10:16:30.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.251+0000 7f5e7f0fc700 1 -- 172.21.15.146:0/3770156806 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e780a1f60 con 0x7f5e7809d860 2023-10-03T10:16:30.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.251+0000 7f5e757fa700 1 -- 172.21.15.146:0/3770156806 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c0038a0 con 0x7f5e7809d860 2023-10-03T10:16:30.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.251+0000 7f5e7f0fc700 1 -- 172.21.15.146:0/3770156806 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e7811d080 con 0x7f5e7809d860 2023-10-03T10:16:30.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.252+0000 7f5e7f0fc700 1 -- 172.21.15.146:0/3770156806 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e7811ea50 con 0x7f5e7809d860 2023-10-03T10:16:30.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.253+0000 7f5e757fa700 1 -- 172.21.15.146:0/3770156806 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e6c003a00 con 0x7f5e7809d860 2023-10-03T10:16:30.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.253+0000 7f5e757fa700 1 -- 172.21.15.146:0/3770156806 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5e6c03ed20 con 0x7f5e7809d860 2023-10-03T10:16:30.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.257+0000 7f5e757fa700 1 -- 172.21.15.146:0/3770156806 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e6c003cb0 con 0x7f5e7809d860 2023-10-03T10:16:30.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.400+0000 7fc026de4700 1 -- 172.21.15.146:0/3213553371 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc02011e700 con 0x7fc02009e870 2023-10-03T10:16:30.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.401+0000 7fc01d7fa700 1 -- 172.21.15.146:0/3213553371 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc014003cb0 con 0x7fc02009e870 2023-10-03T10:16:30.401 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.404+0000 7fc026de4700 1 -- 172.21.15.146:0/3213553371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc02009e870 msgr2=0x7fc0201c1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.404+0000 7fc026de4700 1 --2- 172.21.15.146:0/3213553371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc02009e870 0x7fc0201c1050 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc014000c00 tx=0x7fc014004750 comp rx=0 tx=0).stop 2023-10-03T10:16:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.404+0000 7fc026de4700 1 -- 172.21.15.146:0/3213553371 shutdown_connections 2023-10-03T10:16:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.404+0000 7fc026de4700 1 --2- 172.21.15.146:0/3213553371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc020131d70 0x7fc0201c4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.404+0000 7fc026de4700 1 --2- 172.21.15.146:0/3213553371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc02009e870 0x7fc0201c1050 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.404+0000 7fc026de4700 1 --2- 172.21.15.146:0/3213553371 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc02009f180 0x7fc0201c1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.404+0000 7fc026de4700 1 -- 172.21.15.146:0/3213553371 >> 172.21.15.146:0/3213553371 conn(0x7fc0200a4430 msgr2=0x7fc02012fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.404+0000 7fc026de4700 1 -- 172.21.15.146:0/3213553371 shutdown_connections 2023-10-03T10:16:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.404+0000 7fc026de4700 1 -- 172.21.15.146:0/3213553371 wait complete. 2023-10-03T10:16:30.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:30.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.422+0000 7f33da272700 1 -- 172.21.15.146:0/1189537602 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f33d40a2790 con 0x7f33d4131d70 2023-10-03T10:16:30.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.422+0000 7f33d0ff9700 1 -- 172.21.15.146:0/1189537602 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f33cc01cbb0 con 0x7f33d4131d70 2023-10-03T10:16:30.423 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:30.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.423+0000 7f2f014d5700 1 -- 172.21.15.146:0/1514891486 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2efc11e770 con 0x7f2efc1368e0 2023-10-03T10:16:30.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.423+0000 7f2ef3fff700 1 -- 172.21.15.146:0/1514891486 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ee4015070 con 0x7f2efc1368e0 2023-10-03T10:16:30.424 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:30.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.425+0000 7f33da272700 1 -- 172.21.15.146:0/1189537602 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33d4131d70 msgr2=0x7f33d41c4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.425+0000 7f33da272700 1 --2- 172.21.15.146:0/1189537602 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33d4131d70 0x7f33d41c4070 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009f10 tx=0x7f33cc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.425+0000 7f33da272700 1 -- 172.21.15.146:0/1189537602 shutdown_connections 2023-10-03T10:16:30.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.425+0000 7f33da272700 1 --2- 172.21.15.146:0/1189537602 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f33d4131d70 0x7f33d41c4070 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.425+0000 7f33da272700 1 --2- 172.21.15.146:0/1189537602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d409e870 0x7f33d41c1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.425+0000 7f33da272700 1 --2- 172.21.15.146:0/1189537602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d409f180 0x7f33d41c15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.425+0000 7f33da272700 1 -- 172.21.15.146:0/1189537602 >> 172.21.15.146:0/1189537602 conn(0x7f33d40a4430 msgr2=0x7f33d412dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.425+0000 7f33da272700 1 -- 172.21.15.146:0/1189537602 shutdown_connections 2023-10-03T10:16:30.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.425+0000 7f33da272700 1 -- 172.21.15.146:0/1189537602 wait complete. 2023-10-03T10:16:30.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.425+0000 7f2f014d5700 1 -- 172.21.15.146:0/1514891486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2efc1368e0 msgr2=0x7f2efc1c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.425+0000 7f2f014d5700 1 --2- 172.21.15.146:0/1514891486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2efc1368e0 0x7f2efc1c8b60 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009fd0 tx=0x7f2ee4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:30.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.426+0000 7f2f014d5700 1 -- 172.21.15.146:0/1514891486 shutdown_connections 2023-10-03T10:16:30.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.426+0000 7f2f014d5700 1 --2- 172.21.15.146:0/1514891486 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2efc139200 0x7f2efc11af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.426+0000 7f2f014d5700 1 --2- 172.21.15.146:0/1514891486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2efc133900 0x7f2efc1c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.426+0000 7f2f014d5700 1 --2- 172.21.15.146:0/1514891486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2efc1368e0 0x7f2efc1c8b60 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.426+0000 7f2f014d5700 1 -- 172.21.15.146:0/1514891486 >> 172.21.15.146:0/1514891486 conn(0x7f2efc0a2980 msgr2=0x7f2efc131b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.426+0000 7f2f014d5700 1 -- 172.21.15.146:0/1514891486 shutdown_connections 2023-10-03T10:16:30.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.426+0000 7f2f014d5700 1 -- 172.21.15.146:0/1514891486 wait complete. 2023-10-03T10:16:30.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:30.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.487+0000 7f5e7f0fc700 1 -- 172.21.15.146:0/3770156806 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5e7804f2a0 con 0x7f5e7809d860 2023-10-03T10:16:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.487+0000 7f5e757fa700 1 -- 172.21.15.146:0/3770156806 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e6c0192c0 con 0x7f5e7809d860 2023-10-03T10:16:30.488 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:30.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.489+0000 7f5e7f0fc700 1 -- 172.21.15.146:0/3770156806 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e7809d860 msgr2=0x7f5e781c2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.489+0000 7f5e7f0fc700 1 --2- 172.21.15.146:0/3770156806 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e7809d860 0x7f5e781c2de0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00c500 tx=0x7f5e6c00c810 comp rx=0 tx=0).stop 2023-10-03T10:16:30.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.489+0000 7f5e7f0fc700 1 -- 172.21.15.146:0/3770156806 shutdown_connections 2023-10-03T10:16:30.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.489+0000 7f5e7f0fc700 1 --2- 172.21.15.146:0/3770156806 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e78135f20 0x7f5e781c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.489+0000 7f5e7f0fc700 1 --2- 172.21.15.146:0/3770156806 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e7809d860 0x7f5e781c2de0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.489+0000 7f5e7f0fc700 1 --2- 172.21.15.146:0/3770156806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e7809e340 0x7f5e781c3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.489+0000 7f5e7f0fc700 1 -- 172.21.15.146:0/3770156806 >> 172.21.15.146:0/3770156806 conn(0x7f5e78099c40 msgr2=0x7f5e7806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.489+0000 7f5e7f0fc700 1 -- 172.21.15.146:0/3770156806 shutdown_connections 2023-10-03T10:16:30.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:30.490+0000 7f5e7f0fc700 1 -- 172.21.15.146:0/3770156806 wait complete. 2023-10-03T10:16:30.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:31.418 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:31.439 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:31.440 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:31.502 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:31.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.570+0000 7fef01b6a700 1 Processor -- start 2023-10-03T10:16:31.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.570+0000 7fef01b6a700 1 -- start start 2023-10-03T10:16:31.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.571+0000 7fef01b6a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feefc09e870 0x7feefc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.571+0000 7fef01b6a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feefc09f180 0x7feefc131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.571+0000 7fef01b6a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feefc09c970 con 0x7feefc131d70 2023-10-03T10:16:31.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.571+0000 7fef01b6a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feefc0a0920 con 0x7feefc09f180 2023-10-03T10:16:31.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.571+0000 7fef01b6a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feefc09f9c0 con 0x7feefc09e870 2023-10-03T10:16:31.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.571+0000 7feefb7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feefc09e870 0x7feefc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.571+0000 7feefbfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7feefc131d70 0x7feefc138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47264/0 (socket says 172.21.15.146:47264) 2023-10-03T10:16:31.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.571+0000 7feefbfff700 1 -- 172.21.15.146:0/1256105029 learned_addr learned my addr 172.21.15.146:0/1256105029 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:31.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.571+0000 7feefaffd700 1 --2- 172.21.15.146:0/1256105029 >> v2:172.21.15.146:3300/0 conn(0x7feefc09f180 0x7feefc131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.571+0000 7feefb7fe700 1 -- 172.21.15.146:0/1256105029 >> v2:172.21.15.146:3300/0 conn(0x7feefc09f180 msgr2=0x7feefc131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.571+0000 7feefb7fe700 1 --2- 172.21.15.146:0/1256105029 >> v2:172.21.15.146:3300/0 conn(0x7feefc09f180 0x7feefc131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.571+0000 7feefb7fe700 1 -- 172.21.15.146:0/1256105029 >> v1:172.21.15.146:6789/0 conn(0x7feefc131d70 legacy=0x7feefc138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.571+0000 7feefb7fe700 1 -- 172.21.15.146:0/1256105029 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc09bab0 con 0x7feefc09e870 2023-10-03T10:16:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.572+0000 7feefb7fe700 1 --2- 172.21.15.146:0/1256105029 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feefc09e870 0x7feefc09ec40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7feeec009840 tx=0x7feeec009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=407c5285c22b73d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.572+0000 7feefa7fc700 1 -- 172.21.15.146:0/1256105029 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec011830 con 0x7feefc09e870 2023-10-03T10:16:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.572+0000 7feefa7fc700 1 -- 172.21.15.146:0/1256105029 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeec011990 con 0x7feefc09e870 2023-10-03T10:16:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.572+0000 7feefa7fc700 1 -- 172.21.15.146:0/1256105029 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec011d20 con 0x7feefc09e870 2023-10-03T10:16:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.572+0000 7fef01b6a700 1 -- 172.21.15.146:0/1256105029 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feefc09e870 msgr2=0x7feefc09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.572+0000 7fef01b6a700 1 --2- 172.21.15.146:0/1256105029 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feefc09e870 0x7feefc09ec40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7feeec009840 tx=0x7feeec009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.573+0000 7fef01b6a700 1 -- 172.21.15.146:0/1256105029 shutdown_connections 2023-10-03T10:16:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.573+0000 7fef01b6a700 1 --2- 172.21.15.146:0/1256105029 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feefc09e870 0x7feefc09ec40 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.573+0000 7fef01b6a700 1 --2- 172.21.15.146:0/1256105029 >> v2:172.21.15.146:3300/0 conn(0x7feefc09f180 0x7feefc131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.573+0000 7fef01b6a700 1 -- 172.21.15.146:0/1256105029 >> 172.21.15.146:0/1256105029 conn(0x7feefc0a4430 msgr2=0x7feefc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.573+0000 7fef01b6a700 1 -- 172.21.15.146:0/1256105029 shutdown_connections 2023-10-03T10:16:31.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.573+0000 7fef01b6a700 1 -- 172.21.15.146:0/1256105029 wait complete. 2023-10-03T10:16:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.574+0000 7fef01b6a700 1 Processor -- start 2023-10-03T10:16:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.574+0000 7fef01b6a700 1 -- start start 2023-10-03T10:16:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.575+0000 7fef01b6a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feefc09e870 0x7feefc11bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.575+0000 7fef01b6a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feefc09f180 0x7feefc11c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.575+0000 7fef01b6a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feefc131d70 0x7feefc11ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.575+0000 7fef01b6a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc11d440 con 0x7feefc09f180 2023-10-03T10:16:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.575+0000 7fef01b6a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feefc11dba0 con 0x7feefc09e870 2023-10-03T10:16:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.575+0000 7fef01b6a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feefc11edf0 con 0x7feefc131d70 2023-10-03T10:16:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.575+0000 7feefaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feefc09f180 0x7feefc11c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.575+0000 7feefb7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feefc09e870 0x7feefc11bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.575+0000 7feefaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feefc09f180 0x7feefc11c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49788/0 (socket says 172.21.15.146:49788) 2023-10-03T10:16:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.575+0000 7feefaffd700 1 -- 172.21.15.146:0/1796773828 learned_addr learned my addr 172.21.15.146:0/1796773828 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.575+0000 7feefb7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feefc09e870 0x7feefc11bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59574/0 (socket says 172.21.15.146:59574) 2023-10-03T10:16:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.575+0000 7feefbfff700 1 --2- 172.21.15.146:0/1796773828 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feefc131d70 0x7feefc11ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.576+0000 7feefaffd700 1 -- 172.21.15.146:0/1796773828 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feefc131d70 msgr2=0x7feefc11ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.576+0000 7feefaffd700 1 --2- 172.21.15.146:0/1796773828 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feefc131d70 0x7feefc11ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.576+0000 7feefaffd700 1 -- 172.21.15.146:0/1796773828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feefc09e870 msgr2=0x7feefc11bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.576+0000 7feefaffd700 1 --2- 172.21.15.146:0/1796773828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feefc09e870 0x7feefc11bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.576+0000 7feefaffd700 1 -- 172.21.15.146:0/1796773828 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec0094a0 con 0x7feefc09f180 2023-10-03T10:16:31.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.576+0000 7feefb7fe700 1 --2- 172.21.15.146:0/1796773828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feefc09e870 0x7feefc11bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:31.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.576+0000 7feefaffd700 1 --2- 172.21.15.146:0/1796773828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feefc09f180 0x7feefc11c4d0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7feef000e9b0 tx=0x7feef000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.576+0000 7feee3fff700 1 -- 172.21.15.146:0/1796773828 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0009710 con 0x7feefc09f180 2023-10-03T10:16:31.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.576+0000 7fef01b6a700 1 -- 172.21.15.146:0/1796773828 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feefc11f7d0 con 0x7feefc09f180 2023-10-03T10:16:31.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.576+0000 7feee3fff700 1 -- 172.21.15.146:0/1796773828 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef000ee50 con 0x7feefc09f180 2023-10-03T10:16:31.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.576+0000 7feee3fff700 1 -- 172.21.15.146:0/1796773828 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef000ca70 con 0x7feefc09f180 2023-10-03T10:16:31.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.576+0000 7fef01b6a700 1 -- 172.21.15.146:0/1796773828 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feefc09dba0 con 0x7feefc09f180 2023-10-03T10:16:31.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.577+0000 7fef01b6a700 1 -- 172.21.15.146:0/1796773828 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feefc04f2a0 con 0x7feefc09f180 2023-10-03T10:16:31.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.578+0000 7feee3fff700 1 -- 172.21.15.146:0/1796773828 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feef000cbd0 con 0x7feefc09f180 2023-10-03T10:16:31.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.578+0000 7feee3fff700 1 -- 172.21.15.146:0/1796773828 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feef0047350 con 0x7feefc09f180 2023-10-03T10:16:31.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.586+0000 7feee3fff700 1 -- 172.21.15.146:0/1796773828 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feef0044060 con 0x7feefc09f180 2023-10-03T10:16:31.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.602+0000 7f0718039700 1 Processor -- start 2023-10-03T10:16:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.602+0000 7f0718039700 1 -- start start 2023-10-03T10:16:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.603+0000 7f0718039700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f071009d860 0x7f071009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.603+0000 7f0718039700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f071009e170 0x7f07101307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.603+0000 7f0718039700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071009aaa0 con 0x7f0710130ce0 2023-10-03T10:16:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.603+0000 7f0718039700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f071009f870 con 0x7f071009d860 2023-10-03T10:16:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.603+0000 7f0718039700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071009b360 con 0x7f071009e170 2023-10-03T10:16:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.603+0000 7f0715dd5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f071009d860 0x7f071009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.603+0000 7f0715dd5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f071009d860 0x7f071009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49796/0 (socket says 172.21.15.146:49796) 2023-10-03T10:16:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.603+0000 7f0715dd5700 1 -- 172.21.15.146:0/2684734997 learned_addr learned my addr 172.21.15.146:0/2684734997 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.603+0000 7f07155d4700 1 --2- 172.21.15.146:0/2684734997 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f071009e170 0x7f07101307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.603+0000 7f0715dd5700 1 -- 172.21.15.146:0/2684734997 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f071009e170 msgr2=0x7f07101307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:31.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.603+0000 7f0715dd5700 1 --2- 172.21.15.146:0/2684734997 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f071009e170 0x7f07101307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.603+0000 7f0715dd5700 1 -- 172.21.15.146:0/2684734997 >> v1:172.21.15.146:6789/0 conn(0x7f0710130ce0 legacy=0x7f07101379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.603+0000 7f0715dd5700 1 -- 172.21.15.146:0/2684734997 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071009b620 con 0x7f071009d860 2023-10-03T10:16:31.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.604+0000 7f0715dd5700 1 --2- 172.21.15.146:0/2684734997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071009d860 0x7f071009dc30 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f070c0098f0 tx=0x7f070c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24270128690a0e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.604+0000 7f0714dd3700 1 -- 172.21.15.146:0/2684734997 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c011830 con 0x7f071009d860 2023-10-03T10:16:31.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.604+0000 7f0714dd3700 1 -- 172.21.15.146:0/2684734997 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c011990 con 0x7f071009d860 2023-10-03T10:16:31.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.604+0000 7f0714dd3700 1 -- 172.21.15.146:0/2684734997 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c011d20 con 0x7f071009d860 2023-10-03T10:16:31.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.604+0000 7f0718039700 1 -- 172.21.15.146:0/2684734997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071009d860 msgr2=0x7f071009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.604+0000 7f0718039700 1 --2- 172.21.15.146:0/2684734997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071009d860 0x7f071009dc30 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f070c0098f0 tx=0x7f070c009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:31.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.604+0000 7f0718039700 1 -- 172.21.15.146:0/2684734997 shutdown_connections 2023-10-03T10:16:31.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.604+0000 7f0718039700 1 --2- 172.21.15.146:0/2684734997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071009d860 0x7f071009dc30 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.604+0000 7f0718039700 1 --2- 172.21.15.146:0/2684734997 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f071009e170 0x7f07101307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.605+0000 7f0718039700 1 -- 172.21.15.146:0/2684734997 >> 172.21.15.146:0/2684734997 conn(0x7f0710099c40 msgr2=0x7f07100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.605+0000 7f0718039700 1 -- 172.21.15.146:0/2684734997 shutdown_connections 2023-10-03T10:16:31.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.605+0000 7f0718039700 1 -- 172.21.15.146:0/2684734997 wait complete. 2023-10-03T10:16:31.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.606+0000 7f0718039700 1 Processor -- start 2023-10-03T10:16:31.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.606+0000 7f0718039700 1 -- start start 2023-10-03T10:16:31.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.606+0000 7f0718039700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071009d860 0x7f07101c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.606+0000 7f0718039700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f071009e170 0x7f07101c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.606+0000 7f0718039700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0710130ce0 0x7f07101c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.606+0000 7f0718039700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0710137bf0 con 0x7f071009d860 2023-10-03T10:16:31.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.606+0000 7f0718039700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071009c8b0 con 0x7f0710130ce0 2023-10-03T10:16:31.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.606+0000 7f0718039700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07101373c0 con 0x7f071009e170 2023-10-03T10:16:31.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.606+0000 7f0715dd5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071009d860 0x7f07101c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.606+0000 7f0715dd5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071009d860 0x7f07101c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49800/0 (socket says 172.21.15.146:49800) 2023-10-03T10:16:31.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.606+0000 7f0715dd5700 1 -- 172.21.15.146:0/273222863 learned_addr learned my addr 172.21.15.146:0/273222863 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:31.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.606+0000 7f07165d6700 1 --2- 172.21.15.146:0/273222863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0710130ce0 0x7f07101c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.606+0000 7f0715dd5700 1 -- 172.21.15.146:0/273222863 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f071009e170 msgr2=0x7f07101c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.606+0000 7f0715dd5700 1 --2- 172.21.15.146:0/273222863 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f071009e170 0x7f07101c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.606+0000 7f0715dd5700 1 -- 172.21.15.146:0/273222863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0710130ce0 msgr2=0x7f07101c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.606+0000 7f0715dd5700 1 --2- 172.21.15.146:0/273222863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0710130ce0 0x7f07101c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.606+0000 7f0715dd5700 1 -- 172.21.15.146:0/273222863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070c009550 con 0x7f071009d860 2023-10-03T10:16:31.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.607+0000 7f0715dd5700 1 --2- 172.21.15.146:0/273222863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071009d860 0x7f07101c6100 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f070c009c40 tx=0x7f070c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.607+0000 7f07067fc700 1 -- 172.21.15.146:0/273222863 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c02ba30 con 0x7f071009d860 2023-10-03T10:16:31.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.607+0000 7f0718039700 1 -- 172.21.15.146:0/273222863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07100a21b0 con 0x7f071009d860 2023-10-03T10:16:31.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.607+0000 7f07067fc700 1 -- 172.21.15.146:0/273222863 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c02bbb0 con 0x7f071009d860 2023-10-03T10:16:31.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.607+0000 7f07067fc700 1 -- 172.21.15.146:0/273222863 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c0036a0 con 0x7f071009d860 2023-10-03T10:16:31.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.607+0000 7f0718039700 1 -- 172.21.15.146:0/273222863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0710119e60 con 0x7f071009d860 2023-10-03T10:16:31.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.608+0000 7f06f3fff700 1 -- 172.21.15.146:0/273222863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ec0052e0 con 0x7f071009d860 2023-10-03T10:16:31.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.609+0000 7f07067fc700 1 -- 172.21.15.146:0/273222863 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f070c003800 con 0x7f071009d860 2023-10-03T10:16:31.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.609+0000 7f07067fc700 1 -- 172.21.15.146:0/273222863 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f070c048de0 con 0x7f071009d860 2023-10-03T10:16:31.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.616+0000 7fc4773cc700 1 Processor -- start 2023-10-03T10:16:31.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.616+0000 7fc4773cc700 1 -- start start 2023-10-03T10:16:31.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.616+0000 7fc4773cc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc470136960 0x7fc470138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.616+0000 7fc4773cc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc470139280 0x7fc47013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.616+0000 7fc4773cc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc47006b2d0 con 0x7fc470133ad0 2023-10-03T10:16:31.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.616+0000 7fc4773cc700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4701345b0 con 0x7fc470136960 2023-10-03T10:16:31.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.616+0000 7fc4773cc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc470133610 con 0x7fc470139280 2023-10-03T10:16:31.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.617+0000 7fc475969700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc470139280 0x7fc47013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.617+0000 7fc475969700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc470139280 0x7fc47013b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36488/0 (socket says 172.21.15.146:36488) 2023-10-03T10:16:31.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.617+0000 7fc475969700 1 -- 172.21.15.146:0/113096010 learned_addr learned my addr 172.21.15.146:0/113096010 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:31.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.617+0000 7fc475969700 1 -- 172.21.15.146:0/113096010 >> v2:172.21.15.146:3300/0 conn(0x7fc470136960 msgr2=0x7fc470138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:31.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.617+0000 7fc475969700 1 --2- 172.21.15.146:0/113096010 >> v2:172.21.15.146:3300/0 conn(0x7fc470136960 0x7fc470138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.617+0000 7fc475969700 1 -- 172.21.15.146:0/113096010 >> v1:172.21.15.146:6789/0 conn(0x7fc470133ad0 legacy=0x7fc470133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:31.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.617+0000 7fc475969700 1 -- 172.21.15.146:0/113096010 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47009a500 con 0x7fc470139280 2023-10-03T10:16:31.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.617+0000 7fc475969700 1 --2- 172.21.15.146:0/113096010 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc470139280 0x7fc47013b660 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc468009e50 tx=0x7fc46800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9c374d2174afc9f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.617+0000 7fc467fff700 1 -- 172.21.15.146:0/113096010 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46800e070 con 0x7fc470139280 2023-10-03T10:16:31.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.617+0000 7fc467fff700 1 -- 172.21.15.146:0/113096010 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc468003a20 con 0x7fc470139280 2023-10-03T10:16:31.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.617+0000 7fc467fff700 1 -- 172.21.15.146:0/113096010 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc468003dd0 con 0x7fc470139280 2023-10-03T10:16:31.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.618+0000 7fc4773cc700 1 -- 172.21.15.146:0/113096010 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc470139280 msgr2=0x7fc47013b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.618+0000 7fc4773cc700 1 --2- 172.21.15.146:0/113096010 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc470139280 0x7fc47013b660 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc468009e50 tx=0x7fc46800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:31.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.618+0000 7f07067fc700 1 -- 172.21.15.146:0/273222863 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f070c033390 con 0x7f071009d860 2023-10-03T10:16:31.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.618+0000 7fc4773cc700 1 -- 172.21.15.146:0/113096010 shutdown_connections 2023-10-03T10:16:31.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.618+0000 7fc4773cc700 1 --2- 172.21.15.146:0/113096010 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc470139280 0x7fc47013b660 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.618+0000 7fc4773cc700 1 --2- 172.21.15.146:0/113096010 >> v2:172.21.15.146:3300/0 conn(0x7fc470136960 0x7fc470138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.618+0000 7fc4773cc700 1 -- 172.21.15.146:0/113096010 >> 172.21.15.146:0/113096010 conn(0x7fc470099c40 msgr2=0x7fc4700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.620+0000 7fc4773cc700 1 -- 172.21.15.146:0/113096010 shutdown_connections 2023-10-03T10:16:31.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.620+0000 7fc4773cc700 1 -- 172.21.15.146:0/113096010 wait complete. 2023-10-03T10:16:31.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.621+0000 7fc4773cc700 1 Processor -- start 2023-10-03T10:16:31.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.621+0000 7fc4773cc700 1 -- start start 2023-10-03T10:16:31.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.621+0000 7fc4773cc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc470133ad0 0x7fc470071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.621+0000 7fc4773cc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc470136960 0x7fc470071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.621+0000 7fc4773cc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc470139280 0x7fc4701c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.621+0000 7fc4773cc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4700700b0 con 0x7fc470139280 2023-10-03T10:16:31.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.621+0000 7fc4773cc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4701317a0 con 0x7fc470136960 2023-10-03T10:16:31.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.621+0000 7fc4773cc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc47009f390 con 0x7fc470133ad0 2023-10-03T10:16:31.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.622+0000 7fc474967700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc470136960 0x7fc470071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.622+0000 7fc474967700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc470136960 0x7fc470071d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59606/0 (socket says 172.21.15.146:59606) 2023-10-03T10:16:31.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.622+0000 7fc474967700 1 -- 172.21.15.146:0/1317343012 learned_addr learned my addr 172.21.15.146:0/1317343012 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:31.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.622+0000 7fc475168700 1 --2- 172.21.15.146:0/1317343012 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc470133ad0 0x7fc470071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.622+0000 7fc475969700 1 --2- 172.21.15.146:0/1317343012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc470139280 0x7fc4701c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.622+0000 7fc474967700 1 -- 172.21.15.146:0/1317343012 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc470133ad0 msgr2=0x7fc470071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.622+0000 7fc474967700 1 --2- 172.21.15.146:0/1317343012 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc470133ad0 0x7fc470071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.622+0000 7fc474967700 1 -- 172.21.15.146:0/1317343012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc470139280 msgr2=0x7fc4701c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.622+0000 7fc474967700 1 --2- 172.21.15.146:0/1317343012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc470139280 0x7fc4701c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.622+0000 7fc474967700 1 -- 172.21.15.146:0/1317343012 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc468009b30 con 0x7fc470136960 2023-10-03T10:16:31.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.622+0000 7fc474967700 1 --2- 172.21.15.146:0/1317343012 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc470136960 0x7fc470071d90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc46000b530 tx=0x7fc46000b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.623+0000 7fc465ffb700 1 -- 172.21.15.146:0/1317343012 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc460011830 con 0x7fc470136960 2023-10-03T10:16:31.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.623+0000 7fc465ffb700 1 -- 172.21.15.146:0/1317343012 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc460011990 con 0x7fc470136960 2023-10-03T10:16:31.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.623+0000 7fc4773cc700 1 -- 172.21.15.146:0/1317343012 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47006f3b0 con 0x7fc470136960 2023-10-03T10:16:31.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.623+0000 7fc465ffb700 1 -- 172.21.15.146:0/1317343012 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc460011d40 con 0x7fc470136960 2023-10-03T10:16:31.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.623+0000 7fc4773cc700 1 -- 172.21.15.146:0/1317343012 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc470070de0 con 0x7fc470136960 2023-10-03T10:16:31.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.624+0000 7fc465ffb700 1 -- 172.21.15.146:0/1317343012 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc46001a400 con 0x7fc470136960 2023-10-03T10:16:31.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.624+0000 7fc465ffb700 1 -- 172.21.15.146:0/1317343012 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc46003f7e0 con 0x7fc470136960 2023-10-03T10:16:31.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.625+0000 7fc4773cc700 1 -- 172.21.15.146:0/1317343012 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47004f2a0 con 0x7fc470136960 2023-10-03T10:16:31.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.629+0000 7fc465ffb700 1 -- 172.21.15.146:0/1317343012 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc460015020 con 0x7fc470136960 2023-10-03T10:16:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.652+0000 7fb9545d9700 1 Processor -- start 2023-10-03T10:16:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.652+0000 7fb9545d9700 1 -- start start 2023-10-03T10:16:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.653+0000 7fb9545d9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb94c0a0a70 0x7fb94c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.653+0000 7fb9545d9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb94c0a1380 0x7fb94c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.653+0000 7fb9545d9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb94c133f50 0x7fb94c1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.653+0000 7fb9545d9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb94c09e9d0 con 0x7fb94c133f50 2023-10-03T10:16:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.653+0000 7fb9545d9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c09dc00 con 0x7fb94c0a1380 2023-10-03T10:16:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.653+0000 7fb9545d9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c09dec0 con 0x7fb94c0a0a70 2023-10-03T10:16:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.653+0000 7fb952375700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb94c0a0a70 0x7fb94c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.653+0000 7fb952375700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb94c0a0a70 0x7fb94c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36514/0 (socket says 172.21.15.146:36514) 2023-10-03T10:16:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.653+0000 7fb952375700 1 -- 172.21.15.146:0/48269262 learned_addr learned my addr 172.21.15.146:0/48269262 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.653+0000 7fb951b74700 1 --2- 172.21.15.146:0/48269262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb94c0a1380 0x7fb94c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.653+0000 7fb952b76700 1 --2- 172.21.15.146:0/48269262 >> v2:172.21.15.146:3300/0 conn(0x7fb94c133f50 0x7fb94c1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.653+0000 7fb952375700 1 -- 172.21.15.146:0/48269262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb94c0a1380 msgr2=0x7fb94c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.653+0000 7fb952375700 1 --2- 172.21.15.146:0/48269262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb94c0a1380 0x7fb94c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.653+0000 7fb952375700 1 -- 172.21.15.146:0/48269262 >> v2:172.21.15.146:3300/0 conn(0x7fb94c133f50 msgr2=0x7fb94c1343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.653+0000 7fb952375700 1 --2- 172.21.15.146:0/48269262 >> v2:172.21.15.146:3300/0 conn(0x7fb94c133f50 0x7fb94c1343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.653+0000 7fb952375700 1 -- 172.21.15.146:0/48269262 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c09e6a0 con 0x7fb94c0a0a70 2023-10-03T10:16:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.653+0000 7fb951b74700 1 --2- 172.21.15.146:0/48269262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb94c0a1380 0x7fb94c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.653+0000 7fb952375700 1 --2- 172.21.15.146:0/48269262 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb94c0a0a70 0x7fb94c0a0e40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb9480098f0 tx=0x7fb948009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5f7a7b6946c4a38 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.654+0000 7fb951373700 1 -- 172.21.15.146:0/48269262 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb948011830 con 0x7fb94c0a0a70 2023-10-03T10:16:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.654+0000 7fb951373700 1 -- 172.21.15.146:0/48269262 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb948011990 con 0x7fb94c0a0a70 2023-10-03T10:16:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.654+0000 7fb951373700 1 -- 172.21.15.146:0/48269262 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb948011d20 con 0x7fb94c0a0a70 2023-10-03T10:16:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.655+0000 7fb9545d9700 1 -- 172.21.15.146:0/48269262 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb94c0a0a70 msgr2=0x7fb94c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.655+0000 7fb9545d9700 1 --2- 172.21.15.146:0/48269262 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb94c0a0a70 0x7fb94c0a0e40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb9480098f0 tx=0x7fb948009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.655+0000 7fb9545d9700 1 -- 172.21.15.146:0/48269262 shutdown_connections 2023-10-03T10:16:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.655+0000 7fb9545d9700 1 --2- 172.21.15.146:0/48269262 >> v2:172.21.15.146:3300/0 conn(0x7fb94c133f50 0x7fb94c1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.655+0000 7fb9545d9700 1 --2- 172.21.15.146:0/48269262 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb94c0a0a70 0x7fb94c0a0e40 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.655+0000 7fb9545d9700 1 --2- 172.21.15.146:0/48269262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb94c0a1380 0x7fb94c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.655+0000 7fb9545d9700 1 -- 172.21.15.146:0/48269262 >> 172.21.15.146:0/48269262 conn(0x7fb94c0a6610 msgr2=0x7fb94c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.655+0000 7fb9545d9700 1 -- 172.21.15.146:0/48269262 shutdown_connections 2023-10-03T10:16:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.655+0000 7fb9545d9700 1 -- 172.21.15.146:0/48269262 wait complete. 2023-10-03T10:16:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.656+0000 7fb9545d9700 1 Processor -- start 2023-10-03T10:16:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.656+0000 7fb9545d9700 1 -- start start 2023-10-03T10:16:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.657+0000 7fb9545d9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb94c0a0a70 0x7fb94c1c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.657+0000 7fb9545d9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb94c0a1380 0x7fb94c1c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.657+0000 7fb9545d9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb94c133f50 0x7fb94c1c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.657+0000 7fb9545d9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c1208e0 con 0x7fb94c0a0a70 2023-10-03T10:16:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.657+0000 7fb9545d9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c1206f0 con 0x7fb94c133f50 2023-10-03T10:16:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.657+0000 7fb9545d9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c120fc0 con 0x7fb94c0a1380 2023-10-03T10:16:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.657+0000 7fb952b76700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb94c133f50 0x7fb94c1c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.657+0000 7fb952b76700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb94c133f50 0x7fb94c1c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59612/0 (socket says 172.21.15.146:59612) 2023-10-03T10:16:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.657+0000 7fb952b76700 1 -- 172.21.15.146:0/1571946313 learned_addr learned my addr 172.21.15.146:0/1571946313 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.657+0000 7fb951b74700 1 --2- 172.21.15.146:0/1571946313 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb94c0a1380 0x7fb94c1c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.657+0000 7fb952375700 1 --2- 172.21.15.146:0/1571946313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb94c0a0a70 0x7fb94c1c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.657+0000 7fb952b76700 1 -- 172.21.15.146:0/1571946313 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb94c0a1380 msgr2=0x7fb94c1c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.657+0000 7fb952b76700 1 --2- 172.21.15.146:0/1571946313 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb94c0a1380 0x7fb94c1c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.657+0000 7fb952b76700 1 -- 172.21.15.146:0/1571946313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb94c0a0a70 msgr2=0x7fb94c1c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.657+0000 7fb952b76700 1 --2- 172.21.15.146:0/1571946313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb94c0a0a70 0x7fb94c1c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.657+0000 7fb952b76700 1 -- 172.21.15.146:0/1571946313 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb948009550 con 0x7fb94c133f50 2023-10-03T10:16:31.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.658+0000 7fb952375700 1 --2- 172.21.15.146:0/1571946313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb94c0a0a70 0x7fb94c1c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:31.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.658+0000 7fb951b74700 1 --2- 172.21.15.146:0/1571946313 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb94c0a1380 0x7fb94c1c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:31.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.658+0000 7fb952b76700 1 --2- 172.21.15.146:0/1571946313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb94c133f50 0x7fb94c1c8b50 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb94400efc0 tx=0x7fb94400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.658+0000 7fb942ffd700 1 -- 172.21.15.146:0/1571946313 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb944009ea0 con 0x7fb94c133f50 2023-10-03T10:16:31.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.658+0000 7fb942ffd700 1 -- 172.21.15.146:0/1571946313 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94400f040 con 0x7fb94c133f50 2023-10-03T10:16:31.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.658+0000 7fb942ffd700 1 -- 172.21.15.146:0/1571946313 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94400ced0 con 0x7fb94c133f50 2023-10-03T10:16:31.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.658+0000 7fb9545d9700 1 -- 172.21.15.146:0/1571946313 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb94c121db0 con 0x7fb94c133f50 2023-10-03T10:16:31.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.658+0000 7fb9545d9700 1 -- 172.21.15.146:0/1571946313 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94c122320 con 0x7fb94c133f50 2023-10-03T10:16:31.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.659+0000 7fb942ffd700 1 -- 172.21.15.146:0/1571946313 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb944014480 con 0x7fb94c133f50 2023-10-03T10:16:31.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.659+0000 7fb9545d9700 1 -- 172.21.15.146:0/1571946313 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94c121fa0 con 0x7fb94c133f50 2023-10-03T10:16:31.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.659+0000 7fb942ffd700 1 -- 172.21.15.146:0/1571946313 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb944040160 con 0x7fb94c133f50 2023-10-03T10:16:31.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.664+0000 7fb942ffd700 1 -- 172.21.15.146:0/1571946313 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb944007920 con 0x7fb94c133f50 2023-10-03T10:16:31.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.804+0000 7fef01b6a700 1 -- 172.21.15.146:0/1796773828 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7feefc06b2a0 con 0x7feefc09f180 2023-10-03T10:16:31.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.804+0000 7feee3fff700 1 -- 172.21.15.146:0/1796773828 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7feef0017020 con 0x7feefc09f180 2023-10-03T10:16:31.805 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:31.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.807+0000 7fef01b6a700 1 -- 172.21.15.146:0/1796773828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feefc09f180 msgr2=0x7feefc11c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.807+0000 7fef01b6a700 1 --2- 172.21.15.146:0/1796773828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feefc09f180 0x7feefc11c4d0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7feef000e9b0 tx=0x7feef000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.807+0000 7fef01b6a700 1 -- 172.21.15.146:0/1796773828 shutdown_connections 2023-10-03T10:16:31.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.807+0000 7fef01b6a700 1 --2- 172.21.15.146:0/1796773828 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feefc131d70 0x7feefc11ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.807+0000 7fef01b6a700 1 --2- 172.21.15.146:0/1796773828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feefc09e870 0x7feefc11bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.807+0000 7fef01b6a700 1 --2- 172.21.15.146:0/1796773828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feefc09f180 0x7feefc11c4d0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.807+0000 7fef01b6a700 1 -- 172.21.15.146:0/1796773828 >> 172.21.15.146:0/1796773828 conn(0x7feefc0a4430 msgr2=0x7feefc130f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.808+0000 7fef01b6a700 1 -- 172.21.15.146:0/1796773828 shutdown_connections 2023-10-03T10:16:31.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.808+0000 7fef01b6a700 1 -- 172.21.15.146:0/1796773828 wait complete. 2023-10-03T10:16:31.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.814+0000 7f06f3fff700 1 -- 172.21.15.146:0/273222863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f06ec005590 con 0x7f071009d860 2023-10-03T10:16:31.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.815+0000 7f07067fc700 1 -- 172.21.15.146:0/273222863 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f070c015030 con 0x7f071009d860 2023-10-03T10:16:31.815 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.817+0000 7f06f3fff700 1 -- 172.21.15.146:0/273222863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071009d860 msgr2=0x7f07101c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.817+0000 7f06f3fff700 1 --2- 172.21.15.146:0/273222863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071009d860 0x7f07101c6100 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f070c009c40 tx=0x7f070c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.818+0000 7f06f3fff700 1 -- 172.21.15.146:0/273222863 shutdown_connections 2023-10-03T10:16:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.818+0000 7f06f3fff700 1 --2- 172.21.15.146:0/273222863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0710130ce0 0x7f07101c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.818+0000 7f06f3fff700 1 --2- 172.21.15.146:0/273222863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071009d860 0x7f07101c6100 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.818+0000 7f06f3fff700 1 --2- 172.21.15.146:0/273222863 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f071009e170 0x7f07101c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.818+0000 7f06f3fff700 1 -- 172.21.15.146:0/273222863 >> 172.21.15.146:0/273222863 conn(0x7f0710099c40 msgr2=0x7f07100a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.818+0000 7f06f3fff700 1 -- 172.21.15.146:0/273222863 shutdown_connections 2023-10-03T10:16:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.818+0000 7f06f3fff700 1 -- 172.21.15.146:0/273222863 wait complete. 2023-10-03T10:16:31.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:31.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.830+0000 7fc4773cc700 1 -- 172.21.15.146:0/1317343012 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc47009f0f0 con 0x7fc470136960 2023-10-03T10:16:31.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:31.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.830+0000 7fc465ffb700 1 -- 172.21.15.146:0/1317343012 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc46000f8d0 con 0x7fc470136960 2023-10-03T10:16:31.831 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:31.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.832+0000 7fc4773cc700 1 -- 172.21.15.146:0/1317343012 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc470136960 msgr2=0x7fc470071d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.832+0000 7fc4773cc700 1 --2- 172.21.15.146:0/1317343012 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc470136960 0x7fc470071d90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc46000b530 tx=0x7fc46000b840 comp rx=0 tx=0).stop 2023-10-03T10:16:31.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.832+0000 7fc4773cc700 1 -- 172.21.15.146:0/1317343012 shutdown_connections 2023-10-03T10:16:31.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.832+0000 7fc4773cc700 1 --2- 172.21.15.146:0/1317343012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc470139280 0x7fc4701c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.832+0000 7fc4773cc700 1 --2- 172.21.15.146:0/1317343012 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc470133ad0 0x7fc470071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.832+0000 7fc4773cc700 1 --2- 172.21.15.146:0/1317343012 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc470136960 0x7fc470071d90 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.832+0000 7fc4773cc700 1 -- 172.21.15.146:0/1317343012 >> 172.21.15.146:0/1317343012 conn(0x7fc470099c40 msgr2=0x7fc4701371c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.832+0000 7fc4773cc700 1 -- 172.21.15.146:0/1317343012 shutdown_connections 2023-10-03T10:16:31.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.832+0000 7fc4773cc700 1 -- 172.21.15.146:0/1317343012 wait complete. 2023-10-03T10:16:31.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:31.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.860+0000 7fb9545d9700 1 -- 172.21.15.146:0/1571946313 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb94c04f2a0 con 0x7fb94c133f50 2023-10-03T10:16:31.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.860+0000 7fb942ffd700 1 -- 172.21.15.146:0/1571946313 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb944007330 con 0x7fb94c133f50 2023-10-03T10:16:31.861 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:31.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.862+0000 7fb9545d9700 1 -- 172.21.15.146:0/1571946313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb94c133f50 msgr2=0x7fb94c1c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.862+0000 7fb9545d9700 1 --2- 172.21.15.146:0/1571946313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb94c133f50 0x7fb94c1c8b50 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb94400efc0 tx=0x7fb94400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.862+0000 7fb9545d9700 1 -- 172.21.15.146:0/1571946313 shutdown_connections 2023-10-03T10:16:31.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.863+0000 7fb9545d9700 1 --2- 172.21.15.146:0/1571946313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb94c133f50 0x7fb94c1c8b50 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.863+0000 7fb9545d9700 1 --2- 172.21.15.146:0/1571946313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb94c0a0a70 0x7fb94c1c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.863+0000 7fb9545d9700 1 --2- 172.21.15.146:0/1571946313 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb94c0a1380 0x7fb94c1c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.863+0000 7fb9545d9700 1 -- 172.21.15.146:0/1571946313 >> 172.21.15.146:0/1571946313 conn(0x7fb94c0a6610 msgr2=0x7fb94c1bbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.863+0000 7fb9545d9700 1 -- 172.21.15.146:0/1571946313 shutdown_connections 2023-10-03T10:16:31.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:31.863+0000 7fb9545d9700 1 -- 172.21.15.146:0/1571946313 wait complete. 2023-10-03T10:16:31.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:32.822 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:32.832 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:32.845 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:32.876 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:32.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.968+0000 7fa972ce4700 1 Processor -- start 2023-10-03T10:16:32.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.968+0000 7fa972ce4700 1 -- start start 2023-10-03T10:16:32.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.968+0000 7fa972ce4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa96c09d860 0x7fa96c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.968+0000 7fa972ce4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa96c09e170 0x7fa96c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.968+0000 7fa972ce4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa96c09aaa0 con 0x7fa96c130ce0 2023-10-03T10:16:32.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.968+0000 7fa972ce4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa96c09f870 con 0x7fa96c09e170 2023-10-03T10:16:32.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.968+0000 7fa972ce4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c09b360 con 0x7fa96c09d860 2023-10-03T10:16:32.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.968+0000 7fa971281700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa96c130ce0 0x7fa96c1379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:47294/0 (socket says 172.21.15.146:47294) 2023-10-03T10:16:32.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.968+0000 7fa96bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa96c09e170 0x7fa96c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.968+0000 7fa971281700 1 -- 172.21.15.146:0/361203101 learned_addr learned my addr 172.21.15.146:0/361203101 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:32.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.968+0000 7fa970a80700 1 --2- 172.21.15.146:0/361203101 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa96c09d860 0x7fa96c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.969+0000 7fa96bfff700 1 -- 172.21.15.146:0/361203101 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa96c09d860 msgr2=0x7fa96c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:32.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.969+0000 7fa96bfff700 1 --2- 172.21.15.146:0/361203101 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa96c09d860 0x7fa96c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.969+0000 7fa96bfff700 1 -- 172.21.15.146:0/361203101 >> v1:172.21.15.146:6789/0 conn(0x7fa96c130ce0 legacy=0x7fa96c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.969+0000 7fa96bfff700 1 -- 172.21.15.146:0/361203101 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96c09b620 con 0x7fa96c09e170 2023-10-03T10:16:32.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.969+0000 7fa96bfff700 1 --2- 172.21.15.146:0/361203101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa96c09e170 0x7fa96c1307a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fa958009840 tx=0x7fa958009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493e6e5b1e85c908 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.969+0000 7fa96b7fe700 1 -- 172.21.15.146:0/361203101 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa958011830 con 0x7fa96c09e170 2023-10-03T10:16:32.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.969+0000 7fa96b7fe700 1 -- 172.21.15.146:0/361203101 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa958011990 con 0x7fa96c09e170 2023-10-03T10:16:32.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.969+0000 7fa96b7fe700 1 -- 172.21.15.146:0/361203101 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa958011d20 con 0x7fa96c09e170 2023-10-03T10:16:32.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.970+0000 7fa972ce4700 1 -- 172.21.15.146:0/361203101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa96c09e170 msgr2=0x7fa96c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.970+0000 7fa972ce4700 1 --2- 172.21.15.146:0/361203101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa96c09e170 0x7fa96c1307a0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fa958009840 tx=0x7fa958009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:32.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.970+0000 7fa972ce4700 1 -- 172.21.15.146:0/361203101 shutdown_connections 2023-10-03T10:16:32.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.970+0000 7fa972ce4700 1 --2- 172.21.15.146:0/361203101 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa96c09d860 0x7fa96c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.970+0000 7fa972ce4700 1 --2- 172.21.15.146:0/361203101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa96c09e170 0x7fa96c1307a0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.970+0000 7fa972ce4700 1 -- 172.21.15.146:0/361203101 >> 172.21.15.146:0/361203101 conn(0x7fa96c099c40 msgr2=0x7fa96c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.970+0000 7fa972ce4700 1 -- 172.21.15.146:0/361203101 shutdown_connections 2023-10-03T10:16:32.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.970+0000 7fa972ce4700 1 -- 172.21.15.146:0/361203101 wait complete. 2023-10-03T10:16:32.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.971+0000 7fa972ce4700 1 Processor -- start 2023-10-03T10:16:32.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.971+0000 7fa972ce4700 1 -- start start 2023-10-03T10:16:32.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.971+0000 7fa972ce4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa96c09d860 0x7fa96c138140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.971+0000 7fa972ce4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa96c09e170 0x7fa96c138680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.971+0000 7fa972ce4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa96c130ce0 0x7fa96c1c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.971+0000 7fa972ce4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c13b5c0 con 0x7fa96c09e170 2023-10-03T10:16:32.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.971+0000 7fa972ce4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c13bd60 con 0x7fa96c130ce0 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.971+0000 7fa972ce4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c136b10 con 0x7fa96c09d860 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.972+0000 7fa970a80700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa96c09d860 0x7fa96c138140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.972+0000 7fa970a80700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa96c09d860 0x7fa96c138140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:36540/0 (socket says 172.21.15.146:36540) 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.972+0000 7fa970a80700 1 -- 172.21.15.146:0/4290112885 learned_addr learned my addr 172.21.15.146:0/4290112885 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.972+0000 7fa96bfff700 1 --2- 172.21.15.146:0/4290112885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa96c09e170 0x7fa96c138680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.972+0000 7fa971281700 1 --2- 172.21.15.146:0/4290112885 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa96c130ce0 0x7fa96c1c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.972+0000 7fa96bfff700 1 -- 172.21.15.146:0/4290112885 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa96c09d860 msgr2=0x7fa96c138140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.972+0000 7fa96bfff700 1 --2- 172.21.15.146:0/4290112885 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa96c09d860 0x7fa96c138140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.972+0000 7fa96bfff700 1 -- 172.21.15.146:0/4290112885 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa96c130ce0 msgr2=0x7fa96c1c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.972+0000 7fa96bfff700 1 --2- 172.21.15.146:0/4290112885 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa96c130ce0 0x7fa96c1c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.972+0000 7fa96bfff700 1 -- 172.21.15.146:0/4290112885 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9580094a0 con 0x7fa96c09e170 2023-10-03T10:16:32.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.972+0000 7fa970a80700 1 --2- 172.21.15.146:0/4290112885 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa96c09d860 0x7fa96c138140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.972+0000 7fa971281700 1 --2- 172.21.15.146:0/4290112885 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa96c130ce0 0x7fa96c1c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.972+0000 7fa96bfff700 1 --2- 172.21.15.146:0/4290112885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa96c09e170 0x7fa96c138680 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fa958016000 tx=0x7fa958004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.972+0000 7fa9697fa700 1 -- 172.21.15.146:0/4290112885 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa958004400 con 0x7fa96c09e170 2023-10-03T10:16:32.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.973+0000 7fa9697fa700 1 -- 172.21.15.146:0/4290112885 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95801f070 con 0x7fa96c09e170 2023-10-03T10:16:32.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.973+0000 7fa972ce4700 1 -- 172.21.15.146:0/4290112885 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa96c137190 con 0x7fa96c09e170 2023-10-03T10:16:32.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.973+0000 7fa9697fa700 1 -- 172.21.15.146:0/4290112885 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9580038a0 con 0x7fa96c09e170 2023-10-03T10:16:32.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.973+0000 7fa972ce4700 1 -- 172.21.15.146:0/4290112885 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa96c135710 con 0x7fa96c09e170 2023-10-03T10:16:32.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.973+0000 7fa9697fa700 1 -- 172.21.15.146:0/4290112885 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa958021030 con 0x7fa96c09e170 2023-10-03T10:16:32.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.974+0000 7fa972ce4700 1 -- 172.21.15.146:0/4290112885 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa96c04f2a0 con 0x7fa96c09e170 2023-10-03T10:16:32.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.974+0000 7fa9697fa700 1 -- 172.21.15.146:0/4290112885 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa958040b60 con 0x7fa96c09e170 2023-10-03T10:16:32.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:32.983+0000 7fa9697fa700 1 -- 172.21.15.146:0/4290112885 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa958022970 con 0x7fa96c09e170 2023-10-03T10:16:33.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.004+0000 7fcffcf51700 1 Processor -- start 2023-10-03T10:16:33.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.004+0000 7ff8e0b3f700 1 Processor -- start 2023-10-03T10:16:33.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.004+0000 7fcffcf51700 1 -- start start 2023-10-03T10:16:33.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.004+0000 7fcffcf51700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcff809e870 0x7fcff809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.004+0000 7fcffcf51700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcff809f180 0x7fcff8131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.004+0000 7fcffcf51700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcff8131d70 0x7fcff8132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.004+0000 7fcffcf51700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff80a0920 con 0x7fcff809f180 2023-10-03T10:16:33.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.005+0000 7fcffcf51700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff809c970 con 0x7fcff809e870 2023-10-03T10:16:33.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.005+0000 7fcffcf51700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcff809bab0 con 0x7fcff8131d70 2023-10-03T10:16:33.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.004+0000 7ff8e0b3f700 1 -- start start 2023-10-03T10:16:33.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.005+0000 7ff8e0b3f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff8dc0a0a30 0x7ff8dc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.005+0000 7ff8e0b3f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8dc0a1340 0x7ff8dc12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.005+0000 7ff8e0b3f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8dc0a1e70 con 0x7ff8dc066410 2023-10-03T10:16:33.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.005+0000 7ff8e0b3f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8dc09a720 con 0x7ff8dc0a0a30 2023-10-03T10:16:33.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.005+0000 7ff8e0b3f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc09b300 con 0x7ff8dc0a1340 2023-10-03T10:16:33.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.005+0000 7fcff5d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcff809f180 0x7fcff8131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.005+0000 7fcff5d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcff809f180 0x7fcff8131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49876/0 (socket says 172.21.15.146:49876) 2023-10-03T10:16:33.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.005+0000 7fcff5d9b700 1 -- 172.21.15.146:0/206289231 learned_addr learned my addr 172.21.15.146:0/206289231 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:33.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.005+0000 7fcff6d9d700 1 --2- 172.21.15.146:0/206289231 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcff8131d70 0x7fcff8132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.005+0000 7ff8da59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff8dc0a0a30 0x7ff8dc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.005+0000 7ff8da59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff8dc0a0a30 0x7ff8dc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49880/0 (socket says 172.21.15.146:49880) 2023-10-03T10:16:33.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.005+0000 7ff8da59c700 1 -- 172.21.15.146:0/3853191684 learned_addr learned my addr 172.21.15.146:0/3853191684 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:33.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.005+0000 7ff8d9d9b700 1 --2- 172.21.15.146:0/3853191684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8dc0a1340 0x7ff8dc12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.005+0000 7fcff6d9d700 1 -- 172.21.15.146:0/206289231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcff809e870 msgr2=0x7fcff809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:33.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.005+0000 7fcff6d9d700 1 --2- 172.21.15.146:0/206289231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcff809e870 0x7fcff809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.005+0000 7fcff6d9d700 1 -- 172.21.15.146:0/206289231 >> v2:172.21.15.146:3300/0 conn(0x7fcff809f180 msgr2=0x7fcff8131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:33.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.005+0000 7fcff6d9d700 1 --2- 172.21.15.146:0/206289231 >> v2:172.21.15.146:3300/0 conn(0x7fcff809f180 0x7fcff8131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.005+0000 7fcff6d9d700 1 -- 172.21.15.146:0/206289231 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff809f9c0 con 0x7fcff8131d70 2023-10-03T10:16:33.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.005+0000 7fcff6d9d700 1 --2- 172.21.15.146:0/206289231 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcff8131d70 0x7fcff8132210 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcff0009d90 tx=0x7fcff000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=979aa68af5efac3b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.006+0000 7ff8d959a700 1 -- 172.21.15.146:0/3853191684 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669930541 0 0) 0x7ff8dc0a1e70 con 0x7ff8dc066410 2023-10-03T10:16:33.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.006+0000 7ff8d959a700 1 -- 172.21.15.146:0/3853191684 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8c40057c0 con 0x7ff8dc066410 2023-10-03T10:16:33.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.006+0000 7ff8d9d9b700 1 -- 172.21.15.146:0/3853191684 >> v2:172.21.15.146:3300/0 conn(0x7ff8dc0a0a30 msgr2=0x7ff8dc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:33.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.006+0000 7ff8d9d9b700 1 --2- 172.21.15.146:0/3853191684 >> v2:172.21.15.146:3300/0 conn(0x7ff8dc0a0a30 0x7ff8dc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.006+0000 7ff8d9d9b700 1 -- 172.21.15.146:0/3853191684 >> v1:172.21.15.146:6789/0 conn(0x7ff8dc066410 legacy=0x7ff8dc1304a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.006+0000 7ff8d9d9b700 1 -- 172.21.15.146:0/3853191684 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc09abc0 con 0x7ff8dc0a1340 2023-10-03T10:16:33.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.006+0000 7fcff559a700 1 -- 172.21.15.146:0/206289231 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff000e070 con 0x7fcff8131d70 2023-10-03T10:16:33.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.006+0000 7fcff559a700 1 -- 172.21.15.146:0/206289231 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff000bb20 con 0x7fcff8131d70 2023-10-03T10:16:33.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.006+0000 7fcff559a700 1 -- 172.21.15.146:0/206289231 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff0012430 con 0x7fcff8131d70 2023-10-03T10:16:33.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.006+0000 7ff8d9d9b700 1 --2- 172.21.15.146:0/3853191684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8dc0a1340 0x7ff8dc12ff60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009840 tx=0x7ff8d0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6b6eacdab0d46d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.006+0000 7ff8d959a700 1 -- 172.21.15.146:0/3853191684 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0004230 con 0x7ff8dc0a1340 2023-10-03T10:16:33.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.006+0000 7ff8d959a700 1 -- 172.21.15.146:0/3853191684 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d0004390 con 0x7ff8dc0a1340 2023-10-03T10:16:33.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.006+0000 7ff8d959a700 1 -- 172.21.15.146:0/3853191684 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00036a0 con 0x7ff8dc0a1340 2023-10-03T10:16:33.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.007+0000 7fcffcf51700 1 -- 172.21.15.146:0/206289231 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcff8131d70 msgr2=0x7fcff8132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.007+0000 7fcffcf51700 1 --2- 172.21.15.146:0/206289231 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcff8131d70 0x7fcff8132210 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcff0009d90 tx=0x7fcff000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:33.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.007+0000 7fcffcf51700 1 -- 172.21.15.146:0/206289231 shutdown_connections 2023-10-03T10:16:33.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.007+0000 7fcffcf51700 1 --2- 172.21.15.146:0/206289231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcff809e870 0x7fcff809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.007+0000 7fcffcf51700 1 --2- 172.21.15.146:0/206289231 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcff8131d70 0x7fcff8132210 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.007+0000 7fcffcf51700 1 --2- 172.21.15.146:0/206289231 >> v2:172.21.15.146:3300/0 conn(0x7fcff809f180 0x7fcff8131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.007+0000 7fcffcf51700 1 -- 172.21.15.146:0/206289231 >> 172.21.15.146:0/206289231 conn(0x7fcff80a4430 msgr2=0x7fcff80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.007+0000 7fcffcf51700 1 -- 172.21.15.146:0/206289231 shutdown_connections 2023-10-03T10:16:33.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.007+0000 7fcffcf51700 1 -- 172.21.15.146:0/206289231 wait complete. 2023-10-03T10:16:33.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.007+0000 7ff8e0b3f700 1 -- 172.21.15.146:0/3853191684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8dc0a1340 msgr2=0x7ff8dc12ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.007+0000 7ff8e0b3f700 1 --2- 172.21.15.146:0/3853191684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8dc0a1340 0x7ff8dc12ff60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009840 tx=0x7ff8d0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:33.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.007+0000 7ff8e0b3f700 1 -- 172.21.15.146:0/3853191684 shutdown_connections 2023-10-03T10:16:33.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.007+0000 7ff8e0b3f700 1 --2- 172.21.15.146:0/3853191684 >> v2:172.21.15.146:3300/0 conn(0x7ff8dc0a0a30 0x7ff8dc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.007+0000 7ff8e0b3f700 1 --2- 172.21.15.146:0/3853191684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8dc0a1340 0x7ff8dc12ff60 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.007+0000 7ff8e0b3f700 1 -- 172.21.15.146:0/3853191684 >> 172.21.15.146:0/3853191684 conn(0x7ff8dc0a2980 msgr2=0x7ff8dc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.008+0000 7ff8e0b3f700 1 -- 172.21.15.146:0/3853191684 shutdown_connections 2023-10-03T10:16:33.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.008+0000 7ff8e0b3f700 1 -- 172.21.15.146:0/3853191684 wait complete. 2023-10-03T10:16:33.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.008+0000 7fcffcf51700 1 Processor -- start 2023-10-03T10:16:33.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.008+0000 7fcffcf51700 1 -- start start 2023-10-03T10:16:33.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.008+0000 7fcffcf51700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcff809e870 0x7fcff806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.008+0000 7fcffcf51700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcff809f180 0x7fcff806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.008+0000 7fcffcf51700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff8131d70 0x7fcff806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.008+0000 7fcffcf51700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff806d640 con 0x7fcff8131d70 2023-10-03T10:16:33.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.008+0000 7fcffcf51700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff809b160 con 0x7fcff809e870 2023-10-03T10:16:33.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.008+0000 7fcffcf51700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcff8125fa0 con 0x7fcff809f180 2023-10-03T10:16:33.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.009+0000 7fcff659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcff809e870 0x7fcff806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.009+0000 7fcff659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcff809e870 0x7fcff806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59644/0 (socket says 172.21.15.146:59644) 2023-10-03T10:16:33.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.009+0000 7fcff659c700 1 -- 172.21.15.146:0/3047942402 learned_addr learned my addr 172.21.15.146:0/3047942402 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:33.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.009+0000 7fcff5d9b700 1 --2- 172.21.15.146:0/3047942402 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcff809f180 0x7fcff806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.009+0000 7fcff6d9d700 1 --2- 172.21.15.146:0/3047942402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff8131d70 0x7fcff806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.009+0000 7ff8e0b3f700 1 Processor -- start 2023-10-03T10:16:33.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.009+0000 7fcff659c700 1 -- 172.21.15.146:0/3047942402 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcff809f180 msgr2=0x7fcff806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.009+0000 7fcff659c700 1 --2- 172.21.15.146:0/3047942402 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcff809f180 0x7fcff806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.009+0000 7fcff659c700 1 -- 172.21.15.146:0/3047942402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff8131d70 msgr2=0x7fcff806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.009+0000 7fcff659c700 1 --2- 172.21.15.146:0/3047942402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff8131d70 0x7fcff806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.009+0000 7fcff659c700 1 -- 172.21.15.146:0/3047942402 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff0009a70 con 0x7fcff809e870 2023-10-03T10:16:33.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.009+0000 7fcff659c700 1 --2- 172.21.15.146:0/3047942402 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcff809e870 0x7fcff806b8b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fcfe800b530 tx=0x7fcfe800b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.009+0000 7ff8e0b3f700 1 -- start start 2023-10-03T10:16:33.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.009+0000 7fcfe6ffd700 1 -- 172.21.15.146:0/3047942402 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8011830 con 0x7fcff809e870 2023-10-03T10:16:33.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.009+0000 7fcfe6ffd700 1 -- 172.21.15.146:0/3047942402 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe8011990 con 0x7fcff809e870 2023-10-03T10:16:33.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.009+0000 7fcffcf51700 1 -- 172.21.15.146:0/3047942402 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff80a0210 con 0x7fcff809e870 2023-10-03T10:16:33.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.010+0000 7fcffcf51700 1 -- 172.21.15.146:0/3047942402 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff8125cc0 con 0x7fcff809e870 2023-10-03T10:16:33.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.010+0000 7fcfe6ffd700 1 -- 172.21.15.146:0/3047942402 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8011d40 con 0x7fcff809e870 2023-10-03T10:16:33.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.010+0000 7ff8e0b3f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8dc066410 0x7ff8dc1c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.010+0000 7ff8e0b3f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8dc0a0a30 0x7ff8dc1c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.010+0000 7ff8e0b3f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8dc0a1340 0x7ff8dc1c05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.010+0000 7ff8e0b3f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc1a6620 con 0x7ff8dc0a1340 2023-10-03T10:16:33.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.010+0000 7ff8e0b3f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc0a0030 con 0x7ff8dc066410 2023-10-03T10:16:33.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.010+0000 7ff8e0b3f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc09ae00 con 0x7ff8dc0a0a30 2023-10-03T10:16:33.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.010+0000 7ff8dad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8dc0a1340 0x7ff8dc1c05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.010+0000 7ff8dad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8dc0a1340 0x7ff8dc1c05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49900/0 (socket says 172.21.15.146:49900) 2023-10-03T10:16:33.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.010+0000 7ff8dad9d700 1 -- 172.21.15.146:0/3390458788 learned_addr learned my addr 172.21.15.146:0/3390458788 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:33.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.010+0000 7fcfe6ffd700 1 -- 172.21.15.146:0/3047942402 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcfe801a400 con 0x7fcff809e870 2023-10-03T10:16:33.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.011+0000 7fcfe6ffd700 1 -- 172.21.15.146:0/3047942402 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcfe803f800 con 0x7fcff809e870 2023-10-03T10:16:33.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.011+0000 7ff8dad9d700 1 -- 172.21.15.146:0/3390458788 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8dc0a0a30 msgr2=0x7ff8dc1c4860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:16:33.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.011+0000 7ff8dad9d700 1 --2- 172.21.15.146:0/3390458788 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8dc0a0a30 0x7ff8dc1c4860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.011+0000 7ff8dad9d700 1 -- 172.21.15.146:0/3390458788 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8dc066410 msgr2=0x7ff8dc1c4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.011+0000 7ff8dad9d700 1 --2- 172.21.15.146:0/3390458788 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8dc066410 0x7ff8dc1c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.011+0000 7ff8dad9d700 1 -- 172.21.15.146:0/3390458788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d00094a0 con 0x7ff8dc0a1340 2023-10-03T10:16:33.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.011+0000 7ff8dad9d700 1 --2- 172.21.15.146:0/3390458788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8dc0a1340 0x7ff8dc1c05e0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4001560 tx=0x7ff8d400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.011+0000 7ff8caffd700 1 -- 172.21.15.146:0/3390458788 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4003e30 con 0x7ff8dc0a1340 2023-10-03T10:16:33.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.011+0000 7fcffcf51700 1 -- 172.21.15.146:0/3047942402 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfdc0052e0 con 0x7fcff809e870 2023-10-03T10:16:33.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.011+0000 7ff8caffd700 1 -- 172.21.15.146:0/3390458788 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d4005070 con 0x7ff8dc0a1340 2023-10-03T10:16:33.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.011+0000 7ff8caffd700 1 -- 172.21.15.146:0/3390458788 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4005420 con 0x7ff8dc0a1340 2023-10-03T10:16:33.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.011+0000 7ff8e0b3f700 1 -- 172.21.15.146:0/3390458788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8dc1a5800 con 0x7ff8dc0a1340 2023-10-03T10:16:33.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.012+0000 7ff8e0b3f700 1 -- 172.21.15.146:0/3390458788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8dc1a7dd0 con 0x7ff8dc0a1340 2023-10-03T10:16:33.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.012+0000 7ff8caffd700 1 -- 172.21.15.146:0/3390458788 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff8d4005580 con 0x7ff8dc0a1340 2023-10-03T10:16:33.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.013+0000 7ff8caffd700 1 -- 172.21.15.146:0/3390458788 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff8d403ee10 con 0x7ff8dc0a1340 2023-10-03T10:16:33.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.013+0000 7ff8e0b3f700 1 -- 172.21.15.146:0/3390458788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8dc04f2a0 con 0x7ff8dc0a1340 2023-10-03T10:16:33.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.020+0000 7fcfe6ffd700 1 -- 172.21.15.146:0/3047942402 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcfe80193b0 con 0x7fcff809e870 2023-10-03T10:16:33.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.021+0000 7ff8caffd700 1 -- 172.21.15.146:0/3390458788 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff8d4017020 con 0x7ff8dc0a1340 2023-10-03T10:16:33.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.047+0000 7fcde9410700 1 Processor -- start 2023-10-03T10:16:33.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.047+0000 7fcde9410700 1 -- start start 2023-10-03T10:16:33.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.048+0000 7fcde9410700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcde409e340 0x7fcde41359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.048+0000 7fcde9410700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcde4135f20 0x7fcde4138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.048+0000 7fcde9410700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde409aaa0 con 0x7fcde409d860 2023-10-03T10:16:33.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.048+0000 7fcde9410700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde409e730 con 0x7fcde4135f20 2023-10-03T10:16:33.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.048+0000 7fcde9410700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcde409f870 con 0x7fcde409e340 2023-10-03T10:16:33.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.048+0000 7fcde37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcde4135f20 0x7fcde4138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.048+0000 7fcde37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcde4135f20 0x7fcde4138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59656/0 (socket says 172.21.15.146:59656) 2023-10-03T10:16:33.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.048+0000 7fcde37fe700 1 -- 172.21.15.146:0/3791939125 learned_addr learned my addr 172.21.15.146:0/3791939125 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:33.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.048+0000 7fcde27fc700 1 --2- 172.21.15.146:0/3791939125 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcde409e340 0x7fcde41359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.048+0000 7fcde37fe700 1 -- 172.21.15.146:0/3791939125 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcde409e340 msgr2=0x7fcde41359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.048+0000 7fcde37fe700 1 --2- 172.21.15.146:0/3791939125 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcde409e340 0x7fcde41359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.048+0000 7fcde37fe700 1 -- 172.21.15.146:0/3791939125 >> v1:172.21.15.146:6789/0 conn(0x7fcde409d860 legacy=0x7fcde409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.049+0000 7fcde37fe700 1 -- 172.21.15.146:0/3791939125 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde409b360 con 0x7fcde4135f20 2023-10-03T10:16:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.049+0000 7fcde27fc700 1 --2- 172.21.15.146:0/3791939125 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcde409e340 0x7fcde41359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.049+0000 7fcde37fe700 1 --2- 172.21.15.146:0/3791939125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcde4135f20 0x7fcde4138300 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fcddc009e80 tx=0x7fcddc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b1f6344a6dfc0e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.049+0000 7fcde1ffb700 1 -- 172.21.15.146:0/3791939125 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc00e070 con 0x7fcde4135f20 2023-10-03T10:16:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.049+0000 7fcde1ffb700 1 -- 172.21.15.146:0/3791939125 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcddc00b910 con 0x7fcde4135f20 2023-10-03T10:16:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.049+0000 7fcde1ffb700 1 -- 172.21.15.146:0/3791939125 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc00bcc0 con 0x7fcde4135f20 2023-10-03T10:16:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.049+0000 7fcde9410700 1 -- 172.21.15.146:0/3791939125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcde4135f20 msgr2=0x7fcde4138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.049+0000 7fcde9410700 1 --2- 172.21.15.146:0/3791939125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcde4135f20 0x7fcde4138300 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fcddc009e80 tx=0x7fcddc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:33.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.050+0000 7fcde9410700 1 -- 172.21.15.146:0/3791939125 shutdown_connections 2023-10-03T10:16:33.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.050+0000 7fcde9410700 1 --2- 172.21.15.146:0/3791939125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcde4135f20 0x7fcde4138300 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.050+0000 7fcde9410700 1 --2- 172.21.15.146:0/3791939125 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcde409e340 0x7fcde41359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.050+0000 7fcde9410700 1 -- 172.21.15.146:0/3791939125 >> 172.21.15.146:0/3791939125 conn(0x7fcde4099c40 msgr2=0x7fcde40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.050+0000 7fcde9410700 1 -- 172.21.15.146:0/3791939125 shutdown_connections 2023-10-03T10:16:33.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.050+0000 7fcde9410700 1 -- 172.21.15.146:0/3791939125 wait complete. 2023-10-03T10:16:33.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.051+0000 7fcde9410700 1 Processor -- start 2023-10-03T10:16:33.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.051+0000 7fcde9410700 1 -- start start 2023-10-03T10:16:33.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.052+0000 7fcde9410700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcde409d860 0x7fcde411b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.052+0000 7fcde9410700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcde409e340 0x7fcde411bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.052+0000 7fcde9410700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcde4135f20 0x7fcde411c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.052+0000 7fcde9410700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde411e870 con 0x7fcde4135f20 2023-10-03T10:16:33.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.052+0000 7fcde9410700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde411d9f0 con 0x7fcde409d860 2023-10-03T10:16:33.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.052+0000 7fcde9410700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcde409c8b0 con 0x7fcde409e340 2023-10-03T10:16:33.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.052+0000 7fcde2ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcde409d860 0x7fcde411b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.052+0000 7fcde2ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcde409d860 0x7fcde411b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:59666/0 (socket says 172.21.15.146:59666) 2023-10-03T10:16:33.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.052+0000 7fcde2ffd700 1 -- 172.21.15.146:0/48879753 learned_addr learned my addr 172.21.15.146:0/48879753 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:33.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.052+0000 7fcde27fc700 1 --2- 172.21.15.146:0/48879753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcde409e340 0x7fcde411bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.052+0000 7fcde37fe700 1 --2- 172.21.15.146:0/48879753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcde4135f20 0x7fcde411c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.052+0000 7fcde27fc700 1 -- 172.21.15.146:0/48879753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcde409d860 msgr2=0x7fcde411b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.052+0000 7fcde27fc700 1 --2- 172.21.15.146:0/48879753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcde409d860 0x7fcde411b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.052+0000 7fcde27fc700 1 -- 172.21.15.146:0/48879753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcde4135f20 msgr2=0x7fcde411c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.052+0000 7fcde27fc700 1 --2- 172.21.15.146:0/48879753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcde4135f20 0x7fcde411c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.052+0000 7fcde27fc700 1 -- 172.21.15.146:0/48879753 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd80094a0 con 0x7fcde409e340 2023-10-03T10:16:33.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.053+0000 7fcde27fc700 1 --2- 172.21.15.146:0/48879753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcde409e340 0x7fcde411bb50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800e9b0 tx=0x7fcdd800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.053+0000 7fcdcb7fe700 1 -- 172.21.15.146:0/48879753 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd800c850 con 0x7fcde409e340 2023-10-03T10:16:33.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.053+0000 7fcdcb7fe700 1 -- 172.21.15.146:0/48879753 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd800c9b0 con 0x7fcde409e340 2023-10-03T10:16:33.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.053+0000 7fcdcb7fe700 1 -- 172.21.15.146:0/48879753 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd800cd60 con 0x7fcde409e340 2023-10-03T10:16:33.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.053+0000 7fcde9410700 1 -- 172.21.15.146:0/48879753 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcddc009b30 con 0x7fcde409e340 2023-10-03T10:16:33.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.053+0000 7fcde9410700 1 -- 172.21.15.146:0/48879753 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde411d1d0 con 0x7fcde409e340 2023-10-03T10:16:33.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.054+0000 7fcdcb7fe700 1 -- 172.21.15.146:0/48879753 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcdd8013470 con 0x7fcde409e340 2023-10-03T10:16:33.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.054+0000 7fcdcb7fe700 1 -- 172.21.15.146:0/48879753 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcdd803f810 con 0x7fcde409e340 2023-10-03T10:16:33.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.054+0000 7fcde9410700 1 -- 172.21.15.146:0/48879753 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde40717c0 con 0x7fcde409e340 2023-10-03T10:16:33.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.059+0000 7fcdcb7fe700 1 -- 172.21.15.146:0/48879753 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcdd80232f0 con 0x7fcde409e340 2023-10-03T10:16:33.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.186+0000 7fa972ce4700 1 -- 172.21.15.146:0/4290112885 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa96c137880 con 0x7fa96c09e170 2023-10-03T10:16:33.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.186+0000 7fa9697fa700 1 -- 172.21.15.146:0/4290112885 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa958015090 con 0x7fa96c09e170 2023-10-03T10:16:33.187 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:33.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.189+0000 7fa972ce4700 1 -- 172.21.15.146:0/4290112885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa96c09e170 msgr2=0x7fa96c138680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.189+0000 7fa972ce4700 1 --2- 172.21.15.146:0/4290112885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa96c09e170 0x7fa96c138680 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fa958016000 tx=0x7fa958004750 comp rx=0 tx=0).stop 2023-10-03T10:16:33.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.189+0000 7fa972ce4700 1 -- 172.21.15.146:0/4290112885 shutdown_connections 2023-10-03T10:16:33.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.189+0000 7fa972ce4700 1 --2- 172.21.15.146:0/4290112885 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa96c130ce0 0x7fa96c1c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.189+0000 7fa972ce4700 1 --2- 172.21.15.146:0/4290112885 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa96c09d860 0x7fa96c138140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.189+0000 7fa972ce4700 1 --2- 172.21.15.146:0/4290112885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa96c09e170 0x7fa96c138680 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.189+0000 7fa972ce4700 1 -- 172.21.15.146:0/4290112885 >> 172.21.15.146:0/4290112885 conn(0x7fa96c099c40 msgr2=0x7fa96c139500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.189+0000 7fa972ce4700 1 -- 172.21.15.146:0/4290112885 shutdown_connections 2023-10-03T10:16:33.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.189+0000 7fa972ce4700 1 -- 172.21.15.146:0/4290112885 wait complete. 2023-10-03T10:16:33.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:33.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.216+0000 7ff8e0b3f700 1 -- 172.21.15.146:0/3390458788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff8dc06bce0 con 0x7ff8dc0a1340 2023-10-03T10:16:33.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.217+0000 7ff8caffd700 1 -- 172.21.15.146:0/3390458788 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff8d4011e40 con 0x7ff8dc0a1340 2023-10-03T10:16:33.218 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:33.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.219+0000 7ff8e0b3f700 1 -- 172.21.15.146:0/3390458788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8dc0a1340 msgr2=0x7ff8dc1c05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.219+0000 7ff8e0b3f700 1 --2- 172.21.15.146:0/3390458788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8dc0a1340 0x7ff8dc1c05e0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4001560 tx=0x7ff8d400cc00 comp rx=0 tx=0).stop 2023-10-03T10:16:33.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.219+0000 7ff8e0b3f700 1 -- 172.21.15.146:0/3390458788 shutdown_connections 2023-10-03T10:16:33.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.219+0000 7ff8e0b3f700 1 --2- 172.21.15.146:0/3390458788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8dc0a1340 0x7ff8dc1c05e0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.219+0000 7ff8e0b3f700 1 --2- 172.21.15.146:0/3390458788 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8dc066410 0x7ff8dc1c4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.219+0000 7ff8e0b3f700 1 --2- 172.21.15.146:0/3390458788 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8dc0a0a30 0x7ff8dc1c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.219+0000 7ff8e0b3f700 1 -- 172.21.15.146:0/3390458788 >> 172.21.15.146:0/3390458788 conn(0x7ff8dc0a2980 msgr2=0x7ff8dc09e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.219+0000 7ff8e0b3f700 1 -- 172.21.15.146:0/3390458788 shutdown_connections 2023-10-03T10:16:33.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.219+0000 7ff8e0b3f700 1 -- 172.21.15.146:0/3390458788 wait complete. 2023-10-03T10:16:33.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:33.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.236+0000 7fcffcf51700 1 -- 172.21.15.146:0/3047942402 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcfdc005150 con 0x7fcff809e870 2023-10-03T10:16:33.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.236+0000 7fcfe6ffd700 1 -- 172.21.15.146:0/3047942402 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcfe8029090 con 0x7fcff809e870 2023-10-03T10:16:33.237 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:33.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.238+0000 7fcffcf51700 1 -- 172.21.15.146:0/3047942402 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcff809e870 msgr2=0x7fcff806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.238+0000 7fcffcf51700 1 --2- 172.21.15.146:0/3047942402 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcff809e870 0x7fcff806b8b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fcfe800b530 tx=0x7fcfe800b840 comp rx=0 tx=0).stop 2023-10-03T10:16:33.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.238+0000 7fcffcf51700 1 -- 172.21.15.146:0/3047942402 shutdown_connections 2023-10-03T10:16:33.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.238+0000 7fcffcf51700 1 --2- 172.21.15.146:0/3047942402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff8131d70 0x7fcff806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.238+0000 7fcffcf51700 1 --2- 172.21.15.146:0/3047942402 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcff809e870 0x7fcff806b8b0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.238+0000 7fcffcf51700 1 --2- 172.21.15.146:0/3047942402 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcff809f180 0x7fcff806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.238+0000 7fcffcf51700 1 -- 172.21.15.146:0/3047942402 >> 172.21.15.146:0/3047942402 conn(0x7fcff80a4430 msgr2=0x7fcff811a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.238+0000 7fcffcf51700 1 -- 172.21.15.146:0/3047942402 shutdown_connections 2023-10-03T10:16:33.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.238+0000 7fcffcf51700 1 -- 172.21.15.146:0/3047942402 wait complete. 2023-10-03T10:16:33.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:33.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.271+0000 7fcde9410700 1 -- 172.21.15.146:0/48879753 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcde411ec80 con 0x7fcde409e340 2023-10-03T10:16:33.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.271+0000 7fcdcb7fe700 1 -- 172.21.15.146:0/48879753 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcdd8021020 con 0x7fcde409e340 2023-10-03T10:16:33.272 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:33.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.273+0000 7fcde9410700 1 -- 172.21.15.146:0/48879753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcde409e340 msgr2=0x7fcde411bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.273+0000 7fcde9410700 1 --2- 172.21.15.146:0/48879753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcde409e340 0x7fcde411bb50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800e9b0 tx=0x7fcdd800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.273+0000 7fcde9410700 1 -- 172.21.15.146:0/48879753 shutdown_connections 2023-10-03T10:16:33.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.273+0000 7fcde9410700 1 --2- 172.21.15.146:0/48879753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcde4135f20 0x7fcde411c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.273+0000 7fcde9410700 1 --2- 172.21.15.146:0/48879753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcde409d860 0x7fcde411b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.273+0000 7fcde9410700 1 --2- 172.21.15.146:0/48879753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcde409e340 0x7fcde411bb50 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.273+0000 7fcde9410700 1 -- 172.21.15.146:0/48879753 >> 172.21.15.146:0/48879753 conn(0x7fcde4099c40 msgr2=0x7fcde406e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.273+0000 7fcde9410700 1 -- 172.21.15.146:0/48879753 shutdown_connections 2023-10-03T10:16:33.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:33.273+0000 7fcde9410700 1 -- 172.21.15.146:0/48879753 wait complete. 2023-10-03T10:16:33.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:34.202 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:34.233 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:34.252 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:34.286 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:34.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.350+0000 7f429020e700 1 Processor -- start 2023-10-03T10:16:34.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.351+0000 7f429020e700 1 -- start start 2023-10-03T10:16:34.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.351+0000 7f429020e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f428809e340 0x7f42881359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.351+0000 7f429020e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4288135f20 0x7f4288138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.351+0000 7f429020e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f428809aaa0 con 0x7f428809d860 2023-10-03T10:16:34.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.351+0000 7f429020e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f428809e730 con 0x7f428809e340 2023-10-03T10:16:34.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.351+0000 7f429020e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428809f870 con 0x7f4288135f20 2023-10-03T10:16:34.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.351+0000 7f428d7a9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f428809e340 0x7f42881359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.352+0000 7f428dfaa700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f428809d860 0x7f428809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43064/0 (socket says 172.21.15.146:43064) 2023-10-03T10:16:34.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.352+0000 7f428dfaa700 1 -- 172.21.15.146:0/1142454801 learned_addr learned my addr 172.21.15.146:0/1142454801 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:34.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.352+0000 7f428e7ab700 1 --2- 172.21.15.146:0/1142454801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4288135f20 0x7f4288138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.352+0000 7f428e7ab700 1 -- 172.21.15.146:0/1142454801 >> v2:172.21.15.146:3300/0 conn(0x7f428809e340 msgr2=0x7f42881359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:34.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.352+0000 7f428e7ab700 1 --2- 172.21.15.146:0/1142454801 >> v2:172.21.15.146:3300/0 conn(0x7f428809e340 0x7f42881359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.352+0000 7f428e7ab700 1 -- 172.21.15.146:0/1142454801 >> v1:172.21.15.146:6789/0 conn(0x7f428809d860 legacy=0x7f428809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.352+0000 7f428cfa8700 1 -- 172.21.15.146:0/1142454801 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013173917 0 0) 0x7f428809aaa0 con 0x7f428809d860 2023-10-03T10:16:34.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.352+0000 7f428e7ab700 1 -- 172.21.15.146:0/1142454801 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428809b360 con 0x7f4288135f20 2023-10-03T10:16:34.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.352+0000 7f428d7a9700 1 --2- 172.21.15.146:0/1142454801 >> v2:172.21.15.146:3300/0 conn(0x7f428809e340 0x7f42881359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:34.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.352+0000 7f428e7ab700 1 --2- 172.21.15.146:0/1142454801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4288135f20 0x7f4288138300 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4280009e40 tx=0x7f428000f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d1e8b4d6c1f4933 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:34.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.352+0000 7f428cfa8700 1 -- 172.21.15.146:0/1142454801 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280017410 con 0x7f4288135f20 2023-10-03T10:16:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.352+0000 7f428cfa8700 1 -- 172.21.15.146:0/1142454801 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4280017570 con 0x7f4288135f20 2023-10-03T10:16:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.352+0000 7f428cfa8700 1 -- 172.21.15.146:0/1142454801 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280017920 con 0x7f4288135f20 2023-10-03T10:16:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.353+0000 7f429020e700 1 -- 172.21.15.146:0/1142454801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4288135f20 msgr2=0x7f4288138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.353+0000 7f429020e700 1 --2- 172.21.15.146:0/1142454801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4288135f20 0x7f4288138300 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4280009e40 tx=0x7f428000f740 comp rx=0 tx=0).stop 2023-10-03T10:16:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.353+0000 7f429020e700 1 -- 172.21.15.146:0/1142454801 shutdown_connections 2023-10-03T10:16:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.353+0000 7f429020e700 1 --2- 172.21.15.146:0/1142454801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4288135f20 0x7f4288138300 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.353+0000 7f429020e700 1 --2- 172.21.15.146:0/1142454801 >> v2:172.21.15.146:3300/0 conn(0x7f428809e340 0x7f42881359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.353+0000 7f429020e700 1 -- 172.21.15.146:0/1142454801 >> 172.21.15.146:0/1142454801 conn(0x7f4288099c40 msgr2=0x7f42880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.353+0000 7f429020e700 1 -- 172.21.15.146:0/1142454801 shutdown_connections 2023-10-03T10:16:34.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.353+0000 7f429020e700 1 -- 172.21.15.146:0/1142454801 wait complete. 2023-10-03T10:16:34.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.355+0000 7f429020e700 1 Processor -- start 2023-10-03T10:16:34.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.355+0000 7f429020e700 1 -- start start 2023-10-03T10:16:34.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.355+0000 7f429020e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f428809d860 0x7f4288119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.355+0000 7f429020e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f428809e340 0x7f4288119b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.355+0000 7f429020e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4288135f20 0x7f428811a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.355+0000 7f429020e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428811b500 con 0x7f428809d860 2023-10-03T10:16:34.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.355+0000 7f429020e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4288072070 con 0x7f428809e340 2023-10-03T10:16:34.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.355+0000 7f429020e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f428809c8b0 con 0x7f4288135f20 2023-10-03T10:16:34.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.355+0000 7f428d7a9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f428809e340 0x7f4288119b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.355+0000 7f428e7ab700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4288135f20 0x7f428811a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.356+0000 7f428d7a9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f428809e340 0x7f4288119b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58378/0 (socket says 172.21.15.146:58378) 2023-10-03T10:16:34.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.356+0000 7f428dfaa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f428809d860 0x7f4288119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.356+0000 7f428d7a9700 1 -- 172.21.15.146:0/1007675860 learned_addr learned my addr 172.21.15.146:0/1007675860 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:34.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.356+0000 7f428d7a9700 1 -- 172.21.15.146:0/1007675860 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4288135f20 msgr2=0x7f428811a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.356+0000 7f428d7a9700 1 --2- 172.21.15.146:0/1007675860 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4288135f20 0x7f428811a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.356+0000 7f428d7a9700 1 -- 172.21.15.146:0/1007675860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f428809d860 msgr2=0x7f4288119630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.356+0000 7f428d7a9700 1 --2- 172.21.15.146:0/1007675860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f428809d860 0x7f4288119630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.356+0000 7f428d7a9700 1 -- 172.21.15.146:0/1007675860 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427800b740 con 0x7f428809e340 2023-10-03T10:16:34.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.356+0000 7f428d7a9700 1 --2- 172.21.15.146:0/1007675860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f428809e340 0x7f4288119b70 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f427800ecf0 tx=0x7f427800bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:34.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.356+0000 7f427e7fc700 1 -- 172.21.15.146:0/1007675860 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427800dd70 con 0x7f428809e340 2023-10-03T10:16:34.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.356+0000 7f429020e700 1 -- 172.21.15.146:0/1007675860 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4280009a70 con 0x7f428809e340 2023-10-03T10:16:34.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.356+0000 7f427e7fc700 1 -- 172.21.15.146:0/1007675860 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4278010440 con 0x7f428809e340 2023-10-03T10:16:34.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.356+0000 7f427e7fc700 1 -- 172.21.15.146:0/1007675860 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780107b0 con 0x7f428809e340 2023-10-03T10:16:34.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.356+0000 7f429020e700 1 -- 172.21.15.146:0/1007675860 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428811b690 con 0x7f428809e340 2023-10-03T10:16:34.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.358+0000 7f429020e700 1 -- 172.21.15.146:0/1007675860 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4288133760 con 0x7f428809e340 2023-10-03T10:16:34.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.358+0000 7f427e7fc700 1 -- 172.21.15.146:0/1007675860 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4278010910 con 0x7f428809e340 2023-10-03T10:16:34.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.358+0000 7f427e7fc700 1 -- 172.21.15.146:0/1007675860 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4278014070 con 0x7f428809e340 2023-10-03T10:16:34.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.366+0000 7f427e7fc700 1 -- 172.21.15.146:0/1007675860 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4278010e00 con 0x7f428809e340 2023-10-03T10:16:34.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.389+0000 7f28b13bc700 1 Processor -- start 2023-10-03T10:16:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.389+0000 7f28b13bc700 1 -- start start 2023-10-03T10:16:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.389+0000 7f28b13bc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28ac138040 0x7f28ac138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.389+0000 7f28b13bc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28ac0a08e0 0x7f28ac0a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.389+0000 7f28b13bc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f28ac0a1230 0x7f28ac13ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.389+0000 7f28b13bc700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ac0a2100 con 0x7f28ac0a1230 2023-10-03T10:16:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.389+0000 7f28b13bc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac138950 con 0x7f28ac138040 2023-10-03T10:16:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.389+0000 7f28b13bc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac1379e0 con 0x7f28ac0a08e0 2023-10-03T10:16:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.390+0000 7f28ab7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f28ac0a1230 0x7f28ac13ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.390+0000 7f28aa7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28ac0a08e0 0x7f28ac0a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.390+0000 7f28aaffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28ac138040 0x7f28ac138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.390+0000 7f28ab7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f28ac0a1230 0x7f28ac13ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33134/0 (socket says 172.21.15.146:33134) 2023-10-03T10:16:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.390+0000 7f28ab7fe700 1 -- 172.21.15.146:0/1535667272 learned_addr learned my addr 172.21.15.146:0/1535667272 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.390+0000 7f28ab7fe700 1 -- 172.21.15.146:0/1535667272 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28ac0a08e0 msgr2=0x7f28ac0a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.390+0000 7f28ab7fe700 1 --2- 172.21.15.146:0/1535667272 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28ac0a08e0 0x7f28ac0a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.390+0000 7f28ab7fe700 1 -- 172.21.15.146:0/1535667272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28ac138040 msgr2=0x7f28ac138410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.390+0000 7f28ab7fe700 1 --2- 172.21.15.146:0/1535667272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28ac138040 0x7f28ac138410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.390+0000 7f28ab7fe700 1 -- 172.21.15.146:0/1535667272 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac09b9b0 con 0x7f28ac0a1230 2023-10-03T10:16:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.390+0000 7f28aaffd700 1 --2- 172.21.15.146:0/1535667272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28ac138040 0x7f28ac138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.390+0000 7f28ab7fe700 1 --2- 172.21.15.146:0/1535667272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28ac0a1230 0x7f28ac13ed10 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f28a4009eb0 tx=0x7f28a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8652cfa736260d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.390+0000 7f28a9ffb700 1 -- 172.21.15.146:0/1535667272 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a400e070 con 0x7f28ac0a1230 2023-10-03T10:16:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.390+0000 7f28a9ffb700 1 -- 172.21.15.146:0/1535667272 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a400b890 con 0x7f28ac0a1230 2023-10-03T10:16:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.390+0000 7f28a9ffb700 1 -- 172.21.15.146:0/1535667272 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a400bc40 con 0x7f28ac0a1230 2023-10-03T10:16:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.391+0000 7f28b13bc700 1 -- 172.21.15.146:0/1535667272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28ac0a1230 msgr2=0x7f28ac13ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.391+0000 7f28b13bc700 1 --2- 172.21.15.146:0/1535667272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28ac0a1230 0x7f28ac13ed10 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f28a4009eb0 tx=0x7f28a400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.391+0000 7f28b13bc700 1 -- 172.21.15.146:0/1535667272 shutdown_connections 2023-10-03T10:16:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.391+0000 7f28b13bc700 1 --2- 172.21.15.146:0/1535667272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28ac138040 0x7f28ac138410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.391+0000 7f28b13bc700 1 --2- 172.21.15.146:0/1535667272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28ac0a1230 0x7f28ac13ed10 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.391+0000 7f28b13bc700 1 --2- 172.21.15.146:0/1535667272 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28ac0a08e0 0x7f28ac0a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.391+0000 7f28b13bc700 1 -- 172.21.15.146:0/1535667272 >> 172.21.15.146:0/1535667272 conn(0x7f28ac0a2980 msgr2=0x7f28ac0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.391+0000 7f28b13bc700 1 -- 172.21.15.146:0/1535667272 shutdown_connections 2023-10-03T10:16:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.391+0000 7f28b13bc700 1 -- 172.21.15.146:0/1535667272 wait complete. 2023-10-03T10:16:34.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.393+0000 7f28b13bc700 1 Processor -- start 2023-10-03T10:16:34.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.393+0000 7f28b13bc700 1 -- start start 2023-10-03T10:16:34.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.393+0000 7f28b13bc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28ac0a08e0 0x7f28ac134770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.393+0000 7f28b13bc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28ac0a1230 0x7f28ac134cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.393+0000 7f28b13bc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28ac138040 0x7f28ac1d4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.393+0000 7f28b13bc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac11b0a0 con 0x7f28ac0a08e0 2023-10-03T10:16:34.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.393+0000 7f28b13bc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac09f3b0 con 0x7f28ac138040 2023-10-03T10:16:34.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.393+0000 7f28b13bc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac1351f0 con 0x7f28ac0a1230 2023-10-03T10:16:34.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.394+0000 7f28aaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28ac0a08e0 0x7f28ac134770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.394+0000 7f28aaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28ac0a08e0 0x7f28ac134770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33140/0 (socket says 172.21.15.146:33140) 2023-10-03T10:16:34.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.394+0000 7f28aaffd700 1 -- 172.21.15.146:0/666355159 learned_addr learned my addr 172.21.15.146:0/666355159 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:34.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.394+0000 7f28ab7fe700 1 --2- 172.21.15.146:0/666355159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28ac138040 0x7f28ac1d4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.394+0000 7f28aa7fc700 1 --2- 172.21.15.146:0/666355159 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28ac0a1230 0x7f28ac134cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.394+0000 7f28ab7fe700 1 -- 172.21.15.146:0/666355159 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28ac0a1230 msgr2=0x7f28ac134cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.394+0000 7f28ab7fe700 1 --2- 172.21.15.146:0/666355159 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28ac0a1230 0x7f28ac134cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.394+0000 7f28ab7fe700 1 -- 172.21.15.146:0/666355159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28ac0a08e0 msgr2=0x7f28ac134770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.394+0000 7f28ab7fe700 1 --2- 172.21.15.146:0/666355159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28ac0a08e0 0x7f28ac134770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.394+0000 7f28ab7fe700 1 -- 172.21.15.146:0/666355159 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c009430 con 0x7f28ac138040 2023-10-03T10:16:34.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.394+0000 7f28aaffd700 1 --2- 172.21.15.146:0/666355159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28ac0a08e0 0x7f28ac134770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:34.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.394+0000 7f28aa7fc700 1 --2- 172.21.15.146:0/666355159 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28ac0a1230 0x7f28ac134cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:34.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.394+0000 7f28ab7fe700 1 --2- 172.21.15.146:0/666355159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28ac138040 0x7f28ac1d4f70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f28a4012000 tx=0x7f28a4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:34.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.395+0000 7f28937fe700 1 -- 172.21.15.146:0/666355159 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4003e10 con 0x7f28ac138040 2023-10-03T10:16:34.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.395+0000 7f28937fe700 1 -- 172.21.15.146:0/666355159 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a4004250 con 0x7f28ac138040 2023-10-03T10:16:34.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.395+0000 7f28b13bc700 1 -- 172.21.15.146:0/666355159 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a4009b30 con 0x7f28ac138040 2023-10-03T10:16:34.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.395+0000 7f28937fe700 1 -- 172.21.15.146:0/666355159 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4004600 con 0x7f28ac138040 2023-10-03T10:16:34.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.395+0000 7f28b13bc700 1 -- 172.21.15.146:0/666355159 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ac13ea40 con 0x7f28ac138040 2023-10-03T10:16:34.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.396+0000 7f28b13bc700 1 -- 172.21.15.146:0/666355159 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ac04f2a0 con 0x7f28ac138040 2023-10-03T10:16:34.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.396+0000 7f28937fe700 1 -- 172.21.15.146:0/666355159 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f28a4004760 con 0x7f28ac138040 2023-10-03T10:16:34.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.396+0000 7f28937fe700 1 -- 172.21.15.146:0/666355159 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f28a4041d10 con 0x7f28ac138040 2023-10-03T10:16:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.401+0000 7f28937fe700 1 -- 172.21.15.146:0/666355159 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f28a4045060 con 0x7f28ac138040 2023-10-03T10:16:34.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.423+0000 7f314ab13700 1 Processor -- start 2023-10-03T10:16:34.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.424+0000 7f314ab13700 1 -- start start 2023-10-03T10:16:34.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.424+0000 7f314ab13700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31440a0a70 0x7f31440a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.424+0000 7f314ab13700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31440a1380 0x7f3144133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.424+0000 7f314ab13700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314409dc00 con 0x7f3144133f50 2023-10-03T10:16:34.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.424+0000 7f314ab13700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314409ea60 con 0x7f31440a0a70 2023-10-03T10:16:34.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.424+0000 7f314ab13700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f314409dec0 con 0x7f31440a1380 2023-10-03T10:16:34.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.424+0000 7f31490b0700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3144133f50 0x7f314413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43080/0 (socket says 172.21.15.146:43080) 2023-10-03T10:16:34.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.424+0000 7f31490b0700 1 -- 172.21.15.146:0/3451450139 learned_addr learned my addr 172.21.15.146:0/3451450139 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:34.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.425+0000 7f3143fff700 1 --2- 172.21.15.146:0/3451450139 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31440a1380 0x7f3144133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.425+0000 7f31437fe700 1 -- 172.21.15.146:0/3451450139 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858708339 0 0) 0x7f314409dc00 con 0x7f3144133f50 2023-10-03T10:16:34.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.425+0000 7f31437fe700 1 -- 172.21.15.146:0/3451450139 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31340035b0 con 0x7f3144133f50 2023-10-03T10:16:34.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.425+0000 7f31488af700 1 --2- 172.21.15.146:0/3451450139 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31440a0a70 0x7f31440a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.425+0000 7f3143fff700 1 -- 172.21.15.146:0/3451450139 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31440a0a70 msgr2=0x7f31440a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:34.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.425+0000 7f3143fff700 1 --2- 172.21.15.146:0/3451450139 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31440a0a70 0x7f31440a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.425+0000 7f3143fff700 1 -- 172.21.15.146:0/3451450139 >> v1:172.21.15.146:6789/0 conn(0x7f3144133f50 legacy=0x7f314413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.425+0000 7f3143fff700 1 -- 172.21.15.146:0/3451450139 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314409e6a0 con 0x7f31440a1380 2023-10-03T10:16:34.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.425+0000 7f3143fff700 1 --2- 172.21.15.146:0/3451450139 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31440a1380 0x7f3144133a10 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f3130009870 tx=0x7f3130009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42f438b6539ed1e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:34.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.425+0000 7f31437fe700 1 -- 172.21.15.146:0/3451450139 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130011830 con 0x7f31440a1380 2023-10-03T10:16:34.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.425+0000 7f31437fe700 1 -- 172.21.15.146:0/3451450139 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3130011990 con 0x7f31440a1380 2023-10-03T10:16:34.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.425+0000 7f31437fe700 1 -- 172.21.15.146:0/3451450139 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130011d20 con 0x7f31440a1380 2023-10-03T10:16:34.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.426+0000 7f314ab13700 1 -- 172.21.15.146:0/3451450139 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31440a1380 msgr2=0x7f3144133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.426+0000 7f314ab13700 1 --2- 172.21.15.146:0/3451450139 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31440a1380 0x7f3144133a10 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f3130009870 tx=0x7f3130009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:34.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.426+0000 7f536a9d9700 1 Processor -- start 2023-10-03T10:16:34.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.426+0000 7f314ab13700 1 -- 172.21.15.146:0/3451450139 shutdown_connections 2023-10-03T10:16:34.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.426+0000 7f314ab13700 1 --2- 172.21.15.146:0/3451450139 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31440a0a70 0x7f31440a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.426+0000 7f314ab13700 1 --2- 172.21.15.146:0/3451450139 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f31440a1380 0x7f3144133a10 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.426+0000 7f314ab13700 1 -- 172.21.15.146:0/3451450139 >> 172.21.15.146:0/3451450139 conn(0x7f31440a6610 msgr2=0x7f31440a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.426+0000 7f314ab13700 1 -- 172.21.15.146:0/3451450139 shutdown_connections 2023-10-03T10:16:34.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.426+0000 7f314ab13700 1 -- 172.21.15.146:0/3451450139 wait complete. 2023-10-03T10:16:34.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.426+0000 7f536a9d9700 1 -- start start 2023-10-03T10:16:34.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.427+0000 7f536a9d9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f536409bd20 0x7f536409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.427+0000 7f536a9d9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5364130220 0x7f5364130630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.427+0000 7f536a9d9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5364130b70 0x7f53641375b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.427+0000 7f536a9d9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f536409b310 con 0x7f5364130b70 2023-10-03T10:16:34.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.427+0000 7f536a9d9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536409a510 con 0x7f5364130220 2023-10-03T10:16:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.427+0000 7f536a9d9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f536409b820 con 0x7f536409bd20 2023-10-03T10:16:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.427+0000 7f5368f76700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5364130b70 0x7f53641375b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.427+0000 7f5368f76700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5364130b70 0x7f53641375b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33142/0 (socket says 172.21.15.146:33142) 2023-10-03T10:16:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.427+0000 7f5368f76700 1 -- 172.21.15.146:0/1093433260 learned_addr learned my addr 172.21.15.146:0/1093433260 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.427+0000 7f53637fe700 1 --2- 172.21.15.146:0/1093433260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5364130220 0x7f5364130630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.427+0000 7f5368f76700 1 -- 172.21.15.146:0/1093433260 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f536409bd20 msgr2=0x7f536409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.427+0000 7f5368f76700 1 --2- 172.21.15.146:0/1093433260 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f536409bd20 0x7f536409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.427+0000 7f5368f76700 1 -- 172.21.15.146:0/1093433260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5364130220 msgr2=0x7f5364130630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.427+0000 7f5368f76700 1 --2- 172.21.15.146:0/1093433260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5364130220 0x7f5364130630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.427+0000 7f5368f76700 1 -- 172.21.15.146:0/1093433260 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536412d560 con 0x7f5364130b70 2023-10-03T10:16:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.427+0000 7f53637fe700 1 --2- 172.21.15.146:0/1093433260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5364130220 0x7f5364130630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.427+0000 7f5368f76700 1 --2- 172.21.15.146:0/1093433260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5364130b70 0x7f53641375b0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f535c00d150 tx=0x7f535c00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1016bcf6494514e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:34.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.428+0000 7f314ab13700 1 Processor -- start 2023-10-03T10:16:34.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.428+0000 7f314ab13700 1 -- start start 2023-10-03T10:16:34.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.428+0000 7f5362ffd700 1 -- 172.21.15.146:0/1093433260 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c010070 con 0x7f5364130b70 2023-10-03T10:16:34.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.428+0000 7f5362ffd700 1 -- 172.21.15.146:0/1093433260 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c00ddc0 con 0x7f5364130b70 2023-10-03T10:16:34.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.428+0000 7f5362ffd700 1 -- 172.21.15.146:0/1093433260 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c00b310 con 0x7f5364130b70 2023-10-03T10:16:34.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f314ab13700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31440a0a70 0x7f3144122850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f536a9d9700 1 -- 172.21.15.146:0/1093433260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5364130b70 msgr2=0x7f53641375b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f536a9d9700 1 --2- 172.21.15.146:0/1093433260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5364130b70 0x7f53641375b0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f535c00d150 tx=0x7f535c00d460 comp rx=0 tx=0).stop 2023-10-03T10:16:34.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f314ab13700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31440a1380 0x7f3144122d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f314ab13700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3144133f50 0x7f31441232d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f314ab13700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3144126320 con 0x7f31440a0a70 2023-10-03T10:16:34.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f314ab13700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31440a03e0 con 0x7f31440a1380 2023-10-03T10:16:34.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f314ab13700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31441244b0 con 0x7f3144133f50 2023-10-03T10:16:34.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f31490b0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3144133f50 0x7f31441232d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f3143fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31440a1380 0x7f3144122d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f31488af700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31440a0a70 0x7f3144122850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f31490b0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3144133f50 0x7f31441232d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40540/0 (socket says 172.21.15.146:40540) 2023-10-03T10:16:34.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f31490b0700 1 -- 172.21.15.146:0/541001281 learned_addr learned my addr 172.21.15.146:0/541001281 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:34.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f536a9d9700 1 -- 172.21.15.146:0/1093433260 shutdown_connections 2023-10-03T10:16:34.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f536a9d9700 1 --2- 172.21.15.146:0/1093433260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5364130b70 0x7f53641375b0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f536a9d9700 1 --2- 172.21.15.146:0/1093433260 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f536409bd20 0x7f536409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f536a9d9700 1 --2- 172.21.15.146:0/1093433260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5364130220 0x7f5364130630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f536a9d9700 1 -- 172.21.15.146:0/1093433260 >> 172.21.15.146:0/1093433260 conn(0x7f5364099c40 msgr2=0x7f53640a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f31490b0700 1 -- 172.21.15.146:0/541001281 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31440a1380 msgr2=0x7f3144122d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f31490b0700 1 --2- 172.21.15.146:0/541001281 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31440a1380 0x7f3144122d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f31490b0700 1 -- 172.21.15.146:0/541001281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31440a0a70 msgr2=0x7f3144122850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f31490b0700 1 --2- 172.21.15.146:0/541001281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31440a0a70 0x7f3144122850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f31490b0700 1 -- 172.21.15.146:0/541001281 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31300094a0 con 0x7f3144133f50 2023-10-03T10:16:34.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f31488af700 1 --2- 172.21.15.146:0/541001281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31440a0a70 0x7f3144122850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:34.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f536a9d9700 1 -- 172.21.15.146:0/1093433260 shutdown_connections 2023-10-03T10:16:34.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f536a9d9700 1 -- 172.21.15.146:0/1093433260 wait complete. 2023-10-03T10:16:34.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.429+0000 7f31490b0700 1 --2- 172.21.15.146:0/541001281 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3144133f50 0x7f31441232d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f313c00cb40 tx=0x7f313c00ce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.430+0000 7f536a9d9700 1 Processor -- start 2023-10-03T10:16:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.430+0000 7f536a9d9700 1 -- start start 2023-10-03T10:16:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.431+0000 7f536a9d9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f536409bd20 0x7f5364070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.431+0000 7f536a9d9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5364130220 0x7f5364070d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.431+0000 7f536a9d9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5364130b70 0x7f53640712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.431+0000 7f536a9d9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536411f1e0 con 0x7f536409bd20 2023-10-03T10:16:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.431+0000 7f536a9d9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536412cd70 con 0x7f5364130220 2023-10-03T10:16:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.431+0000 7f536a9d9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f536412a890 con 0x7f5364130b70 2023-10-03T10:16:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.431+0000 7f5363fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f536409bd20 0x7f5364070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.431+0000 7f53637fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5364130220 0x7f5364070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.431+0000 7f5363fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f536409bd20 0x7f5364070840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33154/0 (socket says 172.21.15.146:33154) 2023-10-03T10:16:34.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.431+0000 7f5363fff700 1 -- 172.21.15.146:0/354361250 learned_addr learned my addr 172.21.15.146:0/354361250 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:34.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.431+0000 7f5368f76700 1 --2- 172.21.15.146:0/354361250 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5364130b70 0x7f53640712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.431+0000 7f5363fff700 1 -- 172.21.15.146:0/354361250 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5364130b70 msgr2=0x7f53640712c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.431+0000 7f5363fff700 1 --2- 172.21.15.146:0/354361250 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5364130b70 0x7f53640712c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.431+0000 7f5363fff700 1 -- 172.21.15.146:0/354361250 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5364130220 msgr2=0x7f5364070d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.431+0000 7f5363fff700 1 --2- 172.21.15.146:0/354361250 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5364130220 0x7f5364070d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.431+0000 7f5363fff700 1 -- 172.21.15.146:0/354361250 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c00bd40 con 0x7f536409bd20 2023-10-03T10:16:34.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.431+0000 7f5363fff700 1 --2- 172.21.15.146:0/354361250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f536409bd20 0x7f5364070840 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f535400b4a0 tx=0x7f535400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:34.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.432+0000 7f5360ff9700 1 -- 172.21.15.146:0/354361250 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5354011830 con 0x7f536409bd20 2023-10-03T10:16:34.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.432+0000 7f5360ff9700 1 -- 172.21.15.146:0/354361250 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5354011990 con 0x7f536409bd20 2023-10-03T10:16:34.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.432+0000 7f536a9d9700 1 -- 172.21.15.146:0/354361250 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5364072560 con 0x7f536409bd20 2023-10-03T10:16:34.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.432+0000 7f5360ff9700 1 -- 172.21.15.146:0/354361250 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5354011d40 con 0x7f536409bd20 2023-10-03T10:16:34.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.432+0000 7f536a9d9700 1 -- 172.21.15.146:0/354361250 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f536411fc50 con 0x7f536409bd20 2023-10-03T10:16:34.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.432+0000 7f5360ff9700 1 -- 172.21.15.146:0/354361250 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f535401a400 con 0x7f536409bd20 2023-10-03T10:16:34.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.433+0000 7f5360ff9700 1 -- 172.21.15.146:0/354361250 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f535403f5e0 con 0x7f536409bd20 2023-10-03T10:16:34.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.433+0000 7f31417fa700 1 -- 172.21.15.146:0/541001281 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c00a9e0 con 0x7f3144133f50 2023-10-03T10:16:34.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.433+0000 7f31417fa700 1 -- 172.21.15.146:0/541001281 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c00ab40 con 0x7f3144133f50 2023-10-03T10:16:34.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.433+0000 7f31417fa700 1 -- 172.21.15.146:0/541001281 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c012400 con 0x7f3144133f50 2023-10-03T10:16:34.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.433+0000 7f314ab13700 1 -- 172.21.15.146:0/541001281 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3144133320 con 0x7f3144133f50 2023-10-03T10:16:34.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.433+0000 7f314ab13700 1 -- 172.21.15.146:0/541001281 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3144126ab0 con 0x7f3144133f50 2023-10-03T10:16:34.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.433+0000 7f536a9d9700 1 -- 172.21.15.146:0/354361250 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f536404f2a0 con 0x7f536409bd20 2023-10-03T10:16:34.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.434+0000 7f314ab13700 1 -- 172.21.15.146:0/541001281 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314404f2a0 con 0x7f3144133f50 2023-10-03T10:16:34.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.434+0000 7f31417fa700 1 -- 172.21.15.146:0/541001281 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f313c01b3b0 con 0x7f3144133f50 2023-10-03T10:16:34.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.434+0000 7f31417fa700 1 -- 172.21.15.146:0/541001281 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f313c03f330 con 0x7f3144133f50 2023-10-03T10:16:34.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.438+0000 7f5360ff9700 1 -- 172.21.15.146:0/354361250 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5354015080 con 0x7f536409bd20 2023-10-03T10:16:34.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.443+0000 7f31417fa700 1 -- 172.21.15.146:0/541001281 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f313c0192c0 con 0x7f3144133f50 2023-10-03T10:16:34.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.571+0000 7f429020e700 1 -- 172.21.15.146:0/1007675860 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f428804f2a0 con 0x7f428809e340 2023-10-03T10:16:34.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.571+0000 7f427e7fc700 1 -- 172.21.15.146:0/1007675860 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f427801d030 con 0x7f428809e340 2023-10-03T10:16:34.572 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:34.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.575+0000 7f429020e700 1 -- 172.21.15.146:0/1007675860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f428809e340 msgr2=0x7f4288119b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.575+0000 7f429020e700 1 --2- 172.21.15.146:0/1007675860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f428809e340 0x7f4288119b70 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f427800ecf0 tx=0x7f427800bf70 comp rx=0 tx=0).stop 2023-10-03T10:16:34.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.575+0000 7f429020e700 1 -- 172.21.15.146:0/1007675860 shutdown_connections 2023-10-03T10:16:34.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.575+0000 7f429020e700 1 --2- 172.21.15.146:0/1007675860 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4288135f20 0x7f428811a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.575+0000 7f429020e700 1 --2- 172.21.15.146:0/1007675860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f428809d860 0x7f4288119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.575+0000 7f429020e700 1 --2- 172.21.15.146:0/1007675860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f428809e340 0x7f4288119b70 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.575+0000 7f429020e700 1 -- 172.21.15.146:0/1007675860 >> 172.21.15.146:0/1007675860 conn(0x7f4288099c40 msgr2=0x7f42881308a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.575+0000 7f429020e700 1 -- 172.21.15.146:0/1007675860 shutdown_connections 2023-10-03T10:16:34.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.575+0000 7f429020e700 1 -- 172.21.15.146:0/1007675860 wait complete. 2023-10-03T10:16:34.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:34.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.605+0000 7f28b13bc700 1 -- 172.21.15.146:0/666355159 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f28ac099ab0 con 0x7f28ac138040 2023-10-03T10:16:34.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.606+0000 7f28937fe700 1 -- 172.21.15.146:0/666355159 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f28ac099ab0 con 0x7f28ac138040 2023-10-03T10:16:34.606 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:34.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.608+0000 7f28b13bc700 1 -- 172.21.15.146:0/666355159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28ac138040 msgr2=0x7f28ac1d4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.608+0000 7f28b13bc700 1 --2- 172.21.15.146:0/666355159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28ac138040 0x7f28ac1d4f70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f28a4012000 tx=0x7f28a4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.608+0000 7f28b13bc700 1 -- 172.21.15.146:0/666355159 shutdown_connections 2023-10-03T10:16:34.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.608+0000 7f28b13bc700 1 --2- 172.21.15.146:0/666355159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28ac138040 0x7f28ac1d4f70 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.608+0000 7f28b13bc700 1 --2- 172.21.15.146:0/666355159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28ac0a08e0 0x7f28ac134770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.608+0000 7f28b13bc700 1 --2- 172.21.15.146:0/666355159 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28ac0a1230 0x7f28ac134cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.608+0000 7f28b13bc700 1 -- 172.21.15.146:0/666355159 >> 172.21.15.146:0/666355159 conn(0x7f28ac0a2980 msgr2=0x7f28ac071ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.608+0000 7f28b13bc700 1 -- 172.21.15.146:0/666355159 shutdown_connections 2023-10-03T10:16:34.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.608+0000 7f28b13bc700 1 -- 172.21.15.146:0/666355159 wait complete. 2023-10-03T10:16:34.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:34.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.684+0000 7f536a9d9700 1 -- 172.21.15.146:0/354361250 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f536411ee80 con 0x7f536409bd20 2023-10-03T10:16:34.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.684+0000 7f5360ff9700 1 -- 172.21.15.146:0/354361250 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f535400f8d0 con 0x7f536409bd20 2023-10-03T10:16:34.685 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:34.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.687+0000 7f536a9d9700 1 -- 172.21.15.146:0/354361250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f536409bd20 msgr2=0x7f5364070840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.687+0000 7f536a9d9700 1 --2- 172.21.15.146:0/354361250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f536409bd20 0x7f5364070840 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f535400b4a0 tx=0x7f535400b7b0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.687+0000 7f536a9d9700 1 -- 172.21.15.146:0/354361250 shutdown_connections 2023-10-03T10:16:34.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.687+0000 7f536a9d9700 1 --2- 172.21.15.146:0/354361250 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5364130b70 0x7f53640712c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.687+0000 7f536a9d9700 1 --2- 172.21.15.146:0/354361250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f536409bd20 0x7f5364070840 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.687+0000 7f536a9d9700 1 --2- 172.21.15.146:0/354361250 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5364130220 0x7f5364070d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.687+0000 7f536a9d9700 1 -- 172.21.15.146:0/354361250 >> 172.21.15.146:0/354361250 conn(0x7f5364099c40 msgr2=0x7f53640a10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.687+0000 7f536a9d9700 1 -- 172.21.15.146:0/354361250 shutdown_connections 2023-10-03T10:16:34.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.687+0000 7f536a9d9700 1 -- 172.21.15.146:0/354361250 wait complete. 2023-10-03T10:16:34.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.690+0000 7f314ab13700 1 -- 172.21.15.146:0/541001281 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3144072980 con 0x7f3144133f50 2023-10-03T10:16:34.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.690+0000 7f31417fa700 1 -- 172.21.15.146:0/541001281 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f313c017030 con 0x7f3144133f50 2023-10-03T10:16:34.691 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.694+0000 7f314ab13700 1 -- 172.21.15.146:0/541001281 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3144133f50 msgr2=0x7f31441232d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.694+0000 7f314ab13700 1 --2- 172.21.15.146:0/541001281 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3144133f50 0x7f31441232d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f313c00cb40 tx=0x7f313c00ce50 comp rx=0 tx=0).stop 2023-10-03T10:16:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.694+0000 7f314ab13700 1 -- 172.21.15.146:0/541001281 shutdown_connections 2023-10-03T10:16:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.694+0000 7f314ab13700 1 --2- 172.21.15.146:0/541001281 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3144133f50 0x7f31441232d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.694+0000 7f314ab13700 1 --2- 172.21.15.146:0/541001281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31440a0a70 0x7f3144122850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.694+0000 7f314ab13700 1 --2- 172.21.15.146:0/541001281 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31440a1380 0x7f3144122d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.694+0000 7f314ab13700 1 -- 172.21.15.146:0/541001281 >> 172.21.15.146:0/541001281 conn(0x7f31440a6610 msgr2=0x7f314409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.694+0000 7f314ab13700 1 -- 172.21.15.146:0/541001281 shutdown_connections 2023-10-03T10:16:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:34.694+0000 7f314ab13700 1 -- 172.21.15.146:0/541001281 wait complete. 2023-10-03T10:16:34.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:34.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:35.588 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:35.622 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:35.704 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:35.708 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:35.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.730+0000 7fd868db5700 1 Processor -- start 2023-10-03T10:16:35.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.730+0000 7fd868db5700 1 -- start start 2023-10-03T10:16:35.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.731+0000 7fd868db5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd86412d380 0x7fd86412d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.731+0000 7fd868db5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd864099a60 0x7fd864099e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.731+0000 7fd868db5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd86409a3d0 0x7fd864137610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.731+0000 7fd868db5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd86409bb90 con 0x7fd86409a3d0 2023-10-03T10:16:35.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.731+0000 7fd868db5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86409c210 con 0x7fd86412d380 2023-10-03T10:16:35.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.731+0000 7fd868db5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd86409a870 con 0x7fd864099a60 2023-10-03T10:16:35.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.731+0000 7fd861d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd864099a60 0x7fd864099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.731+0000 7fd861d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd864099a60 0x7fd864099e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40548/0 (socket says 172.21.15.146:40548) 2023-10-03T10:16:35.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.731+0000 7fd862d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd86409a3d0 0x7fd864137610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.731+0000 7fd861d9b700 1 -- 172.21.15.146:0/1090146617 learned_addr learned my addr 172.21.15.146:0/1090146617 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:35.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.731+0000 7fd86259c700 1 --2- 172.21.15.146:0/1090146617 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd86412d380 0x7fd86412d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.731+0000 7fd861d9b700 1 -- 172.21.15.146:0/1090146617 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd86412d380 msgr2=0x7fd86412d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.731+0000 7fd861d9b700 1 --2- 172.21.15.146:0/1090146617 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd86412d380 0x7fd86412d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.731+0000 7fd861d9b700 1 -- 172.21.15.146:0/1090146617 >> v2:172.21.15.146:3300/0 conn(0x7fd86409a3d0 msgr2=0x7fd864137610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.731+0000 7fd861d9b700 1 --2- 172.21.15.146:0/1090146617 >> v2:172.21.15.146:3300/0 conn(0x7fd86409a3d0 0x7fd864137610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.731+0000 7fd861d9b700 1 -- 172.21.15.146:0/1090146617 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86409ced0 con 0x7fd864099a60 2023-10-03T10:16:35.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.731+0000 7fd862d9d700 1 --2- 172.21.15.146:0/1090146617 >> v2:172.21.15.146:3300/0 conn(0x7fd86409a3d0 0x7fd864137610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.731+0000 7fd861d9b700 1 --2- 172.21.15.146:0/1090146617 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd864099a60 0x7fd864099e90 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd8580098f0 tx=0x7fd858009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19e14dbdc5e9d42 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.732+0000 7fd86159a700 1 -- 172.21.15.146:0/1090146617 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd858011830 con 0x7fd864099a60 2023-10-03T10:16:35.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.732+0000 7fd86159a700 1 -- 172.21.15.146:0/1090146617 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd858011990 con 0x7fd864099a60 2023-10-03T10:16:35.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.732+0000 7fd86159a700 1 -- 172.21.15.146:0/1090146617 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd858011d00 con 0x7fd864099a60 2023-10-03T10:16:35.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.732+0000 7fd868db5700 1 -- 172.21.15.146:0/1090146617 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd864099a60 msgr2=0x7fd864099e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.732+0000 7fd868db5700 1 --2- 172.21.15.146:0/1090146617 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd864099a60 0x7fd864099e90 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd8580098f0 tx=0x7fd858009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:35.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.733+0000 7fd868db5700 1 -- 172.21.15.146:0/1090146617 shutdown_connections 2023-10-03T10:16:35.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.733+0000 7fd868db5700 1 --2- 172.21.15.146:0/1090146617 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd86412d380 0x7fd86412d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.733+0000 7fd868db5700 1 --2- 172.21.15.146:0/1090146617 >> v2:172.21.15.146:3300/0 conn(0x7fd86409a3d0 0x7fd864137610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.733+0000 7fd868db5700 1 --2- 172.21.15.146:0/1090146617 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd864099a60 0x7fd864099e90 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.733+0000 7fd868db5700 1 -- 172.21.15.146:0/1090146617 >> 172.21.15.146:0/1090146617 conn(0x7fd8640a2980 msgr2=0x7fd8640a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.733+0000 7fd868db5700 1 -- 172.21.15.146:0/1090146617 shutdown_connections 2023-10-03T10:16:35.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.733+0000 7fd868db5700 1 -- 172.21.15.146:0/1090146617 wait complete. 2023-10-03T10:16:35.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.734+0000 7fd868db5700 1 Processor -- start 2023-10-03T10:16:35.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.734+0000 7fd868db5700 1 -- start start 2023-10-03T10:16:35.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.734+0000 7fd868db5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd864099a60 0x7fd86411ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.734+0000 7fd868db5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd86409a3d0 0x7fd86411b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.734+0000 7fd868db5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd86412d380 0x7fd86411b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.734+0000 7fd868db5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86409b3e0 con 0x7fd86412d380 2023-10-03T10:16:35.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.734+0000 7fd868db5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86411cc50 con 0x7fd864099a60 2023-10-03T10:16:35.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.734+0000 7fd868db5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd86409ee70 con 0x7fd86409a3d0 2023-10-03T10:16:35.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.735+0000 7fd86259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd864099a60 0x7fd86411ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.735+0000 7fd86259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd864099a60 0x7fd86411ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58434/0 (socket says 172.21.15.146:58434) 2023-10-03T10:16:35.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.735+0000 7fd86259c700 1 -- 172.21.15.146:0/573163061 learned_addr learned my addr 172.21.15.146:0/573163061 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:35.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.735+0000 7fd862d9d700 1 --2- 172.21.15.146:0/573163061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd86412d380 0x7fd86411b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.735+0000 7fd86259c700 1 -- 172.21.15.146:0/573163061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd86409a3d0 msgr2=0x7fd86411b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.735+0000 7fd86259c700 1 --2- 172.21.15.146:0/573163061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd86409a3d0 0x7fd86411b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.735+0000 7fd86259c700 1 -- 172.21.15.146:0/573163061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd86412d380 msgr2=0x7fd86411b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.735+0000 7fd86259c700 1 --2- 172.21.15.146:0/573163061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd86412d380 0x7fd86411b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.735+0000 7fd86259c700 1 -- 172.21.15.146:0/573163061 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c009a70 con 0x7fd864099a60 2023-10-03T10:16:35.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.735+0000 7fd86259c700 1 --2- 172.21.15.146:0/573163061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd864099a60 0x7fd86411ab20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd85400e730 tx=0x7fd85400eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.735+0000 7fd852ffd700 1 -- 172.21.15.146:0/573163061 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd854013610 con 0x7fd864099a60 2023-10-03T10:16:35.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.735+0000 7fd852ffd700 1 -- 172.21.15.146:0/573163061 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd854013770 con 0x7fd864099a60 2023-10-03T10:16:35.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.735+0000 7fd868db5700 1 -- 172.21.15.146:0/573163061 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd858009550 con 0x7fd864099a60 2023-10-03T10:16:35.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.735+0000 7fd852ffd700 1 -- 172.21.15.146:0/573163061 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd854013b20 con 0x7fd864099a60 2023-10-03T10:16:35.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.735+0000 7fd868db5700 1 -- 172.21.15.146:0/573163061 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd86411e2d0 con 0x7fd864099a60 2023-10-03T10:16:35.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.737+0000 7fd868db5700 1 -- 172.21.15.146:0/573163061 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86409abf0 con 0x7fd864099a60 2023-10-03T10:16:35.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.737+0000 7fd852ffd700 1 -- 172.21.15.146:0/573163061 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd854013c80 con 0x7fd864099a60 2023-10-03T10:16:35.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.737+0000 7fd852ffd700 1 -- 172.21.15.146:0/573163061 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd85403f080 con 0x7fd864099a60 2023-10-03T10:16:35.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.742+0000 7fd852ffd700 1 -- 172.21.15.146:0/573163061 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd854012370 con 0x7fd864099a60 2023-10-03T10:16:35.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.767+0000 7f22080bc700 1 Processor -- start 2023-10-03T10:16:35.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.768+0000 7f22080bc700 1 -- start start 2023-10-03T10:16:35.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.768+0000 7f22080bc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2200131980 0x7f2200131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.768+0000 7f22080bc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f220009bc70 0x7f220009c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.768+0000 7f22080bc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f220009c5c0 0x7f2200138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.768+0000 7f22080bc700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f220006eb30 con 0x7f220009bc70 2023-10-03T10:16:35.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.768+0000 7f22080bc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22000a1640 con 0x7f2200131980 2023-10-03T10:16:35.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.768+0000 7f22080bc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22000a22d0 con 0x7f220009c5c0 2023-10-03T10:16:35.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.768+0000 7f2205e58700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2200131980 0x7f2200131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.768+0000 7f2205e58700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2200131980 0x7f2200131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58450/0 (socket says 172.21.15.146:58450) 2023-10-03T10:16:35.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.768+0000 7f2205e58700 1 -- 172.21.15.146:0/1340007697 learned_addr learned my addr 172.21.15.146:0/1340007697 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:35.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.768+0000 7f2206659700 1 --2- 172.21.15.146:0/1340007697 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f220009c5c0 0x7f2200138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.769+0000 7f2205657700 1 --2- 172.21.15.146:0/1340007697 >> v2:172.21.15.146:3300/0 conn(0x7f220009bc70 0x7f220009c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.769+0000 7f2205e58700 1 -- 172.21.15.146:0/1340007697 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f220009c5c0 msgr2=0x7f2200138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.769+0000 7f2205e58700 1 --2- 172.21.15.146:0/1340007697 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f220009c5c0 0x7f2200138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.769+0000 7f2205e58700 1 -- 172.21.15.146:0/1340007697 >> v2:172.21.15.146:3300/0 conn(0x7f220009bc70 msgr2=0x7f220009c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.769+0000 7f2205e58700 1 --2- 172.21.15.146:0/1340007697 >> v2:172.21.15.146:3300/0 conn(0x7f220009bc70 0x7f220009c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.769+0000 7f2205e58700 1 -- 172.21.15.146:0/1340007697 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2200131550 con 0x7f2200131980 2023-10-03T10:16:35.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.769+0000 7f2205657700 1 --2- 172.21.15.146:0/1340007697 >> v2:172.21.15.146:3300/0 conn(0x7f220009bc70 0x7f220009c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:35.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.769+0000 7f2205e58700 1 --2- 172.21.15.146:0/1340007697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2200131980 0x7f2200131d50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f21fc006fd0 tx=0x7f21fc009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f48214353df7957 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.769+0000 7f2204e56700 1 -- 172.21.15.146:0/1340007697 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc005e30 con 0x7f2200131980 2023-10-03T10:16:35.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.769+0000 7f2204e56700 1 -- 172.21.15.146:0/1340007697 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc004030 con 0x7f2200131980 2023-10-03T10:16:35.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.769+0000 7f2204e56700 1 -- 172.21.15.146:0/1340007697 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc0043e0 con 0x7f2200131980 2023-10-03T10:16:35.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.770+0000 7f22080bc700 1 -- 172.21.15.146:0/1340007697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2200131980 msgr2=0x7f2200131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.770+0000 7f22080bc700 1 --2- 172.21.15.146:0/1340007697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2200131980 0x7f2200131d50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f21fc006fd0 tx=0x7f21fc009c50 comp rx=0 tx=0).stop 2023-10-03T10:16:35.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.770+0000 7f22080bc700 1 -- 172.21.15.146:0/1340007697 shutdown_connections 2023-10-03T10:16:35.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.770+0000 7f22080bc700 1 --2- 172.21.15.146:0/1340007697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2200131980 0x7f2200131d50 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.770+0000 7f22080bc700 1 --2- 172.21.15.146:0/1340007697 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f220009c5c0 0x7f2200138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.770+0000 7f22080bc700 1 --2- 172.21.15.146:0/1340007697 >> v2:172.21.15.146:3300/0 conn(0x7f220009bc70 0x7f220009c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.770+0000 7f22080bc700 1 -- 172.21.15.146:0/1340007697 >> 172.21.15.146:0/1340007697 conn(0x7f22000a2980 msgr2=0x7f22000a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.770+0000 7f22080bc700 1 -- 172.21.15.146:0/1340007697 shutdown_connections 2023-10-03T10:16:35.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.770+0000 7f22080bc700 1 -- 172.21.15.146:0/1340007697 wait complete. 2023-10-03T10:16:35.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.771+0000 7f22080bc700 1 Processor -- start 2023-10-03T10:16:35.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.771+0000 7f22080bc700 1 -- start start 2023-10-03T10:16:35.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.771+0000 7f22080bc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f220009bc70 0x7f22001c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.771+0000 7f22080bc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f220009c5c0 0x7f22001c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.771+0000 7f22080bc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2200131980 0x7f22001c0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.771+0000 7f22080bc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22001c4b50 con 0x7f2200131980 2023-10-03T10:16:35.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.771+0000 7f22080bc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220011d680 con 0x7f220009c5c0 2023-10-03T10:16:35.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.771+0000 7f22080bc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2200130a40 con 0x7f220009bc70 2023-10-03T10:16:35.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.772+0000 7f2205657700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f220009c5c0 0x7f22001c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.772+0000 7f2205657700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f220009c5c0 0x7f22001c4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58454/0 (socket says 172.21.15.146:58454) 2023-10-03T10:16:35.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.772+0000 7f2205657700 1 -- 172.21.15.146:0/2794798852 learned_addr learned my addr 172.21.15.146:0/2794798852 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:35.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.772+0000 7f2205e58700 1 --2- 172.21.15.146:0/2794798852 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f220009bc70 0x7f22001c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.772+0000 7f2205657700 1 -- 172.21.15.146:0/2794798852 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f220009bc70 msgr2=0x7f22001c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.772+0000 7f2205657700 1 --2- 172.21.15.146:0/2794798852 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f220009bc70 0x7f22001c40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.772+0000 7f2205657700 1 -- 172.21.15.146:0/2794798852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2200131980 msgr2=0x7f22001c0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.772+0000 7f2205657700 1 --2- 172.21.15.146:0/2794798852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2200131980 0x7f22001c0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.772+0000 7f2205657700 1 -- 172.21.15.146:0/2794798852 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc009500 con 0x7f220009c5c0 2023-10-03T10:16:35.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.772+0000 7f2205e58700 1 --2- 172.21.15.146:0/2794798852 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f220009bc70 0x7f22001c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:35.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.772+0000 7f2205657700 1 --2- 172.21.15.146:0/2794798852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f220009c5c0 0x7f22001c4610 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f21f000d800 tx=0x7f21f000dbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.772+0000 7f21f67fc700 1 -- 172.21.15.146:0/2794798852 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f0014620 con 0x7f220009c5c0 2023-10-03T10:16:35.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.772+0000 7f21f67fc700 1 -- 172.21.15.146:0/2794798852 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f0014780 con 0x7f220009c5c0 2023-10-03T10:16:35.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.772+0000 7f22080bc700 1 -- 172.21.15.146:0/2794798852 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220011d170 con 0x7f220009c5c0 2023-10-03T10:16:35.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.772+0000 7f21f67fc700 1 -- 172.21.15.146:0/2794798852 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f0014af0 con 0x7f220009c5c0 2023-10-03T10:16:35.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.773+0000 7f22080bc700 1 -- 172.21.15.146:0/2794798852 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220011f4e0 con 0x7f220009c5c0 2023-10-03T10:16:35.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.773+0000 7f21f67fc700 1 -- 172.21.15.146:0/2794798852 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f21f0014c50 con 0x7f220009c5c0 2023-10-03T10:16:35.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.774+0000 7f21f67fc700 1 -- 172.21.15.146:0/2794798852 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f21f003fc20 con 0x7f220009c5c0 2023-10-03T10:16:35.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.774+0000 7f22080bc700 1 -- 172.21.15.146:0/2794798852 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f220004f2a0 con 0x7f220009c5c0 2023-10-03T10:16:35.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.782+0000 7f21f67fc700 1 -- 172.21.15.146:0/2794798852 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21f0011340 con 0x7f220009c5c0 2023-10-03T10:16:35.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.841+0000 7f4652a9f700 1 Processor -- start 2023-10-03T10:16:35.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.841+0000 7f4652a9f700 1 -- start start 2023-10-03T10:16:35.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.842+0000 7f4652a9f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f464c09e950 0x7f464c09ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.842+0000 7f4652a9f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f464c09f260 0x7f464c137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.842+0000 7f4652a9f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f464c138180 0x7f464c13a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.842+0000 7f4652a9f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464c0a06a0 con 0x7f464c09e950 2023-10-03T10:16:35.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.842+0000 7f4652a9f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0a0150 con 0x7f464c138180 2023-10-03T10:16:35.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.842+0000 7f4652a9f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f464c06b920 con 0x7f464c09f260 2023-10-03T10:16:35.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.842+0000 7f465103c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f464c138180 0x7f464c13a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.842+0000 7f465103c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f464c138180 0x7f464c13a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58458/0 (socket says 172.21.15.146:58458) 2023-10-03T10:16:35.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.842+0000 7f465103c700 1 -- 172.21.15.146:0/2674725403 learned_addr learned my addr 172.21.15.146:0/2674725403 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:35.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.842+0000 7f464bfff700 1 --2- 172.21.15.146:0/2674725403 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f464c09f260 0x7f464c137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.842+0000 7f465083b700 1 --2- 172.21.15.146:0/2674725403 >> v2:172.21.15.146:3300/0 conn(0x7f464c09e950 0x7f464c09ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.842+0000 7f464bfff700 1 -- 172.21.15.146:0/2674725403 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f464c138180 msgr2=0x7f464c13a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.842+0000 7f464bfff700 1 --2- 172.21.15.146:0/2674725403 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f464c138180 0x7f464c13a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.842+0000 7f464bfff700 1 -- 172.21.15.146:0/2674725403 >> v2:172.21.15.146:3300/0 conn(0x7f464c09e950 msgr2=0x7f464c09ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.842+0000 7f464bfff700 1 --2- 172.21.15.146:0/2674725403 >> v2:172.21.15.146:3300/0 conn(0x7f464c09e950 0x7f464c09ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.842+0000 7f464bfff700 1 -- 172.21.15.146:0/2674725403 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c06d8e0 con 0x7f464c09f260 2023-10-03T10:16:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.842+0000 7f465083b700 1 --2- 172.21.15.146:0/2674725403 >> v2:172.21.15.146:3300/0 conn(0x7f464c09e950 0x7f464c09ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.842+0000 7f465103c700 1 --2- 172.21.15.146:0/2674725403 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f464c138180 0x7f464c13a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.843+0000 7f464bfff700 1 --2- 172.21.15.146:0/2674725403 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f464c09f260 0x7f464c137c40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4638009820 tx=0x7f4638009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=868447e3930887c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.843+0000 7f464b7fe700 1 -- 172.21.15.146:0/2674725403 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4638005e30 con 0x7f464c09f260 2023-10-03T10:16:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.843+0000 7f464b7fe700 1 -- 172.21.15.146:0/2674725403 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4638006030 con 0x7f464c09f260 2023-10-03T10:16:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.843+0000 7f464b7fe700 1 -- 172.21.15.146:0/2674725403 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46380063c0 con 0x7f464c09f260 2023-10-03T10:16:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.843+0000 7f4652a9f700 1 -- 172.21.15.146:0/2674725403 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f464c09f260 msgr2=0x7f464c137c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.843+0000 7f4652a9f700 1 --2- 172.21.15.146:0/2674725403 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f464c09f260 0x7f464c137c40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4638009820 tx=0x7f4638009b30 comp rx=0 tx=0).stop 2023-10-03T10:16:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.843+0000 7f4652a9f700 1 -- 172.21.15.146:0/2674725403 shutdown_connections 2023-10-03T10:16:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.844+0000 7f4652a9f700 1 --2- 172.21.15.146:0/2674725403 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f464c138180 0x7f464c13a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.844+0000 7f4652a9f700 1 --2- 172.21.15.146:0/2674725403 >> v2:172.21.15.146:3300/0 conn(0x7f464c09e950 0x7f464c09ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.844+0000 7f4652a9f700 1 --2- 172.21.15.146:0/2674725403 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f464c09f260 0x7f464c137c40 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.844+0000 7f4652a9f700 1 -- 172.21.15.146:0/2674725403 >> 172.21.15.146:0/2674725403 conn(0x7f464c0a4470 msgr2=0x7f464c0a4870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.844+0000 7f4652a9f700 1 -- 172.21.15.146:0/2674725403 shutdown_connections 2023-10-03T10:16:35.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.844+0000 7f4652a9f700 1 -- 172.21.15.146:0/2674725403 wait complete. 2023-10-03T10:16:35.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.844+0000 7f4652a9f700 1 Processor -- start 2023-10-03T10:16:35.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.845+0000 7f4652a9f700 1 -- start start 2023-10-03T10:16:35.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.845+0000 7f4652a9f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f464c09e950 0x7f464c1c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.845+0000 7f4652a9f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f464c09f260 0x7f464c1c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.845+0000 7f4652a9f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f464c138180 0x7f464c1c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.845+0000 7f4652a9f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c123400 con 0x7f464c09e950 2023-10-03T10:16:35.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.845+0000 7f4652a9f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c1217d0 con 0x7f464c138180 2023-10-03T10:16:35.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.845+0000 7f4652a9f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f464c121d50 con 0x7f464c09f260 2023-10-03T10:16:35.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.845+0000 7f464bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f464c09f260 0x7f464c1c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.845+0000 7f465083b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f464c09e950 0x7f464c1c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.845+0000 7f464bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f464c09f260 0x7f464c1c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40620/0 (socket says 172.21.15.146:40620) 2023-10-03T10:16:35.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.845+0000 7f465083b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f464c09e950 0x7f464c1c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33186/0 (socket says 172.21.15.146:33186) 2023-10-03T10:16:35.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.845+0000 7f464bfff700 1 -- 172.21.15.146:0/1300079195 learned_addr learned my addr 172.21.15.146:0/1300079195 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:35.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.846+0000 7f465083b700 1 -- 172.21.15.146:0/1300079195 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f464c09f260 msgr2=0x7f464c1c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.846+0000 7f465083b700 1 --2- 172.21.15.146:0/1300079195 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f464c09f260 0x7f464c1c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.846+0000 7f465083b700 1 -- 172.21.15.146:0/1300079195 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f464c138180 msgr2=0x7f464c1c8e00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:16:35.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.846+0000 7f465083b700 1 --2- 172.21.15.146:0/1300079195 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f464c138180 0x7f464c1c8e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.846+0000 7f465083b700 1 -- 172.21.15.146:0/1300079195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4644009b30 con 0x7f464c09e950 2023-10-03T10:16:35.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.846+0000 7f464bfff700 1 --2- 172.21.15.146:0/1300079195 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f464c09f260 0x7f464c1c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.846+0000 7f465083b700 1 --2- 172.21.15.146:0/1300079195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f464c09e950 0x7f464c1c8380 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f464000e810 tx=0x7f464000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.846+0000 7f46497fa700 1 -- 172.21.15.146:0/1300079195 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464000c070 con 0x7f464c09e950 2023-10-03T10:16:35.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.846+0000 7f46497fa700 1 -- 172.21.15.146:0/1300079195 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4640005c20 con 0x7f464c09e950 2023-10-03T10:16:35.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.846+0000 7f4652a9f700 1 -- 172.21.15.146:0/1300079195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4638009430 con 0x7f464c09e950 2023-10-03T10:16:35.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.846+0000 7f4652a9f700 1 -- 172.21.15.146:0/1300079195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464c123e70 con 0x7f464c09e950 2023-10-03T10:16:35.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.847+0000 7f46497fa700 1 -- 172.21.15.146:0/1300079195 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640006030 con 0x7f464c09e950 2023-10-03T10:16:35.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.847+0000 7f46497fa700 1 -- 172.21.15.146:0/1300079195 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4640006190 con 0x7f464c09e950 2023-10-03T10:16:35.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.847+0000 7f46497fa700 1 -- 172.21.15.146:0/1300079195 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f464003f3f0 con 0x7f464c09e950 2023-10-03T10:16:35.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.848+0000 7f4652a9f700 1 -- 172.21.15.146:0/1300079195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f462c0052e0 con 0x7f464c09e950 2023-10-03T10:16:35.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.857+0000 7f46497fa700 1 -- 172.21.15.146:0/1300079195 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4640006440 con 0x7f464c09e950 2023-10-03T10:16:35.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.868+0000 7f28e7970700 1 Processor -- start 2023-10-03T10:16:35.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.868+0000 7f28e7970700 1 -- start start 2023-10-03T10:16:35.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.868+0000 7f28e7970700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28e009e870 0x7f28e009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.868+0000 7f28e7970700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28e0131f40 0x7f28e0139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.868+0000 7f28e7970700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e009c970 con 0x7f28e009f180 2023-10-03T10:16:35.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.869+0000 7f28e7970700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e00a0920 con 0x7f28e0131f40 2023-10-03T10:16:35.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.869+0000 7f28e7970700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28e009f9c0 con 0x7f28e009e870 2023-10-03T10:16:35.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.869+0000 7f28e4f0b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f28e009f180 0x7f28e0131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43086/0 (socket says 172.21.15.146:43086) 2023-10-03T10:16:35.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.869+0000 7f28e4f0b700 1 -- 172.21.15.146:0/3874730624 learned_addr learned my addr 172.21.15.146:0/3874730624 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:35.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.869+0000 7f28e5f0d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28e0131f40 0x7f28e0139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.869+0000 7f28e570c700 1 --2- 172.21.15.146:0/3874730624 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28e009e870 0x7f28e009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.869+0000 7f28e5f0d700 1 -- 172.21.15.146:0/3874730624 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28e009e870 msgr2=0x7f28e009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.869+0000 7f28e5f0d700 1 --2- 172.21.15.146:0/3874730624 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28e009e870 0x7f28e009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.869+0000 7f28e5f0d700 1 -- 172.21.15.146:0/3874730624 >> v1:172.21.15.146:6789/0 conn(0x7f28e009f180 legacy=0x7f28e0131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.869+0000 7f28e5f0d700 1 -- 172.21.15.146:0/3874730624 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e009bab0 con 0x7f28e0131f40 2023-10-03T10:16:35.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.869+0000 7f28e570c700 1 --2- 172.21.15.146:0/3874730624 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28e009e870 0x7f28e009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:35.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.869+0000 7f28e5f0d700 1 --2- 172.21.15.146:0/3874730624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28e0131f40 0x7f28e0139ca0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f28d8009dc0 tx=0x7f28d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=651d4244b35fe543 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.869+0000 7f28d7fff700 1 -- 172.21.15.146:0/3874730624 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d800e070 con 0x7f28e0131f40 2023-10-03T10:16:35.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.869+0000 7f28d7fff700 1 -- 172.21.15.146:0/3874730624 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d800bbd0 con 0x7f28e0131f40 2023-10-03T10:16:35.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.869+0000 7f28d7fff700 1 -- 172.21.15.146:0/3874730624 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d8012430 con 0x7f28e0131f40 2023-10-03T10:16:35.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.870+0000 7f28e7970700 1 -- 172.21.15.146:0/3874730624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28e0131f40 msgr2=0x7f28e0139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.870+0000 7f28e7970700 1 --2- 172.21.15.146:0/3874730624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28e0131f40 0x7f28e0139ca0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f28d8009dc0 tx=0x7f28d800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:35.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.870+0000 7f28e7970700 1 -- 172.21.15.146:0/3874730624 shutdown_connections 2023-10-03T10:16:35.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.870+0000 7f28e7970700 1 --2- 172.21.15.146:0/3874730624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28e0131f40 0x7f28e0139ca0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.870+0000 7f28e7970700 1 --2- 172.21.15.146:0/3874730624 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28e009e870 0x7f28e009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.870+0000 7f28e7970700 1 -- 172.21.15.146:0/3874730624 >> 172.21.15.146:0/3874730624 conn(0x7f28e00a4430 msgr2=0x7f28e00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.870+0000 7f28e7970700 1 -- 172.21.15.146:0/3874730624 shutdown_connections 2023-10-03T10:16:35.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.870+0000 7f28e7970700 1 -- 172.21.15.146:0/3874730624 wait complete. 2023-10-03T10:16:35.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.871+0000 7f28e7970700 1 Processor -- start 2023-10-03T10:16:35.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.872+0000 7f28e7970700 1 -- start start 2023-10-03T10:16:35.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.872+0000 7f28e7970700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28e009e870 0x7f28e006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.872+0000 7f28e7970700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28e009f180 0x7f28e006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.872+0000 7f28e7970700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28e0131f40 0x7f28e006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.872+0000 7f28e7970700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e0124da0 con 0x7f28e0131f40 2023-10-03T10:16:35.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.872+0000 7f28e7970700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e0125de0 con 0x7f28e009f180 2023-10-03T10:16:35.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.872+0000 7f28e7970700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28e009dc10 con 0x7f28e009e870 2023-10-03T10:16:35.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.872+0000 7f28e570c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28e009e870 0x7f28e006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.872+0000 7f28e570c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28e009e870 0x7f28e006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40632/0 (socket says 172.21.15.146:40632) 2023-10-03T10:16:35.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.872+0000 7f28e570c700 1 -- 172.21.15.146:0/3267696097 learned_addr learned my addr 172.21.15.146:0/3267696097 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:35.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.872+0000 7f28e5f0d700 1 --2- 172.21.15.146:0/3267696097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28e0131f40 0x7f28e006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.872+0000 7f28e4f0b700 1 --2- 172.21.15.146:0/3267696097 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28e009f180 0x7f28e006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.873+0000 7f28e5f0d700 1 -- 172.21.15.146:0/3267696097 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28e009e870 msgr2=0x7f28e006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.873+0000 7f28e5f0d700 1 --2- 172.21.15.146:0/3267696097 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28e009e870 0x7f28e006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.873+0000 7f28e5f0d700 1 -- 172.21.15.146:0/3267696097 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28e009f180 msgr2=0x7f28e006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.873+0000 7f28e5f0d700 1 --2- 172.21.15.146:0/3267696097 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28e009f180 0x7f28e006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.873+0000 7f28e5f0d700 1 -- 172.21.15.146:0/3267696097 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d8009a70 con 0x7f28e0131f40 2023-10-03T10:16:35.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.873+0000 7f28e5f0d700 1 --2- 172.21.15.146:0/3267696097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28e0131f40 0x7f28e006c330 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f28e00673f0 tx=0x7f28d8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.873+0000 7f28d5ffb700 1 -- 172.21.15.146:0/3267696097 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d8012430 con 0x7f28e0131f40 2023-10-03T10:16:35.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.873+0000 7f28d5ffb700 1 -- 172.21.15.146:0/3267696097 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d8020070 con 0x7f28e0131f40 2023-10-03T10:16:35.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.873+0000 7f28d5ffb700 1 -- 172.21.15.146:0/3267696097 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d8004280 con 0x7f28e0131f40 2023-10-03T10:16:35.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.873+0000 7f28e7970700 1 -- 172.21.15.146:0/3267696097 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e0125120 con 0x7f28e0131f40 2023-10-03T10:16:35.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.874+0000 7f28e7970700 1 -- 172.21.15.146:0/3267696097 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e0125570 con 0x7f28e0131f40 2023-10-03T10:16:35.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.874+0000 7f28d5ffb700 1 -- 172.21.15.146:0/3267696097 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f28d80043e0 con 0x7f28e0131f40 2023-10-03T10:16:35.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.875+0000 7f28e7970700 1 -- 172.21.15.146:0/3267696097 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e011ce70 con 0x7f28e0131f40 2023-10-03T10:16:35.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.875+0000 7f28d5ffb700 1 -- 172.21.15.146:0/3267696097 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f28d8022070 con 0x7f28e0131f40 2023-10-03T10:16:35.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.884+0000 7f28d5ffb700 1 -- 172.21.15.146:0/3267696097 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f28d801c400 con 0x7f28e0131f40 2023-10-03T10:16:35.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.942+0000 7fd868db5700 1 -- 172.21.15.146:0/573163061 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd86411df20 con 0x7fd864099a60 2023-10-03T10:16:35.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.943+0000 7fd852ffd700 1 -- 172.21.15.146:0/573163061 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd854021030 con 0x7fd864099a60 2023-10-03T10:16:35.943 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:35.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.946+0000 7fd868db5700 1 -- 172.21.15.146:0/573163061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd864099a60 msgr2=0x7fd86411ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.946+0000 7fd868db5700 1 --2- 172.21.15.146:0/573163061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd864099a60 0x7fd86411ab20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd85400e730 tx=0x7fd85400eaf0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.946+0000 7fd868db5700 1 -- 172.21.15.146:0/573163061 shutdown_connections 2023-10-03T10:16:35.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.946+0000 7fd868db5700 1 --2- 172.21.15.146:0/573163061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd86412d380 0x7fd86411b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.946+0000 7fd868db5700 1 --2- 172.21.15.146:0/573163061 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd864099a60 0x7fd86411ab20 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.946+0000 7fd868db5700 1 --2- 172.21.15.146:0/573163061 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd86409a3d0 0x7fd86411b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.946+0000 7fd868db5700 1 -- 172.21.15.146:0/573163061 >> 172.21.15.146:0/573163061 conn(0x7fd8640a2980 msgr2=0x7fd86409d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.946+0000 7fd868db5700 1 -- 172.21.15.146:0/573163061 shutdown_connections 2023-10-03T10:16:35.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.946+0000 7fd868db5700 1 -- 172.21.15.146:0/573163061 wait complete. 2023-10-03T10:16:35.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:35.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.997+0000 7f22080bc700 1 -- 172.21.15.146:0/2794798852 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f220006bce0 con 0x7f220009c5c0 2023-10-03T10:16:35.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.997+0000 7f21f67fc700 1 -- 172.21.15.146:0/2794798852 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f21f0025b00 con 0x7f220009c5c0 2023-10-03T10:16:35.998 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:36.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.999+0000 7f22080bc700 1 -- 172.21.15.146:0/2794798852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f220009c5c0 msgr2=0x7f22001c4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.999+0000 7f22080bc700 1 --2- 172.21.15.146:0/2794798852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f220009c5c0 0x7f22001c4610 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f21f000d800 tx=0x7f21f000dbc0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.999+0000 7f22080bc700 1 -- 172.21.15.146:0/2794798852 shutdown_connections 2023-10-03T10:16:36.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.999+0000 7f22080bc700 1 --2- 172.21.15.146:0/2794798852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2200131980 0x7f22001c0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.999+0000 7f22080bc700 1 --2- 172.21.15.146:0/2794798852 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f220009bc70 0x7f22001c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.999+0000 7f22080bc700 1 --2- 172.21.15.146:0/2794798852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f220009c5c0 0x7f22001c4610 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.999+0000 7f22080bc700 1 -- 172.21.15.146:0/2794798852 >> 172.21.15.146:0/2794798852 conn(0x7f22000a2980 msgr2=0x7f220009f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.999+0000 7f22080bc700 1 -- 172.21.15.146:0/2794798852 shutdown_connections 2023-10-03T10:16:36.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:35.999+0000 7f22080bc700 1 -- 172.21.15.146:0/2794798852 wait complete. 2023-10-03T10:16:36.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:36.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:36.056+0000 7f4652a9f700 1 -- 172.21.15.146:0/1300079195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f462c005590 con 0x7f464c09e950 2023-10-03T10:16:36.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:36.056+0000 7f46497fa700 1 -- 172.21.15.146:0/1300079195 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f464002a090 con 0x7f464c09e950 2023-10-03T10:16:36.057 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:36.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:36.058+0000 7f4652a9f700 1 -- 172.21.15.146:0/1300079195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f464c09e950 msgr2=0x7f464c1c8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:36.059+0000 7f4652a9f700 1 --2- 172.21.15.146:0/1300079195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f464c09e950 0x7f464c1c8380 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f464000e810 tx=0x7f464000eb20 comp rx=0 tx=0).stop 2023-10-03T10:16:36.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:36.059+0000 7f4652a9f700 1 -- 172.21.15.146:0/1300079195 shutdown_connections 2023-10-03T10:16:36.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:36.059+0000 7f4652a9f700 1 --2- 172.21.15.146:0/1300079195 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f464c138180 0x7f464c1c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:36.059+0000 7f4652a9f700 1 --2- 172.21.15.146:0/1300079195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f464c09e950 0x7f464c1c8380 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:36.059+0000 7f4652a9f700 1 --2- 172.21.15.146:0/1300079195 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f464c09f260 0x7f464c1c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:36.059+0000 7f4652a9f700 1 -- 172.21.15.146:0/1300079195 >> 172.21.15.146:0/1300079195 conn(0x7f464c0a4470 msgr2=0x7f464c0a1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:36.059+0000 7f4652a9f700 1 -- 172.21.15.146:0/1300079195 shutdown_connections 2023-10-03T10:16:36.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:36.059+0000 7f4652a9f700 1 -- 172.21.15.146:0/1300079195 wait complete. 2023-10-03T10:16:36.071 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:36.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:36.079+0000 7f28e7970700 1 -- 172.21.15.146:0/3267696097 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f28e004f2a0 con 0x7f28e0131f40 2023-10-03T10:16:36.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:36.079+0000 7f28d5ffb700 1 -- 172.21.15.146:0/3267696097 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f28d8026bd0 con 0x7f28e0131f40 2023-10-03T10:16:36.080 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:36.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:36.081+0000 7f28e7970700 1 -- 172.21.15.146:0/3267696097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28e0131f40 msgr2=0x7f28e006c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:36.081+0000 7f28e7970700 1 --2- 172.21.15.146:0/3267696097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28e0131f40 0x7f28e006c330 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f28e00673f0 tx=0x7f28d8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:36.081+0000 7f28e7970700 1 -- 172.21.15.146:0/3267696097 shutdown_connections 2023-10-03T10:16:36.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:36.081+0000 7f28e7970700 1 --2- 172.21.15.146:0/3267696097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28e0131f40 0x7f28e006c330 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:36.081+0000 7f28e7970700 1 --2- 172.21.15.146:0/3267696097 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28e009e870 0x7f28e006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:36.081+0000 7f28e7970700 1 --2- 172.21.15.146:0/3267696097 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28e009f180 0x7f28e006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:36.081+0000 7f28e7970700 1 -- 172.21.15.146:0/3267696097 >> 172.21.15.146:0/3267696097 conn(0x7f28e00a4430 msgr2=0x7f28e00721a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:36.081+0000 7f28e7970700 1 -- 172.21.15.146:0/3267696097 shutdown_connections 2023-10-03T10:16:36.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:36.081+0000 7f28e7970700 1 -- 172.21.15.146:0/3267696097 wait complete. 2023-10-03T10:16:36.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:36.964 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:37.013 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:37.072 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:37.095 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:37.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.102+0000 7f0752922700 1 Processor -- start 2023-10-03T10:16:37.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.102+0000 7f0752922700 1 -- start start 2023-10-03T10:16:37.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.103+0000 7f0752922700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f074c133ad0 0x7f074c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.103+0000 7f0752922700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c130bc0 0x7f074c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.103+0000 7f0752922700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074c06b2d0 con 0x7f074c1300a0 2023-10-03T10:16:37.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.103+0000 7f0752922700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074c133610 con 0x7f074c133ad0 2023-10-03T10:16:37.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.103+0000 7f0752922700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f074c09a500 con 0x7f074c130bc0 2023-10-03T10:16:37.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.103+0000 7f0750ebf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c130bc0 0x7f074c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.103+0000 7f074bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f074c133ad0 0x7f074c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.103+0000 7f074b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f074c1300a0 0x7f074c1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43096/0 (socket says 172.21.15.146:43096) 2023-10-03T10:16:37.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.103+0000 7f0750ebf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c130bc0 0x7f074c13b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40648/0 (socket says 172.21.15.146:40648) 2023-10-03T10:16:37.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.103+0000 7f074b7fe700 1 -- 172.21.15.146:0/56362755 learned_addr learned my addr 172.21.15.146:0/56362755 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:37.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.103+0000 7f074affd700 1 -- 172.21.15.146:0/56362755 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987268452 0 0) 0x7f074c06b2d0 con 0x7f074c1300a0 2023-10-03T10:16:37.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.103+0000 7f0750ebf700 1 -- 172.21.15.146:0/56362755 >> v2:172.21.15.146:3300/0 conn(0x7f074c133ad0 msgr2=0x7f074c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:37.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.103+0000 7f0750ebf700 1 --2- 172.21.15.146:0/56362755 >> v2:172.21.15.146:3300/0 conn(0x7f074c133ad0 0x7f074c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.103+0000 7f0750ebf700 1 -- 172.21.15.146:0/56362755 >> v1:172.21.15.146:6789/0 conn(0x7f074c1300a0 legacy=0x7f074c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.103+0000 7f0750ebf700 1 -- 172.21.15.146:0/56362755 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c1338b0 con 0x7f074c130bc0 2023-10-03T10:16:37.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.103+0000 7f0750ebf700 1 --2- 172.21.15.146:0/56362755 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c130bc0 0x7f074c13b990 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0744009d90 tx=0x7f074400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d1cfe21206eb4d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.103+0000 7f074affd700 1 -- 172.21.15.146:0/56362755 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074400e070 con 0x7f074c130bc0 2023-10-03T10:16:37.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.104+0000 7f074affd700 1 -- 172.21.15.146:0/56362755 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074400bb20 con 0x7f074c130bc0 2023-10-03T10:16:37.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.104+0000 7f074affd700 1 -- 172.21.15.146:0/56362755 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0744012430 con 0x7f074c130bc0 2023-10-03T10:16:37.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.104+0000 7f0752922700 1 -- 172.21.15.146:0/56362755 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c130bc0 msgr2=0x7f074c13b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.104+0000 7f0752922700 1 --2- 172.21.15.146:0/56362755 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c130bc0 0x7f074c13b990 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0744009d90 tx=0x7f074400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:37.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.104+0000 7f0752922700 1 -- 172.21.15.146:0/56362755 shutdown_connections 2023-10-03T10:16:37.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.104+0000 7f0752922700 1 --2- 172.21.15.146:0/56362755 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c130bc0 0x7f074c13b990 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.104+0000 7f0752922700 1 --2- 172.21.15.146:0/56362755 >> v2:172.21.15.146:3300/0 conn(0x7f074c133ad0 0x7f074c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.104+0000 7f0752922700 1 -- 172.21.15.146:0/56362755 >> 172.21.15.146:0/56362755 conn(0x7f074c099c40 msgr2=0x7f074c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.104+0000 7f0752922700 1 -- 172.21.15.146:0/56362755 shutdown_connections 2023-10-03T10:16:37.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.105+0000 7f0752922700 1 -- 172.21.15.146:0/56362755 wait complete. 2023-10-03T10:16:37.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.106+0000 7f0752922700 1 Processor -- start 2023-10-03T10:16:37.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.106+0000 7f0752922700 1 -- start start 2023-10-03T10:16:37.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.107+0000 7f0752922700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1300a0 0x7f074c071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.107+0000 7f0752922700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c130bc0 0x7f074c0718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.107+0000 7f0752922700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c133ad0 0x7f074c071df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.107+0000 7f0752922700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c11e100 con 0x7f074c1300a0 2023-10-03T10:16:37.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.107+0000 7f0752922700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c12f6f0 con 0x7f074c130bc0 2023-10-03T10:16:37.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.107+0000 7f0752922700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f074c12dd00 con 0x7f074c133ad0 2023-10-03T10:16:37.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.107+0000 7f074bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1300a0 0x7f074c071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.107+0000 7f074bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1300a0 0x7f074c071370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33208/0 (socket says 172.21.15.146:33208) 2023-10-03T10:16:37.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.107+0000 7f074bfff700 1 -- 172.21.15.146:0/2304465161 learned_addr learned my addr 172.21.15.146:0/2304465161 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:37.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.107+0000 7f074b7fe700 1 --2- 172.21.15.146:0/2304465161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c130bc0 0x7f074c0718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.107+0000 7f0750ebf700 1 --2- 172.21.15.146:0/2304465161 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c133ad0 0x7f074c071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.107+0000 7f074bfff700 1 -- 172.21.15.146:0/2304465161 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c133ad0 msgr2=0x7f074c071df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.107+0000 7f074bfff700 1 --2- 172.21.15.146:0/2304465161 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c133ad0 0x7f074c071df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.107+0000 7f074bfff700 1 -- 172.21.15.146:0/2304465161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c130bc0 msgr2=0x7f074c0718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.107+0000 7f074bfff700 1 --2- 172.21.15.146:0/2304465161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c130bc0 0x7f074c0718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.107+0000 7f074bfff700 1 -- 172.21.15.146:0/2304465161 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0744009a70 con 0x7f074c1300a0 2023-10-03T10:16:37.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.108+0000 7f074bfff700 1 --2- 172.21.15.146:0/2304465161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1300a0 0x7f074c071370 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f073c00e9b0 tx=0x7f073c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.108+0000 7f0748ff9700 1 -- 172.21.15.146:0/2304465161 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c009710 con 0x7f074c1300a0 2023-10-03T10:16:37.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.108+0000 7f0748ff9700 1 -- 172.21.15.146:0/2304465161 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073c00c850 con 0x7f074c1300a0 2023-10-03T10:16:37.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.108+0000 7f0752922700 1 -- 172.21.15.146:0/2304465161 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074c0727b0 con 0x7f074c1300a0 2023-10-03T10:16:37.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.108+0000 7f0748ff9700 1 -- 172.21.15.146:0/2304465161 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c00cbc0 con 0x7f074c1300a0 2023-10-03T10:16:37.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.108+0000 7f0752922700 1 -- 172.21.15.146:0/2304465161 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074c120690 con 0x7f074c1300a0 2023-10-03T10:16:37.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.109+0000 7f0752922700 1 -- 172.21.15.146:0/2304465161 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074c09cb20 con 0x7f074c1300a0 2023-10-03T10:16:37.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.109+0000 7f0748ff9700 1 -- 172.21.15.146:0/2304465161 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f073c00cd20 con 0x7f074c1300a0 2023-10-03T10:16:37.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.109+0000 7f0748ff9700 1 -- 172.21.15.146:0/2304465161 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f073c03f970 con 0x7f074c1300a0 2023-10-03T10:16:37.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.115+0000 7f0748ff9700 1 -- 172.21.15.146:0/2304465161 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f073c01be10 con 0x7f074c1300a0 2023-10-03T10:16:37.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.146+0000 7f125a4b4700 1 Processor -- start 2023-10-03T10:16:37.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.146+0000 7f125a4b4700 1 -- start start 2023-10-03T10:16:37.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.147+0000 7f125a4b4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12540a0a30 0x7f12540a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.147+0000 7f125a4b4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1254130670 0x7f12541381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.147+0000 7f125a4b4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12540a1e70 con 0x7f12540a1340 2023-10-03T10:16:37.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.147+0000 7f125a4b4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125409a720 con 0x7f12540a0a30 2023-10-03T10:16:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.147+0000 7f125a4b4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f125409b300 con 0x7f1254130670 2023-10-03T10:16:37.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.147+0000 7f12537fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f12540a1340 0x7f125412ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43104/0 (socket says 172.21.15.146:43104) 2023-10-03T10:16:37.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.147+0000 7f1258a51700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1254130670 0x7f12541381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.147+0000 7f12537fe700 1 -- 172.21.15.146:0/2234695400 learned_addr learned my addr 172.21.15.146:0/2234695400 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:37.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.147+0000 7f1253fff700 1 --2- 172.21.15.146:0/2234695400 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12540a0a30 0x7f12540a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.147+0000 7f1252ffd700 1 -- 172.21.15.146:0/2234695400 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611070549 0 0) 0x7f12540a1e70 con 0x7f12540a1340 2023-10-03T10:16:37.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.147+0000 7f1252ffd700 1 -- 172.21.15.146:0/2234695400 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f123c0035b0 con 0x7f12540a1340 2023-10-03T10:16:37.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.147+0000 7f1253fff700 1 -- 172.21.15.146:0/2234695400 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1254130670 msgr2=0x7f12541381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:37.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.147+0000 7f1253fff700 1 --2- 172.21.15.146:0/2234695400 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1254130670 0x7f12541381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.147+0000 7f1253fff700 1 -- 172.21.15.146:0/2234695400 >> v1:172.21.15.146:6789/0 conn(0x7f12540a1340 legacy=0x7f125412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.147+0000 7f1253fff700 1 -- 172.21.15.146:0/2234695400 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125409abc0 con 0x7f12540a0a30 2023-10-03T10:16:37.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.147+0000 7f1258a51700 1 --2- 172.21.15.146:0/2234695400 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1254130670 0x7f12541381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.148+0000 7f1253fff700 1 --2- 172.21.15.146:0/2234695400 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12540a0a30 0x7f12540a0e00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f124400dc70 tx=0x7f124400df80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f3d62d5715233e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.148+0000 7f1252ffd700 1 -- 172.21.15.146:0/2234695400 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244012070 con 0x7f12540a0a30 2023-10-03T10:16:37.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.148+0000 7f1252ffd700 1 -- 172.21.15.146:0/2234695400 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1244005a20 con 0x7f12540a0a30 2023-10-03T10:16:37.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.148+0000 7f1252ffd700 1 -- 172.21.15.146:0/2234695400 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244005db0 con 0x7f12540a0a30 2023-10-03T10:16:37.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.148+0000 7f125a4b4700 1 -- 172.21.15.146:0/2234695400 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12540a0a30 msgr2=0x7f12540a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.148+0000 7f125a4b4700 1 --2- 172.21.15.146:0/2234695400 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12540a0a30 0x7f12540a0e00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f124400dc70 tx=0x7f124400df80 comp rx=0 tx=0).stop 2023-10-03T10:16:37.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.149+0000 7f125a4b4700 1 -- 172.21.15.146:0/2234695400 shutdown_connections 2023-10-03T10:16:37.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.149+0000 7f125a4b4700 1 --2- 172.21.15.146:0/2234695400 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1254130670 0x7f12541381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.149+0000 7f125a4b4700 1 --2- 172.21.15.146:0/2234695400 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12540a0a30 0x7f12540a0e00 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.149+0000 7f125a4b4700 1 -- 172.21.15.146:0/2234695400 >> 172.21.15.146:0/2234695400 conn(0x7f12540a2980 msgr2=0x7f12540a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.149+0000 7f125a4b4700 1 -- 172.21.15.146:0/2234695400 shutdown_connections 2023-10-03T10:16:37.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.149+0000 7f125a4b4700 1 -- 172.21.15.146:0/2234695400 wait complete. 2023-10-03T10:16:37.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.150+0000 7f125a4b4700 1 Processor -- start 2023-10-03T10:16:37.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.150+0000 7f125a4b4700 1 -- start start 2023-10-03T10:16:37.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.151+0000 7f125a4b4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12540a0a30 0x7f12541c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.151+0000 7f125a4b4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12540a1340 0x7f12541c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.151+0000 7f125a4b4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1254130670 0x7f12541c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.151+0000 7f125a4b4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125411bd70 con 0x7f12540a1340 2023-10-03T10:16:37.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.151+0000 7f125a4b4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125411bb80 con 0x7f1254130670 2023-10-03T10:16:37.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.151+0000 7f125a4b4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f125409fc10 con 0x7f12540a0a30 2023-10-03T10:16:37.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.151+0000 7f1253fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12540a0a30 0x7f12541c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.151+0000 7f1253fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12540a0a30 0x7f12541c3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40674/0 (socket says 172.21.15.146:40674) 2023-10-03T10:16:37.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.151+0000 7f1253fff700 1 -- 172.21.15.146:0/362292162 learned_addr learned my addr 172.21.15.146:0/362292162 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:37.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.151+0000 7f1258a51700 1 --2- 172.21.15.146:0/362292162 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1254130670 0x7f12541c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.151+0000 7f12537fe700 1 --2- 172.21.15.146:0/362292162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12540a1340 0x7f12541c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.151+0000 7f1253fff700 1 -- 172.21.15.146:0/362292162 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1254130670 msgr2=0x7f12541c48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.151+0000 7f1253fff700 1 --2- 172.21.15.146:0/362292162 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1254130670 0x7f12541c48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.151+0000 7f1253fff700 1 -- 172.21.15.146:0/362292162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12540a1340 msgr2=0x7f12541c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.151+0000 7f1253fff700 1 --2- 172.21.15.146:0/362292162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12540a1340 0x7f12541c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.151+0000 7f1253fff700 1 -- 172.21.15.146:0/362292162 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c00ba90 con 0x7f12540a0a30 2023-10-03T10:16:37.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.151+0000 7f1253fff700 1 --2- 172.21.15.146:0/362292162 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12540a0a30 0x7f12541c3e20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f124400f330 tx=0x7f1244004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.152+0000 7f1250ff9700 1 -- 172.21.15.146:0/362292162 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244006ee0 con 0x7f12540a0a30 2023-10-03T10:16:37.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.152+0000 7f1250ff9700 1 -- 172.21.15.146:0/362292162 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1244010d60 con 0x7f12540a0a30 2023-10-03T10:16:37.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.152+0000 7f125a4b4700 1 -- 172.21.15.146:0/362292162 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124400d8d0 con 0x7f12540a0a30 2023-10-03T10:16:37.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.152+0000 7f1250ff9700 1 -- 172.21.15.146:0/362292162 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12440038e0 con 0x7f12540a0a30 2023-10-03T10:16:37.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.152+0000 7f125a4b4700 1 -- 172.21.15.146:0/362292162 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125411db00 con 0x7f12540a0a30 2023-10-03T10:16:37.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.153+0000 7f1250ff9700 1 -- 172.21.15.146:0/362292162 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f124401d070 con 0x7f12540a0a30 2023-10-03T10:16:37.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.153+0000 7f125a4b4700 1 -- 172.21.15.146:0/362292162 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125411d960 con 0x7f12540a0a30 2023-10-03T10:16:37.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.153+0000 7f1250ff9700 1 -- 172.21.15.146:0/362292162 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1244044130 con 0x7f12540a0a30 2023-10-03T10:16:37.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.158+0000 7f1250ff9700 1 -- 172.21.15.146:0/362292162 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f125411d960 con 0x7f12540a0a30 2023-10-03T10:16:37.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.213+0000 7fbb99d9d700 1 Processor -- start 2023-10-03T10:16:37.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.213+0000 7fbb99d9d700 1 -- start start 2023-10-03T10:16:37.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.214+0000 7fbb99d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbb9409ef80 0x7fbb94138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.214+0000 7fbb99d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb9409f370 0x7fbb9413b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.214+0000 7fbb99d9d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9409af80 con 0x7fbb9409a150 2023-10-03T10:16:37.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.214+0000 7fbb99d9d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb9409a520 con 0x7fbb9409ef80 2023-10-03T10:16:37.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.214+0000 7fbb99d9d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9409fe00 con 0x7fbb9409f370 2023-10-03T10:16:37.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.214+0000 7fbb93fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb9409f370 0x7fbb9413b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.214+0000 7fbb93fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb9409f370 0x7fbb9413b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58538/0 (socket says 172.21.15.146:58538) 2023-10-03T10:16:37.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.214+0000 7fbb93fff700 1 -- 172.21.15.146:0/4239333823 learned_addr learned my addr 172.21.15.146:0/4239333823 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:37.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.215+0000 7fbb92ffd700 1 --2- 172.21.15.146:0/4239333823 >> v2:172.21.15.146:3300/0 conn(0x7fbb9409ef80 0x7fbb94138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.215+0000 7fbb93fff700 1 -- 172.21.15.146:0/4239333823 >> v2:172.21.15.146:3300/0 conn(0x7fbb9409ef80 msgr2=0x7fbb94138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.215+0000 7fbb93fff700 1 --2- 172.21.15.146:0/4239333823 >> v2:172.21.15.146:3300/0 conn(0x7fbb9409ef80 0x7fbb94138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.215+0000 7fbb93fff700 1 -- 172.21.15.146:0/4239333823 >> v1:172.21.15.146:6789/0 conn(0x7fbb9409a150 legacy=0x7fbb9409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.215+0000 7fbb93fff700 1 -- 172.21.15.146:0/4239333823 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9406bc20 con 0x7fbb9409f370 2023-10-03T10:16:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.215+0000 7fbb93fff700 1 --2- 172.21.15.146:0/4239333823 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb9409f370 0x7fbb9413b3b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009e80 tx=0x7fbb8c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccdf61fe87baf1b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.215+0000 7fbb927fc700 1 -- 172.21.15.146:0/4239333823 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c00e070 con 0x7fbb9409f370 2023-10-03T10:16:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.215+0000 7fbb927fc700 1 -- 172.21.15.146:0/4239333823 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8c00b8d0 con 0x7fbb9409f370 2023-10-03T10:16:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.215+0000 7fbb927fc700 1 -- 172.21.15.146:0/4239333823 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c00bc80 con 0x7fbb9409f370 2023-10-03T10:16:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.216+0000 7fbb99d9d700 1 -- 172.21.15.146:0/4239333823 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb9409f370 msgr2=0x7fbb9413b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.216+0000 7fbb99d9d700 1 --2- 172.21.15.146:0/4239333823 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb9409f370 0x7fbb9413b3b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009e80 tx=0x7fbb8c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:37.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.216+0000 7fbb99d9d700 1 -- 172.21.15.146:0/4239333823 shutdown_connections 2023-10-03T10:16:37.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.216+0000 7fbb99d9d700 1 --2- 172.21.15.146:0/4239333823 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb9409f370 0x7fbb9413b3b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.216+0000 7fbb99d9d700 1 --2- 172.21.15.146:0/4239333823 >> v2:172.21.15.146:3300/0 conn(0x7fbb9409ef80 0x7fbb94138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.216+0000 7fbb99d9d700 1 -- 172.21.15.146:0/4239333823 >> 172.21.15.146:0/4239333823 conn(0x7fbb940a4430 msgr2=0x7fbb940a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.216+0000 7fbb99d9d700 1 -- 172.21.15.146:0/4239333823 shutdown_connections 2023-10-03T10:16:37.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.216+0000 7fbb99d9d700 1 -- 172.21.15.146:0/4239333823 wait complete. 2023-10-03T10:16:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.217+0000 7fbb99d9d700 1 Processor -- start 2023-10-03T10:16:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.218+0000 7fbb99d9d700 1 -- start start 2023-10-03T10:16:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.218+0000 7fbb99d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb9409a150 0x7fbb9411ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.218+0000 7fbb99d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb9409ef80 0x7fbb9411f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.218+0000 7fbb99d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb9409f370 0x7fbb9411f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.218+0000 7fbb99d9d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9409bc40 con 0x7fbb9409f370 2023-10-03T10:16:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.218+0000 7fbb99d9d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94121b80 con 0x7fbb9409ef80 2023-10-03T10:16:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.218+0000 7fbb99d9d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94122110 con 0x7fbb9409a150 2023-10-03T10:16:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.218+0000 7fbb93fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb9409f370 0x7fbb9411f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.218+0000 7fbb937fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb9409a150 0x7fbb9411ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.218+0000 7fbb93fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb9409f370 0x7fbb9411f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33228/0 (socket says 172.21.15.146:33228) 2023-10-03T10:16:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.218+0000 7fbb937fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb9409a150 0x7fbb9411ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40678/0 (socket says 172.21.15.146:40678) 2023-10-03T10:16:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.218+0000 7fbb93fff700 1 -- 172.21.15.146:0/1951114357 learned_addr learned my addr 172.21.15.146:0/1951114357 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.218+0000 7fbb92ffd700 1 --2- 172.21.15.146:0/1951114357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb9409ef80 0x7fbb9411f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.219+0000 7fbb937fe700 1 -- 172.21.15.146:0/1951114357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb9409ef80 msgr2=0x7fbb9411f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.219+0000 7fbb937fe700 1 --2- 172.21.15.146:0/1951114357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb9409ef80 0x7fbb9411f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.219+0000 7fbb937fe700 1 -- 172.21.15.146:0/1951114357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb9409f370 msgr2=0x7fbb9411f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.219+0000 7fbb937fe700 1 --2- 172.21.15.146:0/1951114357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb9409f370 0x7fbb9411f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.219+0000 7fbb937fe700 1 -- 172.21.15.146:0/1951114357 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8c009b30 con 0x7fbb9409a150 2023-10-03T10:16:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.219+0000 7fbb93fff700 1 --2- 172.21.15.146:0/1951114357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb9409f370 0x7fbb9411f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.219+0000 7fbb92ffd700 1 --2- 172.21.15.146:0/1951114357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb9409ef80 0x7fbb9411f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.219+0000 7fbb937fe700 1 --2- 172.21.15.146:0/1951114357 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb9409a150 0x7fbb9411ead0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbb84000f60 tx=0x7fbb8400c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.219+0000 7fbb7bfff700 1 -- 172.21.15.146:0/1951114357 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb840052d0 con 0x7fbb9409a150 2023-10-03T10:16:37.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.219+0000 7fbb7bfff700 1 -- 172.21.15.146:0/1951114357 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb84005430 con 0x7fbb9409a150 2023-10-03T10:16:37.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.219+0000 7fbb99d9d700 1 -- 172.21.15.146:0/1951114357 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb94120cd0 con 0x7fbb9409a150 2023-10-03T10:16:37.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.219+0000 7fbb7bfff700 1 -- 172.21.15.146:0/1951114357 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb840038c0 con 0x7fbb9409a150 2023-10-03T10:16:37.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.219+0000 7fbb99d9d700 1 -- 172.21.15.146:0/1951114357 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb941350f0 con 0x7fbb9409a150 2023-10-03T10:16:37.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.220+0000 7fbb7bfff700 1 -- 172.21.15.146:0/1951114357 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb84003c30 con 0x7fbb9409a150 2023-10-03T10:16:37.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.220+0000 7fbb7bfff700 1 -- 172.21.15.146:0/1951114357 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbb8403eba0 con 0x7fbb9409a150 2023-10-03T10:16:37.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.221+0000 7fbb99d9d700 1 -- 172.21.15.146:0/1951114357 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb9409fa30 con 0x7fbb9409a150 2023-10-03T10:16:37.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.230+0000 7fbb7bfff700 1 -- 172.21.15.146:0/1951114357 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb84017080 con 0x7fbb9409a150 2023-10-03T10:16:37.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.236+0000 7f15ea762700 1 Processor -- start 2023-10-03T10:16:37.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.236+0000 7f15ea762700 1 -- start start 2023-10-03T10:16:37.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.236+0000 7f15ea762700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15e40a1550 0x7f15e4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.236+0000 7f15ea762700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f15e4139200 0x7f15e413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.236+0000 7f15ea762700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e409e9d0 con 0x7f15e40a0a70 2023-10-03T10:16:37.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.236+0000 7f15ea762700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e409dc00 con 0x7f15e40a1550 2023-10-03T10:16:37.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.236+0000 7f15ea762700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15e409dec0 con 0x7f15e4139200 2023-10-03T10:16:37.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.236+0000 7f15e3fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f15e40a0a70 0x7f15e40a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43132/0 (socket says 172.21.15.146:43132) 2023-10-03T10:16:37.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.236+0000 7f15e3fff700 1 -- 172.21.15.146:0/3632430377 learned_addr learned my addr 172.21.15.146:0/3632430377 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:37.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.236+0000 7f15e37fe700 1 --2- 172.21.15.146:0/3632430377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15e40a1550 0x7f15e4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.237+0000 7f15e8cff700 1 --2- 172.21.15.146:0/3632430377 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f15e4139200 0x7f15e413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.237+0000 7f15e37fe700 1 -- 172.21.15.146:0/3632430377 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f15e4139200 msgr2=0x7f15e413b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:37.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.237+0000 7f15e37fe700 1 --2- 172.21.15.146:0/3632430377 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f15e4139200 0x7f15e413b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.237+0000 7f15e37fe700 1 -- 172.21.15.146:0/3632430377 >> v1:172.21.15.146:6789/0 conn(0x7f15e40a0a70 legacy=0x7f15e40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:37.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.237+0000 7f15e37fe700 1 -- 172.21.15.146:0/3632430377 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e409e6a0 con 0x7f15e40a1550 2023-10-03T10:16:37.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.237+0000 7f15e37fe700 1 --2- 172.21.15.146:0/3632430377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15e40a1550 0x7f15e4138cc0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009870 tx=0x7f15d8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7cd8bd20ffa4e8d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.237+0000 7f15e2ffd700 1 -- 172.21.15.146:0/3632430377 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8004230 con 0x7f15e40a1550 2023-10-03T10:16:37.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.237+0000 7f15e2ffd700 1 -- 172.21.15.146:0/3632430377 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d8004390 con 0x7f15e40a1550 2023-10-03T10:16:37.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.237+0000 7f15e2ffd700 1 -- 172.21.15.146:0/3632430377 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d80036a0 con 0x7f15e40a1550 2023-10-03T10:16:37.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.238+0000 7f15ea762700 1 -- 172.21.15.146:0/3632430377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15e40a1550 msgr2=0x7f15e4138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.238+0000 7f15ea762700 1 --2- 172.21.15.146:0/3632430377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15e40a1550 0x7f15e4138cc0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009870 tx=0x7f15d8009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:37.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.238+0000 7f15ea762700 1 -- 172.21.15.146:0/3632430377 shutdown_connections 2023-10-03T10:16:37.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.238+0000 7f15ea762700 1 --2- 172.21.15.146:0/3632430377 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f15e4139200 0x7f15e413b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.238+0000 7f15ea762700 1 --2- 172.21.15.146:0/3632430377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15e40a1550 0x7f15e4138cc0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.238+0000 7f15ea762700 1 -- 172.21.15.146:0/3632430377 >> 172.21.15.146:0/3632430377 conn(0x7f15e40a6610 msgr2=0x7f15e40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.238+0000 7f15ea762700 1 -- 172.21.15.146:0/3632430377 shutdown_connections 2023-10-03T10:16:37.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.238+0000 7f15ea762700 1 -- 172.21.15.146:0/3632430377 wait complete. 2023-10-03T10:16:37.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.239+0000 7f15ea762700 1 Processor -- start 2023-10-03T10:16:37.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.239+0000 7f15ea762700 1 -- start start 2023-10-03T10:16:37.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.239+0000 7f15ea762700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f15e40a0a70 0x7f15e4125820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.239+0000 7f15ea762700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15e40a1550 0x7f15e4125d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.239+0000 7f15ea762700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e4139200 0x7f15e41cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.239+0000 7f15ea762700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e4138c10 con 0x7f15e4139200 2023-10-03T10:16:37.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.240+0000 7f15ea762700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e4127b50 con 0x7f15e40a1550 2023-10-03T10:16:37.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.240+0000 7f15ea762700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15e4125150 con 0x7f15e40a0a70 2023-10-03T10:16:37.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.240+0000 7f15e37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15e40a1550 0x7f15e4125d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.240+0000 7f15e37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15e40a1550 0x7f15e4125d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58570/0 (socket says 172.21.15.146:58570) 2023-10-03T10:16:37.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.240+0000 7f15e37fe700 1 -- 172.21.15.146:0/1735290903 learned_addr learned my addr 172.21.15.146:0/1735290903 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:37.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.240+0000 7f15e8cff700 1 --2- 172.21.15.146:0/1735290903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e4139200 0x7f15e41cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.240+0000 7f15e3fff700 1 --2- 172.21.15.146:0/1735290903 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f15e40a0a70 0x7f15e4125820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.240+0000 7f15e37fe700 1 -- 172.21.15.146:0/1735290903 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f15e40a0a70 msgr2=0x7f15e4125820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.240+0000 7f15e37fe700 1 --2- 172.21.15.146:0/1735290903 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f15e40a0a70 0x7f15e4125820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.240+0000 7f15e37fe700 1 -- 172.21.15.146:0/1735290903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e4139200 msgr2=0x7f15e41cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.240+0000 7f15e37fe700 1 --2- 172.21.15.146:0/1735290903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e4139200 0x7f15e41cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.240+0000 7f15e37fe700 1 -- 172.21.15.146:0/1735290903 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d80094a0 con 0x7f15e40a1550 2023-10-03T10:16:37.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.240+0000 7f15e37fe700 1 --2- 172.21.15.146:0/1735290903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15e40a1550 0x7f15e4125d60 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009840 tx=0x7f15d8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.240+0000 7f15e0ff9700 1 -- 172.21.15.146:0/1735290903 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8011630 con 0x7f15e40a1550 2023-10-03T10:16:37.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.240+0000 7f15ea762700 1 -- 172.21.15.146:0/1735290903 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e4127da0 con 0x7f15e40a1550 2023-10-03T10:16:37.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.240+0000 7f15ea762700 1 -- 172.21.15.146:0/1735290903 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e40a03e0 con 0x7f15e40a1550 2023-10-03T10:16:37.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.241+0000 7f15e0ff9700 1 -- 172.21.15.146:0/1735290903 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d801e070 con 0x7f15e40a1550 2023-10-03T10:16:37.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.241+0000 7f15e0ff9700 1 -- 172.21.15.146:0/1735290903 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d80119f0 con 0x7f15e40a1550 2023-10-03T10:16:37.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.241+0000 7f15ea762700 1 -- 172.21.15.146:0/1735290903 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c40052e0 con 0x7f15e40a1550 2023-10-03T10:16:37.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.242+0000 7f15e0ff9700 1 -- 172.21.15.146:0/1735290903 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f15d8011b50 con 0x7f15e40a1550 2023-10-03T10:16:37.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.242+0000 7f15e0ff9700 1 -- 172.21.15.146:0/1735290903 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f15d8041130 con 0x7f15e40a1550 2023-10-03T10:16:37.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.246+0000 7f15e0ff9700 1 -- 172.21.15.146:0/1735290903 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15d8011e00 con 0x7f15e40a1550 2023-10-03T10:16:37.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.314+0000 7f0752922700 1 -- 172.21.15.146:0/2304465161 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f074c04f2a0 con 0x7f074c1300a0 2023-10-03T10:16:37.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.314+0000 7f0748ff9700 1 -- 172.21.15.146:0/2304465161 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f073c021030 con 0x7f074c1300a0 2023-10-03T10:16:37.315 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:37.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.316+0000 7f0752922700 1 -- 172.21.15.146:0/2304465161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1300a0 msgr2=0x7f074c071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.316+0000 7f0752922700 1 --2- 172.21.15.146:0/2304465161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1300a0 0x7f074c071370 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f073c00e9b0 tx=0x7f073c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.316+0000 7f0752922700 1 -- 172.21.15.146:0/2304465161 shutdown_connections 2023-10-03T10:16:37.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.316+0000 7f0752922700 1 --2- 172.21.15.146:0/2304465161 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c133ad0 0x7f074c071df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.316+0000 7f0752922700 1 --2- 172.21.15.146:0/2304465161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1300a0 0x7f074c071370 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.316+0000 7f0752922700 1 --2- 172.21.15.146:0/2304465161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c130bc0 0x7f074c0718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.316+0000 7f0752922700 1 -- 172.21.15.146:0/2304465161 >> 172.21.15.146:0/2304465161 conn(0x7f074c099c40 msgr2=0x7f074c132a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.316+0000 7f0752922700 1 -- 172.21.15.146:0/2304465161 shutdown_connections 2023-10-03T10:16:37.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.316+0000 7f0752922700 1 -- 172.21.15.146:0/2304465161 wait complete. 2023-10-03T10:16:37.329 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:37.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.430+0000 7f125a4b4700 1 -- 172.21.15.146:0/362292162 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f125411d960 con 0x7f12540a0a30 2023-10-03T10:16:37.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.431+0000 7f1250ff9700 1 -- 172.21.15.146:0/362292162 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f125411d960 con 0x7f12540a0a30 2023-10-03T10:16:37.431 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:37.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.433+0000 7f125a4b4700 1 -- 172.21.15.146:0/362292162 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12540a0a30 msgr2=0x7f12541c3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.433+0000 7f125a4b4700 1 --2- 172.21.15.146:0/362292162 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12540a0a30 0x7f12541c3e20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f124400f330 tx=0x7f1244004750 comp rx=0 tx=0).stop 2023-10-03T10:16:37.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.433+0000 7f125a4b4700 1 -- 172.21.15.146:0/362292162 shutdown_connections 2023-10-03T10:16:37.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.433+0000 7f125a4b4700 1 --2- 172.21.15.146:0/362292162 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1254130670 0x7f12541c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.433+0000 7f125a4b4700 1 --2- 172.21.15.146:0/362292162 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12540a0a30 0x7f12541c3e20 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.433+0000 7f125a4b4700 1 --2- 172.21.15.146:0/362292162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12540a1340 0x7f12541c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.433+0000 7f125a4b4700 1 -- 172.21.15.146:0/362292162 >> 172.21.15.146:0/362292162 conn(0x7f12540a2980 msgr2=0x7f125409deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.433+0000 7f125a4b4700 1 -- 172.21.15.146:0/362292162 shutdown_connections 2023-10-03T10:16:37.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.433+0000 7f125a4b4700 1 -- 172.21.15.146:0/362292162 wait complete. 2023-10-03T10:16:37.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.439+0000 7f15ea762700 1 -- 172.21.15.146:0/1735290903 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f15c4005860 con 0x7f15e40a1550 2023-10-03T10:16:37.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.440+0000 7f15e0ff9700 1 -- 172.21.15.146:0/1735290903 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f15d80193c0 con 0x7f15e40a1550 2023-10-03T10:16:37.440 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:37.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.442+0000 7f15ea762700 1 -- 172.21.15.146:0/1735290903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15e40a1550 msgr2=0x7f15e4125d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.442+0000 7f15ea762700 1 --2- 172.21.15.146:0/1735290903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15e40a1550 0x7f15e4125d60 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009840 tx=0x7f15d8004750 comp rx=0 tx=0).stop 2023-10-03T10:16:37.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.442+0000 7f15ea762700 1 -- 172.21.15.146:0/1735290903 shutdown_connections 2023-10-03T10:16:37.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.442+0000 7f15ea762700 1 --2- 172.21.15.146:0/1735290903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e4139200 0x7f15e41cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.442+0000 7f15ea762700 1 --2- 172.21.15.146:0/1735290903 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f15e40a0a70 0x7f15e4125820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.442+0000 7f15ea762700 1 --2- 172.21.15.146:0/1735290903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15e40a1550 0x7f15e4125d60 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.442+0000 7f15ea762700 1 -- 172.21.15.146:0/1735290903 >> 172.21.15.146:0/1735290903 conn(0x7f15e40a6610 msgr2=0x7f15e41be2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.442+0000 7f15ea762700 1 -- 172.21.15.146:0/1735290903 shutdown_connections 2023-10-03T10:16:37.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.442+0000 7f15ea762700 1 -- 172.21.15.146:0/1735290903 wait complete. 2023-10-03T10:16:37.446 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:37.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:37.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.489+0000 7fbb99d9d700 1 -- 172.21.15.146:0/1951114357 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbb94121d70 con 0x7fbb9409a150 2023-10-03T10:16:37.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.490+0000 7fbb7bfff700 1 -- 172.21.15.146:0/1951114357 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb84018260 con 0x7fbb9409a150 2023-10-03T10:16:37.490 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:37.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.492+0000 7fbb99d9d700 1 -- 172.21.15.146:0/1951114357 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb9409a150 msgr2=0x7fbb9411ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.492+0000 7fbb99d9d700 1 --2- 172.21.15.146:0/1951114357 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb9409a150 0x7fbb9411ead0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbb84000f60 tx=0x7fbb8400c6e0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.492+0000 7fbb99d9d700 1 -- 172.21.15.146:0/1951114357 shutdown_connections 2023-10-03T10:16:37.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.492+0000 7fbb99d9d700 1 --2- 172.21.15.146:0/1951114357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb9409f370 0x7fbb9411f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.492+0000 7fbb99d9d700 1 --2- 172.21.15.146:0/1951114357 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbb9409a150 0x7fbb9411ead0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.492+0000 7fbb99d9d700 1 --2- 172.21.15.146:0/1951114357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb9409ef80 0x7fbb9411f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.492+0000 7fbb99d9d700 1 -- 172.21.15.146:0/1951114357 >> 172.21.15.146:0/1951114357 conn(0x7fbb940a4430 msgr2=0x7fbb940a2050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.492+0000 7fbb99d9d700 1 -- 172.21.15.146:0/1951114357 shutdown_connections 2023-10-03T10:16:37.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:37.492+0000 7fbb99d9d700 1 -- 172.21.15.146:0/1951114357 wait complete. 2023-10-03T10:16:37.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:38.329 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:38.447 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:38.455 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:38.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.465+0000 7fe6c1870700 1 Processor -- start 2023-10-03T10:16:38.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.465+0000 7fe6c1870700 1 -- start start 2023-10-03T10:16:38.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.466+0000 7fe6c1870700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe6bc0a0a30 0x7fe6bc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.466+0000 7fe6c1870700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6bc130670 0x7fe6bc1381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.466+0000 7fe6c1870700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6bc0a1e70 con 0x7fe6bc0a1340 2023-10-03T10:16:38.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.466+0000 7fe6c1870700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6bc09a720 con 0x7fe6bc0a0a30 2023-10-03T10:16:38.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.466+0000 7fe6c1870700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc09b300 con 0x7fe6bc130670 2023-10-03T10:16:38.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.466+0000 7fe6baffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe6bc0a0a30 0x7fe6bc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.466+0000 7fe6bb7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6bc130670 0x7fe6bc1381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.466+0000 7fe6baffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe6bc0a0a30 0x7fe6bc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33254/0 (socket says 172.21.15.146:33254) 2023-10-03T10:16:38.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.466+0000 7fe6baffd700 1 -- 172.21.15.146:0/1794985592 learned_addr learned my addr 172.21.15.146:0/1794985592 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:38.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.466+0000 7fe6bb7fe700 1 --2- 172.21.15.146:0/1794985592 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6bc130670 0x7fe6bc1381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40700/0 (socket says 172.21.15.146:40700) 2023-10-03T10:16:38.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.467+0000 7fe6b9ffb700 1 -- 172.21.15.146:0/1794985592 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772572276 0 0) 0x7fe6bc0a1e70 con 0x7fe6bc0a1340 2023-10-03T10:16:38.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.467+0000 7fe6bb7fe700 1 -- 172.21.15.146:0/1794985592 >> v2:172.21.15.146:3300/0 conn(0x7fe6bc0a0a30 msgr2=0x7fe6bc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:38.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.467+0000 7fe6bb7fe700 1 --2- 172.21.15.146:0/1794985592 >> v2:172.21.15.146:3300/0 conn(0x7fe6bc0a0a30 0x7fe6bc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.467+0000 7fe6bb7fe700 1 -- 172.21.15.146:0/1794985592 >> v1:172.21.15.146:6789/0 conn(0x7fe6bc0a1340 legacy=0x7fe6bc12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.467+0000 7fe6bb7fe700 1 -- 172.21.15.146:0/1794985592 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6bc09abc0 con 0x7fe6bc130670 2023-10-03T10:16:38.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.467+0000 7fe6baffd700 1 --2- 172.21.15.146:0/1794985592 >> v2:172.21.15.146:3300/0 conn(0x7fe6bc0a0a30 0x7fe6bc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:38.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.467+0000 7fe6bb7fe700 1 --2- 172.21.15.146:0/1794985592 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6bc130670 0x7fe6bc1381c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400aea0 tx=0x7fe6b400c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=619c071b8ebeccd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.467+0000 7fe6b9ffb700 1 -- 172.21.15.146:0/1794985592 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400f070 con 0x7fe6bc130670 2023-10-03T10:16:38.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.467+0000 7fe6b9ffb700 1 -- 172.21.15.146:0/1794985592 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b400a2e0 con 0x7fe6bc130670 2023-10-03T10:16:38.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.467+0000 7fe6b9ffb700 1 -- 172.21.15.146:0/1794985592 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400cb50 con 0x7fe6bc130670 2023-10-03T10:16:38.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.468+0000 7fe6c1870700 1 -- 172.21.15.146:0/1794985592 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6bc130670 msgr2=0x7fe6bc1381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.468+0000 7fe6c1870700 1 --2- 172.21.15.146:0/1794985592 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6bc130670 0x7fe6bc1381c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400aea0 tx=0x7fe6b400c330 comp rx=0 tx=0).stop 2023-10-03T10:16:38.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.468+0000 7fe6c1870700 1 -- 172.21.15.146:0/1794985592 shutdown_connections 2023-10-03T10:16:38.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.468+0000 7fe6c1870700 1 --2- 172.21.15.146:0/1794985592 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6bc130670 0x7fe6bc1381c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.468+0000 7fe6c1870700 1 --2- 172.21.15.146:0/1794985592 >> v2:172.21.15.146:3300/0 conn(0x7fe6bc0a0a30 0x7fe6bc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.468+0000 7fe6c1870700 1 -- 172.21.15.146:0/1794985592 >> 172.21.15.146:0/1794985592 conn(0x7fe6bc0a2980 msgr2=0x7fe6bc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.468+0000 7fe6c1870700 1 -- 172.21.15.146:0/1794985592 shutdown_connections 2023-10-03T10:16:38.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.468+0000 7fe6c1870700 1 -- 172.21.15.146:0/1794985592 wait complete. 2023-10-03T10:16:38.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.469+0000 7fe6c1870700 1 Processor -- start 2023-10-03T10:16:38.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.470+0000 7fe6c1870700 1 -- start start 2023-10-03T10:16:38.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.470+0000 7fe6c1870700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6bc0a0a30 0x7fe6bc1c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.470+0000 7fe6c1870700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6bc0a1340 0x7fe6bc1c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.470+0000 7fe6c1870700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6bc130670 0x7fe6bc11af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.470+0000 7fe6c1870700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc12f7d0 con 0x7fe6bc0a1340 2023-10-03T10:16:38.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.470+0000 7fe6c1870700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc11ca30 con 0x7fe6bc0a0a30 2023-10-03T10:16:38.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.470+0000 7fe6c1870700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc12f9f0 con 0x7fe6bc130670 2023-10-03T10:16:38.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.470+0000 7fe6ba7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6bc0a1340 0x7fe6bc1c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.470+0000 7fe6ba7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6bc0a1340 0x7fe6bc1c67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33260/0 (socket says 172.21.15.146:33260) 2023-10-03T10:16:38.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.470+0000 7fe6ba7fc700 1 -- 172.21.15.146:0/2817040039 learned_addr learned my addr 172.21.15.146:0/2817040039 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:38.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.470+0000 7fe6bb7fe700 1 --2- 172.21.15.146:0/2817040039 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6bc130670 0x7fe6bc11af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.470+0000 7fe6baffd700 1 --2- 172.21.15.146:0/2817040039 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6bc0a0a30 0x7fe6bc1c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.471+0000 7fe6ba7fc700 1 -- 172.21.15.146:0/2817040039 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6bc130670 msgr2=0x7fe6bc11af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.471+0000 7fe6ba7fc700 1 --2- 172.21.15.146:0/2817040039 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6bc130670 0x7fe6bc11af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.471+0000 7fe6ba7fc700 1 -- 172.21.15.146:0/2817040039 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6bc0a0a30 msgr2=0x7fe6bc1c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.471+0000 7fe6ba7fc700 1 --2- 172.21.15.146:0/2817040039 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6bc0a0a30 0x7fe6bc1c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.471+0000 7fe6ba7fc700 1 -- 172.21.15.146:0/2817040039 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ac009500 con 0x7fe6bc0a1340 2023-10-03T10:16:38.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.471+0000 7fe6ba7fc700 1 --2- 172.21.15.146:0/2817040039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6bc0a1340 0x7fe6bc1c67b0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0001eb0 tx=0x7fe6b000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.471+0000 7fe6a3fff700 1 -- 172.21.15.146:0/2817040039 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b00054e0 con 0x7fe6bc0a1340 2023-10-03T10:16:38.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.471+0000 7fe6a3fff700 1 -- 172.21.15.146:0/2817040039 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b0003680 con 0x7fe6bc0a1340 2023-10-03T10:16:38.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.471+0000 7fe6c1870700 1 -- 172.21.15.146:0/2817040039 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b400ab80 con 0x7fe6bc0a1340 2023-10-03T10:16:38.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.471+0000 7fe6a3fff700 1 -- 172.21.15.146:0/2817040039 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b00039f0 con 0x7fe6bc0a1340 2023-10-03T10:16:38.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.471+0000 7fe6c1870700 1 -- 172.21.15.146:0/2817040039 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6bc1c6cf0 con 0x7fe6bc0a1340 2023-10-03T10:16:38.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.472+0000 7fe6a3fff700 1 -- 172.21.15.146:0/2817040039 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe6b0003b50 con 0x7fe6bc0a1340 2023-10-03T10:16:38.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.472+0000 7fe6a3fff700 1 -- 172.21.15.146:0/2817040039 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe6b003ea30 con 0x7fe6bc0a1340 2023-10-03T10:16:38.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.472+0000 7fe6c1870700 1 -- 172.21.15.146:0/2817040039 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6bc11d040 con 0x7fe6bc0a1340 2023-10-03T10:16:38.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.477+0000 7fe6a3fff700 1 -- 172.21.15.146:0/2817040039 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe6bc11d040 con 0x7fe6bc0a1340 2023-10-03T10:16:38.505 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:38.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.578+0000 7fd7c859d700 1 Processor -- start 2023-10-03T10:16:38.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.579+0000 7fd7c859d700 1 -- start start 2023-10-03T10:16:38.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.579+0000 7fd7c859d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7c0133900 0x7fd7c0133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.579+0000 7fd7c859d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7c00a10b0 0x7fd7c013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.580+0000 7fd7c859d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c009a760 con 0x7fd7c0134210 2023-10-03T10:16:38.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.580+0000 7fd7c859d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c01336e0 con 0x7fd7c00a10b0 2023-10-03T10:16:38.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.580+0000 7fd7c859d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c009a080 con 0x7fd7c0133900 2023-10-03T10:16:38.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.580+0000 7fd7c5b38700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd7c0134210 0x7fd7c00a09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43154/0 (socket says 172.21.15.146:43154) 2023-10-03T10:16:38.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.580+0000 7fd7c6339700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7c0133900 0x7fd7c0133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.580+0000 7fd7c5b38700 1 -- 172.21.15.146:0/1454590686 learned_addr learned my addr 172.21.15.146:0/1454590686 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:38.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.580+0000 7fd7c6b3a700 1 --2- 172.21.15.146:0/1454590686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7c00a10b0 0x7fd7c013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.580+0000 7fd7c5337700 1 -- 172.21.15.146:0/1454590686 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080761149 0 0) 0x7fd7c009a760 con 0x7fd7c0134210 2023-10-03T10:16:38.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.580+0000 7fd7c6b3a700 1 -- 172.21.15.146:0/1454590686 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7c0133900 msgr2=0x7fd7c0133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:38.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.580+0000 7fd7c6b3a700 1 --2- 172.21.15.146:0/1454590686 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7c0133900 0x7fd7c0133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.580+0000 7fd7c6b3a700 1 -- 172.21.15.146:0/1454590686 >> v1:172.21.15.146:6789/0 conn(0x7fd7c0134210 legacy=0x7fd7c00a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.580+0000 7fd7c6b3a700 1 -- 172.21.15.146:0/1454590686 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c00a23e0 con 0x7fd7c00a10b0 2023-10-03T10:16:38.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.580+0000 7fd7c6339700 1 --2- 172.21.15.146:0/1454590686 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7c0133900 0x7fd7c0133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:38.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.580+0000 7fd7c6b3a700 1 --2- 172.21.15.146:0/1454590686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7c00a10b0 0x7fd7c013b910 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8009dc0 tx=0x7fd7b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b75cf7a993c0381 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.580+0000 7fd7c5337700 1 -- 172.21.15.146:0/1454590686 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b800e070 con 0x7fd7c00a10b0 2023-10-03T10:16:38.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.581+0000 7fd7c5337700 1 -- 172.21.15.146:0/1454590686 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b800bb20 con 0x7fd7c00a10b0 2023-10-03T10:16:38.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.581+0000 7fd7c5337700 1 -- 172.21.15.146:0/1454590686 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8012430 con 0x7fd7c00a10b0 2023-10-03T10:16:38.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.581+0000 7fd7c859d700 1 -- 172.21.15.146:0/1454590686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7c00a10b0 msgr2=0x7fd7c013b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.581+0000 7fd7c859d700 1 --2- 172.21.15.146:0/1454590686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7c00a10b0 0x7fd7c013b910 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8009dc0 tx=0x7fd7b800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:38.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.582+0000 7fd7c859d700 1 -- 172.21.15.146:0/1454590686 shutdown_connections 2023-10-03T10:16:38.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.582+0000 7fd7c859d700 1 --2- 172.21.15.146:0/1454590686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7c00a10b0 0x7fd7c013b910 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.582+0000 7fd7c859d700 1 --2- 172.21.15.146:0/1454590686 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7c0133900 0x7fd7c0133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.582+0000 7fd7c859d700 1 -- 172.21.15.146:0/1454590686 >> 172.21.15.146:0/1454590686 conn(0x7fd7c00a2980 msgr2=0x7fd7c00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.582+0000 7fd7c859d700 1 -- 172.21.15.146:0/1454590686 shutdown_connections 2023-10-03T10:16:38.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.582+0000 7fd7c859d700 1 -- 172.21.15.146:0/1454590686 wait complete. 2023-10-03T10:16:38.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.583+0000 7fd7c859d700 1 Processor -- start 2023-10-03T10:16:38.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.583+0000 7fd7c859d700 1 -- start start 2023-10-03T10:16:38.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.584+0000 7fd7c859d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7c00a10b0 0x7fd7c011d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.584+0000 7fd7c859d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7c0133900 0x7fd7c011dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.584+0000 7fd7c859d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7c0134210 0x7fd7c011e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.584+0000 7fd7c859d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c01209f0 con 0x7fd7c0133900 2023-10-03T10:16:38.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.584+0000 7fd7c859d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c011f310 con 0x7fd7c0134210 2023-10-03T10:16:38.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.584+0000 7fd7c859d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c0120ea0 con 0x7fd7c00a10b0 2023-10-03T10:16:38.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.584+0000 7fd7c6339700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7c00a10b0 0x7fd7c011d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.584+0000 7fd7c6339700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7c00a10b0 0x7fd7c011d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40726/0 (socket says 172.21.15.146:40726) 2023-10-03T10:16:38.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.584+0000 7fd7c6339700 1 -- 172.21.15.146:0/3056497325 learned_addr learned my addr 172.21.15.146:0/3056497325 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:38.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.584+0000 7fd7c5b38700 1 --2- 172.21.15.146:0/3056497325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7c0133900 0x7fd7c011dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.584+0000 7fd7c6b3a700 1 --2- 172.21.15.146:0/3056497325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7c0134210 0x7fd7c011e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.584+0000 7fd7c5b38700 1 -- 172.21.15.146:0/3056497325 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7c00a10b0 msgr2=0x7fd7c011d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.584+0000 7fd7c5b38700 1 --2- 172.21.15.146:0/3056497325 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7c00a10b0 0x7fd7c011d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.584+0000 7fd7c5b38700 1 -- 172.21.15.146:0/3056497325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7c0134210 msgr2=0x7fd7c011e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.584+0000 7fd7c5b38700 1 --2- 172.21.15.146:0/3056497325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7c0134210 0x7fd7c011e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.584+0000 7fd7c5b38700 1 -- 172.21.15.146:0/3056497325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7bc009430 con 0x7fd7c0133900 2023-10-03T10:16:38.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.584+0000 7fd7c6339700 1 --2- 172.21.15.146:0/3056497325 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7c00a10b0 0x7fd7c011d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:38.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.584+0000 7fd7c6b3a700 1 --2- 172.21.15.146:0/3056497325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7c0134210 0x7fd7c011e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:38.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.585+0000 7fd7c5b38700 1 --2- 172.21.15.146:0/3056497325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7c0133900 0x7fd7c011dba0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fd7c006b750 tx=0x7fd7b000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.585+0000 7fd7b6ffd700 1 -- 172.21.15.146:0/3056497325 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0004c80 con 0x7fd7c0133900 2023-10-03T10:16:38.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.585+0000 7fd7b6ffd700 1 -- 172.21.15.146:0/3056497325 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b000ce90 con 0x7fd7c0133900 2023-10-03T10:16:38.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.585+0000 7fd7c859d700 1 -- 172.21.15.146:0/3056497325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b8009a70 con 0x7fd7c0133900 2023-10-03T10:16:38.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.585+0000 7fd7b6ffd700 1 -- 172.21.15.146:0/3056497325 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b00070d0 con 0x7fd7c0133900 2023-10-03T10:16:38.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.585+0000 7fd7c859d700 1 -- 172.21.15.146:0/3056497325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c01204c0 con 0x7fd7c0133900 2023-10-03T10:16:38.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.585+0000 7fd7b6ffd700 1 -- 172.21.15.146:0/3056497325 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd7b0007230 con 0x7fd7c0133900 2023-10-03T10:16:38.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.586+0000 7fd7b6ffd700 1 -- 172.21.15.146:0/3056497325 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd7b003f300 con 0x7fd7c0133900 2023-10-03T10:16:38.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.588+0000 7fd7c859d700 1 -- 172.21.15.146:0/3056497325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c011a590 con 0x7fd7c0133900 2023-10-03T10:16:38.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.592+0000 7fd7b6ffd700 1 -- 172.21.15.146:0/3056497325 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd7b001bda0 con 0x7fd7c0133900 2023-10-03T10:16:38.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.605+0000 7fafe732a700 1 Processor -- start 2023-10-03T10:16:38.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.605+0000 7fafe732a700 1 -- start start 2023-10-03T10:16:38.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.606+0000 7fafe732a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fafe0133900 0x7fafe0133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.606+0000 7fafe732a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fafe0134210 0x7fafe00a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.606+0000 7fafe732a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafe00a0ee0 0x7fafe00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.606+0000 7fafe732a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe009a760 con 0x7fafe0133900 2023-10-03T10:16:38.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.606+0000 7fafe732a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe01336e0 con 0x7fafe00a0ee0 2023-10-03T10:16:38.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.606+0000 7fafe732a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafe009a080 con 0x7fafe0134210 2023-10-03T10:16:38.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.606+0000 7fafe50c6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fafe0133900 0x7fafe0133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.606+0000 7fafe50c6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fafe0133900 0x7fafe0133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33290/0 (socket says 172.21.15.146:33290) 2023-10-03T10:16:38.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.606+0000 7fafe50c6700 1 -- 172.21.15.146:0/1956521967 learned_addr learned my addr 172.21.15.146:0/1956521967 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:38.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.606+0000 7fafe58c7700 1 --2- 172.21.15.146:0/1956521967 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafe00a0ee0 0x7fafe00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.606+0000 7fafe48c5700 1 --2- 172.21.15.146:0/1956521967 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fafe0134210 0x7fafe00a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.607+0000 7fafe50c6700 1 -- 172.21.15.146:0/1956521967 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fafe0134210 msgr2=0x7fafe00a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:38.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.607+0000 7fafe50c6700 1 --2- 172.21.15.146:0/1956521967 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fafe0134210 0x7fafe00a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.607+0000 7fafe50c6700 1 -- 172.21.15.146:0/1956521967 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafe00a0ee0 msgr2=0x7fafe00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:38.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.607+0000 7fafe50c6700 1 --2- 172.21.15.146:0/1956521967 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafe00a0ee0 0x7fafe00a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.607+0000 7fafe50c6700 1 -- 172.21.15.146:0/1956521967 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe00a23e0 con 0x7fafe0133900 2023-10-03T10:16:38.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.607+0000 7fafe50c6700 1 --2- 172.21.15.146:0/1956521967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe0133900 0x7fafe0133cd0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fafdc006fd0 tx=0x7fafdc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474c5b3b2ec2dfc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.607+0000 7fafd7fff700 1 -- 172.21.15.146:0/1956521967 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc005e30 con 0x7fafe0133900 2023-10-03T10:16:38.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.607+0000 7fafd7fff700 1 -- 172.21.15.146:0/1956521967 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafdc004030 con 0x7fafe0133900 2023-10-03T10:16:38.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.607+0000 7fafd7fff700 1 -- 172.21.15.146:0/1956521967 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc0043e0 con 0x7fafe0133900 2023-10-03T10:16:38.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.608+0000 7fafe732a700 1 -- 172.21.15.146:0/1956521967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe0133900 msgr2=0x7fafe0133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.608+0000 7fafe732a700 1 --2- 172.21.15.146:0/1956521967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe0133900 0x7fafe0133cd0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fafdc006fd0 tx=0x7fafdc009bd0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.608+0000 7fafe732a700 1 -- 172.21.15.146:0/1956521967 shutdown_connections 2023-10-03T10:16:38.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.608+0000 7fafe732a700 1 --2- 172.21.15.146:0/1956521967 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafe00a0ee0 0x7fafe00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.608+0000 7fafe732a700 1 --2- 172.21.15.146:0/1956521967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe0133900 0x7fafe0133cd0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.608+0000 7fafe732a700 1 --2- 172.21.15.146:0/1956521967 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fafe0134210 0x7fafe00a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.608+0000 7fafe732a700 1 -- 172.21.15.146:0/1956521967 >> 172.21.15.146:0/1956521967 conn(0x7fafe00a2980 msgr2=0x7fafe00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.608+0000 7fafe732a700 1 -- 172.21.15.146:0/1956521967 shutdown_connections 2023-10-03T10:16:38.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.608+0000 7fafe732a700 1 -- 172.21.15.146:0/1956521967 wait complete. 2023-10-03T10:16:38.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.610+0000 7fafe732a700 1 Processor -- start 2023-10-03T10:16:38.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.610+0000 7fafe732a700 1 -- start start 2023-10-03T10:16:38.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.610+0000 7fafe732a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fafe00a0ee0 0x7fafe011d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.610+0000 7fafe732a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafe0133900 0x7fafe011dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.610+0000 7fafe732a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe0134210 0x7fafe011e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.610+0000 7fafe732a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe0121030 con 0x7fafe0134210 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.610+0000 7fafe732a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe011f360 con 0x7fafe0133900 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.610+0000 7fafe732a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafe01205b0 con 0x7fafe00a0ee0 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.610+0000 7fafe48c5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafe0133900 0x7fafe011dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.610+0000 7fafe48c5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafe0133900 0x7fafe011dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58620/0 (socket says 172.21.15.146:58620) 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.610+0000 7fafe48c5700 1 -- 172.21.15.146:0/1456467776 learned_addr learned my addr 172.21.15.146:0/1456467776 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.610+0000 7fafe50c6700 1 --2- 172.21.15.146:0/1456467776 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fafe00a0ee0 0x7fafe011d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.611+0000 7fafe58c7700 1 --2- 172.21.15.146:0/1456467776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe0134210 0x7fafe011e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.611+0000 7fafe50c6700 1 -- 172.21.15.146:0/1456467776 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafe0133900 msgr2=0x7fafe011dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.611+0000 7fafe50c6700 1 --2- 172.21.15.146:0/1456467776 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafe0133900 0x7fafe011dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.611+0000 7fafe50c6700 1 -- 172.21.15.146:0/1456467776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe0134210 msgr2=0x7fafe011e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.611+0000 7fafe50c6700 1 --2- 172.21.15.146:0/1456467776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe0134210 0x7fafe011e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.611+0000 7fafe50c6700 1 -- 172.21.15.146:0/1456467776 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafdc009500 con 0x7fafe00a0ee0 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.611+0000 7fafe58c7700 1 --2- 172.21.15.146:0/1456467776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe0134210 0x7fafe011e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.611+0000 7fafe50c6700 1 --2- 172.21.15.146:0/1456467776 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fafe00a0ee0 0x7fafe011d750 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fafe00a2370 tx=0x7fafdc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.611+0000 7fafd5ffb700 1 -- 172.21.15.146:0/1456467776 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc003bb0 con 0x7fafe00a0ee0 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.611+0000 7fafd5ffb700 1 -- 172.21.15.146:0/1456467776 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafdc003d30 con 0x7fafe00a0ee0 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.611+0000 7fafd5ffb700 1 -- 172.21.15.146:0/1456467776 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc003ea0 con 0x7fafe00a0ee0 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.611+0000 7fafe732a700 1 -- 172.21.15.146:0/1456467776 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe011f920 con 0x7fafe00a0ee0 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.612+0000 7fafe732a700 1 -- 172.21.15.146:0/1456467776 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe0132d80 con 0x7fafe00a0ee0 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.613+0000 7fafe732a700 1 -- 172.21.15.146:0/1456467776 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe011a590 con 0x7fafe00a0ee0 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.613+0000 7fafd5ffb700 1 -- 172.21.15.146:0/1456467776 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fafdc01c660 con 0x7fafe00a0ee0 2023-10-03T10:16:38.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.613+0000 7fafd5ffb700 1 -- 172.21.15.146:0/1456467776 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fafdc040370 con 0x7fafe00a0ee0 2023-10-03T10:16:38.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.618+0000 7fafd5ffb700 1 -- 172.21.15.146:0/1456467776 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fafdc019740 con 0x7fafe00a0ee0 2023-10-03T10:16:38.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.645+0000 7f3407bbd700 1 Processor -- start 2023-10-03T10:16:38.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.645+0000 7f3407bbd700 1 -- start start 2023-10-03T10:16:38.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.645+0000 7f3407bbd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f340009d860 0x7f340009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.645+0000 7f3407bbd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f340009e170 0x7f34001307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.645+0000 7f3407bbd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3400130ce0 0x7f3400131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.645+0000 7f3407bbd700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f340009aaa0 con 0x7f3400130ce0 2023-10-03T10:16:38.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.646+0000 7f3407bbd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340009f870 con 0x7f340009e170 2023-10-03T10:16:38.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.646+0000 7f3407bbd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f340009b360 con 0x7f340009d860 2023-10-03T10:16:38.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.646+0000 7f3405959700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f340009d860 0x7f340009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.646+0000 7f3405158700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f340009e170 0x7f34001307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.646+0000 7f3405959700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f340009d860 0x7f340009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40758/0 (socket says 172.21.15.146:40758) 2023-10-03T10:16:38.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.646+0000 7f3405959700 1 -- 172.21.15.146:0/1313023167 learned_addr learned my addr 172.21.15.146:0/1313023167 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:38.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.646+0000 7f3405158700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f340009e170 0x7f34001307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58622/0 (socket says 172.21.15.146:58622) 2023-10-03T10:16:38.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.646+0000 7f340615a700 1 --2- 172.21.15.146:0/1313023167 >> v2:172.21.15.146:3300/0 conn(0x7f3400130ce0 0x7f3400131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.646+0000 7f3405959700 1 -- 172.21.15.146:0/1313023167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f340009e170 msgr2=0x7f34001307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:38.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.646+0000 7f3405959700 1 --2- 172.21.15.146:0/1313023167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f340009e170 0x7f34001307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.646+0000 7f3405959700 1 -- 172.21.15.146:0/1313023167 >> v2:172.21.15.146:3300/0 conn(0x7f3400130ce0 msgr2=0x7f3400131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:38.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.646+0000 7f3405959700 1 --2- 172.21.15.146:0/1313023167 >> v2:172.21.15.146:3300/0 conn(0x7f3400130ce0 0x7f3400131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.646+0000 7f3405959700 1 -- 172.21.15.146:0/1313023167 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340009b620 con 0x7f340009d860 2023-10-03T10:16:38.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.646+0000 7f3405959700 1 --2- 172.21.15.146:0/1313023167 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f340009d860 0x7f340009dc30 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0098f0 tx=0x7f33fc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae8708560c4f2b12 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.646+0000 7f3404957700 1 -- 172.21.15.146:0/1313023167 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc011830 con 0x7f340009d860 2023-10-03T10:16:38.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.647+0000 7f3404957700 1 -- 172.21.15.146:0/1313023167 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33fc011990 con 0x7f340009d860 2023-10-03T10:16:38.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.647+0000 7f3404957700 1 -- 172.21.15.146:0/1313023167 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc011d20 con 0x7f340009d860 2023-10-03T10:16:38.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.647+0000 7f3407bbd700 1 -- 172.21.15.146:0/1313023167 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f340009d860 msgr2=0x7f340009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.647+0000 7f3407bbd700 1 --2- 172.21.15.146:0/1313023167 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f340009d860 0x7f340009dc30 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0098f0 tx=0x7f33fc009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:38.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.647+0000 7f3407bbd700 1 -- 172.21.15.146:0/1313023167 shutdown_connections 2023-10-03T10:16:38.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.647+0000 7f3407bbd700 1 --2- 172.21.15.146:0/1313023167 >> v2:172.21.15.146:3300/0 conn(0x7f3400130ce0 0x7f3400131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.647+0000 7f3407bbd700 1 --2- 172.21.15.146:0/1313023167 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f340009d860 0x7f340009dc30 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.647+0000 7f3407bbd700 1 --2- 172.21.15.146:0/1313023167 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f340009e170 0x7f34001307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.647+0000 7f3407bbd700 1 -- 172.21.15.146:0/1313023167 >> 172.21.15.146:0/1313023167 conn(0x7f3400099c40 msgr2=0x7f34000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.647+0000 7f3407bbd700 1 -- 172.21.15.146:0/1313023167 shutdown_connections 2023-10-03T10:16:38.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.647+0000 7f3407bbd700 1 -- 172.21.15.146:0/1313023167 wait complete. 2023-10-03T10:16:38.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.649+0000 7f3407bbd700 1 Processor -- start 2023-10-03T10:16:38.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.649+0000 7f3407bbd700 1 -- start start 2023-10-03T10:16:38.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.649+0000 7f3407bbd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f340009d860 0x7f34001201e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.649+0000 7f3407bbd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f340009e170 0x7f3400120720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.649+0000 7f3407bbd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3400130ce0 0x7f3400120c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.649+0000 7f3407bbd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3400121f20 con 0x7f3400130ce0 2023-10-03T10:16:38.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.649+0000 7f3407bbd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3400122ff0 con 0x7f340009d860 2023-10-03T10:16:38.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.649+0000 7f3407bbd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3400123cb0 con 0x7f340009e170 2023-10-03T10:16:38.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.649+0000 7f3405959700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f340009d860 0x7f34001201e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.649+0000 7f3405959700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f340009d860 0x7f34001201e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58624/0 (socket says 172.21.15.146:58624) 2023-10-03T10:16:38.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.649+0000 7f3405959700 1 -- 172.21.15.146:0/1276732067 learned_addr learned my addr 172.21.15.146:0/1276732067 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:38.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.650+0000 7f3405158700 1 --2- 172.21.15.146:0/1276732067 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f340009e170 0x7f3400120720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.650+0000 7f340615a700 1 --2- 172.21.15.146:0/1276732067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3400130ce0 0x7f3400120c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.650+0000 7f3405959700 1 -- 172.21.15.146:0/1276732067 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f340009e170 msgr2=0x7f3400120720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.650+0000 7f3405959700 1 --2- 172.21.15.146:0/1276732067 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f340009e170 0x7f3400120720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.650+0000 7f3405959700 1 -- 172.21.15.146:0/1276732067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3400130ce0 msgr2=0x7f3400120c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.650+0000 7f3405959700 1 --2- 172.21.15.146:0/1276732067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3400130ce0 0x7f3400120c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.650+0000 7f3405959700 1 -- 172.21.15.146:0/1276732067 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33fc009550 con 0x7f340009d860 2023-10-03T10:16:38.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.650+0000 7f3405158700 1 --2- 172.21.15.146:0/1276732067 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f340009e170 0x7f3400120720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:38.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.650+0000 7f3405959700 1 --2- 172.21.15.146:0/1276732067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f340009d860 0x7f34001201e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f33fc000c00 tx=0x7f33fc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.650+0000 7f33f67fc700 1 -- 172.21.15.146:0/1276732067 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc004380 con 0x7f340009d860 2023-10-03T10:16:38.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.650+0000 7f33f67fc700 1 -- 172.21.15.146:0/1276732067 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33fc01f070 con 0x7f340009d860 2023-10-03T10:16:38.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.650+0000 7f3407bbd700 1 -- 172.21.15.146:0/1276732067 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f340009c8b0 con 0x7f340009d860 2023-10-03T10:16:38.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.650+0000 7f33f67fc700 1 -- 172.21.15.146:0/1276732067 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc0036a0 con 0x7f340009d860 2023-10-03T10:16:38.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.650+0000 7f3407bbd700 1 -- 172.21.15.146:0/1276732067 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34001239d0 con 0x7f340009d860 2023-10-03T10:16:38.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.651+0000 7f3407bbd700 1 -- 172.21.15.146:0/1276732067 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f340004f2a0 con 0x7f340009d860 2023-10-03T10:16:38.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.652+0000 7f33f67fc700 1 -- 172.21.15.146:0/1276732067 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f33fc021030 con 0x7f340009d860 2023-10-03T10:16:38.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.652+0000 7f33f67fc700 1 -- 172.21.15.146:0/1276732067 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f33fc0483b0 con 0x7f340009d860 2023-10-03T10:16:38.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.661+0000 7f33f67fc700 1 -- 172.21.15.146:0/1276732067 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33fc00b9d0 con 0x7f340009d860 2023-10-03T10:16:38.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.686+0000 7fe6c1870700 1 -- 172.21.15.146:0/2817040039 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe6bc11d040 con 0x7fe6bc0a1340 2023-10-03T10:16:38.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.686+0000 7fe6a3fff700 1 -- 172.21.15.146:0/2817040039 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe6bc11d040 con 0x7fe6bc0a1340 2023-10-03T10:16:38.687 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:38.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.688+0000 7fe6c1870700 1 -- 172.21.15.146:0/2817040039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6bc0a1340 msgr2=0x7fe6bc1c67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.688+0000 7fe6c1870700 1 --2- 172.21.15.146:0/2817040039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6bc0a1340 0x7fe6bc1c67b0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0001eb0 tx=0x7fe6b000c800 comp rx=0 tx=0).stop 2023-10-03T10:16:38.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.688+0000 7fe6c1870700 1 -- 172.21.15.146:0/2817040039 shutdown_connections 2023-10-03T10:16:38.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.688+0000 7fe6c1870700 1 --2- 172.21.15.146:0/2817040039 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6bc130670 0x7fe6bc11af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.688+0000 7fe6c1870700 1 --2- 172.21.15.146:0/2817040039 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6bc0a0a30 0x7fe6bc1c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.688+0000 7fe6c1870700 1 --2- 172.21.15.146:0/2817040039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6bc0a1340 0x7fe6bc1c67b0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.688+0000 7fe6c1870700 1 -- 172.21.15.146:0/2817040039 >> 172.21.15.146:0/2817040039 conn(0x7fe6bc0a2980 msgr2=0x7fe6bc070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.688+0000 7fe6c1870700 1 -- 172.21.15.146:0/2817040039 shutdown_connections 2023-10-03T10:16:38.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.688+0000 7fe6c1870700 1 -- 172.21.15.146:0/2817040039 wait complete. 2023-10-03T10:16:38.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:38.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.801+0000 7fd7c859d700 1 -- 172.21.15.146:0/3056497325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd7c004f2a0 con 0x7fd7c0133900 2023-10-03T10:16:38.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.802+0000 7fd7b6ffd700 1 -- 172.21.15.146:0/3056497325 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd7b001b340 con 0x7fd7c0133900 2023-10-03T10:16:38.802 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:38.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.804+0000 7fd7c859d700 1 -- 172.21.15.146:0/3056497325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7c0133900 msgr2=0x7fd7c011dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.804+0000 7fd7c859d700 1 --2- 172.21.15.146:0/3056497325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7c0133900 0x7fd7c011dba0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fd7c006b750 tx=0x7fd7b000c790 comp rx=0 tx=0).stop 2023-10-03T10:16:38.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.804+0000 7fd7c859d700 1 -- 172.21.15.146:0/3056497325 shutdown_connections 2023-10-03T10:16:38.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.804+0000 7fd7c859d700 1 --2- 172.21.15.146:0/3056497325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7c0134210 0x7fd7c011e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.804+0000 7fd7c859d700 1 --2- 172.21.15.146:0/3056497325 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd7c00a10b0 0x7fd7c011d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.804+0000 7fd7c859d700 1 --2- 172.21.15.146:0/3056497325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7c0133900 0x7fd7c011dba0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.804+0000 7fd7c859d700 1 -- 172.21.15.146:0/3056497325 >> 172.21.15.146:0/3056497325 conn(0x7fd7c00a2980 msgr2=0x7fd7c01bac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.804+0000 7fd7c859d700 1 -- 172.21.15.146:0/3056497325 shutdown_connections 2023-10-03T10:16:38.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.804+0000 7fd7c859d700 1 -- 172.21.15.146:0/3056497325 wait complete. 2023-10-03T10:16:38.818 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:38.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.856+0000 7fafe732a700 1 -- 172.21.15.146:0/1456467776 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fafe009a2c0 con 0x7fafe00a0ee0 2023-10-03T10:16:38.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.856+0000 7fafd5ffb700 1 -- 172.21.15.146:0/1456467776 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fafdc020070 con 0x7fafe00a0ee0 2023-10-03T10:16:38.856 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:38.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.858+0000 7fafe732a700 1 -- 172.21.15.146:0/1456467776 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fafe00a0ee0 msgr2=0x7fafe011d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.858+0000 7fafe732a700 1 --2- 172.21.15.146:0/1456467776 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fafe00a0ee0 0x7fafe011d750 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fafe00a2370 tx=0x7fafdc004750 comp rx=0 tx=0).stop 2023-10-03T10:16:38.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.858+0000 7fafe732a700 1 -- 172.21.15.146:0/1456467776 shutdown_connections 2023-10-03T10:16:38.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.858+0000 7fafe732a700 1 --2- 172.21.15.146:0/1456467776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe0134210 0x7fafe011e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.858+0000 7fafe732a700 1 --2- 172.21.15.146:0/1456467776 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fafe00a0ee0 0x7fafe011d750 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.858+0000 7fafe732a700 1 --2- 172.21.15.146:0/1456467776 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafe0133900 0x7fafe011dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.858+0000 7fafe732a700 1 -- 172.21.15.146:0/1456467776 >> 172.21.15.146:0/1456467776 conn(0x7fafe00a2980 msgr2=0x7fafe01bae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.858+0000 7fafe732a700 1 -- 172.21.15.146:0/1456467776 shutdown_connections 2023-10-03T10:16:38.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.858+0000 7fafe732a700 1 -- 172.21.15.146:0/1456467776 wait complete. 2023-10-03T10:16:38.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:38.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.896+0000 7f3407bbd700 1 -- 172.21.15.146:0/1276732067 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f340006c3b0 con 0x7f340009d860 2023-10-03T10:16:38.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.896+0000 7f33f67fc700 1 -- 172.21.15.146:0/1276732067 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f33fc015030 con 0x7f340009d860 2023-10-03T10:16:38.897 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:38.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.898+0000 7f3407bbd700 1 -- 172.21.15.146:0/1276732067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f340009d860 msgr2=0x7f34001201e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.898+0000 7f3407bbd700 1 --2- 172.21.15.146:0/1276732067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f340009d860 0x7f34001201e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f33fc000c00 tx=0x7f33fc004750 comp rx=0 tx=0).stop 2023-10-03T10:16:38.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.898+0000 7f3407bbd700 1 -- 172.21.15.146:0/1276732067 shutdown_connections 2023-10-03T10:16:38.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.898+0000 7f3407bbd700 1 --2- 172.21.15.146:0/1276732067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3400130ce0 0x7f3400120c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.898+0000 7f3407bbd700 1 --2- 172.21.15.146:0/1276732067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f340009d860 0x7f34001201e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.898+0000 7f3407bbd700 1 --2- 172.21.15.146:0/1276732067 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f340009e170 0x7f3400120720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.898+0000 7f3407bbd700 1 -- 172.21.15.146:0/1276732067 >> 172.21.15.146:0/1276732067 conn(0x7f3400099c40 msgr2=0x7f340006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.899+0000 7f3407bbd700 1 -- 172.21.15.146:0/1276732067 shutdown_connections 2023-10-03T10:16:38.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:38.899+0000 7f3407bbd700 1 -- 172.21.15.146:0/1276732067 wait complete. 2023-10-03T10:16:38.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:39.702 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:39.818 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:39.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.827+0000 7fb11f4be700 1 Processor -- start 2023-10-03T10:16:39.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.828+0000 7fb11f4be700 1 -- start start 2023-10-03T10:16:39.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.828+0000 7fb11f4be700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb118133ad0 0x7fb118133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.828+0000 7fb11f4be700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb1181300a0 0x7fb1181304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.828+0000 7fb11f4be700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1181309f0 0x7fb11813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.828+0000 7fb11f4be700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb11806b2d0 con 0x7fb1181300a0 2023-10-03T10:16:39.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.828+0000 7fb11f4be700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb118133610 con 0x7fb118133ad0 2023-10-03T10:16:39.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.828+0000 7fb11f4be700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb11809a500 con 0x7fb1181309f0 2023-10-03T10:16:39.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.829+0000 7fb11ca59700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb1181300a0 0x7fb1181304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.829+0000 7fb11da5b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1181309f0 0x7fb11813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.829+0000 7fb11d25a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb118133ad0 0x7fb118133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.829+0000 7fb11ca59700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb1181300a0 0x7fb1181304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33324/0 (socket says 172.21.15.146:33324) 2023-10-03T10:16:39.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.829+0000 7fb11ca59700 1 -- 172.21.15.146:0/1691281511 learned_addr learned my addr 172.21.15.146:0/1691281511 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:39.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.829+0000 7fb11d25a700 1 -- 172.21.15.146:0/1691281511 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1181309f0 msgr2=0x7fb11813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:39.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.829+0000 7fb11d25a700 1 --2- 172.21.15.146:0/1691281511 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1181309f0 0x7fb11813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.829+0000 7fb11d25a700 1 -- 172.21.15.146:0/1691281511 >> v2:172.21.15.146:3300/0 conn(0x7fb1181300a0 msgr2=0x7fb1181304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:39.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.829+0000 7fb11d25a700 1 --2- 172.21.15.146:0/1691281511 >> v2:172.21.15.146:3300/0 conn(0x7fb1181300a0 0x7fb1181304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.829+0000 7fb11d25a700 1 -- 172.21.15.146:0/1691281511 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1181338b0 con 0x7fb118133ad0 2023-10-03T10:16:39.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.829+0000 7fb11ca59700 1 --2- 172.21.15.146:0/1691281511 >> v2:172.21.15.146:3300/0 conn(0x7fb1181300a0 0x7fb1181304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.829+0000 7fb11d25a700 1 --2- 172.21.15.146:0/1691281511 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb118133ad0 0x7fb118133ea0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fb114009840 tx=0x7fb114009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a00f987e3fa0bd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.829+0000 7fb10ffff700 1 -- 172.21.15.146:0/1691281511 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb114011830 con 0x7fb118133ad0 2023-10-03T10:16:39.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.829+0000 7fb10ffff700 1 -- 172.21.15.146:0/1691281511 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb114011990 con 0x7fb118133ad0 2023-10-03T10:16:39.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.829+0000 7fb10ffff700 1 -- 172.21.15.146:0/1691281511 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb114011d20 con 0x7fb118133ad0 2023-10-03T10:16:39.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.830+0000 7fb11f4be700 1 -- 172.21.15.146:0/1691281511 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb118133ad0 msgr2=0x7fb118133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.830+0000 7fb11f4be700 1 --2- 172.21.15.146:0/1691281511 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb118133ad0 0x7fb118133ea0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fb114009840 tx=0x7fb114009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:39.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.830+0000 7fb11f4be700 1 -- 172.21.15.146:0/1691281511 shutdown_connections 2023-10-03T10:16:39.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.830+0000 7fb11f4be700 1 --2- 172.21.15.146:0/1691281511 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb118133ad0 0x7fb118133ea0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.830+0000 7fb11f4be700 1 --2- 172.21.15.146:0/1691281511 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1181309f0 0x7fb11813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.830+0000 7fb11f4be700 1 --2- 172.21.15.146:0/1691281511 >> v2:172.21.15.146:3300/0 conn(0x7fb1181300a0 0x7fb1181304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.830+0000 7fb11f4be700 1 -- 172.21.15.146:0/1691281511 >> 172.21.15.146:0/1691281511 conn(0x7fb118099c40 msgr2=0x7fb1180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.830+0000 7fb11f4be700 1 -- 172.21.15.146:0/1691281511 shutdown_connections 2023-10-03T10:16:39.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.830+0000 7fb11f4be700 1 -- 172.21.15.146:0/1691281511 wait complete. 2023-10-03T10:16:39.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.831+0000 7fb11f4be700 1 Processor -- start 2023-10-03T10:16:39.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.831+0000 7fb11f4be700 1 -- start start 2023-10-03T10:16:39.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.831+0000 7fb11f4be700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1181300a0 0x7fb11811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.831+0000 7fb11f4be700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1181309f0 0x7fb11811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.831+0000 7fb11f4be700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb118133ad0 0x7fb11811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.831+0000 7fb11f4be700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1180726c0 con 0x7fb1181300a0 2023-10-03T10:16:39.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.831+0000 7fb11f4be700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11812d970 con 0x7fb1181309f0 2023-10-03T10:16:39.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.831+0000 7fb11f4be700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1180a33e0 con 0x7fb118133ad0 2023-10-03T10:16:39.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.832+0000 7fb11da5b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb118133ad0 0x7fb11811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.832+0000 7fb11d25a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1181300a0 0x7fb11811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.832+0000 7fb11da5b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb118133ad0 0x7fb11811e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40790/0 (socket says 172.21.15.146:40790) 2023-10-03T10:16:39.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.832+0000 7fb11da5b700 1 -- 172.21.15.146:0/1663959819 learned_addr learned my addr 172.21.15.146:0/1663959819 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:39.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.832+0000 7fb11da5b700 1 -- 172.21.15.146:0/1663959819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1181309f0 msgr2=0x7fb11811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.832+0000 7fb11da5b700 1 --2- 172.21.15.146:0/1663959819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1181309f0 0x7fb11811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.832+0000 7fb11da5b700 1 -- 172.21.15.146:0/1663959819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1181300a0 msgr2=0x7fb11811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.832+0000 7fb11da5b700 1 --2- 172.21.15.146:0/1663959819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1181300a0 0x7fb11811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.832+0000 7fb11da5b700 1 -- 172.21.15.146:0/1663959819 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb108009550 con 0x7fb118133ad0 2023-10-03T10:16:39.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.832+0000 7fb11d25a700 1 --2- 172.21.15.146:0/1663959819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1181300a0 0x7fb11811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.832+0000 7fb11da5b700 1 --2- 172.21.15.146:0/1663959819 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb118133ad0 0x7fb11811e4c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb110009dd0 tx=0x7fb11000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.832+0000 7fb10dffb700 1 -- 172.21.15.146:0/1663959819 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb110009c40 con 0x7fb118133ad0 2023-10-03T10:16:39.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.832+0000 7fb10dffb700 1 -- 172.21.15.146:0/1663959819 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11000f040 con 0x7fb118133ad0 2023-10-03T10:16:39.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.832+0000 7fb11f4be700 1 -- 172.21.15.146:0/1663959819 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1140094a0 con 0x7fb118133ad0 2023-10-03T10:16:39.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.832+0000 7fb10dffb700 1 -- 172.21.15.146:0/1663959819 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb110014480 con 0x7fb118133ad0 2023-10-03T10:16:39.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.832+0000 7fb11f4be700 1 -- 172.21.15.146:0/1663959819 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb11811fde0 con 0x7fb118133ad0 2023-10-03T10:16:39.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.833+0000 7fb10dffb700 1 -- 172.21.15.146:0/1663959819 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb1100145e0 con 0x7fb118133ad0 2023-10-03T10:16:39.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.833+0000 7fb10dffb700 1 -- 172.21.15.146:0/1663959819 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb11003fe00 con 0x7fb118133ad0 2023-10-03T10:16:39.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.834+0000 7fb11f4be700 1 -- 172.21.15.146:0/1663959819 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb11811f950 con 0x7fb118133ad0 2023-10-03T10:16:39.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.838+0000 7fb10dffb700 1 -- 172.21.15.146:0/1663959819 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb110018020 con 0x7fb118133ad0 2023-10-03T10:16:39.871 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:39.913 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:39.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.949+0000 7f2d600fe700 1 Processor -- start 2023-10-03T10:16:39.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.949+0000 7f2d600fe700 1 -- start start 2023-10-03T10:16:39.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.950+0000 7f2d600fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d5809d860 0x7f2d5809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.950+0000 7f2d600fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d5809e170 0x7f2d581307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.950+0000 7f2d600fe700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5809aaa0 con 0x7f2d58130ce0 2023-10-03T10:16:39.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.950+0000 7f2d600fe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5809f870 con 0x7f2d5809e170 2023-10-03T10:16:39.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.950+0000 7f2d600fe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5809b360 con 0x7f2d5809d860 2023-10-03T10:16:39.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.950+0000 7f2d5e69b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2d58130ce0 0x7f2d581379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43168/0 (socket says 172.21.15.146:43168) 2023-10-03T10:16:39.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.950+0000 7f2d5e69b700 1 -- 172.21.15.146:0/2619260607 learned_addr learned my addr 172.21.15.146:0/2619260607 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:39.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.950+0000 7f2d5de9a700 1 --2- 172.21.15.146:0/2619260607 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d5809d860 0x7f2d5809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.950+0000 7f2d5d699700 1 --2- 172.21.15.146:0/2619260607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d5809e170 0x7f2d581307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.950+0000 7f2d5ce98700 1 -- 172.21.15.146:0/2619260607 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352387235 0 0) 0x7f2d5809aaa0 con 0x7f2d58130ce0 2023-10-03T10:16:39.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.950+0000 7f2d5ce98700 1 -- 172.21.15.146:0/2619260607 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d440035b0 con 0x7f2d58130ce0 2023-10-03T10:16:39.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.951+0000 7f2d5de9a700 1 -- 172.21.15.146:0/2619260607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d5809e170 msgr2=0x7f2d581307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:39.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.951+0000 7f2d5de9a700 1 --2- 172.21.15.146:0/2619260607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d5809e170 0x7f2d581307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.951+0000 7f2d5de9a700 1 -- 172.21.15.146:0/2619260607 >> v1:172.21.15.146:6789/0 conn(0x7f2d58130ce0 legacy=0x7f2d581379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.951+0000 7f2d5de9a700 1 -- 172.21.15.146:0/2619260607 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5809b620 con 0x7f2d5809d860 2023-10-03T10:16:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.951+0000 7f2d5de9a700 1 --2- 172.21.15.146:0/2619260607 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d5809d860 0x7f2d5809dc30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2d54009870 tx=0x7f2d54009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2128675742cc8e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.951+0000 7f2d5ce98700 1 -- 172.21.15.146:0/2619260607 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54011830 con 0x7f2d5809d860 2023-10-03T10:16:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.951+0000 7f2d5ce98700 1 -- 172.21.15.146:0/2619260607 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d54011990 con 0x7f2d5809d860 2023-10-03T10:16:39.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.951+0000 7f2d5ce98700 1 -- 172.21.15.146:0/2619260607 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54011d20 con 0x7f2d5809d860 2023-10-03T10:16:39.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.952+0000 7f2d600fe700 1 -- 172.21.15.146:0/2619260607 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d5809d860 msgr2=0x7f2d5809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.952+0000 7f2d600fe700 1 --2- 172.21.15.146:0/2619260607 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d5809d860 0x7f2d5809dc30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2d54009870 tx=0x7f2d54009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:39.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.952+0000 7f2d600fe700 1 -- 172.21.15.146:0/2619260607 shutdown_connections 2023-10-03T10:16:39.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.952+0000 7f2d600fe700 1 --2- 172.21.15.146:0/2619260607 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d5809d860 0x7f2d5809dc30 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.952+0000 7f2d600fe700 1 --2- 172.21.15.146:0/2619260607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d5809e170 0x7f2d581307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.952+0000 7f2d600fe700 1 -- 172.21.15.146:0/2619260607 >> 172.21.15.146:0/2619260607 conn(0x7f2d58099c40 msgr2=0x7f2d580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.952+0000 7f2d600fe700 1 -- 172.21.15.146:0/2619260607 shutdown_connections 2023-10-03T10:16:39.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.952+0000 7f2d600fe700 1 -- 172.21.15.146:0/2619260607 wait complete. 2023-10-03T10:16:39.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.954+0000 7f2d600fe700 1 Processor -- start 2023-10-03T10:16:39.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.954+0000 7f2d600fe700 1 -- start start 2023-10-03T10:16:39.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.954+0000 7f2d600fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d5809d860 0x7f2d5811d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.954+0000 7f2d600fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d5809e170 0x7f2d5811db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.954+0000 7f2d600fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d58130ce0 0x7f2d5811e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.954+0000 7f2d600fe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5809c8b0 con 0x7f2d5809e170 2023-10-03T10:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.954+0000 7f2d600fe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5806b510 con 0x7f2d5809d860 2023-10-03T10:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.954+0000 7f2d600fe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5811fe40 con 0x7f2d58130ce0 2023-10-03T10:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.954+0000 7f2d5e69b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d58130ce0 0x7f2d5811e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.955+0000 7f2d5e69b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d58130ce0 0x7f2d5811e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40816/0 (socket says 172.21.15.146:40816) 2023-10-03T10:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.955+0000 7f2d5e69b700 1 -- 172.21.15.146:0/3335760996 learned_addr learned my addr 172.21.15.146:0/3335760996 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.955+0000 7f2d5de9a700 1 --2- 172.21.15.146:0/3335760996 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d5809d860 0x7f2d5811d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.955+0000 7f2d5d699700 1 --2- 172.21.15.146:0/3335760996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d5809e170 0x7f2d5811db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.955+0000 7f2d5e69b700 1 -- 172.21.15.146:0/3335760996 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d5809d860 msgr2=0x7f2d5811d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.955+0000 7f2d5e69b700 1 --2- 172.21.15.146:0/3335760996 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d5809d860 0x7f2d5811d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.955+0000 7f2d5e69b700 1 -- 172.21.15.146:0/3335760996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d5809e170 msgr2=0x7f2d5811db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.955+0000 7f2d5e69b700 1 --2- 172.21.15.146:0/3335760996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d5809e170 0x7f2d5811db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.955+0000 7f2d5e69b700 1 -- 172.21.15.146:0/3335760996 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d540094a0 con 0x7f2d58130ce0 2023-10-03T10:16:39.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.955+0000 7f2d5e69b700 1 --2- 172.21.15.146:0/3335760996 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d58130ce0 0x7f2d5811e0a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2d5000cb40 tx=0x7f2d5000ce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.955+0000 7f2d4e7fc700 1 -- 172.21.15.146:0/3335760996 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5000a9e0 con 0x7f2d58130ce0 2023-10-03T10:16:39.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.955+0000 7f2d4e7fc700 1 -- 172.21.15.146:0/3335760996 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5000ab40 con 0x7f2d58130ce0 2023-10-03T10:16:39.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.955+0000 7f2d600fe700 1 -- 172.21.15.146:0/3335760996 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5811e7c0 con 0x7f2d58130ce0 2023-10-03T10:16:39.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.955+0000 7f2d4e7fc700 1 -- 172.21.15.146:0/3335760996 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d50011560 con 0x7f2d58130ce0 2023-10-03T10:16:39.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.955+0000 7f2d600fe700 1 -- 172.21.15.146:0/3335760996 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5806aa70 con 0x7f2d58130ce0 2023-10-03T10:16:39.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.957+0000 7f2d600fe700 1 -- 172.21.15.146:0/3335760996 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d5804f2a0 con 0x7f2d58130ce0 2023-10-03T10:16:39.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.957+0000 7f2d4e7fc700 1 -- 172.21.15.146:0/3335760996 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d50017070 con 0x7f2d58130ce0 2023-10-03T10:16:39.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.957+0000 7f2d4e7fc700 1 -- 172.21.15.146:0/3335760996 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2d500116c0 con 0x7f2d58130ce0 2023-10-03T10:16:39.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:39.966+0000 7f2d4e7fc700 1 -- 172.21.15.146:0/3335760996 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d50048060 con 0x7f2d58130ce0 2023-10-03T10:16:40.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.009+0000 7f72180cf700 1 Processor -- start 2023-10-03T10:16:40.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.010+0000 7f72180cf700 1 -- start start 2023-10-03T10:16:40.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.010+0000 7f72180cf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f721009d860 0x7f721009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.010+0000 7f72180cf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f721009e170 0x7f72101307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.010+0000 7f72180cf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7210130ce0 0x7f7210131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.010+0000 7f72180cf700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721009aaa0 con 0x7f7210130ce0 2023-10-03T10:16:40.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.010+0000 7f72180cf700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721009f870 con 0x7f721009d860 2023-10-03T10:16:40.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.010+0000 7f72180cf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f721009b360 con 0x7f721009e170 2023-10-03T10:16:40.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.010+0000 7f7215e6b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f721009d860 0x7f721009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.011+0000 7f7215e6b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f721009d860 0x7f721009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58656/0 (socket says 172.21.15.146:58656) 2023-10-03T10:16:40.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.011+0000 7f7215e6b700 1 -- 172.21.15.146:0/2717321905 learned_addr learned my addr 172.21.15.146:0/2717321905 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:40.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.011+0000 7f721566a700 1 --2- 172.21.15.146:0/2717321905 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f721009e170 0x7f72101307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.011+0000 7f721666c700 1 --2- 172.21.15.146:0/2717321905 >> v2:172.21.15.146:3300/0 conn(0x7f7210130ce0 0x7f7210131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.011+0000 7f7215e6b700 1 -- 172.21.15.146:0/2717321905 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f721009e170 msgr2=0x7f72101307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:40.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.011+0000 7f7215e6b700 1 --2- 172.21.15.146:0/2717321905 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f721009e170 0x7f72101307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.011+0000 7f7215e6b700 1 -- 172.21.15.146:0/2717321905 >> v2:172.21.15.146:3300/0 conn(0x7f7210130ce0 msgr2=0x7f7210131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:40.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.011+0000 7f7215e6b700 1 --2- 172.21.15.146:0/2717321905 >> v2:172.21.15.146:3300/0 conn(0x7f7210130ce0 0x7f7210131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.011+0000 7f7215e6b700 1 -- 172.21.15.146:0/2717321905 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721009b620 con 0x7f721009d860 2023-10-03T10:16:40.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.011+0000 7f7215e6b700 1 --2- 172.21.15.146:0/2717321905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f721009d860 0x7f721009dc30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f720c0098f0 tx=0x7f720c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8ca3e73686df2a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.011+0000 7f7214e69700 1 -- 172.21.15.146:0/2717321905 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c011830 con 0x7f721009d860 2023-10-03T10:16:40.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.011+0000 7f7214e69700 1 -- 172.21.15.146:0/2717321905 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720c011990 con 0x7f721009d860 2023-10-03T10:16:40.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.011+0000 7f7214e69700 1 -- 172.21.15.146:0/2717321905 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c011d20 con 0x7f721009d860 2023-10-03T10:16:40.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.012+0000 7f72180cf700 1 -- 172.21.15.146:0/2717321905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f721009d860 msgr2=0x7f721009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.012+0000 7f72180cf700 1 --2- 172.21.15.146:0/2717321905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f721009d860 0x7f721009dc30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f720c0098f0 tx=0x7f720c009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:40.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.012+0000 7f72180cf700 1 -- 172.21.15.146:0/2717321905 shutdown_connections 2023-10-03T10:16:40.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.012+0000 7f72180cf700 1 --2- 172.21.15.146:0/2717321905 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f721009d860 0x7f721009dc30 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.012+0000 7f72180cf700 1 --2- 172.21.15.146:0/2717321905 >> v2:172.21.15.146:3300/0 conn(0x7f7210130ce0 0x7f7210131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.012+0000 7f72180cf700 1 --2- 172.21.15.146:0/2717321905 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f721009e170 0x7f72101307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.012+0000 7f72180cf700 1 -- 172.21.15.146:0/2717321905 >> 172.21.15.146:0/2717321905 conn(0x7f7210099c40 msgr2=0x7f72100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.012+0000 7f72180cf700 1 -- 172.21.15.146:0/2717321905 shutdown_connections 2023-10-03T10:16:40.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.012+0000 7f72180cf700 1 -- 172.21.15.146:0/2717321905 wait complete. 2023-10-03T10:16:40.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.014+0000 7f72180cf700 1 Processor -- start 2023-10-03T10:16:40.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.014+0000 7f72180cf700 1 -- start start 2023-10-03T10:16:40.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.014+0000 7f72180cf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f721009d860 0x7f72101c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.014+0000 7f72180cf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f721009e170 0x7f72101c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.014+0000 7f72180cf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7210130ce0 0x7f72101c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.014+0000 7f72180cf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721012f610 con 0x7f721009d860 2023-10-03T10:16:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.014+0000 7f72180cf700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7210124f80 con 0x7f721009e170 2023-10-03T10:16:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.014+0000 7f72180cf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7210120090 con 0x7f7210130ce0 2023-10-03T10:16:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.015+0000 7f721566a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f721009e170 0x7f72101c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.015+0000 7f721566a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f721009e170 0x7f72101c8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58664/0 (socket says 172.21.15.146:58664) 2023-10-03T10:16:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.015+0000 7f721566a700 1 -- 172.21.15.146:0/2579270966 learned_addr learned my addr 172.21.15.146:0/2579270966 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.015+0000 7f721666c700 1 --2- 172.21.15.146:0/2579270966 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7210130ce0 0x7f72101c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.015+0000 7f7215e6b700 1 --2- 172.21.15.146:0/2579270966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f721009d860 0x7f72101c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.015+0000 7f721666c700 1 -- 172.21.15.146:0/2579270966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f721009e170 msgr2=0x7f72101c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.015+0000 7f721666c700 1 --2- 172.21.15.146:0/2579270966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f721009e170 0x7f72101c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.015+0000 7f721666c700 1 -- 172.21.15.146:0/2579270966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f721009d860 msgr2=0x7f72101c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.015+0000 7f721666c700 1 --2- 172.21.15.146:0/2579270966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f721009d860 0x7f72101c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.015+0000 7f721666c700 1 -- 172.21.15.146:0/2579270966 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720c009550 con 0x7f7210130ce0 2023-10-03T10:16:40.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.015+0000 7f721666c700 1 --2- 172.21.15.146:0/2579270966 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7210130ce0 0x7f72101c9010 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f720800efc0 tx=0x7f720800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.015+0000 7f72067fc700 1 -- 172.21.15.146:0/2579270966 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720800cc90 con 0x7f7210130ce0 2023-10-03T10:16:40.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.015+0000 7f72067fc700 1 -- 172.21.15.146:0/2579270966 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720800f040 con 0x7f7210130ce0 2023-10-03T10:16:40.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.015+0000 7f72180cf700 1 -- 172.21.15.146:0/2579270966 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72101307a0 con 0x7f7210130ce0 2023-10-03T10:16:40.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.015+0000 7f72067fc700 1 -- 172.21.15.146:0/2579270966 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72080146c0 con 0x7f7210130ce0 2023-10-03T10:16:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.016+0000 7f72180cf700 1 -- 172.21.15.146:0/2579270966 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7210124ca0 con 0x7f7210130ce0 2023-10-03T10:16:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.016+0000 7f72067fc700 1 -- 172.21.15.146:0/2579270966 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7208014820 con 0x7f7210130ce0 2023-10-03T10:16:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.017+0000 7f72067fc700 1 -- 172.21.15.146:0/2579270966 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f72080403f0 con 0x7f7210130ce0 2023-10-03T10:16:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.017+0000 7f72180cf700 1 -- 172.21.15.146:0/2579270966 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721004f2a0 con 0x7f7210130ce0 2023-10-03T10:16:40.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.026+0000 7f72067fc700 1 -- 172.21.15.146:0/2579270966 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7208009e60 con 0x7f7210130ce0 2023-10-03T10:16:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.044+0000 7f04c28e2700 1 Processor -- start 2023-10-03T10:16:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.044+0000 7f04c28e2700 1 -- start start 2023-10-03T10:16:40.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.045+0000 7f04c28e2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f04bc06a770 0x7f04bc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.045+0000 7f04c28e2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f04bc09dec0 0x7f04bc06b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.045+0000 7f04c28e2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04bc06b5c0 con 0x7f04bc131a00 2023-10-03T10:16:40.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.045+0000 7f04c28e2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04bc06e900 con 0x7f04bc09dec0 2023-10-03T10:16:40.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.045+0000 7f04c28e2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc09d180 con 0x7f04bc06a770 2023-10-03T10:16:40.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.045+0000 7f04c0e7f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f04bc131a00 0x7f04bc131e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43176/0 (socket says 172.21.15.146:43176) 2023-10-03T10:16:40.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.045+0000 7f04c0e7f700 1 -- 172.21.15.146:0/4224355827 learned_addr learned my addr 172.21.15.146:0/4224355827 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:40.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.045+0000 7f04bb7fe700 1 --2- 172.21.15.146:0/4224355827 >> v2:172.21.15.146:3300/0 conn(0x7f04bc09dec0 0x7f04bc06b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.045+0000 7f04bbfff700 1 --2- 172.21.15.146:0/4224355827 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f04bc06a770 0x7f04bc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.046+0000 7f04bb7fe700 1 -- 172.21.15.146:0/4224355827 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f04bc06a770 msgr2=0x7f04bc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:40.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.046+0000 7f04bb7fe700 1 --2- 172.21.15.146:0/4224355827 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f04bc06a770 0x7f04bc06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.046+0000 7f04bb7fe700 1 -- 172.21.15.146:0/4224355827 >> v1:172.21.15.146:6789/0 conn(0x7f04bc131a00 legacy=0x7f04bc131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.046+0000 7f04bb7fe700 1 -- 172.21.15.146:0/4224355827 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc09e780 con 0x7f04bc09dec0 2023-10-03T10:16:40.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.046+0000 7f04bb7fe700 1 --2- 172.21.15.146:0/4224355827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04bc09dec0 0x7f04bc06b080 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009840 tx=0x7f04b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f9ba21cc72a3e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.046+0000 7f04baffd700 1 -- 172.21.15.146:0/4224355827 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b0011830 con 0x7f04bc09dec0 2023-10-03T10:16:40.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.046+0000 7f04baffd700 1 -- 172.21.15.146:0/4224355827 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b0011990 con 0x7f04bc09dec0 2023-10-03T10:16:40.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.046+0000 7f04baffd700 1 -- 172.21.15.146:0/4224355827 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b0011d20 con 0x7f04bc09dec0 2023-10-03T10:16:40.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.047+0000 7f04c28e2700 1 -- 172.21.15.146:0/4224355827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04bc09dec0 msgr2=0x7f04bc06b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.047+0000 7f04c28e2700 1 --2- 172.21.15.146:0/4224355827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04bc09dec0 0x7f04bc06b080 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009840 tx=0x7f04b0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:40.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.047+0000 7f04c28e2700 1 -- 172.21.15.146:0/4224355827 shutdown_connections 2023-10-03T10:16:40.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.047+0000 7f04c28e2700 1 --2- 172.21.15.146:0/4224355827 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f04bc06a770 0x7f04bc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.047+0000 7f04c28e2700 1 --2- 172.21.15.146:0/4224355827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04bc09dec0 0x7f04bc06b080 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.047+0000 7f04c28e2700 1 -- 172.21.15.146:0/4224355827 >> 172.21.15.146:0/4224355827 conn(0x7f04bc099c40 msgr2=0x7f04bc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.047+0000 7f04c28e2700 1 -- 172.21.15.146:0/4224355827 shutdown_connections 2023-10-03T10:16:40.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.047+0000 7f04c28e2700 1 -- 172.21.15.146:0/4224355827 wait complete. 2023-10-03T10:16:40.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.047+0000 7fb11f4be700 1 -- 172.21.15.146:0/1663959819 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb118074f10 con 0x7fb118133ad0 2023-10-03T10:16:40.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.047+0000 7fb10dffb700 1 -- 172.21.15.146:0/1663959819 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb11003f070 con 0x7fb118133ad0 2023-10-03T10:16:40.050 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:40.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.048+0000 7f04c28e2700 1 Processor -- start 2023-10-03T10:16:40.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.048+0000 7f04c28e2700 1 -- start start 2023-10-03T10:16:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.048+0000 7f04c28e2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04bc06a770 0x7f04bc11c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.048+0000 7f04c28e2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04bc09dec0 0x7f04bc11c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.049+0000 7f04c28e2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f04bc131a00 0x7f04bc11cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.049+0000 7f04c28e2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc11f920 con 0x7f04bc06a770 2023-10-03T10:16:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.049+0000 7f04c28e2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc071ce0 con 0x7f04bc09dec0 2023-10-03T10:16:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.049+0000 7f04c28e2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc11dc40 con 0x7f04bc131a00 2023-10-03T10:16:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.049+0000 7f04c0e7f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f04bc131a00 0x7f04bc11cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.049+0000 7f04c0e7f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f04bc131a00 0x7f04bc11cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40876/0 (socket says 172.21.15.146:40876) 2023-10-03T10:16:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.049+0000 7f04c0e7f700 1 -- 172.21.15.146:0/3135294081 learned_addr learned my addr 172.21.15.146:0/3135294081 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.049+0000 7f04c0e7f700 1 -- 172.21.15.146:0/3135294081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04bc09dec0 msgr2=0x7f04bc11c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.049+0000 7f04c0e7f700 1 --2- 172.21.15.146:0/3135294081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04bc09dec0 0x7f04bc11c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.049+0000 7f04c0e7f700 1 -- 172.21.15.146:0/3135294081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04bc06a770 msgr2=0x7f04bc11c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.049+0000 7f04c0e7f700 1 --2- 172.21.15.146:0/3135294081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04bc06a770 0x7f04bc11c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.049+0000 7f04c0e7f700 1 -- 172.21.15.146:0/3135294081 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b00094a0 con 0x7f04bc131a00 2023-10-03T10:16:40.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.049+0000 7f04c0e7f700 1 --2- 172.21.15.146:0/3135294081 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f04bc131a00 0x7f04bc11cb00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f04b400cbf0 tx=0x7f04b40021c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.049+0000 7f04b8ff9700 1 -- 172.21.15.146:0/3135294081 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b400ab40 con 0x7f04bc131a00 2023-10-03T10:16:40.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.049+0000 7f04b8ff9700 1 -- 172.21.15.146:0/3135294081 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b400aca0 con 0x7f04bc131a00 2023-10-03T10:16:40.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.049+0000 7f04b8ff9700 1 -- 172.21.15.146:0/3135294081 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4012600 con 0x7f04bc131a00 2023-10-03T10:16:40.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.049+0000 7f04c28e2700 1 -- 172.21.15.146:0/3135294081 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04bc11fb80 con 0x7f04bc131a00 2023-10-03T10:16:40.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.049+0000 7f04c28e2700 1 -- 172.21.15.146:0/3135294081 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04bc11e330 con 0x7f04bc131a00 2023-10-03T10:16:40.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.050+0000 7f04c28e2700 1 -- 172.21.15.146:0/3135294081 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04bc04f2a0 con 0x7f04bc131a00 2023-10-03T10:16:40.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.050+0000 7fb11f4be700 1 -- 172.21.15.146:0/1663959819 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb118133ad0 msgr2=0x7fb11811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.050+0000 7fb11f4be700 1 --2- 172.21.15.146:0/1663959819 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb118133ad0 0x7fb11811e4c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb110009dd0 tx=0x7fb11000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.051+0000 7fb11f4be700 1 -- 172.21.15.146:0/1663959819 shutdown_connections 2023-10-03T10:16:40.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.051+0000 7fb11f4be700 1 --2- 172.21.15.146:0/1663959819 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb118133ad0 0x7fb11811e4c0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.051+0000 7fb11f4be700 1 --2- 172.21.15.146:0/1663959819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1181300a0 0x7fb11811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.051+0000 7fb11f4be700 1 --2- 172.21.15.146:0/1663959819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1181309f0 0x7fb11811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.051+0000 7fb11f4be700 1 -- 172.21.15.146:0/1663959819 >> 172.21.15.146:0/1663959819 conn(0x7fb118099c40 msgr2=0x7fb118132bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.051+0000 7fb11f4be700 1 -- 172.21.15.146:0/1663959819 shutdown_connections 2023-10-03T10:16:40.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.051+0000 7fb11f4be700 1 -- 172.21.15.146:0/1663959819 wait complete. 2023-10-03T10:16:40.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.051+0000 7f04b8ff9700 1 -- 172.21.15.146:0/3135294081 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f04b401b3b0 con 0x7f04bc131a00 2023-10-03T10:16:40.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.051+0000 7f04b8ff9700 1 -- 172.21.15.146:0/3135294081 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f04b403f910 con 0x7f04bc131a00 2023-10-03T10:16:40.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.056+0000 7f04b8ff9700 1 -- 172.21.15.146:0/3135294081 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04b401b660 con 0x7f04bc131a00 2023-10-03T10:16:40.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:40.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.250+0000 7f04c28e2700 1 -- 172.21.15.146:0/3135294081 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f04bc09e3a0 con 0x7f04bc131a00 2023-10-03T10:16:40.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.251+0000 7f04b8ff9700 1 -- 172.21.15.146:0/3135294081 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f04b4017030 con 0x7f04bc131a00 2023-10-03T10:16:40.251 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:40.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.253+0000 7f04c28e2700 1 -- 172.21.15.146:0/3135294081 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f04bc131a00 msgr2=0x7f04bc11cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.253+0000 7f04c28e2700 1 --2- 172.21.15.146:0/3135294081 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f04bc131a00 0x7f04bc11cb00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f04b400cbf0 tx=0x7f04b40021c0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.253+0000 7f04c28e2700 1 -- 172.21.15.146:0/3135294081 shutdown_connections 2023-10-03T10:16:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.253+0000 7f04c28e2700 1 --2- 172.21.15.146:0/3135294081 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f04bc131a00 0x7f04bc11cb00 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.253+0000 7f04c28e2700 1 --2- 172.21.15.146:0/3135294081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04bc06a770 0x7f04bc11c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.253+0000 7f04c28e2700 1 --2- 172.21.15.146:0/3135294081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04bc09dec0 0x7f04bc11c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.253+0000 7f04c28e2700 1 -- 172.21.15.146:0/3135294081 >> 172.21.15.146:0/3135294081 conn(0x7f04bc099c40 msgr2=0x7f04bc1b8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.254+0000 7f04c28e2700 1 -- 172.21.15.146:0/3135294081 shutdown_connections 2023-10-03T10:16:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.254+0000 7f04c28e2700 1 -- 172.21.15.146:0/3135294081 wait complete. 2023-10-03T10:16:40.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.259+0000 7f2d600fe700 1 -- 172.21.15.146:0/3335760996 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2d58130ac0 con 0x7f2d58130ce0 2023-10-03T10:16:40.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.259+0000 7f2d4e7fc700 1 -- 172.21.15.146:0/3335760996 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2d5001f070 con 0x7f2d58130ce0 2023-10-03T10:16:40.260 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:40.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.261+0000 7f2d600fe700 1 -- 172.21.15.146:0/3335760996 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d58130ce0 msgr2=0x7f2d5811e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.261+0000 7f2d600fe700 1 --2- 172.21.15.146:0/3335760996 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d58130ce0 0x7f2d5811e0a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2d5000cb40 tx=0x7f2d5000ce50 comp rx=0 tx=0).stop 2023-10-03T10:16:40.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.261+0000 7f2d600fe700 1 -- 172.21.15.146:0/3335760996 shutdown_connections 2023-10-03T10:16:40.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.261+0000 7f2d600fe700 1 --2- 172.21.15.146:0/3335760996 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d58130ce0 0x7f2d5811e0a0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.261+0000 7f2d600fe700 1 --2- 172.21.15.146:0/3335760996 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d5809d860 0x7f2d5811d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.261+0000 7f2d600fe700 1 --2- 172.21.15.146:0/3335760996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d5809e170 0x7f2d5811db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.261+0000 7f2d600fe700 1 -- 172.21.15.146:0/3335760996 >> 172.21.15.146:0/3335760996 conn(0x7f2d58099c40 msgr2=0x7f2d580a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.262+0000 7f2d600fe700 1 -- 172.21.15.146:0/3335760996 shutdown_connections 2023-10-03T10:16:40.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.262+0000 7f2d600fe700 1 -- 172.21.15.146:0/3335760996 wait complete. 2023-10-03T10:16:40.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:40.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:40.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.301+0000 7f72180cf700 1 -- 172.21.15.146:0/2579270966 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f721006c3b0 con 0x7f7210130ce0 2023-10-03T10:16:40.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.302+0000 7f72067fc700 1 -- 172.21.15.146:0/2579270966 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7208012340 con 0x7f7210130ce0 2023-10-03T10:16:40.302 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:40.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.304+0000 7f72180cf700 1 -- 172.21.15.146:0/2579270966 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7210130ce0 msgr2=0x7f72101c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.304+0000 7f72180cf700 1 --2- 172.21.15.146:0/2579270966 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7210130ce0 0x7f72101c9010 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f720800efc0 tx=0x7f720800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.304+0000 7f72180cf700 1 -- 172.21.15.146:0/2579270966 shutdown_connections 2023-10-03T10:16:40.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.304+0000 7f72180cf700 1 --2- 172.21.15.146:0/2579270966 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7210130ce0 0x7f72101c9010 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.304+0000 7f72180cf700 1 --2- 172.21.15.146:0/2579270966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f721009d860 0x7f72101c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.304+0000 7f72180cf700 1 --2- 172.21.15.146:0/2579270966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f721009e170 0x7f72101c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.304+0000 7f72180cf700 1 -- 172.21.15.146:0/2579270966 >> 172.21.15.146:0/2579270966 conn(0x7f7210099c40 msgr2=0x7f7210071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.304+0000 7f72180cf700 1 -- 172.21.15.146:0/2579270966 shutdown_connections 2023-10-03T10:16:40.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:40.304+0000 7f72180cf700 1 -- 172.21.15.146:0/2579270966 wait complete. 2023-10-03T10:16:40.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:41.066 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:41.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.192+0000 7f4746830700 1 Processor -- start 2023-10-03T10:16:41.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.192+0000 7f4746830700 1 -- start start 2023-10-03T10:16:41.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.192+0000 7f4746830700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4740133ad0 0x7f4740133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.192+0000 7f4746830700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47401300a0 0x7f47401304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.192+0000 7f4746830700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f474006b2d0 con 0x7f47401309f0 2023-10-03T10:16:41.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.192+0000 7f4746830700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4740133610 con 0x7f4740133ad0 2023-10-03T10:16:41.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.192+0000 7f4746830700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474009a500 con 0x7f47401300a0 2023-10-03T10:16:41.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.192+0000 7f473ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4740133ad0 0x7f4740133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.193+0000 7f473f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47401300a0 0x7f47401304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.193+0000 7f4744dcd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f47401309f0 0x7f474013a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43178/0 (socket says 172.21.15.146:43178) 2023-10-03T10:16:41.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.193+0000 7f4744dcd700 1 -- 172.21.15.146:0/3996394125 learned_addr learned my addr 172.21.15.146:0/3996394125 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:41.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.193+0000 7f473ffff700 1 -- 172.21.15.146:0/3996394125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47401300a0 msgr2=0x7f47401304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:41.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.193+0000 7f473ffff700 1 --2- 172.21.15.146:0/3996394125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47401300a0 0x7f47401304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.193+0000 7f473ffff700 1 -- 172.21.15.146:0/3996394125 >> v1:172.21.15.146:6789/0 conn(0x7f47401309f0 legacy=0x7f474013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.193+0000 7f473ffff700 1 -- 172.21.15.146:0/3996394125 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47401338b0 con 0x7f4740133ad0 2023-10-03T10:16:41.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.193+0000 7f473effd700 1 -- 172.21.15.146:0/3996394125 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1164480641 0 0) 0x7f474006b2d0 con 0x7f47401309f0 2023-10-03T10:16:41.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.193+0000 7f473f7fe700 1 --2- 172.21.15.146:0/3996394125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47401300a0 0x7f47401304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:41.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.193+0000 7f473ffff700 1 --2- 172.21.15.146:0/3996394125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4740133ad0 0x7f4740133ea0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f4734009840 tx=0x7f4734009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40c6b4c86828333 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.193+0000 7f473effd700 1 -- 172.21.15.146:0/3996394125 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4734011830 con 0x7f4740133ad0 2023-10-03T10:16:41.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.193+0000 7f473effd700 1 -- 172.21.15.146:0/3996394125 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4734011990 con 0x7f4740133ad0 2023-10-03T10:16:41.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.193+0000 7f473effd700 1 -- 172.21.15.146:0/3996394125 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4734011d20 con 0x7f4740133ad0 2023-10-03T10:16:41.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.194+0000 7f4746830700 1 -- 172.21.15.146:0/3996394125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4740133ad0 msgr2=0x7f4740133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.194+0000 7f4746830700 1 --2- 172.21.15.146:0/3996394125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4740133ad0 0x7f4740133ea0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f4734009840 tx=0x7f4734009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:41.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.194+0000 7f4746830700 1 -- 172.21.15.146:0/3996394125 shutdown_connections 2023-10-03T10:16:41.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.194+0000 7f4746830700 1 --2- 172.21.15.146:0/3996394125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4740133ad0 0x7f4740133ea0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.194+0000 7f4746830700 1 --2- 172.21.15.146:0/3996394125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47401300a0 0x7f47401304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.194+0000 7f4746830700 1 -- 172.21.15.146:0/3996394125 >> 172.21.15.146:0/3996394125 conn(0x7f4740099c40 msgr2=0x7f47400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.194+0000 7f4746830700 1 -- 172.21.15.146:0/3996394125 shutdown_connections 2023-10-03T10:16:41.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.194+0000 7f4746830700 1 -- 172.21.15.146:0/3996394125 wait complete. 2023-10-03T10:16:41.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.195+0000 7f4746830700 1 Processor -- start 2023-10-03T10:16:41.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.195+0000 7f4746830700 1 -- start start 2023-10-03T10:16:41.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.195+0000 7f4746830700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f47401300a0 0x7f474011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.195+0000 7f4746830700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47401309f0 0x7f474011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.195+0000 7f4746830700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4740133ad0 0x7f474011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.195+0000 7f4746830700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47400a3350 con 0x7f47401309f0 2023-10-03T10:16:41.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.195+0000 7f4746830700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474012dd00 con 0x7f4740133ad0 2023-10-03T10:16:41.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.195+0000 7f4746830700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4740072330 con 0x7f47401300a0 2023-10-03T10:16:41.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.195+0000 7f473f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47401309f0 0x7f474011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.195+0000 7f4744dcd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4740133ad0 0x7f474011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.195+0000 7f473ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f47401300a0 0x7f474011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.195+0000 7f473f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47401309f0 0x7f474011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33396/0 (socket says 172.21.15.146:33396) 2023-10-03T10:16:41.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.195+0000 7f473f7fe700 1 -- 172.21.15.146:0/3041999946 learned_addr learned my addr 172.21.15.146:0/3041999946 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:41.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.195+0000 7f4744dcd700 1 -- 172.21.15.146:0/3041999946 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f47401300a0 msgr2=0x7f474011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.195+0000 7f4744dcd700 1 --2- 172.21.15.146:0/3041999946 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f47401300a0 0x7f474011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.196+0000 7f4744dcd700 1 -- 172.21.15.146:0/3041999946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47401309f0 msgr2=0x7f474011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.196+0000 7f4744dcd700 1 --2- 172.21.15.146:0/3041999946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47401309f0 0x7f474011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.196+0000 7f4744dcd700 1 -- 172.21.15.146:0/3041999946 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47300094a0 con 0x7f4740133ad0 2023-10-03T10:16:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.196+0000 7f4744dcd700 1 --2- 172.21.15.146:0/3041999946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4740133ad0 0x7f474011e4c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f473800cbe0 tx=0x7f473800cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.196+0000 7f473cff9700 1 -- 172.21.15.146:0/3041999946 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473800aa40 con 0x7f4740133ad0 2023-10-03T10:16:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.196+0000 7f473cff9700 1 -- 172.21.15.146:0/3041999946 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473800abc0 con 0x7f4740133ad0 2023-10-03T10:16:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.196+0000 7f473cff9700 1 -- 172.21.15.146:0/3041999946 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47380070d0 con 0x7f4740133ad0 2023-10-03T10:16:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.196+0000 7f4746830700 1 -- 172.21.15.146:0/3041999946 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47340094a0 con 0x7f4740133ad0 2023-10-03T10:16:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.196+0000 7f4746830700 1 -- 172.21.15.146:0/3041999946 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f474012d290 con 0x7f4740133ad0 2023-10-03T10:16:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.197+0000 7f473cff9700 1 -- 172.21.15.146:0/3041999946 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4738007230 con 0x7f4740133ad0 2023-10-03T10:16:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.197+0000 7f473cff9700 1 -- 172.21.15.146:0/3041999946 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f473803f010 con 0x7f4740133ad0 2023-10-03T10:16:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.197+0000 7f4746830700 1 -- 172.21.15.146:0/3041999946 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4740131120 con 0x7f4740133ad0 2023-10-03T10:16:41.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.201+0000 7f473cff9700 1 -- 172.21.15.146:0/3041999946 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4738018020 con 0x7f4740133ad0 2023-10-03T10:16:41.269 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:41.275 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:41.318 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:41.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.400+0000 7f4746830700 1 -- 172.21.15.146:0/3041999946 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f474004f2a0 con 0x7f4740133ad0 2023-10-03T10:16:41.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.400+0000 7f473cff9700 1 -- 172.21.15.146:0/3041999946 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f47380074e0 con 0x7f4740133ad0 2023-10-03T10:16:41.401 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:41.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.402+0000 7f4746830700 1 -- 172.21.15.146:0/3041999946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4740133ad0 msgr2=0x7f474011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.402+0000 7f4746830700 1 --2- 172.21.15.146:0/3041999946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4740133ad0 0x7f474011e4c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f473800cbe0 tx=0x7f473800cef0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.402+0000 7f4746830700 1 -- 172.21.15.146:0/3041999946 shutdown_connections 2023-10-03T10:16:41.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.402+0000 7f4746830700 1 --2- 172.21.15.146:0/3041999946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4740133ad0 0x7f474011e4c0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.402+0000 7f4746830700 1 --2- 172.21.15.146:0/3041999946 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f47401300a0 0x7f474011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.402+0000 7f4746830700 1 --2- 172.21.15.146:0/3041999946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47401309f0 0x7f474011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.402+0000 7f4746830700 1 -- 172.21.15.146:0/3041999946 >> 172.21.15.146:0/3041999946 conn(0x7f4740099c40 msgr2=0x7f4740132be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.403+0000 7f4746830700 1 -- 172.21.15.146:0/3041999946 shutdown_connections 2023-10-03T10:16:41.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.403+0000 7f4746830700 1 -- 172.21.15.146:0/3041999946 wait complete. 2023-10-03T10:16:41.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.407+0000 7f832426f700 1 Processor -- start 2023-10-03T10:16:41.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.407+0000 7f832426f700 1 -- start start 2023-10-03T10:16:41.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.407+0000 7f832426f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f831c09d860 0x7f831c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.407+0000 7f832426f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f831c09e170 0x7f831c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.407+0000 7f832426f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f831c130ce0 0x7f831c131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.408+0000 7f832426f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831c09aaa0 con 0x7f831c130ce0 2023-10-03T10:16:41.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.408+0000 7f832426f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831c09f870 con 0x7f831c09d860 2023-10-03T10:16:41.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.408+0000 7f832426f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f831c09b360 con 0x7f831c09e170 2023-10-03T10:16:41.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.408+0000 7f832180a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f831c09e170 0x7f831c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.408+0000 7f832280c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f831c130ce0 0x7f831c131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.408+0000 7f832180a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f831c09e170 0x7f831c1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40898/0 (socket says 172.21.15.146:40898) 2023-10-03T10:16:41.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.408+0000 7f832180a700 1 -- 172.21.15.146:0/1459553857 learned_addr learned my addr 172.21.15.146:0/1459553857 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:41.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.408+0000 7f832200b700 1 --2- 172.21.15.146:0/1459553857 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f831c09d860 0x7f831c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.408+0000 7f832280c700 1 -- 172.21.15.146:0/1459553857 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f831c09e170 msgr2=0x7f831c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:41.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.408+0000 7f832280c700 1 --2- 172.21.15.146:0/1459553857 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f831c09e170 0x7f831c1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.408+0000 7f832280c700 1 -- 172.21.15.146:0/1459553857 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f831c09d860 msgr2=0x7f831c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:41.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.408+0000 7f832280c700 1 --2- 172.21.15.146:0/1459553857 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f831c09d860 0x7f831c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.408+0000 7f832280c700 1 -- 172.21.15.146:0/1459553857 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c09b620 con 0x7f831c130ce0 2023-10-03T10:16:41.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.408+0000 7f832200b700 1 --2- 172.21.15.146:0/1459553857 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f831c09d860 0x7f831c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:41.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.408+0000 7f832280c700 1 --2- 172.21.15.146:0/1459553857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f831c130ce0 0x7f831c131150 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f8314009d90 tx=0x7f831400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6698328709db6181 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.409+0000 7f8321009700 1 -- 172.21.15.146:0/1459553857 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831400bd20 con 0x7f831c130ce0 2023-10-03T10:16:41.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.409+0000 7f8321009700 1 -- 172.21.15.146:0/1459553857 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831400be80 con 0x7f831c130ce0 2023-10-03T10:16:41.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.409+0000 7f8321009700 1 -- 172.21.15.146:0/1459553857 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314010710 con 0x7f831c130ce0 2023-10-03T10:16:41.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.409+0000 7f832426f700 1 -- 172.21.15.146:0/1459553857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f831c130ce0 msgr2=0x7f831c131150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.409+0000 7f832426f700 1 --2- 172.21.15.146:0/1459553857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f831c130ce0 0x7f831c131150 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f8314009d90 tx=0x7f831400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:41.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.410+0000 7f832426f700 1 -- 172.21.15.146:0/1459553857 shutdown_connections 2023-10-03T10:16:41.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.410+0000 7f832426f700 1 --2- 172.21.15.146:0/1459553857 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f831c09d860 0x7f831c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.410+0000 7f832426f700 1 --2- 172.21.15.146:0/1459553857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f831c130ce0 0x7f831c131150 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.410+0000 7f832426f700 1 --2- 172.21.15.146:0/1459553857 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f831c09e170 0x7f831c1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.410+0000 7f832426f700 1 -- 172.21.15.146:0/1459553857 >> 172.21.15.146:0/1459553857 conn(0x7f831c099c40 msgr2=0x7f831c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.410+0000 7f832426f700 1 -- 172.21.15.146:0/1459553857 shutdown_connections 2023-10-03T10:16:41.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.410+0000 7f832426f700 1 -- 172.21.15.146:0/1459553857 wait complete. 2023-10-03T10:16:41.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.411+0000 7f832426f700 1 Processor -- start 2023-10-03T10:16:41.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.411+0000 7f832426f700 1 -- start start 2023-10-03T10:16:41.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.412+0000 7f832426f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f831c09d860 0x7f831c11d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.412+0000 7f832426f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f831c09e170 0x7f831c11d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.412+0000 7f832426f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f831c130ce0 0x7f831c11dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.412+0000 7f832426f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c11e4b0 con 0x7f831c130ce0 2023-10-03T10:16:41.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.412+0000 7f832426f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831c11f240 con 0x7f831c09d860 2023-10-03T10:16:41.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.412+0000 7f832426f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f831c120300 con 0x7f831c09e170 2023-10-03T10:16:41.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.412+0000 7f832200b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f831c09d860 0x7f831c11d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.412+0000 7f832200b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f831c09d860 0x7f831c11d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58716/0 (socket says 172.21.15.146:58716) 2023-10-03T10:16:41.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.412+0000 7f832200b700 1 -- 172.21.15.146:0/145663622 learned_addr learned my addr 172.21.15.146:0/145663622 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:41.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.412+0000 7f832180a700 1 --2- 172.21.15.146:0/145663622 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f831c09e170 0x7f831c11d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.412+0000 7f832280c700 1 --2- 172.21.15.146:0/145663622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f831c130ce0 0x7f831c11dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.412+0000 7f832200b700 1 -- 172.21.15.146:0/145663622 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f831c09e170 msgr2=0x7f831c11d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.412+0000 7f832200b700 1 --2- 172.21.15.146:0/145663622 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f831c09e170 0x7f831c11d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.412+0000 7f832200b700 1 -- 172.21.15.146:0/145663622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f831c130ce0 msgr2=0x7f831c11dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.412+0000 7f832200b700 1 --2- 172.21.15.146:0/145663622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f831c130ce0 0x7f831c11dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.412+0000 7f832200b700 1 -- 172.21.15.146:0/145663622 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83180094a0 con 0x7f831c09d860 2023-10-03T10:16:41.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.412+0000 7f832200b700 1 --2- 172.21.15.146:0/145663622 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f831c09d860 0x7f831c11d050 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f831800b3a0 tx=0x7f831800b6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.413+0000 7f8312ffd700 1 -- 172.21.15.146:0/145663622 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8318019070 con 0x7f831c09d860 2023-10-03T10:16:41.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.413+0000 7f8312ffd700 1 -- 172.21.15.146:0/145663622 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831800be20 con 0x7f831c09d860 2023-10-03T10:16:41.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.413+0000 7f832426f700 1 -- 172.21.15.146:0/145663622 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8314009a70 con 0x7f831c09d860 2023-10-03T10:16:41.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.413+0000 7f8312ffd700 1 -- 172.21.15.146:0/145663622 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831801d650 con 0x7f831c09d860 2023-10-03T10:16:41.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.413+0000 7f832426f700 1 -- 172.21.15.146:0/145663622 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831c09c900 con 0x7f831c09d860 2023-10-03T10:16:41.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.414+0000 7f832426f700 1 -- 172.21.15.146:0/145663622 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831c04f2a0 con 0x7f831c09d860 2023-10-03T10:16:41.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.414+0000 7f8312ffd700 1 -- 172.21.15.146:0/145663622 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f831801d7b0 con 0x7f831c09d860 2023-10-03T10:16:41.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.415+0000 7f8312ffd700 1 -- 172.21.15.146:0/145663622 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8318026730 con 0x7f831c09d860 2023-10-03T10:16:41.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:41.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.421+0000 7f8312ffd700 1 -- 172.21.15.146:0/145663622 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83180263b0 con 0x7f831c09d860 2023-10-03T10:16:41.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.443+0000 7fc5a4e31700 1 Processor -- start 2023-10-03T10:16:41.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.443+0000 7fc5a4e31700 1 -- start start 2023-10-03T10:16:41.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.444+0000 7fc5a4e31700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5a00a0a70 0x7fc5a00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.444+0000 7fc5a4e31700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc5a0134120 0x7fc5a013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.444+0000 7fc5a4e31700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a009dc00 con 0x7fc5a00a1380 2023-10-03T10:16:41.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.444+0000 7fc5a4e31700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a009ea60 con 0x7fc5a0134120 2023-10-03T10:16:41.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.444+0000 7fc5a4e31700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a009dec0 con 0x7fc5a00a0a70 2023-10-03T10:16:41.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.444+0000 7fc59e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5a00a0a70 0x7fc5a00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.444+0000 7fc59e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5a00a0a70 0x7fc5a00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40914/0 (socket says 172.21.15.146:40914) 2023-10-03T10:16:41.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.444+0000 7fc59e59c700 1 -- 172.21.15.146:0/3359153143 learned_addr learned my addr 172.21.15.146:0/3359153143 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:41.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.444+0000 7fc59ed9d700 1 --2- 172.21.15.146:0/3359153143 >> v2:172.21.15.146:3300/0 conn(0x7fc5a0134120 0x7fc5a013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.444+0000 7fc59d59a700 1 -- 172.21.15.146:0/3359153143 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645105990 0 0) 0x7fc5a009dc00 con 0x7fc5a00a1380 2023-10-03T10:16:41.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.444+0000 7fc59e59c700 1 -- 172.21.15.146:0/3359153143 >> v2:172.21.15.146:3300/0 conn(0x7fc5a0134120 msgr2=0x7fc5a013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:41.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.444+0000 7fc59e59c700 1 --2- 172.21.15.146:0/3359153143 >> v2:172.21.15.146:3300/0 conn(0x7fc5a0134120 0x7fc5a013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.444+0000 7fc59e59c700 1 -- 172.21.15.146:0/3359153143 >> v1:172.21.15.146:6789/0 conn(0x7fc5a00a1380 legacy=0x7fc5a0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.444+0000 7fc59e59c700 1 -- 172.21.15.146:0/3359153143 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a009e6a0 con 0x7fc5a00a0a70 2023-10-03T10:16:41.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.445+0000 7fc59e59c700 1 --2- 172.21.15.146:0/3359153143 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5a00a0a70 0x7fc5a00a0e40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc5900098f0 tx=0x7fc590009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51679aaa0c190d3d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.445+0000 7fc59d59a700 1 -- 172.21.15.146:0/3359153143 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59000b8a0 con 0x7fc5a00a0a70 2023-10-03T10:16:41.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.445+0000 7fc59d59a700 1 -- 172.21.15.146:0/3359153143 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59000ba00 con 0x7fc5a00a0a70 2023-10-03T10:16:41.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.445+0000 7fc59d59a700 1 -- 172.21.15.146:0/3359153143 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59000bd90 con 0x7fc5a00a0a70 2023-10-03T10:16:41.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.445+0000 7fc5a4e31700 1 -- 172.21.15.146:0/3359153143 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5a00a0a70 msgr2=0x7fc5a00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.445+0000 7fc5a4e31700 1 --2- 172.21.15.146:0/3359153143 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5a00a0a70 0x7fc5a00a0e40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc5900098f0 tx=0x7fc590009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:41.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.446+0000 7fc5a4e31700 1 -- 172.21.15.146:0/3359153143 shutdown_connections 2023-10-03T10:16:41.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.446+0000 7fc5a4e31700 1 --2- 172.21.15.146:0/3359153143 >> v2:172.21.15.146:3300/0 conn(0x7fc5a0134120 0x7fc5a013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.446+0000 7fc5a4e31700 1 --2- 172.21.15.146:0/3359153143 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5a00a0a70 0x7fc5a00a0e40 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.446+0000 7fc5a4e31700 1 -- 172.21.15.146:0/3359153143 >> 172.21.15.146:0/3359153143 conn(0x7fc5a00a6610 msgr2=0x7fc5a00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.446+0000 7fc5a4e31700 1 -- 172.21.15.146:0/3359153143 shutdown_connections 2023-10-03T10:16:41.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.446+0000 7fc5a4e31700 1 -- 172.21.15.146:0/3359153143 wait complete. 2023-10-03T10:16:41.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.447+0000 7fc5a4e31700 1 Processor -- start 2023-10-03T10:16:41.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.447+0000 7fc5a4e31700 1 -- start start 2023-10-03T10:16:41.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.448+0000 7fc5a4e31700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5a00a0a70 0x7fc5a01226f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.448+0000 7fc5a4e31700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5a00a1380 0x7fc5a0122c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.448+0000 7fc5a4e31700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5a0134120 0x7fc5a0123170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.448+0000 7fc5a4e31700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a01332f0 con 0x7fc5a00a0a70 2023-10-03T10:16:41.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.448+0000 7fc5a4e31700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a01258f0 con 0x7fc5a0134120 2023-10-03T10:16:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.448+0000 7fc5a4e31700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a0123b50 con 0x7fc5a00a1380 2023-10-03T10:16:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.448+0000 7fc59e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5a00a0a70 0x7fc5a01226f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.448+0000 7fc59e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5a00a0a70 0x7fc5a01226f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33454/0 (socket says 172.21.15.146:33454) 2023-10-03T10:16:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.448+0000 7fc59e59c700 1 -- 172.21.15.146:0/1256049642 learned_addr learned my addr 172.21.15.146:0/1256049642 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.448+0000 7fc59ed9d700 1 --2- 172.21.15.146:0/1256049642 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5a0134120 0x7fc5a0123170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.448+0000 7fc59dd9b700 1 --2- 172.21.15.146:0/1256049642 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5a00a1380 0x7fc5a0122c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.448+0000 7fc59e59c700 1 -- 172.21.15.146:0/1256049642 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5a00a1380 msgr2=0x7fc5a0122c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.448+0000 7fc59e59c700 1 --2- 172.21.15.146:0/1256049642 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5a00a1380 0x7fc5a0122c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.448+0000 7fc59e59c700 1 -- 172.21.15.146:0/1256049642 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5a0134120 msgr2=0x7fc5a0123170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.448+0000 7fc59e59c700 1 --2- 172.21.15.146:0/1256049642 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5a0134120 0x7fc5a0123170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.448+0000 7fc59e59c700 1 -- 172.21.15.146:0/1256049642 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc590009550 con 0x7fc5a00a0a70 2023-10-03T10:16:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.449+0000 7fc59e59c700 1 --2- 172.21.15.146:0/1256049642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5a00a0a70 0x7fc5a01226f0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fc590009c40 tx=0x7fc590004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.449+0000 7fc58effd700 1 -- 172.21.15.146:0/1256049642 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590004240 con 0x7fc5a00a0a70 2023-10-03T10:16:41.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.449+0000 7fc58effd700 1 -- 172.21.15.146:0/1256049642 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59001f070 con 0x7fc5a00a0a70 2023-10-03T10:16:41.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.449+0000 7fc58effd700 1 -- 172.21.15.146:0/1256049642 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5900045a0 con 0x7fc5a00a0a70 2023-10-03T10:16:41.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.449+0000 7fc5a4e31700 1 -- 172.21.15.146:0/1256049642 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a0126210 con 0x7fc5a00a0a70 2023-10-03T10:16:41.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.449+0000 7fc5a4e31700 1 -- 172.21.15.146:0/1256049642 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a00a5660 con 0x7fc5a00a0a70 2023-10-03T10:16:41.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.450+0000 7fc58effd700 1 -- 172.21.15.146:0/1256049642 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc590021030 con 0x7fc5a00a0a70 2023-10-03T10:16:41.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.450+0000 7fc58effd700 1 -- 172.21.15.146:0/1256049642 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc590040960 con 0x7fc5a00a0a70 2023-10-03T10:16:41.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.450+0000 7fc5a4e31700 1 -- 172.21.15.146:0/1256049642 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a0133640 con 0x7fc5a00a0a70 2023-10-03T10:16:41.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.455+0000 7fc58effd700 1 -- 172.21.15.146:0/1256049642 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc590006d80 con 0x7fc5a00a0a70 2023-10-03T10:16:41.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.485+0000 7fe026f2f700 1 Processor -- start 2023-10-03T10:16:41.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.485+0000 7fe026f2f700 1 -- start start 2023-10-03T10:16:41.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.485+0000 7fe026f2f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe02006a770 0x7fe0201349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.485+0000 7fe026f2f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe02009e070 0x7fe02013fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.485+0000 7fe026f2f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe02009eca0 con 0x7fe020134f00 2023-10-03T10:16:41.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.485+0000 7fe026f2f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02006b2e0 con 0x7fe02009e070 2023-10-03T10:16:41.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.485+0000 7fe026f2f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe02009f720 con 0x7fe02006a770 2023-10-03T10:16:41.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.485+0000 7fe0254cc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe02009e070 0x7fe02013fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.485+0000 7fe024ccb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe02006a770 0x7fe0201349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.485+0000 7fe01ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe020134f00 0x7fe02009d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43194/0 (socket says 172.21.15.146:43194) 2023-10-03T10:16:41.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.485+0000 7fe0254cc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe02009e070 0x7fe02013fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58734/0 (socket says 172.21.15.146:58734) 2023-10-03T10:16:41.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.485+0000 7fe01ffff700 1 -- 172.21.15.146:0/3196172034 learned_addr learned my addr 172.21.15.146:0/3196172034 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:41.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.486+0000 7fe024ccb700 1 -- 172.21.15.146:0/3196172034 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe02009e070 msgr2=0x7fe02013fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:41.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.486+0000 7fe024ccb700 1 --2- 172.21.15.146:0/3196172034 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe02009e070 0x7fe02013fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.486+0000 7fe024ccb700 1 -- 172.21.15.146:0/3196172034 >> v1:172.21.15.146:6789/0 conn(0x7fe020134f00 legacy=0x7fe02009d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.486+0000 7fe024ccb700 1 -- 172.21.15.146:0/3196172034 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02006b480 con 0x7fe02006a770 2023-10-03T10:16:41.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.486+0000 7fe0254cc700 1 --2- 172.21.15.146:0/3196172034 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe02009e070 0x7fe02013fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:41.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.486+0000 7fe024ccb700 1 --2- 172.21.15.146:0/3196172034 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe02006a770 0x7fe0201349c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe010009870 tx=0x7fe010009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a582d894cca94f63 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.486+0000 7fe01f7fe700 1 -- 172.21.15.146:0/3196172034 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe010011830 con 0x7fe02006a770 2023-10-03T10:16:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.486+0000 7fe01f7fe700 1 -- 172.21.15.146:0/3196172034 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe010011990 con 0x7fe02006a770 2023-10-03T10:16:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.486+0000 7fe01f7fe700 1 -- 172.21.15.146:0/3196172034 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe010011d20 con 0x7fe02006a770 2023-10-03T10:16:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.487+0000 7fe026f2f700 1 -- 172.21.15.146:0/3196172034 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe02006a770 msgr2=0x7fe0201349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.487+0000 7fe026f2f700 1 --2- 172.21.15.146:0/3196172034 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe02006a770 0x7fe0201349c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe010009870 tx=0x7fe010009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.487+0000 7fe026f2f700 1 -- 172.21.15.146:0/3196172034 shutdown_connections 2023-10-03T10:16:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.487+0000 7fe026f2f700 1 --2- 172.21.15.146:0/3196172034 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe02009e070 0x7fe02013fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.487+0000 7fe026f2f700 1 --2- 172.21.15.146:0/3196172034 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe02006a770 0x7fe0201349c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.487+0000 7fe026f2f700 1 -- 172.21.15.146:0/3196172034 >> 172.21.15.146:0/3196172034 conn(0x7fe020099c40 msgr2=0x7fe0200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.487+0000 7fe026f2f700 1 -- 172.21.15.146:0/3196172034 shutdown_connections 2023-10-03T10:16:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.487+0000 7fe026f2f700 1 -- 172.21.15.146:0/3196172034 wait complete. 2023-10-03T10:16:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.488+0000 7fe026f2f700 1 Processor -- start 2023-10-03T10:16:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.488+0000 7fe026f2f700 1 -- start start 2023-10-03T10:16:41.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.488+0000 7fe026f2f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe02006a770 0x7fe020133d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.488+0000 7fe026f2f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe02009e070 0x7fe02011a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.488+0000 7fe026f2f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe020134f00 0x7fe02011aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.488+0000 7fe026f2f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02011b990 con 0x7fe02009e070 2023-10-03T10:16:41.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.488+0000 7fe026f2f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02009f220 con 0x7fe020134f00 2023-10-03T10:16:41.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.488+0000 7fe026f2f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe020138e90 con 0x7fe02006a770 2023-10-03T10:16:41.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.488+0000 7fe024ccb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe02006a770 0x7fe020133d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.488+0000 7fe0254cc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe020134f00 0x7fe02011aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.488+0000 7fe024ccb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe02006a770 0x7fe020133d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40940/0 (socket says 172.21.15.146:40940) 2023-10-03T10:16:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.488+0000 7fe024ccb700 1 -- 172.21.15.146:0/536682112 learned_addr learned my addr 172.21.15.146:0/536682112 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.488+0000 7fe0254cc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe020134f00 0x7fe02011aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58746/0 (socket says 172.21.15.146:58746) 2023-10-03T10:16:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.488+0000 7fe01ffff700 1 --2- 172.21.15.146:0/536682112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe02009e070 0x7fe02011a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.489+0000 7fe0254cc700 1 -- 172.21.15.146:0/536682112 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe02006a770 msgr2=0x7fe020133d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.489+0000 7fe0254cc700 1 --2- 172.21.15.146:0/536682112 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe02006a770 0x7fe020133d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.489+0000 7fe0254cc700 1 -- 172.21.15.146:0/536682112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe02009e070 msgr2=0x7fe02011a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.489+0000 7fe0254cc700 1 --2- 172.21.15.146:0/536682112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe02009e070 0x7fe02011a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.489+0000 7fe0254cc700 1 -- 172.21.15.146:0/536682112 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe018009a70 con 0x7fe020134f00 2023-10-03T10:16:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.489+0000 7fe0254cc700 1 --2- 172.21.15.146:0/536682112 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe020134f00 0x7fe02011aa00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe018009e50 tx=0x7fe01800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.489+0000 7fe01d7fa700 1 -- 172.21.15.146:0/536682112 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01800ca90 con 0x7fe020134f00 2023-10-03T10:16:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.489+0000 7fe01d7fa700 1 -- 172.21.15.146:0/536682112 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01800f040 con 0x7fe020134f00 2023-10-03T10:16:41.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.489+0000 7fe026f2f700 1 -- 172.21.15.146:0/536682112 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0100094a0 con 0x7fe020134f00 2023-10-03T10:16:41.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.489+0000 7fe01d7fa700 1 -- 172.21.15.146:0/536682112 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01800ce50 con 0x7fe020134f00 2023-10-03T10:16:41.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.489+0000 7fe026f2f700 1 -- 172.21.15.146:0/536682112 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0200a0ed0 con 0x7fe020134f00 2023-10-03T10:16:41.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.490+0000 7fe01d7fa700 1 -- 172.21.15.146:0/536682112 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe018014480 con 0x7fe020134f00 2023-10-03T10:16:41.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.490+0000 7fe01d7fa700 1 -- 172.21.15.146:0/536682112 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe01803fc30 con 0x7fe020134f00 2023-10-03T10:16:41.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.490+0000 7fe026f2f700 1 -- 172.21.15.146:0/536682112 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0201399c0 con 0x7fe020134f00 2023-10-03T10:16:41.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.495+0000 7fe01d7fa700 1 -- 172.21.15.146:0/536682112 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe018012930 con 0x7fe020134f00 2023-10-03T10:16:41.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.653+0000 7f832426f700 1 -- 172.21.15.146:0/145663622 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f831c11feb0 con 0x7f831c09d860 2023-10-03T10:16:41.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.653+0000 7f8312ffd700 1 -- 172.21.15.146:0/145663622 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8318022020 con 0x7f831c09d860 2023-10-03T10:16:41.654 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:41.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.655+0000 7f832426f700 1 -- 172.21.15.146:0/145663622 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f831c09d860 msgr2=0x7f831c11d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.655+0000 7f832426f700 1 --2- 172.21.15.146:0/145663622 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f831c09d860 0x7f831c11d050 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f831800b3a0 tx=0x7f831800b6b0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.655+0000 7f832426f700 1 -- 172.21.15.146:0/145663622 shutdown_connections 2023-10-03T10:16:41.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.655+0000 7f832426f700 1 --2- 172.21.15.146:0/145663622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f831c130ce0 0x7f831c11dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.655+0000 7f832426f700 1 --2- 172.21.15.146:0/145663622 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f831c09d860 0x7f831c11d050 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.655+0000 7f832426f700 1 --2- 172.21.15.146:0/145663622 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f831c09e170 0x7f831c11d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.655+0000 7f832426f700 1 -- 172.21.15.146:0/145663622 >> 172.21.15.146:0/145663622 conn(0x7f831c099c40 msgr2=0x7f831c12ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.655+0000 7f832426f700 1 -- 172.21.15.146:0/145663622 shutdown_connections 2023-10-03T10:16:41.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.655+0000 7f832426f700 1 -- 172.21.15.146:0/145663622 wait complete. 2023-10-03T10:16:41.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:41.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.683+0000 7fc5a4e31700 1 -- 172.21.15.146:0/1256049642 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc5a00a03e0 con 0x7fc5a00a0a70 2023-10-03T10:16:41.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.683+0000 7fc58effd700 1 -- 172.21.15.146:0/1256049642 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc59001b430 con 0x7fc5a00a0a70 2023-10-03T10:16:41.684 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:41.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.685+0000 7fc5a4e31700 1 -- 172.21.15.146:0/1256049642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5a00a0a70 msgr2=0x7fc5a01226f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.685+0000 7fc5a4e31700 1 --2- 172.21.15.146:0/1256049642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5a00a0a70 0x7fc5a01226f0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fc590009c40 tx=0x7fc590004750 comp rx=0 tx=0).stop 2023-10-03T10:16:41.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.685+0000 7fc5a4e31700 1 -- 172.21.15.146:0/1256049642 shutdown_connections 2023-10-03T10:16:41.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.685+0000 7fc5a4e31700 1 --2- 172.21.15.146:0/1256049642 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5a0134120 0x7fc5a0123170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.685+0000 7fc5a4e31700 1 --2- 172.21.15.146:0/1256049642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5a00a0a70 0x7fc5a01226f0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.685+0000 7fc5a4e31700 1 --2- 172.21.15.146:0/1256049642 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5a00a1380 0x7fc5a0122c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.685+0000 7fc5a4e31700 1 -- 172.21.15.146:0/1256049642 >> 172.21.15.146:0/1256049642 conn(0x7fc5a00a6610 msgr2=0x7fc5a00a5870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.685+0000 7fc5a4e31700 1 -- 172.21.15.146:0/1256049642 shutdown_connections 2023-10-03T10:16:41.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.685+0000 7fc5a4e31700 1 -- 172.21.15.146:0/1256049642 wait complete. 2023-10-03T10:16:41.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.686+0000 7fe026f2f700 1 -- 172.21.15.146:0/536682112 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe02004f2a0 con 0x7fe020134f00 2023-10-03T10:16:41.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.686+0000 7fe01d7fa700 1 -- 172.21.15.146:0/536682112 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe018012340 con 0x7fe020134f00 2023-10-03T10:16:41.688 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:41.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.689+0000 7fe026f2f700 1 -- 172.21.15.146:0/536682112 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe020134f00 msgr2=0x7fe02011aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.689+0000 7fe026f2f700 1 --2- 172.21.15.146:0/536682112 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe020134f00 0x7fe02011aa00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe018009e50 tx=0x7fe01800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.689+0000 7fe026f2f700 1 -- 172.21.15.146:0/536682112 shutdown_connections 2023-10-03T10:16:41.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.689+0000 7fe026f2f700 1 --2- 172.21.15.146:0/536682112 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe020134f00 0x7fe02011aa00 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.689+0000 7fe026f2f700 1 --2- 172.21.15.146:0/536682112 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe02006a770 0x7fe020133d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.689+0000 7fe026f2f700 1 --2- 172.21.15.146:0/536682112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe02009e070 0x7fe02011a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.689+0000 7fe026f2f700 1 -- 172.21.15.146:0/536682112 >> 172.21.15.146:0/536682112 conn(0x7fe020099c40 msgr2=0x7fe02009c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.689+0000 7fe026f2f700 1 -- 172.21.15.146:0/536682112 shutdown_connections 2023-10-03T10:16:41.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:41.689+0000 7fe026f2f700 1 -- 172.21.15.146:0/536682112 wait complete. 2023-10-03T10:16:41.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:41.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:42.423 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:42.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.549+0000 7fbf7cda3700 1 Processor -- start 2023-10-03T10:16:42.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.549+0000 7fbf7cda3700 1 -- start start 2023-10-03T10:16:42.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.549+0000 7fbf7cda3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf7809d860 0x7fbf7809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.549+0000 7fbf7cda3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf7809e170 0x7fbf781307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.549+0000 7fbf7cda3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbf78130ce0 0x7fbf78131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.549+0000 7fbf7cda3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf7809aaa0 con 0x7fbf78130ce0 2023-10-03T10:16:42.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.549+0000 7fbf7cda3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7809f870 con 0x7fbf7809e170 2023-10-03T10:16:42.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.549+0000 7fbf7cda3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7809b360 con 0x7fbf7809d860 2023-10-03T10:16:42.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.549+0000 7fbf7659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf7809d860 0x7fbf7809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.549+0000 7fbf76d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbf78130ce0 0x7fbf78131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.549+0000 7fbf7659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf7809d860 0x7fbf7809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40944/0 (socket says 172.21.15.146:40944) 2023-10-03T10:16:42.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.549+0000 7fbf76d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbf78130ce0 0x7fbf78131150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33472/0 (socket says 172.21.15.146:33472) 2023-10-03T10:16:42.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.549+0000 7fbf7659c700 1 -- 172.21.15.146:0/3629555622 learned_addr learned my addr 172.21.15.146:0/3629555622 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:42.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.549+0000 7fbf75d9b700 1 --2- 172.21.15.146:0/3629555622 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf7809e170 0x7fbf781307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.550+0000 7fbf76d9d700 1 -- 172.21.15.146:0/3629555622 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf7809d860 msgr2=0x7fbf7809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.550+0000 7fbf76d9d700 1 --2- 172.21.15.146:0/3629555622 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf7809d860 0x7fbf7809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.550+0000 7fbf76d9d700 1 -- 172.21.15.146:0/3629555622 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf7809e170 msgr2=0x7fbf781307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.550+0000 7fbf76d9d700 1 --2- 172.21.15.146:0/3629555622 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf7809e170 0x7fbf781307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.550+0000 7fbf76d9d700 1 -- 172.21.15.146:0/3629555622 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7809b620 con 0x7fbf78130ce0 2023-10-03T10:16:42.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.550+0000 7fbf7659c700 1 --2- 172.21.15.146:0/3629555622 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf7809d860 0x7fbf7809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.550+0000 7fbf75d9b700 1 --2- 172.21.15.146:0/3629555622 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf7809e170 0x7fbf781307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.550+0000 7fbf76d9d700 1 --2- 172.21.15.146:0/3629555622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf78130ce0 0x7fbf78131150 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fbf70009d90 tx=0x7fbf7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f882d7eeca6de5c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.550+0000 7fbf7559a700 1 -- 172.21.15.146:0/3629555622 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7000e070 con 0x7fbf78130ce0 2023-10-03T10:16:42.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.550+0000 7fbf7559a700 1 -- 172.21.15.146:0/3629555622 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7000bb20 con 0x7fbf78130ce0 2023-10-03T10:16:42.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.550+0000 7fbf7559a700 1 -- 172.21.15.146:0/3629555622 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70012430 con 0x7fbf78130ce0 2023-10-03T10:16:42.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.551+0000 7fbf7cda3700 1 -- 172.21.15.146:0/3629555622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf78130ce0 msgr2=0x7fbf78131150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.551+0000 7fbf7cda3700 1 --2- 172.21.15.146:0/3629555622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf78130ce0 0x7fbf78131150 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fbf70009d90 tx=0x7fbf7000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:42.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.551+0000 7fbf7cda3700 1 -- 172.21.15.146:0/3629555622 shutdown_connections 2023-10-03T10:16:42.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.551+0000 7fbf7cda3700 1 --2- 172.21.15.146:0/3629555622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf78130ce0 0x7fbf78131150 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.551+0000 7fbf7cda3700 1 --2- 172.21.15.146:0/3629555622 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf7809d860 0x7fbf7809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.551+0000 7fbf7cda3700 1 --2- 172.21.15.146:0/3629555622 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf7809e170 0x7fbf781307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.551+0000 7fbf7cda3700 1 -- 172.21.15.146:0/3629555622 >> 172.21.15.146:0/3629555622 conn(0x7fbf78099c40 msgr2=0x7fbf780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.551+0000 7fbf7cda3700 1 -- 172.21.15.146:0/3629555622 shutdown_connections 2023-10-03T10:16:42.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.551+0000 7fbf7cda3700 1 -- 172.21.15.146:0/3629555622 wait complete. 2023-10-03T10:16:42.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.552+0000 7fbf7cda3700 1 Processor -- start 2023-10-03T10:16:42.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.552+0000 7fbf7cda3700 1 -- start start 2023-10-03T10:16:42.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.552+0000 7fbf7cda3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf7809d860 0x7fbf7811c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.552+0000 7fbf7cda3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf7809e170 0x7fbf7811c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.552+0000 7fbf7cda3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf78130ce0 0x7fbf7811cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.552+0000 7fbf7cda3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7811fe40 con 0x7fbf7809e170 2023-10-03T10:16:42.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.552+0000 7fbf7cda3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7811f670 con 0x7fbf78130ce0 2023-10-03T10:16:42.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.552+0000 7fbf7cda3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7809c8b0 con 0x7fbf7809d860 2023-10-03T10:16:42.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.552+0000 7fbf75d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf7809e170 0x7fbf7811c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.552+0000 7fbf7659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf7809d860 0x7fbf7811c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.552+0000 7fbf75d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf7809e170 0x7fbf7811c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33476/0 (socket says 172.21.15.146:33476) 2023-10-03T10:16:42.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.552+0000 7fbf75d9b700 1 -- 172.21.15.146:0/1829708470 learned_addr learned my addr 172.21.15.146:0/1829708470 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:42.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.552+0000 7fbf76d9d700 1 --2- 172.21.15.146:0/1829708470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf78130ce0 0x7fbf7811cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.553+0000 7fbf76d9d700 1 -- 172.21.15.146:0/1829708470 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf7809d860 msgr2=0x7fbf7811c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.553+0000 7fbf76d9d700 1 --2- 172.21.15.146:0/1829708470 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf7809d860 0x7fbf7811c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.553+0000 7fbf76d9d700 1 -- 172.21.15.146:0/1829708470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf7809e170 msgr2=0x7fbf7811c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.553+0000 7fbf76d9d700 1 --2- 172.21.15.146:0/1829708470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf7809e170 0x7fbf7811c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.553+0000 7fbf76d9d700 1 -- 172.21.15.146:0/1829708470 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6c00b7f0 con 0x7fbf78130ce0 2023-10-03T10:16:42.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.553+0000 7fbf75d9b700 1 --2- 172.21.15.146:0/1829708470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf7809e170 0x7fbf7811c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.553+0000 7fbf7659c700 1 --2- 172.21.15.146:0/1829708470 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf7809d860 0x7fbf7811c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.553+0000 7fbf76d9d700 1 --2- 172.21.15.146:0/1829708470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf78130ce0 0x7fbf7811cda0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fbf70016000 tx=0x7fbf70004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.553+0000 7fbf66ffd700 1 -- 172.21.15.146:0/1829708470 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70012430 con 0x7fbf78130ce0 2023-10-03T10:16:42.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.553+0000 7fbf66ffd700 1 -- 172.21.15.146:0/1829708470 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf70020070 con 0x7fbf78130ce0 2023-10-03T10:16:42.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.553+0000 7fbf7cda3700 1 -- 172.21.15.146:0/1829708470 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf680094a0 con 0x7fbf78130ce0 2023-10-03T10:16:42.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.553+0000 7fbf66ffd700 1 -- 172.21.15.146:0/1829708470 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70004280 con 0x7fbf78130ce0 2023-10-03T10:16:42.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.553+0000 7fbf7cda3700 1 -- 172.21.15.146:0/1829708470 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf70009a70 con 0x7fbf78130ce0 2023-10-03T10:16:42.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.554+0000 7fbf66ffd700 1 -- 172.21.15.146:0/1829708470 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf700043e0 con 0x7fbf78130ce0 2023-10-03T10:16:42.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.554+0000 7fbf66ffd700 1 -- 172.21.15.146:0/1829708470 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbf70022070 con 0x7fbf78130ce0 2023-10-03T10:16:42.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.554+0000 7fbf7cda3700 1 -- 172.21.15.146:0/1829708470 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf7804f2a0 con 0x7fbf78130ce0 2023-10-03T10:16:42.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.558+0000 7fbf66ffd700 1 -- 172.21.15.146:0/1829708470 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf7001c400 con 0x7fbf78130ce0 2023-10-03T10:16:42.669 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:42.701 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:42.703 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:42.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.750+0000 7fbf7cda3700 1 -- 172.21.15.146:0/1829708470 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbf780a2260 con 0x7fbf78130ce0 2023-10-03T10:16:42.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.751+0000 7fbf66ffd700 1 -- 172.21.15.146:0/1829708470 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbf70035090 con 0x7fbf78130ce0 2023-10-03T10:16:42.751 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:42.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.753+0000 7fbf7cda3700 1 -- 172.21.15.146:0/1829708470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf78130ce0 msgr2=0x7fbf7811cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.753+0000 7fbf7cda3700 1 --2- 172.21.15.146:0/1829708470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf78130ce0 0x7fbf7811cda0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fbf70016000 tx=0x7fbf70004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.753+0000 7fbf7cda3700 1 -- 172.21.15.146:0/1829708470 shutdown_connections 2023-10-03T10:16:42.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.753+0000 7fbf7cda3700 1 --2- 172.21.15.146:0/1829708470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf78130ce0 0x7fbf7811cda0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.753+0000 7fbf7cda3700 1 --2- 172.21.15.146:0/1829708470 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf7809d860 0x7fbf7811c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.753+0000 7fbf7cda3700 1 --2- 172.21.15.146:0/1829708470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf7809e170 0x7fbf7811c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.753+0000 7fbf7cda3700 1 -- 172.21.15.146:0/1829708470 >> 172.21.15.146:0/1829708470 conn(0x7fbf78099c40 msgr2=0x7fbf7812e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.753+0000 7fbf7cda3700 1 -- 172.21.15.146:0/1829708470 shutdown_connections 2023-10-03T10:16:42.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.753+0000 7fbf7cda3700 1 -- 172.21.15.146:0/1829708470 wait complete. 2023-10-03T10:16:42.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:42.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.801+0000 7f7671a5d700 1 Processor -- start 2023-10-03T10:16:42.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.801+0000 7f7671a5d700 1 -- start start 2023-10-03T10:16:42.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.801+0000 7f7671a5d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f766c09ad40 0x7f766c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.801+0000 7f7671a5d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c133f70 0x7f766c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.801+0000 7f7671a5d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f766c09b110 con 0x7f766c0a0a70 2023-10-03T10:16:42.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.801+0000 7f7671a5d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766c0a3b60 con 0x7f766c09ad40 2023-10-03T10:16:42.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.801+0000 7f7671a5d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f766c1348e0 con 0x7f766c133f70 2023-10-03T10:16:42.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.802+0000 7f766b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f766c0a0a70 0x7f766c0a0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43206/0 (socket says 172.21.15.146:43206) 2023-10-03T10:16:42.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.802+0000 7f766b7fe700 1 -- 172.21.15.146:0/1298644981 learned_addr learned my addr 172.21.15.146:0/1298644981 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:42.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.802+0000 7f766a7fc700 1 --2- 172.21.15.146:0/1298644981 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c133f70 0x7f766c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.802+0000 7f766affd700 1 --2- 172.21.15.146:0/1298644981 >> v2:172.21.15.146:3300/0 conn(0x7f766c09ad40 0x7f766c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.802+0000 7f7669ffb700 1 -- 172.21.15.146:0/1298644981 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261878216 0 0) 0x7f766c09b110 con 0x7f766c0a0a70 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.802+0000 7f766a7fc700 1 -- 172.21.15.146:0/1298644981 >> v2:172.21.15.146:3300/0 conn(0x7f766c09ad40 msgr2=0x7f766c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.802+0000 7f766a7fc700 1 --2- 172.21.15.146:0/1298644981 >> v2:172.21.15.146:3300/0 conn(0x7f766c09ad40 0x7f766c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.802+0000 7f766a7fc700 1 -- 172.21.15.146:0/1298644981 >> v1:172.21.15.146:6789/0 conn(0x7f766c0a0a70 legacy=0x7f766c0a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.802+0000 7f766a7fc700 1 -- 172.21.15.146:0/1298644981 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c0a2fa0 con 0x7f766c133f70 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.802+0000 7f766affd700 1 --2- 172.21.15.146:0/1298644981 >> v2:172.21.15.146:3300/0 conn(0x7f766c09ad40 0x7f766c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.802+0000 7f766a7fc700 1 --2- 172.21.15.146:0/1298644981 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c133f70 0x7f766c1343a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7660009840 tx=0x7f7660009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2114174857b9380a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.802+0000 7f7669ffb700 1 -- 172.21.15.146:0/1298644981 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660011830 con 0x7f766c133f70 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.802+0000 7f7669ffb700 1 -- 172.21.15.146:0/1298644981 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7660011990 con 0x7f766c133f70 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.802+0000 7f7669ffb700 1 -- 172.21.15.146:0/1298644981 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660011d20 con 0x7f766c133f70 2023-10-03T10:16:42.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.803+0000 7f7671a5d700 1 -- 172.21.15.146:0/1298644981 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c133f70 msgr2=0x7f766c1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.803+0000 7f7671a5d700 1 --2- 172.21.15.146:0/1298644981 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c133f70 0x7f766c1343a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7660009840 tx=0x7f7660009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:42.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.803+0000 7f7671a5d700 1 -- 172.21.15.146:0/1298644981 shutdown_connections 2023-10-03T10:16:42.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.803+0000 7f7671a5d700 1 --2- 172.21.15.146:0/1298644981 >> v2:172.21.15.146:3300/0 conn(0x7f766c09ad40 0x7f766c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.803+0000 7f7671a5d700 1 --2- 172.21.15.146:0/1298644981 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c133f70 0x7f766c1343a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.803+0000 7f7671a5d700 1 -- 172.21.15.146:0/1298644981 >> 172.21.15.146:0/1298644981 conn(0x7f766c099c40 msgr2=0x7f766c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.803+0000 7f7671a5d700 1 -- 172.21.15.146:0/1298644981 shutdown_connections 2023-10-03T10:16:42.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.803+0000 7f7671a5d700 1 -- 172.21.15.146:0/1298644981 wait complete. 2023-10-03T10:16:42.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.804+0000 7f7671a5d700 1 Processor -- start 2023-10-03T10:16:42.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.804+0000 7f7671a5d700 1 -- start start 2023-10-03T10:16:42.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.805+0000 7f7671a5d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f766c09ad40 0x7f766c1212f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.805+0000 7f7671a5d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c0a0a70 0x7f766c121830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.805+0000 7f7671a5d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f766c133f70 0x7f766c121d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.805+0000 7f7671a5d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c122eb0 con 0x7f766c09ad40 2023-10-03T10:16:42.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.805+0000 7f7671a5d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766c123d40 con 0x7f766c133f70 2023-10-03T10:16:42.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.805+0000 7f7671a5d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f766c124820 con 0x7f766c0a0a70 2023-10-03T10:16:42.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.805+0000 7f766affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f766c09ad40 0x7f766c1212f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.805+0000 7f766a7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c0a0a70 0x7f766c121830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.805+0000 7f766affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f766c09ad40 0x7f766c1212f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33496/0 (socket says 172.21.15.146:33496) 2023-10-03T10:16:42.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.805+0000 7f766a7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c0a0a70 0x7f766c121830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40976/0 (socket says 172.21.15.146:40976) 2023-10-03T10:16:42.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.805+0000 7f766affd700 1 -- 172.21.15.146:0/3762038898 learned_addr learned my addr 172.21.15.146:0/3762038898 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:42.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.805+0000 7f766b7fe700 1 --2- 172.21.15.146:0/3762038898 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f766c133f70 0x7f766c121d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.805+0000 7f766affd700 1 -- 172.21.15.146:0/3762038898 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c0a0a70 msgr2=0x7f766c121830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.805+0000 7f766affd700 1 --2- 172.21.15.146:0/3762038898 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c0a0a70 0x7f766c121830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.805+0000 7f766affd700 1 -- 172.21.15.146:0/3762038898 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f766c133f70 msgr2=0x7f766c121d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.805+0000 7f766affd700 1 --2- 172.21.15.146:0/3762038898 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f766c133f70 0x7f766c121d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.805+0000 7f766affd700 1 -- 172.21.15.146:0/3762038898 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76600094a0 con 0x7f766c09ad40 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.805+0000 7f766b7fe700 1 --2- 172.21.15.146:0/3762038898 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f766c133f70 0x7f766c121d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.805+0000 7f766affd700 1 --2- 172.21.15.146:0/3762038898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f766c09ad40 0x7f766c1212f0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f765c00e840 tx=0x7f765c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.806+0000 7f7653fff700 1 -- 172.21.15.146:0/3762038898 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c00c020 con 0x7f766c09ad40 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.806+0000 7f7653fff700 1 -- 172.21.15.146:0/3762038898 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765c004230 con 0x7f766c09ad40 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.806+0000 7f7653fff700 1 -- 172.21.15.146:0/3762038898 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c0036a0 con 0x7f766c09ad40 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.807+0000 7f7671a5d700 1 -- 172.21.15.146:0/3762038898 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766c124ae0 con 0x7f766c09ad40 2023-10-03T10:16:42.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.807+0000 7f7671a5d700 1 -- 172.21.15.146:0/3762038898 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766c09c7e0 con 0x7f766c09ad40 2023-10-03T10:16:42.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.807+0000 7f7653fff700 1 -- 172.21.15.146:0/3762038898 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f765c003800 con 0x7f766c09ad40 2023-10-03T10:16:42.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.808+0000 7f7653fff700 1 -- 172.21.15.146:0/3762038898 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f765c03f3b0 con 0x7f766c09ad40 2023-10-03T10:16:42.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.808+0000 7f7671a5d700 1 -- 172.21.15.146:0/3762038898 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766c11e060 con 0x7f766c09ad40 2023-10-03T10:16:42.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.813+0000 7f7653fff700 1 -- 172.21.15.146:0/3762038898 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f765c013410 con 0x7f766c09ad40 2023-10-03T10:16:42.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.844+0000 7fc7c5d77700 1 Processor -- start 2023-10-03T10:16:42.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.845+0000 7fc7c5d77700 1 -- start start 2023-10-03T10:16:42.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.845+0000 7fc7c5d77700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c009ad40 0x7fc7c0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.845+0000 7fc7c5d77700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc7c0133f70 0x7fc7c01343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.845+0000 7fc7c5d77700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc7c00a0a70 0x7fc7c00a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.845+0000 7fc7c5d77700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c00a3b60 con 0x7fc7c0133f70 2023-10-03T10:16:42.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.845+0000 7fc7c5d77700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c01348e0 con 0x7fc7c009ad40 2023-10-03T10:16:42.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.845+0000 7fc7c5d77700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c009b110 con 0x7fc7c00a0a70 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.845+0000 7fc7bf7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c009ad40 0x7fc7c0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.845+0000 7fc7bf7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c009ad40 0x7fc7c0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58774/0 (socket says 172.21.15.146:58774) 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.845+0000 7fc7bf7fe700 1 -- 172.21.15.146:0/2192533842 learned_addr learned my addr 172.21.15.146:0/2192533842 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.845+0000 7fc7beffd700 1 --2- 172.21.15.146:0/2192533842 >> v2:172.21.15.146:3300/0 conn(0x7fc7c0133f70 0x7fc7c01343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.845+0000 7fc7bffff700 1 --2- 172.21.15.146:0/2192533842 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc7c00a0a70 0x7fc7c00a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.845+0000 7fc7bf7fe700 1 -- 172.21.15.146:0/2192533842 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc7c00a0a70 msgr2=0x7fc7c00a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.845+0000 7fc7bf7fe700 1 --2- 172.21.15.146:0/2192533842 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc7c00a0a70 0x7fc7c00a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.845+0000 7fc7bf7fe700 1 -- 172.21.15.146:0/2192533842 >> v2:172.21.15.146:3300/0 conn(0x7fc7c0133f70 msgr2=0x7fc7c01343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.845+0000 7fc7bf7fe700 1 --2- 172.21.15.146:0/2192533842 >> v2:172.21.15.146:3300/0 conn(0x7fc7c0133f70 0x7fc7c01343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.845+0000 7fc7bf7fe700 1 -- 172.21.15.146:0/2192533842 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c00a2fa0 con 0x7fc7c009ad40 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.845+0000 7fc7beffd700 1 --2- 172.21.15.146:0/2192533842 >> v2:172.21.15.146:3300/0 conn(0x7fc7c0133f70 0x7fc7c01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.846+0000 7fc7bf7fe700 1 --2- 172.21.15.146:0/2192533842 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c009ad40 0x7fc7c0133a30 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009e50 tx=0x7fc7b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a7d1a7facbb9303 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.846+0000 7fc7be7fc700 1 -- 172.21.15.146:0/2192533842 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b800e070 con 0x7fc7c009ad40 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.846+0000 7fc7be7fc700 1 -- 172.21.15.146:0/2192533842 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b800b910 con 0x7fc7c009ad40 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.846+0000 7fc7be7fc700 1 -- 172.21.15.146:0/2192533842 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b800bcc0 con 0x7fc7c009ad40 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.846+0000 7fc7c5d77700 1 -- 172.21.15.146:0/2192533842 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c009ad40 msgr2=0x7fc7c0133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.846+0000 7fc7c5d77700 1 --2- 172.21.15.146:0/2192533842 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c009ad40 0x7fc7c0133a30 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009e50 tx=0x7fc7b800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.846+0000 7fc7c5d77700 1 -- 172.21.15.146:0/2192533842 shutdown_connections 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.846+0000 7fc7c5d77700 1 --2- 172.21.15.146:0/2192533842 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c009ad40 0x7fc7c0133a30 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.846+0000 7fc7c5d77700 1 --2- 172.21.15.146:0/2192533842 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc7c00a0a70 0x7fc7c00a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.846+0000 7fc7c5d77700 1 --2- 172.21.15.146:0/2192533842 >> v2:172.21.15.146:3300/0 conn(0x7fc7c0133f70 0x7fc7c01343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.846+0000 7fc7c5d77700 1 -- 172.21.15.146:0/2192533842 >> 172.21.15.146:0/2192533842 conn(0x7fc7c0099c40 msgr2=0x7fc7c006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.846+0000 7fc7c5d77700 1 -- 172.21.15.146:0/2192533842 shutdown_connections 2023-10-03T10:16:42.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.847+0000 7fc7c5d77700 1 -- 172.21.15.146:0/2192533842 wait complete. 2023-10-03T10:16:42.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.847+0000 7fc7c5d77700 1 Processor -- start 2023-10-03T10:16:42.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.848+0000 7fc7c5d77700 1 -- start start 2023-10-03T10:16:42.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.848+0000 7fc7c5d77700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c009ad40 0x7fc7c0121290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.848+0000 7fc7c5d77700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc7c00a0a70 0x7fc7c01217d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.848+0000 7fc7c5d77700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7c0133f70 0x7fc7c0121d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.848+0000 7fc7c5d77700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c0124d60 con 0x7fc7c0133f70 2023-10-03T10:16:42.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.848+0000 7fc7c5d77700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c0123d00 con 0x7fc7c009ad40 2023-10-03T10:16:42.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.848+0000 7fc7c5d77700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c01226f0 con 0x7fc7c00a0a70 2023-10-03T10:16:42.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.848+0000 7fc7beffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc7c00a0a70 0x7fc7c01217d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.848+0000 7fc7beffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc7c00a0a70 0x7fc7c01217d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40994/0 (socket says 172.21.15.146:40994) 2023-10-03T10:16:42.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.848+0000 7fc7bf7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c009ad40 0x7fc7c0121290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.848+0000 7fc7beffd700 1 -- 172.21.15.146:0/1281432340 learned_addr learned my addr 172.21.15.146:0/1281432340 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:42.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.848+0000 7fc7bffff700 1 --2- 172.21.15.146:0/1281432340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7c0133f70 0x7fc7c0121d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.848+0000 7fc7bf7fe700 1 -- 172.21.15.146:0/1281432340 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc7c00a0a70 msgr2=0x7fc7c01217d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.848+0000 7fc7bf7fe700 1 --2- 172.21.15.146:0/1281432340 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc7c00a0a70 0x7fc7c01217d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.848+0000 7fc7bf7fe700 1 -- 172.21.15.146:0/1281432340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7c0133f70 msgr2=0x7fc7c0121d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.848+0000 7fc7bf7fe700 1 --2- 172.21.15.146:0/1281432340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7c0133f70 0x7fc7c0121d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.848+0000 7fc7bf7fe700 1 -- 172.21.15.146:0/1281432340 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a80094a0 con 0x7fc7c009ad40 2023-10-03T10:16:42.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.848+0000 7fc7bffff700 1 --2- 172.21.15.146:0/1281432340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7c0133f70 0x7fc7c0121d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.848+0000 7fc7beffd700 1 --2- 172.21.15.146:0/1281432340 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc7c00a0a70 0x7fc7c01217d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.849+0000 7fc7bf7fe700 1 --2- 172.21.15.146:0/1281432340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c009ad40 0x7fc7c0121290 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8015000 tx=0x7fc7b8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.849+0000 7fc7b7fff700 1 -- 172.21.15.146:0/1281432340 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b80092e0 con 0x7fc7c009ad40 2023-10-03T10:16:42.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.849+0000 7fc7b7fff700 1 -- 172.21.15.146:0/1281432340 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b800ce60 con 0x7fc7c009ad40 2023-10-03T10:16:42.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.849+0000 7fc7c5d77700 1 -- 172.21.15.146:0/1281432340 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b8009b30 con 0x7fc7c009ad40 2023-10-03T10:16:42.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.849+0000 7fc7b7fff700 1 -- 172.21.15.146:0/1281432340 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8004470 con 0x7fc7c009ad40 2023-10-03T10:16:42.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.849+0000 7fc7c5d77700 1 -- 172.21.15.146:0/1281432340 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c01247c0 con 0x7fc7c009ad40 2023-10-03T10:16:42.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.850+0000 7fc7c5d77700 1 -- 172.21.15.146:0/1281432340 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c011e060 con 0x7fc7c009ad40 2023-10-03T10:16:42.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.850+0000 7fc7b7fff700 1 -- 172.21.15.146:0/1281432340 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc7b80045d0 con 0x7fc7c009ad40 2023-10-03T10:16:42.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.850+0000 7fc7b7fff700 1 -- 172.21.15.146:0/1281432340 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc7b8040990 con 0x7fc7c009ad40 2023-10-03T10:16:42.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.854+0000 7fc7b7fff700 1 -- 172.21.15.146:0/1281432340 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc7b8004880 con 0x7fc7c009ad40 2023-10-03T10:16:42.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.859+0000 7f0f4e7f5700 1 Processor -- start 2023-10-03T10:16:42.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.859+0000 7f0f4e7f5700 1 -- start start 2023-10-03T10:16:42.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.860+0000 7f0f4e7f5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f4809e950 0x7f0f4809ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.860+0000 7f0f4e7f5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0f481393c0 0x7f0f4813b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.860+0000 7f0f4e7f5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f4809ac20 con 0x7f0f4809f260 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.860+0000 7f0f4e7f5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f480a06c0 con 0x7f0f481393c0 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.860+0000 7f0f4e7f5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4809ae90 con 0x7f0f4809e950 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.860+0000 7f0f4cd92700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0f481393c0 0x7f0f4813b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.860+0000 7f0f477fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0f4809f260 0x7f0f48137ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43212/0 (socket says 172.21.15.146:43212) 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.860+0000 7f0f477fe700 1 -- 172.21.15.146:0/2996928514 learned_addr learned my addr 172.21.15.146:0/2996928514 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.860+0000 7f0f47fff700 1 --2- 172.21.15.146:0/2996928514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f4809e950 0x7f0f4809ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.860+0000 7f0f46ffd700 1 -- 172.21.15.146:0/2996928514 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366518892 0 0) 0x7f0f4809ac20 con 0x7f0f4809f260 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.860+0000 7f0f46ffd700 1 -- 172.21.15.146:0/2996928514 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f300035b0 con 0x7f0f4809f260 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.860+0000 7f0f47fff700 1 -- 172.21.15.146:0/2996928514 >> v2:172.21.15.146:3300/0 conn(0x7f0f481393c0 msgr2=0x7f0f4813b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.860+0000 7f0f47fff700 1 --2- 172.21.15.146:0/2996928514 >> v2:172.21.15.146:3300/0 conn(0x7f0f481393c0 0x7f0f4813b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.860+0000 7f0f47fff700 1 -- 172.21.15.146:0/2996928514 >> v1:172.21.15.146:6789/0 conn(0x7f0f4809f260 legacy=0x7f0f48137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.860+0000 7f0f47fff700 1 -- 172.21.15.146:0/2996928514 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4806ba00 con 0x7f0f4809e950 2023-10-03T10:16:42.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.860+0000 7f0f4cd92700 1 --2- 172.21.15.146:0/2996928514 >> v2:172.21.15.146:3300/0 conn(0x7f0f481393c0 0x7f0f4813b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.861+0000 7f0f47fff700 1 --2- 172.21.15.146:0/2996928514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f4809e950 0x7f0f4809ed20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009820 tx=0x7f0f38009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a90e9c955860da6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.861+0000 7f0f46ffd700 1 -- 172.21.15.146:0/2996928514 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f38005e30 con 0x7f0f4809e950 2023-10-03T10:16:42.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.861+0000 7f0f46ffd700 1 -- 172.21.15.146:0/2996928514 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f38006030 con 0x7f0f4809e950 2023-10-03T10:16:42.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.861+0000 7f0f46ffd700 1 -- 172.21.15.146:0/2996928514 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f380063a0 con 0x7f0f4809e950 2023-10-03T10:16:42.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.861+0000 7f0f4e7f5700 1 -- 172.21.15.146:0/2996928514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f4809e950 msgr2=0x7f0f4809ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.861+0000 7f0f4e7f5700 1 --2- 172.21.15.146:0/2996928514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f4809e950 0x7f0f4809ed20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009820 tx=0x7f0f38009b30 comp rx=0 tx=0).stop 2023-10-03T10:16:42.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.861+0000 7f0f4e7f5700 1 -- 172.21.15.146:0/2996928514 shutdown_connections 2023-10-03T10:16:42.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.861+0000 7f0f4e7f5700 1 --2- 172.21.15.146:0/2996928514 >> v2:172.21.15.146:3300/0 conn(0x7f0f481393c0 0x7f0f4813b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.861+0000 7f0f4e7f5700 1 --2- 172.21.15.146:0/2996928514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f4809e950 0x7f0f4809ed20 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.861+0000 7f0f4e7f5700 1 -- 172.21.15.146:0/2996928514 >> 172.21.15.146:0/2996928514 conn(0x7f0f480a0f70 msgr2=0x7f0f480a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.861+0000 7f0f4e7f5700 1 -- 172.21.15.146:0/2996928514 shutdown_connections 2023-10-03T10:16:42.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.861+0000 7f0f4e7f5700 1 -- 172.21.15.146:0/2996928514 wait complete. 2023-10-03T10:16:42.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.862+0000 7f0f4e7f5700 1 Processor -- start 2023-10-03T10:16:42.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.863+0000 7f0f4e7f5700 1 -- start start 2023-10-03T10:16:42.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.863+0000 7f0f4e7f5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f4809e950 0x7f0f48121830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.863+0000 7f0f4e7f5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f4809f260 0x7f0f48121d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.863+0000 7f0f4e7f5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f481393c0 0x7f0f481222b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.863+0000 7f0f4e7f5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f48125350 con 0x7f0f481393c0 2023-10-03T10:16:42.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.863+0000 7f0f4e7f5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4809e220 con 0x7f0f4809f260 2023-10-03T10:16:42.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.863+0000 7f0f4e7f5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f480a0820 con 0x7f0f4809e950 2023-10-03T10:16:42.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.863+0000 7f0f47fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f4809e950 0x7f0f48121830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.863+0000 7f0f4cd92700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f481393c0 0x7f0f481222b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.863+0000 7f0f47fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f4809e950 0x7f0f48121830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:41008/0 (socket says 172.21.15.146:41008) 2023-10-03T10:16:42.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.863+0000 7f0f4cd92700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f481393c0 0x7f0f481222b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33546/0 (socket says 172.21.15.146:33546) 2023-10-03T10:16:42.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.863+0000 7f0f47fff700 1 -- 172.21.15.146:0/2945509129 learned_addr learned my addr 172.21.15.146:0/2945509129 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:42.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.863+0000 7f0f477fe700 1 --2- 172.21.15.146:0/2945509129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f4809f260 0x7f0f48121d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.864+0000 7f0f47fff700 1 -- 172.21.15.146:0/2945509129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f4809f260 msgr2=0x7f0f48121d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.864+0000 7f0f47fff700 1 --2- 172.21.15.146:0/2945509129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f4809f260 0x7f0f48121d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.864+0000 7f0f47fff700 1 -- 172.21.15.146:0/2945509129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f481393c0 msgr2=0x7f0f481222b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.864+0000 7f0f47fff700 1 --2- 172.21.15.146:0/2945509129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f481393c0 0x7f0f481222b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.864+0000 7f0f47fff700 1 -- 172.21.15.146:0/2945509129 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f40009a70 con 0x7f0f4809e950 2023-10-03T10:16:42.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.864+0000 7f0f477fe700 1 --2- 172.21.15.146:0/2945509129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f4809f260 0x7f0f48121d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.864+0000 7f0f4cd92700 1 --2- 172.21.15.146:0/2945509129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f481393c0 0x7f0f481222b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.864+0000 7f0f47fff700 1 --2- 172.21.15.146:0/2945509129 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f4809e950 0x7f0f48121830 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0f38000c00 tx=0x7f0f38004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.864+0000 7f0f44ff9700 1 -- 172.21.15.146:0/2945509129 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f380065b0 con 0x7f0f4809e950 2023-10-03T10:16:42.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.864+0000 7f0f44ff9700 1 -- 172.21.15.146:0/2945509129 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f38006710 con 0x7f0f4809e950 2023-10-03T10:16:42.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.864+0000 7f0f44ff9700 1 -- 172.21.15.146:0/2945509129 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f38004560 con 0x7f0f4809e950 2023-10-03T10:16:42.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.864+0000 7f0f4e7f5700 1 -- 172.21.15.146:0/2945509129 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f38009430 con 0x7f0f4809e950 2023-10-03T10:16:42.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.864+0000 7f0f4e7f5700 1 -- 172.21.15.146:0/2945509129 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f48124ae0 con 0x7f0f4809e950 2023-10-03T10:16:42.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.865+0000 7f0f44ff9700 1 -- 172.21.15.146:0/2945509129 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f38022070 con 0x7f0f4809e950 2023-10-03T10:16:42.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.865+0000 7f0f44ff9700 1 -- 172.21.15.146:0/2945509129 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0f38040d20 con 0x7f0f4809e950 2023-10-03T10:16:42.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.865+0000 7f0f4e7f5700 1 -- 172.21.15.146:0/2945509129 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f48125ba0 con 0x7f0f4809e950 2023-10-03T10:16:42.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:42.870+0000 7f0f44ff9700 1 -- 172.21.15.146:0/2945509129 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f3802a070 con 0x7f0f4809e950 2023-10-03T10:16:43.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.026+0000 7f7671a5d700 1 -- 172.21.15.146:0/3762038898 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f766c04f2a0 con 0x7f766c09ad40 2023-10-03T10:16:43.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.027+0000 7f7653fff700 1 -- 172.21.15.146:0/3762038898 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f765c02a090 con 0x7f766c09ad40 2023-10-03T10:16:43.028 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:43.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.029+0000 7f7671a5d700 1 -- 172.21.15.146:0/3762038898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f766c09ad40 msgr2=0x7f766c1212f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.029+0000 7f7671a5d700 1 --2- 172.21.15.146:0/3762038898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f766c09ad40 0x7f766c1212f0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f765c00e840 tx=0x7f765c00eb50 comp rx=0 tx=0).stop 2023-10-03T10:16:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.029+0000 7f7671a5d700 1 -- 172.21.15.146:0/3762038898 shutdown_connections 2023-10-03T10:16:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.029+0000 7f7671a5d700 1 --2- 172.21.15.146:0/3762038898 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f766c133f70 0x7f766c121d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.029+0000 7f7671a5d700 1 --2- 172.21.15.146:0/3762038898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f766c09ad40 0x7f766c1212f0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.029+0000 7f7671a5d700 1 --2- 172.21.15.146:0/3762038898 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f766c0a0a70 0x7f766c121830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.029+0000 7f7671a5d700 1 -- 172.21.15.146:0/3762038898 >> 172.21.15.146:0/3762038898 conn(0x7f766c099c40 msgr2=0x7f766c1332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.029+0000 7f7671a5d700 1 -- 172.21.15.146:0/3762038898 shutdown_connections 2023-10-03T10:16:43.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.029+0000 7f7671a5d700 1 -- 172.21.15.146:0/3762038898 wait complete. 2023-10-03T10:16:43.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:43.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.052+0000 7fc7c5d77700 1 -- 172.21.15.146:0/1281432340 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc7c009c7e0 con 0x7fc7c009ad40 2023-10-03T10:16:43.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.053+0000 7fc7b7fff700 1 -- 172.21.15.146:0/1281432340 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc7b801f070 con 0x7fc7c009ad40 2023-10-03T10:16:43.054 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:43.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.055+0000 7fc7c5d77700 1 -- 172.21.15.146:0/1281432340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c009ad40 msgr2=0x7fc7c0121290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.055+0000 7fc7c5d77700 1 --2- 172.21.15.146:0/1281432340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c009ad40 0x7fc7c0121290 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8015000 tx=0x7fc7b8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.055+0000 7fc7c5d77700 1 -- 172.21.15.146:0/1281432340 shutdown_connections 2023-10-03T10:16:43.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.055+0000 7fc7c5d77700 1 --2- 172.21.15.146:0/1281432340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7c0133f70 0x7fc7c0121d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.055+0000 7fc7c5d77700 1 --2- 172.21.15.146:0/1281432340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc7c009ad40 0x7fc7c0121290 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.055+0000 7fc7c5d77700 1 --2- 172.21.15.146:0/1281432340 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc7c00a0a70 0x7fc7c01217d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.055+0000 7fc7c5d77700 1 -- 172.21.15.146:0/1281432340 >> 172.21.15.146:0/1281432340 conn(0x7fc7c0099c40 msgr2=0x7fc7c0133310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.055+0000 7fc7c5d77700 1 -- 172.21.15.146:0/1281432340 shutdown_connections 2023-10-03T10:16:43.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.055+0000 7fc7c5d77700 1 -- 172.21.15.146:0/1281432340 wait complete. 2023-10-03T10:16:43.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.065+0000 7f0f4e7f5700 1 -- 172.21.15.146:0/2945509129 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0f4804f2a0 con 0x7f0f4809e950 2023-10-03T10:16:43.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.066+0000 7f0f44ff9700 1 -- 172.21.15.146:0/2945509129 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f38025470 con 0x7f0f4809e950 2023-10-03T10:16:43.067 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:43.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:43.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.068+0000 7f0f4e7f5700 1 -- 172.21.15.146:0/2945509129 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f4809e950 msgr2=0x7f0f48121830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.068+0000 7f0f4e7f5700 1 --2- 172.21.15.146:0/2945509129 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f4809e950 0x7f0f48121830 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0f38000c00 tx=0x7f0f38004750 comp rx=0 tx=0).stop 2023-10-03T10:16:43.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.068+0000 7f0f4e7f5700 1 -- 172.21.15.146:0/2945509129 shutdown_connections 2023-10-03T10:16:43.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.068+0000 7f0f4e7f5700 1 --2- 172.21.15.146:0/2945509129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f481393c0 0x7f0f481222b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.068+0000 7f0f4e7f5700 1 --2- 172.21.15.146:0/2945509129 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0f4809e950 0x7f0f48121830 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.068+0000 7f0f4e7f5700 1 --2- 172.21.15.146:0/2945509129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0f4809f260 0x7f0f48121d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.068+0000 7f0f4e7f5700 1 -- 172.21.15.146:0/2945509129 >> 172.21.15.146:0/2945509129 conn(0x7f0f480a0f70 msgr2=0x7f0f4809c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.068+0000 7f0f4e7f5700 1 -- 172.21.15.146:0/2945509129 shutdown_connections 2023-10-03T10:16:43.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.068+0000 7f0f4e7f5700 1 -- 172.21.15.146:0/2945509129 wait complete. 2023-10-03T10:16:43.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:43.769 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:43.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.894+0000 7f73062e4700 1 Processor -- start 2023-10-03T10:16:43.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.894+0000 7f73062e4700 1 -- start start 2023-10-03T10:16:43.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.895+0000 7f73062e4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f730009ef80 0x7f7300138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.895+0000 7f73062e4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f730009f370 0x7f730013b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.895+0000 7f73062e4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730009af80 con 0x7f730009a150 2023-10-03T10:16:43.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.895+0000 7f73062e4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730009a520 con 0x7f730009f370 2023-10-03T10:16:43.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.895+0000 7f73062e4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f730009fe00 con 0x7f730009ef80 2023-10-03T10:16:43.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.895+0000 7f7304881700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f730009f370 0x7f730013b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.895+0000 7f72ff7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f730009ef80 0x7f7300138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.895+0000 7f72fffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f730009a150 0x7f730009e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43214/0 (socket says 172.21.15.146:43214) 2023-10-03T10:16:43.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.895+0000 7f72fffff700 1 -- 172.21.15.146:0/3709193830 learned_addr learned my addr 172.21.15.146:0/3709193830 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:43.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.895+0000 7f72feffd700 1 -- 172.21.15.146:0/3709193830 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371493058 0 0) 0x7f730009af80 con 0x7f730009a150 2023-10-03T10:16:43.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.895+0000 7f72feffd700 1 -- 172.21.15.146:0/3709193830 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72ec0035b0 con 0x7f730009a150 2023-10-03T10:16:43.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.895+0000 7f72ff7fe700 1 -- 172.21.15.146:0/3709193830 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f730009f370 msgr2=0x7f730013b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:43.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.895+0000 7f72ff7fe700 1 --2- 172.21.15.146:0/3709193830 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f730009f370 0x7f730013b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.895+0000 7f72ff7fe700 1 -- 172.21.15.146:0/3709193830 >> v1:172.21.15.146:6789/0 conn(0x7f730009a150 legacy=0x7f730009e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.895+0000 7f72ff7fe700 1 -- 172.21.15.146:0/3709193830 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730006bc20 con 0x7f730009ef80 2023-10-03T10:16:43.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.895+0000 7f7304881700 1 --2- 172.21.15.146:0/3709193830 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f730009f370 0x7f730013b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:43.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.896+0000 7f72ff7fe700 1 --2- 172.21.15.146:0/3709193830 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f730009ef80 0x7f7300138e60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f72e80098a0 tx=0x7f72e8009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff5bea93599f2135 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.896+0000 7f72feffd700 1 -- 172.21.15.146:0/3709193830 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e8011830 con 0x7f730009ef80 2023-10-03T10:16:43.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.896+0000 7f72feffd700 1 -- 172.21.15.146:0/3709193830 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e8011990 con 0x7f730009ef80 2023-10-03T10:16:43.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.896+0000 7f72feffd700 1 -- 172.21.15.146:0/3709193830 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e8011d20 con 0x7f730009ef80 2023-10-03T10:16:43.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.896+0000 7f73062e4700 1 -- 172.21.15.146:0/3709193830 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f730009ef80 msgr2=0x7f7300138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.896+0000 7f73062e4700 1 --2- 172.21.15.146:0/3709193830 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f730009ef80 0x7f7300138e60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f72e80098a0 tx=0x7f72e8009bb0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.896+0000 7f73062e4700 1 -- 172.21.15.146:0/3709193830 shutdown_connections 2023-10-03T10:16:43.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.896+0000 7f73062e4700 1 --2- 172.21.15.146:0/3709193830 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f730009f370 0x7f730013b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.896+0000 7f73062e4700 1 --2- 172.21.15.146:0/3709193830 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f730009ef80 0x7f7300138e60 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.896+0000 7f73062e4700 1 -- 172.21.15.146:0/3709193830 >> 172.21.15.146:0/3709193830 conn(0x7f73000a4430 msgr2=0x7f73000a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.896+0000 7f73062e4700 1 -- 172.21.15.146:0/3709193830 shutdown_connections 2023-10-03T10:16:43.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.896+0000 7f73062e4700 1 -- 172.21.15.146:0/3709193830 wait complete. 2023-10-03T10:16:43.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.897+0000 7f73062e4700 1 Processor -- start 2023-10-03T10:16:43.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.897+0000 7f73062e4700 1 -- start start 2023-10-03T10:16:43.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.898+0000 7f73062e4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f730009a150 0x7f73001233d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.898+0000 7f73062e4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f730009ef80 0x7f7300123910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.898+0000 7f73062e4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f730009f370 0x7f7300123e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.898+0000 7f73062e4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7300127000 con 0x7f730009f370 2023-10-03T10:16:43.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.898+0000 7f73062e4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730009b970 con 0x7f730009ef80 2023-10-03T10:16:43.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.898+0000 7f73062e4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73000a0440 con 0x7f730009a150 2023-10-03T10:16:43.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.898+0000 7f72ff7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f730009ef80 0x7f7300123910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.898+0000 7f72fffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f730009a150 0x7f73001233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.898+0000 7f72ff7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f730009ef80 0x7f7300123910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58820/0 (socket says 172.21.15.146:58820) 2023-10-03T10:16:43.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.898+0000 7f72ff7fe700 1 -- 172.21.15.146:0/3378475694 learned_addr learned my addr 172.21.15.146:0/3378475694 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:43.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.898+0000 7f7304881700 1 --2- 172.21.15.146:0/3378475694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f730009f370 0x7f7300123e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.898+0000 7f72ff7fe700 1 -- 172.21.15.146:0/3378475694 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f730009a150 msgr2=0x7f73001233d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.898+0000 7f72ff7fe700 1 --2- 172.21.15.146:0/3378475694 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f730009a150 0x7f73001233d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.898+0000 7f72ff7fe700 1 -- 172.21.15.146:0/3378475694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f730009f370 msgr2=0x7f7300123e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.898+0000 7f72ff7fe700 1 --2- 172.21.15.146:0/3378475694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f730009f370 0x7f7300123e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.898+0000 7f72ff7fe700 1 -- 172.21.15.146:0/3378475694 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f8009a70 con 0x7f730009ef80 2023-10-03T10:16:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.898+0000 7f72fffff700 1 --2- 172.21.15.146:0/3378475694 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f730009a150 0x7f73001233d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.898+0000 7f7304881700 1 --2- 172.21.15.146:0/3378475694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f730009f370 0x7f7300123e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.898+0000 7f72ff7fe700 1 --2- 172.21.15.146:0/3378475694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f730009ef80 0x7f7300123910 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f72e80090b0 tx=0x7f72e8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.898+0000 7f72fcff9700 1 -- 172.21.15.146:0/3378475694 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e8004240 con 0x7f730009ef80 2023-10-03T10:16:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.899+0000 7f72fcff9700 1 -- 172.21.15.146:0/3378475694 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e801f070 con 0x7f730009ef80 2023-10-03T10:16:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.899+0000 7f73062e4700 1 -- 172.21.15.146:0/3378475694 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e80094a0 con 0x7f730009ef80 2023-10-03T10:16:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.899+0000 7f72fcff9700 1 -- 172.21.15.146:0/3378475694 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e80045e0 con 0x7f730009ef80 2023-10-03T10:16:43.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.899+0000 7f73062e4700 1 -- 172.21.15.146:0/3378475694 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7300126c10 con 0x7f730009ef80 2023-10-03T10:16:43.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.899+0000 7f72fcff9700 1 -- 172.21.15.146:0/3378475694 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f72e8021030 con 0x7f730009ef80 2023-10-03T10:16:43.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.899+0000 7f72fcff9700 1 -- 172.21.15.146:0/3378475694 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f72e8040610 con 0x7f730009ef80 2023-10-03T10:16:43.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.899+0000 7f73062e4700 1 -- 172.21.15.146:0/3378475694 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730009fa30 con 0x7f730009ef80 2023-10-03T10:16:43.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:43.904+0000 7f72fcff9700 1 -- 172.21.15.146:0/3378475694 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72e8015080 con 0x7f730009ef80 2023-10-03T10:16:44.042 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:44.069 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:44.082 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:44.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.090+0000 7f73062e4700 1 -- 172.21.15.146:0/3378475694 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7300120270 con 0x7f730009ef80 2023-10-03T10:16:44.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.090+0000 7f72fcff9700 1 -- 172.21.15.146:0/3378475694 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f72e801a450 con 0x7f730009ef80 2023-10-03T10:16:44.091 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:44.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.093+0000 7f73062e4700 1 -- 172.21.15.146:0/3378475694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f730009ef80 msgr2=0x7f7300123910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.093+0000 7f73062e4700 1 --2- 172.21.15.146:0/3378475694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f730009ef80 0x7f7300123910 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f72e80090b0 tx=0x7f72e8004750 comp rx=0 tx=0).stop 2023-10-03T10:16:44.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.093+0000 7f73062e4700 1 -- 172.21.15.146:0/3378475694 shutdown_connections 2023-10-03T10:16:44.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.093+0000 7f73062e4700 1 --2- 172.21.15.146:0/3378475694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f730009f370 0x7f7300123e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.093+0000 7f73062e4700 1 --2- 172.21.15.146:0/3378475694 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f730009a150 0x7f73001233d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.093+0000 7f73062e4700 1 --2- 172.21.15.146:0/3378475694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f730009ef80 0x7f7300123910 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.093+0000 7f73062e4700 1 -- 172.21.15.146:0/3378475694 >> 172.21.15.146:0/3378475694 conn(0x7f73000a4430 msgr2=0x7f73000722f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.093+0000 7f73062e4700 1 -- 172.21.15.146:0/3378475694 shutdown_connections 2023-10-03T10:16:44.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.093+0000 7f73062e4700 1 -- 172.21.15.146:0/3378475694 wait complete. 2023-10-03T10:16:44.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:44.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.174+0000 7fc5d1525700 1 Processor -- start 2023-10-03T10:16:44.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.174+0000 7fc5d1525700 1 -- start start 2023-10-03T10:16:44.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.175+0000 7fc5d1525700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5cc066410 0x7fc5cc1319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.175+0000 7fc5d1525700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc5cc1314b0 0x7fc5cc131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.175+0000 7fc5d1525700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5cc0a0f20 con 0x7fc5cc09bc70 2023-10-03T10:16:44.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.175+0000 7fc5d1525700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5cc0667e0 con 0x7fc5cc1314b0 2023-10-03T10:16:44.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.175+0000 7fc5d1525700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc0a23c0 con 0x7fc5cc066410 2023-10-03T10:16:44.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.175+0000 7fc5caffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5cc066410 0x7fc5cc1319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.175+0000 7fc5ca7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc5cc1314b0 0x7fc5cc131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.175+0000 7fc5caffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5cc066410 0x7fc5cc1319f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58830/0 (socket says 172.21.15.146:58830) 2023-10-03T10:16:44.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.175+0000 7fc5caffd700 1 -- 172.21.15.146:0/1548094005 learned_addr learned my addr 172.21.15.146:0/1548094005 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:44.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.175+0000 7fc5ca7fc700 1 -- 172.21.15.146:0/1548094005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5cc066410 msgr2=0x7fc5cc1319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:44.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.175+0000 7fc5ca7fc700 1 --2- 172.21.15.146:0/1548094005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5cc066410 0x7fc5cc1319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.175+0000 7fc5ca7fc700 1 -- 172.21.15.146:0/1548094005 >> v1:172.21.15.146:6789/0 conn(0x7fc5cc09bc70 legacy=0x7fc5cc09c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.175+0000 7fc5ca7fc700 1 -- 172.21.15.146:0/1548094005 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc0a16e0 con 0x7fc5cc1314b0 2023-10-03T10:16:44.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.175+0000 7fc5c9ffb700 1 -- 172.21.15.146:0/1548094005 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 586027684 0 0) 0x7fc5cc0a0f20 con 0x7fc5cc09bc70 2023-10-03T10:16:44.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.175+0000 7fc5caffd700 1 --2- 172.21.15.146:0/1548094005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5cc066410 0x7fc5cc1319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:44.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.176+0000 7fc5ca7fc700 1 --2- 172.21.15.146:0/1548094005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5cc1314b0 0x7fc5cc131f30 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0009870 tx=0x7fc5c0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976a19b88fd73fb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.176+0000 7fc5c9ffb700 1 -- 172.21.15.146:0/1548094005 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0011830 con 0x7fc5cc1314b0 2023-10-03T10:16:44.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.176+0000 7fc5c9ffb700 1 -- 172.21.15.146:0/1548094005 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c0011990 con 0x7fc5cc1314b0 2023-10-03T10:16:44.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.176+0000 7fc5c9ffb700 1 -- 172.21.15.146:0/1548094005 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0011d20 con 0x7fc5cc1314b0 2023-10-03T10:16:44.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.177+0000 7fc5d1525700 1 -- 172.21.15.146:0/1548094005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5cc1314b0 msgr2=0x7fc5cc131f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.177+0000 7fc5d1525700 1 --2- 172.21.15.146:0/1548094005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5cc1314b0 0x7fc5cc131f30 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0009870 tx=0x7fc5c0009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:44.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.177+0000 7fc5d1525700 1 -- 172.21.15.146:0/1548094005 shutdown_connections 2023-10-03T10:16:44.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.177+0000 7fc5d1525700 1 --2- 172.21.15.146:0/1548094005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5cc066410 0x7fc5cc1319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.177+0000 7fc5d1525700 1 --2- 172.21.15.146:0/1548094005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5cc1314b0 0x7fc5cc131f30 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.177+0000 7fc5d1525700 1 -- 172.21.15.146:0/1548094005 >> 172.21.15.146:0/1548094005 conn(0x7fc5cc0a2980 msgr2=0x7fc5cc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.177+0000 7fc5d1525700 1 -- 172.21.15.146:0/1548094005 shutdown_connections 2023-10-03T10:16:44.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.177+0000 7fc5d1525700 1 -- 172.21.15.146:0/1548094005 wait complete. 2023-10-03T10:16:44.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.178+0000 7fc5d1525700 1 Processor -- start 2023-10-03T10:16:44.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.178+0000 7fc5d1525700 1 -- start start 2023-10-03T10:16:44.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.179+0000 7fc5d1525700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5cc066410 0x7fc5cc135100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.179+0000 7fc5d1525700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5cc09bc70 0x7fc5cc135640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.179+0000 7fc5d1525700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5cc1314b0 0x7fc5cc135b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.179+0000 7fc5d1525700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc1365b0 con 0x7fc5cc1314b0 2023-10-03T10:16:44.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.179+0000 7fc5d1525700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc119170 con 0x7fc5cc09bc70 2023-10-03T10:16:44.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.179+0000 7fc5d1525700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc137f40 con 0x7fc5cc066410 2023-10-03T10:16:44.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.179+0000 7fc5ca7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5cc09bc70 0x7fc5cc135640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.179+0000 7fc5ca7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5cc09bc70 0x7fc5cc135640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58836/0 (socket says 172.21.15.146:58836) 2023-10-03T10:16:44.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.179+0000 7fc5ca7fc700 1 -- 172.21.15.146:0/3609101953 learned_addr learned my addr 172.21.15.146:0/3609101953 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:44.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.179+0000 7fc5caffd700 1 --2- 172.21.15.146:0/3609101953 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5cc066410 0x7fc5cc135100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.179+0000 7fc5cb7fe700 1 --2- 172.21.15.146:0/3609101953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5cc1314b0 0x7fc5cc135b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.179+0000 7fc5ca7fc700 1 -- 172.21.15.146:0/3609101953 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5cc066410 msgr2=0x7fc5cc135100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.179+0000 7fc5ca7fc700 1 --2- 172.21.15.146:0/3609101953 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5cc066410 0x7fc5cc135100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.179+0000 7fc5ca7fc700 1 -- 172.21.15.146:0/3609101953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5cc1314b0 msgr2=0x7fc5cc135b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.179+0000 7fc5ca7fc700 1 --2- 172.21.15.146:0/3609101953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5cc1314b0 0x7fc5cc135b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.179+0000 7fc5ca7fc700 1 -- 172.21.15.146:0/3609101953 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5bc009500 con 0x7fc5cc09bc70 2023-10-03T10:16:44.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.180+0000 7fc5ca7fc700 1 --2- 172.21.15.146:0/3609101953 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5cc09bc70 0x7fc5cc135640 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0009bc0 tx=0x7fc5c0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.180+0000 7fc5b37fe700 1 -- 172.21.15.146:0/3609101953 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0004350 con 0x7fc5cc09bc70 2023-10-03T10:16:44.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.180+0000 7fc5b37fe700 1 -- 172.21.15.146:0/3609101953 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c00044b0 con 0x7fc5cc09bc70 2023-10-03T10:16:44.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.180+0000 7fc5b37fe700 1 -- 172.21.15.146:0/3609101953 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c00038c0 con 0x7fc5cc09bc70 2023-10-03T10:16:44.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.180+0000 7fc5d1525700 1 -- 172.21.15.146:0/3609101953 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c00094a0 con 0x7fc5cc09bc70 2023-10-03T10:16:44.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.180+0000 7fc5d1525700 1 -- 172.21.15.146:0/3609101953 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5cc137a80 con 0x7fc5cc09bc70 2023-10-03T10:16:44.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.181+0000 7fc5b37fe700 1 -- 172.21.15.146:0/3609101953 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc5c0003a20 con 0x7fc5cc09bc70 2023-10-03T10:16:44.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.181+0000 7fc5b37fe700 1 -- 172.21.15.146:0/3609101953 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc5c00405e0 con 0x7fc5cc09bc70 2023-10-03T10:16:44.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.181+0000 7fc5d1525700 1 -- 172.21.15.146:0/3609101953 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5cc04f2a0 con 0x7fc5cc09bc70 2023-10-03T10:16:44.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.186+0000 7fc5b37fe700 1 -- 172.21.15.146:0/3609101953 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc5c001a420 con 0x7fc5cc09bc70 2023-10-03T10:16:44.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.217+0000 7f12f06d1700 1 Processor -- start 2023-10-03T10:16:44.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.217+0000 7f3568887700 1 Processor -- start 2023-10-03T10:16:44.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.217+0000 7f12f06d1700 1 -- start start 2023-10-03T10:16:44.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.217+0000 7f3568887700 1 -- start start 2023-10-03T10:16:44.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.217+0000 7f12f06d1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12e80a1550 0x7f12e8138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.217+0000 7f3568887700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f356409e950 0x7f356409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.217+0000 7f12f06d1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12e8139200 0x7f12e813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.217+0000 7f12f06d1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e809e9d0 con 0x7f12e80a0a70 2023-10-03T10:16:44.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.217+0000 7f12f06d1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e809dc00 con 0x7f12e8139200 2023-10-03T10:16:44.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.217+0000 7f12f06d1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12e809dec0 con 0x7f12e80a1550 2023-10-03T10:16:44.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.217+0000 7f3568887700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f356409f260 0x7f3564137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.217+0000 7f3568887700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356406caa0 con 0x7f3564138180 2023-10-03T10:16:44.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.217+0000 7f3568887700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35640a00b0 con 0x7f356409e950 2023-10-03T10:16:44.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.217+0000 7f3568887700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f356409af60 con 0x7f356409f260 2023-10-03T10:16:44.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.218+0000 7f12edc6c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12e80a1550 0x7f12e8138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.218+0000 7f3561d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f356409f260 0x7f3564137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.218+0000 7f3561d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f356409f260 0x7f3564137c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:41052/0 (socket says 172.21.15.146:41052) 2023-10-03T10:16:44.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.218+0000 7f3561d9b700 1 -- 172.21.15.146:0/1914071716 learned_addr learned my addr 172.21.15.146:0/1914071716 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:44.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.218+0000 7f12edc6c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12e80a1550 0x7f12e8138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:41064/0 (socket says 172.21.15.146:41064) 2023-10-03T10:16:44.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.218+0000 7f12edc6c700 1 -- 172.21.15.146:0/2579687101 learned_addr learned my addr 172.21.15.146:0/2579687101 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:44.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.218+0000 7f356259c700 1 --2- 172.21.15.146:0/1914071716 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f356409e950 0x7f356409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.218+0000 7f12eec6e700 1 --2- 172.21.15.146:0/2579687101 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12e8139200 0x7f12e813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.218+0000 7f3561d9b700 1 -- 172.21.15.146:0/1914071716 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f356409e950 msgr2=0x7f356409ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:44.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.218+0000 7f3561d9b700 1 --2- 172.21.15.146:0/1914071716 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f356409e950 0x7f356409ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.218+0000 7f3561d9b700 1 -- 172.21.15.146:0/1914071716 >> v1:172.21.15.146:6789/0 conn(0x7f3564138180 legacy=0x7f356413a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:44.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.218+0000 7f3561d9b700 1 -- 172.21.15.146:0/1914071716 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35640a0950 con 0x7f356409f260 2023-10-03T10:16:44.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.218+0000 7f12edc6c700 1 -- 172.21.15.146:0/2579687101 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12e8139200 msgr2=0x7f12e813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:44.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.218+0000 7f12edc6c700 1 --2- 172.21.15.146:0/2579687101 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12e8139200 0x7f12e813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.218+0000 7f12edc6c700 1 -- 172.21.15.146:0/2579687101 >> v1:172.21.15.146:6789/0 conn(0x7f12e80a0a70 legacy=0x7f12e80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:44.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.218+0000 7f12edc6c700 1 -- 172.21.15.146:0/2579687101 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e809e6a0 con 0x7f12e80a1550 2023-10-03T10:16:44.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.218+0000 7f3561d9b700 1 --2- 172.21.15.146:0/1914071716 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f356409f260 0x7f3564137c40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f35580098f0 tx=0x7f3558009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce7e347fc55bcfa7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.218+0000 7f12edc6c700 1 --2- 172.21.15.146:0/2579687101 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12e80a1550 0x7f12e8138cc0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009920 tx=0x7f12d8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7f6a1f2622cb17d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.218+0000 7f356159a700 1 -- 172.21.15.146:0/1914071716 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3558005e30 con 0x7f356409f260 2023-10-03T10:16:44.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.219+0000 7f356159a700 1 -- 172.21.15.146:0/1914071716 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3558006030 con 0x7f356409f260 2023-10-03T10:16:44.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.219+0000 7f356159a700 1 -- 172.21.15.146:0/1914071716 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35580063c0 con 0x7f356409f260 2023-10-03T10:16:44.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.219+0000 7f12ed46b700 1 -- 172.21.15.146:0/2579687101 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d8004230 con 0x7f12e80a1550 2023-10-03T10:16:44.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.219+0000 7f12ed46b700 1 -- 172.21.15.146:0/2579687101 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d8004390 con 0x7f12e80a1550 2023-10-03T10:16:44.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.219+0000 7f12ed46b700 1 -- 172.21.15.146:0/2579687101 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d80036a0 con 0x7f12e80a1550 2023-10-03T10:16:44.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.219+0000 7f3568887700 1 -- 172.21.15.146:0/1914071716 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f356409f260 msgr2=0x7f3564137c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.219+0000 7f3568887700 1 --2- 172.21.15.146:0/1914071716 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f356409f260 0x7f3564137c40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f35580098f0 tx=0x7f3558009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:44.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.219+0000 7f12f06d1700 1 -- 172.21.15.146:0/2579687101 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12e80a1550 msgr2=0x7f12e8138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.219+0000 7f12f06d1700 1 --2- 172.21.15.146:0/2579687101 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12e80a1550 0x7f12e8138cc0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009920 tx=0x7f12d8009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:44.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.219+0000 7f3568887700 1 -- 172.21.15.146:0/1914071716 shutdown_connections 2023-10-03T10:16:44.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.219+0000 7f3568887700 1 --2- 172.21.15.146:0/1914071716 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f356409e950 0x7f356409ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.219+0000 7f3568887700 1 --2- 172.21.15.146:0/1914071716 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f356409f260 0x7f3564137c40 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.219+0000 7f3568887700 1 -- 172.21.15.146:0/1914071716 >> 172.21.15.146:0/1914071716 conn(0x7f35640a4470 msgr2=0x7f35640a4870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.219+0000 7f12f06d1700 1 -- 172.21.15.146:0/2579687101 shutdown_connections 2023-10-03T10:16:44.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.219+0000 7f12f06d1700 1 --2- 172.21.15.146:0/2579687101 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12e8139200 0x7f12e813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.219+0000 7f12f06d1700 1 --2- 172.21.15.146:0/2579687101 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12e80a1550 0x7f12e8138cc0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.219+0000 7f12f06d1700 1 -- 172.21.15.146:0/2579687101 >> 172.21.15.146:0/2579687101 conn(0x7f12e80a6610 msgr2=0x7f12e80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.219+0000 7f3568887700 1 -- 172.21.15.146:0/1914071716 shutdown_connections 2023-10-03T10:16:44.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.220+0000 7f12f06d1700 1 -- 172.21.15.146:0/2579687101 shutdown_connections 2023-10-03T10:16:44.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.220+0000 7f3568887700 1 -- 172.21.15.146:0/1914071716 wait complete. 2023-10-03T10:16:44.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.220+0000 7f12f06d1700 1 -- 172.21.15.146:0/2579687101 wait complete. 2023-10-03T10:16:44.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.221+0000 7f3568887700 1 Processor -- start 2023-10-03T10:16:44.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.221+0000 7f3568887700 1 -- start start 2023-10-03T10:16:44.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.221+0000 7f12f06d1700 1 Processor -- start 2023-10-03T10:16:44.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.221+0000 7f12f06d1700 1 -- start start 2023-10-03T10:16:44.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.221+0000 7f3568887700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f356409e950 0x7f3564122b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.221+0000 7f3568887700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f356409f260 0x7f3564123070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.221+0000 7f3568887700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3564138180 0x7f35641235b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.221+0000 7f3568887700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3564124870 con 0x7f356409e950 2023-10-03T10:16:44.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.221+0000 7f3568887700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35640a1870 con 0x7f356409f260 2023-10-03T10:16:44.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.221+0000 7f3568887700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f356406ccc0 con 0x7f3564138180 2023-10-03T10:16:44.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.221+0000 7f356259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f356409e950 0x7f3564122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.221+0000 7f356259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f356409e950 0x7f3564122b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33584/0 (socket says 172.21.15.146:33584) 2023-10-03T10:16:44.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.221+0000 7f356259c700 1 -- 172.21.15.146:0/1921039068 learned_addr learned my addr 172.21.15.146:0/1921039068 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:44.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.221+0000 7f3561d9b700 1 --2- 172.21.15.146:0/1921039068 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f356409f260 0x7f3564123070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.221+0000 7f3562d9d700 1 --2- 172.21.15.146:0/1921039068 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3564138180 0x7f35641235b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.221+0000 7f12f06d1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12e80a0a70 0x7f12e8120970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f12f06d1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12e80a1550 0x7f12e8120eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f12f06d1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12e8139200 0x7f12e81213f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f12f06d1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e8122580 con 0x7f12e80a0a70 2023-10-03T10:16:44.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f12f06d1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e81246d0 con 0x7f12e8139200 2023-10-03T10:16:44.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f12f06d1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12e8123c20 con 0x7f12e80a1550 2023-10-03T10:16:44.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f12eec6e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12e8139200 0x7f12e81213f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f12ee46d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12e80a0a70 0x7f12e8120970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f12eec6e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12e8139200 0x7f12e81213f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58880/0 (socket says 172.21.15.146:58880) 2023-10-03T10:16:44.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f12ee46d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12e80a0a70 0x7f12e8120970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33590/0 (socket says 172.21.15.146:33590) 2023-10-03T10:16:44.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f12eec6e700 1 -- 172.21.15.146:0/3869374014 learned_addr learned my addr 172.21.15.146:0/3869374014 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:44.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f12edc6c700 1 --2- 172.21.15.146:0/3869374014 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12e80a1550 0x7f12e8120eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f356259c700 1 -- 172.21.15.146:0/1921039068 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3564138180 msgr2=0x7f35641235b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f356259c700 1 --2- 172.21.15.146:0/1921039068 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3564138180 0x7f35641235b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f356259c700 1 -- 172.21.15.146:0/1921039068 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f356409f260 msgr2=0x7f3564123070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f356259c700 1 --2- 172.21.15.146:0/1921039068 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f356409f260 0x7f3564123070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f356259c700 1 -- 172.21.15.146:0/1921039068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3558009500 con 0x7f356409e950 2023-10-03T10:16:44.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f3562d9d700 1 --2- 172.21.15.146:0/1921039068 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3564138180 0x7f35641235b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:44.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f12ee46d700 1 -- 172.21.15.146:0/3869374014 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12e80a1550 msgr2=0x7f12e8120eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f12ee46d700 1 --2- 172.21.15.146:0/3869374014 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12e80a1550 0x7f12e8120eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f12ee46d700 1 -- 172.21.15.146:0/3869374014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12e8139200 msgr2=0x7f12e81213f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f12ee46d700 1 --2- 172.21.15.146:0/3869374014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12e8139200 0x7f12e81213f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f12ee46d700 1 -- 172.21.15.146:0/3869374014 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d8009550 con 0x7f12e80a0a70 2023-10-03T10:16:44.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f12eec6e700 1 --2- 172.21.15.146:0/3869374014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12e8139200 0x7f12e81213f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:44.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f356259c700 1 --2- 172.21.15.146:0/1921039068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f356409e950 0x7f3564122b30 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f355400e990 tx=0x7f355400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f12ee46d700 1 --2- 172.21.15.146:0/3869374014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12e80a0a70 0x7f12e8120970 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f12e400c3e0 tx=0x7f12e400c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f3552ffd700 1 -- 172.21.15.146:0/1921039068 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35540096f0 con 0x7f356409e950 2023-10-03T10:16:44.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f3552ffd700 1 -- 172.21.15.146:0/1921039068 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355400c850 con 0x7f356409e950 2023-10-03T10:16:44.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f3552ffd700 1 -- 172.21.15.146:0/1921039068 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355400eee0 con 0x7f356409e950 2023-10-03T10:16:44.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f3568887700 1 -- 172.21.15.146:0/1921039068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3564137590 con 0x7f356409e950 2023-10-03T10:16:44.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f12deffd700 1 -- 172.21.15.146:0/3869374014 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e40052d0 con 0x7f12e80a0a70 2023-10-03T10:16:44.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.223+0000 7f12deffd700 1 -- 172.21.15.146:0/3869374014 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e4005450 con 0x7f12e80a0a70 2023-10-03T10:16:44.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.223+0000 7f12f06d1700 1 -- 172.21.15.146:0/3869374014 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e80a54d0 con 0x7f12e80a0a70 2023-10-03T10:16:44.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.223+0000 7f12deffd700 1 -- 172.21.15.146:0/3869374014 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e40038c0 con 0x7f12e80a0a70 2023-10-03T10:16:44.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.223+0000 7f12f06d1700 1 -- 172.21.15.146:0/3869374014 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e80a0430 con 0x7f12e80a0a70 2023-10-03T10:16:44.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.222+0000 7f3568887700 1 -- 172.21.15.146:0/1921039068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3564126600 con 0x7f356409e950 2023-10-03T10:16:44.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.224+0000 7f3552ffd700 1 -- 172.21.15.146:0/1921039068 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f355400cbc0 con 0x7f356409e950 2023-10-03T10:16:44.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.224+0000 7f12deffd700 1 -- 172.21.15.146:0/3869374014 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12e4003a20 con 0x7f12e80a0a70 2023-10-03T10:16:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.224+0000 7f12f06d1700 1 -- 172.21.15.146:0/3869374014 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e804f2a0 con 0x7f12e80a0a70 2023-10-03T10:16:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.224+0000 7f3568887700 1 -- 172.21.15.146:0/1921039068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356409b720 con 0x7f356409e950 2023-10-03T10:16:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.224+0000 7f3552ffd700 1 -- 172.21.15.146:0/1921039068 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f355403fb30 con 0x7f356409e950 2023-10-03T10:16:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.224+0000 7f12deffd700 1 -- 172.21.15.146:0/3869374014 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f12e403e660 con 0x7f12e80a0a70 2023-10-03T10:16:44.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.229+0000 7f12deffd700 1 -- 172.21.15.146:0/3869374014 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12e4018cd0 con 0x7f12e80a0a70 2023-10-03T10:16:44.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.233+0000 7f3552ffd700 1 -- 172.21.15.146:0/1921039068 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f355401b3b0 con 0x7f356409e950 2023-10-03T10:16:44.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.398+0000 7fc5d1525700 1 -- 172.21.15.146:0/3609101953 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc5cc0724c0 con 0x7fc5cc09bc70 2023-10-03T10:16:44.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.398+0000 7fc5b37fe700 1 -- 172.21.15.146:0/3609101953 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc5c0028070 con 0x7fc5cc09bc70 2023-10-03T10:16:44.399 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:44.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.401+0000 7fc5d1525700 1 -- 172.21.15.146:0/3609101953 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5cc09bc70 msgr2=0x7fc5cc135640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.401+0000 7fc5d1525700 1 --2- 172.21.15.146:0/3609101953 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5cc09bc70 0x7fc5cc135640 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0009bc0 tx=0x7fc5c0004750 comp rx=0 tx=0).stop 2023-10-03T10:16:44.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.401+0000 7fc5d1525700 1 -- 172.21.15.146:0/3609101953 shutdown_connections 2023-10-03T10:16:44.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.401+0000 7fc5d1525700 1 --2- 172.21.15.146:0/3609101953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5cc1314b0 0x7fc5cc135b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.401+0000 7fc5d1525700 1 --2- 172.21.15.146:0/3609101953 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc5cc066410 0x7fc5cc135100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.401+0000 7fc5d1525700 1 --2- 172.21.15.146:0/3609101953 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5cc09bc70 0x7fc5cc135640 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.401+0000 7fc5d1525700 1 -- 172.21.15.146:0/3609101953 >> 172.21.15.146:0/3609101953 conn(0x7fc5cc0a2980 msgr2=0x7fc5cc071500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.401+0000 7fc5d1525700 1 -- 172.21.15.146:0/3609101953 shutdown_connections 2023-10-03T10:16:44.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.401+0000 7fc5d1525700 1 -- 172.21.15.146:0/3609101953 wait complete. 2023-10-03T10:16:44.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:44.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.423+0000 7f12f06d1700 1 -- 172.21.15.146:0/3869374014 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f12e8072980 con 0x7f12e80a0a70 2023-10-03T10:16:44.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.423+0000 7f12deffd700 1 -- 172.21.15.146:0/3869374014 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f12e4017020 con 0x7f12e80a0a70 2023-10-03T10:16:44.424 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:44.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.425+0000 7f12f06d1700 1 -- 172.21.15.146:0/3869374014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12e80a0a70 msgr2=0x7f12e8120970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.425+0000 7f12f06d1700 1 --2- 172.21.15.146:0/3869374014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12e80a0a70 0x7f12e8120970 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f12e400c3e0 tx=0x7f12e400c6f0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.425+0000 7f12f06d1700 1 -- 172.21.15.146:0/3869374014 shutdown_connections 2023-10-03T10:16:44.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.425+0000 7f12f06d1700 1 --2- 172.21.15.146:0/3869374014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12e8139200 0x7f12e81213f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.425+0000 7f12f06d1700 1 --2- 172.21.15.146:0/3869374014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12e80a0a70 0x7f12e8120970 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.425+0000 7f12f06d1700 1 --2- 172.21.15.146:0/3869374014 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f12e80a1550 0x7f12e8120eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.425+0000 7f12f06d1700 1 -- 172.21.15.146:0/3869374014 >> 172.21.15.146:0/3869374014 conn(0x7f12e80a6610 msgr2=0x7f12e809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.425+0000 7f12f06d1700 1 -- 172.21.15.146:0/3869374014 shutdown_connections 2023-10-03T10:16:44.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.425+0000 7f12f06d1700 1 -- 172.21.15.146:0/3869374014 wait complete. 2023-10-03T10:16:44.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:44.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.444+0000 7f3568887700 1 -- 172.21.15.146:0/1921039068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f356404f2a0 con 0x7f356409e950 2023-10-03T10:16:44.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.444+0000 7f3552ffd700 1 -- 172.21.15.146:0/1921039068 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3554021030 con 0x7f356409e950 2023-10-03T10:16:44.444 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:44.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.446+0000 7f3568887700 1 -- 172.21.15.146:0/1921039068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f356409e950 msgr2=0x7f3564122b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.446+0000 7f3568887700 1 --2- 172.21.15.146:0/1921039068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f356409e950 0x7f3564122b30 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f355400e990 tx=0x7f355400eca0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.446+0000 7f3568887700 1 -- 172.21.15.146:0/1921039068 shutdown_connections 2023-10-03T10:16:44.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.446+0000 7f3568887700 1 --2- 172.21.15.146:0/1921039068 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3564138180 0x7f35641235b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.446+0000 7f3568887700 1 --2- 172.21.15.146:0/1921039068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f356409e950 0x7f3564122b30 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.446+0000 7f3568887700 1 --2- 172.21.15.146:0/1921039068 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f356409f260 0x7f3564123070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.446+0000 7f3568887700 1 -- 172.21.15.146:0/1921039068 >> 172.21.15.146:0/1921039068 conn(0x7f35640a4470 msgr2=0x7f356409cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.446+0000 7f3568887700 1 -- 172.21.15.146:0/1921039068 shutdown_connections 2023-10-03T10:16:44.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:44.446+0000 7f3568887700 1 -- 172.21.15.146:0/1921039068 wait complete. 2023-10-03T10:16:44.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:45.110 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:45.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.236+0000 7fa954e95700 1 Processor -- start 2023-10-03T10:16:45.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.236+0000 7fa954e95700 1 -- start start 2023-10-03T10:16:45.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.237+0000 7fa954e95700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa95006a770 0x7fa95006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.237+0000 7fa954e95700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa95006b080 0x7fa9501317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.237+0000 7fa954e95700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa950131cf0 0x7fa950132190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.237+0000 7fa954e95700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa95009f770 con 0x7fa950131cf0 2023-10-03T10:16:45.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.237+0000 7fa954e95700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95009dce0 con 0x7fa95006a770 2023-10-03T10:16:45.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.237+0000 7fa954e95700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa95009da80 con 0x7fa95006b080 2023-10-03T10:16:45.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.237+0000 7fa94dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa95006b080 0x7fa9501317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.237+0000 7fa94ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa950131cf0 0x7fa950132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.237+0000 7fa94e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa95006a770 0x7fa95006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.237+0000 7fa94dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa95006b080 0x7fa9501317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57248/0 (socket says 172.21.15.146:57248) 2023-10-03T10:16:45.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.237+0000 7fa94dd9b700 1 -- 172.21.15.146:0/2579110711 learned_addr learned my addr 172.21.15.146:0/2579110711 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:45.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.237+0000 7fa94e59c700 1 -- 172.21.15.146:0/2579110711 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa95006b080 msgr2=0x7fa9501317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:45.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.237+0000 7fa94e59c700 1 --2- 172.21.15.146:0/2579110711 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa95006b080 0x7fa9501317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.237+0000 7fa94e59c700 1 -- 172.21.15.146:0/2579110711 >> v2:172.21.15.146:3300/0 conn(0x7fa950131cf0 msgr2=0x7fa950132190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:45.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.237+0000 7fa94e59c700 1 --2- 172.21.15.146:0/2579110711 >> v2:172.21.15.146:3300/0 conn(0x7fa950131cf0 0x7fa950132190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.237+0000 7fa94e59c700 1 -- 172.21.15.146:0/2579110711 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95009eb20 con 0x7fa95006a770 2023-10-03T10:16:45.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.237+0000 7fa94ed9d700 1 --2- 172.21.15.146:0/2579110711 >> v2:172.21.15.146:3300/0 conn(0x7fa950131cf0 0x7fa950132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:45.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.237+0000 7fa94dd9b700 1 --2- 172.21.15.146:0/2579110711 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa95006b080 0x7fa9501317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:45.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.237+0000 7fa94e59c700 1 --2- 172.21.15.146:0/2579110711 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa95006a770 0x7fa95006ab40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa944009870 tx=0x7fa944009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2869be0acad0fb49 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.238+0000 7fa94d59a700 1 -- 172.21.15.146:0/2579110711 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944011830 con 0x7fa95006a770 2023-10-03T10:16:45.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.238+0000 7fa94d59a700 1 -- 172.21.15.146:0/2579110711 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa944011990 con 0x7fa95006a770 2023-10-03T10:16:45.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.238+0000 7fa94d59a700 1 -- 172.21.15.146:0/2579110711 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944011d20 con 0x7fa95006a770 2023-10-03T10:16:45.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.238+0000 7fa954e95700 1 -- 172.21.15.146:0/2579110711 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa95006a770 msgr2=0x7fa95006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.238+0000 7fa954e95700 1 --2- 172.21.15.146:0/2579110711 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa95006a770 0x7fa95006ab40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa944009870 tx=0x7fa944009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:45.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.238+0000 7fa954e95700 1 -- 172.21.15.146:0/2579110711 shutdown_connections 2023-10-03T10:16:45.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.238+0000 7fa954e95700 1 --2- 172.21.15.146:0/2579110711 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa95006a770 0x7fa95006ab40 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.238+0000 7fa954e95700 1 --2- 172.21.15.146:0/2579110711 >> v2:172.21.15.146:3300/0 conn(0x7fa950131cf0 0x7fa950132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.238+0000 7fa954e95700 1 --2- 172.21.15.146:0/2579110711 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa95006b080 0x7fa9501317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.238+0000 7fa954e95700 1 -- 172.21.15.146:0/2579110711 >> 172.21.15.146:0/2579110711 conn(0x7fa950099c40 msgr2=0x7fa9500a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.238+0000 7fa954e95700 1 -- 172.21.15.146:0/2579110711 shutdown_connections 2023-10-03T10:16:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.238+0000 7fa954e95700 1 -- 172.21.15.146:0/2579110711 wait complete. 2023-10-03T10:16:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.239+0000 7fa954e95700 1 Processor -- start 2023-10-03T10:16:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.239+0000 7fa954e95700 1 -- start start 2023-10-03T10:16:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa954e95700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa95006a770 0x7fa95009ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa954e95700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa95006b080 0x7fa95009b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa954e95700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa950131cf0 0x7fa9501c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa954e95700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95009aa40 con 0x7fa95006b080 2023-10-03T10:16:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa954e95700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa950121190 con 0x7fa950131cf0 2023-10-03T10:16:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa954e95700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa95009b8a0 con 0x7fa95006a770 2023-10-03T10:16:45.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa94ed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa950131cf0 0x7fa9501c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa94e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa95006a770 0x7fa95009ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa94dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa95006b080 0x7fa95009b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa94ed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa950131cf0 0x7fa9501c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56260/0 (socket says 172.21.15.146:56260) 2023-10-03T10:16:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa94e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa95006a770 0x7fa95009ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57262/0 (socket says 172.21.15.146:57262) 2023-10-03T10:16:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa94ed9d700 1 -- 172.21.15.146:0/441872695 learned_addr learned my addr 172.21.15.146:0/441872695 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa94dd9b700 1 --2- 172.21.15.146:0/441872695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa95006b080 0x7fa95009b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58160/0 (socket says 172.21.15.146:58160) 2023-10-03T10:16:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa94dd9b700 1 -- 172.21.15.146:0/441872695 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa95006a770 msgr2=0x7fa95009ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa94dd9b700 1 --2- 172.21.15.146:0/441872695 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa95006a770 0x7fa95009ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa94dd9b700 1 -- 172.21.15.146:0/441872695 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa950131cf0 msgr2=0x7fa9501c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa94dd9b700 1 --2- 172.21.15.146:0/441872695 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa950131cf0 0x7fa9501c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa94dd9b700 1 -- 172.21.15.146:0/441872695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa940009550 con 0x7fa95006b080 2023-10-03T10:16:45.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa94dd9b700 1 --2- 172.21.15.146:0/441872695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa95006b080 0x7fa95009b360 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fa9500a3ff0 tx=0x7fa94000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa93effd700 1 -- 172.21.15.146:0/441872695 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa940004240 con 0x7fa95006b080 2023-10-03T10:16:45.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa93effd700 1 -- 172.21.15.146:0/441872695 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9400043a0 con 0x7fa95006b080 2023-10-03T10:16:45.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa954e95700 1 -- 172.21.15.146:0/441872695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa948009a70 con 0x7fa95006b080 2023-10-03T10:16:45.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.240+0000 7fa93effd700 1 -- 172.21.15.146:0/441872695 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9400036a0 con 0x7fa95006b080 2023-10-03T10:16:45.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.241+0000 7fa954e95700 1 -- 172.21.15.146:0/441872695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9440094a0 con 0x7fa95006b080 2023-10-03T10:16:45.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.241+0000 7fa93effd700 1 -- 172.21.15.146:0/441872695 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa940003800 con 0x7fa95006b080 2023-10-03T10:16:45.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.241+0000 7fa954e95700 1 -- 172.21.15.146:0/441872695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9500a3db0 con 0x7fa95006b080 2023-10-03T10:16:45.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.241+0000 7fa93effd700 1 -- 172.21.15.146:0/441872695 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa94003fbd0 con 0x7fa95006b080 2023-10-03T10:16:45.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.247+0000 7fa93effd700 1 -- 172.21.15.146:0/441872695 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa940013470 con 0x7fa95006b080 2023-10-03T10:16:45.414 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:45.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.431+0000 7fa954e95700 1 -- 172.21.15.146:0/441872695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa9500a2e60 con 0x7fa95006b080 2023-10-03T10:16:45.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.431+0000 7fa93effd700 1 -- 172.21.15.146:0/441872695 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa94002a070 con 0x7fa95006b080 2023-10-03T10:16:45.432 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:45.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.433+0000 7fa954e95700 1 -- 172.21.15.146:0/441872695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa95006b080 msgr2=0x7fa95009b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.433+0000 7fa954e95700 1 --2- 172.21.15.146:0/441872695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa95006b080 0x7fa95009b360 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fa9500a3ff0 tx=0x7fa94000ec80 comp rx=0 tx=0).stop 2023-10-03T10:16:45.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.433+0000 7fa954e95700 1 -- 172.21.15.146:0/441872695 shutdown_connections 2023-10-03T10:16:45.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.433+0000 7fa954e95700 1 --2- 172.21.15.146:0/441872695 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa950131cf0 0x7fa9501c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.433+0000 7fa954e95700 1 --2- 172.21.15.146:0/441872695 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa95006a770 0x7fa95009ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.433+0000 7fa954e95700 1 --2- 172.21.15.146:0/441872695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa95006b080 0x7fa95009b360 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.433+0000 7fa954e95700 1 -- 172.21.15.146:0/441872695 >> 172.21.15.146:0/441872695 conn(0x7fa950099c40 msgr2=0x7fa9500a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.433+0000 7fa954e95700 1 -- 172.21.15.146:0/441872695 shutdown_connections 2023-10-03T10:16:45.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.433+0000 7fa954e95700 1 -- 172.21.15.146:0/441872695 wait complete. 2023-10-03T10:16:45.439 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:45.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:45.459 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:45.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.544+0000 7f95e3dba700 1 Processor -- start 2023-10-03T10:16:45.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.544+0000 7f95e3dba700 1 -- start start 2023-10-03T10:16:45.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.545+0000 7f95e3dba700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95dc09e950 0x7f95dc09ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.545+0000 7f95e3dba700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f95dc131fa0 0x7f95dc139af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.545+0000 7f95e3dba700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95dc09afb0 con 0x7f95dc09f260 2023-10-03T10:16:45.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.545+0000 7f95e3dba700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95dc0a0970 con 0x7f95dc131fa0 2023-10-03T10:16:45.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.545+0000 7f95e3dba700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc0a0320 con 0x7f95dc09e950 2023-10-03T10:16:45.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.545+0000 7f95e1b56700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95dc09e950 0x7f95dc09ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.545+0000 7f95e1b56700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95dc09e950 0x7f95dc09ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56262/0 (socket says 172.21.15.146:56262) 2023-10-03T10:16:45.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.545+0000 7f95e1b56700 1 -- 172.21.15.146:0/650895128 learned_addr learned my addr 172.21.15.146:0/650895128 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:45.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.545+0000 7f95e2357700 1 --2- 172.21.15.146:0/650895128 >> v2:172.21.15.146:3300/0 conn(0x7f95dc131fa0 0x7f95dc139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.545+0000 7f95e1b56700 1 -- 172.21.15.146:0/650895128 >> v2:172.21.15.146:3300/0 conn(0x7f95dc131fa0 msgr2=0x7f95dc139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:45.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.545+0000 7f95e1b56700 1 --2- 172.21.15.146:0/650895128 >> v2:172.21.15.146:3300/0 conn(0x7f95dc131fa0 0x7f95dc139af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.545+0000 7f95e1b56700 1 -- 172.21.15.146:0/650895128 >> v1:172.21.15.146:6789/0 conn(0x7f95dc09f260 legacy=0x7f95dc131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.545+0000 7f95e1b56700 1 -- 172.21.15.146:0/650895128 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95dc0a0750 con 0x7f95dc09e950 2023-10-03T10:16:45.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.546+0000 7f95e1b56700 1 --2- 172.21.15.146:0/650895128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95dc09e950 0x7f95dc09ed20 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f95d8006fd0 tx=0x7f95d800fcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bb4acbdd6a07d2d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.546+0000 7f95e0b54700 1 -- 172.21.15.146:0/650895128 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d800f460 con 0x7f95dc09e950 2023-10-03T10:16:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.546+0000 7f95e0b54700 1 -- 172.21.15.146:0/650895128 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d800fe50 con 0x7f95dc09e950 2023-10-03T10:16:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.546+0000 7f95e0b54700 1 -- 172.21.15.146:0/650895128 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8005c60 con 0x7f95dc09e950 2023-10-03T10:16:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.546+0000 7f95e3dba700 1 -- 172.21.15.146:0/650895128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95dc09e950 msgr2=0x7f95dc09ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.546+0000 7f95e3dba700 1 --2- 172.21.15.146:0/650895128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95dc09e950 0x7f95dc09ed20 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f95d8006fd0 tx=0x7f95d800fcc0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.547+0000 7f95e3dba700 1 -- 172.21.15.146:0/650895128 shutdown_connections 2023-10-03T10:16:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.547+0000 7f95e3dba700 1 --2- 172.21.15.146:0/650895128 >> v2:172.21.15.146:3300/0 conn(0x7f95dc131fa0 0x7f95dc139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.547+0000 7f95e3dba700 1 --2- 172.21.15.146:0/650895128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95dc09e950 0x7f95dc09ed20 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.547+0000 7f95e3dba700 1 -- 172.21.15.146:0/650895128 >> 172.21.15.146:0/650895128 conn(0x7f95dc0a0f70 msgr2=0x7f95dc0a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.547+0000 7f95e3dba700 1 -- 172.21.15.146:0/650895128 shutdown_connections 2023-10-03T10:16:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.547+0000 7f95e3dba700 1 -- 172.21.15.146:0/650895128 wait complete. 2023-10-03T10:16:45.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.548+0000 7f95e3dba700 1 Processor -- start 2023-10-03T10:16:45.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.548+0000 7f95e3dba700 1 -- start start 2023-10-03T10:16:45.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.548+0000 7f95e3dba700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95dc09e950 0x7f95dc11e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.548+0000 7f95e3dba700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95dc09f260 0x7f95dc11e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.548+0000 7f95e3dba700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95dc131fa0 0x7f95dc11ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.548+0000 7f95e3dba700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc121b50 con 0x7f95dc09e950 2023-10-03T10:16:45.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.548+0000 7f95e3dba700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc0a4e50 con 0x7f95dc09f260 2023-10-03T10:16:45.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.548+0000 7f95e3dba700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc09da40 con 0x7f95dc131fa0 2023-10-03T10:16:45.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.548+0000 7f95e1355700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95dc09f260 0x7f95dc11e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.548+0000 7f95e1355700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95dc09f260 0x7f95dc11e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56264/0 (socket says 172.21.15.146:56264) 2023-10-03T10:16:45.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.548+0000 7f95e1355700 1 -- 172.21.15.146:0/278294099 learned_addr learned my addr 172.21.15.146:0/278294099 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:45.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.548+0000 7f95e2357700 1 --2- 172.21.15.146:0/278294099 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95dc131fa0 0x7f95dc11ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.548+0000 7f95e1b56700 1 --2- 172.21.15.146:0/278294099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95dc09e950 0x7f95dc11e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.549+0000 7f95e2357700 1 -- 172.21.15.146:0/278294099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95dc09f260 msgr2=0x7f95dc11e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.549+0000 7f95e2357700 1 --2- 172.21.15.146:0/278294099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95dc09f260 0x7f95dc11e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.549+0000 7f95e2357700 1 -- 172.21.15.146:0/278294099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95dc09e950 msgr2=0x7f95dc11e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.549+0000 7f95e2357700 1 --2- 172.21.15.146:0/278294099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95dc09e950 0x7f95dc11e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.549+0000 7f95e2357700 1 -- 172.21.15.146:0/278294099 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d800f5f0 con 0x7f95dc131fa0 2023-10-03T10:16:45.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.549+0000 7f95e1355700 1 --2- 172.21.15.146:0/278294099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95dc09f260 0x7f95dc11e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:45.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.549+0000 7f95e2357700 1 --2- 172.21.15.146:0/278294099 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95dc131fa0 0x7f95dc11ed90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f95d400efc0 tx=0x7f95d400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.549+0000 7f95d27fc700 1 -- 172.21.15.146:0/278294099 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d400cc90 con 0x7f95dc131fa0 2023-10-03T10:16:45.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.549+0000 7f95d27fc700 1 -- 172.21.15.146:0/278294099 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d400f040 con 0x7f95dc131fa0 2023-10-03T10:16:45.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.549+0000 7f95e3dba700 1 -- 172.21.15.146:0/278294099 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95dc09ba00 con 0x7f95dc131fa0 2023-10-03T10:16:45.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.549+0000 7f95d27fc700 1 -- 172.21.15.146:0/278294099 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d40146c0 con 0x7f95dc131fa0 2023-10-03T10:16:45.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.549+0000 7f95e3dba700 1 -- 172.21.15.146:0/278294099 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95dc1225c0 con 0x7f95dc131fa0 2023-10-03T10:16:45.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.550+0000 7f95d27fc700 1 -- 172.21.15.146:0/278294099 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f95d4014820 con 0x7f95dc131fa0 2023-10-03T10:16:45.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.550+0000 7f95d27fc700 1 -- 172.21.15.146:0/278294099 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f95d4040200 con 0x7f95dc131fa0 2023-10-03T10:16:45.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.550+0000 7f95e3dba700 1 -- 172.21.15.146:0/278294099 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95dc04f2a0 con 0x7f95dc131fa0 2023-10-03T10:16:45.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.555+0000 7f95d27fc700 1 -- 172.21.15.146:0/278294099 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f95d4018020 con 0x7f95dc131fa0 2023-10-03T10:16:45.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.567+0000 7f28b0cf5700 1 Processor -- start 2023-10-03T10:16:45.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.568+0000 7f28b0cf5700 1 -- start start 2023-10-03T10:16:45.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.568+0000 7f28b0cf5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f28ac06b250 0x7f28ac136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.568+0000 7f28b0cf5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28ac137140 0x7f28ac139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.568+0000 7f28b0cf5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ac09da80 con 0x7f28ac06a770 2023-10-03T10:16:45.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.568+0000 7f28b0cf5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ac09f770 con 0x7f28ac06b250 2023-10-03T10:16:45.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.568+0000 7f28b0cf5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac09dce0 con 0x7f28ac137140 2023-10-03T10:16:45.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.568+0000 7f28a9d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f28ac06b250 0x7f28ac136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.568+0000 7f28a9d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f28ac06b250 0x7f28ac136c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58182/0 (socket says 172.21.15.146:58182) 2023-10-03T10:16:45.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.568+0000 7f28a9d9b700 1 -- 172.21.15.146:0/3836722417 learned_addr learned my addr 172.21.15.146:0/3836722417 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:45.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.568+0000 7f28aad9d700 1 --2- 172.21.15.146:0/3836722417 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28ac137140 0x7f28ac139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.569+0000 7f28a9d9b700 1 -- 172.21.15.146:0/3836722417 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28ac137140 msgr2=0x7f28ac139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:45.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.569+0000 7f28a9d9b700 1 --2- 172.21.15.146:0/3836722417 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28ac137140 0x7f28ac139520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.569+0000 7f28a9d9b700 1 -- 172.21.15.146:0/3836722417 >> v1:172.21.15.146:6789/0 conn(0x7f28ac06a770 legacy=0x7f28ac06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.569+0000 7f28a9d9b700 1 -- 172.21.15.146:0/3836722417 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac09eb20 con 0x7f28ac06b250 2023-10-03T10:16:45.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.569+0000 7f28a959a700 1 -- 172.21.15.146:0/3836722417 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817621410 0 0) 0x7f28ac09da80 con 0x7f28ac06a770 2023-10-03T10:16:45.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.569+0000 7f28a9d9b700 1 --2- 172.21.15.146:0/3836722417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28ac06b250 0x7f28ac136c00 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f28a00098f0 tx=0x7f28a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea0b56297498c78 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.569+0000 7f28a959a700 1 -- 172.21.15.146:0/3836722417 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a0011830 con 0x7f28ac06b250 2023-10-03T10:16:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.569+0000 7f28a959a700 1 -- 172.21.15.146:0/3836722417 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a0011990 con 0x7f28ac06b250 2023-10-03T10:16:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.569+0000 7f28a959a700 1 -- 172.21.15.146:0/3836722417 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a0011d20 con 0x7f28ac06b250 2023-10-03T10:16:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.570+0000 7f28b0cf5700 1 -- 172.21.15.146:0/3836722417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28ac06b250 msgr2=0x7f28ac136c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.570+0000 7f28b0cf5700 1 --2- 172.21.15.146:0/3836722417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28ac06b250 0x7f28ac136c00 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f28a00098f0 tx=0x7f28a0009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.570+0000 7f28b0cf5700 1 -- 172.21.15.146:0/3836722417 shutdown_connections 2023-10-03T10:16:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.570+0000 7f28b0cf5700 1 --2- 172.21.15.146:0/3836722417 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28ac137140 0x7f28ac139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.570+0000 7f28b0cf5700 1 --2- 172.21.15.146:0/3836722417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28ac06b250 0x7f28ac136c00 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.570+0000 7f28b0cf5700 1 -- 172.21.15.146:0/3836722417 >> 172.21.15.146:0/3836722417 conn(0x7f28ac099c40 msgr2=0x7f28ac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.570+0000 7f28b0cf5700 1 -- 172.21.15.146:0/3836722417 shutdown_connections 2023-10-03T10:16:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.570+0000 7f28b0cf5700 1 -- 172.21.15.146:0/3836722417 wait complete. 2023-10-03T10:16:45.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.571+0000 7f28b0cf5700 1 Processor -- start 2023-10-03T10:16:45.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.571+0000 7f28b0cf5700 1 -- start start 2023-10-03T10:16:45.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.571+0000 7f28b0cf5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28ac06a770 0x7f28ac11e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.571+0000 7f28b0cf5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28ac06b250 0x7f28ac11e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.571+0000 7f28b0cf5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28ac137140 0x7f28ac11eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.571+0000 7f28b0cf5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac121ed0 con 0x7f28ac06b250 2023-10-03T10:16:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.571+0000 7f28b0cf5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac121660 con 0x7f28ac137140 2023-10-03T10:16:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.571+0000 7f28b0cf5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac071e10 con 0x7f28ac06a770 2023-10-03T10:16:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.572+0000 7f28aa59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28ac06a770 0x7f28ac11e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.572+0000 7f28aa59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28ac06a770 0x7f28ac11e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57296/0 (socket says 172.21.15.146:57296) 2023-10-03T10:16:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.572+0000 7f28a9d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28ac06b250 0x7f28ac11e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.572+0000 7f28aa59c700 1 -- 172.21.15.146:0/6287335 learned_addr learned my addr 172.21.15.146:0/6287335 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.572+0000 7f28aad9d700 1 --2- 172.21.15.146:0/6287335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28ac137140 0x7f28ac11eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.572+0000 7f28a9d9b700 1 -- 172.21.15.146:0/6287335 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28ac06a770 msgr2=0x7f28ac11e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.572+0000 7f28a9d9b700 1 --2- 172.21.15.146:0/6287335 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28ac06a770 0x7f28ac11e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.572+0000 7f28a9d9b700 1 -- 172.21.15.146:0/6287335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28ac137140 msgr2=0x7f28ac11eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.572+0000 7f28a9d9b700 1 --2- 172.21.15.146:0/6287335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28ac137140 0x7f28ac11eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.572+0000 7f28a9d9b700 1 -- 172.21.15.146:0/6287335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a0009550 con 0x7f28ac06b250 2023-10-03T10:16:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.572+0000 7f28a9d9b700 1 --2- 172.21.15.146:0/6287335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28ac06b250 0x7f28ac11e990 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f28a0016000 tx=0x7f28a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.572+0000 7f289affd700 1 -- 172.21.15.146:0/6287335 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a0004510 con 0x7f28ac06b250 2023-10-03T10:16:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.572+0000 7f289affd700 1 -- 172.21.15.146:0/6287335 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a00036a0 con 0x7f28ac06b250 2023-10-03T10:16:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.572+0000 7f28b0cf5700 1 -- 172.21.15.146:0/6287335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ac0a04b0 con 0x7f28ac06b250 2023-10-03T10:16:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.572+0000 7f289affd700 1 -- 172.21.15.146:0/6287335 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a0003a30 con 0x7f28ac06b250 2023-10-03T10:16:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.572+0000 7f28b0cf5700 1 -- 172.21.15.146:0/6287335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ac136840 con 0x7f28ac06b250 2023-10-03T10:16:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.573+0000 7f289affd700 1 -- 172.21.15.146:0/6287335 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f28a0021070 con 0x7f28ac06b250 2023-10-03T10:16:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.573+0000 7f289affd700 1 -- 172.21.15.146:0/6287335 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f28a0040ad0 con 0x7f28ac06b250 2023-10-03T10:16:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.573+0000 7f28b0cf5700 1 -- 172.21.15.146:0/6287335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ac121890 con 0x7f28ac06b250 2023-10-03T10:16:45.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.578+0000 7f289affd700 1 -- 172.21.15.146:0/6287335 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f28ac121890 con 0x7f28ac06b250 2023-10-03T10:16:45.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.615+0000 7f008aaeb700 1 Processor -- start 2023-10-03T10:16:45.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.615+0000 7f008aaeb700 1 -- start start 2023-10-03T10:16:45.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.616+0000 7f008aaeb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f00840a0a70 0x7f00840a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.616+0000 7f008aaeb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f00840a1380 0x7f0084133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.616+0000 7f008aaeb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0084133f50 0x7f0084134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.616+0000 7f008aaeb700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f008409e9d0 con 0x7f00840a1380 2023-10-03T10:16:45.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.616+0000 7f008aaeb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008409dc00 con 0x7f0084133f50 2023-10-03T10:16:45.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.616+0000 7f008aaeb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f008409dec0 con 0x7f00840a0a70 2023-10-03T10:16:45.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.616+0000 7f0083fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f00840a1380 0x7f0084133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.616+0000 7f0088887700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f00840a0a70 0x7f00840a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.616+0000 7f0083fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f00840a1380 0x7f0084133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58204/0 (socket says 172.21.15.146:58204) 2023-10-03T10:16:45.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.616+0000 7f0088887700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f00840a0a70 0x7f00840a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57304/0 (socket says 172.21.15.146:57304) 2023-10-03T10:16:45.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.616+0000 7f0083fff700 1 -- 172.21.15.146:0/931718914 learned_addr learned my addr 172.21.15.146:0/931718914 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:45.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.616+0000 7f0089088700 1 --2- 172.21.15.146:0/931718914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0084133f50 0x7f0084134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.617+0000 7f0083fff700 1 -- 172.21.15.146:0/931718914 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f00840a0a70 msgr2=0x7f00840a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:45.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.617+0000 7f0083fff700 1 --2- 172.21.15.146:0/931718914 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f00840a0a70 0x7f00840a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.617+0000 7f0083fff700 1 -- 172.21.15.146:0/931718914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0084133f50 msgr2=0x7f0084134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:45.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.617+0000 7f0083fff700 1 --2- 172.21.15.146:0/931718914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0084133f50 0x7f0084134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.617+0000 7f0083fff700 1 -- 172.21.15.146:0/931718914 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008409e6a0 con 0x7f00840a1380 2023-10-03T10:16:45.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.617+0000 7f0088887700 1 --2- 172.21.15.146:0/931718914 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f00840a0a70 0x7f00840a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:45.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.617+0000 7f0089088700 1 --2- 172.21.15.146:0/931718914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0084133f50 0x7f0084134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:45.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.617+0000 7f0083fff700 1 --2- 172.21.15.146:0/931718914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00840a1380 0x7f0084133a10 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f00700098f0 tx=0x7f0070009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838f89707ad49e83 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.617+0000 7f00837fe700 1 -- 172.21.15.146:0/931718914 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0070011830 con 0x7f00840a1380 2023-10-03T10:16:45.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.617+0000 7f00837fe700 1 -- 172.21.15.146:0/931718914 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0070011990 con 0x7f00840a1380 2023-10-03T10:16:45.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.617+0000 7f00837fe700 1 -- 172.21.15.146:0/931718914 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0070011d20 con 0x7f00840a1380 2023-10-03T10:16:45.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.618+0000 7f008aaeb700 1 -- 172.21.15.146:0/931718914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00840a1380 msgr2=0x7f0084133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.618+0000 7f008aaeb700 1 --2- 172.21.15.146:0/931718914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00840a1380 0x7f0084133a10 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f00700098f0 tx=0x7f0070009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:45.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.618+0000 7f008aaeb700 1 -- 172.21.15.146:0/931718914 shutdown_connections 2023-10-03T10:16:45.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.618+0000 7f008aaeb700 1 --2- 172.21.15.146:0/931718914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0084133f50 0x7f0084134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.618+0000 7f008aaeb700 1 --2- 172.21.15.146:0/931718914 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f00840a0a70 0x7f00840a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.618+0000 7f008aaeb700 1 --2- 172.21.15.146:0/931718914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00840a1380 0x7f0084133a10 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.618+0000 7f008aaeb700 1 -- 172.21.15.146:0/931718914 >> 172.21.15.146:0/931718914 conn(0x7f00840a6610 msgr2=0x7f00840a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.618+0000 7f008aaeb700 1 -- 172.21.15.146:0/931718914 shutdown_connections 2023-10-03T10:16:45.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.618+0000 7f008aaeb700 1 -- 172.21.15.146:0/931718914 wait complete. 2023-10-03T10:16:45.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.619+0000 7f008aaeb700 1 Processor -- start 2023-10-03T10:16:45.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.619+0000 7f008aaeb700 1 -- start start 2023-10-03T10:16:45.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.619+0000 7f008aaeb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00840a0a70 0x7f0084122390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.619+0000 7f008aaeb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00840a1380 0x7f00841228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.619+0000 7f008aaeb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0084133f50 0x7f0084122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.619+0000 7f008aaeb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0084133760 con 0x7f00840a1380 2023-10-03T10:16:45.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.619+0000 7f008aaeb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00841237f0 con 0x7f00840a0a70 2023-10-03T10:16:45.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.619+0000 7f008aaeb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0084124e30 con 0x7f0084133f50 2023-10-03T10:16:45.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.619+0000 7f0083fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00840a1380 0x7f00841228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.619+0000 7f0089088700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0084133f50 0x7f0084122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.619+0000 7f0089088700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0084133f50 0x7f0084122e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57314/0 (socket says 172.21.15.146:57314) 2023-10-03T10:16:45.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.619+0000 7f0089088700 1 -- 172.21.15.146:0/3119372768 learned_addr learned my addr 172.21.15.146:0/3119372768 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:45.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.619+0000 7f0083fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00840a1380 0x7f00841228d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58214/0 (socket says 172.21.15.146:58214) 2023-10-03T10:16:45.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.619+0000 7f0088887700 1 --2- 172.21.15.146:0/3119372768 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00840a0a70 0x7f0084122390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.620+0000 7f0083fff700 1 -- 172.21.15.146:0/3119372768 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0084133f50 msgr2=0x7f0084122e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.620+0000 7f0083fff700 1 --2- 172.21.15.146:0/3119372768 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0084133f50 0x7f0084122e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.620+0000 7f0083fff700 1 -- 172.21.15.146:0/3119372768 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00840a0a70 msgr2=0x7f0084122390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.620+0000 7f0083fff700 1 --2- 172.21.15.146:0/3119372768 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00840a0a70 0x7f0084122390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.620+0000 7f0083fff700 1 -- 172.21.15.146:0/3119372768 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00780094a0 con 0x7f00840a1380 2023-10-03T10:16:45.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.620+0000 7f0088887700 1 --2- 172.21.15.146:0/3119372768 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00840a0a70 0x7f0084122390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:45.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.620+0000 7f0083fff700 1 --2- 172.21.15.146:0/3119372768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00840a1380 0x7f00841228d0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f0070016000 tx=0x7f0070004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.620+0000 7f00817fa700 1 -- 172.21.15.146:0/3119372768 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0070004240 con 0x7f00840a1380 2023-10-03T10:16:45.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.620+0000 7f00817fa700 1 -- 172.21.15.146:0/3119372768 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007001f070 con 0x7f00840a1380 2023-10-03T10:16:45.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.620+0000 7f008aaeb700 1 -- 172.21.15.146:0/3119372768 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007c009a70 con 0x7f00840a1380 2023-10-03T10:16:45.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.620+0000 7f00817fa700 1 -- 172.21.15.146:0/3119372768 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00700036a0 con 0x7f00840a1380 2023-10-03T10:16:45.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.620+0000 7f008aaeb700 1 -- 172.21.15.146:0/3119372768 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0070009550 con 0x7f00840a1380 2023-10-03T10:16:45.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.621+0000 7f008aaeb700 1 -- 172.21.15.146:0/3119372768 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00841251f0 con 0x7f00840a1380 2023-10-03T10:16:45.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.622+0000 7f00817fa700 1 -- 172.21.15.146:0/3119372768 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0070021030 con 0x7f00840a1380 2023-10-03T10:16:45.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.622+0000 7f00817fa700 1 -- 172.21.15.146:0/3119372768 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f00700407f0 con 0x7f00840a1380 2023-10-03T10:16:45.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.626+0000 7f00817fa700 1 -- 172.21.15.146:0/3119372768 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f00700199a0 con 0x7f00840a1380 2023-10-03T10:16:45.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.769+0000 7f95e3dba700 1 -- 172.21.15.146:0/278294099 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f95dc06b250 con 0x7f95dc131fa0 2023-10-03T10:16:45.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.769+0000 7f95d27fc700 1 -- 172.21.15.146:0/278294099 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f95d402b090 con 0x7f95dc131fa0 2023-10-03T10:16:45.770 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:45.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.772+0000 7f95e3dba700 1 -- 172.21.15.146:0/278294099 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95dc131fa0 msgr2=0x7f95dc11ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.772+0000 7f95e3dba700 1 --2- 172.21.15.146:0/278294099 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95dc131fa0 0x7f95dc11ed90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f95d400efc0 tx=0x7f95d400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.772+0000 7f95e3dba700 1 -- 172.21.15.146:0/278294099 shutdown_connections 2023-10-03T10:16:45.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.772+0000 7f95e3dba700 1 --2- 172.21.15.146:0/278294099 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95dc131fa0 0x7f95dc11ed90 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.772+0000 7f95e3dba700 1 --2- 172.21.15.146:0/278294099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95dc09e950 0x7f95dc11e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.772+0000 7f95e3dba700 1 --2- 172.21.15.146:0/278294099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95dc09f260 0x7f95dc11e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.772+0000 7f95e3dba700 1 -- 172.21.15.146:0/278294099 >> 172.21.15.146:0/278294099 conn(0x7f95dc0a0f70 msgr2=0x7f95dc071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.773+0000 7f95e3dba700 1 -- 172.21.15.146:0/278294099 shutdown_connections 2023-10-03T10:16:45.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.773+0000 7f95e3dba700 1 -- 172.21.15.146:0/278294099 wait complete. 2023-10-03T10:16:45.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:45.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.793+0000 7f28b0cf5700 1 -- 172.21.15.146:0/6287335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f28ac121890 con 0x7f28ac06b250 2023-10-03T10:16:45.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.793+0000 7f289affd700 1 -- 172.21.15.146:0/6287335 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f28ac121890 con 0x7f28ac06b250 2023-10-03T10:16:45.794 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:45.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.795+0000 7f28b0cf5700 1 -- 172.21.15.146:0/6287335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28ac06b250 msgr2=0x7f28ac11e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.795+0000 7f28b0cf5700 1 --2- 172.21.15.146:0/6287335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28ac06b250 0x7f28ac11e990 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f28a0016000 tx=0x7f28a0004750 comp rx=0 tx=0).stop 2023-10-03T10:16:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.795+0000 7f28b0cf5700 1 -- 172.21.15.146:0/6287335 shutdown_connections 2023-10-03T10:16:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.795+0000 7f28b0cf5700 1 --2- 172.21.15.146:0/6287335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28ac137140 0x7f28ac11eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.795+0000 7f28b0cf5700 1 --2- 172.21.15.146:0/6287335 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f28ac06a770 0x7f28ac11e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.795+0000 7f28b0cf5700 1 --2- 172.21.15.146:0/6287335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28ac06b250 0x7f28ac11e990 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.795+0000 7f28b0cf5700 1 -- 172.21.15.146:0/6287335 >> 172.21.15.146:0/6287335 conn(0x7f28ac099c40 msgr2=0x7f28ac0a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.796+0000 7f28b0cf5700 1 -- 172.21.15.146:0/6287335 shutdown_connections 2023-10-03T10:16:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.796+0000 7f28b0cf5700 1 -- 172.21.15.146:0/6287335 wait complete. 2023-10-03T10:16:45.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:45.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.820+0000 7f008aaeb700 1 -- 172.21.15.146:0/3119372768 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f008411f760 con 0x7f00840a1380 2023-10-03T10:16:45.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.820+0000 7f00817fa700 1 -- 172.21.15.146:0/3119372768 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f00700193b0 con 0x7f00840a1380 2023-10-03T10:16:45.821 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:45.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.822+0000 7f008aaeb700 1 -- 172.21.15.146:0/3119372768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00840a1380 msgr2=0x7f00841228d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.822+0000 7f008aaeb700 1 --2- 172.21.15.146:0/3119372768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00840a1380 0x7f00841228d0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f0070016000 tx=0x7f0070004750 comp rx=0 tx=0).stop 2023-10-03T10:16:45.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.822+0000 7f008aaeb700 1 -- 172.21.15.146:0/3119372768 shutdown_connections 2023-10-03T10:16:45.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.822+0000 7f008aaeb700 1 --2- 172.21.15.146:0/3119372768 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0084133f50 0x7f0084122e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.822+0000 7f008aaeb700 1 --2- 172.21.15.146:0/3119372768 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00840a0a70 0x7f0084122390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.822+0000 7f008aaeb700 1 --2- 172.21.15.146:0/3119372768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00840a1380 0x7f00841228d0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.822+0000 7f008aaeb700 1 -- 172.21.15.146:0/3119372768 >> 172.21.15.146:0/3119372768 conn(0x7f00840a6610 msgr2=0x7f008411c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.822+0000 7f008aaeb700 1 -- 172.21.15.146:0/3119372768 shutdown_connections 2023-10-03T10:16:45.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:45.822+0000 7f008aaeb700 1 -- 172.21.15.146:0/3119372768 wait complete. 2023-10-03T10:16:45.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:46.447 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:46.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11fa6f700 1 Processor -- start 2023-10-03T10:16:46.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11fa6f700 1 -- start start 2023-10-03T10:16:46.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11fa6f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb118099e20 0x7fb11809a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11fa6f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb11809a730 0x7fb118130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11fa6f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb118099a60 con 0x7fb118130890 2023-10-03T10:16:46.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11fa6f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11809bf50 con 0x7fb118099e20 2023-10-03T10:16:46.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11fa6f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb11809b230 con 0x7fb11809a730 2023-10-03T10:16:46.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11d80b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb118099e20 0x7fb11809a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11d00a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb11809a730 0x7fb118130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11d80b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb118099e20 0x7fb11809a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56296/0 (socket says 172.21.15.146:56296) 2023-10-03T10:16:46.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11d00a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb11809a730 0x7fb118130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57328/0 (socket says 172.21.15.146:57328) 2023-10-03T10:16:46.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11d80b700 1 -- 172.21.15.146:0/1271034215 learned_addr learned my addr 172.21.15.146:0/1271034215 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:46.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11c809700 1 -- 172.21.15.146:0/1271034215 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547313557 0 0) 0x7fb118099a60 con 0x7fb118130890 2023-10-03T10:16:46.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11c809700 1 -- 172.21.15.146:0/1271034215 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1040035b0 con 0x7fb118130890 2023-10-03T10:16:46.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11d00a700 1 -- 172.21.15.146:0/1271034215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb118099e20 msgr2=0x7fb11809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11d00a700 1 --2- 172.21.15.146:0/1271034215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb118099e20 0x7fb11809a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11d00a700 1 -- 172.21.15.146:0/1271034215 >> v1:172.21.15.146:6789/0 conn(0x7fb118130890 legacy=0x7fb118137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11d00a700 1 -- 172.21.15.146:0/1271034215 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11809bb90 con 0x7fb11809a730 2023-10-03T10:16:46.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11d80b700 1 --2- 172.21.15.146:0/1271034215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb118099e20 0x7fb11809a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11d00a700 1 --2- 172.21.15.146:0/1271034215 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb11809a730 0x7fb118130350 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb1080098a0 tx=0x7fb108009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de6f45793cbab646 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11c809700 1 -- 172.21.15.146:0/1271034215 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb108011830 con 0x7fb11809a730 2023-10-03T10:16:46.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11c809700 1 -- 172.21.15.146:0/1271034215 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb108011990 con 0x7fb11809a730 2023-10-03T10:16:46.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.575+0000 7fb11c809700 1 -- 172.21.15.146:0/1271034215 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb108011d20 con 0x7fb11809a730 2023-10-03T10:16:46.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.576+0000 7fb11fa6f700 1 -- 172.21.15.146:0/1271034215 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb11809a730 msgr2=0x7fb118130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.576+0000 7fb11fa6f700 1 --2- 172.21.15.146:0/1271034215 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb11809a730 0x7fb118130350 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb1080098a0 tx=0x7fb108009bb0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.576+0000 7fb11fa6f700 1 -- 172.21.15.146:0/1271034215 shutdown_connections 2023-10-03T10:16:46.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.576+0000 7fb11fa6f700 1 --2- 172.21.15.146:0/1271034215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb118099e20 0x7fb11809a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.576+0000 7fb11fa6f700 1 --2- 172.21.15.146:0/1271034215 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb11809a730 0x7fb118130350 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.576+0000 7fb11fa6f700 1 -- 172.21.15.146:0/1271034215 >> 172.21.15.146:0/1271034215 conn(0x7fb1180a2980 msgr2=0x7fb1180a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.576+0000 7fb11fa6f700 1 -- 172.21.15.146:0/1271034215 shutdown_connections 2023-10-03T10:16:46.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.576+0000 7fb11fa6f700 1 -- 172.21.15.146:0/1271034215 wait complete. 2023-10-03T10:16:46.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.577+0000 7fb11fa6f700 1 Processor -- start 2023-10-03T10:16:46.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.577+0000 7fb11fa6f700 1 -- start start 2023-10-03T10:16:46.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.578+0000 7fb11fa6f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb118099e20 0x7fb11811e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.578+0000 7fb11fa6f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb11809a730 0x7fb11811eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.578+0000 7fb11fa6f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb118130890 0x7fb11811f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.578+0000 7fb11fa6f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb118121490 con 0x7fb11809a730 2023-10-03T10:16:46.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.578+0000 7fb11fa6f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11811fd40 con 0x7fb118130890 2023-10-03T10:16:46.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.578+0000 7fb11fa6f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb11809b470 con 0x7fb118099e20 2023-10-03T10:16:46.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.578+0000 7fb11d80b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb118099e20 0x7fb11811e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.578+0000 7fb11d80b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb118099e20 0x7fb11811e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57340/0 (socket says 172.21.15.146:57340) 2023-10-03T10:16:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.578+0000 7fb11e00c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb118130890 0x7fb11811f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.578+0000 7fb11d80b700 1 -- 172.21.15.146:0/2263926145 learned_addr learned my addr 172.21.15.146:0/2263926145 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.578+0000 7fb11d00a700 1 --2- 172.21.15.146:0/2263926145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb11809a730 0x7fb11811eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.578+0000 7fb11d80b700 1 -- 172.21.15.146:0/2263926145 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb118130890 msgr2=0x7fb11811f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.578+0000 7fb11d80b700 1 --2- 172.21.15.146:0/2263926145 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb118130890 0x7fb11811f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.578+0000 7fb11d80b700 1 -- 172.21.15.146:0/2263926145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb11809a730 msgr2=0x7fb11811eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.578+0000 7fb11d80b700 1 --2- 172.21.15.146:0/2263926145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb11809a730 0x7fb11811eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.578+0000 7fb11d80b700 1 -- 172.21.15.146:0/2263926145 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11400b7a0 con 0x7fb118099e20 2023-10-03T10:16:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.578+0000 7fb11d80b700 1 --2- 172.21.15.146:0/2263926145 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb118099e20 0x7fb11811e970 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb11400ed40 tx=0x7fb11400d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.578+0000 7fb10e7fc700 1 -- 172.21.15.146:0/2263926145 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11400dd30 con 0x7fb118099e20 2023-10-03T10:16:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.578+0000 7fb10e7fc700 1 -- 172.21.15.146:0/2263926145 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11400de90 con 0x7fb118099e20 2023-10-03T10:16:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.578+0000 7fb11fa6f700 1 -- 172.21.15.146:0/2263926145 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1080094a0 con 0x7fb118099e20 2023-10-03T10:16:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.578+0000 7fb10e7fc700 1 -- 172.21.15.146:0/2263926145 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb114005c60 con 0x7fb118099e20 2023-10-03T10:16:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.578+0000 7fb11fa6f700 1 -- 172.21.15.146:0/2263926145 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb118120d70 con 0x7fb118099e20 2023-10-03T10:16:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.579+0000 7fb10e7fc700 1 -- 172.21.15.146:0/2263926145 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb114006030 con 0x7fb118099e20 2023-10-03T10:16:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.579+0000 7fb10e7fc700 1 -- 172.21.15.146:0/2263926145 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb11403fbf0 con 0x7fb118099e20 2023-10-03T10:16:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.579+0000 7fb11fa6f700 1 -- 172.21.15.146:0/2263926145 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb11804f2a0 con 0x7fb118099e20 2023-10-03T10:16:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.584+0000 7fb10e7fc700 1 -- 172.21.15.146:0/2263926145 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb11401d080 con 0x7fb118099e20 2023-10-03T10:16:46.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.767+0000 7fb11fa6f700 1 -- 172.21.15.146:0/2263926145 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb11806bce0 con 0x7fb118099e20 2023-10-03T10:16:46.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.768+0000 7fb10e7fc700 1 -- 172.21.15.146:0/2263926145 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb114010440 con 0x7fb118099e20 2023-10-03T10:16:46.768 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:46.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.769+0000 7fb11fa6f700 1 -- 172.21.15.146:0/2263926145 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb118099e20 msgr2=0x7fb11811e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.769+0000 7fb11fa6f700 1 --2- 172.21.15.146:0/2263926145 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb118099e20 0x7fb11811e970 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb11400ed40 tx=0x7fb11400d630 comp rx=0 tx=0).stop 2023-10-03T10:16:46.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.769+0000 7fb11fa6f700 1 -- 172.21.15.146:0/2263926145 shutdown_connections 2023-10-03T10:16:46.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.770+0000 7fb11fa6f700 1 --2- 172.21.15.146:0/2263926145 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb118130890 0x7fb11811f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.770+0000 7fb11fa6f700 1 --2- 172.21.15.146:0/2263926145 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb118099e20 0x7fb11811e970 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.770+0000 7fb11fa6f700 1 --2- 172.21.15.146:0/2263926145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb11809a730 0x7fb11811eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.770+0000 7fb11fa6f700 1 -- 172.21.15.146:0/2263926145 >> 172.21.15.146:0/2263926145 conn(0x7fb1180a2980 msgr2=0x7fb11812d590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.770+0000 7fb11fa6f700 1 -- 172.21.15.146:0/2263926145 shutdown_connections 2023-10-03T10:16:46.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.770+0000 7fb11fa6f700 1 -- 172.21.15.146:0/2263926145 wait complete. 2023-10-03T10:16:46.782 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:46.787 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:46.809 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:46.836 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.915+0000 7fc8f03bf700 1 Processor -- start 2023-10-03T10:16:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.915+0000 7fc8f03bf700 1 -- start start 2023-10-03T10:16:46.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.916+0000 7fc8f03bf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8e8099e20 0x7fc8e809a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.916+0000 7fc8f03bf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8e8130a60 0x7fc8e8138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.916+0000 7fc8f03bf700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e8099a60 con 0x7fc8e809a730 2023-10-03T10:16:46.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.916+0000 7fc8f03bf700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e809bf50 con 0x7fc8e8130a60 2023-10-03T10:16:46.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.916+0000 7fc8f03bf700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e809b230 con 0x7fc8e8099e20 2023-10-03T10:16:46.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.916+0000 7fc8ee15b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8e8099e20 0x7fc8e809a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.916+0000 7fc8ee15b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8e8099e20 0x7fc8e809a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56310/0 (socket says 172.21.15.146:56310) 2023-10-03T10:16:46.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.916+0000 7fc8ed95a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc8e809a730 0x7fc8e8130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52712/0 (socket says 172.21.15.146:52712) 2023-10-03T10:16:46.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.916+0000 7fc8ee15b700 1 -- 172.21.15.146:0/2630912822 learned_addr learned my addr 172.21.15.146:0/2630912822 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:46.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.916+0000 7fc8ee95c700 1 --2- 172.21.15.146:0/2630912822 >> v2:172.21.15.146:3300/0 conn(0x7fc8e8130a60 0x7fc8e8138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.916+0000 7fc8ed159700 1 -- 172.21.15.146:0/2630912822 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516444308 0 0) 0x7fc8e8099a60 con 0x7fc8e809a730 2023-10-03T10:16:46.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.916+0000 7fc8ee15b700 1 -- 172.21.15.146:0/2630912822 >> v2:172.21.15.146:3300/0 conn(0x7fc8e8130a60 msgr2=0x7fc8e8138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.916+0000 7fc8ee15b700 1 --2- 172.21.15.146:0/2630912822 >> v2:172.21.15.146:3300/0 conn(0x7fc8e8130a60 0x7fc8e8138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.916+0000 7fc8ee15b700 1 -- 172.21.15.146:0/2630912822 >> v1:172.21.15.146:6789/0 conn(0x7fc8e809a730 legacy=0x7fc8e8130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.916+0000 7fc8ee15b700 1 -- 172.21.15.146:0/2630912822 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e809bb90 con 0x7fc8e8099e20 2023-10-03T10:16:46.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.917+0000 7fc8ee15b700 1 --2- 172.21.15.146:0/2630912822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8e8099e20 0x7fc8e809a1f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4006fd0 tx=0x7fc8e400bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36372976e62a9c4f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.917+0000 7fc8ed159700 1 -- 172.21.15.146:0/2630912822 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4005e30 con 0x7fc8e8099e20 2023-10-03T10:16:46.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.917+0000 7fc8ed159700 1 -- 172.21.15.146:0/2630912822 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e4004030 con 0x7fc8e8099e20 2023-10-03T10:16:46.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.917+0000 7fc8ed159700 1 -- 172.21.15.146:0/2630912822 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e40043e0 con 0x7fc8e8099e20 2023-10-03T10:16:46.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.917+0000 7fc8f03bf700 1 -- 172.21.15.146:0/2630912822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8e8099e20 msgr2=0x7fc8e809a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.917+0000 7fc8f03bf700 1 --2- 172.21.15.146:0/2630912822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8e8099e20 0x7fc8e809a1f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4006fd0 tx=0x7fc8e400bc80 comp rx=0 tx=0).stop 2023-10-03T10:16:46.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.918+0000 7fc8f03bf700 1 -- 172.21.15.146:0/2630912822 shutdown_connections 2023-10-03T10:16:46.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.918+0000 7fc8f03bf700 1 --2- 172.21.15.146:0/2630912822 >> v2:172.21.15.146:3300/0 conn(0x7fc8e8130a60 0x7fc8e8138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.918+0000 7fc8f03bf700 1 --2- 172.21.15.146:0/2630912822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8e8099e20 0x7fc8e809a1f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.918+0000 7fc8f03bf700 1 -- 172.21.15.146:0/2630912822 >> 172.21.15.146:0/2630912822 conn(0x7fc8e80a2980 msgr2=0x7fc8e80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.918+0000 7fc8f03bf700 1 -- 172.21.15.146:0/2630912822 shutdown_connections 2023-10-03T10:16:46.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.918+0000 7fc8f03bf700 1 -- 172.21.15.146:0/2630912822 wait complete. 2023-10-03T10:16:46.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.918+0000 7fc8f03bf700 1 Processor -- start 2023-10-03T10:16:46.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.919+0000 7fc8f03bf700 1 -- start start 2023-10-03T10:16:46.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.919+0000 7fc8f03bf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8e8099e20 0x7fc8e811a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.919+0000 7fc8f03bf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8e809a730 0x7fc8e811ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.919+0000 7fc8f03bf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8e8130a60 0x7fc8e811b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.919+0000 7fc8f03bf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e811d240 con 0x7fc8e8130a60 2023-10-03T10:16:46.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.919+0000 7fc8f03bf700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e80a1290 con 0x7fc8e8099e20 2023-10-03T10:16:46.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.919+0000 7fc8f03bf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e809b470 con 0x7fc8e809a730 2023-10-03T10:16:46.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.919+0000 7fc8ee95c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8e8130a60 0x7fc8e811b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.919+0000 7fc8ed95a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8e809a730 0x7fc8e811ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.919+0000 7fc8ee95c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8e8130a60 0x7fc8e811b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58244/0 (socket says 172.21.15.146:58244) 2023-10-03T10:16:46.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.919+0000 7fc8ee95c700 1 -- 172.21.15.146:0/49700198 learned_addr learned my addr 172.21.15.146:0/49700198 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:46.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.919+0000 7fc8ee15b700 1 --2- 172.21.15.146:0/49700198 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8e8099e20 0x7fc8e811a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.919+0000 7fc8ee95c700 1 -- 172.21.15.146:0/49700198 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8e809a730 msgr2=0x7fc8e811ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.919+0000 7fc8ee95c700 1 --2- 172.21.15.146:0/49700198 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8e809a730 0x7fc8e811ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.919+0000 7fc8ee95c700 1 -- 172.21.15.146:0/49700198 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8e8099e20 msgr2=0x7fc8e811a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.919+0000 7fc8ee95c700 1 --2- 172.21.15.146:0/49700198 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8e8099e20 0x7fc8e811a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.919+0000 7fc8ee95c700 1 -- 172.21.15.146:0/49700198 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e400b5b0 con 0x7fc8e8130a60 2023-10-03T10:16:46.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.919+0000 7fc8ed95a700 1 --2- 172.21.15.146:0/49700198 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8e809a730 0x7fc8e811ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.920+0000 7fc8ee95c700 1 --2- 172.21.15.146:0/49700198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8e8130a60 0x7fc8e811b3d0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00117b0 tx=0x7fc8e0011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.920+0000 7fc8deffd700 1 -- 172.21.15.146:0/49700198 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0013020 con 0x7fc8e8130a60 2023-10-03T10:16:46.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.920+0000 7fc8deffd700 1 -- 172.21.15.146:0/49700198 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e0013180 con 0x7fc8e8130a60 2023-10-03T10:16:46.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.920+0000 7fc8deffd700 1 -- 172.21.15.146:0/49700198 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e00108a0 con 0x7fc8e8130a60 2023-10-03T10:16:46.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.920+0000 7fc8f03bf700 1 -- 172.21.15.146:0/49700198 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e811c470 con 0x7fc8e8130a60 2023-10-03T10:16:46.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.920+0000 7fc8f03bf700 1 -- 172.21.15.146:0/49700198 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e811cbc0 con 0x7fc8e8130a60 2023-10-03T10:16:46.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.921+0000 7fc8f03bf700 1 -- 172.21.15.146:0/49700198 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e8072480 con 0x7fc8e8130a60 2023-10-03T10:16:46.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.922+0000 7fc8deffd700 1 -- 172.21.15.146:0/49700198 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc8e0010a00 con 0x7fc8e8130a60 2023-10-03T10:16:46.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.922+0000 7fc8deffd700 1 -- 172.21.15.146:0/49700198 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc8e00451e0 con 0x7fc8e8130a60 2023-10-03T10:16:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.926+0000 7fc8deffd700 1 -- 172.21.15.146:0/49700198 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8e000fda0 con 0x7fc8e8130a60 2023-10-03T10:16:46.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.959+0000 7ff2aa0c1700 1 Processor -- start 2023-10-03T10:16:46.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.959+0000 7ff2aa0c1700 1 -- start start 2023-10-03T10:16:46.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.960+0000 7ff2aa0c1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2a40a1550 0x7ff2a4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.960+0000 7ff2aa0c1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff2a4139200 0x7ff2a413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.960+0000 7ff2aa0c1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a409e9d0 con 0x7ff2a40a0a70 2023-10-03T10:16:46.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.960+0000 7ff2aa0c1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a409dc00 con 0x7ff2a4139200 2023-10-03T10:16:46.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.960+0000 7ff2aa0c1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a409dec0 con 0x7ff2a40a1550 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.960+0000 7ff2a2ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2a40a1550 0x7ff2a4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.960+0000 7ff2a2ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2a40a1550 0x7ff2a4138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56328/0 (socket says 172.21.15.146:56328) 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.960+0000 7ff2a2ffd700 1 -- 172.21.15.146:0/226892936 learned_addr learned my addr 172.21.15.146:0/226892936 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.960+0000 7ff2a3fff700 1 --2- 172.21.15.146:0/226892936 >> v2:172.21.15.146:3300/0 conn(0x7ff2a4139200 0x7ff2a413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.960+0000 7ff2a3fff700 1 -- 172.21.15.146:0/226892936 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2a40a1550 msgr2=0x7ff2a4138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.960+0000 7ff2a3fff700 1 --2- 172.21.15.146:0/226892936 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2a40a1550 0x7ff2a4138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.960+0000 7ff2a3fff700 1 -- 172.21.15.146:0/226892936 >> v1:172.21.15.146:6789/0 conn(0x7ff2a40a0a70 legacy=0x7ff2a40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.960+0000 7ff2a3fff700 1 -- 172.21.15.146:0/226892936 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a409e6a0 con 0x7ff2a4139200 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.960+0000 7ff2a3fff700 1 --2- 172.21.15.146:0/226892936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2a4139200 0x7ff2a413b5e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009d90 tx=0x7ff29c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b4a4a078797293 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.960+0000 7ff2a27fc700 1 -- 172.21.15.146:0/226892936 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c00e070 con 0x7ff2a4139200 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.960+0000 7ff2a27fc700 1 -- 172.21.15.146:0/226892936 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29c00bb20 con 0x7ff2a4139200 2023-10-03T10:16:46.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.960+0000 7ff2a27fc700 1 -- 172.21.15.146:0/226892936 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c012430 con 0x7ff2a4139200 2023-10-03T10:16:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.961+0000 7ff2aa0c1700 1 -- 172.21.15.146:0/226892936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2a4139200 msgr2=0x7ff2a413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.961+0000 7ff2aa0c1700 1 --2- 172.21.15.146:0/226892936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2a4139200 0x7ff2a413b5e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009d90 tx=0x7ff29c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.961+0000 7ff2aa0c1700 1 -- 172.21.15.146:0/226892936 shutdown_connections 2023-10-03T10:16:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.961+0000 7ff2aa0c1700 1 --2- 172.21.15.146:0/226892936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2a4139200 0x7ff2a413b5e0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.961+0000 7ff2aa0c1700 1 --2- 172.21.15.146:0/226892936 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2a40a1550 0x7ff2a4138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.961+0000 7ff2aa0c1700 1 -- 172.21.15.146:0/226892936 >> 172.21.15.146:0/226892936 conn(0x7ff2a40a6610 msgr2=0x7ff2a40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.961+0000 7ff2aa0c1700 1 -- 172.21.15.146:0/226892936 shutdown_connections 2023-10-03T10:16:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.961+0000 7ff2aa0c1700 1 -- 172.21.15.146:0/226892936 wait complete. 2023-10-03T10:16:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.962+0000 7ff2aa0c1700 1 Processor -- start 2023-10-03T10:16:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.962+0000 7ff2aa0c1700 1 -- start start 2023-10-03T10:16:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.963+0000 7ff2aa0c1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2a40a0a70 0x7ff2a411e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.963+0000 7ff2aa0c1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff2a40a1550 0x7ff2a411ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.963+0000 7ff2aa0c1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2a4139200 0x7ff2a411f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.963+0000 7ff2aa0c1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a4122290 con 0x7ff2a4139200 2023-10-03T10:16:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.963+0000 7ff2aa0c1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a4121a40 con 0x7ff2a40a0a70 2023-10-03T10:16:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.963+0000 7ff2aa0c1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a40a5100 con 0x7ff2a40a1550 2023-10-03T10:16:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.963+0000 7ff2a37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2a40a0a70 0x7ff2a411e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.963+0000 7ff2a37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2a40a0a70 0x7ff2a411e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56334/0 (socket says 172.21.15.146:56334) 2023-10-03T10:16:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.963+0000 7ff2a37fe700 1 -- 172.21.15.146:0/3074300107 learned_addr learned my addr 172.21.15.146:0/3074300107 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.963+0000 7ff2a3fff700 1 --2- 172.21.15.146:0/3074300107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2a4139200 0x7ff2a411f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.963+0000 7ff2a2ffd700 1 --2- 172.21.15.146:0/3074300107 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff2a40a1550 0x7ff2a411ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.963+0000 7ff2a37fe700 1 -- 172.21.15.146:0/3074300107 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff2a40a1550 msgr2=0x7ff2a411ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.963+0000 7ff2a37fe700 1 --2- 172.21.15.146:0/3074300107 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff2a40a1550 0x7ff2a411ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.963+0000 7ff2a37fe700 1 -- 172.21.15.146:0/3074300107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2a4139200 msgr2=0x7ff2a411f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.963+0000 7ff2a37fe700 1 --2- 172.21.15.146:0/3074300107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2a4139200 0x7ff2a411f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.963+0000 7ff2a37fe700 1 -- 172.21.15.146:0/3074300107 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c009a70 con 0x7ff2a40a0a70 2023-10-03T10:16:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.963+0000 7ff2a3fff700 1 --2- 172.21.15.146:0/3074300107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2a4139200 0x7ff2a411f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.963+0000 7ff2a37fe700 1 --2- 172.21.15.146:0/3074300107 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2a40a0a70 0x7ff2a411e7c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff29400c4e0 tx=0x7ff29400c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.963+0000 7ff28bfff700 1 -- 172.21.15.146:0/3074300107 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2940052d0 con 0x7ff2a40a0a70 2023-10-03T10:16:46.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.964+0000 7ff28bfff700 1 -- 172.21.15.146:0/3074300107 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff294005430 con 0x7ff2a40a0a70 2023-10-03T10:16:46.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.964+0000 7ff2aa0c1700 1 -- 172.21.15.146:0/3074300107 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a4120be0 con 0x7ff2a40a0a70 2023-10-03T10:16:46.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.964+0000 7ff28bfff700 1 -- 172.21.15.146:0/3074300107 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2940038c0 con 0x7ff2a40a0a70 2023-10-03T10:16:46.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.964+0000 7ff2aa0c1700 1 -- 172.21.15.146:0/3074300107 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a41203e0 con 0x7ff2a40a0a70 2023-10-03T10:16:46.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.964+0000 7ff2aa0c1700 1 -- 172.21.15.146:0/3074300107 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a4121db0 con 0x7ff2a40a0a70 2023-10-03T10:16:46.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.965+0000 7ff28bfff700 1 -- 172.21.15.146:0/3074300107 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff294003a20 con 0x7ff2a40a0a70 2023-10-03T10:16:46.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.965+0000 7ff28bfff700 1 -- 172.21.15.146:0/3074300107 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff29403ed20 con 0x7ff2a40a0a70 2023-10-03T10:16:46.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:46.969+0000 7ff28bfff700 1 -- 172.21.15.146:0/3074300107 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff294011590 con 0x7ff2a40a0a70 2023-10-03T10:16:46.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.000+0000 7eff04ee7700 1 Processor -- start 2023-10-03T10:16:46.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.000+0000 7eff04ee7700 1 -- start start 2023-10-03T10:16:47.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.001+0000 7eff04ee7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff0012feb0 0x7eff00130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.001+0000 7eff04ee7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff001307c0 0x7eff000993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.001+0000 7eff04ee7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0009a540 con 0x7eff00099920 2023-10-03T10:16:47.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.001+0000 7eff04ee7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0009ad40 con 0x7eff0012feb0 2023-10-03T10:16:47.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.001+0000 7eff04ee7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff0009e640 con 0x7eff001307c0 2023-10-03T10:16:47.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.001+0000 7efefe59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff0012feb0 0x7eff00130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.001+0000 7efefdd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff001307c0 0x7eff000993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.001+0000 7efefed9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7eff00099920 0x7eff00136e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52728/0 (socket says 172.21.15.146:52728) 2023-10-03T10:16:47.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.001+0000 7efefe59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff0012feb0 0x7eff00130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56344/0 (socket says 172.21.15.146:56344) 2023-10-03T10:16:47.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.001+0000 7efefed9d700 1 -- 172.21.15.146:0/991209980 learned_addr learned my addr 172.21.15.146:0/991209980 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:47.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.001+0000 7efefd59a700 1 -- 172.21.15.146:0/991209980 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117607468 0 0) 0x7eff0009a540 con 0x7eff00099920 2023-10-03T10:16:47.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.001+0000 7efefd59a700 1 -- 172.21.15.146:0/991209980 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efee80035b0 con 0x7eff00099920 2023-10-03T10:16:47.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.001+0000 7efefe59c700 1 -- 172.21.15.146:0/991209980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff001307c0 msgr2=0x7eff000993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:47.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.001+0000 7efefe59c700 1 --2- 172.21.15.146:0/991209980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff001307c0 0x7eff000993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.001+0000 7efefe59c700 1 -- 172.21.15.146:0/991209980 >> v1:172.21.15.146:6789/0 conn(0x7eff00099920 legacy=0x7eff00136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.001+0000 7efefe59c700 1 -- 172.21.15.146:0/991209980 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0009e3c0 con 0x7eff0012feb0 2023-10-03T10:16:47.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.001+0000 7efefdd9b700 1 --2- 172.21.15.146:0/991209980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff001307c0 0x7eff000993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:47.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.001+0000 7efefe59c700 1 --2- 172.21.15.146:0/991209980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff0012feb0 0x7eff00130280 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7efef000b900 tx=0x7efef000bc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a4e2c1cbb2d0b06 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.001+0000 7efefd59a700 1 -- 172.21.15.146:0/991209980 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef0005e30 con 0x7eff0012feb0 2023-10-03T10:16:47.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.002+0000 7efefd59a700 1 -- 172.21.15.146:0/991209980 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef000c620 con 0x7eff0012feb0 2023-10-03T10:16:47.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.002+0000 7efefd59a700 1 -- 172.21.15.146:0/991209980 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef000c990 con 0x7eff0012feb0 2023-10-03T10:16:47.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.002+0000 7eff04ee7700 1 -- 172.21.15.146:0/991209980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff0012feb0 msgr2=0x7eff00130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.002+0000 7eff04ee7700 1 --2- 172.21.15.146:0/991209980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff0012feb0 0x7eff00130280 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7efef000b900 tx=0x7efef000bc10 comp rx=0 tx=0).stop 2023-10-03T10:16:47.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.002+0000 7eff04ee7700 1 -- 172.21.15.146:0/991209980 shutdown_connections 2023-10-03T10:16:47.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.002+0000 7eff04ee7700 1 --2- 172.21.15.146:0/991209980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff0012feb0 0x7eff00130280 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.002+0000 7eff04ee7700 1 --2- 172.21.15.146:0/991209980 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff001307c0 0x7eff000993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.002+0000 7eff04ee7700 1 -- 172.21.15.146:0/991209980 >> 172.21.15.146:0/991209980 conn(0x7eff000a2b30 msgr2=0x7eff0009e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.002+0000 7eff04ee7700 1 -- 172.21.15.146:0/991209980 shutdown_connections 2023-10-03T10:16:47.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.002+0000 7eff04ee7700 1 -- 172.21.15.146:0/991209980 wait complete. 2023-10-03T10:16:47.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.003+0000 7eff04ee7700 1 Processor -- start 2023-10-03T10:16:47.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.003+0000 7eff04ee7700 1 -- start start 2023-10-03T10:16:47.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.004+0000 7eff04ee7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff00099920 0x7eff0006eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.004+0000 7eff04ee7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff0012feb0 0x7eff0006f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.004+0000 7eff04ee7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff001307c0 0x7eff0006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.004+0000 7eff04ee7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0008b850 con 0x7eff001307c0 2023-10-03T10:16:47.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.004+0000 7eff04ee7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0009fde0 con 0x7eff00099920 2023-10-03T10:16:47.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.004+0000 7eff04ee7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff0012a250 con 0x7eff0012feb0 2023-10-03T10:16:47.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.004+0000 7efefdd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff0012feb0 0x7eff0006f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.004+0000 7efefed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff001307c0 0x7eff0006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.004+0000 7efefdd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff0012feb0 0x7eff0006f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57374/0 (socket says 172.21.15.146:57374) 2023-10-03T10:16:47.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.004+0000 7efefdd9b700 1 -- 172.21.15.146:0/1647550548 learned_addr learned my addr 172.21.15.146:0/1647550548 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:47.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.004+0000 7efefe59c700 1 --2- 172.21.15.146:0/1647550548 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff00099920 0x7eff0006eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.004+0000 7efefdd9b700 1 -- 172.21.15.146:0/1647550548 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff00099920 msgr2=0x7eff0006eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.004+0000 7efefdd9b700 1 --2- 172.21.15.146:0/1647550548 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff00099920 0x7eff0006eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.004+0000 7efefdd9b700 1 -- 172.21.15.146:0/1647550548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff001307c0 msgr2=0x7eff0006f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.004+0000 7efefdd9b700 1 --2- 172.21.15.146:0/1647550548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff001307c0 0x7eff0006f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.004+0000 7efefdd9b700 1 -- 172.21.15.146:0/1647550548 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef400d940 con 0x7eff0012feb0 2023-10-03T10:16:47.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.004+0000 7efefdd9b700 1 --2- 172.21.15.146:0/1647550548 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff0012feb0 0x7eff0006f050 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efef4012f90 tx=0x7efef40103a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.005+0000 7efeeeffd700 1 -- 172.21.15.146:0/1647550548 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef4010b00 con 0x7eff0012feb0 2023-10-03T10:16:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.005+0000 7efeeeffd700 1 -- 172.21.15.146:0/1647550548 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef4013040 con 0x7eff0012feb0 2023-10-03T10:16:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.005+0000 7eff04ee7700 1 -- 172.21.15.146:0/1647550548 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efef000b4e0 con 0x7eff0012feb0 2023-10-03T10:16:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.005+0000 7efeeeffd700 1 -- 172.21.15.146:0/1647550548 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef4010e80 con 0x7eff0012feb0 2023-10-03T10:16:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.005+0000 7eff04ee7700 1 -- 172.21.15.146:0/1647550548 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0008b2f0 con 0x7eff0012feb0 2023-10-03T10:16:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.006+0000 7efeeeffd700 1 -- 172.21.15.146:0/1647550548 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efef4018480 con 0x7eff0012feb0 2023-10-03T10:16:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.006+0000 7eff04ee7700 1 -- 172.21.15.146:0/1647550548 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0004f2a0 con 0x7eff0012feb0 2023-10-03T10:16:47.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.006+0000 7efeeeffd700 1 -- 172.21.15.146:0/1647550548 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efef4043690 con 0x7eff0012feb0 2023-10-03T10:16:47.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.010+0000 7efeeeffd700 1 -- 172.21.15.146:0/1647550548 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efef4016910 con 0x7eff0012feb0 2023-10-03T10:16:47.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.127+0000 7fc8f03bf700 1 -- 172.21.15.146:0/49700198 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc8e8072480 con 0x7fc8e8130a60 2023-10-03T10:16:47.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.127+0000 7fc8deffd700 1 -- 172.21.15.146:0/49700198 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc8e8072480 con 0x7fc8e8130a60 2023-10-03T10:16:47.127 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:47.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.130+0000 7fc8f03bf700 1 -- 172.21.15.146:0/49700198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8e8130a60 msgr2=0x7fc8e811b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.130+0000 7fc8f03bf700 1 --2- 172.21.15.146:0/49700198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8e8130a60 0x7fc8e811b3d0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00117b0 tx=0x7fc8e0011ac0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.130+0000 7fc8f03bf700 1 -- 172.21.15.146:0/49700198 shutdown_connections 2023-10-03T10:16:47.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.130+0000 7fc8f03bf700 1 --2- 172.21.15.146:0/49700198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8e8130a60 0x7fc8e811b3d0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.130+0000 7fc8f03bf700 1 --2- 172.21.15.146:0/49700198 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8e8099e20 0x7fc8e811a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.130+0000 7fc8f03bf700 1 --2- 172.21.15.146:0/49700198 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8e809a730 0x7fc8e811ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.130+0000 7fc8f03bf700 1 -- 172.21.15.146:0/49700198 >> 172.21.15.146:0/49700198 conn(0x7fc8e80a2980 msgr2=0x7fc8e812d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.130+0000 7fc8f03bf700 1 -- 172.21.15.146:0/49700198 shutdown_connections 2023-10-03T10:16:47.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.131+0000 7fc8f03bf700 1 -- 172.21.15.146:0/49700198 wait complete. 2023-10-03T10:16:47.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:47.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.168+0000 7ff2aa0c1700 1 -- 172.21.15.146:0/3074300107 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff2a41203e0 con 0x7ff2a40a0a70 2023-10-03T10:16:47.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.168+0000 7ff28bfff700 1 -- 172.21.15.146:0/3074300107 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff2a41203e0 con 0x7ff2a40a0a70 2023-10-03T10:16:47.168 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:47.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.170+0000 7ff2aa0c1700 1 -- 172.21.15.146:0/3074300107 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2a40a0a70 msgr2=0x7ff2a411e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.170+0000 7ff2aa0c1700 1 --2- 172.21.15.146:0/3074300107 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2a40a0a70 0x7ff2a411e7c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff29400c4e0 tx=0x7ff29400c7f0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.171+0000 7ff2aa0c1700 1 -- 172.21.15.146:0/3074300107 shutdown_connections 2023-10-03T10:16:47.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.171+0000 7ff2aa0c1700 1 --2- 172.21.15.146:0/3074300107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2a4139200 0x7ff2a411f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.171+0000 7ff2aa0c1700 1 --2- 172.21.15.146:0/3074300107 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2a40a0a70 0x7ff2a411e7c0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.171+0000 7ff2aa0c1700 1 --2- 172.21.15.146:0/3074300107 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff2a40a1550 0x7ff2a411ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.171+0000 7ff2aa0c1700 1 -- 172.21.15.146:0/3074300107 >> 172.21.15.146:0/3074300107 conn(0x7ff2a40a6610 msgr2=0x7ff2a40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.171+0000 7ff2aa0c1700 1 -- 172.21.15.146:0/3074300107 shutdown_connections 2023-10-03T10:16:47.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.171+0000 7ff2aa0c1700 1 -- 172.21.15.146:0/3074300107 wait complete. 2023-10-03T10:16:47.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:47.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.214+0000 7eff04ee7700 1 -- 172.21.15.146:0/1647550548 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7eff00071d70 con 0x7eff0012feb0 2023-10-03T10:16:47.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.215+0000 7efeeeffd700 1 -- 172.21.15.146:0/1647550548 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efef4017a80 con 0x7eff0012feb0 2023-10-03T10:16:47.214 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:47.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.217+0000 7eff04ee7700 1 -- 172.21.15.146:0/1647550548 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff0012feb0 msgr2=0x7eff0006f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.217+0000 7eff04ee7700 1 --2- 172.21.15.146:0/1647550548 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff0012feb0 0x7eff0006f050 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efef4012f90 tx=0x7efef40103a0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.217+0000 7eff04ee7700 1 -- 172.21.15.146:0/1647550548 shutdown_connections 2023-10-03T10:16:47.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.217+0000 7eff04ee7700 1 --2- 172.21.15.146:0/1647550548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff001307c0 0x7eff0006f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.217+0000 7eff04ee7700 1 --2- 172.21.15.146:0/1647550548 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff00099920 0x7eff0006eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.217+0000 7eff04ee7700 1 --2- 172.21.15.146:0/1647550548 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7eff0012feb0 0x7eff0006f050 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.217+0000 7eff04ee7700 1 -- 172.21.15.146:0/1647550548 >> 172.21.15.146:0/1647550548 conn(0x7eff000a2b30 msgr2=0x7eff0012a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.217+0000 7eff04ee7700 1 -- 172.21.15.146:0/1647550548 shutdown_connections 2023-10-03T10:16:47.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.217+0000 7eff04ee7700 1 -- 172.21.15.146:0/1647550548 wait complete. 2023-10-03T10:16:47.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:47.783 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:47.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.909+0000 7fd1fac73700 1 Processor -- start 2023-10-03T10:16:47.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.909+0000 7fd1fac73700 1 -- start start 2023-10-03T10:16:47.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.910+0000 7fd1fac73700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd1f406a770 0x7fd1f406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.910+0000 7fd1fac73700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1f406b080 0x7fd1f41317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.910+0000 7fd1fac73700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f409da80 con 0x7fd1f4131cf0 2023-10-03T10:16:47.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.910+0000 7fd1fac73700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f409dce0 con 0x7fd1f406a770 2023-10-03T10:16:47.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.910+0000 7fd1fac73700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f409eb20 con 0x7fd1f406b080 2023-10-03T10:16:47.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.910+0000 7fd1f3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1f406b080 0x7fd1f41317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.910+0000 7fd1f8a0f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd1f406a770 0x7fd1f406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.910+0000 7fd1f9210700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd1f4131cf0 0x7fd1f4138c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52742/0 (socket says 172.21.15.146:52742) 2023-10-03T10:16:47.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.910+0000 7fd1f9210700 1 -- 172.21.15.146:0/3083261007 learned_addr learned my addr 172.21.15.146:0/3083261007 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:47.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.910+0000 7fd1f37fe700 1 -- 172.21.15.146:0/3083261007 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 944661472 0 0) 0x7fd1f409da80 con 0x7fd1f4131cf0 2023-10-03T10:16:47.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.910+0000 7fd1f37fe700 1 -- 172.21.15.146:0/3083261007 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1e40035b0 con 0x7fd1f4131cf0 2023-10-03T10:16:47.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.910+0000 7fd1f3fff700 1 -- 172.21.15.146:0/3083261007 >> v2:172.21.15.146:3300/0 conn(0x7fd1f406a770 msgr2=0x7fd1f406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:47.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.910+0000 7fd1f3fff700 1 --2- 172.21.15.146:0/3083261007 >> v2:172.21.15.146:3300/0 conn(0x7fd1f406a770 0x7fd1f406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.910+0000 7fd1f3fff700 1 -- 172.21.15.146:0/3083261007 >> v1:172.21.15.146:6789/0 conn(0x7fd1f4131cf0 legacy=0x7fd1f4138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.910+0000 7fd1f3fff700 1 -- 172.21.15.146:0/3083261007 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f409d860 con 0x7fd1f406b080 2023-10-03T10:16:47.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.910+0000 7fd1f8a0f700 1 --2- 172.21.15.146:0/3083261007 >> v2:172.21.15.146:3300/0 conn(0x7fd1f406a770 0x7fd1f406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:47.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.910+0000 7fd1f3fff700 1 --2- 172.21.15.146:0/3083261007 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1f406b080 0x7fd1f41317b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0009840 tx=0x7fd1e0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d01003d15698b4f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.910+0000 7fd1f37fe700 1 -- 172.21.15.146:0/3083261007 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0011830 con 0x7fd1f406b080 2023-10-03T10:16:47.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.910+0000 7fd1f37fe700 1 -- 172.21.15.146:0/3083261007 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e0011990 con 0x7fd1f406b080 2023-10-03T10:16:47.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.910+0000 7fd1f37fe700 1 -- 172.21.15.146:0/3083261007 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0011d20 con 0x7fd1f406b080 2023-10-03T10:16:47.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.911+0000 7fd1fac73700 1 -- 172.21.15.146:0/3083261007 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1f406b080 msgr2=0x7fd1f41317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.911+0000 7fd1fac73700 1 --2- 172.21.15.146:0/3083261007 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1f406b080 0x7fd1f41317b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0009840 tx=0x7fd1e0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:47.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.911+0000 7fd1fac73700 1 -- 172.21.15.146:0/3083261007 shutdown_connections 2023-10-03T10:16:47.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.911+0000 7fd1fac73700 1 --2- 172.21.15.146:0/3083261007 >> v2:172.21.15.146:3300/0 conn(0x7fd1f406a770 0x7fd1f406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.911+0000 7fd1fac73700 1 --2- 172.21.15.146:0/3083261007 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1f406b080 0x7fd1f41317b0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.911+0000 7fd1fac73700 1 -- 172.21.15.146:0/3083261007 >> 172.21.15.146:0/3083261007 conn(0x7fd1f4099c40 msgr2=0x7fd1f40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.911+0000 7fd1fac73700 1 -- 172.21.15.146:0/3083261007 shutdown_connections 2023-10-03T10:16:47.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.911+0000 7fd1fac73700 1 -- 172.21.15.146:0/3083261007 wait complete. 2023-10-03T10:16:47.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.912+0000 7fd1fac73700 1 Processor -- start 2023-10-03T10:16:47.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.912+0000 7fd1fac73700 1 -- start start 2023-10-03T10:16:47.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.912+0000 7fd1fac73700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1f406a770 0x7fd1f411d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.912+0000 7fd1fac73700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1f406b080 0x7fd1f411d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.912+0000 7fd1fac73700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1f4131cf0 0x7fd1f41c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.912+0000 7fd1fac73700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f4120280 con 0x7fd1f406b080 2023-10-03T10:16:47.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.912+0000 7fd1fac73700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f41310f0 con 0x7fd1f406a770 2023-10-03T10:16:47.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.912+0000 7fd1fac73700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f411cc40 con 0x7fd1f4131cf0 2023-10-03T10:16:47.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.912+0000 7fd1f3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1f406b080 0x7fd1f411d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.912+0000 7fd1f8a0f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1f406a770 0x7fd1f411d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.912+0000 7fd1f3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1f406b080 0x7fd1f411d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58294/0 (socket says 172.21.15.146:58294) 2023-10-03T10:16:47.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.912+0000 7fd1f8a0f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1f406a770 0x7fd1f411d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56384/0 (socket says 172.21.15.146:56384) 2023-10-03T10:16:47.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.912+0000 7fd1f3fff700 1 -- 172.21.15.146:0/1107956487 learned_addr learned my addr 172.21.15.146:0/1107956487 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:47.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.913+0000 7fd1f9210700 1 --2- 172.21.15.146:0/1107956487 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1f4131cf0 0x7fd1f41c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.913+0000 7fd1f8a0f700 1 -- 172.21.15.146:0/1107956487 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1f4131cf0 msgr2=0x7fd1f41c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.913+0000 7fd1f8a0f700 1 --2- 172.21.15.146:0/1107956487 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1f4131cf0 0x7fd1f41c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.913+0000 7fd1f8a0f700 1 -- 172.21.15.146:0/1107956487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1f406b080 msgr2=0x7fd1f411d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.913+0000 7fd1f8a0f700 1 --2- 172.21.15.146:0/1107956487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1f406b080 0x7fd1f411d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.913+0000 7fd1f8a0f700 1 -- 172.21.15.146:0/1107956487 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e80094a0 con 0x7fd1f406a770 2023-10-03T10:16:47.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.913+0000 7fd1f3fff700 1 --2- 172.21.15.146:0/1107956487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1f406b080 0x7fd1f411d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:47.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.913+0000 7fd1f8a0f700 1 --2- 172.21.15.146:0/1107956487 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1f406a770 0x7fd1f411d030 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8010cc0 tx=0x7fd1e800b140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.913+0000 7fd1f17fa700 1 -- 172.21.15.146:0/1107956487 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8015070 con 0x7fd1f406a770 2023-10-03T10:16:47.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.913+0000 7fd1f17fa700 1 -- 172.21.15.146:0/1107956487 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e800b9a0 con 0x7fd1f406a770 2023-10-03T10:16:47.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.913+0000 7fd1fac73700 1 -- 172.21.15.146:0/1107956487 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e00094a0 con 0x7fd1f406a770 2023-10-03T10:16:47.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.913+0000 7fd1f17fa700 1 -- 172.21.15.146:0/1107956487 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e800bd30 con 0x7fd1f406a770 2023-10-03T10:16:47.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.913+0000 7fd1fac73700 1 -- 172.21.15.146:0/1107956487 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f4071e60 con 0x7fd1f406a770 2023-10-03T10:16:47.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.914+0000 7fd1f17fa700 1 -- 172.21.15.146:0/1107956487 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd1e8019410 con 0x7fd1f406a770 2023-10-03T10:16:47.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.914+0000 7fd1f17fa700 1 -- 172.21.15.146:0/1107956487 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd1e8042f90 con 0x7fd1f406a770 2023-10-03T10:16:47.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.914+0000 7fd1fac73700 1 -- 172.21.15.146:0/1107956487 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f411e3d0 con 0x7fd1f406a770 2023-10-03T10:16:47.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:47.919+0000 7fd1f17fa700 1 -- 172.21.15.146:0/1107956487 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1e801e020 con 0x7fd1f406a770 2023-10-03T10:16:48.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.103+0000 7fd1fac73700 1 -- 172.21.15.146:0/1107956487 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd1f409e560 con 0x7fd1f406a770 2023-10-03T10:16:48.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.103+0000 7fd1f17fa700 1 -- 172.21.15.146:0/1107956487 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd1e8017900 con 0x7fd1f406a770 2023-10-03T10:16:48.103 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:48.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.105+0000 7fd1fac73700 1 -- 172.21.15.146:0/1107956487 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1f406a770 msgr2=0x7fd1f411d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.105+0000 7fd1fac73700 1 --2- 172.21.15.146:0/1107956487 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1f406a770 0x7fd1f411d030 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8010cc0 tx=0x7fd1e800b140 comp rx=0 tx=0).stop 2023-10-03T10:16:48.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.105+0000 7fd1fac73700 1 -- 172.21.15.146:0/1107956487 shutdown_connections 2023-10-03T10:16:48.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.105+0000 7fd1fac73700 1 --2- 172.21.15.146:0/1107956487 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1f4131cf0 0x7fd1f41c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.105+0000 7fd1fac73700 1 --2- 172.21.15.146:0/1107956487 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1f406a770 0x7fd1f411d030 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.105+0000 7fd1fac73700 1 --2- 172.21.15.146:0/1107956487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1f406b080 0x7fd1f411d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.105+0000 7fd1fac73700 1 -- 172.21.15.146:0/1107956487 >> 172.21.15.146:0/1107956487 conn(0x7fd1f4099c40 msgr2=0x7fd1f41b9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.105+0000 7fd1fac73700 1 -- 172.21.15.146:0/1107956487 shutdown_connections 2023-10-03T10:16:48.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.105+0000 7fd1fac73700 1 -- 172.21.15.146:0/1107956487 wait complete. 2023-10-03T10:16:48.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:48.148 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:48.182 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:48.229 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:48.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.276+0000 7f99c749e700 1 Processor -- start 2023-10-03T10:16:48.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.276+0000 7f99c749e700 1 -- start start 2023-10-03T10:16:48.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.277+0000 7f99c749e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99c0099e20 0x7f99c009a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.277+0000 7f99c749e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f99c009a730 0x7f99c0130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.277+0000 7f99c749e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c0099a60 con 0x7f99c0130890 2023-10-03T10:16:48.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.277+0000 7f99c749e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c009bf50 con 0x7f99c009a730 2023-10-03T10:16:48.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.277+0000 7f99c749e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99c009b230 con 0x7f99c0099e20 2023-10-03T10:16:48.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.277+0000 7f99c4a39700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f99c009a730 0x7f99c0130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.277+0000 7f99c4a39700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f99c009a730 0x7f99c0130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58298/0 (socket says 172.21.15.146:58298) 2023-10-03T10:16:48.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.277+0000 7f99c5a3b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f99c0130890 0x7f99c0137680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52752/0 (socket says 172.21.15.146:52752) 2023-10-03T10:16:48.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.277+0000 7f99c4a39700 1 -- 172.21.15.146:0/172860006 learned_addr learned my addr 172.21.15.146:0/172860006 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:48.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.277+0000 7f99c523a700 1 --2- 172.21.15.146:0/172860006 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99c0099e20 0x7f99c009a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.277+0000 7f99c4a39700 1 -- 172.21.15.146:0/172860006 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99c0099e20 msgr2=0x7f99c009a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:48.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.277+0000 7f99c4a39700 1 --2- 172.21.15.146:0/172860006 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99c0099e20 0x7f99c009a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.277+0000 7f99c4a39700 1 -- 172.21.15.146:0/172860006 >> v1:172.21.15.146:6789/0 conn(0x7f99c0130890 legacy=0x7f99c0137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.277+0000 7f99b7fff700 1 -- 172.21.15.146:0/172860006 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868450636 0 0) 0x7f99c0099a60 con 0x7f99c0130890 2023-10-03T10:16:48.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.277+0000 7f99c4a39700 1 -- 172.21.15.146:0/172860006 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c009bb90 con 0x7f99c009a730 2023-10-03T10:16:48.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.277+0000 7f99c523a700 1 --2- 172.21.15.146:0/172860006 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99c0099e20 0x7f99c009a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:48.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.277+0000 7f99c4a39700 1 --2- 172.21.15.146:0/172860006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99c009a730 0x7f99c0130350 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f99b000bb90 tx=0x7f99b000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e57102b9272fa8f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.278+0000 7f99b7fff700 1 -- 172.21.15.146:0/172860006 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b000dd30 con 0x7f99c009a730 2023-10-03T10:16:48.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.278+0000 7f99b7fff700 1 -- 172.21.15.146:0/172860006 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b000de90 con 0x7f99c009a730 2023-10-03T10:16:48.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.278+0000 7f99b7fff700 1 -- 172.21.15.146:0/172860006 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0010690 con 0x7f99c009a730 2023-10-03T10:16:48.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.278+0000 7f99c749e700 1 -- 172.21.15.146:0/172860006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99c009a730 msgr2=0x7f99c0130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.278+0000 7f99c749e700 1 --2- 172.21.15.146:0/172860006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99c009a730 0x7f99c0130350 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f99b000bb90 tx=0x7f99b000bea0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.279+0000 7f99c749e700 1 -- 172.21.15.146:0/172860006 shutdown_connections 2023-10-03T10:16:48.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.279+0000 7f99c749e700 1 --2- 172.21.15.146:0/172860006 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99c0099e20 0x7f99c009a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.279+0000 7f99c749e700 1 --2- 172.21.15.146:0/172860006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99c009a730 0x7f99c0130350 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.279+0000 7f99c749e700 1 -- 172.21.15.146:0/172860006 >> 172.21.15.146:0/172860006 conn(0x7f99c00a2980 msgr2=0x7f99c00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.279+0000 7f99c749e700 1 -- 172.21.15.146:0/172860006 shutdown_connections 2023-10-03T10:16:48.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.279+0000 7f99c749e700 1 -- 172.21.15.146:0/172860006 wait complete. 2023-10-03T10:16:48.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.280+0000 7f99c749e700 1 Processor -- start 2023-10-03T10:16:48.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.280+0000 7f99c749e700 1 -- start start 2023-10-03T10:16:48.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.280+0000 7f99c749e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99c0099e20 0x7f99c011ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.280+0000 7f99c749e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99c009a730 0x7f99c011ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.280+0000 7f99c749e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99c0130890 0x7f99c011f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.280+0000 7f99c749e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c011fee0 con 0x7f99c009a730 2023-10-03T10:16:48.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.280+0000 7f99c749e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c0121f90 con 0x7f99c0099e20 2023-10-03T10:16:48.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.280+0000 7f99c749e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99c0120e60 con 0x7f99c0130890 2023-10-03T10:16:48.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.280+0000 7f99c4a39700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99c009a730 0x7f99c011ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.280+0000 7f99c523a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99c0099e20 0x7f99c011ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.280+0000 7f99c4a39700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99c009a730 0x7f99c011ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58312/0 (socket says 172.21.15.146:58312) 2023-10-03T10:16:48.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.280+0000 7f99c4a39700 1 -- 172.21.15.146:0/4283442710 learned_addr learned my addr 172.21.15.146:0/4283442710 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:48.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.280+0000 7f99c523a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99c0099e20 0x7f99c011ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56386/0 (socket says 172.21.15.146:56386) 2023-10-03T10:16:48.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.280+0000 7f99c5a3b700 1 --2- 172.21.15.146:0/4283442710 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99c0130890 0x7f99c011f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.280+0000 7f99c4a39700 1 -- 172.21.15.146:0/4283442710 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99c0130890 msgr2=0x7f99c011f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.280+0000 7f99c4a39700 1 --2- 172.21.15.146:0/4283442710 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99c0130890 0x7f99c011f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.280+0000 7f99c4a39700 1 -- 172.21.15.146:0/4283442710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99c0099e20 msgr2=0x7f99c011ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.280+0000 7f99c4a39700 1 --2- 172.21.15.146:0/4283442710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99c0099e20 0x7f99c011ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.280+0000 7f99c4a39700 1 -- 172.21.15.146:0/4283442710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc009430 con 0x7f99c009a730 2023-10-03T10:16:48.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.281+0000 7f99c5a3b700 1 --2- 172.21.15.146:0/4283442710 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99c0130890 0x7f99c011f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:48.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.281+0000 7f99c523a700 1 --2- 172.21.15.146:0/4283442710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99c0099e20 0x7f99c011ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:48.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.281+0000 7f99c4a39700 1 --2- 172.21.15.146:0/4283442710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99c009a730 0x7f99c011ef50 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f99b0015000 tx=0x7f99b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.281+0000 7f99b5ffb700 1 -- 172.21.15.146:0/4283442710 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0003b70 con 0x7f99c009a730 2023-10-03T10:16:48.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.281+0000 7f99b5ffb700 1 -- 172.21.15.146:0/4283442710 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b0003cd0 con 0x7f99c009a730 2023-10-03T10:16:48.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.281+0000 7f99c749e700 1 -- 172.21.15.146:0/4283442710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b000b7f0 con 0x7f99c009a730 2023-10-03T10:16:48.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.281+0000 7f99b5ffb700 1 -- 172.21.15.146:0/4283442710 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0010690 con 0x7f99c009a730 2023-10-03T10:16:48.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.281+0000 7f99c749e700 1 -- 172.21.15.146:0/4283442710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c00a1250 con 0x7f99c009a730 2023-10-03T10:16:48.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.282+0000 7f99b5ffb700 1 -- 172.21.15.146:0/4283442710 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f99b0019400 con 0x7f99c009a730 2023-10-03T10:16:48.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.282+0000 7f99c749e700 1 -- 172.21.15.146:0/4283442710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c004f2a0 con 0x7f99c009a730 2023-10-03T10:16:48.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.282+0000 7f99b5ffb700 1 -- 172.21.15.146:0/4283442710 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f99b0041030 con 0x7f99c009a730 2023-10-03T10:16:48.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.287+0000 7f99b5ffb700 1 -- 172.21.15.146:0/4283442710 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99b0003e40 con 0x7f99c009a730 2023-10-03T10:16:48.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.321+0000 7fe6a543c700 1 Processor -- start 2023-10-03T10:16:48.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.321+0000 7fe6a543c700 1 -- start start 2023-10-03T10:16:48.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.322+0000 7fe6a543c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6a009f350 0x7fe6a0136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.322+0000 7fe6a543c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6a01371c0 0x7fe6a01395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.322+0000 7fe6a543c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a009c970 con 0x7fe6a009e870 2023-10-03T10:16:48.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.322+0000 7fe6a543c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a00a0920 con 0x7fe6a01371c0 2023-10-03T10:16:48.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.322+0000 7fe6a543c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a009f9c0 con 0x7fe6a009f350 2023-10-03T10:16:48.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.322+0000 7fe69effd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe6a009e870 0x7fe6a009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52756/0 (socket says 172.21.15.146:52756) 2023-10-03T10:16:48.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.322+0000 7fe69effd700 1 -- 172.21.15.146:0/2956344519 learned_addr learned my addr 172.21.15.146:0/2956344519 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:48.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.322+0000 7fe69e7fc700 1 --2- 172.21.15.146:0/2956344519 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6a009f350 0x7fe6a0136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.322+0000 7fe69f7fe700 1 --2- 172.21.15.146:0/2956344519 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6a01371c0 0x7fe6a01395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.322+0000 7fe69dffb700 1 -- 172.21.15.146:0/2956344519 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160886438 0 0) 0x7fe6a009c970 con 0x7fe6a009e870 2023-10-03T10:16:48.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.322+0000 7fe69dffb700 1 -- 172.21.15.146:0/2956344519 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6880035b0 con 0x7fe6a009e870 2023-10-03T10:16:48.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.322+0000 7fe69e7fc700 1 -- 172.21.15.146:0/2956344519 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6a01371c0 msgr2=0x7fe6a01395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:48.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.322+0000 7fe69e7fc700 1 --2- 172.21.15.146:0/2956344519 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6a01371c0 0x7fe6a01395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.322+0000 7fe69e7fc700 1 -- 172.21.15.146:0/2956344519 >> v1:172.21.15.146:6789/0 conn(0x7fe6a009e870 legacy=0x7fe6a009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.322+0000 7fe69e7fc700 1 -- 172.21.15.146:0/2956344519 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a009bab0 con 0x7fe6a009f350 2023-10-03T10:16:48.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.322+0000 7fe69f7fe700 1 --2- 172.21.15.146:0/2956344519 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6a01371c0 0x7fe6a01395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:48.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.323+0000 7fe69e7fc700 1 --2- 172.21.15.146:0/2956344519 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6a009f350 0x7fe6a0136c80 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe694009870 tx=0x7fe694009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5be5904d095c000 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.323+0000 7fe69dffb700 1 -- 172.21.15.146:0/2956344519 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694011830 con 0x7fe6a009f350 2023-10-03T10:16:48.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.323+0000 7fe69dffb700 1 -- 172.21.15.146:0/2956344519 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe694011990 con 0x7fe6a009f350 2023-10-03T10:16:48.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.323+0000 7fe69dffb700 1 -- 172.21.15.146:0/2956344519 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694011d00 con 0x7fe6a009f350 2023-10-03T10:16:48.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.323+0000 7fe6a543c700 1 -- 172.21.15.146:0/2956344519 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6a009f350 msgr2=0x7fe6a0136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.323+0000 7fe6a543c700 1 --2- 172.21.15.146:0/2956344519 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6a009f350 0x7fe6a0136c80 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe694009870 tx=0x7fe694009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:48.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.324+0000 7fe6a543c700 1 -- 172.21.15.146:0/2956344519 shutdown_connections 2023-10-03T10:16:48.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.324+0000 7fe6a543c700 1 --2- 172.21.15.146:0/2956344519 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6a01371c0 0x7fe6a01395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.324+0000 7fe6a543c700 1 --2- 172.21.15.146:0/2956344519 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6a009f350 0x7fe6a0136c80 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.324+0000 7fe6a543c700 1 -- 172.21.15.146:0/2956344519 >> 172.21.15.146:0/2956344519 conn(0x7fe6a00a4430 msgr2=0x7fe6a00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.324+0000 7fe6a543c700 1 -- 172.21.15.146:0/2956344519 shutdown_connections 2023-10-03T10:16:48.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.324+0000 7fe6a543c700 1 -- 172.21.15.146:0/2956344519 wait complete. 2023-10-03T10:16:48.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.325+0000 7fe6a543c700 1 Processor -- start 2023-10-03T10:16:48.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.325+0000 7fe6a543c700 1 -- start start 2023-10-03T10:16:48.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.325+0000 7fe6a543c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6a009e870 0x7fe6a01c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.325+0000 7fe6a543c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6a009f350 0x7fe6a01c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.325+0000 7fe6a543c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6a01371c0 0x7fe6a006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.325+0000 7fe6a543c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a0135010 con 0x7fe6a009e870 2023-10-03T10:16:48.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.325+0000 7fe6a543c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a006d640 con 0x7fe6a009f350 2023-10-03T10:16:48.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.325+0000 7fe6a543c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a01251b0 con 0x7fe6a01371c0 2023-10-03T10:16:48.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.325+0000 7fe69e7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6a009f350 0x7fe6a01c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.325+0000 7fe69e7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6a009f350 0x7fe6a01c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56412/0 (socket says 172.21.15.146:56412) 2023-10-03T10:16:48.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.325+0000 7fe69e7fc700 1 -- 172.21.15.146:0/616982557 learned_addr learned my addr 172.21.15.146:0/616982557 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:48.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.325+0000 7fe69f7fe700 1 --2- 172.21.15.146:0/616982557 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6a01371c0 0x7fe6a006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.325+0000 7fe69effd700 1 --2- 172.21.15.146:0/616982557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6a009e870 0x7fe6a01c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.326+0000 7fe69e7fc700 1 -- 172.21.15.146:0/616982557 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6a01371c0 msgr2=0x7fe6a006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.326+0000 7fe69e7fc700 1 --2- 172.21.15.146:0/616982557 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6a01371c0 0x7fe6a006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.326+0000 7fe69e7fc700 1 -- 172.21.15.146:0/616982557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6a009e870 msgr2=0x7fe6a01c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.326+0000 7fe69e7fc700 1 --2- 172.21.15.146:0/616982557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6a009e870 0x7fe6a01c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.326+0000 7fe69e7fc700 1 -- 172.21.15.146:0/616982557 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe698009a70 con 0x7fe6a009f350 2023-10-03T10:16:48.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.326+0000 7fe69e7fc700 1 --2- 172.21.15.146:0/616982557 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6a009f350 0x7fe6a01c8bd0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe694009bc0 tx=0x7fe694004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.326+0000 7fe6877fe700 1 -- 172.21.15.146:0/616982557 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6940045d0 con 0x7fe6a009f350 2023-10-03T10:16:48.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.326+0000 7fe6877fe700 1 -- 172.21.15.146:0/616982557 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69401f070 con 0x7fe6a009f350 2023-10-03T10:16:48.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.326+0000 7fe6a543c700 1 -- 172.21.15.146:0/616982557 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6940094a0 con 0x7fe6a009f350 2023-10-03T10:16:48.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.326+0000 7fe6877fe700 1 -- 172.21.15.146:0/616982557 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6940038e0 con 0x7fe6a009f350 2023-10-03T10:16:48.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.326+0000 7fe6a543c700 1 -- 172.21.15.146:0/616982557 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a00721f0 con 0x7fe6a009f350 2023-10-03T10:16:48.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.327+0000 7fe6877fe700 1 -- 172.21.15.146:0/616982557 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe694003a40 con 0x7fe6a009f350 2023-10-03T10:16:48.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.327+0000 7fe6877fe700 1 -- 172.21.15.146:0/616982557 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe694021070 con 0x7fe6a009f350 2023-10-03T10:16:48.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.327+0000 7fe6a543c700 1 -- 172.21.15.146:0/616982557 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a004f2a0 con 0x7fe6a009f350 2023-10-03T10:16:48.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.332+0000 7fe6877fe700 1 -- 172.21.15.146:0/616982557 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe694015020 con 0x7fe6a009f350 2023-10-03T10:16:48.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.365+0000 7f1ed4427700 1 Processor -- start 2023-10-03T10:16:48.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.365+0000 7f1ed4427700 1 -- start start 2023-10-03T10:16:48.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.366+0000 7f1ed4427700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ecc131a80 0x7f1ecc131e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.366+0000 7f1ed4427700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ecc09bc70 0x7f1ecc09c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.366+0000 7f1ed4427700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ecc0a23a0 con 0x7f1ecc09c600 2023-10-03T10:16:48.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.366+0000 7f1ed4427700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc131440 con 0x7f1ecc09bc70 2023-10-03T10:16:48.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.366+0000 7f1ed4427700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc132390 con 0x7f1ecc131a80 2023-10-03T10:16:48.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.366+0000 7f1ed21c3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ecc131a80 0x7f1ecc131e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.366+0000 7f1ed21c3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ecc131a80 0x7f1ecc131e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57412/0 (socket says 172.21.15.146:57412) 2023-10-03T10:16:48.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.366+0000 7f1ed21c3700 1 -- 172.21.15.146:0/4150630968 learned_addr learned my addr 172.21.15.146:0/4150630968 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:48.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.366+0000 7f1ed19c2700 1 --2- 172.21.15.146:0/4150630968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ecc09bc70 0x7f1ecc09c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.366+0000 7f1ed11c1700 1 -- 172.21.15.146:0/4150630968 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732552289 0 0) 0x7f1ecc0a23a0 con 0x7f1ecc09c600 2023-10-03T10:16:48.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.366+0000 7f1ed11c1700 1 -- 172.21.15.146:0/4150630968 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1eb80035b0 con 0x7f1ecc09c600 2023-10-03T10:16:48.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.366+0000 7f1ed19c2700 1 -- 172.21.15.146:0/4150630968 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ecc131a80 msgr2=0x7f1ecc131e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:48.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.366+0000 7f1ed19c2700 1 --2- 172.21.15.146:0/4150630968 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ecc131a80 0x7f1ecc131e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.366+0000 7f1ed19c2700 1 -- 172.21.15.146:0/4150630968 >> v1:172.21.15.146:6789/0 conn(0x7f1ecc09c600 legacy=0x7f1ecc138770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.366+0000 7f1ed19c2700 1 -- 172.21.15.146:0/4150630968 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc06eaa0 con 0x7f1ecc09bc70 2023-10-03T10:16:48.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.366+0000 7f1ed21c3700 1 --2- 172.21.15.146:0/4150630968 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ecc131a80 0x7f1ecc131e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:48.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.367+0000 7f1ed19c2700 1 --2- 172.21.15.146:0/4150630968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ecc09bc70 0x7f1ecc09c0c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009870 tx=0x7f1ebc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97bf4b23c0c18b9b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.367+0000 7f1ed11c1700 1 -- 172.21.15.146:0/4150630968 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc011830 con 0x7f1ecc09bc70 2023-10-03T10:16:48.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.367+0000 7f1ed11c1700 1 -- 172.21.15.146:0/4150630968 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ebc011990 con 0x7f1ecc09bc70 2023-10-03T10:16:48.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.367+0000 7f1ed11c1700 1 -- 172.21.15.146:0/4150630968 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc011d00 con 0x7f1ecc09bc70 2023-10-03T10:16:48.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.367+0000 7f1ed4427700 1 -- 172.21.15.146:0/4150630968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ecc09bc70 msgr2=0x7f1ecc09c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.367+0000 7f1ed4427700 1 --2- 172.21.15.146:0/4150630968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ecc09bc70 0x7f1ecc09c0c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009870 tx=0x7f1ebc009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:48.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.367+0000 7f1ed4427700 1 -- 172.21.15.146:0/4150630968 shutdown_connections 2023-10-03T10:16:48.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.367+0000 7f1ed4427700 1 --2- 172.21.15.146:0/4150630968 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ecc131a80 0x7f1ecc131e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.367+0000 7f1ed4427700 1 --2- 172.21.15.146:0/4150630968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ecc09bc70 0x7f1ecc09c0c0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.367+0000 7f1ed4427700 1 -- 172.21.15.146:0/4150630968 >> 172.21.15.146:0/4150630968 conn(0x7f1ecc0a2980 msgr2=0x7f1ecc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.367+0000 7f1ed4427700 1 -- 172.21.15.146:0/4150630968 shutdown_connections 2023-10-03T10:16:48.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.368+0000 7f1ed4427700 1 -- 172.21.15.146:0/4150630968 wait complete. 2023-10-03T10:16:48.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.369+0000 7f1ed4427700 1 Processor -- start 2023-10-03T10:16:48.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.369+0000 7f1ed4427700 1 -- start start 2023-10-03T10:16:48.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.369+0000 7f1ed4427700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ecc09bc70 0x7f1ecc099a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.369+0000 7f1ed4427700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ecc09c600 0x7f1ecc099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.369+0000 7f1ed4427700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ecc131a80 0x7f1ecc09a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.369+0000 7f1ed4427700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc120b50 con 0x7f1ecc09bc70 2023-10-03T10:16:48.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.369+0000 7f1ed4427700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc09b650 con 0x7f1ecc131a80 2023-10-03T10:16:48.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.369+0000 7f1ed4427700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc120db0 con 0x7f1ecc09c600 2023-10-03T10:16:48.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.369+0000 7f1ed21c3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ecc09bc70 0x7f1ecc099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.370+0000 7f1ed21c3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ecc09bc70 0x7f1ecc099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58330/0 (socket says 172.21.15.146:58330) 2023-10-03T10:16:48.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.370+0000 7f1ed21c3700 1 -- 172.21.15.146:0/2030555094 learned_addr learned my addr 172.21.15.146:0/2030555094 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:48.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.370+0000 7f1ed29c4700 1 --2- 172.21.15.146:0/2030555094 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ecc131a80 0x7f1ecc09a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.370+0000 7f1ed19c2700 1 --2- 172.21.15.146:0/2030555094 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ecc09c600 0x7f1ecc099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.370+0000 7f1ed21c3700 1 -- 172.21.15.146:0/2030555094 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ecc09c600 msgr2=0x7f1ecc099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.370+0000 7f1ed21c3700 1 --2- 172.21.15.146:0/2030555094 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ecc09c600 0x7f1ecc099fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.370+0000 7f1ed21c3700 1 -- 172.21.15.146:0/2030555094 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ecc131a80 msgr2=0x7f1ecc09a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.370+0000 7f1ed21c3700 1 --2- 172.21.15.146:0/2030555094 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ecc131a80 0x7f1ecc09a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.370+0000 7f1ed21c3700 1 -- 172.21.15.146:0/2030555094 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec8009500 con 0x7f1ecc09bc70 2023-10-03T10:16:48.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.370+0000 7f1ed29c4700 1 --2- 172.21.15.146:0/2030555094 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ecc131a80 0x7f1ecc09a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:48.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.370+0000 7f1ed21c3700 1 --2- 172.21.15.146:0/2030555094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ecc09bc70 0x7f1ecc099a60 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800ebb0 tx=0x7f1ec800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.370+0000 7f1ec2ffd700 1 -- 172.21.15.146:0/2030555094 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8005a20 con 0x7f1ecc09bc70 2023-10-03T10:16:48.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.370+0000 7f1ec2ffd700 1 -- 172.21.15.146:0/2030555094 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec8005b80 con 0x7f1ecc09bc70 2023-10-03T10:16:48.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.370+0000 7f1ed4427700 1 -- 172.21.15.146:0/2030555094 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ebc0094a0 con 0x7f1ecc09bc70 2023-10-03T10:16:48.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.370+0000 7f1ec2ffd700 1 -- 172.21.15.146:0/2030555094 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec800c850 con 0x7f1ecc09bc70 2023-10-03T10:16:48.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.370+0000 7f1ed4427700 1 -- 172.21.15.146:0/2030555094 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ecc0a1cf0 con 0x7f1ecc09bc70 2023-10-03T10:16:48.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.371+0000 7f1ec2ffd700 1 -- 172.21.15.146:0/2030555094 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ec800c9b0 con 0x7f1ecc09bc70 2023-10-03T10:16:48.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.371+0000 7f1ed4427700 1 -- 172.21.15.146:0/2030555094 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ecc04f2a0 con 0x7f1ecc09bc70 2023-10-03T10:16:48.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.371+0000 7f1ec2ffd700 1 -- 172.21.15.146:0/2030555094 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1ec803f980 con 0x7f1ecc09bc70 2023-10-03T10:16:48.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.376+0000 7f1ec2ffd700 1 -- 172.21.15.146:0/2030555094 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ec8022300 con 0x7f1ecc09bc70 2023-10-03T10:16:48.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.484+0000 7f99c749e700 1 -- 172.21.15.146:0/4283442710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f99c006bce0 con 0x7f99c009a730 2023-10-03T10:16:48.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.484+0000 7f99b5ffb700 1 -- 172.21.15.146:0/4283442710 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f99b0021390 con 0x7f99c009a730 2023-10-03T10:16:48.484 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:48.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.486+0000 7f99c749e700 1 -- 172.21.15.146:0/4283442710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99c009a730 msgr2=0x7f99c011ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.486+0000 7f99c749e700 1 --2- 172.21.15.146:0/4283442710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99c009a730 0x7f99c011ef50 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f99b0015000 tx=0x7f99b0004750 comp rx=0 tx=0).stop 2023-10-03T10:16:48.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.486+0000 7f99c749e700 1 -- 172.21.15.146:0/4283442710 shutdown_connections 2023-10-03T10:16:48.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.486+0000 7f99c749e700 1 --2- 172.21.15.146:0/4283442710 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99c0130890 0x7f99c011f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.486+0000 7f99c749e700 1 --2- 172.21.15.146:0/4283442710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99c0099e20 0x7f99c011ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.486+0000 7f99c749e700 1 --2- 172.21.15.146:0/4283442710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99c009a730 0x7f99c011ef50 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.486+0000 7f99c749e700 1 -- 172.21.15.146:0/4283442710 >> 172.21.15.146:0/4283442710 conn(0x7f99c00a2980 msgr2=0x7f99c012d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.486+0000 7f99c749e700 1 -- 172.21.15.146:0/4283442710 shutdown_connections 2023-10-03T10:16:48.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.486+0000 7f99c749e700 1 -- 172.21.15.146:0/4283442710 wait complete. 2023-10-03T10:16:48.498 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:48.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.530+0000 7fe6a543c700 1 -- 172.21.15.146:0/616982557 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe6a01c9110 con 0x7fe6a009f350 2023-10-03T10:16:48.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.530+0000 7fe6877fe700 1 -- 172.21.15.146:0/616982557 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe694024380 con 0x7fe6a009f350 2023-10-03T10:16:48.530 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:48.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.533+0000 7fe6a543c700 1 -- 172.21.15.146:0/616982557 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6a009f350 msgr2=0x7fe6a01c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.533+0000 7fe6a543c700 1 --2- 172.21.15.146:0/616982557 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6a009f350 0x7fe6a01c8bd0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe694009bc0 tx=0x7fe694004750 comp rx=0 tx=0).stop 2023-10-03T10:16:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.533+0000 7fe6a543c700 1 -- 172.21.15.146:0/616982557 shutdown_connections 2023-10-03T10:16:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.533+0000 7fe6a543c700 1 --2- 172.21.15.146:0/616982557 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe6a01371c0 0x7fe6a006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.533+0000 7fe6a543c700 1 --2- 172.21.15.146:0/616982557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6a009e870 0x7fe6a01c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.533+0000 7fe6a543c700 1 --2- 172.21.15.146:0/616982557 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6a009f350 0x7fe6a01c8bd0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.533+0000 7fe6a543c700 1 -- 172.21.15.146:0/616982557 >> 172.21.15.146:0/616982557 conn(0x7fe6a00a4430 msgr2=0x7fe6a00a28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.533+0000 7fe6a543c700 1 -- 172.21.15.146:0/616982557 shutdown_connections 2023-10-03T10:16:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.533+0000 7fe6a543c700 1 -- 172.21.15.146:0/616982557 wait complete. 2023-10-03T10:16:48.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:48.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.573+0000 7f1ed4427700 1 -- 172.21.15.146:0/2030555094 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1ecc06bce0 con 0x7f1ecc09bc70 2023-10-03T10:16:48.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.573+0000 7f1ec2ffd700 1 -- 172.21.15.146:0/2030555094 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ec8020030 con 0x7f1ecc09bc70 2023-10-03T10:16:48.573 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.576+0000 7f1ed4427700 1 -- 172.21.15.146:0/2030555094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ecc09bc70 msgr2=0x7f1ecc099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.576+0000 7f1ed4427700 1 --2- 172.21.15.146:0/2030555094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ecc09bc70 0x7f1ecc099a60 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800ebb0 tx=0x7f1ec800eec0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.576+0000 7f1ed4427700 1 -- 172.21.15.146:0/2030555094 shutdown_connections 2023-10-03T10:16:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.576+0000 7f1ed4427700 1 --2- 172.21.15.146:0/2030555094 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ecc131a80 0x7f1ecc09a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.576+0000 7f1ed4427700 1 --2- 172.21.15.146:0/2030555094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ecc09bc70 0x7f1ecc099a60 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.576+0000 7f1ed4427700 1 --2- 172.21.15.146:0/2030555094 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1ecc09c600 0x7f1ecc099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.576+0000 7f1ed4427700 1 -- 172.21.15.146:0/2030555094 >> 172.21.15.146:0/2030555094 conn(0x7f1ecc0a2980 msgr2=0x7f1ecc1b8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.576+0000 7f1ed4427700 1 -- 172.21.15.146:0/2030555094 shutdown_connections 2023-10-03T10:16:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:48.576+0000 7f1ed4427700 1 -- 172.21.15.146:0/2030555094 wait complete. 2023-10-03T10:16:48.587 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:49.118 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:49.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.242+0000 7ff4bdce4700 1 Processor -- start 2023-10-03T10:16:49.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.242+0000 7ff4bdce4700 1 -- start start 2023-10-03T10:16:49.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.242+0000 7ff4bdce4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4b8136960 0x7ff4b8138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.242+0000 7ff4bdce4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4b8139280 0x7ff4b813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.242+0000 7ff4bdce4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b806b2d0 con 0x7ff4b8133ad0 2023-10-03T10:16:49.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.242+0000 7ff4bdce4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b81345b0 con 0x7ff4b8136960 2023-10-03T10:16:49.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.242+0000 7ff4bdce4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b8133610 con 0x7ff4b8139280 2023-10-03T10:16:49.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.242+0000 7ff4b6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4b8136960 0x7ff4b8138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.242+0000 7ff4b7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4b8139280 0x7ff4b813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.242+0000 7ff4b77fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff4b8133ad0 0x7ff4b8133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52776/0 (socket says 172.21.15.146:52776) 2023-10-03T10:16:49.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.242+0000 7ff4b77fe700 1 -- 172.21.15.146:0/116790151 learned_addr learned my addr 172.21.15.146:0/116790151 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:49.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.242+0000 7ff4b6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4b8136960 0x7ff4b8138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56444/0 (socket says 172.21.15.146:56444) 2023-10-03T10:16:49.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.243+0000 7ff4b67fc700 1 -- 172.21.15.146:0/116790151 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1414357324 0 0) 0x7ff4b806b2d0 con 0x7ff4b8133ad0 2023-10-03T10:16:49.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.243+0000 7ff4b6ffd700 1 -- 172.21.15.146:0/116790151 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4b8139280 msgr2=0x7ff4b813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:49.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.243+0000 7ff4b6ffd700 1 --2- 172.21.15.146:0/116790151 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4b8139280 0x7ff4b813b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.243+0000 7ff4b6ffd700 1 -- 172.21.15.146:0/116790151 >> v1:172.21.15.146:6789/0 conn(0x7ff4b8133ad0 legacy=0x7ff4b8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.243+0000 7ff4b6ffd700 1 -- 172.21.15.146:0/116790151 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b809a500 con 0x7ff4b8136960 2023-10-03T10:16:49.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.243+0000 7ff4b7fff700 1 --2- 172.21.15.146:0/116790151 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4b8139280 0x7ff4b813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:49.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.243+0000 7ff4b6ffd700 1 --2- 172.21.15.146:0/116790151 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4b8136960 0x7ff4b8138d40 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac009870 tx=0x7ff4ac009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a4d05a8842a3f6e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.243+0000 7ff4b67fc700 1 -- 172.21.15.146:0/116790151 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac011830 con 0x7ff4b8136960 2023-10-03T10:16:49.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.243+0000 7ff4b67fc700 1 -- 172.21.15.146:0/116790151 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac011990 con 0x7ff4b8136960 2023-10-03T10:16:49.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.243+0000 7ff4b67fc700 1 -- 172.21.15.146:0/116790151 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac011d20 con 0x7ff4b8136960 2023-10-03T10:16:49.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.244+0000 7ff4bdce4700 1 -- 172.21.15.146:0/116790151 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4b8136960 msgr2=0x7ff4b8138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.244+0000 7ff4bdce4700 1 --2- 172.21.15.146:0/116790151 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4b8136960 0x7ff4b8138d40 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac009870 tx=0x7ff4ac009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:49.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.244+0000 7ff4bdce4700 1 -- 172.21.15.146:0/116790151 shutdown_connections 2023-10-03T10:16:49.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.244+0000 7ff4bdce4700 1 --2- 172.21.15.146:0/116790151 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4b8139280 0x7ff4b813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.244+0000 7ff4bdce4700 1 --2- 172.21.15.146:0/116790151 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4b8136960 0x7ff4b8138d40 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.244+0000 7ff4bdce4700 1 -- 172.21.15.146:0/116790151 >> 172.21.15.146:0/116790151 conn(0x7ff4b8099c40 msgr2=0x7ff4b80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.244+0000 7ff4bdce4700 1 -- 172.21.15.146:0/116790151 shutdown_connections 2023-10-03T10:16:49.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.244+0000 7ff4bdce4700 1 -- 172.21.15.146:0/116790151 wait complete. 2023-10-03T10:16:49.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.244+0000 7ff4bdce4700 1 Processor -- start 2023-10-03T10:16:49.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.245+0000 7ff4bdce4700 1 -- start start 2023-10-03T10:16:49.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.245+0000 7ff4bdce4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b8133ad0 0x7ff4b812cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.245+0000 7ff4bdce4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4b8136960 0x7ff4b812d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.245+0000 7ff4bdce4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4b8139280 0x7ff4b812d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.245+0000 7ff4bdce4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b81317a0 con 0x7ff4b8133ad0 2023-10-03T10:16:49.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.245+0000 7ff4bdce4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b806edc0 con 0x7ff4b8139280 2023-10-03T10:16:49.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.245+0000 7ff4bdce4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b809f390 con 0x7ff4b8136960 2023-10-03T10:16:49.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.245+0000 7ff4b77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b8133ad0 0x7ff4b812cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.245+0000 7ff4b6ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4b8136960 0x7ff4b812d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.245+0000 7ff4b77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b8133ad0 0x7ff4b812cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58344/0 (socket says 172.21.15.146:58344) 2023-10-03T10:16:49.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.245+0000 7ff4b77fe700 1 -- 172.21.15.146:0/1879292333 learned_addr learned my addr 172.21.15.146:0/1879292333 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:49.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.245+0000 7ff4b7fff700 1 --2- 172.21.15.146:0/1879292333 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4b8139280 0x7ff4b812d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.245+0000 7ff4b6ffd700 1 -- 172.21.15.146:0/1879292333 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4b8139280 msgr2=0x7ff4b812d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.245+0000 7ff4b6ffd700 1 --2- 172.21.15.146:0/1879292333 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4b8139280 0x7ff4b812d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.245+0000 7ff4b6ffd700 1 -- 172.21.15.146:0/1879292333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b8133ad0 msgr2=0x7ff4b812cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.245+0000 7ff4b6ffd700 1 --2- 172.21.15.146:0/1879292333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b8133ad0 0x7ff4b812cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.245+0000 7ff4b6ffd700 1 -- 172.21.15.146:0/1879292333 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b0009a70 con 0x7ff4b8136960 2023-10-03T10:16:49.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.246+0000 7ff4b77fe700 1 --2- 172.21.15.146:0/1879292333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b8133ad0 0x7ff4b812cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:49.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.246+0000 7ff4b6ffd700 1 --2- 172.21.15.146:0/1879292333 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4b8136960 0x7ff4b812d070 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac016000 tx=0x7ff4ac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.246+0000 7ff49ffff700 1 -- 172.21.15.146:0/1879292333 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0042c0 con 0x7ff4b8136960 2023-10-03T10:16:49.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.246+0000 7ff49ffff700 1 -- 172.21.15.146:0/1879292333 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac01f070 con 0x7ff4b8136960 2023-10-03T10:16:49.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.246+0000 7ff4bdce4700 1 -- 172.21.15.146:0/1879292333 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4ac0094a0 con 0x7ff4b8136960 2023-10-03T10:16:49.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.246+0000 7ff49ffff700 1 -- 172.21.15.146:0/1879292333 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0036a0 con 0x7ff4b8136960 2023-10-03T10:16:49.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.246+0000 7ff4bdce4700 1 -- 172.21.15.146:0/1879292333 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b80701b0 con 0x7ff4b8136960 2023-10-03T10:16:49.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.246+0000 7ff49ffff700 1 -- 172.21.15.146:0/1879292333 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff4ac021030 con 0x7ff4b8136960 2023-10-03T10:16:49.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.247+0000 7ff49ffff700 1 -- 172.21.15.146:0/1879292333 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff4ac040660 con 0x7ff4b8136960 2023-10-03T10:16:49.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.247+0000 7ff4bdce4700 1 -- 172.21.15.146:0/1879292333 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b8070ce0 con 0x7ff4b8136960 2023-10-03T10:16:49.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.251+0000 7ff49ffff700 1 -- 172.21.15.146:0/1879292333 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4ac015080 con 0x7ff4b8136960 2023-10-03T10:16:49.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.435+0000 7ff4bdce4700 1 -- 172.21.15.146:0/1879292333 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff4b804f2a0 con 0x7ff4b8136960 2023-10-03T10:16:49.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.435+0000 7ff49ffff700 1 -- 172.21.15.146:0/1879292333 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff4ac0239c0 con 0x7ff4b8136960 2023-10-03T10:16:49.435 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:49.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.437+0000 7ff4bdce4700 1 -- 172.21.15.146:0/1879292333 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4b8136960 msgr2=0x7ff4b812d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.437+0000 7ff4bdce4700 1 --2- 172.21.15.146:0/1879292333 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4b8136960 0x7ff4b812d070 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac016000 tx=0x7ff4ac004750 comp rx=0 tx=0).stop 2023-10-03T10:16:49.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.437+0000 7ff4bdce4700 1 -- 172.21.15.146:0/1879292333 shutdown_connections 2023-10-03T10:16:49.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.437+0000 7ff4bdce4700 1 --2- 172.21.15.146:0/1879292333 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4b8139280 0x7ff4b812d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.437+0000 7ff4bdce4700 1 --2- 172.21.15.146:0/1879292333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b8133ad0 0x7ff4b812cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.437+0000 7ff4bdce4700 1 --2- 172.21.15.146:0/1879292333 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4b8136960 0x7ff4b812d070 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.437+0000 7ff4bdce4700 1 -- 172.21.15.146:0/1879292333 >> 172.21.15.146:0/1879292333 conn(0x7ff4b8099c40 msgr2=0x7ff4b8134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.437+0000 7ff4bdce4700 1 -- 172.21.15.146:0/1879292333 shutdown_connections 2023-10-03T10:16:49.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.437+0000 7ff4bdce4700 1 -- 172.21.15.146:0/1879292333 wait complete. 2023-10-03T10:16:49.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:49.499 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:49.545 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:49.588 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:49.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.634+0000 7f7d82d11700 1 Processor -- start 2023-10-03T10:16:49.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.634+0000 7f7d82d11700 1 -- start start 2023-10-03T10:16:49.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.634+0000 7f7d82d11700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d7c09e870 0x7f7d7c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.634+0000 7f7d82d11700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d7c131f40 0x7f7d7c139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.634+0000 7f7d82d11700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7c09c970 con 0x7f7d7c09f180 2023-10-03T10:16:49.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.634+0000 7f7d82d11700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c0a0920 con 0x7f7d7c09e870 2023-10-03T10:16:49.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.634+0000 7f7d82d11700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c09f9c0 con 0x7f7d7c131f40 2023-10-03T10:16:49.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.634+0000 7f7d7bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7d7c09f180 0x7f7d7c131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52780/0 (socket says 172.21.15.146:52780) 2023-10-03T10:16:49.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.634+0000 7f7d7bfff700 1 -- 172.21.15.146:0/3575581484 learned_addr learned my addr 172.21.15.146:0/3575581484 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:49.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.634+0000 7f7d80aad700 1 --2- 172.21.15.146:0/3575581484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d7c09e870 0x7f7d7c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.634+0000 7f7d812ae700 1 --2- 172.21.15.146:0/3575581484 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d7c131f40 0x7f7d7c139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.635+0000 7f7d7b7fe700 1 -- 172.21.15.146:0/3575581484 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2279109077 0 0) 0x7f7d7c09c970 con 0x7f7d7c09f180 2023-10-03T10:16:49.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.635+0000 7f7d7b7fe700 1 -- 172.21.15.146:0/3575581484 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d6c0035b0 con 0x7f7d7c09f180 2023-10-03T10:16:49.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.635+0000 7f7d80aad700 1 -- 172.21.15.146:0/3575581484 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d7c131f40 msgr2=0x7f7d7c139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:49.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.635+0000 7f7d80aad700 1 --2- 172.21.15.146:0/3575581484 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d7c131f40 0x7f7d7c139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.635+0000 7f7d80aad700 1 -- 172.21.15.146:0/3575581484 >> v1:172.21.15.146:6789/0 conn(0x7f7d7c09f180 legacy=0x7f7d7c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.635+0000 7f7d80aad700 1 -- 172.21.15.146:0/3575581484 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c09bab0 con 0x7f7d7c09e870 2023-10-03T10:16:49.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.635+0000 7f7d812ae700 1 --2- 172.21.15.146:0/3575581484 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d7c131f40 0x7f7d7c139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:49.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.635+0000 7f7d80aad700 1 --2- 172.21.15.146:0/3575581484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d7c09e870 0x7f7d7c09ec40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7d70009870 tx=0x7f7d70009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30f63232a2db0f9e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.635+0000 7f7d7b7fe700 1 -- 172.21.15.146:0/3575581484 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d70011830 con 0x7f7d7c09e870 2023-10-03T10:16:49.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.635+0000 7f7d7b7fe700 1 -- 172.21.15.146:0/3575581484 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d70011990 con 0x7f7d7c09e870 2023-10-03T10:16:49.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.635+0000 7f7d7b7fe700 1 -- 172.21.15.146:0/3575581484 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d70011d20 con 0x7f7d7c09e870 2023-10-03T10:16:49.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.636+0000 7f7d82d11700 1 -- 172.21.15.146:0/3575581484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d7c09e870 msgr2=0x7f7d7c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.636+0000 7f7d82d11700 1 --2- 172.21.15.146:0/3575581484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d7c09e870 0x7f7d7c09ec40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7d70009870 tx=0x7f7d70009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:49.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.636+0000 7f7d82d11700 1 -- 172.21.15.146:0/3575581484 shutdown_connections 2023-10-03T10:16:49.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.636+0000 7f7d82d11700 1 --2- 172.21.15.146:0/3575581484 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d7c131f40 0x7f7d7c139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.636+0000 7f7d82d11700 1 --2- 172.21.15.146:0/3575581484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d7c09e870 0x7f7d7c09ec40 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.636+0000 7f7d82d11700 1 -- 172.21.15.146:0/3575581484 >> 172.21.15.146:0/3575581484 conn(0x7f7d7c0a4430 msgr2=0x7f7d7c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.636+0000 7f7d82d11700 1 -- 172.21.15.146:0/3575581484 shutdown_connections 2023-10-03T10:16:49.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.636+0000 7f7d82d11700 1 -- 172.21.15.146:0/3575581484 wait complete. 2023-10-03T10:16:49.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.637+0000 7f7d82d11700 1 Processor -- start 2023-10-03T10:16:49.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.637+0000 7f7d82d11700 1 -- start start 2023-10-03T10:16:49.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.637+0000 7f7d82d11700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d7c09e870 0x7f7d7c1c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.637+0000 7f7d82d11700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d7c09f180 0x7f7d7c1c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.637+0000 7f7d82d11700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d7c131f40 0x7f7d7c1c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.637+0000 7f7d82d11700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c1201c0 con 0x7f7d7c09e870 2023-10-03T10:16:49.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.637+0000 7f7d82d11700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c0a2d70 con 0x7f7d7c09f180 2023-10-03T10:16:49.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.637+0000 7f7d82d11700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c11e520 con 0x7f7d7c131f40 2023-10-03T10:16:49.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.637+0000 7f7d7bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d7c09f180 0x7f7d7c1c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.638+0000 7f7d80aad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d7c09e870 0x7f7d7c1c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.638+0000 7f7d7bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d7c09f180 0x7f7d7c1c65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56468/0 (socket says 172.21.15.146:56468) 2023-10-03T10:16:49.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.638+0000 7f7d7bfff700 1 -- 172.21.15.146:0/2593242135 learned_addr learned my addr 172.21.15.146:0/2593242135 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:49.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.638+0000 7f7d812ae700 1 --2- 172.21.15.146:0/2593242135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d7c131f40 0x7f7d7c1c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.638+0000 7f7d7bfff700 1 -- 172.21.15.146:0/2593242135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d7c131f40 msgr2=0x7f7d7c1c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.638+0000 7f7d7bfff700 1 --2- 172.21.15.146:0/2593242135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d7c131f40 0x7f7d7c1c6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.638+0000 7f7d7bfff700 1 -- 172.21.15.146:0/2593242135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d7c09e870 msgr2=0x7f7d7c1c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.638+0000 7f7d7bfff700 1 --2- 172.21.15.146:0/2593242135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d7c09e870 0x7f7d7c1c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.638+0000 7f7d7bfff700 1 -- 172.21.15.146:0/2593242135 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d74009a70 con 0x7f7d7c09f180 2023-10-03T10:16:49.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.638+0000 7f7d80aad700 1 --2- 172.21.15.146:0/2593242135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d7c09e870 0x7f7d7c1c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:49.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.638+0000 7f7d7bfff700 1 --2- 172.21.15.146:0/2593242135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d7c09f180 0x7f7d7c1c65d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7d68005910 tx=0x7f7d6800c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.638+0000 7f7d797fa700 1 -- 172.21.15.146:0/2593242135 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d68005d70 con 0x7f7d7c09f180 2023-10-03T10:16:49.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.638+0000 7f7d797fa700 1 -- 172.21.15.146:0/2593242135 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d680070d0 con 0x7f7d7c09f180 2023-10-03T10:16:49.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.638+0000 7f7d797fa700 1 -- 172.21.15.146:0/2593242135 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d68007460 con 0x7f7d7c09f180 2023-10-03T10:16:49.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.638+0000 7f7d82d11700 1 -- 172.21.15.146:0/2593242135 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d700094a0 con 0x7f7d7c09f180 2023-10-03T10:16:49.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.638+0000 7f7d82d11700 1 -- 172.21.15.146:0/2593242135 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7c11ff00 con 0x7f7d7c09f180 2023-10-03T10:16:49.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.639+0000 7f7d797fa700 1 -- 172.21.15.146:0/2593242135 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d680075c0 con 0x7f7d7c09f180 2023-10-03T10:16:49.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.639+0000 7f7d82d11700 1 -- 172.21.15.146:0/2593242135 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d7c04f2a0 con 0x7f7d7c09f180 2023-10-03T10:16:49.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.639+0000 7f7d797fa700 1 -- 172.21.15.146:0/2593242135 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7d6803ec30 con 0x7f7d7c09f180 2023-10-03T10:16:49.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.644+0000 7f7d797fa700 1 -- 172.21.15.146:0/2593242135 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d68040e60 con 0x7f7d7c09f180 2023-10-03T10:16:49.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.675+0000 7f1f698f6700 1 Processor -- start 2023-10-03T10:16:49.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.675+0000 7f1f698f6700 1 -- start start 2023-10-03T10:16:49.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.675+0000 7f1f698f6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f6409ad40 0x7f1f64133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.675+0000 7f1f698f6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1f64133f70 0x7f1f641343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.675+0000 7f1f698f6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f640a0a70 0x7f1f640a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.675+0000 7f1f698f6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f640a3b60 con 0x7f1f64133f70 2023-10-03T10:16:49.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.675+0000 7f1f698f6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f641348e0 con 0x7f1f6409ad40 2023-10-03T10:16:49.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.675+0000 7f1f698f6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6409b110 con 0x7f1f640a0a70 2023-10-03T10:16:49.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.675+0000 7f1f62ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f6409ad40 0x7f1f64133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.675+0000 7f1f637fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f640a0a70 0x7f1f640a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.675+0000 7f1f62ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f6409ad40 0x7f1f64133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56470/0 (socket says 172.21.15.146:56470) 2023-10-03T10:16:49.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.675+0000 7f1f62ffd700 1 -- 172.21.15.146:0/1919212816 learned_addr learned my addr 172.21.15.146:0/1919212816 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:49.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.675+0000 7f1f627fc700 1 --2- 172.21.15.146:0/1919212816 >> v2:172.21.15.146:3300/0 conn(0x7f1f64133f70 0x7f1f641343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.676+0000 7f1f637fe700 1 -- 172.21.15.146:0/1919212816 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f6409ad40 msgr2=0x7f1f64133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:49.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.676+0000 7f1f637fe700 1 --2- 172.21.15.146:0/1919212816 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f6409ad40 0x7f1f64133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.676+0000 7f1f637fe700 1 -- 172.21.15.146:0/1919212816 >> v2:172.21.15.146:3300/0 conn(0x7f1f64133f70 msgr2=0x7f1f641343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:49.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.676+0000 7f1f637fe700 1 --2- 172.21.15.146:0/1919212816 >> v2:172.21.15.146:3300/0 conn(0x7f1f64133f70 0x7f1f641343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.676+0000 7f1f637fe700 1 -- 172.21.15.146:0/1919212816 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f640a2fa0 con 0x7f1f640a0a70 2023-10-03T10:16:49.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.676+0000 7f1f637fe700 1 --2- 172.21.15.146:0/1919212816 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f640a0a70 0x7f1f640a0ed0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009dc0 tx=0x7f1f5c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39e4ba3c476b89ac server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.676+0000 7f1f61ffb700 1 -- 172.21.15.146:0/1919212816 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c00e070 con 0x7f1f640a0a70 2023-10-03T10:16:49.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.676+0000 7f1f61ffb700 1 -- 172.21.15.146:0/1919212816 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c00bae0 con 0x7f1f640a0a70 2023-10-03T10:16:49.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.676+0000 7f1f61ffb700 1 -- 172.21.15.146:0/1919212816 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c00be90 con 0x7f1f640a0a70 2023-10-03T10:16:49.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.677+0000 7f1f698f6700 1 -- 172.21.15.146:0/1919212816 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f640a0a70 msgr2=0x7f1f640a0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.677+0000 7f1f698f6700 1 --2- 172.21.15.146:0/1919212816 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f640a0a70 0x7f1f640a0ed0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009dc0 tx=0x7f1f5c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:49.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.677+0000 7f1f698f6700 1 -- 172.21.15.146:0/1919212816 shutdown_connections 2023-10-03T10:16:49.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.677+0000 7f1f698f6700 1 --2- 172.21.15.146:0/1919212816 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f6409ad40 0x7f1f64133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.677+0000 7f1f698f6700 1 --2- 172.21.15.146:0/1919212816 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f640a0a70 0x7f1f640a0ed0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.677+0000 7f1f698f6700 1 --2- 172.21.15.146:0/1919212816 >> v2:172.21.15.146:3300/0 conn(0x7f1f64133f70 0x7f1f641343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.677+0000 7f1f698f6700 1 -- 172.21.15.146:0/1919212816 >> 172.21.15.146:0/1919212816 conn(0x7f1f64099c40 msgr2=0x7f1f6406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.677+0000 7f1f698f6700 1 -- 172.21.15.146:0/1919212816 shutdown_connections 2023-10-03T10:16:49.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.677+0000 7f1f698f6700 1 -- 172.21.15.146:0/1919212816 wait complete. 2023-10-03T10:16:49.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.678+0000 7f1f698f6700 1 Processor -- start 2023-10-03T10:16:49.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.678+0000 7f1f698f6700 1 -- start start 2023-10-03T10:16:49.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.678+0000 7f1f698f6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f6409ad40 0x7f1f641c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.678+0000 7f1f698f6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f640a0a70 0x7f1f641c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.678+0000 7f1f698f6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f64133f70 0x7f1f641c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.678+0000 7f1f698f6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f641308b0 con 0x7f1f6409ad40 2023-10-03T10:16:49.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.678+0000 7f1f698f6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6409c7e0 con 0x7f1f640a0a70 2023-10-03T10:16:49.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.678+0000 7f1f698f6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6411e3a0 con 0x7f1f64133f70 2023-10-03T10:16:49.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.678+0000 7f1f62ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f6409ad40 0x7f1f641c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.678+0000 7f1f62ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f6409ad40 0x7f1f641c8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58378/0 (socket says 172.21.15.146:58378) 2023-10-03T10:16:49.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.678+0000 7f1f62ffd700 1 -- 172.21.15.146:0/2699342237 learned_addr learned my addr 172.21.15.146:0/2699342237 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:49.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.678+0000 7f1f627fc700 1 --2- 172.21.15.146:0/2699342237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f640a0a70 0x7f1f641c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.679+0000 7f1f637fe700 1 --2- 172.21.15.146:0/2699342237 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f64133f70 0x7f1f641c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.679+0000 7f1f62ffd700 1 -- 172.21.15.146:0/2699342237 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f64133f70 msgr2=0x7f1f641c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.679+0000 7f1f62ffd700 1 --2- 172.21.15.146:0/2699342237 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f64133f70 0x7f1f641c4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.679+0000 7f1f62ffd700 1 -- 172.21.15.146:0/2699342237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f640a0a70 msgr2=0x7f1f641c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.679+0000 7f1f62ffd700 1 --2- 172.21.15.146:0/2699342237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f640a0a70 0x7f1f641c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.679+0000 7f1f62ffd700 1 -- 172.21.15.146:0/2699342237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c009a70 con 0x7f1f6409ad40 2023-10-03T10:16:49.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.679+0000 7f1f62ffd700 1 --2- 172.21.15.146:0/2699342237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f6409ad40 0x7f1f641c8640 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400e870 tx=0x7f1f5400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.679+0000 7f1f4bfff700 1 -- 172.21.15.146:0/2699342237 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f54013680 con 0x7f1f6409ad40 2023-10-03T10:16:49.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.679+0000 7f1f4bfff700 1 -- 172.21.15.146:0/2699342237 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f540137e0 con 0x7f1f6409ad40 2023-10-03T10:16:49.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.679+0000 7f1f698f6700 1 -- 172.21.15.146:0/2699342237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f64132a20 con 0x7f1f6409ad40 2023-10-03T10:16:49.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.679+0000 7f1f4bfff700 1 -- 172.21.15.146:0/2699342237 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f54013b50 con 0x7f1f6409ad40 2023-10-03T10:16:49.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.679+0000 7f1f698f6700 1 -- 172.21.15.146:0/2699342237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f64120770 con 0x7f1f6409ad40 2023-10-03T10:16:49.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.680+0000 7f1f4bfff700 1 -- 172.21.15.146:0/2699342237 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f54013cb0 con 0x7f1f6409ad40 2023-10-03T10:16:49.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.680+0000 7f1f4bfff700 1 -- 172.21.15.146:0/2699342237 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1f5403f4c0 con 0x7f1f6409ad40 2023-10-03T10:16:49.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.680+0000 7f1f698f6700 1 -- 172.21.15.146:0/2699342237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f6411f150 con 0x7f1f6409ad40 2023-10-03T10:16:49.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.689+0000 7f1f4bfff700 1 -- 172.21.15.146:0/2699342237 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f6411f150 con 0x7f1f6409ad40 2023-10-03T10:16:49.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.728+0000 7f2e19d73700 1 Processor -- start 2023-10-03T10:16:49.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.729+0000 7f2e19d73700 1 -- start start 2023-10-03T10:16:49.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.729+0000 7f2e19d73700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e140a0a70 0x7f2e140a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.729+0000 7f2e19d73700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e14134120 0x7f2e1413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.729+0000 7f2e19d73700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1409dc00 con 0x7f2e140a1380 2023-10-03T10:16:49.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.729+0000 7f2e19d73700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1409ea90 con 0x7f2e140a0a70 2023-10-03T10:16:49.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.729+0000 7f2e19d73700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1409dec0 con 0x7f2e14134120 2023-10-03T10:16:49.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.729+0000 7f2e12ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2e140a1380 0x7f2e14133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52784/0 (socket says 172.21.15.146:52784) 2023-10-03T10:16:49.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.729+0000 7f2e12ffd700 1 -- 172.21.15.146:0/1263445165 learned_addr learned my addr 172.21.15.146:0/1263445165 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:49.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.729+0000 7f2e13fff700 1 --2- 172.21.15.146:0/1263445165 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e14134120 0x7f2e1413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.729+0000 7f2e137fe700 1 --2- 172.21.15.146:0/1263445165 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e140a0a70 0x7f2e140a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.729+0000 7f2e127fc700 1 -- 172.21.15.146:0/1263445165 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357770752 0 0) 0x7f2e1409dc00 con 0x7f2e140a1380 2023-10-03T10:16:49.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.730+0000 7f2e127fc700 1 -- 172.21.15.146:0/1263445165 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dfc0035b0 con 0x7f2e140a1380 2023-10-03T10:16:49.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.730+0000 7f2e137fe700 1 -- 172.21.15.146:0/1263445165 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e14134120 msgr2=0x7f2e1413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:49.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.730+0000 7f2e137fe700 1 --2- 172.21.15.146:0/1263445165 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e14134120 0x7f2e1413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.730+0000 7f2e137fe700 1 -- 172.21.15.146:0/1263445165 >> v1:172.21.15.146:6789/0 conn(0x7f2e140a1380 legacy=0x7f2e14133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.730+0000 7f2e137fe700 1 -- 172.21.15.146:0/1263445165 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1409e6a0 con 0x7f2e140a0a70 2023-10-03T10:16:49.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.730+0000 7f2e13fff700 1 --2- 172.21.15.146:0/1263445165 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e14134120 0x7f2e1413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:49.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.730+0000 7f2e137fe700 1 --2- 172.21.15.146:0/1263445165 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e140a0a70 0x7f2e140a0e40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2e04009870 tx=0x7f2e04009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a127f84d099fdfc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.730+0000 7f2e127fc700 1 -- 172.21.15.146:0/1263445165 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e04011830 con 0x7f2e140a0a70 2023-10-03T10:16:49.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.730+0000 7f2e127fc700 1 -- 172.21.15.146:0/1263445165 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e04011990 con 0x7f2e140a0a70 2023-10-03T10:16:49.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.730+0000 7f2e127fc700 1 -- 172.21.15.146:0/1263445165 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e04011d20 con 0x7f2e140a0a70 2023-10-03T10:16:49.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.730+0000 7f2e19d73700 1 -- 172.21.15.146:0/1263445165 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e140a0a70 msgr2=0x7f2e140a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.730+0000 7f2e19d73700 1 --2- 172.21.15.146:0/1263445165 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e140a0a70 0x7f2e140a0e40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2e04009870 tx=0x7f2e04009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:49.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.731+0000 7f2e19d73700 1 -- 172.21.15.146:0/1263445165 shutdown_connections 2023-10-03T10:16:49.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.731+0000 7f2e19d73700 1 --2- 172.21.15.146:0/1263445165 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e14134120 0x7f2e1413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.731+0000 7f2e19d73700 1 --2- 172.21.15.146:0/1263445165 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e140a0a70 0x7f2e140a0e40 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.731+0000 7f2e19d73700 1 -- 172.21.15.146:0/1263445165 >> 172.21.15.146:0/1263445165 conn(0x7f2e140a6610 msgr2=0x7f2e140a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.731+0000 7f2e19d73700 1 -- 172.21.15.146:0/1263445165 shutdown_connections 2023-10-03T10:16:49.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.731+0000 7f2e19d73700 1 -- 172.21.15.146:0/1263445165 wait complete. 2023-10-03T10:16:49.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.731+0000 7f2e19d73700 1 Processor -- start 2023-10-03T10:16:49.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.732+0000 7f2e19d73700 1 -- start start 2023-10-03T10:16:49.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.732+0000 7f2e19d73700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e140a0a70 0x7f2e141c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.732+0000 7f2e19d73700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e140a1380 0x7f2e141c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.732+0000 7f2e19d73700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e14134120 0x7f2e1411e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.732+0000 7f2e19d73700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e141206f0 con 0x7f2e14134120 2023-10-03T10:16:49.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.732+0000 7f2e19d73700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e14120500 con 0x7f2e140a1380 2023-10-03T10:16:49.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.732+0000 7f2e19d73700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e141334d0 con 0x7f2e140a0a70 2023-10-03T10:16:49.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.732+0000 7f2e137fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e140a0a70 0x7f2e141c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.732+0000 7f2e137fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e140a0a70 0x7f2e141c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57476/0 (socket says 172.21.15.146:57476) 2023-10-03T10:16:49.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.732+0000 7f2e137fe700 1 -- 172.21.15.146:0/3048414663 learned_addr learned my addr 172.21.15.146:0/3048414663 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:49.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.732+0000 7f2e12ffd700 1 --2- 172.21.15.146:0/3048414663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e140a1380 0x7f2e141c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.732+0000 7f2e13fff700 1 --2- 172.21.15.146:0/3048414663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e14134120 0x7f2e1411e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.733+0000 7f2e12ffd700 1 -- 172.21.15.146:0/3048414663 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e140a0a70 msgr2=0x7f2e141c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.733+0000 7f2e12ffd700 1 --2- 172.21.15.146:0/3048414663 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e140a0a70 0x7f2e141c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.733+0000 7f2e12ffd700 1 -- 172.21.15.146:0/3048414663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e14134120 msgr2=0x7f2e1411e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.733+0000 7f2e12ffd700 1 --2- 172.21.15.146:0/3048414663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e14134120 0x7f2e1411e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.733+0000 7f2e12ffd700 1 -- 172.21.15.146:0/3048414663 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0c009a70 con 0x7f2e140a1380 2023-10-03T10:16:49.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.733+0000 7f2e137fe700 1 --2- 172.21.15.146:0/3048414663 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e140a0a70 0x7f2e141c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:49.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.733+0000 7f2e12ffd700 1 --2- 172.21.15.146:0/3048414663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e140a1380 0x7f2e141c8eb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800c490 tx=0x7f2e0800c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.733+0000 7f2dfbfff700 1 -- 172.21.15.146:0/3048414663 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08005d70 con 0x7f2e140a1380 2023-10-03T10:16:49.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.733+0000 7f2dfbfff700 1 -- 172.21.15.146:0/3048414663 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e080070d0 con 0x7f2e140a1380 2023-10-03T10:16:49.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.733+0000 7f2dfbfff700 1 -- 172.21.15.146:0/3048414663 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08007440 con 0x7f2e140a1380 2023-10-03T10:16:49.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.733+0000 7f2e19d73700 1 -- 172.21.15.146:0/3048414663 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e040094a0 con 0x7f2e140a1380 2023-10-03T10:16:49.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.733+0000 7f2e19d73700 1 -- 172.21.15.146:0/3048414663 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e14122130 con 0x7f2e140a1380 2023-10-03T10:16:49.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.734+0000 7f2dfbfff700 1 -- 172.21.15.146:0/3048414663 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e080075a0 con 0x7f2e140a1380 2023-10-03T10:16:49.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.734+0000 7f2dfbfff700 1 -- 172.21.15.146:0/3048414663 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2e0803e660 con 0x7f2e140a1380 2023-10-03T10:16:49.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.734+0000 7f2e19d73700 1 -- 172.21.15.146:0/3048414663 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e14133f40 con 0x7f2e140a1380 2023-10-03T10:16:49.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.739+0000 7f2dfbfff700 1 -- 172.21.15.146:0/3048414663 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e08017070 con 0x7f2e140a1380 2023-10-03T10:16:49.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.841+0000 7f7d82d11700 1 -- 172.21.15.146:0/2593242135 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7d7c1203e0 con 0x7f7d7c09f180 2023-10-03T10:16:49.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.842+0000 7f7d797fa700 1 -- 172.21.15.146:0/2593242135 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d68017030 con 0x7f7d7c09f180 2023-10-03T10:16:49.842 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:49.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.844+0000 7f7d82d11700 1 -- 172.21.15.146:0/2593242135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d7c09f180 msgr2=0x7f7d7c1c65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.844+0000 7f7d82d11700 1 --2- 172.21.15.146:0/2593242135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d7c09f180 0x7f7d7c1c65d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7d68005910 tx=0x7f7d6800c9e0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.844+0000 7f7d82d11700 1 -- 172.21.15.146:0/2593242135 shutdown_connections 2023-10-03T10:16:49.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.844+0000 7f7d82d11700 1 --2- 172.21.15.146:0/2593242135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d7c131f40 0x7f7d7c1c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.844+0000 7f7d82d11700 1 --2- 172.21.15.146:0/2593242135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d7c09e870 0x7f7d7c1c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.844+0000 7f7d82d11700 1 --2- 172.21.15.146:0/2593242135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d7c09f180 0x7f7d7c1c65d0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.844+0000 7f7d82d11700 1 -- 172.21.15.146:0/2593242135 >> 172.21.15.146:0/2593242135 conn(0x7f7d7c0a4430 msgr2=0x7f7d7c1b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.844+0000 7f7d82d11700 1 -- 172.21.15.146:0/2593242135 shutdown_connections 2023-10-03T10:16:49.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.844+0000 7f7d82d11700 1 -- 172.21.15.146:0/2593242135 wait complete. 2023-10-03T10:16:49.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:49.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.922+0000 7f1f698f6700 1 -- 172.21.15.146:0/2699342237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1f6411f150 con 0x7f1f6409ad40 2023-10-03T10:16:49.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.923+0000 7f1f4bfff700 1 -- 172.21.15.146:0/2699342237 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1f6411f150 con 0x7f1f6409ad40 2023-10-03T10:16:49.922 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.925+0000 7f1f698f6700 1 -- 172.21.15.146:0/2699342237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f6409ad40 msgr2=0x7f1f641c8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.925+0000 7f1f698f6700 1 --2- 172.21.15.146:0/2699342237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f6409ad40 0x7f1f641c8640 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400e870 tx=0x7f1f5400eb80 comp rx=0 tx=0).stop 2023-10-03T10:16:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.925+0000 7f1f698f6700 1 -- 172.21.15.146:0/2699342237 shutdown_connections 2023-10-03T10:16:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.925+0000 7f1f698f6700 1 --2- 172.21.15.146:0/2699342237 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f64133f70 0x7f1f641c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.925+0000 7f1f698f6700 1 --2- 172.21.15.146:0/2699342237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f6409ad40 0x7f1f641c8640 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.925+0000 7f1f698f6700 1 --2- 172.21.15.146:0/2699342237 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f640a0a70 0x7f1f641c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.925+0000 7f1f698f6700 1 -- 172.21.15.146:0/2699342237 >> 172.21.15.146:0/2699342237 conn(0x7f1f64099c40 msgr2=0x7f1f64131fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.925+0000 7f1f698f6700 1 -- 172.21.15.146:0/2699342237 shutdown_connections 2023-10-03T10:16:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.925+0000 7f1f698f6700 1 -- 172.21.15.146:0/2699342237 wait complete. 2023-10-03T10:16:49.936 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:49.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.963+0000 7f2e19d73700 1 -- 172.21.15.146:0/3048414663 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2e1404f2a0 con 0x7f2e140a1380 2023-10-03T10:16:49.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.963+0000 7f2dfbfff700 1 -- 172.21.15.146:0/3048414663 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e08018af0 con 0x7f2e140a1380 2023-10-03T10:16:49.963 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:49.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.965+0000 7f2e19d73700 1 -- 172.21.15.146:0/3048414663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e140a1380 msgr2=0x7f2e141c8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.965+0000 7f2e19d73700 1 --2- 172.21.15.146:0/3048414663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e140a1380 0x7f2e141c8eb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800c490 tx=0x7f2e0800c7a0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.965+0000 7f2e19d73700 1 -- 172.21.15.146:0/3048414663 shutdown_connections 2023-10-03T10:16:49.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.965+0000 7f2e19d73700 1 --2- 172.21.15.146:0/3048414663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e14134120 0x7f2e1411e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.965+0000 7f2e19d73700 1 --2- 172.21.15.146:0/3048414663 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e140a0a70 0x7f2e141c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.965+0000 7f2e19d73700 1 --2- 172.21.15.146:0/3048414663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e140a1380 0x7f2e141c8eb0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.965+0000 7f2e19d73700 1 -- 172.21.15.146:0/3048414663 >> 172.21.15.146:0/3048414663 conn(0x7f2e140a6610 msgr2=0x7f2e1409aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.965+0000 7f2e19d73700 1 -- 172.21.15.146:0/3048414663 shutdown_connections 2023-10-03T10:16:49.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:49.965+0000 7f2e19d73700 1 -- 172.21.15.146:0/3048414663 wait complete. 2023-10-03T10:16:49.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:50.450 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:50.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.577+0000 7fee807c5700 1 Processor -- start 2023-10-03T10:16:50.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.577+0000 7fee807c5700 1 -- start start 2023-10-03T10:16:50.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.578+0000 7fee807c5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee7809d860 0x7fee7809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.578+0000 7fee807c5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee7809e170 0x7fee781307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.578+0000 7fee807c5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fee78130ce0 0x7fee78131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.578+0000 7fee807c5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7809aaa0 con 0x7fee78130ce0 2023-10-03T10:16:50.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.578+0000 7fee807c5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7809f870 con 0x7fee7809d860 2023-10-03T10:16:50.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.578+0000 7fee807c5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee7809b360 con 0x7fee7809e170 2023-10-03T10:16:50.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.578+0000 7fee7e561700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee7809d860 0x7fee7809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.578+0000 7fee7dd60700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee7809e170 0x7fee781307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.578+0000 7fee7ed62700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fee78130ce0 0x7fee78131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.578+0000 7fee7e561700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee7809d860 0x7fee7809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56504/0 (socket says 172.21.15.146:56504) 2023-10-03T10:16:50.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.578+0000 7fee7dd60700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee7809e170 0x7fee781307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57490/0 (socket says 172.21.15.146:57490) 2023-10-03T10:16:50.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.578+0000 7fee7ed62700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fee78130ce0 0x7fee78131150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58400/0 (socket says 172.21.15.146:58400) 2023-10-03T10:16:50.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.578+0000 7fee7e561700 1 -- 172.21.15.146:0/2113482412 learned_addr learned my addr 172.21.15.146:0/2113482412 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:50.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.578+0000 7fee7ed62700 1 -- 172.21.15.146:0/2113482412 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee7809e170 msgr2=0x7fee781307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.578+0000 7fee7ed62700 1 --2- 172.21.15.146:0/2113482412 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee7809e170 0x7fee781307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.578+0000 7fee7ed62700 1 -- 172.21.15.146:0/2113482412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee7809d860 msgr2=0x7fee7809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.578+0000 7fee7ed62700 1 --2- 172.21.15.146:0/2113482412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee7809d860 0x7fee7809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.578+0000 7fee7ed62700 1 -- 172.21.15.146:0/2113482412 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7809b620 con 0x7fee78130ce0 2023-10-03T10:16:50.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.578+0000 7fee7e561700 1 --2- 172.21.15.146:0/2113482412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee7809d860 0x7fee7809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.578+0000 7fee7dd60700 1 --2- 172.21.15.146:0/2113482412 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee7809e170 0x7fee781307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.579+0000 7fee7ed62700 1 --2- 172.21.15.146:0/2113482412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee78130ce0 0x7fee78131150 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fee70009d90 tx=0x7fee7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a68532c44ca416 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.579+0000 7fee7d55f700 1 -- 172.21.15.146:0/2113482412 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7000e070 con 0x7fee78130ce0 2023-10-03T10:16:50.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.579+0000 7fee7d55f700 1 -- 172.21.15.146:0/2113482412 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7000bb20 con 0x7fee78130ce0 2023-10-03T10:16:50.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.579+0000 7fee7d55f700 1 -- 172.21.15.146:0/2113482412 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70012430 con 0x7fee78130ce0 2023-10-03T10:16:50.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.579+0000 7fee807c5700 1 -- 172.21.15.146:0/2113482412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee78130ce0 msgr2=0x7fee78131150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.579+0000 7fee807c5700 1 --2- 172.21.15.146:0/2113482412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee78130ce0 0x7fee78131150 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fee70009d90 tx=0x7fee7000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:50.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.579+0000 7fee807c5700 1 -- 172.21.15.146:0/2113482412 shutdown_connections 2023-10-03T10:16:50.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.579+0000 7fee807c5700 1 --2- 172.21.15.146:0/2113482412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee7809d860 0x7fee7809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.579+0000 7fee807c5700 1 --2- 172.21.15.146:0/2113482412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee78130ce0 0x7fee78131150 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.579+0000 7fee807c5700 1 --2- 172.21.15.146:0/2113482412 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee7809e170 0x7fee781307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.579+0000 7fee807c5700 1 -- 172.21.15.146:0/2113482412 >> 172.21.15.146:0/2113482412 conn(0x7fee78099c40 msgr2=0x7fee780a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.579+0000 7fee807c5700 1 -- 172.21.15.146:0/2113482412 shutdown_connections 2023-10-03T10:16:50.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.579+0000 7fee807c5700 1 -- 172.21.15.146:0/2113482412 wait complete. 2023-10-03T10:16:50.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.580+0000 7fee807c5700 1 Processor -- start 2023-10-03T10:16:50.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.580+0000 7fee807c5700 1 -- start start 2023-10-03T10:16:50.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee807c5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7809d860 0x7fee78120090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee807c5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee7809e170 0x7fee781205d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee807c5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee78130ce0 0x7fee78120b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee807c5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee78123970 con 0x7fee7809d860 2023-10-03T10:16:50.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee807c5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee78130450 con 0x7fee78130ce0 2023-10-03T10:16:50.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee807c5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee78123610 con 0x7fee7809e170 2023-10-03T10:16:50.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee7e561700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7809d860 0x7fee78120090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee7ed62700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee78130ce0 0x7fee78120b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee7dd60700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee7809e170 0x7fee781205d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee7e561700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7809d860 0x7fee78120090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58404/0 (socket says 172.21.15.146:58404) 2023-10-03T10:16:50.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee7e561700 1 -- 172.21.15.146:0/2923982204 learned_addr learned my addr 172.21.15.146:0/2923982204 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:50.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee7ed62700 1 -- 172.21.15.146:0/2923982204 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee7809e170 msgr2=0x7fee781205d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee7ed62700 1 --2- 172.21.15.146:0/2923982204 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee7809e170 0x7fee781205d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee7ed62700 1 -- 172.21.15.146:0/2923982204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7809d860 msgr2=0x7fee78120090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee7ed62700 1 --2- 172.21.15.146:0/2923982204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7809d860 0x7fee78120090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee7ed62700 1 -- 172.21.15.146:0/2923982204 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee68009550 con 0x7fee78130ce0 2023-10-03T10:16:50.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee7dd60700 1 --2- 172.21.15.146:0/2923982204 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee7809e170 0x7fee781205d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee7e561700 1 --2- 172.21.15.146:0/2923982204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7809d860 0x7fee78120090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee7ed62700 1 --2- 172.21.15.146:0/2923982204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee78130ce0 0x7fee78120b10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fee70016000 tx=0x7fee70004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee6effd700 1 -- 172.21.15.146:0/2923982204 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70012430 con 0x7fee78130ce0 2023-10-03T10:16:50.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee6effd700 1 -- 172.21.15.146:0/2923982204 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee70020070 con 0x7fee78130ce0 2023-10-03T10:16:50.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee807c5700 1 -- 172.21.15.146:0/2923982204 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee740094a0 con 0x7fee78130ce0 2023-10-03T10:16:50.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.581+0000 7fee6effd700 1 -- 172.21.15.146:0/2923982204 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70004280 con 0x7fee78130ce0 2023-10-03T10:16:50.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.582+0000 7fee807c5700 1 -- 172.21.15.146:0/2923982204 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee70009a70 con 0x7fee78130ce0 2023-10-03T10:16:50.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.582+0000 7fee6effd700 1 -- 172.21.15.146:0/2923982204 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee700043e0 con 0x7fee78130ce0 2023-10-03T10:16:50.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.582+0000 7fee6effd700 1 -- 172.21.15.146:0/2923982204 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fee70022070 con 0x7fee78130ce0 2023-10-03T10:16:50.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.582+0000 7fee807c5700 1 -- 172.21.15.146:0/2923982204 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7809c8b0 con 0x7fee78130ce0 2023-10-03T10:16:50.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.587+0000 7fee6effd700 1 -- 172.21.15.146:0/2923982204 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee70012e10 con 0x7fee78130ce0 2023-10-03T10:16:50.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.771+0000 7fee807c5700 1 -- 172.21.15.146:0/2923982204 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fee7804f2a0 con 0x7fee78130ce0 2023-10-03T10:16:50.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.771+0000 7fee6effd700 1 -- 172.21.15.146:0/2923982204 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fee7001a380 con 0x7fee78130ce0 2023-10-03T10:16:50.771 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:50.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.773+0000 7fee807c5700 1 -- 172.21.15.146:0/2923982204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee78130ce0 msgr2=0x7fee78120b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.773+0000 7fee807c5700 1 --2- 172.21.15.146:0/2923982204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee78130ce0 0x7fee78120b10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fee70016000 tx=0x7fee70004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.773+0000 7fee807c5700 1 -- 172.21.15.146:0/2923982204 shutdown_connections 2023-10-03T10:16:50.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.773+0000 7fee807c5700 1 --2- 172.21.15.146:0/2923982204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee78130ce0 0x7fee78120b10 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.773+0000 7fee807c5700 1 --2- 172.21.15.146:0/2923982204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee7809d860 0x7fee78120090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.773+0000 7fee807c5700 1 --2- 172.21.15.146:0/2923982204 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee7809e170 0x7fee781205d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.773+0000 7fee807c5700 1 -- 172.21.15.146:0/2923982204 >> 172.21.15.146:0/2923982204 conn(0x7fee78099c40 msgr2=0x7fee78070b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.773+0000 7fee807c5700 1 -- 172.21.15.146:0/2923982204 shutdown_connections 2023-10-03T10:16:50.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.773+0000 7fee807c5700 1 -- 172.21.15.146:0/2923982204 wait complete. 2023-10-03T10:16:50.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:50.857 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:50.937 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:50.977 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:50.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.986+0000 7f5ec12f4700 1 Processor -- start 2023-10-03T10:16:50.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.986+0000 7f5ec12f4700 1 -- start start 2023-10-03T10:16:50.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.986+0000 7f5ec12f4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5ebc133ad0 0x7f5ebc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.986+0000 7f5ec12f4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ebc1300a0 0x7f5ebc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.986+0000 7f5ec12f4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ebc1309f0 0x7f5ebc13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.986+0000 7f5ec12f4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ebc06b2d0 con 0x7f5ebc133ad0 2023-10-03T10:16:50.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.986+0000 7f5ec12f4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc133610 con 0x7f5ebc1309f0 2023-10-03T10:16:50.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.986+0000 7f5ec12f4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc09a500 con 0x7f5ebc1300a0 2023-10-03T10:16:50.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.986+0000 7f5ebaffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5ebc133ad0 0x7f5ebc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.986+0000 7f5ebaffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5ebc133ad0 0x7f5ebc133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58408/0 (socket says 172.21.15.146:58408) 2023-10-03T10:16:50.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.986+0000 7f5ebaffd700 1 -- 172.21.15.146:0/1242539206 learned_addr learned my addr 172.21.15.146:0/1242539206 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:50.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.986+0000 7f5eba7fc700 1 --2- 172.21.15.146:0/1242539206 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ebc1300a0 0x7f5ebc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.986+0000 7f5ebb7fe700 1 --2- 172.21.15.146:0/1242539206 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ebc1309f0 0x7f5ebc13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.987+0000 7f5ebaffd700 1 -- 172.21.15.146:0/1242539206 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ebc1300a0 msgr2=0x7f5ebc1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.987+0000 7f5ebaffd700 1 --2- 172.21.15.146:0/1242539206 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ebc1300a0 0x7f5ebc1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.987+0000 7f5ebaffd700 1 -- 172.21.15.146:0/1242539206 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ebc1309f0 msgr2=0x7f5ebc13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.987+0000 7f5ebaffd700 1 --2- 172.21.15.146:0/1242539206 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ebc1309f0 0x7f5ebc13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.987+0000 7f5ebaffd700 1 -- 172.21.15.146:0/1242539206 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc1338b0 con 0x7f5ebc133ad0 2023-10-03T10:16:50.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.987+0000 7f5ebaffd700 1 --2- 172.21.15.146:0/1242539206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ebc133ad0 0x7f5ebc133ea0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0098f0 tx=0x7f5eac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86f9ddcce0f37cb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.987+0000 7f5eb9ffb700 1 -- 172.21.15.146:0/1242539206 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac011830 con 0x7f5ebc133ad0 2023-10-03T10:16:50.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.987+0000 7f5eb9ffb700 1 -- 172.21.15.146:0/1242539206 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eac011990 con 0x7f5ebc133ad0 2023-10-03T10:16:50.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.987+0000 7f5eb9ffb700 1 -- 172.21.15.146:0/1242539206 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac011d20 con 0x7f5ebc133ad0 2023-10-03T10:16:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.988+0000 7f5ec12f4700 1 -- 172.21.15.146:0/1242539206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ebc133ad0 msgr2=0x7f5ebc133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.988+0000 7f5ec12f4700 1 --2- 172.21.15.146:0/1242539206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ebc133ad0 0x7f5ebc133ea0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0098f0 tx=0x7f5eac009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.988+0000 7f5ec12f4700 1 -- 172.21.15.146:0/1242539206 shutdown_connections 2023-10-03T10:16:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.988+0000 7f5ec12f4700 1 --2- 172.21.15.146:0/1242539206 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ebc1309f0 0x7f5ebc13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.988+0000 7f5ec12f4700 1 --2- 172.21.15.146:0/1242539206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ebc133ad0 0x7f5ebc133ea0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.988+0000 7f5ec12f4700 1 --2- 172.21.15.146:0/1242539206 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ebc1300a0 0x7f5ebc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.988+0000 7f5ec12f4700 1 -- 172.21.15.146:0/1242539206 >> 172.21.15.146:0/1242539206 conn(0x7f5ebc099c40 msgr2=0x7f5ebc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.988+0000 7f5ec12f4700 1 -- 172.21.15.146:0/1242539206 shutdown_connections 2023-10-03T10:16:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.988+0000 7f5ec12f4700 1 -- 172.21.15.146:0/1242539206 wait complete. 2023-10-03T10:16:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.989+0000 7f5ec12f4700 1 Processor -- start 2023-10-03T10:16:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.989+0000 7f5ec12f4700 1 -- start start 2023-10-03T10:16:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.990+0000 7f5ec12f4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ebc1300a0 0x7f5ebc11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.990+0000 7f5ec12f4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ebc1309f0 0x7f5ebc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.990+0000 7f5ec12f4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ebc133ad0 0x7f5ebc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.990+0000 7f5ec12f4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc11fd00 con 0x7f5ebc133ad0 2023-10-03T10:16:50.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.990+0000 7f5ec12f4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc11ff50 con 0x7f5ebc1309f0 2023-10-03T10:16:50.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.990+0000 7f5ec12f4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc072720 con 0x7f5ebc1300a0 2023-10-03T10:16:50.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.990+0000 7f5eba7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ebc1309f0 0x7f5ebc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.990+0000 7f5eba7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ebc1309f0 0x7f5ebc11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56534/0 (socket says 172.21.15.146:56534) 2023-10-03T10:16:50.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.990+0000 7f5eba7fc700 1 -- 172.21.15.146:0/2864711922 learned_addr learned my addr 172.21.15.146:0/2864711922 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:50.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.990+0000 7f5ebb7fe700 1 --2- 172.21.15.146:0/2864711922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ebc133ad0 0x7f5ebc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.990+0000 7f5ebaffd700 1 --2- 172.21.15.146:0/2864711922 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ebc1300a0 0x7f5ebc11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.990+0000 7f5eba7fc700 1 -- 172.21.15.146:0/2864711922 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ebc1300a0 msgr2=0x7f5ebc11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.990+0000 7f5eba7fc700 1 --2- 172.21.15.146:0/2864711922 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ebc1300a0 0x7f5ebc11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.990+0000 7f5eba7fc700 1 -- 172.21.15.146:0/2864711922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ebc133ad0 msgr2=0x7f5ebc11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.990+0000 7f5eba7fc700 1 --2- 172.21.15.146:0/2864711922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ebc133ad0 0x7f5ebc11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.990+0000 7f5eba7fc700 1 -- 172.21.15.146:0/2864711922 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac009550 con 0x7f5ebc1309f0 2023-10-03T10:16:50.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.990+0000 7f5eba7fc700 1 --2- 172.21.15.146:0/2864711922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ebc1309f0 0x7f5ebc11df80 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000e9b0 tx=0x7f5eb000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.991+0000 7f5ea37fe700 1 -- 172.21.15.146:0/2864711922 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0009710 con 0x7f5ebc1309f0 2023-10-03T10:16:50.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.991+0000 7f5ea37fe700 1 -- 172.21.15.146:0/2864711922 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb000c850 con 0x7f5ebc1309f0 2023-10-03T10:16:50.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.991+0000 7f5ea37fe700 1 -- 172.21.15.146:0/2864711922 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb000cbc0 con 0x7f5ebc1309f0 2023-10-03T10:16:50.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.991+0000 7f5ec12f4700 1 -- 172.21.15.146:0/2864711922 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ebc120850 con 0x7f5ebc1309f0 2023-10-03T10:16:50.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.991+0000 7f5ec12f4700 1 -- 172.21.15.146:0/2864711922 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ebc071fd0 con 0x7f5ebc1309f0 2023-10-03T10:16:50.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.992+0000 7f5ea37fe700 1 -- 172.21.15.146:0/2864711922 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5eb000cd20 con 0x7f5ebc1309f0 2023-10-03T10:16:50.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.992+0000 7f5ec12f4700 1 -- 172.21.15.146:0/2864711922 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ebc0a2620 con 0x7f5ebc1309f0 2023-10-03T10:16:50.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.992+0000 7f5ea37fe700 1 -- 172.21.15.146:0/2864711922 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5eb003f7f0 con 0x7f5ebc1309f0 2023-10-03T10:16:50.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:50.997+0000 7f5ea37fe700 1 -- 172.21.15.146:0/2864711922 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5eb0013990 con 0x7f5ebc1309f0 2023-10-03T10:16:51.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.069+0000 7f544b945700 1 Processor -- start 2023-10-03T10:16:51.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.069+0000 7f544b945700 1 -- start start 2023-10-03T10:16:51.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.070+0000 7f544b945700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f544409e870 0x7f544409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.070+0000 7f544b945700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f544409f180 0x7f5444131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.070+0000 7f544b945700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5444131d70 0x7f5444132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.070+0000 7f544b945700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54440a0920 con 0x7f544409f180 2023-10-03T10:16:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.070+0000 7f544b945700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544409c970 con 0x7f544409e870 2023-10-03T10:16:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.070+0000 7f544b945700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f544409bab0 con 0x7f5444131d70 2023-10-03T10:16:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.070+0000 7f54496e1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f544409e870 0x7f544409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.070+0000 7f54496e1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f544409e870 0x7f544409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56548/0 (socket says 172.21.15.146:56548) 2023-10-03T10:16:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.070+0000 7f54496e1700 1 -- 172.21.15.146:0/1793846201 learned_addr learned my addr 172.21.15.146:0/1793846201 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.070+0000 7f5449ee2700 1 --2- 172.21.15.146:0/1793846201 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5444131d70 0x7f5444132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.070+0000 7f5448ee0700 1 --2- 172.21.15.146:0/1793846201 >> v2:172.21.15.146:3300/0 conn(0x7f544409f180 0x7f5444131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.070+0000 7f54496e1700 1 -- 172.21.15.146:0/1793846201 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5444131d70 msgr2=0x7f5444132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.070+0000 7f54496e1700 1 --2- 172.21.15.146:0/1793846201 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5444131d70 0x7f5444132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.070+0000 7f54496e1700 1 -- 172.21.15.146:0/1793846201 >> v2:172.21.15.146:3300/0 conn(0x7f544409f180 msgr2=0x7f5444131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.070+0000 7f54496e1700 1 --2- 172.21.15.146:0/1793846201 >> v2:172.21.15.146:3300/0 conn(0x7f544409f180 0x7f5444131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.070+0000 7f54496e1700 1 -- 172.21.15.146:0/1793846201 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544409f9c0 con 0x7f544409e870 2023-10-03T10:16:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.071+0000 7f5449ee2700 1 --2- 172.21.15.146:0/1793846201 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5444131d70 0x7f5444132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.071+0000 7f5448ee0700 1 --2- 172.21.15.146:0/1793846201 >> v2:172.21.15.146:3300/0 conn(0x7f544409f180 0x7f5444131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.071+0000 7f54496e1700 1 --2- 172.21.15.146:0/1793846201 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f544409e870 0x7f544409ec40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5440009920 tx=0x7f5440009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c4b0882930bdd8b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.071+0000 7f543bfff700 1 -- 172.21.15.146:0/1793846201 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440011830 con 0x7f544409e870 2023-10-03T10:16:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.071+0000 7f543bfff700 1 -- 172.21.15.146:0/1793846201 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5440011990 con 0x7f544409e870 2023-10-03T10:16:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.071+0000 7f543bfff700 1 -- 172.21.15.146:0/1793846201 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440011d20 con 0x7f544409e870 2023-10-03T10:16:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.071+0000 7f544b945700 1 -- 172.21.15.146:0/1793846201 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f544409e870 msgr2=0x7f544409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.071+0000 7f544b945700 1 --2- 172.21.15.146:0/1793846201 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f544409e870 0x7f544409ec40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5440009920 tx=0x7f5440009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.072+0000 7f544b945700 1 -- 172.21.15.146:0/1793846201 shutdown_connections 2023-10-03T10:16:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.072+0000 7f544b945700 1 --2- 172.21.15.146:0/1793846201 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f544409e870 0x7f544409ec40 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.072+0000 7f544b945700 1 --2- 172.21.15.146:0/1793846201 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5444131d70 0x7f5444132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.072+0000 7f544b945700 1 --2- 172.21.15.146:0/1793846201 >> v2:172.21.15.146:3300/0 conn(0x7f544409f180 0x7f5444131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.072+0000 7f544b945700 1 -- 172.21.15.146:0/1793846201 >> 172.21.15.146:0/1793846201 conn(0x7f54440a4430 msgr2=0x7f54440a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.072+0000 7f544b945700 1 -- 172.21.15.146:0/1793846201 shutdown_connections 2023-10-03T10:16:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.072+0000 7f544b945700 1 -- 172.21.15.146:0/1793846201 wait complete. 2023-10-03T10:16:51.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.073+0000 7f544b945700 1 Processor -- start 2023-10-03T10:16:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.073+0000 7f544b945700 1 -- start start 2023-10-03T10:16:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.073+0000 7f544b945700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f544409e870 0x7f5444120240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.073+0000 7f544b945700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f544409f180 0x7f5444120780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.073+0000 7f544b945700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5444131d70 0x7f5444120cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.073+0000 7f544b945700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54441316a0 con 0x7f544409e870 2023-10-03T10:16:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.073+0000 7f544b945700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5444122ce0 con 0x7f544409f180 2023-10-03T10:16:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.073+0000 7f544b945700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5444123d60 con 0x7f5444131d70 2023-10-03T10:16:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.073+0000 7f5448ee0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f544409f180 0x7f5444120780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.073+0000 7f5448ee0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f544409f180 0x7f5444120780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56564/0 (socket says 172.21.15.146:56564) 2023-10-03T10:16:51.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.073+0000 7f5448ee0700 1 -- 172.21.15.146:0/3989114663 learned_addr learned my addr 172.21.15.146:0/3989114663 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.073+0000 7f54496e1700 1 --2- 172.21.15.146:0/3989114663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f544409e870 0x7f5444120240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.073+0000 7f5449ee2700 1 --2- 172.21.15.146:0/3989114663 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5444131d70 0x7f5444120cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.073+0000 7f5448ee0700 1 -- 172.21.15.146:0/3989114663 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5444131d70 msgr2=0x7f5444120cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.073+0000 7f5448ee0700 1 --2- 172.21.15.146:0/3989114663 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5444131d70 0x7f5444120cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.073+0000 7f5448ee0700 1 -- 172.21.15.146:0/3989114663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f544409e870 msgr2=0x7f5444120240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.073+0000 7f5448ee0700 1 --2- 172.21.15.146:0/3989114663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f544409e870 0x7f5444120240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.073+0000 7f5448ee0700 1 -- 172.21.15.146:0/3989114663 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54340094a0 con 0x7f544409f180 2023-10-03T10:16:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.074+0000 7f5448ee0700 1 --2- 172.21.15.146:0/3989114663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f544409f180 0x7f5444120780 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f543400ebb0 tx=0x7f543400eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.074+0000 7f5439ffb700 1 -- 172.21.15.146:0/3989114663 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5434009e80 con 0x7f544409f180 2023-10-03T10:16:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.074+0000 7f5439ffb700 1 -- 172.21.15.146:0/3989114663 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543400c850 con 0x7f544409f180 2023-10-03T10:16:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.074+0000 7f5439ffb700 1 -- 172.21.15.146:0/3989114663 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543400cbc0 con 0x7f544409f180 2023-10-03T10:16:51.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.074+0000 7f544b945700 1 -- 172.21.15.146:0/3989114663 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543c009a70 con 0x7f544409f180 2023-10-03T10:16:51.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.074+0000 7f544b945700 1 -- 172.21.15.146:0/3989114663 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5440009550 con 0x7f544409f180 2023-10-03T10:16:51.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.075+0000 7f5439ffb700 1 -- 172.21.15.146:0/3989114663 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f543400cd20 con 0x7f544409f180 2023-10-03T10:16:51.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.075+0000 7f5439ffb700 1 -- 172.21.15.146:0/3989114663 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f543403f880 con 0x7f544409f180 2023-10-03T10:16:51.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.075+0000 7f544b945700 1 -- 172.21.15.146:0/3989114663 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f544411d580 con 0x7f544409f180 2023-10-03T10:16:51.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.080+0000 7f5439ffb700 1 -- 172.21.15.146:0/3989114663 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f54340232f0 con 0x7f544409f180 2023-10-03T10:16:51.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.110+0000 7fb8af0d0700 1 Processor -- start 2023-10-03T10:16:51.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.110+0000 7fb8af0d0700 1 -- start start 2023-10-03T10:16:51.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.110+0000 7fb8af0d0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a80a0a70 0x7fb8a80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.110+0000 7fb8af0d0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8a80a1380 0x7fb8a8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.110+0000 7fb8af0d0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a809dc00 con 0x7fb8a8133f50 2023-10-03T10:16:51.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.110+0000 7fb8af0d0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a809ea60 con 0x7fb8a80a1380 2023-10-03T10:16:51.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.110+0000 7fb8af0d0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a809dec0 con 0x7fb8a80a0a70 2023-10-03T10:16:51.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.110+0000 7fb8ace6c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a80a0a70 0x7fb8a80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.110+0000 7fb8ace6c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a80a0a70 0x7fb8a80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56572/0 (socket says 172.21.15.146:56572) 2023-10-03T10:16:51.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.110+0000 7fb8ace6c700 1 -- 172.21.15.146:0/1123506959 learned_addr learned my addr 172.21.15.146:0/1123506959 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:51.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.110+0000 7fb8a7fff700 1 --2- 172.21.15.146:0/1123506959 >> v2:172.21.15.146:3300/0 conn(0x7fb8a80a1380 0x7fb8a8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.111+0000 7fb8ace6c700 1 -- 172.21.15.146:0/1123506959 >> v2:172.21.15.146:3300/0 conn(0x7fb8a80a1380 msgr2=0x7fb8a8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:51.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.111+0000 7fb8ace6c700 1 --2- 172.21.15.146:0/1123506959 >> v2:172.21.15.146:3300/0 conn(0x7fb8a80a1380 0x7fb8a8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.111+0000 7fb8ace6c700 1 -- 172.21.15.146:0/1123506959 >> v1:172.21.15.146:6789/0 conn(0x7fb8a8133f50 legacy=0x7fb8a813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.111+0000 7fb8a77fe700 1 -- 172.21.15.146:0/1123506959 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 124815511 0 0) 0x7fb8a809dc00 con 0x7fb8a8133f50 2023-10-03T10:16:51.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.111+0000 7fb8ace6c700 1 -- 172.21.15.146:0/1123506959 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a809e6a0 con 0x7fb8a80a0a70 2023-10-03T10:16:51.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.111+0000 7fb8a7fff700 1 --2- 172.21.15.146:0/1123506959 >> v2:172.21.15.146:3300/0 conn(0x7fb8a80a1380 0x7fb8a8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.111+0000 7fb8ace6c700 1 --2- 172.21.15.146:0/1123506959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a80a0a70 0x7fb8a80a0e40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb89c0098f0 tx=0x7fb89c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dff7746ede1feb4f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.111+0000 7fb8a77fe700 1 -- 172.21.15.146:0/1123506959 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c011830 con 0x7fb8a80a0a70 2023-10-03T10:16:51.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.111+0000 7fb8a77fe700 1 -- 172.21.15.146:0/1123506959 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c011990 con 0x7fb8a80a0a70 2023-10-03T10:16:51.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.111+0000 7fb8a77fe700 1 -- 172.21.15.146:0/1123506959 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c011d20 con 0x7fb8a80a0a70 2023-10-03T10:16:51.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.112+0000 7fb8af0d0700 1 -- 172.21.15.146:0/1123506959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a80a0a70 msgr2=0x7fb8a80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.112+0000 7fb8af0d0700 1 --2- 172.21.15.146:0/1123506959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a80a0a70 0x7fb8a80a0e40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb89c0098f0 tx=0x7fb89c009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:51.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.112+0000 7fb8af0d0700 1 -- 172.21.15.146:0/1123506959 shutdown_connections 2023-10-03T10:16:51.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.112+0000 7fb8af0d0700 1 --2- 172.21.15.146:0/1123506959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a80a0a70 0x7fb8a80a0e40 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.112+0000 7fb8af0d0700 1 --2- 172.21.15.146:0/1123506959 >> v2:172.21.15.146:3300/0 conn(0x7fb8a80a1380 0x7fb8a8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.112+0000 7fb8af0d0700 1 -- 172.21.15.146:0/1123506959 >> 172.21.15.146:0/1123506959 conn(0x7fb8a80a6610 msgr2=0x7fb8a80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.112+0000 7fb8af0d0700 1 -- 172.21.15.146:0/1123506959 shutdown_connections 2023-10-03T10:16:51.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.112+0000 7fb8af0d0700 1 -- 172.21.15.146:0/1123506959 wait complete. 2023-10-03T10:16:51.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.113+0000 7fb8af0d0700 1 Processor -- start 2023-10-03T10:16:51.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.113+0000 7fb8af0d0700 1 -- start start 2023-10-03T10:16:51.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.114+0000 7fb8af0d0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8a80a0a70 0x7fb8a8122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.114+0000 7fb8af0d0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a80a1380 0x7fb8a8122d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.114+0000 7fb8af0d0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8a8133f50 0x7fb8a81232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.114+0000 7fb8af0d0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a8126140 con 0x7fb8a8133f50 2023-10-03T10:16:51.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.114+0000 7fb8af0d0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a81244d0 con 0x7fb8a80a1380 2023-10-03T10:16:51.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.114+0000 7fb8af0d0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a8126340 con 0x7fb8a80a0a70 2023-10-03T10:16:51.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.114+0000 7fb8ad66d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8a8133f50 0x7fb8a81232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.114+0000 7fb8ad66d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8a8133f50 0x7fb8a81232a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58464/0 (socket says 172.21.15.146:58464) 2023-10-03T10:16:51.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.114+0000 7fb8ad66d700 1 -- 172.21.15.146:0/2501995569 learned_addr learned my addr 172.21.15.146:0/2501995569 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:51.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.114+0000 7fb8a7fff700 1 --2- 172.21.15.146:0/2501995569 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a80a1380 0x7fb8a8122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.115+0000 7fb8ad66d700 1 -- 172.21.15.146:0/2501995569 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8a80a0a70 msgr2=0x7fb8a8122820 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-03T10:16:51.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.115+0000 7fb8ad66d700 1 --2- 172.21.15.146:0/2501995569 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8a80a0a70 0x7fb8a8122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.115+0000 7fb8ad66d700 1 -- 172.21.15.146:0/2501995569 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a80a1380 msgr2=0x7fb8a8122d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.115+0000 7fb8ad66d700 1 --2- 172.21.15.146:0/2501995569 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a80a1380 0x7fb8a8122d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.115+0000 7fb8ad66d700 1 -- 172.21.15.146:0/2501995569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8940094a0 con 0x7fb8a8133f50 2023-10-03T10:16:51.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.115+0000 7fb8a7fff700 1 --2- 172.21.15.146:0/2501995569 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a80a1380 0x7fb8a8122d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.115+0000 7fb8ad66d700 1 --2- 172.21.15.146:0/2501995569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8a8133f50 0x7fb8a81232a0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fb8a000c870 tx=0x7fb8a000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.115+0000 7fb8a57fa700 1 -- 172.21.15.146:0/2501995569 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0003e30 con 0x7fb8a8133f50 2023-10-03T10:16:51.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.115+0000 7fb8a57fa700 1 -- 172.21.15.146:0/2501995569 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a0005070 con 0x7fb8a8133f50 2023-10-03T10:16:51.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.115+0000 7fb8af0d0700 1 -- 172.21.15.146:0/2501995569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb89c009550 con 0x7fb8a8133f50 2023-10-03T10:16:51.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.115+0000 7fb8a57fa700 1 -- 172.21.15.146:0/2501995569 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0005420 con 0x7fb8a8133f50 2023-10-03T10:16:51.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.115+0000 7fb8af0d0700 1 -- 172.21.15.146:0/2501995569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a8125da0 con 0x7fb8a8133f50 2023-10-03T10:16:51.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.116+0000 7fb8af0d0700 1 -- 172.21.15.146:0/2501995569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a804f2a0 con 0x7fb8a8133f50 2023-10-03T10:16:51.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.116+0000 7fb8a57fa700 1 -- 172.21.15.146:0/2501995569 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8a0005580 con 0x7fb8a8133f50 2023-10-03T10:16:51.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.117+0000 7fb8a57fa700 1 -- 172.21.15.146:0/2501995569 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb8a003ee10 con 0x7fb8a8133f50 2023-10-03T10:16:51.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.121+0000 7fb8a57fa700 1 -- 172.21.15.146:0/2501995569 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8a0010770 con 0x7fb8a8133f50 2023-10-03T10:16:51.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.207+0000 7f5ec12f4700 1 -- 172.21.15.146:0/2864711922 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5ebc04f2a0 con 0x7f5ebc1309f0 2023-10-03T10:16:51.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.208+0000 7f5ea37fe700 1 -- 172.21.15.146:0/2864711922 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5eb001ae80 con 0x7f5ebc1309f0 2023-10-03T10:16:51.207 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:51.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.211+0000 7f5ec12f4700 1 -- 172.21.15.146:0/2864711922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ebc1309f0 msgr2=0x7f5ebc11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.211+0000 7f5ec12f4700 1 --2- 172.21.15.146:0/2864711922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ebc1309f0 0x7f5ebc11df80 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000e9b0 tx=0x7f5eb000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.211+0000 7f5ec12f4700 1 -- 172.21.15.146:0/2864711922 shutdown_connections 2023-10-03T10:16:51.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.211+0000 7f5ec12f4700 1 --2- 172.21.15.146:0/2864711922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ebc133ad0 0x7f5ebc11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.211+0000 7f5ec12f4700 1 --2- 172.21.15.146:0/2864711922 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ebc1300a0 0x7f5ebc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.211+0000 7f5ec12f4700 1 --2- 172.21.15.146:0/2864711922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ebc1309f0 0x7f5ebc11df80 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.211+0000 7f5ec12f4700 1 -- 172.21.15.146:0/2864711922 >> 172.21.15.146:0/2864711922 conn(0x7f5ebc099c40 msgr2=0x7f5ebc132c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.211+0000 7f5ec12f4700 1 -- 172.21.15.146:0/2864711922 shutdown_connections 2023-10-03T10:16:51.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.211+0000 7f5ec12f4700 1 -- 172.21.15.146:0/2864711922 wait complete. 2023-10-03T10:16:51.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:51.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.294+0000 7f544b945700 1 -- 172.21.15.146:0/3989114663 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5444123100 con 0x7f544409f180 2023-10-03T10:16:51.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.294+0000 7f5439ffb700 1 -- 172.21.15.146:0/3989114663 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f543401bb60 con 0x7f544409f180 2023-10-03T10:16:51.295 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:51.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.296+0000 7f544b945700 1 -- 172.21.15.146:0/3989114663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f544409f180 msgr2=0x7f5444120780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.296+0000 7f544b945700 1 --2- 172.21.15.146:0/3989114663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f544409f180 0x7f5444120780 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f543400ebb0 tx=0x7f543400eec0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.297+0000 7f544b945700 1 -- 172.21.15.146:0/3989114663 shutdown_connections 2023-10-03T10:16:51.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.297+0000 7f544b945700 1 --2- 172.21.15.146:0/3989114663 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5444131d70 0x7f5444120cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.297+0000 7f544b945700 1 --2- 172.21.15.146:0/3989114663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f544409e870 0x7f5444120240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.297+0000 7f544b945700 1 --2- 172.21.15.146:0/3989114663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f544409f180 0x7f5444120780 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.297+0000 7f544b945700 1 -- 172.21.15.146:0/3989114663 >> 172.21.15.146:0/3989114663 conn(0x7f54440a4430 msgr2=0x7f544411a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.297+0000 7f544b945700 1 -- 172.21.15.146:0/3989114663 shutdown_connections 2023-10-03T10:16:51.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.297+0000 7f544b945700 1 -- 172.21.15.146:0/3989114663 wait complete. 2023-10-03T10:16:51.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:51.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.315+0000 7fb8af0d0700 1 -- 172.21.15.146:0/2501995569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb8a81339b0 con 0x7fb8a8133f50 2023-10-03T10:16:51.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.315+0000 7fb8a57fa700 1 -- 172.21.15.146:0/2501995569 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb8a0017020 con 0x7fb8a8133f50 2023-10-03T10:16:51.315 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:51.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.317+0000 7fb8af0d0700 1 -- 172.21.15.146:0/2501995569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8a8133f50 msgr2=0x7fb8a81232a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.317+0000 7fb8af0d0700 1 --2- 172.21.15.146:0/2501995569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8a8133f50 0x7fb8a81232a0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fb8a000c870 tx=0x7fb8a000cb80 comp rx=0 tx=0).stop 2023-10-03T10:16:51.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.318+0000 7fb8af0d0700 1 -- 172.21.15.146:0/2501995569 shutdown_connections 2023-10-03T10:16:51.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.318+0000 7fb8af0d0700 1 --2- 172.21.15.146:0/2501995569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8a8133f50 0x7fb8a81232a0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.318+0000 7fb8af0d0700 1 --2- 172.21.15.146:0/2501995569 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8a80a0a70 0x7fb8a8122820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.318+0000 7fb8af0d0700 1 --2- 172.21.15.146:0/2501995569 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8a80a1380 0x7fb8a8122d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.318+0000 7fb8af0d0700 1 -- 172.21.15.146:0/2501995569 >> 172.21.15.146:0/2501995569 conn(0x7fb8a80a6610 msgr2=0x7fb8a80a4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.318+0000 7fb8af0d0700 1 -- 172.21.15.146:0/2501995569 shutdown_connections 2023-10-03T10:16:51.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.318+0000 7fb8af0d0700 1 -- 172.21.15.146:0/2501995569 wait complete. 2023-10-03T10:16:51.329 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:51.786 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:51.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.911+0000 7fd1c298e700 1 Processor -- start 2023-10-03T10:16:51.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.911+0000 7fd1c298e700 1 -- start start 2023-10-03T10:16:51.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.911+0000 7fd1c298e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1bc09e870 0x7fd1bc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.912+0000 7fd1c298e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd1bc09f180 0x7fd1bc133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.912+0000 7fd1c298e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1bc09fa00 con 0x7fd1bc134160 2023-10-03T10:16:51.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.912+0000 7fd1c298e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1bc0a0370 con 0x7fd1bc09f180 2023-10-03T10:16:51.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.912+0000 7fd1c298e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc06bec0 con 0x7fd1bc09e870 2023-10-03T10:16:51.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.912+0000 7fd1bbfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1bc09e870 0x7fd1bc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.912+0000 7fd1bb7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd1bc09f180 0x7fd1bc133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.912+0000 7fd1bbfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1bc09e870 0x7fd1bc09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57574/0 (socket says 172.21.15.146:57574) 2023-10-03T10:16:51.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.912+0000 7fd1bb7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd1bc09f180 0x7fd1bc133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58476/0 (socket says 172.21.15.146:58476) 2023-10-03T10:16:51.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.912+0000 7fd1bbfff700 1 -- 172.21.15.146:0/1285790224 learned_addr learned my addr 172.21.15.146:0/1285790224 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:51.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.912+0000 7fd1bb7fe700 1 -- 172.21.15.146:0/1285790224 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1bc09e870 msgr2=0x7fd1bc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:51.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.912+0000 7fd1bb7fe700 1 --2- 172.21.15.146:0/1285790224 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1bc09e870 0x7fd1bc09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.912+0000 7fd1bb7fe700 1 -- 172.21.15.146:0/1285790224 >> v1:172.21.15.146:6789/0 conn(0x7fd1bc134160 legacy=0x7fd1bc13ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.912+0000 7fd1bb7fe700 1 -- 172.21.15.146:0/1285790224 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc09ada0 con 0x7fd1bc09f180 2023-10-03T10:16:51.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.912+0000 7fd1bbfff700 1 --2- 172.21.15.146:0/1285790224 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1bc09e870 0x7fd1bc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.912+0000 7fd1bb7fe700 1 --2- 172.21.15.146:0/1285790224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1bc09f180 0x7fd1bc133c20 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0009840 tx=0x7fd1b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cd5f8f6348d59 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.912+0000 7fd1baffd700 1 -- 172.21.15.146:0/1285790224 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b0011830 con 0x7fd1bc09f180 2023-10-03T10:16:51.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.912+0000 7fd1baffd700 1 -- 172.21.15.146:0/1285790224 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b0011990 con 0x7fd1bc09f180 2023-10-03T10:16:51.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.912+0000 7fd1baffd700 1 -- 172.21.15.146:0/1285790224 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b0011d20 con 0x7fd1bc09f180 2023-10-03T10:16:51.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.913+0000 7fd1c298e700 1 -- 172.21.15.146:0/1285790224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1bc09f180 msgr2=0x7fd1bc133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.913+0000 7fd1c298e700 1 --2- 172.21.15.146:0/1285790224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1bc09f180 0x7fd1bc133c20 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0009840 tx=0x7fd1b0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:51.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.913+0000 7fd1c298e700 1 -- 172.21.15.146:0/1285790224 shutdown_connections 2023-10-03T10:16:51.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.913+0000 7fd1c298e700 1 --2- 172.21.15.146:0/1285790224 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1bc09e870 0x7fd1bc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.913+0000 7fd1c298e700 1 --2- 172.21.15.146:0/1285790224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1bc09f180 0x7fd1bc133c20 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.913+0000 7fd1c298e700 1 -- 172.21.15.146:0/1285790224 >> 172.21.15.146:0/1285790224 conn(0x7fd1bc0a4430 msgr2=0x7fd1bc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.913+0000 7fd1c298e700 1 -- 172.21.15.146:0/1285790224 shutdown_connections 2023-10-03T10:16:51.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.913+0000 7fd1c298e700 1 -- 172.21.15.146:0/1285790224 wait complete. 2023-10-03T10:16:51.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.914+0000 7fd1c298e700 1 Processor -- start 2023-10-03T10:16:51.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.914+0000 7fd1c298e700 1 -- start start 2023-10-03T10:16:51.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.914+0000 7fd1c298e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1bc09e870 0x7fd1bc122ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.914+0000 7fd1c298e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1bc09f180 0x7fd1bc123010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.914+0000 7fd1c298e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1bc134160 0x7fd1bc123550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.914+0000 7fd1c298e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc06fb80 con 0x7fd1bc09e870 2023-10-03T10:16:51.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.914+0000 7fd1c298e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc1335f0 con 0x7fd1bc09f180 2023-10-03T10:16:51.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.914+0000 7fd1c298e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc1247f0 con 0x7fd1bc134160 2023-10-03T10:16:51.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.914+0000 7fd1bbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1bc09e870 0x7fd1bc122ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.915+0000 7fd1bbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1bc09e870 0x7fd1bc122ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58488/0 (socket says 172.21.15.146:58488) 2023-10-03T10:16:51.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.915+0000 7fd1c0f2b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1bc134160 0x7fd1bc123550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.915+0000 7fd1bbfff700 1 -- 172.21.15.146:0/1557223348 learned_addr learned my addr 172.21.15.146:0/1557223348 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:51.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.915+0000 7fd1bb7fe700 1 --2- 172.21.15.146:0/1557223348 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1bc09f180 0x7fd1bc123010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.915+0000 7fd1c0f2b700 1 -- 172.21.15.146:0/1557223348 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1bc09f180 msgr2=0x7fd1bc123010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.915+0000 7fd1c0f2b700 1 --2- 172.21.15.146:0/1557223348 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1bc09f180 0x7fd1bc123010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.915+0000 7fd1c0f2b700 1 -- 172.21.15.146:0/1557223348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1bc09e870 msgr2=0x7fd1bc122ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.915+0000 7fd1c0f2b700 1 --2- 172.21.15.146:0/1557223348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1bc09e870 0x7fd1bc122ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.915+0000 7fd1c0f2b700 1 -- 172.21.15.146:0/1557223348 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac009550 con 0x7fd1bc134160 2023-10-03T10:16:51.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.915+0000 7fd1bbfff700 1 --2- 172.21.15.146:0/1557223348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1bc09e870 0x7fd1bc122ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.915+0000 7fd1c0f2b700 1 --2- 172.21.15.146:0/1557223348 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1bc134160 0x7fd1bc123550 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400cb90 tx=0x7fd1b400cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.915+0000 7fd1b8ff9700 1 -- 172.21.15.146:0/1557223348 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4003c00 con 0x7fd1bc134160 2023-10-03T10:16:51.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.915+0000 7fd1b8ff9700 1 -- 172.21.15.146:0/1557223348 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b4003d60 con 0x7fd1bc134160 2023-10-03T10:16:51.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.915+0000 7fd1c298e700 1 -- 172.21.15.146:0/1557223348 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b00094a0 con 0x7fd1bc134160 2023-10-03T10:16:51.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.915+0000 7fd1b8ff9700 1 -- 172.21.15.146:0/1557223348 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400aa80 con 0x7fd1bc134160 2023-10-03T10:16:51.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.915+0000 7fd1c298e700 1 -- 172.21.15.146:0/1557223348 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1bc126310 con 0x7fd1bc134160 2023-10-03T10:16:51.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.916+0000 7fd1b8ff9700 1 -- 172.21.15.146:0/1557223348 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd1b400abe0 con 0x7fd1bc134160 2023-10-03T10:16:51.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.916+0000 7fd1b8ff9700 1 -- 172.21.15.146:0/1557223348 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd1b403f550 con 0x7fd1bc134160 2023-10-03T10:16:51.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.916+0000 7fd1c298e700 1 -- 172.21.15.146:0/1557223348 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1bc04f2a0 con 0x7fd1bc134160 2023-10-03T10:16:51.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:51.921+0000 7fd1b8ff9700 1 -- 172.21.15.146:0/1557223348 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1b40198f0 con 0x7fd1bc134160 2023-10-03T10:16:52.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.107+0000 7fd1c298e700 1 -- 172.21.15.146:0/1557223348 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd1bc06c9d0 con 0x7fd1bc134160 2023-10-03T10:16:52.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.107+0000 7fd1b8ff9700 1 -- 172.21.15.146:0/1557223348 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd1b4019300 con 0x7fd1bc134160 2023-10-03T10:16:52.107 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:52.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.110+0000 7fd1c298e700 1 -- 172.21.15.146:0/1557223348 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1bc134160 msgr2=0x7fd1bc123550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.110+0000 7fd1c298e700 1 --2- 172.21.15.146:0/1557223348 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1bc134160 0x7fd1bc123550 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400cb90 tx=0x7fd1b400cea0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.110+0000 7fd1c298e700 1 -- 172.21.15.146:0/1557223348 shutdown_connections 2023-10-03T10:16:52.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.110+0000 7fd1c298e700 1 --2- 172.21.15.146:0/1557223348 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd1bc134160 0x7fd1bc123550 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.110+0000 7fd1c298e700 1 --2- 172.21.15.146:0/1557223348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1bc09e870 0x7fd1bc122ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.110+0000 7fd1c298e700 1 --2- 172.21.15.146:0/1557223348 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1bc09f180 0x7fd1bc123010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.110+0000 7fd1c298e700 1 -- 172.21.15.146:0/1557223348 >> 172.21.15.146:0/1557223348 conn(0x7fd1bc0a4430 msgr2=0x7fd1bc09d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.110+0000 7fd1c298e700 1 -- 172.21.15.146:0/1557223348 shutdown_connections 2023-10-03T10:16:52.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.110+0000 7fd1c298e700 1 -- 172.21.15.146:0/1557223348 wait complete. 2023-10-03T10:16:52.122 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:52.228 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:52.309 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:52.330 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:52.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.354+0000 7f99b8a43700 1 Processor -- start 2023-10-03T10:16:52.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.354+0000 7f99b8a43700 1 -- start start 2023-10-03T10:16:52.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.355+0000 7f99b8a43700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f99b4134140 0x7f99b4138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.355+0000 7f99b8a43700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b41345a0 0x7f99b413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.355+0000 7f99b8a43700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b409b110 con 0x7f99b409ad40 2023-10-03T10:16:52.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.355+0000 7f99b8a43700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b40a3b60 con 0x7f99b4134140 2023-10-03T10:16:52.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.355+0000 7f99b8a43700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40a1a80 con 0x7f99b41345a0 2023-10-03T10:16:52.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.355+0000 7f99b1d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f99b4134140 0x7f99b4138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.355+0000 7f99b259c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f99b409ad40 0x7f99b4133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52820/0 (socket says 172.21.15.146:52820) 2023-10-03T10:16:52.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.355+0000 7f99b259c700 1 -- 172.21.15.146:0/1511894324 learned_addr learned my addr 172.21.15.146:0/1511894324 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:52.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.355+0000 7f99b2d9d700 1 --2- 172.21.15.146:0/1511894324 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b41345a0 0x7f99b413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.355+0000 7f99b1d9b700 1 -- 172.21.15.146:0/1511894324 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b41345a0 msgr2=0x7f99b413b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:52.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.355+0000 7f99b1d9b700 1 --2- 172.21.15.146:0/1511894324 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b41345a0 0x7f99b413b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.355+0000 7f99b1d9b700 1 -- 172.21.15.146:0/1511894324 >> v1:172.21.15.146:6789/0 conn(0x7f99b409ad40 legacy=0x7f99b4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.355+0000 7f99b1d9b700 1 -- 172.21.15.146:0/1511894324 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b40a2fa0 con 0x7f99b4134140 2023-10-03T10:16:52.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.355+0000 7f99b2d9d700 1 --2- 172.21.15.146:0/1511894324 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b41345a0 0x7f99b413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:52.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.356+0000 7f99b1d9b700 1 --2- 172.21.15.146:0/1511894324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b4134140 0x7f99b4138e80 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f99a8009840 tx=0x7f99a8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee60ef6e82c8fff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.356+0000 7f99b159a700 1 -- 172.21.15.146:0/1511894324 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8011830 con 0x7f99b4134140 2023-10-03T10:16:52.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.356+0000 7f99b159a700 1 -- 172.21.15.146:0/1511894324 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a8011990 con 0x7f99b4134140 2023-10-03T10:16:52.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.356+0000 7f99b159a700 1 -- 172.21.15.146:0/1511894324 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8011d20 con 0x7f99b4134140 2023-10-03T10:16:52.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.356+0000 7f99b8a43700 1 -- 172.21.15.146:0/1511894324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b4134140 msgr2=0x7f99b4138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.356+0000 7f99b8a43700 1 --2- 172.21.15.146:0/1511894324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b4134140 0x7f99b4138e80 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f99a8009840 tx=0x7f99a8009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:52.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.356+0000 7f99b8a43700 1 -- 172.21.15.146:0/1511894324 shutdown_connections 2023-10-03T10:16:52.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.356+0000 7f99b8a43700 1 --2- 172.21.15.146:0/1511894324 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b41345a0 0x7f99b413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.356+0000 7f99b8a43700 1 --2- 172.21.15.146:0/1511894324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b4134140 0x7f99b4138e80 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.356+0000 7f99b8a43700 1 -- 172.21.15.146:0/1511894324 >> 172.21.15.146:0/1511894324 conn(0x7f99b4099c40 msgr2=0x7f99b406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.357+0000 7f99b8a43700 1 -- 172.21.15.146:0/1511894324 shutdown_connections 2023-10-03T10:16:52.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.357+0000 7f99b8a43700 1 -- 172.21.15.146:0/1511894324 wait complete. 2023-10-03T10:16:52.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.358+0000 7f99b8a43700 1 Processor -- start 2023-10-03T10:16:52.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.358+0000 7f99b8a43700 1 -- start start 2023-10-03T10:16:52.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.358+0000 7f99b8a43700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b409ad40 0x7f99b411c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.358+0000 7f99b8a43700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99b4134140 0x7f99b411ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.358+0000 7f99b8a43700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b41345a0 0x7f99b411d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.358+0000 7f99b8a43700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b411df30 con 0x7f99b409ad40 2023-10-03T10:16:52.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.358+0000 7f99b8a43700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b411f920 con 0x7f99b41345a0 2023-10-03T10:16:52.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.358+0000 7f99b8a43700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99b409c7e0 con 0x7f99b4134140 2023-10-03T10:16:52.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.358+0000 7f99b259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b409ad40 0x7f99b411c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.358+0000 7f99b2d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b41345a0 0x7f99b411d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.358+0000 7f99b259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b409ad40 0x7f99b411c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58504/0 (socket says 172.21.15.146:58504) 2023-10-03T10:16:52.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.358+0000 7f99b259c700 1 -- 172.21.15.146:0/547197605 learned_addr learned my addr 172.21.15.146:0/547197605 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:52.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.358+0000 7f99b1d9b700 1 --2- 172.21.15.146:0/547197605 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99b4134140 0x7f99b411ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.359+0000 7f99b2d9d700 1 -- 172.21.15.146:0/547197605 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99b4134140 msgr2=0x7f99b411ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.359+0000 7f99b2d9d700 1 --2- 172.21.15.146:0/547197605 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99b4134140 0x7f99b411ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.359+0000 7f99b2d9d700 1 -- 172.21.15.146:0/547197605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b409ad40 msgr2=0x7f99b411c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.359+0000 7f99b2d9d700 1 --2- 172.21.15.146:0/547197605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b409ad40 0x7f99b411c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.359+0000 7f99b2d9d700 1 -- 172.21.15.146:0/547197605 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac009a70 con 0x7f99b41345a0 2023-10-03T10:16:52.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.359+0000 7f99b259c700 1 --2- 172.21.15.146:0/547197605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b409ad40 0x7f99b411c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:52.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.359+0000 7f99b1d9b700 1 --2- 172.21.15.146:0/547197605 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99b4134140 0x7f99b411ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:52.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.359+0000 7f99b2d9d700 1 --2- 172.21.15.146:0/547197605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b41345a0 0x7f99b411d340 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00efc0 tx=0x7f99ac00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.359+0000 7f99a2ffd700 1 -- 172.21.15.146:0/547197605 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac00cb40 con 0x7f99b41345a0 2023-10-03T10:16:52.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.359+0000 7f99a2ffd700 1 -- 172.21.15.146:0/547197605 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac00f040 con 0x7f99b41345a0 2023-10-03T10:16:52.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.359+0000 7f99b8a43700 1 -- 172.21.15.146:0/547197605 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a80094a0 con 0x7f99b41345a0 2023-10-03T10:16:52.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.359+0000 7f99a2ffd700 1 -- 172.21.15.146:0/547197605 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac003a20 con 0x7f99b41345a0 2023-10-03T10:16:52.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.359+0000 7f99b8a43700 1 -- 172.21.15.146:0/547197605 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b411efe0 con 0x7f99b41345a0 2023-10-03T10:16:52.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.360+0000 7f99b8a43700 1 -- 172.21.15.146:0/547197605 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b404f2a0 con 0x7f99b41345a0 2023-10-03T10:16:52.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.361+0000 7f99a2ffd700 1 -- 172.21.15.146:0/547197605 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f99ac014480 con 0x7f99b41345a0 2023-10-03T10:16:52.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.361+0000 7f99a2ffd700 1 -- 172.21.15.146:0/547197605 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f99ac040c00 con 0x7f99b41345a0 2023-10-03T10:16:52.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.365+0000 7f99a2ffd700 1 -- 172.21.15.146:0/547197605 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99ac01c590 con 0x7f99b41345a0 2023-10-03T10:16:52.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.439+0000 7f3c11a94700 1 Processor -- start 2023-10-03T10:16:52.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.439+0000 7f3c11a94700 1 -- start start 2023-10-03T10:16:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.439+0000 7f3c11a94700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c0c09e870 0x7f3c0c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.439+0000 7f3c11a94700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c0c09f180 0x7f3c0c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.439+0000 7f3c11a94700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c0c09c970 con 0x7f3c0c131d70 2023-10-03T10:16:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.439+0000 7f3c11a94700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c0a0920 con 0x7f3c0c09f180 2023-10-03T10:16:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.439+0000 7f3c11a94700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c09f9c0 con 0x7f3c0c09e870 2023-10-03T10:16:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.440+0000 7f3c0bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3c0c131d70 0x7f3c0c138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52834/0 (socket says 172.21.15.146:52834) 2023-10-03T10:16:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.440+0000 7f3c0b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c0c09e870 0x7f3c0c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.440+0000 7f3c0bfff700 1 -- 172.21.15.146:0/3797839819 learned_addr learned my addr 172.21.15.146:0/3797839819 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.440+0000 7f3c0affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c0c09f180 0x7f3c0c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.440+0000 7f3c0a7fc700 1 -- 172.21.15.146:0/3797839819 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769562382 0 0) 0x7f3c0c09c970 con 0x7f3c0c131d70 2023-10-03T10:16:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.440+0000 7f3c0affd700 1 -- 172.21.15.146:0/3797839819 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c0c09e870 msgr2=0x7f3c0c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.440+0000 7f3c0affd700 1 --2- 172.21.15.146:0/3797839819 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c0c09e870 0x7f3c0c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.440+0000 7f3c0affd700 1 -- 172.21.15.146:0/3797839819 >> v1:172.21.15.146:6789/0 conn(0x7f3c0c131d70 legacy=0x7f3c0c138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.440+0000 7f3c0affd700 1 -- 172.21.15.146:0/3797839819 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c09bab0 con 0x7f3c0c09f180 2023-10-03T10:16:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.440+0000 7f3c0b7fe700 1 --2- 172.21.15.146:0/3797839819 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c0c09e870 0x7f3c0c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.440+0000 7f3c0affd700 1 --2- 172.21.15.146:0/3797839819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c0c09f180 0x7f3c0c131830 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009870 tx=0x7f3c00009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4219dbeb57041d54 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.440+0000 7f3c0a7fc700 1 -- 172.21.15.146:0/3797839819 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00011830 con 0x7f3c0c09f180 2023-10-03T10:16:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.440+0000 7f3c0a7fc700 1 -- 172.21.15.146:0/3797839819 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c00011990 con 0x7f3c0c09f180 2023-10-03T10:16:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.440+0000 7f3c0a7fc700 1 -- 172.21.15.146:0/3797839819 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00011d20 con 0x7f3c0c09f180 2023-10-03T10:16:52.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.441+0000 7f3c11a94700 1 -- 172.21.15.146:0/3797839819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c0c09f180 msgr2=0x7f3c0c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.441+0000 7f3c11a94700 1 --2- 172.21.15.146:0/3797839819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c0c09f180 0x7f3c0c131830 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009870 tx=0x7f3c00009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.441+0000 7f3c11a94700 1 -- 172.21.15.146:0/3797839819 shutdown_connections 2023-10-03T10:16:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.441+0000 7f3c11a94700 1 --2- 172.21.15.146:0/3797839819 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c0c09e870 0x7f3c0c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.441+0000 7f3c11a94700 1 --2- 172.21.15.146:0/3797839819 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c0c09f180 0x7f3c0c131830 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.441+0000 7f3c11a94700 1 -- 172.21.15.146:0/3797839819 >> 172.21.15.146:0/3797839819 conn(0x7f3c0c0a4430 msgr2=0x7f3c0c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.441+0000 7f3c11a94700 1 -- 172.21.15.146:0/3797839819 shutdown_connections 2023-10-03T10:16:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.441+0000 7f3c11a94700 1 -- 172.21.15.146:0/3797839819 wait complete. 2023-10-03T10:16:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.443+0000 7f3c11a94700 1 Processor -- start 2023-10-03T10:16:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.443+0000 7f3c11a94700 1 -- start start 2023-10-03T10:16:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.444+0000 7f3c11a94700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c0c09e870 0x7f3c0c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.444+0000 7f3c11a94700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c0c09f180 0x7f3c0c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.444+0000 7f3c11a94700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c0c131d70 0x7f3c0c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.444+0000 7f3c11a94700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c130690 con 0x7f3c0c09e870 2023-10-03T10:16:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.444+0000 7f3c11a94700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c124860 con 0x7f3c0c131d70 2023-10-03T10:16:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.444+0000 7f3c11a94700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c123750 con 0x7f3c0c09f180 2023-10-03T10:16:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.444+0000 7f3c0b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c0c09e870 0x7f3c0c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.444+0000 7f3c0affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c0c09f180 0x7f3c0c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.444+0000 7f3c0bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c0c131d70 0x7f3c0c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.444+0000 7f3c0b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c0c09e870 0x7f3c0c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58518/0 (socket says 172.21.15.146:58518) 2023-10-03T10:16:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.444+0000 7f3c0b7fe700 1 -- 172.21.15.146:0/2128019985 learned_addr learned my addr 172.21.15.146:0/2128019985 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.444+0000 7f3c0affd700 1 -- 172.21.15.146:0/2128019985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c0c131d70 msgr2=0x7f3c0c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.444+0000 7f3c0affd700 1 --2- 172.21.15.146:0/2128019985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c0c131d70 0x7f3c0c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.444+0000 7f3c0affd700 1 -- 172.21.15.146:0/2128019985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c0c09e870 msgr2=0x7f3c0c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.444+0000 7f3c0affd700 1 --2- 172.21.15.146:0/2128019985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c0c09e870 0x7f3c0c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.444+0000 7f3c0affd700 1 -- 172.21.15.146:0/2128019985 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc0094a0 con 0x7f3c0c09f180 2023-10-03T10:16:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.444+0000 7f3c0bfff700 1 --2- 172.21.15.146:0/2128019985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c0c131d70 0x7f3c0c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:52.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.444+0000 7f3c0b7fe700 1 --2- 172.21.15.146:0/2128019985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c0c09e870 0x7f3c0c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:52.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.444+0000 7f3c0affd700 1 --2- 172.21.15.146:0/2128019985 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c0c09f180 0x7f3c0c06bdf0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3c00016000 tx=0x7f3c00004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.444+0000 7f3bf3fff700 1 -- 172.21.15.146:0/2128019985 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00004510 con 0x7f3c0c09f180 2023-10-03T10:16:52.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.445+0000 7f3bf3fff700 1 -- 172.21.15.146:0/2128019985 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0001f070 con 0x7f3c0c09f180 2023-10-03T10:16:52.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.445+0000 7f3bf3fff700 1 -- 172.21.15.146:0/2128019985 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c000038e0 con 0x7f3c0c09f180 2023-10-03T10:16:52.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.445+0000 7f3c11a94700 1 -- 172.21.15.146:0/2128019985 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c000094a0 con 0x7f3c0c09f180 2023-10-03T10:16:52.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.445+0000 7f3c11a94700 1 -- 172.21.15.146:0/2128019985 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0c124b70 con 0x7f3c0c09f180 2023-10-03T10:16:52.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.445+0000 7f3bf3fff700 1 -- 172.21.15.146:0/2128019985 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3c00003a40 con 0x7f3c0c09f180 2023-10-03T10:16:52.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.446+0000 7f3bf3fff700 1 -- 172.21.15.146:0/2128019985 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3c00021070 con 0x7f3c0c09f180 2023-10-03T10:16:52.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.446+0000 7f3c11a94700 1 -- 172.21.15.146:0/2128019985 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0c124b70 con 0x7f3c0c09f180 2023-10-03T10:16:52.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.455+0000 7f3bf3fff700 1 -- 172.21.15.146:0/2128019985 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3c0c124b70 con 0x7f3c0c09f180 2023-10-03T10:16:52.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.480+0000 7f387d44e700 1 Processor -- start 2023-10-03T10:16:52.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.481+0000 7f387d44e700 1 -- start start 2023-10-03T10:16:52.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.481+0000 7f387d44e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38781347b0 0x7f3878136b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.481+0000 7f387d44e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f38781370d0 0x7f38781394b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.481+0000 7f387d44e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387806f970 con 0x7f3878098410 2023-10-03T10:16:52.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.481+0000 7f387d44e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38780720a0 con 0x7f38781370d0 2023-10-03T10:16:52.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.481+0000 7f387d44e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3878098ef0 con 0x7f38781347b0 2023-10-03T10:16:52.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.482+0000 7f3876ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3878098410 0x7f38780987e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52838/0 (socket says 172.21.15.146:52838) 2023-10-03T10:16:52.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.482+0000 7f3876ffd700 1 -- 172.21.15.146:0/1401800996 learned_addr learned my addr 172.21.15.146:0/1401800996 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:52.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.482+0000 7f38777fe700 1 --2- 172.21.15.146:0/1401800996 >> v2:172.21.15.146:3300/0 conn(0x7f38781370d0 0x7f38781394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.482+0000 7f38777fe700 1 -- 172.21.15.146:0/1401800996 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38781347b0 msgr2=0x7f3878136b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:52.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.482+0000 7f38777fe700 1 --2- 172.21.15.146:0/1401800996 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38781347b0 0x7f3878136b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.482+0000 7f38777fe700 1 -- 172.21.15.146:0/1401800996 >> v1:172.21.15.146:6789/0 conn(0x7f3878098410 legacy=0x7f38780987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.482+0000 7f3875ffb700 1 -- 172.21.15.146:0/1401800996 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942970271 0 0) 0x7f387806f970 con 0x7f3878098410 2023-10-03T10:16:52.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.482+0000 7f38777fe700 1 -- 172.21.15.146:0/1401800996 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3878072290 con 0x7f38781370d0 2023-10-03T10:16:52.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.483+0000 7f38777fe700 1 --2- 172.21.15.146:0/1401800996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38781370d0 0x7f38781394b0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f3870009d90 tx=0x7f387000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abed161b04daf259 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.483+0000 7f3875ffb700 1 -- 172.21.15.146:0/1401800996 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387000e070 con 0x7f38781370d0 2023-10-03T10:16:52.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.483+0000 7f3875ffb700 1 -- 172.21.15.146:0/1401800996 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387000bbd0 con 0x7f38781370d0 2023-10-03T10:16:52.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.483+0000 7f3875ffb700 1 -- 172.21.15.146:0/1401800996 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3870012430 con 0x7f38781370d0 2023-10-03T10:16:52.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.484+0000 7f387d44e700 1 -- 172.21.15.146:0/1401800996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38781370d0 msgr2=0x7f38781394b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.484+0000 7f387d44e700 1 --2- 172.21.15.146:0/1401800996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38781370d0 0x7f38781394b0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f3870009d90 tx=0x7f387000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:52.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.484+0000 7f387d44e700 1 -- 172.21.15.146:0/1401800996 shutdown_connections 2023-10-03T10:16:52.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.484+0000 7f387d44e700 1 --2- 172.21.15.146:0/1401800996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38781370d0 0x7f38781394b0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.484+0000 7f387d44e700 1 --2- 172.21.15.146:0/1401800996 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38781347b0 0x7f3878136b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.484+0000 7f387d44e700 1 -- 172.21.15.146:0/1401800996 >> 172.21.15.146:0/1401800996 conn(0x7f38780a2b30 msgr2=0x7f387809e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.484+0000 7f387d44e700 1 -- 172.21.15.146:0/1401800996 shutdown_connections 2023-10-03T10:16:52.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.485+0000 7f387d44e700 1 -- 172.21.15.146:0/1401800996 wait complete. 2023-10-03T10:16:52.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.486+0000 7f387d44e700 1 Processor -- start 2023-10-03T10:16:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.486+0000 7f387d44e700 1 -- start start 2023-10-03T10:16:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.487+0000 7f387d44e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3878098410 0x7f38781cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.487+0000 7f387d44e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38781347b0 0x7f38781ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.487+0000 7f387d44e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f38781370d0 0x7f387806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.487+0000 7f387d44e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38780a1b70 con 0x7f3878098410 2023-10-03T10:16:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.487+0000 7f387d44e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38781cc5a0 con 0x7f38781347b0 2023-10-03T10:16:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.487+0000 7f387d44e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3878093dd0 con 0x7f38781370d0 2023-10-03T10:16:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.487+0000 7f38777fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f38781370d0 0x7f387806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.487+0000 7f38777fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f38781370d0 0x7f387806d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57618/0 (socket says 172.21.15.146:57618) 2023-10-03T10:16:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.487+0000 7f38777fe700 1 -- 172.21.15.146:0/1249418778 learned_addr learned my addr 172.21.15.146:0/1249418778 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.487+0000 7f3876ffd700 1 --2- 172.21.15.146:0/1249418778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3878098410 0x7f38781cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.487+0000 7f38767fc700 1 --2- 172.21.15.146:0/1249418778 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38781347b0 0x7f38781ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.488+0000 7f38777fe700 1 -- 172.21.15.146:0/1249418778 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38781347b0 msgr2=0x7f38781ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.488+0000 7f38777fe700 1 --2- 172.21.15.146:0/1249418778 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38781347b0 0x7f38781ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.488+0000 7f38777fe700 1 -- 172.21.15.146:0/1249418778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3878098410 msgr2=0x7f38781cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.488+0000 7f38777fe700 1 --2- 172.21.15.146:0/1249418778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3878098410 0x7f38781cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.488+0000 7f38777fe700 1 -- 172.21.15.146:0/1249418778 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3870009a70 con 0x7f38781370d0 2023-10-03T10:16:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.488+0000 7f38777fe700 1 --2- 172.21.15.146:0/1249418778 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f38781370d0 0x7f387806d6b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f387000b730 tx=0x7f3870004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.488+0000 7f385f7fe700 1 -- 172.21.15.146:0/1249418778 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3870012430 con 0x7f38781370d0 2023-10-03T10:16:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.488+0000 7f385f7fe700 1 -- 172.21.15.146:0/1249418778 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3870020070 con 0x7f38781370d0 2023-10-03T10:16:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.488+0000 7f385f7fe700 1 -- 172.21.15.146:0/1249418778 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3870004280 con 0x7f38781370d0 2023-10-03T10:16:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.489+0000 7f387d44e700 1 -- 172.21.15.146:0/1249418778 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3878070880 con 0x7f38781370d0 2023-10-03T10:16:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.489+0000 7f387d44e700 1 -- 172.21.15.146:0/1249418778 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387809bfc0 con 0x7f38781370d0 2023-10-03T10:16:52.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.490+0000 7f387d44e700 1 -- 172.21.15.146:0/1249418778 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f387806ff50 con 0x7f38781370d0 2023-10-03T10:16:52.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.491+0000 7f385f7fe700 1 -- 172.21.15.146:0/1249418778 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38700043e0 con 0x7f38781370d0 2023-10-03T10:16:52.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.491+0000 7f385f7fe700 1 -- 172.21.15.146:0/1249418778 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3870022070 con 0x7f38781370d0 2023-10-03T10:16:52.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.499+0000 7f385f7fe700 1 -- 172.21.15.146:0/1249418778 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f387806ff50 con 0x7f38781370d0 2023-10-03T10:16:52.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.576+0000 7f99b8a43700 1 -- 172.21.15.146:0/547197605 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f99b411ecc0 con 0x7f99b41345a0 2023-10-03T10:16:52.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.576+0000 7f99a2ffd700 1 -- 172.21.15.146:0/547197605 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f99ac01c3b0 con 0x7f99b41345a0 2023-10-03T10:16:52.576 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:52.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.578+0000 7f99b8a43700 1 -- 172.21.15.146:0/547197605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b41345a0 msgr2=0x7f99b411d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.578+0000 7f99b8a43700 1 --2- 172.21.15.146:0/547197605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b41345a0 0x7f99b411d340 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00efc0 tx=0x7f99ac00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.578+0000 7f99b8a43700 1 -- 172.21.15.146:0/547197605 shutdown_connections 2023-10-03T10:16:52.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.578+0000 7f99b8a43700 1 --2- 172.21.15.146:0/547197605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99b41345a0 0x7f99b411d340 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.578+0000 7f99b8a43700 1 --2- 172.21.15.146:0/547197605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b409ad40 0x7f99b411c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.578+0000 7f99b8a43700 1 --2- 172.21.15.146:0/547197605 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99b4134140 0x7f99b411ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.578+0000 7f99b8a43700 1 -- 172.21.15.146:0/547197605 >> 172.21.15.146:0/547197605 conn(0x7f99b4099c40 msgr2=0x7f99b413b130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.578+0000 7f99b8a43700 1 -- 172.21.15.146:0/547197605 shutdown_connections 2023-10-03T10:16:52.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.579+0000 7f99b8a43700 1 -- 172.21.15.146:0/547197605 wait complete. 2023-10-03T10:16:52.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:52.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.654+0000 7f3c11a94700 1 -- 172.21.15.146:0/2128019985 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3c0c124b70 con 0x7f3c0c09f180 2023-10-03T10:16:52.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.655+0000 7f3bf3fff700 1 -- 172.21.15.146:0/2128019985 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3c0c124b70 con 0x7f3c0c09f180 2023-10-03T10:16:52.654 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:52.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.657+0000 7f3c11a94700 1 -- 172.21.15.146:0/2128019985 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c0c09f180 msgr2=0x7f3c0c06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.657+0000 7f3c11a94700 1 --2- 172.21.15.146:0/2128019985 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c0c09f180 0x7f3c0c06bdf0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3c00016000 tx=0x7f3c00004750 comp rx=0 tx=0).stop 2023-10-03T10:16:52.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.657+0000 7f3c11a94700 1 -- 172.21.15.146:0/2128019985 shutdown_connections 2023-10-03T10:16:52.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.657+0000 7f3c11a94700 1 --2- 172.21.15.146:0/2128019985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c0c131d70 0x7f3c0c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.657+0000 7f3c11a94700 1 --2- 172.21.15.146:0/2128019985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c0c09e870 0x7f3c0c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.657+0000 7f3c11a94700 1 --2- 172.21.15.146:0/2128019985 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3c0c09f180 0x7f3c0c06bdf0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.657+0000 7f3c11a94700 1 -- 172.21.15.146:0/2128019985 >> 172.21.15.146:0/2128019985 conn(0x7f3c0c0a4430 msgr2=0x7f3c0c131040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.657+0000 7f3c11a94700 1 -- 172.21.15.146:0/2128019985 shutdown_connections 2023-10-03T10:16:52.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.657+0000 7f3c11a94700 1 -- 172.21.15.146:0/2128019985 wait complete. 2023-10-03T10:16:52.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:52.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.692+0000 7f387d44e700 1 -- 172.21.15.146:0/1249418778 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3878093f10 con 0x7f38781370d0 2023-10-03T10:16:52.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.692+0000 7f385f7fe700 1 -- 172.21.15.146:0/1249418778 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3878093f10 con 0x7f38781370d0 2023-10-03T10:16:52.692 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:52.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.694+0000 7f387d44e700 1 -- 172.21.15.146:0/1249418778 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f38781370d0 msgr2=0x7f387806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.694+0000 7f387d44e700 1 --2- 172.21.15.146:0/1249418778 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f38781370d0 0x7f387806d6b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f387000b730 tx=0x7f3870004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.695+0000 7f387d44e700 1 -- 172.21.15.146:0/1249418778 shutdown_connections 2023-10-03T10:16:52.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.695+0000 7f387d44e700 1 --2- 172.21.15.146:0/1249418778 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f38781370d0 0x7f387806d6b0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.695+0000 7f387d44e700 1 --2- 172.21.15.146:0/1249418778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3878098410 0x7f38781cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.695+0000 7f387d44e700 1 --2- 172.21.15.146:0/1249418778 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38781347b0 0x7f38781ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.695+0000 7f387d44e700 1 -- 172.21.15.146:0/1249418778 >> 172.21.15.146:0/1249418778 conn(0x7f38780a2b30 msgr2=0x7f387809c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.695+0000 7f387d44e700 1 -- 172.21.15.146:0/1249418778 shutdown_connections 2023-10-03T10:16:52.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:52.695+0000 7f387d44e700 1 -- 172.21.15.146:0/1249418778 wait complete. 2023-10-03T10:16:52.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:53.123 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:53.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.248+0000 7f5c121bb700 1 Processor -- start 2023-10-03T10:16:53.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.248+0000 7f5c121bb700 1 -- start start 2023-10-03T10:16:53.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.248+0000 7f5c121bb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0c136960 0x7f5c0c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.248+0000 7f5c121bb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5c0c139280 0x7f5c0c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.248+0000 7f5c121bb700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c0c06b2d0 con 0x7f5c0c133ad0 2023-10-03T10:16:53.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.248+0000 7f5c121bb700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c0c1345b0 con 0x7f5c0c139280 2023-10-03T10:16:53.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.248+0000 7f5c121bb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c133610 con 0x7f5c0c136960 2023-10-03T10:16:53.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.248+0000 7f5c0bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5c0c139280 0x7f5c0c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.248+0000 7f5c0b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5c0c133ad0 0x7f5c0c133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52844/0 (socket says 172.21.15.146:52844) 2023-10-03T10:16:53.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.248+0000 7f5c0b7fe700 1 -- 172.21.15.146:0/237769176 learned_addr learned my addr 172.21.15.146:0/237769176 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:53.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.248+0000 7f5c0affd700 1 --2- 172.21.15.146:0/237769176 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0c136960 0x7f5c0c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.249+0000 7f5c0bfff700 1 -- 172.21.15.146:0/237769176 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0c136960 msgr2=0x7f5c0c138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:53.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.249+0000 7f5c0bfff700 1 --2- 172.21.15.146:0/237769176 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0c136960 0x7f5c0c138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.249+0000 7f5c0bfff700 1 -- 172.21.15.146:0/237769176 >> v1:172.21.15.146:6789/0 conn(0x7f5c0c133ad0 legacy=0x7f5c0c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.249+0000 7f5c0bfff700 1 -- 172.21.15.146:0/237769176 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0c09a500 con 0x7f5c0c139280 2023-10-03T10:16:53.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.249+0000 7f5c0affd700 1 --2- 172.21.15.146:0/237769176 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0c136960 0x7f5c0c138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.249+0000 7f5c0a7fc700 1 -- 172.21.15.146:0/237769176 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307562236 0 0) 0x7f5c0c06b2d0 con 0x7f5c0c133ad0 2023-10-03T10:16:53.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.249+0000 7f5c0bfff700 1 --2- 172.21.15.146:0/237769176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c0c139280 0x7f5c0c13b660 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f5c04009dc0 tx=0x7f5c0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49c4aec4f87c661 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.249+0000 7f5c0a7fc700 1 -- 172.21.15.146:0/237769176 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0400e070 con 0x7f5c0c139280 2023-10-03T10:16:53.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.249+0000 7f5c0a7fc700 1 -- 172.21.15.146:0/237769176 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0400bae0 con 0x7f5c0c139280 2023-10-03T10:16:53.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.249+0000 7f5c0a7fc700 1 -- 172.21.15.146:0/237769176 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0400be90 con 0x7f5c0c139280 2023-10-03T10:16:53.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.249+0000 7f5c121bb700 1 -- 172.21.15.146:0/237769176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c0c139280 msgr2=0x7f5c0c13b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.249+0000 7f5c121bb700 1 --2- 172.21.15.146:0/237769176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c0c139280 0x7f5c0c13b660 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f5c04009dc0 tx=0x7f5c0400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:53.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.249+0000 7f5c121bb700 1 -- 172.21.15.146:0/237769176 shutdown_connections 2023-10-03T10:16:53.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.249+0000 7f5c121bb700 1 --2- 172.21.15.146:0/237769176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c0c139280 0x7f5c0c13b660 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.249+0000 7f5c121bb700 1 --2- 172.21.15.146:0/237769176 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0c136960 0x7f5c0c138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.249+0000 7f5c121bb700 1 -- 172.21.15.146:0/237769176 >> 172.21.15.146:0/237769176 conn(0x7f5c0c099c40 msgr2=0x7f5c0c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.249+0000 7f5c121bb700 1 -- 172.21.15.146:0/237769176 shutdown_connections 2023-10-03T10:16:53.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.249+0000 7f5c121bb700 1 -- 172.21.15.146:0/237769176 wait complete. 2023-10-03T10:16:53.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.250+0000 7f5c121bb700 1 Processor -- start 2023-10-03T10:16:53.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.251+0000 7f5c121bb700 1 -- start start 2023-10-03T10:16:53.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.251+0000 7f5c121bb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0c133ad0 0x7f5c0c12cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.251+0000 7f5c121bb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c0c136960 0x7f5c0c12d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.251+0000 7f5c121bb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0c139280 0x7f5c0c12d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.251+0000 7f5c121bb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c131830 con 0x7f5c0c136960 2023-10-03T10:16:53.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.251+0000 7f5c121bb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c09f390 con 0x7f5c0c133ad0 2023-10-03T10:16:53.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.251+0000 7f5c121bb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c072270 con 0x7f5c0c139280 2023-10-03T10:16:53.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.251+0000 7f5c0bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0c139280 0x7f5c0c12d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.251+0000 7f5c0b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0c133ad0 0x7f5c0c12cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.251+0000 7f5c0affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c0c136960 0x7f5c0c12d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.251+0000 7f5c0bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0c139280 0x7f5c0c12d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57632/0 (socket says 172.21.15.146:57632) 2023-10-03T10:16:53.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.251+0000 7f5c0bfff700 1 -- 172.21.15.146:0/705055225 learned_addr learned my addr 172.21.15.146:0/705055225 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:53.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.251+0000 7f5c0bfff700 1 -- 172.21.15.146:0/705055225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0c133ad0 msgr2=0x7f5c0c12cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.251+0000 7f5c0bfff700 1 --2- 172.21.15.146:0/705055225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0c133ad0 0x7f5c0c12cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.251+0000 7f5c0bfff700 1 -- 172.21.15.146:0/705055225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c0c136960 msgr2=0x7f5c0c12d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.251+0000 7f5c0bfff700 1 --2- 172.21.15.146:0/705055225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c0c136960 0x7f5c0c12d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.251+0000 7f5c0bfff700 1 -- 172.21.15.146:0/705055225 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c000094a0 con 0x7f5c0c139280 2023-10-03T10:16:53.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.251+0000 7f5c0affd700 1 --2- 172.21.15.146:0/705055225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c0c136960 0x7f5c0c12d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.251+0000 7f5c0b7fe700 1 --2- 172.21.15.146:0/705055225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0c133ad0 0x7f5c0c12cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.251+0000 7f5c0bfff700 1 --2- 172.21.15.146:0/705055225 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0c139280 0x7f5c0c12d5b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5c04014040 tx=0x7f5c04004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.252+0000 7f5bf3fff700 1 -- 172.21.15.146:0/705055225 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c040045d0 con 0x7f5c0c139280 2023-10-03T10:16:53.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.252+0000 7f5bf3fff700 1 -- 172.21.15.146:0/705055225 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c04020070 con 0x7f5c0c139280 2023-10-03T10:16:53.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.252+0000 7f5c121bb700 1 -- 172.21.15.146:0/705055225 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c04009a70 con 0x7f5c0c139280 2023-10-03T10:16:53.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.252+0000 7f5bf3fff700 1 -- 172.21.15.146:0/705055225 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c04004970 con 0x7f5c0c139280 2023-10-03T10:16:53.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.252+0000 7f5c121bb700 1 -- 172.21.15.146:0/705055225 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0c070c90 con 0x7f5c0c139280 2023-10-03T10:16:53.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.252+0000 7f5bf3fff700 1 -- 172.21.15.146:0/705055225 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c04012430 con 0x7f5c0c139280 2023-10-03T10:16:53.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.252+0000 7f5bf3fff700 1 -- 172.21.15.146:0/705055225 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5c04022070 con 0x7f5c0c139280 2023-10-03T10:16:53.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.253+0000 7f5c121bb700 1 -- 172.21.15.146:0/705055225 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c0c06fe70 con 0x7f5c0c139280 2023-10-03T10:16:53.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.257+0000 7f5bf3fff700 1 -- 172.21.15.146:0/705055225 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c040267a0 con 0x7f5c0c139280 2023-10-03T10:16:53.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.440+0000 7f5c121bb700 1 -- 172.21.15.146:0/705055225 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5c0c04f2a0 con 0x7f5c0c139280 2023-10-03T10:16:53.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.440+0000 7f5bf3fff700 1 -- 172.21.15.146:0/705055225 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5c04011390 con 0x7f5c0c139280 2023-10-03T10:16:53.440 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:53.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.442+0000 7f5c121bb700 1 -- 172.21.15.146:0/705055225 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0c139280 msgr2=0x7f5c0c12d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.442+0000 7f5c121bb700 1 --2- 172.21.15.146:0/705055225 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0c139280 0x7f5c0c12d5b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5c04014040 tx=0x7f5c04004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.442+0000 7f5c121bb700 1 -- 172.21.15.146:0/705055225 shutdown_connections 2023-10-03T10:16:53.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.442+0000 7f5c121bb700 1 --2- 172.21.15.146:0/705055225 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c0c139280 0x7f5c0c12d5b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.442+0000 7f5c121bb700 1 --2- 172.21.15.146:0/705055225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c0c133ad0 0x7f5c0c12cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.442+0000 7f5c121bb700 1 --2- 172.21.15.146:0/705055225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c0c136960 0x7f5c0c12d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.442+0000 7f5c121bb700 1 -- 172.21.15.146:0/705055225 >> 172.21.15.146:0/705055225 conn(0x7f5c0c099c40 msgr2=0x7f5c0c1385e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.443+0000 7f5c121bb700 1 -- 172.21.15.146:0/705055225 shutdown_connections 2023-10-03T10:16:53.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.443+0000 7f5c121bb700 1 -- 172.21.15.146:0/705055225 wait complete. 2023-10-03T10:16:53.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:53.591 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:53.669 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:53.707 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:53.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.716+0000 7fbda3d3f700 1 Processor -- start 2023-10-03T10:16:53.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.716+0000 7fbda3d3f700 1 -- start start 2023-10-03T10:16:53.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.717+0000 7fbda3d3f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbd9c06a770 0x7fbd9c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.717+0000 7fbda3d3f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd9c06b080 0x7fbd9c1317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.717+0000 7fbda3d3f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd9c09da80 con 0x7fbd9c131cf0 2023-10-03T10:16:53.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.717+0000 7fbda3d3f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd9c09dce0 con 0x7fbd9c06a770 2023-10-03T10:16:53.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.717+0000 7fbda3d3f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c09eb20 con 0x7fbd9c06b080 2023-10-03T10:16:53.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.717+0000 7fbda1adb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbd9c06a770 0x7fbd9c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.717+0000 7fbda12da700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd9c06b080 0x7fbd9c1317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.717+0000 7fbda22dc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbd9c131cf0 0x7fbd9c138c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52856/0 (socket says 172.21.15.146:52856) 2023-10-03T10:16:53.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.717+0000 7fbda1adb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbd9c06a770 0x7fbd9c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58552/0 (socket says 172.21.15.146:58552) 2023-10-03T10:16:53.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.717+0000 7fbda22dc700 1 -- 172.21.15.146:0/1124677129 learned_addr learned my addr 172.21.15.146:0/1124677129 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.717+0000 7fbda1adb700 1 -- 172.21.15.146:0/1124677129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd9c06b080 msgr2=0x7fbd9c1317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.717+0000 7fbda1adb700 1 --2- 172.21.15.146:0/1124677129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd9c06b080 0x7fbd9c1317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.717+0000 7fbda1adb700 1 -- 172.21.15.146:0/1124677129 >> v1:172.21.15.146:6789/0 conn(0x7fbd9c131cf0 legacy=0x7fbd9c138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.717+0000 7fbda1adb700 1 -- 172.21.15.146:0/1124677129 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c09d860 con 0x7fbd9c06a770 2023-10-03T10:16:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.717+0000 7fbda12da700 1 --2- 172.21.15.146:0/1124677129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd9c06b080 0x7fbd9c1317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.717+0000 7fbda1adb700 1 --2- 172.21.15.146:0/1124677129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9c06a770 0x7fbd9c06ab40 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fbd98009840 tx=0x7fbd98009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2727f4a2c4abcc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.718+0000 7fbda0ad9700 1 -- 172.21.15.146:0/1124677129 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd98011830 con 0x7fbd9c06a770 2023-10-03T10:16:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.718+0000 7fbda0ad9700 1 -- 172.21.15.146:0/1124677129 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd98011990 con 0x7fbd9c06a770 2023-10-03T10:16:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.718+0000 7fbda0ad9700 1 -- 172.21.15.146:0/1124677129 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd98011d20 con 0x7fbd9c06a770 2023-10-03T10:16:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.718+0000 7fbda3d3f700 1 -- 172.21.15.146:0/1124677129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9c06a770 msgr2=0x7fbd9c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.718+0000 7fbda3d3f700 1 --2- 172.21.15.146:0/1124677129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9c06a770 0x7fbd9c06ab40 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fbd98009840 tx=0x7fbd98009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.718+0000 7fbda3d3f700 1 -- 172.21.15.146:0/1124677129 shutdown_connections 2023-10-03T10:16:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.718+0000 7fbda3d3f700 1 --2- 172.21.15.146:0/1124677129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9c06a770 0x7fbd9c06ab40 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.718+0000 7fbda3d3f700 1 --2- 172.21.15.146:0/1124677129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd9c06b080 0x7fbd9c1317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.718+0000 7fbda3d3f700 1 -- 172.21.15.146:0/1124677129 >> 172.21.15.146:0/1124677129 conn(0x7fbd9c099c40 msgr2=0x7fbd9c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.719+0000 7fbda3d3f700 1 -- 172.21.15.146:0/1124677129 shutdown_connections 2023-10-03T10:16:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.719+0000 7fbda3d3f700 1 -- 172.21.15.146:0/1124677129 wait complete. 2023-10-03T10:16:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.720+0000 7fbda3d3f700 1 Processor -- start 2023-10-03T10:16:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.720+0000 7fbda3d3f700 1 -- start start 2023-10-03T10:16:53.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.720+0000 7fbda3d3f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd9c06a770 0x7fbd9c11f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.720+0000 7fbda3d3f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd9c06b080 0x7fbd9c11fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.720+0000 7fbda3d3f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9c131cf0 0x7fbd9c120080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.720+0000 7fbda3d3f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c130450 con 0x7fbd9c131cf0 2023-10-03T10:16:53.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.720+0000 7fbda3d3f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c09a1c0 con 0x7fbd9c06a770 2023-10-03T10:16:53.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.720+0000 7fbda3d3f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c071e10 con 0x7fbd9c06b080 2023-10-03T10:16:53.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.720+0000 7fbda1adb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd9c06a770 0x7fbd9c11f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.720+0000 7fbda1adb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd9c06a770 0x7fbd9c11f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56650/0 (socket says 172.21.15.146:56650) 2023-10-03T10:16:53.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.720+0000 7fbda1adb700 1 -- 172.21.15.146:0/4106459691 learned_addr learned my addr 172.21.15.146:0/4106459691 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:53.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.720+0000 7fbda22dc700 1 --2- 172.21.15.146:0/4106459691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9c131cf0 0x7fbd9c120080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.720+0000 7fbda12da700 1 --2- 172.21.15.146:0/4106459691 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd9c06b080 0x7fbd9c11fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.721+0000 7fbda1adb700 1 -- 172.21.15.146:0/4106459691 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd9c06b080 msgr2=0x7fbd9c11fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.721+0000 7fbda1adb700 1 --2- 172.21.15.146:0/4106459691 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd9c06b080 0x7fbd9c11fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.721+0000 7fbda1adb700 1 -- 172.21.15.146:0/4106459691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9c131cf0 msgr2=0x7fbd9c120080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.721+0000 7fbda1adb700 1 --2- 172.21.15.146:0/4106459691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9c131cf0 0x7fbd9c120080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.721+0000 7fbda1adb700 1 -- 172.21.15.146:0/4106459691 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c0094a0 con 0x7fbd9c06a770 2023-10-03T10:16:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.721+0000 7fbda22dc700 1 --2- 172.21.15.146:0/4106459691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9c131cf0 0x7fbd9c120080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.721+0000 7fbda12da700 1 --2- 172.21.15.146:0/4106459691 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd9c06b080 0x7fbd9c11fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.721+0000 7fbda1adb700 1 --2- 172.21.15.146:0/4106459691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd9c06a770 0x7fbd9c11f600 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fbd98009fd0 tx=0x7fbd98004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.721+0000 7fbd927fc700 1 -- 172.21.15.146:0/4106459691 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd980036a0 con 0x7fbd9c06a770 2023-10-03T10:16:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.721+0000 7fbd927fc700 1 -- 172.21.15.146:0/4106459691 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9801f070 con 0x7fbd9c06a770 2023-10-03T10:16:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.721+0000 7fbd927fc700 1 -- 172.21.15.146:0/4106459691 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd98003a60 con 0x7fbd9c06a770 2023-10-03T10:16:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.721+0000 7fbda3d3f700 1 -- 172.21.15.146:0/4106459691 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd980094a0 con 0x7fbd9c06a770 2023-10-03T10:16:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.721+0000 7fbda3d3f700 1 -- 172.21.15.146:0/4106459691 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd9c122790 con 0x7fbd9c06a770 2023-10-03T10:16:53.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.722+0000 7fbda3d3f700 1 -- 172.21.15.146:0/4106459691 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd9c122980 con 0x7fbd9c06a770 2023-10-03T10:16:53.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.723+0000 7fbd927fc700 1 -- 172.21.15.146:0/4106459691 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd98003bc0 con 0x7fbd9c06a770 2023-10-03T10:16:53.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.723+0000 7fbd927fc700 1 -- 172.21.15.146:0/4106459691 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbd98021070 con 0x7fbd9c06a770 2023-10-03T10:16:53.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.728+0000 7fbd927fc700 1 -- 172.21.15.146:0/4106459691 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd98010d50 con 0x7fbd9c06a770 2023-10-03T10:16:53.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.800+0000 7f45f1c4b700 1 Processor -- start 2023-10-03T10:16:53.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.800+0000 7f45f1c4b700 1 -- start start 2023-10-03T10:16:53.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.801+0000 7f45f1c4b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45ec0a0a70 0x7f45ec0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.801+0000 7f45f1c4b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45ec0a1380 0x7f45ec133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.801+0000 7f45f1c4b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ec09dc00 con 0x7f45ec133f50 2023-10-03T10:16:53.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.801+0000 7f45f1c4b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec09ea60 con 0x7f45ec0a0a70 2023-10-03T10:16:53.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.801+0000 7f45f1c4b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec09dec0 con 0x7f45ec0a1380 2023-10-03T10:16:53.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.801+0000 7f45eaffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45ec0a1380 0x7f45ec133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.801+0000 7f45eb7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45ec0a0a70 0x7f45ec0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.801+0000 7f45ebfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f45ec133f50 0x7f45ec13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52858/0 (socket says 172.21.15.146:52858) 2023-10-03T10:16:53.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.801+0000 7f45ebfff700 1 -- 172.21.15.146:0/3920098959 learned_addr learned my addr 172.21.15.146:0/3920098959 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:53.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.801+0000 7f45eb7fe700 1 -- 172.21.15.146:0/3920098959 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45ec0a1380 msgr2=0x7f45ec133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:53.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.801+0000 7f45eb7fe700 1 --2- 172.21.15.146:0/3920098959 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45ec0a1380 0x7f45ec133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.801+0000 7f45eb7fe700 1 -- 172.21.15.146:0/3920098959 >> v1:172.21.15.146:6789/0 conn(0x7f45ec133f50 legacy=0x7f45ec13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.801+0000 7f45eb7fe700 1 -- 172.21.15.146:0/3920098959 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec09e6a0 con 0x7f45ec0a0a70 2023-10-03T10:16:53.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.801+0000 7f45ea7fc700 1 -- 172.21.15.146:0/3920098959 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339470353 0 0) 0x7f45ec09dc00 con 0x7f45ec133f50 2023-10-03T10:16:53.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.801+0000 7f45eaffd700 1 --2- 172.21.15.146:0/3920098959 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45ec0a1380 0x7f45ec133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.802+0000 7f45eb7fe700 1 --2- 172.21.15.146:0/3920098959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45ec0a0a70 0x7f45ec0a0e40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009870 tx=0x7f45dc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b109cf1c31d3f4e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.802+0000 7f45ea7fc700 1 -- 172.21.15.146:0/3920098959 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc011830 con 0x7f45ec0a0a70 2023-10-03T10:16:53.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.802+0000 7f45ea7fc700 1 -- 172.21.15.146:0/3920098959 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45dc011990 con 0x7f45ec0a0a70 2023-10-03T10:16:53.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.802+0000 7f45ea7fc700 1 -- 172.21.15.146:0/3920098959 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc011d20 con 0x7f45ec0a0a70 2023-10-03T10:16:53.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.803+0000 7f45f1c4b700 1 -- 172.21.15.146:0/3920098959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45ec0a0a70 msgr2=0x7f45ec0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.803+0000 7f45f1c4b700 1 --2- 172.21.15.146:0/3920098959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45ec0a0a70 0x7f45ec0a0e40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009870 tx=0x7f45dc009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:53.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.803+0000 7f45f1c4b700 1 -- 172.21.15.146:0/3920098959 shutdown_connections 2023-10-03T10:16:53.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.803+0000 7f45f1c4b700 1 --2- 172.21.15.146:0/3920098959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45ec0a0a70 0x7f45ec0a0e40 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.803+0000 7f45f1c4b700 1 --2- 172.21.15.146:0/3920098959 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45ec0a1380 0x7f45ec133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.803+0000 7f45f1c4b700 1 -- 172.21.15.146:0/3920098959 >> 172.21.15.146:0/3920098959 conn(0x7f45ec0a6610 msgr2=0x7f45ec0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.803+0000 7f45f1c4b700 1 -- 172.21.15.146:0/3920098959 shutdown_connections 2023-10-03T10:16:53.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.803+0000 7f45f1c4b700 1 -- 172.21.15.146:0/3920098959 wait complete. 2023-10-03T10:16:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.804+0000 7f45f1c4b700 1 Processor -- start 2023-10-03T10:16:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.804+0000 7f45f1c4b700 1 -- start start 2023-10-03T10:16:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.805+0000 7f45f1c4b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45ec0a0a70 0x7f45ec1227a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.805+0000 7f45f1c4b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45ec0a1380 0x7f45ec122ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.805+0000 7f45f1c4b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45ec133f50 0x7f45ec123220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.805+0000 7f45f1c4b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec1339e0 con 0x7f45ec0a0a70 2023-10-03T10:16:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.805+0000 7f45f1c4b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec0a03e0 con 0x7f45ec0a1380 2023-10-03T10:16:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.805+0000 7f45f1c4b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec124360 con 0x7f45ec133f50 2023-10-03T10:16:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.805+0000 7f45eb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45ec0a0a70 0x7f45ec1227a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.805+0000 7f45eaffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45ec0a1380 0x7f45ec122ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.805+0000 7f45eb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45ec0a0a70 0x7f45ec1227a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58562/0 (socket says 172.21.15.146:58562) 2023-10-03T10:16:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.805+0000 7f45eb7fe700 1 -- 172.21.15.146:0/3473618192 learned_addr learned my addr 172.21.15.146:0/3473618192 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.805+0000 7f45ebfff700 1 --2- 172.21.15.146:0/3473618192 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45ec133f50 0x7f45ec123220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.805+0000 7f45eaffd700 1 -- 172.21.15.146:0/3473618192 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45ec133f50 msgr2=0x7f45ec123220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.805+0000 7f45eaffd700 1 --2- 172.21.15.146:0/3473618192 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45ec133f50 0x7f45ec123220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.805+0000 7f45eaffd700 1 -- 172.21.15.146:0/3473618192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45ec0a0a70 msgr2=0x7f45ec1227a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.805+0000 7f45eaffd700 1 --2- 172.21.15.146:0/3473618192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45ec0a0a70 0x7f45ec1227a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.805+0000 7f45eaffd700 1 -- 172.21.15.146:0/3473618192 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e00094a0 con 0x7f45ec0a1380 2023-10-03T10:16:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.805+0000 7f45eb7fe700 1 --2- 172.21.15.146:0/3473618192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45ec0a0a70 0x7f45ec1227a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.805+0000 7f45ebfff700 1 --2- 172.21.15.146:0/3473618192 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45ec133f50 0x7f45ec123220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.805+0000 7f45eaffd700 1 --2- 172.21.15.146:0/3473618192 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45ec0a1380 0x7f45ec122ce0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f45e000e980 tx=0x7f45e000ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.805+0000 7f45d3fff700 1 -- 172.21.15.146:0/3473618192 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e000c690 con 0x7f45ec0a1380 2023-10-03T10:16:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.806+0000 7f45d3fff700 1 -- 172.21.15.146:0/3473618192 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e000c7f0 con 0x7f45ec0a1380 2023-10-03T10:16:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.806+0000 7f45f1c4b700 1 -- 172.21.15.146:0/3473618192 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45dc0094a0 con 0x7f45ec0a1380 2023-10-03T10:16:53.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.806+0000 7f45d3fff700 1 -- 172.21.15.146:0/3473618192 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e000cb80 con 0x7f45ec0a1380 2023-10-03T10:16:53.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.806+0000 7f45f1c4b700 1 -- 172.21.15.146:0/3473618192 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ec125d30 con 0x7f45ec0a1380 2023-10-03T10:16:53.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.807+0000 7f45d3fff700 1 -- 172.21.15.146:0/3473618192 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f45e000cce0 con 0x7f45ec0a1380 2023-10-03T10:16:53.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.807+0000 7f45f1c4b700 1 -- 172.21.15.146:0/3473618192 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ec126b20 con 0x7f45ec0a1380 2023-10-03T10:16:53.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.807+0000 7f45d3fff700 1 -- 172.21.15.146:0/3473618192 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f45e003f6d0 con 0x7f45ec0a1380 2023-10-03T10:16:53.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.815+0000 7f45d3fff700 1 -- 172.21.15.146:0/3473618192 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45e001bb50 con 0x7f45ec0a1380 2023-10-03T10:16:53.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.845+0000 7f997f5fe700 1 Processor -- start 2023-10-03T10:16:53.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.845+0000 7f997f5fe700 1 -- start start 2023-10-03T10:16:53.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.846+0000 7f997f5fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f997809e950 0x7f997809ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.846+0000 7f997f5fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f997809f260 0x7f9978137ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.846+0000 7f997f5fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99781381e0 0x7f997813a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.846+0000 7f997f5fe700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99780a06c0 con 0x7f997809e950 2023-10-03T10:16:53.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.846+0000 7f997f5fe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997809ae90 con 0x7f997809f260 2023-10-03T10:16:53.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.846+0000 7f997f5fe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f997809ac20 con 0x7f99781381e0 2023-10-03T10:16:53.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.846+0000 7f997db9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99781381e0 0x7f997813a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.846+0000 7f997cb99700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f997809f260 0x7f9978137ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.846+0000 7f997d39a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f997809e950 0x7f997809ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.846+0000 7f997cb99700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f997809f260 0x7f9978137ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56668/0 (socket says 172.21.15.146:56668) 2023-10-03T10:16:53.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.846+0000 7f997db9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99781381e0 0x7f997813a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57670/0 (socket says 172.21.15.146:57670) 2023-10-03T10:16:53.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.846+0000 7f997cb99700 1 -- 172.21.15.146:0/2400397235 learned_addr learned my addr 172.21.15.146:0/2400397235 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:53.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.846+0000 7f997d39a700 1 -- 172.21.15.146:0/2400397235 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99781381e0 msgr2=0x7f997813a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:53.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.846+0000 7f997d39a700 1 --2- 172.21.15.146:0/2400397235 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99781381e0 0x7f997813a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.846+0000 7f997d39a700 1 -- 172.21.15.146:0/2400397235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f997809f260 msgr2=0x7f9978137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:53.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.846+0000 7f997d39a700 1 --2- 172.21.15.146:0/2400397235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f997809f260 0x7f9978137ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.846+0000 7f997d39a700 1 -- 172.21.15.146:0/2400397235 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997806ba00 con 0x7f997809e950 2023-10-03T10:16:53.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.846+0000 7f997cb99700 1 --2- 172.21.15.146:0/2400397235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f997809f260 0x7f9978137ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.846+0000 7f997db9b700 1 --2- 172.21.15.146:0/2400397235 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99781381e0 0x7f997813a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.847+0000 7f997d39a700 1 --2- 172.21.15.146:0/2400397235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f997809e950 0x7f997809ed20 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f9974009850 tx=0x7f9974009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af062bff404ef56e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.847+0000 7f996ffff700 1 -- 172.21.15.146:0/2400397235 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974005e30 con 0x7f997809e950 2023-10-03T10:16:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.847+0000 7f996ffff700 1 -- 172.21.15.146:0/2400397235 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9974006030 con 0x7f997809e950 2023-10-03T10:16:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.847+0000 7f996ffff700 1 -- 172.21.15.146:0/2400397235 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99740063c0 con 0x7f997809e950 2023-10-03T10:16:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.847+0000 7f997f5fe700 1 -- 172.21.15.146:0/2400397235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f997809e950 msgr2=0x7f997809ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.847+0000 7f997f5fe700 1 --2- 172.21.15.146:0/2400397235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f997809e950 0x7f997809ed20 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f9974009850 tx=0x7f9974009b60 comp rx=0 tx=0).stop 2023-10-03T10:16:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.847+0000 7f997f5fe700 1 -- 172.21.15.146:0/2400397235 shutdown_connections 2023-10-03T10:16:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.847+0000 7f997f5fe700 1 --2- 172.21.15.146:0/2400397235 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f99781381e0 0x7f997813a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.847+0000 7f997f5fe700 1 --2- 172.21.15.146:0/2400397235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f997809e950 0x7f997809ed20 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.847+0000 7f997f5fe700 1 --2- 172.21.15.146:0/2400397235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f997809f260 0x7f9978137ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.847+0000 7f997f5fe700 1 -- 172.21.15.146:0/2400397235 >> 172.21.15.146:0/2400397235 conn(0x7f99780a0f70 msgr2=0x7f99780a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.847+0000 7f997f5fe700 1 -- 172.21.15.146:0/2400397235 shutdown_connections 2023-10-03T10:16:53.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.848+0000 7f997f5fe700 1 -- 172.21.15.146:0/2400397235 wait complete. 2023-10-03T10:16:53.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.848+0000 7f997f5fe700 1 Processor -- start 2023-10-03T10:16:53.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.848+0000 7f997f5fe700 1 -- start start 2023-10-03T10:16:53.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.849+0000 7f997f5fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f997809e950 0x7f9978121a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.849+0000 7f997f5fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f997809f260 0x7f9978121f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.849+0000 7f997f5fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99781381e0 0x7f9978122480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.849+0000 7f997f5fe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99781363b0 con 0x7f997809e950 2023-10-03T10:16:53.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.849+0000 7f997f5fe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9978123610 con 0x7f99781381e0 2023-10-03T10:16:53.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.849+0000 7f997f5fe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9978123c30 con 0x7f997809f260 2023-10-03T10:16:53.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.849+0000 7f997d39a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f997809e950 0x7f9978121a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.849+0000 7f997d39a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f997809e950 0x7f9978121a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58582/0 (socket says 172.21.15.146:58582) 2023-10-03T10:16:53.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.849+0000 7f997d39a700 1 -- 172.21.15.146:0/173898989 learned_addr learned my addr 172.21.15.146:0/173898989 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:53.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.849+0000 7f997db9b700 1 --2- 172.21.15.146:0/173898989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99781381e0 0x7f9978122480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.849+0000 7f997cb99700 1 --2- 172.21.15.146:0/173898989 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f997809f260 0x7f9978121f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.849+0000 7f997d39a700 1 -- 172.21.15.146:0/173898989 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f997809f260 msgr2=0x7f9978121f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.849+0000 7f997d39a700 1 --2- 172.21.15.146:0/173898989 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f997809f260 0x7f9978121f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.849+0000 7f997d39a700 1 -- 172.21.15.146:0/173898989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99781381e0 msgr2=0x7f9978122480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.849+0000 7f997d39a700 1 --2- 172.21.15.146:0/173898989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99781381e0 0x7f9978122480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.849+0000 7f997d39a700 1 -- 172.21.15.146:0/173898989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9968009550 con 0x7f997809e950 2023-10-03T10:16:53.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.849+0000 7f997db9b700 1 --2- 172.21.15.146:0/173898989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99781381e0 0x7f9978122480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.849+0000 7f997d39a700 1 --2- 172.21.15.146:0/173898989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f997809e950 0x7f9978121a00 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f9974009ba0 tx=0x7f9974004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.850+0000 7f996dffb700 1 -- 172.21.15.146:0/173898989 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99740063a0 con 0x7f997809e950 2023-10-03T10:16:53.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.850+0000 7f996dffb700 1 -- 172.21.15.146:0/173898989 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9974006500 con 0x7f997809e950 2023-10-03T10:16:53.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.850+0000 7f997f5fe700 1 -- 172.21.15.146:0/173898989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9970009a70 con 0x7f997809e950 2023-10-03T10:16:53.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.850+0000 7f996dffb700 1 -- 172.21.15.146:0/173898989 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974006890 con 0x7f997809e950 2023-10-03T10:16:53.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.850+0000 7f997f5fe700 1 -- 172.21.15.146:0/173898989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9974009430 con 0x7f997809e950 2023-10-03T10:16:53.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.851+0000 7f996dffb700 1 -- 172.21.15.146:0/173898989 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9974022070 con 0x7f997809e950 2023-10-03T10:16:53.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.851+0000 7f997f5fe700 1 -- 172.21.15.146:0/173898989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9978136990 con 0x7f997809e950 2023-10-03T10:16:53.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.851+0000 7f996dffb700 1 -- 172.21.15.146:0/173898989 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9974040c50 con 0x7f997809e950 2023-10-03T10:16:53.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.856+0000 7f996dffb700 1 -- 172.21.15.146:0/173898989 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9974003e00 con 0x7f997809e950 2023-10-03T10:16:53.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.926+0000 7fbda3d3f700 1 -- 172.21.15.146:0/4106459691 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbd9c0a1d60 con 0x7fbd9c06a770 2023-10-03T10:16:53.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.926+0000 7fbd927fc700 1 -- 172.21.15.146:0/4106459691 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd98015090 con 0x7fbd9c06a770 2023-10-03T10:16:53.926 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:53.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.928+0000 7fbda3d3f700 1 -- 172.21.15.146:0/4106459691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd9c06a770 msgr2=0x7fbd9c11f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.928+0000 7fbda3d3f700 1 --2- 172.21.15.146:0/4106459691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd9c06a770 0x7fbd9c11f600 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fbd98009fd0 tx=0x7fbd98004750 comp rx=0 tx=0).stop 2023-10-03T10:16:53.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.929+0000 7fbda3d3f700 1 -- 172.21.15.146:0/4106459691 shutdown_connections 2023-10-03T10:16:53.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.929+0000 7fbda3d3f700 1 --2- 172.21.15.146:0/4106459691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9c131cf0 0x7fbd9c120080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.929+0000 7fbda3d3f700 1 --2- 172.21.15.146:0/4106459691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd9c06a770 0x7fbd9c11f600 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.929+0000 7fbda3d3f700 1 --2- 172.21.15.146:0/4106459691 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbd9c06b080 0x7fbd9c11fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.929+0000 7fbda3d3f700 1 -- 172.21.15.146:0/4106459691 >> 172.21.15.146:0/4106459691 conn(0x7fbd9c099c40 msgr2=0x7fbd9c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.930+0000 7fbda3d3f700 1 -- 172.21.15.146:0/4106459691 shutdown_connections 2023-10-03T10:16:53.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:53.930+0000 7fbda3d3f700 1 -- 172.21.15.146:0/4106459691 wait complete. 2023-10-03T10:16:53.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:54.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.011+0000 7f45f1c4b700 1 -- 172.21.15.146:0/3473618192 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f45ec125ec0 con 0x7f45ec0a1380 2023-10-03T10:16:54.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.012+0000 7f45d3fff700 1 -- 172.21.15.146:0/3473618192 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f45e0007040 con 0x7f45ec0a1380 2023-10-03T10:16:54.011 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.014+0000 7f45f1c4b700 1 -- 172.21.15.146:0/3473618192 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45ec0a1380 msgr2=0x7f45ec122ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.014+0000 7f45f1c4b700 1 --2- 172.21.15.146:0/3473618192 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45ec0a1380 0x7f45ec122ce0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f45e000e980 tx=0x7f45e000ec90 comp rx=0 tx=0).stop 2023-10-03T10:16:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.014+0000 7f45f1c4b700 1 -- 172.21.15.146:0/3473618192 shutdown_connections 2023-10-03T10:16:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.014+0000 7f45f1c4b700 1 --2- 172.21.15.146:0/3473618192 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f45ec133f50 0x7f45ec123220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.014+0000 7f45f1c4b700 1 --2- 172.21.15.146:0/3473618192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45ec0a0a70 0x7f45ec1227a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.014+0000 7f45f1c4b700 1 --2- 172.21.15.146:0/3473618192 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45ec0a1380 0x7f45ec122ce0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.014+0000 7f45f1c4b700 1 -- 172.21.15.146:0/3473618192 >> 172.21.15.146:0/3473618192 conn(0x7f45ec0a6610 msgr2=0x7f45ec0a4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.014+0000 7f45f1c4b700 1 -- 172.21.15.146:0/3473618192 shutdown_connections 2023-10-03T10:16:54.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.014+0000 7f45f1c4b700 1 -- 172.21.15.146:0/3473618192 wait complete. 2023-10-03T10:16:54.026 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:54.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.049+0000 7f997f5fe700 1 -- 172.21.15.146:0/173898989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f997804f2a0 con 0x7f997809e950 2023-10-03T10:16:54.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.049+0000 7f996dffb700 1 -- 172.21.15.146:0/173898989 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f997402a020 con 0x7f997809e950 2023-10-03T10:16:54.049 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:54.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.052+0000 7f997f5fe700 1 -- 172.21.15.146:0/173898989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f997809e950 msgr2=0x7f9978121a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.052+0000 7f997f5fe700 1 --2- 172.21.15.146:0/173898989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f997809e950 0x7f9978121a00 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f9974009ba0 tx=0x7f9974004750 comp rx=0 tx=0).stop 2023-10-03T10:16:54.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.052+0000 7f997f5fe700 1 -- 172.21.15.146:0/173898989 shutdown_connections 2023-10-03T10:16:54.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.052+0000 7f997f5fe700 1 --2- 172.21.15.146:0/173898989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99781381e0 0x7f9978122480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.052+0000 7f997f5fe700 1 --2- 172.21.15.146:0/173898989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f997809e950 0x7f9978121a00 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.052+0000 7f997f5fe700 1 --2- 172.21.15.146:0/173898989 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f997809f260 0x7f9978121f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.052+0000 7f997f5fe700 1 -- 172.21.15.146:0/173898989 >> 172.21.15.146:0/173898989 conn(0x7f99780a0f70 msgr2=0x7f9978136d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.052+0000 7f997f5fe700 1 -- 172.21.15.146:0/173898989 shutdown_connections 2023-10-03T10:16:54.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.052+0000 7f997f5fe700 1 -- 172.21.15.146:0/173898989 wait complete. 2023-10-03T10:16:54.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:54.455 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:54.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.580+0000 7f1217063700 1 Processor -- start 2023-10-03T10:16:54.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.580+0000 7f1217063700 1 -- start start 2023-10-03T10:16:54.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.580+0000 7f1217063700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121009e340 0x7f12101359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.580+0000 7f1217063700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1210135f20 0x7f1210138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.580+0000 7f1217063700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121009aaa0 con 0x7f121009d860 2023-10-03T10:16:54.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.580+0000 7f1217063700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121009e730 con 0x7f1210135f20 2023-10-03T10:16:54.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.580+0000 7f1217063700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121009f870 con 0x7f121009e340 2023-10-03T10:16:54.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.581+0000 7f120ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121009e340 0x7f12101359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.581+0000 7f1215600700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1210135f20 0x7f1210138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.581+0000 7f1215600700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1210135f20 0x7f1210138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60610/0 (socket says 172.21.15.146:60610) 2023-10-03T10:16:54.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.581+0000 7f1214dff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f121009d860 0x7f121009dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43968/0 (socket says 172.21.15.146:43968) 2023-10-03T10:16:54.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.581+0000 7f120ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121009e340 0x7f12101359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55486/0 (socket says 172.21.15.146:55486) 2023-10-03T10:16:54.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.581+0000 7f1214dff700 1 -- 172.21.15.146:0/3990813856 learned_addr learned my addr 172.21.15.146:0/3990813856 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:54.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.581+0000 7f1215600700 1 -- 172.21.15.146:0/3990813856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121009e340 msgr2=0x7f12101359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:54.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.581+0000 7f1215600700 1 --2- 172.21.15.146:0/3990813856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121009e340 0x7f12101359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.581+0000 7f1215600700 1 -- 172.21.15.146:0/3990813856 >> v1:172.21.15.146:6789/0 conn(0x7f121009d860 legacy=0x7f121009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.581+0000 7f1215600700 1 -- 172.21.15.146:0/3990813856 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121009b360 con 0x7f1210135f20 2023-10-03T10:16:54.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.581+0000 7f120f7fe700 1 -- 172.21.15.146:0/3990813856 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637150045 0 0) 0x7f121009aaa0 con 0x7f121009d860 2023-10-03T10:16:54.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.581+0000 7f120ffff700 1 --2- 172.21.15.146:0/3990813856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121009e340 0x7f12101359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.581+0000 7f1215600700 1 --2- 172.21.15.146:0/3990813856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1210135f20 0x7f1210138300 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f1208009d90 tx=0x7f120800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c0a46d1fd7093c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.581+0000 7f120f7fe700 1 -- 172.21.15.146:0/3990813856 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120800e070 con 0x7f1210135f20 2023-10-03T10:16:54.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.581+0000 7f120f7fe700 1 -- 172.21.15.146:0/3990813856 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120800bb20 con 0x7f1210135f20 2023-10-03T10:16:54.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.581+0000 7f120f7fe700 1 -- 172.21.15.146:0/3990813856 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1208012430 con 0x7f1210135f20 2023-10-03T10:16:54.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.582+0000 7f1217063700 1 -- 172.21.15.146:0/3990813856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1210135f20 msgr2=0x7f1210138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.582+0000 7f1217063700 1 --2- 172.21.15.146:0/3990813856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1210135f20 0x7f1210138300 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f1208009d90 tx=0x7f120800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:54.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.582+0000 7f1217063700 1 -- 172.21.15.146:0/3990813856 shutdown_connections 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.582+0000 7f1217063700 1 --2- 172.21.15.146:0/3990813856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1210135f20 0x7f1210138300 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.582+0000 7f1217063700 1 --2- 172.21.15.146:0/3990813856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121009e340 0x7f12101359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.582+0000 7f1217063700 1 -- 172.21.15.146:0/3990813856 >> 172.21.15.146:0/3990813856 conn(0x7f1210099c40 msgr2=0x7f12100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.582+0000 7f1217063700 1 -- 172.21.15.146:0/3990813856 shutdown_connections 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.582+0000 7f1217063700 1 -- 172.21.15.146:0/3990813856 wait complete. 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.583+0000 7f1217063700 1 Processor -- start 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.583+0000 7f1217063700 1 -- start start 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.583+0000 7f1217063700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121009d860 0x7f121011e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.583+0000 7f1217063700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121009e340 0x7f121011e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.583+0000 7f1217063700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1210135f20 0x7f121011ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.583+0000 7f1217063700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1210124d30 con 0x7f1210135f20 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.584+0000 7f1217063700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121006b390 con 0x7f121009e340 2023-10-03T10:16:54.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.584+0000 7f1217063700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1210124a90 con 0x7f121009d860 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.584+0000 7f120ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121009e340 0x7f121011e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.584+0000 7f120ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121009e340 0x7f121011e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55494/0 (socket says 172.21.15.146:55494) 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.584+0000 7f120ffff700 1 -- 172.21.15.146:0/2564193582 learned_addr learned my addr 172.21.15.146:0/2564193582 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.584+0000 7f1215600700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1210135f20 0x7f121011ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.584+0000 7f1214dff700 1 --2- 172.21.15.146:0/2564193582 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121009d860 0x7f121011e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.584+0000 7f120ffff700 1 -- 172.21.15.146:0/2564193582 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121009d860 msgr2=0x7f121011e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.584+0000 7f120ffff700 1 --2- 172.21.15.146:0/2564193582 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121009d860 0x7f121011e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.584+0000 7f120ffff700 1 -- 172.21.15.146:0/2564193582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1210135f20 msgr2=0x7f121011ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.584+0000 7f120ffff700 1 --2- 172.21.15.146:0/2564193582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1210135f20 0x7f121011ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.584+0000 7f120ffff700 1 -- 172.21.15.146:0/2564193582 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc0094a0 con 0x7f121009e340 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.584+0000 7f1215600700 1 --2- 172.21.15.146:0/2564193582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1210135f20 0x7f121011ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.584+0000 7f120ffff700 1 --2- 172.21.15.146:0/2564193582 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121009e340 0x7f121011e9e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f11fc00ebe0 tx=0x7f11fc00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.584+0000 7f120d7fa700 1 -- 172.21.15.146:0/2564193582 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc00c850 con 0x7f121009e340 2023-10-03T10:16:54.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.584+0000 7f120d7fa700 1 -- 172.21.15.146:0/2564193582 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11fc00c9b0 con 0x7f121009e340 2023-10-03T10:16:54.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.584+0000 7f120d7fa700 1 -- 172.21.15.146:0/2564193582 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc00cd40 con 0x7f121009e340 2023-10-03T10:16:54.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.584+0000 7f1217063700 1 -- 172.21.15.146:0/2564193582 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1208009a70 con 0x7f121009e340 2023-10-03T10:16:54.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.584+0000 7f1217063700 1 -- 172.21.15.146:0/2564193582 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f121011f820 con 0x7f121009e340 2023-10-03T10:16:54.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.585+0000 7f1217063700 1 -- 172.21.15.146:0/2564193582 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f121004f2a0 con 0x7f121009e340 2023-10-03T10:16:54.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.585+0000 7f120d7fa700 1 -- 172.21.15.146:0/2564193582 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f11fc013470 con 0x7f121009e340 2023-10-03T10:16:54.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.586+0000 7f120d7fa700 1 -- 172.21.15.146:0/2564193582 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f11fc0400c0 con 0x7f121009e340 2023-10-03T10:16:54.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.590+0000 7f120d7fa700 1 -- 172.21.15.146:0/2564193582 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11fc013720 con 0x7f121009e340 2023-10-03T10:16:54.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.772+0000 7f1217063700 1 -- 172.21.15.146:0/2564193582 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f121006c3b0 con 0x7f121009e340 2023-10-03T10:16:54.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.772+0000 7f120d7fa700 1 -- 172.21.15.146:0/2564193582 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f11fc017020 con 0x7f121009e340 2023-10-03T10:16:54.772 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:54.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.774+0000 7f1217063700 1 -- 172.21.15.146:0/2564193582 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121009e340 msgr2=0x7f121011e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.774+0000 7f1217063700 1 --2- 172.21.15.146:0/2564193582 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121009e340 0x7f121011e9e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f11fc00ebe0 tx=0x7f11fc00eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.774+0000 7f1217063700 1 -- 172.21.15.146:0/2564193582 shutdown_connections 2023-10-03T10:16:54.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.774+0000 7f1217063700 1 --2- 172.21.15.146:0/2564193582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1210135f20 0x7f121011ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.774+0000 7f1217063700 1 --2- 172.21.15.146:0/2564193582 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121009d860 0x7f121011e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.774+0000 7f1217063700 1 --2- 172.21.15.146:0/2564193582 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121009e340 0x7f121011e9e0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.774+0000 7f1217063700 1 -- 172.21.15.146:0/2564193582 >> 172.21.15.146:0/2564193582 conn(0x7f1210099c40 msgr2=0x7f1210134a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.774+0000 7f1217063700 1 -- 172.21.15.146:0/2564193582 shutdown_connections 2023-10-03T10:16:54.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:54.774+0000 7f1217063700 1 -- 172.21.15.146:0/2564193582 wait complete. 2023-10-03T10:16:54.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:54.942 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:55.026 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:55.064 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:55.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.066+0000 7f82653b2700 1 Processor -- start 2023-10-03T10:16:55.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.066+0000 7f82653b2700 1 -- start start 2023-10-03T10:16:55.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.067+0000 7f82653b2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f826009ad40 0x7f8260133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.067+0000 7f82653b2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8260133f70 0x7f82601343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.067+0000 7f82653b2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826009b110 con 0x7f82600a0a70 2023-10-03T10:16:55.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.067+0000 7f82653b2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82600a3b60 con 0x7f826009ad40 2023-10-03T10:16:55.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.067+0000 7f82653b2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82601348e0 con 0x7f8260133f70 2023-10-03T10:16:55.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.067+0000 7f825effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f826009ad40 0x7f8260133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.067+0000 7f825e7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8260133f70 0x7f82601343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.067+0000 7f825f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f82600a0a70 0x7f82600a0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43970/0 (socket says 172.21.15.146:43970) 2023-10-03T10:16:55.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.067+0000 7f825f7fe700 1 -- 172.21.15.146:0/2841315376 learned_addr learned my addr 172.21.15.146:0/2841315376 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:55.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.067+0000 7f825effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f826009ad40 0x7f8260133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60624/0 (socket says 172.21.15.146:60624) 2023-10-03T10:16:55.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.067+0000 7f825e7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8260133f70 0x7f82601343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:55826/0 (socket says 172.21.15.146:55826) 2023-10-03T10:16:55.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.067+0000 7f825e7fc700 1 -- 172.21.15.146:0/2841315376 >> v2:172.21.15.146:3300/0 conn(0x7f826009ad40 msgr2=0x7f8260133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.067+0000 7f825e7fc700 1 --2- 172.21.15.146:0/2841315376 >> v2:172.21.15.146:3300/0 conn(0x7f826009ad40 0x7f8260133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.067+0000 7f825e7fc700 1 -- 172.21.15.146:0/2841315376 >> v1:172.21.15.146:6789/0 conn(0x7f82600a0a70 legacy=0x7f82600a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.067+0000 7f825e7fc700 1 -- 172.21.15.146:0/2841315376 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82600a2fa0 con 0x7f8260133f70 2023-10-03T10:16:55.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.067+0000 7f825effd700 1 --2- 172.21.15.146:0/2841315376 >> v2:172.21.15.146:3300/0 conn(0x7f826009ad40 0x7f8260133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:55.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.068+0000 7f825e7fc700 1 --2- 172.21.15.146:0/2841315376 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8260133f70 0x7f82601343a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8254009840 tx=0x7f8254009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f2d1c40387f9e30 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.068+0000 7f825dffb700 1 -- 172.21.15.146:0/2841315376 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8254011830 con 0x7f8260133f70 2023-10-03T10:16:55.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.068+0000 7f825dffb700 1 -- 172.21.15.146:0/2841315376 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8254011990 con 0x7f8260133f70 2023-10-03T10:16:55.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.068+0000 7f825dffb700 1 -- 172.21.15.146:0/2841315376 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8254011d20 con 0x7f8260133f70 2023-10-03T10:16:55.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.068+0000 7f82653b2700 1 -- 172.21.15.146:0/2841315376 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8260133f70 msgr2=0x7f82601343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.068+0000 7f82653b2700 1 --2- 172.21.15.146:0/2841315376 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8260133f70 0x7f82601343a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8254009840 tx=0x7f8254009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:55.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.068+0000 7f82653b2700 1 -- 172.21.15.146:0/2841315376 shutdown_connections 2023-10-03T10:16:55.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.068+0000 7f82653b2700 1 --2- 172.21.15.146:0/2841315376 >> v2:172.21.15.146:3300/0 conn(0x7f826009ad40 0x7f8260133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.068+0000 7f82653b2700 1 --2- 172.21.15.146:0/2841315376 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8260133f70 0x7f82601343a0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.068+0000 7f82653b2700 1 -- 172.21.15.146:0/2841315376 >> 172.21.15.146:0/2841315376 conn(0x7f8260099c40 msgr2=0x7f826006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.069+0000 7f82653b2700 1 -- 172.21.15.146:0/2841315376 shutdown_connections 2023-10-03T10:16:55.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.069+0000 7f82653b2700 1 -- 172.21.15.146:0/2841315376 wait complete. 2023-10-03T10:16:55.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.070+0000 7f82653b2700 1 Processor -- start 2023-10-03T10:16:55.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.070+0000 7f82653b2700 1 -- start start 2023-10-03T10:16:55.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.070+0000 7f82653b2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f826009ad40 0x7f826011e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.070+0000 7f82653b2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82600a0a70 0x7f826011e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.070+0000 7f82653b2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8260133f70 0x7f826011eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.070+0000 7f82653b2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8260122530 con 0x7f8260133f70 2023-10-03T10:16:55.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.070+0000 7f82653b2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826011fc60 con 0x7f82600a0a70 2023-10-03T10:16:55.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.070+0000 7f82653b2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8260120280 con 0x7f826009ad40 2023-10-03T10:16:55.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.071+0000 7f825effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f826009ad40 0x7f826011e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.071+0000 7f825effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f826009ad40 0x7f826011e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:55834/0 (socket says 172.21.15.146:55834) 2023-10-03T10:16:55.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.071+0000 7f825effd700 1 -- 172.21.15.146:0/3498189305 learned_addr learned my addr 172.21.15.146:0/3498189305 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:55.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.071+0000 7f825f7fe700 1 --2- 172.21.15.146:0/3498189305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8260133f70 0x7f826011eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.071+0000 7f825e7fc700 1 --2- 172.21.15.146:0/3498189305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82600a0a70 0x7f826011e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.071+0000 7f825effd700 1 -- 172.21.15.146:0/3498189305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82600a0a70 msgr2=0x7f826011e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.071+0000 7f825effd700 1 --2- 172.21.15.146:0/3498189305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82600a0a70 0x7f826011e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.071+0000 7f825effd700 1 -- 172.21.15.146:0/3498189305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8260133f70 msgr2=0x7f826011eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.071+0000 7f825effd700 1 --2- 172.21.15.146:0/3498189305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8260133f70 0x7f826011eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.071+0000 7f825effd700 1 -- 172.21.15.146:0/3498189305 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82500094a0 con 0x7f826009ad40 2023-10-03T10:16:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.071+0000 7f825e7fc700 1 --2- 172.21.15.146:0/3498189305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82600a0a70 0x7f826011e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.071+0000 7f825effd700 1 --2- 172.21.15.146:0/3498189305 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f826009ad40 0x7f826011e0a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f825000ec40 tx=0x7f825000ef50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.071+0000 7f82477fe700 1 -- 172.21.15.146:0/3498189305 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8250009760 con 0x7f826009ad40 2023-10-03T10:16:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.071+0000 7f82477fe700 1 -- 172.21.15.146:0/3498189305 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825000c850 con 0x7f826009ad40 2023-10-03T10:16:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.071+0000 7f82653b2700 1 -- 172.21.15.146:0/3498189305 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82540094a0 con 0x7f826009ad40 2023-10-03T10:16:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.072+0000 7f82477fe700 1 -- 172.21.15.146:0/3498189305 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825000cbe0 con 0x7f826009ad40 2023-10-03T10:16:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.072+0000 7f82653b2700 1 -- 172.21.15.146:0/3498189305 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82600a0ed0 con 0x7f826009ad40 2023-10-03T10:16:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.072+0000 7f82477fe700 1 -- 172.21.15.146:0/3498189305 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f825000cd40 con 0x7f826009ad40 2023-10-03T10:16:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.072+0000 7f82477fe700 1 -- 172.21.15.146:0/3498189305 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f825003fae0 con 0x7f826009ad40 2023-10-03T10:16:55.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.073+0000 7f82653b2700 1 -- 172.21.15.146:0/3498189305 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f826009c840 con 0x7f826009ad40 2023-10-03T10:16:55.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.077+0000 7f82477fe700 1 -- 172.21.15.146:0/3498189305 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f825001b3b0 con 0x7f826009ad40 2023-10-03T10:16:55.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.166+0000 7f766650d700 1 Processor -- start 2023-10-03T10:16:55.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.166+0000 7f766650d700 1 -- start start 2023-10-03T10:16:55.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.166+0000 7f766650d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7660136960 0x7f7660138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.166+0000 7f766650d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7660139280 0x7f766013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.166+0000 7f766650d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f766006b2d0 con 0x7f7660133ad0 2023-10-03T10:16:55.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.166+0000 7f766650d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76601345b0 con 0x7f7660136960 2023-10-03T10:16:55.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.166+0000 7f766650d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7660133610 con 0x7f7660139280 2023-10-03T10:16:55.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.166+0000 7f765ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7660133ad0 0x7f7660133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43986/0 (socket says 172.21.15.146:43986) 2023-10-03T10:16:55.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.166+0000 7f765ffff700 1 -- 172.21.15.146:0/3021426624 learned_addr learned my addr 172.21.15.146:0/3021426624 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:55.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.166+0000 7f7664aaa700 1 --2- 172.21.15.146:0/3021426624 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7660139280 0x7f766013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.166+0000 7f765f7fe700 1 --2- 172.21.15.146:0/3021426624 >> v2:172.21.15.146:3300/0 conn(0x7f7660136960 0x7f7660138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.167+0000 7f765effd700 1 -- 172.21.15.146:0/3021426624 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649947908 0 0) 0x7f766006b2d0 con 0x7f7660133ad0 2023-10-03T10:16:55.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.167+0000 7f7664aaa700 1 -- 172.21.15.146:0/3021426624 >> v2:172.21.15.146:3300/0 conn(0x7f7660136960 msgr2=0x7f7660138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.167+0000 7f7664aaa700 1 --2- 172.21.15.146:0/3021426624 >> v2:172.21.15.146:3300/0 conn(0x7f7660136960 0x7f7660138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.167+0000 7f7664aaa700 1 -- 172.21.15.146:0/3021426624 >> v1:172.21.15.146:6789/0 conn(0x7f7660133ad0 legacy=0x7f7660133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.167+0000 7f7664aaa700 1 -- 172.21.15.146:0/3021426624 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766009a500 con 0x7f7660139280 2023-10-03T10:16:55.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.167+0000 7f7664aaa700 1 --2- 172.21.15.146:0/3021426624 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7660139280 0x7f766013b660 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7658009d90 tx=0x7f765800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65cd996ba2f20c3e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.167+0000 7f765effd700 1 -- 172.21.15.146:0/3021426624 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765800e070 con 0x7f7660139280 2023-10-03T10:16:55.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.167+0000 7f765effd700 1 -- 172.21.15.146:0/3021426624 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765800bb20 con 0x7f7660139280 2023-10-03T10:16:55.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.167+0000 7f765effd700 1 -- 172.21.15.146:0/3021426624 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7658012430 con 0x7f7660139280 2023-10-03T10:16:55.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.168+0000 7f766650d700 1 -- 172.21.15.146:0/3021426624 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7660139280 msgr2=0x7f766013b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.168+0000 7f766650d700 1 --2- 172.21.15.146:0/3021426624 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7660139280 0x7f766013b660 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7658009d90 tx=0x7f765800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:55.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.168+0000 7f766650d700 1 -- 172.21.15.146:0/3021426624 shutdown_connections 2023-10-03T10:16:55.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.168+0000 7f766650d700 1 --2- 172.21.15.146:0/3021426624 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7660139280 0x7f766013b660 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.168+0000 7f766650d700 1 --2- 172.21.15.146:0/3021426624 >> v2:172.21.15.146:3300/0 conn(0x7f7660136960 0x7f7660138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.168+0000 7f766650d700 1 -- 172.21.15.146:0/3021426624 >> 172.21.15.146:0/3021426624 conn(0x7f7660099c40 msgr2=0x7f76600a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.168+0000 7f766650d700 1 -- 172.21.15.146:0/3021426624 shutdown_connections 2023-10-03T10:16:55.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.168+0000 7f766650d700 1 -- 172.21.15.146:0/3021426624 wait complete. 2023-10-03T10:16:55.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.169+0000 7f766650d700 1 Processor -- start 2023-10-03T10:16:55.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.169+0000 7f766650d700 1 -- start start 2023-10-03T10:16:55.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.170+0000 7f766650d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7660133ad0 0x7f766012cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.170+0000 7f766650d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7660136960 0x7f766012d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.170+0000 7f766650d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7660139280 0x7f766012d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.170+0000 7f766650d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7660070210 con 0x7f7660136960 2023-10-03T10:16:55.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.170+0000 7f766650d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76600703f0 con 0x7f7660133ad0 2023-10-03T10:16:55.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.170+0000 7f766650d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76600726e0 con 0x7f7660139280 2023-10-03T10:16:55.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.170+0000 7f765ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7660133ad0 0x7f766012cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.170+0000 7f765ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7660133ad0 0x7f766012cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55516/0 (socket says 172.21.15.146:55516) 2023-10-03T10:16:55.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.170+0000 7f7664aaa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7660139280 0x7f766012d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.170+0000 7f765ffff700 1 -- 172.21.15.146:0/3637300913 learned_addr learned my addr 172.21.15.146:0/3637300913 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:55.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.170+0000 7f765f7fe700 1 --2- 172.21.15.146:0/3637300913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7660136960 0x7f766012d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.170+0000 7f7664aaa700 1 -- 172.21.15.146:0/3637300913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7660133ad0 msgr2=0x7f766012cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.170+0000 7f7664aaa700 1 --2- 172.21.15.146:0/3637300913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7660133ad0 0x7f766012cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.170+0000 7f7664aaa700 1 -- 172.21.15.146:0/3637300913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7660136960 msgr2=0x7f766012d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.170+0000 7f7664aaa700 1 --2- 172.21.15.146:0/3637300913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7660136960 0x7f766012d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.170+0000 7f7664aaa700 1 -- 172.21.15.146:0/3637300913 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7658009a70 con 0x7f7660139280 2023-10-03T10:16:55.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.171+0000 7f765ffff700 1 --2- 172.21.15.146:0/3637300913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7660133ad0 0x7f766012cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:55.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.171+0000 7f765f7fe700 1 --2- 172.21.15.146:0/3637300913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7660136960 0x7f766012d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:55.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.171+0000 7f7664aaa700 1 --2- 172.21.15.146:0/3637300913 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7660139280 0x7f766012d5b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f7658016000 tx=0x7f7658004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.171+0000 7f765cff9700 1 -- 172.21.15.146:0/3637300913 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7658012430 con 0x7f7660139280 2023-10-03T10:16:55.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.171+0000 7f765cff9700 1 -- 172.21.15.146:0/3637300913 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7658020070 con 0x7f7660139280 2023-10-03T10:16:55.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.171+0000 7f765cff9700 1 -- 172.21.15.146:0/3637300913 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7658004280 con 0x7f7660139280 2023-10-03T10:16:55.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.171+0000 7f766650d700 1 -- 172.21.15.146:0/3637300913 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76601317a0 con 0x7f7660139280 2023-10-03T10:16:55.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.171+0000 7f766650d700 1 -- 172.21.15.146:0/3637300913 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766009f3e0 con 0x7f7660139280 2023-10-03T10:16:55.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.172+0000 7f765cff9700 1 -- 172.21.15.146:0/3637300913 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f76580043e0 con 0x7f7660139280 2023-10-03T10:16:55.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.172+0000 7f765cff9700 1 -- 172.21.15.146:0/3637300913 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7658022070 con 0x7f7660139280 2023-10-03T10:16:55.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.173+0000 7f766650d700 1 -- 172.21.15.146:0/3637300913 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76601302a0 con 0x7f7660139280 2023-10-03T10:16:55.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.178+0000 7f765cff9700 1 -- 172.21.15.146:0/3637300913 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7658025380 con 0x7f7660139280 2023-10-03T10:16:55.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.216+0000 7f81ddf14700 1 Processor -- start 2023-10-03T10:16:55.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.216+0000 7f81ddf14700 1 -- start start 2023-10-03T10:16:55.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.217+0000 7f81ddf14700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81d809e950 0x7f81d809ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.217+0000 7f81ddf14700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81d8134390 0x7f81d813bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.217+0000 7f81ddf14700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d806bcc0 con 0x7f81d809f260 2023-10-03T10:16:55.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.217+0000 7f81ddf14700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d806c9a0 con 0x7f81d8134390 2023-10-03T10:16:55.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.217+0000 7f81ddf14700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81d809afe0 con 0x7f81d809e950 2023-10-03T10:16:55.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.217+0000 7f81d6ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f81d809f260 0x7f81d8133c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44000/0 (socket says 172.21.15.146:44000) 2023-10-03T10:16:55.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.217+0000 7f81d6ffd700 1 -- 172.21.15.146:0/1356639759 learned_addr learned my addr 172.21.15.146:0/1356639759 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:55.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.217+0000 7f81d7fff700 1 --2- 172.21.15.146:0/1356639759 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81d8134390 0x7f81d813bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.217+0000 7f81d77fe700 1 --2- 172.21.15.146:0/1356639759 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81d809e950 0x7f81d809ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.217+0000 7f81d67fc700 1 -- 172.21.15.146:0/1356639759 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197438582 0 0) 0x7f81d806bcc0 con 0x7f81d809f260 2023-10-03T10:16:55.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.217+0000 7f81d67fc700 1 -- 172.21.15.146:0/1356639759 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c00035b0 con 0x7f81d809f260 2023-10-03T10:16:55.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.217+0000 7f81d77fe700 1 -- 172.21.15.146:0/1356639759 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81d8134390 msgr2=0x7f81d813bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.217+0000 7f81d77fe700 1 --2- 172.21.15.146:0/1356639759 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81d8134390 0x7f81d813bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.217+0000 7f81d77fe700 1 -- 172.21.15.146:0/1356639759 >> v1:172.21.15.146:6789/0 conn(0x7f81d809f260 legacy=0x7f81d8133c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.217+0000 7f81d77fe700 1 -- 172.21.15.146:0/1356639759 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d806cb80 con 0x7f81d809e950 2023-10-03T10:16:55.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.217+0000 7f81d7fff700 1 --2- 172.21.15.146:0/1356639759 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81d8134390 0x7f81d813bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:55.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.217+0000 7f81d77fe700 1 --2- 172.21.15.146:0/1356639759 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81d809e950 0x7f81d809ed20 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009850 tx=0x7f81c8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5c506cc7d71f7f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.218+0000 7f81d67fc700 1 -- 172.21.15.146:0/1356639759 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8005e30 con 0x7f81d809e950 2023-10-03T10:16:55.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.218+0000 7f81d67fc700 1 -- 172.21.15.146:0/1356639759 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c8006030 con 0x7f81d809e950 2023-10-03T10:16:55.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.218+0000 7f81d67fc700 1 -- 172.21.15.146:0/1356639759 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c80063e0 con 0x7f81d809e950 2023-10-03T10:16:55.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.218+0000 7f81ddf14700 1 -- 172.21.15.146:0/1356639759 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81d809e950 msgr2=0x7f81d809ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.218+0000 7f81ddf14700 1 --2- 172.21.15.146:0/1356639759 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81d809e950 0x7f81d809ed20 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009850 tx=0x7f81c8009b60 comp rx=0 tx=0).stop 2023-10-03T10:16:55.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.218+0000 7f81ddf14700 1 -- 172.21.15.146:0/1356639759 shutdown_connections 2023-10-03T10:16:55.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.218+0000 7f81ddf14700 1 --2- 172.21.15.146:0/1356639759 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81d8134390 0x7f81d813bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.218+0000 7f81ddf14700 1 --2- 172.21.15.146:0/1356639759 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81d809e950 0x7f81d809ed20 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.218+0000 7f81ddf14700 1 -- 172.21.15.146:0/1356639759 >> 172.21.15.146:0/1356639759 conn(0x7f81d80a0f70 msgr2=0x7f81d80a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.218+0000 7f81ddf14700 1 -- 172.21.15.146:0/1356639759 shutdown_connections 2023-10-03T10:16:55.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.218+0000 7f81ddf14700 1 -- 172.21.15.146:0/1356639759 wait complete. 2023-10-03T10:16:55.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.219+0000 7f81ddf14700 1 Processor -- start 2023-10-03T10:16:55.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.219+0000 7f81ddf14700 1 -- start start 2023-10-03T10:16:55.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.220+0000 7f81ddf14700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81d809e950 0x7f81d8122a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.220+0000 7f81ddf14700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81d809f260 0x7f81d8122fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.220+0000 7f81ddf14700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81d8134390 0x7f81d8123510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.220+0000 7f81ddf14700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d8126360 con 0x7f81d809e950 2023-10-03T10:16:55.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.220+0000 7f81ddf14700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d8124740 con 0x7f81d8134390 2023-10-03T10:16:55.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.220+0000 7f81ddf14700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81d8123ef0 con 0x7f81d809f260 2023-10-03T10:16:55.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.220+0000 7f81d6ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81d809f260 0x7f81d8122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.220+0000 7f81d6ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81d809f260 0x7f81d8122fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:55878/0 (socket says 172.21.15.146:55878) 2023-10-03T10:16:55.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.220+0000 7f81d6ffd700 1 -- 172.21.15.146:0/3534186870 learned_addr learned my addr 172.21.15.146:0/3534186870 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:55.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.220+0000 7f81d77fe700 1 --2- 172.21.15.146:0/3534186870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81d809e950 0x7f81d8122a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.220+0000 7f81d7fff700 1 --2- 172.21.15.146:0/3534186870 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81d8134390 0x7f81d8123510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.220+0000 7f81d6ffd700 1 -- 172.21.15.146:0/3534186870 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81d8134390 msgr2=0x7f81d8123510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.220+0000 7f81d6ffd700 1 --2- 172.21.15.146:0/3534186870 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81d8134390 0x7f81d8123510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.220+0000 7f81d6ffd700 1 -- 172.21.15.146:0/3534186870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81d809e950 msgr2=0x7f81d8122a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.220+0000 7f81d6ffd700 1 --2- 172.21.15.146:0/3534186870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81d809e950 0x7f81d8122a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.220+0000 7f81d6ffd700 1 -- 172.21.15.146:0/3534186870 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d0009a70 con 0x7f81d809f260 2023-10-03T10:16:55.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.220+0000 7f81d77fe700 1 --2- 172.21.15.146:0/3534186870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81d809e950 0x7f81d8122a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:55.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.220+0000 7f81d6ffd700 1 --2- 172.21.15.146:0/3534186870 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81d809f260 0x7f81d8122fd0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00c730 tx=0x7f81cc00caf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.220+0000 7f81bffff700 1 -- 172.21.15.146:0/3534186870 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc005d70 con 0x7f81d809f260 2023-10-03T10:16:55.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.221+0000 7f81bffff700 1 -- 172.21.15.146:0/3534186870 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81cc0070d0 con 0x7f81d809f260 2023-10-03T10:16:55.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.221+0000 7f81ddf14700 1 -- 172.21.15.146:0/3534186870 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c8009430 con 0x7f81d809f260 2023-10-03T10:16:55.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.221+0000 7f81bffff700 1 -- 172.21.15.146:0/3534186870 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc007440 con 0x7f81d809f260 2023-10-03T10:16:55.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.221+0000 7f81ddf14700 1 -- 172.21.15.146:0/3534186870 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d8126010 con 0x7f81d809f260 2023-10-03T10:16:55.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.221+0000 7f81bffff700 1 -- 172.21.15.146:0/3534186870 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81cc0075a0 con 0x7f81d809f260 2023-10-03T10:16:55.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.222+0000 7f81bffff700 1 -- 172.21.15.146:0/3534186870 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f81cc03eb60 con 0x7f81d809f260 2023-10-03T10:16:55.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.222+0000 7f81ddf14700 1 -- 172.21.15.146:0/3534186870 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d804f2a0 con 0x7f81d809f260 2023-10-03T10:16:55.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.226+0000 7f81bffff700 1 -- 172.21.15.146:0/3534186870 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81cc017080 con 0x7f81d809f260 2023-10-03T10:16:55.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.280+0000 7f82653b2700 1 -- 172.21.15.146:0/3498189305 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f826009ed10 con 0x7f826009ad40 2023-10-03T10:16:55.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.281+0000 7f82477fe700 1 -- 172.21.15.146:0/3498189305 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8250017020 con 0x7f826009ad40 2023-10-03T10:16:55.280 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:55.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.283+0000 7f82653b2700 1 -- 172.21.15.146:0/3498189305 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f826009ad40 msgr2=0x7f826011e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.283+0000 7f82653b2700 1 --2- 172.21.15.146:0/3498189305 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f826009ad40 0x7f826011e0a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f825000ec40 tx=0x7f825000ef50 comp rx=0 tx=0).stop 2023-10-03T10:16:55.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.283+0000 7f82653b2700 1 -- 172.21.15.146:0/3498189305 shutdown_connections 2023-10-03T10:16:55.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.283+0000 7f82653b2700 1 --2- 172.21.15.146:0/3498189305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8260133f70 0x7f826011eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.283+0000 7f82653b2700 1 --2- 172.21.15.146:0/3498189305 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f826009ad40 0x7f826011e0a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.283+0000 7f82653b2700 1 --2- 172.21.15.146:0/3498189305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82600a0a70 0x7f826011e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.283+0000 7f82653b2700 1 -- 172.21.15.146:0/3498189305 >> 172.21.15.146:0/3498189305 conn(0x7f8260099c40 msgr2=0x7f8260133080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.283+0000 7f82653b2700 1 -- 172.21.15.146:0/3498189305 shutdown_connections 2023-10-03T10:16:55.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.283+0000 7f82653b2700 1 -- 172.21.15.146:0/3498189305 wait complete. 2023-10-03T10:16:55.295 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.406+0000 7f766650d700 1 -- 172.21.15.146:0/3637300913 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f766004f2a0 con 0x7f7660139280 2023-10-03T10:16:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.407+0000 7f765cff9700 1 -- 172.21.15.146:0/3637300913 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7658026bd0 con 0x7f7660139280 2023-10-03T10:16:55.406 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:55.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.409+0000 7f766650d700 1 -- 172.21.15.146:0/3637300913 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7660139280 msgr2=0x7f766012d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.409+0000 7f766650d700 1 --2- 172.21.15.146:0/3637300913 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7660139280 0x7f766012d5b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f7658016000 tx=0x7f7658004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.409+0000 7f766650d700 1 -- 172.21.15.146:0/3637300913 shutdown_connections 2023-10-03T10:16:55.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.409+0000 7f766650d700 1 --2- 172.21.15.146:0/3637300913 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7660139280 0x7f766012d5b0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.409+0000 7f766650d700 1 --2- 172.21.15.146:0/3637300913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7660133ad0 0x7f766012cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.409+0000 7f766650d700 1 --2- 172.21.15.146:0/3637300913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7660136960 0x7f766012d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.409+0000 7f766650d700 1 -- 172.21.15.146:0/3637300913 >> 172.21.15.146:0/3637300913 conn(0x7f7660099c40 msgr2=0x7f7660132880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.409+0000 7f766650d700 1 -- 172.21.15.146:0/3637300913 shutdown_connections 2023-10-03T10:16:55.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.409+0000 7f766650d700 1 -- 172.21.15.146:0/3637300913 wait complete. 2023-10-03T10:16:55.421 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:55.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.437+0000 7f81ddf14700 1 -- 172.21.15.146:0/3534186870 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f81d80a0850 con 0x7f81d809f260 2023-10-03T10:16:55.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.438+0000 7f81bffff700 1 -- 172.21.15.146:0/3534186870 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f81cc019b40 con 0x7f81d809f260 2023-10-03T10:16:55.437 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:55.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.440+0000 7f81ddf14700 1 -- 172.21.15.146:0/3534186870 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81d809f260 msgr2=0x7f81d8122fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.440+0000 7f81ddf14700 1 --2- 172.21.15.146:0/3534186870 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81d809f260 0x7f81d8122fd0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00c730 tx=0x7f81cc00caf0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.440+0000 7f81ddf14700 1 -- 172.21.15.146:0/3534186870 shutdown_connections 2023-10-03T10:16:55.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.440+0000 7f81ddf14700 1 --2- 172.21.15.146:0/3534186870 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81d8134390 0x7f81d8123510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.440+0000 7f81ddf14700 1 --2- 172.21.15.146:0/3534186870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81d809e950 0x7f81d8122a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.440+0000 7f81ddf14700 1 --2- 172.21.15.146:0/3534186870 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81d809f260 0x7f81d8122fd0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.440+0000 7f81ddf14700 1 -- 172.21.15.146:0/3534186870 >> 172.21.15.146:0/3534186870 conn(0x7f81d80a0f70 msgr2=0x7f81d809ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.440+0000 7f81ddf14700 1 -- 172.21.15.146:0/3534186870 shutdown_connections 2023-10-03T10:16:55.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.440+0000 7f81ddf14700 1 -- 172.21.15.146:0/3534186870 wait complete. 2023-10-03T10:16:55.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:55.787 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:55.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.911+0000 7f4ec3f5e700 1 Processor -- start 2023-10-03T10:16:55.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.911+0000 7f4ec3f5e700 1 -- start start 2023-10-03T10:16:55.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.912+0000 7f4ec3f5e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ebc06a770 0x7f4ebc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.912+0000 7f4ec3f5e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ebc136cb0 0x7f4ebc139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.912+0000 7f4ec3f5e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc06e900 con 0x7f4ebc09dec0 2023-10-03T10:16:55.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.912+0000 7f4ec3f5e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc09d180 con 0x7f4ebc06a770 2023-10-03T10:16:55.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.912+0000 7f4ec3f5e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc09e780 con 0x7f4ebc136cb0 2023-10-03T10:16:55.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.912+0000 7f4ec1cfa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ebc06a770 0x7f4ebc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.912+0000 7f4ec14f9700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4ebc09dec0 0x7f4ebc06b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44016/0 (socket says 172.21.15.146:44016) 2023-10-03T10:16:55.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.912+0000 7f4ec24fb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ebc136cb0 0x7f4ebc139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.912+0000 7f4ec14f9700 1 -- 172.21.15.146:0/3111668666 learned_addr learned my addr 172.21.15.146:0/3111668666 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:55.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.912+0000 7f4ec24fb700 1 -- 172.21.15.146:0/3111668666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ebc06a770 msgr2=0x7f4ebc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.912+0000 7f4ec24fb700 1 --2- 172.21.15.146:0/3111668666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ebc06a770 0x7f4ebc06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.912+0000 7f4ec24fb700 1 -- 172.21.15.146:0/3111668666 >> v1:172.21.15.146:6789/0 conn(0x7f4ebc09dec0 legacy=0x7f4ebc06b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.912+0000 7f4ec0cf8700 1 -- 172.21.15.146:0/3111668666 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418556820 0 0) 0x7f4ebc06e900 con 0x7f4ebc09dec0 2023-10-03T10:16:55.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.912+0000 7f4ec24fb700 1 -- 172.21.15.146:0/3111668666 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ebc09d3c0 con 0x7f4ebc136cb0 2023-10-03T10:16:55.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.912+0000 7f4ec1cfa700 1 --2- 172.21.15.146:0/3111668666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ebc06a770 0x7f4ebc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:55.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.912+0000 7f4ec24fb700 1 --2- 172.21.15.146:0/3111668666 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ebc136cb0 0x7f4ebc139090 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4009dc0 tx=0x7f4eb400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58a0939a49f41bab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.913+0000 7f4ec0cf8700 1 -- 172.21.15.146:0/3111668666 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb400e070 con 0x7f4ebc136cb0 2023-10-03T10:16:55.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.913+0000 7f4ec0cf8700 1 -- 172.21.15.146:0/3111668666 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb400bb20 con 0x7f4ebc136cb0 2023-10-03T10:16:55.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.913+0000 7f4ec0cf8700 1 -- 172.21.15.146:0/3111668666 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb4012430 con 0x7f4ebc136cb0 2023-10-03T10:16:55.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.913+0000 7f4ec3f5e700 1 -- 172.21.15.146:0/3111668666 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ebc136cb0 msgr2=0x7f4ebc139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.913+0000 7f4ec3f5e700 1 --2- 172.21.15.146:0/3111668666 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ebc136cb0 0x7f4ebc139090 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4009dc0 tx=0x7f4eb400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:55.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.913+0000 7f4ec3f5e700 1 -- 172.21.15.146:0/3111668666 shutdown_connections 2023-10-03T10:16:55.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.913+0000 7f4ec3f5e700 1 --2- 172.21.15.146:0/3111668666 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ebc136cb0 0x7f4ebc139090 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.913+0000 7f4ec3f5e700 1 --2- 172.21.15.146:0/3111668666 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ebc06a770 0x7f4ebc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.913+0000 7f4ec3f5e700 1 -- 172.21.15.146:0/3111668666 >> 172.21.15.146:0/3111668666 conn(0x7f4ebc099c40 msgr2=0x7f4ebc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.913+0000 7f4ec3f5e700 1 -- 172.21.15.146:0/3111668666 shutdown_connections 2023-10-03T10:16:55.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.913+0000 7f4ec3f5e700 1 -- 172.21.15.146:0/3111668666 wait complete. 2023-10-03T10:16:55.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.914+0000 7f4ec3f5e700 1 Processor -- start 2023-10-03T10:16:55.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.914+0000 7f4ec3f5e700 1 -- start start 2023-10-03T10:16:55.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4ec3f5e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ebc06a770 0x7f4ebc134370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4ec3f5e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ebc09dec0 0x7f4ebc1348b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4ec3f5e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ebc136cb0 0x7f4ebc134df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4ec3f5e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc0a1140 con 0x7f4ebc136cb0 2023-10-03T10:16:55.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4ec3f5e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc11aa60 con 0x7f4ebc06a770 2023-10-03T10:16:55.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4ec3f5e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc071ce0 con 0x7f4ebc09dec0 2023-10-03T10:16:55.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4ec14f9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ebc09dec0 0x7f4ebc1348b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4ec1cfa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ebc06a770 0x7f4ebc134370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4ec1cfa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ebc06a770 0x7f4ebc134370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55552/0 (socket says 172.21.15.146:55552) 2023-10-03T10:16:55.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4ec14f9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ebc09dec0 0x7f4ebc1348b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:55890/0 (socket says 172.21.15.146:55890) 2023-10-03T10:16:55.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4ec1cfa700 1 -- 172.21.15.146:0/1295017266 learned_addr learned my addr 172.21.15.146:0/1295017266 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:55.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4ec24fb700 1 --2- 172.21.15.146:0/1295017266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ebc136cb0 0x7f4ebc134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4ec1cfa700 1 -- 172.21.15.146:0/1295017266 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ebc09dec0 msgr2=0x7f4ebc1348b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4ec1cfa700 1 --2- 172.21.15.146:0/1295017266 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ebc09dec0 0x7f4ebc1348b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4ec1cfa700 1 -- 172.21.15.146:0/1295017266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ebc136cb0 msgr2=0x7f4ebc134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4ec1cfa700 1 --2- 172.21.15.146:0/1295017266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ebc136cb0 0x7f4ebc134df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4ec1cfa700 1 -- 172.21.15.146:0/1295017266 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eac0094a0 con 0x7f4ebc06a770 2023-10-03T10:16:55.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4ec1cfa700 1 --2- 172.21.15.146:0/1295017266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ebc06a770 0x7f4ebc134370 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00ebe0 tx=0x7f4eac00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4eb27fc700 1 -- 172.21.15.146:0/1295017266 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac00c850 con 0x7f4ebc06a770 2023-10-03T10:16:55.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4eb27fc700 1 -- 172.21.15.146:0/1295017266 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eac00c9b0 con 0x7f4ebc06a770 2023-10-03T10:16:55.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4ec3f5e700 1 -- 172.21.15.146:0/1295017266 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb4009a70 con 0x7f4ebc06a770 2023-10-03T10:16:55.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4eb27fc700 1 -- 172.21.15.146:0/1295017266 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac00cd40 con 0x7f4ebc06a770 2023-10-03T10:16:55.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.915+0000 7f4ec3f5e700 1 -- 172.21.15.146:0/1295017266 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ebc135f80 con 0x7f4ebc06a770 2023-10-03T10:16:55.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.916+0000 7f4eb27fc700 1 -- 172.21.15.146:0/1295017266 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4eac013470 con 0x7f4ebc06a770 2023-10-03T10:16:55.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.916+0000 7f4ec3f5e700 1 -- 172.21.15.146:0/1295017266 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ebc1369a0 con 0x7f4ebc06a770 2023-10-03T10:16:55.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.916+0000 7f4eb27fc700 1 -- 172.21.15.146:0/1295017266 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4eac03f830 con 0x7f4ebc06a770 2023-10-03T10:16:55.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:55.921+0000 7f4eb27fc700 1 -- 172.21.15.146:0/1295017266 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4eac013720 con 0x7f4ebc06a770 2023-10-03T10:16:56.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.105+0000 7f4ec3f5e700 1 -- 172.21.15.146:0/1295017266 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4ebc11a600 con 0x7f4ebc06a770 2023-10-03T10:16:56.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.105+0000 7f4eb27fc700 1 -- 172.21.15.146:0/1295017266 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4ebc11a600 con 0x7f4ebc06a770 2023-10-03T10:16:56.105 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:56.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.107+0000 7f4ec3f5e700 1 -- 172.21.15.146:0/1295017266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ebc06a770 msgr2=0x7f4ebc134370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.107+0000 7f4ec3f5e700 1 --2- 172.21.15.146:0/1295017266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ebc06a770 0x7f4ebc134370 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00ebe0 tx=0x7f4eac00eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.107+0000 7f4ec3f5e700 1 -- 172.21.15.146:0/1295017266 shutdown_connections 2023-10-03T10:16:56.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.107+0000 7f4ec3f5e700 1 --2- 172.21.15.146:0/1295017266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ebc136cb0 0x7f4ebc134df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.107+0000 7f4ec3f5e700 1 --2- 172.21.15.146:0/1295017266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ebc06a770 0x7f4ebc134370 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.107+0000 7f4ec3f5e700 1 --2- 172.21.15.146:0/1295017266 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ebc09dec0 0x7f4ebc1348b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.107+0000 7f4ec3f5e700 1 -- 172.21.15.146:0/1295017266 >> 172.21.15.146:0/1295017266 conn(0x7f4ebc099c40 msgr2=0x7f4ebc138800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.107+0000 7f4ec3f5e700 1 -- 172.21.15.146:0/1295017266 shutdown_connections 2023-10-03T10:16:56.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.107+0000 7f4ec3f5e700 1 -- 172.21.15.146:0/1295017266 wait complete. 2023-10-03T10:16:56.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:56.296 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:56.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.418+0000 7f5a35b1d700 1 Processor -- start 2023-10-03T10:16:56.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.418+0000 7f5a35b1d700 1 -- start start 2023-10-03T10:16:56.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.419+0000 7f5a35b1d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5a3009d860 0x7f5a3009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.419+0000 7f5a35b1d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a30130eb0 0x7f5a30138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.419+0000 7f5a35b1d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3009aaa0 con 0x7f5a3009e170 2023-10-03T10:16:56.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.419+0000 7f5a35b1d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3009f870 con 0x7f5a3009d860 2023-10-03T10:16:56.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.419+0000 7f5a35b1d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3009b360 con 0x7f5a30130eb0 2023-10-03T10:16:56.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.419+0000 7f5a2f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5a3009d860 0x7f5a3009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.419+0000 7f5a2ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a30130eb0 0x7f5a30138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.419+0000 7f5a2effd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5a3009e170 0x7f5a301307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44022/0 (socket says 172.21.15.146:44022) 2023-10-03T10:16:56.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.419+0000 7f5a2effd700 1 -- 172.21.15.146:0/3130909113 learned_addr learned my addr 172.21.15.146:0/3130909113 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:56.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.419+0000 7f5a2f7fe700 1 -- 172.21.15.146:0/3130909113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a30130eb0 msgr2=0x7f5a30138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:56.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.419+0000 7f5a2f7fe700 1 --2- 172.21.15.146:0/3130909113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a30130eb0 0x7f5a30138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.419+0000 7f5a2f7fe700 1 -- 172.21.15.146:0/3130909113 >> v1:172.21.15.146:6789/0 conn(0x7f5a3009e170 legacy=0x7f5a301307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.419+0000 7f5a2f7fe700 1 -- 172.21.15.146:0/3130909113 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3009b620 con 0x7f5a3009d860 2023-10-03T10:16:56.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.419+0000 7f5a2e7fc700 1 -- 172.21.15.146:0/3130909113 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2697724875 0 0) 0x7f5a3009aaa0 con 0x7f5a3009e170 2023-10-03T10:16:56.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.419+0000 7f5a2ffff700 1 --2- 172.21.15.146:0/3130909113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a30130eb0 0x7f5a30138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:56.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.419+0000 7f5a2f7fe700 1 --2- 172.21.15.146:0/3130909113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a3009d860 0x7f5a3009dc30 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f5a18009840 tx=0x7f5a18009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c687eb18f2ef14 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.419+0000 7f5a2e7fc700 1 -- 172.21.15.146:0/3130909113 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18011830 con 0x7f5a3009d860 2023-10-03T10:16:56.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.419+0000 7f5a2e7fc700 1 -- 172.21.15.146:0/3130909113 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a18011990 con 0x7f5a3009d860 2023-10-03T10:16:56.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.419+0000 7f5a2e7fc700 1 -- 172.21.15.146:0/3130909113 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18011d20 con 0x7f5a3009d860 2023-10-03T10:16:56.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.420+0000 7f5a35b1d700 1 -- 172.21.15.146:0/3130909113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a3009d860 msgr2=0x7f5a3009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.420+0000 7f5a35b1d700 1 --2- 172.21.15.146:0/3130909113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a3009d860 0x7f5a3009dc30 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f5a18009840 tx=0x7f5a18009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:56.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.420+0000 7f5a35b1d700 1 -- 172.21.15.146:0/3130909113 shutdown_connections 2023-10-03T10:16:56.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.420+0000 7f5a35b1d700 1 --2- 172.21.15.146:0/3130909113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a30130eb0 0x7f5a30138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.420+0000 7f5a35b1d700 1 --2- 172.21.15.146:0/3130909113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a3009d860 0x7f5a3009dc30 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.420+0000 7f5a35b1d700 1 -- 172.21.15.146:0/3130909113 >> 172.21.15.146:0/3130909113 conn(0x7f5a30099c40 msgr2=0x7f5a300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.420+0000 7f5a35b1d700 1 -- 172.21.15.146:0/3130909113 shutdown_connections 2023-10-03T10:16:56.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.420+0000 7f5a35b1d700 1 -- 172.21.15.146:0/3130909113 wait complete. 2023-10-03T10:16:56.423 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:56.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.421+0000 7f5a35b1d700 1 Processor -- start 2023-10-03T10:16:56.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.421+0000 7f5a35b1d700 1 -- start start 2023-10-03T10:16:56.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a35b1d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a3009d860 0x7f5a301c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a35b1d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5a3009e170 0x7f5a301c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a35b1d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a30130eb0 0x7f5a301c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a35b1d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a30120630 con 0x7f5a3009d860 2023-10-03T10:16:56.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a35b1d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a30126bd0 con 0x7f5a30130eb0 2023-10-03T10:16:56.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a35b1d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a30125ff0 con 0x7f5a3009e170 2023-10-03T10:16:56.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a2f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a3009d860 0x7f5a301c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a2f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a3009d860 0x7f5a301c81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60688/0 (socket says 172.21.15.146:60688) 2023-10-03T10:16:56.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a2ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a30130eb0 0x7f5a301c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a2f7fe700 1 -- 172.21.15.146:0/3822675848 learned_addr learned my addr 172.21.15.146:0/3822675848 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:56.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a2effd700 1 --2- 172.21.15.146:0/3822675848 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5a3009e170 0x7f5a301c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a2ffff700 1 -- 172.21.15.146:0/3822675848 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5a3009e170 msgr2=0x7f5a301c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a2ffff700 1 --2- 172.21.15.146:0/3822675848 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5a3009e170 0x7f5a301c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a2ffff700 1 -- 172.21.15.146:0/3822675848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a3009d860 msgr2=0x7f5a301c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a2ffff700 1 --2- 172.21.15.146:0/3822675848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a3009d860 0x7f5a301c81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a2ffff700 1 -- 172.21.15.146:0/3822675848 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a28009a70 con 0x7f5a30130eb0 2023-10-03T10:16:56.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a2f7fe700 1 --2- 172.21.15.146:0/3822675848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a3009d860 0x7f5a301c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:56.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a2ffff700 1 --2- 172.21.15.146:0/3822675848 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a30130eb0 0x7f5a301c8c70 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f5a28009e50 tx=0x7f5a2800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a27fff700 1 -- 172.21.15.146:0/3822675848 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2800ca90 con 0x7f5a30130eb0 2023-10-03T10:16:56.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a27fff700 1 -- 172.21.15.146:0/3822675848 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2800f040 con 0x7f5a30130eb0 2023-10-03T10:16:56.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a35b1d700 1 -- 172.21.15.146:0/3822675848 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a180094a0 con 0x7f5a30130eb0 2023-10-03T10:16:56.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a27fff700 1 -- 172.21.15.146:0/3822675848 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2800ce50 con 0x7f5a30130eb0 2023-10-03T10:16:56.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.422+0000 7f5a35b1d700 1 -- 172.21.15.146:0/3822675848 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3006b450 con 0x7f5a30130eb0 2023-10-03T10:16:56.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.423+0000 7f5a27fff700 1 -- 172.21.15.146:0/3822675848 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5a28014480 con 0x7f5a30130eb0 2023-10-03T10:16:56.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.423+0000 7f5a27fff700 1 -- 172.21.15.146:0/3822675848 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5a2803fc80 con 0x7f5a30130eb0 2023-10-03T10:16:56.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.423+0000 7f5a35b1d700 1 -- 172.21.15.146:0/3822675848 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3004f2a0 con 0x7f5a30130eb0 2023-10-03T10:16:56.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.428+0000 7f5a27fff700 1 -- 172.21.15.146:0/3822675848 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a28012930 con 0x7f5a30130eb0 2023-10-03T10:16:56.452 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.554+0000 7fc8c43a7700 1 Processor -- start 2023-10-03T10:16:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.554+0000 7fc8c43a7700 1 -- start start 2023-10-03T10:16:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.555+0000 7fc8c43a7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8bc09e870 0x7fc8bc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.555+0000 7fc8c43a7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8bc09f180 0x7fc8bc133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.555+0000 7fc8c43a7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8bc06bec0 con 0x7fc8bc1341d0 2023-10-03T10:16:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.555+0000 7fc8c43a7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc06ce60 con 0x7fc8bc09e870 2023-10-03T10:16:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.555+0000 7fc8c43a7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc09fa00 con 0x7fc8bc09f180 2023-10-03T10:16:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.555+0000 7fc8c2944700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc8bc1341d0 0x7fc8bc13af50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44036/0 (socket says 172.21.15.146:44036) 2023-10-03T10:16:56.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.555+0000 7fc8c2143700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8bc09e870 0x7fc8bc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.555+0000 7fc8c2944700 1 -- 172.21.15.146:0/3702105318 learned_addr learned my addr 172.21.15.146:0/3702105318 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:56.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.555+0000 7fc8c1942700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8bc09f180 0x7fc8bc133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.555+0000 7fc8c1141700 1 -- 172.21.15.146:0/3702105318 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2445508472 0 0) 0x7fc8bc06bec0 con 0x7fc8bc1341d0 2023-10-03T10:16:56.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.555+0000 7fc8c2143700 1 -- 172.21.15.146:0/3702105318 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8bc09f180 msgr2=0x7fc8bc133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:56.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.555+0000 7fc8c2143700 1 --2- 172.21.15.146:0/3702105318 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8bc09f180 0x7fc8bc133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.555+0000 7fc8c2143700 1 -- 172.21.15.146:0/3702105318 >> v1:172.21.15.146:6789/0 conn(0x7fc8bc1341d0 legacy=0x7fc8bc13af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.555+0000 7fc8c2143700 1 -- 172.21.15.146:0/3702105318 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc09ad80 con 0x7fc8bc09e870 2023-10-03T10:16:56.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.555+0000 7fc8c1942700 1 --2- 172.21.15.146:0/3702105318 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8bc09f180 0x7fc8bc133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:56.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.555+0000 7fc8c2143700 1 --2- 172.21.15.146:0/3702105318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8bc09e870 0x7fc8bc09ec40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80098a0 tx=0x7fc8b8009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3303704381a9deb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.556+0000 7fc8c1141700 1 -- 172.21.15.146:0/3702105318 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8011830 con 0x7fc8bc09e870 2023-10-03T10:16:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.556+0000 7fc8c1141700 1 -- 172.21.15.146:0/3702105318 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b8011990 con 0x7fc8bc09e870 2023-10-03T10:16:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.556+0000 7fc8c1141700 1 -- 172.21.15.146:0/3702105318 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8011d20 con 0x7fc8bc09e870 2023-10-03T10:16:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.556+0000 7fc8c43a7700 1 -- 172.21.15.146:0/3702105318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8bc09e870 msgr2=0x7fc8bc09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.556+0000 7fc8c43a7700 1 --2- 172.21.15.146:0/3702105318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8bc09e870 0x7fc8bc09ec40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80098a0 tx=0x7fc8b8009bb0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.556+0000 7fc8c43a7700 1 -- 172.21.15.146:0/3702105318 shutdown_connections 2023-10-03T10:16:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.556+0000 7fc8c43a7700 1 --2- 172.21.15.146:0/3702105318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8bc09e870 0x7fc8bc09ec40 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.556+0000 7fc8c43a7700 1 --2- 172.21.15.146:0/3702105318 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8bc09f180 0x7fc8bc133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.556+0000 7fc8c43a7700 1 -- 172.21.15.146:0/3702105318 >> 172.21.15.146:0/3702105318 conn(0x7fc8bc0a4430 msgr2=0x7fc8bc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.556+0000 7fc8c43a7700 1 -- 172.21.15.146:0/3702105318 shutdown_connections 2023-10-03T10:16:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.556+0000 7fc8c43a7700 1 -- 172.21.15.146:0/3702105318 wait complete. 2023-10-03T10:16:56.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.557+0000 7fc8c43a7700 1 Processor -- start 2023-10-03T10:16:56.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.557+0000 7fc8c43a7700 1 -- start start 2023-10-03T10:16:56.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.558+0000 7fc8c43a7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8bc09e870 0x7fc8bc1c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.558+0000 7fc8c43a7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8bc09f180 0x7fc8bc1c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.558+0000 7fc8c43a7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8bc1341d0 0x7fc8bc1c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.558+0000 7fc8c43a7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc126640 con 0x7fc8bc09f180 2023-10-03T10:16:56.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.558+0000 7fc8c43a7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc126820 con 0x7fc8bc1341d0 2023-10-03T10:16:56.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.558+0000 7fc8c43a7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc0a3c10 con 0x7fc8bc09e870 2023-10-03T10:16:56.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.558+0000 7fc8c2143700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8bc09e870 0x7fc8bc1c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.558+0000 7fc8c1942700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8bc09f180 0x7fc8bc1c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.558+0000 7fc8c2143700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8bc09e870 0x7fc8bc1c5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:55928/0 (socket says 172.21.15.146:55928) 2023-10-03T10:16:56.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.558+0000 7fc8c2143700 1 -- 172.21.15.146:0/3815710972 learned_addr learned my addr 172.21.15.146:0/3815710972 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:56.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.558+0000 7fc8c2944700 1 --2- 172.21.15.146:0/3815710972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8bc1341d0 0x7fc8bc1c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.558+0000 7fc8c2143700 1 -- 172.21.15.146:0/3815710972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8bc1341d0 msgr2=0x7fc8bc1c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.558+0000 7fc8c2143700 1 --2- 172.21.15.146:0/3815710972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8bc1341d0 0x7fc8bc1c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.558+0000 7fc8c2143700 1 -- 172.21.15.146:0/3815710972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8bc09f180 msgr2=0x7fc8bc1c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.558+0000 7fc8c2143700 1 --2- 172.21.15.146:0/3815710972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8bc09f180 0x7fc8bc1c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.558+0000 7fc8c2143700 1 -- 172.21.15.146:0/3815710972 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ac0094a0 con 0x7fc8bc09e870 2023-10-03T10:16:56.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.558+0000 7fc8c1942700 1 --2- 172.21.15.146:0/3815710972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8bc09f180 0x7fc8bc1c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:56.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.558+0000 7fc8c2143700 1 --2- 172.21.15.146:0/3815710972 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8bc09e870 0x7fc8bc1c5800 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0a0900 tx=0x7fc8b8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.559+0000 7fc8b2ffd700 1 -- 172.21.15.146:0/3815710972 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b801a930 con 0x7fc8bc09e870 2023-10-03T10:16:56.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.559+0000 7fc8b2ffd700 1 -- 172.21.15.146:0/3815710972 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b801aa90 con 0x7fc8bc09e870 2023-10-03T10:16:56.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.559+0000 7fc8c43a7700 1 -- 172.21.15.146:0/3815710972 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b80094a0 con 0x7fc8bc09e870 2023-10-03T10:16:56.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.559+0000 7fc8b2ffd700 1 -- 172.21.15.146:0/3815710972 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b801ae20 con 0x7fc8bc09e870 2023-10-03T10:16:56.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.559+0000 7fc8c43a7700 1 -- 172.21.15.146:0/3815710972 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8bc1231e0 con 0x7fc8bc09e870 2023-10-03T10:16:56.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.560+0000 7fc8b2ffd700 1 -- 172.21.15.146:0/3815710972 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc8b80243f0 con 0x7fc8bc09e870 2023-10-03T10:16:56.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.560+0000 7fc8b2ffd700 1 -- 172.21.15.146:0/3815710972 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc8b8040bb0 con 0x7fc8bc09e870 2023-10-03T10:16:56.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.560+0000 7fc8c43a7700 1 -- 172.21.15.146:0/3815710972 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8bc09d8a0 con 0x7fc8bc09e870 2023-10-03T10:16:56.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.565+0000 7fc8b2ffd700 1 -- 172.21.15.146:0/3815710972 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8b800b360 con 0x7fc8bc09e870 2023-10-03T10:16:56.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.598+0000 7f602634d700 1 Processor -- start 2023-10-03T10:16:56.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.598+0000 7f602634d700 1 -- start start 2023-10-03T10:16:56.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.598+0000 7f602634d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f60201350d0 0x7f602013ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.598+0000 7f602634d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f602013d210 0x7f602013f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.599+0000 7f602634d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602009eca0 con 0x7f602006a770 2023-10-03T10:16:56.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.599+0000 7f602634d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602006b2e0 con 0x7f60201350d0 2023-10-03T10:16:56.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.599+0000 7f602634d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f602009f720 con 0x7f602013d210 2023-10-03T10:16:56.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.599+0000 7f601f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f60201350d0 0x7f602013ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.599+0000 7f601ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f602006a770 0x7f60201349c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44046/0 (socket says 172.21.15.146:44046) 2023-10-03T10:16:56.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.599+0000 7f601ffff700 1 -- 172.21.15.146:0/810164197 learned_addr learned my addr 172.21.15.146:0/810164197 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:56.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.599+0000 7f60248ea700 1 --2- 172.21.15.146:0/810164197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f602013d210 0x7f602013f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.599+0000 7f60248ea700 1 -- 172.21.15.146:0/810164197 >> v2:172.21.15.146:3300/0 conn(0x7f60201350d0 msgr2=0x7f602013ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:56.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.599+0000 7f60248ea700 1 --2- 172.21.15.146:0/810164197 >> v2:172.21.15.146:3300/0 conn(0x7f60201350d0 0x7f602013ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.599+0000 7f60248ea700 1 -- 172.21.15.146:0/810164197 >> v1:172.21.15.146:6789/0 conn(0x7f602006a770 legacy=0x7f60201349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.599+0000 7f60248ea700 1 -- 172.21.15.146:0/810164197 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602006b480 con 0x7f602013d210 2023-10-03T10:16:56.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.599+0000 7f601f7fe700 1 --2- 172.21.15.146:0/810164197 >> v2:172.21.15.146:3300/0 conn(0x7f60201350d0 0x7f602013ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:56.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.599+0000 7f60248ea700 1 --2- 172.21.15.146:0/810164197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f602013d210 0x7f602013f5f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6018009dc0 tx=0x7f601800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41bb0f1c38cefc1d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.599+0000 7f601effd700 1 -- 172.21.15.146:0/810164197 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601800e070 con 0x7f602013d210 2023-10-03T10:16:56.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.599+0000 7f601effd700 1 -- 172.21.15.146:0/810164197 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601800bae0 con 0x7f602013d210 2023-10-03T10:16:56.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.599+0000 7f601effd700 1 -- 172.21.15.146:0/810164197 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601800be90 con 0x7f602013d210 2023-10-03T10:16:56.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.600+0000 7f602634d700 1 -- 172.21.15.146:0/810164197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f602013d210 msgr2=0x7f602013f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.600+0000 7f602634d700 1 --2- 172.21.15.146:0/810164197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f602013d210 0x7f602013f5f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6018009dc0 tx=0x7f601800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:56.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.600+0000 7f602634d700 1 -- 172.21.15.146:0/810164197 shutdown_connections 2023-10-03T10:16:56.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.600+0000 7f602634d700 1 --2- 172.21.15.146:0/810164197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f602013d210 0x7f602013f5f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.600+0000 7f602634d700 1 --2- 172.21.15.146:0/810164197 >> v2:172.21.15.146:3300/0 conn(0x7f60201350d0 0x7f602013ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.600+0000 7f602634d700 1 -- 172.21.15.146:0/810164197 >> 172.21.15.146:0/810164197 conn(0x7f6020099c40 msgr2=0x7f60200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.600+0000 7f602634d700 1 -- 172.21.15.146:0/810164197 shutdown_connections 2023-10-03T10:16:56.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.600+0000 7f602634d700 1 -- 172.21.15.146:0/810164197 wait complete. 2023-10-03T10:16:56.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.601+0000 7f602634d700 1 Processor -- start 2023-10-03T10:16:56.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.601+0000 7f602634d700 1 -- start start 2023-10-03T10:16:56.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.601+0000 7f602634d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f602006a770 0x7f60201ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.601+0000 7f602634d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60201350d0 0x7f60201cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.601+0000 7f602634d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f602013d210 0x7f60201cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.601+0000 7f602634d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602011ad90 con 0x7f602013d210 2023-10-03T10:16:56.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.601+0000 7f602634d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602011af70 con 0x7f602006a770 2023-10-03T10:16:56.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.601+0000 7f602634d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f602013ccf0 con 0x7f60201350d0 2023-10-03T10:16:56.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.602+0000 7f601f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60201350d0 0x7f60201cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.602+0000 7f601f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60201350d0 0x7f60201cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:55950/0 (socket says 172.21.15.146:55950) 2023-10-03T10:16:56.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.602+0000 7f601f7fe700 1 -- 172.21.15.146:0/2897943404 learned_addr learned my addr 172.21.15.146:0/2897943404 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:56.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.602+0000 7f60248ea700 1 --2- 172.21.15.146:0/2897943404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f602013d210 0x7f60201cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.602+0000 7f601ffff700 1 --2- 172.21.15.146:0/2897943404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f602006a770 0x7f60201ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.602+0000 7f601f7fe700 1 -- 172.21.15.146:0/2897943404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f602006a770 msgr2=0x7f60201ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.602+0000 7f601f7fe700 1 --2- 172.21.15.146:0/2897943404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f602006a770 0x7f60201ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.602+0000 7f601f7fe700 1 -- 172.21.15.146:0/2897943404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f602013d210 msgr2=0x7f60201cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.602+0000 7f601f7fe700 1 --2- 172.21.15.146:0/2897943404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f602013d210 0x7f60201cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.602+0000 7f601f7fe700 1 -- 172.21.15.146:0/2897943404 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60140094a0 con 0x7f60201350d0 2023-10-03T10:16:56.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.602+0000 7f60248ea700 1 --2- 172.21.15.146:0/2897943404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f602013d210 0x7f60201cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:56.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.602+0000 7f601f7fe700 1 --2- 172.21.15.146:0/2897943404 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60201350d0 0x7f60201cd300 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f601400ec10 tx=0x7f601400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.602+0000 7f601cff9700 1 -- 172.21.15.146:0/2897943404 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601400c850 con 0x7f60201350d0 2023-10-03T10:16:56.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.602+0000 7f601cff9700 1 -- 172.21.15.146:0/2897943404 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601400c9b0 con 0x7f60201350d0 2023-10-03T10:16:56.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.602+0000 7f602634d700 1 -- 172.21.15.146:0/2897943404 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6018009a70 con 0x7f60201350d0 2023-10-03T10:16:56.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.602+0000 7f601cff9700 1 -- 172.21.15.146:0/2897943404 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601400cd20 con 0x7f60201350d0 2023-10-03T10:16:56.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.602+0000 7f602634d700 1 -- 172.21.15.146:0/2897943404 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602009b0f0 con 0x7f60201350d0 2023-10-03T10:16:56.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.603+0000 7f601cff9700 1 -- 172.21.15.146:0/2897943404 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6014013470 con 0x7f60201350d0 2023-10-03T10:16:56.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.603+0000 7f602634d700 1 -- 172.21.15.146:0/2897943404 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602004f2a0 con 0x7f60201350d0 2023-10-03T10:16:56.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.604+0000 7f601cff9700 1 -- 172.21.15.146:0/2897943404 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f601403f7e0 con 0x7f60201350d0 2023-10-03T10:16:56.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.608+0000 7f601cff9700 1 -- 172.21.15.146:0/2897943404 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6014013720 con 0x7f60201350d0 2023-10-03T10:16:56.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.628+0000 7f5a35b1d700 1 -- 172.21.15.146:0/3822675848 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5a3006c3b0 con 0x7f5a30130eb0 2023-10-03T10:16:56.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.628+0000 7f5a27fff700 1 -- 172.21.15.146:0/3822675848 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a2802a090 con 0x7f5a30130eb0 2023-10-03T10:16:56.628 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:56.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.631+0000 7f5a35b1d700 1 -- 172.21.15.146:0/3822675848 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a30130eb0 msgr2=0x7f5a301c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.631+0000 7f5a35b1d700 1 --2- 172.21.15.146:0/3822675848 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a30130eb0 0x7f5a301c8c70 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f5a28009e50 tx=0x7f5a2800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.631+0000 7f5a35b1d700 1 -- 172.21.15.146:0/3822675848 shutdown_connections 2023-10-03T10:16:56.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.631+0000 7f5a35b1d700 1 --2- 172.21.15.146:0/3822675848 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a30130eb0 0x7f5a301c8c70 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.631+0000 7f5a35b1d700 1 --2- 172.21.15.146:0/3822675848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a3009d860 0x7f5a301c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.631+0000 7f5a35b1d700 1 --2- 172.21.15.146:0/3822675848 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5a3009e170 0x7f5a301c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.631+0000 7f5a35b1d700 1 -- 172.21.15.146:0/3822675848 >> 172.21.15.146:0/3822675848 conn(0x7f5a30099c40 msgr2=0x7f5a30119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.631+0000 7f5a35b1d700 1 -- 172.21.15.146:0/3822675848 shutdown_connections 2023-10-03T10:16:56.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.632+0000 7f5a35b1d700 1 -- 172.21.15.146:0/3822675848 wait complete. 2023-10-03T10:16:56.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:56.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.759+0000 7fc8c43a7700 1 -- 172.21.15.146:0/3815710972 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc8bc09b370 con 0x7fc8bc09e870 2023-10-03T10:16:56.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.759+0000 7fc8b2ffd700 1 -- 172.21.15.146:0/3815710972 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc8b8035020 con 0x7fc8bc09e870 2023-10-03T10:16:56.759 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:56.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.761+0000 7fc8c43a7700 1 -- 172.21.15.146:0/3815710972 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8bc09e870 msgr2=0x7fc8bc1c5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.761+0000 7fc8c43a7700 1 --2- 172.21.15.146:0/3815710972 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8bc09e870 0x7fc8bc1c5800 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0a0900 tx=0x7fc8b8004750 comp rx=0 tx=0).stop 2023-10-03T10:16:56.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.761+0000 7fc8c43a7700 1 -- 172.21.15.146:0/3815710972 shutdown_connections 2023-10-03T10:16:56.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.761+0000 7fc8c43a7700 1 --2- 172.21.15.146:0/3815710972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8bc1341d0 0x7fc8bc1c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.761+0000 7fc8c43a7700 1 --2- 172.21.15.146:0/3815710972 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8bc09e870 0x7fc8bc1c5800 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.761+0000 7fc8c43a7700 1 --2- 172.21.15.146:0/3815710972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8bc09f180 0x7fc8bc1c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.761+0000 7fc8c43a7700 1 -- 172.21.15.146:0/3815710972 >> 172.21.15.146:0/3815710972 conn(0x7fc8bc0a4430 msgr2=0x7fc8bc071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.761+0000 7fc8c43a7700 1 -- 172.21.15.146:0/3815710972 shutdown_connections 2023-10-03T10:16:56.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.761+0000 7fc8c43a7700 1 -- 172.21.15.146:0/3815710972 wait complete. 2023-10-03T10:16:56.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:56.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.801+0000 7f602634d700 1 -- 172.21.15.146:0/2897943404 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f602011abf0 con 0x7f60201350d0 2023-10-03T10:16:56.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.802+0000 7f601cff9700 1 -- 172.21.15.146:0/2897943404 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f602011abf0 con 0x7f60201350d0 2023-10-03T10:16:56.801 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.804+0000 7f602634d700 1 -- 172.21.15.146:0/2897943404 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60201350d0 msgr2=0x7f60201cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.804+0000 7f602634d700 1 --2- 172.21.15.146:0/2897943404 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60201350d0 0x7f60201cd300 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f601400ec10 tx=0x7f601400ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.804+0000 7f602634d700 1 -- 172.21.15.146:0/2897943404 shutdown_connections 2023-10-03T10:16:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.804+0000 7f602634d700 1 --2- 172.21.15.146:0/2897943404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f602013d210 0x7f60201cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.804+0000 7f602634d700 1 --2- 172.21.15.146:0/2897943404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f602006a770 0x7f60201ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.804+0000 7f602634d700 1 --2- 172.21.15.146:0/2897943404 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f60201350d0 0x7f60201cd300 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.804+0000 7f602634d700 1 -- 172.21.15.146:0/2897943404 >> 172.21.15.146:0/2897943404 conn(0x7f6020099c40 msgr2=0x7f602013d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.804+0000 7f602634d700 1 -- 172.21.15.146:0/2897943404 shutdown_connections 2023-10-03T10:16:56.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:56.804+0000 7f602634d700 1 -- 172.21.15.146:0/2897943404 wait complete. 2023-10-03T10:16:56.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:57.120 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:57.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.243+0000 7f51e29bc700 1 Processor -- start 2023-10-03T10:16:57.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.243+0000 7f51e29bc700 1 -- start start 2023-10-03T10:16:57.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.243+0000 7f51e29bc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51dc099e20 0x7f51dc09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.244+0000 7f51e29bc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f51dc130a60 0x7f51dc138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.244+0000 7f51e29bc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51dc099a60 con 0x7f51dc09a730 2023-10-03T10:16:57.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.244+0000 7f51e29bc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc09bf50 con 0x7f51dc099e20 2023-10-03T10:16:57.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.244+0000 7f51e29bc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc09b230 con 0x7f51dc130a60 2023-10-03T10:16:57.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.244+0000 7f51dbfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51dc099e20 0x7f51dc09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.244+0000 7f51db7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f51dc09a730 0x7f51dc130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44050/0 (socket says 172.21.15.146:44050) 2023-10-03T10:16:57.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.244+0000 7f51db7fe700 1 -- 172.21.15.146:0/2920850745 learned_addr learned my addr 172.21.15.146:0/2920850745 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:57.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.244+0000 7f51e0f59700 1 --2- 172.21.15.146:0/2920850745 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f51dc130a60 0x7f51dc138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.244+0000 7f51dbfff700 1 -- 172.21.15.146:0/2920850745 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f51dc130a60 msgr2=0x7f51dc138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:57.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.244+0000 7f51daffd700 1 -- 172.21.15.146:0/2920850745 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1125071733 0 0) 0x7f51dc099a60 con 0x7f51dc09a730 2023-10-03T10:16:57.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.244+0000 7f51dbfff700 1 --2- 172.21.15.146:0/2920850745 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f51dc130a60 0x7f51dc138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.244+0000 7f51dbfff700 1 -- 172.21.15.146:0/2920850745 >> v1:172.21.15.146:6789/0 conn(0x7f51dc09a730 legacy=0x7f51dc130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.244+0000 7f51dbfff700 1 -- 172.21.15.146:0/2920850745 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc09bb90 con 0x7f51dc099e20 2023-10-03T10:16:57.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.244+0000 7f51e0f59700 1 --2- 172.21.15.146:0/2920850745 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f51dc130a60 0x7f51dc138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.244+0000 7f51dbfff700 1 --2- 172.21.15.146:0/2920850745 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51dc099e20 0x7f51dc09a1f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f51d0009850 tx=0x7f51d0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f41240f26486aa17 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.244+0000 7f51daffd700 1 -- 172.21.15.146:0/2920850745 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d0005e30 con 0x7f51dc099e20 2023-10-03T10:16:57.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.244+0000 7f51daffd700 1 -- 172.21.15.146:0/2920850745 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d0006030 con 0x7f51dc099e20 2023-10-03T10:16:57.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.244+0000 7f51daffd700 1 -- 172.21.15.146:0/2920850745 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d00063e0 con 0x7f51dc099e20 2023-10-03T10:16:57.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.245+0000 7f51e29bc700 1 -- 172.21.15.146:0/2920850745 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51dc099e20 msgr2=0x7f51dc09a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.245+0000 7f51e29bc700 1 --2- 172.21.15.146:0/2920850745 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51dc099e20 0x7f51dc09a1f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f51d0009850 tx=0x7f51d0009b60 comp rx=0 tx=0).stop 2023-10-03T10:16:57.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.245+0000 7f51e29bc700 1 -- 172.21.15.146:0/2920850745 shutdown_connections 2023-10-03T10:16:57.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.245+0000 7f51e29bc700 1 --2- 172.21.15.146:0/2920850745 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f51dc130a60 0x7f51dc138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.245+0000 7f51e29bc700 1 --2- 172.21.15.146:0/2920850745 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51dc099e20 0x7f51dc09a1f0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.245+0000 7f51e29bc700 1 -- 172.21.15.146:0/2920850745 >> 172.21.15.146:0/2920850745 conn(0x7f51dc0a2980 msgr2=0x7f51dc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.245+0000 7f51e29bc700 1 -- 172.21.15.146:0/2920850745 shutdown_connections 2023-10-03T10:16:57.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.245+0000 7f51e29bc700 1 -- 172.21.15.146:0/2920850745 wait complete. 2023-10-03T10:16:57.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.246+0000 7f51e29bc700 1 Processor -- start 2023-10-03T10:16:57.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.246+0000 7f51e29bc700 1 -- start start 2023-10-03T10:16:57.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.246+0000 7f51e29bc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51dc099e20 0x7f51dc11ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.246+0000 7f51e29bc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f51dc09a730 0x7f51dc11b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.246+0000 7f51e29bc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51dc130a60 0x7f51dc11b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.246+0000 7f51e29bc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc12dd70 con 0x7f51dc130a60 2023-10-03T10:16:57.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.246+0000 7f51e29bc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc09b470 con 0x7f51dc099e20 2023-10-03T10:16:57.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.246+0000 7f51e29bc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc11cab0 con 0x7f51dc09a730 2023-10-03T10:16:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.247+0000 7f51e0f59700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51dc130a60 0x7f51dc11b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.247+0000 7f51dbfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51dc099e20 0x7f51dc11ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.247+0000 7f51db7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f51dc09a730 0x7f51dc11b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.247+0000 7f51e0f59700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51dc130a60 0x7f51dc11b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60742/0 (socket says 172.21.15.146:60742) 2023-10-03T10:16:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.247+0000 7f51e0f59700 1 -- 172.21.15.146:0/3657754390 learned_addr learned my addr 172.21.15.146:0/3657754390 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.247+0000 7f51dbfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51dc099e20 0x7f51dc11ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55620/0 (socket says 172.21.15.146:55620) 2023-10-03T10:16:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.247+0000 7f51e0f59700 1 -- 172.21.15.146:0/3657754390 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f51dc09a730 msgr2=0x7f51dc11b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.247+0000 7f51e0f59700 1 --2- 172.21.15.146:0/3657754390 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f51dc09a730 0x7f51dc11b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.247+0000 7f51e0f59700 1 -- 172.21.15.146:0/3657754390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51dc099e20 msgr2=0x7f51dc11ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.247+0000 7f51e0f59700 1 --2- 172.21.15.146:0/3657754390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51dc099e20 0x7f51dc11ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.247+0000 7f51e0f59700 1 -- 172.21.15.146:0/3657754390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d4009a70 con 0x7f51dc130a60 2023-10-03T10:16:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.247+0000 7f51dbfff700 1 --2- 172.21.15.146:0/3657754390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51dc099e20 0x7f51dc11ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.247+0000 7f51db7fe700 1 --2- 172.21.15.146:0/3657754390 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f51dc09a730 0x7f51dc11b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.247+0000 7f51e0f59700 1 --2- 172.21.15.146:0/3657754390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51dc130a60 0x7f51dc11b8a0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f51d400efc0 tx=0x7f51d400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.247+0000 7f51d8ff9700 1 -- 172.21.15.146:0/3657754390 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d400ca90 con 0x7f51dc130a60 2023-10-03T10:16:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.247+0000 7f51d8ff9700 1 -- 172.21.15.146:0/3657754390 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d400f040 con 0x7f51dc130a60 2023-10-03T10:16:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.247+0000 7f51e29bc700 1 -- 172.21.15.146:0/3657754390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d0009430 con 0x7f51dc130a60 2023-10-03T10:16:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.247+0000 7f51d8ff9700 1 -- 172.21.15.146:0/3657754390 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d400ce10 con 0x7f51dc130a60 2023-10-03T10:16:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.247+0000 7f51e29bc700 1 -- 172.21.15.146:0/3657754390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51dc11f040 con 0x7f51dc130a60 2023-10-03T10:16:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.248+0000 7f51d8ff9700 1 -- 172.21.15.146:0/3657754390 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51d4014480 con 0x7f51dc130a60 2023-10-03T10:16:57.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.248+0000 7f51d8ff9700 1 -- 172.21.15.146:0/3657754390 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f51d403fce0 con 0x7f51dc130a60 2023-10-03T10:16:57.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.248+0000 7f51e29bc700 1 -- 172.21.15.146:0/3657754390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51dc072480 con 0x7f51dc130a60 2023-10-03T10:16:57.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.253+0000 7f51d8ff9700 1 -- 172.21.15.146:0/3657754390 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51dc072480 con 0x7f51dc130a60 2023-10-03T10:16:57.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.437+0000 7f51e29bc700 1 -- 172.21.15.146:0/3657754390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f51dc072480 con 0x7f51dc130a60 2023-10-03T10:16:57.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.437+0000 7f51d8ff9700 1 -- 172.21.15.146:0/3657754390 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f51dc072480 con 0x7f51dc130a60 2023-10-03T10:16:57.437 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:57.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.439+0000 7f51e29bc700 1 -- 172.21.15.146:0/3657754390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51dc130a60 msgr2=0x7f51dc11b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.439+0000 7f51e29bc700 1 --2- 172.21.15.146:0/3657754390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51dc130a60 0x7f51dc11b8a0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f51d400efc0 tx=0x7f51d400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.439+0000 7f51e29bc700 1 -- 172.21.15.146:0/3657754390 shutdown_connections 2023-10-03T10:16:57.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.439+0000 7f51e29bc700 1 --2- 172.21.15.146:0/3657754390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51dc130a60 0x7f51dc11b8a0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.439+0000 7f51e29bc700 1 --2- 172.21.15.146:0/3657754390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51dc099e20 0x7f51dc11ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.439+0000 7f51e29bc700 1 --2- 172.21.15.146:0/3657754390 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f51dc09a730 0x7f51dc11b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.439+0000 7f51e29bc700 1 -- 172.21.15.146:0/3657754390 >> 172.21.15.146:0/3657754390 conn(0x7f51dc0a2980 msgr2=0x7f51dc09dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.440+0000 7f51e29bc700 1 -- 172.21.15.146:0/3657754390 shutdown_connections 2023-10-03T10:16:57.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.440+0000 7f51e29bc700 1 -- 172.21.15.146:0/3657754390 wait complete. 2023-10-03T10:16:57.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:57.644 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:57.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.768+0000 7f47a41eb700 1 Processor -- start 2023-10-03T10:16:57.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.768+0000 7f47a41eb700 1 -- start start 2023-10-03T10:16:57.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.768+0000 7f47a41eb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f479c133ad0 0x7f479c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.768+0000 7f47a41eb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c130bc0 0x7f479c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.768+0000 7f47a41eb700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c06b2d0 con 0x7f479c1300a0 2023-10-03T10:16:57.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.768+0000 7f47a41eb700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479c133610 con 0x7f479c133ad0 2023-10-03T10:16:57.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.768+0000 7f47a41eb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c09a500 con 0x7f479c130bc0 2023-10-03T10:16:57.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.768+0000 7f47a1f87700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f479c133ad0 0x7f479c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.768+0000 7f47a2788700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c130bc0 0x7f479c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.768+0000 7f47a1786700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f479c1300a0 0x7f479c1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44064/0 (socket says 172.21.15.146:44064) 2023-10-03T10:16:57.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.768+0000 7f47a2788700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c130bc0 0x7f479c13b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55636/0 (socket says 172.21.15.146:55636) 2023-10-03T10:16:57.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.769+0000 7f47a1f87700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f479c133ad0 0x7f479c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60750/0 (socket says 172.21.15.146:60750) 2023-10-03T10:16:57.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.769+0000 7f47a1786700 1 -- 172.21.15.146:0/3630508795 learned_addr learned my addr 172.21.15.146:0/3630508795 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:57.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.769+0000 7f47a1f87700 1 -- 172.21.15.146:0/3630508795 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c130bc0 msgr2=0x7f479c13b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:57.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.769+0000 7f47a1f87700 1 --2- 172.21.15.146:0/3630508795 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c130bc0 0x7f479c13b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.769+0000 7f47a1f87700 1 -- 172.21.15.146:0/3630508795 >> v1:172.21.15.146:6789/0 conn(0x7f479c1300a0 legacy=0x7f479c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.769+0000 7f47a1f87700 1 -- 172.21.15.146:0/3630508795 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c1338b0 con 0x7f479c133ad0 2023-10-03T10:16:57.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.769+0000 7f47a0f85700 1 -- 172.21.15.146:0/3630508795 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371997226 0 0) 0x7f479c06b2d0 con 0x7f479c1300a0 2023-10-03T10:16:57.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.769+0000 7f47a2788700 1 --2- 172.21.15.146:0/3630508795 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c130bc0 0x7f479c13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.769+0000 7f47a1f87700 1 --2- 172.21.15.146:0/3630508795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f479c133ad0 0x7f479c133ea0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f478c009840 tx=0x7f478c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d11b69c579e41e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.769+0000 7f47a0f85700 1 -- 172.21.15.146:0/3630508795 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c011830 con 0x7f479c133ad0 2023-10-03T10:16:57.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.769+0000 7f47a0f85700 1 -- 172.21.15.146:0/3630508795 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c011990 con 0x7f479c133ad0 2023-10-03T10:16:57.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.769+0000 7f47a0f85700 1 -- 172.21.15.146:0/3630508795 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c011d20 con 0x7f479c133ad0 2023-10-03T10:16:57.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.770+0000 7f47a41eb700 1 -- 172.21.15.146:0/3630508795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f479c133ad0 msgr2=0x7f479c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.770+0000 7f47a41eb700 1 --2- 172.21.15.146:0/3630508795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f479c133ad0 0x7f479c133ea0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f478c009840 tx=0x7f478c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:57.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.770+0000 7f47a41eb700 1 -- 172.21.15.146:0/3630508795 shutdown_connections 2023-10-03T10:16:57.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.770+0000 7f47a41eb700 1 --2- 172.21.15.146:0/3630508795 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c130bc0 0x7f479c13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.770+0000 7f47a41eb700 1 --2- 172.21.15.146:0/3630508795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f479c133ad0 0x7f479c133ea0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.770+0000 7f47a41eb700 1 -- 172.21.15.146:0/3630508795 >> 172.21.15.146:0/3630508795 conn(0x7f479c099c40 msgr2=0x7f479c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.770+0000 7f47a41eb700 1 -- 172.21.15.146:0/3630508795 shutdown_connections 2023-10-03T10:16:57.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.770+0000 7f47a41eb700 1 -- 172.21.15.146:0/3630508795 wait complete. 2023-10-03T10:16:57.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.771+0000 7f47a41eb700 1 Processor -- start 2023-10-03T10:16:57.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.771+0000 7f47a41eb700 1 -- start start 2023-10-03T10:16:57.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.771+0000 7f47a41eb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f479c1300a0 0x7f479c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.771+0000 7f47a41eb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f479c130bc0 0x7f479c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.771+0000 7f47a41eb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c133ad0 0x7f479c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.771+0000 7f47a41eb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c11fd00 con 0x7f479c130bc0 2023-10-03T10:16:57.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.771+0000 7f47a41eb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c12dd00 con 0x7f479c133ad0 2023-10-03T10:16:57.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.771+0000 7f47a41eb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0720a0 con 0x7f479c1300a0 2023-10-03T10:16:57.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.771+0000 7f47a2788700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c133ad0 0x7f479c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.771+0000 7f47a1786700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f479c130bc0 0x7f479c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.771+0000 7f47a2788700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c133ad0 0x7f479c11e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55652/0 (socket says 172.21.15.146:55652) 2023-10-03T10:16:57.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.771+0000 7f47a2788700 1 -- 172.21.15.146:0/2689280429 learned_addr learned my addr 172.21.15.146:0/2689280429 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:57.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.771+0000 7f47a1f87700 1 --2- 172.21.15.146:0/2689280429 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f479c1300a0 0x7f479c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.771+0000 7f47a1786700 1 -- 172.21.15.146:0/2689280429 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f479c1300a0 msgr2=0x7f479c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.771+0000 7f47a1786700 1 --2- 172.21.15.146:0/2689280429 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f479c1300a0 0x7f479c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.771+0000 7f47a1786700 1 -- 172.21.15.146:0/2689280429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c133ad0 msgr2=0x7f479c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.771+0000 7f47a1786700 1 --2- 172.21.15.146:0/2689280429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c133ad0 0x7f479c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.772+0000 7f47a1786700 1 -- 172.21.15.146:0/2689280429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4794009a70 con 0x7f479c130bc0 2023-10-03T10:16:57.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.772+0000 7f47a2788700 1 --2- 172.21.15.146:0/2689280429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c133ad0 0x7f479c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.772+0000 7f47a1786700 1 --2- 172.21.15.146:0/2689280429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f479c130bc0 0x7f479c11df80 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f479800c3f0 tx=0x7f479800c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.772+0000 7f47927fc700 1 -- 172.21.15.146:0/2689280429 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798004a70 con 0x7f479c130bc0 2023-10-03T10:16:57.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.772+0000 7f47927fc700 1 -- 172.21.15.146:0/2689280429 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4798004c10 con 0x7f479c130bc0 2023-10-03T10:16:57.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.772+0000 7f47a41eb700 1 -- 172.21.15.146:0/2689280429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f478c0094a0 con 0x7f479c130bc0 2023-10-03T10:16:57.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.772+0000 7f47927fc700 1 -- 172.21.15.146:0/2689280429 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47980070d0 con 0x7f479c130bc0 2023-10-03T10:16:57.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.772+0000 7f47a41eb700 1 -- 172.21.15.146:0/2689280429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c11ffe0 con 0x7f479c130bc0 2023-10-03T10:16:57.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.772+0000 7f47927fc700 1 -- 172.21.15.146:0/2689280429 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4798007230 con 0x7f479c130bc0 2023-10-03T10:16:57.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.773+0000 7f47927fc700 1 -- 172.21.15.146:0/2689280429 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f479803f190 con 0x7f479c130bc0 2023-10-03T10:16:57.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.773+0000 7f47a41eb700 1 -- 172.21.15.146:0/2689280429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479c09cb20 con 0x7f479c130bc0 2023-10-03T10:16:57.779 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:57.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.777+0000 7f47927fc700 1 -- 172.21.15.146:0/2689280429 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f479801bb70 con 0x7f479c130bc0 2023-10-03T10:16:57.816 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:57.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.906+0000 7f955c93a700 1 Processor -- start 2023-10-03T10:16:57.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.906+0000 7f955c93a700 1 -- start start 2023-10-03T10:16:57.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.906+0000 7f955c93a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95580a0a70 0x7f95580a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.906+0000 7f955c93a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95580a1380 0x7f9558133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.906+0000 7f955c93a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9558133f50 0x7f95581343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.907+0000 7f955c93a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f955809e9d0 con 0x7f9558133f50 2023-10-03T10:16:57.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.907+0000 7f955c93a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955809dc00 con 0x7f95580a0a70 2023-10-03T10:16:57.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.907+0000 7f955c93a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f955809dec0 con 0x7f95580a1380 2023-10-03T10:16:57.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.907+0000 7f955659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95580a0a70 0x7f95580a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.907+0000 7f9555d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95580a1380 0x7f9558133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.907+0000 7f955659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95580a0a70 0x7f95580a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55656/0 (socket says 172.21.15.146:55656) 2023-10-03T10:16:57.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.907+0000 7f9555d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95580a1380 0x7f9558133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:55982/0 (socket says 172.21.15.146:55982) 2023-10-03T10:16:57.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.907+0000 7f955659c700 1 -- 172.21.15.146:0/658732679 learned_addr learned my addr 172.21.15.146:0/658732679 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:57.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.907+0000 7f9556d9d700 1 --2- 172.21.15.146:0/658732679 >> v2:172.21.15.146:3300/0 conn(0x7f9558133f50 0x7f95581343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.907+0000 7f9555d9b700 1 -- 172.21.15.146:0/658732679 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95580a0a70 msgr2=0x7f95580a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:57.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.907+0000 7f9555d9b700 1 --2- 172.21.15.146:0/658732679 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95580a0a70 0x7f95580a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.907+0000 7f9555d9b700 1 -- 172.21.15.146:0/658732679 >> v2:172.21.15.146:3300/0 conn(0x7f9558133f50 msgr2=0x7f95581343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:57.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.907+0000 7f9555d9b700 1 --2- 172.21.15.146:0/658732679 >> v2:172.21.15.146:3300/0 conn(0x7f9558133f50 0x7f95581343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.907+0000 7f9555d9b700 1 -- 172.21.15.146:0/658732679 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955809e6a0 con 0x7f95580a1380 2023-10-03T10:16:57.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.907+0000 7f955659c700 1 --2- 172.21.15.146:0/658732679 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95580a0a70 0x7f95580a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.907+0000 7f9555d9b700 1 --2- 172.21.15.146:0/658732679 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95580a1380 0x7f9558133a10 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f954c009840 tx=0x7f954c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44e13f2b2c721aa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.907+0000 7f955559a700 1 -- 172.21.15.146:0/658732679 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c011830 con 0x7f95580a1380 2023-10-03T10:16:57.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.907+0000 7f955559a700 1 -- 172.21.15.146:0/658732679 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954c011990 con 0x7f95580a1380 2023-10-03T10:16:57.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.907+0000 7f955559a700 1 -- 172.21.15.146:0/658732679 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c011d20 con 0x7f95580a1380 2023-10-03T10:16:57.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.908+0000 7f955c93a700 1 -- 172.21.15.146:0/658732679 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95580a1380 msgr2=0x7f9558133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.908+0000 7f955c93a700 1 --2- 172.21.15.146:0/658732679 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95580a1380 0x7f9558133a10 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f954c009840 tx=0x7f954c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:57.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.908+0000 7f955c93a700 1 -- 172.21.15.146:0/658732679 shutdown_connections 2023-10-03T10:16:57.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.908+0000 7f955c93a700 1 --2- 172.21.15.146:0/658732679 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95580a0a70 0x7f95580a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.908+0000 7f955c93a700 1 --2- 172.21.15.146:0/658732679 >> v2:172.21.15.146:3300/0 conn(0x7f9558133f50 0x7f95581343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.908+0000 7f955c93a700 1 --2- 172.21.15.146:0/658732679 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95580a1380 0x7f9558133a10 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.908+0000 7f955c93a700 1 -- 172.21.15.146:0/658732679 >> 172.21.15.146:0/658732679 conn(0x7f95580a6610 msgr2=0x7f95580a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.908+0000 7f955c93a700 1 -- 172.21.15.146:0/658732679 shutdown_connections 2023-10-03T10:16:57.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.908+0000 7f955c93a700 1 -- 172.21.15.146:0/658732679 wait complete. 2023-10-03T10:16:57.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.909+0000 7f955c93a700 1 Processor -- start 2023-10-03T10:16:57.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.909+0000 7f955c93a700 1 -- start start 2023-10-03T10:16:57.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.910+0000 7f955c93a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95580a0a70 0x7f955812d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.910+0000 7f955c93a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95580a1380 0x7f955812dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.910+0000 7f955c93a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9558133f50 0x7f955812e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.910+0000 7f955c93a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955806ff80 con 0x7f95580a0a70 2023-10-03T10:16:57.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.910+0000 7f955c93a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955806f2c0 con 0x7f9558133f50 2023-10-03T10:16:57.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.910+0000 7f955c93a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f955812ec00 con 0x7f95580a1380 2023-10-03T10:16:57.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.910+0000 7f955659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95580a0a70 0x7f955812d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.910+0000 7f955659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95580a0a70 0x7f955812d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60778/0 (socket says 172.21.15.146:60778) 2023-10-03T10:16:57.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.910+0000 7f955659c700 1 -- 172.21.15.146:0/1336938431 learned_addr learned my addr 172.21.15.146:0/1336938431 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:57.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.910+0000 7f9555d9b700 1 --2- 172.21.15.146:0/1336938431 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95580a1380 0x7f955812dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.910+0000 7f9556d9d700 1 --2- 172.21.15.146:0/1336938431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9558133f50 0x7f955812e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.910+0000 7f9555d9b700 1 -- 172.21.15.146:0/1336938431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9558133f50 msgr2=0x7f955812e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.910+0000 7f9555d9b700 1 --2- 172.21.15.146:0/1336938431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9558133f50 0x7f955812e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.910+0000 7f9555d9b700 1 -- 172.21.15.146:0/1336938431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95580a0a70 msgr2=0x7f955812d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.910+0000 7f9555d9b700 1 --2- 172.21.15.146:0/1336938431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95580a0a70 0x7f955812d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.910+0000 7f9555d9b700 1 -- 172.21.15.146:0/1336938431 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9548011df0 con 0x7f95580a1380 2023-10-03T10:16:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.910+0000 7f955659c700 1 --2- 172.21.15.146:0/1336938431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95580a0a70 0x7f955812d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.910+0000 7f9556d9d700 1 --2- 172.21.15.146:0/1336938431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9558133f50 0x7f955812e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.910+0000 7f9555d9b700 1 --2- 172.21.15.146:0/1336938431 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95580a1380 0x7f955812dc90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f954c016000 tx=0x7f954c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.911+0000 7f9546ffd700 1 -- 172.21.15.146:0/1336938431 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c004450 con 0x7f95580a1380 2023-10-03T10:16:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.911+0000 7f9546ffd700 1 -- 172.21.15.146:0/1336938431 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954c01f070 con 0x7f95580a1380 2023-10-03T10:16:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.911+0000 7f955c93a700 1 -- 172.21.15.146:0/1336938431 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954c0094a0 con 0x7f95580a1380 2023-10-03T10:16:57.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.911+0000 7f9546ffd700 1 -- 172.21.15.146:0/1336938431 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c0038e0 con 0x7f95580a1380 2023-10-03T10:16:57.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.911+0000 7f955c93a700 1 -- 172.21.15.146:0/1336938431 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95580a4e40 con 0x7f95580a1380 2023-10-03T10:16:57.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.911+0000 7f9546ffd700 1 -- 172.21.15.146:0/1336938431 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f954c003a40 con 0x7f95580a1380 2023-10-03T10:16:57.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.912+0000 7f955c93a700 1 -- 172.21.15.146:0/1336938431 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f955804f2a0 con 0x7f95580a1380 2023-10-03T10:16:57.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.912+0000 7f9546ffd700 1 -- 172.21.15.146:0/1336938431 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f954c021070 con 0x7f95580a1380 2023-10-03T10:16:57.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.916+0000 7f9546ffd700 1 -- 172.21.15.146:0/1336938431 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f954c015020 con 0x7f95580a1380 2023-10-03T10:16:57.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.948+0000 7f502e582700 1 Processor -- start 2023-10-03T10:16:57.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.948+0000 7f502e582700 1 -- start start 2023-10-03T10:16:57.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.949+0000 7f502e582700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f50280a0a70 0x7f50280a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.949+0000 7f502e582700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5028134120 0x7f502813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.949+0000 7f502e582700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502809dc00 con 0x7f50280a1380 2023-10-03T10:16:57.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.949+0000 7f502e582700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502809ea90 con 0x7f50280a0a70 2023-10-03T10:16:57.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.949+0000 7f502e582700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f502809dec0 con 0x7f5028134120 2023-10-03T10:16:57.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.949+0000 7f5027fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f50280a0a70 0x7f50280a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.949+0000 7f50277fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f50280a1380 0x7f5028133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44072/0 (socket says 172.21.15.146:44072) 2023-10-03T10:16:57.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.949+0000 7f50277fe700 1 -- 172.21.15.146:0/1917594456 learned_addr learned my addr 172.21.15.146:0/1917594456 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:57.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.949+0000 7f502cb1f700 1 --2- 172.21.15.146:0/1917594456 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5028134120 0x7f502813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.949+0000 7f5027fff700 1 -- 172.21.15.146:0/1917594456 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5028134120 msgr2=0x7f502813bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:57.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.949+0000 7f5027fff700 1 --2- 172.21.15.146:0/1917594456 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5028134120 0x7f502813bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.949+0000 7f5027fff700 1 -- 172.21.15.146:0/1917594456 >> v1:172.21.15.146:6789/0 conn(0x7f50280a1380 legacy=0x7f5028133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.949+0000 7f5027fff700 1 -- 172.21.15.146:0/1917594456 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502809e6a0 con 0x7f50280a0a70 2023-10-03T10:16:57.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.950+0000 7f5027fff700 1 --2- 172.21.15.146:0/1917594456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50280a0a70 0x7f50280a0e40 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f5018009840 tx=0x7f5018009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ca1c88910980a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.950+0000 7f5026ffd700 1 -- 172.21.15.146:0/1917594456 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5018011830 con 0x7f50280a0a70 2023-10-03T10:16:57.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.950+0000 7f5026ffd700 1 -- 172.21.15.146:0/1917594456 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5018011990 con 0x7f50280a0a70 2023-10-03T10:16:57.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.950+0000 7f5026ffd700 1 -- 172.21.15.146:0/1917594456 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5018011d20 con 0x7f50280a0a70 2023-10-03T10:16:57.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.950+0000 7f502e582700 1 -- 172.21.15.146:0/1917594456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50280a0a70 msgr2=0x7f50280a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.950+0000 7f502e582700 1 --2- 172.21.15.146:0/1917594456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50280a0a70 0x7f50280a0e40 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f5018009840 tx=0x7f5018009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:57.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.950+0000 7f502e582700 1 -- 172.21.15.146:0/1917594456 shutdown_connections 2023-10-03T10:16:57.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.950+0000 7f502e582700 1 --2- 172.21.15.146:0/1917594456 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5028134120 0x7f502813bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.950+0000 7f502e582700 1 --2- 172.21.15.146:0/1917594456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50280a0a70 0x7f50280a0e40 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.950+0000 7f502e582700 1 -- 172.21.15.146:0/1917594456 >> 172.21.15.146:0/1917594456 conn(0x7f50280a6610 msgr2=0x7f50280a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.950+0000 7f502e582700 1 -- 172.21.15.146:0/1917594456 shutdown_connections 2023-10-03T10:16:57.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.950+0000 7f502e582700 1 -- 172.21.15.146:0/1917594456 wait complete. 2023-10-03T10:16:57.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.951+0000 7f502e582700 1 Processor -- start 2023-10-03T10:16:57.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.951+0000 7f502e582700 1 -- start start 2023-10-03T10:16:57.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.952+0000 7f502e582700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50280a0a70 0x7f50281229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.952+0000 7f502e582700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50280a1380 0x7f5028122ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.952+0000 7f502e582700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5028134120 0x7f5028123430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.952+0000 7f502e582700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5028126160 con 0x7f50280a0a70 2023-10-03T10:16:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.952+0000 7f502e582700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5028133aa0 con 0x7f5028134120 2023-10-03T10:16:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.952+0000 7f502e582700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50281334b0 con 0x7f50280a1380 2023-10-03T10:16:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.952+0000 7f5027fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50280a0a70 0x7f50281229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.952+0000 7f50277fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50280a1380 0x7f5028122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.952+0000 7f5027fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50280a0a70 0x7f50281229b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60792/0 (socket says 172.21.15.146:60792) 2023-10-03T10:16:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.952+0000 7f50277fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50280a1380 0x7f5028122ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56014/0 (socket says 172.21.15.146:56014) 2023-10-03T10:16:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.952+0000 7f5027fff700 1 -- 172.21.15.146:0/3121648647 learned_addr learned my addr 172.21.15.146:0/3121648647 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.952+0000 7f50277fe700 1 -- 172.21.15.146:0/3121648647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5028134120 msgr2=0x7f5028123430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.952+0000 7f50277fe700 1 --2- 172.21.15.146:0/3121648647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5028134120 0x7f5028123430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.952+0000 7f50277fe700 1 -- 172.21.15.146:0/3121648647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50280a0a70 msgr2=0x7f50281229b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.952+0000 7f50277fe700 1 --2- 172.21.15.146:0/3121648647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50280a0a70 0x7f50281229b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.952+0000 7f50277fe700 1 -- 172.21.15.146:0/3121648647 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50180094a0 con 0x7f50280a1380 2023-10-03T10:16:57.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.952+0000 7f5027fff700 1 --2- 172.21.15.146:0/3121648647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50280a0a70 0x7f50281229b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.952+0000 7f50277fe700 1 --2- 172.21.15.146:0/3121648647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50280a1380 0x7f5028122ef0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f501c00c500 tx=0x7f501c00c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.953+0000 7f5024ff9700 1 -- 172.21.15.146:0/3121648647 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c005d70 con 0x7f50280a1380 2023-10-03T10:16:57.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.953+0000 7f5024ff9700 1 -- 172.21.15.146:0/3121648647 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501c0070d0 con 0x7f50280a1380 2023-10-03T10:16:57.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.953+0000 7f5024ff9700 1 -- 172.21.15.146:0/3121648647 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c007440 con 0x7f50280a1380 2023-10-03T10:16:57.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.953+0000 7f502e582700 1 -- 172.21.15.146:0/3121648647 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5028125ea0 con 0x7f50280a1380 2023-10-03T10:16:57.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.953+0000 7f502e582700 1 -- 172.21.15.146:0/3121648647 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5028126b40 con 0x7f50280a1380 2023-10-03T10:16:57.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.954+0000 7f5024ff9700 1 -- 172.21.15.146:0/3121648647 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f501c0075a0 con 0x7f50280a1380 2023-10-03T10:16:57.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.954+0000 7f502e582700 1 -- 172.21.15.146:0/3121648647 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f502804f2a0 con 0x7f50280a1380 2023-10-03T10:16:57.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.954+0000 7f5024ff9700 1 -- 172.21.15.146:0/3121648647 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f501c03ea20 con 0x7f50280a1380 2023-10-03T10:16:57.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.958+0000 7f5024ff9700 1 -- 172.21.15.146:0/3121648647 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f501c019d20 con 0x7f50280a1380 2023-10-03T10:16:57.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.980+0000 7f47a41eb700 1 -- 172.21.15.146:0/2689280429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f479c04f2a0 con 0x7f479c130bc0 2023-10-03T10:16:57.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.981+0000 7f47927fc700 1 -- 172.21.15.146:0/2689280429 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f479801ce90 con 0x7f479c130bc0 2023-10-03T10:16:57.981 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.983+0000 7f47a41eb700 1 -- 172.21.15.146:0/2689280429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f479c130bc0 msgr2=0x7f479c11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.983+0000 7f47a41eb700 1 --2- 172.21.15.146:0/2689280429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f479c130bc0 0x7f479c11df80 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f479800c3f0 tx=0x7f479800c700 comp rx=0 tx=0).stop 2023-10-03T10:16:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.983+0000 7f47a41eb700 1 -- 172.21.15.146:0/2689280429 shutdown_connections 2023-10-03T10:16:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.983+0000 7f47a41eb700 1 --2- 172.21.15.146:0/2689280429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c133ad0 0x7f479c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.983+0000 7f47a41eb700 1 --2- 172.21.15.146:0/2689280429 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f479c1300a0 0x7f479c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.983+0000 7f47a41eb700 1 --2- 172.21.15.146:0/2689280429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f479c130bc0 0x7f479c11df80 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.983+0000 7f47a41eb700 1 -- 172.21.15.146:0/2689280429 >> 172.21.15.146:0/2689280429 conn(0x7f479c099c40 msgr2=0x7f479c132bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.983+0000 7f47a41eb700 1 -- 172.21.15.146:0/2689280429 shutdown_connections 2023-10-03T10:16:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:57.983+0000 7f47a41eb700 1 -- 172.21.15.146:0/2689280429 wait complete. 2023-10-03T10:16:57.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:58.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.114+0000 7f955c93a700 1 -- 172.21.15.146:0/1336938431 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f955809be30 con 0x7f95580a1380 2023-10-03T10:16:58.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.114+0000 7f9546ffd700 1 -- 172.21.15.146:0/1336938431 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f954c0253e0 con 0x7f95580a1380 2023-10-03T10:16:58.114 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:58.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.116+0000 7f955c93a700 1 -- 172.21.15.146:0/1336938431 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95580a1380 msgr2=0x7f955812dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.116+0000 7f955c93a700 1 --2- 172.21.15.146:0/1336938431 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95580a1380 0x7f955812dc90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f954c016000 tx=0x7f954c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:58.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.117+0000 7f955c93a700 1 -- 172.21.15.146:0/1336938431 shutdown_connections 2023-10-03T10:16:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.117+0000 7f955c93a700 1 --2- 172.21.15.146:0/1336938431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9558133f50 0x7f955812e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.117+0000 7f955c93a700 1 --2- 172.21.15.146:0/1336938431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95580a0a70 0x7f955812d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.117+0000 7f955c93a700 1 --2- 172.21.15.146:0/1336938431 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95580a1380 0x7f955812dc90 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.117+0000 7f955c93a700 1 -- 172.21.15.146:0/1336938431 >> 172.21.15.146:0/1336938431 conn(0x7f95580a6610 msgr2=0x7f95581336b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.117+0000 7f955c93a700 1 -- 172.21.15.146:0/1336938431 shutdown_connections 2023-10-03T10:16:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.117+0000 7f955c93a700 1 -- 172.21.15.146:0/1336938431 wait complete. 2023-10-03T10:16:58.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:58.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.153+0000 7f502e582700 1 -- 172.21.15.146:0/3121648647 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5028072980 con 0x7f50280a1380 2023-10-03T10:16:58.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.153+0000 7f5024ff9700 1 -- 172.21.15.146:0/3121648647 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f501c0192c0 con 0x7f50280a1380 2023-10-03T10:16:58.153 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:58.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.155+0000 7f502e582700 1 -- 172.21.15.146:0/3121648647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50280a1380 msgr2=0x7f5028122ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.155+0000 7f502e582700 1 --2- 172.21.15.146:0/3121648647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50280a1380 0x7f5028122ef0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f501c00c500 tx=0x7f501c00c810 comp rx=0 tx=0).stop 2023-10-03T10:16:58.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.155+0000 7f502e582700 1 -- 172.21.15.146:0/3121648647 shutdown_connections 2023-10-03T10:16:58.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.155+0000 7f502e582700 1 --2- 172.21.15.146:0/3121648647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5028134120 0x7f5028123430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.155+0000 7f502e582700 1 --2- 172.21.15.146:0/3121648647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50280a0a70 0x7f50281229b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.155+0000 7f502e582700 1 --2- 172.21.15.146:0/3121648647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50280a1380 0x7f5028122ef0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.155+0000 7f502e582700 1 -- 172.21.15.146:0/3121648647 >> 172.21.15.146:0/3121648647 conn(0x7f50280a6610 msgr2=0x7f50280a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.155+0000 7f502e582700 1 -- 172.21.15.146:0/3121648647 shutdown_connections 2023-10-03T10:16:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.155+0000 7f502e582700 1 -- 172.21.15.146:0/3121648647 wait complete. 2023-10-03T10:16:58.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:58.452 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.577+0000 7ff94bd7e700 1 Processor -- start 2023-10-03T10:16:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.577+0000 7ff94bd7e700 1 -- start start 2023-10-03T10:16:58.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.577+0000 7ff94bd7e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff944133ad0 0x7ff944133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.577+0000 7ff94bd7e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff9441300a0 0x7ff9441304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.577+0000 7ff94bd7e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9441309f0 0x7ff94413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.577+0000 7ff94bd7e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff94406b2d0 con 0x7ff9441300a0 2023-10-03T10:16:58.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.577+0000 7ff94bd7e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff944133610 con 0x7ff944133ad0 2023-10-03T10:16:58.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.577+0000 7ff94bd7e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff94409a500 con 0x7ff9441309f0 2023-10-03T10:16:58.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.577+0000 7ff949b1a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff944133ad0 0x7ff944133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.577+0000 7ff949319700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff9441300a0 0x7ff9441304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.577+0000 7ff949319700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff9441300a0 0x7ff9441304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60796/0 (socket says 172.21.15.146:60796) 2023-10-03T10:16:58.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.577+0000 7ff94a31b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9441309f0 0x7ff94413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.577+0000 7ff949b1a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff944133ad0 0x7ff944133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55686/0 (socket says 172.21.15.146:55686) 2023-10-03T10:16:58.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.577+0000 7ff949319700 1 -- 172.21.15.146:0/825388322 learned_addr learned my addr 172.21.15.146:0/825388322 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:58.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.578+0000 7ff949319700 1 -- 172.21.15.146:0/825388322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9441309f0 msgr2=0x7ff94413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:58.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.578+0000 7ff949319700 1 --2- 172.21.15.146:0/825388322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9441309f0 0x7ff94413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.578+0000 7ff949319700 1 -- 172.21.15.146:0/825388322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff944133ad0 msgr2=0x7ff944133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:58.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.578+0000 7ff949319700 1 --2- 172.21.15.146:0/825388322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff944133ad0 0x7ff944133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.578+0000 7ff949319700 1 -- 172.21.15.146:0/825388322 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9441338b0 con 0x7ff9441300a0 2023-10-03T10:16:58.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.578+0000 7ff949b1a700 1 --2- 172.21.15.146:0/825388322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff944133ad0 0x7ff944133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:58.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.578+0000 7ff94a31b700 1 --2- 172.21.15.146:0/825388322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9441309f0 0x7ff94413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:58.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.578+0000 7ff949319700 1 --2- 172.21.15.146:0/825388322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9441300a0 0x7ff9441304b0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7ff9340098f0 tx=0x7ff934009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ae13cc387571a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.578+0000 7ff948b18700 1 -- 172.21.15.146:0/825388322 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934011830 con 0x7ff9441300a0 2023-10-03T10:16:58.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.578+0000 7ff948b18700 1 -- 172.21.15.146:0/825388322 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff934011990 con 0x7ff9441300a0 2023-10-03T10:16:58.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.578+0000 7ff948b18700 1 -- 172.21.15.146:0/825388322 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934011d20 con 0x7ff9441300a0 2023-10-03T10:16:58.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.579+0000 7ff94bd7e700 1 -- 172.21.15.146:0/825388322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9441300a0 msgr2=0x7ff9441304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.579+0000 7ff94bd7e700 1 --2- 172.21.15.146:0/825388322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9441300a0 0x7ff9441304b0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7ff9340098f0 tx=0x7ff934009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:58.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.579+0000 7ff94bd7e700 1 -- 172.21.15.146:0/825388322 shutdown_connections 2023-10-03T10:16:58.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.579+0000 7ff94bd7e700 1 --2- 172.21.15.146:0/825388322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff944133ad0 0x7ff944133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.579+0000 7ff94bd7e700 1 --2- 172.21.15.146:0/825388322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9441309f0 0x7ff94413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.579+0000 7ff94bd7e700 1 --2- 172.21.15.146:0/825388322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9441300a0 0x7ff9441304b0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.579+0000 7ff94bd7e700 1 -- 172.21.15.146:0/825388322 >> 172.21.15.146:0/825388322 conn(0x7ff944099c40 msgr2=0x7ff9440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.579+0000 7ff94bd7e700 1 -- 172.21.15.146:0/825388322 shutdown_connections 2023-10-03T10:16:58.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.579+0000 7ff94bd7e700 1 -- 172.21.15.146:0/825388322 wait complete. 2023-10-03T10:16:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.580+0000 7ff94bd7e700 1 Processor -- start 2023-10-03T10:16:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.580+0000 7ff94bd7e700 1 -- start start 2023-10-03T10:16:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.580+0000 7ff94bd7e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9441300a0 0x7ff94411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.580+0000 7ff94bd7e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9441309f0 0x7ff94411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.580+0000 7ff94bd7e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff944133ad0 0x7ff94411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.580+0000 7ff94bd7e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9441201b0 con 0x7ff9441300a0 2023-10-03T10:16:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.580+0000 7ff94bd7e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440a33e0 con 0x7ff944133ad0 2023-10-03T10:16:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.580+0000 7ff94bd7e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff94412dd00 con 0x7ff9441309f0 2023-10-03T10:16:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.580+0000 7ff949b1a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9441300a0 0x7ff94411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.580+0000 7ff949319700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9441309f0 0x7ff94411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.580+0000 7ff949b1a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9441300a0 0x7ff94411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60806/0 (socket says 172.21.15.146:60806) 2023-10-03T10:16:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.580+0000 7ff94a31b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff944133ad0 0x7ff94411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.580+0000 7ff949b1a700 1 -- 172.21.15.146:0/1533328816 learned_addr learned my addr 172.21.15.146:0/1533328816 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.580+0000 7ff949b1a700 1 -- 172.21.15.146:0/1533328816 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9441309f0 msgr2=0x7ff94411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.580+0000 7ff949b1a700 1 --2- 172.21.15.146:0/1533328816 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9441309f0 0x7ff94411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.580+0000 7ff949b1a700 1 -- 172.21.15.146:0/1533328816 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff944133ad0 msgr2=0x7ff94411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.580+0000 7ff949b1a700 1 --2- 172.21.15.146:0/1533328816 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff944133ad0 0x7ff94411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.580+0000 7ff949b1a700 1 -- 172.21.15.146:0/1533328816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c009a70 con 0x7ff9441300a0 2023-10-03T10:16:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.580+0000 7ff94a31b700 1 --2- 172.21.15.146:0/1533328816 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff944133ad0 0x7ff94411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.581+0000 7ff949b1a700 1 --2- 172.21.15.146:0/1533328816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9441300a0 0x7ff94411da40 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7ff94000ebe0 tx=0x7ff94000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.581+0000 7ff93a7fc700 1 -- 172.21.15.146:0/1533328816 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940009800 con 0x7ff9441300a0 2023-10-03T10:16:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.581+0000 7ff93a7fc700 1 -- 172.21.15.146:0/1533328816 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94000c850 con 0x7ff9441300a0 2023-10-03T10:16:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.581+0000 7ff94bd7e700 1 -- 172.21.15.146:0/1533328816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9400094a0 con 0x7ff9441300a0 2023-10-03T10:16:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.581+0000 7ff93a7fc700 1 -- 172.21.15.146:0/1533328816 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94000cbc0 con 0x7ff9441300a0 2023-10-03T10:16:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.581+0000 7ff94bd7e700 1 -- 172.21.15.146:0/1533328816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff934009550 con 0x7ff9441300a0 2023-10-03T10:16:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.581+0000 7ff93a7fc700 1 -- 172.21.15.146:0/1533328816 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff94000cd20 con 0x7ff9441300a0 2023-10-03T10:16:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.582+0000 7ff93a7fc700 1 -- 172.21.15.146:0/1533328816 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff94003fac0 con 0x7ff9441300a0 2023-10-03T10:16:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.582+0000 7ff94bd7e700 1 -- 172.21.15.146:0/1533328816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9440a2620 con 0x7ff9441300a0 2023-10-03T10:16:58.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.586+0000 7ff93a7fc700 1 -- 172.21.15.146:0/1533328816 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff94001ad70 con 0x7ff9441300a0 2023-10-03T10:16:58.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.769+0000 7ff94bd7e700 1 -- 172.21.15.146:0/1533328816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff94411fd50 con 0x7ff9441300a0 2023-10-03T10:16:58.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.769+0000 7ff93a7fc700 1 -- 172.21.15.146:0/1533328816 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff940021030 con 0x7ff9441300a0 2023-10-03T10:16:58.769 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:58.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.771+0000 7ff94bd7e700 1 -- 172.21.15.146:0/1533328816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9441300a0 msgr2=0x7ff94411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.772+0000 7ff94bd7e700 1 --2- 172.21.15.146:0/1533328816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9441300a0 0x7ff94411da40 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7ff94000ebe0 tx=0x7ff94000eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.772+0000 7ff94bd7e700 1 -- 172.21.15.146:0/1533328816 shutdown_connections 2023-10-03T10:16:58.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.772+0000 7ff94bd7e700 1 --2- 172.21.15.146:0/1533328816 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff944133ad0 0x7ff94411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.772+0000 7ff94bd7e700 1 --2- 172.21.15.146:0/1533328816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9441300a0 0x7ff94411da40 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.772+0000 7ff94bd7e700 1 --2- 172.21.15.146:0/1533328816 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff9441309f0 0x7ff94411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.772+0000 7ff94bd7e700 1 -- 172.21.15.146:0/1533328816 >> 172.21.15.146:0/1533328816 conn(0x7ff944099c40 msgr2=0x7ff944132b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.772+0000 7ff94bd7e700 1 -- 172.21.15.146:0/1533328816 shutdown_connections 2023-10-03T10:16:58.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:58.772+0000 7ff94bd7e700 1 -- 172.21.15.146:0/1533328816 wait complete. 2023-10-03T10:16:58.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:16:58.996 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:59.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.118+0000 7f121f9ef700 1 Processor -- start 2023-10-03T10:16:59.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.118+0000 7f121f9ef700 1 -- start start 2023-10-03T10:16:59.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.119+0000 7f121f9ef700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121809d860 0x7f121809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.119+0000 7f121f9ef700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1218130eb0 0x7f1218138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.119+0000 7f121f9ef700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121809aaa0 con 0x7f121809e170 2023-10-03T10:16:59.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.119+0000 7f121f9ef700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121809f870 con 0x7f1218130eb0 2023-10-03T10:16:59.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.119+0000 7f121f9ef700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f121809b360 con 0x7f121809d860 2023-10-03T10:16:59.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.119+0000 7f121df8c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1218130eb0 0x7f1218138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.119+0000 7f121df8c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1218130eb0 0x7f1218138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55696/0 (socket says 172.21.15.146:55696) 2023-10-03T10:16:59.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.119+0000 7f121df8c700 1 -- 172.21.15.146:0/2563856634 learned_addr learned my addr 172.21.15.146:0/2563856634 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:59.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.119+0000 7f121cf8a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f121809e170 0x7f12181307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44074/0 (socket says 172.21.15.146:44074) 2023-10-03T10:16:59.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.119+0000 7f121d78b700 1 --2- 172.21.15.146:0/2563856634 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121809d860 0x7f121809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.120+0000 7f121df8c700 1 -- 172.21.15.146:0/2563856634 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121809d860 msgr2=0x7f121809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.120+0000 7f121df8c700 1 --2- 172.21.15.146:0/2563856634 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121809d860 0x7f121809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.120+0000 7f121df8c700 1 -- 172.21.15.146:0/2563856634 >> v1:172.21.15.146:6789/0 conn(0x7f121809e170 legacy=0x7f12181307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.120+0000 7f121df8c700 1 -- 172.21.15.146:0/2563856634 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121809b620 con 0x7f1218130eb0 2023-10-03T10:16:59.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.120+0000 7f121d78b700 1 --2- 172.21.15.146:0/2563856634 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121809d860 0x7f121809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.120+0000 7f121df8c700 1 --2- 172.21.15.146:0/2563856634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1218130eb0 0x7f1218138a00 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1210009e80 tx=0x7f121000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63abcfc33afc85d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.121+0000 7f120ffff700 1 -- 172.21.15.146:0/2563856634 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121000e070 con 0x7f1218130eb0 2023-10-03T10:16:59.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.122+0000 7f120ffff700 1 -- 172.21.15.146:0/2563856634 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121000b910 con 0x7f1218130eb0 2023-10-03T10:16:59.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.122+0000 7f120ffff700 1 -- 172.21.15.146:0/2563856634 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121000bcc0 con 0x7f1218130eb0 2023-10-03T10:16:59.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.122+0000 7f121f9ef700 1 -- 172.21.15.146:0/2563856634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1218130eb0 msgr2=0x7f1218138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.122+0000 7f121f9ef700 1 --2- 172.21.15.146:0/2563856634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1218130eb0 0x7f1218138a00 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1210009e80 tx=0x7f121000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:59.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.122+0000 7f121f9ef700 1 -- 172.21.15.146:0/2563856634 shutdown_connections 2023-10-03T10:16:59.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.122+0000 7f121f9ef700 1 --2- 172.21.15.146:0/2563856634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1218130eb0 0x7f1218138a00 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.122+0000 7f121f9ef700 1 --2- 172.21.15.146:0/2563856634 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121809d860 0x7f121809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.122+0000 7f121f9ef700 1 -- 172.21.15.146:0/2563856634 >> 172.21.15.146:0/2563856634 conn(0x7f1218099c40 msgr2=0x7f12180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.122+0000 7f121f9ef700 1 -- 172.21.15.146:0/2563856634 shutdown_connections 2023-10-03T10:16:59.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.122+0000 7f121f9ef700 1 -- 172.21.15.146:0/2563856634 wait complete. 2023-10-03T10:16:59.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.123+0000 7f121f9ef700 1 Processor -- start 2023-10-03T10:16:59.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.123+0000 7f121f9ef700 1 -- start start 2023-10-03T10:16:59.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.124+0000 7f121f9ef700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121809d860 0x7f12181c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.124+0000 7f121f9ef700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121809e170 0x7f12181c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.124+0000 7f121f9ef700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1218130eb0 0x7f1218119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.124+0000 7f121f9ef700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12181c8160 con 0x7f1218130eb0 2023-10-03T10:16:59.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.124+0000 7f121f9ef700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12180a2140 con 0x7f121809d860 2023-10-03T10:16:59.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.124+0000 7f121f9ef700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f121811b630 con 0x7f121809e170 2023-10-03T10:16:59.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.124+0000 7f121cf8a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121809e170 0x7f12181c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.124+0000 7f121df8c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1218130eb0 0x7f1218119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.124+0000 7f121cf8a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121809e170 0x7f12181c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56046/0 (socket says 172.21.15.146:56046) 2023-10-03T10:16:59.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.124+0000 7f121cf8a700 1 -- 172.21.15.146:0/3091066845 learned_addr learned my addr 172.21.15.146:0/3091066845 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:59.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.124+0000 7f121d78b700 1 --2- 172.21.15.146:0/3091066845 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121809d860 0x7f12181c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.124+0000 7f121cf8a700 1 -- 172.21.15.146:0/3091066845 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121809d860 msgr2=0x7f12181c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.124+0000 7f121cf8a700 1 --2- 172.21.15.146:0/3091066845 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121809d860 0x7f12181c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.124+0000 7f121cf8a700 1 -- 172.21.15.146:0/3091066845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1218130eb0 msgr2=0x7f1218119630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.124+0000 7f121cf8a700 1 --2- 172.21.15.146:0/3091066845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1218130eb0 0x7f1218119630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.124+0000 7f121cf8a700 1 -- 172.21.15.146:0/3091066845 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12080094a0 con 0x7f121809e170 2023-10-03T10:16:59.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.124+0000 7f121df8c700 1 --2- 172.21.15.146:0/3091066845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1218130eb0 0x7f1218119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.124+0000 7f121d78b700 1 --2- 172.21.15.146:0/3091066845 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121809d860 0x7f12181c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.124+0000 7f121cf8a700 1 --2- 172.21.15.146:0/3091066845 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121809e170 0x7f12181c8950 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f121400c4f0 tx=0x7f121400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.124+0000 7f120dffb700 1 -- 172.21.15.146:0/3091066845 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1214005cb0 con 0x7f121809e170 2023-10-03T10:16:59.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.124+0000 7f120dffb700 1 -- 172.21.15.146:0/3091066845 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1214005e10 con 0x7f121809e170 2023-10-03T10:16:59.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.125+0000 7f121f9ef700 1 -- 172.21.15.146:0/3091066845 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1210009b30 con 0x7f121809e170 2023-10-03T10:16:59.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.125+0000 7f120dffb700 1 -- 172.21.15.146:0/3091066845 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12140072d0 con 0x7f121809e170 2023-10-03T10:16:59.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.125+0000 7f121f9ef700 1 -- 172.21.15.146:0/3091066845 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f121811bbd0 con 0x7f121809e170 2023-10-03T10:16:59.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.125+0000 7f120dffb700 1 -- 172.21.15.146:0/3091066845 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1214007430 con 0x7f121809e170 2023-10-03T10:16:59.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.125+0000 7f120dffb700 1 -- 172.21.15.146:0/3091066845 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f121403ea30 con 0x7f121809e170 2023-10-03T10:16:59.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.126+0000 7f121f9ef700 1 -- 172.21.15.146:0/3091066845 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f121811b7f0 con 0x7f121809e170 2023-10-03T10:16:59.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.130+0000 7f120dffb700 1 -- 172.21.15.146:0/3091066845 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1214017020 con 0x7f121809e170 2023-10-03T10:16:59.130 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:59.168 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:59.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.256+0000 7f481f8a2700 1 Processor -- start 2023-10-03T10:16:59.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.256+0000 7f481f8a2700 1 -- start start 2023-10-03T10:16:59.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.257+0000 7f481f8a2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f48180a0a70 0x7f48180a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.257+0000 7f481f8a2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48180a1380 0x7f4818133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.257+0000 7f481f8a2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f481809dc00 con 0x7f4818133f50 2023-10-03T10:16:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.257+0000 7f481f8a2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481809ea60 con 0x7f48180a0a70 2023-10-03T10:16:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.257+0000 7f481f8a2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f481809dec0 con 0x7f48180a1380 2023-10-03T10:16:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.257+0000 7f481ce3d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48180a1380 0x7f4818133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.257+0000 7f481d63e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f48180a0a70 0x7f48180a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.257+0000 7f481ce3d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48180a1380 0x7f4818133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56050/0 (socket says 172.21.15.146:56050) 2023-10-03T10:16:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.257+0000 7f481d63e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f48180a0a70 0x7f48180a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60818/0 (socket says 172.21.15.146:60818) 2023-10-03T10:16:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.257+0000 7f481ce3d700 1 -- 172.21.15.146:0/3432570716 learned_addr learned my addr 172.21.15.146:0/3432570716 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.257+0000 7f481d63e700 1 -- 172.21.15.146:0/3432570716 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48180a1380 msgr2=0x7f4818133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.257+0000 7f481d63e700 1 --2- 172.21.15.146:0/3432570716 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48180a1380 0x7f4818133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.257+0000 7f481d63e700 1 -- 172.21.15.146:0/3432570716 >> v1:172.21.15.146:6789/0 conn(0x7f4818133f50 legacy=0x7f481813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.257+0000 7f481d63e700 1 -- 172.21.15.146:0/3432570716 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481809e6a0 con 0x7f48180a0a70 2023-10-03T10:16:59.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.257+0000 7f481ce3d700 1 --2- 172.21.15.146:0/3432570716 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48180a1380 0x7f4818133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.258+0000 7f481d63e700 1 --2- 172.21.15.146:0/3432570716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48180a0a70 0x7f48180a0e40 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f4814009840 tx=0x7f4814009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e540ad845fcf8a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.258+0000 7f480ffff700 1 -- 172.21.15.146:0/3432570716 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4814011830 con 0x7f48180a0a70 2023-10-03T10:16:59.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.258+0000 7f480ffff700 1 -- 172.21.15.146:0/3432570716 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4814011990 con 0x7f48180a0a70 2023-10-03T10:16:59.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.258+0000 7f480ffff700 1 -- 172.21.15.146:0/3432570716 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4814011d20 con 0x7f48180a0a70 2023-10-03T10:16:59.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.258+0000 7f481f8a2700 1 -- 172.21.15.146:0/3432570716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48180a0a70 msgr2=0x7f48180a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.258+0000 7f481f8a2700 1 --2- 172.21.15.146:0/3432570716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48180a0a70 0x7f48180a0e40 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f4814009840 tx=0x7f4814009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:59.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.258+0000 7f481f8a2700 1 -- 172.21.15.146:0/3432570716 shutdown_connections 2023-10-03T10:16:59.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.258+0000 7f481f8a2700 1 --2- 172.21.15.146:0/3432570716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48180a0a70 0x7f48180a0e40 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.258+0000 7f481f8a2700 1 --2- 172.21.15.146:0/3432570716 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48180a1380 0x7f4818133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.258+0000 7f481f8a2700 1 -- 172.21.15.146:0/3432570716 >> 172.21.15.146:0/3432570716 conn(0x7f48180a6610 msgr2=0x7f48180a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.259+0000 7f481f8a2700 1 -- 172.21.15.146:0/3432570716 shutdown_connections 2023-10-03T10:16:59.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.259+0000 7f481f8a2700 1 -- 172.21.15.146:0/3432570716 wait complete. 2023-10-03T10:16:59.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.259+0000 7f481f8a2700 1 Processor -- start 2023-10-03T10:16:59.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.260+0000 7f481f8a2700 1 -- start start 2023-10-03T10:16:59.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.260+0000 7f481f8a2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48180a0a70 0x7f481811e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.260+0000 7f481f8a2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48180a1380 0x7f481811ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.260+0000 7f481f8a2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4818133f50 0x7f481811f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.260+0000 7f481f8a2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4818133790 con 0x7f48180a1380 2023-10-03T10:16:59.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.260+0000 7f481f8a2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4818122320 con 0x7f48180a0a70 2023-10-03T10:16:59.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.260+0000 7f481f8a2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48181339d0 con 0x7f4818133f50 2023-10-03T10:16:59.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.260+0000 7f481ce3d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48180a1380 0x7f481811ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.260+0000 7f481ce3d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48180a1380 0x7f481811ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60824/0 (socket says 172.21.15.146:60824) 2023-10-03T10:16:59.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.260+0000 7f481de3f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4818133f50 0x7f481811f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.260+0000 7f481ce3d700 1 -- 172.21.15.146:0/3812052753 learned_addr learned my addr 172.21.15.146:0/3812052753 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:59.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.260+0000 7f481de3f700 1 -- 172.21.15.146:0/3812052753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48180a0a70 msgr2=0x7f481811e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.260+0000 7f481de3f700 1 --2- 172.21.15.146:0/3812052753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48180a0a70 0x7f481811e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.260+0000 7f481de3f700 1 -- 172.21.15.146:0/3812052753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48180a1380 msgr2=0x7f481811ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.260+0000 7f481de3f700 1 --2- 172.21.15.146:0/3812052753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48180a1380 0x7f481811ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.260+0000 7f481de3f700 1 -- 172.21.15.146:0/3812052753 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4808009550 con 0x7f4818133f50 2023-10-03T10:16:59.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.260+0000 7f481ce3d700 1 --2- 172.21.15.146:0/3812052753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48180a1380 0x7f481811ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.261+0000 7f481de3f700 1 --2- 172.21.15.146:0/3812052753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4818133f50 0x7f481811f2c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f481000cb90 tx=0x7f481000cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.261+0000 7f480dffb700 1 -- 172.21.15.146:0/3812052753 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4810003c00 con 0x7f4818133f50 2023-10-03T10:16:59.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.261+0000 7f480dffb700 1 -- 172.21.15.146:0/3812052753 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4810003d60 con 0x7f4818133f50 2023-10-03T10:16:59.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.261+0000 7f480dffb700 1 -- 172.21.15.146:0/3812052753 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481000aaa0 con 0x7f4818133f50 2023-10-03T10:16:59.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.261+0000 7f481f8a2700 1 -- 172.21.15.146:0/3812052753 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48140094a0 con 0x7f4818133f50 2023-10-03T10:16:59.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.261+0000 7f481f8a2700 1 -- 172.21.15.146:0/3812052753 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4818120c00 con 0x7f4818133f50 2023-10-03T10:16:59.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.262+0000 7f480dffb700 1 -- 172.21.15.146:0/3812052753 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f481000ac00 con 0x7f4818133f50 2023-10-03T10:16:59.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.262+0000 7f480dffb700 1 -- 172.21.15.146:0/3812052753 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f481003f5e0 con 0x7f4818133f50 2023-10-03T10:16:59.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.262+0000 7f481f8a2700 1 -- 172.21.15.146:0/3812052753 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481804f2a0 con 0x7f4818133f50 2023-10-03T10:16:59.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.267+0000 7f480dffb700 1 -- 172.21.15.146:0/3812052753 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48100198f0 con 0x7f4818133f50 2023-10-03T10:16:59.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.299+0000 7f136dfeb700 1 Processor -- start 2023-10-03T10:16:59.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.299+0000 7f136dfeb700 1 -- start start 2023-10-03T10:16:59.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.300+0000 7f136dfeb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f136809ad40 0x7f1368133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.300+0000 7f136dfeb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f13681343a0 0x7f13680a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.300+0000 7f136dfeb700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136809b110 con 0x7f1368133f70 2023-10-03T10:16:59.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.300+0000 7f136dfeb700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13680a3b60 con 0x7f13681343a0 2023-10-03T10:16:59.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.300+0000 7f136dfeb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13680a2fa0 con 0x7f136809ad40 2023-10-03T10:16:59.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.300+0000 7f13677fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f136809ad40 0x7f1368133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.300+0000 7f13677fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f136809ad40 0x7f1368133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56064/0 (socket says 172.21.15.146:56064) 2023-10-03T10:16:59.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.300+0000 7f13677fe700 1 -- 172.21.15.146:0/541989787 learned_addr learned my addr 172.21.15.146:0/541989787 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:59.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.300+0000 7f1367fff700 1 --2- 172.21.15.146:0/541989787 >> v2:172.21.15.146:3300/0 conn(0x7f13681343a0 0x7f13680a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.300+0000 7f13677fe700 1 -- 172.21.15.146:0/541989787 >> v2:172.21.15.146:3300/0 conn(0x7f13681343a0 msgr2=0x7f13680a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.300+0000 7f13677fe700 1 --2- 172.21.15.146:0/541989787 >> v2:172.21.15.146:3300/0 conn(0x7f13681343a0 0x7f13680a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.300+0000 7f13677fe700 1 -- 172.21.15.146:0/541989787 >> v1:172.21.15.146:6789/0 conn(0x7f1368133f70 legacy=0x7f13680a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.300+0000 7f13677fe700 1 -- 172.21.15.146:0/541989787 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136809a280 con 0x7f136809ad40 2023-10-03T10:16:59.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.300+0000 7f13677fe700 1 --2- 172.21.15.146:0/541989787 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f136809ad40 0x7f1368133a30 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1358009e80 tx=0x7f135800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb89440f73846889 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.301+0000 7f13667fc700 1 -- 172.21.15.146:0/541989787 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135800e070 con 0x7f136809ad40 2023-10-03T10:16:59.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.301+0000 7f13667fc700 1 -- 172.21.15.146:0/541989787 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135800b8d0 con 0x7f136809ad40 2023-10-03T10:16:59.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.301+0000 7f13667fc700 1 -- 172.21.15.146:0/541989787 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135800bc80 con 0x7f136809ad40 2023-10-03T10:16:59.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.301+0000 7f136dfeb700 1 -- 172.21.15.146:0/541989787 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f136809ad40 msgr2=0x7f1368133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.301+0000 7f136dfeb700 1 --2- 172.21.15.146:0/541989787 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f136809ad40 0x7f1368133a30 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1358009e80 tx=0x7f135800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:59.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.301+0000 7f136dfeb700 1 -- 172.21.15.146:0/541989787 shutdown_connections 2023-10-03T10:16:59.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.301+0000 7f136dfeb700 1 --2- 172.21.15.146:0/541989787 >> v2:172.21.15.146:3300/0 conn(0x7f13681343a0 0x7f13680a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.301+0000 7f136dfeb700 1 --2- 172.21.15.146:0/541989787 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f136809ad40 0x7f1368133a30 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.301+0000 7f136dfeb700 1 -- 172.21.15.146:0/541989787 >> 172.21.15.146:0/541989787 conn(0x7f1368099c40 msgr2=0x7f136806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.301+0000 7f136dfeb700 1 -- 172.21.15.146:0/541989787 shutdown_connections 2023-10-03T10:16:59.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.301+0000 7f136dfeb700 1 -- 172.21.15.146:0/541989787 wait complete. 2023-10-03T10:16:59.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.302+0000 7f136dfeb700 1 Processor -- start 2023-10-03T10:16:59.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.302+0000 7f136dfeb700 1 -- start start 2023-10-03T10:16:59.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.303+0000 7f136dfeb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f136809ad40 0x7f13681223c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.303+0000 7f136dfeb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1368133f70 0x7f1368122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.303+0000 7f136dfeb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13681343a0 0x7f1368122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.303+0000 7f136dfeb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1368124120 con 0x7f13681343a0 2023-10-03T10:16:59.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.303+0000 7f136dfeb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1368123f30 con 0x7f1368133f70 2023-10-03T10:16:59.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.303+0000 7f136dfeb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1368124e00 con 0x7f136809ad40 2023-10-03T10:16:59.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.303+0000 7f13677fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f136809ad40 0x7f13681223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.303+0000 7f13677fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f136809ad40 0x7f13681223c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56072/0 (socket says 172.21.15.146:56072) 2023-10-03T10:16:59.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.303+0000 7f13677fe700 1 -- 172.21.15.146:0/164280814 learned_addr learned my addr 172.21.15.146:0/164280814 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:59.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.303+0000 7f1367fff700 1 --2- 172.21.15.146:0/164280814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13681343a0 0x7f1368122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.303+0000 7f1366ffd700 1 --2- 172.21.15.146:0/164280814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1368133f70 0x7f1368122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.303+0000 7f1367fff700 1 -- 172.21.15.146:0/164280814 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f136809ad40 msgr2=0x7f13681223c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.303+0000 7f1367fff700 1 --2- 172.21.15.146:0/164280814 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f136809ad40 0x7f13681223c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.303+0000 7f1367fff700 1 -- 172.21.15.146:0/164280814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1368133f70 msgr2=0x7f1368122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.303+0000 7f1367fff700 1 --2- 172.21.15.146:0/164280814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1368133f70 0x7f1368122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.303+0000 7f1367fff700 1 -- 172.21.15.146:0/164280814 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1358009b30 con 0x7f13681343a0 2023-10-03T10:16:59.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.303+0000 7f1366ffd700 1 --2- 172.21.15.146:0/164280814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1368133f70 0x7f1368122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.303+0000 7f1367fff700 1 --2- 172.21.15.146:0/164280814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13681343a0 0x7f1368122e40 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f136000e880 tx=0x7f136000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.303+0000 7f134ffff700 1 -- 172.21.15.146:0/164280814 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360013680 con 0x7f13681343a0 2023-10-03T10:16:59.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.304+0000 7f134ffff700 1 -- 172.21.15.146:0/164280814 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13600137e0 con 0x7f13681343a0 2023-10-03T10:16:59.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.304+0000 7f136dfeb700 1 -- 172.21.15.146:0/164280814 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1368125180 con 0x7f13681343a0 2023-10-03T10:16:59.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.304+0000 7f134ffff700 1 -- 172.21.15.146:0/164280814 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360013b70 con 0x7f13681343a0 2023-10-03T10:16:59.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.304+0000 7f136dfeb700 1 -- 172.21.15.146:0/164280814 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1368125b60 con 0x7f13681343a0 2023-10-03T10:16:59.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.304+0000 7f134ffff700 1 -- 172.21.15.146:0/164280814 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1360013cd0 con 0x7f13681343a0 2023-10-03T10:16:59.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.305+0000 7f134ffff700 1 -- 172.21.15.146:0/164280814 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f136003f5d0 con 0x7f13681343a0 2023-10-03T10:16:59.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.304+0000 7f136dfeb700 1 -- 172.21.15.146:0/164280814 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136804f2a0 con 0x7f13681343a0 2023-10-03T10:16:59.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.309+0000 7f134ffff700 1 -- 172.21.15.146:0/164280814 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1360021020 con 0x7f13681343a0 2023-10-03T10:16:59.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.338+0000 7f121f9ef700 1 -- 172.21.15.146:0/3091066845 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f121804f2a0 con 0x7f121809e170 2023-10-03T10:16:59.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.338+0000 7f120dffb700 1 -- 172.21.15.146:0/3091066845 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f121401b3b0 con 0x7f121809e170 2023-10-03T10:16:59.338 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:16:59.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.340+0000 7f121f9ef700 1 -- 172.21.15.146:0/3091066845 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121809e170 msgr2=0x7f12181c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.340+0000 7f121f9ef700 1 --2- 172.21.15.146:0/3091066845 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121809e170 0x7f12181c8950 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f121400c4f0 tx=0x7f121400c800 comp rx=0 tx=0).stop 2023-10-03T10:16:59.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.340+0000 7f121f9ef700 1 -- 172.21.15.146:0/3091066845 shutdown_connections 2023-10-03T10:16:59.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.340+0000 7f121f9ef700 1 --2- 172.21.15.146:0/3091066845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1218130eb0 0x7f1218119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.340+0000 7f121f9ef700 1 --2- 172.21.15.146:0/3091066845 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f121809d860 0x7f12181c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.340+0000 7f121f9ef700 1 --2- 172.21.15.146:0/3091066845 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f121809e170 0x7f12181c8950 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.340+0000 7f121f9ef700 1 -- 172.21.15.146:0/3091066845 >> 172.21.15.146:0/3091066845 conn(0x7f1218099c40 msgr2=0x7f121813b930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.340+0000 7f121f9ef700 1 -- 172.21.15.146:0/3091066845 shutdown_connections 2023-10-03T10:16:59.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.340+0000 7f121f9ef700 1 -- 172.21.15.146:0/3091066845 wait complete. 2023-10-03T10:16:59.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:16:59.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.463+0000 7f481f8a2700 1 -- 172.21.15.146:0/3812052753 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4818072980 con 0x7f4818133f50 2023-10-03T10:16:59.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.463+0000 7f480dffb700 1 -- 172.21.15.146:0/3812052753 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4810019300 con 0x7f4818133f50 2023-10-03T10:16:59.463 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:16:59.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.465+0000 7f481f8a2700 1 -- 172.21.15.146:0/3812052753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4818133f50 msgr2=0x7f481811f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.465+0000 7f481f8a2700 1 --2- 172.21.15.146:0/3812052753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4818133f50 0x7f481811f2c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f481000cb90 tx=0x7f481000cea0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.465+0000 7f481f8a2700 1 -- 172.21.15.146:0/3812052753 shutdown_connections 2023-10-03T10:16:59.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.465+0000 7f481f8a2700 1 --2- 172.21.15.146:0/3812052753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4818133f50 0x7f481811f2c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.465+0000 7f481f8a2700 1 --2- 172.21.15.146:0/3812052753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48180a0a70 0x7f481811e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.465+0000 7f481f8a2700 1 --2- 172.21.15.146:0/3812052753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48180a1380 0x7f481811ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.465+0000 7f481f8a2700 1 -- 172.21.15.146:0/3812052753 >> 172.21.15.146:0/3812052753 conn(0x7f48180a6610 msgr2=0x7f48180a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.465+0000 7f481f8a2700 1 -- 172.21.15.146:0/3812052753 shutdown_connections 2023-10-03T10:16:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.465+0000 7f481f8a2700 1 -- 172.21.15.146:0/3812052753 wait complete. 2023-10-03T10:16:59.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:16:59.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.505+0000 7f136dfeb700 1 -- 172.21.15.146:0/164280814 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f13680729d0 con 0x7f13681343a0 2023-10-03T10:16:59.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.505+0000 7f134ffff700 1 -- 172.21.15.146:0/164280814 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f136001be10 con 0x7f13681343a0 2023-10-03T10:16:59.505 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:16:59.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.508+0000 7f136dfeb700 1 -- 172.21.15.146:0/164280814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13681343a0 msgr2=0x7f1368122e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.508+0000 7f136dfeb700 1 --2- 172.21.15.146:0/164280814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13681343a0 0x7f1368122e40 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f136000e880 tx=0x7f136000eb90 comp rx=0 tx=0).stop 2023-10-03T10:16:59.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.508+0000 7f136dfeb700 1 -- 172.21.15.146:0/164280814 shutdown_connections 2023-10-03T10:16:59.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.508+0000 7f136dfeb700 1 --2- 172.21.15.146:0/164280814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13681343a0 0x7f1368122e40 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.508+0000 7f136dfeb700 1 --2- 172.21.15.146:0/164280814 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f136809ad40 0x7f13681223c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.508+0000 7f136dfeb700 1 --2- 172.21.15.146:0/164280814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1368133f70 0x7f1368122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.508+0000 7f136dfeb700 1 -- 172.21.15.146:0/164280814 >> 172.21.15.146:0/164280814 conn(0x7f1368099c40 msgr2=0x7f136809b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.508+0000 7f136dfeb700 1 -- 172.21.15.146:0/164280814 shutdown_connections 2023-10-03T10:16:59.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.508+0000 7f136dfeb700 1 -- 172.21.15.146:0/164280814 wait complete. 2023-10-03T10:16:59.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:16:59.785 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:59.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.907+0000 7f07ee4c3700 1 Processor -- start 2023-10-03T10:16:59.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.908+0000 7f07ee4c3700 1 -- start start 2023-10-03T10:16:59.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.908+0000 7f07ee4c3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f07e809e870 0x7f07e809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.908+0000 7f07ee4c3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07e8134330 0x7f07e813be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.908+0000 7f07ee4c3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e809fa00 con 0x7f07e809f180 2023-10-03T10:16:59.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.908+0000 7f07ee4c3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e80a0370 con 0x7f07e809e870 2023-10-03T10:16:59.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.908+0000 7f07ee4c3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e806bec0 con 0x7f07e8134330 2023-10-03T10:16:59.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.908+0000 7f07e7fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f07e809e870 0x7f07e809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.908+0000 7f07eca60700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07e8134330 0x7f07e813be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.908+0000 7f07e77fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f07e809f180 0x7f07e8133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44086/0 (socket says 172.21.15.146:44086) 2023-10-03T10:16:59.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.908+0000 7f07e77fe700 1 -- 172.21.15.146:0/2837352430 learned_addr learned my addr 172.21.15.146:0/2837352430 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:16:59.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.908+0000 7f07e7fff700 1 -- 172.21.15.146:0/2837352430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07e8134330 msgr2=0x7f07e813be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.908+0000 7f07e7fff700 1 --2- 172.21.15.146:0/2837352430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07e8134330 0x7f07e813be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.908+0000 7f07e7fff700 1 -- 172.21.15.146:0/2837352430 >> v1:172.21.15.146:6789/0 conn(0x7f07e809f180 legacy=0x7f07e8133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.908+0000 7f07e7fff700 1 -- 172.21.15.146:0/2837352430 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e809ada0 con 0x7f07e809e870 2023-10-03T10:16:59.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.908+0000 7f07e6ffd700 1 -- 172.21.15.146:0/2837352430 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352816846 0 0) 0x7f07e809fa00 con 0x7f07e809f180 2023-10-03T10:16:59.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.908+0000 7f07eca60700 1 --2- 172.21.15.146:0/2837352430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07e8134330 0x7f07e813be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.909+0000 7f07e7fff700 1 --2- 172.21.15.146:0/2837352430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07e809e870 0x7f07e809ec40 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009840 tx=0x7f07d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5170918c2507174 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.909+0000 7f07e6ffd700 1 -- 172.21.15.146:0/2837352430 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8011830 con 0x7f07e809e870 2023-10-03T10:16:59.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.909+0000 7f07e6ffd700 1 -- 172.21.15.146:0/2837352430 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d8011990 con 0x7f07e809e870 2023-10-03T10:16:59.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.909+0000 7f07e6ffd700 1 -- 172.21.15.146:0/2837352430 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8011d20 con 0x7f07e809e870 2023-10-03T10:16:59.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.909+0000 7f07ee4c3700 1 -- 172.21.15.146:0/2837352430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07e809e870 msgr2=0x7f07e809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.909+0000 7f07ee4c3700 1 --2- 172.21.15.146:0/2837352430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07e809e870 0x7f07e809ec40 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009840 tx=0x7f07d8009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:59.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.909+0000 7f07ee4c3700 1 -- 172.21.15.146:0/2837352430 shutdown_connections 2023-10-03T10:16:59.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.909+0000 7f07ee4c3700 1 --2- 172.21.15.146:0/2837352430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07e8134330 0x7f07e813be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.909+0000 7f07ee4c3700 1 --2- 172.21.15.146:0/2837352430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07e809e870 0x7f07e809ec40 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.909+0000 7f07ee4c3700 1 -- 172.21.15.146:0/2837352430 >> 172.21.15.146:0/2837352430 conn(0x7f07e80a4430 msgr2=0x7f07e80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.909+0000 7f07ee4c3700 1 -- 172.21.15.146:0/2837352430 shutdown_connections 2023-10-03T10:16:59.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.909+0000 7f07ee4c3700 1 -- 172.21.15.146:0/2837352430 wait complete. 2023-10-03T10:16:59.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.910+0000 7f07ee4c3700 1 Processor -- start 2023-10-03T10:16:59.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.910+0000 7f07ee4c3700 1 -- start start 2023-10-03T10:16:59.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.911+0000 7f07ee4c3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07e809e870 0x7f07e81228c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.911+0000 7f07ee4c3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07e809f180 0x7f07e8122e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.911+0000 7f07ee4c3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07e8134330 0x7f07e8123340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.911+0000 7f07ee4c3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e8126190 con 0x7f07e809f180 2023-10-03T10:16:59.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.911+0000 7f07ee4c3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e8124480 con 0x7f07e8134330 2023-10-03T10:16:59.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.911+0000 7f07ee4c3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07e806cfa0 con 0x7f07e809e870 2023-10-03T10:16:59.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.911+0000 7f07e77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07e809f180 0x7f07e8122e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.911+0000 7f07eca60700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07e8134330 0x7f07e8123340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.911+0000 7f07e77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07e809f180 0x7f07e8122e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60864/0 (socket says 172.21.15.146:60864) 2023-10-03T10:16:59.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.911+0000 7f07e77fe700 1 -- 172.21.15.146:0/61394789 learned_addr learned my addr 172.21.15.146:0/61394789 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:16:59.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.911+0000 7f07e7fff700 1 --2- 172.21.15.146:0/61394789 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07e809e870 0x7f07e81228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.911+0000 7f07e77fe700 1 -- 172.21.15.146:0/61394789 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07e809e870 msgr2=0x7f07e81228c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.911+0000 7f07e77fe700 1 --2- 172.21.15.146:0/61394789 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07e809e870 0x7f07e81228c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.911+0000 7f07e77fe700 1 -- 172.21.15.146:0/61394789 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07e8134330 msgr2=0x7f07e8123340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.911+0000 7f07e77fe700 1 --2- 172.21.15.146:0/61394789 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07e8134330 0x7f07e8123340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.911+0000 7f07e77fe700 1 -- 172.21.15.146:0/61394789 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e0009a70 con 0x7f07e809f180 2023-10-03T10:16:59.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.911+0000 7f07eca60700 1 --2- 172.21.15.146:0/61394789 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07e8134330 0x7f07e8123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.911+0000 7f07e77fe700 1 --2- 172.21.15.146:0/61394789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07e809f180 0x7f07e8122e00 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00c520 tx=0x7f07dc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.912+0000 7f07e4ff9700 1 -- 172.21.15.146:0/61394789 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc004c80 con 0x7f07e809f180 2023-10-03T10:16:59.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.912+0000 7f07e4ff9700 1 -- 172.21.15.146:0/61394789 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07dc004e00 con 0x7f07e809f180 2023-10-03T10:16:59.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.912+0000 7f07ee4c3700 1 -- 172.21.15.146:0/61394789 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d80094a0 con 0x7f07e809f180 2023-10-03T10:16:59.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.912+0000 7f07e4ff9700 1 -- 172.21.15.146:0/61394789 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc007310 con 0x7f07e809f180 2023-10-03T10:16:59.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.912+0000 7f07ee4c3700 1 -- 172.21.15.146:0/61394789 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e8126b20 con 0x7f07e809f180 2023-10-03T10:16:59.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.912+0000 7f07e4ff9700 1 -- 172.21.15.146:0/61394789 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07dc007470 con 0x7f07e809f180 2023-10-03T10:16:59.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.913+0000 7f07e4ff9700 1 -- 172.21.15.146:0/61394789 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f07dc03f3a0 con 0x7f07e809f180 2023-10-03T10:16:59.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.913+0000 7f07ee4c3700 1 -- 172.21.15.146:0/61394789 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e8125fd0 con 0x7f07e809f180 2023-10-03T10:16:59.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:16:59.917+0000 7f07e4ff9700 1 -- 172.21.15.146:0/61394789 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07dc0123b0 con 0x7f07e809f180 2023-10-03T10:17:00.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.101+0000 7f07ee4c3700 1 -- 172.21.15.146:0/61394789 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f07e804f2a0 con 0x7f07e809f180 2023-10-03T10:17:00.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.101+0000 7f07e4ff9700 1 -- 172.21.15.146:0/61394789 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f07dc00ce60 con 0x7f07e809f180 2023-10-03T10:17:00.101 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:00.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.103+0000 7f07ee4c3700 1 -- 172.21.15.146:0/61394789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07e809f180 msgr2=0x7f07e8122e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.103+0000 7f07ee4c3700 1 --2- 172.21.15.146:0/61394789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07e809f180 0x7f07e8122e00 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00c520 tx=0x7f07dc00c830 comp rx=0 tx=0).stop 2023-10-03T10:17:00.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.103+0000 7f07ee4c3700 1 -- 172.21.15.146:0/61394789 shutdown_connections 2023-10-03T10:17:00.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.103+0000 7f07ee4c3700 1 --2- 172.21.15.146:0/61394789 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07e8134330 0x7f07e8123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.103+0000 7f07ee4c3700 1 --2- 172.21.15.146:0/61394789 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07e809e870 0x7f07e81228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.103+0000 7f07ee4c3700 1 --2- 172.21.15.146:0/61394789 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07e809f180 0x7f07e8122e00 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.103+0000 7f07ee4c3700 1 -- 172.21.15.146:0/61394789 >> 172.21.15.146:0/61394789 conn(0x7f07e80a4430 msgr2=0x7f07e8070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:00.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.103+0000 7f07ee4c3700 1 -- 172.21.15.146:0/61394789 shutdown_connections 2023-10-03T10:17:00.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.103+0000 7f07ee4c3700 1 -- 172.21.15.146:0/61394789 wait complete. 2023-10-03T10:17:00.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:00.353 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:00.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.477+0000 7fc07c7f5700 1 Processor -- start 2023-10-03T10:17:00.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.477+0000 7fc07c7f5700 1 -- start start 2023-10-03T10:17:00.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.478+0000 7fc07c7f5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc074133ad0 0x7fc074133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.478+0000 7fc07c7f5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc074130bc0 0x7fc07413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.478+0000 7fc07c7f5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07406b2d0 con 0x7fc0741300a0 2023-10-03T10:17:00.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.478+0000 7fc07c7f5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc074133610 con 0x7fc074133ad0 2023-10-03T10:17:00.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.478+0000 7fc07c7f5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc07409a500 con 0x7fc074130bc0 2023-10-03T10:17:00.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.478+0000 7fc07a591700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc074133ad0 0x7fc074133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.478+0000 7fc079d90700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc0741300a0 0x7fc0741304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44094/0 (socket says 172.21.15.146:44094) 2023-10-03T10:17:00.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.478+0000 7fc079d90700 1 -- 172.21.15.146:0/3760991793 learned_addr learned my addr 172.21.15.146:0/3760991793 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:00.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.478+0000 7fc07ad92700 1 --2- 172.21.15.146:0/3760991793 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc074130bc0 0x7fc07413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.478+0000 7fc07958f700 1 -- 172.21.15.146:0/3760991793 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186108319 0 0) 0x7fc07406b2d0 con 0x7fc0741300a0 2023-10-03T10:17:00.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.478+0000 7fc07ad92700 1 -- 172.21.15.146:0/3760991793 >> v2:172.21.15.146:3300/0 conn(0x7fc074133ad0 msgr2=0x7fc074133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:00.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.478+0000 7fc07ad92700 1 --2- 172.21.15.146:0/3760991793 >> v2:172.21.15.146:3300/0 conn(0x7fc074133ad0 0x7fc074133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.478+0000 7fc07ad92700 1 -- 172.21.15.146:0/3760991793 >> v1:172.21.15.146:6789/0 conn(0x7fc0741300a0 legacy=0x7fc0741304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.478+0000 7fc07ad92700 1 -- 172.21.15.146:0/3760991793 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0741338b0 con 0x7fc074130bc0 2023-10-03T10:17:00.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.478+0000 7fc07ad92700 1 --2- 172.21.15.146:0/3760991793 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc074130bc0 0x7fc07413b990 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc06c009d90 tx=0x7fc06c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84e718702c50b43e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.478+0000 7fc07958f700 1 -- 172.21.15.146:0/3760991793 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c00e070 con 0x7fc074130bc0 2023-10-03T10:17:00.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.478+0000 7fc07958f700 1 -- 172.21.15.146:0/3760991793 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c00bb20 con 0x7fc074130bc0 2023-10-03T10:17:00.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.478+0000 7fc07958f700 1 -- 172.21.15.146:0/3760991793 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c012430 con 0x7fc074130bc0 2023-10-03T10:17:00.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.479+0000 7fc07c7f5700 1 -- 172.21.15.146:0/3760991793 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc074130bc0 msgr2=0x7fc07413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.479+0000 7fc07c7f5700 1 --2- 172.21.15.146:0/3760991793 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc074130bc0 0x7fc07413b990 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc06c009d90 tx=0x7fc06c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.479+0000 7fc07c7f5700 1 -- 172.21.15.146:0/3760991793 shutdown_connections 2023-10-03T10:17:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.479+0000 7fc07c7f5700 1 --2- 172.21.15.146:0/3760991793 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc074130bc0 0x7fc07413b990 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.479+0000 7fc07c7f5700 1 --2- 172.21.15.146:0/3760991793 >> v2:172.21.15.146:3300/0 conn(0x7fc074133ad0 0x7fc074133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.479+0000 7fc07c7f5700 1 -- 172.21.15.146:0/3760991793 >> 172.21.15.146:0/3760991793 conn(0x7fc074099c40 msgr2=0x7fc0740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.479+0000 7fc07c7f5700 1 -- 172.21.15.146:0/3760991793 shutdown_connections 2023-10-03T10:17:00.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.479+0000 7fc07c7f5700 1 -- 172.21.15.146:0/3760991793 wait complete. 2023-10-03T10:17:00.481 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:00.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.480+0000 7fc07c7f5700 1 Processor -- start 2023-10-03T10:17:00.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.480+0000 7fc07c7f5700 1 -- start start 2023-10-03T10:17:00.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.481+0000 7fc07c7f5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0741300a0 0x7fc0740713b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.481+0000 7fc07c7f5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc074130bc0 0x7fc0740718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.481+0000 7fc07c7f5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc074133ad0 0x7fc074071e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.481+0000 7fc07c7f5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07411fec0 con 0x7fc074130bc0 2023-10-03T10:17:00.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.481+0000 7fc07c7f5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07411ee60 con 0x7fc074133ad0 2023-10-03T10:17:00.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.481+0000 7fc07c7f5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc07412f680 con 0x7fc0741300a0 2023-10-03T10:17:00.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.481+0000 7fc07a591700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0741300a0 0x7fc0740713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.481+0000 7fc07a591700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0741300a0 0x7fc0740713b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56094/0 (socket says 172.21.15.146:56094) 2023-10-03T10:17:00.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.481+0000 7fc07a591700 1 -- 172.21.15.146:0/453080766 learned_addr learned my addr 172.21.15.146:0/453080766 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:00.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.481+0000 7fc07ad92700 1 --2- 172.21.15.146:0/453080766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc074133ad0 0x7fc074071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.481+0000 7fc079d90700 1 --2- 172.21.15.146:0/453080766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc074130bc0 0x7fc0740718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.481+0000 7fc07ad92700 1 -- 172.21.15.146:0/453080766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0741300a0 msgr2=0x7fc0740713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.481+0000 7fc07ad92700 1 --2- 172.21.15.146:0/453080766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0741300a0 0x7fc0740713b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.481+0000 7fc07ad92700 1 -- 172.21.15.146:0/453080766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc074130bc0 msgr2=0x7fc0740718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.481+0000 7fc07ad92700 1 --2- 172.21.15.146:0/453080766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc074130bc0 0x7fc0740718f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.481+0000 7fc07ad92700 1 -- 172.21.15.146:0/453080766 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06c009a70 con 0x7fc074133ad0 2023-10-03T10:17:00.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.481+0000 7fc07a591700 1 --2- 172.21.15.146:0/453080766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0741300a0 0x7fc0740713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:00.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.482+0000 7fc07ad92700 1 --2- 172.21.15.146:0/453080766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc074133ad0 0x7fc074071e30 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc06c016000 tx=0x7fc06c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.482+0000 7fc06affd700 1 -- 172.21.15.146:0/453080766 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c012430 con 0x7fc074133ad0 2023-10-03T10:17:00.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.482+0000 7fc06affd700 1 -- 172.21.15.146:0/453080766 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c020070 con 0x7fc074133ad0 2023-10-03T10:17:00.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.482+0000 7fc06affd700 1 -- 172.21.15.146:0/453080766 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c004280 con 0x7fc074133ad0 2023-10-03T10:17:00.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.482+0000 7fc07c7f5700 1 -- 172.21.15.146:0/453080766 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07411f6b0 con 0x7fc074133ad0 2023-10-03T10:17:00.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.482+0000 7fc07c7f5700 1 -- 172.21.15.146:0/453080766 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07411dfb0 con 0x7fc074133ad0 2023-10-03T10:17:00.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.483+0000 7fc06affd700 1 -- 172.21.15.146:0/453080766 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc06c0043e0 con 0x7fc074133ad0 2023-10-03T10:17:00.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.483+0000 7fc07c7f5700 1 -- 172.21.15.146:0/453080766 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc07409cb20 con 0x7fc074133ad0 2023-10-03T10:17:00.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.484+0000 7fc06affd700 1 -- 172.21.15.146:0/453080766 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc06c022070 con 0x7fc074133ad0 2023-10-03T10:17:00.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.490+0000 7fc06affd700 1 -- 172.21.15.146:0/453080766 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc06c0269d0 con 0x7fc074133ad0 2023-10-03T10:17:00.520 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.610+0000 7f94051f7700 1 Processor -- start 2023-10-03T10:17:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.610+0000 7f94051f7700 1 -- start start 2023-10-03T10:17:00.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.611+0000 7f94051f7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f940006a770 0x7f940006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.611+0000 7f94051f7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9400131ec0 0x7f9400139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.611+0000 7f94051f7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f940009da80 con 0x7f940006b080 2023-10-03T10:17:00.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.611+0000 7f94051f7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940009dce0 con 0x7f9400131ec0 2023-10-03T10:17:00.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.611+0000 7f94051f7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f940009eb20 con 0x7f940006a770 2023-10-03T10:17:00.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.611+0000 7f93fed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f940006a770 0x7f940006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.611+0000 7f93fe59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f940006b080 0x7f94001317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44108/0 (socket says 172.21.15.146:44108) 2023-10-03T10:17:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.611+0000 7f93fe59c700 1 -- 172.21.15.146:0/1504059034 learned_addr learned my addr 172.21.15.146:0/1504059034 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.611+0000 7f93ff59e700 1 --2- 172.21.15.146:0/1504059034 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9400131ec0 0x7f9400139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.611+0000 7f93fdd9b700 1 -- 172.21.15.146:0/1504059034 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247328517 0 0) 0x7f940009da80 con 0x7f940006b080 2023-10-03T10:17:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.611+0000 7f93fdd9b700 1 -- 172.21.15.146:0/1504059034 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93e80035b0 con 0x7f940006b080 2023-10-03T10:17:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.611+0000 7f93fed9d700 1 -- 172.21.15.146:0/1504059034 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9400131ec0 msgr2=0x7f9400139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.611+0000 7f93fed9d700 1 --2- 172.21.15.146:0/1504059034 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9400131ec0 0x7f9400139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.611+0000 7f93fed9d700 1 -- 172.21.15.146:0/1504059034 >> v1:172.21.15.146:6789/0 conn(0x7f940006b080 legacy=0x7f94001317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.611+0000 7f93fed9d700 1 -- 172.21.15.146:0/1504059034 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940009d860 con 0x7f940006a770 2023-10-03T10:17:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.612+0000 7f93fed9d700 1 --2- 172.21.15.146:0/1504059034 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f940006a770 0x7f940006ab40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f93f0009870 tx=0x7f93f0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e03666eca68c64d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.612+0000 7f93fdd9b700 1 -- 172.21.15.146:0/1504059034 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f0011830 con 0x7f940006a770 2023-10-03T10:17:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.612+0000 7f93fdd9b700 1 -- 172.21.15.146:0/1504059034 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f0011990 con 0x7f940006a770 2023-10-03T10:17:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.612+0000 7f93fdd9b700 1 -- 172.21.15.146:0/1504059034 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f0011d20 con 0x7f940006a770 2023-10-03T10:17:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.612+0000 7f94051f7700 1 -- 172.21.15.146:0/1504059034 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f940006a770 msgr2=0x7f940006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.612+0000 7f94051f7700 1 --2- 172.21.15.146:0/1504059034 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f940006a770 0x7f940006ab40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f93f0009870 tx=0x7f93f0009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:00.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.612+0000 7f94051f7700 1 -- 172.21.15.146:0/1504059034 shutdown_connections 2023-10-03T10:17:00.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.612+0000 7f94051f7700 1 --2- 172.21.15.146:0/1504059034 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9400131ec0 0x7f9400139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.612+0000 7f94051f7700 1 --2- 172.21.15.146:0/1504059034 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f940006a770 0x7f940006ab40 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.612+0000 7f94051f7700 1 -- 172.21.15.146:0/1504059034 >> 172.21.15.146:0/1504059034 conn(0x7f9400099c40 msgr2=0x7f94000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:00.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.612+0000 7f94051f7700 1 -- 172.21.15.146:0/1504059034 shutdown_connections 2023-10-03T10:17:00.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.612+0000 7f94051f7700 1 -- 172.21.15.146:0/1504059034 wait complete. 2023-10-03T10:17:00.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.614+0000 7f94051f7700 1 Processor -- start 2023-10-03T10:17:00.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.614+0000 7f94051f7700 1 -- start start 2023-10-03T10:17:00.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.614+0000 7f94051f7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f940006a770 0x7f940011d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.614+0000 7f94051f7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f940006b080 0x7f940011d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.614+0000 7f94051f7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9400131ec0 0x7f94001c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.614+0000 7f94051f7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9400120130 con 0x7f940006b080 2023-10-03T10:17:00.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.614+0000 7f94051f7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9400131180 con 0x7f940006a770 2023-10-03T10:17:00.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.614+0000 7f94051f7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f940011ccb0 con 0x7f9400131ec0 2023-10-03T10:17:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.614+0000 7f93fe59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f940006b080 0x7f940011d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.614+0000 7f93fed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f940006a770 0x7f940011d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.614+0000 7f93fe59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f940006b080 0x7f940011d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60904/0 (socket says 172.21.15.146:60904) 2023-10-03T10:17:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.614+0000 7f93fe59c700 1 -- 172.21.15.146:0/4274039166 learned_addr learned my addr 172.21.15.146:0/4274039166 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.614+0000 7f93ff59e700 1 --2- 172.21.15.146:0/4274039166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9400131ec0 0x7f94001c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.615+0000 7f93fed9d700 1 -- 172.21.15.146:0/4274039166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9400131ec0 msgr2=0x7f94001c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.615+0000 7f93fed9d700 1 --2- 172.21.15.146:0/4274039166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9400131ec0 0x7f94001c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.615+0000 7f93fed9d700 1 -- 172.21.15.146:0/4274039166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f940006b080 msgr2=0x7f940011d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.615+0000 7f93fed9d700 1 --2- 172.21.15.146:0/4274039166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f940006b080 0x7f940011d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.615+0000 7f93fed9d700 1 -- 172.21.15.146:0/4274039166 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f00094a0 con 0x7f940006a770 2023-10-03T10:17:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.615+0000 7f93fe59c700 1 --2- 172.21.15.146:0/4274039166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f940006b080 0x7f940011d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:00.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.615+0000 7f93fed9d700 1 --2- 172.21.15.146:0/4274039166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f940006a770 0x7f940011d250 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f93f0016000 tx=0x7f93f0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.615+0000 7f93e77fe700 1 -- 172.21.15.146:0/4274039166 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f0004240 con 0x7f940006a770 2023-10-03T10:17:00.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.615+0000 7f93e77fe700 1 -- 172.21.15.146:0/4274039166 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f0023070 con 0x7f940006a770 2023-10-03T10:17:00.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.615+0000 7f93e77fe700 1 -- 172.21.15.146:0/4274039166 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f00045e0 con 0x7f940006a770 2023-10-03T10:17:00.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.615+0000 7f94051f7700 1 -- 172.21.15.146:0/4274039166 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f940011e970 con 0x7f940006a770 2023-10-03T10:17:00.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.615+0000 7f94051f7700 1 -- 172.21.15.146:0/4274039166 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f940011e400 con 0x7f940006a770 2023-10-03T10:17:00.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.616+0000 7f94051f7700 1 -- 172.21.15.146:0/4274039166 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f940011dcd0 con 0x7f940006a770 2023-10-03T10:17:00.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.616+0000 7f93e77fe700 1 -- 172.21.15.146:0/4274039166 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f93f0025030 con 0x7f940006a770 2023-10-03T10:17:00.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.616+0000 7f93e77fe700 1 -- 172.21.15.146:0/4274039166 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f93f0044d50 con 0x7f940006a770 2023-10-03T10:17:00.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.621+0000 7f93e77fe700 1 -- 172.21.15.146:0/4274039166 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f93f0010380 con 0x7f940006a770 2023-10-03T10:17:00.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.647+0000 7fe150303700 1 Processor -- start 2023-10-03T10:17:00.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.647+0000 7fe150303700 1 -- start start 2023-10-03T10:17:00.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.648+0000 7fe150303700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe14809e870 0x7fe14809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.648+0000 7fe150303700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe148134330 0x7fe14813be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.648+0000 7fe150303700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14809fa00 con 0x7fe14809f180 2023-10-03T10:17:00.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.648+0000 7fe150303700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1480a0370 con 0x7fe14809e870 2023-10-03T10:17:00.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.648+0000 7fe150303700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe14806bec0 con 0x7fe148134330 2023-10-03T10:17:00.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.648+0000 7fe14e8a0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe148134330 0x7fe14813be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.648+0000 7fe14d89e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe14809f180 0x7fe148133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44120/0 (socket says 172.21.15.146:44120) 2023-10-03T10:17:00.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.648+0000 7fe14d89e700 1 -- 172.21.15.146:0/3615435515 learned_addr learned my addr 172.21.15.146:0/3615435515 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:00.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.648+0000 7fe14e09f700 1 --2- 172.21.15.146:0/3615435515 >> v2:172.21.15.146:3300/0 conn(0x7fe14809e870 0x7fe14809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.648+0000 7fe14e8a0700 1 -- 172.21.15.146:0/3615435515 >> v2:172.21.15.146:3300/0 conn(0x7fe14809e870 msgr2=0x7fe14809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:00.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.648+0000 7fe14e8a0700 1 --2- 172.21.15.146:0/3615435515 >> v2:172.21.15.146:3300/0 conn(0x7fe14809e870 0x7fe14809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.648+0000 7fe14e8a0700 1 -- 172.21.15.146:0/3615435515 >> v1:172.21.15.146:6789/0 conn(0x7fe14809f180 legacy=0x7fe148133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.648+0000 7fe14e8a0700 1 -- 172.21.15.146:0/3615435515 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14809ada0 con 0x7fe148134330 2023-10-03T10:17:00.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.648+0000 7fe14e8a0700 1 --2- 172.21.15.146:0/3615435515 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe148134330 0x7fe14813be80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe140009d90 tx=0x7fe14000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f040a24b85bf54e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.648+0000 7fe14d09d700 1 -- 172.21.15.146:0/3615435515 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14000e070 con 0x7fe148134330 2023-10-03T10:17:00.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.649+0000 7fe14d09d700 1 -- 172.21.15.146:0/3615435515 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14000bb20 con 0x7fe148134330 2023-10-03T10:17:00.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.649+0000 7fe14d09d700 1 -- 172.21.15.146:0/3615435515 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe140012430 con 0x7fe148134330 2023-10-03T10:17:00.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.649+0000 7fe150303700 1 -- 172.21.15.146:0/3615435515 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe148134330 msgr2=0x7fe14813be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.649+0000 7fe150303700 1 --2- 172.21.15.146:0/3615435515 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe148134330 0x7fe14813be80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe140009d90 tx=0x7fe14000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:00.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.649+0000 7fe150303700 1 -- 172.21.15.146:0/3615435515 shutdown_connections 2023-10-03T10:17:00.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.649+0000 7fe150303700 1 --2- 172.21.15.146:0/3615435515 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe148134330 0x7fe14813be80 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.649+0000 7fe150303700 1 --2- 172.21.15.146:0/3615435515 >> v2:172.21.15.146:3300/0 conn(0x7fe14809e870 0x7fe14809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.649+0000 7fe150303700 1 -- 172.21.15.146:0/3615435515 >> 172.21.15.146:0/3615435515 conn(0x7fe1480a4430 msgr2=0x7fe1480a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:00.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.649+0000 7fe150303700 1 -- 172.21.15.146:0/3615435515 shutdown_connections 2023-10-03T10:17:00.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.649+0000 7fe150303700 1 -- 172.21.15.146:0/3615435515 wait complete. 2023-10-03T10:17:00.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.650+0000 7fe150303700 1 Processor -- start 2023-10-03T10:17:00.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.650+0000 7fe150303700 1 -- start start 2023-10-03T10:17:00.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.651+0000 7fe150303700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe14809e870 0x7fe1481229c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.651+0000 7fe150303700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe14809f180 0x7fe148122f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.651+0000 7fe150303700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe148134330 0x7fe148123440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.651+0000 7fe150303700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe148133540 con 0x7fe14809e870 2023-10-03T10:17:00.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.651+0000 7fe150303700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe148124580 con 0x7fe14809f180 2023-10-03T10:17:00.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.651+0000 7fe150303700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe148123e20 con 0x7fe148134330 2023-10-03T10:17:00.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.651+0000 7fe14e09f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe14809e870 0x7fe1481229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.651+0000 7fe14d89e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe14809f180 0x7fe148122f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.651+0000 7fe14e09f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe14809e870 0x7fe1481229c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60910/0 (socket says 172.21.15.146:60910) 2023-10-03T10:17:00.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.651+0000 7fe14e09f700 1 -- 172.21.15.146:0/3978988815 learned_addr learned my addr 172.21.15.146:0/3978988815 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:00.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.651+0000 7fe14e8a0700 1 --2- 172.21.15.146:0/3978988815 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe148134330 0x7fe148123440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.652+0000 7fe14e09f700 1 -- 172.21.15.146:0/3978988815 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe148134330 msgr2=0x7fe148123440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.652+0000 7fe14e09f700 1 --2- 172.21.15.146:0/3978988815 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe148134330 0x7fe148123440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.652+0000 7fe14e09f700 1 -- 172.21.15.146:0/3978988815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe14809f180 msgr2=0x7fe148122f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.652+0000 7fe14e09f700 1 --2- 172.21.15.146:0/3978988815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe14809f180 0x7fe148122f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.652+0000 7fe14e09f700 1 -- 172.21.15.146:0/3978988815 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe140009a70 con 0x7fe14809e870 2023-10-03T10:17:00.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.652+0000 7fe14e8a0700 1 --2- 172.21.15.146:0/3978988815 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe148134330 0x7fe148123440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:00.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.652+0000 7fe14d89e700 1 --2- 172.21.15.146:0/3978988815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe14809f180 0x7fe148122f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:00.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.652+0000 7fe14e09f700 1 --2- 172.21.15.146:0/3978988815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe14809e870 0x7fe1481229c0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fe14400e9b0 tx=0x7fe14400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.652+0000 7fe13effd700 1 -- 172.21.15.146:0/3978988815 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe144009710 con 0x7fe14809e870 2023-10-03T10:17:00.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.652+0000 7fe13effd700 1 -- 172.21.15.146:0/3978988815 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14400c850 con 0x7fe14809e870 2023-10-03T10:17:00.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.652+0000 7fe150303700 1 -- 172.21.15.146:0/3978988815 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe148126490 con 0x7fe14809e870 2023-10-03T10:17:00.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.652+0000 7fe13effd700 1 -- 172.21.15.146:0/3978988815 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14400cbc0 con 0x7fe14809e870 2023-10-03T10:17:00.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.652+0000 7fe150303700 1 -- 172.21.15.146:0/3978988815 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14806cfa0 con 0x7fe14809e870 2023-10-03T10:17:00.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.653+0000 7fe13effd700 1 -- 172.21.15.146:0/3978988815 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe14400cd20 con 0x7fe14809e870 2023-10-03T10:17:00.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.653+0000 7fe150303700 1 -- 172.21.15.146:0/3978988815 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1481338c0 con 0x7fe14809e870 2023-10-03T10:17:00.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.653+0000 7fe13effd700 1 -- 172.21.15.146:0/3978988815 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe14403f780 con 0x7fe14809e870 2023-10-03T10:17:00.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.658+0000 7fe13effd700 1 -- 172.21.15.146:0/3978988815 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe144021080 con 0x7fe14809e870 2023-10-03T10:17:00.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.685+0000 7fc07c7f5700 1 -- 172.21.15.146:0/453080766 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc07411f200 con 0x7fc074133ad0 2023-10-03T10:17:00.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.686+0000 7fc06affd700 1 -- 172.21.15.146:0/453080766 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc06c02c070 con 0x7fc074133ad0 2023-10-03T10:17:00.686 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:00.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.688+0000 7fc07c7f5700 1 -- 172.21.15.146:0/453080766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc074133ad0 msgr2=0x7fc074071e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.688+0000 7fc07c7f5700 1 --2- 172.21.15.146:0/453080766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc074133ad0 0x7fc074071e30 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc06c016000 tx=0x7fc06c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.688+0000 7fc07c7f5700 1 -- 172.21.15.146:0/453080766 shutdown_connections 2023-10-03T10:17:00.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.688+0000 7fc07c7f5700 1 --2- 172.21.15.146:0/453080766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc074133ad0 0x7fc074071e30 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.688+0000 7fc07c7f5700 1 --2- 172.21.15.146:0/453080766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0741300a0 0x7fc0740713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.688+0000 7fc07c7f5700 1 --2- 172.21.15.146:0/453080766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc074130bc0 0x7fc0740718f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.688+0000 7fc07c7f5700 1 -- 172.21.15.146:0/453080766 >> 172.21.15.146:0/453080766 conn(0x7fc074099c40 msgr2=0x7fc074132a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:00.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.688+0000 7fc07c7f5700 1 -- 172.21.15.146:0/453080766 shutdown_connections 2023-10-03T10:17:00.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.688+0000 7fc07c7f5700 1 -- 172.21.15.146:0/453080766 wait complete. 2023-10-03T10:17:00.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:00.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.816+0000 7f94051f7700 1 -- 172.21.15.146:0/4274039166 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f940004f2a0 con 0x7f940006a770 2023-10-03T10:17:00.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.816+0000 7f93e77fe700 1 -- 172.21.15.146:0/4274039166 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f93f0015030 con 0x7f940006a770 2023-10-03T10:17:00.816 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:00.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.819+0000 7f94051f7700 1 -- 172.21.15.146:0/4274039166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f940006a770 msgr2=0x7f940011d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.819+0000 7f94051f7700 1 --2- 172.21.15.146:0/4274039166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f940006a770 0x7f940011d250 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f93f0016000 tx=0x7f93f0004750 comp rx=0 tx=0).stop 2023-10-03T10:17:00.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.819+0000 7f94051f7700 1 -- 172.21.15.146:0/4274039166 shutdown_connections 2023-10-03T10:17:00.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.819+0000 7f94051f7700 1 --2- 172.21.15.146:0/4274039166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9400131ec0 0x7f94001c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.819+0000 7f94051f7700 1 --2- 172.21.15.146:0/4274039166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f940006a770 0x7f940011d250 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.819+0000 7f94051f7700 1 --2- 172.21.15.146:0/4274039166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f940006b080 0x7f940011d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.819+0000 7f94051f7700 1 -- 172.21.15.146:0/4274039166 >> 172.21.15.146:0/4274039166 conn(0x7f9400099c40 msgr2=0x7f94001b9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:00.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.819+0000 7f94051f7700 1 -- 172.21.15.146:0/4274039166 shutdown_connections 2023-10-03T10:17:00.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.819+0000 7f94051f7700 1 -- 172.21.15.146:0/4274039166 wait complete. 2023-10-03T10:17:00.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:00.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.853+0000 7fe150303700 1 -- 172.21.15.146:0/3978988815 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe14804f2a0 con 0x7fe14809e870 2023-10-03T10:17:00.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.853+0000 7fe13effd700 1 -- 172.21.15.146:0/3978988815 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe144017020 con 0x7fe14809e870 2023-10-03T10:17:00.853 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:00.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.855+0000 7fe150303700 1 -- 172.21.15.146:0/3978988815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe14809e870 msgr2=0x7fe1481229c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.855+0000 7fe150303700 1 --2- 172.21.15.146:0/3978988815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe14809e870 0x7fe1481229c0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fe14400e9b0 tx=0x7fe14400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.855+0000 7fe150303700 1 -- 172.21.15.146:0/3978988815 shutdown_connections 2023-10-03T10:17:00.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.855+0000 7fe150303700 1 --2- 172.21.15.146:0/3978988815 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe148134330 0x7fe148123440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.855+0000 7fe150303700 1 --2- 172.21.15.146:0/3978988815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe14809e870 0x7fe1481229c0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.855+0000 7fe150303700 1 --2- 172.21.15.146:0/3978988815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe14809f180 0x7fe148122f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.855+0000 7fe150303700 1 -- 172.21.15.146:0/3978988815 >> 172.21.15.146:0/3978988815 conn(0x7fe1480a4430 msgr2=0x7fe1480a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.855+0000 7fe150303700 1 -- 172.21.15.146:0/3978988815 shutdown_connections 2023-10-03T10:17:00.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:00.855+0000 7fe150303700 1 -- 172.21.15.146:0/3978988815 wait complete. 2023-10-03T10:17:00.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:01.115 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:01.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.240+0000 7f38337b0700 1 Processor -- start 2023-10-03T10:17:01.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.240+0000 7f38337b0700 1 -- start start 2023-10-03T10:17:01.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.240+0000 7f38337b0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f382c09d860 0x7f382c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.240+0000 7f38337b0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f382c130eb0 0x7f382c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.240+0000 7f38337b0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382c09aaa0 con 0x7f382c09e170 2023-10-03T10:17:01.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.240+0000 7f38337b0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382c09f870 con 0x7f382c130eb0 2023-10-03T10:17:01.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.240+0000 7f38337b0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f382c09b360 con 0x7f382c09d860 2023-10-03T10:17:01.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.241+0000 7f3831d4d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f382c130eb0 0x7f382c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.241+0000 7f383154c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f382c09d860 0x7f382c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.241+0000 7f3831d4d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f382c130eb0 0x7f382c138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60916/0 (socket says 172.21.15.146:60916) 2023-10-03T10:17:01.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.241+0000 7f3831d4d700 1 -- 172.21.15.146:0/3357933742 learned_addr learned my addr 172.21.15.146:0/3357933742 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:01.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.241+0000 7f3830d4b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f382c09e170 0x7f382c1307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44134/0 (socket says 172.21.15.146:44134) 2023-10-03T10:17:01.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.241+0000 7f3831d4d700 1 -- 172.21.15.146:0/3357933742 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f382c09d860 msgr2=0x7f382c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:01.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.241+0000 7f3831d4d700 1 --2- 172.21.15.146:0/3357933742 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f382c09d860 0x7f382c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.241+0000 7f3831d4d700 1 -- 172.21.15.146:0/3357933742 >> v1:172.21.15.146:6789/0 conn(0x7f382c09e170 legacy=0x7f382c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.241+0000 7f3831d4d700 1 -- 172.21.15.146:0/3357933742 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c09b620 con 0x7f382c130eb0 2023-10-03T10:17:01.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.241+0000 7f383154c700 1 --2- 172.21.15.146:0/3357933742 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f382c09d860 0x7f382c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:01.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.241+0000 7f3831d4d700 1 --2- 172.21.15.146:0/3357933742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f382c130eb0 0x7f382c138a00 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f3824009e50 tx=0x7f382400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48462b684c8014cb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.241+0000 7f3823fff700 1 -- 172.21.15.146:0/3357933742 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382400e070 con 0x7f382c130eb0 2023-10-03T10:17:01.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.241+0000 7f3823fff700 1 -- 172.21.15.146:0/3357933742 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382400b910 con 0x7f382c130eb0 2023-10-03T10:17:01.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.241+0000 7f3823fff700 1 -- 172.21.15.146:0/3357933742 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382400bcc0 con 0x7f382c130eb0 2023-10-03T10:17:01.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.242+0000 7f38337b0700 1 -- 172.21.15.146:0/3357933742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f382c130eb0 msgr2=0x7f382c138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.242+0000 7f38337b0700 1 --2- 172.21.15.146:0/3357933742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f382c130eb0 0x7f382c138a00 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f3824009e50 tx=0x7f382400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:01.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.242+0000 7f38337b0700 1 -- 172.21.15.146:0/3357933742 shutdown_connections 2023-10-03T10:17:01.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.242+0000 7f38337b0700 1 --2- 172.21.15.146:0/3357933742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f382c130eb0 0x7f382c138a00 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.242+0000 7f38337b0700 1 --2- 172.21.15.146:0/3357933742 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f382c09d860 0x7f382c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.242+0000 7f38337b0700 1 -- 172.21.15.146:0/3357933742 >> 172.21.15.146:0/3357933742 conn(0x7f382c099c40 msgr2=0x7f382c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.242+0000 7f38337b0700 1 -- 172.21.15.146:0/3357933742 shutdown_connections 2023-10-03T10:17:01.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.242+0000 7f38337b0700 1 -- 172.21.15.146:0/3357933742 wait complete. 2023-10-03T10:17:01.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.243+0000 7f38337b0700 1 Processor -- start 2023-10-03T10:17:01.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.243+0000 7f38337b0700 1 -- start start 2023-10-03T10:17:01.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.243+0000 7f38337b0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f382c09d860 0x7f382c123120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.243+0000 7f38337b0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f382c09e170 0x7f382c123660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.243+0000 7f38337b0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f382c130eb0 0x7f382c1c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.243+0000 7f38337b0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0a2100 con 0x7f382c130eb0 2023-10-03T10:17:01.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.243+0000 7f38337b0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c09c8b0 con 0x7f382c09d860 2023-10-03T10:17:01.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.243+0000 7f38337b0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f382c125e40 con 0x7f382c09e170 2023-10-03T10:17:01.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.243+0000 7f383154c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f382c09d860 0x7f382c123120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.243+0000 7f3830d4b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f382c09e170 0x7f382c123660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.243+0000 7f383154c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f382c09d860 0x7f382c123120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55802/0 (socket says 172.21.15.146:55802) 2023-10-03T10:17:01.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.243+0000 7f383154c700 1 -- 172.21.15.146:0/3649441764 learned_addr learned my addr 172.21.15.146:0/3649441764 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:01.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.243+0000 7f3831d4d700 1 --2- 172.21.15.146:0/3649441764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f382c130eb0 0x7f382c1c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.244+0000 7f383154c700 1 -- 172.21.15.146:0/3649441764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f382c09e170 msgr2=0x7f382c123660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.244+0000 7f383154c700 1 --2- 172.21.15.146:0/3649441764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f382c09e170 0x7f382c123660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.244+0000 7f383154c700 1 -- 172.21.15.146:0/3649441764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f382c130eb0 msgr2=0x7f382c1c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.244+0000 7f383154c700 1 --2- 172.21.15.146:0/3649441764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f382c130eb0 0x7f382c1c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.244+0000 7f383154c700 1 -- 172.21.15.146:0/3649441764 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38280094a0 con 0x7f382c09d860 2023-10-03T10:17:01.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.244+0000 7f3831d4d700 1 --2- 172.21.15.146:0/3649441764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f382c130eb0 0x7f382c1c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:01.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.244+0000 7f3830d4b700 1 --2- 172.21.15.146:0/3649441764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f382c09e170 0x7f382c123660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:01.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.244+0000 7f383154c700 1 --2- 172.21.15.146:0/3649441764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f382c09d860 0x7f382c123120 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f382800ebe0 tx=0x7f382800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.244+0000 7f3821ffb700 1 -- 172.21.15.146:0/3649441764 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382800c850 con 0x7f382c09d860 2023-10-03T10:17:01.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.244+0000 7f3821ffb700 1 -- 172.21.15.146:0/3649441764 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382800c9b0 con 0x7f382c09d860 2023-10-03T10:17:01.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.244+0000 7f3821ffb700 1 -- 172.21.15.146:0/3649441764 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382800cd40 con 0x7f382c09d860 2023-10-03T10:17:01.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.244+0000 7f38337b0700 1 -- 172.21.15.146:0/3649441764 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3824009b30 con 0x7f382c09d860 2023-10-03T10:17:01.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.244+0000 7f38337b0700 1 -- 172.21.15.146:0/3649441764 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382c125140 con 0x7f382c09d860 2023-10-03T10:17:01.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.245+0000 7f3821ffb700 1 -- 172.21.15.146:0/3649441764 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3828013470 con 0x7f382c09d860 2023-10-03T10:17:01.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.245+0000 7f3821ffb700 1 -- 172.21.15.146:0/3649441764 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f382803fb00 con 0x7f382c09d860 2023-10-03T10:17:01.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.245+0000 7f38337b0700 1 -- 172.21.15.146:0/3649441764 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382c126000 con 0x7f382c09d860 2023-10-03T10:17:01.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.249+0000 7f3821ffb700 1 -- 172.21.15.146:0/3649441764 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3828013720 con 0x7f382c09d860 2023-10-03T10:17:01.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.434+0000 7f38337b0700 1 -- 172.21.15.146:0/3649441764 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f382c04f2a0 con 0x7f382c09d860 2023-10-03T10:17:01.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.434+0000 7f3821ffb700 1 -- 172.21.15.146:0/3649441764 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3828017020 con 0x7f382c09d860 2023-10-03T10:17:01.434 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:01.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.436+0000 7f38337b0700 1 -- 172.21.15.146:0/3649441764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f382c09d860 msgr2=0x7f382c123120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.436+0000 7f38337b0700 1 --2- 172.21.15.146:0/3649441764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f382c09d860 0x7f382c123120 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f382800ebe0 tx=0x7f382800eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.436+0000 7f38337b0700 1 -- 172.21.15.146:0/3649441764 shutdown_connections 2023-10-03T10:17:01.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.436+0000 7f38337b0700 1 --2- 172.21.15.146:0/3649441764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f382c130eb0 0x7f382c1c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.436+0000 7f38337b0700 1 --2- 172.21.15.146:0/3649441764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f382c09d860 0x7f382c123120 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.436+0000 7f38337b0700 1 --2- 172.21.15.146:0/3649441764 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f382c09e170 0x7f382c123660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.436+0000 7f38337b0700 1 -- 172.21.15.146:0/3649441764 >> 172.21.15.146:0/3649441764 conn(0x7f382c099c40 msgr2=0x7f382c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.436+0000 7f38337b0700 1 -- 172.21.15.146:0/3649441764 shutdown_connections 2023-10-03T10:17:01.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.436+0000 7f38337b0700 1 -- 172.21.15.146:0/3649441764 wait complete. 2023-10-03T10:17:01.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:01.702 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:01.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.828+0000 7fdf31164700 1 Processor -- start 2023-10-03T10:17:01.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.828+0000 7fdf31164700 1 -- start start 2023-10-03T10:17:01.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.828+0000 7fdf31164700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf2c1347b0 0x7fdf2c136b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.828+0000 7fdf31164700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdf2c1370d0 0x7fdf2c1394b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.828+0000 7fdf31164700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2c06f970 con 0x7fdf2c098410 2023-10-03T10:17:01.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.828+0000 7fdf31164700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2c0720a0 con 0x7fdf2c1370d0 2023-10-03T10:17:01.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.828+0000 7fdf31164700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c098ef0 con 0x7fdf2c1347b0 2023-10-03T10:17:01.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.829+0000 7fdf2b59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdf2c1370d0 0x7fdf2c1394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.829+0000 7fdf2a59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf2c1347b0 0x7fdf2c136b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.829+0000 7fdf2b59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdf2c1370d0 0x7fdf2c1394b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60926/0 (socket says 172.21.15.146:60926) 2023-10-03T10:17:01.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.829+0000 7fdf2a59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf2c1347b0 0x7fdf2c136b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56160/0 (socket says 172.21.15.146:56160) 2023-10-03T10:17:01.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.829+0000 7fdf2b59e700 1 -- 172.21.15.146:0/1072177404 learned_addr learned my addr 172.21.15.146:0/1072177404 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:01.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.829+0000 7fdf2b59e700 1 -- 172.21.15.146:0/1072177404 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf2c1347b0 msgr2=0x7fdf2c136b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:01.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.829+0000 7fdf2b59e700 1 --2- 172.21.15.146:0/1072177404 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf2c1347b0 0x7fdf2c136b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.829+0000 7fdf2b59e700 1 -- 172.21.15.146:0/1072177404 >> v1:172.21.15.146:6789/0 conn(0x7fdf2c098410 legacy=0x7fdf2c0987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.829+0000 7fdf2b59e700 1 -- 172.21.15.146:0/1072177404 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c072290 con 0x7fdf2c1370d0 2023-10-03T10:17:01.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.829+0000 7fdf29d9b700 1 -- 172.21.15.146:0/1072177404 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280065663 0 0) 0x7fdf2c06f970 con 0x7fdf2c098410 2023-10-03T10:17:01.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.829+0000 7fdf2a59c700 1 --2- 172.21.15.146:0/1072177404 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf2c1347b0 0x7fdf2c136b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:01.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.829+0000 7fdf2b59e700 1 --2- 172.21.15.146:0/1072177404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf2c1370d0 0x7fdf2c1394b0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fdf24009e50 tx=0x7fdf2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f56991f7f90310 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.829+0000 7fdf29d9b700 1 -- 172.21.15.146:0/1072177404 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2400e070 con 0x7fdf2c1370d0 2023-10-03T10:17:01.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.829+0000 7fdf29d9b700 1 -- 172.21.15.146:0/1072177404 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2400b910 con 0x7fdf2c1370d0 2023-10-03T10:17:01.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.829+0000 7fdf29d9b700 1 -- 172.21.15.146:0/1072177404 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2400bcc0 con 0x7fdf2c1370d0 2023-10-03T10:17:01.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.830+0000 7fdf31164700 1 -- 172.21.15.146:0/1072177404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf2c1370d0 msgr2=0x7fdf2c1394b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.830+0000 7fdf31164700 1 --2- 172.21.15.146:0/1072177404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf2c1370d0 0x7fdf2c1394b0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fdf24009e50 tx=0x7fdf2400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:01.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.830+0000 7fdf31164700 1 -- 172.21.15.146:0/1072177404 shutdown_connections 2023-10-03T10:17:01.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.830+0000 7fdf31164700 1 --2- 172.21.15.146:0/1072177404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf2c1370d0 0x7fdf2c1394b0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.830+0000 7fdf31164700 1 --2- 172.21.15.146:0/1072177404 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf2c1347b0 0x7fdf2c136b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.830+0000 7fdf31164700 1 -- 172.21.15.146:0/1072177404 >> 172.21.15.146:0/1072177404 conn(0x7fdf2c0a2b30 msgr2=0x7fdf2c09e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.830+0000 7fdf31164700 1 -- 172.21.15.146:0/1072177404 shutdown_connections 2023-10-03T10:17:01.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.830+0000 7fdf31164700 1 -- 172.21.15.146:0/1072177404 wait complete. 2023-10-03T10:17:01.832 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:01.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.832+0000 7fdf31164700 1 Processor -- start 2023-10-03T10:17:01.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.832+0000 7fdf31164700 1 -- start start 2023-10-03T10:17:01.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.832+0000 7fdf31164700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf2c098410 0x7fdf2c12e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.832+0000 7fdf31164700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf2c1347b0 0x7fdf2c12e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.832+0000 7fdf31164700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf2c1370d0 0x7fdf2c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.832+0000 7fdf31164700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c09b6b0 con 0x7fdf2c1347b0 2023-10-03T10:17:01.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.832+0000 7fdf31164700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c09c450 con 0x7fdf2c098410 2023-10-03T10:17:01.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.832+0000 7fdf31164700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c09a420 con 0x7fdf2c1370d0 2023-10-03T10:17:01.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.833+0000 7fdf2a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf2c1347b0 0x7fdf2c12e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.833+0000 7fdf2a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf2c1347b0 0x7fdf2c12e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60930/0 (socket says 172.21.15.146:60930) 2023-10-03T10:17:01.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.833+0000 7fdf2b59e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf2c1370d0 0x7fdf2c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.833+0000 7fdf2a59c700 1 -- 172.21.15.146:0/3195446580 learned_addr learned my addr 172.21.15.146:0/3195446580 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:01.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.833+0000 7fdf2ad9d700 1 --2- 172.21.15.146:0/3195446580 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf2c098410 0x7fdf2c12e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.833+0000 7fdf2b59e700 1 -- 172.21.15.146:0/3195446580 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf2c098410 msgr2=0x7fdf2c12e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.833+0000 7fdf2b59e700 1 --2- 172.21.15.146:0/3195446580 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf2c098410 0x7fdf2c12e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.833+0000 7fdf2b59e700 1 -- 172.21.15.146:0/3195446580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf2c1347b0 msgr2=0x7fdf2c12e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.833+0000 7fdf2b59e700 1 --2- 172.21.15.146:0/3195446580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf2c1347b0 0x7fdf2c12e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.833+0000 7fdf2b59e700 1 -- 172.21.15.146:0/3195446580 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1c0094a0 con 0x7fdf2c1370d0 2023-10-03T10:17:01.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.833+0000 7fdf2a59c700 1 --2- 172.21.15.146:0/3195446580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf2c1347b0 0x7fdf2c12e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:01.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.833+0000 7fdf2b59e700 1 --2- 172.21.15.146:0/3195446580 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf2c1370d0 0x7fdf2c06d6b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fdf24015000 tx=0x7fdf24004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.833+0000 7fdf237fe700 1 -- 172.21.15.146:0/3195446580 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf24003ea0 con 0x7fdf2c1370d0 2023-10-03T10:17:01.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.833+0000 7fdf237fe700 1 -- 172.21.15.146:0/3195446580 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf240048e0 con 0x7fdf2c1370d0 2023-10-03T10:17:01.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.833+0000 7fdf31164700 1 -- 172.21.15.146:0/3195446580 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf24009b30 con 0x7fdf2c1370d0 2023-10-03T10:17:01.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.833+0000 7fdf237fe700 1 -- 172.21.15.146:0/3195446580 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2401c680 con 0x7fdf2c1370d0 2023-10-03T10:17:01.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.833+0000 7fdf31164700 1 -- 172.21.15.146:0/3195446580 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2c071610 con 0x7fdf2c1370d0 2023-10-03T10:17:01.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.834+0000 7fdf237fe700 1 -- 172.21.15.146:0/3195446580 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdf2401c7e0 con 0x7fdf2c1370d0 2023-10-03T10:17:01.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.834+0000 7fdf237fe700 1 -- 172.21.15.146:0/3195446580 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdf24040d60 con 0x7fdf2c1370d0 2023-10-03T10:17:01.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.834+0000 7fdf31164700 1 -- 172.21.15.146:0/3195446580 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf2c04f2a0 con 0x7fdf2c1370d0 2023-10-03T10:17:01.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.839+0000 7fdf237fe700 1 -- 172.21.15.146:0/3195446580 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf240249a0 con 0x7fdf2c1370d0 2023-10-03T10:17:01.867 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:01.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.963+0000 7f52c9832700 1 Processor -- start 2023-10-03T10:17:01.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.963+0000 7f52c9832700 1 -- start start 2023-10-03T10:17:01.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.964+0000 7f52c9832700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52c4134140 0x7f52c4138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.964+0000 7f52c9832700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c41345a0 0x7f52c413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.964+0000 7f52c9832700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c409b110 con 0x7f52c409ad40 2023-10-03T10:17:01.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.964+0000 7f52c9832700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c40a3b60 con 0x7f52c4134140 2023-10-03T10:17:01.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.964+0000 7f52c9832700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40a1a80 con 0x7f52c41345a0 2023-10-03T10:17:01.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.964+0000 7f52c27fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52c4134140 0x7f52c4138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.964+0000 7f52c27fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52c4134140 0x7f52c4138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60946/0 (socket says 172.21.15.146:60946) 2023-10-03T10:17:01.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.964+0000 7f52c27fc700 1 -- 172.21.15.146:0/13900126 learned_addr learned my addr 172.21.15.146:0/13900126 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:01.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.964+0000 7f52c37fe700 1 --2- 172.21.15.146:0/13900126 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c41345a0 0x7f52c413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.964+0000 7f52c27fc700 1 -- 172.21.15.146:0/13900126 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c41345a0 msgr2=0x7f52c413b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:01.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.964+0000 7f52c27fc700 1 --2- 172.21.15.146:0/13900126 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c41345a0 0x7f52c413b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.964+0000 7f52c27fc700 1 -- 172.21.15.146:0/13900126 >> v1:172.21.15.146:6789/0 conn(0x7f52c409ad40 legacy=0x7f52c4133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.964+0000 7f52c27fc700 1 -- 172.21.15.146:0/13900126 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c40a2fa0 con 0x7f52c4134140 2023-10-03T10:17:01.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.964+0000 7f52c1ffb700 1 -- 172.21.15.146:0/13900126 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455234147 0 0) 0x7f52c409b110 con 0x7f52c409ad40 2023-10-03T10:17:01.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.964+0000 7f52c37fe700 1 --2- 172.21.15.146:0/13900126 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c41345a0 0x7f52c413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:01.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.964+0000 7f52c27fc700 1 --2- 172.21.15.146:0/13900126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c4134140 0x7f52c4138e80 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f52b80098f0 tx=0x7f52b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c09d6eea3d5d318 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.964+0000 7f52c1ffb700 1 -- 172.21.15.146:0/13900126 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b8011830 con 0x7f52c4134140 2023-10-03T10:17:01.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.965+0000 7f52c1ffb700 1 -- 172.21.15.146:0/13900126 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b8011990 con 0x7f52c4134140 2023-10-03T10:17:01.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.965+0000 7f52c1ffb700 1 -- 172.21.15.146:0/13900126 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b8011d20 con 0x7f52c4134140 2023-10-03T10:17:01.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.965+0000 7f52c9832700 1 -- 172.21.15.146:0/13900126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c4134140 msgr2=0x7f52c4138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.965+0000 7f52c9832700 1 --2- 172.21.15.146:0/13900126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c4134140 0x7f52c4138e80 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f52b80098f0 tx=0x7f52b8009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:01.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.965+0000 7f52c9832700 1 -- 172.21.15.146:0/13900126 shutdown_connections 2023-10-03T10:17:01.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.965+0000 7f52c9832700 1 --2- 172.21.15.146:0/13900126 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c41345a0 0x7f52c413b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.965+0000 7f52c9832700 1 --2- 172.21.15.146:0/13900126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c4134140 0x7f52c4138e80 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.965+0000 7f52c9832700 1 -- 172.21.15.146:0/13900126 >> 172.21.15.146:0/13900126 conn(0x7f52c4099c40 msgr2=0x7f52c406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.965+0000 7f52c9832700 1 -- 172.21.15.146:0/13900126 shutdown_connections 2023-10-03T10:17:01.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.965+0000 7f52c9832700 1 -- 172.21.15.146:0/13900126 wait complete. 2023-10-03T10:17:01.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.967+0000 7f52c9832700 1 Processor -- start 2023-10-03T10:17:01.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.967+0000 7f52c9832700 1 -- start start 2023-10-03T10:17:01.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.968+0000 7f52c9832700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c409ad40 0x7f52c411c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.968+0000 7f52c9832700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c4134140 0x7f52c411ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.968+0000 7f52c9832700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c41345a0 0x7f52c411d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.968+0000 7f52c9832700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c411f840 con 0x7f52c4134140 2023-10-03T10:17:01.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.968+0000 7f52c9832700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c411da10 con 0x7f52c41345a0 2023-10-03T10:17:01.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.968+0000 7f52c9832700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52c411ee60 con 0x7f52c409ad40 2023-10-03T10:17:01.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.968+0000 7f52c2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c409ad40 0x7f52c411c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.968+0000 7f52c2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c409ad40 0x7f52c411c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56190/0 (socket says 172.21.15.146:56190) 2023-10-03T10:17:01.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.968+0000 7f52c2ffd700 1 -- 172.21.15.146:0/1398333179 learned_addr learned my addr 172.21.15.146:0/1398333179 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:01.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.968+0000 7f52c27fc700 1 --2- 172.21.15.146:0/1398333179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c4134140 0x7f52c411ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.968+0000 7f52c37fe700 1 --2- 172.21.15.146:0/1398333179 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c41345a0 0x7f52c411d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.968+0000 7f52c27fc700 1 -- 172.21.15.146:0/1398333179 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c409ad40 msgr2=0x7f52c411c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.968+0000 7f52c27fc700 1 --2- 172.21.15.146:0/1398333179 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c409ad40 0x7f52c411c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.968+0000 7f52c27fc700 1 -- 172.21.15.146:0/1398333179 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c41345a0 msgr2=0x7f52c411d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.968+0000 7f52c27fc700 1 --2- 172.21.15.146:0/1398333179 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c41345a0 0x7f52c411d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.968+0000 7f52c27fc700 1 -- 172.21.15.146:0/1398333179 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc009a70 con 0x7f52c4134140 2023-10-03T10:17:01.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.968+0000 7f52c2ffd700 1 --2- 172.21.15.146:0/1398333179 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c409ad40 0x7f52c411c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:01.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.968+0000 7f52c37fe700 1 --2- 172.21.15.146:0/1398333179 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c41345a0 0x7f52c411d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:01.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.968+0000 7f52c27fc700 1 --2- 172.21.15.146:0/1398333179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c4134140 0x7f52c411ce00 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f52b8016000 tx=0x7f52b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.969+0000 7f52abfff700 1 -- 172.21.15.146:0/1398333179 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b80045d0 con 0x7f52c4134140 2023-10-03T10:17:01.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.969+0000 7f52abfff700 1 -- 172.21.15.146:0/1398333179 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b801f070 con 0x7f52c4134140 2023-10-03T10:17:01.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.969+0000 7f52c9832700 1 -- 172.21.15.146:0/1398333179 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b8009550 con 0x7f52c4134140 2023-10-03T10:17:01.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.969+0000 7f52abfff700 1 -- 172.21.15.146:0/1398333179 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b80038c0 con 0x7f52c4134140 2023-10-03T10:17:01.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.969+0000 7f52c9832700 1 -- 172.21.15.146:0/1398333179 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c411e640 con 0x7f52c4134140 2023-10-03T10:17:01.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.970+0000 7f52c9832700 1 -- 172.21.15.146:0/1398333179 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c41361e0 con 0x7f52c4134140 2023-10-03T10:17:01.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.970+0000 7f52abfff700 1 -- 172.21.15.146:0/1398333179 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52b8003a20 con 0x7f52c4134140 2023-10-03T10:17:01.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.970+0000 7f52abfff700 1 -- 172.21.15.146:0/1398333179 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f52b8021070 con 0x7f52c4134140 2023-10-03T10:17:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.975+0000 7f52abfff700 1 -- 172.21.15.146:0/1398333179 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52b802f3a0 con 0x7f52c4134140 2023-10-03T10:17:01.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.997+0000 7f6addc3a700 1 Processor -- start 2023-10-03T10:17:01.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.997+0000 7f6addc3a700 1 -- start start 2023-10-03T10:17:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.997+0000 7f6addc3a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ad8134140 0x7f6ad8138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.997+0000 7f6addc3a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ad8134570 0x7f6ad813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.997+0000 7f6addc3a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad809b110 con 0x7f6ad809ad40 2023-10-03T10:17:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.997+0000 7f6addc3a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad80a3b60 con 0x7f6ad8134140 2023-10-03T10:17:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.997+0000 7f6addc3a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad80a1a80 con 0x7f6ad8134570 2023-10-03T10:17:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.997+0000 7f6ad77fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6ad809ad40 0x7f6ad8133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44164/0 (socket says 172.21.15.146:44164) 2023-10-03T10:17:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.997+0000 7f6ad77fe700 1 -- 172.21.15.146:0/3271757317 learned_addr learned my addr 172.21.15.146:0/3271757317 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.998+0000 7f6ad7fff700 1 --2- 172.21.15.146:0/3271757317 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ad8134570 0x7f6ad813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.998+0000 7f6ad6ffd700 1 --2- 172.21.15.146:0/3271757317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ad8134140 0x7f6ad8138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.998+0000 7f6ad7fff700 1 -- 172.21.15.146:0/3271757317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ad8134140 msgr2=0x7f6ad8138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.998+0000 7f6ad7fff700 1 --2- 172.21.15.146:0/3271757317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ad8134140 0x7f6ad8138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.998+0000 7f6ad7fff700 1 -- 172.21.15.146:0/3271757317 >> v1:172.21.15.146:6789/0 conn(0x7f6ad809ad40 legacy=0x7f6ad8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.998+0000 7f6ad7fff700 1 -- 172.21.15.146:0/3271757317 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad80a2fa0 con 0x7f6ad8134570 2023-10-03T10:17:02.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.998+0000 7f6ad6ffd700 1 --2- 172.21.15.146:0/3271757317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ad8134140 0x7f6ad8138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.998+0000 7f6ad7fff700 1 --2- 172.21.15.146:0/3271757317 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ad8134570 0x7f6ad813b3d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009dc0 tx=0x7f6ad000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2269c23c1125256 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.998+0000 7f6ad67fc700 1 -- 172.21.15.146:0/3271757317 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad000e070 con 0x7f6ad8134570 2023-10-03T10:17:02.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.998+0000 7f6ad67fc700 1 -- 172.21.15.146:0/3271757317 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad000bb20 con 0x7f6ad8134570 2023-10-03T10:17:02.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.998+0000 7f6ad67fc700 1 -- 172.21.15.146:0/3271757317 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0012430 con 0x7f6ad8134570 2023-10-03T10:17:02.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.999+0000 7f6addc3a700 1 -- 172.21.15.146:0/3271757317 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ad8134570 msgr2=0x7f6ad813b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.999+0000 7f6addc3a700 1 --2- 172.21.15.146:0/3271757317 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ad8134570 0x7f6ad813b3d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009dc0 tx=0x7f6ad000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:02.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.999+0000 7f6addc3a700 1 -- 172.21.15.146:0/3271757317 shutdown_connections 2023-10-03T10:17:02.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.999+0000 7f6addc3a700 1 --2- 172.21.15.146:0/3271757317 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ad8134570 0x7f6ad813b3d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.999+0000 7f6addc3a700 1 --2- 172.21.15.146:0/3271757317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ad8134140 0x7f6ad8138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.999+0000 7f6addc3a700 1 -- 172.21.15.146:0/3271757317 >> 172.21.15.146:0/3271757317 conn(0x7f6ad8099c40 msgr2=0x7f6ad806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.999+0000 7f6addc3a700 1 -- 172.21.15.146:0/3271757317 shutdown_connections 2023-10-03T10:17:02.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:01.999+0000 7f6addc3a700 1 -- 172.21.15.146:0/3271757317 wait complete. 2023-10-03T10:17:02.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.000+0000 7f6addc3a700 1 Processor -- start 2023-10-03T10:17:02.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.000+0000 7f6addc3a700 1 -- start start 2023-10-03T10:17:02.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.000+0000 7f6addc3a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ad809ad40 0x7f6ad811c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.000+0000 7f6addc3a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ad8134140 0x7f6ad811ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.000+0000 7f6addc3a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ad8134570 0x7f6ad811d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.000+0000 7f6addc3a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad811dcf0 con 0x7f6ad809ad40 2023-10-03T10:17:02.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.000+0000 7f6addc3a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad811ebd0 con 0x7f6ad8134570 2023-10-03T10:17:02.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.000+0000 7f6addc3a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad809c7e0 con 0x7f6ad8134140 2023-10-03T10:17:02.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.001+0000 7f6ad77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ad809ad40 0x7f6ad811c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.001+0000 7f6ad77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ad809ad40 0x7f6ad811c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60966/0 (socket says 172.21.15.146:60966) 2023-10-03T10:17:02.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.001+0000 7f6ad77fe700 1 -- 172.21.15.146:0/1863873956 learned_addr learned my addr 172.21.15.146:0/1863873956 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:02.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.001+0000 7f6ad7fff700 1 --2- 172.21.15.146:0/1863873956 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ad8134570 0x7f6ad811d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.001+0000 7f6ad6ffd700 1 --2- 172.21.15.146:0/1863873956 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ad8134140 0x7f6ad811ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.001+0000 7f6ad77fe700 1 -- 172.21.15.146:0/1863873956 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ad8134140 msgr2=0x7f6ad811ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.001+0000 7f6ad77fe700 1 --2- 172.21.15.146:0/1863873956 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ad8134140 0x7f6ad811ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.001+0000 7f6ad77fe700 1 -- 172.21.15.146:0/1863873956 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ad8134570 msgr2=0x7f6ad811d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.001+0000 7f6ad77fe700 1 --2- 172.21.15.146:0/1863873956 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ad8134570 0x7f6ad811d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.001+0000 7f6ad77fe700 1 -- 172.21.15.146:0/1863873956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6acc0094a0 con 0x7f6ad809ad40 2023-10-03T10:17:02.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.001+0000 7f6ad77fe700 1 --2- 172.21.15.146:0/1863873956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ad809ad40 0x7f6ad811c8c0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800c480 tx=0x7f6ac800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.001+0000 7f6abffff700 1 -- 172.21.15.146:0/1863873956 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8005d70 con 0x7f6ad809ad40 2023-10-03T10:17:02.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.001+0000 7f6abffff700 1 -- 172.21.15.146:0/1863873956 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac80070d0 con 0x7f6ad809ad40 2023-10-03T10:17:02.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.001+0000 7f6addc3a700 1 -- 172.21.15.146:0/1863873956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad0009a70 con 0x7f6ad809ad40 2023-10-03T10:17:02.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.001+0000 7f6abffff700 1 -- 172.21.15.146:0/1863873956 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8007440 con 0x7f6ad809ad40 2023-10-03T10:17:02.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.001+0000 7f6addc3a700 1 -- 172.21.15.146:0/1863873956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad811e910 con 0x7f6ad809ad40 2023-10-03T10:17:02.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.002+0000 7f6abffff700 1 -- 172.21.15.146:0/1863873956 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ac80075a0 con 0x7f6ad809ad40 2023-10-03T10:17:02.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.002+0000 7f6abffff700 1 -- 172.21.15.146:0/1863873956 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6ac803ead0 con 0x7f6ad809ad40 2023-10-03T10:17:02.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.002+0000 7f6addc3a700 1 -- 172.21.15.146:0/1863873956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad804f2a0 con 0x7f6ad809ad40 2023-10-03T10:17:02.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.007+0000 7f6abffff700 1 -- 172.21.15.146:0/1863873956 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ac8019b40 con 0x7f6ad809ad40 2023-10-03T10:17:02.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.042+0000 7fdf31164700 1 -- 172.21.15.146:0/3195446580 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdf2c06ff50 con 0x7fdf2c1370d0 2023-10-03T10:17:02.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.043+0000 7fdf237fe700 1 -- 172.21.15.146:0/3195446580 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdf2c06ff50 con 0x7fdf2c1370d0 2023-10-03T10:17:02.043 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:02.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.046+0000 7fdf31164700 1 -- 172.21.15.146:0/3195446580 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf2c1370d0 msgr2=0x7fdf2c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.046+0000 7fdf31164700 1 --2- 172.21.15.146:0/3195446580 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf2c1370d0 0x7fdf2c06d6b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fdf24015000 tx=0x7fdf24004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.046+0000 7fdf31164700 1 -- 172.21.15.146:0/3195446580 shutdown_connections 2023-10-03T10:17:02.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.046+0000 7fdf31164700 1 --2- 172.21.15.146:0/3195446580 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf2c1370d0 0x7fdf2c06d6b0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.046+0000 7fdf31164700 1 --2- 172.21.15.146:0/3195446580 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf2c098410 0x7fdf2c12e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.046+0000 7fdf31164700 1 --2- 172.21.15.146:0/3195446580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf2c1347b0 0x7fdf2c12e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.046+0000 7fdf31164700 1 -- 172.21.15.146:0/3195446580 >> 172.21.15.146:0/3195446580 conn(0x7fdf2c0a2b30 msgr2=0x7fdf2c09e120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.046+0000 7fdf31164700 1 -- 172.21.15.146:0/3195446580 shutdown_connections 2023-10-03T10:17:02.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.046+0000 7fdf31164700 1 -- 172.21.15.146:0/3195446580 wait complete. 2023-10-03T10:17:02.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:02.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.180+0000 7f52c9832700 1 -- 172.21.15.146:0/1398333179 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f52c411e820 con 0x7f52c4134140 2023-10-03T10:17:02.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.181+0000 7f52abfff700 1 -- 172.21.15.146:0/1398333179 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f52c411e820 con 0x7f52c4134140 2023-10-03T10:17:02.180 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:02.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.182+0000 7f52c9832700 1 -- 172.21.15.146:0/1398333179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c4134140 msgr2=0x7f52c411ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.182+0000 7f52c9832700 1 --2- 172.21.15.146:0/1398333179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c4134140 0x7f52c411ce00 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f52b8016000 tx=0x7f52b8004750 comp rx=0 tx=0).stop 2023-10-03T10:17:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.183+0000 7f52c9832700 1 -- 172.21.15.146:0/1398333179 shutdown_connections 2023-10-03T10:17:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.183+0000 7f52c9832700 1 --2- 172.21.15.146:0/1398333179 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c41345a0 0x7f52c411d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.183+0000 7f52c9832700 1 --2- 172.21.15.146:0/1398333179 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c409ad40 0x7f52c411c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.183+0000 7f52c9832700 1 --2- 172.21.15.146:0/1398333179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c4134140 0x7f52c411ce00 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.183+0000 7f52c9832700 1 -- 172.21.15.146:0/1398333179 >> 172.21.15.146:0/1398333179 conn(0x7f52c4099c40 msgr2=0x7f52c413b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.183+0000 7f52c9832700 1 -- 172.21.15.146:0/1398333179 shutdown_connections 2023-10-03T10:17:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.183+0000 7f52c9832700 1 -- 172.21.15.146:0/1398333179 wait complete. 2023-10-03T10:17:02.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:02.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.201+0000 7f6addc3a700 1 -- 172.21.15.146:0/1863873956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6ad811e280 con 0x7f6ad809ad40 2023-10-03T10:17:02.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.201+0000 7f6abffff700 1 -- 172.21.15.146:0/1863873956 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ac8017020 con 0x7f6ad809ad40 2023-10-03T10:17:02.201 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:02.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.203+0000 7f6addc3a700 1 -- 172.21.15.146:0/1863873956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ad809ad40 msgr2=0x7f6ad811c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.203+0000 7f6addc3a700 1 --2- 172.21.15.146:0/1863873956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ad809ad40 0x7f6ad811c8c0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800c480 tx=0x7f6ac800c790 comp rx=0 tx=0).stop 2023-10-03T10:17:02.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.203+0000 7f6addc3a700 1 -- 172.21.15.146:0/1863873956 shutdown_connections 2023-10-03T10:17:02.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.203+0000 7f6addc3a700 1 --2- 172.21.15.146:0/1863873956 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ad8134570 0x7f6ad811d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.203+0000 7f6addc3a700 1 --2- 172.21.15.146:0/1863873956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ad809ad40 0x7f6ad811c8c0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.203+0000 7f6addc3a700 1 --2- 172.21.15.146:0/1863873956 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6ad8134140 0x7f6ad811ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.203+0000 7f6addc3a700 1 -- 172.21.15.146:0/1863873956 >> 172.21.15.146:0/1863873956 conn(0x7f6ad8099c40 msgr2=0x7f6ad80a6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.203+0000 7f6addc3a700 1 -- 172.21.15.146:0/1863873956 shutdown_connections 2023-10-03T10:17:02.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.203+0000 7f6addc3a700 1 -- 172.21.15.146:0/1863873956 wait complete. 2023-10-03T10:17:02.215 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:02.449 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:02.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.573+0000 7f871a462700 1 Processor -- start 2023-10-03T10:17:02.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.573+0000 7f871a462700 1 -- start start 2023-10-03T10:17:02.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.573+0000 7f871a462700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f871412feb0 0x7f8714130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.573+0000 7f871a462700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f87141307c0 0x7f87140993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.573+0000 7f871a462700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8714099920 0x7f8714099dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.573+0000 7f871a462700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871409a540 con 0x7f87141307c0 2023-10-03T10:17:02.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.573+0000 7f871a462700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871409ad40 con 0x7f8714099920 2023-10-03T10:17:02.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.573+0000 7f871a462700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f871409e640 con 0x7f871412feb0 2023-10-03T10:17:02.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.573+0000 7f87137fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f87141307c0 0x7f87140993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.573+0000 7f8713fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f871412feb0 0x7f8714130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.573+0000 7f87189ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8714099920 0x7f8714099dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.573+0000 7f8713fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f871412feb0 0x7f8714130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56212/0 (socket says 172.21.15.146:56212) 2023-10-03T10:17:02.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.573+0000 7f87137fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f87141307c0 0x7f87140993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60976/0 (socket says 172.21.15.146:60976) 2023-10-03T10:17:02.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.573+0000 7f87189ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8714099920 0x7f8714099dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55840/0 (socket says 172.21.15.146:55840) 2023-10-03T10:17:02.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.573+0000 7f8713fff700 1 -- 172.21.15.146:0/1144145530 learned_addr learned my addr 172.21.15.146:0/1144145530 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:02.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.574+0000 7f87137fe700 1 -- 172.21.15.146:0/1144145530 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f871412feb0 msgr2=0x7f8714130280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:02.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.574+0000 7f87137fe700 1 --2- 172.21.15.146:0/1144145530 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f871412feb0 0x7f8714130280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.574+0000 7f87137fe700 1 -- 172.21.15.146:0/1144145530 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8714099920 msgr2=0x7f8714099dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:02.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.574+0000 7f87137fe700 1 --2- 172.21.15.146:0/1144145530 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8714099920 0x7f8714099dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.574+0000 7f87137fe700 1 -- 172.21.15.146:0/1144145530 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871409e3c0 con 0x7f87141307c0 2023-10-03T10:17:02.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.574+0000 7f8713fff700 1 --2- 172.21.15.146:0/1144145530 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f871412feb0 0x7f8714130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.574+0000 7f87189ff700 1 --2- 172.21.15.146:0/1144145530 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8714099920 0x7f8714099dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.574+0000 7f87137fe700 1 --2- 172.21.15.146:0/1144145530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87141307c0 0x7f87140993e0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f8708009840 tx=0x7f8708009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d22adb86b2822f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.574+0000 7f8712ffd700 1 -- 172.21.15.146:0/1144145530 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708011830 con 0x7f87141307c0 2023-10-03T10:17:02.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.574+0000 7f8712ffd700 1 -- 172.21.15.146:0/1144145530 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8708011990 con 0x7f87141307c0 2023-10-03T10:17:02.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.574+0000 7f8712ffd700 1 -- 172.21.15.146:0/1144145530 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708011d20 con 0x7f87141307c0 2023-10-03T10:17:02.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.575+0000 7f871a462700 1 -- 172.21.15.146:0/1144145530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87141307c0 msgr2=0x7f87140993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.575+0000 7f871a462700 1 --2- 172.21.15.146:0/1144145530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87141307c0 0x7f87140993e0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f8708009840 tx=0x7f8708009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:02.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.575+0000 7f871a462700 1 -- 172.21.15.146:0/1144145530 shutdown_connections 2023-10-03T10:17:02.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.575+0000 7f871a462700 1 --2- 172.21.15.146:0/1144145530 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8714099920 0x7f8714099dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.575+0000 7f871a462700 1 --2- 172.21.15.146:0/1144145530 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f871412feb0 0x7f8714130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.575+0000 7f871a462700 1 --2- 172.21.15.146:0/1144145530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87141307c0 0x7f87140993e0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.575+0000 7f871a462700 1 -- 172.21.15.146:0/1144145530 >> 172.21.15.146:0/1144145530 conn(0x7f87140a2b30 msgr2=0x7f871409e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.575+0000 7f871a462700 1 -- 172.21.15.146:0/1144145530 shutdown_connections 2023-10-03T10:17:02.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.575+0000 7f871a462700 1 -- 172.21.15.146:0/1144145530 wait complete. 2023-10-03T10:17:02.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.576+0000 7f871a462700 1 Processor -- start 2023-10-03T10:17:02.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.576+0000 7f871a462700 1 -- start start 2023-10-03T10:17:02.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.576+0000 7f871a462700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8714099920 0x7f87141c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.576+0000 7f871a462700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f871412feb0 0x7f87141c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.576+0000 7f871a462700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87141307c0 0x7f87141c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.576+0000 7f871a462700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87141c5d40 con 0x7f8714099920 2023-10-03T10:17:02.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.576+0000 7f871a462700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87140725c0 con 0x7f87141307c0 2023-10-03T10:17:02.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.576+0000 7f871a462700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8714129720 con 0x7f871412feb0 2023-10-03T10:17:02.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.576+0000 7f87137fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f871412feb0 0x7f87141c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.576+0000 7f87189ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87141307c0 0x7f87141c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.576+0000 7f8713fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8714099920 0x7f87141c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.576+0000 7f87137fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f871412feb0 0x7f87141c5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56226/0 (socket says 172.21.15.146:56226) 2023-10-03T10:17:02.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.576+0000 7f87137fe700 1 -- 172.21.15.146:0/1169132632 learned_addr learned my addr 172.21.15.146:0/1169132632 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:02.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.577+0000 7f87137fe700 1 -- 172.21.15.146:0/1169132632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87141307c0 msgr2=0x7f87141c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.577+0000 7f87137fe700 1 --2- 172.21.15.146:0/1169132632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87141307c0 0x7f87141c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.577+0000 7f87137fe700 1 -- 172.21.15.146:0/1169132632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8714099920 msgr2=0x7f87141c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.577+0000 7f87137fe700 1 --2- 172.21.15.146:0/1169132632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8714099920 0x7f87141c52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.577+0000 7f87137fe700 1 -- 172.21.15.146:0/1169132632 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c00aa90 con 0x7f871412feb0 2023-10-03T10:17:02.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.577+0000 7f87189ff700 1 --2- 172.21.15.146:0/1169132632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87141307c0 0x7f87141c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.577+0000 7f8713fff700 1 --2- 172.21.15.146:0/1169132632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8714099920 0x7f87141c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.577+0000 7f87137fe700 1 --2- 172.21.15.146:0/1169132632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f871412feb0 0x7f87141c5800 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f87080090b0 tx=0x7f8708004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.577+0000 7f8710ff9700 1 -- 172.21.15.146:0/1169132632 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708004240 con 0x7f871412feb0 2023-10-03T10:17:02.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.577+0000 7f8710ff9700 1 -- 172.21.15.146:0/1169132632 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870801f070 con 0x7f871412feb0 2023-10-03T10:17:02.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.577+0000 7f871a462700 1 -- 172.21.15.146:0/1169132632 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870400b7a0 con 0x7f871412feb0 2023-10-03T10:17:02.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.577+0000 7f8710ff9700 1 -- 172.21.15.146:0/1169132632 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87080036a0 con 0x7f871412feb0 2023-10-03T10:17:02.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.577+0000 7f871a462700 1 -- 172.21.15.146:0/1169132632 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87080094a0 con 0x7f871412feb0 2023-10-03T10:17:02.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.578+0000 7f8710ff9700 1 -- 172.21.15.146:0/1169132632 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8708021030 con 0x7f871412feb0 2023-10-03T10:17:02.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.578+0000 7f871a462700 1 -- 172.21.15.146:0/1169132632 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871409aa40 con 0x7f871412feb0 2023-10-03T10:17:02.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.578+0000 7f8710ff9700 1 -- 172.21.15.146:0/1169132632 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8708040560 con 0x7f871412feb0 2023-10-03T10:17:02.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.582+0000 7f8710ff9700 1 -- 172.21.15.146:0/1169132632 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8708015020 con 0x7f871412feb0 2023-10-03T10:17:02.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.764+0000 7f871a462700 1 -- 172.21.15.146:0/1169132632 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f871404f2a0 con 0x7f871412feb0 2023-10-03T10:17:02.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.764+0000 7f8710ff9700 1 -- 172.21.15.146:0/1169132632 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f87080239c0 con 0x7f871412feb0 2023-10-03T10:17:02.764 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:02.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.767+0000 7f871a462700 1 -- 172.21.15.146:0/1169132632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f871412feb0 msgr2=0x7f87141c5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.767+0000 7f871a462700 1 --2- 172.21.15.146:0/1169132632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f871412feb0 0x7f87141c5800 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f87080090b0 tx=0x7f8708004750 comp rx=0 tx=0).stop 2023-10-03T10:17:02.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.767+0000 7f871a462700 1 -- 172.21.15.146:0/1169132632 shutdown_connections 2023-10-03T10:17:02.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.767+0000 7f871a462700 1 --2- 172.21.15.146:0/1169132632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87141307c0 0x7f87141c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.767+0000 7f871a462700 1 --2- 172.21.15.146:0/1169132632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8714099920 0x7f87141c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.767+0000 7f871a462700 1 --2- 172.21.15.146:0/1169132632 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f871412feb0 0x7f87141c5800 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.767+0000 7f871a462700 1 -- 172.21.15.146:0/1169132632 >> 172.21.15.146:0/1169132632 conn(0x7f87140a2b30 msgr2=0x7f871409fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.767+0000 7f871a462700 1 -- 172.21.15.146:0/1169132632 shutdown_connections 2023-10-03T10:17:02.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:02.767+0000 7f871a462700 1 -- 172.21.15.146:0/1169132632 wait complete. 2023-10-03T10:17:02.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:03.064 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:03.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.189+0000 7fdb45003700 1 Processor -- start 2023-10-03T10:17:03.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.189+0000 7fdb45003700 1 -- start start 2023-10-03T10:17:03.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.190+0000 7fdb45003700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb40136960 0x7fdb40138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.190+0000 7fdb45003700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb40139280 0x7fdb4013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.190+0000 7fdb45003700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4006b2d0 con 0x7fdb40133ad0 2023-10-03T10:17:03.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.190+0000 7fdb45003700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb401345b0 con 0x7fdb40139280 2023-10-03T10:17:03.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.190+0000 7fdb45003700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb40133610 con 0x7fdb40136960 2023-10-03T10:17:03.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.190+0000 7fdb3f59e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb40139280 0x7fdb4013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.190+0000 7fdb3e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb40136960 0x7fdb40138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.190+0000 7fdb3f59e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb40139280 0x7fdb4013b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55868/0 (socket says 172.21.15.146:55868) 2023-10-03T10:17:03.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.190+0000 7fdb3f59e700 1 -- 172.21.15.146:0/4231520878 learned_addr learned my addr 172.21.15.146:0/4231520878 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:03.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.190+0000 7fdb3e59c700 1 --2- 172.21.15.146:0/4231520878 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb40136960 0x7fdb40138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56234/0 (socket says 172.21.15.146:56234) 2023-10-03T10:17:03.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.190+0000 7fdb3ed9d700 1 --1- 172.21.15.146:0/4231520878 >> v1:172.21.15.146:6789/0 conn(0x7fdb40133ad0 0x7fdb40133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44176/0 (socket says 172.21.15.146:44176) 2023-10-03T10:17:03.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.190+0000 7fdb3f59e700 1 -- 172.21.15.146:0/4231520878 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb40136960 msgr2=0x7fdb40138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:03.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.190+0000 7fdb3f59e700 1 --2- 172.21.15.146:0/4231520878 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb40136960 0x7fdb40138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.190+0000 7fdb3f59e700 1 -- 172.21.15.146:0/4231520878 >> v1:172.21.15.146:6789/0 conn(0x7fdb40133ad0 legacy=0x7fdb40133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.190+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/4231520878 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79389206 0 0) 0x7fdb4006b2d0 con 0x7fdb40133ad0 2023-10-03T10:17:03.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.190+0000 7fdb3f59e700 1 -- 172.21.15.146:0/4231520878 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4009a500 con 0x7fdb40139280 2023-10-03T10:17:03.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.190+0000 7fdb3e59c700 1 --2- 172.21.15.146:0/4231520878 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb40136960 0x7fdb40138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.190+0000 7fdb3f59e700 1 --2- 172.21.15.146:0/4231520878 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb40139280 0x7fdb4013b660 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fdb38009e80 tx=0x7fdb3800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=693c2a73351ed26e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.191+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/4231520878 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3800e070 con 0x7fdb40139280 2023-10-03T10:17:03.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.191+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/4231520878 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3800b910 con 0x7fdb40139280 2023-10-03T10:17:03.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.191+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/4231520878 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3800bcc0 con 0x7fdb40139280 2023-10-03T10:17:03.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.191+0000 7fdb45003700 1 -- 172.21.15.146:0/4231520878 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb40139280 msgr2=0x7fdb4013b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.191+0000 7fdb45003700 1 --2- 172.21.15.146:0/4231520878 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb40139280 0x7fdb4013b660 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fdb38009e80 tx=0x7fdb3800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:03.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.191+0000 7fdb45003700 1 -- 172.21.15.146:0/4231520878 shutdown_connections 2023-10-03T10:17:03.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.191+0000 7fdb45003700 1 --2- 172.21.15.146:0/4231520878 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb40139280 0x7fdb4013b660 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.191+0000 7fdb45003700 1 --2- 172.21.15.146:0/4231520878 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb40136960 0x7fdb40138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.191+0000 7fdb45003700 1 -- 172.21.15.146:0/4231520878 >> 172.21.15.146:0/4231520878 conn(0x7fdb40099c40 msgr2=0x7fdb400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.191+0000 7fdb45003700 1 -- 172.21.15.146:0/4231520878 shutdown_connections 2023-10-03T10:17:03.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.191+0000 7fdb45003700 1 -- 172.21.15.146:0/4231520878 wait complete. 2023-10-03T10:17:03.196 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:03.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.192+0000 7fdb45003700 1 Processor -- start 2023-10-03T10:17:03.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.192+0000 7fdb45003700 1 -- start start 2023-10-03T10:17:03.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.193+0000 7fdb45003700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb40133ad0 0x7fdb4012cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.193+0000 7fdb45003700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb40136960 0x7fdb4012d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.193+0000 7fdb45003700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb40139280 0x7fdb4012d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.193+0000 7fdb45003700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4006fc60 con 0x7fdb40133ad0 2023-10-03T10:17:03.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.193+0000 7fdb45003700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb40130aa0 con 0x7fdb40136960 2023-10-03T10:17:03.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.193+0000 7fdb45003700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb40072130 con 0x7fdb40139280 2023-10-03T10:17:03.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.193+0000 7fdb3e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb40136960 0x7fdb4012d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.193+0000 7fdb3ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb40133ad0 0x7fdb4012cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.193+0000 7fdb3e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb40136960 0x7fdb4012d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55872/0 (socket says 172.21.15.146:55872) 2023-10-03T10:17:03.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.193+0000 7fdb3e59c700 1 -- 172.21.15.146:0/277849871 learned_addr learned my addr 172.21.15.146:0/277849871 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:03.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.193+0000 7fdb3f59e700 1 --2- 172.21.15.146:0/277849871 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb40139280 0x7fdb4012d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.193+0000 7fdb3ed9d700 1 -- 172.21.15.146:0/277849871 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb40139280 msgr2=0x7fdb4012d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.193+0000 7fdb3ed9d700 1 --2- 172.21.15.146:0/277849871 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb40139280 0x7fdb4012d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.193+0000 7fdb3ed9d700 1 -- 172.21.15.146:0/277849871 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb40136960 msgr2=0x7fdb4012d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.193+0000 7fdb3ed9d700 1 --2- 172.21.15.146:0/277849871 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb40136960 0x7fdb4012d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.193+0000 7fdb3ed9d700 1 -- 172.21.15.146:0/277849871 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb300094a0 con 0x7fdb40133ad0 2023-10-03T10:17:03.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.193+0000 7fdb3e59c700 1 --2- 172.21.15.146:0/277849871 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb40136960 0x7fdb4012d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.193+0000 7fdb3ed9d700 1 --2- 172.21.15.146:0/277849871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb40133ad0 0x7fdb4012cb30 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400c3c0 tx=0x7fdb3400c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.193+0000 7fdb277fe700 1 -- 172.21.15.146:0/277849871 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb34004a70 con 0x7fdb40133ad0 2023-10-03T10:17:03.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.193+0000 7fdb277fe700 1 -- 172.21.15.146:0/277849871 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb34004bf0 con 0x7fdb40133ad0 2023-10-03T10:17:03.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.193+0000 7fdb45003700 1 -- 172.21.15.146:0/277849871 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb38009b30 con 0x7fdb40133ad0 2023-10-03T10:17:03.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.194+0000 7fdb277fe700 1 -- 172.21.15.146:0/277849871 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb340070d0 con 0x7fdb40133ad0 2023-10-03T10:17:03.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.194+0000 7fdb45003700 1 -- 172.21.15.146:0/277849871 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb40070990 con 0x7fdb40133ad0 2023-10-03T10:17:03.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.194+0000 7fdb277fe700 1 -- 172.21.15.146:0/277849871 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb34007230 con 0x7fdb40133ad0 2023-10-03T10:17:03.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.194+0000 7fdb277fe700 1 -- 172.21.15.146:0/277849871 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdb3403f230 con 0x7fdb40133ad0 2023-10-03T10:17:03.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.194+0000 7fdb45003700 1 -- 172.21.15.146:0/277849871 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb4006fe80 con 0x7fdb40133ad0 2023-10-03T10:17:03.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.199+0000 7fdb277fe700 1 -- 172.21.15.146:0/277849871 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb340074e0 con 0x7fdb40133ad0 2023-10-03T10:17:03.216 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:03.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.326+0000 7fea6532a700 1 Processor -- start 2023-10-03T10:17:03.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.326+0000 7fea6532a700 1 -- start start 2023-10-03T10:17:03.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.327+0000 7fea6532a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fea60133ad0 0x7fea60133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.327+0000 7fea6532a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea601300a0 0x7fea601304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.327+0000 7fea6532a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea601309f0 0x7fea6013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.327+0000 7fea6532a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea6006b2d0 con 0x7fea60133ad0 2023-10-03T10:17:03.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.327+0000 7fea6532a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea60133610 con 0x7fea601309f0 2023-10-03T10:17:03.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.327+0000 7fea6532a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea6009a500 con 0x7fea601300a0 2023-10-03T10:17:03.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.327+0000 7fea5effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fea60133ad0 0x7fea60133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.327+0000 7fea5e7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea601300a0 0x7fea601304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.327+0000 7fea5e7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea601300a0 0x7fea601304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56254/0 (socket says 172.21.15.146:56254) 2023-10-03T10:17:03.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.327+0000 7fea5effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fea60133ad0 0x7fea60133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60998/0 (socket says 172.21.15.146:60998) 2023-10-03T10:17:03.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.327+0000 7fea5e7fc700 1 -- 172.21.15.146:0/440587394 learned_addr learned my addr 172.21.15.146:0/440587394 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:03.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.327+0000 7fea5f7fe700 1 --2- 172.21.15.146:0/440587394 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea601309f0 0x7fea6013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.327+0000 7fea5e7fc700 1 -- 172.21.15.146:0/440587394 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea601309f0 msgr2=0x7fea6013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:03.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.327+0000 7fea5e7fc700 1 --2- 172.21.15.146:0/440587394 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea601309f0 0x7fea6013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.327+0000 7fea5e7fc700 1 -- 172.21.15.146:0/440587394 >> v2:172.21.15.146:3300/0 conn(0x7fea60133ad0 msgr2=0x7fea60133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:03.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.327+0000 7fea5e7fc700 1 --2- 172.21.15.146:0/440587394 >> v2:172.21.15.146:3300/0 conn(0x7fea60133ad0 0x7fea60133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.327+0000 7fea5e7fc700 1 -- 172.21.15.146:0/440587394 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea601338b0 con 0x7fea601300a0 2023-10-03T10:17:03.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.327+0000 7fea5effd700 1 --2- 172.21.15.146:0/440587394 >> v2:172.21.15.146:3300/0 conn(0x7fea60133ad0 0x7fea60133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.328+0000 7fea5e7fc700 1 --2- 172.21.15.146:0/440587394 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea601300a0 0x7fea601304b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fea540098f0 tx=0x7fea54009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59ac1a34fd2a14e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.328+0000 7fea5dffb700 1 -- 172.21.15.146:0/440587394 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54011830 con 0x7fea601300a0 2023-10-03T10:17:03.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.328+0000 7fea5dffb700 1 -- 172.21.15.146:0/440587394 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea54011990 con 0x7fea601300a0 2023-10-03T10:17:03.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.328+0000 7fea5dffb700 1 -- 172.21.15.146:0/440587394 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54011d20 con 0x7fea601300a0 2023-10-03T10:17:03.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.328+0000 7fea6532a700 1 -- 172.21.15.146:0/440587394 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea601300a0 msgr2=0x7fea601304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.328+0000 7fea6532a700 1 --2- 172.21.15.146:0/440587394 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea601300a0 0x7fea601304b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fea540098f0 tx=0x7fea54009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:03.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.328+0000 7fea6532a700 1 -- 172.21.15.146:0/440587394 shutdown_connections 2023-10-03T10:17:03.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.328+0000 7fea6532a700 1 --2- 172.21.15.146:0/440587394 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea601309f0 0x7fea6013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.328+0000 7fea6532a700 1 --2- 172.21.15.146:0/440587394 >> v2:172.21.15.146:3300/0 conn(0x7fea60133ad0 0x7fea60133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.328+0000 7fea6532a700 1 --2- 172.21.15.146:0/440587394 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea601300a0 0x7fea601304b0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.328+0000 7fea6532a700 1 -- 172.21.15.146:0/440587394 >> 172.21.15.146:0/440587394 conn(0x7fea60099c40 msgr2=0x7fea600a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.329+0000 7fea6532a700 1 -- 172.21.15.146:0/440587394 shutdown_connections 2023-10-03T10:17:03.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.329+0000 7fea6532a700 1 -- 172.21.15.146:0/440587394 wait complete. 2023-10-03T10:17:03.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.330+0000 7fea6532a700 1 Processor -- start 2023-10-03T10:17:03.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.330+0000 7fea6532a700 1 -- start start 2023-10-03T10:17:03.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.330+0000 7fea6532a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea601300a0 0x7fea6011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.330+0000 7fea6532a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea601309f0 0x7fea6011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.330+0000 7fea6532a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea60133ad0 0x7fea6011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.330+0000 7fea6532a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6011ee40 con 0x7fea601309f0 2023-10-03T10:17:03.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.330+0000 7fea6532a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea60072580 con 0x7fea601300a0 2023-10-03T10:17:03.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.330+0000 7fea6532a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea6011ffc0 con 0x7fea60133ad0 2023-10-03T10:17:03.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.330+0000 7fea5effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea601300a0 0x7fea6011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.330+0000 7fea5effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea601300a0 0x7fea6011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:55878/0 (socket says 172.21.15.146:55878) 2023-10-03T10:17:03.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.330+0000 7fea5effd700 1 -- 172.21.15.146:0/1748122258 learned_addr learned my addr 172.21.15.146:0/1748122258 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:03.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.330+0000 7fea5e7fc700 1 --2- 172.21.15.146:0/1748122258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea601309f0 0x7fea6011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.330+0000 7fea5f7fe700 1 --2- 172.21.15.146:0/1748122258 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea60133ad0 0x7fea6011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.330+0000 7fea5e7fc700 1 -- 172.21.15.146:0/1748122258 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea60133ad0 msgr2=0x7fea6011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.330+0000 7fea5e7fc700 1 --2- 172.21.15.146:0/1748122258 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea60133ad0 0x7fea6011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.330+0000 7fea5e7fc700 1 -- 172.21.15.146:0/1748122258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea601300a0 msgr2=0x7fea6011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.330+0000 7fea5e7fc700 1 --2- 172.21.15.146:0/1748122258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea601300a0 0x7fea6011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.330+0000 7fea5e7fc700 1 -- 172.21.15.146:0/1748122258 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea500094a0 con 0x7fea601309f0 2023-10-03T10:17:03.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.330+0000 7fea5effd700 1 --2- 172.21.15.146:0/1748122258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea601300a0 0x7fea6011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.330+0000 7fea5f7fe700 1 --2- 172.21.15.146:0/1748122258 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea60133ad0 0x7fea6011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.331+0000 7fea5e7fc700 1 --2- 172.21.15.146:0/1748122258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea601309f0 0x7fea6011df80 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fea6006e5d0 tx=0x7fea54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.331+0000 7fea477fe700 1 -- 172.21.15.146:0/1748122258 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54004240 con 0x7fea601309f0 2023-10-03T10:17:03.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.331+0000 7fea477fe700 1 -- 172.21.15.146:0/1748122258 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5401f070 con 0x7fea601309f0 2023-10-03T10:17:03.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.331+0000 7fea477fe700 1 -- 172.21.15.146:0/1748122258 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea540045e0 con 0x7fea601309f0 2023-10-03T10:17:03.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.331+0000 7fea6532a700 1 -- 172.21.15.146:0/1748122258 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea54009550 con 0x7fea601309f0 2023-10-03T10:17:03.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.331+0000 7fea6532a700 1 -- 172.21.15.146:0/1748122258 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea60071fa0 con 0x7fea601309f0 2023-10-03T10:17:03.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.332+0000 7fea6532a700 1 -- 172.21.15.146:0/1748122258 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6012f8f0 con 0x7fea601309f0 2023-10-03T10:17:03.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.332+0000 7fea477fe700 1 -- 172.21.15.146:0/1748122258 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea54021030 con 0x7fea601309f0 2023-10-03T10:17:03.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.332+0000 7fea477fe700 1 -- 172.21.15.146:0/1748122258 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fea540407a0 con 0x7fea601309f0 2023-10-03T10:17:03.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.337+0000 7fea477fe700 1 -- 172.21.15.146:0/1748122258 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea540197c0 con 0x7fea601309f0 2023-10-03T10:17:03.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.373+0000 7f973a0ed700 1 Processor -- start 2023-10-03T10:17:03.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.373+0000 7f973a0ed700 1 -- start start 2023-10-03T10:17:03.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.374+0000 7f973a0ed700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f973406a770 0x7f973406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.374+0000 7f973a0ed700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f973409dec0 0x7f973406b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.374+0000 7f973a0ed700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9734131a00 0x7f9734131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.374+0000 7f973a0ed700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973406b5c0 con 0x7f973406a770 2023-10-03T10:17:03.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.374+0000 7f973a0ed700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973406e900 con 0x7f9734131a00 2023-10-03T10:17:03.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.374+0000 7f973a0ed700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f973409d180 con 0x7f973409dec0 2023-10-03T10:17:03.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.374+0000 7f97337fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f973406a770 0x7f973406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.374+0000 7f97337fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f973406a770 0x7f973406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32782/0 (socket says 172.21.15.146:32782) 2023-10-03T10:17:03.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.374+0000 7f97337fe700 1 -- 172.21.15.146:0/1191226619 learned_addr learned my addr 172.21.15.146:0/1191226619 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:03.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.374+0000 7f9733fff700 1 --2- 172.21.15.146:0/1191226619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9734131a00 0x7f9734131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.374+0000 7f9732ffd700 1 --2- 172.21.15.146:0/1191226619 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f973409dec0 0x7f973406b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.375+0000 7f97337fe700 1 -- 172.21.15.146:0/1191226619 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f973409dec0 msgr2=0x7f973406b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:03.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.375+0000 7f97337fe700 1 --2- 172.21.15.146:0/1191226619 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f973409dec0 0x7f973406b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.375+0000 7f97337fe700 1 -- 172.21.15.146:0/1191226619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9734131a00 msgr2=0x7f9734131e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:03.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.375+0000 7f97337fe700 1 --2- 172.21.15.146:0/1191226619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9734131a00 0x7f9734131e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.375+0000 7f97337fe700 1 -- 172.21.15.146:0/1191226619 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973409e780 con 0x7f973406a770 2023-10-03T10:17:03.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.375+0000 7f97337fe700 1 --2- 172.21.15.146:0/1191226619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f973406a770 0x7f973406ab40 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f97240098f0 tx=0x7f9724009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2603d9c2f7708e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.375+0000 7f97327fc700 1 -- 172.21.15.146:0/1191226619 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9724011830 con 0x7f973406a770 2023-10-03T10:17:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.375+0000 7f97327fc700 1 -- 172.21.15.146:0/1191226619 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9724011990 con 0x7f973406a770 2023-10-03T10:17:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.375+0000 7f97327fc700 1 -- 172.21.15.146:0/1191226619 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9724011d20 con 0x7f973406a770 2023-10-03T10:17:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.376+0000 7f973a0ed700 1 -- 172.21.15.146:0/1191226619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f973406a770 msgr2=0x7f973406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.376+0000 7f973a0ed700 1 --2- 172.21.15.146:0/1191226619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f973406a770 0x7f973406ab40 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f97240098f0 tx=0x7f9724009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.376+0000 7f973a0ed700 1 -- 172.21.15.146:0/1191226619 shutdown_connections 2023-10-03T10:17:03.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.376+0000 7f973a0ed700 1 --2- 172.21.15.146:0/1191226619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9734131a00 0x7f9734131e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.376+0000 7f973a0ed700 1 --2- 172.21.15.146:0/1191226619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f973406a770 0x7f973406ab40 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.376+0000 7f973a0ed700 1 --2- 172.21.15.146:0/1191226619 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f973409dec0 0x7f973406b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.376+0000 7f973a0ed700 1 -- 172.21.15.146:0/1191226619 >> 172.21.15.146:0/1191226619 conn(0x7f9734099c40 msgr2=0x7f97340a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.376+0000 7f973a0ed700 1 -- 172.21.15.146:0/1191226619 shutdown_connections 2023-10-03T10:17:03.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.376+0000 7f973a0ed700 1 -- 172.21.15.146:0/1191226619 wait complete. 2023-10-03T10:17:03.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.377+0000 7f973a0ed700 1 Processor -- start 2023-10-03T10:17:03.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.377+0000 7f973a0ed700 1 -- start start 2023-10-03T10:17:03.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.378+0000 7f973a0ed700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f973406a770 0x7f973409a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.378+0000 7f973a0ed700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f973409dec0 0x7f973409a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.378+0000 7f973a0ed700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9734131a00 0x7f973409af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.378+0000 7f973a0ed700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973411fc90 con 0x7f9734131a00 2023-10-03T10:17:03.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.378+0000 7f973a0ed700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973411ec30 con 0x7f973409dec0 2023-10-03T10:17:03.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.378+0000 7f973a0ed700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9734130f30 con 0x7f973406a770 2023-10-03T10:17:03.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.378+0000 7f97337fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f973406a770 0x7f973409a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.378+0000 7f9732ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f973409dec0 0x7f973409a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.378+0000 7f97337fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f973406a770 0x7f973409a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56272/0 (socket says 172.21.15.146:56272) 2023-10-03T10:17:03.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.378+0000 7f97337fe700 1 -- 172.21.15.146:0/3700464707 learned_addr learned my addr 172.21.15.146:0/3700464707 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:03.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.378+0000 7f9733fff700 1 --2- 172.21.15.146:0/3700464707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9734131a00 0x7f973409af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.378+0000 7f9733fff700 1 -- 172.21.15.146:0/3700464707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f973406a770 msgr2=0x7f973409a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.378+0000 7f9733fff700 1 --2- 172.21.15.146:0/3700464707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f973406a770 0x7f973409a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.378+0000 7f9733fff700 1 -- 172.21.15.146:0/3700464707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f973409dec0 msgr2=0x7f973409a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.378+0000 7f9733fff700 1 --2- 172.21.15.146:0/3700464707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f973409dec0 0x7f973409a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.378+0000 7f9733fff700 1 -- 172.21.15.146:0/3700464707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9724009550 con 0x7f9734131a00 2023-10-03T10:17:03.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.378+0000 7f97337fe700 1 --2- 172.21.15.146:0/3700464707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f973406a770 0x7f973409a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.378+0000 7f9732ffd700 1 --2- 172.21.15.146:0/3700464707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f973409dec0 0x7f973409a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.379+0000 7f9733fff700 1 --2- 172.21.15.146:0/3700464707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9734131a00 0x7f973409af10 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f972c00efc0 tx=0x7f972c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.379+0000 7f971bfff700 1 -- 172.21.15.146:0/3700464707 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c00cc90 con 0x7f9734131a00 2023-10-03T10:17:03.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.379+0000 7f971bfff700 1 -- 172.21.15.146:0/3700464707 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c00f040 con 0x7f9734131a00 2023-10-03T10:17:03.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.379+0000 7f973a0ed700 1 -- 172.21.15.146:0/3700464707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9734071ce0 con 0x7f9734131a00 2023-10-03T10:17:03.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.379+0000 7f971bfff700 1 -- 172.21.15.146:0/3700464707 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0146c0 con 0x7f9734131a00 2023-10-03T10:17:03.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.379+0000 7f973a0ed700 1 -- 172.21.15.146:0/3700464707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973412d5a0 con 0x7f9734131a00 2023-10-03T10:17:03.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.380+0000 7f971bfff700 1 -- 172.21.15.146:0/3700464707 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f972c014820 con 0x7f9734131a00 2023-10-03T10:17:03.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.380+0000 7f971bfff700 1 -- 172.21.15.146:0/3700464707 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f972c0401a0 con 0x7f9734131a00 2023-10-03T10:17:03.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.380+0000 7f973a0ed700 1 -- 172.21.15.146:0/3700464707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973411f540 con 0x7f9734131a00 2023-10-03T10:17:03.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.389+0000 7f971bfff700 1 -- 172.21.15.146:0/3700464707 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f972c01d400 con 0x7f9734131a00 2023-10-03T10:17:03.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.407+0000 7fdb45003700 1 -- 172.21.15.146:0/277849871 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdb4004f2a0 con 0x7fdb40133ad0 2023-10-03T10:17:03.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.407+0000 7fdb277fe700 1 -- 172.21.15.146:0/277849871 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb3401b340 con 0x7fdb40133ad0 2023-10-03T10:17:03.407 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:03.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.409+0000 7fdb45003700 1 -- 172.21.15.146:0/277849871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb40133ad0 msgr2=0x7fdb4012cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.409+0000 7fdb45003700 1 --2- 172.21.15.146:0/277849871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb40133ad0 0x7fdb4012cb30 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400c3c0 tx=0x7fdb3400c6d0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.409+0000 7fdb45003700 1 -- 172.21.15.146:0/277849871 shutdown_connections 2023-10-03T10:17:03.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.409+0000 7fdb45003700 1 --2- 172.21.15.146:0/277849871 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb40139280 0x7fdb4012d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.409+0000 7fdb45003700 1 --2- 172.21.15.146:0/277849871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb40133ad0 0x7fdb4012cb30 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.409+0000 7fdb45003700 1 --2- 172.21.15.146:0/277849871 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb40136960 0x7fdb4012d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.409+0000 7fdb45003700 1 -- 172.21.15.146:0/277849871 >> 172.21.15.146:0/277849871 conn(0x7fdb40099c40 msgr2=0x7fdb400a3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.410+0000 7fdb45003700 1 -- 172.21.15.146:0/277849871 shutdown_connections 2023-10-03T10:17:03.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.410+0000 7fdb45003700 1 -- 172.21.15.146:0/277849871 wait complete. 2023-10-03T10:17:03.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:03.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.539+0000 7fea6532a700 1 -- 172.21.15.146:0/1748122258 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fea6004f2a0 con 0x7fea601309f0 2023-10-03T10:17:03.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.540+0000 7fea477fe700 1 -- 172.21.15.146:0/1748122258 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fea54015030 con 0x7fea601309f0 2023-10-03T10:17:03.540 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:03.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.543+0000 7fea6532a700 1 -- 172.21.15.146:0/1748122258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea601309f0 msgr2=0x7fea6011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.543+0000 7fea6532a700 1 --2- 172.21.15.146:0/1748122258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea601309f0 0x7fea6011df80 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fea6006e5d0 tx=0x7fea54004750 comp rx=0 tx=0).stop 2023-10-03T10:17:03.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.543+0000 7fea6532a700 1 -- 172.21.15.146:0/1748122258 shutdown_connections 2023-10-03T10:17:03.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.543+0000 7fea6532a700 1 --2- 172.21.15.146:0/1748122258 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fea60133ad0 0x7fea6011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.543+0000 7fea6532a700 1 --2- 172.21.15.146:0/1748122258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea601300a0 0x7fea6011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.543+0000 7fea6532a700 1 --2- 172.21.15.146:0/1748122258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea601309f0 0x7fea6011df80 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.543+0000 7fea6532a700 1 -- 172.21.15.146:0/1748122258 >> 172.21.15.146:0/1748122258 conn(0x7fea60099c40 msgr2=0x7fea6012e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.543+0000 7fea6532a700 1 -- 172.21.15.146:0/1748122258 shutdown_connections 2023-10-03T10:17:03.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.543+0000 7fea6532a700 1 -- 172.21.15.146:0/1748122258 wait complete. 2023-10-03T10:17:03.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.594+0000 7f973a0ed700 1 -- 172.21.15.146:0/3700464707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f973404f2a0 con 0x7f9734131a00 2023-10-03T10:17:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.595+0000 7f971bfff700 1 -- 172.21.15.146:0/3700464707 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f972c007330 con 0x7f9734131a00 2023-10-03T10:17:03.594 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:03.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.597+0000 7f973a0ed700 1 -- 172.21.15.146:0/3700464707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9734131a00 msgr2=0x7f973409af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.597+0000 7f973a0ed700 1 --2- 172.21.15.146:0/3700464707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9734131a00 0x7f973409af10 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f972c00efc0 tx=0x7f972c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.597+0000 7f973a0ed700 1 -- 172.21.15.146:0/3700464707 shutdown_connections 2023-10-03T10:17:03.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.597+0000 7f973a0ed700 1 --2- 172.21.15.146:0/3700464707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9734131a00 0x7f973409af10 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.597+0000 7f973a0ed700 1 --2- 172.21.15.146:0/3700464707 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f973406a770 0x7f973409a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.597+0000 7f973a0ed700 1 --2- 172.21.15.146:0/3700464707 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f973409dec0 0x7f973409a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.597+0000 7f973a0ed700 1 -- 172.21.15.146:0/3700464707 >> 172.21.15.146:0/3700464707 conn(0x7f9734099c40 msgr2=0x7f973412ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.597+0000 7f973a0ed700 1 -- 172.21.15.146:0/3700464707 shutdown_connections 2023-10-03T10:17:03.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.597+0000 7f973a0ed700 1 -- 172.21.15.146:0/3700464707 wait complete. 2023-10-03T10:17:03.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:03.779 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:03.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.902+0000 7f0505e1b700 1 Processor -- start 2023-10-03T10:17:03.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.902+0000 7f0505e1b700 1 -- start start 2023-10-03T10:17:03.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.903+0000 7f0505e1b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f050009f350 0x7f0500136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.903+0000 7f0505e1b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05001371c0 0x7f05001395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.903+0000 7f0505e1b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050009c970 con 0x7f050009e870 2023-10-03T10:17:03.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.903+0000 7f0505e1b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05000a0920 con 0x7f050009f350 2023-10-03T10:17:03.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.903+0000 7f0505e1b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f050009f9c0 con 0x7f05001371c0 2023-10-03T10:17:03.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.903+0000 7f04ff7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f050009e870 0x7f050009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44188/0 (socket says 172.21.15.146:44188) 2023-10-03T10:17:03.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.903+0000 7f04ff7fe700 1 -- 172.21.15.146:0/3655541578 learned_addr learned my addr 172.21.15.146:0/3655541578 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:03.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.903+0000 7f04feffd700 1 --2- 172.21.15.146:0/3655541578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f050009f350 0x7f0500136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.903+0000 7f04fffff700 1 --2- 172.21.15.146:0/3655541578 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05001371c0 0x7f05001395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.903+0000 7f04fe7fc700 1 -- 172.21.15.146:0/3655541578 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279778871 0 0) 0x7f050009c970 con 0x7f050009e870 2023-10-03T10:17:03.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.903+0000 7f04fe7fc700 1 -- 172.21.15.146:0/3655541578 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04ec0035b0 con 0x7f050009e870 2023-10-03T10:17:03.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.903+0000 7f04fffff700 1 -- 172.21.15.146:0/3655541578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f050009f350 msgr2=0x7f0500136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:03.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.903+0000 7f04fffff700 1 --2- 172.21.15.146:0/3655541578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f050009f350 0x7f0500136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.903+0000 7f04fffff700 1 -- 172.21.15.146:0/3655541578 >> v1:172.21.15.146:6789/0 conn(0x7f050009e870 legacy=0x7f050009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.903+0000 7f04fffff700 1 -- 172.21.15.146:0/3655541578 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050009bab0 con 0x7f05001371c0 2023-10-03T10:17:03.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.903+0000 7f04feffd700 1 --2- 172.21.15.146:0/3655541578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f050009f350 0x7f0500136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.903+0000 7f04fffff700 1 --2- 172.21.15.146:0/3655541578 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05001371c0 0x7f05001395a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009dc0 tx=0x7f04f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ace9539161385b1d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.904+0000 7f04fe7fc700 1 -- 172.21.15.146:0/3655541578 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f800e070 con 0x7f05001371c0 2023-10-03T10:17:03.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.904+0000 7f04fe7fc700 1 -- 172.21.15.146:0/3655541578 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f800bb20 con 0x7f05001371c0 2023-10-03T10:17:03.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.904+0000 7f04fe7fc700 1 -- 172.21.15.146:0/3655541578 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8012430 con 0x7f05001371c0 2023-10-03T10:17:03.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.904+0000 7f0505e1b700 1 -- 172.21.15.146:0/3655541578 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05001371c0 msgr2=0x7f05001395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.904+0000 7f0505e1b700 1 --2- 172.21.15.146:0/3655541578 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05001371c0 0x7f05001395a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009dc0 tx=0x7f04f800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:03.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.904+0000 7f0505e1b700 1 -- 172.21.15.146:0/3655541578 shutdown_connections 2023-10-03T10:17:03.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.904+0000 7f0505e1b700 1 --2- 172.21.15.146:0/3655541578 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05001371c0 0x7f05001395a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.904+0000 7f0505e1b700 1 --2- 172.21.15.146:0/3655541578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f050009f350 0x7f0500136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.904+0000 7f0505e1b700 1 -- 172.21.15.146:0/3655541578 >> 172.21.15.146:0/3655541578 conn(0x7f05000a4430 msgr2=0x7f05000a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.904+0000 7f0505e1b700 1 -- 172.21.15.146:0/3655541578 shutdown_connections 2023-10-03T10:17:03.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.904+0000 7f0505e1b700 1 -- 172.21.15.146:0/3655541578 wait complete. 2023-10-03T10:17:03.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.905+0000 7f0505e1b700 1 Processor -- start 2023-10-03T10:17:03.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.905+0000 7f0505e1b700 1 -- start start 2023-10-03T10:17:03.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f0505e1b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f050009e870 0x7f050011f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f0505e1b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f050009f350 0x7f050011faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f0505e1b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05001371c0 0x7f050011ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f0505e1b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0500122e00 con 0x7f050009e870 2023-10-03T10:17:03.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f0505e1b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0500123be0 con 0x7f05001371c0 2023-10-03T10:17:03.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f0505e1b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0500123000 con 0x7f050009f350 2023-10-03T10:17:03.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f04feffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f050009f350 0x7f050011faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f04feffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f050009f350 0x7f050011faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56296/0 (socket says 172.21.15.146:56296) 2023-10-03T10:17:03.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f04ff7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f050009e870 0x7f050011f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f04fffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05001371c0 0x7f050011ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f04feffd700 1 -- 172.21.15.146:0/3859431016 learned_addr learned my addr 172.21.15.146:0/3859431016 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:03.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f04fffff700 1 -- 172.21.15.146:0/3859431016 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f050009f350 msgr2=0x7f050011faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f04fffff700 1 --2- 172.21.15.146:0/3859431016 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f050009f350 0x7f050011faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f04fffff700 1 -- 172.21.15.146:0/3859431016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f050009e870 msgr2=0x7f050011f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f04fffff700 1 --2- 172.21.15.146:0/3859431016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f050009e870 0x7f050011f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f04fffff700 1 -- 172.21.15.146:0/3859431016 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f00094a0 con 0x7f05001371c0 2023-10-03T10:17:03.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f04feffd700 1 --2- 172.21.15.146:0/3859431016 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f050009f350 0x7f050011faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f04fffff700 1 --2- 172.21.15.146:0/3859431016 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05001371c0 0x7f050011ffe0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0500067370 tx=0x7f04f8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f04f7fff700 1 -- 172.21.15.146:0/3859431016 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8004800 con 0x7f05001371c0 2023-10-03T10:17:03.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f04f7fff700 1 -- 172.21.15.146:0/3859431016 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f8020070 con 0x7f05001371c0 2023-10-03T10:17:03.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f0505e1b700 1 -- 172.21.15.146:0/3859431016 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f8009a70 con 0x7f05001371c0 2023-10-03T10:17:03.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f04f7fff700 1 -- 172.21.15.146:0/3859431016 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f80276c0 con 0x7f05001371c0 2023-10-03T10:17:03.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.906+0000 7f0505e1b700 1 -- 172.21.15.146:0/3859431016 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050009dba0 con 0x7f05001371c0 2023-10-03T10:17:03.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.907+0000 7f04f7fff700 1 -- 172.21.15.146:0/3859431016 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f04f8012430 con 0x7f05001371c0 2023-10-03T10:17:03.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.907+0000 7f04f7fff700 1 -- 172.21.15.146:0/3859431016 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f04f8022070 con 0x7f05001371c0 2023-10-03T10:17:03.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.907+0000 7f0505e1b700 1 -- 172.21.15.146:0/3859431016 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0500121080 con 0x7f05001371c0 2023-10-03T10:17:03.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:03.912+0000 7f04f7fff700 1 -- 172.21.15.146:0/3859431016 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04f801a790 con 0x7f05001371c0 2023-10-03T10:17:04.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.094+0000 7f0505e1b700 1 -- 172.21.15.146:0/3859431016 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f050004f2a0 con 0x7f05001371c0 2023-10-03T10:17:04.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.095+0000 7f04f7fff700 1 -- 172.21.15.146:0/3859431016 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f04f802c020 con 0x7f05001371c0 2023-10-03T10:17:04.095 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:04.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.097+0000 7f0505e1b700 1 -- 172.21.15.146:0/3859431016 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05001371c0 msgr2=0x7f050011ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.097+0000 7f0505e1b700 1 --2- 172.21.15.146:0/3859431016 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05001371c0 0x7f050011ffe0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0500067370 tx=0x7f04f8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.097+0000 7f0505e1b700 1 -- 172.21.15.146:0/3859431016 shutdown_connections 2023-10-03T10:17:04.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.097+0000 7f0505e1b700 1 --2- 172.21.15.146:0/3859431016 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05001371c0 0x7f050011ffe0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.097+0000 7f0505e1b700 1 --2- 172.21.15.146:0/3859431016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f050009e870 0x7f050011f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.097+0000 7f0505e1b700 1 --2- 172.21.15.146:0/3859431016 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f050009f350 0x7f050011faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.097+0000 7f0505e1b700 1 -- 172.21.15.146:0/3859431016 >> 172.21.15.146:0/3859431016 conn(0x7f05000a4430 msgr2=0x7f0500135a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.097+0000 7f0505e1b700 1 -- 172.21.15.146:0/3859431016 shutdown_connections 2023-10-03T10:17:04.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.097+0000 7f0505e1b700 1 -- 172.21.15.146:0/3859431016 wait complete. 2023-10-03T10:17:04.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:04.422 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:04.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.547+0000 7fb69bc4b700 1 Processor -- start 2023-10-03T10:17:04.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.547+0000 7fb69bc4b700 1 -- start start 2023-10-03T10:17:04.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.548+0000 7fb69bc4b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb69409e870 0x7fb69409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.548+0000 7fb69bc4b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb694134330 0x7fb69413be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.548+0000 7fb69bc4b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb69409fa00 con 0x7fb69409f180 2023-10-03T10:17:04.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.548+0000 7fb69bc4b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6940a0370 con 0x7fb694134330 2023-10-03T10:17:04.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.548+0000 7fb69bc4b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb69406bec0 con 0x7fb69409e870 2023-10-03T10:17:04.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.548+0000 7fb6991e6700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb69409f180 0x7fb694133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44548/0 (socket says 172.21.15.146:44548) 2023-10-03T10:17:04.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.548+0000 7fb69a1e8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb694134330 0x7fb69413be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.548+0000 7fb6991e6700 1 -- 172.21.15.146:0/541850305 learned_addr learned my addr 172.21.15.146:0/541850305 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:04.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.548+0000 7fb6999e7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb69409e870 0x7fb69409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.548+0000 7fb6989e5700 1 -- 172.21.15.146:0/541850305 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393273723 0 0) 0x7fb69409fa00 con 0x7fb69409f180 2023-10-03T10:17:04.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.549+0000 7fb69a1e8700 1 -- 172.21.15.146:0/541850305 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb69409e870 msgr2=0x7fb69409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:04.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.549+0000 7fb69a1e8700 1 --2- 172.21.15.146:0/541850305 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb69409e870 0x7fb69409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.549+0000 7fb69a1e8700 1 -- 172.21.15.146:0/541850305 >> v1:172.21.15.146:6789/0 conn(0x7fb69409f180 legacy=0x7fb694133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.549+0000 7fb69a1e8700 1 -- 172.21.15.146:0/541850305 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69409ada0 con 0x7fb694134330 2023-10-03T10:17:04.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.549+0000 7fb6999e7700 1 --2- 172.21.15.146:0/541850305 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb69409e870 0x7fb69409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:04.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.549+0000 7fb69a1e8700 1 --2- 172.21.15.146:0/541850305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb694134330 0x7fb69413be80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb68c009dc0 tx=0x7fb68c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58b92747e4a0946b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:04.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.549+0000 7fb6989e5700 1 -- 172.21.15.146:0/541850305 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c00e070 con 0x7fb694134330 2023-10-03T10:17:04.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.549+0000 7fb6989e5700 1 -- 172.21.15.146:0/541850305 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c00bb20 con 0x7fb694134330 2023-10-03T10:17:04.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.549+0000 7fb6989e5700 1 -- 172.21.15.146:0/541850305 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c012430 con 0x7fb694134330 2023-10-03T10:17:04.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.549+0000 7fb69bc4b700 1 -- 172.21.15.146:0/541850305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb694134330 msgr2=0x7fb69413be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.549+0000 7fb69bc4b700 1 --2- 172.21.15.146:0/541850305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb694134330 0x7fb69413be80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb68c009dc0 tx=0x7fb68c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:04.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.550+0000 7fb69bc4b700 1 -- 172.21.15.146:0/541850305 shutdown_connections 2023-10-03T10:17:04.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.550+0000 7fb69bc4b700 1 --2- 172.21.15.146:0/541850305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb694134330 0x7fb69413be80 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.550+0000 7fb69bc4b700 1 --2- 172.21.15.146:0/541850305 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb69409e870 0x7fb69409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.550+0000 7fb69bc4b700 1 -- 172.21.15.146:0/541850305 >> 172.21.15.146:0/541850305 conn(0x7fb6940a4430 msgr2=0x7fb6940a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.550+0000 7fb69bc4b700 1 -- 172.21.15.146:0/541850305 shutdown_connections 2023-10-03T10:17:04.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.550+0000 7fb69bc4b700 1 -- 172.21.15.146:0/541850305 wait complete. 2023-10-03T10:17:04.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.550+0000 7fb69bc4b700 1 Processor -- start 2023-10-03T10:17:04.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.551+0000 7fb69bc4b700 1 -- start start 2023-10-03T10:17:04.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.551+0000 7fb69bc4b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb69409e870 0x7fb6941227f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.551+0000 7fb69bc4b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb69409f180 0x7fb694122d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.551+0000 7fb69bc4b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb694134330 0x7fb694123270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.551+0000 7fb69bc4b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb694126310 con 0x7fb69409e870 2023-10-03T10:17:04.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.551+0000 7fb69bc4b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb694124400 con 0x7fb69409f180 2023-10-03T10:17:04.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.551+0000 7fb69bc4b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6940a16c0 con 0x7fb694134330 2023-10-03T10:17:04.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.551+0000 7fb6991e6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb69409f180 0x7fb694122d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.551+0000 7fb69a1e8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb694134330 0x7fb694123270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.551+0000 7fb69a1e8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb694134330 0x7fb694123270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56864/0 (socket says 172.21.15.146:56864) 2023-10-03T10:17:04.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.551+0000 7fb6991e6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb69409f180 0x7fb694122d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56740/0 (socket says 172.21.15.146:56740) 2023-10-03T10:17:04.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.551+0000 7fb69a1e8700 1 -- 172.21.15.146:0/1674589238 learned_addr learned my addr 172.21.15.146:0/1674589238 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:04.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.551+0000 7fb6999e7700 1 --2- 172.21.15.146:0/1674589238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb69409e870 0x7fb6941227f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.551+0000 7fb6991e6700 1 -- 172.21.15.146:0/1674589238 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb694134330 msgr2=0x7fb694123270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.551+0000 7fb6991e6700 1 --2- 172.21.15.146:0/1674589238 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb694134330 0x7fb694123270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.551+0000 7fb6991e6700 1 -- 172.21.15.146:0/1674589238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb69409e870 msgr2=0x7fb6941227f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.551+0000 7fb6991e6700 1 --2- 172.21.15.146:0/1674589238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb69409e870 0x7fb6941227f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.551+0000 7fb6991e6700 1 -- 172.21.15.146:0/1674589238 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6880094a0 con 0x7fb69409f180 2023-10-03T10:17:04.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.551+0000 7fb69a1e8700 1 --2- 172.21.15.146:0/1674589238 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb694134330 0x7fb694123270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:04.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.551+0000 7fb6999e7700 1 --2- 172.21.15.146:0/1674589238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb69409e870 0x7fb6941227f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:04.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.551+0000 7fb6991e6700 1 --2- 172.21.15.146:0/1674589238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb69409f180 0x7fb694122d30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb694067390 tx=0x7fb69000c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:04.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.552+0000 7fb6867fc700 1 -- 172.21.15.146:0/1674589238 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb690004c80 con 0x7fb69409f180 2023-10-03T10:17:04.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.552+0000 7fb6867fc700 1 -- 172.21.15.146:0/1674589238 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb690004de0 con 0x7fb69409f180 2023-10-03T10:17:04.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.552+0000 7fb69bc4b700 1 -- 172.21.15.146:0/1674589238 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb68c009a70 con 0x7fb69409f180 2023-10-03T10:17:04.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.552+0000 7fb6867fc700 1 -- 172.21.15.146:0/1674589238 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb690007310 con 0x7fb69409f180 2023-10-03T10:17:04.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.552+0000 7fb69bc4b700 1 -- 172.21.15.146:0/1674589238 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb694133310 con 0x7fb69409f180 2023-10-03T10:17:04.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.552+0000 7fb6867fc700 1 -- 172.21.15.146:0/1674589238 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb690007470 con 0x7fb69409f180 2023-10-03T10:17:04.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.553+0000 7fb6867fc700 1 -- 172.21.15.146:0/1674589238 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb69003f1f0 con 0x7fb69409f180 2023-10-03T10:17:04.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.553+0000 7fb69bc4b700 1 -- 172.21.15.146:0/1674589238 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb694125c80 con 0x7fb69409f180 2023-10-03T10:17:04.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.557+0000 7fb6867fc700 1 -- 172.21.15.146:0/1674589238 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb690007720 con 0x7fb69409f180 2023-10-03T10:17:04.560 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:04.609 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:04.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.685+0000 7f48a6b95700 1 Processor -- start 2023-10-03T10:17:04.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.685+0000 7f48a6b95700 1 -- start start 2023-10-03T10:17:04.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.685+0000 7f48a6b95700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a00a1550 0x7f48a0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.685+0000 7f48a6b95700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f48a0139200 0x7f48a013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.685+0000 7f48a6b95700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a009e9d0 con 0x7f48a00a0a70 2023-10-03T10:17:04.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.685+0000 7f48a6b95700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a009dc00 con 0x7f48a0139200 2023-10-03T10:17:04.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.685+0000 7f48a6b95700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a009dec0 con 0x7f48a00a1550 2023-10-03T10:17:04.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.686+0000 7f48a5132700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f48a0139200 0x7f48a013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.686+0000 7f489ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a00a1550 0x7f48a0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.686+0000 7f48a5132700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f48a0139200 0x7f48a013b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60912/0 (socket says 172.21.15.146:60912) 2023-10-03T10:17:04.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.686+0000 7f48a4931700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f48a00a0a70 0x7f48a00a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44550/0 (socket says 172.21.15.146:44550) 2023-10-03T10:17:04.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.686+0000 7f48a5132700 1 -- 172.21.15.146:0/2529231236 learned_addr learned my addr 172.21.15.146:0/2529231236 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:04.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.686+0000 7f489f7fe700 1 -- 172.21.15.146:0/2529231236 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55099993 0 0) 0x7f48a009e9d0 con 0x7f48a00a0a70 2023-10-03T10:17:04.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.686+0000 7f489f7fe700 1 -- 172.21.15.146:0/2529231236 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48900035b0 con 0x7f48a00a0a70 2023-10-03T10:17:04.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.686+0000 7f489ffff700 1 -- 172.21.15.146:0/2529231236 >> v2:172.21.15.146:3300/0 conn(0x7f48a0139200 msgr2=0x7f48a013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:04.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.686+0000 7f489ffff700 1 --2- 172.21.15.146:0/2529231236 >> v2:172.21.15.146:3300/0 conn(0x7f48a0139200 0x7f48a013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.686+0000 7f489ffff700 1 -- 172.21.15.146:0/2529231236 >> v1:172.21.15.146:6789/0 conn(0x7f48a00a0a70 legacy=0x7f48a00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.686+0000 7f489ffff700 1 -- 172.21.15.146:0/2529231236 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a009e6a0 con 0x7f48a00a1550 2023-10-03T10:17:04.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.686+0000 7f48a5132700 1 --2- 172.21.15.146:0/2529231236 >> v2:172.21.15.146:3300/0 conn(0x7f48a0139200 0x7f48a013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:04.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.686+0000 7f489ffff700 1 --2- 172.21.15.146:0/2529231236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a00a1550 0x7f48a0138cc0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f488c009840 tx=0x7f488c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d71228a07614bcd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:04.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.686+0000 7f489f7fe700 1 -- 172.21.15.146:0/2529231236 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c004230 con 0x7f48a00a1550 2023-10-03T10:17:04.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.686+0000 7f489f7fe700 1 -- 172.21.15.146:0/2529231236 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488c004390 con 0x7f48a00a1550 2023-10-03T10:17:04.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.686+0000 7f489f7fe700 1 -- 172.21.15.146:0/2529231236 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c0036a0 con 0x7f48a00a1550 2023-10-03T10:17:04.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.687+0000 7f48a6b95700 1 -- 172.21.15.146:0/2529231236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a00a1550 msgr2=0x7f48a0138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.687+0000 7f48a6b95700 1 --2- 172.21.15.146:0/2529231236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a00a1550 0x7f48a0138cc0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f488c009840 tx=0x7f488c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:04.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.687+0000 7f48a6b95700 1 -- 172.21.15.146:0/2529231236 shutdown_connections 2023-10-03T10:17:04.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.687+0000 7f48a6b95700 1 --2- 172.21.15.146:0/2529231236 >> v2:172.21.15.146:3300/0 conn(0x7f48a0139200 0x7f48a013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.687+0000 7f48a6b95700 1 --2- 172.21.15.146:0/2529231236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a00a1550 0x7f48a0138cc0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.687+0000 7f48a6b95700 1 -- 172.21.15.146:0/2529231236 >> 172.21.15.146:0/2529231236 conn(0x7f48a00a6610 msgr2=0x7f48a00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.687+0000 7f48a6b95700 1 -- 172.21.15.146:0/2529231236 shutdown_connections 2023-10-03T10:17:04.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.687+0000 7f48a6b95700 1 -- 172.21.15.146:0/2529231236 wait complete. 2023-10-03T10:17:04.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.689+0000 7f48a6b95700 1 Processor -- start 2023-10-03T10:17:04.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.689+0000 7f48a6b95700 1 -- start start 2023-10-03T10:17:04.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.690+0000 7f48a6b95700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a00a0a70 0x7f48a01c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.690+0000 7f48a6b95700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48a00a1550 0x7f48a01c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.690+0000 7f48a6b95700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48a0139200 0x7f48a011e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.690+0000 7f48a6b95700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a0120c20 con 0x7f48a0139200 2023-10-03T10:17:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.690+0000 7f48a6b95700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a0120510 con 0x7f48a00a0a70 2023-10-03T10:17:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.690+0000 7f48a6b95700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48a00a5100 con 0x7f48a00a1550 2023-10-03T10:17:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.690+0000 7f48a4931700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a00a0a70 0x7f48a01c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.690+0000 7f48a4931700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a00a0a70 0x7f48a01c8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56760/0 (socket says 172.21.15.146:56760) 2023-10-03T10:17:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.690+0000 7f48a4931700 1 -- 172.21.15.146:0/1979002556 learned_addr learned my addr 172.21.15.146:0/1979002556 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.690+0000 7f48a5132700 1 --2- 172.21.15.146:0/1979002556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48a0139200 0x7f48a011e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.690+0000 7f48a4931700 1 -- 172.21.15.146:0/1979002556 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48a00a1550 msgr2=0x7f48a01c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.690+0000 7f48a4931700 1 --2- 172.21.15.146:0/1979002556 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48a00a1550 0x7f48a01c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.690+0000 7f48a4931700 1 -- 172.21.15.146:0/1979002556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48a0139200 msgr2=0x7f48a011e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.690+0000 7f48a4931700 1 --2- 172.21.15.146:0/1979002556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48a0139200 0x7f48a011e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.690+0000 7f48a4931700 1 -- 172.21.15.146:0/1979002556 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4898009b30 con 0x7f48a00a0a70 2023-10-03T10:17:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.690+0000 7f48a4931700 1 --2- 172.21.15.146:0/1979002556 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a00a0a70 0x7f48a01c8580 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f48940011e0 tx=0x7f489400ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:04.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.690+0000 7f489d7fa700 1 -- 172.21.15.146:0/1979002556 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894004c80 con 0x7f48a00a0a70 2023-10-03T10:17:04.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.690+0000 7f489d7fa700 1 -- 172.21.15.146:0/1979002556 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4894004de0 con 0x7f48a00a0a70 2023-10-03T10:17:04.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.690+0000 7f48a6b95700 1 -- 172.21.15.146:0/1979002556 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488c0094a0 con 0x7f48a00a0a70 2023-10-03T10:17:04.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.691+0000 7f489d7fa700 1 -- 172.21.15.146:0/1979002556 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894007310 con 0x7f48a00a0a70 2023-10-03T10:17:04.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.691+0000 7f48a6b95700 1 -- 172.21.15.146:0/1979002556 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a0121a40 con 0x7f48a00a0a70 2023-10-03T10:17:04.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.691+0000 7f489d7fa700 1 -- 172.21.15.146:0/1979002556 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4894007470 con 0x7f48a00a0a70 2023-10-03T10:17:04.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.691+0000 7f48a6b95700 1 -- 172.21.15.146:0/1979002556 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a004f2a0 con 0x7f48a00a0a70 2023-10-03T10:17:04.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.692+0000 7f489d7fa700 1 -- 172.21.15.146:0/1979002556 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f489403f450 con 0x7f48a00a0a70 2023-10-03T10:17:04.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.696+0000 7f489d7fa700 1 -- 172.21.15.146:0/1979002556 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f489401a6c0 con 0x7f48a00a0a70 2023-10-03T10:17:04.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.737+0000 7fb446307700 1 Processor -- start 2023-10-03T10:17:04.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.737+0000 7fb446307700 1 -- start start 2023-10-03T10:17:04.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.737+0000 7fb446307700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb440133ad0 0x7fb440133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.737+0000 7fb446307700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4401300a0 0x7fb4401304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.737+0000 7fb446307700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb4401309f0 0x7fb44013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.737+0000 7fb446307700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb44006b2d0 con 0x7fb4401309f0 2023-10-03T10:17:04.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.737+0000 7fb446307700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb440133610 con 0x7fb4401300a0 2023-10-03T10:17:04.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.737+0000 7fb446307700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb44009a500 con 0x7fb440133ad0 2023-10-03T10:17:04.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.737+0000 7fb43ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb440133ad0 0x7fb440133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.737+0000 7fb43f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4401300a0 0x7fb4401304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.737+0000 7fb43ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb440133ad0 0x7fb440133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56886/0 (socket says 172.21.15.146:56886) 2023-10-03T10:17:04.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.737+0000 7fb43ffff700 1 -- 172.21.15.146:0/3563541902 learned_addr learned my addr 172.21.15.146:0/3563541902 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:04.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.737+0000 7fb4448a4700 1 --2- 172.21.15.146:0/3563541902 >> v2:172.21.15.146:3300/0 conn(0x7fb4401309f0 0x7fb44013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.738+0000 7fb43ffff700 1 -- 172.21.15.146:0/3563541902 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4401300a0 msgr2=0x7fb4401304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:04.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.738+0000 7fb43ffff700 1 --2- 172.21.15.146:0/3563541902 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4401300a0 0x7fb4401304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.738+0000 7fb43ffff700 1 -- 172.21.15.146:0/3563541902 >> v2:172.21.15.146:3300/0 conn(0x7fb4401309f0 msgr2=0x7fb44013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:04.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.738+0000 7fb43ffff700 1 --2- 172.21.15.146:0/3563541902 >> v2:172.21.15.146:3300/0 conn(0x7fb4401309f0 0x7fb44013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.738+0000 7fb43ffff700 1 -- 172.21.15.146:0/3563541902 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4401338b0 con 0x7fb440133ad0 2023-10-03T10:17:04.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.738+0000 7fb43f7fe700 1 --2- 172.21.15.146:0/3563541902 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4401300a0 0x7fb4401304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:04.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.738+0000 7fb4448a4700 1 --2- 172.21.15.146:0/3563541902 >> v2:172.21.15.146:3300/0 conn(0x7fb4401309f0 0x7fb44013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:04.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.738+0000 7fb43ffff700 1 --2- 172.21.15.146:0/3563541902 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb440133ad0 0x7fb440133ea0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb4300098f0 tx=0x7fb430009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abd58b8df226be7f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:04.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.738+0000 7fb43effd700 1 -- 172.21.15.146:0/3563541902 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb430011830 con 0x7fb440133ad0 2023-10-03T10:17:04.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.738+0000 7fb43effd700 1 -- 172.21.15.146:0/3563541902 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb430011990 con 0x7fb440133ad0 2023-10-03T10:17:04.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.738+0000 7fb43effd700 1 -- 172.21.15.146:0/3563541902 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb430011d20 con 0x7fb440133ad0 2023-10-03T10:17:04.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.738+0000 7fb446307700 1 -- 172.21.15.146:0/3563541902 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb440133ad0 msgr2=0x7fb440133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.738+0000 7fb446307700 1 --2- 172.21.15.146:0/3563541902 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb440133ad0 0x7fb440133ea0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb4300098f0 tx=0x7fb430009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:04.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.738+0000 7fb446307700 1 -- 172.21.15.146:0/3563541902 shutdown_connections 2023-10-03T10:17:04.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.738+0000 7fb446307700 1 --2- 172.21.15.146:0/3563541902 >> v2:172.21.15.146:3300/0 conn(0x7fb4401309f0 0x7fb44013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.738+0000 7fb446307700 1 --2- 172.21.15.146:0/3563541902 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb440133ad0 0x7fb440133ea0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.738+0000 7fb446307700 1 --2- 172.21.15.146:0/3563541902 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4401300a0 0x7fb4401304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.738+0000 7fb446307700 1 -- 172.21.15.146:0/3563541902 >> 172.21.15.146:0/3563541902 conn(0x7fb440099c40 msgr2=0x7fb4400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.739+0000 7fb446307700 1 -- 172.21.15.146:0/3563541902 shutdown_connections 2023-10-03T10:17:04.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.739+0000 7fb446307700 1 -- 172.21.15.146:0/3563541902 wait complete. 2023-10-03T10:17:04.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.739+0000 7fb446307700 1 Processor -- start 2023-10-03T10:17:04.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.740+0000 7fb446307700 1 -- start start 2023-10-03T10:17:04.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.740+0000 7fb446307700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4401300a0 0x7fb4401c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.740+0000 7fb446307700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4401309f0 0x7fb4401c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.740+0000 7fb446307700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb440133ad0 0x7fb4401c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.740+0000 7fb446307700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44012da50 con 0x7fb4401309f0 2023-10-03T10:17:04.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.740+0000 7fb446307700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb440072230 con 0x7fb440133ad0 2023-10-03T10:17:04.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.740+0000 7fb446307700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb44011fe50 con 0x7fb4401300a0 2023-10-03T10:17:04.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.740+0000 7fb43f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4401309f0 0x7fb4401c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.740+0000 7fb43ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4401300a0 0x7fb4401c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.740+0000 7fb43f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4401309f0 0x7fb4401c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60928/0 (socket says 172.21.15.146:60928) 2023-10-03T10:17:04.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.740+0000 7fb43f7fe700 1 -- 172.21.15.146:0/1084481135 learned_addr learned my addr 172.21.15.146:0/1084481135 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:04.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.740+0000 7fb4448a4700 1 --2- 172.21.15.146:0/1084481135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb440133ad0 0x7fb4401c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.741+0000 7fb43f7fe700 1 -- 172.21.15.146:0/1084481135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4401300a0 msgr2=0x7fb4401c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.741+0000 7fb43f7fe700 1 --2- 172.21.15.146:0/1084481135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4401300a0 0x7fb4401c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.741+0000 7fb43f7fe700 1 -- 172.21.15.146:0/1084481135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb440133ad0 msgr2=0x7fb4401c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.741+0000 7fb43f7fe700 1 --2- 172.21.15.146:0/1084481135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb440133ad0 0x7fb4401c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.741+0000 7fb43f7fe700 1 -- 172.21.15.146:0/1084481135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4340094a0 con 0x7fb4401309f0 2023-10-03T10:17:04.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.741+0000 7fb43ffff700 1 --2- 172.21.15.146:0/1084481135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4401300a0 0x7fb4401c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:04.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.741+0000 7fb43f7fe700 1 --2- 172.21.15.146:0/1084481135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4401309f0 0x7fb4401c8c90 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fb43400ebb0 tx=0x7fb43400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:04.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.741+0000 7fb43cff9700 1 -- 172.21.15.146:0/1084481135 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb434009e60 con 0x7fb4401309f0 2023-10-03T10:17:04.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.741+0000 7fb43cff9700 1 -- 172.21.15.146:0/1084481135 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43400c850 con 0x7fb4401309f0 2023-10-03T10:17:04.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.741+0000 7fb446307700 1 -- 172.21.15.146:0/1084481135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb438009a70 con 0x7fb4401309f0 2023-10-03T10:17:04.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.741+0000 7fb43cff9700 1 -- 172.21.15.146:0/1084481135 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43400cbe0 con 0x7fb4401309f0 2023-10-03T10:17:04.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.741+0000 7fb446307700 1 -- 172.21.15.146:0/1084481135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb430009550 con 0x7fb4401309f0 2023-10-03T10:17:04.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.742+0000 7fb43cff9700 1 -- 172.21.15.146:0/1084481135 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb43400cd40 con 0x7fb4401309f0 2023-10-03T10:17:04.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.742+0000 7fb43cff9700 1 -- 172.21.15.146:0/1084481135 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb43403fab0 con 0x7fb4401309f0 2023-10-03T10:17:04.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.742+0000 7fb446307700 1 -- 172.21.15.146:0/1084481135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44011fc50 con 0x7fb4401309f0 2023-10-03T10:17:04.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.747+0000 7fb43cff9700 1 -- 172.21.15.146:0/1084481135 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb43401b3b0 con 0x7fb4401309f0 2023-10-03T10:17:04.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.757+0000 7fb69bc4b700 1 -- 172.21.15.146:0/1674589238 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb69404f2a0 con 0x7fb69409f180 2023-10-03T10:17:04.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.757+0000 7fb6867fc700 1 -- 172.21.15.146:0/1674589238 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb69001b760 con 0x7fb69409f180 2023-10-03T10:17:04.757 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.760+0000 7fb69bc4b700 1 -- 172.21.15.146:0/1674589238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb69409f180 msgr2=0x7fb694122d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.760+0000 7fb69bc4b700 1 --2- 172.21.15.146:0/1674589238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb69409f180 0x7fb694122d30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb694067390 tx=0x7fb69000c750 comp rx=0 tx=0).stop 2023-10-03T10:17:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.760+0000 7fb69bc4b700 1 -- 172.21.15.146:0/1674589238 shutdown_connections 2023-10-03T10:17:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.760+0000 7fb69bc4b700 1 --2- 172.21.15.146:0/1674589238 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb694134330 0x7fb694123270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.760+0000 7fb69bc4b700 1 --2- 172.21.15.146:0/1674589238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb69409e870 0x7fb6941227f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.760+0000 7fb69bc4b700 1 --2- 172.21.15.146:0/1674589238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb69409f180 0x7fb694122d30 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.760+0000 7fb69bc4b700 1 -- 172.21.15.146:0/1674589238 >> 172.21.15.146:0/1674589238 conn(0x7fb6940a4430 msgr2=0x7fb694070e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.760+0000 7fb69bc4b700 1 -- 172.21.15.146:0/1674589238 shutdown_connections 2023-10-03T10:17:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.760+0000 7fb69bc4b700 1 -- 172.21.15.146:0/1674589238 wait complete. 2023-10-03T10:17:04.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.900+0000 7f48a6b95700 1 -- 172.21.15.146:0/1979002556 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f48a0072980 con 0x7f48a00a0a70 2023-10-03T10:17:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.901+0000 7f489d7fa700 1 -- 172.21.15.146:0/1979002556 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4894011360 con 0x7f48a00a0a70 2023-10-03T10:17:04.901 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:04.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.903+0000 7f48a6b95700 1 -- 172.21.15.146:0/1979002556 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a00a0a70 msgr2=0x7f48a01c8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.903+0000 7f48a6b95700 1 --2- 172.21.15.146:0/1979002556 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a00a0a70 0x7f48a01c8580 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f48940011e0 tx=0x7f489400ca30 comp rx=0 tx=0).stop 2023-10-03T10:17:04.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.903+0000 7f48a6b95700 1 -- 172.21.15.146:0/1979002556 shutdown_connections 2023-10-03T10:17:04.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.903+0000 7f48a6b95700 1 --2- 172.21.15.146:0/1979002556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48a0139200 0x7f48a011e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.903+0000 7f48a6b95700 1 --2- 172.21.15.146:0/1979002556 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48a00a0a70 0x7f48a01c8580 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.903+0000 7f48a6b95700 1 --2- 172.21.15.146:0/1979002556 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48a00a1550 0x7f48a01c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.903+0000 7f48a6b95700 1 -- 172.21.15.146:0/1979002556 >> 172.21.15.146:0/1979002556 conn(0x7f48a00a6610 msgr2=0x7f48a00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.903+0000 7f48a6b95700 1 -- 172.21.15.146:0/1979002556 shutdown_connections 2023-10-03T10:17:04.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.903+0000 7f48a6b95700 1 -- 172.21.15.146:0/1979002556 wait complete. 2023-10-03T10:17:04.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:04.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.940+0000 7fb446307700 1 -- 172.21.15.146:0/1084481135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb44004f2a0 con 0x7fb4401309f0 2023-10-03T10:17:04.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.940+0000 7fb43cff9700 1 -- 172.21.15.146:0/1084481135 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb434021020 con 0x7fb4401309f0 2023-10-03T10:17:04.941 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:04.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.942+0000 7fb446307700 1 -- 172.21.15.146:0/1084481135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4401309f0 msgr2=0x7fb4401c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.942+0000 7fb446307700 1 --2- 172.21.15.146:0/1084481135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4401309f0 0x7fb4401c8c90 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fb43400ebb0 tx=0x7fb43400eec0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.942+0000 7fb446307700 1 -- 172.21.15.146:0/1084481135 shutdown_connections 2023-10-03T10:17:04.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.942+0000 7fb446307700 1 --2- 172.21.15.146:0/1084481135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb440133ad0 0x7fb4401c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.942+0000 7fb446307700 1 --2- 172.21.15.146:0/1084481135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4401300a0 0x7fb4401c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.942+0000 7fb446307700 1 --2- 172.21.15.146:0/1084481135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4401309f0 0x7fb4401c8c90 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.942+0000 7fb446307700 1 -- 172.21.15.146:0/1084481135 >> 172.21.15.146:0/1084481135 conn(0x7fb440099c40 msgr2=0x7fb4400a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.943+0000 7fb446307700 1 -- 172.21.15.146:0/1084481135 shutdown_connections 2023-10-03T10:17:04.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:04.943+0000 7fb446307700 1 -- 172.21.15.146:0/1084481135 wait complete. 2023-10-03T10:17:04.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:05.109 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.234+0000 7fbf81484700 1 Processor -- start 2023-10-03T10:17:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.234+0000 7fbf81484700 1 -- start start 2023-10-03T10:17:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.234+0000 7fbf81484700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbf7c09e870 0x7fbf7c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.234+0000 7fbf81484700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf7c134330 0x7fbf7c13be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.234+0000 7fbf81484700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf7c09fa00 con 0x7fbf7c09f180 2023-10-03T10:17:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.234+0000 7fbf81484700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf7c0a0370 con 0x7fbf7c09e870 2023-10-03T10:17:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.234+0000 7fbf81484700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c06bec0 con 0x7fbf7c134330 2023-10-03T10:17:05.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.235+0000 7fbf7affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbf7c09e870 0x7fbf7c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.235+0000 7fbf7b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf7c134330 0x7fbf7c13be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.235+0000 7fbf7affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbf7c09e870 0x7fbf7c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60940/0 (socket says 172.21.15.146:60940) 2023-10-03T10:17:05.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.235+0000 7fbf7a7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbf7c09f180 0x7fbf7c133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44566/0 (socket says 172.21.15.146:44566) 2023-10-03T10:17:05.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.235+0000 7fbf7affd700 1 -- 172.21.15.146:0/1147019758 learned_addr learned my addr 172.21.15.146:0/1147019758 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:05.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.235+0000 7fbf7b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf7c134330 0x7fbf7c13be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56800/0 (socket says 172.21.15.146:56800) 2023-10-03T10:17:05.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.235+0000 7fbf7b7fe700 1 -- 172.21.15.146:0/1147019758 >> v2:172.21.15.146:3300/0 conn(0x7fbf7c09e870 msgr2=0x7fbf7c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:05.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.235+0000 7fbf7b7fe700 1 --2- 172.21.15.146:0/1147019758 >> v2:172.21.15.146:3300/0 conn(0x7fbf7c09e870 0x7fbf7c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.235+0000 7fbf7b7fe700 1 -- 172.21.15.146:0/1147019758 >> v1:172.21.15.146:6789/0 conn(0x7fbf7c09f180 legacy=0x7fbf7c133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.235+0000 7fbf7b7fe700 1 -- 172.21.15.146:0/1147019758 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c09ada0 con 0x7fbf7c134330 2023-10-03T10:17:05.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.235+0000 7fbf79ffb700 1 -- 172.21.15.146:0/1147019758 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28139966 0 0) 0x7fbf7c09fa00 con 0x7fbf7c09f180 2023-10-03T10:17:05.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.235+0000 7fbf7affd700 1 --2- 172.21.15.146:0/1147019758 >> v2:172.21.15.146:3300/0 conn(0x7fbf7c09e870 0x7fbf7c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.235+0000 7fbf7b7fe700 1 --2- 172.21.15.146:0/1147019758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf7c134330 0x7fbf7c13be80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009d90 tx=0x7fbf7400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc1924337cce43a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.235+0000 7fbf79ffb700 1 -- 172.21.15.146:0/1147019758 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7400e070 con 0x7fbf7c134330 2023-10-03T10:17:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.235+0000 7fbf79ffb700 1 -- 172.21.15.146:0/1147019758 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7400bb20 con 0x7fbf7c134330 2023-10-03T10:17:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.235+0000 7fbf79ffb700 1 -- 172.21.15.146:0/1147019758 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf74012430 con 0x7fbf7c134330 2023-10-03T10:17:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.236+0000 7fbf81484700 1 -- 172.21.15.146:0/1147019758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf7c134330 msgr2=0x7fbf7c13be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.236+0000 7fbf81484700 1 --2- 172.21.15.146:0/1147019758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf7c134330 0x7fbf7c13be80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009d90 tx=0x7fbf7400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.236+0000 7fbf81484700 1 -- 172.21.15.146:0/1147019758 shutdown_connections 2023-10-03T10:17:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.236+0000 7fbf81484700 1 --2- 172.21.15.146:0/1147019758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf7c134330 0x7fbf7c13be80 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.236+0000 7fbf81484700 1 --2- 172.21.15.146:0/1147019758 >> v2:172.21.15.146:3300/0 conn(0x7fbf7c09e870 0x7fbf7c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.236+0000 7fbf81484700 1 -- 172.21.15.146:0/1147019758 >> 172.21.15.146:0/1147019758 conn(0x7fbf7c0a4430 msgr2=0x7fbf7c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.236+0000 7fbf81484700 1 -- 172.21.15.146:0/1147019758 shutdown_connections 2023-10-03T10:17:05.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.236+0000 7fbf81484700 1 -- 172.21.15.146:0/1147019758 wait complete. 2023-10-03T10:17:05.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.237+0000 7fbf81484700 1 Processor -- start 2023-10-03T10:17:05.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.237+0000 7fbf81484700 1 -- start start 2023-10-03T10:17:05.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.237+0000 7fbf81484700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf7c09e870 0x7fbf7c1228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.237+0000 7fbf81484700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf7c09f180 0x7fbf7c122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.237+0000 7fbf81484700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf7c134330 0x7fbf7c123370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.237+0000 7fbf81484700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c124390 con 0x7fbf7c134330 2023-10-03T10:17:05.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.237+0000 7fbf81484700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c06d010 con 0x7fbf7c09f180 2023-10-03T10:17:05.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.237+0000 7fbf81484700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c125fc0 con 0x7fbf7c09e870 2023-10-03T10:17:05.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.237+0000 7fbf7b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf7c134330 0x7fbf7c123370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.237+0000 7fbf7a7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf7c09f180 0x7fbf7c122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.237+0000 7fbf7affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf7c09e870 0x7fbf7c1228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.237+0000 7fbf7b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf7c134330 0x7fbf7c123370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60948/0 (socket says 172.21.15.146:60948) 2023-10-03T10:17:05.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.237+0000 7fbf7b7fe700 1 -- 172.21.15.146:0/3212636606 learned_addr learned my addr 172.21.15.146:0/3212636606 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:05.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.238+0000 7fbf7b7fe700 1 -- 172.21.15.146:0/3212636606 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf7c09e870 msgr2=0x7fbf7c1228f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.238+0000 7fbf7b7fe700 1 --2- 172.21.15.146:0/3212636606 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf7c09e870 0x7fbf7c1228f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.238+0000 7fbf7b7fe700 1 -- 172.21.15.146:0/3212636606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf7c09f180 msgr2=0x7fbf7c122e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.238+0000 7fbf7b7fe700 1 --2- 172.21.15.146:0/3212636606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf7c09f180 0x7fbf7c122e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.238+0000 7fbf7b7fe700 1 -- 172.21.15.146:0/3212636606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf70009550 con 0x7fbf7c134330 2023-10-03T10:17:05.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.238+0000 7fbf7affd700 1 --2- 172.21.15.146:0/3212636606 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf7c09e870 0x7fbf7c1228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:05.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.238+0000 7fbf7a7fc700 1 --2- 172.21.15.146:0/3212636606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf7c09f180 0x7fbf7c122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:05.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.238+0000 7fbf7b7fe700 1 --2- 172.21.15.146:0/3212636606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf7c134330 0x7fbf7c123370 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c06c000 tx=0x7fbf74004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.238+0000 7fbf637fe700 1 -- 172.21.15.146:0/3212636606 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf74012430 con 0x7fbf7c134330 2023-10-03T10:17:05.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.238+0000 7fbf637fe700 1 -- 172.21.15.146:0/3212636606 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf74020070 con 0x7fbf7c134330 2023-10-03T10:17:05.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.238+0000 7fbf637fe700 1 -- 172.21.15.146:0/3212636606 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf74004280 con 0x7fbf7c134330 2023-10-03T10:17:05.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.238+0000 7fbf81484700 1 -- 172.21.15.146:0/3212636606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf74009a70 con 0x7fbf7c134330 2023-10-03T10:17:05.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.238+0000 7fbf81484700 1 -- 172.21.15.146:0/3212636606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf7c1336d0 con 0x7fbf7c134330 2023-10-03T10:17:05.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.239+0000 7fbf637fe700 1 -- 172.21.15.146:0/3212636606 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf740043e0 con 0x7fbf7c134330 2023-10-03T10:17:05.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.239+0000 7fbf637fe700 1 -- 172.21.15.146:0/3212636606 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbf74022070 con 0x7fbf7c134330 2023-10-03T10:17:05.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.239+0000 7fbf81484700 1 -- 172.21.15.146:0/3212636606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf7c04f2a0 con 0x7fbf7c134330 2023-10-03T10:17:05.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.243+0000 7fbf637fe700 1 -- 172.21.15.146:0/3212636606 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf7401a970 con 0x7fbf7c134330 2023-10-03T10:17:05.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.428+0000 7fbf81484700 1 -- 172.21.15.146:0/3212636606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbf7c1332a0 con 0x7fbf7c134330 2023-10-03T10:17:05.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.428+0000 7fbf637fe700 1 -- 172.21.15.146:0/3212636606 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbf7401a380 con 0x7fbf7c134330 2023-10-03T10:17:05.428 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:05.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.430+0000 7fbf81484700 1 -- 172.21.15.146:0/3212636606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf7c134330 msgr2=0x7fbf7c123370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.430+0000 7fbf81484700 1 --2- 172.21.15.146:0/3212636606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf7c134330 0x7fbf7c123370 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c06c000 tx=0x7fbf74004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.430+0000 7fbf81484700 1 -- 172.21.15.146:0/3212636606 shutdown_connections 2023-10-03T10:17:05.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.430+0000 7fbf81484700 1 --2- 172.21.15.146:0/3212636606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf7c134330 0x7fbf7c123370 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.430+0000 7fbf81484700 1 --2- 172.21.15.146:0/3212636606 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbf7c09e870 0x7fbf7c1228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.430+0000 7fbf81484700 1 --2- 172.21.15.146:0/3212636606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbf7c09f180 0x7fbf7c122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.430+0000 7fbf81484700 1 -- 172.21.15.146:0/3212636606 >> 172.21.15.146:0/3212636606 conn(0x7fbf7c0a4430 msgr2=0x7fbf7c0a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.430+0000 7fbf81484700 1 -- 172.21.15.146:0/3212636606 shutdown_connections 2023-10-03T10:17:05.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.430+0000 7fbf81484700 1 -- 172.21.15.146:0/3212636606 wait complete. 2023-10-03T10:17:05.442 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:05.777 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:05.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.902+0000 7f7360a77700 1 Processor -- start 2023-10-03T10:17:05.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.902+0000 7f7360a77700 1 -- start start 2023-10-03T10:17:05.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.903+0000 7f7360a77700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f735c133900 0x7f735c133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.903+0000 7f7360a77700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f735c0a10b0 0x7f735c13b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.903+0000 7f7360a77700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f735c09a760 con 0x7f735c134210 2023-10-03T10:17:05.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.903+0000 7f7360a77700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735c1336e0 con 0x7f735c133900 2023-10-03T10:17:05.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.903+0000 7f7360a77700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f735c09a080 con 0x7f735c0a10b0 2023-10-03T10:17:05.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.903+0000 7f735a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f735c133900 0x7f735c133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.903+0000 7f7359d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f735c134210 0x7f735c0a09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44582/0 (socket says 172.21.15.146:44582) 2023-10-03T10:17:05.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.903+0000 7f7359d9b700 1 -- 172.21.15.146:0/3813753238 learned_addr learned my addr 172.21.15.146:0/3813753238 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:05.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.903+0000 7f735ad9d700 1 --2- 172.21.15.146:0/3813753238 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f735c0a10b0 0x7f735c13b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.904+0000 7f735a59c700 1 -- 172.21.15.146:0/3813753238 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f735c0a10b0 msgr2=0x7f735c13b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:05.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.904+0000 7f735959a700 1 -- 172.21.15.146:0/3813753238 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332134409 0 0) 0x7f735c09a760 con 0x7f735c134210 2023-10-03T10:17:05.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.904+0000 7f735a59c700 1 --2- 172.21.15.146:0/3813753238 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f735c0a10b0 0x7f735c13b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.904+0000 7f735a59c700 1 -- 172.21.15.146:0/3813753238 >> v1:172.21.15.146:6789/0 conn(0x7f735c134210 legacy=0x7f735c0a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.904+0000 7f735a59c700 1 -- 172.21.15.146:0/3813753238 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735c0a23e0 con 0x7f735c133900 2023-10-03T10:17:05.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.904+0000 7f735ad9d700 1 --2- 172.21.15.146:0/3813753238 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f735c0a10b0 0x7f735c13b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:05.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.904+0000 7f735a59c700 1 --2- 172.21.15.146:0/3813753238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f735c133900 0x7f735c133cd0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7350009850 tx=0x7f7350009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ddbf5425017a5a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.904+0000 7f735959a700 1 -- 172.21.15.146:0/3813753238 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7350005e30 con 0x7f735c133900 2023-10-03T10:17:05.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.904+0000 7f735959a700 1 -- 172.21.15.146:0/3813753238 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7350006030 con 0x7f735c133900 2023-10-03T10:17:05.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.904+0000 7f735959a700 1 -- 172.21.15.146:0/3813753238 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73500063e0 con 0x7f735c133900 2023-10-03T10:17:05.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.904+0000 7f7360a77700 1 -- 172.21.15.146:0/3813753238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f735c133900 msgr2=0x7f735c133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.904+0000 7f7360a77700 1 --2- 172.21.15.146:0/3813753238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f735c133900 0x7f735c133cd0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7350009850 tx=0x7f7350009b60 comp rx=0 tx=0).stop 2023-10-03T10:17:05.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.904+0000 7f7360a77700 1 -- 172.21.15.146:0/3813753238 shutdown_connections 2023-10-03T10:17:05.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.904+0000 7f7360a77700 1 --2- 172.21.15.146:0/3813753238 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f735c0a10b0 0x7f735c13b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.904+0000 7f7360a77700 1 --2- 172.21.15.146:0/3813753238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f735c133900 0x7f735c133cd0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.904+0000 7f7360a77700 1 -- 172.21.15.146:0/3813753238 >> 172.21.15.146:0/3813753238 conn(0x7f735c0a2980 msgr2=0x7f735c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.904+0000 7f7360a77700 1 -- 172.21.15.146:0/3813753238 shutdown_connections 2023-10-03T10:17:05.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.905+0000 7f7360a77700 1 -- 172.21.15.146:0/3813753238 wait complete. 2023-10-03T10:17:05.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.905+0000 7f7360a77700 1 Processor -- start 2023-10-03T10:17:05.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.906+0000 7f7360a77700 1 -- start start 2023-10-03T10:17:05.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.906+0000 7f7360a77700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f735c0a10b0 0x7f735c11d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.906+0000 7f7360a77700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f735c133900 0x7f735c11dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.906+0000 7f7360a77700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f735c134210 0x7f735c11e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.906+0000 7f7360a77700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735c11f3b0 con 0x7f735c0a10b0 2023-10-03T10:17:05.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.906+0000 7f7360a77700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735c11f9d0 con 0x7f735c134210 2023-10-03T10:17:05.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.906+0000 7f7360a77700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f735c120600 con 0x7f735c133900 2023-10-03T10:17:05.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.906+0000 7f735ad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f735c134210 0x7f735c11e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.906+0000 7f735a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f735c0a10b0 0x7f735c11d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.906+0000 7f735ad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f735c134210 0x7f735c11e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56840/0 (socket says 172.21.15.146:56840) 2023-10-03T10:17:05.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.906+0000 7f735a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f735c0a10b0 0x7f735c11d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60950/0 (socket says 172.21.15.146:60950) 2023-10-03T10:17:05.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.906+0000 7f735ad9d700 1 -- 172.21.15.146:0/3543146501 learned_addr learned my addr 172.21.15.146:0/3543146501 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:05.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.906+0000 7f7359d9b700 1 --2- 172.21.15.146:0/3543146501 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f735c133900 0x7f735c11dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.906+0000 7f735ad9d700 1 -- 172.21.15.146:0/3543146501 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f735c133900 msgr2=0x7f735c11dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.906+0000 7f735ad9d700 1 --2- 172.21.15.146:0/3543146501 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f735c133900 0x7f735c11dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.906+0000 7f735ad9d700 1 -- 172.21.15.146:0/3543146501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f735c0a10b0 msgr2=0x7f735c11d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.906+0000 7f735ad9d700 1 --2- 172.21.15.146:0/3543146501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f735c0a10b0 0x7f735c11d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.906+0000 7f735ad9d700 1 -- 172.21.15.146:0/3543146501 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7354009a70 con 0x7f735c134210 2023-10-03T10:17:05.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.906+0000 7f735a59c700 1 --2- 172.21.15.146:0/3543146501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f735c0a10b0 0x7f735c11d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:05.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.906+0000 7f735ad9d700 1 --2- 172.21.15.146:0/3543146501 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f735c134210 0x7f735c11e2c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7354009f00 tx=0x7f735400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.907+0000 7f734affd700 1 -- 172.21.15.146:0/3543146501 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7354009d70 con 0x7f735c134210 2023-10-03T10:17:05.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.907+0000 7f734affd700 1 -- 172.21.15.146:0/3543146501 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735400f040 con 0x7f735c134210 2023-10-03T10:17:05.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.907+0000 7f7360a77700 1 -- 172.21.15.146:0/3543146501 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7350009430 con 0x7f735c134210 2023-10-03T10:17:05.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.907+0000 7f734affd700 1 -- 172.21.15.146:0/3543146501 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735400cd70 con 0x7f735c134210 2023-10-03T10:17:05.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.907+0000 7f7360a77700 1 -- 172.21.15.146:0/3543146501 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735c132d30 con 0x7f735c134210 2023-10-03T10:17:05.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.907+0000 7f734affd700 1 -- 172.21.15.146:0/3543146501 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7354014480 con 0x7f735c134210 2023-10-03T10:17:05.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.907+0000 7f734affd700 1 -- 172.21.15.146:0/3543146501 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f735403fce0 con 0x7f735c134210 2023-10-03T10:17:05.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.908+0000 7f7360a77700 1 -- 172.21.15.146:0/3543146501 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f735c09a320 con 0x7f735c134210 2023-10-03T10:17:05.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:05.912+0000 7f734affd700 1 -- 172.21.15.146:0/3543146501 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7354012930 con 0x7f735c134210 2023-10-03T10:17:05.916 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:05.955 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:06.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.041+0000 7f843e7bd700 1 Processor -- start 2023-10-03T10:17:06.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.041+0000 7f843e7bd700 1 -- start start 2023-10-03T10:17:06.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.042+0000 7f843e7bd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84380a0a70 0x7f84380a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.042+0000 7f843e7bd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f84380a1380 0x7f8438133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.042+0000 7f843e7bd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843809dc00 con 0x7f8438133f50 2023-10-03T10:17:06.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.042+0000 7f843e7bd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843809ea60 con 0x7f84380a0a70 2023-10-03T10:17:06.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.042+0000 7f843e7bd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f843809dec0 con 0x7f84380a1380 2023-10-03T10:17:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.042+0000 7f843cd5a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8438133f50 0x7f843813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44590/0 (socket says 172.21.15.146:44590) 2023-10-03T10:17:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.042+0000 7f843cd5a700 1 -- 172.21.15.146:0/3281067180 learned_addr learned my addr 172.21.15.146:0/3281067180 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.042+0000 7f84377fe700 1 --2- 172.21.15.146:0/3281067180 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f84380a1380 0x7f8438133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.042+0000 7f8437fff700 1 --2- 172.21.15.146:0/3281067180 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84380a0a70 0x7f84380a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.042+0000 7f8436ffd700 1 -- 172.21.15.146:0/3281067180 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3911737523 0 0) 0x7f843809dc00 con 0x7f8438133f50 2023-10-03T10:17:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.042+0000 7f8436ffd700 1 -- 172.21.15.146:0/3281067180 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84200035b0 con 0x7f8438133f50 2023-10-03T10:17:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.042+0000 7f8437fff700 1 -- 172.21.15.146:0/3281067180 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f84380a1380 msgr2=0x7f8438133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.042+0000 7f8437fff700 1 --2- 172.21.15.146:0/3281067180 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f84380a1380 0x7f8438133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.042+0000 7f8437fff700 1 -- 172.21.15.146:0/3281067180 >> v1:172.21.15.146:6789/0 conn(0x7f8438133f50 legacy=0x7f843813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.042+0000 7f8437fff700 1 -- 172.21.15.146:0/3281067180 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843809e6a0 con 0x7f84380a0a70 2023-10-03T10:17:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.043+0000 7f8437fff700 1 --2- 172.21.15.146:0/3281067180 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84380a0a70 0x7f84380a0e40 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8428009870 tx=0x7f8428009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ae67b6837c7898c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.043+0000 7f8436ffd700 1 -- 172.21.15.146:0/3281067180 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8428011830 con 0x7f84380a0a70 2023-10-03T10:17:06.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.043+0000 7f8436ffd700 1 -- 172.21.15.146:0/3281067180 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8428011990 con 0x7f84380a0a70 2023-10-03T10:17:06.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.043+0000 7f8436ffd700 1 -- 172.21.15.146:0/3281067180 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8428011d20 con 0x7f84380a0a70 2023-10-03T10:17:06.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.043+0000 7f843e7bd700 1 -- 172.21.15.146:0/3281067180 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84380a0a70 msgr2=0x7f84380a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.043+0000 7f843e7bd700 1 --2- 172.21.15.146:0/3281067180 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84380a0a70 0x7f84380a0e40 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8428009870 tx=0x7f8428009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:06.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.043+0000 7f843e7bd700 1 -- 172.21.15.146:0/3281067180 shutdown_connections 2023-10-03T10:17:06.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.043+0000 7f843e7bd700 1 --2- 172.21.15.146:0/3281067180 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84380a0a70 0x7f84380a0e40 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.043+0000 7f843e7bd700 1 --2- 172.21.15.146:0/3281067180 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f84380a1380 0x7f8438133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.043+0000 7f843e7bd700 1 -- 172.21.15.146:0/3281067180 >> 172.21.15.146:0/3281067180 conn(0x7f84380a6610 msgr2=0x7f84380a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.043+0000 7f843e7bd700 1 -- 172.21.15.146:0/3281067180 shutdown_connections 2023-10-03T10:17:06.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.044+0000 7f843e7bd700 1 -- 172.21.15.146:0/3281067180 wait complete. 2023-10-03T10:17:06.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.044+0000 7f843e7bd700 1 Processor -- start 2023-10-03T10:17:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.045+0000 7f843e7bd700 1 -- start start 2023-10-03T10:17:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.045+0000 7f843e7bd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84380a0a70 0x7f84381228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.045+0000 7f843e7bd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84380a1380 0x7f8438122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.045+0000 7f843e7bd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8438133f50 0x7f8438123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.045+0000 7f843e7bd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8438126100 con 0x7f84380a0a70 2023-10-03T10:17:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.045+0000 7f843e7bd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8438125d60 con 0x7f84380a1380 2023-10-03T10:17:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.045+0000 7f843e7bd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8438133970 con 0x7f8438133f50 2023-10-03T10:17:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.045+0000 7f8437fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84380a0a70 0x7f84381228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.045+0000 7f8437fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84380a0a70 0x7f84381228b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60962/0 (socket says 172.21.15.146:60962) 2023-10-03T10:17:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.045+0000 7f8437fff700 1 -- 172.21.15.146:0/1123060722 learned_addr learned my addr 172.21.15.146:0/1123060722 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.045+0000 7f84377fe700 1 --2- 172.21.15.146:0/1123060722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84380a1380 0x7f8438122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.045+0000 7f843cd5a700 1 --2- 172.21.15.146:0/1123060722 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8438133f50 0x7f8438123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.046+0000 7f8437fff700 1 -- 172.21.15.146:0/1123060722 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8438133f50 msgr2=0x7f8438123330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.046+0000 7f8437fff700 1 --2- 172.21.15.146:0/1123060722 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8438133f50 0x7f8438123330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.046+0000 7f8437fff700 1 -- 172.21.15.146:0/1123060722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84380a1380 msgr2=0x7f8438122df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.046+0000 7f8437fff700 1 --2- 172.21.15.146:0/1123060722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84380a1380 0x7f8438122df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.046+0000 7f8437fff700 1 -- 172.21.15.146:0/1123060722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84280094a0 con 0x7f84380a0a70 2023-10-03T10:17:06.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.046+0000 7f843cd5a700 1 --2- 172.21.15.146:0/1123060722 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8438133f50 0x7f8438123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.046+0000 7f84377fe700 1 --2- 172.21.15.146:0/1123060722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84380a1380 0x7f8438122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.046+0000 7f8437fff700 1 --2- 172.21.15.146:0/1123060722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84380a0a70 0x7f84381228b0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f8428009bc0 tx=0x7f8428004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.046+0000 7f8434ff9700 1 -- 172.21.15.146:0/1123060722 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8428004510 con 0x7f84380a0a70 2023-10-03T10:17:06.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.046+0000 7f8434ff9700 1 -- 172.21.15.146:0/1123060722 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842801f070 con 0x7f84380a0a70 2023-10-03T10:17:06.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.046+0000 7f843e7bd700 1 -- 172.21.15.146:0/1123060722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84381243f0 con 0x7f84380a0a70 2023-10-03T10:17:06.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.046+0000 7f8434ff9700 1 -- 172.21.15.146:0/1123060722 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84280038e0 con 0x7f84380a0a70 2023-10-03T10:17:06.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.046+0000 7f843e7bd700 1 -- 172.21.15.146:0/1123060722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8438126a90 con 0x7f84380a0a70 2023-10-03T10:17:06.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.047+0000 7f843e7bd700 1 -- 172.21.15.146:0/1123060722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843804f2a0 con 0x7f84380a0a70 2023-10-03T10:17:06.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.047+0000 7f8434ff9700 1 -- 172.21.15.146:0/1123060722 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8428003a40 con 0x7f84380a0a70 2023-10-03T10:17:06.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.048+0000 7f8434ff9700 1 -- 172.21.15.146:0/1123060722 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8428021070 con 0x7f84380a0a70 2023-10-03T10:17:06.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.052+0000 7f8434ff9700 1 -- 172.21.15.146:0/1123060722 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f84280253e0 con 0x7f84380a0a70 2023-10-03T10:17:06.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.084+0000 7f2d17a57700 1 Processor -- start 2023-10-03T10:17:06.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.084+0000 7f2d17a57700 1 -- start start 2023-10-03T10:17:06.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.085+0000 7f2d17a57700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2d1009ad40 0x7f2d10133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.085+0000 7f2d17a57700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d101343d0 0x7f2d100a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.085+0000 7f2d17a57700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d1009b110 con 0x7f2d10133f70 2023-10-03T10:17:06.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.085+0000 7f2d17a57700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d100a3b60 con 0x7f2d1009ad40 2023-10-03T10:17:06.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.085+0000 7f2d17a57700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d10134850 con 0x7f2d101343d0 2023-10-03T10:17:06.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.085+0000 7f2d157f3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2d1009ad40 0x7f2d10133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.085+0000 7f2d15ff4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d101343d0 0x7f2d100a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.085+0000 7f2d14ff2700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2d10133f70 0x7f2d100a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44606/0 (socket says 172.21.15.146:44606) 2023-10-03T10:17:06.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.085+0000 7f2d14ff2700 1 -- 172.21.15.146:0/217420042 learned_addr learned my addr 172.21.15.146:0/217420042 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:06.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.085+0000 7f2d15ff4700 1 -- 172.21.15.146:0/217420042 >> v2:172.21.15.146:3300/0 conn(0x7f2d1009ad40 msgr2=0x7f2d10133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.085+0000 7f2d15ff4700 1 --2- 172.21.15.146:0/217420042 >> v2:172.21.15.146:3300/0 conn(0x7f2d1009ad40 0x7f2d10133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.085+0000 7f2d15ff4700 1 -- 172.21.15.146:0/217420042 >> v1:172.21.15.146:6789/0 conn(0x7f2d10133f70 legacy=0x7f2d100a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.085+0000 7f2d15ff4700 1 -- 172.21.15.146:0/217420042 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d100a2fa0 con 0x7f2d101343d0 2023-10-03T10:17:06.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.085+0000 7f2d07fff700 1 -- 172.21.15.146:0/217420042 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901258282 0 0) 0x7f2d1009b110 con 0x7f2d10133f70 2023-10-03T10:17:06.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.085+0000 7f2d157f3700 1 --2- 172.21.15.146:0/217420042 >> v2:172.21.15.146:3300/0 conn(0x7f2d1009ad40 0x7f2d10133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.085+0000 7f2d15ff4700 1 --2- 172.21.15.146:0/217420042 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d101343d0 0x7f2d100a1180 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009d90 tx=0x7f2d0800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5acb869064b23b00 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.086+0000 7f2d07fff700 1 -- 172.21.15.146:0/217420042 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0800e070 con 0x7f2d101343d0 2023-10-03T10:17:06.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.086+0000 7f2d07fff700 1 -- 172.21.15.146:0/217420042 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0800bb20 con 0x7f2d101343d0 2023-10-03T10:17:06.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.086+0000 7f2d07fff700 1 -- 172.21.15.146:0/217420042 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08012430 con 0x7f2d101343d0 2023-10-03T10:17:06.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.086+0000 7f2d17a57700 1 -- 172.21.15.146:0/217420042 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d101343d0 msgr2=0x7f2d100a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.086+0000 7f2d17a57700 1 --2- 172.21.15.146:0/217420042 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d101343d0 0x7f2d100a1180 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009d90 tx=0x7f2d0800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:06.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.086+0000 7f2d17a57700 1 -- 172.21.15.146:0/217420042 shutdown_connections 2023-10-03T10:17:06.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.086+0000 7f2d17a57700 1 --2- 172.21.15.146:0/217420042 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d101343d0 0x7f2d100a1180 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.086+0000 7f2d17a57700 1 --2- 172.21.15.146:0/217420042 >> v2:172.21.15.146:3300/0 conn(0x7f2d1009ad40 0x7f2d10133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.086+0000 7f2d17a57700 1 -- 172.21.15.146:0/217420042 >> 172.21.15.146:0/217420042 conn(0x7f2d10099c40 msgr2=0x7f2d1006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.087+0000 7f2d17a57700 1 -- 172.21.15.146:0/217420042 shutdown_connections 2023-10-03T10:17:06.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.087+0000 7f2d17a57700 1 -- 172.21.15.146:0/217420042 wait complete. 2023-10-03T10:17:06.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.088+0000 7f2d17a57700 1 Processor -- start 2023-10-03T10:17:06.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.088+0000 7f2d17a57700 1 -- start start 2023-10-03T10:17:06.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.088+0000 7f2d17a57700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d1009ad40 0x7f2d1011f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.088+0000 7f2d17a57700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d10133f70 0x7f2d1011f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.088+0000 7f2d17a57700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d101343d0 0x7f2d101c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.088+0000 7f2d17a57700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d10122330 con 0x7f2d10133f70 2023-10-03T10:17:06.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.088+0000 7f2d17a57700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d10122510 con 0x7f2d101343d0 2023-10-03T10:17:06.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.089+0000 7f2d17a57700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d10133380 con 0x7f2d1009ad40 2023-10-03T10:17:06.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.089+0000 7f2d14ff2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d10133f70 0x7f2d1011f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.089+0000 7f2d157f3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d1009ad40 0x7f2d1011f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.089+0000 7f2d157f3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d1009ad40 0x7f2d1011f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:56950/0 (socket says 172.21.15.146:56950) 2023-10-03T10:17:06.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.089+0000 7f2d157f3700 1 -- 172.21.15.146:0/2858331734 learned_addr learned my addr 172.21.15.146:0/2858331734 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:06.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.089+0000 7f2d14ff2700 1 --2- 172.21.15.146:0/2858331734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d10133f70 0x7f2d1011f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60974/0 (socket says 172.21.15.146:60974) 2023-10-03T10:17:06.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.089+0000 7f2d15ff4700 1 --2- 172.21.15.146:0/2858331734 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d101343d0 0x7f2d101c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.089+0000 7f2d157f3700 1 -- 172.21.15.146:0/2858331734 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d101343d0 msgr2=0x7f2d101c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.089+0000 7f2d157f3700 1 --2- 172.21.15.146:0/2858331734 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d101343d0 0x7f2d101c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.089+0000 7f2d157f3700 1 -- 172.21.15.146:0/2858331734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d10133f70 msgr2=0x7f2d1011f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.089+0000 7f2d157f3700 1 --2- 172.21.15.146:0/2858331734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d10133f70 0x7f2d1011f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.089+0000 7f2d157f3700 1 -- 172.21.15.146:0/2858331734 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c0094a0 con 0x7f2d1009ad40 2023-10-03T10:17:06.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.089+0000 7f2d157f3700 1 --2- 172.21.15.146:0/2858331734 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d1009ad40 0x7f2d1011f3c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00ec10 tx=0x7f2d0c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.089+0000 7f2d05ffb700 1 -- 172.21.15.146:0/2858331734 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c00c850 con 0x7f2d1009ad40 2023-10-03T10:17:06.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.089+0000 7f2d05ffb700 1 -- 172.21.15.146:0/2858331734 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0c00c9b0 con 0x7f2d1009ad40 2023-10-03T10:17:06.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.089+0000 7f2d17a57700 1 -- 172.21.15.146:0/2858331734 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d08009a70 con 0x7f2d1009ad40 2023-10-03T10:17:06.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.089+0000 7f2d05ffb700 1 -- 172.21.15.146:0/2858331734 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c00cd20 con 0x7f2d1009ad40 2023-10-03T10:17:06.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.090+0000 7f2d17a57700 1 -- 172.21.15.146:0/2858331734 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1009c7e0 con 0x7f2d1009ad40 2023-10-03T10:17:06.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.091+0000 7f2d05ffb700 1 -- 172.21.15.146:0/2858331734 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d0c013470 con 0x7f2d1009ad40 2023-10-03T10:17:06.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.091+0000 7f2d17a57700 1 -- 172.21.15.146:0/2858331734 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1004f2a0 con 0x7f2d1009ad40 2023-10-03T10:17:06.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.091+0000 7f2d05ffb700 1 -- 172.21.15.146:0/2858331734 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2d0c03f730 con 0x7f2d1009ad40 2023-10-03T10:17:06.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.095+0000 7f2d05ffb700 1 -- 172.21.15.146:0/2858331734 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d0c013aa0 con 0x7f2d1009ad40 2023-10-03T10:17:06.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.122+0000 7f7360a77700 1 -- 172.21.15.146:0/3543146501 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f735c11a590 con 0x7f735c134210 2023-10-03T10:17:06.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.122+0000 7f734affd700 1 -- 172.21.15.146:0/3543146501 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f735402a090 con 0x7f735c134210 2023-10-03T10:17:06.122 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:06.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.125+0000 7f7360a77700 1 -- 172.21.15.146:0/3543146501 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f735c134210 msgr2=0x7f735c11e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.125+0000 7f7360a77700 1 --2- 172.21.15.146:0/3543146501 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f735c134210 0x7f735c11e2c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7354009f00 tx=0x7f735400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.125+0000 7f7360a77700 1 -- 172.21.15.146:0/3543146501 shutdown_connections 2023-10-03T10:17:06.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.125+0000 7f7360a77700 1 --2- 172.21.15.146:0/3543146501 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f735c134210 0x7f735c11e2c0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.125+0000 7f7360a77700 1 --2- 172.21.15.146:0/3543146501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f735c0a10b0 0x7f735c11d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.125+0000 7f7360a77700 1 --2- 172.21.15.146:0/3543146501 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f735c133900 0x7f735c11dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.125+0000 7f7360a77700 1 -- 172.21.15.146:0/3543146501 >> 172.21.15.146:0/3543146501 conn(0x7f735c0a2980 msgr2=0x7f735c1bad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.125+0000 7f7360a77700 1 -- 172.21.15.146:0/3543146501 shutdown_connections 2023-10-03T10:17:06.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.125+0000 7f7360a77700 1 -- 172.21.15.146:0/3543146501 wait complete. 2023-10-03T10:17:06.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:06.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.255+0000 7f843e7bd700 1 -- 172.21.15.146:0/1123060722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8438072980 con 0x7f84380a0a70 2023-10-03T10:17:06.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.255+0000 7f8434ff9700 1 -- 172.21.15.146:0/1123060722 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8428034020 con 0x7f84380a0a70 2023-10-03T10:17:06.255 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:06.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.257+0000 7f843e7bd700 1 -- 172.21.15.146:0/1123060722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84380a0a70 msgr2=0x7f84381228b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.257+0000 7f843e7bd700 1 --2- 172.21.15.146:0/1123060722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84380a0a70 0x7f84381228b0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f8428009bc0 tx=0x7f8428004750 comp rx=0 tx=0).stop 2023-10-03T10:17:06.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.257+0000 7f843e7bd700 1 -- 172.21.15.146:0/1123060722 shutdown_connections 2023-10-03T10:17:06.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.257+0000 7f843e7bd700 1 --2- 172.21.15.146:0/1123060722 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8438133f50 0x7f8438123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.257+0000 7f843e7bd700 1 --2- 172.21.15.146:0/1123060722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84380a0a70 0x7f84381228b0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.257+0000 7f843e7bd700 1 --2- 172.21.15.146:0/1123060722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84380a1380 0x7f8438122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.257+0000 7f843e7bd700 1 -- 172.21.15.146:0/1123060722 >> 172.21.15.146:0/1123060722 conn(0x7f84380a6610 msgr2=0x7f84380a4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.258+0000 7f843e7bd700 1 -- 172.21.15.146:0/1123060722 shutdown_connections 2023-10-03T10:17:06.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.258+0000 7f843e7bd700 1 -- 172.21.15.146:0/1123060722 wait complete. 2023-10-03T10:17:06.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:06.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.292+0000 7f2d17a57700 1 -- 172.21.15.146:0/2858331734 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2d10120df0 con 0x7f2d1009ad40 2023-10-03T10:17:06.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.292+0000 7f2d05ffb700 1 -- 172.21.15.146:0/2858331734 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d0c021020 con 0x7f2d1009ad40 2023-10-03T10:17:06.292 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:06.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.295+0000 7f2d17a57700 1 -- 172.21.15.146:0/2858331734 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d1009ad40 msgr2=0x7f2d1011f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.295+0000 7f2d17a57700 1 --2- 172.21.15.146:0/2858331734 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d1009ad40 0x7f2d1011f3c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00ec10 tx=0x7f2d0c00ef20 comp rx=0 tx=0).stop 2023-10-03T10:17:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.295+0000 7f2d17a57700 1 -- 172.21.15.146:0/2858331734 shutdown_connections 2023-10-03T10:17:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.295+0000 7f2d17a57700 1 --2- 172.21.15.146:0/2858331734 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d101343d0 0x7f2d101c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.295+0000 7f2d17a57700 1 --2- 172.21.15.146:0/2858331734 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d1009ad40 0x7f2d1011f3c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.295+0000 7f2d17a57700 1 --2- 172.21.15.146:0/2858331734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d10133f70 0x7f2d1011f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.295+0000 7f2d17a57700 1 -- 172.21.15.146:0/2858331734 >> 172.21.15.146:0/2858331734 conn(0x7f2d10099c40 msgr2=0x7f2d101bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.295+0000 7f2d17a57700 1 -- 172.21.15.146:0/2858331734 shutdown_connections 2023-10-03T10:17:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.295+0000 7f2d17a57700 1 -- 172.21.15.146:0/2858331734 wait complete. 2023-10-03T10:17:06.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:06.444 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:06.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.569+0000 7f2e2f4f8700 1 Processor -- start 2023-10-03T10:17:06.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.569+0000 7f2e2f4f8700 1 -- start start 2023-10-03T10:17:06.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.569+0000 7f2e2f4f8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e2809d860 0x7f2e2809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.569+0000 7f2e2f4f8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e28130eb0 0x7f2e28138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.569+0000 7f2e2f4f8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2809aaa0 con 0x7f2e2809e170 2023-10-03T10:17:06.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.569+0000 7f2e2f4f8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2809f870 con 0x7f2e28130eb0 2023-10-03T10:17:06.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.569+0000 7f2e2f4f8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2809b360 con 0x7f2e2809d860 2023-10-03T10:17:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.569+0000 7f2e2ca93700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2e2809e170 0x7f2e281307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44622/0 (socket says 172.21.15.146:44622) 2023-10-03T10:17:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.569+0000 7f2e2ca93700 1 -- 172.21.15.146:0/1000198828 learned_addr learned my addr 172.21.15.146:0/1000198828 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.569+0000 7f2e2da95700 1 --2- 172.21.15.146:0/1000198828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e28130eb0 0x7f2e28138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.569+0000 7f2e2d294700 1 --2- 172.21.15.146:0/1000198828 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e2809d860 0x7f2e2809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.570+0000 7f2e1ffff700 1 -- 172.21.15.146:0/1000198828 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119690862 0 0) 0x7f2e2809aaa0 con 0x7f2e2809e170 2023-10-03T10:17:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.570+0000 7f2e1ffff700 1 -- 172.21.15.146:0/1000198828 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e140035b0 con 0x7f2e2809e170 2023-10-03T10:17:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.570+0000 7f2e2d294700 1 -- 172.21.15.146:0/1000198828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e28130eb0 msgr2=0x7f2e28138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.570+0000 7f2e2d294700 1 --2- 172.21.15.146:0/1000198828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e28130eb0 0x7f2e28138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.570+0000 7f2e2d294700 1 -- 172.21.15.146:0/1000198828 >> v1:172.21.15.146:6789/0 conn(0x7f2e2809e170 legacy=0x7f2e281307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.570+0000 7f2e2d294700 1 -- 172.21.15.146:0/1000198828 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2809b620 con 0x7f2e2809d860 2023-10-03T10:17:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.570+0000 7f2e2da95700 1 --2- 172.21.15.146:0/1000198828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e28130eb0 0x7f2e28138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.570+0000 7f2e2d294700 1 --2- 172.21.15.146:0/1000198828 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e2809d860 0x7f2e2809dc30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009870 tx=0x7f2e18009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=457161a197bd2b03 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.570+0000 7f2e1ffff700 1 -- 172.21.15.146:0/1000198828 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e18011830 con 0x7f2e2809d860 2023-10-03T10:17:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.570+0000 7f2e1ffff700 1 -- 172.21.15.146:0/1000198828 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e18011990 con 0x7f2e2809d860 2023-10-03T10:17:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.570+0000 7f2e1ffff700 1 -- 172.21.15.146:0/1000198828 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e18011d20 con 0x7f2e2809d860 2023-10-03T10:17:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.571+0000 7f2e2f4f8700 1 -- 172.21.15.146:0/1000198828 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e2809d860 msgr2=0x7f2e2809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.571+0000 7f2e2f4f8700 1 --2- 172.21.15.146:0/1000198828 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e2809d860 0x7f2e2809dc30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009870 tx=0x7f2e18009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.571+0000 7f2e2f4f8700 1 -- 172.21.15.146:0/1000198828 shutdown_connections 2023-10-03T10:17:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.571+0000 7f2e2f4f8700 1 --2- 172.21.15.146:0/1000198828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e28130eb0 0x7f2e28138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.571+0000 7f2e2f4f8700 1 --2- 172.21.15.146:0/1000198828 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e2809d860 0x7f2e2809dc30 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.571+0000 7f2e2f4f8700 1 -- 172.21.15.146:0/1000198828 >> 172.21.15.146:0/1000198828 conn(0x7f2e28099c40 msgr2=0x7f2e280a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.571+0000 7f2e2f4f8700 1 -- 172.21.15.146:0/1000198828 shutdown_connections 2023-10-03T10:17:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.571+0000 7f2e2f4f8700 1 -- 172.21.15.146:0/1000198828 wait complete. 2023-10-03T10:17:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.571+0000 7f2e2f4f8700 1 Processor -- start 2023-10-03T10:17:06.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.572+0000 7f2e2f4f8700 1 -- start start 2023-10-03T10:17:06.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.572+0000 7f2e2f4f8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e2809d860 0x7f2e28123220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.572+0000 7f2e2f4f8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e2809e170 0x7f2e28123760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.572+0000 7f2e2f4f8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e28130eb0 0x7f2e281c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.572+0000 7f2e2f4f8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e28125f40 con 0x7f2e28130eb0 2023-10-03T10:17:06.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.572+0000 7f2e2f4f8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e28122e30 con 0x7f2e2809d860 2023-10-03T10:17:06.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.572+0000 7f2e2f4f8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e28124540 con 0x7f2e2809e170 2023-10-03T10:17:06.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.572+0000 7f2e2d294700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e2809d860 0x7f2e28123220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.572+0000 7f2e2ca93700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e2809e170 0x7f2e28123760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.572+0000 7f2e2d294700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e2809d860 0x7f2e28123220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56902/0 (socket says 172.21.15.146:56902) 2023-10-03T10:17:06.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.572+0000 7f2e2d294700 1 -- 172.21.15.146:0/1039270515 learned_addr learned my addr 172.21.15.146:0/1039270515 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:06.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.572+0000 7f2e2da95700 1 --2- 172.21.15.146:0/1039270515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e28130eb0 0x7f2e281c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.572+0000 7f2e2ca93700 1 -- 172.21.15.146:0/1039270515 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e2809d860 msgr2=0x7f2e28123220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.572+0000 7f2e2ca93700 1 --2- 172.21.15.146:0/1039270515 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e2809d860 0x7f2e28123220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.572+0000 7f2e2ca93700 1 -- 172.21.15.146:0/1039270515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e28130eb0 msgr2=0x7f2e281c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.572+0000 7f2e2ca93700 1 --2- 172.21.15.146:0/1039270515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e28130eb0 0x7f2e281c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.572+0000 7f2e2ca93700 1 -- 172.21.15.146:0/1039270515 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e20009a70 con 0x7f2e2809e170 2023-10-03T10:17:06.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.572+0000 7f2e2d294700 1 --2- 172.21.15.146:0/1039270515 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e2809d860 0x7f2e28123220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.572+0000 7f2e2ca93700 1 --2- 172.21.15.146:0/1039270515 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e2809e170 0x7f2e28123760 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400c490 tx=0x7f2e2400c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.573+0000 7f2e1dffb700 1 -- 172.21.15.146:0/1039270515 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24005d70 con 0x7f2e2809e170 2023-10-03T10:17:06.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.573+0000 7f2e1dffb700 1 -- 172.21.15.146:0/1039270515 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e240070d0 con 0x7f2e2809e170 2023-10-03T10:17:06.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.573+0000 7f2e2f4f8700 1 -- 172.21.15.146:0/1039270515 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e180094a0 con 0x7f2e2809e170 2023-10-03T10:17:06.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.573+0000 7f2e1dffb700 1 -- 172.21.15.146:0/1039270515 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24007440 con 0x7f2e2809e170 2023-10-03T10:17:06.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.573+0000 7f2e2f4f8700 1 -- 172.21.15.146:0/1039270515 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e28124ab0 con 0x7f2e2809e170 2023-10-03T10:17:06.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.573+0000 7f2e1dffb700 1 -- 172.21.15.146:0/1039270515 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e240075a0 con 0x7f2e2809e170 2023-10-03T10:17:06.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.574+0000 7f2e1dffb700 1 -- 172.21.15.146:0/1039270515 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2e2403eab0 con 0x7f2e2809e170 2023-10-03T10:17:06.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.574+0000 7f2e2f4f8700 1 -- 172.21.15.146:0/1039270515 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2809c8b0 con 0x7f2e2809e170 2023-10-03T10:17:06.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.578+0000 7f2e1dffb700 1 -- 172.21.15.146:0/1039270515 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e2401bb10 con 0x7f2e2809e170 2023-10-03T10:17:06.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.762+0000 7f2e2f4f8700 1 -- 172.21.15.146:0/1039270515 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2e2804f2a0 con 0x7f2e2809e170 2023-10-03T10:17:06.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.763+0000 7f2e1dffb700 1 -- 172.21.15.146:0/1039270515 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2e240192c0 con 0x7f2e2809e170 2023-10-03T10:17:06.763 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:06.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.765+0000 7f2e2f4f8700 1 -- 172.21.15.146:0/1039270515 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e2809e170 msgr2=0x7f2e28123760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.765+0000 7f2e2f4f8700 1 --2- 172.21.15.146:0/1039270515 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e2809e170 0x7f2e28123760 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400c490 tx=0x7f2e2400c7a0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.765+0000 7f2e2f4f8700 1 -- 172.21.15.146:0/1039270515 shutdown_connections 2023-10-03T10:17:06.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.765+0000 7f2e2f4f8700 1 --2- 172.21.15.146:0/1039270515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e28130eb0 0x7f2e281c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.765+0000 7f2e2f4f8700 1 --2- 172.21.15.146:0/1039270515 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e2809d860 0x7f2e28123220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.765+0000 7f2e2f4f8700 1 --2- 172.21.15.146:0/1039270515 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e2809e170 0x7f2e28123760 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.765+0000 7f2e2f4f8700 1 -- 172.21.15.146:0/1039270515 >> 172.21.15.146:0/1039270515 conn(0x7f2e28099c40 msgr2=0x7f2e280a2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.765+0000 7f2e2f4f8700 1 -- 172.21.15.146:0/1039270515 shutdown_connections 2023-10-03T10:17:06.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:06.765+0000 7f2e2f4f8700 1 -- 172.21.15.146:0/1039270515 wait complete. 2023-10-03T10:17:06.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:07.143 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.268+0000 7f3ca9694700 1 Processor -- start 2023-10-03T10:17:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.268+0000 7f3ca9694700 1 -- start start 2023-10-03T10:17:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.268+0000 7f3ca9694700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ca409e950 0x7f3ca409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.268+0000 7f3ca9694700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ca409f260 0x7f3ca4137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.268+0000 7f3ca9694700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca406caa0 con 0x7f3ca4138180 2023-10-03T10:17:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.268+0000 7f3ca9694700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca40a00b0 con 0x7f3ca409e950 2023-10-03T10:17:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.268+0000 7f3ca9694700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca409af60 con 0x7f3ca409f260 2023-10-03T10:17:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.268+0000 7f3ca2ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ca409e950 0x7f3ca409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.268+0000 7f3ca27fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ca409f260 0x7f3ca4137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.268+0000 7f3ca37fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3ca4138180 0x7f3ca413a560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44626/0 (socket says 172.21.15.146:44626) 2023-10-03T10:17:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.268+0000 7f3ca37fe700 1 -- 172.21.15.146:0/2589766810 learned_addr learned my addr 172.21.15.146:0/2589766810 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.269+0000 7f3ca1ffb700 1 -- 172.21.15.146:0/2589766810 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199004913 0 0) 0x7f3ca406caa0 con 0x7f3ca4138180 2023-10-03T10:17:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.269+0000 7f3ca2ffd700 1 -- 172.21.15.146:0/2589766810 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ca409f260 msgr2=0x7f3ca4137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.269+0000 7f3ca2ffd700 1 --2- 172.21.15.146:0/2589766810 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ca409f260 0x7f3ca4137c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.269+0000 7f3ca2ffd700 1 -- 172.21.15.146:0/2589766810 >> v1:172.21.15.146:6789/0 conn(0x7f3ca4138180 legacy=0x7f3ca413a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.269+0000 7f3ca2ffd700 1 -- 172.21.15.146:0/2589766810 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca40a0950 con 0x7f3ca409e950 2023-10-03T10:17:07.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.269+0000 7f3ca27fc700 1 --2- 172.21.15.146:0/2589766810 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ca409f260 0x7f3ca4137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:07.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.269+0000 7f3ca2ffd700 1 --2- 172.21.15.146:0/2589766810 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ca409e950 0x7f3ca409ed20 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3c94009880 tx=0x7f3c94009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90b2ffb1ec985f6c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:07.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.269+0000 7f3ca1ffb700 1 -- 172.21.15.146:0/2589766810 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94005e30 con 0x7f3ca409e950 2023-10-03T10:17:07.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.269+0000 7f3ca1ffb700 1 -- 172.21.15.146:0/2589766810 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c94006030 con 0x7f3ca409e950 2023-10-03T10:17:07.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.269+0000 7f3ca1ffb700 1 -- 172.21.15.146:0/2589766810 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c940063c0 con 0x7f3ca409e950 2023-10-03T10:17:07.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.269+0000 7f3ca9694700 1 -- 172.21.15.146:0/2589766810 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ca409e950 msgr2=0x7f3ca409ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.269+0000 7f3ca9694700 1 --2- 172.21.15.146:0/2589766810 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ca409e950 0x7f3ca409ed20 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3c94009880 tx=0x7f3c94009b90 comp rx=0 tx=0).stop 2023-10-03T10:17:07.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.269+0000 7f3ca9694700 1 -- 172.21.15.146:0/2589766810 shutdown_connections 2023-10-03T10:17:07.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.269+0000 7f3ca9694700 1 --2- 172.21.15.146:0/2589766810 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ca409e950 0x7f3ca409ed20 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.269+0000 7f3ca9694700 1 --2- 172.21.15.146:0/2589766810 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ca409f260 0x7f3ca4137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.269+0000 7f3ca9694700 1 -- 172.21.15.146:0/2589766810 >> 172.21.15.146:0/2589766810 conn(0x7f3ca40a4470 msgr2=0x7f3ca40a4870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:07.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.269+0000 7f3ca9694700 1 -- 172.21.15.146:0/2589766810 shutdown_connections 2023-10-03T10:17:07.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.270+0000 7f3ca9694700 1 -- 172.21.15.146:0/2589766810 wait complete. 2023-10-03T10:17:07.272 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:07.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.271+0000 7f3ca9694700 1 Processor -- start 2023-10-03T10:17:07.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.271+0000 7f3ca9694700 1 -- start start 2023-10-03T10:17:07.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.271+0000 7f3ca9694700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ca409e950 0x7f3ca4122d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.271+0000 7f3ca9694700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ca409f260 0x7f3ca41232b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.271+0000 7f3ca9694700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ca4138180 0x7f3ca41237f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.271+0000 7f3ca9694700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca41263d0 con 0x7f3ca409f260 2023-10-03T10:17:07.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.271+0000 7f3ca9694700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca406ccc0 con 0x7f3ca409e950 2023-10-03T10:17:07.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.271+0000 7f3ca9694700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca41265b0 con 0x7f3ca4138180 2023-10-03T10:17:07.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.271+0000 7f3ca2ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ca409e950 0x7f3ca4122d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.271+0000 7f3ca37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ca4138180 0x7f3ca41237f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.271+0000 7f3ca27fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ca409f260 0x7f3ca41232b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.271+0000 7f3ca2ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ca409e950 0x7f3ca4122d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56910/0 (socket says 172.21.15.146:56910) 2023-10-03T10:17:07.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.271+0000 7f3ca2ffd700 1 -- 172.21.15.146:0/3247466196 learned_addr learned my addr 172.21.15.146:0/3247466196 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:07.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.271+0000 7f3ca2ffd700 1 -- 172.21.15.146:0/3247466196 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ca4138180 msgr2=0x7f3ca41237f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.271+0000 7f3ca2ffd700 1 --2- 172.21.15.146:0/3247466196 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ca4138180 0x7f3ca41237f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.271+0000 7f3ca2ffd700 1 -- 172.21.15.146:0/3247466196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ca409f260 msgr2=0x7f3ca41232b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.271+0000 7f3ca2ffd700 1 --2- 172.21.15.146:0/3247466196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ca409f260 0x7f3ca41232b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.271+0000 7f3ca2ffd700 1 -- 172.21.15.146:0/3247466196 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c98009430 con 0x7f3ca409e950 2023-10-03T10:17:07.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.271+0000 7f3ca27fc700 1 --2- 172.21.15.146:0/3247466196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ca409f260 0x7f3ca41232b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:07.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.272+0000 7f3ca2ffd700 1 --2- 172.21.15.146:0/3247466196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ca409e950 0x7f3ca4122d70 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f3c94009bd0 tx=0x7f3c94004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:07.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.272+0000 7f3c8b7fe700 1 -- 172.21.15.146:0/3247466196 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94004240 con 0x7f3ca409e950 2023-10-03T10:17:07.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.272+0000 7f3c8b7fe700 1 -- 172.21.15.146:0/3247466196 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c940043a0 con 0x7f3ca409e950 2023-10-03T10:17:07.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.272+0000 7f3ca9694700 1 -- 172.21.15.146:0/3247466196 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c94009430 con 0x7f3ca409e950 2023-10-03T10:17:07.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.272+0000 7f3c8b7fe700 1 -- 172.21.15.146:0/3247466196 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94006920 con 0x7f3ca409e950 2023-10-03T10:17:07.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.272+0000 7f3ca9694700 1 -- 172.21.15.146:0/3247466196 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca4125130 con 0x7f3ca409e950 2023-10-03T10:17:07.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.272+0000 7f3c8b7fe700 1 -- 172.21.15.146:0/3247466196 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3c94022020 con 0x7f3ca409e950 2023-10-03T10:17:07.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.273+0000 7f3c8b7fe700 1 -- 172.21.15.146:0/3247466196 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3c94040980 con 0x7f3ca409e950 2023-10-03T10:17:07.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.273+0000 7f3ca9694700 1 -- 172.21.15.146:0/3247466196 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca41261d0 con 0x7f3ca409e950 2023-10-03T10:17:07.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.278+0000 7f3c8b7fe700 1 -- 172.21.15.146:0/3247466196 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3c94011420 con 0x7f3ca409e950 2023-10-03T10:17:07.307 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:07.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.403+0000 7fcd9fcb6700 1 Processor -- start 2023-10-03T10:17:07.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.403+0000 7fcd9fcb6700 1 -- start start 2023-10-03T10:17:07.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.403+0000 7fcd9fcb6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcd9809e870 0x7fcd9809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.403+0000 7fcd9fcb6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd9809f180 0x7fcd98133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.403+0000 7fcd9fcb6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd98134160 0x7fcd981345e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.403+0000 7fcd9fcb6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd980a0370 con 0x7fcd9809e870 2023-10-03T10:17:07.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.403+0000 7fcd9fcb6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9809fa00 con 0x7fcd9809f180 2023-10-03T10:17:07.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.403+0000 7fcd9fcb6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9809ada0 con 0x7fcd98134160 2023-10-03T10:17:07.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.404+0000 7fcd9da52700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcd9809e870 0x7fcd9809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.404+0000 7fcd9e253700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd98134160 0x7fcd981345e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.404+0000 7fcd9da52700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcd9809e870 0x7fcd9809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32778/0 (socket says 172.21.15.146:32778) 2023-10-03T10:17:07.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.404+0000 7fcd9da52700 1 -- 172.21.15.146:0/4098573293 learned_addr learned my addr 172.21.15.146:0/4098573293 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:07.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.404+0000 7fcd9d251700 1 --2- 172.21.15.146:0/4098573293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd9809f180 0x7fcd98133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.404+0000 7fcd9da52700 1 -- 172.21.15.146:0/4098573293 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd98134160 msgr2=0x7fcd981345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:07.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.404+0000 7fcd9da52700 1 --2- 172.21.15.146:0/4098573293 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd98134160 0x7fcd981345e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.404+0000 7fcd9da52700 1 -- 172.21.15.146:0/4098573293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd9809f180 msgr2=0x7fcd98133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:07.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.404+0000 7fcd9da52700 1 --2- 172.21.15.146:0/4098573293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd9809f180 0x7fcd98133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.404+0000 7fcd9da52700 1 -- 172.21.15.146:0/4098573293 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9806bec0 con 0x7fcd9809e870 2023-10-03T10:17:07.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.404+0000 7fcd9e253700 1 --2- 172.21.15.146:0/4098573293 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd98134160 0x7fcd981345e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:07.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.404+0000 7fcd9da52700 1 --2- 172.21.15.146:0/4098573293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9809e870 0x7fcd9809ec40 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fcd94009920 tx=0x7fcd94009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e4666a2e6dfc6e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:07.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.404+0000 7fcd9ca50700 1 -- 172.21.15.146:0/4098573293 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94011830 con 0x7fcd9809e870 2023-10-03T10:17:07.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.404+0000 7fcd9ca50700 1 -- 172.21.15.146:0/4098573293 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd94011990 con 0x7fcd9809e870 2023-10-03T10:17:07.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.404+0000 7fcd9ca50700 1 -- 172.21.15.146:0/4098573293 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94011d20 con 0x7fcd9809e870 2023-10-03T10:17:07.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.405+0000 7fcd9fcb6700 1 -- 172.21.15.146:0/4098573293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9809e870 msgr2=0x7fcd9809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.405+0000 7fcd9fcb6700 1 --2- 172.21.15.146:0/4098573293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9809e870 0x7fcd9809ec40 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fcd94009920 tx=0x7fcd94009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:07.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.405+0000 7fcd9fcb6700 1 -- 172.21.15.146:0/4098573293 shutdown_connections 2023-10-03T10:17:07.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.405+0000 7fcd9fcb6700 1 --2- 172.21.15.146:0/4098573293 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd98134160 0x7fcd981345e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.405+0000 7fcd9fcb6700 1 --2- 172.21.15.146:0/4098573293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9809e870 0x7fcd9809ec40 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.405+0000 7fcd9fcb6700 1 --2- 172.21.15.146:0/4098573293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd9809f180 0x7fcd98133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.405+0000 7fcd9fcb6700 1 -- 172.21.15.146:0/4098573293 >> 172.21.15.146:0/4098573293 conn(0x7fcd980a4430 msgr2=0x7fcd980a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:07.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.405+0000 7fcd9fcb6700 1 -- 172.21.15.146:0/4098573293 shutdown_connections 2023-10-03T10:17:07.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.405+0000 7fcd9fcb6700 1 -- 172.21.15.146:0/4098573293 wait complete. 2023-10-03T10:17:07.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.406+0000 7fcd9fcb6700 1 Processor -- start 2023-10-03T10:17:07.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.406+0000 7fcd9fcb6700 1 -- start start 2023-10-03T10:17:07.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.407+0000 7fcd9fcb6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd9809e870 0x7fcd98122590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.407+0000 7fcd9fcb6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9809f180 0x7fcd98122ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.407+0000 7fcd9fcb6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd98134160 0x7fcd98123010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.407+0000 7fcd9fcb6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd98123a60 con 0x7fcd9809f180 2023-10-03T10:17:07.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.407+0000 7fcd9fcb6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd98133960 con 0x7fcd98134160 2023-10-03T10:17:07.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.407+0000 7fcd9fcb6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd98125030 con 0x7fcd9809e870 2023-10-03T10:17:07.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.407+0000 7fcd9e253700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd98134160 0x7fcd98123010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.407+0000 7fcd9e253700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd98134160 0x7fcd98123010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56930/0 (socket says 172.21.15.146:56930) 2023-10-03T10:17:07.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.407+0000 7fcd9e253700 1 -- 172.21.15.146:0/565096350 learned_addr learned my addr 172.21.15.146:0/565096350 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:07.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.407+0000 7fcd9da52700 1 --2- 172.21.15.146:0/565096350 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd9809e870 0x7fcd98122590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.407+0000 7fcd9d251700 1 --2- 172.21.15.146:0/565096350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9809f180 0x7fcd98122ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.407+0000 7fcd9e253700 1 -- 172.21.15.146:0/565096350 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd9809e870 msgr2=0x7fcd98122590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.407+0000 7fcd9e253700 1 --2- 172.21.15.146:0/565096350 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd9809e870 0x7fcd98122590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.407+0000 7fcd9e253700 1 -- 172.21.15.146:0/565096350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9809f180 msgr2=0x7fcd98122ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.407+0000 7fcd9e253700 1 --2- 172.21.15.146:0/565096350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9809f180 0x7fcd98122ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.407+0000 7fcd9e253700 1 -- 172.21.15.146:0/565096350 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd90009a70 con 0x7fcd98134160 2023-10-03T10:17:07.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.408+0000 7fcd9e253700 1 --2- 172.21.15.146:0/565096350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd98134160 0x7fcd98123010 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000efc0 tx=0x7fcd9000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:07.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.408+0000 7fcd8e7fc700 1 -- 172.21.15.146:0/565096350 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9000ca90 con 0x7fcd98134160 2023-10-03T10:17:07.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.408+0000 7fcd8e7fc700 1 -- 172.21.15.146:0/565096350 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9000f040 con 0x7fcd98134160 2023-10-03T10:17:07.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.408+0000 7fcd9fcb6700 1 -- 172.21.15.146:0/565096350 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd94009550 con 0x7fcd98134160 2023-10-03T10:17:07.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.408+0000 7fcd8e7fc700 1 -- 172.21.15.146:0/565096350 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9000ce10 con 0x7fcd98134160 2023-10-03T10:17:07.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.408+0000 7fcd9fcb6700 1 -- 172.21.15.146:0/565096350 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd980a1330 con 0x7fcd98134160 2023-10-03T10:17:07.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.409+0000 7fcd8e7fc700 1 -- 172.21.15.146:0/565096350 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd90014480 con 0x7fcd98134160 2023-10-03T10:17:07.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.409+0000 7fcd9fcb6700 1 -- 172.21.15.146:0/565096350 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9804f2a0 con 0x7fcd98134160 2023-10-03T10:17:07.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.409+0000 7fcd8e7fc700 1 -- 172.21.15.146:0/565096350 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcd9003fd70 con 0x7fcd98134160 2023-10-03T10:17:07.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.417+0000 7fcd8e7fc700 1 -- 172.21.15.146:0/565096350 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd90012930 con 0x7fcd98134160 2023-10-03T10:17:07.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.448+0000 7fdfc1b31700 1 Processor -- start 2023-10-03T10:17:07.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.448+0000 7fdfc1b31700 1 -- start start 2023-10-03T10:17:07.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.448+0000 7fdfc1b31700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfbc0a1550 0x7fdfbc138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.448+0000 7fdfc1b31700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfbc139200 0x7fdfbc13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.448+0000 7fdfc1b31700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfbc09e9d0 con 0x7fdfbc0a0a70 2023-10-03T10:17:07.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.448+0000 7fdfc1b31700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc09dc00 con 0x7fdfbc0a1550 2023-10-03T10:17:07.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.448+0000 7fdfc1b31700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc09dec0 con 0x7fdfbc139200 2023-10-03T10:17:07.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.448+0000 7fdfbb7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdfbc0a0a70 0x7fdfbc0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44642/0 (socket says 172.21.15.146:44642) 2023-10-03T10:17:07.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.448+0000 7fdfbb7fe700 1 -- 172.21.15.146:0/1874592358 learned_addr learned my addr 172.21.15.146:0/1874592358 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:07.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.448+0000 7fdfbaffd700 1 --2- 172.21.15.146:0/1874592358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfbc0a1550 0x7fdfbc138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.448+0000 7fdfbbfff700 1 --2- 172.21.15.146:0/1874592358 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfbc139200 0x7fdfbc13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.449+0000 7fdfba7fc700 1 -- 172.21.15.146:0/1874592358 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121085176 0 0) 0x7fdfbc09e9d0 con 0x7fdfbc0a0a70 2023-10-03T10:17:07.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.449+0000 7fdfbaffd700 1 -- 172.21.15.146:0/1874592358 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfbc139200 msgr2=0x7fdfbc13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:07.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.449+0000 7fdfbaffd700 1 --2- 172.21.15.146:0/1874592358 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfbc139200 0x7fdfbc13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.449+0000 7fdfbaffd700 1 -- 172.21.15.146:0/1874592358 >> v1:172.21.15.146:6789/0 conn(0x7fdfbc0a0a70 legacy=0x7fdfbc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.449+0000 7fdfbaffd700 1 -- 172.21.15.146:0/1874592358 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc09e6a0 con 0x7fdfbc0a1550 2023-10-03T10:17:07.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.449+0000 7fdfbaffd700 1 --2- 172.21.15.146:0/1874592358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfbc0a1550 0x7fdfbc138cc0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0009870 tx=0x7fdfb0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22b9299dc9d246f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:07.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.449+0000 7fdfba7fc700 1 -- 172.21.15.146:0/1874592358 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0011830 con 0x7fdfbc0a1550 2023-10-03T10:17:07.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.449+0000 7fdfba7fc700 1 -- 172.21.15.146:0/1874592358 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb0011990 con 0x7fdfbc0a1550 2023-10-03T10:17:07.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.449+0000 7fdfba7fc700 1 -- 172.21.15.146:0/1874592358 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0011d20 con 0x7fdfbc0a1550 2023-10-03T10:17:07.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.449+0000 7fdfc1b31700 1 -- 172.21.15.146:0/1874592358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfbc0a1550 msgr2=0x7fdfbc138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.449+0000 7fdfc1b31700 1 --2- 172.21.15.146:0/1874592358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfbc0a1550 0x7fdfbc138cc0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0009870 tx=0x7fdfb0009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:07.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.450+0000 7fdfc1b31700 1 -- 172.21.15.146:0/1874592358 shutdown_connections 2023-10-03T10:17:07.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.450+0000 7fdfc1b31700 1 --2- 172.21.15.146:0/1874592358 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfbc139200 0x7fdfbc13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.450+0000 7fdfc1b31700 1 --2- 172.21.15.146:0/1874592358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfbc0a1550 0x7fdfbc138cc0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.450+0000 7fdfc1b31700 1 -- 172.21.15.146:0/1874592358 >> 172.21.15.146:0/1874592358 conn(0x7fdfbc0a6610 msgr2=0x7fdfbc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:07.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.450+0000 7fdfc1b31700 1 -- 172.21.15.146:0/1874592358 shutdown_connections 2023-10-03T10:17:07.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.450+0000 7fdfc1b31700 1 -- 172.21.15.146:0/1874592358 wait complete. 2023-10-03T10:17:07.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.450+0000 7fdfc1b31700 1 Processor -- start 2023-10-03T10:17:07.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.451+0000 7fdfc1b31700 1 -- start start 2023-10-03T10:17:07.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.451+0000 7fdfc1b31700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfbc0a0a70 0x7fdfbc1207d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.451+0000 7fdfc1b31700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfbc0a1550 0x7fdfbc120d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.451+0000 7fdfc1b31700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfbc139200 0x7fdfbc121250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.451+0000 7fdfc1b31700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc1242f0 con 0x7fdfbc0a1550 2023-10-03T10:17:07.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.451+0000 7fdfc1b31700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc136620 con 0x7fdfbc0a0a70 2023-10-03T10:17:07.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.451+0000 7fdfc1b31700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc122ba0 con 0x7fdfbc139200 2023-10-03T10:17:07.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.451+0000 7fdfbaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfbc0a1550 0x7fdfbc120d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.451+0000 7fdfbb7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfbc0a0a70 0x7fdfbc1207d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.451+0000 7fdfbaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfbc0a1550 0x7fdfbc120d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32798/0 (socket says 172.21.15.146:32798) 2023-10-03T10:17:07.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.451+0000 7fdfbaffd700 1 -- 172.21.15.146:0/824893802 learned_addr learned my addr 172.21.15.146:0/824893802 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:07.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.451+0000 7fdfbbfff700 1 --2- 172.21.15.146:0/824893802 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfbc139200 0x7fdfbc121250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.451+0000 7fdfbb7fe700 1 -- 172.21.15.146:0/824893802 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfbc139200 msgr2=0x7fdfbc121250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.451+0000 7fdfbb7fe700 1 --2- 172.21.15.146:0/824893802 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfbc139200 0x7fdfbc121250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.452+0000 7fdfbb7fe700 1 -- 172.21.15.146:0/824893802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfbc0a1550 msgr2=0x7fdfbc120d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.452+0000 7fdfbb7fe700 1 --2- 172.21.15.146:0/824893802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfbc0a1550 0x7fdfbc120d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.452+0000 7fdfbb7fe700 1 -- 172.21.15.146:0/824893802 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb00094a0 con 0x7fdfbc0a0a70 2023-10-03T10:17:07.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.452+0000 7fdfbbfff700 1 --2- 172.21.15.146:0/824893802 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfbc139200 0x7fdfbc121250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:07.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.452+0000 7fdfbb7fe700 1 --2- 172.21.15.146:0/824893802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfbc0a0a70 0x7fdfbc1207d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00c4a0 tx=0x7fdfac00c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:07.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.452+0000 7fdfa3fff700 1 -- 172.21.15.146:0/824893802 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac004c80 con 0x7fdfbc0a0a70 2023-10-03T10:17:07.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.452+0000 7fdfa3fff700 1 -- 172.21.15.146:0/824893802 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfac004de0 con 0x7fdfbc0a0a70 2023-10-03T10:17:07.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.452+0000 7fdfa3fff700 1 -- 172.21.15.146:0/824893802 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac007310 con 0x7fdfbc0a0a70 2023-10-03T10:17:07.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.452+0000 7fdfc1b31700 1 -- 172.21.15.146:0/824893802 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfbc0a5100 con 0x7fdfbc0a0a70 2023-10-03T10:17:07.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.452+0000 7fdfc1b31700 1 -- 172.21.15.146:0/824893802 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfbc123f70 con 0x7fdfbc0a0a70 2023-10-03T10:17:07.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.453+0000 7fdfa3fff700 1 -- 172.21.15.146:0/824893802 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdfac007470 con 0x7fdfbc0a0a70 2023-10-03T10:17:07.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.453+0000 7fdfc1b31700 1 -- 172.21.15.146:0/824893802 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfbc04f2a0 con 0x7fdfbc0a0a70 2023-10-03T10:17:07.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.453+0000 7fdfa3fff700 1 -- 172.21.15.146:0/824893802 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdfac03f210 con 0x7fdfbc0a0a70 2023-10-03T10:17:07.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.457+0000 7fdfa3fff700 1 -- 172.21.15.146:0/824893802 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdfac007720 con 0x7fdfbc0a0a70 2023-10-03T10:17:07.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.478+0000 7f3ca9694700 1 -- 172.21.15.146:0/3247466196 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3ca404f2a0 con 0x7f3ca409e950 2023-10-03T10:17:07.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.478+0000 7f3c8b7fe700 1 -- 172.21.15.146:0/3247466196 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3c94034090 con 0x7f3ca409e950 2023-10-03T10:17:07.478 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:07.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.480+0000 7f3ca9694700 1 -- 172.21.15.146:0/3247466196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ca409e950 msgr2=0x7f3ca4122d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.480+0000 7f3ca9694700 1 --2- 172.21.15.146:0/3247466196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ca409e950 0x7f3ca4122d70 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f3c94009bd0 tx=0x7f3c94004750 comp rx=0 tx=0).stop 2023-10-03T10:17:07.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.481+0000 7f3ca9694700 1 -- 172.21.15.146:0/3247466196 shutdown_connections 2023-10-03T10:17:07.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.481+0000 7f3ca9694700 1 --2- 172.21.15.146:0/3247466196 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ca4138180 0x7f3ca41237f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.481+0000 7f3ca9694700 1 --2- 172.21.15.146:0/3247466196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ca409e950 0x7f3ca4122d70 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.481+0000 7f3ca9694700 1 --2- 172.21.15.146:0/3247466196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ca409f260 0x7f3ca41232b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.481+0000 7f3ca9694700 1 -- 172.21.15.146:0/3247466196 >> 172.21.15.146:0/3247466196 conn(0x7f3ca40a4470 msgr2=0x7f3ca4071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:07.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.481+0000 7f3ca9694700 1 -- 172.21.15.146:0/3247466196 shutdown_connections 2023-10-03T10:17:07.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.481+0000 7f3ca9694700 1 -- 172.21.15.146:0/3247466196 wait complete. 2023-10-03T10:17:07.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:07.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.609+0000 7fcd9fcb6700 1 -- 172.21.15.146:0/565096350 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcd98072d60 con 0x7fcd98134160 2023-10-03T10:17:07.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.610+0000 7fcd8e7fc700 1 -- 172.21.15.146:0/565096350 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcd90012340 con 0x7fcd98134160 2023-10-03T10:17:07.609 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:07.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.612+0000 7fcd9fcb6700 1 -- 172.21.15.146:0/565096350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd98134160 msgr2=0x7fcd98123010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.612+0000 7fcd9fcb6700 1 --2- 172.21.15.146:0/565096350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd98134160 0x7fcd98123010 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000efc0 tx=0x7fcd9000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.612+0000 7fcd9fcb6700 1 -- 172.21.15.146:0/565096350 shutdown_connections 2023-10-03T10:17:07.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.612+0000 7fcd9fcb6700 1 --2- 172.21.15.146:0/565096350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd98134160 0x7fcd98123010 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.612+0000 7fcd9fcb6700 1 --2- 172.21.15.146:0/565096350 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd9809e870 0x7fcd98122590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.612+0000 7fcd9fcb6700 1 --2- 172.21.15.146:0/565096350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9809f180 0x7fcd98122ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.612+0000 7fcd9fcb6700 1 -- 172.21.15.146:0/565096350 >> 172.21.15.146:0/565096350 conn(0x7fcd980a4430 msgr2=0x7fcd98070b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:07.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.612+0000 7fcd9fcb6700 1 -- 172.21.15.146:0/565096350 shutdown_connections 2023-10-03T10:17:07.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.612+0000 7fcd9fcb6700 1 -- 172.21.15.146:0/565096350 wait complete. 2023-10-03T10:17:07.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:07.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.651+0000 7fdfc1b31700 1 -- 172.21.15.146:0/824893802 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdfbc072980 con 0x7fdfbc0a0a70 2023-10-03T10:17:07.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.651+0000 7fdfa3fff700 1 -- 172.21.15.146:0/824893802 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdfac011360 con 0x7fdfbc0a0a70 2023-10-03T10:17:07.651 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:07.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.653+0000 7fdfc1b31700 1 -- 172.21.15.146:0/824893802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfbc0a0a70 msgr2=0x7fdfbc1207d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.653+0000 7fdfc1b31700 1 --2- 172.21.15.146:0/824893802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfbc0a0a70 0x7fdfbc1207d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00c4a0 tx=0x7fdfac00c7b0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.653+0000 7fdfc1b31700 1 -- 172.21.15.146:0/824893802 shutdown_connections 2023-10-03T10:17:07.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.653+0000 7fdfc1b31700 1 --2- 172.21.15.146:0/824893802 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdfbc139200 0x7fdfbc121250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.653+0000 7fdfc1b31700 1 --2- 172.21.15.146:0/824893802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdfbc0a0a70 0x7fdfbc1207d0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.653+0000 7fdfc1b31700 1 --2- 172.21.15.146:0/824893802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfbc0a1550 0x7fdfbc120d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.653+0000 7fdfc1b31700 1 -- 172.21.15.146:0/824893802 >> 172.21.15.146:0/824893802 conn(0x7fdfbc0a6610 msgr2=0x7fdfbc0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:07.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.653+0000 7fdfc1b31700 1 -- 172.21.15.146:0/824893802 shutdown_connections 2023-10-03T10:17:07.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.653+0000 7fdfc1b31700 1 -- 172.21.15.146:0/824893802 wait complete. 2023-10-03T10:17:07.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:07.778 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:07.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.900+0000 7fa63adeb700 1 Processor -- start 2023-10-03T10:17:07.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.900+0000 7fa63adeb700 1 -- start start 2023-10-03T10:17:07.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa63adeb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa634133ad0 0x7fa634133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa63adeb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa6341300a0 0x7fa6341304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa63adeb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6341309f0 0x7fa63413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa63adeb700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa63406b2d0 con 0x7fa634133ad0 2023-10-03T10:17:07.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa63adeb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa634133610 con 0x7fa6341309f0 2023-10-03T10:17:07.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa63adeb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa63409a500 con 0x7fa6341300a0 2023-10-03T10:17:07.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa633fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa6341300a0 0x7fa6341304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa638b87700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa634133ad0 0x7fa634133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa639388700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6341309f0 0x7fa63413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa639388700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6341309f0 0x7fa63413a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56966/0 (socket says 172.21.15.146:56966) 2023-10-03T10:17:07.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa633fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa6341300a0 0x7fa6341304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57034/0 (socket says 172.21.15.146:57034) 2023-10-03T10:17:07.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa638b87700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa634133ad0 0x7fa634133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32806/0 (socket says 172.21.15.146:32806) 2023-10-03T10:17:07.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa639388700 1 -- 172.21.15.146:0/3530526425 learned_addr learned my addr 172.21.15.146:0/3530526425 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:07.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa639388700 1 -- 172.21.15.146:0/3530526425 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa6341300a0 msgr2=0x7fa6341304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:07.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa639388700 1 --2- 172.21.15.146:0/3530526425 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa6341300a0 0x7fa6341304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa639388700 1 -- 172.21.15.146:0/3530526425 >> v2:172.21.15.146:3300/0 conn(0x7fa634133ad0 msgr2=0x7fa634133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:07.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa639388700 1 --2- 172.21.15.146:0/3530526425 >> v2:172.21.15.146:3300/0 conn(0x7fa634133ad0 0x7fa634133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa639388700 1 -- 172.21.15.146:0/3530526425 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6341338b0 con 0x7fa6341309f0 2023-10-03T10:17:07.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa633fff700 1 --2- 172.21.15.146:0/3530526425 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa6341300a0 0x7fa6341304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:07.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa638b87700 1 --2- 172.21.15.146:0/3530526425 >> v2:172.21.15.146:3300/0 conn(0x7fa634133ad0 0x7fa634133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:07.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa639388700 1 --2- 172.21.15.146:0/3530526425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6341309f0 0x7fa63413a980 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa62c009e50 tx=0x7fa62c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a8cd3883cf66908 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:07.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa6337fe700 1 -- 172.21.15.146:0/3530526425 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c00e070 con 0x7fa6341309f0 2023-10-03T10:17:07.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa6337fe700 1 -- 172.21.15.146:0/3530526425 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62c00b910 con 0x7fa6341309f0 2023-10-03T10:17:07.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.901+0000 7fa6337fe700 1 -- 172.21.15.146:0/3530526425 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c00bcc0 con 0x7fa6341309f0 2023-10-03T10:17:07.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.902+0000 7fa63adeb700 1 -- 172.21.15.146:0/3530526425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6341309f0 msgr2=0x7fa63413a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.902+0000 7fa63adeb700 1 --2- 172.21.15.146:0/3530526425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6341309f0 0x7fa63413a980 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa62c009e50 tx=0x7fa62c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:07.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.902+0000 7fa63adeb700 1 -- 172.21.15.146:0/3530526425 shutdown_connections 2023-10-03T10:17:07.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.902+0000 7fa63adeb700 1 --2- 172.21.15.146:0/3530526425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6341309f0 0x7fa63413a980 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.902+0000 7fa63adeb700 1 --2- 172.21.15.146:0/3530526425 >> v2:172.21.15.146:3300/0 conn(0x7fa634133ad0 0x7fa634133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.902+0000 7fa63adeb700 1 --2- 172.21.15.146:0/3530526425 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa6341300a0 0x7fa6341304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.902+0000 7fa63adeb700 1 -- 172.21.15.146:0/3530526425 >> 172.21.15.146:0/3530526425 conn(0x7fa634099c40 msgr2=0x7fa6340a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:07.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.902+0000 7fa63adeb700 1 -- 172.21.15.146:0/3530526425 shutdown_connections 2023-10-03T10:17:07.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.902+0000 7fa63adeb700 1 -- 172.21.15.146:0/3530526425 wait complete. 2023-10-03T10:17:07.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.903+0000 7fa63adeb700 1 Processor -- start 2023-10-03T10:17:07.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.903+0000 7fa63adeb700 1 -- start start 2023-10-03T10:17:07.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.903+0000 7fa63adeb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6341300a0 0x7fa63411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.903+0000 7fa63adeb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6341309f0 0x7fa63411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.903+0000 7fa63adeb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa634133ad0 0x7fa63411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.903+0000 7fa63adeb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63412d930 con 0x7fa6341300a0 2023-10-03T10:17:07.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.903+0000 7fa63adeb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63411fa40 con 0x7fa6341309f0 2023-10-03T10:17:07.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.903+0000 7fa63adeb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa63411fd00 con 0x7fa634133ad0 2023-10-03T10:17:07.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.904+0000 7fa638b87700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6341300a0 0x7fa63411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.904+0000 7fa633fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6341309f0 0x7fa63411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.904+0000 7fa639388700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa634133ad0 0x7fa63411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.904+0000 7fa638b87700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6341300a0 0x7fa63411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32818/0 (socket says 172.21.15.146:32818) 2023-10-03T10:17:07.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.904+0000 7fa633fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6341309f0 0x7fa63411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56982/0 (socket says 172.21.15.146:56982) 2023-10-03T10:17:07.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.904+0000 7fa638b87700 1 -- 172.21.15.146:0/792406797 learned_addr learned my addr 172.21.15.146:0/792406797 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:07.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.904+0000 7fa638b87700 1 -- 172.21.15.146:0/792406797 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa634133ad0 msgr2=0x7fa63411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.904+0000 7fa638b87700 1 --2- 172.21.15.146:0/792406797 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa634133ad0 0x7fa63411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.904+0000 7fa638b87700 1 -- 172.21.15.146:0/792406797 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6341309f0 msgr2=0x7fa63411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.904+0000 7fa638b87700 1 --2- 172.21.15.146:0/792406797 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6341309f0 0x7fa63411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.904+0000 7fa638b87700 1 -- 172.21.15.146:0/792406797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6200094a0 con 0x7fa6341300a0 2023-10-03T10:17:07.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.904+0000 7fa633fff700 1 --2- 172.21.15.146:0/792406797 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6341309f0 0x7fa63411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:07.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.904+0000 7fa638b87700 1 --2- 172.21.15.146:0/792406797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6341300a0 0x7fa63411da40 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fa62800ebe0 tx=0x7fa62800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:07.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.904+0000 7fa6317fa700 1 -- 172.21.15.146:0/792406797 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62800c850 con 0x7fa6341300a0 2023-10-03T10:17:07.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.904+0000 7fa6317fa700 1 -- 172.21.15.146:0/792406797 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62800c9b0 con 0x7fa6341300a0 2023-10-03T10:17:07.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.904+0000 7fa63adeb700 1 -- 172.21.15.146:0/792406797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6280094a0 con 0x7fa6341300a0 2023-10-03T10:17:07.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.904+0000 7fa6317fa700 1 -- 172.21.15.146:0/792406797 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62800cd40 con 0x7fa6341300a0 2023-10-03T10:17:07.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.904+0000 7fa63adeb700 1 -- 172.21.15.146:0/792406797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62c009b30 con 0x7fa6341300a0 2023-10-03T10:17:07.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.905+0000 7fa6317fa700 1 -- 172.21.15.146:0/792406797 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa628013470 con 0x7fa6341300a0 2023-10-03T10:17:07.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.905+0000 7fa63adeb700 1 -- 172.21.15.146:0/792406797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63404f2a0 con 0x7fa6341300a0 2023-10-03T10:17:07.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.905+0000 7fa6317fa700 1 -- 172.21.15.146:0/792406797 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa62803f790 con 0x7fa6341300a0 2023-10-03T10:17:07.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:07.910+0000 7fa6317fa700 1 -- 172.21.15.146:0/792406797 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa62800cea0 con 0x7fa6341300a0 2023-10-03T10:17:08.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.093+0000 7fa63adeb700 1 -- 172.21.15.146:0/792406797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa6341208e0 con 0x7fa6341300a0 2023-10-03T10:17:08.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.093+0000 7fa6317fa700 1 -- 172.21.15.146:0/792406797 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa62801b9c0 con 0x7fa6341300a0 2023-10-03T10:17:08.093 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:08.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.095+0000 7fa63adeb700 1 -- 172.21.15.146:0/792406797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6341300a0 msgr2=0x7fa63411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.095+0000 7fa63adeb700 1 --2- 172.21.15.146:0/792406797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6341300a0 0x7fa63411da40 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fa62800ebe0 tx=0x7fa62800eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.095+0000 7fa63adeb700 1 -- 172.21.15.146:0/792406797 shutdown_connections 2023-10-03T10:17:08.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.095+0000 7fa63adeb700 1 --2- 172.21.15.146:0/792406797 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa634133ad0 0x7fa63411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.095+0000 7fa63adeb700 1 --2- 172.21.15.146:0/792406797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6341300a0 0x7fa63411da40 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.095+0000 7fa63adeb700 1 --2- 172.21.15.146:0/792406797 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6341309f0 0x7fa63411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.095+0000 7fa63adeb700 1 -- 172.21.15.146:0/792406797 >> 172.21.15.146:0/792406797 conn(0x7fa634099c40 msgr2=0x7fa63412e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.095+0000 7fa63adeb700 1 -- 172.21.15.146:0/792406797 shutdown_connections 2023-10-03T10:17:08.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.095+0000 7fa63adeb700 1 -- 172.21.15.146:0/792406797 wait complete. 2023-10-03T10:17:08.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:08.494 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:08.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.618+0000 7f57713e8700 1 Processor -- start 2023-10-03T10:17:08.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.618+0000 7f57713e8700 1 -- start start 2023-10-03T10:17:08.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.619+0000 7f57713e8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f576c133ad0 0x7f576c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.619+0000 7f57713e8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576c130bc0 0x7f576c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.619+0000 7f57713e8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f576c06b2d0 con 0x7f576c1300a0 2023-10-03T10:17:08.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.619+0000 7f57713e8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576c133610 con 0x7f576c133ad0 2023-10-03T10:17:08.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.619+0000 7f57713e8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576c09a500 con 0x7f576c130bc0 2023-10-03T10:17:08.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.619+0000 7f576affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f576c133ad0 0x7f576c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.619+0000 7f576a7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f576c1300a0 0x7f576c1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44644/0 (socket says 172.21.15.146:44644) 2023-10-03T10:17:08.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.619+0000 7f576b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576c130bc0 0x7f576c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.619+0000 7f576a7fc700 1 -- 172.21.15.146:0/476920018 learned_addr learned my addr 172.21.15.146:0/476920018 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:08.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.619+0000 7f576b7fe700 1 -- 172.21.15.146:0/476920018 >> v2:172.21.15.146:3300/0 conn(0x7f576c133ad0 msgr2=0x7f576c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:08.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.619+0000 7f576b7fe700 1 --2- 172.21.15.146:0/476920018 >> v2:172.21.15.146:3300/0 conn(0x7f576c133ad0 0x7f576c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.619+0000 7f576b7fe700 1 -- 172.21.15.146:0/476920018 >> v1:172.21.15.146:6789/0 conn(0x7f576c1300a0 legacy=0x7f576c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.619+0000 7f576b7fe700 1 -- 172.21.15.146:0/476920018 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576c1338b0 con 0x7f576c130bc0 2023-10-03T10:17:08.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.619+0000 7f576affd700 1 --2- 172.21.15.146:0/476920018 >> v2:172.21.15.146:3300/0 conn(0x7f576c133ad0 0x7f576c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.619+0000 7f576b7fe700 1 --2- 172.21.15.146:0/476920018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576c130bc0 0x7f576c13b990 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f5764009d90 tx=0x7f576400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb9a6e6e6129d8c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.619+0000 7f5769ffb700 1 -- 172.21.15.146:0/476920018 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576400e070 con 0x7f576c130bc0 2023-10-03T10:17:08.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.619+0000 7f5769ffb700 1 -- 172.21.15.146:0/476920018 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576400bb20 con 0x7f576c130bc0 2023-10-03T10:17:08.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.619+0000 7f5769ffb700 1 -- 172.21.15.146:0/476920018 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5764012430 con 0x7f576c130bc0 2023-10-03T10:17:08.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.620+0000 7f57713e8700 1 -- 172.21.15.146:0/476920018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576c130bc0 msgr2=0x7f576c13b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.620+0000 7f57713e8700 1 --2- 172.21.15.146:0/476920018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576c130bc0 0x7f576c13b990 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f5764009d90 tx=0x7f576400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:08.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.620+0000 7f57713e8700 1 -- 172.21.15.146:0/476920018 shutdown_connections 2023-10-03T10:17:08.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.620+0000 7f57713e8700 1 --2- 172.21.15.146:0/476920018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576c130bc0 0x7f576c13b990 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.620+0000 7f57713e8700 1 --2- 172.21.15.146:0/476920018 >> v2:172.21.15.146:3300/0 conn(0x7f576c133ad0 0x7f576c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.620+0000 7f57713e8700 1 -- 172.21.15.146:0/476920018 >> 172.21.15.146:0/476920018 conn(0x7f576c099c40 msgr2=0x7f576c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.620+0000 7f57713e8700 1 -- 172.21.15.146:0/476920018 shutdown_connections 2023-10-03T10:17:08.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.620+0000 7f57713e8700 1 -- 172.21.15.146:0/476920018 wait complete. 2023-10-03T10:17:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.621+0000 7f57713e8700 1 Processor -- start 2023-10-03T10:17:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.621+0000 7f57713e8700 1 -- start start 2023-10-03T10:17:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.621+0000 7f57713e8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f576c1300a0 0x7f576c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.621+0000 7f57713e8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576c130bc0 0x7f576c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.621+0000 7f57713e8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f576c133ad0 0x7f576c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.621+0000 7f57713e8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576c12d8f0 con 0x7f576c1300a0 2023-10-03T10:17:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.621+0000 7f57713e8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576c11ffa0 con 0x7f576c130bc0 2023-10-03T10:17:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.621+0000 7f57713e8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f576c12dd00 con 0x7f576c133ad0 2023-10-03T10:17:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.622+0000 7f576affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f576c1300a0 0x7f576c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.622+0000 7f576a7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576c130bc0 0x7f576c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.622+0000 7f576affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f576c1300a0 0x7f576c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32842/0 (socket says 172.21.15.146:32842) 2023-10-03T10:17:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.622+0000 7f576affd700 1 -- 172.21.15.146:0/84357157 learned_addr learned my addr 172.21.15.146:0/84357157 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.622+0000 7f576b7fe700 1 --2- 172.21.15.146:0/84357157 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f576c133ad0 0x7f576c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.622+0000 7f576affd700 1 -- 172.21.15.146:0/84357157 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f576c133ad0 msgr2=0x7f576c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.622+0000 7f576affd700 1 --2- 172.21.15.146:0/84357157 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f576c133ad0 0x7f576c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.622+0000 7f576affd700 1 -- 172.21.15.146:0/84357157 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576c130bc0 msgr2=0x7f576c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.622+0000 7f576affd700 1 --2- 172.21.15.146:0/84357157 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576c130bc0 0x7f576c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.622+0000 7f576affd700 1 -- 172.21.15.146:0/84357157 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57600094a0 con 0x7f576c1300a0 2023-10-03T10:17:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.622+0000 7f576a7fc700 1 --2- 172.21.15.146:0/84357157 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576c130bc0 0x7f576c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.622+0000 7f576affd700 1 --2- 172.21.15.146:0/84357157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f576c1300a0 0x7f576c11da40 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f576000ebe0 tx=0x7f576000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.622+0000 7f57537fe700 1 -- 172.21.15.146:0/84357157 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576000c850 con 0x7f576c1300a0 2023-10-03T10:17:08.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.622+0000 7f57537fe700 1 -- 172.21.15.146:0/84357157 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576000c9b0 con 0x7f576c1300a0 2023-10-03T10:17:08.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.622+0000 7f57713e8700 1 -- 172.21.15.146:0/84357157 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5764009a70 con 0x7f576c1300a0 2023-10-03T10:17:08.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.622+0000 7f57537fe700 1 -- 172.21.15.146:0/84357157 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576000cd40 con 0x7f576c1300a0 2023-10-03T10:17:08.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.622+0000 7f57713e8700 1 -- 172.21.15.146:0/84357157 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576c11f2e0 con 0x7f576c1300a0 2023-10-03T10:17:08.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.623+0000 7f57537fe700 1 -- 172.21.15.146:0/84357157 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5760013470 con 0x7f576c1300a0 2023-10-03T10:17:08.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.623+0000 7f57537fe700 1 -- 172.21.15.146:0/84357157 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f576003fb30 con 0x7f576c1300a0 2023-10-03T10:17:08.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.623+0000 7f57713e8700 1 -- 172.21.15.146:0/84357157 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f576c04f2a0 con 0x7f576c1300a0 2023-10-03T10:17:08.626 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:08.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.628+0000 7f57537fe700 1 -- 172.21.15.146:0/84357157 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5760021020 con 0x7f576c1300a0 2023-10-03T10:17:08.665 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:08.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.752+0000 7f1d7419d700 1 Processor -- start 2023-10-03T10:17:08.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.753+0000 7f1d7419d700 1 -- start start 2023-10-03T10:17:08.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.753+0000 7f1d7419d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1d6c0a1550 0x7f1d6c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.753+0000 7f1d7419d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d6c139200 0x7f1d6c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.753+0000 7f1d7419d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d6c09e9d0 con 0x7f1d6c0a0a70 2023-10-03T10:17:08.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.753+0000 7f1d7419d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d6c09dc00 con 0x7f1d6c0a1550 2023-10-03T10:17:08.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.753+0000 7f1d7419d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c09dec0 con 0x7f1d6c139200 2023-10-03T10:17:08.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.753+0000 7f1d7273a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d6c139200 0x7f1d6c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.753+0000 7f1d7273a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d6c139200 0x7f1d6c13b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57052/0 (socket says 172.21.15.146:57052) 2023-10-03T10:17:08.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.753+0000 7f1d7273a700 1 -- 172.21.15.146:0/1478556492 learned_addr learned my addr 172.21.15.146:0/1478556492 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:08.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.753+0000 7f1d71738700 1 --2- 172.21.15.146:0/1478556492 >> v2:172.21.15.146:3300/0 conn(0x7f1d6c0a1550 0x7f1d6c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.754+0000 7f1d7273a700 1 -- 172.21.15.146:0/1478556492 >> v2:172.21.15.146:3300/0 conn(0x7f1d6c0a1550 msgr2=0x7f1d6c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.754+0000 7f1d7273a700 1 --2- 172.21.15.146:0/1478556492 >> v2:172.21.15.146:3300/0 conn(0x7f1d6c0a1550 0x7f1d6c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.754+0000 7f1d7273a700 1 -- 172.21.15.146:0/1478556492 >> v1:172.21.15.146:6789/0 conn(0x7f1d6c0a0a70 legacy=0x7f1d6c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.754+0000 7f1d7273a700 1 -- 172.21.15.146:0/1478556492 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c09e6a0 con 0x7f1d6c139200 2023-10-03T10:17:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.754+0000 7f1d70f37700 1 -- 172.21.15.146:0/1478556492 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621331250 0 0) 0x7f1d6c09e9d0 con 0x7f1d6c0a0a70 2023-10-03T10:17:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.754+0000 7f1d71738700 1 --2- 172.21.15.146:0/1478556492 >> v2:172.21.15.146:3300/0 conn(0x7f1d6c0a1550 0x7f1d6c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.754+0000 7f1d7273a700 1 --2- 172.21.15.146:0/1478556492 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d6c139200 0x7f1d6c13b5e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1d64009e50 tx=0x7f1d6400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df0c1cc7ac3e1f18 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.754+0000 7f1d70f37700 1 -- 172.21.15.146:0/1478556492 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6400e070 con 0x7f1d6c139200 2023-10-03T10:17:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.754+0000 7f1d70f37700 1 -- 172.21.15.146:0/1478556492 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6400b910 con 0x7f1d6c139200 2023-10-03T10:17:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.754+0000 7f1d70f37700 1 -- 172.21.15.146:0/1478556492 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6400bcc0 con 0x7f1d6c139200 2023-10-03T10:17:08.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.755+0000 7f1d7419d700 1 -- 172.21.15.146:0/1478556492 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d6c139200 msgr2=0x7f1d6c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.755+0000 7f1d7419d700 1 --2- 172.21.15.146:0/1478556492 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d6c139200 0x7f1d6c13b5e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1d64009e50 tx=0x7f1d6400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:08.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.755+0000 7f1d7419d700 1 -- 172.21.15.146:0/1478556492 shutdown_connections 2023-10-03T10:17:08.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.755+0000 7f1d7419d700 1 --2- 172.21.15.146:0/1478556492 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d6c139200 0x7f1d6c13b5e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.755+0000 7f1d7419d700 1 --2- 172.21.15.146:0/1478556492 >> v2:172.21.15.146:3300/0 conn(0x7f1d6c0a1550 0x7f1d6c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.755+0000 7f1d7419d700 1 -- 172.21.15.146:0/1478556492 >> 172.21.15.146:0/1478556492 conn(0x7f1d6c0a6610 msgr2=0x7f1d6c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.755+0000 7f1d7419d700 1 -- 172.21.15.146:0/1478556492 shutdown_connections 2023-10-03T10:17:08.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.755+0000 7f1d7419d700 1 -- 172.21.15.146:0/1478556492 wait complete. 2023-10-03T10:17:08.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.756+0000 7f1d7419d700 1 Processor -- start 2023-10-03T10:17:08.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.756+0000 7f1d7419d700 1 -- start start 2023-10-03T10:17:08.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.756+0000 7f1d7419d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d6c0a0a70 0x7f1d6c1208a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.756+0000 7f1d7419d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d6c0a1550 0x7f1d6c120de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.756+0000 7f1d7419d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d6c139200 0x7f1d6c121320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.756+0000 7f1d7419d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c1243c0 con 0x7f1d6c139200 2023-10-03T10:17:08.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.756+0000 7f1d7419d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c0a03e0 con 0x7f1d6c0a0a70 2023-10-03T10:17:08.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.756+0000 7f1d7419d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c1224b0 con 0x7f1d6c0a1550 2023-10-03T10:17:08.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.756+0000 7f1d71738700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d6c0a1550 0x7f1d6c120de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.756+0000 7f1d71f39700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d6c0a0a70 0x7f1d6c1208a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.756+0000 7f1d71738700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d6c0a1550 0x7f1d6c120de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57054/0 (socket says 172.21.15.146:57054) 2023-10-03T10:17:08.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.756+0000 7f1d71738700 1 -- 172.21.15.146:0/2072675734 learned_addr learned my addr 172.21.15.146:0/2072675734 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:08.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.756+0000 7f1d7273a700 1 --2- 172.21.15.146:0/2072675734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d6c139200 0x7f1d6c121320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.756+0000 7f1d71738700 1 -- 172.21.15.146:0/2072675734 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d6c0a0a70 msgr2=0x7f1d6c1208a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.756+0000 7f1d71738700 1 --2- 172.21.15.146:0/2072675734 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d6c0a0a70 0x7f1d6c1208a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.756+0000 7f1d71738700 1 -- 172.21.15.146:0/2072675734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d6c139200 msgr2=0x7f1d6c121320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.756+0000 7f1d71738700 1 --2- 172.21.15.146:0/2072675734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d6c139200 0x7f1d6c121320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.757+0000 7f1d71738700 1 -- 172.21.15.146:0/2072675734 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d5c0094a0 con 0x7f1d6c0a1550 2023-10-03T10:17:08.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.757+0000 7f1d71738700 1 --2- 172.21.15.146:0/2072675734 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d6c0a1550 0x7f1d6c120de0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c00ebe0 tx=0x7f1d5c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.757+0000 7f1d627fc700 1 -- 172.21.15.146:0/2072675734 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c00c850 con 0x7f1d6c0a1550 2023-10-03T10:17:08.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.757+0000 7f1d627fc700 1 -- 172.21.15.146:0/2072675734 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c00c9b0 con 0x7f1d6c0a1550 2023-10-03T10:17:08.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.757+0000 7f1d627fc700 1 -- 172.21.15.146:0/2072675734 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c00cd40 con 0x7f1d6c0a1550 2023-10-03T10:17:08.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.757+0000 7f1d7419d700 1 -- 172.21.15.146:0/2072675734 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d64009b30 con 0x7f1d6c0a1550 2023-10-03T10:17:08.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.757+0000 7f1d7419d700 1 -- 172.21.15.146:0/2072675734 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d6c123e20 con 0x7f1d6c0a1550 2023-10-03T10:17:08.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.758+0000 7f1d627fc700 1 -- 172.21.15.146:0/2072675734 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d5c013470 con 0x7f1d6c0a1550 2023-10-03T10:17:08.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.758+0000 7f1d7419d700 1 -- 172.21.15.146:0/2072675734 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d6c0a2700 con 0x7f1d6c0a1550 2023-10-03T10:17:08.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.758+0000 7f1d627fc700 1 -- 172.21.15.146:0/2072675734 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1d5c03fb00 con 0x7f1d6c0a1550 2023-10-03T10:17:08.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.762+0000 7f1d627fc700 1 -- 172.21.15.146:0/2072675734 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d5c013720 con 0x7f1d6c0a1550 2023-10-03T10:17:08.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.799+0000 7ff27d480700 1 Processor -- start 2023-10-03T10:17:08.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.799+0000 7ff27d480700 1 -- start start 2023-10-03T10:17:08.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.799+0000 7ff27d480700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff27809e870 0x7ff27809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.800+0000 7ff27d480700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2781343a0 0x7ff27813bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.800+0000 7ff27d480700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27806bec0 con 0x7ff27809f180 2023-10-03T10:17:08.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.800+0000 7ff27d480700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff27806ce60 con 0x7ff27809e870 2023-10-03T10:17:08.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.800+0000 7ff27d480700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27809fa00 con 0x7ff2781343a0 2023-10-03T10:17:08.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.800+0000 7ff2777fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2781343a0 0x7ff27813bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.800+0000 7ff2777fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2781343a0 0x7ff27813bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57016/0 (socket says 172.21.15.146:57016) 2023-10-03T10:17:08.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.800+0000 7ff2777fe700 1 -- 172.21.15.146:0/3948214432 learned_addr learned my addr 172.21.15.146:0/3948214432 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:08.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.800+0000 7ff2767fc700 1 --1- 172.21.15.146:0/3948214432 >> v1:172.21.15.146:6789/0 conn(0x7ff27809f180 0x7ff278133c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44660/0 (socket says 172.21.15.146:44660) 2023-10-03T10:17:08.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.800+0000 7ff276ffd700 1 --2- 172.21.15.146:0/3948214432 >> v2:172.21.15.146:3300/0 conn(0x7ff27809e870 0x7ff27809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.800+0000 7ff2777fe700 1 -- 172.21.15.146:0/3948214432 >> v2:172.21.15.146:3300/0 conn(0x7ff27809e870 msgr2=0x7ff27809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:08.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.800+0000 7ff2777fe700 1 --2- 172.21.15.146:0/3948214432 >> v2:172.21.15.146:3300/0 conn(0x7ff27809e870 0x7ff27809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.800+0000 7ff2777fe700 1 -- 172.21.15.146:0/3948214432 >> v1:172.21.15.146:6789/0 conn(0x7ff27809f180 legacy=0x7ff278133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.800+0000 7ff2777fe700 1 -- 172.21.15.146:0/3948214432 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27809ad80 con 0x7ff2781343a0 2023-10-03T10:17:08.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.800+0000 7ff275ffb700 1 -- 172.21.15.146:0/3948214432 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651080028 0 0) 0x7ff27806bec0 con 0x7ff27809f180 2023-10-03T10:17:08.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.800+0000 7ff276ffd700 1 --2- 172.21.15.146:0/3948214432 >> v2:172.21.15.146:3300/0 conn(0x7ff27809e870 0x7ff27809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.800+0000 7ff2777fe700 1 --2- 172.21.15.146:0/3948214432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2781343a0 0x7ff27813bf60 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff270009e50 tx=0x7ff27000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2667f1664abb221 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.800+0000 7ff275ffb700 1 -- 172.21.15.146:0/3948214432 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27000e070 con 0x7ff2781343a0 2023-10-03T10:17:08.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.800+0000 7ff275ffb700 1 -- 172.21.15.146:0/3948214432 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27000b910 con 0x7ff2781343a0 2023-10-03T10:17:08.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.801+0000 7ff275ffb700 1 -- 172.21.15.146:0/3948214432 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27000bcc0 con 0x7ff2781343a0 2023-10-03T10:17:08.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.801+0000 7ff27d480700 1 -- 172.21.15.146:0/3948214432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2781343a0 msgr2=0x7ff27813bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.801+0000 7ff27d480700 1 --2- 172.21.15.146:0/3948214432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2781343a0 0x7ff27813bf60 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff270009e50 tx=0x7ff27000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:08.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.801+0000 7ff27d480700 1 -- 172.21.15.146:0/3948214432 shutdown_connections 2023-10-03T10:17:08.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.801+0000 7ff27d480700 1 --2- 172.21.15.146:0/3948214432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2781343a0 0x7ff27813bf60 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.801+0000 7ff27d480700 1 --2- 172.21.15.146:0/3948214432 >> v2:172.21.15.146:3300/0 conn(0x7ff27809e870 0x7ff27809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.801+0000 7ff27d480700 1 -- 172.21.15.146:0/3948214432 >> 172.21.15.146:0/3948214432 conn(0x7ff2780a4430 msgr2=0x7ff2780a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.801+0000 7ff27d480700 1 -- 172.21.15.146:0/3948214432 shutdown_connections 2023-10-03T10:17:08.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.801+0000 7ff27d480700 1 -- 172.21.15.146:0/3948214432 wait complete. 2023-10-03T10:17:08.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.802+0000 7ff27d480700 1 Processor -- start 2023-10-03T10:17:08.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.802+0000 7ff27d480700 1 -- start start 2023-10-03T10:17:08.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff27d480700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff27809e870 0x7ff278122b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff27d480700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff27809f180 0x7ff278123070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff27d480700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff2781343a0 0x7ff2781235b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff27d480700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2781262e0 con 0x7ff27809f180 2023-10-03T10:17:08.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff27d480700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2781247c0 con 0x7ff27809e870 2023-10-03T10:17:08.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff27d480700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2780a3cf0 con 0x7ff2781343a0 2023-10-03T10:17:08.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff276ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff27809e870 0x7ff278122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff276ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff27809e870 0x7ff278122b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57018/0 (socket says 172.21.15.146:57018) 2023-10-03T10:17:08.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff276ffd700 1 -- 172.21.15.146:0/3023583094 learned_addr learned my addr 172.21.15.146:0/3023583094 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:08.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff2777fe700 1 --2- 172.21.15.146:0/3023583094 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff2781343a0 0x7ff2781235b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff2767fc700 1 --2- 172.21.15.146:0/3023583094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff27809f180 0x7ff278123070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff276ffd700 1 -- 172.21.15.146:0/3023583094 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff2781343a0 msgr2=0x7ff2781235b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff276ffd700 1 --2- 172.21.15.146:0/3023583094 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff2781343a0 0x7ff2781235b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff276ffd700 1 -- 172.21.15.146:0/3023583094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff27809f180 msgr2=0x7ff278123070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff276ffd700 1 --2- 172.21.15.146:0/3023583094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff27809f180 0x7ff278123070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff276ffd700 1 -- 172.21.15.146:0/3023583094 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2680094a0 con 0x7ff27809e870 2023-10-03T10:17:08.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff2777fe700 1 --2- 172.21.15.146:0/3023583094 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff2781343a0 0x7ff2781235b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff2767fc700 1 --2- 172.21.15.146:0/3023583094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff27809f180 0x7ff278123070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff276ffd700 1 --2- 172.21.15.146:0/3023583094 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff27809e870 0x7ff278122b30 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff26800ec10 tx=0x7ff26800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff25f7fe700 1 -- 172.21.15.146:0/3023583094 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26800c850 con 0x7ff27809e870 2023-10-03T10:17:08.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff25f7fe700 1 -- 172.21.15.146:0/3023583094 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26800c9b0 con 0x7ff27809e870 2023-10-03T10:17:08.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff27d480700 1 -- 172.21.15.146:0/3023583094 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff270009b30 con 0x7ff27809e870 2023-10-03T10:17:08.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.803+0000 7ff25f7fe700 1 -- 172.21.15.146:0/3023583094 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26800cd20 con 0x7ff27809e870 2023-10-03T10:17:08.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.804+0000 7ff27d480700 1 -- 172.21.15.146:0/3023583094 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27806d000 con 0x7ff27809e870 2023-10-03T10:17:08.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.805+0000 7ff25f7fe700 1 -- 172.21.15.146:0/3023583094 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff268013470 con 0x7ff27809e870 2023-10-03T10:17:08.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.805+0000 7ff27d480700 1 -- 172.21.15.146:0/3023583094 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff27804f2a0 con 0x7ff27809e870 2023-10-03T10:17:08.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.805+0000 7ff25f7fe700 1 -- 172.21.15.146:0/3023583094 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff26803fb30 con 0x7ff27809e870 2023-10-03T10:17:08.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.809+0000 7ff25f7fe700 1 -- 172.21.15.146:0/3023583094 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff268013720 con 0x7ff27809e870 2023-10-03T10:17:08.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.833+0000 7f57713e8700 1 -- 172.21.15.146:0/84357157 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f576c071690 con 0x7f576c1300a0 2023-10-03T10:17:08.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.834+0000 7f57537fe700 1 -- 172.21.15.146:0/84357157 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5760017070 con 0x7f576c1300a0 2023-10-03T10:17:08.834 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.836+0000 7f57713e8700 1 -- 172.21.15.146:0/84357157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f576c1300a0 msgr2=0x7f576c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.836+0000 7f57713e8700 1 --2- 172.21.15.146:0/84357157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f576c1300a0 0x7f576c11da40 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f576000ebe0 tx=0x7f576000eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.836+0000 7f57713e8700 1 -- 172.21.15.146:0/84357157 shutdown_connections 2023-10-03T10:17:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.836+0000 7f57713e8700 1 --2- 172.21.15.146:0/84357157 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f576c133ad0 0x7f576c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.836+0000 7f57713e8700 1 --2- 172.21.15.146:0/84357157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f576c1300a0 0x7f576c11da40 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.836+0000 7f57713e8700 1 --2- 172.21.15.146:0/84357157 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f576c130bc0 0x7f576c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.836+0000 7f57713e8700 1 -- 172.21.15.146:0/84357157 >> 172.21.15.146:0/84357157 conn(0x7f576c099c40 msgr2=0x7f576c12e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.836+0000 7f57713e8700 1 -- 172.21.15.146:0/84357157 shutdown_connections 2023-10-03T10:17:08.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.836+0000 7f57713e8700 1 -- 172.21.15.146:0/84357157 wait complete. 2023-10-03T10:17:08.848 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:08.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.966+0000 7f1d7419d700 1 -- 172.21.15.146:0/2072675734 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1d6c06ccf0 con 0x7f1d6c0a1550 2023-10-03T10:17:08.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.966+0000 7f1d627fc700 1 -- 172.21.15.146:0/2072675734 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1d5c021070 con 0x7f1d6c0a1550 2023-10-03T10:17:08.966 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:08.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.968+0000 7f1d7419d700 1 -- 172.21.15.146:0/2072675734 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d6c0a1550 msgr2=0x7f1d6c120de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.968+0000 7f1d7419d700 1 --2- 172.21.15.146:0/2072675734 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d6c0a1550 0x7f1d6c120de0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c00ebe0 tx=0x7f1d5c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.968+0000 7f1d7419d700 1 -- 172.21.15.146:0/2072675734 shutdown_connections 2023-10-03T10:17:08.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.968+0000 7f1d7419d700 1 --2- 172.21.15.146:0/2072675734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d6c139200 0x7f1d6c121320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.968+0000 7f1d7419d700 1 --2- 172.21.15.146:0/2072675734 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d6c0a0a70 0x7f1d6c1208a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.968+0000 7f1d7419d700 1 --2- 172.21.15.146:0/2072675734 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d6c0a1550 0x7f1d6c120de0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.968+0000 7f1d7419d700 1 -- 172.21.15.146:0/2072675734 >> 172.21.15.146:0/2072675734 conn(0x7f1d6c0a6610 msgr2=0x7f1d6c136b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.968+0000 7f1d7419d700 1 -- 172.21.15.146:0/2072675734 shutdown_connections 2023-10-03T10:17:08.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:08.968+0000 7f1d7419d700 1 -- 172.21.15.146:0/2072675734 wait complete. 2023-10-03T10:17:08.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:09.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.012+0000 7ff27d480700 1 -- 172.21.15.146:0/3023583094 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff278072d60 con 0x7ff27809e870 2023-10-03T10:17:09.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.012+0000 7ff25f7fe700 1 -- 172.21.15.146:0/3023583094 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff268011af0 con 0x7ff27809e870 2023-10-03T10:17:09.012 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:09.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.014+0000 7ff27d480700 1 -- 172.21.15.146:0/3023583094 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff27809e870 msgr2=0x7ff278122b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.014+0000 7ff27d480700 1 --2- 172.21.15.146:0/3023583094 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff27809e870 0x7ff278122b30 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff26800ec10 tx=0x7ff26800ef20 comp rx=0 tx=0).stop 2023-10-03T10:17:09.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.014+0000 7ff27d480700 1 -- 172.21.15.146:0/3023583094 shutdown_connections 2023-10-03T10:17:09.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.014+0000 7ff27d480700 1 --2- 172.21.15.146:0/3023583094 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff2781343a0 0x7ff2781235b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.014+0000 7ff27d480700 1 --2- 172.21.15.146:0/3023583094 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff27809e870 0x7ff278122b30 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.014+0000 7ff27d480700 1 --2- 172.21.15.146:0/3023583094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff27809f180 0x7ff278123070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.014+0000 7ff27d480700 1 -- 172.21.15.146:0/3023583094 >> 172.21.15.146:0/3023583094 conn(0x7ff2780a4430 msgr2=0x7ff2780a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.014+0000 7ff27d480700 1 -- 172.21.15.146:0/3023583094 shutdown_connections 2023-10-03T10:17:09.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.015+0000 7ff27d480700 1 -- 172.21.15.146:0/3023583094 wait complete. 2023-10-03T10:17:09.026 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:09.108 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:09.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.231+0000 7fb3d4d9b700 1 Processor -- start 2023-10-03T10:17:09.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.231+0000 7fb3d4d9b700 1 -- start start 2023-10-03T10:17:09.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.232+0000 7fb3d4d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3d0136960 0x7fb3d0138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.232+0000 7fb3d4d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb3d0139280 0x7fb3d013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.232+0000 7fb3d4d9b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d006b2d0 con 0x7fb3d0133ad0 2023-10-03T10:17:09.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.232+0000 7fb3d4d9b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d01345b0 con 0x7fb3d0136960 2023-10-03T10:17:09.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.232+0000 7fb3d4d9b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d0133610 con 0x7fb3d0139280 2023-10-03T10:17:09.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.232+0000 7fb3cdd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3d0136960 0x7fb3d0138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.232+0000 7fb3ced9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb3d0139280 0x7fb3d013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.232+0000 7fb3cdd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3d0136960 0x7fb3d0138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57026/0 (socket says 172.21.15.146:57026) 2023-10-03T10:17:09.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.232+0000 7fb3cdd9b700 1 -- 172.21.15.146:0/2210702131 learned_addr learned my addr 172.21.15.146:0/2210702131 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:09.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.232+0000 7fb3cdd9b700 1 -- 172.21.15.146:0/2210702131 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb3d0139280 msgr2=0x7fb3d013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.232+0000 7fb3cd59a700 1 -- 172.21.15.146:0/2210702131 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687006981 0 0) 0x7fb3d006b2d0 con 0x7fb3d0133ad0 2023-10-03T10:17:09.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.232+0000 7fb3cdd9b700 1 --2- 172.21.15.146:0/2210702131 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb3d0139280 0x7fb3d013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.232+0000 7fb3cdd9b700 1 -- 172.21.15.146:0/2210702131 >> v1:172.21.15.146:6789/0 conn(0x7fb3d0133ad0 legacy=0x7fb3d0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.232+0000 7fb3cdd9b700 1 -- 172.21.15.146:0/2210702131 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d009a500 con 0x7fb3d0136960 2023-10-03T10:17:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.232+0000 7fb3ced9d700 1 --2- 172.21.15.146:0/2210702131 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb3d0139280 0x7fb3d013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.233+0000 7fb3cdd9b700 1 --2- 172.21.15.146:0/2210702131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3d0136960 0x7fb3d0138d40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009920 tx=0x7fb3c0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8b9628f4309bd3f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.233+0000 7fb3cd59a700 1 -- 172.21.15.146:0/2210702131 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0011830 con 0x7fb3d0136960 2023-10-03T10:17:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.233+0000 7fb3cd59a700 1 -- 172.21.15.146:0/2210702131 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c0011990 con 0x7fb3d0136960 2023-10-03T10:17:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.233+0000 7fb3cd59a700 1 -- 172.21.15.146:0/2210702131 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0011d20 con 0x7fb3d0136960 2023-10-03T10:17:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.233+0000 7fb3d4d9b700 1 -- 172.21.15.146:0/2210702131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3d0136960 msgr2=0x7fb3d0138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.233+0000 7fb3d4d9b700 1 --2- 172.21.15.146:0/2210702131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3d0136960 0x7fb3d0138d40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009920 tx=0x7fb3c0009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.233+0000 7fb3d4d9b700 1 -- 172.21.15.146:0/2210702131 shutdown_connections 2023-10-03T10:17:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.233+0000 7fb3d4d9b700 1 --2- 172.21.15.146:0/2210702131 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb3d0139280 0x7fb3d013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.233+0000 7fb3d4d9b700 1 --2- 172.21.15.146:0/2210702131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3d0136960 0x7fb3d0138d40 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.233+0000 7fb3d4d9b700 1 -- 172.21.15.146:0/2210702131 >> 172.21.15.146:0/2210702131 conn(0x7fb3d0099c40 msgr2=0x7fb3d00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.233+0000 7fb3d4d9b700 1 -- 172.21.15.146:0/2210702131 shutdown_connections 2023-10-03T10:17:09.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.233+0000 7fb3d4d9b700 1 -- 172.21.15.146:0/2210702131 wait complete. 2023-10-03T10:17:09.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.234+0000 7fb3d4d9b700 1 Processor -- start 2023-10-03T10:17:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.234+0000 7fb3d4d9b700 1 -- start start 2023-10-03T10:17:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.235+0000 7fb3d4d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb3d0133ad0 0x7fb3d0071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.235+0000 7fb3d4d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3d0136960 0x7fb3d0071690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.235+0000 7fb3d4d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3d0139280 0x7fb3d0071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.235+0000 7fb3d4d9b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d00722c0 con 0x7fb3d0136960 2023-10-03T10:17:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.235+0000 7fb3d4d9b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d006ffd0 con 0x7fb3d0139280 2023-10-03T10:17:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.235+0000 7fb3d4d9b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d009f390 con 0x7fb3d0133ad0 2023-10-03T10:17:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.235+0000 7fb3ce59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb3d0133ad0 0x7fb3d0071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.235+0000 7fb3cdd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3d0136960 0x7fb3d0071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.235+0000 7fb3cdd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3d0136960 0x7fb3d0071690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32904/0 (socket says 172.21.15.146:32904) 2023-10-03T10:17:09.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.235+0000 7fb3ce59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb3d0133ad0 0x7fb3d0071150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57082/0 (socket says 172.21.15.146:57082) 2023-10-03T10:17:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.235+0000 7fb3cdd9b700 1 -- 172.21.15.146:0/3087801509 learned_addr learned my addr 172.21.15.146:0/3087801509 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.235+0000 7fb3ced9d700 1 --2- 172.21.15.146:0/3087801509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3d0139280 0x7fb3d0071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.235+0000 7fb3ce59c700 1 -- 172.21.15.146:0/3087801509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3d0139280 msgr2=0x7fb3d0071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.235+0000 7fb3ce59c700 1 --2- 172.21.15.146:0/3087801509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3d0139280 0x7fb3d0071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.235+0000 7fb3ce59c700 1 -- 172.21.15.146:0/3087801509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3d0136960 msgr2=0x7fb3d0071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.235+0000 7fb3ce59c700 1 --2- 172.21.15.146:0/3087801509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3d0136960 0x7fb3d0071690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.235+0000 7fb3ce59c700 1 -- 172.21.15.146:0/3087801509 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c8009a70 con 0x7fb3d0133ad0 2023-10-03T10:17:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.235+0000 7fb3ced9d700 1 --2- 172.21.15.146:0/3087801509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3d0139280 0x7fb3d0071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.235+0000 7fb3cdd9b700 1 --2- 172.21.15.146:0/3087801509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3d0136960 0x7fb3d0071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.235+0000 7fb3ce59c700 1 --2- 172.21.15.146:0/3087801509 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb3d0133ad0 0x7fb3d0071150 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4000f60 tx=0x7fb3c400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.236+0000 7fb3beffd700 1 -- 172.21.15.146:0/3087801509 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c40052d0 con 0x7fb3d0133ad0 2023-10-03T10:17:09.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.236+0000 7fb3beffd700 1 -- 172.21.15.146:0/3087801509 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c4005450 con 0x7fb3d0133ad0 2023-10-03T10:17:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.236+0000 7fb3d4d9b700 1 -- 172.21.15.146:0/3087801509 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c0009550 con 0x7fb3d0133ad0 2023-10-03T10:17:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.236+0000 7fb3beffd700 1 -- 172.21.15.146:0/3087801509 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c40038c0 con 0x7fb3d0133ad0 2023-10-03T10:17:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.236+0000 7fb3d4d9b700 1 -- 172.21.15.146:0/3087801509 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d0070d00 con 0x7fb3d0133ad0 2023-10-03T10:17:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.236+0000 7fb3beffd700 1 -- 172.21.15.146:0/3087801509 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3c4003a20 con 0x7fb3d0133ad0 2023-10-03T10:17:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.236+0000 7fb3d4d9b700 1 -- 172.21.15.146:0/3087801509 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d004f2a0 con 0x7fb3d0133ad0 2023-10-03T10:17:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.237+0000 7fb3beffd700 1 -- 172.21.15.146:0/3087801509 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb3c403e9b0 con 0x7fb3d0133ad0 2023-10-03T10:17:09.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.241+0000 7fb3beffd700 1 -- 172.21.15.146:0/3087801509 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3c4019d20 con 0x7fb3d0133ad0 2023-10-03T10:17:09.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.425+0000 7fb3d4d9b700 1 -- 172.21.15.146:0/3087801509 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb3d009f0f0 con 0x7fb3d0133ad0 2023-10-03T10:17:09.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.426+0000 7fb3beffd700 1 -- 172.21.15.146:0/3087801509 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb3c4017030 con 0x7fb3d0133ad0 2023-10-03T10:17:09.426 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:09.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.428+0000 7fb3d4d9b700 1 -- 172.21.15.146:0/3087801509 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb3d0133ad0 msgr2=0x7fb3d0071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.428+0000 7fb3d4d9b700 1 --2- 172.21.15.146:0/3087801509 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb3d0133ad0 0x7fb3d0071150 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4000f60 tx=0x7fb3c400c6a0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.428+0000 7fb3d4d9b700 1 -- 172.21.15.146:0/3087801509 shutdown_connections 2023-10-03T10:17:09.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.428+0000 7fb3d4d9b700 1 --2- 172.21.15.146:0/3087801509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3d0139280 0x7fb3d0071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.428+0000 7fb3d4d9b700 1 --2- 172.21.15.146:0/3087801509 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb3d0133ad0 0x7fb3d0071150 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.428+0000 7fb3d4d9b700 1 --2- 172.21.15.146:0/3087801509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3d0136960 0x7fb3d0071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.428+0000 7fb3d4d9b700 1 -- 172.21.15.146:0/3087801509 >> 172.21.15.146:0/3087801509 conn(0x7fb3d0099c40 msgr2=0x7fb3d0134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.428+0000 7fb3d4d9b700 1 -- 172.21.15.146:0/3087801509 shutdown_connections 2023-10-03T10:17:09.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.428+0000 7fb3d4d9b700 1 -- 172.21.15.146:0/3087801509 wait complete. 2023-10-03T10:17:09.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:09.849 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:09.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.975+0000 7fe392ced700 1 Processor -- start 2023-10-03T10:17:09.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.975+0000 7fe392ced700 1 -- start start 2023-10-03T10:17:09.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.975+0000 7fe392ced700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c09e870 0x7fe38c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.975+0000 7fe392ced700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe38c09f180 0x7fe38c133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.975+0000 7fe392ced700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c134160 0x7fe38c134600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.975+0000 7fe392ced700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe38c0a0370 con 0x7fe38c09f180 2023-10-03T10:17:09.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.975+0000 7fe392ced700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c09fa00 con 0x7fe38c09e870 2023-10-03T10:17:09.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.975+0000 7fe392ced700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c09ada0 con 0x7fe38c134160 2023-10-03T10:17:09.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.975+0000 7fe390a89700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c09e870 0x7fe38c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.975+0000 7fe39128a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c134160 0x7fe38c134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.975+0000 7fe390a89700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c09e870 0x7fe38c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57050/0 (socket says 172.21.15.146:57050) 2023-10-03T10:17:09.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.975+0000 7fe38bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe38c09f180 0x7fe38c133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.975+0000 7fe390a89700 1 -- 172.21.15.146:0/2266478467 learned_addr learned my addr 172.21.15.146:0/2266478467 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:09.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.976+0000 7fe390a89700 1 -- 172.21.15.146:0/2266478467 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c134160 msgr2=0x7fe38c134600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.976+0000 7fe390a89700 1 --2- 172.21.15.146:0/2266478467 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c134160 0x7fe38c134600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.976+0000 7fe390a89700 1 -- 172.21.15.146:0/2266478467 >> v2:172.21.15.146:3300/0 conn(0x7fe38c09f180 msgr2=0x7fe38c133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.976+0000 7fe390a89700 1 --2- 172.21.15.146:0/2266478467 >> v2:172.21.15.146:3300/0 conn(0x7fe38c09f180 0x7fe38c133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.976+0000 7fe390a89700 1 -- 172.21.15.146:0/2266478467 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38c06bec0 con 0x7fe38c09e870 2023-10-03T10:17:09.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.976+0000 7fe38bfff700 1 --2- 172.21.15.146:0/2266478467 >> v2:172.21.15.146:3300/0 conn(0x7fe38c09f180 0x7fe38c133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.976+0000 7fe39128a700 1 --2- 172.21.15.146:0/2266478467 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c134160 0x7fe38c134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.976+0000 7fe390a89700 1 --2- 172.21.15.146:0/2266478467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c09e870 0x7fe38c09ec40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe3800098f0 tx=0x7fe380009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cd5ab64ec7a027d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.976+0000 7fe38b7fe700 1 -- 172.21.15.146:0/2266478467 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe380011830 con 0x7fe38c09e870 2023-10-03T10:17:09.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.976+0000 7fe38b7fe700 1 -- 172.21.15.146:0/2266478467 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe380011990 con 0x7fe38c09e870 2023-10-03T10:17:09.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.976+0000 7fe38b7fe700 1 -- 172.21.15.146:0/2266478467 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe380011d20 con 0x7fe38c09e870 2023-10-03T10:17:09.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.976+0000 7fe392ced700 1 -- 172.21.15.146:0/2266478467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c09e870 msgr2=0x7fe38c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.976+0000 7fe392ced700 1 --2- 172.21.15.146:0/2266478467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c09e870 0x7fe38c09ec40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe3800098f0 tx=0x7fe380009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:09.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.977+0000 7fe392ced700 1 -- 172.21.15.146:0/2266478467 shutdown_connections 2023-10-03T10:17:09.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.977+0000 7fe392ced700 1 --2- 172.21.15.146:0/2266478467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c09e870 0x7fe38c09ec40 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.977+0000 7fe392ced700 1 --2- 172.21.15.146:0/2266478467 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c134160 0x7fe38c134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.977+0000 7fe392ced700 1 --2- 172.21.15.146:0/2266478467 >> v2:172.21.15.146:3300/0 conn(0x7fe38c09f180 0x7fe38c133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.977+0000 7fe392ced700 1 -- 172.21.15.146:0/2266478467 >> 172.21.15.146:0/2266478467 conn(0x7fe38c0a4430 msgr2=0x7fe38c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.977+0000 7fe392ced700 1 -- 172.21.15.146:0/2266478467 shutdown_connections 2023-10-03T10:17:09.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.977+0000 7fe392ced700 1 -- 172.21.15.146:0/2266478467 wait complete. 2023-10-03T10:17:09.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.977+0000 7fe392ced700 1 Processor -- start 2023-10-03T10:17:09.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.977+0000 7fe392ced700 1 -- start start 2023-10-03T10:17:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.978+0000 7fe392ced700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c09e870 0x7fe38c122530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.978+0000 7fe392ced700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c09f180 0x7fe38c122a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.978+0000 7fe392ced700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe38c134160 0x7fe38c122fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.978+0000 7fe392ced700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c125d70 con 0x7fe38c134160 2023-10-03T10:17:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.978+0000 7fe392ced700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c1240a0 con 0x7fe38c09e870 2023-10-03T10:17:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.978+0000 7fe392ced700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c124f30 con 0x7fe38c09f180 2023-10-03T10:17:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.978+0000 7fe390a89700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c09e870 0x7fe38c122530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.978+0000 7fe38bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c09f180 0x7fe38c122a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.978+0000 7fe390a89700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c09e870 0x7fe38c122530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57064/0 (socket says 172.21.15.146:57064) 2023-10-03T10:17:09.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.978+0000 7fe390a89700 1 -- 172.21.15.146:0/2086409538 learned_addr learned my addr 172.21.15.146:0/2086409538 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:09.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.978+0000 7fe39128a700 1 --2- 172.21.15.146:0/2086409538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe38c134160 0x7fe38c122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.978+0000 7fe390a89700 1 -- 172.21.15.146:0/2086409538 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c09f180 msgr2=0x7fe38c122a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.978+0000 7fe390a89700 1 --2- 172.21.15.146:0/2086409538 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c09f180 0x7fe38c122a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.978+0000 7fe390a89700 1 -- 172.21.15.146:0/2086409538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe38c134160 msgr2=0x7fe38c122fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.978+0000 7fe390a89700 1 --2- 172.21.15.146:0/2086409538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe38c134160 0x7fe38c122fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.978+0000 7fe390a89700 1 -- 172.21.15.146:0/2086409538 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3780094a0 con 0x7fe38c09e870 2023-10-03T10:17:09.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.978+0000 7fe38bfff700 1 --2- 172.21.15.146:0/2086409538 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c09f180 0x7fe38c122a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.979+0000 7fe390a89700 1 --2- 172.21.15.146:0/2086409538 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c09e870 0x7fe38c122530 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe380009c40 tx=0x7fe380004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.979+0000 7fe3897fa700 1 -- 172.21.15.146:0/2086409538 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe380004450 con 0x7fe38c09e870 2023-10-03T10:17:09.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.979+0000 7fe3897fa700 1 -- 172.21.15.146:0/2086409538 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38001e070 con 0x7fe38c09e870 2023-10-03T10:17:09.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.979+0000 7fe392ced700 1 -- 172.21.15.146:0/2086409538 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe384009a70 con 0x7fe38c09e870 2023-10-03T10:17:09.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.979+0000 7fe3897fa700 1 -- 172.21.15.146:0/2086409538 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3800038e0 con 0x7fe38c09e870 2023-10-03T10:17:09.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.979+0000 7fe392ced700 1 -- 172.21.15.146:0/2086409538 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe380009550 con 0x7fe38c09e870 2023-10-03T10:17:09.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.979+0000 7fe3897fa700 1 -- 172.21.15.146:0/2086409538 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe380003a40 con 0x7fe38c09e870 2023-10-03T10:17:09.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.980+0000 7fe3897fa700 1 -- 172.21.15.146:0/2086409538 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe380040410 con 0x7fe38c09e870 2023-10-03T10:17:09.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.980+0000 7fe392ced700 1 -- 172.21.15.146:0/2086409538 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe38c125af0 con 0x7fe38c09e870 2023-10-03T10:17:09.984 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:09.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:09.984+0000 7fe3897fa700 1 -- 172.21.15.146:0/2086409538 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe380024400 con 0x7fe38c09e870 2023-10-03T10:17:10.027 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:10.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.111+0000 7f1a2118b700 1 Processor -- start 2023-10-03T10:17:10.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.111+0000 7f1a2118b700 1 -- start start 2023-10-03T10:17:10.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.112+0000 7f1a2118b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a1c06a770 0x7f1a1c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.112+0000 7f1a2118b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a1c136cb0 0x7f1a1c139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.112+0000 7f1a2118b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a1c06e900 con 0x7f1a1c09dec0 2023-10-03T10:17:10.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.112+0000 7f1a2118b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c09d180 con 0x7f1a1c136cb0 2023-10-03T10:17:10.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.112+0000 7f1a2118b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c09e780 con 0x7f1a1c06a770 2023-10-03T10:17:10.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.112+0000 7f1a1a59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1a1c09dec0 0x7f1a1c06b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44680/0 (socket says 172.21.15.146:44680) 2023-10-03T10:17:10.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.112+0000 7f1a1a59c700 1 -- 172.21.15.146:0/83443989 learned_addr learned my addr 172.21.15.146:0/83443989 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:10.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.112+0000 7f1a1ad9d700 1 --2- 172.21.15.146:0/83443989 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a1c06a770 0x7f1a1c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.112+0000 7f1a1b59e700 1 --2- 172.21.15.146:0/83443989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a1c136cb0 0x7f1a1c139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.112+0000 7f1a19d9b700 1 -- 172.21.15.146:0/83443989 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2492721964 0 0) 0x7f1a1c06e900 con 0x7f1a1c09dec0 2023-10-03T10:17:10.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.112+0000 7f1a19d9b700 1 -- 172.21.15.146:0/83443989 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a040035b0 con 0x7f1a1c09dec0 2023-10-03T10:17:10.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.112+0000 7f1a1ad9d700 1 -- 172.21.15.146:0/83443989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a1c136cb0 msgr2=0x7f1a1c139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.112+0000 7f1a1ad9d700 1 --2- 172.21.15.146:0/83443989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a1c136cb0 0x7f1a1c139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.112+0000 7f1a1ad9d700 1 -- 172.21.15.146:0/83443989 >> v1:172.21.15.146:6789/0 conn(0x7f1a1c09dec0 legacy=0x7f1a1c06b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.112+0000 7f1a1ad9d700 1 -- 172.21.15.146:0/83443989 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c09d3c0 con 0x7f1a1c06a770 2023-10-03T10:17:10.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.113+0000 7f1a1ad9d700 1 --2- 172.21.15.146:0/83443989 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a1c06a770 0x7f1a1c06ab40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009870 tx=0x7f1a0c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5058f88cc0e958c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.113+0000 7f1a19d9b700 1 -- 172.21.15.146:0/83443989 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c011830 con 0x7f1a1c06a770 2023-10-03T10:17:10.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.113+0000 7f1a19d9b700 1 -- 172.21.15.146:0/83443989 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0c011990 con 0x7f1a1c06a770 2023-10-03T10:17:10.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.113+0000 7f1a19d9b700 1 -- 172.21.15.146:0/83443989 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c011d20 con 0x7f1a1c06a770 2023-10-03T10:17:10.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.113+0000 7f1a2118b700 1 -- 172.21.15.146:0/83443989 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a1c06a770 msgr2=0x7f1a1c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.113+0000 7f1a2118b700 1 --2- 172.21.15.146:0/83443989 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a1c06a770 0x7f1a1c06ab40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009870 tx=0x7f1a0c009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:10.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.113+0000 7f1a2118b700 1 -- 172.21.15.146:0/83443989 shutdown_connections 2023-10-03T10:17:10.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.113+0000 7f1a2118b700 1 --2- 172.21.15.146:0/83443989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a1c136cb0 0x7f1a1c139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.113+0000 7f1a2118b700 1 --2- 172.21.15.146:0/83443989 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a1c06a770 0x7f1a1c06ab40 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.113+0000 7f1a2118b700 1 -- 172.21.15.146:0/83443989 >> 172.21.15.146:0/83443989 conn(0x7f1a1c099c40 msgr2=0x7f1a1c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.113+0000 7f1a2118b700 1 -- 172.21.15.146:0/83443989 shutdown_connections 2023-10-03T10:17:10.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.113+0000 7f1a2118b700 1 -- 172.21.15.146:0/83443989 wait complete. 2023-10-03T10:17:10.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.115+0000 7f1a2118b700 1 Processor -- start 2023-10-03T10:17:10.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.115+0000 7f1a2118b700 1 -- start start 2023-10-03T10:17:10.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.116+0000 7f1a2118b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a1c06a770 0x7f1a1c1344d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.116+0000 7f1a2118b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1c09dec0 0x7f1a1c134a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.116+0000 7f1a2118b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a1c136cb0 0x7f1a1c134f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.116+0000 7f1a2118b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c11a430 con 0x7f1a1c09dec0 2023-10-03T10:17:10.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.116+0000 7f1a2118b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c1360f0 con 0x7f1a1c136cb0 2023-10-03T10:17:10.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.116+0000 7f1a2118b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1c11a8e0 con 0x7f1a1c06a770 2023-10-03T10:17:10.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.116+0000 7f1a1a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1c09dec0 0x7f1a1c134a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.116+0000 7f1a1a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1c09dec0 0x7f1a1c134a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32934/0 (socket says 172.21.15.146:32934) 2023-10-03T10:17:10.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.116+0000 7f1a1a59c700 1 -- 172.21.15.146:0/1465385226 learned_addr learned my addr 172.21.15.146:0/1465385226 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:10.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.116+0000 7f1a1b59e700 1 --2- 172.21.15.146:0/1465385226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a1c136cb0 0x7f1a1c134f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.116+0000 7f1a1ad9d700 1 --2- 172.21.15.146:0/1465385226 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a1c06a770 0x7f1a1c1344d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.116+0000 7f1a1a59c700 1 -- 172.21.15.146:0/1465385226 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a1c06a770 msgr2=0x7f1a1c1344d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.116+0000 7f1a1a59c700 1 --2- 172.21.15.146:0/1465385226 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a1c06a770 0x7f1a1c1344d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.116+0000 7f1a1a59c700 1 -- 172.21.15.146:0/1465385226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a1c136cb0 msgr2=0x7f1a1c134f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.116+0000 7f1a1a59c700 1 --2- 172.21.15.146:0/1465385226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a1c136cb0 0x7f1a1c134f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.116+0000 7f1a1a59c700 1 -- 172.21.15.146:0/1465385226 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c0094a0 con 0x7f1a1c09dec0 2023-10-03T10:17:10.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.116+0000 7f1a1a59c700 1 --2- 172.21.15.146:0/1465385226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1c09dec0 0x7f1a1c134a10 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000c700 tx=0x7f1a1000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.116+0000 7f1a037fe700 1 -- 172.21.15.146:0/1465385226 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10005d70 con 0x7f1a1c09dec0 2023-10-03T10:17:10.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.116+0000 7f1a037fe700 1 -- 172.21.15.146:0/1465385226 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a100070d0 con 0x7f1a1c09dec0 2023-10-03T10:17:10.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.117+0000 7f1a037fe700 1 -- 172.21.15.146:0/1465385226 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10007460 con 0x7f1a1c09dec0 2023-10-03T10:17:10.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.117+0000 7f1a2118b700 1 -- 172.21.15.146:0/1465385226 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1c119f00 con 0x7f1a1c09dec0 2023-10-03T10:17:10.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.117+0000 7f1a2118b700 1 -- 172.21.15.146:0/1465385226 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1c071ce0 con 0x7f1a1c09dec0 2023-10-03T10:17:10.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.117+0000 7f1a037fe700 1 -- 172.21.15.146:0/1465385226 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a100075c0 con 0x7f1a1c09dec0 2023-10-03T10:17:10.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.117+0000 7f1a037fe700 1 -- 172.21.15.146:0/1465385226 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1a1003eb50 con 0x7f1a1c09dec0 2023-10-03T10:17:10.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.118+0000 7f1a2118b700 1 -- 172.21.15.146:0/1465385226 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1c04f2a0 con 0x7f1a1c09dec0 2023-10-03T10:17:10.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.122+0000 7f1a037fe700 1 -- 172.21.15.146:0/1465385226 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a10018260 con 0x7f1a1c09dec0 2023-10-03T10:17:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.154+0000 7fad66813700 1 Processor -- start 2023-10-03T10:17:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.154+0000 7fad66813700 1 -- start start 2023-10-03T10:17:10.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.154+0000 7fad66813700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad600a1550 0x7fad60138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.154+0000 7fad66813700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad60139200 0x7fad6013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.154+0000 7fad66813700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad6009e9d0 con 0x7fad600a0a70 2023-10-03T10:17:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.154+0000 7fad66813700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6009dc00 con 0x7fad60139200 2023-10-03T10:17:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.154+0000 7fad66813700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad6009dec0 con 0x7fad600a1550 2023-10-03T10:17:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.155+0000 7fad5f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad600a1550 0x7fad60138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.155+0000 7fad5ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fad600a0a70 0x7fad600a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44692/0 (socket says 172.21.15.146:44692) 2023-10-03T10:17:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.155+0000 7fad5ffff700 1 -- 172.21.15.146:0/4273159761 learned_addr learned my addr 172.21.15.146:0/4273159761 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.155+0000 7fad5f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad600a1550 0x7fad60138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57134/0 (socket says 172.21.15.146:57134) 2023-10-03T10:17:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.155+0000 7fad64db0700 1 --2- 172.21.15.146:0/4273159761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad60139200 0x7fad6013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.155+0000 7fad5f7fe700 1 -- 172.21.15.146:0/4273159761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad60139200 msgr2=0x7fad6013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.155+0000 7fad5f7fe700 1 --2- 172.21.15.146:0/4273159761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad60139200 0x7fad6013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.155+0000 7fad5f7fe700 1 -- 172.21.15.146:0/4273159761 >> v1:172.21.15.146:6789/0 conn(0x7fad600a0a70 legacy=0x7fad600a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.155+0000 7fad5effd700 1 -- 172.21.15.146:0/4273159761 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974887195 0 0) 0x7fad6009e9d0 con 0x7fad600a0a70 2023-10-03T10:17:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.155+0000 7fad5f7fe700 1 -- 172.21.15.146:0/4273159761 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6009e6a0 con 0x7fad600a1550 2023-10-03T10:17:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.155+0000 7fad64db0700 1 --2- 172.21.15.146:0/4273159761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad60139200 0x7fad6013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.155+0000 7fad5f7fe700 1 --2- 172.21.15.146:0/4273159761 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad600a1550 0x7fad60138cc0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fad54009870 tx=0x7fad54009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fe766a8626cab0e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.155+0000 7fad5effd700 1 -- 172.21.15.146:0/4273159761 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54011830 con 0x7fad600a1550 2023-10-03T10:17:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.155+0000 7fad5effd700 1 -- 172.21.15.146:0/4273159761 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad54011990 con 0x7fad600a1550 2023-10-03T10:17:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.155+0000 7fad5effd700 1 -- 172.21.15.146:0/4273159761 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54011d20 con 0x7fad600a1550 2023-10-03T10:17:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.156+0000 7fad66813700 1 -- 172.21.15.146:0/4273159761 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad600a1550 msgr2=0x7fad60138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.156+0000 7fad66813700 1 --2- 172.21.15.146:0/4273159761 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad600a1550 0x7fad60138cc0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fad54009870 tx=0x7fad54009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.156+0000 7fad66813700 1 -- 172.21.15.146:0/4273159761 shutdown_connections 2023-10-03T10:17:10.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.156+0000 7fad66813700 1 --2- 172.21.15.146:0/4273159761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad60139200 0x7fad6013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.156+0000 7fad66813700 1 --2- 172.21.15.146:0/4273159761 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad600a1550 0x7fad60138cc0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.156+0000 7fad66813700 1 -- 172.21.15.146:0/4273159761 >> 172.21.15.146:0/4273159761 conn(0x7fad600a6610 msgr2=0x7fad600a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.156+0000 7fad66813700 1 -- 172.21.15.146:0/4273159761 shutdown_connections 2023-10-03T10:17:10.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.156+0000 7fad66813700 1 -- 172.21.15.146:0/4273159761 wait complete. 2023-10-03T10:17:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.157+0000 7fad66813700 1 Processor -- start 2023-10-03T10:17:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.157+0000 7fad66813700 1 -- start start 2023-10-03T10:17:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.158+0000 7fad66813700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad600a0a70 0x7fad6011e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.158+0000 7fad66813700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad600a1550 0x7fad6011ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.158+0000 7fad66813700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad60139200 0x7fad6011f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.158+0000 7fad66813700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad60120370 con 0x7fad600a0a70 2023-10-03T10:17:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.158+0000 7fad66813700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad60134650 con 0x7fad60139200 2023-10-03T10:17:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.158+0000 7fad66813700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad60121fa0 con 0x7fad600a1550 2023-10-03T10:17:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.158+0000 7fad64db0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad60139200 0x7fad6011f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.158+0000 7fad64db0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad60139200 0x7fad6011f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57082/0 (socket says 172.21.15.146:57082) 2023-10-03T10:17:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.158+0000 7fad5ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad600a0a70 0x7fad6011e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.158+0000 7fad64db0700 1 -- 172.21.15.146:0/4201366235 learned_addr learned my addr 172.21.15.146:0/4201366235 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.158+0000 7fad5f7fe700 1 --2- 172.21.15.146:0/4201366235 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad600a1550 0x7fad6011ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.159+0000 7fad64db0700 1 -- 172.21.15.146:0/4201366235 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad600a1550 msgr2=0x7fad6011ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.159+0000 7fad64db0700 1 --2- 172.21.15.146:0/4201366235 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad600a1550 0x7fad6011ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.159+0000 7fad64db0700 1 -- 172.21.15.146:0/4201366235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad600a0a70 msgr2=0x7fad6011e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.159+0000 7fad64db0700 1 --2- 172.21.15.146:0/4201366235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad600a0a70 0x7fad6011e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.159+0000 7fad64db0700 1 -- 172.21.15.146:0/4201366235 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad540094a0 con 0x7fad60139200 2023-10-03T10:17:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.159+0000 7fad5f7fe700 1 --2- 172.21.15.146:0/4201366235 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad600a1550 0x7fad6011ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.159+0000 7fad5ffff700 1 --2- 172.21.15.146:0/4201366235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad600a0a70 0x7fad6011e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.159+0000 7fad64db0700 1 --2- 172.21.15.146:0/4201366235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad60139200 0x7fad6011f230 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fad58007ec0 tx=0x7fad5800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.159+0000 7fad5cff9700 1 -- 172.21.15.146:0/4201366235 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5800dd80 con 0x7fad60139200 2023-10-03T10:17:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.159+0000 7fad5cff9700 1 -- 172.21.15.146:0/4201366235 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5800f040 con 0x7fad60139200 2023-10-03T10:17:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.159+0000 7fad66813700 1 -- 172.21.15.146:0/4201366235 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad60121a10 con 0x7fad60139200 2023-10-03T10:17:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.159+0000 7fad5cff9700 1 -- 172.21.15.146:0/4201366235 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad58003c60 con 0x7fad60139200 2023-10-03T10:17:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.159+0000 7fad66813700 1 -- 172.21.15.146:0/4201366235 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad600a5100 con 0x7fad60139200 2023-10-03T10:17:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.160+0000 7fad66813700 1 -- 172.21.15.146:0/4201366235 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad600a0440 con 0x7fad60139200 2023-10-03T10:17:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.161+0000 7fad5cff9700 1 -- 172.21.15.146:0/4201366235 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad58004030 con 0x7fad60139200 2023-10-03T10:17:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.161+0000 7fad5cff9700 1 -- 172.21.15.146:0/4201366235 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fad5803fb80 con 0x7fad60139200 2023-10-03T10:17:10.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.169+0000 7fad5cff9700 1 -- 172.21.15.146:0/4201366235 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad5801e3b0 con 0x7fad60139200 2023-10-03T10:17:10.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.185+0000 7fe392ced700 1 -- 172.21.15.146:0/2086409538 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe38c04f2a0 con 0x7fe38c09e870 2023-10-03T10:17:10.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.186+0000 7fe3897fa700 1 -- 172.21.15.146:0/2086409538 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe380015030 con 0x7fe38c09e870 2023-10-03T10:17:10.185 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:10.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.189+0000 7fe392ced700 1 -- 172.21.15.146:0/2086409538 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c09e870 msgr2=0x7fe38c122530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.189+0000 7fe392ced700 1 --2- 172.21.15.146:0/2086409538 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c09e870 0x7fe38c122530 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe380009c40 tx=0x7fe380004750 comp rx=0 tx=0).stop 2023-10-03T10:17:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.189+0000 7fe392ced700 1 -- 172.21.15.146:0/2086409538 shutdown_connections 2023-10-03T10:17:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.189+0000 7fe392ced700 1 --2- 172.21.15.146:0/2086409538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe38c134160 0x7fe38c122fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.189+0000 7fe392ced700 1 --2- 172.21.15.146:0/2086409538 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38c09e870 0x7fe38c122530 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.189+0000 7fe392ced700 1 --2- 172.21.15.146:0/2086409538 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe38c09f180 0x7fe38c122a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.189+0000 7fe392ced700 1 -- 172.21.15.146:0/2086409538 >> 172.21.15.146:0/2086409538 conn(0x7fe38c0a4430 msgr2=0x7fe38c0a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.189+0000 7fe392ced700 1 -- 172.21.15.146:0/2086409538 shutdown_connections 2023-10-03T10:17:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.189+0000 7fe392ced700 1 -- 172.21.15.146:0/2086409538 wait complete. 2023-10-03T10:17:10.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:10.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.316+0000 7f1a2118b700 1 -- 172.21.15.146:0/1465385226 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1a1c11b3b0 con 0x7f1a1c09dec0 2023-10-03T10:17:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.316+0000 7f1a037fe700 1 -- 172.21.15.146:0/1465385226 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1a10017020 con 0x7f1a1c09dec0 2023-10-03T10:17:10.316 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:10.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.318+0000 7f1a2118b700 1 -- 172.21.15.146:0/1465385226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1c09dec0 msgr2=0x7f1a1c134a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.318+0000 7f1a2118b700 1 --2- 172.21.15.146:0/1465385226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1c09dec0 0x7f1a1c134a10 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000c700 tx=0x7f1a1000ca10 comp rx=0 tx=0).stop 2023-10-03T10:17:10.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.318+0000 7f1a2118b700 1 -- 172.21.15.146:0/1465385226 shutdown_connections 2023-10-03T10:17:10.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.318+0000 7f1a2118b700 1 --2- 172.21.15.146:0/1465385226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a1c136cb0 0x7f1a1c134f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.318+0000 7f1a2118b700 1 --2- 172.21.15.146:0/1465385226 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a1c06a770 0x7f1a1c1344d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.318+0000 7f1a2118b700 1 --2- 172.21.15.146:0/1465385226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a1c09dec0 0x7f1a1c134a10 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.318+0000 7f1a2118b700 1 -- 172.21.15.146:0/1465385226 >> 172.21.15.146:0/1465385226 conn(0x7f1a1c099c40 msgr2=0x7f1a1c12f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.318+0000 7f1a2118b700 1 -- 172.21.15.146:0/1465385226 shutdown_connections 2023-10-03T10:17:10.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.318+0000 7f1a2118b700 1 -- 172.21.15.146:0/1465385226 wait complete. 2023-10-03T10:17:10.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:10.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.367+0000 7fad66813700 1 -- 172.21.15.146:0/4201366235 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fad6004f2a0 con 0x7fad60139200 2023-10-03T10:17:10.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.368+0000 7fad5cff9700 1 -- 172.21.15.146:0/4201366235 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad5801a020 con 0x7fad60139200 2023-10-03T10:17:10.367 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:10.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.370+0000 7fad66813700 1 -- 172.21.15.146:0/4201366235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad60139200 msgr2=0x7fad6011f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.370+0000 7fad66813700 1 --2- 172.21.15.146:0/4201366235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad60139200 0x7fad6011f230 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fad58007ec0 tx=0x7fad5800d3b0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.370+0000 7fad66813700 1 -- 172.21.15.146:0/4201366235 shutdown_connections 2023-10-03T10:17:10.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.370+0000 7fad66813700 1 --2- 172.21.15.146:0/4201366235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad60139200 0x7fad6011f230 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.370+0000 7fad66813700 1 --2- 172.21.15.146:0/4201366235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad600a0a70 0x7fad6011e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.370+0000 7fad66813700 1 --2- 172.21.15.146:0/4201366235 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fad600a1550 0x7fad6011ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.370+0000 7fad66813700 1 -- 172.21.15.146:0/4201366235 >> 172.21.15.146:0/4201366235 conn(0x7fad600a6610 msgr2=0x7fad600a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.370+0000 7fad66813700 1 -- 172.21.15.146:0/4201366235 shutdown_connections 2023-10-03T10:17:10.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.370+0000 7fad66813700 1 -- 172.21.15.146:0/4201366235 wait complete. 2023-10-03T10:17:10.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:10.440 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:10.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.563+0000 7f481dd19700 1 Processor -- start 2023-10-03T10:17:10.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.564+0000 7f481dd19700 1 -- start start 2023-10-03T10:17:10.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.564+0000 7f481dd19700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4818133ad0 0x7f4818133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.564+0000 7f481dd19700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4818130bc0 0x7f481813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.564+0000 7f481dd19700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f481806b2d0 con 0x7f48181300a0 2023-10-03T10:17:10.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.564+0000 7f481dd19700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4818133610 con 0x7f4818130bc0 2023-10-03T10:17:10.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.564+0000 7f481dd19700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481809a500 con 0x7f4818133ad0 2023-10-03T10:17:10.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.564+0000 7f48177fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4818133ad0 0x7f4818133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.564+0000 7f4817fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4818130bc0 0x7f481813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.564+0000 7f48177fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4818133ad0 0x7f4818133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57096/0 (socket says 172.21.15.146:57096) 2023-10-03T10:17:10.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.564+0000 7f4816ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f48181300a0 0x7f48181304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44700/0 (socket says 172.21.15.146:44700) 2023-10-03T10:17:10.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.564+0000 7f48177fe700 1 -- 172.21.15.146:0/2628879434 learned_addr learned my addr 172.21.15.146:0/2628879434 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:10.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.564+0000 7f4817fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4818130bc0 0x7f481813b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32956/0 (socket says 172.21.15.146:32956) 2023-10-03T10:17:10.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.564+0000 7f4817fff700 1 -- 172.21.15.146:0/2628879434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4818133ad0 msgr2=0x7f4818133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.564+0000 7f4817fff700 1 --2- 172.21.15.146:0/2628879434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4818133ad0 0x7f4818133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.564+0000 7f4817fff700 1 -- 172.21.15.146:0/2628879434 >> v1:172.21.15.146:6789/0 conn(0x7f48181300a0 legacy=0x7f48181304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.564+0000 7f4817fff700 1 -- 172.21.15.146:0/2628879434 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48181338b0 con 0x7f4818130bc0 2023-10-03T10:17:10.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.564+0000 7f48167fc700 1 -- 172.21.15.146:0/2628879434 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759386838 0 0) 0x7f481806b2d0 con 0x7f48181300a0 2023-10-03T10:17:10.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.564+0000 7f48177fe700 1 --2- 172.21.15.146:0/2628879434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4818133ad0 0x7f4818133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:10.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.565+0000 7f4817fff700 1 --2- 172.21.15.146:0/2628879434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4818130bc0 0x7f481813b990 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f4810009d90 tx=0x7f481000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2467cc96a3b2cfa5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.565+0000 7f48167fc700 1 -- 172.21.15.146:0/2628879434 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481000e070 con 0x7f4818130bc0 2023-10-03T10:17:10.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.565+0000 7f48167fc700 1 -- 172.21.15.146:0/2628879434 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481000bb20 con 0x7f4818130bc0 2023-10-03T10:17:10.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.565+0000 7f48167fc700 1 -- 172.21.15.146:0/2628879434 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4810012430 con 0x7f4818130bc0 2023-10-03T10:17:10.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.565+0000 7f481dd19700 1 -- 172.21.15.146:0/2628879434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4818130bc0 msgr2=0x7f481813b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.565+0000 7f481dd19700 1 --2- 172.21.15.146:0/2628879434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4818130bc0 0x7f481813b990 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f4810009d90 tx=0x7f481000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:10.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.565+0000 7f481dd19700 1 -- 172.21.15.146:0/2628879434 shutdown_connections 2023-10-03T10:17:10.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.565+0000 7f481dd19700 1 --2- 172.21.15.146:0/2628879434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4818130bc0 0x7f481813b990 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.565+0000 7f481dd19700 1 --2- 172.21.15.146:0/2628879434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4818133ad0 0x7f4818133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.565+0000 7f481dd19700 1 -- 172.21.15.146:0/2628879434 >> 172.21.15.146:0/2628879434 conn(0x7f4818099c40 msgr2=0x7f48180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.565+0000 7f481dd19700 1 -- 172.21.15.146:0/2628879434 shutdown_connections 2023-10-03T10:17:10.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.565+0000 7f481dd19700 1 -- 172.21.15.146:0/2628879434 wait complete. 2023-10-03T10:17:10.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.566+0000 7f481dd19700 1 Processor -- start 2023-10-03T10:17:10.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.566+0000 7f481dd19700 1 -- start start 2023-10-03T10:17:10.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.567+0000 7f481dd19700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48181300a0 0x7f481811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.567+0000 7f481dd19700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4818130bc0 0x7f481811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.567+0000 7f481dd19700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4818133ad0 0x7f481811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.567+0000 7f481dd19700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48181208e0 con 0x7f48181300a0 2023-10-03T10:17:10.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.567+0000 7f481dd19700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481811f9d0 con 0x7f4818133ad0 2023-10-03T10:17:10.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.567+0000 7f481dd19700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4818120070 con 0x7f4818130bc0 2023-10-03T10:17:10.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.567+0000 7f48177fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48181300a0 0x7f481811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.567+0000 7f48177fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48181300a0 0x7f481811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32972/0 (socket says 172.21.15.146:32972) 2023-10-03T10:17:10.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.567+0000 7f4816ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4818130bc0 0x7f481811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.567+0000 7f48177fe700 1 -- 172.21.15.146:0/2589510209 learned_addr learned my addr 172.21.15.146:0/2589510209 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:10.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.567+0000 7f4817fff700 1 --2- 172.21.15.146:0/2589510209 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4818133ad0 0x7f481811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.567+0000 7f48177fe700 1 -- 172.21.15.146:0/2589510209 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4818130bc0 msgr2=0x7f481811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.567+0000 7f48177fe700 1 --2- 172.21.15.146:0/2589510209 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4818130bc0 0x7f481811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.567+0000 7f48177fe700 1 -- 172.21.15.146:0/2589510209 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4818133ad0 msgr2=0x7f481811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.567+0000 7f48177fe700 1 --2- 172.21.15.146:0/2589510209 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4818133ad0 0x7f481811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.567+0000 7f48177fe700 1 -- 172.21.15.146:0/2589510209 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480c009550 con 0x7f48181300a0 2023-10-03T10:17:10.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.567+0000 7f4817fff700 1 --2- 172.21.15.146:0/2589510209 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4818133ad0 0x7f481811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:10.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.567+0000 7f48177fe700 1 --2- 172.21.15.146:0/2589510209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48181300a0 0x7f481811da40 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f480c00ebe0 tx=0x7f480c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.567+0000 7f47fffff700 1 -- 172.21.15.146:0/2589510209 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c00c850 con 0x7f48181300a0 2023-10-03T10:17:10.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.568+0000 7f47fffff700 1 -- 172.21.15.146:0/2589510209 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480c00c9b0 con 0x7f48181300a0 2023-10-03T10:17:10.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.568+0000 7f481dd19700 1 -- 172.21.15.146:0/2589510209 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4810009a70 con 0x7f48181300a0 2023-10-03T10:17:10.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.568+0000 7f47fffff700 1 -- 172.21.15.146:0/2589510209 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c00cd40 con 0x7f48181300a0 2023-10-03T10:17:10.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.568+0000 7f481dd19700 1 -- 172.21.15.146:0/2589510209 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f481812dd00 con 0x7f48181300a0 2023-10-03T10:17:10.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.568+0000 7f47fffff700 1 -- 172.21.15.146:0/2589510209 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f480c013470 con 0x7f48181300a0 2023-10-03T10:17:10.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.569+0000 7f47fffff700 1 -- 172.21.15.146:0/2589510209 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f480c03f8c0 con 0x7f48181300a0 2023-10-03T10:17:10.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.569+0000 7f481dd19700 1 -- 172.21.15.146:0/2589510209 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481811feb0 con 0x7f48181300a0 2023-10-03T10:17:10.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.573+0000 7f47fffff700 1 -- 172.21.15.146:0/2589510209 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f481811feb0 con 0x7f48181300a0 2023-10-03T10:17:10.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.756+0000 7f481dd19700 1 -- 172.21.15.146:0/2589510209 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f481809cb20 con 0x7f48181300a0 2023-10-03T10:17:10.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.756+0000 7f47fffff700 1 -- 172.21.15.146:0/2589510209 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f480c017070 con 0x7f48181300a0 2023-10-03T10:17:10.757 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:10.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.758+0000 7f481dd19700 1 -- 172.21.15.146:0/2589510209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48181300a0 msgr2=0x7f481811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.759+0000 7f481dd19700 1 --2- 172.21.15.146:0/2589510209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48181300a0 0x7f481811da40 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f480c00ebe0 tx=0x7f480c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.759+0000 7f481dd19700 1 -- 172.21.15.146:0/2589510209 shutdown_connections 2023-10-03T10:17:10.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.759+0000 7f481dd19700 1 --2- 172.21.15.146:0/2589510209 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4818133ad0 0x7f481811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.759+0000 7f481dd19700 1 --2- 172.21.15.146:0/2589510209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48181300a0 0x7f481811da40 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.759+0000 7f481dd19700 1 --2- 172.21.15.146:0/2589510209 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4818130bc0 0x7f481811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.759+0000 7f481dd19700 1 -- 172.21.15.146:0/2589510209 >> 172.21.15.146:0/2589510209 conn(0x7f4818099c40 msgr2=0x7f4818132950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.759+0000 7f481dd19700 1 -- 172.21.15.146:0/2589510209 shutdown_connections 2023-10-03T10:17:10.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:10.759+0000 7f481dd19700 1 -- 172.21.15.146:0/2589510209 wait complete. 2023-10-03T10:17:10.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:11.206 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:11.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.328+0000 7efeedfde700 1 Processor -- start 2023-10-03T10:17:11.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.329+0000 7efeedfde700 1 -- start start 2023-10-03T10:17:11.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.329+0000 7efeedfde700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efee8133ad0 0x7efee8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.329+0000 7efeedfde700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efee81300a0 0x7efee81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.329+0000 7efeedfde700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee806b2d0 con 0x7efee81309f0 2023-10-03T10:17:11.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.329+0000 7efeedfde700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee8133610 con 0x7efee81300a0 2023-10-03T10:17:11.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.329+0000 7efeedfde700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efee809a500 con 0x7efee8133ad0 2023-10-03T10:17:11.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.329+0000 7efee6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efee81300a0 0x7efee81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.329+0000 7efee7fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7efee81309f0 0x7efee813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44704/0 (socket says 172.21.15.146:44704) 2023-10-03T10:17:11.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.329+0000 7efee6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efee81300a0 0x7efee81304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57116/0 (socket says 172.21.15.146:57116) 2023-10-03T10:17:11.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.329+0000 7efee7fff700 1 -- 172.21.15.146:0/3144784192 learned_addr learned my addr 172.21.15.146:0/3144784192 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.329+0000 7efee77fe700 1 --2- 172.21.15.146:0/3144784192 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efee8133ad0 0x7efee8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.329+0000 7efee67fc700 1 -- 172.21.15.146:0/3144784192 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2337759528 0 0) 0x7efee806b2d0 con 0x7efee81309f0 2023-10-03T10:17:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.329+0000 7efee6ffd700 1 -- 172.21.15.146:0/3144784192 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efee8133ad0 msgr2=0x7efee8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.329+0000 7efee6ffd700 1 --2- 172.21.15.146:0/3144784192 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efee8133ad0 0x7efee8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.329+0000 7efee6ffd700 1 -- 172.21.15.146:0/3144784192 >> v1:172.21.15.146:6789/0 conn(0x7efee81309f0 legacy=0x7efee813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.329+0000 7efee6ffd700 1 -- 172.21.15.146:0/3144784192 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee81338b0 con 0x7efee81300a0 2023-10-03T10:17:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.329+0000 7efee77fe700 1 --2- 172.21.15.146:0/3144784192 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efee8133ad0 0x7efee8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.330+0000 7efee6ffd700 1 --2- 172.21.15.146:0/3144784192 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efee81300a0 0x7efee81304b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7efed8009870 tx=0x7efed8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffb5efa0043a3e54 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.330+0000 7efee67fc700 1 -- 172.21.15.146:0/3144784192 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed8011830 con 0x7efee81300a0 2023-10-03T10:17:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.330+0000 7efee67fc700 1 -- 172.21.15.146:0/3144784192 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed8011990 con 0x7efee81300a0 2023-10-03T10:17:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.330+0000 7efee67fc700 1 -- 172.21.15.146:0/3144784192 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed8011d20 con 0x7efee81300a0 2023-10-03T10:17:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.330+0000 7efeedfde700 1 -- 172.21.15.146:0/3144784192 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efee81300a0 msgr2=0x7efee81304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.330+0000 7efeedfde700 1 --2- 172.21.15.146:0/3144784192 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efee81300a0 0x7efee81304b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7efed8009870 tx=0x7efed8009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:11.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.330+0000 7efeedfde700 1 -- 172.21.15.146:0/3144784192 shutdown_connections 2023-10-03T10:17:11.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.330+0000 7efeedfde700 1 --2- 172.21.15.146:0/3144784192 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efee8133ad0 0x7efee8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.330+0000 7efeedfde700 1 --2- 172.21.15.146:0/3144784192 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efee81300a0 0x7efee81304b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.330+0000 7efeedfde700 1 -- 172.21.15.146:0/3144784192 >> 172.21.15.146:0/3144784192 conn(0x7efee8099c40 msgr2=0x7efee80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.330+0000 7efeedfde700 1 -- 172.21.15.146:0/3144784192 shutdown_connections 2023-10-03T10:17:11.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.330+0000 7efeedfde700 1 -- 172.21.15.146:0/3144784192 wait complete. 2023-10-03T10:17:11.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.331+0000 7efeedfde700 1 Processor -- start 2023-10-03T10:17:11.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.331+0000 7efeedfde700 1 -- start start 2023-10-03T10:17:11.334 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:11.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.332+0000 7efeedfde700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efee81300a0 0x7efee811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.332+0000 7efeedfde700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efee81309f0 0x7efee811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.332+0000 7efeedfde700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efee8133ad0 0x7efee811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.332+0000 7efeedfde700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee812d7a0 con 0x7efee81300a0 2023-10-03T10:17:11.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.332+0000 7efeedfde700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee80a3390 con 0x7efee8133ad0 2023-10-03T10:17:11.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.332+0000 7efeedfde700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efee812dd00 con 0x7efee81309f0 2023-10-03T10:17:11.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.332+0000 7efee77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efee81300a0 0x7efee811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.332+0000 7efee6ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efee81309f0 0x7efee811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.332+0000 7efee77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efee81300a0 0x7efee811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32978/0 (socket says 172.21.15.146:32978) 2023-10-03T10:17:11.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.332+0000 7efee77fe700 1 -- 172.21.15.146:0/635499264 learned_addr learned my addr 172.21.15.146:0/635499264 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:11.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.332+0000 7efee7fff700 1 --2- 172.21.15.146:0/635499264 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efee8133ad0 0x7efee811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.332+0000 7efee6ffd700 1 -- 172.21.15.146:0/635499264 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efee8133ad0 msgr2=0x7efee811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.332+0000 7efee6ffd700 1 --2- 172.21.15.146:0/635499264 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efee8133ad0 0x7efee811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.332+0000 7efee6ffd700 1 -- 172.21.15.146:0/635499264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efee81300a0 msgr2=0x7efee811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.332+0000 7efee6ffd700 1 --2- 172.21.15.146:0/635499264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efee81300a0 0x7efee811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.332+0000 7efee6ffd700 1 -- 172.21.15.146:0/635499264 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed00094a0 con 0x7efee81309f0 2023-10-03T10:17:11.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.332+0000 7efee77fe700 1 --2- 172.21.15.146:0/635499264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efee81300a0 0x7efee811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:11.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.332+0000 7efee6ffd700 1 --2- 172.21.15.146:0/635499264 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efee81309f0 0x7efee811df80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7efed8016000 tx=0x7efed8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:11.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.333+0000 7efedffff700 1 -- 172.21.15.146:0/635499264 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed8004510 con 0x7efee81309f0 2023-10-03T10:17:11.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.333+0000 7efedffff700 1 -- 172.21.15.146:0/635499264 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed801e070 con 0x7efee81309f0 2023-10-03T10:17:11.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.333+0000 7efeedfde700 1 -- 172.21.15.146:0/635499264 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed80094a0 con 0x7efee81309f0 2023-10-03T10:17:11.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.333+0000 7efedffff700 1 -- 172.21.15.146:0/635499264 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed80038c0 con 0x7efee81309f0 2023-10-03T10:17:11.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.333+0000 7efeedfde700 1 -- 172.21.15.146:0/635499264 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee8120440 con 0x7efee81309f0 2023-10-03T10:17:11.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.333+0000 7efedffff700 1 -- 172.21.15.146:0/635499264 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efed8003a20 con 0x7efee81309f0 2023-10-03T10:17:11.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.333+0000 7efedffff700 1 -- 172.21.15.146:0/635499264 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efed8020070 con 0x7efee81309f0 2023-10-03T10:17:11.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.334+0000 7efeedfde700 1 -- 172.21.15.146:0/635499264 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee811fdf0 con 0x7efee81309f0 2023-10-03T10:17:11.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.338+0000 7efedffff700 1 -- 172.21.15.146:0/635499264 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efed8015080 con 0x7efee81309f0 2023-10-03T10:17:11.382 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:11.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.465+0000 7f62664f2700 1 Processor -- start 2023-10-03T10:17:11.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.465+0000 7f62664f2700 1 -- start start 2023-10-03T10:17:11.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.466+0000 7f62664f2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62600a0a70 0x7f62600a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.466+0000 7f62664f2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6260134120 0x7f626013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.466+0000 7f62664f2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f626009dc00 con 0x7f62600a1380 2023-10-03T10:17:11.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.466+0000 7f62664f2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f626009ea60 con 0x7f6260134120 2023-10-03T10:17:11.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.466+0000 7f62664f2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f626009dec0 con 0x7f62600a0a70 2023-10-03T10:17:11.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.466+0000 7f625ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62600a0a70 0x7f62600a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.466+0000 7f6264a8f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6260134120 0x7f626013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.466+0000 7f625ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62600a0a70 0x7f62600a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57156/0 (socket says 172.21.15.146:57156) 2023-10-03T10:17:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.466+0000 7f6264a8f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6260134120 0x7f626013bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32988/0 (socket says 172.21.15.146:32988) 2023-10-03T10:17:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.466+0000 7f625ffff700 1 -- 172.21.15.146:0/2003048945 learned_addr learned my addr 172.21.15.146:0/2003048945 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.466+0000 7f6264a8f700 1 -- 172.21.15.146:0/2003048945 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62600a0a70 msgr2=0x7f62600a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.466+0000 7f6264a8f700 1 --2- 172.21.15.146:0/2003048945 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62600a0a70 0x7f62600a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.466+0000 7f6264a8f700 1 -- 172.21.15.146:0/2003048945 >> v1:172.21.15.146:6789/0 conn(0x7f62600a1380 legacy=0x7f6260133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.467+0000 7f6264a8f700 1 -- 172.21.15.146:0/2003048945 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626009e6a0 con 0x7f6260134120 2023-10-03T10:17:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.466+0000 7f625effd700 1 -- 172.21.15.146:0/2003048945 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376215148 0 0) 0x7f626009dc00 con 0x7f62600a1380 2023-10-03T10:17:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.467+0000 7f625ffff700 1 --2- 172.21.15.146:0/2003048945 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62600a0a70 0x7f62600a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:11.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.467+0000 7f6264a8f700 1 --2- 172.21.15.146:0/2003048945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6260134120 0x7f626013bce0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f6258009d90 tx=0x7f625800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6954f1a4ea36fcfc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:11.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.467+0000 7f625effd700 1 -- 172.21.15.146:0/2003048945 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625800e070 con 0x7f6260134120 2023-10-03T10:17:11.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.467+0000 7f625effd700 1 -- 172.21.15.146:0/2003048945 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625800bb20 con 0x7f6260134120 2023-10-03T10:17:11.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.467+0000 7f625effd700 1 -- 172.21.15.146:0/2003048945 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6258012430 con 0x7f6260134120 2023-10-03T10:17:11.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.467+0000 7f62664f2700 1 -- 172.21.15.146:0/2003048945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6260134120 msgr2=0x7f626013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.467+0000 7f62664f2700 1 --2- 172.21.15.146:0/2003048945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6260134120 0x7f626013bce0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f6258009d90 tx=0x7f625800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:11.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.468+0000 7f62664f2700 1 -- 172.21.15.146:0/2003048945 shutdown_connections 2023-10-03T10:17:11.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.468+0000 7f62664f2700 1 --2- 172.21.15.146:0/2003048945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6260134120 0x7f626013bce0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.468+0000 7f62664f2700 1 --2- 172.21.15.146:0/2003048945 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62600a0a70 0x7f62600a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.468+0000 7f62664f2700 1 -- 172.21.15.146:0/2003048945 >> 172.21.15.146:0/2003048945 conn(0x7f62600a6610 msgr2=0x7f62600a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.468+0000 7f62664f2700 1 -- 172.21.15.146:0/2003048945 shutdown_connections 2023-10-03T10:17:11.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.468+0000 7f62664f2700 1 -- 172.21.15.146:0/2003048945 wait complete. 2023-10-03T10:17:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.469+0000 7f62664f2700 1 Processor -- start 2023-10-03T10:17:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.469+0000 7f62664f2700 1 -- start start 2023-10-03T10:17:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.470+0000 7f62664f2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62600a0a70 0x7f6260122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.470+0000 7f62664f2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62600a1380 0x7f6260122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.470+0000 7f62664f2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6260134120 0x7f62601231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.470+0000 7f62664f2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62601332b0 con 0x7f62600a1380 2023-10-03T10:17:11.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.470+0000 7f62664f2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62601258b0 con 0x7f6260134120 2023-10-03T10:17:11.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.470+0000 7f62664f2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62601242c0 con 0x7f62600a0a70 2023-10-03T10:17:11.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.470+0000 7f625f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62600a1380 0x7f6260122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.470+0000 7f625ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62600a0a70 0x7f6260122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.470+0000 7f625f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62600a1380 0x7f6260122c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33002/0 (socket says 172.21.15.146:33002) 2023-10-03T10:17:11.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.470+0000 7f625f7fe700 1 -- 172.21.15.146:0/1891228460 learned_addr learned my addr 172.21.15.146:0/1891228460 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:11.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.470+0000 7f6264a8f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6260134120 0x7f62601231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.470+0000 7f625f7fe700 1 -- 172.21.15.146:0/1891228460 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62600a0a70 msgr2=0x7f6260122750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.470+0000 7f625f7fe700 1 --2- 172.21.15.146:0/1891228460 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62600a0a70 0x7f6260122750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.470+0000 7f625f7fe700 1 -- 172.21.15.146:0/1891228460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6260134120 msgr2=0x7f62601231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.470+0000 7f625f7fe700 1 --2- 172.21.15.146:0/1891228460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6260134120 0x7f62601231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.470+0000 7f625f7fe700 1 -- 172.21.15.146:0/1891228460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6250009550 con 0x7f62600a1380 2023-10-03T10:17:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.470+0000 7f625ffff700 1 --2- 172.21.15.146:0/1891228460 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62600a0a70 0x7f6260122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.470+0000 7f6264a8f700 1 --2- 172.21.15.146:0/1891228460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6260134120 0x7f62601231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.470+0000 7f625f7fe700 1 --2- 172.21.15.146:0/1891228460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62600a1380 0x7f6260122c90 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f625400c580 tx=0x7f625400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.471+0000 7f625cff9700 1 -- 172.21.15.146:0/1891228460 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62540054e0 con 0x7f62600a1380 2023-10-03T10:17:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.471+0000 7f625cff9700 1 -- 172.21.15.146:0/1891228460 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6254003680 con 0x7f62600a1380 2023-10-03T10:17:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.471+0000 7f62664f2700 1 -- 172.21.15.146:0/1891228460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6258009a70 con 0x7f62600a1380 2023-10-03T10:17:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.471+0000 7f625cff9700 1 -- 172.21.15.146:0/1891228460 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254003a30 con 0x7f62600a1380 2023-10-03T10:17:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.471+0000 7f62664f2700 1 -- 172.21.15.146:0/1891228460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6260125c30 con 0x7f62600a1380 2023-10-03T10:17:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.471+0000 7f625cff9700 1 -- 172.21.15.146:0/1891228460 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6254003b90 con 0x7f62600a1380 2023-10-03T10:17:11.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.472+0000 7f625cff9700 1 -- 172.21.15.146:0/1891228460 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6254011bc0 con 0x7f62600a1380 2023-10-03T10:17:11.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.472+0000 7f62664f2700 1 -- 172.21.15.146:0/1891228460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626004f2a0 con 0x7f62600a1380 2023-10-03T10:17:11.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.477+0000 7f625cff9700 1 -- 172.21.15.146:0/1891228460 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6254017030 con 0x7f62600a1380 2023-10-03T10:17:11.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.509+0000 7f59dfda6700 1 Processor -- start 2023-10-03T10:17:11.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.509+0000 7f59dfda6700 1 -- start start 2023-10-03T10:17:11.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.509+0000 7f59dfda6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f59d809e950 0x7f59d809ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.509+0000 7f59dfda6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f59d809f260 0x7f59d8131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.509+0000 7f59dfda6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59d8131dd0 0x7f59d8132250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.509+0000 7f59dfda6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d809b6d0 con 0x7f59d809e950 2023-10-03T10:17:11.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.509+0000 7f59dfda6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d809afb0 con 0x7f59d8131dd0 2023-10-03T10:17:11.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.509+0000 7f59dfda6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59d80a0970 con 0x7f59d809f260 2023-10-03T10:17:11.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.510+0000 7f59ddb42700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f59d809e950 0x7f59d809ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.510+0000 7f59dd341700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f59d809f260 0x7f59d8131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.510+0000 7f59de343700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59d8131dd0 0x7f59d8132250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.510+0000 7f59ddb42700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f59d809e950 0x7f59d809ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33018/0 (socket says 172.21.15.146:33018) 2023-10-03T10:17:11.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.510+0000 7f59ddb42700 1 -- 172.21.15.146:0/1905695795 learned_addr learned my addr 172.21.15.146:0/1905695795 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:11.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.510+0000 7f59dd341700 1 -- 172.21.15.146:0/1905695795 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59d8131dd0 msgr2=0x7f59d8132250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:11.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.510+0000 7f59dd341700 1 --2- 172.21.15.146:0/1905695795 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59d8131dd0 0x7f59d8132250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.510+0000 7f59dd341700 1 -- 172.21.15.146:0/1905695795 >> v2:172.21.15.146:3300/0 conn(0x7f59d809e950 msgr2=0x7f59d809ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:11.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.510+0000 7f59dd341700 1 --2- 172.21.15.146:0/1905695795 >> v2:172.21.15.146:3300/0 conn(0x7f59d809e950 0x7f59d809ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.510+0000 7f59dd341700 1 -- 172.21.15.146:0/1905695795 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d80a0320 con 0x7f59d809f260 2023-10-03T10:17:11.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.510+0000 7f59de343700 1 --2- 172.21.15.146:0/1905695795 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59d8131dd0 0x7f59d8132250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:11.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.510+0000 7f59ddb42700 1 --2- 172.21.15.146:0/1905695795 >> v2:172.21.15.146:3300/0 conn(0x7f59d809e950 0x7f59d809ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:11.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.510+0000 7f59dd341700 1 --2- 172.21.15.146:0/1905695795 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f59d809f260 0x7f59d8131890 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f59c8009840 tx=0x7f59c8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc44d68565afc585 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:11.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.510+0000 7f59dcb40700 1 -- 172.21.15.146:0/1905695795 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c8011830 con 0x7f59d809f260 2023-10-03T10:17:11.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.510+0000 7f59dcb40700 1 -- 172.21.15.146:0/1905695795 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c8011990 con 0x7f59d809f260 2023-10-03T10:17:11.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.510+0000 7f59dcb40700 1 -- 172.21.15.146:0/1905695795 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c8011d20 con 0x7f59d809f260 2023-10-03T10:17:11.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.511+0000 7f59dfda6700 1 -- 172.21.15.146:0/1905695795 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f59d809f260 msgr2=0x7f59d8131890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.511+0000 7f59dfda6700 1 --2- 172.21.15.146:0/1905695795 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f59d809f260 0x7f59d8131890 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f59c8009840 tx=0x7f59c8009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:11.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.511+0000 7f59dfda6700 1 -- 172.21.15.146:0/1905695795 shutdown_connections 2023-10-03T10:17:11.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.511+0000 7f59dfda6700 1 --2- 172.21.15.146:0/1905695795 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59d8131dd0 0x7f59d8132250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.511+0000 7f59dfda6700 1 --2- 172.21.15.146:0/1905695795 >> v2:172.21.15.146:3300/0 conn(0x7f59d809e950 0x7f59d809ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.511+0000 7f59dfda6700 1 --2- 172.21.15.146:0/1905695795 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f59d809f260 0x7f59d8131890 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.511+0000 7f59dfda6700 1 -- 172.21.15.146:0/1905695795 >> 172.21.15.146:0/1905695795 conn(0x7f59d80a0f70 msgr2=0x7f59d80a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.511+0000 7f59dfda6700 1 -- 172.21.15.146:0/1905695795 shutdown_connections 2023-10-03T10:17:11.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.511+0000 7f59dfda6700 1 -- 172.21.15.146:0/1905695795 wait complete. 2023-10-03T10:17:11.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.512+0000 7f59dfda6700 1 Processor -- start 2023-10-03T10:17:11.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.512+0000 7f59dfda6700 1 -- start start 2023-10-03T10:17:11.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.512+0000 7f59dfda6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f59d809e950 0x7f59d806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.512+0000 7f59dfda6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59d809f260 0x7f59d806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.512+0000 7f59dfda6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59d8131dd0 0x7f59d806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.512+0000 7f59dfda6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d806cd10 con 0x7f59d809f260 2023-10-03T10:17:11.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.512+0000 7f59dfda6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d8125790 con 0x7f59d8131dd0 2023-10-03T10:17:11.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.512+0000 7f59dfda6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59d8125e40 con 0x7f59d809e950 2023-10-03T10:17:11.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.513+0000 7f59ddb42700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f59d809e950 0x7f59d806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.513+0000 7f59ddb42700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f59d809e950 0x7f59d806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57192/0 (socket says 172.21.15.146:57192) 2023-10-03T10:17:11.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.513+0000 7f59ddb42700 1 -- 172.21.15.146:0/3501776549 learned_addr learned my addr 172.21.15.146:0/3501776549 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:11.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.513+0000 7f59de343700 1 --2- 172.21.15.146:0/3501776549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59d8131dd0 0x7f59d806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.513+0000 7f59dd341700 1 --2- 172.21.15.146:0/3501776549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59d809f260 0x7f59d806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.513+0000 7f59ddb42700 1 -- 172.21.15.146:0/3501776549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59d8131dd0 msgr2=0x7f59d806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.513+0000 7f59ddb42700 1 --2- 172.21.15.146:0/3501776549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59d8131dd0 0x7f59d806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.513+0000 7f59ddb42700 1 -- 172.21.15.146:0/3501776549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59d809f260 msgr2=0x7f59d806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.513+0000 7f59ddb42700 1 --2- 172.21.15.146:0/3501776549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59d809f260 0x7f59d806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.513+0000 7f59ddb42700 1 -- 172.21.15.146:0/3501776549 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d4009500 con 0x7f59d809e950 2023-10-03T10:17:11.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.513+0000 7f59dd341700 1 --2- 172.21.15.146:0/3501776549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59d809f260 0x7f59d806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:11.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.513+0000 7f59ddb42700 1 --2- 172.21.15.146:0/3501776549 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f59d809e950 0x7f59d806b8b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f59d400ebb0 tx=0x7f59d400ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:11.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.513+0000 7f59ce7fc700 1 -- 172.21.15.146:0/3501776549 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4005a20 con 0x7f59d809e950 2023-10-03T10:17:11.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.513+0000 7f59ce7fc700 1 -- 172.21.15.146:0/3501776549 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d4005b80 con 0x7f59d809e950 2023-10-03T10:17:11.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.513+0000 7f59dfda6700 1 -- 172.21.15.146:0/3501776549 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d0009a70 con 0x7f59d809e950 2023-10-03T10:17:11.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.513+0000 7f59ce7fc700 1 -- 172.21.15.146:0/3501776549 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d400c850 con 0x7f59d809e950 2023-10-03T10:17:11.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.513+0000 7f59dfda6700 1 -- 172.21.15.146:0/3501776549 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c80094a0 con 0x7f59d809e950 2023-10-03T10:17:11.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.514+0000 7f59ce7fc700 1 -- 172.21.15.146:0/3501776549 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f59d400c9b0 con 0x7f59d809e950 2023-10-03T10:17:11.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.514+0000 7f59ce7fc700 1 -- 172.21.15.146:0/3501776549 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f59d403fa00 con 0x7f59d809e950 2023-10-03T10:17:11.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.514+0000 7f59dfda6700 1 -- 172.21.15.146:0/3501776549 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d81314c0 con 0x7f59d809e950 2023-10-03T10:17:11.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.523+0000 7f59ce7fc700 1 -- 172.21.15.146:0/3501776549 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f59d4022300 con 0x7f59d809e950 2023-10-03T10:17:11.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.542+0000 7efeedfde700 1 -- 172.21.15.146:0/635499264 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efee804f2a0 con 0x7efee81309f0 2023-10-03T10:17:11.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.542+0000 7efedffff700 1 -- 172.21.15.146:0/635499264 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efed8003cd0 con 0x7efee81309f0 2023-10-03T10:17:11.543 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:11.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.544+0000 7efeedfde700 1 -- 172.21.15.146:0/635499264 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efee81309f0 msgr2=0x7efee811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.544+0000 7efeedfde700 1 --2- 172.21.15.146:0/635499264 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efee81309f0 0x7efee811df80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7efed8016000 tx=0x7efed8004750 comp rx=0 tx=0).stop 2023-10-03T10:17:11.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.544+0000 7efeedfde700 1 -- 172.21.15.146:0/635499264 shutdown_connections 2023-10-03T10:17:11.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.544+0000 7efeedfde700 1 --2- 172.21.15.146:0/635499264 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efee8133ad0 0x7efee811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.544+0000 7efeedfde700 1 --2- 172.21.15.146:0/635499264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efee81300a0 0x7efee811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.544+0000 7efeedfde700 1 --2- 172.21.15.146:0/635499264 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efee81309f0 0x7efee811df80 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.544+0000 7efeedfde700 1 -- 172.21.15.146:0/635499264 >> 172.21.15.146:0/635499264 conn(0x7efee8099c40 msgr2=0x7efee8132b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.545+0000 7efeedfde700 1 -- 172.21.15.146:0/635499264 shutdown_connections 2023-10-03T10:17:11.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.545+0000 7efeedfde700 1 -- 172.21.15.146:0/635499264 wait complete. 2023-10-03T10:17:11.558 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:11.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.672+0000 7f62664f2700 1 -- 172.21.15.146:0/1891228460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6260072980 con 0x7f62600a1380 2023-10-03T10:17:11.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.672+0000 7f625cff9700 1 -- 172.21.15.146:0/1891228460 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6254003e40 con 0x7f62600a1380 2023-10-03T10:17:11.673 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:11.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.674+0000 7f62664f2700 1 -- 172.21.15.146:0/1891228460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62600a1380 msgr2=0x7f6260122c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.674+0000 7f62664f2700 1 --2- 172.21.15.146:0/1891228460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62600a1380 0x7f6260122c90 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f625400c580 tx=0x7f625400c890 comp rx=0 tx=0).stop 2023-10-03T10:17:11.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.674+0000 7f62664f2700 1 -- 172.21.15.146:0/1891228460 shutdown_connections 2023-10-03T10:17:11.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.674+0000 7f62664f2700 1 --2- 172.21.15.146:0/1891228460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6260134120 0x7f62601231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.674+0000 7f62664f2700 1 --2- 172.21.15.146:0/1891228460 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62600a0a70 0x7f6260122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.674+0000 7f62664f2700 1 --2- 172.21.15.146:0/1891228460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62600a1380 0x7f6260122c90 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.674+0000 7f62664f2700 1 -- 172.21.15.146:0/1891228460 >> 172.21.15.146:0/1891228460 conn(0x7f62600a6610 msgr2=0x7f626011c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.675+0000 7f62664f2700 1 -- 172.21.15.146:0/1891228460 shutdown_connections 2023-10-03T10:17:11.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.675+0000 7f62664f2700 1 -- 172.21.15.146:0/1891228460 wait complete. 2023-10-03T10:17:11.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:11.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.716+0000 7f59dfda6700 1 -- 172.21.15.146:0/3501776549 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f59d809da40 con 0x7f59d809e950 2023-10-03T10:17:11.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.716+0000 7f59ce7fc700 1 -- 172.21.15.146:0/3501776549 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f59d402a090 con 0x7f59d809e950 2023-10-03T10:17:11.717 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:11.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.718+0000 7f59dfda6700 1 -- 172.21.15.146:0/3501776549 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f59d809e950 msgr2=0x7f59d806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.718+0000 7f59dfda6700 1 --2- 172.21.15.146:0/3501776549 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f59d809e950 0x7f59d806b8b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f59d400ebb0 tx=0x7f59d400ef70 comp rx=0 tx=0).stop 2023-10-03T10:17:11.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.718+0000 7f59dfda6700 1 -- 172.21.15.146:0/3501776549 shutdown_connections 2023-10-03T10:17:11.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.718+0000 7f59dfda6700 1 --2- 172.21.15.146:0/3501776549 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59d8131dd0 0x7f59d806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.718+0000 7f59dfda6700 1 --2- 172.21.15.146:0/3501776549 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f59d809e950 0x7f59d806b8b0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.718+0000 7f59dfda6700 1 --2- 172.21.15.146:0/3501776549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59d809f260 0x7f59d806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.718+0000 7f59dfda6700 1 -- 172.21.15.146:0/3501776549 >> 172.21.15.146:0/3501776549 conn(0x7f59d80a0f70 msgr2=0x7f59d80a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.718+0000 7f59dfda6700 1 -- 172.21.15.146:0/3501776549 shutdown_connections 2023-10-03T10:17:11.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.718+0000 7f59dfda6700 1 -- 172.21.15.146:0/3501776549 wait complete. 2023-10-03T10:17:11.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:11.772 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:11.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.894+0000 7f1b1db06700 1 Processor -- start 2023-10-03T10:17:11.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.894+0000 7f1b1db06700 1 -- start start 2023-10-03T10:17:11.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.895+0000 7f1b1db06700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1b1809d860 0x7f1b1809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.895+0000 7f1b1db06700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1809e170 0x7f1b181307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.895+0000 7f1b1db06700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1b18130ce0 0x7f1b18131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.895+0000 7f1b1db06700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b1809aaa0 con 0x7f1b18130ce0 2023-10-03T10:17:11.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.895+0000 7f1b1db06700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1809f870 con 0x7f1b1809e170 2023-10-03T10:17:11.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.895+0000 7f1b1db06700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1809b360 con 0x7f1b1809d860 2023-10-03T10:17:11.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.895+0000 7f1b177fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1b1809d860 0x7f1b1809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.895+0000 7f1b16ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1809e170 0x7f1b181307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.895+0000 7f1b17fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1b18130ce0 0x7f1b18131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.895+0000 7f1b16ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1809e170 0x7f1b181307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57158/0 (socket says 172.21.15.146:57158) 2023-10-03T10:17:11.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.895+0000 7f1b177fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1b1809d860 0x7f1b1809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57194/0 (socket says 172.21.15.146:57194) 2023-10-03T10:17:11.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.895+0000 7f1b16ffd700 1 -- 172.21.15.146:0/2886598579 learned_addr learned my addr 172.21.15.146:0/2886598579 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:11.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.895+0000 7f1b177fe700 1 -- 172.21.15.146:0/2886598579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1809e170 msgr2=0x7f1b181307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:11.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.895+0000 7f1b177fe700 1 --2- 172.21.15.146:0/2886598579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1809e170 0x7f1b181307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.895+0000 7f1b177fe700 1 -- 172.21.15.146:0/2886598579 >> v2:172.21.15.146:3300/0 conn(0x7f1b18130ce0 msgr2=0x7f1b18131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:11.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.895+0000 7f1b177fe700 1 --2- 172.21.15.146:0/2886598579 >> v2:172.21.15.146:3300/0 conn(0x7f1b18130ce0 0x7f1b18131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.895+0000 7f1b177fe700 1 -- 172.21.15.146:0/2886598579 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1809b620 con 0x7f1b1809d860 2023-10-03T10:17:11.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.895+0000 7f1b16ffd700 1 --2- 172.21.15.146:0/2886598579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1809e170 0x7f1b181307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:11.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.895+0000 7f1b17fff700 1 --2- 172.21.15.146:0/2886598579 >> v2:172.21.15.146:3300/0 conn(0x7f1b18130ce0 0x7f1b18131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:11.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.895+0000 7f1b177fe700 1 --2- 172.21.15.146:0/2886598579 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1b1809d860 0x7f1b1809dc30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f1b08009840 tx=0x7f1b08009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b2deeb3fc6dcb9f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:11.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.896+0000 7f1b167fc700 1 -- 172.21.15.146:0/2886598579 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08011830 con 0x7f1b1809d860 2023-10-03T10:17:11.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.896+0000 7f1b167fc700 1 -- 172.21.15.146:0/2886598579 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b08011990 con 0x7f1b1809d860 2023-10-03T10:17:11.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.896+0000 7f1b167fc700 1 -- 172.21.15.146:0/2886598579 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08011d20 con 0x7f1b1809d860 2023-10-03T10:17:11.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.896+0000 7f1b1db06700 1 -- 172.21.15.146:0/2886598579 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1b1809d860 msgr2=0x7f1b1809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.896+0000 7f1b1db06700 1 --2- 172.21.15.146:0/2886598579 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1b1809d860 0x7f1b1809dc30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f1b08009840 tx=0x7f1b08009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:11.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.896+0000 7f1b1db06700 1 -- 172.21.15.146:0/2886598579 shutdown_connections 2023-10-03T10:17:11.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.896+0000 7f1b1db06700 1 --2- 172.21.15.146:0/2886598579 >> v2:172.21.15.146:3300/0 conn(0x7f1b18130ce0 0x7f1b18131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.896+0000 7f1b1db06700 1 --2- 172.21.15.146:0/2886598579 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1b1809d860 0x7f1b1809dc30 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.896+0000 7f1b1db06700 1 --2- 172.21.15.146:0/2886598579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1809e170 0x7f1b181307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.896+0000 7f1b1db06700 1 -- 172.21.15.146:0/2886598579 >> 172.21.15.146:0/2886598579 conn(0x7f1b18099c40 msgr2=0x7f1b180a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.896+0000 7f1b1db06700 1 -- 172.21.15.146:0/2886598579 shutdown_connections 2023-10-03T10:17:11.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.896+0000 7f1b1db06700 1 -- 172.21.15.146:0/2886598579 wait complete. 2023-10-03T10:17:11.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.897+0000 7f1b1db06700 1 Processor -- start 2023-10-03T10:17:11.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.897+0000 7f1b1db06700 1 -- start start 2023-10-03T10:17:11.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.898+0000 7f1b1db06700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b1809d860 0x7f1b1811d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.898+0000 7f1b1db06700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1809e170 0x7f1b1811d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.898+0000 7f1b1db06700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1b18130ce0 0x7f1b1811daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:11.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.898+0000 7f1b1db06700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b18120320 con 0x7f1b1809d860 2023-10-03T10:17:11.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.898+0000 7f1b1db06700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1809c8b0 con 0x7f1b1809e170 2023-10-03T10:17:11.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.898+0000 7f1b1db06700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b18071a50 con 0x7f1b18130ce0 2023-10-03T10:17:11.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.898+0000 7f1b16ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1809e170 0x7f1b1811d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.898+0000 7f1b177fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b1809d860 0x7f1b1811d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.898+0000 7f1b16ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1809e170 0x7f1b1811d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57170/0 (socket says 172.21.15.146:57170) 2023-10-03T10:17:11.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.898+0000 7f1b16ffd700 1 -- 172.21.15.146:0/1668523612 learned_addr learned my addr 172.21.15.146:0/1668523612 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:11.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.898+0000 7f1b16ffd700 1 -- 172.21.15.146:0/1668523612 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1b18130ce0 msgr2=0x7f1b1811daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.898+0000 7f1b16ffd700 1 --2- 172.21.15.146:0/1668523612 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1b18130ce0 0x7f1b1811daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.898+0000 7f1b16ffd700 1 -- 172.21.15.146:0/1668523612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b1809d860 msgr2=0x7f1b1811d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.898+0000 7f1b16ffd700 1 --2- 172.21.15.146:0/1668523612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b1809d860 0x7f1b1811d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.898+0000 7f1b16ffd700 1 -- 172.21.15.146:0/1668523612 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c009550 con 0x7f1b1809e170 2023-10-03T10:17:11.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.898+0000 7f1b177fe700 1 --2- 172.21.15.146:0/1668523612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b1809d860 0x7f1b1811d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:11.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.898+0000 7f1b16ffd700 1 --2- 172.21.15.146:0/1668523612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1809e170 0x7f1b1811d5b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00ebb0 tx=0x7f1b0c00eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:11.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.900+0000 7f1afffff700 1 -- 172.21.15.146:0/1668523612 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c004240 con 0x7f1b1809e170 2023-10-03T10:17:11.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.900+0000 7f1afffff700 1 -- 172.21.15.146:0/1668523612 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0c0043a0 con 0x7f1b1809e170 2023-10-03T10:17:11.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.900+0000 7f1b1db06700 1 -- 172.21.15.146:0/1668523612 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b1000bc80 con 0x7f1b1809e170 2023-10-03T10:17:11.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.900+0000 7f1afffff700 1 -- 172.21.15.146:0/1668523612 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c0036a0 con 0x7f1b1809e170 2023-10-03T10:17:11.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.900+0000 7f1b1db06700 1 -- 172.21.15.146:0/1668523612 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b080094a0 con 0x7f1b1809e170 2023-10-03T10:17:11.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.901+0000 7f1afffff700 1 -- 172.21.15.146:0/1668523612 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b0c003800 con 0x7f1b1809e170 2023-10-03T10:17:11.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.901+0000 7f1b1db06700 1 -- 172.21.15.146:0/1668523612 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b1804f2a0 con 0x7f1b1809e170 2023-10-03T10:17:11.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.901+0000 7f1afffff700 1 -- 172.21.15.146:0/1668523612 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1b0c03f810 con 0x7f1b1809e170 2023-10-03T10:17:11.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:11.905+0000 7f1afffff700 1 -- 172.21.15.146:0/1668523612 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b0c011350 con 0x7f1b1809e170 2023-10-03T10:17:12.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.089+0000 7f1b1db06700 1 -- 172.21.15.146:0/1668523612 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1b18120710 con 0x7f1b1809e170 2023-10-03T10:17:12.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.089+0000 7f1afffff700 1 -- 172.21.15.146:0/1668523612 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1b0c01bba0 con 0x7f1b1809e170 2023-10-03T10:17:12.090 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:12.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.091+0000 7f1b1db06700 1 -- 172.21.15.146:0/1668523612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1809e170 msgr2=0x7f1b1811d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.091+0000 7f1b1db06700 1 --2- 172.21.15.146:0/1668523612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1809e170 0x7f1b1811d5b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00ebb0 tx=0x7f1b0c00eec0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.091+0000 7f1b1db06700 1 -- 172.21.15.146:0/1668523612 shutdown_connections 2023-10-03T10:17:12.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.091+0000 7f1b1db06700 1 --2- 172.21.15.146:0/1668523612 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1b18130ce0 0x7f1b1811daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.091+0000 7f1b1db06700 1 --2- 172.21.15.146:0/1668523612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b1809d860 0x7f1b1811d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.091+0000 7f1b1db06700 1 --2- 172.21.15.146:0/1668523612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1809e170 0x7f1b1811d5b0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.091+0000 7f1b1db06700 1 -- 172.21.15.146:0/1668523612 >> 172.21.15.146:0/1668523612 conn(0x7f1b18099c40 msgr2=0x7f1b1812fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.091+0000 7f1b1db06700 1 -- 172.21.15.146:0/1668523612 shutdown_connections 2023-10-03T10:17:12.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.091+0000 7f1b1db06700 1 -- 172.21.15.146:0/1668523612 wait complete. 2023-10-03T10:17:12.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:12.558 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:12.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.684+0000 7f3280853700 1 Processor -- start 2023-10-03T10:17:12.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.684+0000 7f3280853700 1 -- start start 2023-10-03T10:17:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.684+0000 7f3280853700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f327c12feb0 0x7f327c130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.684+0000 7f3280853700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f327c099af0 0x7f327c137ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.685+0000 7f3280853700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f327c09a540 con 0x7f327c1307c0 2023-10-03T10:17:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.685+0000 7f3280853700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f327c09ad40 con 0x7f327c099af0 2023-10-03T10:17:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.685+0000 7f3280853700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327c09e640 con 0x7f327c12feb0 2023-10-03T10:17:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.685+0000 7f327a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f327c12feb0 0x7f327c130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.685+0000 7f327a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f327c12feb0 0x7f327c130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57176/0 (socket says 172.21.15.146:57176) 2023-10-03T10:17:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.685+0000 7f327ad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f327c099af0 0x7f327c137ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.685+0000 7f327a59c700 1 -- 172.21.15.146:0/1177407729 learned_addr learned my addr 172.21.15.146:0/1177407729 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.685+0000 7f327a59c700 1 -- 172.21.15.146:0/1177407729 >> v2:172.21.15.146:3300/0 conn(0x7f327c099af0 msgr2=0x7f327c137ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.685+0000 7f327a59c700 1 --2- 172.21.15.146:0/1177407729 >> v2:172.21.15.146:3300/0 conn(0x7f327c099af0 0x7f327c137ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.685+0000 7f327a59c700 1 -- 172.21.15.146:0/1177407729 >> v1:172.21.15.146:6789/0 conn(0x7f327c1307c0 legacy=0x7f327c0993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.685+0000 7f327a59c700 1 -- 172.21.15.146:0/1177407729 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c09e3c0 con 0x7f327c12feb0 2023-10-03T10:17:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.685+0000 7f327ad9d700 1 --2- 172.21.15.146:0/1177407729 >> v2:172.21.15.146:3300/0 conn(0x7f327c099af0 0x7f327c137ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.685+0000 7f327a59c700 1 --2- 172.21.15.146:0/1177407729 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f327c12feb0 0x7f327c130280 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f326c006fd0 tx=0x7f326c00be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3898e3149893429 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.685+0000 7f327959a700 1 -- 172.21.15.146:0/1177407729 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c005e30 con 0x7f327c12feb0 2023-10-03T10:17:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.685+0000 7f327959a700 1 -- 172.21.15.146:0/1177407729 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326c004030 con 0x7f327c12feb0 2023-10-03T10:17:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.685+0000 7f327959a700 1 -- 172.21.15.146:0/1177407729 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c0043e0 con 0x7f327c12feb0 2023-10-03T10:17:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.686+0000 7f3280853700 1 -- 172.21.15.146:0/1177407729 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f327c12feb0 msgr2=0x7f327c130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.686+0000 7f3280853700 1 --2- 172.21.15.146:0/1177407729 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f327c12feb0 0x7f327c130280 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f326c006fd0 tx=0x7f326c00be70 comp rx=0 tx=0).stop 2023-10-03T10:17:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.686+0000 7f3280853700 1 -- 172.21.15.146:0/1177407729 shutdown_connections 2023-10-03T10:17:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.686+0000 7f3280853700 1 --2- 172.21.15.146:0/1177407729 >> v2:172.21.15.146:3300/0 conn(0x7f327c099af0 0x7f327c137ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.686+0000 7f3280853700 1 --2- 172.21.15.146:0/1177407729 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f327c12feb0 0x7f327c130280 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.686+0000 7f3280853700 1 -- 172.21.15.146:0/1177407729 >> 172.21.15.146:0/1177407729 conn(0x7f327c0a2b30 msgr2=0x7f327c09e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.686+0000 7f3280853700 1 -- 172.21.15.146:0/1177407729 shutdown_connections 2023-10-03T10:17:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.686+0000 7f3280853700 1 -- 172.21.15.146:0/1177407729 wait complete. 2023-10-03T10:17:12.690 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:12.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.687+0000 7f3280853700 1 Processor -- start 2023-10-03T10:17:12.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.687+0000 7f3280853700 1 -- start start 2023-10-03T10:17:12.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.687+0000 7f3280853700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f327c099af0 0x7f327c098410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.687+0000 7f3280853700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f327c12feb0 0x7f327c098950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.687+0000 7f3280853700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c1307c0 0x7f327c1c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.687+0000 7f3280853700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c06e8b0 con 0x7f327c1307c0 2023-10-03T10:17:12.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.687+0000 7f3280853700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327c06d8a0 con 0x7f327c099af0 2023-10-03T10:17:12.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.687+0000 7f3280853700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f327c12a230 con 0x7f327c12feb0 2023-10-03T10:17:12.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.687+0000 7f327a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f327c099af0 0x7f327c098410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.687+0000 7f327ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c1307c0 0x7f327c1c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.687+0000 7f3279d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f327c12feb0 0x7f327c098950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.688+0000 7f327a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f327c099af0 0x7f327c098410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57192/0 (socket says 172.21.15.146:57192) 2023-10-03T10:17:12.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.688+0000 7f327ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c1307c0 0x7f327c1c41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33052/0 (socket says 172.21.15.146:33052) 2023-10-03T10:17:12.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.688+0000 7f327a59c700 1 -- 172.21.15.146:0/4063759403 learned_addr learned my addr 172.21.15.146:0/4063759403 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:12.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.688+0000 7f3279d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f327c12feb0 0x7f327c098950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57202/0 (socket says 172.21.15.146:57202) 2023-10-03T10:17:12.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.688+0000 7f327a59c700 1 -- 172.21.15.146:0/4063759403 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f327c12feb0 msgr2=0x7f327c098950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.688+0000 7f327a59c700 1 --2- 172.21.15.146:0/4063759403 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f327c12feb0 0x7f327c098950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.688+0000 7f327a59c700 1 -- 172.21.15.146:0/4063759403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c1307c0 msgr2=0x7f327c1c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.688+0000 7f327a59c700 1 --2- 172.21.15.146:0/4063759403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c1307c0 0x7f327c1c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.688+0000 7f327a59c700 1 -- 172.21.15.146:0/4063759403 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3274009a70 con 0x7f327c099af0 2023-10-03T10:17:12.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.688+0000 7f327ad9d700 1 --2- 172.21.15.146:0/4063759403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c1307c0 0x7f327c1c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:12.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.688+0000 7f327a59c700 1 --2- 172.21.15.146:0/4063759403 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f327c099af0 0x7f327c098410 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f326c00b340 tx=0x7f326c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.688+0000 7f326affd700 1 -- 172.21.15.146:0/4063759403 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c003ab0 con 0x7f327c099af0 2023-10-03T10:17:12.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.688+0000 7f326affd700 1 -- 172.21.15.146:0/4063759403 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326c003c10 con 0x7f327c099af0 2023-10-03T10:17:12.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.688+0000 7f3280853700 1 -- 172.21.15.146:0/4063759403 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f326c00b7a0 con 0x7f327c099af0 2023-10-03T10:17:12.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.688+0000 7f326affd700 1 -- 172.21.15.146:0/4063759403 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c010470 con 0x7f327c099af0 2023-10-03T10:17:12.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.688+0000 7f3280853700 1 -- 172.21.15.146:0/4063759403 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f327c0a18e0 con 0x7f327c099af0 2023-10-03T10:17:12.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.689+0000 7f326affd700 1 -- 172.21.15.146:0/4063759403 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f326c0193f0 con 0x7f327c099af0 2023-10-03T10:17:12.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.689+0000 7f326affd700 1 -- 172.21.15.146:0/4063759403 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f326c042a70 con 0x7f327c099af0 2023-10-03T10:17:12.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.689+0000 7f3280853700 1 -- 172.21.15.146:0/4063759403 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f327c12d6c0 con 0x7f327c099af0 2023-10-03T10:17:12.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.694+0000 7f326affd700 1 -- 172.21.15.146:0/4063759403 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f326c006c00 con 0x7f327c099af0 2023-10-03T10:17:12.731 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:12.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.821+0000 7fb59f034700 1 Processor -- start 2023-10-03T10:17:12.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.821+0000 7fb59f034700 1 -- start start 2023-10-03T10:17:12.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.821+0000 7fb59f034700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb5981309f0 0x7fb598130dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.821+0000 7fb59f034700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb59809d8f0 0x7fb59809dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.821+0000 7fb59f034700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb59809c1f0 con 0x7fb59809e280 2023-10-03T10:17:12.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.821+0000 7fb59f034700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59806dc20 con 0x7fb5981309f0 2023-10-03T10:17:12.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.821+0000 7fb59f034700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59809b1f0 con 0x7fb59809d8f0 2023-10-03T10:17:12.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.822+0000 7fb597fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb59809d8f0 0x7fb59809dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.822+0000 7fb59cdd0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb5981309f0 0x7fb598130dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.822+0000 7fb597fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb59809d8f0 0x7fb59809dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57202/0 (socket says 172.21.15.146:57202) 2023-10-03T10:17:12.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.822+0000 7fb597fff700 1 -- 172.21.15.146:0/278204018 learned_addr learned my addr 172.21.15.146:0/278204018 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:12.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.822+0000 7fb597fff700 1 -- 172.21.15.146:0/278204018 >> v2:172.21.15.146:3300/0 conn(0x7fb5981309f0 msgr2=0x7fb598130dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:12.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.822+0000 7fb597fff700 1 --2- 172.21.15.146:0/278204018 >> v2:172.21.15.146:3300/0 conn(0x7fb5981309f0 0x7fb598130dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.822+0000 7fb597fff700 1 -- 172.21.15.146:0/278204018 >> v1:172.21.15.146:6789/0 conn(0x7fb59809e280 legacy=0x7fb598137750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.822+0000 7fb597fff700 1 -- 172.21.15.146:0/278204018 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59809e700 con 0x7fb59809d8f0 2023-10-03T10:17:12.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.822+0000 7fb5977fe700 1 -- 172.21.15.146:0/278204018 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1314522997 0 0) 0x7fb59809c1f0 con 0x7fb59809e280 2023-10-03T10:17:12.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.822+0000 7fb59cdd0700 1 --2- 172.21.15.146:0/278204018 >> v2:172.21.15.146:3300/0 conn(0x7fb5981309f0 0x7fb598130dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:12.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.822+0000 7fb597fff700 1 --2- 172.21.15.146:0/278204018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb59809d8f0 0x7fb59809dd40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb5840098f0 tx=0x7fb584009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ab97177fead8e87 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.822+0000 7fb5977fe700 1 -- 172.21.15.146:0/278204018 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb584011830 con 0x7fb59809d8f0 2023-10-03T10:17:12.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.822+0000 7fb5977fe700 1 -- 172.21.15.146:0/278204018 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb584011990 con 0x7fb59809d8f0 2023-10-03T10:17:12.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.822+0000 7fb5977fe700 1 -- 172.21.15.146:0/278204018 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb584011d20 con 0x7fb59809d8f0 2023-10-03T10:17:12.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.823+0000 7fb59f034700 1 -- 172.21.15.146:0/278204018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb59809d8f0 msgr2=0x7fb59809dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.823+0000 7fb59f034700 1 --2- 172.21.15.146:0/278204018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb59809d8f0 0x7fb59809dd40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb5840098f0 tx=0x7fb584009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:12.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.823+0000 7fb59f034700 1 -- 172.21.15.146:0/278204018 shutdown_connections 2023-10-03T10:17:12.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.823+0000 7fb59f034700 1 --2- 172.21.15.146:0/278204018 >> v2:172.21.15.146:3300/0 conn(0x7fb5981309f0 0x7fb598130dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.823+0000 7fb59f034700 1 --2- 172.21.15.146:0/278204018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb59809d8f0 0x7fb59809dd40 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.823+0000 7fb59f034700 1 -- 172.21.15.146:0/278204018 >> 172.21.15.146:0/278204018 conn(0x7fb5980a2b30 msgr2=0x7fb59809e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.823+0000 7fb59f034700 1 -- 172.21.15.146:0/278204018 shutdown_connections 2023-10-03T10:17:12.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.823+0000 7fb59f034700 1 -- 172.21.15.146:0/278204018 wait complete. 2023-10-03T10:17:12.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.824+0000 7fb59f034700 1 Processor -- start 2023-10-03T10:17:12.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.824+0000 7fb59f034700 1 -- start start 2023-10-03T10:17:12.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.825+0000 7fb59f034700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb59809d8f0 0x7fb59812ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.825+0000 7fb59f034700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb59809e280 0x7fb59812d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.825+0000 7fb59f034700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5981309f0 0x7fb59812d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.825+0000 7fb59f034700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59809a3b0 con 0x7fb5981309f0 2023-10-03T10:17:12.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.825+0000 7fb59f034700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59808c190 con 0x7fb59809d8f0 2023-10-03T10:17:12.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.825+0000 7fb59f034700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5980a1760 con 0x7fb59809e280 2023-10-03T10:17:12.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.825+0000 7fb597fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb59809e280 0x7fb59812d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.825+0000 7fb597fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb59809e280 0x7fb59812d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57216/0 (socket says 172.21.15.146:57216) 2023-10-03T10:17:12.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.825+0000 7fb597fff700 1 -- 172.21.15.146:0/3539233608 learned_addr learned my addr 172.21.15.146:0/3539233608 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:12.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.825+0000 7fb59cdd0700 1 --2- 172.21.15.146:0/3539233608 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb59809d8f0 0x7fb59812ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.825+0000 7fb59d5d1700 1 --2- 172.21.15.146:0/3539233608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5981309f0 0x7fb59812d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.826+0000 7fb597fff700 1 -- 172.21.15.146:0/3539233608 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb59809d8f0 msgr2=0x7fb59812ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.826+0000 7fb597fff700 1 --2- 172.21.15.146:0/3539233608 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb59809d8f0 0x7fb59812ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.826+0000 7fb597fff700 1 -- 172.21.15.146:0/3539233608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5981309f0 msgr2=0x7fb59812d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.826+0000 7fb597fff700 1 --2- 172.21.15.146:0/3539233608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5981309f0 0x7fb59812d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.826+0000 7fb597fff700 1 -- 172.21.15.146:0/3539233608 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58c009430 con 0x7fb59809e280 2023-10-03T10:17:12.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.826+0000 7fb597fff700 1 --2- 172.21.15.146:0/3539233608 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb59809e280 0x7fb59812d3a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb584009130 tx=0x7fb584004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.826+0000 7fb5957fa700 1 -- 172.21.15.146:0/3539233608 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb584004510 con 0x7fb59809e280 2023-10-03T10:17:12.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.826+0000 7fb5957fa700 1 -- 172.21.15.146:0/3539233608 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58401e070 con 0x7fb59809e280 2023-10-03T10:17:12.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.826+0000 7fb59f034700 1 -- 172.21.15.146:0/3539233608 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb584009550 con 0x7fb59809e280 2023-10-03T10:17:12.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.826+0000 7fb5957fa700 1 -- 172.21.15.146:0/3539233608 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5840038c0 con 0x7fb59809e280 2023-10-03T10:17:12.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.826+0000 7fb59f034700 1 -- 172.21.15.146:0/3539233608 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb59808bec0 con 0x7fb59809e280 2023-10-03T10:17:12.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.827+0000 7fb59f034700 1 -- 172.21.15.146:0/3539233608 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb59808ba70 con 0x7fb59809e280 2023-10-03T10:17:12.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.827+0000 7fb5957fa700 1 -- 172.21.15.146:0/3539233608 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb584003a20 con 0x7fb59809e280 2023-10-03T10:17:12.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.827+0000 7fb5957fa700 1 -- 172.21.15.146:0/3539233608 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb584040660 con 0x7fb59809e280 2023-10-03T10:17:12.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.832+0000 7fb5957fa700 1 -- 172.21.15.146:0/3539233608 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb584003cd0 con 0x7fb59809e280 2023-10-03T10:17:12.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.863+0000 7f4f0cc30700 1 Processor -- start 2023-10-03T10:17:12.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.863+0000 7f4f0cc30700 1 -- start start 2023-10-03T10:17:12.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.864+0000 7f4f0cc30700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f080a1550 0x7f4f08138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.864+0000 7f4f0cc30700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4f08139200 0x7f4f0813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.864+0000 7f4f0cc30700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0809e9d0 con 0x7f4f080a0a70 2023-10-03T10:17:12.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.864+0000 7f4f0cc30700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0809dc00 con 0x7f4f08139200 2023-10-03T10:17:12.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.864+0000 7f4f0cc30700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0809dec0 con 0x7f4f080a1550 2023-10-03T10:17:12.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.864+0000 7f4f05d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f080a1550 0x7f4f08138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.864+0000 7f4f0659c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4f080a0a70 0x7f4f080a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44744/0 (socket says 172.21.15.146:44744) 2023-10-03T10:17:12.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.864+0000 7f4f06d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4f08139200 0x7f4f0813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.864+0000 7f4f0659c700 1 -- 172.21.15.146:0/3539105276 learned_addr learned my addr 172.21.15.146:0/3539105276 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:12.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.864+0000 7f4f06d9d700 1 -- 172.21.15.146:0/3539105276 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f080a1550 msgr2=0x7f4f08138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:12.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.864+0000 7f4f06d9d700 1 --2- 172.21.15.146:0/3539105276 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f080a1550 0x7f4f08138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.864+0000 7f4f06d9d700 1 -- 172.21.15.146:0/3539105276 >> v1:172.21.15.146:6789/0 conn(0x7f4f080a0a70 legacy=0x7f4f080a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.864+0000 7f4f06d9d700 1 -- 172.21.15.146:0/3539105276 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0809e6a0 con 0x7f4f08139200 2023-10-03T10:17:12.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.864+0000 7f4f0559a700 1 -- 172.21.15.146:0/3539105276 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2887649614 0 0) 0x7f4f0809e9d0 con 0x7f4f080a0a70 2023-10-03T10:17:12.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.864+0000 7f4f05d9b700 1 --2- 172.21.15.146:0/3539105276 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f080a1550 0x7f4f08138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:12.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.865+0000 7f4f06d9d700 1 --2- 172.21.15.146:0/3539105276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f08139200 0x7f4f0813b5e0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f4f00009d90 tx=0x7f4f0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de36ae0c36e2298a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.865+0000 7f4f0559a700 1 -- 172.21.15.146:0/3539105276 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0000e070 con 0x7f4f08139200 2023-10-03T10:17:12.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.865+0000 7f4f0559a700 1 -- 172.21.15.146:0/3539105276 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0000bb20 con 0x7f4f08139200 2023-10-03T10:17:12.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.865+0000 7f4f0559a700 1 -- 172.21.15.146:0/3539105276 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f00012430 con 0x7f4f08139200 2023-10-03T10:17:12.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.865+0000 7f4f0cc30700 1 -- 172.21.15.146:0/3539105276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f08139200 msgr2=0x7f4f0813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.865+0000 7f4f0cc30700 1 --2- 172.21.15.146:0/3539105276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f08139200 0x7f4f0813b5e0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f4f00009d90 tx=0x7f4f0000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:12.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.865+0000 7f4f0cc30700 1 -- 172.21.15.146:0/3539105276 shutdown_connections 2023-10-03T10:17:12.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.865+0000 7f4f0cc30700 1 --2- 172.21.15.146:0/3539105276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f08139200 0x7f4f0813b5e0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.865+0000 7f4f0cc30700 1 --2- 172.21.15.146:0/3539105276 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f080a1550 0x7f4f08138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.865+0000 7f4f0cc30700 1 -- 172.21.15.146:0/3539105276 >> 172.21.15.146:0/3539105276 conn(0x7f4f080a6610 msgr2=0x7f4f080a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.865+0000 7f4f0cc30700 1 -- 172.21.15.146:0/3539105276 shutdown_connections 2023-10-03T10:17:12.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.865+0000 7f4f0cc30700 1 -- 172.21.15.146:0/3539105276 wait complete. 2023-10-03T10:17:12.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.867+0000 7f4f0cc30700 1 Processor -- start 2023-10-03T10:17:12.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.867+0000 7f4f0cc30700 1 -- start start 2023-10-03T10:17:12.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.867+0000 7f4f0cc30700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f080a0a70 0x7f4f08121760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.867+0000 7f4f0cc30700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f080a1550 0x7f4f08121ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.867+0000 7f4f0cc30700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f08139200 0x7f4f081221e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.867+0000 7f4f0cc30700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f08125280 con 0x7f4f08139200 2023-10-03T10:17:12.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.867+0000 7f4f0cc30700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f08123990 con 0x7f4f080a1550 2023-10-03T10:17:12.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.867+0000 7f4f0cc30700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f080a03e0 con 0x7f4f080a0a70 2023-10-03T10:17:12.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.868+0000 7f4f0659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f080a0a70 0x7f4f08121760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.868+0000 7f4f06d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f08139200 0x7f4f081221e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.868+0000 7f4f0659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f080a0a70 0x7f4f08121760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57232/0 (socket says 172.21.15.146:57232) 2023-10-03T10:17:12.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.868+0000 7f4f0659c700 1 -- 172.21.15.146:0/2238673220 learned_addr learned my addr 172.21.15.146:0/2238673220 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:12.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.868+0000 7f4f06d9d700 1 --2- 172.21.15.146:0/2238673220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f08139200 0x7f4f081221e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33078/0 (socket says 172.21.15.146:33078) 2023-10-03T10:17:12.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.868+0000 7f4f05d9b700 1 --2- 172.21.15.146:0/2238673220 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f080a1550 0x7f4f08121ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.868+0000 7f4f0659c700 1 -- 172.21.15.146:0/2238673220 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f080a1550 msgr2=0x7f4f08121ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.868+0000 7f4f0659c700 1 --2- 172.21.15.146:0/2238673220 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f080a1550 0x7f4f08121ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.868+0000 7f4f0659c700 1 -- 172.21.15.146:0/2238673220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f08139200 msgr2=0x7f4f081221e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.868+0000 7f4f0659c700 1 --2- 172.21.15.146:0/2238673220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f08139200 0x7f4f081221e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.868+0000 7f4f0659c700 1 -- 172.21.15.146:0/2238673220 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4efc0094a0 con 0x7f4f080a0a70 2023-10-03T10:17:12.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.868+0000 7f4f06d9d700 1 --2- 172.21.15.146:0/2238673220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f08139200 0x7f4f081221e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:12.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.868+0000 7f4f0659c700 1 --2- 172.21.15.146:0/2238673220 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f080a0a70 0x7f4f08121760 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f4ef800c520 tx=0x7f4ef800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.868+0000 7f4ef6ffd700 1 -- 172.21.15.146:0/2238673220 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8004c80 con 0x7f4f080a0a70 2023-10-03T10:17:12.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.868+0000 7f4ef6ffd700 1 -- 172.21.15.146:0/2238673220 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef8004de0 con 0x7f4f080a0a70 2023-10-03T10:17:12.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.868+0000 7f4f0cc30700 1 -- 172.21.15.146:0/2238673220 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f00009a70 con 0x7f4f080a0a70 2023-10-03T10:17:12.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.868+0000 7f4ef6ffd700 1 -- 172.21.15.146:0/2238673220 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8007310 con 0x7f4f080a0a70 2023-10-03T10:17:12.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.868+0000 7f4f0cc30700 1 -- 172.21.15.146:0/2238673220 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f08124ce0 con 0x7f4f080a0a70 2023-10-03T10:17:12.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.869+0000 7f4ef6ffd700 1 -- 172.21.15.146:0/2238673220 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ef8007470 con 0x7f4f080a0a70 2023-10-03T10:17:12.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.869+0000 7f4f0cc30700 1 -- 172.21.15.146:0/2238673220 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0804f2a0 con 0x7f4f080a0a70 2023-10-03T10:17:12.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.870+0000 7f4ef6ffd700 1 -- 172.21.15.146:0/2238673220 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4ef803f3b0 con 0x7f4f080a0a70 2023-10-03T10:17:12.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.875+0000 7f4ef6ffd700 1 -- 172.21.15.146:0/2238673220 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ef80133c0 con 0x7f4f080a0a70 2023-10-03T10:17:12.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.894+0000 7f3280853700 1 -- 172.21.15.146:0/4063759403 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f327c06f150 con 0x7f327c099af0 2023-10-03T10:17:12.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.895+0000 7f326affd700 1 -- 172.21.15.146:0/4063759403 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f327c06f150 con 0x7f327c099af0 2023-10-03T10:17:12.896 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:12.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.897+0000 7f3280853700 1 -- 172.21.15.146:0/4063759403 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f327c099af0 msgr2=0x7f327c098410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.897+0000 7f3280853700 1 --2- 172.21.15.146:0/4063759403 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f327c099af0 0x7f327c098410 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f326c00b340 tx=0x7f326c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:12.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.897+0000 7f3280853700 1 -- 172.21.15.146:0/4063759403 shutdown_connections 2023-10-03T10:17:12.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.897+0000 7f3280853700 1 --2- 172.21.15.146:0/4063759403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c1307c0 0x7f327c1c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.897+0000 7f3280853700 1 --2- 172.21.15.146:0/4063759403 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f327c099af0 0x7f327c098410 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.897+0000 7f3280853700 1 --2- 172.21.15.146:0/4063759403 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f327c12feb0 0x7f327c098950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.897+0000 7f3280853700 1 -- 172.21.15.146:0/4063759403 >> 172.21.15.146:0/4063759403 conn(0x7f327c0a2b30 msgr2=0x7f327c12e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.897+0000 7f3280853700 1 -- 172.21.15.146:0/4063759403 shutdown_connections 2023-10-03T10:17:12.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:12.897+0000 7f3280853700 1 -- 172.21.15.146:0/4063759403 wait complete. 2023-10-03T10:17:12.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:13.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.023+0000 7fb59f034700 1 -- 172.21.15.146:0/3539233608 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb59804f2a0 con 0x7fb59809e280 2023-10-03T10:17:13.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.023+0000 7fb5957fa700 1 -- 172.21.15.146:0/3539233608 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb584015030 con 0x7fb59809e280 2023-10-03T10:17:13.024 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:13.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.025+0000 7fb59f034700 1 -- 172.21.15.146:0/3539233608 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb59809e280 msgr2=0x7fb59812d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.025+0000 7fb59f034700 1 --2- 172.21.15.146:0/3539233608 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb59809e280 0x7fb59812d3a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb584009130 tx=0x7fb584004750 comp rx=0 tx=0).stop 2023-10-03T10:17:13.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.026+0000 7fb59f034700 1 -- 172.21.15.146:0/3539233608 shutdown_connections 2023-10-03T10:17:13.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.026+0000 7fb59f034700 1 --2- 172.21.15.146:0/3539233608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5981309f0 0x7fb59812d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.026+0000 7fb59f034700 1 --2- 172.21.15.146:0/3539233608 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb59809d8f0 0x7fb59812ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.026+0000 7fb59f034700 1 --2- 172.21.15.146:0/3539233608 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb59809e280 0x7fb59812d3a0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.026+0000 7fb59f034700 1 -- 172.21.15.146:0/3539233608 >> 172.21.15.146:0/3539233608 conn(0x7fb5980a2b30 msgr2=0x7fb59809fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.026+0000 7fb59f034700 1 -- 172.21.15.146:0/3539233608 shutdown_connections 2023-10-03T10:17:13.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.026+0000 7fb59f034700 1 -- 172.21.15.146:0/3539233608 wait complete. 2023-10-03T10:17:13.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:13.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.067+0000 7f4f0cc30700 1 -- 172.21.15.146:0/2238673220 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4f08072980 con 0x7f4f080a0a70 2023-10-03T10:17:13.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.067+0000 7f4ef6ffd700 1 -- 172.21.15.146:0/2238673220 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ef80102c0 con 0x7f4f080a0a70 2023-10-03T10:17:13.068 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:13.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.069+0000 7f4f0cc30700 1 -- 172.21.15.146:0/2238673220 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f080a0a70 msgr2=0x7f4f08121760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.069+0000 7f4f0cc30700 1 --2- 172.21.15.146:0/2238673220 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f080a0a70 0x7f4f08121760 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f4ef800c520 tx=0x7f4ef800c830 comp rx=0 tx=0).stop 2023-10-03T10:17:13.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.069+0000 7f4f0cc30700 1 -- 172.21.15.146:0/2238673220 shutdown_connections 2023-10-03T10:17:13.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.069+0000 7f4f0cc30700 1 --2- 172.21.15.146:0/2238673220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f08139200 0x7f4f081221e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.069+0000 7f4f0cc30700 1 --2- 172.21.15.146:0/2238673220 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4f080a0a70 0x7f4f08121760 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.069+0000 7f4f0cc30700 1 --2- 172.21.15.146:0/2238673220 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f080a1550 0x7f4f08121ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.069+0000 7f4f0cc30700 1 -- 172.21.15.146:0/2238673220 >> 172.21.15.146:0/2238673220 conn(0x7f4f080a6610 msgr2=0x7f4f080a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.069+0000 7f4f0cc30700 1 -- 172.21.15.146:0/2238673220 shutdown_connections 2023-10-03T10:17:13.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.069+0000 7f4f0cc30700 1 -- 172.21.15.146:0/2238673220 wait complete. 2023-10-03T10:17:13.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:13.105 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:13.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.244+0000 7f9fed727700 1 Processor -- start 2023-10-03T10:17:13.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.244+0000 7f9fed727700 1 -- start start 2023-10-03T10:17:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.245+0000 7f9fed727700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9fe80a1510 0x7f9fe81351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.245+0000 7f9fed727700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fe81356e0 0x7f9fe8137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.245+0000 7f9fed727700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe80a1e70 con 0x7f9fe80a0a30 2023-10-03T10:17:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.245+0000 7f9fed727700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe809a720 con 0x7f9fe80a1510 2023-10-03T10:17:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.245+0000 7f9fed727700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe809b300 con 0x7f9fe81356e0 2023-10-03T10:17:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.245+0000 7f9fe77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fe81356e0 0x7f9fe8137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.245+0000 7f9fe67fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9fe80a1510 0x7f9fe81351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.245+0000 7f9fe77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fe81356e0 0x7f9fe8137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57230/0 (socket says 172.21.15.146:57230) 2023-10-03T10:17:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.245+0000 7f9fe77fe700 1 -- 172.21.15.146:0/515623261 learned_addr learned my addr 172.21.15.146:0/515623261 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.245+0000 7f9fe6ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9fe80a0a30 0x7f9fe80a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44754/0 (socket says 172.21.15.146:44754) 2023-10-03T10:17:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.245+0000 7f9fe67fc700 1 -- 172.21.15.146:0/515623261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fe81356e0 msgr2=0x7f9fe8137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.245+0000 7f9fe67fc700 1 --2- 172.21.15.146:0/515623261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fe81356e0 0x7f9fe8137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.245+0000 7f9fe67fc700 1 -- 172.21.15.146:0/515623261 >> v1:172.21.15.146:6789/0 conn(0x7f9fe80a0a30 legacy=0x7f9fe80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.245+0000 7f9fe67fc700 1 -- 172.21.15.146:0/515623261 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe809abc0 con 0x7f9fe80a1510 2023-10-03T10:17:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.245+0000 7f9fe5ffb700 1 -- 172.21.15.146:0/515623261 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646140099 0 0) 0x7f9fe80a1e70 con 0x7f9fe80a0a30 2023-10-03T10:17:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.245+0000 7f9fe77fe700 1 --2- 172.21.15.146:0/515623261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fe81356e0 0x7f9fe8137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.245+0000 7f9fe67fc700 1 --2- 172.21.15.146:0/515623261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fe80a1510 0x7f9fe81351a0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800bae0 tx=0x7f9fd800bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63be2a6124de239 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.246+0000 7f9fe5ffb700 1 -- 172.21.15.146:0/515623261 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd800dc70 con 0x7f9fe80a1510 2023-10-03T10:17:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.246+0000 7f9fe5ffb700 1 -- 172.21.15.146:0/515623261 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd800ddd0 con 0x7f9fe80a1510 2023-10-03T10:17:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.246+0000 7f9fe5ffb700 1 -- 172.21.15.146:0/515623261 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8010690 con 0x7f9fe80a1510 2023-10-03T10:17:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.246+0000 7f9fed727700 1 -- 172.21.15.146:0/515623261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fe80a1510 msgr2=0x7f9fe81351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.246+0000 7f9fed727700 1 --2- 172.21.15.146:0/515623261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fe80a1510 0x7f9fe81351a0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800bae0 tx=0x7f9fd800bdf0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.246+0000 7f9fed727700 1 -- 172.21.15.146:0/515623261 shutdown_connections 2023-10-03T10:17:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.246+0000 7f9fed727700 1 --2- 172.21.15.146:0/515623261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fe81356e0 0x7f9fe8137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.246+0000 7f9fed727700 1 --2- 172.21.15.146:0/515623261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fe80a1510 0x7f9fe81351a0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.246+0000 7f9fed727700 1 -- 172.21.15.146:0/515623261 >> 172.21.15.146:0/515623261 conn(0x7f9fe80a2980 msgr2=0x7f9fe80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.246+0000 7f9fed727700 1 -- 172.21.15.146:0/515623261 shutdown_connections 2023-10-03T10:17:13.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.246+0000 7f9fed727700 1 -- 172.21.15.146:0/515623261 wait complete. 2023-10-03T10:17:13.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.247+0000 7f9fed727700 1 Processor -- start 2023-10-03T10:17:13.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.247+0000 7f9fed727700 1 -- start start 2023-10-03T10:17:13.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fed727700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fe80a0a30 0x7f9fe8118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fed727700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fe80a1510 0x7f9fe8119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fed727700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fe81356e0 0x7f9fe8119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fed727700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe811bc10 con 0x7f9fe80a0a30 2023-10-03T10:17:13.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fed727700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe8119f70 con 0x7f9fe80a1510 2023-10-03T10:17:13.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fed727700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe809fce0 con 0x7f9fe81356e0 2023-10-03T10:17:13.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fe6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fe80a0a30 0x7f9fe8118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fe6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fe80a0a30 0x7f9fe8118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33098/0 (socket says 172.21.15.146:33098) 2023-10-03T10:17:13.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fe6ffd700 1 -- 172.21.15.146:0/1461758190 learned_addr learned my addr 172.21.15.146:0/1461758190 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:13.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fe67fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fe80a1510 0x7f9fe8119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fe77fe700 1 --2- 172.21.15.146:0/1461758190 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fe81356e0 0x7f9fe8119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fe6ffd700 1 -- 172.21.15.146:0/1461758190 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fe81356e0 msgr2=0x7f9fe8119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fe6ffd700 1 --2- 172.21.15.146:0/1461758190 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fe81356e0 0x7f9fe8119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fe6ffd700 1 -- 172.21.15.146:0/1461758190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fe80a1510 msgr2=0x7f9fe8119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fe6ffd700 1 --2- 172.21.15.146:0/1461758190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fe80a1510 0x7f9fe8119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fe6ffd700 1 -- 172.21.15.146:0/1461758190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe0009b30 con 0x7f9fe80a0a30 2023-10-03T10:17:13.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fe67fc700 1 --2- 172.21.15.146:0/1461758190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fe80a1510 0x7f9fe8119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:13.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fe6ffd700 1 --2- 172.21.15.146:0/1461758190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fe80a0a30 0x7f9fe8118df0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00c520 tx=0x7f9fdc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fcf7fe700 1 -- 172.21.15.146:0/1461758190 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc0074e0 con 0x7f9fe80a0a30 2023-10-03T10:17:13.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fcf7fe700 1 -- 172.21.15.146:0/1461758190 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc007640 con 0x7f9fe80a0a30 2023-10-03T10:17:13.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fed727700 1 -- 172.21.15.146:0/1461758190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd800b740 con 0x7f9fe80a0a30 2023-10-03T10:17:13.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fcf7fe700 1 -- 172.21.15.146:0/1461758190 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc005a70 con 0x7f9fe80a0a30 2023-10-03T10:17:13.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.248+0000 7f9fed727700 1 -- 172.21.15.146:0/1461758190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe809ae50 con 0x7f9fe80a0a30 2023-10-03T10:17:13.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.249+0000 7f9fcf7fe700 1 -- 172.21.15.146:0/1461758190 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9fdc005bd0 con 0x7f9fe80a0a30 2023-10-03T10:17:13.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.249+0000 7f9fcf7fe700 1 -- 172.21.15.146:0/1461758190 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9fdc03ea80 con 0x7f9fe80a0a30 2023-10-03T10:17:13.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.249+0000 7f9fed727700 1 -- 172.21.15.146:0/1461758190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe804f2a0 con 0x7f9fe80a0a30 2023-10-03T10:17:13.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.254+0000 7f9fcf7fe700 1 -- 172.21.15.146:0/1461758190 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9fdc017080 con 0x7f9fe80a0a30 2023-10-03T10:17:13.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.437+0000 7f9fed727700 1 -- 172.21.15.146:0/1461758190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9fe806bce0 con 0x7f9fe80a0a30 2023-10-03T10:17:13.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.437+0000 7f9fcf7fe700 1 -- 172.21.15.146:0/1461758190 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9fdc00f260 con 0x7f9fe80a0a30 2023-10-03T10:17:13.438 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:13.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.439+0000 7f9fed727700 1 -- 172.21.15.146:0/1461758190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fe80a0a30 msgr2=0x7f9fe8118df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.439+0000 7f9fed727700 1 --2- 172.21.15.146:0/1461758190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fe80a0a30 0x7f9fe8118df0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00c520 tx=0x7f9fdc00c830 comp rx=0 tx=0).stop 2023-10-03T10:17:13.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.439+0000 7f9fed727700 1 -- 172.21.15.146:0/1461758190 shutdown_connections 2023-10-03T10:17:13.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.439+0000 7f9fed727700 1 --2- 172.21.15.146:0/1461758190 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9fe81356e0 0x7f9fe8119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.439+0000 7f9fed727700 1 --2- 172.21.15.146:0/1461758190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fe80a0a30 0x7f9fe8118df0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.439+0000 7f9fed727700 1 --2- 172.21.15.146:0/1461758190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fe80a1510 0x7f9fe8119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.439+0000 7f9fed727700 1 -- 172.21.15.146:0/1461758190 >> 172.21.15.146:0/1461758190 conn(0x7f9fe80a2980 msgr2=0x7f9fe81306c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.439+0000 7f9fed727700 1 -- 172.21.15.146:0/1461758190 shutdown_connections 2023-10-03T10:17:13.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:13.439+0000 7f9fed727700 1 -- 172.21.15.146:0/1461758190 wait complete. 2023-10-03T10:17:13.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:13.911 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:14.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.035+0000 7fd697346700 1 Processor -- start 2023-10-03T10:17:14.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.035+0000 7fd697346700 1 -- start start 2023-10-03T10:17:14.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.035+0000 7fd697346700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd69009d860 0x7fd69009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.035+0000 7fd697346700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd69009e170 0x7fd6901307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.035+0000 7fd697346700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd690130ce0 0x7fd690131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.035+0000 7fd697346700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd690131670 con 0x7fd69009d860 2023-10-03T10:17:14.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.035+0000 7fd697346700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69009aaa0 con 0x7fd690130ce0 2023-10-03T10:17:14.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.035+0000 7fd697346700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd69009f870 con 0x7fd69009e170 2023-10-03T10:17:14.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.036+0000 7fd6948e1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd69009e170 0x7fd6901307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.036+0000 7fd6950e2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd69009d860 0x7fd69009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.036+0000 7fd6958e3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd690130ce0 0x7fd690131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.036+0000 7fd6950e2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd69009d860 0x7fd69009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33112/0 (socket says 172.21.15.146:33112) 2023-10-03T10:17:14.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.036+0000 7fd6948e1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd69009e170 0x7fd6901307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57258/0 (socket says 172.21.15.146:57258) 2023-10-03T10:17:14.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.036+0000 7fd6950e2700 1 -- 172.21.15.146:0/3852496228 learned_addr learned my addr 172.21.15.146:0/3852496228 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:14.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.036+0000 7fd6948e1700 1 -- 172.21.15.146:0/3852496228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd690130ce0 msgr2=0x7fd690131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:14.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.036+0000 7fd6948e1700 1 --2- 172.21.15.146:0/3852496228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd690130ce0 0x7fd690131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.036+0000 7fd6948e1700 1 -- 172.21.15.146:0/3852496228 >> v2:172.21.15.146:3300/0 conn(0x7fd69009d860 msgr2=0x7fd69009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:14.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.036+0000 7fd6948e1700 1 --2- 172.21.15.146:0/3852496228 >> v2:172.21.15.146:3300/0 conn(0x7fd69009d860 0x7fd69009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.036+0000 7fd6948e1700 1 -- 172.21.15.146:0/3852496228 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69009b360 con 0x7fd69009e170 2023-10-03T10:17:14.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.036+0000 7fd6958e3700 1 --2- 172.21.15.146:0/3852496228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd690130ce0 0x7fd690131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.036+0000 7fd6950e2700 1 --2- 172.21.15.146:0/3852496228 >> v2:172.21.15.146:3300/0 conn(0x7fd69009d860 0x7fd69009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.036+0000 7fd6948e1700 1 --2- 172.21.15.146:0/3852496228 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd69009e170 0x7fd6901307a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd680009870 tx=0x7fd680009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91900cae4a2356cc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.036+0000 7fd687fff700 1 -- 172.21.15.146:0/3852496228 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd680011830 con 0x7fd69009e170 2023-10-03T10:17:14.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.036+0000 7fd687fff700 1 -- 172.21.15.146:0/3852496228 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd680011990 con 0x7fd69009e170 2023-10-03T10:17:14.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.036+0000 7fd687fff700 1 -- 172.21.15.146:0/3852496228 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd680011d20 con 0x7fd69009e170 2023-10-03T10:17:14.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.037+0000 7fd697346700 1 -- 172.21.15.146:0/3852496228 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd69009e170 msgr2=0x7fd6901307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.037+0000 7fd697346700 1 --2- 172.21.15.146:0/3852496228 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd69009e170 0x7fd6901307a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd680009870 tx=0x7fd680009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:14.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.037+0000 7fd697346700 1 -- 172.21.15.146:0/3852496228 shutdown_connections 2023-10-03T10:17:14.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.037+0000 7fd697346700 1 --2- 172.21.15.146:0/3852496228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd690130ce0 0x7fd690131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.037+0000 7fd697346700 1 --2- 172.21.15.146:0/3852496228 >> v2:172.21.15.146:3300/0 conn(0x7fd69009d860 0x7fd69009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.037+0000 7fd697346700 1 --2- 172.21.15.146:0/3852496228 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd69009e170 0x7fd6901307a0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.037+0000 7fd697346700 1 -- 172.21.15.146:0/3852496228 >> 172.21.15.146:0/3852496228 conn(0x7fd690099c40 msgr2=0x7fd6900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.037+0000 7fd697346700 1 -- 172.21.15.146:0/3852496228 shutdown_connections 2023-10-03T10:17:14.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.037+0000 7fd697346700 1 -- 172.21.15.146:0/3852496228 wait complete. 2023-10-03T10:17:14.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.038+0000 7fd697346700 1 Processor -- start 2023-10-03T10:17:14.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.038+0000 7fd697346700 1 -- start start 2023-10-03T10:17:14.041 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:14.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.038+0000 7fd697346700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd69009d860 0x7fd69011b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.038+0000 7fd697346700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd69009e170 0x7fd69011b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.038+0000 7fd697346700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd690130ce0 0x7fd69011baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.038+0000 7fd697346700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69011eb90 con 0x7fd69009d860 2023-10-03T10:17:14.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.038+0000 7fd697346700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69011d2a0 con 0x7fd69009e170 2023-10-03T10:17:14.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.038+0000 7fd697346700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd69011e320 con 0x7fd690130ce0 2023-10-03T10:17:14.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.038+0000 7fd6950e2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd69009d860 0x7fd69011b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.038+0000 7fd6948e1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd69009e170 0x7fd69011b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.038+0000 7fd6950e2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd69009d860 0x7fd69011b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33118/0 (socket says 172.21.15.146:33118) 2023-10-03T10:17:14.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.038+0000 7fd6948e1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd69009e170 0x7fd69011b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57274/0 (socket says 172.21.15.146:57274) 2023-10-03T10:17:14.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.038+0000 7fd6950e2700 1 -- 172.21.15.146:0/1220302461 learned_addr learned my addr 172.21.15.146:0/1220302461 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:14.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.038+0000 7fd6958e3700 1 --2- 172.21.15.146:0/1220302461 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd690130ce0 0x7fd69011baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.039+0000 7fd6950e2700 1 -- 172.21.15.146:0/1220302461 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd690130ce0 msgr2=0x7fd69011baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.039+0000 7fd6950e2700 1 --2- 172.21.15.146:0/1220302461 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd690130ce0 0x7fd69011baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.039+0000 7fd6950e2700 1 -- 172.21.15.146:0/1220302461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd69009e170 msgr2=0x7fd69011b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.039+0000 7fd6950e2700 1 --2- 172.21.15.146:0/1220302461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd69009e170 0x7fd69011b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.039+0000 7fd6950e2700 1 -- 172.21.15.146:0/1220302461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68c00b7f0 con 0x7fd69009d860 2023-10-03T10:17:14.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.039+0000 7fd6948e1700 1 --2- 172.21.15.146:0/1220302461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd69009e170 0x7fd69011b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.039+0000 7fd6958e3700 1 --2- 172.21.15.146:0/1220302461 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd690130ce0 0x7fd69011baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.039+0000 7fd6950e2700 1 --2- 172.21.15.146:0/1220302461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd69009d860 0x7fd69011b070 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fd68c010ee0 tx=0x7fd68c00e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.039+0000 7fd685ffb700 1 -- 172.21.15.146:0/1220302461 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c004030 con 0x7fd69009d860 2023-10-03T10:17:14.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.039+0000 7fd685ffb700 1 -- 172.21.15.146:0/1220302461 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68c004190 con 0x7fd69009d860 2023-10-03T10:17:14.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.039+0000 7fd697346700 1 -- 172.21.15.146:0/1220302461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd688009a70 con 0x7fd69009d860 2023-10-03T10:17:14.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.039+0000 7fd685ffb700 1 -- 172.21.15.146:0/1220302461 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c004520 con 0x7fd69009d860 2023-10-03T10:17:14.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.039+0000 7fd697346700 1 -- 172.21.15.146:0/1220302461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6800094a0 con 0x7fd69009d860 2023-10-03T10:17:14.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.040+0000 7fd685ffb700 1 -- 172.21.15.146:0/1220302461 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd68c0036a0 con 0x7fd69009d860 2023-10-03T10:17:14.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.040+0000 7fd697346700 1 -- 172.21.15.146:0/1220302461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6900710b0 con 0x7fd69009d860 2023-10-03T10:17:14.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.040+0000 7fd685ffb700 1 -- 172.21.15.146:0/1220302461 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd68c0423a0 con 0x7fd69009d860 2023-10-03T10:17:14.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.045+0000 7fd685ffb700 1 -- 172.21.15.146:0/1220302461 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd68c011450 con 0x7fd69009d860 2023-10-03T10:17:14.082 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:14.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.174+0000 7f6a61890700 1 Processor -- start 2023-10-03T10:17:14.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.174+0000 7f6a61890700 1 -- start start 2023-10-03T10:17:14.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.174+0000 7f6a61890700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6a5c133660 0x7f6a5c135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.174+0000 7f6a61890700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a5c135f80 0x7f6a5c138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.174+0000 7f6a61890700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5c099a60 con 0x7f6a5c099e20 2023-10-03T10:17:14.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.174+0000 7f6a61890700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5c09bf50 con 0x7f6a5c133660 2023-10-03T10:17:14.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.174+0000 7f6a61890700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c09b230 con 0x7f6a5c135f80 2023-10-03T10:17:14.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.175+0000 7f6a5b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a5c135f80 0x7f6a5c138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.175+0000 7f6a5affd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6a5c099e20 0x7f6a5c09a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44768/0 (socket says 172.21.15.146:44768) 2023-10-03T10:17:14.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.175+0000 7f6a5a7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6a5c133660 0x7f6a5c135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.175+0000 7f6a5affd700 1 -- 172.21.15.146:0/1897970265 learned_addr learned my addr 172.21.15.146:0/1897970265 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:14.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.175+0000 7f6a5b7fe700 1 -- 172.21.15.146:0/1897970265 >> v2:172.21.15.146:3300/0 conn(0x7f6a5c133660 msgr2=0x7f6a5c135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:14.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.175+0000 7f6a5b7fe700 1 --2- 172.21.15.146:0/1897970265 >> v2:172.21.15.146:3300/0 conn(0x7f6a5c133660 0x7f6a5c135a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.175+0000 7f6a5b7fe700 1 -- 172.21.15.146:0/1897970265 >> v1:172.21.15.146:6789/0 conn(0x7f6a5c099e20 legacy=0x7f6a5c09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.175+0000 7f6a59ffb700 1 -- 172.21.15.146:0/1897970265 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874936243 0 0) 0x7f6a5c099a60 con 0x7f6a5c099e20 2023-10-03T10:17:14.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.175+0000 7f6a5b7fe700 1 -- 172.21.15.146:0/1897970265 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c09bb90 con 0x7f6a5c135f80 2023-10-03T10:17:14.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.175+0000 7f6a5b7fe700 1 --2- 172.21.15.146:0/1897970265 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a5c135f80 0x7f6a5c138360 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400be30 tx=0x7f6a54009290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=298fc3eb94d0d281 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.175+0000 7f6a59ffb700 1 -- 172.21.15.146:0/1897970265 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5400c890 con 0x7f6a5c135f80 2023-10-03T10:17:14.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.175+0000 7f6a59ffb700 1 -- 172.21.15.146:0/1897970265 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5400c9f0 con 0x7f6a5c135f80 2023-10-03T10:17:14.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.175+0000 7f6a59ffb700 1 -- 172.21.15.146:0/1897970265 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5400cda0 con 0x7f6a5c135f80 2023-10-03T10:17:14.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.176+0000 7f6a61890700 1 -- 172.21.15.146:0/1897970265 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a5c135f80 msgr2=0x7f6a5c138360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.176+0000 7f6a61890700 1 --2- 172.21.15.146:0/1897970265 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a5c135f80 0x7f6a5c138360 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400be30 tx=0x7f6a54009290 comp rx=0 tx=0).stop 2023-10-03T10:17:14.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.176+0000 7f6a61890700 1 -- 172.21.15.146:0/1897970265 shutdown_connections 2023-10-03T10:17:14.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.176+0000 7f6a61890700 1 --2- 172.21.15.146:0/1897970265 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a5c135f80 0x7f6a5c138360 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.176+0000 7f6a61890700 1 --2- 172.21.15.146:0/1897970265 >> v2:172.21.15.146:3300/0 conn(0x7f6a5c133660 0x7f6a5c135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.176+0000 7f6a61890700 1 -- 172.21.15.146:0/1897970265 >> 172.21.15.146:0/1897970265 conn(0x7f6a5c0a2980 msgr2=0x7f6a5c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.176+0000 7f6a61890700 1 -- 172.21.15.146:0/1897970265 shutdown_connections 2023-10-03T10:17:14.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.176+0000 7f6a61890700 1 -- 172.21.15.146:0/1897970265 wait complete. 2023-10-03T10:17:14.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.177+0000 7f6a61890700 1 Processor -- start 2023-10-03T10:17:14.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.178+0000 7f6a61890700 1 -- start start 2023-10-03T10:17:14.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.178+0000 7f6a61890700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a5c099e20 0x7f6a5c06fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.178+0000 7f6a61890700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a5c133660 0x7f6a5c070360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.178+0000 7f6a61890700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a5c135f80 0x7f6a5c0708a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.178+0000 7f6a61890700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c133a30 con 0x7f6a5c133660 2023-10-03T10:17:14.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.178+0000 7f6a61890700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c119600 con 0x7f6a5c135f80 2023-10-03T10:17:14.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.178+0000 7f6a61890700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c119e80 con 0x7f6a5c099e20 2023-10-03T10:17:14.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.178+0000 7f6a5affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a5c099e20 0x7f6a5c06fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.178+0000 7f6a5b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a5c135f80 0x7f6a5c0708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.178+0000 7f6a5affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a5c099e20 0x7f6a5c06fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:57284/0 (socket says 172.21.15.146:57284) 2023-10-03T10:17:14.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.178+0000 7f6a5affd700 1 -- 172.21.15.146:0/2294126002 learned_addr learned my addr 172.21.15.146:0/2294126002 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:14.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.178+0000 7f6a5a7fc700 1 --2- 172.21.15.146:0/2294126002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a5c133660 0x7f6a5c070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.179+0000 7f6a5b7fe700 1 -- 172.21.15.146:0/2294126002 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a5c099e20 msgr2=0x7f6a5c06fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.179+0000 7f6a5b7fe700 1 --2- 172.21.15.146:0/2294126002 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a5c099e20 0x7f6a5c06fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.179+0000 7f6a5b7fe700 1 -- 172.21.15.146:0/2294126002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a5c133660 msgr2=0x7f6a5c070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.179+0000 7f6a5b7fe700 1 --2- 172.21.15.146:0/2294126002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a5c133660 0x7f6a5c070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.179+0000 7f6a5b7fe700 1 -- 172.21.15.146:0/2294126002 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5400ba90 con 0x7f6a5c135f80 2023-10-03T10:17:14.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.179+0000 7f6a5affd700 1 --2- 172.21.15.146:0/2294126002 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a5c099e20 0x7f6a5c06fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.179+0000 7f6a5b7fe700 1 --2- 172.21.15.146:0/2294126002 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a5c135f80 0x7f6a5c0708a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6a54015000 tx=0x7f6a54004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.179+0000 7f6a43fff700 1 -- 172.21.15.146:0/2294126002 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54004450 con 0x7f6a5c135f80 2023-10-03T10:17:14.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.179+0000 7f6a43fff700 1 -- 172.21.15.146:0/2294126002 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a540045b0 con 0x7f6a5c135f80 2023-10-03T10:17:14.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.179+0000 7f6a61890700 1 -- 172.21.15.146:0/2294126002 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5c11a410 con 0x7f6a5c135f80 2023-10-03T10:17:14.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.179+0000 7f6a43fff700 1 -- 172.21.15.146:0/2294126002 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54004940 con 0x7f6a5c135f80 2023-10-03T10:17:14.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.179+0000 7f6a61890700 1 -- 172.21.15.146:0/2294126002 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5c1ca120 con 0x7f6a5c135f80 2023-10-03T10:17:14.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.180+0000 7f6a43fff700 1 -- 172.21.15.146:0/2294126002 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a5401e420 con 0x7f6a5c135f80 2023-10-03T10:17:14.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.180+0000 7f6a43fff700 1 -- 172.21.15.146:0/2294126002 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6a54040ee0 con 0x7f6a5c135f80 2023-10-03T10:17:14.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.180+0000 7f6a61890700 1 -- 172.21.15.146:0/2294126002 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5c072480 con 0x7f6a5c135f80 2023-10-03T10:17:14.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.185+0000 7f6a43fff700 1 -- 172.21.15.146:0/2294126002 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a5c072480 con 0x7f6a5c135f80 2023-10-03T10:17:14.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.215+0000 7f52c06a9700 1 Processor -- start 2023-10-03T10:17:14.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.215+0000 7f52c06a9700 1 -- start start 2023-10-03T10:17:14.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.215+0000 7f52c06a9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52b809d860 0x7f52b809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.215+0000 7f52c06a9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b809e170 0x7f52b81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.215+0000 7f52c06a9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52b8130ce0 0x7f52b8131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.215+0000 7f52c06a9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52b809aaa0 con 0x7f52b8130ce0 2023-10-03T10:17:14.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.215+0000 7f52c06a9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b809f870 con 0x7f52b809d860 2023-10-03T10:17:14.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.215+0000 7f52c06a9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52b809b360 con 0x7f52b809e170 2023-10-03T10:17:14.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.216+0000 7f52be445700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52b809d860 0x7f52b809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.216+0000 7f52bdc44700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b809e170 0x7f52b81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.216+0000 7f52bec46700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52b8130ce0 0x7f52b8131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.216+0000 7f52be445700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52b809d860 0x7f52b809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57310/0 (socket says 172.21.15.146:57310) 2023-10-03T10:17:14.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.216+0000 7f52be445700 1 -- 172.21.15.146:0/962468691 learned_addr learned my addr 172.21.15.146:0/962468691 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:14.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.216+0000 7f52be445700 1 -- 172.21.15.146:0/962468691 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b809e170 msgr2=0x7f52b81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:14.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.216+0000 7f52be445700 1 --2- 172.21.15.146:0/962468691 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b809e170 0x7f52b81307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.216+0000 7f52be445700 1 -- 172.21.15.146:0/962468691 >> v2:172.21.15.146:3300/0 conn(0x7f52b8130ce0 msgr2=0x7f52b8131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:14.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.216+0000 7f52be445700 1 --2- 172.21.15.146:0/962468691 >> v2:172.21.15.146:3300/0 conn(0x7f52b8130ce0 0x7f52b8131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.216+0000 7f52be445700 1 -- 172.21.15.146:0/962468691 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b809b620 con 0x7f52b809d860 2023-10-03T10:17:14.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.216+0000 7f52bec46700 1 --2- 172.21.15.146:0/962468691 >> v2:172.21.15.146:3300/0 conn(0x7f52b8130ce0 0x7f52b8131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.216+0000 7f52be445700 1 --2- 172.21.15.146:0/962468691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52b809d860 0x7f52b809dc30 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f52b40098f0 tx=0x7f52b4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38f6d0d144344eca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.216+0000 7f52bd443700 1 -- 172.21.15.146:0/962468691 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4011830 con 0x7f52b809d860 2023-10-03T10:17:14.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.216+0000 7f52bd443700 1 -- 172.21.15.146:0/962468691 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b4011990 con 0x7f52b809d860 2023-10-03T10:17:14.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.216+0000 7f52bd443700 1 -- 172.21.15.146:0/962468691 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4011d20 con 0x7f52b809d860 2023-10-03T10:17:14.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.217+0000 7f52c06a9700 1 -- 172.21.15.146:0/962468691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52b809d860 msgr2=0x7f52b809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.217+0000 7f52c06a9700 1 --2- 172.21.15.146:0/962468691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52b809d860 0x7f52b809dc30 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f52b40098f0 tx=0x7f52b4009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:14.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.217+0000 7f52c06a9700 1 -- 172.21.15.146:0/962468691 shutdown_connections 2023-10-03T10:17:14.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.217+0000 7f52c06a9700 1 --2- 172.21.15.146:0/962468691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52b809d860 0x7f52b809dc30 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.217+0000 7f52c06a9700 1 --2- 172.21.15.146:0/962468691 >> v2:172.21.15.146:3300/0 conn(0x7f52b8130ce0 0x7f52b8131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.217+0000 7f52c06a9700 1 --2- 172.21.15.146:0/962468691 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b809e170 0x7f52b81307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.217+0000 7f52c06a9700 1 -- 172.21.15.146:0/962468691 >> 172.21.15.146:0/962468691 conn(0x7f52b8099c40 msgr2=0x7f52b80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.217+0000 7f52c06a9700 1 -- 172.21.15.146:0/962468691 shutdown_connections 2023-10-03T10:17:14.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.217+0000 7f52c06a9700 1 -- 172.21.15.146:0/962468691 wait complete. 2023-10-03T10:17:14.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.218+0000 7f52c06a9700 1 Processor -- start 2023-10-03T10:17:14.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.218+0000 7f52c06a9700 1 -- start start 2023-10-03T10:17:14.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.218+0000 7f52c06a9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b809d860 0x7f52b8119f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.218+0000 7f52c06a9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b809e170 0x7f52b811a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.218+0000 7f52c06a9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52b8130ce0 0x7f52b811a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.218+0000 7f52c06a9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b811bd10 con 0x7f52b809d860 2023-10-03T10:17:14.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.218+0000 7f52c06a9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b811bb20 con 0x7f52b8130ce0 2023-10-03T10:17:14.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.218+0000 7f52c06a9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52b809c8b0 con 0x7f52b809e170 2023-10-03T10:17:14.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.218+0000 7f52be445700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b809d860 0x7f52b8119f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.218+0000 7f52be445700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b809d860 0x7f52b8119f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33156/0 (socket says 172.21.15.146:33156) 2023-10-03T10:17:14.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.218+0000 7f52be445700 1 -- 172.21.15.146:0/3982457395 learned_addr learned my addr 172.21.15.146:0/3982457395 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:14.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.218+0000 7f52bdc44700 1 --2- 172.21.15.146:0/3982457395 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b809e170 0x7f52b811a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.219+0000 7f52bec46700 1 --2- 172.21.15.146:0/3982457395 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52b8130ce0 0x7f52b811a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.219+0000 7f52bdc44700 1 -- 172.21.15.146:0/3982457395 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52b8130ce0 msgr2=0x7f52b811a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.219+0000 7f52bdc44700 1 --2- 172.21.15.146:0/3982457395 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52b8130ce0 0x7f52b811a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.219+0000 7f52bdc44700 1 -- 172.21.15.146:0/3982457395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b809d860 msgr2=0x7f52b8119f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.219+0000 7f52bdc44700 1 --2- 172.21.15.146:0/3982457395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b809d860 0x7f52b8119f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.219+0000 7f52bdc44700 1 -- 172.21.15.146:0/3982457395 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b0009a70 con 0x7f52b809e170 2023-10-03T10:17:14.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.219+0000 7f52be445700 1 --2- 172.21.15.146:0/3982457395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b809d860 0x7f52b8119f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.219+0000 7f52bdc44700 1 --2- 172.21.15.146:0/3982457395 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b809e170 0x7f52b811a490 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f52a8012c50 tx=0x7f52a8012f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.219+0000 7f52aeffd700 1 -- 172.21.15.146:0/3982457395 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a800c930 con 0x7f52b809e170 2023-10-03T10:17:14.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.219+0000 7f52aeffd700 1 -- 172.21.15.146:0/3982457395 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a800ca90 con 0x7f52b809e170 2023-10-03T10:17:14.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.219+0000 7f52c06a9700 1 -- 172.21.15.146:0/3982457395 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b4009550 con 0x7f52b809e170 2023-10-03T10:17:14.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.219+0000 7f52aeffd700 1 -- 172.21.15.146:0/3982457395 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a800ce20 con 0x7f52b809e170 2023-10-03T10:17:14.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.219+0000 7f52c06a9700 1 -- 172.21.15.146:0/3982457395 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b811d490 con 0x7f52b809e170 2023-10-03T10:17:14.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.220+0000 7f52aeffd700 1 -- 172.21.15.146:0/3982457395 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52a801a410 con 0x7f52b809e170 2023-10-03T10:17:14.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.220+0000 7f52c06a9700 1 -- 172.21.15.146:0/3982457395 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b811d1c0 con 0x7f52b809e170 2023-10-03T10:17:14.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.220+0000 7f52aeffd700 1 -- 172.21.15.146:0/3982457395 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f52a8043100 con 0x7f52b809e170 2023-10-03T10:17:14.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.225+0000 7f52aeffd700 1 -- 172.21.15.146:0/3982457395 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52a8018900 con 0x7f52b809e170 2023-10-03T10:17:14.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.247+0000 7fd697346700 1 -- 172.21.15.146:0/1220302461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd69004f2a0 con 0x7fd69009d860 2023-10-03T10:17:14.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.247+0000 7fd685ffb700 1 -- 172.21.15.146:0/1220302461 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd68c00db40 con 0x7fd69009d860 2023-10-03T10:17:14.248 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:14.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.249+0000 7fd697346700 1 -- 172.21.15.146:0/1220302461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd69009d860 msgr2=0x7fd69011b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.249+0000 7fd697346700 1 --2- 172.21.15.146:0/1220302461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd69009d860 0x7fd69011b070 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fd68c010ee0 tx=0x7fd68c00e640 comp rx=0 tx=0).stop 2023-10-03T10:17:14.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.249+0000 7fd697346700 1 -- 172.21.15.146:0/1220302461 shutdown_connections 2023-10-03T10:17:14.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.249+0000 7fd697346700 1 --2- 172.21.15.146:0/1220302461 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd690130ce0 0x7fd69011baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.249+0000 7fd697346700 1 --2- 172.21.15.146:0/1220302461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd69009d860 0x7fd69011b070 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.249+0000 7fd697346700 1 --2- 172.21.15.146:0/1220302461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd69009e170 0x7fd69011b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.249+0000 7fd697346700 1 -- 172.21.15.146:0/1220302461 >> 172.21.15.146:0/1220302461 conn(0x7fd690099c40 msgr2=0x7fd69012de90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.249+0000 7fd697346700 1 -- 172.21.15.146:0/1220302461 shutdown_connections 2023-10-03T10:17:14.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.249+0000 7fd697346700 1 -- 172.21.15.146:0/1220302461 wait complete. 2023-10-03T10:17:14.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:14.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.379+0000 7f6a61890700 1 -- 172.21.15.146:0/2294126002 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6a5c072480 con 0x7f6a5c135f80 2023-10-03T10:17:14.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.379+0000 7f6a43fff700 1 -- 172.21.15.146:0/2294126002 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6a5c072480 con 0x7f6a5c135f80 2023-10-03T10:17:14.380 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:14.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.381+0000 7f6a61890700 1 -- 172.21.15.146:0/2294126002 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a5c135f80 msgr2=0x7f6a5c0708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.381+0000 7f6a61890700 1 --2- 172.21.15.146:0/2294126002 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a5c135f80 0x7f6a5c0708a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6a54015000 tx=0x7f6a54004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.381+0000 7f6a61890700 1 -- 172.21.15.146:0/2294126002 shutdown_connections 2023-10-03T10:17:14.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.381+0000 7f6a61890700 1 --2- 172.21.15.146:0/2294126002 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a5c135f80 0x7f6a5c0708a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.381+0000 7f6a61890700 1 --2- 172.21.15.146:0/2294126002 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6a5c099e20 0x7f6a5c06fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.381+0000 7f6a61890700 1 --2- 172.21.15.146:0/2294126002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a5c133660 0x7f6a5c070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.381+0000 7f6a61890700 1 -- 172.21.15.146:0/2294126002 >> 172.21.15.146:0/2294126002 conn(0x7f6a5c0a2980 msgr2=0x7f6a5c1324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.381+0000 7f6a61890700 1 -- 172.21.15.146:0/2294126002 shutdown_connections 2023-10-03T10:17:14.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.381+0000 7f6a61890700 1 -- 172.21.15.146:0/2294126002 wait complete. 2023-10-03T10:17:14.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:14.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.413+0000 7f52c06a9700 1 -- 172.21.15.146:0/3982457395 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f52b804f2a0 con 0x7f52b809e170 2023-10-03T10:17:14.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.413+0000 7f52aeffd700 1 -- 172.21.15.146:0/3982457395 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f52a801f070 con 0x7f52b809e170 2023-10-03T10:17:14.414 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:14.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.415+0000 7f52c06a9700 1 -- 172.21.15.146:0/3982457395 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b809e170 msgr2=0x7f52b811a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.415+0000 7f52c06a9700 1 --2- 172.21.15.146:0/3982457395 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b809e170 0x7f52b811a490 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f52a8012c50 tx=0x7f52a8012f60 comp rx=0 tx=0).stop 2023-10-03T10:17:14.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.416+0000 7f52c06a9700 1 -- 172.21.15.146:0/3982457395 shutdown_connections 2023-10-03T10:17:14.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.416+0000 7f52c06a9700 1 --2- 172.21.15.146:0/3982457395 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52b8130ce0 0x7f52b811a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.416+0000 7f52c06a9700 1 --2- 172.21.15.146:0/3982457395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b809d860 0x7f52b8119f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.416+0000 7f52c06a9700 1 --2- 172.21.15.146:0/3982457395 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52b809e170 0x7f52b811a490 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.416+0000 7f52c06a9700 1 -- 172.21.15.146:0/3982457395 >> 172.21.15.146:0/3982457395 conn(0x7f52b8099c40 msgr2=0x7f52b80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.416+0000 7f52c06a9700 1 -- 172.21.15.146:0/3982457395 shutdown_connections 2023-10-03T10:17:14.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.416+0000 7f52c06a9700 1 -- 172.21.15.146:0/3982457395 wait complete. 2023-10-03T10:17:14.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:14.453 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:14.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.591+0000 7fc0d8b9f700 1 Processor -- start 2023-10-03T10:17:14.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.591+0000 7fc0d8b9f700 1 -- start start 2023-10-03T10:17:14.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.591+0000 7fc0d8b9f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d406a770 0x7fc0d412ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.591+0000 7fc0d8b9f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc0d4130520 0x7fc0d4130990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.591+0000 7fc0d8b9f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0d4133470 0x7fc0d41338e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.591+0000 7fc0d8b9f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d409af90 con 0x7fc0d4130520 2023-10-03T10:17:14.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.591+0000 7fc0d8b9f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d409f590 con 0x7fc0d4133470 2023-10-03T10:17:14.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.591+0000 7fc0d8b9f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d4130ed0 con 0x7fc0d406a770 2023-10-03T10:17:14.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.591+0000 7fc0d3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0d4133470 0x7fc0d41338e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.591+0000 7fc0d37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d406a770 0x7fc0d412ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.591+0000 7fc0d2ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc0d4130520 0x7fc0d4130990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.591+0000 7fc0d3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0d4133470 0x7fc0d41338e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35084/0 (socket says 172.21.15.146:35084) 2023-10-03T10:17:14.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.591+0000 7fc0d37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d406a770 0x7fc0d412ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51130/0 (socket says 172.21.15.146:51130) 2023-10-03T10:17:14.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.591+0000 7fc0d3fff700 1 -- 172.21.15.146:0/1539431973 learned_addr learned my addr 172.21.15.146:0/1539431973 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:14.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.592+0000 7fc0d3fff700 1 -- 172.21.15.146:0/1539431973 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d406a770 msgr2=0x7fc0d412ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:14.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.592+0000 7fc0d3fff700 1 --2- 172.21.15.146:0/1539431973 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d406a770 0x7fc0d412ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.592+0000 7fc0d3fff700 1 -- 172.21.15.146:0/1539431973 >> v2:172.21.15.146:3300/0 conn(0x7fc0d4130520 msgr2=0x7fc0d4130990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:14.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.592+0000 7fc0d3fff700 1 --2- 172.21.15.146:0/1539431973 >> v2:172.21.15.146:3300/0 conn(0x7fc0d4130520 0x7fc0d4130990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.592+0000 7fc0d3fff700 1 -- 172.21.15.146:0/1539431973 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d409a5d0 con 0x7fc0d4133470 2023-10-03T10:17:14.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.592+0000 7fc0d2ffd700 1 --2- 172.21.15.146:0/1539431973 >> v2:172.21.15.146:3300/0 conn(0x7fc0d4130520 0x7fc0d4130990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.592+0000 7fc0d3fff700 1 --2- 172.21.15.146:0/1539431973 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0d4133470 0x7fc0d41338e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc009eb0 tx=0x7fc0cc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19c682380804a847 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.592+0000 7fc0d27fc700 1 -- 172.21.15.146:0/1539431973 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc00e070 con 0x7fc0d4133470 2023-10-03T10:17:14.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.592+0000 7fc0d27fc700 1 -- 172.21.15.146:0/1539431973 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0cc00b890 con 0x7fc0d4133470 2023-10-03T10:17:14.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.592+0000 7fc0d27fc700 1 -- 172.21.15.146:0/1539431973 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc00bc40 con 0x7fc0d4133470 2023-10-03T10:17:14.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.593+0000 7fc0d8b9f700 1 -- 172.21.15.146:0/1539431973 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0d4133470 msgr2=0x7fc0d41338e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.593+0000 7fc0d8b9f700 1 --2- 172.21.15.146:0/1539431973 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0d4133470 0x7fc0d41338e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc009eb0 tx=0x7fc0cc00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:14.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.593+0000 7fc0d8b9f700 1 -- 172.21.15.146:0/1539431973 shutdown_connections 2023-10-03T10:17:14.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.593+0000 7fc0d8b9f700 1 --2- 172.21.15.146:0/1539431973 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0d4133470 0x7fc0d41338e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.593+0000 7fc0d8b9f700 1 --2- 172.21.15.146:0/1539431973 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d406a770 0x7fc0d412ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.593+0000 7fc0d8b9f700 1 --2- 172.21.15.146:0/1539431973 >> v2:172.21.15.146:3300/0 conn(0x7fc0d4130520 0x7fc0d4130990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.593+0000 7fc0d8b9f700 1 -- 172.21.15.146:0/1539431973 >> 172.21.15.146:0/1539431973 conn(0x7fc0d40a2d80 msgr2=0x7fc0d40a3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.593+0000 7fc0d8b9f700 1 -- 172.21.15.146:0/1539431973 shutdown_connections 2023-10-03T10:17:14.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.593+0000 7fc0d8b9f700 1 -- 172.21.15.146:0/1539431973 wait complete. 2023-10-03T10:17:14.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.594+0000 7fc0d8b9f700 1 Processor -- start 2023-10-03T10:17:14.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.594+0000 7fc0d8b9f700 1 -- start start 2023-10-03T10:17:14.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.594+0000 7fc0d8b9f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d406a770 0x7fc0d411d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.594+0000 7fc0d8b9f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0d4130520 0x7fc0d411dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.594+0000 7fc0d8b9f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0d4133470 0x7fc0d411e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.594+0000 7fc0d8b9f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d4120080 con 0x7fc0d4133470 2023-10-03T10:17:14.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.594+0000 7fc0d8b9f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d40721e0 con 0x7fc0d4130520 2023-10-03T10:17:14.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.594+0000 7fc0d8b9f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d411ed50 con 0x7fc0d406a770 2023-10-03T10:17:14.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.594+0000 7fc0d37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d406a770 0x7fc0d411d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.594+0000 7fc0d3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0d4133470 0x7fc0d411e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.594+0000 7fc0d2ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0d4130520 0x7fc0d411dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.594+0000 7fc0d37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d406a770 0x7fc0d411d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51146/0 (socket says 172.21.15.146:51146) 2023-10-03T10:17:14.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.594+0000 7fc0d37fe700 1 -- 172.21.15.146:0/802387089 learned_addr learned my addr 172.21.15.146:0/802387089 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:14.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.595+0000 7fc0d2ffd700 1 -- 172.21.15.146:0/802387089 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d406a770 msgr2=0x7fc0d411d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.595+0000 7fc0d2ffd700 1 --2- 172.21.15.146:0/802387089 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d406a770 0x7fc0d411d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.595+0000 7fc0d2ffd700 1 -- 172.21.15.146:0/802387089 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0d4133470 msgr2=0x7fc0d411e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.595+0000 7fc0d2ffd700 1 --2- 172.21.15.146:0/802387089 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0d4133470 0x7fc0d411e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.595+0000 7fc0d2ffd700 1 -- 172.21.15.146:0/802387089 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c80094a0 con 0x7fc0d4130520 2023-10-03T10:17:14.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.595+0000 7fc0d37fe700 1 --2- 172.21.15.146:0/802387089 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d406a770 0x7fc0d411d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.595+0000 7fc0d3fff700 1 --2- 172.21.15.146:0/802387089 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0d4133470 0x7fc0d411e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.595+0000 7fc0d2ffd700 1 --2- 172.21.15.146:0/802387089 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0d4130520 0x7fc0d411dd20 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc0c800e980 tx=0x7fc0c800ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.595+0000 7fc0bbfff700 1 -- 172.21.15.146:0/802387089 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c800c690 con 0x7fc0d4130520 2023-10-03T10:17:14.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.595+0000 7fc0bbfff700 1 -- 172.21.15.146:0/802387089 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c800c7f0 con 0x7fc0d4130520 2023-10-03T10:17:14.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.595+0000 7fc0d8b9f700 1 -- 172.21.15.146:0/802387089 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0cc009b30 con 0x7fc0d4130520 2023-10-03T10:17:14.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.595+0000 7fc0bbfff700 1 -- 172.21.15.146:0/802387089 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c800cb80 con 0x7fc0d4130520 2023-10-03T10:17:14.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.595+0000 7fc0d8b9f700 1 -- 172.21.15.146:0/802387089 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d411fa50 con 0x7fc0d4130520 2023-10-03T10:17:14.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.596+0000 7fc0bbfff700 1 -- 172.21.15.146:0/802387089 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc0c800cce0 con 0x7fc0d4130520 2023-10-03T10:17:14.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.596+0000 7fc0bbfff700 1 -- 172.21.15.146:0/802387089 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc0c803f9e0 con 0x7fc0d4130520 2023-10-03T10:17:14.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.596+0000 7fc0d8b9f700 1 -- 172.21.15.146:0/802387089 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d411fc70 con 0x7fc0d4130520 2023-10-03T10:17:14.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.601+0000 7fc0bbfff700 1 -- 172.21.15.146:0/802387089 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc0c801b3b0 con 0x7fc0d4130520 2023-10-03T10:17:14.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.785+0000 7fc0d8b9f700 1 -- 172.21.15.146:0/802387089 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc0d404f2a0 con 0x7fc0d4130520 2023-10-03T10:17:14.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.785+0000 7fc0bbfff700 1 -- 172.21.15.146:0/802387089 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc0c802b090 con 0x7fc0d4130520 2023-10-03T10:17:14.786 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:14.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.787+0000 7fc0d8b9f700 1 -- 172.21.15.146:0/802387089 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0d4130520 msgr2=0x7fc0d411dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.787+0000 7fc0d8b9f700 1 --2- 172.21.15.146:0/802387089 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0d4130520 0x7fc0d411dd20 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc0c800e980 tx=0x7fc0c800ec90 comp rx=0 tx=0).stop 2023-10-03T10:17:14.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.787+0000 7fc0d8b9f700 1 -- 172.21.15.146:0/802387089 shutdown_connections 2023-10-03T10:17:14.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.787+0000 7fc0d8b9f700 1 --2- 172.21.15.146:0/802387089 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0d4133470 0x7fc0d411e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.787+0000 7fc0d8b9f700 1 --2- 172.21.15.146:0/802387089 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0d406a770 0x7fc0d411d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.787+0000 7fc0d8b9f700 1 --2- 172.21.15.146:0/802387089 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0d4130520 0x7fc0d411dd20 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.787+0000 7fc0d8b9f700 1 -- 172.21.15.146:0/802387089 >> 172.21.15.146:0/802387089 conn(0x7fc0d40a2d80 msgr2=0x7fc0d40a1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.787+0000 7fc0d8b9f700 1 -- 172.21.15.146:0/802387089 shutdown_connections 2023-10-03T10:17:14.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:14.787+0000 7fc0d8b9f700 1 -- 172.21.15.146:0/802387089 wait complete. 2023-10-03T10:17:14.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:15.263 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:15.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.388+0000 7f24f66be700 1 Processor -- start 2023-10-03T10:17:15.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.388+0000 7f24f66be700 1 -- start start 2023-10-03T10:17:15.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.388+0000 7f24f66be700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f24f0133ad0 0x7f24f0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.388+0000 7f24f66be700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24f0130bc0 0x7f24f013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.388+0000 7f24f66be700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f006b2d0 con 0x7f24f01300a0 2023-10-03T10:17:15.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.388+0000 7f24f66be700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f0133610 con 0x7f24f0133ad0 2023-10-03T10:17:15.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.388+0000 7f24f66be700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f009a500 con 0x7f24f0130bc0 2023-10-03T10:17:15.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.389+0000 7f24effff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f24f0133ad0 0x7f24f0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.389+0000 7f24f4c5b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24f0130bc0 0x7f24f013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.389+0000 7f24ef7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f24f01300a0 0x7f24f01304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59118/0 (socket says 172.21.15.146:59118) 2023-10-03T10:17:15.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.389+0000 7f24ef7fe700 1 -- 172.21.15.146:0/2794166782 learned_addr learned my addr 172.21.15.146:0/2794166782 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:15.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.389+0000 7f24f4c5b700 1 -- 172.21.15.146:0/2794166782 >> v2:172.21.15.146:3300/0 conn(0x7f24f0133ad0 msgr2=0x7f24f0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:15.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.389+0000 7f24f4c5b700 1 --2- 172.21.15.146:0/2794166782 >> v2:172.21.15.146:3300/0 conn(0x7f24f0133ad0 0x7f24f0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.389+0000 7f24f4c5b700 1 -- 172.21.15.146:0/2794166782 >> v1:172.21.15.146:6789/0 conn(0x7f24f01300a0 legacy=0x7f24f01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.389+0000 7f24f4c5b700 1 -- 172.21.15.146:0/2794166782 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f01338b0 con 0x7f24f0130bc0 2023-10-03T10:17:15.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.389+0000 7f24effff700 1 --2- 172.21.15.146:0/2794166782 >> v2:172.21.15.146:3300/0 conn(0x7f24f0133ad0 0x7f24f0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:15.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.389+0000 7f24f4c5b700 1 --2- 172.21.15.146:0/2794166782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24f0130bc0 0x7f24f013b990 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f24e8009d90 tx=0x7f24e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4dc461edf90969c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.389+0000 7f24eeffd700 1 -- 172.21.15.146:0/2794166782 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e800e070 con 0x7f24f0130bc0 2023-10-03T10:17:15.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.389+0000 7f24eeffd700 1 -- 172.21.15.146:0/2794166782 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e800bb20 con 0x7f24f0130bc0 2023-10-03T10:17:15.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.389+0000 7f24eeffd700 1 -- 172.21.15.146:0/2794166782 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e8012430 con 0x7f24f0130bc0 2023-10-03T10:17:15.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.390+0000 7f24f66be700 1 -- 172.21.15.146:0/2794166782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24f0130bc0 msgr2=0x7f24f013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.390+0000 7f24f66be700 1 --2- 172.21.15.146:0/2794166782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24f0130bc0 0x7f24f013b990 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f24e8009d90 tx=0x7f24e800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:15.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.390+0000 7f24f66be700 1 -- 172.21.15.146:0/2794166782 shutdown_connections 2023-10-03T10:17:15.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.390+0000 7f24f66be700 1 --2- 172.21.15.146:0/2794166782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24f0130bc0 0x7f24f013b990 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.390+0000 7f24f66be700 1 --2- 172.21.15.146:0/2794166782 >> v2:172.21.15.146:3300/0 conn(0x7f24f0133ad0 0x7f24f0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.390+0000 7f24f66be700 1 -- 172.21.15.146:0/2794166782 >> 172.21.15.146:0/2794166782 conn(0x7f24f0099c40 msgr2=0x7f24f00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.390+0000 7f24f66be700 1 -- 172.21.15.146:0/2794166782 shutdown_connections 2023-10-03T10:17:15.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.390+0000 7f24f66be700 1 -- 172.21.15.146:0/2794166782 wait complete. 2023-10-03T10:17:15.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.391+0000 7f24f66be700 1 Processor -- start 2023-10-03T10:17:15.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.391+0000 7f24f66be700 1 -- start start 2023-10-03T10:17:15.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.391+0000 7f24f66be700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24f01300a0 0x7f24f011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.391+0000 7f24f66be700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24f0130bc0 0x7f24f011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.391+0000 7f24f66be700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24f0133ad0 0x7f24f011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.391+0000 7f24f66be700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f012d8f0 con 0x7f24f0130bc0 2023-10-03T10:17:15.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.391+0000 7f24f66be700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f011ffa0 con 0x7f24f0133ad0 2023-10-03T10:17:15.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.391+0000 7f24f66be700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24f012dd00 con 0x7f24f01300a0 2023-10-03T10:17:15.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.391+0000 7f24f4c5b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24f0133ad0 0x7f24f011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.391+0000 7f24effff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24f01300a0 0x7f24f011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.391+0000 7f24ef7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24f0130bc0 0x7f24f011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.391+0000 7f24f4c5b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24f0133ad0 0x7f24f011e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35112/0 (socket says 172.21.15.146:35112) 2023-10-03T10:17:15.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.391+0000 7f24effff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24f01300a0 0x7f24f011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51162/0 (socket says 172.21.15.146:51162) 2023-10-03T10:17:15.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.391+0000 7f24f4c5b700 1 -- 172.21.15.146:0/254235124 learned_addr learned my addr 172.21.15.146:0/254235124 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:15.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.392+0000 7f24f4c5b700 1 -- 172.21.15.146:0/254235124 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24f01300a0 msgr2=0x7f24f011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.392+0000 7f24f4c5b700 1 --2- 172.21.15.146:0/254235124 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24f01300a0 0x7f24f011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.392+0000 7f24f4c5b700 1 -- 172.21.15.146:0/254235124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24f0130bc0 msgr2=0x7f24f011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.392+0000 7f24f4c5b700 1 --2- 172.21.15.146:0/254235124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24f0130bc0 0x7f24f011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.392+0000 7f24f4c5b700 1 -- 172.21.15.146:0/254235124 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e40094a0 con 0x7f24f0133ad0 2023-10-03T10:17:15.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.392+0000 7f24f4c5b700 1 --2- 172.21.15.146:0/254235124 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24f0133ad0 0x7f24f011e4c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f24e8014040 tx=0x7f24e8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.392+0000 7f24ecff9700 1 -- 172.21.15.146:0/254235124 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e8012430 con 0x7f24f0133ad0 2023-10-03T10:17:15.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.392+0000 7f24ecff9700 1 -- 172.21.15.146:0/254235124 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e8020070 con 0x7f24f0133ad0 2023-10-03T10:17:15.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.392+0000 7f24f66be700 1 -- 172.21.15.146:0/254235124 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e8009a70 con 0x7f24f0133ad0 2023-10-03T10:17:15.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.392+0000 7f24ecff9700 1 -- 172.21.15.146:0/254235124 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e8003ea0 con 0x7f24f0133ad0 2023-10-03T10:17:15.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.392+0000 7f24f66be700 1 -- 172.21.15.146:0/254235124 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f011f2e0 con 0x7f24f0133ad0 2023-10-03T10:17:15.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.393+0000 7f24ecff9700 1 -- 172.21.15.146:0/254235124 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f24e8004280 con 0x7f24f0133ad0 2023-10-03T10:17:15.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.393+0000 7f24ecff9700 1 -- 172.21.15.146:0/254235124 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f24e8022070 con 0x7f24f0133ad0 2023-10-03T10:17:15.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.393+0000 7f24f66be700 1 -- 172.21.15.146:0/254235124 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f004f2a0 con 0x7f24f0133ad0 2023-10-03T10:17:15.397 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:15.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.397+0000 7f24ecff9700 1 -- 172.21.15.146:0/254235124 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f24e8004530 con 0x7f24f0133ad0 2023-10-03T10:17:15.429 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:15.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.522+0000 7ff8c9122700 1 Processor -- start 2023-10-03T10:17:15.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.522+0000 7ff8c9122700 1 -- start start 2023-10-03T10:17:15.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.522+0000 7ff8c9122700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8c409d860 0x7ff8c409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.522+0000 7ff8c9122700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8c409e170 0x7ff8c41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.523+0000 7ff8c9122700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff8c4130ce0 0x7ff8c4131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.523+0000 7ff8c9122700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c409aaa0 con 0x7ff8c4130ce0 2023-10-03T10:17:15.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.523+0000 7ff8c9122700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c409f870 con 0x7ff8c409e170 2023-10-03T10:17:15.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.523+0000 7ff8c9122700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c409b360 con 0x7ff8c409d860 2023-10-03T10:17:15.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.523+0000 7ff8c359e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff8c4130ce0 0x7ff8c4131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.523+0000 7ff8c2d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8c409d860 0x7ff8c409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.523+0000 7ff8c259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8c409e170 0x7ff8c41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.523+0000 7ff8c359e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff8c4130ce0 0x7ff8c4131150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57918/0 (socket says 172.21.15.146:57918) 2023-10-03T10:17:15.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.523+0000 7ff8c359e700 1 -- 172.21.15.146:0/314677036 learned_addr learned my addr 172.21.15.146:0/314677036 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:15.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.523+0000 7ff8c359e700 1 -- 172.21.15.146:0/314677036 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8c409d860 msgr2=0x7ff8c409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:15.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.523+0000 7ff8c359e700 1 --2- 172.21.15.146:0/314677036 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8c409d860 0x7ff8c409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.523+0000 7ff8c359e700 1 -- 172.21.15.146:0/314677036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8c409e170 msgr2=0x7ff8c41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:15.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.523+0000 7ff8c359e700 1 --2- 172.21.15.146:0/314677036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8c409e170 0x7ff8c41307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.523+0000 7ff8c359e700 1 -- 172.21.15.146:0/314677036 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c409b620 con 0x7ff8c4130ce0 2023-10-03T10:17:15.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.523+0000 7ff8c359e700 1 --2- 172.21.15.146:0/314677036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8c4130ce0 0x7ff8c4131150 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009480 tx=0x7ff8bc00ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc0b44171f1d89f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.523+0000 7ff8c1d9b700 1 -- 172.21.15.146:0/314677036 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc00d720 con 0x7ff8c4130ce0 2023-10-03T10:17:15.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.523+0000 7ff8c1d9b700 1 -- 172.21.15.146:0/314677036 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc00c040 con 0x7ff8c4130ce0 2023-10-03T10:17:15.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.523+0000 7ff8c1d9b700 1 -- 172.21.15.146:0/314677036 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc00a240 con 0x7ff8c4130ce0 2023-10-03T10:17:15.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.524+0000 7ff8c9122700 1 -- 172.21.15.146:0/314677036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8c4130ce0 msgr2=0x7ff8c4131150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.524+0000 7ff8c9122700 1 --2- 172.21.15.146:0/314677036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8c4130ce0 0x7ff8c4131150 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009480 tx=0x7ff8bc00ab20 comp rx=0 tx=0).stop 2023-10-03T10:17:15.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.524+0000 7ff8c9122700 1 -- 172.21.15.146:0/314677036 shutdown_connections 2023-10-03T10:17:15.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.524+0000 7ff8c9122700 1 --2- 172.21.15.146:0/314677036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8c4130ce0 0x7ff8c4131150 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.524+0000 7ff8c9122700 1 --2- 172.21.15.146:0/314677036 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8c409d860 0x7ff8c409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.524+0000 7ff8c9122700 1 --2- 172.21.15.146:0/314677036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8c409e170 0x7ff8c41307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.524+0000 7ff8c9122700 1 -- 172.21.15.146:0/314677036 >> 172.21.15.146:0/314677036 conn(0x7ff8c4099c40 msgr2=0x7ff8c40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.524+0000 7ff8c9122700 1 -- 172.21.15.146:0/314677036 shutdown_connections 2023-10-03T10:17:15.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.524+0000 7ff8c9122700 1 -- 172.21.15.146:0/314677036 wait complete. 2023-10-03T10:17:15.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.525+0000 7ff8c9122700 1 Processor -- start 2023-10-03T10:17:15.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.525+0000 7ff8c9122700 1 -- start start 2023-10-03T10:17:15.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.526+0000 7ff8c9122700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8c409d860 0x7ff8c411c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.526+0000 7ff8c9122700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8c409e170 0x7ff8c411c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.526+0000 7ff8c9122700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8c4130ce0 0x7ff8c411cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.526+0000 7ff8c9122700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c411fe40 con 0x7ff8c409e170 2023-10-03T10:17:15.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.526+0000 7ff8c9122700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c411f670 con 0x7ff8c409d860 2023-10-03T10:17:15.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.526+0000 7ff8c9122700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c409c8b0 con 0x7ff8c4130ce0 2023-10-03T10:17:15.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.526+0000 7ff8c259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8c409e170 0x7ff8c411c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.526+0000 7ff8c259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8c409e170 0x7ff8c411c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57926/0 (socket says 172.21.15.146:57926) 2023-10-03T10:17:15.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.526+0000 7ff8c259c700 1 -- 172.21.15.146:0/802536493 learned_addr learned my addr 172.21.15.146:0/802536493 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:15.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.526+0000 7ff8c2d9d700 1 --2- 172.21.15.146:0/802536493 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8c409d860 0x7ff8c411c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.526+0000 7ff8c359e700 1 --2- 172.21.15.146:0/802536493 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8c4130ce0 0x7ff8c411cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.526+0000 7ff8c259c700 1 -- 172.21.15.146:0/802536493 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8c4130ce0 msgr2=0x7ff8c411cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.526+0000 7ff8c259c700 1 --2- 172.21.15.146:0/802536493 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8c4130ce0 0x7ff8c411cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.526+0000 7ff8c259c700 1 -- 172.21.15.146:0/802536493 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8c409d860 msgr2=0x7ff8c411c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.526+0000 7ff8c259c700 1 --2- 172.21.15.146:0/802536493 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8c409d860 0x7ff8c411c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.526+0000 7ff8c259c700 1 -- 172.21.15.146:0/802536493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc00a530 con 0x7ff8c409e170 2023-10-03T10:17:15.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.526+0000 7ff8c259c700 1 --2- 172.21.15.146:0/802536493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8c409e170 0x7ff8c411c860 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8014360 tx=0x7ff8b8014670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.527+0000 7ff8ab7fe700 1 -- 172.21.15.146:0/802536493 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8016050 con 0x7ff8c409e170 2023-10-03T10:17:15.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.527+0000 7ff8ab7fe700 1 -- 172.21.15.146:0/802536493 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b8017040 con 0x7ff8c409e170 2023-10-03T10:17:15.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.527+0000 7ff8ab7fe700 1 -- 172.21.15.146:0/802536493 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b80112d0 con 0x7ff8c409e170 2023-10-03T10:17:15.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.527+0000 7ff8c9122700 1 -- 172.21.15.146:0/802536493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c411e4e0 con 0x7ff8c409e170 2023-10-03T10:17:15.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.527+0000 7ff8c9122700 1 -- 172.21.15.146:0/802536493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c411f8a0 con 0x7ff8c409e170 2023-10-03T10:17:15.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.527+0000 7ff8ab7fe700 1 -- 172.21.15.146:0/802536493 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff8b8011430 con 0x7ff8c409e170 2023-10-03T10:17:15.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.528+0000 7ff8ab7fe700 1 -- 172.21.15.146:0/802536493 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff8b8047b90 con 0x7ff8c409e170 2023-10-03T10:17:15.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.528+0000 7ff8c9122700 1 -- 172.21.15.146:0/802536493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c412e310 con 0x7ff8c409e170 2023-10-03T10:17:15.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.532+0000 7ff8ab7fe700 1 -- 172.21.15.146:0/802536493 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff8b800fa30 con 0x7ff8c409e170 2023-10-03T10:17:15.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.566+0000 7fa5a9886700 1 Processor -- start 2023-10-03T10:17:15.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.566+0000 7fa5a9886700 1 -- start start 2023-10-03T10:17:15.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.566+0000 7fa5a9886700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5a409e950 0x7fa5a409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.566+0000 7fa5a9886700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5a409f260 0x7fa5a4131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.566+0000 7fa5a9886700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa5a4131dd0 0x7fa5a4132250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.566+0000 7fa5a9886700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a409b6d0 con 0x7fa5a4131dd0 2023-10-03T10:17:15.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.566+0000 7fa5a9886700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a409afb0 con 0x7fa5a409e950 2023-10-03T10:17:15.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.566+0000 7fa5a9886700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a40a0970 con 0x7fa5a409f260 2023-10-03T10:17:15.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.567+0000 7fa5a37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa5a4131dd0 0x7fa5a4132250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.567+0000 7fa5a37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa5a4131dd0 0x7fa5a4132250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57942/0 (socket says 172.21.15.146:57942) 2023-10-03T10:17:15.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.567+0000 7fa5a37fe700 1 -- 172.21.15.146:0/1466156901 learned_addr learned my addr 172.21.15.146:0/1466156901 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:15.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.567+0000 7fa5a27fc700 1 --2- 172.21.15.146:0/1466156901 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5a409f260 0x7fa5a4131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.567+0000 7fa5a2ffd700 1 --2- 172.21.15.146:0/1466156901 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5a409e950 0x7fa5a409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.567+0000 7fa5a37fe700 1 -- 172.21.15.146:0/1466156901 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5a409f260 msgr2=0x7fa5a4131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:15.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.567+0000 7fa5a37fe700 1 --2- 172.21.15.146:0/1466156901 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5a409f260 0x7fa5a4131890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.567+0000 7fa5a37fe700 1 -- 172.21.15.146:0/1466156901 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5a409e950 msgr2=0x7fa5a409ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:15.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.567+0000 7fa5a37fe700 1 --2- 172.21.15.146:0/1466156901 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5a409e950 0x7fa5a409ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.567+0000 7fa5a37fe700 1 -- 172.21.15.146:0/1466156901 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a40a0320 con 0x7fa5a4131dd0 2023-10-03T10:17:15.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.567+0000 7fa5a37fe700 1 --2- 172.21.15.146:0/1466156901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5a4131dd0 0x7fa5a4132250 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fa59c009e50 tx=0x7fa59c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2f5fba0daf2f89 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.567+0000 7fa5a1ffb700 1 -- 172.21.15.146:0/1466156901 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c00e070 con 0x7fa5a4131dd0 2023-10-03T10:17:15.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.567+0000 7fa5a1ffb700 1 -- 172.21.15.146:0/1466156901 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59c00b910 con 0x7fa5a4131dd0 2023-10-03T10:17:15.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.567+0000 7fa5a1ffb700 1 -- 172.21.15.146:0/1466156901 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c00bcc0 con 0x7fa5a4131dd0 2023-10-03T10:17:15.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.568+0000 7fa5a9886700 1 -- 172.21.15.146:0/1466156901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5a4131dd0 msgr2=0x7fa5a4132250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.568+0000 7fa5a9886700 1 --2- 172.21.15.146:0/1466156901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5a4131dd0 0x7fa5a4132250 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fa59c009e50 tx=0x7fa59c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:15.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.568+0000 7fa5a9886700 1 -- 172.21.15.146:0/1466156901 shutdown_connections 2023-10-03T10:17:15.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.568+0000 7fa5a9886700 1 --2- 172.21.15.146:0/1466156901 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5a409e950 0x7fa5a409ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.568+0000 7fa5a9886700 1 --2- 172.21.15.146:0/1466156901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5a4131dd0 0x7fa5a4132250 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.568+0000 7fa5a9886700 1 --2- 172.21.15.146:0/1466156901 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5a409f260 0x7fa5a4131890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.568+0000 7fa5a9886700 1 -- 172.21.15.146:0/1466156901 >> 172.21.15.146:0/1466156901 conn(0x7fa5a40a0f70 msgr2=0x7fa5a40a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.568+0000 7fa5a9886700 1 -- 172.21.15.146:0/1466156901 shutdown_connections 2023-10-03T10:17:15.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.568+0000 7fa5a9886700 1 -- 172.21.15.146:0/1466156901 wait complete. 2023-10-03T10:17:15.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.569+0000 7fa5a9886700 1 Processor -- start 2023-10-03T10:17:15.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.569+0000 7fa5a9886700 1 -- start start 2023-10-03T10:17:15.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.569+0000 7fa5a9886700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5a409e950 0x7fa5a41c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.569+0000 7fa5a9886700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5a409f260 0x7fa5a41c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.569+0000 7fa5a9886700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5a4131dd0 0x7fa5a41c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.569+0000 7fa5a9886700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a411e6a0 con 0x7fa5a4131dd0 2023-10-03T10:17:15.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.569+0000 7fa5a9886700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a41318d0 con 0x7fa5a409f260 2023-10-03T10:17:15.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.569+0000 7fa5a9886700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a411fe50 con 0x7fa5a409e950 2023-10-03T10:17:15.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.570+0000 7fa5a2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5a409e950 0x7fa5a41c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.570+0000 7fa5a2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5a409e950 0x7fa5a41c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51208/0 (socket says 172.21.15.146:51208) 2023-10-03T10:17:15.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.570+0000 7fa5a2ffd700 1 -- 172.21.15.146:0/3797027117 learned_addr learned my addr 172.21.15.146:0/3797027117 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:15.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.570+0000 7fa5a37fe700 1 --2- 172.21.15.146:0/3797027117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5a4131dd0 0x7fa5a41c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.570+0000 7fa5a27fc700 1 --2- 172.21.15.146:0/3797027117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5a409f260 0x7fa5a41c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.570+0000 7fa5a2ffd700 1 -- 172.21.15.146:0/3797027117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5a409f260 msgr2=0x7fa5a41c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.570+0000 7fa5a2ffd700 1 --2- 172.21.15.146:0/3797027117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5a409f260 0x7fa5a41c63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.570+0000 7fa5a2ffd700 1 -- 172.21.15.146:0/3797027117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5a4131dd0 msgr2=0x7fa5a41c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.570+0000 7fa5a2ffd700 1 --2- 172.21.15.146:0/3797027117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5a4131dd0 0x7fa5a41c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.570+0000 7fa5a2ffd700 1 -- 172.21.15.146:0/3797027117 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c009b30 con 0x7fa5a409e950 2023-10-03T10:17:15.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.570+0000 7fa5a2ffd700 1 --2- 172.21.15.146:0/3797027117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5a409e950 0x7fa5a41c5ea0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa59400e990 tx=0x7fa59400eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.570+0000 7fa58bfff700 1 -- 172.21.15.146:0/3797027117 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5940096f0 con 0x7fa5a409e950 2023-10-03T10:17:15.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.570+0000 7fa58bfff700 1 -- 172.21.15.146:0/3797027117 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59400c850 con 0x7fa5a409e950 2023-10-03T10:17:15.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.570+0000 7fa5a9886700 1 -- 172.21.15.146:0/3797027117 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a409da40 con 0x7fa5a409e950 2023-10-03T10:17:15.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.570+0000 7fa58bfff700 1 -- 172.21.15.146:0/3797027117 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59400eee0 con 0x7fa5a409e950 2023-10-03T10:17:15.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.570+0000 7fa5a9886700 1 -- 172.21.15.146:0/3797027117 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a4120b80 con 0x7fa5a409e950 2023-10-03T10:17:15.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.571+0000 7fa58bfff700 1 -- 172.21.15.146:0/3797027117 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa59400cbc0 con 0x7fa5a409e950 2023-10-03T10:17:15.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.571+0000 7fa58bfff700 1 -- 172.21.15.146:0/3797027117 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa59403fc40 con 0x7fa5a409e950 2023-10-03T10:17:15.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.571+0000 7fa5a9886700 1 -- 172.21.15.146:0/3797027117 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a404f2a0 con 0x7fa5a409e950 2023-10-03T10:17:15.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.576+0000 7fa58bfff700 1 -- 172.21.15.146:0/3797027117 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa594021020 con 0x7fa5a409e950 2023-10-03T10:17:15.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.597+0000 7f24f66be700 1 -- 172.21.15.146:0/254235124 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f24f006c3b0 con 0x7f24f0133ad0 2023-10-03T10:17:15.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.597+0000 7f24ecff9700 1 -- 172.21.15.146:0/254235124 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f24e801a380 con 0x7f24f0133ad0 2023-10-03T10:17:15.598 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:15.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.600+0000 7f24f66be700 1 -- 172.21.15.146:0/254235124 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24f0133ad0 msgr2=0x7f24f011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.600+0000 7f24f66be700 1 --2- 172.21.15.146:0/254235124 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24f0133ad0 0x7f24f011e4c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f24e8014040 tx=0x7f24e8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.600+0000 7f24f66be700 1 -- 172.21.15.146:0/254235124 shutdown_connections 2023-10-03T10:17:15.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.600+0000 7f24f66be700 1 --2- 172.21.15.146:0/254235124 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24f0133ad0 0x7f24f011e4c0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.600+0000 7f24f66be700 1 --2- 172.21.15.146:0/254235124 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24f01300a0 0x7f24f011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.600+0000 7f24f66be700 1 --2- 172.21.15.146:0/254235124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24f0130bc0 0x7f24f011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.600+0000 7f24f66be700 1 -- 172.21.15.146:0/254235124 >> 172.21.15.146:0/254235124 conn(0x7f24f0099c40 msgr2=0x7f24f012e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.600+0000 7f24f66be700 1 -- 172.21.15.146:0/254235124 shutdown_connections 2023-10-03T10:17:15.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.600+0000 7f24f66be700 1 -- 172.21.15.146:0/254235124 wait complete. 2023-10-03T10:17:15.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:15.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.731+0000 7ff8c9122700 1 -- 172.21.15.146:0/802536493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff8c404f2a0 con 0x7ff8c409e170 2023-10-03T10:17:15.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.731+0000 7ff8ab7fe700 1 -- 172.21.15.146:0/802536493 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff8b801a360 con 0x7ff8c409e170 2023-10-03T10:17:15.732 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:15.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.734+0000 7ff8c9122700 1 -- 172.21.15.146:0/802536493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8c409e170 msgr2=0x7ff8c411c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.734+0000 7ff8c9122700 1 --2- 172.21.15.146:0/802536493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8c409e170 0x7ff8c411c860 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8014360 tx=0x7ff8b8014670 comp rx=0 tx=0).stop 2023-10-03T10:17:15.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.734+0000 7ff8c9122700 1 -- 172.21.15.146:0/802536493 shutdown_connections 2023-10-03T10:17:15.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.734+0000 7ff8c9122700 1 --2- 172.21.15.146:0/802536493 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8c4130ce0 0x7ff8c411cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.734+0000 7ff8c9122700 1 --2- 172.21.15.146:0/802536493 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8c409d860 0x7ff8c411c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.734+0000 7ff8c9122700 1 --2- 172.21.15.146:0/802536493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8c409e170 0x7ff8c411c860 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.734+0000 7ff8c9122700 1 -- 172.21.15.146:0/802536493 >> 172.21.15.146:0/802536493 conn(0x7ff8c4099c40 msgr2=0x7ff8c412e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.734+0000 7ff8c9122700 1 -- 172.21.15.146:0/802536493 shutdown_connections 2023-10-03T10:17:15.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.734+0000 7ff8c9122700 1 -- 172.21.15.146:0/802536493 wait complete. 2023-10-03T10:17:15.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:15.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.770+0000 7fa5a9886700 1 -- 172.21.15.146:0/3797027117 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa5a409b8b0 con 0x7fa5a409e950 2023-10-03T10:17:15.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.770+0000 7fa58bfff700 1 -- 172.21.15.146:0/3797027117 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa594017070 con 0x7fa5a409e950 2023-10-03T10:17:15.771 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:15.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.772+0000 7fa5a9886700 1 -- 172.21.15.146:0/3797027117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5a409e950 msgr2=0x7fa5a41c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.772+0000 7fa5a9886700 1 --2- 172.21.15.146:0/3797027117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5a409e950 0x7fa5a41c5ea0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa59400e990 tx=0x7fa59400eca0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.772+0000 7fa5a9886700 1 -- 172.21.15.146:0/3797027117 shutdown_connections 2023-10-03T10:17:15.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.772+0000 7fa5a9886700 1 --2- 172.21.15.146:0/3797027117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5a4131dd0 0x7fa5a41c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.772+0000 7fa5a9886700 1 --2- 172.21.15.146:0/3797027117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa5a409e950 0x7fa5a41c5ea0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.772+0000 7fa5a9886700 1 --2- 172.21.15.146:0/3797027117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5a409f260 0x7fa5a41c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.772+0000 7fa5a9886700 1 -- 172.21.15.146:0/3797027117 >> 172.21.15.146:0/3797027117 conn(0x7fa5a40a0f70 msgr2=0x7fa5a40a2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.772+0000 7fa5a9886700 1 -- 172.21.15.146:0/3797027117 shutdown_connections 2023-10-03T10:17:15.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.772+0000 7fa5a9886700 1 -- 172.21.15.146:0/3797027117 wait complete. 2023-10-03T10:17:15.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:15.801 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:15.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.947+0000 7f2beebc0700 1 Processor -- start 2023-10-03T10:17:15.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.947+0000 7f2beebc0700 1 -- start start 2023-10-03T10:17:15.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.948+0000 7f2beebc0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2be8133900 0x7f2be8133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.948+0000 7f2beebc0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2be8134210 0x7f2be80a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.948+0000 7f2beebc0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be809a760 con 0x7f2be80a0ee0 2023-10-03T10:17:15.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.948+0000 7f2beebc0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be81336e0 con 0x7f2be8134210 2023-10-03T10:17:15.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.948+0000 7f2beebc0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2be809a080 con 0x7f2be8133900 2023-10-03T10:17:15.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.948+0000 7f2bec95c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2be8133900 0x7f2be8133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.948+0000 7f2bec95c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2be8133900 0x7f2be8133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51222/0 (socket says 172.21.15.146:51222) 2023-10-03T10:17:15.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.948+0000 7f2bec95c700 1 -- 172.21.15.146:0/1036668712 learned_addr learned my addr 172.21.15.146:0/1036668712 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:15.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.948+0000 7f2be7fff700 1 --2- 172.21.15.146:0/1036668712 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2be8134210 0x7f2be80a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.948+0000 7f2be77fe700 1 -- 172.21.15.146:0/1036668712 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646136453 0 0) 0x7f2be809a760 con 0x7f2be80a0ee0 2023-10-03T10:17:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.948+0000 7f2be7fff700 1 -- 172.21.15.146:0/1036668712 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2be8133900 msgr2=0x7f2be8133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.948+0000 7f2be7fff700 1 --2- 172.21.15.146:0/1036668712 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2be8133900 0x7f2be8133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.948+0000 7f2be7fff700 1 -- 172.21.15.146:0/1036668712 >> v1:172.21.15.146:6789/0 conn(0x7f2be80a0ee0 legacy=0x7f2be813a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.948+0000 7f2be7fff700 1 -- 172.21.15.146:0/1036668712 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be80a23e0 con 0x7f2be8134210 2023-10-03T10:17:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.948+0000 7f2bec95c700 1 --2- 172.21.15.146:0/1036668712 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2be8133900 0x7f2be8133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.948+0000 7f2be7fff700 1 --2- 172.21.15.146:0/1036668712 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2be8134210 0x7f2be80a09a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4009870 tx=0x7f2bd4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ea92506cad9a6e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.948+0000 7f2be77fe700 1 -- 172.21.15.146:0/1036668712 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4011830 con 0x7f2be8134210 2023-10-03T10:17:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.948+0000 7f2be77fe700 1 -- 172.21.15.146:0/1036668712 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd4011990 con 0x7f2be8134210 2023-10-03T10:17:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.948+0000 7f2be77fe700 1 -- 172.21.15.146:0/1036668712 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4011d20 con 0x7f2be8134210 2023-10-03T10:17:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.949+0000 7f2beebc0700 1 -- 172.21.15.146:0/1036668712 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2be8134210 msgr2=0x7f2be80a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.949+0000 7f2beebc0700 1 --2- 172.21.15.146:0/1036668712 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2be8134210 0x7f2be80a09a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4009870 tx=0x7f2bd4009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.949+0000 7f2beebc0700 1 -- 172.21.15.146:0/1036668712 shutdown_connections 2023-10-03T10:17:15.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.949+0000 7f2beebc0700 1 --2- 172.21.15.146:0/1036668712 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2be8133900 0x7f2be8133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.949+0000 7f2beebc0700 1 --2- 172.21.15.146:0/1036668712 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2be8134210 0x7f2be80a09a0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.949+0000 7f2beebc0700 1 -- 172.21.15.146:0/1036668712 >> 172.21.15.146:0/1036668712 conn(0x7f2be80a2980 msgr2=0x7f2be80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.949+0000 7f2beebc0700 1 -- 172.21.15.146:0/1036668712 shutdown_connections 2023-10-03T10:17:15.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.949+0000 7f2beebc0700 1 -- 172.21.15.146:0/1036668712 wait complete. 2023-10-03T10:17:15.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.950+0000 7f2beebc0700 1 Processor -- start 2023-10-03T10:17:15.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.950+0000 7f2beebc0700 1 -- start start 2023-10-03T10:17:15.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.950+0000 7f2beebc0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2be80a0ee0 0x7f2be811d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2beebc0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2be8133900 0x7f2be811dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2beebc0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2be8134210 0x7f2be811e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2beebc0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be81209f0 con 0x7f2be8133900 2023-10-03T10:17:15.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2beebc0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be809a2c0 con 0x7f2be8134210 2023-10-03T10:17:15.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2beebc0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2be8132ce0 con 0x7f2be80a0ee0 2023-10-03T10:17:15.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2bec95c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2be80a0ee0 0x7f2be811d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2bed15d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2be8134210 0x7f2be811e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2be7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2be8133900 0x7f2be811dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2bec95c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2be80a0ee0 0x7f2be811d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51228/0 (socket says 172.21.15.146:51228) 2023-10-03T10:17:15.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2bec95c700 1 -- 172.21.15.146:0/1206446869 learned_addr learned my addr 172.21.15.146:0/1206446869 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:15.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2bec95c700 1 -- 172.21.15.146:0/1206446869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2be8134210 msgr2=0x7f2be811e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2bec95c700 1 --2- 172.21.15.146:0/1206446869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2be8134210 0x7f2be811e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2bec95c700 1 -- 172.21.15.146:0/1206446869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2be8133900 msgr2=0x7f2be811dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2bec95c700 1 --2- 172.21.15.146:0/1206446869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2be8133900 0x7f2be811dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2bec95c700 1 -- 172.21.15.146:0/1206446869 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc009500 con 0x7f2be80a0ee0 2023-10-03T10:17:15.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2bed15d700 1 --2- 172.21.15.146:0/1206446869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2be8134210 0x7f2be811e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:15.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2be7fff700 1 --2- 172.21.15.146:0/1206446869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2be8133900 0x7f2be811dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:15.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2bec95c700 1 --2- 172.21.15.146:0/1206446869 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2be80a0ee0 0x7f2be811d740 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc00ebb0 tx=0x7f2bdc00eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2be57fa700 1 -- 172.21.15.146:0/1206446869 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc005a20 con 0x7f2be80a0ee0 2023-10-03T10:17:15.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2be57fa700 1 -- 172.21.15.146:0/1206446869 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bdc005b80 con 0x7f2be80a0ee0 2023-10-03T10:17:15.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2beebc0700 1 -- 172.21.15.146:0/1206446869 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd40094a0 con 0x7f2be80a0ee0 2023-10-03T10:17:15.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2be57fa700 1 -- 172.21.15.146:0/1206446869 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc00c850 con 0x7f2be80a0ee0 2023-10-03T10:17:15.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.951+0000 7f2beebc0700 1 -- 172.21.15.146:0/1206446869 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be81205a0 con 0x7f2be80a0ee0 2023-10-03T10:17:15.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.952+0000 7f2beebc0700 1 -- 172.21.15.146:0/1206446869 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be811a590 con 0x7f2be80a0ee0 2023-10-03T10:17:15.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.953+0000 7f2be57fa700 1 -- 172.21.15.146:0/1206446869 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2bdc00c9b0 con 0x7f2be80a0ee0 2023-10-03T10:17:15.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.953+0000 7f2be57fa700 1 -- 172.21.15.146:0/1206446869 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2bdc03ff30 con 0x7f2be80a0ee0 2023-10-03T10:17:15.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:15.957+0000 7f2be57fa700 1 -- 172.21.15.146:0/1206446869 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2bdc006030 con 0x7f2be80a0ee0 2023-10-03T10:17:16.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.142+0000 7f2beebc0700 1 -- 172.21.15.146:0/1206446869 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2be8120c20 con 0x7f2be80a0ee0 2023-10-03T10:17:16.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.143+0000 7f2be57fa700 1 -- 172.21.15.146:0/1206446869 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2be8120c20 con 0x7f2be80a0ee0 2023-10-03T10:17:16.143 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:16.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.145+0000 7f2beebc0700 1 -- 172.21.15.146:0/1206446869 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2be80a0ee0 msgr2=0x7f2be811d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.145+0000 7f2beebc0700 1 --2- 172.21.15.146:0/1206446869 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2be80a0ee0 0x7f2be811d740 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc00ebb0 tx=0x7f2bdc00eec0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.145+0000 7f2beebc0700 1 -- 172.21.15.146:0/1206446869 shutdown_connections 2023-10-03T10:17:16.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.145+0000 7f2beebc0700 1 --2- 172.21.15.146:0/1206446869 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2be8134210 0x7f2be811e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.145+0000 7f2beebc0700 1 --2- 172.21.15.146:0/1206446869 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2be80a0ee0 0x7f2be811d740 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.145+0000 7f2beebc0700 1 --2- 172.21.15.146:0/1206446869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2be8133900 0x7f2be811dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.145+0000 7f2beebc0700 1 -- 172.21.15.146:0/1206446869 >> 172.21.15.146:0/1206446869 conn(0x7f2be80a2980 msgr2=0x7f2be81bac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.145+0000 7f2beebc0700 1 -- 172.21.15.146:0/1206446869 shutdown_connections 2023-10-03T10:17:16.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.145+0000 7f2beebc0700 1 -- 172.21.15.146:0/1206446869 wait complete. 2023-10-03T10:17:16.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:16.614 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:16.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.737+0000 7fa2a379a700 1 Processor -- start 2023-10-03T10:17:16.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.738+0000 7fa2a379a700 1 -- start start 2023-10-03T10:17:16.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.738+0000 7fa2a379a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa29c09d860 0x7fa29c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.738+0000 7fa2a379a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa29c130eb0 0x7fa29c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.738+0000 7fa2a379a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29c09aaa0 con 0x7fa29c09e170 2023-10-03T10:17:16.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.738+0000 7fa2a379a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29c09f870 con 0x7fa29c130eb0 2023-10-03T10:17:16.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.738+0000 7fa2a379a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c09b360 con 0x7fa29c09d860 2023-10-03T10:17:16.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.738+0000 7fa2a1d37700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa29c130eb0 0x7fa29c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.738+0000 7fa2a1536700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa29c09d860 0x7fa29c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.738+0000 7fa2a1d37700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa29c130eb0 0x7fa29c138a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57956/0 (socket says 172.21.15.146:57956) 2023-10-03T10:17:16.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.738+0000 7fa2a1536700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa29c09d860 0x7fa29c09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35180/0 (socket says 172.21.15.146:35180) 2023-10-03T10:17:16.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.738+0000 7fa2a0d35700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa29c09e170 0x7fa29c1307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59142/0 (socket says 172.21.15.146:59142) 2023-10-03T10:17:16.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.738+0000 7fa2a1d37700 1 -- 172.21.15.146:0/1765705866 learned_addr learned my addr 172.21.15.146:0/1765705866 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:16.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.738+0000 7fa2a1536700 1 -- 172.21.15.146:0/1765705866 >> v2:172.21.15.146:3300/0 conn(0x7fa29c130eb0 msgr2=0x7fa29c138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:16.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.738+0000 7fa2a1536700 1 --2- 172.21.15.146:0/1765705866 >> v2:172.21.15.146:3300/0 conn(0x7fa29c130eb0 0x7fa29c138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.738+0000 7fa2a1536700 1 -- 172.21.15.146:0/1765705866 >> v1:172.21.15.146:6789/0 conn(0x7fa29c09e170 legacy=0x7fa29c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.738+0000 7fa28ffff700 1 -- 172.21.15.146:0/1765705866 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945813649 0 0) 0x7fa29c09aaa0 con 0x7fa29c09e170 2023-10-03T10:17:16.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.738+0000 7fa2a1536700 1 -- 172.21.15.146:0/1765705866 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c09b620 con 0x7fa29c09d860 2023-10-03T10:17:16.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.738+0000 7fa2a1d37700 1 --2- 172.21.15.146:0/1765705866 >> v2:172.21.15.146:3300/0 conn(0x7fa29c130eb0 0x7fa29c138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:16.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.739+0000 7fa2a1536700 1 --2- 172.21.15.146:0/1765705866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa29c09d860 0x7fa29c09dc30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fa290009840 tx=0x7fa290009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a953ff7eee0b232 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.739+0000 7fa28ffff700 1 -- 172.21.15.146:0/1765705866 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa290011830 con 0x7fa29c09d860 2023-10-03T10:17:16.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.739+0000 7fa28ffff700 1 -- 172.21.15.146:0/1765705866 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa290011990 con 0x7fa29c09d860 2023-10-03T10:17:16.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.739+0000 7fa28ffff700 1 -- 172.21.15.146:0/1765705866 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa290011d20 con 0x7fa29c09d860 2023-10-03T10:17:16.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.739+0000 7fa2a379a700 1 -- 172.21.15.146:0/1765705866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa29c09d860 msgr2=0x7fa29c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.739+0000 7fa2a379a700 1 --2- 172.21.15.146:0/1765705866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa29c09d860 0x7fa29c09dc30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fa290009840 tx=0x7fa290009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:16.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.739+0000 7fa2a379a700 1 -- 172.21.15.146:0/1765705866 shutdown_connections 2023-10-03T10:17:16.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.739+0000 7fa2a379a700 1 --2- 172.21.15.146:0/1765705866 >> v2:172.21.15.146:3300/0 conn(0x7fa29c130eb0 0x7fa29c138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.739+0000 7fa2a379a700 1 --2- 172.21.15.146:0/1765705866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa29c09d860 0x7fa29c09dc30 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.739+0000 7fa2a379a700 1 -- 172.21.15.146:0/1765705866 >> 172.21.15.146:0/1765705866 conn(0x7fa29c099c40 msgr2=0x7fa29c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.739+0000 7fa2a379a700 1 -- 172.21.15.146:0/1765705866 shutdown_connections 2023-10-03T10:17:16.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.739+0000 7fa2a379a700 1 -- 172.21.15.146:0/1765705866 wait complete. 2023-10-03T10:17:16.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.741+0000 7fa2a379a700 1 Processor -- start 2023-10-03T10:17:16.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.741+0000 7fa2a379a700 1 -- start start 2023-10-03T10:17:16.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.741+0000 7fa2a379a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa29c09d860 0x7fa29c11f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.741+0000 7fa2a379a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa29c09e170 0x7fa29c11f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.741+0000 7fa2a379a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa29c130eb0 0x7fa29c11fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.741+0000 7fa2a379a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c09c8b0 con 0x7fa29c09d860 2023-10-03T10:17:16.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.741+0000 7fa2a379a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c122bc0 con 0x7fa29c130eb0 2023-10-03T10:17:16.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.741+0000 7fa2a379a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c0a0770 con 0x7fa29c09e170 2023-10-03T10:17:16.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.741+0000 7fa2a1536700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa29c09d860 0x7fa29c11f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.741+0000 7fa2a1536700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa29c09d860 0x7fa29c11f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57970/0 (socket says 172.21.15.146:57970) 2023-10-03T10:17:16.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.741+0000 7fa2a0d35700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa29c09e170 0x7fa29c11f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.741+0000 7fa2a1536700 1 -- 172.21.15.146:0/578488126 learned_addr learned my addr 172.21.15.146:0/578488126 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:16.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.741+0000 7fa2a1d37700 1 --2- 172.21.15.146:0/578488126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa29c130eb0 0x7fa29c11fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.742+0000 7fa2a1536700 1 -- 172.21.15.146:0/578488126 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa29c09e170 msgr2=0x7fa29c11f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.742+0000 7fa2a1536700 1 --2- 172.21.15.146:0/578488126 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa29c09e170 0x7fa29c11f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.742+0000 7fa2a1536700 1 -- 172.21.15.146:0/578488126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa29c130eb0 msgr2=0x7fa29c11fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.742+0000 7fa2a1536700 1 --2- 172.21.15.146:0/578488126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa29c130eb0 0x7fa29c11fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.742+0000 7fa2a1536700 1 -- 172.21.15.146:0/578488126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa294009b30 con 0x7fa29c09d860 2023-10-03T10:17:16.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.742+0000 7fa2a1536700 1 --2- 172.21.15.146:0/578488126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa29c09d860 0x7fa29c11f420 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fa290009fd0 tx=0x7fa290004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.742+0000 7fa28dffb700 1 -- 172.21.15.146:0/578488126 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa290004480 con 0x7fa29c09d860 2023-10-03T10:17:16.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.742+0000 7fa28dffb700 1 -- 172.21.15.146:0/578488126 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29001f070 con 0x7fa29c09d860 2023-10-03T10:17:16.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.742+0000 7fa2a379a700 1 -- 172.21.15.146:0/578488126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2900094a0 con 0x7fa29c09d860 2023-10-03T10:17:16.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.742+0000 7fa28dffb700 1 -- 172.21.15.146:0/578488126 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900038e0 con 0x7fa29c09d860 2023-10-03T10:17:16.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.742+0000 7fa2a379a700 1 -- 172.21.15.146:0/578488126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29c12fea0 con 0x7fa29c09d860 2023-10-03T10:17:16.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.743+0000 7fa28dffb700 1 -- 172.21.15.146:0/578488126 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa290021030 con 0x7fa29c09d860 2023-10-03T10:17:16.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.743+0000 7fa28dffb700 1 -- 172.21.15.146:0/578488126 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa2900407e0 con 0x7fa29c09d860 2023-10-03T10:17:16.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.743+0000 7fa2a379a700 1 -- 172.21.15.146:0/578488126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29c1236f0 con 0x7fa29c09d860 2023-10-03T10:17:16.747 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:16.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.748+0000 7fa28dffb700 1 -- 172.21.15.146:0/578488126 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa290003a40 con 0x7fa29c09d860 2023-10-03T10:17:16.785 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:16.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.873+0000 7f58656a0700 1 Processor -- start 2023-10-03T10:17:16.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.873+0000 7f58656a0700 1 -- start start 2023-10-03T10:17:16.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.873+0000 7f58656a0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f586009e870 0x7f586009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.873+0000 7f58656a0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f586009f180 0x7f5860133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.873+0000 7f58656a0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f586009fa00 con 0x7f5860134160 2023-10-03T10:17:16.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.873+0000 7f58656a0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58600a0370 con 0x7f586009e870 2023-10-03T10:17:16.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.873+0000 7f58656a0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f586006bec0 con 0x7f586009f180 2023-10-03T10:17:16.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.874+0000 7f585effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f586009e870 0x7f586009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.874+0000 7f585f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5860134160 0x7f586013ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59144/0 (socket says 172.21.15.146:59144) 2023-10-03T10:17:16.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.874+0000 7f585f7fe700 1 -- 172.21.15.146:0/2749188114 learned_addr learned my addr 172.21.15.146:0/2749188114 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:16.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.874+0000 7f585e7fc700 1 --2- 172.21.15.146:0/2749188114 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f586009f180 0x7f5860133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.874+0000 7f585effd700 1 -- 172.21.15.146:0/2749188114 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f586009f180 msgr2=0x7f5860133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:16.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.874+0000 7f585effd700 1 --2- 172.21.15.146:0/2749188114 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f586009f180 0x7f5860133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.874+0000 7f585effd700 1 -- 172.21.15.146:0/2749188114 >> v1:172.21.15.146:6789/0 conn(0x7f5860134160 legacy=0x7f586013ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.874+0000 7f585effd700 1 -- 172.21.15.146:0/2749188114 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586009ada0 con 0x7f586009e870 2023-10-03T10:17:16.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.874+0000 7f585effd700 1 --2- 172.21.15.146:0/2749188114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f586009e870 0x7f586009ec40 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f5850009840 tx=0x7f5850009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae11303d1ca9652 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.874+0000 7f585dffb700 1 -- 172.21.15.146:0/2749188114 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850011830 con 0x7f586009e870 2023-10-03T10:17:16.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.874+0000 7f585dffb700 1 -- 172.21.15.146:0/2749188114 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5850011990 con 0x7f586009e870 2023-10-03T10:17:16.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.874+0000 7f585dffb700 1 -- 172.21.15.146:0/2749188114 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850011d20 con 0x7f586009e870 2023-10-03T10:17:16.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.875+0000 7f58656a0700 1 -- 172.21.15.146:0/2749188114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f586009e870 msgr2=0x7f586009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.875+0000 7f58656a0700 1 --2- 172.21.15.146:0/2749188114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f586009e870 0x7f586009ec40 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f5850009840 tx=0x7f5850009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:16.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.875+0000 7f58656a0700 1 -- 172.21.15.146:0/2749188114 shutdown_connections 2023-10-03T10:17:16.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.875+0000 7f58656a0700 1 --2- 172.21.15.146:0/2749188114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f586009e870 0x7f586009ec40 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.875+0000 7f58656a0700 1 --2- 172.21.15.146:0/2749188114 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f586009f180 0x7f5860133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.875+0000 7f58656a0700 1 -- 172.21.15.146:0/2749188114 >> 172.21.15.146:0/2749188114 conn(0x7f58600a4430 msgr2=0x7f58600a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.875+0000 7f58656a0700 1 -- 172.21.15.146:0/2749188114 shutdown_connections 2023-10-03T10:17:16.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.875+0000 7f58656a0700 1 -- 172.21.15.146:0/2749188114 wait complete. 2023-10-03T10:17:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.876+0000 7f58656a0700 1 Processor -- start 2023-10-03T10:17:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.876+0000 7f58656a0700 1 -- start start 2023-10-03T10:17:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.877+0000 7f58656a0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f586009e870 0x7f5860122b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.877+0000 7f58656a0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f586009f180 0x7f5860123040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.877+0000 7f58656a0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5860134160 0x7f5860123580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.877+0000 7f58656a0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5860124890 con 0x7f5860134160 2023-10-03T10:17:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.877+0000 7f58656a0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5860124f70 con 0x7f586009e870 2023-10-03T10:17:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.877+0000 7f58656a0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f586006cfa0 con 0x7f586009f180 2023-10-03T10:17:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.877+0000 7f585effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f586009e870 0x7f5860122b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.877+0000 7f585f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5860134160 0x7f5860123580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.877+0000 7f585effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f586009e870 0x7f5860122b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35186/0 (socket says 172.21.15.146:35186) 2023-10-03T10:17:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.877+0000 7f585effd700 1 -- 172.21.15.146:0/350921208 learned_addr learned my addr 172.21.15.146:0/350921208 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.877+0000 7f585e7fc700 1 --2- 172.21.15.146:0/350921208 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f586009f180 0x7f5860123040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.877+0000 7f585f7fe700 1 -- 172.21.15.146:0/350921208 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f586009f180 msgr2=0x7f5860123040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.877+0000 7f585f7fe700 1 --2- 172.21.15.146:0/350921208 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f586009f180 0x7f5860123040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.877+0000 7f585f7fe700 1 -- 172.21.15.146:0/350921208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f586009e870 msgr2=0x7f5860122b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.877+0000 7f585f7fe700 1 --2- 172.21.15.146:0/350921208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f586009e870 0x7f5860122b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.878+0000 7f585f7fe700 1 -- 172.21.15.146:0/350921208 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58500094a0 con 0x7f5860134160 2023-10-03T10:17:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.878+0000 7f585effd700 1 --2- 172.21.15.146:0/350921208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f586009e870 0x7f5860122b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:16.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.878+0000 7f585e7fc700 1 --2- 172.21.15.146:0/350921208 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f586009f180 0x7f5860123040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:16.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.878+0000 7f585f7fe700 1 --2- 172.21.15.146:0/350921208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5860134160 0x7f5860123580 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f585800cb00 tx=0x7f585800ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.878+0000 7f58477fe700 1 -- 172.21.15.146:0/350921208 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585800aa20 con 0x7f5860134160 2023-10-03T10:17:16.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.878+0000 7f58477fe700 1 -- 172.21.15.146:0/350921208 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585800ab80 con 0x7f5860134160 2023-10-03T10:17:16.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.878+0000 7f58656a0700 1 -- 172.21.15.146:0/350921208 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5860126620 con 0x7f5860134160 2023-10-03T10:17:16.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.878+0000 7f58477fe700 1 -- 172.21.15.146:0/350921208 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5858012400 con 0x7f5860134160 2023-10-03T10:17:16.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.878+0000 7f58656a0700 1 -- 172.21.15.146:0/350921208 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5860126340 con 0x7f5860134160 2023-10-03T10:17:16.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.879+0000 7f58477fe700 1 -- 172.21.15.146:0/350921208 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f585801b3b0 con 0x7f5860134160 2023-10-03T10:17:16.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.879+0000 7f58477fe700 1 -- 172.21.15.146:0/350921208 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f585803f280 con 0x7f5860134160 2023-10-03T10:17:16.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.879+0000 7f58656a0700 1 -- 172.21.15.146:0/350921208 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f586004f2a0 con 0x7f5860134160 2023-10-03T10:17:16.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.884+0000 7f58477fe700 1 -- 172.21.15.146:0/350921208 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f58580192c0 con 0x7f5860134160 2023-10-03T10:17:16.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.917+0000 7fb2224f9700 1 Processor -- start 2023-10-03T10:17:16.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.917+0000 7fb2224f9700 1 -- start start 2023-10-03T10:17:16.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.918+0000 7fb2224f9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb21c136960 0x7fb21c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.918+0000 7fb2224f9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb21c139280 0x7fb21c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.918+0000 7fb2224f9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb21c06b2d0 con 0x7fb21c133ad0 2023-10-03T10:17:16.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.918+0000 7fb2224f9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c1345b0 con 0x7fb21c136960 2023-10-03T10:17:16.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.918+0000 7fb2224f9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c133610 con 0x7fb21c139280 2023-10-03T10:17:16.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.918+0000 7fb21b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb21c136960 0x7fb21c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.918+0000 7fb21b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb21c136960 0x7fb21c138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35188/0 (socket says 172.21.15.146:35188) 2023-10-03T10:17:16.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.918+0000 7fb21b7fe700 1 -- 172.21.15.146:0/2315327145 learned_addr learned my addr 172.21.15.146:0/2315327145 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:16.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.918+0000 7fb220a96700 1 --2- 172.21.15.146:0/2315327145 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb21c139280 0x7fb21c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.918+0000 7fb21b7fe700 1 -- 172.21.15.146:0/2315327145 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb21c139280 msgr2=0x7fb21c13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:16.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.918+0000 7fb21b7fe700 1 --2- 172.21.15.146:0/2315327145 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb21c139280 0x7fb21c13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.918+0000 7fb21b7fe700 1 -- 172.21.15.146:0/2315327145 >> v1:172.21.15.146:6789/0 conn(0x7fb21c133ad0 legacy=0x7fb21c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.918+0000 7fb21b7fe700 1 -- 172.21.15.146:0/2315327145 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21c09a500 con 0x7fb21c136960 2023-10-03T10:17:16.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.918+0000 7fb21affd700 1 -- 172.21.15.146:0/2315327145 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466425393 0 0) 0x7fb21c06b2d0 con 0x7fb21c133ad0 2023-10-03T10:17:16.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.919+0000 7fb220a96700 1 --2- 172.21.15.146:0/2315327145 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb21c139280 0x7fb21c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:16.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.919+0000 7fb21b7fe700 1 --2- 172.21.15.146:0/2315327145 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb21c136960 0x7fb21c138d40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb210009920 tx=0x7fb210009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eaf29b7f8fb6f47d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.919+0000 7fb21affd700 1 -- 172.21.15.146:0/2315327145 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210011830 con 0x7fb21c136960 2023-10-03T10:17:16.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.919+0000 7fb21affd700 1 -- 172.21.15.146:0/2315327145 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb210011990 con 0x7fb21c136960 2023-10-03T10:17:16.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.919+0000 7fb21affd700 1 -- 172.21.15.146:0/2315327145 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210011d20 con 0x7fb21c136960 2023-10-03T10:17:16.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.919+0000 7fb2224f9700 1 -- 172.21.15.146:0/2315327145 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb21c136960 msgr2=0x7fb21c138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.919+0000 7fb2224f9700 1 --2- 172.21.15.146:0/2315327145 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb21c136960 0x7fb21c138d40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb210009920 tx=0x7fb210009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:16.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.919+0000 7fb2224f9700 1 -- 172.21.15.146:0/2315327145 shutdown_connections 2023-10-03T10:17:16.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.919+0000 7fb2224f9700 1 --2- 172.21.15.146:0/2315327145 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb21c139280 0x7fb21c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.919+0000 7fb2224f9700 1 --2- 172.21.15.146:0/2315327145 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb21c136960 0x7fb21c138d40 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.919+0000 7fb2224f9700 1 -- 172.21.15.146:0/2315327145 >> 172.21.15.146:0/2315327145 conn(0x7fb21c099c40 msgr2=0x7fb21c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.919+0000 7fb2224f9700 1 -- 172.21.15.146:0/2315327145 shutdown_connections 2023-10-03T10:17:16.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.919+0000 7fb2224f9700 1 -- 172.21.15.146:0/2315327145 wait complete. 2023-10-03T10:17:16.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.920+0000 7fb2224f9700 1 Processor -- start 2023-10-03T10:17:16.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.921+0000 7fb2224f9700 1 -- start start 2023-10-03T10:17:16.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.921+0000 7fb2224f9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb21c133ad0 0x7fb21c071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.921+0000 7fb2224f9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb21c136960 0x7fb21c071690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.921+0000 7fb2224f9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb21c139280 0x7fb21c071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.921+0000 7fb2224f9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c0722c0 con 0x7fb21c133ad0 2023-10-03T10:17:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.921+0000 7fb2224f9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c06ffd0 con 0x7fb21c136960 2023-10-03T10:17:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.921+0000 7fb2224f9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c09f390 con 0x7fb21c139280 2023-10-03T10:17:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.921+0000 7fb21bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb21c133ad0 0x7fb21c071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.921+0000 7fb21b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb21c136960 0x7fb21c071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.921+0000 7fb21bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb21c133ad0 0x7fb21c071150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57994/0 (socket says 172.21.15.146:57994) 2023-10-03T10:17:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.921+0000 7fb21bfff700 1 -- 172.21.15.146:0/3974991130 learned_addr learned my addr 172.21.15.146:0/3974991130 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.921+0000 7fb21b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb21c136960 0x7fb21c071690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35190/0 (socket says 172.21.15.146:35190) 2023-10-03T10:17:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.921+0000 7fb220a96700 1 --2- 172.21.15.146:0/3974991130 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb21c139280 0x7fb21c071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.921+0000 7fb21bfff700 1 -- 172.21.15.146:0/3974991130 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb21c139280 msgr2=0x7fb21c071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.921+0000 7fb21bfff700 1 --2- 172.21.15.146:0/3974991130 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb21c139280 0x7fb21c071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.921+0000 7fb21bfff700 1 -- 172.21.15.146:0/3974991130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb21c136960 msgr2=0x7fb21c071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.921+0000 7fb21bfff700 1 --2- 172.21.15.146:0/3974991130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb21c136960 0x7fb21c071690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.921+0000 7fb21bfff700 1 -- 172.21.15.146:0/3974991130 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb214009a70 con 0x7fb21c133ad0 2023-10-03T10:17:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.921+0000 7fb21b7fe700 1 --2- 172.21.15.146:0/3974991130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb21c136960 0x7fb21c071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.922+0000 7fb21bfff700 1 --2- 172.21.15.146:0/3974991130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb21c133ad0 0x7fb21c071150 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00c450 tx=0x7fb20c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.922+0000 7fb218ff9700 1 -- 172.21.15.146:0/3974991130 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c0054e0 con 0x7fb21c133ad0 2023-10-03T10:17:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.922+0000 7fb218ff9700 1 -- 172.21.15.146:0/3974991130 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20c00ce50 con 0x7fb21c133ad0 2023-10-03T10:17:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.922+0000 7fb2224f9700 1 -- 172.21.15.146:0/3974991130 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb210009550 con 0x7fb21c133ad0 2023-10-03T10:17:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.922+0000 7fb218ff9700 1 -- 172.21.15.146:0/3974991130 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c0038c0 con 0x7fb21c133ad0 2023-10-03T10:17:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.922+0000 7fb2224f9700 1 -- 172.21.15.146:0/3974991130 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb21c070d00 con 0x7fb21c133ad0 2023-10-03T10:17:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.923+0000 7fb218ff9700 1 -- 172.21.15.146:0/3974991130 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb20c003a20 con 0x7fb21c133ad0 2023-10-03T10:17:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.923+0000 7fb218ff9700 1 -- 172.21.15.146:0/3974991130 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb20c03ea50 con 0x7fb21c133ad0 2023-10-03T10:17:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.923+0000 7fb2224f9700 1 -- 172.21.15.146:0/3974991130 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb21c04f2a0 con 0x7fb21c133ad0 2023-10-03T10:17:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.928+0000 7fb218ff9700 1 -- 172.21.15.146:0/3974991130 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb20c017070 con 0x7fb21c133ad0 2023-10-03T10:17:16.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.949+0000 7fa2a379a700 1 -- 172.21.15.146:0/578488126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa29c04f2a0 con 0x7fa29c09d860 2023-10-03T10:17:16.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.949+0000 7fa28dffb700 1 -- 172.21.15.146:0/578488126 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa290015020 con 0x7fa29c09d860 2023-10-03T10:17:16.950 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:16.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.952+0000 7fa2a379a700 1 -- 172.21.15.146:0/578488126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa29c09d860 msgr2=0x7fa29c11f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.952+0000 7fa2a379a700 1 --2- 172.21.15.146:0/578488126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa29c09d860 0x7fa29c11f420 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fa290009fd0 tx=0x7fa290004750 comp rx=0 tx=0).stop 2023-10-03T10:17:16.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.952+0000 7fa2a379a700 1 -- 172.21.15.146:0/578488126 shutdown_connections 2023-10-03T10:17:16.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.952+0000 7fa2a379a700 1 --2- 172.21.15.146:0/578488126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa29c130eb0 0x7fa29c11fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.952+0000 7fa2a379a700 1 --2- 172.21.15.146:0/578488126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa29c09d860 0x7fa29c11f420 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.952+0000 7fa2a379a700 1 --2- 172.21.15.146:0/578488126 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa29c09e170 0x7fa29c11f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.952+0000 7fa2a379a700 1 -- 172.21.15.146:0/578488126 >> 172.21.15.146:0/578488126 conn(0x7fa29c099c40 msgr2=0x7fa29c119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.953+0000 7fa2a379a700 1 -- 172.21.15.146:0/578488126 shutdown_connections 2023-10-03T10:17:16.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:16.953+0000 7fa2a379a700 1 -- 172.21.15.146:0/578488126 wait complete. 2023-10-03T10:17:16.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:17.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.081+0000 7f58656a0700 1 -- 172.21.15.146:0/350921208 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f586006c9d0 con 0x7f5860134160 2023-10-03T10:17:17.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.082+0000 7f58477fe700 1 -- 172.21.15.146:0/350921208 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5858017020 con 0x7f5860134160 2023-10-03T10:17:17.083 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:17.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.084+0000 7f58656a0700 1 -- 172.21.15.146:0/350921208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5860134160 msgr2=0x7f5860123580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.084+0000 7f58656a0700 1 --2- 172.21.15.146:0/350921208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5860134160 0x7f5860123580 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f585800cb00 tx=0x7f585800ce10 comp rx=0 tx=0).stop 2023-10-03T10:17:17.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.084+0000 7f58656a0700 1 -- 172.21.15.146:0/350921208 shutdown_connections 2023-10-03T10:17:17.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.084+0000 7f58656a0700 1 --2- 172.21.15.146:0/350921208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5860134160 0x7f5860123580 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.084+0000 7f58656a0700 1 --2- 172.21.15.146:0/350921208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f586009e870 0x7f5860122b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.084+0000 7f58656a0700 1 --2- 172.21.15.146:0/350921208 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f586009f180 0x7f5860123040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.084+0000 7f58656a0700 1 -- 172.21.15.146:0/350921208 >> 172.21.15.146:0/350921208 conn(0x7f58600a4430 msgr2=0x7f58600a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.084+0000 7f58656a0700 1 -- 172.21.15.146:0/350921208 shutdown_connections 2023-10-03T10:17:17.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.084+0000 7f58656a0700 1 -- 172.21.15.146:0/350921208 wait complete. 2023-10-03T10:17:17.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:17.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.130+0000 7fb2224f9700 1 -- 172.21.15.146:0/3974991130 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb21c09f0f0 con 0x7fb21c133ad0 2023-10-03T10:17:17.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.130+0000 7fb218ff9700 1 -- 172.21.15.146:0/3974991130 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb20c019b20 con 0x7fb21c133ad0 2023-10-03T10:17:17.131 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:17.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.132+0000 7fb2224f9700 1 -- 172.21.15.146:0/3974991130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb21c133ad0 msgr2=0x7fb21c071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.132+0000 7fb2224f9700 1 --2- 172.21.15.146:0/3974991130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb21c133ad0 0x7fb21c071150 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00c450 tx=0x7fb20c00c760 comp rx=0 tx=0).stop 2023-10-03T10:17:17.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.132+0000 7fb2224f9700 1 -- 172.21.15.146:0/3974991130 shutdown_connections 2023-10-03T10:17:17.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.132+0000 7fb2224f9700 1 --2- 172.21.15.146:0/3974991130 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb21c139280 0x7fb21c071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.132+0000 7fb2224f9700 1 --2- 172.21.15.146:0/3974991130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb21c133ad0 0x7fb21c071150 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.132+0000 7fb2224f9700 1 --2- 172.21.15.146:0/3974991130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb21c136960 0x7fb21c071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.132+0000 7fb2224f9700 1 -- 172.21.15.146:0/3974991130 >> 172.21.15.146:0/3974991130 conn(0x7fb21c099c40 msgr2=0x7fb21c134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.132+0000 7fb2224f9700 1 -- 172.21.15.146:0/3974991130 shutdown_connections 2023-10-03T10:17:17.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.132+0000 7fb2224f9700 1 -- 172.21.15.146:0/3974991130 wait complete. 2023-10-03T10:17:17.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:17.159 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:17.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.307+0000 7f8d923a1700 1 Processor -- start 2023-10-03T10:17:17.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.307+0000 7f8d923a1700 1 -- start start 2023-10-03T10:17:17.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.307+0000 7f8d923a1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8d8c09a150 0x7f8d8c09e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.307+0000 7f8d923a1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d8c09edb0 0x7f8d8c09f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.307+0000 7f8d923a1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d8c09af80 con 0x7f8d8c133c20 2023-10-03T10:17:17.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.307+0000 7f8d923a1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d8c09fe00 con 0x7f8d8c09a150 2023-10-03T10:17:17.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.307+0000 7f8d923a1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c06bec0 con 0x7f8d8c09edb0 2023-10-03T10:17:17.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.307+0000 7f8d8bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8d8c09a150 0x7f8d8c09e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.307+0000 7f8d9093e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8d8c133c20 0x7f8d8c1340c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59158/0 (socket says 172.21.15.146:59158) 2023-10-03T10:17:17.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.308+0000 7f8d9093e700 1 -- 172.21.15.146:0/3719701346 learned_addr learned my addr 172.21.15.146:0/3719701346 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:17.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.307+0000 7f8d8b7fe700 1 --2- 172.21.15.146:0/3719701346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d8c09edb0 0x7f8d8c09f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.308+0000 7f8d8bfff700 1 -- 172.21.15.146:0/3719701346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d8c09edb0 msgr2=0x7f8d8c09f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:17.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.308+0000 7f8d8bfff700 1 --2- 172.21.15.146:0/3719701346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d8c09edb0 0x7f8d8c09f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.308+0000 7f8d8bfff700 1 -- 172.21.15.146:0/3719701346 >> v1:172.21.15.146:6789/0 conn(0x7f8d8c133c20 legacy=0x7f8d8c1340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.308+0000 7f8d8bfff700 1 -- 172.21.15.146:0/3719701346 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c09f6e0 con 0x7f8d8c09a150 2023-10-03T10:17:17.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.308+0000 7f8d8affd700 1 -- 172.21.15.146:0/3719701346 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880606137 0 0) 0x7f8d8c09af80 con 0x7f8d8c133c20 2023-10-03T10:17:17.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.308+0000 7f8d8b7fe700 1 --2- 172.21.15.146:0/3719701346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d8c09edb0 0x7f8d8c09f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.308+0000 7f8d8bfff700 1 --2- 172.21.15.146:0/3719701346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d8c09a150 0x7f8d8c09e870 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009840 tx=0x7f8d7c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e7cf78fc2e3662 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.308+0000 7f8d8affd700 1 -- 172.21.15.146:0/3719701346 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c011830 con 0x7f8d8c09a150 2023-10-03T10:17:17.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.308+0000 7f8d8affd700 1 -- 172.21.15.146:0/3719701346 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7c011990 con 0x7f8d8c09a150 2023-10-03T10:17:17.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.308+0000 7f8d8affd700 1 -- 172.21.15.146:0/3719701346 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c011d20 con 0x7f8d8c09a150 2023-10-03T10:17:17.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.309+0000 7f8d923a1700 1 -- 172.21.15.146:0/3719701346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d8c09a150 msgr2=0x7f8d8c09e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.309+0000 7f8d923a1700 1 --2- 172.21.15.146:0/3719701346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d8c09a150 0x7f8d8c09e870 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009840 tx=0x7f8d7c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:17.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.309+0000 7f8d923a1700 1 -- 172.21.15.146:0/3719701346 shutdown_connections 2023-10-03T10:17:17.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.309+0000 7f8d923a1700 1 --2- 172.21.15.146:0/3719701346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d8c09a150 0x7f8d8c09e870 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.309+0000 7f8d923a1700 1 --2- 172.21.15.146:0/3719701346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d8c09edb0 0x7f8d8c09f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.309+0000 7f8d923a1700 1 -- 172.21.15.146:0/3719701346 >> 172.21.15.146:0/3719701346 conn(0x7f8d8c0a4430 msgr2=0x7f8d8c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.309+0000 7f8d923a1700 1 -- 172.21.15.146:0/3719701346 shutdown_connections 2023-10-03T10:17:17.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.309+0000 7f8d923a1700 1 -- 172.21.15.146:0/3719701346 wait complete. 2023-10-03T10:17:17.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.310+0000 7f8d923a1700 1 Processor -- start 2023-10-03T10:17:17.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.310+0000 7f8d923a1700 1 -- start start 2023-10-03T10:17:17.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.310+0000 7f8d923a1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d8c09a150 0x7f8d8c1225c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.310+0000 7f8d923a1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d8c09edb0 0x7f8d8c122b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.310+0000 7f8d923a1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d8c133c20 0x7f8d8c123040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.310+0000 7f8d923a1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c1260e0 con 0x7f8d8c09a150 2023-10-03T10:17:17.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.310+0000 7f8d923a1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c125bd0 con 0x7f8d8c09edb0 2023-10-03T10:17:17.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.310+0000 7f8d923a1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c125060 con 0x7f8d8c133c20 2023-10-03T10:17:17.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.310+0000 7f8d8b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d8c09edb0 0x7f8d8c122b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.310+0000 7f8d9093e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d8c133c20 0x7f8d8c123040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.310+0000 7f8d8b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d8c09edb0 0x7f8d8c122b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35204/0 (socket says 172.21.15.146:35204) 2023-10-03T10:17:17.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.310+0000 7f8d8b7fe700 1 -- 172.21.15.146:0/1507469587 learned_addr learned my addr 172.21.15.146:0/1507469587 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:17.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.310+0000 7f8d8bfff700 1 --2- 172.21.15.146:0/1507469587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d8c09a150 0x7f8d8c1225c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.311+0000 7f8d9093e700 1 -- 172.21.15.146:0/1507469587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d8c09edb0 msgr2=0x7f8d8c122b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.311+0000 7f8d9093e700 1 --2- 172.21.15.146:0/1507469587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d8c09edb0 0x7f8d8c122b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.311+0000 7f8d9093e700 1 -- 172.21.15.146:0/1507469587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d8c09a150 msgr2=0x7f8d8c1225c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.311+0000 7f8d9093e700 1 --2- 172.21.15.146:0/1507469587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d8c09a150 0x7f8d8c1225c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.311+0000 7f8d9093e700 1 -- 172.21.15.146:0/1507469587 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d800094a0 con 0x7f8d8c133c20 2023-10-03T10:17:17.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.311+0000 7f8d8b7fe700 1 --2- 172.21.15.146:0/1507469587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d8c09edb0 0x7f8d8c122b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.311+0000 7f8d8bfff700 1 --2- 172.21.15.146:0/1507469587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d8c09a150 0x7f8d8c1225c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.311+0000 7f8d9093e700 1 --2- 172.21.15.146:0/1507469587 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d8c133c20 0x7f8d8c123040 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8d8400cbe0 tx=0x7f8d8400cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.311+0000 7f8d88ff9700 1 -- 172.21.15.146:0/1507469587 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8400aa40 con 0x7f8d8c133c20 2023-10-03T10:17:17.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.311+0000 7f8d88ff9700 1 -- 172.21.15.146:0/1507469587 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8400abc0 con 0x7f8d8c133c20 2023-10-03T10:17:17.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.311+0000 7f8d923a1700 1 -- 172.21.15.146:0/1507469587 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7c0094a0 con 0x7f8d8c133c20 2023-10-03T10:17:17.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.311+0000 7f8d88ff9700 1 -- 172.21.15.146:0/1507469587 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d840070d0 con 0x7f8d8c133c20 2023-10-03T10:17:17.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.311+0000 7f8d923a1700 1 -- 172.21.15.146:0/1507469587 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8c0a13d0 con 0x7f8d8c133c20 2023-10-03T10:17:17.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.312+0000 7f8d88ff9700 1 -- 172.21.15.146:0/1507469587 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d84007230 con 0x7f8d8c133c20 2023-10-03T10:17:17.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.312+0000 7f8d88ff9700 1 -- 172.21.15.146:0/1507469587 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8d8403f400 con 0x7f8d8c133c20 2023-10-03T10:17:17.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.312+0000 7f8d923a1700 1 -- 172.21.15.146:0/1507469587 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d8c09fa30 con 0x7f8d8c133c20 2023-10-03T10:17:17.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.317+0000 7f8d88ff9700 1 -- 172.21.15.146:0/1507469587 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d84018080 con 0x7f8d8c133c20 2023-10-03T10:17:17.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.499+0000 7f8d923a1700 1 -- 172.21.15.146:0/1507469587 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8d8c1339f0 con 0x7f8d8c133c20 2023-10-03T10:17:17.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.499+0000 7f8d88ff9700 1 -- 172.21.15.146:0/1507469587 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8d840074e0 con 0x7f8d8c133c20 2023-10-03T10:17:17.500 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:17.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.501+0000 7f8d923a1700 1 -- 172.21.15.146:0/1507469587 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d8c133c20 msgr2=0x7f8d8c123040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.502+0000 7f8d923a1700 1 --2- 172.21.15.146:0/1507469587 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d8c133c20 0x7f8d8c123040 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8d8400cbe0 tx=0x7f8d8400cef0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.502+0000 7f8d923a1700 1 -- 172.21.15.146:0/1507469587 shutdown_connections 2023-10-03T10:17:17.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.502+0000 7f8d923a1700 1 --2- 172.21.15.146:0/1507469587 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d8c133c20 0x7f8d8c123040 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.502+0000 7f8d923a1700 1 --2- 172.21.15.146:0/1507469587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d8c09a150 0x7f8d8c1225c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.502+0000 7f8d923a1700 1 --2- 172.21.15.146:0/1507469587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d8c09edb0 0x7f8d8c122b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.502+0000 7f8d923a1700 1 -- 172.21.15.146:0/1507469587 >> 172.21.15.146:0/1507469587 conn(0x7f8d8c0a4430 msgr2=0x7f8d8c0a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.502+0000 7f8d923a1700 1 -- 172.21.15.146:0/1507469587 shutdown_connections 2023-10-03T10:17:17.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:17.502+0000 7f8d923a1700 1 -- 172.21.15.146:0/1507469587 wait complete. 2023-10-03T10:17:17.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:17.971 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:18.098 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:18.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.098+0000 7fe4a5b09700 1 Processor -- start 2023-10-03T10:17:18.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.098+0000 7fe4a5b09700 1 -- start start 2023-10-03T10:17:18.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.098+0000 7fe4a5b09700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe4a009d860 0x7fe4a009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.098+0000 7fe4a5b09700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4a009e170 0x7fe4a01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.098+0000 7fe4a5b09700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a009aaa0 con 0x7fe4a0130ce0 2023-10-03T10:17:18.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.098+0000 7fe4a5b09700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a009f870 con 0x7fe4a009d860 2023-10-03T10:17:18.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.098+0000 7fe4a5b09700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a009b360 con 0x7fe4a009e170 2023-10-03T10:17:18.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.099+0000 7fe49effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4a009e170 0x7fe4a01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.099+0000 7fe49f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe4a009d860 0x7fe4a009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.099+0000 7fe49effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4a009e170 0x7fe4a01307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51302/0 (socket says 172.21.15.146:51302) 2023-10-03T10:17:18.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.099+0000 7fe49ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe4a0130ce0 0x7fe4a01379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59164/0 (socket says 172.21.15.146:59164) 2023-10-03T10:17:18.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.099+0000 7fe49f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe4a009d860 0x7fe4a009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58020/0 (socket says 172.21.15.146:58020) 2023-10-03T10:17:18.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.099+0000 7fe49effd700 1 -- 172.21.15.146:0/3839160874 learned_addr learned my addr 172.21.15.146:0/3839160874 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:18.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.099+0000 7fe49f7fe700 1 -- 172.21.15.146:0/3839160874 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4a009e170 msgr2=0x7fe4a01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:18.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.099+0000 7fe49f7fe700 1 --2- 172.21.15.146:0/3839160874 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4a009e170 0x7fe4a01307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.099+0000 7fe49f7fe700 1 -- 172.21.15.146:0/3839160874 >> v1:172.21.15.146:6789/0 conn(0x7fe4a0130ce0 legacy=0x7fe4a01379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.099+0000 7fe49f7fe700 1 -- 172.21.15.146:0/3839160874 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a009b620 con 0x7fe4a009d860 2023-10-03T10:17:18.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.099+0000 7fe49e7fc700 1 -- 172.21.15.146:0/3839160874 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729150874 0 0) 0x7fe4a009aaa0 con 0x7fe4a0130ce0 2023-10-03T10:17:18.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.099+0000 7fe49effd700 1 --2- 172.21.15.146:0/3839160874 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4a009e170 0x7fe4a01307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:18.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.099+0000 7fe49f7fe700 1 --2- 172.21.15.146:0/3839160874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4a009d860 0x7fe4a009dc30 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fe494009840 tx=0x7fe494009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a151ce7b7e72a99 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.099+0000 7fe49e7fc700 1 -- 172.21.15.146:0/3839160874 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494011830 con 0x7fe4a009d860 2023-10-03T10:17:18.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.099+0000 7fe49e7fc700 1 -- 172.21.15.146:0/3839160874 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe494011990 con 0x7fe4a009d860 2023-10-03T10:17:18.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.099+0000 7fe49e7fc700 1 -- 172.21.15.146:0/3839160874 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494011d20 con 0x7fe4a009d860 2023-10-03T10:17:18.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.100+0000 7fe4a5b09700 1 -- 172.21.15.146:0/3839160874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4a009d860 msgr2=0x7fe4a009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.100+0000 7fe4a5b09700 1 --2- 172.21.15.146:0/3839160874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4a009d860 0x7fe4a009dc30 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fe494009840 tx=0x7fe494009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:18.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.100+0000 7fe4a5b09700 1 -- 172.21.15.146:0/3839160874 shutdown_connections 2023-10-03T10:17:18.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.100+0000 7fe4a5b09700 1 --2- 172.21.15.146:0/3839160874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4a009d860 0x7fe4a009dc30 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.100+0000 7fe4a5b09700 1 --2- 172.21.15.146:0/3839160874 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4a009e170 0x7fe4a01307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.100+0000 7fe4a5b09700 1 -- 172.21.15.146:0/3839160874 >> 172.21.15.146:0/3839160874 conn(0x7fe4a0099c40 msgr2=0x7fe4a00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.100+0000 7fe4a5b09700 1 -- 172.21.15.146:0/3839160874 shutdown_connections 2023-10-03T10:17:18.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.100+0000 7fe4a5b09700 1 -- 172.21.15.146:0/3839160874 wait complete. 2023-10-03T10:17:18.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.101+0000 7fe4a5b09700 1 Processor -- start 2023-10-03T10:17:18.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.101+0000 7fe4a5b09700 1 -- start start 2023-10-03T10:17:18.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.101+0000 7fe4a5b09700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4a009d860 0x7fe4a0139b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.101+0000 7fe4a5b09700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a009e170 0x7fe4a013a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.101+0000 7fe4a5b09700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4a0130ce0 0x7fe4a013a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.101+0000 7fe4a5b09700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a01198b0 con 0x7fe4a0130ce0 2023-10-03T10:17:18.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.101+0000 7fe4a5b09700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a0071ee0 con 0x7fe4a009e170 2023-10-03T10:17:18.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.101+0000 7fe4a5b09700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a009c8b0 con 0x7fe4a009d860 2023-10-03T10:17:18.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.102+0000 7fe49effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a009e170 0x7fe4a013a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.102+0000 7fe49ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4a0130ce0 0x7fe4a013a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.102+0000 7fe49effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a009e170 0x7fe4a013a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35208/0 (socket says 172.21.15.146:35208) 2023-10-03T10:17:18.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.102+0000 7fe49effd700 1 -- 172.21.15.146:0/3915411446 learned_addr learned my addr 172.21.15.146:0/3915411446 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:18.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.102+0000 7fe49f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4a009d860 0x7fe4a0139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.102+0000 7fe49effd700 1 -- 172.21.15.146:0/3915411446 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4a009d860 msgr2=0x7fe4a0139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.102+0000 7fe49effd700 1 --2- 172.21.15.146:0/3915411446 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4a009d860 0x7fe4a0139b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.102+0000 7fe49effd700 1 -- 172.21.15.146:0/3915411446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4a0130ce0 msgr2=0x7fe4a013a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.102+0000 7fe49effd700 1 --2- 172.21.15.146:0/3915411446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4a0130ce0 0x7fe4a013a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.102+0000 7fe49effd700 1 -- 172.21.15.146:0/3915411446 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe490009550 con 0x7fe4a009e170 2023-10-03T10:17:18.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.102+0000 7fe49ffff700 1 --2- 172.21.15.146:0/3915411446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4a0130ce0 0x7fe4a013a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:18.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.102+0000 7fe49effd700 1 --2- 172.21.15.146:0/3915411446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a009e170 0x7fe4a013a070 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe49000ebe0 tx=0x7fe49000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.102+0000 7fe487fff700 1 -- 172.21.15.146:0/3915411446 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49000c850 con 0x7fe4a009e170 2023-10-03T10:17:18.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.102+0000 7fe487fff700 1 -- 172.21.15.146:0/3915411446 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49000c9b0 con 0x7fe4a009e170 2023-10-03T10:17:18.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.102+0000 7fe4a5b09700 1 -- 172.21.15.146:0/3915411446 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4940094a0 con 0x7fe4a009e170 2023-10-03T10:17:18.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.102+0000 7fe487fff700 1 -- 172.21.15.146:0/3915411446 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49000cd40 con 0x7fe4a009e170 2023-10-03T10:17:18.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.102+0000 7fe4a5b09700 1 -- 172.21.15.146:0/3915411446 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a011be40 con 0x7fe4a009e170 2023-10-03T10:17:18.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.103+0000 7fe487fff700 1 -- 172.21.15.146:0/3915411446 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe490013470 con 0x7fe4a009e170 2023-10-03T10:17:18.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.103+0000 7fe487fff700 1 -- 172.21.15.146:0/3915411446 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe49003f850 con 0x7fe4a009e170 2023-10-03T10:17:18.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.103+0000 7fe4a5b09700 1 -- 172.21.15.146:0/3915411446 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a004f2a0 con 0x7fe4a009e170 2023-10-03T10:17:18.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.109+0000 7fe487fff700 1 -- 172.21.15.146:0/3915411446 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4900232f0 con 0x7fe4a009e170 2023-10-03T10:17:18.146 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:18.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.227+0000 7f2788384700 1 Processor -- start 2023-10-03T10:17:18.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.227+0000 7f2788384700 1 -- start start 2023-10-03T10:17:18.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.228+0000 7f2788384700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27800a1550 0x7f2780138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.228+0000 7f2788384700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2780139200 0x7f278013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.228+0000 7f2788384700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278009e9d0 con 0x7f27800a0a70 2023-10-03T10:17:18.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.228+0000 7f2788384700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f278009dc00 con 0x7f2780139200 2023-10-03T10:17:18.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.228+0000 7f2788384700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f278009dec0 con 0x7f27800a1550 2023-10-03T10:17:18.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.228+0000 7f2786120700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f27800a0a70 0x7f27800a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59178/0 (socket says 172.21.15.146:59178) 2023-10-03T10:17:18.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.228+0000 7f2786120700 1 -- 172.21.15.146:0/2531529942 learned_addr learned my addr 172.21.15.146:0/2531529942 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:18.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.228+0000 7f278591f700 1 --2- 172.21.15.146:0/2531529942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27800a1550 0x7f2780138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.228+0000 7f2786921700 1 --2- 172.21.15.146:0/2531529942 >> v2:172.21.15.146:3300/0 conn(0x7f2780139200 0x7f278013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.228+0000 7f278511e700 1 -- 172.21.15.146:0/2531529942 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3434788966 0 0) 0x7f278009e9d0 con 0x7f27800a0a70 2023-10-03T10:17:18.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.228+0000 7f278511e700 1 -- 172.21.15.146:0/2531529942 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f276c0035b0 con 0x7f27800a0a70 2023-10-03T10:17:18.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.228+0000 7f278591f700 1 -- 172.21.15.146:0/2531529942 >> v2:172.21.15.146:3300/0 conn(0x7f2780139200 msgr2=0x7f278013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:18.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.228+0000 7f278591f700 1 --2- 172.21.15.146:0/2531529942 >> v2:172.21.15.146:3300/0 conn(0x7f2780139200 0x7f278013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.228+0000 7f278591f700 1 -- 172.21.15.146:0/2531529942 >> v1:172.21.15.146:6789/0 conn(0x7f27800a0a70 legacy=0x7f27800a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.228+0000 7f278591f700 1 -- 172.21.15.146:0/2531529942 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278009e6a0 con 0x7f27800a1550 2023-10-03T10:17:18.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.228+0000 7f278591f700 1 --2- 172.21.15.146:0/2531529942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27800a1550 0x7f2780138cc0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2770009840 tx=0x7f2770009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3576987b244fbeb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.229+0000 7f278511e700 1 -- 172.21.15.146:0/2531529942 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770004230 con 0x7f27800a1550 2023-10-03T10:17:18.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.229+0000 7f278511e700 1 -- 172.21.15.146:0/2531529942 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2770004390 con 0x7f27800a1550 2023-10-03T10:17:18.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.229+0000 7f278511e700 1 -- 172.21.15.146:0/2531529942 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27700036a0 con 0x7f27800a1550 2023-10-03T10:17:18.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.229+0000 7f2788384700 1 -- 172.21.15.146:0/2531529942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27800a1550 msgr2=0x7f2780138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.229+0000 7f2788384700 1 --2- 172.21.15.146:0/2531529942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27800a1550 0x7f2780138cc0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2770009840 tx=0x7f2770009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:18.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.229+0000 7f2788384700 1 -- 172.21.15.146:0/2531529942 shutdown_connections 2023-10-03T10:17:18.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.229+0000 7f2788384700 1 --2- 172.21.15.146:0/2531529942 >> v2:172.21.15.146:3300/0 conn(0x7f2780139200 0x7f278013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.229+0000 7f2788384700 1 --2- 172.21.15.146:0/2531529942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27800a1550 0x7f2780138cc0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.229+0000 7f2788384700 1 -- 172.21.15.146:0/2531529942 >> 172.21.15.146:0/2531529942 conn(0x7f27800a6610 msgr2=0x7f27800a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.229+0000 7f2788384700 1 -- 172.21.15.146:0/2531529942 shutdown_connections 2023-10-03T10:17:18.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.229+0000 7f2788384700 1 -- 172.21.15.146:0/2531529942 wait complete. 2023-10-03T10:17:18.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.230+0000 7f2788384700 1 Processor -- start 2023-10-03T10:17:18.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.230+0000 7f2788384700 1 -- start start 2023-10-03T10:17:18.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.231+0000 7f2788384700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27800a0a70 0x7f278011f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.231+0000 7f2788384700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27800a1550 0x7f278011f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.231+0000 7f2788384700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2780139200 0x7f27801c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.231+0000 7f2788384700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2780120c60 con 0x7f27800a1550 2023-10-03T10:17:18.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.231+0000 7f2788384700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27800a0470 con 0x7f2780139200 2023-10-03T10:17:18.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.231+0000 7f2788384700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2780122760 con 0x7f27800a0a70 2023-10-03T10:17:18.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.231+0000 7f278591f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27800a1550 0x7f278011f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.231+0000 7f278591f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27800a1550 0x7f278011f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58036/0 (socket says 172.21.15.146:58036) 2023-10-03T10:17:18.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.231+0000 7f278591f700 1 -- 172.21.15.146:0/4161075655 learned_addr learned my addr 172.21.15.146:0/4161075655 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:18.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.231+0000 7f2786921700 1 --2- 172.21.15.146:0/4161075655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2780139200 0x7f27801c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.231+0000 7f2786120700 1 --2- 172.21.15.146:0/4161075655 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27800a0a70 0x7f278011f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.231+0000 7f2786921700 1 -- 172.21.15.146:0/4161075655 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27800a0a70 msgr2=0x7f278011f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.231+0000 7f2786921700 1 --2- 172.21.15.146:0/4161075655 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27800a0a70 0x7f278011f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.231+0000 7f2786921700 1 -- 172.21.15.146:0/4161075655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27800a1550 msgr2=0x7f278011f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.231+0000 7f2786921700 1 --2- 172.21.15.146:0/4161075655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27800a1550 0x7f278011f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.231+0000 7f2786921700 1 -- 172.21.15.146:0/4161075655 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27700094a0 con 0x7f2780139200 2023-10-03T10:17:18.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.231+0000 7f278591f700 1 --2- 172.21.15.146:0/4161075655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27800a1550 0x7f278011f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:18.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.231+0000 7f2786921700 1 --2- 172.21.15.146:0/4161075655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2780139200 0x7f27801c83f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2778009d90 tx=0x7f277800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.231+0000 7f2776ffd700 1 -- 172.21.15.146:0/4161075655 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2778009c00 con 0x7f2780139200 2023-10-03T10:17:18.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.232+0000 7f2776ffd700 1 -- 172.21.15.146:0/4161075655 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277800f040 con 0x7f2780139200 2023-10-03T10:17:18.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.232+0000 7f2788384700 1 -- 172.21.15.146:0/4161075655 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27800a5100 con 0x7f2780139200 2023-10-03T10:17:18.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.232+0000 7f2776ffd700 1 -- 172.21.15.146:0/4161075655 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277800ce90 con 0x7f2780139200 2023-10-03T10:17:18.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.232+0000 7f2788384700 1 -- 172.21.15.146:0/4161075655 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27801222f0 con 0x7f2780139200 2023-10-03T10:17:18.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.232+0000 7f2788384700 1 -- 172.21.15.146:0/4161075655 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27800a2700 con 0x7f2780139200 2023-10-03T10:17:18.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.233+0000 7f2776ffd700 1 -- 172.21.15.146:0/4161075655 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2778014480 con 0x7f2780139200 2023-10-03T10:17:18.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.233+0000 7f2776ffd700 1 -- 172.21.15.146:0/4161075655 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2778040890 con 0x7f2780139200 2023-10-03T10:17:18.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.237+0000 7f2776ffd700 1 -- 172.21.15.146:0/4161075655 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2778012930 con 0x7f2780139200 2023-10-03T10:17:18.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.273+0000 7ff0270b6700 1 Processor -- start 2023-10-03T10:17:18.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.273+0000 7ff0270b6700 1 -- start start 2023-10-03T10:17:18.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.273+0000 7ff0270b6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0200a0a70 0x7ff0200a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.273+0000 7ff0270b6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff0200a1380 0x7ff020133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.273+0000 7ff0270b6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff020133f50 0x7ff020134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.273+0000 7ff0270b6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff02009e9d0 con 0x7ff0200a1380 2023-10-03T10:17:18.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.273+0000 7ff0270b6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02009dc00 con 0x7ff020133f50 2023-10-03T10:17:18.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.273+0000 7ff0270b6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff02009dec0 con 0x7ff0200a0a70 2023-10-03T10:17:18.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.274+0000 7ff01ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff0200a1380 0x7ff020133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.274+0000 7ff025653700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff020133f50 0x7ff020134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.274+0000 7ff01ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff0200a1380 0x7ff020133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58038/0 (socket says 172.21.15.146:58038) 2023-10-03T10:17:18.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.274+0000 7ff01ffff700 1 -- 172.21.15.146:0/1451687961 learned_addr learned my addr 172.21.15.146:0/1451687961 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:18.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.274+0000 7ff024e52700 1 --2- 172.21.15.146:0/1451687961 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0200a0a70 0x7ff0200a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.274+0000 7ff025653700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff020133f50 0x7ff020134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35226/0 (socket says 172.21.15.146:35226) 2023-10-03T10:17:18.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.274+0000 7ff024e52700 1 -- 172.21.15.146:0/1451687961 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff020133f50 msgr2=0x7ff020134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:18.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.274+0000 7ff024e52700 1 --2- 172.21.15.146:0/1451687961 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff020133f50 0x7ff020134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.274+0000 7ff024e52700 1 -- 172.21.15.146:0/1451687961 >> v2:172.21.15.146:3300/0 conn(0x7ff0200a1380 msgr2=0x7ff020133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:18.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.274+0000 7ff024e52700 1 --2- 172.21.15.146:0/1451687961 >> v2:172.21.15.146:3300/0 conn(0x7ff0200a1380 0x7ff020133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.274+0000 7ff024e52700 1 -- 172.21.15.146:0/1451687961 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02009e6a0 con 0x7ff0200a0a70 2023-10-03T10:17:18.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.274+0000 7ff01ffff700 1 --2- 172.21.15.146:0/1451687961 >> v2:172.21.15.146:3300/0 conn(0x7ff0200a1380 0x7ff020133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:18.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.274+0000 7ff024e52700 1 --2- 172.21.15.146:0/1451687961 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0200a0a70 0x7ff0200a0e40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff014009840 tx=0x7ff014009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77b86c55fac115e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.274+0000 7ff01f7fe700 1 -- 172.21.15.146:0/1451687961 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff014011830 con 0x7ff0200a0a70 2023-10-03T10:17:18.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.274+0000 7ff01f7fe700 1 -- 172.21.15.146:0/1451687961 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff014011990 con 0x7ff0200a0a70 2023-10-03T10:17:18.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.274+0000 7ff01f7fe700 1 -- 172.21.15.146:0/1451687961 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff014011d20 con 0x7ff0200a0a70 2023-10-03T10:17:18.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.275+0000 7ff0270b6700 1 -- 172.21.15.146:0/1451687961 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0200a0a70 msgr2=0x7ff0200a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.275+0000 7ff0270b6700 1 --2- 172.21.15.146:0/1451687961 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0200a0a70 0x7ff0200a0e40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff014009840 tx=0x7ff014009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:18.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.275+0000 7ff0270b6700 1 -- 172.21.15.146:0/1451687961 shutdown_connections 2023-10-03T10:17:18.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.275+0000 7ff0270b6700 1 --2- 172.21.15.146:0/1451687961 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff020133f50 0x7ff020134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.275+0000 7ff0270b6700 1 --2- 172.21.15.146:0/1451687961 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0200a0a70 0x7ff0200a0e40 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.275+0000 7ff0270b6700 1 --2- 172.21.15.146:0/1451687961 >> v2:172.21.15.146:3300/0 conn(0x7ff0200a1380 0x7ff020133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.275+0000 7ff0270b6700 1 -- 172.21.15.146:0/1451687961 >> 172.21.15.146:0/1451687961 conn(0x7ff0200a6610 msgr2=0x7ff0200a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.275+0000 7ff0270b6700 1 -- 172.21.15.146:0/1451687961 shutdown_connections 2023-10-03T10:17:18.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.275+0000 7ff0270b6700 1 -- 172.21.15.146:0/1451687961 wait complete. 2023-10-03T10:17:18.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.276+0000 7ff0270b6700 1 Processor -- start 2023-10-03T10:17:18.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.276+0000 7ff0270b6700 1 -- start start 2023-10-03T10:17:18.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.276+0000 7ff0270b6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0200a0a70 0x7ff02011f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.276+0000 7ff0270b6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0200a1380 0x7ff02011f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.276+0000 7ff0270b6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff020133f50 0x7ff02011fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.276+0000 7ff0270b6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff020122bd0 con 0x7ff0200a0a70 2023-10-03T10:17:18.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.276+0000 7ff0270b6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0201207f0 con 0x7ff020133f50 2023-10-03T10:17:18.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.276+0000 7ff0270b6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0200a03e0 con 0x7ff0200a1380 2023-10-03T10:17:18.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.277+0000 7ff01ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0200a1380 0x7ff02011f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.277+0000 7ff01ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0200a1380 0x7ff02011f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51328/0 (socket says 172.21.15.146:51328) 2023-10-03T10:17:18.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.277+0000 7ff01ffff700 1 -- 172.21.15.146:0/2941776505 learned_addr learned my addr 172.21.15.146:0/2941776505 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:18.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.277+0000 7ff025653700 1 --2- 172.21.15.146:0/2941776505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff020133f50 0x7ff02011fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.277+0000 7ff024e52700 1 --2- 172.21.15.146:0/2941776505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0200a0a70 0x7ff02011f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.277+0000 7ff01ffff700 1 -- 172.21.15.146:0/2941776505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff020133f50 msgr2=0x7ff02011fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.277+0000 7ff01ffff700 1 --2- 172.21.15.146:0/2941776505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff020133f50 0x7ff02011fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.277+0000 7ff01ffff700 1 -- 172.21.15.146:0/2941776505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0200a0a70 msgr2=0x7ff02011f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.277+0000 7ff01ffff700 1 --2- 172.21.15.146:0/2941776505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0200a0a70 0x7ff02011f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.277+0000 7ff01ffff700 1 -- 172.21.15.146:0/2941776505 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00c009550 con 0x7ff0200a1380 2023-10-03T10:17:18.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.277+0000 7ff01ffff700 1 --2- 172.21.15.146:0/2941776505 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0200a1380 0x7ff02011f8d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00ebb0 tx=0x7ff00c00eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.277+0000 7ff01d7fa700 1 -- 172.21.15.146:0/2941776505 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c004240 con 0x7ff0200a1380 2023-10-03T10:17:18.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.277+0000 7ff01d7fa700 1 -- 172.21.15.146:0/2941776505 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00c0043a0 con 0x7ff0200a1380 2023-10-03T10:17:18.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.277+0000 7ff01d7fa700 1 -- 172.21.15.146:0/2941776505 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c0036a0 con 0x7ff0200a1380 2023-10-03T10:17:18.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.277+0000 7ff0270b6700 1 -- 172.21.15.146:0/2941776505 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0140094a0 con 0x7ff0200a1380 2023-10-03T10:17:18.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.277+0000 7ff0270b6700 1 -- 172.21.15.146:0/2941776505 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff020122910 con 0x7ff0200a1380 2023-10-03T10:17:18.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.278+0000 7ff01d7fa700 1 -- 172.21.15.146:0/2941776505 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff00c003800 con 0x7ff0200a1380 2023-10-03T10:17:18.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.279+0000 7ff01d7fa700 1 -- 172.21.15.146:0/2941776505 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff00c03f810 con 0x7ff0200a1380 2023-10-03T10:17:18.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.279+0000 7ff0270b6700 1 -- 172.21.15.146:0/2941776505 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02004f2a0 con 0x7ff0200a1380 2023-10-03T10:17:18.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.288+0000 7ff01d7fa700 1 -- 172.21.15.146:0/2941776505 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff00c00c5e0 con 0x7ff0200a1380 2023-10-03T10:17:18.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.313+0000 7fe4a5b09700 1 -- 172.21.15.146:0/3915411446 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe4a006c3b0 con 0x7fe4a009e170 2023-10-03T10:17:18.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.314+0000 7fe487fff700 1 -- 172.21.15.146:0/3915411446 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe490021020 con 0x7fe4a009e170 2023-10-03T10:17:18.314 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:18.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.317+0000 7fe4a5b09700 1 -- 172.21.15.146:0/3915411446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a009e170 msgr2=0x7fe4a013a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.317+0000 7fe4a5b09700 1 --2- 172.21.15.146:0/3915411446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a009e170 0x7fe4a013a070 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe49000ebe0 tx=0x7fe49000eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.317+0000 7fe4a5b09700 1 -- 172.21.15.146:0/3915411446 shutdown_connections 2023-10-03T10:17:18.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.317+0000 7fe4a5b09700 1 --2- 172.21.15.146:0/3915411446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4a0130ce0 0x7fe4a013a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.317+0000 7fe4a5b09700 1 --2- 172.21.15.146:0/3915411446 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4a009d860 0x7fe4a0139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.317+0000 7fe4a5b09700 1 --2- 172.21.15.146:0/3915411446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4a009e170 0x7fe4a013a070 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.317+0000 7fe4a5b09700 1 -- 172.21.15.146:0/3915411446 >> 172.21.15.146:0/3915411446 conn(0x7fe4a0099c40 msgr2=0x7fe4a013b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.317+0000 7fe4a5b09700 1 -- 172.21.15.146:0/3915411446 shutdown_connections 2023-10-03T10:17:18.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.317+0000 7fe4a5b09700 1 -- 172.21.15.146:0/3915411446 wait complete. 2023-10-03T10:17:18.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:18.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.435+0000 7f2788384700 1 -- 172.21.15.146:0/4161075655 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2780121ee0 con 0x7f2780139200 2023-10-03T10:17:18.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.436+0000 7f2776ffd700 1 -- 172.21.15.146:0/4161075655 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2780121ee0 con 0x7f2780139200 2023-10-03T10:17:18.436 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:18.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.438+0000 7f2788384700 1 -- 172.21.15.146:0/4161075655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2780139200 msgr2=0x7f27801c83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.438+0000 7f2788384700 1 --2- 172.21.15.146:0/4161075655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2780139200 0x7f27801c83f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2778009d90 tx=0x7f277800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.438+0000 7f2788384700 1 -- 172.21.15.146:0/4161075655 shutdown_connections 2023-10-03T10:17:18.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.438+0000 7f2788384700 1 --2- 172.21.15.146:0/4161075655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2780139200 0x7f27801c83f0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.438+0000 7f2788384700 1 --2- 172.21.15.146:0/4161075655 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f27800a0a70 0x7f278011f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.438+0000 7f2788384700 1 --2- 172.21.15.146:0/4161075655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27800a1550 0x7f278011f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.438+0000 7f2788384700 1 -- 172.21.15.146:0/4161075655 >> 172.21.15.146:0/4161075655 conn(0x7f27800a6610 msgr2=0x7f27800a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.438+0000 7f2788384700 1 -- 172.21.15.146:0/4161075655 shutdown_connections 2023-10-03T10:17:18.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.438+0000 7f2788384700 1 -- 172.21.15.146:0/4161075655 wait complete. 2023-10-03T10:17:18.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:18.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.487+0000 7ff0270b6700 1 -- 172.21.15.146:0/2941776505 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff0201236a0 con 0x7ff0200a1380 2023-10-03T10:17:18.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.488+0000 7ff01d7fa700 1 -- 172.21.15.146:0/2941776505 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff00c0123d0 con 0x7ff0200a1380 2023-10-03T10:17:18.488 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:18.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.490+0000 7ff0270b6700 1 -- 172.21.15.146:0/2941776505 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0200a1380 msgr2=0x7ff02011f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.490+0000 7ff0270b6700 1 --2- 172.21.15.146:0/2941776505 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0200a1380 0x7ff02011f8d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00ebb0 tx=0x7ff00c00eec0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.490+0000 7ff0270b6700 1 -- 172.21.15.146:0/2941776505 shutdown_connections 2023-10-03T10:17:18.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.490+0000 7ff0270b6700 1 --2- 172.21.15.146:0/2941776505 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff020133f50 0x7ff02011fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.490+0000 7ff0270b6700 1 --2- 172.21.15.146:0/2941776505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0200a0a70 0x7ff02011f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.490+0000 7ff0270b6700 1 --2- 172.21.15.146:0/2941776505 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0200a1380 0x7ff02011f8d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.490+0000 7ff0270b6700 1 -- 172.21.15.146:0/2941776505 >> 172.21.15.146:0/2941776505 conn(0x7ff0200a6610 msgr2=0x7ff02009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.490+0000 7ff0270b6700 1 -- 172.21.15.146:0/2941776505 shutdown_connections 2023-10-03T10:17:18.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.490+0000 7ff0270b6700 1 -- 172.21.15.146:0/2941776505 wait complete. 2023-10-03T10:17:18.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:18.515 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.665+0000 7f9d8a163700 1 Processor -- start 2023-10-03T10:17:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.665+0000 7f9d8a163700 1 -- start start 2023-10-03T10:17:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.666+0000 7f9d8a163700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d84133ad0 0x7f9d84133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.666+0000 7f9d8a163700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9d841300a0 0x7f9d841304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.666+0000 7f9d8a163700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d841309f0 0x7f9d8413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.666+0000 7f9d8a163700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d8406b2d0 con 0x7f9d841300a0 2023-10-03T10:17:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.666+0000 7f9d8a163700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d84133610 con 0x7f9d841309f0 2023-10-03T10:17:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.666+0000 7f9d8a163700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8409a500 con 0x7f9d84133ad0 2023-10-03T10:17:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.666+0000 7f9d83fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d841309f0 0x7f9d8413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.666+0000 7f9d82ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9d841300a0 0x7f9d841304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.666+0000 7f9d82ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9d841300a0 0x7f9d841304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58056/0 (socket says 172.21.15.146:58056) 2023-10-03T10:17:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.666+0000 7f9d83fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d841309f0 0x7f9d8413a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35246/0 (socket says 172.21.15.146:35246) 2023-10-03T10:17:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.666+0000 7f9d82ffd700 1 -- 172.21.15.146:0/1018051199 learned_addr learned my addr 172.21.15.146:0/1018051199 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.666+0000 7f9d837fe700 1 --2- 172.21.15.146:0/1018051199 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d84133ad0 0x7f9d84133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.666+0000 7f9d83fff700 1 -- 172.21.15.146:0/1018051199 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d84133ad0 msgr2=0x7f9d84133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.666+0000 7f9d83fff700 1 --2- 172.21.15.146:0/1018051199 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d84133ad0 0x7f9d84133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.666+0000 7f9d83fff700 1 -- 172.21.15.146:0/1018051199 >> v2:172.21.15.146:3300/0 conn(0x7f9d841300a0 msgr2=0x7f9d841304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.666+0000 7f9d83fff700 1 --2- 172.21.15.146:0/1018051199 >> v2:172.21.15.146:3300/0 conn(0x7f9d841300a0 0x7f9d841304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.666+0000 7f9d83fff700 1 -- 172.21.15.146:0/1018051199 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d841338b0 con 0x7f9d841309f0 2023-10-03T10:17:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.666+0000 7f9d82ffd700 1 --2- 172.21.15.146:0/1018051199 >> v2:172.21.15.146:3300/0 conn(0x7f9d841300a0 0x7f9d841304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.666+0000 7f9d83fff700 1 --2- 172.21.15.146:0/1018051199 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d841309f0 0x7f9d8413a980 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009d90 tx=0x7f9d7c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39852646c31423d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.666+0000 7f9d827fc700 1 -- 172.21.15.146:0/1018051199 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c00e070 con 0x7f9d841309f0 2023-10-03T10:17:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.667+0000 7f9d827fc700 1 -- 172.21.15.146:0/1018051199 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c00bb20 con 0x7f9d841309f0 2023-10-03T10:17:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.667+0000 7f9d827fc700 1 -- 172.21.15.146:0/1018051199 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c012430 con 0x7f9d841309f0 2023-10-03T10:17:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.667+0000 7f9d8a163700 1 -- 172.21.15.146:0/1018051199 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d841309f0 msgr2=0x7f9d8413a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.667+0000 7f9d8a163700 1 --2- 172.21.15.146:0/1018051199 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d841309f0 0x7f9d8413a980 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009d90 tx=0x7f9d7c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:18.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.667+0000 7f9d8a163700 1 -- 172.21.15.146:0/1018051199 shutdown_connections 2023-10-03T10:17:18.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.667+0000 7f9d8a163700 1 --2- 172.21.15.146:0/1018051199 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d841309f0 0x7f9d8413a980 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.667+0000 7f9d8a163700 1 --2- 172.21.15.146:0/1018051199 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d84133ad0 0x7f9d84133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.667+0000 7f9d8a163700 1 --2- 172.21.15.146:0/1018051199 >> v2:172.21.15.146:3300/0 conn(0x7f9d841300a0 0x7f9d841304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.667+0000 7f9d8a163700 1 -- 172.21.15.146:0/1018051199 >> 172.21.15.146:0/1018051199 conn(0x7f9d84099c40 msgr2=0x7f9d840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.667+0000 7f9d8a163700 1 -- 172.21.15.146:0/1018051199 shutdown_connections 2023-10-03T10:17:18.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.667+0000 7f9d8a163700 1 -- 172.21.15.146:0/1018051199 wait complete. 2023-10-03T10:17:18.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.668+0000 7f9d8a163700 1 Processor -- start 2023-10-03T10:17:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.668+0000 7f9d8a163700 1 -- start start 2023-10-03T10:17:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d8a163700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d841300a0 0x7f9d8411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d8a163700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d841309f0 0x7f9d8411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d8a163700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d84133ad0 0x7f9d8411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d8a163700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8411f020 con 0x7f9d84133ad0 2023-10-03T10:17:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d8a163700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8412de80 con 0x7f9d841309f0 2023-10-03T10:17:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d8a163700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d840a33e0 con 0x7f9d841300a0 2023-10-03T10:17:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d82ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d841309f0 0x7f9d8411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d837fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d841300a0 0x7f9d8411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d82ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d841309f0 0x7f9d8411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35260/0 (socket says 172.21.15.146:35260) 2023-10-03T10:17:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d82ffd700 1 -- 172.21.15.146:0/3169319874 learned_addr learned my addr 172.21.15.146:0/3169319874 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d83fff700 1 --2- 172.21.15.146:0/3169319874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d84133ad0 0x7f9d8411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d837fe700 1 -- 172.21.15.146:0/3169319874 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d841309f0 msgr2=0x7f9d8411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d837fe700 1 --2- 172.21.15.146:0/3169319874 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d841309f0 0x7f9d8411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d837fe700 1 -- 172.21.15.146:0/3169319874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d84133ad0 msgr2=0x7f9d8411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d837fe700 1 --2- 172.21.15.146:0/3169319874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d84133ad0 0x7f9d8411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d837fe700 1 -- 172.21.15.146:0/3169319874 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d74009550 con 0x7f9d841300a0 2023-10-03T10:17:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d82ffd700 1 --2- 172.21.15.146:0/3169319874 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d841309f0 0x7f9d8411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d837fe700 1 --2- 172.21.15.146:0/3169319874 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d841300a0 0x7f9d8411da40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00e900 tx=0x7f9d6c00ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d7bfff700 1 -- 172.21.15.146:0/3169319874 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c013680 con 0x7f9d841300a0 2023-10-03T10:17:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d7bfff700 1 -- 172.21.15.146:0/3169319874 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c0137e0 con 0x7f9d841300a0 2023-10-03T10:17:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d7bfff700 1 -- 172.21.15.146:0/3169319874 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c013b50 con 0x7f9d841300a0 2023-10-03T10:17:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d8a163700 1 -- 172.21.15.146:0/3169319874 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7c009a70 con 0x7f9d841300a0 2023-10-03T10:17:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.669+0000 7f9d8a163700 1 -- 172.21.15.146:0/3169319874 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8411fbe0 con 0x7f9d841300a0 2023-10-03T10:17:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.670+0000 7f9d7bfff700 1 -- 172.21.15.146:0/3169319874 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d6c013cb0 con 0x7f9d841300a0 2023-10-03T10:17:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.670+0000 7f9d7bfff700 1 -- 172.21.15.146:0/3169319874 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9d6c03f650 con 0x7f9d841300a0 2023-10-03T10:17:18.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.670+0000 7f9d8a163700 1 -- 172.21.15.146:0/3169319874 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8404f2a0 con 0x7f9d841300a0 2023-10-03T10:17:18.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.675+0000 7f9d7bfff700 1 -- 172.21.15.146:0/3169319874 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d6c01c970 con 0x7f9d841300a0 2023-10-03T10:17:18.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.860+0000 7f9d8a163700 1 -- 172.21.15.146:0/3169319874 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9d8411fd70 con 0x7f9d841300a0 2023-10-03T10:17:18.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.860+0000 7f9d7bfff700 1 -- 172.21.15.146:0/3169319874 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9d6c02a090 con 0x7f9d841300a0 2023-10-03T10:17:18.861 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:18.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.862+0000 7f9d8a163700 1 -- 172.21.15.146:0/3169319874 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d841300a0 msgr2=0x7f9d8411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.862+0000 7f9d8a163700 1 --2- 172.21.15.146:0/3169319874 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d841300a0 0x7f9d8411da40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00e900 tx=0x7f9d6c00ec10 comp rx=0 tx=0).stop 2023-10-03T10:17:18.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.862+0000 7f9d8a163700 1 -- 172.21.15.146:0/3169319874 shutdown_connections 2023-10-03T10:17:18.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.862+0000 7f9d8a163700 1 --2- 172.21.15.146:0/3169319874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d84133ad0 0x7f9d8411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.862+0000 7f9d8a163700 1 --2- 172.21.15.146:0/3169319874 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d841300a0 0x7f9d8411da40 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.862+0000 7f9d8a163700 1 --2- 172.21.15.146:0/3169319874 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d841309f0 0x7f9d8411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.862+0000 7f9d8a163700 1 -- 172.21.15.146:0/3169319874 >> 172.21.15.146:0/3169319874 conn(0x7f9d84099c40 msgr2=0x7f9d84132b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.862+0000 7f9d8a163700 1 -- 172.21.15.146:0/3169319874 shutdown_connections 2023-10-03T10:17:18.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:18.862+0000 7f9d8a163700 1 -- 172.21.15.146:0/3169319874 wait complete. 2023-10-03T10:17:18.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:19.334 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:19.451 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:19.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.458+0000 7f0440957700 1 Processor -- start 2023-10-03T10:17:19.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.458+0000 7f0440957700 1 -- start start 2023-10-03T10:17:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.458+0000 7f0440957700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f043c12e490 0x7f043c12e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.458+0000 7f0440957700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f043c09da10 0x7f043c06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.459+0000 7f0440957700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f043c06acb0 0x7f043c06b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.459+0000 7f0440957700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043c12de50 con 0x7f043c06acb0 2023-10-03T10:17:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.459+0000 7f0440957700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c09f6e0 con 0x7f043c12e490 2023-10-03T10:17:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.459+0000 7f0440957700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f043c09eb00 con 0x7f043c09da10 2023-10-03T10:17:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.459+0000 7f043a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f043c12e490 0x7f043c12e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.459+0000 7f0439d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f043c09da10 0x7f043c06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.459+0000 7f043ad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f043c06acb0 0x7f043c06b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.459+0000 7f043a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f043c12e490 0x7f043c12e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35262/0 (socket says 172.21.15.146:35262) 2023-10-03T10:17:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.459+0000 7f0439d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f043c09da10 0x7f043c06a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51364/0 (socket says 172.21.15.146:51364) 2023-10-03T10:17:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.459+0000 7f043a59c700 1 -- 172.21.15.146:0/2334497694 learned_addr learned my addr 172.21.15.146:0/2334497694 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.459+0000 7f0439d9b700 1 -- 172.21.15.146:0/2334497694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f043c12e490 msgr2=0x7f043c12e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.459+0000 7f0439d9b700 1 --2- 172.21.15.146:0/2334497694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f043c12e490 0x7f043c12e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.459+0000 7f0439d9b700 1 -- 172.21.15.146:0/2334497694 >> v2:172.21.15.146:3300/0 conn(0x7f043c06acb0 msgr2=0x7f043c06b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.459+0000 7f0439d9b700 1 --2- 172.21.15.146:0/2334497694 >> v2:172.21.15.146:3300/0 conn(0x7f043c06acb0 0x7f043c06b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.459+0000 7f0439d9b700 1 -- 172.21.15.146:0/2334497694 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c09e780 con 0x7f043c09da10 2023-10-03T10:17:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.459+0000 7f043ad9d700 1 --2- 172.21.15.146:0/2334497694 >> v2:172.21.15.146:3300/0 conn(0x7f043c06acb0 0x7f043c06b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.459+0000 7f043a59c700 1 --2- 172.21.15.146:0/2334497694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f043c12e490 0x7f043c12e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.459+0000 7f0439d9b700 1 --2- 172.21.15.146:0/2334497694 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f043c09da10 0x7f043c06a770 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0430009870 tx=0x7f0430009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1340cb9eb8ed8e5d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.459+0000 7f043959a700 1 -- 172.21.15.146:0/2334497694 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0430011830 con 0x7f043c09da10 2023-10-03T10:17:19.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.459+0000 7f043959a700 1 -- 172.21.15.146:0/2334497694 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0430011990 con 0x7f043c09da10 2023-10-03T10:17:19.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.459+0000 7f043959a700 1 -- 172.21.15.146:0/2334497694 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0430011d20 con 0x7f043c09da10 2023-10-03T10:17:19.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.460+0000 7f0440957700 1 -- 172.21.15.146:0/2334497694 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f043c09da10 msgr2=0x7f043c06a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.460+0000 7f0440957700 1 --2- 172.21.15.146:0/2334497694 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f043c09da10 0x7f043c06a770 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0430009870 tx=0x7f0430009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:19.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.460+0000 7f0440957700 1 -- 172.21.15.146:0/2334497694 shutdown_connections 2023-10-03T10:17:19.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.460+0000 7f0440957700 1 --2- 172.21.15.146:0/2334497694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f043c12e490 0x7f043c12e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.460+0000 7f0440957700 1 --2- 172.21.15.146:0/2334497694 >> v2:172.21.15.146:3300/0 conn(0x7f043c06acb0 0x7f043c06b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.460+0000 7f0440957700 1 --2- 172.21.15.146:0/2334497694 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f043c09da10 0x7f043c06a770 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.460+0000 7f0440957700 1 -- 172.21.15.146:0/2334497694 >> 172.21.15.146:0/2334497694 conn(0x7f043c099c40 msgr2=0x7f043c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.460+0000 7f0440957700 1 -- 172.21.15.146:0/2334497694 shutdown_connections 2023-10-03T10:17:19.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.460+0000 7f0440957700 1 -- 172.21.15.146:0/2334497694 wait complete. 2023-10-03T10:17:19.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.461+0000 7f0440957700 1 Processor -- start 2023-10-03T10:17:19.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.461+0000 7f0440957700 1 -- start start 2023-10-03T10:17:19.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.462+0000 7f0440957700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f043c06acb0 0x7f043c070920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.462+0000 7f0440957700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f043c09da10 0x7f043c070e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.462+0000 7f0440957700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f043c12e490 0x7f043c0713a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.462+0000 7f0440957700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c071d10 con 0x7f043c12e490 2023-10-03T10:17:19.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.462+0000 7f0440957700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0a1010 con 0x7f043c09da10 2023-10-03T10:17:19.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.462+0000 7f0440957700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f043c12bab0 con 0x7f043c06acb0 2023-10-03T10:17:19.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.462+0000 7f043a59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f043c06acb0 0x7f043c070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.462+0000 7f0439d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f043c09da10 0x7f043c070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.462+0000 7f043a59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f043c06acb0 0x7f043c070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51376/0 (socket says 172.21.15.146:51376) 2023-10-03T10:17:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.462+0000 7f043a59c700 1 -- 172.21.15.146:0/4137714689 learned_addr learned my addr 172.21.15.146:0/4137714689 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.462+0000 7f043ad9d700 1 --2- 172.21.15.146:0/4137714689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f043c12e490 0x7f043c0713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.462+0000 7f043a59c700 1 -- 172.21.15.146:0/4137714689 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f043c09da10 msgr2=0x7f043c070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.462+0000 7f043a59c700 1 --2- 172.21.15.146:0/4137714689 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f043c09da10 0x7f043c070e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.462+0000 7f043a59c700 1 -- 172.21.15.146:0/4137714689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f043c12e490 msgr2=0x7f043c0713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.462+0000 7f043a59c700 1 --2- 172.21.15.146:0/4137714689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f043c12e490 0x7f043c0713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.462+0000 7f043a59c700 1 -- 172.21.15.146:0/4137714689 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0434009a70 con 0x7f043c06acb0 2023-10-03T10:17:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.462+0000 7f043a59c700 1 --2- 172.21.15.146:0/4137714689 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f043c06acb0 0x7f043c070920 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f042c00ebe0 tx=0x7f042c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.462+0000 7f042affd700 1 -- 172.21.15.146:0/4137714689 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c00c850 con 0x7f043c06acb0 2023-10-03T10:17:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.463+0000 7f042affd700 1 -- 172.21.15.146:0/4137714689 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042c00c9b0 con 0x7f043c06acb0 2023-10-03T10:17:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.463+0000 7f0440957700 1 -- 172.21.15.146:0/4137714689 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f042c009550 con 0x7f043c06acb0 2023-10-03T10:17:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.463+0000 7f042affd700 1 -- 172.21.15.146:0/4137714689 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c00cd20 con 0x7f043c06acb0 2023-10-03T10:17:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.463+0000 7f0440957700 1 -- 172.21.15.146:0/4137714689 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04300094a0 con 0x7f043c06acb0 2023-10-03T10:17:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.463+0000 7f042affd700 1 -- 172.21.15.146:0/4137714689 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f042c013470 con 0x7f043c06acb0 2023-10-03T10:17:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.463+0000 7f042affd700 1 -- 172.21.15.146:0/4137714689 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f042c03fc10 con 0x7f043c06acb0 2023-10-03T10:17:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.464+0000 7f0440957700 1 -- 172.21.15.146:0/4137714689 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043c11a7e0 con 0x7f043c06acb0 2023-10-03T10:17:19.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.468+0000 7f042affd700 1 -- 172.21.15.146:0/4137714689 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f042c017080 con 0x7f043c06acb0 2023-10-03T10:17:19.503 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:19.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.580+0000 7f80808bd700 1 Processor -- start 2023-10-03T10:17:19.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.580+0000 7f80808bd700 1 -- start start 2023-10-03T10:17:19.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.581+0000 7f80808bd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f807c09d860 0x7f807c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.581+0000 7f80808bd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f807c130eb0 0x7f807c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.581+0000 7f80808bd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f807c09aaa0 con 0x7f807c09e170 2023-10-03T10:17:19.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.581+0000 7f80808bd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807c09f870 con 0x7f807c130eb0 2023-10-03T10:17:19.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.581+0000 7f80808bd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f807c09b360 con 0x7f807c09d860 2023-10-03T10:17:19.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.581+0000 7f807ad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f807c130eb0 0x7f807c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.581+0000 7f8079d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f807c09e170 0x7f807c1307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59180/0 (socket says 172.21.15.146:59180) 2023-10-03T10:17:19.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.581+0000 7f8079d9b700 1 -- 172.21.15.146:0/3335416832 learned_addr learned my addr 172.21.15.146:0/3335416832 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:19.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.581+0000 7f807a59c700 1 --2- 172.21.15.146:0/3335416832 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f807c09d860 0x7f807c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.581+0000 7f807959a700 1 -- 172.21.15.146:0/3335416832 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215412662 0 0) 0x7f807c09aaa0 con 0x7f807c09e170 2023-10-03T10:17:19.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.581+0000 7f807959a700 1 -- 172.21.15.146:0/3335416832 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80640057c0 con 0x7f807c09e170 2023-10-03T10:17:19.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.581+0000 7f807ad9d700 1 -- 172.21.15.146:0/3335416832 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f807c09d860 msgr2=0x7f807c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.581+0000 7f807ad9d700 1 --2- 172.21.15.146:0/3335416832 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f807c09d860 0x7f807c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.581+0000 7f807ad9d700 1 -- 172.21.15.146:0/3335416832 >> v1:172.21.15.146:6789/0 conn(0x7f807c09e170 legacy=0x7f807c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.581+0000 7f807ad9d700 1 -- 172.21.15.146:0/3335416832 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807c09b620 con 0x7f807c130eb0 2023-10-03T10:17:19.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.582+0000 7f807a59c700 1 --2- 172.21.15.146:0/3335416832 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f807c09d860 0x7f807c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.582+0000 7f807ad9d700 1 --2- 172.21.15.146:0/3335416832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f807c130eb0 0x7f807c138a00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8074009dc0 tx=0x7f807400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cead2882d9cc235b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.582+0000 7f807959a700 1 -- 172.21.15.146:0/3335416832 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807400e070 con 0x7f807c130eb0 2023-10-03T10:17:19.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.582+0000 7f807959a700 1 -- 172.21.15.146:0/3335416832 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807400bb20 con 0x7f807c130eb0 2023-10-03T10:17:19.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.582+0000 7f807959a700 1 -- 172.21.15.146:0/3335416832 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8074012430 con 0x7f807c130eb0 2023-10-03T10:17:19.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.582+0000 7f80808bd700 1 -- 172.21.15.146:0/3335416832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f807c130eb0 msgr2=0x7f807c138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.582+0000 7f80808bd700 1 --2- 172.21.15.146:0/3335416832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f807c130eb0 0x7f807c138a00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8074009dc0 tx=0x7f807400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:19.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.583+0000 7f80808bd700 1 -- 172.21.15.146:0/3335416832 shutdown_connections 2023-10-03T10:17:19.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.583+0000 7f80808bd700 1 --2- 172.21.15.146:0/3335416832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f807c130eb0 0x7f807c138a00 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.583+0000 7f80808bd700 1 --2- 172.21.15.146:0/3335416832 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f807c09d860 0x7f807c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.583+0000 7f80808bd700 1 -- 172.21.15.146:0/3335416832 >> 172.21.15.146:0/3335416832 conn(0x7f807c099c40 msgr2=0x7f807c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.583+0000 7f80808bd700 1 -- 172.21.15.146:0/3335416832 shutdown_connections 2023-10-03T10:17:19.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.583+0000 7f80808bd700 1 -- 172.21.15.146:0/3335416832 wait complete. 2023-10-03T10:17:19.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.584+0000 7f80808bd700 1 Processor -- start 2023-10-03T10:17:19.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.584+0000 7f80808bd700 1 -- start start 2023-10-03T10:17:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.585+0000 7f80808bd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f807c09d860 0x7f807c11e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.585+0000 7f80808bd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f807c09e170 0x7f807c11e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.585+0000 7f80808bd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f807c130eb0 0x7f807c11ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.585+0000 7f80808bd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807c121ae0 con 0x7f807c09d860 2023-10-03T10:17:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.585+0000 7f80808bd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807c121dc0 con 0x7f807c130eb0 2023-10-03T10:17:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.585+0000 7f80808bd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f807c0a26f0 con 0x7f807c09e170 2023-10-03T10:17:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.585+0000 7f807a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f807c09d860 0x7f807c11e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.585+0000 7f8079d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f807c09e170 0x7f807c11e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.585+0000 7f8079d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f807c09e170 0x7f807c11e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51402/0 (socket says 172.21.15.146:51402) 2023-10-03T10:17:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.585+0000 7f807a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f807c09d860 0x7f807c11e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58098/0 (socket says 172.21.15.146:58098) 2023-10-03T10:17:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.585+0000 7f8079d9b700 1 -- 172.21.15.146:0/657840790 learned_addr learned my addr 172.21.15.146:0/657840790 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.585+0000 7f807ad9d700 1 --2- 172.21.15.146:0/657840790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f807c130eb0 0x7f807c11ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.585+0000 7f8079d9b700 1 -- 172.21.15.146:0/657840790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f807c130eb0 msgr2=0x7f807c11ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.585+0000 7f8079d9b700 1 --2- 172.21.15.146:0/657840790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f807c130eb0 0x7f807c11ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.585+0000 7f8079d9b700 1 -- 172.21.15.146:0/657840790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f807c09d860 msgr2=0x7f807c11e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.585+0000 7f8079d9b700 1 --2- 172.21.15.146:0/657840790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f807c09d860 0x7f807c11e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.585+0000 7f8079d9b700 1 -- 172.21.15.146:0/657840790 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806c0094a0 con 0x7f807c09e170 2023-10-03T10:17:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.585+0000 7f807a59c700 1 --2- 172.21.15.146:0/657840790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f807c09d860 0x7f807c11e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.585+0000 7f807ad9d700 1 --2- 172.21.15.146:0/657840790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f807c130eb0 0x7f807c11ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.586+0000 7f8079d9b700 1 --2- 172.21.15.146:0/657840790 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f807c09e170 0x7f807c11e830 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f8070005910 tx=0x7f807000c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.586+0000 7f806affd700 1 -- 172.21.15.146:0/657840790 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8070005d70 con 0x7f807c09e170 2023-10-03T10:17:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.586+0000 7f806affd700 1 -- 172.21.15.146:0/657840790 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80700070d0 con 0x7f807c09e170 2023-10-03T10:17:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.586+0000 7f80808bd700 1 -- 172.21.15.146:0/657840790 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8074009a70 con 0x7f807c09e170 2023-10-03T10:17:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.586+0000 7f806affd700 1 -- 172.21.15.146:0/657840790 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8070007460 con 0x7f807c09e170 2023-10-03T10:17:19.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.586+0000 7f80808bd700 1 -- 172.21.15.146:0/657840790 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807c121100 con 0x7f807c09e170 2023-10-03T10:17:19.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.587+0000 7f80808bd700 1 -- 172.21.15.146:0/657840790 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807c120d30 con 0x7f807c09e170 2023-10-03T10:17:19.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.587+0000 7f806affd700 1 -- 172.21.15.146:0/657840790 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f80700075c0 con 0x7f807c09e170 2023-10-03T10:17:19.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.587+0000 7f806affd700 1 -- 172.21.15.146:0/657840790 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f807003efe0 con 0x7f807c09e170 2023-10-03T10:17:19.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.596+0000 7f806affd700 1 -- 172.21.15.146:0/657840790 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f807000f260 con 0x7f807c09e170 2023-10-03T10:17:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.631+0000 7fdde60cb700 1 Processor -- start 2023-10-03T10:17:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.631+0000 7fdde60cb700 1 -- start start 2023-10-03T10:17:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.631+0000 7fdde60cb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdde0099e20 0x7fdde009a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.631+0000 7fdde60cb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdde0130a60 0x7fdde0138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.631+0000 7fdde60cb700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde0099a60 con 0x7fdde009a730 2023-10-03T10:17:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.631+0000 7fdde60cb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde009bf50 con 0x7fdde0130a60 2023-10-03T10:17:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.631+0000 7fdde60cb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdde009b230 con 0x7fdde0099e20 2023-10-03T10:17:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.632+0000 7fdddf7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdde0099e20 0x7fdde009a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.632+0000 7fdddeffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdde009a730 0x7fdde0130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59196/0 (socket says 172.21.15.146:59196) 2023-10-03T10:17:19.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.632+0000 7fdddeffd700 1 -- 172.21.15.146:0/4172705678 learned_addr learned my addr 172.21.15.146:0/4172705678 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:19.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.632+0000 7fdddffff700 1 --2- 172.21.15.146:0/4172705678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdde0130a60 0x7fdde0138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.632+0000 7fdddf7fe700 1 -- 172.21.15.146:0/4172705678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdde0130a60 msgr2=0x7fdde0138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.632+0000 7fdddf7fe700 1 --2- 172.21.15.146:0/4172705678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdde0130a60 0x7fdde0138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.632+0000 7fdddf7fe700 1 -- 172.21.15.146:0/4172705678 >> v1:172.21.15.146:6789/0 conn(0x7fdde009a730 legacy=0x7fdde0130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.632+0000 7fdddf7fe700 1 -- 172.21.15.146:0/4172705678 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde009bb90 con 0x7fdde0099e20 2023-10-03T10:17:19.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.632+0000 7fdddf7fe700 1 --2- 172.21.15.146:0/4172705678 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdde0099e20 0x7fdde009a1f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009850 tx=0x7fddd0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=116ee7934a8fbeac server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.632+0000 7fddde7fc700 1 -- 172.21.15.146:0/4172705678 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0005e30 con 0x7fdde0099e20 2023-10-03T10:17:19.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.632+0000 7fddde7fc700 1 -- 172.21.15.146:0/4172705678 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd0006030 con 0x7fdde0099e20 2023-10-03T10:17:19.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.632+0000 7fddde7fc700 1 -- 172.21.15.146:0/4172705678 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd00063e0 con 0x7fdde0099e20 2023-10-03T10:17:19.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.633+0000 7fdde60cb700 1 -- 172.21.15.146:0/4172705678 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdde0099e20 msgr2=0x7fdde009a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.633+0000 7fdde60cb700 1 --2- 172.21.15.146:0/4172705678 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdde0099e20 0x7fdde009a1f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009850 tx=0x7fddd0009b60 comp rx=0 tx=0).stop 2023-10-03T10:17:19.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.633+0000 7fdde60cb700 1 -- 172.21.15.146:0/4172705678 shutdown_connections 2023-10-03T10:17:19.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.633+0000 7fdde60cb700 1 --2- 172.21.15.146:0/4172705678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdde0130a60 0x7fdde0138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.633+0000 7fdde60cb700 1 --2- 172.21.15.146:0/4172705678 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdde0099e20 0x7fdde009a1f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.633+0000 7fdde60cb700 1 -- 172.21.15.146:0/4172705678 >> 172.21.15.146:0/4172705678 conn(0x7fdde00a2980 msgr2=0x7fdde00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.633+0000 7fdde60cb700 1 -- 172.21.15.146:0/4172705678 shutdown_connections 2023-10-03T10:17:19.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.633+0000 7fdde60cb700 1 -- 172.21.15.146:0/4172705678 wait complete. 2023-10-03T10:17:19.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.634+0000 7fdde60cb700 1 Processor -- start 2023-10-03T10:17:19.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.634+0000 7fdde60cb700 1 -- start start 2023-10-03T10:17:19.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.634+0000 7fdde60cb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdde0099e20 0x7fdde01c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.634+0000 7fdde60cb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdde009a730 0x7fdde01c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.634+0000 7fdde60cb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdde0130a60 0x7fdde01c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.635+0000 7fdde60cb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde012bae0 con 0x7fdde009a730 2023-10-03T10:17:19.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.635+0000 7fdde60cb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde0128490 con 0x7fdde0130a60 2023-10-03T10:17:19.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.635+0000 7fdde60cb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdde012ab40 con 0x7fdde0099e20 2023-10-03T10:17:19.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.635+0000 7fdddf7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdde0099e20 0x7fdde01c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.635+0000 7fdddf7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdde0099e20 0x7fdde01c5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51424/0 (socket says 172.21.15.146:51424) 2023-10-03T10:17:19.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.635+0000 7fdddf7fe700 1 -- 172.21.15.146:0/2063726025 learned_addr learned my addr 172.21.15.146:0/2063726025 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:19.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.635+0000 7fdddffff700 1 --2- 172.21.15.146:0/2063726025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdde0130a60 0x7fdde01c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.635+0000 7fdddeffd700 1 --2- 172.21.15.146:0/2063726025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdde009a730 0x7fdde01c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.635+0000 7fdddf7fe700 1 -- 172.21.15.146:0/2063726025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdde0130a60 msgr2=0x7fdde01c6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.635+0000 7fdddf7fe700 1 --2- 172.21.15.146:0/2063726025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdde0130a60 0x7fdde01c6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.635+0000 7fdddf7fe700 1 -- 172.21.15.146:0/2063726025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdde009a730 msgr2=0x7fdde01c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.635+0000 7fdddf7fe700 1 --2- 172.21.15.146:0/2063726025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdde009a730 0x7fdde01c6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.635+0000 7fdddf7fe700 1 -- 172.21.15.146:0/2063726025 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd0009430 con 0x7fdde0099e20 2023-10-03T10:17:19.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.635+0000 7fdddffff700 1 --2- 172.21.15.146:0/2063726025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdde0130a60 0x7fdde01c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.635+0000 7fdddeffd700 1 --2- 172.21.15.146:0/2063726025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdde009a730 0x7fdde01c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.635+0000 7fdddf7fe700 1 --2- 172.21.15.146:0/2063726025 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdde0099e20 0x7fdde01c5ed0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fddd0013040 tx=0x7fddd0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.635+0000 7fddc7fff700 1 -- 172.21.15.146:0/2063726025 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0020820 con 0x7fdde0099e20 2023-10-03T10:17:19.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.635+0000 7fddc7fff700 1 -- 172.21.15.146:0/2063726025 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd0024070 con 0x7fdde0099e20 2023-10-03T10:17:19.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.635+0000 7fdde60cb700 1 -- 172.21.15.146:0/2063726025 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde00a1070 con 0x7fdde0099e20 2023-10-03T10:17:19.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.635+0000 7fddc7fff700 1 -- 172.21.15.146:0/2063726025 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0020ba0 con 0x7fdde0099e20 2023-10-03T10:17:19.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.635+0000 7fdde60cb700 1 -- 172.21.15.146:0/2063726025 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde0129bc0 con 0x7fdde0099e20 2023-10-03T10:17:19.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.636+0000 7fddc7fff700 1 -- 172.21.15.146:0/2063726025 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fddd0026030 con 0x7fdde0099e20 2023-10-03T10:17:19.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.636+0000 7fddc7fff700 1 -- 172.21.15.146:0/2063726025 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fddd0045300 con 0x7fdde0099e20 2023-10-03T10:17:19.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.636+0000 7fdde60cb700 1 -- 172.21.15.146:0/2063726025 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde0072480 con 0x7fdde0099e20 2023-10-03T10:17:19.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.641+0000 7fddc7fff700 1 -- 172.21.15.146:0/2063726025 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdde0072480 con 0x7fdde0099e20 2023-10-03T10:17:19.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.698+0000 7f0440957700 1 -- 172.21.15.146:0/4137714689 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f043c04f2a0 con 0x7f043c06acb0 2023-10-03T10:17:19.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.699+0000 7f042affd700 1 -- 172.21.15.146:0/4137714689 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f042c01b3b0 con 0x7f043c06acb0 2023-10-03T10:17:19.700 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:19.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.701+0000 7f0440957700 1 -- 172.21.15.146:0/4137714689 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f043c06acb0 msgr2=0x7f043c070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.701+0000 7f0440957700 1 --2- 172.21.15.146:0/4137714689 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f043c06acb0 0x7f043c070920 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f042c00ebe0 tx=0x7f042c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.701+0000 7f0440957700 1 -- 172.21.15.146:0/4137714689 shutdown_connections 2023-10-03T10:17:19.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.701+0000 7f0440957700 1 --2- 172.21.15.146:0/4137714689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f043c12e490 0x7f043c0713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.701+0000 7f0440957700 1 --2- 172.21.15.146:0/4137714689 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f043c06acb0 0x7f043c070920 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.701+0000 7f0440957700 1 --2- 172.21.15.146:0/4137714689 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f043c09da10 0x7f043c070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.701+0000 7f0440957700 1 -- 172.21.15.146:0/4137714689 >> 172.21.15.146:0/4137714689 conn(0x7f043c099c40 msgr2=0x7f043c12cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.701+0000 7f0440957700 1 -- 172.21.15.146:0/4137714689 shutdown_connections 2023-10-03T10:17:19.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.701+0000 7f0440957700 1 -- 172.21.15.146:0/4137714689 wait complete. 2023-10-03T10:17:19.714 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:19.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.791+0000 7f80808bd700 1 -- 172.21.15.146:0/657840790 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f807c04f2a0 con 0x7f807c09e170 2023-10-03T10:17:19.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.791+0000 7f806affd700 1 -- 172.21.15.146:0/657840790 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8070019ab0 con 0x7f807c09e170 2023-10-03T10:17:19.792 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:19.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.793+0000 7f80808bd700 1 -- 172.21.15.146:0/657840790 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f807c09e170 msgr2=0x7f807c11e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.793+0000 7f80808bd700 1 --2- 172.21.15.146:0/657840790 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f807c09e170 0x7f807c11e830 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f8070005910 tx=0x7f807000c9e0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.793+0000 7f80808bd700 1 -- 172.21.15.146:0/657840790 shutdown_connections 2023-10-03T10:17:19.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.793+0000 7f80808bd700 1 --2- 172.21.15.146:0/657840790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f807c130eb0 0x7f807c11ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.793+0000 7f80808bd700 1 --2- 172.21.15.146:0/657840790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f807c09d860 0x7f807c11e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.793+0000 7f80808bd700 1 --2- 172.21.15.146:0/657840790 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f807c09e170 0x7f807c11e830 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.793+0000 7f80808bd700 1 -- 172.21.15.146:0/657840790 >> 172.21.15.146:0/657840790 conn(0x7f807c099c40 msgr2=0x7f807c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.793+0000 7f80808bd700 1 -- 172.21.15.146:0/657840790 shutdown_connections 2023-10-03T10:17:19.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.793+0000 7f80808bd700 1 -- 172.21.15.146:0/657840790 wait complete. 2023-10-03T10:17:19.806 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:19.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.856+0000 7fdde60cb700 1 -- 172.21.15.146:0/2063726025 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdde0072480 con 0x7fdde0099e20 2023-10-03T10:17:19.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.857+0000 7fddc7fff700 1 -- 172.21.15.146:0/2063726025 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdde0072480 con 0x7fdde0099e20 2023-10-03T10:17:19.858 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:19.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.859+0000 7fdde60cb700 1 -- 172.21.15.146:0/2063726025 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdde0099e20 msgr2=0x7fdde01c5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.859+0000 7fdde60cb700 1 --2- 172.21.15.146:0/2063726025 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdde0099e20 0x7fdde01c5ed0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fddd0013040 tx=0x7fddd0004750 comp rx=0 tx=0).stop 2023-10-03T10:17:19.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.859+0000 7fdde60cb700 1 -- 172.21.15.146:0/2063726025 shutdown_connections 2023-10-03T10:17:19.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.859+0000 7fdde60cb700 1 --2- 172.21.15.146:0/2063726025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdde0130a60 0x7fdde01c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.859+0000 7fdde60cb700 1 --2- 172.21.15.146:0/2063726025 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdde0099e20 0x7fdde01c5ed0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.859+0000 7fdde60cb700 1 --2- 172.21.15.146:0/2063726025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdde009a730 0x7fdde01c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.859+0000 7fdde60cb700 1 -- 172.21.15.146:0/2063726025 >> 172.21.15.146:0/2063726025 conn(0x7fdde00a2980 msgr2=0x7fdde0127040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.859+0000 7fdde60cb700 1 -- 172.21.15.146:0/2063726025 shutdown_connections 2023-10-03T10:17:19.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.859+0000 7fdde60cb700 1 -- 172.21.15.146:0/2063726025 wait complete. 2023-10-03T10:17:19.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:19.876 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:19.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.996+0000 7fa7ed440700 1 Processor -- start 2023-10-03T10:17:19.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.997+0000 7fa7ed440700 1 -- start start 2023-10-03T10:17:20.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.997+0000 7fa7ed440700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7e809d8f0 0x7fa7e812feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.997+0000 7fa7ed440700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7e8135f90 0x7fa7e8138370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.997+0000 7fa7ed440700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e809a540 con 0x7fa7e809dcc0 2023-10-03T10:17:20.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.997+0000 7fa7ed440700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e8130b00 con 0x7fa7e8135f90 2023-10-03T10:17:20.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.997+0000 7fa7ed440700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e809ad40 con 0x7fa7e809d8f0 2023-10-03T10:17:20.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.997+0000 7fa7e77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7e8135f90 0x7fa7e8138370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.997+0000 7fa7e77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7e8135f90 0x7fa7e8138370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35314/0 (socket says 172.21.15.146:35314) 2023-10-03T10:17:20.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.997+0000 7fa7e6ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7e809d8f0 0x7fa7e812feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.997+0000 7fa7e77fe700 1 -- 172.21.15.146:0/2334482481 learned_addr learned my addr 172.21.15.146:0/2334482481 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:20.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.997+0000 7fa7e67fc700 1 --1- 172.21.15.146:0/2334482481 >> v1:172.21.15.146:6789/0 conn(0x7fa7e809dcc0 0x7fa7e81303f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59198/0 (socket says 172.21.15.146:59198) 2023-10-03T10:17:20.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.997+0000 7fa7e77fe700 1 -- 172.21.15.146:0/2334482481 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7e809d8f0 msgr2=0x7fa7e812feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:20.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.997+0000 7fa7e77fe700 1 --2- 172.21.15.146:0/2334482481 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7e809d8f0 0x7fa7e812feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.997+0000 7fa7e5ffb700 1 -- 172.21.15.146:0/2334482481 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889422021 0 0) 0x7fa7e809a540 con 0x7fa7e809dcc0 2023-10-03T10:17:20.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.997+0000 7fa7e77fe700 1 -- 172.21.15.146:0/2334482481 >> v1:172.21.15.146:6789/0 conn(0x7fa7e809dcc0 legacy=0x7fa7e81303f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.997+0000 7fa7e77fe700 1 -- 172.21.15.146:0/2334482481 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e809e640 con 0x7fa7e8135f90 2023-10-03T10:17:20.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.997+0000 7fa7e6ffd700 1 --2- 172.21.15.146:0/2334482481 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7e809d8f0 0x7fa7e812feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:20.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.998+0000 7fa7e77fe700 1 --2- 172.21.15.146:0/2334482481 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7e8135f90 0x7fa7e8138370 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000d180 tx=0x7fa7e000d490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5e9508ad9aadee8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.998+0000 7fa7e5ffb700 1 -- 172.21.15.146:0/2334482481 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0010070 con 0x7fa7e8135f90 2023-10-03T10:17:20.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.998+0000 7fa7e5ffb700 1 -- 172.21.15.146:0/2334482481 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e000dd40 con 0x7fa7e8135f90 2023-10-03T10:17:20.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.998+0000 7fa7e5ffb700 1 -- 172.21.15.146:0/2334482481 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e000b310 con 0x7fa7e8135f90 2023-10-03T10:17:20.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.998+0000 7fa7ed440700 1 -- 172.21.15.146:0/2334482481 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7e8135f90 msgr2=0x7fa7e8138370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.998+0000 7fa7ed440700 1 --2- 172.21.15.146:0/2334482481 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7e8135f90 0x7fa7e8138370 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000d180 tx=0x7fa7e000d490 comp rx=0 tx=0).stop 2023-10-03T10:17:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.998+0000 7fa7ed440700 1 -- 172.21.15.146:0/2334482481 shutdown_connections 2023-10-03T10:17:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.998+0000 7fa7ed440700 1 --2- 172.21.15.146:0/2334482481 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7e8135f90 0x7fa7e8138370 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.998+0000 7fa7ed440700 1 --2- 172.21.15.146:0/2334482481 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7e809d8f0 0x7fa7e812feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.998+0000 7fa7ed440700 1 -- 172.21.15.146:0/2334482481 >> 172.21.15.146:0/2334482481 conn(0x7fa7e80a2b30 msgr2=0x7fa7e809e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.998+0000 7fa7ed440700 1 -- 172.21.15.146:0/2334482481 shutdown_connections 2023-10-03T10:17:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.998+0000 7fa7ed440700 1 -- 172.21.15.146:0/2334482481 wait complete. 2023-10-03T10:17:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.999+0000 7fa7ed440700 1 Processor -- start 2023-10-03T10:17:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:19.999+0000 7fa7ed440700 1 -- start start 2023-10-03T10:17:20.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.000+0000 7fa7ed440700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7e809d8f0 0x7fa7e806e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.000+0000 7fa7ed440700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7e809dcc0 0x7fa7e806eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.000+0000 7fa7ed440700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7e8135f90 0x7fa7e806f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.000+0000 7fa7ed440700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e8071fc0 con 0x7fa7e809dcc0 2023-10-03T10:17:20.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.000+0000 7fa7ed440700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80a0b60 con 0x7fa7e8135f90 2023-10-03T10:17:20.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.000+0000 7fa7ed440700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e806fec0 con 0x7fa7e809d8f0 2023-10-03T10:17:20.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.000+0000 7fa7e6ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7e809d8f0 0x7fa7e806e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.000+0000 7fa7e67fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7e809dcc0 0x7fa7e806eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.000+0000 7fa7e77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7e8135f90 0x7fa7e806f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.000+0000 7fa7e67fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7e809dcc0 0x7fa7e806eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58112/0 (socket says 172.21.15.146:58112) 2023-10-03T10:17:20.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.000+0000 7fa7e6ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7e809d8f0 0x7fa7e806e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51442/0 (socket says 172.21.15.146:51442) 2023-10-03T10:17:20.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.000+0000 7fa7e77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7e8135f90 0x7fa7e806f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35326/0 (socket says 172.21.15.146:35326) 2023-10-03T10:17:20.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.000+0000 7fa7e67fc700 1 -- 172.21.15.146:0/4134825758 learned_addr learned my addr 172.21.15.146:0/4134825758 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:20.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.000+0000 7fa7e6ffd700 1 -- 172.21.15.146:0/4134825758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7e8135f90 msgr2=0x7fa7e806f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.000+0000 7fa7e6ffd700 1 --2- 172.21.15.146:0/4134825758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7e8135f90 0x7fa7e806f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.000+0000 7fa7e6ffd700 1 -- 172.21.15.146:0/4134825758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7e809dcc0 msgr2=0x7fa7e806eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.000+0000 7fa7e6ffd700 1 --2- 172.21.15.146:0/4134825758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7e809dcc0 0x7fa7e806eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.000+0000 7fa7e6ffd700 1 -- 172.21.15.146:0/4134825758 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d0009430 con 0x7fa7e809d8f0 2023-10-03T10:17:20.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.000+0000 7fa7e77fe700 1 --2- 172.21.15.146:0/4134825758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7e8135f90 0x7fa7e806f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:20.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.000+0000 7fa7e67fc700 1 --2- 172.21.15.146:0/4134825758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7e809dcc0 0x7fa7e806eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:20.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.000+0000 7fa7e6ffd700 1 --2- 172.21.15.146:0/4134825758 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7e809d8f0 0x7fa7e806e960 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0010c90 tx=0x7fa7d000b140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.001+0000 7fa7df7fe700 1 -- 172.21.15.146:0/4134825758 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0015070 con 0x7fa7e809d8f0 2023-10-03T10:17:20.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.001+0000 7fa7df7fe700 1 -- 172.21.15.146:0/4134825758 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d0005a20 con 0x7fa7e809d8f0 2023-10-03T10:17:20.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.001+0000 7fa7ed440700 1 -- 172.21.15.146:0/4134825758 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e000bd40 con 0x7fa7e809d8f0 2023-10-03T10:17:20.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.001+0000 7fa7df7fe700 1 -- 172.21.15.146:0/4134825758 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0005d90 con 0x7fa7e809d8f0 2023-10-03T10:17:20.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.001+0000 7fa7ed440700 1 -- 172.21.15.146:0/4134825758 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e8071c90 con 0x7fa7e809d8f0 2023-10-03T10:17:20.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.001+0000 7fa7df7fe700 1 -- 172.21.15.146:0/4134825758 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa7d000b970 con 0x7fa7e809d8f0 2023-10-03T10:17:20.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.001+0000 7fa7df7fe700 1 -- 172.21.15.146:0/4134825758 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa7d0042f70 con 0x7fa7e809d8f0 2023-10-03T10:17:20.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.002+0000 7fa7ed440700 1 -- 172.21.15.146:0/4134825758 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e804f2a0 con 0x7fa7e809d8f0 2023-10-03T10:17:20.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.006+0000 7fa7df7fe700 1 -- 172.21.15.146:0/4134825758 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa7d001e070 con 0x7fa7e809d8f0 2023-10-03T10:17:20.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.191+0000 7fa7ed440700 1 -- 172.21.15.146:0/4134825758 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa7e806b2a0 con 0x7fa7e809d8f0 2023-10-03T10:17:20.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.191+0000 7fa7df7fe700 1 -- 172.21.15.146:0/4134825758 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa7d0018c10 con 0x7fa7e809d8f0 2023-10-03T10:17:20.192 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:20.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.194+0000 7fa7ed440700 1 -- 172.21.15.146:0/4134825758 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7e809d8f0 msgr2=0x7fa7e806e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.194+0000 7fa7ed440700 1 --2- 172.21.15.146:0/4134825758 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7e809d8f0 0x7fa7e806e960 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0010c90 tx=0x7fa7d000b140 comp rx=0 tx=0).stop 2023-10-03T10:17:20.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.194+0000 7fa7ed440700 1 -- 172.21.15.146:0/4134825758 shutdown_connections 2023-10-03T10:17:20.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.194+0000 7fa7ed440700 1 --2- 172.21.15.146:0/4134825758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7e8135f90 0x7fa7e806f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.194+0000 7fa7ed440700 1 --2- 172.21.15.146:0/4134825758 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa7e809d8f0 0x7fa7e806e960 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.194+0000 7fa7ed440700 1 --2- 172.21.15.146:0/4134825758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7e809dcc0 0x7fa7e806eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.194+0000 7fa7ed440700 1 -- 172.21.15.146:0/4134825758 >> 172.21.15.146:0/4134825758 conn(0x7fa7e80a2b30 msgr2=0x7fa7e809c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.194+0000 7fa7ed440700 1 -- 172.21.15.146:0/4134825758 shutdown_connections 2023-10-03T10:17:20.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.194+0000 7fa7ed440700 1 -- 172.21.15.146:0/4134825758 wait complete. 2023-10-03T10:17:20.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:20.715 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:20.807 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:20.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.847+0000 7fb009b11700 1 Processor -- start 2023-10-03T10:17:20.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.847+0000 7fb009b11700 1 -- start start 2023-10-03T10:17:20.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.847+0000 7fb009b11700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb00409ad40 0x7fb004133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.847+0000 7fb009b11700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb004133f70 0x7fb0041343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.847+0000 7fb009b11700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0040a0a70 0x7fb0040a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.847+0000 7fb009b11700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0040a3b60 con 0x7fb00409ad40 2023-10-03T10:17:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.847+0000 7fb009b11700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0041348e0 con 0x7fb004133f70 2023-10-03T10:17:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.847+0000 7fb009b11700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb00409b110 con 0x7fb0040a0a70 2023-10-03T10:17:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.848+0000 7fb003fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0040a0a70 0x7fb0040a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.847+0000 7fb002ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb004133f70 0x7fb0041343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.848+0000 7fb003fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0040a0a70 0x7fb0040a0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51446/0 (socket says 172.21.15.146:51446) 2023-10-03T10:17:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.848+0000 7fb003fff700 1 -- 172.21.15.146:0/22783644 learned_addr learned my addr 172.21.15.146:0/22783644 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.848+0000 7fb0037fe700 1 --2- 172.21.15.146:0/22783644 >> v2:172.21.15.146:3300/0 conn(0x7fb00409ad40 0x7fb004133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.848+0000 7fb0037fe700 1 -- 172.21.15.146:0/22783644 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0040a0a70 msgr2=0x7fb0040a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.848+0000 7fb0037fe700 1 --2- 172.21.15.146:0/22783644 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0040a0a70 0x7fb0040a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.848+0000 7fb0037fe700 1 -- 172.21.15.146:0/22783644 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb004133f70 msgr2=0x7fb0041343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.848+0000 7fb0037fe700 1 --2- 172.21.15.146:0/22783644 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb004133f70 0x7fb0041343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.848+0000 7fb0037fe700 1 -- 172.21.15.146:0/22783644 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0040a2fa0 con 0x7fb00409ad40 2023-10-03T10:17:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.848+0000 7fb002ffd700 1 --2- 172.21.15.146:0/22783644 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb004133f70 0x7fb0041343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.848+0000 7fb003fff700 1 --2- 172.21.15.146:0/22783644 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0040a0a70 0x7fb0040a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.848+0000 7fb0037fe700 1 --2- 172.21.15.146:0/22783644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb00409ad40 0x7fb004133a30 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7faff4009dc0 tx=0x7faff400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b78006858e6fc21 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.848+0000 7fb0027fc700 1 -- 172.21.15.146:0/22783644 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff400e070 con 0x7fb00409ad40 2023-10-03T10:17:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.848+0000 7fb0027fc700 1 -- 172.21.15.146:0/22783644 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff400bae0 con 0x7fb00409ad40 2023-10-03T10:17:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.848+0000 7fb0027fc700 1 -- 172.21.15.146:0/22783644 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff400be90 con 0x7fb00409ad40 2023-10-03T10:17:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.849+0000 7fb009b11700 1 -- 172.21.15.146:0/22783644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb00409ad40 msgr2=0x7fb004133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.849+0000 7fb009b11700 1 --2- 172.21.15.146:0/22783644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb00409ad40 0x7fb004133a30 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7faff4009dc0 tx=0x7faff400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.849+0000 7fb009b11700 1 -- 172.21.15.146:0/22783644 shutdown_connections 2023-10-03T10:17:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.849+0000 7fb009b11700 1 --2- 172.21.15.146:0/22783644 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb0040a0a70 0x7fb0040a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.849+0000 7fb009b11700 1 --2- 172.21.15.146:0/22783644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb00409ad40 0x7fb004133a30 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.849+0000 7fb009b11700 1 --2- 172.21.15.146:0/22783644 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb004133f70 0x7fb0041343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.849+0000 7fb009b11700 1 -- 172.21.15.146:0/22783644 >> 172.21.15.146:0/22783644 conn(0x7fb004099c40 msgr2=0x7fb00406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.849+0000 7fb009b11700 1 -- 172.21.15.146:0/22783644 shutdown_connections 2023-10-03T10:17:20.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.849+0000 7fb009b11700 1 -- 172.21.15.146:0/22783644 wait complete. 2023-10-03T10:17:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.850+0000 7fb009b11700 1 Processor -- start 2023-10-03T10:17:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.850+0000 7fb009b11700 1 -- start start 2023-10-03T10:17:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.850+0000 7fb009b11700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb00409ad40 0x7fb00411d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.850+0000 7fb009b11700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0040a0a70 0x7fb00411d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.850+0000 7fb009b11700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb004133f70 0x7fb00411dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.850+0000 7fb009b11700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb004120bb0 con 0x7fb0040a0a70 2023-10-03T10:17:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.850+0000 7fb009b11700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0041306c0 con 0x7fb00409ad40 2023-10-03T10:17:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.850+0000 7fb009b11700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb004120130 con 0x7fb004133f70 2023-10-03T10:17:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.850+0000 7fb002ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0040a0a70 0x7fb00411d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.850+0000 7fb0037fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb00409ad40 0x7fb00411d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.850+0000 7fb002ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0040a0a70 0x7fb00411d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58122/0 (socket says 172.21.15.146:58122) 2023-10-03T10:17:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.850+0000 7fb0037fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb00409ad40 0x7fb00411d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35354/0 (socket says 172.21.15.146:35354) 2023-10-03T10:17:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.850+0000 7fb002ffd700 1 -- 172.21.15.146:0/331112542 learned_addr learned my addr 172.21.15.146:0/331112542 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.851+0000 7fb003fff700 1 --2- 172.21.15.146:0/331112542 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb004133f70 0x7fb00411dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.851+0000 7fb003fff700 1 -- 172.21.15.146:0/331112542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb00409ad40 msgr2=0x7fb00411d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.851+0000 7fb003fff700 1 --2- 172.21.15.146:0/331112542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb00409ad40 0x7fb00411d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.851+0000 7fb003fff700 1 -- 172.21.15.146:0/331112542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0040a0a70 msgr2=0x7fb00411d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.851+0000 7fb003fff700 1 --2- 172.21.15.146:0/331112542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0040a0a70 0x7fb00411d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.851+0000 7fb003fff700 1 -- 172.21.15.146:0/331112542 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faffc009550 con 0x7fb004133f70 2023-10-03T10:17:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.851+0000 7fb0037fe700 1 --2- 172.21.15.146:0/331112542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb00409ad40 0x7fb00411d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.851+0000 7fb002ffd700 1 --2- 172.21.15.146:0/331112542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0040a0a70 0x7fb00411d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.851+0000 7fb003fff700 1 --2- 172.21.15.146:0/331112542 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb004133f70 0x7fb00411dd50 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7faffc00e930 tx=0x7faffc00ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.851+0000 7fafebfff700 1 -- 172.21.15.146:0/331112542 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc004020 con 0x7fb004133f70 2023-10-03T10:17:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.851+0000 7fafebfff700 1 -- 172.21.15.146:0/331112542 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faffc0041a0 con 0x7fb004133f70 2023-10-03T10:17:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.851+0000 7fafebfff700 1 -- 172.21.15.146:0/331112542 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc004550 con 0x7fb004133f70 2023-10-03T10:17:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.851+0000 7fb009b11700 1 -- 172.21.15.146:0/331112542 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff80094a0 con 0x7fb004133f70 2023-10-03T10:17:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.851+0000 7fb009b11700 1 -- 172.21.15.146:0/331112542 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff4009a70 con 0x7fb004133f70 2023-10-03T10:17:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.852+0000 7fafebfff700 1 -- 172.21.15.146:0/331112542 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faffc0036a0 con 0x7fb004133f70 2023-10-03T10:17:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.852+0000 7fb009b11700 1 -- 172.21.15.146:0/331112542 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0040a3540 con 0x7fb004133f70 2023-10-03T10:17:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.852+0000 7fafebfff700 1 -- 172.21.15.146:0/331112542 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faffc03f250 con 0x7fb004133f70 2023-10-03T10:17:20.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.857+0000 7fafebfff700 1 -- 172.21.15.146:0/331112542 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faffc013680 con 0x7fb004133f70 2023-10-03T10:17:20.872 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:20.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.938+0000 7f92da9b5700 1 Processor -- start 2023-10-03T10:17:20.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.938+0000 7f92da9b5700 1 -- start start 2023-10-03T10:17:20.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.939+0000 7f92da9b5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92d409dec0 0x7f92d406b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.939+0000 7f92da9b5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f92d4136cb0 0x7f92d4139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.939+0000 7f92da9b5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d406e900 con 0x7f92d406a770 2023-10-03T10:17:20.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.939+0000 7f92da9b5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d409d180 con 0x7f92d4136cb0 2023-10-03T10:17:20.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.939+0000 7f92da9b5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d409e780 con 0x7f92d409dec0 2023-10-03T10:17:20.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.939+0000 7f92d37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92d409dec0 0x7f92d406b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.939+0000 7f92d37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92d409dec0 0x7f92d406b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35358/0 (socket says 172.21.15.146:35358) 2023-10-03T10:17:20.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.939+0000 7f92d37fe700 1 -- 172.21.15.146:0/2933093021 learned_addr learned my addr 172.21.15.146:0/2933093021 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:20.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.939+0000 7f92d3fff700 1 --1- 172.21.15.146:0/2933093021 >> v1:172.21.15.146:6789/0 conn(0x7f92d406a770 0x7f92d406ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59204/0 (socket says 172.21.15.146:59204) 2023-10-03T10:17:20.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.939+0000 7f92d8f52700 1 --2- 172.21.15.146:0/2933093021 >> v2:172.21.15.146:3300/0 conn(0x7f92d4136cb0 0x7f92d4139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.940+0000 7f92d2ffd700 1 -- 172.21.15.146:0/2933093021 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238441829 0 0) 0x7f92d406e900 con 0x7f92d406a770 2023-10-03T10:17:20.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.940+0000 7f92d37fe700 1 -- 172.21.15.146:0/2933093021 >> v2:172.21.15.146:3300/0 conn(0x7f92d4136cb0 msgr2=0x7f92d4139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:20.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.940+0000 7f92d37fe700 1 --2- 172.21.15.146:0/2933093021 >> v2:172.21.15.146:3300/0 conn(0x7f92d4136cb0 0x7f92d4139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.940+0000 7f92d37fe700 1 -- 172.21.15.146:0/2933093021 >> v1:172.21.15.146:6789/0 conn(0x7f92d406a770 legacy=0x7f92d406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.940+0000 7f92d37fe700 1 -- 172.21.15.146:0/2933093021 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d409d3c0 con 0x7f92d409dec0 2023-10-03T10:17:20.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.940+0000 7f92d37fe700 1 --2- 172.21.15.146:0/2933093021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92d409dec0 0x7f92d406b250 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f92c80098f0 tx=0x7f92c8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=724f75eab450d2c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.940+0000 7f92d2ffd700 1 -- 172.21.15.146:0/2933093021 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8011830 con 0x7f92d409dec0 2023-10-03T10:17:20.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.940+0000 7f92d2ffd700 1 -- 172.21.15.146:0/2933093021 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c8011990 con 0x7f92d409dec0 2023-10-03T10:17:20.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.940+0000 7f92d2ffd700 1 -- 172.21.15.146:0/2933093021 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8011d20 con 0x7f92d409dec0 2023-10-03T10:17:20.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.941+0000 7f92da9b5700 1 -- 172.21.15.146:0/2933093021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92d409dec0 msgr2=0x7f92d406b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.941+0000 7f92da9b5700 1 --2- 172.21.15.146:0/2933093021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92d409dec0 0x7f92d406b250 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f92c80098f0 tx=0x7f92c8009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:20.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.941+0000 7f92da9b5700 1 -- 172.21.15.146:0/2933093021 shutdown_connections 2023-10-03T10:17:20.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.941+0000 7f92da9b5700 1 --2- 172.21.15.146:0/2933093021 >> v2:172.21.15.146:3300/0 conn(0x7f92d4136cb0 0x7f92d4139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.941+0000 7f92da9b5700 1 --2- 172.21.15.146:0/2933093021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92d409dec0 0x7f92d406b250 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.941+0000 7f92da9b5700 1 -- 172.21.15.146:0/2933093021 >> 172.21.15.146:0/2933093021 conn(0x7f92d4099c40 msgr2=0x7f92d40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.941+0000 7f92da9b5700 1 -- 172.21.15.146:0/2933093021 shutdown_connections 2023-10-03T10:17:20.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.941+0000 7f92da9b5700 1 -- 172.21.15.146:0/2933093021 wait complete. 2023-10-03T10:17:20.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.942+0000 7f92da9b5700 1 Processor -- start 2023-10-03T10:17:20.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.942+0000 7f92da9b5700 1 -- start start 2023-10-03T10:17:20.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.943+0000 7f92da9b5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f92d406a770 0x7f92d409a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.943+0000 7f92da9b5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92d409dec0 0x7f92d409a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.943+0000 7f92da9b5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92d4136cb0 0x7f92d409af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.943+0000 7f92da9b5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d41357e0 con 0x7f92d4136cb0 2023-10-03T10:17:20.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.943+0000 7f92da9b5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d40a1080 con 0x7f92d409dec0 2023-10-03T10:17:20.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.943+0000 7f92da9b5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92d4135030 con 0x7f92d406a770 2023-10-03T10:17:20.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.943+0000 7f92d3fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f92d406a770 0x7f92d409a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.943+0000 7f92d3fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f92d406a770 0x7f92d409a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51460/0 (socket says 172.21.15.146:51460) 2023-10-03T10:17:20.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.943+0000 7f92d3fff700 1 -- 172.21.15.146:0/152521171 learned_addr learned my addr 172.21.15.146:0/152521171 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:20.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.943+0000 7f92d37fe700 1 --2- 172.21.15.146:0/152521171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92d409dec0 0x7f92d409a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.943+0000 7f92d8f52700 1 --2- 172.21.15.146:0/152521171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92d4136cb0 0x7f92d409af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.944+0000 7f92d37fe700 1 -- 172.21.15.146:0/152521171 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f92d406a770 msgr2=0x7f92d409a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.944+0000 7f92d37fe700 1 --2- 172.21.15.146:0/152521171 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f92d406a770 0x7f92d409a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.944+0000 7f92d37fe700 1 -- 172.21.15.146:0/152521171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92d4136cb0 msgr2=0x7f92d409af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.944+0000 7f92d37fe700 1 --2- 172.21.15.146:0/152521171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92d4136cb0 0x7f92d409af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.944+0000 7f92d37fe700 1 -- 172.21.15.146:0/152521171 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c8009550 con 0x7f92d409dec0 2023-10-03T10:17:20.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.944+0000 7f92d3fff700 1 --2- 172.21.15.146:0/152521171 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f92d406a770 0x7f92d409a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:20.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.944+0000 7f92d37fe700 1 --2- 172.21.15.146:0/152521171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92d409dec0 0x7f92d409a9d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f92c8016000 tx=0x7f92c8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.944+0000 7f92d0ff9700 1 -- 172.21.15.146:0/152521171 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8004400 con 0x7f92d409dec0 2023-10-03T10:17:20.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.944+0000 7f92d0ff9700 1 -- 172.21.15.146:0/152521171 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c801f070 con 0x7f92d409dec0 2023-10-03T10:17:20.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.944+0000 7f92da9b5700 1 -- 172.21.15.146:0/152521171 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d4135480 con 0x7f92d409dec0 2023-10-03T10:17:20.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.944+0000 7f92d0ff9700 1 -- 172.21.15.146:0/152521171 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c80038a0 con 0x7f92d409dec0 2023-10-03T10:17:20.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.944+0000 7f92da9b5700 1 -- 172.21.15.146:0/152521171 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d4134580 con 0x7f92d409dec0 2023-10-03T10:17:20.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.945+0000 7f92da9b5700 1 -- 172.21.15.146:0/152521171 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d404f2a0 con 0x7f92d409dec0 2023-10-03T10:17:20.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.945+0000 7f92d0ff9700 1 -- 172.21.15.146:0/152521171 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f92c8021030 con 0x7f92d409dec0 2023-10-03T10:17:20.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.945+0000 7f92d0ff9700 1 -- 172.21.15.146:0/152521171 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f92c8040ab0 con 0x7f92d409dec0 2023-10-03T10:17:20.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:20.954+0000 7f92d0ff9700 1 -- 172.21.15.146:0/152521171 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92c80239c0 con 0x7f92d409dec0 2023-10-03T10:17:21.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.002+0000 7f3ab2dd5700 1 Processor -- start 2023-10-03T10:17:21.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.002+0000 7f3ab2dd5700 1 -- start start 2023-10-03T10:17:21.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.002+0000 7f3ab2dd5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3aac09f350 0x7f3aac136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.002+0000 7f3ab2dd5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3aac1371c0 0x7f3aac1395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.002+0000 7f3ab2dd5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aac09c970 con 0x7f3aac09e870 2023-10-03T10:17:21.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.002+0000 7f3ab2dd5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac0a0920 con 0x7f3aac09f350 2023-10-03T10:17:21.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.002+0000 7f3ab2dd5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac09f9c0 con 0x7f3aac1371c0 2023-10-03T10:17:21.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.003+0000 7f3ab1372700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3aac1371c0 0x7f3aac1395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.003+0000 7f3ab1372700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3aac1371c0 0x7f3aac1395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51468/0 (socket says 172.21.15.146:51468) 2023-10-03T10:17:21.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.003+0000 7f3ab1372700 1 -- 172.21.15.146:0/3054776997 learned_addr learned my addr 172.21.15.146:0/3054776997 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:21.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.003+0000 7f3ab0b71700 1 --1- 172.21.15.146:0/3054776997 >> v1:172.21.15.146:6789/0 conn(0x7f3aac09e870 0x7f3aac09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59216/0 (socket says 172.21.15.146:59216) 2023-10-03T10:17:21.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.003+0000 7f3aabfff700 1 --2- 172.21.15.146:0/3054776997 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3aac09f350 0x7f3aac136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.003+0000 7f3ab1372700 1 -- 172.21.15.146:0/3054776997 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3aac09f350 msgr2=0x7f3aac136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:21.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.003+0000 7f3ab1372700 1 --2- 172.21.15.146:0/3054776997 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3aac09f350 0x7f3aac136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.003+0000 7f3aab7fe700 1 -- 172.21.15.146:0/3054776997 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2199928091 0 0) 0x7f3aac09c970 con 0x7f3aac09e870 2023-10-03T10:17:21.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.003+0000 7f3ab1372700 1 -- 172.21.15.146:0/3054776997 >> v1:172.21.15.146:6789/0 conn(0x7f3aac09e870 legacy=0x7f3aac09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.003+0000 7f3ab1372700 1 -- 172.21.15.146:0/3054776997 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac09bab0 con 0x7f3aac1371c0 2023-10-03T10:17:21.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.003+0000 7f3aabfff700 1 --2- 172.21.15.146:0/3054776997 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3aac09f350 0x7f3aac136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:21.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.003+0000 7f3ab1372700 1 --2- 172.21.15.146:0/3054776997 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3aac1371c0 0x7f3aac1395a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4009e80 tx=0x7f3aa400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85c6486ba2624656 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.003+0000 7f3aab7fe700 1 -- 172.21.15.146:0/3054776997 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa400e070 con 0x7f3aac1371c0 2023-10-03T10:17:21.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.003+0000 7f3aab7fe700 1 -- 172.21.15.146:0/3054776997 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa400b910 con 0x7f3aac1371c0 2023-10-03T10:17:21.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.003+0000 7f3aab7fe700 1 -- 172.21.15.146:0/3054776997 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa400bcc0 con 0x7f3aac1371c0 2023-10-03T10:17:21.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.004+0000 7f3ab2dd5700 1 -- 172.21.15.146:0/3054776997 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3aac1371c0 msgr2=0x7f3aac1395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.004+0000 7f3ab2dd5700 1 --2- 172.21.15.146:0/3054776997 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3aac1371c0 0x7f3aac1395a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4009e80 tx=0x7f3aa400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:21.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.004+0000 7f3ab2dd5700 1 -- 172.21.15.146:0/3054776997 shutdown_connections 2023-10-03T10:17:21.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.004+0000 7f3ab2dd5700 1 --2- 172.21.15.146:0/3054776997 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3aac1371c0 0x7f3aac1395a0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.004+0000 7f3ab2dd5700 1 --2- 172.21.15.146:0/3054776997 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3aac09f350 0x7f3aac136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.004+0000 7f3ab2dd5700 1 -- 172.21.15.146:0/3054776997 >> 172.21.15.146:0/3054776997 conn(0x7f3aac0a4430 msgr2=0x7f3aac0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.004+0000 7f3ab2dd5700 1 -- 172.21.15.146:0/3054776997 shutdown_connections 2023-10-03T10:17:21.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.004+0000 7f3ab2dd5700 1 -- 172.21.15.146:0/3054776997 wait complete. 2023-10-03T10:17:21.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.005+0000 7f3ab2dd5700 1 Processor -- start 2023-10-03T10:17:21.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.005+0000 7f3ab2dd5700 1 -- start start 2023-10-03T10:17:21.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.006+0000 7f3ab2dd5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3aac09e870 0x7f3aac06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.006+0000 7f3ab2dd5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3aac09f350 0x7f3aac06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.006+0000 7f3ab2dd5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3aac1371c0 0x7f3aac06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.006+0000 7f3ab2dd5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac06cd80 con 0x7f3aac09f350 2023-10-03T10:17:21.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.006+0000 7f3ab2dd5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac126370 con 0x7f3aac1371c0 2023-10-03T10:17:21.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.006+0000 7f3ab2dd5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac06d4c0 con 0x7f3aac09e870 2023-10-03T10:17:21.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.006+0000 7f3aabfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3aac09f350 0x7f3aac06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.006+0000 7f3aabfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3aac09f350 0x7f3aac06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58162/0 (socket says 172.21.15.146:58162) 2023-10-03T10:17:21.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.006+0000 7f3aabfff700 1 -- 172.21.15.146:0/2115050606 learned_addr learned my addr 172.21.15.146:0/2115050606 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:21.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.006+0000 7f3ab1372700 1 --2- 172.21.15.146:0/2115050606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3aac1371c0 0x7f3aac06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.006+0000 7f3ab0b71700 1 --2- 172.21.15.146:0/2115050606 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3aac09e870 0x7f3aac06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.007+0000 7f3aabfff700 1 -- 172.21.15.146:0/2115050606 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3aac09e870 msgr2=0x7f3aac06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.007+0000 7f3aabfff700 1 --2- 172.21.15.146:0/2115050606 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3aac09e870 0x7f3aac06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.007+0000 7f3aabfff700 1 -- 172.21.15.146:0/2115050606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3aac1371c0 msgr2=0x7f3aac06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.007+0000 7f3aabfff700 1 --2- 172.21.15.146:0/2115050606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3aac1371c0 0x7f3aac06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.007+0000 7f3aabfff700 1 -- 172.21.15.146:0/2115050606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a980094a0 con 0x7f3aac09f350 2023-10-03T10:17:21.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.007+0000 7f3aabfff700 1 --2- 172.21.15.146:0/2115050606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3aac09f350 0x7f3aac06bdf0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800ec10 tx=0x7f3a9800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.007+0000 7f3aa97fa700 1 -- 172.21.15.146:0/2115050606 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9800c910 con 0x7f3aac09f350 2023-10-03T10:17:21.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.007+0000 7f3aa97fa700 1 -- 172.21.15.146:0/2115050606 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9800ca70 con 0x7f3aac09f350 2023-10-03T10:17:21.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.007+0000 7f3ab2dd5700 1 -- 172.21.15.146:0/2115050606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa4009b30 con 0x7f3aac09f350 2023-10-03T10:17:21.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.007+0000 7f3aa97fa700 1 -- 172.21.15.146:0/2115050606 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9800cde0 con 0x7f3aac09f350 2023-10-03T10:17:21.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.007+0000 7f3ab2dd5700 1 -- 172.21.15.146:0/2115050606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aac125dd0 con 0x7f3aac09f350 2023-10-03T10:17:21.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.008+0000 7f3aa97fa700 1 -- 172.21.15.146:0/2115050606 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a98013470 con 0x7f3aac09f350 2023-10-03T10:17:21.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.008+0000 7f3ab2dd5700 1 -- 172.21.15.146:0/2115050606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aac04f2a0 con 0x7f3aac09f350 2023-10-03T10:17:21.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.008+0000 7f3aa97fa700 1 -- 172.21.15.146:0/2115050606 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3a9803fcf0 con 0x7f3aac09f350 2023-10-03T10:17:21.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.017+0000 7f3aa97fa700 1 -- 172.21.15.146:0/2115050606 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a9801b3b0 con 0x7f3aac09f350 2023-10-03T10:17:21.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.062+0000 7fb009b11700 1 -- 172.21.15.146:0/331112542 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb00409c7e0 con 0x7fb004133f70 2023-10-03T10:17:21.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.062+0000 7fafebfff700 1 -- 172.21.15.146:0/331112542 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faffc020070 con 0x7fb004133f70 2023-10-03T10:17:21.063 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:21.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.064+0000 7fb009b11700 1 -- 172.21.15.146:0/331112542 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb004133f70 msgr2=0x7fb00411dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.064+0000 7fb009b11700 1 --2- 172.21.15.146:0/331112542 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb004133f70 0x7fb00411dd50 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7faffc00e930 tx=0x7faffc00ec40 comp rx=0 tx=0).stop 2023-10-03T10:17:21.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.065+0000 7fb009b11700 1 -- 172.21.15.146:0/331112542 shutdown_connections 2023-10-03T10:17:21.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.065+0000 7fb009b11700 1 --2- 172.21.15.146:0/331112542 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb004133f70 0x7fb00411dd50 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.065+0000 7fb009b11700 1 --2- 172.21.15.146:0/331112542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb00409ad40 0x7fb00411d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.065+0000 7fb009b11700 1 --2- 172.21.15.146:0/331112542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0040a0a70 0x7fb00411d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.065+0000 7fb009b11700 1 -- 172.21.15.146:0/331112542 >> 172.21.15.146:0/331112542 conn(0x7fb004099c40 msgr2=0x7fb004131fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.065+0000 7fb009b11700 1 -- 172.21.15.146:0/331112542 shutdown_connections 2023-10-03T10:17:21.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.065+0000 7fb009b11700 1 -- 172.21.15.146:0/331112542 wait complete. 2023-10-03T10:17:21.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:21.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.150+0000 7f92da9b5700 1 -- 172.21.15.146:0/152521171 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f92d4135610 con 0x7f92d409dec0 2023-10-03T10:17:21.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.150+0000 7f92d0ff9700 1 -- 172.21.15.146:0/152521171 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f92c8032020 con 0x7f92d409dec0 2023-10-03T10:17:21.151 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:21.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.152+0000 7f92da9b5700 1 -- 172.21.15.146:0/152521171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92d409dec0 msgr2=0x7f92d409a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.152+0000 7f92da9b5700 1 --2- 172.21.15.146:0/152521171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92d409dec0 0x7f92d409a9d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f92c8016000 tx=0x7f92c8004750 comp rx=0 tx=0).stop 2023-10-03T10:17:21.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.152+0000 7f92da9b5700 1 -- 172.21.15.146:0/152521171 shutdown_connections 2023-10-03T10:17:21.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.152+0000 7f92da9b5700 1 --2- 172.21.15.146:0/152521171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92d4136cb0 0x7f92d409af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.152+0000 7f92da9b5700 1 --2- 172.21.15.146:0/152521171 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f92d406a770 0x7f92d409a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.152+0000 7f92da9b5700 1 --2- 172.21.15.146:0/152521171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f92d409dec0 0x7f92d409a9d0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.153+0000 7f92da9b5700 1 -- 172.21.15.146:0/152521171 >> 172.21.15.146:0/152521171 conn(0x7f92d4099c40 msgr2=0x7f92d4138990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.153+0000 7f92da9b5700 1 -- 172.21.15.146:0/152521171 shutdown_connections 2023-10-03T10:17:21.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.153+0000 7f92da9b5700 1 -- 172.21.15.146:0/152521171 wait complete. 2023-10-03T10:17:21.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:21.207 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:21.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.211+0000 7f3ab2dd5700 1 -- 172.21.15.146:0/2115050606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3aac124c50 con 0x7f3aac09f350 2023-10-03T10:17:21.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.212+0000 7f3aa97fa700 1 -- 172.21.15.146:0/2115050606 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a98021030 con 0x7f3aac09f350 2023-10-03T10:17:21.213 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:21.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.214+0000 7f3ab2dd5700 1 -- 172.21.15.146:0/2115050606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3aac09f350 msgr2=0x7f3aac06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.214+0000 7f3ab2dd5700 1 --2- 172.21.15.146:0/2115050606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3aac09f350 0x7f3aac06bdf0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800ec10 tx=0x7f3a9800ef20 comp rx=0 tx=0).stop 2023-10-03T10:17:21.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.214+0000 7f3ab2dd5700 1 -- 172.21.15.146:0/2115050606 shutdown_connections 2023-10-03T10:17:21.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.214+0000 7f3ab2dd5700 1 --2- 172.21.15.146:0/2115050606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3aac1371c0 0x7f3aac06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.214+0000 7f3ab2dd5700 1 --2- 172.21.15.146:0/2115050606 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3aac09e870 0x7f3aac06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.214+0000 7f3ab2dd5700 1 --2- 172.21.15.146:0/2115050606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3aac09f350 0x7f3aac06bdf0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.214+0000 7f3ab2dd5700 1 -- 172.21.15.146:0/2115050606 >> 172.21.15.146:0/2115050606 conn(0x7f3aac0a4430 msgr2=0x7f3aac0a27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.214+0000 7f3ab2dd5700 1 -- 172.21.15.146:0/2115050606 shutdown_connections 2023-10-03T10:17:21.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.214+0000 7f3ab2dd5700 1 -- 172.21.15.146:0/2115050606 wait complete. 2023-10-03T10:17:21.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:21.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.328+0000 7f4d52135700 1 Processor -- start 2023-10-03T10:17:21.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.328+0000 7f4d52135700 1 -- start start 2023-10-03T10:17:21.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.329+0000 7f4d52135700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d4c09e870 0x7f4d4c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.329+0000 7f4d52135700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4d4c09f180 0x7f4d4c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.329+0000 7f4d52135700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d4c131d70 0x7f4d4c132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.329+0000 7f4d52135700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4c0a0920 con 0x7f4d4c09f180 2023-10-03T10:17:21.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.329+0000 7f4d52135700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c09c970 con 0x7f4d4c131d70 2023-10-03T10:17:21.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.329+0000 7f4d52135700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c09bab0 con 0x7f4d4c09e870 2023-10-03T10:17:21.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.329+0000 7f4d4b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d4c09e870 0x7f4d4c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.329+0000 7f4d4bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d4c131d70 0x7f4d4c132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.329+0000 7f4d4affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4d4c09f180 0x7f4d4c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.329+0000 7f4d4b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d4c09e870 0x7f4d4c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51480/0 (socket says 172.21.15.146:51480) 2023-10-03T10:17:21.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.329+0000 7f4d4affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4d4c09f180 0x7f4d4c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58164/0 (socket says 172.21.15.146:58164) 2023-10-03T10:17:21.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.329+0000 7f4d4bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d4c131d70 0x7f4d4c132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35404/0 (socket says 172.21.15.146:35404) 2023-10-03T10:17:21.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.329+0000 7f4d4b7fe700 1 -- 172.21.15.146:0/2888236423 learned_addr learned my addr 172.21.15.146:0/2888236423 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:21.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.329+0000 7f4d4b7fe700 1 -- 172.21.15.146:0/2888236423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d4c131d70 msgr2=0x7f4d4c132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:21.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.329+0000 7f4d4b7fe700 1 --2- 172.21.15.146:0/2888236423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d4c131d70 0x7f4d4c132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.329+0000 7f4d4b7fe700 1 -- 172.21.15.146:0/2888236423 >> v2:172.21.15.146:3300/0 conn(0x7f4d4c09f180 msgr2=0x7f4d4c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:21.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.329+0000 7f4d4b7fe700 1 --2- 172.21.15.146:0/2888236423 >> v2:172.21.15.146:3300/0 conn(0x7f4d4c09f180 0x7f4d4c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.329+0000 7f4d4b7fe700 1 -- 172.21.15.146:0/2888236423 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c09f9c0 con 0x7f4d4c09e870 2023-10-03T10:17:21.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.329+0000 7f4d4bfff700 1 --2- 172.21.15.146:0/2888236423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d4c131d70 0x7f4d4c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:21.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.329+0000 7f4d4affd700 1 --2- 172.21.15.146:0/2888236423 >> v2:172.21.15.146:3300/0 conn(0x7f4d4c09f180 0x7f4d4c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:21.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.330+0000 7f4d4b7fe700 1 --2- 172.21.15.146:0/2888236423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d4c09e870 0x7f4d4c09ec40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4d340098f0 tx=0x7f4d34009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ea0a7f970679877 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.330+0000 7f4d4a7fc700 1 -- 172.21.15.146:0/2888236423 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34011830 con 0x7f4d4c09e870 2023-10-03T10:17:21.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.330+0000 7f4d4a7fc700 1 -- 172.21.15.146:0/2888236423 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d34011990 con 0x7f4d4c09e870 2023-10-03T10:17:21.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.330+0000 7f4d4a7fc700 1 -- 172.21.15.146:0/2888236423 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34011d20 con 0x7f4d4c09e870 2023-10-03T10:17:21.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.330+0000 7f4d52135700 1 -- 172.21.15.146:0/2888236423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d4c09e870 msgr2=0x7f4d4c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.330+0000 7f4d52135700 1 --2- 172.21.15.146:0/2888236423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d4c09e870 0x7f4d4c09ec40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4d340098f0 tx=0x7f4d34009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:21.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.330+0000 7f4d52135700 1 -- 172.21.15.146:0/2888236423 shutdown_connections 2023-10-03T10:17:21.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.330+0000 7f4d52135700 1 --2- 172.21.15.146:0/2888236423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d4c131d70 0x7f4d4c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.330+0000 7f4d52135700 1 --2- 172.21.15.146:0/2888236423 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d4c09e870 0x7f4d4c09ec40 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.330+0000 7f4d52135700 1 --2- 172.21.15.146:0/2888236423 >> v2:172.21.15.146:3300/0 conn(0x7f4d4c09f180 0x7f4d4c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.330+0000 7f4d52135700 1 -- 172.21.15.146:0/2888236423 >> 172.21.15.146:0/2888236423 conn(0x7f4d4c0a4430 msgr2=0x7f4d4c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.330+0000 7f4d52135700 1 -- 172.21.15.146:0/2888236423 shutdown_connections 2023-10-03T10:17:21.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.330+0000 7f4d52135700 1 -- 172.21.15.146:0/2888236423 wait complete. 2023-10-03T10:17:21.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.331+0000 7f4d52135700 1 Processor -- start 2023-10-03T10:17:21.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.331+0000 7f4d52135700 1 -- start start 2023-10-03T10:17:21.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.332+0000 7f4d52135700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d4c09e870 0x7f4d4c120260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.332+0000 7f4d52135700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d4c09f180 0x7f4d4c1207a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.332+0000 7f4d52135700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d4c131d70 0x7f4d4c120ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.332+0000 7f4d52135700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c121730 con 0x7f4d4c09e870 2023-10-03T10:17:21.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.332+0000 7f4d52135700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c123db0 con 0x7f4d4c131d70 2023-10-03T10:17:21.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.332+0000 7f4d52135700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c09b160 con 0x7f4d4c09f180 2023-10-03T10:17:21.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.332+0000 7f4d4b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d4c09e870 0x7f4d4c120260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.332+0000 7f4d4affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d4c09f180 0x7f4d4c1207a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.332+0000 7f4d4b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d4c09e870 0x7f4d4c120260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58172/0 (socket says 172.21.15.146:58172) 2023-10-03T10:17:21.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.332+0000 7f4d4b7fe700 1 -- 172.21.15.146:0/2000386824 learned_addr learned my addr 172.21.15.146:0/2000386824 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:21.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.332+0000 7f4d4bfff700 1 --2- 172.21.15.146:0/2000386824 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d4c131d70 0x7f4d4c120ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.332+0000 7f4d4affd700 1 -- 172.21.15.146:0/2000386824 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d4c131d70 msgr2=0x7f4d4c120ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.332+0000 7f4d4affd700 1 --2- 172.21.15.146:0/2000386824 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d4c131d70 0x7f4d4c120ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.332+0000 7f4d4affd700 1 -- 172.21.15.146:0/2000386824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d4c09e870 msgr2=0x7f4d4c120260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.332+0000 7f4d4affd700 1 --2- 172.21.15.146:0/2000386824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d4c09e870 0x7f4d4c120260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.332+0000 7f4d4affd700 1 -- 172.21.15.146:0/2000386824 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c0094a0 con 0x7f4d4c09f180 2023-10-03T10:17:21.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.332+0000 7f4d4b7fe700 1 --2- 172.21.15.146:0/2000386824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d4c09e870 0x7f4d4c120260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:21.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.332+0000 7f4d4bfff700 1 --2- 172.21.15.146:0/2000386824 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d4c131d70 0x7f4d4c120ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:21.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.332+0000 7f4d4affd700 1 --2- 172.21.15.146:0/2000386824 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d4c09f180 0x7f4d4c1207a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c00e980 tx=0x7f4d3c00ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.333+0000 7f4d43fff700 1 -- 172.21.15.146:0/2000386824 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c004030 con 0x7f4d4c09f180 2023-10-03T10:17:21.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.333+0000 7f4d43fff700 1 -- 172.21.15.146:0/2000386824 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3c004190 con 0x7f4d4c09f180 2023-10-03T10:17:21.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.333+0000 7f4d52135700 1 -- 172.21.15.146:0/2000386824 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d44009a70 con 0x7f4d4c09f180 2023-10-03T10:17:21.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.333+0000 7f4d43fff700 1 -- 172.21.15.146:0/2000386824 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c004520 con 0x7f4d4c09f180 2023-10-03T10:17:21.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.333+0000 7f4d52135700 1 -- 172.21.15.146:0/2000386824 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d34009550 con 0x7f4d4c09f180 2023-10-03T10:17:21.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.333+0000 7f4d43fff700 1 -- 172.21.15.146:0/2000386824 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d3c0036a0 con 0x7f4d4c09f180 2023-10-03T10:17:21.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.334+0000 7f4d43fff700 1 -- 172.21.15.146:0/2000386824 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4d3c03f760 con 0x7f4d4c09f180 2023-10-03T10:17:21.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.334+0000 7f4d52135700 1 -- 172.21.15.146:0/2000386824 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4c04f2a0 con 0x7f4d4c09f180 2023-10-03T10:17:21.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.338+0000 7f4d43fff700 1 -- 172.21.15.146:0/2000386824 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d3c01bbe0 con 0x7f4d4c09f180 2023-10-03T10:17:21.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.524+0000 7f4d52135700 1 -- 172.21.15.146:0/2000386824 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4d4c131b50 con 0x7f4d4c09f180 2023-10-03T10:17:21.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.524+0000 7f4d43fff700 1 -- 172.21.15.146:0/2000386824 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4d3c02a090 con 0x7f4d4c09f180 2023-10-03T10:17:21.525 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:21.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.526+0000 7f4d52135700 1 -- 172.21.15.146:0/2000386824 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d4c09f180 msgr2=0x7f4d4c1207a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.526+0000 7f4d52135700 1 --2- 172.21.15.146:0/2000386824 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d4c09f180 0x7f4d4c1207a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c00e980 tx=0x7f4d3c00ec90 comp rx=0 tx=0).stop 2023-10-03T10:17:21.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.526+0000 7f4d52135700 1 -- 172.21.15.146:0/2000386824 shutdown_connections 2023-10-03T10:17:21.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.526+0000 7f4d52135700 1 --2- 172.21.15.146:0/2000386824 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d4c131d70 0x7f4d4c120ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.526+0000 7f4d52135700 1 --2- 172.21.15.146:0/2000386824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d4c09e870 0x7f4d4c120260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.526+0000 7f4d52135700 1 --2- 172.21.15.146:0/2000386824 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d4c09f180 0x7f4d4c1207a0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.526+0000 7f4d52135700 1 -- 172.21.15.146:0/2000386824 >> 172.21.15.146:0/2000386824 conn(0x7f4d4c0a4430 msgr2=0x7f4d4c06f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.526+0000 7f4d52135700 1 -- 172.21.15.146:0/2000386824 shutdown_connections 2023-10-03T10:17:21.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:21.526+0000 7f4d52135700 1 -- 172.21.15.146:0/2000386824 wait complete. 2023-10-03T10:17:21.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:22.079 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:22.166 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:22.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.208+0000 7f408245e700 1 Processor -- start 2023-10-03T10:17:22.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.208+0000 7f408245e700 1 -- start start 2023-10-03T10:17:22.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.208+0000 7f408245e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f407c09ad40 0x7f407c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.208+0000 7f408245e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f407c133f70 0x7f407c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.208+0000 7f408245e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f407c0a0a70 0x7f407c0a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.208+0000 7f408245e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f407c0a3b60 con 0x7f407c09ad40 2023-10-03T10:17:22.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.208+0000 7f408245e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407c1348e0 con 0x7f407c0a0a70 2023-10-03T10:17:22.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.208+0000 7f408245e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f407c09b110 con 0x7f407c133f70 2023-10-03T10:17:22.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.208+0000 7f407bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f407c09ad40 0x7f407c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.208+0000 7f40809fb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f407c0a0a70 0x7f407c0a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.208+0000 7f407b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f407c133f70 0x7f407c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.208+0000 7f40809fb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f407c0a0a70 0x7f407c0a0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35418/0 (socket says 172.21.15.146:35418) 2023-10-03T10:17:22.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.208+0000 7f407bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f407c09ad40 0x7f407c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58174/0 (socket says 172.21.15.146:58174) 2023-10-03T10:17:22.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.208+0000 7f407b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f407c133f70 0x7f407c1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51504/0 (socket says 172.21.15.146:51504) 2023-10-03T10:17:22.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.208+0000 7f40809fb700 1 -- 172.21.15.146:0/2401003812 learned_addr learned my addr 172.21.15.146:0/2401003812 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:22.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.209+0000 7f40809fb700 1 -- 172.21.15.146:0/2401003812 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f407c133f70 msgr2=0x7f407c1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.209+0000 7f40809fb700 1 --2- 172.21.15.146:0/2401003812 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f407c133f70 0x7f407c1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.209+0000 7f40809fb700 1 -- 172.21.15.146:0/2401003812 >> v2:172.21.15.146:3300/0 conn(0x7f407c09ad40 msgr2=0x7f407c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.209+0000 7f40809fb700 1 --2- 172.21.15.146:0/2401003812 >> v2:172.21.15.146:3300/0 conn(0x7f407c09ad40 0x7f407c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.209+0000 7f40809fb700 1 -- 172.21.15.146:0/2401003812 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407c0a2fa0 con 0x7f407c0a0a70 2023-10-03T10:17:22.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.209+0000 7f407bfff700 1 --2- 172.21.15.146:0/2401003812 >> v2:172.21.15.146:3300/0 conn(0x7f407c09ad40 0x7f407c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.209+0000 7f40809fb700 1 --2- 172.21.15.146:0/2401003812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f407c0a0a70 0x7f407c0a0f10 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4074009e50 tx=0x7f407400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3367b2326c2a1220 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.209+0000 7f407affd700 1 -- 172.21.15.146:0/2401003812 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407400e070 con 0x7f407c0a0a70 2023-10-03T10:17:22.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.209+0000 7f407affd700 1 -- 172.21.15.146:0/2401003812 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407400b910 con 0x7f407c0a0a70 2023-10-03T10:17:22.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.209+0000 7f407affd700 1 -- 172.21.15.146:0/2401003812 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407400bcc0 con 0x7f407c0a0a70 2023-10-03T10:17:22.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.210+0000 7f408245e700 1 -- 172.21.15.146:0/2401003812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f407c0a0a70 msgr2=0x7f407c0a0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.210+0000 7f408245e700 1 --2- 172.21.15.146:0/2401003812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f407c0a0a70 0x7f407c0a0f10 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4074009e50 tx=0x7f407400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:22.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.210+0000 7f408245e700 1 -- 172.21.15.146:0/2401003812 shutdown_connections 2023-10-03T10:17:22.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.210+0000 7f408245e700 1 --2- 172.21.15.146:0/2401003812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f407c0a0a70 0x7f407c0a0f10 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.210+0000 7f408245e700 1 --2- 172.21.15.146:0/2401003812 >> v2:172.21.15.146:3300/0 conn(0x7f407c09ad40 0x7f407c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.210+0000 7f408245e700 1 --2- 172.21.15.146:0/2401003812 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f407c133f70 0x7f407c1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.210+0000 7f408245e700 1 -- 172.21.15.146:0/2401003812 >> 172.21.15.146:0/2401003812 conn(0x7f407c099c40 msgr2=0x7f407c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.210+0000 7f408245e700 1 -- 172.21.15.146:0/2401003812 shutdown_connections 2023-10-03T10:17:22.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.210+0000 7f408245e700 1 -- 172.21.15.146:0/2401003812 wait complete. 2023-10-03T10:17:22.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.211+0000 7f408245e700 1 Processor -- start 2023-10-03T10:17:22.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.211+0000 7f408245e700 1 -- start start 2023-10-03T10:17:22.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.211+0000 7f408245e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f407c09ad40 0x7f407c1c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.211+0000 7f408245e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f407c0a0a70 0x7f407c1c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.211+0000 7f408245e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f407c133f70 0x7f407c1c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.211+0000 7f408245e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c121330 con 0x7f407c09ad40 2023-10-03T10:17:22.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.211+0000 7f408245e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407c11f670 con 0x7f407c133f70 2023-10-03T10:17:22.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.211+0000 7f408245e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f407c09c140 con 0x7f407c0a0a70 2023-10-03T10:17:22.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.212+0000 7f407bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f407c09ad40 0x7f407c1c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.212+0000 7f40809fb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f407c133f70 0x7f407c1c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.212+0000 7f407bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f407c09ad40 0x7f407c1c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58184/0 (socket says 172.21.15.146:58184) 2023-10-03T10:17:22.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.212+0000 7f40809fb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f407c133f70 0x7f407c1c8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35426/0 (socket says 172.21.15.146:35426) 2023-10-03T10:17:22.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.212+0000 7f407bfff700 1 -- 172.21.15.146:0/3058298149 learned_addr learned my addr 172.21.15.146:0/3058298149 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:22.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.212+0000 7f407b7fe700 1 --2- 172.21.15.146:0/3058298149 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f407c0a0a70 0x7f407c1c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.212+0000 7f407b7fe700 1 -- 172.21.15.146:0/3058298149 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f407c133f70 msgr2=0x7f407c1c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.212+0000 7f407b7fe700 1 --2- 172.21.15.146:0/3058298149 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f407c133f70 0x7f407c1c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.212+0000 7f407b7fe700 1 -- 172.21.15.146:0/3058298149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f407c09ad40 msgr2=0x7f407c1c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.212+0000 7f407b7fe700 1 --2- 172.21.15.146:0/3058298149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f407c09ad40 0x7f407c1c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.212+0000 7f407b7fe700 1 -- 172.21.15.146:0/3058298149 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c0094a0 con 0x7f407c0a0a70 2023-10-03T10:17:22.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.212+0000 7f407bfff700 1 --2- 172.21.15.146:0/3058298149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f407c09ad40 0x7f407c1c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.212+0000 7f40809fb700 1 --2- 172.21.15.146:0/3058298149 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f407c133f70 0x7f407c1c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.212+0000 7f407b7fe700 1 --2- 172.21.15.146:0/3058298149 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f407c0a0a70 0x7f407c1c8740 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f407000e900 tx=0x7f407000ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.212+0000 7f4078ff9700 1 -- 172.21.15.146:0/3058298149 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4070013680 con 0x7f407c0a0a70 2023-10-03T10:17:22.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.212+0000 7f4078ff9700 1 -- 172.21.15.146:0/3058298149 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40700137e0 con 0x7f407c0a0a70 2023-10-03T10:17:22.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.212+0000 7f4078ff9700 1 -- 172.21.15.146:0/3058298149 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4070013b50 con 0x7f407c0a0a70 2023-10-03T10:17:22.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.212+0000 7f408245e700 1 -- 172.21.15.146:0/3058298149 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4074009b30 con 0x7f407c0a0a70 2023-10-03T10:17:22.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.212+0000 7f408245e700 1 -- 172.21.15.146:0/3058298149 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407c11fe60 con 0x7f407c0a0a70 2023-10-03T10:17:22.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.213+0000 7f4078ff9700 1 -- 172.21.15.146:0/3058298149 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4070013cb0 con 0x7f407c0a0a70 2023-10-03T10:17:22.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.213+0000 7f4078ff9700 1 -- 172.21.15.146:0/3058298149 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f407003f8f0 con 0x7f407c0a0a70 2023-10-03T10:17:22.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.213+0000 7f408245e700 1 -- 172.21.15.146:0/3058298149 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407c04f2a0 con 0x7f407c0a0a70 2023-10-03T10:17:22.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.218+0000 7f4078ff9700 1 -- 172.21.15.146:0/3058298149 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f407001b7c0 con 0x7f407c0a0a70 2023-10-03T10:17:22.228 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:22.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.293+0000 7f81b1f3d700 1 Processor -- start 2023-10-03T10:17:22.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.293+0000 7f81b1f3d700 1 -- start start 2023-10-03T10:17:22.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.294+0000 7f81b1f3d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ac133ad0 0x7f81ac133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.294+0000 7f81b1f3d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81ac1300a0 0x7f81ac1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.294+0000 7f81b1f3d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81ac06b2d0 con 0x7f81ac1309f0 2023-10-03T10:17:22.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.294+0000 7f81b1f3d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81ac133610 con 0x7f81ac1300a0 2023-10-03T10:17:22.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.294+0000 7f81b1f3d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac09a500 con 0x7f81ac133ad0 2023-10-03T10:17:22.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.294+0000 7f81ab7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ac133ad0 0x7f81ac133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.294+0000 7f81aaffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81ac1300a0 0x7f81ac1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.294+0000 7f81abfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f81ac1309f0 0x7f81ac13a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59218/0 (socket says 172.21.15.146:59218) 2023-10-03T10:17:22.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.294+0000 7f81abfff700 1 -- 172.21.15.146:0/3412245887 learned_addr learned my addr 172.21.15.146:0/3412245887 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:22.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.294+0000 7f81ab7fe700 1 -- 172.21.15.146:0/3412245887 >> v2:172.21.15.146:3300/0 conn(0x7f81ac1300a0 msgr2=0x7f81ac1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.294+0000 7f81ab7fe700 1 --2- 172.21.15.146:0/3412245887 >> v2:172.21.15.146:3300/0 conn(0x7f81ac1300a0 0x7f81ac1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.294+0000 7f81ab7fe700 1 -- 172.21.15.146:0/3412245887 >> v1:172.21.15.146:6789/0 conn(0x7f81ac1309f0 legacy=0x7f81ac13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.294+0000 7f81aa7fc700 1 -- 172.21.15.146:0/3412245887 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563220569 0 0) 0x7f81ac06b2d0 con 0x7f81ac1309f0 2023-10-03T10:17:22.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.294+0000 7f81ab7fe700 1 -- 172.21.15.146:0/3412245887 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ac1338b0 con 0x7f81ac133ad0 2023-10-03T10:17:22.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.295+0000 7f81ab7fe700 1 --2- 172.21.15.146:0/3412245887 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ac133ad0 0x7f81ac133ea0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f819c009840 tx=0x7f819c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5eebd60d9eb67203 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.295+0000 7f81aa7fc700 1 -- 172.21.15.146:0/3412245887 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c011830 con 0x7f81ac133ad0 2023-10-03T10:17:22.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.295+0000 7f81aa7fc700 1 -- 172.21.15.146:0/3412245887 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c011990 con 0x7f81ac133ad0 2023-10-03T10:17:22.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.295+0000 7f81aa7fc700 1 -- 172.21.15.146:0/3412245887 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c011d20 con 0x7f81ac133ad0 2023-10-03T10:17:22.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.295+0000 7f81b1f3d700 1 -- 172.21.15.146:0/3412245887 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ac133ad0 msgr2=0x7f81ac133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.295+0000 7f81b1f3d700 1 --2- 172.21.15.146:0/3412245887 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ac133ad0 0x7f81ac133ea0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f819c009840 tx=0x7f819c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:22.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.295+0000 7f81b1f3d700 1 -- 172.21.15.146:0/3412245887 shutdown_connections 2023-10-03T10:17:22.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.295+0000 7f81b1f3d700 1 --2- 172.21.15.146:0/3412245887 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ac133ad0 0x7f81ac133ea0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.295+0000 7f81b1f3d700 1 --2- 172.21.15.146:0/3412245887 >> v2:172.21.15.146:3300/0 conn(0x7f81ac1300a0 0x7f81ac1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.295+0000 7f81b1f3d700 1 -- 172.21.15.146:0/3412245887 >> 172.21.15.146:0/3412245887 conn(0x7f81ac099c40 msgr2=0x7f81ac0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.295+0000 7f81b1f3d700 1 -- 172.21.15.146:0/3412245887 shutdown_connections 2023-10-03T10:17:22.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.295+0000 7f81b1f3d700 1 -- 172.21.15.146:0/3412245887 wait complete. 2023-10-03T10:17:22.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.296+0000 7f81b1f3d700 1 Processor -- start 2023-10-03T10:17:22.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.296+0000 7f81b1f3d700 1 -- start start 2023-10-03T10:17:22.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.297+0000 7f81b1f3d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ac1300a0 0x7f81ac0712f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.297+0000 7f81b1f3d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81ac1309f0 0x7f81ac071830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.297+0000 7f81b1f3d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81ac133ad0 0x7f81ac071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.297+0000 7f81b1f3d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac11fe60 con 0x7f81ac1309f0 2023-10-03T10:17:22.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.297+0000 7f81b1f3d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac11f950 con 0x7f81ac133ad0 2023-10-03T10:17:22.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.297+0000 7f81b1f3d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac11f5f0 con 0x7f81ac1300a0 2023-10-03T10:17:22.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.297+0000 7f81ab7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ac1300a0 0x7f81ac0712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.297+0000 7f81ab7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ac1300a0 0x7f81ac0712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51534/0 (socket says 172.21.15.146:51534) 2023-10-03T10:17:22.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.297+0000 7f81ab7fe700 1 -- 172.21.15.146:0/1644171013 learned_addr learned my addr 172.21.15.146:0/1644171013 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:22.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.297+0000 7f81aaffd700 1 --2- 172.21.15.146:0/1644171013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81ac1309f0 0x7f81ac071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.297+0000 7f81ab7fe700 1 -- 172.21.15.146:0/1644171013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81ac133ad0 msgr2=0x7f81ac071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.297+0000 7f81ab7fe700 1 --2- 172.21.15.146:0/1644171013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81ac133ad0 0x7f81ac071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.297+0000 7f81ab7fe700 1 -- 172.21.15.146:0/1644171013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81ac1309f0 msgr2=0x7f81ac071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.297+0000 7f81ab7fe700 1 --2- 172.21.15.146:0/1644171013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81ac1309f0 0x7f81ac071830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.297+0000 7f81ab7fe700 1 -- 172.21.15.146:0/1644171013 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c0094a0 con 0x7f81ac1300a0 2023-10-03T10:17:22.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.297+0000 7f81ab7fe700 1 --2- 172.21.15.146:0/1644171013 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ac1300a0 0x7f81ac0712f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f819c009fd0 tx=0x7f819c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.298+0000 7f8193fff700 1 -- 172.21.15.146:0/1644171013 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c004480 con 0x7f81ac1300a0 2023-10-03T10:17:22.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.298+0000 7f8193fff700 1 -- 172.21.15.146:0/1644171013 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c01f070 con 0x7f81ac1300a0 2023-10-03T10:17:22.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.298+0000 7f81b1f3d700 1 -- 172.21.15.146:0/1644171013 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81ac0a3330 con 0x7f81ac1300a0 2023-10-03T10:17:22.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.298+0000 7f8193fff700 1 -- 172.21.15.146:0/1644171013 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c0038c0 con 0x7f81ac1300a0 2023-10-03T10:17:22.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.298+0000 7f81b1f3d700 1 -- 172.21.15.146:0/1644171013 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81ac11df50 con 0x7f81ac1300a0 2023-10-03T10:17:22.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.298+0000 7f8193fff700 1 -- 172.21.15.146:0/1644171013 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f819c021030 con 0x7f81ac1300a0 2023-10-03T10:17:22.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.299+0000 7f8193fff700 1 -- 172.21.15.146:0/1644171013 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f819c040860 con 0x7f81ac1300a0 2023-10-03T10:17:22.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.299+0000 7f81b1f3d700 1 -- 172.21.15.146:0/1644171013 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81ac09cb20 con 0x7f81ac1300a0 2023-10-03T10:17:22.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.303+0000 7f8193fff700 1 -- 172.21.15.146:0/1644171013 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f819c003a20 con 0x7f81ac1300a0 2023-10-03T10:17:22.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.353+0000 7f3ec343f700 1 Processor -- start 2023-10-03T10:17:22.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.354+0000 7f3ec343f700 1 -- start start 2023-10-03T10:17:22.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.354+0000 7f3ec343f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ebc09ad40 0x7f3ebc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.354+0000 7f3ec343f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ebc133f70 0x7f3ebc1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.354+0000 7f3ec343f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ebc09b110 con 0x7f3ebc0a0a70 2023-10-03T10:17:22.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.355+0000 7f3ec343f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc0a3b60 con 0x7f3ebc133f70 2023-10-03T10:17:22.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.355+0000 7f3ec343f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc1348e0 con 0x7f3ebc09ad40 2023-10-03T10:17:22.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.355+0000 7f3ec11db700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ebc09ad40 0x7f3ebc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.355+0000 7f3ec19dc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3ebc0a0a70 0x7f3ebc0a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59224/0 (socket says 172.21.15.146:59224) 2023-10-03T10:17:22.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.355+0000 7f3ec09da700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ebc133f70 0x7f3ebc1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.355+0000 7f3ec19dc700 1 -- 172.21.15.146:0/4202424299 learned_addr learned my addr 172.21.15.146:0/4202424299 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:22.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.355+0000 7f3eb3fff700 1 -- 172.21.15.146:0/4202424299 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484314323 0 0) 0x7f3ebc09b110 con 0x7f3ebc0a0a70 2023-10-03T10:17:22.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.355+0000 7f3ec11db700 1 -- 172.21.15.146:0/4202424299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ebc133f70 msgr2=0x7f3ebc1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.355+0000 7f3ec11db700 1 --2- 172.21.15.146:0/4202424299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ebc133f70 0x7f3ebc1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.355+0000 7f3ec11db700 1 -- 172.21.15.146:0/4202424299 >> v1:172.21.15.146:6789/0 conn(0x7f3ebc0a0a70 legacy=0x7f3ebc0a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.355+0000 7f3ec11db700 1 -- 172.21.15.146:0/4202424299 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc0a2fa0 con 0x7f3ebc09ad40 2023-10-03T10:17:22.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.355+0000 7f3ec11db700 1 --2- 172.21.15.146:0/4202424299 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ebc09ad40 0x7f3ebc133a30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8009870 tx=0x7f3eb8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcbad12ae70cea55 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.355+0000 7f3eb3fff700 1 -- 172.21.15.146:0/4202424299 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb8011830 con 0x7f3ebc09ad40 2023-10-03T10:17:22.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.355+0000 7f3eb3fff700 1 -- 172.21.15.146:0/4202424299 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb8011990 con 0x7f3ebc09ad40 2023-10-03T10:17:22.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.355+0000 7f3eb3fff700 1 -- 172.21.15.146:0/4202424299 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb8011d20 con 0x7f3ebc09ad40 2023-10-03T10:17:22.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.356+0000 7f3ec343f700 1 -- 172.21.15.146:0/4202424299 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ebc09ad40 msgr2=0x7f3ebc133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.356+0000 7f3ec343f700 1 --2- 172.21.15.146:0/4202424299 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ebc09ad40 0x7f3ebc133a30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8009870 tx=0x7f3eb8009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:22.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.356+0000 7f3ec343f700 1 -- 172.21.15.146:0/4202424299 shutdown_connections 2023-10-03T10:17:22.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.356+0000 7f3ec343f700 1 --2- 172.21.15.146:0/4202424299 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ebc09ad40 0x7f3ebc133a30 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.356+0000 7f3ec343f700 1 --2- 172.21.15.146:0/4202424299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ebc133f70 0x7f3ebc1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.356+0000 7f3ec343f700 1 -- 172.21.15.146:0/4202424299 >> 172.21.15.146:0/4202424299 conn(0x7f3ebc099c40 msgr2=0x7f3ebc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.356+0000 7f3ec343f700 1 -- 172.21.15.146:0/4202424299 shutdown_connections 2023-10-03T10:17:22.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.356+0000 7f3ec343f700 1 -- 172.21.15.146:0/4202424299 wait complete. 2023-10-03T10:17:22.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.357+0000 7f3ec343f700 1 Processor -- start 2023-10-03T10:17:22.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.357+0000 7f3ec343f700 1 -- start start 2023-10-03T10:17:22.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.357+0000 7f3ec343f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ebc09ad40 0x7f3ebc11f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.357+0000 7f3ec343f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ebc0a0a70 0x7f3ebc11f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.357+0000 7f3ec343f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ebc133f70 0x7f3ebc1c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.358+0000 7f3ec343f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc122500 con 0x7f3ebc0a0a70 2023-10-03T10:17:22.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.358+0000 7f3ec343f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc133370 con 0x7f3ebc133f70 2023-10-03T10:17:22.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.358+0000 7f3ec343f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ebc11eec0 con 0x7f3ebc09ad40 2023-10-03T10:17:22.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.358+0000 7f3ec11db700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ebc09ad40 0x7f3ebc11f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.358+0000 7f3ec11db700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ebc09ad40 0x7f3ebc11f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51546/0 (socket says 172.21.15.146:51546) 2023-10-03T10:17:22.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.358+0000 7f3ec11db700 1 -- 172.21.15.146:0/2902457736 learned_addr learned my addr 172.21.15.146:0/2902457736 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:22.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.358+0000 7f3ec09da700 1 --2- 172.21.15.146:0/2902457736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ebc0a0a70 0x7f3ebc11f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.358+0000 7f3ec19dc700 1 --2- 172.21.15.146:0/2902457736 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ebc133f70 0x7f3ebc1c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.358+0000 7f3ec09da700 1 -- 172.21.15.146:0/2902457736 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ebc09ad40 msgr2=0x7f3ebc11f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.358+0000 7f3ec09da700 1 --2- 172.21.15.146:0/2902457736 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ebc09ad40 0x7f3ebc11f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.358+0000 7f3ec09da700 1 -- 172.21.15.146:0/2902457736 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ebc133f70 msgr2=0x7f3ebc1c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.358+0000 7f3ec09da700 1 --2- 172.21.15.146:0/2902457736 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ebc133f70 0x7f3ebc1c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.358+0000 7f3ec09da700 1 -- 172.21.15.146:0/2902457736 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb80094a0 con 0x7f3ebc0a0a70 2023-10-03T10:17:22.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.358+0000 7f3ec19dc700 1 --2- 172.21.15.146:0/2902457736 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ebc133f70 0x7f3ebc1c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.358+0000 7f3ec11db700 1 --2- 172.21.15.146:0/2902457736 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ebc09ad40 0x7f3ebc11f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.358+0000 7f3ec09da700 1 --2- 172.21.15.146:0/2902457736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ebc0a0a70 0x7f3ebc11f7f0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00e8d0 tx=0x7f3eac00ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.358+0000 7f3eb1ffb700 1 -- 172.21.15.146:0/2902457736 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac013680 con 0x7f3ebc0a0a70 2023-10-03T10:17:22.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.358+0000 7f3eb1ffb700 1 -- 172.21.15.146:0/2902457736 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eac0137e0 con 0x7f3ebc0a0a70 2023-10-03T10:17:22.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.358+0000 7f3ec343f700 1 -- 172.21.15.146:0/2902457736 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ebc09e770 con 0x7f3ebc0a0a70 2023-10-03T10:17:22.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.358+0000 7f3eb1ffb700 1 -- 172.21.15.146:0/2902457736 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac013b50 con 0x7f3ebc0a0a70 2023-10-03T10:17:22.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.359+0000 7f3ec343f700 1 -- 172.21.15.146:0/2902457736 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ebc1205f0 con 0x7f3ebc0a0a70 2023-10-03T10:17:22.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.359+0000 7f3ec343f700 1 -- 172.21.15.146:0/2902457736 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ebc04f2a0 con 0x7f3ebc0a0a70 2023-10-03T10:17:22.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.359+0000 7f3eb1ffb700 1 -- 172.21.15.146:0/2902457736 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3eac013cb0 con 0x7f3ebc0a0a70 2023-10-03T10:17:22.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.360+0000 7f3eb1ffb700 1 -- 172.21.15.146:0/2902457736 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3eac03f650 con 0x7f3ebc0a0a70 2023-10-03T10:17:22.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.369+0000 7f3eb1ffb700 1 -- 172.21.15.146:0/2902457736 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3eac01bde0 con 0x7f3ebc0a0a70 2023-10-03T10:17:22.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.415+0000 7f408245e700 1 -- 172.21.15.146:0/3058298149 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f407c1202e0 con 0x7f407c0a0a70 2023-10-03T10:17:22.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.415+0000 7f4078ff9700 1 -- 172.21.15.146:0/3058298149 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f407002a090 con 0x7f407c0a0a70 2023-10-03T10:17:22.416 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:22.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.417+0000 7f408245e700 1 -- 172.21.15.146:0/3058298149 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f407c0a0a70 msgr2=0x7f407c1c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.417+0000 7f408245e700 1 --2- 172.21.15.146:0/3058298149 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f407c0a0a70 0x7f407c1c8740 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f407000e900 tx=0x7f407000ec10 comp rx=0 tx=0).stop 2023-10-03T10:17:22.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.417+0000 7f408245e700 1 -- 172.21.15.146:0/3058298149 shutdown_connections 2023-10-03T10:17:22.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.417+0000 7f408245e700 1 --2- 172.21.15.146:0/3058298149 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f407c133f70 0x7f407c1c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.417+0000 7f408245e700 1 --2- 172.21.15.146:0/3058298149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f407c09ad40 0x7f407c1c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.417+0000 7f408245e700 1 --2- 172.21.15.146:0/3058298149 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f407c0a0a70 0x7f407c1c8740 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.417+0000 7f408245e700 1 -- 172.21.15.146:0/3058298149 >> 172.21.15.146:0/3058298149 conn(0x7f407c099c40 msgr2=0x7f407c09e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.418+0000 7f408245e700 1 -- 172.21.15.146:0/3058298149 shutdown_connections 2023-10-03T10:17:22.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.418+0000 7f408245e700 1 -- 172.21.15.146:0/3058298149 wait complete. 2023-10-03T10:17:22.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:22.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.505+0000 7f81b1f3d700 1 -- 172.21.15.146:0/1644171013 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f81ac04f2a0 con 0x7f81ac1300a0 2023-10-03T10:17:22.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.505+0000 7f8193fff700 1 -- 172.21.15.146:0/1644171013 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f819c015020 con 0x7f81ac1300a0 2023-10-03T10:17:22.506 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:22.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.507+0000 7f81b1f3d700 1 -- 172.21.15.146:0/1644171013 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ac1300a0 msgr2=0x7f81ac0712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.507+0000 7f81b1f3d700 1 --2- 172.21.15.146:0/1644171013 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ac1300a0 0x7f81ac0712f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f819c009fd0 tx=0x7f819c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:22.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.508+0000 7f81b1f3d700 1 -- 172.21.15.146:0/1644171013 shutdown_connections 2023-10-03T10:17:22.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.508+0000 7f81b1f3d700 1 --2- 172.21.15.146:0/1644171013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81ac133ad0 0x7f81ac071d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.508+0000 7f81b1f3d700 1 --2- 172.21.15.146:0/1644171013 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ac1300a0 0x7f81ac0712f0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.508+0000 7f81b1f3d700 1 --2- 172.21.15.146:0/1644171013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81ac1309f0 0x7f81ac071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.508+0000 7f81b1f3d700 1 -- 172.21.15.146:0/1644171013 >> 172.21.15.146:0/1644171013 conn(0x7f81ac099c40 msgr2=0x7f81ac132ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.508+0000 7f81b1f3d700 1 -- 172.21.15.146:0/1644171013 shutdown_connections 2023-10-03T10:17:22.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.508+0000 7f81b1f3d700 1 -- 172.21.15.146:0/1644171013 wait complete. 2023-10-03T10:17:22.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:22.540 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:22.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.571+0000 7f3ec343f700 1 -- 172.21.15.146:0/2902457736 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3ebc0729d0 con 0x7f3ebc0a0a70 2023-10-03T10:17:22.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.571+0000 7f3eb1ffb700 1 -- 172.21.15.146:0/2902457736 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3eac021070 con 0x7f3ebc0a0a70 2023-10-03T10:17:22.572 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:22.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.574+0000 7f3ec343f700 1 -- 172.21.15.146:0/2902457736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ebc0a0a70 msgr2=0x7f3ebc11f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.574+0000 7f3ec343f700 1 --2- 172.21.15.146:0/2902457736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ebc0a0a70 0x7f3ebc11f7f0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00e8d0 tx=0x7f3eac00ebe0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.574+0000 7f3ec343f700 1 -- 172.21.15.146:0/2902457736 shutdown_connections 2023-10-03T10:17:22.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.574+0000 7f3ec343f700 1 --2- 172.21.15.146:0/2902457736 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ebc133f70 0x7f3ebc1c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.574+0000 7f3ec343f700 1 --2- 172.21.15.146:0/2902457736 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ebc09ad40 0x7f3ebc11f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.574+0000 7f3ec343f700 1 --2- 172.21.15.146:0/2902457736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ebc0a0a70 0x7f3ebc11f7f0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.574+0000 7f3ec343f700 1 -- 172.21.15.146:0/2902457736 >> 172.21.15.146:0/2902457736 conn(0x7f3ebc099c40 msgr2=0x7f3ebc1bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.574+0000 7f3ec343f700 1 -- 172.21.15.146:0/2902457736 shutdown_connections 2023-10-03T10:17:22.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.574+0000 7f3ec343f700 1 -- 172.21.15.146:0/2902457736 wait complete. 2023-10-03T10:17:22.586 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:22.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.663+0000 7fa657a98700 1 Processor -- start 2023-10-03T10:17:22.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.663+0000 7fa657a98700 1 -- start start 2023-10-03T10:17:22.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.664+0000 7fa657a98700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa65009d860 0x7fa65009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.664+0000 7fa657a98700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa65009e170 0x7fa6501307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.664+0000 7fa657a98700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa650130ce0 0x7fa650131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.664+0000 7fa657a98700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa65009aaa0 con 0x7fa650130ce0 2023-10-03T10:17:22.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.664+0000 7fa657a98700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65009f870 con 0x7fa65009d860 2023-10-03T10:17:22.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.664+0000 7fa657a98700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa65009b360 con 0x7fa65009e170 2023-10-03T10:17:22.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.664+0000 7fa655834700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa65009d860 0x7fa65009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.664+0000 7fa655033700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa65009e170 0x7fa6501307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.664+0000 7fa655834700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa65009d860 0x7fa65009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35470/0 (socket says 172.21.15.146:35470) 2023-10-03T10:17:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.664+0000 7fa655834700 1 -- 172.21.15.146:0/1713983322 learned_addr learned my addr 172.21.15.146:0/1713983322 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.664+0000 7fa656035700 1 --2- 172.21.15.146:0/1713983322 >> v2:172.21.15.146:3300/0 conn(0x7fa650130ce0 0x7fa650131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.664+0000 7fa655834700 1 -- 172.21.15.146:0/1713983322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa65009e170 msgr2=0x7fa6501307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.664+0000 7fa655834700 1 --2- 172.21.15.146:0/1713983322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa65009e170 0x7fa6501307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.664+0000 7fa655834700 1 -- 172.21.15.146:0/1713983322 >> v2:172.21.15.146:3300/0 conn(0x7fa650130ce0 msgr2=0x7fa650131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.664+0000 7fa655834700 1 --2- 172.21.15.146:0/1713983322 >> v2:172.21.15.146:3300/0 conn(0x7fa650130ce0 0x7fa650131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.664+0000 7fa655834700 1 -- 172.21.15.146:0/1713983322 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65009b620 con 0x7fa65009d860 2023-10-03T10:17:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.664+0000 7fa655033700 1 --2- 172.21.15.146:0/1713983322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa65009e170 0x7fa6501307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.664+0000 7fa656035700 1 --2- 172.21.15.146:0/1713983322 >> v2:172.21.15.146:3300/0 conn(0x7fa650130ce0 0x7fa650131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.664+0000 7fa655834700 1 --2- 172.21.15.146:0/1713983322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa65009d860 0x7fa65009dc30 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa64c0098f0 tx=0x7fa64c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=668174115fd1f14d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.664+0000 7fa654832700 1 -- 172.21.15.146:0/1713983322 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c011830 con 0x7fa65009d860 2023-10-03T10:17:22.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.664+0000 7fa654832700 1 -- 172.21.15.146:0/1713983322 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64c011990 con 0x7fa65009d860 2023-10-03T10:17:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.664+0000 7fa654832700 1 -- 172.21.15.146:0/1713983322 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c011d20 con 0x7fa65009d860 2023-10-03T10:17:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.665+0000 7fa657a98700 1 -- 172.21.15.146:0/1713983322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa65009d860 msgr2=0x7fa65009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.665+0000 7fa657a98700 1 --2- 172.21.15.146:0/1713983322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa65009d860 0x7fa65009dc30 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa64c0098f0 tx=0x7fa64c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.665+0000 7fa657a98700 1 -- 172.21.15.146:0/1713983322 shutdown_connections 2023-10-03T10:17:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.665+0000 7fa657a98700 1 --2- 172.21.15.146:0/1713983322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa65009d860 0x7fa65009dc30 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.665+0000 7fa657a98700 1 --2- 172.21.15.146:0/1713983322 >> v2:172.21.15.146:3300/0 conn(0x7fa650130ce0 0x7fa650131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.665+0000 7fa657a98700 1 --2- 172.21.15.146:0/1713983322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa65009e170 0x7fa6501307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.665+0000 7fa657a98700 1 -- 172.21.15.146:0/1713983322 >> 172.21.15.146:0/1713983322 conn(0x7fa650099c40 msgr2=0x7fa6500a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.665+0000 7fa657a98700 1 -- 172.21.15.146:0/1713983322 shutdown_connections 2023-10-03T10:17:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.665+0000 7fa657a98700 1 -- 172.21.15.146:0/1713983322 wait complete. 2023-10-03T10:17:22.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.666+0000 7fa657a98700 1 Processor -- start 2023-10-03T10:17:22.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.666+0000 7fa657a98700 1 -- start start 2023-10-03T10:17:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.666+0000 7fa657a98700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa65009d860 0x7fa650119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.666+0000 7fa657a98700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa65009e170 0x7fa65011a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.666+0000 7fa657a98700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa650130ce0 0x7fa65011a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.666+0000 7fa657a98700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65011e3e0 con 0x7fa650130ce0 2023-10-03T10:17:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.666+0000 7fa657a98700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65011bbb0 con 0x7fa65009e170 2023-10-03T10:17:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.666+0000 7fa657a98700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa65011d740 con 0x7fa65009d860 2023-10-03T10:17:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.666+0000 7fa655834700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa65009d860 0x7fa650119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.666+0000 7fa655033700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa65009e170 0x7fa65011a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.666+0000 7fa655834700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa65009d860 0x7fa650119f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51560/0 (socket says 172.21.15.146:51560) 2023-10-03T10:17:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.666+0000 7fa656035700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa650130ce0 0x7fa65011a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.666+0000 7fa655834700 1 -- 172.21.15.146:0/1504677718 learned_addr learned my addr 172.21.15.146:0/1504677718 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.667+0000 7fa655834700 1 -- 172.21.15.146:0/1504677718 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa65009e170 msgr2=0x7fa65011a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.667+0000 7fa655834700 1 --2- 172.21.15.146:0/1504677718 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa65009e170 0x7fa65011a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.667+0000 7fa655834700 1 -- 172.21.15.146:0/1504677718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa650130ce0 msgr2=0x7fa65011a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.667+0000 7fa655834700 1 --2- 172.21.15.146:0/1504677718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa650130ce0 0x7fa65011a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.667+0000 7fa655834700 1 -- 172.21.15.146:0/1504677718 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6400094a0 con 0x7fa65009d860 2023-10-03T10:17:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.667+0000 7fa655834700 1 --2- 172.21.15.146:0/1504677718 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa65009d860 0x7fa650119f00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fa64c009c40 tx=0x7fa64c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.667+0000 7fa6467fc700 1 -- 172.21.15.146:0/1504677718 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c004450 con 0x7fa65009d860 2023-10-03T10:17:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.667+0000 7fa6467fc700 1 -- 172.21.15.146:0/1504677718 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64c0045b0 con 0x7fa65009d860 2023-10-03T10:17:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.667+0000 7fa657a98700 1 -- 172.21.15.146:0/1504677718 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6480099e0 con 0x7fa65009d860 2023-10-03T10:17:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.667+0000 7fa6467fc700 1 -- 172.21.15.146:0/1504677718 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c0038c0 con 0x7fa65009d860 2023-10-03T10:17:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.667+0000 7fa657a98700 1 -- 172.21.15.146:0/1504677718 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64c009550 con 0x7fa65009d860 2023-10-03T10:17:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.668+0000 7fa6467fc700 1 -- 172.21.15.146:0/1504677718 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa64c021070 con 0x7fa65009d860 2023-10-03T10:17:22.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.668+0000 7fa6467fc700 1 -- 172.21.15.146:0/1504677718 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa64c0408d0 con 0x7fa65009d860 2023-10-03T10:17:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.668+0000 7fa657a98700 1 -- 172.21.15.146:0/1504677718 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65011cdc0 con 0x7fa65009d860 2023-10-03T10:17:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.673+0000 7fa6467fc700 1 -- 172.21.15.146:0/1504677718 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa64c029080 con 0x7fa65009d860 2023-10-03T10:17:22.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.858+0000 7fa657a98700 1 -- 172.21.15.146:0/1504677718 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa65004f2a0 con 0x7fa65009d860 2023-10-03T10:17:22.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.859+0000 7fa6467fc700 1 -- 172.21.15.146:0/1504677718 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa64c015020 con 0x7fa65009d860 2023-10-03T10:17:22.859 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.860+0000 7fa657a98700 1 -- 172.21.15.146:0/1504677718 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa65009d860 msgr2=0x7fa650119f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.860+0000 7fa657a98700 1 --2- 172.21.15.146:0/1504677718 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa65009d860 0x7fa650119f00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fa64c009c40 tx=0x7fa64c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.861+0000 7fa657a98700 1 -- 172.21.15.146:0/1504677718 shutdown_connections 2023-10-03T10:17:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.861+0000 7fa657a98700 1 --2- 172.21.15.146:0/1504677718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa650130ce0 0x7fa65011a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.861+0000 7fa657a98700 1 --2- 172.21.15.146:0/1504677718 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa65009d860 0x7fa650119f00 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.861+0000 7fa657a98700 1 --2- 172.21.15.146:0/1504677718 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa65009e170 0x7fa65011a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.861+0000 7fa657a98700 1 -- 172.21.15.146:0/1504677718 >> 172.21.15.146:0/1504677718 conn(0x7fa650099c40 msgr2=0x7fa6500a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.861+0000 7fa657a98700 1 -- 172.21.15.146:0/1504677718 shutdown_connections 2023-10-03T10:17:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:22.861+0000 7fa657a98700 1 -- 172.21.15.146:0/1504677718 wait complete. 2023-10-03T10:17:22.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:23.432 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:23.521 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.563+0000 7f96b79e5700 1 Processor -- start 2023-10-03T10:17:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.563+0000 7f96b79e5700 1 -- start start 2023-10-03T10:17:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.564+0000 7f96b79e5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f96b009d860 0x7f96b009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.564+0000 7f96b79e5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96b009e170 0x7f96b01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.564+0000 7f96b79e5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b009aaa0 con 0x7f96b0130ce0 2023-10-03T10:17:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.564+0000 7f96b79e5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b009f870 con 0x7f96b009e170 2023-10-03T10:17:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.564+0000 7f96b79e5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96b009b360 con 0x7f96b009d860 2023-10-03T10:17:23.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.564+0000 7f96b4f80700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96b009e170 0x7f96b01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.564+0000 7f96b5781700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f96b009d860 0x7f96b009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.564+0000 7f96b4f80700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96b009e170 0x7f96b01307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35490/0 (socket says 172.21.15.146:35490) 2023-10-03T10:17:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.564+0000 7f96b5781700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f96b009d860 0x7f96b009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51570/0 (socket says 172.21.15.146:51570) 2023-10-03T10:17:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.564+0000 7f96b4f80700 1 -- 172.21.15.146:0/284001706 learned_addr learned my addr 172.21.15.146:0/284001706 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.564+0000 7f96a7fff700 1 -- 172.21.15.146:0/284001706 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458346239 0 0) 0x7f96b009aaa0 con 0x7f96b0130ce0 2023-10-03T10:17:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.564+0000 7f96b4f80700 1 -- 172.21.15.146:0/284001706 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f96b009d860 msgr2=0x7f96b009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.564+0000 7f96b4f80700 1 --2- 172.21.15.146:0/284001706 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f96b009d860 0x7f96b009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.564+0000 7f96b4f80700 1 -- 172.21.15.146:0/284001706 >> v1:172.21.15.146:6789/0 conn(0x7f96b0130ce0 legacy=0x7f96b01379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.564+0000 7f96b4f80700 1 -- 172.21.15.146:0/284001706 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b009b620 con 0x7f96b009e170 2023-10-03T10:17:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.564+0000 7f96b5781700 1 --2- 172.21.15.146:0/284001706 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f96b009d860 0x7f96b009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.565+0000 7f96b4f80700 1 --2- 172.21.15.146:0/284001706 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96b009e170 0x7f96b01307a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f96a0009920 tx=0x7f96a0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f669657d296a5dac server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.565+0000 7f96a7fff700 1 -- 172.21.15.146:0/284001706 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0011830 con 0x7f96b009e170 2023-10-03T10:17:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.565+0000 7f96a7fff700 1 -- 172.21.15.146:0/284001706 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a0011990 con 0x7f96b009e170 2023-10-03T10:17:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.565+0000 7f96a7fff700 1 -- 172.21.15.146:0/284001706 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0011d20 con 0x7f96b009e170 2023-10-03T10:17:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.565+0000 7f96b79e5700 1 -- 172.21.15.146:0/284001706 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96b009e170 msgr2=0x7f96b01307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.565+0000 7f96b79e5700 1 --2- 172.21.15.146:0/284001706 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96b009e170 0x7f96b01307a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f96a0009920 tx=0x7f96a0009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.565+0000 7f96b79e5700 1 -- 172.21.15.146:0/284001706 shutdown_connections 2023-10-03T10:17:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.565+0000 7f96b79e5700 1 --2- 172.21.15.146:0/284001706 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f96b009d860 0x7f96b009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.565+0000 7f96b79e5700 1 --2- 172.21.15.146:0/284001706 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96b009e170 0x7f96b01307a0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.565+0000 7f96b79e5700 1 -- 172.21.15.146:0/284001706 >> 172.21.15.146:0/284001706 conn(0x7f96b0099c40 msgr2=0x7f96b00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.565+0000 7f96b79e5700 1 -- 172.21.15.146:0/284001706 shutdown_connections 2023-10-03T10:17:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.565+0000 7f96b79e5700 1 -- 172.21.15.146:0/284001706 wait complete. 2023-10-03T10:17:23.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.566+0000 7f96b79e5700 1 Processor -- start 2023-10-03T10:17:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.566+0000 7f96b79e5700 1 -- start start 2023-10-03T10:17:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.567+0000 7f96b79e5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96b009d860 0x7f96b01c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.567+0000 7f96b79e5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96b009e170 0x7f96b01c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.567+0000 7f96b79e5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f96b0130ce0 0x7f96b01c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.567+0000 7f96b79e5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b0070670 con 0x7f96b009d860 2023-10-03T10:17:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.567+0000 7f96b79e5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b0125e00 con 0x7f96b009e170 2023-10-03T10:17:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.567+0000 7f96b79e5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96b01308a0 con 0x7f96b0130ce0 2023-10-03T10:17:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.567+0000 7f96b4f80700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96b009e170 0x7f96b01c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.567+0000 7f96b5781700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96b009d860 0x7f96b01c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.567+0000 7f96b4f80700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96b009e170 0x7f96b01c7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35498/0 (socket says 172.21.15.146:35498) 2023-10-03T10:17:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.567+0000 7f96b5781700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96b009d860 0x7f96b01c72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58234/0 (socket says 172.21.15.146:58234) 2023-10-03T10:17:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.567+0000 7f96b4f80700 1 -- 172.21.15.146:0/1596009669 learned_addr learned my addr 172.21.15.146:0/1596009669 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.567+0000 7f96b5f82700 1 --2- 172.21.15.146:0/1596009669 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f96b0130ce0 0x7f96b01c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.567+0000 7f96b4f80700 1 -- 172.21.15.146:0/1596009669 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f96b0130ce0 msgr2=0x7f96b01c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.567+0000 7f96b4f80700 1 --2- 172.21.15.146:0/1596009669 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f96b0130ce0 0x7f96b01c8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.567+0000 7f96b4f80700 1 -- 172.21.15.146:0/1596009669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96b009d860 msgr2=0x7f96b01c72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.567+0000 7f96b4f80700 1 --2- 172.21.15.146:0/1596009669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96b009d860 0x7f96b01c72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.567+0000 7f96b4f80700 1 -- 172.21.15.146:0/1596009669 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ac0094a0 con 0x7f96b009e170 2023-10-03T10:17:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.567+0000 7f96b4f80700 1 --2- 172.21.15.146:0/1596009669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96b009e170 0x7f96b01c7800 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f96a0000c00 tx=0x7f96a0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.567+0000 7f96a5ffb700 1 -- 172.21.15.146:0/1596009669 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0004450 con 0x7f96b009e170 2023-10-03T10:17:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.567+0000 7f96a5ffb700 1 -- 172.21.15.146:0/1596009669 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a00045b0 con 0x7f96b009e170 2023-10-03T10:17:23.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.567+0000 7f96a5ffb700 1 -- 172.21.15.146:0/1596009669 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a00038a0 con 0x7f96b009e170 2023-10-03T10:17:23.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.567+0000 7f96b79e5700 1 -- 172.21.15.146:0/1596009669 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a0009550 con 0x7f96b009e170 2023-10-03T10:17:23.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.568+0000 7f96b79e5700 1 -- 172.21.15.146:0/1596009669 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b0126410 con 0x7f96b009e170 2023-10-03T10:17:23.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.568+0000 7f96a5ffb700 1 -- 172.21.15.146:0/1596009669 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f96a0021070 con 0x7f96b009e170 2023-10-03T10:17:23.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.569+0000 7f96b79e5700 1 -- 172.21.15.146:0/1596009669 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b0126250 con 0x7f96b009e170 2023-10-03T10:17:23.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.569+0000 7f96a5ffb700 1 -- 172.21.15.146:0/1596009669 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f96a00408e0 con 0x7f96b009e170 2023-10-03T10:17:23.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.573+0000 7f96a5ffb700 1 -- 172.21.15.146:0/1596009669 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f96a0015020 con 0x7f96b009e170 2023-10-03T10:17:23.587 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:23.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.648+0000 7f2455208700 1 Processor -- start 2023-10-03T10:17:23.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.648+0000 7f2455208700 1 -- start start 2023-10-03T10:17:23.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.649+0000 7f2455208700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f24500a1550 0x7f2450138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.649+0000 7f2455208700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2450139200 0x7f245013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.649+0000 7f2455208700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245009e9d0 con 0x7f24500a0a70 2023-10-03T10:17:23.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.649+0000 7f2455208700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245009dc00 con 0x7f24500a1550 2023-10-03T10:17:23.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.649+0000 7f2455208700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f245009dec0 con 0x7f2450139200 2023-10-03T10:17:23.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.649+0000 7f244f59e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2450139200 0x7f245013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.649+0000 7f244f59e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2450139200 0x7f245013b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51584/0 (socket says 172.21.15.146:51584) 2023-10-03T10:17:23.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.649+0000 7f244e59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f24500a1550 0x7f2450138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.649+0000 7f244ed9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f24500a0a70 0x7f24500a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59236/0 (socket says 172.21.15.146:59236) 2023-10-03T10:17:23.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.649+0000 7f244f59e700 1 -- 172.21.15.146:0/216858144 learned_addr learned my addr 172.21.15.146:0/216858144 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:23.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.649+0000 7f244e59c700 1 -- 172.21.15.146:0/216858144 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2450139200 msgr2=0x7f245013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.649+0000 7f244e59c700 1 --2- 172.21.15.146:0/216858144 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2450139200 0x7f245013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.649+0000 7f244e59c700 1 -- 172.21.15.146:0/216858144 >> v1:172.21.15.146:6789/0 conn(0x7f24500a0a70 legacy=0x7f24500a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.649+0000 7f244e59c700 1 -- 172.21.15.146:0/216858144 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245009e6a0 con 0x7f24500a1550 2023-10-03T10:17:23.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.649+0000 7f244f59e700 1 --2- 172.21.15.146:0/216858144 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2450139200 0x7f245013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:23.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.649+0000 7f244e59c700 1 --2- 172.21.15.146:0/216858144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24500a1550 0x7f2450138cc0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f2444009840 tx=0x7f2444009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75077ef9aa2620e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.650+0000 7f244dd9b700 1 -- 172.21.15.146:0/216858144 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444011830 con 0x7f24500a1550 2023-10-03T10:17:23.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.650+0000 7f244dd9b700 1 -- 172.21.15.146:0/216858144 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2444011990 con 0x7f24500a1550 2023-10-03T10:17:23.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.650+0000 7f244dd9b700 1 -- 172.21.15.146:0/216858144 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444011d20 con 0x7f24500a1550 2023-10-03T10:17:23.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.650+0000 7f2455208700 1 -- 172.21.15.146:0/216858144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24500a1550 msgr2=0x7f2450138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.650+0000 7f2455208700 1 --2- 172.21.15.146:0/216858144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24500a1550 0x7f2450138cc0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f2444009840 tx=0x7f2444009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:23.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.650+0000 7f2455208700 1 -- 172.21.15.146:0/216858144 shutdown_connections 2023-10-03T10:17:23.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.650+0000 7f2455208700 1 --2- 172.21.15.146:0/216858144 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2450139200 0x7f245013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.650+0000 7f2455208700 1 --2- 172.21.15.146:0/216858144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24500a1550 0x7f2450138cc0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.650+0000 7f2455208700 1 -- 172.21.15.146:0/216858144 >> 172.21.15.146:0/216858144 conn(0x7f24500a6610 msgr2=0x7f24500a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.650+0000 7f2455208700 1 -- 172.21.15.146:0/216858144 shutdown_connections 2023-10-03T10:17:23.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.650+0000 7f2455208700 1 -- 172.21.15.146:0/216858144 wait complete. 2023-10-03T10:17:23.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.651+0000 7f2455208700 1 Processor -- start 2023-10-03T10:17:23.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.651+0000 7f2455208700 1 -- start start 2023-10-03T10:17:23.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.652+0000 7f2455208700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24500a0a70 0x7f245011e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.652+0000 7f2455208700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24500a1550 0x7f245011ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.652+0000 7f2455208700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2450139200 0x7f245011f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.652+0000 7f2455208700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2450122070 con 0x7f2450139200 2023-10-03T10:17:23.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.652+0000 7f2455208700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2450120440 con 0x7f24500a1550 2023-10-03T10:17:23.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.652+0000 7f2455208700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24500a5290 con 0x7f24500a0a70 2023-10-03T10:17:23.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.652+0000 7f244ed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24500a0a70 0x7f245011e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.652+0000 7f244ed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24500a0a70 0x7f245011e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51594/0 (socket says 172.21.15.146:51594) 2023-10-03T10:17:23.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.652+0000 7f244ed9d700 1 -- 172.21.15.146:0/3223203192 learned_addr learned my addr 172.21.15.146:0/3223203192 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:23.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.652+0000 7f244e59c700 1 --2- 172.21.15.146:0/3223203192 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24500a1550 0x7f245011ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.652+0000 7f244f59e700 1 --2- 172.21.15.146:0/3223203192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2450139200 0x7f245011f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.652+0000 7f244f59e700 1 -- 172.21.15.146:0/3223203192 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24500a0a70 msgr2=0x7f245011e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.652+0000 7f244f59e700 1 --2- 172.21.15.146:0/3223203192 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24500a0a70 0x7f245011e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.652+0000 7f244f59e700 1 -- 172.21.15.146:0/3223203192 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24500a1550 msgr2=0x7f245011ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.652+0000 7f244f59e700 1 --2- 172.21.15.146:0/3223203192 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24500a1550 0x7f245011ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.652+0000 7f244f59e700 1 -- 172.21.15.146:0/3223203192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2448009b30 con 0x7f2450139200 2023-10-03T10:17:23.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.652+0000 7f244ed9d700 1 --2- 172.21.15.146:0/3223203192 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24500a0a70 0x7f245011e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:23.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.652+0000 7f244e59c700 1 --2- 172.21.15.146:0/3223203192 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24500a1550 0x7f245011ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:23.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.653+0000 7f244f59e700 1 --2- 172.21.15.146:0/3223203192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2450139200 0x7f245011f2b0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f244800ef90 tx=0x7f244800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.653+0000 7f24377fe700 1 -- 172.21.15.146:0/3223203192 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448018070 con 0x7f2450139200 2023-10-03T10:17:23.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.653+0000 7f24377fe700 1 -- 172.21.15.146:0/3223203192 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244800f040 con 0x7f2450139200 2023-10-03T10:17:23.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.653+0000 7f2455208700 1 -- 172.21.15.146:0/3223203192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24440094a0 con 0x7f2450139200 2023-10-03T10:17:23.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.653+0000 7f24377fe700 1 -- 172.21.15.146:0/3223203192 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448003c60 con 0x7f2450139200 2023-10-03T10:17:23.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.653+0000 7f2455208700 1 -- 172.21.15.146:0/3223203192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2450121db0 con 0x7f2450139200 2023-10-03T10:17:23.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.654+0000 7f2455208700 1 -- 172.21.15.146:0/3223203192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f245004f2a0 con 0x7f2450139200 2023-10-03T10:17:23.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.654+0000 7f24377fe700 1 -- 172.21.15.146:0/3223203192 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f244800c880 con 0x7f2450139200 2023-10-03T10:17:23.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.654+0000 7f24377fe700 1 -- 172.21.15.146:0/3223203192 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f244803f640 con 0x7f2450139200 2023-10-03T10:17:23.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.663+0000 7f24377fe700 1 -- 172.21.15.146:0/3223203192 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f244801ccf0 con 0x7f2450139200 2023-10-03T10:17:23.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.716+0000 7effc240b700 1 Processor -- start 2023-10-03T10:17:23.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.716+0000 7effc240b700 1 -- start start 2023-10-03T10:17:23.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.716+0000 7effc240b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7effbc0a1550 0x7effbc138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.716+0000 7effc240b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7effbc139200 0x7effbc13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.716+0000 7effc240b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effbc09e9d0 con 0x7effbc0a0a70 2023-10-03T10:17:23.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.716+0000 7effc240b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc09dc00 con 0x7effbc0a1550 2023-10-03T10:17:23.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.716+0000 7effc240b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effbc09dec0 con 0x7effbc139200 2023-10-03T10:17:23.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.716+0000 7effbbfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7effbc0a0a70 0x7effbc0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59252/0 (socket says 172.21.15.146:59252) 2023-10-03T10:17:23.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.716+0000 7effbbfff700 1 -- 172.21.15.146:0/3766325597 learned_addr learned my addr 172.21.15.146:0/3766325597 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:23.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.716+0000 7effc09a8700 1 --2- 172.21.15.146:0/3766325597 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7effbc139200 0x7effbc13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.716+0000 7effbb7fe700 1 --2- 172.21.15.146:0/3766325597 >> v2:172.21.15.146:3300/0 conn(0x7effbc0a1550 0x7effbc138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.717+0000 7effc09a8700 1 -- 172.21.15.146:0/3766325597 >> v2:172.21.15.146:3300/0 conn(0x7effbc0a1550 msgr2=0x7effbc138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.717+0000 7effc09a8700 1 --2- 172.21.15.146:0/3766325597 >> v2:172.21.15.146:3300/0 conn(0x7effbc0a1550 0x7effbc138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.717+0000 7effc09a8700 1 -- 172.21.15.146:0/3766325597 >> v1:172.21.15.146:6789/0 conn(0x7effbc0a0a70 legacy=0x7effbc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.717+0000 7effbaffd700 1 -- 172.21.15.146:0/3766325597 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139697087 0 0) 0x7effbc09e9d0 con 0x7effbc0a0a70 2023-10-03T10:17:23.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.717+0000 7effc09a8700 1 -- 172.21.15.146:0/3766325597 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc09e6a0 con 0x7effbc139200 2023-10-03T10:17:23.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.717+0000 7effc09a8700 1 --2- 172.21.15.146:0/3766325597 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7effbc139200 0x7effbc13b5e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7effb4009d90 tx=0x7effb400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24c1275276f53e59 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.717+0000 7effbaffd700 1 -- 172.21.15.146:0/3766325597 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb400e070 con 0x7effbc139200 2023-10-03T10:17:23.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.717+0000 7effbaffd700 1 -- 172.21.15.146:0/3766325597 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb400bb20 con 0x7effbc139200 2023-10-03T10:17:23.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.717+0000 7effbaffd700 1 -- 172.21.15.146:0/3766325597 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb4012430 con 0x7effbc139200 2023-10-03T10:17:23.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.718+0000 7effc240b700 1 -- 172.21.15.146:0/3766325597 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7effbc139200 msgr2=0x7effbc13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.718+0000 7effc240b700 1 --2- 172.21.15.146:0/3766325597 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7effbc139200 0x7effbc13b5e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7effb4009d90 tx=0x7effb400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:23.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.718+0000 7effc240b700 1 -- 172.21.15.146:0/3766325597 shutdown_connections 2023-10-03T10:17:23.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.718+0000 7effc240b700 1 --2- 172.21.15.146:0/3766325597 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7effbc139200 0x7effbc13b5e0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.718+0000 7effc240b700 1 --2- 172.21.15.146:0/3766325597 >> v2:172.21.15.146:3300/0 conn(0x7effbc0a1550 0x7effbc138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.718+0000 7effc240b700 1 -- 172.21.15.146:0/3766325597 >> 172.21.15.146:0/3766325597 conn(0x7effbc0a6610 msgr2=0x7effbc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.718+0000 7effc240b700 1 -- 172.21.15.146:0/3766325597 shutdown_connections 2023-10-03T10:17:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.718+0000 7effc240b700 1 -- 172.21.15.146:0/3766325597 wait complete. 2023-10-03T10:17:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.719+0000 7effc240b700 1 Processor -- start 2023-10-03T10:17:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.719+0000 7effc240b700 1 -- start start 2023-10-03T10:17:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.720+0000 7effc240b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effbc0a0a70 0x7effbc121730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.720+0000 7effc240b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7effbc0a1550 0x7effbc121c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.720+0000 7effc240b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7effbc139200 0x7effbc1221b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.720+0000 7effc240b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc124a50 con 0x7effbc0a0a70 2023-10-03T10:17:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.720+0000 7effc240b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc124f70 con 0x7effbc0a1550 2023-10-03T10:17:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.720+0000 7effc240b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effbc09cb10 con 0x7effbc139200 2023-10-03T10:17:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.720+0000 7effbb7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7effbc0a1550 0x7effbc121c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.720+0000 7effbbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effbc0a0a70 0x7effbc121730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.720+0000 7effbb7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7effbc0a1550 0x7effbc121c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35520/0 (socket says 172.21.15.146:35520) 2023-10-03T10:17:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.720+0000 7effbb7fe700 1 -- 172.21.15.146:0/2459560275 learned_addr learned my addr 172.21.15.146:0/2459560275 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.720+0000 7effc09a8700 1 --2- 172.21.15.146:0/2459560275 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7effbc139200 0x7effbc1221b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.721+0000 7effbbfff700 1 -- 172.21.15.146:0/2459560275 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7effbc139200 msgr2=0x7effbc1221b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.721+0000 7effbbfff700 1 --2- 172.21.15.146:0/2459560275 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7effbc139200 0x7effbc1221b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.721+0000 7effbbfff700 1 -- 172.21.15.146:0/2459560275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7effbc0a1550 msgr2=0x7effbc121c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.721+0000 7effbbfff700 1 --2- 172.21.15.146:0/2459560275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7effbc0a1550 0x7effbc121c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.721+0000 7effbbfff700 1 -- 172.21.15.146:0/2459560275 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb4009a70 con 0x7effbc0a0a70 2023-10-03T10:17:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.721+0000 7effbb7fe700 1 --2- 172.21.15.146:0/2459560275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7effbc0a1550 0x7effbc121c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.721+0000 7effbbfff700 1 --2- 172.21.15.146:0/2459560275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effbc0a0a70 0x7effbc121730 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7effac00c470 tx=0x7effac00c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.721+0000 7effb8ff9700 1 -- 172.21.15.146:0/2459560275 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac004c80 con 0x7effbc0a0a70 2023-10-03T10:17:23.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.721+0000 7effb8ff9700 1 -- 172.21.15.146:0/2459560275 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac004de0 con 0x7effbc0a0a70 2023-10-03T10:17:23.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.721+0000 7effc240b700 1 -- 172.21.15.146:0/2459560275 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc0a03e0 con 0x7effbc0a0a70 2023-10-03T10:17:23.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.721+0000 7effb8ff9700 1 -- 172.21.15.146:0/2459560275 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac007310 con 0x7effbc0a0a70 2023-10-03T10:17:23.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.721+0000 7effc240b700 1 -- 172.21.15.146:0/2459560275 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc1259e0 con 0x7effbc0a0a70 2023-10-03T10:17:23.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.722+0000 7effb8ff9700 1 -- 172.21.15.146:0/2459560275 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7effac007470 con 0x7effbc0a0a70 2023-10-03T10:17:23.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.722+0000 7effc240b700 1 -- 172.21.15.146:0/2459560275 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effbc04f2a0 con 0x7effbc0a0a70 2023-10-03T10:17:23.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.722+0000 7effb8ff9700 1 -- 172.21.15.146:0/2459560275 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7effac03f280 con 0x7effbc0a0a70 2023-10-03T10:17:23.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.727+0000 7effb8ff9700 1 -- 172.21.15.146:0/2459560275 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effac0102c0 con 0x7effbc0a0a70 2023-10-03T10:17:23.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.778+0000 7f96b79e5700 1 -- 172.21.15.146:0/1596009669 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f96b004f2a0 con 0x7f96b009e170 2023-10-03T10:17:23.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.778+0000 7f96a5ffb700 1 -- 172.21.15.146:0/1596009669 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f96a0029070 con 0x7f96b009e170 2023-10-03T10:17:23.779 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:23.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.781+0000 7f96b79e5700 1 -- 172.21.15.146:0/1596009669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96b009e170 msgr2=0x7f96b01c7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.781+0000 7f96b79e5700 1 --2- 172.21.15.146:0/1596009669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96b009e170 0x7f96b01c7800 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f96a0000c00 tx=0x7f96a0004750 comp rx=0 tx=0).stop 2023-10-03T10:17:23.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.782+0000 7f96b79e5700 1 -- 172.21.15.146:0/1596009669 shutdown_connections 2023-10-03T10:17:23.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.782+0000 7f96b79e5700 1 --2- 172.21.15.146:0/1596009669 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f96b0130ce0 0x7f96b01c8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.782+0000 7f96b79e5700 1 --2- 172.21.15.146:0/1596009669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96b009d860 0x7f96b01c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.782+0000 7f96b79e5700 1 --2- 172.21.15.146:0/1596009669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96b009e170 0x7f96b01c7800 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.782+0000 7f96b79e5700 1 -- 172.21.15.146:0/1596009669 >> 172.21.15.146:0/1596009669 conn(0x7f96b0099c40 msgr2=0x7f96b006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.782+0000 7f96b79e5700 1 -- 172.21.15.146:0/1596009669 shutdown_connections 2023-10-03T10:17:23.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.782+0000 7f96b79e5700 1 -- 172.21.15.146:0/1596009669 wait complete. 2023-10-03T10:17:23.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:23.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.857+0000 7f2455208700 1 -- 172.21.15.146:0/3223203192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2450120c00 con 0x7f2450139200 2023-10-03T10:17:23.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.857+0000 7f24377fe700 1 -- 172.21.15.146:0/3223203192 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f244801de00 con 0x7f2450139200 2023-10-03T10:17:23.858 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:23.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.859+0000 7f2455208700 1 -- 172.21.15.146:0/3223203192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2450139200 msgr2=0x7f245011f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.859+0000 7f2455208700 1 --2- 172.21.15.146:0/3223203192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2450139200 0x7f245011f2b0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f244800ef90 tx=0x7f244800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.859+0000 7f2455208700 1 -- 172.21.15.146:0/3223203192 shutdown_connections 2023-10-03T10:17:23.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.859+0000 7f2455208700 1 --2- 172.21.15.146:0/3223203192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2450139200 0x7f245011f2b0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.859+0000 7f2455208700 1 --2- 172.21.15.146:0/3223203192 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24500a0a70 0x7f245011e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.859+0000 7f2455208700 1 --2- 172.21.15.146:0/3223203192 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24500a1550 0x7f245011ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.859+0000 7f2455208700 1 -- 172.21.15.146:0/3223203192 >> 172.21.15.146:0/3223203192 conn(0x7f24500a6610 msgr2=0x7f2450136c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.859+0000 7f2455208700 1 -- 172.21.15.146:0/3223203192 shutdown_connections 2023-10-03T10:17:23.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.859+0000 7f2455208700 1 -- 172.21.15.146:0/3223203192 wait complete. 2023-10-03T10:17:23.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:23.874 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:23.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.924+0000 7effc240b700 1 -- 172.21.15.146:0/2459560275 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7effbc072980 con 0x7effbc0a0a70 2023-10-03T10:17:23.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.925+0000 7effb8ff9700 1 -- 172.21.15.146:0/2459560275 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effac011360 con 0x7effbc0a0a70 2023-10-03T10:17:23.926 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:23.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.927+0000 7effc240b700 1 -- 172.21.15.146:0/2459560275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effbc0a0a70 msgr2=0x7effbc121730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.927+0000 7effc240b700 1 --2- 172.21.15.146:0/2459560275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effbc0a0a70 0x7effbc121730 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7effac00c470 tx=0x7effac00c780 comp rx=0 tx=0).stop 2023-10-03T10:17:23.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.927+0000 7effc240b700 1 -- 172.21.15.146:0/2459560275 shutdown_connections 2023-10-03T10:17:23.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.927+0000 7effc240b700 1 --2- 172.21.15.146:0/2459560275 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7effbc139200 0x7effbc1221b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.927+0000 7effc240b700 1 --2- 172.21.15.146:0/2459560275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effbc0a0a70 0x7effbc121730 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.927+0000 7effc240b700 1 --2- 172.21.15.146:0/2459560275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7effbc0a1550 0x7effbc121c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.927+0000 7effc240b700 1 -- 172.21.15.146:0/2459560275 >> 172.21.15.146:0/2459560275 conn(0x7effbc0a6610 msgr2=0x7effbc0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.927+0000 7effc240b700 1 -- 172.21.15.146:0/2459560275 shutdown_connections 2023-10-03T10:17:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.927+0000 7effc240b700 1 -- 172.21.15.146:0/2459560275 wait complete. 2023-10-03T10:17:23.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:23.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.999+0000 7f8f77c9e700 1 Processor -- start 2023-10-03T10:17:23.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.999+0000 7f8f77c9e700 1 -- start start 2023-10-03T10:17:24.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.999+0000 7f8f77c9e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f70133ad0 0x7f8f70133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.999+0000 7f8f77c9e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f701300a0 0x7f8f701304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.999+0000 7f8f77c9e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8f701309f0 0x7f8f7013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.999+0000 7f8f77c9e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f7006b2d0 con 0x7f8f701309f0 2023-10-03T10:17:24.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.999+0000 7f8f77c9e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f70133610 con 0x7f8f701300a0 2023-10-03T10:17:24.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.999+0000 7f8f77c9e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7009a500 con 0x7f8f70133ad0 2023-10-03T10:17:24.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.999+0000 7f8f75a3a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f70133ad0 0x7f8f70133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.999+0000 7f8f75239700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f701300a0 0x7f8f701304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.999+0000 7f8f7623b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8f701309f0 0x7f8f7013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.999+0000 7f8f75a3a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f70133ad0 0x7f8f70133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:51630/0 (socket says 172.21.15.146:51630) 2023-10-03T10:17:24.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.999+0000 7f8f75239700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f701300a0 0x7f8f701304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35532/0 (socket says 172.21.15.146:35532) 2023-10-03T10:17:24.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:23.999+0000 7f8f75a3a700 1 -- 172.21.15.146:0/4167421233 learned_addr learned my addr 172.21.15.146:0/4167421233 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:24.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.000+0000 7f8f75a3a700 1 -- 172.21.15.146:0/4167421233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f701300a0 msgr2=0x7f8f701304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:24.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.000+0000 7f8f75a3a700 1 --2- 172.21.15.146:0/4167421233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f701300a0 0x7f8f701304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.000+0000 7f8f75a3a700 1 -- 172.21.15.146:0/4167421233 >> v2:172.21.15.146:3300/0 conn(0x7f8f701309f0 msgr2=0x7f8f7013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:24.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.000+0000 7f8f75a3a700 1 --2- 172.21.15.146:0/4167421233 >> v2:172.21.15.146:3300/0 conn(0x7f8f701309f0 0x7f8f7013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.000+0000 7f8f75a3a700 1 -- 172.21.15.146:0/4167421233 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f701338b0 con 0x7f8f70133ad0 2023-10-03T10:17:24.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.000+0000 7f8f7623b700 1 --2- 172.21.15.146:0/4167421233 >> v2:172.21.15.146:3300/0 conn(0x7f8f701309f0 0x7f8f7013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:24.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.000+0000 7f8f75a3a700 1 --2- 172.21.15.146:0/4167421233 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f70133ad0 0x7f8f70133ea0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c0098f0 tx=0x7f8f6c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c9e2fe7f83f5922 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:24.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.000+0000 7f8f74a38700 1 -- 172.21.15.146:0/4167421233 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c011830 con 0x7f8f70133ad0 2023-10-03T10:17:24.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.000+0000 7f8f74a38700 1 -- 172.21.15.146:0/4167421233 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6c011990 con 0x7f8f70133ad0 2023-10-03T10:17:24.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.000+0000 7f8f74a38700 1 -- 172.21.15.146:0/4167421233 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c011d20 con 0x7f8f70133ad0 2023-10-03T10:17:24.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.000+0000 7f8f77c9e700 1 -- 172.21.15.146:0/4167421233 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f70133ad0 msgr2=0x7f8f70133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.000+0000 7f8f77c9e700 1 --2- 172.21.15.146:0/4167421233 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f70133ad0 0x7f8f70133ea0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c0098f0 tx=0x7f8f6c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:24.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.001+0000 7f8f77c9e700 1 -- 172.21.15.146:0/4167421233 shutdown_connections 2023-10-03T10:17:24.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.001+0000 7f8f77c9e700 1 --2- 172.21.15.146:0/4167421233 >> v2:172.21.15.146:3300/0 conn(0x7f8f701309f0 0x7f8f7013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.001+0000 7f8f77c9e700 1 --2- 172.21.15.146:0/4167421233 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f70133ad0 0x7f8f70133ea0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.001+0000 7f8f77c9e700 1 --2- 172.21.15.146:0/4167421233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f701300a0 0x7f8f701304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.001+0000 7f8f77c9e700 1 -- 172.21.15.146:0/4167421233 >> 172.21.15.146:0/4167421233 conn(0x7f8f70099c40 msgr2=0x7f8f700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.001+0000 7f8f77c9e700 1 -- 172.21.15.146:0/4167421233 shutdown_connections 2023-10-03T10:17:24.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.001+0000 7f8f77c9e700 1 -- 172.21.15.146:0/4167421233 wait complete. 2023-10-03T10:17:24.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.001+0000 7f8f77c9e700 1 Processor -- start 2023-10-03T10:17:24.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.002+0000 7f8f77c9e700 1 -- start start 2023-10-03T10:17:24.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.002+0000 7f8f77c9e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f701300a0 0x7f8f701c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.002+0000 7f8f77c9e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f701309f0 0x7f8f701c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.002+0000 7f8f77c9e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f70133ad0 0x7f8f701c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.002+0000 7f8f77c9e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7012da50 con 0x7f8f701300a0 2023-10-03T10:17:24.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.002+0000 7f8f77c9e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f70072230 con 0x7f8f701309f0 2023-10-03T10:17:24.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.002+0000 7f8f77c9e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7011fe50 con 0x7f8f70133ad0 2023-10-03T10:17:24.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.002+0000 7f8f75239700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f701309f0 0x7f8f701c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.002+0000 7f8f75a3a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f701300a0 0x7f8f701c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.002+0000 7f8f7623b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f70133ad0 0x7f8f701c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.002+0000 7f8f75239700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f701309f0 0x7f8f701c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35540/0 (socket says 172.21.15.146:35540) 2023-10-03T10:17:24.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.002+0000 7f8f75239700 1 -- 172.21.15.146:0/368785427 learned_addr learned my addr 172.21.15.146:0/368785427 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:24.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.002+0000 7f8f75239700 1 -- 172.21.15.146:0/368785427 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f70133ad0 msgr2=0x7f8f701c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.002+0000 7f8f75239700 1 --2- 172.21.15.146:0/368785427 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f70133ad0 0x7f8f701c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.002+0000 7f8f75239700 1 -- 172.21.15.146:0/368785427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f701300a0 msgr2=0x7f8f701c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.002+0000 7f8f75239700 1 --2- 172.21.15.146:0/368785427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f701300a0 0x7f8f701c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.002+0000 7f8f75239700 1 -- 172.21.15.146:0/368785427 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f68009a70 con 0x7f8f701309f0 2023-10-03T10:17:24.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.002+0000 7f8f75a3a700 1 --2- 172.21.15.146:0/368785427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f701300a0 0x7f8f701c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:24.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.002+0000 7f8f7623b700 1 --2- 172.21.15.146:0/368785427 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f70133ad0 0x7f8f701c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:24.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.002+0000 7f8f75239700 1 --2- 172.21.15.146:0/368785427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f701309f0 0x7f8f701c8c90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000e840 tx=0x7f8f6000eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:24.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.003+0000 7f8f667fc700 1 -- 172.21.15.146:0/368785427 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f60009590 con 0x7f8f701309f0 2023-10-03T10:17:24.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.003+0000 7f8f667fc700 1 -- 172.21.15.146:0/368785427 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f60013680 con 0x7f8f701309f0 2023-10-03T10:17:24.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.003+0000 7f8f77c9e700 1 -- 172.21.15.146:0/368785427 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6c009550 con 0x7f8f701309f0 2023-10-03T10:17:24.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.003+0000 7f8f667fc700 1 -- 172.21.15.146:0/368785427 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f60013a10 con 0x7f8f701309f0 2023-10-03T10:17:24.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.003+0000 7f8f77c9e700 1 -- 172.21.15.146:0/368785427 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f7011fb90 con 0x7f8f701309f0 2023-10-03T10:17:24.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.003+0000 7f8f667fc700 1 -- 172.21.15.146:0/368785427 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f60013b70 con 0x7f8f701309f0 2023-10-03T10:17:24.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.003+0000 7f8f667fc700 1 -- 172.21.15.146:0/368785427 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8f6003f920 con 0x7f8f701309f0 2023-10-03T10:17:24.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.004+0000 7f8f77c9e700 1 -- 172.21.15.146:0/368785427 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f7004f2a0 con 0x7f8f701309f0 2023-10-03T10:17:24.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.008+0000 7f8f667fc700 1 -- 172.21.15.146:0/368785427 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f60021020 con 0x7f8f701309f0 2023-10-03T10:17:24.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.192+0000 7f8f77c9e700 1 -- 172.21.15.146:0/368785427 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8f70071900 con 0x7f8f701309f0 2023-10-03T10:17:24.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.192+0000 7f8f667fc700 1 -- 172.21.15.146:0/368785427 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8f60017070 con 0x7f8f701309f0 2023-10-03T10:17:24.193 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:24.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.194+0000 7f8f77c9e700 1 -- 172.21.15.146:0/368785427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f701309f0 msgr2=0x7f8f701c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.194+0000 7f8f77c9e700 1 --2- 172.21.15.146:0/368785427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f701309f0 0x7f8f701c8c90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000e840 tx=0x7f8f6000eb50 comp rx=0 tx=0).stop 2023-10-03T10:17:24.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.194+0000 7f8f77c9e700 1 -- 172.21.15.146:0/368785427 shutdown_connections 2023-10-03T10:17:24.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.194+0000 7f8f77c9e700 1 --2- 172.21.15.146:0/368785427 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f70133ad0 0x7f8f701c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.194+0000 7f8f77c9e700 1 --2- 172.21.15.146:0/368785427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f701300a0 0x7f8f701c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.194+0000 7f8f77c9e700 1 --2- 172.21.15.146:0/368785427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f701309f0 0x7f8f701c8c90 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.194+0000 7f8f77c9e700 1 -- 172.21.15.146:0/368785427 >> 172.21.15.146:0/368785427 conn(0x7f8f70099c40 msgr2=0x7f8f700a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.194+0000 7f8f77c9e700 1 -- 172.21.15.146:0/368785427 shutdown_connections 2023-10-03T10:17:24.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.194+0000 7f8f77c9e700 1 -- 172.21.15.146:0/368785427 wait complete. 2023-10-03T10:17:24.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:24.796 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:24.873 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:24.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.924+0000 7fef0d0fc700 1 Processor -- start 2023-10-03T10:17:24.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.924+0000 7fef0d0fc700 1 -- start start 2023-10-03T10:17:24.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.925+0000 7fef0d0fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef08134140 0x7fef08138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.925+0000 7fef0d0fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fef08134570 0x7fef0813b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.925+0000 7fef0d0fc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef0809b110 con 0x7fef0809ad40 2023-10-03T10:17:24.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.925+0000 7fef0d0fc700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef080a3b60 con 0x7fef08134570 2023-10-03T10:17:24.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.925+0000 7fef0d0fc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef080a1a80 con 0x7fef08134140 2023-10-03T10:17:24.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.925+0000 7fef0659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef08134140 0x7fef08138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.925+0000 7fef0759e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fef08134570 0x7fef0813b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.925+0000 7fef0659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef08134140 0x7fef08138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37642/0 (socket says 172.21.15.146:37642) 2023-10-03T10:17:24.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.925+0000 7fef0659c700 1 -- 172.21.15.146:0/3418936433 learned_addr learned my addr 172.21.15.146:0/3418936433 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:24.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.925+0000 7fef0659c700 1 -- 172.21.15.146:0/3418936433 >> v2:172.21.15.146:3300/0 conn(0x7fef08134570 msgr2=0x7fef0813b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:24.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.925+0000 7fef0659c700 1 --2- 172.21.15.146:0/3418936433 >> v2:172.21.15.146:3300/0 conn(0x7fef08134570 0x7fef0813b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.925+0000 7fef0659c700 1 -- 172.21.15.146:0/3418936433 >> v1:172.21.15.146:6789/0 conn(0x7fef0809ad40 legacy=0x7fef08133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.925+0000 7fef05d9b700 1 -- 172.21.15.146:0/3418936433 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605105753 0 0) 0x7fef0809b110 con 0x7fef0809ad40 2023-10-03T10:17:24.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.925+0000 7fef0659c700 1 -- 172.21.15.146:0/3418936433 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef080a2fa0 con 0x7fef08134140 2023-10-03T10:17:24.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.925+0000 7fef0759e700 1 --2- 172.21.15.146:0/3418936433 >> v2:172.21.15.146:3300/0 conn(0x7fef08134570 0x7fef0813b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:24.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.925+0000 7fef0659c700 1 --2- 172.21.15.146:0/3418936433 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef08134140 0x7fef08138e80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7feefc0098f0 tx=0x7feefc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae3466b2abb5c6fa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:24.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.925+0000 7fef05d9b700 1 -- 172.21.15.146:0/3418936433 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc011830 con 0x7fef08134140 2023-10-03T10:17:24.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.926+0000 7fef05d9b700 1 -- 172.21.15.146:0/3418936433 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feefc011990 con 0x7fef08134140 2023-10-03T10:17:24.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.926+0000 7fef05d9b700 1 -- 172.21.15.146:0/3418936433 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc011d20 con 0x7fef08134140 2023-10-03T10:17:24.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.926+0000 7fef0d0fc700 1 -- 172.21.15.146:0/3418936433 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef08134140 msgr2=0x7fef08138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.926+0000 7fef0d0fc700 1 --2- 172.21.15.146:0/3418936433 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef08134140 0x7fef08138e80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7feefc0098f0 tx=0x7feefc009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:24.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.926+0000 7fef0d0fc700 1 -- 172.21.15.146:0/3418936433 shutdown_connections 2023-10-03T10:17:24.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.926+0000 7fef0d0fc700 1 --2- 172.21.15.146:0/3418936433 >> v2:172.21.15.146:3300/0 conn(0x7fef08134570 0x7fef0813b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.926+0000 7fef0d0fc700 1 --2- 172.21.15.146:0/3418936433 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef08134140 0x7fef08138e80 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.926+0000 7fef0d0fc700 1 -- 172.21.15.146:0/3418936433 >> 172.21.15.146:0/3418936433 conn(0x7fef08099c40 msgr2=0x7fef0806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.926+0000 7fef0d0fc700 1 -- 172.21.15.146:0/3418936433 shutdown_connections 2023-10-03T10:17:24.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.926+0000 7fef0d0fc700 1 -- 172.21.15.146:0/3418936433 wait complete. 2023-10-03T10:17:24.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.927+0000 7fef0d0fc700 1 Processor -- start 2023-10-03T10:17:24.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.927+0000 7fef0d0fc700 1 -- start start 2023-10-03T10:17:24.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.928+0000 7fef0d0fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef0809ad40 0x7fef0811c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.928+0000 7fef0d0fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef08134140 0x7fef0811ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.928+0000 7fef0d0fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef08134570 0x7fef0811d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.928+0000 7fef0d0fc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0811eaf0 con 0x7fef08134140 2023-10-03T10:17:24.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.928+0000 7fef0d0fc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef0811e740 con 0x7fef08134570 2023-10-03T10:17:24.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.928+0000 7fef0d0fc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef0809c7e0 con 0x7fef0809ad40 2023-10-03T10:17:24.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.928+0000 7fef0659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef08134140 0x7fef0811ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.928+0000 7fef06d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef0809ad40 0x7fef0811c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.928+0000 7fef06d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef0809ad40 0x7fef0811c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37644/0 (socket says 172.21.15.146:37644) 2023-10-03T10:17:24.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.928+0000 7fef0659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef08134140 0x7fef0811ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51856/0 (socket says 172.21.15.146:51856) 2023-10-03T10:17:24.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.928+0000 7fef06d9d700 1 -- 172.21.15.146:0/1219460036 learned_addr learned my addr 172.21.15.146:0/1219460036 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:24.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.928+0000 7fef0659c700 1 -- 172.21.15.146:0/1219460036 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef0809ad40 msgr2=0x7fef0811c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.928+0000 7fef0659c700 1 --2- 172.21.15.146:0/1219460036 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef0809ad40 0x7fef0811c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.928+0000 7fef0659c700 1 -- 172.21.15.146:0/1219460036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef08134570 msgr2=0x7fef0811d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.928+0000 7fef0659c700 1 --2- 172.21.15.146:0/1219460036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef08134570 0x7fef0811d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.928+0000 7fef0659c700 1 -- 172.21.15.146:0/1219460036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef00009a70 con 0x7fef08134140 2023-10-03T10:17:24.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.928+0000 7fef0659c700 1 --2- 172.21.15.146:0/1219460036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef08134140 0x7fef0811ce00 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7feefc016000 tx=0x7feefc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:24.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.928+0000 7feeef7fe700 1 -- 172.21.15.146:0/1219460036 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc004510 con 0x7fef08134140 2023-10-03T10:17:24.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.928+0000 7feeef7fe700 1 -- 172.21.15.146:0/1219460036 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feefc01e070 con 0x7fef08134140 2023-10-03T10:17:24.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.928+0000 7fef0d0fc700 1 -- 172.21.15.146:0/1219460036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feefc009550 con 0x7fef08134140 2023-10-03T10:17:24.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.928+0000 7feeef7fe700 1 -- 172.21.15.146:0/1219460036 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc0038c0 con 0x7fef08134140 2023-10-03T10:17:24.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.929+0000 7fef0d0fc700 1 -- 172.21.15.146:0/1219460036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0811d9f0 con 0x7fef08134140 2023-10-03T10:17:24.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.929+0000 7feeef7fe700 1 -- 172.21.15.146:0/1219460036 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feefc003a20 con 0x7fef08134140 2023-10-03T10:17:24.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.929+0000 7feeef7fe700 1 -- 172.21.15.146:0/1219460036 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feefc040590 con 0x7fef08134140 2023-10-03T10:17:24.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.930+0000 7fef0d0fc700 1 -- 172.21.15.146:0/1219460036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef0804f2a0 con 0x7fef08134140 2023-10-03T10:17:24.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:24.934+0000 7feeef7fe700 1 -- 172.21.15.146:0/1219460036 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feefc015070 con 0x7fef08134140 2023-10-03T10:17:24.942 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:25.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.003+0000 7fcd62598700 1 Processor -- start 2023-10-03T10:17:25.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.003+0000 7fcd62598700 1 -- start start 2023-10-03T10:17:25.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.003+0000 7fcd62598700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcd5c0a1550 0x7fcd5c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.004+0000 7fcd62598700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd5c139200 0x7fcd5c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.004+0000 7fcd62598700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd5c09e9d0 con 0x7fcd5c0a0a70 2023-10-03T10:17:25.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.004+0000 7fcd62598700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5c09dc00 con 0x7fcd5c0a1550 2023-10-03T10:17:25.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.004+0000 7fcd62598700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c09dec0 con 0x7fcd5c139200 2023-10-03T10:17:25.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.004+0000 7fcd5b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcd5c0a1550 0x7fcd5c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.004+0000 7fcd5bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcd5c0a0a70 0x7fcd5c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58432/0 (socket says 172.21.15.146:58432) 2023-10-03T10:17:25.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.004+0000 7fcd5bfff700 1 -- 172.21.15.146:0/2954503435 learned_addr learned my addr 172.21.15.146:0/2954503435 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:25.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.004+0000 7fcd60b35700 1 --2- 172.21.15.146:0/2954503435 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd5c139200 0x7fcd5c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.004+0000 7fcd5b7fe700 1 -- 172.21.15.146:0/2954503435 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd5c139200 msgr2=0x7fcd5c13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:25.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.004+0000 7fcd5b7fe700 1 --2- 172.21.15.146:0/2954503435 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd5c139200 0x7fcd5c13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.004+0000 7fcd5b7fe700 1 -- 172.21.15.146:0/2954503435 >> v1:172.21.15.146:6789/0 conn(0x7fcd5c0a0a70 legacy=0x7fcd5c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.004+0000 7fcd5b7fe700 1 -- 172.21.15.146:0/2954503435 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5c09e6a0 con 0x7fcd5c0a1550 2023-10-03T10:17:25.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.004+0000 7fcd5b7fe700 1 --2- 172.21.15.146:0/2954503435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c0a1550 0x7fcd5c138cc0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009840 tx=0x7fcd50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1a01a0245d0b21 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.004+0000 7fcd5affd700 1 -- 172.21.15.146:0/2954503435 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd50011830 con 0x7fcd5c0a1550 2023-10-03T10:17:25.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.004+0000 7fcd5affd700 1 -- 172.21.15.146:0/2954503435 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd50011990 con 0x7fcd5c0a1550 2023-10-03T10:17:25.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.004+0000 7fcd5affd700 1 -- 172.21.15.146:0/2954503435 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd50011d20 con 0x7fcd5c0a1550 2023-10-03T10:17:25.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.005+0000 7fcd62598700 1 -- 172.21.15.146:0/2954503435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c0a1550 msgr2=0x7fcd5c138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.005+0000 7fcd62598700 1 --2- 172.21.15.146:0/2954503435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c0a1550 0x7fcd5c138cc0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009840 tx=0x7fcd50009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:25.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.005+0000 7fcd62598700 1 -- 172.21.15.146:0/2954503435 shutdown_connections 2023-10-03T10:17:25.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.005+0000 7fcd62598700 1 --2- 172.21.15.146:0/2954503435 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd5c139200 0x7fcd5c13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.005+0000 7fcd62598700 1 --2- 172.21.15.146:0/2954503435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c0a1550 0x7fcd5c138cc0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.005+0000 7fcd62598700 1 -- 172.21.15.146:0/2954503435 >> 172.21.15.146:0/2954503435 conn(0x7fcd5c0a6610 msgr2=0x7fcd5c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.005+0000 7fcd62598700 1 -- 172.21.15.146:0/2954503435 shutdown_connections 2023-10-03T10:17:25.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.005+0000 7fcd62598700 1 -- 172.21.15.146:0/2954503435 wait complete. 2023-10-03T10:17:25.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.006+0000 7fcd62598700 1 Processor -- start 2023-10-03T10:17:25.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.007+0000 7fcd62598700 1 -- start start 2023-10-03T10:17:25.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.007+0000 7fcd62598700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd5c0a0a70 0x7fcd5c11e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.007+0000 7fcd62598700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c0a1550 0x7fcd5c11ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.007+0000 7fcd62598700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd5c139200 0x7fcd5c11f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.007+0000 7fcd62598700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c121a90 con 0x7fcd5c0a1550 2023-10-03T10:17:25.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.007+0000 7fcd62598700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c120410 con 0x7fcd5c139200 2023-10-03T10:17:25.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.007+0000 7fcd62598700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c0a5220 con 0x7fcd5c0a0a70 2023-10-03T10:17:25.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.007+0000 7fcd5b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c0a1550 0x7fcd5c11ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.007+0000 7fcd5bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd5c0a0a70 0x7fcd5c11e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.007+0000 7fcd5b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c0a1550 0x7fcd5c11ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51868/0 (socket says 172.21.15.146:51868) 2023-10-03T10:17:25.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.007+0000 7fcd5b7fe700 1 -- 172.21.15.146:0/1984661440 learned_addr learned my addr 172.21.15.146:0/1984661440 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:25.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.007+0000 7fcd60b35700 1 --2- 172.21.15.146:0/1984661440 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd5c139200 0x7fcd5c11f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.008+0000 7fcd5bfff700 1 -- 172.21.15.146:0/1984661440 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd5c139200 msgr2=0x7fcd5c11f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.008+0000 7fcd5bfff700 1 --2- 172.21.15.146:0/1984661440 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd5c139200 0x7fcd5c11f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.008+0000 7fcd5bfff700 1 -- 172.21.15.146:0/1984661440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c0a1550 msgr2=0x7fcd5c11ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.008+0000 7fcd5bfff700 1 --2- 172.21.15.146:0/1984661440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c0a1550 0x7fcd5c11ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.008+0000 7fcd5bfff700 1 -- 172.21.15.146:0/1984661440 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd500094a0 con 0x7fcd5c0a0a70 2023-10-03T10:17:25.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.008+0000 7fcd5bfff700 1 --2- 172.21.15.146:0/1984661440 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd5c0a0a70 0x7fcd5c11e8a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00c500 tx=0x7fcd4c00c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.008+0000 7fcd58ff9700 1 -- 172.21.15.146:0/1984661440 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c005d70 con 0x7fcd5c0a0a70 2023-10-03T10:17:25.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.008+0000 7fcd58ff9700 1 -- 172.21.15.146:0/1984661440 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c0070d0 con 0x7fcd5c0a0a70 2023-10-03T10:17:25.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.008+0000 7fcd62598700 1 -- 172.21.15.146:0/1984661440 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5c0a03e0 con 0x7fcd5c0a0a70 2023-10-03T10:17:25.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.008+0000 7fcd58ff9700 1 -- 172.21.15.146:0/1984661440 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c007440 con 0x7fcd5c0a0a70 2023-10-03T10:17:25.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.008+0000 7fcd62598700 1 -- 172.21.15.146:0/1984661440 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5c122820 con 0x7fcd5c0a0a70 2023-10-03T10:17:25.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.009+0000 7fcd58ff9700 1 -- 172.21.15.146:0/1984661440 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd4c0075a0 con 0x7fcd5c0a0a70 2023-10-03T10:17:25.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.009+0000 7fcd58ff9700 1 -- 172.21.15.146:0/1984661440 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcd4c03ea40 con 0x7fcd5c0a0a70 2023-10-03T10:17:25.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.009+0000 7fcd62598700 1 -- 172.21.15.146:0/1984661440 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5c121e30 con 0x7fcd5c0a0a70 2023-10-03T10:17:25.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.018+0000 7fcd58ff9700 1 -- 172.21.15.146:0/1984661440 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd4c019d20 con 0x7fcd5c0a0a70 2023-10-03T10:17:25.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.072+0000 7fe17a9f4700 1 Processor -- start 2023-10-03T10:17:25.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.072+0000 7fe17a9f4700 1 -- start start 2023-10-03T10:17:25.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.073+0000 7fe17a9f4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe17406a770 0x7fe17406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.073+0000 7fe17a9f4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe17409dec0 0x7fe17406b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.073+0000 7fe17a9f4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17406b5c0 con 0x7fe174131a00 2023-10-03T10:17:25.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.073+0000 7fe17a9f4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17406e900 con 0x7fe17406a770 2023-10-03T10:17:25.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.073+0000 7fe17a9f4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe17409d180 con 0x7fe17409dec0 2023-10-03T10:17:25.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.073+0000 7fe173fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe17406a770 0x7fe17406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.073+0000 7fe1737fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe17409dec0 0x7fe17406b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.073+0000 7fe178f91700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe174131a00 0x7fe174131e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58434/0 (socket says 172.21.15.146:58434) 2023-10-03T10:17:25.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.073+0000 7fe178f91700 1 -- 172.21.15.146:0/2832473647 learned_addr learned my addr 172.21.15.146:0/2832473647 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:25.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.074+0000 7fe173fff700 1 -- 172.21.15.146:0/2832473647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe17409dec0 msgr2=0x7fe17406b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:25.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.074+0000 7fe173fff700 1 --2- 172.21.15.146:0/2832473647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe17409dec0 0x7fe17406b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.074+0000 7fe173fff700 1 -- 172.21.15.146:0/2832473647 >> v1:172.21.15.146:6789/0 conn(0x7fe174131a00 legacy=0x7fe174131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.074+0000 7fe173fff700 1 -- 172.21.15.146:0/2832473647 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17409e780 con 0x7fe17406a770 2023-10-03T10:17:25.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.074+0000 7fe172ffd700 1 -- 172.21.15.146:0/2832473647 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369083034 0 0) 0x7fe17406b5c0 con 0x7fe174131a00 2023-10-03T10:17:25.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.074+0000 7fe173fff700 1 --2- 172.21.15.146:0/2832473647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe17406a770 0x7fe17406ab40 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fe164009840 tx=0x7fe164009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f48d4cfcff976e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.074+0000 7fe172ffd700 1 -- 172.21.15.146:0/2832473647 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164011830 con 0x7fe17406a770 2023-10-03T10:17:25.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.074+0000 7fe172ffd700 1 -- 172.21.15.146:0/2832473647 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe164011990 con 0x7fe17406a770 2023-10-03T10:17:25.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.074+0000 7fe172ffd700 1 -- 172.21.15.146:0/2832473647 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164011d20 con 0x7fe17406a770 2023-10-03T10:17:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.075+0000 7fe17a9f4700 1 -- 172.21.15.146:0/2832473647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe17406a770 msgr2=0x7fe17406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.075+0000 7fe17a9f4700 1 --2- 172.21.15.146:0/2832473647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe17406a770 0x7fe17406ab40 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fe164009840 tx=0x7fe164009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.075+0000 7fe17a9f4700 1 -- 172.21.15.146:0/2832473647 shutdown_connections 2023-10-03T10:17:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.075+0000 7fe17a9f4700 1 --2- 172.21.15.146:0/2832473647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe17406a770 0x7fe17406ab40 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.075+0000 7fe17a9f4700 1 --2- 172.21.15.146:0/2832473647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe17409dec0 0x7fe17406b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.075+0000 7fe17a9f4700 1 -- 172.21.15.146:0/2832473647 >> 172.21.15.146:0/2832473647 conn(0x7fe174099c40 msgr2=0x7fe1740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.075+0000 7fe17a9f4700 1 -- 172.21.15.146:0/2832473647 shutdown_connections 2023-10-03T10:17:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.075+0000 7fe17a9f4700 1 -- 172.21.15.146:0/2832473647 wait complete. 2023-10-03T10:17:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.076+0000 7fe17a9f4700 1 Processor -- start 2023-10-03T10:17:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.076+0000 7fe17a9f4700 1 -- start start 2023-10-03T10:17:25.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.076+0000 7fe17a9f4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe17406a770 0x7fe174119fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.076+0000 7fe17a9f4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe17409dec0 0x7fe17411a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.076+0000 7fe17a9f4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe174131a00 0x7fe17411aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.076+0000 7fe17a9f4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17411bbc0 con 0x7fe17409dec0 2023-10-03T10:17:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.076+0000 7fe17a9f4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17411ce10 con 0x7fe174131a00 2023-10-03T10:17:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.076+0000 7fe17a9f4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe17411c1a0 con 0x7fe17406a770 2023-10-03T10:17:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.077+0000 7fe1737fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe17409dec0 0x7fe17411a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.077+0000 7fe1737fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe17409dec0 0x7fe17411a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51890/0 (socket says 172.21.15.146:51890) 2023-10-03T10:17:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.077+0000 7fe1737fe700 1 -- 172.21.15.146:0/250705572 learned_addr learned my addr 172.21.15.146:0/250705572 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.077+0000 7fe173fff700 1 --2- 172.21.15.146:0/250705572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe17406a770 0x7fe174119fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.077+0000 7fe178f91700 1 --2- 172.21.15.146:0/250705572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe174131a00 0x7fe17411aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.077+0000 7fe1737fe700 1 -- 172.21.15.146:0/250705572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe17406a770 msgr2=0x7fe174119fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.077+0000 7fe1737fe700 1 --2- 172.21.15.146:0/250705572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe17406a770 0x7fe174119fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.077+0000 7fe1737fe700 1 -- 172.21.15.146:0/250705572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe174131a00 msgr2=0x7fe17411aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.077+0000 7fe1737fe700 1 --2- 172.21.15.146:0/250705572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe174131a00 0x7fe17411aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.077+0000 7fe1737fe700 1 -- 172.21.15.146:0/250705572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1640094a0 con 0x7fe17409dec0 2023-10-03T10:17:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.077+0000 7fe1737fe700 1 --2- 172.21.15.146:0/250705572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe17409dec0 0x7fe17411a4f0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fe16800e9e0 tx=0x7fe16800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.077+0000 7fe170ff9700 1 -- 172.21.15.146:0/250705572 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe168009710 con 0x7fe17409dec0 2023-10-03T10:17:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.077+0000 7fe170ff9700 1 -- 172.21.15.146:0/250705572 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16800ee80 con 0x7fe17409dec0 2023-10-03T10:17:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.077+0000 7fe17a9f4700 1 -- 172.21.15.146:0/250705572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17411d7f0 con 0x7fe17409dec0 2023-10-03T10:17:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.077+0000 7fe170ff9700 1 -- 172.21.15.146:0/250705572 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16800ca50 con 0x7fe17409dec0 2023-10-03T10:17:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.078+0000 7fe170ff9700 1 -- 172.21.15.146:0/250705572 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe16800cbb0 con 0x7fe17409dec0 2023-10-03T10:17:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.078+0000 7fe17a9f4700 1 -- 172.21.15.146:0/250705572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe174071ce0 con 0x7fe17409dec0 2023-10-03T10:17:25.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.078+0000 7fe170ff9700 1 -- 172.21.15.146:0/250705572 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe168012dc0 con 0x7fe17409dec0 2023-10-03T10:17:25.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.079+0000 7fe17a9f4700 1 -- 172.21.15.146:0/250705572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe174072220 con 0x7fe17409dec0 2023-10-03T10:17:25.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.088+0000 7fe170ff9700 1 -- 172.21.15.146:0/250705572 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe168017020 con 0x7fe17409dec0 2023-10-03T10:17:25.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.141+0000 7fef0d0fc700 1 -- 172.21.15.146:0/1219460036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fef080a5880 con 0x7fef08134140 2023-10-03T10:17:25.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.141+0000 7feeef7fe700 1 -- 172.21.15.146:0/1219460036 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feefc035070 con 0x7fef08134140 2023-10-03T10:17:25.142 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:25.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.144+0000 7fef0d0fc700 1 -- 172.21.15.146:0/1219460036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef08134140 msgr2=0x7fef0811ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.144+0000 7fef0d0fc700 1 --2- 172.21.15.146:0/1219460036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef08134140 0x7fef0811ce00 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7feefc016000 tx=0x7feefc004750 comp rx=0 tx=0).stop 2023-10-03T10:17:25.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.144+0000 7fef0d0fc700 1 -- 172.21.15.146:0/1219460036 shutdown_connections 2023-10-03T10:17:25.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.144+0000 7fef0d0fc700 1 --2- 172.21.15.146:0/1219460036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef08134570 0x7fef0811d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.144+0000 7fef0d0fc700 1 --2- 172.21.15.146:0/1219460036 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef0809ad40 0x7fef0811c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.144+0000 7fef0d0fc700 1 --2- 172.21.15.146:0/1219460036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef08134140 0x7fef0811ce00 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.144+0000 7fef0d0fc700 1 -- 172.21.15.146:0/1219460036 >> 172.21.15.146:0/1219460036 conn(0x7fef08099c40 msgr2=0x7fef0813af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.144+0000 7fef0d0fc700 1 -- 172.21.15.146:0/1219460036 shutdown_connections 2023-10-03T10:17:25.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.144+0000 7fef0d0fc700 1 -- 172.21.15.146:0/1219460036 wait complete. 2023-10-03T10:17:25.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:25.208 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:25.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.215+0000 7fcd62598700 1 -- 172.21.15.146:0/1984661440 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcd5c04f2a0 con 0x7fcd5c0a0a70 2023-10-03T10:17:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.215+0000 7fcd58ff9700 1 -- 172.21.15.146:0/1984661440 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcd4c017020 con 0x7fcd5c0a0a70 2023-10-03T10:17:25.216 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:25.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.217+0000 7fcd62598700 1 -- 172.21.15.146:0/1984661440 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd5c0a0a70 msgr2=0x7fcd5c11e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.217+0000 7fcd62598700 1 --2- 172.21.15.146:0/1984661440 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd5c0a0a70 0x7fcd5c11e8a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00c500 tx=0x7fcd4c00c810 comp rx=0 tx=0).stop 2023-10-03T10:17:25.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.217+0000 7fcd62598700 1 -- 172.21.15.146:0/1984661440 shutdown_connections 2023-10-03T10:17:25.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.217+0000 7fcd62598700 1 --2- 172.21.15.146:0/1984661440 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd5c139200 0x7fcd5c11f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.217+0000 7fcd62598700 1 --2- 172.21.15.146:0/1984661440 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcd5c0a0a70 0x7fcd5c11e8a0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.218+0000 7fcd62598700 1 --2- 172.21.15.146:0/1984661440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd5c0a1550 0x7fcd5c11ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.218+0000 7fcd62598700 1 -- 172.21.15.146:0/1984661440 >> 172.21.15.146:0/1984661440 conn(0x7fcd5c0a6610 msgr2=0x7fcd5c0a5980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.218+0000 7fcd62598700 1 -- 172.21.15.146:0/1984661440 shutdown_connections 2023-10-03T10:17:25.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.218+0000 7fcd62598700 1 -- 172.21.15.146:0/1984661440 wait complete. 2023-10-03T10:17:25.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:25.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.283+0000 7fe17a9f4700 1 -- 172.21.15.146:0/250705572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe17404f2a0 con 0x7fe17409dec0 2023-10-03T10:17:25.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.283+0000 7fe170ff9700 1 -- 172.21.15.146:0/250705572 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe1680102b0 con 0x7fe17409dec0 2023-10-03T10:17:25.284 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:25.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.285+0000 7fe17a9f4700 1 -- 172.21.15.146:0/250705572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe17409dec0 msgr2=0x7fe17411a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.285+0000 7fe17a9f4700 1 --2- 172.21.15.146:0/250705572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe17409dec0 0x7fe17411a4f0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fe16800e9e0 tx=0x7fe16800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.285+0000 7fe17a9f4700 1 -- 172.21.15.146:0/250705572 shutdown_connections 2023-10-03T10:17:25.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.285+0000 7fe17a9f4700 1 --2- 172.21.15.146:0/250705572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe174131a00 0x7fe17411aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.285+0000 7fe17a9f4700 1 --2- 172.21.15.146:0/250705572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe17406a770 0x7fe174119fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.285+0000 7fe17a9f4700 1 --2- 172.21.15.146:0/250705572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe17409dec0 0x7fe17411a4f0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.285+0000 7fe17a9f4700 1 -- 172.21.15.146:0/250705572 >> 172.21.15.146:0/250705572 conn(0x7fe174099c40 msgr2=0x7fe17412ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.285+0000 7fe17a9f4700 1 -- 172.21.15.146:0/250705572 shutdown_connections 2023-10-03T10:17:25.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.285+0000 7fe17a9f4700 1 -- 172.21.15.146:0/250705572 wait complete. 2023-10-03T10:17:25.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:25.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.331+0000 7f98ff997700 1 Processor -- start 2023-10-03T10:17:25.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.332+0000 7f98ff997700 1 -- start start 2023-10-03T10:17:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.332+0000 7f98ff997700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f809e340 0x7f98f81359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.332+0000 7f98ff997700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f98f8135f20 0x7f98f8138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.332+0000 7f98ff997700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f809aaa0 con 0x7f98f809d860 2023-10-03T10:17:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.332+0000 7f98ff997700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f809e730 con 0x7f98f8135f20 2023-10-03T10:17:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.332+0000 7f98ff997700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f809f870 con 0x7f98f809e340 2023-10-03T10:17:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.332+0000 7f98fdf34700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f98f8135f20 0x7f98f8138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.332+0000 7f98fcf32700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f809e340 0x7f98f81359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.332+0000 7f98fd733700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f98f809d860 0x7f98f809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58436/0 (socket says 172.21.15.146:58436) 2023-10-03T10:17:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.332+0000 7f98fd733700 1 -- 172.21.15.146:0/2729188852 learned_addr learned my addr 172.21.15.146:0/2729188852 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.333+0000 7f98fcf32700 1 -- 172.21.15.146:0/2729188852 >> v2:172.21.15.146:3300/0 conn(0x7f98f8135f20 msgr2=0x7f98f8138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.333+0000 7f98fcf32700 1 --2- 172.21.15.146:0/2729188852 >> v2:172.21.15.146:3300/0 conn(0x7f98f8135f20 0x7f98f8138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.333+0000 7f98fcf32700 1 -- 172.21.15.146:0/2729188852 >> v1:172.21.15.146:6789/0 conn(0x7f98f809d860 legacy=0x7f98f809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.333+0000 7f98effff700 1 -- 172.21.15.146:0/2729188852 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767891654 0 0) 0x7f98f809aaa0 con 0x7f98f809d860 2023-10-03T10:17:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.333+0000 7f98fcf32700 1 -- 172.21.15.146:0/2729188852 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f809b360 con 0x7f98f809e340 2023-10-03T10:17:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.333+0000 7f98fdf34700 1 --2- 172.21.15.146:0/2729188852 >> v2:172.21.15.146:3300/0 conn(0x7f98f8135f20 0x7f98f8138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.333+0000 7f98fcf32700 1 --2- 172.21.15.146:0/2729188852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f809e340 0x7f98f81359e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f98f4009840 tx=0x7f98f4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41b94fe2d37348fc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.333+0000 7f98effff700 1 -- 172.21.15.146:0/2729188852 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f4011830 con 0x7f98f809e340 2023-10-03T10:17:25.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.333+0000 7f98effff700 1 -- 172.21.15.146:0/2729188852 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f4011990 con 0x7f98f809e340 2023-10-03T10:17:25.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.333+0000 7f98effff700 1 -- 172.21.15.146:0/2729188852 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f4011d20 con 0x7f98f809e340 2023-10-03T10:17:25.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.333+0000 7f98ff997700 1 -- 172.21.15.146:0/2729188852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f809e340 msgr2=0x7f98f81359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.333+0000 7f98ff997700 1 --2- 172.21.15.146:0/2729188852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f809e340 0x7f98f81359e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f98f4009840 tx=0x7f98f4009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:25.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.333+0000 7f98ff997700 1 -- 172.21.15.146:0/2729188852 shutdown_connections 2023-10-03T10:17:25.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.333+0000 7f98ff997700 1 --2- 172.21.15.146:0/2729188852 >> v2:172.21.15.146:3300/0 conn(0x7f98f8135f20 0x7f98f8138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.333+0000 7f98ff997700 1 --2- 172.21.15.146:0/2729188852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f809e340 0x7f98f81359e0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.333+0000 7f98ff997700 1 -- 172.21.15.146:0/2729188852 >> 172.21.15.146:0/2729188852 conn(0x7f98f8099c40 msgr2=0x7f98f80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.333+0000 7f98ff997700 1 -- 172.21.15.146:0/2729188852 shutdown_connections 2023-10-03T10:17:25.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.334+0000 7f98ff997700 1 -- 172.21.15.146:0/2729188852 wait complete. 2023-10-03T10:17:25.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.334+0000 7f98ff997700 1 Processor -- start 2023-10-03T10:17:25.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.334+0000 7f98ff997700 1 -- start start 2023-10-03T10:17:25.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.335+0000 7f98ff997700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98f809d860 0x7f98f811c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.335+0000 7f98ff997700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f809e340 0x7f98f811c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.335+0000 7f98ff997700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f98f8135f20 0x7f98f811cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.335+0000 7f98ff997700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f811e470 con 0x7f98f809d860 2023-10-03T10:17:25.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.335+0000 7f98ff997700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f809c940 con 0x7f98f809e340 2023-10-03T10:17:25.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.335+0000 7f98ff997700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98f8072720 con 0x7f98f8135f20 2023-10-03T10:17:25.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.335+0000 7f98fd733700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98f809d860 0x7f98f811c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.335+0000 7f98fcf32700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f809e340 0x7f98f811c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.335+0000 7f98fdf34700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f98f8135f20 0x7f98f811cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.335+0000 7f98fcf32700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f809e340 0x7f98f811c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45136/0 (socket says 172.21.15.146:45136) 2023-10-03T10:17:25.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.335+0000 7f98fcf32700 1 -- 172.21.15.146:0/1142147278 learned_addr learned my addr 172.21.15.146:0/1142147278 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:25.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.335+0000 7f98fd733700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98f809d860 0x7f98f811c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51902/0 (socket says 172.21.15.146:51902) 2023-10-03T10:17:25.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.335+0000 7f98fcf32700 1 -- 172.21.15.146:0/1142147278 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f98f8135f20 msgr2=0x7f98f811cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.335+0000 7f98fcf32700 1 --2- 172.21.15.146:0/1142147278 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f98f8135f20 0x7f98f811cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.335+0000 7f98fcf32700 1 -- 172.21.15.146:0/1142147278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98f809d860 msgr2=0x7f98f811c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.335+0000 7f98fcf32700 1 --2- 172.21.15.146:0/1142147278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98f809d860 0x7f98f811c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.335+0000 7f98fcf32700 1 -- 172.21.15.146:0/1142147278 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f000bc80 con 0x7f98f809e340 2023-10-03T10:17:25.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.335+0000 7f98fcf32700 1 --2- 172.21.15.146:0/1142147278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f809e340 0x7f98f811c750 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f98f40090b0 tx=0x7f98f4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.335+0000 7f98edffb700 1 -- 172.21.15.146:0/1142147278 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f4004340 con 0x7f98f809e340 2023-10-03T10:17:25.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.335+0000 7f98edffb700 1 -- 172.21.15.146:0/1142147278 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f401f070 con 0x7f98f809e340 2023-10-03T10:17:25.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.335+0000 7f98ff997700 1 -- 172.21.15.146:0/1142147278 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f40094a0 con 0x7f98f809e340 2023-10-03T10:17:25.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.335+0000 7f98edffb700 1 -- 172.21.15.146:0/1142147278 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f40036a0 con 0x7f98f809e340 2023-10-03T10:17:25.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.336+0000 7f98ff997700 1 -- 172.21.15.146:0/1142147278 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f811e610 con 0x7f98f809e340 2023-10-03T10:17:25.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.336+0000 7f98edffb700 1 -- 172.21.15.146:0/1142147278 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f98f4021030 con 0x7f98f809e340 2023-10-03T10:17:25.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.336+0000 7f98edffb700 1 -- 172.21.15.146:0/1142147278 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f98f40407a0 con 0x7f98f809e340 2023-10-03T10:17:25.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.337+0000 7f98ff997700 1 -- 172.21.15.146:0/1142147278 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f804f2a0 con 0x7f98f809e340 2023-10-03T10:17:25.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.341+0000 7f98edffb700 1 -- 172.21.15.146:0/1142147278 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f98f4003800 con 0x7f98f809e340 2023-10-03T10:17:25.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.525+0000 7f98ff997700 1 -- 172.21.15.146:0/1142147278 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f98f811f660 con 0x7f98f809e340 2023-10-03T10:17:25.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.525+0000 7f98edffb700 1 -- 172.21.15.146:0/1142147278 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f98f40193b0 con 0x7f98f809e340 2023-10-03T10:17:25.526 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:25.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.527+0000 7f98ff997700 1 -- 172.21.15.146:0/1142147278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f809e340 msgr2=0x7f98f811c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.527+0000 7f98ff997700 1 --2- 172.21.15.146:0/1142147278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f809e340 0x7f98f811c750 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f98f40090b0 tx=0x7f98f4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:25.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.528+0000 7f98ff997700 1 -- 172.21.15.146:0/1142147278 shutdown_connections 2023-10-03T10:17:25.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.528+0000 7f98ff997700 1 --2- 172.21.15.146:0/1142147278 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f98f8135f20 0x7f98f811cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.528+0000 7f98ff997700 1 --2- 172.21.15.146:0/1142147278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98f809d860 0x7f98f811c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.528+0000 7f98ff997700 1 --2- 172.21.15.146:0/1142147278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f98f809e340 0x7f98f811c750 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.528+0000 7f98ff997700 1 -- 172.21.15.146:0/1142147278 >> 172.21.15.146:0/1142147278 conn(0x7f98f8099c40 msgr2=0x7f98f806ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.528+0000 7f98ff997700 1 -- 172.21.15.146:0/1142147278 shutdown_connections 2023-10-03T10:17:25.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:25.528+0000 7f98ff997700 1 -- 172.21.15.146:0/1142147278 wait complete. 2023-10-03T10:17:25.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:26.160 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:26.232 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:26.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.289+0000 7f889e744700 1 Processor -- start 2023-10-03T10:17:26.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.289+0000 7f889e744700 1 -- start start 2023-10-03T10:17:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.290+0000 7f889e744700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f889809e340 0x7f88981359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.290+0000 7f889e744700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8898135f20 0x7f8898138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.290+0000 7f889e744700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889809aaa0 con 0x7f889809d860 2023-10-03T10:17:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.290+0000 7f889e744700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889809e730 con 0x7f8898135f20 2023-10-03T10:17:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.290+0000 7f889e744700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f889809f870 con 0x7f889809e340 2023-10-03T10:17:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.290+0000 7f88977fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f889809e340 0x7f88981359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.290+0000 7f8897fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f889809d860 0x7f889809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58450/0 (socket says 172.21.15.146:58450) 2023-10-03T10:17:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.290+0000 7f8897fff700 1 -- 172.21.15.146:0/2946501147 learned_addr learned my addr 172.21.15.146:0/2946501147 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.290+0000 7f889cce1700 1 --2- 172.21.15.146:0/2946501147 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8898135f20 0x7f8898138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.290+0000 7f8896ffd700 1 -- 172.21.15.146:0/2946501147 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776875020 0 0) 0x7f889809aaa0 con 0x7f889809d860 2023-10-03T10:17:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.290+0000 7f8896ffd700 1 -- 172.21.15.146:0/2946501147 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88800035b0 con 0x7f889809d860 2023-10-03T10:17:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.290+0000 7f889cce1700 1 -- 172.21.15.146:0/2946501147 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f889809e340 msgr2=0x7f88981359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.290+0000 7f889cce1700 1 --2- 172.21.15.146:0/2946501147 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f889809e340 0x7f88981359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.290+0000 7f889cce1700 1 -- 172.21.15.146:0/2946501147 >> v1:172.21.15.146:6789/0 conn(0x7f889809d860 legacy=0x7f889809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.290+0000 7f889cce1700 1 -- 172.21.15.146:0/2946501147 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889809b360 con 0x7f8898135f20 2023-10-03T10:17:26.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.290+0000 7f88977fe700 1 --2- 172.21.15.146:0/2946501147 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f889809e340 0x7f88981359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:26.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.291+0000 7f889cce1700 1 --2- 172.21.15.146:0/2946501147 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8898135f20 0x7f8898138300 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8890009dc0 tx=0x7f889000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9882b410f7ef27e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.291+0000 7f8896ffd700 1 -- 172.21.15.146:0/2946501147 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889000e070 con 0x7f8898135f20 2023-10-03T10:17:26.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.291+0000 7f8896ffd700 1 -- 172.21.15.146:0/2946501147 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889000bb20 con 0x7f8898135f20 2023-10-03T10:17:26.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.291+0000 7f8896ffd700 1 -- 172.21.15.146:0/2946501147 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890012430 con 0x7f8898135f20 2023-10-03T10:17:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.291+0000 7f889e744700 1 -- 172.21.15.146:0/2946501147 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8898135f20 msgr2=0x7f8898138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.291+0000 7f889e744700 1 --2- 172.21.15.146:0/2946501147 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8898135f20 0x7f8898138300 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8890009dc0 tx=0x7f889000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.291+0000 7f889e744700 1 -- 172.21.15.146:0/2946501147 shutdown_connections 2023-10-03T10:17:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.291+0000 7f889e744700 1 --2- 172.21.15.146:0/2946501147 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8898135f20 0x7f8898138300 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.291+0000 7f889e744700 1 --2- 172.21.15.146:0/2946501147 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f889809e340 0x7f88981359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.291+0000 7f889e744700 1 -- 172.21.15.146:0/2946501147 >> 172.21.15.146:0/2946501147 conn(0x7f8898099c40 msgr2=0x7f88980a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.291+0000 7f889e744700 1 -- 172.21.15.146:0/2946501147 shutdown_connections 2023-10-03T10:17:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.291+0000 7f889e744700 1 -- 172.21.15.146:0/2946501147 wait complete. 2023-10-03T10:17:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.292+0000 7f889e744700 1 Processor -- start 2023-10-03T10:17:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.292+0000 7f889e744700 1 -- start start 2023-10-03T10:17:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.293+0000 7f889e744700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f889809d860 0x7f88981c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.293+0000 7f889e744700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f889809e340 0x7f88981c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.293+0000 7f889e744700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8898135f20 0x7f889806e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.293+0000 7f889e744700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8898070730 con 0x7f8898135f20 2023-10-03T10:17:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.293+0000 7f889e744700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8898070540 con 0x7f889809e340 2023-10-03T10:17:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.293+0000 7f889e744700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8898121ad0 con 0x7f889809d860 2023-10-03T10:17:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.293+0000 7f8897fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f889809d860 0x7f88981c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.293+0000 7f889cce1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8898135f20 0x7f889806e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.293+0000 7f8897fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f889809d860 0x7f88981c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37708/0 (socket says 172.21.15.146:37708) 2023-10-03T10:17:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.293+0000 7f8897fff700 1 -- 172.21.15.146:0/462377750 learned_addr learned my addr 172.21.15.146:0/462377750 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.293+0000 7f88977fe700 1 --2- 172.21.15.146:0/462377750 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f889809e340 0x7f88981c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.293+0000 7f8897fff700 1 -- 172.21.15.146:0/462377750 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f889809e340 msgr2=0x7f88981c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.293+0000 7f8897fff700 1 --2- 172.21.15.146:0/462377750 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f889809e340 0x7f88981c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.293+0000 7f8897fff700 1 -- 172.21.15.146:0/462377750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8898135f20 msgr2=0x7f889806e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.293+0000 7f8897fff700 1 --2- 172.21.15.146:0/462377750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8898135f20 0x7f889806e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.293+0000 7f8897fff700 1 -- 172.21.15.146:0/462377750 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c0094a0 con 0x7f889809d860 2023-10-03T10:17:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.293+0000 7f8897fff700 1 --2- 172.21.15.146:0/462377750 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f889809d860 0x7f88981c8470 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8888001eb0 tx=0x7f888800c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.294+0000 7f8894ff9700 1 -- 172.21.15.146:0/462377750 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8888005d70 con 0x7f889809d860 2023-10-03T10:17:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.294+0000 7f8894ff9700 1 -- 172.21.15.146:0/462377750 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88880070d0 con 0x7f889809d860 2023-10-03T10:17:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.294+0000 7f889e744700 1 -- 172.21.15.146:0/462377750 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8890009a70 con 0x7f889809d860 2023-10-03T10:17:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.294+0000 7f8894ff9700 1 -- 172.21.15.146:0/462377750 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8888007440 con 0x7f889809d860 2023-10-03T10:17:26.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.294+0000 7f889e744700 1 -- 172.21.15.146:0/462377750 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8898071430 con 0x7f889809d860 2023-10-03T10:17:26.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.295+0000 7f889e744700 1 -- 172.21.15.146:0/462377750 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889809c8b0 con 0x7f889809d860 2023-10-03T10:17:26.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.295+0000 7f8894ff9700 1 -- 172.21.15.146:0/462377750 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88880075a0 con 0x7f889809d860 2023-10-03T10:17:26.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.295+0000 7f8894ff9700 1 -- 172.21.15.146:0/462377750 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f888803ef20 con 0x7f889809d860 2023-10-03T10:17:26.298 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:26.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.299+0000 7f8894ff9700 1 -- 172.21.15.146:0/462377750 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8888019b40 con 0x7f889809d860 2023-10-03T10:17:26.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.361+0000 7fa39c1a8700 1 Processor -- start 2023-10-03T10:17:26.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.362+0000 7fa39c1a8700 1 -- start start 2023-10-03T10:17:26.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.362+0000 7fa39c1a8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3940a0a70 0x7fa3940a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.362+0000 7fa39c1a8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa394134120 0x7fa39413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.362+0000 7fa39c1a8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39409dc00 con 0x7fa3940a1380 2023-10-03T10:17:26.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.362+0000 7fa39c1a8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39409ea90 con 0x7fa394134120 2023-10-03T10:17:26.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.362+0000 7fa39c1a8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa39409dec0 con 0x7fa3940a0a70 2023-10-03T10:17:26.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.362+0000 7fa39a745700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa394134120 0x7fa39413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.362+0000 7fa39a745700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa394134120 0x7fa39413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45156/0 (socket says 172.21.15.146:45156) 2023-10-03T10:17:26.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.362+0000 7fa39a745700 1 -- 172.21.15.146:0/642134658 learned_addr learned my addr 172.21.15.146:0/642134658 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:26.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.362+0000 7fa399f44700 1 --2- 172.21.15.146:0/642134658 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3940a0a70 0x7fa3940a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.363+0000 7fa39a745700 1 -- 172.21.15.146:0/642134658 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3940a0a70 msgr2=0x7fa3940a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:26.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.363+0000 7fa39a745700 1 --2- 172.21.15.146:0/642134658 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3940a0a70 0x7fa3940a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.363+0000 7fa39a745700 1 -- 172.21.15.146:0/642134658 >> v1:172.21.15.146:6789/0 conn(0x7fa3940a1380 legacy=0x7fa394133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.363+0000 7fa39a745700 1 -- 172.21.15.146:0/642134658 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39409e6a0 con 0x7fa394134120 2023-10-03T10:17:26.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.363+0000 7fa39a745700 1 --2- 172.21.15.146:0/642134658 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa394134120 0x7fa39413bce0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa38c009e80 tx=0x7fa38c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=103e2a7901b4844a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.363+0000 7fa398f42700 1 -- 172.21.15.146:0/642134658 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c00e070 con 0x7fa394134120 2023-10-03T10:17:26.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.363+0000 7fa398f42700 1 -- 172.21.15.146:0/642134658 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c00b910 con 0x7fa394134120 2023-10-03T10:17:26.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.363+0000 7fa398f42700 1 -- 172.21.15.146:0/642134658 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c00bcc0 con 0x7fa394134120 2023-10-03T10:17:26.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.364+0000 7fa39c1a8700 1 -- 172.21.15.146:0/642134658 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa394134120 msgr2=0x7fa39413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.364+0000 7fa39c1a8700 1 --2- 172.21.15.146:0/642134658 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa394134120 0x7fa39413bce0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa38c009e80 tx=0x7fa38c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:26.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.364+0000 7fa39c1a8700 1 -- 172.21.15.146:0/642134658 shutdown_connections 2023-10-03T10:17:26.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.364+0000 7fa39c1a8700 1 --2- 172.21.15.146:0/642134658 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa394134120 0x7fa39413bce0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.364+0000 7fa39c1a8700 1 --2- 172.21.15.146:0/642134658 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3940a0a70 0x7fa3940a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.364+0000 7fa39c1a8700 1 -- 172.21.15.146:0/642134658 >> 172.21.15.146:0/642134658 conn(0x7fa3940a6610 msgr2=0x7fa3940a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.364+0000 7fa39c1a8700 1 -- 172.21.15.146:0/642134658 shutdown_connections 2023-10-03T10:17:26.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.364+0000 7fa39c1a8700 1 -- 172.21.15.146:0/642134658 wait complete. 2023-10-03T10:17:26.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.365+0000 7fa39c1a8700 1 Processor -- start 2023-10-03T10:17:26.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.365+0000 7fa39c1a8700 1 -- start start 2023-10-03T10:17:26.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.365+0000 7fa39c1a8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3940a0a70 0x7fa394122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.365+0000 7fa39c1a8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3940a1380 0x7fa394122e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.365+0000 7fa39c1a8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa394134120 0x7fa394123390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.365+0000 7fa39c1a8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3941260c0 con 0x7fa3940a0a70 2023-10-03T10:17:26.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.365+0000 7fa39c1a8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3941245a0 con 0x7fa394134120 2023-10-03T10:17:26.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.365+0000 7fa39c1a8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa394133a10 con 0x7fa3940a1380 2023-10-03T10:17:26.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.365+0000 7fa399743700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3940a1380 0x7fa394122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.365+0000 7fa39a745700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa394134120 0x7fa394123390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.365+0000 7fa399743700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3940a1380 0x7fa394122e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37712/0 (socket says 172.21.15.146:37712) 2023-10-03T10:17:26.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.365+0000 7fa399743700 1 -- 172.21.15.146:0/1373266042 learned_addr learned my addr 172.21.15.146:0/1373266042 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:26.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.365+0000 7fa399f44700 1 --2- 172.21.15.146:0/1373266042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3940a0a70 0x7fa394122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.366+0000 7fa39a745700 1 -- 172.21.15.146:0/1373266042 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3940a1380 msgr2=0x7fa394122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.366+0000 7fa39a745700 1 --2- 172.21.15.146:0/1373266042 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3940a1380 0x7fa394122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.366+0000 7fa39a745700 1 -- 172.21.15.146:0/1373266042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3940a0a70 msgr2=0x7fa394122910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.366+0000 7fa39a745700 1 --2- 172.21.15.146:0/1373266042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3940a0a70 0x7fa394122910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.366+0000 7fa39a745700 1 -- 172.21.15.146:0/1373266042 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c009b30 con 0x7fa394134120 2023-10-03T10:17:26.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.366+0000 7fa399743700 1 --2- 172.21.15.146:0/1373266042 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3940a1380 0x7fa394122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:26.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.366+0000 7fa39a745700 1 --2- 172.21.15.146:0/1373266042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa394134120 0x7fa394123390 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa38c015000 tx=0x7fa38c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.366+0000 7fa38a7fc700 1 -- 172.21.15.146:0/1373266042 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c004240 con 0x7fa394134120 2023-10-03T10:17:26.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.366+0000 7fa38a7fc700 1 -- 172.21.15.146:0/1373266042 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c0092e0 con 0x7fa394134120 2023-10-03T10:17:26.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.366+0000 7fa39c1a8700 1 -- 172.21.15.146:0/1373266042 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3940a03e0 con 0x7fa394134120 2023-10-03T10:17:26.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.366+0000 7fa38a7fc700 1 -- 172.21.15.146:0/1373266042 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c004620 con 0x7fa394134120 2023-10-03T10:17:26.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.366+0000 7fa39c1a8700 1 -- 172.21.15.146:0/1373266042 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa394126b30 con 0x7fa394134120 2023-10-03T10:17:26.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.367+0000 7fa38a7fc700 1 -- 172.21.15.146:0/1373266042 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa38c004780 con 0x7fa394134120 2023-10-03T10:17:26.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.367+0000 7fa38a7fc700 1 -- 172.21.15.146:0/1373266042 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa38c0414c0 con 0x7fa394134120 2023-10-03T10:17:26.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.367+0000 7fa39c1a8700 1 -- 172.21.15.146:0/1373266042 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39404f2a0 con 0x7fa394134120 2023-10-03T10:17:26.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.372+0000 7fa38a7fc700 1 -- 172.21.15.146:0/1373266042 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa38c02d7a0 con 0x7fa394134120 2023-10-03T10:17:26.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.426+0000 7ff8e39f6700 1 Processor -- start 2023-10-03T10:17:26.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.426+0000 7ff8e39f6700 1 -- start start 2023-10-03T10:17:26.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.426+0000 7ff8e39f6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8dc0a1550 0x7ff8dc138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.426+0000 7ff8e39f6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8dc139200 0x7ff8dc13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.426+0000 7ff8e39f6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8dc09e9d0 con 0x7ff8dc0a0a70 2023-10-03T10:17:26.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.426+0000 7ff8e39f6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc09dc00 con 0x7ff8dc139200 2023-10-03T10:17:26.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.426+0000 7ff8e39f6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc09dec0 con 0x7ff8dc0a1550 2023-10-03T10:17:26.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.427+0000 7ff8e1f93700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8dc139200 0x7ff8dc13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.427+0000 7ff8e0f91700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8dc0a1550 0x7ff8dc138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.427+0000 7ff8e0f91700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8dc0a1550 0x7ff8dc138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37718/0 (socket says 172.21.15.146:37718) 2023-10-03T10:17:26.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.427+0000 7ff8e1f93700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8dc139200 0x7ff8dc13b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45176/0 (socket says 172.21.15.146:45176) 2023-10-03T10:17:26.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.427+0000 7ff8e0f91700 1 -- 172.21.15.146:0/2036109191 learned_addr learned my addr 172.21.15.146:0/2036109191 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.427+0000 7ff8e1792700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff8dc0a0a70 0x7ff8dc0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58458/0 (socket says 172.21.15.146:58458) 2023-10-03T10:17:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.427+0000 7ff8e0f91700 1 -- 172.21.15.146:0/2036109191 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8dc139200 msgr2=0x7ff8dc13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.427+0000 7ff8e0f91700 1 --2- 172.21.15.146:0/2036109191 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8dc139200 0x7ff8dc13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.427+0000 7ff8e0f91700 1 -- 172.21.15.146:0/2036109191 >> v1:172.21.15.146:6789/0 conn(0x7ff8dc0a0a70 legacy=0x7ff8dc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.427+0000 7ff8e0f91700 1 -- 172.21.15.146:0/2036109191 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc09e6a0 con 0x7ff8dc0a1550 2023-10-03T10:17:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.427+0000 7ff8e0f91700 1 --2- 172.21.15.146:0/2036109191 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8dc0a1550 0x7ff8dc138cc0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc009920 tx=0x7ff8cc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6009f8aedd60da7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.427+0000 7ff8d3fff700 1 -- 172.21.15.146:0/2036109191 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc011830 con 0x7ff8dc0a1550 2023-10-03T10:17:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.427+0000 7ff8d3fff700 1 -- 172.21.15.146:0/2036109191 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8cc011990 con 0x7ff8dc0a1550 2023-10-03T10:17:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.427+0000 7ff8d3fff700 1 -- 172.21.15.146:0/2036109191 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc011d20 con 0x7ff8dc0a1550 2023-10-03T10:17:26.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.428+0000 7ff8e39f6700 1 -- 172.21.15.146:0/2036109191 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8dc0a1550 msgr2=0x7ff8dc138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.428+0000 7ff8e39f6700 1 --2- 172.21.15.146:0/2036109191 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8dc0a1550 0x7ff8dc138cc0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc009920 tx=0x7ff8cc009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:26.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.428+0000 7ff8e39f6700 1 -- 172.21.15.146:0/2036109191 shutdown_connections 2023-10-03T10:17:26.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.428+0000 7ff8e39f6700 1 --2- 172.21.15.146:0/2036109191 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8dc139200 0x7ff8dc13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.428+0000 7ff8e39f6700 1 --2- 172.21.15.146:0/2036109191 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8dc0a1550 0x7ff8dc138cc0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.428+0000 7ff8e39f6700 1 -- 172.21.15.146:0/2036109191 >> 172.21.15.146:0/2036109191 conn(0x7ff8dc0a6610 msgr2=0x7ff8dc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.428+0000 7ff8e39f6700 1 -- 172.21.15.146:0/2036109191 shutdown_connections 2023-10-03T10:17:26.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.428+0000 7ff8e39f6700 1 -- 172.21.15.146:0/2036109191 wait complete. 2023-10-03T10:17:26.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.429+0000 7ff8e39f6700 1 Processor -- start 2023-10-03T10:17:26.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.429+0000 7ff8e39f6700 1 -- start start 2023-10-03T10:17:26.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.430+0000 7ff8e39f6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8dc0a0a70 0x7ff8dc11e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.430+0000 7ff8e39f6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8dc0a1550 0x7ff8dc11eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.430+0000 7ff8e39f6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8dc139200 0x7ff8dc11f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.430+0000 7ff8e39f6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc121ec0 con 0x7ff8dc0a1550 2023-10-03T10:17:26.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.430+0000 7ff8e39f6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc1220a0 con 0x7ff8dc0a0a70 2023-10-03T10:17:26.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.430+0000 7ff8e39f6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc0a03e0 con 0x7ff8dc139200 2023-10-03T10:17:26.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.430+0000 7ff8e0f91700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8dc0a1550 0x7ff8dc11eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.430+0000 7ff8e0f91700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8dc0a1550 0x7ff8dc11eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51930/0 (socket says 172.21.15.146:51930) 2023-10-03T10:17:26.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.430+0000 7ff8e0f91700 1 -- 172.21.15.146:0/3316204461 learned_addr learned my addr 172.21.15.146:0/3316204461 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:26.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.430+0000 7ff8e1792700 1 --2- 172.21.15.146:0/3316204461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8dc0a0a70 0x7ff8dc11e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.430+0000 7ff8e1f93700 1 --2- 172.21.15.146:0/3316204461 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8dc139200 0x7ff8dc11f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.430+0000 7ff8e0f91700 1 -- 172.21.15.146:0/3316204461 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8dc139200 msgr2=0x7ff8dc11f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.430+0000 7ff8e0f91700 1 --2- 172.21.15.146:0/3316204461 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8dc139200 0x7ff8dc11f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.430+0000 7ff8e0f91700 1 -- 172.21.15.146:0/3316204461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8dc0a0a70 msgr2=0x7ff8dc11e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.430+0000 7ff8e0f91700 1 --2- 172.21.15.146:0/3316204461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8dc0a0a70 0x7ff8dc11e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.430+0000 7ff8e0f91700 1 -- 172.21.15.146:0/3316204461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc009550 con 0x7ff8dc0a1550 2023-10-03T10:17:26.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.430+0000 7ff8e1f93700 1 --2- 172.21.15.146:0/3316204461 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8dc139200 0x7ff8dc11f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:26.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.430+0000 7ff8e0f91700 1 --2- 172.21.15.146:0/3316204461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8dc0a1550 0x7ff8dc11eda0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc000c00 tx=0x7ff8cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.430+0000 7ff8d1ffb700 1 -- 172.21.15.146:0/3316204461 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc004450 con 0x7ff8dc0a1550 2023-10-03T10:17:26.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.430+0000 7ff8d1ffb700 1 -- 172.21.15.146:0/3316204461 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8cc01f070 con 0x7ff8dc0a1550 2023-10-03T10:17:26.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.430+0000 7ff8d1ffb700 1 -- 172.21.15.146:0/3316204461 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc0038c0 con 0x7ff8dc0a1550 2023-10-03T10:17:26.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.430+0000 7ff8e39f6700 1 -- 172.21.15.146:0/3316204461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8dc121af0 con 0x7ff8dc0a1550 2023-10-03T10:17:26.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.431+0000 7ff8e39f6700 1 -- 172.21.15.146:0/3316204461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8dc120c20 con 0x7ff8dc0a1550 2023-10-03T10:17:26.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.431+0000 7ff8e39f6700 1 -- 172.21.15.146:0/3316204461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8dc04f2a0 con 0x7ff8dc0a1550 2023-10-03T10:17:26.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.432+0000 7ff8d1ffb700 1 -- 172.21.15.146:0/3316204461 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff8cc003a20 con 0x7ff8dc0a1550 2023-10-03T10:17:26.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.432+0000 7ff8d1ffb700 1 -- 172.21.15.146:0/3316204461 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff8cc021070 con 0x7ff8dc0a1550 2023-10-03T10:17:26.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.440+0000 7ff8d1ffb700 1 -- 172.21.15.146:0/3316204461 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff8cc0045b0 con 0x7ff8dc0a1550 2023-10-03T10:17:26.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.502+0000 7f889e744700 1 -- 172.21.15.146:0/462377750 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f889804f2a0 con 0x7f889809d860 2023-10-03T10:17:26.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.503+0000 7f8894ff9700 1 -- 172.21.15.146:0/462377750 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8888017070 con 0x7f889809d860 2023-10-03T10:17:26.503 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:26.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.505+0000 7f889e744700 1 -- 172.21.15.146:0/462377750 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f889809d860 msgr2=0x7f88981c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.505+0000 7f889e744700 1 --2- 172.21.15.146:0/462377750 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f889809d860 0x7f88981c8470 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8888001eb0 tx=0x7f888800c7b0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.505+0000 7f889e744700 1 -- 172.21.15.146:0/462377750 shutdown_connections 2023-10-03T10:17:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.505+0000 7f889e744700 1 --2- 172.21.15.146:0/462377750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8898135f20 0x7f889806e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.505+0000 7f889e744700 1 --2- 172.21.15.146:0/462377750 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f889809d860 0x7f88981c8470 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.505+0000 7f889e744700 1 --2- 172.21.15.146:0/462377750 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f889809e340 0x7f88981c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.505+0000 7f889e744700 1 -- 172.21.15.146:0/462377750 >> 172.21.15.146:0/462377750 conn(0x7f8898099c40 msgr2=0x7f889806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.505+0000 7f889e744700 1 -- 172.21.15.146:0/462377750 shutdown_connections 2023-10-03T10:17:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.505+0000 7f889e744700 1 -- 172.21.15.146:0/462377750 wait complete. 2023-10-03T10:17:26.518 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:26.541 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:26.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.566+0000 7fa39c1a8700 1 -- 172.21.15.146:0/1373266042 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa394072980 con 0x7fa394134120 2023-10-03T10:17:26.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.566+0000 7fa38a7fc700 1 -- 172.21.15.146:0/1373266042 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa38c034090 con 0x7fa394134120 2023-10-03T10:17:26.567 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.569+0000 7fa39c1a8700 1 -- 172.21.15.146:0/1373266042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa394134120 msgr2=0x7fa394123390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.569+0000 7fa39c1a8700 1 --2- 172.21.15.146:0/1373266042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa394134120 0x7fa394123390 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa38c015000 tx=0x7fa38c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.569+0000 7fa39c1a8700 1 -- 172.21.15.146:0/1373266042 shutdown_connections 2023-10-03T10:17:26.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.569+0000 7fa39c1a8700 1 --2- 172.21.15.146:0/1373266042 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa394134120 0x7fa394123390 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.569+0000 7fa39c1a8700 1 --2- 172.21.15.146:0/1373266042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3940a0a70 0x7fa394122910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.569+0000 7fa39c1a8700 1 --2- 172.21.15.146:0/1373266042 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3940a1380 0x7fa394122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.569+0000 7fa39c1a8700 1 -- 172.21.15.146:0/1373266042 >> 172.21.15.146:0/1373266042 conn(0x7fa3940a6610 msgr2=0x7fa3940a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.569+0000 7fa39c1a8700 1 -- 172.21.15.146:0/1373266042 shutdown_connections 2023-10-03T10:17:26.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.569+0000 7fa39c1a8700 1 -- 172.21.15.146:0/1373266042 wait complete. 2023-10-03T10:17:26.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:26.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.634+0000 7ff8e39f6700 1 -- 172.21.15.146:0/3316204461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff8dc1221e0 con 0x7ff8dc0a1550 2023-10-03T10:17:26.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.635+0000 7ff8d1ffb700 1 -- 172.21.15.146:0/3316204461 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff8dc1221e0 con 0x7ff8dc0a1550 2023-10-03T10:17:26.635 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.638+0000 7ff8e39f6700 1 -- 172.21.15.146:0/3316204461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8dc0a1550 msgr2=0x7ff8dc11eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.638+0000 7ff8e39f6700 1 --2- 172.21.15.146:0/3316204461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8dc0a1550 0x7ff8dc11eda0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc000c00 tx=0x7ff8cc004750 comp rx=0 tx=0).stop 2023-10-03T10:17:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.638+0000 7ff8e39f6700 1 -- 172.21.15.146:0/3316204461 shutdown_connections 2023-10-03T10:17:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.638+0000 7ff8e39f6700 1 --2- 172.21.15.146:0/3316204461 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff8dc139200 0x7ff8dc11f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.638+0000 7ff8e39f6700 1 --2- 172.21.15.146:0/3316204461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff8dc0a0a70 0x7ff8dc11e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.638+0000 7ff8e39f6700 1 --2- 172.21.15.146:0/3316204461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8dc0a1550 0x7ff8dc11eda0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.638+0000 7ff8e39f6700 1 -- 172.21.15.146:0/3316204461 >> 172.21.15.146:0/3316204461 conn(0x7ff8dc0a6610 msgr2=0x7ff8dc136c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.638+0000 7ff8e39f6700 1 -- 172.21.15.146:0/3316204461 shutdown_connections 2023-10-03T10:17:26.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.638+0000 7ff8e39f6700 1 -- 172.21.15.146:0/3316204461 wait complete. 2023-10-03T10:17:26.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.672+0000 7f2b63bb5700 1 Processor -- start 2023-10-03T10:17:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.672+0000 7f2b63bb5700 1 -- start start 2023-10-03T10:17:26.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.672+0000 7f2b63bb5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5c131980 0x7f2b5c131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.672+0000 7f2b63bb5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2b5c09bc70 0x7f2b5c09c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.672+0000 7f2b63bb5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b5c09c5c0 0x7f2b5c138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.672+0000 7f2b63bb5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5c06eb30 con 0x7f2b5c09bc70 2023-10-03T10:17:26.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.672+0000 7f2b63bb5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c0a1640 con 0x7f2b5c131980 2023-10-03T10:17:26.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.672+0000 7f2b63bb5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c0a22d0 con 0x7f2b5c09c5c0 2023-10-03T10:17:26.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.673+0000 7f2b62152700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b5c09c5c0 0x7f2b5c138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.673+0000 7f2b62152700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b5c09c5c0 0x7f2b5c138700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37746/0 (socket says 172.21.15.146:37746) 2023-10-03T10:17:26.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.673+0000 7f2b61150700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2b5c09bc70 0x7f2b5c09c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.673+0000 7f2b62152700 1 -- 172.21.15.146:0/2376064753 learned_addr learned my addr 172.21.15.146:0/2376064753 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:26.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.673+0000 7f2b61951700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5c131980 0x7f2b5c131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.673+0000 7f2b62152700 1 -- 172.21.15.146:0/2376064753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5c131980 msgr2=0x7f2b5c131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:26.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.673+0000 7f2b62152700 1 --2- 172.21.15.146:0/2376064753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5c131980 0x7f2b5c131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.673+0000 7f2b62152700 1 -- 172.21.15.146:0/2376064753 >> v2:172.21.15.146:3300/0 conn(0x7f2b5c09bc70 msgr2=0x7f2b5c09c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.673+0000 7f2b62152700 1 --2- 172.21.15.146:0/2376064753 >> v2:172.21.15.146:3300/0 conn(0x7f2b5c09bc70 0x7f2b5c09c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.673+0000 7f2b62152700 1 -- 172.21.15.146:0/2376064753 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c131550 con 0x7f2b5c09c5c0 2023-10-03T10:17:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.673+0000 7f2b61951700 1 --2- 172.21.15.146:0/2376064753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5c131980 0x7f2b5c131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.673+0000 7f2b61150700 1 --2- 172.21.15.146:0/2376064753 >> v2:172.21.15.146:3300/0 conn(0x7f2b5c09bc70 0x7f2b5c09c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.673+0000 7f2b62152700 1 --2- 172.21.15.146:0/2376064753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b5c09c5c0 0x7f2b5c138700 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f2b54009e80 tx=0x7f2b5400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab5487efc80196a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.673+0000 7f2b6094f700 1 -- 172.21.15.146:0/2376064753 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5400e070 con 0x7f2b5c09c5c0 2023-10-03T10:17:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.673+0000 7f2b6094f700 1 -- 172.21.15.146:0/2376064753 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5400b8d0 con 0x7f2b5c09c5c0 2023-10-03T10:17:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.673+0000 7f2b6094f700 1 -- 172.21.15.146:0/2376064753 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5400bc80 con 0x7f2b5c09c5c0 2023-10-03T10:17:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.674+0000 7f2b63bb5700 1 -- 172.21.15.146:0/2376064753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b5c09c5c0 msgr2=0x7f2b5c138700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.674+0000 7f2b63bb5700 1 --2- 172.21.15.146:0/2376064753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b5c09c5c0 0x7f2b5c138700 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f2b54009e80 tx=0x7f2b5400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.674+0000 7f2b63bb5700 1 -- 172.21.15.146:0/2376064753 shutdown_connections 2023-10-03T10:17:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.674+0000 7f2b63bb5700 1 --2- 172.21.15.146:0/2376064753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5c131980 0x7f2b5c131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.674+0000 7f2b63bb5700 1 --2- 172.21.15.146:0/2376064753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b5c09c5c0 0x7f2b5c138700 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.674+0000 7f2b63bb5700 1 --2- 172.21.15.146:0/2376064753 >> v2:172.21.15.146:3300/0 conn(0x7f2b5c09bc70 0x7f2b5c09c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.674+0000 7f2b63bb5700 1 -- 172.21.15.146:0/2376064753 >> 172.21.15.146:0/2376064753 conn(0x7f2b5c0a2980 msgr2=0x7f2b5c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.674+0000 7f2b63bb5700 1 -- 172.21.15.146:0/2376064753 shutdown_connections 2023-10-03T10:17:26.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.674+0000 7f2b63bb5700 1 -- 172.21.15.146:0/2376064753 wait complete. 2023-10-03T10:17:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.675+0000 7f2b63bb5700 1 Processor -- start 2023-10-03T10:17:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.675+0000 7f2b63bb5700 1 -- start start 2023-10-03T10:17:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.675+0000 7f2b63bb5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b5c09bc70 0x7f2b5c099a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.675+0000 7f2b63bb5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5c09c5c0 0x7f2b5c099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.675+0000 7f2b63bb5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b5c131980 0x7f2b5c09a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.675+0000 7f2b63bb5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c123550 con 0x7f2b5c131980 2023-10-03T10:17:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.675+0000 7f2b63bb5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c09b590 con 0x7f2b5c09c5c0 2023-10-03T10:17:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.675+0000 7f2b63bb5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c1226b0 con 0x7f2b5c09bc70 2023-10-03T10:17:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.675+0000 7f2b61951700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b5c09bc70 0x7f2b5c099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.675+0000 7f2b61150700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5c09c5c0 0x7f2b5c099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.675+0000 7f2b62152700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b5c131980 0x7f2b5c09a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.675+0000 7f2b61951700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b5c09bc70 0x7f2b5c099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37748/0 (socket says 172.21.15.146:37748) 2023-10-03T10:17:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.675+0000 7f2b61150700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5c09c5c0 0x7f2b5c099fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45196/0 (socket says 172.21.15.146:45196) 2023-10-03T10:17:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.675+0000 7f2b61951700 1 -- 172.21.15.146:0/1579724200 learned_addr learned my addr 172.21.15.146:0/1579724200 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.675+0000 7f2b61951700 1 -- 172.21.15.146:0/1579724200 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5c09c5c0 msgr2=0x7f2b5c099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.675+0000 7f2b61951700 1 --2- 172.21.15.146:0/1579724200 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5c09c5c0 0x7f2b5c099fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.676+0000 7f2b61951700 1 -- 172.21.15.146:0/1579724200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b5c131980 msgr2=0x7f2b5c09a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.676+0000 7f2b61951700 1 --2- 172.21.15.146:0/1579724200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b5c131980 0x7f2b5c09a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.676+0000 7f2b61951700 1 -- 172.21.15.146:0/1579724200 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c0094a0 con 0x7f2b5c09bc70 2023-10-03T10:17:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.676+0000 7f2b61150700 1 --2- 172.21.15.146:0/1579724200 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5c09c5c0 0x7f2b5c099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.676+0000 7f2b62152700 1 --2- 172.21.15.146:0/1579724200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b5c131980 0x7f2b5c09a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.676+0000 7f2b61951700 1 --2- 172.21.15.146:0/1579724200 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b5c09bc70 0x7f2b5c099a60 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800ebe0 tx=0x7f2b5800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.676+0000 7f2b527fc700 1 -- 172.21.15.146:0/1579724200 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b58005a20 con 0x7f2b5c09bc70 2023-10-03T10:17:26.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.676+0000 7f2b527fc700 1 -- 172.21.15.146:0/1579724200 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b58005b80 con 0x7f2b5c09bc70 2023-10-03T10:17:26.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.676+0000 7f2b63bb5700 1 -- 172.21.15.146:0/1579724200 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b58009430 con 0x7f2b5c09bc70 2023-10-03T10:17:26.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.676+0000 7f2b527fc700 1 -- 172.21.15.146:0/1579724200 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5800c850 con 0x7f2b5c09bc70 2023-10-03T10:17:26.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.676+0000 7f2b63bb5700 1 -- 172.21.15.146:0/1579724200 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b54009b30 con 0x7f2b5c09bc70 2023-10-03T10:17:26.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.676+0000 7f2b527fc700 1 -- 172.21.15.146:0/1579724200 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b5800c9b0 con 0x7f2b5c09bc70 2023-10-03T10:17:26.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.677+0000 7f2b527fc700 1 -- 172.21.15.146:0/1579724200 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2b5803f950 con 0x7f2b5c09bc70 2023-10-03T10:17:26.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.677+0000 7f2b63bb5700 1 -- 172.21.15.146:0/1579724200 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b5c04f2a0 con 0x7f2b5c09bc70 2023-10-03T10:17:26.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.681+0000 7f2b527fc700 1 -- 172.21.15.146:0/1579724200 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b58022300 con 0x7f2b5c09bc70 2023-10-03T10:17:26.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.866+0000 7f2b63bb5700 1 -- 172.21.15.146:0/1579724200 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2b5c122bc0 con 0x7f2b5c09bc70 2023-10-03T10:17:26.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.866+0000 7f2b527fc700 1 -- 172.21.15.146:0/1579724200 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2b5802a090 con 0x7f2b5c09bc70 2023-10-03T10:17:26.867 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:26.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.869+0000 7f2b63bb5700 1 -- 172.21.15.146:0/1579724200 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b5c09bc70 msgr2=0x7f2b5c099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.869+0000 7f2b63bb5700 1 --2- 172.21.15.146:0/1579724200 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b5c09bc70 0x7f2b5c099a60 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800ebe0 tx=0x7f2b5800eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.869+0000 7f2b63bb5700 1 -- 172.21.15.146:0/1579724200 shutdown_connections 2023-10-03T10:17:26.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.869+0000 7f2b63bb5700 1 --2- 172.21.15.146:0/1579724200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b5c131980 0x7f2b5c09a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.869+0000 7f2b63bb5700 1 --2- 172.21.15.146:0/1579724200 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b5c09bc70 0x7f2b5c099a60 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.869+0000 7f2b63bb5700 1 --2- 172.21.15.146:0/1579724200 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5c09c5c0 0x7f2b5c099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.869+0000 7f2b63bb5700 1 -- 172.21.15.146:0/1579724200 >> 172.21.15.146:0/1579724200 conn(0x7f2b5c0a2980 msgr2=0x7f2b5c06ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.869+0000 7f2b63bb5700 1 -- 172.21.15.146:0/1579724200 shutdown_connections 2023-10-03T10:17:26.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:26.869+0000 7f2b63bb5700 1 -- 172.21.15.146:0/1579724200 wait complete. 2023-10-03T10:17:26.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:27.519 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:27.583 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:27.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.651+0000 7fe4dba4a700 1 Processor -- start 2023-10-03T10:17:27.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.651+0000 7fe4dba4a700 1 -- start start 2023-10-03T10:17:27.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.652+0000 7fe4dba4a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4d406a770 0x7fe4d406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.652+0000 7fe4dba4a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe4d4136cb0 0x7fe4d4139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.652+0000 7fe4dba4a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d406e900 con 0x7fe4d409dec0 2023-10-03T10:17:27.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.652+0000 7fe4dba4a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4d409d180 con 0x7fe4d4136cb0 2023-10-03T10:17:27.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.652+0000 7fe4d97e6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4d406a770 0x7fe4d406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.652+0000 7fe4dba4a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d409e780 con 0x7fe4d406a770 2023-10-03T10:17:27.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.652+0000 7fe4d8fe5700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe4d409dec0 0x7fe4d406b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58460/0 (socket says 172.21.15.146:58460) 2023-10-03T10:17:27.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.652+0000 7fe4d9fe7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe4d4136cb0 0x7fe4d4139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.652+0000 7fe4d8fe5700 1 -- 172.21.15.146:0/1981428702 learned_addr learned my addr 172.21.15.146:0/1981428702 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:27.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.652+0000 7fe4cbfff700 1 -- 172.21.15.146:0/1981428702 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4048215750 0 0) 0x7fe4d406e900 con 0x7fe4d409dec0 2023-10-03T10:17:27.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.652+0000 7fe4d97e6700 1 -- 172.21.15.146:0/1981428702 >> v2:172.21.15.146:3300/0 conn(0x7fe4d4136cb0 msgr2=0x7fe4d4139090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:27.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.652+0000 7fe4d97e6700 1 --2- 172.21.15.146:0/1981428702 >> v2:172.21.15.146:3300/0 conn(0x7fe4d4136cb0 0x7fe4d4139090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.652+0000 7fe4d97e6700 1 -- 172.21.15.146:0/1981428702 >> v1:172.21.15.146:6789/0 conn(0x7fe4d409dec0 legacy=0x7fe4d406b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.652+0000 7fe4d97e6700 1 -- 172.21.15.146:0/1981428702 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d409d3c0 con 0x7fe4d406a770 2023-10-03T10:17:27.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.652+0000 7fe4d97e6700 1 --2- 172.21.15.146:0/1981428702 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4d406a770 0x7fe4d406ab40 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009840 tx=0x7fe4d0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e162a36c20273a8b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.653+0000 7fe4cbfff700 1 -- 172.21.15.146:0/1981428702 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0011830 con 0x7fe4d406a770 2023-10-03T10:17:27.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.653+0000 7fe4cbfff700 1 -- 172.21.15.146:0/1981428702 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d0011990 con 0x7fe4d406a770 2023-10-03T10:17:27.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.653+0000 7fe4cbfff700 1 -- 172.21.15.146:0/1981428702 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0011d20 con 0x7fe4d406a770 2023-10-03T10:17:27.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.653+0000 7fe4dba4a700 1 -- 172.21.15.146:0/1981428702 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4d406a770 msgr2=0x7fe4d406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.653+0000 7fe4dba4a700 1 --2- 172.21.15.146:0/1981428702 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4d406a770 0x7fe4d406ab40 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009840 tx=0x7fe4d0009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:27.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.653+0000 7fe4dba4a700 1 -- 172.21.15.146:0/1981428702 shutdown_connections 2023-10-03T10:17:27.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.653+0000 7fe4dba4a700 1 --2- 172.21.15.146:0/1981428702 >> v2:172.21.15.146:3300/0 conn(0x7fe4d4136cb0 0x7fe4d4139090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.653+0000 7fe4dba4a700 1 --2- 172.21.15.146:0/1981428702 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4d406a770 0x7fe4d406ab40 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.653+0000 7fe4dba4a700 1 -- 172.21.15.146:0/1981428702 >> 172.21.15.146:0/1981428702 conn(0x7fe4d4099c40 msgr2=0x7fe4d40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.653+0000 7fe4dba4a700 1 -- 172.21.15.146:0/1981428702 shutdown_connections 2023-10-03T10:17:27.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.653+0000 7fe4dba4a700 1 -- 172.21.15.146:0/1981428702 wait complete. 2023-10-03T10:17:27.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.654+0000 7fe4dba4a700 1 Processor -- start 2023-10-03T10:17:27.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.654+0000 7fe4dba4a700 1 -- start start 2023-10-03T10:17:27.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.655+0000 7fe4dba4a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4d406a770 0x7fe4d409a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.655+0000 7fe4dba4a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4d409dec0 0x7fe4d409a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.655+0000 7fe4dba4a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4d4136cb0 0x7fe4d409af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.655+0000 7fe4dba4a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d4135970 con 0x7fe4d409dec0 2023-10-03T10:17:27.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.655+0000 7fe4dba4a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d41356b0 con 0x7fe4d4136cb0 2023-10-03T10:17:27.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.655+0000 7fe4dba4a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d4135c50 con 0x7fe4d406a770 2023-10-03T10:17:27.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.655+0000 7fe4d8fe5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4d409dec0 0x7fe4d409a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.655+0000 7fe4d9fe7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4d4136cb0 0x7fe4d409af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.655+0000 7fe4d8fe5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4d409dec0 0x7fe4d409a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51960/0 (socket says 172.21.15.146:51960) 2023-10-03T10:17:27.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.655+0000 7fe4d8fe5700 1 -- 172.21.15.146:0/393704135 learned_addr learned my addr 172.21.15.146:0/393704135 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:27.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.655+0000 7fe4d97e6700 1 --2- 172.21.15.146:0/393704135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4d406a770 0x7fe4d409a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.655+0000 7fe4d8fe5700 1 -- 172.21.15.146:0/393704135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4d406a770 msgr2=0x7fe4d409a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.655+0000 7fe4d8fe5700 1 --2- 172.21.15.146:0/393704135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4d406a770 0x7fe4d409a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.655+0000 7fe4d8fe5700 1 -- 172.21.15.146:0/393704135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4d4136cb0 msgr2=0x7fe4d409af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.655+0000 7fe4d8fe5700 1 --2- 172.21.15.146:0/393704135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4d4136cb0 0x7fe4d409af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.655+0000 7fe4d8fe5700 1 -- 172.21.15.146:0/393704135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d00094a0 con 0x7fe4d409dec0 2023-10-03T10:17:27.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.655+0000 7fe4d9fe7700 1 --2- 172.21.15.146:0/393704135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4d4136cb0 0x7fe4d409af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:27.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.655+0000 7fe4d8fe5700 1 --2- 172.21.15.146:0/393704135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4d409dec0 0x7fe4d409a9d0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400c520 tx=0x7fe4c400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.655+0000 7fe4c9ffb700 1 -- 172.21.15.146:0/393704135 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4004c80 con 0x7fe4d409dec0 2023-10-03T10:17:27.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.655+0000 7fe4c9ffb700 1 -- 172.21.15.146:0/393704135 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c4004e00 con 0x7fe4d409dec0 2023-10-03T10:17:27.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.656+0000 7fe4dba4a700 1 -- 172.21.15.146:0/393704135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d40a0ff0 con 0x7fe4d409dec0 2023-10-03T10:17:27.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.656+0000 7fe4c9ffb700 1 -- 172.21.15.146:0/393704135 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4007310 con 0x7fe4d409dec0 2023-10-03T10:17:27.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.656+0000 7fe4dba4a700 1 -- 172.21.15.146:0/393704135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d409b860 con 0x7fe4d409dec0 2023-10-03T10:17:27.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.656+0000 7fe4c9ffb700 1 -- 172.21.15.146:0/393704135 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4c4007470 con 0x7fe4d409dec0 2023-10-03T10:17:27.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.656+0000 7fe4c9ffb700 1 -- 172.21.15.146:0/393704135 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe4c403f320 con 0x7fe4d409dec0 2023-10-03T10:17:27.659 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:27.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.657+0000 7fe4dba4a700 1 -- 172.21.15.146:0/393704135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d4136830 con 0x7fe4d409dec0 2023-10-03T10:17:27.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.661+0000 7fe4c9ffb700 1 -- 172.21.15.146:0/393704135 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4c40123b0 con 0x7fe4d409dec0 2023-10-03T10:17:27.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.713+0000 7fabe2d0a700 1 Processor -- start 2023-10-03T10:17:27.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.713+0000 7fabe2d0a700 1 -- start start 2023-10-03T10:17:27.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.714+0000 7fabe2d0a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fabdc0a1550 0x7fabdc138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.714+0000 7fabe2d0a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabdc139200 0x7fabdc13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.714+0000 7fabe2d0a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabdc09e9d0 con 0x7fabdc0a0a70 2023-10-03T10:17:27.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.714+0000 7fabe2d0a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabdc09dc00 con 0x7fabdc0a1550 2023-10-03T10:17:27.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.714+0000 7fabe2d0a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc09dec0 con 0x7fabdc139200 2023-10-03T10:17:27.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.714+0000 7fabe12a7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabdc139200 0x7fabdc13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.714+0000 7fabdbfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fabdc0a1550 0x7fabdc138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.714+0000 7fabe12a7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabdc139200 0x7fabdc13b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45212/0 (socket says 172.21.15.146:45212) 2023-10-03T10:17:27.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.714+0000 7fabe0aa6700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fabdc0a0a70 0x7fabdc0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58464/0 (socket says 172.21.15.146:58464) 2023-10-03T10:17:27.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.714+0000 7fabe12a7700 1 -- 172.21.15.146:0/3743949858 learned_addr learned my addr 172.21.15.146:0/3743949858 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:27.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.714+0000 7fabdbfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fabdc0a1550 0x7fabdc138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51968/0 (socket says 172.21.15.146:51968) 2023-10-03T10:17:27.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.714+0000 7fabdbfff700 1 -- 172.21.15.146:0/3743949858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabdc139200 msgr2=0x7fabdc13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:27.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.714+0000 7fabdbfff700 1 --2- 172.21.15.146:0/3743949858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabdc139200 0x7fabdc13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.714+0000 7fabdbfff700 1 -- 172.21.15.146:0/3743949858 >> v1:172.21.15.146:6789/0 conn(0x7fabdc0a0a70 legacy=0x7fabdc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.714+0000 7fabdbfff700 1 -- 172.21.15.146:0/3743949858 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabdc09e6a0 con 0x7fabdc0a1550 2023-10-03T10:17:27.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.714+0000 7fabdb7fe700 1 -- 172.21.15.146:0/3743949858 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856750037 0 0) 0x7fabdc09e9d0 con 0x7fabdc0a0a70 2023-10-03T10:17:27.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.714+0000 7fabdbfff700 1 --2- 172.21.15.146:0/3743949858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabdc0a1550 0x7fabdc138cc0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fabc8009840 tx=0x7fabc8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b3400e079a06d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.715+0000 7fabdb7fe700 1 -- 172.21.15.146:0/3743949858 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8011830 con 0x7fabdc0a1550 2023-10-03T10:17:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.715+0000 7fabdb7fe700 1 -- 172.21.15.146:0/3743949858 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc8011990 con 0x7fabdc0a1550 2023-10-03T10:17:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.715+0000 7fabdb7fe700 1 -- 172.21.15.146:0/3743949858 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8011d20 con 0x7fabdc0a1550 2023-10-03T10:17:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.715+0000 7fabe2d0a700 1 -- 172.21.15.146:0/3743949858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabdc0a1550 msgr2=0x7fabdc138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.715+0000 7fabe2d0a700 1 --2- 172.21.15.146:0/3743949858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabdc0a1550 0x7fabdc138cc0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fabc8009840 tx=0x7fabc8009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.715+0000 7fabe2d0a700 1 -- 172.21.15.146:0/3743949858 shutdown_connections 2023-10-03T10:17:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.715+0000 7fabe2d0a700 1 --2- 172.21.15.146:0/3743949858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabdc139200 0x7fabdc13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.715+0000 7fabe2d0a700 1 --2- 172.21.15.146:0/3743949858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabdc0a1550 0x7fabdc138cc0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.715+0000 7fabe2d0a700 1 -- 172.21.15.146:0/3743949858 >> 172.21.15.146:0/3743949858 conn(0x7fabdc0a6610 msgr2=0x7fabdc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.715+0000 7fabe2d0a700 1 -- 172.21.15.146:0/3743949858 shutdown_connections 2023-10-03T10:17:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.715+0000 7fabe2d0a700 1 -- 172.21.15.146:0/3743949858 wait complete. 2023-10-03T10:17:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.717+0000 7fabe2d0a700 1 Processor -- start 2023-10-03T10:17:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.717+0000 7fabe2d0a700 1 -- start start 2023-10-03T10:17:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.717+0000 7fabe2d0a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fabdc0a0a70 0x7fabdc11e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.717+0000 7fabe2d0a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabdc0a1550 0x7fabdc11ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.717+0000 7fabe2d0a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabdc139200 0x7fabdc11f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.717+0000 7fabe2d0a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc1345d0 con 0x7fabdc0a1550 2023-10-03T10:17:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.717+0000 7fabe2d0a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc120b10 con 0x7fabdc139200 2023-10-03T10:17:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.717+0000 7fabe2d0a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc0a5100 con 0x7fabdc0a0a70 2023-10-03T10:17:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.718+0000 7fabe0aa6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fabdc0a0a70 0x7fabdc11e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.718+0000 7fabe0aa6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fabdc0a0a70 0x7fabdc11e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37770/0 (socket says 172.21.15.146:37770) 2023-10-03T10:17:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.718+0000 7fabe0aa6700 1 -- 172.21.15.146:0/386731053 learned_addr learned my addr 172.21.15.146:0/386731053 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:27.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.718+0000 7fabdbfff700 1 --2- 172.21.15.146:0/386731053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabdc0a1550 0x7fabdc11ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.718+0000 7fabe12a7700 1 --2- 172.21.15.146:0/386731053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabdc139200 0x7fabdc11f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.718+0000 7fabe0aa6700 1 -- 172.21.15.146:0/386731053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabdc139200 msgr2=0x7fabdc11f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.718+0000 7fabe0aa6700 1 --2- 172.21.15.146:0/386731053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabdc139200 0x7fabdc11f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.718+0000 7fabe0aa6700 1 -- 172.21.15.146:0/386731053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabdc0a1550 msgr2=0x7fabdc11ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.718+0000 7fabe0aa6700 1 --2- 172.21.15.146:0/386731053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabdc0a1550 0x7fabdc11ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.718+0000 7fabe0aa6700 1 -- 172.21.15.146:0/386731053 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc80094a0 con 0x7fabdc0a0a70 2023-10-03T10:17:27.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.718+0000 7fabe12a7700 1 --2- 172.21.15.146:0/386731053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabdc139200 0x7fabdc11f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:27.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.718+0000 7fabdbfff700 1 --2- 172.21.15.146:0/386731053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabdc0a1550 0x7fabdc11ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:27.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.718+0000 7fabe0aa6700 1 --2- 172.21.15.146:0/386731053 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fabdc0a0a70 0x7fabdc11e780 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fabd000c520 tx=0x7fabd000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.718+0000 7fabd97fa700 1 -- 172.21.15.146:0/386731053 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0004c80 con 0x7fabdc0a0a70 2023-10-03T10:17:27.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.718+0000 7fabd97fa700 1 -- 172.21.15.146:0/386731053 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd0004de0 con 0x7fabdc0a0a70 2023-10-03T10:17:27.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.718+0000 7fabe2d0a700 1 -- 172.21.15.146:0/386731053 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabdc0a03e0 con 0x7fabdc0a0a70 2023-10-03T10:17:27.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.718+0000 7fabd97fa700 1 -- 172.21.15.146:0/386731053 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0007310 con 0x7fabdc0a0a70 2023-10-03T10:17:27.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.718+0000 7fabe2d0a700 1 -- 172.21.15.146:0/386731053 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabdc122990 con 0x7fabdc0a0a70 2023-10-03T10:17:27.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.719+0000 7fabd97fa700 1 -- 172.21.15.146:0/386731053 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fabd0007470 con 0x7fabdc0a0a70 2023-10-03T10:17:27.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.719+0000 7fabd97fa700 1 -- 172.21.15.146:0/386731053 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fabd003f470 con 0x7fabdc0a0a70 2023-10-03T10:17:27.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.720+0000 7fabe2d0a700 1 -- 172.21.15.146:0/386731053 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabdc04f2a0 con 0x7fabdc0a0a70 2023-10-03T10:17:27.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.725+0000 7fabd97fa700 1 -- 172.21.15.146:0/386731053 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fabd00123b0 con 0x7fabdc0a0a70 2023-10-03T10:17:27.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.788+0000 7f4d61196700 1 Processor -- start 2023-10-03T10:17:27.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.788+0000 7f4d61196700 1 -- start start 2023-10-03T10:17:27.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.789+0000 7f4d61196700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d5c09e340 0x7f4d5c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.789+0000 7f4d61196700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4d5c135f20 0x7f4d5c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.789+0000 7f4d61196700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5c09aaa0 con 0x7f4d5c09d860 2023-10-03T10:17:27.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.789+0000 7f4d61196700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d5c09e730 con 0x7f4d5c135f20 2023-10-03T10:17:27.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.789+0000 7f4d61196700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c09f870 con 0x7f4d5c09e340 2023-10-03T10:17:27.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.789+0000 7f4d5a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d5c09e340 0x7f4d5c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.789+0000 7f4d5ad9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4d5c09d860 0x7f4d5c09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58470/0 (socket says 172.21.15.146:58470) 2023-10-03T10:17:27.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.789+0000 7f4d5ad9d700 1 -- 172.21.15.146:0/2390502850 learned_addr learned my addr 172.21.15.146:0/2390502850 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:27.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.789+0000 7f4d5a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d5c09e340 0x7f4d5c1359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45238/0 (socket says 172.21.15.146:45238) 2023-10-03T10:17:27.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.789+0000 7f4d5b59e700 1 --2- 172.21.15.146:0/2390502850 >> v2:172.21.15.146:3300/0 conn(0x7f4d5c135f20 0x7f4d5c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.789+0000 7f4d59d9b700 1 -- 172.21.15.146:0/2390502850 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985440054 0 0) 0x7f4d5c09aaa0 con 0x7f4d5c09d860 2023-10-03T10:17:27.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.789+0000 7f4d59d9b700 1 -- 172.21.15.146:0/2390502850 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d440035b0 con 0x7f4d5c09d860 2023-10-03T10:17:27.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.789+0000 7f4d5a59c700 1 -- 172.21.15.146:0/2390502850 >> v2:172.21.15.146:3300/0 conn(0x7f4d5c135f20 msgr2=0x7f4d5c138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:27.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.789+0000 7f4d5a59c700 1 --2- 172.21.15.146:0/2390502850 >> v2:172.21.15.146:3300/0 conn(0x7f4d5c135f20 0x7f4d5c138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.789+0000 7f4d5a59c700 1 -- 172.21.15.146:0/2390502850 >> v1:172.21.15.146:6789/0 conn(0x7f4d5c09d860 legacy=0x7f4d5c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.789+0000 7f4d5a59c700 1 -- 172.21.15.146:0/2390502850 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c09b360 con 0x7f4d5c09e340 2023-10-03T10:17:27.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.790+0000 7f4d5a59c700 1 --2- 172.21.15.146:0/2390502850 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d5c09e340 0x7f4d5c1359e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4d50009840 tx=0x7f4d50009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1a19b95eb58334a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.790+0000 7f4d59d9b700 1 -- 172.21.15.146:0/2390502850 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d50011830 con 0x7f4d5c09e340 2023-10-03T10:17:27.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.790+0000 7f4d59d9b700 1 -- 172.21.15.146:0/2390502850 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d50011990 con 0x7f4d5c09e340 2023-10-03T10:17:27.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.790+0000 7f4d59d9b700 1 -- 172.21.15.146:0/2390502850 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d50011d20 con 0x7f4d5c09e340 2023-10-03T10:17:27.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.790+0000 7f4d61196700 1 -- 172.21.15.146:0/2390502850 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d5c09e340 msgr2=0x7f4d5c1359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.790+0000 7f4d61196700 1 --2- 172.21.15.146:0/2390502850 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d5c09e340 0x7f4d5c1359e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4d50009840 tx=0x7f4d50009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:27.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.790+0000 7f4d61196700 1 -- 172.21.15.146:0/2390502850 shutdown_connections 2023-10-03T10:17:27.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.790+0000 7f4d61196700 1 --2- 172.21.15.146:0/2390502850 >> v2:172.21.15.146:3300/0 conn(0x7f4d5c135f20 0x7f4d5c138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.790+0000 7f4d61196700 1 --2- 172.21.15.146:0/2390502850 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d5c09e340 0x7f4d5c1359e0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.790+0000 7f4d61196700 1 -- 172.21.15.146:0/2390502850 >> 172.21.15.146:0/2390502850 conn(0x7f4d5c099c40 msgr2=0x7f4d5c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.791+0000 7f4d61196700 1 -- 172.21.15.146:0/2390502850 shutdown_connections 2023-10-03T10:17:27.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.791+0000 7f4d61196700 1 -- 172.21.15.146:0/2390502850 wait complete. 2023-10-03T10:17:27.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.792+0000 7f4d61196700 1 Processor -- start 2023-10-03T10:17:27.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.792+0000 7f4d61196700 1 -- start start 2023-10-03T10:17:27.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.792+0000 7f4d61196700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d5c09d860 0x7f4d5c11d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.792+0000 7f4d61196700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d5c09e340 0x7f4d5c11db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.792+0000 7f4d61196700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d5c135f20 0x7f4d5c11e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.792+0000 7f4d61196700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c11fa40 con 0x7f4d5c135f20 2023-10-03T10:17:27.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.792+0000 7f4d61196700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c120e80 con 0x7f4d5c09d860 2023-10-03T10:17:27.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.792+0000 7f4d61196700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c11f360 con 0x7f4d5c09e340 2023-10-03T10:17:27.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.792+0000 7f4d5a59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d5c09e340 0x7f4d5c11db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.792+0000 7f4d5a59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d5c09e340 0x7f4d5c11db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37776/0 (socket says 172.21.15.146:37776) 2023-10-03T10:17:27.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.792+0000 7f4d5a59c700 1 -- 172.21.15.146:0/3969226998 learned_addr learned my addr 172.21.15.146:0/3969226998 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:27.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.792+0000 7f4d5b59e700 1 --2- 172.21.15.146:0/3969226998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d5c135f20 0x7f4d5c11e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.792+0000 7f4d5ad9d700 1 --2- 172.21.15.146:0/3969226998 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d5c09d860 0x7f4d5c11d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.793+0000 7f4d5b59e700 1 -- 172.21.15.146:0/3969226998 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d5c09e340 msgr2=0x7f4d5c11db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.793+0000 7f4d5b59e700 1 --2- 172.21.15.146:0/3969226998 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d5c09e340 0x7f4d5c11db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.793+0000 7f4d5b59e700 1 -- 172.21.15.146:0/3969226998 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d5c09d860 msgr2=0x7f4d5c11d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.793+0000 7f4d5b59e700 1 --2- 172.21.15.146:0/3969226998 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d5c09d860 0x7f4d5c11d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.793+0000 7f4d5b59e700 1 -- 172.21.15.146:0/3969226998 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d500094a0 con 0x7f4d5c135f20 2023-10-03T10:17:27.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.793+0000 7f4d5a59c700 1 --2- 172.21.15.146:0/3969226998 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d5c09e340 0x7f4d5c11db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:27.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.793+0000 7f4d5b59e700 1 --2- 172.21.15.146:0/3969226998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d5c135f20 0x7f4d5c11e0c0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400efc0 tx=0x7f4d5400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.793+0000 7f4d437fe700 1 -- 172.21.15.146:0/3969226998 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5400cc90 con 0x7f4d5c135f20 2023-10-03T10:17:27.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.793+0000 7f4d437fe700 1 -- 172.21.15.146:0/3969226998 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5400f040 con 0x7f4d5c135f20 2023-10-03T10:17:27.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.793+0000 7f4d61196700 1 -- 172.21.15.146:0/3969226998 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d5c1321a0 con 0x7f4d5c135f20 2023-10-03T10:17:27.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.793+0000 7f4d437fe700 1 -- 172.21.15.146:0/3969226998 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d540146c0 con 0x7f4d5c135f20 2023-10-03T10:17:27.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.793+0000 7f4d61196700 1 -- 172.21.15.146:0/3969226998 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d5c120bc0 con 0x7f4d5c135f20 2023-10-03T10:17:27.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.794+0000 7f4d61196700 1 -- 172.21.15.146:0/3969226998 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d5c04f2a0 con 0x7f4d5c135f20 2023-10-03T10:17:27.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.795+0000 7f4d437fe700 1 -- 172.21.15.146:0/3969226998 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d54014820 con 0x7f4d5c135f20 2023-10-03T10:17:27.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.795+0000 7f4d437fe700 1 -- 172.21.15.146:0/3969226998 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4d54040760 con 0x7f4d5c135f20 2023-10-03T10:17:27.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.799+0000 7f4d437fe700 1 -- 172.21.15.146:0/3969226998 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d54014ad0 con 0x7f4d5c135f20 2023-10-03T10:17:27.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.859+0000 7fe4dba4a700 1 -- 172.21.15.146:0/393704135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe4d404f2a0 con 0x7fe4d409dec0 2023-10-03T10:17:27.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.859+0000 7fe4c9ffb700 1 -- 172.21.15.146:0/393704135 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4c4011360 con 0x7fe4d409dec0 2023-10-03T10:17:27.860 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.861+0000 7fe4dba4a700 1 -- 172.21.15.146:0/393704135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4d409dec0 msgr2=0x7fe4d409a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.861+0000 7fe4dba4a700 1 --2- 172.21.15.146:0/393704135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4d409dec0 0x7fe4d409a9d0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400c520 tx=0x7fe4c400c830 comp rx=0 tx=0).stop 2023-10-03T10:17:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.862+0000 7fe4dba4a700 1 -- 172.21.15.146:0/393704135 shutdown_connections 2023-10-03T10:17:27.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.862+0000 7fe4dba4a700 1 --2- 172.21.15.146:0/393704135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4d4136cb0 0x7fe4d409af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.862+0000 7fe4dba4a700 1 --2- 172.21.15.146:0/393704135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe4d406a770 0x7fe4d409a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.862+0000 7fe4dba4a700 1 --2- 172.21.15.146:0/393704135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4d409dec0 0x7fe4d409a9d0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.862+0000 7fe4dba4a700 1 -- 172.21.15.146:0/393704135 >> 172.21.15.146:0/393704135 conn(0x7fe4d4099c40 msgr2=0x7fe4d4138910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.862+0000 7fe4dba4a700 1 -- 172.21.15.146:0/393704135 shutdown_connections 2023-10-03T10:17:27.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.862+0000 7fe4dba4a700 1 -- 172.21.15.146:0/393704135 wait complete. 2023-10-03T10:17:27.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:27.882 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:27.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.927+0000 7fabe2d0a700 1 -- 172.21.15.146:0/386731053 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fabdc072980 con 0x7fabdc0a0a70 2023-10-03T10:17:27.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.928+0000 7fabd97fa700 1 -- 172.21.15.146:0/386731053 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fabd0011360 con 0x7fabdc0a0a70 2023-10-03T10:17:27.928 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:27.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.930+0000 7fabe2d0a700 1 -- 172.21.15.146:0/386731053 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fabdc0a0a70 msgr2=0x7fabdc11e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.930+0000 7fabe2d0a700 1 --2- 172.21.15.146:0/386731053 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fabdc0a0a70 0x7fabdc11e780 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fabd000c520 tx=0x7fabd000c830 comp rx=0 tx=0).stop 2023-10-03T10:17:27.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.930+0000 7fabe2d0a700 1 -- 172.21.15.146:0/386731053 shutdown_connections 2023-10-03T10:17:27.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.930+0000 7fabe2d0a700 1 --2- 172.21.15.146:0/386731053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabdc139200 0x7fabdc11f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.930+0000 7fabe2d0a700 1 --2- 172.21.15.146:0/386731053 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fabdc0a0a70 0x7fabdc11e780 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.930+0000 7fabe2d0a700 1 --2- 172.21.15.146:0/386731053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabdc0a1550 0x7fabdc11ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.930+0000 7fabe2d0a700 1 -- 172.21.15.146:0/386731053 >> 172.21.15.146:0/386731053 conn(0x7fabdc0a6610 msgr2=0x7fabdc0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.930+0000 7fabe2d0a700 1 -- 172.21.15.146:0/386731053 shutdown_connections 2023-10-03T10:17:27.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.930+0000 7fabe2d0a700 1 -- 172.21.15.146:0/386731053 wait complete. 2023-10-03T10:17:27.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:27.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.999+0000 7f4d61196700 1 -- 172.21.15.146:0/3969226998 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4d5c072000 con 0x7f4d5c135f20 2023-10-03T10:17:27.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:27.999+0000 7f4d437fe700 1 -- 172.21.15.146:0/3969226998 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d5401c3b0 con 0x7f4d5c135f20 2023-10-03T10:17:28.000 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:28.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.001+0000 7f4d61196700 1 -- 172.21.15.146:0/3969226998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d5c135f20 msgr2=0x7f4d5c11e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.001+0000 7f4d61196700 1 --2- 172.21.15.146:0/3969226998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d5c135f20 0x7f4d5c11e0c0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400efc0 tx=0x7f4d5400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.001+0000 7f4d61196700 1 -- 172.21.15.146:0/3969226998 shutdown_connections 2023-10-03T10:17:28.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.001+0000 7f4d61196700 1 --2- 172.21.15.146:0/3969226998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d5c135f20 0x7f4d5c11e0c0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.001+0000 7f4d61196700 1 --2- 172.21.15.146:0/3969226998 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d5c09d860 0x7f4d5c11d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.001+0000 7f4d61196700 1 --2- 172.21.15.146:0/3969226998 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d5c09e340 0x7f4d5c11db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.001+0000 7f4d61196700 1 -- 172.21.15.146:0/3969226998 >> 172.21.15.146:0/3969226998 conn(0x7f4d5c099c40 msgr2=0x7f4d5c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.001+0000 7f4d61196700 1 -- 172.21.15.146:0/3969226998 shutdown_connections 2023-10-03T10:17:28.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.001+0000 7f4d61196700 1 -- 172.21.15.146:0/3969226998 wait complete. 2023-10-03T10:17:28.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.009+0000 7f162d29b700 1 Processor -- start 2023-10-03T10:17:28.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.009+0000 7f162d29b700 1 -- start start 2023-10-03T10:17:28.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.010+0000 7f162d29b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f162809e870 0x7f162809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.010+0000 7f162d29b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f162809f180 0x7f1628131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.010+0000 7f162d29b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162809c970 con 0x7f1628131d70 2023-10-03T10:17:28.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.010+0000 7f162d29b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16280a0920 con 0x7f162809f180 2023-10-03T10:17:28.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.010+0000 7f162d29b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f162809f9c0 con 0x7f162809e870 2023-10-03T10:17:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.010+0000 7f16267fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f162809f180 0x7f1628131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.010+0000 7f1626ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f162809e870 0x7f162809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.010+0000 7f1626ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f162809e870 0x7f162809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37780/0 (socket says 172.21.15.146:37780) 2023-10-03T10:17:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.010+0000 7f16267fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f162809f180 0x7f1628131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45252/0 (socket says 172.21.15.146:45252) 2023-10-03T10:17:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.010+0000 7f1626ffd700 1 -- 172.21.15.146:0/1903835144 learned_addr learned my addr 172.21.15.146:0/1903835144 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.010+0000 7f16277fe700 1 --1- 172.21.15.146:0/1903835144 >> v1:172.21.15.146:6789/0 conn(0x7f1628131d70 0x7f1628138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58484/0 (socket says 172.21.15.146:58484) 2023-10-03T10:17:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.010+0000 7f1626ffd700 1 -- 172.21.15.146:0/1903835144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f162809f180 msgr2=0x7f1628131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.010+0000 7f1626ffd700 1 --2- 172.21.15.146:0/1903835144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f162809f180 0x7f1628131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.010+0000 7f1626ffd700 1 -- 172.21.15.146:0/1903835144 >> v1:172.21.15.146:6789/0 conn(0x7f1628131d70 legacy=0x7f1628138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.010+0000 7f1625ffb700 1 -- 172.21.15.146:0/1903835144 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652796201 0 0) 0x7f162809c970 con 0x7f1628131d70 2023-10-03T10:17:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.010+0000 7f1626ffd700 1 -- 172.21.15.146:0/1903835144 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162809bab0 con 0x7f162809e870 2023-10-03T10:17:28.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.010+0000 7f16267fc700 1 --2- 172.21.15.146:0/1903835144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f162809f180 0x7f1628131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:28.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.010+0000 7f1626ffd700 1 --2- 172.21.15.146:0/1903835144 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f162809e870 0x7f162809ec40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1618009920 tx=0x7f1618009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9709b1869ea78ad9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.010+0000 7f1625ffb700 1 -- 172.21.15.146:0/1903835144 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618011830 con 0x7f162809e870 2023-10-03T10:17:28.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.011+0000 7f1625ffb700 1 -- 172.21.15.146:0/1903835144 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1618011990 con 0x7f162809e870 2023-10-03T10:17:28.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.011+0000 7f1625ffb700 1 -- 172.21.15.146:0/1903835144 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618011d20 con 0x7f162809e870 2023-10-03T10:17:28.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.011+0000 7f162d29b700 1 -- 172.21.15.146:0/1903835144 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f162809e870 msgr2=0x7f162809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.011+0000 7f162d29b700 1 --2- 172.21.15.146:0/1903835144 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f162809e870 0x7f162809ec40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1618009920 tx=0x7f1618009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:28.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.011+0000 7f162d29b700 1 -- 172.21.15.146:0/1903835144 shutdown_connections 2023-10-03T10:17:28.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.011+0000 7f162d29b700 1 --2- 172.21.15.146:0/1903835144 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f162809e870 0x7f162809ec40 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.011+0000 7f162d29b700 1 --2- 172.21.15.146:0/1903835144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f162809f180 0x7f1628131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.011+0000 7f162d29b700 1 -- 172.21.15.146:0/1903835144 >> 172.21.15.146:0/1903835144 conn(0x7f16280a4430 msgr2=0x7f16280a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.012+0000 7f162d29b700 1 -- 172.21.15.146:0/1903835144 shutdown_connections 2023-10-03T10:17:28.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.012+0000 7f162d29b700 1 -- 172.21.15.146:0/1903835144 wait complete. 2023-10-03T10:17:28.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.013+0000 7f162d29b700 1 Processor -- start 2023-10-03T10:17:28.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.013+0000 7f162d29b700 1 -- start start 2023-10-03T10:17:28.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.013+0000 7f162d29b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f162809e870 0x7f162806b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.013+0000 7f162d29b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f162809f180 0x7f162806bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.014+0000 7f162d29b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1628131d70 0x7f162806c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.014+0000 7f162d29b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162806d480 con 0x7f1628131d70 2023-10-03T10:17:28.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.014+0000 7f162d29b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16281312c0 con 0x7f162809f180 2023-10-03T10:17:28.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.014+0000 7f162d29b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f162809dba0 con 0x7f162809e870 2023-10-03T10:17:28.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.014+0000 7f1626ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f162809e870 0x7f162806b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.014+0000 7f1626ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f162809e870 0x7f162806b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37786/0 (socket says 172.21.15.146:37786) 2023-10-03T10:17:28.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.014+0000 7f1626ffd700 1 -- 172.21.15.146:0/3982971314 learned_addr learned my addr 172.21.15.146:0/3982971314 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:28.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.014+0000 7f16267fc700 1 --2- 172.21.15.146:0/3982971314 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f162809f180 0x7f162806bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.014+0000 7f16277fe700 1 --2- 172.21.15.146:0/3982971314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1628131d70 0x7f162806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.014+0000 7f1626ffd700 1 -- 172.21.15.146:0/3982971314 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f162809f180 msgr2=0x7f162806bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.014+0000 7f1626ffd700 1 --2- 172.21.15.146:0/3982971314 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f162809f180 0x7f162806bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.014+0000 7f1626ffd700 1 -- 172.21.15.146:0/3982971314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1628131d70 msgr2=0x7f162806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.014+0000 7f1626ffd700 1 --2- 172.21.15.146:0/3982971314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1628131d70 0x7f162806c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.014+0000 7f1626ffd700 1 -- 172.21.15.146:0/3982971314 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c0094a0 con 0x7f162809e870 2023-10-03T10:17:28.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.014+0000 7f16267fc700 1 --2- 172.21.15.146:0/3982971314 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f162809f180 0x7f162806bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:28.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.014+0000 7f16277fe700 1 --2- 172.21.15.146:0/3982971314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1628131d70 0x7f162806c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:28.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.014+0000 7f1626ffd700 1 --2- 172.21.15.146:0/3982971314 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f162809e870 0x7f162806b880 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f1618000c00 tx=0x7f1618004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.014+0000 7f160f7fe700 1 -- 172.21.15.146:0/3982971314 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618004450 con 0x7f162809e870 2023-10-03T10:17:28.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:28.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.014+0000 7f160f7fe700 1 -- 172.21.15.146:0/3982971314 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16180045d0 con 0x7f162809e870 2023-10-03T10:17:28.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.014+0000 7f162d29b700 1 -- 172.21.15.146:0/3982971314 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1618009550 con 0x7f162809e870 2023-10-03T10:17:28.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.014+0000 7f160f7fe700 1 -- 172.21.15.146:0/3982971314 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16180038e0 con 0x7f162809e870 2023-10-03T10:17:28.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.014+0000 7f162d29b700 1 -- 172.21.15.146:0/3982971314 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1628125ff0 con 0x7f162809e870 2023-10-03T10:17:28.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.015+0000 7f160f7fe700 1 -- 172.21.15.146:0/3982971314 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1618003a40 con 0x7f162809e870 2023-10-03T10:17:28.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.015+0000 7f160f7fe700 1 -- 172.21.15.146:0/3982971314 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1618020030 con 0x7f162809e870 2023-10-03T10:17:28.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.015+0000 7f162d29b700 1 -- 172.21.15.146:0/3982971314 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162804f2a0 con 0x7f162809e870 2023-10-03T10:17:28.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.020+0000 7f160f7fe700 1 -- 172.21.15.146:0/3982971314 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1618015080 con 0x7f162809e870 2023-10-03T10:17:28.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.206+0000 7f162d29b700 1 -- 172.21.15.146:0/3982971314 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1628131b50 con 0x7f162809e870 2023-10-03T10:17:28.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.207+0000 7f160f7fe700 1 -- 172.21.15.146:0/3982971314 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f161802a020 con 0x7f162809e870 2023-10-03T10:17:28.207 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:28.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.209+0000 7f162d29b700 1 -- 172.21.15.146:0/3982971314 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f162809e870 msgr2=0x7f162806b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.209+0000 7f162d29b700 1 --2- 172.21.15.146:0/3982971314 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f162809e870 0x7f162806b880 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f1618000c00 tx=0x7f1618004750 comp rx=0 tx=0).stop 2023-10-03T10:17:28.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.209+0000 7f162d29b700 1 -- 172.21.15.146:0/3982971314 shutdown_connections 2023-10-03T10:17:28.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.209+0000 7f162d29b700 1 --2- 172.21.15.146:0/3982971314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1628131d70 0x7f162806c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.209+0000 7f162d29b700 1 --2- 172.21.15.146:0/3982971314 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f162809e870 0x7f162806b880 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.209+0000 7f162d29b700 1 --2- 172.21.15.146:0/3982971314 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f162809f180 0x7f162806bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.209+0000 7f162d29b700 1 -- 172.21.15.146:0/3982971314 >> 172.21.15.146:0/3982971314 conn(0x7f16280a4430 msgr2=0x7f162811a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.209+0000 7f162d29b700 1 -- 172.21.15.146:0/3982971314 shutdown_connections 2023-10-03T10:17:28.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:28.209+0000 7f162d29b700 1 -- 172.21.15.146:0/3982971314 wait complete. 2023-10-03T10:17:28.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:28.875 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:28.944 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:29.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.011+0000 7f69fff12700 1 Processor -- start 2023-10-03T10:17:29.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.012+0000 7f69fff12700 1 -- start start 2023-10-03T10:17:29.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.012+0000 7f69fff12700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f69f809ad40 0x7f69f8133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.012+0000 7f69fff12700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f69f8133f70 0x7f69f81343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.012+0000 7f69fff12700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f80a0a70 0x7f69f80a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.012+0000 7f69fff12700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f80a3b60 con 0x7f69f809ad40 2023-10-03T10:17:29.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.012+0000 7f69fff12700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f81348e0 con 0x7f69f80a0a70 2023-10-03T10:17:29.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.012+0000 7f69fff12700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69f809b110 con 0x7f69f8133f70 2023-10-03T10:17:29.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.012+0000 7f69fdcae700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f69f809ad40 0x7f69f8133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.012+0000 7f69fd4ad700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f69f8133f70 0x7f69f81343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.012+0000 7f69fd4ad700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f69f8133f70 0x7f69f81343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37802/0 (socket says 172.21.15.146:37802) 2023-10-03T10:17:29.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.012+0000 7f69fdcae700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f69f809ad40 0x7f69f8133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52018/0 (socket says 172.21.15.146:52018) 2023-10-03T10:17:29.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.012+0000 7f69fd4ad700 1 -- 172.21.15.146:0/224253832 learned_addr learned my addr 172.21.15.146:0/224253832 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:29.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.012+0000 7f69fe4af700 1 --2- 172.21.15.146:0/224253832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f80a0a70 0x7f69f80a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.013+0000 7f69fd4ad700 1 -- 172.21.15.146:0/224253832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f80a0a70 msgr2=0x7f69f80a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.013+0000 7f69fd4ad700 1 --2- 172.21.15.146:0/224253832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f80a0a70 0x7f69f80a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.013+0000 7f69fd4ad700 1 -- 172.21.15.146:0/224253832 >> v2:172.21.15.146:3300/0 conn(0x7f69f809ad40 msgr2=0x7f69f8133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.013+0000 7f69fd4ad700 1 --2- 172.21.15.146:0/224253832 >> v2:172.21.15.146:3300/0 conn(0x7f69f809ad40 0x7f69f8133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.013+0000 7f69fd4ad700 1 -- 172.21.15.146:0/224253832 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f80a2fa0 con 0x7f69f8133f70 2023-10-03T10:17:29.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.013+0000 7f69fdcae700 1 --2- 172.21.15.146:0/224253832 >> v2:172.21.15.146:3300/0 conn(0x7f69f809ad40 0x7f69f8133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.013+0000 7f69fd4ad700 1 --2- 172.21.15.146:0/224253832 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f69f8133f70 0x7f69f81343a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f69e8009920 tx=0x7f69e8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5f0431189c81f5f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.013+0000 7f69fccac700 1 -- 172.21.15.146:0/224253832 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e8011830 con 0x7f69f8133f70 2023-10-03T10:17:29.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.013+0000 7f69fccac700 1 -- 172.21.15.146:0/224253832 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e8011990 con 0x7f69f8133f70 2023-10-03T10:17:29.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.013+0000 7f69fccac700 1 -- 172.21.15.146:0/224253832 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e8011d20 con 0x7f69f8133f70 2023-10-03T10:17:29.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.013+0000 7f69fff12700 1 -- 172.21.15.146:0/224253832 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f69f8133f70 msgr2=0x7f69f81343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.013+0000 7f69fff12700 1 --2- 172.21.15.146:0/224253832 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f69f8133f70 0x7f69f81343a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f69e8009920 tx=0x7f69e8009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:29.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.014+0000 7f69fff12700 1 -- 172.21.15.146:0/224253832 shutdown_connections 2023-10-03T10:17:29.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.014+0000 7f69fff12700 1 --2- 172.21.15.146:0/224253832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f80a0a70 0x7f69f80a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.014+0000 7f69fff12700 1 --2- 172.21.15.146:0/224253832 >> v2:172.21.15.146:3300/0 conn(0x7f69f809ad40 0x7f69f8133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.014+0000 7f69fff12700 1 --2- 172.21.15.146:0/224253832 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f69f8133f70 0x7f69f81343a0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.014+0000 7f69fff12700 1 -- 172.21.15.146:0/224253832 >> 172.21.15.146:0/224253832 conn(0x7f69f8099c40 msgr2=0x7f69f806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.014+0000 7f69fff12700 1 -- 172.21.15.146:0/224253832 shutdown_connections 2023-10-03T10:17:29.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.014+0000 7f69fff12700 1 -- 172.21.15.146:0/224253832 wait complete. 2023-10-03T10:17:29.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.015+0000 7f69fff12700 1 Processor -- start 2023-10-03T10:17:29.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.015+0000 7f69fff12700 1 -- start start 2023-10-03T10:17:29.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.015+0000 7f69fff12700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f69f809ad40 0x7f69f81c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.015+0000 7f69fff12700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f80a0a70 0x7f69f81c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.015+0000 7f69fff12700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f8133f70 0x7f69f81c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.015+0000 7f69fff12700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f8122330 con 0x7f69f8133f70 2023-10-03T10:17:29.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.015+0000 7f69fff12700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f8133820 con 0x7f69f80a0a70 2023-10-03T10:17:29.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.015+0000 7f69fff12700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69f8122070 con 0x7f69f809ad40 2023-10-03T10:17:29.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.015+0000 7f69fd4ad700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f80a0a70 0x7f69f81c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.015+0000 7f69fdcae700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f69f809ad40 0x7f69f81c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.015+0000 7f69fd4ad700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f80a0a70 0x7f69f81c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45264/0 (socket says 172.21.15.146:45264) 2023-10-03T10:17:29.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.015+0000 7f69fd4ad700 1 -- 172.21.15.146:0/3013684802 learned_addr learned my addr 172.21.15.146:0/3013684802 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:29.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.015+0000 7f69fe4af700 1 --2- 172.21.15.146:0/3013684802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f8133f70 0x7f69f81c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.015+0000 7f69fd4ad700 1 -- 172.21.15.146:0/3013684802 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f69f809ad40 msgr2=0x7f69f81c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.015+0000 7f69fd4ad700 1 --2- 172.21.15.146:0/3013684802 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f69f809ad40 0x7f69f81c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.015+0000 7f69fd4ad700 1 -- 172.21.15.146:0/3013684802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f8133f70 msgr2=0x7f69f81c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.015+0000 7f69fd4ad700 1 --2- 172.21.15.146:0/3013684802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f8133f70 0x7f69f81c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.015+0000 7f69fd4ad700 1 -- 172.21.15.146:0/3013684802 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f40094a0 con 0x7f69f80a0a70 2023-10-03T10:17:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.015+0000 7f69fe4af700 1 --2- 172.21.15.146:0/3013684802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f8133f70 0x7f69f81c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.015+0000 7f69fdcae700 1 --2- 172.21.15.146:0/3013684802 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f69f809ad40 0x7f69f81c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.016+0000 7f69fd4ad700 1 --2- 172.21.15.146:0/3013684802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f80a0a70 0x7f69f81c8840 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f69e8009870 tx=0x7f69e8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.016+0000 7f69ee7fc700 1 -- 172.21.15.146:0/3013684802 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e8004450 con 0x7f69f80a0a70 2023-10-03T10:17:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.016+0000 7f69ee7fc700 1 -- 172.21.15.146:0/3013684802 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e80045b0 con 0x7f69f80a0a70 2023-10-03T10:17:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.016+0000 7f69fff12700 1 -- 172.21.15.146:0/3013684802 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e8009550 con 0x7f69f80a0a70 2023-10-03T10:17:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.016+0000 7f69ee7fc700 1 -- 172.21.15.146:0/3013684802 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e80038e0 con 0x7f69f80a0a70 2023-10-03T10:17:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.016+0000 7f69fff12700 1 -- 172.21.15.146:0/3013684802 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f8122da0 con 0x7f69f80a0a70 2023-10-03T10:17:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.017+0000 7f69ee7fc700 1 -- 172.21.15.146:0/3013684802 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f69e8003a40 con 0x7f69f80a0a70 2023-10-03T10:17:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.017+0000 7f69ee7fc700 1 -- 172.21.15.146:0/3013684802 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f69e8040530 con 0x7f69f80a0a70 2023-10-03T10:17:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.017+0000 7f69fff12700 1 -- 172.21.15.146:0/3013684802 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f8122570 con 0x7f69f80a0a70 2023-10-03T10:17:29.021 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.021+0000 7f69ee7fc700 1 -- 172.21.15.146:0/3013684802 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f69e801a420 con 0x7f69f80a0a70 2023-10-03T10:17:29.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.074+0000 7fac9964b700 1 Processor -- start 2023-10-03T10:17:29.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.074+0000 7fac9964b700 1 -- start start 2023-10-03T10:17:29.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.075+0000 7fac9964b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac9409f350 0x7fac94138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.075+0000 7fac9964b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fac941393a0 0x7fac9413b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.075+0000 7fac9964b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9409fa00 con 0x7fac9409e870 2023-10-03T10:17:29.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.075+0000 7fac9964b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac940a0370 con 0x7fac941393a0 2023-10-03T10:17:29.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.075+0000 7fac9964b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac9406bec0 con 0x7fac9409f350 2023-10-03T10:17:29.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.075+0000 7fac937fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fac941393a0 0x7fac9413b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.075+0000 7fac927fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac9409f350 0x7fac94138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.075+0000 7fac92ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fac9409e870 0x7fac9409ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58498/0 (socket says 172.21.15.146:58498) 2023-10-03T10:17:29.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.075+0000 7fac937fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fac941393a0 0x7fac9413b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52042/0 (socket says 172.21.15.146:52042) 2023-10-03T10:17:29.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.075+0000 7fac927fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac9409f350 0x7fac94138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37830/0 (socket says 172.21.15.146:37830) 2023-10-03T10:17:29.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.075+0000 7fac92ffd700 1 -- 172.21.15.146:0/469993462 learned_addr learned my addr 172.21.15.146:0/469993462 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:29.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.075+0000 7fac937fe700 1 -- 172.21.15.146:0/469993462 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac9409f350 msgr2=0x7fac94138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.075+0000 7fac937fe700 1 --2- 172.21.15.146:0/469993462 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac9409f350 0x7fac94138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.075+0000 7fac937fe700 1 -- 172.21.15.146:0/469993462 >> v1:172.21.15.146:6789/0 conn(0x7fac9409e870 legacy=0x7fac9409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.075+0000 7fac937fe700 1 -- 172.21.15.146:0/469993462 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9409ada0 con 0x7fac941393a0 2023-10-03T10:17:29.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.075+0000 7fac927fc700 1 --2- 172.21.15.146:0/469993462 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac9409f350 0x7fac94138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.076+0000 7fac937fe700 1 --2- 172.21.15.146:0/469993462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac941393a0 0x7fac9413b780 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fac8c009d90 tx=0x7fac8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d5ea36deb195e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.076+0000 7fac91ffb700 1 -- 172.21.15.146:0/469993462 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8c00e070 con 0x7fac941393a0 2023-10-03T10:17:29.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.076+0000 7fac91ffb700 1 -- 172.21.15.146:0/469993462 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8c00bb20 con 0x7fac941393a0 2023-10-03T10:17:29.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.076+0000 7fac91ffb700 1 -- 172.21.15.146:0/469993462 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8c012430 con 0x7fac941393a0 2023-10-03T10:17:29.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.076+0000 7fac9964b700 1 -- 172.21.15.146:0/469993462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac941393a0 msgr2=0x7fac9413b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.076+0000 7fac9964b700 1 --2- 172.21.15.146:0/469993462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac941393a0 0x7fac9413b780 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fac8c009d90 tx=0x7fac8c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:29.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.076+0000 7fac9964b700 1 -- 172.21.15.146:0/469993462 shutdown_connections 2023-10-03T10:17:29.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.076+0000 7fac9964b700 1 --2- 172.21.15.146:0/469993462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac941393a0 0x7fac9413b780 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.076+0000 7fac9964b700 1 --2- 172.21.15.146:0/469993462 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac9409f350 0x7fac94138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.077+0000 7fac9964b700 1 -- 172.21.15.146:0/469993462 >> 172.21.15.146:0/469993462 conn(0x7fac940a4430 msgr2=0x7fac940a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.077+0000 7fac9964b700 1 -- 172.21.15.146:0/469993462 shutdown_connections 2023-10-03T10:17:29.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.077+0000 7fac9964b700 1 -- 172.21.15.146:0/469993462 wait complete. 2023-10-03T10:17:29.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.078+0000 7fac9964b700 1 Processor -- start 2023-10-03T10:17:29.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.078+0000 7fac9964b700 1 -- start start 2023-10-03T10:17:29.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.078+0000 7fac9964b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac9409e870 0x7fac9411ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.078+0000 7fac9964b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac9409f350 0x7fac9411f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.078+0000 7fac9964b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac941393a0 0x7fac9411f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.078+0000 7fac9964b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac941220b0 con 0x7fac941393a0 2023-10-03T10:17:29.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.078+0000 7fac9964b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac94120770 con 0x7fac9409f350 2023-10-03T10:17:29.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.078+0000 7fac9964b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac9406fa10 con 0x7fac9409e870 2023-10-03T10:17:29.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.078+0000 7fac92ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac9409e870 0x7fac9411ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.078+0000 7fac927fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac9409f350 0x7fac9411f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.078+0000 7fac92ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac9409e870 0x7fac9411ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37836/0 (socket says 172.21.15.146:37836) 2023-10-03T10:17:29.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.078+0000 7fac927fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac9409f350 0x7fac9411f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45274/0 (socket says 172.21.15.146:45274) 2023-10-03T10:17:29.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.078+0000 7fac92ffd700 1 -- 172.21.15.146:0/3759035218 learned_addr learned my addr 172.21.15.146:0/3759035218 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:29.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.078+0000 7fac937fe700 1 --2- 172.21.15.146:0/3759035218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac941393a0 0x7fac9411f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.079+0000 7fac92ffd700 1 -- 172.21.15.146:0/3759035218 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac9409f350 msgr2=0x7fac9411f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.079+0000 7fac92ffd700 1 --2- 172.21.15.146:0/3759035218 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac9409f350 0x7fac9411f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.079+0000 7fac92ffd700 1 -- 172.21.15.146:0/3759035218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac941393a0 msgr2=0x7fac9411f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.079+0000 7fac92ffd700 1 --2- 172.21.15.146:0/3759035218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac941393a0 0x7fac9411f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.079+0000 7fac92ffd700 1 -- 172.21.15.146:0/3759035218 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac880094a0 con 0x7fac9409e870 2023-10-03T10:17:29.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.079+0000 7fac927fc700 1 --2- 172.21.15.146:0/3759035218 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac9409f350 0x7fac9411f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.079+0000 7fac92ffd700 1 --2- 172.21.15.146:0/3759035218 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac9409e870 0x7fac9411ead0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fac8400c480 tx=0x7fac8400c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.079+0000 7fac7b7fe700 1 -- 172.21.15.146:0/3759035218 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac84005d70 con 0x7fac9409e870 2023-10-03T10:17:29.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.079+0000 7fac7b7fe700 1 -- 172.21.15.146:0/3759035218 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac840070d0 con 0x7fac9409e870 2023-10-03T10:17:29.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.079+0000 7fac9964b700 1 -- 172.21.15.146:0/3759035218 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8c009a70 con 0x7fac9409e870 2023-10-03T10:17:29.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.079+0000 7fac7b7fe700 1 -- 172.21.15.146:0/3759035218 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac84007440 con 0x7fac9409e870 2023-10-03T10:17:29.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.079+0000 7fac9964b700 1 -- 172.21.15.146:0/3759035218 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac941225e0 con 0x7fac9409e870 2023-10-03T10:17:29.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.080+0000 7fac9964b700 1 -- 172.21.15.146:0/3759035218 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac9404f2a0 con 0x7fac9409e870 2023-10-03T10:17:29.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.080+0000 7fac7b7fe700 1 -- 172.21.15.146:0/3759035218 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fac840075a0 con 0x7fac9409e870 2023-10-03T10:17:29.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.080+0000 7fac7b7fe700 1 -- 172.21.15.146:0/3759035218 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fac8403ea20 con 0x7fac9409e870 2023-10-03T10:17:29.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.085+0000 7fac7b7fe700 1 -- 172.21.15.146:0/3759035218 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac84019b40 con 0x7fac9409e870 2023-10-03T10:17:29.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.147+0000 7f4e3d18f700 1 Processor -- start 2023-10-03T10:17:29.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.147+0000 7f4e3d18f700 1 -- start start 2023-10-03T10:17:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.148+0000 7f4e3d18f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e3809e870 0x7f4e3809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.148+0000 7f4e3d18f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4e38131f40 0x7f4e38139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.148+0000 7f4e3d18f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3809c970 con 0x7f4e3809f180 2023-10-03T10:17:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.148+0000 7f4e3d18f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e380a0920 con 0x7f4e38131f40 2023-10-03T10:17:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.148+0000 7f4e3d18f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3809f9c0 con 0x7f4e3809e870 2023-10-03T10:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.148+0000 7f4e3659c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4e3809f180 0x7f4e38131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58506/0 (socket says 172.21.15.146:58506) 2023-10-03T10:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.148+0000 7f4e3659c700 1 -- 172.21.15.146:0/1458606373 learned_addr learned my addr 172.21.15.146:0/1458606373 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.148+0000 7f4e36d9d700 1 --2- 172.21.15.146:0/1458606373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e3809e870 0x7f4e3809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.148+0000 7f4e3759e700 1 --2- 172.21.15.146:0/1458606373 >> v2:172.21.15.146:3300/0 conn(0x7f4e38131f40 0x7f4e38139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.148+0000 7f4e36d9d700 1 -- 172.21.15.146:0/1458606373 >> v2:172.21.15.146:3300/0 conn(0x7f4e38131f40 msgr2=0x7f4e38139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.148+0000 7f4e36d9d700 1 --2- 172.21.15.146:0/1458606373 >> v2:172.21.15.146:3300/0 conn(0x7f4e38131f40 0x7f4e38139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.148+0000 7f4e36d9d700 1 -- 172.21.15.146:0/1458606373 >> v1:172.21.15.146:6789/0 conn(0x7f4e3809f180 legacy=0x7f4e38131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.148+0000 7f4e36d9d700 1 -- 172.21.15.146:0/1458606373 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3809bab0 con 0x7f4e3809e870 2023-10-03T10:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.148+0000 7f4e3759e700 1 --2- 172.21.15.146:0/1458606373 >> v2:172.21.15.146:3300/0 conn(0x7f4e38131f40 0x7f4e38139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.148+0000 7f4e36d9d700 1 --2- 172.21.15.146:0/1458606373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e3809e870 0x7f4e3809ec40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009840 tx=0x7f4e28009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a383a0df9f6a0a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.148+0000 7f4e35d9b700 1 -- 172.21.15.146:0/1458606373 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28011830 con 0x7f4e3809e870 2023-10-03T10:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.148+0000 7f4e35d9b700 1 -- 172.21.15.146:0/1458606373 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e28011990 con 0x7f4e3809e870 2023-10-03T10:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.148+0000 7f4e35d9b700 1 -- 172.21.15.146:0/1458606373 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28011d20 con 0x7f4e3809e870 2023-10-03T10:17:29.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.149+0000 7f4e3d18f700 1 -- 172.21.15.146:0/1458606373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e3809e870 msgr2=0x7f4e3809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.149+0000 7f4e3d18f700 1 --2- 172.21.15.146:0/1458606373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e3809e870 0x7f4e3809ec40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009840 tx=0x7f4e28009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.149+0000 7f4e3d18f700 1 -- 172.21.15.146:0/1458606373 shutdown_connections 2023-10-03T10:17:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.149+0000 7f4e3d18f700 1 --2- 172.21.15.146:0/1458606373 >> v2:172.21.15.146:3300/0 conn(0x7f4e38131f40 0x7f4e38139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.149+0000 7f4e3d18f700 1 --2- 172.21.15.146:0/1458606373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e3809e870 0x7f4e3809ec40 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.149+0000 7f4e3d18f700 1 -- 172.21.15.146:0/1458606373 >> 172.21.15.146:0/1458606373 conn(0x7f4e380a4430 msgr2=0x7f4e380a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.149+0000 7f4e3d18f700 1 -- 172.21.15.146:0/1458606373 shutdown_connections 2023-10-03T10:17:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.149+0000 7f4e3d18f700 1 -- 172.21.15.146:0/1458606373 wait complete. 2023-10-03T10:17:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.151+0000 7f4e3d18f700 1 Processor -- start 2023-10-03T10:17:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.151+0000 7f4e3d18f700 1 -- start start 2023-10-03T10:17:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.151+0000 7f4e3d18f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e3809e870 0x7f4e3806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.151+0000 7f4e3d18f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e3809f180 0x7f4e3806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.151+0000 7f4e3d18f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e38131f40 0x7f4e3806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.151+0000 7f4e3d18f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e381256f0 con 0x7f4e38131f40 2023-10-03T10:17:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.151+0000 7f4e3d18f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e381249d0 con 0x7f4e3809e870 2023-10-03T10:17:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.151+0000 7f4e3d18f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e38126010 con 0x7f4e3809f180 2023-10-03T10:17:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.151+0000 7f4e3659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e3809f180 0x7f4e3806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.151+0000 7f4e3659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e3809f180 0x7f4e3806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37850/0 (socket says 172.21.15.146:37850) 2023-10-03T10:17:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.151+0000 7f4e3659c700 1 -- 172.21.15.146:0/4112824545 learned_addr learned my addr 172.21.15.146:0/4112824545 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.151+0000 7f4e3759e700 1 --2- 172.21.15.146:0/4112824545 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e38131f40 0x7f4e3806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.151+0000 7f4e36d9d700 1 --2- 172.21.15.146:0/4112824545 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e3809e870 0x7f4e3806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.151+0000 7f4e3659c700 1 -- 172.21.15.146:0/4112824545 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e3809e870 msgr2=0x7f4e3806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.151+0000 7f4e3659c700 1 --2- 172.21.15.146:0/4112824545 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e3809e870 0x7f4e3806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.151+0000 7f4e3659c700 1 -- 172.21.15.146:0/4112824545 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e38131f40 msgr2=0x7f4e3806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.151+0000 7f4e3659c700 1 --2- 172.21.15.146:0/4112824545 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e38131f40 0x7f4e3806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.151+0000 7f4e3659c700 1 -- 172.21.15.146:0/4112824545 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e30009a70 con 0x7f4e3809f180 2023-10-03T10:17:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.152+0000 7f4e36d9d700 1 --2- 172.21.15.146:0/4112824545 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e3809e870 0x7f4e3806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.152+0000 7f4e3659c700 1 --2- 172.21.15.146:0/4112824545 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e3809f180 0x7f4e3806bdf0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00c530 tx=0x7f4e2c00c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.152+0000 7f4e1f7fe700 1 -- 172.21.15.146:0/4112824545 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c005d70 con 0x7f4e3809f180 2023-10-03T10:17:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.152+0000 7f4e1f7fe700 1 -- 172.21.15.146:0/4112824545 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c0070d0 con 0x7f4e3809f180 2023-10-03T10:17:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.152+0000 7f4e1f7fe700 1 -- 172.21.15.146:0/4112824545 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c007440 con 0x7f4e3809f180 2023-10-03T10:17:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.152+0000 7f4e3d18f700 1 -- 172.21.15.146:0/4112824545 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e280094a0 con 0x7f4e3809f180 2023-10-03T10:17:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.152+0000 7f4e3d18f700 1 -- 172.21.15.146:0/4112824545 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e38125a70 con 0x7f4e3809f180 2023-10-03T10:17:29.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.153+0000 7f4e1f7fe700 1 -- 172.21.15.146:0/4112824545 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e2c0075a0 con 0x7f4e3809f180 2023-10-03T10:17:29.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.153+0000 7f4e1f7fe700 1 -- 172.21.15.146:0/4112824545 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4e2c03ea60 con 0x7f4e3809f180 2023-10-03T10:17:29.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.153+0000 7f4e3d18f700 1 -- 172.21.15.146:0/4112824545 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3804f2a0 con 0x7f4e3809f180 2023-10-03T10:17:29.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.162+0000 7f4e1f7fe700 1 -- 172.21.15.146:0/4112824545 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e2c019b20 con 0x7f4e3809f180 2023-10-03T10:17:29.223 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:29.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.224+0000 7f69fff12700 1 -- 172.21.15.146:0/3013684802 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f69f804f2a0 con 0x7f69f80a0a70 2023-10-03T10:17:29.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.224+0000 7f69ee7fc700 1 -- 172.21.15.146:0/3013684802 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f69e8028030 con 0x7f69f80a0a70 2023-10-03T10:17:29.225 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.227+0000 7f69fff12700 1 -- 172.21.15.146:0/3013684802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f80a0a70 msgr2=0x7f69f81c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.227+0000 7f69fff12700 1 --2- 172.21.15.146:0/3013684802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f80a0a70 0x7f69f81c8840 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f69e8009870 tx=0x7f69e8004750 comp rx=0 tx=0).stop 2023-10-03T10:17:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.227+0000 7f69fff12700 1 -- 172.21.15.146:0/3013684802 shutdown_connections 2023-10-03T10:17:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.227+0000 7f69fff12700 1 --2- 172.21.15.146:0/3013684802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f8133f70 0x7f69f81c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.227+0000 7f69fff12700 1 --2- 172.21.15.146:0/3013684802 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f69f809ad40 0x7f69f81c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.227+0000 7f69fff12700 1 --2- 172.21.15.146:0/3013684802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f80a0a70 0x7f69f81c8840 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.227+0000 7f69fff12700 1 -- 172.21.15.146:0/3013684802 >> 172.21.15.146:0/3013684802 conn(0x7f69f8099c40 msgr2=0x7f69f80a4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.227+0000 7f69fff12700 1 -- 172.21.15.146:0/3013684802 shutdown_connections 2023-10-03T10:17:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.227+0000 7f69fff12700 1 -- 172.21.15.146:0/3013684802 wait complete. 2023-10-03T10:17:29.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:29.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.316+0000 7fac9964b700 1 -- 172.21.15.146:0/3759035218 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fac94072d60 con 0x7fac9409e870 2023-10-03T10:17:29.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.317+0000 7fac7b7fe700 1 -- 172.21.15.146:0/3759035218 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fac84017030 con 0x7fac9409e870 2023-10-03T10:17:29.317 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:29.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.319+0000 7fac9964b700 1 -- 172.21.15.146:0/3759035218 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac9409e870 msgr2=0x7fac9411ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.319+0000 7fac9964b700 1 --2- 172.21.15.146:0/3759035218 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac9409e870 0x7fac9411ead0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fac8400c480 tx=0x7fac8400c790 comp rx=0 tx=0).stop 2023-10-03T10:17:29.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.319+0000 7fac9964b700 1 -- 172.21.15.146:0/3759035218 shutdown_connections 2023-10-03T10:17:29.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.319+0000 7fac9964b700 1 --2- 172.21.15.146:0/3759035218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac941393a0 0x7fac9411f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.319+0000 7fac9964b700 1 --2- 172.21.15.146:0/3759035218 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac9409e870 0x7fac9411ead0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.319+0000 7fac9964b700 1 --2- 172.21.15.146:0/3759035218 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac9409f350 0x7fac9411f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.319+0000 7fac9964b700 1 -- 172.21.15.146:0/3759035218 >> 172.21.15.146:0/3759035218 conn(0x7fac940a4430 msgr2=0x7fac94071280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.319+0000 7fac9964b700 1 -- 172.21.15.146:0/3759035218 shutdown_connections 2023-10-03T10:17:29.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.319+0000 7fac9964b700 1 -- 172.21.15.146:0/3759035218 wait complete. 2023-10-03T10:17:29.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:29.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.350+0000 7fa2d0287700 1 Processor -- start 2023-10-03T10:17:29.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.350+0000 7fa2d0287700 1 -- start start 2023-10-03T10:17:29.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.350+0000 7fa2d0287700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2c809e870 0x7fa2c809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.350+0000 7fa2d0287700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2c809f180 0x7fa2c8133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.350+0000 7fa2d0287700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c809fa00 con 0x7fa2c8134160 2023-10-03T10:17:29.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.350+0000 7fa2d0287700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c80a0370 con 0x7fa2c809f180 2023-10-03T10:17:29.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.350+0000 7fa2d0287700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c806bec0 con 0x7fa2c809e870 2023-10-03T10:17:29.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.350+0000 7fa2ce023700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2c809e870 0x7fa2c809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.351+0000 7fa2ce023700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2c809e870 0x7fa2c809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37860/0 (socket says 172.21.15.146:37860) 2023-10-03T10:17:29.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.351+0000 7fa2ce023700 1 -- 172.21.15.146:0/2345939556 learned_addr learned my addr 172.21.15.146:0/2345939556 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:29.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.351+0000 7fa2cd822700 1 --2- 172.21.15.146:0/2345939556 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2c809f180 0x7fa2c8133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.351+0000 7fa2ce023700 1 -- 172.21.15.146:0/2345939556 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2c809f180 msgr2=0x7fa2c8133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.351+0000 7fa2cd021700 1 -- 172.21.15.146:0/2345939556 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474098093 0 0) 0x7fa2c809fa00 con 0x7fa2c8134160 2023-10-03T10:17:29.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.351+0000 7fa2ce023700 1 --2- 172.21.15.146:0/2345939556 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2c809f180 0x7fa2c8133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.351+0000 7fa2ce023700 1 -- 172.21.15.146:0/2345939556 >> v1:172.21.15.146:6789/0 conn(0x7fa2c8134160 legacy=0x7fa2c813ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.351+0000 7fa2ce023700 1 -- 172.21.15.146:0/2345939556 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c809ada0 con 0x7fa2c809e870 2023-10-03T10:17:29.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.351+0000 7fa2cd822700 1 --2- 172.21.15.146:0/2345939556 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2c809f180 0x7fa2c8133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.351+0000 7fa2ce023700 1 --2- 172.21.15.146:0/2345939556 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2c809e870 0x7fa2c809ec40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4009950 tx=0x7fa2c4009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=577ccf51282c0266 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.351+0000 7fa2cd021700 1 -- 172.21.15.146:0/2345939556 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c4011830 con 0x7fa2c809e870 2023-10-03T10:17:29.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.351+0000 7fa2cd021700 1 -- 172.21.15.146:0/2345939556 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c4011990 con 0x7fa2c809e870 2023-10-03T10:17:29.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.351+0000 7fa2cd021700 1 -- 172.21.15.146:0/2345939556 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c4011d40 con 0x7fa2c809e870 2023-10-03T10:17:29.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.352+0000 7fa2d0287700 1 -- 172.21.15.146:0/2345939556 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2c809e870 msgr2=0x7fa2c809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.352+0000 7fa2d0287700 1 --2- 172.21.15.146:0/2345939556 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2c809e870 0x7fa2c809ec40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4009950 tx=0x7fa2c4009c60 comp rx=0 tx=0).stop 2023-10-03T10:17:29.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.352+0000 7fa2d0287700 1 -- 172.21.15.146:0/2345939556 shutdown_connections 2023-10-03T10:17:29.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.352+0000 7fa2d0287700 1 --2- 172.21.15.146:0/2345939556 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2c809e870 0x7fa2c809ec40 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.352+0000 7fa2d0287700 1 --2- 172.21.15.146:0/2345939556 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2c809f180 0x7fa2c8133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.352+0000 7fa2d0287700 1 -- 172.21.15.146:0/2345939556 >> 172.21.15.146:0/2345939556 conn(0x7fa2c80a4430 msgr2=0x7fa2c80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.352+0000 7fa2d0287700 1 -- 172.21.15.146:0/2345939556 shutdown_connections 2023-10-03T10:17:29.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.352+0000 7fa2d0287700 1 -- 172.21.15.146:0/2345939556 wait complete. 2023-10-03T10:17:29.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.353+0000 7fa2d0287700 1 Processor -- start 2023-10-03T10:17:29.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.353+0000 7fa2d0287700 1 -- start start 2023-10-03T10:17:29.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.353+0000 7fa2d0287700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2c809e870 0x7fa2c81229d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.353+0000 7fa2d0287700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2c809f180 0x7fa2c8122f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.353+0000 7fa2d0287700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2c8134160 0x7fa2c8123450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.353+0000 7fa2d0287700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c81264a0 con 0x7fa2c8134160 2023-10-03T10:17:29.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.353+0000 7fa2d0287700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c8125c10 con 0x7fa2c809e870 2023-10-03T10:17:29.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.353+0000 7fa2d0287700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c80a1650 con 0x7fa2c809f180 2023-10-03T10:17:29.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.353+0000 7fa2cd822700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2c809f180 0x7fa2c8122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.353+0000 7fa2ce023700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2c809e870 0x7fa2c81229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.353+0000 7fa2cd822700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2c809f180 0x7fa2c8122f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37864/0 (socket says 172.21.15.146:37864) 2023-10-03T10:17:29.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.353+0000 7fa2cd822700 1 -- 172.21.15.146:0/2994756763 learned_addr learned my addr 172.21.15.146:0/2994756763 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:29.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.353+0000 7fa2ce824700 1 --2- 172.21.15.146:0/2994756763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2c8134160 0x7fa2c8123450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.354+0000 7fa2cd822700 1 -- 172.21.15.146:0/2994756763 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2c809e870 msgr2=0x7fa2c81229d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.354+0000 7fa2cd822700 1 --2- 172.21.15.146:0/2994756763 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2c809e870 0x7fa2c81229d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.354+0000 7fa2cd822700 1 -- 172.21.15.146:0/2994756763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2c8134160 msgr2=0x7fa2c8123450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.354+0000 7fa2cd822700 1 --2- 172.21.15.146:0/2994756763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2c8134160 0x7fa2c8123450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.354+0000 7fa2cd822700 1 -- 172.21.15.146:0/2994756763 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b80094a0 con 0x7fa2c809f180 2023-10-03T10:17:29.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.354+0000 7fa2ce023700 1 --2- 172.21.15.146:0/2994756763 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2c809e870 0x7fa2c81229d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.354+0000 7fa2cd822700 1 --2- 172.21.15.146:0/2994756763 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2c809f180 0x7fa2c8122f10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa2b800ebb0 tx=0x7fa2b800eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.354+0000 7fa2beffd700 1 -- 172.21.15.146:0/2994756763 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b800c850 con 0x7fa2c809f180 2023-10-03T10:17:29.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.354+0000 7fa2beffd700 1 -- 172.21.15.146:0/2994756763 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b800c9b0 con 0x7fa2c809f180 2023-10-03T10:17:29.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.354+0000 7fa2d0287700 1 -- 172.21.15.146:0/2994756763 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c4009550 con 0x7fa2c809f180 2023-10-03T10:17:29.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.354+0000 7fa2beffd700 1 -- 172.21.15.146:0/2994756763 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b800cd40 con 0x7fa2c809f180 2023-10-03T10:17:29.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.354+0000 7fa2d0287700 1 -- 172.21.15.146:0/2994756763 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c8125f00 con 0x7fa2c809f180 2023-10-03T10:17:29.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.355+0000 7fa2beffd700 1 -- 172.21.15.146:0/2994756763 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa2b8013470 con 0x7fa2c809f180 2023-10-03T10:17:29.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.355+0000 7fa2beffd700 1 -- 172.21.15.146:0/2994756763 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa2b803f8b0 con 0x7fa2c809f180 2023-10-03T10:17:29.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.355+0000 7fa2d0287700 1 -- 172.21.15.146:0/2994756763 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c8123e80 con 0x7fa2c809f180 2023-10-03T10:17:29.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.359+0000 7fa2beffd700 1 -- 172.21.15.146:0/2994756763 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2b80232f0 con 0x7fa2c809f180 2023-10-03T10:17:29.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.386+0000 7f4e3d18f700 1 -- 172.21.15.146:0/4112824545 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4e3806b2a0 con 0x7f4e3809f180 2023-10-03T10:17:29.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.386+0000 7f4e1f7fe700 1 -- 172.21.15.146:0/4112824545 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e2c017020 con 0x7f4e3809f180 2023-10-03T10:17:29.387 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:29.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.388+0000 7f4e3d18f700 1 -- 172.21.15.146:0/4112824545 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e3809f180 msgr2=0x7f4e3806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.388+0000 7f4e3d18f700 1 --2- 172.21.15.146:0/4112824545 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e3809f180 0x7f4e3806bdf0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00c530 tx=0x7f4e2c00c840 comp rx=0 tx=0).stop 2023-10-03T10:17:29.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.388+0000 7f4e3d18f700 1 -- 172.21.15.146:0/4112824545 shutdown_connections 2023-10-03T10:17:29.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.388+0000 7f4e3d18f700 1 --2- 172.21.15.146:0/4112824545 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e38131f40 0x7f4e3806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.388+0000 7f4e3d18f700 1 --2- 172.21.15.146:0/4112824545 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4e3809e870 0x7f4e3806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.388+0000 7f4e3d18f700 1 --2- 172.21.15.146:0/4112824545 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4e3809f180 0x7f4e3806bdf0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.388+0000 7f4e3d18f700 1 -- 172.21.15.146:0/4112824545 >> 172.21.15.146:0/4112824545 conn(0x7f4e380a4430 msgr2=0x7f4e3811a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.388+0000 7f4e3d18f700 1 -- 172.21.15.146:0/4112824545 shutdown_connections 2023-10-03T10:17:29.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.388+0000 7f4e3d18f700 1 -- 172.21.15.146:0/4112824545 wait complete. 2023-10-03T10:17:29.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:29.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.556+0000 7fa2d0287700 1 -- 172.21.15.146:0/2994756763 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa2c804f2a0 con 0x7fa2c809f180 2023-10-03T10:17:29.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.556+0000 7fa2beffd700 1 -- 172.21.15.146:0/2994756763 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa2b8017020 con 0x7fa2c809f180 2023-10-03T10:17:29.557 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:29.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.558+0000 7fa2d0287700 1 -- 172.21.15.146:0/2994756763 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2c809f180 msgr2=0x7fa2c8122f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.558+0000 7fa2d0287700 1 --2- 172.21.15.146:0/2994756763 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2c809f180 0x7fa2c8122f10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa2b800ebb0 tx=0x7fa2b800eec0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.558+0000 7fa2d0287700 1 -- 172.21.15.146:0/2994756763 shutdown_connections 2023-10-03T10:17:29.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.558+0000 7fa2d0287700 1 --2- 172.21.15.146:0/2994756763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2c8134160 0x7fa2c8123450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.558+0000 7fa2d0287700 1 --2- 172.21.15.146:0/2994756763 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2c809e870 0x7fa2c81229d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.558+0000 7fa2d0287700 1 --2- 172.21.15.146:0/2994756763 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa2c809f180 0x7fa2c8122f10 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.558+0000 7fa2d0287700 1 -- 172.21.15.146:0/2994756763 >> 172.21.15.146:0/2994756763 conn(0x7fa2c80a4430 msgr2=0x7fa2c8070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.558+0000 7fa2d0287700 1 -- 172.21.15.146:0/2994756763 shutdown_connections 2023-10-03T10:17:29.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:29.558+0000 7fa2d0287700 1 -- 172.21.15.146:0/2994756763 wait complete. 2023-10-03T10:17:29.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:30.247 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:30.333 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:30.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.381+0000 7fe26b261700 1 Processor -- start 2023-10-03T10:17:30.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.381+0000 7fe26b261700 1 -- start start 2023-10-03T10:17:30.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.382+0000 7fe26b261700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe26406b250 0x7fe264136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.382+0000 7fe26b261700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe264137140 0x7fe264139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.382+0000 7fe26b261700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26409da80 con 0x7fe26406a770 2023-10-03T10:17:30.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.382+0000 7fe26b261700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26409dce0 con 0x7fe264137140 2023-10-03T10:17:30.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.382+0000 7fe26b261700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe26406b620 con 0x7fe26406b250 2023-10-03T10:17:30.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.382+0000 7fe263fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe26406b250 0x7fe264136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.382+0000 7fe2697fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe264137140 0x7fe264139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.382+0000 7fe268ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe26406a770 0x7fe26406ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58530/0 (socket says 172.21.15.146:58530) 2023-10-03T10:17:30.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.382+0000 7fe268ffd700 1 -- 172.21.15.146:0/1084161727 learned_addr learned my addr 172.21.15.146:0/1084161727 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:30.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.382+0000 7fe2697fe700 1 -- 172.21.15.146:0/1084161727 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe26406b250 msgr2=0x7fe264136c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:30.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.382+0000 7fe2697fe700 1 --2- 172.21.15.146:0/1084161727 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe26406b250 0x7fe264136c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.382+0000 7fe2697fe700 1 -- 172.21.15.146:0/1084161727 >> v1:172.21.15.146:6789/0 conn(0x7fe26406a770 legacy=0x7fe26406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.382+0000 7fe2697fe700 1 -- 172.21.15.146:0/1084161727 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26409eb20 con 0x7fe264137140 2023-10-03T10:17:30.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.382+0000 7fe263fff700 1 --2- 172.21.15.146:0/1084161727 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe26406b250 0x7fe264136c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:30.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.382+0000 7fe2697fe700 1 --2- 172.21.15.146:0/1084161727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe264137140 0x7fe264139520 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fe25c009d90 tx=0x7fe25c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ec7bfb71d1537d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.383+0000 7fe2637fe700 1 -- 172.21.15.146:0/1084161727 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c00e070 con 0x7fe264137140 2023-10-03T10:17:30.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.383+0000 7fe2637fe700 1 -- 172.21.15.146:0/1084161727 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25c00bb20 con 0x7fe264137140 2023-10-03T10:17:30.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.383+0000 7fe2637fe700 1 -- 172.21.15.146:0/1084161727 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c012430 con 0x7fe264137140 2023-10-03T10:17:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.383+0000 7fe26b261700 1 -- 172.21.15.146:0/1084161727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe264137140 msgr2=0x7fe264139520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.383+0000 7fe26b261700 1 --2- 172.21.15.146:0/1084161727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe264137140 0x7fe264139520 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fe25c009d90 tx=0x7fe25c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.383+0000 7fe26b261700 1 -- 172.21.15.146:0/1084161727 shutdown_connections 2023-10-03T10:17:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.383+0000 7fe26b261700 1 --2- 172.21.15.146:0/1084161727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe264137140 0x7fe264139520 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.383+0000 7fe26b261700 1 --2- 172.21.15.146:0/1084161727 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe26406b250 0x7fe264136c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.383+0000 7fe26b261700 1 -- 172.21.15.146:0/1084161727 >> 172.21.15.146:0/1084161727 conn(0x7fe264099c40 msgr2=0x7fe2640a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.383+0000 7fe26b261700 1 -- 172.21.15.146:0/1084161727 shutdown_connections 2023-10-03T10:17:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.383+0000 7fe26b261700 1 -- 172.21.15.146:0/1084161727 wait complete. 2023-10-03T10:17:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.384+0000 7fe26b261700 1 Processor -- start 2023-10-03T10:17:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.384+0000 7fe26b261700 1 -- start start 2023-10-03T10:17:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.385+0000 7fe26b261700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe26406a770 0x7fe264120630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.385+0000 7fe26b261700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe26406b250 0x7fe264120b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.385+0000 7fe26b261700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe264137140 0x7fe2641210b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.385+0000 7fe26b261700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe264122430 con 0x7fe264137140 2023-10-03T10:17:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.385+0000 7fe26b261700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe264122240 con 0x7fe26406b250 2023-10-03T10:17:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.385+0000 7fe26b261700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2641365b0 con 0x7fe26406a770 2023-10-03T10:17:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.385+0000 7fe2697fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe264137140 0x7fe2641210b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.385+0000 7fe263fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe26406b250 0x7fe264120b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.385+0000 7fe2697fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe264137140 0x7fe2641210b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52102/0 (socket says 172.21.15.146:52102) 2023-10-03T10:17:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.385+0000 7fe2697fe700 1 -- 172.21.15.146:0/3237818490 learned_addr learned my addr 172.21.15.146:0/3237818490 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.385+0000 7fe268ffd700 1 --2- 172.21.15.146:0/3237818490 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe26406a770 0x7fe264120630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.385+0000 7fe263fff700 1 -- 172.21.15.146:0/3237818490 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe26406a770 msgr2=0x7fe264120630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.385+0000 7fe263fff700 1 --2- 172.21.15.146:0/3237818490 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe26406a770 0x7fe264120630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.385+0000 7fe263fff700 1 -- 172.21.15.146:0/3237818490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe264137140 msgr2=0x7fe2641210b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.385+0000 7fe263fff700 1 --2- 172.21.15.146:0/3237818490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe264137140 0x7fe2641210b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.385+0000 7fe263fff700 1 -- 172.21.15.146:0/3237818490 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2500094a0 con 0x7fe26406b250 2023-10-03T10:17:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.385+0000 7fe2697fe700 1 --2- 172.21.15.146:0/3237818490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe264137140 0x7fe2641210b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.386+0000 7fe263fff700 1 --2- 172.21.15.146:0/3237818490 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe26406b250 0x7fe264120b70 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe25000e9b0 tx=0x7fe25000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.386+0000 7fe2617fa700 1 -- 172.21.15.146:0/3237818490 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25000c850 con 0x7fe26406b250 2023-10-03T10:17:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.386+0000 7fe2617fa700 1 -- 172.21.15.146:0/3237818490 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25000c9b0 con 0x7fe26406b250 2023-10-03T10:17:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.386+0000 7fe26b261700 1 -- 172.21.15.146:0/3237818490 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25c009a70 con 0x7fe26406b250 2023-10-03T10:17:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.386+0000 7fe2617fa700 1 -- 172.21.15.146:0/3237818490 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25000cd60 con 0x7fe26406b250 2023-10-03T10:17:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.386+0000 7fe26b261700 1 -- 172.21.15.146:0/3237818490 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe264123e70 con 0x7fe26406b250 2023-10-03T10:17:30.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.387+0000 7fe2617fa700 1 -- 172.21.15.146:0/3237818490 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe250013470 con 0x7fe26406b250 2023-10-03T10:17:30.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.387+0000 7fe2617fa700 1 -- 172.21.15.146:0/3237818490 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe25003f760 con 0x7fe26406b250 2023-10-03T10:17:30.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.387+0000 7fe26b261700 1 -- 172.21.15.146:0/3237818490 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe264122a90 con 0x7fe26406b250 2023-10-03T10:17:30.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.392+0000 7fe2617fa700 1 -- 172.21.15.146:0/3237818490 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe2500232f0 con 0x7fe26406b250 2023-10-03T10:17:30.406 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:30.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.461+0000 7f413f5c9700 1 Processor -- start 2023-10-03T10:17:30.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.461+0000 7f413f5c9700 1 -- start start 2023-10-03T10:17:30.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.462+0000 7f413f5c9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f413809e870 0x7f413809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.462+0000 7f413f5c9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f413809f180 0x7f4138133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.462+0000 7f413f5c9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f413806bec0 con 0x7f41381341d0 2023-10-03T10:17:30.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.462+0000 7f413f5c9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413806ce60 con 0x7f413809f180 2023-10-03T10:17:30.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.462+0000 7f413f5c9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f413809fa00 con 0x7f413809e870 2023-10-03T10:17:30.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.462+0000 7f413d365700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f413809e870 0x7f413809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.462+0000 7f413cb64700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f413809f180 0x7f4138133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.462+0000 7f413cb64700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f413809f180 0x7f4138133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45318/0 (socket says 172.21.15.146:45318) 2023-10-03T10:17:30.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.462+0000 7f413d365700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f413809e870 0x7f413809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37900/0 (socket says 172.21.15.146:37900) 2023-10-03T10:17:30.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.462+0000 7f413cb64700 1 -- 172.21.15.146:0/1906402992 learned_addr learned my addr 172.21.15.146:0/1906402992 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:30.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.462+0000 7f413d365700 1 -- 172.21.15.146:0/1906402992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f413809f180 msgr2=0x7f4138133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:30.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.462+0000 7f413d365700 1 --2- 172.21.15.146:0/1906402992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f413809f180 0x7f4138133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.462+0000 7f413d365700 1 -- 172.21.15.146:0/1906402992 >> v1:172.21.15.146:6789/0 conn(0x7f41381341d0 legacy=0x7f413813af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.462+0000 7f412ffff700 1 -- 172.21.15.146:0/1906402992 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412975493 0 0) 0x7f413806bec0 con 0x7f41381341d0 2023-10-03T10:17:30.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.462+0000 7f413d365700 1 -- 172.21.15.146:0/1906402992 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413809ad80 con 0x7f413809e870 2023-10-03T10:17:30.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.462+0000 7f413cb64700 1 --2- 172.21.15.146:0/1906402992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f413809f180 0x7f4138133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:30.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.462+0000 7f413d365700 1 --2- 172.21.15.146:0/1906402992 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f413809e870 0x7f413809ec40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f41340098a0 tx=0x7f4134009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=170bf398471bcce0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.463+0000 7f412ffff700 1 -- 172.21.15.146:0/1906402992 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4134011830 con 0x7f413809e870 2023-10-03T10:17:30.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.463+0000 7f412ffff700 1 -- 172.21.15.146:0/1906402992 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4134011990 con 0x7f413809e870 2023-10-03T10:17:30.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.463+0000 7f412ffff700 1 -- 172.21.15.146:0/1906402992 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4134011d20 con 0x7f413809e870 2023-10-03T10:17:30.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.463+0000 7f413f5c9700 1 -- 172.21.15.146:0/1906402992 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f413809e870 msgr2=0x7f413809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.463+0000 7f413f5c9700 1 --2- 172.21.15.146:0/1906402992 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f413809e870 0x7f413809ec40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f41340098a0 tx=0x7f4134009bb0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.463+0000 7f413f5c9700 1 -- 172.21.15.146:0/1906402992 shutdown_connections 2023-10-03T10:17:30.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.463+0000 7f413f5c9700 1 --2- 172.21.15.146:0/1906402992 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f413809e870 0x7f413809ec40 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.463+0000 7f413f5c9700 1 --2- 172.21.15.146:0/1906402992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f413809f180 0x7f4138133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.463+0000 7f413f5c9700 1 -- 172.21.15.146:0/1906402992 >> 172.21.15.146:0/1906402992 conn(0x7f41380a4430 msgr2=0x7f41380a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.463+0000 7f413f5c9700 1 -- 172.21.15.146:0/1906402992 shutdown_connections 2023-10-03T10:17:30.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.463+0000 7f413f5c9700 1 -- 172.21.15.146:0/1906402992 wait complete. 2023-10-03T10:17:30.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.465+0000 7f413f5c9700 1 Processor -- start 2023-10-03T10:17:30.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.465+0000 7f413f5c9700 1 -- start start 2023-10-03T10:17:30.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.465+0000 7f413f5c9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f413809e870 0x7f41381229c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.465+0000 7f413f5c9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f413809f180 0x7f4138122f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.465+0000 7f413f5c9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41381341d0 0x7f4138123440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.465+0000 7f413f5c9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4138125bc0 con 0x7f413809f180 2023-10-03T10:17:30.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.465+0000 7f413f5c9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41381334e0 con 0x7f41381341d0 2023-10-03T10:17:30.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.465+0000 7f413f5c9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41380a3b20 con 0x7f413809e870 2023-10-03T10:17:30.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.465+0000 7f413db66700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41381341d0 0x7f4138123440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.465+0000 7f413d365700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f413809e870 0x7f41381229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.465+0000 7f413db66700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41381341d0 0x7f4138123440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45332/0 (socket says 172.21.15.146:45332) 2023-10-03T10:17:30.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.465+0000 7f413db66700 1 -- 172.21.15.146:0/3633707282 learned_addr learned my addr 172.21.15.146:0/3633707282 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:30.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.466+0000 7f413cb64700 1 --2- 172.21.15.146:0/3633707282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f413809f180 0x7f4138122f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.466+0000 7f413db66700 1 -- 172.21.15.146:0/3633707282 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f413809e870 msgr2=0x7f41381229c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.466+0000 7f413db66700 1 --2- 172.21.15.146:0/3633707282 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f413809e870 0x7f41381229c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.466+0000 7f413db66700 1 -- 172.21.15.146:0/3633707282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f413809f180 msgr2=0x7f4138122f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.466+0000 7f413db66700 1 --2- 172.21.15.146:0/3633707282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f413809f180 0x7f4138122f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.466+0000 7f413db66700 1 -- 172.21.15.146:0/3633707282 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4128009550 con 0x7f41381341d0 2023-10-03T10:17:30.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.466+0000 7f413d365700 1 --2- 172.21.15.146:0/3633707282 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f413809e870 0x7f41381229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:30.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.466+0000 7f413db66700 1 --2- 172.21.15.146:0/3633707282 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41381341d0 0x7f4138123440 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4130001560 tx=0x7f413000cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.466+0000 7f412dffb700 1 -- 172.21.15.146:0/3633707282 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4130003e30 con 0x7f41381341d0 2023-10-03T10:17:30.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.466+0000 7f412dffb700 1 -- 172.21.15.146:0/3633707282 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4130005070 con 0x7f41381341d0 2023-10-03T10:17:30.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.466+0000 7f413f5c9700 1 -- 172.21.15.146:0/3633707282 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41340094a0 con 0x7f41381341d0 2023-10-03T10:17:30.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.466+0000 7f412dffb700 1 -- 172.21.15.146:0/3633707282 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4130005420 con 0x7f41381341d0 2023-10-03T10:17:30.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.466+0000 7f413f5c9700 1 -- 172.21.15.146:0/3633707282 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4138124540 con 0x7f41381341d0 2023-10-03T10:17:30.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.467+0000 7f413f5c9700 1 -- 172.21.15.146:0/3633707282 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4138133910 con 0x7f41381341d0 2023-10-03T10:17:30.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.468+0000 7f412dffb700 1 -- 172.21.15.146:0/3633707282 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4130005580 con 0x7f41381341d0 2023-10-03T10:17:30.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.468+0000 7f412dffb700 1 -- 172.21.15.146:0/3633707282 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f413003ed20 con 0x7f41381341d0 2023-10-03T10:17:30.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.472+0000 7f412dffb700 1 -- 172.21.15.146:0/3633707282 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4130043070 con 0x7f41381341d0 2023-10-03T10:17:30.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.532+0000 7f43b2c23700 1 Processor -- start 2023-10-03T10:17:30.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.532+0000 7f43b2c23700 1 -- start start 2023-10-03T10:17:30.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.533+0000 7f43b2c23700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f43ac134140 0x7f43ac138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.533+0000 7f43b2c23700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ac1345a0 0x7f43ac13b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.533+0000 7f43b2c23700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ac09b110 con 0x7f43ac09ad40 2023-10-03T10:17:30.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.533+0000 7f43b2c23700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ac0a3b60 con 0x7f43ac134140 2023-10-03T10:17:30.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.533+0000 7f43b2c23700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac0a1a80 con 0x7f43ac1345a0 2023-10-03T10:17:30.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.533+0000 7f43abfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f43ac134140 0x7f43ac138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.533+0000 7f43b11c0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ac1345a0 0x7f43ac13b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.533+0000 7f43b11c0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ac1345a0 0x7f43ac13b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37916/0 (socket says 172.21.15.146:37916) 2023-10-03T10:17:30.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.533+0000 7f43abfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f43ac134140 0x7f43ac138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52122/0 (socket says 172.21.15.146:52122) 2023-10-03T10:17:30.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.533+0000 7f43b11c0700 1 -- 172.21.15.146:0/1878023852 learned_addr learned my addr 172.21.15.146:0/1878023852 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:30.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.533+0000 7f43b09bf700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f43ac09ad40 0x7f43ac133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58546/0 (socket says 172.21.15.146:58546) 2023-10-03T10:17:30.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.533+0000 7f43ab7fe700 1 -- 172.21.15.146:0/1878023852 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2849908778 0 0) 0x7f43ac09b110 con 0x7f43ac09ad40 2023-10-03T10:17:30.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.533+0000 7f43b11c0700 1 -- 172.21.15.146:0/1878023852 >> v2:172.21.15.146:3300/0 conn(0x7f43ac134140 msgr2=0x7f43ac138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:30.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.533+0000 7f43b11c0700 1 --2- 172.21.15.146:0/1878023852 >> v2:172.21.15.146:3300/0 conn(0x7f43ac134140 0x7f43ac138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.533+0000 7f43b11c0700 1 -- 172.21.15.146:0/1878023852 >> v1:172.21.15.146:6789/0 conn(0x7f43ac09ad40 legacy=0x7f43ac133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.533+0000 7f43b11c0700 1 -- 172.21.15.146:0/1878023852 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac0a2fa0 con 0x7f43ac1345a0 2023-10-03T10:17:30.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.533+0000 7f43b11c0700 1 --2- 172.21.15.146:0/1878023852 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ac1345a0 0x7f43ac13b3d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009e50 tx=0x7f43a400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d4d3eab7f663fc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.534+0000 7f43ab7fe700 1 -- 172.21.15.146:0/1878023852 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a400e070 con 0x7f43ac1345a0 2023-10-03T10:17:30.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.534+0000 7f43ab7fe700 1 -- 172.21.15.146:0/1878023852 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a400b910 con 0x7f43ac1345a0 2023-10-03T10:17:30.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.534+0000 7f43ab7fe700 1 -- 172.21.15.146:0/1878023852 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a400bcc0 con 0x7f43ac1345a0 2023-10-03T10:17:30.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.534+0000 7f43b2c23700 1 -- 172.21.15.146:0/1878023852 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ac1345a0 msgr2=0x7f43ac13b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.534+0000 7f43b2c23700 1 --2- 172.21.15.146:0/1878023852 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ac1345a0 0x7f43ac13b3d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009e50 tx=0x7f43a400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.534+0000 7f43b2c23700 1 -- 172.21.15.146:0/1878023852 shutdown_connections 2023-10-03T10:17:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.534+0000 7f43b2c23700 1 --2- 172.21.15.146:0/1878023852 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ac1345a0 0x7f43ac13b3d0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.534+0000 7f43b2c23700 1 --2- 172.21.15.146:0/1878023852 >> v2:172.21.15.146:3300/0 conn(0x7f43ac134140 0x7f43ac138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.534+0000 7f43b2c23700 1 -- 172.21.15.146:0/1878023852 >> 172.21.15.146:0/1878023852 conn(0x7f43ac099c40 msgr2=0x7f43ac06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.534+0000 7f43b2c23700 1 -- 172.21.15.146:0/1878023852 shutdown_connections 2023-10-03T10:17:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.534+0000 7f43b2c23700 1 -- 172.21.15.146:0/1878023852 wait complete. 2023-10-03T10:17:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.535+0000 7f43b2c23700 1 Processor -- start 2023-10-03T10:17:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.535+0000 7f43b2c23700 1 -- start start 2023-10-03T10:17:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.536+0000 7f43b2c23700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ac09ad40 0x7f43ac11c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.536+0000 7f43b2c23700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ac134140 0x7f43ac11ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.536+0000 7f43b2c23700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43ac1345a0 0x7f43ac11d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.536+0000 7f43b2c23700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac11df30 con 0x7f43ac09ad40 2023-10-03T10:17:30.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.536+0000 7f43b2c23700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac0a4430 con 0x7f43ac1345a0 2023-10-03T10:17:30.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.536+0000 7f43b2c23700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac11e6d0 con 0x7f43ac134140 2023-10-03T10:17:30.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.536+0000 7f43b09bf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ac09ad40 0x7f43ac11c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.536+0000 7f43b09bf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ac09ad40 0x7f43ac11c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52134/0 (socket says 172.21.15.146:52134) 2023-10-03T10:17:30.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.536+0000 7f43b09bf700 1 -- 172.21.15.146:0/1006651984 learned_addr learned my addr 172.21.15.146:0/1006651984 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:30.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.536+0000 7f43b11c0700 1 --2- 172.21.15.146:0/1006651984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43ac1345a0 0x7f43ac11d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.536+0000 7f43abfff700 1 --2- 172.21.15.146:0/1006651984 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ac134140 0x7f43ac11ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.536+0000 7f43b09bf700 1 -- 172.21.15.146:0/1006651984 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ac134140 msgr2=0x7f43ac11ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.536+0000 7f43b09bf700 1 --2- 172.21.15.146:0/1006651984 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ac134140 0x7f43ac11ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.536+0000 7f43b09bf700 1 -- 172.21.15.146:0/1006651984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43ac1345a0 msgr2=0x7f43ac11d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.536+0000 7f43b09bf700 1 --2- 172.21.15.146:0/1006651984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43ac1345a0 0x7f43ac11d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.536+0000 7f43b09bf700 1 -- 172.21.15.146:0/1006651984 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a4009b30 con 0x7f43ac09ad40 2023-10-03T10:17:30.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.536+0000 7f43b09bf700 1 --2- 172.21.15.146:0/1006651984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ac09ad40 0x7f43ac11c8c0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f43a000c550 tx=0x7f43a000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.537+0000 7f43a97fa700 1 -- 172.21.15.146:0/1006651984 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a0004c80 con 0x7f43ac09ad40 2023-10-03T10:17:30.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.537+0000 7f43a97fa700 1 -- 172.21.15.146:0/1006651984 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a0004de0 con 0x7f43ac09ad40 2023-10-03T10:17:30.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.537+0000 7f43a97fa700 1 -- 172.21.15.146:0/1006651984 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a0007310 con 0x7f43ac09ad40 2023-10-03T10:17:30.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.537+0000 7f43b2c23700 1 -- 172.21.15.146:0/1006651984 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ac11ec60 con 0x7f43ac09ad40 2023-10-03T10:17:30.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.537+0000 7f43b2c23700 1 -- 172.21.15.146:0/1006651984 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ac139810 con 0x7f43ac09ad40 2023-10-03T10:17:30.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.538+0000 7f43a97fa700 1 -- 172.21.15.146:0/1006651984 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f43a0007470 con 0x7f43ac09ad40 2023-10-03T10:17:30.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.538+0000 7f43b2c23700 1 -- 172.21.15.146:0/1006651984 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ac1361e0 con 0x7f43ac09ad40 2023-10-03T10:17:30.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.538+0000 7f43a97fa700 1 -- 172.21.15.146:0/1006651984 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f43a003f260 con 0x7f43ac09ad40 2023-10-03T10:17:30.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.542+0000 7f43a97fa700 1 -- 172.21.15.146:0/1006651984 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f43a00133c0 con 0x7f43ac09ad40 2023-10-03T10:17:30.571 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:30.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.589+0000 7fe26b261700 1 -- 172.21.15.146:0/3237818490 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe26404f2a0 con 0x7fe26406b250 2023-10-03T10:17:30.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.590+0000 7fe2617fa700 1 -- 172.21.15.146:0/3237818490 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe250021020 con 0x7fe26406b250 2023-10-03T10:17:30.591 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:30.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.593+0000 7fe26b261700 1 -- 172.21.15.146:0/3237818490 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe26406b250 msgr2=0x7fe264120b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.593+0000 7fe26b261700 1 --2- 172.21.15.146:0/3237818490 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe26406b250 0x7fe264120b70 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe25000e9b0 tx=0x7fe25000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.593+0000 7fe26b261700 1 -- 172.21.15.146:0/3237818490 shutdown_connections 2023-10-03T10:17:30.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.593+0000 7fe26b261700 1 --2- 172.21.15.146:0/3237818490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe264137140 0x7fe2641210b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.593+0000 7fe26b261700 1 --2- 172.21.15.146:0/3237818490 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe26406a770 0x7fe264120630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.593+0000 7fe26b261700 1 --2- 172.21.15.146:0/3237818490 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe26406b250 0x7fe264120b70 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.593+0000 7fe26b261700 1 -- 172.21.15.146:0/3237818490 >> 172.21.15.146:0/3237818490 conn(0x7fe264099c40 msgr2=0x7fe26406fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.593+0000 7fe26b261700 1 -- 172.21.15.146:0/3237818490 shutdown_connections 2023-10-03T10:17:30.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.593+0000 7fe26b261700 1 -- 172.21.15.146:0/3237818490 wait complete. 2023-10-03T10:17:30.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:30.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.674+0000 7f413f5c9700 1 -- 172.21.15.146:0/3633707282 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f413804f2a0 con 0x7f41381341d0 2023-10-03T10:17:30.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.674+0000 7f412dffb700 1 -- 172.21.15.146:0/3633707282 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4130017020 con 0x7f41381341d0 2023-10-03T10:17:30.675 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:30.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.676+0000 7f413f5c9700 1 -- 172.21.15.146:0/3633707282 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41381341d0 msgr2=0x7f4138123440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.676+0000 7f413f5c9700 1 --2- 172.21.15.146:0/3633707282 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41381341d0 0x7f4138123440 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4130001560 tx=0x7f413000cb50 comp rx=0 tx=0).stop 2023-10-03T10:17:30.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.676+0000 7f413f5c9700 1 -- 172.21.15.146:0/3633707282 shutdown_connections 2023-10-03T10:17:30.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.676+0000 7f413f5c9700 1 --2- 172.21.15.146:0/3633707282 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41381341d0 0x7f4138123440 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.676+0000 7f413f5c9700 1 --2- 172.21.15.146:0/3633707282 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f413809e870 0x7f41381229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.676+0000 7f413f5c9700 1 --2- 172.21.15.146:0/3633707282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f413809f180 0x7f4138122f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.676+0000 7f413f5c9700 1 -- 172.21.15.146:0/3633707282 >> 172.21.15.146:0/3633707282 conn(0x7f41380a4430 msgr2=0x7f4138071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.676+0000 7f413f5c9700 1 -- 172.21.15.146:0/3633707282 shutdown_connections 2023-10-03T10:17:30.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.676+0000 7f413f5c9700 1 -- 172.21.15.146:0/3633707282 wait complete. 2023-10-03T10:17:30.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:30.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.699+0000 7fd88a494700 1 Processor -- start 2023-10-03T10:17:30.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.699+0000 7fd88a494700 1 -- start start 2023-10-03T10:17:30.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.700+0000 7fd88a494700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd88406a770 0x7fd884133970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.700+0000 7fd88a494700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd884130650 0x7fd88413b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.700+0000 7fd88a494700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd88409a3f0 con 0x7fd884133eb0 2023-10-03T10:17:30.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.700+0000 7fd88a494700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88409ef40 con 0x7fd884130650 2023-10-03T10:17:30.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.700+0000 7fd88a494700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88409f6b0 con 0x7fd88406a770 2023-10-03T10:17:30.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.700+0000 7fd883fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd88406a770 0x7fd884133970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.700+0000 7fd888a31700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd884130650 0x7fd88413b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.700+0000 7fd888a31700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd884130650 0x7fd88413b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52138/0 (socket says 172.21.15.146:52138) 2023-10-03T10:17:30.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.700+0000 7fd883fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd88406a770 0x7fd884133970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45356/0 (socket says 172.21.15.146:45356) 2023-10-03T10:17:30.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.700+0000 7fd8837fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd884133eb0 0x7fd88412ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58552/0 (socket says 172.21.15.146:58552) 2023-10-03T10:17:30.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.700+0000 7fd888a31700 1 -- 172.21.15.146:0/2945865205 learned_addr learned my addr 172.21.15.146:0/2945865205 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:30.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.700+0000 7fd883fff700 1 -- 172.21.15.146:0/2945865205 >> v2:172.21.15.146:3300/0 conn(0x7fd884130650 msgr2=0x7fd88413b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:30.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.700+0000 7fd883fff700 1 --2- 172.21.15.146:0/2945865205 >> v2:172.21.15.146:3300/0 conn(0x7fd884130650 0x7fd88413b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.700+0000 7fd883fff700 1 -- 172.21.15.146:0/2945865205 >> v1:172.21.15.146:6789/0 conn(0x7fd884133eb0 legacy=0x7fd88412ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.700+0000 7fd883fff700 1 -- 172.21.15.146:0/2945865205 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88409eb00 con 0x7fd88406a770 2023-10-03T10:17:30.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.700+0000 7fd888a31700 1 --2- 172.21.15.146:0/2945865205 >> v2:172.21.15.146:3300/0 conn(0x7fd884130650 0x7fd88413b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:30.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.700+0000 7fd882ffd700 1 -- 172.21.15.146:0/2945865205 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3822819725 0 0) 0x7fd88409a3f0 con 0x7fd884133eb0 2023-10-03T10:17:30.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.700+0000 7fd883fff700 1 --2- 172.21.15.146:0/2945865205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd88406a770 0x7fd884133970 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd86c009840 tx=0x7fd86c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fad8bb1bea693d89 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.700+0000 7fd882ffd700 1 -- 172.21.15.146:0/2945865205 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c011830 con 0x7fd88406a770 2023-10-03T10:17:30.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.700+0000 7fd882ffd700 1 -- 172.21.15.146:0/2945865205 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86c011990 con 0x7fd88406a770 2023-10-03T10:17:30.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.700+0000 7fd882ffd700 1 -- 172.21.15.146:0/2945865205 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c011d20 con 0x7fd88406a770 2023-10-03T10:17:30.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.701+0000 7fd88a494700 1 -- 172.21.15.146:0/2945865205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd88406a770 msgr2=0x7fd884133970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.701+0000 7fd88a494700 1 --2- 172.21.15.146:0/2945865205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd88406a770 0x7fd884133970 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd86c009840 tx=0x7fd86c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:30.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.701+0000 7fd88a494700 1 -- 172.21.15.146:0/2945865205 shutdown_connections 2023-10-03T10:17:30.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.701+0000 7fd88a494700 1 --2- 172.21.15.146:0/2945865205 >> v2:172.21.15.146:3300/0 conn(0x7fd884130650 0x7fd88413b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.701+0000 7fd88a494700 1 --2- 172.21.15.146:0/2945865205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd88406a770 0x7fd884133970 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.701+0000 7fd88a494700 1 -- 172.21.15.146:0/2945865205 >> 172.21.15.146:0/2945865205 conn(0x7fd8840a2ef0 msgr2=0x7fd8840a32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.701+0000 7fd88a494700 1 -- 172.21.15.146:0/2945865205 shutdown_connections 2023-10-03T10:17:30.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.701+0000 7fd88a494700 1 -- 172.21.15.146:0/2945865205 wait complete. 2023-10-03T10:17:30.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.702+0000 7fd88a494700 1 Processor -- start 2023-10-03T10:17:30.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.702+0000 7fd88a494700 1 -- start start 2023-10-03T10:17:30.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.703+0000 7fd88a494700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd88406a770 0x7fd88411d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.703+0000 7fd88a494700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd884130650 0x7fd88411de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.703+0000 7fd88a494700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd884133eb0 0x7fd88411e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.703+0000 7fd88a494700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8840723c0 con 0x7fd88406a770 2023-10-03T10:17:30.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.703+0000 7fd88a494700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88412d280 con 0x7fd884130650 2023-10-03T10:17:30.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.703+0000 7fd88a494700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd88411fc70 con 0x7fd884133eb0 2023-10-03T10:17:30.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.703+0000 7fd8837fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd884130650 0x7fd88411de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.703+0000 7fd8837fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd884130650 0x7fd88411de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45364/0 (socket says 172.21.15.146:45364) 2023-10-03T10:17:30.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.703+0000 7fd883fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd88406a770 0x7fd88411d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.703+0000 7fd8837fe700 1 -- 172.21.15.146:0/692177008 learned_addr learned my addr 172.21.15.146:0/692177008 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:30.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.703+0000 7fd8837fe700 1 -- 172.21.15.146:0/692177008 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd884133eb0 msgr2=0x7fd88411e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.703+0000 7fd8837fe700 1 --2- 172.21.15.146:0/692177008 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd884133eb0 0x7fd88411e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.703+0000 7fd8837fe700 1 -- 172.21.15.146:0/692177008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd88406a770 msgr2=0x7fd88411d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.703+0000 7fd8837fe700 1 --2- 172.21.15.146:0/692177008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd88406a770 0x7fd88411d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.703+0000 7fd8837fe700 1 -- 172.21.15.146:0/692177008 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c009b30 con 0x7fd884130650 2023-10-03T10:17:30.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.703+0000 7fd8837fe700 1 --2- 172.21.15.146:0/692177008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd884130650 0x7fd88411de90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd874001eb0 tx=0x7fd87400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.703+0000 7fd880ff9700 1 -- 172.21.15.146:0/692177008 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874004c80 con 0x7fd884130650 2023-10-03T10:17:30.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.703+0000 7fd880ff9700 1 -- 172.21.15.146:0/692177008 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd874004de0 con 0x7fd884130650 2023-10-03T10:17:30.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.703+0000 7fd880ff9700 1 -- 172.21.15.146:0/692177008 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874007310 con 0x7fd884130650 2023-10-03T10:17:30.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.703+0000 7fd88a494700 1 -- 172.21.15.146:0/692177008 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86c0094a0 con 0x7fd884130650 2023-10-03T10:17:30.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.703+0000 7fd88a494700 1 -- 172.21.15.146:0/692177008 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd884120260 con 0x7fd884130650 2023-10-03T10:17:30.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.704+0000 7fd880ff9700 1 -- 172.21.15.146:0/692177008 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd874007470 con 0x7fd884130650 2023-10-03T10:17:30.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.704+0000 7fd88a494700 1 -- 172.21.15.146:0/692177008 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd88409ab90 con 0x7fd884130650 2023-10-03T10:17:30.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.704+0000 7fd880ff9700 1 -- 172.21.15.146:0/692177008 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd87403f220 con 0x7fd884130650 2023-10-03T10:17:30.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.709+0000 7fd880ff9700 1 -- 172.21.15.146:0/692177008 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd8740102c0 con 0x7fd884130650 2023-10-03T10:17:30.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.747+0000 7f43b2c23700 1 -- 172.21.15.146:0/1006651984 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f43ac04f2a0 con 0x7f43ac09ad40 2023-10-03T10:17:30.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.748+0000 7f43a97fa700 1 -- 172.21.15.146:0/1006651984 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f43a0011360 con 0x7f43ac09ad40 2023-10-03T10:17:30.748 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:30.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.750+0000 7f43b2c23700 1 -- 172.21.15.146:0/1006651984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ac09ad40 msgr2=0x7f43ac11c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.750+0000 7f43b2c23700 1 --2- 172.21.15.146:0/1006651984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ac09ad40 0x7f43ac11c8c0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f43a000c550 tx=0x7f43a000c860 comp rx=0 tx=0).stop 2023-10-03T10:17:30.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.750+0000 7f43b2c23700 1 -- 172.21.15.146:0/1006651984 shutdown_connections 2023-10-03T10:17:30.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.750+0000 7f43b2c23700 1 --2- 172.21.15.146:0/1006651984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43ac1345a0 0x7f43ac11d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.750+0000 7f43b2c23700 1 --2- 172.21.15.146:0/1006651984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ac09ad40 0x7f43ac11c8c0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.750+0000 7f43b2c23700 1 --2- 172.21.15.146:0/1006651984 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ac134140 0x7f43ac11ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.750+0000 7f43b2c23700 1 -- 172.21.15.146:0/1006651984 >> 172.21.15.146:0/1006651984 conn(0x7f43ac099c40 msgr2=0x7f43ac13b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.750+0000 7f43b2c23700 1 -- 172.21.15.146:0/1006651984 shutdown_connections 2023-10-03T10:17:30.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.750+0000 7f43b2c23700 1 -- 172.21.15.146:0/1006651984 wait complete. 2023-10-03T10:17:30.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.895+0000 7fd88a494700 1 -- 172.21.15.146:0/692177008 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd884120260 con 0x7fd884130650 2023-10-03T10:17:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.896+0000 7fd880ff9700 1 -- 172.21.15.146:0/692177008 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd884120260 con 0x7fd884130650 2023-10-03T10:17:30.896 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.898+0000 7fd88a494700 1 -- 172.21.15.146:0/692177008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd884130650 msgr2=0x7fd88411de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.898+0000 7fd88a494700 1 --2- 172.21.15.146:0/692177008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd884130650 0x7fd88411de90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd874001eb0 tx=0x7fd87400c800 comp rx=0 tx=0).stop 2023-10-03T10:17:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.898+0000 7fd88a494700 1 -- 172.21.15.146:0/692177008 shutdown_connections 2023-10-03T10:17:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.898+0000 7fd88a494700 1 --2- 172.21.15.146:0/692177008 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd884133eb0 0x7fd88411e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.898+0000 7fd88a494700 1 --2- 172.21.15.146:0/692177008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd88406a770 0x7fd88411d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.898+0000 7fd88a494700 1 --2- 172.21.15.146:0/692177008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd884130650 0x7fd88411de90 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.898+0000 7fd88a494700 1 -- 172.21.15.146:0/692177008 >> 172.21.15.146:0/692177008 conn(0x7fd8840a2ef0 msgr2=0x7fd88409ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.898+0000 7fd88a494700 1 -- 172.21.15.146:0/692177008 shutdown_connections 2023-10-03T10:17:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:30.898+0000 7fd88a494700 1 -- 172.21.15.146:0/692177008 wait complete. 2023-10-03T10:17:30.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:31.608 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:31.690 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:31.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.736+0000 7fa221a7c700 1 Processor -- start 2023-10-03T10:17:31.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.736+0000 7fa221a7c700 1 -- start start 2023-10-03T10:17:31.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.736+0000 7fa221a7c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c09e870 0x7fa21c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.736+0000 7fa221a7c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c09f180 0x7fa21c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.736+0000 7fa221a7c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa21c131d70 0x7fa21c132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.736+0000 7fa221a7c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa21c0a0920 con 0x7fa21c131d70 2023-10-03T10:17:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.736+0000 7fa221a7c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c09c970 con 0x7fa21c09f180 2023-10-03T10:17:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.736+0000 7fa221a7c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c09bab0 con 0x7fa21c09e870 2023-10-03T10:17:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.736+0000 7fa21affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c09f180 0x7fa21c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.736+0000 7fa21b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c09e870 0x7fa21c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.736+0000 7fa21b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c09e870 0x7fa21c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37942/0 (socket says 172.21.15.146:37942) 2023-10-03T10:17:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.736+0000 7fa21affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c09f180 0x7fa21c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45380/0 (socket says 172.21.15.146:45380) 2023-10-03T10:17:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.736+0000 7fa21b7fe700 1 -- 172.21.15.146:0/1439312148 learned_addr learned my addr 172.21.15.146:0/1439312148 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.736+0000 7fa21bfff700 1 --2- 172.21.15.146:0/1439312148 >> v2:172.21.15.146:3300/0 conn(0x7fa21c131d70 0x7fa21c132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.737+0000 7fa21b7fe700 1 -- 172.21.15.146:0/1439312148 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c09f180 msgr2=0x7fa21c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:31.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.737+0000 7fa21b7fe700 1 --2- 172.21.15.146:0/1439312148 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c09f180 0x7fa21c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.737+0000 7fa21b7fe700 1 -- 172.21.15.146:0/1439312148 >> v2:172.21.15.146:3300/0 conn(0x7fa21c131d70 msgr2=0x7fa21c132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:31.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.737+0000 7fa21b7fe700 1 --2- 172.21.15.146:0/1439312148 >> v2:172.21.15.146:3300/0 conn(0x7fa21c131d70 0x7fa21c132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.737+0000 7fa21b7fe700 1 -- 172.21.15.146:0/1439312148 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21c09f9c0 con 0x7fa21c09e870 2023-10-03T10:17:31.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.737+0000 7fa21affd700 1 --2- 172.21.15.146:0/1439312148 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c09f180 0x7fa21c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:31.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.737+0000 7fa21bfff700 1 --2- 172.21.15.146:0/1439312148 >> v2:172.21.15.146:3300/0 conn(0x7fa21c131d70 0x7fa21c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:31.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.737+0000 7fa21b7fe700 1 --2- 172.21.15.146:0/1439312148 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c09e870 0x7fa21c09ec40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0098f0 tx=0x7fa20c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c10e06f5fba9f3b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.737+0000 7fa21a7fc700 1 -- 172.21.15.146:0/1439312148 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c011830 con 0x7fa21c09e870 2023-10-03T10:17:31.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.737+0000 7fa21a7fc700 1 -- 172.21.15.146:0/1439312148 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20c011990 con 0x7fa21c09e870 2023-10-03T10:17:31.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.737+0000 7fa21a7fc700 1 -- 172.21.15.146:0/1439312148 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c011d20 con 0x7fa21c09e870 2023-10-03T10:17:31.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.738+0000 7fa221a7c700 1 -- 172.21.15.146:0/1439312148 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c09e870 msgr2=0x7fa21c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.738+0000 7fa221a7c700 1 --2- 172.21.15.146:0/1439312148 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c09e870 0x7fa21c09ec40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0098f0 tx=0x7fa20c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:31.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.738+0000 7fa221a7c700 1 -- 172.21.15.146:0/1439312148 shutdown_connections 2023-10-03T10:17:31.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.738+0000 7fa221a7c700 1 --2- 172.21.15.146:0/1439312148 >> v2:172.21.15.146:3300/0 conn(0x7fa21c131d70 0x7fa21c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.738+0000 7fa221a7c700 1 --2- 172.21.15.146:0/1439312148 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c09e870 0x7fa21c09ec40 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.738+0000 7fa221a7c700 1 --2- 172.21.15.146:0/1439312148 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c09f180 0x7fa21c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.738+0000 7fa221a7c700 1 -- 172.21.15.146:0/1439312148 >> 172.21.15.146:0/1439312148 conn(0x7fa21c0a4430 msgr2=0x7fa21c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.738+0000 7fa221a7c700 1 -- 172.21.15.146:0/1439312148 shutdown_connections 2023-10-03T10:17:31.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.738+0000 7fa221a7c700 1 -- 172.21.15.146:0/1439312148 wait complete. 2023-10-03T10:17:31.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.739+0000 7fa221a7c700 1 Processor -- start 2023-10-03T10:17:31.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.739+0000 7fa221a7c700 1 -- start start 2023-10-03T10:17:31.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.739+0000 7fa221a7c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c09e870 0x7fa21c11f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.739+0000 7fa221a7c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa21c09f180 0x7fa21c11f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.739+0000 7fa221a7c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c131d70 0x7fa21c11fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.739+0000 7fa221a7c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c120c90 con 0x7fa21c09f180 2023-10-03T10:17:31.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.739+0000 7fa221a7c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c122960 con 0x7fa21c131d70 2023-10-03T10:17:31.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.739+0000 7fa221a7c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c121b20 con 0x7fa21c09e870 2023-10-03T10:17:31.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.739+0000 7fa21bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c131d70 0x7fa21c11fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.739+0000 7fa21b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c09e870 0x7fa21c11f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.739+0000 7fa21bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c131d70 0x7fa21c11fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45384/0 (socket says 172.21.15.146:45384) 2023-10-03T10:17:31.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.739+0000 7fa21b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c09e870 0x7fa21c11f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37950/0 (socket says 172.21.15.146:37950) 2023-10-03T10:17:31.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.739+0000 7fa21bfff700 1 -- 172.21.15.146:0/1134553085 learned_addr learned my addr 172.21.15.146:0/1134553085 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:31.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.739+0000 7fa21affd700 1 --2- 172.21.15.146:0/1134553085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa21c09f180 0x7fa21c11f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.740+0000 7fa21b7fe700 1 -- 172.21.15.146:0/1134553085 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c131d70 msgr2=0x7fa21c11fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.740+0000 7fa21b7fe700 1 --2- 172.21.15.146:0/1134553085 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c131d70 0x7fa21c11fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.740+0000 7fa21b7fe700 1 -- 172.21.15.146:0/1134553085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa21c09f180 msgr2=0x7fa21c11f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.740+0000 7fa21b7fe700 1 --2- 172.21.15.146:0/1134553085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa21c09f180 0x7fa21c11f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.740+0000 7fa21b7fe700 1 -- 172.21.15.146:0/1134553085 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2100094a0 con 0x7fa21c09e870 2023-10-03T10:17:31.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.740+0000 7fa21bfff700 1 --2- 172.21.15.146:0/1134553085 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c131d70 0x7fa21c11fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:31.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.740+0000 7fa21affd700 1 --2- 172.21.15.146:0/1134553085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa21c09f180 0x7fa21c11f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:31.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.740+0000 7fa21b7fe700 1 --2- 172.21.15.146:0/1134553085 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c09e870 0x7fa21c11f120 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa20c016000 tx=0x7fa20c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.740+0000 7fa203fff700 1 -- 172.21.15.146:0/1134553085 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c004240 con 0x7fa21c09e870 2023-10-03T10:17:31.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.740+0000 7fa203fff700 1 -- 172.21.15.146:0/1134553085 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20c01f070 con 0x7fa21c09e870 2023-10-03T10:17:31.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.740+0000 7fa221a7c700 1 -- 172.21.15.146:0/1134553085 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa214009a70 con 0x7fa21c09e870 2023-10-03T10:17:31.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.740+0000 7fa203fff700 1 -- 172.21.15.146:0/1134553085 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c0045e0 con 0x7fa21c09e870 2023-10-03T10:17:31.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.740+0000 7fa221a7c700 1 -- 172.21.15.146:0/1134553085 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20c009550 con 0x7fa21c09e870 2023-10-03T10:17:31.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.741+0000 7fa203fff700 1 -- 172.21.15.146:0/1134553085 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa20c021030 con 0x7fa21c09e870 2023-10-03T10:17:31.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.741+0000 7fa203fff700 1 -- 172.21.15.146:0/1134553085 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa20c0408f0 con 0x7fa21c09e870 2023-10-03T10:17:31.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.741+0000 7fa221a7c700 1 -- 172.21.15.146:0/1134553085 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa21c122560 con 0x7fa21c09e870 2023-10-03T10:17:31.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.746+0000 7fa203fff700 1 -- 172.21.15.146:0/1134553085 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa20c015070 con 0x7fa21c09e870 2023-10-03T10:17:31.763 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:31.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.818+0000 7fb762d48700 1 Processor -- start 2023-10-03T10:17:31.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.818+0000 7fb762d48700 1 -- start start 2023-10-03T10:17:31.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.819+0000 7fb762d48700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb75c133ad0 0x7fb75c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.819+0000 7fb762d48700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb75c1300a0 0x7fb75c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.819+0000 7fb762d48700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb75c1309f0 0x7fb75c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.819+0000 7fb762d48700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb75c06b2d0 con 0x7fb75c133ad0 2023-10-03T10:17:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.819+0000 7fb762d48700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c133610 con 0x7fb75c1300a0 2023-10-03T10:17:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.819+0000 7fb762d48700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c09a500 con 0x7fb75c1309f0 2023-10-03T10:17:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.819+0000 7fb75bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb75c1300a0 0x7fb75c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.819+0000 7fb75bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb75c1300a0 0x7fb75c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45390/0 (socket says 172.21.15.146:45390) 2023-10-03T10:17:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.819+0000 7fb75bfff700 1 -- 172.21.15.146:0/1769283758 learned_addr learned my addr 172.21.15.146:0/1769283758 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.819+0000 7fb7612e5700 1 --2- 172.21.15.146:0/1769283758 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb75c1309f0 0x7fb75c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.819+0000 7fb760ae4700 1 --2- 172.21.15.146:0/1769283758 >> v2:172.21.15.146:3300/0 conn(0x7fb75c133ad0 0x7fb75c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.819+0000 7fb75bfff700 1 -- 172.21.15.146:0/1769283758 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb75c1309f0 msgr2=0x7fb75c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.819+0000 7fb75bfff700 1 --2- 172.21.15.146:0/1769283758 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb75c1309f0 0x7fb75c13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.819+0000 7fb75bfff700 1 -- 172.21.15.146:0/1769283758 >> v2:172.21.15.146:3300/0 conn(0x7fb75c133ad0 msgr2=0x7fb75c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:31.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.819+0000 7fb75bfff700 1 --2- 172.21.15.146:0/1769283758 >> v2:172.21.15.146:3300/0 conn(0x7fb75c133ad0 0x7fb75c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.819+0000 7fb75bfff700 1 -- 172.21.15.146:0/1769283758 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c1338b0 con 0x7fb75c1300a0 2023-10-03T10:17:31.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.819+0000 7fb7612e5700 1 --2- 172.21.15.146:0/1769283758 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb75c1309f0 0x7fb75c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:31.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.820+0000 7fb75bfff700 1 --2- 172.21.15.146:0/1769283758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb75c1300a0 0x7fb75c1304b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fb7480098f0 tx=0x7fb748009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fde8b47f79a6cbe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.820+0000 7fb75b7fe700 1 -- 172.21.15.146:0/1769283758 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb748011830 con 0x7fb75c1300a0 2023-10-03T10:17:31.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.820+0000 7fb75b7fe700 1 -- 172.21.15.146:0/1769283758 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb748011990 con 0x7fb75c1300a0 2023-10-03T10:17:31.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.820+0000 7fb75b7fe700 1 -- 172.21.15.146:0/1769283758 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb748011d20 con 0x7fb75c1300a0 2023-10-03T10:17:31.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.820+0000 7fb762d48700 1 -- 172.21.15.146:0/1769283758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb75c1300a0 msgr2=0x7fb75c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.820+0000 7fb762d48700 1 --2- 172.21.15.146:0/1769283758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb75c1300a0 0x7fb75c1304b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fb7480098f0 tx=0x7fb748009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:31.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.820+0000 7fb762d48700 1 -- 172.21.15.146:0/1769283758 shutdown_connections 2023-10-03T10:17:31.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.820+0000 7fb762d48700 1 --2- 172.21.15.146:0/1769283758 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb75c1309f0 0x7fb75c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.820+0000 7fb762d48700 1 --2- 172.21.15.146:0/1769283758 >> v2:172.21.15.146:3300/0 conn(0x7fb75c133ad0 0x7fb75c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.820+0000 7fb762d48700 1 --2- 172.21.15.146:0/1769283758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb75c1300a0 0x7fb75c1304b0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.820+0000 7fb762d48700 1 -- 172.21.15.146:0/1769283758 >> 172.21.15.146:0/1769283758 conn(0x7fb75c099c40 msgr2=0x7fb75c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.820+0000 7fb762d48700 1 -- 172.21.15.146:0/1769283758 shutdown_connections 2023-10-03T10:17:31.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.820+0000 7fb762d48700 1 -- 172.21.15.146:0/1769283758 wait complete. 2023-10-03T10:17:31.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.821+0000 7fb762d48700 1 Processor -- start 2023-10-03T10:17:31.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.821+0000 7fb762d48700 1 -- start start 2023-10-03T10:17:31.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.822+0000 7fb762d48700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb75c1300a0 0x7fb75c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.822+0000 7fb762d48700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb75c1309f0 0x7fb75c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.822+0000 7fb762d48700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb75c133ad0 0x7fb75c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.822+0000 7fb762d48700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c0720e0 con 0x7fb75c1309f0 2023-10-03T10:17:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.822+0000 7fb762d48700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c11fa40 con 0x7fb75c133ad0 2023-10-03T10:17:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.822+0000 7fb762d48700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c12dd00 con 0x7fb75c1300a0 2023-10-03T10:17:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.822+0000 7fb760ae4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb75c1300a0 0x7fb75c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.822+0000 7fb760ae4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb75c1300a0 0x7fb75c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37976/0 (socket says 172.21.15.146:37976) 2023-10-03T10:17:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.822+0000 7fb75bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb75c1309f0 0x7fb75c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.822+0000 7fb760ae4700 1 -- 172.21.15.146:0/4126454828 learned_addr learned my addr 172.21.15.146:0/4126454828 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.822+0000 7fb7612e5700 1 --2- 172.21.15.146:0/4126454828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb75c133ad0 0x7fb75c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.822+0000 7fb760ae4700 1 -- 172.21.15.146:0/4126454828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb75c133ad0 msgr2=0x7fb75c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.822+0000 7fb760ae4700 1 --2- 172.21.15.146:0/4126454828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb75c133ad0 0x7fb75c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.822+0000 7fb760ae4700 1 -- 172.21.15.146:0/4126454828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb75c1309f0 msgr2=0x7fb75c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.822+0000 7fb760ae4700 1 --2- 172.21.15.146:0/4126454828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb75c1309f0 0x7fb75c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.822+0000 7fb760ae4700 1 -- 172.21.15.146:0/4126454828 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb748009550 con 0x7fb75c1300a0 2023-10-03T10:17:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.823+0000 7fb760ae4700 1 --2- 172.21.15.146:0/4126454828 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb75c1300a0 0x7fb75c11da40 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb75000e9b0 tx=0x7fb75000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.823+0000 7fb7597fa700 1 -- 172.21.15.146:0/4126454828 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb750009710 con 0x7fb75c1300a0 2023-10-03T10:17:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.823+0000 7fb7597fa700 1 -- 172.21.15.146:0/4126454828 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75000ee50 con 0x7fb75c1300a0 2023-10-03T10:17:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.823+0000 7fb7597fa700 1 -- 172.21.15.146:0/4126454828 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75000ca50 con 0x7fb75c1300a0 2023-10-03T10:17:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.823+0000 7fb762d48700 1 -- 172.21.15.146:0/4126454828 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75c11ede0 con 0x7fb75c1300a0 2023-10-03T10:17:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.823+0000 7fb762d48700 1 -- 172.21.15.146:0/4126454828 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75c0713d0 con 0x7fb75c1300a0 2023-10-03T10:17:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.823+0000 7fb7597fa700 1 -- 172.21.15.146:0/4126454828 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb75000cbb0 con 0x7fb75c1300a0 2023-10-03T10:17:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.824+0000 7fb7597fa700 1 -- 172.21.15.146:0/4126454828 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb75003f6d0 con 0x7fb75c1300a0 2023-10-03T10:17:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.824+0000 7fb762d48700 1 -- 172.21.15.146:0/4126454828 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb75c04f2a0 con 0x7fb75c1300a0 2023-10-03T10:17:31.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.828+0000 7fb7597fa700 1 -- 172.21.15.146:0/4126454828 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb750017020 con 0x7fb75c1300a0 2023-10-03T10:17:31.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.900+0000 7f860f27a700 1 Processor -- start 2023-10-03T10:17:31.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.900+0000 7f860f27a700 1 -- start start 2023-10-03T10:17:31.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.901+0000 7f860f27a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f860809f350 0x7f8608136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.901+0000 7f860f27a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86081371c0 0x7f86081395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.901+0000 7f860f27a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860809c970 con 0x7f860809e870 2023-10-03T10:17:31.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.901+0000 7f860f27a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86080a0920 con 0x7f86081371c0 2023-10-03T10:17:31.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.901+0000 7f860f27a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f860809f9c0 con 0x7f860809f350 2023-10-03T10:17:31.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.901+0000 7f860c815700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f860809f350 0x7f8608136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.901+0000 7f860c815700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f860809f350 0x7f8608136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:37982/0 (socket says 172.21.15.146:37982) 2023-10-03T10:17:31.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.901+0000 7f860d817700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86081371c0 0x7f86081395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.901+0000 7f860c815700 1 -- 172.21.15.146:0/555197209 learned_addr learned my addr 172.21.15.146:0/555197209 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:31.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.901+0000 7f860d817700 1 -- 172.21.15.146:0/555197209 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f860809f350 msgr2=0x7f8608136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:31.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.901+0000 7f860d817700 1 --2- 172.21.15.146:0/555197209 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f860809f350 0x7f8608136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.901+0000 7f860d817700 1 -- 172.21.15.146:0/555197209 >> v1:172.21.15.146:6789/0 conn(0x7f860809e870 legacy=0x7f860809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.901+0000 7f860d817700 1 -- 172.21.15.146:0/555197209 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860809bab0 con 0x7f86081371c0 2023-10-03T10:17:31.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.901+0000 7f860c815700 1 --2- 172.21.15.146:0/555197209 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f860809f350 0x7f8608136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:31.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.901+0000 7f860d817700 1 --2- 172.21.15.146:0/555197209 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86081371c0 0x7f86081395a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8600009dc0 tx=0x7f860000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a551a43110a13fee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.902+0000 7f85fffff700 1 -- 172.21.15.146:0/555197209 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860000e070 con 0x7f86081371c0 2023-10-03T10:17:31.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.902+0000 7f85fffff700 1 -- 172.21.15.146:0/555197209 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860000bb20 con 0x7f86081371c0 2023-10-03T10:17:31.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.902+0000 7f85fffff700 1 -- 172.21.15.146:0/555197209 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8600012430 con 0x7f86081371c0 2023-10-03T10:17:31.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.902+0000 7f860f27a700 1 -- 172.21.15.146:0/555197209 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86081371c0 msgr2=0x7f86081395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.902+0000 7f860f27a700 1 --2- 172.21.15.146:0/555197209 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86081371c0 0x7f86081395a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8600009dc0 tx=0x7f860000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:31.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.902+0000 7f860f27a700 1 -- 172.21.15.146:0/555197209 shutdown_connections 2023-10-03T10:17:31.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.902+0000 7f860f27a700 1 --2- 172.21.15.146:0/555197209 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86081371c0 0x7f86081395a0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.902+0000 7f860f27a700 1 --2- 172.21.15.146:0/555197209 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f860809f350 0x7f8608136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.902+0000 7f860f27a700 1 -- 172.21.15.146:0/555197209 >> 172.21.15.146:0/555197209 conn(0x7f86080a4430 msgr2=0x7f86080a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.902+0000 7f860f27a700 1 -- 172.21.15.146:0/555197209 shutdown_connections 2023-10-03T10:17:31.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.902+0000 7f860f27a700 1 -- 172.21.15.146:0/555197209 wait complete. 2023-10-03T10:17:31.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.903+0000 7f860f27a700 1 Processor -- start 2023-10-03T10:17:31.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.903+0000 7f860f27a700 1 -- start start 2023-10-03T10:17:31.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.904+0000 7f860f27a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f860809e870 0x7f86081c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.904+0000 7f860f27a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f860809f350 0x7f86081c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.904+0000 7f860f27a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86081371c0 0x7f86081c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.904+0000 7f860f27a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8608124da0 con 0x7f860809f350 2023-10-03T10:17:31.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.904+0000 7f860f27a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860806d470 con 0x7f86081371c0 2023-10-03T10:17:31.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.904+0000 7f860f27a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8608072410 con 0x7f860809e870 2023-10-03T10:17:31.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.904+0000 7f860d817700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86081371c0 0x7f86081c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.904+0000 7f860d817700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86081371c0 0x7f86081c8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45414/0 (socket says 172.21.15.146:45414) 2023-10-03T10:17:31.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.904+0000 7f860d817700 1 -- 172.21.15.146:0/879939356 learned_addr learned my addr 172.21.15.146:0/879939356 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:31.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.904+0000 7f860c815700 1 --2- 172.21.15.146:0/879939356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f860809f350 0x7f86081c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.904+0000 7f860d817700 1 -- 172.21.15.146:0/879939356 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f860809e870 msgr2=0x7f86081c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.904+0000 7f860d817700 1 --2- 172.21.15.146:0/879939356 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f860809e870 0x7f86081c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.904+0000 7f860d817700 1 -- 172.21.15.146:0/879939356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f860809f350 msgr2=0x7f86081c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.904+0000 7f860d817700 1 --2- 172.21.15.146:0/879939356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f860809f350 0x7f86081c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.904+0000 7f860d817700 1 -- 172.21.15.146:0/879939356 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f8009550 con 0x7f86081371c0 2023-10-03T10:17:31.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.904+0000 7f860c815700 1 --2- 172.21.15.146:0/879939356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f860809f350 0x7f86081c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:31.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.905+0000 7f860d817700 1 --2- 172.21.15.146:0/879939356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86081371c0 0x7f86081c8ec0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8600014040 tx=0x7f8600004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.906+0000 7f85fdffb700 1 -- 172.21.15.146:0/879939356 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8600004960 con 0x7f86081371c0 2023-10-03T10:17:31.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.906+0000 7f85fdffb700 1 -- 172.21.15.146:0/879939356 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8600020070 con 0x7f86081371c0 2023-10-03T10:17:31.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.906+0000 7f860f27a700 1 -- 172.21.15.146:0/879939356 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8600009a70 con 0x7f86081371c0 2023-10-03T10:17:31.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.906+0000 7f85fdffb700 1 -- 172.21.15.146:0/879939356 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000276a0 con 0x7f86081371c0 2023-10-03T10:17:31.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.906+0000 7f860f27a700 1 -- 172.21.15.146:0/879939356 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86081240a0 con 0x7f86081371c0 2023-10-03T10:17:31.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.907+0000 7f85fdffb700 1 -- 172.21.15.146:0/879939356 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8600027800 con 0x7f86081371c0 2023-10-03T10:17:31.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.907+0000 7f85fdffb700 1 -- 172.21.15.146:0/879939356 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8600022070 con 0x7f86081371c0 2023-10-03T10:17:31.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.907+0000 7f860f27a700 1 -- 172.21.15.146:0/879939356 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860804f2a0 con 0x7f86081371c0 2023-10-03T10:17:31.912 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:31.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.912+0000 7f85fdffb700 1 -- 172.21.15.146:0/879939356 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8600027ab0 con 0x7f86081371c0 2023-10-03T10:17:31.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.946+0000 7fa221a7c700 1 -- 172.21.15.146:0/1134553085 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa21c11be60 con 0x7fa21c09e870 2023-10-03T10:17:31.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.947+0000 7fa203fff700 1 -- 172.21.15.146:0/1134553085 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa20c01a450 con 0x7fa21c09e870 2023-10-03T10:17:31.947 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:31.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.949+0000 7fa221a7c700 1 -- 172.21.15.146:0/1134553085 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c09e870 msgr2=0x7fa21c11f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.949+0000 7fa221a7c700 1 --2- 172.21.15.146:0/1134553085 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c09e870 0x7fa21c11f120 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa20c016000 tx=0x7fa20c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:31.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.949+0000 7fa221a7c700 1 -- 172.21.15.146:0/1134553085 shutdown_connections 2023-10-03T10:17:31.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.949+0000 7fa221a7c700 1 --2- 172.21.15.146:0/1134553085 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa21c131d70 0x7fa21c11fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.949+0000 7fa221a7c700 1 --2- 172.21.15.146:0/1134553085 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa21c09e870 0x7fa21c11f120 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.949+0000 7fa221a7c700 1 --2- 172.21.15.146:0/1134553085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa21c09f180 0x7fa21c11f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.949+0000 7fa221a7c700 1 -- 172.21.15.146:0/1134553085 >> 172.21.15.146:0/1134553085 conn(0x7fa21c0a4430 msgr2=0x7fa21c1310d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.949+0000 7fa221a7c700 1 -- 172.21.15.146:0/1134553085 shutdown_connections 2023-10-03T10:17:31.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:31.949+0000 7fa221a7c700 1 -- 172.21.15.146:0/1134553085 wait complete. 2023-10-03T10:17:31.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:32.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.038+0000 7ff416e39700 1 Processor -- start 2023-10-03T10:17:32.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.038+0000 7ff416e39700 1 -- start start 2023-10-03T10:17:32.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.038+0000 7ff416e39700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4101319f0 0x7ff410131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.038+0000 7ff416e39700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff41009bc70 0x7ff41009c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.038+0000 7ff416e39700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff41009c5e0 0x7ff410138770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.038+0000 7ff416e39700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4100a2590 con 0x7ff41009bc70 2023-10-03T10:17:32.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.038+0000 7ff416e39700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41006eaa0 con 0x7ff4101319f0 2023-10-03T10:17:32.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.038+0000 7ff416e39700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4101315c0 con 0x7ff41009c5e0 2023-10-03T10:17:32.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.038+0000 7ff40ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff41009bc70 0x7ff41009c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.038+0000 7ff40ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff41009bc70 0x7ff41009c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52214/0 (socket says 172.21.15.146:52214) 2023-10-03T10:17:32.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.038+0000 7ff40ffff700 1 -- 172.21.15.146:0/2810730170 learned_addr learned my addr 172.21.15.146:0/2810730170 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:32.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.038+0000 7ff414bd5700 1 --2- 172.21.15.146:0/2810730170 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4101319f0 0x7ff410131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.038+0000 7ff4153d6700 1 --2- 172.21.15.146:0/2810730170 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff41009c5e0 0x7ff410138770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.039+0000 7ff40ffff700 1 -- 172.21.15.146:0/2810730170 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff41009c5e0 msgr2=0x7ff410138770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.039+0000 7ff40ffff700 1 --2- 172.21.15.146:0/2810730170 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff41009c5e0 0x7ff410138770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.039+0000 7ff40ffff700 1 -- 172.21.15.146:0/2810730170 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4101319f0 msgr2=0x7ff410131dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.039+0000 7ff40ffff700 1 --2- 172.21.15.146:0/2810730170 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4101319f0 0x7ff410131dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.039+0000 7ff40ffff700 1 -- 172.21.15.146:0/2810730170 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4100a1640 con 0x7ff41009bc70 2023-10-03T10:17:32.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.039+0000 7ff40ffff700 1 --2- 172.21.15.146:0/2810730170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff41009bc70 0x7ff41009c0a0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0098f0 tx=0x7ff3fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337643e6e4ef8ddc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.039+0000 7ff40f7fe700 1 -- 172.21.15.146:0/2810730170 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc011830 con 0x7ff41009bc70 2023-10-03T10:17:32.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.039+0000 7ff40f7fe700 1 -- 172.21.15.146:0/2810730170 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc011990 con 0x7ff41009bc70 2023-10-03T10:17:32.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.039+0000 7ff40f7fe700 1 -- 172.21.15.146:0/2810730170 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc011d20 con 0x7ff41009bc70 2023-10-03T10:17:32.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.040+0000 7ff416e39700 1 -- 172.21.15.146:0/2810730170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff41009bc70 msgr2=0x7ff41009c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.040+0000 7ff416e39700 1 --2- 172.21.15.146:0/2810730170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff41009bc70 0x7ff41009c0a0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0098f0 tx=0x7ff3fc009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:32.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.040+0000 7ff416e39700 1 -- 172.21.15.146:0/2810730170 shutdown_connections 2023-10-03T10:17:32.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.040+0000 7ff416e39700 1 --2- 172.21.15.146:0/2810730170 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4101319f0 0x7ff410131dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.040+0000 7ff416e39700 1 --2- 172.21.15.146:0/2810730170 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff41009c5e0 0x7ff410138770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.040+0000 7ff416e39700 1 --2- 172.21.15.146:0/2810730170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff41009bc70 0x7ff41009c0a0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.040+0000 7ff416e39700 1 -- 172.21.15.146:0/2810730170 >> 172.21.15.146:0/2810730170 conn(0x7ff4100a2980 msgr2=0x7ff4100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.040+0000 7ff416e39700 1 -- 172.21.15.146:0/2810730170 shutdown_connections 2023-10-03T10:17:32.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.040+0000 7ff416e39700 1 -- 172.21.15.146:0/2810730170 wait complete. 2023-10-03T10:17:32.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.041+0000 7ff416e39700 1 Processor -- start 2023-10-03T10:17:32.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.041+0000 7ff416e39700 1 -- start start 2023-10-03T10:17:32.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.041+0000 7ff416e39700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff41009bc70 0x7ff410099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.041+0000 7ff416e39700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff41009c5e0 0x7ff410099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.041+0000 7ff416e39700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4101319f0 0x7ff41009a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.041+0000 7ff416e39700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4101213f0 con 0x7ff4101319f0 2023-10-03T10:17:32.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.041+0000 7ff416e39700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff410120b80 con 0x7ff41009bc70 2023-10-03T10:17:32.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.041+0000 7ff416e39700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff41009b6a0 con 0x7ff41009c5e0 2023-10-03T10:17:32.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.041+0000 7ff40ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff41009c5e0 0x7ff410099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.042+0000 7ff40ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff41009c5e0 0x7ff410099fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38004/0 (socket says 172.21.15.146:38004) 2023-10-03T10:17:32.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.042+0000 7ff40ffff700 1 -- 172.21.15.146:0/895314422 learned_addr learned my addr 172.21.15.146:0/895314422 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:32.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.042+0000 7ff4153d6700 1 --2- 172.21.15.146:0/895314422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4101319f0 0x7ff41009a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.042+0000 7ff414bd5700 1 --2- 172.21.15.146:0/895314422 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff41009bc70 0x7ff410099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.042+0000 7ff40ffff700 1 -- 172.21.15.146:0/895314422 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff41009bc70 msgr2=0x7ff410099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.042+0000 7ff40ffff700 1 --2- 172.21.15.146:0/895314422 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff41009bc70 0x7ff410099a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.042+0000 7ff40ffff700 1 -- 172.21.15.146:0/895314422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4101319f0 msgr2=0x7ff41009a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.042+0000 7ff40ffff700 1 --2- 172.21.15.146:0/895314422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4101319f0 0x7ff41009a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.042+0000 7ff40ffff700 1 -- 172.21.15.146:0/895314422 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc009550 con 0x7ff41009c5e0 2023-10-03T10:17:32.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.042+0000 7ff40ffff700 1 --2- 172.21.15.146:0/895314422 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff41009c5e0 0x7ff410099fd0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009c40 tx=0x7ff3fc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.042+0000 7ff40d7fa700 1 -- 172.21.15.146:0/895314422 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc004450 con 0x7ff41009c5e0 2023-10-03T10:17:32.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.042+0000 7ff40d7fa700 1 -- 172.21.15.146:0/895314422 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc01e070 con 0x7ff41009c5e0 2023-10-03T10:17:32.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.042+0000 7ff416e39700 1 -- 172.21.15.146:0/895314422 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff410120e50 con 0x7ff41009c5e0 2023-10-03T10:17:32.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.042+0000 7ff40d7fa700 1 -- 172.21.15.146:0/895314422 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc0038e0 con 0x7ff41009c5e0 2023-10-03T10:17:32.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.042+0000 7ff416e39700 1 -- 172.21.15.146:0/895314422 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4100a1cb0 con 0x7ff41009c5e0 2023-10-03T10:17:32.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.043+0000 7ff40d7fa700 1 -- 172.21.15.146:0/895314422 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff3fc003a40 con 0x7ff41009c5e0 2023-10-03T10:17:32.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.043+0000 7ff416e39700 1 -- 172.21.15.146:0/895314422 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff410120fe0 con 0x7ff41009c5e0 2023-10-03T10:17:32.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.043+0000 7ff40d7fa700 1 -- 172.21.15.146:0/895314422 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff3fc040380 con 0x7ff41009c5e0 2023-10-03T10:17:32.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.052+0000 7ff40d7fa700 1 -- 172.21.15.146:0/895314422 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff410120fe0 con 0x7ff41009c5e0 2023-10-03T10:17:32.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.075+0000 7fb762d48700 1 -- 172.21.15.146:0/4126454828 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb75c11fc60 con 0x7fb75c1300a0 2023-10-03T10:17:32.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.076+0000 7fb7597fa700 1 -- 172.21.15.146:0/4126454828 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb75c11fc60 con 0x7fb75c1300a0 2023-10-03T10:17:32.076 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:32.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.079+0000 7fb762d48700 1 -- 172.21.15.146:0/4126454828 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb75c1300a0 msgr2=0x7fb75c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.079+0000 7fb762d48700 1 --2- 172.21.15.146:0/4126454828 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb75c1300a0 0x7fb75c11da40 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb75000e9b0 tx=0x7fb75000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.079+0000 7fb762d48700 1 -- 172.21.15.146:0/4126454828 shutdown_connections 2023-10-03T10:17:32.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.079+0000 7fb762d48700 1 --2- 172.21.15.146:0/4126454828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb75c133ad0 0x7fb75c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.079+0000 7fb762d48700 1 --2- 172.21.15.146:0/4126454828 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb75c1300a0 0x7fb75c11da40 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.079+0000 7fb762d48700 1 --2- 172.21.15.146:0/4126454828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb75c1309f0 0x7fb75c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.079+0000 7fb762d48700 1 -- 172.21.15.146:0/4126454828 >> 172.21.15.146:0/4126454828 conn(0x7fb75c099c40 msgr2=0x7fb75c12e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.079+0000 7fb762d48700 1 -- 172.21.15.146:0/4126454828 shutdown_connections 2023-10-03T10:17:32.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.079+0000 7fb762d48700 1 -- 172.21.15.146:0/4126454828 wait complete. 2023-10-03T10:17:32.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:32.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.157+0000 7f860f27a700 1 -- 172.21.15.146:0/879939356 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8608125b30 con 0x7f86081371c0 2023-10-03T10:17:32.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.157+0000 7f85fdffb700 1 -- 172.21.15.146:0/879939356 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f860002fb80 con 0x7f86081371c0 2023-10-03T10:17:32.158 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:32.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.159+0000 7f860f27a700 1 -- 172.21.15.146:0/879939356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86081371c0 msgr2=0x7f86081c8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.159+0000 7f860f27a700 1 --2- 172.21.15.146:0/879939356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86081371c0 0x7f86081c8ec0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8600014040 tx=0x7f8600004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.159+0000 7f860f27a700 1 -- 172.21.15.146:0/879939356 shutdown_connections 2023-10-03T10:17:32.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.159+0000 7f860f27a700 1 --2- 172.21.15.146:0/879939356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86081371c0 0x7f86081c8ec0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.159+0000 7f860f27a700 1 --2- 172.21.15.146:0/879939356 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f860809e870 0x7f86081c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.159+0000 7f860f27a700 1 --2- 172.21.15.146:0/879939356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f860809f350 0x7f86081c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.159+0000 7f860f27a700 1 -- 172.21.15.146:0/879939356 >> 172.21.15.146:0/879939356 conn(0x7f86080a4430 msgr2=0x7f86080a0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.159+0000 7f860f27a700 1 -- 172.21.15.146:0/879939356 shutdown_connections 2023-10-03T10:17:32.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.159+0000 7f860f27a700 1 -- 172.21.15.146:0/879939356 wait complete. 2023-10-03T10:17:32.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:32.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.243+0000 7ff416e39700 1 -- 172.21.15.146:0/895314422 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff410120fe0 con 0x7ff41009c5e0 2023-10-03T10:17:32.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.244+0000 7ff40d7fa700 1 -- 172.21.15.146:0/895314422 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff410120fe0 con 0x7ff41009c5e0 2023-10-03T10:17:32.245 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:32.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.246+0000 7ff416e39700 1 -- 172.21.15.146:0/895314422 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff41009c5e0 msgr2=0x7ff410099fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.246+0000 7ff416e39700 1 --2- 172.21.15.146:0/895314422 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff41009c5e0 0x7ff410099fd0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009c40 tx=0x7ff3fc004750 comp rx=0 tx=0).stop 2023-10-03T10:17:32.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.246+0000 7ff416e39700 1 -- 172.21.15.146:0/895314422 shutdown_connections 2023-10-03T10:17:32.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.246+0000 7ff416e39700 1 --2- 172.21.15.146:0/895314422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4101319f0 0x7ff41009a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.246+0000 7ff416e39700 1 --2- 172.21.15.146:0/895314422 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff41009bc70 0x7ff410099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.246+0000 7ff416e39700 1 --2- 172.21.15.146:0/895314422 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff41009c5e0 0x7ff410099fd0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.246+0000 7ff416e39700 1 -- 172.21.15.146:0/895314422 >> 172.21.15.146:0/895314422 conn(0x7ff4100a2980 msgr2=0x7ff4101b84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.246+0000 7ff416e39700 1 -- 172.21.15.146:0/895314422 shutdown_connections 2023-10-03T10:17:32.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:32.246+0000 7ff416e39700 1 -- 172.21.15.146:0/895314422 wait complete. 2023-10-03T10:17:32.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:32.963 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:33.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.089+0000 7f3ad9cad700 1 Processor -- start 2023-10-03T10:17:33.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.090+0000 7f3ad9cad700 1 -- start start 2023-10-03T10:17:33.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.090+0000 7f3ad9cad700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3ad4133ad0 0x7f3ad4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.090+0000 7f3ad9cad700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ad4130bc0 0x7f3ad413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.090+0000 7f3ad9cad700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad406b2d0 con 0x7f3ad41300a0 2023-10-03T10:17:33.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.090+0000 7f3ad9cad700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad4133610 con 0x7f3ad4133ad0 2023-10-03T10:17:33.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.090+0000 7f3ad9cad700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad409a500 con 0x7f3ad4130bc0 2023-10-03T10:17:33.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.090+0000 7f3ad37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3ad4133ad0 0x7f3ad4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.090+0000 7f3ad3fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ad4130bc0 0x7f3ad413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.090+0000 7f3ad37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3ad4133ad0 0x7f3ad4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52228/0 (socket says 172.21.15.146:52228) 2023-10-03T10:17:33.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.090+0000 7f3ad3fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ad4130bc0 0x7f3ad413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38012/0 (socket says 172.21.15.146:38012) 2023-10-03T10:17:33.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.090+0000 7f3ad2ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3ad41300a0 0x7f3ad41304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58578/0 (socket says 172.21.15.146:58578) 2023-10-03T10:17:33.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.090+0000 7f3ad37fe700 1 -- 172.21.15.146:0/3692944770 learned_addr learned my addr 172.21.15.146:0/3692944770 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:33.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.090+0000 7f3ad37fe700 1 -- 172.21.15.146:0/3692944770 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ad4130bc0 msgr2=0x7f3ad413b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:33.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.090+0000 7f3ad37fe700 1 --2- 172.21.15.146:0/3692944770 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ad4130bc0 0x7f3ad413b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.090+0000 7f3ad37fe700 1 -- 172.21.15.146:0/3692944770 >> v1:172.21.15.146:6789/0 conn(0x7f3ad41300a0 legacy=0x7f3ad41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.090+0000 7f3ad37fe700 1 -- 172.21.15.146:0/3692944770 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad41338b0 con 0x7f3ad4133ad0 2023-10-03T10:17:33.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.090+0000 7f3ad3fff700 1 --2- 172.21.15.146:0/3692944770 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ad4130bc0 0x7f3ad413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:33.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.091+0000 7f3ad37fe700 1 --2- 172.21.15.146:0/3692944770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ad4133ad0 0x7f3ad4133ea0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f3abc0098f0 tx=0x7f3abc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf48b0ce1d92e4b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.091+0000 7f3ad27fc700 1 -- 172.21.15.146:0/3692944770 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc011830 con 0x7f3ad4133ad0 2023-10-03T10:17:33.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.091+0000 7f3ad27fc700 1 -- 172.21.15.146:0/3692944770 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc011990 con 0x7f3ad4133ad0 2023-10-03T10:17:33.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.091+0000 7f3ad27fc700 1 -- 172.21.15.146:0/3692944770 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc011d20 con 0x7f3ad4133ad0 2023-10-03T10:17:33.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.091+0000 7f3ad9cad700 1 -- 172.21.15.146:0/3692944770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ad4133ad0 msgr2=0x7f3ad4133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.091+0000 7f3ad9cad700 1 --2- 172.21.15.146:0/3692944770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ad4133ad0 0x7f3ad4133ea0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f3abc0098f0 tx=0x7f3abc009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:33.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.091+0000 7f3ad9cad700 1 -- 172.21.15.146:0/3692944770 shutdown_connections 2023-10-03T10:17:33.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.091+0000 7f3ad9cad700 1 --2- 172.21.15.146:0/3692944770 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ad4130bc0 0x7f3ad413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.091+0000 7f3ad9cad700 1 --2- 172.21.15.146:0/3692944770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ad4133ad0 0x7f3ad4133ea0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.091+0000 7f3ad9cad700 1 -- 172.21.15.146:0/3692944770 >> 172.21.15.146:0/3692944770 conn(0x7f3ad4099c40 msgr2=0x7f3ad40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.091+0000 7f3ad9cad700 1 -- 172.21.15.146:0/3692944770 shutdown_connections 2023-10-03T10:17:33.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.091+0000 7f3ad9cad700 1 -- 172.21.15.146:0/3692944770 wait complete. 2023-10-03T10:17:33.103 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:33.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.092+0000 7f3ad9cad700 1 Processor -- start 2023-10-03T10:17:33.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.092+0000 7f3ad9cad700 1 -- start start 2023-10-03T10:17:33.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.093+0000 7f3ad9cad700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ad41300a0 0x7f3ad411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.093+0000 7f3ad9cad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ad4130bc0 0x7f3ad411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.093+0000 7f3ad9cad700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ad4133ad0 0x7f3ad411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.093+0000 7f3ad9cad700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad4120e00 con 0x7f3ad4130bc0 2023-10-03T10:17:33.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.093+0000 7f3ad9cad700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad412d580 con 0x7f3ad41300a0 2023-10-03T10:17:33.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.093+0000 7f3ad9cad700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad412dd00 con 0x7f3ad4133ad0 2023-10-03T10:17:33.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.093+0000 7f3ad2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ad4130bc0 0x7f3ad411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.093+0000 7f3ad3fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ad4133ad0 0x7f3ad411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.093+0000 7f3ad2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ad4130bc0 0x7f3ad411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52234/0 (socket says 172.21.15.146:52234) 2023-10-03T10:17:33.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.093+0000 7f3ad2ffd700 1 -- 172.21.15.146:0/966868104 learned_addr learned my addr 172.21.15.146:0/966868104 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:33.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.093+0000 7f3ad37fe700 1 --2- 172.21.15.146:0/966868104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ad41300a0 0x7f3ad411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.093+0000 7f3ad3fff700 1 -- 172.21.15.146:0/966868104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ad41300a0 msgr2=0x7f3ad411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.093+0000 7f3ad3fff700 1 --2- 172.21.15.146:0/966868104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ad41300a0 0x7f3ad411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.093+0000 7f3ad3fff700 1 -- 172.21.15.146:0/966868104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ad4130bc0 msgr2=0x7f3ad411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.093+0000 7f3ad3fff700 1 --2- 172.21.15.146:0/966868104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ad4130bc0 0x7f3ad411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.093+0000 7f3ad3fff700 1 -- 172.21.15.146:0/966868104 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc009a70 con 0x7f3ad4133ad0 2023-10-03T10:17:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.093+0000 7f3ad2ffd700 1 --2- 172.21.15.146:0/966868104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ad4130bc0 0x7f3ad411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.093+0000 7f3ad3fff700 1 --2- 172.21.15.146:0/966868104 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ad4133ad0 0x7f3ad411e4c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009e50 tx=0x7f3acc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.094+0000 7f3acbfff700 1 -- 172.21.15.146:0/966868104 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc00ca90 con 0x7f3ad4133ad0 2023-10-03T10:17:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.094+0000 7f3acbfff700 1 -- 172.21.15.146:0/966868104 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3acc00f040 con 0x7f3ad4133ad0 2023-10-03T10:17:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.094+0000 7f3ad9cad700 1 -- 172.21.15.146:0/966868104 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3abc009550 con 0x7f3ad4133ad0 2023-10-03T10:17:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.094+0000 7f3acbfff700 1 -- 172.21.15.146:0/966868104 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc00ce50 con 0x7f3ad4133ad0 2023-10-03T10:17:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.094+0000 7f3ad9cad700 1 -- 172.21.15.146:0/966868104 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad40721b0 con 0x7f3ad4133ad0 2023-10-03T10:17:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.094+0000 7f3acbfff700 1 -- 172.21.15.146:0/966868104 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3acc014480 con 0x7f3ad4133ad0 2023-10-03T10:17:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.095+0000 7f3acbfff700 1 -- 172.21.15.146:0/966868104 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3acc03fba0 con 0x7f3ad4133ad0 2023-10-03T10:17:33.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.095+0000 7f3ad9cad700 1 -- 172.21.15.146:0/966868104 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad404f2a0 con 0x7f3ad4133ad0 2023-10-03T10:17:33.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.099+0000 7f3acbfff700 1 -- 172.21.15.146:0/966868104 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3acc012910 con 0x7f3ad4133ad0 2023-10-03T10:17:33.172 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:33.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.235+0000 7f1fd5b72700 1 Processor -- start 2023-10-03T10:17:33.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.235+0000 7f1fd5b72700 1 -- start start 2023-10-03T10:17:33.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.235+0000 7f1fd5b72700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1fd006a770 0x7f1fd006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.235+0000 7f1fd5b72700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fd009dec0 0x7f1fd006b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.235+0000 7f1fd5b72700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd006b5c0 con 0x7f1fd0131a00 2023-10-03T10:17:33.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.235+0000 7f1fd5b72700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd006e900 con 0x7f1fd009dec0 2023-10-03T10:17:33.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.235+0000 7f1fd5b72700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd009d180 con 0x7f1fd006a770 2023-10-03T10:17:33.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.236+0000 7f1fcffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1fd0131a00 0x7f1fd0131e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:58580/0 (socket says 172.21.15.146:58580) 2023-10-03T10:17:33.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.236+0000 7f1fcffff700 1 -- 172.21.15.146:0/3953490124 learned_addr learned my addr 172.21.15.146:0/3953490124 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:33.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.236+0000 7f1fcf7fe700 1 --2- 172.21.15.146:0/3953490124 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1fd006a770 0x7f1fd006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.236+0000 7f1fceffd700 1 --2- 172.21.15.146:0/3953490124 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fd009dec0 0x7f1fd006b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.236+0000 7f1fcf7fe700 1 -- 172.21.15.146:0/3953490124 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fd009dec0 msgr2=0x7f1fd006b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:33.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.236+0000 7f1fce7fc700 1 -- 172.21.15.146:0/3953490124 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919554195 0 0) 0x7f1fd006b5c0 con 0x7f1fd0131a00 2023-10-03T10:17:33.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.236+0000 7f1fcf7fe700 1 --2- 172.21.15.146:0/3953490124 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fd009dec0 0x7f1fd006b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.236+0000 7f1fcf7fe700 1 -- 172.21.15.146:0/3953490124 >> v1:172.21.15.146:6789/0 conn(0x7f1fd0131a00 legacy=0x7f1fd0131e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.236+0000 7f1fcf7fe700 1 -- 172.21.15.146:0/3953490124 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd009e780 con 0x7f1fd006a770 2023-10-03T10:17:33.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.236+0000 7f1fcf7fe700 1 --2- 172.21.15.146:0/3953490124 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1fd006a770 0x7f1fd006ab40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0009870 tx=0x7f1fc0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f670e0327f5e7505 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.236+0000 7f1fce7fc700 1 -- 172.21.15.146:0/3953490124 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0011830 con 0x7f1fd006a770 2023-10-03T10:17:33.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.236+0000 7f1fce7fc700 1 -- 172.21.15.146:0/3953490124 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc0011990 con 0x7f1fd006a770 2023-10-03T10:17:33.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.236+0000 7f1fce7fc700 1 -- 172.21.15.146:0/3953490124 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0011d20 con 0x7f1fd006a770 2023-10-03T10:17:33.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.237+0000 7f1fd5b72700 1 -- 172.21.15.146:0/3953490124 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1fd006a770 msgr2=0x7f1fd006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.237+0000 7f1fd5b72700 1 --2- 172.21.15.146:0/3953490124 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1fd006a770 0x7f1fd006ab40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0009870 tx=0x7f1fc0009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:33.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.237+0000 7f1fd5b72700 1 -- 172.21.15.146:0/3953490124 shutdown_connections 2023-10-03T10:17:33.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.237+0000 7f1fd5b72700 1 --2- 172.21.15.146:0/3953490124 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1fd006a770 0x7f1fd006ab40 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.237+0000 7f1fd5b72700 1 --2- 172.21.15.146:0/3953490124 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fd009dec0 0x7f1fd006b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.237+0000 7f1fd5b72700 1 -- 172.21.15.146:0/3953490124 >> 172.21.15.146:0/3953490124 conn(0x7f1fd0099c40 msgr2=0x7f1fd00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.237+0000 7f1fd5b72700 1 -- 172.21.15.146:0/3953490124 shutdown_connections 2023-10-03T10:17:33.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.237+0000 7f1fd5b72700 1 -- 172.21.15.146:0/3953490124 wait complete. 2023-10-03T10:17:33.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.238+0000 7f1fd5b72700 1 Processor -- start 2023-10-03T10:17:33.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.238+0000 7f1fd5b72700 1 -- start start 2023-10-03T10:17:33.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.239+0000 7f1fd5b72700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fd006a770 0x7f1fd011f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.239+0000 7f1fd5b72700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fd009dec0 0x7f1fd011fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.239+0000 7f1fd5b72700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1fd0131a00 0x7f1fd01200a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.239+0000 7f1fd5b72700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd0121840 con 0x7f1fd006a770 2023-10-03T10:17:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.239+0000 7f1fd5b72700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd0130e20 con 0x7f1fd009dec0 2023-10-03T10:17:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.239+0000 7f1fd5b72700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd0071ce0 con 0x7f1fd0131a00 2023-10-03T10:17:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.239+0000 7f1fcf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fd006a770 0x7f1fd011f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.239+0000 7f1fcffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1fd0131a00 0x7f1fd01200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.239+0000 7f1fcf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fd006a770 0x7f1fd011f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52246/0 (socket says 172.21.15.146:52246) 2023-10-03T10:17:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.239+0000 7f1fcffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1fd0131a00 0x7f1fd01200a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38040/0 (socket says 172.21.15.146:38040) 2023-10-03T10:17:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.239+0000 7f1fcf7fe700 1 -- 172.21.15.146:0/3592924615 learned_addr learned my addr 172.21.15.146:0/3592924615 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.239+0000 7f1fceffd700 1 --2- 172.21.15.146:0/3592924615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fd009dec0 0x7f1fd011fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.239+0000 7f1fcf7fe700 1 -- 172.21.15.146:0/3592924615 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1fd0131a00 msgr2=0x7f1fd01200a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.239+0000 7f1fcf7fe700 1 --2- 172.21.15.146:0/3592924615 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1fd0131a00 0x7f1fd01200a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.239+0000 7f1fcf7fe700 1 -- 172.21.15.146:0/3592924615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fd009dec0 msgr2=0x7f1fd011fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.239+0000 7f1fcf7fe700 1 --2- 172.21.15.146:0/3592924615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fd009dec0 0x7f1fd011fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.239+0000 7f1fcf7fe700 1 -- 172.21.15.146:0/3592924615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc00094a0 con 0x7f1fd006a770 2023-10-03T10:17:33.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.239+0000 7f1fceffd700 1 --2- 172.21.15.146:0/3592924615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fd009dec0 0x7f1fd011fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:33.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.239+0000 7f1fcffff700 1 --2- 172.21.15.146:0/3592924615 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1fd0131a00 0x7f1fd01200a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:33.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.240+0000 7f1fcf7fe700 1 --2- 172.21.15.146:0/3592924615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fd006a770 0x7f1fd011f620 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f1fc00090b0 tx=0x7f1fc0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.240+0000 7f1fb7fff700 1 -- 172.21.15.146:0/3592924615 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0004510 con 0x7f1fd006a770 2023-10-03T10:17:33.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.240+0000 7f1fb7fff700 1 -- 172.21.15.146:0/3592924615 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc001f070 con 0x7f1fd006a770 2023-10-03T10:17:33.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.240+0000 7f1fb7fff700 1 -- 172.21.15.146:0/3592924615 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc00038c0 con 0x7f1fd006a770 2023-10-03T10:17:33.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.240+0000 7f1fd5b72700 1 -- 172.21.15.146:0/3592924615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd0120a10 con 0x7f1fd006a770 2023-10-03T10:17:33.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.240+0000 7f1fd5b72700 1 -- 172.21.15.146:0/3592924615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd0123160 con 0x7f1fd006a770 2023-10-03T10:17:33.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.241+0000 7f1fb7fff700 1 -- 172.21.15.146:0/3592924615 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1fc0003a20 con 0x7f1fd006a770 2023-10-03T10:17:33.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.241+0000 7f1fb7fff700 1 -- 172.21.15.146:0/3592924615 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1fc0021070 con 0x7f1fd006a770 2023-10-03T10:17:33.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.241+0000 7f1fd5b72700 1 -- 172.21.15.146:0/3592924615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd004f2a0 con 0x7f1fd006a770 2023-10-03T10:17:33.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.246+0000 7f1fb7fff700 1 -- 172.21.15.146:0/3592924615 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1fc0015080 con 0x7f1fd006a770 2023-10-03T10:17:33.260 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:33.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.298+0000 7f3ad9cad700 1 -- 172.21.15.146:0/966868104 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3ad4120180 con 0x7f3ad4133ad0 2023-10-03T10:17:33.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.298+0000 7f3acbfff700 1 -- 172.21.15.146:0/966868104 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ad4120180 con 0x7f3ad4133ad0 2023-10-03T10:17:33.299 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:33.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.300+0000 7f3ad9cad700 1 -- 172.21.15.146:0/966868104 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ad4133ad0 msgr2=0x7f3ad411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.300+0000 7f3ad9cad700 1 --2- 172.21.15.146:0/966868104 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ad4133ad0 0x7f3ad411e4c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009e50 tx=0x7f3acc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.300+0000 7f3ad9cad700 1 -- 172.21.15.146:0/966868104 shutdown_connections 2023-10-03T10:17:33.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.300+0000 7f3ad9cad700 1 --2- 172.21.15.146:0/966868104 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3ad4133ad0 0x7f3ad411e4c0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.300+0000 7f3ad9cad700 1 --2- 172.21.15.146:0/966868104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ad41300a0 0x7f3ad411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.300+0000 7f3ad9cad700 1 --2- 172.21.15.146:0/966868104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ad4130bc0 0x7f3ad411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.300+0000 7f3ad9cad700 1 -- 172.21.15.146:0/966868104 >> 172.21.15.146:0/966868104 conn(0x7f3ad4099c40 msgr2=0x7f3ad4132190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.301+0000 7f3ad9cad700 1 -- 172.21.15.146:0/966868104 shutdown_connections 2023-10-03T10:17:33.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.301+0000 7f3ad9cad700 1 -- 172.21.15.146:0/966868104 wait complete. 2023-10-03T10:17:33.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.301+0000 7feb3c088700 1 Processor -- start 2023-10-03T10:17:33.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.301+0000 7feb3c088700 1 -- start start 2023-10-03T10:17:33.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.301+0000 7feb3c088700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb3409e870 0x7feb3409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.301+0000 7feb3c088700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feb3409f180 0x7feb34131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.301+0000 7feb3c088700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb34131d70 0x7feb34132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.301+0000 7feb3c088700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb340a0920 con 0x7feb3409f180 2023-10-03T10:17:33.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.301+0000 7feb3c088700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3409c970 con 0x7feb34131d70 2023-10-03T10:17:33.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.301+0000 7feb3c088700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb3409bab0 con 0x7feb3409e870 2023-10-03T10:17:33.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.302+0000 7feb39e24700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb3409e870 0x7feb3409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.302+0000 7feb39e24700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb3409e870 0x7feb3409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38042/0 (socket says 172.21.15.146:38042) 2023-10-03T10:17:33.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.302+0000 7feb39e24700 1 -- 172.21.15.146:0/1158765948 learned_addr learned my addr 172.21.15.146:0/1158765948 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:33.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.302+0000 7feb39623700 1 --2- 172.21.15.146:0/1158765948 >> v2:172.21.15.146:3300/0 conn(0x7feb3409f180 0x7feb34131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.302+0000 7feb39e24700 1 -- 172.21.15.146:0/1158765948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb34131d70 msgr2=0x7feb34132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:33.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.302+0000 7feb39e24700 1 --2- 172.21.15.146:0/1158765948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb34131d70 0x7feb34132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.302+0000 7feb39e24700 1 -- 172.21.15.146:0/1158765948 >> v2:172.21.15.146:3300/0 conn(0x7feb3409f180 msgr2=0x7feb34131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:33.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.302+0000 7feb39e24700 1 --2- 172.21.15.146:0/1158765948 >> v2:172.21.15.146:3300/0 conn(0x7feb3409f180 0x7feb34131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.302+0000 7feb39e24700 1 -- 172.21.15.146:0/1158765948 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3409f9c0 con 0x7feb3409e870 2023-10-03T10:17:33.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.302+0000 7feb39623700 1 --2- 172.21.15.146:0/1158765948 >> v2:172.21.15.146:3300/0 conn(0x7feb3409f180 0x7feb34131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:33.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.302+0000 7feb39e24700 1 --2- 172.21.15.146:0/1158765948 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb3409e870 0x7feb3409ec40 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7feb300098f0 tx=0x7feb30009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f49d97b3da32c315 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.302+0000 7feb38e22700 1 -- 172.21.15.146:0/1158765948 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3000b8a0 con 0x7feb3409e870 2023-10-03T10:17:33.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.302+0000 7feb38e22700 1 -- 172.21.15.146:0/1158765948 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3000ba00 con 0x7feb3409e870 2023-10-03T10:17:33.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.302+0000 7feb38e22700 1 -- 172.21.15.146:0/1158765948 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3000bd90 con 0x7feb3409e870 2023-10-03T10:17:33.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.303+0000 7feb3c088700 1 -- 172.21.15.146:0/1158765948 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb3409e870 msgr2=0x7feb3409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.303+0000 7feb3c088700 1 --2- 172.21.15.146:0/1158765948 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb3409e870 0x7feb3409ec40 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7feb300098f0 tx=0x7feb30009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:33.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.303+0000 7feb3c088700 1 -- 172.21.15.146:0/1158765948 shutdown_connections 2023-10-03T10:17:33.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.303+0000 7feb3c088700 1 --2- 172.21.15.146:0/1158765948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb34131d70 0x7feb34132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.303+0000 7feb3c088700 1 --2- 172.21.15.146:0/1158765948 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb3409e870 0x7feb3409ec40 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.303+0000 7feb3c088700 1 --2- 172.21.15.146:0/1158765948 >> v2:172.21.15.146:3300/0 conn(0x7feb3409f180 0x7feb34131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.303+0000 7feb3c088700 1 -- 172.21.15.146:0/1158765948 >> 172.21.15.146:0/1158765948 conn(0x7feb340a4430 msgr2=0x7feb340a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.303+0000 7feb3c088700 1 -- 172.21.15.146:0/1158765948 shutdown_connections 2023-10-03T10:17:33.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.303+0000 7feb3c088700 1 -- 172.21.15.146:0/1158765948 wait complete. 2023-10-03T10:17:33.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.304+0000 7feb3c088700 1 Processor -- start 2023-10-03T10:17:33.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.304+0000 7feb3c088700 1 -- start start 2023-10-03T10:17:33.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.305+0000 7feb3c088700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb3409e870 0x7feb3406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.305+0000 7feb3c088700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb3409f180 0x7feb3406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.305+0000 7feb3c088700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb34131d70 0x7feb3406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.305+0000 7feb3c088700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb34125d40 con 0x7feb34131d70 2023-10-03T10:17:33.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.305+0000 7feb3c088700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb341314f0 con 0x7feb3409e870 2023-10-03T10:17:33.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.305+0000 7feb3c088700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb3406d530 con 0x7feb3409f180 2023-10-03T10:17:33.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.305+0000 7feb39623700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb3409f180 0x7feb3406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.305+0000 7feb39623700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb3409f180 0x7feb3406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38054/0 (socket says 172.21.15.146:38054) 2023-10-03T10:17:33.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.305+0000 7feb39623700 1 -- 172.21.15.146:0/416359870 learned_addr learned my addr 172.21.15.146:0/416359870 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:33.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.305+0000 7feb3a625700 1 --2- 172.21.15.146:0/416359870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb34131d70 0x7feb3406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.305+0000 7feb39623700 1 -- 172.21.15.146:0/416359870 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb3409e870 msgr2=0x7feb3406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.305+0000 7feb39623700 1 --2- 172.21.15.146:0/416359870 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb3409e870 0x7feb3406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.305+0000 7feb39623700 1 -- 172.21.15.146:0/416359870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb34131d70 msgr2=0x7feb3406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.305+0000 7feb39623700 1 --2- 172.21.15.146:0/416359870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb34131d70 0x7feb3406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.305+0000 7feb39623700 1 -- 172.21.15.146:0/416359870 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb30009550 con 0x7feb3409f180 2023-10-03T10:17:33.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.306+0000 7feb39623700 1 --2- 172.21.15.146:0/416359870 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb3409f180 0x7feb3406bdf0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7feb2400e810 tx=0x7feb2400eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.306+0000 7feb2a7fc700 1 -- 172.21.15.146:0/416359870 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb24013610 con 0x7feb3409f180 2023-10-03T10:17:33.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.306+0000 7feb2a7fc700 1 -- 172.21.15.146:0/416359870 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb24013770 con 0x7feb3409f180 2023-10-03T10:17:33.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.306+0000 7feb2a7fc700 1 -- 172.21.15.146:0/416359870 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb24013b20 con 0x7feb3409f180 2023-10-03T10:17:33.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.306+0000 7feb3c088700 1 -- 172.21.15.146:0/416359870 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb340a0210 con 0x7feb3409f180 2023-10-03T10:17:33.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.306+0000 7feb3c088700 1 -- 172.21.15.146:0/416359870 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb341267b0 con 0x7feb3409f180 2023-10-03T10:17:33.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.307+0000 7feb3c088700 1 -- 172.21.15.146:0/416359870 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3404f2a0 con 0x7feb3409f180 2023-10-03T10:17:33.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.308+0000 7feb2a7fc700 1 -- 172.21.15.146:0/416359870 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb24013c80 con 0x7feb3409f180 2023-10-03T10:17:33.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.308+0000 7feb2a7fc700 1 -- 172.21.15.146:0/416359870 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feb2403f3c0 con 0x7feb3409f180 2023-10-03T10:17:33.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:33.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.316+0000 7feb2a7fc700 1 -- 172.21.15.146:0/416359870 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb24012370 con 0x7feb3409f180 2023-10-03T10:17:33.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.393+0000 7f85339c2700 1 Processor -- start 2023-10-03T10:17:33.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.393+0000 7f85339c2700 1 -- start start 2023-10-03T10:17:33.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.394+0000 7f85339c2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f852c09e950 0x7f852c09ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.394+0000 7f85339c2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f852c131fa0 0x7f852c139af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.394+0000 7f85339c2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852c09afb0 con 0x7f852c09f260 2023-10-03T10:17:33.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.394+0000 7f85339c2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f852c0a0970 con 0x7f852c09e950 2023-10-03T10:17:33.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.394+0000 7f85339c2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852c0a0320 con 0x7f852c131fa0 2023-10-03T10:17:33.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.394+0000 7f8531f5f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f852c131fa0 0x7f852c139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.394+0000 7f853175e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f852c09e950 0x7f852c09ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.394+0000 7f8531f5f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f852c131fa0 0x7f852c139af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45480/0 (socket says 172.21.15.146:45480) 2023-10-03T10:17:33.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.394+0000 7f8531f5f700 1 -- 172.21.15.146:0/2747772411 learned_addr learned my addr 172.21.15.146:0/2747772411 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:33.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.395+0000 7f853175e700 1 -- 172.21.15.146:0/2747772411 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f852c131fa0 msgr2=0x7f852c139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:33.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.395+0000 7f853175e700 1 --2- 172.21.15.146:0/2747772411 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f852c131fa0 0x7f852c139af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.395+0000 7f853175e700 1 -- 172.21.15.146:0/2747772411 >> v1:172.21.15.146:6789/0 conn(0x7f852c09f260 legacy=0x7f852c131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.395+0000 7f8523fff700 1 -- 172.21.15.146:0/2747772411 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972261003 0 0) 0x7f852c09afb0 con 0x7f852c09f260 2023-10-03T10:17:33.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.395+0000 7f853175e700 1 -- 172.21.15.146:0/2747772411 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852c0a0750 con 0x7f852c09e950 2023-10-03T10:17:33.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.395+0000 7f853175e700 1 --2- 172.21.15.146:0/2747772411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f852c09e950 0x7f852c09ed20 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f8528009820 tx=0x7f8528009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbed305f5267777 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.395+0000 7f8523fff700 1 -- 172.21.15.146:0/2747772411 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528005e30 con 0x7f852c09e950 2023-10-03T10:17:33.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.395+0000 7f8523fff700 1 -- 172.21.15.146:0/2747772411 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8528006030 con 0x7f852c09e950 2023-10-03T10:17:33.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.395+0000 7f8523fff700 1 -- 172.21.15.146:0/2747772411 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85280063c0 con 0x7f852c09e950 2023-10-03T10:17:33.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.395+0000 7f85339c2700 1 -- 172.21.15.146:0/2747772411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f852c09e950 msgr2=0x7f852c09ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.395+0000 7f85339c2700 1 --2- 172.21.15.146:0/2747772411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f852c09e950 0x7f852c09ed20 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f8528009820 tx=0x7f8528009b30 comp rx=0 tx=0).stop 2023-10-03T10:17:33.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.396+0000 7f85339c2700 1 -- 172.21.15.146:0/2747772411 shutdown_connections 2023-10-03T10:17:33.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.396+0000 7f85339c2700 1 --2- 172.21.15.146:0/2747772411 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f852c131fa0 0x7f852c139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.396+0000 7f85339c2700 1 --2- 172.21.15.146:0/2747772411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f852c09e950 0x7f852c09ed20 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.396+0000 7f85339c2700 1 -- 172.21.15.146:0/2747772411 >> 172.21.15.146:0/2747772411 conn(0x7f852c0a0f70 msgr2=0x7f852c0a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.396+0000 7f85339c2700 1 -- 172.21.15.146:0/2747772411 shutdown_connections 2023-10-03T10:17:33.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.396+0000 7f85339c2700 1 -- 172.21.15.146:0/2747772411 wait complete. 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.396+0000 7f85339c2700 1 Processor -- start 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.397+0000 7f85339c2700 1 -- start start 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.397+0000 7f85339c2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f852c09e950 0x7f852c120680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.397+0000 7f85339c2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f852c09f260 0x7f852c120bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.397+0000 7f85339c2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f852c131fa0 0x7f852c121100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.397+0000 7f85339c2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852c123f50 con 0x7f852c09e950 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.397+0000 7f85339c2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852c0a4ba0 con 0x7f852c131fa0 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.397+0000 7f85339c2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f852c09da40 con 0x7f852c09f260 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.397+0000 7f8530f5d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f852c09f260 0x7f852c120bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.397+0000 7f853175e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f852c09e950 0x7f852c120680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.397+0000 7f8531f5f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f852c131fa0 0x7f852c121100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.397+0000 7f8530f5d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f852c09f260 0x7f852c120bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:38070/0 (socket says 172.21.15.146:38070) 2023-10-03T10:17:33.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.397+0000 7f8531f5f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f852c131fa0 0x7f852c121100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45486/0 (socket says 172.21.15.146:45486) 2023-10-03T10:17:33.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.397+0000 7f853175e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f852c09e950 0x7f852c120680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52264/0 (socket says 172.21.15.146:52264) 2023-10-03T10:17:33.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.397+0000 7f8530f5d700 1 -- 172.21.15.146:0/2961625604 learned_addr learned my addr 172.21.15.146:0/2961625604 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:33.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.397+0000 7f853175e700 1 -- 172.21.15.146:0/2961625604 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f852c09f260 msgr2=0x7f852c120bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.397+0000 7f853175e700 1 --2- 172.21.15.146:0/2961625604 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f852c09f260 0x7f852c120bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.397+0000 7f853175e700 1 -- 172.21.15.146:0/2961625604 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f852c131fa0 msgr2=0x7f852c121100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.397+0000 7f853175e700 1 --2- 172.21.15.146:0/2961625604 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f852c131fa0 0x7f852c121100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.397+0000 7f853175e700 1 -- 172.21.15.146:0/2961625604 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8528009430 con 0x7f852c09e950 2023-10-03T10:17:33.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.398+0000 7f853175e700 1 --2- 172.21.15.146:0/2961625604 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f852c09e950 0x7f852c120680 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f8528015000 tx=0x7f8528004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.398+0000 7f8521ffb700 1 -- 172.21.15.146:0/2961625604 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528006990 con 0x7f852c09e950 2023-10-03T10:17:33.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.398+0000 7f8521ffb700 1 -- 172.21.15.146:0/2961625604 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8528004260 con 0x7f852c09e950 2023-10-03T10:17:33.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.398+0000 7f8521ffb700 1 -- 172.21.15.146:0/2961625604 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85280036a0 con 0x7f852c09e950 2023-10-03T10:17:33.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.398+0000 7f85339c2700 1 -- 172.21.15.146:0/2961625604 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f852c122330 con 0x7f852c09e950 2023-10-03T10:17:33.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.398+0000 7f85339c2700 1 -- 172.21.15.146:0/2961625604 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852c1246a0 con 0x7f852c09e950 2023-10-03T10:17:33.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.399+0000 7f8521ffb700 1 -- 172.21.15.146:0/2961625604 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8528022070 con 0x7f852c09e950 2023-10-03T10:17:33.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.399+0000 7f85339c2700 1 -- 172.21.15.146:0/2961625604 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f852c04f2a0 con 0x7f852c09e950 2023-10-03T10:17:33.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.399+0000 7f8521ffb700 1 -- 172.21.15.146:0/2961625604 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8528040d60 con 0x7f852c09e950 2023-10-03T10:17:33.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.404+0000 7f8521ffb700 1 -- 172.21.15.146:0/2961625604 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f852802f9a0 con 0x7f852c09e950 2023-10-03T10:17:33.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.446+0000 7f1fd5b72700 1 -- 172.21.15.146:0/3592924615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1fd0122c80 con 0x7f1fd006a770 2023-10-03T10:17:33.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.447+0000 7f1fb7fff700 1 -- 172.21.15.146:0/3592924615 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1fd0122c80 con 0x7f1fd006a770 2023-10-03T10:17:33.447 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.449+0000 7f1fd5b72700 1 -- 172.21.15.146:0/3592924615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fd006a770 msgr2=0x7f1fd011f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.449+0000 7f1fd5b72700 1 --2- 172.21.15.146:0/3592924615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fd006a770 0x7f1fd011f620 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f1fc00090b0 tx=0x7f1fc0004750 comp rx=0 tx=0).stop 2023-10-03T10:17:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.449+0000 7f1fd5b72700 1 -- 172.21.15.146:0/3592924615 shutdown_connections 2023-10-03T10:17:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.449+0000 7f1fd5b72700 1 --2- 172.21.15.146:0/3592924615 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1fd0131a00 0x7f1fd01200a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.449+0000 7f1fd5b72700 1 --2- 172.21.15.146:0/3592924615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fd006a770 0x7f1fd011f620 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.449+0000 7f1fd5b72700 1 --2- 172.21.15.146:0/3592924615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fd009dec0 0x7f1fd011fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.449+0000 7f1fd5b72700 1 -- 172.21.15.146:0/3592924615 >> 172.21.15.146:0/3592924615 conn(0x7f1fd0099c40 msgr2=0x7f1fd012f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.449+0000 7f1fd5b72700 1 -- 172.21.15.146:0/3592924615 shutdown_connections 2023-10-03T10:17:33.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.449+0000 7f1fd5b72700 1 -- 172.21.15.146:0/3592924615 wait complete. 2023-10-03T10:17:33.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:33.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.512+0000 7feb3c088700 1 -- 172.21.15.146:0/416359870 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feb34131b50 con 0x7feb3409f180 2023-10-03T10:17:33.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.512+0000 7feb2a7fc700 1 -- 172.21.15.146:0/416359870 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb24021030 con 0x7feb3409f180 2023-10-03T10:17:33.513 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:33.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.515+0000 7feb3c088700 1 -- 172.21.15.146:0/416359870 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb3409f180 msgr2=0x7feb3406bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.515+0000 7feb3c088700 1 --2- 172.21.15.146:0/416359870 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb3409f180 0x7feb3406bdf0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7feb2400e810 tx=0x7feb2400eb20 comp rx=0 tx=0).stop 2023-10-03T10:17:33.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.515+0000 7feb3c088700 1 -- 172.21.15.146:0/416359870 shutdown_connections 2023-10-03T10:17:33.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.515+0000 7feb3c088700 1 --2- 172.21.15.146:0/416359870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb34131d70 0x7feb3406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.515+0000 7feb3c088700 1 --2- 172.21.15.146:0/416359870 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb3409e870 0x7feb3406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.515+0000 7feb3c088700 1 --2- 172.21.15.146:0/416359870 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb3409f180 0x7feb3406bdf0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.515+0000 7feb3c088700 1 -- 172.21.15.146:0/416359870 >> 172.21.15.146:0/416359870 conn(0x7feb340a4430 msgr2=0x7feb3406f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.515+0000 7feb3c088700 1 -- 172.21.15.146:0/416359870 shutdown_connections 2023-10-03T10:17:33.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.515+0000 7feb3c088700 1 -- 172.21.15.146:0/416359870 wait complete. 2023-10-03T10:17:33.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:33.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.597+0000 7f85339c2700 1 -- 172.21.15.146:0/2961625604 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f852c09b8b0 con 0x7f852c09e950 2023-10-03T10:17:33.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.597+0000 7f8521ffb700 1 -- 172.21.15.146:0/2961625604 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f852802a020 con 0x7f852c09e950 2023-10-03T10:17:33.598 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:33.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.599+0000 7f85339c2700 1 -- 172.21.15.146:0/2961625604 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f852c09e950 msgr2=0x7f852c120680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.599+0000 7f85339c2700 1 --2- 172.21.15.146:0/2961625604 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f852c09e950 0x7f852c120680 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f8528015000 tx=0x7f8528004750 comp rx=0 tx=0).stop 2023-10-03T10:17:33.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.599+0000 7f85339c2700 1 -- 172.21.15.146:0/2961625604 shutdown_connections 2023-10-03T10:17:33.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.599+0000 7f85339c2700 1 --2- 172.21.15.146:0/2961625604 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f852c131fa0 0x7f852c121100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.599+0000 7f85339c2700 1 --2- 172.21.15.146:0/2961625604 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f852c09e950 0x7f852c120680 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.599+0000 7f85339c2700 1 --2- 172.21.15.146:0/2961625604 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f852c09f260 0x7f852c120bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.599+0000 7f85339c2700 1 -- 172.21.15.146:0/2961625604 >> 172.21.15.146:0/2961625604 conn(0x7f852c0a0f70 msgr2=0x7f852c11a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.599+0000 7f85339c2700 1 -- 172.21.15.146:0/2961625604 shutdown_connections 2023-10-03T10:17:33.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:33.599+0000 7f85339c2700 1 -- 172.21.15.146:0/2961625604 wait complete. 2023-10-03T10:17:33.612 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:34.319 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:34.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.442+0000 7f36f7210700 1 Processor -- start 2023-10-03T10:17:34.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.442+0000 7f36f7210700 1 -- start start 2023-10-03T10:17:34.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.442+0000 7f36f7210700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f009e870 0x7f36f009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.442+0000 7f36f7210700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f36f009f180 0x7f36f0133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.442+0000 7f36f7210700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f009fa00 con 0x7f36f0134160 2023-10-03T10:17:34.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.442+0000 7f36f7210700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f00a0370 con 0x7f36f009f180 2023-10-03T10:17:34.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.442+0000 7f36f7210700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f006bec0 con 0x7f36f009e870 2023-10-03T10:17:34.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.443+0000 7f36f4fac700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f009e870 0x7f36f009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.443+0000 7f36effff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f36f009f180 0x7f36f0133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.443+0000 7f36effff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f36f009f180 0x7f36f0133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32990/0 (socket says 172.21.15.146:32990) 2023-10-03T10:17:34.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.443+0000 7f36f4fac700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f009e870 0x7f36f009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56470/0 (socket says 172.21.15.146:56470) 2023-10-03T10:17:34.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.443+0000 7f36f57ad700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f36f0134160 0x7f36f013ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44934/0 (socket says 172.21.15.146:44934) 2023-10-03T10:17:34.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.443+0000 7f36effff700 1 -- 172.21.15.146:0/3302606587 learned_addr learned my addr 172.21.15.146:0/3302606587 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:34.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.443+0000 7f36effff700 1 -- 172.21.15.146:0/3302606587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f009e870 msgr2=0x7f36f009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:34.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.443+0000 7f36effff700 1 --2- 172.21.15.146:0/3302606587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f009e870 0x7f36f009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.443+0000 7f36effff700 1 -- 172.21.15.146:0/3302606587 >> v1:172.21.15.146:6789/0 conn(0x7f36f0134160 legacy=0x7f36f013ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.443+0000 7f36effff700 1 -- 172.21.15.146:0/3302606587 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f009ada0 con 0x7f36f009f180 2023-10-03T10:17:34.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.443+0000 7f36ef7fe700 1 -- 172.21.15.146:0/3302606587 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674480621 0 0) 0x7f36f009fa00 con 0x7f36f0134160 2023-10-03T10:17:34.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.443+0000 7f36f4fac700 1 --2- 172.21.15.146:0/3302606587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f009e870 0x7f36f009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:34.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.443+0000 7f36effff700 1 --2- 172.21.15.146:0/3302606587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36f009f180 0x7f36f0133c20 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0098f0 tx=0x7f36dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102fe2e82ef4a151 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.443+0000 7f36ef7fe700 1 -- 172.21.15.146:0/3302606587 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc011830 con 0x7f36f009f180 2023-10-03T10:17:34.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.443+0000 7f36ef7fe700 1 -- 172.21.15.146:0/3302606587 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36dc011990 con 0x7f36f009f180 2023-10-03T10:17:34.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.443+0000 7f36ef7fe700 1 -- 172.21.15.146:0/3302606587 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc011d20 con 0x7f36f009f180 2023-10-03T10:17:34.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.444+0000 7f36f7210700 1 -- 172.21.15.146:0/3302606587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36f009f180 msgr2=0x7f36f0133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.444+0000 7f36f7210700 1 --2- 172.21.15.146:0/3302606587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36f009f180 0x7f36f0133c20 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0098f0 tx=0x7f36dc009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:34.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.444+0000 7f36f7210700 1 -- 172.21.15.146:0/3302606587 shutdown_connections 2023-10-03T10:17:34.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.444+0000 7f36f7210700 1 --2- 172.21.15.146:0/3302606587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f009e870 0x7f36f009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.444+0000 7f36f7210700 1 --2- 172.21.15.146:0/3302606587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36f009f180 0x7f36f0133c20 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.444+0000 7f36f7210700 1 -- 172.21.15.146:0/3302606587 >> 172.21.15.146:0/3302606587 conn(0x7f36f00a4430 msgr2=0x7f36f00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.444+0000 7f36f7210700 1 -- 172.21.15.146:0/3302606587 shutdown_connections 2023-10-03T10:17:34.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.444+0000 7f36f7210700 1 -- 172.21.15.146:0/3302606587 wait complete. 2023-10-03T10:17:34.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.445+0000 7f36f7210700 1 Processor -- start 2023-10-03T10:17:34.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.445+0000 7f36f7210700 1 -- start start 2023-10-03T10:17:34.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.445+0000 7f36f7210700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f009e870 0x7f36f0122b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.445+0000 7f36f7210700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36f009f180 0x7f36f01230a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.445+0000 7f36f7210700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36f0134160 0x7f36f01235e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.445+0000 7f36f7210700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f0124010 con 0x7f36f009f180 2023-10-03T10:17:34.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.445+0000 7f36f7210700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f0124830 con 0x7f36f009e870 2023-10-03T10:17:34.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.445+0000 7f36f7210700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36f0124cd0 con 0x7f36f0134160 2023-10-03T10:17:34.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.445+0000 7f36effff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36f009f180 0x7f36f01230a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.445+0000 7f36f4fac700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f009e870 0x7f36f0122b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.445+0000 7f36effff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36f009f180 0x7f36f01230a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32994/0 (socket says 172.21.15.146:32994) 2023-10-03T10:17:34.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.445+0000 7f36effff700 1 -- 172.21.15.146:0/1620884776 learned_addr learned my addr 172.21.15.146:0/1620884776 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:34.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.445+0000 7f36f4fac700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f009e870 0x7f36f0122b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56484/0 (socket says 172.21.15.146:56484) 2023-10-03T10:17:34.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.445+0000 7f36f57ad700 1 --2- 172.21.15.146:0/1620884776 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36f0134160 0x7f36f01235e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.446+0000 7f36f4fac700 1 -- 172.21.15.146:0/1620884776 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36f0134160 msgr2=0x7f36f01235e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.446+0000 7f36f4fac700 1 --2- 172.21.15.146:0/1620884776 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36f0134160 0x7f36f01235e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.446+0000 7f36f4fac700 1 -- 172.21.15.146:0/1620884776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36f009f180 msgr2=0x7f36f01230a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.446+0000 7f36f4fac700 1 --2- 172.21.15.146:0/1620884776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36f009f180 0x7f36f01230a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.446+0000 7f36f4fac700 1 -- 172.21.15.146:0/1620884776 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e40094a0 con 0x7f36f009e870 2023-10-03T10:17:34.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.446+0000 7f36effff700 1 --2- 172.21.15.146:0/1620884776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36f009f180 0x7f36f01230a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:34.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.446+0000 7f36f4fac700 1 --2- 172.21.15.146:0/1620884776 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f009e870 0x7f36f0122b60 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f36e400e9b0 tx=0x7f36e400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.446+0000 7f36ed7fa700 1 -- 172.21.15.146:0/1620884776 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e400ee50 con 0x7f36f009e870 2023-10-03T10:17:34.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.446+0000 7f36ed7fa700 1 -- 172.21.15.146:0/1620884776 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e400c850 con 0x7f36f009e870 2023-10-03T10:17:34.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.446+0000 7f36f7210700 1 -- 172.21.15.146:0/1620884776 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36dc009550 con 0x7f36f009e870 2023-10-03T10:17:34.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.446+0000 7f36ed7fa700 1 -- 172.21.15.146:0/1620884776 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e400cc00 con 0x7f36f009e870 2023-10-03T10:17:34.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.446+0000 7f36f7210700 1 -- 172.21.15.146:0/1620884776 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f0126350 con 0x7f36f009e870 2023-10-03T10:17:34.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.447+0000 7f36f7210700 1 -- 172.21.15.146:0/1620884776 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f004f2a0 con 0x7f36f009e870 2023-10-03T10:17:34.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.447+0000 7f36ed7fa700 1 -- 172.21.15.146:0/1620884776 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f36e4013470 con 0x7f36f009e870 2023-10-03T10:17:34.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.448+0000 7f36ed7fa700 1 -- 172.21.15.146:0/1620884776 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f36e403fee0 con 0x7f36f009e870 2023-10-03T10:17:34.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.452+0000 7f36ed7fa700 1 -- 172.21.15.146:0/1620884776 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f36e4013720 con 0x7f36f009e870 2023-10-03T10:17:34.462 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:34.528 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:34.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.586+0000 7f01d0623700 1 Processor -- start 2023-10-03T10:17:34.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.586+0000 7f01d0623700 1 -- start start 2023-10-03T10:17:34.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.587+0000 7f01d0623700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f01c806a770 0x7f01c806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.587+0000 7f01d0623700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c8131ec0 0x7f01c8139c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.587+0000 7f01d0623700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c809da80 con 0x7f01c806b080 2023-10-03T10:17:34.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.587+0000 7f01d0623700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c809dce0 con 0x7f01c806a770 2023-10-03T10:17:34.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.587+0000 7f01d0623700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c809eb20 con 0x7f01c8131ec0 2023-10-03T10:17:34.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.587+0000 7f01ce3bf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f01c806a770 0x7f01c806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.587+0000 7f01ce3bf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f01c806a770 0x7f01c806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33004/0 (socket says 172.21.15.146:33004) 2023-10-03T10:17:34.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.587+0000 7f01cebc0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c8131ec0 0x7f01c8139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.587+0000 7f01cdbbe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f01c806b080 0x7f01c81317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44946/0 (socket says 172.21.15.146:44946) 2023-10-03T10:17:34.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.587+0000 7f01ce3bf700 1 -- 172.21.15.146:0/3275124748 learned_addr learned my addr 172.21.15.146:0/3275124748 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:34.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.588+0000 7f01ce3bf700 1 -- 172.21.15.146:0/3275124748 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c8131ec0 msgr2=0x7f01c8139c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:34.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.588+0000 7f01ce3bf700 1 --2- 172.21.15.146:0/3275124748 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c8131ec0 0x7f01c8139c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.588+0000 7f01ce3bf700 1 -- 172.21.15.146:0/3275124748 >> v1:172.21.15.146:6789/0 conn(0x7f01c806b080 legacy=0x7f01c81317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.588+0000 7f01ce3bf700 1 -- 172.21.15.146:0/3275124748 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c809d860 con 0x7f01c806a770 2023-10-03T10:17:34.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.588+0000 7f01cd3bd700 1 -- 172.21.15.146:0/3275124748 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153524737 0 0) 0x7f01c809da80 con 0x7f01c806b080 2023-10-03T10:17:34.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.588+0000 7f01cebc0700 1 --2- 172.21.15.146:0/3275124748 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c8131ec0 0x7f01c8139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:34.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.588+0000 7f01ce3bf700 1 --2- 172.21.15.146:0/3275124748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c806a770 0x7f01c806ab40 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f01c40098f0 tx=0x7f01c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78797544fa579e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.588+0000 7f01cd3bd700 1 -- 172.21.15.146:0/3275124748 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4011830 con 0x7f01c806a770 2023-10-03T10:17:34.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.588+0000 7f01cd3bd700 1 -- 172.21.15.146:0/3275124748 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c4011990 con 0x7f01c806a770 2023-10-03T10:17:34.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.588+0000 7f01cd3bd700 1 -- 172.21.15.146:0/3275124748 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4011d20 con 0x7f01c806a770 2023-10-03T10:17:34.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.588+0000 7f01d0623700 1 -- 172.21.15.146:0/3275124748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c806a770 msgr2=0x7f01c806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.588+0000 7f01d0623700 1 --2- 172.21.15.146:0/3275124748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c806a770 0x7f01c806ab40 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f01c40098f0 tx=0x7f01c4009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:34.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.589+0000 7f01d0623700 1 -- 172.21.15.146:0/3275124748 shutdown_connections 2023-10-03T10:17:34.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.589+0000 7f01d0623700 1 --2- 172.21.15.146:0/3275124748 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c8131ec0 0x7f01c8139c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.589+0000 7f01d0623700 1 --2- 172.21.15.146:0/3275124748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c806a770 0x7f01c806ab40 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.589+0000 7f01d0623700 1 -- 172.21.15.146:0/3275124748 >> 172.21.15.146:0/3275124748 conn(0x7f01c8099c40 msgr2=0x7f01c80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.589+0000 7f01d0623700 1 -- 172.21.15.146:0/3275124748 shutdown_connections 2023-10-03T10:17:34.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.589+0000 7f01d0623700 1 -- 172.21.15.146:0/3275124748 wait complete. 2023-10-03T10:17:34.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.590+0000 7f01d0623700 1 Processor -- start 2023-10-03T10:17:34.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.590+0000 7f01d0623700 1 -- start start 2023-10-03T10:17:34.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01d0623700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c806a770 0x7f01c809ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01d0623700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c806b080 0x7f01c809b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01d0623700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f01c8131ec0 0x7f01c81c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01d0623700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c81314c0 con 0x7f01c806b080 2023-10-03T10:17:34.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01d0623700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c809b8c0 con 0x7f01c806a770 2023-10-03T10:17:34.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01d0623700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01c81220d0 con 0x7f01c8131ec0 2023-10-03T10:17:34.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01cdbbe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c806b080 0x7f01c809b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01cebc0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f01c8131ec0 0x7f01c81c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01cdbbe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c806b080 0x7f01c809b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33018/0 (socket says 172.21.15.146:33018) 2023-10-03T10:17:34.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01cdbbe700 1 -- 172.21.15.146:0/3047377477 learned_addr learned my addr 172.21.15.146:0/3047377477 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:34.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01ce3bf700 1 --2- 172.21.15.146:0/3047377477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c806a770 0x7f01c809ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01cebc0700 1 -- 172.21.15.146:0/3047377477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c806a770 msgr2=0x7f01c809ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01cebc0700 1 --2- 172.21.15.146:0/3047377477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c806a770 0x7f01c809ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01cebc0700 1 -- 172.21.15.146:0/3047377477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c806b080 msgr2=0x7f01c809b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01cebc0700 1 --2- 172.21.15.146:0/3047377477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c806b080 0x7f01c809b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01cebc0700 1 -- 172.21.15.146:0/3047377477 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c0009a70 con 0x7f01c8131ec0 2023-10-03T10:17:34.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01ce3bf700 1 --2- 172.21.15.146:0/3047377477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c806a770 0x7f01c809ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:34.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01cdbbe700 1 --2- 172.21.15.146:0/3047377477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c806b080 0x7f01c809b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:34.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01cebc0700 1 --2- 172.21.15.146:0/3047377477 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f01c8131ec0 0x7f01c81c81b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009e50 tx=0x7f01c000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01beffd700 1 -- 172.21.15.146:0/3047377477 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c000ca90 con 0x7f01c8131ec0 2023-10-03T10:17:34.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01beffd700 1 -- 172.21.15.146:0/3047377477 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c000f040 con 0x7f01c8131ec0 2023-10-03T10:17:34.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01d0623700 1 -- 172.21.15.146:0/3047377477 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c4009550 con 0x7f01c8131ec0 2023-10-03T10:17:34.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.591+0000 7f01beffd700 1 -- 172.21.15.146:0/3047377477 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c000ce50 con 0x7f01c8131ec0 2023-10-03T10:17:34.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.592+0000 7f01d0623700 1 -- 172.21.15.146:0/3047377477 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c8122390 con 0x7f01c8131ec0 2023-10-03T10:17:34.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.592+0000 7f01beffd700 1 -- 172.21.15.146:0/3047377477 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f01c0014480 con 0x7f01c8131ec0 2023-10-03T10:17:34.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.593+0000 7f01d0623700 1 -- 172.21.15.146:0/3047377477 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c809d2f0 con 0x7f01c8131ec0 2023-10-03T10:17:34.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.593+0000 7f01beffd700 1 -- 172.21.15.146:0/3047377477 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f01c003fc30 con 0x7f01c8131ec0 2023-10-03T10:17:34.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.597+0000 7f01beffd700 1 -- 172.21.15.146:0/3047377477 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f01c0012930 con 0x7f01c8131ec0 2023-10-03T10:17:34.613 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:34.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.652+0000 7f36f7210700 1 -- 172.21.15.146:0/1620884776 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f36f0133f40 con 0x7f36f009e870 2023-10-03T10:17:34.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.652+0000 7f36ed7fa700 1 -- 172.21.15.146:0/1620884776 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f36e401ab10 con 0x7f36f009e870 2023-10-03T10:17:34.653 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:34.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.655+0000 7f36f7210700 1 -- 172.21.15.146:0/1620884776 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f009e870 msgr2=0x7f36f0122b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.655+0000 7f36f7210700 1 --2- 172.21.15.146:0/1620884776 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f009e870 0x7f36f0122b60 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f36e400e9b0 tx=0x7f36e400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.655+0000 7f36f7210700 1 -- 172.21.15.146:0/1620884776 shutdown_connections 2023-10-03T10:17:34.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.655+0000 7f36f7210700 1 --2- 172.21.15.146:0/1620884776 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f36f0134160 0x7f36f01235e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.655+0000 7f36f7210700 1 --2- 172.21.15.146:0/1620884776 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36f009e870 0x7f36f0122b60 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.655+0000 7f36f7210700 1 --2- 172.21.15.146:0/1620884776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36f009f180 0x7f36f01230a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.655+0000 7f36f7210700 1 -- 172.21.15.146:0/1620884776 >> 172.21.15.146:0/1620884776 conn(0x7f36f00a4430 msgr2=0x7f36f00a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.655+0000 7f36f7210700 1 -- 172.21.15.146:0/1620884776 shutdown_connections 2023-10-03T10:17:34.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.655+0000 7f36f7210700 1 -- 172.21.15.146:0/1620884776 wait complete. 2023-10-03T10:17:34.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.659+0000 7f1ea10e6700 1 Processor -- start 2023-10-03T10:17:34.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.659+0000 7f1ea10e6700 1 -- start start 2023-10-03T10:17:34.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.660+0000 7f1ea10e6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e9c0a0a30 0x7f1e9c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.660+0000 7f1ea10e6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1e9c0a1340 0x7f1e9c12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.660+0000 7f1ea10e6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9c0a1e70 con 0x7f1e9c1304a0 2023-10-03T10:17:34.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.660+0000 7f1ea10e6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e9c09a720 con 0x7f1e9c0a1340 2023-10-03T10:17:34.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.660+0000 7f1ea10e6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c09b300 con 0x7f1e9c0a0a30 2023-10-03T10:17:34.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.660+0000 7f1e9ad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e9c0a0a30 0x7f1e9c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.660+0000 7f1e9ad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e9c0a0a30 0x7f1e9c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56516/0 (socket says 172.21.15.146:56516) 2023-10-03T10:17:34.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.660+0000 7f1e9ad9d700 1 -- 172.21.15.146:0/315654096 learned_addr learned my addr 172.21.15.146:0/315654096 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:34.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.660+0000 7f1e9ad9d700 1 -- 172.21.15.146:0/315654096 >> v2:172.21.15.146:3300/0 conn(0x7f1e9c0a1340 msgr2=0x7f1e9c12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:34.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.660+0000 7f1e9ad9d700 1 --2- 172.21.15.146:0/315654096 >> v2:172.21.15.146:3300/0 conn(0x7f1e9c0a1340 0x7f1e9c12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.660+0000 7f1e9ad9d700 1 -- 172.21.15.146:0/315654096 >> v1:172.21.15.146:6789/0 conn(0x7f1e9c1304a0 legacy=0x7f1e9c1371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:34.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.660+0000 7f1e9ad9d700 1 -- 172.21.15.146:0/315654096 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9c09abc0 con 0x7f1e9c0a0a30 2023-10-03T10:17:34.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.661+0000 7f1e9ad9d700 1 --2- 172.21.15.146:0/315654096 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e9c0a0a30 0x7f1e9c0a0e00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c006fd0 tx=0x7f1e8c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6920284a57eb3777 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.661+0000 7f1e99d9b700 1 -- 172.21.15.146:0/315654096 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c005e30 con 0x7f1e9c0a0a30 2023-10-03T10:17:34.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.661+0000 7f1e99d9b700 1 -- 172.21.15.146:0/315654096 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8c006030 con 0x7f1e9c0a0a30 2023-10-03T10:17:34.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.661+0000 7f1e99d9b700 1 -- 172.21.15.146:0/315654096 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c0063c0 con 0x7f1e9c0a0a30 2023-10-03T10:17:34.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.662+0000 7f1ea10e6700 1 -- 172.21.15.146:0/315654096 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e9c0a0a30 msgr2=0x7f1e9c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.662+0000 7f1ea10e6700 1 --2- 172.21.15.146:0/315654096 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e9c0a0a30 0x7f1e9c0a0e00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c006fd0 tx=0x7f1e8c009bd0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.662+0000 7f1ea10e6700 1 -- 172.21.15.146:0/315654096 shutdown_connections 2023-10-03T10:17:34.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.662+0000 7f1ea10e6700 1 --2- 172.21.15.146:0/315654096 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e9c0a0a30 0x7f1e9c0a0e00 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.662+0000 7f1ea10e6700 1 --2- 172.21.15.146:0/315654096 >> v2:172.21.15.146:3300/0 conn(0x7f1e9c0a1340 0x7f1e9c12ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.662+0000 7f1ea10e6700 1 -- 172.21.15.146:0/315654096 >> 172.21.15.146:0/315654096 conn(0x7f1e9c0a2980 msgr2=0x7f1e9c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.662+0000 7f1ea10e6700 1 -- 172.21.15.146:0/315654096 shutdown_connections 2023-10-03T10:17:34.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.662+0000 7f1ea10e6700 1 -- 172.21.15.146:0/315654096 wait complete. 2023-10-03T10:17:34.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.664+0000 7f1ea10e6700 1 Processor -- start 2023-10-03T10:17:34.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.664+0000 7f1ea10e6700 1 -- start start 2023-10-03T10:17:34.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.664+0000 7f1ea10e6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e9c0a0a30 0x7f1e9c13adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.664+0000 7f1ea10e6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e9c0a1340 0x7f1e9c13b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.664+0000 7f1ea10e6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e9c1304a0 0x7f1e9c13b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.664+0000 7f1ea10e6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c139510 con 0x7f1e9c0a0a30 2023-10-03T10:17:34.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.664+0000 7f1ea10e6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c09ae00 con 0x7f1e9c0a1340 2023-10-03T10:17:34.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.664+0000 7f1ea10e6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c137b60 con 0x7f1e9c1304a0 2023-10-03T10:17:34.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.665+0000 7f1e9b59e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e9c1304a0 0x7f1e9c13b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.665+0000 7f1e9b59e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e9c1304a0 0x7f1e9c13b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:48680/0 (socket says 172.21.15.146:48680) 2023-10-03T10:17:34.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.665+0000 7f1e9b59e700 1 -- 172.21.15.146:0/3265426839 learned_addr learned my addr 172.21.15.146:0/3265426839 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:34.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.665+0000 7f1e9ad9d700 1 --2- 172.21.15.146:0/3265426839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e9c0a0a30 0x7f1e9c13adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.665+0000 7f1e9a59c700 1 --2- 172.21.15.146:0/3265426839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e9c0a1340 0x7f1e9c13b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.665+0000 7f1e9b59e700 1 -- 172.21.15.146:0/3265426839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e9c0a1340 msgr2=0x7f1e9c13b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.665+0000 7f1e9b59e700 1 --2- 172.21.15.146:0/3265426839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e9c0a1340 0x7f1e9c13b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.665+0000 7f1e9b59e700 1 -- 172.21.15.146:0/3265426839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e9c0a0a30 msgr2=0x7f1e9c13adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.665+0000 7f1e9b59e700 1 --2- 172.21.15.146:0/3265426839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e9c0a0a30 0x7f1e9c13adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.665+0000 7f1e9b59e700 1 -- 172.21.15.146:0/3265426839 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c009500 con 0x7f1e9c1304a0 2023-10-03T10:17:34.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.665+0000 7f1e9b59e700 1 --2- 172.21.15.146:0/3265426839 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e9c1304a0 0x7f1e9c13b830 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1e9400c7a0 tx=0x7f1e9400cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.665+0000 7f1e837fe700 1 -- 172.21.15.146:0/3265426839 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e94003e10 con 0x7f1e9c1304a0 2023-10-03T10:17:34.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.666+0000 7f1e837fe700 1 -- 172.21.15.146:0/3265426839 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e94005070 con 0x7f1e9c1304a0 2023-10-03T10:17:34.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.666+0000 7f1e837fe700 1 -- 172.21.15.146:0/3265426839 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e94005420 con 0x7f1e9c1304a0 2023-10-03T10:17:34.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.666+0000 7f1ea10e6700 1 -- 172.21.15.146:0/3265426839 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9c13a1d0 con 0x7f1e9c1304a0 2023-10-03T10:17:34.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.666+0000 7f1ea10e6700 1 -- 172.21.15.146:0/3265426839 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9c13bd70 con 0x7f1e9c1304a0 2023-10-03T10:17:34.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.667+0000 7f1e837fe700 1 -- 172.21.15.146:0/3265426839 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e94005580 con 0x7f1e9c1304a0 2023-10-03T10:17:34.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.667+0000 7f1e837fe700 1 -- 172.21.15.146:0/3265426839 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1e9403e930 con 0x7f1e9c1304a0 2023-10-03T10:17:34.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.667+0000 7f1ea10e6700 1 -- 172.21.15.146:0/3265426839 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e9c04f2a0 con 0x7f1e9c1304a0 2023-10-03T10:17:34.671 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:34.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.676+0000 7f1e837fe700 1 -- 172.21.15.146:0/3265426839 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e94005830 con 0x7f1e9c1304a0 2023-10-03T10:17:34.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.761+0000 7f5091c3f700 1 Processor -- start 2023-10-03T10:17:34.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.761+0000 7f5091c3f700 1 -- start start 2023-10-03T10:17:34.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.762+0000 7f5091c3f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f508c0a0a70 0x7f508c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.762+0000 7f5091c3f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f508c0a1380 0x7f508c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.762+0000 7f5091c3f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508c09dc00 con 0x7f508c133f50 2023-10-03T10:17:34.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.762+0000 7f5091c3f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508c09ea60 con 0x7f508c0a1380 2023-10-03T10:17:34.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.762+0000 7f5091c3f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f508c09dec0 con 0x7f508c0a0a70 2023-10-03T10:17:34.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.762+0000 7f508affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f508c0a1380 0x7f508c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.762+0000 7f508affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f508c0a1380 0x7f508c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33044/0 (socket says 172.21.15.146:33044) 2023-10-03T10:17:34.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.762+0000 7f508affd700 1 -- 172.21.15.146:0/1300118481 learned_addr learned my addr 172.21.15.146:0/1300118481 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:34.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.762+0000 7f508b7fe700 1 --2- 172.21.15.146:0/1300118481 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f508c0a0a70 0x7f508c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.762+0000 7f508affd700 1 -- 172.21.15.146:0/1300118481 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f508c0a0a70 msgr2=0x7f508c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:34.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.762+0000 7f508affd700 1 --2- 172.21.15.146:0/1300118481 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f508c0a0a70 0x7f508c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.762+0000 7f508affd700 1 -- 172.21.15.146:0/1300118481 >> v1:172.21.15.146:6789/0 conn(0x7f508c133f50 legacy=0x7f508c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.762+0000 7f508affd700 1 -- 172.21.15.146:0/1300118481 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c09e6a0 con 0x7f508c0a1380 2023-10-03T10:17:34.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.762+0000 7f508a7fc700 1 -- 172.21.15.146:0/1300118481 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302359011 0 0) 0x7f508c09dc00 con 0x7f508c133f50 2023-10-03T10:17:34.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.762+0000 7f508affd700 1 --2- 172.21.15.146:0/1300118481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f508c0a1380 0x7f508c133a10 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f50800098f0 tx=0x7f5080009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33b66062c60b3df6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.762+0000 7f508a7fc700 1 -- 172.21.15.146:0/1300118481 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080011830 con 0x7f508c0a1380 2023-10-03T10:17:34.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.762+0000 7f508a7fc700 1 -- 172.21.15.146:0/1300118481 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5080011990 con 0x7f508c0a1380 2023-10-03T10:17:34.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.762+0000 7f508a7fc700 1 -- 172.21.15.146:0/1300118481 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080011d20 con 0x7f508c0a1380 2023-10-03T10:17:34.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.763+0000 7f5091c3f700 1 -- 172.21.15.146:0/1300118481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f508c0a1380 msgr2=0x7f508c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.763+0000 7f5091c3f700 1 --2- 172.21.15.146:0/1300118481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f508c0a1380 0x7f508c133a10 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f50800098f0 tx=0x7f5080009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:34.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.763+0000 7f5091c3f700 1 -- 172.21.15.146:0/1300118481 shutdown_connections 2023-10-03T10:17:34.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.763+0000 7f5091c3f700 1 --2- 172.21.15.146:0/1300118481 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f508c0a0a70 0x7f508c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.763+0000 7f5091c3f700 1 --2- 172.21.15.146:0/1300118481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f508c0a1380 0x7f508c133a10 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.763+0000 7f5091c3f700 1 -- 172.21.15.146:0/1300118481 >> 172.21.15.146:0/1300118481 conn(0x7f508c0a6610 msgr2=0x7f508c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.763+0000 7f5091c3f700 1 -- 172.21.15.146:0/1300118481 shutdown_connections 2023-10-03T10:17:34.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.763+0000 7f5091c3f700 1 -- 172.21.15.146:0/1300118481 wait complete. 2023-10-03T10:17:34.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.764+0000 7f5091c3f700 1 Processor -- start 2023-10-03T10:17:34.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.764+0000 7f5091c3f700 1 -- start start 2023-10-03T10:17:34.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.765+0000 7f5091c3f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f508c0a0a70 0x7f508c1229c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.765+0000 7f5091c3f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f508c0a1380 0x7f508c122f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.765+0000 7f5091c3f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f508c133f50 0x7f508c123440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.765+0000 7f5091c3f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c126530 con 0x7f508c0a0a70 2023-10-03T10:17:34.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.765+0000 7f5091c3f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c0a03e0 con 0x7f508c0a1380 2023-10-03T10:17:34.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.765+0000 7f5091c3f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f508c133990 con 0x7f508c133f50 2023-10-03T10:17:34.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.765+0000 7f508affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f508c0a1380 0x7f508c122f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.765+0000 7f508affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f508c0a1380 0x7f508c122f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56530/0 (socket says 172.21.15.146:56530) 2023-10-03T10:17:34.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.765+0000 7f508affd700 1 -- 172.21.15.146:0/3372486084 learned_addr learned my addr 172.21.15.146:0/3372486084 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:34.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.765+0000 7f508bfff700 1 --2- 172.21.15.146:0/3372486084 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f508c133f50 0x7f508c123440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.765+0000 7f508b7fe700 1 --2- 172.21.15.146:0/3372486084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f508c0a0a70 0x7f508c1229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.765+0000 7f508affd700 1 -- 172.21.15.146:0/3372486084 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f508c133f50 msgr2=0x7f508c123440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.765+0000 7f508affd700 1 --2- 172.21.15.146:0/3372486084 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f508c133f50 0x7f508c123440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.765+0000 7f508affd700 1 -- 172.21.15.146:0/3372486084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f508c0a0a70 msgr2=0x7f508c1229c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.765+0000 7f508affd700 1 --2- 172.21.15.146:0/3372486084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f508c0a0a70 0x7f508c1229c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.765+0000 7f508affd700 1 -- 172.21.15.146:0/3372486084 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5080009550 con 0x7f508c0a1380 2023-10-03T10:17:34.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.765+0000 7f508affd700 1 --2- 172.21.15.146:0/3372486084 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f508c0a1380 0x7f508c122f00 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f5080009c40 tx=0x7f5080004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.765+0000 7f5073fff700 1 -- 172.21.15.146:0/3372486084 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080004300 con 0x7f508c0a1380 2023-10-03T10:17:34.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.765+0000 7f5073fff700 1 -- 172.21.15.146:0/3372486084 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508001f070 con 0x7f508c0a1380 2023-10-03T10:17:34.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.765+0000 7f5073fff700 1 -- 172.21.15.146:0/3372486084 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50800036a0 con 0x7f508c0a1380 2023-10-03T10:17:34.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.765+0000 7f5091c3f700 1 -- 172.21.15.146:0/3372486084 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508c133450 con 0x7f508c0a1380 2023-10-03T10:17:34.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.766+0000 7f5091c3f700 1 -- 172.21.15.146:0/3372486084 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508c124540 con 0x7f508c0a1380 2023-10-03T10:17:34.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.766+0000 7f5073fff700 1 -- 172.21.15.146:0/3372486084 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5080021030 con 0x7f508c0a1380 2023-10-03T10:17:34.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.767+0000 7f5073fff700 1 -- 172.21.15.146:0/3372486084 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5080040970 con 0x7f508c0a1380 2023-10-03T10:17:34.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.767+0000 7f5091c3f700 1 -- 172.21.15.146:0/3372486084 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508c124730 con 0x7f508c0a1380 2023-10-03T10:17:34.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.775+0000 7f5073fff700 1 -- 172.21.15.146:0/3372486084 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5080015070 con 0x7f508c0a1380 2023-10-03T10:17:34.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.805+0000 7f01d0623700 1 -- 172.21.15.146:0/3047377477 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f01c809cb20 con 0x7f01c8131ec0 2023-10-03T10:17:34.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.805+0000 7f01beffd700 1 -- 172.21.15.146:0/3047377477 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f01c0012340 con 0x7f01c8131ec0 2023-10-03T10:17:34.806 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:34.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.807+0000 7f01d0623700 1 -- 172.21.15.146:0/3047377477 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f01c8131ec0 msgr2=0x7f01c81c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.807+0000 7f01d0623700 1 --2- 172.21.15.146:0/3047377477 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f01c8131ec0 0x7f01c81c81b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009e50 tx=0x7f01c000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.807+0000 7f01d0623700 1 -- 172.21.15.146:0/3047377477 shutdown_connections 2023-10-03T10:17:34.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.807+0000 7f01d0623700 1 --2- 172.21.15.146:0/3047377477 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f01c8131ec0 0x7f01c81c81b0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.807+0000 7f01d0623700 1 --2- 172.21.15.146:0/3047377477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c806a770 0x7f01c809ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.807+0000 7f01d0623700 1 --2- 172.21.15.146:0/3047377477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c806b080 0x7f01c809b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.807+0000 7f01d0623700 1 -- 172.21.15.146:0/3047377477 >> 172.21.15.146:0/3047377477 conn(0x7f01c8099c40 msgr2=0x7f01c81b99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.807+0000 7f01d0623700 1 -- 172.21.15.146:0/3047377477 shutdown_connections 2023-10-03T10:17:34.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.807+0000 7f01d0623700 1 -- 172.21.15.146:0/3047377477 wait complete. 2023-10-03T10:17:34.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:34.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.891+0000 7f1ea10e6700 1 -- 172.21.15.146:0/3265426839 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1e9c139b40 con 0x7f1e9c1304a0 2023-10-03T10:17:34.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.891+0000 7f1e837fe700 1 -- 172.21.15.146:0/3265426839 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e9c139b40 con 0x7f1e9c1304a0 2023-10-03T10:17:34.892 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:34.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.893+0000 7f1ea10e6700 1 -- 172.21.15.146:0/3265426839 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e9c1304a0 msgr2=0x7f1e9c13b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.893+0000 7f1ea10e6700 1 --2- 172.21.15.146:0/3265426839 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e9c1304a0 0x7f1e9c13b830 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1e9400c7a0 tx=0x7f1e9400cab0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.893+0000 7f1ea10e6700 1 -- 172.21.15.146:0/3265426839 shutdown_connections 2023-10-03T10:17:34.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.893+0000 7f1ea10e6700 1 --2- 172.21.15.146:0/3265426839 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1e9c1304a0 0x7f1e9c13b830 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.893+0000 7f1ea10e6700 1 --2- 172.21.15.146:0/3265426839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e9c0a0a30 0x7f1e9c13adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.893+0000 7f1ea10e6700 1 --2- 172.21.15.146:0/3265426839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1e9c0a1340 0x7f1e9c13b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.893+0000 7f1ea10e6700 1 -- 172.21.15.146:0/3265426839 >> 172.21.15.146:0/3265426839 conn(0x7f1e9c0a2980 msgr2=0x7f1e9c09deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.893+0000 7f1ea10e6700 1 -- 172.21.15.146:0/3265426839 shutdown_connections 2023-10-03T10:17:34.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.893+0000 7f1ea10e6700 1 -- 172.21.15.146:0/3265426839 wait complete. 2023-10-03T10:17:34.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:34.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.969+0000 7f5091c3f700 1 -- 172.21.15.146:0/3372486084 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f508c04f2a0 con 0x7f508c0a1380 2023-10-03T10:17:34.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.969+0000 7f5073fff700 1 -- 172.21.15.146:0/3372486084 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5080023790 con 0x7f508c0a1380 2023-10-03T10:17:34.970 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:34.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.971+0000 7f5091c3f700 1 -- 172.21.15.146:0/3372486084 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f508c0a1380 msgr2=0x7f508c122f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.971+0000 7f5091c3f700 1 --2- 172.21.15.146:0/3372486084 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f508c0a1380 0x7f508c122f00 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f5080009c40 tx=0x7f5080004750 comp rx=0 tx=0).stop 2023-10-03T10:17:34.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.971+0000 7f5091c3f700 1 -- 172.21.15.146:0/3372486084 shutdown_connections 2023-10-03T10:17:34.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.971+0000 7f5091c3f700 1 --2- 172.21.15.146:0/3372486084 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f508c133f50 0x7f508c123440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.971+0000 7f5091c3f700 1 --2- 172.21.15.146:0/3372486084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f508c0a0a70 0x7f508c1229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.971+0000 7f5091c3f700 1 --2- 172.21.15.146:0/3372486084 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f508c0a1380 0x7f508c122f00 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.971+0000 7f5091c3f700 1 -- 172.21.15.146:0/3372486084 >> 172.21.15.146:0/3372486084 conn(0x7f508c0a6610 msgr2=0x7f508c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.971+0000 7f5091c3f700 1 -- 172.21.15.146:0/3372486084 shutdown_connections 2023-10-03T10:17:34.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:34.971+0000 7f5091c3f700 1 -- 172.21.15.146:0/3372486084 wait complete. 2023-10-03T10:17:34.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:35.673 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:35.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.798+0000 7efe90533700 1 Processor -- start 2023-10-03T10:17:35.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.798+0000 7efe90533700 1 -- start start 2023-10-03T10:17:35.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.799+0000 7efe90533700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efe88133ad0 0x7efe88133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.799+0000 7efe90533700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe881300a0 0x7efe881304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.799+0000 7efe90533700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe881309f0 0x7efe8813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.799+0000 7efe90533700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe8806b2d0 con 0x7efe88133ad0 2023-10-03T10:17:35.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.799+0000 7efe90533700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe88133610 con 0x7efe881309f0 2023-10-03T10:17:35.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.799+0000 7efe90533700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe8809a500 con 0x7efe881300a0 2023-10-03T10:17:35.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.799+0000 7efe8ead0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe881309f0 0x7efe8813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.799+0000 7efe8dace700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe881300a0 0x7efe881304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.799+0000 7efe8dace700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe881300a0 0x7efe881304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:48706/0 (socket says 172.21.15.146:48706) 2023-10-03T10:17:35.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.799+0000 7efe8ead0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe881309f0 0x7efe8813a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56536/0 (socket says 172.21.15.146:56536) 2023-10-03T10:17:35.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.799+0000 7efe8dace700 1 -- 172.21.15.146:0/3978294651 learned_addr learned my addr 172.21.15.146:0/3978294651 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:35.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.799+0000 7efe8e2cf700 1 --2- 172.21.15.146:0/3978294651 >> v2:172.21.15.146:3300/0 conn(0x7efe88133ad0 0x7efe88133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.799+0000 7efe8dace700 1 -- 172.21.15.146:0/3978294651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe881309f0 msgr2=0x7efe8813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:35.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.799+0000 7efe8dace700 1 --2- 172.21.15.146:0/3978294651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe881309f0 0x7efe8813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.799+0000 7efe8dace700 1 -- 172.21.15.146:0/3978294651 >> v2:172.21.15.146:3300/0 conn(0x7efe88133ad0 msgr2=0x7efe88133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:35.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.799+0000 7efe8dace700 1 --2- 172.21.15.146:0/3978294651 >> v2:172.21.15.146:3300/0 conn(0x7efe88133ad0 0x7efe88133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.799+0000 7efe8dace700 1 -- 172.21.15.146:0/3978294651 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe881338b0 con 0x7efe881300a0 2023-10-03T10:17:35.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.800+0000 7efe8e2cf700 1 --2- 172.21.15.146:0/3978294651 >> v2:172.21.15.146:3300/0 conn(0x7efe88133ad0 0x7efe88133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:35.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.799+0000 7efe8ead0700 1 --2- 172.21.15.146:0/3978294651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe881309f0 0x7efe8813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:35.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.800+0000 7efe8dace700 1 --2- 172.21.15.146:0/3978294651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe881300a0 0x7efe881304b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7efe840098f0 tx=0x7efe84009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b8cfdbb1c98a89d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.800+0000 7efe8d2cd700 1 -- 172.21.15.146:0/3978294651 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe84011830 con 0x7efe881300a0 2023-10-03T10:17:35.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.800+0000 7efe8d2cd700 1 -- 172.21.15.146:0/3978294651 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe84011990 con 0x7efe881300a0 2023-10-03T10:17:35.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.800+0000 7efe8d2cd700 1 -- 172.21.15.146:0/3978294651 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe84011d20 con 0x7efe881300a0 2023-10-03T10:17:35.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.800+0000 7efe90533700 1 -- 172.21.15.146:0/3978294651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe881300a0 msgr2=0x7efe881304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.800+0000 7efe90533700 1 --2- 172.21.15.146:0/3978294651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe881300a0 0x7efe881304b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7efe840098f0 tx=0x7efe84009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:35.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.800+0000 7efe90533700 1 -- 172.21.15.146:0/3978294651 shutdown_connections 2023-10-03T10:17:35.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.800+0000 7efe90533700 1 --2- 172.21.15.146:0/3978294651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe881309f0 0x7efe8813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.800+0000 7efe90533700 1 --2- 172.21.15.146:0/3978294651 >> v2:172.21.15.146:3300/0 conn(0x7efe88133ad0 0x7efe88133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.800+0000 7efe90533700 1 --2- 172.21.15.146:0/3978294651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe881300a0 0x7efe881304b0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.800+0000 7efe90533700 1 -- 172.21.15.146:0/3978294651 >> 172.21.15.146:0/3978294651 conn(0x7efe88099c40 msgr2=0x7efe880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.800+0000 7efe90533700 1 -- 172.21.15.146:0/3978294651 shutdown_connections 2023-10-03T10:17:35.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.800+0000 7efe90533700 1 -- 172.21.15.146:0/3978294651 wait complete. 2023-10-03T10:17:35.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.801+0000 7efe90533700 1 Processor -- start 2023-10-03T10:17:35.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.801+0000 7efe90533700 1 -- start start 2023-10-03T10:17:35.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.802+0000 7efe90533700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe881300a0 0x7efe8811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.802+0000 7efe90533700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe881309f0 0x7efe8811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.802+0000 7efe90533700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe88133ad0 0x7efe8811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.802+0000 7efe90533700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe881209f0 con 0x7efe881300a0 2023-10-03T10:17:35.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.802+0000 7efe90533700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8812f920 con 0x7efe881309f0 2023-10-03T10:17:35.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.802+0000 7efe90533700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe8812d8c0 con 0x7efe88133ad0 2023-10-03T10:17:35.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.802+0000 7efe8dace700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe881309f0 0x7efe8811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.802+0000 7efe8ead0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe88133ad0 0x7efe8811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.802+0000 7efe8e2cf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe881300a0 0x7efe8811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.802+0000 7efe8dace700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe881309f0 0x7efe8811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56538/0 (socket says 172.21.15.146:56538) 2023-10-03T10:17:35.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.802+0000 7efe8dace700 1 -- 172.21.15.146:0/645542390 learned_addr learned my addr 172.21.15.146:0/645542390 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:35.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.802+0000 7efe8dace700 1 -- 172.21.15.146:0/645542390 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe88133ad0 msgr2=0x7efe8811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.802+0000 7efe8dace700 1 --2- 172.21.15.146:0/645542390 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe88133ad0 0x7efe8811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.802+0000 7efe8dace700 1 -- 172.21.15.146:0/645542390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe881300a0 msgr2=0x7efe8811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.802+0000 7efe8dace700 1 --2- 172.21.15.146:0/645542390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe881300a0 0x7efe8811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.802+0000 7efe8dace700 1 -- 172.21.15.146:0/645542390 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe80009a70 con 0x7efe881309f0 2023-10-03T10:17:35.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.802+0000 7efe8ead0700 1 --2- 172.21.15.146:0/645542390 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe88133ad0 0x7efe8811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:35.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.802+0000 7efe8dace700 1 --2- 172.21.15.146:0/645542390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe881309f0 0x7efe8811df80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7efe84000c00 tx=0x7efe84004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.802+0000 7efe7effd700 1 -- 172.21.15.146:0/645542390 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe84004240 con 0x7efe881309f0 2023-10-03T10:17:35.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.802+0000 7efe7effd700 1 -- 172.21.15.146:0/645542390 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8401f070 con 0x7efe881309f0 2023-10-03T10:17:35.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.802+0000 7efe90533700 1 -- 172.21.15.146:0/645542390 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe780094a0 con 0x7efe881309f0 2023-10-03T10:17:35.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.802+0000 7efe7effd700 1 -- 172.21.15.146:0/645542390 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe840045c0 con 0x7efe881309f0 2023-10-03T10:17:35.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.803+0000 7efe90533700 1 -- 172.21.15.146:0/645542390 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe84009550 con 0x7efe881309f0 2023-10-03T10:17:35.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.803+0000 7efe7effd700 1 -- 172.21.15.146:0/645542390 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe84021030 con 0x7efe881309f0 2023-10-03T10:17:35.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.803+0000 7efe7effd700 1 -- 172.21.15.146:0/645542390 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efe84040830 con 0x7efe881309f0 2023-10-03T10:17:35.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.803+0000 7efe90533700 1 -- 172.21.15.146:0/645542390 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe8809cb20 con 0x7efe881309f0 2023-10-03T10:17:35.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.808+0000 7efe7effd700 1 -- 172.21.15.146:0/645542390 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe84015070 con 0x7efe881309f0 2023-10-03T10:17:35.821 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:35.907 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:35.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.946+0000 7f81f21ad700 1 Processor -- start 2023-10-03T10:17:35.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.946+0000 7f81f21ad700 1 -- start start 2023-10-03T10:17:35.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.946+0000 7f81f21ad700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ec133900 0x7f81ec133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.946+0000 7f81f21ad700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81ec134210 0x7f81ec0a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.946+0000 7f81f21ad700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81ec0a0ee0 0x7f81ec0a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.946+0000 7f81f21ad700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81ec09a760 con 0x7f81ec134210 2023-10-03T10:17:35.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.946+0000 7f81f21ad700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec1336e0 con 0x7f81ec0a0ee0 2023-10-03T10:17:35.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.946+0000 7f81f21ad700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec09a080 con 0x7f81ec133900 2023-10-03T10:17:35.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.947+0000 7f81eaffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81ec134210 0x7f81ec0a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.947+0000 7f81eb7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ec133900 0x7f81ec133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.947+0000 7f81eaffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81ec134210 0x7f81ec0a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33090/0 (socket says 172.21.15.146:33090) 2023-10-03T10:17:35.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.947+0000 7f81eaffd700 1 -- 172.21.15.146:0/439838183 learned_addr learned my addr 172.21.15.146:0/439838183 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:35.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.947+0000 7f81ebfff700 1 --2- 172.21.15.146:0/439838183 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81ec0a0ee0 0x7f81ec0a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.947+0000 7f81eb7fe700 1 -- 172.21.15.146:0/439838183 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81ec0a0ee0 msgr2=0x7f81ec0a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:35.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.947+0000 7f81eb7fe700 1 --2- 172.21.15.146:0/439838183 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81ec0a0ee0 0x7f81ec0a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.947+0000 7f81eb7fe700 1 -- 172.21.15.146:0/439838183 >> v2:172.21.15.146:3300/0 conn(0x7f81ec134210 msgr2=0x7f81ec0a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:35.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.947+0000 7f81eb7fe700 1 --2- 172.21.15.146:0/439838183 >> v2:172.21.15.146:3300/0 conn(0x7f81ec134210 0x7f81ec0a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.947+0000 7f81eb7fe700 1 -- 172.21.15.146:0/439838183 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ec0a23e0 con 0x7f81ec133900 2023-10-03T10:17:35.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.947+0000 7f81eaffd700 1 --2- 172.21.15.146:0/439838183 >> v2:172.21.15.146:3300/0 conn(0x7f81ec134210 0x7f81ec0a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:35.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.947+0000 7f81eb7fe700 1 --2- 172.21.15.146:0/439838183 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ec133900 0x7f81ec133cd0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f81dc009820 tx=0x7f81dc009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4900cf54848da67 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.947+0000 7f81ea7fc700 1 -- 172.21.15.146:0/439838183 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc005e30 con 0x7f81ec133900 2023-10-03T10:17:35.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.947+0000 7f81ea7fc700 1 -- 172.21.15.146:0/439838183 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81dc006030 con 0x7f81ec133900 2023-10-03T10:17:35.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.947+0000 7f81ea7fc700 1 -- 172.21.15.146:0/439838183 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc0063c0 con 0x7f81ec133900 2023-10-03T10:17:35.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.948+0000 7f81f21ad700 1 -- 172.21.15.146:0/439838183 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ec133900 msgr2=0x7f81ec133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.948+0000 7f81f21ad700 1 --2- 172.21.15.146:0/439838183 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ec133900 0x7f81ec133cd0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f81dc009820 tx=0x7f81dc009b30 comp rx=0 tx=0).stop 2023-10-03T10:17:35.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.948+0000 7f81f21ad700 1 -- 172.21.15.146:0/439838183 shutdown_connections 2023-10-03T10:17:35.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.948+0000 7f81f21ad700 1 --2- 172.21.15.146:0/439838183 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81ec0a0ee0 0x7f81ec0a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.948+0000 7f81f21ad700 1 --2- 172.21.15.146:0/439838183 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ec133900 0x7f81ec133cd0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.948+0000 7f81f21ad700 1 --2- 172.21.15.146:0/439838183 >> v2:172.21.15.146:3300/0 conn(0x7f81ec134210 0x7f81ec0a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.948+0000 7f81f21ad700 1 -- 172.21.15.146:0/439838183 >> 172.21.15.146:0/439838183 conn(0x7f81ec0a2980 msgr2=0x7f81ec0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.948+0000 7f81f21ad700 1 -- 172.21.15.146:0/439838183 shutdown_connections 2023-10-03T10:17:35.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.948+0000 7f81f21ad700 1 -- 172.21.15.146:0/439838183 wait complete. 2023-10-03T10:17:35.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.949+0000 7f81f21ad700 1 Processor -- start 2023-10-03T10:17:35.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.949+0000 7f81f21ad700 1 -- start start 2023-10-03T10:17:35.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.950+0000 7f81f21ad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81ec0a0ee0 0x7f81ec11c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.950+0000 7f81f21ad700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ec133900 0x7f81ec11cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.950+0000 7f81f21ad700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81ec134210 0x7f81ec11d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.950+0000 7f81f21ad700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec11f930 con 0x7f81ec0a0ee0 2023-10-03T10:17:35.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.950+0000 7f81f21ad700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec09a2c0 con 0x7f81ec134210 2023-10-03T10:17:35.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.950+0000 7f81f21ad700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec132f10 con 0x7f81ec133900 2023-10-03T10:17:35.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.950+0000 7f81eaffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ec133900 0x7f81ec11cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.950+0000 7f81eb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81ec0a0ee0 0x7f81ec11c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.950+0000 7f81eaffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ec133900 0x7f81ec11cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:48738/0 (socket says 172.21.15.146:48738) 2023-10-03T10:17:35.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.950+0000 7f81eb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81ec0a0ee0 0x7f81ec11c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33106/0 (socket says 172.21.15.146:33106) 2023-10-03T10:17:35.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.950+0000 7f81eaffd700 1 -- 172.21.15.146:0/3104748221 learned_addr learned my addr 172.21.15.146:0/3104748221 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:35.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.950+0000 7f81ebfff700 1 --2- 172.21.15.146:0/3104748221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81ec134210 0x7f81ec11d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.950+0000 7f81eaffd700 1 -- 172.21.15.146:0/3104748221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81ec134210 msgr2=0x7f81ec11d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.950+0000 7f81eaffd700 1 --2- 172.21.15.146:0/3104748221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81ec134210 0x7f81ec11d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.950+0000 7f81eaffd700 1 -- 172.21.15.146:0/3104748221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81ec0a0ee0 msgr2=0x7f81ec11c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.950+0000 7f81eaffd700 1 --2- 172.21.15.146:0/3104748221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81ec0a0ee0 0x7f81ec11c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.950+0000 7f81eaffd700 1 -- 172.21.15.146:0/3104748221 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e0009550 con 0x7f81ec133900 2023-10-03T10:17:35.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.950+0000 7f81eb7fe700 1 --2- 172.21.15.146:0/3104748221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81ec0a0ee0 0x7f81ec11c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:35.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.950+0000 7f81eaffd700 1 --2- 172.21.15.146:0/3104748221 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ec133900 0x7f81ec11cbc0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f81e000ebe0 tx=0x7f81e000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.950+0000 7f81d3fff700 1 -- 172.21.15.146:0/3104748221 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e000c850 con 0x7f81ec133900 2023-10-03T10:17:35.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.951+0000 7f81d3fff700 1 -- 172.21.15.146:0/3104748221 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e000c9b0 con 0x7f81ec133900 2023-10-03T10:17:35.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.951+0000 7f81d3fff700 1 -- 172.21.15.146:0/3104748221 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e000cd60 con 0x7f81ec133900 2023-10-03T10:17:35.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.951+0000 7f81f21ad700 1 -- 172.21.15.146:0/3104748221 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81dc009430 con 0x7f81ec133900 2023-10-03T10:17:35.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.951+0000 7f81f21ad700 1 -- 172.21.15.146:0/3104748221 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81ec11f4e0 con 0x7f81ec133900 2023-10-03T10:17:35.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.951+0000 7f81d3fff700 1 -- 172.21.15.146:0/3104748221 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81e0013470 con 0x7f81ec133900 2023-10-03T10:17:35.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.952+0000 7f81d3fff700 1 -- 172.21.15.146:0/3104748221 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f81e003f6a0 con 0x7f81ec133900 2023-10-03T10:17:35.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.952+0000 7f81f21ad700 1 -- 172.21.15.146:0/3104748221 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81ec11fd40 con 0x7f81ec133900 2023-10-03T10:17:35.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:35.961+0000 7f81d3fff700 1 -- 172.21.15.146:0/3104748221 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81e00232f0 con 0x7f81ec133900 2023-10-03T10:17:35.984 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:36.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.014+0000 7efe90533700 1 -- 172.21.15.146:0/645542390 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efe8812dd00 con 0x7efe881309f0 2023-10-03T10:17:36.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.014+0000 7efe7effd700 1 -- 172.21.15.146:0/645542390 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe8401a450 con 0x7efe881309f0 2023-10-03T10:17:36.015 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:36.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.017+0000 7efe90533700 1 -- 172.21.15.146:0/645542390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe881309f0 msgr2=0x7efe8811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.017+0000 7efe90533700 1 --2- 172.21.15.146:0/645542390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe881309f0 0x7efe8811df80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7efe84000c00 tx=0x7efe84004750 comp rx=0 tx=0).stop 2023-10-03T10:17:36.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.017+0000 7efe90533700 1 -- 172.21.15.146:0/645542390 shutdown_connections 2023-10-03T10:17:36.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.017+0000 7efe90533700 1 --2- 172.21.15.146:0/645542390 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe88133ad0 0x7efe8811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.017+0000 7efe90533700 1 --2- 172.21.15.146:0/645542390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe881300a0 0x7efe8811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.017+0000 7efe90533700 1 --2- 172.21.15.146:0/645542390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe881309f0 0x7efe8811df80 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.017+0000 7efe90533700 1 -- 172.21.15.146:0/645542390 >> 172.21.15.146:0/645542390 conn(0x7efe88099c40 msgr2=0x7efe88132ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.017+0000 7efe90533700 1 -- 172.21.15.146:0/645542390 shutdown_connections 2023-10-03T10:17:36.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.017+0000 7efe90533700 1 -- 172.21.15.146:0/645542390 wait complete. 2023-10-03T10:17:36.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:36.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.036+0000 7fa3eb044700 1 Processor -- start 2023-10-03T10:17:36.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.036+0000 7fa3eb044700 1 -- start start 2023-10-03T10:17:36.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.036+0000 7fa3eb044700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3e4066410 0x7fa3e41319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.036+0000 7fa3eb044700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa3e41314b0 0x7fa3e4131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.037+0000 7fa3eb044700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e409bc70 0x7fa3e409c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.037+0000 7fa3eb044700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e40667e0 con 0x7fa3e41314b0 2023-10-03T10:17:36.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.037+0000 7fa3eb044700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e40a23c0 con 0x7fa3e4066410 2023-10-03T10:17:36.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.037+0000 7fa3eb044700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e40a0f20 con 0x7fa3e409bc70 2023-10-03T10:17:36.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.037+0000 7fa3e3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa3e41314b0 0x7fa3e4131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.037+0000 7fa3e8de0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3e4066410 0x7fa3e41319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.037+0000 7fa3e8de0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3e4066410 0x7fa3e41319f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56562/0 (socket says 172.21.15.146:56562) 2023-10-03T10:17:36.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.037+0000 7fa3e8de0700 1 -- 172.21.15.146:0/2528438300 learned_addr learned my addr 172.21.15.146:0/2528438300 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:36.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.037+0000 7fa3e3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa3e41314b0 0x7fa3e4131f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33116/0 (socket says 172.21.15.146:33116) 2023-10-03T10:17:36.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.037+0000 7fa3e95e1700 1 --2- 172.21.15.146:0/2528438300 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e409bc70 0x7fa3e409c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.037+0000 7fa3e3fff700 1 -- 172.21.15.146:0/2528438300 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e409bc70 msgr2=0x7fa3e409c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.037+0000 7fa3e3fff700 1 --2- 172.21.15.146:0/2528438300 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e409bc70 0x7fa3e409c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.037+0000 7fa3e3fff700 1 -- 172.21.15.146:0/2528438300 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3e4066410 msgr2=0x7fa3e41319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.037+0000 7fa3e3fff700 1 --2- 172.21.15.146:0/2528438300 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3e4066410 0x7fa3e41319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.037+0000 7fa3e3fff700 1 -- 172.21.15.146:0/2528438300 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e40a16e0 con 0x7fa3e41314b0 2023-10-03T10:17:36.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.037+0000 7fa3e8de0700 1 --2- 172.21.15.146:0/2528438300 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3e4066410 0x7fa3e41319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.037+0000 7fa3e95e1700 1 --2- 172.21.15.146:0/2528438300 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e409bc70 0x7fa3e409c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:36.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.037+0000 7fa3e3fff700 1 --2- 172.21.15.146:0/2528438300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3e41314b0 0x7fa3e4131f30 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000dc90 tx=0x7fa3d000f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a298806709cc86bf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.037+0000 7fa3e37fe700 1 -- 172.21.15.146:0/2528438300 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0012070 con 0x7fa3e41314b0 2023-10-03T10:17:36.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.037+0000 7fa3e37fe700 1 -- 172.21.15.146:0/2528438300 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d000d2e0 con 0x7fa3e41314b0 2023-10-03T10:17:36.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.038+0000 7fa3e37fe700 1 -- 172.21.15.146:0/2528438300 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d000f8b0 con 0x7fa3e41314b0 2023-10-03T10:17:36.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.038+0000 7fa3eb044700 1 -- 172.21.15.146:0/2528438300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3e41314b0 msgr2=0x7fa3e4131f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.038+0000 7fa3eb044700 1 --2- 172.21.15.146:0/2528438300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3e41314b0 0x7fa3e4131f30 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000dc90 tx=0x7fa3d000f050 comp rx=0 tx=0).stop 2023-10-03T10:17:36.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.038+0000 7fa3eb044700 1 -- 172.21.15.146:0/2528438300 shutdown_connections 2023-10-03T10:17:36.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.038+0000 7fa3eb044700 1 --2- 172.21.15.146:0/2528438300 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3e4066410 0x7fa3e41319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.038+0000 7fa3eb044700 1 --2- 172.21.15.146:0/2528438300 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e409bc70 0x7fa3e409c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.038+0000 7fa3eb044700 1 --2- 172.21.15.146:0/2528438300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3e41314b0 0x7fa3e4131f30 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.038+0000 7fa3eb044700 1 -- 172.21.15.146:0/2528438300 >> 172.21.15.146:0/2528438300 conn(0x7fa3e40a2980 msgr2=0x7fa3e40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.038+0000 7fa3eb044700 1 -- 172.21.15.146:0/2528438300 shutdown_connections 2023-10-03T10:17:36.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.038+0000 7fa3eb044700 1 -- 172.21.15.146:0/2528438300 wait complete. 2023-10-03T10:17:36.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.040+0000 7fa3eb044700 1 Processor -- start 2023-10-03T10:17:36.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.040+0000 7fa3eb044700 1 -- start start 2023-10-03T10:17:36.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.040+0000 7fa3eb044700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e4066410 0x7fa3e411b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.041+0000 7fa3eb044700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3e409bc70 0x7fa3e411bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.041+0000 7fa3eb044700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3e41314b0 0x7fa3e411c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.041+0000 7fa3eb044700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e411d8f0 con 0x7fa3e41314b0 2023-10-03T10:17:36.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.041+0000 7fa3eb044700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e411fb70 con 0x7fa3e409bc70 2023-10-03T10:17:36.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.041+0000 7fa3eb044700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e411f1b0 con 0x7fa3e4066410 2023-10-03T10:17:36.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.041+0000 7fa3e8de0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e4066410 0x7fa3e411b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.041+0000 7fa3e8de0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e4066410 0x7fa3e411b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:48764/0 (socket says 172.21.15.146:48764) 2023-10-03T10:17:36.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.041+0000 7fa3e8de0700 1 -- 172.21.15.146:0/2265479532 learned_addr learned my addr 172.21.15.146:0/2265479532 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:36.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.041+0000 7fa3e3fff700 1 --2- 172.21.15.146:0/2265479532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3e409bc70 0x7fa3e411bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.041+0000 7fa3e95e1700 1 --2- 172.21.15.146:0/2265479532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3e41314b0 0x7fa3e411c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.041+0000 7fa3e8de0700 1 -- 172.21.15.146:0/2265479532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3e409bc70 msgr2=0x7fa3e411bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.041+0000 7fa3e8de0700 1 --2- 172.21.15.146:0/2265479532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3e409bc70 0x7fa3e411bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.041+0000 7fa3e8de0700 1 -- 172.21.15.146:0/2265479532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3e41314b0 msgr2=0x7fa3e411c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.041+0000 7fa3e8de0700 1 --2- 172.21.15.146:0/2265479532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3e41314b0 0x7fa3e411c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.041+0000 7fa3e8de0700 1 -- 172.21.15.146:0/2265479532 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d8009500 con 0x7fa3e4066410 2023-10-03T10:17:36.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.041+0000 7fa3e8de0700 1 --2- 172.21.15.146:0/2265479532 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e4066410 0x7fa3e411b690 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800ebe0 tx=0x7fa3d800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.041+0000 7fa3e17fa700 1 -- 172.21.15.146:0/2265479532 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8005a20 con 0x7fa3e4066410 2023-10-03T10:17:36.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.041+0000 7fa3e17fa700 1 -- 172.21.15.146:0/2265479532 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d8005b80 con 0x7fa3e4066410 2023-10-03T10:17:36.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.041+0000 7fa3eb044700 1 -- 172.21.15.146:0/2265479532 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d000d940 con 0x7fa3e4066410 2023-10-03T10:17:36.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.041+0000 7fa3e17fa700 1 -- 172.21.15.146:0/2265479532 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d800c850 con 0x7fa3e4066410 2023-10-03T10:17:36.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.042+0000 7fa3eb044700 1 -- 172.21.15.146:0/2265479532 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e411e9a0 con 0x7fa3e4066410 2023-10-03T10:17:36.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.042+0000 7fa3eb044700 1 -- 172.21.15.146:0/2265479532 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e40714c0 con 0x7fa3e4066410 2023-10-03T10:17:36.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.042+0000 7fa3e17fa700 1 -- 172.21.15.146:0/2265479532 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa3d800c9b0 con 0x7fa3e4066410 2023-10-03T10:17:36.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.043+0000 7fa3e17fa700 1 -- 172.21.15.146:0/2265479532 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa3d803f480 con 0x7fa3e4066410 2023-10-03T10:17:36.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.051+0000 7fa3e17fa700 1 -- 172.21.15.146:0/2265479532 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3d8022b70 con 0x7fa3e4066410 2023-10-03T10:17:36.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.119+0000 7f0772d07700 1 Processor -- start 2023-10-03T10:17:36.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.119+0000 7f0772d07700 1 -- start start 2023-10-03T10:17:36.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.119+0000 7f0772d07700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f076c09e340 0x7f076c1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.119+0000 7f0772d07700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f076c135f20 0x7f076c138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.119+0000 7f0772d07700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f076c09aaa0 con 0x7f076c09d860 2023-10-03T10:17:36.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.119+0000 7f0772d07700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076c09e730 con 0x7f076c09e340 2023-10-03T10:17:36.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.119+0000 7f0772d07700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f076c09f870 con 0x7f076c135f20 2023-10-03T10:17:36.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.119+0000 7f076bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f076c09e340 0x7f076c1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.119+0000 7f07712a4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f076c135f20 0x7f076c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.119+0000 7f076bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f076c09e340 0x7f076c1359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56576/0 (socket says 172.21.15.146:56576) 2023-10-03T10:17:36.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.119+0000 7f07712a4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f076c135f20 0x7f076c138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:48766/0 (socket says 172.21.15.146:48766) 2023-10-03T10:17:36.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.119+0000 7f076bfff700 1 -- 172.21.15.146:0/2355770196 learned_addr learned my addr 172.21.15.146:0/2355770196 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:36.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.120+0000 7f076b7fe700 1 -- 172.21.15.146:0/2355770196 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617866085 0 0) 0x7f076c09aaa0 con 0x7f076c09d860 2023-10-03T10:17:36.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.120+0000 7f076bfff700 1 -- 172.21.15.146:0/2355770196 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f076c135f20 msgr2=0x7f076c138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.120+0000 7f076bfff700 1 --2- 172.21.15.146:0/2355770196 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f076c135f20 0x7f076c138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.120+0000 7f076bfff700 1 -- 172.21.15.146:0/2355770196 >> v1:172.21.15.146:6789/0 conn(0x7f076c09d860 legacy=0x7f076c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.120+0000 7f076bfff700 1 -- 172.21.15.146:0/2355770196 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c09b360 con 0x7f076c09e340 2023-10-03T10:17:36.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.120+0000 7f07712a4700 1 --2- 172.21.15.146:0/2355770196 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f076c135f20 0x7f076c138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.120+0000 7f076bfff700 1 --2- 172.21.15.146:0/2355770196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f076c09e340 0x7f076c1359e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0758009920 tx=0x7f0758009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7cc37d601a0730 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.120+0000 7f076b7fe700 1 -- 172.21.15.146:0/2355770196 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758011830 con 0x7f076c09e340 2023-10-03T10:17:36.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.120+0000 7f076b7fe700 1 -- 172.21.15.146:0/2355770196 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0758011990 con 0x7f076c09e340 2023-10-03T10:17:36.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.120+0000 7f076b7fe700 1 -- 172.21.15.146:0/2355770196 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758011d20 con 0x7f076c09e340 2023-10-03T10:17:36.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.121+0000 7f0772d07700 1 -- 172.21.15.146:0/2355770196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f076c09e340 msgr2=0x7f076c1359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.121+0000 7f0772d07700 1 --2- 172.21.15.146:0/2355770196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f076c09e340 0x7f076c1359e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0758009920 tx=0x7f0758009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:36.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.121+0000 7f0772d07700 1 -- 172.21.15.146:0/2355770196 shutdown_connections 2023-10-03T10:17:36.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.121+0000 7f0772d07700 1 --2- 172.21.15.146:0/2355770196 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f076c135f20 0x7f076c138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.121+0000 7f0772d07700 1 --2- 172.21.15.146:0/2355770196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f076c09e340 0x7f076c1359e0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.121+0000 7f0772d07700 1 -- 172.21.15.146:0/2355770196 >> 172.21.15.146:0/2355770196 conn(0x7f076c099c40 msgr2=0x7f076c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.121+0000 7f0772d07700 1 -- 172.21.15.146:0/2355770196 shutdown_connections 2023-10-03T10:17:36.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.121+0000 7f0772d07700 1 -- 172.21.15.146:0/2355770196 wait complete. 2023-10-03T10:17:36.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.122+0000 7f0772d07700 1 Processor -- start 2023-10-03T10:17:36.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.122+0000 7f0772d07700 1 -- start start 2023-10-03T10:17:36.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.122+0000 7f0772d07700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f076c09d860 0x7f076c11b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.122+0000 7f0772d07700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f076c09e340 0x7f076c11ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.122+0000 7f0772d07700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f076c135f20 0x7f076c11bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.122+0000 7f0772d07700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c11da50 con 0x7f076c09e340 2023-10-03T10:17:36.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.122+0000 7f0772d07700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076c11fa30 con 0x7f076c135f20 2023-10-03T10:17:36.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.122+0000 7f0772d07700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f076c11ed90 con 0x7f076c09d860 2023-10-03T10:17:36.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.122+0000 7f076bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f076c09e340 0x7f076c11ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.122+0000 7f076bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f076c09e340 0x7f076c11ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33132/0 (socket says 172.21.15.146:33132) 2023-10-03T10:17:36.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.122+0000 7f076bfff700 1 -- 172.21.15.146:0/1453415480 learned_addr learned my addr 172.21.15.146:0/1453415480 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:36.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.122+0000 7f07712a4700 1 --2- 172.21.15.146:0/1453415480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f076c135f20 0x7f076c11bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.123+0000 7f0770aa3700 1 --2- 172.21.15.146:0/1453415480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f076c09d860 0x7f076c11b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.123+0000 7f076bfff700 1 -- 172.21.15.146:0/1453415480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f076c09d860 msgr2=0x7f076c11b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.123+0000 7f076bfff700 1 --2- 172.21.15.146:0/1453415480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f076c09d860 0x7f076c11b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.123+0000 7f076bfff700 1 -- 172.21.15.146:0/1453415480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f076c135f20 msgr2=0x7f076c11bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.123+0000 7f076bfff700 1 --2- 172.21.15.146:0/1453415480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f076c135f20 0x7f076c11bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.123+0000 7f076bfff700 1 -- 172.21.15.146:0/1453415480 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0764009a70 con 0x7f076c09e340 2023-10-03T10:17:36.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.123+0000 7f07712a4700 1 --2- 172.21.15.146:0/1453415480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f076c135f20 0x7f076c11bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.123+0000 7f0770aa3700 1 --2- 172.21.15.146:0/1453415480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f076c09d860 0x7f076c11b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.123+0000 7f076bfff700 1 --2- 172.21.15.146:0/1453415480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f076c09e340 0x7f076c11ba90 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f0758011e30 tx=0x7f0758004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.123+0000 7f07697fa700 1 -- 172.21.15.146:0/1453415480 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758004450 con 0x7f076c09e340 2023-10-03T10:17:36.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.123+0000 7f07697fa700 1 -- 172.21.15.146:0/1453415480 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07580036a0 con 0x7f076c09e340 2023-10-03T10:17:36.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.123+0000 7f0772d07700 1 -- 172.21.15.146:0/1453415480 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0758009550 con 0x7f076c09e340 2023-10-03T10:17:36.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.123+0000 7f07697fa700 1 -- 172.21.15.146:0/1453415480 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07580045b0 con 0x7f076c09e340 2023-10-03T10:17:36.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.123+0000 7f0772d07700 1 -- 172.21.15.146:0/1453415480 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076c09c8b0 con 0x7f076c09e340 2023-10-03T10:17:36.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.124+0000 7f07697fa700 1 -- 172.21.15.146:0/1453415480 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0758021020 con 0x7f076c09e340 2023-10-03T10:17:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.124+0000 7f07697fa700 1 -- 172.21.15.146:0/1453415480 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0758040860 con 0x7f076c09e340 2023-10-03T10:17:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.125+0000 7f0772d07700 1 -- 172.21.15.146:0/1453415480 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076c04f2a0 con 0x7f076c09e340 2023-10-03T10:17:36.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.129+0000 7f07697fa700 1 -- 172.21.15.146:0/1453415480 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07580199a0 con 0x7f076c09e340 2023-10-03T10:17:36.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.164+0000 7f81f21ad700 1 -- 172.21.15.146:0/3104748221 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f81ec11fb60 con 0x7f81ec133900 2023-10-03T10:17:36.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.164+0000 7f81d3fff700 1 -- 172.21.15.146:0/3104748221 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f81ec11fb60 con 0x7f81ec133900 2023-10-03T10:17:36.165 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:36.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.167+0000 7f81f21ad700 1 -- 172.21.15.146:0/3104748221 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ec133900 msgr2=0x7f81ec11cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.167+0000 7f81f21ad700 1 --2- 172.21.15.146:0/3104748221 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ec133900 0x7f81ec11cbc0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f81e000ebe0 tx=0x7f81e000eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.168+0000 7f81f21ad700 1 -- 172.21.15.146:0/3104748221 shutdown_connections 2023-10-03T10:17:36.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.168+0000 7f81f21ad700 1 --2- 172.21.15.146:0/3104748221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81ec134210 0x7f81ec11d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.168+0000 7f81f21ad700 1 --2- 172.21.15.146:0/3104748221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81ec0a0ee0 0x7f81ec11c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.168+0000 7f81f21ad700 1 --2- 172.21.15.146:0/3104748221 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81ec133900 0x7f81ec11cbc0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.168+0000 7f81f21ad700 1 -- 172.21.15.146:0/3104748221 >> 172.21.15.146:0/3104748221 conn(0x7f81ec0a2980 msgr2=0x7f81ec1bae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.168+0000 7f81f21ad700 1 -- 172.21.15.146:0/3104748221 shutdown_connections 2023-10-03T10:17:36.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.168+0000 7f81f21ad700 1 -- 172.21.15.146:0/3104748221 wait complete. 2023-10-03T10:17:36.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:36.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.255+0000 7fa3eb044700 1 -- 172.21.15.146:0/2265479532 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa3e411e940 con 0x7fa3e4066410 2023-10-03T10:17:36.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.256+0000 7fa3e17fa700 1 -- 172.21.15.146:0/2265479532 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa3d8022760 con 0x7fa3e4066410 2023-10-03T10:17:36.257 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:36.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.258+0000 7fa3eb044700 1 -- 172.21.15.146:0/2265479532 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e4066410 msgr2=0x7fa3e411b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.258+0000 7fa3eb044700 1 --2- 172.21.15.146:0/2265479532 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e4066410 0x7fa3e411b690 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800ebe0 tx=0x7fa3d800eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.258+0000 7fa3eb044700 1 -- 172.21.15.146:0/2265479532 shutdown_connections 2023-10-03T10:17:36.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.258+0000 7fa3eb044700 1 --2- 172.21.15.146:0/2265479532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3e41314b0 0x7fa3e411c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.258+0000 7fa3eb044700 1 --2- 172.21.15.146:0/2265479532 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3e4066410 0x7fa3e411b690 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.258+0000 7fa3eb044700 1 --2- 172.21.15.146:0/2265479532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3e409bc70 0x7fa3e411bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.258+0000 7fa3eb044700 1 -- 172.21.15.146:0/2265479532 >> 172.21.15.146:0/2265479532 conn(0x7fa3e40a2980 msgr2=0x7fa3e409fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.258+0000 7fa3eb044700 1 -- 172.21.15.146:0/2265479532 shutdown_connections 2023-10-03T10:17:36.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.258+0000 7fa3eb044700 1 -- 172.21.15.146:0/2265479532 wait complete. 2023-10-03T10:17:36.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:36.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.321+0000 7f0772d07700 1 -- 172.21.15.146:0/1453415480 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f076c06c3b0 con 0x7f076c09e340 2023-10-03T10:17:36.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.322+0000 7f07697fa700 1 -- 172.21.15.146:0/1453415480 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0758029030 con 0x7f076c09e340 2023-10-03T10:17:36.323 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.324+0000 7f0772d07700 1 -- 172.21.15.146:0/1453415480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f076c09e340 msgr2=0x7f076c11ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.324+0000 7f0772d07700 1 --2- 172.21.15.146:0/1453415480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f076c09e340 0x7f076c11ba90 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f0758011e30 tx=0x7f0758004750 comp rx=0 tx=0).stop 2023-10-03T10:17:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.324+0000 7f0772d07700 1 -- 172.21.15.146:0/1453415480 shutdown_connections 2023-10-03T10:17:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.324+0000 7f0772d07700 1 --2- 172.21.15.146:0/1453415480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f076c135f20 0x7f076c11bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.324+0000 7f0772d07700 1 --2- 172.21.15.146:0/1453415480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f076c09d860 0x7f076c11b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.324+0000 7f0772d07700 1 --2- 172.21.15.146:0/1453415480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f076c09e340 0x7f076c11ba90 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.324+0000 7f0772d07700 1 -- 172.21.15.146:0/1453415480 >> 172.21.15.146:0/1453415480 conn(0x7f076c099c40 msgr2=0x7f076c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.324+0000 7f0772d07700 1 -- 172.21.15.146:0/1453415480 shutdown_connections 2023-10-03T10:17:36.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:36.324+0000 7f0772d07700 1 -- 172.21.15.146:0/1453415480 wait complete. 2023-10-03T10:17:36.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:37.033 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.170+0000 7fc637ab0700 1 Processor -- start 2023-10-03T10:17:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.170+0000 7fc637ab0700 1 -- start start 2023-10-03T10:17:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.170+0000 7fc637ab0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc63009f350 0x7fc630136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.170+0000 7fc637ab0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6301371c0 0x7fc6301395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.170+0000 7fc637ab0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63009c970 con 0x7fc63009e870 2023-10-03T10:17:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.170+0000 7fc637ab0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6300a0920 con 0x7fc63009f350 2023-10-03T10:17:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.170+0000 7fc637ab0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63009f9c0 con 0x7fc6301371c0 2023-10-03T10:17:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.170+0000 7fc63604d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6301371c0 0x7fc6301395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.170+0000 7fc63584c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc63009e870 0x7fc63009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44996/0 (socket says 172.21.15.146:44996) 2023-10-03T10:17:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.170+0000 7fc63584c700 1 -- 172.21.15.146:0/873929773 learned_addr learned my addr 172.21.15.146:0/873929773 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.170+0000 7fc63504b700 1 --2- 172.21.15.146:0/873929773 >> v2:172.21.15.146:3300/0 conn(0x7fc63009f350 0x7fc630136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.171+0000 7fc63604d700 1 -- 172.21.15.146:0/873929773 >> v2:172.21.15.146:3300/0 conn(0x7fc63009f350 msgr2=0x7fc630136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.171+0000 7fc63604d700 1 --2- 172.21.15.146:0/873929773 >> v2:172.21.15.146:3300/0 conn(0x7fc63009f350 0x7fc630136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.171+0000 7fc63604d700 1 -- 172.21.15.146:0/873929773 >> v1:172.21.15.146:6789/0 conn(0x7fc63009e870 legacy=0x7fc63009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.171+0000 7fc63604d700 1 -- 172.21.15.146:0/873929773 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63009bab0 con 0x7fc6301371c0 2023-10-03T10:17:37.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.171+0000 7fc63504b700 1 --2- 172.21.15.146:0/873929773 >> v2:172.21.15.146:3300/0 conn(0x7fc63009f350 0x7fc630136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:37.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.171+0000 7fc63604d700 1 --2- 172.21.15.146:0/873929773 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6301371c0 0x7fc6301395a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc628009d90 tx=0x7fc62800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d2aff9b0f3bec07 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.171+0000 7fc63484a700 1 -- 172.21.15.146:0/873929773 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62800e070 con 0x7fc6301371c0 2023-10-03T10:17:37.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.171+0000 7fc63484a700 1 -- 172.21.15.146:0/873929773 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62800bb20 con 0x7fc6301371c0 2023-10-03T10:17:37.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.171+0000 7fc63484a700 1 -- 172.21.15.146:0/873929773 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc628012430 con 0x7fc6301371c0 2023-10-03T10:17:37.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.172+0000 7fc637ab0700 1 -- 172.21.15.146:0/873929773 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6301371c0 msgr2=0x7fc6301395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.172+0000 7fc637ab0700 1 --2- 172.21.15.146:0/873929773 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6301371c0 0x7fc6301395a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc628009d90 tx=0x7fc62800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:37.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.172+0000 7fc637ab0700 1 -- 172.21.15.146:0/873929773 shutdown_connections 2023-10-03T10:17:37.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.172+0000 7fc637ab0700 1 --2- 172.21.15.146:0/873929773 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6301371c0 0x7fc6301395a0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.172+0000 7fc637ab0700 1 --2- 172.21.15.146:0/873929773 >> v2:172.21.15.146:3300/0 conn(0x7fc63009f350 0x7fc630136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.172+0000 7fc637ab0700 1 -- 172.21.15.146:0/873929773 >> 172.21.15.146:0/873929773 conn(0x7fc6300a4430 msgr2=0x7fc6300a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.172+0000 7fc637ab0700 1 -- 172.21.15.146:0/873929773 shutdown_connections 2023-10-03T10:17:37.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.172+0000 7fc637ab0700 1 -- 172.21.15.146:0/873929773 wait complete. 2023-10-03T10:17:37.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.173+0000 7fc637ab0700 1 Processor -- start 2023-10-03T10:17:37.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.173+0000 7fc637ab0700 1 -- start start 2023-10-03T10:17:37.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc637ab0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc63009e870 0x7fc63011e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc637ab0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc63009f350 0x7fc63011ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc637ab0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc6301371c0 0x7fc63011f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc637ab0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc630133f80 con 0x7fc63009e870 2023-10-03T10:17:37.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc637ab0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc630122190 con 0x7fc63009f350 2023-10-03T10:17:37.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc637ab0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc63009dba0 con 0x7fc6301371c0 2023-10-03T10:17:37.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc63584c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc63009e870 0x7fc63011e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc63504b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc63009f350 0x7fc63011ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc63584c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc63009e870 0x7fc63011e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33160/0 (socket says 172.21.15.146:33160) 2023-10-03T10:17:37.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc63584c700 1 -- 172.21.15.146:0/364783004 learned_addr learned my addr 172.21.15.146:0/364783004 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:37.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc63604d700 1 --2- 172.21.15.146:0/364783004 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc6301371c0 0x7fc63011f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc63584c700 1 -- 172.21.15.146:0/364783004 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc6301371c0 msgr2=0x7fc63011f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc63584c700 1 --2- 172.21.15.146:0/364783004 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc6301371c0 0x7fc63011f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc63584c700 1 -- 172.21.15.146:0/364783004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc63009f350 msgr2=0x7fc63011ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc63584c700 1 --2- 172.21.15.146:0/364783004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc63009f350 0x7fc63011ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc63584c700 1 -- 172.21.15.146:0/364783004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6200094a0 con 0x7fc63009e870 2023-10-03T10:17:37.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc63504b700 1 --2- 172.21.15.146:0/364783004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc63009f350 0x7fc63011ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:37.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc63584c700 1 --2- 172.21.15.146:0/364783004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc63009e870 0x7fc63011e670 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fc62c00c550 tx=0x7fc62c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc6267fc700 1 -- 172.21.15.146:0/364783004 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c005d70 con 0x7fc63009e870 2023-10-03T10:17:37.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc6267fc700 1 -- 172.21.15.146:0/364783004 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c0070d0 con 0x7fc63009e870 2023-10-03T10:17:37.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc637ab0700 1 -- 172.21.15.146:0/364783004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc628009a70 con 0x7fc63009e870 2023-10-03T10:17:37.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc6267fc700 1 -- 172.21.15.146:0/364783004 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c007440 con 0x7fc63009e870 2023-10-03T10:17:37.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.174+0000 7fc637ab0700 1 -- 172.21.15.146:0/364783004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc630121bf0 con 0x7fc63009e870 2023-10-03T10:17:37.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.175+0000 7fc6267fc700 1 -- 172.21.15.146:0/364783004 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc62c0075a0 con 0x7fc63009e870 2023-10-03T10:17:37.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.175+0000 7fc637ab0700 1 -- 172.21.15.146:0/364783004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63004f2a0 con 0x7fc63009e870 2023-10-03T10:17:37.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.175+0000 7fc6267fc700 1 -- 172.21.15.146:0/364783004 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc62c03ea70 con 0x7fc63009e870 2023-10-03T10:17:37.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.180+0000 7fc6267fc700 1 -- 172.21.15.146:0/364783004 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc62c040e60 con 0x7fc63009e870 2023-10-03T10:17:37.186 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:37.271 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:37.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.311+0000 7f818f9fe700 1 Processor -- start 2023-10-03T10:17:37.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.311+0000 7f818f9fe700 1 -- start start 2023-10-03T10:17:37.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.312+0000 7f818f9fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8188133ad0 0x7f8188133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.312+0000 7f818f9fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8188130bc0 0x7f818813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.312+0000 7f818f9fe700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818806b2d0 con 0x7f81881300a0 2023-10-03T10:17:37.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.312+0000 7f818f9fe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8188133610 con 0x7f8188133ad0 2023-10-03T10:17:37.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.312+0000 7f818f9fe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f818809a500 con 0x7f8188130bc0 2023-10-03T10:17:37.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.312+0000 7f818df9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8188130bc0 0x7f818813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.312+0000 7f818cf99700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f81881300a0 0x7f81881304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45004/0 (socket says 172.21.15.146:45004) 2023-10-03T10:17:37.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.312+0000 7f818cf99700 1 -- 172.21.15.146:0/573889595 learned_addr learned my addr 172.21.15.146:0/573889595 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:37.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.312+0000 7f818d79a700 1 --2- 172.21.15.146:0/573889595 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8188133ad0 0x7f8188133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.312+0000 7f817ffff700 1 -- 172.21.15.146:0/573889595 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714766932 0 0) 0x7f818806b2d0 con 0x7f81881300a0 2023-10-03T10:17:37.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.312+0000 7f817ffff700 1 -- 172.21.15.146:0/573889595 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81740035b0 con 0x7f81881300a0 2023-10-03T10:17:37.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.312+0000 7f818df9b700 1 -- 172.21.15.146:0/573889595 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8188133ad0 msgr2=0x7f8188133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:37.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.312+0000 7f818df9b700 1 --2- 172.21.15.146:0/573889595 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8188133ad0 0x7f8188133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.312+0000 7f818df9b700 1 -- 172.21.15.146:0/573889595 >> v1:172.21.15.146:6789/0 conn(0x7f81881300a0 legacy=0x7f81881304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.312+0000 7f818df9b700 1 -- 172.21.15.146:0/573889595 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81881338b0 con 0x7f8188130bc0 2023-10-03T10:17:37.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.312+0000 7f818d79a700 1 --2- 172.21.15.146:0/573889595 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8188133ad0 0x7f8188133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:37.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.313+0000 7f818df9b700 1 --2- 172.21.15.146:0/573889595 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8188130bc0 0x7f818813b990 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8180009dc0 tx=0x7f818000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=424b57d837bc3709 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.313+0000 7f817ffff700 1 -- 172.21.15.146:0/573889595 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818000e070 con 0x7f8188130bc0 2023-10-03T10:17:37.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.313+0000 7f817ffff700 1 -- 172.21.15.146:0/573889595 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818000bb20 con 0x7f8188130bc0 2023-10-03T10:17:37.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.313+0000 7f817ffff700 1 -- 172.21.15.146:0/573889595 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8180012430 con 0x7f8188130bc0 2023-10-03T10:17:37.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.313+0000 7f818f9fe700 1 -- 172.21.15.146:0/573889595 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8188130bc0 msgr2=0x7f818813b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.313+0000 7f818f9fe700 1 --2- 172.21.15.146:0/573889595 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8188130bc0 0x7f818813b990 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8180009dc0 tx=0x7f818000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:37.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.314+0000 7f818f9fe700 1 -- 172.21.15.146:0/573889595 shutdown_connections 2023-10-03T10:17:37.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.314+0000 7f818f9fe700 1 --2- 172.21.15.146:0/573889595 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8188130bc0 0x7f818813b990 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.314+0000 7f818f9fe700 1 --2- 172.21.15.146:0/573889595 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8188133ad0 0x7f8188133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.314+0000 7f818f9fe700 1 -- 172.21.15.146:0/573889595 >> 172.21.15.146:0/573889595 conn(0x7f8188099c40 msgr2=0x7f81880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.314+0000 7f818f9fe700 1 -- 172.21.15.146:0/573889595 shutdown_connections 2023-10-03T10:17:37.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.314+0000 7f818f9fe700 1 -- 172.21.15.146:0/573889595 wait complete. 2023-10-03T10:17:37.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.315+0000 7f818f9fe700 1 Processor -- start 2023-10-03T10:17:37.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.315+0000 7f818f9fe700 1 -- start start 2023-10-03T10:17:37.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.315+0000 7f818f9fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81881300a0 0x7f818811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.315+0000 7f818f9fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8188130bc0 0x7f818811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.315+0000 7f818f9fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8188133ad0 0x7f818811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.315+0000 7f818f9fe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8188072450 con 0x7f8188133ad0 2023-10-03T10:17:37.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.315+0000 7f818f9fe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818811fc80 con 0x7f8188130bc0 2023-10-03T10:17:37.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.315+0000 7f818f9fe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f818812dd00 con 0x7f81881300a0 2023-10-03T10:17:37.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.315+0000 7f818d79a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81881300a0 0x7f818811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.315+0000 7f818d79a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81881300a0 0x7f818811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:48798/0 (socket says 172.21.15.146:48798) 2023-10-03T10:17:37.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.315+0000 7f818d79a700 1 -- 172.21.15.146:0/2196217766 learned_addr learned my addr 172.21.15.146:0/2196217766 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:37.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.315+0000 7f818cf99700 1 --2- 172.21.15.146:0/2196217766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8188130bc0 0x7f818811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.315+0000 7f818df9b700 1 --2- 172.21.15.146:0/2196217766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8188133ad0 0x7f818811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.315+0000 7f818cf99700 1 -- 172.21.15.146:0/2196217766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81881300a0 msgr2=0x7f818811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.315+0000 7f818cf99700 1 --2- 172.21.15.146:0/2196217766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81881300a0 0x7f818811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.315+0000 7f818cf99700 1 -- 172.21.15.146:0/2196217766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8188133ad0 msgr2=0x7f818811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.315+0000 7f818cf99700 1 --2- 172.21.15.146:0/2196217766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8188133ad0 0x7f818811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.315+0000 7f818cf99700 1 -- 172.21.15.146:0/2196217766 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81840094a0 con 0x7f8188130bc0 2023-10-03T10:17:37.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.316+0000 7f818d79a700 1 --2- 172.21.15.146:0/2196217766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81881300a0 0x7f818811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:37.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.316+0000 7f818cf99700 1 --2- 172.21.15.146:0/2196217766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8188130bc0 0x7f818811df80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f817800c400 tx=0x7f817800c710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.316+0000 7f817dffb700 1 -- 172.21.15.146:0/2196217766 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8178005d70 con 0x7f8188130bc0 2023-10-03T10:17:37.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.316+0000 7f817dffb700 1 -- 172.21.15.146:0/2196217766 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817800ce90 con 0x7f8188130bc0 2023-10-03T10:17:37.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.316+0000 7f817dffb700 1 -- 172.21.15.146:0/2196217766 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81780072f0 con 0x7f8188130bc0 2023-10-03T10:17:37.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.316+0000 7f818f9fe700 1 -- 172.21.15.146:0/2196217766 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8180009a70 con 0x7f8188130bc0 2023-10-03T10:17:37.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.316+0000 7f818f9fe700 1 -- 172.21.15.146:0/2196217766 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818811f970 con 0x7f8188130bc0 2023-10-03T10:17:37.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.317+0000 7f817dffb700 1 -- 172.21.15.146:0/2196217766 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8178007450 con 0x7f8188130bc0 2023-10-03T10:17:37.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.317+0000 7f817dffb700 1 -- 172.21.15.146:0/2196217766 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f817803ea90 con 0x7f8188130bc0 2023-10-03T10:17:37.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.317+0000 7f818f9fe700 1 -- 172.21.15.146:0/2196217766 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f818804f2a0 con 0x7f8188130bc0 2023-10-03T10:17:37.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.322+0000 7f817dffb700 1 -- 172.21.15.146:0/2196217766 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8178017020 con 0x7f8188130bc0 2023-10-03T10:17:37.337 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:37.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.392+0000 7fc637ab0700 1 -- 172.21.15.146:0/364783004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc630120a70 con 0x7fc63009e870 2023-10-03T10:17:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.392+0000 7fc6267fc700 1 -- 172.21.15.146:0/364783004 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc62c017070 con 0x7fc63009e870 2023-10-03T10:17:37.393 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:37.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.396+0000 7fc637ab0700 1 -- 172.21.15.146:0/364783004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc63009e870 msgr2=0x7fc63011e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.396+0000 7fc637ab0700 1 --2- 172.21.15.146:0/364783004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc63009e870 0x7fc63011e670 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fc62c00c550 tx=0x7fc62c00c860 comp rx=0 tx=0).stop 2023-10-03T10:17:37.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.396+0000 7fc637ab0700 1 -- 172.21.15.146:0/364783004 shutdown_connections 2023-10-03T10:17:37.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.396+0000 7fc637ab0700 1 --2- 172.21.15.146:0/364783004 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc6301371c0 0x7fc63011f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.396+0000 7fc637ab0700 1 --2- 172.21.15.146:0/364783004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc63009e870 0x7fc63011e670 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.396+0000 7fc637ab0700 1 --2- 172.21.15.146:0/364783004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc63009f350 0x7fc63011ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.396+0000 7fc637ab0700 1 -- 172.21.15.146:0/364783004 >> 172.21.15.146:0/364783004 conn(0x7fc6300a4430 msgr2=0x7fc630134960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.396+0000 7fc637ab0700 1 -- 172.21.15.146:0/364783004 shutdown_connections 2023-10-03T10:17:37.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.396+0000 7fc637ab0700 1 -- 172.21.15.146:0/364783004 wait complete. 2023-10-03T10:17:37.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.409+0000 7f3f9e745700 1 Processor -- start 2023-10-03T10:17:37.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.410+0000 7f3f9e745700 1 -- start start 2023-10-03T10:17:37.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:37.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.410+0000 7f3f9e745700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f98133b80 0x7f3f98133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.410+0000 7f3f9e745700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3f98099a60 0x7f3f980a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.410+0000 7f3f9e745700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f980a0e20 0x7f3f980a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.410+0000 7f3f9e745700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9809aa00 con 0x7f3f98099a60 2023-10-03T10:17:37.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.410+0000 7f3f9e745700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9809a080 con 0x7f3f980a0e20 2023-10-03T10:17:37.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.410+0000 7f3f9e745700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f98133750 con 0x7f3f98133b80 2023-10-03T10:17:37.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.410+0000 7f3f977fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3f98099a60 0x7f3f980a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.410+0000 7f3f977fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3f98099a60 0x7f3f980a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33176/0 (socket says 172.21.15.146:33176) 2023-10-03T10:17:37.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.410+0000 7f3f977fe700 1 -- 172.21.15.146:0/280997711 learned_addr learned my addr 172.21.15.146:0/280997711 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:37.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.410+0000 7f3f97fff700 1 --2- 172.21.15.146:0/280997711 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f98133b80 0x7f3f98133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.410+0000 7f3f9cce2700 1 --2- 172.21.15.146:0/280997711 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f980a0e20 0x7f3f980a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.411+0000 7f3f977fe700 1 -- 172.21.15.146:0/280997711 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f98133b80 msgr2=0x7f3f98133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:37.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.411+0000 7f3f977fe700 1 --2- 172.21.15.146:0/280997711 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f98133b80 0x7f3f98133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.411+0000 7f3f977fe700 1 -- 172.21.15.146:0/280997711 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f980a0e20 msgr2=0x7f3f980a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:37.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.411+0000 7f3f977fe700 1 --2- 172.21.15.146:0/280997711 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f980a0e20 0x7f3f980a12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.411+0000 7f3f977fe700 1 -- 172.21.15.146:0/280997711 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9809a760 con 0x7f3f98099a60 2023-10-03T10:17:37.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.411+0000 7f3f97fff700 1 --2- 172.21.15.146:0/280997711 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f98133b80 0x7f3f98133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:37.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.411+0000 7f3f977fe700 1 --2- 172.21.15.146:0/280997711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f98099a60 0x7f3f980a08e0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0098f0 tx=0x7f3f8c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a329d87d13e33fb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.411+0000 7f3f96ffd700 1 -- 172.21.15.146:0/280997711 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c011830 con 0x7f3f98099a60 2023-10-03T10:17:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.411+0000 7f3f96ffd700 1 -- 172.21.15.146:0/280997711 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c011990 con 0x7f3f98099a60 2023-10-03T10:17:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.411+0000 7f3f96ffd700 1 -- 172.21.15.146:0/280997711 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c011d20 con 0x7f3f98099a60 2023-10-03T10:17:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.412+0000 7f3f9e745700 1 -- 172.21.15.146:0/280997711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f98099a60 msgr2=0x7f3f980a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.412+0000 7f3f9e745700 1 --2- 172.21.15.146:0/280997711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f98099a60 0x7f3f980a08e0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0098f0 tx=0x7f3f8c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.412+0000 7f3f9e745700 1 -- 172.21.15.146:0/280997711 shutdown_connections 2023-10-03T10:17:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.412+0000 7f3f9e745700 1 --2- 172.21.15.146:0/280997711 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f980a0e20 0x7f3f980a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.412+0000 7f3f9e745700 1 --2- 172.21.15.146:0/280997711 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f98133b80 0x7f3f98133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.412+0000 7f3f9e745700 1 --2- 172.21.15.146:0/280997711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f98099a60 0x7f3f980a08e0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.412+0000 7f3f9e745700 1 -- 172.21.15.146:0/280997711 >> 172.21.15.146:0/280997711 conn(0x7f3f980a2980 msgr2=0x7f3f980a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.412+0000 7f3f9e745700 1 -- 172.21.15.146:0/280997711 shutdown_connections 2023-10-03T10:17:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.412+0000 7f3f9e745700 1 -- 172.21.15.146:0/280997711 wait complete. 2023-10-03T10:17:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.413+0000 7f3f9e745700 1 Processor -- start 2023-10-03T10:17:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.413+0000 7f3f9e745700 1 -- start start 2023-10-03T10:17:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.414+0000 7f3f9e745700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f98099a60 0x7f3f9811a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.414+0000 7f3f9e745700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f980a0e20 0x7f3f9811acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.414+0000 7f3f9e745700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f98133b80 0x7f3f9811b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.414+0000 7f3f9e745700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9811bc00 con 0x7f3f980a0e20 2023-10-03T10:17:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.414+0000 7f3f9e745700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9811c380 con 0x7f3f98099a60 2023-10-03T10:17:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.414+0000 7f3f9e745700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9811c9a0 con 0x7f3f98133b80 2023-10-03T10:17:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.414+0000 7f3f977fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f980a0e20 0x7f3f9811acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.414+0000 7f3f977fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f980a0e20 0x7f3f9811acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33184/0 (socket says 172.21.15.146:33184) 2023-10-03T10:17:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.414+0000 7f3f97fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f98099a60 0x7f3f9811a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.414+0000 7f3f977fe700 1 -- 172.21.15.146:0/3627971473 learned_addr learned my addr 172.21.15.146:0/3627971473 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.414+0000 7f3f9cce2700 1 --2- 172.21.15.146:0/3627971473 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f98133b80 0x7f3f9811b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.414+0000 7f3f977fe700 1 -- 172.21.15.146:0/3627971473 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f98133b80 msgr2=0x7f3f9811b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.414+0000 7f3f977fe700 1 --2- 172.21.15.146:0/3627971473 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f98133b80 0x7f3f9811b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.414+0000 7f3f977fe700 1 -- 172.21.15.146:0/3627971473 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f98099a60 msgr2=0x7f3f9811a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.414+0000 7f3f977fe700 1 --2- 172.21.15.146:0/3627971473 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f98099a60 0x7f3f9811a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.414+0000 7f3f977fe700 1 -- 172.21.15.146:0/3627971473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f88009430 con 0x7f3f980a0e20 2023-10-03T10:17:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.414+0000 7f3f97fff700 1 --2- 172.21.15.146:0/3627971473 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f98099a60 0x7f3f9811a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.415+0000 7f3f977fe700 1 --2- 172.21.15.146:0/3627971473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f980a0e20 0x7f3f9811acb0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c013000 tx=0x7f3f8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.415+0000 7f3f94ff9700 1 -- 172.21.15.146:0/3627971473 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c004240 con 0x7f3f980a0e20 2023-10-03T10:17:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.415+0000 7f3f94ff9700 1 -- 172.21.15.146:0/3627971473 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c01f070 con 0x7f3f980a0e20 2023-10-03T10:17:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.415+0000 7f3f9e745700 1 -- 172.21.15.146:0/3627971473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f8c009550 con 0x7f3f980a0e20 2023-10-03T10:17:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.415+0000 7f3f94ff9700 1 -- 172.21.15.146:0/3627971473 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c0045e0 con 0x7f3f980a0e20 2023-10-03T10:17:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.415+0000 7f3f9e745700 1 -- 172.21.15.146:0/3627971473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f98130a90 con 0x7f3f980a0e20 2023-10-03T10:17:37.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.416+0000 7f3f9e745700 1 -- 172.21.15.146:0/3627971473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9809e9b0 con 0x7f3f980a0e20 2023-10-03T10:17:37.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.416+0000 7f3f94ff9700 1 -- 172.21.15.146:0/3627971473 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f8c021030 con 0x7f3f980a0e20 2023-10-03T10:17:37.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.416+0000 7f3f94ff9700 1 -- 172.21.15.146:0/3627971473 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3f8c040a20 con 0x7f3f980a0e20 2023-10-03T10:17:37.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.425+0000 7f3f94ff9700 1 -- 172.21.15.146:0/3627971473 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f8c0197c0 con 0x7f3f980a0e20 2023-10-03T10:17:37.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.470+0000 7f1801a2f700 1 Processor -- start 2023-10-03T10:17:37.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.470+0000 7f1801a2f700 1 -- start start 2023-10-03T10:17:37.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.470+0000 7f1801a2f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f17fc09e340 0x7f17fc1359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.470+0000 7f1801a2f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f17fc135f20 0x7f17fc138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.470+0000 7f1801a2f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17fc09aaa0 con 0x7f17fc09d860 2023-10-03T10:17:37.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.470+0000 7f1801a2f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17fc09e730 con 0x7f17fc09e340 2023-10-03T10:17:37.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.470+0000 7f1801a2f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc09f870 con 0x7f17fc135f20 2023-10-03T10:17:37.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.471+0000 7f17fb7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f17fc135f20 0x7f17fc138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.471+0000 7f17faffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f17fc09d860 0x7f17fc09dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45016/0 (socket says 172.21.15.146:45016) 2023-10-03T10:17:37.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.471+0000 7f17faffd700 1 -- 172.21.15.146:0/1651823579 learned_addr learned my addr 172.21.15.146:0/1651823579 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:37.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.471+0000 7f17fa7fc700 1 --2- 172.21.15.146:0/1651823579 >> v2:172.21.15.146:3300/0 conn(0x7f17fc09e340 0x7f17fc1359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.471+0000 7f17fb7fe700 1 -- 172.21.15.146:0/1651823579 >> v2:172.21.15.146:3300/0 conn(0x7f17fc09e340 msgr2=0x7f17fc1359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:37.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.471+0000 7f17fb7fe700 1 --2- 172.21.15.146:0/1651823579 >> v2:172.21.15.146:3300/0 conn(0x7f17fc09e340 0x7f17fc1359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.471+0000 7f17fb7fe700 1 -- 172.21.15.146:0/1651823579 >> v1:172.21.15.146:6789/0 conn(0x7f17fc09d860 legacy=0x7f17fc09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.471+0000 7f17f9ffb700 1 -- 172.21.15.146:0/1651823579 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107815873 0 0) 0x7f17fc09aaa0 con 0x7f17fc09d860 2023-10-03T10:17:37.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.471+0000 7f17fb7fe700 1 -- 172.21.15.146:0/1651823579 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17fc09b360 con 0x7f17fc135f20 2023-10-03T10:17:37.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.471+0000 7f17fa7fc700 1 --2- 172.21.15.146:0/1651823579 >> v2:172.21.15.146:3300/0 conn(0x7f17fc09e340 0x7f17fc1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:37.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.471+0000 7f17fb7fe700 1 --2- 172.21.15.146:0/1651823579 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f17fc135f20 0x7f17fc138300 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009dc0 tx=0x7f17f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0641e77388b7c1d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.471+0000 7f17f9ffb700 1 -- 172.21.15.146:0/1651823579 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f400e070 con 0x7f17fc135f20 2023-10-03T10:17:37.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.471+0000 7f17f9ffb700 1 -- 172.21.15.146:0/1651823579 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f400bae0 con 0x7f17fc135f20 2023-10-03T10:17:37.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.471+0000 7f17f9ffb700 1 -- 172.21.15.146:0/1651823579 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f400be90 con 0x7f17fc135f20 2023-10-03T10:17:37.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.472+0000 7f1801a2f700 1 -- 172.21.15.146:0/1651823579 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f17fc135f20 msgr2=0x7f17fc138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.472+0000 7f1801a2f700 1 --2- 172.21.15.146:0/1651823579 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f17fc135f20 0x7f17fc138300 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009dc0 tx=0x7f17f400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:37.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.472+0000 7f1801a2f700 1 -- 172.21.15.146:0/1651823579 shutdown_connections 2023-10-03T10:17:37.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.472+0000 7f1801a2f700 1 --2- 172.21.15.146:0/1651823579 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f17fc135f20 0x7f17fc138300 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.472+0000 7f1801a2f700 1 --2- 172.21.15.146:0/1651823579 >> v2:172.21.15.146:3300/0 conn(0x7f17fc09e340 0x7f17fc1359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.472+0000 7f1801a2f700 1 -- 172.21.15.146:0/1651823579 >> 172.21.15.146:0/1651823579 conn(0x7f17fc099c40 msgr2=0x7f17fc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.472+0000 7f1801a2f700 1 -- 172.21.15.146:0/1651823579 shutdown_connections 2023-10-03T10:17:37.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.472+0000 7f1801a2f700 1 -- 172.21.15.146:0/1651823579 wait complete. 2023-10-03T10:17:37.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.473+0000 7f1801a2f700 1 Processor -- start 2023-10-03T10:17:37.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.473+0000 7f1801a2f700 1 -- start start 2023-10-03T10:17:37.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.474+0000 7f1801a2f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17fc09d860 0x7f17fc11e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.474+0000 7f1801a2f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f17fc09e340 0x7f17fc11e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.474+0000 7f1801a2f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17fc135f20 0x7f17fc11ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.474+0000 7f1801a2f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc124ca0 con 0x7f17fc135f20 2023-10-03T10:17:37.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.474+0000 7f1801a2f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc124e80 con 0x7f17fc09d860 2023-10-03T10:17:37.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.474+0000 7f1801a2f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc0a07d0 con 0x7f17fc09e340 2023-10-03T10:17:37.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.474+0000 7f17faffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17fc09d860 0x7f17fc11e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.474+0000 7f17faffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17fc09d860 0x7f17fc11e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56648/0 (socket says 172.21.15.146:56648) 2023-10-03T10:17:37.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.474+0000 7f17faffd700 1 -- 172.21.15.146:0/2760736459 learned_addr learned my addr 172.21.15.146:0/2760736459 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:37.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.474+0000 7f17fa7fc700 1 --2- 172.21.15.146:0/2760736459 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f17fc09e340 0x7f17fc11e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.474+0000 7f17fb7fe700 1 --2- 172.21.15.146:0/2760736459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17fc135f20 0x7f17fc11ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.474+0000 7f17faffd700 1 -- 172.21.15.146:0/2760736459 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f17fc09e340 msgr2=0x7f17fc11e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.474+0000 7f17faffd700 1 --2- 172.21.15.146:0/2760736459 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f17fc09e340 0x7f17fc11e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.474+0000 7f17faffd700 1 -- 172.21.15.146:0/2760736459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17fc135f20 msgr2=0x7f17fc11ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.474+0000 7f17faffd700 1 --2- 172.21.15.146:0/2760736459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17fc135f20 0x7f17fc11ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.474+0000 7f17faffd700 1 -- 172.21.15.146:0/2760736459 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f00094a0 con 0x7f17fc09d860 2023-10-03T10:17:37.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.474+0000 7f17faffd700 1 --2- 172.21.15.146:0/2760736459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17fc09d860 0x7f17fc11e3a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00c550 tx=0x7f17ec00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.475+0000 7f17e3fff700 1 -- 172.21.15.146:0/2760736459 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec004c80 con 0x7f17fc09d860 2023-10-03T10:17:37.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.475+0000 7f17e3fff700 1 -- 172.21.15.146:0/2760736459 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ec004de0 con 0x7f17fc09d860 2023-10-03T10:17:37.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.475+0000 7f1801a2f700 1 -- 172.21.15.146:0/2760736459 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f4009a70 con 0x7f17fc09d860 2023-10-03T10:17:37.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.475+0000 7f17e3fff700 1 -- 172.21.15.146:0/2760736459 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec007310 con 0x7f17fc09d860 2023-10-03T10:17:37.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.475+0000 7f1801a2f700 1 -- 172.21.15.146:0/2760736459 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17fc09c900 con 0x7f17fc09d860 2023-10-03T10:17:37.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.476+0000 7f1801a2f700 1 -- 172.21.15.146:0/2760736459 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17fc06ab00 con 0x7f17fc09d860 2023-10-03T10:17:37.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.476+0000 7f17e3fff700 1 -- 172.21.15.146:0/2760736459 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f17ec007470 con 0x7f17fc09d860 2023-10-03T10:17:37.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.476+0000 7f17e3fff700 1 -- 172.21.15.146:0/2760736459 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f17ec03f940 con 0x7f17fc09d860 2023-10-03T10:17:37.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.481+0000 7f17e3fff700 1 -- 172.21.15.146:0/2760736459 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17ec0133c0 con 0x7f17fc09d860 2023-10-03T10:17:37.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.524+0000 7f818f9fe700 1 -- 172.21.15.146:0/2196217766 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f818812f540 con 0x7f8188130bc0 2023-10-03T10:17:37.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.525+0000 7f817dffb700 1 -- 172.21.15.146:0/2196217766 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8178019b40 con 0x7f8188130bc0 2023-10-03T10:17:37.525 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:37.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.527+0000 7f818f9fe700 1 -- 172.21.15.146:0/2196217766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8188130bc0 msgr2=0x7f818811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.527+0000 7f818f9fe700 1 --2- 172.21.15.146:0/2196217766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8188130bc0 0x7f818811df80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f817800c400 tx=0x7f817800c710 comp rx=0 tx=0).stop 2023-10-03T10:17:37.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.527+0000 7f818f9fe700 1 -- 172.21.15.146:0/2196217766 shutdown_connections 2023-10-03T10:17:37.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.527+0000 7f818f9fe700 1 --2- 172.21.15.146:0/2196217766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8188133ad0 0x7f818811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.527+0000 7f818f9fe700 1 --2- 172.21.15.146:0/2196217766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81881300a0 0x7f818811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.527+0000 7f818f9fe700 1 --2- 172.21.15.146:0/2196217766 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8188130bc0 0x7f818811df80 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.527+0000 7f818f9fe700 1 -- 172.21.15.146:0/2196217766 >> 172.21.15.146:0/2196217766 conn(0x7f8188099c40 msgr2=0x7f818812e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.527+0000 7f818f9fe700 1 -- 172.21.15.146:0/2196217766 shutdown_connections 2023-10-03T10:17:37.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.527+0000 7f818f9fe700 1 -- 172.21.15.146:0/2196217766 wait complete. 2023-10-03T10:17:37.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:37.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.619+0000 7f3f9e745700 1 -- 172.21.15.146:0/3627971473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3f9809a2c0 con 0x7f3f980a0e20 2023-10-03T10:17:37.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.620+0000 7f3f94ff9700 1 -- 172.21.15.146:0/3627971473 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f8c015030 con 0x7f3f980a0e20 2023-10-03T10:17:37.621 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:37.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.622+0000 7f3f9e745700 1 -- 172.21.15.146:0/3627971473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f980a0e20 msgr2=0x7f3f9811acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.622+0000 7f3f9e745700 1 --2- 172.21.15.146:0/3627971473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f980a0e20 0x7f3f9811acb0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c013000 tx=0x7f3f8c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:37.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.622+0000 7f3f9e745700 1 -- 172.21.15.146:0/3627971473 shutdown_connections 2023-10-03T10:17:37.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.622+0000 7f3f9e745700 1 --2- 172.21.15.146:0/3627971473 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f98133b80 0x7f3f9811b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.622+0000 7f3f9e745700 1 --2- 172.21.15.146:0/3627971473 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f98099a60 0x7f3f9811a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.622+0000 7f3f9e745700 1 --2- 172.21.15.146:0/3627971473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f980a0e20 0x7f3f9811acb0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.622+0000 7f3f9e745700 1 -- 172.21.15.146:0/3627971473 >> 172.21.15.146:0/3627971473 conn(0x7f3f980a2980 msgr2=0x7f3f9812f740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.622+0000 7f3f9e745700 1 -- 172.21.15.146:0/3627971473 shutdown_connections 2023-10-03T10:17:37.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.622+0000 7f3f9e745700 1 -- 172.21.15.146:0/3627971473 wait complete. 2023-10-03T10:17:37.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:37.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.672+0000 7f1801a2f700 1 -- 172.21.15.146:0/2760736459 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f17fc04f2a0 con 0x7f17fc09d860 2023-10-03T10:17:37.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.672+0000 7f17e3fff700 1 -- 172.21.15.146:0/2760736459 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f17ec011360 con 0x7f17fc09d860 2023-10-03T10:17:37.673 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:37.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.674+0000 7f1801a2f700 1 -- 172.21.15.146:0/2760736459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17fc09d860 msgr2=0x7f17fc11e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.674+0000 7f1801a2f700 1 --2- 172.21.15.146:0/2760736459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17fc09d860 0x7f17fc11e3a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00c550 tx=0x7f17ec00c860 comp rx=0 tx=0).stop 2023-10-03T10:17:37.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.674+0000 7f1801a2f700 1 -- 172.21.15.146:0/2760736459 shutdown_connections 2023-10-03T10:17:37.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.674+0000 7f1801a2f700 1 --2- 172.21.15.146:0/2760736459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17fc135f20 0x7f17fc11ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.674+0000 7f1801a2f700 1 --2- 172.21.15.146:0/2760736459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17fc09d860 0x7f17fc11e3a0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.674+0000 7f1801a2f700 1 --2- 172.21.15.146:0/2760736459 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f17fc09e340 0x7f17fc11e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.674+0000 7f1801a2f700 1 -- 172.21.15.146:0/2760736459 >> 172.21.15.146:0/2760736459 conn(0x7f17fc099c40 msgr2=0x7f17fc0a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.675+0000 7f1801a2f700 1 -- 172.21.15.146:0/2760736459 shutdown_connections 2023-10-03T10:17:37.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:37.675+0000 7f1801a2f700 1 -- 172.21.15.146:0/2760736459 wait complete. 2023-10-03T10:17:37.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:38.412 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:38.541 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:38.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.546+0000 7f730f652700 1 Processor -- start 2023-10-03T10:17:38.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.546+0000 7f730f652700 1 -- start start 2023-10-03T10:17:38.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.547+0000 7f730f652700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f73080a0a30 0x7f73080a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.547+0000 7f730f652700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73080a1340 0x7f730812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.547+0000 7f730f652700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73080a1e70 con 0x7f73081304a0 2023-10-03T10:17:38.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.547+0000 7f730f652700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f730809a720 con 0x7f73080a0a30 2023-10-03T10:17:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.547+0000 7f730f652700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730809b300 con 0x7f73080a1340 2023-10-03T10:17:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.547+0000 7f730cbed700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73080a1340 0x7f730812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.547+0000 7f730d3ee700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f73080a0a30 0x7f73080a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.547+0000 7f730cbed700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73080a1340 0x7f730812ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56656/0 (socket says 172.21.15.146:56656) 2023-10-03T10:17:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.547+0000 7f730d3ee700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f73080a0a30 0x7f73080a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33198/0 (socket says 172.21.15.146:33198) 2023-10-03T10:17:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.547+0000 7f730cbed700 1 -- 172.21.15.146:0/2146237359 learned_addr learned my addr 172.21.15.146:0/2146237359 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.547+0000 7f730dbef700 1 --1- 172.21.15.146:0/2146237359 >> v1:172.21.15.146:6789/0 conn(0x7f73081304a0 0x7f73081371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45018/0 (socket says 172.21.15.146:45018) 2023-10-03T10:17:38.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.547+0000 7f730d3ee700 1 -- 172.21.15.146:0/2146237359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73080a1340 msgr2=0x7f730812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:38.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.547+0000 7f730d3ee700 1 --2- 172.21.15.146:0/2146237359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73080a1340 0x7f730812ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.547+0000 7f730d3ee700 1 -- 172.21.15.146:0/2146237359 >> v1:172.21.15.146:6789/0 conn(0x7f73081304a0 legacy=0x7f73081371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.547+0000 7f730d3ee700 1 -- 172.21.15.146:0/2146237359 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730809abc0 con 0x7f73080a0a30 2023-10-03T10:17:38.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.547+0000 7f72fffff700 1 -- 172.21.15.146:0/2146237359 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3339658320 0 0) 0x7f73080a1e70 con 0x7f73081304a0 2023-10-03T10:17:38.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.547+0000 7f730cbed700 1 --2- 172.21.15.146:0/2146237359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73080a1340 0x7f730812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.548+0000 7f730d3ee700 1 --2- 172.21.15.146:0/2146237359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73080a0a30 0x7f73080a0e00 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f7304009820 tx=0x7f7304009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7df22a7b540c33 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.548+0000 7f72fffff700 1 -- 172.21.15.146:0/2146237359 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7304005e30 con 0x7f73080a0a30 2023-10-03T10:17:38.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.548+0000 7f72fffff700 1 -- 172.21.15.146:0/2146237359 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7304006030 con 0x7f73080a0a30 2023-10-03T10:17:38.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.548+0000 7f72fffff700 1 -- 172.21.15.146:0/2146237359 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73040063c0 con 0x7f73080a0a30 2023-10-03T10:17:38.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.548+0000 7f730f652700 1 -- 172.21.15.146:0/2146237359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73080a0a30 msgr2=0x7f73080a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.548+0000 7f730f652700 1 --2- 172.21.15.146:0/2146237359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73080a0a30 0x7f73080a0e00 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f7304009820 tx=0x7f7304009b30 comp rx=0 tx=0).stop 2023-10-03T10:17:38.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.548+0000 7f730f652700 1 -- 172.21.15.146:0/2146237359 shutdown_connections 2023-10-03T10:17:38.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.548+0000 7f730f652700 1 --2- 172.21.15.146:0/2146237359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73080a0a30 0x7f73080a0e00 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.548+0000 7f730f652700 1 --2- 172.21.15.146:0/2146237359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73080a1340 0x7f730812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.548+0000 7f730f652700 1 -- 172.21.15.146:0/2146237359 >> 172.21.15.146:0/2146237359 conn(0x7f73080a2980 msgr2=0x7f73080a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.549+0000 7f730f652700 1 -- 172.21.15.146:0/2146237359 shutdown_connections 2023-10-03T10:17:38.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.549+0000 7f730f652700 1 -- 172.21.15.146:0/2146237359 wait complete. 2023-10-03T10:17:38.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.549+0000 7f730f652700 1 Processor -- start 2023-10-03T10:17:38.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.550+0000 7f730f652700 1 -- start start 2023-10-03T10:17:38.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.550+0000 7f730f652700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73080a0a30 0x7f730811ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.550+0000 7f730f652700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73080a1340 0x7f730811b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.550+0000 7f730f652700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73081304a0 0x7f730811b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.550+0000 7f730f652700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730811d090 con 0x7f73081304a0 2023-10-03T10:17:38.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.550+0000 7f730f652700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730809ae70 con 0x7f73080a0a30 2023-10-03T10:17:38.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.550+0000 7f730f652700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f730809faa0 con 0x7f73080a1340 2023-10-03T10:17:38.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.550+0000 7f730cbed700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73080a1340 0x7f730811b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.550+0000 7f730dbef700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73081304a0 0x7f730811b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.550+0000 7f730d3ee700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73080a0a30 0x7f730811ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.550+0000 7f730cbed700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73080a1340 0x7f730811b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:48838/0 (socket says 172.21.15.146:48838) 2023-10-03T10:17:38.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.550+0000 7f730cbed700 1 -- 172.21.15.146:0/1905668906 learned_addr learned my addr 172.21.15.146:0/1905668906 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:38.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.550+0000 7f730d3ee700 1 -- 172.21.15.146:0/1905668906 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73080a1340 msgr2=0x7f730811b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.550+0000 7f730d3ee700 1 --2- 172.21.15.146:0/1905668906 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73080a1340 0x7f730811b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.550+0000 7f730d3ee700 1 -- 172.21.15.146:0/1905668906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73081304a0 msgr2=0x7f730811b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.550+0000 7f730d3ee700 1 --2- 172.21.15.146:0/1905668906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73081304a0 0x7f730811b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.550+0000 7f730d3ee700 1 -- 172.21.15.146:0/1905668906 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f800d9f0 con 0x7f73080a0a30 2023-10-03T10:17:38.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.551+0000 7f730dbef700 1 --2- 172.21.15.146:0/1905668906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73081304a0 0x7f730811b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.551+0000 7f730d3ee700 1 --2- 172.21.15.146:0/1905668906 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73080a0a30 0x7f730811ae60 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f7304015000 tx=0x7f7304004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.551+0000 7f730cbed700 1 --2- 172.21.15.146:0/1905668906 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73080a1340 0x7f730811b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.551+0000 7f72fdffb700 1 -- 172.21.15.146:0/1905668906 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73040063a0 con 0x7f73080a0a30 2023-10-03T10:17:38.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.551+0000 7f72fdffb700 1 -- 172.21.15.146:0/1905668906 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7304006500 con 0x7f73080a0a30 2023-10-03T10:17:38.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.551+0000 7f730f652700 1 -- 172.21.15.146:0/1905668906 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7304009430 con 0x7f73080a0a30 2023-10-03T10:17:38.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.551+0000 7f72fdffb700 1 -- 172.21.15.146:0/1905668906 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7304006890 con 0x7f73080a0a30 2023-10-03T10:17:38.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.551+0000 7f730f652700 1 -- 172.21.15.146:0/1905668906 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730811e6a0 con 0x7f73080a0a30 2023-10-03T10:17:38.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.552+0000 7f730f652700 1 -- 172.21.15.146:0/1905668906 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730804f2a0 con 0x7f73080a0a30 2023-10-03T10:17:38.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.553+0000 7f72fdffb700 1 -- 172.21.15.146:0/1905668906 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7304022070 con 0x7f73080a0a30 2023-10-03T10:17:38.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.553+0000 7f72fdffb700 1 -- 172.21.15.146:0/1905668906 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7304041080 con 0x7f73080a0a30 2023-10-03T10:17:38.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.557+0000 7f72fdffb700 1 -- 172.21.15.146:0/1905668906 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f730402f7d0 con 0x7f73080a0a30 2023-10-03T10:17:38.636 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:38.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.668+0000 7fef64bf3700 1 Processor -- start 2023-10-03T10:17:38.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.668+0000 7fef64bf3700 1 -- start start 2023-10-03T10:17:38.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.669+0000 7fef64bf3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fef60132100 0x7fef601367d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.669+0000 7fef64bf3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef601314b0 0x7fef60138d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.669+0000 7fef64bf3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef600a0f20 con 0x7fef60066410 2023-10-03T10:17:38.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.669+0000 7fef64bf3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef600667e0 con 0x7fef60132100 2023-10-03T10:17:38.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.669+0000 7fef64bf3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef600a23c0 con 0x7fef601314b0 2023-10-03T10:17:38.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.669+0000 7fef5dd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fef60132100 0x7fef601367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.669+0000 7fef5dd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fef60132100 0x7fef601367d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33206/0 (socket says 172.21.15.146:33206) 2023-10-03T10:17:38.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.669+0000 7fef5dd9b700 1 -- 172.21.15.146:0/3024767866 learned_addr learned my addr 172.21.15.146:0/3024767866 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:38.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.669+0000 7fef5e59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fef60066410 0x7fef601319f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45026/0 (socket says 172.21.15.146:45026) 2023-10-03T10:17:38.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.669+0000 7fef5ed9d700 1 --2- 172.21.15.146:0/3024767866 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef601314b0 0x7fef60138d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.669+0000 7fef5dd9b700 1 -- 172.21.15.146:0/3024767866 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef601314b0 msgr2=0x7fef60138d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:38.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.669+0000 7fef5dd9b700 1 --2- 172.21.15.146:0/3024767866 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef601314b0 0x7fef60138d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.669+0000 7fef5dd9b700 1 -- 172.21.15.146:0/3024767866 >> v1:172.21.15.146:6789/0 conn(0x7fef60066410 legacy=0x7fef601319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.669+0000 7fef5dd9b700 1 -- 172.21.15.146:0/3024767866 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef600a16e0 con 0x7fef60132100 2023-10-03T10:17:38.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.669+0000 7fef5ed9d700 1 --2- 172.21.15.146:0/3024767866 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef601314b0 0x7fef60138d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.669+0000 7fef5dd9b700 1 --2- 172.21.15.146:0/3024767866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef60132100 0x7fef601367d0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fef54009920 tx=0x7fef54009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea7ad0eea098417 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.670+0000 7fef5d59a700 1 -- 172.21.15.146:0/3024767866 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54011830 con 0x7fef60132100 2023-10-03T10:17:38.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.670+0000 7fef5d59a700 1 -- 172.21.15.146:0/3024767866 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef54011990 con 0x7fef60132100 2023-10-03T10:17:38.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.670+0000 7fef5d59a700 1 -- 172.21.15.146:0/3024767866 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54011d20 con 0x7fef60132100 2023-10-03T10:17:38.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.670+0000 7fef64bf3700 1 -- 172.21.15.146:0/3024767866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef60132100 msgr2=0x7fef601367d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.670+0000 7fef64bf3700 1 --2- 172.21.15.146:0/3024767866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef60132100 0x7fef601367d0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fef54009920 tx=0x7fef54009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:38.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.670+0000 7fef64bf3700 1 -- 172.21.15.146:0/3024767866 shutdown_connections 2023-10-03T10:17:38.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.670+0000 7fef64bf3700 1 --2- 172.21.15.146:0/3024767866 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef601314b0 0x7fef60138d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.670+0000 7fef64bf3700 1 --2- 172.21.15.146:0/3024767866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef60132100 0x7fef601367d0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.670+0000 7fef64bf3700 1 -- 172.21.15.146:0/3024767866 >> 172.21.15.146:0/3024767866 conn(0x7fef600a2980 msgr2=0x7fef600a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.670+0000 7fef64bf3700 1 -- 172.21.15.146:0/3024767866 shutdown_connections 2023-10-03T10:17:38.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.670+0000 7fef64bf3700 1 -- 172.21.15.146:0/3024767866 wait complete. 2023-10-03T10:17:38.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.672+0000 7fef64bf3700 1 Processor -- start 2023-10-03T10:17:38.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.672+0000 7fef64bf3700 1 -- start start 2023-10-03T10:17:38.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.673+0000 7fef64bf3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef60066410 0x7fef6012dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.673+0000 7fef64bf3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef601314b0 0x7fef6012e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.673+0000 7fef64bf3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef60132100 0x7fef60136690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.673+0000 7fef64bf3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef60138b30 con 0x7fef60132100 2023-10-03T10:17:38.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.673+0000 7fef64bf3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6009b6c0 con 0x7fef601314b0 2023-10-03T10:17:38.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.673+0000 7fef64bf3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef60099c50 con 0x7fef60066410 2023-10-03T10:17:38.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.673+0000 7fef5e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef60066410 0x7fef6012dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.673+0000 7fef5ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef60132100 0x7fef60136690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.673+0000 7fef5e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef60066410 0x7fef6012dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:48856/0 (socket says 172.21.15.146:48856) 2023-10-03T10:17:38.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.673+0000 7fef5ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef60132100 0x7fef60136690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33212/0 (socket says 172.21.15.146:33212) 2023-10-03T10:17:38.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.673+0000 7fef5e59c700 1 -- 172.21.15.146:0/3575293637 learned_addr learned my addr 172.21.15.146:0/3575293637 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:38.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.673+0000 7fef5e59c700 1 -- 172.21.15.146:0/3575293637 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef601314b0 msgr2=0x7fef6012e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.673+0000 7fef5e59c700 1 --2- 172.21.15.146:0/3575293637 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef601314b0 0x7fef6012e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.673+0000 7fef5e59c700 1 -- 172.21.15.146:0/3575293637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef60132100 msgr2=0x7fef60136690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.673+0000 7fef5e59c700 1 --2- 172.21.15.146:0/3575293637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef60132100 0x7fef60136690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.673+0000 7fef5e59c700 1 -- 172.21.15.146:0/3575293637 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef58009a70 con 0x7fef60066410 2023-10-03T10:17:38.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.673+0000 7fef5ed9d700 1 --2- 172.21.15.146:0/3575293637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef60132100 0x7fef60136690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.673+0000 7fef5e59c700 1 --2- 172.21.15.146:0/3575293637 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef60066410 0x7fef6012dbb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fef5000c500 tx=0x7fef5000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.673+0000 7fef4effd700 1 -- 172.21.15.146:0/3575293637 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef500074e0 con 0x7fef60066410 2023-10-03T10:17:38.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.673+0000 7fef4effd700 1 -- 172.21.15.146:0/3575293637 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef50007640 con 0x7fef60066410 2023-10-03T10:17:38.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.673+0000 7fef64bf3700 1 -- 172.21.15.146:0/3575293637 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef54009550 con 0x7fef60066410 2023-10-03T10:17:38.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.673+0000 7fef4effd700 1 -- 172.21.15.146:0/3575293637 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef50005a70 con 0x7fef60066410 2023-10-03T10:17:38.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.674+0000 7fef64bf3700 1 -- 172.21.15.146:0/3575293637 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6009b2d0 con 0x7fef60066410 2023-10-03T10:17:38.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.674+0000 7fef4effd700 1 -- 172.21.15.146:0/3575293637 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef50005bd0 con 0x7fef60066410 2023-10-03T10:17:38.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.675+0000 7fef4effd700 1 -- 172.21.15.146:0/3575293637 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fef5003eb50 con 0x7fef60066410 2023-10-03T10:17:38.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.675+0000 7fef64bf3700 1 -- 172.21.15.146:0/3575293637 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6004f2a0 con 0x7fef60066410 2023-10-03T10:17:38.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.679+0000 7fef4effd700 1 -- 172.21.15.146:0/3575293637 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef50017070 con 0x7fef60066410 2023-10-03T10:17:38.688 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:38.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.758+0000 7f730f652700 1 -- 172.21.15.146:0/1905668906 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f730811d260 con 0x7f73080a0a30 2023-10-03T10:17:38.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.758+0000 7f72fdffb700 1 -- 172.21.15.146:0/1905668906 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f730401c410 con 0x7f73080a0a30 2023-10-03T10:17:38.759 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:38.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.762+0000 7f730f652700 1 -- 172.21.15.146:0/1905668906 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73080a0a30 msgr2=0x7f730811ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.762+0000 7f730f652700 1 --2- 172.21.15.146:0/1905668906 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73080a0a30 0x7f730811ae60 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f7304015000 tx=0x7f7304004750 comp rx=0 tx=0).stop 2023-10-03T10:17:38.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.762+0000 7f730f652700 1 -- 172.21.15.146:0/1905668906 shutdown_connections 2023-10-03T10:17:38.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.762+0000 7f730f652700 1 --2- 172.21.15.146:0/1905668906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73081304a0 0x7f730811b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.762+0000 7f730f652700 1 --2- 172.21.15.146:0/1905668906 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73080a0a30 0x7f730811ae60 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.762+0000 7f730f652700 1 --2- 172.21.15.146:0/1905668906 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73080a1340 0x7f730811b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.762+0000 7f730f652700 1 -- 172.21.15.146:0/1905668906 >> 172.21.15.146:0/1905668906 conn(0x7f73080a2980 msgr2=0x7f73081b78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.763+0000 7f730f652700 1 -- 172.21.15.146:0/1905668906 shutdown_connections 2023-10-03T10:17:38.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.763+0000 7f730f652700 1 -- 172.21.15.146:0/1905668906 wait complete. 2023-10-03T10:17:38.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.765+0000 7efecc943700 1 Processor -- start 2023-10-03T10:17:38.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.765+0000 7efecc943700 1 -- start start 2023-10-03T10:17:38.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.766+0000 7efecc943700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efec8138040 0x7efec8138410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.766+0000 7efecc943700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efec80a08e0 0x7efec80a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.766+0000 7efecc943700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec81379e0 con 0x7efec80a1230 2023-10-03T10:17:38.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.766+0000 7efecc943700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec80a2100 con 0x7efec80a08e0 2023-10-03T10:17:38.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.766+0000 7efecc943700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efec8138950 con 0x7efec8138040 2023-10-03T10:17:38.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.766+0000 7efec659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efec8138040 0x7efec8138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.766+0000 7efec5d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efec80a08e0 0x7efec80a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.766+0000 7efec659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efec8138040 0x7efec8138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:48862/0 (socket says 172.21.15.146:48862) 2023-10-03T10:17:38.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.766+0000 7efec659c700 1 -- 172.21.15.146:0/4206183011 learned_addr learned my addr 172.21.15.146:0/4206183011 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:38.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.766+0000 7efec659c700 1 -- 172.21.15.146:0/4206183011 >> v2:172.21.15.146:3300/0 conn(0x7efec80a08e0 msgr2=0x7efec80a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:38.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.766+0000 7efec659c700 1 --2- 172.21.15.146:0/4206183011 >> v2:172.21.15.146:3300/0 conn(0x7efec80a08e0 0x7efec80a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.766+0000 7efec659c700 1 -- 172.21.15.146:0/4206183011 >> v1:172.21.15.146:6789/0 conn(0x7efec80a1230 legacy=0x7efec813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:38.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.766+0000 7efec659c700 1 -- 172.21.15.146:0/4206183011 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec809b9b0 con 0x7efec8138040 2023-10-03T10:17:38.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.766+0000 7efec5d9b700 1 --2- 172.21.15.146:0/4206183011 >> v2:172.21.15.146:3300/0 conn(0x7efec80a08e0 0x7efec80a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.766+0000 7efec659c700 1 --2- 172.21.15.146:0/4206183011 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efec8138040 0x7efec8138410 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7efeb80098f0 tx=0x7efeb8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67c9d7bec9c08b45 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.767+0000 7efec559a700 1 -- 172.21.15.146:0/4206183011 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb8005e30 con 0x7efec8138040 2023-10-03T10:17:38.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.767+0000 7efec559a700 1 -- 172.21.15.146:0/4206183011 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb8006030 con 0x7efec8138040 2023-10-03T10:17:38.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.767+0000 7efec559a700 1 -- 172.21.15.146:0/4206183011 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb80063c0 con 0x7efec8138040 2023-10-03T10:17:38.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.767+0000 7efecc943700 1 -- 172.21.15.146:0/4206183011 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efec8138040 msgr2=0x7efec8138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.767+0000 7efecc943700 1 --2- 172.21.15.146:0/4206183011 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efec8138040 0x7efec8138410 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7efeb80098f0 tx=0x7efeb8009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:38.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.767+0000 7efecc943700 1 -- 172.21.15.146:0/4206183011 shutdown_connections 2023-10-03T10:17:38.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.767+0000 7efecc943700 1 --2- 172.21.15.146:0/4206183011 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efec8138040 0x7efec8138410 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.767+0000 7efecc943700 1 --2- 172.21.15.146:0/4206183011 >> v2:172.21.15.146:3300/0 conn(0x7efec80a08e0 0x7efec80a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.767+0000 7efecc943700 1 -- 172.21.15.146:0/4206183011 >> 172.21.15.146:0/4206183011 conn(0x7efec80a2980 msgr2=0x7efec80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.768+0000 7efecc943700 1 -- 172.21.15.146:0/4206183011 shutdown_connections 2023-10-03T10:17:38.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.768+0000 7efecc943700 1 -- 172.21.15.146:0/4206183011 wait complete. 2023-10-03T10:17:38.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.769+0000 7efecc943700 1 Processor -- start 2023-10-03T10:17:38.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.769+0000 7efecc943700 1 -- start start 2023-10-03T10:17:38.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.770+0000 7efecc943700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efec80a08e0 0x7efec8126330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.770+0000 7efecc943700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efec80a1230 0x7efec8126870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.770+0000 7efecc943700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efec8138040 0x7efec8126db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.770+0000 7efecc943700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec8129e50 con 0x7efec80a1230 2023-10-03T10:17:38.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.770+0000 7efecc943700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec81287d0 con 0x7efec8138040 2023-10-03T10:17:38.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.770+0000 7efecc943700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efec8127f40 con 0x7efec80a08e0 2023-10-03T10:17:38.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.770+0000 7efec659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efec80a08e0 0x7efec8126330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.770+0000 7efec659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efec80a08e0 0x7efec8126330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:48874/0 (socket says 172.21.15.146:48874) 2023-10-03T10:17:38.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.770+0000 7efec659c700 1 -- 172.21.15.146:0/4088487091 learned_addr learned my addr 172.21.15.146:0/4088487091 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:38.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.770+0000 7efec6d9d700 1 --2- 172.21.15.146:0/4088487091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efec8138040 0x7efec8126db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.770+0000 7efec659c700 1 -- 172.21.15.146:0/4088487091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efec8138040 msgr2=0x7efec8126db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.770+0000 7efec659c700 1 --2- 172.21.15.146:0/4088487091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efec8138040 0x7efec8126db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.770+0000 7efec659c700 1 -- 172.21.15.146:0/4088487091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efec80a1230 msgr2=0x7efec8126870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.770+0000 7efec659c700 1 --2- 172.21.15.146:0/4088487091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efec80a1230 0x7efec8126870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.770+0000 7efec659c700 1 -- 172.21.15.146:0/4088487091 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc0094a0 con 0x7efec80a08e0 2023-10-03T10:17:38.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.770+0000 7efec659c700 1 --2- 172.21.15.146:0/4088487091 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efec80a08e0 0x7efec8126330 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009f50 tx=0x7efeb8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.770+0000 7efeb6ffd700 1 -- 172.21.15.146:0/4088487091 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb8004230 con 0x7efec80a08e0 2023-10-03T10:17:38.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.771+0000 7efeb6ffd700 1 -- 172.21.15.146:0/4088487091 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb80043b0 con 0x7efec80a08e0 2023-10-03T10:17:38.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.771+0000 7efecc943700 1 -- 172.21.15.146:0/4088487091 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb8009500 con 0x7efec80a08e0 2023-10-03T10:17:38.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.771+0000 7efeb6ffd700 1 -- 172.21.15.146:0/4088487091 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb8006950 con 0x7efec80a08e0 2023-10-03T10:17:38.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.771+0000 7efecc943700 1 -- 172.21.15.146:0/4088487091 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec8137280 con 0x7efec80a08e0 2023-10-03T10:17:38.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.771+0000 7efeb6ffd700 1 -- 172.21.15.146:0/4088487091 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efeb80036a0 con 0x7efec80a08e0 2023-10-03T10:17:38.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.772+0000 7efeb6ffd700 1 -- 172.21.15.146:0/4088487091 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efeb8021030 con 0x7efec80a08e0 2023-10-03T10:17:38.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.772+0000 7efecc943700 1 -- 172.21.15.146:0/4088487091 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec81299f0 con 0x7efec80a08e0 2023-10-03T10:17:38.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.777+0000 7efeb6ffd700 1 -- 172.21.15.146:0/4088487091 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efec81299f0 con 0x7efec80a08e0 2023-10-03T10:17:38.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:38.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.827+0000 7f6c642b3700 1 Processor -- start 2023-10-03T10:17:38.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.827+0000 7f6c642b3700 1 -- start start 2023-10-03T10:17:38.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.828+0000 7f6c642b3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c5c136960 0x7f6c5c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.828+0000 7f6c642b3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c5c139280 0x7f6c5c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.828+0000 7f6c642b3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c5c06b2d0 con 0x7f6c5c133ad0 2023-10-03T10:17:38.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.828+0000 7f6c642b3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c1345b0 con 0x7f6c5c136960 2023-10-03T10:17:38.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.828+0000 7f6c642b3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c133610 con 0x7f6c5c139280 2023-10-03T10:17:38.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.828+0000 7f6c62850700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c5c139280 0x7f6c5c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.828+0000 7f6c6204f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6c5c133ad0 0x7f6c5c133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45042/0 (socket says 172.21.15.146:45042) 2023-10-03T10:17:38.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.828+0000 7f6c6184e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c5c136960 0x7f6c5c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.828+0000 7f6c6204f700 1 -- 172.21.15.146:0/1903379086 learned_addr learned my addr 172.21.15.146:0/1903379086 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:38.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.828+0000 7f6c6184e700 1 -- 172.21.15.146:0/1903379086 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c5c139280 msgr2=0x7f6c5c13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:38.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.828+0000 7f6c6184e700 1 --2- 172.21.15.146:0/1903379086 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c5c139280 0x7f6c5c13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.828+0000 7f6c6184e700 1 -- 172.21.15.146:0/1903379086 >> v1:172.21.15.146:6789/0 conn(0x7f6c5c133ad0 legacy=0x7f6c5c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.828+0000 7f6c6104d700 1 -- 172.21.15.146:0/1903379086 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691886149 0 0) 0x7f6c5c06b2d0 con 0x7f6c5c133ad0 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.828+0000 7f6c6184e700 1 -- 172.21.15.146:0/1903379086 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5c09a500 con 0x7f6c5c136960 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.828+0000 7f6c62850700 1 --2- 172.21.15.146:0/1903379086 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c5c139280 0x7f6c5c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.828+0000 7f6c6184e700 1 --2- 172.21.15.146:0/1903379086 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c5c136960 0x7f6c5c138d40 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009870 tx=0x7f6c4c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a37eccc625733821 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.828+0000 7f6c6104d700 1 -- 172.21.15.146:0/1903379086 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c011830 con 0x7f6c5c136960 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.829+0000 7f6c6104d700 1 -- 172.21.15.146:0/1903379086 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c011990 con 0x7f6c5c136960 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.829+0000 7f6c6104d700 1 -- 172.21.15.146:0/1903379086 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c011d20 con 0x7f6c5c136960 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.829+0000 7f6c642b3700 1 -- 172.21.15.146:0/1903379086 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c5c136960 msgr2=0x7f6c5c138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.829+0000 7f6c642b3700 1 --2- 172.21.15.146:0/1903379086 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c5c136960 0x7f6c5c138d40 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009870 tx=0x7f6c4c009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.829+0000 7f6c642b3700 1 -- 172.21.15.146:0/1903379086 shutdown_connections 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.829+0000 7f6c642b3700 1 --2- 172.21.15.146:0/1903379086 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c5c139280 0x7f6c5c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.829+0000 7f6c642b3700 1 --2- 172.21.15.146:0/1903379086 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c5c136960 0x7f6c5c138d40 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.829+0000 7f6c642b3700 1 -- 172.21.15.146:0/1903379086 >> 172.21.15.146:0/1903379086 conn(0x7f6c5c099c40 msgr2=0x7f6c5c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.829+0000 7f6c642b3700 1 -- 172.21.15.146:0/1903379086 shutdown_connections 2023-10-03T10:17:38.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.829+0000 7f6c642b3700 1 -- 172.21.15.146:0/1903379086 wait complete. 2023-10-03T10:17:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.830+0000 7f6c642b3700 1 Processor -- start 2023-10-03T10:17:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.830+0000 7f6c642b3700 1 -- start start 2023-10-03T10:17:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.831+0000 7f6c642b3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c5c133ad0 0x7f6c5c12cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.831+0000 7f6c642b3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c5c136960 0x7f6c5c12d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.831+0000 7f6c642b3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c5c139280 0x7f6c5c12d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.831+0000 7f6c642b3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c1317a0 con 0x7f6c5c133ad0 2023-10-03T10:17:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.831+0000 7f6c642b3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c06edc0 con 0x7f6c5c136960 2023-10-03T10:17:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.831+0000 7f6c642b3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c09f390 con 0x7f6c5c139280 2023-10-03T10:17:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.831+0000 7f6c6184e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c5c136960 0x7f6c5c12d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.831+0000 7f6c6184e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c5c136960 0x7f6c5c12d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56708/0 (socket says 172.21.15.146:56708) 2023-10-03T10:17:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.831+0000 7f6c6184e700 1 -- 172.21.15.146:0/1713730488 learned_addr learned my addr 172.21.15.146:0/1713730488 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.831+0000 7f6c6204f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c5c133ad0 0x7f6c5c12cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.831+0000 7f6c62850700 1 --2- 172.21.15.146:0/1713730488 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c5c139280 0x7f6c5c12d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.831+0000 7f6c6184e700 1 -- 172.21.15.146:0/1713730488 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c5c139280 msgr2=0x7f6c5c12d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.831+0000 7f6c6184e700 1 --2- 172.21.15.146:0/1713730488 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c5c139280 0x7f6c5c12d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.831+0000 7f6c6184e700 1 -- 172.21.15.146:0/1713730488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c5c133ad0 msgr2=0x7f6c5c12cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.831+0000 7f6c6184e700 1 --2- 172.21.15.146:0/1713730488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c5c133ad0 0x7f6c5c12cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.831+0000 7f6c6184e700 1 -- 172.21.15.146:0/1713730488 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c54009a70 con 0x7f6c5c136960 2023-10-03T10:17:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.831+0000 7f6c6184e700 1 --2- 172.21.15.146:0/1713730488 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c5c136960 0x7f6c5c12d070 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009840 tx=0x7f6c4c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.831+0000 7f6c52ffd700 1 -- 172.21.15.146:0/1713730488 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0042c0 con 0x7f6c5c136960 2023-10-03T10:17:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.831+0000 7f6c52ffd700 1 -- 172.21.15.146:0/1713730488 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c01f070 con 0x7f6c5c136960 2023-10-03T10:17:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.831+0000 7f6c642b3700 1 -- 172.21.15.146:0/1713730488 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4c0094a0 con 0x7f6c5c136960 2023-10-03T10:17:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.831+0000 7f6c52ffd700 1 -- 172.21.15.146:0/1713730488 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0036a0 con 0x7f6c5c136960 2023-10-03T10:17:38.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.831+0000 7f6c642b3700 1 -- 172.21.15.146:0/1713730488 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c5c0701b0 con 0x7f6c5c136960 2023-10-03T10:17:38.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.832+0000 7f6c642b3700 1 -- 172.21.15.146:0/1713730488 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c5c072780 con 0x7f6c5c136960 2023-10-03T10:17:38.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.832+0000 7f6c52ffd700 1 -- 172.21.15.146:0/1713730488 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c4c021030 con 0x7f6c5c136960 2023-10-03T10:17:38.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.832+0000 7f6c52ffd700 1 -- 172.21.15.146:0/1713730488 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6c4c040710 con 0x7f6c5c136960 2023-10-03T10:17:38.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.837+0000 7f6c52ffd700 1 -- 172.21.15.146:0/1713730488 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c4c0239c0 con 0x7f6c5c136960 2023-10-03T10:17:38.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.883+0000 7fef64bf3700 1 -- 172.21.15.146:0/3575293637 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fef600724e0 con 0x7fef60066410 2023-10-03T10:17:38.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.883+0000 7fef4effd700 1 -- 172.21.15.146:0/3575293637 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fef5000f260 con 0x7fef60066410 2023-10-03T10:17:38.884 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:38.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.885+0000 7fef64bf3700 1 -- 172.21.15.146:0/3575293637 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef60066410 msgr2=0x7fef6012dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.885+0000 7fef64bf3700 1 --2- 172.21.15.146:0/3575293637 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef60066410 0x7fef6012dbb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fef5000c500 tx=0x7fef5000c8c0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.885+0000 7fef64bf3700 1 -- 172.21.15.146:0/3575293637 shutdown_connections 2023-10-03T10:17:38.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.885+0000 7fef64bf3700 1 --2- 172.21.15.146:0/3575293637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef60132100 0x7fef60136690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.885+0000 7fef64bf3700 1 --2- 172.21.15.146:0/3575293637 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fef60066410 0x7fef6012dbb0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.885+0000 7fef64bf3700 1 --2- 172.21.15.146:0/3575293637 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef601314b0 0x7fef6012e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.885+0000 7fef64bf3700 1 -- 172.21.15.146:0/3575293637 >> 172.21.15.146:0/3575293637 conn(0x7fef600a2980 msgr2=0x7fef60130240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.885+0000 7fef64bf3700 1 -- 172.21.15.146:0/3575293637 shutdown_connections 2023-10-03T10:17:38.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.885+0000 7fef64bf3700 1 -- 172.21.15.146:0/3575293637 wait complete. 2023-10-03T10:17:38.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:38.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.975+0000 7efecc943700 1 -- 172.21.15.146:0/4088487091 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efec81299f0 con 0x7efec80a08e0 2023-10-03T10:17:38.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.975+0000 7efeb6ffd700 1 -- 172.21.15.146:0/4088487091 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efeb8035090 con 0x7efec80a08e0 2023-10-03T10:17:38.976 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:38.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.977+0000 7efecc943700 1 -- 172.21.15.146:0/4088487091 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efec80a08e0 msgr2=0x7efec8126330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.977+0000 7efecc943700 1 --2- 172.21.15.146:0/4088487091 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efec80a08e0 0x7efec8126330 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009f50 tx=0x7efeb8004750 comp rx=0 tx=0).stop 2023-10-03T10:17:38.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.978+0000 7efecc943700 1 -- 172.21.15.146:0/4088487091 shutdown_connections 2023-10-03T10:17:38.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.978+0000 7efecc943700 1 --2- 172.21.15.146:0/4088487091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efec8138040 0x7efec8126db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.978+0000 7efecc943700 1 --2- 172.21.15.146:0/4088487091 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efec80a08e0 0x7efec8126330 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.978+0000 7efecc943700 1 --2- 172.21.15.146:0/4088487091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efec80a1230 0x7efec8126870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.978+0000 7efecc943700 1 -- 172.21.15.146:0/4088487091 >> 172.21.15.146:0/4088487091 conn(0x7efec80a2980 msgr2=0x7efec809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.978+0000 7efecc943700 1 -- 172.21.15.146:0/4088487091 shutdown_connections 2023-10-03T10:17:38.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:38.978+0000 7efecc943700 1 -- 172.21.15.146:0/4088487091 wait complete. 2023-10-03T10:17:38.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.032+0000 7f6c642b3700 1 -- 172.21.15.146:0/1713730488 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6c5c070ce0 con 0x7f6c5c136960 2023-10-03T10:17:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.032+0000 7f6c52ffd700 1 -- 172.21.15.146:0/1713730488 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6c4c015070 con 0x7f6c5c136960 2023-10-03T10:17:39.033 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:39.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.034+0000 7f6c642b3700 1 -- 172.21.15.146:0/1713730488 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c5c136960 msgr2=0x7f6c5c12d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.034+0000 7f6c642b3700 1 --2- 172.21.15.146:0/1713730488 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c5c136960 0x7f6c5c12d070 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009840 tx=0x7f6c4c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:39.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.034+0000 7f6c642b3700 1 -- 172.21.15.146:0/1713730488 shutdown_connections 2023-10-03T10:17:39.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.034+0000 7f6c642b3700 1 --2- 172.21.15.146:0/1713730488 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c5c139280 0x7f6c5c12d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.034+0000 7f6c642b3700 1 --2- 172.21.15.146:0/1713730488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c5c133ad0 0x7f6c5c12cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.034+0000 7f6c642b3700 1 --2- 172.21.15.146:0/1713730488 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c5c136960 0x7f6c5c12d070 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.034+0000 7f6c642b3700 1 -- 172.21.15.146:0/1713730488 >> 172.21.15.146:0/1713730488 conn(0x7f6c5c099c40 msgr2=0x7f6c5c134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.034+0000 7f6c642b3700 1 -- 172.21.15.146:0/1713730488 shutdown_connections 2023-10-03T10:17:39.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.034+0000 7f6c642b3700 1 -- 172.21.15.146:0/1713730488 wait complete. 2023-10-03T10:17:39.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:39.784 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:39.898 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:39.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.920+0000 7f9f0d0c6700 1 Processor -- start 2023-10-03T10:17:39.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.920+0000 7f9f0d0c6700 1 -- start start 2023-10-03T10:17:39.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.921+0000 7f9f0d0c6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f081335f0 0x7f9f081359d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.921+0000 7f9f0d0c6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9f08135f10 0x7f9f081382f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.921+0000 7f9f0d0c6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f0809bb90 con 0x7f9f0812d380 2023-10-03T10:17:39.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.921+0000 7f9f0d0c6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f0809c210 con 0x7f9f08135f10 2023-10-03T10:17:39.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.921+0000 7f9f0d0c6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0809ced0 con 0x7f9f081335f0 2023-10-03T10:17:39.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.921+0000 7f9f0659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f081335f0 0x7f9f081359d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.921+0000 7f9f0759e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9f08135f10 0x7f9f081382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.921+0000 7f9f0659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f081335f0 0x7f9f081359d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56718/0 (socket says 172.21.15.146:56718) 2023-10-03T10:17:39.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.921+0000 7f9f0659c700 1 -- 172.21.15.146:0/2971765053 learned_addr learned my addr 172.21.15.146:0/2971765053 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:39.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.921+0000 7f9f0759e700 1 -- 172.21.15.146:0/2971765053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f081335f0 msgr2=0x7f9f081359d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:39.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.921+0000 7f9f0759e700 1 --2- 172.21.15.146:0/2971765053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f081335f0 0x7f9f081359d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.921+0000 7f9f0759e700 1 -- 172.21.15.146:0/2971765053 >> v1:172.21.15.146:6789/0 conn(0x7f9f0812d380 legacy=0x7f9f0812d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.921+0000 7f9f0759e700 1 -- 172.21.15.146:0/2971765053 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0809ac30 con 0x7f9f08135f10 2023-10-03T10:17:39.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.922+0000 7f9f0759e700 1 --2- 172.21.15.146:0/2971765053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f08135f10 0x7f9f081382f0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009d90 tx=0x7f9f0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bfbd40954661a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.922+0000 7f9f05d9b700 1 -- 172.21.15.146:0/2971765053 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0000e070 con 0x7f9f08135f10 2023-10-03T10:17:39.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.922+0000 7f9f05d9b700 1 -- 172.21.15.146:0/2971765053 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0000bb20 con 0x7f9f08135f10 2023-10-03T10:17:39.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.922+0000 7f9f05d9b700 1 -- 172.21.15.146:0/2971765053 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f00012430 con 0x7f9f08135f10 2023-10-03T10:17:39.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.922+0000 7f9f0d0c6700 1 -- 172.21.15.146:0/2971765053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f08135f10 msgr2=0x7f9f081382f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.922+0000 7f9f0d0c6700 1 --2- 172.21.15.146:0/2971765053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f08135f10 0x7f9f081382f0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009d90 tx=0x7f9f0000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:39.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.922+0000 7f9f0d0c6700 1 -- 172.21.15.146:0/2971765053 shutdown_connections 2023-10-03T10:17:39.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.922+0000 7f9f0d0c6700 1 --2- 172.21.15.146:0/2971765053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f08135f10 0x7f9f081382f0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.922+0000 7f9f0d0c6700 1 --2- 172.21.15.146:0/2971765053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f081335f0 0x7f9f081359d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.922+0000 7f9f0d0c6700 1 -- 172.21.15.146:0/2971765053 >> 172.21.15.146:0/2971765053 conn(0x7f9f080a2980 msgr2=0x7f9f080a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.922+0000 7f9f0d0c6700 1 -- 172.21.15.146:0/2971765053 shutdown_connections 2023-10-03T10:17:39.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.922+0000 7f9f0d0c6700 1 -- 172.21.15.146:0/2971765053 wait complete. 2023-10-03T10:17:39.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.924+0000 7f9f0d0c6700 1 Processor -- start 2023-10-03T10:17:39.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.924+0000 7f9f0d0c6700 1 -- start start 2023-10-03T10:17:39.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.924+0000 7f9f0d0c6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f0812d380 0x7f9f081c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.924+0000 7f9f0d0c6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f081335f0 0x7f9f081c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.924+0000 7f9f0d0c6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f08135f10 0x7f9f081c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.924+0000 7f9f0d0c6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f08071880 con 0x7f9f081335f0 2023-10-03T10:17:39.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.924+0000 7f9f0d0c6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f080a1450 con 0x7f9f08135f10 2023-10-03T10:17:39.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.924+0000 7f9f0d0c6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f08133ce0 con 0x7f9f0812d380 2023-10-03T10:17:39.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.924+0000 7f9f0759e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f08135f10 0x7f9f081c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.924+0000 7f9f06d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f0812d380 0x7f9f081c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.924+0000 7f9f0659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f081335f0 0x7f9f081c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.924+0000 7f9f06d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f0812d380 0x7f9f081c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:48898/0 (socket says 172.21.15.146:48898) 2023-10-03T10:17:39.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.924+0000 7f9f0659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f081335f0 0x7f9f081c87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33256/0 (socket says 172.21.15.146:33256) 2023-10-03T10:17:39.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.924+0000 7f9f0759e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f08135f10 0x7f9f081c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56726/0 (socket says 172.21.15.146:56726) 2023-10-03T10:17:39.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.924+0000 7f9f06d9d700 1 -- 172.21.15.146:0/1774622638 learned_addr learned my addr 172.21.15.146:0/1774622638 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:39.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.925+0000 7f9f06d9d700 1 -- 172.21.15.146:0/1774622638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f08135f10 msgr2=0x7f9f081c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.925+0000 7f9f06d9d700 1 --2- 172.21.15.146:0/1774622638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f08135f10 0x7f9f081c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.925+0000 7f9f06d9d700 1 -- 172.21.15.146:0/1774622638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f081335f0 msgr2=0x7f9f081c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.925+0000 7f9f06d9d700 1 --2- 172.21.15.146:0/1774622638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f081335f0 0x7f9f081c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.925+0000 7f9f06d9d700 1 -- 172.21.15.146:0/1774622638 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f00009a70 con 0x7f9f0812d380 2023-10-03T10:17:39.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.925+0000 7f9f0659c700 1 --2- 172.21.15.146:0/1774622638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f081335f0 0x7f9f081c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:39.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.925+0000 7f9f06d9d700 1 --2- 172.21.15.146:0/1774622638 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f0812d380 0x7f9f081c82a0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800c430 tx=0x7f9ef800c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.925+0000 7f9eef7fe700 1 -- 172.21.15.146:0/1774622638 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef80054e0 con 0x7f9f0812d380 2023-10-03T10:17:39.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.925+0000 7f9eef7fe700 1 -- 172.21.15.146:0/1774622638 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef800ce40 con 0x7f9f0812d380 2023-10-03T10:17:39.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.925+0000 7f9f0d0c6700 1 -- 172.21.15.146:0/1774622638 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0809b3e0 con 0x7f9f0812d380 2023-10-03T10:17:39.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.925+0000 7f9eef7fe700 1 -- 172.21.15.146:0/1774622638 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef80038c0 con 0x7f9f0812d380 2023-10-03T10:17:39.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.925+0000 7f9f0d0c6700 1 -- 172.21.15.146:0/1774622638 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f080a0c50 con 0x7f9f0812d380 2023-10-03T10:17:39.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.926+0000 7f9eef7fe700 1 -- 172.21.15.146:0/1774622638 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ef8003a20 con 0x7f9f0812d380 2023-10-03T10:17:39.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.926+0000 7f9f0d0c6700 1 -- 172.21.15.146:0/1774622638 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0804f2a0 con 0x7f9f0812d380 2023-10-03T10:17:39.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.926+0000 7f9eef7fe700 1 -- 172.21.15.146:0/1774622638 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9ef803ea50 con 0x7f9f0812d380 2023-10-03T10:17:39.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:39.931+0000 7f9eef7fe700 1 -- 172.21.15.146:0/1774622638 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ef8019b40 con 0x7f9f0812d380 2023-10-03T10:17:39.991 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:40.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.028+0000 7fa565cde700 1 Processor -- start 2023-10-03T10:17:40.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.028+0000 7fa565cde700 1 -- start start 2023-10-03T10:17:40.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.029+0000 7fa565cde700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa56009d860 0x7fa56009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.029+0000 7fa565cde700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa56009e170 0x7fa5601307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.029+0000 7fa565cde700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa560130ce0 0x7fa560131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.029+0000 7fa565cde700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56009aaa0 con 0x7fa56009e170 2023-10-03T10:17:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.029+0000 7fa565cde700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56009f870 con 0x7fa560130ce0 2023-10-03T10:17:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.029+0000 7fa565cde700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa56009b360 con 0x7fa56009d860 2023-10-03T10:17:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.029+0000 7fa55effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa56009e170 0x7fa5601307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.029+0000 7fa55f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa56009d860 0x7fa56009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.029+0000 7fa55effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa56009e170 0x7fa5601307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33272/0 (socket says 172.21.15.146:33272) 2023-10-03T10:17:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.029+0000 7fa55ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa560130ce0 0x7fa560131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.029+0000 7fa55effd700 1 -- 172.21.15.146:0/3775782093 learned_addr learned my addr 172.21.15.146:0/3775782093 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.029+0000 7fa55f7fe700 1 -- 172.21.15.146:0/3775782093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa560130ce0 msgr2=0x7fa560131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.029+0000 7fa55f7fe700 1 --2- 172.21.15.146:0/3775782093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa560130ce0 0x7fa560131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.029+0000 7fa55f7fe700 1 -- 172.21.15.146:0/3775782093 >> v2:172.21.15.146:3300/0 conn(0x7fa56009e170 msgr2=0x7fa5601307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.029+0000 7fa55f7fe700 1 --2- 172.21.15.146:0/3775782093 >> v2:172.21.15.146:3300/0 conn(0x7fa56009e170 0x7fa5601307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.029+0000 7fa55f7fe700 1 -- 172.21.15.146:0/3775782093 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56009b620 con 0x7fa56009d860 2023-10-03T10:17:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.029+0000 7fa55effd700 1 --2- 172.21.15.146:0/3775782093 >> v2:172.21.15.146:3300/0 conn(0x7fa56009e170 0x7fa5601307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.029+0000 7fa55f7fe700 1 --2- 172.21.15.146:0/3775782093 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa56009d860 0x7fa56009dc30 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa55000bb10 tx=0x7fa55000be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c20f87600ac6994c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.030+0000 7fa55e7fc700 1 -- 172.21.15.146:0/3775782093 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55000dc30 con 0x7fa56009d860 2023-10-03T10:17:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.030+0000 7fa55e7fc700 1 -- 172.21.15.146:0/3775782093 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55000dd90 con 0x7fa56009d860 2023-10-03T10:17:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.030+0000 7fa55e7fc700 1 -- 172.21.15.146:0/3775782093 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa550012990 con 0x7fa56009d860 2023-10-03T10:17:40.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.030+0000 7fa565cde700 1 -- 172.21.15.146:0/3775782093 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa56009d860 msgr2=0x7fa56009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.030+0000 7fa565cde700 1 --2- 172.21.15.146:0/3775782093 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa56009d860 0x7fa56009dc30 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa55000bb10 tx=0x7fa55000be20 comp rx=0 tx=0).stop 2023-10-03T10:17:40.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.031+0000 7fa565cde700 1 -- 172.21.15.146:0/3775782093 shutdown_connections 2023-10-03T10:17:40.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.031+0000 7fa565cde700 1 --2- 172.21.15.146:0/3775782093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa560130ce0 0x7fa560131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.031+0000 7fa565cde700 1 --2- 172.21.15.146:0/3775782093 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa56009d860 0x7fa56009dc30 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.031+0000 7fa565cde700 1 --2- 172.21.15.146:0/3775782093 >> v2:172.21.15.146:3300/0 conn(0x7fa56009e170 0x7fa5601307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.031+0000 7fa565cde700 1 -- 172.21.15.146:0/3775782093 >> 172.21.15.146:0/3775782093 conn(0x7fa560099c40 msgr2=0x7fa5600a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.031+0000 7fa565cde700 1 -- 172.21.15.146:0/3775782093 shutdown_connections 2023-10-03T10:17:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.031+0000 7fa565cde700 1 -- 172.21.15.146:0/3775782093 wait complete. 2023-10-03T10:17:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.032+0000 7fa565cde700 1 Processor -- start 2023-10-03T10:17:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.032+0000 7fa565cde700 1 -- start start 2023-10-03T10:17:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.033+0000 7fa565cde700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa56009d860 0x7fa56011dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.033+0000 7fa565cde700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa56009e170 0x7fa56011e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.033+0000 7fa565cde700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa560130ce0 0x7fa56011ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.033+0000 7fa565cde700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56011fb30 con 0x7fa56009e170 2023-10-03T10:17:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.033+0000 7fa565cde700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56009c8b0 con 0x7fa560130ce0 2023-10-03T10:17:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.033+0000 7fa565cde700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa560121760 con 0x7fa56009d860 2023-10-03T10:17:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.033+0000 7fa55ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa560130ce0 0x7fa56011ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.033+0000 7fa55effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa56009e170 0x7fa56011e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.033+0000 7fa55ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa560130ce0 0x7fa56011ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56744/0 (socket says 172.21.15.146:56744) 2023-10-03T10:17:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.033+0000 7fa55effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa56009e170 0x7fa56011e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33286/0 (socket says 172.21.15.146:33286) 2023-10-03T10:17:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.033+0000 7fa55f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa56009d860 0x7fa56011dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.033+0000 7fa55ffff700 1 -- 172.21.15.146:0/3452817353 learned_addr learned my addr 172.21.15.146:0/3452817353 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.033+0000 7fa55ffff700 1 -- 172.21.15.146:0/3452817353 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa56009d860 msgr2=0x7fa56011dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.033+0000 7fa55ffff700 1 --2- 172.21.15.146:0/3452817353 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa56009d860 0x7fa56011dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.033+0000 7fa55ffff700 1 -- 172.21.15.146:0/3452817353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa56009e170 msgr2=0x7fa56011e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.033+0000 7fa55ffff700 1 --2- 172.21.15.146:0/3452817353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa56009e170 0x7fa56011e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.033+0000 7fa55ffff700 1 -- 172.21.15.146:0/3452817353 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa554009550 con 0x7fa560130ce0 2023-10-03T10:17:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.033+0000 7fa55effd700 1 --2- 172.21.15.146:0/3452817353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa56009e170 0x7fa56011e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.034+0000 7fa55ffff700 1 --2- 172.21.15.146:0/3452817353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa560130ce0 0x7fa56011ea70 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fa55800efc0 tx=0x7fa55800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.034+0000 7fa547fff700 1 -- 172.21.15.146:0/3452817353 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa558009ea0 con 0x7fa560130ce0 2023-10-03T10:17:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.034+0000 7fa547fff700 1 -- 172.21.15.146:0/3452817353 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55800f040 con 0x7fa560130ce0 2023-10-03T10:17:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.034+0000 7fa565cde700 1 -- 172.21.15.146:0/3452817353 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa55000b740 con 0x7fa560130ce0 2023-10-03T10:17:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.034+0000 7fa547fff700 1 -- 172.21.15.146:0/3452817353 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55800ced0 con 0x7fa560130ce0 2023-10-03T10:17:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.034+0000 7fa565cde700 1 -- 172.21.15.146:0/3452817353 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa560120d80 con 0x7fa560130ce0 2023-10-03T10:17:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.035+0000 7fa547fff700 1 -- 172.21.15.146:0/3452817353 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa558014480 con 0x7fa560130ce0 2023-10-03T10:17:40.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.035+0000 7fa547fff700 1 -- 172.21.15.146:0/3452817353 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa55803fe50 con 0x7fa560130ce0 2023-10-03T10:17:40.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.035+0000 7fa565cde700 1 -- 172.21.15.146:0/3452817353 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56011add0 con 0x7fa560130ce0 2023-10-03T10:17:40.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.040+0000 7fa547fff700 1 -- 172.21.15.146:0/3452817353 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa558018020 con 0x7fa560130ce0 2023-10-03T10:17:40.047 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:40.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.120+0000 7fccaa2b4700 1 Processor -- start 2023-10-03T10:17:40.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.120+0000 7fccaa2b4700 1 -- start start 2023-10-03T10:17:40.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.120+0000 7fccaa2b4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcca409e950 0x7fcca409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.120+0000 7fccaa2b4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcca409f260 0x7fcca4131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.120+0000 7fccaa2b4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca409afb0 con 0x7fcca4131dd0 2023-10-03T10:17:40.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.120+0000 7fccaa2b4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca40a0970 con 0x7fcca409e950 2023-10-03T10:17:40.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.120+0000 7fccaa2b4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca40a0320 con 0x7fcca409f260 2023-10-03T10:17:40.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.120+0000 7fcca8851700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcca4131dd0 0x7fcca4138ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45058/0 (socket says 172.21.15.146:45058) 2023-10-03T10:17:40.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.121+0000 7fcca8851700 1 -- 172.21.15.146:0/2439836949 learned_addr learned my addr 172.21.15.146:0/2439836949 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:40.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.121+0000 7fcca3fff700 1 --2- 172.21.15.146:0/2439836949 >> v2:172.21.15.146:3300/0 conn(0x7fcca409e950 0x7fcca409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.121+0000 7fcca37fe700 1 --2- 172.21.15.146:0/2439836949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcca409f260 0x7fcca4131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.121+0000 7fcca2ffd700 1 -- 172.21.15.146:0/2439836949 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668230109 0 0) 0x7fcca409afb0 con 0x7fcca4131dd0 2023-10-03T10:17:40.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.121+0000 7fcca2ffd700 1 -- 172.21.15.146:0/2439836949 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc8c0035b0 con 0x7fcca4131dd0 2023-10-03T10:17:40.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.121+0000 7fcca3fff700 1 -- 172.21.15.146:0/2439836949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcca409f260 msgr2=0x7fcca4131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:40.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.121+0000 7fcca3fff700 1 --2- 172.21.15.146:0/2439836949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcca409f260 0x7fcca4131890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.121+0000 7fcca3fff700 1 -- 172.21.15.146:0/2439836949 >> v1:172.21.15.146:6789/0 conn(0x7fcca4131dd0 legacy=0x7fcca4138ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.121+0000 7fcca3fff700 1 -- 172.21.15.146:0/2439836949 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca40a0750 con 0x7fcca409e950 2023-10-03T10:17:40.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.121+0000 7fcca37fe700 1 --2- 172.21.15.146:0/2439836949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcca409f260 0x7fcca4131890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:40.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.121+0000 7fcca3fff700 1 --2- 172.21.15.146:0/2439836949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcca409e950 0x7fcca409ed20 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009820 tx=0x7fcc94009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720560b6360cd3cf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.121+0000 7fcca2ffd700 1 -- 172.21.15.146:0/2439836949 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc94005e30 con 0x7fcca409e950 2023-10-03T10:17:40.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.121+0000 7fcca2ffd700 1 -- 172.21.15.146:0/2439836949 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc94006030 con 0x7fcca409e950 2023-10-03T10:17:40.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.121+0000 7fcca2ffd700 1 -- 172.21.15.146:0/2439836949 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc940063c0 con 0x7fcca409e950 2023-10-03T10:17:40.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.122+0000 7fccaa2b4700 1 -- 172.21.15.146:0/2439836949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcca409e950 msgr2=0x7fcca409ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.122+0000 7fccaa2b4700 1 --2- 172.21.15.146:0/2439836949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcca409e950 0x7fcca409ed20 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009820 tx=0x7fcc94009b30 comp rx=0 tx=0).stop 2023-10-03T10:17:40.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.122+0000 7fccaa2b4700 1 -- 172.21.15.146:0/2439836949 shutdown_connections 2023-10-03T10:17:40.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.122+0000 7fccaa2b4700 1 --2- 172.21.15.146:0/2439836949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcca409e950 0x7fcca409ed20 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.122+0000 7fccaa2b4700 1 --2- 172.21.15.146:0/2439836949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcca409f260 0x7fcca4131890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.122+0000 7fccaa2b4700 1 -- 172.21.15.146:0/2439836949 >> 172.21.15.146:0/2439836949 conn(0x7fcca40a0f70 msgr2=0x7fcca40a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.122+0000 7fccaa2b4700 1 -- 172.21.15.146:0/2439836949 shutdown_connections 2023-10-03T10:17:40.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.122+0000 7fccaa2b4700 1 -- 172.21.15.146:0/2439836949 wait complete. 2023-10-03T10:17:40.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.123+0000 7fccaa2b4700 1 Processor -- start 2023-10-03T10:17:40.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.123+0000 7fccaa2b4700 1 -- start start 2023-10-03T10:17:40.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.124+0000 7fccaa2b4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcca409e950 0x7fcca4120930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.124+0000 7fccaa2b4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcca409f260 0x7fcca4120e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.124+0000 7fccaa2b4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcca4131dd0 0x7fcca41213b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.124+0000 7fccaa2b4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca4123f50 con 0x7fcca409f260 2023-10-03T10:17:40.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.124+0000 7fccaa2b4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca4121e00 con 0x7fcca4131dd0 2023-10-03T10:17:40.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.124+0000 7fccaa2b4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcca409da40 con 0x7fcca409e950 2023-10-03T10:17:40.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.124+0000 7fcca3fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcca409e950 0x7fcca4120930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.124+0000 7fcca3fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcca409e950 0x7fcca4120930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:48938/0 (socket says 172.21.15.146:48938) 2023-10-03T10:17:40.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.124+0000 7fcca3fff700 1 -- 172.21.15.146:0/3095127832 learned_addr learned my addr 172.21.15.146:0/3095127832 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:40.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.124+0000 7fcca37fe700 1 --2- 172.21.15.146:0/3095127832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcca409f260 0x7fcca4120e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.124+0000 7fcca8851700 1 --2- 172.21.15.146:0/3095127832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcca4131dd0 0x7fcca41213b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.124+0000 7fcca37fe700 1 -- 172.21.15.146:0/3095127832 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcca409e950 msgr2=0x7fcca4120930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.124+0000 7fcca37fe700 1 --2- 172.21.15.146:0/3095127832 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcca409e950 0x7fcca4120930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.124+0000 7fcca37fe700 1 -- 172.21.15.146:0/3095127832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcca4131dd0 msgr2=0x7fcca41213b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.124+0000 7fcca37fe700 1 --2- 172.21.15.146:0/3095127832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcca4131dd0 0x7fcca41213b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.124+0000 7fcca37fe700 1 -- 172.21.15.146:0/3095127832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc980094a0 con 0x7fcca409f260 2023-10-03T10:17:40.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.124+0000 7fcca37fe700 1 --2- 172.21.15.146:0/3095127832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcca409f260 0x7fcca4120e70 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800e9b0 tx=0x7fcc9800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.124+0000 7fcca0ff9700 1 -- 172.21.15.146:0/3095127832 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9800c850 con 0x7fcca409f260 2023-10-03T10:17:40.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.125+0000 7fcca0ff9700 1 -- 172.21.15.146:0/3095127832 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9800c9b0 con 0x7fcca409f260 2023-10-03T10:17:40.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.125+0000 7fccaa2b4700 1 -- 172.21.15.146:0/3095127832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc94009430 con 0x7fcca409f260 2023-10-03T10:17:40.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.125+0000 7fcca0ff9700 1 -- 172.21.15.146:0/3095127832 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9800cd40 con 0x7fcca409f260 2023-10-03T10:17:40.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.125+0000 7fccaa2b4700 1 -- 172.21.15.146:0/3095127832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca4123b90 con 0x7fcca409f260 2023-10-03T10:17:40.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.126+0000 7fcca0ff9700 1 -- 172.21.15.146:0/3095127832 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcc98013470 con 0x7fcca409f260 2023-10-03T10:17:40.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.126+0000 7fccaa2b4700 1 -- 172.21.15.146:0/3095127832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca404f2a0 con 0x7fcca409f260 2023-10-03T10:17:40.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.126+0000 7fcca0ff9700 1 -- 172.21.15.146:0/3095127832 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcc9803f470 con 0x7fcca409f260 2023-10-03T10:17:40.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.130+0000 7fcca0ff9700 1 -- 172.21.15.146:0/3095127832 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcc98021080 con 0x7fcca409f260 2023-10-03T10:17:40.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.174+0000 7f90ee795700 1 Processor -- start 2023-10-03T10:17:40.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.174+0000 7f90ee795700 1 -- start start 2023-10-03T10:17:40.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.175+0000 7f90ee795700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90e8133ad0 0x7f90e8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.175+0000 7f90ee795700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f90e8130bc0 0x7f90e813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.175+0000 7f90ee795700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e806b2d0 con 0x7f90e81300a0 2023-10-03T10:17:40.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.175+0000 7f90ee795700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e8133610 con 0x7f90e8130bc0 2023-10-03T10:17:40.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.175+0000 7f90ee795700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90e809a500 con 0x7f90e8133ad0 2023-10-03T10:17:40.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.175+0000 7f90e7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90e8133ad0 0x7f90e8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.175+0000 7f90e7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90e8133ad0 0x7f90e8133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:48952/0 (socket says 172.21.15.146:48952) 2023-10-03T10:17:40.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.175+0000 7f90e7fff700 1 -- 172.21.15.146:0/3373471563 learned_addr learned my addr 172.21.15.146:0/3373471563 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:40.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.175+0000 7f90e77fe700 1 --1- 172.21.15.146:0/3373471563 >> v1:172.21.15.146:6789/0 conn(0x7f90e81300a0 0x7f90e81304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45066/0 (socket says 172.21.15.146:45066) 2023-10-03T10:17:40.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.175+0000 7f90ecd32700 1 --2- 172.21.15.146:0/3373471563 >> v2:172.21.15.146:3300/0 conn(0x7f90e8130bc0 0x7f90e813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.175+0000 7f90e7fff700 1 -- 172.21.15.146:0/3373471563 >> v2:172.21.15.146:3300/0 conn(0x7f90e8130bc0 msgr2=0x7f90e813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:40.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.175+0000 7f90e7fff700 1 --2- 172.21.15.146:0/3373471563 >> v2:172.21.15.146:3300/0 conn(0x7f90e8130bc0 0x7f90e813b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.175+0000 7f90e7fff700 1 -- 172.21.15.146:0/3373471563 >> v1:172.21.15.146:6789/0 conn(0x7f90e81300a0 legacy=0x7f90e81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.175+0000 7f90e6ffd700 1 -- 172.21.15.146:0/3373471563 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110496674 0 0) 0x7f90e806b2d0 con 0x7f90e81300a0 2023-10-03T10:17:40.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.175+0000 7f90e7fff700 1 -- 172.21.15.146:0/3373471563 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e81338b0 con 0x7f90e8133ad0 2023-10-03T10:17:40.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.175+0000 7f90ecd32700 1 --2- 172.21.15.146:0/3373471563 >> v2:172.21.15.146:3300/0 conn(0x7f90e8130bc0 0x7f90e813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:40.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.176+0000 7f90e7fff700 1 --2- 172.21.15.146:0/3373471563 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90e8133ad0 0x7f90e8133ea0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f90d80098f0 tx=0x7f90d8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6aa7400cea20e067 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.176+0000 7f90e6ffd700 1 -- 172.21.15.146:0/3373471563 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d8011830 con 0x7f90e8133ad0 2023-10-03T10:17:40.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.176+0000 7f90e6ffd700 1 -- 172.21.15.146:0/3373471563 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d8011990 con 0x7f90e8133ad0 2023-10-03T10:17:40.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.176+0000 7f90e6ffd700 1 -- 172.21.15.146:0/3373471563 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d8011d20 con 0x7f90e8133ad0 2023-10-03T10:17:40.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.176+0000 7f90ee795700 1 -- 172.21.15.146:0/3373471563 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90e8133ad0 msgr2=0x7f90e8133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.176+0000 7f90ee795700 1 --2- 172.21.15.146:0/3373471563 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90e8133ad0 0x7f90e8133ea0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f90d80098f0 tx=0x7f90d8009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:40.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.176+0000 7f90ee795700 1 -- 172.21.15.146:0/3373471563 shutdown_connections 2023-10-03T10:17:40.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.176+0000 7f90ee795700 1 --2- 172.21.15.146:0/3373471563 >> v2:172.21.15.146:3300/0 conn(0x7f90e8130bc0 0x7f90e813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.176+0000 7f90ee795700 1 --2- 172.21.15.146:0/3373471563 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90e8133ad0 0x7f90e8133ea0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.176+0000 7f90ee795700 1 -- 172.21.15.146:0/3373471563 >> 172.21.15.146:0/3373471563 conn(0x7f90e8099c40 msgr2=0x7f90e80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.176+0000 7f90ee795700 1 -- 172.21.15.146:0/3373471563 shutdown_connections 2023-10-03T10:17:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.177+0000 7f90ee795700 1 -- 172.21.15.146:0/3373471563 wait complete. 2023-10-03T10:17:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.177+0000 7f90ee795700 1 Processor -- start 2023-10-03T10:17:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.178+0000 7f90ee795700 1 -- start start 2023-10-03T10:17:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.178+0000 7f90ee795700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90e81300a0 0x7f90e811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.178+0000 7f90ee795700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90e8130bc0 0x7f90e811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.178+0000 7f90ee795700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90e8133ad0 0x7f90e811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.178+0000 7f90ee795700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e8120050 con 0x7f90e8130bc0 2023-10-03T10:17:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.178+0000 7f90ee795700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e81209c0 con 0x7f90e81300a0 2023-10-03T10:17:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.178+0000 7f90ee795700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90e8071fd0 con 0x7f90e8133ad0 2023-10-03T10:17:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.178+0000 7f90e77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90e8130bc0 0x7f90e811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.178+0000 7f90e7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90e81300a0 0x7f90e811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.178+0000 7f90ecd32700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90e8133ad0 0x7f90e811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.178+0000 7f90e77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90e8130bc0 0x7f90e811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33322/0 (socket says 172.21.15.146:33322) 2023-10-03T10:17:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.178+0000 7f90e77fe700 1 -- 172.21.15.146:0/2397695596 learned_addr learned my addr 172.21.15.146:0/2397695596 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.178+0000 7f90e7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90e81300a0 0x7f90e811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56762/0 (socket says 172.21.15.146:56762) 2023-10-03T10:17:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.179+0000 7f90ecd32700 1 -- 172.21.15.146:0/2397695596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90e81300a0 msgr2=0x7f90e811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.179+0000 7f90ecd32700 1 --2- 172.21.15.146:0/2397695596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90e81300a0 0x7f90e811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.179+0000 7f90ecd32700 1 -- 172.21.15.146:0/2397695596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90e8130bc0 msgr2=0x7f90e811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.179+0000 7f90ecd32700 1 --2- 172.21.15.146:0/2397695596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90e8130bc0 0x7f90e811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.179+0000 7f90ecd32700 1 -- 172.21.15.146:0/2397695596 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e0009a70 con 0x7f90e8133ad0 2023-10-03T10:17:40.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.179+0000 7f90e7fff700 1 --2- 172.21.15.146:0/2397695596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90e81300a0 0x7f90e811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:40.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.179+0000 7f90ecd32700 1 --2- 172.21.15.146:0/2397695596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90e8133ad0 0x7f90e811e4c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f90e000efc0 tx=0x7f90e000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.179+0000 7f90e4ff9700 1 -- 172.21.15.146:0/2397695596 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e000ca90 con 0x7f90e8133ad0 2023-10-03T10:17:40.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.179+0000 7f90e4ff9700 1 -- 172.21.15.146:0/2397695596 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e000f040 con 0x7f90e8133ad0 2023-10-03T10:17:40.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.179+0000 7f90ee795700 1 -- 172.21.15.146:0/2397695596 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d8009550 con 0x7f90e8133ad0 2023-10-03T10:17:40.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.179+0000 7f90e4ff9700 1 -- 172.21.15.146:0/2397695596 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e000ce30 con 0x7f90e8133ad0 2023-10-03T10:17:40.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.179+0000 7f90ee795700 1 -- 172.21.15.146:0/2397695596 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e80a34b0 con 0x7f90e8133ad0 2023-10-03T10:17:40.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.180+0000 7f90e4ff9700 1 -- 172.21.15.146:0/2397695596 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f90e0014480 con 0x7f90e8133ad0 2023-10-03T10:17:40.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.180+0000 7f90ee795700 1 -- 172.21.15.146:0/2397695596 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e811fa10 con 0x7f90e8133ad0 2023-10-03T10:17:40.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.180+0000 7f90e4ff9700 1 -- 172.21.15.146:0/2397695596 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f90e0014730 con 0x7f90e8133ad0 2023-10-03T10:17:40.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.189+0000 7f90e4ff9700 1 -- 172.21.15.146:0/2397695596 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f90e811fa10 con 0x7f90e8133ad0 2023-10-03T10:17:40.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.228+0000 7f9f0d0c6700 1 -- 172.21.15.146:0/1774622638 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9f08071490 con 0x7f9f0812d380 2023-10-03T10:17:40.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.228+0000 7f9eef7fe700 1 -- 172.21.15.146:0/1774622638 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f08071490 con 0x7f9f0812d380 2023-10-03T10:17:40.229 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:40.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.230+0000 7f9f0d0c6700 1 -- 172.21.15.146:0/1774622638 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f0812d380 msgr2=0x7f9f081c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.230+0000 7f9f0d0c6700 1 --2- 172.21.15.146:0/1774622638 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f0812d380 0x7f9f081c82a0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800c430 tx=0x7f9ef800c740 comp rx=0 tx=0).stop 2023-10-03T10:17:40.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.231+0000 7f9f0d0c6700 1 -- 172.21.15.146:0/1774622638 shutdown_connections 2023-10-03T10:17:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.231+0000 7f9f0d0c6700 1 --2- 172.21.15.146:0/1774622638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f08135f10 0x7f9f081c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.231+0000 7f9f0d0c6700 1 --2- 172.21.15.146:0/1774622638 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f0812d380 0x7f9f081c82a0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.231+0000 7f9f0d0c6700 1 --2- 172.21.15.146:0/1774622638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f081335f0 0x7f9f081c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.231+0000 7f9f0d0c6700 1 -- 172.21.15.146:0/1774622638 >> 172.21.15.146:0/1774622638 conn(0x7f9f080a2980 msgr2=0x7f9f0812c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.231+0000 7f9f0d0c6700 1 -- 172.21.15.146:0/1774622638 shutdown_connections 2023-10-03T10:17:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.231+0000 7f9f0d0c6700 1 -- 172.21.15.146:0/1774622638 wait complete. 2023-10-03T10:17:40.244 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:40.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.327+0000 7fa565cde700 1 -- 172.21.15.146:0/3452817353 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa56004f2a0 con 0x7fa560130ce0 2023-10-03T10:17:40.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.327+0000 7fa547fff700 1 -- 172.21.15.146:0/3452817353 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa55801a680 con 0x7fa560130ce0 2023-10-03T10:17:40.328 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:40.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.329+0000 7fa565cde700 1 -- 172.21.15.146:0/3452817353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa560130ce0 msgr2=0x7fa56011ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.329+0000 7fa565cde700 1 --2- 172.21.15.146:0/3452817353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa560130ce0 0x7fa56011ea70 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fa55800efc0 tx=0x7fa55800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.329+0000 7fa565cde700 1 -- 172.21.15.146:0/3452817353 shutdown_connections 2023-10-03T10:17:40.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.329+0000 7fa565cde700 1 --2- 172.21.15.146:0/3452817353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa560130ce0 0x7fa56011ea70 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.329+0000 7fa565cde700 1 --2- 172.21.15.146:0/3452817353 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa56009d860 0x7fa56011dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.329+0000 7fa565cde700 1 --2- 172.21.15.146:0/3452817353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa56009e170 0x7fa56011e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.329+0000 7fa565cde700 1 -- 172.21.15.146:0/3452817353 >> 172.21.15.146:0/3452817353 conn(0x7fa560099c40 msgr2=0x7fa560071240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.329+0000 7fa565cde700 1 -- 172.21.15.146:0/3452817353 shutdown_connections 2023-10-03T10:17:40.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.329+0000 7fa565cde700 1 -- 172.21.15.146:0/3452817353 wait complete. 2023-10-03T10:17:40.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.329+0000 7fccaa2b4700 1 -- 172.21.15.146:0/3095127832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcca41317a0 con 0x7fcca409f260 2023-10-03T10:17:40.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.330+0000 7fcca0ff9700 1 -- 172.21.15.146:0/3095127832 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcc980102b0 con 0x7fcca409f260 2023-10-03T10:17:40.331 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:40.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.332+0000 7fccaa2b4700 1 -- 172.21.15.146:0/3095127832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcca409f260 msgr2=0x7fcca4120e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.332+0000 7fccaa2b4700 1 --2- 172.21.15.146:0/3095127832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcca409f260 0x7fcca4120e70 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800e9b0 tx=0x7fcc9800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.332+0000 7fccaa2b4700 1 -- 172.21.15.146:0/3095127832 shutdown_connections 2023-10-03T10:17:40.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.332+0000 7fccaa2b4700 1 --2- 172.21.15.146:0/3095127832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcca4131dd0 0x7fcca41213b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.332+0000 7fccaa2b4700 1 --2- 172.21.15.146:0/3095127832 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcca409e950 0x7fcca4120930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.332+0000 7fccaa2b4700 1 --2- 172.21.15.146:0/3095127832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcca409f260 0x7fcca4120e70 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.332+0000 7fccaa2b4700 1 -- 172.21.15.146:0/3095127832 >> 172.21.15.146:0/3095127832 conn(0x7fcca40a0f70 msgr2=0x7fcca411a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.332+0000 7fccaa2b4700 1 -- 172.21.15.146:0/3095127832 shutdown_connections 2023-10-03T10:17:40.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.332+0000 7fccaa2b4700 1 -- 172.21.15.146:0/3095127832 wait complete. 2023-10-03T10:17:40.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:40.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:40.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.383+0000 7f90ee795700 1 -- 172.21.15.146:0/2397695596 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f90e811fa10 con 0x7f90e8133ad0 2023-10-03T10:17:40.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.383+0000 7f90e4ff9700 1 -- 172.21.15.146:0/2397695596 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f90e811fa10 con 0x7f90e8133ad0 2023-10-03T10:17:40.384 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:40.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.385+0000 7f90ee795700 1 -- 172.21.15.146:0/2397695596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90e8133ad0 msgr2=0x7f90e811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.385+0000 7f90ee795700 1 --2- 172.21.15.146:0/2397695596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90e8133ad0 0x7f90e811e4c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f90e000efc0 tx=0x7f90e000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.385+0000 7f90ee795700 1 -- 172.21.15.146:0/2397695596 shutdown_connections 2023-10-03T10:17:40.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.385+0000 7f90ee795700 1 --2- 172.21.15.146:0/2397695596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90e8133ad0 0x7f90e811e4c0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.385+0000 7f90ee795700 1 --2- 172.21.15.146:0/2397695596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90e81300a0 0x7f90e811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.385+0000 7f90ee795700 1 --2- 172.21.15.146:0/2397695596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90e8130bc0 0x7f90e811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.385+0000 7f90ee795700 1 -- 172.21.15.146:0/2397695596 >> 172.21.15.146:0/2397695596 conn(0x7f90e8099c40 msgr2=0x7f90e812f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.385+0000 7f90ee795700 1 -- 172.21.15.146:0/2397695596 shutdown_connections 2023-10-03T10:17:40.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:40.385+0000 7f90ee795700 1 -- 172.21.15.146:0/2397695596 wait complete. 2023-10-03T10:17:40.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:41.245 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:41.345 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:41.346 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:41.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.388+0000 7f5da8945700 1 Processor -- start 2023-10-03T10:17:41.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.388+0000 7f5da8945700 1 -- start start 2023-10-03T10:17:41.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.389+0000 7f5da8945700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5da4133ad0 0x7f5da4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.389+0000 7f5da8945700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5da41300a0 0x7f5da41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.389+0000 7f5da8945700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5da41309f0 0x7f5da413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.389+0000 7f5da8945700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da406b2d0 con 0x7f5da41309f0 2023-10-03T10:17:41.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.389+0000 7f5da8945700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da4133610 con 0x7f5da41300a0 2023-10-03T10:17:41.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.389+0000 7f5da8945700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5da409a500 con 0x7f5da4133ad0 2023-10-03T10:17:41.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.390+0000 7f5da1d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5da41300a0 0x7f5da41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.390+0000 7f5da259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5da4133ad0 0x7f5da4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.390+0000 7f5da1d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5da41300a0 0x7f5da41304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56776/0 (socket says 172.21.15.146:56776) 2023-10-03T10:17:41.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.390+0000 7f5da1d9b700 1 -- 172.21.15.146:0/1760243649 learned_addr learned my addr 172.21.15.146:0/1760243649 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:41.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.390+0000 7f5da2d9d700 1 --2- 172.21.15.146:0/1760243649 >> v2:172.21.15.146:3300/0 conn(0x7f5da41309f0 0x7f5da413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.390+0000 7f5da1d9b700 1 -- 172.21.15.146:0/1760243649 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5da4133ad0 msgr2=0x7f5da4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:41.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.390+0000 7f5da1d9b700 1 --2- 172.21.15.146:0/1760243649 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5da4133ad0 0x7f5da4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.390+0000 7f5da1d9b700 1 -- 172.21.15.146:0/1760243649 >> v2:172.21.15.146:3300/0 conn(0x7f5da41309f0 msgr2=0x7f5da413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:41.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.390+0000 7f5da1d9b700 1 --2- 172.21.15.146:0/1760243649 >> v2:172.21.15.146:3300/0 conn(0x7f5da41309f0 0x7f5da413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.390+0000 7f5da1d9b700 1 -- 172.21.15.146:0/1760243649 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da41338b0 con 0x7f5da41300a0 2023-10-03T10:17:41.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.390+0000 7f5da259c700 1 --2- 172.21.15.146:0/1760243649 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5da4133ad0 0x7f5da4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:41.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.390+0000 7f5da2d9d700 1 --2- 172.21.15.146:0/1760243649 >> v2:172.21.15.146:3300/0 conn(0x7f5da41309f0 0x7f5da413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:41.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.390+0000 7f5da1d9b700 1 --2- 172.21.15.146:0/1760243649 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5da41300a0 0x7f5da41304b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5d980098f0 tx=0x7f5d98009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3af448f00c2ba05 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.390+0000 7f5da159a700 1 -- 172.21.15.146:0/1760243649 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d98011830 con 0x7f5da41300a0 2023-10-03T10:17:41.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.390+0000 7f5da159a700 1 -- 172.21.15.146:0/1760243649 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d98011990 con 0x7f5da41300a0 2023-10-03T10:17:41.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.390+0000 7f5da159a700 1 -- 172.21.15.146:0/1760243649 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d98011d20 con 0x7f5da41300a0 2023-10-03T10:17:41.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.391+0000 7f5da8945700 1 -- 172.21.15.146:0/1760243649 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5da41300a0 msgr2=0x7f5da41304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.391+0000 7f5da8945700 1 --2- 172.21.15.146:0/1760243649 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5da41300a0 0x7f5da41304b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5d980098f0 tx=0x7f5d98009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:41.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.392+0000 7f5da8945700 1 -- 172.21.15.146:0/1760243649 shutdown_connections 2023-10-03T10:17:41.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.392+0000 7f5da8945700 1 --2- 172.21.15.146:0/1760243649 >> v2:172.21.15.146:3300/0 conn(0x7f5da41309f0 0x7f5da413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.392+0000 7f5da8945700 1 --2- 172.21.15.146:0/1760243649 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5da4133ad0 0x7f5da4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.392+0000 7f5da8945700 1 --2- 172.21.15.146:0/1760243649 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5da41300a0 0x7f5da41304b0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.392+0000 7f5da8945700 1 -- 172.21.15.146:0/1760243649 >> 172.21.15.146:0/1760243649 conn(0x7f5da4099c40 msgr2=0x7f5da40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.392+0000 7f5da8945700 1 -- 172.21.15.146:0/1760243649 shutdown_connections 2023-10-03T10:17:41.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.392+0000 7f5da8945700 1 -- 172.21.15.146:0/1760243649 wait complete. 2023-10-03T10:17:41.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.393+0000 7f5da8945700 1 Processor -- start 2023-10-03T10:17:41.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.393+0000 7f5da8945700 1 -- start start 2023-10-03T10:17:41.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.394+0000 7f5da8945700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5da41300a0 0x7f5da411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.394+0000 7f5da8945700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5da41309f0 0x7f5da411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.394+0000 7f5da8945700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5da4133ad0 0x7f5da411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.394+0000 7f5da8945700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da411ff40 con 0x7f5da4133ad0 2023-10-03T10:17:41.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.394+0000 7f5da8945700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da4072370 con 0x7f5da41309f0 2023-10-03T10:17:41.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.394+0000 7f5da8945700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5da412dd00 con 0x7f5da41300a0 2023-10-03T10:17:41.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.394+0000 7f5da1d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5da41309f0 0x7f5da411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.394+0000 7f5da1d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5da41309f0 0x7f5da411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56780/0 (socket says 172.21.15.146:56780) 2023-10-03T10:17:41.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.394+0000 7f5da1d9b700 1 -- 172.21.15.146:0/451671958 learned_addr learned my addr 172.21.15.146:0/451671958 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:41.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.394+0000 7f5da259c700 1 --2- 172.21.15.146:0/451671958 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5da41300a0 0x7f5da411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.394+0000 7f5da2d9d700 1 --2- 172.21.15.146:0/451671958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5da4133ad0 0x7f5da411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.394+0000 7f5da259c700 1 -- 172.21.15.146:0/451671958 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5da41309f0 msgr2=0x7f5da411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.394+0000 7f5da259c700 1 --2- 172.21.15.146:0/451671958 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5da41309f0 0x7f5da411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.394+0000 7f5da259c700 1 -- 172.21.15.146:0/451671958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5da4133ad0 msgr2=0x7f5da411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.394+0000 7f5da259c700 1 --2- 172.21.15.146:0/451671958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5da4133ad0 0x7f5da411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.394+0000 7f5da259c700 1 -- 172.21.15.146:0/451671958 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9c009a70 con 0x7f5da41300a0 2023-10-03T10:17:41.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.394+0000 7f5da1d9b700 1 --2- 172.21.15.146:0/451671958 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5da41309f0 0x7f5da411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:41.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.394+0000 7f5da2d9d700 1 --2- 172.21.15.146:0/451671958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5da4133ad0 0x7f5da411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:41.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.395+0000 7f5da259c700 1 --2- 172.21.15.146:0/451671958 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5da41300a0 0x7f5da411da40 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400e9b0 tx=0x7f5d9400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.395+0000 7f5d92ffd700 1 -- 172.21.15.146:0/451671958 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9400c850 con 0x7f5da41300a0 2023-10-03T10:17:41.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.395+0000 7f5d92ffd700 1 -- 172.21.15.146:0/451671958 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9400c9b0 con 0x7f5da41300a0 2023-10-03T10:17:41.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.395+0000 7f5da8945700 1 -- 172.21.15.146:0/451671958 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d940094a0 con 0x7f5da41300a0 2023-10-03T10:17:41.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.395+0000 7f5d92ffd700 1 -- 172.21.15.146:0/451671958 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9400cd60 con 0x7f5da41300a0 2023-10-03T10:17:41.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.395+0000 7f5da8945700 1 -- 172.21.15.146:0/451671958 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d98009550 con 0x7f5da41300a0 2023-10-03T10:17:41.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.396+0000 7f5d92ffd700 1 -- 172.21.15.146:0/451671958 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5d94013470 con 0x7f5da41300a0 2023-10-03T10:17:41.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.396+0000 7f5d92ffd700 1 -- 172.21.15.146:0/451671958 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5d9403f750 con 0x7f5da41300a0 2023-10-03T10:17:41.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.396+0000 7f5da8945700 1 -- 172.21.15.146:0/451671958 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da404f2a0 con 0x7f5da41300a0 2023-10-03T10:17:41.399 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:41.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.405+0000 7f5d92ffd700 1 -- 172.21.15.146:0/451671958 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5d940232f0 con 0x7f5da41300a0 2023-10-03T10:17:41.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.481+0000 7f9bd424e700 1 Processor -- start 2023-10-03T10:17:41.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.481+0000 7f9bd424e700 1 -- start start 2023-10-03T10:17:41.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.481+0000 7f9bd424e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bcc131980 0x7f9bcc131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.481+0000 7f9bd424e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9bcc09bc70 0x7f9bcc09c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.481+0000 7f9bd424e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bcc09c5c0 0x7f9bcc138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.482+0000 7f9bd424e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bcc06eb30 con 0x7f9bcc09bc70 2023-10-03T10:17:41.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.482+0000 7f9bd424e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc0a1640 con 0x7f9bcc131980 2023-10-03T10:17:41.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.482+0000 7f9bd424e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc0a22d0 con 0x7f9bcc09c5c0 2023-10-03T10:17:41.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.482+0000 7f9bd1fea700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bcc131980 0x7f9bcc131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.482+0000 7f9bd1fea700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bcc131980 0x7f9bcc131d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56788/0 (socket says 172.21.15.146:56788) 2023-10-03T10:17:41.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.482+0000 7f9bd1fea700 1 -- 172.21.15.146:0/2586546700 learned_addr learned my addr 172.21.15.146:0/2586546700 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:41.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.482+0000 7f9bd17e9700 1 --2- 172.21.15.146:0/2586546700 >> v2:172.21.15.146:3300/0 conn(0x7f9bcc09bc70 0x7f9bcc09c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.482+0000 7f9bd27eb700 1 --2- 172.21.15.146:0/2586546700 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bcc09c5c0 0x7f9bcc138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.482+0000 7f9bd1fea700 1 -- 172.21.15.146:0/2586546700 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bcc09c5c0 msgr2=0x7f9bcc138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:41.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.482+0000 7f9bd1fea700 1 --2- 172.21.15.146:0/2586546700 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bcc09c5c0 0x7f9bcc138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.482+0000 7f9bd1fea700 1 -- 172.21.15.146:0/2586546700 >> v2:172.21.15.146:3300/0 conn(0x7f9bcc09bc70 msgr2=0x7f9bcc09c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:41.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.482+0000 7f9bd1fea700 1 --2- 172.21.15.146:0/2586546700 >> v2:172.21.15.146:3300/0 conn(0x7f9bcc09bc70 0x7f9bcc09c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.482+0000 7f9bd1fea700 1 -- 172.21.15.146:0/2586546700 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bcc131550 con 0x7f9bcc131980 2023-10-03T10:17:41.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.482+0000 7f9bd17e9700 1 --2- 172.21.15.146:0/2586546700 >> v2:172.21.15.146:3300/0 conn(0x7f9bcc09bc70 0x7f9bcc09c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:41.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.482+0000 7f9bd1fea700 1 --2- 172.21.15.146:0/2586546700 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bcc131980 0x7f9bcc131d50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8006fd0 tx=0x7f9bc8009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39aef9f5367d9fef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.482+0000 7f9bd0fe8700 1 -- 172.21.15.146:0/2586546700 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8005e30 con 0x7f9bcc131980 2023-10-03T10:17:41.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.483+0000 7f9bd0fe8700 1 -- 172.21.15.146:0/2586546700 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc8004030 con 0x7f9bcc131980 2023-10-03T10:17:41.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.483+0000 7f9bd0fe8700 1 -- 172.21.15.146:0/2586546700 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc80043e0 con 0x7f9bcc131980 2023-10-03T10:17:41.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.483+0000 7f9bd424e700 1 -- 172.21.15.146:0/2586546700 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bcc131980 msgr2=0x7f9bcc131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.483+0000 7f9bd424e700 1 --2- 172.21.15.146:0/2586546700 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bcc131980 0x7f9bcc131d50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8006fd0 tx=0x7f9bc8009bd0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.483+0000 7f9bd424e700 1 -- 172.21.15.146:0/2586546700 shutdown_connections 2023-10-03T10:17:41.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.483+0000 7f9bd424e700 1 --2- 172.21.15.146:0/2586546700 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bcc131980 0x7f9bcc131d50 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.483+0000 7f9bd424e700 1 --2- 172.21.15.146:0/2586546700 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bcc09c5c0 0x7f9bcc138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.483+0000 7f9bd424e700 1 --2- 172.21.15.146:0/2586546700 >> v2:172.21.15.146:3300/0 conn(0x7f9bcc09bc70 0x7f9bcc09c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.483+0000 7f9bd424e700 1 -- 172.21.15.146:0/2586546700 >> 172.21.15.146:0/2586546700 conn(0x7f9bcc0a2980 msgr2=0x7f9bcc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.483+0000 7f9bd424e700 1 -- 172.21.15.146:0/2586546700 shutdown_connections 2023-10-03T10:17:41.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.483+0000 7f9bd424e700 1 -- 172.21.15.146:0/2586546700 wait complete. 2023-10-03T10:17:41.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.485+0000 7f9bd424e700 1 Processor -- start 2023-10-03T10:17:41.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.485+0000 7f9bd424e700 1 -- start start 2023-10-03T10:17:41.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.485+0000 7f9bd424e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bcc09bc70 0x7f9bcc099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.485+0000 7f9bd424e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bcc09c5c0 0x7f9bcc099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.485+0000 7f9bd424e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bcc131980 0x7f9bcc09a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.485+0000 7f9bd424e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc09af60 con 0x7f9bcc09c5c0 2023-10-03T10:17:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.485+0000 7f9bd424e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc120420 con 0x7f9bcc131980 2023-10-03T10:17:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.485+0000 7f9bd424e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bcc121460 con 0x7f9bcc09bc70 2023-10-03T10:17:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.486+0000 7f9bd1fea700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bcc09bc70 0x7f9bcc099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.486+0000 7f9bd1fea700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bcc09bc70 0x7f9bcc099a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:48998/0 (socket says 172.21.15.146:48998) 2023-10-03T10:17:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.486+0000 7f9bd1fea700 1 -- 172.21.15.146:0/2249543753 learned_addr learned my addr 172.21.15.146:0/2249543753 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.486+0000 7f9bd17e9700 1 --2- 172.21.15.146:0/2249543753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bcc09c5c0 0x7f9bcc099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.486+0000 7f9bd27eb700 1 --2- 172.21.15.146:0/2249543753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bcc131980 0x7f9bcc09a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.486+0000 7f9bd1fea700 1 -- 172.21.15.146:0/2249543753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bcc131980 msgr2=0x7f9bcc09a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.486+0000 7f9bd1fea700 1 --2- 172.21.15.146:0/2249543753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bcc131980 0x7f9bcc09a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.486+0000 7f9bd1fea700 1 -- 172.21.15.146:0/2249543753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bcc09c5c0 msgr2=0x7f9bcc099fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.486+0000 7f9bd1fea700 1 --2- 172.21.15.146:0/2249543753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bcc09c5c0 0x7f9bcc099fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.486+0000 7f9bd1fea700 1 -- 172.21.15.146:0/2249543753 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc0094a0 con 0x7f9bcc09bc70 2023-10-03T10:17:41.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.486+0000 7f9bd27eb700 1 --2- 172.21.15.146:0/2249543753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bcc131980 0x7f9bcc09a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:41.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.486+0000 7f9bd1fea700 1 --2- 172.21.15.146:0/2249543753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bcc09bc70 0x7f9bcc099a90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009c10 tx=0x7f9bc8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.486+0000 7f9bc27fc700 1 -- 172.21.15.146:0/2249543753 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8003ab0 con 0x7f9bcc09bc70 2023-10-03T10:17:41.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.486+0000 7f9bc27fc700 1 -- 172.21.15.146:0/2249543753 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc8003c10 con 0x7f9bcc09bc70 2023-10-03T10:17:41.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.486+0000 7f9bd424e700 1 -- 172.21.15.146:0/2249543753 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc8009500 con 0x7f9bcc09bc70 2023-10-03T10:17:41.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.486+0000 7f9bd424e700 1 -- 172.21.15.146:0/2249543753 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bcc0a1c40 con 0x7f9bcc09bc70 2023-10-03T10:17:41.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.487+0000 7f9bc27fc700 1 -- 172.21.15.146:0/2249543753 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8006030 con 0x7f9bcc09bc70 2023-10-03T10:17:41.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.487+0000 7f9bc27fc700 1 -- 172.21.15.146:0/2249543753 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9bc8006190 con 0x7f9bcc09bc70 2023-10-03T10:17:41.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.487+0000 7f9bc27fc700 1 -- 172.21.15.146:0/2249543753 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9bc80404b0 con 0x7f9bcc09bc70 2023-10-03T10:17:41.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.488+0000 7f9bd424e700 1 -- 172.21.15.146:0/2249543753 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb40052e0 con 0x7f9bcc09bc70 2023-10-03T10:17:41.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.491+0000 7f8f574ee700 1 Processor -- start 2023-10-03T10:17:41.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.491+0000 7f8f574ee700 1 -- start start 2023-10-03T10:17:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.491+0000 7f8f574ee700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f50133b80 0x7f8f50133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.491+0000 7f8f574ee700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8f50099a60 0x7f8f500a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.491+0000 7f8f574ee700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f5009aa00 con 0x7f8f500a0e20 2023-10-03T10:17:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.491+0000 7f8f574ee700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f5009a080 con 0x7f8f50099a60 2023-10-03T10:17:41.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.492+0000 7f8f574ee700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f50133750 con 0x7f8f50133b80 2023-10-03T10:17:41.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.492+0000 7f8f5528a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f50133b80 0x7f8f50133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.492+0000 7f8f55a8b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8f500a0e20 0x7f8f5013a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45080/0 (socket says 172.21.15.146:45080) 2023-10-03T10:17:41.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.492+0000 7f8f5528a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f50133b80 0x7f8f50133f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56804/0 (socket says 172.21.15.146:56804) 2023-10-03T10:17:41.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.492+0000 7f8f55a8b700 1 -- 172.21.15.146:0/3098608088 learned_addr learned my addr 172.21.15.146:0/3098608088 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:41.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.492+0000 7f8f54a89700 1 --2- 172.21.15.146:0/3098608088 >> v2:172.21.15.146:3300/0 conn(0x7f8f50099a60 0x7f8f500a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.492+0000 7f8f5528a700 1 -- 172.21.15.146:0/3098608088 >> v2:172.21.15.146:3300/0 conn(0x7f8f50099a60 msgr2=0x7f8f500a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:41.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.492+0000 7f8f5528a700 1 --2- 172.21.15.146:0/3098608088 >> v2:172.21.15.146:3300/0 conn(0x7f8f50099a60 0x7f8f500a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.492+0000 7f8f5528a700 1 -- 172.21.15.146:0/3098608088 >> v1:172.21.15.146:6789/0 conn(0x7f8f500a0e20 legacy=0x7f8f5013a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.492+0000 7f8f5528a700 1 -- 172.21.15.146:0/3098608088 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5009a760 con 0x7f8f50133b80 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.492+0000 7f8f54a89700 1 --2- 172.21.15.146:0/3098608088 >> v2:172.21.15.146:3300/0 conn(0x7f8f50099a60 0x7f8f500a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.492+0000 7f8f5528a700 1 --2- 172.21.15.146:0/3098608088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f50133b80 0x7f8f50133f50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c009820 tx=0x7f8f4c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=269c257e1052fb53 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.492+0000 7f8f47fff700 1 -- 172.21.15.146:0/3098608088 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c005e30 con 0x7f8f50133b80 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.492+0000 7f8f47fff700 1 -- 172.21.15.146:0/3098608088 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4c006030 con 0x7f8f50133b80 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.492+0000 7f8f47fff700 1 -- 172.21.15.146:0/3098608088 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c0063c0 con 0x7f8f50133b80 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.493+0000 7f8f574ee700 1 -- 172.21.15.146:0/3098608088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f50133b80 msgr2=0x7f8f50133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.493+0000 7f8f574ee700 1 --2- 172.21.15.146:0/3098608088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f50133b80 0x7f8f50133f50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c009820 tx=0x7f8f4c009b30 comp rx=0 tx=0).stop 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.493+0000 7f8f574ee700 1 -- 172.21.15.146:0/3098608088 shutdown_connections 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.493+0000 7f8f574ee700 1 --2- 172.21.15.146:0/3098608088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f50133b80 0x7f8f50133f50 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.493+0000 7f8f574ee700 1 --2- 172.21.15.146:0/3098608088 >> v2:172.21.15.146:3300/0 conn(0x7f8f50099a60 0x7f8f500a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.493+0000 7f8f574ee700 1 -- 172.21.15.146:0/3098608088 >> 172.21.15.146:0/3098608088 conn(0x7f8f500a2980 msgr2=0x7f8f500a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.493+0000 7f8f574ee700 1 -- 172.21.15.146:0/3098608088 shutdown_connections 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.493+0000 7f8f574ee700 1 -- 172.21.15.146:0/3098608088 wait complete. 2023-10-03T10:17:41.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.494+0000 7f8f574ee700 1 Processor -- start 2023-10-03T10:17:41.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.494+0000 7f8f574ee700 1 -- start start 2023-10-03T10:17:41.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.495+0000 7f8f574ee700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f50099a60 0x7f8f5011faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.495+0000 7f8f574ee700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f500a0e20 0x7f8f50120030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.495+0000 7f8f574ee700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f50133b80 0x7f8f50120570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.495+0000 7f8f574ee700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f50123020 con 0x7f8f50099a60 2023-10-03T10:17:41.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.495+0000 7f8f574ee700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5009a2c0 con 0x7f8f500a0e20 2023-10-03T10:17:41.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.495+0000 7f8f574ee700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f50121750 con 0x7f8f50133b80 2023-10-03T10:17:41.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.495+0000 7f8f55a8b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f50133b80 0x7f8f50120570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.495+0000 7f8f55a8b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f50133b80 0x7f8f50120570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49012/0 (socket says 172.21.15.146:49012) 2023-10-03T10:17:41.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.495+0000 7f8f54a89700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f500a0e20 0x7f8f50120030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.495+0000 7f8f55a8b700 1 -- 172.21.15.146:0/735487260 learned_addr learned my addr 172.21.15.146:0/735487260 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:41.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.495+0000 7f8f5528a700 1 --2- 172.21.15.146:0/735487260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f50099a60 0x7f8f5011faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.495+0000 7f8f54a89700 1 -- 172.21.15.146:0/735487260 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f50133b80 msgr2=0x7f8f50120570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.495+0000 7f8f54a89700 1 --2- 172.21.15.146:0/735487260 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f50133b80 0x7f8f50120570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.495+0000 7f8f54a89700 1 -- 172.21.15.146:0/735487260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f50099a60 msgr2=0x7f8f5011faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.495+0000 7f8f54a89700 1 --2- 172.21.15.146:0/735487260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f50099a60 0x7f8f5011faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.495+0000 7f8f54a89700 1 -- 172.21.15.146:0/735487260 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f400094a0 con 0x7f8f500a0e20 2023-10-03T10:17:41.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.495+0000 7f8f5528a700 1 --2- 172.21.15.146:0/735487260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f50099a60 0x7f8f5011faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:41.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.495+0000 7f8f54a89700 1 --2- 172.21.15.146:0/735487260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f500a0e20 0x7f8f50120030 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8f500a20b0 tx=0x7f8f4000ec60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.496+0000 7f8f45ffb700 1 -- 172.21.15.146:0/735487260 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40013680 con 0x7f8f500a0e20 2023-10-03T10:17:41.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.496+0000 7f8f45ffb700 1 -- 172.21.15.146:0/735487260 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f400137e0 con 0x7f8f500a0e20 2023-10-03T10:17:41.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.496+0000 7f8f574ee700 1 -- 172.21.15.146:0/735487260 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f4c009430 con 0x7f8f500a0e20 2023-10-03T10:17:41.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.496+0000 7f8f45ffb700 1 -- 172.21.15.146:0/735487260 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40013b90 con 0x7f8f500a0e20 2023-10-03T10:17:41.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.496+0000 7f8f574ee700 1 -- 172.21.15.146:0/735487260 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f50120ec0 con 0x7f8f500a0e20 2023-10-03T10:17:41.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.497+0000 7f8f45ffb700 1 -- 172.21.15.146:0/735487260 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f40013cf0 con 0x7f8f500a0e20 2023-10-03T10:17:41.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.497+0000 7f8f574ee700 1 -- 172.21.15.146:0/735487260 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f5004f2a0 con 0x7f8f500a0e20 2023-10-03T10:17:41.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.497+0000 7f8f45ffb700 1 -- 172.21.15.146:0/735487260 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8f4003faa0 con 0x7f8f500a0e20 2023-10-03T10:17:41.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.497+0000 7f9bc27fc700 1 -- 172.21.15.146:0/2249543753 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9bc8016080 con 0x7f9bcc09bc70 2023-10-03T10:17:41.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.502+0000 7f8f45ffb700 1 -- 172.21.15.146:0/735487260 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f4000c970 con 0x7f8f500a0e20 2023-10-03T10:17:41.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.528+0000 7fd66d821700 1 Processor -- start 2023-10-03T10:17:41.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.528+0000 7fd66d821700 1 -- start start 2023-10-03T10:17:41.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.529+0000 7fd66d821700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6680a1550 0x7fd668138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.529+0000 7fd66d821700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd668139200 0x7fd66813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.529+0000 7fd66d821700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd66809e9d0 con 0x7fd6680a0a70 2023-10-03T10:17:41.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.529+0000 7fd66d821700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66809dc00 con 0x7fd668139200 2023-10-03T10:17:41.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.529+0000 7fd66d821700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd66809dec0 con 0x7fd6680a1550 2023-10-03T10:17:41.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.529+0000 7fd666ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd6680a0a70 0x7fd6680a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45086/0 (socket says 172.21.15.146:45086) 2023-10-03T10:17:41.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.529+0000 7fd666ffd700 1 -- 172.21.15.146:0/704250584 learned_addr learned my addr 172.21.15.146:0/704250584 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:41.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.529+0000 7fd6667fc700 1 --2- 172.21.15.146:0/704250584 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6680a1550 0x7fd668138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.529+0000 7fd6677fe700 1 --2- 172.21.15.146:0/704250584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd668139200 0x7fd66813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.529+0000 7fd6677fe700 1 -- 172.21.15.146:0/704250584 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6680a1550 msgr2=0x7fd668138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:41.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.529+0000 7fd6677fe700 1 --2- 172.21.15.146:0/704250584 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6680a1550 0x7fd668138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.529+0000 7fd6677fe700 1 -- 172.21.15.146:0/704250584 >> v1:172.21.15.146:6789/0 conn(0x7fd6680a0a70 legacy=0x7fd6680a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.529+0000 7fd6677fe700 1 -- 172.21.15.146:0/704250584 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66809e6a0 con 0x7fd668139200 2023-10-03T10:17:41.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.529+0000 7fd6677fe700 1 --2- 172.21.15.146:0/704250584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd668139200 0x7fd66813b5e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd660009dc0 tx=0x7fd66000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb66bde95ee4c320 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.530+0000 7fd665ffb700 1 -- 172.21.15.146:0/704250584 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66000e070 con 0x7fd668139200 2023-10-03T10:17:41.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.530+0000 7fd665ffb700 1 -- 172.21.15.146:0/704250584 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd660003a20 con 0x7fd668139200 2023-10-03T10:17:41.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.530+0000 7fd665ffb700 1 -- 172.21.15.146:0/704250584 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd660003dd0 con 0x7fd668139200 2023-10-03T10:17:41.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.530+0000 7fd66d821700 1 -- 172.21.15.146:0/704250584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd668139200 msgr2=0x7fd66813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.530+0000 7fd66d821700 1 --2- 172.21.15.146:0/704250584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd668139200 0x7fd66813b5e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd660009dc0 tx=0x7fd66000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:41.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.530+0000 7fd66d821700 1 -- 172.21.15.146:0/704250584 shutdown_connections 2023-10-03T10:17:41.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.530+0000 7fd66d821700 1 --2- 172.21.15.146:0/704250584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd668139200 0x7fd66813b5e0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.530+0000 7fd66d821700 1 --2- 172.21.15.146:0/704250584 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6680a1550 0x7fd668138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.530+0000 7fd66d821700 1 -- 172.21.15.146:0/704250584 >> 172.21.15.146:0/704250584 conn(0x7fd6680a6610 msgr2=0x7fd6680a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.530+0000 7fd66d821700 1 -- 172.21.15.146:0/704250584 shutdown_connections 2023-10-03T10:17:41.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.530+0000 7fd66d821700 1 -- 172.21.15.146:0/704250584 wait complete. 2023-10-03T10:17:41.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.532+0000 7fd66d821700 1 Processor -- start 2023-10-03T10:17:41.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.532+0000 7fd66d821700 1 -- start start 2023-10-03T10:17:41.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.532+0000 7fd66d821700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6680a0a70 0x7fd66811e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.532+0000 7fd66d821700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6680a1550 0x7fd66811ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.532+0000 7fd66d821700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd668139200 0x7fd66811f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.532+0000 7fd66d821700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd668120d20 con 0x7fd6680a1550 2023-10-03T10:17:41.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.532+0000 7fd66d821700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd668122360 con 0x7fd668139200 2023-10-03T10:17:41.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.532+0000 7fd66d821700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6680a5290 con 0x7fd6680a0a70 2023-10-03T10:17:41.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.533+0000 7fd666ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6680a0a70 0x7fd66811e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.533+0000 7fd666ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6680a0a70 0x7fd66811e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49038/0 (socket says 172.21.15.146:49038) 2023-10-03T10:17:41.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.533+0000 7fd666ffd700 1 -- 172.21.15.146:0/3594361473 learned_addr learned my addr 172.21.15.146:0/3594361473 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:41.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.533+0000 7fd6667fc700 1 --2- 172.21.15.146:0/3594361473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6680a1550 0x7fd66811ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.533+0000 7fd6677fe700 1 --2- 172.21.15.146:0/3594361473 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd668139200 0x7fd66811f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.533+0000 7fd6667fc700 1 -- 172.21.15.146:0/3594361473 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6680a0a70 msgr2=0x7fd66811e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.533+0000 7fd6667fc700 1 --2- 172.21.15.146:0/3594361473 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6680a0a70 0x7fd66811e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.533+0000 7fd6667fc700 1 -- 172.21.15.146:0/3594361473 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd668139200 msgr2=0x7fd66811f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.533+0000 7fd6667fc700 1 --2- 172.21.15.146:0/3594361473 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd668139200 0x7fd66811f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.533+0000 7fd6667fc700 1 -- 172.21.15.146:0/3594361473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd660009a70 con 0x7fd6680a1550 2023-10-03T10:17:41.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.533+0000 7fd666ffd700 1 --2- 172.21.15.146:0/3594361473 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6680a0a70 0x7fd66811e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:41.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.533+0000 7fd6667fc700 1 --2- 172.21.15.146:0/3594361473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6680a1550 0x7fd66811ed80 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00e930 tx=0x7fd65c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.533+0000 7fd64ffff700 1 -- 172.21.15.146:0/3594361473 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c00ee80 con 0x7fd6680a1550 2023-10-03T10:17:41.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.533+0000 7fd64ffff700 1 -- 172.21.15.146:0/3594361473 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65c00c850 con 0x7fd6680a1550 2023-10-03T10:17:41.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.533+0000 7fd66d821700 1 -- 172.21.15.146:0/3594361473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd668121b50 con 0x7fd6680a1550 2023-10-03T10:17:41.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.533+0000 7fd64ffff700 1 -- 172.21.15.146:0/3594361473 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c00cbc0 con 0x7fd6680a1550 2023-10-03T10:17:41.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.533+0000 7fd66d821700 1 -- 172.21.15.146:0/3594361473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd668134730 con 0x7fd6680a1550 2023-10-03T10:17:41.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.534+0000 7fd64ffff700 1 -- 172.21.15.146:0/3594361473 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd65c00cd20 con 0x7fd6680a1550 2023-10-03T10:17:41.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.535+0000 7fd66d821700 1 -- 172.21.15.146:0/3594361473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd668121d20 con 0x7fd6680a1550 2023-10-03T10:17:41.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.535+0000 7fd64ffff700 1 -- 172.21.15.146:0/3594361473 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd65c03f900 con 0x7fd6680a1550 2023-10-03T10:17:41.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.539+0000 7fd64ffff700 1 -- 172.21.15.146:0/3594361473 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd668121d20 con 0x7fd6680a1550 2023-10-03T10:17:41.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.617+0000 7f5da8945700 1 -- 172.21.15.146:0/451671958 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5da406c3b0 con 0x7f5da41300a0 2023-10-03T10:17:41.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.617+0000 7f5d92ffd700 1 -- 172.21.15.146:0/451671958 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d94021030 con 0x7f5da41300a0 2023-10-03T10:17:41.618 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:41.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.620+0000 7f5da8945700 1 -- 172.21.15.146:0/451671958 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5da41300a0 msgr2=0x7f5da411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.620+0000 7f5da8945700 1 --2- 172.21.15.146:0/451671958 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5da41300a0 0x7f5da411da40 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400e9b0 tx=0x7f5d9400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.620+0000 7f5da8945700 1 -- 172.21.15.146:0/451671958 shutdown_connections 2023-10-03T10:17:41.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.620+0000 7f5da8945700 1 --2- 172.21.15.146:0/451671958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5da4133ad0 0x7f5da411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.620+0000 7f5da8945700 1 --2- 172.21.15.146:0/451671958 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5da41300a0 0x7f5da411da40 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.620+0000 7f5da8945700 1 --2- 172.21.15.146:0/451671958 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5da41309f0 0x7f5da411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.620+0000 7f5da8945700 1 -- 172.21.15.146:0/451671958 >> 172.21.15.146:0/451671958 conn(0x7f5da4099c40 msgr2=0x7f5da40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.620+0000 7f5da8945700 1 -- 172.21.15.146:0/451671958 shutdown_connections 2023-10-03T10:17:41.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.620+0000 7f5da8945700 1 -- 172.21.15.146:0/451671958 wait complete. 2023-10-03T10:17:41.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:41.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.734+0000 7fd66d821700 1 -- 172.21.15.146:0/3594361473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd668121d20 con 0x7fd6680a1550 2023-10-03T10:17:41.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.734+0000 7fd64ffff700 1 -- 172.21.15.146:0/3594361473 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd668121d20 con 0x7fd6680a1550 2023-10-03T10:17:41.735 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:41.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.738+0000 7fd66d821700 1 -- 172.21.15.146:0/3594361473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6680a1550 msgr2=0x7fd66811ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.738+0000 7fd66d821700 1 --2- 172.21.15.146:0/3594361473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6680a1550 0x7fd66811ed80 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00e930 tx=0x7fd65c00ec40 comp rx=0 tx=0).stop 2023-10-03T10:17:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.738+0000 7fd66d821700 1 -- 172.21.15.146:0/3594361473 shutdown_connections 2023-10-03T10:17:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.738+0000 7fd66d821700 1 --2- 172.21.15.146:0/3594361473 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd668139200 0x7fd66811f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.738+0000 7fd66d821700 1 --2- 172.21.15.146:0/3594361473 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd6680a0a70 0x7fd66811e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.738+0000 7fd66d821700 1 --2- 172.21.15.146:0/3594361473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6680a1550 0x7fd66811ed80 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.738+0000 7fd66d821700 1 -- 172.21.15.146:0/3594361473 >> 172.21.15.146:0/3594361473 conn(0x7fd6680a6610 msgr2=0x7fd66809a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.738+0000 7fd66d821700 1 -- 172.21.15.146:0/3594361473 shutdown_connections 2023-10-03T10:17:41.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.738+0000 7fd66d821700 1 -- 172.21.15.146:0/3594361473 wait complete. 2023-10-03T10:17:41.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.743+0000 7f9bd424e700 1 -- 172.21.15.146:0/2249543753 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9bb4005590 con 0x7f9bcc09bc70 2023-10-03T10:17:41.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.744+0000 7f9bc27fc700 1 -- 172.21.15.146:0/2249543753 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9bc801c420 con 0x7f9bcc09bc70 2023-10-03T10:17:41.744 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:41.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.746+0000 7f9bd424e700 1 -- 172.21.15.146:0/2249543753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bcc09bc70 msgr2=0x7f9bcc099a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.746+0000 7f9bd424e700 1 --2- 172.21.15.146:0/2249543753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bcc09bc70 0x7f9bcc099a90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009c10 tx=0x7f9bc8004750 comp rx=0 tx=0).stop 2023-10-03T10:17:41.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.746+0000 7f9bd424e700 1 -- 172.21.15.146:0/2249543753 shutdown_connections 2023-10-03T10:17:41.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.746+0000 7f9bd424e700 1 --2- 172.21.15.146:0/2249543753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9bcc131980 0x7f9bcc09a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.746+0000 7f9bd424e700 1 --2- 172.21.15.146:0/2249543753 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9bcc09bc70 0x7f9bcc099a90 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.746+0000 7f9bd424e700 1 --2- 172.21.15.146:0/2249543753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bcc09c5c0 0x7f9bcc099fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.746+0000 7f9bd424e700 1 -- 172.21.15.146:0/2249543753 >> 172.21.15.146:0/2249543753 conn(0x7f9bcc0a2980 msgr2=0x7f9bcc1b8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.746+0000 7f9bd424e700 1 -- 172.21.15.146:0/2249543753 shutdown_connections 2023-10-03T10:17:41.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.746+0000 7f9bd424e700 1 -- 172.21.15.146:0/2249543753 wait complete. 2023-10-03T10:17:41.756 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:41.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:41.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.763+0000 7f8f574ee700 1 -- 172.21.15.146:0/735487260 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8f50130e90 con 0x7f8f500a0e20 2023-10-03T10:17:41.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.763+0000 7f8f45ffb700 1 -- 172.21.15.146:0/735487260 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f40017070 con 0x7f8f500a0e20 2023-10-03T10:17:41.764 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:41.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.765+0000 7f8f574ee700 1 -- 172.21.15.146:0/735487260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f500a0e20 msgr2=0x7f8f50120030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.765+0000 7f8f574ee700 1 --2- 172.21.15.146:0/735487260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f500a0e20 0x7f8f50120030 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8f500a20b0 tx=0x7f8f4000ec60 comp rx=0 tx=0).stop 2023-10-03T10:17:41.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.765+0000 7f8f574ee700 1 -- 172.21.15.146:0/735487260 shutdown_connections 2023-10-03T10:17:41.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.765+0000 7f8f574ee700 1 --2- 172.21.15.146:0/735487260 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f50133b80 0x7f8f50120570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.765+0000 7f8f574ee700 1 --2- 172.21.15.146:0/735487260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f50099a60 0x7f8f5011faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.765+0000 7f8f574ee700 1 --2- 172.21.15.146:0/735487260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f500a0e20 0x7f8f50120030 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.765+0000 7f8f574ee700 1 -- 172.21.15.146:0/735487260 >> 172.21.15.146:0/735487260 conn(0x7f8f500a2980 msgr2=0x7f8f50132360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.765+0000 7f8f574ee700 1 -- 172.21.15.146:0/735487260 shutdown_connections 2023-10-03T10:17:41.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:41.765+0000 7f8f574ee700 1 -- 172.21.15.146:0/735487260 wait complete. 2023-10-03T10:17:41.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:42.639 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:42.757 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:42.760 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:42.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.768+0000 7f8d2444d700 1 Processor -- start 2023-10-03T10:17:42.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.768+0000 7f8d2444d700 1 -- start start 2023-10-03T10:17:42.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.769+0000 7f8d2444d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8d1c09d860 0x7f8d1c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.769+0000 7f8d2444d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c130eb0 0x7f8d1c138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.769+0000 7f8d2444d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d1c09aaa0 con 0x7f8d1c09e170 2023-10-03T10:17:42.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.769+0000 7f8d2444d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1c09f870 con 0x7f8d1c09d860 2023-10-03T10:17:42.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.769+0000 7f8d2444d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c09b360 con 0x7f8d1c130eb0 2023-10-03T10:17:42.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.769+0000 7f8d221e9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8d1c09d860 0x7f8d1c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.769+0000 7f8d229ea700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c130eb0 0x7f8d1c138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.769+0000 7f8d219e8700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8d1c09e170 0x7f8d1c1307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45092/0 (socket says 172.21.15.146:45092) 2023-10-03T10:17:42.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.769+0000 7f8d219e8700 1 -- 172.21.15.146:0/2226046418 learned_addr learned my addr 172.21.15.146:0/2226046418 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:42.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.769+0000 7f8d221e9700 1 -- 172.21.15.146:0/2226046418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c130eb0 msgr2=0x7f8d1c138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.769+0000 7f8d221e9700 1 --2- 172.21.15.146:0/2226046418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c130eb0 0x7f8d1c138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.769+0000 7f8d221e9700 1 -- 172.21.15.146:0/2226046418 >> v1:172.21.15.146:6789/0 conn(0x7f8d1c09e170 legacy=0x7f8d1c1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.769+0000 7f8d221e9700 1 -- 172.21.15.146:0/2226046418 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c09b620 con 0x7f8d1c09d860 2023-10-03T10:17:42.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.769+0000 7f8d229ea700 1 --2- 172.21.15.146:0/2226046418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c130eb0 0x7f8d1c138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:42.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.769+0000 7f8d211e7700 1 -- 172.21.15.146:0/2226046418 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375657948 0 0) 0x7f8d1c09aaa0 con 0x7f8d1c09e170 2023-10-03T10:17:42.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.769+0000 7f8d221e9700 1 --2- 172.21.15.146:0/2226046418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d1c09d860 0x7f8d1c09dc30 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f8d18009840 tx=0x7f8d18009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea10764615543ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.769+0000 7f8d211e7700 1 -- 172.21.15.146:0/2226046418 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d18011830 con 0x7f8d1c09d860 2023-10-03T10:17:42.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.769+0000 7f8d211e7700 1 -- 172.21.15.146:0/2226046418 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d18011990 con 0x7f8d1c09d860 2023-10-03T10:17:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.769+0000 7f8d211e7700 1 -- 172.21.15.146:0/2226046418 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d18011d20 con 0x7f8d1c09d860 2023-10-03T10:17:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.770+0000 7f8d2444d700 1 -- 172.21.15.146:0/2226046418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d1c09d860 msgr2=0x7f8d1c09dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.770+0000 7f8d2444d700 1 --2- 172.21.15.146:0/2226046418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d1c09d860 0x7f8d1c09dc30 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f8d18009840 tx=0x7f8d18009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.770+0000 7f8d2444d700 1 -- 172.21.15.146:0/2226046418 shutdown_connections 2023-10-03T10:17:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.770+0000 7f8d2444d700 1 --2- 172.21.15.146:0/2226046418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c130eb0 0x7f8d1c138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.770+0000 7f8d2444d700 1 --2- 172.21.15.146:0/2226046418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d1c09d860 0x7f8d1c09dc30 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.771+0000 7f8d2444d700 1 -- 172.21.15.146:0/2226046418 >> 172.21.15.146:0/2226046418 conn(0x7f8d1c099c40 msgr2=0x7f8d1c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.771+0000 7f8d2444d700 1 -- 172.21.15.146:0/2226046418 shutdown_connections 2023-10-03T10:17:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.771+0000 7f8d2444d700 1 -- 172.21.15.146:0/2226046418 wait complete. 2023-10-03T10:17:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.772+0000 7f8d2444d700 1 Processor -- start 2023-10-03T10:17:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.772+0000 7f8d2444d700 1 -- start start 2023-10-03T10:17:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.772+0000 7f8d2444d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d1c09d860 0x7f8d1c11e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.772+0000 7f8d2444d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c09e170 0x7f8d1c11e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.772+0000 7f8d2444d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d1c130eb0 0x7f8d1c11ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.772+0000 7f8d2444d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c121b20 con 0x7f8d1c130eb0 2023-10-03T10:17:42.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.772+0000 7f8d2444d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c1207c0 con 0x7f8d1c09e170 2023-10-03T10:17:42.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.772+0000 7f8d2444d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c072030 con 0x7f8d1c09d860 2023-10-03T10:17:42.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.772+0000 7f8d219e8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c09e170 0x7f8d1c11e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.772+0000 7f8d221e9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d1c09d860 0x7f8d1c11e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.772+0000 7f8d219e8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c09e170 0x7f8d1c11e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56858/0 (socket says 172.21.15.146:56858) 2023-10-03T10:17:42.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.773+0000 7f8d219e8700 1 -- 172.21.15.146:0/1513487036 learned_addr learned my addr 172.21.15.146:0/1513487036 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:42.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.773+0000 7f8d229ea700 1 --2- 172.21.15.146:0/1513487036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d1c130eb0 0x7f8d1c11ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.773+0000 7f8d219e8700 1 -- 172.21.15.146:0/1513487036 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d1c09d860 msgr2=0x7f8d1c11e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.773+0000 7f8d219e8700 1 --2- 172.21.15.146:0/1513487036 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d1c09d860 0x7f8d1c11e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.773+0000 7f8d219e8700 1 -- 172.21.15.146:0/1513487036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d1c130eb0 msgr2=0x7f8d1c11ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.773+0000 7f8d219e8700 1 --2- 172.21.15.146:0/1513487036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d1c130eb0 0x7f8d1c11ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.773+0000 7f8d219e8700 1 -- 172.21.15.146:0/1513487036 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d14009a70 con 0x7f8d1c09e170 2023-10-03T10:17:42.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.773+0000 7f8d221e9700 1 --2- 172.21.15.146:0/1513487036 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d1c09d860 0x7f8d1c11e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:42.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.773+0000 7f8d229ea700 1 --2- 172.21.15.146:0/1513487036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d1c130eb0 0x7f8d1c11ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:42.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.773+0000 7f8d219e8700 1 --2- 172.21.15.146:0/1513487036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c09e170 0x7f8d1c11e8c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00c520 tx=0x7f8d0c00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.773+0000 7f8d12ffd700 1 -- 172.21.15.146:0/1513487036 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c004c80 con 0x7f8d1c09e170 2023-10-03T10:17:42.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.773+0000 7f8d12ffd700 1 -- 172.21.15.146:0/1513487036 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c004de0 con 0x7f8d1c09e170 2023-10-03T10:17:42.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.773+0000 7f8d2444d700 1 -- 172.21.15.146:0/1513487036 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d180094a0 con 0x7f8d1c09e170 2023-10-03T10:17:42.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.773+0000 7f8d12ffd700 1 -- 172.21.15.146:0/1513487036 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c007310 con 0x7f8d1c09e170 2023-10-03T10:17:42.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.773+0000 7f8d2444d700 1 -- 172.21.15.146:0/1513487036 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1c121860 con 0x7f8d1c09e170 2023-10-03T10:17:42.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.774+0000 7f8d2444d700 1 -- 172.21.15.146:0/1513487036 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1c04f2a0 con 0x7f8d1c09e170 2023-10-03T10:17:42.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.775+0000 7f8d12ffd700 1 -- 172.21.15.146:0/1513487036 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d0c007470 con 0x7f8d1c09e170 2023-10-03T10:17:42.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.775+0000 7f8d12ffd700 1 -- 172.21.15.146:0/1513487036 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8d0c03f260 con 0x7f8d1c09e170 2023-10-03T10:17:42.778 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:42.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.780+0000 7f8d12ffd700 1 -- 172.21.15.146:0/1513487036 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d0c0133c0 con 0x7f8d1c09e170 2023-10-03T10:17:42.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.899+0000 7f3cd50d6700 1 Processor -- start 2023-10-03T10:17:42.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.899+0000 7f3cd50d6700 1 -- start start 2023-10-03T10:17:42.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.899+0000 7f3cd50d6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cd00a0a70 0x7f3cd00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.899+0000 7f3cd50d6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cd00a1380 0x7f3cd0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.899+0000 7f3cd50d6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3cd0133f50 0x7f3cd01343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.899+0000 7f3cd50d6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd009e9d0 con 0x7f3cd0133f50 2023-10-03T10:17:42.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.899+0000 7f3cd50d6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd009dc00 con 0x7f3cd00a0a70 2023-10-03T10:17:42.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.899+0000 7f3cd50d6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd009dec0 con 0x7f3cd00a1380 2023-10-03T10:17:42.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.899+0000 7f3cce59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cd00a1380 0x7f3cd0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.899+0000 7f3cce59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cd00a1380 0x7f3cd0133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49060/0 (socket says 172.21.15.146:49060) 2023-10-03T10:17:42.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.899+0000 7f3cce59c700 1 -- 172.21.15.146:0/1051828607 learned_addr learned my addr 172.21.15.146:0/1051828607 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:42.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.899+0000 7f3cced9d700 1 --2- 172.21.15.146:0/1051828607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cd00a0a70 0x7f3cd00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.899+0000 7f3ccf59e700 1 --2- 172.21.15.146:0/1051828607 >> v2:172.21.15.146:3300/0 conn(0x7f3cd0133f50 0x7f3cd01343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.900+0000 7f3ccf59e700 1 -- 172.21.15.146:0/1051828607 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cd00a1380 msgr2=0x7f3cd0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.900+0000 7f3ccf59e700 1 --2- 172.21.15.146:0/1051828607 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cd00a1380 0x7f3cd0133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.900+0000 7f3ccf59e700 1 -- 172.21.15.146:0/1051828607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cd00a0a70 msgr2=0x7f3cd00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.900+0000 7f3ccf59e700 1 --2- 172.21.15.146:0/1051828607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cd00a0a70 0x7f3cd00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.900+0000 7f3ccf59e700 1 -- 172.21.15.146:0/1051828607 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd009e6a0 con 0x7f3cd0133f50 2023-10-03T10:17:42.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.900+0000 7f2a533e5700 1 Processor -- start 2023-10-03T10:17:42.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.900+0000 7f3ccf59e700 1 --2- 172.21.15.146:0/1051828607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cd0133f50 0x7f3cd01343f0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8009d90 tx=0x7f3cc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e8aa73667d76a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.900+0000 7f3ccdd9b700 1 -- 172.21.15.146:0/1051828607 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc800e070 con 0x7f3cd0133f50 2023-10-03T10:17:42.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.900+0000 7f2a533e5700 1 -- start start 2023-10-03T10:17:42.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.900+0000 7f3ccdd9b700 1 -- 172.21.15.146:0/1051828607 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc800bb20 con 0x7f3cd0133f50 2023-10-03T10:17:42.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.900+0000 7f3ccdd9b700 1 -- 172.21.15.146:0/1051828607 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8012430 con 0x7f3cd0133f50 2023-10-03T10:17:42.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.901+0000 7f2a533e5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2a4c09a670 0x7f2a4c1389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.901+0000 7f2a533e5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a4c138f20 0x7f2a4c13b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.901+0000 7f2a533e5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4c130240 con 0x7f2a4c130460 2023-10-03T10:17:42.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.901+0000 7f2a533e5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4c099b20 con 0x7f2a4c09a670 2023-10-03T10:17:42.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.901+0000 7f2a533e5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c09c0e0 con 0x7f2a4c138f20 2023-10-03T10:17:42.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.901+0000 7f2a51982700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a4c138f20 0x7f2a4c13b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.901+0000 7f2a50980700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2a4c09a670 0x7f2a4c1389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.901+0000 7f2a51982700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a4c138f20 0x7f2a4c13b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49066/0 (socket says 172.21.15.146:49066) 2023-10-03T10:17:42.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.901+0000 7f2a51982700 1 -- 172.21.15.146:0/3221238238 learned_addr learned my addr 172.21.15.146:0/3221238238 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:42.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.901+0000 7f3cd50d6700 1 -- 172.21.15.146:0/1051828607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cd0133f50 msgr2=0x7f3cd01343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.901+0000 7f3cd50d6700 1 --2- 172.21.15.146:0/1051828607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cd0133f50 0x7f3cd01343f0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8009d90 tx=0x7f3cc800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:42.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.901+0000 7f2a51982700 1 -- 172.21.15.146:0/3221238238 >> v2:172.21.15.146:3300/0 conn(0x7f2a4c09a670 msgr2=0x7f2a4c1389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.901+0000 7f2a51982700 1 --2- 172.21.15.146:0/3221238238 >> v2:172.21.15.146:3300/0 conn(0x7f2a4c09a670 0x7f2a4c1389e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.901+0000 7f2a51982700 1 -- 172.21.15.146:0/3221238238 >> v1:172.21.15.146:6789/0 conn(0x7f2a4c130460 legacy=0x7f2a4c130830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.901+0000 7f2a51982700 1 -- 172.21.15.146:0/3221238238 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c099de0 con 0x7f2a4c138f20 2023-10-03T10:17:42.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.901+0000 7f2a51982700 1 --2- 172.21.15.146:0/3221238238 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a4c138f20 0x7f2a4c13b300 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009e50 tx=0x7f2a4400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f57050286b7fb31a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.901+0000 7f3cd50d6700 1 -- 172.21.15.146:0/1051828607 shutdown_connections 2023-10-03T10:17:42.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.901+0000 7f3cd50d6700 1 --2- 172.21.15.146:0/1051828607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cd00a0a70 0x7f3cd00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.901+0000 7f3cd50d6700 1 --2- 172.21.15.146:0/1051828607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cd0133f50 0x7f3cd01343f0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.901+0000 7f3cd50d6700 1 --2- 172.21.15.146:0/1051828607 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cd00a1380 0x7f3cd0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.901+0000 7f3cd50d6700 1 -- 172.21.15.146:0/1051828607 >> 172.21.15.146:0/1051828607 conn(0x7f3cd00a6610 msgr2=0x7f3cd00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.902+0000 7f2a43fff700 1 -- 172.21.15.146:0/3221238238 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4400e070 con 0x7f2a4c138f20 2023-10-03T10:17:42.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.902+0000 7f2a43fff700 1 -- 172.21.15.146:0/3221238238 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4400b910 con 0x7f2a4c138f20 2023-10-03T10:17:42.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.902+0000 7f3cd50d6700 1 -- 172.21.15.146:0/1051828607 shutdown_connections 2023-10-03T10:17:42.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.902+0000 7f3cd50d6700 1 -- 172.21.15.146:0/1051828607 wait complete. 2023-10-03T10:17:42.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.902+0000 7f2a43fff700 1 -- 172.21.15.146:0/3221238238 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4400bcc0 con 0x7f2a4c138f20 2023-10-03T10:17:42.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.903+0000 7f3cd50d6700 1 Processor -- start 2023-10-03T10:17:42.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.903+0000 7f3cd50d6700 1 -- start start 2023-10-03T10:17:42.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.903+0000 7f2a533e5700 1 -- 172.21.15.146:0/3221238238 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a4c138f20 msgr2=0x7f2a4c13b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.903+0000 7f2a533e5700 1 --2- 172.21.15.146:0/3221238238 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a4c138f20 0x7f2a4c13b300 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009e50 tx=0x7f2a4400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:42.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.903+0000 7f2a533e5700 1 -- 172.21.15.146:0/3221238238 shutdown_connections 2023-10-03T10:17:42.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.903+0000 7f2a533e5700 1 --2- 172.21.15.146:0/3221238238 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a4c138f20 0x7f2a4c13b300 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.903+0000 7f2a533e5700 1 --2- 172.21.15.146:0/3221238238 >> v2:172.21.15.146:3300/0 conn(0x7f2a4c09a670 0x7f2a4c1389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.903+0000 7f2a533e5700 1 -- 172.21.15.146:0/3221238238 >> 172.21.15.146:0/3221238238 conn(0x7f2a4c0a1ee0 msgr2=0x7f2a4c0a22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.904+0000 7f3cd50d6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cd00a0a70 0x7f3cd011f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.904+0000 7f3cd50d6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cd00a1380 0x7f3cd011f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.904+0000 7f3cd50d6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cd0133f50 0x7f3cd011fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.904+0000 7f3cd50d6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd0122dc0 con 0x7f3cd0133f50 2023-10-03T10:17:42.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.904+0000 7f3cd50d6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd01228b0 con 0x7f3cd00a1380 2023-10-03T10:17:42.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.904+0000 7f3cd50d6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd0121d50 con 0x7f3cd00a0a70 2023-10-03T10:17:42.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.904+0000 7f3cced9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cd00a0a70 0x7f3cd011f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.904+0000 7f3cced9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cd00a0a70 0x7f3cd011f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49076/0 (socket says 172.21.15.146:49076) 2023-10-03T10:17:42.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.904+0000 7f3cced9d700 1 -- 172.21.15.146:0/2093747895 learned_addr learned my addr 172.21.15.146:0/2093747895 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:42.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.904+0000 7f3ccf59e700 1 --2- 172.21.15.146:0/2093747895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cd0133f50 0x7f3cd011fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.904+0000 7f3ccf59e700 1 -- 172.21.15.146:0/2093747895 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cd00a0a70 msgr2=0x7f3cd011f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.904+0000 7f3ccf59e700 1 --2- 172.21.15.146:0/2093747895 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cd00a0a70 0x7f3cd011f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.904+0000 7f3ccf59e700 1 -- 172.21.15.146:0/2093747895 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cd00a1380 msgr2=0x7f3cd011f830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:17:42.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.904+0000 7f3ccf59e700 1 --2- 172.21.15.146:0/2093747895 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cd00a1380 0x7f3cd011f830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.904+0000 7f3ccf59e700 1 -- 172.21.15.146:0/2093747895 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc8009a70 con 0x7f3cd0133f50 2023-10-03T10:17:42.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.904+0000 7f3cced9d700 1 --2- 172.21.15.146:0/2093747895 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cd00a0a70 0x7f3cd011f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:42.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.904+0000 7f3ccf59e700 1 --2- 172.21.15.146:0/2093747895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cd0133f50 0x7f3cd011fd70 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8016000 tx=0x7f3cc8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.906+0000 7f2a533e5700 1 -- 172.21.15.146:0/3221238238 shutdown_connections 2023-10-03T10:17:42.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.906+0000 7f2a533e5700 1 -- 172.21.15.146:0/3221238238 wait complete. 2023-10-03T10:17:42.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.906+0000 7f2a533e5700 1 Processor -- start 2023-10-03T10:17:42.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.906+0000 7f2a533e5700 1 -- start start 2023-10-03T10:17:42.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.907+0000 7f2a533e5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a4c09a670 0x7f2a4c126fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.907+0000 7f2a533e5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a4c130460 0x7f2a4c1274e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.907+0000 7f2a533e5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a4c138f20 0x7f2a4c127a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.907+0000 7f2a533e5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c1295f0 con 0x7f2a4c09a670 2023-10-03T10:17:42.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.907+0000 7f2a533e5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c130020 con 0x7f2a4c130460 2023-10-03T10:17:42.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.907+0000 7f2a533e5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c1297d0 con 0x7f2a4c138f20 2023-10-03T10:17:42.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.907+0000 7f2a51982700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a4c138f20 0x7f2a4c127a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.907+0000 7f2a51982700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a4c138f20 0x7f2a4c127a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49080/0 (socket says 172.21.15.146:49080) 2023-10-03T10:17:42.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.907+0000 7f2a51982700 1 -- 172.21.15.146:0/3058306970 learned_addr learned my addr 172.21.15.146:0/3058306970 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:42.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.907+0000 7f2a51181700 1 --2- 172.21.15.146:0/3058306970 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a4c09a670 0x7f2a4c126fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.907+0000 7f2a50980700 1 --2- 172.21.15.146:0/3058306970 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a4c130460 0x7f2a4c1274e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.907+0000 7f3cb77fe700 1 -- 172.21.15.146:0/2093747895 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc80048b0 con 0x7f3cd0133f50 2023-10-03T10:17:42.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.907+0000 7f3cb77fe700 1 -- 172.21.15.146:0/2093747895 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc8020070 con 0x7f3cd0133f50 2023-10-03T10:17:42.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.907+0000 7f3cb77fe700 1 -- 172.21.15.146:0/2093747895 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc80276c0 con 0x7f3cd0133f50 2023-10-03T10:17:42.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.907+0000 7f3cd50d6700 1 -- 172.21.15.146:0/2093747895 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd0120750 con 0x7f3cd0133f50 2023-10-03T10:17:42.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.907+0000 7f3cd50d6700 1 -- 172.21.15.146:0/2093747895 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd0120eb0 con 0x7f3cd0133f50 2023-10-03T10:17:42.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.907+0000 7f2a51982700 1 -- 172.21.15.146:0/3058306970 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a4c130460 msgr2=0x7f2a4c1274e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.907+0000 7f2a51982700 1 --2- 172.21.15.146:0/3058306970 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a4c130460 0x7f2a4c1274e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.907+0000 7f2a51982700 1 -- 172.21.15.146:0/3058306970 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a4c09a670 msgr2=0x7f2a4c126fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.907+0000 7f2a51982700 1 --2- 172.21.15.146:0/3058306970 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a4c09a670 0x7f2a4c126fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.907+0000 7f2a51982700 1 -- 172.21.15.146:0/3058306970 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a44009b30 con 0x7f2a4c138f20 2023-10-03T10:17:42.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.908+0000 7f2a51982700 1 --2- 172.21.15.146:0/3058306970 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a4c138f20 0x7f2a4c127a20 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c09c220 tx=0x7f2a44004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.908+0000 7f2a41ffb700 1 -- 172.21.15.146:0/3058306970 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440048b0 con 0x7f2a4c138f20 2023-10-03T10:17:42.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.908+0000 7f2a41ffb700 1 -- 172.21.15.146:0/3058306970 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a440092e0 con 0x7f2a4c138f20 2023-10-03T10:17:42.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.908+0000 7f2a41ffb700 1 -- 172.21.15.146:0/3058306970 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4401c630 con 0x7f2a4c138f20 2023-10-03T10:17:42.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.909+0000 7f2a533e5700 1 -- 172.21.15.146:0/3058306970 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4c13b310 con 0x7f2a4c138f20 2023-10-03T10:17:42.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.909+0000 7f2a533e5700 1 -- 172.21.15.146:0/3058306970 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4c09c320 con 0x7f2a4c138f20 2023-10-03T10:17:42.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.909+0000 7f3cd50d6700 1 -- 172.21.15.146:0/2093747895 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd004f2a0 con 0x7f3cd0133f50 2023-10-03T10:17:42.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.909+0000 7f3cb77fe700 1 -- 172.21.15.146:0/2093747895 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3cc8031480 con 0x7f3cd0133f50 2023-10-03T10:17:42.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.910+0000 7f3cb77fe700 1 -- 172.21.15.146:0/2093747895 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3cc8022070 con 0x7f3cd0133f50 2023-10-03T10:17:42.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.910+0000 7f2a533e5700 1 -- 172.21.15.146:0/3058306970 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4c04f2a0 con 0x7f2a4c138f20 2023-10-03T10:17:42.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.910+0000 7f2a41ffb700 1 -- 172.21.15.146:0/3058306970 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a4401c790 con 0x7f2a4c138f20 2023-10-03T10:17:42.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.911+0000 7f2a41ffb700 1 -- 172.21.15.146:0/3058306970 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2a440413c0 con 0x7f2a4c138f20 2023-10-03T10:17:42.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.915+0000 7f2e13cd2700 1 Processor -- start 2023-10-03T10:17:42.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.915+0000 7f2e13cd2700 1 -- start start 2023-10-03T10:17:42.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.915+0000 7f2e13cd2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e0c131980 0x7f2e0c131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.915+0000 7f2e13cd2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e0c09bc70 0x7f2e0c09c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.915+0000 7f2e13cd2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e0c0a1640 con 0x7f2e0c09c5c0 2023-10-03T10:17:42.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.915+0000 7f2e13cd2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c06eb30 con 0x7f2e0c131980 2023-10-03T10:17:42.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.915+0000 7f2e13cd2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c0a22d0 con 0x7f2e0c09bc70 2023-10-03T10:17:42.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.916+0000 7f2e1226f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2e0c09c5c0 0x7f2e0c138700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45098/0 (socket says 172.21.15.146:45098) 2023-10-03T10:17:42.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.916+0000 7f2e1226f700 1 -- 172.21.15.146:0/2437346465 learned_addr learned my addr 172.21.15.146:0/2437346465 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:42.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.916+0000 7f2e11a6e700 1 --2- 172.21.15.146:0/2437346465 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e0c131980 0x7f2e0c131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.916+0000 7f2e1126d700 1 --2- 172.21.15.146:0/2437346465 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e0c09bc70 0x7f2e0c09c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.916+0000 7f2e11a6e700 1 -- 172.21.15.146:0/2437346465 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e0c09bc70 msgr2=0x7f2e0c09c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.916+0000 7f2e11a6e700 1 --2- 172.21.15.146:0/2437346465 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e0c09bc70 0x7f2e0c09c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.916+0000 7f2e11a6e700 1 -- 172.21.15.146:0/2437346465 >> v1:172.21.15.146:6789/0 conn(0x7f2e0c09c5c0 legacy=0x7f2e0c138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.916+0000 7f2e11a6e700 1 -- 172.21.15.146:0/2437346465 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0c131550 con 0x7f2e0c131980 2023-10-03T10:17:42.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.916+0000 7f2e11a6e700 1 --2- 172.21.15.146:0/2437346465 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e0c131980 0x7f2e0c131d50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009850 tx=0x7f2e08009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37ac13ea25ef7db1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.916+0000 7f2e10a6c700 1 -- 172.21.15.146:0/2437346465 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08005e30 con 0x7f2e0c131980 2023-10-03T10:17:42.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.916+0000 7f2e10a6c700 1 -- 172.21.15.146:0/2437346465 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e08006030 con 0x7f2e0c131980 2023-10-03T10:17:42.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.916+0000 7f2e10a6c700 1 -- 172.21.15.146:0/2437346465 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e080063e0 con 0x7f2e0c131980 2023-10-03T10:17:42.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.917+0000 7f3cb77fe700 1 -- 172.21.15.146:0/2093747895 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3cc8003e30 con 0x7f3cd0133f50 2023-10-03T10:17:42.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.917+0000 7f2e13cd2700 1 -- 172.21.15.146:0/2437346465 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e0c131980 msgr2=0x7f2e0c131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.917+0000 7f2e13cd2700 1 --2- 172.21.15.146:0/2437346465 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e0c131980 0x7f2e0c131d50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009850 tx=0x7f2e08009b60 comp rx=0 tx=0).stop 2023-10-03T10:17:42.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.917+0000 7f2e13cd2700 1 -- 172.21.15.146:0/2437346465 shutdown_connections 2023-10-03T10:17:42.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.917+0000 7f2e13cd2700 1 --2- 172.21.15.146:0/2437346465 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e0c131980 0x7f2e0c131d50 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.917+0000 7f2e13cd2700 1 --2- 172.21.15.146:0/2437346465 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e0c09bc70 0x7f2e0c09c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.917+0000 7f2e13cd2700 1 -- 172.21.15.146:0/2437346465 >> 172.21.15.146:0/2437346465 conn(0x7f2e0c0a2980 msgr2=0x7f2e0c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.917+0000 7f2e13cd2700 1 -- 172.21.15.146:0/2437346465 shutdown_connections 2023-10-03T10:17:42.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.917+0000 7f2e13cd2700 1 -- 172.21.15.146:0/2437346465 wait complete. 2023-10-03T10:17:42.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.918+0000 7f2e13cd2700 1 Processor -- start 2023-10-03T10:17:42.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.918+0000 7f2e13cd2700 1 -- start start 2023-10-03T10:17:42.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.919+0000 7f2e13cd2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e0c09bc70 0x7f2e0c11b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.919+0000 7f2e13cd2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e0c09c5c0 0x7f2e0c11bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.919+0000 7f2e13cd2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e0c131980 0x7f2e0c11c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.919+0000 7f2e13cd2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c11d430 con 0x7f2e0c131980 2023-10-03T10:17:42.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.919+0000 7f2e13cd2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c11e680 con 0x7f2e0c09c5c0 2023-10-03T10:17:42.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.919+0000 7f2e13cd2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c11f100 con 0x7f2e0c09bc70 2023-10-03T10:17:42.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.919+0000 7f2e11a6e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e0c09bc70 0x7f2e0c11b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.919+0000 7f2e11a6e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e0c09bc70 0x7f2e0c11b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:49094/0 (socket says 172.21.15.146:49094) 2023-10-03T10:17:42.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.919+0000 7f2e1126d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e0c09c5c0 0x7f2e0c11bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.919+0000 7f2e11a6e700 1 -- 172.21.15.146:0/1022287332 learned_addr learned my addr 172.21.15.146:0/1022287332 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:42.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.919+0000 7f2e1226f700 1 --2- 172.21.15.146:0/1022287332 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e0c131980 0x7f2e0c11c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.919+0000 7f2a41ffb700 1 -- 172.21.15.146:0/3058306970 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a4401ce60 con 0x7f2a4c138f20 2023-10-03T10:17:42.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.919+0000 7f2e1126d700 1 -- 172.21.15.146:0/1022287332 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e0c09bc70 msgr2=0x7f2e0c11b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.919+0000 7f2e1126d700 1 --2- 172.21.15.146:0/1022287332 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e0c09bc70 0x7f2e0c11b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.919+0000 7f2e1126d700 1 -- 172.21.15.146:0/1022287332 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e0c131980 msgr2=0x7f2e0c11c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.919+0000 7f2e1126d700 1 --2- 172.21.15.146:0/1022287332 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e0c131980 0x7f2e0c11c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.919+0000 7f2e1126d700 1 -- 172.21.15.146:0/1022287332 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e08009430 con 0x7f2e0c09c5c0 2023-10-03T10:17:42.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.919+0000 7f2e1126d700 1 --2- 172.21.15.146:0/1022287332 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e0c09c5c0 0x7f2e0c11bdb0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009c70 tx=0x7f2dfc009f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.920+0000 7f2e027fc700 1 -- 172.21.15.146:0/1022287332 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc015070 con 0x7f2e0c09c5c0 2023-10-03T10:17:42.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.920+0000 7f2e027fc700 1 -- 172.21.15.146:0/1022287332 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dfc00b8a0 con 0x7f2e0c09c5c0 2023-10-03T10:17:42.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.920+0000 7f2e027fc700 1 -- 172.21.15.146:0/1022287332 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc00bc10 con 0x7f2e0c09c5c0 2023-10-03T10:17:42.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.920+0000 7f2e13cd2700 1 -- 172.21.15.146:0/1022287332 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0c11da20 con 0x7f2e0c09c5c0 2023-10-03T10:17:42.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.920+0000 7f2e13cd2700 1 -- 172.21.15.146:0/1022287332 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0c0a1c40 con 0x7f2e0c09c5c0 2023-10-03T10:17:42.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.920+0000 7f2e027fc700 1 -- 172.21.15.146:0/1022287332 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2dfc019410 con 0x7f2e0c09c5c0 2023-10-03T10:17:42.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.921+0000 7f2e027fc700 1 -- 172.21.15.146:0/1022287332 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2dfc042ef0 con 0x7f2e0c09c5c0 2023-10-03T10:17:42.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.921+0000 7f2e13cd2700 1 -- 172.21.15.146:0/1022287332 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e0c04f2a0 con 0x7f2e0c09c5c0 2023-10-03T10:17:42.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:42.925+0000 7f2e027fc700 1 -- 172.21.15.146:0/1022287332 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2dfc01e020 con 0x7f2e0c09c5c0 2023-10-03T10:17:43.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.013+0000 7f8d2444d700 1 -- 172.21.15.146:0/1513487036 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8d1c06c3b0 con 0x7f8d1c09e170 2023-10-03T10:17:43.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.014+0000 7f8d12ffd700 1 -- 172.21.15.146:0/1513487036 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d0c011360 con 0x7f8d1c09e170 2023-10-03T10:17:43.014 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:43.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.016+0000 7f8d2444d700 1 -- 172.21.15.146:0/1513487036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c09e170 msgr2=0x7f8d1c11e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.016+0000 7f8d2444d700 1 --2- 172.21.15.146:0/1513487036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c09e170 0x7f8d1c11e8c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00c520 tx=0x7f8d0c00c830 comp rx=0 tx=0).stop 2023-10-03T10:17:43.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.016+0000 7f8d2444d700 1 -- 172.21.15.146:0/1513487036 shutdown_connections 2023-10-03T10:17:43.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.016+0000 7f8d2444d700 1 --2- 172.21.15.146:0/1513487036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d1c130eb0 0x7f8d1c11ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.016+0000 7f8d2444d700 1 --2- 172.21.15.146:0/1513487036 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d1c09d860 0x7f8d1c11e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.016+0000 7f8d2444d700 1 --2- 172.21.15.146:0/1513487036 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d1c09e170 0x7f8d1c11e8c0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.016+0000 7f8d2444d700 1 -- 172.21.15.146:0/1513487036 >> 172.21.15.146:0/1513487036 conn(0x7f8d1c099c40 msgr2=0x7f8d1c070de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.016+0000 7f8d2444d700 1 -- 172.21.15.146:0/1513487036 shutdown_connections 2023-10-03T10:17:43.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.016+0000 7f8d2444d700 1 -- 172.21.15.146:0/1513487036 wait complete. 2023-10-03T10:17:43.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:43.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.114+0000 7f3cd50d6700 1 -- 172.21.15.146:0/2093747895 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3cd0072980 con 0x7f3cd0133f50 2023-10-03T10:17:43.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.115+0000 7f3cb77fe700 1 -- 172.21.15.146:0/2093747895 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3cc8036090 con 0x7f3cd0133f50 2023-10-03T10:17:43.116 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:43.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.117+0000 7f3cd50d6700 1 -- 172.21.15.146:0/2093747895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cd0133f50 msgr2=0x7f3cd011fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.117+0000 7f3cd50d6700 1 --2- 172.21.15.146:0/2093747895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cd0133f50 0x7f3cd011fd70 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8016000 tx=0x7f3cc8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.117+0000 7f3cd50d6700 1 -- 172.21.15.146:0/2093747895 shutdown_connections 2023-10-03T10:17:43.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.117+0000 7f3cd50d6700 1 --2- 172.21.15.146:0/2093747895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cd0133f50 0x7f3cd011fd70 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.117+0000 7f3cd50d6700 1 --2- 172.21.15.146:0/2093747895 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cd00a0a70 0x7f3cd011f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.117+0000 7f3cd50d6700 1 --2- 172.21.15.146:0/2093747895 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cd00a1380 0x7f3cd011f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.117+0000 7f3cd50d6700 1 -- 172.21.15.146:0/2093747895 >> 172.21.15.146:0/2093747895 conn(0x7f3cd00a6610 msgr2=0x7f3cd009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.117+0000 7f3cd50d6700 1 -- 172.21.15.146:0/2093747895 shutdown_connections 2023-10-03T10:17:43.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.117+0000 7f3cd50d6700 1 -- 172.21.15.146:0/2093747895 wait complete. 2023-10-03T10:17:43.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.119+0000 7f2e13cd2700 1 -- 172.21.15.146:0/1022287332 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2e0c06e130 con 0x7f2e0c09c5c0 2023-10-03T10:17:43.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.119+0000 7f2e027fc700 1 -- 172.21.15.146:0/1022287332 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2dfc017310 con 0x7f2e0c09c5c0 2023-10-03T10:17:43.120 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:43.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.121+0000 7f2e13cd2700 1 -- 172.21.15.146:0/1022287332 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e0c09c5c0 msgr2=0x7f2e0c11bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.121+0000 7f2e13cd2700 1 --2- 172.21.15.146:0/1022287332 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e0c09c5c0 0x7f2e0c11bdb0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009c70 tx=0x7f2dfc009f80 comp rx=0 tx=0).stop 2023-10-03T10:17:43.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.122+0000 7f2e13cd2700 1 -- 172.21.15.146:0/1022287332 shutdown_connections 2023-10-03T10:17:43.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.122+0000 7f2e13cd2700 1 --2- 172.21.15.146:0/1022287332 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e0c131980 0x7f2e0c11c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.122+0000 7f2e13cd2700 1 --2- 172.21.15.146:0/1022287332 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2e0c09bc70 0x7f2e0c11b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.122+0000 7f2e13cd2700 1 --2- 172.21.15.146:0/1022287332 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e0c09c5c0 0x7f2e0c11bdb0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.122+0000 7f2e13cd2700 1 -- 172.21.15.146:0/1022287332 >> 172.21.15.146:0/1022287332 conn(0x7f2e0c0a2980 msgr2=0x7f2e0c09fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.122+0000 7f2e13cd2700 1 -- 172.21.15.146:0/1022287332 shutdown_connections 2023-10-03T10:17:43.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.122+0000 7f2e13cd2700 1 -- 172.21.15.146:0/1022287332 wait complete. 2023-10-03T10:17:43.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:43.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:43.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.135+0000 7f2a533e5700 1 -- 172.21.15.146:0/3058306970 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2a4c06b2a0 con 0x7f2a4c138f20 2023-10-03T10:17:43.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.136+0000 7f2a41ffb700 1 -- 172.21.15.146:0/3058306970 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2a44031020 con 0x7f2a4c138f20 2023-10-03T10:17:43.136 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:43.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.138+0000 7f2a533e5700 1 -- 172.21.15.146:0/3058306970 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a4c138f20 msgr2=0x7f2a4c127a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.138+0000 7f2a533e5700 1 --2- 172.21.15.146:0/3058306970 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a4c138f20 0x7f2a4c127a20 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c09c220 tx=0x7f2a44004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.138+0000 7f2a533e5700 1 -- 172.21.15.146:0/3058306970 shutdown_connections 2023-10-03T10:17:43.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.138+0000 7f2a533e5700 1 --2- 172.21.15.146:0/3058306970 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2a4c138f20 0x7f2a4c127a20 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.138+0000 7f2a533e5700 1 --2- 172.21.15.146:0/3058306970 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a4c09a670 0x7f2a4c126fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.138+0000 7f2a533e5700 1 --2- 172.21.15.146:0/3058306970 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a4c130460 0x7f2a4c1274e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.138+0000 7f2a533e5700 1 -- 172.21.15.146:0/3058306970 >> 172.21.15.146:0/3058306970 conn(0x7f2a4c0a1ee0 msgr2=0x7f2a4c09c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.138+0000 7f2a533e5700 1 -- 172.21.15.146:0/3058306970 shutdown_connections 2023-10-03T10:17:43.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:43.138+0000 7f2a533e5700 1 -- 172.21.15.146:0/3058306970 wait complete. 2023-10-03T10:17:43.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:44.031 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:44.132 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:44.136 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:44.151 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.162+0000 7f07f3507700 1 Processor -- start 2023-10-03T10:17:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.162+0000 7f07f3507700 1 -- start start 2023-10-03T10:17:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.162+0000 7f07f3507700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07ec136960 0x7f07ec138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.162+0000 7f07f3507700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f07ec139280 0x7f07ec13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.162+0000 7f07f3507700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07ec06b2d0 con 0x7f07ec133ad0 2023-10-03T10:17:44.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.162+0000 7f07f3507700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07ec1345b0 con 0x7f07ec139280 2023-10-03T10:17:44.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.162+0000 7f07f3507700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec133610 con 0x7f07ec136960 2023-10-03T10:17:44.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.162+0000 7f07f12a3700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f07ec133ad0 0x7f07ec133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45100/0 (socket says 172.21.15.146:45100) 2023-10-03T10:17:44.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.162+0000 7f07f12a3700 1 -- 172.21.15.146:0/3164735793 learned_addr learned my addr 172.21.15.146:0/3164735793 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:44.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.162+0000 7f07f1aa4700 1 --2- 172.21.15.146:0/3164735793 >> v2:172.21.15.146:3300/0 conn(0x7f07ec139280 0x7f07ec13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.162+0000 7f07f0aa2700 1 --2- 172.21.15.146:0/3164735793 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07ec136960 0x7f07ec138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.163+0000 7f07f0aa2700 1 -- 172.21.15.146:0/3164735793 >> v2:172.21.15.146:3300/0 conn(0x7f07ec139280 msgr2=0x7f07ec13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:44.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.163+0000 7f07f0aa2700 1 --2- 172.21.15.146:0/3164735793 >> v2:172.21.15.146:3300/0 conn(0x7f07ec139280 0x7f07ec13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.163+0000 7f07f0aa2700 1 -- 172.21.15.146:0/3164735793 >> v1:172.21.15.146:6789/0 conn(0x7f07ec133ad0 legacy=0x7f07ec133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.163+0000 7f07f0aa2700 1 -- 172.21.15.146:0/3164735793 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec09a500 con 0x7f07ec136960 2023-10-03T10:17:44.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.163+0000 7f07e3fff700 1 -- 172.21.15.146:0/3164735793 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3848570425 0 0) 0x7f07ec06b2d0 con 0x7f07ec133ad0 2023-10-03T10:17:44.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.163+0000 7f07f1aa4700 1 --2- 172.21.15.146:0/3164735793 >> v2:172.21.15.146:3300/0 conn(0x7f07ec139280 0x7f07ec13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.163+0000 7f07f0aa2700 1 --2- 172.21.15.146:0/3164735793 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07ec136960 0x7f07ec138d40 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f07dc009870 tx=0x7f07dc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4144f293a610e2af server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.163+0000 7f07e3fff700 1 -- 172.21.15.146:0/3164735793 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc011830 con 0x7f07ec136960 2023-10-03T10:17:44.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.163+0000 7f07e3fff700 1 -- 172.21.15.146:0/3164735793 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07dc011990 con 0x7f07ec136960 2023-10-03T10:17:44.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.163+0000 7f07e3fff700 1 -- 172.21.15.146:0/3164735793 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc011d20 con 0x7f07ec136960 2023-10-03T10:17:44.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.164+0000 7f07f3507700 1 -- 172.21.15.146:0/3164735793 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07ec136960 msgr2=0x7f07ec138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.164+0000 7f07f3507700 1 --2- 172.21.15.146:0/3164735793 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07ec136960 0x7f07ec138d40 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f07dc009870 tx=0x7f07dc009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:44.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.165+0000 7f07f3507700 1 -- 172.21.15.146:0/3164735793 shutdown_connections 2023-10-03T10:17:44.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.165+0000 7f07f3507700 1 --2- 172.21.15.146:0/3164735793 >> v2:172.21.15.146:3300/0 conn(0x7f07ec139280 0x7f07ec13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.165+0000 7f07f3507700 1 --2- 172.21.15.146:0/3164735793 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07ec136960 0x7f07ec138d40 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.165+0000 7f07f3507700 1 -- 172.21.15.146:0/3164735793 >> 172.21.15.146:0/3164735793 conn(0x7f07ec099c40 msgr2=0x7f07ec0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.165+0000 7f07f3507700 1 -- 172.21.15.146:0/3164735793 shutdown_connections 2023-10-03T10:17:44.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.165+0000 7f07f3507700 1 -- 172.21.15.146:0/3164735793 wait complete. 2023-10-03T10:17:44.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.166+0000 7f07f3507700 1 Processor -- start 2023-10-03T10:17:44.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.166+0000 7f07f3507700 1 -- start start 2023-10-03T10:17:44.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.167+0000 7f07f3507700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07ec133ad0 0x7f07ec071770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.167+0000 7f07f3507700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07ec136960 0x7f07ec071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.167+0000 7f07f3507700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07ec139280 0x7f07ec1c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.167+0000 7f07f3507700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec1303b0 con 0x7f07ec139280 2023-10-03T10:17:44.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.167+0000 7f07f3507700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec09f390 con 0x7f07ec133ad0 2023-10-03T10:17:44.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.167+0000 7f07f3507700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec130b60 con 0x7f07ec136960 2023-10-03T10:17:44.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.167+0000 7f07f12a3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07ec133ad0 0x7f07ec071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.167+0000 7f07f1aa4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07ec139280 0x7f07ec1c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.167+0000 7f07f1aa4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07ec139280 0x7f07ec1c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33442/0 (socket says 172.21.15.146:33442) 2023-10-03T10:17:44.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.167+0000 7f07f12a3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07ec133ad0 0x7f07ec071770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:56918/0 (socket says 172.21.15.146:56918) 2023-10-03T10:17:44.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.167+0000 7f07f1aa4700 1 -- 172.21.15.146:0/4243139414 learned_addr learned my addr 172.21.15.146:0/4243139414 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:44.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.167+0000 7f07f0aa2700 1 --2- 172.21.15.146:0/4243139414 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07ec136960 0x7f07ec071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.168+0000 7f07f1aa4700 1 -- 172.21.15.146:0/4243139414 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07ec136960 msgr2=0x7f07ec071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.168+0000 7f07f1aa4700 1 --2- 172.21.15.146:0/4243139414 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07ec136960 0x7f07ec071cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.168+0000 7f07f1aa4700 1 -- 172.21.15.146:0/4243139414 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07ec133ad0 msgr2=0x7f07ec071770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.168+0000 7f07f1aa4700 1 --2- 172.21.15.146:0/4243139414 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07ec133ad0 0x7f07ec071770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.168+0000 7f07f1aa4700 1 -- 172.21.15.146:0/4243139414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e4009a70 con 0x7f07ec139280 2023-10-03T10:17:44.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.168+0000 7f07f0aa2700 1 --2- 172.21.15.146:0/4243139414 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07ec136960 0x7f07ec071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.168+0000 7f07f1aa4700 1 --2- 172.21.15.146:0/4243139414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07ec139280 0x7f07ec1c8470 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f07e400efc0 tx=0x7f07e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.168+0000 7f07e1ffb700 1 -- 172.21.15.146:0/4243139414 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e400ca90 con 0x7f07ec139280 2023-10-03T10:17:44.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.168+0000 7f07e1ffb700 1 -- 172.21.15.146:0/4243139414 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e400f040 con 0x7f07ec139280 2023-10-03T10:17:44.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.168+0000 7f07f3507700 1 -- 172.21.15.146:0/4243139414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07dc0094a0 con 0x7f07ec139280 2023-10-03T10:17:44.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.168+0000 7f07e1ffb700 1 -- 172.21.15.146:0/4243139414 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e400ce10 con 0x7f07ec139280 2023-10-03T10:17:44.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.168+0000 7f07f3507700 1 -- 172.21.15.146:0/4243139414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ec070d70 con 0x7f07ec139280 2023-10-03T10:17:44.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.170+0000 7f07f3507700 1 -- 172.21.15.146:0/4243139414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07ec0701e0 con 0x7f07ec139280 2023-10-03T10:17:44.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.170+0000 7f07e1ffb700 1 -- 172.21.15.146:0/4243139414 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07e4003a20 con 0x7f07ec139280 2023-10-03T10:17:44.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.170+0000 7f07e1ffb700 1 -- 172.21.15.146:0/4243139414 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f07e4040550 con 0x7f07ec139280 2023-10-03T10:17:44.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.175+0000 7f07e1ffb700 1 -- 172.21.15.146:0/4243139414 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07e401b770 con 0x7f07ec139280 2023-10-03T10:17:44.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.264+0000 7f23ad609700 1 Processor -- start 2023-10-03T10:17:44.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.264+0000 7f23ad609700 1 -- start start 2023-10-03T10:17:44.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.264+0000 7f23ad609700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f23a809f350 0x7f23a8136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.264+0000 7f23ad609700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a81371c0 0x7f23a81395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.264+0000 7f23ad609700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a809c970 con 0x7f23a809e870 2023-10-03T10:17:44.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.264+0000 7f23ad609700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a80a0920 con 0x7f23a809f350 2023-10-03T10:17:44.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.264+0000 7f23ad609700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23a809f9c0 con 0x7f23a81371c0 2023-10-03T10:17:44.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.265+0000 7f23a67fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f23a809f350 0x7f23a8136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.265+0000 7f23a6ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f23a809e870 0x7f23a809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39276/0 (socket says 172.21.15.146:39276) 2023-10-03T10:17:44.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.265+0000 7f23a6ffd700 1 -- 172.21.15.146:0/1033571376 learned_addr learned my addr 172.21.15.146:0/1033571376 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:44.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.265+0000 7f23a77fe700 1 --2- 172.21.15.146:0/1033571376 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a81371c0 0x7f23a81395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.265+0000 7f23a5ffb700 1 -- 172.21.15.146:0/1033571376 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2384483855 0 0) 0x7f23a809c970 con 0x7f23a809e870 2023-10-03T10:17:44.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.265+0000 7f23a5ffb700 1 -- 172.21.15.146:0/1033571376 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23900035b0 con 0x7f23a809e870 2023-10-03T10:17:44.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.265+0000 7f23a67fc700 1 -- 172.21.15.146:0/1033571376 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a81371c0 msgr2=0x7f23a81395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:44.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.265+0000 7f23a67fc700 1 --2- 172.21.15.146:0/1033571376 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a81371c0 0x7f23a81395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.265+0000 7f23a67fc700 1 -- 172.21.15.146:0/1033571376 >> v1:172.21.15.146:6789/0 conn(0x7f23a809e870 legacy=0x7f23a809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.265+0000 7f23a67fc700 1 -- 172.21.15.146:0/1033571376 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a809bab0 con 0x7f23a809f350 2023-10-03T10:17:44.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.265+0000 7f23a77fe700 1 --2- 172.21.15.146:0/1033571376 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a81371c0 0x7f23a81395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.265+0000 7f23a67fc700 1 --2- 172.21.15.146:0/1033571376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a809f350 0x7f23a8136c80 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f239c009840 tx=0x7f239c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86da21c99a5a369d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.265+0000 7f23a5ffb700 1 -- 172.21.15.146:0/1033571376 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239c011830 con 0x7f23a809f350 2023-10-03T10:17:44.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.266+0000 7f23a5ffb700 1 -- 172.21.15.146:0/1033571376 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239c011990 con 0x7f23a809f350 2023-10-03T10:17:44.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.266+0000 7f23a5ffb700 1 -- 172.21.15.146:0/1033571376 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239c011d20 con 0x7f23a809f350 2023-10-03T10:17:44.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.266+0000 7f23ad609700 1 -- 172.21.15.146:0/1033571376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a809f350 msgr2=0x7f23a8136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.266+0000 7f23ad609700 1 --2- 172.21.15.146:0/1033571376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a809f350 0x7f23a8136c80 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f239c009840 tx=0x7f239c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:44.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.266+0000 7f23ad609700 1 -- 172.21.15.146:0/1033571376 shutdown_connections 2023-10-03T10:17:44.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.266+0000 7f23ad609700 1 --2- 172.21.15.146:0/1033571376 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a81371c0 0x7f23a81395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.266+0000 7f23ad609700 1 --2- 172.21.15.146:0/1033571376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a809f350 0x7f23a8136c80 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.266+0000 7f23ad609700 1 -- 172.21.15.146:0/1033571376 >> 172.21.15.146:0/1033571376 conn(0x7f23a80a4430 msgr2=0x7f23a80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.267+0000 7f23ad609700 1 -- 172.21.15.146:0/1033571376 shutdown_connections 2023-10-03T10:17:44.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.267+0000 7f23ad609700 1 -- 172.21.15.146:0/1033571376 wait complete. 2023-10-03T10:17:44.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.268+0000 7f23ad609700 1 Processor -- start 2023-10-03T10:17:44.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.268+0000 7f23ad609700 1 -- start start 2023-10-03T10:17:44.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.268+0000 7f23ad609700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a809e870 0x7f23a811ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.268+0000 7f23ad609700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a809f350 0x7f23a811ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.268+0000 7f23ad609700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a81371c0 0x7f23a811f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.268+0000 7f23ad609700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a8121e50 con 0x7f23a81371c0 2023-10-03T10:17:44.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.268+0000 7f23ad609700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a809dba0 con 0x7f23a809f350 2023-10-03T10:17:44.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.268+0000 7f23ad609700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23a81206e0 con 0x7f23a809e870 2023-10-03T10:17:44.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.268+0000 7f23a67fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a809f350 0x7f23a811ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.268+0000 7f23a67fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a809f350 0x7f23a811ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43792/0 (socket says 172.21.15.146:43792) 2023-10-03T10:17:44.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.268+0000 7f23a67fc700 1 -- 172.21.15.146:0/3808768274 learned_addr learned my addr 172.21.15.146:0/3808768274 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:44.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.268+0000 7f23a6ffd700 1 --2- 172.21.15.146:0/3808768274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a809e870 0x7f23a811ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.268+0000 7f23a77fe700 1 --2- 172.21.15.146:0/3808768274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a81371c0 0x7f23a811f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.269+0000 7f23a6ffd700 1 -- 172.21.15.146:0/3808768274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a809f350 msgr2=0x7f23a811ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.269+0000 7f23a6ffd700 1 --2- 172.21.15.146:0/3808768274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a809f350 0x7f23a811ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.269+0000 7f23a6ffd700 1 -- 172.21.15.146:0/3808768274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a81371c0 msgr2=0x7f23a811f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.269+0000 7f23a6ffd700 1 --2- 172.21.15.146:0/3808768274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a81371c0 0x7f23a811f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.269+0000 7f23a6ffd700 1 -- 172.21.15.146:0/3808768274 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a0009a70 con 0x7f23a809e870 2023-10-03T10:17:44.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.269+0000 7f23a6ffd700 1 --2- 172.21.15.146:0/3808768274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a809e870 0x7f23a811ea50 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f239800c490 tx=0x7f239800c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.269+0000 7f238f7fe700 1 -- 172.21.15.146:0/3808768274 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2398005d70 con 0x7f23a809e870 2023-10-03T10:17:44.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.269+0000 7f238f7fe700 1 -- 172.21.15.146:0/3808768274 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23980070d0 con 0x7f23a809e870 2023-10-03T10:17:44.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.269+0000 7f23ad609700 1 -- 172.21.15.146:0/3808768274 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f239c0094a0 con 0x7f23a809e870 2023-10-03T10:17:44.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.269+0000 7f238f7fe700 1 -- 172.21.15.146:0/3808768274 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2398007440 con 0x7f23a809e870 2023-10-03T10:17:44.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.269+0000 7f23ad609700 1 -- 172.21.15.146:0/3808768274 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a8122110 con 0x7f23a809e870 2023-10-03T10:17:44.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.270+0000 7f238f7fe700 1 -- 172.21.15.146:0/3808768274 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23980075a0 con 0x7f23a809e870 2023-10-03T10:17:44.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.270+0000 7f23ad609700 1 -- 172.21.15.146:0/3808768274 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a804f2a0 con 0x7f23a809e870 2023-10-03T10:17:44.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.270+0000 7f238f7fe700 1 -- 172.21.15.146:0/3808768274 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f239803ea30 con 0x7f23a809e870 2023-10-03T10:17:44.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.278+0000 7f238f7fe700 1 -- 172.21.15.146:0/3808768274 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2398017080 con 0x7f23a809e870 2023-10-03T10:17:44.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.296+0000 7f2139b44700 1 Processor -- start 2023-10-03T10:17:44.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.296+0000 7f2139b44700 1 -- start start 2023-10-03T10:17:44.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.297+0000 7f2139b44700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f21340a0a70 0x7f21340a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.297+0000 7f2139b44700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21340a1380 0x7f2134133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.297+0000 7f2139b44700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2134133f50 0x7f21341343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.297+0000 7f2139b44700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f213409e9d0 con 0x7f21340a0a70 2023-10-03T10:17:44.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.297+0000 7f2139b44700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213409dc00 con 0x7f21340a1380 2023-10-03T10:17:44.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.297+0000 7f2139b44700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f213409dec0 con 0x7f2134133f50 2023-10-03T10:17:44.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.297+0000 7f2132ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21340a1380 0x7f2134133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.297+0000 7f2132ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21340a1380 0x7f2134133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43804/0 (socket says 172.21.15.146:43804) 2023-10-03T10:17:44.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.297+0000 7f2132ffd700 1 -- 172.21.15.146:0/1678344774 learned_addr learned my addr 172.21.15.146:0/1678344774 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:44.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.297+0000 7f21337fe700 1 --2- 172.21.15.146:0/1678344774 >> v2:172.21.15.146:3300/0 conn(0x7f21340a0a70 0x7f21340a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.297+0000 7f2133fff700 1 --2- 172.21.15.146:0/1678344774 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2134133f50 0x7f21341343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.297+0000 7f21337fe700 1 -- 172.21.15.146:0/1678344774 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2134133f50 msgr2=0x7f21341343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:44.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.297+0000 7f21337fe700 1 --2- 172.21.15.146:0/1678344774 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2134133f50 0x7f21341343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.297+0000 7f21337fe700 1 -- 172.21.15.146:0/1678344774 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21340a1380 msgr2=0x7f2134133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:44.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.297+0000 7f21337fe700 1 --2- 172.21.15.146:0/1678344774 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21340a1380 0x7f2134133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.297+0000 7f21337fe700 1 -- 172.21.15.146:0/1678344774 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213409e6a0 con 0x7f21340a0a70 2023-10-03T10:17:44.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.297+0000 7f2132ffd700 1 --2- 172.21.15.146:0/1678344774 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21340a1380 0x7f2134133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.297+0000 7f21337fe700 1 --2- 172.21.15.146:0/1678344774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21340a0a70 0x7f21340a0e40 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f2124009840 tx=0x7f2124009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc2f894d3927914 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.298+0000 7f21327fc700 1 -- 172.21.15.146:0/1678344774 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124011830 con 0x7f21340a0a70 2023-10-03T10:17:44.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.298+0000 7f21327fc700 1 -- 172.21.15.146:0/1678344774 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2124011990 con 0x7f21340a0a70 2023-10-03T10:17:44.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.298+0000 7f21327fc700 1 -- 172.21.15.146:0/1678344774 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124011d20 con 0x7f21340a0a70 2023-10-03T10:17:44.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.298+0000 7f2139b44700 1 -- 172.21.15.146:0/1678344774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21340a0a70 msgr2=0x7f21340a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.298+0000 7f2139b44700 1 --2- 172.21.15.146:0/1678344774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21340a0a70 0x7f21340a0e40 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f2124009840 tx=0x7f2124009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:44.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.298+0000 7f2139b44700 1 -- 172.21.15.146:0/1678344774 shutdown_connections 2023-10-03T10:17:44.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.298+0000 7f2139b44700 1 --2- 172.21.15.146:0/1678344774 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2134133f50 0x7f21341343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.298+0000 7f2139b44700 1 --2- 172.21.15.146:0/1678344774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21340a0a70 0x7f21340a0e40 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.298+0000 7f2139b44700 1 --2- 172.21.15.146:0/1678344774 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21340a1380 0x7f2134133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.298+0000 7f2139b44700 1 -- 172.21.15.146:0/1678344774 >> 172.21.15.146:0/1678344774 conn(0x7f21340a6610 msgr2=0x7f21340a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.298+0000 7f2139b44700 1 -- 172.21.15.146:0/1678344774 shutdown_connections 2023-10-03T10:17:44.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.299+0000 7f2139b44700 1 -- 172.21.15.146:0/1678344774 wait complete. 2023-10-03T10:17:44.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.300+0000 7f2139b44700 1 Processor -- start 2023-10-03T10:17:44.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.300+0000 7f2139b44700 1 -- start start 2023-10-03T10:17:44.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.300+0000 7f0c14e43700 1 Processor -- start 2023-10-03T10:17:44.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.300+0000 7f0c14e43700 1 -- start start 2023-10-03T10:17:44.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f2139b44700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21340a0a70 0x7f21341c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f2139b44700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21340a1380 0x7f21341c12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f2139b44700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2134133f50 0x7f21341c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f2139b44700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2134120500 con 0x7f21340a1380 2023-10-03T10:17:44.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f2139b44700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2134121940 con 0x7f21340a0a70 2023-10-03T10:17:44.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f2139b44700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21341c1800 con 0x7f2134133f50 2023-10-03T10:17:44.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f2133fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2134133f50 0x7f21341c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f2133fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2134133f50 0x7f21341c3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58308/0 (socket says 172.21.15.146:58308) 2023-10-03T10:17:44.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f2133fff700 1 -- 172.21.15.146:0/336225093 learned_addr learned my addr 172.21.15.146:0/336225093 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:44.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f21337fe700 1 --2- 172.21.15.146:0/336225093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21340a0a70 0x7f21341c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f0c14e43700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c10133ad0 0x7f0c10133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f0c14e43700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c101300a0 0x7f0c101304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f0c14e43700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c101309f0 0x7f0c1013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f0c14e43700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1006b2d0 con 0x7f0c101300a0 2023-10-03T10:17:44.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f0c14e43700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c10133610 con 0x7f0c10133ad0 2023-10-03T10:17:44.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f0c14e43700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1009a500 con 0x7f0c101309f0 2023-10-03T10:17:44.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f21337fe700 1 -- 172.21.15.146:0/336225093 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2134133f50 msgr2=0x7f21341c3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f21337fe700 1 --2- 172.21.15.146:0/336225093 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2134133f50 0x7f21341c3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f21337fe700 1 -- 172.21.15.146:0/336225093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21340a1380 msgr2=0x7f21341c12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f21337fe700 1 --2- 172.21.15.146:0/336225093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21340a1380 0x7f21341c12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f21337fe700 1 -- 172.21.15.146:0/336225093 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2128013a10 con 0x7f21340a0a70 2023-10-03T10:17:44.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f0c0e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c10133ad0 0x7f0c10133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f0c0ed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c101309f0 0x7f0c1013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f0c0e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c10133ad0 0x7f0c10133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43814/0 (socket says 172.21.15.146:43814) 2023-10-03T10:17:44.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f0c0e59c700 1 -- 172.21.15.146:0/1658497387 learned_addr learned my addr 172.21.15.146:0/1658497387 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:44.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.301+0000 7f0c0ed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c101309f0 0x7f0c1013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58322/0 (socket says 172.21.15.146:58322) 2023-10-03T10:17:44.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.302+0000 7f21337fe700 1 --2- 172.21.15.146:0/336225093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21340a0a70 0x7f21341c0d80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f21340a72d0 tx=0x7f2124004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.302+0000 7f0c0ed9d700 1 -- 172.21.15.146:0/1658497387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c10133ad0 msgr2=0x7f0c10133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:44.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.302+0000 7f0c0ed9d700 1 --2- 172.21.15.146:0/1658497387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c10133ad0 0x7f0c10133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.302+0000 7f0c0ed9d700 1 -- 172.21.15.146:0/1658497387 >> v2:172.21.15.146:3300/0 conn(0x7f0c101300a0 msgr2=0x7f0c101304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:44.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.302+0000 7f0c0ed9d700 1 --2- 172.21.15.146:0/1658497387 >> v2:172.21.15.146:3300/0 conn(0x7f0c101300a0 0x7f0c101304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.302+0000 7f0c0ed9d700 1 -- 172.21.15.146:0/1658497387 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c101338b0 con 0x7f0c101309f0 2023-10-03T10:17:44.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.302+0000 7f0c0ed9d700 1 --2- 172.21.15.146:0/1658497387 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c101309f0 0x7f0c1013a980 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0c08009d90 tx=0x7f0c0800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5d2d6afd2d09483 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.302+0000 7f211bfff700 1 -- 172.21.15.146:0/336225093 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124004450 con 0x7f21340a0a70 2023-10-03T10:17:44.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.302+0000 7f2139b44700 1 -- 172.21.15.146:0/336225093 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21240094a0 con 0x7f21340a0a70 2023-10-03T10:17:44.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.302+0000 7f2139b44700 1 -- 172.21.15.146:0/336225093 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21340a4d00 con 0x7f21340a0a70 2023-10-03T10:17:44.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.302+0000 7f0c0d59a700 1 -- 172.21.15.146:0/1658497387 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0800e070 con 0x7f0c101309f0 2023-10-03T10:17:44.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.302+0000 7f0c0d59a700 1 -- 172.21.15.146:0/1658497387 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0800bb20 con 0x7f0c101309f0 2023-10-03T10:17:44.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.302+0000 7f0c0d59a700 1 -- 172.21.15.146:0/1658497387 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c08012430 con 0x7f0c101309f0 2023-10-03T10:17:44.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.303+0000 7f0c14e43700 1 -- 172.21.15.146:0/1658497387 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c101309f0 msgr2=0x7f0c1013a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.303+0000 7f0c14e43700 1 --2- 172.21.15.146:0/1658497387 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c101309f0 0x7f0c1013a980 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0c08009d90 tx=0x7f0c0800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:44.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.302+0000 7f211bfff700 1 -- 172.21.15.146:0/336225093 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212401f070 con 0x7f21340a0a70 2023-10-03T10:17:44.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.302+0000 7f211bfff700 1 -- 172.21.15.146:0/336225093 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21240038a0 con 0x7f21340a0a70 2023-10-03T10:17:44.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.303+0000 7f211bfff700 1 -- 172.21.15.146:0/336225093 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2124003a00 con 0x7f21340a0a70 2023-10-03T10:17:44.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.303+0000 7f2139b44700 1 -- 172.21.15.146:0/336225093 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21140052e0 con 0x7f21340a0a70 2023-10-03T10:17:44.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.303+0000 7f0c14e43700 1 -- 172.21.15.146:0/1658497387 shutdown_connections 2023-10-03T10:17:44.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.303+0000 7f0c14e43700 1 --2- 172.21.15.146:0/1658497387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c10133ad0 0x7f0c10133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.303+0000 7f0c14e43700 1 --2- 172.21.15.146:0/1658497387 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c101309f0 0x7f0c1013a980 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.303+0000 7f0c14e43700 1 --2- 172.21.15.146:0/1658497387 >> v2:172.21.15.146:3300/0 conn(0x7f0c101300a0 0x7f0c101304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.303+0000 7f0c14e43700 1 -- 172.21.15.146:0/1658497387 >> 172.21.15.146:0/1658497387 conn(0x7f0c10099c40 msgr2=0x7f0c100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.303+0000 7f0c14e43700 1 -- 172.21.15.146:0/1658497387 shutdown_connections 2023-10-03T10:17:44.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.303+0000 7f211bfff700 1 -- 172.21.15.146:0/336225093 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2124021070 con 0x7f21340a0a70 2023-10-03T10:17:44.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.303+0000 7f0c14e43700 1 -- 172.21.15.146:0/1658497387 wait complete. 2023-10-03T10:17:44.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.305+0000 7f0c14e43700 1 Processor -- start 2023-10-03T10:17:44.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.305+0000 7f0c14e43700 1 -- start start 2023-10-03T10:17:44.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.306+0000 7f0c14e43700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c101300a0 0x7f0c1011cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.306+0000 7f0c14e43700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c101309f0 0x7f0c10119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.306+0000 7f0c14e43700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c10133ad0 0x7f0c10119b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.306+0000 7f0c14e43700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1012f840 con 0x7f0c10133ad0 2023-10-03T10:17:44.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.306+0000 7f0c14e43700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1011b800 con 0x7f0c101309f0 2023-10-03T10:17:44.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.306+0000 7f0c14e43700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1012dd00 con 0x7f0c101300a0 2023-10-03T10:17:44.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.306+0000 7f0c0e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c101300a0 0x7f0c1011cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.306+0000 7f0c0e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c101300a0 0x7f0c1011cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58324/0 (socket says 172.21.15.146:58324) 2023-10-03T10:17:44.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.306+0000 7f0c0dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c101309f0 0x7f0c10119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.306+0000 7f0c0e59c700 1 -- 172.21.15.146:0/4048610552 learned_addr learned my addr 172.21.15.146:0/4048610552 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:44.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.306+0000 7f0c0ed9d700 1 --2- 172.21.15.146:0/4048610552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c10133ad0 0x7f0c10119b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.306+0000 7f0c0dd9b700 1 -- 172.21.15.146:0/4048610552 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c101300a0 msgr2=0x7f0c1011cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.306+0000 7f0c0dd9b700 1 --2- 172.21.15.146:0/4048610552 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c101300a0 0x7f0c1011cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.306+0000 7f0c0dd9b700 1 -- 172.21.15.146:0/4048610552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c10133ad0 msgr2=0x7f0c10119b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.306+0000 7f0c0dd9b700 1 --2- 172.21.15.146:0/4048610552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c10133ad0 0x7f0c10119b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.306+0000 7f0c0dd9b700 1 -- 172.21.15.146:0/4048610552 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c08009a70 con 0x7f0c101309f0 2023-10-03T10:17:44.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.306+0000 7f0c0e59c700 1 --2- 172.21.15.146:0/4048610552 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c101300a0 0x7f0c1011cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.307+0000 7f0c0dd9b700 1 --2- 172.21.15.146:0/4048610552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c101309f0 0x7f0c10119630 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0c1009ea20 tx=0x7f0c0400b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.308+0000 7f0bfeffd700 1 -- 172.21.15.146:0/4048610552 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04011830 con 0x7f0c101309f0 2023-10-03T10:17:44.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.308+0000 7f0bfeffd700 1 -- 172.21.15.146:0/4048610552 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c04011990 con 0x7f0c101309f0 2023-10-03T10:17:44.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.308+0000 7f0c14e43700 1 -- 172.21.15.146:0/4048610552 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c1011c980 con 0x7f0c101309f0 2023-10-03T10:17:44.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.308+0000 7f0bfeffd700 1 -- 172.21.15.146:0/4048610552 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04011d40 con 0x7f0c101309f0 2023-10-03T10:17:44.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.308+0000 7f0c14e43700 1 -- 172.21.15.146:0/4048610552 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c10071890 con 0x7f0c101309f0 2023-10-03T10:17:44.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.308+0000 7f211bfff700 1 -- 172.21.15.146:0/336225093 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21240045b0 con 0x7f21340a0a70 2023-10-03T10:17:44.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.309+0000 7f0c14e43700 1 -- 172.21.15.146:0/4048610552 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c1004f2a0 con 0x7f0c101309f0 2023-10-03T10:17:44.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.314+0000 7f0bfeffd700 1 -- 172.21.15.146:0/4048610552 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c0401a400 con 0x7f0c101309f0 2023-10-03T10:17:44.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.314+0000 7f0bfeffd700 1 -- 172.21.15.146:0/4048610552 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0c0403fc80 con 0x7f0c101309f0 2023-10-03T10:17:44.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.319+0000 7f0bfeffd700 1 -- 172.21.15.146:0/4048610552 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c04021300 con 0x7f0c101309f0 2023-10-03T10:17:44.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.407+0000 7f07f3507700 1 -- 172.21.15.146:0/4243139414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f07ec070440 con 0x7f07ec139280 2023-10-03T10:17:44.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.407+0000 7f07e1ffb700 1 -- 172.21.15.146:0/4243139414 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f07ec070440 con 0x7f07ec139280 2023-10-03T10:17:44.408 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:44.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.410+0000 7f07f3507700 1 -- 172.21.15.146:0/4243139414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07ec139280 msgr2=0x7f07ec1c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.410+0000 7f07f3507700 1 --2- 172.21.15.146:0/4243139414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07ec139280 0x7f07ec1c8470 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f07e400efc0 tx=0x7f07e400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.410+0000 7f07f3507700 1 -- 172.21.15.146:0/4243139414 shutdown_connections 2023-10-03T10:17:44.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.410+0000 7f07f3507700 1 --2- 172.21.15.146:0/4243139414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07ec139280 0x7f07ec1c8470 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.410+0000 7f07f3507700 1 --2- 172.21.15.146:0/4243139414 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07ec133ad0 0x7f07ec071770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.410+0000 7f07f3507700 1 --2- 172.21.15.146:0/4243139414 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07ec136960 0x7f07ec071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.410+0000 7f07f3507700 1 -- 172.21.15.146:0/4243139414 >> 172.21.15.146:0/4243139414 conn(0x7f07ec099c40 msgr2=0x7f07ec137150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.410+0000 7f07f3507700 1 -- 172.21.15.146:0/4243139414 shutdown_connections 2023-10-03T10:17:44.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.410+0000 7f07f3507700 1 -- 172.21.15.146:0/4243139414 wait complete. 2023-10-03T10:17:44.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:44.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.479+0000 7f23ad609700 1 -- 172.21.15.146:0/3808768274 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f23a806b2a0 con 0x7f23a809e870 2023-10-03T10:17:44.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.479+0000 7f238f7fe700 1 -- 172.21.15.146:0/3808768274 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f23980192c0 con 0x7f23a809e870 2023-10-03T10:17:44.480 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:44.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.481+0000 7f23ad609700 1 -- 172.21.15.146:0/3808768274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a809e870 msgr2=0x7f23a811ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.482+0000 7f23ad609700 1 --2- 172.21.15.146:0/3808768274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a809e870 0x7f23a811ea50 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f239800c490 tx=0x7f239800c7a0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.482+0000 7f23ad609700 1 -- 172.21.15.146:0/3808768274 shutdown_connections 2023-10-03T10:17:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.482+0000 7f23ad609700 1 --2- 172.21.15.146:0/3808768274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a81371c0 0x7f23a811f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.482+0000 7f23ad609700 1 --2- 172.21.15.146:0/3808768274 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23a809e870 0x7f23a811ea50 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.482+0000 7f23ad609700 1 --2- 172.21.15.146:0/3808768274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23a809f350 0x7f23a811ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.482+0000 7f23ad609700 1 -- 172.21.15.146:0/3808768274 >> 172.21.15.146:0/3808768274 conn(0x7f23a80a4430 msgr2=0x7f23a809d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.482+0000 7f23ad609700 1 -- 172.21.15.146:0/3808768274 shutdown_connections 2023-10-03T10:17:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.482+0000 7f23ad609700 1 -- 172.21.15.146:0/3808768274 wait complete. 2023-10-03T10:17:44.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:44.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.502+0000 7f2139b44700 1 -- 172.21.15.146:0/336225093 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2114005590 con 0x7f21340a0a70 2023-10-03T10:17:44.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.502+0000 7f211bfff700 1 -- 172.21.15.146:0/336225093 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2124015020 con 0x7f21340a0a70 2023-10-03T10:17:44.503 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:44.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.504+0000 7f2139b44700 1 -- 172.21.15.146:0/336225093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21340a0a70 msgr2=0x7f21341c0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.504+0000 7f2139b44700 1 --2- 172.21.15.146:0/336225093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21340a0a70 0x7f21341c0d80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f21340a72d0 tx=0x7f2124004750 comp rx=0 tx=0).stop 2023-10-03T10:17:44.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.504+0000 7f2139b44700 1 -- 172.21.15.146:0/336225093 shutdown_connections 2023-10-03T10:17:44.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.504+0000 7f2139b44700 1 --2- 172.21.15.146:0/336225093 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2134133f50 0x7f21341c3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.504+0000 7f2139b44700 1 --2- 172.21.15.146:0/336225093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21340a0a70 0x7f21341c0d80 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.504+0000 7f2139b44700 1 --2- 172.21.15.146:0/336225093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21340a1380 0x7f21341c12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.504+0000 7f2139b44700 1 -- 172.21.15.146:0/336225093 >> 172.21.15.146:0/336225093 conn(0x7f21340a6610 msgr2=0x7f213409b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.504+0000 7f2139b44700 1 -- 172.21.15.146:0/336225093 shutdown_connections 2023-10-03T10:17:44.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.504+0000 7f2139b44700 1 -- 172.21.15.146:0/336225093 wait complete. 2023-10-03T10:17:44.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:44.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.535+0000 7f0c14e43700 1 -- 172.21.15.146:0/4048610552 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0c1012f570 con 0x7f0c101309f0 2023-10-03T10:17:44.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.536+0000 7f0bfeffd700 1 -- 172.21.15.146:0/4048610552 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c04028090 con 0x7f0c101309f0 2023-10-03T10:17:44.536 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:44.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.538+0000 7f0c14e43700 1 -- 172.21.15.146:0/4048610552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c101309f0 msgr2=0x7f0c10119630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.538+0000 7f0c14e43700 1 --2- 172.21.15.146:0/4048610552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c101309f0 0x7f0c10119630 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0c1009ea20 tx=0x7f0c0400b730 comp rx=0 tx=0).stop 2023-10-03T10:17:44.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.538+0000 7f0c14e43700 1 -- 172.21.15.146:0/4048610552 shutdown_connections 2023-10-03T10:17:44.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.538+0000 7f0c14e43700 1 --2- 172.21.15.146:0/4048610552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c10133ad0 0x7f0c10119b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.538+0000 7f0c14e43700 1 --2- 172.21.15.146:0/4048610552 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c101300a0 0x7f0c1011cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.538+0000 7f0c14e43700 1 --2- 172.21.15.146:0/4048610552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c101309f0 0x7f0c10119630 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.538+0000 7f0c14e43700 1 -- 172.21.15.146:0/4048610552 >> 172.21.15.146:0/4048610552 conn(0x7f0c10099c40 msgr2=0x7f0c1012e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.538+0000 7f0c14e43700 1 -- 172.21.15.146:0/4048610552 shutdown_connections 2023-10-03T10:17:44.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:44.538+0000 7f0c14e43700 1 -- 172.21.15.146:0/4048610552 wait complete. 2023-10-03T10:17:44.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:45.425 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:45.495 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:45.519 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:45.551 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:45.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.565+0000 7f6e5d2d1700 1 Processor -- start 2023-10-03T10:17:45.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.565+0000 7f6e5d2d1700 1 -- start start 2023-10-03T10:17:45.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.566+0000 7f6e5d2d1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e58133a70 0x7f6e58133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.566+0000 7f6e5d2d1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6e580a08e0 0x7f6e580a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.566+0000 7f6e5d2d1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e58133640 con 0x7f6e580a1290 2023-10-03T10:17:45.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.566+0000 7f6e5d2d1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e580a1d50 con 0x7f6e580a08e0 2023-10-03T10:17:45.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.566+0000 7f6e5d2d1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5809b620 con 0x7f6e58133a70 2023-10-03T10:17:45.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.566+0000 7f6e567fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6e580a08e0 0x7f6e580a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.566+0000 7f6e56ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e58133a70 0x7f6e58133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.566+0000 7f6e567fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6e580a08e0 0x7f6e580a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60066/0 (socket says 172.21.15.146:60066) 2023-10-03T10:17:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.566+0000 7f6e577fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6e580a1290 0x7f6e5813a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39284/0 (socket says 172.21.15.146:39284) 2023-10-03T10:17:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.566+0000 7f6e567fc700 1 -- 172.21.15.146:0/1180025017 learned_addr learned my addr 172.21.15.146:0/1180025017 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.567+0000 7f6e56ffd700 1 -- 172.21.15.146:0/1180025017 >> v2:172.21.15.146:3300/0 conn(0x7f6e580a08e0 msgr2=0x7f6e580a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.567+0000 7f6e56ffd700 1 --2- 172.21.15.146:0/1180025017 >> v2:172.21.15.146:3300/0 conn(0x7f6e580a08e0 0x7f6e580a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.567+0000 7f6e56ffd700 1 -- 172.21.15.146:0/1180025017 >> v1:172.21.15.146:6789/0 conn(0x7f6e580a1290 legacy=0x7f6e5813a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.567+0000 7f6e55ffb700 1 -- 172.21.15.146:0/1180025017 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306400367 0 0) 0x7f6e58133640 con 0x7f6e580a1290 2023-10-03T10:17:45.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.567+0000 7f6e56ffd700 1 -- 172.21.15.146:0/1180025017 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e58133870 con 0x7f6e58133a70 2023-10-03T10:17:45.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.567+0000 7f6e56ffd700 1 --2- 172.21.15.146:0/1180025017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e58133a70 0x7f6e58133e40 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009820 tx=0x7f6e48009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2da00e0c17a28b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.567+0000 7f6e55ffb700 1 -- 172.21.15.146:0/1180025017 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48005e30 con 0x7f6e58133a70 2023-10-03T10:17:45.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.567+0000 7f6e55ffb700 1 -- 172.21.15.146:0/1180025017 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e48006030 con 0x7f6e58133a70 2023-10-03T10:17:45.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.567+0000 7f6e55ffb700 1 -- 172.21.15.146:0/1180025017 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e480063c0 con 0x7f6e58133a70 2023-10-03T10:17:45.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.568+0000 7f6e5d2d1700 1 -- 172.21.15.146:0/1180025017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e58133a70 msgr2=0x7f6e58133e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.568+0000 7f6e5d2d1700 1 --2- 172.21.15.146:0/1180025017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e58133a70 0x7f6e58133e40 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009820 tx=0x7f6e48009b30 comp rx=0 tx=0).stop 2023-10-03T10:17:45.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.568+0000 7f6e5d2d1700 1 -- 172.21.15.146:0/1180025017 shutdown_connections 2023-10-03T10:17:45.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.568+0000 7f6e5d2d1700 1 --2- 172.21.15.146:0/1180025017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e58133a70 0x7f6e58133e40 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.568+0000 7f6e5d2d1700 1 --2- 172.21.15.146:0/1180025017 >> v2:172.21.15.146:3300/0 conn(0x7f6e580a08e0 0x7f6e580a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.568+0000 7f6e5d2d1700 1 -- 172.21.15.146:0/1180025017 >> 172.21.15.146:0/1180025017 conn(0x7f6e580a2980 msgr2=0x7f6e580a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.568+0000 7f6e5d2d1700 1 -- 172.21.15.146:0/1180025017 shutdown_connections 2023-10-03T10:17:45.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.568+0000 7f6e5d2d1700 1 -- 172.21.15.146:0/1180025017 wait complete. 2023-10-03T10:17:45.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.569+0000 7f6e5d2d1700 1 Processor -- start 2023-10-03T10:17:45.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.569+0000 7f6e5d2d1700 1 -- start start 2023-10-03T10:17:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.570+0000 7f6e5d2d1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e580a08e0 0x7f6e5811c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.570+0000 7f6e5d2d1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e580a1290 0x7f6e5811cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.570+0000 7f6e5d2d1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e58133a70 0x7f6e5811d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.570+0000 7f6e5d2d1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5811e5b0 con 0x7f6e580a1290 2023-10-03T10:17:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.570+0000 7f6e5d2d1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5811e3c0 con 0x7f6e580a08e0 2023-10-03T10:17:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.570+0000 7f6e5d2d1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5809a350 con 0x7f6e58133a70 2023-10-03T10:17:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.570+0000 7f6e56ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e580a08e0 0x7f6e5811c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.570+0000 7f6e56ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e580a08e0 0x7f6e5811c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43836/0 (socket says 172.21.15.146:43836) 2023-10-03T10:17:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.570+0000 7f6e56ffd700 1 -- 172.21.15.146:0/2984213809 learned_addr learned my addr 172.21.15.146:0/2984213809 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.570+0000 7f6e567fc700 1 --2- 172.21.15.146:0/2984213809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e580a1290 0x7f6e5811cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.571+0000 7f6e567fc700 1 -- 172.21.15.146:0/2984213809 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e58133a70 msgr2=0x7f6e5811d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.571+0000 7f6e567fc700 1 --2- 172.21.15.146:0/2984213809 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e58133a70 0x7f6e5811d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.571+0000 7f6e567fc700 1 -- 172.21.15.146:0/2984213809 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e580a08e0 msgr2=0x7f6e5811c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.571+0000 7f6e567fc700 1 --2- 172.21.15.146:0/2984213809 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e580a08e0 0x7f6e5811c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.571+0000 7f6e567fc700 1 -- 172.21.15.146:0/2984213809 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e48009430 con 0x7f6e580a1290 2023-10-03T10:17:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.571+0000 7f6e56ffd700 1 --2- 172.21.15.146:0/2984213809 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e580a08e0 0x7f6e5811c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.571+0000 7f6e567fc700 1 --2- 172.21.15.146:0/2984213809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e580a1290 0x7f6e5811cd70 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00e870 tx=0x7f6e4c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.571+0000 7f6e3f7fe700 1 -- 172.21.15.146:0/2984213809 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c013680 con 0x7f6e580a1290 2023-10-03T10:17:45.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.571+0000 7f6e3f7fe700 1 -- 172.21.15.146:0/2984213809 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4c0137e0 con 0x7f6e580a1290 2023-10-03T10:17:45.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.571+0000 7f6e3f7fe700 1 -- 172.21.15.146:0/2984213809 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c013b50 con 0x7f6e580a1290 2023-10-03T10:17:45.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.571+0000 7f6e5d2d1700 1 -- 172.21.15.146:0/2984213809 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5811fd30 con 0x7f6e580a1290 2023-10-03T10:17:45.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.571+0000 7f6e5d2d1700 1 -- 172.21.15.146:0/2984213809 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5811f1c0 con 0x7f6e580a1290 2023-10-03T10:17:45.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.572+0000 7f6e5d2d1700 1 -- 172.21.15.146:0/2984213809 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e581203a0 con 0x7f6e580a1290 2023-10-03T10:17:45.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.572+0000 7f6e3f7fe700 1 -- 172.21.15.146:0/2984213809 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e4c013cb0 con 0x7f6e580a1290 2023-10-03T10:17:45.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.573+0000 7f6e3f7fe700 1 -- 172.21.15.146:0/2984213809 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6e4c03f530 con 0x7f6e580a1290 2023-10-03T10:17:45.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.577+0000 7f6e3f7fe700 1 -- 172.21.15.146:0/2984213809 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e4c01bde0 con 0x7f6e580a1290 2023-10-03T10:17:45.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.639+0000 7fc09e39a700 1 Processor -- start 2023-10-03T10:17:45.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.640+0000 7fc09e39a700 1 -- start start 2023-10-03T10:17:45.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.640+0000 7fc09e39a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0980a1550 0x7fc098138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.640+0000 7fc09e39a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc098139200 0x7fc09813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.640+0000 7fc09e39a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09809e9d0 con 0x7fc0980a0a70 2023-10-03T10:17:45.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.640+0000 7fc09e39a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09809dc00 con 0x7fc098139200 2023-10-03T10:17:45.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.640+0000 7fc09e39a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc09809dec0 con 0x7fc0980a1550 2023-10-03T10:17:45.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.640+0000 7fc09c937700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc098139200 0x7fc09813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.640+0000 7fc09c937700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc098139200 0x7fc09813b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60074/0 (socket says 172.21.15.146:60074) 2023-10-03T10:17:45.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.640+0000 7fc097fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc0980a0a70 0x7fc0980a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39294/0 (socket says 172.21.15.146:39294) 2023-10-03T10:17:45.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.641+0000 7fc0977fe700 1 --2- 172.21.15.146:0/3059526709 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0980a1550 0x7fc098138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.641+0000 7fc09c937700 1 -- 172.21.15.146:0/3059526709 learned_addr learned my addr 172.21.15.146:0/3059526709 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:45.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.641+0000 7fc09c937700 1 -- 172.21.15.146:0/3059526709 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0980a1550 msgr2=0x7fc098138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:45.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.641+0000 7fc09c937700 1 --2- 172.21.15.146:0/3059526709 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0980a1550 0x7fc098138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.641+0000 7fc09c937700 1 -- 172.21.15.146:0/3059526709 >> v1:172.21.15.146:6789/0 conn(0x7fc0980a0a70 legacy=0x7fc0980a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.641+0000 7fc09c937700 1 -- 172.21.15.146:0/3059526709 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09809e6a0 con 0x7fc098139200 2023-10-03T10:17:45.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.641+0000 7fc09c937700 1 --2- 172.21.15.146:0/3059526709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc098139200 0x7fc09813b5e0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fc090009e50 tx=0x7fc09000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61975d04aa8d9d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.641+0000 7fc096ffd700 1 -- 172.21.15.146:0/3059526709 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09000e070 con 0x7fc098139200 2023-10-03T10:17:45.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.641+0000 7fc096ffd700 1 -- 172.21.15.146:0/3059526709 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09000b9c0 con 0x7fc098139200 2023-10-03T10:17:45.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.641+0000 7fc096ffd700 1 -- 172.21.15.146:0/3059526709 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09000bd70 con 0x7fc098139200 2023-10-03T10:17:45.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.642+0000 7fc09e39a700 1 -- 172.21.15.146:0/3059526709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc098139200 msgr2=0x7fc09813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.642+0000 7fc09e39a700 1 --2- 172.21.15.146:0/3059526709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc098139200 0x7fc09813b5e0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fc090009e50 tx=0x7fc09000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:45.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.642+0000 7fc09e39a700 1 -- 172.21.15.146:0/3059526709 shutdown_connections 2023-10-03T10:17:45.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.642+0000 7fc09e39a700 1 --2- 172.21.15.146:0/3059526709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc098139200 0x7fc09813b5e0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.642+0000 7fc09e39a700 1 --2- 172.21.15.146:0/3059526709 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0980a1550 0x7fc098138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.642+0000 7fc09e39a700 1 -- 172.21.15.146:0/3059526709 >> 172.21.15.146:0/3059526709 conn(0x7fc0980a6610 msgr2=0x7fc0980a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.642+0000 7fc09e39a700 1 -- 172.21.15.146:0/3059526709 shutdown_connections 2023-10-03T10:17:45.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.642+0000 7fc09e39a700 1 -- 172.21.15.146:0/3059526709 wait complete. 2023-10-03T10:17:45.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.644+0000 7fc09e39a700 1 Processor -- start 2023-10-03T10:17:45.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.644+0000 7fc09e39a700 1 -- start start 2023-10-03T10:17:45.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.645+0000 7fc09e39a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0980a0a70 0x7fc09811e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.645+0000 7fc09e39a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0980a1550 0x7fc09811ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.645+0000 7fc09e39a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc098139200 0x7fc09811f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.645+0000 7fc09e39a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc098122260 con 0x7fc0980a1550 2023-10-03T10:17:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.645+0000 7fc09e39a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0980a03e0 con 0x7fc0980a0a70 2023-10-03T10:17:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.645+0000 7fc09e39a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc098121a10 con 0x7fc098139200 2023-10-03T10:17:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.645+0000 7fc09c937700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc098139200 0x7fc09811f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.645+0000 7fc09c937700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc098139200 0x7fc09811f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58344/0 (socket says 172.21.15.146:58344) 2023-10-03T10:17:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.645+0000 7fc09c937700 1 -- 172.21.15.146:0/3172136792 learned_addr learned my addr 172.21.15.146:0/3172136792 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.645+0000 7fc0977fe700 1 --2- 172.21.15.146:0/3172136792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0980a1550 0x7fc09811ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.645+0000 7fc09c937700 1 -- 172.21.15.146:0/3172136792 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0980a0a70 msgr2=0x7fc09811e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.645+0000 7fc09c937700 1 --2- 172.21.15.146:0/3172136792 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0980a0a70 0x7fc09811e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.645+0000 7fc09c937700 1 -- 172.21.15.146:0/3172136792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0980a1550 msgr2=0x7fc09811ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.645+0000 7fc09c937700 1 --2- 172.21.15.146:0/3172136792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0980a1550 0x7fc09811ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.645+0000 7fc09c937700 1 -- 172.21.15.146:0/3172136792 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc090009b30 con 0x7fc098139200 2023-10-03T10:17:45.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.645+0000 7fc09c937700 1 --2- 172.21.15.146:0/3172136792 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc098139200 0x7fc09811f1c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc09809dd40 tx=0x7fc090004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.646+0000 7fc094ff9700 1 -- 172.21.15.146:0/3172136792 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0900048b0 con 0x7fc098139200 2023-10-03T10:17:45.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.646+0000 7fc094ff9700 1 -- 172.21.15.146:0/3172136792 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0900099b0 con 0x7fc098139200 2023-10-03T10:17:45.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.646+0000 7fc09e39a700 1 -- 172.21.15.146:0/3172136792 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc098120350 con 0x7fc098139200 2023-10-03T10:17:45.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.646+0000 7fc094ff9700 1 -- 172.21.15.146:0/3172136792 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09001c680 con 0x7fc098139200 2023-10-03T10:17:45.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.646+0000 7fc09e39a700 1 -- 172.21.15.146:0/3172136792 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0980a5150 con 0x7fc098139200 2023-10-03T10:17:45.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.646+0000 7fc094ff9700 1 -- 172.21.15.146:0/3172136792 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc09001c7e0 con 0x7fc098139200 2023-10-03T10:17:45.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.647+0000 7fc094ff9700 1 -- 172.21.15.146:0/3172136792 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc090041370 con 0x7fc098139200 2023-10-03T10:17:45.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.647+0000 7fc07e7fc700 1 -- 172.21.15.146:0/3172136792 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0700052e0 con 0x7fc098139200 2023-10-03T10:17:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.655+0000 7fc094ff9700 1 -- 172.21.15.146:0/3172136792 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc0900257d0 con 0x7fc098139200 2023-10-03T10:17:45.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.679+0000 7f9c332fe700 1 Processor -- start 2023-10-03T10:17:45.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.680+0000 7f9c332fe700 1 -- start start 2023-10-03T10:17:45.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.680+0000 7f9c332fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c2c133ad0 0x7f9c2c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.680+0000 7f9c332fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9c2c1300a0 0x7f9c2c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.680+0000 7f9c332fe700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c2c06b2d0 con 0x7f9c2c1309f0 2023-10-03T10:17:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.680+0000 7f9c332fe700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c2c133610 con 0x7f9c2c1300a0 2023-10-03T10:17:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.680+0000 7f9c332fe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c09a500 con 0x7f9c2c133ad0 2023-10-03T10:17:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.681+0000 7f9c3109a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c2c133ad0 0x7f9c2c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.681+0000 7f9c3109a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c2c133ad0 0x7f9c2c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58354/0 (socket says 172.21.15.146:58354) 2023-10-03T10:17:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.681+0000 7f9c3109a700 1 -- 172.21.15.146:0/2217101701 learned_addr learned my addr 172.21.15.146:0/2217101701 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.681+0000 7f9c30899700 1 --2- 172.21.15.146:0/2217101701 >> v2:172.21.15.146:3300/0 conn(0x7f9c2c1300a0 0x7f9c2c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.681+0000 7f9c3109a700 1 -- 172.21.15.146:0/2217101701 >> v2:172.21.15.146:3300/0 conn(0x7f9c2c1300a0 msgr2=0x7f9c2c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.681+0000 7f9c3109a700 1 --2- 172.21.15.146:0/2217101701 >> v2:172.21.15.146:3300/0 conn(0x7f9c2c1300a0 0x7f9c2c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.681+0000 7f9c3109a700 1 -- 172.21.15.146:0/2217101701 >> v1:172.21.15.146:6789/0 conn(0x7f9c2c1309f0 legacy=0x7f9c2c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.681+0000 7f9c3109a700 1 -- 172.21.15.146:0/2217101701 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c1338b0 con 0x7f9c2c133ad0 2023-10-03T10:17:45.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.681+0000 7f9c3109a700 1 --2- 172.21.15.146:0/2217101701 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c2c133ad0 0x7f9c2c133ea0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f9c280098f0 tx=0x7f9c28009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7356f4ded6a7360 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.681+0000 7f9c23fff700 1 -- 172.21.15.146:0/2217101701 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c28011830 con 0x7f9c2c133ad0 2023-10-03T10:17:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.681+0000 7f9c23fff700 1 -- 172.21.15.146:0/2217101701 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c28011990 con 0x7f9c2c133ad0 2023-10-03T10:17:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.681+0000 7f9c23fff700 1 -- 172.21.15.146:0/2217101701 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c28011d20 con 0x7f9c2c133ad0 2023-10-03T10:17:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.682+0000 7f9c332fe700 1 -- 172.21.15.146:0/2217101701 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c2c133ad0 msgr2=0x7f9c2c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.682+0000 7f9c332fe700 1 --2- 172.21.15.146:0/2217101701 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c2c133ad0 0x7f9c2c133ea0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f9c280098f0 tx=0x7f9c28009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.682+0000 7f9c332fe700 1 -- 172.21.15.146:0/2217101701 shutdown_connections 2023-10-03T10:17:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.682+0000 7f9c332fe700 1 --2- 172.21.15.146:0/2217101701 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c2c133ad0 0x7f9c2c133ea0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.682+0000 7f9c332fe700 1 --2- 172.21.15.146:0/2217101701 >> v2:172.21.15.146:3300/0 conn(0x7f9c2c1300a0 0x7f9c2c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.682+0000 7f9c332fe700 1 -- 172.21.15.146:0/2217101701 >> 172.21.15.146:0/2217101701 conn(0x7f9c2c099c40 msgr2=0x7f9c2c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.682+0000 7f9c332fe700 1 -- 172.21.15.146:0/2217101701 shutdown_connections 2023-10-03T10:17:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.682+0000 7f9c332fe700 1 -- 172.21.15.146:0/2217101701 wait complete. 2023-10-03T10:17:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.684+0000 7f9c332fe700 1 Processor -- start 2023-10-03T10:17:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.684+0000 7f9c332fe700 1 -- start start 2023-10-03T10:17:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.684+0000 7f9c332fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c2c1300a0 0x7f9c2c11c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.684+0000 7f9c332fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2c1309f0 0x7f9c2c11c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.684+0000 7f9c332fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c2c133ad0 0x7f9c2c1cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.684+0000 7f9c332fe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c11a130 con 0x7f9c2c1309f0 2023-10-03T10:17:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.684+0000 7f9c332fe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c11ae30 con 0x7f9c2c1300a0 2023-10-03T10:17:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.684+0000 7f9c332fe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c119630 con 0x7f9c2c133ad0 2023-10-03T10:17:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.685+0000 7f9c3109a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c2c1300a0 0x7f9c2c11c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.685+0000 7f9c3109a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c2c1300a0 0x7f9c2c11c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43862/0 (socket says 172.21.15.146:43862) 2023-10-03T10:17:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.685+0000 7f9c3109a700 1 -- 172.21.15.146:0/4035799335 learned_addr learned my addr 172.21.15.146:0/4035799335 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.685+0000 7f9c3189b700 1 --2- 172.21.15.146:0/4035799335 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c2c133ad0 0x7f9c2c1cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.685+0000 7f9c30899700 1 --2- 172.21.15.146:0/4035799335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2c1309f0 0x7f9c2c11c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.685+0000 7f9c3109a700 1 -- 172.21.15.146:0/4035799335 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c2c133ad0 msgr2=0x7f9c2c1cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.685+0000 7f9c3109a700 1 --2- 172.21.15.146:0/4035799335 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c2c133ad0 0x7f9c2c1cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.685+0000 7f9c3109a700 1 -- 172.21.15.146:0/4035799335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2c1309f0 msgr2=0x7f9c2c11c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.685+0000 7f9c3109a700 1 --2- 172.21.15.146:0/4035799335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2c1309f0 0x7f9c2c11c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.685+0000 7f9c3109a700 1 -- 172.21.15.146:0/4035799335 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c28009550 con 0x7f9c2c1300a0 2023-10-03T10:17:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.685+0000 7f9c3109a700 1 --2- 172.21.15.146:0/4035799335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c2c1300a0 0x7f9c2c11c460 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9c28000c00 tx=0x7f9c28004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.685+0000 7f9c21ffb700 1 -- 172.21.15.146:0/4035799335 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c280036a0 con 0x7f9c2c1300a0 2023-10-03T10:17:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.685+0000 7f9c21ffb700 1 -- 172.21.15.146:0/4035799335 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c28003800 con 0x7f9c2c1300a0 2023-10-03T10:17:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.685+0000 7f9c21ffb700 1 -- 172.21.15.146:0/4035799335 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c28003bb0 con 0x7f9c2c1300a0 2023-10-03T10:17:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.685+0000 7f9c332fe700 1 -- 172.21.15.146:0/4035799335 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c2c119a30 con 0x7f9c2c1300a0 2023-10-03T10:17:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.686+0000 7f9c332fe700 1 -- 172.21.15.146:0/4035799335 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c2c11bb60 con 0x7f9c2c1300a0 2023-10-03T10:17:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.687+0000 7f9c21ffb700 1 -- 172.21.15.146:0/4035799335 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c28003d10 con 0x7f9c2c1300a0 2023-10-03T10:17:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.687+0000 7f9c21ffb700 1 -- 172.21.15.146:0/4035799335 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9c28021030 con 0x7f9c2c1300a0 2023-10-03T10:17:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.687+0000 7f9c332fe700 1 -- 172.21.15.146:0/4035799335 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c2c11b200 con 0x7f9c2c1300a0 2023-10-03T10:17:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.696+0000 7f9c21ffb700 1 -- 172.21.15.146:0/4035799335 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c28015080 con 0x7f9c2c1300a0 2023-10-03T10:17:45.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.697+0000 7f963aef4700 1 Processor -- start 2023-10-03T10:17:45.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.697+0000 7f963aef4700 1 -- start start 2023-10-03T10:17:45.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.698+0000 7f963aef4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f963409f060 0x7f963413d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.698+0000 7f963aef4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f963409f4a0 0x7f963413f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.698+0000 7f963aef4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f963406bc80 con 0x7f963409a090 2023-10-03T10:17:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.698+0000 7f963aef4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f963409a460 con 0x7f963409f060 2023-10-03T10:17:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.698+0000 7f963aef4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963406c0f0 con 0x7f963409f4a0 2023-10-03T10:17:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.698+0000 7f9633fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f963409f060 0x7f963413d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.698+0000 7f9633fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f963409f060 0x7f963413d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60124/0 (socket says 172.21.15.146:60124) 2023-10-03T10:17:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.698+0000 7f9633fff700 1 -- 172.21.15.146:0/3467132137 learned_addr learned my addr 172.21.15.146:0/3467132137 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.698+0000 7f9633fff700 1 -- 172.21.15.146:0/3467132137 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f963409f4a0 msgr2=0x7f963413f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.698+0000 7f9633fff700 1 --2- 172.21.15.146:0/3467132137 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f963409f4a0 0x7f963413f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.698+0000 7f9633fff700 1 -- 172.21.15.146:0/3467132137 >> v1:172.21.15.146:6789/0 conn(0x7f963409a090 legacy=0x7f963409e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.698+0000 7f9633fff700 1 -- 172.21.15.146:0/3467132137 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963406d8f0 con 0x7f963409f060 2023-10-03T10:17:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.699+0000 7f9633fff700 1 --2- 172.21.15.146:0/3467132137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963409f060 0x7f963413d480 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f96200098f0 tx=0x7f9620009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f255b5ad68c2175d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.699+0000 7f96337fe700 1 -- 172.21.15.146:0/3467132137 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962000b8a0 con 0x7f963409f060 2023-10-03T10:17:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.699+0000 7f96337fe700 1 -- 172.21.15.146:0/3467132137 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962000ba00 con 0x7f963409f060 2023-10-03T10:17:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.699+0000 7f96337fe700 1 -- 172.21.15.146:0/3467132137 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962000bd90 con 0x7f963409f060 2023-10-03T10:17:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.699+0000 7f963aef4700 1 -- 172.21.15.146:0/3467132137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963409f060 msgr2=0x7f963413d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.699+0000 7f963aef4700 1 --2- 172.21.15.146:0/3467132137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963409f060 0x7f963413d480 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f96200098f0 tx=0x7f9620009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.699+0000 7f963aef4700 1 -- 172.21.15.146:0/3467132137 shutdown_connections 2023-10-03T10:17:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.699+0000 7f963aef4700 1 --2- 172.21.15.146:0/3467132137 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f963409f4a0 0x7f963413f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.699+0000 7f963aef4700 1 --2- 172.21.15.146:0/3467132137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963409f060 0x7f963413d480 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.699+0000 7f963aef4700 1 -- 172.21.15.146:0/3467132137 >> 172.21.15.146:0/3467132137 conn(0x7f96340a0f70 msgr2=0x7f96340a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.700+0000 7f963aef4700 1 -- 172.21.15.146:0/3467132137 shutdown_connections 2023-10-03T10:17:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.700+0000 7f963aef4700 1 -- 172.21.15.146:0/3467132137 wait complete. 2023-10-03T10:17:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.700+0000 7f963aef4700 1 Processor -- start 2023-10-03T10:17:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.701+0000 7f963aef4700 1 -- start start 2023-10-03T10:17:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.701+0000 7f963aef4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963409a090 0x7f963411c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.701+0000 7f963aef4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f963409f060 0x7f963412ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.701+0000 7f963aef4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f963409f4a0 0x7f963412f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.701+0000 7f963aef4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96341348b0 con 0x7f963409a090 2023-10-03T10:17:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.701+0000 7f963aef4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96340a0460 con 0x7f963409f060 2023-10-03T10:17:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.701+0000 7f963aef4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96340a2070 con 0x7f963409f4a0 2023-10-03T10:17:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.701+0000 7f9638c90700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963409a090 0x7f963411c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.701+0000 7f9638c90700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963409a090 0x7f963411c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60134/0 (socket says 172.21.15.146:60134) 2023-10-03T10:17:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.701+0000 7f9638c90700 1 -- 172.21.15.146:0/2440742416 learned_addr learned my addr 172.21.15.146:0/2440742416 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.701+0000 7f9639491700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f963409f4a0 0x7f963412f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.701+0000 7f9633fff700 1 --2- 172.21.15.146:0/2440742416 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f963409f060 0x7f963412ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.702+0000 7f9638c90700 1 -- 172.21.15.146:0/2440742416 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f963409f4a0 msgr2=0x7f963412f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.702+0000 7f9638c90700 1 --2- 172.21.15.146:0/2440742416 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f963409f4a0 0x7f963412f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.702+0000 7f9638c90700 1 -- 172.21.15.146:0/2440742416 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f963409f060 msgr2=0x7f963412ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.702+0000 7f9638c90700 1 --2- 172.21.15.146:0/2440742416 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f963409f060 0x7f963412ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.702+0000 7f9638c90700 1 -- 172.21.15.146:0/2440742416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9620009550 con 0x7f963409a090 2023-10-03T10:17:45.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.702+0000 7f9639491700 1 --2- 172.21.15.146:0/2440742416 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f963409f4a0 0x7f963412f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.702+0000 7f9638c90700 1 --2- 172.21.15.146:0/2440742416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963409a090 0x7f963411c9e0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f962800c4d0 tx=0x7f962800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.702+0000 7f96317fa700 1 -- 172.21.15.146:0/2440742416 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96280054e0 con 0x7f963409a090 2023-10-03T10:17:45.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.702+0000 7f96317fa700 1 -- 172.21.15.146:0/2440742416 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9628003680 con 0x7f963409a090 2023-10-03T10:17:45.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.702+0000 7f963aef4700 1 -- 172.21.15.146:0/2440742416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9634134a90 con 0x7f963409a090 2023-10-03T10:17:45.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.702+0000 7f96317fa700 1 -- 172.21.15.146:0/2440742416 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9628003a30 con 0x7f963409a090 2023-10-03T10:17:45.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.702+0000 7f963aef4700 1 -- 172.21.15.146:0/2440742416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9634135500 con 0x7f963409a090 2023-10-03T10:17:45.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.703+0000 7f963aef4700 1 -- 172.21.15.146:0/2440742416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f963404f2a0 con 0x7f963409a090 2023-10-03T10:17:45.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.703+0000 7f96317fa700 1 -- 172.21.15.146:0/2440742416 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9628003b90 con 0x7f963409a090 2023-10-03T10:17:45.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.708+0000 7f96317fa700 1 -- 172.21.15.146:0/2440742416 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9628010dc0 con 0x7f963409a090 2023-10-03T10:17:45.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.708+0000 7f96317fa700 1 -- 172.21.15.146:0/2440742416 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9628044060 con 0x7f963409a090 2023-10-03T10:17:45.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.793+0000 7f6e5d2d1700 1 -- 172.21.15.146:0/2984213809 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6e5804f2a0 con 0x7f6e580a1290 2023-10-03T10:17:45.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.794+0000 7f6e3f7fe700 1 -- 172.21.15.146:0/2984213809 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e4c01b3b0 con 0x7f6e580a1290 2023-10-03T10:17:45.795 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.796+0000 7f6e5d2d1700 1 -- 172.21.15.146:0/2984213809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e580a1290 msgr2=0x7f6e5811cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.796+0000 7f6e5d2d1700 1 --2- 172.21.15.146:0/2984213809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e580a1290 0x7f6e5811cd70 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00e870 tx=0x7f6e4c00eb80 comp rx=0 tx=0).stop 2023-10-03T10:17:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.796+0000 7f6e5d2d1700 1 -- 172.21.15.146:0/2984213809 shutdown_connections 2023-10-03T10:17:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.796+0000 7f6e5d2d1700 1 --2- 172.21.15.146:0/2984213809 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6e58133a70 0x7f6e5811d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.796+0000 7f6e5d2d1700 1 --2- 172.21.15.146:0/2984213809 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e580a08e0 0x7f6e5811c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.796+0000 7f6e5d2d1700 1 --2- 172.21.15.146:0/2984213809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e580a1290 0x7f6e5811cd70 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.796+0000 7f6e5d2d1700 1 -- 172.21.15.146:0/2984213809 >> 172.21.15.146:0/2984213809 conn(0x7f6e580a2980 msgr2=0x7f6e58131540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.796+0000 7f6e5d2d1700 1 -- 172.21.15.146:0/2984213809 shutdown_connections 2023-10-03T10:17:45.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.796+0000 7f6e5d2d1700 1 -- 172.21.15.146:0/2984213809 wait complete. 2023-10-03T10:17:45.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:45.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.885+0000 7fc07e7fc700 1 -- 172.21.15.146:0/3172136792 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc070005590 con 0x7fc098139200 2023-10-03T10:17:45.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.885+0000 7fc094ff9700 1 -- 172.21.15.146:0/3172136792 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc090034090 con 0x7fc098139200 2023-10-03T10:17:45.886 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:45.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.887+0000 7fc07e7fc700 1 -- 172.21.15.146:0/3172136792 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc098139200 msgr2=0x7fc09811f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.887+0000 7fc07e7fc700 1 --2- 172.21.15.146:0/3172136792 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc098139200 0x7fc09811f1c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc09809dd40 tx=0x7fc090004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.887+0000 7fc07e7fc700 1 -- 172.21.15.146:0/3172136792 shutdown_connections 2023-10-03T10:17:45.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.887+0000 7fc07e7fc700 1 --2- 172.21.15.146:0/3172136792 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc098139200 0x7fc09811f1c0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.887+0000 7fc07e7fc700 1 --2- 172.21.15.146:0/3172136792 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0980a0a70 0x7fc09811e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.887+0000 7fc07e7fc700 1 --2- 172.21.15.146:0/3172136792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0980a1550 0x7fc09811ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.887+0000 7fc07e7fc700 1 -- 172.21.15.146:0/3172136792 >> 172.21.15.146:0/3172136792 conn(0x7fc0980a6610 msgr2=0x7fc0980a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.888+0000 7fc07e7fc700 1 -- 172.21.15.146:0/3172136792 shutdown_connections 2023-10-03T10:17:45.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.888+0000 7fc07e7fc700 1 -- 172.21.15.146:0/3172136792 wait complete. 2023-10-03T10:17:45.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:45.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.901+0000 7f963aef4700 1 -- 172.21.15.146:0/2440742416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f963406b250 con 0x7f963409a090 2023-10-03T10:17:45.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.901+0000 7f96317fa700 1 -- 172.21.15.146:0/2440742416 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9628017020 con 0x7f963409a090 2023-10-03T10:17:45.902 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:45.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.903+0000 7f963aef4700 1 -- 172.21.15.146:0/2440742416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963409a090 msgr2=0x7f963411c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.903+0000 7f963aef4700 1 --2- 172.21.15.146:0/2440742416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963409a090 0x7f963411c9e0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f962800c4d0 tx=0x7f962800c7e0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.903+0000 7f963aef4700 1 -- 172.21.15.146:0/2440742416 shutdown_connections 2023-10-03T10:17:45.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.903+0000 7f963aef4700 1 --2- 172.21.15.146:0/2440742416 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f963409f4a0 0x7f963412f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.903+0000 7f963aef4700 1 --2- 172.21.15.146:0/2440742416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963409a090 0x7f963411c9e0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.903+0000 7f963aef4700 1 --2- 172.21.15.146:0/2440742416 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f963409f060 0x7f963412ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.903+0000 7f963aef4700 1 -- 172.21.15.146:0/2440742416 >> 172.21.15.146:0/2440742416 conn(0x7f96340a0f70 msgr2=0x7f96340a3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.903+0000 7f963aef4700 1 -- 172.21.15.146:0/2440742416 shutdown_connections 2023-10-03T10:17:45.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.903+0000 7f963aef4700 1 -- 172.21.15.146:0/2440742416 wait complete. 2023-10-03T10:17:45.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:45.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.920+0000 7f9c332fe700 1 -- 172.21.15.146:0/4035799335 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9c2c09e1a0 con 0x7f9c2c1300a0 2023-10-03T10:17:45.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.921+0000 7f9c21ffb700 1 -- 172.21.15.146:0/4035799335 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9c2802b020 con 0x7f9c2c1300a0 2023-10-03T10:17:45.922 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:45.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.923+0000 7f9c332fe700 1 -- 172.21.15.146:0/4035799335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c2c1300a0 msgr2=0x7f9c2c11c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.923+0000 7f9c332fe700 1 --2- 172.21.15.146:0/4035799335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c2c1300a0 0x7f9c2c11c460 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9c28000c00 tx=0x7f9c28004750 comp rx=0 tx=0).stop 2023-10-03T10:17:45.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.923+0000 7f9c332fe700 1 -- 172.21.15.146:0/4035799335 shutdown_connections 2023-10-03T10:17:45.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.923+0000 7f9c332fe700 1 --2- 172.21.15.146:0/4035799335 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9c2c133ad0 0x7f9c2c1cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.923+0000 7f9c332fe700 1 --2- 172.21.15.146:0/4035799335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c2c1300a0 0x7f9c2c11c460 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.923+0000 7f9c332fe700 1 --2- 172.21.15.146:0/4035799335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c2c1309f0 0x7f9c2c11c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.923+0000 7f9c332fe700 1 -- 172.21.15.146:0/4035799335 >> 172.21.15.146:0/4035799335 conn(0x7f9c2c099c40 msgr2=0x7f9c2c12eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.923+0000 7f9c332fe700 1 -- 172.21.15.146:0/4035799335 shutdown_connections 2023-10-03T10:17:45.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:45.923+0000 7f9c332fe700 1 -- 172.21.15.146:0/4035799335 wait complete. 2023-10-03T10:17:45.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:46.810 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:46.901 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:46.916 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:46.937 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:46.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.950+0000 7fd78238f700 1 Processor -- start 2023-10-03T10:17:46.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.950+0000 7fd78238f700 1 -- start start 2023-10-03T10:17:46.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.950+0000 7fd78238f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd77c0a0a30 0x7fd77c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.950+0000 7fd78238f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd77c0a1340 0x7fd77c12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.950+0000 7fd78238f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd77c0a1e70 con 0x7fd77c1304a0 2023-10-03T10:17:46.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.950+0000 7fd78238f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd77c09a720 con 0x7fd77c0a0a30 2023-10-03T10:17:46.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.950+0000 7fd78238f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c09b300 con 0x7fd77c0a1340 2023-10-03T10:17:46.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.950+0000 7fd77bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd77c0a0a30 0x7fd77c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.950+0000 7fd77bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd77c0a0a30 0x7fd77c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60142/0 (socket says 172.21.15.146:60142) 2023-10-03T10:17:46.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.950+0000 7fd77bfff700 1 -- 172.21.15.146:0/447003656 learned_addr learned my addr 172.21.15.146:0/447003656 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:46.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.951+0000 7fd77bfff700 1 -- 172.21.15.146:0/447003656 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd77c0a1340 msgr2=0x7fd77c12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:46.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.951+0000 7fd77bfff700 1 --2- 172.21.15.146:0/447003656 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd77c0a1340 0x7fd77c12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.951+0000 7fd77bfff700 1 -- 172.21.15.146:0/447003656 >> v1:172.21.15.146:6789/0 conn(0x7fd77c1304a0 legacy=0x7fd77c1371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.951+0000 7fd77affd700 1 -- 172.21.15.146:0/447003656 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890647378 0 0) 0x7fd77c0a1e70 con 0x7fd77c1304a0 2023-10-03T10:17:46.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.951+0000 7fd77bfff700 1 -- 172.21.15.146:0/447003656 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c09abc0 con 0x7fd77c0a0a30 2023-10-03T10:17:46.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.951+0000 7fd77bfff700 1 --2- 172.21.15.146:0/447003656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd77c0a0a30 0x7fd77c0a0e00 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fd76c006fd0 tx=0x7fd76c00ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce59ca179869c89 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.951+0000 7fd77affd700 1 -- 172.21.15.146:0/447003656 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c005e30 con 0x7fd77c0a0a30 2023-10-03T10:17:46.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.951+0000 7fd77affd700 1 -- 172.21.15.146:0/447003656 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76c004030 con 0x7fd77c0a0a30 2023-10-03T10:17:46.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.951+0000 7fd77affd700 1 -- 172.21.15.146:0/447003656 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c0043e0 con 0x7fd77c0a0a30 2023-10-03T10:17:46.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.952+0000 7fd78238f700 1 -- 172.21.15.146:0/447003656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd77c0a0a30 msgr2=0x7fd77c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.952+0000 7fd78238f700 1 --2- 172.21.15.146:0/447003656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd77c0a0a30 0x7fd77c0a0e00 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fd76c006fd0 tx=0x7fd76c00ad70 comp rx=0 tx=0).stop 2023-10-03T10:17:46.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.953+0000 7fd78238f700 1 -- 172.21.15.146:0/447003656 shutdown_connections 2023-10-03T10:17:46.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.953+0000 7fd78238f700 1 --2- 172.21.15.146:0/447003656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd77c0a0a30 0x7fd77c0a0e00 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.953+0000 7fd78238f700 1 --2- 172.21.15.146:0/447003656 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd77c0a1340 0x7fd77c12ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.953+0000 7fd78238f700 1 -- 172.21.15.146:0/447003656 >> 172.21.15.146:0/447003656 conn(0x7fd77c0a2980 msgr2=0x7fd77c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.953+0000 7fd78238f700 1 -- 172.21.15.146:0/447003656 shutdown_connections 2023-10-03T10:17:46.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.953+0000 7fd78238f700 1 -- 172.21.15.146:0/447003656 wait complete. 2023-10-03T10:17:46.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.954+0000 7fd78238f700 1 Processor -- start 2023-10-03T10:17:46.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.955+0000 7fd78238f700 1 -- start start 2023-10-03T10:17:46.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.955+0000 7fd78238f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd77c0a0a30 0x7fd77c11fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.955+0000 7fd78238f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd77c0a1340 0x7fd77c1201f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.955+0000 7fd78238f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd77c1304a0 0x7fd77c1c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.955+0000 7fd78238f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c122c20 con 0x7fd77c0a1340 2023-10-03T10:17:46.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.955+0000 7fd78238f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c09fb10 con 0x7fd77c1304a0 2023-10-03T10:17:46.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.955+0000 7fd78238f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c1215a0 con 0x7fd77c0a0a30 2023-10-03T10:17:46.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.956+0000 7fd77bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd77c0a0a30 0x7fd77c11fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.956+0000 7fd77bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd77c0a0a30 0x7fd77c11fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58394/0 (socket says 172.21.15.146:58394) 2023-10-03T10:17:46.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.956+0000 7fd77bfff700 1 -- 172.21.15.146:0/2088526680 learned_addr learned my addr 172.21.15.146:0/2088526680 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:46.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.956+0000 7fd77b7fe700 1 --2- 172.21.15.146:0/2088526680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd77c0a1340 0x7fd77c1201f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.956+0000 7fd78092c700 1 --2- 172.21.15.146:0/2088526680 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd77c1304a0 0x7fd77c1c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.956+0000 7fd77bfff700 1 -- 172.21.15.146:0/2088526680 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd77c1304a0 msgr2=0x7fd77c1c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.956+0000 7fd77bfff700 1 --2- 172.21.15.146:0/2088526680 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd77c1304a0 0x7fd77c1c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.956+0000 7fd77bfff700 1 -- 172.21.15.146:0/2088526680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd77c0a1340 msgr2=0x7fd77c1201f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.956+0000 7fd77bfff700 1 --2- 172.21.15.146:0/2088526680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd77c0a1340 0x7fd77c1201f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.956+0000 7fd77bfff700 1 -- 172.21.15.146:0/2088526680 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c00a6a0 con 0x7fd77c0a0a30 2023-10-03T10:17:46.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.956+0000 7fd78092c700 1 --2- 172.21.15.146:0/2088526680 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd77c1304a0 0x7fd77c1c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:46.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.956+0000 7fd77bfff700 1 --2- 172.21.15.146:0/2088526680 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd77c0a0a30 0x7fd77c11fcb0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd77c099eb0 tx=0x7fd76c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.956+0000 7fd778ff9700 1 -- 172.21.15.146:0/2088526680 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c01e070 con 0x7fd77c0a0a30 2023-10-03T10:17:46.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.957+0000 7fd778ff9700 1 -- 172.21.15.146:0/2088526680 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76c0036a0 con 0x7fd77c0a0a30 2023-10-03T10:17:46.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.957+0000 7fd78238f700 1 -- 172.21.15.146:0/2088526680 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd77c09ae00 con 0x7fd77c0a0a30 2023-10-03T10:17:46.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.957+0000 7fd78238f700 1 -- 172.21.15.146:0/2088526680 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77c120ff0 con 0x7fd77c0a0a30 2023-10-03T10:17:46.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.957+0000 7fd778ff9700 1 -- 172.21.15.146:0/2088526680 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c003a30 con 0x7fd77c0a0a30 2023-10-03T10:17:46.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.958+0000 7fd778ff9700 1 -- 172.21.15.146:0/2088526680 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd76c003b90 con 0x7fd77c0a0a30 2023-10-03T10:17:46.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.958+0000 7fd778ff9700 1 -- 172.21.15.146:0/2088526680 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd76c040990 con 0x7fd77c0a0a30 2023-10-03T10:17:46.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.958+0000 7fd78238f700 1 -- 172.21.15.146:0/2088526680 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75c0052e0 con 0x7fd77c0a0a30 2023-10-03T10:17:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:46.964+0000 7fd778ff9700 1 -- 172.21.15.146:0/2088526680 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd76c022410 con 0x7fd77c0a0a30 2023-10-03T10:17:47.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.036+0000 7f7f2e1db700 1 Processor -- start 2023-10-03T10:17:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.036+0000 7f7f2e1db700 1 -- start start 2023-10-03T10:17:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.037+0000 7f7f2e1db700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f28133ad0 0x7f7f28133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.037+0000 7f7f2e1db700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7f281300a0 0x7f7f281304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.037+0000 7f7f2e1db700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2806b2d0 con 0x7f7f281309f0 2023-10-03T10:17:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.037+0000 7f7f2e1db700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f28133610 con 0x7f7f281300a0 2023-10-03T10:17:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.037+0000 7f7f2e1db700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2809a500 con 0x7f7f28133ad0 2023-10-03T10:17:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.037+0000 7f7f277fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f28133ad0 0x7f7f28133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.037+0000 7f7f277fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f28133ad0 0x7f7f28133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43914/0 (socket says 172.21.15.146:43914) 2023-10-03T10:17:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.037+0000 7f7f277fe700 1 -- 172.21.15.146:0/899264954 learned_addr learned my addr 172.21.15.146:0/899264954 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.037+0000 7f7f26ffd700 1 --2- 172.21.15.146:0/899264954 >> v2:172.21.15.146:3300/0 conn(0x7f7f281300a0 0x7f7f281304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.037+0000 7f7f267fc700 1 -- 172.21.15.146:0/899264954 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3044873354 0 0) 0x7f7f2806b2d0 con 0x7f7f281309f0 2023-10-03T10:17:47.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.038+0000 7f7f267fc700 1 -- 172.21.15.146:0/899264954 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f100035b0 con 0x7f7f281309f0 2023-10-03T10:17:47.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.038+0000 7f7f26ffd700 1 -- 172.21.15.146:0/899264954 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f28133ad0 msgr2=0x7f7f28133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:47.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.038+0000 7f7f26ffd700 1 --2- 172.21.15.146:0/899264954 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f28133ad0 0x7f7f28133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.038+0000 7f7f26ffd700 1 -- 172.21.15.146:0/899264954 >> v1:172.21.15.146:6789/0 conn(0x7f7f281309f0 legacy=0x7f7f2813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.038+0000 7f7f26ffd700 1 -- 172.21.15.146:0/899264954 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f281338b0 con 0x7f7f281300a0 2023-10-03T10:17:47.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.038+0000 7f7f26ffd700 1 --2- 172.21.15.146:0/899264954 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f281300a0 0x7f7f281304b0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009840 tx=0x7f7f1c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9156dfeb7a29eb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.038+0000 7f7f267fc700 1 -- 172.21.15.146:0/899264954 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c004230 con 0x7f7f281300a0 2023-10-03T10:17:47.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.038+0000 7f7f267fc700 1 -- 172.21.15.146:0/899264954 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1c004390 con 0x7f7f281300a0 2023-10-03T10:17:47.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.038+0000 7f7f267fc700 1 -- 172.21.15.146:0/899264954 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c0036a0 con 0x7f7f281300a0 2023-10-03T10:17:47.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.039+0000 7f7f2e1db700 1 -- 172.21.15.146:0/899264954 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f281300a0 msgr2=0x7f7f281304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.039+0000 7f7f2e1db700 1 --2- 172.21.15.146:0/899264954 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f281300a0 0x7f7f281304b0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009840 tx=0x7f7f1c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:47.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.039+0000 7f7f2e1db700 1 -- 172.21.15.146:0/899264954 shutdown_connections 2023-10-03T10:17:47.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.039+0000 7f7f2e1db700 1 --2- 172.21.15.146:0/899264954 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f28133ad0 0x7f7f28133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.039+0000 7f7f2e1db700 1 --2- 172.21.15.146:0/899264954 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f281300a0 0x7f7f281304b0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.039+0000 7f7f2e1db700 1 -- 172.21.15.146:0/899264954 >> 172.21.15.146:0/899264954 conn(0x7f7f28099c40 msgr2=0x7f7f280a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.039+0000 7f7f2e1db700 1 -- 172.21.15.146:0/899264954 shutdown_connections 2023-10-03T10:17:47.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.039+0000 7f7f2e1db700 1 -- 172.21.15.146:0/899264954 wait complete. 2023-10-03T10:17:47.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.040+0000 7f7f2e1db700 1 Processor -- start 2023-10-03T10:17:47.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.040+0000 7f7f2e1db700 1 -- start start 2023-10-03T10:17:47.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.041+0000 7f7f2e1db700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f281300a0 0x7f7f2811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.041+0000 7f7f2e1db700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f281309f0 0x7f7f2811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.041+0000 7f7f2e1db700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f28133ad0 0x7f7f2811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.041+0000 7f7f2e1db700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f28120130 con 0x7f7f281300a0 2023-10-03T10:17:47.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.041+0000 7f7f2e1db700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2812d900 con 0x7f7f28133ad0 2023-10-03T10:17:47.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.041+0000 7f7f2e1db700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f28120a30 con 0x7f7f281309f0 2023-10-03T10:17:47.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.041+0000 7f7f26ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f281309f0 0x7f7f2811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.041+0000 7f7f26ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f281309f0 0x7f7f2811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58408/0 (socket says 172.21.15.146:58408) 2023-10-03T10:17:47.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.041+0000 7f7f26ffd700 1 -- 172.21.15.146:0/3709557305 learned_addr learned my addr 172.21.15.146:0/3709557305 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:47.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.041+0000 7f7f277fe700 1 --2- 172.21.15.146:0/3709557305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f281300a0 0x7f7f2811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.041+0000 7f7f27fff700 1 --2- 172.21.15.146:0/3709557305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f28133ad0 0x7f7f2811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.041+0000 7f7f26ffd700 1 -- 172.21.15.146:0/3709557305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f28133ad0 msgr2=0x7f7f2811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.041+0000 7f7f26ffd700 1 --2- 172.21.15.146:0/3709557305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f28133ad0 0x7f7f2811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.041+0000 7f7f26ffd700 1 -- 172.21.15.146:0/3709557305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f281300a0 msgr2=0x7f7f2811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.041+0000 7f7f26ffd700 1 --2- 172.21.15.146:0/3709557305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f281300a0 0x7f7f2811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.041+0000 7f7f26ffd700 1 -- 172.21.15.146:0/3709557305 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1c0094a0 con 0x7f7f281309f0 2023-10-03T10:17:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.041+0000 7f7f27fff700 1 --2- 172.21.15.146:0/3709557305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f28133ad0 0x7f7f2811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.042+0000 7f7f26ffd700 1 --2- 172.21.15.146:0/3709557305 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f281309f0 0x7f7f2811df80 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009b90 tx=0x7f7f1c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.042+0000 7f7f0ffff700 1 -- 172.21.15.146:0/3709557305 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c003cf0 con 0x7f7f281309f0 2023-10-03T10:17:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.042+0000 7f7f0ffff700 1 -- 172.21.15.146:0/3709557305 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1c003e90 con 0x7f7f281309f0 2023-10-03T10:17:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.042+0000 7f7f2e1db700 1 -- 172.21.15.146:0/3709557305 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f280a3460 con 0x7f7f281309f0 2023-10-03T10:17:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.042+0000 7f7f0ffff700 1 -- 172.21.15.146:0/3709557305 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c011870 con 0x7f7f281309f0 2023-10-03T10:17:47.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.042+0000 7f7f2e1db700 1 -- 172.21.15.146:0/3709557305 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2811ef20 con 0x7f7f281309f0 2023-10-03T10:17:47.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.043+0000 7f7f2e1db700 1 -- 172.21.15.146:0/3709557305 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2804f2a0 con 0x7f7f281309f0 2023-10-03T10:17:47.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.043+0000 7f7f0ffff700 1 -- 172.21.15.146:0/3709557305 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f1c018040 con 0x7f7f281309f0 2023-10-03T10:17:47.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.044+0000 7f7f0ffff700 1 -- 172.21.15.146:0/3709557305 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7f1c03fec0 con 0x7f7f281309f0 2023-10-03T10:17:47.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.052+0000 7f7f0ffff700 1 -- 172.21.15.146:0/3709557305 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f1c01a400 con 0x7f7f281309f0 2023-10-03T10:17:47.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.077+0000 7f0753704700 1 Processor -- start 2023-10-03T10:17:47.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.077+0000 7f0753704700 1 -- start start 2023-10-03T10:17:47.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.077+0000 7f0753704700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f074c133ad0 0x7f074c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.077+0000 7f0753704700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1300a0 0x7f074c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.077+0000 7f0753704700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074c06b2d0 con 0x7f074c1309f0 2023-10-03T10:17:47.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.077+0000 7f0753704700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074c133610 con 0x7f074c133ad0 2023-10-03T10:17:47.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.077+0000 7f0753704700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c09a500 con 0x7f074c1300a0 2023-10-03T10:17:47.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.078+0000 7f0750c9f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1300a0 0x7f074c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.078+0000 7f0750c9f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1300a0 0x7f074c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43946/0 (socket says 172.21.15.146:43946) 2023-10-03T10:17:47.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.078+0000 7f0751ca1700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f074c1309f0 0x7f074c13a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39332/0 (socket says 172.21.15.146:39332) 2023-10-03T10:17:47.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.078+0000 7f0750c9f700 1 -- 172.21.15.146:0/2838233781 learned_addr learned my addr 172.21.15.146:0/2838233781 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:47.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.078+0000 7f07514a0700 1 --2- 172.21.15.146:0/2838233781 >> v2:172.21.15.146:3300/0 conn(0x7f074c133ad0 0x7f074c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.078+0000 7f0750c9f700 1 -- 172.21.15.146:0/2838233781 >> v2:172.21.15.146:3300/0 conn(0x7f074c133ad0 msgr2=0x7f074c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:47.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.078+0000 7f0750c9f700 1 --2- 172.21.15.146:0/2838233781 >> v2:172.21.15.146:3300/0 conn(0x7f074c133ad0 0x7f074c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.078+0000 7f0750c9f700 1 -- 172.21.15.146:0/2838233781 >> v1:172.21.15.146:6789/0 conn(0x7f074c1309f0 legacy=0x7f074c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.078+0000 7f0750c9f700 1 -- 172.21.15.146:0/2838233781 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c1338b0 con 0x7f074c1300a0 2023-10-03T10:17:47.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.078+0000 7f0750c9f700 1 --2- 172.21.15.146:0/2838233781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1300a0 0x7f074c1304b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f073c0098f0 tx=0x7f073c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e732dba75b1db28f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.078+0000 7f0743fff700 1 -- 172.21.15.146:0/2838233781 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c011830 con 0x7f074c1300a0 2023-10-03T10:17:47.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.078+0000 7f0743fff700 1 -- 172.21.15.146:0/2838233781 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073c011990 con 0x7f074c1300a0 2023-10-03T10:17:47.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.078+0000 7f0743fff700 1 -- 172.21.15.146:0/2838233781 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c011d20 con 0x7f074c1300a0 2023-10-03T10:17:47.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.079+0000 7f0753704700 1 -- 172.21.15.146:0/2838233781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1300a0 msgr2=0x7f074c1304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.079+0000 7f0753704700 1 --2- 172.21.15.146:0/2838233781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1300a0 0x7f074c1304b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f073c0098f0 tx=0x7f073c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:47.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.079+0000 7f0753704700 1 -- 172.21.15.146:0/2838233781 shutdown_connections 2023-10-03T10:17:47.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.079+0000 7f0753704700 1 --2- 172.21.15.146:0/2838233781 >> v2:172.21.15.146:3300/0 conn(0x7f074c133ad0 0x7f074c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.079+0000 7f0753704700 1 --2- 172.21.15.146:0/2838233781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1300a0 0x7f074c1304b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.079+0000 7f0753704700 1 -- 172.21.15.146:0/2838233781 >> 172.21.15.146:0/2838233781 conn(0x7f074c099c40 msgr2=0x7f074c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.079+0000 7f0753704700 1 -- 172.21.15.146:0/2838233781 shutdown_connections 2023-10-03T10:17:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.079+0000 7f0753704700 1 -- 172.21.15.146:0/2838233781 wait complete. 2023-10-03T10:17:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.080+0000 7f0753704700 1 Processor -- start 2023-10-03T10:17:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.080+0000 7f0753704700 1 -- start start 2023-10-03T10:17:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.081+0000 7f0753704700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1300a0 0x7f074c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.081+0000 7f0753704700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1309f0 0x7f074c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.081+0000 7f0753704700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c133ad0 0x7f074c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.081+0000 7f0753704700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c11fd60 con 0x7f074c1309f0 2023-10-03T10:17:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.081+0000 7f0753704700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c0724c0 con 0x7f074c1300a0 2023-10-03T10:17:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.081+0000 7f0753704700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f074c12fe10 con 0x7f074c133ad0 2023-10-03T10:17:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.081+0000 7f0750c9f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1309f0 0x7f074c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.081+0000 7f07514a0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1300a0 0x7f074c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.081+0000 7f0750c9f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1309f0 0x7f074c11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60176/0 (socket says 172.21.15.146:60176) 2023-10-03T10:17:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.081+0000 7f0750c9f700 1 -- 172.21.15.146:0/3248047110 learned_addr learned my addr 172.21.15.146:0/3248047110 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:47.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.081+0000 7f0751ca1700 1 --2- 172.21.15.146:0/3248047110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c133ad0 0x7f074c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.082+0000 7f07514a0700 1 -- 172.21.15.146:0/3248047110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c133ad0 msgr2=0x7f074c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.082+0000 7f07514a0700 1 --2- 172.21.15.146:0/3248047110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c133ad0 0x7f074c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.082+0000 7f07514a0700 1 -- 172.21.15.146:0/3248047110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1309f0 msgr2=0x7f074c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.082+0000 7f07514a0700 1 --2- 172.21.15.146:0/3248047110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1309f0 0x7f074c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.082+0000 7f07514a0700 1 -- 172.21.15.146:0/3248047110 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c009550 con 0x7f074c1300a0 2023-10-03T10:17:47.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.082+0000 7f0751ca1700 1 --2- 172.21.15.146:0/3248047110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c133ad0 0x7f074c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:47.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.082+0000 7f0750c9f700 1 --2- 172.21.15.146:0/3248047110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1309f0 0x7f074c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:47.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.082+0000 7f07514a0700 1 --2- 172.21.15.146:0/3248047110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1300a0 0x7f074c11da40 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f074800e900 tx=0x7f074800ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.082+0000 7f0741ffb700 1 -- 172.21.15.146:0/3248047110 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748013680 con 0x7f074c1300a0 2023-10-03T10:17:47.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.082+0000 7f0741ffb700 1 -- 172.21.15.146:0/3248047110 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07480137e0 con 0x7f074c1300a0 2023-10-03T10:17:47.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.082+0000 7f0741ffb700 1 -- 172.21.15.146:0/3248047110 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748013b50 con 0x7f074c1300a0 2023-10-03T10:17:47.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.082+0000 7f0753704700 1 -- 172.21.15.146:0/3248047110 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074c120300 con 0x7f074c1300a0 2023-10-03T10:17:47.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.082+0000 7f0753704700 1 -- 172.21.15.146:0/3248047110 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074c12dd00 con 0x7f074c1300a0 2023-10-03T10:17:47.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.083+0000 7f0753704700 1 -- 172.21.15.146:0/3248047110 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074c04f2a0 con 0x7f074c1300a0 2023-10-03T10:17:47.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.083+0000 7f0741ffb700 1 -- 172.21.15.146:0/3248047110 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0748013cb0 con 0x7f074c1300a0 2023-10-03T10:17:47.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.085+0000 7f0741ffb700 1 -- 172.21.15.146:0/3248047110 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f074801bea0 con 0x7f074c1300a0 2023-10-03T10:17:47.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.092+0000 7f0741ffb700 1 -- 172.21.15.146:0/3248047110 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f074801bc70 con 0x7f074c1300a0 2023-10-03T10:17:47.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.093+0000 7fd4cf093700 1 Processor -- start 2023-10-03T10:17:47.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.093+0000 7fd4cf093700 1 -- start start 2023-10-03T10:17:47.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.094+0000 7fd4cf093700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4c80a0a70 0x7fd4c80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.094+0000 7fd4cf093700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4c80a1380 0x7fd4c8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.094+0000 7fd4cf093700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd4c8133f50 0x7fd4c81343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.094+0000 7fd4cf093700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c809e9d0 con 0x7fd4c8133f50 2023-10-03T10:17:47.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.094+0000 7fd4cf093700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c809dc00 con 0x7fd4c80a0a70 2023-10-03T10:17:47.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.094+0000 7fd4cf093700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c809dec0 con 0x7fd4c80a1380 2023-10-03T10:17:47.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.094+0000 7fd4cce2f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4c80a0a70 0x7fd4c80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.094+0000 7fd4cce2f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4c80a0a70 0x7fd4c80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43962/0 (socket says 172.21.15.146:43962) 2023-10-03T10:17:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.094+0000 7fd4cd630700 1 --2- 172.21.15.146:0/616077383 >> v2:172.21.15.146:3300/0 conn(0x7fd4c8133f50 0x7fd4c81343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.094+0000 7fd4cce2f700 1 -- 172.21.15.146:0/616077383 learned_addr learned my addr 172.21.15.146:0/616077383 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.095+0000 7fd4cce2f700 1 -- 172.21.15.146:0/616077383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4c80a1380 msgr2=0x7fd4c8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.095+0000 7fd4cce2f700 1 --2- 172.21.15.146:0/616077383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4c80a1380 0x7fd4c8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.095+0000 7fd4cce2f700 1 -- 172.21.15.146:0/616077383 >> v2:172.21.15.146:3300/0 conn(0x7fd4c8133f50 msgr2=0x7fd4c81343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.095+0000 7fd4cce2f700 1 --2- 172.21.15.146:0/616077383 >> v2:172.21.15.146:3300/0 conn(0x7fd4c8133f50 0x7fd4c81343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.095+0000 7fd4cce2f700 1 -- 172.21.15.146:0/616077383 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c809e6a0 con 0x7fd4c80a0a70 2023-10-03T10:17:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.095+0000 7fd4cce2f700 1 --2- 172.21.15.146:0/616077383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4c80a0a70 0x7fd4c80a0e40 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc0098f0 tx=0x7fd4bc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4a8658344a216f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.095+0000 7fd4c77fe700 1 -- 172.21.15.146:0/616077383 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc011830 con 0x7fd4c80a0a70 2023-10-03T10:17:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.095+0000 7fd4c77fe700 1 -- 172.21.15.146:0/616077383 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc011990 con 0x7fd4c80a0a70 2023-10-03T10:17:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.095+0000 7fd4c77fe700 1 -- 172.21.15.146:0/616077383 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc011d20 con 0x7fd4c80a0a70 2023-10-03T10:17:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.096+0000 7fd4cf093700 1 -- 172.21.15.146:0/616077383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4c80a0a70 msgr2=0x7fd4c80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.096+0000 7fd4cf093700 1 --2- 172.21.15.146:0/616077383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4c80a0a70 0x7fd4c80a0e40 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc0098f0 tx=0x7fd4bc009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:47.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.096+0000 7fd4cf093700 1 -- 172.21.15.146:0/616077383 shutdown_connections 2023-10-03T10:17:47.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.096+0000 7fd4cf093700 1 --2- 172.21.15.146:0/616077383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4c80a0a70 0x7fd4c80a0e40 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.096+0000 7fd4cf093700 1 --2- 172.21.15.146:0/616077383 >> v2:172.21.15.146:3300/0 conn(0x7fd4c8133f50 0x7fd4c81343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.096+0000 7fd4cf093700 1 --2- 172.21.15.146:0/616077383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4c80a1380 0x7fd4c8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.096+0000 7fd4cf093700 1 -- 172.21.15.146:0/616077383 >> 172.21.15.146:0/616077383 conn(0x7fd4c80a6610 msgr2=0x7fd4c80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.096+0000 7fd4cf093700 1 -- 172.21.15.146:0/616077383 shutdown_connections 2023-10-03T10:17:47.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.096+0000 7fd4cf093700 1 -- 172.21.15.146:0/616077383 wait complete. 2023-10-03T10:17:47.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.097+0000 7fd4cf093700 1 Processor -- start 2023-10-03T10:17:47.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.097+0000 7fd4cf093700 1 -- start start 2023-10-03T10:17:47.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.098+0000 7fd4cf093700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4c80a0a70 0x7fd4c8122350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.098+0000 7fd4cf093700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4c80a1380 0x7fd4c8122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.098+0000 7fd4cf093700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4c8133f50 0x7fd4c8122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.098+0000 7fd4cf093700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c8133720 con 0x7fd4c80a0a70 2023-10-03T10:17:47.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.098+0000 7fd4cf093700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c81237b0 con 0x7fd4c8133f50 2023-10-03T10:17:47.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.098+0000 7fd4cf093700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c8124df0 con 0x7fd4c80a1380 2023-10-03T10:17:47.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.098+0000 7fd4cce2f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4c80a0a70 0x7fd4c8122350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.098+0000 7fd4cce2f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4c80a0a70 0x7fd4c8122350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60186/0 (socket says 172.21.15.146:60186) 2023-10-03T10:17:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.098+0000 7fd4cce2f700 1 -- 172.21.15.146:0/1933408254 learned_addr learned my addr 172.21.15.146:0/1933408254 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.098+0000 7fd4cd630700 1 --2- 172.21.15.146:0/1933408254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4c8133f50 0x7fd4c8122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.098+0000 7fd4c7fff700 1 --2- 172.21.15.146:0/1933408254 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4c80a1380 0x7fd4c8122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.099+0000 7fd4cd630700 1 -- 172.21.15.146:0/1933408254 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4c80a1380 msgr2=0x7fd4c8122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.099+0000 7fd4cd630700 1 --2- 172.21.15.146:0/1933408254 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4c80a1380 0x7fd4c8122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.099+0000 7fd4cd630700 1 -- 172.21.15.146:0/1933408254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4c80a0a70 msgr2=0x7fd4c8122350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.099+0000 7fd4cd630700 1 --2- 172.21.15.146:0/1933408254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4c80a0a70 0x7fd4c8122350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.099+0000 7fd4cd630700 1 -- 172.21.15.146:0/1933408254 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc009550 con 0x7fd4c8133f50 2023-10-03T10:17:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.099+0000 7fd4cd630700 1 --2- 172.21.15.146:0/1933408254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4c8133f50 0x7fd4c8122dd0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0009d90 tx=0x7fd4c000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.099+0000 7fd4c57fa700 1 -- 172.21.15.146:0/1933408254 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0009c00 con 0x7fd4c8133f50 2023-10-03T10:17:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.099+0000 7fd4cf093700 1 -- 172.21.15.146:0/1933408254 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c81258d0 con 0x7fd4c8133f50 2023-10-03T10:17:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.099+0000 7fd4c57fa700 1 -- 172.21.15.146:0/1933408254 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c000f040 con 0x7fd4c8133f50 2023-10-03T10:17:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.099+0000 7fd4c57fa700 1 -- 172.21.15.146:0/1933408254 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0014480 con 0x7fd4c8133f50 2023-10-03T10:17:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.099+0000 7fd4cf093700 1 -- 172.21.15.146:0/1933408254 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c80a03e0 con 0x7fd4c8133f50 2023-10-03T10:17:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.100+0000 7fd4cf093700 1 -- 172.21.15.146:0/1933408254 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c811f760 con 0x7fd4c8133f50 2023-10-03T10:17:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.100+0000 7fd4c57fa700 1 -- 172.21.15.146:0/1933408254 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd4c00145e0 con 0x7fd4c8133f50 2023-10-03T10:17:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.101+0000 7fd4c57fa700 1 -- 172.21.15.146:0/1933408254 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd4c0040360 con 0x7fd4c8133f50 2023-10-03T10:17:47.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.110+0000 7fd4c57fa700 1 -- 172.21.15.146:0/1933408254 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd4c0018070 con 0x7fd4c8133f50 2023-10-03T10:17:47.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.183+0000 7fd78238f700 1 -- 172.21.15.146:0/2088526680 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd75c005590 con 0x7fd77c0a0a30 2023-10-03T10:17:47.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.183+0000 7fd778ff9700 1 -- 172.21.15.146:0/2088526680 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd76c033070 con 0x7fd77c0a0a30 2023-10-03T10:17:47.184 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:47.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.185+0000 7fd78238f700 1 -- 172.21.15.146:0/2088526680 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd77c0a0a30 msgr2=0x7fd77c11fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.185+0000 7fd78238f700 1 --2- 172.21.15.146:0/2088526680 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd77c0a0a30 0x7fd77c11fcb0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd77c099eb0 tx=0x7fd76c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:47.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.185+0000 7fd78238f700 1 -- 172.21.15.146:0/2088526680 shutdown_connections 2023-10-03T10:17:47.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.185+0000 7fd78238f700 1 --2- 172.21.15.146:0/2088526680 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd77c1304a0 0x7fd77c1c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.185+0000 7fd78238f700 1 --2- 172.21.15.146:0/2088526680 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd77c0a0a30 0x7fd77c11fcb0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.185+0000 7fd78238f700 1 --2- 172.21.15.146:0/2088526680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd77c0a1340 0x7fd77c1201f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.185+0000 7fd78238f700 1 -- 172.21.15.146:0/2088526680 >> 172.21.15.146:0/2088526680 conn(0x7fd77c0a2980 msgr2=0x7fd77c06ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.185+0000 7fd78238f700 1 -- 172.21.15.146:0/2088526680 shutdown_connections 2023-10-03T10:17:47.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.186+0000 7fd78238f700 1 -- 172.21.15.146:0/2088526680 wait complete. 2023-10-03T10:17:47.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:47.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.276+0000 7f7f2e1db700 1 -- 172.21.15.146:0/3709557305 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7f2806c3b0 con 0x7f7f281309f0 2023-10-03T10:17:47.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.276+0000 7f7f0ffff700 1 -- 172.21.15.146:0/3709557305 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7f1c02b070 con 0x7f7f281309f0 2023-10-03T10:17:47.277 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:47.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.278+0000 7f7f2e1db700 1 -- 172.21.15.146:0/3709557305 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f281309f0 msgr2=0x7f7f2811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.278+0000 7f7f2e1db700 1 --2- 172.21.15.146:0/3709557305 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f281309f0 0x7f7f2811df80 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009b90 tx=0x7f7f1c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:47.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.278+0000 7f7f2e1db700 1 -- 172.21.15.146:0/3709557305 shutdown_connections 2023-10-03T10:17:47.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.278+0000 7f7f2e1db700 1 --2- 172.21.15.146:0/3709557305 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f28133ad0 0x7f7f2811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.278+0000 7f7f2e1db700 1 --2- 172.21.15.146:0/3709557305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f281300a0 0x7f7f2811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.278+0000 7f7f2e1db700 1 --2- 172.21.15.146:0/3709557305 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f281309f0 0x7f7f2811df80 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.278+0000 7f7f2e1db700 1 -- 172.21.15.146:0/3709557305 >> 172.21.15.146:0/3709557305 conn(0x7f7f28099c40 msgr2=0x7f7f28131f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.278+0000 7f7f2e1db700 1 -- 172.21.15.146:0/3709557305 shutdown_connections 2023-10-03T10:17:47.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.278+0000 7f7f2e1db700 1 -- 172.21.15.146:0/3709557305 wait complete. 2023-10-03T10:17:47.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:47.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.290+0000 7f0753704700 1 -- 172.21.15.146:0/3248047110 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f074c1200e0 con 0x7f074c1300a0 2023-10-03T10:17:47.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.290+0000 7f0741ffb700 1 -- 172.21.15.146:0/3248047110 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0748017070 con 0x7f074c1300a0 2023-10-03T10:17:47.292 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:47.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.292+0000 7f0753704700 1 -- 172.21.15.146:0/3248047110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1300a0 msgr2=0x7f074c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.292+0000 7f0753704700 1 --2- 172.21.15.146:0/3248047110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1300a0 0x7f074c11da40 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f074800e900 tx=0x7f074800ec10 comp rx=0 tx=0).stop 2023-10-03T10:17:47.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.292+0000 7f0753704700 1 -- 172.21.15.146:0/3248047110 shutdown_connections 2023-10-03T10:17:47.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.292+0000 7f0753704700 1 --2- 172.21.15.146:0/3248047110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f074c133ad0 0x7f074c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.292+0000 7f0753704700 1 --2- 172.21.15.146:0/3248047110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f074c1300a0 0x7f074c11da40 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.292+0000 7f0753704700 1 --2- 172.21.15.146:0/3248047110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1309f0 0x7f074c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.293+0000 7f0753704700 1 -- 172.21.15.146:0/3248047110 >> 172.21.15.146:0/3248047110 conn(0x7f074c099c40 msgr2=0x7f074c131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.293+0000 7f0753704700 1 -- 172.21.15.146:0/3248047110 shutdown_connections 2023-10-03T10:17:47.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.293+0000 7f0753704700 1 -- 172.21.15.146:0/3248047110 wait complete. 2023-10-03T10:17:47.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:47.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.314+0000 7fd4cf093700 1 -- 172.21.15.146:0/1933408254 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd4c804f2a0 con 0x7fd4c8133f50 2023-10-03T10:17:47.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.314+0000 7fd4c57fa700 1 -- 172.21.15.146:0/1933408254 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd4c002c090 con 0x7fd4c8133f50 2023-10-03T10:17:47.315 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:47.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.317+0000 7fd4cf093700 1 -- 172.21.15.146:0/1933408254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4c8133f50 msgr2=0x7fd4c8122dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.317+0000 7fd4cf093700 1 --2- 172.21.15.146:0/1933408254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4c8133f50 0x7fd4c8122dd0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0009d90 tx=0x7fd4c000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.317+0000 7fd4cf093700 1 -- 172.21.15.146:0/1933408254 shutdown_connections 2023-10-03T10:17:47.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.317+0000 7fd4cf093700 1 --2- 172.21.15.146:0/1933408254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4c8133f50 0x7fd4c8122dd0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.317+0000 7fd4cf093700 1 --2- 172.21.15.146:0/1933408254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4c80a0a70 0x7fd4c8122350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.317+0000 7fd4cf093700 1 --2- 172.21.15.146:0/1933408254 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4c80a1380 0x7fd4c8122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.317+0000 7fd4cf093700 1 -- 172.21.15.146:0/1933408254 >> 172.21.15.146:0/1933408254 conn(0x7fd4c80a6610 msgr2=0x7fd4c811c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.317+0000 7fd4cf093700 1 -- 172.21.15.146:0/1933408254 shutdown_connections 2023-10-03T10:17:47.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:47.317+0000 7fd4cf093700 1 -- 172.21.15.146:0/1933408254 wait complete. 2023-10-03T10:17:47.329 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:48.199 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:48.291 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:48.306 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:48.331 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:48.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.331+0000 7feb881da700 1 Processor -- start 2023-10-03T10:17:48.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.331+0000 7feb881da700 1 -- start start 2023-10-03T10:17:48.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.332+0000 7feb881da700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feb8009f350 0x7feb80138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.332+0000 7feb881da700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb801393a0 0x7feb8013b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.332+0000 7feb881da700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8009fa00 con 0x7feb8009e870 2023-10-03T10:17:48.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.332+0000 7feb881da700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb800a0370 con 0x7feb8009f350 2023-10-03T10:17:48.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.332+0000 7feb881da700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb8006bec0 con 0x7feb801393a0 2023-10-03T10:17:48.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.332+0000 7feb85775700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feb8009f350 0x7feb80138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.332+0000 7feb86777700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb801393a0 0x7feb8013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.332+0000 7feb85f76700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7feb8009e870 0x7feb8009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39338/0 (socket says 172.21.15.146:39338) 2023-10-03T10:17:48.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.332+0000 7feb85f76700 1 -- 172.21.15.146:0/2819322771 learned_addr learned my addr 172.21.15.146:0/2819322771 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:48.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.332+0000 7feb86777700 1 -- 172.21.15.146:0/2819322771 >> v2:172.21.15.146:3300/0 conn(0x7feb8009f350 msgr2=0x7feb80138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:48.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.332+0000 7feb86777700 1 --2- 172.21.15.146:0/2819322771 >> v2:172.21.15.146:3300/0 conn(0x7feb8009f350 0x7feb80138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.332+0000 7feb86777700 1 -- 172.21.15.146:0/2819322771 >> v1:172.21.15.146:6789/0 conn(0x7feb8009e870 legacy=0x7feb8009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.332+0000 7feb86777700 1 -- 172.21.15.146:0/2819322771 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8009ada0 con 0x7feb801393a0 2023-10-03T10:17:48.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.332+0000 7feb85775700 1 --2- 172.21.15.146:0/2819322771 >> v2:172.21.15.146:3300/0 conn(0x7feb8009f350 0x7feb80138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.332+0000 7feb86777700 1 --2- 172.21.15.146:0/2819322771 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb801393a0 0x7feb8013b780 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7feb78009d90 tx=0x7feb7800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34072d60364c3810 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.333+0000 7feb84f74700 1 -- 172.21.15.146:0/2819322771 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7800e070 con 0x7feb801393a0 2023-10-03T10:17:48.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.333+0000 7feb84f74700 1 -- 172.21.15.146:0/2819322771 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7800bb20 con 0x7feb801393a0 2023-10-03T10:17:48.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.333+0000 7feb84f74700 1 -- 172.21.15.146:0/2819322771 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb78012430 con 0x7feb801393a0 2023-10-03T10:17:48.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.333+0000 7feb881da700 1 -- 172.21.15.146:0/2819322771 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb801393a0 msgr2=0x7feb8013b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.333+0000 7feb881da700 1 --2- 172.21.15.146:0/2819322771 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb801393a0 0x7feb8013b780 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7feb78009d90 tx=0x7feb7800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.333+0000 7feb881da700 1 -- 172.21.15.146:0/2819322771 shutdown_connections 2023-10-03T10:17:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.333+0000 7feb881da700 1 --2- 172.21.15.146:0/2819322771 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb801393a0 0x7feb8013b780 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.333+0000 7feb881da700 1 --2- 172.21.15.146:0/2819322771 >> v2:172.21.15.146:3300/0 conn(0x7feb8009f350 0x7feb80138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.333+0000 7feb881da700 1 -- 172.21.15.146:0/2819322771 >> 172.21.15.146:0/2819322771 conn(0x7feb800a4430 msgr2=0x7feb800a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.333+0000 7feb881da700 1 -- 172.21.15.146:0/2819322771 shutdown_connections 2023-10-03T10:17:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.334+0000 7feb881da700 1 -- 172.21.15.146:0/2819322771 wait complete. 2023-10-03T10:17:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.335+0000 7feb881da700 1 Processor -- start 2023-10-03T10:17:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.335+0000 7feb881da700 1 -- start start 2023-10-03T10:17:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.336+0000 7feb881da700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb8009e870 0x7feb8011ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.336+0000 7feb881da700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb8009f350 0x7feb8011f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.336+0000 7feb881da700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb801393a0 0x7feb8011f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.336+0000 7feb881da700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb801224a0 con 0x7feb8009e870 2023-10-03T10:17:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.336+0000 7feb881da700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8006cfa0 con 0x7feb8009f350 2023-10-03T10:17:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.336+0000 7feb881da700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb80121c50 con 0x7feb801393a0 2023-10-03T10:17:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.336+0000 7feb85775700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb8009f350 0x7feb8011f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.336+0000 7feb85775700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb8009f350 0x7feb8011f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:43976/0 (socket says 172.21.15.146:43976) 2023-10-03T10:17:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.336+0000 7feb85775700 1 -- 172.21.15.146:0/3143941032 learned_addr learned my addr 172.21.15.146:0/3143941032 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.336+0000 7feb86777700 1 --2- 172.21.15.146:0/3143941032 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb801393a0 0x7feb8011f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.336+0000 7feb85f76700 1 --2- 172.21.15.146:0/3143941032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb8009e870 0x7feb8011ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.336+0000 7feb85775700 1 -- 172.21.15.146:0/3143941032 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb801393a0 msgr2=0x7feb8011f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.336+0000 7feb85775700 1 --2- 172.21.15.146:0/3143941032 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb801393a0 0x7feb8011f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.336+0000 7feb85775700 1 -- 172.21.15.146:0/3143941032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb8009e870 msgr2=0x7feb8011ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.336+0000 7feb85775700 1 --2- 172.21.15.146:0/3143941032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb8009e870 0x7feb8011ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.336+0000 7feb85775700 1 -- 172.21.15.146:0/3143941032 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb700094a0 con 0x7feb8009f350 2023-10-03T10:17:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.336+0000 7feb86777700 1 --2- 172.21.15.146:0/3143941032 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb801393a0 0x7feb8011f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.336+0000 7feb85775700 1 --2- 172.21.15.146:0/3143941032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb8009f350 0x7feb8011f010 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7feb7000ebe0 tx=0x7feb7000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.337+0000 7feb767fc700 1 -- 172.21.15.146:0/3143941032 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7000c850 con 0x7feb8009f350 2023-10-03T10:17:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.337+0000 7feb767fc700 1 -- 172.21.15.146:0/3143941032 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7000c9b0 con 0x7feb8009f350 2023-10-03T10:17:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.337+0000 7feb767fc700 1 -- 172.21.15.146:0/3143941032 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7000cd40 con 0x7feb8009f350 2023-10-03T10:17:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.337+0000 7feb881da700 1 -- 172.21.15.146:0/3143941032 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb78009a70 con 0x7feb8009f350 2023-10-03T10:17:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.337+0000 7feb881da700 1 -- 172.21.15.146:0/3143941032 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8006f960 con 0x7feb8009f350 2023-10-03T10:17:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.337+0000 7feb767fc700 1 -- 172.21.15.146:0/3143941032 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb70013470 con 0x7feb8009f350 2023-10-03T10:17:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.338+0000 7feb767fc700 1 -- 172.21.15.146:0/3143941032 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feb7003fb00 con 0x7feb8009f350 2023-10-03T10:17:48.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.338+0000 7feb881da700 1 -- 172.21.15.146:0/3143941032 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8004f2a0 con 0x7feb8009f350 2023-10-03T10:17:48.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.343+0000 7feb767fc700 1 -- 172.21.15.146:0/3143941032 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb70013720 con 0x7feb8009f350 2023-10-03T10:17:48.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.433+0000 7f26537f6700 1 Processor -- start 2023-10-03T10:17:48.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.433+0000 7f26537f6700 1 -- start start 2023-10-03T10:17:48.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.434+0000 7f26537f6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f264c09e870 0x7f264c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.434+0000 7f26537f6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f264c134330 0x7f264c13be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.434+0000 7f26537f6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f264c09fa00 con 0x7f264c09f180 2023-10-03T10:17:48.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.434+0000 7f26537f6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f264c0a0370 con 0x7f264c09e870 2023-10-03T10:17:48.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.434+0000 7f26537f6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264c06bec0 con 0x7f264c134330 2023-10-03T10:17:48.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.434+0000 7f2651592700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f264c09e870 0x7f264c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.434+0000 7f2650d91700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f264c09f180 0x7f264c133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39344/0 (socket says 172.21.15.146:39344) 2023-10-03T10:17:48.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.434+0000 7f2650d91700 1 -- 172.21.15.146:0/114720946 learned_addr learned my addr 172.21.15.146:0/114720946 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:48.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.434+0000 7f2651d93700 1 --2- 172.21.15.146:0/114720946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f264c134330 0x7f264c13be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.434+0000 7f2643fff700 1 -- 172.21.15.146:0/114720946 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163426276 0 0) 0x7f264c09fa00 con 0x7f264c09f180 2023-10-03T10:17:48.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.434+0000 7f2643fff700 1 -- 172.21.15.146:0/114720946 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26380035b0 con 0x7f264c09f180 2023-10-03T10:17:48.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.434+0000 7f2651d93700 1 -- 172.21.15.146:0/114720946 >> v2:172.21.15.146:3300/0 conn(0x7f264c09e870 msgr2=0x7f264c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:48.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.434+0000 7f2651d93700 1 --2- 172.21.15.146:0/114720946 >> v2:172.21.15.146:3300/0 conn(0x7f264c09e870 0x7f264c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.434+0000 7f2651d93700 1 -- 172.21.15.146:0/114720946 >> v1:172.21.15.146:6789/0 conn(0x7f264c09f180 legacy=0x7f264c133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.434+0000 7f2651d93700 1 -- 172.21.15.146:0/114720946 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264c09ada0 con 0x7f264c134330 2023-10-03T10:17:48.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.435+0000 7f2651d93700 1 --2- 172.21.15.146:0/114720946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f264c134330 0x7f264c13be80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2644009d90 tx=0x7f264400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79a768fbd51f11e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.435+0000 7f2643fff700 1 -- 172.21.15.146:0/114720946 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264400e070 con 0x7f264c134330 2023-10-03T10:17:48.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.435+0000 7f2643fff700 1 -- 172.21.15.146:0/114720946 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264400bb20 con 0x7f264c134330 2023-10-03T10:17:48.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.435+0000 7f2643fff700 1 -- 172.21.15.146:0/114720946 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2644012430 con 0x7f264c134330 2023-10-03T10:17:48.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.436+0000 7f26537f6700 1 -- 172.21.15.146:0/114720946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f264c134330 msgr2=0x7f264c13be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.436+0000 7f26537f6700 1 --2- 172.21.15.146:0/114720946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f264c134330 0x7f264c13be80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2644009d90 tx=0x7f264400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:48.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.436+0000 7f26537f6700 1 -- 172.21.15.146:0/114720946 shutdown_connections 2023-10-03T10:17:48.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.436+0000 7f26537f6700 1 --2- 172.21.15.146:0/114720946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f264c134330 0x7f264c13be80 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.436+0000 7f26537f6700 1 --2- 172.21.15.146:0/114720946 >> v2:172.21.15.146:3300/0 conn(0x7f264c09e870 0x7f264c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.436+0000 7f26537f6700 1 -- 172.21.15.146:0/114720946 >> 172.21.15.146:0/114720946 conn(0x7f264c0a4430 msgr2=0x7f264c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.436+0000 7f26537f6700 1 -- 172.21.15.146:0/114720946 shutdown_connections 2023-10-03T10:17:48.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.436+0000 7f26537f6700 1 -- 172.21.15.146:0/114720946 wait complete. 2023-10-03T10:17:48.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.437+0000 7f26537f6700 1 Processor -- start 2023-10-03T10:17:48.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.437+0000 7f26537f6700 1 -- start start 2023-10-03T10:17:48.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.438+0000 7f26537f6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f264c09e870 0x7f264c122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.438+0000 7f26537f6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f264c09f180 0x7f264c122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.438+0000 7f26537f6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f264c134330 0x7f264c123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.438+0000 7f26537f6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c06d010 con 0x7f264c09f180 2023-10-03T10:17:48.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.438+0000 7f26537f6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264c123bd0 con 0x7f264c09e870 2023-10-03T10:17:48.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.438+0000 7f26537f6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f264c125fd0 con 0x7f264c134330 2023-10-03T10:17:48.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.438+0000 7f2651592700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f264c09e870 0x7f264c122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.438+0000 7f2651592700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f264c09e870 0x7f264c122790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44004/0 (socket says 172.21.15.146:44004) 2023-10-03T10:17:48.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.438+0000 7f2651592700 1 -- 172.21.15.146:0/1688726377 learned_addr learned my addr 172.21.15.146:0/1688726377 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:48.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.438+0000 7f2650d91700 1 --2- 172.21.15.146:0/1688726377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f264c09f180 0x7f264c122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.438+0000 7f2651d93700 1 --2- 172.21.15.146:0/1688726377 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f264c134330 0x7f264c123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.438+0000 7f2650d91700 1 -- 172.21.15.146:0/1688726377 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f264c134330 msgr2=0x7f264c123210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.438+0000 7f2650d91700 1 --2- 172.21.15.146:0/1688726377 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f264c134330 0x7f264c123210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.438+0000 7f2650d91700 1 -- 172.21.15.146:0/1688726377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f264c09e870 msgr2=0x7f264c122790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.438+0000 7f2650d91700 1 --2- 172.21.15.146:0/1688726377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f264c09e870 0x7f264c122790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.438+0000 7f2650d91700 1 -- 172.21.15.146:0/1688726377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2644009a70 con 0x7f264c09f180 2023-10-03T10:17:48.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.439+0000 7f2650d91700 1 --2- 172.21.15.146:0/1688726377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f264c09f180 0x7f264c122cd0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f263c00c490 tx=0x7f263c00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.439+0000 7f2641ffb700 1 -- 172.21.15.146:0/1688726377 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c005d70 con 0x7f264c09f180 2023-10-03T10:17:48.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.439+0000 7f2641ffb700 1 -- 172.21.15.146:0/1688726377 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263c0070d0 con 0x7f264c09f180 2023-10-03T10:17:48.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.439+0000 7f2641ffb700 1 -- 172.21.15.146:0/1688726377 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c007440 con 0x7f264c09f180 2023-10-03T10:17:48.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.439+0000 7f26537f6700 1 -- 172.21.15.146:0/1688726377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264c124bc0 con 0x7f264c09f180 2023-10-03T10:17:48.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.439+0000 7f26537f6700 1 -- 172.21.15.146:0/1688726377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264c1336e0 con 0x7f264c09f180 2023-10-03T10:17:48.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.440+0000 7f2641ffb700 1 -- 172.21.15.146:0/1688726377 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f263c0075a0 con 0x7f264c09f180 2023-10-03T10:17:48.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.440+0000 7f2641ffb700 1 -- 172.21.15.146:0/1688726377 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f263c03e710 con 0x7f264c09f180 2023-10-03T10:17:48.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.441+0000 7f26537f6700 1 -- 172.21.15.146:0/1688726377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264c04f2a0 con 0x7f264c09f180 2023-10-03T10:17:48.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.446+0000 7f2641ffb700 1 -- 172.21.15.146:0/1688726377 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f263c017080 con 0x7f264c09f180 2023-10-03T10:17:48.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.463+0000 7f1b14932700 1 Processor -- start 2023-10-03T10:17:48.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.463+0000 7f1b14932700 1 -- start start 2023-10-03T10:17:48.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.464+0000 7f1b14932700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1b1009a130 0x7f1b1009e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.464+0000 7f1b14932700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1009f1e0 0x7f1b1013fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.464+0000 7f1b14932700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b10072b30 con 0x7f1b1009edb0 2023-10-03T10:17:48.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.464+0000 7f1b14932700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b1009a500 con 0x7f1b1009a130 2023-10-03T10:17:48.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.464+0000 7f1b14932700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1009ada0 con 0x7f1b1009f1e0 2023-10-03T10:17:48.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.464+0000 7f1b0ed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1009f1e0 0x7f1b1013fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.464+0000 7f1b0dd9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1b1009edb0 0x7f1b1013c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39352/0 (socket says 172.21.15.146:39352) 2023-10-03T10:17:48.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.464+0000 7f1b0dd9b700 1 -- 172.21.15.146:0/3317768276 learned_addr learned my addr 172.21.15.146:0/3317768276 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:48.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.464+0000 7f1b0e59c700 1 --2- 172.21.15.146:0/3317768276 >> v2:172.21.15.146:3300/0 conn(0x7f1b1009a130 0x7f1b1009e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.465+0000 7f1b0ed9d700 1 -- 172.21.15.146:0/3317768276 >> v2:172.21.15.146:3300/0 conn(0x7f1b1009a130 msgr2=0x7f1b1009e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:48.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.465+0000 7f1b0ed9d700 1 --2- 172.21.15.146:0/3317768276 >> v2:172.21.15.146:3300/0 conn(0x7f1b1009a130 0x7f1b1009e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.465+0000 7f1b0ed9d700 1 -- 172.21.15.146:0/3317768276 >> v1:172.21.15.146:6789/0 conn(0x7f1b1009edb0 legacy=0x7f1b1013c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.465+0000 7f1b0ed9d700 1 -- 172.21.15.146:0/3317768276 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1009fe00 con 0x7f1b1009f1e0 2023-10-03T10:17:48.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.465+0000 7f1b0d59a700 1 -- 172.21.15.146:0/3317768276 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834012296 0 0) 0x7f1b10072b30 con 0x7f1b1009edb0 2023-10-03T10:17:48.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.465+0000 7f1b0e59c700 1 --2- 172.21.15.146:0/3317768276 >> v2:172.21.15.146:3300/0 conn(0x7f1b1009a130 0x7f1b1009e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.465+0000 7f1b0ed9d700 1 --2- 172.21.15.146:0/3317768276 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1009f1e0 0x7f1b1013fb40 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1b08009d90 tx=0x7f1b0800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63e7a921ec84b6e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.465+0000 7f1b0d59a700 1 -- 172.21.15.146:0/3317768276 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0800e070 con 0x7f1b1009f1e0 2023-10-03T10:17:48.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.465+0000 7f1b0d59a700 1 -- 172.21.15.146:0/3317768276 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0800bb20 con 0x7f1b1009f1e0 2023-10-03T10:17:48.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.465+0000 7f1b0d59a700 1 -- 172.21.15.146:0/3317768276 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08012430 con 0x7f1b1009f1e0 2023-10-03T10:17:48.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.466+0000 7f1b14932700 1 -- 172.21.15.146:0/3317768276 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1009f1e0 msgr2=0x7f1b1013fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.466+0000 7f1b14932700 1 --2- 172.21.15.146:0/3317768276 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1009f1e0 0x7f1b1013fb40 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1b08009d90 tx=0x7f1b0800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:48.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.466+0000 7f1b14932700 1 -- 172.21.15.146:0/3317768276 shutdown_connections 2023-10-03T10:17:48.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.466+0000 7f1b14932700 1 --2- 172.21.15.146:0/3317768276 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1009f1e0 0x7f1b1013fb40 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.466+0000 7f1b14932700 1 --2- 172.21.15.146:0/3317768276 >> v2:172.21.15.146:3300/0 conn(0x7f1b1009a130 0x7f1b1009e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.466+0000 7f1b14932700 1 -- 172.21.15.146:0/3317768276 >> 172.21.15.146:0/3317768276 conn(0x7f1b100a4430 msgr2=0x7f1b100a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.466+0000 7f1b14932700 1 -- 172.21.15.146:0/3317768276 shutdown_connections 2023-10-03T10:17:48.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.466+0000 7f1b14932700 1 -- 172.21.15.146:0/3317768276 wait complete. 2023-10-03T10:17:48.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.467+0000 7f1b14932700 1 Processor -- start 2023-10-03T10:17:48.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.467+0000 7f1b14932700 1 -- start start 2023-10-03T10:17:48.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.468+0000 7f1b14932700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1009a130 0x7f1b1011a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.468+0000 7f1b14932700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b1009edb0 0x7f1b1011ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.468+0000 7f1b14932700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1b1009f1e0 0x7f1b1011b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.468+0000 7f1b14932700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1011c510 con 0x7f1b1009edb0 2023-10-03T10:17:48.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.468+0000 7f1b14932700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1011d320 con 0x7f1b1009a130 2023-10-03T10:17:48.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.468+0000 7f1b14932700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1011bc80 con 0x7f1b1009f1e0 2023-10-03T10:17:48.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.468+0000 7f1b0e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1009a130 0x7f1b1011a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.468+0000 7f1b0e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1009a130 0x7f1b1011a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44010/0 (socket says 172.21.15.146:44010) 2023-10-03T10:17:48.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.468+0000 7f1b0e59c700 1 -- 172.21.15.146:0/3530955509 learned_addr learned my addr 172.21.15.146:0/3530955509 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:48.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.468+0000 7f1b0dd9b700 1 --2- 172.21.15.146:0/3530955509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b1009edb0 0x7f1b1011ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.469+0000 7f1b0e59c700 1 -- 172.21.15.146:0/3530955509 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1b1009f1e0 msgr2=0x7f1b1011b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.469+0000 7f1b0e59c700 1 --2- 172.21.15.146:0/3530955509 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1b1009f1e0 0x7f1b1011b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.469+0000 7f1b0e59c700 1 -- 172.21.15.146:0/3530955509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b1009edb0 msgr2=0x7f1b1011ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.469+0000 7f1b0e59c700 1 --2- 172.21.15.146:0/3530955509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b1009edb0 0x7f1b1011ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.469+0000 7f1b0e59c700 1 -- 172.21.15.146:0/3530955509 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b000094a0 con 0x7f1b1009a130 2023-10-03T10:17:48.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.469+0000 7f1b0e59c700 1 --2- 172.21.15.146:0/3530955509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1009a130 0x7f1b1011a6c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000ebe0 tx=0x7f1b0000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.469+0000 7f1afeffd700 1 -- 172.21.15.146:0/3530955509 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0000c850 con 0x7f1b1009a130 2023-10-03T10:17:48.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.469+0000 7f1afeffd700 1 -- 172.21.15.146:0/3530955509 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0000c9b0 con 0x7f1b1009a130 2023-10-03T10:17:48.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.469+0000 7f1b14932700 1 -- 172.21.15.146:0/3530955509 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b08009a70 con 0x7f1b1009a130 2023-10-03T10:17:48.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.469+0000 7f1b14932700 1 -- 172.21.15.146:0/3530955509 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1009e2c0 con 0x7f1b1009a130 2023-10-03T10:17:48.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.469+0000 7f1afeffd700 1 -- 172.21.15.146:0/3530955509 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0000cd40 con 0x7f1b1009a130 2023-10-03T10:17:48.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.470+0000 7f1afcff9700 1 -- 172.21.15.146:0/3530955509 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af40052e0 con 0x7f1b1009a130 2023-10-03T10:17:48.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.470+0000 7f1afeffd700 1 -- 172.21.15.146:0/3530955509 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b00013470 con 0x7f1b1009a130 2023-10-03T10:17:48.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.471+0000 7f1afeffd700 1 -- 172.21.15.146:0/3530955509 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1b0003fb40 con 0x7f1b1009a130 2023-10-03T10:17:48.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.475+0000 7f1afeffd700 1 -- 172.21.15.146:0/3530955509 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b00013720 con 0x7f1b1009a130 2023-10-03T10:17:48.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.482+0000 7ff7c04db700 1 Processor -- start 2023-10-03T10:17:48.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.482+0000 7ff7c04db700 1 -- start start 2023-10-03T10:17:48.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.483+0000 7ff7c04db700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7b809d860 0x7ff7b809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.483+0000 7ff7c04db700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7b809e170 0x7ff7b81307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.483+0000 7ff7c04db700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b809aaa0 con 0x7ff7b8130ce0 2023-10-03T10:17:48.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.483+0000 7ff7c04db700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b809f870 con 0x7ff7b809e170 2023-10-03T10:17:48.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.483+0000 7ff7c04db700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b809b360 con 0x7ff7b809d860 2023-10-03T10:17:48.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.483+0000 7ff7bea78700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff7b8130ce0 0x7ff7b81379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39354/0 (socket says 172.21.15.146:39354) 2023-10-03T10:17:48.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.483+0000 7ff7bea78700 1 -- 172.21.15.146:0/1814115836 learned_addr learned my addr 172.21.15.146:0/1814115836 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:48.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.485+0000 7ff7bd275700 1 -- 172.21.15.146:0/1814115836 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734555202 0 0) 0x7ff7b809aaa0 con 0x7ff7b8130ce0 2023-10-03T10:17:48.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.485+0000 7ff7bd275700 1 -- 172.21.15.146:0/1814115836 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7a40035b0 con 0x7ff7b8130ce0 2023-10-03T10:17:48.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.485+0000 7ff7bd275700 1 -- 172.21.15.146:0/1814115836 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1138689769 0 0) 0x7ff7a40035b0 con 0x7ff7b8130ce0 2023-10-03T10:17:48.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.485+0000 7ff7bd275700 1 -- 172.21.15.146:0/1814115836 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7b809d860 msgr2=0x7ff7b809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:48.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.485+0000 7ff7bd275700 1 --2- 172.21.15.146:0/1814115836 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7b809d860 0x7ff7b809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.485+0000 7ff7bd275700 1 -- 172.21.15.146:0/1814115836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7b809e170 msgr2=0x7ff7b81307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:48.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.485+0000 7ff7bd275700 1 --2- 172.21.15.146:0/1814115836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7b809e170 0x7ff7b81307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.485+0000 7ff7bd275700 1 -- 172.21.15.146:0/1814115836 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b809b620 con 0x7ff7b8130ce0 2023-10-03T10:17:48.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.485+0000 7ff7bd275700 1 -- 172.21.15.146:0/1814115836 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2532932501 0 0) 0x7ff7a8001670 con 0x7ff7b8130ce0 2023-10-03T10:17:48.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.485+0000 7ff7bd275700 1 -- 172.21.15.146:0/1814115836 >> v1:172.21.15.146:6789/0 conn(0x7ff7b8130ce0 legacy=0x7ff7b81379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.485+0000 7ff7bd275700 1 --2- 172.21.15.146:0/1814115836 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7b809d860 0x7ff7a4003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.485+0000 7ff7bd275700 1 --2- 172.21.15.146:0/1814115836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7b809e170 0x7ff7a40041e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.485+0000 7ff7bd275700 1 --2- 172.21.15.146:0/1814115836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7a4004a00 0x7ff7a4004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.485+0000 7ff7bd275700 1 -- 172.21.15.146:0/1814115836 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b809f870 con 0x7ff7a4004a00 2023-10-03T10:17:48.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.485+0000 7ff7bd275700 1 -- 172.21.15.146:0/1814115836 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b809b360 con 0x7ff7b809e170 2023-10-03T10:17:48.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.485+0000 7ff7bd275700 1 -- 172.21.15.146:0/1814115836 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a4005680 con 0x7ff7b809d860 2023-10-03T10:17:48.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.485+0000 7ff7bea78700 1 --2- 172.21.15.146:0/1814115836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7a4004a00 0x7ff7a4004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.485+0000 7ff7be277700 1 --2- 172.21.15.146:0/1814115836 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7b809d860 0x7ff7a4003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.486+0000 7ff7bea78700 1 -- 172.21.15.146:0/1814115836 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7b809d860 msgr2=0x7ff7a4003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:48.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.486+0000 7ff7bea78700 1 --2- 172.21.15.146:0/1814115836 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7b809d860 0x7ff7a4003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.486+0000 7ff7bea78700 1 -- 172.21.15.146:0/1814115836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7b809e170 msgr2=0x7ff7a40041e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:48.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.486+0000 7ff7bea78700 1 --2- 172.21.15.146:0/1814115836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7b809e170 0x7ff7a40041e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.486+0000 7ff7bea78700 1 -- 172.21.15.146:0/1814115836 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a40035b0 con 0x7ff7a4004a00 2023-10-03T10:17:48.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.486+0000 7ff7bea78700 1 --2- 172.21.15.146:0/1814115836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7a4004a00 0x7ff7a4004e70 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7ff7a800c160 tx=0x7ff7a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45afc51316d6a40 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.486+0000 7ff7bd275700 1 -- 172.21.15.146:0/1814115836 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a8007b70 con 0x7ff7a4004a00 2023-10-03T10:17:48.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.486+0000 7ff7bd275700 1 -- 172.21.15.146:0/1814115836 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a800cd00 con 0x7ff7a4004a00 2023-10-03T10:17:48.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.486+0000 7ff7bd275700 1 -- 172.21.15.146:0/1814115836 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a8005ba0 con 0x7ff7a4004a00 2023-10-03T10:17:48.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.487+0000 7ff7c04db700 1 -- 172.21.15.146:0/1814115836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7a4004a00 msgr2=0x7ff7a4004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.487+0000 7ff7c04db700 1 --2- 172.21.15.146:0/1814115836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7a4004a00 0x7ff7a4004e70 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7ff7a800c160 tx=0x7ff7a4005880 comp rx=0 tx=0).stop 2023-10-03T10:17:48.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.490+0000 7ff7c04db700 1 -- 172.21.15.146:0/1814115836 shutdown_connections 2023-10-03T10:17:48.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.490+0000 7ff7c04db700 1 --2- 172.21.15.146:0/1814115836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7a4004a00 0x7ff7a4004e70 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.490+0000 7ff7c04db700 1 --2- 172.21.15.146:0/1814115836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7b809e170 0x7ff7a40041e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.490+0000 7ff7c04db700 1 --2- 172.21.15.146:0/1814115836 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7b809d860 0x7ff7a4003a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.490+0000 7ff7c04db700 1 -- 172.21.15.146:0/1814115836 >> 172.21.15.146:0/1814115836 conn(0x7ff7b8099c40 msgr2=0x7ff7b80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.490+0000 7ff7c04db700 1 -- 172.21.15.146:0/1814115836 shutdown_connections 2023-10-03T10:17:48.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.490+0000 7ff7c04db700 1 -- 172.21.15.146:0/1814115836 wait complete. 2023-10-03T10:17:48.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.492+0000 7ff7c04db700 1 Processor -- start 2023-10-03T10:17:48.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.492+0000 7ff7c04db700 1 -- start start 2023-10-03T10:17:48.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.492+0000 7ff7c04db700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7a4004a00 0x7ff7b81cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.493+0000 7ff7c04db700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7b809d860 0x7ff7b81ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.493+0000 7ff7c04db700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7b809e170 0x7ff7b81cd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.493+0000 7ff7c04db700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b812ef80 con 0x7ff7b809d860 2023-10-03T10:17:48.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.493+0000 7ff7c04db700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b813c060 con 0x7ff7a4004a00 2023-10-03T10:17:48.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.493+0000 7ff7c04db700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b812ea60 con 0x7ff7b809e170 2023-10-03T10:17:48.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.493+0000 7ff7bea78700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7b809e170 0x7ff7b81cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.493+0000 7ff7bea78700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7b809e170 0x7ff7b81cd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58502/0 (socket says 172.21.15.146:58502) 2023-10-03T10:17:48.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.493+0000 7ff7bea78700 1 -- 172.21.15.146:0/4275584024 learned_addr learned my addr 172.21.15.146:0/4275584024 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:48.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.493+0000 7ff7be277700 1 --2- 172.21.15.146:0/4275584024 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7a4004a00 0x7ff7b81cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.493+0000 7ff7bea78700 1 -- 172.21.15.146:0/4275584024 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7a4004a00 msgr2=0x7ff7b81cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.493+0000 7ff7bea78700 1 --2- 172.21.15.146:0/4275584024 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7a4004a00 0x7ff7b81cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.493+0000 7ff7bea78700 1 -- 172.21.15.146:0/4275584024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7b809d860 msgr2=0x7ff7b81ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.493+0000 7ff7bea78700 1 --2- 172.21.15.146:0/4275584024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7b809d860 0x7ff7b81ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.493+0000 7ff7bea78700 1 -- 172.21.15.146:0/4275584024 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b813b570 con 0x7ff7b809e170 2023-10-03T10:17:48.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.494+0000 7ff7bea78700 1 --2- 172.21.15.146:0/4275584024 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7b809e170 0x7ff7b81cd020 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff7b804fd60 tx=0x7ff7b809b1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.494+0000 7ff7aeffd700 1 -- 172.21.15.146:0/4275584024 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a8005e80 con 0x7ff7b809e170 2023-10-03T10:17:48.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.495+0000 7ff7aeffd700 1 -- 172.21.15.146:0/4275584024 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a800ce70 con 0x7ff7b809e170 2023-10-03T10:17:48.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.495+0000 7ff7aeffd700 1 -- 172.21.15.146:0/4275584024 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a80072d0 con 0x7ff7b809e170 2023-10-03T10:17:48.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.495+0000 7ff7c04db700 1 -- 172.21.15.146:0/4275584024 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b812e040 con 0x7ff7b809e170 2023-10-03T10:17:48.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.495+0000 7ff7c04db700 1 -- 172.21.15.146:0/4275584024 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b812e7a0 con 0x7ff7b809e170 2023-10-03T10:17:48.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.496+0000 7ff7c04db700 1 -- 172.21.15.146:0/4275584024 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b809aa40 con 0x7ff7b809e170 2023-10-03T10:17:48.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.497+0000 7ff7aeffd700 1 -- 172.21.15.146:0/4275584024 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff7a8007430 con 0x7ff7b809e170 2023-10-03T10:17:48.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.497+0000 7ff7aeffd700 1 -- 172.21.15.146:0/4275584024 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff7a8041050 con 0x7ff7b809e170 2023-10-03T10:17:48.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.505+0000 7ff7aeffd700 1 -- 172.21.15.146:0/4275584024 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff7a80076e0 con 0x7ff7b809e170 2023-10-03T10:17:48.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.547+0000 7feb881da700 1 -- 172.21.15.146:0/3143941032 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feb80072d60 con 0x7feb8009f350 2023-10-03T10:17:48.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.548+0000 7feb767fc700 1 -- 172.21.15.146:0/3143941032 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb70021030 con 0x7feb8009f350 2023-10-03T10:17:48.548 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:48.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.550+0000 7feb881da700 1 -- 172.21.15.146:0/3143941032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb8009f350 msgr2=0x7feb8011f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.550+0000 7feb881da700 1 --2- 172.21.15.146:0/3143941032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb8009f350 0x7feb8011f010 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7feb7000ebe0 tx=0x7feb7000eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.550+0000 7feb881da700 1 -- 172.21.15.146:0/3143941032 shutdown_connections 2023-10-03T10:17:48.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.550+0000 7feb881da700 1 --2- 172.21.15.146:0/3143941032 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feb801393a0 0x7feb8011f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.550+0000 7feb881da700 1 --2- 172.21.15.146:0/3143941032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb8009e870 0x7feb8011ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.550+0000 7feb881da700 1 --2- 172.21.15.146:0/3143941032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feb8009f350 0x7feb8011f010 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.550+0000 7feb881da700 1 -- 172.21.15.146:0/3143941032 >> 172.21.15.146:0/3143941032 conn(0x7feb800a4430 msgr2=0x7feb801382c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.550+0000 7feb881da700 1 -- 172.21.15.146:0/3143941032 shutdown_connections 2023-10-03T10:17:48.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.550+0000 7feb881da700 1 -- 172.21.15.146:0/3143941032 wait complete. 2023-10-03T10:17:48.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:48.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.678+0000 7f1afcff9700 1 -- 172.21.15.146:0/3530955509 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1af4005590 con 0x7f1b1009a130 2023-10-03T10:17:48.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.678+0000 7f1afeffd700 1 -- 172.21.15.146:0/3530955509 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1b00017030 con 0x7f1b1009a130 2023-10-03T10:17:48.679 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:48.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.681+0000 7f1afcff9700 1 -- 172.21.15.146:0/3530955509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1009a130 msgr2=0x7f1b1011a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.681+0000 7f1afcff9700 1 --2- 172.21.15.146:0/3530955509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1009a130 0x7f1b1011a6c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000ebe0 tx=0x7f1b0000eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.681+0000 7f1afcff9700 1 -- 172.21.15.146:0/3530955509 shutdown_connections 2023-10-03T10:17:48.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.681+0000 7f1afcff9700 1 --2- 172.21.15.146:0/3530955509 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1b1009f1e0 0x7f1b1011b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.681+0000 7f1afcff9700 1 --2- 172.21.15.146:0/3530955509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b1009a130 0x7f1b1011a6c0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.681+0000 7f1afcff9700 1 --2- 172.21.15.146:0/3530955509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b1009edb0 0x7f1b1011ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.681+0000 7f1afcff9700 1 -- 172.21.15.146:0/3530955509 >> 172.21.15.146:0/3530955509 conn(0x7f1b100a4430 msgr2=0x7f1b100a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.681+0000 7f1afcff9700 1 -- 172.21.15.146:0/3530955509 shutdown_connections 2023-10-03T10:17:48.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.681+0000 7f1afcff9700 1 -- 172.21.15.146:0/3530955509 wait complete. 2023-10-03T10:17:48.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:48.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.712+0000 7f26537f6700 1 -- 172.21.15.146:0/1688726377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f264c072d60 con 0x7f264c09f180 2023-10-03T10:17:48.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.712+0000 7f2641ffb700 1 -- 172.21.15.146:0/1688726377 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f263c011bc0 con 0x7f264c09f180 2023-10-03T10:17:48.713 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:48.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.714+0000 7f26537f6700 1 -- 172.21.15.146:0/1688726377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f264c09f180 msgr2=0x7f264c122cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.714+0000 7f26537f6700 1 --2- 172.21.15.146:0/1688726377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f264c09f180 0x7f264c122cd0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f263c00c490 tx=0x7f263c00c7a0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.714+0000 7f26537f6700 1 -- 172.21.15.146:0/1688726377 shutdown_connections 2023-10-03T10:17:48.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.714+0000 7f26537f6700 1 --2- 172.21.15.146:0/1688726377 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f264c134330 0x7f264c123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.714+0000 7f26537f6700 1 --2- 172.21.15.146:0/1688726377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f264c09e870 0x7f264c122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.714+0000 7f26537f6700 1 --2- 172.21.15.146:0/1688726377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f264c09f180 0x7f264c122cd0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.714+0000 7f26537f6700 1 -- 172.21.15.146:0/1688726377 >> 172.21.15.146:0/1688726377 conn(0x7f264c0a4430 msgr2=0x7f264c0a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.714+0000 7f26537f6700 1 -- 172.21.15.146:0/1688726377 shutdown_connections 2023-10-03T10:17:48.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.714+0000 7f26537f6700 1 -- 172.21.15.146:0/1688726377 wait complete. 2023-10-03T10:17:48.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:48.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.754+0000 7ff7c04db700 1 -- 172.21.15.146:0/4275584024 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff7b804f2a0 con 0x7ff7b809e170 2023-10-03T10:17:48.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.754+0000 7ff7aeffd700 1 -- 172.21.15.146:0/4275584024 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff7a8017020 con 0x7ff7b809e170 2023-10-03T10:17:48.755 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.756+0000 7ff7c04db700 1 -- 172.21.15.146:0/4275584024 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7b809e170 msgr2=0x7ff7b81cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.756+0000 7ff7c04db700 1 --2- 172.21.15.146:0/4275584024 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7b809e170 0x7ff7b81cd020 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff7b804fd60 tx=0x7ff7b809b1a0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.756+0000 7ff7c04db700 1 -- 172.21.15.146:0/4275584024 shutdown_connections 2023-10-03T10:17:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.756+0000 7ff7c04db700 1 --2- 172.21.15.146:0/4275584024 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7b809e170 0x7ff7b81cd020 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.756+0000 7ff7c04db700 1 --2- 172.21.15.146:0/4275584024 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7a4004a00 0x7ff7b81cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.756+0000 7ff7c04db700 1 --2- 172.21.15.146:0/4275584024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7b809d860 0x7ff7b81ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.756+0000 7ff7c04db700 1 -- 172.21.15.146:0/4275584024 >> 172.21.15.146:0/4275584024 conn(0x7ff7b8099c40 msgr2=0x7ff7b80a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.756+0000 7ff7c04db700 1 -- 172.21.15.146:0/4275584024 shutdown_connections 2023-10-03T10:17:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:48.756+0000 7ff7c04db700 1 -- 172.21.15.146:0/4275584024 wait complete. 2023-10-03T10:17:48.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:49.564 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:49.694 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:49.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.697+0000 7f0c7a018700 1 Processor -- start 2023-10-03T10:17:49.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.697+0000 7f0c7a018700 1 -- start start 2023-10-03T10:17:49.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.698+0000 7f0c7a018700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c74133ad0 0x7f0c74133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.698+0000 7f0c7a018700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c741300a0 0x7f0c741304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.698+0000 7f0c7a018700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c741309f0 0x7f0c7413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.698+0000 7f0c7a018700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c7406b2d0 con 0x7f0c74133ad0 2023-10-03T10:17:49.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.698+0000 7f0c7a018700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c74133610 con 0x7f0c741309f0 2023-10-03T10:17:49.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.698+0000 7f0c7a018700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7409a500 con 0x7f0c741300a0 2023-10-03T10:17:49.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.698+0000 7f0c737fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c74133ad0 0x7f0c74133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.698+0000 7f0c73fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c741309f0 0x7f0c7413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.698+0000 7f0c737fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c74133ad0 0x7f0c74133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60288/0 (socket says 172.21.15.146:60288) 2023-10-03T10:17:49.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.698+0000 7f0c73fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c741309f0 0x7f0c7413a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44048/0 (socket says 172.21.15.146:44048) 2023-10-03T10:17:49.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.698+0000 7f0c72ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c741300a0 0x7f0c741304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.698+0000 7f0c737fe700 1 -- 172.21.15.146:0/1098553703 learned_addr learned my addr 172.21.15.146:0/1098553703 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:49.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.698+0000 7f0c72ffd700 1 -- 172.21.15.146:0/1098553703 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c741309f0 msgr2=0x7f0c7413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.698+0000 7f0c72ffd700 1 --2- 172.21.15.146:0/1098553703 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c741309f0 0x7f0c7413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.698+0000 7f0c72ffd700 1 -- 172.21.15.146:0/1098553703 >> v2:172.21.15.146:3300/0 conn(0x7f0c74133ad0 msgr2=0x7f0c74133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.698+0000 7f0c72ffd700 1 --2- 172.21.15.146:0/1098553703 >> v2:172.21.15.146:3300/0 conn(0x7f0c74133ad0 0x7f0c74133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.698+0000 7f0c72ffd700 1 -- 172.21.15.146:0/1098553703 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c741338b0 con 0x7f0c741300a0 2023-10-03T10:17:49.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.698+0000 7f0c737fe700 1 --2- 172.21.15.146:0/1098553703 >> v2:172.21.15.146:3300/0 conn(0x7f0c74133ad0 0x7f0c74133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.698+0000 7f0c73fff700 1 --2- 172.21.15.146:0/1098553703 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c741309f0 0x7f0c7413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.699+0000 7f0c72ffd700 1 --2- 172.21.15.146:0/1098553703 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c741300a0 0x7f0c741304b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009840 tx=0x7f0c68009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15e763253c9f3176 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.699+0000 7f0c727fc700 1 -- 172.21.15.146:0/1098553703 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c68011830 con 0x7f0c741300a0 2023-10-03T10:17:49.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.699+0000 7f0c727fc700 1 -- 172.21.15.146:0/1098553703 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c68011990 con 0x7f0c741300a0 2023-10-03T10:17:49.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.699+0000 7f0c727fc700 1 -- 172.21.15.146:0/1098553703 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c68011d20 con 0x7f0c741300a0 2023-10-03T10:17:49.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.699+0000 7f0c7a018700 1 -- 172.21.15.146:0/1098553703 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c741300a0 msgr2=0x7f0c741304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.699+0000 7f0c7a018700 1 --2- 172.21.15.146:0/1098553703 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c741300a0 0x7f0c741304b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009840 tx=0x7f0c68009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:49.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.699+0000 7f0c7a018700 1 -- 172.21.15.146:0/1098553703 shutdown_connections 2023-10-03T10:17:49.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.699+0000 7f0c7a018700 1 --2- 172.21.15.146:0/1098553703 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c741309f0 0x7f0c7413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.699+0000 7f0c7a018700 1 --2- 172.21.15.146:0/1098553703 >> v2:172.21.15.146:3300/0 conn(0x7f0c74133ad0 0x7f0c74133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.699+0000 7f0c7a018700 1 --2- 172.21.15.146:0/1098553703 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c741300a0 0x7f0c741304b0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.699+0000 7f0c7a018700 1 -- 172.21.15.146:0/1098553703 >> 172.21.15.146:0/1098553703 conn(0x7f0c74099c40 msgr2=0x7f0c740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.700+0000 7f0c7a018700 1 -- 172.21.15.146:0/1098553703 shutdown_connections 2023-10-03T10:17:49.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.700+0000 7f0c7a018700 1 -- 172.21.15.146:0/1098553703 wait complete. 2023-10-03T10:17:49.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.700+0000 7f0c7a018700 1 Processor -- start 2023-10-03T10:17:49.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.701+0000 7f0c7a018700 1 -- start start 2023-10-03T10:17:49.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.701+0000 7f0c7a018700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c741300a0 0x7f0c7411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.701+0000 7f0c7a018700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c741309f0 0x7f0c7411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.701+0000 7f0c7a018700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c74133ad0 0x7f0c7411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.701+0000 7f0c7a018700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7411fd70 con 0x7f0c741309f0 2023-10-03T10:17:49.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.701+0000 7f0c7a018700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7411f060 con 0x7f0c741300a0 2023-10-03T10:17:49.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.701+0000 7f0c7a018700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c740a33e0 con 0x7f0c74133ad0 2023-10-03T10:17:49.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.701+0000 7f0c737fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c741300a0 0x7f0c7411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.701+0000 7f0c73fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c74133ad0 0x7f0c7411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.701+0000 7f0c737fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c741300a0 0x7f0c7411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44058/0 (socket says 172.21.15.146:44058) 2023-10-03T10:17:49.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.701+0000 7f0c737fe700 1 -- 172.21.15.146:0/80481921 learned_addr learned my addr 172.21.15.146:0/80481921 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:49.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.701+0000 7f0c72ffd700 1 --2- 172.21.15.146:0/80481921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c741309f0 0x7f0c7411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.701+0000 7f0c737fe700 1 -- 172.21.15.146:0/80481921 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c74133ad0 msgr2=0x7f0c7411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.701+0000 7f0c737fe700 1 --2- 172.21.15.146:0/80481921 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c74133ad0 0x7f0c7411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.701+0000 7f0c737fe700 1 -- 172.21.15.146:0/80481921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c741309f0 msgr2=0x7f0c7411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.701+0000 7f0c737fe700 1 --2- 172.21.15.146:0/80481921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c741309f0 0x7f0c7411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.701+0000 7f0c737fe700 1 -- 172.21.15.146:0/80481921 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c009a70 con 0x7f0c741300a0 2023-10-03T10:17:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.702+0000 7f0c73fff700 1 --2- 172.21.15.146:0/80481921 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c74133ad0 0x7f0c7411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.702+0000 7f0c72ffd700 1 --2- 172.21.15.146:0/80481921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c741309f0 0x7f0c7411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.702+0000 7f0c737fe700 1 --2- 172.21.15.146:0/80481921 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c741300a0 0x7f0c7411da40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0c6400ebe0 tx=0x7f0c6400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.702+0000 7f0c5bfff700 1 -- 172.21.15.146:0/80481921 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6400c850 con 0x7f0c741300a0 2023-10-03T10:17:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.702+0000 7f0c5bfff700 1 -- 172.21.15.146:0/80481921 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6400c9b0 con 0x7f0c741300a0 2023-10-03T10:17:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.702+0000 7f0c7a018700 1 -- 172.21.15.146:0/80481921 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c64009550 con 0x7f0c741300a0 2023-10-03T10:17:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.702+0000 7f0c5bfff700 1 -- 172.21.15.146:0/80481921 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6400cd20 con 0x7f0c741300a0 2023-10-03T10:17:49.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.702+0000 7f0c7a018700 1 -- 172.21.15.146:0/80481921 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c680094a0 con 0x7f0c741300a0 2023-10-03T10:17:49.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.703+0000 7f0c5bfff700 1 -- 172.21.15.146:0/80481921 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c64013470 con 0x7f0c741300a0 2023-10-03T10:17:49.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.703+0000 7f0c5bfff700 1 -- 172.21.15.146:0/80481921 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0c6403fab0 con 0x7f0c741300a0 2023-10-03T10:17:49.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.703+0000 7f0c7a018700 1 -- 172.21.15.146:0/80481921 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c7412dd60 con 0x7f0c741300a0 2023-10-03T10:17:49.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.708+0000 7f0c5bfff700 1 -- 172.21.15.146:0/80481921 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c6401b3b0 con 0x7f0c741300a0 2023-10-03T10:17:49.727 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:49.770 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:49.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.826+0000 7f95303d5700 1 Processor -- start 2023-10-03T10:17:49.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.826+0000 7f95303d5700 1 -- start start 2023-10-03T10:17:49.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.827+0000 7f95303d5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9528138410 0x7f95280a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.827+0000 7f95303d5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f952813dd10 0x7f95281400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.827+0000 7f95303d5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95281379e0 con 0x7f9528138040 2023-10-03T10:17:49.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.827+0000 7f95303d5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95280a2100 con 0x7f9528138410 2023-10-03T10:17:49.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.827+0000 7f95303d5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f952809b9b0 con 0x7f952813dd10 2023-10-03T10:17:49.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.827+0000 7f952d970700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9528138410 0x7f95280a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.827+0000 7f952d970700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9528138410 0x7f95280a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44066/0 (socket says 172.21.15.146:44066) 2023-10-03T10:17:49.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.827+0000 7f952d970700 1 -- 172.21.15.146:0/4164237303 learned_addr learned my addr 172.21.15.146:0/4164237303 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:49.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.827+0000 7f952e171700 1 --1- 172.21.15.146:0/4164237303 >> v1:172.21.15.146:6789/0 conn(0x7f9528138040 0x7f95280a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39360/0 (socket says 172.21.15.146:39360) 2023-10-03T10:17:49.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.827+0000 7f952e972700 1 --2- 172.21.15.146:0/4164237303 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f952813dd10 0x7f95281400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.827+0000 7f952d970700 1 -- 172.21.15.146:0/4164237303 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f952813dd10 msgr2=0x7f95281400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.827+0000 7f952d970700 1 --2- 172.21.15.146:0/4164237303 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f952813dd10 0x7f95281400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.827+0000 7f952d970700 1 -- 172.21.15.146:0/4164237303 >> v1:172.21.15.146:6789/0 conn(0x7f9528138040 legacy=0x7f95280a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.827+0000 7f952d970700 1 -- 172.21.15.146:0/4164237303 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9528137c10 con 0x7f9528138410 2023-10-03T10:17:49.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.827+0000 7f952d16f700 1 -- 172.21.15.146:0/4164237303 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703062645 0 0) 0x7f95281379e0 con 0x7f9528138040 2023-10-03T10:17:49.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.828+0000 7f952d970700 1 --2- 172.21.15.146:0/4164237303 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9528138410 0x7f95280a0ff0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f9518009920 tx=0x7f9518009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4c9bbed3d7e45e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.828+0000 7f952d16f700 1 -- 172.21.15.146:0/4164237303 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951800ba60 con 0x7f9528138410 2023-10-03T10:17:49.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.828+0000 7f952d16f700 1 -- 172.21.15.146:0/4164237303 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951800bbc0 con 0x7f9528138410 2023-10-03T10:17:49.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.828+0000 7f952d16f700 1 -- 172.21.15.146:0/4164237303 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518009e70 con 0x7f9528138410 2023-10-03T10:17:49.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.829+0000 7f95303d5700 1 -- 172.21.15.146:0/4164237303 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9528138410 msgr2=0x7f95280a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.829+0000 7f95303d5700 1 --2- 172.21.15.146:0/4164237303 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9528138410 0x7f95280a0ff0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f9518009920 tx=0x7f9518009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:49.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.829+0000 7f95303d5700 1 -- 172.21.15.146:0/4164237303 shutdown_connections 2023-10-03T10:17:49.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.829+0000 7f95303d5700 1 --2- 172.21.15.146:0/4164237303 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f952813dd10 0x7f95281400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.829+0000 7f95303d5700 1 --2- 172.21.15.146:0/4164237303 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9528138410 0x7f95280a0ff0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.829+0000 7f95303d5700 1 -- 172.21.15.146:0/4164237303 >> 172.21.15.146:0/4164237303 conn(0x7f95280a2980 msgr2=0x7f95280a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.829+0000 7f95303d5700 1 -- 172.21.15.146:0/4164237303 shutdown_connections 2023-10-03T10:17:49.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.829+0000 7f95303d5700 1 -- 172.21.15.146:0/4164237303 wait complete. 2023-10-03T10:17:49.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.830+0000 7f95303d5700 1 Processor -- start 2023-10-03T10:17:49.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.830+0000 7f95303d5700 1 -- start start 2023-10-03T10:17:49.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.831+0000 7f95303d5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9528138040 0x7f952813c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.831+0000 7f95303d5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9528138410 0x7f9528135bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.831+0000 7f95303d5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f952813dd10 0x7f95281360f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.831+0000 7f95303d5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952813d410 con 0x7f9528138040 2023-10-03T10:17:49.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.831+0000 7f95303d5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952813cce0 con 0x7f952813dd10 2023-10-03T10:17:49.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.831+0000 7f95303d5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f952813d9e0 con 0x7f9528138410 2023-10-03T10:17:49.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.831+0000 7f952e171700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9528138040 0x7f952813c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.831+0000 7f952e171700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9528138040 0x7f952813c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60300/0 (socket says 172.21.15.146:60300) 2023-10-03T10:17:49.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.831+0000 7f952e171700 1 -- 172.21.15.146:0/2115375836 learned_addr learned my addr 172.21.15.146:0/2115375836 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:49.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.831+0000 7f952e972700 1 --2- 172.21.15.146:0/2115375836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f952813dd10 0x7f95281360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.831+0000 7f952d970700 1 --2- 172.21.15.146:0/2115375836 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9528138410 0x7f9528135bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.832+0000 7f952e171700 1 -- 172.21.15.146:0/2115375836 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9528138410 msgr2=0x7f9528135bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.832+0000 7f952e171700 1 --2- 172.21.15.146:0/2115375836 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9528138410 0x7f9528135bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.832+0000 7f952e171700 1 -- 172.21.15.146:0/2115375836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f952813dd10 msgr2=0x7f95281360f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.832+0000 7f952e171700 1 --2- 172.21.15.146:0/2115375836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f952813dd10 0x7f95281360f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.832+0000 7f952e171700 1 -- 172.21.15.146:0/2115375836 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9518009550 con 0x7f9528138040 2023-10-03T10:17:49.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.832+0000 7f952d970700 1 --2- 172.21.15.146:0/2115375836 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9528138410 0x7f9528135bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.832+0000 7f952e171700 1 --2- 172.21.15.146:0/2115375836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9528138040 0x7f952813c0f0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f952400c450 tx=0x7f952400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.832+0000 7f951effd700 1 -- 172.21.15.146:0/2115375836 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95240074e0 con 0x7f9528138040 2023-10-03T10:17:49.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.832+0000 7f951effd700 1 -- 172.21.15.146:0/2115375836 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9524007660 con 0x7f9528138040 2023-10-03T10:17:49.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.832+0000 7f95303d5700 1 -- 172.21.15.146:0/2115375836 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95281198c0 con 0x7f9528138040 2023-10-03T10:17:49.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.832+0000 7f951effd700 1 -- 172.21.15.146:0/2115375836 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9524005a70 con 0x7f9528138040 2023-10-03T10:17:49.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.832+0000 7f95303d5700 1 -- 172.21.15.146:0/2115375836 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9528136740 con 0x7f9528138040 2023-10-03T10:17:49.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.833+0000 7f951effd700 1 -- 172.21.15.146:0/2115375836 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9524005bd0 con 0x7f9528138040 2023-10-03T10:17:49.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.833+0000 7f951effd700 1 -- 172.21.15.146:0/2115375836 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f952403ea00 con 0x7f9528138040 2023-10-03T10:17:49.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.833+0000 7f95303d5700 1 -- 172.21.15.146:0/2115375836 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95100052e0 con 0x7f9528138040 2023-10-03T10:17:49.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.842+0000 7f951effd700 1 -- 172.21.15.146:0/2115375836 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9524017070 con 0x7f9528138040 2023-10-03T10:17:49.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.867+0000 7fe29344c700 1 Processor -- start 2023-10-03T10:17:49.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.867+0000 7fe29344c700 1 -- start start 2023-10-03T10:17:49.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.868+0000 7fe29344c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe28c0a0a30 0x7fe28c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.868+0000 7fe29344c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c0a1340 0x7fe28c12ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.868+0000 7fe29344c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe28c1304a0 0x7fe28c1308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.868+0000 7fe29344c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe28c130e30 con 0x7fe28c0a0a30 2023-10-03T10:17:49.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.868+0000 7fe29344c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c0a1e70 con 0x7fe28c0a1340 2023-10-03T10:17:49.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.868+0000 7fe29344c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c09a720 con 0x7fe28c1304a0 2023-10-03T10:17:49.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.868+0000 7fe2911e8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe28c0a0a30 0x7fe28c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.868+0000 7fe2911e8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe28c0a0a30 0x7fe28c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60304/0 (socket says 172.21.15.146:60304) 2023-10-03T10:17:49.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.868+0000 7fe2911e8700 1 -- 172.21.15.146:0/3530443346 learned_addr learned my addr 172.21.15.146:0/3530443346 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:49.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.868+0000 7fe2909e7700 1 --2- 172.21.15.146:0/3530443346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c0a1340 0x7fe28c12ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.869+0000 7fe2919e9700 1 --2- 172.21.15.146:0/3530443346 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe28c1304a0 0x7fe28c1308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.869+0000 7fe2911e8700 1 -- 172.21.15.146:0/3530443346 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe28c1304a0 msgr2=0x7fe28c1308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.869+0000 7fe2911e8700 1 --2- 172.21.15.146:0/3530443346 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe28c1304a0 0x7fe28c1308f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.869+0000 7fe2911e8700 1 -- 172.21.15.146:0/3530443346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c0a1340 msgr2=0x7fe28c12ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.869+0000 7fe2911e8700 1 --2- 172.21.15.146:0/3530443346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c0a1340 0x7fe28c12ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.869+0000 7fe2911e8700 1 -- 172.21.15.146:0/3530443346 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28c09b300 con 0x7fe28c0a0a30 2023-10-03T10:17:49.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.869+0000 7fe2911e8700 1 --2- 172.21.15.146:0/3530443346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0a0a30 0x7fe28c0a0e00 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fe288006fd0 tx=0x7fe28800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5609513a2343879d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.869+0000 7fe283fff700 1 -- 172.21.15.146:0/3530443346 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe288005e30 con 0x7fe28c0a0a30 2023-10-03T10:17:49.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.869+0000 7fe283fff700 1 -- 172.21.15.146:0/3530443346 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe288004030 con 0x7fe28c0a0a30 2023-10-03T10:17:49.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.869+0000 7fe283fff700 1 -- 172.21.15.146:0/3530443346 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2880043e0 con 0x7fe28c0a0a30 2023-10-03T10:17:49.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.870+0000 7fe29344c700 1 -- 172.21.15.146:0/3530443346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0a0a30 msgr2=0x7fe28c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.870+0000 7fe29344c700 1 --2- 172.21.15.146:0/3530443346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0a0a30 0x7fe28c0a0e00 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fe288006fd0 tx=0x7fe28800be70 comp rx=0 tx=0).stop 2023-10-03T10:17:49.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.870+0000 7fe29344c700 1 -- 172.21.15.146:0/3530443346 shutdown_connections 2023-10-03T10:17:49.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.870+0000 7fe29344c700 1 --2- 172.21.15.146:0/3530443346 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe28c1304a0 0x7fe28c1308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.870+0000 7fe29344c700 1 --2- 172.21.15.146:0/3530443346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0a0a30 0x7fe28c0a0e00 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.870+0000 7fe29344c700 1 --2- 172.21.15.146:0/3530443346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c0a1340 0x7fe28c12ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.870+0000 7fe29344c700 1 -- 172.21.15.146:0/3530443346 >> 172.21.15.146:0/3530443346 conn(0x7fe28c0a2980 msgr2=0x7fe28c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.870+0000 7fe29344c700 1 -- 172.21.15.146:0/3530443346 shutdown_connections 2023-10-03T10:17:49.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.870+0000 7fe29344c700 1 -- 172.21.15.146:0/3530443346 wait complete. 2023-10-03T10:17:49.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.871+0000 7fe29344c700 1 Processor -- start 2023-10-03T10:17:49.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.871+0000 7fe29344c700 1 -- start start 2023-10-03T10:17:49.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.872+0000 7fe29344c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c0a0a30 0x7fe28c126a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.872+0000 7fe29344c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0a1340 0x7fe28c126fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.872+0000 7fe29344c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe28c1304a0 0x7fe28c1274e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.872+0000 7fe29344c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c12f8d0 con 0x7fe28c0a1340 2023-10-03T10:17:49.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.872+0000 7fe29344c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c09ae00 con 0x7fe28c0a0a30 2023-10-03T10:17:49.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.872+0000 7fe29344c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c1297e0 con 0x7fe28c1304a0 2023-10-03T10:17:49.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.872+0000 7fe2909e7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0a1340 0x7fe28c126fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.872+0000 7fe2909e7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0a1340 0x7fe28c126fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60312/0 (socket says 172.21.15.146:60312) 2023-10-03T10:17:49.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.872+0000 7fe2909e7700 1 -- 172.21.15.146:0/1982599615 learned_addr learned my addr 172.21.15.146:0/1982599615 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:49.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.872+0000 7fe2919e9700 1 --2- 172.21.15.146:0/1982599615 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe28c1304a0 0x7fe28c1274e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.872+0000 7fe2911e8700 1 --2- 172.21.15.146:0/1982599615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c0a0a30 0x7fe28c126a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.872+0000 7fe2909e7700 1 -- 172.21.15.146:0/1982599615 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe28c1304a0 msgr2=0x7fe28c1274e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.872+0000 7fe2909e7700 1 --2- 172.21.15.146:0/1982599615 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe28c1304a0 0x7fe28c1274e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.872+0000 7fe2909e7700 1 -- 172.21.15.146:0/1982599615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c0a0a30 msgr2=0x7fe28c126a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.872+0000 7fe2909e7700 1 --2- 172.21.15.146:0/1982599615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c0a0a30 0x7fe28c126a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.872+0000 7fe2909e7700 1 -- 172.21.15.146:0/1982599615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28800b7a0 con 0x7fe28c0a1340 2023-10-03T10:17:49.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.872+0000 7fe2919e9700 1 --2- 172.21.15.146:0/1982599615 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe28c1304a0 0x7fe28c1274e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.872+0000 7fe2911e8700 1 --2- 172.21.15.146:0/1982599615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c0a0a30 0x7fe28c126a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.873+0000 7fe2909e7700 1 --2- 172.21.15.146:0/1982599615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0a1340 0x7fe28c126fa0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00e930 tx=0x7fe27c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.873+0000 7fe281ffb700 1 -- 172.21.15.146:0/1982599615 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c013680 con 0x7fe28c0a1340 2023-10-03T10:17:49.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.873+0000 7fe281ffb700 1 -- 172.21.15.146:0/1982599615 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c0137e0 con 0x7fe28c0a1340 2023-10-03T10:17:49.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.873+0000 7fe281ffb700 1 -- 172.21.15.146:0/1982599615 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c013b70 con 0x7fe28c0a1340 2023-10-03T10:17:49.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.873+0000 7fe29344c700 1 -- 172.21.15.146:0/1982599615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28c128be0 con 0x7fe28c0a1340 2023-10-03T10:17:49.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.873+0000 7fe29344c700 1 -- 172.21.15.146:0/1982599615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28c129df0 con 0x7fe28c0a1340 2023-10-03T10:17:49.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.874+0000 7fe29344c700 1 -- 172.21.15.146:0/1982599615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28c11a590 con 0x7fe28c0a1340 2023-10-03T10:17:49.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.875+0000 7fe281ffb700 1 -- 172.21.15.146:0/1982599615 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe27c013cd0 con 0x7fe28c0a1340 2023-10-03T10:17:49.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.875+0000 7fe281ffb700 1 -- 172.21.15.146:0/1982599615 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe27c03f7a0 con 0x7fe28c0a1340 2023-10-03T10:17:49.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.883+0000 7fe281ffb700 1 -- 172.21.15.146:0/1982599615 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe27c00c970 con 0x7fe28c0a1340 2023-10-03T10:17:49.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.910+0000 7f4ee24ab700 1 Processor -- start 2023-10-03T10:17:49.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.910+0000 7f4ee24ab700 1 -- start start 2023-10-03T10:17:49.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.910+0000 7f4ee24ab700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4edc132e70 0x7f4edc135250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.910+0000 7f4ee24ab700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4edc135790 0x7f4edc137b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.910+0000 7f4ee24ab700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4edc09a540 con 0x7f4edc12feb0 2023-10-03T10:17:49.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.910+0000 7f4ee24ab700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4edc09ad40 con 0x7f4edc135790 2023-10-03T10:17:49.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.910+0000 7f4ee24ab700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc09e640 con 0x7f4edc132e70 2023-10-03T10:17:49.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.911+0000 7f4edb7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4edc132e70 0x7f4edc135250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.911+0000 7f4edb7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4edc132e70 0x7f4edc135250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58558/0 (socket says 172.21.15.146:58558) 2023-10-03T10:17:49.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.911+0000 7f4edb7fe700 1 -- 172.21.15.146:0/3038911454 learned_addr learned my addr 172.21.15.146:0/3038911454 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:49.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.911+0000 7f4ee0a48700 1 --2- 172.21.15.146:0/3038911454 >> v2:172.21.15.146:3300/0 conn(0x7f4edc135790 0x7f4edc137b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.911+0000 7f4edb7fe700 1 -- 172.21.15.146:0/3038911454 >> v2:172.21.15.146:3300/0 conn(0x7f4edc135790 msgr2=0x7f4edc137b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.911+0000 7f4edb7fe700 1 --2- 172.21.15.146:0/3038911454 >> v2:172.21.15.146:3300/0 conn(0x7f4edc135790 0x7f4edc137b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.911+0000 7f4edb7fe700 1 -- 172.21.15.146:0/3038911454 >> v1:172.21.15.146:6789/0 conn(0x7f4edc12feb0 legacy=0x7f4edc130280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.911+0000 7f4edaffd700 1 -- 172.21.15.146:0/3038911454 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2432946397 0 0) 0x7f4edc09a540 con 0x7f4edc12feb0 2023-10-03T10:17:49.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.911+0000 7f4edb7fe700 1 -- 172.21.15.146:0/3038911454 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc09e3c0 con 0x7f4edc132e70 2023-10-03T10:17:49.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.912+0000 7f4edb7fe700 1 --2- 172.21.15.146:0/3038911454 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4edc132e70 0x7f4edc135250 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00098f0 tx=0x7f4ed0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7c5707a07a3aa8c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.912+0000 7f4edaffd700 1 -- 172.21.15.146:0/3038911454 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0011830 con 0x7f4edc132e70 2023-10-03T10:17:49.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.912+0000 7f4edaffd700 1 -- 172.21.15.146:0/3038911454 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed0011990 con 0x7f4edc132e70 2023-10-03T10:17:49.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.912+0000 7f4edaffd700 1 -- 172.21.15.146:0/3038911454 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0011d20 con 0x7f4edc132e70 2023-10-03T10:17:49.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.912+0000 7f4ee24ab700 1 -- 172.21.15.146:0/3038911454 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4edc132e70 msgr2=0x7f4edc135250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.912+0000 7f4ee24ab700 1 --2- 172.21.15.146:0/3038911454 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4edc132e70 0x7f4edc135250 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00098f0 tx=0x7f4ed0009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.912+0000 7f4ee24ab700 1 -- 172.21.15.146:0/3038911454 shutdown_connections 2023-10-03T10:17:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.912+0000 7f4ee24ab700 1 --2- 172.21.15.146:0/3038911454 >> v2:172.21.15.146:3300/0 conn(0x7f4edc135790 0x7f4edc137b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.912+0000 7f4ee24ab700 1 --2- 172.21.15.146:0/3038911454 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4edc132e70 0x7f4edc135250 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.912+0000 7f4ee24ab700 1 -- 172.21.15.146:0/3038911454 >> 172.21.15.146:0/3038911454 conn(0x7f4edc0a2b30 msgr2=0x7f4edc09e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.913+0000 7f4ee24ab700 1 -- 172.21.15.146:0/3038911454 shutdown_connections 2023-10-03T10:17:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.913+0000 7f4ee24ab700 1 -- 172.21.15.146:0/3038911454 wait complete. 2023-10-03T10:17:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.914+0000 7f4ee24ab700 1 Processor -- start 2023-10-03T10:17:49.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.914+0000 7f4ee24ab700 1 -- start start 2023-10-03T10:17:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.915+0000 7f4ee24ab700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4edc12feb0 0x7f4edc1c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.915+0000 7f4ee24ab700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4edc132e70 0x7f4edc1c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.915+0000 7f4ee24ab700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4edc135790 0x7f4edc1c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.915+0000 7f4ee24ab700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc127880 con 0x7f4edc12feb0 2023-10-03T10:17:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.915+0000 7f4ee24ab700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc13bd20 con 0x7f4edc132e70 2023-10-03T10:17:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.915+0000 7f4ee24ab700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc12a0d0 con 0x7f4edc135790 2023-10-03T10:17:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.915+0000 7f4edbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4edc12feb0 0x7f4edc1c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.915+0000 7f4edbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4edc12feb0 0x7f4edc1c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60324/0 (socket says 172.21.15.146:60324) 2023-10-03T10:17:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.915+0000 7f4edbfff700 1 -- 172.21.15.146:0/769674687 learned_addr learned my addr 172.21.15.146:0/769674687 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:49.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.915+0000 7f4edb7fe700 1 --2- 172.21.15.146:0/769674687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4edc132e70 0x7f4edc1c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.915+0000 7f4ee0a48700 1 --2- 172.21.15.146:0/769674687 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4edc135790 0x7f4edc1c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.915+0000 7f4edbfff700 1 -- 172.21.15.146:0/769674687 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4edc135790 msgr2=0x7f4edc1c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.915+0000 7f4edbfff700 1 --2- 172.21.15.146:0/769674687 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4edc135790 0x7f4edc1c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.915+0000 7f4edbfff700 1 -- 172.21.15.146:0/769674687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4edc132e70 msgr2=0x7f4edc1c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.915+0000 7f4edbfff700 1 --2- 172.21.15.146:0/769674687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4edc132e70 0x7f4edc1c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.915+0000 7f4edbfff700 1 -- 172.21.15.146:0/769674687 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed0009550 con 0x7f4edc12feb0 2023-10-03T10:17:49.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.916+0000 7f4edbfff700 1 --2- 172.21.15.146:0/769674687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4edc12feb0 0x7f4edc1c82d0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00c580 tx=0x7f4ecc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.916+0000 7f4ed8ff9700 1 -- 172.21.15.146:0/769674687 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc0054e0 con 0x7f4edc12feb0 2023-10-03T10:17:49.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.916+0000 7f4ed8ff9700 1 -- 172.21.15.146:0/769674687 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ecc003680 con 0x7f4edc12feb0 2023-10-03T10:17:49.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.916+0000 7f4ee24ab700 1 -- 172.21.15.146:0/769674687 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4edc072230 con 0x7f4edc12feb0 2023-10-03T10:17:49.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.916+0000 7f4ed8ff9700 1 -- 172.21.15.146:0/769674687 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc003a30 con 0x7f4edc12feb0 2023-10-03T10:17:49.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.916+0000 7f4ee24ab700 1 -- 172.21.15.146:0/769674687 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4edc12ccb0 con 0x7f4edc12feb0 2023-10-03T10:17:49.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.917+0000 7f4ee24ab700 1 -- 172.21.15.146:0/769674687 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4edc04f2a0 con 0x7f4edc12feb0 2023-10-03T10:17:49.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.917+0000 7f4ed8ff9700 1 -- 172.21.15.146:0/769674687 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ecc003b90 con 0x7f4edc12feb0 2023-10-03T10:17:49.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.919+0000 7f4ed8ff9700 1 -- 172.21.15.146:0/769674687 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4ecc011980 con 0x7f4edc12feb0 2023-10-03T10:17:49.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.919+0000 7f0c7a018700 1 -- 172.21.15.146:0/80481921 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0c7404f2a0 con 0x7f0c741300a0 2023-10-03T10:17:49.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.919+0000 7f0c5bfff700 1 -- 172.21.15.146:0/80481921 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c64011350 con 0x7f0c741300a0 2023-10-03T10:17:49.919 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:49.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.921+0000 7f0c7a018700 1 -- 172.21.15.146:0/80481921 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c741300a0 msgr2=0x7f0c7411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.921+0000 7f0c7a018700 1 --2- 172.21.15.146:0/80481921 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c741300a0 0x7f0c7411da40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0c6400ebe0 tx=0x7f0c6400eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.922+0000 7f0c7a018700 1 -- 172.21.15.146:0/80481921 shutdown_connections 2023-10-03T10:17:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.922+0000 7f0c7a018700 1 --2- 172.21.15.146:0/80481921 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0c74133ad0 0x7f0c7411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.922+0000 7f0c7a018700 1 --2- 172.21.15.146:0/80481921 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c741300a0 0x7f0c7411da40 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.922+0000 7f0c7a018700 1 --2- 172.21.15.146:0/80481921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c741309f0 0x7f0c7411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.922+0000 7f0c7a018700 1 -- 172.21.15.146:0/80481921 >> 172.21.15.146:0/80481921 conn(0x7f0c74099c40 msgr2=0x7f0c7412e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.925+0000 7f0c7a018700 1 -- 172.21.15.146:0/80481921 shutdown_connections 2023-10-03T10:17:49.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.925+0000 7f0c7a018700 1 -- 172.21.15.146:0/80481921 wait complete. 2023-10-03T10:17:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:49.926+0000 7f4ed8ff9700 1 -- 172.21.15.146:0/769674687 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ecc044060 con 0x7f4edc12feb0 2023-10-03T10:17:49.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:50.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.054+0000 7f95303d5700 1 -- 172.21.15.146:0/2115375836 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9510005590 con 0x7f9528138040 2023-10-03T10:17:50.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.054+0000 7f951effd700 1 -- 172.21.15.146:0/2115375836 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f952401b3b0 con 0x7f9528138040 2023-10-03T10:17:50.054 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:50.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.057+0000 7f95303d5700 1 -- 172.21.15.146:0/2115375836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9528138040 msgr2=0x7f952813c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.057+0000 7f95303d5700 1 --2- 172.21.15.146:0/2115375836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9528138040 0x7f952813c0f0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f952400c450 tx=0x7f952400c760 comp rx=0 tx=0).stop 2023-10-03T10:17:50.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.057+0000 7f95303d5700 1 -- 172.21.15.146:0/2115375836 shutdown_connections 2023-10-03T10:17:50.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.057+0000 7f95303d5700 1 --2- 172.21.15.146:0/2115375836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f952813dd10 0x7f95281360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.057+0000 7f95303d5700 1 --2- 172.21.15.146:0/2115375836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9528138040 0x7f952813c0f0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.057+0000 7f95303d5700 1 --2- 172.21.15.146:0/2115375836 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9528138410 0x7f9528135bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.057+0000 7f95303d5700 1 -- 172.21.15.146:0/2115375836 >> 172.21.15.146:0/2115375836 conn(0x7f95280a2980 msgr2=0x7f9528140b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.057+0000 7f95303d5700 1 -- 172.21.15.146:0/2115375836 shutdown_connections 2023-10-03T10:17:50.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.057+0000 7f95303d5700 1 -- 172.21.15.146:0/2115375836 wait complete. 2023-10-03T10:17:50.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:50.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.083+0000 7fe29344c700 1 -- 172.21.15.146:0/1982599615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe28c04f2a0 con 0x7fe28c0a1340 2023-10-03T10:17:50.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.083+0000 7fe281ffb700 1 -- 172.21.15.146:0/1982599615 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe27c017030 con 0x7fe28c0a1340 2023-10-03T10:17:50.083 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:50.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.085+0000 7fe29344c700 1 -- 172.21.15.146:0/1982599615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0a1340 msgr2=0x7fe28c126fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.085+0000 7fe29344c700 1 --2- 172.21.15.146:0/1982599615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0a1340 0x7fe28c126fa0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00e930 tx=0x7fe27c00ec40 comp rx=0 tx=0).stop 2023-10-03T10:17:50.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.085+0000 7fe29344c700 1 -- 172.21.15.146:0/1982599615 shutdown_connections 2023-10-03T10:17:50.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.085+0000 7fe29344c700 1 --2- 172.21.15.146:0/1982599615 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe28c1304a0 0x7fe28c1274e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.085+0000 7fe29344c700 1 --2- 172.21.15.146:0/1982599615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe28c0a0a30 0x7fe28c126a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.085+0000 7fe29344c700 1 --2- 172.21.15.146:0/1982599615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0a1340 0x7fe28c126fa0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.085+0000 7fe29344c700 1 -- 172.21.15.146:0/1982599615 >> 172.21.15.146:0/1982599615 conn(0x7fe28c0a2980 msgr2=0x7fe28c0712c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.085+0000 7fe29344c700 1 -- 172.21.15.146:0/1982599615 shutdown_connections 2023-10-03T10:17:50.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.085+0000 7fe29344c700 1 -- 172.21.15.146:0/1982599615 wait complete. 2023-10-03T10:17:50.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:50.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.122+0000 7f4ee24ab700 1 -- 172.21.15.146:0/769674687 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4edc06b2a0 con 0x7f4edc12feb0 2023-10-03T10:17:50.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.122+0000 7f4ed8ff9700 1 -- 172.21.15.146:0/769674687 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ecc044070 con 0x7f4edc12feb0 2023-10-03T10:17:50.122 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:50.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.124+0000 7f4ee24ab700 1 -- 172.21.15.146:0/769674687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4edc12feb0 msgr2=0x7f4edc1c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.124+0000 7f4ee24ab700 1 --2- 172.21.15.146:0/769674687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4edc12feb0 0x7f4edc1c82d0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00c580 tx=0x7f4ecc00c890 comp rx=0 tx=0).stop 2023-10-03T10:17:50.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.124+0000 7f4ee24ab700 1 -- 172.21.15.146:0/769674687 shutdown_connections 2023-10-03T10:17:50.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.124+0000 7f4ee24ab700 1 --2- 172.21.15.146:0/769674687 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4edc135790 0x7f4edc1c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.124+0000 7f4ee24ab700 1 --2- 172.21.15.146:0/769674687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4edc12feb0 0x7f4edc1c82d0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.124+0000 7f4ee24ab700 1 --2- 172.21.15.146:0/769674687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4edc132e70 0x7f4edc1c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.124+0000 7f4ee24ab700 1 -- 172.21.15.146:0/769674687 >> 172.21.15.146:0/769674687 conn(0x7f4edc0a2b30 msgr2=0x7f4edc131d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.124+0000 7f4ee24ab700 1 -- 172.21.15.146:0/769674687 shutdown_connections 2023-10-03T10:17:50.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:50.124+0000 7f4ee24ab700 1 -- 172.21.15.146:0/769674687 wait complete. 2023-10-03T10:17:50.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:50.939 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:51.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.066+0000 7ff7ab5e0700 1 Processor -- start 2023-10-03T10:17:51.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.067+0000 7ff7ab5e0700 1 -- start start 2023-10-03T10:17:51.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.067+0000 7ff7ab5e0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff7a4133900 0x7ff7a4133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.067+0000 7ff7ab5e0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7a4134210 0x7ff7a40a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.067+0000 7ff7ab5e0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7a40a0ee0 0x7ff7a40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.067+0000 7ff7ab5e0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a409a760 con 0x7ff7a4133900 2023-10-03T10:17:51.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.067+0000 7ff7ab5e0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a41336e0 con 0x7ff7a4134210 2023-10-03T10:17:51.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.067+0000 7ff7ab5e0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a409a080 con 0x7ff7a40a0ee0 2023-10-03T10:17:51.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.067+0000 7ff7a9b7d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7a40a0ee0 0x7ff7a40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.067+0000 7ff7a8b7b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7a4134210 0x7ff7a40a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.067+0000 7ff7a937c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff7a4133900 0x7ff7a4133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.067+0000 7ff7a9b7d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7a40a0ee0 0x7ff7a40a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58564/0 (socket says 172.21.15.146:58564) 2023-10-03T10:17:51.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.067+0000 7ff7a8b7b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7a4134210 0x7ff7a40a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44110/0 (socket says 172.21.15.146:44110) 2023-10-03T10:17:51.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.067+0000 7ff7a9b7d700 1 -- 172.21.15.146:0/870090286 learned_addr learned my addr 172.21.15.146:0/870090286 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:51.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.068+0000 7ff7a9b7d700 1 -- 172.21.15.146:0/870090286 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7a4134210 msgr2=0x7ff7a40a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.068+0000 7ff7a9b7d700 1 --2- 172.21.15.146:0/870090286 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7a4134210 0x7ff7a40a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.068+0000 7ff7a9b7d700 1 -- 172.21.15.146:0/870090286 >> v2:172.21.15.146:3300/0 conn(0x7ff7a4133900 msgr2=0x7ff7a4133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.068+0000 7ff7a9b7d700 1 --2- 172.21.15.146:0/870090286 >> v2:172.21.15.146:3300/0 conn(0x7ff7a4133900 0x7ff7a4133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.068+0000 7ff7a9b7d700 1 -- 172.21.15.146:0/870090286 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a40a23e0 con 0x7ff7a40a0ee0 2023-10-03T10:17:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.068+0000 7ff7a937c700 1 --2- 172.21.15.146:0/870090286 >> v2:172.21.15.146:3300/0 conn(0x7ff7a4133900 0x7ff7a4133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.068+0000 7ff7a8b7b700 1 --2- 172.21.15.146:0/870090286 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7a4134210 0x7ff7a40a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.068+0000 7ff7a9b7d700 1 --2- 172.21.15.146:0/870090286 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7a40a0ee0 0x7ff7a40a1340 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff79c009e50 tx=0x7ff79c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=441e233f9cc0fb53 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.068+0000 7ff79bfff700 1 -- 172.21.15.146:0/870090286 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c00e070 con 0x7ff7a40a0ee0 2023-10-03T10:17:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.068+0000 7ff79bfff700 1 -- 172.21.15.146:0/870090286 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79c00b910 con 0x7ff7a40a0ee0 2023-10-03T10:17:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.068+0000 7ff79bfff700 1 -- 172.21.15.146:0/870090286 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c00bcc0 con 0x7ff7a40a0ee0 2023-10-03T10:17:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.068+0000 7ff7ab5e0700 1 -- 172.21.15.146:0/870090286 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7a40a0ee0 msgr2=0x7ff7a40a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.068+0000 7ff7ab5e0700 1 --2- 172.21.15.146:0/870090286 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7a40a0ee0 0x7ff7a40a1340 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff79c009e50 tx=0x7ff79c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:51.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.069+0000 7ff7ab5e0700 1 -- 172.21.15.146:0/870090286 shutdown_connections 2023-10-03T10:17:51.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.069+0000 7ff7ab5e0700 1 --2- 172.21.15.146:0/870090286 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7a40a0ee0 0x7ff7a40a1340 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.069+0000 7ff7ab5e0700 1 --2- 172.21.15.146:0/870090286 >> v2:172.21.15.146:3300/0 conn(0x7ff7a4133900 0x7ff7a4133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.069+0000 7ff7ab5e0700 1 --2- 172.21.15.146:0/870090286 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7a4134210 0x7ff7a40a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.069+0000 7ff7ab5e0700 1 -- 172.21.15.146:0/870090286 >> 172.21.15.146:0/870090286 conn(0x7ff7a40a2980 msgr2=0x7ff7a40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.069+0000 7ff7ab5e0700 1 -- 172.21.15.146:0/870090286 shutdown_connections 2023-10-03T10:17:51.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.069+0000 7ff7ab5e0700 1 -- 172.21.15.146:0/870090286 wait complete. 2023-10-03T10:17:51.071 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:51.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.069+0000 7ff7ab5e0700 1 Processor -- start 2023-10-03T10:17:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.070+0000 7ff7ab5e0700 1 -- start start 2023-10-03T10:17:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.070+0000 7ff7ab5e0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7a40a0ee0 0x7ff7a411d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.070+0000 7ff7ab5e0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7a4133900 0x7ff7a411dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.070+0000 7ff7ab5e0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7a4134210 0x7ff7a411e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.070+0000 7ff7ab5e0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a411ec70 con 0x7ff7a40a0ee0 2023-10-03T10:17:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.070+0000 7ff7ab5e0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a411f3d0 con 0x7ff7a4133900 2023-10-03T10:17:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.070+0000 7ff7ab5e0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a411f9f0 con 0x7ff7a4134210 2023-10-03T10:17:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.070+0000 7ff7a937c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7a40a0ee0 0x7ff7a411d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.070+0000 7ff7a8b7b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7a4133900 0x7ff7a411dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.070+0000 7ff7a9b7d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7a4134210 0x7ff7a411e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.070+0000 7ff7a937c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7a40a0ee0 0x7ff7a411d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60342/0 (socket says 172.21.15.146:60342) 2023-10-03T10:17:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.070+0000 7ff7a937c700 1 -- 172.21.15.146:0/2526469601 learned_addr learned my addr 172.21.15.146:0/2526469601 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.070+0000 7ff7a9b7d700 1 -- 172.21.15.146:0/2526469601 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7a4133900 msgr2=0x7ff7a411dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.070+0000 7ff7a9b7d700 1 --2- 172.21.15.146:0/2526469601 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7a4133900 0x7ff7a411dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.070+0000 7ff7a9b7d700 1 -- 172.21.15.146:0/2526469601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7a40a0ee0 msgr2=0x7ff7a411d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.070+0000 7ff7a9b7d700 1 --2- 172.21.15.146:0/2526469601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7a40a0ee0 0x7ff7a411d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.070+0000 7ff7a9b7d700 1 -- 172.21.15.146:0/2526469601 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff794009430 con 0x7ff7a4134210 2023-10-03T10:17:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.070+0000 7ff7a9b7d700 1 --2- 172.21.15.146:0/2526469601 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7a4134210 0x7ff7a411e240 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff79c015000 tx=0x7ff79c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.071+0000 7ff799ffb700 1 -- 172.21.15.146:0/2526469601 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c0099b0 con 0x7ff7a4134210 2023-10-03T10:17:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.071+0000 7ff799ffb700 1 -- 172.21.15.146:0/2526469601 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79c00ce80 con 0x7ff7a4134210 2023-10-03T10:17:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.071+0000 7ff7ab5e0700 1 -- 172.21.15.146:0/2526469601 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a00094a0 con 0x7ff7a4134210 2023-10-03T10:17:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.071+0000 7ff799ffb700 1 -- 172.21.15.146:0/2526469601 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c004470 con 0x7ff7a4134210 2023-10-03T10:17:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.071+0000 7ff7ab5e0700 1 -- 172.21.15.146:0/2526469601 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff79c009b30 con 0x7ff7a4134210 2023-10-03T10:17:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.072+0000 7ff799ffb700 1 -- 172.21.15.146:0/2526469601 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff79c0045d0 con 0x7ff7a4134210 2023-10-03T10:17:51.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.072+0000 7ff799ffb700 1 -- 172.21.15.146:0/2526469601 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff79c0408e0 con 0x7ff7a4134210 2023-10-03T10:17:51.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.072+0000 7ff7ab5e0700 1 -- 172.21.15.146:0/2526469601 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a41206b0 con 0x7ff7a4134210 2023-10-03T10:17:51.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.076+0000 7ff799ffb700 1 -- 172.21.15.146:0/2526469601 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff79c004880 con 0x7ff7a4134210 2023-10-03T10:17:51.098 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:51.137 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:51.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.212+0000 7f801aec6700 1 Processor -- start 2023-10-03T10:17:51.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.212+0000 7f801aec6700 1 -- start start 2023-10-03T10:17:51.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.213+0000 7f801aec6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f801412d2f0 0x7f801412d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.213+0000 7f801aec6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8014130e70 0x7f8014138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.213+0000 7f801aec6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80140a24b0 con 0x7f8014130350 2023-10-03T10:17:51.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.213+0000 7f801aec6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8014072520 con 0x7f8014130e70 2023-10-03T10:17:51.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.213+0000 7f801aec6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801409cd30 con 0x7f801412d2f0 2023-10-03T10:17:51.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.213+0000 7f8018c62700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f801412d2f0 0x7f801412d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.213+0000 7f8018c62700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f801412d2f0 0x7f801412d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44138/0 (socket says 172.21.15.146:44138) 2023-10-03T10:17:51.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.213+0000 7f8018c62700 1 -- 172.21.15.146:0/2453450226 learned_addr learned my addr 172.21.15.146:0/2453450226 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:51.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.213+0000 7f8019463700 1 --2- 172.21.15.146:0/2453450226 >> v2:172.21.15.146:3300/0 conn(0x7f8014130e70 0x7f8014138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.214+0000 7f8018c62700 1 -- 172.21.15.146:0/2453450226 >> v2:172.21.15.146:3300/0 conn(0x7f8014130e70 msgr2=0x7f8014138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:51.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.214+0000 7f8018c62700 1 --2- 172.21.15.146:0/2453450226 >> v2:172.21.15.146:3300/0 conn(0x7f8014130e70 0x7f8014138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.214+0000 7f8018c62700 1 -- 172.21.15.146:0/2453450226 >> v1:172.21.15.146:6789/0 conn(0x7f8014130350 legacy=0x7f8014130760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.214+0000 7f8018c62700 1 -- 172.21.15.146:0/2453450226 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801409bbb0 con 0x7f801412d2f0 2023-10-03T10:17:51.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.214+0000 7f8018c62700 1 --2- 172.21.15.146:0/2453450226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f801412d2f0 0x7f801412d6c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f8008006fd0 tx=0x7f8008013480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c364262c3a7ee5a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.214+0000 7f80137fe700 1 -- 172.21.15.146:0/2453450226 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008016070 con 0x7f801412d2f0 2023-10-03T10:17:51.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.214+0000 7f80137fe700 1 -- 172.21.15.146:0/2453450226 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8008013d50 con 0x7f801412d2f0 2023-10-03T10:17:51.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.214+0000 7f80137fe700 1 -- 172.21.15.146:0/2453450226 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008005c60 con 0x7f801412d2f0 2023-10-03T10:17:51.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.215+0000 7f801aec6700 1 -- 172.21.15.146:0/2453450226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f801412d2f0 msgr2=0x7f801412d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.215+0000 7f801aec6700 1 --2- 172.21.15.146:0/2453450226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f801412d2f0 0x7f801412d6c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f8008006fd0 tx=0x7f8008013480 comp rx=0 tx=0).stop 2023-10-03T10:17:51.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.215+0000 7f801aec6700 1 -- 172.21.15.146:0/2453450226 shutdown_connections 2023-10-03T10:17:51.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.215+0000 7f801aec6700 1 --2- 172.21.15.146:0/2453450226 >> v2:172.21.15.146:3300/0 conn(0x7f8014130e70 0x7f8014138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.215+0000 7f801aec6700 1 --2- 172.21.15.146:0/2453450226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f801412d2f0 0x7f801412d6c0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.215+0000 7f801aec6700 1 -- 172.21.15.146:0/2453450226 >> 172.21.15.146:0/2453450226 conn(0x7f80140a2980 msgr2=0x7f80140a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.215+0000 7f801aec6700 1 -- 172.21.15.146:0/2453450226 shutdown_connections 2023-10-03T10:17:51.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.215+0000 7f801aec6700 1 -- 172.21.15.146:0/2453450226 wait complete. 2023-10-03T10:17:51.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.216+0000 7f801aec6700 1 Processor -- start 2023-10-03T10:17:51.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.216+0000 7f801aec6700 1 -- start start 2023-10-03T10:17:51.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.216+0000 7f801aec6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f801412d2f0 0x7f801411a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.216+0000 7f801aec6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8014130350 0x7f801411ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.216+0000 7f801aec6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8014130e70 0x7f801411b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.216+0000 7f801aec6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801411d7c0 con 0x7f8014130e70 2023-10-03T10:17:51.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.216+0000 7f801aec6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801411e210 con 0x7f801412d2f0 2023-10-03T10:17:51.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.216+0000 7f801aec6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f801411d300 con 0x7f8014130350 2023-10-03T10:17:51.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.216+0000 7f8018c62700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f801412d2f0 0x7f801411a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.216+0000 7f8018c62700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f801412d2f0 0x7f801411a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44154/0 (socket says 172.21.15.146:44154) 2023-10-03T10:17:51.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.216+0000 7f8018c62700 1 -- 172.21.15.146:0/2802276266 learned_addr learned my addr 172.21.15.146:0/2802276266 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:51.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.217+0000 7f8019463700 1 --2- 172.21.15.146:0/2802276266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8014130e70 0x7f801411b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.217+0000 7f8013fff700 1 --2- 172.21.15.146:0/2802276266 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8014130350 0x7f801411ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.217+0000 7f8018c62700 1 -- 172.21.15.146:0/2802276266 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8014130350 msgr2=0x7f801411ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.217+0000 7f8018c62700 1 --2- 172.21.15.146:0/2802276266 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8014130350 0x7f801411ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.217+0000 7f8018c62700 1 -- 172.21.15.146:0/2802276266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8014130e70 msgr2=0x7f801411b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.217+0000 7f8018c62700 1 --2- 172.21.15.146:0/2802276266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8014130e70 0x7f801411b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.217+0000 7f8018c62700 1 -- 172.21.15.146:0/2802276266 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8008011da0 con 0x7f801412d2f0 2023-10-03T10:17:51.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.217+0000 7f8018c62700 1 --2- 172.21.15.146:0/2802276266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f801412d2f0 0x7f801411a940 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f801409ce70 tx=0x7f8008004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.217+0000 7f80117fa700 1 -- 172.21.15.146:0/2802276266 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80080045e0 con 0x7f801412d2f0 2023-10-03T10:17:51.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.217+0000 7f80117fa700 1 -- 172.21.15.146:0/2802276266 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80080116d0 con 0x7f801412d2f0 2023-10-03T10:17:51.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.217+0000 7f80117fa700 1 -- 172.21.15.146:0/2802276266 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800800fa70 con 0x7f801412d2f0 2023-10-03T10:17:51.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.217+0000 7f801aec6700 1 -- 172.21.15.146:0/2802276266 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801412ebd0 con 0x7f801412d2f0 2023-10-03T10:17:51.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.218+0000 7f801aec6700 1 -- 172.21.15.146:0/2802276266 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801409b4f0 con 0x7f801412d2f0 2023-10-03T10:17:51.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.218+0000 7f80117fa700 1 -- 172.21.15.146:0/2802276266 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f800800fbd0 con 0x7f801412d2f0 2023-10-03T10:17:51.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.219+0000 7f80117fa700 1 -- 172.21.15.146:0/2802276266 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8008048d10 con 0x7f801412d2f0 2023-10-03T10:17:51.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.219+0000 7f801aec6700 1 -- 172.21.15.146:0/2802276266 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f801409cf30 con 0x7f801412d2f0 2023-10-03T10:17:51.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.224+0000 7f80117fa700 1 -- 172.21.15.146:0/2802276266 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f801409cf30 con 0x7f801412d2f0 2023-10-03T10:17:51.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.263+0000 7f6da9868700 1 Processor -- start 2023-10-03T10:17:51.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.263+0000 7f6da9868700 1 -- start start 2023-10-03T10:17:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.264+0000 7f6da9868700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6da409a150 0x7f6da409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.264+0000 7f6da9868700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6da409edb0 0x7f6da409f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.264+0000 7f6da9868700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6da409af80 con 0x7f6da4133c20 2023-10-03T10:17:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.264+0000 7f6da9868700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da409fe00 con 0x7f6da409edb0 2023-10-03T10:17:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.264+0000 7f6da9868700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6da406bec0 con 0x7f6da409a150 2023-10-03T10:17:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.264+0000 7f6da2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6da409a150 0x7f6da409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.264+0000 7f6da2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6da409a150 0x7f6da409e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58588/0 (socket says 172.21.15.146:58588) 2023-10-03T10:17:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.264+0000 7f6da2ffd700 1 -- 172.21.15.146:0/146890807 learned_addr learned my addr 172.21.15.146:0/146890807 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:51.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.264+0000 7f6da27fc700 1 --2- 172.21.15.146:0/146890807 >> v2:172.21.15.146:3300/0 conn(0x7f6da409edb0 0x7f6da409f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.265+0000 7f6da27fc700 1 -- 172.21.15.146:0/146890807 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6da409a150 msgr2=0x7f6da409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:51.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.265+0000 7f6da27fc700 1 --2- 172.21.15.146:0/146890807 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6da409a150 0x7f6da409e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.265+0000 7f6da27fc700 1 -- 172.21.15.146:0/146890807 >> v1:172.21.15.146:6789/0 conn(0x7f6da4133c20 legacy=0x7f6da4134070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.265+0000 7f6da27fc700 1 -- 172.21.15.146:0/146890807 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da409f6e0 con 0x7f6da409edb0 2023-10-03T10:17:51.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.265+0000 7f6da1ffb700 1 -- 172.21.15.146:0/146890807 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651802766 0 0) 0x7f6da409af80 con 0x7f6da4133c20 2023-10-03T10:17:51.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.265+0000 7f6da2ffd700 1 --2- 172.21.15.146:0/146890807 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6da409a150 0x7f6da409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:51.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.265+0000 7f6da27fc700 1 --2- 172.21.15.146:0/146890807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6da409edb0 0x7f6da409f1a0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f6d98009840 tx=0x7f6d98009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4965f7f265bf54 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.265+0000 7f6da1ffb700 1 -- 172.21.15.146:0/146890807 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d98011830 con 0x7f6da409edb0 2023-10-03T10:17:51.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.265+0000 7f6da1ffb700 1 -- 172.21.15.146:0/146890807 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d98011990 con 0x7f6da409edb0 2023-10-03T10:17:51.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.265+0000 7f6da1ffb700 1 -- 172.21.15.146:0/146890807 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d98011d20 con 0x7f6da409edb0 2023-10-03T10:17:51.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.266+0000 7f6da9868700 1 -- 172.21.15.146:0/146890807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6da409edb0 msgr2=0x7f6da409f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.266+0000 7f6da9868700 1 --2- 172.21.15.146:0/146890807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6da409edb0 0x7f6da409f1a0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f6d98009840 tx=0x7f6d98009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:51.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.266+0000 7f6da9868700 1 -- 172.21.15.146:0/146890807 shutdown_connections 2023-10-03T10:17:51.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.266+0000 7f6da9868700 1 --2- 172.21.15.146:0/146890807 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6da409a150 0x7f6da409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.266+0000 7f6da9868700 1 --2- 172.21.15.146:0/146890807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6da409edb0 0x7f6da409f1a0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.266+0000 7f6da9868700 1 -- 172.21.15.146:0/146890807 >> 172.21.15.146:0/146890807 conn(0x7f6da40a4430 msgr2=0x7f6da40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.266+0000 7f6da9868700 1 -- 172.21.15.146:0/146890807 shutdown_connections 2023-10-03T10:17:51.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.266+0000 7f6da9868700 1 -- 172.21.15.146:0/146890807 wait complete. 2023-10-03T10:17:51.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.267+0000 7f6da9868700 1 Processor -- start 2023-10-03T10:17:51.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.268+0000 7f6da9868700 1 -- start start 2023-10-03T10:17:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.268+0000 7f6da9868700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6da409a150 0x7f6da41226d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.268+0000 7f6da9868700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6da409edb0 0x7f6da4122c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.268+0000 7f6da9868700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6da4133c20 0x7f6da4123150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.268+0000 7f6da9868700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da4133a90 con 0x7f6da409a150 2023-10-03T10:17:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.268+0000 7f6da9868700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da41250d0 con 0x7f6da409edb0 2023-10-03T10:17:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.268+0000 7f6da9868700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6da4126150 con 0x7f6da4133c20 2023-10-03T10:17:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.269+0000 7f6da2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6da409a150 0x7f6da41226d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.269+0000 7f6da2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6da409a150 0x7f6da41226d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60366/0 (socket says 172.21.15.146:60366) 2023-10-03T10:17:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.269+0000 7f6da2ffd700 1 -- 172.21.15.146:0/2087888688 learned_addr learned my addr 172.21.15.146:0/2087888688 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.269+0000 7f6da37fe700 1 --2- 172.21.15.146:0/2087888688 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6da4133c20 0x7f6da4123150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.269+0000 7f6da27fc700 1 --2- 172.21.15.146:0/2087888688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6da409edb0 0x7f6da4122c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.269+0000 7f6da2ffd700 1 -- 172.21.15.146:0/2087888688 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6da4133c20 msgr2=0x7f6da4123150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.269+0000 7f6da2ffd700 1 --2- 172.21.15.146:0/2087888688 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6da4133c20 0x7f6da4123150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.269+0000 7f6da2ffd700 1 -- 172.21.15.146:0/2087888688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6da409edb0 msgr2=0x7f6da4122c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.269+0000 7f6da2ffd700 1 --2- 172.21.15.146:0/2087888688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6da409edb0 0x7f6da4122c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.269+0000 7f6da2ffd700 1 -- 172.21.15.146:0/2087888688 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d94009550 con 0x7f6da409a150 2023-10-03T10:17:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.269+0000 7f6da27fc700 1 --2- 172.21.15.146:0/2087888688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6da409edb0 0x7f6da4122c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.269+0000 7f6da2ffd700 1 --2- 172.21.15.146:0/2087888688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6da409a150 0x7f6da41226d0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400e9b0 tx=0x7f6d9400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.269+0000 7f6d8bfff700 1 -- 172.21.15.146:0/2087888688 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9400c850 con 0x7f6da409a150 2023-10-03T10:17:51.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.269+0000 7f6d8bfff700 1 -- 172.21.15.146:0/2087888688 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9400c9b0 con 0x7f6da409a150 2023-10-03T10:17:51.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.269+0000 7f6da9868700 1 -- 172.21.15.146:0/2087888688 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d980094a0 con 0x7f6da409a150 2023-10-03T10:17:51.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.269+0000 7f6d8bfff700 1 -- 172.21.15.146:0/2087888688 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9400cd20 con 0x7f6da409a150 2023-10-03T10:17:51.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.269+0000 7f6da9868700 1 -- 172.21.15.146:0/2087888688 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da4125490 con 0x7f6da409a150 2023-10-03T10:17:51.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.270+0000 7f6d8bfff700 1 -- 172.21.15.146:0/2087888688 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6d94013470 con 0x7f6da409a150 2023-10-03T10:17:51.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.271+0000 7f6d8bfff700 1 -- 172.21.15.146:0/2087888688 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6d9403f8e0 con 0x7f6da409a150 2023-10-03T10:17:51.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.271+0000 7f6da9868700 1 -- 172.21.15.146:0/2087888688 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da409fa30 con 0x7f6da409a150 2023-10-03T10:17:51.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.276+0000 7f6d8bfff700 1 -- 172.21.15.146:0/2087888688 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d940232f0 con 0x7f6da409a150 2023-10-03T10:17:51.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.291+0000 7ff7ab5e0700 1 -- 172.21.15.146:0/2526469601 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff7a411a590 con 0x7ff7a4134210 2023-10-03T10:17:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.291+0000 7ff799ffb700 1 -- 172.21.15.146:0/2526469601 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff79c020030 con 0x7ff7a4134210 2023-10-03T10:17:51.291 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.293+0000 7ff7ab5e0700 1 -- 172.21.15.146:0/2526469601 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7a4134210 msgr2=0x7ff7a411e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.293+0000 7ff7ab5e0700 1 --2- 172.21.15.146:0/2526469601 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7a4134210 0x7ff7a411e240 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff79c015000 tx=0x7ff79c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.293+0000 7ff7ab5e0700 1 -- 172.21.15.146:0/2526469601 shutdown_connections 2023-10-03T10:17:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.293+0000 7ff7ab5e0700 1 --2- 172.21.15.146:0/2526469601 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7a4134210 0x7ff7a411e240 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.293+0000 7ff7ab5e0700 1 --2- 172.21.15.146:0/2526469601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7a40a0ee0 0x7ff7a411d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.293+0000 7ff7ab5e0700 1 --2- 172.21.15.146:0/2526469601 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7a4133900 0x7ff7a411dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.293+0000 7ff7ab5e0700 1 -- 172.21.15.146:0/2526469601 >> 172.21.15.146:0/2526469601 conn(0x7ff7a40a2980 msgr2=0x7ff7a41bad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.298+0000 7ff7ab5e0700 1 -- 172.21.15.146:0/2526469601 shutdown_connections 2023-10-03T10:17:51.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.298+0000 7ff7ab5e0700 1 -- 172.21.15.146:0/2526469601 wait complete. 2023-10-03T10:17:51.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.307+0000 7f72fbf94700 1 Processor -- start 2023-10-03T10:17:51.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.308+0000 7f72fbf94700 1 -- start start 2023-10-03T10:17:51.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.308+0000 7f72fbf94700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72f4133ad0 0x7f72f4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.308+0000 7f72fbf94700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72f41300a0 0x7f72f41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.308+0000 7f72fbf94700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f406b2d0 con 0x7f72f41309f0 2023-10-03T10:17:51.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.308+0000 7f72fbf94700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f4133610 con 0x7f72f41300a0 2023-10-03T10:17:51.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.308+0000 7f72fbf94700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72f409a500 con 0x7f72f4133ad0 2023-10-03T10:17:51.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.309+0000 7f72f952f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72f41300a0 0x7f72f41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.309+0000 7f72f9d30700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72f4133ad0 0x7f72f4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.309+0000 7f72f952f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72f41300a0 0x7f72f41304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44174/0 (socket says 172.21.15.146:44174) 2023-10-03T10:17:51.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.309+0000 7f72f9d30700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72f4133ad0 0x7f72f4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58606/0 (socket says 172.21.15.146:58606) 2023-10-03T10:17:51.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.309+0000 7f72f952f700 1 -- 172.21.15.146:0/2755778722 learned_addr learned my addr 172.21.15.146:0/2755778722 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:51.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.309+0000 7f72f952f700 1 -- 172.21.15.146:0/2755778722 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72f4133ad0 msgr2=0x7f72f4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:51.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.309+0000 7f72f952f700 1 --2- 172.21.15.146:0/2755778722 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72f4133ad0 0x7f72f4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.309+0000 7f72f952f700 1 -- 172.21.15.146:0/2755778722 >> v1:172.21.15.146:6789/0 conn(0x7f72f41309f0 legacy=0x7f72f413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.309+0000 7f72f952f700 1 -- 172.21.15.146:0/2755778722 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f41338b0 con 0x7f72f41300a0 2023-10-03T10:17:51.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.309+0000 7f72f952f700 1 --2- 172.21.15.146:0/2755778722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72f41300a0 0x7f72f41304b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f72e4009920 tx=0x7f72e4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cee34d509e47ef79 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.309+0000 7f72f8d2e700 1 -- 172.21.15.146:0/2755778722 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e4011830 con 0x7f72f41300a0 2023-10-03T10:17:51.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.309+0000 7f72f8d2e700 1 -- 172.21.15.146:0/2755778722 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e4011990 con 0x7f72f41300a0 2023-10-03T10:17:51.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.309+0000 7f72f8d2e700 1 -- 172.21.15.146:0/2755778722 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e4011d20 con 0x7f72f41300a0 2023-10-03T10:17:51.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.310+0000 7f72fbf94700 1 -- 172.21.15.146:0/2755778722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72f41300a0 msgr2=0x7f72f41304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.310+0000 7f72fbf94700 1 --2- 172.21.15.146:0/2755778722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72f41300a0 0x7f72f41304b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f72e4009920 tx=0x7f72e4009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:51.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.310+0000 7f72fbf94700 1 -- 172.21.15.146:0/2755778722 shutdown_connections 2023-10-03T10:17:51.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.310+0000 7f72fbf94700 1 --2- 172.21.15.146:0/2755778722 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72f4133ad0 0x7f72f4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.310+0000 7f72fbf94700 1 --2- 172.21.15.146:0/2755778722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72f41300a0 0x7f72f41304b0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.310+0000 7f72fbf94700 1 -- 172.21.15.146:0/2755778722 >> 172.21.15.146:0/2755778722 conn(0x7f72f4099c40 msgr2=0x7f72f40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.310+0000 7f72fbf94700 1 -- 172.21.15.146:0/2755778722 shutdown_connections 2023-10-03T10:17:51.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.310+0000 7f72fbf94700 1 -- 172.21.15.146:0/2755778722 wait complete. 2023-10-03T10:17:51.312 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:51.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.311+0000 7f72fbf94700 1 Processor -- start 2023-10-03T10:17:51.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.311+0000 7f72fbf94700 1 -- start start 2023-10-03T10:17:51.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.312+0000 7f72fbf94700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72f41300a0 0x7f72f411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.312+0000 7f72fbf94700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72f41309f0 0x7f72f411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.312+0000 7f72fbf94700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72f4133ad0 0x7f72f411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.312+0000 7f72fbf94700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f4120e40 con 0x7f72f41309f0 2023-10-03T10:17:51.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.312+0000 7f72fbf94700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f4120460 con 0x7f72f41300a0 2023-10-03T10:17:51.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.312+0000 7f72fbf94700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72f412dd00 con 0x7f72f4133ad0 2023-10-03T10:17:51.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.312+0000 7f72f952f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72f41309f0 0x7f72f411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.312+0000 7f72f952f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72f41309f0 0x7f72f411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60382/0 (socket says 172.21.15.146:60382) 2023-10-03T10:17:51.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.312+0000 7f72f952f700 1 -- 172.21.15.146:0/1768170093 learned_addr learned my addr 172.21.15.146:0/1768170093 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:51.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.312+0000 7f72fa531700 1 --2- 172.21.15.146:0/1768170093 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72f4133ad0 0x7f72f411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.312+0000 7f72f9d30700 1 --2- 172.21.15.146:0/1768170093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72f41300a0 0x7f72f411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.312+0000 7f72f952f700 1 -- 172.21.15.146:0/1768170093 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72f4133ad0 msgr2=0x7f72f411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.312+0000 7f72f952f700 1 --2- 172.21.15.146:0/1768170093 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72f4133ad0 0x7f72f411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.312+0000 7f72f952f700 1 -- 172.21.15.146:0/1768170093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72f41300a0 msgr2=0x7f72f411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.312+0000 7f72f952f700 1 --2- 172.21.15.146:0/1768170093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72f41300a0 0x7f72f411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.312+0000 7f72f952f700 1 -- 172.21.15.146:0/1768170093 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e4009550 con 0x7f72f41309f0 2023-10-03T10:17:51.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.312+0000 7f72f952f700 1 --2- 172.21.15.146:0/1768170093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72f41309f0 0x7f72f411df80 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f72e40098f0 tx=0x7f72e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.312+0000 7f72ea7fc700 1 -- 172.21.15.146:0/1768170093 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e4004510 con 0x7f72f41309f0 2023-10-03T10:17:51.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.313+0000 7f72ea7fc700 1 -- 172.21.15.146:0/1768170093 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e401e070 con 0x7f72f41309f0 2023-10-03T10:17:51.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.313+0000 7f72ea7fc700 1 -- 172.21.15.146:0/1768170093 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e40038e0 con 0x7f72f41309f0 2023-10-03T10:17:51.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.313+0000 7f72fbf94700 1 -- 172.21.15.146:0/1768170093 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f411ed70 con 0x7f72f41309f0 2023-10-03T10:17:51.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.313+0000 7f72fbf94700 1 -- 172.21.15.146:0/1768170093 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f412d890 con 0x7f72f41309f0 2023-10-03T10:17:51.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.313+0000 7f72ea7fc700 1 -- 172.21.15.146:0/1768170093 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f72e4003a40 con 0x7f72f41309f0 2023-10-03T10:17:51.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.314+0000 7f72ea7fc700 1 -- 172.21.15.146:0/1768170093 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f72e40404c0 con 0x7f72f41309f0 2023-10-03T10:17:51.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.314+0000 7f72fbf94700 1 -- 172.21.15.146:0/1768170093 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f411fe20 con 0x7f72f41309f0 2023-10-03T10:17:51.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.318+0000 7f72ea7fc700 1 -- 172.21.15.146:0/1768170093 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72f411fe20 con 0x7f72f41309f0 2023-10-03T10:17:51.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.436+0000 7f801aec6700 1 -- 172.21.15.146:0/2802276266 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f801409cf30 con 0x7f801412d2f0 2023-10-03T10:17:51.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.437+0000 7f80117fa700 1 -- 172.21.15.146:0/2802276266 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f801409cf30 con 0x7f801412d2f0 2023-10-03T10:17:51.437 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:51.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.439+0000 7f801aec6700 1 -- 172.21.15.146:0/2802276266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f801412d2f0 msgr2=0x7f801411a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.439+0000 7f801aec6700 1 --2- 172.21.15.146:0/2802276266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f801412d2f0 0x7f801411a940 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f801409ce70 tx=0x7f8008004750 comp rx=0 tx=0).stop 2023-10-03T10:17:51.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.439+0000 7f801aec6700 1 -- 172.21.15.146:0/2802276266 shutdown_connections 2023-10-03T10:17:51.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.439+0000 7f801aec6700 1 --2- 172.21.15.146:0/2802276266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8014130e70 0x7f801411b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.439+0000 7f801aec6700 1 --2- 172.21.15.146:0/2802276266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f801412d2f0 0x7f801411a940 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.439+0000 7f801aec6700 1 --2- 172.21.15.146:0/2802276266 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8014130350 0x7f801411ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.439+0000 7f801aec6700 1 -- 172.21.15.146:0/2802276266 >> 172.21.15.146:0/2802276266 conn(0x7f80140a2980 msgr2=0x7f8014099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.439+0000 7f801aec6700 1 -- 172.21.15.146:0/2802276266 shutdown_connections 2023-10-03T10:17:51.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.439+0000 7f801aec6700 1 -- 172.21.15.146:0/2802276266 wait complete. 2023-10-03T10:17:51.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:51.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.483+0000 7f6da9868700 1 -- 172.21.15.146:0/2087888688 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6da404f2a0 con 0x7f6da409a150 2023-10-03T10:17:51.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.483+0000 7f6d8bfff700 1 -- 172.21.15.146:0/2087888688 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6d94017020 con 0x7f6da409a150 2023-10-03T10:17:51.483 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:51.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.485+0000 7f6da9868700 1 -- 172.21.15.146:0/2087888688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6da409a150 msgr2=0x7f6da41226d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.485+0000 7f6da9868700 1 --2- 172.21.15.146:0/2087888688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6da409a150 0x7f6da41226d0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400e9b0 tx=0x7f6d9400ed70 comp rx=0 tx=0).stop 2023-10-03T10:17:51.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.485+0000 7f6da9868700 1 -- 172.21.15.146:0/2087888688 shutdown_connections 2023-10-03T10:17:51.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.485+0000 7f6da9868700 1 --2- 172.21.15.146:0/2087888688 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6da4133c20 0x7f6da4123150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.485+0000 7f6da9868700 1 --2- 172.21.15.146:0/2087888688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6da409a150 0x7f6da41226d0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.485+0000 7f6da9868700 1 --2- 172.21.15.146:0/2087888688 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6da409edb0 0x7f6da4122c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.485+0000 7f6da9868700 1 -- 172.21.15.146:0/2087888688 >> 172.21.15.146:0/2087888688 conn(0x7f6da40a4430 msgr2=0x7f6da40a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.486+0000 7f6da9868700 1 -- 172.21.15.146:0/2087888688 shutdown_connections 2023-10-03T10:17:51.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.486+0000 7f6da9868700 1 -- 172.21.15.146:0/2087888688 wait complete. 2023-10-03T10:17:51.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:51.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.529+0000 7f72fbf94700 1 -- 172.21.15.146:0/1768170093 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f72f411fe20 con 0x7f72f41309f0 2023-10-03T10:17:51.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.530+0000 7f72ea7fc700 1 -- 172.21.15.146:0/1768170093 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f72f411fe20 con 0x7f72f41309f0 2023-10-03T10:17:51.530 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:51.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.532+0000 7f72fbf94700 1 -- 172.21.15.146:0/1768170093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72f41309f0 msgr2=0x7f72f411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.532+0000 7f72fbf94700 1 --2- 172.21.15.146:0/1768170093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72f41309f0 0x7f72f411df80 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f72e40098f0 tx=0x7f72e4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:51.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.532+0000 7f72fbf94700 1 -- 172.21.15.146:0/1768170093 shutdown_connections 2023-10-03T10:17:51.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.532+0000 7f72fbf94700 1 --2- 172.21.15.146:0/1768170093 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f72f4133ad0 0x7f72f411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.532+0000 7f72fbf94700 1 --2- 172.21.15.146:0/1768170093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f72f41300a0 0x7f72f411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.532+0000 7f72fbf94700 1 --2- 172.21.15.146:0/1768170093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72f41309f0 0x7f72f411df80 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.532+0000 7f72fbf94700 1 -- 172.21.15.146:0/1768170093 >> 172.21.15.146:0/1768170093 conn(0x7f72f4099c40 msgr2=0x7f72f4131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.532+0000 7f72fbf94700 1 -- 172.21.15.146:0/1768170093 shutdown_connections 2023-10-03T10:17:51.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:51.532+0000 7f72fbf94700 1 -- 172.21.15.146:0/1768170093 wait complete. 2023-10-03T10:17:51.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:52.313 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:52.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.437+0000 7fdcbe34c700 1 Processor -- start 2023-10-03T10:17:52.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.437+0000 7fdcbe34c700 1 -- start start 2023-10-03T10:17:52.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.438+0000 7fdcbe34c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcb80a1510 0x7fdcb81351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.438+0000 7fdcbe34c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdcb81356e0 0x7fdcb8137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.438+0000 7fdcbe34c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb80a1e70 con 0x7fdcb80a0a30 2023-10-03T10:17:52.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.438+0000 7fdcbe34c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb809a720 con 0x7fdcb81356e0 2023-10-03T10:17:52.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.438+0000 7fdcbe34c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb809b300 con 0x7fdcb80a1510 2023-10-03T10:17:52.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.438+0000 7fdcbc8e9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdcb81356e0 0x7fdcb8137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.438+0000 7fdcb77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcb80a1510 0x7fdcb81351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.438+0000 7fdcb7fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdcb80a0a30 0x7fdcb80a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39414/0 (socket says 172.21.15.146:39414) 2023-10-03T10:17:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.438+0000 7fdcb7fff700 1 -- 172.21.15.146:0/3227025684 learned_addr learned my addr 172.21.15.146:0/3227025684 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.438+0000 7fdcbc8e9700 1 -- 172.21.15.146:0/3227025684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcb80a1510 msgr2=0x7fdcb81351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.438+0000 7fdcbc8e9700 1 --2- 172.21.15.146:0/3227025684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcb80a1510 0x7fdcb81351a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.438+0000 7fdcbc8e9700 1 -- 172.21.15.146:0/3227025684 >> v1:172.21.15.146:6789/0 conn(0x7fdcb80a0a30 legacy=0x7fdcb80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.438+0000 7fdcbc8e9700 1 -- 172.21.15.146:0/3227025684 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb809abc0 con 0x7fdcb81356e0 2023-10-03T10:17:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.438+0000 7fdcb77fe700 1 --2- 172.21.15.146:0/3227025684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcb80a1510 0x7fdcb81351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.438+0000 7fdcbc8e9700 1 --2- 172.21.15.146:0/3227025684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcb81356e0 0x7fdcb8137ac0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000bfa0 tx=0x7fdcb000d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223a94b0df05f2ed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.438+0000 7fdcb6ffd700 1 -- 172.21.15.146:0/3227025684 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0010070 con 0x7fdcb81356e0 2023-10-03T10:17:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.438+0000 7fdcb6ffd700 1 -- 172.21.15.146:0/3227025684 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb000da00 con 0x7fdcb81356e0 2023-10-03T10:17:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.438+0000 7fdcb6ffd700 1 -- 172.21.15.146:0/3227025684 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb000ddb0 con 0x7fdcb81356e0 2023-10-03T10:17:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.439+0000 7fdcbe34c700 1 -- 172.21.15.146:0/3227025684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcb81356e0 msgr2=0x7fdcb8137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.439+0000 7fdcbe34c700 1 --2- 172.21.15.146:0/3227025684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcb81356e0 0x7fdcb8137ac0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000bfa0 tx=0x7fdcb000d330 comp rx=0 tx=0).stop 2023-10-03T10:17:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.439+0000 7fdcbe34c700 1 -- 172.21.15.146:0/3227025684 shutdown_connections 2023-10-03T10:17:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.439+0000 7fdcbe34c700 1 --2- 172.21.15.146:0/3227025684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcb81356e0 0x7fdcb8137ac0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.439+0000 7fdcbe34c700 1 --2- 172.21.15.146:0/3227025684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcb80a1510 0x7fdcb81351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.439+0000 7fdcbe34c700 1 -- 172.21.15.146:0/3227025684 >> 172.21.15.146:0/3227025684 conn(0x7fdcb80a2980 msgr2=0x7fdcb80a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.439+0000 7fdcbe34c700 1 -- 172.21.15.146:0/3227025684 shutdown_connections 2023-10-03T10:17:52.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.439+0000 7fdcbe34c700 1 -- 172.21.15.146:0/3227025684 wait complete. 2023-10-03T10:17:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.440+0000 7fdcbe34c700 1 Processor -- start 2023-10-03T10:17:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.440+0000 7fdcbe34c700 1 -- start start 2023-10-03T10:17:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.440+0000 7fdcbe34c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcb80a0a30 0x7fdcb81c0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.440+0000 7fdcbe34c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdcb80a1510 0x7fdcb81c1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.440+0000 7fdcbe34c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcb81356e0 0x7fdcb81c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.440+0000 7fdcbe34c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb8135590 con 0x7fdcb81356e0 2023-10-03T10:17:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.440+0000 7fdcbe34c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb81219d0 con 0x7fdcb80a0a30 2023-10-03T10:17:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.440+0000 7fdcbe34c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb8122700 con 0x7fdcb80a1510 2023-10-03T10:17:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.441+0000 7fdcb7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcb80a0a30 0x7fdcb81c0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.441+0000 7fdcb77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdcb80a1510 0x7fdcb81c1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.441+0000 7fdcbc8e9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcb81356e0 0x7fdcb81c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.441+0000 7fdcb77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdcb80a1510 0x7fdcb81c1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58626/0 (socket says 172.21.15.146:58626) 2023-10-03T10:17:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.441+0000 7fdcbc8e9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcb81356e0 0x7fdcb81c3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60404/0 (socket says 172.21.15.146:60404) 2023-10-03T10:17:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.441+0000 7fdcb77fe700 1 -- 172.21.15.146:0/765336650 learned_addr learned my addr 172.21.15.146:0/765336650 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.441+0000 7fdcb7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcb80a0a30 0x7fdcb81c0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44192/0 (socket says 172.21.15.146:44192) 2023-10-03T10:17:52.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.441+0000 7fdcb7fff700 1 -- 172.21.15.146:0/765336650 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdcb80a1510 msgr2=0x7fdcb81c1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.441+0000 7fdcb7fff700 1 --2- 172.21.15.146:0/765336650 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdcb80a1510 0x7fdcb81c1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.441+0000 7fdcb7fff700 1 -- 172.21.15.146:0/765336650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcb81356e0 msgr2=0x7fdcb81c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.441+0000 7fdcb7fff700 1 --2- 172.21.15.146:0/765336650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcb81356e0 0x7fdcb81c3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.441+0000 7fdcb7fff700 1 -- 172.21.15.146:0/765336650 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca80094a0 con 0x7fdcb80a0a30 2023-10-03T10:17:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.441+0000 7fdcb77fe700 1 --2- 172.21.15.146:0/765336650 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdcb80a1510 0x7fdcb81c1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.441+0000 7fdcb7fff700 1 --2- 172.21.15.146:0/765336650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcb80a0a30 0x7fdcb81c0dc0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00c560 tx=0x7fdcac00c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.441+0000 7fdcb4ff9700 1 -- 172.21.15.146:0/765336650 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac0074e0 con 0x7fdcb80a0a30 2023-10-03T10:17:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.441+0000 7fdcb4ff9700 1 -- 172.21.15.146:0/765336650 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac00ce90 con 0x7fdcb80a0a30 2023-10-03T10:17:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.441+0000 7fdcbe34c700 1 -- 172.21.15.146:0/765336650 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb000bc80 con 0x7fdcb80a0a30 2023-10-03T10:17:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.441+0000 7fdcb4ff9700 1 -- 172.21.15.146:0/765336650 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac005830 con 0x7fdcb80a0a30 2023-10-03T10:17:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.441+0000 7fdcbe34c700 1 -- 172.21.15.146:0/765336650 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb809ae00 con 0x7fdcb80a0a30 2023-10-03T10:17:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.442+0000 7fdcb4ff9700 1 -- 172.21.15.146:0/765336650 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdcac005990 con 0x7fdcb80a0a30 2023-10-03T10:17:52.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.442+0000 7fdcb4ff9700 1 -- 172.21.15.146:0/765336650 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdcac03e8d0 con 0x7fdcb80a0a30 2023-10-03T10:17:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.442+0000 7fdcbe34c700 1 -- 172.21.15.146:0/765336650 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb804f2a0 con 0x7fdcb80a0a30 2023-10-03T10:17:52.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.447+0000 7fdcb4ff9700 1 -- 172.21.15.146:0/765336650 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdcac019b40 con 0x7fdcb80a0a30 2023-10-03T10:17:52.452 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:52.498 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:52.544 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.587+0000 7fb7929e3700 1 Processor -- start 2023-10-03T10:17:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.587+0000 7fb7929e3700 1 -- start start 2023-10-03T10:17:52.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.588+0000 7fb7929e3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb78c09d860 0x7fb78c09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.588+0000 7fb7929e3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb78c09e170 0x7fb78c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.588+0000 7fb7929e3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78c09aaa0 con 0x7fb78c130ce0 2023-10-03T10:17:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.588+0000 7fb7929e3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb78c09f870 con 0x7fb78c09e170 2023-10-03T10:17:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.588+0000 7fb7929e3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c09b360 con 0x7fb78c09d860 2023-10-03T10:17:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.588+0000 7fb78b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb78c09e170 0x7fb78c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.588+0000 7fb78b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb78c09e170 0x7fb78c1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60418/0 (socket says 172.21.15.146:60418) 2023-10-03T10:17:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.588+0000 7fb78b7fe700 1 -- 172.21.15.146:0/1064675514 learned_addr learned my addr 172.21.15.146:0/1064675514 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.588+0000 7fb78bfff700 1 --2- 172.21.15.146:0/1064675514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb78c09d860 0x7fb78c09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.588+0000 7fb78b7fe700 1 -- 172.21.15.146:0/1064675514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb78c09d860 msgr2=0x7fb78c09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:52.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.588+0000 7fb78b7fe700 1 --2- 172.21.15.146:0/1064675514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb78c09d860 0x7fb78c09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.588+0000 7fb78b7fe700 1 -- 172.21.15.146:0/1064675514 >> v1:172.21.15.146:6789/0 conn(0x7fb78c130ce0 legacy=0x7fb78c1379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.588+0000 7fb78b7fe700 1 -- 172.21.15.146:0/1064675514 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c09b620 con 0x7fb78c09e170 2023-10-03T10:17:52.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.589+0000 7fb78b7fe700 1 --2- 172.21.15.146:0/1064675514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78c09e170 0x7fb78c1307a0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fb78000bb90 tx=0x7fb78000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c972ea5e0929384c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.589+0000 7fb78affd700 1 -- 172.21.15.146:0/1064675514 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78000dd30 con 0x7fb78c09e170 2023-10-03T10:17:52.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.589+0000 7fb78affd700 1 -- 172.21.15.146:0/1064675514 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78000de90 con 0x7fb78c09e170 2023-10-03T10:17:52.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.589+0000 7fb78affd700 1 -- 172.21.15.146:0/1064675514 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780010690 con 0x7fb78c09e170 2023-10-03T10:17:52.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.590+0000 7fb7929e3700 1 -- 172.21.15.146:0/1064675514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78c09e170 msgr2=0x7fb78c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.590+0000 7fb7929e3700 1 --2- 172.21.15.146:0/1064675514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78c09e170 0x7fb78c1307a0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fb78000bb90 tx=0x7fb78000bea0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.590+0000 7fb7929e3700 1 -- 172.21.15.146:0/1064675514 shutdown_connections 2023-10-03T10:17:52.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.590+0000 7fb7929e3700 1 --2- 172.21.15.146:0/1064675514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb78c09d860 0x7fb78c09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.590+0000 7fb7929e3700 1 --2- 172.21.15.146:0/1064675514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78c09e170 0x7fb78c1307a0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.590+0000 7fb7929e3700 1 -- 172.21.15.146:0/1064675514 >> 172.21.15.146:0/1064675514 conn(0x7fb78c099c40 msgr2=0x7fb78c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.590+0000 7fb7929e3700 1 -- 172.21.15.146:0/1064675514 shutdown_connections 2023-10-03T10:17:52.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.590+0000 7fb7929e3700 1 -- 172.21.15.146:0/1064675514 wait complete. 2023-10-03T10:17:52.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.591+0000 7fb7929e3700 1 Processor -- start 2023-10-03T10:17:52.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.591+0000 7fb7929e3700 1 -- start start 2023-10-03T10:17:52.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.592+0000 7fb7929e3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78c09d860 0x7fb78c1c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.592+0000 7fb7929e3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb78c09e170 0x7fb78c1c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.592+0000 7fb7929e3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb78c130ce0 0x7fb78c1c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.592+0000 7fb7929e3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c124cb0 con 0x7fb78c09d860 2023-10-03T10:17:52.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.592+0000 7fb7929e3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c122ea0 con 0x7fb78c09e170 2023-10-03T10:17:52.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.592+0000 7fb7929e3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c126570 con 0x7fb78c130ce0 2023-10-03T10:17:52.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.592+0000 7fb78bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78c09d860 0x7fb78c1c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.592+0000 7fb78b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb78c09e170 0x7fb78c1c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.592+0000 7fb78bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78c09d860 0x7fb78c1c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60434/0 (socket says 172.21.15.146:60434) 2023-10-03T10:17:52.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.592+0000 7fb78bfff700 1 -- 172.21.15.146:0/2744316524 learned_addr learned my addr 172.21.15.146:0/2744316524 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:52.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.592+0000 7fb790f80700 1 --2- 172.21.15.146:0/2744316524 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb78c130ce0 0x7fb78c1c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.593+0000 7fb78bfff700 1 -- 172.21.15.146:0/2744316524 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb78c130ce0 msgr2=0x7fb78c1c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.593+0000 7fb78bfff700 1 --2- 172.21.15.146:0/2744316524 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb78c130ce0 0x7fb78c1c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.593+0000 7fb78bfff700 1 -- 172.21.15.146:0/2744316524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb78c09e170 msgr2=0x7fb78c1c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.593+0000 7fb78bfff700 1 --2- 172.21.15.146:0/2744316524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb78c09e170 0x7fb78c1c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.593+0000 7fb78bfff700 1 -- 172.21.15.146:0/2744316524 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78000b7f0 con 0x7fb78c09d860 2023-10-03T10:17:52.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.593+0000 7fb78b7fe700 1 --2- 172.21.15.146:0/2744316524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb78c09e170 0x7fb78c1c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.593+0000 7fb78bfff700 1 --2- 172.21.15.146:0/2744316524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78c09d860 0x7fb78c1c8200 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00e9b0 tx=0x7fb77c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.593+0000 7fb788ff9700 1 -- 172.21.15.146:0/2744316524 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c009710 con 0x7fb78c09d860 2023-10-03T10:17:52.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.593+0000 7fb788ff9700 1 -- 172.21.15.146:0/2744316524 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77c00ee50 con 0x7fb78c09d860 2023-10-03T10:17:52.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.593+0000 7fb7929e3700 1 -- 172.21.15.146:0/2744316524 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78c0a21b0 con 0x7fb78c09d860 2023-10-03T10:17:52.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.593+0000 7fb788ff9700 1 -- 172.21.15.146:0/2744316524 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c00c9f0 con 0x7fb78c09d860 2023-10-03T10:17:52.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.593+0000 7fb7929e3700 1 -- 172.21.15.146:0/2744316524 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb78c124e50 con 0x7fb78c09d860 2023-10-03T10:17:52.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.594+0000 7fb788ff9700 1 -- 172.21.15.146:0/2744316524 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb77c00cb50 con 0x7fb78c09d860 2023-10-03T10:17:52.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.594+0000 7fb7929e3700 1 -- 172.21.15.146:0/2744316524 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb76c0052e0 con 0x7fb78c09d860 2023-10-03T10:17:52.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.595+0000 7fb788ff9700 1 -- 172.21.15.146:0/2744316524 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb77c03fbc0 con 0x7fb78c09d860 2023-10-03T10:17:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.603+0000 7fb788ff9700 1 -- 172.21.15.146:0/2744316524 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb77c01b3b0 con 0x7fb78c09d860 2023-10-03T10:17:52.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.640+0000 7f0ab1b3a700 1 Processor -- start 2023-10-03T10:17:52.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.640+0000 7f0ab1b3a700 1 -- start start 2023-10-03T10:17:52.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.641+0000 7f0ab1b3a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aac0a0a70 0x7f0aac0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.641+0000 7f0ab1b3a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0aac0a1380 0x7f0aac133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.641+0000 7f0ab1b3a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aac09dc00 con 0x7f0aac133f50 2023-10-03T10:17:52.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.641+0000 7f0ab1b3a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac09ea60 con 0x7f0aac0a0a70 2023-10-03T10:17:52.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.641+0000 7f0ab1b3a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac09dec0 con 0x7f0aac0a1380 2023-10-03T10:17:52.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.641+0000 7f0aab7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aac0a0a70 0x7f0aac0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.641+0000 7f0aab7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aac0a0a70 0x7f0aac0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44218/0 (socket says 172.21.15.146:44218) 2023-10-03T10:17:52.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.641+0000 7f0aabfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0aac133f50 0x7f0aac13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39428/0 (socket says 172.21.15.146:39428) 2023-10-03T10:17:52.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.641+0000 7f0aab7fe700 1 -- 172.21.15.146:0/730396814 learned_addr learned my addr 172.21.15.146:0/730396814 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:52.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.641+0000 7f0aaaffd700 1 --2- 172.21.15.146:0/730396814 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0aac0a1380 0x7f0aac133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.642+0000 7f0aab7fe700 1 -- 172.21.15.146:0/730396814 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0aac0a1380 msgr2=0x7f0aac133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:52.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.642+0000 7f0aaa7fc700 1 -- 172.21.15.146:0/730396814 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 49760216 0 0) 0x7f0aac09dc00 con 0x7f0aac133f50 2023-10-03T10:17:52.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.642+0000 7f0aab7fe700 1 --2- 172.21.15.146:0/730396814 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0aac0a1380 0x7f0aac133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.642+0000 7f0aab7fe700 1 -- 172.21.15.146:0/730396814 >> v1:172.21.15.146:6789/0 conn(0x7f0aac133f50 legacy=0x7f0aac13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.642+0000 7f0aab7fe700 1 -- 172.21.15.146:0/730396814 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac09e6a0 con 0x7f0aac0a0a70 2023-10-03T10:17:52.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.642+0000 7f0aaaffd700 1 --2- 172.21.15.146:0/730396814 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0aac0a1380 0x7f0aac133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.642+0000 7f0aab7fe700 1 --2- 172.21.15.146:0/730396814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aac0a0a70 0x7f0aac0a0e40 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009920 tx=0x7f0a9c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df25231b01b66c2f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.642+0000 7f0aaa7fc700 1 -- 172.21.15.146:0/730396814 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c011830 con 0x7f0aac0a0a70 2023-10-03T10:17:52.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.642+0000 7f0aaa7fc700 1 -- 172.21.15.146:0/730396814 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c011990 con 0x7f0aac0a0a70 2023-10-03T10:17:52.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.642+0000 7f0aaa7fc700 1 -- 172.21.15.146:0/730396814 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c011d20 con 0x7f0aac0a0a70 2023-10-03T10:17:52.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.643+0000 7f0ab1b3a700 1 -- 172.21.15.146:0/730396814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aac0a0a70 msgr2=0x7f0aac0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.643+0000 7f0ab1b3a700 1 --2- 172.21.15.146:0/730396814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aac0a0a70 0x7f0aac0a0e40 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009920 tx=0x7f0a9c009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:52.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.643+0000 7f0ab1b3a700 1 -- 172.21.15.146:0/730396814 shutdown_connections 2023-10-03T10:17:52.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.643+0000 7f0ab1b3a700 1 --2- 172.21.15.146:0/730396814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aac0a0a70 0x7f0aac0a0e40 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.643+0000 7f0ab1b3a700 1 --2- 172.21.15.146:0/730396814 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0aac0a1380 0x7f0aac133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.643+0000 7f0ab1b3a700 1 -- 172.21.15.146:0/730396814 >> 172.21.15.146:0/730396814 conn(0x7f0aac0a6610 msgr2=0x7f0aac0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.643+0000 7f0ab1b3a700 1 -- 172.21.15.146:0/730396814 shutdown_connections 2023-10-03T10:17:52.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.643+0000 7f0ab1b3a700 1 -- 172.21.15.146:0/730396814 wait complete. 2023-10-03T10:17:52.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.644+0000 7f0ab1b3a700 1 Processor -- start 2023-10-03T10:17:52.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.644+0000 7f0ab1b3a700 1 -- start start 2023-10-03T10:17:52.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.645+0000 7f0ab1b3a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0aac0a0a70 0x7f0aac1228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.645+0000 7f0ab1b3a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aac0a1380 0x7f0aac122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.645+0000 7f0ab1b3a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0aac133f50 0x7f0aac123360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.645+0000 7f0ab1b3a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac126200 con 0x7f0aac0a0a70 2023-10-03T10:17:52.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.645+0000 7f0ab1b3a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac133940 con 0x7f0aac0a1380 2023-10-03T10:17:52.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.645+0000 7f0ab1b3a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac133400 con 0x7f0aac133f50 2023-10-03T10:17:52.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.645+0000 7f0aab7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0aac0a0a70 0x7f0aac1228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.645+0000 7f0aab7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0aac0a0a70 0x7f0aac1228e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60450/0 (socket says 172.21.15.146:60450) 2023-10-03T10:17:52.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.645+0000 7f0aab7fe700 1 -- 172.21.15.146:0/3138515387 learned_addr learned my addr 172.21.15.146:0/3138515387 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:52.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.645+0000 7f0aaaffd700 1 --2- 172.21.15.146:0/3138515387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aac0a1380 0x7f0aac122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.645+0000 7f0aabfff700 1 --2- 172.21.15.146:0/3138515387 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0aac133f50 0x7f0aac123360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.646+0000 7f0aab7fe700 1 -- 172.21.15.146:0/3138515387 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0aac133f50 msgr2=0x7f0aac123360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.646+0000 7f0aab7fe700 1 --2- 172.21.15.146:0/3138515387 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0aac133f50 0x7f0aac123360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.646+0000 7f0aab7fe700 1 -- 172.21.15.146:0/3138515387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aac0a1380 msgr2=0x7f0aac122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.646+0000 7f0aab7fe700 1 --2- 172.21.15.146:0/3138515387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aac0a1380 0x7f0aac122e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.646+0000 7f0aab7fe700 1 -- 172.21.15.146:0/3138515387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa00094a0 con 0x7f0aac0a0a70 2023-10-03T10:17:52.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.646+0000 7f0aab7fe700 1 --2- 172.21.15.146:0/3138515387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0aac0a0a70 0x7f0aac1228e0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c000c00 tx=0x7f0a9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.646+0000 7f0a93fff700 1 -- 172.21.15.146:0/3138515387 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c004510 con 0x7f0aac0a0a70 2023-10-03T10:17:52.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.646+0000 7f0a93fff700 1 -- 172.21.15.146:0/3138515387 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c0036a0 con 0x7f0aac0a0a70 2023-10-03T10:17:52.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.646+0000 7f0ab1b3a700 1 -- 172.21.15.146:0/3138515387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9c009550 con 0x7f0aac0a0a70 2023-10-03T10:17:52.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.646+0000 7f0a93fff700 1 -- 172.21.15.146:0/3138515387 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c003a10 con 0x7f0aac0a0a70 2023-10-03T10:17:52.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.646+0000 7f0ab1b3a700 1 -- 172.21.15.146:0/3138515387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aac0a0430 con 0x7f0aac0a0a70 2023-10-03T10:17:52.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.647+0000 7f0ab1b3a700 1 -- 172.21.15.146:0/3138515387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aac126c50 con 0x7f0aac0a0a70 2023-10-03T10:17:52.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.647+0000 7f0a93fff700 1 -- 172.21.15.146:0/3138515387 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a9c003b70 con 0x7f0aac0a0a70 2023-10-03T10:17:52.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.648+0000 7f0a93fff700 1 -- 172.21.15.146:0/3138515387 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0a9c021030 con 0x7f0aac0a0a70 2023-10-03T10:17:52.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.652+0000 7f0a93fff700 1 -- 172.21.15.146:0/3138515387 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a9c042e60 con 0x7f0aac0a0a70 2023-10-03T10:17:52.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.662+0000 7fdcbe34c700 1 -- 172.21.15.146:0/765336650 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdcb81207f0 con 0x7fdcb80a0a30 2023-10-03T10:17:52.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.662+0000 7fdcb4ff9700 1 -- 172.21.15.146:0/765336650 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdcac017020 con 0x7fdcb80a0a30 2023-10-03T10:17:52.662 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:52.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.664+0000 7fdcbe34c700 1 -- 172.21.15.146:0/765336650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcb80a0a30 msgr2=0x7fdcb81c0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.664+0000 7fdcbe34c700 1 --2- 172.21.15.146:0/765336650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcb80a0a30 0x7fdcb81c0dc0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00c560 tx=0x7fdcac00c870 comp rx=0 tx=0).stop 2023-10-03T10:17:52.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.665+0000 7fdcbe34c700 1 -- 172.21.15.146:0/765336650 shutdown_connections 2023-10-03T10:17:52.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.665+0000 7fdcbe34c700 1 --2- 172.21.15.146:0/765336650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcb81356e0 0x7fdcb81c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.665+0000 7fdcbe34c700 1 --2- 172.21.15.146:0/765336650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcb80a0a30 0x7fdcb81c0dc0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.665+0000 7fdcbe34c700 1 --2- 172.21.15.146:0/765336650 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdcb80a1510 0x7fdcb81c1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.665+0000 7fdcbe34c700 1 -- 172.21.15.146:0/765336650 >> 172.21.15.146:0/765336650 conn(0x7fdcb80a2980 msgr2=0x7fdcb809deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.665+0000 7fdcbe34c700 1 -- 172.21.15.146:0/765336650 shutdown_connections 2023-10-03T10:17:52.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.665+0000 7fdcbe34c700 1 -- 172.21.15.146:0/765336650 wait complete. 2023-10-03T10:17:52.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:52.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.684+0000 7f3f8b1f9700 1 Processor -- start 2023-10-03T10:17:52.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.684+0000 7f3f8b1f9700 1 -- start start 2023-10-03T10:17:52.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.684+0000 7f3f8b1f9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f8409e870 0x7f3f8409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.684+0000 7f3f8b1f9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f841343a0 0x7f3f8413bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.684+0000 7f3f8b1f9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8406bec0 con 0x7f3f8409f180 2023-10-03T10:17:52.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.684+0000 7f3f8b1f9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8406ce60 con 0x7f3f8409e870 2023-10-03T10:17:52.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.684+0000 7f3f8b1f9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8409fa00 con 0x7f3f841343a0 2023-10-03T10:17:52.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.685+0000 7f3f83fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3f8409f180 0x7f3f84133c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39430/0 (socket says 172.21.15.146:39430) 2023-10-03T10:17:52.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.685+0000 7f3f83fff700 1 -- 172.21.15.146:0/2765597872 learned_addr learned my addr 172.21.15.146:0/2765597872 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:52.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.685+0000 7f3f88f95700 1 --2- 172.21.15.146:0/2765597872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f8409e870 0x7f3f8409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.685+0000 7f3f89796700 1 --2- 172.21.15.146:0/2765597872 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f841343a0 0x7f3f8413bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.685+0000 7f3f88f95700 1 -- 172.21.15.146:0/2765597872 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f841343a0 msgr2=0x7f3f8413bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:52.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.685+0000 7f3f88f95700 1 --2- 172.21.15.146:0/2765597872 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f841343a0 0x7f3f8413bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.685+0000 7f3f88f95700 1 -- 172.21.15.146:0/2765597872 >> v1:172.21.15.146:6789/0 conn(0x7f3f8409f180 legacy=0x7f3f84133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.685+0000 7f3f88f95700 1 -- 172.21.15.146:0/2765597872 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8409ad80 con 0x7f3f8409e870 2023-10-03T10:17:52.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.685+0000 7f3f89796700 1 --2- 172.21.15.146:0/2765597872 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f841343a0 0x7f3f8413bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.685+0000 7f3f837fe700 1 -- 172.21.15.146:0/2765597872 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1464769493 0 0) 0x7f3f8406bec0 con 0x7f3f8409f180 2023-10-03T10:17:52.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.685+0000 7f3f88f95700 1 --2- 172.21.15.146:0/2765597872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f8409e870 0x7f3f8409ec40 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3f78009870 tx=0x7f3f78009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2f90b9d8cf2aefb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.685+0000 7f3f837fe700 1 -- 172.21.15.146:0/2765597872 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f78011830 con 0x7f3f8409e870 2023-10-03T10:17:52.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.685+0000 7f3f837fe700 1 -- 172.21.15.146:0/2765597872 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f78011990 con 0x7f3f8409e870 2023-10-03T10:17:52.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.685+0000 7f3f837fe700 1 -- 172.21.15.146:0/2765597872 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f78011d20 con 0x7f3f8409e870 2023-10-03T10:17:52.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.686+0000 7f3f8b1f9700 1 -- 172.21.15.146:0/2765597872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f8409e870 msgr2=0x7f3f8409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.686+0000 7f3f8b1f9700 1 --2- 172.21.15.146:0/2765597872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f8409e870 0x7f3f8409ec40 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3f78009870 tx=0x7f3f78009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:52.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.686+0000 7f3f8b1f9700 1 -- 172.21.15.146:0/2765597872 shutdown_connections 2023-10-03T10:17:52.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.686+0000 7f3f8b1f9700 1 --2- 172.21.15.146:0/2765597872 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f841343a0 0x7f3f8413bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.686+0000 7f3f8b1f9700 1 --2- 172.21.15.146:0/2765597872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f8409e870 0x7f3f8409ec40 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.686+0000 7f3f8b1f9700 1 -- 172.21.15.146:0/2765597872 >> 172.21.15.146:0/2765597872 conn(0x7f3f840a4430 msgr2=0x7f3f840a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.686+0000 7f3f8b1f9700 1 -- 172.21.15.146:0/2765597872 shutdown_connections 2023-10-03T10:17:52.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.686+0000 7f3f8b1f9700 1 -- 172.21.15.146:0/2765597872 wait complete. 2023-10-03T10:17:52.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.687+0000 7f3f8b1f9700 1 Processor -- start 2023-10-03T10:17:52.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.687+0000 7f3f8b1f9700 1 -- start start 2023-10-03T10:17:52.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.687+0000 7f3f8b1f9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f8409e870 0x7f3f841228c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.687+0000 7f3f8b1f9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f8409f180 0x7f3f84122e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.687+0000 7f3f8b1f9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f841343a0 0x7f3f84123340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.687+0000 7f3f8b1f9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f84125ac0 con 0x7f3f8409e870 2023-10-03T10:17:52.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.687+0000 7f3f8b1f9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f84133460 con 0x7f3f841343a0 2023-10-03T10:17:52.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.687+0000 7f3f8b1f9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f841263e0 con 0x7f3f8409f180 2023-10-03T10:17:52.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.688+0000 7f3f83fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f8409f180 0x7f3f84122e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.688+0000 7f3f83fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f8409f180 0x7f3f84122e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58672/0 (socket says 172.21.15.146:58672) 2023-10-03T10:17:52.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.688+0000 7f3f83fff700 1 -- 172.21.15.146:0/1338414068 learned_addr learned my addr 172.21.15.146:0/1338414068 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:52.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.688+0000 7f3f88f95700 1 --2- 172.21.15.146:0/1338414068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f8409e870 0x7f3f841228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.688+0000 7f3f89796700 1 --2- 172.21.15.146:0/1338414068 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f841343a0 0x7f3f84123340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.688+0000 7f3f88f95700 1 -- 172.21.15.146:0/1338414068 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f8409f180 msgr2=0x7f3f84122e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.688+0000 7f3f88f95700 1 --2- 172.21.15.146:0/1338414068 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f8409f180 0x7f3f84122e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.688+0000 7f3f88f95700 1 -- 172.21.15.146:0/1338414068 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f841343a0 msgr2=0x7f3f84123340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.688+0000 7f3f88f95700 1 --2- 172.21.15.146:0/1338414068 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f841343a0 0x7f3f84123340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.688+0000 7f3f88f95700 1 -- 172.21.15.146:0/1338414068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7c009a70 con 0x7f3f8409e870 2023-10-03T10:17:52.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.688+0000 7f3f83fff700 1 --2- 172.21.15.146:0/1338414068 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f8409f180 0x7f3f84122e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.688+0000 7f3f89796700 1 --2- 172.21.15.146:0/1338414068 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f841343a0 0x7f3f84123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.688+0000 7f3f88f95700 1 --2- 172.21.15.146:0/1338414068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f8409e870 0x7f3f841228c0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f3f840673f0 tx=0x7f3f78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.688+0000 7f3f817fa700 1 -- 172.21.15.146:0/1338414068 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f780044d0 con 0x7f3f8409e870 2023-10-03T10:17:52.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.688+0000 7f3f817fa700 1 -- 172.21.15.146:0/1338414068 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7801f070 con 0x7f3f8409e870 2023-10-03T10:17:52.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.688+0000 7f3f8b1f9700 1 -- 172.21.15.146:0/1338414068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f780094a0 con 0x7f3f8409e870 2023-10-03T10:17:52.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.688+0000 7f3f817fa700 1 -- 172.21.15.146:0/1338414068 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f780038c0 con 0x7f3f8409e870 2023-10-03T10:17:52.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.688+0000 7f3f8b1f9700 1 -- 172.21.15.146:0/1338414068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8406cfa0 con 0x7f3f8409e870 2023-10-03T10:17:52.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.689+0000 7f3f817fa700 1 -- 172.21.15.146:0/1338414068 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f78003a20 con 0x7f3f8409e870 2023-10-03T10:17:52.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.689+0000 7f3f817fa700 1 -- 172.21.15.146:0/1338414068 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3f78021070 con 0x7f3f8409e870 2023-10-03T10:17:52.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.689+0000 7f3f8b1f9700 1 -- 172.21.15.146:0/1338414068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f84125d70 con 0x7f3f8409e870 2023-10-03T10:17:52.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.698+0000 7f3f817fa700 1 -- 172.21.15.146:0/1338414068 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f780253e0 con 0x7f3f8409e870 2023-10-03T10:17:52.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.807+0000 7fb7929e3700 1 -- 172.21.15.146:0/2744316524 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb76c005590 con 0x7fb78c09d860 2023-10-03T10:17:52.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.808+0000 7fb788ff9700 1 -- 172.21.15.146:0/2744316524 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb77c021030 con 0x7fb78c09d860 2023-10-03T10:17:52.807 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:52.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.810+0000 7fb7929e3700 1 -- 172.21.15.146:0/2744316524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78c09d860 msgr2=0x7fb78c1c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.810+0000 7fb7929e3700 1 --2- 172.21.15.146:0/2744316524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78c09d860 0x7fb78c1c8200 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00e9b0 tx=0x7fb77c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.810+0000 7fb7929e3700 1 -- 172.21.15.146:0/2744316524 shutdown_connections 2023-10-03T10:17:52.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.810+0000 7fb7929e3700 1 --2- 172.21.15.146:0/2744316524 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb78c130ce0 0x7fb78c1c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.810+0000 7fb7929e3700 1 --2- 172.21.15.146:0/2744316524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb78c09d860 0x7fb78c1c8200 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.810+0000 7fb7929e3700 1 --2- 172.21.15.146:0/2744316524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb78c09e170 0x7fb78c1c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.811+0000 7fb7929e3700 1 -- 172.21.15.146:0/2744316524 >> 172.21.15.146:0/2744316524 conn(0x7fb78c099c40 msgr2=0x7fb78c0a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.811+0000 7fb7929e3700 1 -- 172.21.15.146:0/2744316524 shutdown_connections 2023-10-03T10:17:52.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.811+0000 7fb7929e3700 1 -- 172.21.15.146:0/2744316524 wait complete. 2023-10-03T10:17:52.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:52.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.862+0000 7f0ab1b3a700 1 -- 172.21.15.146:0/3138515387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0aac04f2a0 con 0x7f0aac0a0a70 2023-10-03T10:17:52.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.862+0000 7f0a93fff700 1 -- 172.21.15.146:0/3138515387 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0a9c02b020 con 0x7f0aac0a0a70 2023-10-03T10:17:52.862 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:52.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.864+0000 7f0ab1b3a700 1 -- 172.21.15.146:0/3138515387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0aac0a0a70 msgr2=0x7f0aac1228e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.864+0000 7f0ab1b3a700 1 --2- 172.21.15.146:0/3138515387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0aac0a0a70 0x7f0aac1228e0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c000c00 tx=0x7f0a9c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:52.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.864+0000 7f0ab1b3a700 1 -- 172.21.15.146:0/3138515387 shutdown_connections 2023-10-03T10:17:52.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.864+0000 7f0ab1b3a700 1 --2- 172.21.15.146:0/3138515387 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0aac133f50 0x7f0aac123360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.864+0000 7f0ab1b3a700 1 --2- 172.21.15.146:0/3138515387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0aac0a0a70 0x7f0aac1228e0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.864+0000 7f0ab1b3a700 1 --2- 172.21.15.146:0/3138515387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aac0a1380 0x7f0aac122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.864+0000 7f0ab1b3a700 1 -- 172.21.15.146:0/3138515387 >> 172.21.15.146:0/3138515387 conn(0x7f0aac0a6610 msgr2=0x7f0aac0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.864+0000 7f0ab1b3a700 1 -- 172.21.15.146:0/3138515387 shutdown_connections 2023-10-03T10:17:52.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.865+0000 7f0ab1b3a700 1 -- 172.21.15.146:0/3138515387 wait complete. 2023-10-03T10:17:52.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:52.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.892+0000 7f3f8b1f9700 1 -- 172.21.15.146:0/1338414068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3f8404f2a0 con 0x7f3f8409e870 2023-10-03T10:17:52.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.892+0000 7f3f817fa700 1 -- 172.21.15.146:0/1338414068 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f78010b70 con 0x7f3f8409e870 2023-10-03T10:17:52.892 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:52.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.895+0000 7f3f8b1f9700 1 -- 172.21.15.146:0/1338414068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f8409e870 msgr2=0x7f3f841228c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.895+0000 7f3f8b1f9700 1 --2- 172.21.15.146:0/1338414068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f8409e870 0x7f3f841228c0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f3f840673f0 tx=0x7f3f78004750 comp rx=0 tx=0).stop 2023-10-03T10:17:52.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.895+0000 7f3f8b1f9700 1 -- 172.21.15.146:0/1338414068 shutdown_connections 2023-10-03T10:17:52.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.895+0000 7f3f8b1f9700 1 --2- 172.21.15.146:0/1338414068 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f841343a0 0x7f3f84123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.895+0000 7f3f8b1f9700 1 --2- 172.21.15.146:0/1338414068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f8409e870 0x7f3f841228c0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.895+0000 7f3f8b1f9700 1 --2- 172.21.15.146:0/1338414068 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f8409f180 0x7f3f84122e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.895+0000 7f3f8b1f9700 1 -- 172.21.15.146:0/1338414068 >> 172.21.15.146:0/1338414068 conn(0x7f3f840a4430 msgr2=0x7f3f84070ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.895+0000 7f3f8b1f9700 1 -- 172.21.15.146:0/1338414068 shutdown_connections 2023-10-03T10:17:52.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:52.895+0000 7f3f8b1f9700 1 -- 172.21.15.146:0/1338414068 wait complete. 2023-10-03T10:17:52.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:53.683 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.814+0000 7f94ddbd6700 1 Processor -- start 2023-10-03T10:17:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.814+0000 7f94ddbd6700 1 -- start start 2023-10-03T10:17:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.814+0000 7f94ddbd6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d806a770 0x7f94d806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.814+0000 7f94ddbd6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f94d806b080 0x7f94d81317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.814+0000 7f94ddbd6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f94d8131cf0 0x7f94d8132190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.814+0000 7f94ddbd6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d809f770 con 0x7f94d806b080 2023-10-03T10:17:53.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.814+0000 7f94ddbd6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d809dce0 con 0x7f94d806a770 2023-10-03T10:17:53.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.814+0000 7f94ddbd6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94d809da80 con 0x7f94d8131cf0 2023-10-03T10:17:53.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.815+0000 7f94d6ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f94d806b080 0x7f94d81317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.815+0000 7f94d77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d806a770 0x7f94d806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.815+0000 7f94d6ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f94d806b080 0x7f94d81317b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60468/0 (socket says 172.21.15.146:60468) 2023-10-03T10:17:53.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.815+0000 7f94d77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d806a770 0x7f94d806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44260/0 (socket says 172.21.15.146:44260) 2023-10-03T10:17:53.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.815+0000 7f94d6ffd700 1 -- 172.21.15.146:0/3415169026 learned_addr learned my addr 172.21.15.146:0/3415169026 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:53.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.815+0000 7f94d7fff700 1 --2- 172.21.15.146:0/3415169026 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f94d8131cf0 0x7f94d8132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.815+0000 7f94d6ffd700 1 -- 172.21.15.146:0/3415169026 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f94d8131cf0 msgr2=0x7f94d8132190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:53.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.815+0000 7f94d6ffd700 1 --2- 172.21.15.146:0/3415169026 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f94d8131cf0 0x7f94d8132190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.815+0000 7f94d6ffd700 1 -- 172.21.15.146:0/3415169026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d806a770 msgr2=0x7f94d806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.815+0000 7f94d6ffd700 1 --2- 172.21.15.146:0/3415169026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d806a770 0x7f94d806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.815+0000 7f94d6ffd700 1 -- 172.21.15.146:0/3415169026 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d809eb20 con 0x7f94d806b080 2023-10-03T10:17:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.815+0000 7f94d77fe700 1 --2- 172.21.15.146:0/3415169026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d806a770 0x7f94d806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.815+0000 7f94d7fff700 1 --2- 172.21.15.146:0/3415169026 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f94d8131cf0 0x7f94d8132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.815+0000 7f94d6ffd700 1 --2- 172.21.15.146:0/3415169026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d806b080 0x7f94d81317b0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f94c80098f0 tx=0x7f94c8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74dd94e4ab3fb7ab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.815+0000 7f94d67fc700 1 -- 172.21.15.146:0/3415169026 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8011830 con 0x7f94d806b080 2023-10-03T10:17:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.815+0000 7f94d67fc700 1 -- 172.21.15.146:0/3415169026 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c8011990 con 0x7f94d806b080 2023-10-03T10:17:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.815+0000 7f94d67fc700 1 -- 172.21.15.146:0/3415169026 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8011d20 con 0x7f94d806b080 2023-10-03T10:17:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.816+0000 7f94ddbd6700 1 -- 172.21.15.146:0/3415169026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d806b080 msgr2=0x7f94d81317b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.816+0000 7f94ddbd6700 1 --2- 172.21.15.146:0/3415169026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d806b080 0x7f94d81317b0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f94c80098f0 tx=0x7f94c8009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:53.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.816+0000 7f94ddbd6700 1 -- 172.21.15.146:0/3415169026 shutdown_connections 2023-10-03T10:17:53.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.816+0000 7f94ddbd6700 1 --2- 172.21.15.146:0/3415169026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d806a770 0x7f94d806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.816+0000 7f94ddbd6700 1 --2- 172.21.15.146:0/3415169026 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f94d8131cf0 0x7f94d8132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.816+0000 7f94ddbd6700 1 --2- 172.21.15.146:0/3415169026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d806b080 0x7f94d81317b0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.816+0000 7f94ddbd6700 1 -- 172.21.15.146:0/3415169026 >> 172.21.15.146:0/3415169026 conn(0x7f94d8099c40 msgr2=0x7f94d80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.816+0000 7f94ddbd6700 1 -- 172.21.15.146:0/3415169026 shutdown_connections 2023-10-03T10:17:53.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.816+0000 7f94ddbd6700 1 -- 172.21.15.146:0/3415169026 wait complete. 2023-10-03T10:17:53.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.817+0000 7f94ddbd6700 1 Processor -- start 2023-10-03T10:17:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.817+0000 7f94ddbd6700 1 -- start start 2023-10-03T10:17:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.817+0000 7f94ddbd6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d806a770 0x7f94d811efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.817+0000 7f94ddbd6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f94d806b080 0x7f94d811f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.817+0000 7f94ddbd6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d8131cf0 0x7f94d811fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.817+0000 7f94ddbd6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80a28c0 con 0x7f94d8131cf0 2023-10-03T10:17:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.817+0000 7f94ddbd6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d8120b60 con 0x7f94d806a770 2023-10-03T10:17:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.817+0000 7f94ddbd6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94d8122a40 con 0x7f94d806b080 2023-10-03T10:17:53.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.817+0000 7f94d77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d806a770 0x7f94d811efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.818+0000 7f94d6ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f94d806b080 0x7f94d811f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.818+0000 7f94d7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d8131cf0 0x7f94d811fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.818+0000 7f94d77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d806a770 0x7f94d811efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44274/0 (socket says 172.21.15.146:44274) 2023-10-03T10:17:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.818+0000 7f94d77fe700 1 -- 172.21.15.146:0/2321484142 learned_addr learned my addr 172.21.15.146:0/2321484142 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.818+0000 7f94d6ffd700 1 -- 172.21.15.146:0/2321484142 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d806a770 msgr2=0x7f94d811efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.818+0000 7f94d6ffd700 1 --2- 172.21.15.146:0/2321484142 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d806a770 0x7f94d811efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.818+0000 7f94d6ffd700 1 -- 172.21.15.146:0/2321484142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d8131cf0 msgr2=0x7f94d811fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.818+0000 7f94d6ffd700 1 --2- 172.21.15.146:0/2321484142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d8131cf0 0x7f94d811fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.818+0000 7f94d6ffd700 1 -- 172.21.15.146:0/2321484142 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c00094a0 con 0x7f94d806b080 2023-10-03T10:17:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.818+0000 7f94d77fe700 1 --2- 172.21.15.146:0/2321484142 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d806a770 0x7f94d811efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.818+0000 7f94d6ffd700 1 --2- 172.21.15.146:0/2321484142 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f94d806b080 0x7f94d811f520 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f94c8016000 tx=0x7f94c8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.818+0000 7f94cffff700 1 -- 172.21.15.146:0/2321484142 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8004240 con 0x7f94d806b080 2023-10-03T10:17:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.818+0000 7f94cffff700 1 -- 172.21.15.146:0/2321484142 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c801f070 con 0x7f94d806b080 2023-10-03T10:17:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.818+0000 7f94ddbd6700 1 -- 172.21.15.146:0/2321484142 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d0009a70 con 0x7f94d806b080 2023-10-03T10:17:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.818+0000 7f94cffff700 1 -- 172.21.15.146:0/2321484142 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c80036a0 con 0x7f94d806b080 2023-10-03T10:17:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.818+0000 7f94ddbd6700 1 -- 172.21.15.146:0/2321484142 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c8009550 con 0x7f94d806b080 2023-10-03T10:17:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.819+0000 7f94cffff700 1 -- 172.21.15.146:0/2321484142 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f94c8021030 con 0x7f94d806b080 2023-10-03T10:17:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.819+0000 7f94cffff700 1 -- 172.21.15.146:0/2321484142 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f94c8040760 con 0x7f94d806b080 2023-10-03T10:17:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.819+0000 7f94ddbd6700 1 -- 172.21.15.146:0/2321484142 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d811bde0 con 0x7f94d806b080 2023-10-03T10:17:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.824+0000 7f94cffff700 1 -- 172.21.15.146:0/2321484142 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f94c8015080 con 0x7f94d806b080 2023-10-03T10:17:53.828 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:53.877 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:53.907 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:53.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.954+0000 7feaabec9700 1 Processor -- start 2023-10-03T10:17:53.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.955+0000 7feaabec9700 1 -- start start 2023-10-03T10:17:53.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.955+0000 7feaabec9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feaa4136960 0x7feaa4138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.955+0000 7feaabec9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feaa4139280 0x7feaa413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.955+0000 7feaabec9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa406b2d0 con 0x7feaa4133ad0 2023-10-03T10:17:53.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.955+0000 7feaabec9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa41345b0 con 0x7feaa4136960 2023-10-03T10:17:53.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.955+0000 7feaabec9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feaa4133610 con 0x7feaa4139280 2023-10-03T10:17:53.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.955+0000 7feaaa466700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feaa4139280 0x7feaa413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.955+0000 7feaaa466700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feaa4139280 0x7feaa413b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58702/0 (socket says 172.21.15.146:58702) 2023-10-03T10:17:53.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.955+0000 7feaaa466700 1 -- 172.21.15.146:0/2843966199 learned_addr learned my addr 172.21.15.146:0/2843966199 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:53.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.956+0000 7feaa9464700 1 --2- 172.21.15.146:0/2843966199 >> v2:172.21.15.146:3300/0 conn(0x7feaa4136960 0x7feaa4138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.956+0000 7feaaa466700 1 -- 172.21.15.146:0/2843966199 >> v2:172.21.15.146:3300/0 conn(0x7feaa4136960 msgr2=0x7feaa4138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:53.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.956+0000 7feaaa466700 1 --2- 172.21.15.146:0/2843966199 >> v2:172.21.15.146:3300/0 conn(0x7feaa4136960 0x7feaa4138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.956+0000 7feaaa466700 1 -- 172.21.15.146:0/2843966199 >> v1:172.21.15.146:6789/0 conn(0x7feaa4133ad0 legacy=0x7feaa4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:53.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.956+0000 7feaaa466700 1 -- 172.21.15.146:0/2843966199 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa409a500 con 0x7feaa4139280 2023-10-03T10:17:53.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.956+0000 7feaaa466700 1 --2- 172.21.15.146:0/2843966199 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feaa4139280 0x7feaa413b660 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009e50 tx=0x7fea9c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37681be24a5db31b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.956+0000 7feaa8c63700 1 -- 172.21.15.146:0/2843966199 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00e070 con 0x7feaa4139280 2023-10-03T10:17:53.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.956+0000 7feaa8c63700 1 -- 172.21.15.146:0/2843966199 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9c003a20 con 0x7feaa4139280 2023-10-03T10:17:53.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.956+0000 7feaa8c63700 1 -- 172.21.15.146:0/2843966199 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c003dd0 con 0x7feaa4139280 2023-10-03T10:17:53.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.957+0000 7feaabec9700 1 -- 172.21.15.146:0/2843966199 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feaa4139280 msgr2=0x7feaa413b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.957+0000 7feaabec9700 1 --2- 172.21.15.146:0/2843966199 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feaa4139280 0x7feaa413b660 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009e50 tx=0x7fea9c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:53.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.957+0000 7feaabec9700 1 -- 172.21.15.146:0/2843966199 shutdown_connections 2023-10-03T10:17:53.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.957+0000 7feaabec9700 1 --2- 172.21.15.146:0/2843966199 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feaa4139280 0x7feaa413b660 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.957+0000 7feaabec9700 1 --2- 172.21.15.146:0/2843966199 >> v2:172.21.15.146:3300/0 conn(0x7feaa4136960 0x7feaa4138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.957+0000 7feaabec9700 1 -- 172.21.15.146:0/2843966199 >> 172.21.15.146:0/2843966199 conn(0x7feaa4099c40 msgr2=0x7feaa40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.958+0000 7feaabec9700 1 -- 172.21.15.146:0/2843966199 shutdown_connections 2023-10-03T10:17:53.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.958+0000 7feaabec9700 1 -- 172.21.15.146:0/2843966199 wait complete. 2023-10-03T10:17:53.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.958+0000 7feaabec9700 1 Processor -- start 2023-10-03T10:17:53.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.959+0000 7feaabec9700 1 -- start start 2023-10-03T10:17:53.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.959+0000 7feaabec9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feaa4136960 0x7feaa40718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.959+0000 7feaabec9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feaa4139280 0x7feaa4071e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.959+0000 7feaabec9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feaa4072340 0x7feaa41c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.959+0000 7feaabec9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa406ed60 con 0x7feaa4136960 2023-10-03T10:17:53.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.959+0000 7feaabec9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa409f400 con 0x7feaa4072340 2023-10-03T10:17:53.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.959+0000 7feaabec9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feaa41317a0 con 0x7feaa4139280 2023-10-03T10:17:53.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.959+0000 7feaa9c65700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feaa4136960 0x7feaa40718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.959+0000 7feaa9c65700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feaa4136960 0x7feaa40718c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60500/0 (socket says 172.21.15.146:60500) 2023-10-03T10:17:53.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.959+0000 7feaa9c65700 1 -- 172.21.15.146:0/3379166562 learned_addr learned my addr 172.21.15.146:0/3379166562 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:53.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.959+0000 7feaa9464700 1 --2- 172.21.15.146:0/3379166562 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feaa4139280 0x7feaa4071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.959+0000 7feaaa466700 1 --2- 172.21.15.146:0/3379166562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feaa4072340 0x7feaa41c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.960+0000 7feaa9464700 1 -- 172.21.15.146:0/3379166562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feaa4072340 msgr2=0x7feaa41c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.960+0000 7feaa9464700 1 --2- 172.21.15.146:0/3379166562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feaa4072340 0x7feaa41c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.960+0000 7feaa9464700 1 -- 172.21.15.146:0/3379166562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feaa4136960 msgr2=0x7feaa40718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.960+0000 7feaa9464700 1 --2- 172.21.15.146:0/3379166562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feaa4136960 0x7feaa40718c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.960+0000 7feaa9464700 1 -- 172.21.15.146:0/3379166562 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c009b30 con 0x7feaa4139280 2023-10-03T10:17:53.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.960+0000 7feaa9c65700 1 --2- 172.21.15.146:0/3379166562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feaa4136960 0x7feaa40718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.960+0000 7feaa9464700 1 --2- 172.21.15.146:0/3379166562 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feaa4139280 0x7feaa4071e00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fea9400e7e0 tx=0x7fea9400eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.960+0000 7fea9a7fc700 1 -- 172.21.15.146:0/3379166562 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9400c070 con 0x7feaa4139280 2023-10-03T10:17:53.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.960+0000 7fea9a7fc700 1 -- 172.21.15.146:0/3379166562 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea94013610 con 0x7feaa4139280 2023-10-03T10:17:53.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.960+0000 7feaabec9700 1 -- 172.21.15.146:0/3379166562 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa40703e0 con 0x7feaa4139280 2023-10-03T10:17:53.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.960+0000 7fea9a7fc700 1 -- 172.21.15.146:0/3379166562 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea940139a0 con 0x7feaa4139280 2023-10-03T10:17:53.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.960+0000 7feaabec9700 1 -- 172.21.15.146:0/3379166562 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa406f3b0 con 0x7feaa4139280 2023-10-03T10:17:53.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.961+0000 7feaabec9700 1 -- 172.21.15.146:0/3379166562 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa404f2a0 con 0x7feaa4139280 2023-10-03T10:17:53.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.961+0000 7fea9a7fc700 1 -- 172.21.15.146:0/3379166562 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea94013b00 con 0x7feaa4139280 2023-10-03T10:17:53.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.961+0000 7fea9a7fc700 1 -- 172.21.15.146:0/3379166562 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fea9403f490 con 0x7feaa4139280 2023-10-03T10:17:53.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:53.966+0000 7fea9a7fc700 1 -- 172.21.15.146:0/3379166562 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea94010900 con 0x7feaa4139280 2023-10-03T10:17:54.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.008+0000 7f9d4cd51700 1 Processor -- start 2023-10-03T10:17:54.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.008+0000 7f9d4cd51700 1 -- start start 2023-10-03T10:17:54.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.009+0000 7f9d4cd51700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d48133ad0 0x7f9d48133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.009+0000 7f9d4cd51700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d48130bc0 0x7f9d4813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.009+0000 7f9d4cd51700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4806b2d0 con 0x7f9d481300a0 2023-10-03T10:17:54.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.009+0000 7f9d4cd51700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d48133610 con 0x7f9d48133ad0 2023-10-03T10:17:54.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.009+0000 7f9d4cd51700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4809a500 con 0x7f9d48130bc0 2023-10-03T10:17:54.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.009+0000 7f9d4659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d48133ad0 0x7f9d48133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.009+0000 7f9d45d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9d481300a0 0x7f9d481304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39448/0 (socket says 172.21.15.146:39448) 2023-10-03T10:17:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.009+0000 7f9d4659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d48133ad0 0x7f9d48133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44296/0 (socket says 172.21.15.146:44296) 2023-10-03T10:17:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.009+0000 7f9d45d9b700 1 -- 172.21.15.146:0/65886992 learned_addr learned my addr 172.21.15.146:0/65886992 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.009+0000 7f9d46d9d700 1 --2- 172.21.15.146:0/65886992 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d48130bc0 0x7f9d4813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.009+0000 7f9d4559a700 1 -- 172.21.15.146:0/65886992 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161950609 0 0) 0x7f9d4806b2d0 con 0x7f9d481300a0 2023-10-03T10:17:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.009+0000 7f9d4559a700 1 -- 172.21.15.146:0/65886992 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d300035b0 con 0x7f9d481300a0 2023-10-03T10:17:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.009+0000 7f9d46d9d700 1 -- 172.21.15.146:0/65886992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d48133ad0 msgr2=0x7f9d48133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.009+0000 7f9d46d9d700 1 --2- 172.21.15.146:0/65886992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d48133ad0 0x7f9d48133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.009+0000 7f9d46d9d700 1 -- 172.21.15.146:0/65886992 >> v1:172.21.15.146:6789/0 conn(0x7f9d481300a0 legacy=0x7f9d481304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.009+0000 7f9d46d9d700 1 -- 172.21.15.146:0/65886992 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d481338b0 con 0x7f9d48130bc0 2023-10-03T10:17:54.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.009+0000 7f9d4659c700 1 --2- 172.21.15.146:0/65886992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d48133ad0 0x7f9d48133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:54.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.009+0000 7f9d46d9d700 1 --2- 172.21.15.146:0/65886992 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d48130bc0 0x7f9d4813b990 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9d40009dc0 tx=0x7f9d4000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e92e871536968c64 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:54.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.010+0000 7f9d4559a700 1 -- 172.21.15.146:0/65886992 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4000e070 con 0x7f9d48130bc0 2023-10-03T10:17:54.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.010+0000 7f9d4559a700 1 -- 172.21.15.146:0/65886992 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4000bb20 con 0x7f9d48130bc0 2023-10-03T10:17:54.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.010+0000 7f9d4559a700 1 -- 172.21.15.146:0/65886992 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40012430 con 0x7f9d48130bc0 2023-10-03T10:17:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.011+0000 7f9d4cd51700 1 -- 172.21.15.146:0/65886992 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d48130bc0 msgr2=0x7f9d4813b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.011+0000 7f9d4cd51700 1 --2- 172.21.15.146:0/65886992 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d48130bc0 0x7f9d4813b990 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9d40009dc0 tx=0x7f9d4000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.011+0000 7f9d4cd51700 1 -- 172.21.15.146:0/65886992 shutdown_connections 2023-10-03T10:17:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.011+0000 7f9d4cd51700 1 --2- 172.21.15.146:0/65886992 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d48130bc0 0x7f9d4813b990 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.011+0000 7f9d4cd51700 1 --2- 172.21.15.146:0/65886992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d48133ad0 0x7f9d48133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.011+0000 7f9d4cd51700 1 -- 172.21.15.146:0/65886992 >> 172.21.15.146:0/65886992 conn(0x7f9d48099c40 msgr2=0x7f9d480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.011+0000 7f9d4cd51700 1 -- 172.21.15.146:0/65886992 shutdown_connections 2023-10-03T10:17:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.011+0000 7f9d4cd51700 1 -- 172.21.15.146:0/65886992 wait complete. 2023-10-03T10:17:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.012+0000 7f9d4cd51700 1 Processor -- start 2023-10-03T10:17:54.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.012+0000 7f9d4cd51700 1 -- start start 2023-10-03T10:17:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.012+0000 7f9d4cd51700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d481300a0 0x7f9d4811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.012+0000 7f9d4cd51700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d48130bc0 0x7f9d4811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.012+0000 7f9d4cd51700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d48133ad0 0x7f9d4811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.012+0000 7f9d4cd51700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4811fa40 con 0x7f9d48130bc0 2023-10-03T10:17:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.012+0000 7f9d4cd51700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4811f250 con 0x7f9d48133ad0 2023-10-03T10:17:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.012+0000 7f9d4cd51700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4812dd00 con 0x7f9d481300a0 2023-10-03T10:17:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.012+0000 7f9d4659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d481300a0 0x7f9d4811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.013+0000 7f9d4659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d481300a0 0x7f9d4811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58722/0 (socket says 172.21.15.146:58722) 2023-10-03T10:17:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.013+0000 7f9d4659c700 1 -- 172.21.15.146:0/2186511331 learned_addr learned my addr 172.21.15.146:0/2186511331 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:54.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.013+0000 7f9d45d9b700 1 --2- 172.21.15.146:0/2186511331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d48130bc0 0x7f9d4811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.013+0000 7f9d46d9d700 1 --2- 172.21.15.146:0/2186511331 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d48133ad0 0x7f9d4811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.013+0000 7f9d4659c700 1 -- 172.21.15.146:0/2186511331 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d48133ad0 msgr2=0x7f9d4811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.013+0000 7f9d4659c700 1 --2- 172.21.15.146:0/2186511331 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d48133ad0 0x7f9d4811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.013+0000 7f9d4659c700 1 -- 172.21.15.146:0/2186511331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d48130bc0 msgr2=0x7f9d4811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.013+0000 7f9d4659c700 1 --2- 172.21.15.146:0/2186511331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d48130bc0 0x7f9d4811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.013+0000 7f9d4659c700 1 -- 172.21.15.146:0/2186511331 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d380094a0 con 0x7f9d481300a0 2023-10-03T10:17:54.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.013+0000 7f9d4659c700 1 --2- 172.21.15.146:0/2186511331 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d481300a0 0x7f9d4811da40 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800ebe0 tx=0x7f9d3800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:54.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.013+0000 7f9d36ffd700 1 -- 172.21.15.146:0/2186511331 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d38009800 con 0x7f9d481300a0 2023-10-03T10:17:54.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.013+0000 7f9d36ffd700 1 -- 172.21.15.146:0/2186511331 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3800c910 con 0x7f9d481300a0 2023-10-03T10:17:54.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.013+0000 7f9d4cd51700 1 -- 172.21.15.146:0/2186511331 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d40009a70 con 0x7f9d481300a0 2023-10-03T10:17:54.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.013+0000 7f9d36ffd700 1 -- 172.21.15.146:0/2186511331 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3800cc80 con 0x7f9d481300a0 2023-10-03T10:17:54.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.013+0000 7f9d4cd51700 1 -- 172.21.15.146:0/2186511331 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4811ffe0 con 0x7f9d481300a0 2023-10-03T10:17:54.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.015+0000 7f9d4cd51700 1 -- 172.21.15.146:0/2186511331 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4809cb20 con 0x7f9d481300a0 2023-10-03T10:17:54.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.015+0000 7f9d36ffd700 1 -- 172.21.15.146:0/2186511331 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d38013470 con 0x7f9d481300a0 2023-10-03T10:17:54.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.015+0000 7f9d36ffd700 1 -- 172.21.15.146:0/2186511331 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9d380473b0 con 0x7f9d481300a0 2023-10-03T10:17:54.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.024+0000 7f9d36ffd700 1 -- 172.21.15.146:0/2186511331 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d38013720 con 0x7f9d481300a0 2023-10-03T10:17:54.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.030+0000 7f94ddbd6700 1 -- 172.21.15.146:0/2321484142 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f94d804f2a0 con 0x7f94d806b080 2023-10-03T10:17:54.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.030+0000 7f94cffff700 1 -- 172.21.15.146:0/2321484142 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f94c80239c0 con 0x7f94d806b080 2023-10-03T10:17:54.030 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:54.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.033+0000 7f94ddbd6700 1 -- 172.21.15.146:0/2321484142 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f94d806b080 msgr2=0x7f94d811f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.033+0000 7f94ddbd6700 1 --2- 172.21.15.146:0/2321484142 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f94d806b080 0x7f94d811f520 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f94c8016000 tx=0x7f94c8004750 comp rx=0 tx=0).stop 2023-10-03T10:17:54.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.033+0000 7f94ddbd6700 1 -- 172.21.15.146:0/2321484142 shutdown_connections 2023-10-03T10:17:54.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.033+0000 7f94ddbd6700 1 --2- 172.21.15.146:0/2321484142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d8131cf0 0x7f94d811fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.033+0000 7f94ddbd6700 1 --2- 172.21.15.146:0/2321484142 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d806a770 0x7f94d811efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.033+0000 7f94ddbd6700 1 --2- 172.21.15.146:0/2321484142 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f94d806b080 0x7f94d811f520 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.033+0000 7f94ddbd6700 1 -- 172.21.15.146:0/2321484142 >> 172.21.15.146:0/2321484142 conn(0x7f94d8099c40 msgr2=0x7f94d8131020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.033+0000 7f94ddbd6700 1 -- 172.21.15.146:0/2321484142 shutdown_connections 2023-10-03T10:17:54.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.033+0000 7f94ddbd6700 1 -- 172.21.15.146:0/2321484142 wait complete. 2023-10-03T10:17:54.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:54.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.049+0000 7f19e0906700 1 Processor -- start 2023-10-03T10:17:54.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.049+0000 7f19e0906700 1 -- start start 2023-10-03T10:17:54.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.050+0000 7f19e0906700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19dc133ad0 0x7f19dc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.050+0000 7f19e0906700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19dc1300a0 0x7f19dc1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.050+0000 7f19e0906700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19dc1309f0 0x7f19dc13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.050+0000 7f19e0906700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19dc06b2d0 con 0x7f19dc1300a0 2023-10-03T10:17:54.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.050+0000 7f19e0906700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc133610 con 0x7f19dc133ad0 2023-10-03T10:17:54.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.050+0000 7f19e0906700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc09a500 con 0x7f19dc1309f0 2023-10-03T10:17:54.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.050+0000 7f19da59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19dc133ad0 0x7f19dc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.050+0000 7f19d9d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19dc1300a0 0x7f19dc1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.050+0000 7f19da59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19dc133ad0 0x7f19dc133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:44312/0 (socket says 172.21.15.146:44312) 2023-10-03T10:17:54.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.050+0000 7f19d9d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19dc1300a0 0x7f19dc1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60524/0 (socket says 172.21.15.146:60524) 2023-10-03T10:17:54.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.050+0000 7f19dad9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19dc1309f0 0x7f19dc13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.050+0000 7f19da59c700 1 -- 172.21.15.146:0/2441362516 learned_addr learned my addr 172.21.15.146:0/2441362516 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:54.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.051+0000 7f19dad9d700 1 -- 172.21.15.146:0/2441362516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19dc133ad0 msgr2=0x7f19dc133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:54.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.051+0000 7f19dad9d700 1 --2- 172.21.15.146:0/2441362516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19dc133ad0 0x7f19dc133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.051+0000 7f19dad9d700 1 -- 172.21.15.146:0/2441362516 >> v2:172.21.15.146:3300/0 conn(0x7f19dc1300a0 msgr2=0x7f19dc1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:54.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.051+0000 7f19dad9d700 1 --2- 172.21.15.146:0/2441362516 >> v2:172.21.15.146:3300/0 conn(0x7f19dc1300a0 0x7f19dc1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.051+0000 7f19dad9d700 1 -- 172.21.15.146:0/2441362516 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc1338b0 con 0x7f19dc1309f0 2023-10-03T10:17:54.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.051+0000 7f19d9d9b700 1 --2- 172.21.15.146:0/2441362516 >> v2:172.21.15.146:3300/0 conn(0x7f19dc1300a0 0x7f19dc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:54.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.051+0000 7f19da59c700 1 --2- 172.21.15.146:0/2441362516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19dc133ad0 0x7f19dc133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:54.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.051+0000 7f19dad9d700 1 --2- 172.21.15.146:0/2441362516 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19dc1309f0 0x7f19dc13a980 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009d90 tx=0x7f19d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25f02c58de1ec54b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:54.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.051+0000 7f19d959a700 1 -- 172.21.15.146:0/2441362516 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d400e070 con 0x7f19dc1309f0 2023-10-03T10:17:54.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.051+0000 7f19d959a700 1 -- 172.21.15.146:0/2441362516 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d400bb20 con 0x7f19dc1309f0 2023-10-03T10:17:54.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.051+0000 7f19d959a700 1 -- 172.21.15.146:0/2441362516 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d4012430 con 0x7f19dc1309f0 2023-10-03T10:17:54.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.052+0000 7f19e0906700 1 -- 172.21.15.146:0/2441362516 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19dc1309f0 msgr2=0x7f19dc13a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.052+0000 7f19e0906700 1 --2- 172.21.15.146:0/2441362516 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19dc1309f0 0x7f19dc13a980 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009d90 tx=0x7f19d400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:54.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.052+0000 7f19e0906700 1 -- 172.21.15.146:0/2441362516 shutdown_connections 2023-10-03T10:17:54.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.052+0000 7f19e0906700 1 --2- 172.21.15.146:0/2441362516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19dc133ad0 0x7f19dc133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.052+0000 7f19e0906700 1 --2- 172.21.15.146:0/2441362516 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19dc1309f0 0x7f19dc13a980 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.052+0000 7f19e0906700 1 --2- 172.21.15.146:0/2441362516 >> v2:172.21.15.146:3300/0 conn(0x7f19dc1300a0 0x7f19dc1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.052+0000 7f19e0906700 1 -- 172.21.15.146:0/2441362516 >> 172.21.15.146:0/2441362516 conn(0x7f19dc099c40 msgr2=0x7f19dc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.052+0000 7f19e0906700 1 -- 172.21.15.146:0/2441362516 shutdown_connections 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.052+0000 7f19e0906700 1 -- 172.21.15.146:0/2441362516 wait complete. 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.053+0000 7f19e0906700 1 Processor -- start 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.053+0000 7f19e0906700 1 -- start start 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.053+0000 7f19e0906700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19dc1300a0 0x7f19dc11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.053+0000 7f19e0906700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19dc1309f0 0x7f19dc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.053+0000 7f19e0906700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19dc133ad0 0x7f19dc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.053+0000 7f19e0906700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc120a10 con 0x7f19dc133ad0 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.053+0000 7f19e0906700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc11fa70 con 0x7f19dc1309f0 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.053+0000 7f19e0906700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc12d8c0 con 0x7f19dc1300a0 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.053+0000 7f19da59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19dc1300a0 0x7f19dc11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.053+0000 7f19da59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19dc1300a0 0x7f19dc11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58752/0 (socket says 172.21.15.146:58752) 2023-10-03T10:17:54.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.054+0000 7f19da59c700 1 -- 172.21.15.146:0/494438786 learned_addr learned my addr 172.21.15.146:0/494438786 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:54.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.054+0000 7f19dad9d700 1 --2- 172.21.15.146:0/494438786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19dc133ad0 0x7f19dc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.054+0000 7f19d9d9b700 1 --2- 172.21.15.146:0/494438786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19dc1309f0 0x7f19dc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.054+0000 7f19d9d9b700 1 -- 172.21.15.146:0/494438786 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19dc1300a0 msgr2=0x7f19dc11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.054+0000 7f19d9d9b700 1 --2- 172.21.15.146:0/494438786 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19dc1300a0 0x7f19dc11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.054+0000 7f19d9d9b700 1 -- 172.21.15.146:0/494438786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19dc133ad0 msgr2=0x7f19dc11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.054+0000 7f19d9d9b700 1 --2- 172.21.15.146:0/494438786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19dc133ad0 0x7f19dc11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.054+0000 7f19d9d9b700 1 -- 172.21.15.146:0/494438786 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d00094a0 con 0x7f19dc1309f0 2023-10-03T10:17:54.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.054+0000 7f19da59c700 1 --2- 172.21.15.146:0/494438786 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19dc1300a0 0x7f19dc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:54.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.054+0000 7f19dad9d700 1 --2- 172.21.15.146:0/494438786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19dc133ad0 0x7f19dc11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:54.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.054+0000 7f19d9d9b700 1 --2- 172.21.15.146:0/494438786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19dc1309f0 0x7f19dc11df80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f19d000e980 tx=0x7f19d000ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:54.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.054+0000 7f19caffd700 1 -- 172.21.15.146:0/494438786 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d000c690 con 0x7f19dc1309f0 2023-10-03T10:17:54.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.054+0000 7f19caffd700 1 -- 172.21.15.146:0/494438786 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d000c7f0 con 0x7f19dc1309f0 2023-10-03T10:17:54.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.054+0000 7f19e0906700 1 -- 172.21.15.146:0/494438786 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19cc009550 con 0x7f19dc1309f0 2023-10-03T10:17:54.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.054+0000 7f19caffd700 1 -- 172.21.15.146:0/494438786 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d000cb80 con 0x7f19dc1309f0 2023-10-03T10:17:54.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.054+0000 7f19e0906700 1 -- 172.21.15.146:0/494438786 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d4009a70 con 0x7f19dc1309f0 2023-10-03T10:17:54.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.055+0000 7f19e0906700 1 -- 172.21.15.146:0/494438786 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19dc12dd60 con 0x7f19dc1309f0 2023-10-03T10:17:54.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.055+0000 7f19caffd700 1 -- 172.21.15.146:0/494438786 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19d000cce0 con 0x7f19dc1309f0 2023-10-03T10:17:54.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.056+0000 7f19caffd700 1 -- 172.21.15.146:0/494438786 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f19d003f710 con 0x7f19dc1309f0 2023-10-03T10:17:54.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.064+0000 7f19caffd700 1 -- 172.21.15.146:0/494438786 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19d001b3b0 con 0x7f19dc1309f0 2023-10-03T10:17:54.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.166+0000 7feaabec9700 1 -- 172.21.15.146:0/3379166562 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7feaa409f0f0 con 0x7feaa4139280 2023-10-03T10:17:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.166+0000 7fea9a7fc700 1 -- 172.21.15.146:0/3379166562 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fea94010310 con 0x7feaa4139280 2023-10-03T10:17:54.166 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:54.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.168+0000 7feaabec9700 1 -- 172.21.15.146:0/3379166562 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feaa4139280 msgr2=0x7feaa4071e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.168+0000 7feaabec9700 1 --2- 172.21.15.146:0/3379166562 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feaa4139280 0x7feaa4071e00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fea9400e7e0 tx=0x7fea9400eaf0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.168+0000 7feaabec9700 1 -- 172.21.15.146:0/3379166562 shutdown_connections 2023-10-03T10:17:54.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.168+0000 7feaabec9700 1 --2- 172.21.15.146:0/3379166562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feaa4072340 0x7feaa41c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.168+0000 7feaabec9700 1 --2- 172.21.15.146:0/3379166562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feaa4136960 0x7feaa40718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.168+0000 7feaabec9700 1 --2- 172.21.15.146:0/3379166562 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feaa4139280 0x7feaa4071e00 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.168+0000 7feaabec9700 1 -- 172.21.15.146:0/3379166562 >> 172.21.15.146:0/3379166562 conn(0x7feaa4099c40 msgr2=0x7feaa41371c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.168+0000 7feaabec9700 1 -- 172.21.15.146:0/3379166562 shutdown_connections 2023-10-03T10:17:54.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.169+0000 7feaabec9700 1 -- 172.21.15.146:0/3379166562 wait complete. 2023-10-03T10:17:54.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:54.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.225+0000 7f9d4cd51700 1 -- 172.21.15.146:0/2186511331 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9d4804f2a0 con 0x7f9d481300a0 2023-10-03T10:17:54.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.226+0000 7f9d36ffd700 1 -- 172.21.15.146:0/2186511331 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9d38017030 con 0x7f9d481300a0 2023-10-03T10:17:54.225 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:54.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.228+0000 7f9d4cd51700 1 -- 172.21.15.146:0/2186511331 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d481300a0 msgr2=0x7f9d4811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.228+0000 7f9d4cd51700 1 --2- 172.21.15.146:0/2186511331 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d481300a0 0x7f9d4811da40 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800ebe0 tx=0x7f9d3800eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.228+0000 7f9d4cd51700 1 -- 172.21.15.146:0/2186511331 shutdown_connections 2023-10-03T10:17:54.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.228+0000 7f9d4cd51700 1 --2- 172.21.15.146:0/2186511331 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d48133ad0 0x7f9d4811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.228+0000 7f9d4cd51700 1 --2- 172.21.15.146:0/2186511331 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9d481300a0 0x7f9d4811da40 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.228+0000 7f9d4cd51700 1 --2- 172.21.15.146:0/2186511331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d48130bc0 0x7f9d4811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.228+0000 7f9d4cd51700 1 -- 172.21.15.146:0/2186511331 >> 172.21.15.146:0/2186511331 conn(0x7f9d48099c40 msgr2=0x7f9d48132c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.228+0000 7f9d4cd51700 1 -- 172.21.15.146:0/2186511331 shutdown_connections 2023-10-03T10:17:54.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.228+0000 7f9d4cd51700 1 -- 172.21.15.146:0/2186511331 wait complete. 2023-10-03T10:17:54.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:54.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.262+0000 7f19e0906700 1 -- 172.21.15.146:0/494438786 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f19dc04f2a0 con 0x7f19dc1309f0 2023-10-03T10:17:54.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.263+0000 7f19caffd700 1 -- 172.21.15.146:0/494438786 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f19d0017070 con 0x7f19dc1309f0 2023-10-03T10:17:54.262 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:54.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.265+0000 7f19e0906700 1 -- 172.21.15.146:0/494438786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19dc1309f0 msgr2=0x7f19dc11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.265+0000 7f19e0906700 1 --2- 172.21.15.146:0/494438786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19dc1309f0 0x7f19dc11df80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f19d000e980 tx=0x7f19d000ec90 comp rx=0 tx=0).stop 2023-10-03T10:17:54.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.265+0000 7f19e0906700 1 -- 172.21.15.146:0/494438786 shutdown_connections 2023-10-03T10:17:54.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.265+0000 7f19e0906700 1 --2- 172.21.15.146:0/494438786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19dc133ad0 0x7f19dc11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.265+0000 7f19e0906700 1 --2- 172.21.15.146:0/494438786 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19dc1300a0 0x7f19dc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.265+0000 7f19e0906700 1 --2- 172.21.15.146:0/494438786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19dc1309f0 0x7f19dc11df80 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.265+0000 7f19e0906700 1 -- 172.21.15.146:0/494438786 >> 172.21.15.146:0/494438786 conn(0x7f19dc099c40 msgr2=0x7f19dc131f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.265+0000 7f19e0906700 1 -- 172.21.15.146:0/494438786 shutdown_connections 2023-10-03T10:17:54.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:54.265+0000 7f19e0906700 1 -- 172.21.15.146:0/494438786 wait complete. 2023-10-03T10:17:54.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:55.046 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:55.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.175+0000 7f3bd1fb9700 1 Processor -- start 2023-10-03T10:17:55.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.175+0000 7f3bd1fb9700 1 -- start start 2023-10-03T10:17:55.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.175+0000 7f3bd1fb9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3bcc09d860 0x7f3bcc09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.175+0000 7f3bd1fb9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bcc09e170 0x7f3bcc1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.175+0000 7f3bd1fb9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bcc130ce0 0x7f3bcc131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.175+0000 7f3bd1fb9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bcc131670 con 0x7f3bcc09d860 2023-10-03T10:17:55.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.175+0000 7f3bd1fb9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc09aaa0 con 0x7f3bcc09e170 2023-10-03T10:17:55.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.175+0000 7f3bd1fb9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc09f870 con 0x7f3bcc130ce0 2023-10-03T10:17:55.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.175+0000 7f3bcaffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bcc09e170 0x7f3bcc1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.175+0000 7f3bcbfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bcc130ce0 0x7f3bcc131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.175+0000 7f3bcbfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bcc130ce0 0x7f3bcc131130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:58978/0 (socket says 172.21.15.146:58978) 2023-10-03T10:17:55.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.175+0000 7f3bcaffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bcc09e170 0x7f3bcc1307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52500/0 (socket says 172.21.15.146:52500) 2023-10-03T10:17:55.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.175+0000 7f3bcbfff700 1 -- 172.21.15.146:0/3353067847 learned_addr learned my addr 172.21.15.146:0/3353067847 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:55.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.175+0000 7f3bcb7fe700 1 --2- 172.21.15.146:0/3353067847 >> v2:172.21.15.146:3300/0 conn(0x7f3bcc09d860 0x7f3bcc09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.176+0000 7f3bcbfff700 1 -- 172.21.15.146:0/3353067847 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bcc09e170 msgr2=0x7f3bcc1307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:55.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.176+0000 7f3bcbfff700 1 --2- 172.21.15.146:0/3353067847 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bcc09e170 0x7f3bcc1307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.176+0000 7f3bcbfff700 1 -- 172.21.15.146:0/3353067847 >> v2:172.21.15.146:3300/0 conn(0x7f3bcc09d860 msgr2=0x7f3bcc09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:55.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.176+0000 7f3bcbfff700 1 --2- 172.21.15.146:0/3353067847 >> v2:172.21.15.146:3300/0 conn(0x7f3bcc09d860 0x7f3bcc09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.176+0000 7f3bcbfff700 1 -- 172.21.15.146:0/3353067847 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc09b360 con 0x7f3bcc130ce0 2023-10-03T10:17:55.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.176+0000 7f3bcb7fe700 1 --2- 172.21.15.146:0/3353067847 >> v2:172.21.15.146:3300/0 conn(0x7f3bcc09d860 0x7f3bcc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.176+0000 7f3bcaffd700 1 --2- 172.21.15.146:0/3353067847 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bcc09e170 0x7f3bcc1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.176+0000 7f3bcbfff700 1 --2- 172.21.15.146:0/3353067847 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bcc130ce0 0x7f3bcc131130 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3bc400d180 tx=0x7f3bc400d490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=238c8c1c32537bdb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.176+0000 7f3bca7fc700 1 -- 172.21.15.146:0/3353067847 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4010070 con 0x7f3bcc130ce0 2023-10-03T10:17:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.176+0000 7f3bca7fc700 1 -- 172.21.15.146:0/3353067847 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc400dd00 con 0x7f3bcc130ce0 2023-10-03T10:17:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.176+0000 7f3bca7fc700 1 -- 172.21.15.146:0/3353067847 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc400b310 con 0x7f3bcc130ce0 2023-10-03T10:17:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.176+0000 7f3bd1fb9700 1 -- 172.21.15.146:0/3353067847 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bcc130ce0 msgr2=0x7f3bcc131130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.176+0000 7f3bd1fb9700 1 --2- 172.21.15.146:0/3353067847 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bcc130ce0 0x7f3bcc131130 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3bc400d180 tx=0x7f3bc400d490 comp rx=0 tx=0).stop 2023-10-03T10:17:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.177+0000 7f3bd1fb9700 1 -- 172.21.15.146:0/3353067847 shutdown_connections 2023-10-03T10:17:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.177+0000 7f3bd1fb9700 1 --2- 172.21.15.146:0/3353067847 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bcc130ce0 0x7f3bcc131130 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.177+0000 7f3bd1fb9700 1 --2- 172.21.15.146:0/3353067847 >> v2:172.21.15.146:3300/0 conn(0x7f3bcc09d860 0x7f3bcc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.177+0000 7f3bd1fb9700 1 --2- 172.21.15.146:0/3353067847 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bcc09e170 0x7f3bcc1307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.177+0000 7f3bd1fb9700 1 -- 172.21.15.146:0/3353067847 >> 172.21.15.146:0/3353067847 conn(0x7f3bcc099c40 msgr2=0x7f3bcc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.177+0000 7f3bd1fb9700 1 -- 172.21.15.146:0/3353067847 shutdown_connections 2023-10-03T10:17:55.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.177+0000 7f3bd1fb9700 1 -- 172.21.15.146:0/3353067847 wait complete. 2023-10-03T10:17:55.181 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:55.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.177+0000 7f3bd1fb9700 1 Processor -- start 2023-10-03T10:17:55.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.178+0000 7f3bd1fb9700 1 -- start start 2023-10-03T10:17:55.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.178+0000 7f3bd1fb9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bcc09d860 0x7f3bcc11f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.178+0000 7f3bd1fb9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bcc09e170 0x7f3bcc11fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.178+0000 7f3bd1fb9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bcc130ce0 0x7f3bcc1200c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.178+0000 7f3bd1fb9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc09c8b0 con 0x7f3bcc130ce0 2023-10-03T10:17:55.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.178+0000 7f3bd1fb9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc122e80 con 0x7f3bcc09e170 2023-10-03T10:17:55.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.178+0000 7f3bd1fb9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc121360 con 0x7f3bcc09d860 2023-10-03T10:17:55.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.178+0000 7f3bcaffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bcc09e170 0x7f3bcc11fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.178+0000 7f3bcbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bcc130ce0 0x7f3bcc1200c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.178+0000 7f3bcaffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bcc09e170 0x7f3bcc11fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52516/0 (socket says 172.21.15.146:52516) 2023-10-03T10:17:55.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.178+0000 7f3bcb7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bcc09d860 0x7f3bcc11f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.178+0000 7f3bcbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bcc130ce0 0x7f3bcc1200c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39050/0 (socket says 172.21.15.146:39050) 2023-10-03T10:17:55.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.178+0000 7f3bcaffd700 1 -- 172.21.15.146:0/1684821668 learned_addr learned my addr 172.21.15.146:0/1684821668 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:55.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.178+0000 7f3bcbfff700 1 -- 172.21.15.146:0/1684821668 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bcc09d860 msgr2=0x7f3bcc11f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.178+0000 7f3bcbfff700 1 --2- 172.21.15.146:0/1684821668 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bcc09d860 0x7f3bcc11f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.178+0000 7f3bcbfff700 1 -- 172.21.15.146:0/1684821668 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bcc09e170 msgr2=0x7f3bcc11fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.178+0000 7f3bcbfff700 1 --2- 172.21.15.146:0/1684821668 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bcc09e170 0x7f3bcc11fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.178+0000 7f3bcbfff700 1 -- 172.21.15.146:0/1684821668 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc0094a0 con 0x7f3bcc130ce0 2023-10-03T10:17:55.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.178+0000 7f3bcaffd700 1 --2- 172.21.15.146:0/1684821668 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bcc09e170 0x7f3bcc11fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.179+0000 7f3bcbfff700 1 --2- 172.21.15.146:0/1684821668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bcc130ce0 0x7f3bcc1200c0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4017000 tx=0x7f3bc4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.179+0000 7f3bb3fff700 1 -- 172.21.15.146:0/1684821668 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4003e50 con 0x7f3bcc130ce0 2023-10-03T10:17:55.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.179+0000 7f3bb3fff700 1 -- 172.21.15.146:0/1684821668 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc400b4c0 con 0x7f3bcc130ce0 2023-10-03T10:17:55.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.179+0000 7f3bd1fb9700 1 -- 172.21.15.146:0/1684821668 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc00094a0 con 0x7f3bcc130ce0 2023-10-03T10:17:55.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.179+0000 7f3bb3fff700 1 -- 172.21.15.146:0/1684821668 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4009a70 con 0x7f3bcc130ce0 2023-10-03T10:17:55.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.179+0000 7f3bd1fb9700 1 -- 172.21.15.146:0/1684821668 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc400bd40 con 0x7f3bcc130ce0 2023-10-03T10:17:55.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.179+0000 7f3bb3fff700 1 -- 172.21.15.146:0/1684821668 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3bc4009bd0 con 0x7f3bcc130ce0 2023-10-03T10:17:55.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.180+0000 7f3bb3fff700 1 -- 172.21.15.146:0/1684821668 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3bc40409f0 con 0x7f3bcc130ce0 2023-10-03T10:17:55.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.180+0000 7f3bd1fb9700 1 -- 172.21.15.146:0/1684821668 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bcc04f2a0 con 0x7f3bcc130ce0 2023-10-03T10:17:55.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.184+0000 7f3bb3fff700 1 -- 172.21.15.146:0/1684821668 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3bc401d430 con 0x7f3bcc130ce0 2023-10-03T10:17:55.240 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:55.277 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:55.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.314+0000 7f7d53009700 1 Processor -- start 2023-10-03T10:17:55.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.315+0000 7f7d53009700 1 -- start start 2023-10-03T10:17:55.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.315+0000 7f7d53009700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d4c133450 0x7f7d4c135830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.315+0000 7f7d53009700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7d4c135d70 0x7f7d4c138150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.315+0000 7f7d53009700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4c09b720 con 0x7f7d4c09e800 2023-10-03T10:17:55.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.315+0000 7f7d53009700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c09b180 con 0x7f7d4c135d70 2023-10-03T10:17:55.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.315+0000 7f7d53009700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c09ebd0 con 0x7f7d4c133450 2023-10-03T10:17:55.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.315+0000 7f7d50da5700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7d4c09e800 0x7f7d4c12d4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35592/0 (socket says 172.21.15.146:35592) 2023-10-03T10:17:55.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.315+0000 7f7d50da5700 1 -- 172.21.15.146:0/358209679 learned_addr learned my addr 172.21.15.146:0/358209679 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:55.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.316+0000 7f7d4bfff700 1 --2- 172.21.15.146:0/358209679 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d4c133450 0x7f7d4c135830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.316+0000 7f7d515a6700 1 --2- 172.21.15.146:0/358209679 >> v2:172.21.15.146:3300/0 conn(0x7f7d4c135d70 0x7f7d4c138150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.316+0000 7f7d4b7fe700 1 -- 172.21.15.146:0/358209679 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2037187364 0 0) 0x7f7d4c09b720 con 0x7f7d4c09e800 2023-10-03T10:17:55.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.316+0000 7f7d4b7fe700 1 -- 172.21.15.146:0/358209679 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d3c0035b0 con 0x7f7d4c09e800 2023-10-03T10:17:55.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.316+0000 7f7d515a6700 1 -- 172.21.15.146:0/358209679 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d4c133450 msgr2=0x7f7d4c135830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:55.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.316+0000 7f7d515a6700 1 --2- 172.21.15.146:0/358209679 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d4c133450 0x7f7d4c135830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.316+0000 7f7d515a6700 1 -- 172.21.15.146:0/358209679 >> v1:172.21.15.146:6789/0 conn(0x7f7d4c09e800 legacy=0x7f7d4c12d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.316+0000 7f7d515a6700 1 -- 172.21.15.146:0/358209679 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c09b440 con 0x7f7d4c135d70 2023-10-03T10:17:55.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.316+0000 7f7d515a6700 1 --2- 172.21.15.146:0/358209679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d4c135d70 0x7f7d4c138150 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009d90 tx=0x7f7d4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ffbb0f90a523dad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.316+0000 7f7d4b7fe700 1 -- 172.21.15.146:0/358209679 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400e070 con 0x7f7d4c135d70 2023-10-03T10:17:55.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.317+0000 7f7d4b7fe700 1 -- 172.21.15.146:0/358209679 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4400bb20 con 0x7f7d4c135d70 2023-10-03T10:17:55.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.317+0000 7f7d4b7fe700 1 -- 172.21.15.146:0/358209679 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400be90 con 0x7f7d4c135d70 2023-10-03T10:17:55.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.317+0000 7f7d53009700 1 -- 172.21.15.146:0/358209679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d4c135d70 msgr2=0x7f7d4c138150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.317+0000 7f7d53009700 1 --2- 172.21.15.146:0/358209679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d4c135d70 0x7f7d4c138150 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009d90 tx=0x7f7d4400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:55.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.318+0000 7f7d53009700 1 -- 172.21.15.146:0/358209679 shutdown_connections 2023-10-03T10:17:55.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.318+0000 7f7d53009700 1 --2- 172.21.15.146:0/358209679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d4c135d70 0x7f7d4c138150 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.318+0000 7f7d53009700 1 --2- 172.21.15.146:0/358209679 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d4c133450 0x7f7d4c135830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.318+0000 7f7d53009700 1 -- 172.21.15.146:0/358209679 >> 172.21.15.146:0/358209679 conn(0x7f7d4c0a2ef0 msgr2=0x7f7d4c0a32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.318+0000 7f7d53009700 1 -- 172.21.15.146:0/358209679 shutdown_connections 2023-10-03T10:17:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.318+0000 7f7d53009700 1 -- 172.21.15.146:0/358209679 wait complete. 2023-10-03T10:17:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.319+0000 7f7d53009700 1 Processor -- start 2023-10-03T10:17:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.319+0000 7f7d53009700 1 -- start start 2023-10-03T10:17:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.320+0000 7f7d53009700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d4c09e800 0x7f7d4c129640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.320+0000 7f7d53009700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d4c133450 0x7f7d4c129b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.320+0000 7f7d53009700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d4c135d70 0x7f7d4c12a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.320+0000 7f7d53009700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c070250 con 0x7f7d4c135d70 2023-10-03T10:17:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.320+0000 7f7d53009700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c06eb60 con 0x7f7d4c133450 2023-10-03T10:17:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.320+0000 7f7d53009700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c12cad0 con 0x7f7d4c09e800 2023-10-03T10:17:55.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.320+0000 7f7d50da5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d4c09e800 0x7f7d4c129640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.320+0000 7f7d50da5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d4c09e800 0x7f7d4c129640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59000/0 (socket says 172.21.15.146:59000) 2023-10-03T10:17:55.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.320+0000 7f7d50da5700 1 -- 172.21.15.146:0/2488008215 learned_addr learned my addr 172.21.15.146:0/2488008215 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:55.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.320+0000 7f7d515a6700 1 --2- 172.21.15.146:0/2488008215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d4c135d70 0x7f7d4c12a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.320+0000 7f7d4bfff700 1 --2- 172.21.15.146:0/2488008215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d4c133450 0x7f7d4c129b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.320+0000 7f7d4bfff700 1 -- 172.21.15.146:0/2488008215 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d4c09e800 msgr2=0x7f7d4c129640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.320+0000 7f7d4bfff700 1 --2- 172.21.15.146:0/2488008215 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d4c09e800 0x7f7d4c129640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.320+0000 7f7d4bfff700 1 -- 172.21.15.146:0/2488008215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d4c135d70 msgr2=0x7f7d4c12a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.320+0000 7f7d4bfff700 1 --2- 172.21.15.146:0/2488008215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d4c135d70 0x7f7d4c12a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.320+0000 7f7d4bfff700 1 -- 172.21.15.146:0/2488008215 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d44009a70 con 0x7f7d4c133450 2023-10-03T10:17:55.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.320+0000 7f7d50da5700 1 --2- 172.21.15.146:0/2488008215 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d4c09e800 0x7f7d4c129640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.321+0000 7f7d4bfff700 1 --2- 172.21.15.146:0/2488008215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d4c133450 0x7f7d4c129b80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f7d3800e8d0 tx=0x7f7d3800ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.321+0000 7f7d497fa700 1 -- 172.21.15.146:0/2488008215 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38013680 con 0x7f7d4c133450 2023-10-03T10:17:55.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.321+0000 7f7d497fa700 1 -- 172.21.15.146:0/2488008215 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d380137e0 con 0x7f7d4c133450 2023-10-03T10:17:55.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.321+0000 7f7d53009700 1 -- 172.21.15.146:0/2488008215 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4c130d20 con 0x7f7d4c133450 2023-10-03T10:17:55.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.321+0000 7f7d497fa700 1 -- 172.21.15.146:0/2488008215 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38013b50 con 0x7f7d4c133450 2023-10-03T10:17:55.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.321+0000 7f7d53009700 1 -- 172.21.15.146:0/2488008215 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c070bc0 con 0x7f7d4c133450 2023-10-03T10:17:55.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.322+0000 7f7d497fa700 1 -- 172.21.15.146:0/2488008215 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d38013cb0 con 0x7f7d4c133450 2023-10-03T10:17:55.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.322+0000 7f7d53009700 1 -- 172.21.15.146:0/2488008215 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d2c0052e0 con 0x7f7d4c133450 2023-10-03T10:17:55.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.323+0000 7f7d497fa700 1 -- 172.21.15.146:0/2488008215 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7d3803fb40 con 0x7f7d4c133450 2023-10-03T10:17:55.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.327+0000 7f7d497fa700 1 -- 172.21.15.146:0/2488008215 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d3801adc0 con 0x7f7d4c133450 2023-10-03T10:17:55.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.373+0000 7f9b22357700 1 Processor -- start 2023-10-03T10:17:55.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.373+0000 7f9b22357700 1 -- start start 2023-10-03T10:17:55.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.374+0000 7f9b22357700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b1c06a770 0x7f9b1c1349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.374+0000 7f9b22357700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9b1c134f00 0x7f9b1c09d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.374+0000 7f9b22357700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b1c09dea0 0x7f9b1c09e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.374+0000 7f9b22357700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1c06b2e0 con 0x7f9b1c134f00 2023-10-03T10:17:55.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.374+0000 7f9b22357700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c09eca0 con 0x7f9b1c06a770 2023-10-03T10:17:55.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.374+0000 7f9b22357700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c09f720 con 0x7f9b1c09dea0 2023-10-03T10:17:55.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.374+0000 7f9b1bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b1c06a770 0x7f9b1c1349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.374+0000 7f9b208f4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b1c09dea0 0x7f9b1c09e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.374+0000 7f9b1b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9b1c134f00 0x7f9b1c09d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.374+0000 7f9b1bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b1c06a770 0x7f9b1c1349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52552/0 (socket says 172.21.15.146:52552) 2023-10-03T10:17:55.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.374+0000 7f9b1bfff700 1 -- 172.21.15.146:0/2856965176 learned_addr learned my addr 172.21.15.146:0/2856965176 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:55.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.374+0000 7f9b1bfff700 1 -- 172.21.15.146:0/2856965176 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b1c09dea0 msgr2=0x7f9b1c09e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:55.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.374+0000 7f9b1bfff700 1 --2- 172.21.15.146:0/2856965176 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b1c09dea0 0x7f9b1c09e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.374+0000 7f9b1bfff700 1 -- 172.21.15.146:0/2856965176 >> v2:172.21.15.146:3300/0 conn(0x7f9b1c134f00 msgr2=0x7f9b1c09d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:55.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.374+0000 7f9b1bfff700 1 --2- 172.21.15.146:0/2856965176 >> v2:172.21.15.146:3300/0 conn(0x7f9b1c134f00 0x7f9b1c09d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.374+0000 7f9b1bfff700 1 -- 172.21.15.146:0/2856965176 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c06b480 con 0x7f9b1c06a770 2023-10-03T10:17:55.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.374+0000 7f9b1b7fe700 1 --2- 172.21.15.146:0/2856965176 >> v2:172.21.15.146:3300/0 conn(0x7f9b1c134f00 0x7f9b1c09d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.375+0000 7f9b1bfff700 1 --2- 172.21.15.146:0/2856965176 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b1c06a770 0x7f9b1c1349c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0098f0 tx=0x7f9b0c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bae85d5d6ef4a270 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.375+0000 7f9b1affd700 1 -- 172.21.15.146:0/2856965176 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c011830 con 0x7f9b1c06a770 2023-10-03T10:17:55.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.375+0000 7f9b1affd700 1 -- 172.21.15.146:0/2856965176 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0c011990 con 0x7f9b1c06a770 2023-10-03T10:17:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.375+0000 7f9b1affd700 1 -- 172.21.15.146:0/2856965176 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c011d20 con 0x7f9b1c06a770 2023-10-03T10:17:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.376+0000 7f9b22357700 1 -- 172.21.15.146:0/2856965176 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b1c06a770 msgr2=0x7f9b1c1349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.376+0000 7f9b22357700 1 --2- 172.21.15.146:0/2856965176 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b1c06a770 0x7f9b1c1349c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0098f0 tx=0x7f9b0c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.376+0000 7f9b22357700 1 -- 172.21.15.146:0/2856965176 shutdown_connections 2023-10-03T10:17:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.376+0000 7f9b22357700 1 --2- 172.21.15.146:0/2856965176 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b1c06a770 0x7f9b1c1349c0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.376+0000 7f9b22357700 1 --2- 172.21.15.146:0/2856965176 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b1c09dea0 0x7f9b1c09e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.376+0000 7f9b22357700 1 --2- 172.21.15.146:0/2856965176 >> v2:172.21.15.146:3300/0 conn(0x7f9b1c134f00 0x7f9b1c09d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.376+0000 7f9b22357700 1 -- 172.21.15.146:0/2856965176 >> 172.21.15.146:0/2856965176 conn(0x7f9b1c099c40 msgr2=0x7f9b1c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.376+0000 7f9b22357700 1 -- 172.21.15.146:0/2856965176 shutdown_connections 2023-10-03T10:17:55.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.376+0000 7f9b22357700 1 -- 172.21.15.146:0/2856965176 wait complete. 2023-10-03T10:17:55.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.377+0000 7f9b22357700 1 Processor -- start 2023-10-03T10:17:55.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.377+0000 7f9b22357700 1 -- start start 2023-10-03T10:17:55.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.378+0000 7f9b22357700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b1c06a770 0x7f9b1c11a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.378+0000 7f9b22357700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b1c09dea0 0x7f9b1c11ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.378+0000 7f9b22357700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b1c134f00 0x7f9b1c11b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.378+0000 7f9b22357700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c11c5f0 con 0x7f9b1c134f00 2023-10-03T10:17:55.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.378+0000 7f9b22357700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c126e00 con 0x7f9b1c06a770 2023-10-03T10:17:55.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.378+0000 7f9b22357700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c11bab0 con 0x7f9b1c09dea0 2023-10-03T10:17:55.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.378+0000 7f9b1b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b1c09dea0 0x7f9b1c11ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.378+0000 7f9b1b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b1c09dea0 0x7f9b1c11ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59030/0 (socket says 172.21.15.146:59030) 2023-10-03T10:17:55.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.378+0000 7f9b1b7fe700 1 -- 172.21.15.146:0/524428286 learned_addr learned my addr 172.21.15.146:0/524428286 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:55.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.378+0000 7f9b208f4700 1 --2- 172.21.15.146:0/524428286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b1c134f00 0x7f9b1c11b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.378+0000 7f9b1bfff700 1 --2- 172.21.15.146:0/524428286 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b1c06a770 0x7f9b1c11a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.378+0000 7f9b1b7fe700 1 -- 172.21.15.146:0/524428286 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b1c06a770 msgr2=0x7f9b1c11a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.378+0000 7f9b1b7fe700 1 --2- 172.21.15.146:0/524428286 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b1c06a770 0x7f9b1c11a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.378+0000 7f9b1b7fe700 1 -- 172.21.15.146:0/524428286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b1c134f00 msgr2=0x7f9b1c11b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.378+0000 7f9b1b7fe700 1 --2- 172.21.15.146:0/524428286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b1c134f00 0x7f9b1c11b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.378+0000 7f9b1b7fe700 1 -- 172.21.15.146:0/524428286 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b100094a0 con 0x7f9b1c09dea0 2023-10-03T10:17:55.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.378+0000 7f9b1b7fe700 1 --2- 172.21.15.146:0/524428286 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b1c09dea0 0x7f9b1c11ab90 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000ebe0 tx=0x7f9b1000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.379+0000 7f9b18ff9700 1 -- 172.21.15.146:0/524428286 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1000c8b0 con 0x7f9b1c09dea0 2023-10-03T10:17:55.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.379+0000 7f9b18ff9700 1 -- 172.21.15.146:0/524428286 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1000ca10 con 0x7f9b1c09dea0 2023-10-03T10:17:55.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.379+0000 7f9b22357700 1 -- 172.21.15.146:0/524428286 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0c009550 con 0x7f9b1c09dea0 2023-10-03T10:17:55.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.379+0000 7f9b18ff9700 1 -- 172.21.15.146:0/524428286 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1000cda0 con 0x7f9b1c09dea0 2023-10-03T10:17:55.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.379+0000 7f9b22357700 1 -- 172.21.15.146:0/524428286 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1c11d3f0 con 0x7f9b1c09dea0 2023-10-03T10:17:55.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.380+0000 7f9b22357700 1 -- 172.21.15.146:0/524428286 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b1c04f2a0 con 0x7f9b1c09dea0 2023-10-03T10:17:55.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.380+0000 7f9b18ff9700 1 -- 172.21.15.146:0/524428286 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b10013470 con 0x7f9b1c09dea0 2023-10-03T10:17:55.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.389+0000 7f9b18ff9700 1 -- 172.21.15.146:0/524428286 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9b10011350 con 0x7f9b1c09dea0 2023-10-03T10:17:55.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.389+0000 7f3bd1fb9700 1 -- 172.21.15.146:0/1684821668 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3bcc131270 con 0x7f3bcc130ce0 2023-10-03T10:17:55.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.389+0000 7f9b18ff9700 1 -- 172.21.15.146:0/524428286 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b10044060 con 0x7f9b1c09dea0 2023-10-03T10:17:55.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.390+0000 7f3bb3fff700 1 -- 172.21.15.146:0/1684821668 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3bc4034090 con 0x7f3bcc130ce0 2023-10-03T10:17:55.390 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:55.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.393+0000 7f3bd1fb9700 1 -- 172.21.15.146:0/1684821668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bcc130ce0 msgr2=0x7f3bcc1200c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.393+0000 7f3bd1fb9700 1 --2- 172.21.15.146:0/1684821668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bcc130ce0 0x7f3bcc1200c0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4017000 tx=0x7f3bc4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.394+0000 7f3bd1fb9700 1 -- 172.21.15.146:0/1684821668 shutdown_connections 2023-10-03T10:17:55.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.394+0000 7f3bd1fb9700 1 --2- 172.21.15.146:0/1684821668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bcc130ce0 0x7f3bcc1200c0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.394+0000 7f3bd1fb9700 1 --2- 172.21.15.146:0/1684821668 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3bcc09d860 0x7f3bcc11f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.394+0000 7f3bd1fb9700 1 --2- 172.21.15.146:0/1684821668 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bcc09e170 0x7f3bcc11fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.394+0000 7f3bd1fb9700 1 -- 172.21.15.146:0/1684821668 >> 172.21.15.146:0/1684821668 conn(0x7f3bcc099c40 msgr2=0x7f3bcc12df40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.394+0000 7f3bd1fb9700 1 -- 172.21.15.146:0/1684821668 shutdown_connections 2023-10-03T10:17:55.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.394+0000 7f3bd1fb9700 1 -- 172.21.15.146:0/1684821668 wait complete. 2023-10-03T10:17:55.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:55.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.456+0000 7fd01cbb1700 1 Processor -- start 2023-10-03T10:17:55.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.456+0000 7fd01cbb1700 1 -- start start 2023-10-03T10:17:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.456+0000 7fd01cbb1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd01809e870 0x7fd01809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.456+0000 7fd01cbb1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd018134330 0x7fd01813be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.456+0000 7fd01cbb1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01809fa00 con 0x7fd01809f180 2023-10-03T10:17:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.456+0000 7fd01cbb1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0180a0370 con 0x7fd018134330 2023-10-03T10:17:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.456+0000 7fd01cbb1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd01806bec0 con 0x7fd01809e870 2023-10-03T10:17:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.457+0000 7fd015d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd01809f180 0x7fd018133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35600/0 (socket says 172.21.15.146:35600) 2023-10-03T10:17:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.457+0000 7fd016d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd018134330 0x7fd01813be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.457+0000 7fd015d9b700 1 -- 172.21.15.146:0/3337593175 learned_addr learned my addr 172.21.15.146:0/3337593175 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.457+0000 7fd01659c700 1 --2- 172.21.15.146:0/3337593175 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd01809e870 0x7fd01809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.457+0000 7fd016d9d700 1 -- 172.21.15.146:0/3337593175 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd01809e870 msgr2=0x7fd01809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:55.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.457+0000 7fd016d9d700 1 --2- 172.21.15.146:0/3337593175 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd01809e870 0x7fd01809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.457+0000 7fd016d9d700 1 -- 172.21.15.146:0/3337593175 >> v1:172.21.15.146:6789/0 conn(0x7fd01809f180 legacy=0x7fd018133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.457+0000 7fd016d9d700 1 -- 172.21.15.146:0/3337593175 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01809ada0 con 0x7fd018134330 2023-10-03T10:17:55.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.457+0000 7fd01559a700 1 -- 172.21.15.146:0/3337593175 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304678450 0 0) 0x7fd01809fa00 con 0x7fd01809f180 2023-10-03T10:17:55.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.457+0000 7fd016d9d700 1 --2- 172.21.15.146:0/3337593175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd018134330 0x7fd01813be80 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fd010009d90 tx=0x7fd01000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352b8d41a7e01345 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.457+0000 7fd01559a700 1 -- 172.21.15.146:0/3337593175 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01000e070 con 0x7fd018134330 2023-10-03T10:17:55.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.457+0000 7fd01559a700 1 -- 172.21.15.146:0/3337593175 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01000bb20 con 0x7fd018134330 2023-10-03T10:17:55.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.457+0000 7fd01559a700 1 -- 172.21.15.146:0/3337593175 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd010012430 con 0x7fd018134330 2023-10-03T10:17:55.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.458+0000 7fd01cbb1700 1 -- 172.21.15.146:0/3337593175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd018134330 msgr2=0x7fd01813be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.458+0000 7fd01cbb1700 1 --2- 172.21.15.146:0/3337593175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd018134330 0x7fd01813be80 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fd010009d90 tx=0x7fd01000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:55.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.458+0000 7fd01cbb1700 1 -- 172.21.15.146:0/3337593175 shutdown_connections 2023-10-03T10:17:55.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.458+0000 7fd01cbb1700 1 --2- 172.21.15.146:0/3337593175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd018134330 0x7fd01813be80 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.458+0000 7fd01cbb1700 1 --2- 172.21.15.146:0/3337593175 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd01809e870 0x7fd01809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.458+0000 7fd01cbb1700 1 -- 172.21.15.146:0/3337593175 >> 172.21.15.146:0/3337593175 conn(0x7fd0180a4430 msgr2=0x7fd0180a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.458+0000 7fd01cbb1700 1 -- 172.21.15.146:0/3337593175 shutdown_connections 2023-10-03T10:17:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.458+0000 7fd01cbb1700 1 -- 172.21.15.146:0/3337593175 wait complete. 2023-10-03T10:17:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.459+0000 7fd01cbb1700 1 Processor -- start 2023-10-03T10:17:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.459+0000 7fd01cbb1700 1 -- start start 2023-10-03T10:17:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.459+0000 7fd01cbb1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd01809e870 0x7fd018122770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.459+0000 7fd01cbb1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd01809f180 0x7fd018122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.459+0000 7fd01cbb1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd018134330 0x7fd0181231f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.459+0000 7fd01cbb1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01806d010 con 0x7fd01809f180 2023-10-03T10:17:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.459+0000 7fd01cbb1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd018123bb0 con 0x7fd018134330 2023-10-03T10:17:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.459+0000 7fd01cbb1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd018125fb0 con 0x7fd01809e870 2023-10-03T10:17:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.459+0000 7fd015d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd01809f180 0x7fd018122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.460+0000 7fd015d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd01809f180 0x7fd018122cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39104/0 (socket says 172.21.15.146:39104) 2023-10-03T10:17:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.460+0000 7fd015d9b700 1 -- 172.21.15.146:0/86243748 learned_addr learned my addr 172.21.15.146:0/86243748 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.460+0000 7fd01659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd01809e870 0x7fd018122770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.460+0000 7fd016d9d700 1 --2- 172.21.15.146:0/86243748 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd018134330 0x7fd0181231f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.460+0000 7fd015d9b700 1 -- 172.21.15.146:0/86243748 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd01809e870 msgr2=0x7fd018122770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.460+0000 7fd015d9b700 1 --2- 172.21.15.146:0/86243748 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd01809e870 0x7fd018122770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.460+0000 7fd015d9b700 1 -- 172.21.15.146:0/86243748 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd018134330 msgr2=0x7fd0181231f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.460+0000 7fd015d9b700 1 --2- 172.21.15.146:0/86243748 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd018134330 0x7fd0181231f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.460+0000 7fd015d9b700 1 -- 172.21.15.146:0/86243748 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd010009a70 con 0x7fd01809f180 2023-10-03T10:17:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.460+0000 7fd015d9b700 1 --2- 172.21.15.146:0/86243748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd01809f180 0x7fd018122cb0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fd00c001eb0 tx=0x7fd00c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.460+0000 7fd006ffd700 1 -- 172.21.15.146:0/86243748 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c004c80 con 0x7fd01809f180 2023-10-03T10:17:55.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.460+0000 7fd006ffd700 1 -- 172.21.15.146:0/86243748 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00c004de0 con 0x7fd01809f180 2023-10-03T10:17:55.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.460+0000 7fd01cbb1700 1 -- 172.21.15.146:0/86243748 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd018124ba0 con 0x7fd01809f180 2023-10-03T10:17:55.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.460+0000 7fd006ffd700 1 -- 172.21.15.146:0/86243748 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c007310 con 0x7fd01809f180 2023-10-03T10:17:55.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.460+0000 7fd01cbb1700 1 -- 172.21.15.146:0/86243748 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0181336c0 con 0x7fd01809f180 2023-10-03T10:17:55.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.461+0000 7fd006ffd700 1 -- 172.21.15.146:0/86243748 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd00c007470 con 0x7fd01809f180 2023-10-03T10:17:55.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.461+0000 7fd01cbb1700 1 -- 172.21.15.146:0/86243748 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd01804f2a0 con 0x7fd01809f180 2023-10-03T10:17:55.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.461+0000 7fd006ffd700 1 -- 172.21.15.146:0/86243748 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd00c03f2b0 con 0x7fd01809f180 2023-10-03T10:17:55.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.466+0000 7fd006ffd700 1 -- 172.21.15.146:0/86243748 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd00c0133c0 con 0x7fd01809f180 2023-10-03T10:17:55.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.579+0000 7f7d53009700 1 -- 172.21.15.146:0/2488008215 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7d2c005590 con 0x7f7d4c133450 2023-10-03T10:17:55.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.579+0000 7f7d497fa700 1 -- 172.21.15.146:0/2488008215 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7d3803fe60 con 0x7f7d4c133450 2023-10-03T10:17:55.579 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:55.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.581+0000 7f7d53009700 1 -- 172.21.15.146:0/2488008215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d4c133450 msgr2=0x7f7d4c129b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.581+0000 7f7d53009700 1 --2- 172.21.15.146:0/2488008215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d4c133450 0x7f7d4c129b80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f7d3800e8d0 tx=0x7f7d3800ebe0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.582+0000 7f7d53009700 1 -- 172.21.15.146:0/2488008215 shutdown_connections 2023-10-03T10:17:55.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.582+0000 7f7d53009700 1 --2- 172.21.15.146:0/2488008215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d4c135d70 0x7f7d4c12a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.582+0000 7f7d53009700 1 --2- 172.21.15.146:0/2488008215 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d4c09e800 0x7f7d4c129640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.582+0000 7f7d53009700 1 --2- 172.21.15.146:0/2488008215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d4c133450 0x7f7d4c129b80 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.582+0000 7f7d53009700 1 -- 172.21.15.146:0/2488008215 >> 172.21.15.146:0/2488008215 conn(0x7f7d4c0a2ef0 msgr2=0x7f7d4c09c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.582+0000 7f7d53009700 1 -- 172.21.15.146:0/2488008215 shutdown_connections 2023-10-03T10:17:55.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.582+0000 7f7d53009700 1 -- 172.21.15.146:0/2488008215 wait complete. 2023-10-03T10:17:55.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.588+0000 7f9b22357700 1 -- 172.21.15.146:0/524428286 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9b1c11ca50 con 0x7f9b1c09dea0 2023-10-03T10:17:55.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.588+0000 7f9b18ff9700 1 -- 172.21.15.146:0/524428286 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9b10017020 con 0x7f9b1c09dea0 2023-10-03T10:17:55.588 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:55.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.590+0000 7f9b22357700 1 -- 172.21.15.146:0/524428286 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b1c09dea0 msgr2=0x7f9b1c11ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.590+0000 7f9b22357700 1 --2- 172.21.15.146:0/524428286 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b1c09dea0 0x7f9b1c11ab90 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000ebe0 tx=0x7f9b1000eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.590+0000 7f9b22357700 1 -- 172.21.15.146:0/524428286 shutdown_connections 2023-10-03T10:17:55.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.590+0000 7f9b22357700 1 --2- 172.21.15.146:0/524428286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b1c134f00 0x7f9b1c11b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.590+0000 7f9b22357700 1 --2- 172.21.15.146:0/524428286 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b1c06a770 0x7f9b1c11a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.590+0000 7f9b22357700 1 --2- 172.21.15.146:0/524428286 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9b1c09dea0 0x7f9b1c11ab90 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.590+0000 7f9b22357700 1 -- 172.21.15.146:0/524428286 >> 172.21.15.146:0/524428286 conn(0x7f9b1c099c40 msgr2=0x7f9b1c09c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.591+0000 7f9b22357700 1 -- 172.21.15.146:0/524428286 shutdown_connections 2023-10-03T10:17:55.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.591+0000 7f9b22357700 1 -- 172.21.15.146:0/524428286 wait complete. 2023-10-03T10:17:55.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:55.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:55.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.658+0000 7fd01cbb1700 1 -- 172.21.15.146:0/86243748 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd01806c9d0 con 0x7fd01809f180 2023-10-03T10:17:55.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.658+0000 7fd006ffd700 1 -- 172.21.15.146:0/86243748 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd00c0102c0 con 0x7fd01809f180 2023-10-03T10:17:55.658 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:55.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.660+0000 7fd01cbb1700 1 -- 172.21.15.146:0/86243748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd01809f180 msgr2=0x7fd018122cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.660+0000 7fd01cbb1700 1 --2- 172.21.15.146:0/86243748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd01809f180 0x7fd018122cb0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fd00c001eb0 tx=0x7fd00c00c800 comp rx=0 tx=0).stop 2023-10-03T10:17:55.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.661+0000 7fd01cbb1700 1 -- 172.21.15.146:0/86243748 shutdown_connections 2023-10-03T10:17:55.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.661+0000 7fd01cbb1700 1 --2- 172.21.15.146:0/86243748 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd018134330 0x7fd0181231f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.661+0000 7fd01cbb1700 1 --2- 172.21.15.146:0/86243748 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd01809e870 0x7fd018122770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.661+0000 7fd01cbb1700 1 --2- 172.21.15.146:0/86243748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd01809f180 0x7fd018122cb0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.661+0000 7fd01cbb1700 1 -- 172.21.15.146:0/86243748 >> 172.21.15.146:0/86243748 conn(0x7fd0180a4430 msgr2=0x7fd018070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.661+0000 7fd01cbb1700 1 -- 172.21.15.146:0/86243748 shutdown_connections 2023-10-03T10:17:55.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:55.661+0000 7fd01cbb1700 1 -- 172.21.15.146:0/86243748 wait complete. 2023-10-03T10:17:55.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:56.407 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:56.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.540+0000 7f2c9c508700 1 Processor -- start 2023-10-03T10:17:56.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.540+0000 7f2c9c508700 1 -- start start 2023-10-03T10:17:56.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.541+0000 7f2c9c508700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c94136950 0x7f2c94138d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.541+0000 7f2c9c508700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c94139270 0x7f2c9413b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.541+0000 7f2c9c508700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c94133640 con 0x7f2c94133a70 2023-10-03T10:17:56.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.541+0000 7f2c9c508700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940a1d50 con 0x7f2c94139270 2023-10-03T10:17:56.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.541+0000 7f2c9c508700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c94134550 con 0x7f2c94136950 2023-10-03T10:17:56.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.541+0000 7f2c9aaa5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c94139270 0x7f2c9413b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.541+0000 7f2c99aa3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c94136950 0x7f2c94138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.541+0000 7f2c9a2a4700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2c94133a70 0x7f2c94133e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35608/0 (socket says 172.21.15.146:35608) 2023-10-03T10:17:56.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.541+0000 7f2c9a2a4700 1 -- 172.21.15.146:0/964458309 learned_addr learned my addr 172.21.15.146:0/964458309 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:56.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.541+0000 7f2c992a2700 1 -- 172.21.15.146:0/964458309 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022204005 0 0) 0x7f2c94133640 con 0x7f2c94133a70 2023-10-03T10:17:56.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.541+0000 7f2c992a2700 1 -- 172.21.15.146:0/964458309 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c800035b0 con 0x7f2c94133a70 2023-10-03T10:17:56.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.541+0000 7f2c9aaa5700 1 -- 172.21.15.146:0/964458309 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c94136950 msgr2=0x7f2c94138d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:56.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.541+0000 7f2c9aaa5700 1 --2- 172.21.15.146:0/964458309 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c94136950 0x7f2c94138d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.541+0000 7f2c9aaa5700 1 -- 172.21.15.146:0/964458309 >> v1:172.21.15.146:6789/0 conn(0x7f2c94133a70 legacy=0x7f2c94133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.542+0000 7f2c9aaa5700 1 -- 172.21.15.146:0/964458309 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c9409b620 con 0x7f2c94139270 2023-10-03T10:17:56.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.542+0000 7f2c99aa3700 1 --2- 172.21.15.146:0/964458309 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c94136950 0x7f2c94138d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.542+0000 7f2c9aaa5700 1 --2- 172.21.15.146:0/964458309 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c94139270 0x7f2c9413b650 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c009dc0 tx=0x7f2c8c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3515514c40c45f5d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.542+0000 7f2c992a2700 1 -- 172.21.15.146:0/964458309 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c00e070 con 0x7f2c94139270 2023-10-03T10:17:56.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.542+0000 7f2c992a2700 1 -- 172.21.15.146:0/964458309 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8c00bb20 con 0x7f2c94139270 2023-10-03T10:17:56.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.542+0000 7f2c992a2700 1 -- 172.21.15.146:0/964458309 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c012430 con 0x7f2c94139270 2023-10-03T10:17:56.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.542+0000 7f2c9c508700 1 -- 172.21.15.146:0/964458309 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c94139270 msgr2=0x7f2c9413b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.542+0000 7f2c9c508700 1 --2- 172.21.15.146:0/964458309 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c94139270 0x7f2c9413b650 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c009dc0 tx=0x7f2c8c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:56.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.542+0000 7f2c9c508700 1 -- 172.21.15.146:0/964458309 shutdown_connections 2023-10-03T10:17:56.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.542+0000 7f2c9c508700 1 --2- 172.21.15.146:0/964458309 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c94139270 0x7f2c9413b650 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.542+0000 7f2c9c508700 1 --2- 172.21.15.146:0/964458309 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c94136950 0x7f2c94138d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.542+0000 7f2c9c508700 1 -- 172.21.15.146:0/964458309 >> 172.21.15.146:0/964458309 conn(0x7f2c940a2980 msgr2=0x7f2c940a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.542+0000 7f2c9c508700 1 -- 172.21.15.146:0/964458309 shutdown_connections 2023-10-03T10:17:56.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.542+0000 7f2c9c508700 1 -- 172.21.15.146:0/964458309 wait complete. 2023-10-03T10:17:56.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.543+0000 7f2c9c508700 1 Processor -- start 2023-10-03T10:17:56.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.543+0000 7f2c9c508700 1 -- start start 2023-10-03T10:17:56.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.544+0000 7f2c9c508700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c94133a70 0x7f2c94119d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.544+0000 7f2c9c508700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c94136950 0x7f2c9411a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.544+0000 7f2c9c508700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c94139270 0x7f2c9411a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.544+0000 7f2c9c508700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9411d7a0 con 0x7f2c94139270 2023-10-03T10:17:56.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.544+0000 7f2c9c508700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9411beb0 con 0x7f2c94136950 2023-10-03T10:17:56.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.544+0000 7f2c9c508700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9409a350 con 0x7f2c94133a70 2023-10-03T10:17:56.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.544+0000 7f2c99aa3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c94136950 0x7f2c9411a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.544+0000 7f2c99aa3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c94136950 0x7f2c9411a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52594/0 (socket says 172.21.15.146:52594) 2023-10-03T10:17:56.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.544+0000 7f2c9aaa5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c94139270 0x7f2c9411a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.544+0000 7f2c99aa3700 1 -- 172.21.15.146:0/1202626489 learned_addr learned my addr 172.21.15.146:0/1202626489 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:56.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.544+0000 7f2c9a2a4700 1 --2- 172.21.15.146:0/1202626489 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c94133a70 0x7f2c94119d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.544+0000 7f2c99aa3700 1 -- 172.21.15.146:0/1202626489 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c94133a70 msgr2=0x7f2c94119d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.544+0000 7f2c99aa3700 1 --2- 172.21.15.146:0/1202626489 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c94133a70 0x7f2c94119d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.544+0000 7f2c99aa3700 1 -- 172.21.15.146:0/1202626489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c94139270 msgr2=0x7f2c9411a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.544+0000 7f2c99aa3700 1 --2- 172.21.15.146:0/1202626489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c94139270 0x7f2c9411a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.544+0000 7f2c99aa3700 1 -- 172.21.15.146:0/1202626489 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c900094a0 con 0x7f2c94136950 2023-10-03T10:17:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.544+0000 7f2c9aaa5700 1 --2- 172.21.15.146:0/1202626489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c94139270 0x7f2c9411a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.544+0000 7f2c99aa3700 1 --2- 172.21.15.146:0/1202626489 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c94136950 0x7f2c9411a250 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000ebe0 tx=0x7f2c9000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.544+0000 7f2c86ffd700 1 -- 172.21.15.146:0/1202626489 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c900097a0 con 0x7f2c94136950 2023-10-03T10:17:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.544+0000 7f2c86ffd700 1 -- 172.21.15.146:0/1202626489 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9000c850 con 0x7f2c94136950 2023-10-03T10:17:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.544+0000 7f2c86ffd700 1 -- 172.21.15.146:0/1202626489 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9000cbe0 con 0x7f2c94136950 2023-10-03T10:17:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.544+0000 7f2c9c508700 1 -- 172.21.15.146:0/1202626489 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c8c009a70 con 0x7f2c94136950 2023-10-03T10:17:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.545+0000 7f2c9c508700 1 -- 172.21.15.146:0/1202626489 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9411d200 con 0x7f2c94136950 2023-10-03T10:17:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.545+0000 7f2c86ffd700 1 -- 172.21.15.146:0/1202626489 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c9000cd40 con 0x7f2c94136950 2023-10-03T10:17:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.545+0000 7f2c86ffd700 1 -- 172.21.15.146:0/1202626489 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2c9003f780 con 0x7f2c94136950 2023-10-03T10:17:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.545+0000 7f2c9c508700 1 -- 172.21.15.146:0/1202626489 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c9404f2a0 con 0x7f2c94136950 2023-10-03T10:17:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.550+0000 7f2c86ffd700 1 -- 172.21.15.146:0/1202626489 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c900232f0 con 0x7f2c94136950 2023-10-03T10:17:56.594 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:56.603 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:56.673 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:56.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.734+0000 7fd26dcd2700 1 Processor -- start 2023-10-03T10:17:56.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.734+0000 7fd26dcd2700 1 -- start start 2023-10-03T10:17:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.735+0000 7fd26dcd2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd26809f350 0x7fd268136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.735+0000 7fd26dcd2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd2681371c0 0x7fd2681395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.735+0000 7fd26dcd2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26809c970 con 0x7fd26809e870 2023-10-03T10:17:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.735+0000 7fd26dcd2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2680a0920 con 0x7fd2681371c0 2023-10-03T10:17:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.735+0000 7fd26dcd2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd26809f9c0 con 0x7fd26809f350 2023-10-03T10:17:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.735+0000 7fd2677fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd26809e870 0x7fd26809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35614/0 (socket says 172.21.15.146:35614) 2023-10-03T10:17:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.735+0000 7fd267fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd2681371c0 0x7fd2681395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.735+0000 7fd2677fe700 1 -- 172.21.15.146:0/2789363058 learned_addr learned my addr 172.21.15.146:0/2789363058 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:56.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.735+0000 7fd266ffd700 1 --2- 172.21.15.146:0/2789363058 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd26809f350 0x7fd268136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.736+0000 7fd2667fc700 1 -- 172.21.15.146:0/2789363058 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495540140 0 0) 0x7fd26809c970 con 0x7fd26809e870 2023-10-03T10:17:56.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.736+0000 7fd2667fc700 1 -- 172.21.15.146:0/2789363058 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2500035b0 con 0x7fd26809e870 2023-10-03T10:17:56.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.736+0000 7fd266ffd700 1 -- 172.21.15.146:0/2789363058 >> v2:172.21.15.146:3300/0 conn(0x7fd2681371c0 msgr2=0x7fd2681395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:56.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.736+0000 7fd266ffd700 1 --2- 172.21.15.146:0/2789363058 >> v2:172.21.15.146:3300/0 conn(0x7fd2681371c0 0x7fd2681395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.736+0000 7fd266ffd700 1 -- 172.21.15.146:0/2789363058 >> v1:172.21.15.146:6789/0 conn(0x7fd26809e870 legacy=0x7fd26809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.736+0000 7fd266ffd700 1 -- 172.21.15.146:0/2789363058 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26809bab0 con 0x7fd26809f350 2023-10-03T10:17:56.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.736+0000 7fd267fff700 1 --2- 172.21.15.146:0/2789363058 >> v2:172.21.15.146:3300/0 conn(0x7fd2681371c0 0x7fd2681395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.736+0000 7fd266ffd700 1 --2- 172.21.15.146:0/2789363058 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd26809f350 0x7fd268136c80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fd25c009840 tx=0x7fd25c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5e3405d5da441e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.736+0000 7fd2667fc700 1 -- 172.21.15.146:0/2789363058 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c004230 con 0x7fd26809f350 2023-10-03T10:17:56.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.736+0000 7fd2667fc700 1 -- 172.21.15.146:0/2789363058 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25c004390 con 0x7fd26809f350 2023-10-03T10:17:56.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.736+0000 7fd2667fc700 1 -- 172.21.15.146:0/2789363058 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c0036a0 con 0x7fd26809f350 2023-10-03T10:17:56.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.737+0000 7fd26dcd2700 1 -- 172.21.15.146:0/2789363058 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd26809f350 msgr2=0x7fd268136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.737+0000 7fd26dcd2700 1 --2- 172.21.15.146:0/2789363058 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd26809f350 0x7fd268136c80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fd25c009840 tx=0x7fd25c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:56.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.737+0000 7fd26dcd2700 1 -- 172.21.15.146:0/2789363058 shutdown_connections 2023-10-03T10:17:56.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.737+0000 7fd26dcd2700 1 --2- 172.21.15.146:0/2789363058 >> v2:172.21.15.146:3300/0 conn(0x7fd2681371c0 0x7fd2681395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.737+0000 7fd26dcd2700 1 --2- 172.21.15.146:0/2789363058 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd26809f350 0x7fd268136c80 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.737+0000 7fd26dcd2700 1 -- 172.21.15.146:0/2789363058 >> 172.21.15.146:0/2789363058 conn(0x7fd2680a4430 msgr2=0x7fd2680a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.737+0000 7fd26dcd2700 1 -- 172.21.15.146:0/2789363058 shutdown_connections 2023-10-03T10:17:56.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.737+0000 7fd26dcd2700 1 -- 172.21.15.146:0/2789363058 wait complete. 2023-10-03T10:17:56.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.738+0000 7fd26dcd2700 1 Processor -- start 2023-10-03T10:17:56.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.738+0000 7fd26dcd2700 1 -- start start 2023-10-03T10:17:56.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.739+0000 7fd26dcd2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd26809e870 0x7fd2681245d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.739+0000 7fd26dcd2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd26809f350 0x7fd268122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.739+0000 7fd26dcd2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2681371c0 0x7fd268123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.739+0000 7fd26dcd2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd268120c40 con 0x7fd2681371c0 2023-10-03T10:17:56.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.739+0000 7fd26dcd2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd268122480 con 0x7fd26809f350 2023-10-03T10:17:56.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.739+0000 7fd26dcd2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd268121cc0 con 0x7fd26809e870 2023-10-03T10:17:56.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.739+0000 7fd267fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2681371c0 0x7fd268123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.739+0000 7fd267fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2681371c0 0x7fd268123380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39146/0 (socket says 172.21.15.146:39146) 2023-10-03T10:17:56.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.739+0000 7fd267fff700 1 -- 172.21.15.146:0/3538628952 learned_addr learned my addr 172.21.15.146:0/3538628952 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:56.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.739+0000 7fd2677fe700 1 --2- 172.21.15.146:0/3538628952 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd26809e870 0x7fd2681245d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.739+0000 7fd267fff700 1 -- 172.21.15.146:0/3538628952 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd26809e870 msgr2=0x7fd2681245d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.739+0000 7fd267fff700 1 --2- 172.21.15.146:0/3538628952 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd26809e870 0x7fd2681245d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.739+0000 7fd267fff700 1 -- 172.21.15.146:0/3538628952 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd26809f350 msgr2=0x7fd268122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.739+0000 7fd267fff700 1 --2- 172.21.15.146:0/3538628952 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd26809f350 0x7fd268122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.739+0000 7fd267fff700 1 -- 172.21.15.146:0/3538628952 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd260009a70 con 0x7fd2681371c0 2023-10-03T10:17:56.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.739+0000 7fd2677fe700 1 --2- 172.21.15.146:0/3538628952 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd26809e870 0x7fd2681245d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.739+0000 7fd267fff700 1 --2- 172.21.15.146:0/3538628952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2681371c0 0x7fd268123380 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fd26000ef90 tx=0x7fd26000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.740+0000 7fd24ffff700 1 -- 172.21.15.146:0/3538628952 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26000cd40 con 0x7fd2681371c0 2023-10-03T10:17:56.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.740+0000 7fd24ffff700 1 -- 172.21.15.146:0/3538628952 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26000f040 con 0x7fd2681371c0 2023-10-03T10:17:56.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.740+0000 7fd26dcd2700 1 -- 172.21.15.146:0/3538628952 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd25c0094a0 con 0x7fd2681371c0 2023-10-03T10:17:56.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.740+0000 7fd24ffff700 1 -- 172.21.15.146:0/3538628952 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2600146c0 con 0x7fd2681371c0 2023-10-03T10:17:56.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.740+0000 7fd26dcd2700 1 -- 172.21.15.146:0/3538628952 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2681214d0 con 0x7fd2681371c0 2023-10-03T10:17:56.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.741+0000 7fd26dcd2700 1 -- 172.21.15.146:0/3538628952 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd26804f2a0 con 0x7fd2681371c0 2023-10-03T10:17:56.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.746+0000 7fd24ffff700 1 -- 172.21.15.146:0/3538628952 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd260014820 con 0x7fd2681371c0 2023-10-03T10:17:56.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.746+0000 7fd24ffff700 1 -- 172.21.15.146:0/3538628952 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd260040a20 con 0x7fd2681371c0 2023-10-03T10:17:56.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.750+0000 7fd24ffff700 1 -- 172.21.15.146:0/3538628952 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd260007330 con 0x7fd2681371c0 2023-10-03T10:17:56.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.753+0000 7f2c9c508700 1 -- 172.21.15.146:0/1202626489 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2c9411c080 con 0x7f2c94136950 2023-10-03T10:17:56.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.753+0000 7f2c86ffd700 1 -- 172.21.15.146:0/1202626489 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c9001bb10 con 0x7f2c94136950 2023-10-03T10:17:56.753 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:56.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.757+0000 7f2c9c508700 1 -- 172.21.15.146:0/1202626489 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c94136950 msgr2=0x7f2c9411a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.757+0000 7f2c9c508700 1 --2- 172.21.15.146:0/1202626489 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c94136950 0x7f2c9411a250 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000ebe0 tx=0x7f2c9000eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.757+0000 7f2c9c508700 1 -- 172.21.15.146:0/1202626489 shutdown_connections 2023-10-03T10:17:56.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.757+0000 7f2c9c508700 1 --2- 172.21.15.146:0/1202626489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c94139270 0x7f2c9411a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.757+0000 7f2c9c508700 1 --2- 172.21.15.146:0/1202626489 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2c94133a70 0x7f2c94119d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.757+0000 7f2c9c508700 1 --2- 172.21.15.146:0/1202626489 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c94136950 0x7f2c9411a250 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.757+0000 7f2c9c508700 1 -- 172.21.15.146:0/1202626489 >> 172.21.15.146:0/1202626489 conn(0x7f2c940a2980 msgr2=0x7f2c940a08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.757+0000 7f2c9c508700 1 -- 172.21.15.146:0/1202626489 shutdown_connections 2023-10-03T10:17:56.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.757+0000 7f2c9c508700 1 -- 172.21.15.146:0/1202626489 wait complete. 2023-10-03T10:17:56.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:56.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.782+0000 7f845e644700 1 Processor -- start 2023-10-03T10:17:56.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.782+0000 7f845e644700 1 -- start start 2023-10-03T10:17:56.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.782+0000 7f845e644700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f845809e870 0x7f845809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.782+0000 7f845e644700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8458131f40 0x7f8458139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.782+0000 7f845e644700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845809c970 con 0x7f845809f180 2023-10-03T10:17:56.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.782+0000 7f845e644700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84580a0920 con 0x7f8458131f40 2023-10-03T10:17:56.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.783+0000 7f845e644700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845809f9c0 con 0x7f845809e870 2023-10-03T10:17:56.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.783+0000 7f8457fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f845809e870 0x7f845809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.783+0000 7f8457fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f845809e870 0x7f845809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52600/0 (socket says 172.21.15.146:52600) 2023-10-03T10:17:56.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.783+0000 7f8457fff700 1 -- 172.21.15.146:0/703222771 learned_addr learned my addr 172.21.15.146:0/703222771 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:56.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.783+0000 7f845cbe1700 1 --2- 172.21.15.146:0/703222771 >> v2:172.21.15.146:3300/0 conn(0x7f8458131f40 0x7f8458139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.783+0000 7f8457fff700 1 -- 172.21.15.146:0/703222771 >> v2:172.21.15.146:3300/0 conn(0x7f8458131f40 msgr2=0x7f8458139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:56.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.783+0000 7f8457fff700 1 --2- 172.21.15.146:0/703222771 >> v2:172.21.15.146:3300/0 conn(0x7f8458131f40 0x7f8458139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.783+0000 7f8457fff700 1 -- 172.21.15.146:0/703222771 >> v1:172.21.15.146:6789/0 conn(0x7f845809f180 legacy=0x7f8458131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.783+0000 7f8456ffd700 1 -- 172.21.15.146:0/703222771 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4052641827 0 0) 0x7f845809c970 con 0x7f845809f180 2023-10-03T10:17:56.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.783+0000 7f8457fff700 1 -- 172.21.15.146:0/703222771 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845809bab0 con 0x7f845809e870 2023-10-03T10:17:56.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.783+0000 7f845cbe1700 1 --2- 172.21.15.146:0/703222771 >> v2:172.21.15.146:3300/0 conn(0x7f8458131f40 0x7f8458139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.783+0000 7f8457fff700 1 --2- 172.21.15.146:0/703222771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f845809e870 0x7f845809ec40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f84480098f0 tx=0x7f8448009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8b8d254f911163d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.783+0000 7f8456ffd700 1 -- 172.21.15.146:0/703222771 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448011830 con 0x7f845809e870 2023-10-03T10:17:56.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.783+0000 7f8456ffd700 1 -- 172.21.15.146:0/703222771 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8448011990 con 0x7f845809e870 2023-10-03T10:17:56.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.783+0000 7f8456ffd700 1 -- 172.21.15.146:0/703222771 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448011d20 con 0x7f845809e870 2023-10-03T10:17:56.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.784+0000 7f845e644700 1 -- 172.21.15.146:0/703222771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f845809e870 msgr2=0x7f845809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.784+0000 7f845e644700 1 --2- 172.21.15.146:0/703222771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f845809e870 0x7f845809ec40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f84480098f0 tx=0x7f8448009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:56.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.784+0000 7f845e644700 1 -- 172.21.15.146:0/703222771 shutdown_connections 2023-10-03T10:17:56.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.784+0000 7f845e644700 1 --2- 172.21.15.146:0/703222771 >> v2:172.21.15.146:3300/0 conn(0x7f8458131f40 0x7f8458139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.784+0000 7f845e644700 1 --2- 172.21.15.146:0/703222771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f845809e870 0x7f845809ec40 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.784+0000 7f845e644700 1 -- 172.21.15.146:0/703222771 >> 172.21.15.146:0/703222771 conn(0x7f84580a4430 msgr2=0x7f84580a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.785+0000 7f845e644700 1 -- 172.21.15.146:0/703222771 shutdown_connections 2023-10-03T10:17:56.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.785+0000 7f845e644700 1 -- 172.21.15.146:0/703222771 wait complete. 2023-10-03T10:17:56.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.785+0000 7f845e644700 1 Processor -- start 2023-10-03T10:17:56.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.786+0000 7f845e644700 1 -- start start 2023-10-03T10:17:56.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.786+0000 7f845e644700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f845809e870 0x7f84581c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.786+0000 7f845e644700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f845809f180 0x7f84581c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.786+0000 7f845e644700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8458131f40 0x7f84581c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.786+0000 7f845e644700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845811e6e0 con 0x7f845809e870 2023-10-03T10:17:56.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.786+0000 7f845e644700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845811e4f0 con 0x7f8458131f40 2023-10-03T10:17:56.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.786+0000 7f845e644700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f845809dba0 con 0x7f845809f180 2023-10-03T10:17:56.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.786+0000 7f84577fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f845809f180 0x7f84581c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.786+0000 7f84577fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f845809f180 0x7f84581c6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59084/0 (socket says 172.21.15.146:59084) 2023-10-03T10:17:56.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.786+0000 7f845cbe1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8458131f40 0x7f84581c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.786+0000 7f84577fe700 1 -- 172.21.15.146:0/2554481415 learned_addr learned my addr 172.21.15.146:0/2554481415 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:56.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.786+0000 7f8457fff700 1 --2- 172.21.15.146:0/2554481415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f845809e870 0x7f84581c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.787+0000 7f8457fff700 1 -- 172.21.15.146:0/2554481415 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f845809f180 msgr2=0x7f84581c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.787+0000 7f8457fff700 1 --2- 172.21.15.146:0/2554481415 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f845809f180 0x7f84581c6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.787+0000 7f8457fff700 1 -- 172.21.15.146:0/2554481415 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8458131f40 msgr2=0x7f84581c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.787+0000 7f8457fff700 1 --2- 172.21.15.146:0/2554481415 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8458131f40 0x7f84581c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.787+0000 7f8457fff700 1 -- 172.21.15.146:0/2554481415 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8450009a70 con 0x7f845809e870 2023-10-03T10:17:56.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.787+0000 7f845cbe1700 1 --2- 172.21.15.146:0/2554481415 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8458131f40 0x7f84581c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.787+0000 7f8457fff700 1 --2- 172.21.15.146:0/2554481415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f845809e870 0x7f84581c6100 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f8448016000 tx=0x7f8448004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.787+0000 7f8454ff9700 1 -- 172.21.15.146:0/2554481415 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84480044d0 con 0x7f845809e870 2023-10-03T10:17:56.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.787+0000 7f8454ff9700 1 -- 172.21.15.146:0/2554481415 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844801e070 con 0x7f845809e870 2023-10-03T10:17:56.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.787+0000 7f845e644700 1 -- 172.21.15.146:0/2554481415 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8448009550 con 0x7f845809e870 2023-10-03T10:17:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.787+0000 7f8454ff9700 1 -- 172.21.15.146:0/2554481415 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84480038c0 con 0x7f845809e870 2023-10-03T10:17:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.787+0000 7f845e644700 1 -- 172.21.15.146:0/2554481415 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8458120450 con 0x7f845809e870 2023-10-03T10:17:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.788+0000 7f8454ff9700 1 -- 172.21.15.146:0/2554481415 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8448003a20 con 0x7f845809e870 2023-10-03T10:17:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.788+0000 7f8454ff9700 1 -- 172.21.15.146:0/2554481415 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8448040300 con 0x7f845809e870 2023-10-03T10:17:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.788+0000 7f845e644700 1 -- 172.21.15.146:0/2554481415 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8458120450 con 0x7f845809e870 2023-10-03T10:17:56.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.793+0000 7f8454ff9700 1 -- 172.21.15.146:0/2554481415 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8458120450 con 0x7f845809e870 2023-10-03T10:17:56.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.817+0000 7f2da8656700 1 Processor -- start 2023-10-03T10:17:56.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.817+0000 7f2da8656700 1 -- start start 2023-10-03T10:17:56.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.818+0000 7f2da8656700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2da0134140 0x7f2da0138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.818+0000 7f2da8656700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2da0134570 0x7f2da013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.818+0000 7f2da8656700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da009b110 con 0x7f2da009ad40 2023-10-03T10:17:56.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.818+0000 7f2da8656700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da00a3b60 con 0x7f2da0134140 2023-10-03T10:17:56.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.818+0000 7f2da8656700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2da00a1a80 con 0x7f2da0134570 2023-10-03T10:17:56.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.818+0000 7f2da5bf1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2da0134140 0x7f2da0138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.818+0000 7f2da5bf1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2da0134140 0x7f2da0138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52618/0 (socket says 172.21.15.146:52618) 2023-10-03T10:17:56.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.818+0000 7f2da5bf1700 1 -- 172.21.15.146:0/4053037742 learned_addr learned my addr 172.21.15.146:0/4053037742 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:56.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.818+0000 7f2da63f2700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2da009ad40 0x7f2da0133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35636/0 (socket says 172.21.15.146:35636) 2023-10-03T10:17:56.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.818+0000 7f2da6bf3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2da0134570 0x7f2da013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.818+0000 7f2da53f0700 1 -- 172.21.15.146:0/4053037742 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542646235 0 0) 0x7f2da009b110 con 0x7f2da009ad40 2023-10-03T10:17:56.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.818+0000 7f2da53f0700 1 -- 172.21.15.146:0/4053037742 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d8c0035b0 con 0x7f2da009ad40 2023-10-03T10:17:56.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.818+0000 7f2da5bf1700 1 -- 172.21.15.146:0/4053037742 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2da0134570 msgr2=0x7f2da013b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:56.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.819+0000 7f2da5bf1700 1 --2- 172.21.15.146:0/4053037742 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2da0134570 0x7f2da013b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.819+0000 7f2da5bf1700 1 -- 172.21.15.146:0/4053037742 >> v1:172.21.15.146:6789/0 conn(0x7f2da009ad40 legacy=0x7f2da0133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.819+0000 7f2da5bf1700 1 -- 172.21.15.146:0/4053037742 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da00a2fa0 con 0x7f2da0134140 2023-10-03T10:17:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.819+0000 7f2da6bf3700 1 --2- 172.21.15.146:0/4053037742 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2da0134570 0x7f2da013b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.819+0000 7f2da5bf1700 1 --2- 172.21.15.146:0/4053037742 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2da0134140 0x7f2da0138e80 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009950 tx=0x7f2d90009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eac2486b474679c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.819+0000 7f2da53f0700 1 -- 172.21.15.146:0/4053037742 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d90011830 con 0x7f2da0134140 2023-10-03T10:17:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.819+0000 7f2da53f0700 1 -- 172.21.15.146:0/4053037742 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d90011990 con 0x7f2da0134140 2023-10-03T10:17:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.819+0000 7f2da53f0700 1 -- 172.21.15.146:0/4053037742 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d90011d40 con 0x7f2da0134140 2023-10-03T10:17:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.820+0000 7f2da8656700 1 -- 172.21.15.146:0/4053037742 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2da0134140 msgr2=0x7f2da0138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.820+0000 7f2da8656700 1 --2- 172.21.15.146:0/4053037742 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2da0134140 0x7f2da0138e80 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009950 tx=0x7f2d90009c60 comp rx=0 tx=0).stop 2023-10-03T10:17:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.820+0000 7f2da8656700 1 -- 172.21.15.146:0/4053037742 shutdown_connections 2023-10-03T10:17:56.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.820+0000 7f2da8656700 1 --2- 172.21.15.146:0/4053037742 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2da0134570 0x7f2da013b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.820+0000 7f2da8656700 1 --2- 172.21.15.146:0/4053037742 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2da0134140 0x7f2da0138e80 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.820+0000 7f2da8656700 1 -- 172.21.15.146:0/4053037742 >> 172.21.15.146:0/4053037742 conn(0x7f2da0099c40 msgr2=0x7f2da006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.820+0000 7f2da8656700 1 -- 172.21.15.146:0/4053037742 shutdown_connections 2023-10-03T10:17:56.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.820+0000 7f2da8656700 1 -- 172.21.15.146:0/4053037742 wait complete. 2023-10-03T10:17:56.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.821+0000 7f2da8656700 1 Processor -- start 2023-10-03T10:17:56.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.821+0000 7f2da8656700 1 -- start start 2023-10-03T10:17:56.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.821+0000 7f2da8656700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2da009ad40 0x7f2da0139490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.821+0000 7f2da8656700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2da0134140 0x7f2da01399d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.821+0000 7f2da8656700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2da0134570 0x7f2da0139f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.821+0000 7f2da8656700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da01336f0 con 0x7f2da0134570 2023-10-03T10:17:56.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.821+0000 7f2da8656700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da011e110 con 0x7f2da009ad40 2023-10-03T10:17:56.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.821+0000 7f2da8656700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2da011eaf0 con 0x7f2da0134140 2023-10-03T10:17:56.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.821+0000 7f2da63f2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2da009ad40 0x7f2da0139490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.821+0000 7f2da63f2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2da009ad40 0x7f2da0139490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52634/0 (socket says 172.21.15.146:52634) 2023-10-03T10:17:56.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.821+0000 7f2da63f2700 1 -- 172.21.15.146:0/1863365942 learned_addr learned my addr 172.21.15.146:0/1863365942 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:56.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.821+0000 7f2da5bf1700 1 --2- 172.21.15.146:0/1863365942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2da0134140 0x7f2da01399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.821+0000 7f2da6bf3700 1 --2- 172.21.15.146:0/1863365942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2da0134570 0x7f2da0139f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.822+0000 7f2da63f2700 1 -- 172.21.15.146:0/1863365942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2da0134140 msgr2=0x7f2da01399d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.822+0000 7f2da63f2700 1 --2- 172.21.15.146:0/1863365942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2da0134140 0x7f2da01399d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.822+0000 7f2da63f2700 1 -- 172.21.15.146:0/1863365942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2da0134570 msgr2=0x7f2da0139f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.822+0000 7f2da63f2700 1 --2- 172.21.15.146:0/1863365942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2da0134570 0x7f2da0139f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.822+0000 7f2da63f2700 1 -- 172.21.15.146:0/1863365942 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d98009a70 con 0x7f2da009ad40 2023-10-03T10:17:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.822+0000 7f2da5bf1700 1 --2- 172.21.15.146:0/1863365942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2da0134140 0x7f2da01399d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.822+0000 7f2da6bf3700 1 --2- 172.21.15.146:0/1863365942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2da0134570 0x7f2da0139f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.822+0000 7f2da63f2700 1 --2- 172.21.15.146:0/1863365942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2da009ad40 0x7f2da0139490 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c001eb0 tx=0x7f2d9c00c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.822+0000 7f2d96ffd700 1 -- 172.21.15.146:0/1863365942 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c005cb0 con 0x7f2da009ad40 2023-10-03T10:17:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.822+0000 7f2d96ffd700 1 -- 172.21.15.146:0/1863365942 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9c005e10 con 0x7f2da009ad40 2023-10-03T10:17:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.822+0000 7f2da8656700 1 -- 172.21.15.146:0/1863365942 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d90009550 con 0x7f2da009ad40 2023-10-03T10:17:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.822+0000 7f2d96ffd700 1 -- 172.21.15.146:0/1863365942 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c0072d0 con 0x7f2da009ad40 2023-10-03T10:17:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.822+0000 7f2da8656700 1 -- 172.21.15.146:0/1863365942 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da009e500 con 0x7f2da009ad40 2023-10-03T10:17:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.823+0000 7f2d96ffd700 1 -- 172.21.15.146:0/1863365942 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d9c007430 con 0x7f2da009ad40 2023-10-03T10:17:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.823+0000 7f2d96ffd700 1 -- 172.21.15.146:0/1863365942 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2d9c03ea80 con 0x7f2da009ad40 2023-10-03T10:17:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.823+0000 7f2da8656700 1 -- 172.21.15.146:0/1863365942 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da01361e0 con 0x7f2da009ad40 2023-10-03T10:17:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.828+0000 7f2d96ffd700 1 -- 172.21.15.146:0/1863365942 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d9c01b3b0 con 0x7f2da009ad40 2023-10-03T10:17:56.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.950+0000 7fd26dcd2700 1 -- 172.21.15.146:0/3538628952 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd268122040 con 0x7fd2681371c0 2023-10-03T10:17:56.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.950+0000 7fd24ffff700 1 -- 172.21.15.146:0/3538628952 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd26002a070 con 0x7fd2681371c0 2023-10-03T10:17:56.950 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:56.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.952+0000 7fd26dcd2700 1 -- 172.21.15.146:0/3538628952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2681371c0 msgr2=0x7fd268123380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.952+0000 7fd26dcd2700 1 --2- 172.21.15.146:0/3538628952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2681371c0 0x7fd268123380 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fd26000ef90 tx=0x7fd26000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.952+0000 7fd26dcd2700 1 -- 172.21.15.146:0/3538628952 shutdown_connections 2023-10-03T10:17:56.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.952+0000 7fd26dcd2700 1 --2- 172.21.15.146:0/3538628952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2681371c0 0x7fd268123380 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.952+0000 7fd26dcd2700 1 --2- 172.21.15.146:0/3538628952 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd26809e870 0x7fd2681245d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.952+0000 7fd26dcd2700 1 --2- 172.21.15.146:0/3538628952 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd26809f350 0x7fd268122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.952+0000 7fd26dcd2700 1 -- 172.21.15.146:0/3538628952 >> 172.21.15.146:0/3538628952 conn(0x7fd2680a4430 msgr2=0x7fd2680a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.952+0000 7fd26dcd2700 1 -- 172.21.15.146:0/3538628952 shutdown_connections 2023-10-03T10:17:56.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:56.952+0000 7fd26dcd2700 1 -- 172.21.15.146:0/3538628952 wait complete. 2023-10-03T10:17:56.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:57.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.021+0000 7f845e644700 1 -- 172.21.15.146:0/2554481415 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8458120450 con 0x7f845809e870 2023-10-03T10:17:57.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.022+0000 7f8454ff9700 1 -- 172.21.15.146:0/2554481415 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8458120450 con 0x7f845809e870 2023-10-03T10:17:57.022 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:57.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.024+0000 7f845e644700 1 -- 172.21.15.146:0/2554481415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f845809e870 msgr2=0x7f84581c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.024+0000 7f845e644700 1 --2- 172.21.15.146:0/2554481415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f845809e870 0x7f84581c6100 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f8448016000 tx=0x7f8448004750 comp rx=0 tx=0).stop 2023-10-03T10:17:57.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.024+0000 7f845e644700 1 -- 172.21.15.146:0/2554481415 shutdown_connections 2023-10-03T10:17:57.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.024+0000 7f845e644700 1 --2- 172.21.15.146:0/2554481415 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8458131f40 0x7f84581c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.024+0000 7f845e644700 1 --2- 172.21.15.146:0/2554481415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f845809e870 0x7f84581c6100 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.024+0000 7f845e644700 1 --2- 172.21.15.146:0/2554481415 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f845809f180 0x7f84581c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.024+0000 7f845e644700 1 -- 172.21.15.146:0/2554481415 >> 172.21.15.146:0/2554481415 conn(0x7f84580a4430 msgr2=0x7f845809c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:57.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.024+0000 7f845e644700 1 -- 172.21.15.146:0/2554481415 shutdown_connections 2023-10-03T10:17:57.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.024+0000 7f845e644700 1 -- 172.21.15.146:0/2554481415 wait complete. 2023-10-03T10:17:57.035 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:57.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.047+0000 7f2da8656700 1 -- 172.21.15.146:0/1863365942 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2da009c7e0 con 0x7f2da009ad40 2023-10-03T10:17:57.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.047+0000 7f2d96ffd700 1 -- 172.21.15.146:0/1863365942 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d9c017020 con 0x7f2da009ad40 2023-10-03T10:17:57.047 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:57.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.049+0000 7f2da8656700 1 -- 172.21.15.146:0/1863365942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2da009ad40 msgr2=0x7f2da0139490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.049+0000 7f2da8656700 1 --2- 172.21.15.146:0/1863365942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2da009ad40 0x7f2da0139490 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c001eb0 tx=0x7f2d9c00c7b0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.049+0000 7f2da8656700 1 -- 172.21.15.146:0/1863365942 shutdown_connections 2023-10-03T10:17:57.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.049+0000 7f2da8656700 1 --2- 172.21.15.146:0/1863365942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2da0134570 0x7f2da0139f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.049+0000 7f2da8656700 1 --2- 172.21.15.146:0/1863365942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2da009ad40 0x7f2da0139490 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.049+0000 7f2da8656700 1 --2- 172.21.15.146:0/1863365942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2da0134140 0x7f2da01399d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.049+0000 7f2da8656700 1 -- 172.21.15.146:0/1863365942 >> 172.21.15.146:0/1863365942 conn(0x7f2da0099c40 msgr2=0x7f2da013b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:57.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.049+0000 7f2da8656700 1 -- 172.21.15.146:0/1863365942 shutdown_connections 2023-10-03T10:17:57.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.049+0000 7f2da8656700 1 -- 172.21.15.146:0/1863365942 wait complete. 2023-10-03T10:17:57.061 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:57.775 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:57.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.907+0000 7f10fd540700 1 Processor -- start 2023-10-03T10:17:57.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.907+0000 7f10fd540700 1 -- start start 2023-10-03T10:17:57.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.907+0000 7f10fd540700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f10f80a0a70 0x7f10f80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.907+0000 7f10fd540700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f10f80a1380 0x7f10f8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.908+0000 7f10fd540700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f809dc00 con 0x7f10f8133f50 2023-10-03T10:17:57.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.908+0000 7f10fd540700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f809ea60 con 0x7f10f80a1380 2023-10-03T10:17:57.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.908+0000 7f10fd540700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10f809dec0 con 0x7f10f80a0a70 2023-10-03T10:17:57.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.908+0000 7f10f67fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f10f80a1380 0x7f10f8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.908+0000 7f10f6ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f10f80a0a70 0x7f10f80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.908+0000 7f10f67fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f10f80a1380 0x7f10f8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39176/0 (socket says 172.21.15.146:39176) 2023-10-03T10:17:57.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.908+0000 7f10f77fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f10f8133f50 0x7f10f813acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35640/0 (socket says 172.21.15.146:35640) 2023-10-03T10:17:57.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.908+0000 7f10f67fc700 1 -- 172.21.15.146:0/595006601 learned_addr learned my addr 172.21.15.146:0/595006601 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:57.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.908+0000 7f10f67fc700 1 -- 172.21.15.146:0/595006601 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f10f80a0a70 msgr2=0x7f10f80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:57.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.908+0000 7f10f67fc700 1 --2- 172.21.15.146:0/595006601 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f10f80a0a70 0x7f10f80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.908+0000 7f10f67fc700 1 -- 172.21.15.146:0/595006601 >> v1:172.21.15.146:6789/0 conn(0x7f10f8133f50 legacy=0x7f10f813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.908+0000 7f10f67fc700 1 -- 172.21.15.146:0/595006601 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f809e6a0 con 0x7f10f80a1380 2023-10-03T10:17:57.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.908+0000 7f10f5ffb700 1 -- 172.21.15.146:0/595006601 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3157215401 0 0) 0x7f10f809dc00 con 0x7f10f8133f50 2023-10-03T10:17:57.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.908+0000 7f10f6ffd700 1 --2- 172.21.15.146:0/595006601 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f10f80a0a70 0x7f10f80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:57.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.908+0000 7f10f67fc700 1 --2- 172.21.15.146:0/595006601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10f80a1380 0x7f10f8133a10 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f10e80098f0 tx=0x7f10e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58691d17d8471239 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.908+0000 7f10f5ffb700 1 -- 172.21.15.146:0/595006601 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e8011830 con 0x7f10f80a1380 2023-10-03T10:17:57.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.908+0000 7f10f5ffb700 1 -- 172.21.15.146:0/595006601 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e8011990 con 0x7f10f80a1380 2023-10-03T10:17:57.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.908+0000 7f10f5ffb700 1 -- 172.21.15.146:0/595006601 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e8011d20 con 0x7f10f80a1380 2023-10-03T10:17:57.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.909+0000 7f10fd540700 1 -- 172.21.15.146:0/595006601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10f80a1380 msgr2=0x7f10f8133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.909+0000 7f10fd540700 1 --2- 172.21.15.146:0/595006601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10f80a1380 0x7f10f8133a10 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f10e80098f0 tx=0x7f10e8009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:57.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.909+0000 7f10fd540700 1 -- 172.21.15.146:0/595006601 shutdown_connections 2023-10-03T10:17:57.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.909+0000 7f10fd540700 1 --2- 172.21.15.146:0/595006601 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f10f80a0a70 0x7f10f80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.909+0000 7f10fd540700 1 --2- 172.21.15.146:0/595006601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10f80a1380 0x7f10f8133a10 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.909+0000 7f10fd540700 1 -- 172.21.15.146:0/595006601 >> 172.21.15.146:0/595006601 conn(0x7f10f80a6610 msgr2=0x7f10f80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:57.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.909+0000 7f10fd540700 1 -- 172.21.15.146:0/595006601 shutdown_connections 2023-10-03T10:17:57.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.909+0000 7f10fd540700 1 -- 172.21.15.146:0/595006601 wait complete. 2023-10-03T10:17:57.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.910+0000 7f10fd540700 1 Processor -- start 2023-10-03T10:17:57.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.910+0000 7f10fd540700 1 -- start start 2023-10-03T10:17:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.910+0000 7f10fd540700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10f80a0a70 0x7f10f8122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.910+0000 7f10fd540700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f10f80a1380 0x7f10f8122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.910+0000 7f10fd540700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f10f8133f50 0x7f10f8123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.910+0000 7f10fd540700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f8126220 con 0x7f10f80a0a70 2023-10-03T10:17:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.910+0000 7f10fd540700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f8133960 con 0x7f10f8133f50 2023-10-03T10:17:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.910+0000 7f10fd540700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10f8133420 con 0x7f10f80a1380 2023-10-03T10:17:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.910+0000 7f10f6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10f80a0a70 0x7f10f8122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.911+0000 7f10f6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10f80a0a70 0x7f10f8122900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39178/0 (socket says 172.21.15.146:39178) 2023-10-03T10:17:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.911+0000 7f10f77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f10f8133f50 0x7f10f8123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.911+0000 7f10f6ffd700 1 -- 172.21.15.146:0/4033622993 learned_addr learned my addr 172.21.15.146:0/4033622993 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.911+0000 7f10f67fc700 1 --2- 172.21.15.146:0/4033622993 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f10f80a1380 0x7f10f8122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.911+0000 7f10f6ffd700 1 -- 172.21.15.146:0/4033622993 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f10f80a1380 msgr2=0x7f10f8122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.911+0000 7f10f6ffd700 1 --2- 172.21.15.146:0/4033622993 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f10f80a1380 0x7f10f8122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.911+0000 7f10f6ffd700 1 -- 172.21.15.146:0/4033622993 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f10f8133f50 msgr2=0x7f10f8123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.911+0000 7f10f6ffd700 1 --2- 172.21.15.146:0/4033622993 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f10f8133f50 0x7f10f8123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.911+0000 7f10f6ffd700 1 -- 172.21.15.146:0/4033622993 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec0094a0 con 0x7f10f80a0a70 2023-10-03T10:17:57.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.911+0000 7f10f77fe700 1 --2- 172.21.15.146:0/4033622993 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f10f8133f50 0x7f10f8123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:57.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.911+0000 7f10f67fc700 1 --2- 172.21.15.146:0/4033622993 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f10f80a1380 0x7f10f8122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:57.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.911+0000 7f10f6ffd700 1 --2- 172.21.15.146:0/4033622993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10f80a0a70 0x7f10f8122900 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00ebe0 tx=0x7f10ec00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.911+0000 7f10df7fe700 1 -- 172.21.15.146:0/4033622993 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec00c850 con 0x7f10f80a0a70 2023-10-03T10:17:57.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.911+0000 7f10df7fe700 1 -- 172.21.15.146:0/4033622993 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec00c9b0 con 0x7f10f80a0a70 2023-10-03T10:17:57.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.911+0000 7f10fd540700 1 -- 172.21.15.146:0/4033622993 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e8009550 con 0x7f10f80a0a70 2023-10-03T10:17:57.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.911+0000 7f10df7fe700 1 -- 172.21.15.146:0/4033622993 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec00cd40 con 0x7f10f80a0a70 2023-10-03T10:17:57.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.911+0000 7f10fd540700 1 -- 172.21.15.146:0/4033622993 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f8126bb0 con 0x7f10f80a0a70 2023-10-03T10:17:57.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.912+0000 7f10df7fe700 1 -- 172.21.15.146:0/4033622993 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10ec013470 con 0x7f10f80a0a70 2023-10-03T10:17:57.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.912+0000 7f10df7fe700 1 -- 172.21.15.146:0/4033622993 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f10ec03fc10 con 0x7f10f80a0a70 2023-10-03T10:17:57.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.912+0000 7f10fd540700 1 -- 172.21.15.146:0/4033622993 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f804f2a0 con 0x7f10f80a0a70 2023-10-03T10:17:57.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:57.917+0000 7f10df7fe700 1 -- 172.21.15.146:0/4033622993 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10ec021080 con 0x7f10f80a0a70 2023-10-03T10:17:57.965 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:58.036 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:58.062 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:58.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.092+0000 7f3e1b007700 1 Processor -- start 2023-10-03T10:17:58.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.092+0000 7f3e1b007700 1 -- start start 2023-10-03T10:17:58.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.093+0000 7f3e1b007700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e140a0a30 0x7f3e140a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.093+0000 7f3e1b007700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3e140a1340 0x7f3e1412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.093+0000 7f3e1b007700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e141304a0 0x7f3e14130940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.093+0000 7f3e1b007700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e140a1e70 con 0x7f3e140a1340 2023-10-03T10:17:58.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.093+0000 7f3e1b007700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1409a720 con 0x7f3e141304a0 2023-10-03T10:17:58.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.093+0000 7f3e1b007700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1409b300 con 0x7f3e140a0a30 2023-10-03T10:17:58.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.093+0000 7f3e13fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3e140a1340 0x7f3e1412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.093+0000 7f3e195a4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e141304a0 0x7f3e14130940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.093+0000 7f3e13fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3e140a1340 0x7f3e1412ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39188/0 (socket says 172.21.15.146:39188) 2023-10-03T10:17:58.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.093+0000 7f3e13fff700 1 -- 172.21.15.146:0/2223747759 learned_addr learned my addr 172.21.15.146:0/2223747759 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:58.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.093+0000 7f3e195a4700 1 -- 172.21.15.146:0/2223747759 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e140a0a30 msgr2=0x7f3e140a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:58.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.093+0000 7f3e195a4700 1 --2- 172.21.15.146:0/2223747759 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e140a0a30 0x7f3e140a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.093+0000 7f3e195a4700 1 -- 172.21.15.146:0/2223747759 >> v2:172.21.15.146:3300/0 conn(0x7f3e140a1340 msgr2=0x7f3e1412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:58.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.093+0000 7f3e195a4700 1 --2- 172.21.15.146:0/2223747759 >> v2:172.21.15.146:3300/0 conn(0x7f3e140a1340 0x7f3e1412ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.093+0000 7f3e195a4700 1 -- 172.21.15.146:0/2223747759 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1409abc0 con 0x7f3e141304a0 2023-10-03T10:17:58.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.094+0000 7f3e13fff700 1 --2- 172.21.15.146:0/2223747759 >> v2:172.21.15.146:3300/0 conn(0x7f3e140a1340 0x7f3e1412ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:58.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.094+0000 7f3e195a4700 1 --2- 172.21.15.146:0/2223747759 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e141304a0 0x7f3e14130940 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009d90 tx=0x7f3e0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=841c95a850da8d9e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.094+0000 7f3e137fe700 1 -- 172.21.15.146:0/2223747759 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c00e070 con 0x7f3e141304a0 2023-10-03T10:17:58.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.094+0000 7f3e137fe700 1 -- 172.21.15.146:0/2223747759 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c00bb20 con 0x7f3e141304a0 2023-10-03T10:17:58.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.094+0000 7f3e137fe700 1 -- 172.21.15.146:0/2223747759 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c012430 con 0x7f3e141304a0 2023-10-03T10:17:58.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.095+0000 7f3e1b007700 1 -- 172.21.15.146:0/2223747759 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e141304a0 msgr2=0x7f3e14130940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.095+0000 7f3e1b007700 1 --2- 172.21.15.146:0/2223747759 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e141304a0 0x7f3e14130940 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009d90 tx=0x7f3e0c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.095+0000 7f3e1b007700 1 -- 172.21.15.146:0/2223747759 shutdown_connections 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.095+0000 7f3e1b007700 1 --2- 172.21.15.146:0/2223747759 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e141304a0 0x7f3e14130940 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.095+0000 7f3e1b007700 1 --2- 172.21.15.146:0/2223747759 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e140a0a30 0x7f3e140a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.095+0000 7f3e1b007700 1 --2- 172.21.15.146:0/2223747759 >> v2:172.21.15.146:3300/0 conn(0x7f3e140a1340 0x7f3e1412ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.095+0000 7f3e1b007700 1 -- 172.21.15.146:0/2223747759 >> 172.21.15.146:0/2223747759 conn(0x7f3e140a2980 msgr2=0x7f3e140a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.095+0000 7f3e1b007700 1 -- 172.21.15.146:0/2223747759 shutdown_connections 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.095+0000 7f3e1b007700 1 -- 172.21.15.146:0/2223747759 wait complete. 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.096+0000 7f3e1b007700 1 Processor -- start 2023-10-03T10:17:58.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.097+0000 7f3e1b007700 1 -- start start 2023-10-03T10:17:58.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.097+0000 7f3e1b007700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e140a0a30 0x7f3e141308a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.097+0000 7f3e1b007700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e140a1340 0x7f3e14130de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.097+0000 7f3e1b007700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e141304a0 0x7f3e14131320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.097+0000 7f3e1b007700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e14131b20 con 0x7f3e141304a0 2023-10-03T10:17:58.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.097+0000 7f3e1b007700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e141301a0 con 0x7f3e140a0a30 2023-10-03T10:17:58.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.097+0000 7f3e1b007700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1409f540 con 0x7f3e140a1340 2023-10-03T10:17:58.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.098+0000 7f3e13fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e140a1340 0x7f3e14130de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.098+0000 7f3e13fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e140a1340 0x7f3e14130de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59148/0 (socket says 172.21.15.146:59148) 2023-10-03T10:17:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.098+0000 7f3e13fff700 1 -- 172.21.15.146:0/285321808 learned_addr learned my addr 172.21.15.146:0/285321808 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.098+0000 7f3e18da3700 1 --2- 172.21.15.146:0/285321808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e140a0a30 0x7f3e141308a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.098+0000 7f3e195a4700 1 --2- 172.21.15.146:0/285321808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e141304a0 0x7f3e14131320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.098+0000 7f3e13fff700 1 -- 172.21.15.146:0/285321808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e140a0a30 msgr2=0x7f3e141308a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.098+0000 7f3e13fff700 1 --2- 172.21.15.146:0/285321808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e140a0a30 0x7f3e141308a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.098+0000 7f3e13fff700 1 -- 172.21.15.146:0/285321808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e141304a0 msgr2=0x7f3e14131320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.098+0000 7f3e13fff700 1 --2- 172.21.15.146:0/285321808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e141304a0 0x7f3e14131320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.098+0000 7f3e13fff700 1 -- 172.21.15.146:0/285321808 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e00009550 con 0x7f3e140a1340 2023-10-03T10:17:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.098+0000 7f3e18da3700 1 --2- 172.21.15.146:0/285321808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e140a0a30 0x7f3e141308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.098+0000 7f3e13fff700 1 --2- 172.21.15.146:0/285321808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e140a1340 0x7f3e14130de0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f3e00010df0 tx=0x7f3e0000e640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.098+0000 7f3e117fa700 1 -- 172.21.15.146:0/285321808 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0000ee50 con 0x7f3e140a1340 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.098+0000 7f3e117fa700 1 -- 172.21.15.146:0/285321808 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e00011450 con 0x7f3e140a1340 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.098+0000 7f3e1b007700 1 -- 172.21.15.146:0/285321808 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e0c009a70 con 0x7f3e140a1340 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.098+0000 7f3e117fa700 1 -- 172.21.15.146:0/285321808 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e00011800 con 0x7f3e140a1340 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.099+0000 7f3e1b007700 1 -- 172.21.15.146:0/285321808 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e14131cc0 con 0x7f3e140a1340 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.099+0000 7f3e1b007700 1 -- 172.21.15.146:0/285321808 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e14132da0 con 0x7f3e140a1340 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.100+0000 7f3e117fa700 1 -- 172.21.15.146:0/285321808 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e00011b70 con 0x7f3e140a1340 2023-10-03T10:17:58.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.100+0000 7f3e117fa700 1 -- 172.21.15.146:0/285321808 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3e000400e0 con 0x7f3e140a1340 2023-10-03T10:17:58.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.105+0000 7f3e117fa700 1 -- 172.21.15.146:0/285321808 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e00019440 con 0x7f3e140a1340 2023-10-03T10:17:58.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.116+0000 7f10fd540700 1 -- 172.21.15.146:0/4033622993 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f10f8126010 con 0x7f10f80a0a70 2023-10-03T10:17:58.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.116+0000 7f10df7fe700 1 -- 172.21.15.146:0/4033622993 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10ec017020 con 0x7f10f80a0a70 2023-10-03T10:17:58.116 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.120+0000 7f10fd540700 1 -- 172.21.15.146:0/4033622993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10f80a0a70 msgr2=0x7f10f8122900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.120+0000 7f10fd540700 1 --2- 172.21.15.146:0/4033622993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10f80a0a70 0x7f10f8122900 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00ebe0 tx=0x7f10ec00eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.120+0000 7f10fd540700 1 -- 172.21.15.146:0/4033622993 shutdown_connections 2023-10-03T10:17:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.120+0000 7f10fd540700 1 --2- 172.21.15.146:0/4033622993 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f10f8133f50 0x7f10f8123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.120+0000 7f10fd540700 1 --2- 172.21.15.146:0/4033622993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10f80a0a70 0x7f10f8122900 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.120+0000 7f10fd540700 1 --2- 172.21.15.146:0/4033622993 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f10f80a1380 0x7f10f8122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.120+0000 7f10fd540700 1 -- 172.21.15.146:0/4033622993 >> 172.21.15.146:0/4033622993 conn(0x7f10f80a6610 msgr2=0x7f10f80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.120+0000 7f10fd540700 1 -- 172.21.15.146:0/4033622993 shutdown_connections 2023-10-03T10:17:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.120+0000 7f10fd540700 1 -- 172.21.15.146:0/4033622993 wait complete. 2023-10-03T10:17:58.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:58.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.167+0000 7fee167e9700 1 Processor -- start 2023-10-03T10:17:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.167+0000 7fee167e9700 1 -- start start 2023-10-03T10:17:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.168+0000 7fee167e9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee1009d860 0x7fee1009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.168+0000 7fee167e9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee10130eb0 0x7fee10138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.168+0000 7fee167e9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee1009aaa0 con 0x7fee1009e170 2023-10-03T10:17:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.168+0000 7fee167e9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1009f870 con 0x7fee1009d860 2023-10-03T10:17:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.168+0000 7fee167e9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee1009b360 con 0x7fee10130eb0 2023-10-03T10:17:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.168+0000 7fee0f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fee1009e170 0x7fee101307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35644/0 (socket says 172.21.15.146:35644) 2023-10-03T10:17:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.168+0000 7fee0f7fe700 1 -- 172.21.15.146:0/2938406428 learned_addr learned my addr 172.21.15.146:0/2938406428 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:58.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.169+0000 7fee0ffff700 1 --2- 172.21.15.146:0/2938406428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee1009d860 0x7fee1009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.169+0000 7fee14d86700 1 --2- 172.21.15.146:0/2938406428 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee10130eb0 0x7fee10138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.169+0000 7fee0ffff700 1 -- 172.21.15.146:0/2938406428 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee10130eb0 msgr2=0x7fee10138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:58.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.169+0000 7fee0ffff700 1 --2- 172.21.15.146:0/2938406428 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee10130eb0 0x7fee10138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.169+0000 7fee0ffff700 1 -- 172.21.15.146:0/2938406428 >> v1:172.21.15.146:6789/0 conn(0x7fee1009e170 legacy=0x7fee101307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.169+0000 7fee0ffff700 1 -- 172.21.15.146:0/2938406428 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1009b620 con 0x7fee1009d860 2023-10-03T10:17:58.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.169+0000 7fee0ffff700 1 --2- 172.21.15.146:0/2938406428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee1009d860 0x7fee1009dc30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fee000098d0 tx=0x7fee00009be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1731ae7c20a63d49 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.171+0000 7fee0effd700 1 -- 172.21.15.146:0/2938406428 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee00004230 con 0x7fee1009d860 2023-10-03T10:17:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.171+0000 7fee0effd700 1 -- 172.21.15.146:0/2938406428 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee00004390 con 0x7fee1009d860 2023-10-03T10:17:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.171+0000 7fee0effd700 1 -- 172.21.15.146:0/2938406428 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee00010890 con 0x7fee1009d860 2023-10-03T10:17:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.171+0000 7fee167e9700 1 -- 172.21.15.146:0/2938406428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee1009d860 msgr2=0x7fee1009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.171+0000 7fee167e9700 1 --2- 172.21.15.146:0/2938406428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee1009d860 0x7fee1009dc30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fee000098d0 tx=0x7fee00009be0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.171+0000 7fee167e9700 1 -- 172.21.15.146:0/2938406428 shutdown_connections 2023-10-03T10:17:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.171+0000 7fee167e9700 1 --2- 172.21.15.146:0/2938406428 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee10130eb0 0x7fee10138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.171+0000 7fee167e9700 1 --2- 172.21.15.146:0/2938406428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee1009d860 0x7fee1009dc30 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.171+0000 7fee167e9700 1 -- 172.21.15.146:0/2938406428 >> 172.21.15.146:0/2938406428 conn(0x7fee10099c40 msgr2=0x7fee100a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.171+0000 7fee167e9700 1 -- 172.21.15.146:0/2938406428 shutdown_connections 2023-10-03T10:17:58.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.171+0000 7fee167e9700 1 -- 172.21.15.146:0/2938406428 wait complete. 2023-10-03T10:17:58.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.172+0000 7fee167e9700 1 Processor -- start 2023-10-03T10:17:58.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.173+0000 7fee167e9700 1 -- start start 2023-10-03T10:17:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.173+0000 7fee167e9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee1009e170 0x7fee1011e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.173+0000 7fee167e9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee10130eb0 0x7fee1011eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.173+0000 7fee167e9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee1011f080 0x7fee101c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.173+0000 7fee167e9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1011fa40 con 0x7fee10130eb0 2023-10-03T10:17:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.173+0000 7fee167e9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee10120320 con 0x7fee1009e170 2023-10-03T10:17:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.173+0000 7fee167e9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee10121e40 con 0x7fee1011f080 2023-10-03T10:17:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.173+0000 7fee0ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee1009e170 0x7fee1011e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.173+0000 7fee0f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee10130eb0 0x7fee1011eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.173+0000 7fee0ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee1009e170 0x7fee1011e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52672/0 (socket says 172.21.15.146:52672) 2023-10-03T10:17:58.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.173+0000 7fee0ffff700 1 -- 172.21.15.146:0/3081245771 learned_addr learned my addr 172.21.15.146:0/3081245771 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.173+0000 7fee14d86700 1 --2- 172.21.15.146:0/3081245771 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee1011f080 0x7fee101c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.173+0000 7fee0ffff700 1 -- 172.21.15.146:0/3081245771 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee1011f080 msgr2=0x7fee101c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.173+0000 7fee0ffff700 1 --2- 172.21.15.146:0/3081245771 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee1011f080 0x7fee101c4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.173+0000 7fee0ffff700 1 -- 172.21.15.146:0/3081245771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee10130eb0 msgr2=0x7fee1011eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.173+0000 7fee0ffff700 1 --2- 172.21.15.146:0/3081245771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee10130eb0 0x7fee1011eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.173+0000 7fee0ffff700 1 -- 172.21.15.146:0/3081245771 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee000094a0 con 0x7fee1009e170 2023-10-03T10:17:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.173+0000 7fee0f7fe700 1 --2- 172.21.15.146:0/3081245771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee10130eb0 0x7fee1011eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.174+0000 7fee0ffff700 1 --2- 172.21.15.146:0/3081245771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee1009e170 0x7fee1011e600 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fee000090b0 tx=0x7fee00004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.174+0000 7fee0cff9700 1 -- 172.21.15.146:0/3081245771 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee00004230 con 0x7fee1009e170 2023-10-03T10:17:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.174+0000 7fee0cff9700 1 -- 172.21.15.146:0/3081245771 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee00003ad0 con 0x7fee1009e170 2023-10-03T10:17:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.174+0000 7fee167e9700 1 -- 172.21.15.146:0/3081245771 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee101207c0 con 0x7fee1009e170 2023-10-03T10:17:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.174+0000 7fee0cff9700 1 -- 172.21.15.146:0/3081245771 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee00003e80 con 0x7fee1009e170 2023-10-03T10:17:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.174+0000 7fee167e9700 1 -- 172.21.15.146:0/3081245771 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee100a1ee0 con 0x7fee1009e170 2023-10-03T10:17:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.175+0000 7fee0cff9700 1 -- 172.21.15.146:0/3081245771 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee00023460 con 0x7fee1009e170 2023-10-03T10:17:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.175+0000 7fee0cff9700 1 -- 172.21.15.146:0/3081245771 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fee00044f20 con 0x7fee1009e170 2023-10-03T10:17:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.175+0000 7fee167e9700 1 -- 172.21.15.146:0/3081245771 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee10121a70 con 0x7fee1009e170 2023-10-03T10:17:58.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.180+0000 7fee0cff9700 1 -- 172.21.15.146:0/3081245771 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee0002b9a0 con 0x7fee1009e170 2023-10-03T10:17:58.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.219+0000 7fb09215a700 1 Processor -- start 2023-10-03T10:17:58.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.219+0000 7fb09215a700 1 -- start start 2023-10-03T10:17:58.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.220+0000 7fb09215a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb08c134140 0x7fb08c138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.220+0000 7fb09215a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb08c134570 0x7fb08c13b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.220+0000 7fb09215a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c09b110 con 0x7fb08c09ad40 2023-10-03T10:17:58.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.220+0000 7fb09215a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08c0a3b60 con 0x7fb08c134570 2023-10-03T10:17:58.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.220+0000 7fb09215a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c0a1a80 con 0x7fb08c134140 2023-10-03T10:17:58.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.220+0000 7fb08affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb08c134140 0x7fb08c138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.220+0000 7fb08b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb08c09ad40 0x7fb08c133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35650/0 (socket says 172.21.15.146:35650) 2023-10-03T10:17:58.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.220+0000 7fb08b7fe700 1 -- 172.21.15.146:0/2356927188 learned_addr learned my addr 172.21.15.146:0/2356927188 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:58.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.220+0000 7fb08bfff700 1 --2- 172.21.15.146:0/2356927188 >> v2:172.21.15.146:3300/0 conn(0x7fb08c134570 0x7fb08c13b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.220+0000 7fb08affd700 1 -- 172.21.15.146:0/2356927188 >> v2:172.21.15.146:3300/0 conn(0x7fb08c134570 msgr2=0x7fb08c13b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:58.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.220+0000 7fb08affd700 1 --2- 172.21.15.146:0/2356927188 >> v2:172.21.15.146:3300/0 conn(0x7fb08c134570 0x7fb08c13b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.220+0000 7fb08affd700 1 -- 172.21.15.146:0/2356927188 >> v1:172.21.15.146:6789/0 conn(0x7fb08c09ad40 legacy=0x7fb08c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.220+0000 7fb08affd700 1 -- 172.21.15.146:0/2356927188 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c0a2fa0 con 0x7fb08c134140 2023-10-03T10:17:58.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.220+0000 7fb08affd700 1 --2- 172.21.15.146:0/2356927188 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb08c134140 0x7fb08c138e80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb080009840 tx=0x7fb080009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f663bfbe43f7b770 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.221+0000 7fb08a7fc700 1 -- 172.21.15.146:0/2356927188 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb080004230 con 0x7fb08c134140 2023-10-03T10:17:58.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.221+0000 7fb08a7fc700 1 -- 172.21.15.146:0/2356927188 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb080004390 con 0x7fb08c134140 2023-10-03T10:17:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.221+0000 7fb08a7fc700 1 -- 172.21.15.146:0/2356927188 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0800036a0 con 0x7fb08c134140 2023-10-03T10:17:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.221+0000 7fb09215a700 1 -- 172.21.15.146:0/2356927188 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb08c134140 msgr2=0x7fb08c138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.221+0000 7fb09215a700 1 --2- 172.21.15.146:0/2356927188 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb08c134140 0x7fb08c138e80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb080009840 tx=0x7fb080009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.221+0000 7fb09215a700 1 -- 172.21.15.146:0/2356927188 shutdown_connections 2023-10-03T10:17:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.221+0000 7fb09215a700 1 --2- 172.21.15.146:0/2356927188 >> v2:172.21.15.146:3300/0 conn(0x7fb08c134570 0x7fb08c13b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.221+0000 7fb09215a700 1 --2- 172.21.15.146:0/2356927188 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb08c134140 0x7fb08c138e80 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.221+0000 7fb09215a700 1 -- 172.21.15.146:0/2356927188 >> 172.21.15.146:0/2356927188 conn(0x7fb08c099c40 msgr2=0x7fb08c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.221+0000 7fb09215a700 1 -- 172.21.15.146:0/2356927188 shutdown_connections 2023-10-03T10:17:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.221+0000 7fb09215a700 1 -- 172.21.15.146:0/2356927188 wait complete. 2023-10-03T10:17:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.222+0000 7fb09215a700 1 Processor -- start 2023-10-03T10:17:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.222+0000 7fb09215a700 1 -- start start 2023-10-03T10:17:58.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.223+0000 7fb09215a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb08c09ad40 0x7fb08c11c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.223+0000 7fb09215a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb08c134140 0x7fb08c11ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.223+0000 7fb09215a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb08c134570 0x7fb08c11d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.223+0000 7fb09215a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c133780 con 0x7fb08c09ad40 2023-10-03T10:17:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.223+0000 7fb09215a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c0a4110 con 0x7fb08c134570 2023-10-03T10:17:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.223+0000 7fb09215a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c09c7e0 con 0x7fb08c134140 2023-10-03T10:17:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.223+0000 7fb08affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb08c134140 0x7fb08c11ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.223+0000 7fb08affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb08c134140 0x7fb08c11ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59192/0 (socket says 172.21.15.146:59192) 2023-10-03T10:17:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.223+0000 7fb08affd700 1 -- 172.21.15.146:0/1591035938 learned_addr learned my addr 172.21.15.146:0/1591035938 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.223+0000 7fb08b7fe700 1 --2- 172.21.15.146:0/1591035938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb08c09ad40 0x7fb08c11c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.223+0000 7fb08affd700 1 -- 172.21.15.146:0/1591035938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb08c134570 msgr2=0x7fb08c11d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.223+0000 7fb08affd700 1 --2- 172.21.15.146:0/1591035938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb08c134570 0x7fb08c11d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.223+0000 7fb08affd700 1 -- 172.21.15.146:0/1591035938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb08c09ad40 msgr2=0x7fb08c11c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.223+0000 7fb08affd700 1 --2- 172.21.15.146:0/1591035938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb08c09ad40 0x7fb08c11c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.223+0000 7fb08affd700 1 -- 172.21.15.146:0/1591035938 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0800094a0 con 0x7fb08c134140 2023-10-03T10:17:58.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.223+0000 7fb08b7fe700 1 --2- 172.21.15.146:0/1591035938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb08c09ad40 0x7fb08c11c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:58.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.223+0000 7fb08affd700 1 --2- 172.21.15.146:0/1591035938 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb08c134140 0x7fb08c11ce00 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fb0800090b0 tx=0x7fb080004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.224+0000 7fb073fff700 1 -- 172.21.15.146:0/1591035938 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb080003d80 con 0x7fb08c134140 2023-10-03T10:17:58.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.224+0000 7fb073fff700 1 -- 172.21.15.146:0/1591035938 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08001f070 con 0x7fb08c134140 2023-10-03T10:17:58.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.224+0000 7fb09215a700 1 -- 172.21.15.146:0/1591035938 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08c13a1b0 con 0x7fb08c134140 2023-10-03T10:17:58.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.224+0000 7fb073fff700 1 -- 172.21.15.146:0/1591035938 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb080011870 con 0x7fb08c134140 2023-10-03T10:17:58.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.224+0000 7fb09215a700 1 -- 172.21.15.146:0/1591035938 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08c11ddc0 con 0x7fb08c134140 2023-10-03T10:17:58.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.224+0000 7fb073fff700 1 -- 172.21.15.146:0/1591035938 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb080021030 con 0x7fb08c134140 2023-10-03T10:17:58.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.225+0000 7fb09215a700 1 -- 172.21.15.146:0/1591035938 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08c11eb10 con 0x7fb08c134140 2023-10-03T10:17:58.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.225+0000 7fb073fff700 1 -- 172.21.15.146:0/1591035938 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb080040940 con 0x7fb08c134140 2023-10-03T10:17:58.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.229+0000 7fb073fff700 1 -- 172.21.15.146:0/1591035938 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb080011e00 con 0x7fb08c134140 2023-10-03T10:17:58.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.305+0000 7f3e1b007700 1 -- 172.21.15.146:0/285321808 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3e1404f2a0 con 0x7f3e140a1340 2023-10-03T10:17:58.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.305+0000 7f3e117fa700 1 -- 172.21.15.146:0/285321808 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3e000183a0 con 0x7f3e140a1340 2023-10-03T10:17:58.305 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:58.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.307+0000 7f3e1b007700 1 -- 172.21.15.146:0/285321808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e140a1340 msgr2=0x7f3e14130de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.307+0000 7f3e1b007700 1 --2- 172.21.15.146:0/285321808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e140a1340 0x7f3e14130de0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f3e00010df0 tx=0x7f3e0000e640 comp rx=0 tx=0).stop 2023-10-03T10:17:58.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.307+0000 7f3e1b007700 1 -- 172.21.15.146:0/285321808 shutdown_connections 2023-10-03T10:17:58.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.307+0000 7f3e1b007700 1 --2- 172.21.15.146:0/285321808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e141304a0 0x7f3e14131320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.307+0000 7f3e1b007700 1 --2- 172.21.15.146:0/285321808 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e140a0a30 0x7f3e141308a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.307+0000 7f3e1b007700 1 --2- 172.21.15.146:0/285321808 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e140a1340 0x7f3e14130de0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.307+0000 7f3e1b007700 1 -- 172.21.15.146:0/285321808 >> 172.21.15.146:0/285321808 conn(0x7f3e140a2980 msgr2=0x7f3e14070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.307+0000 7f3e1b007700 1 -- 172.21.15.146:0/285321808 shutdown_connections 2023-10-03T10:17:58.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.308+0000 7f3e1b007700 1 -- 172.21.15.146:0/285321808 wait complete. 2023-10-03T10:17:58.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:58.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.375+0000 7fee167e9700 1 -- 172.21.15.146:0/3081245771 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fee1004f2a0 con 0x7fee1009e170 2023-10-03T10:17:58.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.376+0000 7fee0cff9700 1 -- 172.21.15.146:0/3081245771 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fee00027030 con 0x7fee1009e170 2023-10-03T10:17:58.375 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:58.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.378+0000 7fee167e9700 1 -- 172.21.15.146:0/3081245771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee1009e170 msgr2=0x7fee1011e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.378+0000 7fee167e9700 1 --2- 172.21.15.146:0/3081245771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee1009e170 0x7fee1011e600 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fee000090b0 tx=0x7fee00004750 comp rx=0 tx=0).stop 2023-10-03T10:17:58.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.378+0000 7fee167e9700 1 -- 172.21.15.146:0/3081245771 shutdown_connections 2023-10-03T10:17:58.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.378+0000 7fee167e9700 1 --2- 172.21.15.146:0/3081245771 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fee1011f080 0x7fee101c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.378+0000 7fee167e9700 1 --2- 172.21.15.146:0/3081245771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fee1009e170 0x7fee1011e600 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.378+0000 7fee167e9700 1 --2- 172.21.15.146:0/3081245771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee10130eb0 0x7fee1011eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.378+0000 7fee167e9700 1 -- 172.21.15.146:0/3081245771 >> 172.21.15.146:0/3081245771 conn(0x7fee10099c40 msgr2=0x7fee100a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.378+0000 7fee167e9700 1 -- 172.21.15.146:0/3081245771 shutdown_connections 2023-10-03T10:17:58.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.378+0000 7fee167e9700 1 -- 172.21.15.146:0/3081245771 wait complete. 2023-10-03T10:17:58.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:58.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.421+0000 7fb09215a700 1 -- 172.21.15.146:0/1591035938 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb08c11eb10 con 0x7fb08c134140 2023-10-03T10:17:58.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.422+0000 7fb073fff700 1 -- 172.21.15.146:0/1591035938 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb080023bc0 con 0x7fb08c134140 2023-10-03T10:17:58.422 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:58.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.424+0000 7fb09215a700 1 -- 172.21.15.146:0/1591035938 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb08c134140 msgr2=0x7fb08c11ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.424+0000 7fb09215a700 1 --2- 172.21.15.146:0/1591035938 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb08c134140 0x7fb08c11ce00 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fb0800090b0 tx=0x7fb080004750 comp rx=0 tx=0).stop 2023-10-03T10:17:58.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.424+0000 7fb09215a700 1 -- 172.21.15.146:0/1591035938 shutdown_connections 2023-10-03T10:17:58.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.424+0000 7fb09215a700 1 --2- 172.21.15.146:0/1591035938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb08c134570 0x7fb08c11d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.424+0000 7fb09215a700 1 --2- 172.21.15.146:0/1591035938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb08c09ad40 0x7fb08c11c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.424+0000 7fb09215a700 1 --2- 172.21.15.146:0/1591035938 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb08c134140 0x7fb08c11ce00 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.424+0000 7fb09215a700 1 -- 172.21.15.146:0/1591035938 >> 172.21.15.146:0/1591035938 conn(0x7fb08c099c40 msgr2=0x7fb08c09b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.424+0000 7fb09215a700 1 -- 172.21.15.146:0/1591035938 shutdown_connections 2023-10-03T10:17:58.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:58.424+0000 7fb09215a700 1 -- 172.21.15.146:0/1591035938 wait complete. 2023-10-03T10:17:58.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:17:59.139 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:59.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.273+0000 7fd676838700 1 Processor -- start 2023-10-03T10:17:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.273+0000 7fd676838700 1 -- start start 2023-10-03T10:17:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.273+0000 7fd676838700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd670131980 0x7fd670131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.273+0000 7fd676838700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd67009bc70 0x7fd67009c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.273+0000 7fd676838700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6700a1640 con 0x7fd67009c5c0 2023-10-03T10:17:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.273+0000 7fd676838700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd67006eb30 con 0x7fd67009bc70 2023-10-03T10:17:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.273+0000 7fd676838700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6700a22d0 con 0x7fd670131980 2023-10-03T10:17:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.273+0000 7fd66f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd67009bc70 0x7fd67009c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.273+0000 7fd674dd5700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd67009c5c0 0x7fd670138700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35654/0 (socket says 172.21.15.146:35654) 2023-10-03T10:17:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.273+0000 7fd674dd5700 1 -- 172.21.15.146:0/2612819426 learned_addr learned my addr 172.21.15.146:0/2612819426 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.274+0000 7fd66ffff700 1 --2- 172.21.15.146:0/2612819426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd670131980 0x7fd670131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.274+0000 7fd66f7fe700 1 -- 172.21.15.146:0/2612819426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd670131980 msgr2=0x7fd670131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:59.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.274+0000 7fd66f7fe700 1 --2- 172.21.15.146:0/2612819426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd670131980 0x7fd670131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.274+0000 7fd66f7fe700 1 -- 172.21.15.146:0/2612819426 >> v1:172.21.15.146:6789/0 conn(0x7fd67009c5c0 legacy=0x7fd670138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.274+0000 7fd66effd700 1 -- 172.21.15.146:0/2612819426 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257038653 0 0) 0x7fd6700a1640 con 0x7fd67009c5c0 2023-10-03T10:17:59.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.274+0000 7fd66f7fe700 1 -- 172.21.15.146:0/2612819426 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd670131550 con 0x7fd67009bc70 2023-10-03T10:17:59.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.274+0000 7fd66ffff700 1 --2- 172.21.15.146:0/2612819426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd670131980 0x7fd670131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:59.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.274+0000 7fd66f7fe700 1 --2- 172.21.15.146:0/2612819426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd67009bc70 0x7fd67009c080 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fd664009840 tx=0x7fd664009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=532255c219d06bf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.274+0000 7fd66effd700 1 -- 172.21.15.146:0/2612819426 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd664011830 con 0x7fd67009bc70 2023-10-03T10:17:59.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.274+0000 7fd66effd700 1 -- 172.21.15.146:0/2612819426 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd664011990 con 0x7fd67009bc70 2023-10-03T10:17:59.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.274+0000 7fd66effd700 1 -- 172.21.15.146:0/2612819426 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd664011d20 con 0x7fd67009bc70 2023-10-03T10:17:59.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.275+0000 7fd676838700 1 -- 172.21.15.146:0/2612819426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd67009bc70 msgr2=0x7fd67009c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.275+0000 7fd676838700 1 --2- 172.21.15.146:0/2612819426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd67009bc70 0x7fd67009c080 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fd664009840 tx=0x7fd664009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:59.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.275+0000 7fd676838700 1 -- 172.21.15.146:0/2612819426 shutdown_connections 2023-10-03T10:17:59.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.275+0000 7fd676838700 1 --2- 172.21.15.146:0/2612819426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd670131980 0x7fd670131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.275+0000 7fd676838700 1 --2- 172.21.15.146:0/2612819426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd67009bc70 0x7fd67009c080 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.275+0000 7fd676838700 1 -- 172.21.15.146:0/2612819426 >> 172.21.15.146:0/2612819426 conn(0x7fd6700a2980 msgr2=0x7fd6700a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.275+0000 7fd676838700 1 -- 172.21.15.146:0/2612819426 shutdown_connections 2023-10-03T10:17:59.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.275+0000 7fd676838700 1 -- 172.21.15.146:0/2612819426 wait complete. 2023-10-03T10:17:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.276+0000 7fd676838700 1 Processor -- start 2023-10-03T10:17:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.276+0000 7fd676838700 1 -- start start 2023-10-03T10:17:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.276+0000 7fd676838700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd67009bc70 0x7fd67011b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.276+0000 7fd676838700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd67009c5c0 0x7fd67011bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.276+0000 7fd676838700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd670131980 0x7fd67011c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.276+0000 7fd676838700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67011f2b0 con 0x7fd67009c5c0 2023-10-03T10:17:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.276+0000 7fd676838700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67011e680 con 0x7fd670131980 2023-10-03T10:17:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.276+0000 7fd676838700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd670130a40 con 0x7fd67009bc70 2023-10-03T10:17:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.276+0000 7fd66f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd67009c5c0 0x7fd67011bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.276+0000 7fd674dd5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd670131980 0x7fd67011c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.276+0000 7fd66ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd67009bc70 0x7fd67011b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.276+0000 7fd66f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd67009c5c0 0x7fd67011bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39234/0 (socket says 172.21.15.146:39234) 2023-10-03T10:17:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.276+0000 7fd66f7fe700 1 -- 172.21.15.146:0/1999166663 learned_addr learned my addr 172.21.15.146:0/1999166663 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.277+0000 7fd66f7fe700 1 -- 172.21.15.146:0/1999166663 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd67009bc70 msgr2=0x7fd67011b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.277+0000 7fd66f7fe700 1 --2- 172.21.15.146:0/1999166663 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd67009bc70 0x7fd67011b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.277+0000 7fd66f7fe700 1 -- 172.21.15.146:0/1999166663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd670131980 msgr2=0x7fd67011c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.277+0000 7fd66f7fe700 1 --2- 172.21.15.146:0/1999166663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd670131980 0x7fd67011c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.277+0000 7fd66f7fe700 1 -- 172.21.15.146:0/1999166663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd660009430 con 0x7fd67009c5c0 2023-10-03T10:17:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.277+0000 7fd674dd5700 1 --2- 172.21.15.146:0/1999166663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd670131980 0x7fd67011c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.277+0000 7fd66f7fe700 1 --2- 172.21.15.146:0/1999166663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd67009c5c0 0x7fd67011bcd0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fd664009fd0 tx=0x7fd664004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.277+0000 7fd66cff9700 1 -- 172.21.15.146:0/1999166663 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6640036a0 con 0x7fd67009c5c0 2023-10-03T10:17:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.277+0000 7fd66cff9700 1 -- 172.21.15.146:0/1999166663 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66401e070 con 0x7fd67009c5c0 2023-10-03T10:17:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.277+0000 7fd676838700 1 -- 172.21.15.146:0/1999166663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6640094a0 con 0x7fd67009c5c0 2023-10-03T10:17:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.277+0000 7fd66cff9700 1 -- 172.21.15.146:0/1999166663 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd664003a40 con 0x7fd67009c5c0 2023-10-03T10:17:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.277+0000 7fd676838700 1 -- 172.21.15.146:0/1999166663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67011d3a0 con 0x7fd67009c5c0 2023-10-03T10:17:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.278+0000 7fd66cff9700 1 -- 172.21.15.146:0/1999166663 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd664003ba0 con 0x7fd67009c5c0 2023-10-03T10:17:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.278+0000 7fd66cff9700 1 -- 172.21.15.146:0/1999166663 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd664020070 con 0x7fd67009c5c0 2023-10-03T10:17:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.278+0000 7fd676838700 1 -- 172.21.15.146:0/1999166663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd67004f2a0 con 0x7fd67009c5c0 2023-10-03T10:17:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.283+0000 7fd66cff9700 1 -- 172.21.15.146:0/1999166663 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd66402a070 con 0x7fd67009c5c0 2023-10-03T10:17:59.320 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:59.390 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:59.436 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:59.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.448+0000 7fe92f476700 1 Processor -- start 2023-10-03T10:17:59.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.448+0000 7fe92f476700 1 -- start start 2023-10-03T10:17:59.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.449+0000 7fe92f476700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9280a0a30 0x7fe9280a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.449+0000 7fe92f476700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe9280a1340 0x7fe92812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.449+0000 7fe92f476700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9280a1e70 con 0x7fe9281304a0 2023-10-03T10:17:59.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.449+0000 7fe92f476700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe92809a720 con 0x7fe9280a1340 2023-10-03T10:17:59.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.449+0000 7fe92f476700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92809b300 con 0x7fe9280a0a30 2023-10-03T10:17:59.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.449+0000 7fe92d212700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9280a0a30 0x7fe9280a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.449+0000 7fe92d212700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9280a0a30 0x7fe9280a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52722/0 (socket says 172.21.15.146:52722) 2023-10-03T10:17:59.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.449+0000 7fe92d212700 1 -- 172.21.15.146:0/4262624675 learned_addr learned my addr 172.21.15.146:0/4262624675 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:59.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.449+0000 7fe92ca11700 1 --2- 172.21.15.146:0/4262624675 >> v2:172.21.15.146:3300/0 conn(0x7fe9280a1340 0x7fe92812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.450+0000 7fe92d212700 1 -- 172.21.15.146:0/4262624675 >> v2:172.21.15.146:3300/0 conn(0x7fe9280a1340 msgr2=0x7fe92812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:59.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.450+0000 7fe92d212700 1 --2- 172.21.15.146:0/4262624675 >> v2:172.21.15.146:3300/0 conn(0x7fe9280a1340 0x7fe92812ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.450+0000 7fe92d212700 1 -- 172.21.15.146:0/4262624675 >> v1:172.21.15.146:6789/0 conn(0x7fe9281304a0 legacy=0x7fe9281371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.450+0000 7fe92d212700 1 -- 172.21.15.146:0/4262624675 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92809abc0 con 0x7fe9280a0a30 2023-10-03T10:17:59.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.450+0000 7fe92d212700 1 --2- 172.21.15.146:0/4262624675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9280a0a30 0x7fe9280a0e00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe924006fd0 tx=0x7fe92400acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3fbe2ef0bf33f9b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.450+0000 7fe91ffff700 1 -- 172.21.15.146:0/4262624675 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92401dcb0 con 0x7fe9280a0a30 2023-10-03T10:17:59.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.450+0000 7fe91ffff700 1 -- 172.21.15.146:0/4262624675 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92401de10 con 0x7fe9280a0a30 2023-10-03T10:17:59.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.450+0000 7fe91ffff700 1 -- 172.21.15.146:0/4262624675 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe924005c40 con 0x7fe9280a0a30 2023-10-03T10:17:59.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.451+0000 7fe92f476700 1 -- 172.21.15.146:0/4262624675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9280a0a30 msgr2=0x7fe9280a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.451+0000 7fe92f476700 1 --2- 172.21.15.146:0/4262624675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9280a0a30 0x7fe9280a0e00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe924006fd0 tx=0x7fe92400acf0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.451+0000 7fe92f476700 1 -- 172.21.15.146:0/4262624675 shutdown_connections 2023-10-03T10:17:59.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.451+0000 7fe92f476700 1 --2- 172.21.15.146:0/4262624675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9280a0a30 0x7fe9280a0e00 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.451+0000 7fe92f476700 1 --2- 172.21.15.146:0/4262624675 >> v2:172.21.15.146:3300/0 conn(0x7fe9280a1340 0x7fe92812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.451+0000 7fe92f476700 1 -- 172.21.15.146:0/4262624675 >> 172.21.15.146:0/4262624675 conn(0x7fe9280a2980 msgr2=0x7fe9280a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.451+0000 7fe92f476700 1 -- 172.21.15.146:0/4262624675 shutdown_connections 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.451+0000 7fe92f476700 1 -- 172.21.15.146:0/4262624675 wait complete. 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.452+0000 7fe92f476700 1 Processor -- start 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.452+0000 7fe92f476700 1 -- start start 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.453+0000 7fe92f476700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9280a0a30 0x7fe928119e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.453+0000 7fe92f476700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9280a1340 0x7fe92811a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.453+0000 7fe92f476700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9281304a0 0x7fe9281c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.453+0000 7fe92f476700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92812cd20 con 0x7fe9281304a0 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.453+0000 7fe92f476700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92811c0c0 con 0x7fe9280a1340 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.453+0000 7fe92f476700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe92811c920 con 0x7fe9280a0a30 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.453+0000 7fe92d212700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9280a0a30 0x7fe928119e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.453+0000 7fe92d212700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9280a0a30 0x7fe928119e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59208/0 (socket says 172.21.15.146:59208) 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.453+0000 7fe92d212700 1 -- 172.21.15.146:0/1943539749 learned_addr learned my addr 172.21.15.146:0/1943539749 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.453+0000 7fe92ca11700 1 --2- 172.21.15.146:0/1943539749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9280a1340 0x7fe92811a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.453+0000 7fe92da13700 1 --2- 172.21.15.146:0/1943539749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9281304a0 0x7fe9281c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.453+0000 7fe92ca11700 1 -- 172.21.15.146:0/1943539749 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9280a0a30 msgr2=0x7fe928119e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.453+0000 7fe92ca11700 1 --2- 172.21.15.146:0/1943539749 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9280a0a30 0x7fe928119e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.453+0000 7fe92ca11700 1 -- 172.21.15.146:0/1943539749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9281304a0 msgr2=0x7fe9281c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.453+0000 7fe92ca11700 1 --2- 172.21.15.146:0/1943539749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9281304a0 0x7fe9281c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.453+0000 7fe92ca11700 1 -- 172.21.15.146:0/1943539749 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92400a5b0 con 0x7fe9280a1340 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.453+0000 7fe92da13700 1 --2- 172.21.15.146:0/1943539749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9281304a0 0x7fe9281c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.453+0000 7fe92ca11700 1 --2- 172.21.15.146:0/1943539749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9280a1340 0x7fe92811a3d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe91800d960 tx=0x7fe91800dc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.453+0000 7fe91dffb700 1 -- 172.21.15.146:0/1943539749 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe918004220 con 0x7fe9280a1340 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.454+0000 7fe91dffb700 1 -- 172.21.15.146:0/1943539749 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe918004380 con 0x7fe9280a1340 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.454+0000 7fe91dffb700 1 -- 172.21.15.146:0/1943539749 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91800f6d0 con 0x7fe9280a1340 2023-10-03T10:17:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.454+0000 7fe92f476700 1 -- 172.21.15.146:0/1943539749 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92811b050 con 0x7fe9280a1340 2023-10-03T10:17:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.454+0000 7fe92f476700 1 -- 172.21.15.146:0/1943539749 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe928119860 con 0x7fe9280a1340 2023-10-03T10:17:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.455+0000 7fe91dffb700 1 -- 172.21.15.146:0/1943539749 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe91800f830 con 0x7fe9280a1340 2023-10-03T10:17:59.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.455+0000 7fe91dffb700 1 -- 172.21.15.146:0/1943539749 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe91803f5b0 con 0x7fe9280a1340 2023-10-03T10:17:59.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.456+0000 7fe92f476700 1 -- 172.21.15.146:0/1943539749 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92804f2a0 con 0x7fe9280a1340 2023-10-03T10:17:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.464+0000 7fe91dffb700 1 -- 172.21.15.146:0/1943539749 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe9180036a0 con 0x7fe9280a1340 2023-10-03T10:17:59.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.481+0000 7fd676838700 1 -- 172.21.15.146:0/1999166663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd67006bce0 con 0x7fd67009c5c0 2023-10-03T10:17:59.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.481+0000 7fd66cff9700 1 -- 172.21.15.146:0/1999166663 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd664015020 con 0x7fd67009c5c0 2023-10-03T10:17:59.481 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:17:59.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.484+0000 7fd676838700 1 -- 172.21.15.146:0/1999166663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd67009c5c0 msgr2=0x7fd67011bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.484+0000 7fd676838700 1 --2- 172.21.15.146:0/1999166663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd67009c5c0 0x7fd67011bcd0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fd664009fd0 tx=0x7fd664004750 comp rx=0 tx=0).stop 2023-10-03T10:17:59.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.484+0000 7fd676838700 1 -- 172.21.15.146:0/1999166663 shutdown_connections 2023-10-03T10:17:59.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.484+0000 7fd676838700 1 --2- 172.21.15.146:0/1999166663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd670131980 0x7fd67011c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.484+0000 7fd676838700 1 --2- 172.21.15.146:0/1999166663 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd67009bc70 0x7fd67011b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.484+0000 7fd676838700 1 --2- 172.21.15.146:0/1999166663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd67009c5c0 0x7fd67011bcd0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.484+0000 7fd676838700 1 -- 172.21.15.146:0/1999166663 >> 172.21.15.146:0/1999166663 conn(0x7fd6700a2980 msgr2=0x7fd6701b8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.484+0000 7fd676838700 1 -- 172.21.15.146:0/1999166663 shutdown_connections 2023-10-03T10:17:59.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.484+0000 7fd676838700 1 -- 172.21.15.146:0/1999166663 wait complete. 2023-10-03T10:17:59.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:17:59.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.531+0000 7f50f90b6700 1 Processor -- start 2023-10-03T10:17:59.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.531+0000 7f50f90b6700 1 -- start start 2023-10-03T10:17:59.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.531+0000 7f50f90b6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50f40a0a70 0x7f50f40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.531+0000 7f50f90b6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f50f40a1380 0x7f50f4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.531+0000 7f50f90b6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50f4133f50 0x7f50f4134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.531+0000 7f50f90b6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f409e9d0 con 0x7f50f40a1380 2023-10-03T10:17:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.531+0000 7f50f90b6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f409dc00 con 0x7f50f40a0a70 2023-10-03T10:17:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.531+0000 7f50f90b6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50f409dec0 con 0x7f50f4133f50 2023-10-03T10:17:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.531+0000 7f50f359e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50f4133f50 0x7f50f4134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.531+0000 7f50f2d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50f40a0a70 0x7f50f40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.531+0000 7f50f359e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50f4133f50 0x7f50f4134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59220/0 (socket says 172.21.15.146:59220) 2023-10-03T10:17:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.531+0000 7f50f359e700 1 -- 172.21.15.146:0/2103331287 learned_addr learned my addr 172.21.15.146:0/2103331287 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.531+0000 7f50f259c700 1 --2- 172.21.15.146:0/2103331287 >> v2:172.21.15.146:3300/0 conn(0x7f50f40a1380 0x7f50f4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.532+0000 7f50f2d9d700 1 -- 172.21.15.146:0/2103331287 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50f4133f50 msgr2=0x7f50f4134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.532+0000 7f50f2d9d700 1 --2- 172.21.15.146:0/2103331287 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50f4133f50 0x7f50f4134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.532+0000 7f50f2d9d700 1 -- 172.21.15.146:0/2103331287 >> v2:172.21.15.146:3300/0 conn(0x7f50f40a1380 msgr2=0x7f50f4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.532+0000 7f50f2d9d700 1 --2- 172.21.15.146:0/2103331287 >> v2:172.21.15.146:3300/0 conn(0x7f50f40a1380 0x7f50f4133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.532+0000 7f50f2d9d700 1 -- 172.21.15.146:0/2103331287 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f409e6a0 con 0x7f50f40a0a70 2023-10-03T10:17:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.532+0000 7f50f259c700 1 --2- 172.21.15.146:0/2103331287 >> v2:172.21.15.146:3300/0 conn(0x7f50f40a1380 0x7f50f4133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.532+0000 7f50f2d9d700 1 --2- 172.21.15.146:0/2103331287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50f40a0a70 0x7f50f40a0e40 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f50e4009840 tx=0x7f50e4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74f96554eef389cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.532+0000 7f50f1d9b700 1 -- 172.21.15.146:0/2103331287 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4011830 con 0x7f50f40a0a70 2023-10-03T10:17:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.532+0000 7f50f1d9b700 1 -- 172.21.15.146:0/2103331287 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e4011990 con 0x7f50f40a0a70 2023-10-03T10:17:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.532+0000 7f50f1d9b700 1 -- 172.21.15.146:0/2103331287 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4011d20 con 0x7f50f40a0a70 2023-10-03T10:17:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.533+0000 7f50f90b6700 1 -- 172.21.15.146:0/2103331287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50f40a0a70 msgr2=0x7f50f40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.533+0000 7f50f90b6700 1 --2- 172.21.15.146:0/2103331287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50f40a0a70 0x7f50f40a0e40 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f50e4009840 tx=0x7f50e4009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.533+0000 7f50f90b6700 1 -- 172.21.15.146:0/2103331287 shutdown_connections 2023-10-03T10:17:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.533+0000 7f50f90b6700 1 --2- 172.21.15.146:0/2103331287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50f40a0a70 0x7f50f40a0e40 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.533+0000 7f50f90b6700 1 --2- 172.21.15.146:0/2103331287 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50f4133f50 0x7f50f4134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.533+0000 7f50f90b6700 1 --2- 172.21.15.146:0/2103331287 >> v2:172.21.15.146:3300/0 conn(0x7f50f40a1380 0x7f50f4133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.533+0000 7f50f90b6700 1 -- 172.21.15.146:0/2103331287 >> 172.21.15.146:0/2103331287 conn(0x7f50f40a6610 msgr2=0x7f50f40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.533+0000 7f50f90b6700 1 -- 172.21.15.146:0/2103331287 shutdown_connections 2023-10-03T10:17:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.533+0000 7f50f90b6700 1 -- 172.21.15.146:0/2103331287 wait complete. 2023-10-03T10:17:59.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.534+0000 7f50f90b6700 1 Processor -- start 2023-10-03T10:17:59.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.534+0000 7f50f90b6700 1 -- start start 2023-10-03T10:17:59.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.534+0000 7f50f90b6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50f40a0a70 0x7f50f4122580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.534+0000 7f50f90b6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50f40a1380 0x7f50f4122ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.534+0000 7f50f90b6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50f4133f50 0x7f50f4123000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.534+0000 7f50f90b6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f4124190 con 0x7f50f40a0a70 2023-10-03T10:17:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.534+0000 7f50f90b6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f40a0450 con 0x7f50f40a1380 2023-10-03T10:17:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.534+0000 7f50f90b6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50f41239c0 con 0x7f50f4133f50 2023-10-03T10:17:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.535+0000 7f50f2d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50f40a0a70 0x7f50f4122580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.535+0000 7f50f2d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50f40a0a70 0x7f50f4122580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39266/0 (socket says 172.21.15.146:39266) 2023-10-03T10:17:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.535+0000 7f50f2d9d700 1 -- 172.21.15.146:0/1158075062 learned_addr learned my addr 172.21.15.146:0/1158075062 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.535+0000 7f50f359e700 1 --2- 172.21.15.146:0/1158075062 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50f4133f50 0x7f50f4123000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.535+0000 7f50f259c700 1 --2- 172.21.15.146:0/1158075062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50f40a1380 0x7f50f4122ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.535+0000 7f50f2d9d700 1 -- 172.21.15.146:0/1158075062 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50f4133f50 msgr2=0x7f50f4123000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.535+0000 7f50f2d9d700 1 --2- 172.21.15.146:0/1158075062 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50f4133f50 0x7f50f4123000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.535+0000 7f50f2d9d700 1 -- 172.21.15.146:0/1158075062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50f40a1380 msgr2=0x7f50f4122ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.535+0000 7f50f2d9d700 1 --2- 172.21.15.146:0/1158075062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50f40a1380 0x7f50f4122ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.535+0000 7f50f2d9d700 1 -- 172.21.15.146:0/1158075062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e80094a0 con 0x7f50f40a0a70 2023-10-03T10:17:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.535+0000 7f50f359e700 1 --2- 172.21.15.146:0/1158075062 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50f4133f50 0x7f50f4123000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.535+0000 7f50f259c700 1 --2- 172.21.15.146:0/1158075062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50f40a1380 0x7f50f4122ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.535+0000 7f50f2d9d700 1 --2- 172.21.15.146:0/1158075062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50f40a0a70 0x7f50f4122580 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f50e40090b0 tx=0x7f50e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.535+0000 7f50db7fe700 1 -- 172.21.15.146:0/1158075062 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4004450 con 0x7f50f40a0a70 2023-10-03T10:17:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.535+0000 7f50db7fe700 1 -- 172.21.15.146:0/1158075062 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e401e070 con 0x7f50f40a0a70 2023-10-03T10:17:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.535+0000 7f50db7fe700 1 -- 172.21.15.146:0/1158075062 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e40038e0 con 0x7f50f40a0a70 2023-10-03T10:17:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.535+0000 7f50f90b6700 1 -- 172.21.15.146:0/1158075062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e40094a0 con 0x7f50f40a0a70 2023-10-03T10:17:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.535+0000 7f50f90b6700 1 -- 172.21.15.146:0/1158075062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f409d340 con 0x7f50f40a0a70 2023-10-03T10:17:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.536+0000 7f50db7fe700 1 -- 172.21.15.146:0/1158075062 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50e4003a40 con 0x7f50f40a0a70 2023-10-03T10:17:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.536+0000 7f50db7fe700 1 -- 172.21.15.146:0/1158075062 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f50e4040350 con 0x7f50f40a0a70 2023-10-03T10:17:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.537+0000 7f50f90b6700 1 -- 172.21.15.146:0/1158075062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f404f2a0 con 0x7f50f40a0a70 2023-10-03T10:17:59.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.541+0000 7f50db7fe700 1 -- 172.21.15.146:0/1158075062 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50e4015020 con 0x7f50f40a0a70 2023-10-03T10:17:59.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.569+0000 7f617e494700 1 Processor -- start 2023-10-03T10:17:59.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.569+0000 7f617e494700 1 -- start start 2023-10-03T10:17:59.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.569+0000 7f617e494700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f61780a1550 0x7f6178138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.570+0000 7f617e494700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6178139200 0x7f617813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.570+0000 7f617e494700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f617809e9d0 con 0x7f61780a0a70 2023-10-03T10:17:59.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.570+0000 7f617e494700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f617809dc00 con 0x7f61780a1550 2023-10-03T10:17:59.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.570+0000 7f617e494700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617809dec0 con 0x7f6178139200 2023-10-03T10:17:59.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.570+0000 7f61777fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f61780a1550 0x7f6178138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.570+0000 7f6177fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f61780a0a70 0x7f61780a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35682/0 (socket says 172.21.15.146:35682) 2023-10-03T10:17:59.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.570+0000 7f61777fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f61780a1550 0x7f6178138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39270/0 (socket says 172.21.15.146:39270) 2023-10-03T10:17:59.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.570+0000 7f6177fff700 1 -- 172.21.15.146:0/2439927263 learned_addr learned my addr 172.21.15.146:0/2439927263 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:17:59.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.570+0000 7f617ca31700 1 --2- 172.21.15.146:0/2439927263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6178139200 0x7f617813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.570+0000 7f61777fe700 1 -- 172.21.15.146:0/2439927263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6178139200 msgr2=0x7f617813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:59.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.570+0000 7f61777fe700 1 --2- 172.21.15.146:0/2439927263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6178139200 0x7f617813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.570+0000 7f61777fe700 1 -- 172.21.15.146:0/2439927263 >> v1:172.21.15.146:6789/0 conn(0x7f61780a0a70 legacy=0x7f61780a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.570+0000 7f6176ffd700 1 -- 172.21.15.146:0/2439927263 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102827881 0 0) 0x7f617809e9d0 con 0x7f61780a0a70 2023-10-03T10:17:59.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.570+0000 7f61777fe700 1 -- 172.21.15.146:0/2439927263 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617809e6a0 con 0x7f61780a1550 2023-10-03T10:17:59.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.570+0000 7f61777fe700 1 --2- 172.21.15.146:0/2439927263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61780a1550 0x7f6178138cc0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f616c009840 tx=0x7f616c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9f7c274ea48411 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.570+0000 7f6176ffd700 1 -- 172.21.15.146:0/2439927263 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c011830 con 0x7f61780a1550 2023-10-03T10:17:59.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.570+0000 7f6176ffd700 1 -- 172.21.15.146:0/2439927263 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616c011990 con 0x7f61780a1550 2023-10-03T10:17:59.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.570+0000 7f6176ffd700 1 -- 172.21.15.146:0/2439927263 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c011d20 con 0x7f61780a1550 2023-10-03T10:17:59.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.571+0000 7f617e494700 1 -- 172.21.15.146:0/2439927263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61780a1550 msgr2=0x7f6178138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.571+0000 7f617e494700 1 --2- 172.21.15.146:0/2439927263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61780a1550 0x7f6178138cc0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f616c009840 tx=0x7f616c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:59.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.571+0000 7f617e494700 1 -- 172.21.15.146:0/2439927263 shutdown_connections 2023-10-03T10:17:59.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.571+0000 7f617e494700 1 --2- 172.21.15.146:0/2439927263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6178139200 0x7f617813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.571+0000 7f617e494700 1 --2- 172.21.15.146:0/2439927263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61780a1550 0x7f6178138cc0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.571+0000 7f617e494700 1 -- 172.21.15.146:0/2439927263 >> 172.21.15.146:0/2439927263 conn(0x7f61780a6610 msgr2=0x7f61780a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.571+0000 7f617e494700 1 -- 172.21.15.146:0/2439927263 shutdown_connections 2023-10-03T10:17:59.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.571+0000 7f617e494700 1 -- 172.21.15.146:0/2439927263 wait complete. 2023-10-03T10:17:59.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.572+0000 7f617e494700 1 Processor -- start 2023-10-03T10:17:59.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.572+0000 7f617e494700 1 -- start start 2023-10-03T10:17:59.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.573+0000 7f617e494700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f61780a0a70 0x7f61781207c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.573+0000 7f617e494700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61780a1550 0x7f6178120d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.573+0000 7f617e494700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6178139200 0x7f6178121240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.573+0000 7f617e494700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61781360a0 con 0x7f6178139200 2023-10-03T10:17:59.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.573+0000 7f617e494700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6178136660 con 0x7f61780a1550 2023-10-03T10:17:59.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.573+0000 7f617e494700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6178124290 con 0x7f61780a0a70 2023-10-03T10:17:59.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.573+0000 7f617ca31700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6178139200 0x7f6178121240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.573+0000 7f617ca31700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6178139200 0x7f6178121240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39276/0 (socket says 172.21.15.146:39276) 2023-10-03T10:17:59.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.573+0000 7f617ca31700 1 -- 172.21.15.146:0/2915167703 learned_addr learned my addr 172.21.15.146:0/2915167703 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:17:59.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.573+0000 7f61777fe700 1 --2- 172.21.15.146:0/2915167703 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61780a1550 0x7f6178120d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.573+0000 7f6177fff700 1 --2- 172.21.15.146:0/2915167703 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f61780a0a70 0x7f61781207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.573+0000 7f617ca31700 1 -- 172.21.15.146:0/2915167703 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f61780a0a70 msgr2=0x7f61781207c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.573+0000 7f617ca31700 1 --2- 172.21.15.146:0/2915167703 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f61780a0a70 0x7f61781207c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.573+0000 7f617ca31700 1 -- 172.21.15.146:0/2915167703 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61780a1550 msgr2=0x7f6178120d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.573+0000 7f617ca31700 1 --2- 172.21.15.146:0/2915167703 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61780a1550 0x7f6178120d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.573+0000 7f617ca31700 1 -- 172.21.15.146:0/2915167703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c0094a0 con 0x7f6178139200 2023-10-03T10:17:59.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.573+0000 7f6177fff700 1 --2- 172.21.15.146:0/2915167703 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f61780a0a70 0x7f61781207c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:59.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.573+0000 7f61777fe700 1 --2- 172.21.15.146:0/2915167703 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61780a1550 0x7f6178120d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:59.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.573+0000 7f617ca31700 1 --2- 172.21.15.146:0/2915167703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6178139200 0x7f6178121240 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f617000efc0 tx=0x7f617000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.573+0000 7f6174ff9700 1 -- 172.21.15.146:0/2915167703 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617000cc90 con 0x7f6178139200 2023-10-03T10:17:59.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.574+0000 7f6174ff9700 1 -- 172.21.15.146:0/2915167703 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617000f040 con 0x7f6178139200 2023-10-03T10:17:59.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.574+0000 7f617e494700 1 -- 172.21.15.146:0/2915167703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61780a5100 con 0x7f6178139200 2023-10-03T10:17:59.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.574+0000 7f6174ff9700 1 -- 172.21.15.146:0/2915167703 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61700146c0 con 0x7f6178139200 2023-10-03T10:17:59.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.574+0000 7f617e494700 1 -- 172.21.15.146:0/2915167703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6178122b80 con 0x7f6178139200 2023-10-03T10:17:59.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.574+0000 7f6174ff9700 1 -- 172.21.15.146:0/2915167703 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6170014820 con 0x7f6178139200 2023-10-03T10:17:59.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.574+0000 7f617e494700 1 -- 172.21.15.146:0/2915167703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617804f2a0 con 0x7f6178139200 2023-10-03T10:17:59.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.575+0000 7f6174ff9700 1 -- 172.21.15.146:0/2915167703 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f61700403c0 con 0x7f6178139200 2023-10-03T10:17:59.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.579+0000 7f6174ff9700 1 -- 172.21.15.146:0/2915167703 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6170012930 con 0x7f6178139200 2023-10-03T10:17:59.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.677+0000 7fe92f476700 1 -- 172.21.15.146:0/1943539749 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe92811ce20 con 0x7fe9280a1340 2023-10-03T10:17:59.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.677+0000 7fe91dffb700 1 -- 172.21.15.146:0/1943539749 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe91801e030 con 0x7fe9280a1340 2023-10-03T10:17:59.677 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:59.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.680+0000 7fe92f476700 1 -- 172.21.15.146:0/1943539749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9280a1340 msgr2=0x7fe92811a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.680+0000 7fe92f476700 1 --2- 172.21.15.146:0/1943539749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9280a1340 0x7fe92811a3d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe91800d960 tx=0x7fe91800dc70 comp rx=0 tx=0).stop 2023-10-03T10:17:59.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.680+0000 7fe92f476700 1 -- 172.21.15.146:0/1943539749 shutdown_connections 2023-10-03T10:17:59.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.680+0000 7fe92f476700 1 --2- 172.21.15.146:0/1943539749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9281304a0 0x7fe9281c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.680+0000 7fe92f476700 1 --2- 172.21.15.146:0/1943539749 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9280a0a30 0x7fe928119e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.680+0000 7fe92f476700 1 --2- 172.21.15.146:0/1943539749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9280a1340 0x7fe92811a3d0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.680+0000 7fe92f476700 1 -- 172.21.15.146:0/1943539749 >> 172.21.15.146:0/1943539749 conn(0x7fe9280a2980 msgr2=0x7fe92812e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.680+0000 7fe92f476700 1 -- 172.21.15.146:0/1943539749 shutdown_connections 2023-10-03T10:17:59.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.680+0000 7fe92f476700 1 -- 172.21.15.146:0/1943539749 wait complete. 2023-10-03T10:17:59.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:17:59.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.743+0000 7f50f90b6700 1 -- 172.21.15.146:0/1158075062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f50f41334d0 con 0x7f50f40a0a70 2023-10-03T10:17:59.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.743+0000 7f50db7fe700 1 -- 172.21.15.146:0/1158075062 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f50e4003cf0 con 0x7f50f40a0a70 2023-10-03T10:17:59.743 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:17:59.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.745+0000 7f50f90b6700 1 -- 172.21.15.146:0/1158075062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50f40a0a70 msgr2=0x7f50f4122580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.745+0000 7f50f90b6700 1 --2- 172.21.15.146:0/1158075062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50f40a0a70 0x7f50f4122580 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f50e40090b0 tx=0x7f50e4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:59.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.745+0000 7f50f90b6700 1 -- 172.21.15.146:0/1158075062 shutdown_connections 2023-10-03T10:17:59.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.745+0000 7f50f90b6700 1 --2- 172.21.15.146:0/1158075062 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50f4133f50 0x7f50f4123000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.745+0000 7f50f90b6700 1 --2- 172.21.15.146:0/1158075062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50f40a0a70 0x7f50f4122580 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.745+0000 7f50f90b6700 1 --2- 172.21.15.146:0/1158075062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50f40a1380 0x7f50f4122ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.745+0000 7f50f90b6700 1 -- 172.21.15.146:0/1158075062 >> 172.21.15.146:0/1158075062 conn(0x7f50f40a6610 msgr2=0x7f50f409f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.745+0000 7f50f90b6700 1 -- 172.21.15.146:0/1158075062 shutdown_connections 2023-10-03T10:17:59.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.745+0000 7f50f90b6700 1 -- 172.21.15.146:0/1158075062 wait complete. 2023-10-03T10:17:59.757 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:17:59.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.774+0000 7f617e494700 1 -- 172.21.15.146:0/2915167703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6178124010 con 0x7f6178139200 2023-10-03T10:17:59.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.775+0000 7f6174ff9700 1 -- 172.21.15.146:0/2915167703 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6170012340 con 0x7f6178139200 2023-10-03T10:17:59.774 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:17:59.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.777+0000 7f617e494700 1 -- 172.21.15.146:0/2915167703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6178139200 msgr2=0x7f6178121240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.777+0000 7f617e494700 1 --2- 172.21.15.146:0/2915167703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6178139200 0x7f6178121240 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f617000efc0 tx=0x7f617000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.777+0000 7f617e494700 1 -- 172.21.15.146:0/2915167703 shutdown_connections 2023-10-03T10:17:59.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.777+0000 7f617e494700 1 --2- 172.21.15.146:0/2915167703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6178139200 0x7f6178121240 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.777+0000 7f617e494700 1 --2- 172.21.15.146:0/2915167703 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f61780a0a70 0x7f61781207c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.777+0000 7f617e494700 1 --2- 172.21.15.146:0/2915167703 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61780a1550 0x7f6178120d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.777+0000 7f617e494700 1 -- 172.21.15.146:0/2915167703 >> 172.21.15.146:0/2915167703 conn(0x7f61780a6610 msgr2=0x7f61780a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.777+0000 7f617e494700 1 -- 172.21.15.146:0/2915167703 shutdown_connections 2023-10-03T10:17:59.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:17:59.777+0000 7f617e494700 1 -- 172.21.15.146:0/2915167703 wait complete. 2023-10-03T10:17:59.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:00.498 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:00.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.633+0000 7f0b107af700 1 Processor -- start 2023-10-03T10:18:00.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.633+0000 7f0b107af700 1 -- start start 2023-10-03T10:18:00.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.634+0000 7f0b107af700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b08136960 0x7f0b08138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.634+0000 7f0b107af700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b08139280 0x7f0b0813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.634+0000 7f0b107af700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b0806b2d0 con 0x7f0b08133ad0 2023-10-03T10:18:00.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.634+0000 7f0b107af700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b081345b0 con 0x7f0b08136960 2023-10-03T10:18:00.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.634+0000 7f0b107af700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b08133610 con 0x7f0b08139280 2023-10-03T10:18:00.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.634+0000 7f0b0dd4a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b08136960 0x7f0b08138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.634+0000 7f0b0ed4c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b08139280 0x7f0b0813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.634+0000 7f0b0e54b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0b08133ad0 0x7f0b08133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35698/0 (socket says 172.21.15.146:35698) 2023-10-03T10:18:00.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.634+0000 7f0b0e54b700 1 -- 172.21.15.146:0/1334961675 learned_addr learned my addr 172.21.15.146:0/1334961675 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:00.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.634+0000 7f0b0dd4a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b08136960 0x7f0b08138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39292/0 (socket says 172.21.15.146:39292) 2023-10-03T10:18:00.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.634+0000 7f0b0d549700 1 -- 172.21.15.146:0/1334961675 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353393355 0 0) 0x7f0b0806b2d0 con 0x7f0b08133ad0 2023-10-03T10:18:00.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.634+0000 7f0b0ed4c700 1 -- 172.21.15.146:0/1334961675 >> v2:172.21.15.146:3300/0 conn(0x7f0b08136960 msgr2=0x7f0b08138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:00.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.634+0000 7f0b0ed4c700 1 --2- 172.21.15.146:0/1334961675 >> v2:172.21.15.146:3300/0 conn(0x7f0b08136960 0x7f0b08138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.634+0000 7f0b0ed4c700 1 -- 172.21.15.146:0/1334961675 >> v1:172.21.15.146:6789/0 conn(0x7f0b08133ad0 legacy=0x7f0b08133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.634+0000 7f0b0ed4c700 1 -- 172.21.15.146:0/1334961675 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0809a500 con 0x7f0b08139280 2023-10-03T10:18:00.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.634+0000 7f0b0ed4c700 1 --2- 172.21.15.146:0/1334961675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b08139280 0x7f0b0813b660 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f0b00009d90 tx=0x7f0b0000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9358960aec6562dd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.634+0000 7f0b0d549700 1 -- 172.21.15.146:0/1334961675 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0000e070 con 0x7f0b08139280 2023-10-03T10:18:00.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.634+0000 7f0b0d549700 1 -- 172.21.15.146:0/1334961675 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0000bb20 con 0x7f0b08139280 2023-10-03T10:18:00.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.634+0000 7f0b0d549700 1 -- 172.21.15.146:0/1334961675 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b00012430 con 0x7f0b08139280 2023-10-03T10:18:00.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.635+0000 7f0b107af700 1 -- 172.21.15.146:0/1334961675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b08139280 msgr2=0x7f0b0813b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.635+0000 7f0b107af700 1 --2- 172.21.15.146:0/1334961675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b08139280 0x7f0b0813b660 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f0b00009d90 tx=0x7f0b0000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:00.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.635+0000 7f0b107af700 1 -- 172.21.15.146:0/1334961675 shutdown_connections 2023-10-03T10:18:00.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.635+0000 7f0b107af700 1 --2- 172.21.15.146:0/1334961675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b08139280 0x7f0b0813b660 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.635+0000 7f0b107af700 1 --2- 172.21.15.146:0/1334961675 >> v2:172.21.15.146:3300/0 conn(0x7f0b08136960 0x7f0b08138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.635+0000 7f0b107af700 1 -- 172.21.15.146:0/1334961675 >> 172.21.15.146:0/1334961675 conn(0x7f0b08099c40 msgr2=0x7f0b080a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.635+0000 7f0b107af700 1 -- 172.21.15.146:0/1334961675 shutdown_connections 2023-10-03T10:18:00.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.635+0000 7f0b107af700 1 -- 172.21.15.146:0/1334961675 wait complete. 2023-10-03T10:18:00.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.636+0000 7f0b107af700 1 Processor -- start 2023-10-03T10:18:00.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.636+0000 7f0b107af700 1 -- start start 2023-10-03T10:18:00.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.636+0000 7f0b107af700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b08133ad0 0x7f0b0812cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.636+0000 7f0b107af700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b08136960 0x7f0b0812d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.636+0000 7f0b107af700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b08139280 0x7f0b0812d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.636+0000 7f0b107af700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b08070210 con 0x7f0b08133ad0 2023-10-03T10:18:00.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.636+0000 7f0b107af700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b080703f0 con 0x7f0b08136960 2023-10-03T10:18:00.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.636+0000 7f0b107af700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b080726e0 con 0x7f0b08139280 2023-10-03T10:18:00.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.636+0000 7f0b0e54b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b08133ad0 0x7f0b0812cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.636+0000 7f0b0dd4a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b08136960 0x7f0b0812d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.636+0000 7f0b0e54b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b08133ad0 0x7f0b0812cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39308/0 (socket says 172.21.15.146:39308) 2023-10-03T10:18:00.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.637+0000 7f0b0e54b700 1 -- 172.21.15.146:0/2769352541 learned_addr learned my addr 172.21.15.146:0/2769352541 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:00.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.637+0000 7f0b0ed4c700 1 --2- 172.21.15.146:0/2769352541 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b08139280 0x7f0b0812d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.637+0000 7f0b0dd4a700 1 -- 172.21.15.146:0/2769352541 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b08139280 msgr2=0x7f0b0812d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.637+0000 7f0b0dd4a700 1 --2- 172.21.15.146:0/2769352541 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b08139280 0x7f0b0812d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.637+0000 7f0b0dd4a700 1 -- 172.21.15.146:0/2769352541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b08133ad0 msgr2=0x7f0b0812cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.637+0000 7f0b0dd4a700 1 --2- 172.21.15.146:0/2769352541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b08133ad0 0x7f0b0812cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.637+0000 7f0b0dd4a700 1 -- 172.21.15.146:0/2769352541 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b00009a70 con 0x7f0b08136960 2023-10-03T10:18:00.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.637+0000 7f0b0dd4a700 1 --2- 172.21.15.146:0/2769352541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b08136960 0x7f0b0812d070 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0b0400e900 tx=0x7f0b0400ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.637+0000 7f0afeffd700 1 -- 172.21.15.146:0/2769352541 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b04013680 con 0x7f0b08136960 2023-10-03T10:18:00.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.637+0000 7f0afeffd700 1 -- 172.21.15.146:0/2769352541 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b040137e0 con 0x7f0b08136960 2023-10-03T10:18:00.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.637+0000 7f0b107af700 1 -- 172.21.15.146:0/2769352541 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b081317a0 con 0x7f0b08136960 2023-10-03T10:18:00.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.637+0000 7f0afeffd700 1 -- 172.21.15.146:0/2769352541 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b04013b50 con 0x7f0b08136960 2023-10-03T10:18:00.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.637+0000 7f0b107af700 1 -- 172.21.15.146:0/2769352541 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b0809f3e0 con 0x7f0b08136960 2023-10-03T10:18:00.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.638+0000 7f0afeffd700 1 -- 172.21.15.146:0/2769352541 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b04013cb0 con 0x7f0b08136960 2023-10-03T10:18:00.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.638+0000 7f0b107af700 1 -- 172.21.15.146:0/2769352541 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b0804f2a0 con 0x7f0b08136960 2023-10-03T10:18:00.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.638+0000 7f0afeffd700 1 -- 172.21.15.146:0/2769352541 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0b0403f9c0 con 0x7f0b08136960 2023-10-03T10:18:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.643+0000 7f0afeffd700 1 -- 172.21.15.146:0/2769352541 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b04017080 con 0x7f0b08136960 2023-10-03T10:18:00.696 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:00.758 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:00.790 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.824+0000 7fb35c7e0700 1 Processor -- start 2023-10-03T10:18:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.824+0000 7fb35c7e0700 1 -- start start 2023-10-03T10:18:00.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.825+0000 7fb35c7e0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb354133a70 0x7fb354133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.825+0000 7fb35c7e0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb3540a08e0 0x7fb3540a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.825+0000 7fb35c7e0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3540a1290 0x7fb35413a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.825+0000 7fb35c7e0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb354133640 con 0x7fb3540a08e0 2023-10-03T10:18:00.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.825+0000 7fb35c7e0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3540a1d50 con 0x7fb3540a1290 2023-10-03T10:18:00.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.825+0000 7fb35c7e0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb35409b620 con 0x7fb354133a70 2023-10-03T10:18:00.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.825+0000 7fb359d7b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb3540a08e0 0x7fb3540a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.825+0000 7fb359d7b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb3540a08e0 0x7fb3540a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39314/0 (socket says 172.21.15.146:39314) 2023-10-03T10:18:00.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.825+0000 7fb35a57c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb354133a70 0x7fb354133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.825+0000 7fb359d7b700 1 -- 172.21.15.146:0/3297011383 learned_addr learned my addr 172.21.15.146:0/3297011383 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:00.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.825+0000 7fb35ad7d700 1 --2- 172.21.15.146:0/3297011383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3540a1290 0x7fb35413a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.825+0000 7fb359d7b700 1 -- 172.21.15.146:0/3297011383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb354133a70 msgr2=0x7fb354133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:00.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.825+0000 7fb359d7b700 1 --2- 172.21.15.146:0/3297011383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb354133a70 0x7fb354133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.825+0000 7fb359d7b700 1 -- 172.21.15.146:0/3297011383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3540a1290 msgr2=0x7fb35413a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:00.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.825+0000 7fb359d7b700 1 --2- 172.21.15.146:0/3297011383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3540a1290 0x7fb35413a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.825+0000 7fb359d7b700 1 -- 172.21.15.146:0/3297011383 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb354133870 con 0x7fb3540a08e0 2023-10-03T10:18:00.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.826+0000 7fb359d7b700 1 --2- 172.21.15.146:0/3297011383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3540a08e0 0x7fb3540a0d50 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fb3440098f0 tx=0x7fb344009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c792945e324e5a5f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.826+0000 7fb35957a700 1 -- 172.21.15.146:0/3297011383 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb344011830 con 0x7fb3540a08e0 2023-10-03T10:18:00.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.826+0000 7fb35957a700 1 -- 172.21.15.146:0/3297011383 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb344011990 con 0x7fb3540a08e0 2023-10-03T10:18:00.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.826+0000 7fb35957a700 1 -- 172.21.15.146:0/3297011383 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb344011d20 con 0x7fb3540a08e0 2023-10-03T10:18:00.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.827+0000 7fb35c7e0700 1 -- 172.21.15.146:0/3297011383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3540a08e0 msgr2=0x7fb3540a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.827+0000 7fb35c7e0700 1 --2- 172.21.15.146:0/3297011383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3540a08e0 0x7fb3540a0d50 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fb3440098f0 tx=0x7fb344009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:00.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.827+0000 7fb35c7e0700 1 -- 172.21.15.146:0/3297011383 shutdown_connections 2023-10-03T10:18:00.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.827+0000 7fb35c7e0700 1 --2- 172.21.15.146:0/3297011383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3540a1290 0x7fb35413a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.827+0000 7fb35c7e0700 1 --2- 172.21.15.146:0/3297011383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb354133a70 0x7fb354133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.827+0000 7fb35c7e0700 1 --2- 172.21.15.146:0/3297011383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3540a08e0 0x7fb3540a0d50 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.827+0000 7fb35c7e0700 1 -- 172.21.15.146:0/3297011383 >> 172.21.15.146:0/3297011383 conn(0x7fb3540a2980 msgr2=0x7fb3540a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.827+0000 7fb35c7e0700 1 -- 172.21.15.146:0/3297011383 shutdown_connections 2023-10-03T10:18:00.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.827+0000 7fb35c7e0700 1 -- 172.21.15.146:0/3297011383 wait complete. 2023-10-03T10:18:00.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.828+0000 7fb35c7e0700 1 Processor -- start 2023-10-03T10:18:00.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.829+0000 7fb35c7e0700 1 -- start start 2023-10-03T10:18:00.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.829+0000 7fb35c7e0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb3540a08e0 0x7fb35411a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.829+0000 7fb35c7e0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3540a1290 0x7fb35411ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.829+0000 7fb35c7e0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb354133a70 0x7fb35411b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.829+0000 7fb35c7e0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35411db80 con 0x7fb354133a70 2023-10-03T10:18:00.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.829+0000 7fb35c7e0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb354131f50 con 0x7fb3540a1290 2023-10-03T10:18:00.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.829+0000 7fb35c7e0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb35411c320 con 0x7fb3540a08e0 2023-10-03T10:18:00.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.829+0000 7fb35a57c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb3540a08e0 0x7fb35411a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.829+0000 7fb35a57c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb3540a08e0 0x7fb35411a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59276/0 (socket says 172.21.15.146:59276) 2023-10-03T10:18:00.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.829+0000 7fb35a57c700 1 -- 172.21.15.146:0/1715356607 learned_addr learned my addr 172.21.15.146:0/1715356607 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:00.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.829+0000 7fb35ad7d700 1 --2- 172.21.15.146:0/1715356607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb354133a70 0x7fb35411b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.829+0000 7fb359d7b700 1 --2- 172.21.15.146:0/1715356607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3540a1290 0x7fb35411ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.830+0000 7fb359d7b700 1 -- 172.21.15.146:0/1715356607 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb3540a08e0 msgr2=0x7fb35411a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.830+0000 7fb359d7b700 1 --2- 172.21.15.146:0/1715356607 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb3540a08e0 0x7fb35411a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.830+0000 7fb359d7b700 1 -- 172.21.15.146:0/1715356607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb354133a70 msgr2=0x7fb35411b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.830+0000 7fb359d7b700 1 --2- 172.21.15.146:0/1715356607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb354133a70 0x7fb35411b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.830+0000 7fb359d7b700 1 -- 172.21.15.146:0/1715356607 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb344009550 con 0x7fb3540a1290 2023-10-03T10:18:00.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.830+0000 7fb359d7b700 1 --2- 172.21.15.146:0/1715356607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3540a1290 0x7fb35411ab40 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fb344016000 tx=0x7fb344004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.830+0000 7fb34affd700 1 -- 172.21.15.146:0/1715356607 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb344004450 con 0x7fb3540a1290 2023-10-03T10:18:00.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.830+0000 7fb34affd700 1 -- 172.21.15.146:0/1715356607 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34401e070 con 0x7fb3540a1290 2023-10-03T10:18:00.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.830+0000 7fb35c7e0700 1 -- 172.21.15.146:0/1715356607 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb35411d4d0 con 0x7fb3540a1290 2023-10-03T10:18:00.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.830+0000 7fb34affd700 1 -- 172.21.15.146:0/1715356607 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3440038a0 con 0x7fb3540a1290 2023-10-03T10:18:00.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.830+0000 7fb35c7e0700 1 -- 172.21.15.146:0/1715356607 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35411e120 con 0x7fb3540a1290 2023-10-03T10:18:00.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.831+0000 7fb35c7e0700 1 -- 172.21.15.146:0/1715356607 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb35409e9b0 con 0x7fb3540a1290 2023-10-03T10:18:00.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.832+0000 7fb34affd700 1 -- 172.21.15.146:0/1715356607 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb344003a00 con 0x7fb3540a1290 2023-10-03T10:18:00.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.832+0000 7fb34affd700 1 -- 172.21.15.146:0/1715356607 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb344020070 con 0x7fb3540a1290 2023-10-03T10:18:00.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.837+0000 7fb34affd700 1 -- 172.21.15.146:0/1715356607 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3440045b0 con 0x7fb3540a1290 2023-10-03T10:18:00.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.841+0000 7f0b107af700 1 -- 172.21.15.146:0/2769352541 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0b081302a0 con 0x7f0b08136960 2023-10-03T10:18:00.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.841+0000 7f0afeffd700 1 -- 172.21.15.146:0/2769352541 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b0401b590 con 0x7f0b08136960 2023-10-03T10:18:00.841 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:00.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.843+0000 7f0b107af700 1 -- 172.21.15.146:0/2769352541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b08136960 msgr2=0x7f0b0812d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.843+0000 7f0b107af700 1 --2- 172.21.15.146:0/2769352541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b08136960 0x7f0b0812d070 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0b0400e900 tx=0x7f0b0400ec10 comp rx=0 tx=0).stop 2023-10-03T10:18:00.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.843+0000 7f0b107af700 1 -- 172.21.15.146:0/2769352541 shutdown_connections 2023-10-03T10:18:00.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.843+0000 7f0b107af700 1 --2- 172.21.15.146:0/2769352541 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b08139280 0x7f0b0812d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.843+0000 7f0b107af700 1 --2- 172.21.15.146:0/2769352541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b08133ad0 0x7f0b0812cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.843+0000 7f0b107af700 1 --2- 172.21.15.146:0/2769352541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b08136960 0x7f0b0812d070 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.843+0000 7f0b107af700 1 -- 172.21.15.146:0/2769352541 >> 172.21.15.146:0/2769352541 conn(0x7f0b08099c40 msgr2=0x7f0b08132880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.843+0000 7f0b107af700 1 -- 172.21.15.146:0/2769352541 shutdown_connections 2023-10-03T10:18:00.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.843+0000 7f0b107af700 1 -- 172.21.15.146:0/2769352541 wait complete. 2023-10-03T10:18:00.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:00.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.889+0000 7fd347613700 1 Processor -- start 2023-10-03T10:18:00.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.889+0000 7fd347613700 1 -- start start 2023-10-03T10:18:00.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.889+0000 7fd347613700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd340134140 0x7fd340138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.889+0000 7fd347613700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3401345a0 0x7fd34013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.889+0000 7fd347613700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd34009b110 con 0x7fd34009ad40 2023-10-03T10:18:00.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.889+0000 7fd347613700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3400a3b60 con 0x7fd340134140 2023-10-03T10:18:00.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.889+0000 7fd347613700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3400a1a80 con 0x7fd3401345a0 2023-10-03T10:18:00.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.890+0000 7fd344bae700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd340134140 0x7fd340138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.890+0000 7fd344bae700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd340134140 0x7fd340138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39332/0 (socket says 172.21.15.146:39332) 2023-10-03T10:18:00.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.890+0000 7fd344bae700 1 -- 172.21.15.146:0/77218425 learned_addr learned my addr 172.21.15.146:0/77218425 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:00.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.890+0000 7fd3453af700 1 --1- 172.21.15.146:0/77218425 >> v1:172.21.15.146:6789/0 conn(0x7fd34009ad40 0x7fd340133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35714/0 (socket says 172.21.15.146:35714) 2023-10-03T10:18:00.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.890+0000 7fd345bb0700 1 --2- 172.21.15.146:0/77218425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3401345a0 0x7fd34013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.890+0000 7fd344bae700 1 -- 172.21.15.146:0/77218425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3401345a0 msgr2=0x7fd34013b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:00.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.890+0000 7fd344bae700 1 --2- 172.21.15.146:0/77218425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3401345a0 0x7fd34013b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.890+0000 7fd344bae700 1 -- 172.21.15.146:0/77218425 >> v1:172.21.15.146:6789/0 conn(0x7fd34009ad40 legacy=0x7fd340133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.890+0000 7fd344bae700 1 -- 172.21.15.146:0/77218425 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3400a2fa0 con 0x7fd340134140 2023-10-03T10:18:00.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.890+0000 7fd345bb0700 1 --2- 172.21.15.146:0/77218425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3401345a0 0x7fd34013b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.890+0000 7fd344bae700 1 --2- 172.21.15.146:0/77218425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd340134140 0x7fd340138e80 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fd3300098f0 tx=0x7fd330009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0efbe2c73b5da5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.890+0000 7fd337fff700 1 -- 172.21.15.146:0/77218425 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd330011830 con 0x7fd340134140 2023-10-03T10:18:00.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.890+0000 7fd337fff700 1 -- 172.21.15.146:0/77218425 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd330011990 con 0x7fd340134140 2023-10-03T10:18:00.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.890+0000 7fd337fff700 1 -- 172.21.15.146:0/77218425 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd330011d20 con 0x7fd340134140 2023-10-03T10:18:00.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.891+0000 7fd347613700 1 -- 172.21.15.146:0/77218425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd340134140 msgr2=0x7fd340138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.891+0000 7fd347613700 1 --2- 172.21.15.146:0/77218425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd340134140 0x7fd340138e80 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fd3300098f0 tx=0x7fd330009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:00.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.891+0000 7fd347613700 1 -- 172.21.15.146:0/77218425 shutdown_connections 2023-10-03T10:18:00.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.891+0000 7fd347613700 1 --2- 172.21.15.146:0/77218425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3401345a0 0x7fd34013b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.891+0000 7fd347613700 1 --2- 172.21.15.146:0/77218425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd340134140 0x7fd340138e80 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.891+0000 7fd347613700 1 -- 172.21.15.146:0/77218425 >> 172.21.15.146:0/77218425 conn(0x7fd340099c40 msgr2=0x7fd34006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.891+0000 7fd347613700 1 -- 172.21.15.146:0/77218425 shutdown_connections 2023-10-03T10:18:00.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.891+0000 7fd347613700 1 -- 172.21.15.146:0/77218425 wait complete. 2023-10-03T10:18:00.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.892+0000 7fd347613700 1 Processor -- start 2023-10-03T10:18:00.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.892+0000 7fd347613700 1 -- start start 2023-10-03T10:18:00.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.892+0000 7fd347613700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd34009ad40 0x7fd34011c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.892+0000 7fd347613700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd340134140 0x7fd34011ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.892+0000 7fd347613700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3401345a0 0x7fd34011d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.892+0000 7fd347613700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34011df30 con 0x7fd34009ad40 2023-10-03T10:18:00.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.892+0000 7fd347613700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34011f920 con 0x7fd340134140 2023-10-03T10:18:00.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.892+0000 7fd347613700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd34009c7e0 con 0x7fd3401345a0 2023-10-03T10:18:00.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.892+0000 7fd344bae700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd340134140 0x7fd34011ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.892+0000 7fd3453af700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd34009ad40 0x7fd34011c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.892+0000 7fd344bae700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd340134140 0x7fd34011ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52808/0 (socket says 172.21.15.146:52808) 2023-10-03T10:18:00.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.892+0000 7fd344bae700 1 -- 172.21.15.146:0/168897056 learned_addr learned my addr 172.21.15.146:0/168897056 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:00.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.893+0000 7fd345bb0700 1 --2- 172.21.15.146:0/168897056 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3401345a0 0x7fd34011d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.893+0000 7fd344bae700 1 -- 172.21.15.146:0/168897056 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3401345a0 msgr2=0x7fd34011d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.893+0000 7fd344bae700 1 --2- 172.21.15.146:0/168897056 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3401345a0 0x7fd34011d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.893+0000 7fd344bae700 1 -- 172.21.15.146:0/168897056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd34009ad40 msgr2=0x7fd34011c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.893+0000 7fd344bae700 1 --2- 172.21.15.146:0/168897056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd34009ad40 0x7fd34011c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.893+0000 7fd344bae700 1 -- 172.21.15.146:0/168897056 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd338009a70 con 0x7fd340134140 2023-10-03T10:18:00.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.893+0000 7fd344bae700 1 --2- 172.21.15.146:0/168897056 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd340134140 0x7fd34011ce00 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd330009c40 tx=0x7fd330004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.893+0000 7fd335ffb700 1 -- 172.21.15.146:0/168897056 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3300044d0 con 0x7fd340134140 2023-10-03T10:18:00.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.893+0000 7fd335ffb700 1 -- 172.21.15.146:0/168897056 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33001e070 con 0x7fd340134140 2023-10-03T10:18:00.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.893+0000 7fd347613700 1 -- 172.21.15.146:0/168897056 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd330009550 con 0x7fd340134140 2023-10-03T10:18:00.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.893+0000 7fd335ffb700 1 -- 172.21.15.146:0/168897056 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3300038e0 con 0x7fd340134140 2023-10-03T10:18:00.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.893+0000 7fd347613700 1 -- 172.21.15.146:0/168897056 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34011ec60 con 0x7fd340134140 2023-10-03T10:18:00.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.894+0000 7fd335ffb700 1 -- 172.21.15.146:0/168897056 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd330003a40 con 0x7fd340134140 2023-10-03T10:18:00.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.894+0000 7fd347613700 1 -- 172.21.15.146:0/168897056 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34004f2a0 con 0x7fd340134140 2023-10-03T10:18:00.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.894+0000 7fd335ffb700 1 -- 172.21.15.146:0/168897056 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd330020070 con 0x7fd340134140 2023-10-03T10:18:00.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.903+0000 7fd335ffb700 1 -- 172.21.15.146:0/168897056 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd330010380 con 0x7fd340134140 2023-10-03T10:18:00.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.948+0000 7f4ad6962700 1 Processor -- start 2023-10-03T10:18:00.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.948+0000 7f4ad6962700 1 -- start start 2023-10-03T10:18:00.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.949+0000 7f4ad6962700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ad009ad40 0x7f4ad0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.949+0000 7f4ad6962700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ad0133f70 0x7f4ad01343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.949+0000 7f4ad6962700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4ad00a0a70 0x7f4ad00a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.949+0000 7f4ad6962700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad00a3b60 con 0x7f4ad00a0a70 2023-10-03T10:18:00.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.949+0000 7f4ad6962700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad01348e0 con 0x7f4ad009ad40 2023-10-03T10:18:00.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.949+0000 7f4ad6962700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad009b110 con 0x7f4ad0133f70 2023-10-03T10:18:00.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.949+0000 7f4acffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ad009ad40 0x7f4ad0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.949+0000 7f4acffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ad009ad40 0x7f4ad0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52810/0 (socket says 172.21.15.146:52810) 2023-10-03T10:18:00.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.949+0000 7f4acf7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ad0133f70 0x7f4ad01343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.949+0000 7f4acffff700 1 -- 172.21.15.146:0/3866429105 learned_addr learned my addr 172.21.15.146:0/3866429105 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:00.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.949+0000 7f4ad4eff700 1 --2- 172.21.15.146:0/3866429105 >> v2:172.21.15.146:3300/0 conn(0x7f4ad00a0a70 0x7f4ad00a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.949+0000 7f4acf7fe700 1 -- 172.21.15.146:0/3866429105 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ad009ad40 msgr2=0x7f4ad0133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:00.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.949+0000 7f4acf7fe700 1 --2- 172.21.15.146:0/3866429105 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ad009ad40 0x7f4ad0133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.949+0000 7f4acf7fe700 1 -- 172.21.15.146:0/3866429105 >> v2:172.21.15.146:3300/0 conn(0x7f4ad00a0a70 msgr2=0x7f4ad00a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:00.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.949+0000 7f4acf7fe700 1 --2- 172.21.15.146:0/3866429105 >> v2:172.21.15.146:3300/0 conn(0x7f4ad00a0a70 0x7f4ad00a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.949+0000 7f4acf7fe700 1 -- 172.21.15.146:0/3866429105 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad00a2fa0 con 0x7f4ad0133f70 2023-10-03T10:18:00.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.949+0000 7f4acffff700 1 --2- 172.21.15.146:0/3866429105 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ad009ad40 0x7f4ad0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.949+0000 7f4ad4eff700 1 --2- 172.21.15.146:0/3866429105 >> v2:172.21.15.146:3300/0 conn(0x7f4ad00a0a70 0x7f4ad00a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:00.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.950+0000 7f4acf7fe700 1 --2- 172.21.15.146:0/3866429105 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ad0133f70 0x7f4ad01343a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009840 tx=0x7f4ac4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d15cd757070b2b64 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.950+0000 7f4aceffd700 1 -- 172.21.15.146:0/3866429105 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4011830 con 0x7f4ad0133f70 2023-10-03T10:18:00.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.950+0000 7f4aceffd700 1 -- 172.21.15.146:0/3866429105 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac4011990 con 0x7f4ad0133f70 2023-10-03T10:18:00.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.950+0000 7f4aceffd700 1 -- 172.21.15.146:0/3866429105 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4011d20 con 0x7f4ad0133f70 2023-10-03T10:18:00.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.950+0000 7f4ad6962700 1 -- 172.21.15.146:0/3866429105 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ad0133f70 msgr2=0x7f4ad01343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.950+0000 7f4ad6962700 1 --2- 172.21.15.146:0/3866429105 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ad0133f70 0x7f4ad01343a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009840 tx=0x7f4ac4009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:00.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.950+0000 7f4ad6962700 1 -- 172.21.15.146:0/3866429105 shutdown_connections 2023-10-03T10:18:00.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.950+0000 7f4ad6962700 1 --2- 172.21.15.146:0/3866429105 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ad009ad40 0x7f4ad0133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.950+0000 7f4ad6962700 1 --2- 172.21.15.146:0/3866429105 >> v2:172.21.15.146:3300/0 conn(0x7f4ad00a0a70 0x7f4ad00a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.950+0000 7f4ad6962700 1 --2- 172.21.15.146:0/3866429105 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ad0133f70 0x7f4ad01343a0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.950+0000 7f4ad6962700 1 -- 172.21.15.146:0/3866429105 >> 172.21.15.146:0/3866429105 conn(0x7f4ad0099c40 msgr2=0x7f4ad006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.950+0000 7f4ad6962700 1 -- 172.21.15.146:0/3866429105 shutdown_connections 2023-10-03T10:18:00.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.950+0000 7f4ad6962700 1 -- 172.21.15.146:0/3866429105 wait complete. 2023-10-03T10:18:00.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.951+0000 7f4ad6962700 1 Processor -- start 2023-10-03T10:18:00.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.951+0000 7f4ad6962700 1 -- start start 2023-10-03T10:18:00.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.952+0000 7f4ad6962700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ad009ad40 0x7f4ad01c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.952+0000 7f4ad6962700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ad00a0a70 0x7f4ad01c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.952+0000 7f4ad6962700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ad0133f70 0x7f4ad01c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.952+0000 7f4ad6962700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad0120880 con 0x7f4ad0133f70 2023-10-03T10:18:00.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.952+0000 7f4ad6962700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad0120690 con 0x7f4ad009ad40 2023-10-03T10:18:00.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.952+0000 7f4ad6962700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad0122330 con 0x7f4ad00a0a70 2023-10-03T10:18:00.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.952+0000 7f4acffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ad009ad40 0x7f4ad01c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.952+0000 7f4acf7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ad00a0a70 0x7f4ad01c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.952+0000 7f4acffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ad009ad40 0x7f4ad01c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52824/0 (socket says 172.21.15.146:52824) 2023-10-03T10:18:00.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.952+0000 7f4acffff700 1 -- 172.21.15.146:0/2778197722 learned_addr learned my addr 172.21.15.146:0/2778197722 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:00.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.952+0000 7f4acf7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ad00a0a70 0x7f4ad01c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59296/0 (socket says 172.21.15.146:59296) 2023-10-03T10:18:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.952+0000 7f4ad4eff700 1 --2- 172.21.15.146:0/2778197722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ad0133f70 0x7f4ad01c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.952+0000 7f4acffff700 1 -- 172.21.15.146:0/2778197722 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ad00a0a70 msgr2=0x7f4ad01c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.952+0000 7f4acffff700 1 --2- 172.21.15.146:0/2778197722 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ad00a0a70 0x7f4ad01c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.952+0000 7f4acffff700 1 -- 172.21.15.146:0/2778197722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ad0133f70 msgr2=0x7f4ad01c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.952+0000 7f4acffff700 1 --2- 172.21.15.146:0/2778197722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ad0133f70 0x7f4ad01c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.952+0000 7f4acffff700 1 -- 172.21.15.146:0/2778197722 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac0009550 con 0x7f4ad009ad40 2023-10-03T10:18:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.953+0000 7f4acf7fe700 1 --2- 172.21.15.146:0/2778197722 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ad00a0a70 0x7f4ad01c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.953+0000 7f4acffff700 1 --2- 172.21.15.146:0/2778197722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ad009ad40 0x7f4ad01c8200 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000e960 tx=0x7f4ac000ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.953+0000 7f4accff9700 1 -- 172.21.15.146:0/2778197722 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0004030 con 0x7f4ad009ad40 2023-10-03T10:18:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.953+0000 7f4accff9700 1 -- 172.21.15.146:0/2778197722 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac0004190 con 0x7f4ad009ad40 2023-10-03T10:18:00.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.953+0000 7f4ad6962700 1 -- 172.21.15.146:0/2778197722 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac40094a0 con 0x7f4ad009ad40 2023-10-03T10:18:00.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.953+0000 7f4accff9700 1 -- 172.21.15.146:0/2778197722 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0004520 con 0x7f4ad009ad40 2023-10-03T10:18:00.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.953+0000 7f4ad6962700 1 -- 172.21.15.146:0/2778197722 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad0120e80 con 0x7f4ad009ad40 2023-10-03T10:18:00.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.954+0000 7f4ad6962700 1 -- 172.21.15.146:0/2778197722 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad0121360 con 0x7f4ad009ad40 2023-10-03T10:18:00.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.955+0000 7f4accff9700 1 -- 172.21.15.146:0/2778197722 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ac00036a0 con 0x7f4ad009ad40 2023-10-03T10:18:00.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.955+0000 7f4accff9700 1 -- 172.21.15.146:0/2778197722 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4ac003fc70 con 0x7f4ad009ad40 2023-10-03T10:18:00.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:00.959+0000 7f4accff9700 1 -- 172.21.15.146:0/2778197722 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ac0003950 con 0x7f4ad009ad40 2023-10-03T10:18:01.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.059+0000 7fb35c7e0700 1 -- 172.21.15.146:0/1715356607 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb35404f2a0 con 0x7fb3540a1290 2023-10-03T10:18:01.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.060+0000 7fb34affd700 1 -- 172.21.15.146:0/1715356607 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb344015070 con 0x7fb3540a1290 2023-10-03T10:18:01.060 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:01.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.063+0000 7fb35c7e0700 1 -- 172.21.15.146:0/1715356607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3540a1290 msgr2=0x7fb35411ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.063+0000 7fb35c7e0700 1 --2- 172.21.15.146:0/1715356607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3540a1290 0x7fb35411ab40 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fb344016000 tx=0x7fb344004750 comp rx=0 tx=0).stop 2023-10-03T10:18:01.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.063+0000 7fb35c7e0700 1 -- 172.21.15.146:0/1715356607 shutdown_connections 2023-10-03T10:18:01.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.063+0000 7fb35c7e0700 1 --2- 172.21.15.146:0/1715356607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb354133a70 0x7fb35411b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.063+0000 7fb35c7e0700 1 --2- 172.21.15.146:0/1715356607 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb3540a08e0 0x7fb35411a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.063+0000 7fb35c7e0700 1 --2- 172.21.15.146:0/1715356607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3540a1290 0x7fb35411ab40 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.063+0000 7fb35c7e0700 1 -- 172.21.15.146:0/1715356607 >> 172.21.15.146:0/1715356607 conn(0x7fb3540a2980 msgr2=0x7fb35412f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:01.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.063+0000 7fb35c7e0700 1 -- 172.21.15.146:0/1715356607 shutdown_connections 2023-10-03T10:18:01.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.063+0000 7fb35c7e0700 1 -- 172.21.15.146:0/1715356607 wait complete. 2023-10-03T10:18:01.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:01.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.101+0000 7fd347613700 1 -- 172.21.15.146:0/168897056 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd3400729d0 con 0x7fd340134140 2023-10-03T10:18:01.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.102+0000 7fd335ffb700 1 -- 172.21.15.146:0/168897056 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd33000bbd0 con 0x7fd340134140 2023-10-03T10:18:01.102 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:01.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.104+0000 7fd347613700 1 -- 172.21.15.146:0/168897056 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd340134140 msgr2=0x7fd34011ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.104+0000 7fd347613700 1 --2- 172.21.15.146:0/168897056 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd340134140 0x7fd34011ce00 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd330009c40 tx=0x7fd330004750 comp rx=0 tx=0).stop 2023-10-03T10:18:01.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.104+0000 7fd347613700 1 -- 172.21.15.146:0/168897056 shutdown_connections 2023-10-03T10:18:01.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.104+0000 7fd347613700 1 --2- 172.21.15.146:0/168897056 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd3401345a0 0x7fd34011d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.104+0000 7fd347613700 1 --2- 172.21.15.146:0/168897056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd34009ad40 0x7fd34011c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.104+0000 7fd347613700 1 --2- 172.21.15.146:0/168897056 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd340134140 0x7fd34011ce00 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.104+0000 7fd347613700 1 -- 172.21.15.146:0/168897056 >> 172.21.15.146:0/168897056 conn(0x7fd340099c40 msgr2=0x7fd34013b130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:01.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.104+0000 7fd347613700 1 -- 172.21.15.146:0/168897056 shutdown_connections 2023-10-03T10:18:01.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.104+0000 7fd347613700 1 -- 172.21.15.146:0/168897056 wait complete. 2023-10-03T10:18:01.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:01.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.154+0000 7f4ad6962700 1 -- 172.21.15.146:0/2778197722 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4ad004f2a0 con 0x7f4ad009ad40 2023-10-03T10:18:01.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.154+0000 7f4accff9700 1 -- 172.21.15.146:0/2778197722 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ac0020020 con 0x7f4ad009ad40 2023-10-03T10:18:01.154 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:01.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.156+0000 7f4ad6962700 1 -- 172.21.15.146:0/2778197722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ad009ad40 msgr2=0x7f4ad01c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.156+0000 7f4ad6962700 1 --2- 172.21.15.146:0/2778197722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ad009ad40 0x7f4ad01c8200 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000e960 tx=0x7f4ac000ec70 comp rx=0 tx=0).stop 2023-10-03T10:18:01.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.156+0000 7f4ad6962700 1 -- 172.21.15.146:0/2778197722 shutdown_connections 2023-10-03T10:18:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.156+0000 7f4ad6962700 1 --2- 172.21.15.146:0/2778197722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ad0133f70 0x7f4ad01c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.156+0000 7f4ad6962700 1 --2- 172.21.15.146:0/2778197722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ad009ad40 0x7f4ad01c8200 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.156+0000 7f4ad6962700 1 --2- 172.21.15.146:0/2778197722 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ad00a0a70 0x7f4ad01c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.156+0000 7f4ad6962700 1 -- 172.21.15.146:0/2778197722 >> 172.21.15.146:0/2778197722 conn(0x7f4ad0099c40 msgr2=0x7f4ad01bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.156+0000 7f4ad6962700 1 -- 172.21.15.146:0/2778197722 shutdown_connections 2023-10-03T10:18:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.157+0000 7f4ad6962700 1 -- 172.21.15.146:0/2778197722 wait complete. 2023-10-03T10:18:01.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:01.857 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.991+0000 7f757ae4f700 1 Processor -- start 2023-10-03T10:18:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.991+0000 7f757ae4f700 1 -- start start 2023-10-03T10:18:01.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.992+0000 7f757ae4f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7574136960 0x7f7574138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.992+0000 7f757ae4f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7574139280 0x7f757413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.992+0000 7f757ae4f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757406b2d0 con 0x7f7574133ad0 2023-10-03T10:18:01.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.992+0000 7f757ae4f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75741345b0 con 0x7f7574139280 2023-10-03T10:18:01.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.992+0000 7f757ae4f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7574133610 con 0x7f7574136960 2023-10-03T10:18:01.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.992+0000 7f7573fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7574136960 0x7f7574138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.992+0000 7f7578beb700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7574133ad0 0x7f7574133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35726/0 (socket says 172.21.15.146:35726) 2023-10-03T10:18:01.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.992+0000 7f75793ec700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7574139280 0x7f757413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.992+0000 7f7578beb700 1 -- 172.21.15.146:0/2938136225 learned_addr learned my addr 172.21.15.146:0/2938136225 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:01.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.992+0000 7f75737fe700 1 -- 172.21.15.146:0/2938136225 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679593040 0 0) 0x7f757406b2d0 con 0x7f7574133ad0 2023-10-03T10:18:01.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.992+0000 7f7573fff700 1 -- 172.21.15.146:0/2938136225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7574139280 msgr2=0x7f757413b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:01.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.992+0000 7f7573fff700 1 --2- 172.21.15.146:0/2938136225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7574139280 0x7f757413b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.992+0000 7f7573fff700 1 -- 172.21.15.146:0/2938136225 >> v1:172.21.15.146:6789/0 conn(0x7f7574133ad0 legacy=0x7f7574133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.992+0000 7f7573fff700 1 -- 172.21.15.146:0/2938136225 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757409a500 con 0x7f7574136960 2023-10-03T10:18:01.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.992+0000 7f75793ec700 1 --2- 172.21.15.146:0/2938136225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7574139280 0x7f757413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:01.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.992+0000 7f7573fff700 1 --2- 172.21.15.146:0/2938136225 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7574136960 0x7f7574138d40 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7560009870 tx=0x7f7560009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bee8cb254f41ba5b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:01.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.992+0000 7f75737fe700 1 -- 172.21.15.146:0/2938136225 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7560011830 con 0x7f7574136960 2023-10-03T10:18:01.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.992+0000 7f75737fe700 1 -- 172.21.15.146:0/2938136225 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7560011990 con 0x7f7574136960 2023-10-03T10:18:01.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.992+0000 7f75737fe700 1 -- 172.21.15.146:0/2938136225 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7560011d20 con 0x7f7574136960 2023-10-03T10:18:01.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.993+0000 7f757ae4f700 1 -- 172.21.15.146:0/2938136225 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7574136960 msgr2=0x7f7574138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.993+0000 7f757ae4f700 1 --2- 172.21.15.146:0/2938136225 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7574136960 0x7f7574138d40 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7560009870 tx=0x7f7560009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:01.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.993+0000 7f757ae4f700 1 -- 172.21.15.146:0/2938136225 shutdown_connections 2023-10-03T10:18:01.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.993+0000 7f757ae4f700 1 --2- 172.21.15.146:0/2938136225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7574139280 0x7f757413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.993+0000 7f757ae4f700 1 --2- 172.21.15.146:0/2938136225 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7574136960 0x7f7574138d40 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.993+0000 7f757ae4f700 1 -- 172.21.15.146:0/2938136225 >> 172.21.15.146:0/2938136225 conn(0x7f7574099c40 msgr2=0x7f75740a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:01.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.993+0000 7f757ae4f700 1 -- 172.21.15.146:0/2938136225 shutdown_connections 2023-10-03T10:18:01.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.993+0000 7f757ae4f700 1 -- 172.21.15.146:0/2938136225 wait complete. 2023-10-03T10:18:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.994+0000 7f757ae4f700 1 Processor -- start 2023-10-03T10:18:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.994+0000 7f757ae4f700 1 -- start start 2023-10-03T10:18:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.994+0000 7f757ae4f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7574133ad0 0x7f757412cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.994+0000 7f757ae4f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7574136960 0x7f757412d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.994+0000 7f757ae4f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7574139280 0x7f757412d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.994+0000 7f757ae4f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75741303a0 con 0x7f7574136960 2023-10-03T10:18:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.994+0000 7f757ae4f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7574072080 con 0x7f7574139280 2023-10-03T10:18:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.994+0000 7f757ae4f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7574072240 con 0x7f7574133ad0 2023-10-03T10:18:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.995+0000 7f7578beb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7574133ad0 0x7f757412cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.995+0000 7f7573fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7574136960 0x7f757412d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.995+0000 7f7578beb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7574133ad0 0x7f757412cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59316/0 (socket says 172.21.15.146:59316) 2023-10-03T10:18:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.995+0000 7f75793ec700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7574139280 0x7f757412d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.995+0000 7f7578beb700 1 -- 172.21.15.146:0/3505477356 learned_addr learned my addr 172.21.15.146:0/3505477356 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.995+0000 7f75793ec700 1 -- 172.21.15.146:0/3505477356 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7574133ad0 msgr2=0x7f757412cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.995+0000 7f75793ec700 1 --2- 172.21.15.146:0/3505477356 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7574133ad0 0x7f757412cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.995+0000 7f75793ec700 1 -- 172.21.15.146:0/3505477356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7574136960 msgr2=0x7f757412d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.995+0000 7f75793ec700 1 --2- 172.21.15.146:0/3505477356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7574136960 0x7f757412d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.995+0000 7f75793ec700 1 -- 172.21.15.146:0/3505477356 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c009a70 con 0x7f7574139280 2023-10-03T10:18:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.995+0000 7f7573fff700 1 --2- 172.21.15.146:0/3505477356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7574136960 0x7f757412d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.995+0000 7f7578beb700 1 --2- 172.21.15.146:0/3505477356 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7574133ad0 0x7f757412cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.995+0000 7f75793ec700 1 --2- 172.21.15.146:0/3505477356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7574139280 0x7f757412d5b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f756c00efc0 tx=0x7f756c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.995+0000 7f75717fa700 1 -- 172.21.15.146:0/3505477356 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c00ca90 con 0x7f7574139280 2023-10-03T10:18:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.995+0000 7f75717fa700 1 -- 172.21.15.146:0/3505477356 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c00f040 con 0x7f7574139280 2023-10-03T10:18:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.995+0000 7f757ae4f700 1 -- 172.21.15.146:0/3505477356 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75600094a0 con 0x7f7574139280 2023-10-03T10:18:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.995+0000 7f75717fa700 1 -- 172.21.15.146:0/3505477356 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c00ce30 con 0x7f7574139280 2023-10-03T10:18:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.995+0000 7f757ae4f700 1 -- 172.21.15.146:0/3505477356 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7574138e50 con 0x7f7574139280 2023-10-03T10:18:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.996+0000 7f75717fa700 1 -- 172.21.15.146:0/3505477356 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f756c014480 con 0x7f7574139280 2023-10-03T10:18:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.996+0000 7f75717fa700 1 -- 172.21.15.146:0/3505477356 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f756c03fa90 con 0x7f7574139280 2023-10-03T10:18:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:01.996+0000 7f757ae4f700 1 -- 172.21.15.146:0/3505477356 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7574138e50 con 0x7f7574139280 2023-10-03T10:18:02.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.001+0000 7f75717fa700 1 -- 172.21.15.146:0/3505477356 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7574138e50 con 0x7f7574139280 2023-10-03T10:18:02.076 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:02.117 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:02.169 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:02.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.202+0000 7f757ae4f700 1 -- 172.21.15.146:0/3505477356 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7574138e50 con 0x7f7574139280 2023-10-03T10:18:02.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.203+0000 7f75717fa700 1 -- 172.21.15.146:0/3505477356 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7574138e50 con 0x7f7574139280 2023-10-03T10:18:02.203 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:02.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.204+0000 7f52c506b700 1 Processor -- start 2023-10-03T10:18:02.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.204+0000 7f52c506b700 1 -- start start 2023-10-03T10:18:02.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.205+0000 7f52c506b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c0136950 0x7f52c0138d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.205+0000 7f52c506b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c0139270 0x7f52c013b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.205+0000 7f52c506b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c0133640 con 0x7f52c0133a70 2023-10-03T10:18:02.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.205+0000 7f52c506b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00a1d50 con 0x7f52c0136950 2023-10-03T10:18:02.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.205+0000 7f52c506b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52c0134550 con 0x7f52c0139270 2023-10-03T10:18:02.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.205+0000 7f52be59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c0136950 0x7f52c0138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.205+0000 7f52bed9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f52c0133a70 0x7f52c0133e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35740/0 (socket says 172.21.15.146:35740) 2023-10-03T10:18:02.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.205+0000 7f52bed9d700 1 -- 172.21.15.146:0/1641915211 learned_addr learned my addr 172.21.15.146:0/1641915211 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:02.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.205+0000 7f52be59c700 1 -- 172.21.15.146:0/1641915211 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c0139270 msgr2=0x7f52c013b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:02.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.205+0000 7f52bf59e700 1 --2- 172.21.15.146:0/1641915211 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c0139270 0x7f52c013b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.205+0000 7f52bdd9b700 1 -- 172.21.15.146:0/1641915211 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3234218043 0 0) 0x7f52c0133640 con 0x7f52c0133a70 2023-10-03T10:18:02.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.205+0000 7f52be59c700 1 --2- 172.21.15.146:0/1641915211 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c0139270 0x7f52c013b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.205+0000 7f52be59c700 1 -- 172.21.15.146:0/1641915211 >> v1:172.21.15.146:6789/0 conn(0x7f52c0133a70 legacy=0x7f52c0133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.205+0000 7f52be59c700 1 -- 172.21.15.146:0/1641915211 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c009b620 con 0x7f52c0136950 2023-10-03T10:18:02.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.205+0000 7f52bf59e700 1 --2- 172.21.15.146:0/1641915211 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c0139270 0x7f52c013b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:02.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.205+0000 7f757ae4f700 1 -- 172.21.15.146:0/3505477356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7574139280 msgr2=0x7f757412d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.205+0000 7f757ae4f700 1 --2- 172.21.15.146:0/3505477356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7574139280 0x7f757412d5b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f756c00efc0 tx=0x7f756c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.206+0000 7f757ae4f700 1 -- 172.21.15.146:0/3505477356 shutdown_connections 2023-10-03T10:18:02.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.206+0000 7f757ae4f700 1 --2- 172.21.15.146:0/3505477356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7574139280 0x7f757412d5b0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.206+0000 7f757ae4f700 1 --2- 172.21.15.146:0/3505477356 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7574133ad0 0x7f757412cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.206+0000 7f757ae4f700 1 --2- 172.21.15.146:0/3505477356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7574136960 0x7f757412d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.206+0000 7f757ae4f700 1 -- 172.21.15.146:0/3505477356 >> 172.21.15.146:0/3505477356 conn(0x7f7574099c40 msgr2=0x7f7574134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.206+0000 7f52be59c700 1 --2- 172.21.15.146:0/1641915211 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c0136950 0x7f52c0138d30 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f52b4009870 tx=0x7f52b4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45959bf7ac135f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.206+0000 7f757ae4f700 1 -- 172.21.15.146:0/3505477356 shutdown_connections 2023-10-03T10:18:02.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.206+0000 7f757ae4f700 1 -- 172.21.15.146:0/3505477356 wait complete. 2023-10-03T10:18:02.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.206+0000 7f52bdd9b700 1 -- 172.21.15.146:0/1641915211 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4011830 con 0x7f52c0136950 2023-10-03T10:18:02.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.206+0000 7f52bdd9b700 1 -- 172.21.15.146:0/1641915211 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b4011990 con 0x7f52c0136950 2023-10-03T10:18:02.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.206+0000 7f52bdd9b700 1 -- 172.21.15.146:0/1641915211 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4011d20 con 0x7f52c0136950 2023-10-03T10:18:02.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.207+0000 7f52c506b700 1 -- 172.21.15.146:0/1641915211 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c0136950 msgr2=0x7f52c0138d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.207+0000 7f52c506b700 1 --2- 172.21.15.146:0/1641915211 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c0136950 0x7f52c0138d30 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f52b4009870 tx=0x7f52b4009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:02.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.208+0000 7f52c506b700 1 -- 172.21.15.146:0/1641915211 shutdown_connections 2023-10-03T10:18:02.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.208+0000 7f52c506b700 1 --2- 172.21.15.146:0/1641915211 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c0139270 0x7f52c013b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.208+0000 7f52c506b700 1 --2- 172.21.15.146:0/1641915211 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c0136950 0x7f52c0138d30 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.208+0000 7f52c506b700 1 -- 172.21.15.146:0/1641915211 >> 172.21.15.146:0/1641915211 conn(0x7f52c00a2980 msgr2=0x7f52c00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.210+0000 7f52c506b700 1 -- 172.21.15.146:0/1641915211 shutdown_connections 2023-10-03T10:18:02.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.210+0000 7f52c506b700 1 -- 172.21.15.146:0/1641915211 wait complete. 2023-10-03T10:18:02.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.211+0000 7f52c506b700 1 Processor -- start 2023-10-03T10:18:02.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.211+0000 7f52c506b700 1 -- start start 2023-10-03T10:18:02.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.212+0000 7f52c506b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c0133a70 0x7f52c012dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.212+0000 7f52c506b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c0136950 0x7f52c012e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.212+0000 7f52c506b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c0139270 0x7f52c0119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.212+0000 7f52c506b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c009a350 con 0x7f52c0139270 2023-10-03T10:18:02.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.212+0000 7f52c506b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c011c330 con 0x7f52c0133a70 2023-10-03T10:18:02.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.212+0000 7f52c506b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52c011c5f0 con 0x7f52c0136950 2023-10-03T10:18:02.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.212+0000 7f52bed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c0133a70 0x7f52c012dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.212+0000 7f52be59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c0136950 0x7f52c012e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.212+0000 7f52be59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c0136950 0x7f52c012e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59338/0 (socket says 172.21.15.146:59338) 2023-10-03T10:18:02.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.212+0000 7f52bed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c0133a70 0x7f52c012dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52838/0 (socket says 172.21.15.146:52838) 2023-10-03T10:18:02.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.212+0000 7f52be59c700 1 -- 172.21.15.146:0/3105489969 learned_addr learned my addr 172.21.15.146:0/3105489969 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:02.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.212+0000 7f52bf59e700 1 --2- 172.21.15.146:0/3105489969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c0139270 0x7f52c0119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.213+0000 7f52bed9d700 1 -- 172.21.15.146:0/3105489969 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c0136950 msgr2=0x7f52c012e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.213+0000 7f52bed9d700 1 --2- 172.21.15.146:0/3105489969 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c0136950 0x7f52c012e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.213+0000 7f52bed9d700 1 -- 172.21.15.146:0/3105489969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c0139270 msgr2=0x7f52c0119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.213+0000 7f52bed9d700 1 --2- 172.21.15.146:0/3105489969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c0139270 0x7f52c0119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.213+0000 7f52bed9d700 1 -- 172.21.15.146:0/3105489969 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b40094a0 con 0x7f52c0133a70 2023-10-03T10:18:02.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.213+0000 7f52bf59e700 1 --2- 172.21.15.146:0/3105489969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c0139270 0x7f52c0119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:02.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.213+0000 7f52be59c700 1 --2- 172.21.15.146:0/3105489969 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c0136950 0x7f52c012e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:02.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.213+0000 7f52bed9d700 1 --2- 172.21.15.146:0/3105489969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c0133a70 0x7f52c012dd80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f52b000c750 tx=0x7f52b000ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.213+0000 7f52a77fe700 1 -- 172.21.15.146:0/3105489969 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b00074e0 con 0x7f52c0133a70 2023-10-03T10:18:02.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.213+0000 7f52a77fe700 1 -- 172.21.15.146:0/3105489969 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b0007640 con 0x7f52c0133a70 2023-10-03T10:18:02.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.213+0000 7f52a77fe700 1 -- 172.21.15.146:0/3105489969 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b0005a70 con 0x7f52c0133a70 2023-10-03T10:18:02.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.213+0000 7f52c506b700 1 -- 172.21.15.146:0/3105489969 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c011d1a0 con 0x7f52c0133a70 2023-10-03T10:18:02.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.213+0000 7f52c506b700 1 -- 172.21.15.146:0/3105489969 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c011ac70 con 0x7f52c0133a70 2023-10-03T10:18:02.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.214+0000 7f52a77fe700 1 -- 172.21.15.146:0/3105489969 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52b0005bd0 con 0x7f52c0133a70 2023-10-03T10:18:02.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.214+0000 7f52a77fe700 1 -- 172.21.15.146:0/3105489969 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f52b003ea80 con 0x7f52c0133a70 2023-10-03T10:18:02.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.214+0000 7f52c506b700 1 -- 172.21.15.146:0/3105489969 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c009c120 con 0x7f52c0133a70 2023-10-03T10:18:02.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.219+0000 7f52a77fe700 1 -- 172.21.15.146:0/3105489969 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52b0017080 con 0x7f52c0133a70 2023-10-03T10:18:02.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:02.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.251+0000 7f53d8071700 1 Processor -- start 2023-10-03T10:18:02.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.251+0000 7f53d8071700 1 -- start start 2023-10-03T10:18:02.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.252+0000 7f53d8071700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53d00a1550 0x7f53d0138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.252+0000 7f53d8071700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d0139200 0x7f53d013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.252+0000 7f53d8071700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d009e9d0 con 0x7f53d00a0a70 2023-10-03T10:18:02.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.252+0000 7f53d8071700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d009dc00 con 0x7f53d0139200 2023-10-03T10:18:02.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.252+0000 7f53d8071700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53d009dec0 con 0x7f53d00a1550 2023-10-03T10:18:02.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.252+0000 7f53d5e0d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f53d00a0a70 0x7f53d00a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35756/0 (socket says 172.21.15.146:35756) 2023-10-03T10:18:02.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.252+0000 7f53d5e0d700 1 -- 172.21.15.146:0/1228659639 learned_addr learned my addr 172.21.15.146:0/1228659639 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:02.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.252+0000 7f53d560c700 1 --2- 172.21.15.146:0/1228659639 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53d00a1550 0x7f53d0138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.252+0000 7f53d660e700 1 --2- 172.21.15.146:0/1228659639 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d0139200 0x7f53d013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.252+0000 7f53d4e0b700 1 -- 172.21.15.146:0/1228659639 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955501088 0 0) 0x7f53d009e9d0 con 0x7f53d00a0a70 2023-10-03T10:18:02.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.252+0000 7f53d4e0b700 1 -- 172.21.15.146:0/1228659639 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53bc0035b0 con 0x7f53d00a0a70 2023-10-03T10:18:02.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.253+0000 7f53d660e700 1 -- 172.21.15.146:0/1228659639 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53d00a1550 msgr2=0x7f53d0138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:02.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.253+0000 7f53d660e700 1 --2- 172.21.15.146:0/1228659639 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53d00a1550 0x7f53d0138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.253+0000 7f53d660e700 1 -- 172.21.15.146:0/1228659639 >> v1:172.21.15.146:6789/0 conn(0x7f53d00a0a70 legacy=0x7f53d00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.253+0000 7f53d660e700 1 -- 172.21.15.146:0/1228659639 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d009e6a0 con 0x7f53d0139200 2023-10-03T10:18:02.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.253+0000 7f53d560c700 1 --2- 172.21.15.146:0/1228659639 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53d00a1550 0x7f53d0138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:02.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.253+0000 7f53d660e700 1 --2- 172.21.15.146:0/1228659639 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d0139200 0x7f53d013b5e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009dc0 tx=0x7f53c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1ae7344a16c22bf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.253+0000 7f53d4e0b700 1 -- 172.21.15.146:0/1228659639 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c800e070 con 0x7f53d0139200 2023-10-03T10:18:02.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.253+0000 7f53d4e0b700 1 -- 172.21.15.146:0/1228659639 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c800bae0 con 0x7f53d0139200 2023-10-03T10:18:02.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.253+0000 7f53d4e0b700 1 -- 172.21.15.146:0/1228659639 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c800be70 con 0x7f53d0139200 2023-10-03T10:18:02.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.254+0000 7f53d8071700 1 -- 172.21.15.146:0/1228659639 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d0139200 msgr2=0x7f53d013b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.254+0000 7f53d8071700 1 --2- 172.21.15.146:0/1228659639 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d0139200 0x7f53d013b5e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009dc0 tx=0x7f53c800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:02.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.254+0000 7f53d8071700 1 -- 172.21.15.146:0/1228659639 shutdown_connections 2023-10-03T10:18:02.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.254+0000 7f53d8071700 1 --2- 172.21.15.146:0/1228659639 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d0139200 0x7f53d013b5e0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.254+0000 7f53d8071700 1 --2- 172.21.15.146:0/1228659639 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53d00a1550 0x7f53d0138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.254+0000 7f53d8071700 1 -- 172.21.15.146:0/1228659639 >> 172.21.15.146:0/1228659639 conn(0x7f53d00a6610 msgr2=0x7f53d00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.254+0000 7f53d8071700 1 -- 172.21.15.146:0/1228659639 shutdown_connections 2023-10-03T10:18:02.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.254+0000 7f53d8071700 1 -- 172.21.15.146:0/1228659639 wait complete. 2023-10-03T10:18:02.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.255+0000 7f53d8071700 1 Processor -- start 2023-10-03T10:18:02.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.255+0000 7f53d8071700 1 -- start start 2023-10-03T10:18:02.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.256+0000 7f53d8071700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53d00a0a70 0x7f53d011e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.256+0000 7f53d8071700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d00a1550 0x7f53d011ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.256+0000 7f53d8071700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53d0139200 0x7f53d011f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.256+0000 7f53d8071700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d01203e0 con 0x7f53d0139200 2023-10-03T10:18:02.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.256+0000 7f53d8071700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d0120a00 con 0x7f53d00a1550 2023-10-03T10:18:02.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.256+0000 7f53d8071700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00a0450 con 0x7f53d00a0a70 2023-10-03T10:18:02.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.256+0000 7f53d5e0d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53d00a0a70 0x7f53d011e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.256+0000 7f53d5e0d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53d00a0a70 0x7f53d011e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59348/0 (socket says 172.21.15.146:59348) 2023-10-03T10:18:02.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.256+0000 7f53d5e0d700 1 -- 172.21.15.146:0/1752676743 learned_addr learned my addr 172.21.15.146:0/1752676743 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:02.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.256+0000 7f53d560c700 1 --2- 172.21.15.146:0/1752676743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d00a1550 0x7f53d011ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.256+0000 7f53d660e700 1 --2- 172.21.15.146:0/1752676743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53d0139200 0x7f53d011f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.256+0000 7f53d560c700 1 -- 172.21.15.146:0/1752676743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53d00a0a70 msgr2=0x7f53d011e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.256+0000 7f53d560c700 1 --2- 172.21.15.146:0/1752676743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53d00a0a70 0x7f53d011e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.256+0000 7f53d560c700 1 -- 172.21.15.146:0/1752676743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53d0139200 msgr2=0x7f53d011f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.256+0000 7f53d560c700 1 --2- 172.21.15.146:0/1752676743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53d0139200 0x7f53d011f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.256+0000 7f53d560c700 1 -- 172.21.15.146:0/1752676743 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c00094a0 con 0x7f53d00a1550 2023-10-03T10:18:02.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.257+0000 7f53d560c700 1 --2- 172.21.15.146:0/1752676743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d00a1550 0x7f53d011ed60 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f53c000e9e0 tx=0x7f53c000ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.257+0000 7f53c67fc700 1 -- 172.21.15.146:0/1752676743 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c000ee80 con 0x7f53d00a1550 2023-10-03T10:18:02.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.257+0000 7f53c67fc700 1 -- 172.21.15.146:0/1752676743 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c000c7f0 con 0x7f53d00a1550 2023-10-03T10:18:02.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.257+0000 7f53d8071700 1 -- 172.21.15.146:0/1752676743 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c8009a70 con 0x7f53d00a1550 2023-10-03T10:18:02.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.257+0000 7f53c67fc700 1 -- 172.21.15.146:0/1752676743 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c000cba0 con 0x7f53d00a1550 2023-10-03T10:18:02.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.257+0000 7f53d8071700 1 -- 172.21.15.146:0/1752676743 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d0122070 con 0x7f53d00a1550 2023-10-03T10:18:02.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.258+0000 7f53c67fc700 1 -- 172.21.15.146:0/1752676743 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f53c000cd00 con 0x7f53d00a1550 2023-10-03T10:18:02.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.258+0000 7f53c67fc700 1 -- 172.21.15.146:0/1752676743 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f53c003fa30 con 0x7f53d00a1550 2023-10-03T10:18:02.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.258+0000 7f53d8071700 1 -- 172.21.15.146:0/1752676743 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d009ea80 con 0x7f53d00a1550 2023-10-03T10:18:02.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.267+0000 7f53c67fc700 1 -- 172.21.15.146:0/1752676743 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f53c0021080 con 0x7f53d00a1550 2023-10-03T10:18:02.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.303+0000 7f0b1d602700 1 Processor -- start 2023-10-03T10:18:02.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.303+0000 7f0b1d602700 1 -- start start 2023-10-03T10:18:02.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.304+0000 7f0b1d602700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b1809f200 0x7f0b18138a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.304+0000 7f0b1d602700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b18138f80 0x7f0b1813b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.304+0000 7f0b1d602700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b18072b60 con 0x7f0b1809e720 2023-10-03T10:18:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.304+0000 7f0b1d602700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b180a03d0 con 0x7f0b1809f200 2023-10-03T10:18:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.304+0000 7f0b1d602700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1809f7d0 con 0x7f0b18138f80 2023-10-03T10:18:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.304+0000 7f0b167fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b1809f200 0x7f0b18138a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.304+0000 7f0b16ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0b1809e720 0x7f0b1809eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35772/0 (socket says 172.21.15.146:35772) 2023-10-03T10:18:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.304+0000 7f0b16ffd700 1 -- 172.21.15.146:0/2623516117 learned_addr learned my addr 172.21.15.146:0/2623516117 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.304+0000 7f0b167fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b1809f200 0x7f0b18138a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52848/0 (socket says 172.21.15.146:52848) 2023-10-03T10:18:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.304+0000 7f0b177fe700 1 --2- 172.21.15.146:0/2623516117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b18138f80 0x7f0b1813b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.304+0000 7f0b15ffb700 1 -- 172.21.15.146:0/2623516117 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3630677698 0 0) 0x7f0b18072b60 con 0x7f0b1809e720 2023-10-03T10:18:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.304+0000 7f0b167fc700 1 -- 172.21.15.146:0/2623516117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b18138f80 msgr2=0x7f0b1813b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.304+0000 7f0b167fc700 1 --2- 172.21.15.146:0/2623516117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b18138f80 0x7f0b1813b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.304+0000 7f0b167fc700 1 -- 172.21.15.146:0/2623516117 >> v1:172.21.15.146:6789/0 conn(0x7f0b1809e720 legacy=0x7f0b1809eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.304+0000 7f0b167fc700 1 -- 172.21.15.146:0/2623516117 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1806be50 con 0x7f0b1809f200 2023-10-03T10:18:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.304+0000 7f0b167fc700 1 --2- 172.21.15.146:0/2623516117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b1809f200 0x7f0b18138a40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c0098a0 tx=0x7f0b0c009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb4117ac4ff19f2a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.305+0000 7f0b15ffb700 1 -- 172.21.15.146:0/2623516117 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c011830 con 0x7f0b1809f200 2023-10-03T10:18:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.305+0000 7f0b15ffb700 1 -- 172.21.15.146:0/2623516117 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c011990 con 0x7f0b1809f200 2023-10-03T10:18:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.305+0000 7f0b15ffb700 1 -- 172.21.15.146:0/2623516117 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c011d40 con 0x7f0b1809f200 2023-10-03T10:18:02.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.305+0000 7f0b1d602700 1 -- 172.21.15.146:0/2623516117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b1809f200 msgr2=0x7f0b18138a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.305+0000 7f0b1d602700 1 --2- 172.21.15.146:0/2623516117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b1809f200 0x7f0b18138a40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c0098a0 tx=0x7f0b0c009bb0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.305+0000 7f0b1d602700 1 -- 172.21.15.146:0/2623516117 shutdown_connections 2023-10-03T10:18:02.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.305+0000 7f0b1d602700 1 --2- 172.21.15.146:0/2623516117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b18138f80 0x7f0b1813b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.305+0000 7f0b1d602700 1 --2- 172.21.15.146:0/2623516117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b1809f200 0x7f0b18138a40 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.306+0000 7f0b1d602700 1 -- 172.21.15.146:0/2623516117 >> 172.21.15.146:0/2623516117 conn(0x7f0b180a0d40 msgr2=0x7f0b180a1140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.306+0000 7f0b1d602700 1 -- 172.21.15.146:0/2623516117 shutdown_connections 2023-10-03T10:18:02.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.306+0000 7f0b1d602700 1 -- 172.21.15.146:0/2623516117 wait complete. 2023-10-03T10:18:02.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.307+0000 7f0b1d602700 1 Processor -- start 2023-10-03T10:18:02.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.307+0000 7f0b1d602700 1 -- start start 2023-10-03T10:18:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.307+0000 7f0b1d602700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b1809e720 0x7f0b18121800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.307+0000 7f0b1d602700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b1809f200 0x7f0b18121d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.307+0000 7f0b1d602700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b18138f80 0x7f0b18122280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.307+0000 7f0b1d602700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b18137610 con 0x7f0b1809e720 2023-10-03T10:18:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.307+0000 7f0b1d602700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b180a05a0 con 0x7f0b1809f200 2023-10-03T10:18:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.307+0000 7f0b1d602700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b18123b90 con 0x7f0b18138f80 2023-10-03T10:18:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.307+0000 7f0b16ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b1809e720 0x7f0b18121800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.307+0000 7f0b16ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b1809e720 0x7f0b18121800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39384/0 (socket says 172.21.15.146:39384) 2023-10-03T10:18:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.307+0000 7f0b16ffd700 1 -- 172.21.15.146:0/2820922214 learned_addr learned my addr 172.21.15.146:0/2820922214 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.307+0000 7f0b177fe700 1 --2- 172.21.15.146:0/2820922214 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b18138f80 0x7f0b18122280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.307+0000 7f0b167fc700 1 --2- 172.21.15.146:0/2820922214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b1809f200 0x7f0b18121d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.308+0000 7f0b16ffd700 1 -- 172.21.15.146:0/2820922214 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b18138f80 msgr2=0x7f0b18122280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.308+0000 7f0b16ffd700 1 --2- 172.21.15.146:0/2820922214 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b18138f80 0x7f0b18122280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.308+0000 7f0b16ffd700 1 -- 172.21.15.146:0/2820922214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b1809f200 msgr2=0x7f0b18121d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.308+0000 7f0b16ffd700 1 --2- 172.21.15.146:0/2820922214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b1809f200 0x7f0b18121d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.308+0000 7f0b16ffd700 1 -- 172.21.15.146:0/2820922214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0c0094a0 con 0x7f0b1809e720 2023-10-03T10:18:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.308+0000 7f0b16ffd700 1 --2- 172.21.15.146:0/2820922214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b1809e720 0x7f0b18121800 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f0b0800c550 tx=0x7f0b0800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.308+0000 7f0aff7fe700 1 -- 172.21.15.146:0/2820922214 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b08004c80 con 0x7f0b1809e720 2023-10-03T10:18:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.308+0000 7f0aff7fe700 1 -- 172.21.15.146:0/2820922214 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b08004e00 con 0x7f0b1809e720 2023-10-03T10:18:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.308+0000 7f0b1d602700 1 -- 172.21.15.146:0/2820922214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b18125240 con 0x7f0b1809e720 2023-10-03T10:18:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.308+0000 7f0aff7fe700 1 -- 172.21.15.146:0/2820922214 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b08007310 con 0x7f0b1809e720 2023-10-03T10:18:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.308+0000 7f0b1d602700 1 -- 172.21.15.146:0/2820922214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b18124f60 con 0x7f0b1809e720 2023-10-03T10:18:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.309+0000 7f0aff7fe700 1 -- 172.21.15.146:0/2820922214 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b08007470 con 0x7f0b1809e720 2023-10-03T10:18:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.309+0000 7f0aff7fe700 1 -- 172.21.15.146:0/2820922214 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0b0803f320 con 0x7f0b1809e720 2023-10-03T10:18:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.309+0000 7f0b1d602700 1 -- 172.21.15.146:0/2820922214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1804f2a0 con 0x7f0b1809e720 2023-10-03T10:18:02.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.314+0000 7f0aff7fe700 1 -- 172.21.15.146:0/2820922214 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b080123b0 con 0x7f0b1809e720 2023-10-03T10:18:02.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.422+0000 7f52c506b700 1 -- 172.21.15.146:0/3105489969 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f52c011c140 con 0x7f52c0133a70 2023-10-03T10:18:02.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.422+0000 7f52a77fe700 1 -- 172.21.15.146:0/3105489969 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f52b0019cd0 con 0x7f52c0133a70 2023-10-03T10:18:02.422 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.425+0000 7f52c506b700 1 -- 172.21.15.146:0/3105489969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c0133a70 msgr2=0x7f52c012dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.425+0000 7f52c506b700 1 --2- 172.21.15.146:0/3105489969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c0133a70 0x7f52c012dd80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f52b000c750 tx=0x7f52b000ca60 comp rx=0 tx=0).stop 2023-10-03T10:18:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.425+0000 7f52c506b700 1 -- 172.21.15.146:0/3105489969 shutdown_connections 2023-10-03T10:18:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.425+0000 7f52c506b700 1 --2- 172.21.15.146:0/3105489969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52c0139270 0x7f52c0119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.425+0000 7f52c506b700 1 --2- 172.21.15.146:0/3105489969 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52c0133a70 0x7f52c012dd80 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.425+0000 7f52c506b700 1 --2- 172.21.15.146:0/3105489969 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52c0136950 0x7f52c012e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.425+0000 7f52c506b700 1 -- 172.21.15.146:0/3105489969 >> 172.21.15.146:0/3105489969 conn(0x7f52c00a2980 msgr2=0x7f52c012f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.425+0000 7f52c506b700 1 -- 172.21.15.146:0/3105489969 shutdown_connections 2023-10-03T10:18:02.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.425+0000 7f52c506b700 1 -- 172.21.15.146:0/3105489969 wait complete. 2023-10-03T10:18:02.442 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:02.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.464+0000 7f53d8071700 1 -- 172.21.15.146:0/1752676743 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f53d004f2a0 con 0x7f53d00a1550 2023-10-03T10:18:02.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.464+0000 7f53c67fc700 1 -- 172.21.15.146:0/1752676743 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f53c0017020 con 0x7f53d00a1550 2023-10-03T10:18:02.464 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:02.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.466+0000 7f53d8071700 1 -- 172.21.15.146:0/1752676743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d00a1550 msgr2=0x7f53d011ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.466+0000 7f53d8071700 1 --2- 172.21.15.146:0/1752676743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d00a1550 0x7f53d011ed60 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f53c000e9e0 tx=0x7f53c000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.466+0000 7f53d8071700 1 -- 172.21.15.146:0/1752676743 shutdown_connections 2023-10-03T10:18:02.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.466+0000 7f53d8071700 1 --2- 172.21.15.146:0/1752676743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53d0139200 0x7f53d011f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.466+0000 7f53d8071700 1 --2- 172.21.15.146:0/1752676743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53d00a0a70 0x7f53d011e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.466+0000 7f53d8071700 1 --2- 172.21.15.146:0/1752676743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d00a1550 0x7f53d011ed60 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.466+0000 7f53d8071700 1 -- 172.21.15.146:0/1752676743 >> 172.21.15.146:0/1752676743 conn(0x7f53d00a6610 msgr2=0x7f53d0136c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.466+0000 7f53d8071700 1 -- 172.21.15.146:0/1752676743 shutdown_connections 2023-10-03T10:18:02.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.466+0000 7f53d8071700 1 -- 172.21.15.146:0/1752676743 wait complete. 2023-10-03T10:18:02.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:02.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.517+0000 7f0b1d602700 1 -- 172.21.15.146:0/2820922214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0b18125a30 con 0x7f0b1809e720 2023-10-03T10:18:02.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.518+0000 7f0aff7fe700 1 -- 172.21.15.146:0/2820922214 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b08011360 con 0x7f0b1809e720 2023-10-03T10:18:02.517 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:02.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.520+0000 7f0b1d602700 1 -- 172.21.15.146:0/2820922214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b1809e720 msgr2=0x7f0b18121800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.520+0000 7f0b1d602700 1 --2- 172.21.15.146:0/2820922214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b1809e720 0x7f0b18121800 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f0b0800c550 tx=0x7f0b0800c860 comp rx=0 tx=0).stop 2023-10-03T10:18:02.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.520+0000 7f0b1d602700 1 -- 172.21.15.146:0/2820922214 shutdown_connections 2023-10-03T10:18:02.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.520+0000 7f0b1d602700 1 --2- 172.21.15.146:0/2820922214 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b18138f80 0x7f0b18122280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.520+0000 7f0b1d602700 1 --2- 172.21.15.146:0/2820922214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b1809e720 0x7f0b18121800 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.520+0000 7f0b1d602700 1 --2- 172.21.15.146:0/2820922214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b1809f200 0x7f0b18121d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.520+0000 7f0b1d602700 1 -- 172.21.15.146:0/2820922214 >> 172.21.15.146:0/2820922214 conn(0x7f0b180a0d40 msgr2=0x7f0b18070c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.520+0000 7f0b1d602700 1 -- 172.21.15.146:0/2820922214 shutdown_connections 2023-10-03T10:18:02.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:02.520+0000 7f0b1d602700 1 -- 172.21.15.146:0/2820922214 wait complete. 2023-10-03T10:18:02.531 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:03.222 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:03.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.348+0000 7f6fd1190700 1 Processor -- start 2023-10-03T10:18:03.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.348+0000 7f6fd1190700 1 -- start start 2023-10-03T10:18:03.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.349+0000 7f6fd1190700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6fcc09d860 0x7f6fcc09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.349+0000 7f6fd1190700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6fcc09e170 0x7f6fcc1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.349+0000 7f6fd1190700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6fcc130ce0 0x7f6fcc131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.349+0000 7f6fd1190700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fcc131670 con 0x7f6fcc09d860 2023-10-03T10:18:03.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.349+0000 7f6fd1190700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc09aaa0 con 0x7f6fcc130ce0 2023-10-03T10:18:03.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.349+0000 7f6fd1190700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc09f870 con 0x7f6fcc09e170 2023-10-03T10:18:03.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.349+0000 7f6fcb59e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6fcc130ce0 0x7f6fcc131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.349+0000 7f6fcad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6fcc09d860 0x7f6fcc09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.349+0000 7f6fca59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6fcc09e170 0x7f6fcc1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.349+0000 7f6fcb59e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6fcc130ce0 0x7f6fcc131130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52868/0 (socket says 172.21.15.146:52868) 2023-10-03T10:18:03.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.349+0000 7f6fcb59e700 1 -- 172.21.15.146:0/131307946 learned_addr learned my addr 172.21.15.146:0/131307946 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:03.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.349+0000 7f6fcad9d700 1 --2- 172.21.15.146:0/131307946 >> v2:172.21.15.146:3300/0 conn(0x7f6fcc09d860 0x7f6fcc09dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39390/0 (socket says 172.21.15.146:39390) 2023-10-03T10:18:03.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.349+0000 7f6fca59c700 1 -- 172.21.15.146:0/131307946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6fcc130ce0 msgr2=0x7f6fcc131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:03.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.349+0000 7f6fca59c700 1 --2- 172.21.15.146:0/131307946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6fcc130ce0 0x7f6fcc131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.349+0000 7f6fca59c700 1 -- 172.21.15.146:0/131307946 >> v2:172.21.15.146:3300/0 conn(0x7f6fcc09d860 msgr2=0x7f6fcc09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:03.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.349+0000 7f6fca59c700 1 --2- 172.21.15.146:0/131307946 >> v2:172.21.15.146:3300/0 conn(0x7f6fcc09d860 0x7f6fcc09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.349+0000 7f6fca59c700 1 -- 172.21.15.146:0/131307946 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc09b360 con 0x7f6fcc09e170 2023-10-03T10:18:03.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.349+0000 7f6fcad9d700 1 --2- 172.21.15.146:0/131307946 >> v2:172.21.15.146:3300/0 conn(0x7f6fcc09d860 0x7f6fcc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.349+0000 7f6fcb59e700 1 --2- 172.21.15.146:0/131307946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6fcc130ce0 0x7f6fcc131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.349+0000 7f6fca59c700 1 --2- 172.21.15.146:0/131307946 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6fcc09e170 0x7f6fcc1307a0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc009870 tx=0x7f6fbc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2882b2ba973dc643 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.350+0000 7f6fc9d9b700 1 -- 172.21.15.146:0/131307946 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc011830 con 0x7f6fcc09e170 2023-10-03T10:18:03.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.350+0000 7f6fc9d9b700 1 -- 172.21.15.146:0/131307946 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc011990 con 0x7f6fcc09e170 2023-10-03T10:18:03.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.350+0000 7f6fc9d9b700 1 -- 172.21.15.146:0/131307946 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc011d20 con 0x7f6fcc09e170 2023-10-03T10:18:03.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.350+0000 7f6fd1190700 1 -- 172.21.15.146:0/131307946 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6fcc09e170 msgr2=0x7f6fcc1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.350+0000 7f6fd1190700 1 --2- 172.21.15.146:0/131307946 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6fcc09e170 0x7f6fcc1307a0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc009870 tx=0x7f6fbc009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:03.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.350+0000 7f6fd1190700 1 -- 172.21.15.146:0/131307946 shutdown_connections 2023-10-03T10:18:03.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.350+0000 7f6fd1190700 1 --2- 172.21.15.146:0/131307946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6fcc130ce0 0x7f6fcc131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.350+0000 7f6fd1190700 1 --2- 172.21.15.146:0/131307946 >> v2:172.21.15.146:3300/0 conn(0x7f6fcc09d860 0x7f6fcc09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.350+0000 7f6fd1190700 1 --2- 172.21.15.146:0/131307946 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6fcc09e170 0x7f6fcc1307a0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.350+0000 7f6fd1190700 1 -- 172.21.15.146:0/131307946 >> 172.21.15.146:0/131307946 conn(0x7f6fcc099c40 msgr2=0x7f6fcc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.350+0000 7f6fd1190700 1 -- 172.21.15.146:0/131307946 shutdown_connections 2023-10-03T10:18:03.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.350+0000 7f6fd1190700 1 -- 172.21.15.146:0/131307946 wait complete. 2023-10-03T10:18:03.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.351+0000 7f6fd1190700 1 Processor -- start 2023-10-03T10:18:03.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.351+0000 7f6fd1190700 1 -- start start 2023-10-03T10:18:03.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.352+0000 7f6fd1190700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6fcc09d860 0x7f6fcc11b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.352+0000 7f6fd1190700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6fcc09e170 0x7f6fcc11b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.352+0000 7f6fd1190700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc130ce0 0x7f6fcc11bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.352+0000 7f6fd1190700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc11c5f0 con 0x7f6fcc130ce0 2023-10-03T10:18:03.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.352+0000 7f6fd1190700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc12d500 con 0x7f6fcc09d860 2023-10-03T10:18:03.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.352+0000 7f6fd1190700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc11df80 con 0x7f6fcc09e170 2023-10-03T10:18:03.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.352+0000 7f6fcb59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc130ce0 0x7f6fcc11bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.352+0000 7f6fcad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6fcc09d860 0x7f6fcc11b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.352+0000 7f6fcb59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc130ce0 0x7f6fcc11bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39406/0 (socket says 172.21.15.146:39406) 2023-10-03T10:18:03.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.352+0000 7f6fcb59e700 1 -- 172.21.15.146:0/2241221587 learned_addr learned my addr 172.21.15.146:0/2241221587 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:03.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.352+0000 7f6fca59c700 1 --2- 172.21.15.146:0/2241221587 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6fcc09e170 0x7f6fcc11b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.352+0000 7f6fcad9d700 1 -- 172.21.15.146:0/2241221587 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6fcc09e170 msgr2=0x7f6fcc11b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.352+0000 7f6fcad9d700 1 --2- 172.21.15.146:0/2241221587 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6fcc09e170 0x7f6fcc11b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.352+0000 7f6fcad9d700 1 -- 172.21.15.146:0/2241221587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc130ce0 msgr2=0x7f6fcc11bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.352+0000 7f6fcad9d700 1 --2- 172.21.15.146:0/2241221587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc130ce0 0x7f6fcc11bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.352+0000 7f6fcad9d700 1 -- 172.21.15.146:0/2241221587 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc000b740 con 0x7f6fcc09d860 2023-10-03T10:18:03.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.352+0000 7f6fcb59e700 1 --2- 172.21.15.146:0/2241221587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc130ce0 0x7f6fcc11bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.352+0000 7f6fcad9d700 1 --2- 172.21.15.146:0/2241221587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6fcc09d860 0x7f6fcc11b120 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0010e30 tx=0x7f6fc000e640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.353+0000 7f6fb37fe700 1 -- 172.21.15.146:0/2241221587 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0010ec0 con 0x7f6fcc09d860 2023-10-03T10:18:03.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.353+0000 7f6fb37fe700 1 -- 172.21.15.146:0/2241221587 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc0004030 con 0x7f6fcc09d860 2023-10-03T10:18:03.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.353+0000 7f6fd1190700 1 -- 172.21.15.146:0/2241221587 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc4009b30 con 0x7f6fcc09d860 2023-10-03T10:18:03.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.353+0000 7f6fb37fe700 1 -- 172.21.15.146:0/2241221587 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc00043a0 con 0x7f6fcc09d860 2023-10-03T10:18:03.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.353+0000 7f6fd1190700 1 -- 172.21.15.146:0/2241221587 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fbc0094a0 con 0x7f6fcc09d860 2023-10-03T10:18:03.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.353+0000 7f6fb37fe700 1 -- 172.21.15.146:0/2241221587 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6fc00036a0 con 0x7f6fcc09d860 2023-10-03T10:18:03.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.354+0000 7f6fb37fe700 1 -- 172.21.15.146:0/2241221587 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6fc0042250 con 0x7f6fcc09d860 2023-10-03T10:18:03.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.354+0000 7f6fd1190700 1 -- 172.21.15.146:0/2241221587 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fcc11e430 con 0x7f6fcc09d860 2023-10-03T10:18:03.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.358+0000 7f6fb37fe700 1 -- 172.21.15.146:0/2241221587 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6fcc11e430 con 0x7f6fcc09d860 2023-10-03T10:18:03.443 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:03.478 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:03.532 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:03.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.548+0000 7f6fd1190700 1 -- 172.21.15.146:0/2241221587 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6fcc11e430 con 0x7f6fcc09d860 2023-10-03T10:18:03.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.549+0000 7f6fb37fe700 1 -- 172.21.15.146:0/2241221587 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6fcc11e430 con 0x7f6fcc09d860 2023-10-03T10:18:03.550 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:03.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.551+0000 7f6fd1190700 1 -- 172.21.15.146:0/2241221587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6fcc09d860 msgr2=0x7f6fcc11b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.551+0000 7f6fd1190700 1 --2- 172.21.15.146:0/2241221587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6fcc09d860 0x7f6fcc11b120 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0010e30 tx=0x7f6fc000e640 comp rx=0 tx=0).stop 2023-10-03T10:18:03.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.551+0000 7f6fd1190700 1 -- 172.21.15.146:0/2241221587 shutdown_connections 2023-10-03T10:18:03.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.551+0000 7f6fd1190700 1 --2- 172.21.15.146:0/2241221587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc130ce0 0x7f6fcc11bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.551+0000 7f6fd1190700 1 --2- 172.21.15.146:0/2241221587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6fcc09d860 0x7f6fcc11b120 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.551+0000 7f6fd1190700 1 --2- 172.21.15.146:0/2241221587 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6fcc09e170 0x7f6fcc11b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.551+0000 7f6fd1190700 1 -- 172.21.15.146:0/2241221587 >> 172.21.15.146:0/2241221587 conn(0x7f6fcc099c40 msgr2=0x7f6fcc12df60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.551+0000 7f6fd1190700 1 -- 172.21.15.146:0/2241221587 shutdown_connections 2023-10-03T10:18:03.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.551+0000 7f6fd1190700 1 -- 172.21.15.146:0/2241221587 wait complete. 2023-10-03T10:18:03.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:03.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.575+0000 7f8c88e1e700 1 Processor -- start 2023-10-03T10:18:03.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.576+0000 7f8c88e1e700 1 -- start start 2023-10-03T10:18:03.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.576+0000 7f8c88e1e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8c84133ad0 0x7f8c84133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.576+0000 7f8c88e1e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c84130bc0 0x7f8c8413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.576+0000 7f8c88e1e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c8406b2d0 con 0x7f8c841300a0 2023-10-03T10:18:03.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.576+0000 7f8c88e1e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c84133610 con 0x7f8c84133ad0 2023-10-03T10:18:03.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.576+0000 7f8c88e1e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8409a500 con 0x7f8c84130bc0 2023-10-03T10:18:03.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.576+0000 7f8c8259c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8c84133ad0 0x7f8c84133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.576+0000 7f8c82d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c84130bc0 0x7f8c8413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.576+0000 7f8c82d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c84130bc0 0x7f8c8413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59392/0 (socket says 172.21.15.146:59392) 2023-10-03T10:18:03.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.576+0000 7f8c8259c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8c84133ad0 0x7f8c84133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39418/0 (socket says 172.21.15.146:39418) 2023-10-03T10:18:03.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.576+0000 7f8c82d9d700 1 -- 172.21.15.146:0/1700964525 learned_addr learned my addr 172.21.15.146:0/1700964525 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:03.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.576+0000 7f8c81d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8c841300a0 0x7f8c841304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35786/0 (socket says 172.21.15.146:35786) 2023-10-03T10:18:03.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.577+0000 7f8c8259c700 1 -- 172.21.15.146:0/1700964525 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c84130bc0 msgr2=0x7f8c8413b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:03.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.577+0000 7f8c8259c700 1 --2- 172.21.15.146:0/1700964525 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c84130bc0 0x7f8c8413b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.577+0000 7f8c8259c700 1 -- 172.21.15.146:0/1700964525 >> v1:172.21.15.146:6789/0 conn(0x7f8c841300a0 legacy=0x7f8c841304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.577+0000 7f8c8259c700 1 -- 172.21.15.146:0/1700964525 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c841338b0 con 0x7f8c84133ad0 2023-10-03T10:18:03.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.577+0000 7f8c8159a700 1 -- 172.21.15.146:0/1700964525 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834258452 0 0) 0x7f8c8406b2d0 con 0x7f8c841300a0 2023-10-03T10:18:03.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.577+0000 7f8c8259c700 1 --2- 172.21.15.146:0/1700964525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c84133ad0 0x7f8c84133ea0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009840 tx=0x7f8c74009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad84264c47ceb524 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.577+0000 7f8c8159a700 1 -- 172.21.15.146:0/1700964525 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c74011830 con 0x7f8c84133ad0 2023-10-03T10:18:03.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.577+0000 7f8c8159a700 1 -- 172.21.15.146:0/1700964525 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c74011990 con 0x7f8c84133ad0 2023-10-03T10:18:03.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.577+0000 7f8c8159a700 1 -- 172.21.15.146:0/1700964525 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c74011d20 con 0x7f8c84133ad0 2023-10-03T10:18:03.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.578+0000 7f8c88e1e700 1 -- 172.21.15.146:0/1700964525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c84133ad0 msgr2=0x7f8c84133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.578+0000 7f8c88e1e700 1 --2- 172.21.15.146:0/1700964525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c84133ad0 0x7f8c84133ea0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009840 tx=0x7f8c74009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:03.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.578+0000 7f8c88e1e700 1 -- 172.21.15.146:0/1700964525 shutdown_connections 2023-10-03T10:18:03.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.578+0000 7f8c88e1e700 1 --2- 172.21.15.146:0/1700964525 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c84130bc0 0x7f8c8413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.578+0000 7f8c88e1e700 1 --2- 172.21.15.146:0/1700964525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c84133ad0 0x7f8c84133ea0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.578+0000 7f8c88e1e700 1 -- 172.21.15.146:0/1700964525 >> 172.21.15.146:0/1700964525 conn(0x7f8c84099c40 msgr2=0x7f8c840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.578+0000 7f8c88e1e700 1 -- 172.21.15.146:0/1700964525 shutdown_connections 2023-10-03T10:18:03.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.578+0000 7f8c88e1e700 1 -- 172.21.15.146:0/1700964525 wait complete. 2023-10-03T10:18:03.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.579+0000 7f8c88e1e700 1 Processor -- start 2023-10-03T10:18:03.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.579+0000 7f8c88e1e700 1 -- start start 2023-10-03T10:18:03.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.579+0000 7f8c88e1e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c841300a0 0x7f8c8411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.579+0000 7f8c88e1e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c84130bc0 0x7f8c8411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.579+0000 7f8c88e1e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c84133ad0 0x7f8c8411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.579+0000 7f8c88e1e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8411f160 con 0x7f8c84133ad0 2023-10-03T10:18:03.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.579+0000 7f8c88e1e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c84120210 con 0x7f8c84130bc0 2023-10-03T10:18:03.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.579+0000 7f8c88e1e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8412dd00 con 0x7f8c841300a0 2023-10-03T10:18:03.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.580+0000 7f8c8259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c841300a0 0x7f8c8411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.580+0000 7f8c81d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c84130bc0 0x7f8c8411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.580+0000 7f8c8259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c841300a0 0x7f8c8411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59396/0 (socket says 172.21.15.146:59396) 2023-10-03T10:18:03.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.580+0000 7f8c8259c700 1 -- 172.21.15.146:0/1429600045 learned_addr learned my addr 172.21.15.146:0/1429600045 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:03.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.580+0000 7f8c82d9d700 1 --2- 172.21.15.146:0/1429600045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c84133ad0 0x7f8c8411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.580+0000 7f8c8259c700 1 -- 172.21.15.146:0/1429600045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c84130bc0 msgr2=0x7f8c8411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.580+0000 7f8c8259c700 1 --2- 172.21.15.146:0/1429600045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c84130bc0 0x7f8c8411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.580+0000 7f8c8259c700 1 -- 172.21.15.146:0/1429600045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c84133ad0 msgr2=0x7f8c8411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.580+0000 7f8c8259c700 1 --2- 172.21.15.146:0/1429600045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c84133ad0 0x7f8c8411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.580+0000 7f8c8259c700 1 -- 172.21.15.146:0/1429600045 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c740094a0 con 0x7f8c841300a0 2023-10-03T10:18:03.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.580+0000 7f8c81d9b700 1 --2- 172.21.15.146:0/1429600045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c84130bc0 0x7f8c8411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.580+0000 7f8c82d9d700 1 --2- 172.21.15.146:0/1429600045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c84133ad0 0x7f8c8411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.580+0000 7f8c8259c700 1 --2- 172.21.15.146:0/1429600045 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c841300a0 0x7f8c8411da40 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009fd0 tx=0x7f8c74004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.580+0000 7f8c72ffd700 1 -- 172.21.15.146:0/1429600045 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c740036a0 con 0x7f8c841300a0 2023-10-03T10:18:03.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.580+0000 7f8c72ffd700 1 -- 172.21.15.146:0/1429600045 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7401f070 con 0x7f8c841300a0 2023-10-03T10:18:03.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.580+0000 7f8c88e1e700 1 -- 172.21.15.146:0/1429600045 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c840a33c0 con 0x7f8c841300a0 2023-10-03T10:18:03.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.580+0000 7f8c72ffd700 1 -- 172.21.15.146:0/1429600045 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c74003a60 con 0x7f8c841300a0 2023-10-03T10:18:03.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.581+0000 7f8c72ffd700 1 -- 172.21.15.146:0/1429600045 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c74003bc0 con 0x7f8c841300a0 2023-10-03T10:18:03.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.581+0000 7f8c88e1e700 1 -- 172.21.15.146:0/1429600045 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c8411ea00 con 0x7f8c841300a0 2023-10-03T10:18:03.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.582+0000 7f8c72ffd700 1 -- 172.21.15.146:0/1429600045 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8c74021070 con 0x7f8c841300a0 2023-10-03T10:18:03.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.583+0000 7f8c88e1e700 1 -- 172.21.15.146:0/1429600045 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c8409cb20 con 0x7f8c841300a0 2023-10-03T10:18:03.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.587+0000 7f8c72ffd700 1 -- 172.21.15.146:0/1429600045 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c74015020 con 0x7f8c841300a0 2023-10-03T10:18:03.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.618+0000 7f4a65601700 1 Processor -- start 2023-10-03T10:18:03.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.618+0000 7f4a65601700 1 -- start start 2023-10-03T10:18:03.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.619+0000 7f4a65601700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a6009ad40 0x7f4a60133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.619+0000 7f4a65601700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a60133f70 0x7f4a601343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.619+0000 7f4a65601700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6009b110 con 0x7f4a600a0a70 2023-10-03T10:18:03.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.619+0000 7f4a65601700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a600a3b60 con 0x7f4a60133f70 2023-10-03T10:18:03.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.619+0000 7f4a65601700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a601348e0 con 0x7f4a6009ad40 2023-10-03T10:18:03.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.619+0000 7f4a5e7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a60133f70 0x7f4a601343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.619+0000 7f4a5effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a6009ad40 0x7f4a60133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.619+0000 7f4a5e7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a60133f70 0x7f4a601343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52884/0 (socket says 172.21.15.146:52884) 2023-10-03T10:18:03.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.619+0000 7f4a5e7fc700 1 -- 172.21.15.146:0/3869871578 learned_addr learned my addr 172.21.15.146:0/3869871578 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:03.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.619+0000 7f4a5e7fc700 1 -- 172.21.15.146:0/3869871578 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a6009ad40 msgr2=0x7f4a60133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:03.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.619+0000 7f4a5e7fc700 1 --2- 172.21.15.146:0/3869871578 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a6009ad40 0x7f4a60133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.619+0000 7f4a5e7fc700 1 -- 172.21.15.146:0/3869871578 >> v1:172.21.15.146:6789/0 conn(0x7f4a600a0a70 legacy=0x7f4a600a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.619+0000 7f4a5e7fc700 1 -- 172.21.15.146:0/3869871578 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a600a2fa0 con 0x7f4a60133f70 2023-10-03T10:18:03.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.619+0000 7f4a5dffb700 1 -- 172.21.15.146:0/3869871578 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819078778 0 0) 0x7f4a6009b110 con 0x7f4a600a0a70 2023-10-03T10:18:03.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.619+0000 7f4a5effd700 1 --2- 172.21.15.146:0/3869871578 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a6009ad40 0x7f4a60133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.620+0000 7f4a5e7fc700 1 --2- 172.21.15.146:0/3869871578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a60133f70 0x7f4a601343a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009920 tx=0x7f4a54009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3aff694e40b85c02 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.620+0000 7f4a5dffb700 1 -- 172.21.15.146:0/3869871578 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a54011830 con 0x7f4a60133f70 2023-10-03T10:18:03.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.620+0000 7f4a5dffb700 1 -- 172.21.15.146:0/3869871578 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a54011990 con 0x7f4a60133f70 2023-10-03T10:18:03.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.620+0000 7f4a5dffb700 1 -- 172.21.15.146:0/3869871578 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a54011d20 con 0x7f4a60133f70 2023-10-03T10:18:03.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.620+0000 7f4a65601700 1 -- 172.21.15.146:0/3869871578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a60133f70 msgr2=0x7f4a601343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.620+0000 7f4a65601700 1 --2- 172.21.15.146:0/3869871578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a60133f70 0x7f4a601343a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009920 tx=0x7f4a54009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:03.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.620+0000 7f4a65601700 1 -- 172.21.15.146:0/3869871578 shutdown_connections 2023-10-03T10:18:03.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.620+0000 7f4a65601700 1 --2- 172.21.15.146:0/3869871578 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a6009ad40 0x7f4a60133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.620+0000 7f4a65601700 1 --2- 172.21.15.146:0/3869871578 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a60133f70 0x7f4a601343a0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.620+0000 7f4a65601700 1 -- 172.21.15.146:0/3869871578 >> 172.21.15.146:0/3869871578 conn(0x7f4a60099c40 msgr2=0x7f4a6006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.621+0000 7f4a65601700 1 -- 172.21.15.146:0/3869871578 shutdown_connections 2023-10-03T10:18:03.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.621+0000 7f4a65601700 1 -- 172.21.15.146:0/3869871578 wait complete. 2023-10-03T10:18:03.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.622+0000 7f4a65601700 1 Processor -- start 2023-10-03T10:18:03.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.622+0000 7f4a65601700 1 -- start start 2023-10-03T10:18:03.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.622+0000 7f4a65601700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a6009ad40 0x7f4a60121270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.622+0000 7f4a65601700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a600a0a70 0x7f4a601217b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.622+0000 7f4a65601700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a60133f70 0x7f4a60121cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.622+0000 7f4a65601700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a60122e80 con 0x7f4a6009ad40 2023-10-03T10:18:03.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.622+0000 7f4a65601700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a60123d10 con 0x7f4a60133f70 2023-10-03T10:18:03.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.622+0000 7f4a65601700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a601247f0 con 0x7f4a600a0a70 2023-10-03T10:18:03.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.622+0000 7f4a5effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a6009ad40 0x7f4a60121270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.622+0000 7f4a5effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a6009ad40 0x7f4a60121270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39442/0 (socket says 172.21.15.146:39442) 2023-10-03T10:18:03.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.622+0000 7f4a5effd700 1 -- 172.21.15.146:0/1080719186 learned_addr learned my addr 172.21.15.146:0/1080719186 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:03.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.622+0000 7f4a5e7fc700 1 --2- 172.21.15.146:0/1080719186 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a600a0a70 0x7f4a601217b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.622+0000 7f4a5f7fe700 1 --2- 172.21.15.146:0/1080719186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a60133f70 0x7f4a60121cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.623+0000 7f4a5effd700 1 -- 172.21.15.146:0/1080719186 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a600a0a70 msgr2=0x7f4a601217b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.623+0000 7f4a5effd700 1 --2- 172.21.15.146:0/1080719186 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a600a0a70 0x7f4a601217b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.623+0000 7f4a5effd700 1 -- 172.21.15.146:0/1080719186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a60133f70 msgr2=0x7f4a60121cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.623+0000 7f4a5effd700 1 --2- 172.21.15.146:0/1080719186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a60133f70 0x7f4a60121cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.623+0000 7f4a5effd700 1 -- 172.21.15.146:0/1080719186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a500094a0 con 0x7f4a6009ad40 2023-10-03T10:18:03.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.623+0000 7f4a5f7fe700 1 --2- 172.21.15.146:0/1080719186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a60133f70 0x7f4a60121cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:03.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.623+0000 7f4a5e7fc700 1 --2- 172.21.15.146:0/1080719186 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a600a0a70 0x7f4a601217b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.623+0000 7f4a5effd700 1 --2- 172.21.15.146:0/1080719186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a6009ad40 0x7f4a60121270 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000ec10 tx=0x7f4a5000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.623+0000 7f4a477fe700 1 -- 172.21.15.146:0/1080719186 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5000c850 con 0x7f4a6009ad40 2023-10-03T10:18:03.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.623+0000 7f4a477fe700 1 -- 172.21.15.146:0/1080719186 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5000c9b0 con 0x7f4a6009ad40 2023-10-03T10:18:03.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.623+0000 7f4a65601700 1 -- 172.21.15.146:0/1080719186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a54009550 con 0x7f4a6009ad40 2023-10-03T10:18:03.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.623+0000 7f4a477fe700 1 -- 172.21.15.146:0/1080719186 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5000cd40 con 0x7f4a6009ad40 2023-10-03T10:18:03.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.623+0000 7f4a65601700 1 -- 172.21.15.146:0/1080719186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6009c7e0 con 0x7f4a6009ad40 2023-10-03T10:18:03.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.624+0000 7f4a477fe700 1 -- 172.21.15.146:0/1080719186 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4a50013470 con 0x7f4a6009ad40 2023-10-03T10:18:03.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.624+0000 7f4a477fe700 1 -- 172.21.15.146:0/1080719186 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4a5003fb30 con 0x7f4a6009ad40 2023-10-03T10:18:03.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.624+0000 7f4a65601700 1 -- 172.21.15.146:0/1080719186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a601240d0 con 0x7f4a6009ad40 2023-10-03T10:18:03.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.629+0000 7f4a477fe700 1 -- 172.21.15.146:0/1080719186 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4a50021070 con 0x7f4a6009ad40 2023-10-03T10:18:03.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.667+0000 7f0d11de3700 1 Processor -- start 2023-10-03T10:18:03.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.667+0000 7f0d11de3700 1 -- start start 2023-10-03T10:18:03.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.668+0000 7f0d11de3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d0c0a0a70 0x7f0d0c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.668+0000 7f0d11de3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0c0a1380 0x7f0d0c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.668+0000 7f0d11de3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0c09dc00 con 0x7f0d0c133f50 2023-10-03T10:18:03.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.668+0000 7f0d11de3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c09ea60 con 0x7f0d0c0a0a70 2023-10-03T10:18:03.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.668+0000 7f0d11de3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c09dec0 con 0x7f0d0c0a1380 2023-10-03T10:18:03.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.668+0000 7f0d0affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0c0a1380 0x7f0d0c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.668+0000 7f0d0affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0c0a1380 0x7f0d0c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:59426/0 (socket says 172.21.15.146:59426) 2023-10-03T10:18:03.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.668+0000 7f0d0bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0d0c133f50 0x7f0d0c13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35806/0 (socket says 172.21.15.146:35806) 2023-10-03T10:18:03.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.668+0000 7f0d0affd700 1 -- 172.21.15.146:0/3773952475 learned_addr learned my addr 172.21.15.146:0/3773952475 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:03.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.668+0000 7f0d0b7fe700 1 --2- 172.21.15.146:0/3773952475 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d0c0a0a70 0x7f0d0c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.669+0000 7f0d0a7fc700 1 -- 172.21.15.146:0/3773952475 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1356578382 0 0) 0x7f0d0c09dc00 con 0x7f0d0c133f50 2023-10-03T10:18:03.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.669+0000 7f0d0affd700 1 -- 172.21.15.146:0/3773952475 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d0c0a0a70 msgr2=0x7f0d0c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:03.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.669+0000 7f0d0affd700 1 --2- 172.21.15.146:0/3773952475 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d0c0a0a70 0x7f0d0c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.669+0000 7f0d0affd700 1 -- 172.21.15.146:0/3773952475 >> v1:172.21.15.146:6789/0 conn(0x7f0d0c133f50 legacy=0x7f0d0c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.669+0000 7f0d0affd700 1 -- 172.21.15.146:0/3773952475 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c09e6a0 con 0x7f0d0c0a1380 2023-10-03T10:18:03.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.669+0000 7f0d0b7fe700 1 --2- 172.21.15.146:0/3773952475 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d0c0a0a70 0x7f0d0c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.669+0000 7f0d0affd700 1 --2- 172.21.15.146:0/3773952475 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0c0a1380 0x7f0d0c133a10 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009920 tx=0x7f0d00009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7da947a7729b360f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.669+0000 7f0d0a7fc700 1 -- 172.21.15.146:0/3773952475 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00011830 con 0x7f0d0c0a1380 2023-10-03T10:18:03.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.669+0000 7f0d0a7fc700 1 -- 172.21.15.146:0/3773952475 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d00011990 con 0x7f0d0c0a1380 2023-10-03T10:18:03.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.669+0000 7f0d0a7fc700 1 -- 172.21.15.146:0/3773952475 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00011d20 con 0x7f0d0c0a1380 2023-10-03T10:18:03.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.670+0000 7f0d11de3700 1 -- 172.21.15.146:0/3773952475 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0c0a1380 msgr2=0x7f0d0c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.670+0000 7f0d11de3700 1 --2- 172.21.15.146:0/3773952475 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0c0a1380 0x7f0d0c133a10 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009920 tx=0x7f0d00009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:03.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.670+0000 7f0d11de3700 1 -- 172.21.15.146:0/3773952475 shutdown_connections 2023-10-03T10:18:03.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.670+0000 7f0d11de3700 1 --2- 172.21.15.146:0/3773952475 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d0c0a0a70 0x7f0d0c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.670+0000 7f0d11de3700 1 --2- 172.21.15.146:0/3773952475 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0c0a1380 0x7f0d0c133a10 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.670+0000 7f0d11de3700 1 -- 172.21.15.146:0/3773952475 >> 172.21.15.146:0/3773952475 conn(0x7f0d0c0a6610 msgr2=0x7f0d0c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.670+0000 7f0d11de3700 1 -- 172.21.15.146:0/3773952475 shutdown_connections 2023-10-03T10:18:03.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.670+0000 7f0d11de3700 1 -- 172.21.15.146:0/3773952475 wait complete. 2023-10-03T10:18:03.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.671+0000 7f0d11de3700 1 Processor -- start 2023-10-03T10:18:03.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.671+0000 7f0d11de3700 1 -- start start 2023-10-03T10:18:03.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.672+0000 7f0d11de3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d0c0a0a70 0x7f0d0c1228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.672+0000 7f0d11de3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0c0a1380 0x7f0d0c122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.672+0000 7f0d11de3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d0c133f50 0x7f0d0c123360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.672+0000 7f0d11de3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c126200 con 0x7f0d0c133f50 2023-10-03T10:18:03.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.672+0000 7f0d11de3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c133940 con 0x7f0d0c0a0a70 2023-10-03T10:18:03.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.672+0000 7f0d11de3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c133400 con 0x7f0d0c0a1380 2023-10-03T10:18:03.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.672+0000 7f0d0b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d0c0a0a70 0x7f0d0c1228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.672+0000 7f0d0affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0c0a1380 0x7f0d0c122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.672+0000 7f0d0b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d0c0a0a70 0x7f0d0c1228e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:52910/0 (socket says 172.21.15.146:52910) 2023-10-03T10:18:03.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.672+0000 7f0d0b7fe700 1 -- 172.21.15.146:0/2942329667 learned_addr learned my addr 172.21.15.146:0/2942329667 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:03.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.672+0000 7f0d0bfff700 1 --2- 172.21.15.146:0/2942329667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d0c133f50 0x7f0d0c123360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.672+0000 7f0d0b7fe700 1 -- 172.21.15.146:0/2942329667 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0c0a1380 msgr2=0x7f0d0c122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.672+0000 7f0d0b7fe700 1 --2- 172.21.15.146:0/2942329667 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0c0a1380 0x7f0d0c122e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.672+0000 7f0d0b7fe700 1 -- 172.21.15.146:0/2942329667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d0c133f50 msgr2=0x7f0d0c123360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.672+0000 7f0d0b7fe700 1 --2- 172.21.15.146:0/2942329667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d0c133f50 0x7f0d0c123360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.672+0000 7f0d0b7fe700 1 -- 172.21.15.146:0/2942329667 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc0094a0 con 0x7f0d0c0a0a70 2023-10-03T10:18:03.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.673+0000 7f0d0b7fe700 1 --2- 172.21.15.146:0/2942329667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d0c0a0a70 0x7f0d0c1228e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00ec10 tx=0x7f0cfc00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.673+0000 7f0cf3fff700 1 -- 172.21.15.146:0/2942329667 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc00c850 con 0x7f0d0c0a0a70 2023-10-03T10:18:03.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.673+0000 7f0cf3fff700 1 -- 172.21.15.146:0/2942329667 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cfc00c9b0 con 0x7f0d0c0a0a70 2023-10-03T10:18:03.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.673+0000 7f0cf3fff700 1 -- 172.21.15.146:0/2942329667 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc00cd20 con 0x7f0d0c0a0a70 2023-10-03T10:18:03.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.673+0000 7f0d11de3700 1 -- 172.21.15.146:0/2942329667 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d00009550 con 0x7f0d0c0a0a70 2023-10-03T10:18:03.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.673+0000 7f0d11de3700 1 -- 172.21.15.146:0/2942329667 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d0c0a0430 con 0x7f0d0c0a0a70 2023-10-03T10:18:03.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.674+0000 7f0d11de3700 1 -- 172.21.15.146:0/2942329667 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d0c126c50 con 0x7f0d0c0a0a70 2023-10-03T10:18:03.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.674+0000 7f0cf3fff700 1 -- 172.21.15.146:0/2942329667 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0cfc013470 con 0x7f0d0c0a0a70 2023-10-03T10:18:03.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.674+0000 7f0cf3fff700 1 -- 172.21.15.146:0/2942329667 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0cfc03fb50 con 0x7f0d0c0a0a70 2023-10-03T10:18:03.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.683+0000 7f0cf3fff700 1 -- 172.21.15.146:0/2942329667 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cfc013720 con 0x7f0d0c0a0a70 2023-10-03T10:18:03.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.791+0000 7f8c88e1e700 1 -- 172.21.15.146:0/1429600045 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8c8404f2a0 con 0x7f8c841300a0 2023-10-03T10:18:03.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.792+0000 7f8c72ffd700 1 -- 172.21.15.146:0/1429600045 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8c7401a950 con 0x7f8c841300a0 2023-10-03T10:18:03.791 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:03.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.794+0000 7f8c88e1e700 1 -- 172.21.15.146:0/1429600045 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c841300a0 msgr2=0x7f8c8411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.794+0000 7f8c88e1e700 1 --2- 172.21.15.146:0/1429600045 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c841300a0 0x7f8c8411da40 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009fd0 tx=0x7f8c74004750 comp rx=0 tx=0).stop 2023-10-03T10:18:03.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.794+0000 7f8c88e1e700 1 -- 172.21.15.146:0/1429600045 shutdown_connections 2023-10-03T10:18:03.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.794+0000 7f8c88e1e700 1 --2- 172.21.15.146:0/1429600045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c84133ad0 0x7f8c8411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.794+0000 7f8c88e1e700 1 --2- 172.21.15.146:0/1429600045 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c841300a0 0x7f8c8411da40 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.794+0000 7f8c88e1e700 1 --2- 172.21.15.146:0/1429600045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c84130bc0 0x7f8c8411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.794+0000 7f8c88e1e700 1 -- 172.21.15.146:0/1429600045 >> 172.21.15.146:0/1429600045 conn(0x7f8c84099c40 msgr2=0x7f8c84132ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.794+0000 7f8c88e1e700 1 -- 172.21.15.146:0/1429600045 shutdown_connections 2023-10-03T10:18:03.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.794+0000 7f8c88e1e700 1 -- 172.21.15.146:0/1429600045 wait complete. 2023-10-03T10:18:03.806 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:03.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.827+0000 7f4a65601700 1 -- 172.21.15.146:0/1080719186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4a6011e060 con 0x7f4a6009ad40 2023-10-03T10:18:03.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.828+0000 7f4a477fe700 1 -- 172.21.15.146:0/1080719186 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4a5002a090 con 0x7f4a6009ad40 2023-10-03T10:18:03.827 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:03.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.830+0000 7f4a65601700 1 -- 172.21.15.146:0/1080719186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a6009ad40 msgr2=0x7f4a60121270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.830+0000 7f4a65601700 1 --2- 172.21.15.146:0/1080719186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a6009ad40 0x7f4a60121270 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000ec10 tx=0x7f4a5000ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:03.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.830+0000 7f4a65601700 1 -- 172.21.15.146:0/1080719186 shutdown_connections 2023-10-03T10:18:03.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.830+0000 7f4a65601700 1 --2- 172.21.15.146:0/1080719186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a60133f70 0x7f4a60121cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.830+0000 7f4a65601700 1 --2- 172.21.15.146:0/1080719186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a6009ad40 0x7f4a60121270 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.830+0000 7f4a65601700 1 --2- 172.21.15.146:0/1080719186 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a600a0a70 0x7f4a601217b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.830+0000 7f4a65601700 1 -- 172.21.15.146:0/1080719186 >> 172.21.15.146:0/1080719186 conn(0x7f4a60099c40 msgr2=0x7f4a60133260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.830+0000 7f4a65601700 1 -- 172.21.15.146:0/1080719186 shutdown_connections 2023-10-03T10:18:03.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.830+0000 7f4a65601700 1 -- 172.21.15.146:0/1080719186 wait complete. 2023-10-03T10:18:03.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:03.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.877+0000 7f0d11de3700 1 -- 172.21.15.146:0/2942329667 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0d0c04f2a0 con 0x7f0d0c0a0a70 2023-10-03T10:18:03.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.877+0000 7f0cf3fff700 1 -- 172.21.15.146:0/2942329667 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0cfc011b00 con 0x7f0d0c0a0a70 2023-10-03T10:18:03.877 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:03.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.879+0000 7f0d11de3700 1 -- 172.21.15.146:0/2942329667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d0c0a0a70 msgr2=0x7f0d0c1228e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.879+0000 7f0d11de3700 1 --2- 172.21.15.146:0/2942329667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d0c0a0a70 0x7f0d0c1228e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00ec10 tx=0x7f0cfc00ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:03.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.879+0000 7f0d11de3700 1 -- 172.21.15.146:0/2942329667 shutdown_connections 2023-10-03T10:18:03.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.879+0000 7f0d11de3700 1 --2- 172.21.15.146:0/2942329667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d0c133f50 0x7f0d0c123360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.879+0000 7f0d11de3700 1 --2- 172.21.15.146:0/2942329667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d0c0a0a70 0x7f0d0c1228e0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.879+0000 7f0d11de3700 1 --2- 172.21.15.146:0/2942329667 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0d0c0a1380 0x7f0d0c122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.879+0000 7f0d11de3700 1 -- 172.21.15.146:0/2942329667 >> 172.21.15.146:0/2942329667 conn(0x7f0d0c0a6610 msgr2=0x7f0d0c0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.879+0000 7f0d11de3700 1 -- 172.21.15.146:0/2942329667 shutdown_connections 2023-10-03T10:18:03.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:03.879+0000 7f0d11de3700 1 -- 172.21.15.146:0/2942329667 wait complete. 2023-10-03T10:18:03.891 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:04.565 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:04.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.696+0000 7f252645c700 1 Processor -- start 2023-10-03T10:18:04.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.696+0000 7f252645c700 1 -- start start 2023-10-03T10:18:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.697+0000 7f252645c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f252009ad40 0x7f2520133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.697+0000 7f252645c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25201343d0 0x7f25200a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.697+0000 7f252645c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252009b110 con 0x7f2520133f70 2023-10-03T10:18:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.697+0000 7f252645c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25200a3b60 con 0x7f252009ad40 2023-10-03T10:18:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.697+0000 7f252645c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2520134850 con 0x7f25201343d0 2023-10-03T10:18:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.697+0000 7f251ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f252009ad40 0x7f2520133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.697+0000 7f25249f9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25201343d0 0x7f25200a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.697+0000 7f25249f9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25201343d0 0x7f25200a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60332/0 (socket says 172.21.15.146:60332) 2023-10-03T10:18:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.697+0000 7f251ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f252009ad40 0x7f2520133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33688/0 (socket says 172.21.15.146:33688) 2023-10-03T10:18:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.697+0000 7f25249f9700 1 -- 172.21.15.146:0/2949256310 learned_addr learned my addr 172.21.15.146:0/2949256310 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.697+0000 7f251f7fe700 1 --1- 172.21.15.146:0/2949256310 >> v1:172.21.15.146:6789/0 conn(0x7f2520133f70 0x7f25200a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49690/0 (socket says 172.21.15.146:49690) 2023-10-03T10:18:04.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.697+0000 7f25249f9700 1 -- 172.21.15.146:0/2949256310 >> v2:172.21.15.146:3300/0 conn(0x7f252009ad40 msgr2=0x7f2520133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:04.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.697+0000 7f25249f9700 1 --2- 172.21.15.146:0/2949256310 >> v2:172.21.15.146:3300/0 conn(0x7f252009ad40 0x7f2520133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.697+0000 7f25249f9700 1 -- 172.21.15.146:0/2949256310 >> v1:172.21.15.146:6789/0 conn(0x7f2520133f70 legacy=0x7f25200a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.697+0000 7f25249f9700 1 -- 172.21.15.146:0/2949256310 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25200a2fa0 con 0x7f25201343d0 2023-10-03T10:18:04.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.697+0000 7f251effd700 1 -- 172.21.15.146:0/2949256310 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3018961548 0 0) 0x7f252009b110 con 0x7f2520133f70 2023-10-03T10:18:04.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.697+0000 7f251ffff700 1 --2- 172.21.15.146:0/2949256310 >> v2:172.21.15.146:3300/0 conn(0x7f252009ad40 0x7f2520133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.697+0000 7f25249f9700 1 --2- 172.21.15.146:0/2949256310 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25201343d0 0x7f25200a1180 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f2518009e50 tx=0x7f251800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3657a9d2913e8963 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.697+0000 7f251effd700 1 -- 172.21.15.146:0/2949256310 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251800e070 con 0x7f25201343d0 2023-10-03T10:18:04.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.697+0000 7f251effd700 1 -- 172.21.15.146:0/2949256310 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251800b910 con 0x7f25201343d0 2023-10-03T10:18:04.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.697+0000 7f251effd700 1 -- 172.21.15.146:0/2949256310 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251800bcc0 con 0x7f25201343d0 2023-10-03T10:18:04.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.698+0000 7f252645c700 1 -- 172.21.15.146:0/2949256310 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25201343d0 msgr2=0x7f25200a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.698+0000 7f252645c700 1 --2- 172.21.15.146:0/2949256310 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25201343d0 0x7f25200a1180 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f2518009e50 tx=0x7f251800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:04.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.698+0000 7f252645c700 1 -- 172.21.15.146:0/2949256310 shutdown_connections 2023-10-03T10:18:04.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.698+0000 7f252645c700 1 --2- 172.21.15.146:0/2949256310 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25201343d0 0x7f25200a1180 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.698+0000 7f252645c700 1 --2- 172.21.15.146:0/2949256310 >> v2:172.21.15.146:3300/0 conn(0x7f252009ad40 0x7f2520133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.698+0000 7f252645c700 1 -- 172.21.15.146:0/2949256310 >> 172.21.15.146:0/2949256310 conn(0x7f2520099c40 msgr2=0x7f252006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.698+0000 7f252645c700 1 -- 172.21.15.146:0/2949256310 shutdown_connections 2023-10-03T10:18:04.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.698+0000 7f252645c700 1 -- 172.21.15.146:0/2949256310 wait complete. 2023-10-03T10:18:04.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.699+0000 7f252645c700 1 Processor -- start 2023-10-03T10:18:04.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.699+0000 7f252645c700 1 -- start start 2023-10-03T10:18:04.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f252645c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f252009ad40 0x7f252011f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f252645c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2520133f70 0x7f252011f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f252645c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25201343d0 0x7f25201c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f252645c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25200a4230 con 0x7f252009ad40 2023-10-03T10:18:04.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f252645c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25201223c0 con 0x7f2520133f70 2023-10-03T10:18:04.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f252645c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2520133510 con 0x7f25201343d0 2023-10-03T10:18:04.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f251ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f252009ad40 0x7f252011f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f251f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2520133f70 0x7f252011f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f251ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f252009ad40 0x7f252011f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33698/0 (socket says 172.21.15.146:33698) 2023-10-03T10:18:04.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f251ffff700 1 -- 172.21.15.146:0/2858007628 learned_addr learned my addr 172.21.15.146:0/2858007628 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:04.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f25249f9700 1 --2- 172.21.15.146:0/2858007628 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25201343d0 0x7f25201c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f251ffff700 1 -- 172.21.15.146:0/2858007628 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25201343d0 msgr2=0x7f25201c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f251ffff700 1 --2- 172.21.15.146:0/2858007628 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25201343d0 0x7f25201c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f251ffff700 1 -- 172.21.15.146:0/2858007628 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2520133f70 msgr2=0x7f252011f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f251ffff700 1 --2- 172.21.15.146:0/2858007628 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2520133f70 0x7f252011f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f251ffff700 1 -- 172.21.15.146:0/2858007628 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25140094a0 con 0x7f252009ad40 2023-10-03T10:18:04.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f251f7fe700 1 --2- 172.21.15.146:0/2858007628 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2520133f70 0x7f252011f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f251ffff700 1 --2- 172.21.15.146:0/2858007628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f252009ad40 0x7f252011f450 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f251400ec40 tx=0x7f251400ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f251cff9700 1 -- 172.21.15.146:0/2858007628 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514009760 con 0x7f252009ad40 2023-10-03T10:18:04.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f251cff9700 1 -- 172.21.15.146:0/2858007628 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251400c850 con 0x7f252009ad40 2023-10-03T10:18:04.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f252645c700 1 -- 172.21.15.146:0/2858007628 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2518009b30 con 0x7f252009ad40 2023-10-03T10:18:04.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f251cff9700 1 -- 172.21.15.146:0/2858007628 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251400cbe0 con 0x7f252009ad40 2023-10-03T10:18:04.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.700+0000 7f252645c700 1 -- 172.21.15.146:0/2858007628 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2520120f80 con 0x7f252009ad40 2023-10-03T10:18:04.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.701+0000 7f251cff9700 1 -- 172.21.15.146:0/2858007628 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f251400cd40 con 0x7f252009ad40 2023-10-03T10:18:04.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.701+0000 7f252645c700 1 -- 172.21.15.146:0/2858007628 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2520120850 con 0x7f252009ad40 2023-10-03T10:18:04.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.701+0000 7f251cff9700 1 -- 172.21.15.146:0/2858007628 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f251403fab0 con 0x7f252009ad40 2023-10-03T10:18:04.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.706+0000 7f251cff9700 1 -- 172.21.15.146:0/2858007628 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f251401b3b0 con 0x7f252009ad40 2023-10-03T10:18:04.807 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:04.842 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:04.892 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:04.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.896+0000 7f252645c700 1 -- 172.21.15.146:0/2858007628 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2520122500 con 0x7f252009ad40 2023-10-03T10:18:04.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.896+0000 7f251cff9700 1 -- 172.21.15.146:0/2858007628 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2520122500 con 0x7f252009ad40 2023-10-03T10:18:04.896 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.899+0000 7f252645c700 1 -- 172.21.15.146:0/2858007628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f252009ad40 msgr2=0x7f252011f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.899+0000 7f252645c700 1 --2- 172.21.15.146:0/2858007628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f252009ad40 0x7f252011f450 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f251400ec40 tx=0x7f251400ef50 comp rx=0 tx=0).stop 2023-10-03T10:18:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.899+0000 7f252645c700 1 -- 172.21.15.146:0/2858007628 shutdown_connections 2023-10-03T10:18:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.899+0000 7f252645c700 1 --2- 172.21.15.146:0/2858007628 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25201343d0 0x7f25201c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.899+0000 7f252645c700 1 --2- 172.21.15.146:0/2858007628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f252009ad40 0x7f252011f450 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.899+0000 7f252645c700 1 --2- 172.21.15.146:0/2858007628 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2520133f70 0x7f252011f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.899+0000 7f252645c700 1 -- 172.21.15.146:0/2858007628 >> 172.21.15.146:0/2858007628 conn(0x7f2520099c40 msgr2=0x7f25201bbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.899+0000 7f252645c700 1 -- 172.21.15.146:0/2858007628 shutdown_connections 2023-10-03T10:18:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.899+0000 7f252645c700 1 -- 172.21.15.146:0/2858007628 wait complete. 2023-10-03T10:18:04.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:04.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.938+0000 7f876f14a700 1 Processor -- start 2023-10-03T10:18:04.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.939+0000 7f876f14a700 1 -- start start 2023-10-03T10:18:04.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.939+0000 7f876f14a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f876809f350 0x7f8768138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.939+0000 7f876f14a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87681393a0 0x7f876813b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.939+0000 7f876f14a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f876809fa00 con 0x7f876809e870 2023-10-03T10:18:04.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.939+0000 7f876f14a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87680a0370 con 0x7f876809f350 2023-10-03T10:18:04.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.939+0000 7f876f14a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f876806bec0 con 0x7f87681393a0 2023-10-03T10:18:04.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.939+0000 7f8767fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f876809f350 0x7f8768138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.939+0000 7f8767fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f876809f350 0x7f8768138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33704/0 (socket says 172.21.15.146:33704) 2023-10-03T10:18:04.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.939+0000 7f876cee6700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f876809e870 0x7f876809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49698/0 (socket says 172.21.15.146:49698) 2023-10-03T10:18:04.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.939+0000 7f8767fff700 1 -- 172.21.15.146:0/239138805 learned_addr learned my addr 172.21.15.146:0/239138805 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:04.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.939+0000 7f876d6e7700 1 --2- 172.21.15.146:0/239138805 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87681393a0 0x7f876813b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.940+0000 7f876d6e7700 1 -- 172.21.15.146:0/239138805 >> v2:172.21.15.146:3300/0 conn(0x7f876809f350 msgr2=0x7f8768138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:04.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.940+0000 7f876d6e7700 1 --2- 172.21.15.146:0/239138805 >> v2:172.21.15.146:3300/0 conn(0x7f876809f350 0x7f8768138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.940+0000 7f876d6e7700 1 -- 172.21.15.146:0/239138805 >> v1:172.21.15.146:6789/0 conn(0x7f876809e870 legacy=0x7f876809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.940+0000 7f876d6e7700 1 -- 172.21.15.146:0/239138805 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876809ada0 con 0x7f87681393a0 2023-10-03T10:18:04.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.940+0000 7f8767fff700 1 --2- 172.21.15.146:0/239138805 >> v2:172.21.15.146:3300/0 conn(0x7f876809f350 0x7f8768138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.940+0000 7f876d6e7700 1 --2- 172.21.15.146:0/239138805 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87681393a0 0x7f876813b780 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8760009d90 tx=0x7f876000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=463dfcc70646352c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.940+0000 7f87677fe700 1 -- 172.21.15.146:0/239138805 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876000e070 con 0x7f87681393a0 2023-10-03T10:18:04.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.940+0000 7f87677fe700 1 -- 172.21.15.146:0/239138805 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876000bb20 con 0x7f87681393a0 2023-10-03T10:18:04.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.940+0000 7f87677fe700 1 -- 172.21.15.146:0/239138805 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760012430 con 0x7f87681393a0 2023-10-03T10:18:04.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.941+0000 7f876f14a700 1 -- 172.21.15.146:0/239138805 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87681393a0 msgr2=0x7f876813b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.941+0000 7f876f14a700 1 --2- 172.21.15.146:0/239138805 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87681393a0 0x7f876813b780 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8760009d90 tx=0x7f876000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:04.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.941+0000 7f876f14a700 1 -- 172.21.15.146:0/239138805 shutdown_connections 2023-10-03T10:18:04.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.941+0000 7f876f14a700 1 --2- 172.21.15.146:0/239138805 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f87681393a0 0x7f876813b780 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.941+0000 7f876f14a700 1 --2- 172.21.15.146:0/239138805 >> v2:172.21.15.146:3300/0 conn(0x7f876809f350 0x7f8768138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.941+0000 7f876f14a700 1 -- 172.21.15.146:0/239138805 >> 172.21.15.146:0/239138805 conn(0x7f87680a4430 msgr2=0x7f87680a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.941+0000 7f876f14a700 1 -- 172.21.15.146:0/239138805 shutdown_connections 2023-10-03T10:18:04.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.941+0000 7f876f14a700 1 -- 172.21.15.146:0/239138805 wait complete. 2023-10-03T10:18:04.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.942+0000 7f876f14a700 1 Processor -- start 2023-10-03T10:18:04.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.942+0000 7f876f14a700 1 -- start start 2023-10-03T10:18:04.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.943+0000 7f876f14a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f876809e870 0x7f876811ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.943+0000 7f876f14a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f876809f350 0x7f876811f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.943+0000 7f876f14a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87681393a0 0x7f876811f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.943+0000 7f876f14a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87681224a0 con 0x7f876809e870 2023-10-03T10:18:04.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.943+0000 7f876f14a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876806cfa0 con 0x7f87681393a0 2023-10-03T10:18:04.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.943+0000 7f876f14a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8768121c50 con 0x7f876809f350 2023-10-03T10:18:04.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.943+0000 7f876cee6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f876809e870 0x7f876811ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.943+0000 7f876d6e7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87681393a0 0x7f876811f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.943+0000 7f876cee6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f876809e870 0x7f876811ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33720/0 (socket says 172.21.15.146:33720) 2023-10-03T10:18:04.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.943+0000 7f876cee6700 1 -- 172.21.15.146:0/3657148130 learned_addr learned my addr 172.21.15.146:0/3657148130 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:04.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.943+0000 7f876d6e7700 1 --2- 172.21.15.146:0/3657148130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87681393a0 0x7f876811f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60340/0 (socket says 172.21.15.146:60340) 2023-10-03T10:18:04.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.943+0000 7f8767fff700 1 --2- 172.21.15.146:0/3657148130 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f876809f350 0x7f876811f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.943+0000 7f876d6e7700 1 -- 172.21.15.146:0/3657148130 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f876809f350 msgr2=0x7f876811f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.943+0000 7f876d6e7700 1 --2- 172.21.15.146:0/3657148130 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f876809f350 0x7f876811f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.943+0000 7f876d6e7700 1 -- 172.21.15.146:0/3657148130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f876809e870 msgr2=0x7f876811ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.943+0000 7f876d6e7700 1 --2- 172.21.15.146:0/3657148130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f876809e870 0x7f876811ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.943+0000 7f876d6e7700 1 -- 172.21.15.146:0/3657148130 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8754009550 con 0x7f87681393a0 2023-10-03T10:18:04.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.944+0000 7f876cee6700 1 --2- 172.21.15.146:0/3657148130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f876809e870 0x7f876811ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.944+0000 7f876d6e7700 1 --2- 172.21.15.146:0/3657148130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87681393a0 0x7f876811f550 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8760016000 tx=0x7f8760004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.944+0000 7f87657fa700 1 -- 172.21.15.146:0/3657148130 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760012430 con 0x7f87681393a0 2023-10-03T10:18:04.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.944+0000 7f87657fa700 1 -- 172.21.15.146:0/3657148130 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8760020070 con 0x7f87681393a0 2023-10-03T10:18:04.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.944+0000 7f876f14a700 1 -- 172.21.15.146:0/3657148130 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8760009a70 con 0x7f87681393a0 2023-10-03T10:18:04.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.944+0000 7f87657fa700 1 -- 172.21.15.146:0/3657148130 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760004040 con 0x7f87681393a0 2023-10-03T10:18:04.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.944+0000 7f876f14a700 1 -- 172.21.15.146:0/3657148130 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876806f960 con 0x7f87681393a0 2023-10-03T10:18:04.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.945+0000 7f87657fa700 1 -- 172.21.15.146:0/3657148130 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f87600041a0 con 0x7f87681393a0 2023-10-03T10:18:04.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.945+0000 7f87657fa700 1 -- 172.21.15.146:0/3657148130 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8760022070 con 0x7f87681393a0 2023-10-03T10:18:04.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.945+0000 7f876f14a700 1 -- 172.21.15.146:0/3657148130 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f876804f2a0 con 0x7f87681393a0 2023-10-03T10:18:04.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.950+0000 7f87657fa700 1 -- 172.21.15.146:0/3657148130 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f876001c400 con 0x7f87681393a0 2023-10-03T10:18:04.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.987+0000 7f1a7bca4700 1 Processor -- start 2023-10-03T10:18:04.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.987+0000 7f1a7bca4700 1 -- start start 2023-10-03T10:18:04.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.988+0000 7f1a7bca4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a7409e870 0x7f1a7409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.988+0000 7f1a7bca4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a7409f180 0x7f1a7413c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.988+0000 7f1a7bca4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1a7413c850 0x7f1a7413ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.988+0000 7f1a7bca4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a7409ad60 con 0x7f1a7413c850 2023-10-03T10:18:04.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.988+0000 7f1a7bca4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7406caf0 con 0x7f1a7409f180 2023-10-03T10:18:04.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.988+0000 7f1a7bca4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7406bd90 con 0x7f1a7409e870 2023-10-03T10:18:04.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.988+0000 7f1a7923f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a7409f180 0x7f1a7413c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.988+0000 7f1a7923f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a7409f180 0x7f1a7413c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60352/0 (socket says 172.21.15.146:60352) 2023-10-03T10:18:04.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.988+0000 7f1a7923f700 1 -- 172.21.15.146:0/3735239335 learned_addr learned my addr 172.21.15.146:0/3735239335 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:04.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.988+0000 7f1a79a40700 1 --2- 172.21.15.146:0/3735239335 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a7409e870 0x7f1a7409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.988+0000 7f1a7a241700 1 --2- 172.21.15.146:0/3735239335 >> v2:172.21.15.146:3300/0 conn(0x7f1a7413c850 0x7f1a7413ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.988+0000 7f1a7a241700 1 -- 172.21.15.146:0/3735239335 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a7409e870 msgr2=0x7f1a7409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:04.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.988+0000 7f1a7a241700 1 --2- 172.21.15.146:0/3735239335 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a7409e870 0x7f1a7409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.988+0000 7f1a7a241700 1 -- 172.21.15.146:0/3735239335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a7409f180 msgr2=0x7f1a7413c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:04.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.988+0000 7f1a7a241700 1 --2- 172.21.15.146:0/3735239335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a7409f180 0x7f1a7413c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.988+0000 7f1a7a241700 1 -- 172.21.15.146:0/3735239335 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7409a990 con 0x7f1a7413c850 2023-10-03T10:18:04.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.988+0000 7f1a79a40700 1 --2- 172.21.15.146:0/3735239335 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a7409e870 0x7f1a7409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.988+0000 7f1a7923f700 1 --2- 172.21.15.146:0/3735239335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a7409f180 0x7f1a7413c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.989+0000 7f1a7a241700 1 --2- 172.21.15.146:0/3735239335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a7413c850 0x7f1a7413ec30 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c009d90 tx=0x7f1a6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f83beb166bf0af server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.989+0000 7f1a78a3e700 1 -- 172.21.15.146:0/3735239335 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c00e070 con 0x7f1a7413c850 2023-10-03T10:18:04.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.989+0000 7f1a78a3e700 1 -- 172.21.15.146:0/3735239335 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6c00bb20 con 0x7f1a7413c850 2023-10-03T10:18:04.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.989+0000 7f1a78a3e700 1 -- 172.21.15.146:0/3735239335 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c012430 con 0x7f1a7413c850 2023-10-03T10:18:04.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.989+0000 7f1a7bca4700 1 -- 172.21.15.146:0/3735239335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a7413c850 msgr2=0x7f1a7413ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.989+0000 7f1a7bca4700 1 --2- 172.21.15.146:0/3735239335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a7413c850 0x7f1a7413ec30 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c009d90 tx=0x7f1a6c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:04.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.989+0000 7f1a7bca4700 1 -- 172.21.15.146:0/3735239335 shutdown_connections 2023-10-03T10:18:04.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.989+0000 7f1a7bca4700 1 --2- 172.21.15.146:0/3735239335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a7413c850 0x7f1a7413ec30 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.989+0000 7f1a7bca4700 1 --2- 172.21.15.146:0/3735239335 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a7409e870 0x7f1a7409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.989+0000 7f1a7bca4700 1 --2- 172.21.15.146:0/3735239335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a7409f180 0x7f1a7413c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.989+0000 7f1a7bca4700 1 -- 172.21.15.146:0/3735239335 >> 172.21.15.146:0/3735239335 conn(0x7f1a740a4150 msgr2=0x7f1a740a4550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.990+0000 7f1a7bca4700 1 -- 172.21.15.146:0/3735239335 shutdown_connections 2023-10-03T10:18:04.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.990+0000 7f1a7bca4700 1 -- 172.21.15.146:0/3735239335 wait complete. 2023-10-03T10:18:04.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.990+0000 7f1a7bca4700 1 Processor -- start 2023-10-03T10:18:04.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.990+0000 7f1a7bca4700 1 -- start start 2023-10-03T10:18:04.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.991+0000 7f1a7bca4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a7409e870 0x7f1a741274c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.991+0000 7f1a7bca4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a7409f180 0x7f1a74127a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.991+0000 7f1a7bca4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a7413c850 0x7f1a74127f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.991+0000 7f1a7bca4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a74128f80 con 0x7f1a7409e870 2023-10-03T10:18:04.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.991+0000 7f1a7bca4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7412aaa0 con 0x7f1a7413c850 2023-10-03T10:18:04.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.991+0000 7f1a7bca4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a74072360 con 0x7f1a7409f180 2023-10-03T10:18:04.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.991+0000 7f1a7923f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a7409f180 0x7f1a74127a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.991+0000 7f1a7923f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a7409f180 0x7f1a74127a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43296/0 (socket says 172.21.15.146:43296) 2023-10-03T10:18:04.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.991+0000 7f1a7923f700 1 -- 172.21.15.146:0/2380596221 learned_addr learned my addr 172.21.15.146:0/2380596221 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:04.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.991+0000 7f1a79a40700 1 --2- 172.21.15.146:0/2380596221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a7409e870 0x7f1a741274c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.991+0000 7f1a7923f700 1 -- 172.21.15.146:0/2380596221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a7413c850 msgr2=0x7f1a74127f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.991+0000 7f1a7a241700 1 --2- 172.21.15.146:0/2380596221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a7413c850 0x7f1a74127f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.991+0000 7f1a7923f700 1 --2- 172.21.15.146:0/2380596221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a7413c850 0x7f1a74127f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.991+0000 7f1a7923f700 1 -- 172.21.15.146:0/2380596221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a7409e870 msgr2=0x7f1a741274c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.991+0000 7f1a7923f700 1 --2- 172.21.15.146:0/2380596221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a7409e870 0x7f1a741274c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.991+0000 7f1a7923f700 1 -- 172.21.15.146:0/2380596221 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a700094a0 con 0x7f1a7409f180 2023-10-03T10:18:04.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.991+0000 7f1a7a241700 1 --2- 172.21.15.146:0/2380596221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a7413c850 0x7f1a74127f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:04.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.991+0000 7f1a7923f700 1 --2- 172.21.15.146:0/2380596221 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a7409f180 0x7f1a74127a00 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f1a6400ebe0 tx=0x7f1a6400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.992+0000 7f1a6a7fc700 1 -- 172.21.15.146:0/2380596221 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6400c850 con 0x7f1a7409f180 2023-10-03T10:18:04.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.992+0000 7f1a6a7fc700 1 -- 172.21.15.146:0/2380596221 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6400c9b0 con 0x7f1a7409f180 2023-10-03T10:18:04.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.992+0000 7f1a7bca4700 1 -- 172.21.15.146:0/2380596221 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a64009550 con 0x7f1a7409f180 2023-10-03T10:18:04.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.992+0000 7f1a6a7fc700 1 -- 172.21.15.146:0/2380596221 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6400cd60 con 0x7f1a7409f180 2023-10-03T10:18:04.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.992+0000 7f1a7bca4700 1 -- 172.21.15.146:0/2380596221 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a6c009a70 con 0x7f1a7409f180 2023-10-03T10:18:04.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.992+0000 7f1a6a7fc700 1 -- 172.21.15.146:0/2380596221 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a64013470 con 0x7f1a7409f180 2023-10-03T10:18:04.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.993+0000 7f1a7bca4700 1 -- 172.21.15.146:0/2380596221 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a7404f2a0 con 0x7f1a7409f180 2023-10-03T10:18:04.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.993+0000 7f1a6a7fc700 1 -- 172.21.15.146:0/2380596221 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1a6403fc60 con 0x7f1a7409f180 2023-10-03T10:18:04.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:04.997+0000 7f1a6a7fc700 1 -- 172.21.15.146:0/2380596221 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a6401b3b0 con 0x7f1a7409f180 2023-10-03T10:18:05.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.031+0000 7efe8d051700 1 Processor -- start 2023-10-03T10:18:05.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.031+0000 7efe8d051700 1 -- start start 2023-10-03T10:18:05.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.032+0000 7efe8d051700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efe880a1550 0x7efe88138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.032+0000 7efe8d051700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe88139200 0x7efe8813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.032+0000 7efe8d051700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe8809e9d0 con 0x7efe880a0a70 2023-10-03T10:18:05.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.032+0000 7efe8d051700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe8809dc00 con 0x7efe880a1550 2023-10-03T10:18:05.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.032+0000 7efe8d051700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8809dec0 con 0x7efe88139200 2023-10-03T10:18:05.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.032+0000 7efe8659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efe880a1550 0x7efe88138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.032+0000 7efe8659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efe880a1550 0x7efe88138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33756/0 (socket says 172.21.15.146:33756) 2023-10-03T10:18:05.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.032+0000 7efe8659c700 1 -- 172.21.15.146:0/4075919186 learned_addr learned my addr 172.21.15.146:0/4075919186 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:05.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.032+0000 7efe8759e700 1 --2- 172.21.15.146:0/4075919186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe88139200 0x7efe8813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.032+0000 7efe8659c700 1 -- 172.21.15.146:0/4075919186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe88139200 msgr2=0x7efe8813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:05.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.032+0000 7efe8659c700 1 --2- 172.21.15.146:0/4075919186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe88139200 0x7efe8813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.032+0000 7efe8659c700 1 -- 172.21.15.146:0/4075919186 >> v1:172.21.15.146:6789/0 conn(0x7efe880a0a70 legacy=0x7efe880a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.032+0000 7efe85d9b700 1 -- 172.21.15.146:0/4075919186 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3450776720 0 0) 0x7efe8809e9d0 con 0x7efe880a0a70 2023-10-03T10:18:05.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.032+0000 7efe8659c700 1 -- 172.21.15.146:0/4075919186 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8809e6a0 con 0x7efe880a1550 2023-10-03T10:18:05.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.032+0000 7efe8759e700 1 --2- 172.21.15.146:0/4075919186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe88139200 0x7efe8813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:05.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.032+0000 7efe8659c700 1 --2- 172.21.15.146:0/4075919186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe880a1550 0x7efe88138cc0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7efe7c0098f0 tx=0x7efe7c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d642380451d1eb11 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:05.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.033+0000 7efe85d9b700 1 -- 172.21.15.146:0/4075919186 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c011830 con 0x7efe880a1550 2023-10-03T10:18:05.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.033+0000 7efe85d9b700 1 -- 172.21.15.146:0/4075919186 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7c011990 con 0x7efe880a1550 2023-10-03T10:18:05.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.033+0000 7efe85d9b700 1 -- 172.21.15.146:0/4075919186 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c011d20 con 0x7efe880a1550 2023-10-03T10:18:05.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.033+0000 7efe8d051700 1 -- 172.21.15.146:0/4075919186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe880a1550 msgr2=0x7efe88138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.033+0000 7efe8d051700 1 --2- 172.21.15.146:0/4075919186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe880a1550 0x7efe88138cc0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7efe7c0098f0 tx=0x7efe7c009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:05.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.033+0000 7efe8d051700 1 -- 172.21.15.146:0/4075919186 shutdown_connections 2023-10-03T10:18:05.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.033+0000 7efe8d051700 1 --2- 172.21.15.146:0/4075919186 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe88139200 0x7efe8813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.033+0000 7efe8d051700 1 --2- 172.21.15.146:0/4075919186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe880a1550 0x7efe88138cc0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.033+0000 7efe8d051700 1 -- 172.21.15.146:0/4075919186 >> 172.21.15.146:0/4075919186 conn(0x7efe880a6610 msgr2=0x7efe880a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.033+0000 7efe8d051700 1 -- 172.21.15.146:0/4075919186 shutdown_connections 2023-10-03T10:18:05.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.033+0000 7efe8d051700 1 -- 172.21.15.146:0/4075919186 wait complete. 2023-10-03T10:18:05.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.035+0000 7efe8d051700 1 Processor -- start 2023-10-03T10:18:05.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.035+0000 7efe8d051700 1 -- start start 2023-10-03T10:18:05.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.036+0000 7efe8d051700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe880a0a70 0x7efe8811e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.036+0000 7efe8d051700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe880a1550 0x7efe8811ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.036+0000 7efe8d051700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe88139200 0x7efe8811f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.036+0000 7efe8d051700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe881219d0 con 0x7efe880a0a70 2023-10-03T10:18:05.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.036+0000 7efe8d051700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe880a5100 con 0x7efe88139200 2023-10-03T10:18:05.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.036+0000 7efe8d051700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe880a03e0 con 0x7efe880a1550 2023-10-03T10:18:05.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.036+0000 7efe86d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe880a0a70 0x7efe8811e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.036+0000 7efe8659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe880a1550 0x7efe8811ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.036+0000 7efe86d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe880a0a70 0x7efe8811e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33764/0 (socket says 172.21.15.146:33764) 2023-10-03T10:18:05.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.036+0000 7efe86d9d700 1 -- 172.21.15.146:0/525737575 learned_addr learned my addr 172.21.15.146:0/525737575 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:05.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.036+0000 7efe8759e700 1 --2- 172.21.15.146:0/525737575 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe88139200 0x7efe8811f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.036+0000 7efe86d9d700 1 -- 172.21.15.146:0/525737575 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe880a1550 msgr2=0x7efe8811ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.036+0000 7efe86d9d700 1 --2- 172.21.15.146:0/525737575 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe880a1550 0x7efe8811ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.036+0000 7efe86d9d700 1 -- 172.21.15.146:0/525737575 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe88139200 msgr2=0x7efe8811f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.036+0000 7efe86d9d700 1 --2- 172.21.15.146:0/525737575 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe88139200 0x7efe8811f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.036+0000 7efe86d9d700 1 -- 172.21.15.146:0/525737575 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe80009a70 con 0x7efe880a0a70 2023-10-03T10:18:05.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.036+0000 7efe8759e700 1 --2- 172.21.15.146:0/525737575 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe88139200 0x7efe8811f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:05.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.036+0000 7efe8659c700 1 --2- 172.21.15.146:0/525737575 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe880a1550 0x7efe8811ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:05.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.036+0000 7efe86d9d700 1 --2- 172.21.15.146:0/525737575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe880a0a70 0x7efe8811e770 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7efe78001eb0 tx=0x7efe7800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:05.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.037+0000 7efe6f7fe700 1 -- 172.21.15.146:0/525737575 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe780054e0 con 0x7efe880a0a70 2023-10-03T10:18:05.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.037+0000 7efe6f7fe700 1 -- 172.21.15.146:0/525737575 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe78003680 con 0x7efe880a0a70 2023-10-03T10:18:05.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.037+0000 7efe8d051700 1 -- 172.21.15.146:0/525737575 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe7c009550 con 0x7efe880a0a70 2023-10-03T10:18:05.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.037+0000 7efe6f7fe700 1 -- 172.21.15.146:0/525737575 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe780039f0 con 0x7efe880a0a70 2023-10-03T10:18:05.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.037+0000 7efe8d051700 1 -- 172.21.15.146:0/525737575 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe88120ae0 con 0x7efe880a0a70 2023-10-03T10:18:05.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.038+0000 7efe6f7fe700 1 -- 172.21.15.146:0/525737575 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe78003b50 con 0x7efe880a0a70 2023-10-03T10:18:05.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.038+0000 7efe8d051700 1 -- 172.21.15.146:0/525737575 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe88134610 con 0x7efe880a0a70 2023-10-03T10:18:05.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.038+0000 7efe6f7fe700 1 -- 172.21.15.146:0/525737575 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7efe7803ea50 con 0x7efe880a0a70 2023-10-03T10:18:05.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.042+0000 7efe6f7fe700 1 -- 172.21.15.146:0/525737575 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe7801b3b0 con 0x7efe880a0a70 2023-10-03T10:18:05.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.147+0000 7f876f14a700 1 -- 172.21.15.146:0/3657148130 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8768072d60 con 0x7f87681393a0 2023-10-03T10:18:05.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.148+0000 7f87657fa700 1 -- 172.21.15.146:0/3657148130 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8760035090 con 0x7f87681393a0 2023-10-03T10:18:05.147 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:05.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.150+0000 7f876f14a700 1 -- 172.21.15.146:0/3657148130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87681393a0 msgr2=0x7f876811f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.150+0000 7f876f14a700 1 --2- 172.21.15.146:0/3657148130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87681393a0 0x7f876811f550 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8760016000 tx=0x7f8760004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.150+0000 7f876f14a700 1 -- 172.21.15.146:0/3657148130 shutdown_connections 2023-10-03T10:18:05.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.150+0000 7f876f14a700 1 --2- 172.21.15.146:0/3657148130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87681393a0 0x7f876811f550 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.150+0000 7f876f14a700 1 --2- 172.21.15.146:0/3657148130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f876809e870 0x7f876811ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.150+0000 7f876f14a700 1 --2- 172.21.15.146:0/3657148130 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f876809f350 0x7f876811f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.150+0000 7f876f14a700 1 -- 172.21.15.146:0/3657148130 >> 172.21.15.146:0/3657148130 conn(0x7f87680a4430 msgr2=0x7f87681382c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.150+0000 7f876f14a700 1 -- 172.21.15.146:0/3657148130 shutdown_connections 2023-10-03T10:18:05.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.150+0000 7f876f14a700 1 -- 172.21.15.146:0/3657148130 wait complete. 2023-10-03T10:18:05.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:05.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.200+0000 7f1a7bca4700 1 -- 172.21.15.146:0/2380596221 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1a7412a6f0 con 0x7f1a7409f180 2023-10-03T10:18:05.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.200+0000 7f1a6a7fc700 1 -- 172.21.15.146:0/2380596221 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1a64017070 con 0x7f1a7409f180 2023-10-03T10:18:05.200 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:05.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.202+0000 7f1a7bca4700 1 -- 172.21.15.146:0/2380596221 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a7409f180 msgr2=0x7f1a74127a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.202+0000 7f1a7bca4700 1 --2- 172.21.15.146:0/2380596221 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a7409f180 0x7f1a74127a00 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f1a6400ebe0 tx=0x7f1a6400eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.202+0000 7f1a7bca4700 1 -- 172.21.15.146:0/2380596221 shutdown_connections 2023-10-03T10:18:05.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.202+0000 7f1a7bca4700 1 --2- 172.21.15.146:0/2380596221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1a7413c850 0x7f1a74127f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.202+0000 7f1a7bca4700 1 --2- 172.21.15.146:0/2380596221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a7409e870 0x7f1a741274c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.202+0000 7f1a7bca4700 1 --2- 172.21.15.146:0/2380596221 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1a7409f180 0x7f1a74127a00 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.202+0000 7f1a7bca4700 1 -- 172.21.15.146:0/2380596221 >> 172.21.15.146:0/2380596221 conn(0x7f1a740a4150 msgr2=0x7f1a740a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.202+0000 7f1a7bca4700 1 -- 172.21.15.146:0/2380596221 shutdown_connections 2023-10-03T10:18:05.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.202+0000 7f1a7bca4700 1 -- 172.21.15.146:0/2380596221 wait complete. 2023-10-03T10:18:05.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:05.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.235+0000 7efe8d051700 1 -- 172.21.15.146:0/525737575 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efe8804f2a0 con 0x7efe880a0a70 2023-10-03T10:18:05.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.236+0000 7efe6f7fe700 1 -- 172.21.15.146:0/525737575 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe78017070 con 0x7efe880a0a70 2023-10-03T10:18:05.235 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.238+0000 7efe8d051700 1 -- 172.21.15.146:0/525737575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe880a0a70 msgr2=0x7efe8811e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.238+0000 7efe8d051700 1 --2- 172.21.15.146:0/525737575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe880a0a70 0x7efe8811e770 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7efe78001eb0 tx=0x7efe7800c800 comp rx=0 tx=0).stop 2023-10-03T10:18:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.238+0000 7efe8d051700 1 -- 172.21.15.146:0/525737575 shutdown_connections 2023-10-03T10:18:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.238+0000 7efe8d051700 1 --2- 172.21.15.146:0/525737575 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe88139200 0x7efe8811f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.238+0000 7efe8d051700 1 --2- 172.21.15.146:0/525737575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe880a0a70 0x7efe8811e770 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.238+0000 7efe8d051700 1 --2- 172.21.15.146:0/525737575 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7efe880a1550 0x7efe8811ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.238+0000 7efe8d051700 1 -- 172.21.15.146:0/525737575 >> 172.21.15.146:0/525737575 conn(0x7efe880a6610 msgr2=0x7efe880a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.238+0000 7efe8d051700 1 -- 172.21.15.146:0/525737575 shutdown_connections 2023-10-03T10:18:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:05.238+0000 7efe8d051700 1 -- 172.21.15.146:0/525737575 wait complete. 2023-10-03T10:18:05.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:05.915 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:06.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.042+0000 7f4a0d8a8700 1 Processor -- start 2023-10-03T10:18:06.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.042+0000 7f4a0d8a8700 1 -- start start 2023-10-03T10:18:06.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.043+0000 7f4a0d8a8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a0809f430 0x7f4a08138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.043+0000 7f4a0d8a8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4a081393a0 0x7f4a0813b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.043+0000 7f4a0d8a8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a0806d8a0 con 0x7f4a0809e950 2023-10-03T10:18:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.043+0000 7f4a0d8a8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a080a0680 con 0x7f4a081393a0 2023-10-03T10:18:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.043+0000 7f4a0d8a8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0806caa0 con 0x7f4a0809f430 2023-10-03T10:18:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.043+0000 7f4a067fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a0809f430 0x7f4a08138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.043+0000 7f4a077fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4a081393a0 0x7f4a0813b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.043+0000 7f4a06ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4a0809e950 0x7f4a0809ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49718/0 (socket says 172.21.15.146:49718) 2023-10-03T10:18:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.043+0000 7f4a077fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4a081393a0 0x7f4a0813b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33780/0 (socket says 172.21.15.146:33780) 2023-10-03T10:18:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.043+0000 7f4a06ffd700 1 -- 172.21.15.146:0/1127778526 learned_addr learned my addr 172.21.15.146:0/1127778526 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.043+0000 7f4a067fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a0809f430 0x7f4a08138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43308/0 (socket says 172.21.15.146:43308) 2023-10-03T10:18:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.043+0000 7f4a067fc700 1 -- 172.21.15.146:0/1127778526 >> v2:172.21.15.146:3300/0 conn(0x7f4a081393a0 msgr2=0x7f4a0813b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.043+0000 7f4a067fc700 1 --2- 172.21.15.146:0/1127778526 >> v2:172.21.15.146:3300/0 conn(0x7f4a081393a0 0x7f4a0813b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.043+0000 7f4a067fc700 1 -- 172.21.15.146:0/1127778526 >> v1:172.21.15.146:6789/0 conn(0x7f4a0809e950 legacy=0x7f4a0809ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.043+0000 7f4a05ffb700 1 -- 172.21.15.146:0/1127778526 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 870651763 0 0) 0x7f4a0806d8a0 con 0x7f4a0809e950 2023-10-03T10:18:06.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.043+0000 7f4a067fc700 1 -- 172.21.15.146:0/1127778526 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0806b920 con 0x7f4a0809f430 2023-10-03T10:18:06.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.043+0000 7f4a077fe700 1 --2- 172.21.15.146:0/1127778526 >> v2:172.21.15.146:3300/0 conn(0x7f4a081393a0 0x7f4a0813b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.044+0000 7f4a067fc700 1 --2- 172.21.15.146:0/1127778526 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a0809f430 0x7f4a08138e60 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f49f8009820 tx=0x7f49f8009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=901edc20f392e3ea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.044+0000 7f4a05ffb700 1 -- 172.21.15.146:0/1127778526 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f8005e30 con 0x7f4a0809f430 2023-10-03T10:18:06.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.044+0000 7f4a05ffb700 1 -- 172.21.15.146:0/1127778526 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f8006030 con 0x7f4a0809f430 2023-10-03T10:18:06.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.044+0000 7f4a05ffb700 1 -- 172.21.15.146:0/1127778526 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f80063c0 con 0x7f4a0809f430 2023-10-03T10:18:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.044+0000 7f4a0d8a8700 1 -- 172.21.15.146:0/1127778526 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a0809f430 msgr2=0x7f4a08138e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.044+0000 7f4a0d8a8700 1 --2- 172.21.15.146:0/1127778526 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a0809f430 0x7f4a08138e60 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f49f8009820 tx=0x7f49f8009b30 comp rx=0 tx=0).stop 2023-10-03T10:18:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.044+0000 7f4a0d8a8700 1 -- 172.21.15.146:0/1127778526 shutdown_connections 2023-10-03T10:18:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.044+0000 7f4a0d8a8700 1 --2- 172.21.15.146:0/1127778526 >> v2:172.21.15.146:3300/0 conn(0x7f4a081393a0 0x7f4a0813b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.044+0000 7f4a0d8a8700 1 --2- 172.21.15.146:0/1127778526 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a0809f430 0x7f4a08138e60 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.044+0000 7f4a0d8a8700 1 -- 172.21.15.146:0/1127778526 >> 172.21.15.146:0/1127778526 conn(0x7f4a080a4470 msgr2=0x7f4a080a4870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.044+0000 7f4a0d8a8700 1 -- 172.21.15.146:0/1127778526 shutdown_connections 2023-10-03T10:18:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.044+0000 7f4a0d8a8700 1 -- 172.21.15.146:0/1127778526 wait complete. 2023-10-03T10:18:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.045+0000 7f4a0d8a8700 1 Processor -- start 2023-10-03T10:18:06.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.045+0000 7f4a0d8a8700 1 -- start start 2023-10-03T10:18:06.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.046+0000 7f4a0d8a8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a0809e950 0x7f4a08121860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.046+0000 7f4a0d8a8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a0809f430 0x7f4a08121da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.046+0000 7f4a0d8a8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a081393a0 0x7f4a081222e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.046+0000 7f4a0d8a8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a08124680 con 0x7f4a0809f430 2023-10-03T10:18:06.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.046+0000 7f4a0d8a8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a08122ca0 con 0x7f4a081393a0 2023-10-03T10:18:06.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.046+0000 7f4a0d8a8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0806ccc0 con 0x7f4a0809e950 2023-10-03T10:18:06.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.046+0000 7f4a06ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a0809e950 0x7f4a08121860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.046+0000 7f4a067fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a0809f430 0x7f4a08121da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.046+0000 7f4a06ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a0809e950 0x7f4a08121860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43320/0 (socket says 172.21.15.146:43320) 2023-10-03T10:18:06.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.046+0000 7f4a06ffd700 1 -- 172.21.15.146:0/1604737943 learned_addr learned my addr 172.21.15.146:0/1604737943 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:06.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.046+0000 7f4a077fe700 1 --2- 172.21.15.146:0/1604737943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a081393a0 0x7f4a081222e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.046+0000 7f4a067fc700 1 -- 172.21.15.146:0/1604737943 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a0809e950 msgr2=0x7f4a08121860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.046+0000 7f4a067fc700 1 --2- 172.21.15.146:0/1604737943 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a0809e950 0x7f4a08121860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.046+0000 7f4a067fc700 1 -- 172.21.15.146:0/1604737943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a081393a0 msgr2=0x7f4a081222e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.046+0000 7f4a067fc700 1 --2- 172.21.15.146:0/1604737943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a081393a0 0x7f4a081222e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.046+0000 7f4a067fc700 1 -- 172.21.15.146:0/1604737943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a00009a70 con 0x7f4a0809f430 2023-10-03T10:18:06.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.046+0000 7f4a06ffd700 1 --2- 172.21.15.146:0/1604737943 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a0809e950 0x7f4a08121860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.046+0000 7f4a067fc700 1 --2- 172.21.15.146:0/1604737943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a0809f430 0x7f4a08121da0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f49f8015000 tx=0x7f49f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.046+0000 7f49effff700 1 -- 172.21.15.146:0/1604737943 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f8004240 con 0x7f4a0809f430 2023-10-03T10:18:06.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.047+0000 7f49effff700 1 -- 172.21.15.146:0/1604737943 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f80043c0 con 0x7f4a0809f430 2023-10-03T10:18:06.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.047+0000 7f4a0d8a8700 1 -- 172.21.15.146:0/1604737943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f8009430 con 0x7f4a0809f430 2023-10-03T10:18:06.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.047+0000 7f49effff700 1 -- 172.21.15.146:0/1604737943 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f8006950 con 0x7f4a0809f430 2023-10-03T10:18:06.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.047+0000 7f4a0d8a8700 1 -- 172.21.15.146:0/1604737943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a08123c90 con 0x7f4a0809f430 2023-10-03T10:18:06.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.047+0000 7f49effff700 1 -- 172.21.15.146:0/1604737943 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f49f8022070 con 0x7f4a0809f430 2023-10-03T10:18:06.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.047+0000 7f49effff700 1 -- 172.21.15.146:0/1604737943 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f49f8040d90 con 0x7f4a0809f430 2023-10-03T10:18:06.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.048+0000 7f4a0d8a8700 1 -- 172.21.15.146:0/1604737943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a0804f2a0 con 0x7f4a0809f430 2023-10-03T10:18:06.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.052+0000 7f49effff700 1 -- 172.21.15.146:0/1604737943 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49f802a070 con 0x7f4a0809f430 2023-10-03T10:18:06.166 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:06.215 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:06.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.244+0000 7f4a0d8a8700 1 -- 172.21.15.146:0/1604737943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4a0806b2e0 con 0x7f4a0809f430 2023-10-03T10:18:06.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.244+0000 7f49effff700 1 -- 172.21.15.146:0/1604737943 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f49f802f800 con 0x7f4a0809f430 2023-10-03T10:18:06.244 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:06.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.246+0000 7f4a0d8a8700 1 -- 172.21.15.146:0/1604737943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a0809f430 msgr2=0x7f4a08121da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.246+0000 7f4a0d8a8700 1 --2- 172.21.15.146:0/1604737943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a0809f430 0x7f4a08121da0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f49f8015000 tx=0x7f49f8004750 comp rx=0 tx=0).stop 2023-10-03T10:18:06.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.246+0000 7f4a0d8a8700 1 -- 172.21.15.146:0/1604737943 shutdown_connections 2023-10-03T10:18:06.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.246+0000 7f4a0d8a8700 1 --2- 172.21.15.146:0/1604737943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a081393a0 0x7f4a081222e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.246+0000 7f4a0d8a8700 1 --2- 172.21.15.146:0/1604737943 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4a0809e950 0x7f4a08121860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.246+0000 7f4a0d8a8700 1 --2- 172.21.15.146:0/1604737943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a0809f430 0x7f4a08121da0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.246+0000 7f4a0d8a8700 1 -- 172.21.15.146:0/1604737943 >> 172.21.15.146:0/1604737943 conn(0x7f4a080a4470 msgr2=0x7f4a080a1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.247+0000 7f4a0d8a8700 1 -- 172.21.15.146:0/1604737943 shutdown_connections 2023-10-03T10:18:06.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.247+0000 7f4a0d8a8700 1 -- 172.21.15.146:0/1604737943 wait complete. 2023-10-03T10:18:06.250 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:06.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:06.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.295+0000 7fe8c13b7700 1 Processor -- start 2023-10-03T10:18:06.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.295+0000 7fe8c13b7700 1 -- start start 2023-10-03T10:18:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.295+0000 7fe8c13b7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe8bc133ad0 0x7fe8bc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.295+0000 7fe8c13b7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8bc130bc0 0x7fe8bc13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.295+0000 7fe8c13b7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8bc06b2d0 con 0x7fe8bc1300a0 2023-10-03T10:18:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.295+0000 7fe8c13b7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8bc133610 con 0x7fe8bc133ad0 2023-10-03T10:18:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.295+0000 7fe8c13b7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc09a500 con 0x7fe8bc130bc0 2023-10-03T10:18:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.295+0000 7fe8baffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe8bc133ad0 0x7fe8bc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.295+0000 7fe8ba7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe8bc1300a0 0x7fe8bc1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49720/0 (socket says 172.21.15.146:49720) 2023-10-03T10:18:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.295+0000 7fe8ba7fc700 1 -- 172.21.15.146:0/3667630175 learned_addr learned my addr 172.21.15.146:0/3667630175 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.295+0000 7fe8bb7fe700 1 --2- 172.21.15.146:0/3667630175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8bc130bc0 0x7fe8bc13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.296+0000 7fe8baffd700 1 -- 172.21.15.146:0/3667630175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8bc130bc0 msgr2=0x7fe8bc13b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.296+0000 7fe8baffd700 1 --2- 172.21.15.146:0/3667630175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8bc130bc0 0x7fe8bc13b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.296+0000 7fe8baffd700 1 -- 172.21.15.146:0/3667630175 >> v1:172.21.15.146:6789/0 conn(0x7fe8bc1300a0 legacy=0x7fe8bc1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.296+0000 7fe8b9ffb700 1 -- 172.21.15.146:0/3667630175 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152939638 0 0) 0x7fe8bc06b2d0 con 0x7fe8bc1300a0 2023-10-03T10:18:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.296+0000 7fe8baffd700 1 -- 172.21.15.146:0/3667630175 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc1338b0 con 0x7fe8bc133ad0 2023-10-03T10:18:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.296+0000 7fe8bb7fe700 1 --2- 172.21.15.146:0/3667630175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8bc130bc0 0x7fe8bc13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.296+0000 7fe8baffd700 1 --2- 172.21.15.146:0/3667630175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8bc133ad0 0x7fe8bc133ea0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac009840 tx=0x7fe8ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c627857300b9c7fd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.296+0000 7fe8b9ffb700 1 -- 172.21.15.146:0/3667630175 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac011830 con 0x7fe8bc133ad0 2023-10-03T10:18:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.296+0000 7fe8b9ffb700 1 -- 172.21.15.146:0/3667630175 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac011990 con 0x7fe8bc133ad0 2023-10-03T10:18:06.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.296+0000 7fe8b9ffb700 1 -- 172.21.15.146:0/3667630175 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac011d20 con 0x7fe8bc133ad0 2023-10-03T10:18:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.297+0000 7fe8c13b7700 1 -- 172.21.15.146:0/3667630175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8bc133ad0 msgr2=0x7fe8bc133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.297+0000 7fe8c13b7700 1 --2- 172.21.15.146:0/3667630175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8bc133ad0 0x7fe8bc133ea0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac009840 tx=0x7fe8ac009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.297+0000 7fe8c13b7700 1 -- 172.21.15.146:0/3667630175 shutdown_connections 2023-10-03T10:18:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.297+0000 7fe8c13b7700 1 --2- 172.21.15.146:0/3667630175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8bc130bc0 0x7fe8bc13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.297+0000 7fe8c13b7700 1 --2- 172.21.15.146:0/3667630175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8bc133ad0 0x7fe8bc133ea0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.297+0000 7fe8c13b7700 1 -- 172.21.15.146:0/3667630175 >> 172.21.15.146:0/3667630175 conn(0x7fe8bc099c40 msgr2=0x7fe8bc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.297+0000 7fe8c13b7700 1 -- 172.21.15.146:0/3667630175 shutdown_connections 2023-10-03T10:18:06.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.297+0000 7fe8c13b7700 1 -- 172.21.15.146:0/3667630175 wait complete. 2023-10-03T10:18:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.298+0000 7fe8c13b7700 1 Processor -- start 2023-10-03T10:18:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.298+0000 7fe8c13b7700 1 -- start start 2023-10-03T10:18:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.298+0000 7fe8c13b7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8bc1300a0 0x7fe8bc0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.298+0000 7fe8c13b7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8bc130bc0 0x7fe8bc070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.298+0000 7fe8c13b7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8bc133ad0 0x7fe8bc071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.298+0000 7fe8c13b7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc072100 con 0x7fe8bc133ad0 2023-10-03T10:18:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.298+0000 7fe8c13b7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc11e9f0 con 0x7fe8bc130bc0 2023-10-03T10:18:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.298+0000 7fe8c13b7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc11dad0 con 0x7fe8bc1300a0 2023-10-03T10:18:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.299+0000 7fe8ba7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8bc130bc0 0x7fe8bc070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.299+0000 7fe8baffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8bc1300a0 0x7fe8bc0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.299+0000 7fe8baffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8bc1300a0 0x7fe8bc0705f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43336/0 (socket says 172.21.15.146:43336) 2023-10-03T10:18:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.299+0000 7fe8baffd700 1 -- 172.21.15.146:0/3830818445 learned_addr learned my addr 172.21.15.146:0/3830818445 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.299+0000 7fe8bb7fe700 1 --2- 172.21.15.146:0/3830818445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8bc133ad0 0x7fe8bc071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.299+0000 7fe8ba7fc700 1 -- 172.21.15.146:0/3830818445 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8bc1300a0 msgr2=0x7fe8bc0705f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.299+0000 7fe8ba7fc700 1 --2- 172.21.15.146:0/3830818445 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8bc1300a0 0x7fe8bc0705f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.299+0000 7fe8ba7fc700 1 -- 172.21.15.146:0/3830818445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8bc133ad0 msgr2=0x7fe8bc071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.299+0000 7fe8ba7fc700 1 --2- 172.21.15.146:0/3830818445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8bc133ad0 0x7fe8bc071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.299+0000 7fe8ba7fc700 1 -- 172.21.15.146:0/3830818445 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b4009a70 con 0x7fe8bc130bc0 2023-10-03T10:18:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.299+0000 7fe8baffd700 1 --2- 172.21.15.146:0/3830818445 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8bc1300a0 0x7fe8bc0705f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.299+0000 7fe8ba7fc700 1 --2- 172.21.15.146:0/3830818445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8bc130bc0 0x7fe8bc070b30 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000c470 tx=0x7fe8b000c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.299+0000 7fe8a37fe700 1 -- 172.21.15.146:0/3830818445 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0004c80 con 0x7fe8bc130bc0 2023-10-03T10:18:06.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.299+0000 7fe8a37fe700 1 -- 172.21.15.146:0/3830818445 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b0004de0 con 0x7fe8bc130bc0 2023-10-03T10:18:06.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.299+0000 7fe8c13b7700 1 -- 172.21.15.146:0/3830818445 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ac0094a0 con 0x7fe8bc130bc0 2023-10-03T10:18:06.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.299+0000 7fe8a37fe700 1 -- 172.21.15.146:0/3830818445 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0007310 con 0x7fe8bc130bc0 2023-10-03T10:18:06.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.299+0000 7fe8c13b7700 1 -- 172.21.15.146:0/3830818445 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8bc11dcf0 con 0x7fe8bc130bc0 2023-10-03T10:18:06.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.300+0000 7fe8a37fe700 1 -- 172.21.15.146:0/3830818445 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe8b0007470 con 0x7fe8bc130bc0 2023-10-03T10:18:06.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.301+0000 7fe8c13b7700 1 -- 172.21.15.146:0/3830818445 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8bc11edc0 con 0x7fe8bc130bc0 2023-10-03T10:18:06.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.301+0000 7fe8a37fe700 1 -- 172.21.15.146:0/3830818445 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe8b003f200 con 0x7fe8bc130bc0 2023-10-03T10:18:06.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.305+0000 7fe8a37fe700 1 -- 172.21.15.146:0/3830818445 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe8b0007720 con 0x7fe8bc130bc0 2023-10-03T10:18:06.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.354+0000 7fa22eced700 1 Processor -- start 2023-10-03T10:18:06.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.354+0000 7fa22eced700 1 -- start start 2023-10-03T10:18:06.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.354+0000 7fa22eced700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa22809e870 0x7fa22809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.354+0000 7fa22eced700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa22809f180 0x7fa228133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.354+0000 7fa22eced700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa2281341d0 0x7fa228134670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.354+0000 7fa22eced700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22806ce60 con 0x7fa2281341d0 2023-10-03T10:18:06.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.354+0000 7fa22eced700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22806bec0 con 0x7fa22809f180 2023-10-03T10:18:06.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.354+0000 7fa22eced700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa22809fa00 con 0x7fa22809e870 2023-10-03T10:18:06.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.354+0000 7fa227fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa22809f180 0x7fa228133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.354+0000 7fa22ca89700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa22809e870 0x7fa22809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.354+0000 7fa227fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa22809f180 0x7fa228133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60422/0 (socket says 172.21.15.146:60422) 2023-10-03T10:18:06.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.354+0000 7fa227fff700 1 -- 172.21.15.146:0/2813458299 learned_addr learned my addr 172.21.15.146:0/2813458299 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:06.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.354+0000 7fa22d28a700 1 --2- 172.21.15.146:0/2813458299 >> v2:172.21.15.146:3300/0 conn(0x7fa2281341d0 0x7fa228134670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.355+0000 7fa227fff700 1 -- 172.21.15.146:0/2813458299 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa22809e870 msgr2=0x7fa22809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.355+0000 7fa227fff700 1 --2- 172.21.15.146:0/2813458299 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa22809e870 0x7fa22809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.355+0000 7fa227fff700 1 -- 172.21.15.146:0/2813458299 >> v2:172.21.15.146:3300/0 conn(0x7fa2281341d0 msgr2=0x7fa228134670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.355+0000 7fa227fff700 1 --2- 172.21.15.146:0/2813458299 >> v2:172.21.15.146:3300/0 conn(0x7fa2281341d0 0x7fa228134670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.355+0000 7fa227fff700 1 -- 172.21.15.146:0/2813458299 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22809ad80 con 0x7fa22809f180 2023-10-03T10:18:06.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.355+0000 7fa22ca89700 1 --2- 172.21.15.146:0/2813458299 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa22809e870 0x7fa22809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.355+0000 7fa227fff700 1 --2- 172.21.15.146:0/2813458299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa22809f180 0x7fa228133c90 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa214009920 tx=0x7fa214009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a0f3fe2561ac1f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.355+0000 7fa2277fe700 1 -- 172.21.15.146:0/2813458299 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa214011830 con 0x7fa22809f180 2023-10-03T10:18:06.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.355+0000 7fa2277fe700 1 -- 172.21.15.146:0/2813458299 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa214011990 con 0x7fa22809f180 2023-10-03T10:18:06.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.355+0000 7fa2277fe700 1 -- 172.21.15.146:0/2813458299 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa214011d20 con 0x7fa22809f180 2023-10-03T10:18:06.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.356+0000 7fa22eced700 1 -- 172.21.15.146:0/2813458299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa22809f180 msgr2=0x7fa228133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.356+0000 7fa22eced700 1 --2- 172.21.15.146:0/2813458299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa22809f180 0x7fa228133c90 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa214009920 tx=0x7fa214009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:06.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.356+0000 7fa22eced700 1 -- 172.21.15.146:0/2813458299 shutdown_connections 2023-10-03T10:18:06.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.356+0000 7fa22eced700 1 --2- 172.21.15.146:0/2813458299 >> v2:172.21.15.146:3300/0 conn(0x7fa2281341d0 0x7fa228134670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.356+0000 7fa22eced700 1 --2- 172.21.15.146:0/2813458299 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa22809e870 0x7fa22809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.356+0000 7fa22eced700 1 --2- 172.21.15.146:0/2813458299 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa22809f180 0x7fa228133c90 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.356+0000 7fa22eced700 1 -- 172.21.15.146:0/2813458299 >> 172.21.15.146:0/2813458299 conn(0x7fa2280a4430 msgr2=0x7fa2280a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.356+0000 7fa22eced700 1 -- 172.21.15.146:0/2813458299 shutdown_connections 2023-10-03T10:18:06.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.356+0000 7fa22eced700 1 -- 172.21.15.146:0/2813458299 wait complete. 2023-10-03T10:18:06.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.357+0000 7fa22eced700 1 Processor -- start 2023-10-03T10:18:06.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.357+0000 7fa22eced700 1 -- start start 2023-10-03T10:18:06.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.358+0000 7fa22eced700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa22809e870 0x7fa228122530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.358+0000 7fa22eced700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa22809f180 0x7fa228122a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.358+0000 7fa22eced700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2281341d0 0x7fa228122fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.358+0000 7fa22eced700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa228125d80 con 0x7fa2281341d0 2023-10-03T10:18:06.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.358+0000 7fa22eced700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2281240b0 con 0x7fa22809f180 2023-10-03T10:18:06.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.358+0000 7fa22eced700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa228124f40 con 0x7fa22809e870 2023-10-03T10:18:06.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.358+0000 7fa227fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa22809f180 0x7fa228122a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.358+0000 7fa22ca89700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa22809e870 0x7fa228122530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.358+0000 7fa227fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa22809f180 0x7fa228122a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60426/0 (socket says 172.21.15.146:60426) 2023-10-03T10:18:06.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.358+0000 7fa227fff700 1 -- 172.21.15.146:0/2548046454 learned_addr learned my addr 172.21.15.146:0/2548046454 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:06.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.358+0000 7fa22d28a700 1 --2- 172.21.15.146:0/2548046454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2281341d0 0x7fa228122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.358+0000 7fa227fff700 1 -- 172.21.15.146:0/2548046454 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa22809e870 msgr2=0x7fa228122530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.358+0000 7fa227fff700 1 --2- 172.21.15.146:0/2548046454 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa22809e870 0x7fa228122530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.358+0000 7fa227fff700 1 -- 172.21.15.146:0/2548046454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2281341d0 msgr2=0x7fa228122fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.358+0000 7fa227fff700 1 --2- 172.21.15.146:0/2548046454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2281341d0 0x7fa228122fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.358+0000 7fa227fff700 1 -- 172.21.15.146:0/2548046454 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21c0094a0 con 0x7fa22809f180 2023-10-03T10:18:06.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.358+0000 7fa22ca89700 1 --2- 172.21.15.146:0/2548046454 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa22809e870 0x7fa228122530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.358+0000 7fa22d28a700 1 --2- 172.21.15.146:0/2548046454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2281341d0 0x7fa228122fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.359+0000 7fa227fff700 1 --2- 172.21.15.146:0/2548046454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa22809f180 0x7fa228122a70 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fa214000c00 tx=0x7fa214004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.359+0000 7fa2257fa700 1 -- 172.21.15.146:0/2548046454 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa214004240 con 0x7fa22809f180 2023-10-03T10:18:06.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.359+0000 7fa2257fa700 1 -- 172.21.15.146:0/2548046454 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21401f070 con 0x7fa22809f180 2023-10-03T10:18:06.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.359+0000 7fa22eced700 1 -- 172.21.15.146:0/2548046454 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa214009550 con 0x7fa22809f180 2023-10-03T10:18:06.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.359+0000 7fa2257fa700 1 -- 172.21.15.146:0/2548046454 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2140036a0 con 0x7fa22809f180 2023-10-03T10:18:06.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.359+0000 7fa22eced700 1 -- 172.21.15.146:0/2548046454 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2280a1770 con 0x7fa22809f180 2023-10-03T10:18:06.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.360+0000 7fa2257fa700 1 -- 172.21.15.146:0/2548046454 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa214021030 con 0x7fa22809f180 2023-10-03T10:18:06.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.360+0000 7fa2257fa700 1 -- 172.21.15.146:0/2548046454 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa214040720 con 0x7fa22809f180 2023-10-03T10:18:06.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.360+0000 7fa22eced700 1 -- 172.21.15.146:0/2548046454 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa228125300 con 0x7fa22809f180 2023-10-03T10:18:06.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.369+0000 7fa2257fa700 1 -- 172.21.15.146:0/2548046454 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa21400b9d0 con 0x7fa22809f180 2023-10-03T10:18:06.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.389+0000 7f56d79b0700 1 Processor -- start 2023-10-03T10:18:06.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.389+0000 7f56d79b0700 1 -- start start 2023-10-03T10:18:06.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.390+0000 7f56d79b0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56d009ad40 0x7f56d0133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.390+0000 7f56d79b0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f56d01343a0 0x7f56d00a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.390+0000 7f56d79b0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d009b110 con 0x7f56d0133f70 2023-10-03T10:18:06.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.390+0000 7f56d79b0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d00a3b60 con 0x7f56d01343a0 2023-10-03T10:18:06.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.390+0000 7f56d79b0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d00a2fa0 con 0x7f56d009ad40 2023-10-03T10:18:06.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.390+0000 7f56d574c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56d009ad40 0x7f56d0133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.390+0000 7f56d5f4d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f56d01343a0 0x7f56d00a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.390+0000 7f56d4f4b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f56d0133f70 0x7f56d00a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49722/0 (socket says 172.21.15.146:49722) 2023-10-03T10:18:06.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.390+0000 7f56d4f4b700 1 -- 172.21.15.146:0/2231795214 learned_addr learned my addr 172.21.15.146:0/2231795214 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:06.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.390+0000 7f56d574c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56d009ad40 0x7f56d0133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60436/0 (socket says 172.21.15.146:60436) 2023-10-03T10:18:06.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.390+0000 7f56c7fff700 1 -- 172.21.15.146:0/2231795214 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 317629064 0 0) 0x7f56d009b110 con 0x7f56d0133f70 2023-10-03T10:18:06.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.390+0000 7f56d574c700 1 -- 172.21.15.146:0/2231795214 >> v2:172.21.15.146:3300/0 conn(0x7f56d01343a0 msgr2=0x7f56d00a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.390+0000 7f56d574c700 1 --2- 172.21.15.146:0/2231795214 >> v2:172.21.15.146:3300/0 conn(0x7f56d01343a0 0x7f56d00a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.390+0000 7f56d574c700 1 -- 172.21.15.146:0/2231795214 >> v1:172.21.15.146:6789/0 conn(0x7f56d0133f70 legacy=0x7f56d00a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.390+0000 7f56d574c700 1 -- 172.21.15.146:0/2231795214 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d009a280 con 0x7f56d009ad40 2023-10-03T10:18:06.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.390+0000 7f56d574c700 1 --2- 172.21.15.146:0/2231795214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56d009ad40 0x7f56d0133a30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f56cc009870 tx=0x7f56cc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d36d0ce1eb27739 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.390+0000 7f56c7fff700 1 -- 172.21.15.146:0/2231795214 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc011830 con 0x7f56d009ad40 2023-10-03T10:18:06.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.390+0000 7f56c7fff700 1 -- 172.21.15.146:0/2231795214 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56cc011990 con 0x7f56d009ad40 2023-10-03T10:18:06.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.390+0000 7f56c7fff700 1 -- 172.21.15.146:0/2231795214 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc011d20 con 0x7f56d009ad40 2023-10-03T10:18:06.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.391+0000 7f56d79b0700 1 -- 172.21.15.146:0/2231795214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56d009ad40 msgr2=0x7f56d0133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.391+0000 7f56d79b0700 1 --2- 172.21.15.146:0/2231795214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56d009ad40 0x7f56d0133a30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f56cc009870 tx=0x7f56cc009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:06.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.391+0000 7f56d79b0700 1 -- 172.21.15.146:0/2231795214 shutdown_connections 2023-10-03T10:18:06.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.391+0000 7f56d79b0700 1 --2- 172.21.15.146:0/2231795214 >> v2:172.21.15.146:3300/0 conn(0x7f56d01343a0 0x7f56d00a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.391+0000 7f56d79b0700 1 --2- 172.21.15.146:0/2231795214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56d009ad40 0x7f56d0133a30 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.391+0000 7f56d79b0700 1 -- 172.21.15.146:0/2231795214 >> 172.21.15.146:0/2231795214 conn(0x7f56d0099c40 msgr2=0x7f56d006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.391+0000 7f56d79b0700 1 -- 172.21.15.146:0/2231795214 shutdown_connections 2023-10-03T10:18:06.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.391+0000 7f56d79b0700 1 -- 172.21.15.146:0/2231795214 wait complete. 2023-10-03T10:18:06.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.392+0000 7f56d79b0700 1 Processor -- start 2023-10-03T10:18:06.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.392+0000 7f56d79b0700 1 -- start start 2023-10-03T10:18:06.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.392+0000 7f56d79b0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56d009ad40 0x7f56d011e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.392+0000 7f56d79b0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56d0133f70 0x7f56d011eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.392+0000 7f56d79b0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f56d01343a0 0x7f56d01c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.392+0000 7f56d79b0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d0121450 con 0x7f56d0133f70 2023-10-03T10:18:06.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.392+0000 7f56d79b0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d0121630 con 0x7f56d009ad40 2023-10-03T10:18:06.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.392+0000 7f56d79b0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56d01324a0 con 0x7f56d01343a0 2023-10-03T10:18:06.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.393+0000 7f56d574c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56d009ad40 0x7f56d011e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.393+0000 7f56d574c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56d009ad40 0x7f56d011e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60450/0 (socket says 172.21.15.146:60450) 2023-10-03T10:18:06.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.393+0000 7f56d574c700 1 -- 172.21.15.146:0/2559263452 learned_addr learned my addr 172.21.15.146:0/2559263452 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:06.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.393+0000 7f56d4f4b700 1 --2- 172.21.15.146:0/2559263452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56d0133f70 0x7f56d011eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.393+0000 7f56d574c700 1 -- 172.21.15.146:0/2559263452 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f56d01343a0 msgr2=0x7f56d01c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.393+0000 7f56d5f4d700 1 --2- 172.21.15.146:0/2559263452 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f56d01343a0 0x7f56d01c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.393+0000 7f56d574c700 1 --2- 172.21.15.146:0/2559263452 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f56d01343a0 0x7f56d01c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.393+0000 7f56d574c700 1 -- 172.21.15.146:0/2559263452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56d0133f70 msgr2=0x7f56d011eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.393+0000 7f56d574c700 1 --2- 172.21.15.146:0/2559263452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56d0133f70 0x7f56d011eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.393+0000 7f56d574c700 1 -- 172.21.15.146:0/2559263452 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc0094a0 con 0x7f56d009ad40 2023-10-03T10:18:06.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.393+0000 7f56d4f4b700 1 --2- 172.21.15.146:0/2559263452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56d0133f70 0x7f56d011eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:06.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.393+0000 7f56d574c700 1 --2- 172.21.15.146:0/2559263452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56d009ad40 0x7f56d011e610 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f56cc000c00 tx=0x7f56cc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.393+0000 7f56c5ffb700 1 -- 172.21.15.146:0/2559263452 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc0036a0 con 0x7f56d009ad40 2023-10-03T10:18:06.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.393+0000 7f56c5ffb700 1 -- 172.21.15.146:0/2559263452 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56cc01e070 con 0x7f56d009ad40 2023-10-03T10:18:06.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.393+0000 7f56d79b0700 1 -- 172.21.15.146:0/2559263452 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d00a4b90 con 0x7f56d009ad40 2023-10-03T10:18:06.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.393+0000 7f56c5ffb700 1 -- 172.21.15.146:0/2559263452 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc003a20 con 0x7f56d009ad40 2023-10-03T10:18:06.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.394+0000 7f56d79b0700 1 -- 172.21.15.146:0/2559263452 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d011ff10 con 0x7f56d009ad40 2023-10-03T10:18:06.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.394+0000 7f56d79b0700 1 -- 172.21.15.146:0/2559263452 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d004f2a0 con 0x7f56d009ad40 2023-10-03T10:18:06.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.395+0000 7f56c5ffb700 1 -- 172.21.15.146:0/2559263452 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f56cc003b80 con 0x7f56d009ad40 2023-10-03T10:18:06.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.395+0000 7f56c5ffb700 1 -- 172.21.15.146:0/2559263452 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f56cc020070 con 0x7f56d009ad40 2023-10-03T10:18:06.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.403+0000 7f56c5ffb700 1 -- 172.21.15.146:0/2559263452 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56cc0243e0 con 0x7f56d009ad40 2023-10-03T10:18:06.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.508+0000 7fe8c13b7700 1 -- 172.21.15.146:0/3830818445 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe8bc04f2a0 con 0x7fe8bc130bc0 2023-10-03T10:18:06.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.509+0000 7fe8a37fe700 1 -- 172.21.15.146:0/3830818445 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe8b0011360 con 0x7fe8bc130bc0 2023-10-03T10:18:06.508 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:06.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.511+0000 7fe8c13b7700 1 -- 172.21.15.146:0/3830818445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8bc130bc0 msgr2=0x7fe8bc070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.511+0000 7fe8c13b7700 1 --2- 172.21.15.146:0/3830818445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8bc130bc0 0x7fe8bc070b30 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000c470 tx=0x7fe8b000c780 comp rx=0 tx=0).stop 2023-10-03T10:18:06.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.511+0000 7fe8c13b7700 1 -- 172.21.15.146:0/3830818445 shutdown_connections 2023-10-03T10:18:06.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.511+0000 7fe8c13b7700 1 --2- 172.21.15.146:0/3830818445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8bc133ad0 0x7fe8bc071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.511+0000 7fe8c13b7700 1 --2- 172.21.15.146:0/3830818445 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe8bc1300a0 0x7fe8bc0705f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.511+0000 7fe8c13b7700 1 --2- 172.21.15.146:0/3830818445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8bc130bc0 0x7fe8bc070b30 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.511+0000 7fe8c13b7700 1 -- 172.21.15.146:0/3830818445 >> 172.21.15.146:0/3830818445 conn(0x7fe8bc099c40 msgr2=0x7fe8bc12e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.511+0000 7fe8c13b7700 1 -- 172.21.15.146:0/3830818445 shutdown_connections 2023-10-03T10:18:06.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.511+0000 7fe8c13b7700 1 -- 172.21.15.146:0/3830818445 wait complete. 2023-10-03T10:18:06.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:06.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.563+0000 7fa22eced700 1 -- 172.21.15.146:0/2548046454 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa228125b00 con 0x7fa22809f180 2023-10-03T10:18:06.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.563+0000 7fa2257fa700 1 -- 172.21.15.146:0/2548046454 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa214015020 con 0x7fa22809f180 2023-10-03T10:18:06.563 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:06.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.565+0000 7fa22eced700 1 -- 172.21.15.146:0/2548046454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa22809f180 msgr2=0x7fa228122a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.565+0000 7fa22eced700 1 --2- 172.21.15.146:0/2548046454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa22809f180 0x7fa228122a70 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fa214000c00 tx=0x7fa214004750 comp rx=0 tx=0).stop 2023-10-03T10:18:06.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.565+0000 7fa22eced700 1 -- 172.21.15.146:0/2548046454 shutdown_connections 2023-10-03T10:18:06.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.565+0000 7fa22eced700 1 --2- 172.21.15.146:0/2548046454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2281341d0 0x7fa228122fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.565+0000 7fa22eced700 1 --2- 172.21.15.146:0/2548046454 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa22809e870 0x7fa228122530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.565+0000 7fa22eced700 1 --2- 172.21.15.146:0/2548046454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa22809f180 0x7fa228122a70 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.565+0000 7fa22eced700 1 -- 172.21.15.146:0/2548046454 >> 172.21.15.146:0/2548046454 conn(0x7fa2280a4430 msgr2=0x7fa228071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.565+0000 7fa22eced700 1 -- 172.21.15.146:0/2548046454 shutdown_connections 2023-10-03T10:18:06.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.565+0000 7fa22eced700 1 -- 172.21.15.146:0/2548046454 wait complete. 2023-10-03T10:18:06.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:06.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.597+0000 7f56d79b0700 1 -- 172.21.15.146:0/2559263452 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f56d011f720 con 0x7f56d009ad40 2023-10-03T10:18:06.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.597+0000 7f56c5ffb700 1 -- 172.21.15.146:0/2559263452 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56cc015020 con 0x7f56d009ad40 2023-10-03T10:18:06.597 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:06.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.599+0000 7f56d79b0700 1 -- 172.21.15.146:0/2559263452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56d009ad40 msgr2=0x7f56d011e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.599+0000 7f56d79b0700 1 --2- 172.21.15.146:0/2559263452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56d009ad40 0x7f56d011e610 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f56cc000c00 tx=0x7f56cc004750 comp rx=0 tx=0).stop 2023-10-03T10:18:06.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.599+0000 7f56d79b0700 1 -- 172.21.15.146:0/2559263452 shutdown_connections 2023-10-03T10:18:06.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.599+0000 7f56d79b0700 1 --2- 172.21.15.146:0/2559263452 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f56d01343a0 0x7f56d01c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.599+0000 7f56d79b0700 1 --2- 172.21.15.146:0/2559263452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56d009ad40 0x7f56d011e610 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.599+0000 7f56d79b0700 1 --2- 172.21.15.146:0/2559263452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56d0133f70 0x7f56d011eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.599+0000 7f56d79b0700 1 -- 172.21.15.146:0/2559263452 >> 172.21.15.146:0/2559263452 conn(0x7f56d0099c40 msgr2=0x7f56d0132b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.599+0000 7f56d79b0700 1 -- 172.21.15.146:0/2559263452 shutdown_connections 2023-10-03T10:18:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:06.599+0000 7f56d79b0700 1 -- 172.21.15.146:0/2559263452 wait complete. 2023-10-03T10:18:06.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:07.261 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:07.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.387+0000 7f0e85d92700 1 Processor -- start 2023-10-03T10:18:07.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.387+0000 7f0e85d92700 1 -- start start 2023-10-03T10:18:07.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.388+0000 7f0e85d92700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e8009f350 0x7f0e80138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.388+0000 7f0e85d92700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0e801393a0 0x7f0e8013b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.388+0000 7f0e85d92700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e8006c6a0 con 0x7f0e8009e870 2023-10-03T10:18:07.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.388+0000 7f0e85d92700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e8009f780 con 0x7f0e801393a0 2023-10-03T10:18:07.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.388+0000 7f0e85d92700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8006bec0 con 0x7f0e8009f350 2023-10-03T10:18:07.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.388+0000 7f0e7ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0e801393a0 0x7f0e8013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.388+0000 7f0e7effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e8009f350 0x7f0e80138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.388+0000 7f0e7f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0e8009e870 0x7f0e8009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49730/0 (socket says 172.21.15.146:49730) 2023-10-03T10:18:07.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.388+0000 7f0e7f7fe700 1 -- 172.21.15.146:0/2083656553 learned_addr learned my addr 172.21.15.146:0/2083656553 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:07.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.388+0000 7f0e7ffff700 1 -- 172.21.15.146:0/2083656553 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e8009f350 msgr2=0x7f0e80138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:07.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.388+0000 7f0e7ffff700 1 --2- 172.21.15.146:0/2083656553 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e8009f350 0x7f0e80138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.388+0000 7f0e7ffff700 1 -- 172.21.15.146:0/2083656553 >> v1:172.21.15.146:6789/0 conn(0x7f0e8009e870 legacy=0x7f0e8009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.388+0000 7f0e7ffff700 1 -- 172.21.15.146:0/2083656553 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8006c8f0 con 0x7f0e801393a0 2023-10-03T10:18:07.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.388+0000 7f0e7e7fc700 1 -- 172.21.15.146:0/2083656553 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987804950 0 0) 0x7f0e8006c6a0 con 0x7f0e8009e870 2023-10-03T10:18:07.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.388+0000 7f0e7effd700 1 --2- 172.21.15.146:0/2083656553 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e8009f350 0x7f0e80138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:07.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.388+0000 7f0e7ffff700 1 --2- 172.21.15.146:0/2083656553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e801393a0 0x7f0e8013b780 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f0e78009d90 tx=0x7f0e7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c2b1f8d55d5a2b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.388+0000 7f0e7e7fc700 1 -- 172.21.15.146:0/2083656553 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7800e070 con 0x7f0e801393a0 2023-10-03T10:18:07.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.388+0000 7f0e7e7fc700 1 -- 172.21.15.146:0/2083656553 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7800bb20 con 0x7f0e801393a0 2023-10-03T10:18:07.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.388+0000 7f0e7e7fc700 1 -- 172.21.15.146:0/2083656553 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e78012430 con 0x7f0e801393a0 2023-10-03T10:18:07.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.389+0000 7f0e85d92700 1 -- 172.21.15.146:0/2083656553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e801393a0 msgr2=0x7f0e8013b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.389+0000 7f0e85d92700 1 --2- 172.21.15.146:0/2083656553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e801393a0 0x7f0e8013b780 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f0e78009d90 tx=0x7f0e7800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:07.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.389+0000 7f0e85d92700 1 -- 172.21.15.146:0/2083656553 shutdown_connections 2023-10-03T10:18:07.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.389+0000 7f0e85d92700 1 --2- 172.21.15.146:0/2083656553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e801393a0 0x7f0e8013b780 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.389+0000 7f0e85d92700 1 --2- 172.21.15.146:0/2083656553 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e8009f350 0x7f0e80138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.389+0000 7f0e85d92700 1 -- 172.21.15.146:0/2083656553 >> 172.21.15.146:0/2083656553 conn(0x7f0e800a4430 msgr2=0x7f0e800a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.389+0000 7f0e85d92700 1 -- 172.21.15.146:0/2083656553 shutdown_connections 2023-10-03T10:18:07.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.389+0000 7f0e85d92700 1 -- 172.21.15.146:0/2083656553 wait complete. 2023-10-03T10:18:07.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.390+0000 7f0e85d92700 1 Processor -- start 2023-10-03T10:18:07.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.390+0000 7f0e85d92700 1 -- start start 2023-10-03T10:18:07.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.390+0000 7f0e85d92700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e8009e870 0x7f0e80121830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.390+0000 7f0e85d92700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0e8009f350 0x7f0e80121d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.390+0000 7f0e85d92700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e801393a0 0x7f0e801222b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.390+0000 7f0e85d92700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e80124350 con 0x7f0e801393a0 2023-10-03T10:18:07.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.390+0000 7f0e85d92700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8006cfa0 con 0x7f0e8009e870 2023-10-03T10:18:07.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.390+0000 7f0e85d92700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e80125070 con 0x7f0e8009f350 2023-10-03T10:18:07.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.391+0000 7f0e7f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e8009e870 0x7f0e80121830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.391+0000 7f0e7f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e8009e870 0x7f0e80121830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60456/0 (socket says 172.21.15.146:60456) 2023-10-03T10:18:07.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.391+0000 7f0e7f7fe700 1 -- 172.21.15.146:0/3258385767 learned_addr learned my addr 172.21.15.146:0/3258385767 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:07.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.391+0000 7f0e7ffff700 1 --2- 172.21.15.146:0/3258385767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e801393a0 0x7f0e801222b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.391+0000 7f0e7effd700 1 --2- 172.21.15.146:0/3258385767 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0e8009f350 0x7f0e80121d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.391+0000 7f0e7f7fe700 1 -- 172.21.15.146:0/3258385767 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0e8009f350 msgr2=0x7f0e80121d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.391+0000 7f0e7f7fe700 1 --2- 172.21.15.146:0/3258385767 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0e8009f350 0x7f0e80121d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.391+0000 7f0e7f7fe700 1 -- 172.21.15.146:0/3258385767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e801393a0 msgr2=0x7f0e801222b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.391+0000 7f0e7f7fe700 1 --2- 172.21.15.146:0/3258385767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e801393a0 0x7f0e801222b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.391+0000 7f0e7f7fe700 1 -- 172.21.15.146:0/3258385767 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e700094a0 con 0x7f0e8009e870 2023-10-03T10:18:07.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.391+0000 7f0e7ffff700 1 --2- 172.21.15.146:0/3258385767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e801393a0 0x7f0e801222b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:07.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.391+0000 7f0e7f7fe700 1 --2- 172.21.15.146:0/3258385767 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e8009e870 0x7f0e80121830 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400c520 tx=0x7f0e7400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.391+0000 7f0e67fff700 1 -- 172.21.15.146:0/3258385767 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e74004c80 con 0x7f0e8009e870 2023-10-03T10:18:07.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.391+0000 7f0e67fff700 1 -- 172.21.15.146:0/3258385767 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e74004de0 con 0x7f0e8009e870 2023-10-03T10:18:07.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.391+0000 7f0e85d92700 1 -- 172.21.15.146:0/3258385767 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e78009a70 con 0x7f0e8009e870 2023-10-03T10:18:07.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.391+0000 7f0e67fff700 1 -- 172.21.15.146:0/3258385767 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e74007310 con 0x7f0e8009e870 2023-10-03T10:18:07.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.391+0000 7f0e85d92700 1 -- 172.21.15.146:0/3258385767 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e80123c30 con 0x7f0e8009e870 2023-10-03T10:18:07.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.392+0000 7f0e67fff700 1 -- 172.21.15.146:0/3258385767 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e74007470 con 0x7f0e8009e870 2023-10-03T10:18:07.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.392+0000 7f0e67fff700 1 -- 172.21.15.146:0/3258385767 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0e7403f320 con 0x7f0e8009e870 2023-10-03T10:18:07.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.392+0000 7f0e85d92700 1 -- 172.21.15.146:0/3258385767 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e8004f2a0 con 0x7f0e8009e870 2023-10-03T10:18:07.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.397+0000 7f0e67fff700 1 -- 172.21.15.146:0/3258385767 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0e740123b0 con 0x7f0e8009e870 2023-10-03T10:18:07.523 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:07.577 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:07.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.590+0000 7f0e85d92700 1 -- 172.21.15.146:0/3258385767 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0e80072d60 con 0x7f0e8009e870 2023-10-03T10:18:07.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.590+0000 7f0e67fff700 1 -- 172.21.15.146:0/3258385767 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0e74011360 con 0x7f0e8009e870 2023-10-03T10:18:07.590 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:07.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.592+0000 7f0e85d92700 1 -- 172.21.15.146:0/3258385767 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e8009e870 msgr2=0x7f0e80121830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.592+0000 7f0e85d92700 1 --2- 172.21.15.146:0/3258385767 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e8009e870 0x7f0e80121830 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400c520 tx=0x7f0e7400c830 comp rx=0 tx=0).stop 2023-10-03T10:18:07.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.593+0000 7f0e85d92700 1 -- 172.21.15.146:0/3258385767 shutdown_connections 2023-10-03T10:18:07.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.593+0000 7f0e85d92700 1 --2- 172.21.15.146:0/3258385767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e801393a0 0x7f0e801222b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.593+0000 7f0e85d92700 1 --2- 172.21.15.146:0/3258385767 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e8009e870 0x7f0e80121830 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.593+0000 7f0e85d92700 1 --2- 172.21.15.146:0/3258385767 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0e8009f350 0x7f0e80121d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.593+0000 7f0e85d92700 1 -- 172.21.15.146:0/3258385767 >> 172.21.15.146:0/3258385767 conn(0x7f0e800a4430 msgr2=0x7f0e8009d480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.593+0000 7f0e85d92700 1 -- 172.21.15.146:0/3258385767 shutdown_connections 2023-10-03T10:18:07.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.593+0000 7f0e85d92700 1 -- 172.21.15.146:0/3258385767 wait complete. 2023-10-03T10:18:07.606 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:07.612 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:07.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.653+0000 7f8aabe8d700 1 Processor -- start 2023-10-03T10:18:07.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.654+0000 7f8aabe8d700 1 -- start start 2023-10-03T10:18:07.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.654+0000 7f8aabe8d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8aa409d860 0x7f8aa409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.654+0000 7f8aabe8d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa409e170 0x7f8aa41307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.654+0000 7f8aabe8d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa409aaa0 con 0x7f8aa4130ce0 2023-10-03T10:18:07.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.654+0000 7f8aabe8d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa409f870 con 0x7f8aa409d860 2023-10-03T10:18:07.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.654+0000 7f8aabe8d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa409b360 con 0x7f8aa409e170 2023-10-03T10:18:07.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.654+0000 7f8aa9428700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa409e170 0x7f8aa41307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.654+0000 7f8aa9428700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa409e170 0x7f8aa41307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60458/0 (socket says 172.21.15.146:60458) 2023-10-03T10:18:07.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.654+0000 7f8aa9428700 1 -- 172.21.15.146:0/2882124826 learned_addr learned my addr 172.21.15.146:0/2882124826 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:07.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.654+0000 7f8aa9c29700 1 --2- 172.21.15.146:0/2882124826 >> v2:172.21.15.146:3300/0 conn(0x7f8aa409d860 0x7f8aa409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.655+0000 7f8aa9428700 1 -- 172.21.15.146:0/2882124826 >> v2:172.21.15.146:3300/0 conn(0x7f8aa409d860 msgr2=0x7f8aa409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:07.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.655+0000 7f8aa9428700 1 --2- 172.21.15.146:0/2882124826 >> v2:172.21.15.146:3300/0 conn(0x7f8aa409d860 0x7f8aa409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.655+0000 7f8aa9428700 1 -- 172.21.15.146:0/2882124826 >> v1:172.21.15.146:6789/0 conn(0x7f8aa4130ce0 legacy=0x7f8aa41379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.655+0000 7f8aa9428700 1 -- 172.21.15.146:0/2882124826 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa409b620 con 0x7f8aa409e170 2023-10-03T10:18:07.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.655+0000 7f8aa9428700 1 --2- 172.21.15.146:0/2882124826 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa409e170 0x7f8aa41307a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8a940098f0 tx=0x7f8a94009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1bad8d71cfc0a5b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.655+0000 7f8aa8c27700 1 -- 172.21.15.146:0/2882124826 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a94011830 con 0x7f8aa409e170 2023-10-03T10:18:07.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.655+0000 7f8aa8c27700 1 -- 172.21.15.146:0/2882124826 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a94011990 con 0x7f8aa409e170 2023-10-03T10:18:07.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.655+0000 7f8aa8c27700 1 -- 172.21.15.146:0/2882124826 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a94011d20 con 0x7f8aa409e170 2023-10-03T10:18:07.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.656+0000 7f8aabe8d700 1 -- 172.21.15.146:0/2882124826 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa409e170 msgr2=0x7f8aa41307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.656+0000 7f8aabe8d700 1 --2- 172.21.15.146:0/2882124826 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa409e170 0x7f8aa41307a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8a940098f0 tx=0x7f8a94009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:07.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.656+0000 7f8aabe8d700 1 -- 172.21.15.146:0/2882124826 shutdown_connections 2023-10-03T10:18:07.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.656+0000 7f8aabe8d700 1 --2- 172.21.15.146:0/2882124826 >> v2:172.21.15.146:3300/0 conn(0x7f8aa409d860 0x7f8aa409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.656+0000 7f8aabe8d700 1 --2- 172.21.15.146:0/2882124826 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa409e170 0x7f8aa41307a0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.656+0000 7f8aabe8d700 1 -- 172.21.15.146:0/2882124826 >> 172.21.15.146:0/2882124826 conn(0x7f8aa4099c40 msgr2=0x7f8aa40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.656+0000 7f8aabe8d700 1 -- 172.21.15.146:0/2882124826 shutdown_connections 2023-10-03T10:18:07.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.656+0000 7f8aabe8d700 1 -- 172.21.15.146:0/2882124826 wait complete. 2023-10-03T10:18:07.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.657+0000 7f8aabe8d700 1 Processor -- start 2023-10-03T10:18:07.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.657+0000 7f8aabe8d700 1 -- start start 2023-10-03T10:18:07.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.657+0000 7f8aabe8d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8aa409d860 0x7f8aa4123500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.657+0000 7f8aabe8d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8aa409e170 0x7f8aa4123a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.657+0000 7f8aabe8d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa4130ce0 0x7f8aa41c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.657+0000 7f8aabe8d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa41263e0 con 0x7f8aa409e170 2023-10-03T10:18:07.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.657+0000 7f8aabe8d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa4124fa0 con 0x7f8aa4130ce0 2023-10-03T10:18:07.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.657+0000 7f8aabe8d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa41265c0 con 0x7f8aa409d860 2023-10-03T10:18:07.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.657+0000 7f8aa9428700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8aa409e170 0x7f8aa4123a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.657+0000 7f8aa9428700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8aa409e170 0x7f8aa4123a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33900/0 (socket says 172.21.15.146:33900) 2023-10-03T10:18:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.657+0000 7f8aa9428700 1 -- 172.21.15.146:0/3198071547 learned_addr learned my addr 172.21.15.146:0/3198071547 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.657+0000 7f8aa9c29700 1 --2- 172.21.15.146:0/3198071547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8aa409d860 0x7f8aa4123500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.657+0000 7f8aaa42a700 1 --2- 172.21.15.146:0/3198071547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa4130ce0 0x7f8aa41c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.658+0000 7f8aa9428700 1 -- 172.21.15.146:0/3198071547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8aa409d860 msgr2=0x7f8aa4123500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.658+0000 7f8aa9428700 1 --2- 172.21.15.146:0/3198071547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8aa409d860 0x7f8aa4123500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.658+0000 7f8aa9428700 1 -- 172.21.15.146:0/3198071547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa4130ce0 msgr2=0x7f8aa41c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.658+0000 7f8aa9428700 1 --2- 172.21.15.146:0/3198071547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa4130ce0 0x7f8aa41c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.658+0000 7f8aa9428700 1 -- 172.21.15.146:0/3198071547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a94009550 con 0x7f8aa409e170 2023-10-03T10:18:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.658+0000 7f8aa9c29700 1 --2- 172.21.15.146:0/3198071547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8aa409d860 0x7f8aa4123500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.658+0000 7f8aa9428700 1 --2- 172.21.15.146:0/3198071547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8aa409e170 0x7f8aa4123a40 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009c40 tx=0x7f8a94004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.658+0000 7f8a9a7fc700 1 -- 172.21.15.146:0/3198071547 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a940036a0 con 0x7f8aa409e170 2023-10-03T10:18:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.658+0000 7f8a9a7fc700 1 -- 172.21.15.146:0/3198071547 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a94003800 con 0x7f8aa409e170 2023-10-03T10:18:07.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.658+0000 7f8a9a7fc700 1 -- 172.21.15.146:0/3198071547 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a94003bb0 con 0x7f8aa409e170 2023-10-03T10:18:07.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.659+0000 7f8aabe8d700 1 -- 172.21.15.146:0/3198071547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa4123f80 con 0x7f8aa409e170 2023-10-03T10:18:07.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.659+0000 7f8aabe8d700 1 -- 172.21.15.146:0/3198071547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa40a2140 con 0x7f8aa409e170 2023-10-03T10:18:07.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.660+0000 7f8a9a7fc700 1 -- 172.21.15.146:0/3198071547 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a94021070 con 0x7f8aa409e170 2023-10-03T10:18:07.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.660+0000 7f8aabe8d700 1 -- 172.21.15.146:0/3198071547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa409c8b0 con 0x7f8aa409e170 2023-10-03T10:18:07.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.660+0000 7f8a9a7fc700 1 -- 172.21.15.146:0/3198071547 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8a94040c40 con 0x7f8aa409e170 2023-10-03T10:18:07.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.665+0000 7f8a9a7fc700 1 -- 172.21.15.146:0/3198071547 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a9402d3a0 con 0x7f8aa409e170 2023-10-03T10:18:07.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.708+0000 7fbe964c9700 1 Processor -- start 2023-10-03T10:18:07.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.709+0000 7fbe964c9700 1 -- start start 2023-10-03T10:18:07.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.709+0000 7fbe964c9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe9009d860 0x7fbe9009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.709+0000 7fbe964c9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 0x7fbe901307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.709+0000 7fbe964c9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe9009aaa0 con 0x7fbe90130ce0 2023-10-03T10:18:07.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.709+0000 7fbe964c9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9009f870 con 0x7fbe9009d860 2023-10-03T10:18:07.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.709+0000 7fbe964c9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9009b360 con 0x7fbe9009e170 2023-10-03T10:18:07.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.709+0000 7fbe8f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 0x7fbe901307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.709+0000 7fbe94a66700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbe90130ce0 0x7fbe901379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49748/0 (socket says 172.21.15.146:49748) 2023-10-03T10:18:07.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.709+0000 7fbe94a66700 1 -- 172.21.15.146:0/2662967893 learned_addr learned my addr 172.21.15.146:0/2662967893 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:07.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.709+0000 7fbe8ffff700 1 --2- 172.21.15.146:0/2662967893 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe9009d860 0x7fbe9009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.710+0000 7fbe8ffff700 1 -- 172.21.15.146:0/2662967893 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 msgr2=0x7fbe901307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:07.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.710+0000 7fbe8ffff700 1 --2- 172.21.15.146:0/2662967893 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 0x7fbe901307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.710+0000 7fbe8ffff700 1 -- 172.21.15.146:0/2662967893 >> v1:172.21.15.146:6789/0 conn(0x7fbe90130ce0 legacy=0x7fbe901379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.710+0000 7fbe8effd700 1 -- 172.21.15.146:0/2662967893 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467277465 0 0) 0x7fbe9009aaa0 con 0x7fbe90130ce0 2023-10-03T10:18:07.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.710+0000 7fbe8ffff700 1 -- 172.21.15.146:0/2662967893 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9009b620 con 0x7fbe9009d860 2023-10-03T10:18:07.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.710+0000 7fbe8f7fe700 1 --2- 172.21.15.146:0/2662967893 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 0x7fbe901307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:07.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.710+0000 7fbe8ffff700 1 --2- 172.21.15.146:0/2662967893 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe9009d860 0x7fbe9009dc30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009870 tx=0x7fbe80009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3a6d741ae647915 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.710+0000 7fbe8effd700 1 -- 172.21.15.146:0/2662967893 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe80011830 con 0x7fbe9009d860 2023-10-03T10:18:07.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.710+0000 7fbe8effd700 1 -- 172.21.15.146:0/2662967893 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe80011990 con 0x7fbe9009d860 2023-10-03T10:18:07.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.710+0000 7fbe8effd700 1 -- 172.21.15.146:0/2662967893 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe80011d20 con 0x7fbe9009d860 2023-10-03T10:18:07.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.711+0000 7fbe964c9700 1 -- 172.21.15.146:0/2662967893 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe9009d860 msgr2=0x7fbe9009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.711+0000 7fbe964c9700 1 --2- 172.21.15.146:0/2662967893 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe9009d860 0x7fbe9009dc30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009870 tx=0x7fbe80009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:07.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.711+0000 7fbe964c9700 1 -- 172.21.15.146:0/2662967893 shutdown_connections 2023-10-03T10:18:07.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.711+0000 7fbe964c9700 1 --2- 172.21.15.146:0/2662967893 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe9009d860 0x7fbe9009dc30 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.711+0000 7fbe964c9700 1 --2- 172.21.15.146:0/2662967893 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 0x7fbe901307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.711+0000 7fbe964c9700 1 -- 172.21.15.146:0/2662967893 >> 172.21.15.146:0/2662967893 conn(0x7fbe90099c40 msgr2=0x7fbe900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.711+0000 7fbe964c9700 1 -- 172.21.15.146:0/2662967893 shutdown_connections 2023-10-03T10:18:07.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.711+0000 7fbe964c9700 1 -- 172.21.15.146:0/2662967893 wait complete. 2023-10-03T10:18:07.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.712+0000 7fbe964c9700 1 Processor -- start 2023-10-03T10:18:07.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.712+0000 7fbe964c9700 1 -- start start 2023-10-03T10:18:07.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.712+0000 7fbe964c9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe9009d860 0x7fbe9011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.712+0000 7fbe964c9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 0x7fbe9011ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.712+0000 7fbe964c9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe90130ce0 0x7fbe9011ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.712+0000 7fbe964c9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9009c8b0 con 0x7fbe90130ce0 2023-10-03T10:18:07.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.712+0000 7fbe964c9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe90120190 con 0x7fbe9009d860 2023-10-03T10:18:07.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.712+0000 7fbe964c9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe90121cb0 con 0x7fbe9009e170 2023-10-03T10:18:07.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.713+0000 7fbe8f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 0x7fbe9011ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.713+0000 7fbe8f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 0x7fbe9011ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43396/0 (socket says 172.21.15.146:43396) 2023-10-03T10:18:07.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.713+0000 7fbe8f7fe700 1 -- 172.21.15.146:0/1017123899 learned_addr learned my addr 172.21.15.146:0/1017123899 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:07.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.713+0000 7fbe8ffff700 1 --2- 172.21.15.146:0/1017123899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe9009d860 0x7fbe9011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.713+0000 7fbe94a66700 1 --2- 172.21.15.146:0/1017123899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe90130ce0 0x7fbe9011ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.713+0000 7fbe8f7fe700 1 -- 172.21.15.146:0/1017123899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe9009d860 msgr2=0x7fbe9011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.713+0000 7fbe8f7fe700 1 --2- 172.21.15.146:0/1017123899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe9009d860 0x7fbe9011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.713+0000 7fbe8f7fe700 1 -- 172.21.15.146:0/1017123899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe90130ce0 msgr2=0x7fbe9011ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.713+0000 7fbe8f7fe700 1 --2- 172.21.15.146:0/1017123899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe90130ce0 0x7fbe9011ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.713+0000 7fbe8f7fe700 1 -- 172.21.15.146:0/1017123899 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8400b740 con 0x7fbe9009e170 2023-10-03T10:18:07.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.713+0000 7fbe8ffff700 1 --2- 172.21.15.146:0/1017123899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe9009d860 0x7fbe9011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:07.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.713+0000 7fbe8f7fe700 1 --2- 172.21.15.146:0/1017123899 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 0x7fbe9011ea00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fbe84010f00 tx=0x7fbe8400e640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.713+0000 7fbe8cff9700 1 -- 172.21.15.146:0/1017123899 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe84011650 con 0x7fbe9009e170 2023-10-03T10:18:07.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.713+0000 7fbe8cff9700 1 -- 172.21.15.146:0/1017123899 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe840117b0 con 0x7fbe9009e170 2023-10-03T10:18:07.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.713+0000 7fbe8cff9700 1 -- 172.21.15.146:0/1017123899 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe84011b40 con 0x7fbe9009e170 2023-10-03T10:18:07.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.713+0000 7fbe964c9700 1 -- 172.21.15.146:0/1017123899 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe800094a0 con 0x7fbe9009e170 2023-10-03T10:18:07.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.713+0000 7fbe964c9700 1 -- 172.21.15.146:0/1017123899 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe90120610 con 0x7fbe9009e170 2023-10-03T10:18:07.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.714+0000 7fbe8cff9700 1 -- 172.21.15.146:0/1017123899 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe84011ca0 con 0x7fbe9009e170 2023-10-03T10:18:07.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.714+0000 7fbe8cff9700 1 -- 172.21.15.146:0/1017123899 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbe840424a0 con 0x7fbe9009e170 2023-10-03T10:18:07.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.714+0000 7fbe964c9700 1 -- 172.21.15.146:0/1017123899 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe901227e0 con 0x7fbe9009e170 2023-10-03T10:18:07.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.719+0000 7fbe8cff9700 1 -- 172.21.15.146:0/1017123899 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe84017b80 con 0x7fbe9009e170 2023-10-03T10:18:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.776+0000 7f7cd47d0700 1 Processor -- start 2023-10-03T10:18:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.776+0000 7f7cd47d0700 1 -- start start 2023-10-03T10:18:07.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.777+0000 7f7cd47d0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ccc09e870 0x7f7ccc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.777+0000 7f7cd47d0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ccc131f40 0x7f7ccc139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.777+0000 7f7cd47d0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ccc09c970 con 0x7f7ccc09f180 2023-10-03T10:18:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.777+0000 7f7cd47d0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc0a0920 con 0x7f7ccc09e870 2023-10-03T10:18:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.777+0000 7f7cd47d0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc09f9c0 con 0x7f7ccc131f40 2023-10-03T10:18:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.777+0000 7f7cd1d6b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7ccc09f180 0x7f7ccc131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49764/0 (socket says 172.21.15.146:49764) 2023-10-03T10:18:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.777+0000 7f7cd1d6b700 1 -- 172.21.15.146:0/1360050370 learned_addr learned my addr 172.21.15.146:0/1360050370 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.777+0000 7f7cd2d6d700 1 --2- 172.21.15.146:0/1360050370 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ccc131f40 0x7f7ccc139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.777+0000 7f7cd256c700 1 --2- 172.21.15.146:0/1360050370 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ccc09e870 0x7f7ccc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.777+0000 7f7cd256c700 1 -- 172.21.15.146:0/1360050370 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ccc131f40 msgr2=0x7f7ccc139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.777+0000 7f7cd256c700 1 --2- 172.21.15.146:0/1360050370 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ccc131f40 0x7f7ccc139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.777+0000 7f7cd256c700 1 -- 172.21.15.146:0/1360050370 >> v1:172.21.15.146:6789/0 conn(0x7f7ccc09f180 legacy=0x7f7ccc131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.777+0000 7f7cd256c700 1 -- 172.21.15.146:0/1360050370 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ccc09bab0 con 0x7f7ccc09e870 2023-10-03T10:18:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.777+0000 7f7cd2d6d700 1 --2- 172.21.15.146:0/1360050370 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ccc131f40 0x7f7ccc139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.778+0000 7f7cd256c700 1 --2- 172.21.15.146:0/1360050370 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ccc09e870 0x7f7ccc09ec40 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8009870 tx=0x7f7cc8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8133e778e875e267 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.778+0000 7f7cd156a700 1 -- 172.21.15.146:0/1360050370 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8011830 con 0x7f7ccc09e870 2023-10-03T10:18:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.778+0000 7f7cd156a700 1 -- 172.21.15.146:0/1360050370 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc8011990 con 0x7f7ccc09e870 2023-10-03T10:18:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.778+0000 7f7cd156a700 1 -- 172.21.15.146:0/1360050370 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8011d20 con 0x7f7ccc09e870 2023-10-03T10:18:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.778+0000 7f7cd47d0700 1 -- 172.21.15.146:0/1360050370 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ccc09e870 msgr2=0x7f7ccc09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.778+0000 7f7cd47d0700 1 --2- 172.21.15.146:0/1360050370 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ccc09e870 0x7f7ccc09ec40 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8009870 tx=0x7f7cc8009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.779+0000 7f7cd47d0700 1 -- 172.21.15.146:0/1360050370 shutdown_connections 2023-10-03T10:18:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.779+0000 7f7cd47d0700 1 --2- 172.21.15.146:0/1360050370 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ccc131f40 0x7f7ccc139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.779+0000 7f7cd47d0700 1 --2- 172.21.15.146:0/1360050370 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ccc09e870 0x7f7ccc09ec40 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.779+0000 7f7cd47d0700 1 -- 172.21.15.146:0/1360050370 >> 172.21.15.146:0/1360050370 conn(0x7f7ccc0a4430 msgr2=0x7f7ccc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.779+0000 7f7cd47d0700 1 -- 172.21.15.146:0/1360050370 shutdown_connections 2023-10-03T10:18:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.779+0000 7f7cd47d0700 1 -- 172.21.15.146:0/1360050370 wait complete. 2023-10-03T10:18:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.780+0000 7f7cd47d0700 1 Processor -- start 2023-10-03T10:18:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.780+0000 7f7cd47d0700 1 -- start start 2023-10-03T10:18:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.780+0000 7f7cd47d0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ccc09e870 0x7f7ccc06b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.780+0000 7f7cd47d0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ccc09f180 0x7f7ccc06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.780+0000 7f7cd47d0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ccc131f40 0x7f7ccc06c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.780+0000 7f7cd47d0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc06d3e0 con 0x7f7ccc09f180 2023-10-03T10:18:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.780+0000 7f7cd47d0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc125dc0 con 0x7f7ccc09e870 2023-10-03T10:18:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.780+0000 7f7cd47d0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc126030 con 0x7f7ccc131f40 2023-10-03T10:18:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.781+0000 7f7cd256c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ccc09e870 0x7f7ccc06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.781+0000 7f7cd256c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ccc09e870 0x7f7ccc06b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60494/0 (socket says 172.21.15.146:60494) 2023-10-03T10:18:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.781+0000 7f7cd256c700 1 -- 172.21.15.146:0/1532585231 learned_addr learned my addr 172.21.15.146:0/1532585231 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.781+0000 7f7cd1d6b700 1 --2- 172.21.15.146:0/1532585231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ccc09f180 0x7f7ccc06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.781+0000 7f7cd2d6d700 1 --2- 172.21.15.146:0/1532585231 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ccc131f40 0x7f7ccc06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.781+0000 7f7cd256c700 1 -- 172.21.15.146:0/1532585231 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ccc131f40 msgr2=0x7f7ccc06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.781+0000 7f7cd256c700 1 --2- 172.21.15.146:0/1532585231 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ccc131f40 0x7f7ccc06c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.781+0000 7f7cd256c700 1 -- 172.21.15.146:0/1532585231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ccc09f180 msgr2=0x7f7ccc06bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.781+0000 7f7cd256c700 1 --2- 172.21.15.146:0/1532585231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ccc09f180 0x7f7ccc06bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.781+0000 7f7cd256c700 1 -- 172.21.15.146:0/1532585231 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc4009a70 con 0x7f7ccc09e870 2023-10-03T10:18:07.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.781+0000 7f7cd256c700 1 --2- 172.21.15.146:0/1532585231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ccc09e870 0x7f7ccc06b880 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80090b0 tx=0x7f7cc8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.781+0000 7f7cc2ffd700 1 -- 172.21.15.146:0/1532585231 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc80045d0 con 0x7f7ccc09e870 2023-10-03T10:18:07.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.781+0000 7f7cc2ffd700 1 -- 172.21.15.146:0/1532585231 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc801e070 con 0x7f7ccc09e870 2023-10-03T10:18:07.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.781+0000 7f7cc2ffd700 1 -- 172.21.15.146:0/1532585231 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc80038e0 con 0x7f7ccc09e870 2023-10-03T10:18:07.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.781+0000 7f7cd47d0700 1 -- 172.21.15.146:0/1532585231 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc80094a0 con 0x7f7ccc09e870 2023-10-03T10:18:07.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.781+0000 7f7cd47d0700 1 -- 172.21.15.146:0/1532585231 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ccc125720 con 0x7f7ccc09e870 2023-10-03T10:18:07.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.782+0000 7f7cc2ffd700 1 -- 172.21.15.146:0/1532585231 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7cc8003a40 con 0x7f7ccc09e870 2023-10-03T10:18:07.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.782+0000 7f7cd47d0700 1 -- 172.21.15.146:0/1532585231 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ccc04f2a0 con 0x7f7ccc09e870 2023-10-03T10:18:07.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.782+0000 7f7cc2ffd700 1 -- 172.21.15.146:0/1532585231 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7cc80405c0 con 0x7f7ccc09e870 2023-10-03T10:18:07.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.791+0000 7f7cc2ffd700 1 -- 172.21.15.146:0/1532585231 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7cc8015070 con 0x7f7ccc09e870 2023-10-03T10:18:07.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.866+0000 7f8aabe8d700 1 -- 172.21.15.146:0/3198071547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8aa404f2a0 con 0x7f8aa409e170 2023-10-03T10:18:07.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.866+0000 7f8a9a7fc700 1 -- 172.21.15.146:0/3198071547 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8a94029030 con 0x7f8aa409e170 2023-10-03T10:18:07.866 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:07.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.869+0000 7f8aabe8d700 1 -- 172.21.15.146:0/3198071547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8aa409e170 msgr2=0x7f8aa4123a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.869+0000 7f8aabe8d700 1 --2- 172.21.15.146:0/3198071547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8aa409e170 0x7f8aa4123a40 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009c40 tx=0x7f8a94004750 comp rx=0 tx=0).stop 2023-10-03T10:18:07.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.869+0000 7f8aabe8d700 1 -- 172.21.15.146:0/3198071547 shutdown_connections 2023-10-03T10:18:07.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.869+0000 7f8aabe8d700 1 --2- 172.21.15.146:0/3198071547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8aa4130ce0 0x7f8aa41c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.869+0000 7f8aabe8d700 1 --2- 172.21.15.146:0/3198071547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8aa409d860 0x7f8aa4123500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.869+0000 7f8aabe8d700 1 --2- 172.21.15.146:0/3198071547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8aa409e170 0x7f8aa4123a40 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.869+0000 7f8aabe8d700 1 -- 172.21.15.146:0/3198071547 >> 172.21.15.146:0/3198071547 conn(0x7f8aa4099c40 msgr2=0x7f8aa40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.869+0000 7f8aabe8d700 1 -- 172.21.15.146:0/3198071547 shutdown_connections 2023-10-03T10:18:07.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.869+0000 7f8aabe8d700 1 -- 172.21.15.146:0/3198071547 wait complete. 2023-10-03T10:18:07.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:07.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.916+0000 7fbe964c9700 1 -- 172.21.15.146:0/1017123899 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbe90121950 con 0x7fbe9009e170 2023-10-03T10:18:07.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.919+0000 7fbe8cff9700 1 -- 172.21.15.146:0/1017123899 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbe90121950 con 0x7fbe9009e170 2023-10-03T10:18:07.919 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:07.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.921+0000 7fbe964c9700 1 -- 172.21.15.146:0/1017123899 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 msgr2=0x7fbe9011ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.921+0000 7fbe964c9700 1 --2- 172.21.15.146:0/1017123899 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 0x7fbe9011ea00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fbe84010f00 tx=0x7fbe8400e640 comp rx=0 tx=0).stop 2023-10-03T10:18:07.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.921+0000 7fbe964c9700 1 -- 172.21.15.146:0/1017123899 shutdown_connections 2023-10-03T10:18:07.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.921+0000 7fbe964c9700 1 --2- 172.21.15.146:0/1017123899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe90130ce0 0x7fbe9011ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.921+0000 7fbe964c9700 1 --2- 172.21.15.146:0/1017123899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe9009d860 0x7fbe9011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.921+0000 7fbe964c9700 1 --2- 172.21.15.146:0/1017123899 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbe9009e170 0x7fbe9011ea00 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.921+0000 7fbe964c9700 1 -- 172.21.15.146:0/1017123899 >> 172.21.15.146:0/1017123899 conn(0x7fbe90099c40 msgr2=0x7fbe900a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.922+0000 7fbe964c9700 1 -- 172.21.15.146:0/1017123899 shutdown_connections 2023-10-03T10:18:07.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.922+0000 7fbe964c9700 1 -- 172.21.15.146:0/1017123899 wait complete. 2023-10-03T10:18:07.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:07.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.988+0000 7f7cd47d0700 1 -- 172.21.15.146:0/1532585231 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7ccc06b2a0 con 0x7f7ccc09e870 2023-10-03T10:18:07.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.988+0000 7f7cc2ffd700 1 -- 172.21.15.146:0/1532585231 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7cc802d7d0 con 0x7f7ccc09e870 2023-10-03T10:18:07.988 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:07.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.991+0000 7f7cd47d0700 1 -- 172.21.15.146:0/1532585231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ccc09e870 msgr2=0x7f7ccc06b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.991+0000 7f7cd47d0700 1 --2- 172.21.15.146:0/1532585231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ccc09e870 0x7f7ccc06b880 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80090b0 tx=0x7f7cc8004750 comp rx=0 tx=0).stop 2023-10-03T10:18:07.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.991+0000 7f7cd47d0700 1 -- 172.21.15.146:0/1532585231 shutdown_connections 2023-10-03T10:18:07.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.991+0000 7f7cd47d0700 1 --2- 172.21.15.146:0/1532585231 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ccc131f40 0x7f7ccc06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.991+0000 7f7cd47d0700 1 --2- 172.21.15.146:0/1532585231 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ccc09e870 0x7f7ccc06b880 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.991+0000 7f7cd47d0700 1 --2- 172.21.15.146:0/1532585231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ccc09f180 0x7f7ccc06bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.991+0000 7f7cd47d0700 1 -- 172.21.15.146:0/1532585231 >> 172.21.15.146:0/1532585231 conn(0x7f7ccc0a4430 msgr2=0x7f7ccc0a3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.991+0000 7f7cd47d0700 1 -- 172.21.15.146:0/1532585231 shutdown_connections 2023-10-03T10:18:07.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:07.991+0000 7f7cd47d0700 1 -- 172.21.15.146:0/1532585231 wait complete. 2023-10-03T10:18:08.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:08.606 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:08.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.732+0000 7fd00bb87700 1 Processor -- start 2023-10-03T10:18:08.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.732+0000 7fd00bb87700 1 -- start start 2023-10-03T10:18:08.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.733+0000 7fd00bb87700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd00409d860 0x7fd00409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.733+0000 7fd00bb87700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd00409e170 0x7fd0041307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.733+0000 7fd00bb87700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd00409aaa0 con 0x7fd004130ce0 2023-10-03T10:18:08.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.733+0000 7fd00bb87700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00409f870 con 0x7fd00409d860 2023-10-03T10:18:08.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.733+0000 7fd00bb87700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd00409b360 con 0x7fd00409e170 2023-10-03T10:18:08.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.733+0000 7fd009923700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd00409d860 0x7fd00409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.733+0000 7fd009122700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd00409e170 0x7fd0041307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.733+0000 7fd00a124700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd004130ce0 0x7fd0041379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49772/0 (socket says 172.21.15.146:49772) 2023-10-03T10:18:08.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.733+0000 7fd00a124700 1 -- 172.21.15.146:0/57367464 learned_addr learned my addr 172.21.15.146:0/57367464 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:08.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.733+0000 7fd009122700 1 -- 172.21.15.146:0/57367464 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd00409d860 msgr2=0x7fd00409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:08.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.733+0000 7fd009122700 1 --2- 172.21.15.146:0/57367464 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd00409d860 0x7fd00409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.733+0000 7fd009122700 1 -- 172.21.15.146:0/57367464 >> v1:172.21.15.146:6789/0 conn(0x7fd004130ce0 legacy=0x7fd0041379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.733+0000 7fd009122700 1 -- 172.21.15.146:0/57367464 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00409b620 con 0x7fd00409e170 2023-10-03T10:18:08.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.733+0000 7fd008921700 1 -- 172.21.15.146:0/57367464 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853030124 0 0) 0x7fd00409aaa0 con 0x7fd004130ce0 2023-10-03T10:18:08.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.733+0000 7fd009923700 1 --2- 172.21.15.146:0/57367464 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd00409d860 0x7fd00409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:08.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.733+0000 7fd009122700 1 --2- 172.21.15.146:0/57367464 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd00409e170 0x7fd0041307a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fd000009870 tx=0x7fd000009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d38967187594996 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:08.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.733+0000 7fd008921700 1 -- 172.21.15.146:0/57367464 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd000011830 con 0x7fd00409e170 2023-10-03T10:18:08.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.733+0000 7fd008921700 1 -- 172.21.15.146:0/57367464 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd000011990 con 0x7fd00409e170 2023-10-03T10:18:08.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.733+0000 7fd008921700 1 -- 172.21.15.146:0/57367464 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd000011d20 con 0x7fd00409e170 2023-10-03T10:18:08.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.734+0000 7fd00bb87700 1 -- 172.21.15.146:0/57367464 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd00409e170 msgr2=0x7fd0041307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.734+0000 7fd00bb87700 1 --2- 172.21.15.146:0/57367464 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd00409e170 0x7fd0041307a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fd000009870 tx=0x7fd000009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:08.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.734+0000 7fd00bb87700 1 -- 172.21.15.146:0/57367464 shutdown_connections 2023-10-03T10:18:08.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.734+0000 7fd00bb87700 1 --2- 172.21.15.146:0/57367464 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd00409d860 0x7fd00409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.734+0000 7fd00bb87700 1 --2- 172.21.15.146:0/57367464 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd00409e170 0x7fd0041307a0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.734+0000 7fd00bb87700 1 -- 172.21.15.146:0/57367464 >> 172.21.15.146:0/57367464 conn(0x7fd004099c40 msgr2=0x7fd0040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.734+0000 7fd00bb87700 1 -- 172.21.15.146:0/57367464 shutdown_connections 2023-10-03T10:18:08.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.734+0000 7fd00bb87700 1 -- 172.21.15.146:0/57367464 wait complete. 2023-10-03T10:18:08.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.735+0000 7fd00bb87700 1 Processor -- start 2023-10-03T10:18:08.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.735+0000 7fd00bb87700 1 -- start start 2023-10-03T10:18:08.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.736+0000 7fd00bb87700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd00409d860 0x7fd00411f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.736+0000 7fd00bb87700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd00409e170 0x7fd00411fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.736+0000 7fd00bb87700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd004130ce0 0x7fd004120000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.736+0000 7fd00bb87700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd004122ea0 con 0x7fd00409e170 2023-10-03T10:18:08.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.736+0000 7fd00bb87700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0041209e0 con 0x7fd004130ce0 2023-10-03T10:18:08.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.736+0000 7fd00bb87700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0041230a0 con 0x7fd00409d860 2023-10-03T10:18:08.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.736+0000 7fd009122700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd00409e170 0x7fd00411fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.736+0000 7fd009122700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd00409e170 0x7fd00411fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33928/0 (socket says 172.21.15.146:33928) 2023-10-03T10:18:08.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.736+0000 7fd00a124700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd004130ce0 0x7fd004120000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.736+0000 7fd009122700 1 -- 172.21.15.146:0/1257566513 learned_addr learned my addr 172.21.15.146:0/1257566513 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:08.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.736+0000 7fd009923700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd00409d860 0x7fd00411f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.736+0000 7fd00a124700 1 -- 172.21.15.146:0/1257566513 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd00409d860 msgr2=0x7fd00411f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.736+0000 7fd00a124700 1 --2- 172.21.15.146:0/1257566513 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd00409d860 0x7fd00411f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.736+0000 7fd00a124700 1 -- 172.21.15.146:0/1257566513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd00409e170 msgr2=0x7fd00411fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.736+0000 7fd00a124700 1 --2- 172.21.15.146:0/1257566513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd00409e170 0x7fd00411fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.736+0000 7fd00a124700 1 -- 172.21.15.146:0/1257566513 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff40094a0 con 0x7fd004130ce0 2023-10-03T10:18:08.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.736+0000 7fd009122700 1 --2- 172.21.15.146:0/1257566513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd00409e170 0x7fd00411fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:08.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.736+0000 7fd00a124700 1 --2- 172.21.15.146:0/1257566513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd004130ce0 0x7fd004120000 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00cbe0 tx=0x7fcffc00cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:08.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.737+0000 7fcffa7fc700 1 -- 172.21.15.146:0/1257566513 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc00aa40 con 0x7fd004130ce0 2023-10-03T10:18:08.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.737+0000 7fcffa7fc700 1 -- 172.21.15.146:0/1257566513 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcffc00abc0 con 0x7fd004130ce0 2023-10-03T10:18:08.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.737+0000 7fd00bb87700 1 -- 172.21.15.146:0/1257566513 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0000094a0 con 0x7fd004130ce0 2023-10-03T10:18:08.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.737+0000 7fcffa7fc700 1 -- 172.21.15.146:0/1257566513 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc0070d0 con 0x7fd004130ce0 2023-10-03T10:18:08.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.737+0000 7fd00bb87700 1 -- 172.21.15.146:0/1257566513 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0041300a0 con 0x7fd004130ce0 2023-10-03T10:18:08.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.737+0000 7fcffa7fc700 1 -- 172.21.15.146:0/1257566513 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcffc007230 con 0x7fd004130ce0 2023-10-03T10:18:08.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.737+0000 7fcffa7fc700 1 -- 172.21.15.146:0/1257566513 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcffc03f080 con 0x7fd004130ce0 2023-10-03T10:18:08.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.738+0000 7fd00bb87700 1 -- 172.21.15.146:0/1257566513 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00404f2a0 con 0x7fd004130ce0 2023-10-03T10:18:08.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.742+0000 7fcffa7fc700 1 -- 172.21.15.146:0/1257566513 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcffc018020 con 0x7fd004130ce0 2023-10-03T10:18:08.881 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:08.934 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:08.937 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.936+0000 7fd00bb87700 1 -- 172.21.15.146:0/1257566513 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd00409c580 con 0x7fd004130ce0 2023-10-03T10:18:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.937+0000 7fcffa7fc700 1 -- 172.21.15.146:0/1257566513 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd00409c580 con 0x7fd004130ce0 2023-10-03T10:18:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.939+0000 7fd00bb87700 1 -- 172.21.15.146:0/1257566513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd004130ce0 msgr2=0x7fd004120000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.939+0000 7fd00bb87700 1 --2- 172.21.15.146:0/1257566513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd004130ce0 0x7fd004120000 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00cbe0 tx=0x7fcffc00cef0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.939+0000 7fd00bb87700 1 -- 172.21.15.146:0/1257566513 shutdown_connections 2023-10-03T10:18:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.939+0000 7fd00bb87700 1 --2- 172.21.15.146:0/1257566513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd004130ce0 0x7fd004120000 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.939+0000 7fd00bb87700 1 --2- 172.21.15.146:0/1257566513 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd00409d860 0x7fd00411f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.939+0000 7fd00bb87700 1 --2- 172.21.15.146:0/1257566513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd00409e170 0x7fd00411fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.939+0000 7fd00bb87700 1 -- 172.21.15.146:0/1257566513 >> 172.21.15.146:0/1257566513 conn(0x7fd004099c40 msgr2=0x7fd004119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.939+0000 7fd00bb87700 1 -- 172.21.15.146:0/1257566513 shutdown_connections 2023-10-03T10:18:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:08.939+0000 7fd00bb87700 1 -- 172.21.15.146:0/1257566513 wait complete. 2023-10-03T10:18:08.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:09.003 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:09.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.016+0000 7fd83c624700 1 Processor -- start 2023-10-03T10:18:09.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.016+0000 7fd83c624700 1 -- start start 2023-10-03T10:18:09.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.016+0000 7fd83c624700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd834133900 0x7fd834133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.016+0000 7fd83c624700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd834134210 0x7fd8340a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.016+0000 7fd83c624700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83409a760 con 0x7fd8340a0ee0 2023-10-03T10:18:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.016+0000 7fd83c624700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8341336e0 con 0x7fd834134210 2023-10-03T10:18:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.016+0000 7fd83c624700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83409a080 con 0x7fd834133900 2023-10-03T10:18:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.017+0000 7fd83abc1700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd8340a0ee0 0x7fd83413a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49774/0 (socket says 172.21.15.146:49774) 2023-10-03T10:18:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.017+0000 7fd83a3c0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd834133900 0x7fd834133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.017+0000 7fd83abc1700 1 -- 172.21.15.146:0/2409906092 learned_addr learned my addr 172.21.15.146:0/2409906092 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.017+0000 7fd839bbf700 1 --2- 172.21.15.146:0/2409906092 >> v2:172.21.15.146:3300/0 conn(0x7fd834134210 0x7fd8340a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.017+0000 7fd839bbf700 1 -- 172.21.15.146:0/2409906092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd834133900 msgr2=0x7fd834133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.017+0000 7fd839bbf700 1 --2- 172.21.15.146:0/2409906092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd834133900 0x7fd834133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.017+0000 7fd839bbf700 1 -- 172.21.15.146:0/2409906092 >> v1:172.21.15.146:6789/0 conn(0x7fd8340a0ee0 legacy=0x7fd83413a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.017+0000 7fd839bbf700 1 -- 172.21.15.146:0/2409906092 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8340a23e0 con 0x7fd834134210 2023-10-03T10:18:09.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.017+0000 7fd83a3c0700 1 --2- 172.21.15.146:0/2409906092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd834133900 0x7fd834133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:09.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.017+0000 7fd839bbf700 1 --2- 172.21.15.146:0/2409906092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd834134210 0x7fd8340a09a0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fd824009840 tx=0x7fd824009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a047a66d025959 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.017+0000 7fd8393be700 1 -- 172.21.15.146:0/2409906092 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824011830 con 0x7fd834134210 2023-10-03T10:18:09.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.017+0000 7fd8393be700 1 -- 172.21.15.146:0/2409906092 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd824011990 con 0x7fd834134210 2023-10-03T10:18:09.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.017+0000 7fd8393be700 1 -- 172.21.15.146:0/2409906092 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824011d20 con 0x7fd834134210 2023-10-03T10:18:09.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.018+0000 7fd83c624700 1 -- 172.21.15.146:0/2409906092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd834134210 msgr2=0x7fd8340a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.018+0000 7fd83c624700 1 --2- 172.21.15.146:0/2409906092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd834134210 0x7fd8340a09a0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fd824009840 tx=0x7fd824009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:09.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.018+0000 7fd83c624700 1 -- 172.21.15.146:0/2409906092 shutdown_connections 2023-10-03T10:18:09.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.018+0000 7fd83c624700 1 --2- 172.21.15.146:0/2409906092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd834133900 0x7fd834133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.018+0000 7fd83c624700 1 --2- 172.21.15.146:0/2409906092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd834134210 0x7fd8340a09a0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.018+0000 7fd83c624700 1 -- 172.21.15.146:0/2409906092 >> 172.21.15.146:0/2409906092 conn(0x7fd8340a2980 msgr2=0x7fd8340a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.018+0000 7fd83c624700 1 -- 172.21.15.146:0/2409906092 shutdown_connections 2023-10-03T10:18:09.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.018+0000 7fd83c624700 1 -- 172.21.15.146:0/2409906092 wait complete. 2023-10-03T10:18:09.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.019+0000 7fd83c624700 1 Processor -- start 2023-10-03T10:18:09.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.019+0000 7fd83c624700 1 -- start start 2023-10-03T10:18:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.020+0000 7fd83c624700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8340a0ee0 0x7fd83411d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.020+0000 7fd83c624700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd834133900 0x7fd83411dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.020+0000 7fd83c624700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd834134210 0x7fd83411e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.020+0000 7fd83c624700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8341212e0 con 0x7fd834134210 2023-10-03T10:18:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.020+0000 7fd83c624700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83411f9f0 con 0x7fd8340a0ee0 2023-10-03T10:18:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.020+0000 7fd83c624700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8341206b0 con 0x7fd834133900 2023-10-03T10:18:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.020+0000 7fd83a3c0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8340a0ee0 0x7fd83411d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.020+0000 7fd83a3c0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8340a0ee0 0x7fd83411d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60528/0 (socket says 172.21.15.146:60528) 2023-10-03T10:18:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.020+0000 7fd83a3c0700 1 -- 172.21.15.146:0/141923675 learned_addr learned my addr 172.21.15.146:0/141923675 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.020+0000 7fd839bbf700 1 --2- 172.21.15.146:0/141923675 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd834133900 0x7fd83411dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.020+0000 7fd83abc1700 1 --2- 172.21.15.146:0/141923675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd834134210 0x7fd83411e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.020+0000 7fd83a3c0700 1 -- 172.21.15.146:0/141923675 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd834133900 msgr2=0x7fd83411dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.020+0000 7fd83a3c0700 1 --2- 172.21.15.146:0/141923675 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd834133900 0x7fd83411dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.020+0000 7fd83a3c0700 1 -- 172.21.15.146:0/141923675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd834134210 msgr2=0x7fd83411e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.020+0000 7fd83a3c0700 1 --2- 172.21.15.146:0/141923675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd834134210 0x7fd83411e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.020+0000 7fd83a3c0700 1 -- 172.21.15.146:0/141923675 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd830009430 con 0x7fd8340a0ee0 2023-10-03T10:18:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.020+0000 7fd83a3c0700 1 --2- 172.21.15.146:0/141923675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8340a0ee0 0x7fd83411d7c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd83000ec10 tx=0x7fd83000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.021+0000 7fd82affd700 1 -- 172.21.15.146:0/141923675 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830005a20 con 0x7fd8340a0ee0 2023-10-03T10:18:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.021+0000 7fd82affd700 1 -- 172.21.15.146:0/141923675 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd830005b80 con 0x7fd8340a0ee0 2023-10-03T10:18:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.021+0000 7fd82affd700 1 -- 172.21.15.146:0/141923675 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83000c850 con 0x7fd8340a0ee0 2023-10-03T10:18:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.021+0000 7fd83c624700 1 -- 172.21.15.146:0/141923675 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8240094a0 con 0x7fd8340a0ee0 2023-10-03T10:18:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.021+0000 7fd83c624700 1 -- 172.21.15.146:0/141923675 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd834132ee0 con 0x7fd8340a0ee0 2023-10-03T10:18:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.021+0000 7fd82affd700 1 -- 172.21.15.146:0/141923675 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd83000c9b0 con 0x7fd8340a0ee0 2023-10-03T10:18:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.022+0000 7fd82affd700 1 -- 172.21.15.146:0/141923675 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd83003f990 con 0x7fd8340a0ee0 2023-10-03T10:18:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.022+0000 7fd83c624700 1 -- 172.21.15.146:0/141923675 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83411a590 con 0x7fd8340a0ee0 2023-10-03T10:18:09.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.030+0000 7fd82affd700 1 -- 172.21.15.146:0/141923675 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd830011af0 con 0x7fd8340a0ee0 2023-10-03T10:18:09.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.073+0000 7fb51a27e700 1 Processor -- start 2023-10-03T10:18:09.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.073+0000 7fb51a27e700 1 -- start start 2023-10-03T10:18:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.074+0000 7fb51a27e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb51409e950 0x7fb51409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.074+0000 7fb51a27e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb514131fa0 0x7fb514139af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.074+0000 7fb51a27e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb51409afb0 con 0x7fb51409f260 2023-10-03T10:18:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.074+0000 7fb51a27e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5140a0970 con 0x7fb51409e950 2023-10-03T10:18:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.074+0000 7fb51a27e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5140a0320 con 0x7fb514131fa0 2023-10-03T10:18:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.074+0000 7fb513fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb51409e950 0x7fb51409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.074+0000 7fb513fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb51409e950 0x7fb51409ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33952/0 (socket says 172.21.15.146:33952) 2023-10-03T10:18:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.074+0000 7fb5137fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb51409f260 0x7fb514131890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49786/0 (socket says 172.21.15.146:49786) 2023-10-03T10:18:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.074+0000 7fb513fff700 1 -- 172.21.15.146:0/733380843 learned_addr learned my addr 172.21.15.146:0/733380843 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.074+0000 7fb51881b700 1 --2- 172.21.15.146:0/733380843 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb514131fa0 0x7fb514139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.074+0000 7fb513fff700 1 -- 172.21.15.146:0/733380843 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb514131fa0 msgr2=0x7fb514139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.074+0000 7fb513fff700 1 --2- 172.21.15.146:0/733380843 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb514131fa0 0x7fb514139af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.074+0000 7fb513fff700 1 -- 172.21.15.146:0/733380843 >> v1:172.21.15.146:6789/0 conn(0x7fb51409f260 legacy=0x7fb514131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.074+0000 7fb512ffd700 1 -- 172.21.15.146:0/733380843 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832744985 0 0) 0x7fb51409afb0 con 0x7fb51409f260 2023-10-03T10:18:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.074+0000 7fb513fff700 1 -- 172.21.15.146:0/733380843 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5140a0750 con 0x7fb51409e950 2023-10-03T10:18:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.074+0000 7fb513fff700 1 --2- 172.21.15.146:0/733380843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb51409e950 0x7fb51409ed20 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fb504006fd0 tx=0x7fb504009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a79544d3d376a4e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.074+0000 7fb512ffd700 1 -- 172.21.15.146:0/733380843 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb504005e30 con 0x7fb51409e950 2023-10-03T10:18:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.075+0000 7fb512ffd700 1 -- 172.21.15.146:0/733380843 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb504004030 con 0x7fb51409e950 2023-10-03T10:18:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.075+0000 7fb512ffd700 1 -- 172.21.15.146:0/733380843 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5040043e0 con 0x7fb51409e950 2023-10-03T10:18:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.075+0000 7fb51a27e700 1 -- 172.21.15.146:0/733380843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb51409e950 msgr2=0x7fb51409ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.075+0000 7fb51a27e700 1 --2- 172.21.15.146:0/733380843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb51409e950 0x7fb51409ed20 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fb504006fd0 tx=0x7fb504009bd0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.075+0000 7fb51a27e700 1 -- 172.21.15.146:0/733380843 shutdown_connections 2023-10-03T10:18:09.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.075+0000 7fb51a27e700 1 --2- 172.21.15.146:0/733380843 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb514131fa0 0x7fb514139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.075+0000 7fb51a27e700 1 --2- 172.21.15.146:0/733380843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb51409e950 0x7fb51409ed20 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.075+0000 7fb51a27e700 1 -- 172.21.15.146:0/733380843 >> 172.21.15.146:0/733380843 conn(0x7fb5140a0f70 msgr2=0x7fb5140a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.075+0000 7fb51a27e700 1 -- 172.21.15.146:0/733380843 shutdown_connections 2023-10-03T10:18:09.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.075+0000 7fb51a27e700 1 -- 172.21.15.146:0/733380843 wait complete. 2023-10-03T10:18:09.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.076+0000 7fb51a27e700 1 Processor -- start 2023-10-03T10:18:09.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.076+0000 7fb51a27e700 1 -- start start 2023-10-03T10:18:09.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.077+0000 7fb51a27e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb51409e950 0x7fb514120450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.077+0000 7fb51a27e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb51409f260 0x7fb514120990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.077+0000 7fb51a27e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb514131fa0 0x7fb514120ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.077+0000 7fb51a27e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb514121920 con 0x7fb514131fa0 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.077+0000 7fb51a27e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb514123f70 con 0x7fb51409f260 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.077+0000 7fb51a27e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb514122100 con 0x7fb51409e950 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.077+0000 7fb5137fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb51409f260 0x7fb514120990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.077+0000 7fb51881b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb514131fa0 0x7fb514120ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.077+0000 7fb5137fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb51409f260 0x7fb514120990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60546/0 (socket says 172.21.15.146:60546) 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.077+0000 7fb51881b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb514131fa0 0x7fb514120ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33962/0 (socket says 172.21.15.146:33962) 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.077+0000 7fb5137fe700 1 -- 172.21.15.146:0/1787995414 learned_addr learned my addr 172.21.15.146:0/1787995414 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.077+0000 7fb513fff700 1 --2- 172.21.15.146:0/1787995414 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb51409e950 0x7fb514120450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.077+0000 7fb5137fe700 1 -- 172.21.15.146:0/1787995414 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb51409e950 msgr2=0x7fb514120450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.077+0000 7fb5137fe700 1 --2- 172.21.15.146:0/1787995414 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb51409e950 0x7fb514120450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.077+0000 7fb5137fe700 1 -- 172.21.15.146:0/1787995414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb514131fa0 msgr2=0x7fb514120ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.077+0000 7fb5137fe700 1 --2- 172.21.15.146:0/1787995414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb514131fa0 0x7fb514120ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.077+0000 7fb5137fe700 1 -- 172.21.15.146:0/1787995414 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb504009500 con 0x7fb51409f260 2023-10-03T10:18:09.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.077+0000 7fb513fff700 1 --2- 172.21.15.146:0/1787995414 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb51409e950 0x7fb514120450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:09.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.077+0000 7fb51881b700 1 --2- 172.21.15.146:0/1787995414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb514131fa0 0x7fb514120ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:09.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.077+0000 7fb5137fe700 1 --2- 172.21.15.146:0/1787995414 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb51409f260 0x7fb514120990 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb5080018d0 tx=0x7fb508001be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.078+0000 7fb510ff9700 1 -- 172.21.15.146:0/1787995414 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50800c070 con 0x7fb51409f260 2023-10-03T10:18:09.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.078+0000 7fb510ff9700 1 -- 172.21.15.146:0/1787995414 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb508004870 con 0x7fb51409f260 2023-10-03T10:18:09.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.078+0000 7fb51a27e700 1 -- 172.21.15.146:0/1787995414 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5140a4be0 con 0x7fb51409f260 2023-10-03T10:18:09.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.078+0000 7fb510ff9700 1 -- 172.21.15.146:0/1787995414 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50800e310 con 0x7fb51409f260 2023-10-03T10:18:09.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.078+0000 7fb51a27e700 1 -- 172.21.15.146:0/1787995414 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb514130f50 con 0x7fb51409f260 2023-10-03T10:18:09.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.079+0000 7fb510ff9700 1 -- 172.21.15.146:0/1787995414 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb508004c00 con 0x7fb51409f260 2023-10-03T10:18:09.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.079+0000 7fb510ff9700 1 -- 172.21.15.146:0/1787995414 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb50803eec0 con 0x7fb51409f260 2023-10-03T10:18:09.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.079+0000 7fb51a27e700 1 -- 172.21.15.146:0/1787995414 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb51404f2a0 con 0x7fb51409f260 2023-10-03T10:18:09.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.083+0000 7fb510ff9700 1 -- 172.21.15.146:0/1787995414 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5080070d0 con 0x7fb51409f260 2023-10-03T10:18:09.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.135+0000 7f09f7208700 1 Processor -- start 2023-10-03T10:18:09.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.135+0000 7f09f7208700 1 -- start start 2023-10-03T10:18:09.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.135+0000 7f09f7208700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09f009d860 0x7f09f009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.135+0000 7f09f7208700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09f009e170 0x7f09f01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.135+0000 7f09f7208700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f009aaa0 con 0x7f09f0130ce0 2023-10-03T10:18:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.135+0000 7f09f7208700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f009f870 con 0x7f09f009e170 2023-10-03T10:18:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.135+0000 7f09f7208700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09f009b360 con 0x7f09f009d860 2023-10-03T10:18:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.135+0000 7f09effff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09f009e170 0x7f09f01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.135+0000 7f09f57a5700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f09f0130ce0 0x7f09f01379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49802/0 (socket says 172.21.15.146:49802) 2023-10-03T10:18:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.135+0000 7f09f4fa4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09f009d860 0x7f09f009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.135+0000 7f09f57a5700 1 -- 172.21.15.146:0/1017366364 learned_addr learned my addr 172.21.15.146:0/1017366364 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.136+0000 7f09ef7fe700 1 -- 172.21.15.146:0/1017366364 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928930349 0 0) 0x7f09f009aaa0 con 0x7f09f0130ce0 2023-10-03T10:18:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.136+0000 7f09f4fa4700 1 -- 172.21.15.146:0/1017366364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09f009e170 msgr2=0x7f09f01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.136+0000 7f09f4fa4700 1 --2- 172.21.15.146:0/1017366364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09f009e170 0x7f09f01307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.136+0000 7f09f4fa4700 1 -- 172.21.15.146:0/1017366364 >> v1:172.21.15.146:6789/0 conn(0x7f09f0130ce0 legacy=0x7f09f01379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.136+0000 7f09f4fa4700 1 -- 172.21.15.146:0/1017366364 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f009b620 con 0x7f09f009d860 2023-10-03T10:18:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.136+0000 7f09f4fa4700 1 --2- 172.21.15.146:0/1017366364 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09f009d860 0x7f09f009dc30 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009870 tx=0x7f09e4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82ebf90418a558fe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.136+0000 7f09ef7fe700 1 -- 172.21.15.146:0/1017366364 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4011830 con 0x7f09f009d860 2023-10-03T10:18:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.136+0000 7f09ef7fe700 1 -- 172.21.15.146:0/1017366364 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e4011990 con 0x7f09f009d860 2023-10-03T10:18:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.136+0000 7f09ef7fe700 1 -- 172.21.15.146:0/1017366364 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4011d20 con 0x7f09f009d860 2023-10-03T10:18:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.137+0000 7f09f7208700 1 -- 172.21.15.146:0/1017366364 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09f009d860 msgr2=0x7f09f009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.137+0000 7f09f7208700 1 --2- 172.21.15.146:0/1017366364 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09f009d860 0x7f09f009dc30 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009870 tx=0x7f09e4009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.137+0000 7f09f7208700 1 -- 172.21.15.146:0/1017366364 shutdown_connections 2023-10-03T10:18:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.137+0000 7f09f7208700 1 --2- 172.21.15.146:0/1017366364 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09f009d860 0x7f09f009dc30 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.137+0000 7f09f7208700 1 --2- 172.21.15.146:0/1017366364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09f009e170 0x7f09f01307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.137+0000 7f09f7208700 1 -- 172.21.15.146:0/1017366364 >> 172.21.15.146:0/1017366364 conn(0x7f09f0099c40 msgr2=0x7f09f00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.137+0000 7f09f7208700 1 -- 172.21.15.146:0/1017366364 shutdown_connections 2023-10-03T10:18:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.137+0000 7f09f7208700 1 -- 172.21.15.146:0/1017366364 wait complete. 2023-10-03T10:18:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.138+0000 7f09f7208700 1 Processor -- start 2023-10-03T10:18:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.138+0000 7f09f7208700 1 -- start start 2023-10-03T10:18:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.139+0000 7f09f7208700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09f009d860 0x7f09f01354a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.139+0000 7f09f7208700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09f009e170 0x7f09f01359e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.139+0000 7f09f7208700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09f0130ce0 0x7f09f0135f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.139+0000 7f09f7208700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f0137f40 con 0x7f09f009d860 2023-10-03T10:18:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.139+0000 7f09f7208700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f0138a20 con 0x7f09f009e170 2023-10-03T10:18:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.139+0000 7f09f7208700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09f0138ce0 con 0x7f09f0130ce0 2023-10-03T10:18:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.139+0000 7f09effff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09f009e170 0x7f09f01359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.139+0000 7f09f4fa4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09f009d860 0x7f09f01354a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.139+0000 7f09effff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09f009e170 0x7f09f01359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60564/0 (socket says 172.21.15.146:60564) 2023-10-03T10:18:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.139+0000 7f09effff700 1 -- 172.21.15.146:0/4233489573 learned_addr learned my addr 172.21.15.146:0/4233489573 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.139+0000 7f09f57a5700 1 --2- 172.21.15.146:0/4233489573 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09f0130ce0 0x7f09f0135f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.139+0000 7f09effff700 1 -- 172.21.15.146:0/4233489573 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09f0130ce0 msgr2=0x7f09f0135f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.139+0000 7f09effff700 1 --2- 172.21.15.146:0/4233489573 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09f0130ce0 0x7f09f0135f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.139+0000 7f09effff700 1 -- 172.21.15.146:0/4233489573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09f009d860 msgr2=0x7f09f01354a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.139+0000 7f09effff700 1 --2- 172.21.15.146:0/4233489573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09f009d860 0x7f09f01354a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.139+0000 7f09effff700 1 -- 172.21.15.146:0/4233489573 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e40094a0 con 0x7f09f009e170 2023-10-03T10:18:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.140+0000 7f09effff700 1 --2- 172.21.15.146:0/4233489573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09f009e170 0x7f09f01359e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00e980 tx=0x7f09dc00ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.140+0000 7f09ed7fa700 1 -- 172.21.15.146:0/4233489573 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc009710 con 0x7f09f009e170 2023-10-03T10:18:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.140+0000 7f09ed7fa700 1 -- 172.21.15.146:0/4233489573 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc00c690 con 0x7f09f009e170 2023-10-03T10:18:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.140+0000 7f09f7208700 1 -- 172.21.15.146:0/4233489573 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f0138300 con 0x7f09f009e170 2023-10-03T10:18:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.140+0000 7f09ed7fa700 1 -- 172.21.15.146:0/4233489573 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc00ca20 con 0x7f09f009e170 2023-10-03T10:18:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.140+0000 7f09f7208700 1 -- 172.21.15.146:0/4233489573 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f01375c0 con 0x7f09f009e170 2023-10-03T10:18:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.141+0000 7f09ed7fa700 1 -- 172.21.15.146:0/4233489573 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09dc00cb80 con 0x7f09f009e170 2023-10-03T10:18:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.141+0000 7f09ed7fa700 1 -- 172.21.15.146:0/4233489573 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f09dc03fa80 con 0x7f09f009e170 2023-10-03T10:18:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.141+0000 7f09f7208700 1 -- 172.21.15.146:0/4233489573 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f004f2a0 con 0x7f09f009e170 2023-10-03T10:18:09.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.150+0000 7f09ed7fa700 1 -- 172.21.15.146:0/4233489573 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09dc01b3b0 con 0x7f09f009e170 2023-10-03T10:18:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.246+0000 7fd83c624700 1 -- 172.21.15.146:0/141923675 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd83404f2a0 con 0x7fd8340a0ee0 2023-10-03T10:18:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.247+0000 7fd82affd700 1 -- 172.21.15.146:0/141923675 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd83002a090 con 0x7fd8340a0ee0 2023-10-03T10:18:09.246 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.250+0000 7fd83c624700 1 -- 172.21.15.146:0/141923675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8340a0ee0 msgr2=0x7fd83411d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.250+0000 7fd83c624700 1 --2- 172.21.15.146:0/141923675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8340a0ee0 0x7fd83411d7c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd83000ec10 tx=0x7fd83000ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.250+0000 7fd83c624700 1 -- 172.21.15.146:0/141923675 shutdown_connections 2023-10-03T10:18:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.250+0000 7fd83c624700 1 --2- 172.21.15.146:0/141923675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd834134210 0x7fd83411e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.250+0000 7fd83c624700 1 --2- 172.21.15.146:0/141923675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8340a0ee0 0x7fd83411d7c0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.250+0000 7fd83c624700 1 --2- 172.21.15.146:0/141923675 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd834133900 0x7fd83411dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.250+0000 7fd83c624700 1 -- 172.21.15.146:0/141923675 >> 172.21.15.146:0/141923675 conn(0x7fd8340a2980 msgr2=0x7fd8341bad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.250+0000 7fd83c624700 1 -- 172.21.15.146:0/141923675 shutdown_connections 2023-10-03T10:18:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.250+0000 7fd83c624700 1 -- 172.21.15.146:0/141923675 wait complete. 2023-10-03T10:18:09.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:09.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.287+0000 7fb51a27e700 1 -- 172.21.15.146:0/1787995414 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb51409b8b0 con 0x7fb51409f260 2023-10-03T10:18:09.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.287+0000 7fb510ff9700 1 -- 172.21.15.146:0/1787995414 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb5080202f0 con 0x7fb51409f260 2023-10-03T10:18:09.287 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:09.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.289+0000 7fb51a27e700 1 -- 172.21.15.146:0/1787995414 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb51409f260 msgr2=0x7fb514120990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.289+0000 7fb51a27e700 1 --2- 172.21.15.146:0/1787995414 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb51409f260 0x7fb514120990 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb5080018d0 tx=0x7fb508001be0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.289+0000 7fb51a27e700 1 -- 172.21.15.146:0/1787995414 shutdown_connections 2023-10-03T10:18:09.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.289+0000 7fb51a27e700 1 --2- 172.21.15.146:0/1787995414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb514131fa0 0x7fb514120ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.289+0000 7fb51a27e700 1 --2- 172.21.15.146:0/1787995414 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb51409e950 0x7fb514120450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.289+0000 7fb51a27e700 1 --2- 172.21.15.146:0/1787995414 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb51409f260 0x7fb514120990 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.289+0000 7fb51a27e700 1 -- 172.21.15.146:0/1787995414 >> 172.21.15.146:0/1787995414 conn(0x7fb5140a0f70 msgr2=0x7fb51411a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.289+0000 7fb51a27e700 1 -- 172.21.15.146:0/1787995414 shutdown_connections 2023-10-03T10:18:09.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.289+0000 7fb51a27e700 1 -- 172.21.15.146:0/1787995414 wait complete. 2023-10-03T10:18:09.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:09.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.342+0000 7f09f7208700 1 -- 172.21.15.146:0/4233489573 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f09f01378a0 con 0x7f09f009e170 2023-10-03T10:18:09.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.343+0000 7f09ed7fa700 1 -- 172.21.15.146:0/4233489573 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f09dc021030 con 0x7f09f009e170 2023-10-03T10:18:09.342 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.345+0000 7f09f7208700 1 -- 172.21.15.146:0/4233489573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09f009e170 msgr2=0x7f09f01359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.345+0000 7f09f7208700 1 --2- 172.21.15.146:0/4233489573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09f009e170 0x7f09f01359e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00e980 tx=0x7f09dc00ec90 comp rx=0 tx=0).stop 2023-10-03T10:18:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.345+0000 7f09f7208700 1 -- 172.21.15.146:0/4233489573 shutdown_connections 2023-10-03T10:18:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.345+0000 7f09f7208700 1 --2- 172.21.15.146:0/4233489573 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f09f0130ce0 0x7f09f0135f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.345+0000 7f09f7208700 1 --2- 172.21.15.146:0/4233489573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09f009d860 0x7f09f01354a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.345+0000 7f09f7208700 1 --2- 172.21.15.146:0/4233489573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09f009e170 0x7f09f01359e0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.345+0000 7f09f7208700 1 -- 172.21.15.146:0/4233489573 >> 172.21.15.146:0/4233489573 conn(0x7f09f0099c40 msgr2=0x7f09f01393c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.345+0000 7f09f7208700 1 -- 172.21.15.146:0/4233489573 shutdown_connections 2023-10-03T10:18:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:09.345+0000 7f09f7208700 1 -- 172.21.15.146:0/4233489573 wait complete. 2023-10-03T10:18:09.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:09.952 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:10.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.084+0000 7f290c087700 1 Processor -- start 2023-10-03T10:18:10.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.084+0000 7f290c087700 1 -- start start 2023-10-03T10:18:10.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.085+0000 7f290c087700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2904133ad0 0x7f2904133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.085+0000 7f290c087700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f29041300a0 0x7f29041304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.085+0000 7f290c087700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f29041309f0 0x7f290413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.085+0000 7f290c087700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f290406b2d0 con 0x7f29041300a0 2023-10-03T10:18:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.085+0000 7f290c087700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2904133610 con 0x7f2904133ad0 2023-10-03T10:18:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.085+0000 7f290c087700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f290409a500 con 0x7f29041309f0 2023-10-03T10:18:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.085+0000 7f290a624700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f29041309f0 0x7f290413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.085+0000 7f2909622700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f29041300a0 0x7f29041304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.085+0000 7f2909e23700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2904133ad0 0x7f2904133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.085+0000 7f2909622700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f29041300a0 0x7f29041304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33986/0 (socket says 172.21.15.146:33986) 2023-10-03T10:18:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.085+0000 7f2909e23700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2904133ad0 0x7f2904133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60580/0 (socket says 172.21.15.146:60580) 2023-10-03T10:18:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.085+0000 7f290a624700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f29041309f0 0x7f290413a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43444/0 (socket says 172.21.15.146:43444) 2023-10-03T10:18:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.085+0000 7f2909622700 1 -- 172.21.15.146:0/1694118268 learned_addr learned my addr 172.21.15.146:0/1694118268 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.085+0000 7f2909e23700 1 -- 172.21.15.146:0/1694118268 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f29041309f0 msgr2=0x7f290413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.085+0000 7f2909e23700 1 --2- 172.21.15.146:0/1694118268 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f29041309f0 0x7f290413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.085+0000 7f2909e23700 1 -- 172.21.15.146:0/1694118268 >> v2:172.21.15.146:3300/0 conn(0x7f29041300a0 msgr2=0x7f29041304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.085+0000 7f2909e23700 1 --2- 172.21.15.146:0/1694118268 >> v2:172.21.15.146:3300/0 conn(0x7f29041300a0 0x7f29041304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.085+0000 7f2909e23700 1 -- 172.21.15.146:0/1694118268 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29041338b0 con 0x7f2904133ad0 2023-10-03T10:18:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.085+0000 7f2909622700 1 --2- 172.21.15.146:0/1694118268 >> v2:172.21.15.146:3300/0 conn(0x7f29041300a0 0x7f29041304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.085+0000 7f2909e23700 1 --2- 172.21.15.146:0/1694118268 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2904133ad0 0x7f2904133ea0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f28f4009840 tx=0x7f28f4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdaf9ab6b0f23441 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.086+0000 7f2908e21700 1 -- 172.21.15.146:0/1694118268 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f4011830 con 0x7f2904133ad0 2023-10-03T10:18:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.086+0000 7f2908e21700 1 -- 172.21.15.146:0/1694118268 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f4011990 con 0x7f2904133ad0 2023-10-03T10:18:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.086+0000 7f2908e21700 1 -- 172.21.15.146:0/1694118268 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f4011d20 con 0x7f2904133ad0 2023-10-03T10:18:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.086+0000 7f290c087700 1 -- 172.21.15.146:0/1694118268 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2904133ad0 msgr2=0x7f2904133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.086+0000 7f290c087700 1 --2- 172.21.15.146:0/1694118268 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2904133ad0 0x7f2904133ea0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f28f4009840 tx=0x7f28f4009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.086+0000 7f290c087700 1 -- 172.21.15.146:0/1694118268 shutdown_connections 2023-10-03T10:18:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.086+0000 7f290c087700 1 --2- 172.21.15.146:0/1694118268 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2904133ad0 0x7f2904133ea0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.086+0000 7f290c087700 1 --2- 172.21.15.146:0/1694118268 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f29041309f0 0x7f290413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.086+0000 7f290c087700 1 --2- 172.21.15.146:0/1694118268 >> v2:172.21.15.146:3300/0 conn(0x7f29041300a0 0x7f29041304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.086+0000 7f290c087700 1 -- 172.21.15.146:0/1694118268 >> 172.21.15.146:0/1694118268 conn(0x7f2904099c40 msgr2=0x7f29040a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.086+0000 7f290c087700 1 -- 172.21.15.146:0/1694118268 shutdown_connections 2023-10-03T10:18:10.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.086+0000 7f290c087700 1 -- 172.21.15.146:0/1694118268 wait complete. 2023-10-03T10:18:10.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.087+0000 7f290c087700 1 Processor -- start 2023-10-03T10:18:10.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.087+0000 7f290c087700 1 -- start start 2023-10-03T10:18:10.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.087+0000 7f290c087700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f29041300a0 0x7f290411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.087+0000 7f290c087700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29041309f0 0x7f290411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.088+0000 7f290c087700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2904133ad0 0x7f290411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.088+0000 7f290c087700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29040726c0 con 0x7f29041309f0 2023-10-03T10:18:10.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.088+0000 7f290c087700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f290412d970 con 0x7f2904133ad0 2023-10-03T10:18:10.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.088+0000 7f290c087700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29040a33e0 con 0x7f29041300a0 2023-10-03T10:18:10.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.088+0000 7f2909e23700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f29041300a0 0x7f290411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.088+0000 7f2909622700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29041309f0 0x7f290411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.088+0000 7f2909e23700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f29041300a0 0x7f290411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43446/0 (socket says 172.21.15.146:43446) 2023-10-03T10:18:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.088+0000 7f2909e23700 1 -- 172.21.15.146:0/2518093005 learned_addr learned my addr 172.21.15.146:0/2518093005 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.088+0000 7f290a624700 1 --2- 172.21.15.146:0/2518093005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2904133ad0 0x7f290411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.088+0000 7f2909622700 1 -- 172.21.15.146:0/2518093005 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f29041300a0 msgr2=0x7f290411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.088+0000 7f2909622700 1 --2- 172.21.15.146:0/2518093005 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f29041300a0 0x7f290411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.088+0000 7f2909622700 1 -- 172.21.15.146:0/2518093005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2904133ad0 msgr2=0x7f290411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.088+0000 7f2909622700 1 --2- 172.21.15.146:0/2518093005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2904133ad0 0x7f290411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.088+0000 7f2909622700 1 -- 172.21.15.146:0/2518093005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2900009550 con 0x7f29041309f0 2023-10-03T10:18:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.088+0000 7f290a624700 1 --2- 172.21.15.146:0/2518093005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2904133ad0 0x7f290411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.088+0000 7f2909e23700 1 --2- 172.21.15.146:0/2518093005 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f29041300a0 0x7f290411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.088+0000 7f2909622700 1 --2- 172.21.15.146:0/2518093005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29041309f0 0x7f290411df80 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f290409ea20 tx=0x7f290000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.088+0000 7f28fa7fc700 1 -- 172.21.15.146:0/2518093005 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2900004240 con 0x7f29041309f0 2023-10-03T10:18:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.088+0000 7f28fa7fc700 1 -- 172.21.15.146:0/2518093005 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29000043a0 con 0x7f29041309f0 2023-10-03T10:18:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.088+0000 7f290c087700 1 -- 172.21.15.146:0/2518093005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f40094a0 con 0x7f29041309f0 2023-10-03T10:18:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.088+0000 7f28fa7fc700 1 -- 172.21.15.146:0/2518093005 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29000036a0 con 0x7f29041309f0 2023-10-03T10:18:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.088+0000 7f290c087700 1 -- 172.21.15.146:0/2518093005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f290411fde0 con 0x7f29041309f0 2023-10-03T10:18:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.089+0000 7f28fa7fc700 1 -- 172.21.15.146:0/2518093005 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2900003800 con 0x7f29041309f0 2023-10-03T10:18:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.089+0000 7f28fa7fc700 1 -- 172.21.15.146:0/2518093005 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f290003f7c0 con 0x7f29041309f0 2023-10-03T10:18:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.089+0000 7f290c087700 1 -- 172.21.15.146:0/2518093005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f290411f950 con 0x7f29041309f0 2023-10-03T10:18:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.094+0000 7f28fa7fc700 1 -- 172.21.15.146:0/2518093005 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2900013470 con 0x7f29041309f0 2023-10-03T10:18:10.266 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:10.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.282+0000 7f290c087700 1 -- 172.21.15.146:0/2518093005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2904074f10 con 0x7f29041309f0 2023-10-03T10:18:10.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.283+0000 7f28fa7fc700 1 -- 172.21.15.146:0/2518093005 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f290001bb60 con 0x7f29041309f0 2023-10-03T10:18:10.282 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:10.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.285+0000 7f290c087700 1 -- 172.21.15.146:0/2518093005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29041309f0 msgr2=0x7f290411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.285+0000 7f290c087700 1 --2- 172.21.15.146:0/2518093005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29041309f0 0x7f290411df80 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f290409ea20 tx=0x7f290000ec80 comp rx=0 tx=0).stop 2023-10-03T10:18:10.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.285+0000 7f290c087700 1 -- 172.21.15.146:0/2518093005 shutdown_connections 2023-10-03T10:18:10.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.285+0000 7f290c087700 1 --2- 172.21.15.146:0/2518093005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2904133ad0 0x7f290411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.285+0000 7f290c087700 1 --2- 172.21.15.146:0/2518093005 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f29041300a0 0x7f290411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.285+0000 7f290c087700 1 --2- 172.21.15.146:0/2518093005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29041309f0 0x7f290411df80 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.285+0000 7f290c087700 1 -- 172.21.15.146:0/2518093005 >> 172.21.15.146:0/2518093005 conn(0x7f2904099c40 msgr2=0x7f2904132bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.285+0000 7f290c087700 1 -- 172.21.15.146:0/2518093005 shutdown_connections 2023-10-03T10:18:10.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.285+0000 7f290c087700 1 -- 172.21.15.146:0/2518093005 wait complete. 2023-10-03T10:18:10.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:10.302 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:10.357 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:10.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.395+0000 7fd690625700 1 Processor -- start 2023-10-03T10:18:10.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.395+0000 7fd690625700 1 -- start start 2023-10-03T10:18:10.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.395+0000 7fd690625700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd688099a60 0x7fd6881388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.395+0000 7fd690625700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd688138e30 0x7fd68813b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.395+0000 7fd690625700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68809aa00 con 0x7fd688133b80 2023-10-03T10:18:10.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.395+0000 7fd690625700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68809a080 con 0x7fd688099a60 2023-10-03T10:18:10.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.395+0000 7fd690625700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd688133750 con 0x7fd688138e30 2023-10-03T10:18:10.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.396+0000 7fd68ebc2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd688138e30 0x7fd68813b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.396+0000 7fd68dbc0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd688099a60 0x7fd6881388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.396+0000 7fd68dbc0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd688099a60 0x7fd6881388f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34002/0 (socket says 172.21.15.146:34002) 2023-10-03T10:18:10.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.396+0000 7fd68dbc0700 1 -- 172.21.15.146:0/293842946 learned_addr learned my addr 172.21.15.146:0/293842946 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:10.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.396+0000 7fd68ebc2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd688138e30 0x7fd68813b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60606/0 (socket says 172.21.15.146:60606) 2023-10-03T10:18:10.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.396+0000 7fd68dbc0700 1 -- 172.21.15.146:0/293842946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd688138e30 msgr2=0x7fd68813b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:10.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.396+0000 7fd68dbc0700 1 --2- 172.21.15.146:0/293842946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd688138e30 0x7fd68813b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.396+0000 7fd68dbc0700 1 -- 172.21.15.146:0/293842946 >> v1:172.21.15.146:6789/0 conn(0x7fd688133b80 legacy=0x7fd688133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.396+0000 7fd68dbc0700 1 -- 172.21.15.146:0/293842946 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68809a760 con 0x7fd688099a60 2023-10-03T10:18:10.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.396+0000 7fd68d3bf700 1 -- 172.21.15.146:0/293842946 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464886642 0 0) 0x7fd68809aa00 con 0x7fd688133b80 2023-10-03T10:18:10.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.396+0000 7fd68ebc2700 1 --2- 172.21.15.146:0/293842946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd688138e30 0x7fd68813b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.396+0000 7fd68dbc0700 1 --2- 172.21.15.146:0/293842946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd688099a60 0x7fd6881388f0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fd6780098f0 tx=0x7fd678009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8875d903401f9b62 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.396+0000 7fd68d3bf700 1 -- 172.21.15.146:0/293842946 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678011830 con 0x7fd688099a60 2023-10-03T10:18:10.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.396+0000 7fd68d3bf700 1 -- 172.21.15.146:0/293842946 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd678011990 con 0x7fd688099a60 2023-10-03T10:18:10.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.396+0000 7fd68d3bf700 1 -- 172.21.15.146:0/293842946 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678011d20 con 0x7fd688099a60 2023-10-03T10:18:10.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.397+0000 7fd690625700 1 -- 172.21.15.146:0/293842946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd688099a60 msgr2=0x7fd6881388f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.397+0000 7fd690625700 1 --2- 172.21.15.146:0/293842946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd688099a60 0x7fd6881388f0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fd6780098f0 tx=0x7fd678009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.397+0000 7fd690625700 1 -- 172.21.15.146:0/293842946 shutdown_connections 2023-10-03T10:18:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.397+0000 7fd690625700 1 --2- 172.21.15.146:0/293842946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd688138e30 0x7fd68813b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.397+0000 7fd690625700 1 --2- 172.21.15.146:0/293842946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd688099a60 0x7fd6881388f0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.397+0000 7fd690625700 1 -- 172.21.15.146:0/293842946 >> 172.21.15.146:0/293842946 conn(0x7fd6880a2980 msgr2=0x7fd6880a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.397+0000 7fd690625700 1 -- 172.21.15.146:0/293842946 shutdown_connections 2023-10-03T10:18:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.397+0000 7fd690625700 1 -- 172.21.15.146:0/293842946 wait complete. 2023-10-03T10:18:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.398+0000 7fd690625700 1 Processor -- start 2023-10-03T10:18:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.398+0000 7fd690625700 1 -- start start 2023-10-03T10:18:10.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.399+0000 7fd690625700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd688099a60 0x7fd688118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.399+0000 7fd690625700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd688133b80 0x7fd688119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.399+0000 7fd690625700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd688138e30 0x7fd688119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.399+0000 7fd690625700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68811ae00 con 0x7fd688133b80 2023-10-03T10:18:10.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.399+0000 7fd690625700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68811b2b0 con 0x7fd688099a60 2023-10-03T10:18:10.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.399+0000 7fd690625700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd68813b220 con 0x7fd688138e30 2023-10-03T10:18:10.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.399+0000 7fd68e3c1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd688099a60 0x7fd688118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.399+0000 7fd68e3c1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd688099a60 0x7fd688118df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60618/0 (socket says 172.21.15.146:60618) 2023-10-03T10:18:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.399+0000 7fd68e3c1700 1 -- 172.21.15.146:0/2906481295 learned_addr learned my addr 172.21.15.146:0/2906481295 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.399+0000 7fd68ebc2700 1 --2- 172.21.15.146:0/2906481295 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd688138e30 0x7fd688119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.399+0000 7fd68dbc0700 1 --2- 172.21.15.146:0/2906481295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd688133b80 0x7fd688119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.399+0000 7fd68e3c1700 1 -- 172.21.15.146:0/2906481295 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd688138e30 msgr2=0x7fd688119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.399+0000 7fd68e3c1700 1 --2- 172.21.15.146:0/2906481295 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd688138e30 0x7fd688119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.399+0000 7fd68e3c1700 1 -- 172.21.15.146:0/2906481295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd688133b80 msgr2=0x7fd688119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.399+0000 7fd68e3c1700 1 --2- 172.21.15.146:0/2906481295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd688133b80 0x7fd688119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.399+0000 7fd68e3c1700 1 -- 172.21.15.146:0/2906481295 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd680009a70 con 0x7fd688099a60 2023-10-03T10:18:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.399+0000 7fd68e3c1700 1 --2- 172.21.15.146:0/2906481295 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd688099a60 0x7fd688118df0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd68400c580 tx=0x7fd68400c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.399+0000 7fd67effd700 1 -- 172.21.15.146:0/2906481295 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6840054e0 con 0x7fd688099a60 2023-10-03T10:18:10.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.399+0000 7fd67effd700 1 -- 172.21.15.146:0/2906481295 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd684003680 con 0x7fd688099a60 2023-10-03T10:18:10.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.399+0000 7fd690625700 1 -- 172.21.15.146:0/2906481295 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd678009550 con 0x7fd688099a60 2023-10-03T10:18:10.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.399+0000 7fd67effd700 1 -- 172.21.15.146:0/2906481295 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd684003a30 con 0x7fd688099a60 2023-10-03T10:18:10.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.399+0000 7fd690625700 1 -- 172.21.15.146:0/2906481295 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68811a8d0 con 0x7fd688099a60 2023-10-03T10:18:10.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.400+0000 7fd67effd700 1 -- 172.21.15.146:0/2906481295 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd684003b90 con 0x7fd688099a60 2023-10-03T10:18:10.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.400+0000 7fd67effd700 1 -- 172.21.15.146:0/2906481295 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd68403ead0 con 0x7fd688099a60 2023-10-03T10:18:10.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.401+0000 7fd690625700 1 -- 172.21.15.146:0/2906481295 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd688137850 con 0x7fd688099a60 2023-10-03T10:18:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.405+0000 7fd67effd700 1 -- 172.21.15.146:0/2906481295 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd684017020 con 0x7fd688099a60 2023-10-03T10:18:10.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.465+0000 7f1614e27700 1 Processor -- start 2023-10-03T10:18:10.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.466+0000 7f1614e27700 1 -- start start 2023-10-03T10:18:10.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.466+0000 7f1614e27700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16100a0a70 0x7f16100a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.466+0000 7f1614e27700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1610134120 0x7f161013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.466+0000 7f1614e27700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f161009dc00 con 0x7f16100a1380 2023-10-03T10:18:10.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.466+0000 7f1614e27700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f161009ea60 con 0x7f1610134120 2023-10-03T10:18:10.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.466+0000 7f1614e27700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f161009dec0 con 0x7f16100a0a70 2023-10-03T10:18:10.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.467+0000 7f160ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1610134120 0x7f161013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.467+0000 7f160dd9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f16100a1380 0x7f1610133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49808/0 (socket says 172.21.15.146:49808) 2023-10-03T10:18:10.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.467+0000 7f160dd9b700 1 -- 172.21.15.146:0/2179551747 learned_addr learned my addr 172.21.15.146:0/2179551747 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:10.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.467+0000 7f160e59c700 1 --2- 172.21.15.146:0/2179551747 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16100a0a70 0x7f16100a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.467+0000 7f160ed9d700 1 -- 172.21.15.146:0/2179551747 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16100a0a70 msgr2=0x7f16100a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:10.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.467+0000 7f160ed9d700 1 --2- 172.21.15.146:0/2179551747 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16100a0a70 0x7f16100a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.467+0000 7f160ed9d700 1 -- 172.21.15.146:0/2179551747 >> v1:172.21.15.146:6789/0 conn(0x7f16100a1380 legacy=0x7f1610133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.467+0000 7f160ed9d700 1 -- 172.21.15.146:0/2179551747 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161009e6a0 con 0x7f1610134120 2023-10-03T10:18:10.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.467+0000 7f160d59a700 1 -- 172.21.15.146:0/2179551747 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4244759671 0 0) 0x7f161009dc00 con 0x7f16100a1380 2023-10-03T10:18:10.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.467+0000 7f160ed9d700 1 --2- 172.21.15.146:0/2179551747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1610134120 0x7f161013bce0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f1608009d90 tx=0x7f160800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f411f45a3d3ebe27 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.467+0000 7f160d59a700 1 -- 172.21.15.146:0/2179551747 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160800e070 con 0x7f1610134120 2023-10-03T10:18:10.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.467+0000 7f160d59a700 1 -- 172.21.15.146:0/2179551747 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160800bb20 con 0x7f1610134120 2023-10-03T10:18:10.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.467+0000 7f160d59a700 1 -- 172.21.15.146:0/2179551747 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1608012430 con 0x7f1610134120 2023-10-03T10:18:10.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.468+0000 7f1614e27700 1 -- 172.21.15.146:0/2179551747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1610134120 msgr2=0x7f161013bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.468+0000 7f1614e27700 1 --2- 172.21.15.146:0/2179551747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1610134120 0x7f161013bce0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f1608009d90 tx=0x7f160800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:10.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.468+0000 7f1614e27700 1 -- 172.21.15.146:0/2179551747 shutdown_connections 2023-10-03T10:18:10.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.468+0000 7f1614e27700 1 --2- 172.21.15.146:0/2179551747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1610134120 0x7f161013bce0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.468+0000 7f1614e27700 1 --2- 172.21.15.146:0/2179551747 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f16100a0a70 0x7f16100a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.468+0000 7f1614e27700 1 -- 172.21.15.146:0/2179551747 >> 172.21.15.146:0/2179551747 conn(0x7f16100a6610 msgr2=0x7f16100a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.468+0000 7f1614e27700 1 -- 172.21.15.146:0/2179551747 shutdown_connections 2023-10-03T10:18:10.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.468+0000 7f1614e27700 1 -- 172.21.15.146:0/2179551747 wait complete. 2023-10-03T10:18:10.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.470+0000 7f1614e27700 1 Processor -- start 2023-10-03T10:18:10.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.470+0000 7f1614e27700 1 -- start start 2023-10-03T10:18:10.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.470+0000 7f1614e27700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16100a0a70 0x7f1610122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.470+0000 7f1614e27700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16100a1380 0x7f1610122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.470+0000 7f1614e27700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1610134120 0x7f16101231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.470+0000 7f1614e27700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16101332b0 con 0x7f16100a1380 2023-10-03T10:18:10.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.470+0000 7f1614e27700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16101258b0 con 0x7f16100a0a70 2023-10-03T10:18:10.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.470+0000 7f1614e27700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16101242c0 con 0x7f1610134120 2023-10-03T10:18:10.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.470+0000 7f160e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16100a0a70 0x7f1610122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.470+0000 7f160e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16100a0a70 0x7f1610122750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60626/0 (socket says 172.21.15.146:60626) 2023-10-03T10:18:10.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.470+0000 7f160e59c700 1 -- 172.21.15.146:0/1596536616 learned_addr learned my addr 172.21.15.146:0/1596536616 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:10.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.471+0000 7f160dd9b700 1 --2- 172.21.15.146:0/1596536616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16100a1380 0x7f1610122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.471+0000 7f160ed9d700 1 --2- 172.21.15.146:0/1596536616 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1610134120 0x7f16101231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.471+0000 7f160e59c700 1 -- 172.21.15.146:0/1596536616 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1610134120 msgr2=0x7f16101231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.471+0000 7f160e59c700 1 --2- 172.21.15.146:0/1596536616 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1610134120 0x7f16101231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.471+0000 7f160e59c700 1 -- 172.21.15.146:0/1596536616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16100a1380 msgr2=0x7f1610122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.471+0000 7f160e59c700 1 --2- 172.21.15.146:0/1596536616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16100a1380 0x7f1610122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.471+0000 7f160e59c700 1 -- 172.21.15.146:0/1596536616 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1608009a70 con 0x7f16100a0a70 2023-10-03T10:18:10.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.471+0000 7f160e59c700 1 --2- 172.21.15.146:0/1596536616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16100a0a70 0x7f1610122750 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f160000e9b0 tx=0x7f160000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.471+0000 7f15feffd700 1 -- 172.21.15.146:0/1596536616 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1600009710 con 0x7f16100a0a70 2023-10-03T10:18:10.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.471+0000 7f15feffd700 1 -- 172.21.15.146:0/1596536616 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160000ee50 con 0x7f16100a0a70 2023-10-03T10:18:10.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.471+0000 7f15feffd700 1 -- 172.21.15.146:0/1596536616 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160000ca50 con 0x7f16100a0a70 2023-10-03T10:18:10.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.471+0000 7f1614e27700 1 -- 172.21.15.146:0/1596536616 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16101261d0 con 0x7f16100a0a70 2023-10-03T10:18:10.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.471+0000 7f1614e27700 1 -- 172.21.15.146:0/1596536616 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16100a0430 con 0x7f16100a0a70 2023-10-03T10:18:10.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.472+0000 7f15feffd700 1 -- 172.21.15.146:0/1596536616 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f160000cbb0 con 0x7f16100a0a70 2023-10-03T10:18:10.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.472+0000 7f15feffd700 1 -- 172.21.15.146:0/1596536616 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f160003f6b0 con 0x7f16100a0a70 2023-10-03T10:18:10.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.472+0000 7f1614e27700 1 -- 172.21.15.146:0/1596536616 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16100a55f0 con 0x7f16100a0a70 2023-10-03T10:18:10.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.477+0000 7f15feffd700 1 -- 172.21.15.146:0/1596536616 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1600021080 con 0x7f16100a0a70 2023-10-03T10:18:10.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.510+0000 7f08453af700 1 Processor -- start 2023-10-03T10:18:10.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.510+0000 7f08453af700 1 -- start start 2023-10-03T10:18:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.511+0000 7f08453af700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08400a1550 0x7f0840138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.511+0000 7f08453af700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0840139200 0x7f084013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.511+0000 7f08453af700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f084009e9d0 con 0x7f08400a0a70 2023-10-03T10:18:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.511+0000 7f08453af700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084009dc00 con 0x7f08400a1550 2023-10-03T10:18:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.511+0000 7f08453af700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f084009dec0 con 0x7f0840139200 2023-10-03T10:18:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.511+0000 7f083effd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f08400a0a70 0x7f08400a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49824/0 (socket says 172.21.15.146:49824) 2023-10-03T10:18:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.511+0000 7f083effd700 1 -- 172.21.15.146:0/3702986524 learned_addr learned my addr 172.21.15.146:0/3702986524 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.511+0000 7f083e7fc700 1 --2- 172.21.15.146:0/3702986524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08400a1550 0x7f0840138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.511+0000 7f083f7fe700 1 --2- 172.21.15.146:0/3702986524 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0840139200 0x7f084013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.511+0000 7f083dffb700 1 -- 172.21.15.146:0/3702986524 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201661538 0 0) 0x7f084009e9d0 con 0x7f08400a0a70 2023-10-03T10:18:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.511+0000 7f083e7fc700 1 -- 172.21.15.146:0/3702986524 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0840139200 msgr2=0x7f084013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.511+0000 7f083e7fc700 1 --2- 172.21.15.146:0/3702986524 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0840139200 0x7f084013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.511+0000 7f083e7fc700 1 -- 172.21.15.146:0/3702986524 >> v1:172.21.15.146:6789/0 conn(0x7f08400a0a70 legacy=0x7f08400a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.511+0000 7f083e7fc700 1 -- 172.21.15.146:0/3702986524 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084009e6a0 con 0x7f08400a1550 2023-10-03T10:18:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.511+0000 7f083f7fe700 1 --2- 172.21.15.146:0/3702986524 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0840139200 0x7f084013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.511+0000 7f083e7fc700 1 --2- 172.21.15.146:0/3702986524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08400a1550 0x7f0840138cc0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0834009870 tx=0x7f0834009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a6f58335e5298a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.512+0000 7f083dffb700 1 -- 172.21.15.146:0/3702986524 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0834011830 con 0x7f08400a1550 2023-10-03T10:18:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.512+0000 7f083dffb700 1 -- 172.21.15.146:0/3702986524 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0834011990 con 0x7f08400a1550 2023-10-03T10:18:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.512+0000 7f083dffb700 1 -- 172.21.15.146:0/3702986524 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0834011d20 con 0x7f08400a1550 2023-10-03T10:18:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.512+0000 7f08453af700 1 -- 172.21.15.146:0/3702986524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08400a1550 msgr2=0x7f0840138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.512+0000 7f08453af700 1 --2- 172.21.15.146:0/3702986524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08400a1550 0x7f0840138cc0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0834009870 tx=0x7f0834009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.512+0000 7f08453af700 1 -- 172.21.15.146:0/3702986524 shutdown_connections 2023-10-03T10:18:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.512+0000 7f08453af700 1 --2- 172.21.15.146:0/3702986524 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0840139200 0x7f084013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.512+0000 7f08453af700 1 --2- 172.21.15.146:0/3702986524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08400a1550 0x7f0840138cc0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.512+0000 7f08453af700 1 -- 172.21.15.146:0/3702986524 >> 172.21.15.146:0/3702986524 conn(0x7f08400a6610 msgr2=0x7f08400a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.512+0000 7f08453af700 1 -- 172.21.15.146:0/3702986524 shutdown_connections 2023-10-03T10:18:10.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.512+0000 7f08453af700 1 -- 172.21.15.146:0/3702986524 wait complete. 2023-10-03T10:18:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.513+0000 7f08453af700 1 Processor -- start 2023-10-03T10:18:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.513+0000 7f08453af700 1 -- start start 2023-10-03T10:18:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.514+0000 7f08453af700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08400a0a70 0x7f084011e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.514+0000 7f08453af700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08400a1550 0x7f084011ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.514+0000 7f08453af700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0840139200 0x7f084011f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.514+0000 7f08453af700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08401222d0 con 0x7f08400a0a70 2023-10-03T10:18:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.514+0000 7f08453af700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08400a03e0 con 0x7f0840139200 2023-10-03T10:18:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.514+0000 7f08453af700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08400a5100 con 0x7f08400a1550 2023-10-03T10:18:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.514+0000 7f083e7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08400a1550 0x7f084011ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.514+0000 7f083e7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08400a1550 0x7f084011ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43482/0 (socket says 172.21.15.146:43482) 2023-10-03T10:18:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.514+0000 7f083e7fc700 1 -- 172.21.15.146:0/3381132907 learned_addr learned my addr 172.21.15.146:0/3381132907 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.514+0000 7f083f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0840139200 0x7f084011f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.514+0000 7f083effd700 1 --2- 172.21.15.146:0/3381132907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08400a0a70 0x7f084011e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.514+0000 7f083e7fc700 1 -- 172.21.15.146:0/3381132907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0840139200 msgr2=0x7f084011f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.514+0000 7f083e7fc700 1 --2- 172.21.15.146:0/3381132907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0840139200 0x7f084011f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.514+0000 7f083e7fc700 1 -- 172.21.15.146:0/3381132907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08400a0a70 msgr2=0x7f084011e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.514+0000 7f083e7fc700 1 --2- 172.21.15.146:0/3381132907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08400a0a70 0x7f084011e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.514+0000 7f083e7fc700 1 -- 172.21.15.146:0/3381132907 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0838009a70 con 0x7f08400a1550 2023-10-03T10:18:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.514+0000 7f083f7fe700 1 --2- 172.21.15.146:0/3381132907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0840139200 0x7f084011f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.514+0000 7f083effd700 1 --2- 172.21.15.146:0/3381132907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08400a0a70 0x7f084011e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.514+0000 7f083e7fc700 1 --2- 172.21.15.146:0/3381132907 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08400a1550 0x7f084011ecf0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0834009840 tx=0x7f0834004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.514+0000 7f08277fe700 1 -- 172.21.15.146:0/3381132907 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08340045d0 con 0x7f08400a1550 2023-10-03T10:18:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.514+0000 7f08277fe700 1 -- 172.21.15.146:0/3381132907 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083401f070 con 0x7f08400a1550 2023-10-03T10:18:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.514+0000 7f08277fe700 1 -- 172.21.15.146:0/3381132907 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08340038e0 con 0x7f08400a1550 2023-10-03T10:18:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.515+0000 7f08453af700 1 -- 172.21.15.146:0/3381132907 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08340094a0 con 0x7f08400a1550 2023-10-03T10:18:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.515+0000 7f08453af700 1 -- 172.21.15.146:0/3381132907 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0840121d30 con 0x7f08400a1550 2023-10-03T10:18:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.515+0000 7f08277fe700 1 -- 172.21.15.146:0/3381132907 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0834003a40 con 0x7f08400a1550 2023-10-03T10:18:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.516+0000 7f08277fe700 1 -- 172.21.15.146:0/3381132907 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0834021070 con 0x7f08400a1550 2023-10-03T10:18:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.516+0000 7f08453af700 1 -- 172.21.15.146:0/3381132907 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084004f2a0 con 0x7f08400a1550 2023-10-03T10:18:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.520+0000 7f08277fe700 1 -- 172.21.15.146:0/3381132907 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f083401a430 con 0x7f08400a1550 2023-10-03T10:18:10.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.607+0000 7fd690625700 1 -- 172.21.15.146:0/2906481295 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd68804f2a0 con 0x7fd688099a60 2023-10-03T10:18:10.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.608+0000 7fd67effd700 1 -- 172.21.15.146:0/2906481295 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd684003e40 con 0x7fd688099a60 2023-10-03T10:18:10.608 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.610+0000 7fd690625700 1 -- 172.21.15.146:0/2906481295 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd688099a60 msgr2=0x7fd688118df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.610+0000 7fd690625700 1 --2- 172.21.15.146:0/2906481295 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd688099a60 0x7fd688118df0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd68400c580 tx=0x7fd68400c890 comp rx=0 tx=0).stop 2023-10-03T10:18:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.610+0000 7fd690625700 1 -- 172.21.15.146:0/2906481295 shutdown_connections 2023-10-03T10:18:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.610+0000 7fd690625700 1 --2- 172.21.15.146:0/2906481295 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd688138e30 0x7fd688119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.610+0000 7fd690625700 1 --2- 172.21.15.146:0/2906481295 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd688099a60 0x7fd688118df0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.610+0000 7fd690625700 1 --2- 172.21.15.146:0/2906481295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd688133b80 0x7fd688119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.610+0000 7fd690625700 1 -- 172.21.15.146:0/2906481295 >> 172.21.15.146:0/2906481295 conn(0x7fd6880a2980 msgr2=0x7fd68809b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.610+0000 7fd690625700 1 -- 172.21.15.146:0/2906481295 shutdown_connections 2023-10-03T10:18:10.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.610+0000 7fd690625700 1 -- 172.21.15.146:0/2906481295 wait complete. 2023-10-03T10:18:10.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:10.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.673+0000 7f1614e27700 1 -- 172.21.15.146:0/1596536616 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f161004f2a0 con 0x7f16100a0a70 2023-10-03T10:18:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.673+0000 7f15feffd700 1 -- 172.21.15.146:0/1596536616 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1600017020 con 0x7f16100a0a70 2023-10-03T10:18:10.673 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:10.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.675+0000 7f1614e27700 1 -- 172.21.15.146:0/1596536616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16100a0a70 msgr2=0x7f1610122750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.675+0000 7f1614e27700 1 --2- 172.21.15.146:0/1596536616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16100a0a70 0x7f1610122750 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f160000e9b0 tx=0x7f160000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.675+0000 7f1614e27700 1 -- 172.21.15.146:0/1596536616 shutdown_connections 2023-10-03T10:18:10.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.675+0000 7f1614e27700 1 --2- 172.21.15.146:0/1596536616 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1610134120 0x7f16101231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.675+0000 7f1614e27700 1 --2- 172.21.15.146:0/1596536616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16100a0a70 0x7f1610122750 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.675+0000 7f1614e27700 1 --2- 172.21.15.146:0/1596536616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16100a1380 0x7f1610122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.675+0000 7f1614e27700 1 -- 172.21.15.146:0/1596536616 >> 172.21.15.146:0/1596536616 conn(0x7f16100a6610 msgr2=0x7f161011c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.675+0000 7f1614e27700 1 -- 172.21.15.146:0/1596536616 shutdown_connections 2023-10-03T10:18:10.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.675+0000 7f1614e27700 1 -- 172.21.15.146:0/1596536616 wait complete. 2023-10-03T10:18:10.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:10.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.713+0000 7f08453af700 1 -- 172.21.15.146:0/3381132907 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0840120bb0 con 0x7f08400a1550 2023-10-03T10:18:10.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.713+0000 7f08277fe700 1 -- 172.21.15.146:0/3381132907 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0834015020 con 0x7f08400a1550 2023-10-03T10:18:10.713 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:10.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.716+0000 7f08453af700 1 -- 172.21.15.146:0/3381132907 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08400a1550 msgr2=0x7f084011ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.716+0000 7f08453af700 1 --2- 172.21.15.146:0/3381132907 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08400a1550 0x7f084011ecf0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0834009840 tx=0x7f0834004750 comp rx=0 tx=0).stop 2023-10-03T10:18:10.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.716+0000 7f08453af700 1 -- 172.21.15.146:0/3381132907 shutdown_connections 2023-10-03T10:18:10.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.716+0000 7f08453af700 1 --2- 172.21.15.146:0/3381132907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0840139200 0x7f084011f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.716+0000 7f08453af700 1 --2- 172.21.15.146:0/3381132907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08400a0a70 0x7f084011e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.716+0000 7f08453af700 1 --2- 172.21.15.146:0/3381132907 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08400a1550 0x7f084011ecf0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.716+0000 7f08453af700 1 -- 172.21.15.146:0/3381132907 >> 172.21.15.146:0/3381132907 conn(0x7f08400a6610 msgr2=0x7f08400a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.716+0000 7f08453af700 1 -- 172.21.15.146:0/3381132907 shutdown_connections 2023-10-03T10:18:10.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:10.716+0000 7f08453af700 1 -- 172.21.15.146:0/3381132907 wait complete. 2023-10-03T10:18:10.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:11.299 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:11.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.422+0000 7f2f6a143700 1 Processor -- start 2023-10-03T10:18:11.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.422+0000 7f2f6a143700 1 -- start start 2023-10-03T10:18:11.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.423+0000 7f2f6a143700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f640a0a30 0x7f2f640a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.423+0000 7f2f6a143700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2f640a1340 0x7f2f6412ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.423+0000 7f2f6a143700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f640a1e70 con 0x7f2f641304a0 2023-10-03T10:18:11.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.423+0000 7f2f6a143700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6409a720 con 0x7f2f640a1340 2023-10-03T10:18:11.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.423+0000 7f2f6a143700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6409b300 con 0x7f2f640a0a30 2023-10-03T10:18:11.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.423+0000 7f2f62ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2f640a1340 0x7f2f6412ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.423+0000 7f2f637fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f640a0a30 0x7f2f640a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.423+0000 7f2f63fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2f641304a0 0x7f2f641371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49826/0 (socket says 172.21.15.146:49826) 2023-10-03T10:18:11.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.423+0000 7f2f62ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2f640a1340 0x7f2f6412ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34058/0 (socket says 172.21.15.146:34058) 2023-10-03T10:18:11.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.423+0000 7f2f63fff700 1 -- 172.21.15.146:0/3334938775 learned_addr learned my addr 172.21.15.146:0/3334938775 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:11.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.423+0000 7f2f627fc700 1 -- 172.21.15.146:0/3334938775 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129984565 0 0) 0x7f2f640a1e70 con 0x7f2f641304a0 2023-10-03T10:18:11.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.423+0000 7f2f627fc700 1 -- 172.21.15.146:0/3334938775 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f4c0035b0 con 0x7f2f641304a0 2023-10-03T10:18:11.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.423+0000 7f2f637fe700 1 -- 172.21.15.146:0/3334938775 >> v2:172.21.15.146:3300/0 conn(0x7f2f640a1340 msgr2=0x7f2f6412ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:11.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.423+0000 7f2f637fe700 1 --2- 172.21.15.146:0/3334938775 >> v2:172.21.15.146:3300/0 conn(0x7f2f640a1340 0x7f2f6412ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.423+0000 7f2f637fe700 1 -- 172.21.15.146:0/3334938775 >> v1:172.21.15.146:6789/0 conn(0x7f2f641304a0 legacy=0x7f2f641371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.423+0000 7f2f637fe700 1 -- 172.21.15.146:0/3334938775 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6409abc0 con 0x7f2f640a0a30 2023-10-03T10:18:11.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.423+0000 7f2f637fe700 1 --2- 172.21.15.146:0/3334938775 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f640a0a30 0x7f2f640a0e00 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f2f58009820 tx=0x7f2f58009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d8f992686e25f32 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.423+0000 7f2f627fc700 1 -- 172.21.15.146:0/3334938775 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f58005e30 con 0x7f2f640a0a30 2023-10-03T10:18:11.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.424+0000 7f2f627fc700 1 -- 172.21.15.146:0/3334938775 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f58006030 con 0x7f2f640a0a30 2023-10-03T10:18:11.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.424+0000 7f2f627fc700 1 -- 172.21.15.146:0/3334938775 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f580063c0 con 0x7f2f640a0a30 2023-10-03T10:18:11.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.424+0000 7f2f6a143700 1 -- 172.21.15.146:0/3334938775 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f640a0a30 msgr2=0x7f2f640a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.424+0000 7f2f6a143700 1 --2- 172.21.15.146:0/3334938775 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f640a0a30 0x7f2f640a0e00 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f2f58009820 tx=0x7f2f58009b30 comp rx=0 tx=0).stop 2023-10-03T10:18:11.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.424+0000 7f2f6a143700 1 -- 172.21.15.146:0/3334938775 shutdown_connections 2023-10-03T10:18:11.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.424+0000 7f2f6a143700 1 --2- 172.21.15.146:0/3334938775 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f640a0a30 0x7f2f640a0e00 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.424+0000 7f2f6a143700 1 --2- 172.21.15.146:0/3334938775 >> v2:172.21.15.146:3300/0 conn(0x7f2f640a1340 0x7f2f6412ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.424+0000 7f2f6a143700 1 -- 172.21.15.146:0/3334938775 >> 172.21.15.146:0/3334938775 conn(0x7f2f640a2980 msgr2=0x7f2f640a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.424+0000 7f2f6a143700 1 -- 172.21.15.146:0/3334938775 shutdown_connections 2023-10-03T10:18:11.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.424+0000 7f2f6a143700 1 -- 172.21.15.146:0/3334938775 wait complete. 2023-10-03T10:18:11.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.425+0000 7f2f6a143700 1 Processor -- start 2023-10-03T10:18:11.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.425+0000 7f2f6a143700 1 -- start start 2023-10-03T10:18:11.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f6a143700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f640a0a30 0x7f2f641c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f6a143700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f640a1340 0x7f2f641c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f6a143700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f641304a0 0x7f2f641c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f6a143700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f64136ac0 con 0x7f2f641304a0 2023-10-03T10:18:11.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f6a143700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f64138020 con 0x7f2f640a1340 2023-10-03T10:18:11.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f6a143700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6409f940 con 0x7f2f640a0a30 2023-10-03T10:18:11.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f62ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f640a1340 0x7f2f641c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f637fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f640a0a30 0x7f2f641c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f62ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f640a1340 0x7f2f641c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60670/0 (socket says 172.21.15.146:60670) 2023-10-03T10:18:11.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f637fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f640a0a30 0x7f2f641c52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43488/0 (socket says 172.21.15.146:43488) 2023-10-03T10:18:11.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f62ffd700 1 -- 172.21.15.146:0/3215152557 learned_addr learned my addr 172.21.15.146:0/3215152557 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:11.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f63fff700 1 --2- 172.21.15.146:0/3215152557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f641304a0 0x7f2f641c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f637fe700 1 -- 172.21.15.146:0/3215152557 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f640a1340 msgr2=0x7f2f641c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f637fe700 1 --2- 172.21.15.146:0/3215152557 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f640a1340 0x7f2f641c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f637fe700 1 -- 172.21.15.146:0/3215152557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f641304a0 msgr2=0x7f2f641c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f637fe700 1 --2- 172.21.15.146:0/3215152557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f641304a0 0x7f2f641c1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f637fe700 1 -- 172.21.15.146:0/3215152557 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f58009430 con 0x7f2f640a0a30 2023-10-03T10:18:11.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f62ffd700 1 --2- 172.21.15.146:0/3215152557 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f640a1340 0x7f2f641c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:11.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f63fff700 1 --2- 172.21.15.146:0/3215152557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f641304a0 0x7f2f641c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:11.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f637fe700 1 --2- 172.21.15.146:0/3215152557 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f640a0a30 0x7f2f641c52d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f2f58009820 tx=0x7f2f58004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f4bfff700 1 -- 172.21.15.146:0/3215152557 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f580061a0 con 0x7f2f640a0a30 2023-10-03T10:18:11.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f4bfff700 1 -- 172.21.15.146:0/3215152557 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f58020070 con 0x7f2f640a0a30 2023-10-03T10:18:11.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f6a143700 1 -- 172.21.15.146:0/3215152557 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f64137710 con 0x7f2f640a0a30 2023-10-03T10:18:11.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f4bfff700 1 -- 172.21.15.146:0/3215152557 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f58006560 con 0x7f2f640a0a30 2023-10-03T10:18:11.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.426+0000 7f2f6a143700 1 -- 172.21.15.146:0/3215152557 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f64137190 con 0x7f2f640a0a30 2023-10-03T10:18:11.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.427+0000 7f2f4bfff700 1 -- 172.21.15.146:0/3215152557 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f58022030 con 0x7f2f640a0a30 2023-10-03T10:18:11.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.427+0000 7f2f6a143700 1 -- 172.21.15.146:0/3215152557 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f64137380 con 0x7f2f640a0a30 2023-10-03T10:18:11.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.427+0000 7f2f4bfff700 1 -- 172.21.15.146:0/3215152557 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2f58040ae0 con 0x7f2f640a0a30 2023-10-03T10:18:11.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.432+0000 7f2f4bfff700 1 -- 172.21.15.146:0/3215152557 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f58019590 con 0x7f2f640a0a30 2023-10-03T10:18:11.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.616+0000 7f2f6a143700 1 -- 172.21.15.146:0/3215152557 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2f6404f2a0 con 0x7f2f640a0a30 2023-10-03T10:18:11.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.616+0000 7f2f4bfff700 1 -- 172.21.15.146:0/3215152557 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f5801b410 con 0x7f2f640a0a30 2023-10-03T10:18:11.616 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:11.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.618+0000 7f2f6a143700 1 -- 172.21.15.146:0/3215152557 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f640a0a30 msgr2=0x7f2f641c52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.618+0000 7f2f6a143700 1 --2- 172.21.15.146:0/3215152557 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f640a0a30 0x7f2f641c52d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f2f58009820 tx=0x7f2f58004750 comp rx=0 tx=0).stop 2023-10-03T10:18:11.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.618+0000 7f2f6a143700 1 -- 172.21.15.146:0/3215152557 shutdown_connections 2023-10-03T10:18:11.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.618+0000 7f2f6a143700 1 --2- 172.21.15.146:0/3215152557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f641304a0 0x7f2f641c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.618+0000 7f2f6a143700 1 --2- 172.21.15.146:0/3215152557 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f640a0a30 0x7f2f641c52d0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.618+0000 7f2f6a143700 1 --2- 172.21.15.146:0/3215152557 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f640a1340 0x7f2f641c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.618+0000 7f2f6a143700 1 -- 172.21.15.146:0/3215152557 >> 172.21.15.146:0/3215152557 conn(0x7f2f640a2980 msgr2=0x7f2f640a2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.618+0000 7f2f6a143700 1 -- 172.21.15.146:0/3215152557 shutdown_connections 2023-10-03T10:18:11.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.618+0000 7f2f6a143700 1 -- 172.21.15.146:0/3215152557 wait complete. 2023-10-03T10:18:11.622 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:11.631 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:11.687 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:11.728 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:11.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.751+0000 7fdb7ffab700 1 Processor -- start 2023-10-03T10:18:11.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.751+0000 7fdb7ffab700 1 -- start start 2023-10-03T10:18:11.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.752+0000 7fdb7ffab700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdb78099e20 0x7fdb7809a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.752+0000 7fdb7ffab700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb7809a730 0x7fdb78130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.752+0000 7fdb7ffab700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb78130890 0x7fdb78130ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.752+0000 7fdb7ffab700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb7809bf50 con 0x7fdb78099e20 2023-10-03T10:18:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.752+0000 7fdb7ffab700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb78131220 con 0x7fdb7809a730 2023-10-03T10:18:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.752+0000 7fdb7ffab700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb78099a60 con 0x7fdb78130890 2023-10-03T10:18:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.752+0000 7fdb7d546700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb7809a730 0x7fdb78130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.752+0000 7fdb7d546700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb7809a730 0x7fdb78130350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60674/0 (socket says 172.21.15.146:60674) 2023-10-03T10:18:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.752+0000 7fdb7d546700 1 -- 172.21.15.146:0/1267217878 learned_addr learned my addr 172.21.15.146:0/1267217878 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.752+0000 7fdb7dd47700 1 --2- 172.21.15.146:0/1267217878 >> v2:172.21.15.146:3300/0 conn(0x7fdb78099e20 0x7fdb7809a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.752+0000 7fdb7d546700 1 -- 172.21.15.146:0/1267217878 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb78130890 msgr2=0x7fdb78130ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.752+0000 7fdb7d546700 1 --2- 172.21.15.146:0/1267217878 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb78130890 0x7fdb78130ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.752+0000 7fdb7d546700 1 -- 172.21.15.146:0/1267217878 >> v2:172.21.15.146:3300/0 conn(0x7fdb78099e20 msgr2=0x7fdb7809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.752+0000 7fdb7d546700 1 --2- 172.21.15.146:0/1267217878 >> v2:172.21.15.146:3300/0 conn(0x7fdb78099e20 0x7fdb7809a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.752+0000 7fdb7d546700 1 -- 172.21.15.146:0/1267217878 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7809b230 con 0x7fdb7809a730 2023-10-03T10:18:11.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.752+0000 7fdb7dd47700 1 --2- 172.21.15.146:0/1267217878 >> v2:172.21.15.146:3300/0 conn(0x7fdb78099e20 0x7fdb7809a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:11.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.752+0000 7fdb7d546700 1 --2- 172.21.15.146:0/1267217878 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb7809a730 0x7fdb78130350 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800bbc0 tx=0x7fdb6800bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6082378088414b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.753+0000 7fdb7cd45700 1 -- 172.21.15.146:0/1267217878 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6800dcf0 con 0x7fdb7809a730 2023-10-03T10:18:11.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.753+0000 7fdb7cd45700 1 -- 172.21.15.146:0/1267217878 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6800de50 con 0x7fdb7809a730 2023-10-03T10:18:11.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.753+0000 7fdb7cd45700 1 -- 172.21.15.146:0/1267217878 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb68010690 con 0x7fdb7809a730 2023-10-03T10:18:11.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.753+0000 7fdb7ffab700 1 -- 172.21.15.146:0/1267217878 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb7809a730 msgr2=0x7fdb78130350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.753+0000 7fdb7ffab700 1 --2- 172.21.15.146:0/1267217878 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb7809a730 0x7fdb78130350 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800bbc0 tx=0x7fdb6800bed0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.753+0000 7fdb7ffab700 1 -- 172.21.15.146:0/1267217878 shutdown_connections 2023-10-03T10:18:11.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.753+0000 7fdb7ffab700 1 --2- 172.21.15.146:0/1267217878 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb78130890 0x7fdb78130ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.753+0000 7fdb7ffab700 1 --2- 172.21.15.146:0/1267217878 >> v2:172.21.15.146:3300/0 conn(0x7fdb78099e20 0x7fdb7809a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.753+0000 7fdb7ffab700 1 --2- 172.21.15.146:0/1267217878 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb7809a730 0x7fdb78130350 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.753+0000 7fdb7ffab700 1 -- 172.21.15.146:0/1267217878 >> 172.21.15.146:0/1267217878 conn(0x7fdb780a2980 msgr2=0x7fdb780a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.754+0000 7fdb7ffab700 1 -- 172.21.15.146:0/1267217878 shutdown_connections 2023-10-03T10:18:11.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.754+0000 7fdb7ffab700 1 -- 172.21.15.146:0/1267217878 wait complete. 2023-10-03T10:18:11.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.755+0000 7fdb7ffab700 1 Processor -- start 2023-10-03T10:18:11.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.755+0000 7fdb7ffab700 1 -- start start 2023-10-03T10:18:11.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.755+0000 7fdb7ffab700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb78099e20 0x7fdb7811ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.755+0000 7fdb7ffab700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb7809a730 0x7fdb7811bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.755+0000 7fdb7ffab700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb78130890 0x7fdb7811c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.755+0000 7fdb7ffab700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7811df40 con 0x7fdb78130890 2023-10-03T10:18:11.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.755+0000 7fdb7ffab700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7811f580 con 0x7fdb7809a730 2023-10-03T10:18:11.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.755+0000 7fdb7ffab700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7811dc20 con 0x7fdb78099e20 2023-10-03T10:18:11.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.756+0000 7fdb7d546700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb7809a730 0x7fdb7811bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.756+0000 7fdb7d546700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb7809a730 0x7fdb7811bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60680/0 (socket says 172.21.15.146:60680) 2023-10-03T10:18:11.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.756+0000 7fdb7d546700 1 -- 172.21.15.146:0/3095475462 learned_addr learned my addr 172.21.15.146:0/3095475462 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:11.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.756+0000 7fdb7e548700 1 --2- 172.21.15.146:0/3095475462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb78130890 0x7fdb7811c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.756+0000 7fdb7dd47700 1 --2- 172.21.15.146:0/3095475462 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb78099e20 0x7fdb7811ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.756+0000 7fdb7e548700 1 -- 172.21.15.146:0/3095475462 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb78099e20 msgr2=0x7fdb7811ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.756+0000 7fdb7e548700 1 --2- 172.21.15.146:0/3095475462 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb78099e20 0x7fdb7811ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.756+0000 7fdb7e548700 1 -- 172.21.15.146:0/3095475462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb7809a730 msgr2=0x7fdb7811bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.756+0000 7fdb7e548700 1 --2- 172.21.15.146:0/3095475462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb7809a730 0x7fdb7811bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.756+0000 7fdb7e548700 1 -- 172.21.15.146:0/3095475462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb74009430 con 0x7fdb78130890 2023-10-03T10:18:11.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.756+0000 7fdb7d546700 1 --2- 172.21.15.146:0/3095475462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb7809a730 0x7fdb7811bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:11.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.756+0000 7fdb7e548700 1 --2- 172.21.15.146:0/3095475462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb78130890 0x7fdb7811c4e0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fdb70009ed0 tx=0x7fdb70009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.756+0000 7fdb6e7fc700 1 -- 172.21.15.146:0/3095475462 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70018440 con 0x7fdb78130890 2023-10-03T10:18:11.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.756+0000 7fdb6e7fc700 1 -- 172.21.15.146:0/3095475462 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb700185c0 con 0x7fdb78130890 2023-10-03T10:18:11.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.756+0000 7fdb7ffab700 1 -- 172.21.15.146:0/3095475462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6800b7f0 con 0x7fdb78130890 2023-10-03T10:18:11.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.756+0000 7fdb6e7fc700 1 -- 172.21.15.146:0/3095475462 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70018970 con 0x7fdb78130890 2023-10-03T10:18:11.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.756+0000 7fdb7ffab700 1 -- 172.21.15.146:0/3095475462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7811efe0 con 0x7fdb78130890 2023-10-03T10:18:11.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.757+0000 7fdb7ffab700 1 -- 172.21.15.146:0/3095475462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb78071740 con 0x7fdb78130890 2023-10-03T10:18:11.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.758+0000 7fdb6e7fc700 1 -- 172.21.15.146:0/3095475462 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb700213b0 con 0x7fdb78130890 2023-10-03T10:18:11.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.758+0000 7fdb6e7fc700 1 -- 172.21.15.146:0/3095475462 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdb70006e40 con 0x7fdb78130890 2023-10-03T10:18:11.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.762+0000 7fdb6e7fc700 1 -- 172.21.15.146:0/3095475462 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb70020360 con 0x7fdb78130890 2023-10-03T10:18:11.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.825+0000 7f0034c39700 1 Processor -- start 2023-10-03T10:18:11.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.825+0000 7f0034c39700 1 -- start start 2023-10-03T10:18:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.825+0000 7f0034c39700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0030133b80 0x7f0030133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.825+0000 7f0034c39700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f00300a0ff0 0x7f003013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.826+0000 7f0034c39700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003009aa00 con 0x7f0030099a60 2023-10-03T10:18:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.826+0000 7f0034c39700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f003009a080 con 0x7f0030133b80 2023-10-03T10:18:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.826+0000 7f0034c39700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0030133750 con 0x7f00300a0ff0 2023-10-03T10:18:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.826+0000 7f002ed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f00300a0ff0 0x7f003013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.826+0000 7f002e59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0030133b80 0x7f0030133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.826+0000 7f002dd9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0030099a60 0x7f00300a08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49830/0 (socket says 172.21.15.146:49830) 2023-10-03T10:18:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.826+0000 7f002ed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f00300a0ff0 0x7f003013b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43510/0 (socket says 172.21.15.146:43510) 2023-10-03T10:18:11.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.826+0000 7f002dd9b700 1 -- 172.21.15.146:0/3291445440 learned_addr learned my addr 172.21.15.146:0/3291445440 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.826+0000 7f002e59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0030133b80 0x7f0030133f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34070/0 (socket says 172.21.15.146:34070) 2023-10-03T10:18:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.826+0000 7f002e59c700 1 -- 172.21.15.146:0/3291445440 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f00300a0ff0 msgr2=0x7f003013b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.826+0000 7f002e59c700 1 --2- 172.21.15.146:0/3291445440 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f00300a0ff0 0x7f003013b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.826+0000 7f002e59c700 1 -- 172.21.15.146:0/3291445440 >> v1:172.21.15.146:6789/0 conn(0x7f0030099a60 legacy=0x7f00300a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.826+0000 7f002e59c700 1 -- 172.21.15.146:0/3291445440 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003009a760 con 0x7f0030133b80 2023-10-03T10:18:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.826+0000 7f002d59a700 1 -- 172.21.15.146:0/3291445440 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999645774 0 0) 0x7f003009aa00 con 0x7f0030099a60 2023-10-03T10:18:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.826+0000 7f002ed9d700 1 --2- 172.21.15.146:0/3291445440 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f00300a0ff0 0x7f003013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.826+0000 7f002e59c700 1 --2- 172.21.15.146:0/3291445440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0030133b80 0x7f0030133f50 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f0020009820 tx=0x7f0020009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a4975aa309ba73 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.826+0000 7f002d59a700 1 -- 172.21.15.146:0/3291445440 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020005e30 con 0x7f0030133b80 2023-10-03T10:18:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.826+0000 7f002d59a700 1 -- 172.21.15.146:0/3291445440 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0020006030 con 0x7f0030133b80 2023-10-03T10:18:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.826+0000 7f002d59a700 1 -- 172.21.15.146:0/3291445440 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00200063c0 con 0x7f0030133b80 2023-10-03T10:18:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.827+0000 7f0034c39700 1 -- 172.21.15.146:0/3291445440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0030133b80 msgr2=0x7f0030133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.827+0000 7f0034c39700 1 --2- 172.21.15.146:0/3291445440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0030133b80 0x7f0030133f50 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f0020009820 tx=0x7f0020009b30 comp rx=0 tx=0).stop 2023-10-03T10:18:11.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.827+0000 7f0034c39700 1 -- 172.21.15.146:0/3291445440 shutdown_connections 2023-10-03T10:18:11.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.827+0000 7f0034c39700 1 --2- 172.21.15.146:0/3291445440 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f00300a0ff0 0x7f003013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.827+0000 7f0034c39700 1 --2- 172.21.15.146:0/3291445440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0030133b80 0x7f0030133f50 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.827+0000 7f0034c39700 1 -- 172.21.15.146:0/3291445440 >> 172.21.15.146:0/3291445440 conn(0x7f00300a2980 msgr2=0x7f00300a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.827+0000 7f0034c39700 1 -- 172.21.15.146:0/3291445440 shutdown_connections 2023-10-03T10:18:11.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.827+0000 7f0034c39700 1 -- 172.21.15.146:0/3291445440 wait complete. 2023-10-03T10:18:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.828+0000 7f0034c39700 1 Processor -- start 2023-10-03T10:18:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.828+0000 7f0034c39700 1 -- start start 2023-10-03T10:18:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.829+0000 7f0034c39700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0030099a60 0x7f003011a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.829+0000 7f0034c39700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00300a0ff0 0x7f003011abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.829+0000 7f0034c39700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0030133b80 0x7f003011b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.829+0000 7f0034c39700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003011c8e0 con 0x7f00300a0ff0 2023-10-03T10:18:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.829+0000 7f0034c39700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003011d5a0 con 0x7f0030133b80 2023-10-03T10:18:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.829+0000 7f0034c39700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f003009c210 con 0x7f0030099a60 2023-10-03T10:18:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.829+0000 7f002e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0030099a60 0x7f003011a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.829+0000 7f002ed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0030133b80 0x7f003011b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.829+0000 7f002dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00300a0ff0 0x7f003011abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.829+0000 7f002e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0030099a60 0x7f003011a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43524/0 (socket says 172.21.15.146:43524) 2023-10-03T10:18:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.829+0000 7f002e59c700 1 -- 172.21.15.146:0/3961018714 learned_addr learned my addr 172.21.15.146:0/3961018714 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.829+0000 7f002dd9b700 1 -- 172.21.15.146:0/3961018714 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0030099a60 msgr2=0x7f003011a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.829+0000 7f002dd9b700 1 --2- 172.21.15.146:0/3961018714 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0030099a60 0x7f003011a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.829+0000 7f002dd9b700 1 -- 172.21.15.146:0/3961018714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0030133b80 msgr2=0x7f003011b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.829+0000 7f002dd9b700 1 --2- 172.21.15.146:0/3961018714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0030133b80 0x7f003011b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.829+0000 7f002dd9b700 1 -- 172.21.15.146:0/3961018714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0028009a70 con 0x7f00300a0ff0 2023-10-03T10:18:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.829+0000 7f002ed9d700 1 --2- 172.21.15.146:0/3961018714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0030133b80 0x7f003011b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.829+0000 7f002e59c700 1 --2- 172.21.15.146:0/3961018714 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0030099a60 0x7f003011a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.830+0000 7f002dd9b700 1 --2- 172.21.15.146:0/3961018714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00300a0ff0 0x7f003011abf0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f002400c470 tx=0x7f002400c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.830+0000 7f001effd700 1 -- 172.21.15.146:0/3961018714 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0024004c80 con 0x7f00300a0ff0 2023-10-03T10:18:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.830+0000 7f001effd700 1 -- 172.21.15.146:0/3961018714 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0024004de0 con 0x7f00300a0ff0 2023-10-03T10:18:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.830+0000 7f0034c39700 1 -- 172.21.15.146:0/3961018714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0020009430 con 0x7f00300a0ff0 2023-10-03T10:18:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.830+0000 7f001effd700 1 -- 172.21.15.146:0/3961018714 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0024007310 con 0x7f00300a0ff0 2023-10-03T10:18:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.830+0000 7f0034c39700 1 -- 172.21.15.146:0/3961018714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003009a2c0 con 0x7f00300a0ff0 2023-10-03T10:18:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.831+0000 7f001effd700 1 -- 172.21.15.146:0/3961018714 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0024007470 con 0x7f00300a0ff0 2023-10-03T10:18:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.831+0000 7f0034c39700 1 -- 172.21.15.146:0/3961018714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f003009e9b0 con 0x7f00300a0ff0 2023-10-03T10:18:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.831+0000 7f001effd700 1 -- 172.21.15.146:0/3961018714 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f002403f210 con 0x7f00300a0ff0 2023-10-03T10:18:11.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.835+0000 7f001effd700 1 -- 172.21.15.146:0/3961018714 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0024007720 con 0x7f00300a0ff0 2023-10-03T10:18:11.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.861+0000 7f026ae08700 1 Processor -- start 2023-10-03T10:18:11.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.862+0000 7f026ae08700 1 -- start start 2023-10-03T10:18:11.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.862+0000 7f026ae08700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0264133ad0 0x7f0264133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.862+0000 7f026ae08700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0264130bc0 0x7f026413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.862+0000 7f026ae08700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026406b2d0 con 0x7f02641300a0 2023-10-03T10:18:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.862+0000 7f026ae08700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0264133610 con 0x7f0264130bc0 2023-10-03T10:18:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.862+0000 7f026ae08700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026409a500 con 0x7f0264133ad0 2023-10-03T10:18:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.862+0000 7f0268ba4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0264133ad0 0x7f0264133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.862+0000 7f0268ba4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0264133ad0 0x7f0264133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60698/0 (socket says 172.21.15.146:60698) 2023-10-03T10:18:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.862+0000 7f0268ba4700 1 -- 172.21.15.146:0/387089284 learned_addr learned my addr 172.21.15.146:0/387089284 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.862+0000 7f02693a5700 1 --2- 172.21.15.146:0/387089284 >> v2:172.21.15.146:3300/0 conn(0x7f0264130bc0 0x7f026413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.862+0000 7f0268ba4700 1 -- 172.21.15.146:0/387089284 >> v2:172.21.15.146:3300/0 conn(0x7f0264130bc0 msgr2=0x7f026413b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.862+0000 7f0268ba4700 1 --2- 172.21.15.146:0/387089284 >> v2:172.21.15.146:3300/0 conn(0x7f0264130bc0 0x7f026413b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.862+0000 7f0268ba4700 1 -- 172.21.15.146:0/387089284 >> v1:172.21.15.146:6789/0 conn(0x7f02641300a0 legacy=0x7f02641304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.863+0000 7f02637fe700 1 -- 172.21.15.146:0/387089284 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216970387 0 0) 0x7f026406b2d0 con 0x7f02641300a0 2023-10-03T10:18:11.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.863+0000 7f0268ba4700 1 -- 172.21.15.146:0/387089284 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02641338b0 con 0x7f0264133ad0 2023-10-03T10:18:11.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.863+0000 7f0268ba4700 1 --2- 172.21.15.146:0/387089284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0264133ad0 0x7f0264133ea0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f02580098f0 tx=0x7f0258009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7380892b295a6626 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.863+0000 7f02637fe700 1 -- 172.21.15.146:0/387089284 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258011830 con 0x7f0264133ad0 2023-10-03T10:18:11.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.863+0000 7f02637fe700 1 -- 172.21.15.146:0/387089284 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0258011990 con 0x7f0264133ad0 2023-10-03T10:18:11.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.863+0000 7f02637fe700 1 -- 172.21.15.146:0/387089284 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258011d20 con 0x7f0264133ad0 2023-10-03T10:18:11.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.863+0000 7f026ae08700 1 -- 172.21.15.146:0/387089284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0264133ad0 msgr2=0x7f0264133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.863+0000 7f026ae08700 1 --2- 172.21.15.146:0/387089284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0264133ad0 0x7f0264133ea0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f02580098f0 tx=0x7f0258009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:11.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.863+0000 7f026ae08700 1 -- 172.21.15.146:0/387089284 shutdown_connections 2023-10-03T10:18:11.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.863+0000 7f026ae08700 1 --2- 172.21.15.146:0/387089284 >> v2:172.21.15.146:3300/0 conn(0x7f0264130bc0 0x7f026413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.863+0000 7f026ae08700 1 --2- 172.21.15.146:0/387089284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0264133ad0 0x7f0264133ea0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.863+0000 7f026ae08700 1 -- 172.21.15.146:0/387089284 >> 172.21.15.146:0/387089284 conn(0x7f0264099c40 msgr2=0x7f02640a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.864+0000 7f026ae08700 1 -- 172.21.15.146:0/387089284 shutdown_connections 2023-10-03T10:18:11.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.864+0000 7f026ae08700 1 -- 172.21.15.146:0/387089284 wait complete. 2023-10-03T10:18:11.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.864+0000 7f026ae08700 1 Processor -- start 2023-10-03T10:18:11.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.864+0000 7f026ae08700 1 -- start start 2023-10-03T10:18:11.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.865+0000 7f026ae08700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02641300a0 0x7f026411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.865+0000 7f026ae08700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0264130bc0 0x7f026411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.865+0000 7f026ae08700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0264133ad0 0x7f026411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.865+0000 7f026ae08700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026411f080 con 0x7f0264133ad0 2023-10-03T10:18:11.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.865+0000 7f026ae08700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0264072170 con 0x7f0264130bc0 2023-10-03T10:18:11.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.865+0000 7f026ae08700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0264120190 con 0x7f02641300a0 2023-10-03T10:18:11.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.865+0000 7f0268ba4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02641300a0 0x7f026411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.865+0000 7f02693a5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0264133ad0 0x7f026411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.865+0000 7f0268ba4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02641300a0 0x7f026411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43532/0 (socket says 172.21.15.146:43532) 2023-10-03T10:18:11.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.865+0000 7f02693a5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0264133ad0 0x7f026411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34098/0 (socket says 172.21.15.146:34098) 2023-10-03T10:18:11.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.865+0000 7f0268ba4700 1 -- 172.21.15.146:0/2860868125 learned_addr learned my addr 172.21.15.146:0/2860868125 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:11.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.865+0000 7f0263fff700 1 --2- 172.21.15.146:0/2860868125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0264130bc0 0x7f026411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.865+0000 7f0268ba4700 1 -- 172.21.15.146:0/2860868125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0264130bc0 msgr2=0x7f026411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.865+0000 7f0268ba4700 1 --2- 172.21.15.146:0/2860868125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0264130bc0 0x7f026411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.865+0000 7f0268ba4700 1 -- 172.21.15.146:0/2860868125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0264133ad0 msgr2=0x7f026411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.865+0000 7f0268ba4700 1 --2- 172.21.15.146:0/2860868125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0264133ad0 0x7f026411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.866+0000 7f0268ba4700 1 -- 172.21.15.146:0/2860868125 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0258009550 con 0x7f02641300a0 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.866+0000 7f02693a5700 1 --2- 172.21.15.146:0/2860868125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0264133ad0 0x7f026411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.866+0000 7f0263fff700 1 --2- 172.21.15.146:0/2860868125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0264130bc0 0x7f026411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.866+0000 7f0268ba4700 1 --2- 172.21.15.146:0/2860868125 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02641300a0 0x7f026411da40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0258009c40 tx=0x7f0258004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.866+0000 7f02617fa700 1 -- 172.21.15.146:0/2860868125 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258004510 con 0x7f02641300a0 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.866+0000 7f02617fa700 1 -- 172.21.15.146:0/2860868125 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02580036a0 con 0x7f02641300a0 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.866+0000 7f026ae08700 1 -- 172.21.15.146:0/2860868125 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026411fbf0 con 0x7f02641300a0 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.866+0000 7f02617fa700 1 -- 172.21.15.146:0/2860868125 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258003a50 con 0x7f02641300a0 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.866+0000 7f026ae08700 1 -- 172.21.15.146:0/2860868125 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026412dd00 con 0x7f02641300a0 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.867+0000 7f026ae08700 1 -- 172.21.15.146:0/2860868125 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026411f5d0 con 0x7f02641300a0 2023-10-03T10:18:11.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.867+0000 7f02617fa700 1 -- 172.21.15.146:0/2860868125 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0258021070 con 0x7f02641300a0 2023-10-03T10:18:11.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.867+0000 7f02617fa700 1 -- 172.21.15.146:0/2860868125 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0258040ad0 con 0x7f02641300a0 2023-10-03T10:18:11.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.872+0000 7f02617fa700 1 -- 172.21.15.146:0/2860868125 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0258019770 con 0x7f02641300a0 2023-10-03T10:18:11.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.975+0000 7fdb7ffab700 1 -- 172.21.15.146:0/3095475462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdb7804f2a0 con 0x7fdb78130890 2023-10-03T10:18:11.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.975+0000 7fdb6e7fc700 1 -- 172.21.15.146:0/3095475462 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdb7001d030 con 0x7fdb78130890 2023-10-03T10:18:11.975 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:11.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.977+0000 7fdb7ffab700 1 -- 172.21.15.146:0/3095475462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb78130890 msgr2=0x7fdb7811c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.977+0000 7fdb7ffab700 1 --2- 172.21.15.146:0/3095475462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb78130890 0x7fdb7811c4e0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fdb70009ed0 tx=0x7fdb70009f00 comp rx=0 tx=0).stop 2023-10-03T10:18:11.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.977+0000 7fdb7ffab700 1 -- 172.21.15.146:0/3095475462 shutdown_connections 2023-10-03T10:18:11.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.977+0000 7fdb7ffab700 1 --2- 172.21.15.146:0/3095475462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb78130890 0x7fdb7811c4e0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.977+0000 7fdb7ffab700 1 --2- 172.21.15.146:0/3095475462 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdb78099e20 0x7fdb7811ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.977+0000 7fdb7ffab700 1 --2- 172.21.15.146:0/3095475462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb7809a730 0x7fdb7811bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.977+0000 7fdb7ffab700 1 -- 172.21.15.146:0/3095475462 >> 172.21.15.146:0/3095475462 conn(0x7fdb780a2980 msgr2=0x7fdb7809fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.977+0000 7fdb7ffab700 1 -- 172.21.15.146:0/3095475462 shutdown_connections 2023-10-03T10:18:11.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:11.977+0000 7fdb7ffab700 1 -- 172.21.15.146:0/3095475462 wait complete. 2023-10-03T10:18:11.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:12.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.039+0000 7f0034c39700 1 -- 172.21.15.146:0/3961018714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f003011dd70 con 0x7f00300a0ff0 2023-10-03T10:18:12.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.039+0000 7f001effd700 1 -- 172.21.15.146:0/3961018714 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0024011360 con 0x7f00300a0ff0 2023-10-03T10:18:12.039 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:12.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.042+0000 7f0034c39700 1 -- 172.21.15.146:0/3961018714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00300a0ff0 msgr2=0x7f003011abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.042+0000 7f0034c39700 1 --2- 172.21.15.146:0/3961018714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00300a0ff0 0x7f003011abf0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f002400c470 tx=0x7f002400c780 comp rx=0 tx=0).stop 2023-10-03T10:18:12.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.042+0000 7f0034c39700 1 -- 172.21.15.146:0/3961018714 shutdown_connections 2023-10-03T10:18:12.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.042+0000 7f0034c39700 1 --2- 172.21.15.146:0/3961018714 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0030133b80 0x7f003011b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.042+0000 7f0034c39700 1 --2- 172.21.15.146:0/3961018714 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0030099a60 0x7f003011a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.042+0000 7f0034c39700 1 --2- 172.21.15.146:0/3961018714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00300a0ff0 0x7f003011abf0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.042+0000 7f0034c39700 1 -- 172.21.15.146:0/3961018714 >> 172.21.15.146:0/3961018714 conn(0x7f00300a2980 msgr2=0x7f003012f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.042+0000 7f0034c39700 1 -- 172.21.15.146:0/3961018714 shutdown_connections 2023-10-03T10:18:12.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.042+0000 7f0034c39700 1 -- 172.21.15.146:0/3961018714 wait complete. 2023-10-03T10:18:12.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:12.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.073+0000 7f026ae08700 1 -- 172.21.15.146:0/2860868125 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f026404f2a0 con 0x7f02641300a0 2023-10-03T10:18:12.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.073+0000 7f02617fa700 1 -- 172.21.15.146:0/2860868125 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0258029030 con 0x7f02641300a0 2023-10-03T10:18:12.073 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:12.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.075+0000 7f026ae08700 1 -- 172.21.15.146:0/2860868125 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02641300a0 msgr2=0x7f026411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.075+0000 7f026ae08700 1 --2- 172.21.15.146:0/2860868125 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02641300a0 0x7f026411da40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0258009c40 tx=0x7f0258004750 comp rx=0 tx=0).stop 2023-10-03T10:18:12.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.075+0000 7f026ae08700 1 -- 172.21.15.146:0/2860868125 shutdown_connections 2023-10-03T10:18:12.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.075+0000 7f026ae08700 1 --2- 172.21.15.146:0/2860868125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0264133ad0 0x7f026411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.075+0000 7f026ae08700 1 --2- 172.21.15.146:0/2860868125 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02641300a0 0x7f026411da40 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.075+0000 7f026ae08700 1 --2- 172.21.15.146:0/2860868125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0264130bc0 0x7f026411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.075+0000 7f026ae08700 1 -- 172.21.15.146:0/2860868125 >> 172.21.15.146:0/2860868125 conn(0x7f0264099c40 msgr2=0x7f0264132a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.075+0000 7f026ae08700 1 -- 172.21.15.146:0/2860868125 shutdown_connections 2023-10-03T10:18:12.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.075+0000 7f026ae08700 1 -- 172.21.15.146:0/2860868125 wait complete. 2023-10-03T10:18:12.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:12.632 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:12.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.756+0000 7f86c9653700 1 Processor -- start 2023-10-03T10:18:12.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.757+0000 7f86c9653700 1 -- start start 2023-10-03T10:18:12.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.757+0000 7f86c9653700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f86c41309f0 0x7f86c4130dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.757+0000 7f86c9653700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f86c409d8f0 0x7f86c409dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.757+0000 7f86c9653700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86c409e280 0x7f86c4137750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.757+0000 7f86c9653700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c409c1f0 con 0x7f86c409d8f0 2023-10-03T10:18:12.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.757+0000 7f86c9653700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c409b1f0 con 0x7f86c409e280 2023-10-03T10:18:12.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.757+0000 7f86c9653700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86c4131300 con 0x7f86c41309f0 2023-10-03T10:18:12.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.757+0000 7f86c2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f86c41309f0 0x7f86c4130dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.757+0000 7f86c27fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f86c409d8f0 0x7f86c409dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.757+0000 7f86c37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86c409e280 0x7f86c4137750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.757+0000 7f86c27fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f86c409d8f0 0x7f86c409dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34100/0 (socket says 172.21.15.146:34100) 2023-10-03T10:18:12.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.757+0000 7f86c2ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f86c41309f0 0x7f86c4130dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:43544/0 (socket says 172.21.15.146:43544) 2023-10-03T10:18:12.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.757+0000 7f86c27fc700 1 -- 172.21.15.146:0/1906656524 learned_addr learned my addr 172.21.15.146:0/1906656524 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:12.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.757+0000 7f86c37fe700 1 -- 172.21.15.146:0/1906656524 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f86c41309f0 msgr2=0x7f86c4130dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:12.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.757+0000 7f86c37fe700 1 --2- 172.21.15.146:0/1906656524 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f86c41309f0 0x7f86c4130dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.757+0000 7f86c37fe700 1 -- 172.21.15.146:0/1906656524 >> v2:172.21.15.146:3300/0 conn(0x7f86c409d8f0 msgr2=0x7f86c409dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:12.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.757+0000 7f86c37fe700 1 --2- 172.21.15.146:0/1906656524 >> v2:172.21.15.146:3300/0 conn(0x7f86c409d8f0 0x7f86c409dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.757+0000 7f86c37fe700 1 -- 172.21.15.146:0/1906656524 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c409e6f0 con 0x7f86c409e280 2023-10-03T10:18:12.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.757+0000 7f86c27fc700 1 --2- 172.21.15.146:0/1906656524 >> v2:172.21.15.146:3300/0 conn(0x7f86c409d8f0 0x7f86c409dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:12.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.758+0000 7f86c37fe700 1 --2- 172.21.15.146:0/1906656524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86c409e280 0x7f86c4137750 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009d90 tx=0x7f86bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca8bb93f0c322976 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.758+0000 7f86c1ffb700 1 -- 172.21.15.146:0/1906656524 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc00e070 con 0x7f86c409e280 2023-10-03T10:18:12.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.758+0000 7f86c1ffb700 1 -- 172.21.15.146:0/1906656524 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc00bb20 con 0x7f86c409e280 2023-10-03T10:18:12.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.758+0000 7f86c1ffb700 1 -- 172.21.15.146:0/1906656524 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc012430 con 0x7f86c409e280 2023-10-03T10:18:12.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.758+0000 7f86c9653700 1 -- 172.21.15.146:0/1906656524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86c409e280 msgr2=0x7f86c4137750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.758+0000 7f86c9653700 1 --2- 172.21.15.146:0/1906656524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86c409e280 0x7f86c4137750 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009d90 tx=0x7f86bc00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:12.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.758+0000 7f86c9653700 1 -- 172.21.15.146:0/1906656524 shutdown_connections 2023-10-03T10:18:12.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.758+0000 7f86c9653700 1 --2- 172.21.15.146:0/1906656524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86c409e280 0x7f86c4137750 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.758+0000 7f86c9653700 1 --2- 172.21.15.146:0/1906656524 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f86c41309f0 0x7f86c4130dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.758+0000 7f86c9653700 1 --2- 172.21.15.146:0/1906656524 >> v2:172.21.15.146:3300/0 conn(0x7f86c409d8f0 0x7f86c409dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.758+0000 7f86c9653700 1 -- 172.21.15.146:0/1906656524 >> 172.21.15.146:0/1906656524 conn(0x7f86c40a2b30 msgr2=0x7f86c409e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.758+0000 7f86c9653700 1 -- 172.21.15.146:0/1906656524 shutdown_connections 2023-10-03T10:18:12.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.758+0000 7f86c9653700 1 -- 172.21.15.146:0/1906656524 wait complete. 2023-10-03T10:18:12.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.760+0000 7f86c9653700 1 Processor -- start 2023-10-03T10:18:12.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.760+0000 7f86c9653700 1 -- start start 2023-10-03T10:18:12.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.760+0000 7f86c9653700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86c409d8f0 0x7f86c412ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.760+0000 7f86c9653700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86c409e280 0x7f86c412d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.760+0000 7f86c9653700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f86c41309f0 0x7f86c412d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.761+0000 7f86c9653700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c408c570 con 0x7f86c409d8f0 2023-10-03T10:18:12.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.761+0000 7f86c2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86c409d8f0 0x7f86c412ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.761+0000 7f86c2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86c409d8f0 0x7f86c412ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34108/0 (socket says 172.21.15.146:34108) 2023-10-03T10:18:12.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.761+0000 7f86c2ffd700 1 -- 172.21.15.146:0/1762275683 learned_addr learned my addr 172.21.15.146:0/1762275683 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:12.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.761+0000 7f86c27fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86c409e280 0x7f86c412d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.761+0000 7f86c9653700 1 -- 172.21.15.146:0/1762275683 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c408c750 con 0x7f86c409e280 2023-10-03T10:18:12.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.761+0000 7f86c9653700 1 -- 172.21.15.146:0/1762275683 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86c409d230 con 0x7f86c41309f0 2023-10-03T10:18:12.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.761+0000 7f86c37fe700 1 --2- 172.21.15.146:0/1762275683 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f86c41309f0 0x7f86c412d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.761+0000 7f86c2ffd700 1 -- 172.21.15.146:0/1762275683 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f86c41309f0 msgr2=0x7f86c412d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.761+0000 7f86c2ffd700 1 --2- 172.21.15.146:0/1762275683 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f86c41309f0 0x7f86c412d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.761+0000 7f86c2ffd700 1 -- 172.21.15.146:0/1762275683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86c409e280 msgr2=0x7f86c412d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.761+0000 7f86c2ffd700 1 --2- 172.21.15.146:0/1762275683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86c409e280 0x7f86c412d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.761+0000 7f86c2ffd700 1 -- 172.21.15.146:0/1762275683 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b4009550 con 0x7f86c409d8f0 2023-10-03T10:18:12.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.761+0000 7f86c2ffd700 1 --2- 172.21.15.146:0/1762275683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86c409d8f0 0x7f86c412ced0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00e990 tx=0x7f86ac00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.761+0000 7f86bb7fe700 1 -- 172.21.15.146:0/1762275683 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac0096f0 con 0x7f86c409d8f0 2023-10-03T10:18:12.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.761+0000 7f86bb7fe700 1 -- 172.21.15.146:0/1762275683 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ac00c690 con 0x7f86c409d8f0 2023-10-03T10:18:12.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.761+0000 7f86c9653700 1 -- 172.21.15.146:0/1762275683 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86bc009a70 con 0x7f86c409d8f0 2023-10-03T10:18:12.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.761+0000 7f86bb7fe700 1 -- 172.21.15.146:0/1762275683 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac00ca00 con 0x7f86c409d8f0 2023-10-03T10:18:12.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.761+0000 7f86c9653700 1 -- 172.21.15.146:0/1762275683 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c4099e20 con 0x7f86c409d8f0 2023-10-03T10:18:12.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.762+0000 7f86bb7fe700 1 -- 172.21.15.146:0/1762275683 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f86ac00cb60 con 0x7f86c409d8f0 2023-10-03T10:18:12.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.762+0000 7f86c9653700 1 -- 172.21.15.146:0/1762275683 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c409b490 con 0x7f86c409d8f0 2023-10-03T10:18:12.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.762+0000 7f86bb7fe700 1 -- 172.21.15.146:0/1762275683 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f86ac03fac0 con 0x7f86c409d8f0 2023-10-03T10:18:12.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.767+0000 7f86bb7fe700 1 -- 172.21.15.146:0/1762275683 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86ac017020 con 0x7f86c409d8f0 2023-10-03T10:18:12.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.954+0000 7f86c9653700 1 -- 172.21.15.146:0/1762275683 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f86c404f2a0 con 0x7f86c409d8f0 2023-10-03T10:18:12.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.954+0000 7f86bb7fe700 1 -- 172.21.15.146:0/1762275683 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f86ac021020 con 0x7f86c409d8f0 2023-10-03T10:18:12.954 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:12.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.956+0000 7f86c9653700 1 -- 172.21.15.146:0/1762275683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86c409d8f0 msgr2=0x7f86c412ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.956+0000 7f86c9653700 1 --2- 172.21.15.146:0/1762275683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86c409d8f0 0x7f86c412ced0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00e990 tx=0x7f86ac00eca0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.956+0000 7f86c9653700 1 -- 172.21.15.146:0/1762275683 shutdown_connections 2023-10-03T10:18:12.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.956+0000 7f86c9653700 1 --2- 172.21.15.146:0/1762275683 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f86c41309f0 0x7f86c412d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.956+0000 7f86c9653700 1 --2- 172.21.15.146:0/1762275683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86c409d8f0 0x7f86c412ced0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.956+0000 7f86c9653700 1 --2- 172.21.15.146:0/1762275683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86c409e280 0x7f86c412d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.956+0000 7f86c9653700 1 -- 172.21.15.146:0/1762275683 >> 172.21.15.146:0/1762275683 conn(0x7f86c40a2b30 msgr2=0x7f86c40a0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.956+0000 7f86c9653700 1 -- 172.21.15.146:0/1762275683 shutdown_connections 2023-10-03T10:18:12.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:12.956+0000 7f86c9653700 1 -- 172.21.15.146:0/1762275683 wait complete. 2023-10-03T10:18:12.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:12.990 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:13.055 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:13.087 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:13.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.116+0000 7f88f9570700 1 Processor -- start 2023-10-03T10:18:13.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.117+0000 7f88f9570700 1 -- start start 2023-10-03T10:18:13.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.117+0000 7f88f9570700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88f4132100 0x7f88f41367d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.117+0000 7f88f9570700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f88f41314b0 0x7f88f4138d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.117+0000 7f88f9570700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f40a0f20 con 0x7f88f4066410 2023-10-03T10:18:13.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.117+0000 7f88f9570700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f40667e0 con 0x7f88f41314b0 2023-10-03T10:18:13.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.117+0000 7f88f9570700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f40a23c0 con 0x7f88f4132100 2023-10-03T10:18:13.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.117+0000 7f88f27fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88f4132100 0x7f88f41367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.118+0000 7f88f27fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88f4132100 0x7f88f41367d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60752/0 (socket says 172.21.15.146:60752) 2023-10-03T10:18:13.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.118+0000 7f88f27fc700 1 -- 172.21.15.146:0/3136222481 learned_addr learned my addr 172.21.15.146:0/3136222481 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:13.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.118+0000 7f88f37fe700 1 --2- 172.21.15.146:0/3136222481 >> v2:172.21.15.146:3300/0 conn(0x7f88f41314b0 0x7f88f4138d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.118+0000 7f88f27fc700 1 -- 172.21.15.146:0/3136222481 >> v2:172.21.15.146:3300/0 conn(0x7f88f41314b0 msgr2=0x7f88f4138d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:13.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.118+0000 7f88f27fc700 1 --2- 172.21.15.146:0/3136222481 >> v2:172.21.15.146:3300/0 conn(0x7f88f41314b0 0x7f88f4138d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.118+0000 7f88f27fc700 1 -- 172.21.15.146:0/3136222481 >> v1:172.21.15.146:6789/0 conn(0x7f88f4066410 legacy=0x7f88f41319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.118+0000 7f88f27fc700 1 -- 172.21.15.146:0/3136222481 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f40a16e0 con 0x7f88f4132100 2023-10-03T10:18:13.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.118+0000 7f88f27fc700 1 --2- 172.21.15.146:0/3136222481 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88f4132100 0x7f88f41367d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f88e8009920 tx=0x7f88e8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=682a9d2f6ac27153 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.118+0000 7f88f1ffb700 1 -- 172.21.15.146:0/3136222481 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e8011830 con 0x7f88f4132100 2023-10-03T10:18:13.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.118+0000 7f88f1ffb700 1 -- 172.21.15.146:0/3136222481 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e8011990 con 0x7f88f4132100 2023-10-03T10:18:13.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.118+0000 7f88f1ffb700 1 -- 172.21.15.146:0/3136222481 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e8011d20 con 0x7f88f4132100 2023-10-03T10:18:13.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.119+0000 7f88f9570700 1 -- 172.21.15.146:0/3136222481 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88f4132100 msgr2=0x7f88f41367d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.119+0000 7f88f9570700 1 --2- 172.21.15.146:0/3136222481 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88f4132100 0x7f88f41367d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f88e8009920 tx=0x7f88e8009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:13.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.119+0000 7f88f9570700 1 -- 172.21.15.146:0/3136222481 shutdown_connections 2023-10-03T10:18:13.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.119+0000 7f88f9570700 1 --2- 172.21.15.146:0/3136222481 >> v2:172.21.15.146:3300/0 conn(0x7f88f41314b0 0x7f88f4138d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.119+0000 7f88f9570700 1 --2- 172.21.15.146:0/3136222481 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88f4132100 0x7f88f41367d0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.119+0000 7f88f9570700 1 -- 172.21.15.146:0/3136222481 >> 172.21.15.146:0/3136222481 conn(0x7f88f40a2980 msgr2=0x7f88f40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.120+0000 7f88f9570700 1 -- 172.21.15.146:0/3136222481 shutdown_connections 2023-10-03T10:18:13.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.120+0000 7f88f9570700 1 -- 172.21.15.146:0/3136222481 wait complete. 2023-10-03T10:18:13.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.121+0000 7f88f9570700 1 Processor -- start 2023-10-03T10:18:13.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.121+0000 7f88f9570700 1 -- start start 2023-10-03T10:18:13.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.121+0000 7f88f9570700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f88f4066410 0x7f88f4119050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.121+0000 7f88f9570700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88f41314b0 0x7f88f4119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.121+0000 7f88f9570700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88f4132100 0x7f88f4119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.121+0000 7f88f9570700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f412ece0 con 0x7f88f41314b0 2023-10-03T10:18:13.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.121+0000 7f88f9570700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f411c860 con 0x7f88f4132100 2023-10-03T10:18:13.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.121+0000 7f88f9570700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88f411af50 con 0x7f88f4066410 2023-10-03T10:18:13.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.121+0000 7f88f27fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88f41314b0 0x7f88f4119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.121+0000 7f88f27fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88f41314b0 0x7f88f4119590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34122/0 (socket says 172.21.15.146:34122) 2023-10-03T10:18:13.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.121+0000 7f88f27fc700 1 -- 172.21.15.146:0/2406901417 learned_addr learned my addr 172.21.15.146:0/2406901417 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:13.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.121+0000 7f88f37fe700 1 --2- 172.21.15.146:0/2406901417 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88f4132100 0x7f88f4119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.121+0000 7f88f2ffd700 1 --2- 172.21.15.146:0/2406901417 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f88f4066410 0x7f88f4119050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.122+0000 7f88f27fc700 1 -- 172.21.15.146:0/2406901417 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f88f4066410 msgr2=0x7f88f4119050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.122+0000 7f88f27fc700 1 --2- 172.21.15.146:0/2406901417 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f88f4066410 0x7f88f4119050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.122+0000 7f88f27fc700 1 -- 172.21.15.146:0/2406901417 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88f4132100 msgr2=0x7f88f4119ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.122+0000 7f88f27fc700 1 --2- 172.21.15.146:0/2406901417 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88f4132100 0x7f88f4119ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.122+0000 7f88f27fc700 1 -- 172.21.15.146:0/2406901417 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e8009550 con 0x7f88f41314b0 2023-10-03T10:18:13.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.122+0000 7f88f37fe700 1 --2- 172.21.15.146:0/2406901417 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88f4132100 0x7f88f4119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:13.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.122+0000 7f88f27fc700 1 --2- 172.21.15.146:0/2406901417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88f41314b0 0x7f88f4119590 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f88e8009870 tx=0x7f88e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.122+0000 7f88db7fe700 1 -- 172.21.15.146:0/2406901417 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e8004240 con 0x7f88f41314b0 2023-10-03T10:18:13.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.122+0000 7f88db7fe700 1 -- 172.21.15.146:0/2406901417 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e801f070 con 0x7f88f41314b0 2023-10-03T10:18:13.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.122+0000 7f88f9570700 1 -- 172.21.15.146:0/2406901417 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f411c2c0 con 0x7f88f41314b0 2023-10-03T10:18:13.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.122+0000 7f88db7fe700 1 -- 172.21.15.146:0/2406901417 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e80036a0 con 0x7f88f41314b0 2023-10-03T10:18:13.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.122+0000 7f88f9570700 1 -- 172.21.15.146:0/2406901417 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f411cff0 con 0x7f88f41314b0 2023-10-03T10:18:13.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.123+0000 7f88f9570700 1 -- 172.21.15.146:0/2406901417 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f404f2a0 con 0x7f88f41314b0 2023-10-03T10:18:13.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.123+0000 7f88db7fe700 1 -- 172.21.15.146:0/2406901417 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88e8021030 con 0x7f88f41314b0 2023-10-03T10:18:13.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.123+0000 7f88db7fe700 1 -- 172.21.15.146:0/2406901417 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f88e8040920 con 0x7f88f41314b0 2023-10-03T10:18:13.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.128+0000 7f88db7fe700 1 -- 172.21.15.146:0/2406901417 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88e80199a0 con 0x7f88f41314b0 2023-10-03T10:18:13.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.183+0000 7f9130e96700 1 Processor -- start 2023-10-03T10:18:13.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.183+0000 7f9130e96700 1 -- start start 2023-10-03T10:18:13.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.184+0000 7f9130e96700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f912c0a1550 0x7f912c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.184+0000 7f9130e96700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f912c139200 0x7f912c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.184+0000 7f9130e96700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912c09e9d0 con 0x7f912c0a0a70 2023-10-03T10:18:13.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.184+0000 7f9130e96700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f912c09dc00 con 0x7f912c139200 2023-10-03T10:18:13.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.184+0000 7f9130e96700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912c09dec0 con 0x7f912c0a1550 2023-10-03T10:18:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.184+0000 7f912a59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f912c0a0a70 0x7f912c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49864/0 (socket says 172.21.15.146:49864) 2023-10-03T10:18:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.184+0000 7f912a59c700 1 -- 172.21.15.146:0/2722752092 learned_addr learned my addr 172.21.15.146:0/2722752092 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.184+0000 7f9129d9b700 1 --2- 172.21.15.146:0/2722752092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f912c0a1550 0x7f912c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.184+0000 7f912ad9d700 1 --2- 172.21.15.146:0/2722752092 >> v2:172.21.15.146:3300/0 conn(0x7f912c139200 0x7f912c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.184+0000 7f912959a700 1 -- 172.21.15.146:0/2722752092 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253474083 0 0) 0x7f912c09e9d0 con 0x7f912c0a0a70 2023-10-03T10:18:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.184+0000 7f912959a700 1 -- 172.21.15.146:0/2722752092 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91140035b0 con 0x7f912c0a0a70 2023-10-03T10:18:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.184+0000 7f912ad9d700 1 -- 172.21.15.146:0/2722752092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f912c0a1550 msgr2=0x7f912c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.184+0000 7f912ad9d700 1 --2- 172.21.15.146:0/2722752092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f912c0a1550 0x7f912c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.184+0000 7f912ad9d700 1 -- 172.21.15.146:0/2722752092 >> v1:172.21.15.146:6789/0 conn(0x7f912c0a0a70 legacy=0x7f912c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.184+0000 7f912ad9d700 1 -- 172.21.15.146:0/2722752092 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c09e6a0 con 0x7f912c139200 2023-10-03T10:18:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.184+0000 7f9129d9b700 1 --2- 172.21.15.146:0/2722752092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f912c0a1550 0x7f912c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.184+0000 7f912ad9d700 1 --2- 172.21.15.146:0/2722752092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f912c139200 0x7f912c13b5e0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f9124009d90 tx=0x7f912400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32864a6f531523c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.185+0000 7f912959a700 1 -- 172.21.15.146:0/2722752092 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912400e070 con 0x7f912c139200 2023-10-03T10:18:13.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.185+0000 7f912959a700 1 -- 172.21.15.146:0/2722752092 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912400bb20 con 0x7f912c139200 2023-10-03T10:18:13.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.185+0000 7f912959a700 1 -- 172.21.15.146:0/2722752092 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124012430 con 0x7f912c139200 2023-10-03T10:18:13.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.185+0000 7f9130e96700 1 -- 172.21.15.146:0/2722752092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f912c139200 msgr2=0x7f912c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.185+0000 7f9130e96700 1 --2- 172.21.15.146:0/2722752092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f912c139200 0x7f912c13b5e0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f9124009d90 tx=0x7f912400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:13.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.185+0000 7f9130e96700 1 -- 172.21.15.146:0/2722752092 shutdown_connections 2023-10-03T10:18:13.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.185+0000 7f9130e96700 1 --2- 172.21.15.146:0/2722752092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f912c139200 0x7f912c13b5e0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.185+0000 7f9130e96700 1 --2- 172.21.15.146:0/2722752092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f912c0a1550 0x7f912c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.185+0000 7f9130e96700 1 -- 172.21.15.146:0/2722752092 >> 172.21.15.146:0/2722752092 conn(0x7f912c0a6610 msgr2=0x7f912c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.186+0000 7f9130e96700 1 -- 172.21.15.146:0/2722752092 shutdown_connections 2023-10-03T10:18:13.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.186+0000 7f9130e96700 1 -- 172.21.15.146:0/2722752092 wait complete. 2023-10-03T10:18:13.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.187+0000 7f9130e96700 1 Processor -- start 2023-10-03T10:18:13.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.187+0000 7f9130e96700 1 -- start start 2023-10-03T10:18:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.188+0000 7f9130e96700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f912c0a0a70 0x7f912c121970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.188+0000 7f9130e96700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f912c0a1550 0x7f912c121eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.188+0000 7f9130e96700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f912c139200 0x7f912c1223f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.188+0000 7f9130e96700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912c123dc0 con 0x7f912c139200 2023-10-03T10:18:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.188+0000 7f9130e96700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912c125400 con 0x7f912c0a0a70 2023-10-03T10:18:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.188+0000 7f9130e96700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f912c0a5710 con 0x7f912c0a1550 2023-10-03T10:18:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.188+0000 7f912a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f912c0a0a70 0x7f912c121970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.188+0000 7f9129d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f912c0a1550 0x7f912c121eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.188+0000 7f912a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f912c0a0a70 0x7f912c121970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60786/0 (socket says 172.21.15.146:60786) 2023-10-03T10:18:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.188+0000 7f912a59c700 1 -- 172.21.15.146:0/475989990 learned_addr learned my addr 172.21.15.146:0/475989990 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.188+0000 7f912ad9d700 1 --2- 172.21.15.146:0/475989990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f912c139200 0x7f912c1223f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.188+0000 7f9129d9b700 1 -- 172.21.15.146:0/475989990 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f912c0a0a70 msgr2=0x7f912c121970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.188+0000 7f9129d9b700 1 --2- 172.21.15.146:0/475989990 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f912c0a0a70 0x7f912c121970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.188+0000 7f9129d9b700 1 -- 172.21.15.146:0/475989990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f912c139200 msgr2=0x7f912c1223f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.188+0000 7f9129d9b700 1 --2- 172.21.15.146:0/475989990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f912c139200 0x7f912c1223f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.188+0000 7f9129d9b700 1 -- 172.21.15.146:0/475989990 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91200094a0 con 0x7f912c0a1550 2023-10-03T10:18:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.188+0000 7f912ad9d700 1 --2- 172.21.15.146:0/475989990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f912c139200 0x7f912c1223f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.189+0000 7f9129d9b700 1 --2- 172.21.15.146:0/475989990 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f912c0a1550 0x7f912c121eb0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f912000e9e0 tx=0x7f912000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.189+0000 7f911affd700 1 -- 172.21.15.146:0/475989990 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912000ee80 con 0x7f912c0a1550 2023-10-03T10:18:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.189+0000 7f911affd700 1 -- 172.21.15.146:0/475989990 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912000c850 con 0x7f912c0a1550 2023-10-03T10:18:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.189+0000 7f9130e96700 1 -- 172.21.15.146:0/475989990 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9124009a70 con 0x7f912c0a1550 2023-10-03T10:18:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.189+0000 7f911affd700 1 -- 172.21.15.146:0/475989990 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912000cc00 con 0x7f912c0a1550 2023-10-03T10:18:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.189+0000 7f9130e96700 1 -- 172.21.15.146:0/475989990 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f912c0a0430 con 0x7f912c0a1550 2023-10-03T10:18:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.189+0000 7f911affd700 1 -- 172.21.15.146:0/475989990 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f912000cd60 con 0x7f912c0a1550 2023-10-03T10:18:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.190+0000 7f911affd700 1 -- 172.21.15.146:0/475989990 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f912003fab0 con 0x7f912c0a1550 2023-10-03T10:18:13.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.190+0000 7f9130e96700 1 -- 172.21.15.146:0/475989990 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f912c124b90 con 0x7f912c0a1550 2023-10-03T10:18:13.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.195+0000 7f911affd700 1 -- 172.21.15.146:0/475989990 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f912001b3b0 con 0x7f912c0a1550 2023-10-03T10:18:13.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.226+0000 7f6f98da1700 1 Processor -- start 2023-10-03T10:18:13.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.227+0000 7f6f98da1700 1 -- start start 2023-10-03T10:18:13.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.227+0000 7f6f98da1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f9409fa30 0x7f6f9409ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.227+0000 7f6f98da1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9413d210 0x7f6f9413f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.227+0000 7f6f98da1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f9406ba90 con 0x7f6f9409a190 2023-10-03T10:18:13.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.227+0000 7f6f98da1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9409a560 con 0x7f6f9413d210 2023-10-03T10:18:13.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.227+0000 7f6f98da1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9406c6a0 con 0x7f6f9409fa30 2023-10-03T10:18:13.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.227+0000 7f6f92ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f9409fa30 0x7f6f9409ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.227+0000 7f6f937fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6f9409a190 0x7f6f9409e720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49868/0 (socket says 172.21.15.146:49868) 2023-10-03T10:18:13.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.227+0000 7f6f937fe700 1 -- 172.21.15.146:0/1005116391 learned_addr learned my addr 172.21.15.146:0/1005116391 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:13.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.227+0000 7f6f93fff700 1 --2- 172.21.15.146:0/1005116391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9413d210 0x7f6f9413f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.228+0000 7f6f927fc700 1 -- 172.21.15.146:0/1005116391 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862542820 0 0) 0x7f6f9406ba90 con 0x7f6f9409a190 2023-10-03T10:18:13.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.228+0000 7f6f927fc700 1 -- 172.21.15.146:0/1005116391 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f7c0035b0 con 0x7f6f9409a190 2023-10-03T10:18:13.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.228+0000 7f6f92ffd700 1 -- 172.21.15.146:0/1005116391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9413d210 msgr2=0x7f6f9413f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:13.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.228+0000 7f6f92ffd700 1 --2- 172.21.15.146:0/1005116391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9413d210 0x7f6f9413f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.228+0000 7f6f92ffd700 1 -- 172.21.15.146:0/1005116391 >> v1:172.21.15.146:6789/0 conn(0x7f6f9409a190 legacy=0x7f6f9409e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.228+0000 7f6f92ffd700 1 -- 172.21.15.146:0/1005116391 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9406cd80 con 0x7f6f9409fa30 2023-10-03T10:18:13.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.228+0000 7f6f92ffd700 1 --2- 172.21.15.146:0/1005116391 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f9409fa30 0x7f6f9409ee30 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009870 tx=0x7f6f88009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd2c0abfd83ebe72 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.228+0000 7f6f927fc700 1 -- 172.21.15.146:0/1005116391 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88011830 con 0x7f6f9409fa30 2023-10-03T10:18:13.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.228+0000 7f6f927fc700 1 -- 172.21.15.146:0/1005116391 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f88011990 con 0x7f6f9409fa30 2023-10-03T10:18:13.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.228+0000 7f6f927fc700 1 -- 172.21.15.146:0/1005116391 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88011d20 con 0x7f6f9409fa30 2023-10-03T10:18:13.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.229+0000 7f6f98da1700 1 -- 172.21.15.146:0/1005116391 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f9409fa30 msgr2=0x7f6f9409ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.229+0000 7f6f98da1700 1 --2- 172.21.15.146:0/1005116391 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f9409fa30 0x7f6f9409ee30 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009870 tx=0x7f6f88009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:13.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.229+0000 7f6f98da1700 1 -- 172.21.15.146:0/1005116391 shutdown_connections 2023-10-03T10:18:13.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.229+0000 7f6f98da1700 1 --2- 172.21.15.146:0/1005116391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9413d210 0x7f6f9413f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.229+0000 7f6f98da1700 1 --2- 172.21.15.146:0/1005116391 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f9409fa30 0x7f6f9409ee30 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.229+0000 7f6f98da1700 1 -- 172.21.15.146:0/1005116391 >> 172.21.15.146:0/1005116391 conn(0x7f6f940a0d40 msgr2=0x7f6f940a1140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.229+0000 7f6f98da1700 1 -- 172.21.15.146:0/1005116391 shutdown_connections 2023-10-03T10:18:13.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.229+0000 7f6f98da1700 1 -- 172.21.15.146:0/1005116391 wait complete. 2023-10-03T10:18:13.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.230+0000 7f6f98da1700 1 Processor -- start 2023-10-03T10:18:13.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.230+0000 7f6f98da1700 1 -- start start 2023-10-03T10:18:13.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.231+0000 7f6f98da1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9409a190 0x7f6f9411bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.231+0000 7f6f98da1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f9409fa30 0x7f6f9411c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.231+0000 7f6f98da1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f9413d210 0x7f6f9411ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.231+0000 7f6f98da1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f94127600 con 0x7f6f9409fa30 2023-10-03T10:18:13.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.231+0000 7f6f98da1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9413cf60 con 0x7f6f9409a190 2023-10-03T10:18:13.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.231+0000 7f6f98da1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f94127980 con 0x7f6f9413d210 2023-10-03T10:18:13.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.231+0000 7f6f92ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f9409fa30 0x7f6f9411c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.231+0000 7f6f937fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9409a190 0x7f6f9411bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.231+0000 7f6f937fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9409a190 0x7f6f9411bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60808/0 (socket says 172.21.15.146:60808) 2023-10-03T10:18:13.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.231+0000 7f6f92ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f9409fa30 0x7f6f9411c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34168/0 (socket says 172.21.15.146:34168) 2023-10-03T10:18:13.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.231+0000 7f6f937fe700 1 -- 172.21.15.146:0/329435708 learned_addr learned my addr 172.21.15.146:0/329435708 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:13.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.231+0000 7f6f93fff700 1 --2- 172.21.15.146:0/329435708 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f9413d210 0x7f6f9411ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.232+0000 7f6f937fe700 1 -- 172.21.15.146:0/329435708 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f9413d210 msgr2=0x7f6f9411ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.232+0000 7f6f937fe700 1 --2- 172.21.15.146:0/329435708 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f9413d210 0x7f6f9411ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.232+0000 7f6f937fe700 1 -- 172.21.15.146:0/329435708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f9409fa30 msgr2=0x7f6f9411c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.232+0000 7f6f937fe700 1 --2- 172.21.15.146:0/329435708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f9409fa30 0x7f6f9411c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.232+0000 7f6f937fe700 1 -- 172.21.15.146:0/329435708 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f880094a0 con 0x7f6f9409a190 2023-10-03T10:18:13.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.232+0000 7f6f92ffd700 1 --2- 172.21.15.146:0/329435708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f9409fa30 0x7f6f9411c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:13.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.232+0000 7f6f937fe700 1 --2- 172.21.15.146:0/329435708 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9409a190 0x7f6f9411bfb0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400c4d0 tx=0x7f6f8400c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.232+0000 7f6f7bfff700 1 -- 172.21.15.146:0/329435708 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8400cea0 con 0x7f6f9409a190 2023-10-03T10:18:13.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.232+0000 7f6f7bfff700 1 -- 172.21.15.146:0/329435708 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f84005d70 con 0x7f6f9409a190 2023-10-03T10:18:13.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.232+0000 7f6f7bfff700 1 -- 172.21.15.146:0/329435708 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f840072f0 con 0x7f6f9409a190 2023-10-03T10:18:13.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.232+0000 7f6f98da1700 1 -- 172.21.15.146:0/329435708 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9411d410 con 0x7f6f9409a190 2023-10-03T10:18:13.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.232+0000 7f6f98da1700 1 -- 172.21.15.146:0/329435708 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9409ff20 con 0x7f6f9409a190 2023-10-03T10:18:13.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.233+0000 7f6f7bfff700 1 -- 172.21.15.146:0/329435708 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f84007450 con 0x7f6f9409a190 2023-10-03T10:18:13.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.233+0000 7f6f7bfff700 1 -- 172.21.15.146:0/329435708 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6f8403eab0 con 0x7f6f9409a190 2023-10-03T10:18:13.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.233+0000 7f6f98da1700 1 -- 172.21.15.146:0/329435708 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9404f2a0 con 0x7f6f9409a190 2023-10-03T10:18:13.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.238+0000 7f6f7bfff700 1 -- 172.21.15.146:0/329435708 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f84017070 con 0x7f6f9409a190 2023-10-03T10:18:13.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.330+0000 7f88f9570700 1 -- 172.21.15.146:0/2406901417 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f88f40724c0 con 0x7f88f41314b0 2023-10-03T10:18:13.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.330+0000 7f88db7fe700 1 -- 172.21.15.146:0/2406901417 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f88e8015030 con 0x7f88f41314b0 2023-10-03T10:18:13.330 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:13.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.333+0000 7f88f9570700 1 -- 172.21.15.146:0/2406901417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88f41314b0 msgr2=0x7f88f4119590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.333+0000 7f88f9570700 1 --2- 172.21.15.146:0/2406901417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88f41314b0 0x7f88f4119590 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f88e8009870 tx=0x7f88e8004750 comp rx=0 tx=0).stop 2023-10-03T10:18:13.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.333+0000 7f88f9570700 1 -- 172.21.15.146:0/2406901417 shutdown_connections 2023-10-03T10:18:13.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.333+0000 7f88f9570700 1 --2- 172.21.15.146:0/2406901417 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88f4132100 0x7f88f4119ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.333+0000 7f88f9570700 1 --2- 172.21.15.146:0/2406901417 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f88f4066410 0x7f88f4119050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.333+0000 7f88f9570700 1 --2- 172.21.15.146:0/2406901417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88f41314b0 0x7f88f4119590 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.333+0000 7f88f9570700 1 -- 172.21.15.146:0/2406901417 >> 172.21.15.146:0/2406901417 conn(0x7f88f40a2980 msgr2=0x7f88f4130240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.333+0000 7f88f9570700 1 -- 172.21.15.146:0/2406901417 shutdown_connections 2023-10-03T10:18:13.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.333+0000 7f88f9570700 1 -- 172.21.15.146:0/2406901417 wait complete. 2023-10-03T10:18:13.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:13.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.390+0000 7f9130e96700 1 -- 172.21.15.146:0/475989990 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f912c124dc0 con 0x7f912c0a1550 2023-10-03T10:18:13.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.391+0000 7f911affd700 1 -- 172.21.15.146:0/475989990 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f912c124dc0 con 0x7f912c0a1550 2023-10-03T10:18:13.390 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:13.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.393+0000 7f9130e96700 1 -- 172.21.15.146:0/475989990 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f912c0a1550 msgr2=0x7f912c121eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.393+0000 7f9130e96700 1 --2- 172.21.15.146:0/475989990 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f912c0a1550 0x7f912c121eb0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f912000e9e0 tx=0x7f912000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.393+0000 7f9130e96700 1 -- 172.21.15.146:0/475989990 shutdown_connections 2023-10-03T10:18:13.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.393+0000 7f9130e96700 1 --2- 172.21.15.146:0/475989990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f912c139200 0x7f912c1223f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.393+0000 7f9130e96700 1 --2- 172.21.15.146:0/475989990 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f912c0a0a70 0x7f912c121970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.393+0000 7f9130e96700 1 --2- 172.21.15.146:0/475989990 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f912c0a1550 0x7f912c121eb0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.393+0000 7f9130e96700 1 -- 172.21.15.146:0/475989990 >> 172.21.15.146:0/475989990 conn(0x7f912c0a6610 msgr2=0x7f912c137cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.393+0000 7f9130e96700 1 -- 172.21.15.146:0/475989990 shutdown_connections 2023-10-03T10:18:13.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.393+0000 7f9130e96700 1 -- 172.21.15.146:0/475989990 wait complete. 2023-10-03T10:18:13.404 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:13.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.433+0000 7f6f98da1700 1 -- 172.21.15.146:0/329435708 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6f9406b0d0 con 0x7f6f9409a190 2023-10-03T10:18:13.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.433+0000 7f6f7bfff700 1 -- 172.21.15.146:0/329435708 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f84019b40 con 0x7f6f9409a190 2023-10-03T10:18:13.433 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:13.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.435+0000 7f6f98da1700 1 -- 172.21.15.146:0/329435708 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9409a190 msgr2=0x7f6f9411bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.435+0000 7f6f98da1700 1 --2- 172.21.15.146:0/329435708 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9409a190 0x7f6f9411bfb0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400c4d0 tx=0x7f6f8400c7e0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.435+0000 7f6f98da1700 1 -- 172.21.15.146:0/329435708 shutdown_connections 2023-10-03T10:18:13.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.435+0000 7f6f98da1700 1 --2- 172.21.15.146:0/329435708 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6f9413d210 0x7f6f9411ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.435+0000 7f6f98da1700 1 --2- 172.21.15.146:0/329435708 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6f9409a190 0x7f6f9411bfb0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.435+0000 7f6f98da1700 1 --2- 172.21.15.146:0/329435708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f9409fa30 0x7f6f9411c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.435+0000 7f6f98da1700 1 -- 172.21.15.146:0/329435708 >> 172.21.15.146:0/329435708 conn(0x7f6f940a0d40 msgr2=0x7f6f9413e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.435+0000 7f6f98da1700 1 -- 172.21.15.146:0/329435708 shutdown_connections 2023-10-03T10:18:13.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:13.436+0000 7f6f98da1700 1 -- 172.21.15.146:0/329435708 wait complete. 2023-10-03T10:18:13.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:13.968 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:14.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.091+0000 7f6016cb5700 1 Processor -- start 2023-10-03T10:18:14.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.091+0000 7f6016cb5700 1 -- start start 2023-10-03T10:18:14.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.091+0000 7f6016cb5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f601009e870 0x7f601009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.091+0000 7f6016cb5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f601009f180 0x7f6010131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.091+0000 7f6016cb5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f601009c970 con 0x7f6010131d70 2023-10-03T10:18:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.091+0000 7f6016cb5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60100a0920 con 0x7f601009f180 2023-10-03T10:18:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.091+0000 7f6016cb5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601009f9c0 con 0x7f601009e870 2023-10-03T10:18:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.092+0000 7f600ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f601009f180 0x7f6010131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.092+0000 7f6014a51700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f601009e870 0x7f601009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.092+0000 7f600ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f601009f180 0x7f6010131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34174/0 (socket says 172.21.15.146:34174) 2023-10-03T10:18:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.092+0000 7f6015252700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6010131d70 0x7f6010138c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49874/0 (socket says 172.21.15.146:49874) 2023-10-03T10:18:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.092+0000 7f600ffff700 1 -- 172.21.15.146:0/270971336 learned_addr learned my addr 172.21.15.146:0/270971336 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.092+0000 7f6014a51700 1 -- 172.21.15.146:0/270971336 >> v2:172.21.15.146:3300/0 conn(0x7f601009f180 msgr2=0x7f6010131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.092+0000 7f6014a51700 1 --2- 172.21.15.146:0/270971336 >> v2:172.21.15.146:3300/0 conn(0x7f601009f180 0x7f6010131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.092+0000 7f6014a51700 1 -- 172.21.15.146:0/270971336 >> v1:172.21.15.146:6789/0 conn(0x7f6010131d70 legacy=0x7f6010138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.092+0000 7f6014a51700 1 -- 172.21.15.146:0/270971336 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601009bab0 con 0x7f601009e870 2023-10-03T10:18:14.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.092+0000 7f600f7fe700 1 -- 172.21.15.146:0/270971336 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1595337549 0 0) 0x7f601009c970 con 0x7f6010131d70 2023-10-03T10:18:14.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.092+0000 7f600ffff700 1 --2- 172.21.15.146:0/270971336 >> v2:172.21.15.146:3300/0 conn(0x7f601009f180 0x7f6010131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:14.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.092+0000 7f6014a51700 1 --2- 172.21.15.146:0/270971336 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f601009e870 0x7f601009ec40 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f6004009840 tx=0x7f6004009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e789f72487671fa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:14.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.092+0000 7f600f7fe700 1 -- 172.21.15.146:0/270971336 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6004011830 con 0x7f601009e870 2023-10-03T10:18:14.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.092+0000 7f600f7fe700 1 -- 172.21.15.146:0/270971336 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6004011990 con 0x7f601009e870 2023-10-03T10:18:14.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.092+0000 7f600f7fe700 1 -- 172.21.15.146:0/270971336 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6004011d20 con 0x7f601009e870 2023-10-03T10:18:14.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.093+0000 7f6016cb5700 1 -- 172.21.15.146:0/270971336 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f601009e870 msgr2=0x7f601009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.093+0000 7f6016cb5700 1 --2- 172.21.15.146:0/270971336 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f601009e870 0x7f601009ec40 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f6004009840 tx=0x7f6004009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:14.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.093+0000 7f6016cb5700 1 -- 172.21.15.146:0/270971336 shutdown_connections 2023-10-03T10:18:14.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.093+0000 7f6016cb5700 1 --2- 172.21.15.146:0/270971336 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f601009e870 0x7f601009ec40 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.093+0000 7f6016cb5700 1 --2- 172.21.15.146:0/270971336 >> v2:172.21.15.146:3300/0 conn(0x7f601009f180 0x7f6010131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.093+0000 7f6016cb5700 1 -- 172.21.15.146:0/270971336 >> 172.21.15.146:0/270971336 conn(0x7f60100a4430 msgr2=0x7f60100a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.093+0000 7f6016cb5700 1 -- 172.21.15.146:0/270971336 shutdown_connections 2023-10-03T10:18:14.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.093+0000 7f6016cb5700 1 -- 172.21.15.146:0/270971336 wait complete. 2023-10-03T10:18:14.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.094+0000 7f6016cb5700 1 Processor -- start 2023-10-03T10:18:14.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.094+0000 7f6016cb5700 1 -- start start 2023-10-03T10:18:14.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.094+0000 7f6016cb5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f601009e870 0x7f601011d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.094+0000 7f6016cb5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f601009f180 0x7f601011d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.094+0000 7f6016cb5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6010131d70 0x7f60101c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.094+0000 7f6016cb5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60101312d0 con 0x7f601009f180 2023-10-03T10:18:14.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.094+0000 7f6016cb5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6010120210 con 0x7f601009e870 2023-10-03T10:18:14.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.094+0000 7f6016cb5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f601011ce30 con 0x7f6010131d70 2023-10-03T10:18:14.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.094+0000 7f6014a51700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f601009e870 0x7f601011d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.094+0000 7f600ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f601009f180 0x7f601011d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.094+0000 7f6014a51700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f601009e870 0x7f601011d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:60822/0 (socket says 172.21.15.146:60822) 2023-10-03T10:18:14.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.094+0000 7f6014a51700 1 -- 172.21.15.146:0/2336130180 learned_addr learned my addr 172.21.15.146:0/2336130180 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:14.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.094+0000 7f6015252700 1 --2- 172.21.15.146:0/2336130180 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6010131d70 0x7f60101c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.095+0000 7f6014a51700 1 -- 172.21.15.146:0/2336130180 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6010131d70 msgr2=0x7f60101c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.095+0000 7f6014a51700 1 --2- 172.21.15.146:0/2336130180 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6010131d70 0x7f60101c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.095+0000 7f6014a51700 1 -- 172.21.15.146:0/2336130180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f601009f180 msgr2=0x7f601011d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.095+0000 7f6014a51700 1 --2- 172.21.15.146:0/2336130180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f601009f180 0x7f601011d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.095+0000 7f6014a51700 1 -- 172.21.15.146:0/2336130180 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ffc009550 con 0x7f601009e870 2023-10-03T10:18:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.095+0000 7f600ffff700 1 --2- 172.21.15.146:0/2336130180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f601009f180 0x7f601011d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.095+0000 7f6014a51700 1 --2- 172.21.15.146:0/2336130180 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f601009e870 0x7f601011d480 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f6004009b90 tx=0x7f6004004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.095+0000 7f600d7fa700 1 -- 172.21.15.146:0/2336130180 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60040036a0 con 0x7f601009e870 2023-10-03T10:18:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.095+0000 7f600d7fa700 1 -- 172.21.15.146:0/2336130180 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600401e070 con 0x7f601009e870 2023-10-03T10:18:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.095+0000 7f6016cb5700 1 -- 172.21.15.146:0/2336130180 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60040094a0 con 0x7f601009e870 2023-10-03T10:18:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.095+0000 7f600d7fa700 1 -- 172.21.15.146:0/2336130180 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6004003a60 con 0x7f601009e870 2023-10-03T10:18:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.095+0000 7f6016cb5700 1 -- 172.21.15.146:0/2336130180 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601009dba0 con 0x7f601009e870 2023-10-03T10:18:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.096+0000 7f600d7fa700 1 -- 172.21.15.146:0/2336130180 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6004003bc0 con 0x7f601009e870 2023-10-03T10:18:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.096+0000 7f600d7fa700 1 -- 172.21.15.146:0/2336130180 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f60040404b0 con 0x7f601009e870 2023-10-03T10:18:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.096+0000 7f6016cb5700 1 -- 172.21.15.146:0/2336130180 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f601011fde0 con 0x7f601009e870 2023-10-03T10:18:14.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.101+0000 7f600d7fa700 1 -- 172.21.15.146:0/2336130180 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6004015080 con 0x7f601009e870 2023-10-03T10:18:14.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.284+0000 7f6016cb5700 1 -- 172.21.15.146:0/2336130180 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f601011eda0 con 0x7f601009e870 2023-10-03T10:18:14.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.285+0000 7f600d7fa700 1 -- 172.21.15.146:0/2336130180 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f600402d970 con 0x7f601009e870 2023-10-03T10:18:14.285 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:14.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.287+0000 7f6016cb5700 1 -- 172.21.15.146:0/2336130180 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f601009e870 msgr2=0x7f601011d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.287+0000 7f6016cb5700 1 --2- 172.21.15.146:0/2336130180 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f601009e870 0x7f601011d480 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f6004009b90 tx=0x7f6004004750 comp rx=0 tx=0).stop 2023-10-03T10:18:14.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.287+0000 7f6016cb5700 1 -- 172.21.15.146:0/2336130180 shutdown_connections 2023-10-03T10:18:14.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.287+0000 7f6016cb5700 1 --2- 172.21.15.146:0/2336130180 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6010131d70 0x7f60101c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.287+0000 7f6016cb5700 1 --2- 172.21.15.146:0/2336130180 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f601009e870 0x7f601011d480 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.287+0000 7f6016cb5700 1 --2- 172.21.15.146:0/2336130180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f601009f180 0x7f601011d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.287+0000 7f6016cb5700 1 -- 172.21.15.146:0/2336130180 >> 172.21.15.146:0/2336130180 conn(0x7f60100a4430 msgr2=0x7f60101b9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.287+0000 7f6016cb5700 1 -- 172.21.15.146:0/2336130180 shutdown_connections 2023-10-03T10:18:14.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.287+0000 7f6016cb5700 1 -- 172.21.15.146:0/2336130180 wait complete. 2023-10-03T10:18:14.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:14.345 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:14.405 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:14.448 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:14.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.476+0000 7f4946862700 1 Processor -- start 2023-10-03T10:18:14.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.476+0000 7f4946862700 1 -- start start 2023-10-03T10:18:14.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.477+0000 7f4946862700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f494009d860 0x7f494009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.477+0000 7f4946862700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4940130eb0 0x7f4940138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.477+0000 7f4946862700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494009aaa0 con 0x7f494009e170 2023-10-03T10:18:14.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.477+0000 7f4946862700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494009f870 con 0x7f4940130eb0 2023-10-03T10:18:14.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.477+0000 7f4946862700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f494009b360 con 0x7f494009d860 2023-10-03T10:18:14.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.477+0000 7f493f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f494009e170 0x7f49401307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33666/0 (socket says 172.21.15.146:33666) 2023-10-03T10:18:14.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.477+0000 7f493f7fe700 1 -- 172.21.15.146:0/2728940590 learned_addr learned my addr 172.21.15.146:0/2728940590 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:14.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.477+0000 7f4944dff700 1 --2- 172.21.15.146:0/2728940590 >> v2:172.21.15.146:3300/0 conn(0x7f4940130eb0 0x7f4940138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.477+0000 7f493ffff700 1 --2- 172.21.15.146:0/2728940590 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f494009d860 0x7f494009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.477+0000 7f493ffff700 1 -- 172.21.15.146:0/2728940590 >> v2:172.21.15.146:3300/0 conn(0x7f4940130eb0 msgr2=0x7f4940138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:14.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.477+0000 7f493ffff700 1 --2- 172.21.15.146:0/2728940590 >> v2:172.21.15.146:3300/0 conn(0x7f4940130eb0 0x7f4940138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.477+0000 7f493ffff700 1 -- 172.21.15.146:0/2728940590 >> v1:172.21.15.146:6789/0 conn(0x7f494009e170 legacy=0x7f49401307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.477+0000 7f493ffff700 1 -- 172.21.15.146:0/2728940590 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494009b620 con 0x7f494009d860 2023-10-03T10:18:14.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.477+0000 7f493effd700 1 -- 172.21.15.146:0/2728940590 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777832395 0 0) 0x7f494009aaa0 con 0x7f494009e170 2023-10-03T10:18:14.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.477+0000 7f4944dff700 1 --2- 172.21.15.146:0/2728940590 >> v2:172.21.15.146:3300/0 conn(0x7f4940130eb0 0x7f4940138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:14.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.477+0000 7f493ffff700 1 --2- 172.21.15.146:0/2728940590 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f494009d860 0x7f494009dc30 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4930009840 tx=0x7f4930009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f13ad850d7b7c3fe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:14.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.478+0000 7f493effd700 1 -- 172.21.15.146:0/2728940590 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4930011830 con 0x7f494009d860 2023-10-03T10:18:14.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.478+0000 7f493effd700 1 -- 172.21.15.146:0/2728940590 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4930011990 con 0x7f494009d860 2023-10-03T10:18:14.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.478+0000 7f493effd700 1 -- 172.21.15.146:0/2728940590 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4930011d20 con 0x7f494009d860 2023-10-03T10:18:14.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.478+0000 7f4946862700 1 -- 172.21.15.146:0/2728940590 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f494009d860 msgr2=0x7f494009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.478+0000 7f4946862700 1 --2- 172.21.15.146:0/2728940590 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f494009d860 0x7f494009dc30 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4930009840 tx=0x7f4930009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:14.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.478+0000 7f4946862700 1 -- 172.21.15.146:0/2728940590 shutdown_connections 2023-10-03T10:18:14.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.478+0000 7f4946862700 1 --2- 172.21.15.146:0/2728940590 >> v2:172.21.15.146:3300/0 conn(0x7f4940130eb0 0x7f4940138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.478+0000 7f4946862700 1 --2- 172.21.15.146:0/2728940590 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f494009d860 0x7f494009dc30 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.478+0000 7f4946862700 1 -- 172.21.15.146:0/2728940590 >> 172.21.15.146:0/2728940590 conn(0x7f4940099c40 msgr2=0x7f49400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.478+0000 7f4946862700 1 -- 172.21.15.146:0/2728940590 shutdown_connections 2023-10-03T10:18:14.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.479+0000 7f4946862700 1 -- 172.21.15.146:0/2728940590 wait complete. 2023-10-03T10:18:14.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.479+0000 7f4946862700 1 Processor -- start 2023-10-03T10:18:14.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.480+0000 7f4946862700 1 -- start start 2023-10-03T10:18:14.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.480+0000 7f4946862700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f494009d860 0x7f4940135be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.480+0000 7f4946862700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f494009e170 0x7f4940136120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.480+0000 7f4946862700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4940130eb0 0x7f4940136660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.480+0000 7f4946862700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4940137d20 con 0x7f4940130eb0 2023-10-03T10:18:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.480+0000 7f4946862700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4940071f70 con 0x7f494009e170 2023-10-03T10:18:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.480+0000 7f4946862700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4940137750 con 0x7f494009d860 2023-10-03T10:18:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.480+0000 7f493ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f494009d860 0x7f4940135be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.480+0000 7f493ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f494009d860 0x7f4940135be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54478/0 (socket says 172.21.15.146:54478) 2023-10-03T10:18:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.480+0000 7f493ffff700 1 -- 172.21.15.146:0/3106110743 learned_addr learned my addr 172.21.15.146:0/3106110743 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.480+0000 7f493f7fe700 1 --2- 172.21.15.146:0/3106110743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f494009e170 0x7f4940136120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.480+0000 7f4944dff700 1 --2- 172.21.15.146:0/3106110743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4940130eb0 0x7f4940136660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.480+0000 7f493ffff700 1 -- 172.21.15.146:0/3106110743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f494009e170 msgr2=0x7f4940136120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.481+0000 7f493ffff700 1 --2- 172.21.15.146:0/3106110743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f494009e170 0x7f4940136120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.481+0000 7f493ffff700 1 -- 172.21.15.146:0/3106110743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4940130eb0 msgr2=0x7f4940136660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.481+0000 7f493ffff700 1 --2- 172.21.15.146:0/3106110743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4940130eb0 0x7f4940136660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.481+0000 7f493ffff700 1 -- 172.21.15.146:0/3106110743 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4938009a70 con 0x7f494009d860 2023-10-03T10:18:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.481+0000 7f493ffff700 1 --2- 172.21.15.146:0/3106110743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f494009d860 0x7f4940135be0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4930009fd0 tx=0x7f4930004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.481+0000 7f493cff9700 1 -- 172.21.15.146:0/3106110743 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49300045d0 con 0x7f494009d860 2023-10-03T10:18:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.481+0000 7f493cff9700 1 -- 172.21.15.146:0/3106110743 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493001f070 con 0x7f494009d860 2023-10-03T10:18:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.481+0000 7f4946862700 1 -- 172.21.15.146:0/3106110743 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49300094a0 con 0x7f494009d860 2023-10-03T10:18:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.481+0000 7f493cff9700 1 -- 172.21.15.146:0/3106110743 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49300038a0 con 0x7f494009d860 2023-10-03T10:18:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.481+0000 7f4946862700 1 -- 172.21.15.146:0/3106110743 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4940138d80 con 0x7f494009d860 2023-10-03T10:18:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.482+0000 7f4946862700 1 -- 172.21.15.146:0/3106110743 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494004f2a0 con 0x7f494009d860 2023-10-03T10:18:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.482+0000 7f493cff9700 1 -- 172.21.15.146:0/3106110743 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4930003a00 con 0x7f494009d860 2023-10-03T10:18:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.483+0000 7f493cff9700 1 -- 172.21.15.146:0/3106110743 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4930021070 con 0x7f494009d860 2023-10-03T10:18:14.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.491+0000 7f493cff9700 1 -- 172.21.15.146:0/3106110743 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49300259d0 con 0x7f494009d860 2023-10-03T10:18:14.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.535+0000 7f7f42854700 1 Processor -- start 2023-10-03T10:18:14.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.535+0000 7f7f42854700 1 -- start start 2023-10-03T10:18:14.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.536+0000 7f7f42854700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f3c0a0a70 0x7f7f3c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.536+0000 7f7f42854700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f3c0a1380 0x7f7f3c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.536+0000 7f7f42854700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7f3c133f50 0x7f7f3c1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.536+0000 7f7f42854700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f3c09e9d0 con 0x7f7f3c133f50 2023-10-03T10:18:14.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.536+0000 7f7f42854700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c09dc00 con 0x7f7f3c0a0a70 2023-10-03T10:18:14.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.536+0000 7f7f42854700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c09dec0 con 0x7f7f3c0a1380 2023-10-03T10:18:14.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.536+0000 7f7f3b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f3c0a1380 0x7f7f3c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.536+0000 7f7f3bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f3c0a0a70 0x7f7f3c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.536+0000 7f7f40df1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7f3c133f50 0x7f7f3c1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.536+0000 7f7f3b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f3c0a1380 0x7f7f3c133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54482/0 (socket says 172.21.15.146:54482) 2023-10-03T10:18:14.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.536+0000 7f7f3b7fe700 1 -- 172.21.15.146:0/1371019634 learned_addr learned my addr 172.21.15.146:0/1371019634 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:14.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.536+0000 7f7f3bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f3c0a0a70 0x7f7f3c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57136/0 (socket says 172.21.15.146:57136) 2023-10-03T10:18:14.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.537+0000 7f7f3bfff700 1 -- 172.21.15.146:0/1371019634 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f3c0a1380 msgr2=0x7f7f3c133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:14.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.537+0000 7f7f3bfff700 1 --2- 172.21.15.146:0/1371019634 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f3c0a1380 0x7f7f3c133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.537+0000 7f7f3bfff700 1 -- 172.21.15.146:0/1371019634 >> v2:172.21.15.146:3300/0 conn(0x7f7f3c133f50 msgr2=0x7f7f3c1343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:14.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.537+0000 7f7f3bfff700 1 --2- 172.21.15.146:0/1371019634 >> v2:172.21.15.146:3300/0 conn(0x7f7f3c133f50 0x7f7f3c1343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.537+0000 7f7f3bfff700 1 -- 172.21.15.146:0/1371019634 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c09e6a0 con 0x7f7f3c0a0a70 2023-10-03T10:18:14.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.537+0000 7f7f3b7fe700 1 --2- 172.21.15.146:0/1371019634 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f3c0a1380 0x7f7f3c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:14.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.537+0000 7f7f40df1700 1 --2- 172.21.15.146:0/1371019634 >> v2:172.21.15.146:3300/0 conn(0x7f7f3c133f50 0x7f7f3c1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:14.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.537+0000 7f7f3bfff700 1 --2- 172.21.15.146:0/1371019634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f3c0a0a70 0x7f7f3c0a0e40 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c009840 tx=0x7f7f2c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b358b4b83c216bfd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:14.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.537+0000 7f7f3affd700 1 -- 172.21.15.146:0/1371019634 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c011830 con 0x7f7f3c0a0a70 2023-10-03T10:18:14.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.537+0000 7f7f3affd700 1 -- 172.21.15.146:0/1371019634 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2c011990 con 0x7f7f3c0a0a70 2023-10-03T10:18:14.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.537+0000 7f7f3affd700 1 -- 172.21.15.146:0/1371019634 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c011d20 con 0x7f7f3c0a0a70 2023-10-03T10:18:14.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.538+0000 7f7f42854700 1 -- 172.21.15.146:0/1371019634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f3c0a0a70 msgr2=0x7f7f3c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.538+0000 7f7f42854700 1 --2- 172.21.15.146:0/1371019634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f3c0a0a70 0x7f7f3c0a0e40 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c009840 tx=0x7f7f2c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:14.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.538+0000 7f7f42854700 1 -- 172.21.15.146:0/1371019634 shutdown_connections 2023-10-03T10:18:14.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.538+0000 7f7f42854700 1 --2- 172.21.15.146:0/1371019634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f3c0a0a70 0x7f7f3c0a0e40 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.538+0000 7f7f42854700 1 --2- 172.21.15.146:0/1371019634 >> v2:172.21.15.146:3300/0 conn(0x7f7f3c133f50 0x7f7f3c1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.538+0000 7f7f42854700 1 --2- 172.21.15.146:0/1371019634 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f3c0a1380 0x7f7f3c133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.538+0000 7f7f42854700 1 -- 172.21.15.146:0/1371019634 >> 172.21.15.146:0/1371019634 conn(0x7f7f3c0a6610 msgr2=0x7f7f3c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.538+0000 7f7f42854700 1 -- 172.21.15.146:0/1371019634 shutdown_connections 2023-10-03T10:18:14.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.538+0000 7f7f42854700 1 -- 172.21.15.146:0/1371019634 wait complete. 2023-10-03T10:18:14.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.539+0000 7f7f42854700 1 Processor -- start 2023-10-03T10:18:14.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.539+0000 7f7f42854700 1 -- start start 2023-10-03T10:18:14.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.539+0000 7f7f42854700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f3c0a0a70 0x7f7f3c1224f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.539+0000 7f7f42854700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f3c0a1380 0x7f7f3c122a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.539+0000 7f7f42854700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f3c133f50 0x7f7f3c122f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.539+0000 7f7f42854700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c125d30 con 0x7f7f3c0a0a70 2023-10-03T10:18:14.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.539+0000 7f7f42854700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c1249d0 con 0x7f7f3c0a1380 2023-10-03T10:18:14.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.539+0000 7f7f42854700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c0a5150 con 0x7f7f3c133f50 2023-10-03T10:18:14.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.539+0000 7f7f3b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f3c0a1380 0x7f7f3c122a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.539+0000 7f7f3b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f3c0a1380 0x7f7f3c122a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57146/0 (socket says 172.21.15.146:57146) 2023-10-03T10:18:14.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.539+0000 7f7f3b7fe700 1 -- 172.21.15.146:0/4188036997 learned_addr learned my addr 172.21.15.146:0/4188036997 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:14.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.539+0000 7f7f3bfff700 1 --2- 172.21.15.146:0/4188036997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f3c0a0a70 0x7f7f3c1224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.539+0000 7f7f40df1700 1 --2- 172.21.15.146:0/4188036997 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f3c133f50 0x7f7f3c122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.540+0000 7f7f3b7fe700 1 -- 172.21.15.146:0/4188036997 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f3c133f50 msgr2=0x7f7f3c122f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.540+0000 7f7f3b7fe700 1 --2- 172.21.15.146:0/4188036997 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f3c133f50 0x7f7f3c122f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.540+0000 7f7f3b7fe700 1 -- 172.21.15.146:0/4188036997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f3c0a0a70 msgr2=0x7f7f3c1224f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.540+0000 7f7f3b7fe700 1 --2- 172.21.15.146:0/4188036997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f3c0a0a70 0x7f7f3c1224f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.540+0000 7f7f3b7fe700 1 -- 172.21.15.146:0/4188036997 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f30009550 con 0x7f7f3c0a1380 2023-10-03T10:18:14.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.540+0000 7f7f3b7fe700 1 --2- 172.21.15.146:0/4188036997 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f3c0a1380 0x7f7f3c122a30 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f7f3000ebe0 tx=0x7f7f3000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:14.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.540+0000 7f7f38ff9700 1 -- 172.21.15.146:0/4188036997 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f30004240 con 0x7f7f3c0a1380 2023-10-03T10:18:14.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.540+0000 7f7f38ff9700 1 -- 172.21.15.146:0/4188036997 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f300043a0 con 0x7f7f3c0a1380 2023-10-03T10:18:14.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.540+0000 7f7f42854700 1 -- 172.21.15.146:0/4188036997 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f34009a70 con 0x7f7f3c0a1380 2023-10-03T10:18:14.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.540+0000 7f7f38ff9700 1 -- 172.21.15.146:0/4188036997 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f300036a0 con 0x7f7f3c0a1380 2023-10-03T10:18:14.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.540+0000 7f7f42854700 1 -- 172.21.15.146:0/4188036997 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2c0094a0 con 0x7f7f3c0a1380 2023-10-03T10:18:14.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.541+0000 7f7f38ff9700 1 -- 172.21.15.146:0/4188036997 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f30003800 con 0x7f7f3c0a1380 2023-10-03T10:18:14.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.541+0000 7f7f42854700 1 -- 172.21.15.146:0/4188036997 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f3c11f050 con 0x7f7f3c0a1380 2023-10-03T10:18:14.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.541+0000 7f7f38ff9700 1 -- 172.21.15.146:0/4188036997 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7f3003f7e0 con 0x7f7f3c0a1380 2023-10-03T10:18:14.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.546+0000 7f7f38ff9700 1 -- 172.21.15.146:0/4188036997 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f3000c5e0 con 0x7f7f3c0a1380 2023-10-03T10:18:14.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.580+0000 7f52fda2e700 1 Processor -- start 2023-10-03T10:18:14.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.580+0000 7f52fda2e700 1 -- start start 2023-10-03T10:18:14.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.581+0000 7f52fda2e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52f809bd20 0x7f52f809c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.581+0000 7f52fda2e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52f81337d0 0x7f52f8133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.581+0000 7f52fda2e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f809a8e0 con 0x7f52f8134160 2023-10-03T10:18:14.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.581+0000 7f52fda2e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f809ad30 con 0x7f52f81337d0 2023-10-03T10:18:14.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.581+0000 7f52fda2e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f809a620 con 0x7f52f809bd20 2023-10-03T10:18:14.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.581+0000 7f52f67fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52f81337d0 0x7f52f8133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.581+0000 7f52f77fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f52f8134160 0x7f52f813ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33670/0 (socket says 172.21.15.146:33670) 2023-10-03T10:18:14.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.581+0000 7f52f77fe700 1 -- 172.21.15.146:0/3895359610 learned_addr learned my addr 172.21.15.146:0/3895359610 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:14.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.581+0000 7f52f6ffd700 1 --2- 172.21.15.146:0/3895359610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52f809bd20 0x7f52f809c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.581+0000 7f52f67fc700 1 -- 172.21.15.146:0/3895359610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52f809bd20 msgr2=0x7f52f809c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:14.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.581+0000 7f52f67fc700 1 --2- 172.21.15.146:0/3895359610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52f809bd20 0x7f52f809c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.581+0000 7f52f67fc700 1 -- 172.21.15.146:0/3895359610 >> v1:172.21.15.146:6789/0 conn(0x7f52f8134160 legacy=0x7f52f813ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.581+0000 7f52f67fc700 1 -- 172.21.15.146:0/3895359610 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f809b840 con 0x7f52f81337d0 2023-10-03T10:18:14.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.581+0000 7f52f5ffb700 1 -- 172.21.15.146:0/3895359610 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737183838 0 0) 0x7f52f809a8e0 con 0x7f52f8134160 2023-10-03T10:18:14.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.581+0000 7f52f67fc700 1 --2- 172.21.15.146:0/3895359610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52f81337d0 0x7f52f8133c20 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f52ec009840 tx=0x7f52ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be4532e06924c36 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:14.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.582+0000 7f52f5ffb700 1 -- 172.21.15.146:0/3895359610 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec011830 con 0x7f52f81337d0 2023-10-03T10:18:14.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.582+0000 7f52f5ffb700 1 -- 172.21.15.146:0/3895359610 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec011990 con 0x7f52f81337d0 2023-10-03T10:18:14.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.582+0000 7f52f5ffb700 1 -- 172.21.15.146:0/3895359610 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec011d20 con 0x7f52f81337d0 2023-10-03T10:18:14.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.582+0000 7f52fda2e700 1 -- 172.21.15.146:0/3895359610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52f81337d0 msgr2=0x7f52f8133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.582+0000 7f52fda2e700 1 --2- 172.21.15.146:0/3895359610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52f81337d0 0x7f52f8133c20 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f52ec009840 tx=0x7f52ec009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:14.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.582+0000 7f52fda2e700 1 -- 172.21.15.146:0/3895359610 shutdown_connections 2023-10-03T10:18:14.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.582+0000 7f52fda2e700 1 --2- 172.21.15.146:0/3895359610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52f809bd20 0x7f52f809c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.582+0000 7f52fda2e700 1 --2- 172.21.15.146:0/3895359610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52f81337d0 0x7f52f8133c20 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.582+0000 7f52fda2e700 1 -- 172.21.15.146:0/3895359610 >> 172.21.15.146:0/3895359610 conn(0x7f52f809f9f0 msgr2=0x7f52f809fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.582+0000 7f52fda2e700 1 -- 172.21.15.146:0/3895359610 shutdown_connections 2023-10-03T10:18:14.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.582+0000 7f52fda2e700 1 -- 172.21.15.146:0/3895359610 wait complete. 2023-10-03T10:18:14.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.583+0000 7f52fda2e700 1 Processor -- start 2023-10-03T10:18:14.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.584+0000 7f52fda2e700 1 -- start start 2023-10-03T10:18:14.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.584+0000 7f52fda2e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52f809bd20 0x7f52f811dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.584+0000 7f52fda2e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52f81337d0 0x7f52f811e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.584+0000 7f52fda2e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52f8134160 0x7f52f811ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.584+0000 7f52fda2e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f811f460 con 0x7f52f81337d0 2023-10-03T10:18:14.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.584+0000 7f52fda2e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f811fbc0 con 0x7f52f8134160 2023-10-03T10:18:14.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.584+0000 7f52fda2e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52f81201e0 con 0x7f52f809bd20 2023-10-03T10:18:14.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.585+0000 7f52f77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52f8134160 0x7f52f811ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.585+0000 7f52f77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52f8134160 0x7f52f811ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57168/0 (socket says 172.21.15.146:57168) 2023-10-03T10:18:14.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.585+0000 7f52f77fe700 1 -- 172.21.15.146:0/1815674110 learned_addr learned my addr 172.21.15.146:0/1815674110 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:14.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.585+0000 7f52f67fc700 1 --2- 172.21.15.146:0/1815674110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52f81337d0 0x7f52f811e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.585+0000 7f52f6ffd700 1 --2- 172.21.15.146:0/1815674110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52f809bd20 0x7f52f811dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.585+0000 7f52f67fc700 1 -- 172.21.15.146:0/1815674110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52f809bd20 msgr2=0x7f52f811dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.585+0000 7f52f67fc700 1 --2- 172.21.15.146:0/1815674110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52f809bd20 0x7f52f811dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.585+0000 7f52f67fc700 1 -- 172.21.15.146:0/1815674110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52f8134160 msgr2=0x7f52f811ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.585+0000 7f52f67fc700 1 --2- 172.21.15.146:0/1815674110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52f8134160 0x7f52f811ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.585+0000 7f52f67fc700 1 -- 172.21.15.146:0/1815674110 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec0094a0 con 0x7f52f81337d0 2023-10-03T10:18:14.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.585+0000 7f52f77fe700 1 --2- 172.21.15.146:0/1815674110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52f8134160 0x7f52f811ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:14.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.585+0000 7f52f67fc700 1 --2- 172.21.15.146:0/1815674110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52f81337d0 0x7f52f811e4f0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f52f8134870 tx=0x7f52ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:14.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.585+0000 7f52dffff700 1 -- 172.21.15.146:0/1815674110 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec004400 con 0x7f52f81337d0 2023-10-03T10:18:14.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.585+0000 7f52dffff700 1 -- 172.21.15.146:0/1815674110 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec01f070 con 0x7f52f81337d0 2023-10-03T10:18:14.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.585+0000 7f52fda2e700 1 -- 172.21.15.146:0/1815674110 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f81217f0 con 0x7f52f81337d0 2023-10-03T10:18:14.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.585+0000 7f52dffff700 1 -- 172.21.15.146:0/1815674110 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0038a0 con 0x7f52f81337d0 2023-10-03T10:18:14.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.585+0000 7f52fda2e700 1 -- 172.21.15.146:0/1815674110 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f80a12e0 con 0x7f52f81337d0 2023-10-03T10:18:14.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.586+0000 7f52dffff700 1 -- 172.21.15.146:0/1815674110 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52ec021030 con 0x7f52f81337d0 2023-10-03T10:18:14.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.586+0000 7f52dffff700 1 -- 172.21.15.146:0/1815674110 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f52ec0408c0 con 0x7f52f81337d0 2023-10-03T10:18:14.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.586+0000 7f52fda2e700 1 -- 172.21.15.146:0/1815674110 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f811ad60 con 0x7f52f81337d0 2023-10-03T10:18:14.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.591+0000 7f52dffff700 1 -- 172.21.15.146:0/1815674110 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52ec004560 con 0x7f52f81337d0 2023-10-03T10:18:14.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.687+0000 7f4946862700 1 -- 172.21.15.146:0/3106110743 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4940137ed0 con 0x7f494009d860 2023-10-03T10:18:14.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.688+0000 7f493cff9700 1 -- 172.21.15.146:0/3106110743 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4930034090 con 0x7f494009d860 2023-10-03T10:18:14.689 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:14.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.690+0000 7f4946862700 1 -- 172.21.15.146:0/3106110743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f494009d860 msgr2=0x7f4940135be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.690+0000 7f4946862700 1 --2- 172.21.15.146:0/3106110743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f494009d860 0x7f4940135be0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4930009fd0 tx=0x7f4930004750 comp rx=0 tx=0).stop 2023-10-03T10:18:14.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.690+0000 7f4946862700 1 -- 172.21.15.146:0/3106110743 shutdown_connections 2023-10-03T10:18:14.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.690+0000 7f4946862700 1 --2- 172.21.15.146:0/3106110743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4940130eb0 0x7f4940136660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.690+0000 7f4946862700 1 --2- 172.21.15.146:0/3106110743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f494009d860 0x7f4940135be0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.690+0000 7f4946862700 1 --2- 172.21.15.146:0/3106110743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f494009e170 0x7f4940136120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.690+0000 7f4946862700 1 -- 172.21.15.146:0/3106110743 >> 172.21.15.146:0/3106110743 conn(0x7f4940099c40 msgr2=0x7f4940139640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.690+0000 7f4946862700 1 -- 172.21.15.146:0/3106110743 shutdown_connections 2023-10-03T10:18:14.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.690+0000 7f4946862700 1 -- 172.21.15.146:0/3106110743 wait complete. 2023-10-03T10:18:14.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:14.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.742+0000 7f7f42854700 1 -- 172.21.15.146:0/4188036997 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7f3c124f80 con 0x7f7f3c0a1380 2023-10-03T10:18:14.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.743+0000 7f7f38ff9700 1 -- 172.21.15.146:0/4188036997 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7f30011580 con 0x7f7f3c0a1380 2023-10-03T10:18:14.743 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:14.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.745+0000 7f7f42854700 1 -- 172.21.15.146:0/4188036997 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f3c0a1380 msgr2=0x7f7f3c122a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.745+0000 7f7f42854700 1 --2- 172.21.15.146:0/4188036997 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f3c0a1380 0x7f7f3c122a30 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f7f3000ebe0 tx=0x7f7f3000eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.745+0000 7f7f42854700 1 -- 172.21.15.146:0/4188036997 shutdown_connections 2023-10-03T10:18:14.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.745+0000 7f7f42854700 1 --2- 172.21.15.146:0/4188036997 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7f3c133f50 0x7f7f3c122f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.745+0000 7f7f42854700 1 --2- 172.21.15.146:0/4188036997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f3c0a0a70 0x7f7f3c1224f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.745+0000 7f7f42854700 1 --2- 172.21.15.146:0/4188036997 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f3c0a1380 0x7f7f3c122a30 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.745+0000 7f7f42854700 1 -- 172.21.15.146:0/4188036997 >> 172.21.15.146:0/4188036997 conn(0x7f7f3c0a6610 msgr2=0x7f7f3c09c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.745+0000 7f7f42854700 1 -- 172.21.15.146:0/4188036997 shutdown_connections 2023-10-03T10:18:14.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.745+0000 7f7f42854700 1 -- 172.21.15.146:0/4188036997 wait complete. 2023-10-03T10:18:14.758 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:14.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.785+0000 7f52fda2e700 1 -- 172.21.15.146:0/1815674110 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f52f809cc90 con 0x7f52f81337d0 2023-10-03T10:18:14.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.785+0000 7f52dffff700 1 -- 172.21.15.146:0/1815674110 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f52ec015020 con 0x7f52f81337d0 2023-10-03T10:18:14.786 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:14.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.787+0000 7f52fda2e700 1 -- 172.21.15.146:0/1815674110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52f81337d0 msgr2=0x7f52f811e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.787+0000 7f52fda2e700 1 --2- 172.21.15.146:0/1815674110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52f81337d0 0x7f52f811e4f0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f52f8134870 tx=0x7f52ec004750 comp rx=0 tx=0).stop 2023-10-03T10:18:14.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.787+0000 7f52fda2e700 1 -- 172.21.15.146:0/1815674110 shutdown_connections 2023-10-03T10:18:14.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.787+0000 7f52fda2e700 1 --2- 172.21.15.146:0/1815674110 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52f8134160 0x7f52f811ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.787+0000 7f52fda2e700 1 --2- 172.21.15.146:0/1815674110 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52f809bd20 0x7f52f811dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.787+0000 7f52fda2e700 1 --2- 172.21.15.146:0/1815674110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52f81337d0 0x7f52f811e4f0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.787+0000 7f52fda2e700 1 -- 172.21.15.146:0/1815674110 >> 172.21.15.146:0/1815674110 conn(0x7f52f809f9f0 msgr2=0x7f52f8132fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.788+0000 7f52fda2e700 1 -- 172.21.15.146:0/1815674110 shutdown_connections 2023-10-03T10:18:14.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:14.788+0000 7f52fda2e700 1 -- 172.21.15.146:0/1815674110 wait complete. 2023-10-03T10:18:14.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:15.301 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:15.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.424+0000 7fd4654e6700 1 Processor -- start 2023-10-03T10:18:15.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.424+0000 7fd4654e6700 1 -- start start 2023-10-03T10:18:15.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.424+0000 7fd4654e6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4600a0a90 0x7fd4600a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.424+0000 7fd4654e6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd4600a13a0 0x7fd460133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.424+0000 7fd4654e6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4600a1fe0 con 0x7fd460133f70 2023-10-03T10:18:15.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.424+0000 7fd4654e6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4600a3aa0 con 0x7fd4600a13a0 2023-10-03T10:18:15.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.424+0000 7fd4654e6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd46009a540 con 0x7fd4600a0a90 2023-10-03T10:18:15.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.424+0000 7fd45effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4600a0a90 0x7fd4600a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.424+0000 7fd45e7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd4600a13a0 0x7fd460133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.424+0000 7fd45f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd460133f70 0x7fd46013ae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33684/0 (socket says 172.21.15.146:33684) 2023-10-03T10:18:15.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.424+0000 7fd45f7fe700 1 -- 172.21.15.146:0/2033181459 learned_addr learned my addr 172.21.15.146:0/2033181459 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:15.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.425+0000 7fd45e7fc700 1 -- 172.21.15.146:0/2033181459 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4600a0a90 msgr2=0x7fd4600a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:15.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.425+0000 7fd45e7fc700 1 --2- 172.21.15.146:0/2033181459 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4600a0a90 0x7fd4600a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.425+0000 7fd45e7fc700 1 -- 172.21.15.146:0/2033181459 >> v1:172.21.15.146:6789/0 conn(0x7fd460133f70 legacy=0x7fd46013ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.425+0000 7fd45dffb700 1 -- 172.21.15.146:0/2033181459 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187729391 0 0) 0x7fd4600a1fe0 con 0x7fd460133f70 2023-10-03T10:18:15.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.425+0000 7fd45e7fc700 1 -- 172.21.15.146:0/2033181459 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46009a280 con 0x7fd4600a13a0 2023-10-03T10:18:15.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.425+0000 7fd45effd700 1 --2- 172.21.15.146:0/2033181459 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4600a0a90 0x7fd4600a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.425+0000 7fd45e7fc700 1 --2- 172.21.15.146:0/2033181459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4600a13a0 0x7fd460133a30 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fd450009840 tx=0x7fd450009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1edc8bbdc77a22b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.425+0000 7fd45dffb700 1 -- 172.21.15.146:0/2033181459 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd450011830 con 0x7fd4600a13a0 2023-10-03T10:18:15.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.425+0000 7fd45dffb700 1 -- 172.21.15.146:0/2033181459 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd450011990 con 0x7fd4600a13a0 2023-10-03T10:18:15.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.425+0000 7fd45dffb700 1 -- 172.21.15.146:0/2033181459 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd450011d20 con 0x7fd4600a13a0 2023-10-03T10:18:15.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.426+0000 7fd4654e6700 1 -- 172.21.15.146:0/2033181459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4600a13a0 msgr2=0x7fd460133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.426+0000 7fd4654e6700 1 --2- 172.21.15.146:0/2033181459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4600a13a0 0x7fd460133a30 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fd450009840 tx=0x7fd450009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:15.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.426+0000 7fd4654e6700 1 -- 172.21.15.146:0/2033181459 shutdown_connections 2023-10-03T10:18:15.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.426+0000 7fd4654e6700 1 --2- 172.21.15.146:0/2033181459 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd4600a0a90 0x7fd4600a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.426+0000 7fd4654e6700 1 --2- 172.21.15.146:0/2033181459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4600a13a0 0x7fd460133a30 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.426+0000 7fd4654e6700 1 -- 172.21.15.146:0/2033181459 >> 172.21.15.146:0/2033181459 conn(0x7fd460099c40 msgr2=0x7fd46006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.426+0000 7fd4654e6700 1 -- 172.21.15.146:0/2033181459 shutdown_connections 2023-10-03T10:18:15.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.426+0000 7fd4654e6700 1 -- 172.21.15.146:0/2033181459 wait complete. 2023-10-03T10:18:15.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.427+0000 7fd4654e6700 1 Processor -- start 2023-10-03T10:18:15.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.427+0000 7fd4654e6700 1 -- start start 2023-10-03T10:18:15.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.427+0000 7fd4654e6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4600a0a90 0x7fd4601c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.427+0000 7fd4654e6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4600a13a0 0x7fd4601c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.427+0000 7fd4654e6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd460133f70 0x7fd4601c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.427+0000 7fd4654e6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd460120c70 con 0x7fd4600a0a90 2023-10-03T10:18:15.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.427+0000 7fd4654e6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd460120810 con 0x7fd4600a13a0 2023-10-03T10:18:15.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.427+0000 7fd4654e6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd460122530 con 0x7fd460133f70 2023-10-03T10:18:15.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.427+0000 7fd45f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd460133f70 0x7fd4601c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.427+0000 7fd45e7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4600a13a0 0x7fd4601c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.427+0000 7fd45effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4600a0a90 0x7fd4601c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.427+0000 7fd45e7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4600a13a0 0x7fd4601c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57180/0 (socket says 172.21.15.146:57180) 2023-10-03T10:18:15.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.427+0000 7fd45e7fc700 1 -- 172.21.15.146:0/304613638 learned_addr learned my addr 172.21.15.146:0/304613638 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:15.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.427+0000 7fd45f7fe700 1 --2- 172.21.15.146:0/304613638 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd460133f70 0x7fd4601c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54510/0 (socket says 172.21.15.146:54510) 2023-10-03T10:18:15.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.428+0000 7fd45f7fe700 1 -- 172.21.15.146:0/304613638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4600a13a0 msgr2=0x7fd4601c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.428+0000 7fd45f7fe700 1 --2- 172.21.15.146:0/304613638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4600a13a0 0x7fd4601c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.428+0000 7fd45f7fe700 1 -- 172.21.15.146:0/304613638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4600a0a90 msgr2=0x7fd4601c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.428+0000 7fd45f7fe700 1 --2- 172.21.15.146:0/304613638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4600a0a90 0x7fd4601c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.428+0000 7fd45f7fe700 1 -- 172.21.15.146:0/304613638 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4540094a0 con 0x7fd460133f70 2023-10-03T10:18:15.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.428+0000 7fd45e7fc700 1 --2- 172.21.15.146:0/304613638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4600a13a0 0x7fd4601c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.428+0000 7fd45effd700 1 --2- 172.21.15.146:0/304613638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4600a0a90 0x7fd4601c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.428+0000 7fd45f7fe700 1 --2- 172.21.15.146:0/304613638 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd460133f70 0x7fd4601c8c10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd45800cc10 tx=0x7fd45800cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.428+0000 7fd4477fe700 1 -- 172.21.15.146:0/304613638 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45800aa00 con 0x7fd460133f70 2023-10-03T10:18:15.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.428+0000 7fd4477fe700 1 -- 172.21.15.146:0/304613638 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45800ab80 con 0x7fd460133f70 2023-10-03T10:18:15.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.428+0000 7fd4477fe700 1 -- 172.21.15.146:0/304613638 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4580070d0 con 0x7fd460133f70 2023-10-03T10:18:15.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.428+0000 7fd4654e6700 1 -- 172.21.15.146:0/304613638 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4500094a0 con 0x7fd460133f70 2023-10-03T10:18:15.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.428+0000 7fd4654e6700 1 -- 172.21.15.146:0/304613638 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd460122250 con 0x7fd460133f70 2023-10-03T10:18:15.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.429+0000 7fd4477fe700 1 -- 172.21.15.146:0/304613638 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd458007230 con 0x7fd460133f70 2023-10-03T10:18:15.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.429+0000 7fd4477fe700 1 -- 172.21.15.146:0/304613638 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd45803f070 con 0x7fd460133f70 2023-10-03T10:18:15.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.429+0000 7fd4654e6700 1 -- 172.21.15.146:0/304613638 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4601220b0 con 0x7fd460133f70 2023-10-03T10:18:15.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.433+0000 7fd4477fe700 1 -- 172.21.15.146:0/304613638 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd4601220b0 con 0x7fd460133f70 2023-10-03T10:18:15.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.617+0000 7fd4654e6700 1 -- 172.21.15.146:0/304613638 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd4601220b0 con 0x7fd460133f70 2023-10-03T10:18:15.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.617+0000 7fd4477fe700 1 -- 172.21.15.146:0/304613638 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd4601220b0 con 0x7fd460133f70 2023-10-03T10:18:15.618 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:15.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.620+0000 7fd4654e6700 1 -- 172.21.15.146:0/304613638 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd460133f70 msgr2=0x7fd4601c8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.620+0000 7fd4654e6700 1 --2- 172.21.15.146:0/304613638 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd460133f70 0x7fd4601c8c10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd45800cc10 tx=0x7fd45800cf20 comp rx=0 tx=0).stop 2023-10-03T10:18:15.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.620+0000 7fd4654e6700 1 -- 172.21.15.146:0/304613638 shutdown_connections 2023-10-03T10:18:15.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.620+0000 7fd4654e6700 1 --2- 172.21.15.146:0/304613638 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd460133f70 0x7fd4601c8c10 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.620+0000 7fd4654e6700 1 --2- 172.21.15.146:0/304613638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4600a0a90 0x7fd4601c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.620+0000 7fd4654e6700 1 --2- 172.21.15.146:0/304613638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4600a13a0 0x7fd4601c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.620+0000 7fd4654e6700 1 -- 172.21.15.146:0/304613638 >> 172.21.15.146:0/304613638 conn(0x7fd460099c40 msgr2=0x7fd4601bbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.620+0000 7fd4654e6700 1 -- 172.21.15.146:0/304613638 shutdown_connections 2023-10-03T10:18:15.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.620+0000 7fd4654e6700 1 -- 172.21.15.146:0/304613638 wait complete. 2023-10-03T10:18:15.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:15.705 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:15.759 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:15.801 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:15.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.833+0000 7f26408c7700 1 Processor -- start 2023-10-03T10:18:15.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.833+0000 7f26408c7700 1 -- start start 2023-10-03T10:18:15.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.834+0000 7f26408c7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f263c06a770 0x7f263c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.834+0000 7f26408c7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f263c136cb0 0x7f263c139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.834+0000 7f26408c7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c06e900 con 0x7f263c09dec0 2023-10-03T10:18:15.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.834+0000 7f26408c7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c09d180 con 0x7f263c06a770 2023-10-03T10:18:15.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.834+0000 7f26408c7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f263c09e780 con 0x7f263c136cb0 2023-10-03T10:18:15.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.835+0000 7f2639d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f263c09dec0 0x7f263c06b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33686/0 (socket says 172.21.15.146:33686) 2023-10-03T10:18:15.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.835+0000 7f2639d9b700 1 -- 172.21.15.146:0/386360890 learned_addr learned my addr 172.21.15.146:0/386360890 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.835+0000 7f263ad9d700 1 --2- 172.21.15.146:0/386360890 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f263c136cb0 0x7f263c139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.835+0000 7f263a59c700 1 --2- 172.21.15.146:0/386360890 >> v2:172.21.15.146:3300/0 conn(0x7f263c06a770 0x7f263c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.835+0000 7f263959a700 1 -- 172.21.15.146:0/386360890 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271228930 0 0) 0x7f263c06e900 con 0x7f263c09dec0 2023-10-03T10:18:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.835+0000 7f263959a700 1 -- 172.21.15.146:0/386360890 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26240035b0 con 0x7f263c09dec0 2023-10-03T10:18:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.835+0000 7f263ad9d700 1 -- 172.21.15.146:0/386360890 >> v2:172.21.15.146:3300/0 conn(0x7f263c06a770 msgr2=0x7f263c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.835+0000 7f263ad9d700 1 --2- 172.21.15.146:0/386360890 >> v2:172.21.15.146:3300/0 conn(0x7f263c06a770 0x7f263c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.835+0000 7f263ad9d700 1 -- 172.21.15.146:0/386360890 >> v1:172.21.15.146:6789/0 conn(0x7f263c09dec0 legacy=0x7f263c06b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.835+0000 7f263ad9d700 1 -- 172.21.15.146:0/386360890 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263c09d3c0 con 0x7f263c136cb0 2023-10-03T10:18:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.835+0000 7f263a59c700 1 --2- 172.21.15.146:0/386360890 >> v2:172.21.15.146:3300/0 conn(0x7f263c06a770 0x7f263c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.835+0000 7f263ad9d700 1 --2- 172.21.15.146:0/386360890 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f263c136cb0 0x7f263c139090 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2634009d90 tx=0x7f263400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a8e6171a905ee42 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.835+0000 7f263959a700 1 -- 172.21.15.146:0/386360890 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263400e070 con 0x7f263c136cb0 2023-10-03T10:18:15.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.835+0000 7f263959a700 1 -- 172.21.15.146:0/386360890 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263400bb20 con 0x7f263c136cb0 2023-10-03T10:18:15.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.835+0000 7f263959a700 1 -- 172.21.15.146:0/386360890 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263400be90 con 0x7f263c136cb0 2023-10-03T10:18:15.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.836+0000 7f26408c7700 1 -- 172.21.15.146:0/386360890 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f263c136cb0 msgr2=0x7f263c139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.836+0000 7f26408c7700 1 --2- 172.21.15.146:0/386360890 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f263c136cb0 0x7f263c139090 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2634009d90 tx=0x7f263400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:15.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.836+0000 7f26408c7700 1 -- 172.21.15.146:0/386360890 shutdown_connections 2023-10-03T10:18:15.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.836+0000 7f26408c7700 1 --2- 172.21.15.146:0/386360890 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f263c136cb0 0x7f263c139090 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.836+0000 7f26408c7700 1 --2- 172.21.15.146:0/386360890 >> v2:172.21.15.146:3300/0 conn(0x7f263c06a770 0x7f263c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.836+0000 7f26408c7700 1 -- 172.21.15.146:0/386360890 >> 172.21.15.146:0/386360890 conn(0x7f263c099c40 msgr2=0x7f263c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.836+0000 7f26408c7700 1 -- 172.21.15.146:0/386360890 shutdown_connections 2023-10-03T10:18:15.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.836+0000 7f26408c7700 1 -- 172.21.15.146:0/386360890 wait complete. 2023-10-03T10:18:15.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.837+0000 7f26408c7700 1 Processor -- start 2023-10-03T10:18:15.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.837+0000 7f26408c7700 1 -- start start 2023-10-03T10:18:15.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.838+0000 7f26408c7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f263c06a770 0x7f263c09a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.838+0000 7f26408c7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f263c09dec0 0x7f263c09a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.838+0000 7f26408c7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f263c136cb0 0x7f263c09af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.838+0000 7f26408c7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263c135670 con 0x7f263c06a770 2023-10-03T10:18:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.838+0000 7f26408c7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263c136800 con 0x7f263c09dec0 2023-10-03T10:18:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.838+0000 7f26408c7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f263c1391b0 con 0x7f263c136cb0 2023-10-03T10:18:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.838+0000 7f263a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f263c06a770 0x7f263c09a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.838+0000 7f2639d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f263c09dec0 0x7f263c09a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.838+0000 7f263a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f263c06a770 0x7f263c09a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39602/0 (socket says 172.21.15.146:39602) 2023-10-03T10:18:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.838+0000 7f263a59c700 1 -- 172.21.15.146:0/2182711982 learned_addr learned my addr 172.21.15.146:0/2182711982 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.838+0000 7f263ad9d700 1 --2- 172.21.15.146:0/2182711982 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f263c136cb0 0x7f263c09af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.838+0000 7f263a59c700 1 -- 172.21.15.146:0/2182711982 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f263c136cb0 msgr2=0x7f263c09af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.838+0000 7f263a59c700 1 --2- 172.21.15.146:0/2182711982 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f263c136cb0 0x7f263c09af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.838+0000 7f263a59c700 1 -- 172.21.15.146:0/2182711982 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f263c09dec0 msgr2=0x7f263c09a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.838+0000 7f263a59c700 1 --2- 172.21.15.146:0/2182711982 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f263c09dec0 0x7f263c09a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.838+0000 7f263a59c700 1 -- 172.21.15.146:0/2182711982 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262c0094a0 con 0x7f263c06a770 2023-10-03T10:18:15.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.838+0000 7f2639d9b700 1 --2- 172.21.15.146:0/2182711982 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f263c09dec0 0x7f263c09a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.838+0000 7f263ad9d700 1 --2- 172.21.15.146:0/2182711982 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f263c136cb0 0x7f263c09af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.838+0000 7f263a59c700 1 --2- 172.21.15.146:0/2182711982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f263c06a770 0x7f263c09a490 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f262c00ebe0 tx=0x7f262c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.838+0000 7f262affd700 1 -- 172.21.15.146:0/2182711982 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c00c850 con 0x7f263c06a770 2023-10-03T10:18:15.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.839+0000 7f262affd700 1 -- 172.21.15.146:0/2182711982 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262c00c9b0 con 0x7f263c06a770 2023-10-03T10:18:15.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.839+0000 7f26408c7700 1 -- 172.21.15.146:0/2182711982 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2634009a70 con 0x7f263c06a770 2023-10-03T10:18:15.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.839+0000 7f262affd700 1 -- 172.21.15.146:0/2182711982 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c00cd40 con 0x7f263c06a770 2023-10-03T10:18:15.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.839+0000 7f26408c7700 1 -- 172.21.15.146:0/2182711982 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263c135b80 con 0x7f263c06a770 2023-10-03T10:18:15.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.840+0000 7f262affd700 1 -- 172.21.15.146:0/2182711982 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f262c013470 con 0x7f263c06a770 2023-10-03T10:18:15.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.840+0000 7f262affd700 1 -- 172.21.15.146:0/2182711982 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f262c03f7b0 con 0x7f263c06a770 2023-10-03T10:18:15.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.840+0000 7f26408c7700 1 -- 172.21.15.146:0/2182711982 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f263c04f2a0 con 0x7f263c06a770 2023-10-03T10:18:15.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.848+0000 7f262affd700 1 -- 172.21.15.146:0/2182711982 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f262c013720 con 0x7f263c06a770 2023-10-03T10:18:15.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.889+0000 7fcfc015a700 1 Processor -- start 2023-10-03T10:18:15.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.889+0000 7fcfc015a700 1 -- start start 2023-10-03T10:18:15.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.890+0000 7fcfc015a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcfb809e870 0x7fcfb809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.890+0000 7fcfc015a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfb8134330 0x7fcfb813be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.890+0000 7fcfc015a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb809fa00 con 0x7fcfb809f180 2023-10-03T10:18:15.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.890+0000 7fcfc015a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb80a0370 con 0x7fcfb809e870 2023-10-03T10:18:15.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.890+0000 7fcfc015a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb806bec0 con 0x7fcfb8134330 2023-10-03T10:18:15.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.890+0000 7fcfbe6f7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfb8134330 0x7fcfb813be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.890+0000 7fcfbdef6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcfb809e870 0x7fcfb809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.890+0000 7fcfbe6f7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfb8134330 0x7fcfb813be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54536/0 (socket says 172.21.15.146:54536) 2023-10-03T10:18:15.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.890+0000 7fcfbd6f5700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcfb809f180 0x7fcfb8133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33692/0 (socket says 172.21.15.146:33692) 2023-10-03T10:18:15.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.890+0000 7fcfbe6f7700 1 -- 172.21.15.146:0/3875638269 learned_addr learned my addr 172.21.15.146:0/3875638269 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:15.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.890+0000 7fcfbdef6700 1 -- 172.21.15.146:0/3875638269 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfb8134330 msgr2=0x7fcfb813be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:15.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.890+0000 7fcfbdef6700 1 --2- 172.21.15.146:0/3875638269 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfb8134330 0x7fcfb813be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.890+0000 7fcfbdef6700 1 -- 172.21.15.146:0/3875638269 >> v1:172.21.15.146:6789/0 conn(0x7fcfb809f180 legacy=0x7fcfb8133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.890+0000 7fcfbdef6700 1 -- 172.21.15.146:0/3875638269 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb809ada0 con 0x7fcfb809e870 2023-10-03T10:18:15.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.890+0000 7fcfbcef4700 1 -- 172.21.15.146:0/3875638269 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970528146 0 0) 0x7fcfb809fa00 con 0x7fcfb809f180 2023-10-03T10:18:15.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.890+0000 7fcfbe6f7700 1 --2- 172.21.15.146:0/3875638269 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfb8134330 0x7fcfb813be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.890+0000 7fcfbdef6700 1 --2- 172.21.15.146:0/3875638269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfb809e870 0x7fcfb809ec40 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009840 tx=0x7fcfb4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a117dd63c74e8f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.891+0000 7fcfbcef4700 1 -- 172.21.15.146:0/3875638269 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4011830 con 0x7fcfb809e870 2023-10-03T10:18:15.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.891+0000 7fcfbcef4700 1 -- 172.21.15.146:0/3875638269 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb4011990 con 0x7fcfb809e870 2023-10-03T10:18:15.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.891+0000 7fcfbcef4700 1 -- 172.21.15.146:0/3875638269 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4011d20 con 0x7fcfb809e870 2023-10-03T10:18:15.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.891+0000 7fcfc015a700 1 -- 172.21.15.146:0/3875638269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfb809e870 msgr2=0x7fcfb809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.891+0000 7fcfc015a700 1 --2- 172.21.15.146:0/3875638269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfb809e870 0x7fcfb809ec40 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009840 tx=0x7fcfb4009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:15.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.891+0000 7fcfc015a700 1 -- 172.21.15.146:0/3875638269 shutdown_connections 2023-10-03T10:18:15.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.891+0000 7fcfc015a700 1 --2- 172.21.15.146:0/3875638269 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfb8134330 0x7fcfb813be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.891+0000 7fcfc015a700 1 --2- 172.21.15.146:0/3875638269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfb809e870 0x7fcfb809ec40 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.891+0000 7fcfc015a700 1 -- 172.21.15.146:0/3875638269 >> 172.21.15.146:0/3875638269 conn(0x7fcfb80a4430 msgr2=0x7fcfb80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.891+0000 7fcfc015a700 1 -- 172.21.15.146:0/3875638269 shutdown_connections 2023-10-03T10:18:15.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.891+0000 7fcfc015a700 1 -- 172.21.15.146:0/3875638269 wait complete. 2023-10-03T10:18:15.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.892+0000 7fcfc015a700 1 Processor -- start 2023-10-03T10:18:15.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.892+0000 7fcfc015a700 1 -- start start 2023-10-03T10:18:15.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.893+0000 7fcfc015a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfb809e870 0x7fcfb8122950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.893+0000 7fcfc015a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfb809f180 0x7fcfb8122e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.893+0000 7fcfc015a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfb8134330 0x7fcfb81233d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.893+0000 7fcfc015a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb8124560 con 0x7fcfb8134330 2023-10-03T10:18:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.893+0000 7fcfc015a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb81334e0 con 0x7fcfb809e870 2023-10-03T10:18:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.893+0000 7fcfc015a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb8125ed0 con 0x7fcfb809f180 2023-10-03T10:18:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.893+0000 7fcfbdef6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfb809e870 0x7fcfb8122950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.893+0000 7fcfbdef6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfb809e870 0x7fcfb8122950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57204/0 (socket says 172.21.15.146:57204) 2023-10-03T10:18:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.893+0000 7fcfbdef6700 1 -- 172.21.15.146:0/3537952071 learned_addr learned my addr 172.21.15.146:0/3537952071 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.893+0000 7fcfbd6f5700 1 --2- 172.21.15.146:0/3537952071 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfb809f180 0x7fcfb8122e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.893+0000 7fcfbe6f7700 1 --2- 172.21.15.146:0/3537952071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfb8134330 0x7fcfb81233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.893+0000 7fcfbdef6700 1 -- 172.21.15.146:0/3537952071 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfb809f180 msgr2=0x7fcfb8122e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.893+0000 7fcfbdef6700 1 --2- 172.21.15.146:0/3537952071 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfb809f180 0x7fcfb8122e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.893+0000 7fcfbdef6700 1 -- 172.21.15.146:0/3537952071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfb8134330 msgr2=0x7fcfb81233d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.893+0000 7fcfbdef6700 1 --2- 172.21.15.146:0/3537952071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfb8134330 0x7fcfb81233d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.893+0000 7fcfbdef6700 1 -- 172.21.15.146:0/3537952071 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb0009b30 con 0x7fcfb809e870 2023-10-03T10:18:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.893+0000 7fcfbdef6700 1 --2- 172.21.15.146:0/3537952071 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfb809e870 0x7fcfb8122950 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40090b0 tx=0x7fcfb4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.894+0000 7fcfae7fc700 1 -- 172.21.15.146:0/3537952071 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4004550 con 0x7fcfb809e870 2023-10-03T10:18:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.894+0000 7fcfae7fc700 1 -- 172.21.15.146:0/3537952071 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb401f070 con 0x7fcfb809e870 2023-10-03T10:18:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.894+0000 7fcfc015a700 1 -- 172.21.15.146:0/3537952071 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb40094a0 con 0x7fcfb809e870 2023-10-03T10:18:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.894+0000 7fcfae7fc700 1 -- 172.21.15.146:0/3537952071 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40038e0 con 0x7fcfb809e870 2023-10-03T10:18:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.894+0000 7fcfc015a700 1 -- 172.21.15.146:0/3537952071 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb81264c0 con 0x7fcfb809e870 2023-10-03T10:18:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.894+0000 7fcfae7fc700 1 -- 172.21.15.146:0/3537952071 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcfb4003a40 con 0x7fcfb809e870 2023-10-03T10:18:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.895+0000 7fcfae7fc700 1 -- 172.21.15.146:0/3537952071 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcfb4021070 con 0x7fcfb809e870 2023-10-03T10:18:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.895+0000 7fcfc015a700 1 -- 172.21.15.146:0/3537952071 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb81264c0 con 0x7fcfb809e870 2023-10-03T10:18:15.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.899+0000 7fcfae7fc700 1 -- 172.21.15.146:0/3537952071 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcfb81264c0 con 0x7fcfb809e870 2023-10-03T10:18:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.930+0000 7f4d5781d700 1 Processor -- start 2023-10-03T10:18:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.930+0000 7f4d5781d700 1 -- start start 2023-10-03T10:18:15.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.931+0000 7f4d5781d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d50133ad0 0x7f4d50133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.931+0000 7f4d5781d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d50130bc0 0x7f4d5013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.931+0000 7f4d5781d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5006b2d0 con 0x7f4d501300a0 2023-10-03T10:18:15.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.931+0000 7f4d5781d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d50133610 con 0x7f4d50130bc0 2023-10-03T10:18:15.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.931+0000 7f4d5781d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5009a500 con 0x7f4d50133ad0 2023-10-03T10:18:15.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.931+0000 7f4d555b9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d50133ad0 0x7f4d50133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.931+0000 7f4d54db8700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4d501300a0 0x7f4d501304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33702/0 (socket says 172.21.15.146:33702) 2023-10-03T10:18:15.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.931+0000 7f4d54db8700 1 -- 172.21.15.146:0/2518265021 learned_addr learned my addr 172.21.15.146:0/2518265021 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:15.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.931+0000 7f4d55dba700 1 --2- 172.21.15.146:0/2518265021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d50130bc0 0x7f4d5013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.931+0000 7f4d47fff700 1 -- 172.21.15.146:0/2518265021 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3597773112 0 0) 0x7f4d5006b2d0 con 0x7f4d501300a0 2023-10-03T10:18:15.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.931+0000 7f4d555b9700 1 -- 172.21.15.146:0/2518265021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d50130bc0 msgr2=0x7f4d5013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:15.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.931+0000 7f4d555b9700 1 --2- 172.21.15.146:0/2518265021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d50130bc0 0x7f4d5013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.931+0000 7f4d555b9700 1 -- 172.21.15.146:0/2518265021 >> v1:172.21.15.146:6789/0 conn(0x7f4d501300a0 legacy=0x7f4d501304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.931+0000 7f4d555b9700 1 -- 172.21.15.146:0/2518265021 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d501338b0 con 0x7f4d50133ad0 2023-10-03T10:18:15.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.931+0000 7f4d55dba700 1 --2- 172.21.15.146:0/2518265021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d50130bc0 0x7f4d5013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.932+0000 7f4d555b9700 1 --2- 172.21.15.146:0/2518265021 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d50133ad0 0x7f4d50133ea0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c009870 tx=0x7f4d4c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd6bf07dbd477209 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.932+0000 7f4d47fff700 1 -- 172.21.15.146:0/2518265021 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c011830 con 0x7f4d50133ad0 2023-10-03T10:18:15.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.932+0000 7f4d47fff700 1 -- 172.21.15.146:0/2518265021 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4c011990 con 0x7f4d50133ad0 2023-10-03T10:18:15.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.932+0000 7f4d47fff700 1 -- 172.21.15.146:0/2518265021 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c011d20 con 0x7f4d50133ad0 2023-10-03T10:18:15.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.932+0000 7f4d5781d700 1 -- 172.21.15.146:0/2518265021 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d50133ad0 msgr2=0x7f4d50133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.932+0000 7f4d5781d700 1 --2- 172.21.15.146:0/2518265021 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d50133ad0 0x7f4d50133ea0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c009870 tx=0x7f4d4c009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:15.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.932+0000 7f4d5781d700 1 -- 172.21.15.146:0/2518265021 shutdown_connections 2023-10-03T10:18:15.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.932+0000 7f4d5781d700 1 --2- 172.21.15.146:0/2518265021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d50130bc0 0x7f4d5013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.932+0000 7f4d5781d700 1 --2- 172.21.15.146:0/2518265021 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d50133ad0 0x7f4d50133ea0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.932+0000 7f4d5781d700 1 -- 172.21.15.146:0/2518265021 >> 172.21.15.146:0/2518265021 conn(0x7f4d50099c40 msgr2=0x7f4d500a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.932+0000 7f4d5781d700 1 -- 172.21.15.146:0/2518265021 shutdown_connections 2023-10-03T10:18:15.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.932+0000 7f4d5781d700 1 -- 172.21.15.146:0/2518265021 wait complete. 2023-10-03T10:18:15.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.933+0000 7f4d5781d700 1 Processor -- start 2023-10-03T10:18:15.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.933+0000 7f4d5781d700 1 -- start start 2023-10-03T10:18:15.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.934+0000 7f4d5781d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d501300a0 0x7f4d5011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.934+0000 7f4d5781d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d50130bc0 0x7f4d5011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.934+0000 7f4d5781d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d50133ad0 0x7f4d5011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.934+0000 7f4d5781d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d50120950 con 0x7f4d50130bc0 2023-10-03T10:18:15.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.934+0000 7f4d5781d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5012d930 con 0x7f4d501300a0 2023-10-03T10:18:15.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.934+0000 7f4d5781d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5011fd00 con 0x7f4d50133ad0 2023-10-03T10:18:15.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.934+0000 7f4d54db8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d50130bc0 0x7f4d5011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.934+0000 7f4d54db8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d50130bc0 0x7f4d5011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39620/0 (socket says 172.21.15.146:39620) 2023-10-03T10:18:15.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.934+0000 7f4d54db8700 1 -- 172.21.15.146:0/496299122 learned_addr learned my addr 172.21.15.146:0/496299122 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:15.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.934+0000 7f4d55dba700 1 --2- 172.21.15.146:0/496299122 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d50133ad0 0x7f4d5011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.934+0000 7f4d555b9700 1 --2- 172.21.15.146:0/496299122 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d501300a0 0x7f4d5011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.934+0000 7f4d55dba700 1 -- 172.21.15.146:0/496299122 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d501300a0 msgr2=0x7f4d5011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.934+0000 7f4d55dba700 1 --2- 172.21.15.146:0/496299122 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d501300a0 0x7f4d5011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.934+0000 7f4d55dba700 1 -- 172.21.15.146:0/496299122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d50130bc0 msgr2=0x7f4d5011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.934+0000 7f4d55dba700 1 --2- 172.21.15.146:0/496299122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d50130bc0 0x7f4d5011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.934+0000 7f4d55dba700 1 -- 172.21.15.146:0/496299122 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d48009a70 con 0x7f4d50133ad0 2023-10-03T10:18:15.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.934+0000 7f4d555b9700 1 --2- 172.21.15.146:0/496299122 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d501300a0 0x7f4d5011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.934+0000 7f4d54db8700 1 --2- 172.21.15.146:0/496299122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d50130bc0 0x7f4d5011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.935+0000 7f4d55dba700 1 --2- 172.21.15.146:0/496299122 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d50133ad0 0x7f4d5011e4c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4d4800efc0 tx=0x7f4d4800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.935+0000 7f4d45ffb700 1 -- 172.21.15.146:0/496299122 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4800ca90 con 0x7f4d50133ad0 2023-10-03T10:18:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.935+0000 7f4d45ffb700 1 -- 172.21.15.146:0/496299122 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4800f040 con 0x7f4d50133ad0 2023-10-03T10:18:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.935+0000 7f4d45ffb700 1 -- 172.21.15.146:0/496299122 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4800ce30 con 0x7f4d50133ad0 2023-10-03T10:18:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.935+0000 7f4d5781d700 1 -- 172.21.15.146:0/496299122 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4c0094a0 con 0x7f4d50133ad0 2023-10-03T10:18:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.935+0000 7f4d5781d700 1 -- 172.21.15.146:0/496299122 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d500a33c0 con 0x7f4d50133ad0 2023-10-03T10:18:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.936+0000 7f4d45ffb700 1 -- 172.21.15.146:0/496299122 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d48014480 con 0x7f4d50133ad0 2023-10-03T10:18:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.936+0000 7f4d45ffb700 1 -- 172.21.15.146:0/496299122 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4d4803fc20 con 0x7f4d50133ad0 2023-10-03T10:18:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.936+0000 7f4d5781d700 1 -- 172.21.15.146:0/496299122 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d5004f2a0 con 0x7f4d50133ad0 2023-10-03T10:18:15.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:15.940+0000 7f4d45ffb700 1 -- 172.21.15.146:0/496299122 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d48012930 con 0x7f4d50133ad0 2023-10-03T10:18:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.046+0000 7f26408c7700 1 -- 172.21.15.146:0/2182711982 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f263c1357e0 con 0x7f263c06a770 2023-10-03T10:18:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.047+0000 7f262affd700 1 -- 172.21.15.146:0/2182711982 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f263c1357e0 con 0x7f263c06a770 2023-10-03T10:18:16.048 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:16.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.050+0000 7f26408c7700 1 -- 172.21.15.146:0/2182711982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f263c06a770 msgr2=0x7f263c09a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.050+0000 7f26408c7700 1 --2- 172.21.15.146:0/2182711982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f263c06a770 0x7f263c09a490 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f262c00ebe0 tx=0x7f262c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.050+0000 7f26408c7700 1 -- 172.21.15.146:0/2182711982 shutdown_connections 2023-10-03T10:18:16.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.050+0000 7f26408c7700 1 --2- 172.21.15.146:0/2182711982 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f263c136cb0 0x7f263c09af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.050+0000 7f26408c7700 1 --2- 172.21.15.146:0/2182711982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f263c06a770 0x7f263c09a490 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.050+0000 7f26408c7700 1 --2- 172.21.15.146:0/2182711982 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f263c09dec0 0x7f263c09a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.050+0000 7f26408c7700 1 -- 172.21.15.146:0/2182711982 >> 172.21.15.146:0/2182711982 conn(0x7f263c099c40 msgr2=0x7f263c0a2810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.050+0000 7f26408c7700 1 -- 172.21.15.146:0/2182711982 shutdown_connections 2023-10-03T10:18:16.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.050+0000 7f26408c7700 1 -- 172.21.15.146:0/2182711982 wait complete. 2023-10-03T10:18:16.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:16.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.105+0000 7fcfc015a700 1 -- 172.21.15.146:0/3537952071 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcfb81264c0 con 0x7fcfb809e870 2023-10-03T10:18:16.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.105+0000 7fcfae7fc700 1 -- 172.21.15.146:0/3537952071 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcfb81264c0 con 0x7fcfb809e870 2023-10-03T10:18:16.106 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:16.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.108+0000 7fcfc015a700 1 -- 172.21.15.146:0/3537952071 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfb809e870 msgr2=0x7fcfb8122950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.108+0000 7fcfc015a700 1 --2- 172.21.15.146:0/3537952071 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfb809e870 0x7fcfb8122950 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40090b0 tx=0x7fcfb4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:16.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.108+0000 7fcfc015a700 1 -- 172.21.15.146:0/3537952071 shutdown_connections 2023-10-03T10:18:16.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.108+0000 7fcfc015a700 1 --2- 172.21.15.146:0/3537952071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfb8134330 0x7fcfb81233d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.108+0000 7fcfc015a700 1 --2- 172.21.15.146:0/3537952071 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcfb809e870 0x7fcfb8122950 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.108+0000 7fcfc015a700 1 --2- 172.21.15.146:0/3537952071 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcfb809f180 0x7fcfb8122e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.108+0000 7fcfc015a700 1 -- 172.21.15.146:0/3537952071 >> 172.21.15.146:0/3537952071 conn(0x7fcfb80a4430 msgr2=0x7fcfb8070f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.108+0000 7fcfc015a700 1 -- 172.21.15.146:0/3537952071 shutdown_connections 2023-10-03T10:18:16.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.108+0000 7fcfc015a700 1 -- 172.21.15.146:0/3537952071 wait complete. 2023-10-03T10:18:16.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:16.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.134+0000 7f4d5781d700 1 -- 172.21.15.146:0/496299122 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4d5006c3b0 con 0x7f4d50133ad0 2023-10-03T10:18:16.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.134+0000 7f4d45ffb700 1 -- 172.21.15.146:0/496299122 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d48012340 con 0x7f4d50133ad0 2023-10-03T10:18:16.135 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:16.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.137+0000 7f4d5781d700 1 -- 172.21.15.146:0/496299122 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d50133ad0 msgr2=0x7f4d5011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.137+0000 7f4d5781d700 1 --2- 172.21.15.146:0/496299122 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d50133ad0 0x7f4d5011e4c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4d4800efc0 tx=0x7f4d4800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.137+0000 7f4d5781d700 1 -- 172.21.15.146:0/496299122 shutdown_connections 2023-10-03T10:18:16.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.137+0000 7f4d5781d700 1 --2- 172.21.15.146:0/496299122 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4d50133ad0 0x7f4d5011e4c0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.137+0000 7f4d5781d700 1 --2- 172.21.15.146:0/496299122 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4d501300a0 0x7f4d5011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.137+0000 7f4d5781d700 1 --2- 172.21.15.146:0/496299122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d50130bc0 0x7f4d5011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.137+0000 7f4d5781d700 1 -- 172.21.15.146:0/496299122 >> 172.21.15.146:0/496299122 conn(0x7f4d50099c40 msgr2=0x7f4d5012e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.137+0000 7f4d5781d700 1 -- 172.21.15.146:0/496299122 shutdown_connections 2023-10-03T10:18:16.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.137+0000 7f4d5781d700 1 -- 172.21.15.146:0/496299122 wait complete. 2023-10-03T10:18:16.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:16.633 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:16.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.757+0000 7fab2c3e8700 1 Processor -- start 2023-10-03T10:18:16.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.757+0000 7fab2c3e8700 1 -- start start 2023-10-03T10:18:16.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.758+0000 7fab2c3e8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fab24133ad0 0x7fab24133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.758+0000 7fab2c3e8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab241300a0 0x7fab241304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.758+0000 7fab2c3e8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2406b2d0 con 0x7fab241309f0 2023-10-03T10:18:16.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.758+0000 7fab2c3e8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab24133610 con 0x7fab24133ad0 2023-10-03T10:18:16.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.758+0000 7fab2c3e8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab2409a500 con 0x7fab241300a0 2023-10-03T10:18:16.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.758+0000 7fab2a184700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fab24133ad0 0x7fab24133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.758+0000 7fab29983700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab241300a0 0x7fab241304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.758+0000 7fab2a985700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fab241309f0 0x7fab2413a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33714/0 (socket says 172.21.15.146:33714) 2023-10-03T10:18:16.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.758+0000 7fab2a985700 1 -- 172.21.15.146:0/3882706619 learned_addr learned my addr 172.21.15.146:0/3882706619 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:16.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.758+0000 7fab29983700 1 -- 172.21.15.146:0/3882706619 >> v2:172.21.15.146:3300/0 conn(0x7fab24133ad0 msgr2=0x7fab24133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:16.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.758+0000 7fab29983700 1 --2- 172.21.15.146:0/3882706619 >> v2:172.21.15.146:3300/0 conn(0x7fab24133ad0 0x7fab24133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.758+0000 7fab29983700 1 -- 172.21.15.146:0/3882706619 >> v1:172.21.15.146:6789/0 conn(0x7fab241309f0 legacy=0x7fab2413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.758+0000 7fab29983700 1 -- 172.21.15.146:0/3882706619 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab241338b0 con 0x7fab241300a0 2023-10-03T10:18:16.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.758+0000 7fab2a184700 1 --2- 172.21.15.146:0/3882706619 >> v2:172.21.15.146:3300/0 conn(0x7fab24133ad0 0x7fab24133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.758+0000 7fab29983700 1 --2- 172.21.15.146:0/3882706619 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab241300a0 0x7fab241304b0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fab20009840 tx=0x7fab20009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f9ecce566c21385 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.758+0000 7fab29182700 1 -- 172.21.15.146:0/3882706619 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab20011830 con 0x7fab241300a0 2023-10-03T10:18:16.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.758+0000 7fab29182700 1 -- 172.21.15.146:0/3882706619 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab20011990 con 0x7fab241300a0 2023-10-03T10:18:16.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.758+0000 7fab29182700 1 -- 172.21.15.146:0/3882706619 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab20011d20 con 0x7fab241300a0 2023-10-03T10:18:16.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.759+0000 7fab2c3e8700 1 -- 172.21.15.146:0/3882706619 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab241300a0 msgr2=0x7fab241304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.759+0000 7fab2c3e8700 1 --2- 172.21.15.146:0/3882706619 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab241300a0 0x7fab241304b0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fab20009840 tx=0x7fab20009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:16.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.759+0000 7fab2c3e8700 1 -- 172.21.15.146:0/3882706619 shutdown_connections 2023-10-03T10:18:16.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.759+0000 7fab2c3e8700 1 --2- 172.21.15.146:0/3882706619 >> v2:172.21.15.146:3300/0 conn(0x7fab24133ad0 0x7fab24133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.759+0000 7fab2c3e8700 1 --2- 172.21.15.146:0/3882706619 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab241300a0 0x7fab241304b0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.759+0000 7fab2c3e8700 1 -- 172.21.15.146:0/3882706619 >> 172.21.15.146:0/3882706619 conn(0x7fab24099c40 msgr2=0x7fab240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.759+0000 7fab2c3e8700 1 -- 172.21.15.146:0/3882706619 shutdown_connections 2023-10-03T10:18:16.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.759+0000 7fab2c3e8700 1 -- 172.21.15.146:0/3882706619 wait complete. 2023-10-03T10:18:16.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.760+0000 7fab2c3e8700 1 Processor -- start 2023-10-03T10:18:16.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.760+0000 7fab2c3e8700 1 -- start start 2023-10-03T10:18:16.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.761+0000 7fab2c3e8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab241300a0 0x7fab2411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.761+0000 7fab2c3e8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab241309f0 0x7fab2411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.761+0000 7fab2c3e8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab24133ad0 0x7fab2411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.761+0000 7fab2c3e8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2412fdf0 con 0x7fab241300a0 2023-10-03T10:18:16.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.761+0000 7fab2c3e8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2412dd00 con 0x7fab24133ad0 2023-10-03T10:18:16.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.761+0000 7fab2c3e8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab24072380 con 0x7fab241309f0 2023-10-03T10:18:16.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.761+0000 7fab2a184700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab241300a0 0x7fab2411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.761+0000 7fab2a184700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab241300a0 0x7fab2411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39650/0 (socket says 172.21.15.146:39650) 2023-10-03T10:18:16.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.761+0000 7fab2a985700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab24133ad0 0x7fab2411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.761+0000 7fab2a184700 1 -- 172.21.15.146:0/1227216369 learned_addr learned my addr 172.21.15.146:0/1227216369 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:16.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.761+0000 7fab29983700 1 --2- 172.21.15.146:0/1227216369 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab241309f0 0x7fab2411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.761+0000 7fab2a184700 1 -- 172.21.15.146:0/1227216369 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab241309f0 msgr2=0x7fab2411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.761+0000 7fab2a184700 1 --2- 172.21.15.146:0/1227216369 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab241309f0 0x7fab2411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.761+0000 7fab2a184700 1 -- 172.21.15.146:0/1227216369 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab24133ad0 msgr2=0x7fab2411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.761+0000 7fab2a184700 1 --2- 172.21.15.146:0/1227216369 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab24133ad0 0x7fab2411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.761+0000 7fab2a184700 1 -- 172.21.15.146:0/1227216369 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab140094a0 con 0x7fab241300a0 2023-10-03T10:18:16.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.761+0000 7fab2a985700 1 --2- 172.21.15.146:0/1227216369 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab24133ad0 0x7fab2411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.762+0000 7fab2a184700 1 --2- 172.21.15.146:0/1227216369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab241300a0 0x7fab2411da40 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fab1400ebe0 tx=0x7fab1400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.762+0000 7fab1affd700 1 -- 172.21.15.146:0/1227216369 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1400c850 con 0x7fab241300a0 2023-10-03T10:18:16.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.762+0000 7fab1affd700 1 -- 172.21.15.146:0/1227216369 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1400c9b0 con 0x7fab241300a0 2023-10-03T10:18:16.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.762+0000 7fab2c3e8700 1 -- 172.21.15.146:0/1227216369 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab200094a0 con 0x7fab241300a0 2023-10-03T10:18:16.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.762+0000 7fab1affd700 1 -- 172.21.15.146:0/1227216369 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1400cd40 con 0x7fab241300a0 2023-10-03T10:18:16.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.762+0000 7fab2c3e8700 1 -- 172.21.15.146:0/1227216369 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2411ff20 con 0x7fab241300a0 2023-10-03T10:18:16.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.762+0000 7fab1affd700 1 -- 172.21.15.146:0/1227216369 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab14013470 con 0x7fab241300a0 2023-10-03T10:18:16.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.763+0000 7fab2c3e8700 1 -- 172.21.15.146:0/1227216369 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab2404f2a0 con 0x7fab241300a0 2023-10-03T10:18:16.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.763+0000 7fab1affd700 1 -- 172.21.15.146:0/1227216369 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fab1403fb50 con 0x7fab241300a0 2023-10-03T10:18:16.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.767+0000 7fab1affd700 1 -- 172.21.15.146:0/1227216369 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab14017020 con 0x7fab241300a0 2023-10-03T10:18:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.956+0000 7fab2c3e8700 1 -- 172.21.15.146:0/1227216369 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fab2406c3b0 con 0x7fab241300a0 2023-10-03T10:18:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.956+0000 7fab1affd700 1 -- 172.21.15.146:0/1227216369 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab1400cea0 con 0x7fab241300a0 2023-10-03T10:18:16.957 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:16.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.958+0000 7fab2c3e8700 1 -- 172.21.15.146:0/1227216369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab241300a0 msgr2=0x7fab2411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.958+0000 7fab2c3e8700 1 --2- 172.21.15.146:0/1227216369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab241300a0 0x7fab2411da40 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fab1400ebe0 tx=0x7fab1400eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.959+0000 7fab2c3e8700 1 -- 172.21.15.146:0/1227216369 shutdown_connections 2023-10-03T10:18:16.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.959+0000 7fab2c3e8700 1 --2- 172.21.15.146:0/1227216369 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab24133ad0 0x7fab2411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.959+0000 7fab2c3e8700 1 --2- 172.21.15.146:0/1227216369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab241300a0 0x7fab2411da40 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.959+0000 7fab2c3e8700 1 --2- 172.21.15.146:0/1227216369 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fab241309f0 0x7fab2411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.959+0000 7fab2c3e8700 1 -- 172.21.15.146:0/1227216369 >> 172.21.15.146:0/1227216369 conn(0x7fab24099c40 msgr2=0x7fab24131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.959+0000 7fab2c3e8700 1 -- 172.21.15.146:0/1227216369 shutdown_connections 2023-10-03T10:18:16.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:16.959+0000 7fab2c3e8700 1 -- 172.21.15.146:0/1227216369 wait complete. 2023-10-03T10:18:16.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:17.068 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:17.121 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:17.149 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:17.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.203+0000 7f90461ec700 1 Processor -- start 2023-10-03T10:18:17.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.203+0000 7f90461ec700 1 -- start start 2023-10-03T10:18:17.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.204+0000 7f90461ec700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f904009f350 0x7f9040136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.204+0000 7f90461ec700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90401371c0 0x7f90401395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.204+0000 7f90461ec700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904009c970 con 0x7f904009e870 2023-10-03T10:18:17.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.204+0000 7f90461ec700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90400a0920 con 0x7f904009f350 2023-10-03T10:18:17.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.204+0000 7f90461ec700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f904009f9c0 con 0x7f90401371c0 2023-10-03T10:18:17.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.204+0000 7f903effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f904009f350 0x7f9040136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.204+0000 7f903f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f904009e870 0x7f904009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33718/0 (socket says 172.21.15.146:33718) 2023-10-03T10:18:17.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.204+0000 7f903f7fe700 1 -- 172.21.15.146:0/359420406 learned_addr learned my addr 172.21.15.146:0/359420406 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:17.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.204+0000 7f903ffff700 1 --2- 172.21.15.146:0/359420406 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90401371c0 0x7f90401395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.204+0000 7f903ffff700 1 -- 172.21.15.146:0/359420406 >> v2:172.21.15.146:3300/0 conn(0x7f904009f350 msgr2=0x7f9040136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:17.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.204+0000 7f903ffff700 1 --2- 172.21.15.146:0/359420406 >> v2:172.21.15.146:3300/0 conn(0x7f904009f350 0x7f9040136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.204+0000 7f903ffff700 1 -- 172.21.15.146:0/359420406 >> v1:172.21.15.146:6789/0 conn(0x7f904009e870 legacy=0x7f904009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.204+0000 7f903ffff700 1 -- 172.21.15.146:0/359420406 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904009bab0 con 0x7f90401371c0 2023-10-03T10:18:17.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.204+0000 7f903e7fc700 1 -- 172.21.15.146:0/359420406 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118067801 0 0) 0x7f904009c970 con 0x7f904009e870 2023-10-03T10:18:17.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.204+0000 7f903effd700 1 --2- 172.21.15.146:0/359420406 >> v2:172.21.15.146:3300/0 conn(0x7f904009f350 0x7f9040136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.205+0000 7f903ffff700 1 --2- 172.21.15.146:0/359420406 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90401371c0 0x7f90401395a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f9038009d90 tx=0x7f903800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0365b43806d5213 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.205+0000 7f903e7fc700 1 -- 172.21.15.146:0/359420406 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903800e070 con 0x7f90401371c0 2023-10-03T10:18:17.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.205+0000 7f903e7fc700 1 -- 172.21.15.146:0/359420406 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903800bb20 con 0x7f90401371c0 2023-10-03T10:18:17.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.205+0000 7f903e7fc700 1 -- 172.21.15.146:0/359420406 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9038012430 con 0x7f90401371c0 2023-10-03T10:18:17.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.206+0000 7f90461ec700 1 -- 172.21.15.146:0/359420406 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90401371c0 msgr2=0x7f90401395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.206+0000 7f90461ec700 1 --2- 172.21.15.146:0/359420406 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90401371c0 0x7f90401395a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f9038009d90 tx=0x7f903800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:17.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.206+0000 7f90461ec700 1 -- 172.21.15.146:0/359420406 shutdown_connections 2023-10-03T10:18:17.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.206+0000 7f90461ec700 1 --2- 172.21.15.146:0/359420406 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f90401371c0 0x7f90401395a0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.206+0000 7f90461ec700 1 --2- 172.21.15.146:0/359420406 >> v2:172.21.15.146:3300/0 conn(0x7f904009f350 0x7f9040136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.206+0000 7f90461ec700 1 -- 172.21.15.146:0/359420406 >> 172.21.15.146:0/359420406 conn(0x7f90400a4430 msgr2=0x7f90400a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:17.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.206+0000 7f90461ec700 1 -- 172.21.15.146:0/359420406 shutdown_connections 2023-10-03T10:18:17.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.206+0000 7f90461ec700 1 -- 172.21.15.146:0/359420406 wait complete. 2023-10-03T10:18:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.207+0000 7f90461ec700 1 Processor -- start 2023-10-03T10:18:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.207+0000 7f90461ec700 1 -- start start 2023-10-03T10:18:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.208+0000 7f90461ec700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f904009e870 0x7f90401c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.208+0000 7f90461ec700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f904009f350 0x7f90401c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.208+0000 7f90461ec700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90401371c0 0x7f90401c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.208+0000 7f90461ec700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904006d6b0 con 0x7f904009f350 2023-10-03T10:18:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.208+0000 7f90461ec700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904006d4c0 con 0x7f90401371c0 2023-10-03T10:18:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.208+0000 7f90461ec700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90401263c0 con 0x7f904009e870 2023-10-03T10:18:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.208+0000 7f903f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f904009e870 0x7f90401c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.208+0000 7f903f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f904009e870 0x7f90401c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54614/0 (socket says 172.21.15.146:54614) 2023-10-03T10:18:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.208+0000 7f903f7fe700 1 -- 172.21.15.146:0/2459873213 learned_addr learned my addr 172.21.15.146:0/2459873213 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.208+0000 7f903ffff700 1 --2- 172.21.15.146:0/2459873213 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90401371c0 0x7f90401c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.208+0000 7f903effd700 1 --2- 172.21.15.146:0/2459873213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f904009f350 0x7f90401c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.209+0000 7f903f7fe700 1 -- 172.21.15.146:0/2459873213 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90401371c0 msgr2=0x7f90401c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.209+0000 7f903f7fe700 1 --2- 172.21.15.146:0/2459873213 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90401371c0 0x7f90401c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.209+0000 7f903f7fe700 1 -- 172.21.15.146:0/2459873213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f904009f350 msgr2=0x7f90401c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.209+0000 7f903f7fe700 1 --2- 172.21.15.146:0/2459873213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f904009f350 0x7f90401c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.209+0000 7f903f7fe700 1 -- 172.21.15.146:0/2459873213 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90340094a0 con 0x7f904009e870 2023-10-03T10:18:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.209+0000 7f903f7fe700 1 --2- 172.21.15.146:0/2459873213 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f904009e870 0x7f90401c8440 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f903000c550 tx=0x7f903000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.209+0000 7f9027fff700 1 -- 172.21.15.146:0/2459873213 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030004c80 con 0x7f904009e870 2023-10-03T10:18:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.209+0000 7f9027fff700 1 -- 172.21.15.146:0/2459873213 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9030004e00 con 0x7f904009e870 2023-10-03T10:18:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.209+0000 7f9027fff700 1 -- 172.21.15.146:0/2459873213 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030007310 con 0x7f904009e870 2023-10-03T10:18:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.209+0000 7f90461ec700 1 -- 172.21.15.146:0/2459873213 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9038009a70 con 0x7f904009e870 2023-10-03T10:18:17.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.209+0000 7f90461ec700 1 -- 172.21.15.146:0/2459873213 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9040124f10 con 0x7f904009e870 2023-10-03T10:18:17.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.210+0000 7f9027fff700 1 -- 172.21.15.146:0/2459873213 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9030007470 con 0x7f904009e870 2023-10-03T10:18:17.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.210+0000 7f9027fff700 1 -- 172.21.15.146:0/2459873213 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f903003f2d0 con 0x7f904009e870 2023-10-03T10:18:17.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.210+0000 7f90461ec700 1 -- 172.21.15.146:0/2459873213 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9040125ff0 con 0x7f904009e870 2023-10-03T10:18:17.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.219+0000 7f9027fff700 1 -- 172.21.15.146:0/2459873213 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f90300123b0 con 0x7f904009e870 2023-10-03T10:18:17.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.257+0000 7fe7d9c29700 1 Processor -- start 2023-10-03T10:18:17.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.257+0000 7fe7d9c29700 1 -- start start 2023-10-03T10:18:17.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.257+0000 7fe7d9c29700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d409e870 0x7fe7d409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.257+0000 7fe7d9c29700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d409f180 0x7fe7d4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.258+0000 7fe7d9c29700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe7d4131d70 0x7fe7d4132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.258+0000 7fe7d9c29700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d40a0920 con 0x7fe7d4131d70 2023-10-03T10:18:17.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.258+0000 7fe7d9c29700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d409c970 con 0x7fe7d409f180 2023-10-03T10:18:17.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.258+0000 7fe7d9c29700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d409bab0 con 0x7fe7d409e870 2023-10-03T10:18:17.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.258+0000 7fe7d2ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d409f180 0x7fe7d4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.258+0000 7fe7d37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d409e870 0x7fe7d409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.258+0000 7fe7d2ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d409f180 0x7fe7d4131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57242/0 (socket says 172.21.15.146:57242) 2023-10-03T10:18:17.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.258+0000 7fe7d37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d409e870 0x7fe7d409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54618/0 (socket says 172.21.15.146:54618) 2023-10-03T10:18:17.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.258+0000 7fe7d2ffd700 1 -- 172.21.15.146:0/2465274097 learned_addr learned my addr 172.21.15.146:0/2465274097 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:17.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.258+0000 7fe7d3fff700 1 --2- 172.21.15.146:0/2465274097 >> v2:172.21.15.146:3300/0 conn(0x7fe7d4131d70 0x7fe7d4132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.258+0000 7fe7d3fff700 1 -- 172.21.15.146:0/2465274097 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d409e870 msgr2=0x7fe7d409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:17.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.258+0000 7fe7d3fff700 1 --2- 172.21.15.146:0/2465274097 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d409e870 0x7fe7d409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.258+0000 7fe7d3fff700 1 -- 172.21.15.146:0/2465274097 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d409f180 msgr2=0x7fe7d4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:17.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.258+0000 7fe7d3fff700 1 --2- 172.21.15.146:0/2465274097 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d409f180 0x7fe7d4131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.258+0000 7fe7d3fff700 1 -- 172.21.15.146:0/2465274097 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d409f9c0 con 0x7fe7d4131d70 2023-10-03T10:18:17.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.258+0000 7fe7d2ffd700 1 --2- 172.21.15.146:0/2465274097 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d409f180 0x7fe7d4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.258+0000 7fe7d37fe700 1 --2- 172.21.15.146:0/2465274097 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d409e870 0x7fe7d409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.258+0000 7fe7d3fff700 1 --2- 172.21.15.146:0/2465274097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d4131d70 0x7fe7d4132210 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc009d90 tx=0x7fe7cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87ec8ca15692902 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.258+0000 7fe7d27fc700 1 -- 172.21.15.146:0/2465274097 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc00e070 con 0x7fe7d4131d70 2023-10-03T10:18:17.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.258+0000 7fe7d27fc700 1 -- 172.21.15.146:0/2465274097 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7cc00bb20 con 0x7fe7d4131d70 2023-10-03T10:18:17.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.258+0000 7fe7d27fc700 1 -- 172.21.15.146:0/2465274097 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc012430 con 0x7fe7d4131d70 2023-10-03T10:18:17.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.259+0000 7fe7d9c29700 1 -- 172.21.15.146:0/2465274097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d4131d70 msgr2=0x7fe7d4132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.259+0000 7fe7d9c29700 1 --2- 172.21.15.146:0/2465274097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d4131d70 0x7fe7d4132210 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc009d90 tx=0x7fe7cc00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:17.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.259+0000 7fe7d9c29700 1 -- 172.21.15.146:0/2465274097 shutdown_connections 2023-10-03T10:18:17.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.259+0000 7fe7d9c29700 1 --2- 172.21.15.146:0/2465274097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d4131d70 0x7fe7d4132210 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.259+0000 7fe7d9c29700 1 --2- 172.21.15.146:0/2465274097 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d409e870 0x7fe7d409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.259+0000 7fe7d9c29700 1 --2- 172.21.15.146:0/2465274097 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d409f180 0x7fe7d4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.259+0000 7fe7d9c29700 1 -- 172.21.15.146:0/2465274097 >> 172.21.15.146:0/2465274097 conn(0x7fe7d40a4430 msgr2=0x7fe7d40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:17.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.259+0000 7fe7d9c29700 1 -- 172.21.15.146:0/2465274097 shutdown_connections 2023-10-03T10:18:17.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.259+0000 7fe7d9c29700 1 -- 172.21.15.146:0/2465274097 wait complete. 2023-10-03T10:18:17.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.260+0000 7fe7d9c29700 1 Processor -- start 2023-10-03T10:18:17.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.260+0000 7fe7d9c29700 1 -- start start 2023-10-03T10:18:17.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.261+0000 7fe7d9c29700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d409e870 0x7fe7d411f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.261+0000 7fe7d9c29700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d409f180 0x7fe7d411f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.261+0000 7fe7d9c29700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d4131d70 0x7fe7d411fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.261+0000 7fe7d9c29700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d4121d80 con 0x7fe7d409f180 2023-10-03T10:18:17.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.261+0000 7fe7d9c29700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d4130640 con 0x7fe7d4131d70 2023-10-03T10:18:17.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.261+0000 7fe7d9c29700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d4120760 con 0x7fe7d409e870 2023-10-03T10:18:17.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.261+0000 7fe7d37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d409e870 0x7fe7d411f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.261+0000 7fe7d37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d409e870 0x7fe7d411f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54632/0 (socket says 172.21.15.146:54632) 2023-10-03T10:18:17.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.261+0000 7fe7d3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d4131d70 0x7fe7d411fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.261+0000 7fe7d37fe700 1 -- 172.21.15.146:0/3928011021 learned_addr learned my addr 172.21.15.146:0/3928011021 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:17.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.261+0000 7fe7d2ffd700 1 --2- 172.21.15.146:0/3928011021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d409f180 0x7fe7d411f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.261+0000 7fe7d37fe700 1 -- 172.21.15.146:0/3928011021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d4131d70 msgr2=0x7fe7d411fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.261+0000 7fe7d37fe700 1 --2- 172.21.15.146:0/3928011021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d4131d70 0x7fe7d411fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.261+0000 7fe7d37fe700 1 -- 172.21.15.146:0/3928011021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d409f180 msgr2=0x7fe7d411f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.261+0000 7fe7d37fe700 1 --2- 172.21.15.146:0/3928011021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d409f180 0x7fe7d411f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.261+0000 7fe7d37fe700 1 -- 172.21.15.146:0/3928011021 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c40094a0 con 0x7fe7d409e870 2023-10-03T10:18:17.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.261+0000 7fe7d2ffd700 1 --2- 172.21.15.146:0/3928011021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d409f180 0x7fe7d411f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:17.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.261+0000 7fe7d37fe700 1 --2- 172.21.15.146:0/3928011021 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d409e870 0x7fe7d411f370 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009e40 tx=0x7fe7c400eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.262+0000 7fe7bbfff700 1 -- 172.21.15.146:0/3928011021 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4009780 con 0x7fe7d409e870 2023-10-03T10:18:17.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.262+0000 7fe7bbfff700 1 -- 172.21.15.146:0/3928011021 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c4013860 con 0x7fe7d409e870 2023-10-03T10:18:17.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.262+0000 7fe7d9c29700 1 -- 172.21.15.146:0/3928011021 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c8009550 con 0x7fe7d409e870 2023-10-03T10:18:17.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.262+0000 7fe7bbfff700 1 -- 172.21.15.146:0/3928011021 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4013bf0 con 0x7fe7d409e870 2023-10-03T10:18:17.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.262+0000 7fe7d9c29700 1 -- 172.21.15.146:0/3928011021 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7cc009a70 con 0x7fe7d409e870 2023-10-03T10:18:17.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.263+0000 7fe7bbfff700 1 -- 172.21.15.146:0/3928011021 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe7c4013d50 con 0x7fe7d409e870 2023-10-03T10:18:17.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.263+0000 7fe7d9c29700 1 -- 172.21.15.146:0/3928011021 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d411be60 con 0x7fe7d409e870 2023-10-03T10:18:17.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.263+0000 7fe7bbfff700 1 -- 172.21.15.146:0/3928011021 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe7c40436d0 con 0x7fe7d409e870 2023-10-03T10:18:17.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.267+0000 7fe7bbfff700 1 -- 172.21.15.146:0/3928011021 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe7c401b440 con 0x7fe7d409e870 2023-10-03T10:18:17.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.296+0000 7f963de5f700 1 Processor -- start 2023-10-03T10:18:17.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.296+0000 7f963de5f700 1 -- start start 2023-10-03T10:18:17.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.297+0000 7f963de5f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f963809ad40 0x7f9638133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.297+0000 7f963de5f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9638133f70 0x7f96381343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.297+0000 7f963de5f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96380a0a70 0x7f96380a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.297+0000 7f963de5f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96380a3b60 con 0x7f963809ad40 2023-10-03T10:18:17.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.297+0000 7f963de5f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96381348e0 con 0x7f96380a0a70 2023-10-03T10:18:17.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.297+0000 7f963de5f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f963809b110 con 0x7f9638133f70 2023-10-03T10:18:17.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.297+0000 7f96377fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f963809ad40 0x7f9638133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.297+0000 7f96377fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f963809ad40 0x7f9638133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39708/0 (socket says 172.21.15.146:39708) 2023-10-03T10:18:17.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.297+0000 7f96377fe700 1 -- 172.21.15.146:0/1349364485 learned_addr learned my addr 172.21.15.146:0/1349364485 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:17.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.297+0000 7f9637fff700 1 --2- 172.21.15.146:0/1349364485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96380a0a70 0x7f96380a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.297+0000 7f9636ffd700 1 --2- 172.21.15.146:0/1349364485 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9638133f70 0x7f96381343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.297+0000 7f96377fe700 1 -- 172.21.15.146:0/1349364485 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9638133f70 msgr2=0x7f96381343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:17.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.297+0000 7f96377fe700 1 --2- 172.21.15.146:0/1349364485 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9638133f70 0x7f96381343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.297+0000 7f96377fe700 1 -- 172.21.15.146:0/1349364485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96380a0a70 msgr2=0x7f96380a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:17.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.297+0000 7f96377fe700 1 --2- 172.21.15.146:0/1349364485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96380a0a70 0x7f96380a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.297+0000 7f96377fe700 1 -- 172.21.15.146:0/1349364485 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96380a2fa0 con 0x7f963809ad40 2023-10-03T10:18:17.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.297+0000 7f9637fff700 1 --2- 172.21.15.146:0/1349364485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96380a0a70 0x7f96380a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.297+0000 7f96377fe700 1 --2- 172.21.15.146:0/1349364485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963809ad40 0x7f9638133a30 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f9628009920 tx=0x7f9628009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee80dbcae1f24c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.297+0000 7f96367fc700 1 -- 172.21.15.146:0/1349364485 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9628011830 con 0x7f963809ad40 2023-10-03T10:18:17.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.298+0000 7f96367fc700 1 -- 172.21.15.146:0/1349364485 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9628011990 con 0x7f963809ad40 2023-10-03T10:18:17.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.298+0000 7f96367fc700 1 -- 172.21.15.146:0/1349364485 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9628011d20 con 0x7f963809ad40 2023-10-03T10:18:17.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.298+0000 7f963de5f700 1 -- 172.21.15.146:0/1349364485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963809ad40 msgr2=0x7f9638133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.298+0000 7f963de5f700 1 --2- 172.21.15.146:0/1349364485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963809ad40 0x7f9638133a30 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f9628009920 tx=0x7f9628009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:17.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.298+0000 7f963de5f700 1 -- 172.21.15.146:0/1349364485 shutdown_connections 2023-10-03T10:18:17.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.298+0000 7f963de5f700 1 --2- 172.21.15.146:0/1349364485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96380a0a70 0x7f96380a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.298+0000 7f963de5f700 1 --2- 172.21.15.146:0/1349364485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963809ad40 0x7f9638133a30 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.298+0000 7f963de5f700 1 --2- 172.21.15.146:0/1349364485 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9638133f70 0x7f96381343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.298+0000 7f963de5f700 1 -- 172.21.15.146:0/1349364485 >> 172.21.15.146:0/1349364485 conn(0x7f9638099c40 msgr2=0x7f963806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:17.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.298+0000 7f963de5f700 1 -- 172.21.15.146:0/1349364485 shutdown_connections 2023-10-03T10:18:17.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.298+0000 7f963de5f700 1 -- 172.21.15.146:0/1349364485 wait complete. 2023-10-03T10:18:17.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.299+0000 7f963de5f700 1 Processor -- start 2023-10-03T10:18:17.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.299+0000 7f963de5f700 1 -- start start 2023-10-03T10:18:17.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.300+0000 7f963de5f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963809ad40 0x7f9638121470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.300+0000 7f963de5f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96380a0a70 0x7f96381219b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.300+0000 7f963de5f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9638133f70 0x7f9638121ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.300+0000 7f963de5f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9638123f00 con 0x7f963809ad40 2023-10-03T10:18:17.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.300+0000 7f963de5f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9638124cd0 con 0x7f96380a0a70 2023-10-03T10:18:17.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.300+0000 7f963de5f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96381327c0 con 0x7f9638133f70 2023-10-03T10:18:17.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.300+0000 7f96377fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963809ad40 0x7f9638121470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.300+0000 7f96377fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963809ad40 0x7f9638121470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39724/0 (socket says 172.21.15.146:39724) 2023-10-03T10:18:17.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.300+0000 7f96377fe700 1 -- 172.21.15.146:0/4015815856 learned_addr learned my addr 172.21.15.146:0/4015815856 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:17.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.300+0000 7f9636ffd700 1 --2- 172.21.15.146:0/4015815856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96380a0a70 0x7f96381219b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.300+0000 7f9637fff700 1 --2- 172.21.15.146:0/4015815856 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9638133f70 0x7f9638121ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.300+0000 7f96377fe700 1 -- 172.21.15.146:0/4015815856 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9638133f70 msgr2=0x7f9638121ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.300+0000 7f96377fe700 1 --2- 172.21.15.146:0/4015815856 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9638133f70 0x7f9638121ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.300+0000 7f96377fe700 1 -- 172.21.15.146:0/4015815856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96380a0a70 msgr2=0x7f96381219b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.300+0000 7f96377fe700 1 --2- 172.21.15.146:0/4015815856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96380a0a70 0x7f96381219b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.300+0000 7f96377fe700 1 -- 172.21.15.146:0/4015815856 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9630009a70 con 0x7f963809ad40 2023-10-03T10:18:17.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.300+0000 7f9636ffd700 1 --2- 172.21.15.146:0/4015815856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96380a0a70 0x7f96381219b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.300+0000 7f96377fe700 1 --2- 172.21.15.146:0/4015815856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963809ad40 0x7f9638121470 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f9628009130 tx=0x7f9628004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.301+0000 7f961ffff700 1 -- 172.21.15.146:0/4015815856 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9628004450 con 0x7f963809ad40 2023-10-03T10:18:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.301+0000 7f961ffff700 1 -- 172.21.15.146:0/4015815856 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962801e070 con 0x7f963809ad40 2023-10-03T10:18:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.301+0000 7f963de5f700 1 -- 172.21.15.146:0/4015815856 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9628009550 con 0x7f963809ad40 2023-10-03T10:18:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.301+0000 7f961ffff700 1 -- 172.21.15.146:0/4015815856 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96280038c0 con 0x7f963809ad40 2023-10-03T10:18:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.301+0000 7f963de5f700 1 -- 172.21.15.146:0/4015815856 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9638124970 con 0x7f963809ad40 2023-10-03T10:18:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.302+0000 7f961ffff700 1 -- 172.21.15.146:0/4015815856 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9628003a20 con 0x7f963809ad40 2023-10-03T10:18:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.302+0000 7f961ffff700 1 -- 172.21.15.146:0/4015815856 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9628020070 con 0x7f963809ad40 2023-10-03T10:18:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.302+0000 7f963de5f700 1 -- 172.21.15.146:0/4015815856 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f963811e060 con 0x7f963809ad40 2023-10-03T10:18:17.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.306+0000 7f961ffff700 1 -- 172.21.15.146:0/4015815856 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f962802a080 con 0x7f963809ad40 2023-10-03T10:18:17.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.415+0000 7f90461ec700 1 -- 172.21.15.146:0/2459873213 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f904004f2a0 con 0x7f904009e870 2023-10-03T10:18:17.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.416+0000 7f9027fff700 1 -- 172.21.15.146:0/2459873213 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9030011360 con 0x7f904009e870 2023-10-03T10:18:17.416 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.419+0000 7f90461ec700 1 -- 172.21.15.146:0/2459873213 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f904009e870 msgr2=0x7f90401c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.419+0000 7f90461ec700 1 --2- 172.21.15.146:0/2459873213 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f904009e870 0x7f90401c8440 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f903000c550 tx=0x7f903000c860 comp rx=0 tx=0).stop 2023-10-03T10:18:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.419+0000 7f90461ec700 1 -- 172.21.15.146:0/2459873213 shutdown_connections 2023-10-03T10:18:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.419+0000 7f90461ec700 1 --2- 172.21.15.146:0/2459873213 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90401371c0 0x7f90401c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.419+0000 7f90461ec700 1 --2- 172.21.15.146:0/2459873213 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f904009e870 0x7f90401c8440 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.419+0000 7f90461ec700 1 --2- 172.21.15.146:0/2459873213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f904009f350 0x7f90401c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.419+0000 7f90461ec700 1 -- 172.21.15.146:0/2459873213 >> 172.21.15.146:0/2459873213 conn(0x7f90400a4430 msgr2=0x7f90400a2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.419+0000 7f90461ec700 1 -- 172.21.15.146:0/2459873213 shutdown_connections 2023-10-03T10:18:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.419+0000 7f90461ec700 1 -- 172.21.15.146:0/2459873213 wait complete. 2023-10-03T10:18:17.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:17.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.481+0000 7fe7d9c29700 1 -- 172.21.15.146:0/3928011021 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe7d404f2a0 con 0x7fe7d409e870 2023-10-03T10:18:17.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.481+0000 7fe7bbfff700 1 -- 172.21.15.146:0/3928011021 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe7c4020030 con 0x7fe7d409e870 2023-10-03T10:18:17.482 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:17.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.484+0000 7fe7d9c29700 1 -- 172.21.15.146:0/3928011021 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d409e870 msgr2=0x7fe7d411f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.484+0000 7fe7d9c29700 1 --2- 172.21.15.146:0/3928011021 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d409e870 0x7fe7d411f370 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009e40 tx=0x7fe7c400eec0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.484+0000 7fe7d9c29700 1 -- 172.21.15.146:0/3928011021 shutdown_connections 2023-10-03T10:18:17.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.484+0000 7fe7d9c29700 1 --2- 172.21.15.146:0/3928011021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d4131d70 0x7fe7d411fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.484+0000 7fe7d9c29700 1 --2- 172.21.15.146:0/3928011021 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d409e870 0x7fe7d411f370 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.484+0000 7fe7d9c29700 1 --2- 172.21.15.146:0/3928011021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d409f180 0x7fe7d411f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.484+0000 7fe7d9c29700 1 -- 172.21.15.146:0/3928011021 >> 172.21.15.146:0/3928011021 conn(0x7fe7d40a4430 msgr2=0x7fe7d41310a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:17.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.484+0000 7fe7d9c29700 1 -- 172.21.15.146:0/3928011021 shutdown_connections 2023-10-03T10:18:17.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.484+0000 7fe7d9c29700 1 -- 172.21.15.146:0/3928011021 wait complete. 2023-10-03T10:18:17.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:17.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.532+0000 7f963de5f700 1 -- 172.21.15.146:0/4015815856 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9638124760 con 0x7f963809ad40 2023-10-03T10:18:17.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.533+0000 7f961ffff700 1 -- 172.21.15.146:0/4015815856 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9628015020 con 0x7f963809ad40 2023-10-03T10:18:17.533 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:17.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.535+0000 7f963de5f700 1 -- 172.21.15.146:0/4015815856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963809ad40 msgr2=0x7f9638121470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.535+0000 7f963de5f700 1 --2- 172.21.15.146:0/4015815856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963809ad40 0x7f9638121470 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f9628009130 tx=0x7f9628004750 comp rx=0 tx=0).stop 2023-10-03T10:18:17.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.535+0000 7f963de5f700 1 -- 172.21.15.146:0/4015815856 shutdown_connections 2023-10-03T10:18:17.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.535+0000 7f963de5f700 1 --2- 172.21.15.146:0/4015815856 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9638133f70 0x7f9638121ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.535+0000 7f963de5f700 1 --2- 172.21.15.146:0/4015815856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963809ad40 0x7f9638121470 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.535+0000 7f963de5f700 1 --2- 172.21.15.146:0/4015815856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96380a0a70 0x7f96381219b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.535+0000 7f963de5f700 1 -- 172.21.15.146:0/4015815856 >> 172.21.15.146:0/4015815856 conn(0x7f9638099c40 msgr2=0x7f96381332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:17.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.535+0000 7f963de5f700 1 -- 172.21.15.146:0/4015815856 shutdown_connections 2023-10-03T10:18:17.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:17.535+0000 7f963de5f700 1 -- 172.21.15.146:0/4015815856 wait complete. 2023-10-03T10:18:17.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:17.973 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:18.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.096+0000 7faa17b69700 1 Processor -- start 2023-10-03T10:18:18.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.096+0000 7faa17b69700 1 -- start start 2023-10-03T10:18:18.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.097+0000 7faa17b69700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faa1009e870 0x7faa1009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.097+0000 7faa17b69700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa1009f180 0x7faa10131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.097+0000 7faa17b69700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1009c970 con 0x7faa10131d70 2023-10-03T10:18:18.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.097+0000 7faa17b69700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa100a0920 con 0x7faa1009e870 2023-10-03T10:18:18.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.097+0000 7faa17b69700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1009f9c0 con 0x7faa1009f180 2023-10-03T10:18:18.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.097+0000 7faa15104700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa1009f180 0x7faa10131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.097+0000 7faa15905700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faa1009e870 0x7faa1009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.097+0000 7faa15104700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa1009f180 0x7faa10131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57284/0 (socket says 172.21.15.146:57284) 2023-10-03T10:18:18.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.097+0000 7faa15104700 1 -- 172.21.15.146:0/815418457 learned_addr learned my addr 172.21.15.146:0/815418457 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:18.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.097+0000 7faa15905700 1 -- 172.21.15.146:0/815418457 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa1009f180 msgr2=0x7faa10131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:18.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.097+0000 7faa15905700 1 --2- 172.21.15.146:0/815418457 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa1009f180 0x7faa10131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.097+0000 7faa15905700 1 -- 172.21.15.146:0/815418457 >> v1:172.21.15.146:6789/0 conn(0x7faa10131d70 legacy=0x7faa10138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.097+0000 7faa15905700 1 -- 172.21.15.146:0/815418457 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1009bab0 con 0x7faa1009e870 2023-10-03T10:18:18.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.097+0000 7faa14903700 1 -- 172.21.15.146:0/815418457 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1897433464 0 0) 0x7faa1009c970 con 0x7faa10131d70 2023-10-03T10:18:18.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.097+0000 7faa15104700 1 --2- 172.21.15.146:0/815418457 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa1009f180 0x7faa10131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:18.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.097+0000 7faa15905700 1 --2- 172.21.15.146:0/815418457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa1009e870 0x7faa1009ec40 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009840 tx=0x7faa0c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b575806994b64b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.097+0000 7faa14903700 1 -- 172.21.15.146:0/815418457 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c011830 con 0x7faa1009e870 2023-10-03T10:18:18.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.097+0000 7faa14903700 1 -- 172.21.15.146:0/815418457 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0c011990 con 0x7faa1009e870 2023-10-03T10:18:18.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.098+0000 7faa14903700 1 -- 172.21.15.146:0/815418457 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c011d20 con 0x7faa1009e870 2023-10-03T10:18:18.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.098+0000 7faa17b69700 1 -- 172.21.15.146:0/815418457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa1009e870 msgr2=0x7faa1009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.098+0000 7faa17b69700 1 --2- 172.21.15.146:0/815418457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa1009e870 0x7faa1009ec40 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009840 tx=0x7faa0c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:18.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.098+0000 7faa17b69700 1 -- 172.21.15.146:0/815418457 shutdown_connections 2023-10-03T10:18:18.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.098+0000 7faa17b69700 1 --2- 172.21.15.146:0/815418457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa1009e870 0x7faa1009ec40 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.098+0000 7faa17b69700 1 --2- 172.21.15.146:0/815418457 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa1009f180 0x7faa10131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.098+0000 7faa17b69700 1 -- 172.21.15.146:0/815418457 >> 172.21.15.146:0/815418457 conn(0x7faa100a4430 msgr2=0x7faa100a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.098+0000 7faa17b69700 1 -- 172.21.15.146:0/815418457 shutdown_connections 2023-10-03T10:18:18.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.098+0000 7faa17b69700 1 -- 172.21.15.146:0/815418457 wait complete. 2023-10-03T10:18:18.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.099+0000 7faa17b69700 1 Processor -- start 2023-10-03T10:18:18.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.099+0000 7faa17b69700 1 -- start start 2023-10-03T10:18:18.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.099+0000 7faa17b69700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa1009e870 0x7faa1011f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.099+0000 7faa17b69700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faa1009f180 0x7faa1011f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.099+0000 7faa17b69700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa10131d70 0x7faa1011fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.099+0000 7faa17b69700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa101206e0 con 0x7faa1009e870 2023-10-03T10:18:18.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.099+0000 7faa17b69700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa101305e0 con 0x7faa10131d70 2023-10-03T10:18:18.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.099+0000 7faa17b69700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa10121cb0 con 0x7faa1009f180 2023-10-03T10:18:18.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.099+0000 7faa15905700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa1009e870 0x7faa1011f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.099+0000 7faa16106700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa10131d70 0x7faa1011fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.099+0000 7faa15104700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faa1009f180 0x7faa1011f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.100+0000 7faa15905700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa1009e870 0x7faa1011f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39736/0 (socket says 172.21.15.146:39736) 2023-10-03T10:18:18.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.100+0000 7faa15905700 1 -- 172.21.15.146:0/3417037363 learned_addr learned my addr 172.21.15.146:0/3417037363 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:18.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.100+0000 7faa15104700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faa1009f180 0x7faa1011f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54654/0 (socket says 172.21.15.146:54654) 2023-10-03T10:18:18.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.100+0000 7faa16106700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa10131d70 0x7faa1011fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57302/0 (socket says 172.21.15.146:57302) 2023-10-03T10:18:18.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.100+0000 7faa15905700 1 -- 172.21.15.146:0/3417037363 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faa1009f180 msgr2=0x7faa1011f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.100+0000 7faa15905700 1 --2- 172.21.15.146:0/3417037363 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faa1009f180 0x7faa1011f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.100+0000 7faa15905700 1 -- 172.21.15.146:0/3417037363 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa10131d70 msgr2=0x7faa1011fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.100+0000 7faa15905700 1 --2- 172.21.15.146:0/3417037363 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa10131d70 0x7faa1011fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.100+0000 7faa15905700 1 -- 172.21.15.146:0/3417037363 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa00009550 con 0x7faa1009e870 2023-10-03T10:18:18.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.100+0000 7faa15104700 1 --2- 172.21.15.146:0/3417037363 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faa1009f180 0x7faa1011f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:18.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.100+0000 7faa16106700 1 --2- 172.21.15.146:0/3417037363 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa10131d70 0x7faa1011fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:18.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.100+0000 7faa15905700 1 --2- 172.21.15.146:0/3417037363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa1009e870 0x7faa1011f210 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0090b0 tx=0x7faa0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.100+0000 7faa067fc700 1 -- 172.21.15.146:0/3417037363 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c004550 con 0x7faa1009e870 2023-10-03T10:18:18.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.100+0000 7faa067fc700 1 -- 172.21.15.146:0/3417037363 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0c01e070 con 0x7faa1009e870 2023-10-03T10:18:18.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.100+0000 7faa17b69700 1 -- 172.21.15.146:0/3417037363 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa0c0094a0 con 0x7faa1009e870 2023-10-03T10:18:18.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.100+0000 7faa067fc700 1 -- 172.21.15.146:0/3417037363 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c0038e0 con 0x7faa1009e870 2023-10-03T10:18:18.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.100+0000 7faa17b69700 1 -- 172.21.15.146:0/3417037363 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa10122510 con 0x7faa1009e870 2023-10-03T10:18:18.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.101+0000 7faa067fc700 1 -- 172.21.15.146:0/3417037363 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa0c003a40 con 0x7faa1009e870 2023-10-03T10:18:18.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.101+0000 7faa067fc700 1 -- 172.21.15.146:0/3417037363 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faa0c040540 con 0x7faa1009e870 2023-10-03T10:18:18.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.101+0000 7faa17b69700 1 -- 172.21.15.146:0/3417037363 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa1011be60 con 0x7faa1009e870 2023-10-03T10:18:18.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.106+0000 7faa067fc700 1 -- 172.21.15.146:0/3417037363 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa0c015020 con 0x7faa1009e870 2023-10-03T10:18:18.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.290+0000 7faa17b69700 1 -- 172.21.15.146:0/3417037363 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faa1004f2a0 con 0x7faa1009e870 2023-10-03T10:18:18.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.290+0000 7faa067fc700 1 -- 172.21.15.146:0/3417037363 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa0c02d7d0 con 0x7faa1009e870 2023-10-03T10:18:18.291 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:18.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.292+0000 7faa17b69700 1 -- 172.21.15.146:0/3417037363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa1009e870 msgr2=0x7faa1011f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.292+0000 7faa17b69700 1 --2- 172.21.15.146:0/3417037363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa1009e870 0x7faa1011f210 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0090b0 tx=0x7faa0c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:18.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.292+0000 7faa17b69700 1 -- 172.21.15.146:0/3417037363 shutdown_connections 2023-10-03T10:18:18.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.292+0000 7faa17b69700 1 --2- 172.21.15.146:0/3417037363 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa10131d70 0x7faa1011fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.292+0000 7faa17b69700 1 --2- 172.21.15.146:0/3417037363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa1009e870 0x7faa1011f210 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.292+0000 7faa17b69700 1 --2- 172.21.15.146:0/3417037363 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faa1009f180 0x7faa1011f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.292+0000 7faa17b69700 1 -- 172.21.15.146:0/3417037363 >> 172.21.15.146:0/3417037363 conn(0x7faa100a4430 msgr2=0x7faa10131140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.293+0000 7faa17b69700 1 -- 172.21.15.146:0/3417037363 shutdown_connections 2023-10-03T10:18:18.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.293+0000 7faa17b69700 1 -- 172.21.15.146:0/3417037363 wait complete. 2023-10-03T10:18:18.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:18.437 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:18.501 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:18.548 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:18.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.563+0000 7f2298d10700 1 Processor -- start 2023-10-03T10:18:18.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.563+0000 7f2298d10700 1 -- start start 2023-10-03T10:18:18.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.564+0000 7f2298d10700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f229409d860 0x7f229409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.564+0000 7f2298d10700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f229409e170 0x7f22941307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.564+0000 7f2298d10700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f229409aaa0 con 0x7f2294130ce0 2023-10-03T10:18:18.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.564+0000 7f2298d10700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f229409f870 con 0x7f229409d860 2023-10-03T10:18:18.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.564+0000 7f2298d10700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f229409b360 con 0x7f229409e170 2023-10-03T10:18:18.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.564+0000 7f229259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f229409d860 0x7f229409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.564+0000 7f2292d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2294130ce0 0x7f22941379f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33736/0 (socket says 172.21.15.146:33736) 2023-10-03T10:18:18.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.564+0000 7f2291d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f229409e170 0x7f22941307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.564+0000 7f2292d9d700 1 -- 172.21.15.146:0/1582911854 learned_addr learned my addr 172.21.15.146:0/1582911854 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:18.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.564+0000 7f229159a700 1 -- 172.21.15.146:0/1582911854 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2515649873 0 0) 0x7f229409aaa0 con 0x7f2294130ce0 2023-10-03T10:18:18.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.564+0000 7f2291d9b700 1 -- 172.21.15.146:0/1582911854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f229409d860 msgr2=0x7f229409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:18.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.564+0000 7f2291d9b700 1 --2- 172.21.15.146:0/1582911854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f229409d860 0x7f229409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.564+0000 7f2291d9b700 1 -- 172.21.15.146:0/1582911854 >> v1:172.21.15.146:6789/0 conn(0x7f2294130ce0 legacy=0x7f22941379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.564+0000 7f2291d9b700 1 -- 172.21.15.146:0/1582911854 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229409b620 con 0x7f229409e170 2023-10-03T10:18:18.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.564+0000 7f229259c700 1 --2- 172.21.15.146:0/1582911854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f229409d860 0x7f229409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:18.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.565+0000 7f2291d9b700 1 --2- 172.21.15.146:0/1582911854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f229409e170 0x7f22941307a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2288009870 tx=0x7f2288009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5437f9a8fcf102d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.565+0000 7f229159a700 1 -- 172.21.15.146:0/1582911854 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2288011830 con 0x7f229409e170 2023-10-03T10:18:18.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.565+0000 7f229159a700 1 -- 172.21.15.146:0/1582911854 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2288011990 con 0x7f229409e170 2023-10-03T10:18:18.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.565+0000 7f229159a700 1 -- 172.21.15.146:0/1582911854 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2288011d20 con 0x7f229409e170 2023-10-03T10:18:18.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.566+0000 7f2298d10700 1 -- 172.21.15.146:0/1582911854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f229409e170 msgr2=0x7f22941307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.566+0000 7f2298d10700 1 --2- 172.21.15.146:0/1582911854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f229409e170 0x7f22941307a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2288009870 tx=0x7f2288009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:18.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.566+0000 7f2298d10700 1 -- 172.21.15.146:0/1582911854 shutdown_connections 2023-10-03T10:18:18.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.566+0000 7f2298d10700 1 --2- 172.21.15.146:0/1582911854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f229409d860 0x7f229409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.566+0000 7f2298d10700 1 --2- 172.21.15.146:0/1582911854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f229409e170 0x7f22941307a0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.566+0000 7f2298d10700 1 -- 172.21.15.146:0/1582911854 >> 172.21.15.146:0/1582911854 conn(0x7f2294099c40 msgr2=0x7f22940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.566+0000 7f2298d10700 1 -- 172.21.15.146:0/1582911854 shutdown_connections 2023-10-03T10:18:18.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.566+0000 7f2298d10700 1 -- 172.21.15.146:0/1582911854 wait complete. 2023-10-03T10:18:18.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.567+0000 7f2298d10700 1 Processor -- start 2023-10-03T10:18:18.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.568+0000 7f2298d10700 1 -- start start 2023-10-03T10:18:18.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.568+0000 7f2298d10700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f229409d860 0x7f22941c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.568+0000 7f2298d10700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f229409e170 0x7f22941c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.568+0000 7f2298d10700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2294130ce0 0x7f22941c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.568+0000 7f2298d10700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2294126e00 con 0x7f229409d860 2023-10-03T10:18:18.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.568+0000 7f2298d10700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2294120bc0 con 0x7f229409e170 2023-10-03T10:18:18.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.568+0000 7f2298d10700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f229411f5d0 con 0x7f2294130ce0 2023-10-03T10:18:18.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.568+0000 7f2291d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f229409e170 0x7f22941c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.568+0000 7f2291d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f229409e170 0x7f22941c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57312/0 (socket says 172.21.15.146:57312) 2023-10-03T10:18:18.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.568+0000 7f2291d9b700 1 -- 172.21.15.146:0/981443992 learned_addr learned my addr 172.21.15.146:0/981443992 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:18.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.568+0000 7f2292d9d700 1 --2- 172.21.15.146:0/981443992 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2294130ce0 0x7f22941c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.569+0000 7f229259c700 1 --2- 172.21.15.146:0/981443992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f229409d860 0x7f22941c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.569+0000 7f2291d9b700 1 -- 172.21.15.146:0/981443992 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2294130ce0 msgr2=0x7f22941c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.569+0000 7f2291d9b700 1 --2- 172.21.15.146:0/981443992 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2294130ce0 0x7f22941c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.569+0000 7f2291d9b700 1 -- 172.21.15.146:0/981443992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f229409d860 msgr2=0x7f22941c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.569+0000 7f2291d9b700 1 --2- 172.21.15.146:0/981443992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f229409d860 0x7f22941c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.569+0000 7f2291d9b700 1 -- 172.21.15.146:0/981443992 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22840094a0 con 0x7f229409e170 2023-10-03T10:18:18.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.569+0000 7f2292d9d700 1 --2- 172.21.15.146:0/981443992 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2294130ce0 0x7f22941c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:18.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.569+0000 7f2291d9b700 1 --2- 172.21.15.146:0/981443992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f229409e170 0x7f22941c86a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f22880090b0 tx=0x7f2288004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.569+0000 7f2282ffd700 1 -- 172.21.15.146:0/981443992 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2288004510 con 0x7f229409e170 2023-10-03T10:18:18.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.569+0000 7f2282ffd700 1 -- 172.21.15.146:0/981443992 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228801f070 con 0x7f229409e170 2023-10-03T10:18:18.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.569+0000 7f2282ffd700 1 -- 172.21.15.146:0/981443992 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22880038e0 con 0x7f229409e170 2023-10-03T10:18:18.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.569+0000 7f2298d10700 1 -- 172.21.15.146:0/981443992 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22880094a0 con 0x7f229409e170 2023-10-03T10:18:18.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.569+0000 7f2298d10700 1 -- 172.21.15.146:0/981443992 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f229406b230 con 0x7f229409e170 2023-10-03T10:18:18.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.570+0000 7f2298d10700 1 -- 172.21.15.146:0/981443992 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f229406be10 con 0x7f229409e170 2023-10-03T10:18:18.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.570+0000 7f2282ffd700 1 -- 172.21.15.146:0/981443992 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2288003a40 con 0x7f229409e170 2023-10-03T10:18:18.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.571+0000 7f2282ffd700 1 -- 172.21.15.146:0/981443992 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2288021070 con 0x7f229409e170 2023-10-03T10:18:18.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.576+0000 7f2282ffd700 1 -- 172.21.15.146:0/981443992 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2288024be0 con 0x7f229409e170 2023-10-03T10:18:18.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.631+0000 7f523c5b2700 1 Processor -- start 2023-10-03T10:18:18.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.631+0000 7f523c5b2700 1 -- start start 2023-10-03T10:18:18.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.632+0000 7f523c5b2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52340a0a70 0x7f52340a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.632+0000 7f523c5b2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52340a1380 0x7f5234133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.632+0000 7f523c5b2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523409dc00 con 0x7f5234133f50 2023-10-03T10:18:18.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.632+0000 7f523c5b2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523409ea60 con 0x7f52340a1380 2023-10-03T10:18:18.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.632+0000 7f523c5b2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f523409dec0 con 0x7f52340a0a70 2023-10-03T10:18:18.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.632+0000 7f5239b4d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52340a1380 0x7f5234133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.632+0000 7f523ab4f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5234133f50 0x7f523413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33738/0 (socket says 172.21.15.146:33738) 2023-10-03T10:18:18.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.632+0000 7f523ab4f700 1 -- 172.21.15.146:0/678442276 learned_addr learned my addr 172.21.15.146:0/678442276 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:18.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.632+0000 7f523a34e700 1 --2- 172.21.15.146:0/678442276 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52340a0a70 0x7f52340a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.632+0000 7f5239b4d700 1 -- 172.21.15.146:0/678442276 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52340a0a70 msgr2=0x7f52340a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:18.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.632+0000 7f5239b4d700 1 --2- 172.21.15.146:0/678442276 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52340a0a70 0x7f52340a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.632+0000 7f5239b4d700 1 -- 172.21.15.146:0/678442276 >> v1:172.21.15.146:6789/0 conn(0x7f5234133f50 legacy=0x7f523413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.632+0000 7f5239b4d700 1 -- 172.21.15.146:0/678442276 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523409e6a0 con 0x7f52340a1380 2023-10-03T10:18:18.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.632+0000 7f523934c700 1 -- 172.21.15.146:0/678442276 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152861214 0 0) 0x7f523409dc00 con 0x7f5234133f50 2023-10-03T10:18:18.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.632+0000 7f523a34e700 1 --2- 172.21.15.146:0/678442276 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52340a0a70 0x7f52340a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:18.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.632+0000 7f5239b4d700 1 --2- 172.21.15.146:0/678442276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52340a1380 0x7f5234133a10 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f5224009840 tx=0x7f5224009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c93c05a7e2e17b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.633+0000 7f523934c700 1 -- 172.21.15.146:0/678442276 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5224011830 con 0x7f52340a1380 2023-10-03T10:18:18.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.633+0000 7f523934c700 1 -- 172.21.15.146:0/678442276 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5224011990 con 0x7f52340a1380 2023-10-03T10:18:18.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.633+0000 7f523934c700 1 -- 172.21.15.146:0/678442276 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5224011d20 con 0x7f52340a1380 2023-10-03T10:18:18.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.633+0000 7f523c5b2700 1 -- 172.21.15.146:0/678442276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52340a1380 msgr2=0x7f5234133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.633+0000 7f523c5b2700 1 --2- 172.21.15.146:0/678442276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52340a1380 0x7f5234133a10 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f5224009840 tx=0x7f5224009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:18.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.633+0000 7f523c5b2700 1 -- 172.21.15.146:0/678442276 shutdown_connections 2023-10-03T10:18:18.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.633+0000 7f523c5b2700 1 --2- 172.21.15.146:0/678442276 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52340a0a70 0x7f52340a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.633+0000 7f523c5b2700 1 --2- 172.21.15.146:0/678442276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52340a1380 0x7f5234133a10 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.633+0000 7f523c5b2700 1 -- 172.21.15.146:0/678442276 >> 172.21.15.146:0/678442276 conn(0x7f52340a6610 msgr2=0x7f52340a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.634+0000 7f523c5b2700 1 -- 172.21.15.146:0/678442276 shutdown_connections 2023-10-03T10:18:18.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.634+0000 7f523c5b2700 1 -- 172.21.15.146:0/678442276 wait complete. 2023-10-03T10:18:18.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.634+0000 7f523c5b2700 1 Processor -- start 2023-10-03T10:18:18.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.634+0000 7f523c5b2700 1 -- start start 2023-10-03T10:18:18.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.635+0000 7f523c5b2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52340a0a70 0x7f52341228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.635+0000 7f523c5b2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52340a1380 0x7f5234122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.635+0000 7f523c5b2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5234133f50 0x7f5234123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.635+0000 7f523c5b2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52341245d0 con 0x7f5234133f50 2023-10-03T10:18:18.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.635+0000 7f523c5b2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5234124cf0 con 0x7f52340a1380 2023-10-03T10:18:18.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.635+0000 7f523c5b2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52341333d0 con 0x7f52340a0a70 2023-10-03T10:18:18.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.635+0000 7f523a34e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52340a0a70 0x7f52341228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.635+0000 7f523a34e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52340a0a70 0x7f52341228b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54694/0 (socket says 172.21.15.146:54694) 2023-10-03T10:18:18.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.635+0000 7f523a34e700 1 -- 172.21.15.146:0/2654403852 learned_addr learned my addr 172.21.15.146:0/2654403852 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:18.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.635+0000 7f523ab4f700 1 --2- 172.21.15.146:0/2654403852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5234133f50 0x7f5234123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.636+0000 7f523a34e700 1 -- 172.21.15.146:0/2654403852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52340a1380 msgr2=0x7f5234122df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.636+0000 7f523a34e700 1 --2- 172.21.15.146:0/2654403852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52340a1380 0x7f5234122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.636+0000 7f523a34e700 1 -- 172.21.15.146:0/2654403852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5234133f50 msgr2=0x7f5234123330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.636+0000 7f523a34e700 1 --2- 172.21.15.146:0/2654403852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5234133f50 0x7f5234123330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.636+0000 7f523a34e700 1 -- 172.21.15.146:0/2654403852 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52300094a0 con 0x7f52340a0a70 2023-10-03T10:18:18.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.636+0000 7f523a34e700 1 --2- 172.21.15.146:0/2654403852 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52340a0a70 0x7f52341228b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f523000ebe0 tx=0x7f523000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.636+0000 7f522affd700 1 -- 172.21.15.146:0/2654403852 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230009800 con 0x7f52340a0a70 2023-10-03T10:18:18.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.636+0000 7f522affd700 1 -- 172.21.15.146:0/2654403852 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523000c910 con 0x7f52340a0a70 2023-10-03T10:18:18.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.636+0000 7f523c5b2700 1 -- 172.21.15.146:0/2654403852 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52240094a0 con 0x7f52340a0a70 2023-10-03T10:18:18.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.636+0000 7f522affd700 1 -- 172.21.15.146:0/2654403852 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523000cc80 con 0x7f52340a0a70 2023-10-03T10:18:18.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.636+0000 7f523c5b2700 1 -- 172.21.15.146:0/2654403852 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5234133800 con 0x7f52340a0a70 2023-10-03T10:18:18.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.637+0000 7f522affd700 1 -- 172.21.15.146:0/2654403852 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5230013470 con 0x7f52340a0a70 2023-10-03T10:18:18.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.637+0000 7f523c5b2700 1 -- 172.21.15.146:0/2654403852 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f523404f2a0 con 0x7f52340a0a70 2023-10-03T10:18:18.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.637+0000 7f522affd700 1 -- 172.21.15.146:0/2654403852 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f523003fc20 con 0x7f52340a0a70 2023-10-03T10:18:18.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.642+0000 7f522affd700 1 -- 172.21.15.146:0/2654403852 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5230021070 con 0x7f52340a0a70 2023-10-03T10:18:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.675+0000 7f7d57dd1700 1 Processor -- start 2023-10-03T10:18:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.675+0000 7f7d57dd1700 1 -- start start 2023-10-03T10:18:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.676+0000 7f7d57dd1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7d50133ad0 0x7f7d50133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.676+0000 7f7d57dd1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d501300a0 0x7f7d501304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.676+0000 7f7d57dd1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d5006b2d0 con 0x7f7d501309f0 2023-10-03T10:18:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.676+0000 7f7d57dd1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d50133610 con 0x7f7d50133ad0 2023-10-03T10:18:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.676+0000 7f7d57dd1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5009a500 con 0x7f7d501300a0 2023-10-03T10:18:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.676+0000 7f7d5536c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d501300a0 0x7f7d501304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.676+0000 7f7d5536c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d501300a0 0x7f7d501304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57334/0 (socket says 172.21.15.146:57334) 2023-10-03T10:18:18.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.676+0000 7f7d5536c700 1 -- 172.21.15.146:0/2716562900 learned_addr learned my addr 172.21.15.146:0/2716562900 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:18.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.676+0000 7f7d55b6d700 1 --2- 172.21.15.146:0/2716562900 >> v2:172.21.15.146:3300/0 conn(0x7f7d50133ad0 0x7f7d50133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.676+0000 7f7d5536c700 1 -- 172.21.15.146:0/2716562900 >> v2:172.21.15.146:3300/0 conn(0x7f7d50133ad0 msgr2=0x7f7d50133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:18.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.676+0000 7f7d5536c700 1 --2- 172.21.15.146:0/2716562900 >> v2:172.21.15.146:3300/0 conn(0x7f7d50133ad0 0x7f7d50133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.676+0000 7f7d5536c700 1 -- 172.21.15.146:0/2716562900 >> v1:172.21.15.146:6789/0 conn(0x7f7d501309f0 legacy=0x7f7d5013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.676+0000 7f7d5536c700 1 -- 172.21.15.146:0/2716562900 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d501338b0 con 0x7f7d501300a0 2023-10-03T10:18:18.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.676+0000 7f7d5536c700 1 --2- 172.21.15.146:0/2716562900 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d501300a0 0x7f7d501304b0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7d400098f0 tx=0x7f7d40009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=164ab9f1aec0ee79 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.677+0000 7f7d54b6b700 1 -- 172.21.15.146:0/2716562900 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d40011830 con 0x7f7d501300a0 2023-10-03T10:18:18.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.677+0000 7f7d54b6b700 1 -- 172.21.15.146:0/2716562900 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d40011990 con 0x7f7d501300a0 2023-10-03T10:18:18.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.677+0000 7f7d54b6b700 1 -- 172.21.15.146:0/2716562900 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d40011d20 con 0x7f7d501300a0 2023-10-03T10:18:18.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.677+0000 7f7d57dd1700 1 -- 172.21.15.146:0/2716562900 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d501300a0 msgr2=0x7f7d501304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.677+0000 7f7d57dd1700 1 --2- 172.21.15.146:0/2716562900 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d501300a0 0x7f7d501304b0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7d400098f0 tx=0x7f7d40009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:18.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.677+0000 7f7d57dd1700 1 -- 172.21.15.146:0/2716562900 shutdown_connections 2023-10-03T10:18:18.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.677+0000 7f7d57dd1700 1 --2- 172.21.15.146:0/2716562900 >> v2:172.21.15.146:3300/0 conn(0x7f7d50133ad0 0x7f7d50133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.677+0000 7f7d57dd1700 1 --2- 172.21.15.146:0/2716562900 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d501300a0 0x7f7d501304b0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.677+0000 7f7d57dd1700 1 -- 172.21.15.146:0/2716562900 >> 172.21.15.146:0/2716562900 conn(0x7f7d50099c40 msgr2=0x7f7d500a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.677+0000 7f7d57dd1700 1 -- 172.21.15.146:0/2716562900 shutdown_connections 2023-10-03T10:18:18.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.677+0000 7f7d57dd1700 1 -- 172.21.15.146:0/2716562900 wait complete. 2023-10-03T10:18:18.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.678+0000 7f7d57dd1700 1 Processor -- start 2023-10-03T10:18:18.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.678+0000 7f7d57dd1700 1 -- start start 2023-10-03T10:18:18.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.679+0000 7f7d57dd1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d501300a0 0x7f7d5011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.679+0000 7f7d57dd1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d501309f0 0x7f7d5011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.679+0000 7f7d57dd1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d50133ad0 0x7f7d5011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.679+0000 7f7d57dd1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5012d3e0 con 0x7f7d50133ad0 2023-10-03T10:18:18.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.679+0000 7f7d57dd1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5011f9e0 con 0x7f7d501300a0 2023-10-03T10:18:18.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.679+0000 7f7d57dd1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d50072320 con 0x7f7d501309f0 2023-10-03T10:18:18.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.679+0000 7f7d5536c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d501309f0 0x7f7d5011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.679+0000 7f7d5536c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d501309f0 0x7f7d5011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54708/0 (socket says 172.21.15.146:54708) 2023-10-03T10:18:18.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.679+0000 7f7d5536c700 1 -- 172.21.15.146:0/2733169552 learned_addr learned my addr 172.21.15.146:0/2733169552 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:18.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.679+0000 7f7d5636e700 1 --2- 172.21.15.146:0/2733169552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d50133ad0 0x7f7d5011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.679+0000 7f7d55b6d700 1 --2- 172.21.15.146:0/2733169552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d501300a0 0x7f7d5011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.679+0000 7f7d5536c700 1 -- 172.21.15.146:0/2733169552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d501300a0 msgr2=0x7f7d5011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.679+0000 7f7d5536c700 1 --2- 172.21.15.146:0/2733169552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d501300a0 0x7f7d5011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.679+0000 7f7d5536c700 1 -- 172.21.15.146:0/2733169552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d50133ad0 msgr2=0x7f7d5011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.679+0000 7f7d5536c700 1 --2- 172.21.15.146:0/2733169552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d50133ad0 0x7f7d5011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.679+0000 7f7d5536c700 1 -- 172.21.15.146:0/2733169552 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d40009550 con 0x7f7d501309f0 2023-10-03T10:18:18.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.679+0000 7f7d5536c700 1 --2- 172.21.15.146:0/2733169552 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d501309f0 0x7f7d5011df80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f7d40009c40 tx=0x7f7d40004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.679+0000 7f7d467fc700 1 -- 172.21.15.146:0/2733169552 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d40004510 con 0x7f7d501309f0 2023-10-03T10:18:18.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.680+0000 7f7d467fc700 1 -- 172.21.15.146:0/2733169552 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4001e070 con 0x7f7d501309f0 2023-10-03T10:18:18.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.680+0000 7f7d57dd1700 1 -- 172.21.15.146:0/2733169552 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d50120360 con 0x7f7d501309f0 2023-10-03T10:18:18.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.680+0000 7f7d467fc700 1 -- 172.21.15.146:0/2733169552 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d400038e0 con 0x7f7d501309f0 2023-10-03T10:18:18.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.680+0000 7f7d57dd1700 1 -- 172.21.15.146:0/2733169552 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5011fd60 con 0x7f7d501309f0 2023-10-03T10:18:18.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.680+0000 7f7d467fc700 1 -- 172.21.15.146:0/2733169552 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d40003a40 con 0x7f7d501309f0 2023-10-03T10:18:18.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.680+0000 7f7d467fc700 1 -- 172.21.15.146:0/2733169552 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7d40020070 con 0x7f7d501309f0 2023-10-03T10:18:18.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.681+0000 7f7d57dd1700 1 -- 172.21.15.146:0/2733169552 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5009ea10 con 0x7f7d501309f0 2023-10-03T10:18:18.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.689+0000 7f7d467fc700 1 -- 172.21.15.146:0/2733169552 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d40025480 con 0x7f7d501309f0 2023-10-03T10:18:18.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.771+0000 7f2298d10700 1 -- 172.21.15.146:0/981443992 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f229404f2a0 con 0x7f229409e170 2023-10-03T10:18:18.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.771+0000 7f2282ffd700 1 -- 172.21.15.146:0/981443992 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f228802b020 con 0x7f229409e170 2023-10-03T10:18:18.772 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:18.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.774+0000 7f2298d10700 1 -- 172.21.15.146:0/981443992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f229409e170 msgr2=0x7f22941c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.774+0000 7f2298d10700 1 --2- 172.21.15.146:0/981443992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f229409e170 0x7f22941c86a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f22880090b0 tx=0x7f2288004750 comp rx=0 tx=0).stop 2023-10-03T10:18:18.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.774+0000 7f2298d10700 1 -- 172.21.15.146:0/981443992 shutdown_connections 2023-10-03T10:18:18.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.774+0000 7f2298d10700 1 --2- 172.21.15.146:0/981443992 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2294130ce0 0x7f22941c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.774+0000 7f2298d10700 1 --2- 172.21.15.146:0/981443992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f229409d860 0x7f22941c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.774+0000 7f2298d10700 1 --2- 172.21.15.146:0/981443992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f229409e170 0x7f22941c86a0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.774+0000 7f2298d10700 1 -- 172.21.15.146:0/981443992 >> 172.21.15.146:0/981443992 conn(0x7f2294099c40 msgr2=0x7f2294119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.775+0000 7f2298d10700 1 -- 172.21.15.146:0/981443992 shutdown_connections 2023-10-03T10:18:18.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.775+0000 7f2298d10700 1 -- 172.21.15.146:0/981443992 wait complete. 2023-10-03T10:18:18.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:18.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.841+0000 7f523c5b2700 1 -- 172.21.15.146:0/2654403852 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5234072980 con 0x7f52340a0a70 2023-10-03T10:18:18.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.841+0000 7f522affd700 1 -- 172.21.15.146:0/2654403852 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f523002a090 con 0x7f52340a0a70 2023-10-03T10:18:18.842 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:18.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.843+0000 7f523c5b2700 1 -- 172.21.15.146:0/2654403852 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52340a0a70 msgr2=0x7f52341228b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.843+0000 7f523c5b2700 1 --2- 172.21.15.146:0/2654403852 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52340a0a70 0x7f52341228b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f523000ebe0 tx=0x7f523000eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.843+0000 7f523c5b2700 1 -- 172.21.15.146:0/2654403852 shutdown_connections 2023-10-03T10:18:18.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.843+0000 7f523c5b2700 1 --2- 172.21.15.146:0/2654403852 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5234133f50 0x7f5234123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.843+0000 7f523c5b2700 1 --2- 172.21.15.146:0/2654403852 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52340a0a70 0x7f52341228b0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.843+0000 7f523c5b2700 1 --2- 172.21.15.146:0/2654403852 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52340a1380 0x7f5234122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.844+0000 7f523c5b2700 1 -- 172.21.15.146:0/2654403852 >> 172.21.15.146:0/2654403852 conn(0x7f52340a6610 msgr2=0x7f523409ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.844+0000 7f523c5b2700 1 -- 172.21.15.146:0/2654403852 shutdown_connections 2023-10-03T10:18:18.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.844+0000 7f523c5b2700 1 -- 172.21.15.146:0/2654403852 wait complete. 2023-10-03T10:18:18.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:18.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.883+0000 7f7d57dd1700 1 -- 172.21.15.146:0/2733169552 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7d5004f2a0 con 0x7f7d501309f0 2023-10-03T10:18:18.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.884+0000 7f7d467fc700 1 -- 172.21.15.146:0/2733169552 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d40015030 con 0x7f7d501309f0 2023-10-03T10:18:18.884 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:18.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.886+0000 7f7d57dd1700 1 -- 172.21.15.146:0/2733169552 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d501309f0 msgr2=0x7f7d5011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.886+0000 7f7d57dd1700 1 --2- 172.21.15.146:0/2733169552 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d501309f0 0x7f7d5011df80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f7d40009c40 tx=0x7f7d40004750 comp rx=0 tx=0).stop 2023-10-03T10:18:18.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.886+0000 7f7d57dd1700 1 -- 172.21.15.146:0/2733169552 shutdown_connections 2023-10-03T10:18:18.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.886+0000 7f7d57dd1700 1 --2- 172.21.15.146:0/2733169552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d50133ad0 0x7f7d5011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.886+0000 7f7d57dd1700 1 --2- 172.21.15.146:0/2733169552 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d501300a0 0x7f7d5011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.886+0000 7f7d57dd1700 1 --2- 172.21.15.146:0/2733169552 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d501309f0 0x7f7d5011df80 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.886+0000 7f7d57dd1700 1 -- 172.21.15.146:0/2733169552 >> 172.21.15.146:0/2733169552 conn(0x7f7d50099c40 msgr2=0x7f7d50131510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.886+0000 7f7d57dd1700 1 -- 172.21.15.146:0/2733169552 shutdown_connections 2023-10-03T10:18:18.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:18.886+0000 7f7d57dd1700 1 -- 172.21.15.146:0/2733169552 wait complete. 2023-10-03T10:18:18.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:19.306 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:19.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.429+0000 7f64f8384700 1 Processor -- start 2023-10-03T10:18:19.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.429+0000 7f64f8384700 1 -- start start 2023-10-03T10:18:19.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.430+0000 7f64f8384700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64f009d860 0x7f64f009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.430+0000 7f64f8384700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f64f0130eb0 0x7f64f0138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.430+0000 7f64f8384700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f009aaa0 con 0x7f64f009e170 2023-10-03T10:18:19.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.430+0000 7f64f8384700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f009f870 con 0x7f64f0130eb0 2023-10-03T10:18:19.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.430+0000 7f64f8384700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f009b360 con 0x7f64f009d860 2023-10-03T10:18:19.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.430+0000 7f64f6921700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f64f0130eb0 0x7f64f0138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.430+0000 7f64f6120700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64f009d860 0x7f64f009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.430+0000 7f64f591f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f64f009e170 0x7f64f01307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33756/0 (socket says 172.21.15.146:33756) 2023-10-03T10:18:19.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.430+0000 7f64f591f700 1 -- 172.21.15.146:0/991671789 learned_addr learned my addr 172.21.15.146:0/991671789 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:19.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.430+0000 7f64f6120700 1 -- 172.21.15.146:0/991671789 >> v2:172.21.15.146:3300/0 conn(0x7f64f0130eb0 msgr2=0x7f64f0138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.430+0000 7f64f6120700 1 --2- 172.21.15.146:0/991671789 >> v2:172.21.15.146:3300/0 conn(0x7f64f0130eb0 0x7f64f0138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.430+0000 7f64f6120700 1 -- 172.21.15.146:0/991671789 >> v1:172.21.15.146:6789/0 conn(0x7f64f009e170 legacy=0x7f64f01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.430+0000 7f64f6120700 1 -- 172.21.15.146:0/991671789 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f009b620 con 0x7f64f009d860 2023-10-03T10:18:19.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.430+0000 7f64f6921700 1 --2- 172.21.15.146:0/991671789 >> v2:172.21.15.146:3300/0 conn(0x7f64f0130eb0 0x7f64f0138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.430+0000 7f64f6120700 1 --2- 172.21.15.146:0/991671789 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64f009d860 0x7f64f009dc30 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009840 tx=0x7f64e0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea775fe6dc98b06a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.430+0000 7f64f511e700 1 -- 172.21.15.146:0/991671789 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e0011830 con 0x7f64f009d860 2023-10-03T10:18:19.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.430+0000 7f64f511e700 1 -- 172.21.15.146:0/991671789 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e0011990 con 0x7f64f009d860 2023-10-03T10:18:19.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.430+0000 7f64f511e700 1 -- 172.21.15.146:0/991671789 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e0011d20 con 0x7f64f009d860 2023-10-03T10:18:19.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.431+0000 7f64f8384700 1 -- 172.21.15.146:0/991671789 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64f009d860 msgr2=0x7f64f009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.431+0000 7f64f8384700 1 --2- 172.21.15.146:0/991671789 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64f009d860 0x7f64f009dc30 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009840 tx=0x7f64e0009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:19.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.431+0000 7f64f8384700 1 -- 172.21.15.146:0/991671789 shutdown_connections 2023-10-03T10:18:19.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.431+0000 7f64f8384700 1 --2- 172.21.15.146:0/991671789 >> v2:172.21.15.146:3300/0 conn(0x7f64f0130eb0 0x7f64f0138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.431+0000 7f64f8384700 1 --2- 172.21.15.146:0/991671789 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64f009d860 0x7f64f009dc30 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.431+0000 7f64f8384700 1 -- 172.21.15.146:0/991671789 >> 172.21.15.146:0/991671789 conn(0x7f64f0099c40 msgr2=0x7f64f00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.431+0000 7f64f8384700 1 -- 172.21.15.146:0/991671789 shutdown_connections 2023-10-03T10:18:19.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.431+0000 7f64f8384700 1 -- 172.21.15.146:0/991671789 wait complete. 2023-10-03T10:18:19.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.432+0000 7f64f8384700 1 Processor -- start 2023-10-03T10:18:19.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.432+0000 7f64f8384700 1 -- start start 2023-10-03T10:18:19.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.432+0000 7f64f8384700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64f009d860 0x7f64f0120650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.432+0000 7f64f8384700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f64f009e170 0x7f64f0120b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.432+0000 7f64f8384700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64f0130eb0 0x7f64f01210d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.432+0000 7f64f8384700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f0121b20 con 0x7f64f0130eb0 2023-10-03T10:18:19.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.432+0000 7f64f8384700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f0130590 con 0x7f64f009d860 2023-10-03T10:18:19.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.432+0000 7f64f8384700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64f0122370 con 0x7f64f009e170 2023-10-03T10:18:19.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.432+0000 7f64f6120700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64f009d860 0x7f64f0120650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.432+0000 7f64f6921700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64f0130eb0 0x7f64f01210d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.432+0000 7f64f591f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f64f009e170 0x7f64f0120b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.432+0000 7f64f6120700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64f009d860 0x7f64f0120650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57366/0 (socket says 172.21.15.146:57366) 2023-10-03T10:18:19.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.432+0000 7f64f6921700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64f0130eb0 0x7f64f01210d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39790/0 (socket says 172.21.15.146:39790) 2023-10-03T10:18:19.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.432+0000 7f64f6120700 1 -- 172.21.15.146:0/2277611499 learned_addr learned my addr 172.21.15.146:0/2277611499 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:19.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.433+0000 7f64f6921700 1 -- 172.21.15.146:0/2277611499 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f64f009e170 msgr2=0x7f64f0120b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.433+0000 7f64f6921700 1 --2- 172.21.15.146:0/2277611499 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f64f009e170 0x7f64f0120b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.433+0000 7f64f6921700 1 -- 172.21.15.146:0/2277611499 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64f009d860 msgr2=0x7f64f0120650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.433+0000 7f64f6921700 1 --2- 172.21.15.146:0/2277611499 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64f009d860 0x7f64f0120650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.433+0000 7f64f6921700 1 -- 172.21.15.146:0/2277611499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e8009a70 con 0x7f64f0130eb0 2023-10-03T10:18:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.433+0000 7f64f591f700 1 --2- 172.21.15.146:0/2277611499 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f64f009e170 0x7f64f0120b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.433+0000 7f64f6120700 1 --2- 172.21.15.146:0/2277611499 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64f009d860 0x7f64f0120650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.433+0000 7f64f6921700 1 --2- 172.21.15.146:0/2277611499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64f0130eb0 0x7f64f01210d0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f64e800efc0 tx=0x7f64e800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.433+0000 7f64e6ffd700 1 -- 172.21.15.146:0/2277611499 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e800ca90 con 0x7f64f0130eb0 2023-10-03T10:18:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.433+0000 7f64e6ffd700 1 -- 172.21.15.146:0/2277611499 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e800f040 con 0x7f64f0130eb0 2023-10-03T10:18:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.433+0000 7f64f8384700 1 -- 172.21.15.146:0/2277611499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e00094a0 con 0x7f64f0130eb0 2023-10-03T10:18:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.433+0000 7f64e6ffd700 1 -- 172.21.15.146:0/2277611499 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e800ce30 con 0x7f64f0130eb0 2023-10-03T10:18:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.433+0000 7f64f8384700 1 -- 172.21.15.146:0/2277611499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f0122a50 con 0x7f64f0130eb0 2023-10-03T10:18:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.434+0000 7f64e6ffd700 1 -- 172.21.15.146:0/2277611499 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f64e8014480 con 0x7f64f0130eb0 2023-10-03T10:18:19.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.434+0000 7f64e6ffd700 1 -- 172.21.15.146:0/2277611499 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f64e803fbf0 con 0x7f64f0130eb0 2023-10-03T10:18:19.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.434+0000 7f64f8384700 1 -- 172.21.15.146:0/2277611499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f004f2a0 con 0x7f64f0130eb0 2023-10-03T10:18:19.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.439+0000 7f64e6ffd700 1 -- 172.21.15.146:0/2277611499 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f64e8012930 con 0x7f64f0130eb0 2023-10-03T10:18:19.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.626+0000 7f64f8384700 1 -- 172.21.15.146:0/2277611499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f64f01227b0 con 0x7f64f0130eb0 2023-10-03T10:18:19.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.626+0000 7f64e6ffd700 1 -- 172.21.15.146:0/2277611499 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f64e8009cc0 con 0x7f64f0130eb0 2023-10-03T10:18:19.627 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.628+0000 7f64f8384700 1 -- 172.21.15.146:0/2277611499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64f0130eb0 msgr2=0x7f64f01210d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.628+0000 7f64f8384700 1 --2- 172.21.15.146:0/2277611499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64f0130eb0 0x7f64f01210d0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f64e800efc0 tx=0x7f64e800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.628+0000 7f64f8384700 1 -- 172.21.15.146:0/2277611499 shutdown_connections 2023-10-03T10:18:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.628+0000 7f64f8384700 1 --2- 172.21.15.146:0/2277611499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64f0130eb0 0x7f64f01210d0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.628+0000 7f64f8384700 1 --2- 172.21.15.146:0/2277611499 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64f009d860 0x7f64f0120650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.628+0000 7f64f8384700 1 --2- 172.21.15.146:0/2277611499 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f64f009e170 0x7f64f0120b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.628+0000 7f64f8384700 1 -- 172.21.15.146:0/2277611499 >> 172.21.15.146:0/2277611499 conn(0x7f64f0099c40 msgr2=0x7f64f006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.628+0000 7f64f8384700 1 -- 172.21.15.146:0/2277611499 shutdown_connections 2023-10-03T10:18:19.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.628+0000 7f64f8384700 1 -- 172.21.15.146:0/2277611499 wait complete. 2023-10-03T10:18:19.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:19.788 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:19.858 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:19.899 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:19.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.915+0000 7f1933289700 1 Processor -- start 2023-10-03T10:18:19.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.915+0000 7f1933289700 1 -- start start 2023-10-03T10:18:19.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.916+0000 7f1933289700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f192c066410 0x7f192c1319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.916+0000 7f1933289700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f192c1314b0 0x7f192c131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.916+0000 7f1933289700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192c0a0f20 con 0x7f192c09bc70 2023-10-03T10:18:19.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.916+0000 7f1933289700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192c0667e0 con 0x7f192c1314b0 2023-10-03T10:18:19.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.916+0000 7f1933289700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f192c0a23c0 con 0x7f192c066410 2023-10-03T10:18:19.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.916+0000 7f1930824700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f192c1314b0 0x7f192c131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.916+0000 7f1931025700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f192c066410 0x7f192c1319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.916+0000 7f1930824700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f192c1314b0 0x7f192c131f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39796/0 (socket says 172.21.15.146:39796) 2023-10-03T10:18:19.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.916+0000 7f1930824700 1 -- 172.21.15.146:0/3358996569 learned_addr learned my addr 172.21.15.146:0/3358996569 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:19.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.916+0000 7f1930824700 1 -- 172.21.15.146:0/3358996569 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f192c066410 msgr2=0x7f192c1319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.916+0000 7f1930824700 1 --2- 172.21.15.146:0/3358996569 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f192c066410 0x7f192c1319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.916+0000 7f1930824700 1 -- 172.21.15.146:0/3358996569 >> v1:172.21.15.146:6789/0 conn(0x7f192c09bc70 legacy=0x7f192c09c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.916+0000 7f1923fff700 1 -- 172.21.15.146:0/3358996569 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241772516 0 0) 0x7f192c0a0f20 con 0x7f192c09bc70 2023-10-03T10:18:19.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.916+0000 7f1930824700 1 -- 172.21.15.146:0/3358996569 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c0a16e0 con 0x7f192c1314b0 2023-10-03T10:18:19.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.917+0000 7f1930824700 1 --2- 172.21.15.146:0/3358996569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f192c1314b0 0x7f192c131f30 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f191c009920 tx=0x7f191c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9832db8f85104da4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.917+0000 7f1923fff700 1 -- 172.21.15.146:0/3358996569 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c011830 con 0x7f192c1314b0 2023-10-03T10:18:19.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.917+0000 7f1923fff700 1 -- 172.21.15.146:0/3358996569 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c011990 con 0x7f192c1314b0 2023-10-03T10:18:19.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.917+0000 7f1923fff700 1 -- 172.21.15.146:0/3358996569 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c011d20 con 0x7f192c1314b0 2023-10-03T10:18:19.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.917+0000 7f1933289700 1 -- 172.21.15.146:0/3358996569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f192c1314b0 msgr2=0x7f192c131f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.917+0000 7f1933289700 1 --2- 172.21.15.146:0/3358996569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f192c1314b0 0x7f192c131f30 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f191c009920 tx=0x7f191c009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:19.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.917+0000 7f1933289700 1 -- 172.21.15.146:0/3358996569 shutdown_connections 2023-10-03T10:18:19.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.917+0000 7f1933289700 1 --2- 172.21.15.146:0/3358996569 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f192c066410 0x7f192c1319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.917+0000 7f1933289700 1 --2- 172.21.15.146:0/3358996569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f192c1314b0 0x7f192c131f30 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.917+0000 7f1933289700 1 -- 172.21.15.146:0/3358996569 >> 172.21.15.146:0/3358996569 conn(0x7f192c0a2980 msgr2=0x7f192c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.918+0000 7f1933289700 1 -- 172.21.15.146:0/3358996569 shutdown_connections 2023-10-03T10:18:19.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.918+0000 7f1933289700 1 -- 172.21.15.146:0/3358996569 wait complete. 2023-10-03T10:18:19.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.918+0000 7f1933289700 1 Processor -- start 2023-10-03T10:18:19.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.919+0000 7f1933289700 1 -- start start 2023-10-03T10:18:19.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.919+0000 7f1933289700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f192c066410 0x7f192c135180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.919+0000 7f1933289700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f192c09bc70 0x7f192c1356c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.919+0000 7f1933289700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f192c1314b0 0x7f192c135c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.919+0000 7f1933289700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192c1190b0 con 0x7f192c066410 2023-10-03T10:18:19.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.919+0000 7f1933289700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192c1192b0 con 0x7f192c09bc70 2023-10-03T10:18:19.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.919+0000 7f1933289700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f192c137b40 con 0x7f192c1314b0 2023-10-03T10:18:19.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.919+0000 7f1931025700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f192c066410 0x7f192c135180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.919+0000 7f1930824700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f192c09bc70 0x7f192c1356c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.919+0000 7f1931025700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f192c066410 0x7f192c135180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39798/0 (socket says 172.21.15.146:39798) 2023-10-03T10:18:19.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.919+0000 7f1931025700 1 -- 172.21.15.146:0/3230760722 learned_addr learned my addr 172.21.15.146:0/3230760722 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:19.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.919+0000 7f1931826700 1 --2- 172.21.15.146:0/3230760722 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f192c1314b0 0x7f192c135c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.919+0000 7f1931025700 1 -- 172.21.15.146:0/3230760722 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f192c1314b0 msgr2=0x7f192c135c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.919+0000 7f1931025700 1 --2- 172.21.15.146:0/3230760722 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f192c1314b0 0x7f192c135c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.919+0000 7f1931025700 1 -- 172.21.15.146:0/3230760722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f192c09bc70 msgr2=0x7f192c1356c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.919+0000 7f1931025700 1 --2- 172.21.15.146:0/3230760722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f192c09bc70 0x7f192c1356c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.919+0000 7f1931025700 1 -- 172.21.15.146:0/3230760722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191c009550 con 0x7f192c066410 2023-10-03T10:18:19.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.920+0000 7f1931025700 1 --2- 172.21.15.146:0/3230760722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f192c066410 0x7f192c135180 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f192800e990 tx=0x7f192800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.920+0000 7f1921ffb700 1 -- 172.21.15.146:0/3230760722 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19280096f0 con 0x7f192c066410 2023-10-03T10:18:19.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.920+0000 7f1921ffb700 1 -- 172.21.15.146:0/3230760722 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192800c690 con 0x7f192c066410 2023-10-03T10:18:19.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.920+0000 7f1933289700 1 -- 172.21.15.146:0/3230760722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f192c12dc90 con 0x7f192c066410 2023-10-03T10:18:19.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.920+0000 7f1921ffb700 1 -- 172.21.15.146:0/3230760722 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192800ca00 con 0x7f192c066410 2023-10-03T10:18:19.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.920+0000 7f1933289700 1 -- 172.21.15.146:0/3230760722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192c130850 con 0x7f192c066410 2023-10-03T10:18:19.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.921+0000 7f1921ffb700 1 -- 172.21.15.146:0/3230760722 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f192800cb60 con 0x7f192c066410 2023-10-03T10:18:19.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.921+0000 7f1921ffb700 1 -- 172.21.15.146:0/3230760722 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f192803fb50 con 0x7f192c066410 2023-10-03T10:18:19.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.921+0000 7f1933289700 1 -- 172.21.15.146:0/3230760722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f192c04f2a0 con 0x7f192c066410 2023-10-03T10:18:19.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.927+0000 7f1921ffb700 1 -- 172.21.15.146:0/3230760722 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1928021020 con 0x7f192c066410 2023-10-03T10:18:19.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.988+0000 7fd08c4a3700 1 Processor -- start 2023-10-03T10:18:19.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.988+0000 7fd08c4a3700 1 -- start start 2023-10-03T10:18:19.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.988+0000 7fd08c4a3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd08409e870 0x7fd08409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.988+0000 7fd08c4a3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd08409f180 0x7fd084131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.988+0000 7fd08c4a3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd084131d70 0x7fd084132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.988+0000 7fd08c4a3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0840a0920 con 0x7fd084131d70 2023-10-03T10:18:19.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.988+0000 7fd08c4a3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08409c970 con 0x7fd08409e870 2023-10-03T10:18:19.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.988+0000 7fd08c4a3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd08409bab0 con 0x7fd08409f180 2023-10-03T10:18:19.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.988+0000 7fd089a3e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd08409f180 0x7fd084131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.988+0000 7fd08a23f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd08409e870 0x7fd08409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.988+0000 7fd089a3e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd08409f180 0x7fd084131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54738/0 (socket says 172.21.15.146:54738) 2023-10-03T10:18:19.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.988+0000 7fd089a3e700 1 -- 172.21.15.146:0/2718888765 learned_addr learned my addr 172.21.15.146:0/2718888765 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:19.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.988+0000 7fd08a23f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd08409e870 0x7fd08409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57384/0 (socket says 172.21.15.146:57384) 2023-10-03T10:18:19.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.988+0000 7fd08aa40700 1 --2- 172.21.15.146:0/2718888765 >> v2:172.21.15.146:3300/0 conn(0x7fd084131d70 0x7fd084132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.989+0000 7fd089a3e700 1 -- 172.21.15.146:0/2718888765 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd08409e870 msgr2=0x7fd08409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.989+0000 7fd089a3e700 1 --2- 172.21.15.146:0/2718888765 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd08409e870 0x7fd08409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.989+0000 7fd089a3e700 1 -- 172.21.15.146:0/2718888765 >> v2:172.21.15.146:3300/0 conn(0x7fd084131d70 msgr2=0x7fd084132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.989+0000 7fd089a3e700 1 --2- 172.21.15.146:0/2718888765 >> v2:172.21.15.146:3300/0 conn(0x7fd084131d70 0x7fd084132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.989+0000 7fd089a3e700 1 -- 172.21.15.146:0/2718888765 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08409f9c0 con 0x7fd08409f180 2023-10-03T10:18:19.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.989+0000 7fd08aa40700 1 --2- 172.21.15.146:0/2718888765 >> v2:172.21.15.146:3300/0 conn(0x7fd084131d70 0x7fd084132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.989+0000 7fd089a3e700 1 --2- 172.21.15.146:0/2718888765 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd08409f180 0x7fd084131830 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fd0740098f0 tx=0x7fd074009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b0f2aead55968cf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.989+0000 7fd08923d700 1 -- 172.21.15.146:0/2718888765 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074011830 con 0x7fd08409f180 2023-10-03T10:18:19.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.989+0000 7fd08923d700 1 -- 172.21.15.146:0/2718888765 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd074011990 con 0x7fd08409f180 2023-10-03T10:18:19.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.989+0000 7fd08923d700 1 -- 172.21.15.146:0/2718888765 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074011d20 con 0x7fd08409f180 2023-10-03T10:18:19.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.990+0000 7fd08c4a3700 1 -- 172.21.15.146:0/2718888765 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd08409f180 msgr2=0x7fd084131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.990+0000 7fd08c4a3700 1 --2- 172.21.15.146:0/2718888765 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd08409f180 0x7fd084131830 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fd0740098f0 tx=0x7fd074009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:19.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.990+0000 7fd08c4a3700 1 -- 172.21.15.146:0/2718888765 shutdown_connections 2023-10-03T10:18:19.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.990+0000 7fd08c4a3700 1 --2- 172.21.15.146:0/2718888765 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd08409e870 0x7fd08409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.990+0000 7fd08c4a3700 1 --2- 172.21.15.146:0/2718888765 >> v2:172.21.15.146:3300/0 conn(0x7fd084131d70 0x7fd084132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.990+0000 7fd08c4a3700 1 --2- 172.21.15.146:0/2718888765 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd08409f180 0x7fd084131830 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.990+0000 7fd08c4a3700 1 -- 172.21.15.146:0/2718888765 >> 172.21.15.146:0/2718888765 conn(0x7fd0840a4430 msgr2=0x7fd0840a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.990+0000 7fd08c4a3700 1 -- 172.21.15.146:0/2718888765 shutdown_connections 2023-10-03T10:18:19.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.990+0000 7fd08c4a3700 1 -- 172.21.15.146:0/2718888765 wait complete. 2023-10-03T10:18:19.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.991+0000 7fd08c4a3700 1 Processor -- start 2023-10-03T10:18:19.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.991+0000 7fd08c4a3700 1 -- start start 2023-10-03T10:18:19.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.992+0000 7fd08c4a3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd08409e870 0x7fd08411f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.992+0000 7fd08c4a3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd08409f180 0x7fd08411f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.992+0000 7fd08c4a3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd084131d70 0x7fd08411fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.992+0000 7fd08c4a3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0841206b0 con 0x7fd08409e870 2023-10-03T10:18:19.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.992+0000 7fd08c4a3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd084121c70 con 0x7fd08409f180 2023-10-03T10:18:19.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.992+0000 7fd08c4a3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd084122cb0 con 0x7fd084131d70 2023-10-03T10:18:19.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.992+0000 7fd08a23f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd08409e870 0x7fd08411f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.992+0000 7fd08a23f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd08409e870 0x7fd08411f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39814/0 (socket says 172.21.15.146:39814) 2023-10-03T10:18:19.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.992+0000 7fd08a23f700 1 -- 172.21.15.146:0/3934967855 learned_addr learned my addr 172.21.15.146:0/3934967855 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:19.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.992+0000 7fd08aa40700 1 --2- 172.21.15.146:0/3934967855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd084131d70 0x7fd08411fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.992+0000 7fd089a3e700 1 --2- 172.21.15.146:0/3934967855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd08409f180 0x7fd08411f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.992+0000 7fd08a23f700 1 -- 172.21.15.146:0/3934967855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd084131d70 msgr2=0x7fd08411fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.992+0000 7fd08a23f700 1 --2- 172.21.15.146:0/3934967855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd084131d70 0x7fd08411fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.992+0000 7fd08a23f700 1 -- 172.21.15.146:0/3934967855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd08409f180 msgr2=0x7fd08411f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.992+0000 7fd08a23f700 1 --2- 172.21.15.146:0/3934967855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd08409f180 0x7fd08411f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.992+0000 7fd08a23f700 1 -- 172.21.15.146:0/3934967855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd07c009a70 con 0x7fd08409e870 2023-10-03T10:18:19.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.992+0000 7fd08aa40700 1 --2- 172.21.15.146:0/3934967855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd084131d70 0x7fd08411fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.992+0000 7fd089a3e700 1 --2- 172.21.15.146:0/3934967855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd08409f180 0x7fd08411f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.993+0000 7fd08a23f700 1 --2- 172.21.15.146:0/3934967855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd08409e870 0x7fd08411f1e0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fd08000e960 tx=0x7fd08000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.993+0000 7fd07affd700 1 -- 172.21.15.146:0/3934967855 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08000c640 con 0x7fd08409e870 2023-10-03T10:18:19.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.993+0000 7fd07affd700 1 -- 172.21.15.146:0/3934967855 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08000c7a0 con 0x7fd08409e870 2023-10-03T10:18:19.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.993+0000 7fd08c4a3700 1 -- 172.21.15.146:0/3934967855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd074009550 con 0x7fd08409e870 2023-10-03T10:18:19.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.993+0000 7fd07affd700 1 -- 172.21.15.146:0/3934967855 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08000cb30 con 0x7fd08409e870 2023-10-03T10:18:19.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.993+0000 7fd08c4a3700 1 -- 172.21.15.146:0/3934967855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd084131830 con 0x7fd08409e870 2023-10-03T10:18:19.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.994+0000 7fd07affd700 1 -- 172.21.15.146:0/3934967855 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd08000cc90 con 0x7fd08409e870 2023-10-03T10:18:19.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.994+0000 7fd08c4a3700 1 -- 172.21.15.146:0/3934967855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd08404f2a0 con 0x7fd08409e870 2023-10-03T10:18:19.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.994+0000 7fd07affd700 1 -- 172.21.15.146:0/3934967855 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd08003f6d0 con 0x7fd08409e870 2023-10-03T10:18:19.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:19.999+0000 7fd07affd700 1 -- 172.21.15.146:0/3934967855 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd0800232f0 con 0x7fd08409e870 2023-10-03T10:18:20.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.028+0000 7f05f7de0700 1 Processor -- start 2023-10-03T10:18:20.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.029+0000 7f05f7de0700 1 -- start start 2023-10-03T10:18:20.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.029+0000 7f05f7de0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05f00a0a70 0x7f05f00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.029+0000 7f05f7de0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f05f00a1380 0x7f05f0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.029+0000 7f05f7de0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05f0133f50 0x7f05f0134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.029+0000 7f05f7de0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f009e9d0 con 0x7f05f00a1380 2023-10-03T10:18:20.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.029+0000 7f05f7de0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f009dc00 con 0x7f05f0133f50 2023-10-03T10:18:20.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.029+0000 7f05f7de0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05f009dec0 con 0x7f05f00a0a70 2023-10-03T10:18:20.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.029+0000 7f05f637d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05f0133f50 0x7f05f0134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.029+0000 7f05f537b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f05f00a1380 0x7f05f0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.029+0000 7f05f637d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05f0133f50 0x7f05f0134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57398/0 (socket says 172.21.15.146:57398) 2023-10-03T10:18:20.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.029+0000 7f05f637d700 1 -- 172.21.15.146:0/4203686668 learned_addr learned my addr 172.21.15.146:0/4203686668 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:20.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.029+0000 7f05f5b7c700 1 --2- 172.21.15.146:0/4203686668 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05f00a0a70 0x7f05f00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.029+0000 7f05f537b700 1 -- 172.21.15.146:0/4203686668 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05f00a0a70 msgr2=0x7f05f00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.029+0000 7f05f537b700 1 --2- 172.21.15.146:0/4203686668 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05f00a0a70 0x7f05f00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.030+0000 7f05f537b700 1 -- 172.21.15.146:0/4203686668 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05f0133f50 msgr2=0x7f05f0134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.030+0000 7f05f537b700 1 --2- 172.21.15.146:0/4203686668 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05f0133f50 0x7f05f0134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.030+0000 7f05f537b700 1 -- 172.21.15.146:0/4203686668 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f009e6a0 con 0x7f05f00a1380 2023-10-03T10:18:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.030+0000 7f05f537b700 1 --2- 172.21.15.146:0/4203686668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05f00a1380 0x7f05f0133a10 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f05e0009840 tx=0x7f05e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d97e1e68681029b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.030+0000 7f05f4b7a700 1 -- 172.21.15.146:0/4203686668 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0011830 con 0x7f05f00a1380 2023-10-03T10:18:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.030+0000 7f05f4b7a700 1 -- 172.21.15.146:0/4203686668 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e0011990 con 0x7f05f00a1380 2023-10-03T10:18:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.030+0000 7f05f4b7a700 1 -- 172.21.15.146:0/4203686668 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0011d20 con 0x7f05f00a1380 2023-10-03T10:18:20.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.031+0000 7f05f7de0700 1 -- 172.21.15.146:0/4203686668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05f00a1380 msgr2=0x7f05f0133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.031+0000 7f05f7de0700 1 --2- 172.21.15.146:0/4203686668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05f00a1380 0x7f05f0133a10 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f05e0009840 tx=0x7f05e0009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:20.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.031+0000 7f05f7de0700 1 -- 172.21.15.146:0/4203686668 shutdown_connections 2023-10-03T10:18:20.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.031+0000 7f05f7de0700 1 --2- 172.21.15.146:0/4203686668 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05f0133f50 0x7f05f0134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.031+0000 7f05f7de0700 1 --2- 172.21.15.146:0/4203686668 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05f00a0a70 0x7f05f00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.031+0000 7f05f7de0700 1 --2- 172.21.15.146:0/4203686668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05f00a1380 0x7f05f0133a10 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.031+0000 7f05f7de0700 1 -- 172.21.15.146:0/4203686668 >> 172.21.15.146:0/4203686668 conn(0x7f05f00a6610 msgr2=0x7f05f00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.031+0000 7f05f7de0700 1 -- 172.21.15.146:0/4203686668 shutdown_connections 2023-10-03T10:18:20.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.031+0000 7f05f7de0700 1 -- 172.21.15.146:0/4203686668 wait complete. 2023-10-03T10:18:20.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.032+0000 7f05f7de0700 1 Processor -- start 2023-10-03T10:18:20.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.032+0000 7f05f7de0700 1 -- start start 2023-10-03T10:18:20.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.033+0000 7f05f7de0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05f00a0a70 0x7f05f0122440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.033+0000 7f05f7de0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05f00a1380 0x7f05f0122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.033+0000 7f05f7de0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05f0133f50 0x7f05f0122ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.033+0000 7f05f7de0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f0125250 con 0x7f05f0133f50 2023-10-03T10:18:20.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.033+0000 7f05f7de0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f0124180 con 0x7f05f00a0a70 2023-10-03T10:18:20.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.033+0000 7f05f7de0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05f0124e90 con 0x7f05f00a1380 2023-10-03T10:18:20.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.033+0000 7f05f537b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05f00a1380 0x7f05f0122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.033+0000 7f05f537b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05f00a1380 0x7f05f0122980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54776/0 (socket says 172.21.15.146:54776) 2023-10-03T10:18:20.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.033+0000 7f05f537b700 1 -- 172.21.15.146:0/702991477 learned_addr learned my addr 172.21.15.146:0/702991477 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:20.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.033+0000 7f05f637d700 1 --2- 172.21.15.146:0/702991477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05f0133f50 0x7f05f0122ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.033+0000 7f05f5b7c700 1 --2- 172.21.15.146:0/702991477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05f00a0a70 0x7f05f0122440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.033+0000 7f05f637d700 1 -- 172.21.15.146:0/702991477 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05f00a1380 msgr2=0x7f05f0122980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.033+0000 7f05f637d700 1 --2- 172.21.15.146:0/702991477 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05f00a1380 0x7f05f0122980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.033+0000 7f05f637d700 1 -- 172.21.15.146:0/702991477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05f00a0a70 msgr2=0x7f05f0122440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.033+0000 7f05f637d700 1 --2- 172.21.15.146:0/702991477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05f00a0a70 0x7f05f0122440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.033+0000 7f05f637d700 1 -- 172.21.15.146:0/702991477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e00094a0 con 0x7f05f0133f50 2023-10-03T10:18:20.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.033+0000 7f05f5b7c700 1 --2- 172.21.15.146:0/702991477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05f00a0a70 0x7f05f0122440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:20.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.033+0000 7f05f537b700 1 --2- 172.21.15.146:0/702991477 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05f00a1380 0x7f05f0122980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:20.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.034+0000 7f05f637d700 1 --2- 172.21.15.146:0/702991477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05f0133f50 0x7f05f0122ec0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009d90 tx=0x7f05e800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.034+0000 7f05e67fc700 1 -- 172.21.15.146:0/702991477 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e8003c20 con 0x7f05f0133f50 2023-10-03T10:18:20.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.034+0000 7f05e67fc700 1 -- 172.21.15.146:0/702991477 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e800f040 con 0x7f05f0133f50 2023-10-03T10:18:20.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.034+0000 7f05e67fc700 1 -- 172.21.15.146:0/702991477 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e800c880 con 0x7f05f0133f50 2023-10-03T10:18:20.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.034+0000 7f05f7de0700 1 -- 172.21.15.146:0/702991477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f0125f10 con 0x7f05f0133f50 2023-10-03T10:18:20.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.034+0000 7f05f7de0700 1 -- 172.21.15.146:0/702991477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f0125970 con 0x7f05f0133f50 2023-10-03T10:18:20.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.035+0000 7f05f7de0700 1 -- 172.21.15.146:0/702991477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f004f2a0 con 0x7f05f0133f50 2023-10-03T10:18:20.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.035+0000 7f05e67fc700 1 -- 172.21.15.146:0/702991477 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f05e800c9e0 con 0x7f05f0133f50 2023-10-03T10:18:20.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.035+0000 7f05e67fc700 1 -- 172.21.15.146:0/702991477 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f05e803f920 con 0x7f05f0133f50 2023-10-03T10:18:20.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.039+0000 7f05e67fc700 1 -- 172.21.15.146:0/702991477 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f05e8013d70 con 0x7f05f0133f50 2023-10-03T10:18:20.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.126+0000 7f1933289700 1 -- 172.21.15.146:0/3230760722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f192c0724e0 con 0x7f192c066410 2023-10-03T10:18:20.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.126+0000 7f1921ffb700 1 -- 172.21.15.146:0/3230760722 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1928017070 con 0x7f192c066410 2023-10-03T10:18:20.127 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:20.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.128+0000 7f1933289700 1 -- 172.21.15.146:0/3230760722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f192c066410 msgr2=0x7f192c135180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.128+0000 7f1933289700 1 --2- 172.21.15.146:0/3230760722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f192c066410 0x7f192c135180 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f192800e990 tx=0x7f192800eca0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.128+0000 7f1933289700 1 -- 172.21.15.146:0/3230760722 shutdown_connections 2023-10-03T10:18:20.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.128+0000 7f1933289700 1 --2- 172.21.15.146:0/3230760722 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f192c1314b0 0x7f192c135c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.128+0000 7f1933289700 1 --2- 172.21.15.146:0/3230760722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f192c066410 0x7f192c135180 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.128+0000 7f1933289700 1 --2- 172.21.15.146:0/3230760722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f192c09bc70 0x7f192c1356c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.128+0000 7f1933289700 1 -- 172.21.15.146:0/3230760722 >> 172.21.15.146:0/3230760722 conn(0x7f192c0a2980 msgr2=0x7f192c071530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.128+0000 7f1933289700 1 -- 172.21.15.146:0/3230760722 shutdown_connections 2023-10-03T10:18:20.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.129+0000 7f1933289700 1 -- 172.21.15.146:0/3230760722 wait complete. 2023-10-03T10:18:20.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:20.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.195+0000 7fd08c4a3700 1 -- 172.21.15.146:0/3934967855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd084120da0 con 0x7fd08409e870 2023-10-03T10:18:20.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.195+0000 7fd07affd700 1 -- 172.21.15.146:0/3934967855 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd080017070 con 0x7fd08409e870 2023-10-03T10:18:20.196 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:20.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.197+0000 7fd08c4a3700 1 -- 172.21.15.146:0/3934967855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd08409e870 msgr2=0x7fd08411f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.197+0000 7fd08c4a3700 1 --2- 172.21.15.146:0/3934967855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd08409e870 0x7fd08411f1e0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fd08000e960 tx=0x7fd08000ec70 comp rx=0 tx=0).stop 2023-10-03T10:18:20.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.198+0000 7fd08c4a3700 1 -- 172.21.15.146:0/3934967855 shutdown_connections 2023-10-03T10:18:20.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.198+0000 7fd08c4a3700 1 --2- 172.21.15.146:0/3934967855 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd084131d70 0x7fd08411fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.198+0000 7fd08c4a3700 1 --2- 172.21.15.146:0/3934967855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd08409e870 0x7fd08411f1e0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.198+0000 7fd08c4a3700 1 --2- 172.21.15.146:0/3934967855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd08409f180 0x7fd08411f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.198+0000 7fd08c4a3700 1 -- 172.21.15.146:0/3934967855 >> 172.21.15.146:0/3934967855 conn(0x7fd0840a4430 msgr2=0x7fd08409cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.198+0000 7fd08c4a3700 1 -- 172.21.15.146:0/3934967855 shutdown_connections 2023-10-03T10:18:20.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.198+0000 7fd08c4a3700 1 -- 172.21.15.146:0/3934967855 wait complete. 2023-10-03T10:18:20.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:20.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.235+0000 7f05f7de0700 1 -- 172.21.15.146:0/702991477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f05f0125750 con 0x7f05f0133f50 2023-10-03T10:18:20.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.236+0000 7f05e67fc700 1 -- 172.21.15.146:0/702991477 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f05e8014e00 con 0x7f05f0133f50 2023-10-03T10:18:20.236 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:20.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.238+0000 7f05f7de0700 1 -- 172.21.15.146:0/702991477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05f0133f50 msgr2=0x7f05f0122ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.238+0000 7f05f7de0700 1 --2- 172.21.15.146:0/702991477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05f0133f50 0x7f05f0122ec0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009d90 tx=0x7f05e800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.238+0000 7f05f7de0700 1 -- 172.21.15.146:0/702991477 shutdown_connections 2023-10-03T10:18:20.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.238+0000 7f05f7de0700 1 --2- 172.21.15.146:0/702991477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05f0133f50 0x7f05f0122ec0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.238+0000 7f05f7de0700 1 --2- 172.21.15.146:0/702991477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05f00a0a70 0x7f05f0122440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.238+0000 7f05f7de0700 1 --2- 172.21.15.146:0/702991477 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f05f00a1380 0x7f05f0122980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.238+0000 7f05f7de0700 1 -- 172.21.15.146:0/702991477 >> 172.21.15.146:0/702991477 conn(0x7f05f00a6610 msgr2=0x7f05f009c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.238+0000 7f05f7de0700 1 -- 172.21.15.146:0/702991477 shutdown_connections 2023-10-03T10:18:20.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.238+0000 7f05f7de0700 1 -- 172.21.15.146:0/702991477 wait complete. 2023-10-03T10:18:20.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:20.642 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:20.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.768+0000 7f7a91565700 1 Processor -- start 2023-10-03T10:18:20.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.768+0000 7f7a91565700 1 -- start start 2023-10-03T10:18:20.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.768+0000 7f7a91565700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7a8c0a0a90 0x7f7a8c0a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.768+0000 7f7a91565700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a8c0a13a0 0x7f7a8c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.768+0000 7f7a91565700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a8c133f70 0x7f7a8c1343d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.768+0000 7f7a91565700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a8c0a3aa0 con 0x7f7a8c0a0a90 2023-10-03T10:18:20.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.768+0000 7f7a91565700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c09a540 con 0x7f7a8c133f70 2023-10-03T10:18:20.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.768+0000 7f7a91565700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c0a1fe0 con 0x7f7a8c0a13a0 2023-10-03T10:18:20.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.768+0000 7f7a8b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a8c133f70 0x7f7a8c1343d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.768+0000 7f7a8a7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a8c0a13a0 0x7f7a8c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.768+0000 7f7a8b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a8c133f70 0x7f7a8c1343d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57426/0 (socket says 172.21.15.146:57426) 2023-10-03T10:18:20.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.768+0000 7f7a8a7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a8c0a13a0 0x7f7a8c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54788/0 (socket says 172.21.15.146:54788) 2023-10-03T10:18:20.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.768+0000 7f7a8affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7a8c0a0a90 0x7f7a8c0a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.768+0000 7f7a8b7fe700 1 -- 172.21.15.146:0/4213457920 learned_addr learned my addr 172.21.15.146:0/4213457920 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:20.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.768+0000 7f7a8a7fc700 1 -- 172.21.15.146:0/4213457920 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a8c133f70 msgr2=0x7f7a8c1343d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.768+0000 7f7a8a7fc700 1 --2- 172.21.15.146:0/4213457920 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a8c133f70 0x7f7a8c1343d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.769+0000 7f7a8a7fc700 1 -- 172.21.15.146:0/4213457920 >> v2:172.21.15.146:3300/0 conn(0x7f7a8c0a0a90 msgr2=0x7f7a8c0a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.769+0000 7f7a8a7fc700 1 --2- 172.21.15.146:0/4213457920 >> v2:172.21.15.146:3300/0 conn(0x7f7a8c0a0a90 0x7f7a8c0a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.769+0000 7f7a8a7fc700 1 -- 172.21.15.146:0/4213457920 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c09a280 con 0x7f7a8c0a13a0 2023-10-03T10:18:20.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.769+0000 7f7a8b7fe700 1 --2- 172.21.15.146:0/4213457920 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a8c133f70 0x7f7a8c1343d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:20.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.769+0000 7f7a8affd700 1 --2- 172.21.15.146:0/4213457920 >> v2:172.21.15.146:3300/0 conn(0x7f7a8c0a0a90 0x7f7a8c0a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:20.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.769+0000 7f7a8a7fc700 1 --2- 172.21.15.146:0/4213457920 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a8c0a13a0 0x7f7a8c133a30 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009870 tx=0x7f7a7c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6e2b3523f4e8aab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.769+0000 7f7a89ffb700 1 -- 172.21.15.146:0/4213457920 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c011830 con 0x7f7a8c0a13a0 2023-10-03T10:18:20.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.769+0000 7f7a89ffb700 1 -- 172.21.15.146:0/4213457920 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c011990 con 0x7f7a8c0a13a0 2023-10-03T10:18:20.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.769+0000 7f7a89ffb700 1 -- 172.21.15.146:0/4213457920 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c011d20 con 0x7f7a8c0a13a0 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.769+0000 7f7a91565700 1 -- 172.21.15.146:0/4213457920 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a8c0a13a0 msgr2=0x7f7a8c133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.769+0000 7f7a91565700 1 --2- 172.21.15.146:0/4213457920 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a8c0a13a0 0x7f7a8c133a30 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009870 tx=0x7f7a7c009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.769+0000 7f7a91565700 1 -- 172.21.15.146:0/4213457920 shutdown_connections 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.769+0000 7f7a91565700 1 --2- 172.21.15.146:0/4213457920 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a8c133f70 0x7f7a8c1343d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.769+0000 7f7a91565700 1 --2- 172.21.15.146:0/4213457920 >> v2:172.21.15.146:3300/0 conn(0x7f7a8c0a0a90 0x7f7a8c0a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.769+0000 7f7a91565700 1 --2- 172.21.15.146:0/4213457920 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a8c0a13a0 0x7f7a8c133a30 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.769+0000 7f7a91565700 1 -- 172.21.15.146:0/4213457920 >> 172.21.15.146:0/4213457920 conn(0x7f7a8c099c40 msgr2=0x7f7a8c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.769+0000 7f7a91565700 1 -- 172.21.15.146:0/4213457920 shutdown_connections 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.769+0000 7f7a91565700 1 -- 172.21.15.146:0/4213457920 wait complete. 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.770+0000 7f7a91565700 1 Processor -- start 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.771+0000 7f7a91565700 1 -- start start 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.771+0000 7f7a91565700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a8c0a0a90 0x7f7a8c11f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.771+0000 7f7a91565700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a8c0a13a0 0x7f7a8c11fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.771+0000 7f7a91565700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a8c133f70 0x7f7a8c1c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.771+0000 7f7a91565700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c122470 con 0x7f7a8c0a0a90 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.771+0000 7f7a91565700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c122650 con 0x7f7a8c0a13a0 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.771+0000 7f7a91565700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c1334c0 con 0x7f7a8c133f70 2023-10-03T10:18:20.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.771+0000 7f7a8b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a8c133f70 0x7f7a8c1c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.771+0000 7f7a8a7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a8c0a13a0 0x7f7a8c11fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.771+0000 7f7a8affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a8c0a0a90 0x7f7a8c11f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.771+0000 7f7a8b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a8c133f70 0x7f7a8c1c8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54792/0 (socket says 172.21.15.146:54792) 2023-10-03T10:18:20.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.771+0000 7f7a8b7fe700 1 -- 172.21.15.146:0/4293498743 learned_addr learned my addr 172.21.15.146:0/4293498743 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:20.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.771+0000 7f7a8b7fe700 1 -- 172.21.15.146:0/4293498743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a8c0a13a0 msgr2=0x7f7a8c11fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.771+0000 7f7a8b7fe700 1 --2- 172.21.15.146:0/4293498743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a8c0a13a0 0x7f7a8c11fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.771+0000 7f7a8b7fe700 1 -- 172.21.15.146:0/4293498743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a8c0a0a90 msgr2=0x7f7a8c11f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.771+0000 7f7a8b7fe700 1 --2- 172.21.15.146:0/4293498743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a8c0a0a90 0x7f7a8c11f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.771+0000 7f7a8b7fe700 1 -- 172.21.15.146:0/4293498743 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a800094a0 con 0x7f7a8c133f70 2023-10-03T10:18:20.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.771+0000 7f7a8a7fc700 1 --2- 172.21.15.146:0/4293498743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a8c0a13a0 0x7f7a8c11fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:20.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.771+0000 7f7a8affd700 1 --2- 172.21.15.146:0/4293498743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a8c0a0a90 0x7f7a8c11f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:20.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.771+0000 7f7a8b7fe700 1 --2- 172.21.15.146:0/4293498743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a8c133f70 0x7f7a8c1c8300 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f7a84009f10 tx=0x7f7a8400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.772+0000 7f7a737fe700 1 -- 172.21.15.146:0/4293498743 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a84018070 con 0x7f7a8c133f70 2023-10-03T10:18:20.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.772+0000 7f7a737fe700 1 -- 172.21.15.146:0/4293498743 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8400f040 con 0x7f7a8c133f70 2023-10-03T10:18:20.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.772+0000 7f7a737fe700 1 -- 172.21.15.146:0/4293498743 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a84003c40 con 0x7f7a8c133f70 2023-10-03T10:18:20.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.772+0000 7f7a91565700 1 -- 172.21.15.146:0/4293498743 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a84009b30 con 0x7f7a8c133f70 2023-10-03T10:18:20.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.772+0000 7f7a91565700 1 -- 172.21.15.146:0/4293498743 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7c0094a0 con 0x7f7a8c133f70 2023-10-03T10:18:20.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.772+0000 7f7a737fe700 1 -- 172.21.15.146:0/4293498743 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a8400c940 con 0x7f7a8c133f70 2023-10-03T10:18:20.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.772+0000 7f7a737fe700 1 -- 172.21.15.146:0/4293498743 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7a8403f7f0 con 0x7f7a8c133f70 2023-10-03T10:18:20.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.773+0000 7f7a91565700 1 -- 172.21.15.146:0/4293498743 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a8c04f2a0 con 0x7f7a8c133f70 2023-10-03T10:18:20.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.777+0000 7f7a737fe700 1 -- 172.21.15.146:0/4293498743 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a84014480 con 0x7f7a8c133f70 2023-10-03T10:18:20.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.965+0000 7f7a91565700 1 -- 172.21.15.146:0/4293498743 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7a8c120f30 con 0x7f7a8c133f70 2023-10-03T10:18:20.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.965+0000 7f7a737fe700 1 -- 172.21.15.146:0/4293498743 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7a8401cbb0 con 0x7f7a8c133f70 2023-10-03T10:18:20.966 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:20.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.967+0000 7f7a91565700 1 -- 172.21.15.146:0/4293498743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a8c133f70 msgr2=0x7f7a8c1c8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.967+0000 7f7a91565700 1 --2- 172.21.15.146:0/4293498743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a8c133f70 0x7f7a8c1c8300 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f7a84009f10 tx=0x7f7a8400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.967+0000 7f7a91565700 1 -- 172.21.15.146:0/4293498743 shutdown_connections 2023-10-03T10:18:20.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.967+0000 7f7a91565700 1 --2- 172.21.15.146:0/4293498743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7a8c133f70 0x7f7a8c1c8300 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.967+0000 7f7a91565700 1 --2- 172.21.15.146:0/4293498743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a8c0a0a90 0x7f7a8c11f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.967+0000 7f7a91565700 1 --2- 172.21.15.146:0/4293498743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7a8c0a13a0 0x7f7a8c11fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.967+0000 7f7a91565700 1 -- 172.21.15.146:0/4293498743 >> 172.21.15.146:0/4293498743 conn(0x7f7a8c099c40 msgr2=0x7f7a8c1bbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.967+0000 7f7a91565700 1 -- 172.21.15.146:0/4293498743 shutdown_connections 2023-10-03T10:18:20.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:20.967+0000 7f7a91565700 1 -- 172.21.15.146:0/4293498743 wait complete. 2023-10-03T10:18:20.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:21.142 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:21.212 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:21.251 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:21.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.269+0000 7fb8ced72700 1 Processor -- start 2023-10-03T10:18:21.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.269+0000 7fb8ced72700 1 -- start start 2023-10-03T10:18:21.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.269+0000 7fb8ced72700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8c8133ad0 0x7fb8c8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.269+0000 7fb8ced72700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c8130bc0 0x7fb8c813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.269+0000 7fb8ced72700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c806b2d0 con 0x7fb8c81300a0 2023-10-03T10:18:21.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.269+0000 7fb8ced72700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c8133610 con 0x7fb8c8130bc0 2023-10-03T10:18:21.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.269+0000 7fb8ced72700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c809a500 con 0x7fb8c8133ad0 2023-10-03T10:18:21.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.270+0000 7fb8c7fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb8c81300a0 0x7fb8c81304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33774/0 (socket says 172.21.15.146:33774) 2023-10-03T10:18:21.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.270+0000 7fb8c7fff700 1 -- 172.21.15.146:0/878239717 learned_addr learned my addr 172.21.15.146:0/878239717 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:21.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.270+0000 7fb8cd30f700 1 --2- 172.21.15.146:0/878239717 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c8130bc0 0x7fb8c813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.270+0000 7fb8ccb0e700 1 --2- 172.21.15.146:0/878239717 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8c8133ad0 0x7fb8c8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.270+0000 7fb8cd30f700 1 -- 172.21.15.146:0/878239717 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8c8133ad0 msgr2=0x7fb8c8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:21.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.270+0000 7fb8cd30f700 1 --2- 172.21.15.146:0/878239717 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8c8133ad0 0x7fb8c8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.270+0000 7fb8cd30f700 1 -- 172.21.15.146:0/878239717 >> v1:172.21.15.146:6789/0 conn(0x7fb8c81300a0 legacy=0x7fb8c81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.270+0000 7fb8cd30f700 1 -- 172.21.15.146:0/878239717 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c81338b0 con 0x7fb8c8130bc0 2023-10-03T10:18:21.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.270+0000 7fb8c77fe700 1 -- 172.21.15.146:0/878239717 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280489463 0 0) 0x7fb8c806b2d0 con 0x7fb8c81300a0 2023-10-03T10:18:21.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.270+0000 7fb8cd30f700 1 --2- 172.21.15.146:0/878239717 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c8130bc0 0x7fb8c813b990 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009dc0 tx=0x7fb8c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6bf852df48665a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:21.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.270+0000 7fb8c77fe700 1 -- 172.21.15.146:0/878239717 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c000e070 con 0x7fb8c8130bc0 2023-10-03T10:18:21.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.270+0000 7fb8c77fe700 1 -- 172.21.15.146:0/878239717 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c000bbd0 con 0x7fb8c8130bc0 2023-10-03T10:18:21.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.270+0000 7fb8c77fe700 1 -- 172.21.15.146:0/878239717 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0012430 con 0x7fb8c8130bc0 2023-10-03T10:18:21.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.271+0000 7fb8ced72700 1 -- 172.21.15.146:0/878239717 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c8130bc0 msgr2=0x7fb8c813b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.271+0000 7fb8ced72700 1 --2- 172.21.15.146:0/878239717 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c8130bc0 0x7fb8c813b990 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009dc0 tx=0x7fb8c000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:21.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.271+0000 7fb8ced72700 1 -- 172.21.15.146:0/878239717 shutdown_connections 2023-10-03T10:18:21.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.271+0000 7fb8ced72700 1 --2- 172.21.15.146:0/878239717 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c8130bc0 0x7fb8c813b990 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.271+0000 7fb8ced72700 1 --2- 172.21.15.146:0/878239717 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8c8133ad0 0x7fb8c8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.271+0000 7fb8ced72700 1 -- 172.21.15.146:0/878239717 >> 172.21.15.146:0/878239717 conn(0x7fb8c8099c40 msgr2=0x7fb8c80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:21.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.271+0000 7fb8ced72700 1 -- 172.21.15.146:0/878239717 shutdown_connections 2023-10-03T10:18:21.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.271+0000 7fb8ced72700 1 -- 172.21.15.146:0/878239717 wait complete. 2023-10-03T10:18:21.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.272+0000 7fb8ced72700 1 Processor -- start 2023-10-03T10:18:21.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.272+0000 7fb8ced72700 1 -- start start 2023-10-03T10:18:21.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.273+0000 7fb8ced72700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c81300a0 0x7fb8c811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.273+0000 7fb8ced72700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8c8130bc0 0x7fb8c811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.273+0000 7fb8ced72700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c8133ad0 0x7fb8c811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.273+0000 7fb8ced72700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c812d890 con 0x7fb8c8133ad0 2023-10-03T10:18:21.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.273+0000 7fb8ced72700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c811fab0 con 0x7fb8c81300a0 2023-10-03T10:18:21.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.273+0000 7fb8ced72700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c8120950 con 0x7fb8c8130bc0 2023-10-03T10:18:21.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.273+0000 7fb8ccb0e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c81300a0 0x7fb8c811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.273+0000 7fb8ccb0e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c81300a0 0x7fb8c811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57442/0 (socket says 172.21.15.146:57442) 2023-10-03T10:18:21.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.273+0000 7fb8ccb0e700 1 -- 172.21.15.146:0/3377249780 learned_addr learned my addr 172.21.15.146:0/3377249780 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:21.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.273+0000 7fb8cd30f700 1 --2- 172.21.15.146:0/3377249780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c8133ad0 0x7fb8c811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.274+0000 7fb8ccb0e700 1 -- 172.21.15.146:0/3377249780 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8c8130bc0 msgr2=0x7fb8c811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.274+0000 7fb8ccb0e700 1 --2- 172.21.15.146:0/3377249780 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8c8130bc0 0x7fb8c811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.274+0000 7fb8ccb0e700 1 -- 172.21.15.146:0/3377249780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c8133ad0 msgr2=0x7fb8c811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.274+0000 7fb8ccb0e700 1 --2- 172.21.15.146:0/3377249780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c8133ad0 0x7fb8c811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.274+0000 7fb8ccb0e700 1 -- 172.21.15.146:0/3377249780 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c0009a70 con 0x7fb8c81300a0 2023-10-03T10:18:21.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.274+0000 7fb8cd30f700 1 --2- 172.21.15.146:0/3377249780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c8133ad0 0x7fb8c811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:21.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.274+0000 7fb8ccb0e700 1 --2- 172.21.15.146:0/3377249780 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c81300a0 0x7fb8c811da40 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00e840 tx=0x7fb8bc00eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:21.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.274+0000 7fb8c57fa700 1 -- 172.21.15.146:0/3377249780 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc013610 con 0x7fb8c81300a0 2023-10-03T10:18:21.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.274+0000 7fb8c57fa700 1 -- 172.21.15.146:0/3377249780 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8bc013770 con 0x7fb8c81300a0 2023-10-03T10:18:21.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.274+0000 7fb8ced72700 1 -- 172.21.15.146:0/3377249780 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c812f740 con 0x7fb8c81300a0 2023-10-03T10:18:21.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.274+0000 7fb8c57fa700 1 -- 172.21.15.146:0/3377249780 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc013b20 con 0x7fb8c81300a0 2023-10-03T10:18:21.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.274+0000 7fb8ced72700 1 -- 172.21.15.146:0/3377249780 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c811fd70 con 0x7fb8c81300a0 2023-10-03T10:18:21.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.275+0000 7fb8c57fa700 1 -- 172.21.15.146:0/3377249780 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8bc013c80 con 0x7fb8c81300a0 2023-10-03T10:18:21.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.275+0000 7fb8c57fa700 1 -- 172.21.15.146:0/3377249780 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb8bc03f460 con 0x7fb8c81300a0 2023-10-03T10:18:21.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.276+0000 7fb8ced72700 1 -- 172.21.15.146:0/3377249780 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c806be10 con 0x7fb8c81300a0 2023-10-03T10:18:21.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.281+0000 7fb8c57fa700 1 -- 172.21.15.146:0/3377249780 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8bc021080 con 0x7fb8c81300a0 2023-10-03T10:18:21.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.342+0000 7f7553561700 1 Processor -- start 2023-10-03T10:18:21.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.343+0000 7f7553561700 1 -- start start 2023-10-03T10:18:21.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.343+0000 7f7553561700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f754c066410 0x7f754c1319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.343+0000 7f7553561700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f754c1314b0 0x7f754c131f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.343+0000 7f7553561700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f754c09bc70 0x7f754c09c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.343+0000 7f7553561700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f754c0667e0 con 0x7f754c066410 2023-10-03T10:18:21.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.343+0000 7f7553561700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c0a23c0 con 0x7f754c09bc70 2023-10-03T10:18:21.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.343+0000 7f7553561700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f754c0a0f20 con 0x7f754c1314b0 2023-10-03T10:18:21.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.344+0000 7f7550afc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f754c1314b0 0x7f754c131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.344+0000 7f7550afc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f754c1314b0 0x7f754c131f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54818/0 (socket says 172.21.15.146:54818) 2023-10-03T10:18:21.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.344+0000 7f7550afc700 1 -- 172.21.15.146:0/1893241117 learned_addr learned my addr 172.21.15.146:0/1893241117 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:21.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.344+0000 7f7551afe700 1 --2- 172.21.15.146:0/1893241117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f754c09bc70 0x7f754c09c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.344+0000 7f75512fd700 1 --2- 172.21.15.146:0/1893241117 >> v2:172.21.15.146:3300/0 conn(0x7f754c066410 0x7f754c1319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.344+0000 7f7550afc700 1 -- 172.21.15.146:0/1893241117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f754c09bc70 msgr2=0x7f754c09c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:21.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.344+0000 7f7550afc700 1 --2- 172.21.15.146:0/1893241117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f754c09bc70 0x7f754c09c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.344+0000 7f7550afc700 1 -- 172.21.15.146:0/1893241117 >> v2:172.21.15.146:3300/0 conn(0x7f754c066410 msgr2=0x7f754c1319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:21.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.344+0000 7f7550afc700 1 --2- 172.21.15.146:0/1893241117 >> v2:172.21.15.146:3300/0 conn(0x7f754c066410 0x7f754c1319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.344+0000 7f7550afc700 1 -- 172.21.15.146:0/1893241117 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c0a16e0 con 0x7f754c1314b0 2023-10-03T10:18:21.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.344+0000 7f7550afc700 1 --2- 172.21.15.146:0/1893241117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f754c1314b0 0x7f754c131f30 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f753c009920 tx=0x7f753c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d526c279f2bc1065 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:21.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.344+0000 7f7543fff700 1 -- 172.21.15.146:0/1893241117 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c010a90 con 0x7f754c1314b0 2023-10-03T10:18:21.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.344+0000 7f7543fff700 1 -- 172.21.15.146:0/1893241117 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753c010bf0 con 0x7f754c1314b0 2023-10-03T10:18:21.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.344+0000 7f7543fff700 1 -- 172.21.15.146:0/1893241117 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c018440 con 0x7f754c1314b0 2023-10-03T10:18:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.345+0000 7f7553561700 1 -- 172.21.15.146:0/1893241117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f754c1314b0 msgr2=0x7f754c131f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.345+0000 7f7553561700 1 --2- 172.21.15.146:0/1893241117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f754c1314b0 0x7f754c131f30 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f753c009920 tx=0x7f753c009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.345+0000 7f7553561700 1 -- 172.21.15.146:0/1893241117 shutdown_connections 2023-10-03T10:18:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.345+0000 7f7553561700 1 --2- 172.21.15.146:0/1893241117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f754c09bc70 0x7f754c09c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.345+0000 7f7553561700 1 --2- 172.21.15.146:0/1893241117 >> v2:172.21.15.146:3300/0 conn(0x7f754c066410 0x7f754c1319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.345+0000 7f7553561700 1 --2- 172.21.15.146:0/1893241117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f754c1314b0 0x7f754c131f30 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.345+0000 7f7553561700 1 -- 172.21.15.146:0/1893241117 >> 172.21.15.146:0/1893241117 conn(0x7f754c0a2980 msgr2=0x7f754c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.345+0000 7f7553561700 1 -- 172.21.15.146:0/1893241117 shutdown_connections 2023-10-03T10:18:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.345+0000 7f7553561700 1 -- 172.21.15.146:0/1893241117 wait complete. 2023-10-03T10:18:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.346+0000 7f7553561700 1 Processor -- start 2023-10-03T10:18:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.346+0000 7f7553561700 1 -- start start 2023-10-03T10:18:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.347+0000 7f7553561700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f754c066410 0x7f754c119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.347+0000 7f7553561700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f754c09bc70 0x7f754c119db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.347+0000 7f7553561700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f754c1314b0 0x7f754c11a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.347+0000 7f7553561700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c12cc80 con 0x7f754c066410 2023-10-03T10:18:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.347+0000 7f7553561700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c11d390 con 0x7f754c1314b0 2023-10-03T10:18:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.347+0000 7f7553561700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f754c11c740 con 0x7f754c09bc70 2023-10-03T10:18:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.347+0000 7f75512fd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f754c066410 0x7f754c119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.347+0000 7f75512fd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f754c066410 0x7f754c119870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39872/0 (socket says 172.21.15.146:39872) 2023-10-03T10:18:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.347+0000 7f75512fd700 1 -- 172.21.15.146:0/1438894937 learned_addr learned my addr 172.21.15.146:0/1438894937 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.347+0000 7f7550afc700 1 --2- 172.21.15.146:0/1438894937 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f754c09bc70 0x7f754c119db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.347+0000 7f7551afe700 1 --2- 172.21.15.146:0/1438894937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f754c1314b0 0x7f754c11a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.347+0000 7f75512fd700 1 -- 172.21.15.146:0/1438894937 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f754c09bc70 msgr2=0x7f754c119db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.347+0000 7f75512fd700 1 --2- 172.21.15.146:0/1438894937 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f754c09bc70 0x7f754c119db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.347+0000 7f75512fd700 1 -- 172.21.15.146:0/1438894937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f754c1314b0 msgr2=0x7f754c11a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.347+0000 7f75512fd700 1 --2- 172.21.15.146:0/1438894937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f754c1314b0 0x7f754c11a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.347+0000 7f75512fd700 1 -- 172.21.15.146:0/1438894937 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753c009550 con 0x7f754c066410 2023-10-03T10:18:21.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.347+0000 7f7550afc700 1 --2- 172.21.15.146:0/1438894937 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f754c09bc70 0x7f754c119db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:21.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.347+0000 7f7551afe700 1 --2- 172.21.15.146:0/1438894937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f754c1314b0 0x7f754c11a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:21.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.347+0000 7f75512fd700 1 --2- 172.21.15.146:0/1438894937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f754c066410 0x7f754c119870 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f754800e990 tx=0x7f754800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:21.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.348+0000 7f7541ffb700 1 -- 172.21.15.146:0/1438894937 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75480096f0 con 0x7f754c066410 2023-10-03T10:18:21.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.348+0000 7f7541ffb700 1 -- 172.21.15.146:0/1438894937 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754800c850 con 0x7f754c066410 2023-10-03T10:18:21.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.348+0000 7f7553561700 1 -- 172.21.15.146:0/1438894937 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754c09a540 con 0x7f754c066410 2023-10-03T10:18:21.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.348+0000 7f7541ffb700 1 -- 172.21.15.146:0/1438894937 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754800cbc0 con 0x7f754c066410 2023-10-03T10:18:21.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.348+0000 7f7553561700 1 -- 172.21.15.146:0/1438894937 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754c11d0b0 con 0x7f754c066410 2023-10-03T10:18:21.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.349+0000 7f7541ffb700 1 -- 172.21.15.146:0/1438894937 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f754800cd20 con 0x7f754c066410 2023-10-03T10:18:21.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.349+0000 7f7541ffb700 1 -- 172.21.15.146:0/1438894937 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f754803fcc0 con 0x7f754c066410 2023-10-03T10:18:21.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.349+0000 7f7553561700 1 -- 172.21.15.146:0/1438894937 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f754c11cd20 con 0x7f754c066410 2023-10-03T10:18:21.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.357+0000 7f7541ffb700 1 -- 172.21.15.146:0/1438894937 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7548021080 con 0x7f754c066410 2023-10-03T10:18:21.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.389+0000 7f24a1c6d700 1 Processor -- start 2023-10-03T10:18:21.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.389+0000 7f24a1c6d700 1 -- start start 2023-10-03T10:18:21.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.389+0000 7f24a1c6d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f249c134140 0x7f249c138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.389+0000 7f24a1c6d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f249c134570 0x7f249c13b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.389+0000 7f24a1c6d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f249c09b110 con 0x7f249c09ad40 2023-10-03T10:18:21.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.389+0000 7f24a1c6d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f249c0a3b60 con 0x7f249c134570 2023-10-03T10:18:21.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.389+0000 7f24a1c6d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f249c0a1a80 con 0x7f249c134140 2023-10-03T10:18:21.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.389+0000 7f249bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f249c134570 0x7f249c13b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.389+0000 7f249affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f249c134140 0x7f249c138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.390+0000 7f249bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f249c134570 0x7f249c13b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39878/0 (socket says 172.21.15.146:39878) 2023-10-03T10:18:21.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.390+0000 7f249bfff700 1 -- 172.21.15.146:0/3856363321 learned_addr learned my addr 172.21.15.146:0/3856363321 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:21.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.390+0000 7f249b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f249c09ad40 0x7f249c133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33776/0 (socket says 172.21.15.146:33776) 2023-10-03T10:18:21.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.390+0000 7f249a7fc700 1 -- 172.21.15.146:0/3856363321 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138814909 0 0) 0x7f249c09b110 con 0x7f249c09ad40 2023-10-03T10:18:21.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.390+0000 7f249a7fc700 1 -- 172.21.15.146:0/3856363321 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24840035b0 con 0x7f249c09ad40 2023-10-03T10:18:21.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.390+0000 7f249bfff700 1 -- 172.21.15.146:0/3856363321 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f249c134140 msgr2=0x7f249c138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:21.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.390+0000 7f249bfff700 1 --2- 172.21.15.146:0/3856363321 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f249c134140 0x7f249c138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.390+0000 7f249bfff700 1 -- 172.21.15.146:0/3856363321 >> v1:172.21.15.146:6789/0 conn(0x7f249c09ad40 legacy=0x7f249c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.390+0000 7f249bfff700 1 -- 172.21.15.146:0/3856363321 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249c0a2fa0 con 0x7f249c134570 2023-10-03T10:18:21.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.390+0000 7f249affd700 1 --2- 172.21.15.146:0/3856363321 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f249c134140 0x7f249c138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:21.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.390+0000 7f249bfff700 1 --2- 172.21.15.146:0/3856363321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249c134570 0x7f249c13b3d0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f2494009e50 tx=0x7f249400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7539a22a63b18 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:21.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.390+0000 7f249a7fc700 1 -- 172.21.15.146:0/3856363321 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249400e070 con 0x7f249c134570 2023-10-03T10:18:21.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.390+0000 7f249a7fc700 1 -- 172.21.15.146:0/3856363321 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249400b910 con 0x7f249c134570 2023-10-03T10:18:21.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.390+0000 7f249a7fc700 1 -- 172.21.15.146:0/3856363321 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249400bcc0 con 0x7f249c134570 2023-10-03T10:18:21.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.391+0000 7f24a1c6d700 1 -- 172.21.15.146:0/3856363321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249c134570 msgr2=0x7f249c13b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.391+0000 7f24a1c6d700 1 --2- 172.21.15.146:0/3856363321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249c134570 0x7f249c13b3d0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f2494009e50 tx=0x7f249400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:21.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.391+0000 7f24a1c6d700 1 -- 172.21.15.146:0/3856363321 shutdown_connections 2023-10-03T10:18:21.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.391+0000 7f24a1c6d700 1 --2- 172.21.15.146:0/3856363321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249c134570 0x7f249c13b3d0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.391+0000 7f24a1c6d700 1 --2- 172.21.15.146:0/3856363321 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f249c134140 0x7f249c138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.391+0000 7f24a1c6d700 1 -- 172.21.15.146:0/3856363321 >> 172.21.15.146:0/3856363321 conn(0x7f249c099c40 msgr2=0x7f249c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:21.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.391+0000 7f24a1c6d700 1 -- 172.21.15.146:0/3856363321 shutdown_connections 2023-10-03T10:18:21.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.391+0000 7f24a1c6d700 1 -- 172.21.15.146:0/3856363321 wait complete. 2023-10-03T10:18:21.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.392+0000 7f24a1c6d700 1 Processor -- start 2023-10-03T10:18:21.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.392+0000 7f24a1c6d700 1 -- start start 2023-10-03T10:18:21.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.393+0000 7f24a1c6d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f249c09ad40 0x7f249c139370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.393+0000 7f24a1c6d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f249c134140 0x7f249c1398b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.393+0000 7f24a1c6d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249c134570 0x7f249c139df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:21.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.393+0000 7f24a1c6d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c13a840 con 0x7f249c134570 2023-10-03T10:18:21.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.393+0000 7f24a1c6d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249c11ecc0 con 0x7f249c09ad40 2023-10-03T10:18:21.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.393+0000 7f24a1c6d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f249c11d620 con 0x7f249c134140 2023-10-03T10:18:21.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.393+0000 7f249affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f249c134140 0x7f249c1398b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.393+0000 7f249affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f249c134140 0x7f249c1398b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54858/0 (socket says 172.21.15.146:54858) 2023-10-03T10:18:21.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.393+0000 7f249affd700 1 -- 172.21.15.146:0/194892426 learned_addr learned my addr 172.21.15.146:0/194892426 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:21.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.393+0000 7f249b7fe700 1 --2- 172.21.15.146:0/194892426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f249c09ad40 0x7f249c139370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.393+0000 7f249bfff700 1 --2- 172.21.15.146:0/194892426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249c134570 0x7f249c139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:21.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.393+0000 7f249affd700 1 -- 172.21.15.146:0/194892426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f249c09ad40 msgr2=0x7f249c139370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.393+0000 7f249affd700 1 --2- 172.21.15.146:0/194892426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f249c09ad40 0x7f249c139370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.393+0000 7f249affd700 1 -- 172.21.15.146:0/194892426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249c134570 msgr2=0x7f249c139df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.393+0000 7f249affd700 1 --2- 172.21.15.146:0/194892426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249c134570 0x7f249c139df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.393+0000 7f249affd700 1 -- 172.21.15.146:0/194892426 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24900094a0 con 0x7f249c134140 2023-10-03T10:18:21.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.393+0000 7f249bfff700 1 --2- 172.21.15.146:0/194892426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249c134570 0x7f249c139df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:21.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.394+0000 7f249affd700 1 --2- 172.21.15.146:0/194892426 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f249c134140 0x7f249c1398b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f249000ec10 tx=0x7f249000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:21.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.394+0000 7f2483fff700 1 -- 172.21.15.146:0/194892426 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249000c850 con 0x7f249c134140 2023-10-03T10:18:21.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.394+0000 7f2483fff700 1 -- 172.21.15.146:0/194892426 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249000c9b0 con 0x7f249c134140 2023-10-03T10:18:21.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.394+0000 7f24a1c6d700 1 -- 172.21.15.146:0/194892426 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2494009b30 con 0x7f249c134140 2023-10-03T10:18:21.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.394+0000 7f2483fff700 1 -- 172.21.15.146:0/194892426 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249000cd40 con 0x7f249c134140 2023-10-03T10:18:21.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.394+0000 7f24a1c6d700 1 -- 172.21.15.146:0/194892426 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249c09c7e0 con 0x7f249c134140 2023-10-03T10:18:21.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.395+0000 7f2483fff700 1 -- 172.21.15.146:0/194892426 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2490013470 con 0x7f249c134140 2023-10-03T10:18:21.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.395+0000 7f24a1c6d700 1 -- 172.21.15.146:0/194892426 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1361e0 con 0x7f249c134140 2023-10-03T10:18:21.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.395+0000 7f2483fff700 1 -- 172.21.15.146:0/194892426 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f249003f7a0 con 0x7f249c134140 2023-10-03T10:18:21.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.399+0000 7f2483fff700 1 -- 172.21.15.146:0/194892426 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2490013720 con 0x7f249c134140 2023-10-03T10:18:21.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.480+0000 7fb8ced72700 1 -- 172.21.15.146:0/3377249780 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb8c804f2a0 con 0x7fb8c81300a0 2023-10-03T10:18:21.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.480+0000 7fb8c57fa700 1 -- 172.21.15.146:0/3377249780 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb8bc012370 con 0x7fb8c81300a0 2023-10-03T10:18:21.481 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:21.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.482+0000 7fb8ced72700 1 -- 172.21.15.146:0/3377249780 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c81300a0 msgr2=0x7fb8c811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.482+0000 7fb8ced72700 1 --2- 172.21.15.146:0/3377249780 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c81300a0 0x7fb8c811da40 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00e840 tx=0x7fb8bc00eb50 comp rx=0 tx=0).stop 2023-10-03T10:18:21.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.482+0000 7fb8ced72700 1 -- 172.21.15.146:0/3377249780 shutdown_connections 2023-10-03T10:18:21.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.482+0000 7fb8ced72700 1 --2- 172.21.15.146:0/3377249780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c8133ad0 0x7fb8c811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.482+0000 7fb8ced72700 1 --2- 172.21.15.146:0/3377249780 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c81300a0 0x7fb8c811da40 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.482+0000 7fb8ced72700 1 --2- 172.21.15.146:0/3377249780 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb8c8130bc0 0x7fb8c811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.482+0000 7fb8ced72700 1 -- 172.21.15.146:0/3377249780 >> 172.21.15.146:0/3377249780 conn(0x7fb8c8099c40 msgr2=0x7fb8c8132bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:21.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.482+0000 7fb8ced72700 1 -- 172.21.15.146:0/3377249780 shutdown_connections 2023-10-03T10:18:21.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.482+0000 7fb8ced72700 1 -- 172.21.15.146:0/3377249780 wait complete. 2023-10-03T10:18:21.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:21.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.552+0000 7f7553561700 1 -- 172.21.15.146:0/1438894937 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f754c04f2a0 con 0x7f754c066410 2023-10-03T10:18:21.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.552+0000 7f7541ffb700 1 -- 172.21.15.146:0/1438894937 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7548017020 con 0x7f754c066410 2023-10-03T10:18:21.553 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:21.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.554+0000 7f7553561700 1 -- 172.21.15.146:0/1438894937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f754c066410 msgr2=0x7f754c119870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.554+0000 7f7553561700 1 --2- 172.21.15.146:0/1438894937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f754c066410 0x7f754c119870 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f754800e990 tx=0x7f754800ed50 comp rx=0 tx=0).stop 2023-10-03T10:18:21.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.554+0000 7f7553561700 1 -- 172.21.15.146:0/1438894937 shutdown_connections 2023-10-03T10:18:21.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.554+0000 7f7553561700 1 --2- 172.21.15.146:0/1438894937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f754c1314b0 0x7f754c11a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.554+0000 7f7553561700 1 --2- 172.21.15.146:0/1438894937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f754c066410 0x7f754c119870 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.554+0000 7f7553561700 1 --2- 172.21.15.146:0/1438894937 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f754c09bc70 0x7f754c119db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.554+0000 7f7553561700 1 -- 172.21.15.146:0/1438894937 >> 172.21.15.146:0/1438894937 conn(0x7f754c0a2980 msgr2=0x7f754c12e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:21.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.554+0000 7f7553561700 1 -- 172.21.15.146:0/1438894937 shutdown_connections 2023-10-03T10:18:21.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.554+0000 7f7553561700 1 -- 172.21.15.146:0/1438894937 wait complete. 2023-10-03T10:18:21.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:21.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.594+0000 7f24a1c6d700 1 -- 172.21.15.146:0/194892426 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f249c04f2a0 con 0x7f249c134140 2023-10-03T10:18:21.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.594+0000 7f2483fff700 1 -- 172.21.15.146:0/194892426 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f249001bba0 con 0x7f249c134140 2023-10-03T10:18:21.595 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:21.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.596+0000 7f24a1c6d700 1 -- 172.21.15.146:0/194892426 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f249c134140 msgr2=0x7f249c1398b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.596+0000 7f24a1c6d700 1 --2- 172.21.15.146:0/194892426 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f249c134140 0x7f249c1398b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f249000ec10 tx=0x7f249000ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:21.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.596+0000 7f24a1c6d700 1 -- 172.21.15.146:0/194892426 shutdown_connections 2023-10-03T10:18:21.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.596+0000 7f24a1c6d700 1 --2- 172.21.15.146:0/194892426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249c134570 0x7f249c139df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.596+0000 7f24a1c6d700 1 --2- 172.21.15.146:0/194892426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f249c09ad40 0x7f249c139370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.596+0000 7f24a1c6d700 1 --2- 172.21.15.146:0/194892426 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f249c134140 0x7f249c1398b0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.596+0000 7f24a1c6d700 1 -- 172.21.15.146:0/194892426 >> 172.21.15.146:0/194892426 conn(0x7f249c099c40 msgr2=0x7f249c13b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:21.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.596+0000 7f24a1c6d700 1 -- 172.21.15.146:0/194892426 shutdown_connections 2023-10-03T10:18:21.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:21.596+0000 7f24a1c6d700 1 -- 172.21.15.146:0/194892426 wait complete. 2023-10-03T10:18:21.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:21.981 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.103+0000 7fcc4e774700 1 Processor -- start 2023-10-03T10:18:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.103+0000 7fcc4e774700 1 -- start start 2023-10-03T10:18:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.103+0000 7fcc4e774700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcc4809d860 0x7fcc4809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.103+0000 7fcc4e774700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc4809e170 0x7fcc481307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.103+0000 7fcc4e774700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc48130ce0 0x7fcc48131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.104+0000 7fcc4e774700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc48131670 con 0x7fcc4809d860 2023-10-03T10:18:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.104+0000 7fcc4e774700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4809aaa0 con 0x7fcc4809e170 2023-10-03T10:18:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.104+0000 7fcc4e774700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4809f870 con 0x7fcc48130ce0 2023-10-03T10:18:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.104+0000 7fcc47fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcc4809d860 0x7fcc4809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.104+0000 7fcc477fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc4809e170 0x7fcc481307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.104+0000 7fcc4cd11700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc48130ce0 0x7fcc48131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.104+0000 7fcc477fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc4809e170 0x7fcc481307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57472/0 (socket says 172.21.15.146:57472) 2023-10-03T10:18:22.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.104+0000 7fcc47fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcc4809d860 0x7fcc4809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39898/0 (socket says 172.21.15.146:39898) 2023-10-03T10:18:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.104+0000 7fcc4cd11700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc48130ce0 0x7fcc48131130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54868/0 (socket says 172.21.15.146:54868) 2023-10-03T10:18:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.104+0000 7fcc477fe700 1 -- 172.21.15.146:0/682283346 learned_addr learned my addr 172.21.15.146:0/682283346 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.104+0000 7fcc4cd11700 1 -- 172.21.15.146:0/682283346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc4809e170 msgr2=0x7fcc481307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.104+0000 7fcc4cd11700 1 --2- 172.21.15.146:0/682283346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc4809e170 0x7fcc481307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.104+0000 7fcc4cd11700 1 -- 172.21.15.146:0/682283346 >> v2:172.21.15.146:3300/0 conn(0x7fcc4809d860 msgr2=0x7fcc4809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.104+0000 7fcc4cd11700 1 --2- 172.21.15.146:0/682283346 >> v2:172.21.15.146:3300/0 conn(0x7fcc4809d860 0x7fcc4809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.104+0000 7fcc4cd11700 1 -- 172.21.15.146:0/682283346 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4809b360 con 0x7fcc48130ce0 2023-10-03T10:18:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.104+0000 7fcc47fff700 1 --2- 172.21.15.146:0/682283346 >> v2:172.21.15.146:3300/0 conn(0x7fcc4809d860 0x7fcc4809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.104+0000 7fcc477fe700 1 --2- 172.21.15.146:0/682283346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc4809e170 0x7fcc481307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.104+0000 7fcc4cd11700 1 --2- 172.21.15.146:0/682283346 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc48130ce0 0x7fcc48131130 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009dc0 tx=0x7fcc4000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85397ff6ef1cb699 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.104+0000 7fcc46ffd700 1 -- 172.21.15.146:0/682283346 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4000e070 con 0x7fcc48130ce0 2023-10-03T10:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.104+0000 7fcc46ffd700 1 -- 172.21.15.146:0/682283346 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4000bae0 con 0x7fcc48130ce0 2023-10-03T10:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.104+0000 7fcc46ffd700 1 -- 172.21.15.146:0/682283346 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4000be90 con 0x7fcc48130ce0 2023-10-03T10:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.105+0000 7fcc4e774700 1 -- 172.21.15.146:0/682283346 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc48130ce0 msgr2=0x7fcc48131130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.105+0000 7fcc4e774700 1 --2- 172.21.15.146:0/682283346 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc48130ce0 0x7fcc48131130 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009dc0 tx=0x7fcc4000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.105+0000 7fcc4e774700 1 -- 172.21.15.146:0/682283346 shutdown_connections 2023-10-03T10:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.105+0000 7fcc4e774700 1 --2- 172.21.15.146:0/682283346 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc48130ce0 0x7fcc48131130 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.105+0000 7fcc4e774700 1 --2- 172.21.15.146:0/682283346 >> v2:172.21.15.146:3300/0 conn(0x7fcc4809d860 0x7fcc4809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.105+0000 7fcc4e774700 1 --2- 172.21.15.146:0/682283346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc4809e170 0x7fcc481307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.105+0000 7fcc4e774700 1 -- 172.21.15.146:0/682283346 >> 172.21.15.146:0/682283346 conn(0x7fcc48099c40 msgr2=0x7fcc480a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.105+0000 7fcc4e774700 1 -- 172.21.15.146:0/682283346 shutdown_connections 2023-10-03T10:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.105+0000 7fcc4e774700 1 -- 172.21.15.146:0/682283346 wait complete. 2023-10-03T10:18:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.106+0000 7fcc4e774700 1 Processor -- start 2023-10-03T10:18:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.106+0000 7fcc4e774700 1 -- start start 2023-10-03T10:18:22.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.106+0000 7fcc4e774700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4809d860 0x7fcc4806e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.106+0000 7fcc4e774700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc4809e170 0x7fcc4806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.106+0000 7fcc4e774700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc48130ce0 0x7fcc4806f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.106+0000 7fcc4e774700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc481246b0 con 0x7fcc4809d860 2023-10-03T10:18:22.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.106+0000 7fcc4e774700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc48130570 con 0x7fcc48130ce0 2023-10-03T10:18:22.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.106+0000 7fcc4e774700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc480a21f0 con 0x7fcc4809e170 2023-10-03T10:18:22.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.106+0000 7fcc477fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc4809e170 0x7fcc4806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.106+0000 7fcc4cd11700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc48130ce0 0x7fcc4806f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.106+0000 7fcc477fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc4809e170 0x7fcc4806ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54878/0 (socket says 172.21.15.146:54878) 2023-10-03T10:18:22.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.106+0000 7fcc47fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4809d860 0x7fcc4806e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.106+0000 7fcc477fe700 1 -- 172.21.15.146:0/1989819942 learned_addr learned my addr 172.21.15.146:0/1989819942 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:22.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.107+0000 7fcc477fe700 1 -- 172.21.15.146:0/1989819942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc48130ce0 msgr2=0x7fcc4806f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.107+0000 7fcc477fe700 1 --2- 172.21.15.146:0/1989819942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc48130ce0 0x7fcc4806f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.107+0000 7fcc477fe700 1 -- 172.21.15.146:0/1989819942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4809d860 msgr2=0x7fcc4806e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.107+0000 7fcc477fe700 1 --2- 172.21.15.146:0/1989819942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4809d860 0x7fcc4806e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.107+0000 7fcc477fe700 1 -- 172.21.15.146:0/1989819942 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3c0094a0 con 0x7fcc4809e170 2023-10-03T10:18:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.107+0000 7fcc4cd11700 1 --2- 172.21.15.146:0/1989819942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc48130ce0 0x7fcc4806f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.107+0000 7fcc47fff700 1 --2- 172.21.15.146:0/1989819942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4809d860 0x7fcc4806e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.107+0000 7fcc477fe700 1 --2- 172.21.15.146:0/1989819942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc4809e170 0x7fcc4806ee70 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800ebe0 tx=0x7fcc3800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.107+0000 7fcc44ff9700 1 -- 172.21.15.146:0/1989819942 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3800c850 con 0x7fcc4809e170 2023-10-03T10:18:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.107+0000 7fcc44ff9700 1 -- 172.21.15.146:0/1989819942 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3800c9b0 con 0x7fcc4809e170 2023-10-03T10:18:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.107+0000 7fcc44ff9700 1 -- 172.21.15.146:0/1989819942 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3800cd40 con 0x7fcc4809e170 2023-10-03T10:18:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.107+0000 7fcc4e774700 1 -- 172.21.15.146:0/1989819942 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc38009550 con 0x7fcc4809e170 2023-10-03T10:18:22.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.107+0000 7fcc4e774700 1 -- 172.21.15.146:0/1989819942 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc40009a70 con 0x7fcc4809e170 2023-10-03T10:18:22.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.108+0000 7fcc44ff9700 1 -- 172.21.15.146:0/1989819942 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcc38013470 con 0x7fcc4809e170 2023-10-03T10:18:22.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.108+0000 7fcc44ff9700 1 -- 172.21.15.146:0/1989819942 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcc3803f890 con 0x7fcc4809e170 2023-10-03T10:18:22.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.108+0000 7fcc4e774700 1 -- 172.21.15.146:0/1989819942 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc4804f2a0 con 0x7fcc4809e170 2023-10-03T10:18:22.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.113+0000 7fcc44ff9700 1 -- 172.21.15.146:0/1989819942 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcc38017080 con 0x7fcc4809e170 2023-10-03T10:18:22.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.297+0000 7fcc4e774700 1 -- 172.21.15.146:0/1989819942 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcc4806c3b0 con 0x7fcc4809e170 2023-10-03T10:18:22.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.297+0000 7fcc44ff9700 1 -- 172.21.15.146:0/1989819942 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcc380232f0 con 0x7fcc4809e170 2023-10-03T10:18:22.298 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:22.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.300+0000 7fcc4e774700 1 -- 172.21.15.146:0/1989819942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc4809e170 msgr2=0x7fcc4806ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.300+0000 7fcc4e774700 1 --2- 172.21.15.146:0/1989819942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc4809e170 0x7fcc4806ee70 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800ebe0 tx=0x7fcc3800eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.300+0000 7fcc4e774700 1 -- 172.21.15.146:0/1989819942 shutdown_connections 2023-10-03T10:18:22.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.300+0000 7fcc4e774700 1 --2- 172.21.15.146:0/1989819942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc48130ce0 0x7fcc4806f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.300+0000 7fcc4e774700 1 --2- 172.21.15.146:0/1989819942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4809d860 0x7fcc4806e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.300+0000 7fcc4e774700 1 --2- 172.21.15.146:0/1989819942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc4809e170 0x7fcc4806ee70 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.300+0000 7fcc4e774700 1 -- 172.21.15.146:0/1989819942 >> 172.21.15.146:0/1989819942 conn(0x7fcc48099c40 msgr2=0x7fcc48070b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.300+0000 7fcc4e774700 1 -- 172.21.15.146:0/1989819942 shutdown_connections 2023-10-03T10:18:22.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.300+0000 7fcc4e774700 1 -- 172.21.15.146:0/1989819942 wait complete. 2023-10-03T10:18:22.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:22.496 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:22.567 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:22.610 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:22.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.621+0000 7fda2b7ca700 1 Processor -- start 2023-10-03T10:18:22.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.622+0000 7fda2b7ca700 1 -- start start 2023-10-03T10:18:22.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.622+0000 7fda2b7ca700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fda2409e340 0x7fda241359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.622+0000 7fda2b7ca700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fda24135f20 0x7fda24138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.622+0000 7fda2b7ca700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2409aaa0 con 0x7fda2409d860 2023-10-03T10:18:22.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.622+0000 7fda2b7ca700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2409e730 con 0x7fda2409e340 2023-10-03T10:18:22.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.622+0000 7fda2b7ca700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda2409f870 con 0x7fda24135f20 2023-10-03T10:18:22.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.622+0000 7fda28d65700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fda2409e340 0x7fda241359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.622+0000 7fda28d65700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fda2409e340 0x7fda241359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39926/0 (socket says 172.21.15.146:39926) 2023-10-03T10:18:22.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.622+0000 7fda29566700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fda2409d860 0x7fda2409dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33792/0 (socket says 172.21.15.146:33792) 2023-10-03T10:18:22.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.622+0000 7fda28d65700 1 -- 172.21.15.146:0/2616371419 learned_addr learned my addr 172.21.15.146:0/2616371419 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:22.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.622+0000 7fda29d67700 1 --2- 172.21.15.146:0/2616371419 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fda24135f20 0x7fda24138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.623+0000 7fda28d65700 1 -- 172.21.15.146:0/2616371419 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fda24135f20 msgr2=0x7fda24138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:22.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.623+0000 7fda28d65700 1 --2- 172.21.15.146:0/2616371419 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fda24135f20 0x7fda24138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.623+0000 7fda28d65700 1 -- 172.21.15.146:0/2616371419 >> v1:172.21.15.146:6789/0 conn(0x7fda2409d860 legacy=0x7fda2409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.623+0000 7fda28d65700 1 -- 172.21.15.146:0/2616371419 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2409b360 con 0x7fda2409e340 2023-10-03T10:18:22.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.623+0000 7fda28d65700 1 --2- 172.21.15.146:0/2616371419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2409e340 0x7fda241359e0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fda1400bb90 tx=0x7fda1400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3743df89b537cb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.623+0000 7fda1bfff700 1 -- 172.21.15.146:0/2616371419 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1400dc30 con 0x7fda2409e340 2023-10-03T10:18:22.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.623+0000 7fda1bfff700 1 -- 172.21.15.146:0/2616371419 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1400dd90 con 0x7fda2409e340 2023-10-03T10:18:22.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.623+0000 7fda1bfff700 1 -- 172.21.15.146:0/2616371419 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda14004250 con 0x7fda2409e340 2023-10-03T10:18:22.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.624+0000 7fda2b7ca700 1 -- 172.21.15.146:0/2616371419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2409e340 msgr2=0x7fda241359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.624+0000 7fda2b7ca700 1 --2- 172.21.15.146:0/2616371419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2409e340 0x7fda241359e0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fda1400bb90 tx=0x7fda1400bea0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.624+0000 7fda2b7ca700 1 -- 172.21.15.146:0/2616371419 shutdown_connections 2023-10-03T10:18:22.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.624+0000 7fda2b7ca700 1 --2- 172.21.15.146:0/2616371419 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fda24135f20 0x7fda24138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.624+0000 7fda2b7ca700 1 --2- 172.21.15.146:0/2616371419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2409e340 0x7fda241359e0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.624+0000 7fda2b7ca700 1 -- 172.21.15.146:0/2616371419 >> 172.21.15.146:0/2616371419 conn(0x7fda24099c40 msgr2=0x7fda240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.624+0000 7fda2b7ca700 1 -- 172.21.15.146:0/2616371419 shutdown_connections 2023-10-03T10:18:22.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.624+0000 7fda2b7ca700 1 -- 172.21.15.146:0/2616371419 wait complete. 2023-10-03T10:18:22.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.625+0000 7fda2b7ca700 1 Processor -- start 2023-10-03T10:18:22.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.625+0000 7fda2b7ca700 1 -- start start 2023-10-03T10:18:22.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.625+0000 7fda2b7ca700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda2409d860 0x7fda24119630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.625+0000 7fda2b7ca700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2409e340 0x7fda24119b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.625+0000 7fda2b7ca700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fda24135f20 0x7fda2411a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.625+0000 7fda2b7ca700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2411b000 con 0x7fda2409e340 2023-10-03T10:18:22.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.625+0000 7fda2b7ca700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2411cca0 con 0x7fda2409d860 2023-10-03T10:18:22.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.625+0000 7fda2b7ca700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda2411c230 con 0x7fda24135f20 2023-10-03T10:18:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.625+0000 7fda28d65700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2409e340 0x7fda24119b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.625+0000 7fda28d65700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2409e340 0x7fda24119b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39928/0 (socket says 172.21.15.146:39928) 2023-10-03T10:18:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.625+0000 7fda28d65700 1 -- 172.21.15.146:0/3754195806 learned_addr learned my addr 172.21.15.146:0/3754195806 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.625+0000 7fda29d67700 1 --2- 172.21.15.146:0/3754195806 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fda24135f20 0x7fda2411a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.625+0000 7fda29566700 1 --2- 172.21.15.146:0/3754195806 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda2409d860 0x7fda24119630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.626+0000 7fda28d65700 1 -- 172.21.15.146:0/3754195806 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fda24135f20 msgr2=0x7fda2411a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.626+0000 7fda28d65700 1 --2- 172.21.15.146:0/3754195806 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fda24135f20 0x7fda2411a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.626+0000 7fda28d65700 1 -- 172.21.15.146:0/3754195806 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda2409d860 msgr2=0x7fda24119630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.626+0000 7fda28d65700 1 --2- 172.21.15.146:0/3754195806 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda2409d860 0x7fda24119630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.626+0000 7fda28d65700 1 -- 172.21.15.146:0/3754195806 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1400b7f0 con 0x7fda2409e340 2023-10-03T10:18:22.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.626+0000 7fda29d67700 1 --2- 172.21.15.146:0/3754195806 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fda24135f20 0x7fda2411a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.626+0000 7fda28d65700 1 --2- 172.21.15.146:0/3754195806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2409e340 0x7fda24119b70 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fda14004000 tx=0x7fda14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.626+0000 7fda19ffb700 1 -- 172.21.15.146:0/3754195806 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda14020070 con 0x7fda2409e340 2023-10-03T10:18:22.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.626+0000 7fda2b7ca700 1 -- 172.21.15.146:0/3754195806 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda2409c8b0 con 0x7fda2409e340 2023-10-03T10:18:22.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.626+0000 7fda19ffb700 1 -- 172.21.15.146:0/3754195806 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1400da30 con 0x7fda2409e340 2023-10-03T10:18:22.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.626+0000 7fda19ffb700 1 -- 172.21.15.146:0/3754195806 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1400dba0 con 0x7fda2409e340 2023-10-03T10:18:22.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.626+0000 7fda2b7ca700 1 -- 172.21.15.146:0/3754195806 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda2411d6a0 con 0x7fda2409e340 2023-10-03T10:18:22.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.627+0000 7fda2b7ca700 1 -- 172.21.15.146:0/3754195806 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda2404f2a0 con 0x7fda2409e340 2023-10-03T10:18:22.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.627+0000 7fda19ffb700 1 -- 172.21.15.146:0/3754195806 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fda1402d3f0 con 0x7fda2409e340 2023-10-03T10:18:22.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.628+0000 7fda19ffb700 1 -- 172.21.15.146:0/3754195806 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fda14042bd0 con 0x7fda2409e340 2023-10-03T10:18:22.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.632+0000 7fda19ffb700 1 -- 172.21.15.146:0/3754195806 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda14006d80 con 0x7fda2409e340 2023-10-03T10:18:22.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.712+0000 7f243cbe1700 1 Processor -- start 2023-10-03T10:18:22.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.712+0000 7f243cbe1700 1 -- start start 2023-10-03T10:18:22.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.713+0000 7f243cbe1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f243809e340 0x7f24381359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.713+0000 7f243cbe1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2438135f20 0x7f2438138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.713+0000 7f243cbe1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f243809aaa0 con 0x7f243809d860 2023-10-03T10:18:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.713+0000 7f243cbe1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f243809e730 con 0x7f243809e340 2023-10-03T10:18:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.713+0000 7f243cbe1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f243809f870 con 0x7f2438135f20 2023-10-03T10:18:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.713+0000 7f2435d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f243809e340 0x7f24381359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.713+0000 7f243659c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f243809d860 0x7f243809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33798/0 (socket says 172.21.15.146:33798) 2023-10-03T10:18:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.713+0000 7f2435d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f243809e340 0x7f24381359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39944/0 (socket says 172.21.15.146:39944) 2023-10-03T10:18:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.713+0000 7f243659c700 1 -- 172.21.15.146:0/3165246514 learned_addr learned my addr 172.21.15.146:0/3165246514 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.713+0000 7f2436d9d700 1 --2- 172.21.15.146:0/3165246514 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2438135f20 0x7f2438138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.714+0000 7f2435d9b700 1 -- 172.21.15.146:0/3165246514 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2438135f20 msgr2=0x7f2438138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:22.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.714+0000 7f2435d9b700 1 --2- 172.21.15.146:0/3165246514 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2438135f20 0x7f2438138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.714+0000 7f2435d9b700 1 -- 172.21.15.146:0/3165246514 >> v1:172.21.15.146:6789/0 conn(0x7f243809d860 legacy=0x7f243809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.714+0000 7f2435d9b700 1 -- 172.21.15.146:0/3165246514 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243809b360 con 0x7f243809e340 2023-10-03T10:18:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.714+0000 7f243559a700 1 -- 172.21.15.146:0/3165246514 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071415914 0 0) 0x7f243809aaa0 con 0x7f243809d860 2023-10-03T10:18:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.714+0000 7f2435d9b700 1 --2- 172.21.15.146:0/3165246514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f243809e340 0x7f24381359e0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f242c009840 tx=0x7f242c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52639214448a1289 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.714+0000 7f243559a700 1 -- 172.21.15.146:0/3165246514 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c011830 con 0x7f243809e340 2023-10-03T10:18:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.714+0000 7f243559a700 1 -- 172.21.15.146:0/3165246514 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242c011990 con 0x7f243809e340 2023-10-03T10:18:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.714+0000 7f243559a700 1 -- 172.21.15.146:0/3165246514 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c011d20 con 0x7f243809e340 2023-10-03T10:18:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.715+0000 7f243cbe1700 1 -- 172.21.15.146:0/3165246514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f243809e340 msgr2=0x7f24381359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.715+0000 7f243cbe1700 1 --2- 172.21.15.146:0/3165246514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f243809e340 0x7f24381359e0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f242c009840 tx=0x7f242c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.715+0000 7f243cbe1700 1 -- 172.21.15.146:0/3165246514 shutdown_connections 2023-10-03T10:18:22.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.715+0000 7f243cbe1700 1 --2- 172.21.15.146:0/3165246514 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2438135f20 0x7f2438138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.715+0000 7f243cbe1700 1 --2- 172.21.15.146:0/3165246514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f243809e340 0x7f24381359e0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.715+0000 7f243cbe1700 1 -- 172.21.15.146:0/3165246514 >> 172.21.15.146:0/3165246514 conn(0x7f2438099c40 msgr2=0x7f24380a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.715+0000 7f243cbe1700 1 -- 172.21.15.146:0/3165246514 shutdown_connections 2023-10-03T10:18:22.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.715+0000 7f243cbe1700 1 -- 172.21.15.146:0/3165246514 wait complete. 2023-10-03T10:18:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.716+0000 7f243cbe1700 1 Processor -- start 2023-10-03T10:18:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.716+0000 7f243cbe1700 1 -- start start 2023-10-03T10:18:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.717+0000 7f243cbe1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f243809d860 0x7f243811d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.717+0000 7f243cbe1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f243809e340 0x7f243811ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.717+0000 7f243cbe1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2438135f20 0x7f243811e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.717+0000 7f243cbe1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243809a150 con 0x7f2438135f20 2023-10-03T10:18:22.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.717+0000 7f243cbe1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243806b360 con 0x7f243809d860 2023-10-03T10:18:22.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.717+0000 7f243cbe1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f243811ffd0 con 0x7f243809e340 2023-10-03T10:18:22.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.717+0000 7f243659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f243809d860 0x7f243811d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.717+0000 7f243659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f243809d860 0x7f243811d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:57510/0 (socket says 172.21.15.146:57510) 2023-10-03T10:18:22.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.717+0000 7f243659c700 1 -- 172.21.15.146:0/3181760166 learned_addr learned my addr 172.21.15.146:0/3181760166 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:22.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.717+0000 7f2435d9b700 1 --2- 172.21.15.146:0/3181760166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f243809e340 0x7f243811ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.717+0000 7f2436d9d700 1 --2- 172.21.15.146:0/3181760166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2438135f20 0x7f243811e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.717+0000 7f243659c700 1 -- 172.21.15.146:0/3181760166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f243809e340 msgr2=0x7f243811ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.717+0000 7f243659c700 1 --2- 172.21.15.146:0/3181760166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f243809e340 0x7f243811ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.717+0000 7f243659c700 1 -- 172.21.15.146:0/3181760166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2438135f20 msgr2=0x7f243811e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.717+0000 7f243659c700 1 --2- 172.21.15.146:0/3181760166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2438135f20 0x7f243811e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.717+0000 7f243659c700 1 -- 172.21.15.146:0/3181760166 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c0094a0 con 0x7f243809d860 2023-10-03T10:18:22.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.717+0000 7f2435d9b700 1 --2- 172.21.15.146:0/3181760166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f243809e340 0x7f243811ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.717+0000 7f2436d9d700 1 --2- 172.21.15.146:0/3181760166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2438135f20 0x7f243811e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.718+0000 7f243659c700 1 --2- 172.21.15.146:0/3181760166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f243809d860 0x7f243811d8b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f242800c520 tx=0x7f242800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.718+0000 7f2426ffd700 1 -- 172.21.15.146:0/3181760166 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2428004c80 con 0x7f243809d860 2023-10-03T10:18:22.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.718+0000 7f2426ffd700 1 -- 172.21.15.146:0/3181760166 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2428004de0 con 0x7f243809d860 2023-10-03T10:18:22.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.718+0000 7f2426ffd700 1 -- 172.21.15.146:0/3181760166 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2428007310 con 0x7f243809d860 2023-10-03T10:18:22.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.718+0000 7f243cbe1700 1 -- 172.21.15.146:0/3181760166 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243811f070 con 0x7f243809d860 2023-10-03T10:18:22.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.718+0000 7f243cbe1700 1 -- 172.21.15.146:0/3181760166 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f243806aa10 con 0x7f243809d860 2023-10-03T10:18:22.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.719+0000 7f2426ffd700 1 -- 172.21.15.146:0/3181760166 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2428007470 con 0x7f243809d860 2023-10-03T10:18:22.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.719+0000 7f243cbe1700 1 -- 172.21.15.146:0/3181760166 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f243804f2a0 con 0x7f243809d860 2023-10-03T10:18:22.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.719+0000 7f2426ffd700 1 -- 172.21.15.146:0/3181760166 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f242803f0b0 con 0x7f243809d860 2023-10-03T10:18:22.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.724+0000 7f2426ffd700 1 -- 172.21.15.146:0/3181760166 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f24280102c0 con 0x7f243809d860 2023-10-03T10:18:22.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.739+0000 7fa86206e700 1 Processor -- start 2023-10-03T10:18:22.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.739+0000 7fa86206e700 1 -- start start 2023-10-03T10:18:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.739+0000 7fa86206e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa85c09f350 0x7fa85c138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.739+0000 7fa86206e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c1393a0 0x7fa85c13b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.739+0000 7fa86206e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa85c09fa00 con 0x7fa85c09e870 2023-10-03T10:18:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.739+0000 7fa86206e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa85c0a0370 con 0x7fa85c09f350 2023-10-03T10:18:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.739+0000 7fa86206e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c06bec0 con 0x7fa85c1393a0 2023-10-03T10:18:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.739+0000 7fa85affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa85c09f350 0x7fa85c138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.739+0000 7fa85bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c1393a0 0x7fa85c13b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.739+0000 7fa85affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa85c09f350 0x7fa85c138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39954/0 (socket says 172.21.15.146:39954) 2023-10-03T10:18:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.739+0000 7fa85affd700 1 -- 172.21.15.146:0/3193942060 learned_addr learned my addr 172.21.15.146:0/3193942060 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.740+0000 7fa85bfff700 1 -- 172.21.15.146:0/3193942060 >> v2:172.21.15.146:3300/0 conn(0x7fa85c09f350 msgr2=0x7fa85c138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.740+0000 7fa85bfff700 1 --2- 172.21.15.146:0/3193942060 >> v2:172.21.15.146:3300/0 conn(0x7fa85c09f350 0x7fa85c138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.740+0000 7fa85bfff700 1 -- 172.21.15.146:0/3193942060 >> v1:172.21.15.146:6789/0 conn(0x7fa85c09e870 legacy=0x7fa85c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.740+0000 7fa85bfff700 1 -- 172.21.15.146:0/3193942060 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85c09ada0 con 0x7fa85c1393a0 2023-10-03T10:18:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.740+0000 7fa85affd700 1 --2- 172.21.15.146:0/3193942060 >> v2:172.21.15.146:3300/0 conn(0x7fa85c09f350 0x7fa85c138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.740+0000 7fa85bfff700 1 --2- 172.21.15.146:0/3193942060 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c1393a0 0x7fa85c13b780 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fa854009d90 tx=0x7fa85400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19e50d8db225f143 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.740+0000 7fa85a7fc700 1 -- 172.21.15.146:0/3193942060 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85400e070 con 0x7fa85c1393a0 2023-10-03T10:18:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.740+0000 7fa85a7fc700 1 -- 172.21.15.146:0/3193942060 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85400bb20 con 0x7fa85c1393a0 2023-10-03T10:18:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.740+0000 7fa85a7fc700 1 -- 172.21.15.146:0/3193942060 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa854012430 con 0x7fa85c1393a0 2023-10-03T10:18:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.741+0000 7fa86206e700 1 -- 172.21.15.146:0/3193942060 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c1393a0 msgr2=0x7fa85c13b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.741+0000 7fa86206e700 1 --2- 172.21.15.146:0/3193942060 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c1393a0 0x7fa85c13b780 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fa854009d90 tx=0x7fa85400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.741+0000 7fa86206e700 1 -- 172.21.15.146:0/3193942060 shutdown_connections 2023-10-03T10:18:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.741+0000 7fa86206e700 1 --2- 172.21.15.146:0/3193942060 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c1393a0 0x7fa85c13b780 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.741+0000 7fa86206e700 1 --2- 172.21.15.146:0/3193942060 >> v2:172.21.15.146:3300/0 conn(0x7fa85c09f350 0x7fa85c138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.741+0000 7fa86206e700 1 -- 172.21.15.146:0/3193942060 >> 172.21.15.146:0/3193942060 conn(0x7fa85c0a4430 msgr2=0x7fa85c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.741+0000 7fa86206e700 1 -- 172.21.15.146:0/3193942060 shutdown_connections 2023-10-03T10:18:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.741+0000 7fa86206e700 1 -- 172.21.15.146:0/3193942060 wait complete. 2023-10-03T10:18:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.742+0000 7fa86206e700 1 Processor -- start 2023-10-03T10:18:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.742+0000 7fa86206e700 1 -- start start 2023-10-03T10:18:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.742+0000 7fa86206e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa85c09e870 0x7fa85c11ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.742+0000 7fa86206e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa85c09f350 0x7fa85c11f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.742+0000 7fa86206e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c1393a0 0x7fa85c11f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.742+0000 7fa86206e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c1224a0 con 0x7fa85c09e870 2023-10-03T10:18:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.742+0000 7fa86206e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c06cfa0 con 0x7fa85c1393a0 2023-10-03T10:18:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.742+0000 7fa86206e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c121c50 con 0x7fa85c09f350 2023-10-03T10:18:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.743+0000 7fa85affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa85c09f350 0x7fa85c11f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.743+0000 7fa85b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa85c09e870 0x7fa85c11ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.743+0000 7fa85affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa85c09f350 0x7fa85c11f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54916/0 (socket says 172.21.15.146:54916) 2023-10-03T10:18:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.743+0000 7fa85b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa85c09e870 0x7fa85c11ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39960/0 (socket says 172.21.15.146:39960) 2023-10-03T10:18:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.743+0000 7fa85affd700 1 -- 172.21.15.146:0/3736822637 learned_addr learned my addr 172.21.15.146:0/3736822637 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.743+0000 7fa85bfff700 1 --2- 172.21.15.146:0/3736822637 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c1393a0 0x7fa85c11f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.743+0000 7fa85b7fe700 1 -- 172.21.15.146:0/3736822637 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa85c09f350 msgr2=0x7fa85c11f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.743+0000 7fa85b7fe700 1 --2- 172.21.15.146:0/3736822637 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa85c09f350 0x7fa85c11f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.743+0000 7fa85b7fe700 1 -- 172.21.15.146:0/3736822637 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c1393a0 msgr2=0x7fa85c11f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.743+0000 7fa85b7fe700 1 --2- 172.21.15.146:0/3736822637 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c1393a0 0x7fa85c11f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.743+0000 7fa85b7fe700 1 -- 172.21.15.146:0/3736822637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa850009550 con 0x7fa85c09e870 2023-10-03T10:18:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.743+0000 7fa85bfff700 1 --2- 172.21.15.146:0/3736822637 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c1393a0 0x7fa85c11f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.743+0000 7fa85b7fe700 1 --2- 172.21.15.146:0/3736822637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa85c09e870 0x7fa85c11ead0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fa84c000f60 tx=0x7fa84c00c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.743+0000 7fa843fff700 1 -- 172.21.15.146:0/3736822637 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c0052d0 con 0x7fa85c09e870 2023-10-03T10:18:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.743+0000 7fa843fff700 1 -- 172.21.15.146:0/3736822637 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84c005430 con 0x7fa85c09e870 2023-10-03T10:18:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.743+0000 7fa86206e700 1 -- 172.21.15.146:0/3736822637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa854009a70 con 0x7fa85c09e870 2023-10-03T10:18:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.743+0000 7fa843fff700 1 -- 172.21.15.146:0/3736822637 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c0038c0 con 0x7fa85c09e870 2023-10-03T10:18:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.743+0000 7fa86206e700 1 -- 172.21.15.146:0/3736822637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa85c06f960 con 0x7fa85c09e870 2023-10-03T10:18:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.744+0000 7fa843fff700 1 -- 172.21.15.146:0/3736822637 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa84c003c30 con 0x7fa85c09e870 2023-10-03T10:18:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.744+0000 7fa843fff700 1 -- 172.21.15.146:0/3736822637 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa84c03ec80 con 0x7fa85c09e870 2023-10-03T10:18:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.744+0000 7fa86206e700 1 -- 172.21.15.146:0/3736822637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa85c04f2a0 con 0x7fa85c09e870 2023-10-03T10:18:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.749+0000 7fa843fff700 1 -- 172.21.15.146:0/3736822637 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa84c017070 con 0x7fa85c09e870 2023-10-03T10:18:22.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.850+0000 7fda2b7ca700 1 -- 172.21.15.146:0/3754195806 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fda24130580 con 0x7fda2409e340 2023-10-03T10:18:22.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.850+0000 7fda19ffb700 1 -- 172.21.15.146:0/3754195806 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fda14029070 con 0x7fda2409e340 2023-10-03T10:18:22.851 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:22.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.853+0000 7fda2b7ca700 1 -- 172.21.15.146:0/3754195806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2409e340 msgr2=0x7fda24119b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.853+0000 7fda2b7ca700 1 --2- 172.21.15.146:0/3754195806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2409e340 0x7fda24119b70 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fda14004000 tx=0x7fda14004750 comp rx=0 tx=0).stop 2023-10-03T10:18:22.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.853+0000 7fda2b7ca700 1 -- 172.21.15.146:0/3754195806 shutdown_connections 2023-10-03T10:18:22.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.853+0000 7fda2b7ca700 1 --2- 172.21.15.146:0/3754195806 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fda24135f20 0x7fda2411a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.853+0000 7fda2b7ca700 1 --2- 172.21.15.146:0/3754195806 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fda2409d860 0x7fda24119630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.853+0000 7fda2b7ca700 1 --2- 172.21.15.146:0/3754195806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda2409e340 0x7fda24119b70 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.853+0000 7fda2b7ca700 1 -- 172.21.15.146:0/3754195806 >> 172.21.15.146:0/3754195806 conn(0x7fda24099c40 msgr2=0x7fda240a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.853+0000 7fda2b7ca700 1 -- 172.21.15.146:0/3754195806 shutdown_connections 2023-10-03T10:18:22.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.853+0000 7fda2b7ca700 1 -- 172.21.15.146:0/3754195806 wait complete. 2023-10-03T10:18:22.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:22.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.917+0000 7f243cbe1700 1 -- 172.21.15.146:0/3181760166 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f243811f010 con 0x7f243809d860 2023-10-03T10:18:22.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.917+0000 7f2426ffd700 1 -- 172.21.15.146:0/3181760166 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f242802c020 con 0x7f243809d860 2023-10-03T10:18:22.918 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:22.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.920+0000 7f243cbe1700 1 -- 172.21.15.146:0/3181760166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f243809d860 msgr2=0x7f243811d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.920+0000 7f243cbe1700 1 --2- 172.21.15.146:0/3181760166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f243809d860 0x7f243811d8b0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f242800c520 tx=0x7f242800c830 comp rx=0 tx=0).stop 2023-10-03T10:18:22.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.920+0000 7f243cbe1700 1 -- 172.21.15.146:0/3181760166 shutdown_connections 2023-10-03T10:18:22.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.920+0000 7f243cbe1700 1 --2- 172.21.15.146:0/3181760166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2438135f20 0x7f243811e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.920+0000 7f243cbe1700 1 --2- 172.21.15.146:0/3181760166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f243809d860 0x7f243811d8b0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.920+0000 7f243cbe1700 1 --2- 172.21.15.146:0/3181760166 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f243809e340 0x7f243811ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.920+0000 7f243cbe1700 1 -- 172.21.15.146:0/3181760166 >> 172.21.15.146:0/3181760166 conn(0x7f2438099c40 msgr2=0x7f2438134f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.920+0000 7f243cbe1700 1 -- 172.21.15.146:0/3181760166 shutdown_connections 2023-10-03T10:18:22.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.920+0000 7f243cbe1700 1 -- 172.21.15.146:0/3181760166 wait complete. 2023-10-03T10:18:22.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:22.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.942+0000 7fa86206e700 1 -- 172.21.15.146:0/3736822637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa85c072d60 con 0x7fa85c09e870 2023-10-03T10:18:22.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.943+0000 7fa843fff700 1 -- 172.21.15.146:0/3736822637 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa84c01bb10 con 0x7fa85c09e870 2023-10-03T10:18:22.943 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:22.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.945+0000 7fa86206e700 1 -- 172.21.15.146:0/3736822637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa85c09e870 msgr2=0x7fa85c11ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.945+0000 7fa86206e700 1 --2- 172.21.15.146:0/3736822637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa85c09e870 0x7fa85c11ead0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fa84c000f60 tx=0x7fa84c00c6e0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.945+0000 7fa86206e700 1 -- 172.21.15.146:0/3736822637 shutdown_connections 2023-10-03T10:18:22.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.945+0000 7fa86206e700 1 --2- 172.21.15.146:0/3736822637 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c1393a0 0x7fa85c11f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.945+0000 7fa86206e700 1 --2- 172.21.15.146:0/3736822637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa85c09e870 0x7fa85c11ead0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.945+0000 7fa86206e700 1 --2- 172.21.15.146:0/3736822637 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa85c09f350 0x7fa85c11f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.945+0000 7fa86206e700 1 -- 172.21.15.146:0/3736822637 >> 172.21.15.146:0/3736822637 conn(0x7fa85c0a4430 msgr2=0x7fa85c1382c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.945+0000 7fa86206e700 1 -- 172.21.15.146:0/3736822637 shutdown_connections 2023-10-03T10:18:22.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:22.945+0000 7fa86206e700 1 -- 172.21.15.146:0/3736822637 wait complete. 2023-10-03T10:18:22.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:23.313 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:23.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.436+0000 7f85be480700 1 Processor -- start 2023-10-03T10:18:23.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.436+0000 7f85be480700 1 -- start start 2023-10-03T10:18:23.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.436+0000 7f85be480700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f85b8136960 0x7f85b8138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.436+0000 7f85be480700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85b8139280 0x7f85b813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.436+0000 7f85be480700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b806b2d0 con 0x7f85b8133ad0 2023-10-03T10:18:23.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.436+0000 7f85be480700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b81345b0 con 0x7f85b8136960 2023-10-03T10:18:23.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.436+0000 7f85be480700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85b8133610 con 0x7f85b8139280 2023-10-03T10:18:23.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.436+0000 7f85b77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f85b8136960 0x7f85b8138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.436+0000 7f85bca1d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85b8139280 0x7f85b813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.436+0000 7f85b7fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f85b8133ad0 0x7f85b8133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33810/0 (socket says 172.21.15.146:33810) 2023-10-03T10:18:23.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.436+0000 7f85b7fff700 1 -- 172.21.15.146:0/2538900480 learned_addr learned my addr 172.21.15.146:0/2538900480 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:23.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.437+0000 7f85bca1d700 1 -- 172.21.15.146:0/2538900480 >> v2:172.21.15.146:3300/0 conn(0x7f85b8136960 msgr2=0x7f85b8138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:23.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.437+0000 7f85bca1d700 1 --2- 172.21.15.146:0/2538900480 >> v2:172.21.15.146:3300/0 conn(0x7f85b8136960 0x7f85b8138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.437+0000 7f85bca1d700 1 -- 172.21.15.146:0/2538900480 >> v1:172.21.15.146:6789/0 conn(0x7f85b8133ad0 legacy=0x7f85b8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.437+0000 7f85bca1d700 1 -- 172.21.15.146:0/2538900480 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b809a500 con 0x7f85b8139280 2023-10-03T10:18:23.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.437+0000 7f85b6ffd700 1 -- 172.21.15.146:0/2538900480 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902219218 0 0) 0x7f85b806b2d0 con 0x7f85b8133ad0 2023-10-03T10:18:23.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.437+0000 7f85b77fe700 1 --2- 172.21.15.146:0/2538900480 >> v2:172.21.15.146:3300/0 conn(0x7f85b8136960 0x7f85b8138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:23.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.437+0000 7f85bca1d700 1 --2- 172.21.15.146:0/2538900480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85b8139280 0x7f85b813b660 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f85b0009d90 tx=0x7f85b000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21a9a10e08735de0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.437+0000 7f85b6ffd700 1 -- 172.21.15.146:0/2538900480 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b000e070 con 0x7f85b8139280 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.437+0000 7f85b6ffd700 1 -- 172.21.15.146:0/2538900480 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b000bb20 con 0x7f85b8139280 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.437+0000 7f85b6ffd700 1 -- 172.21.15.146:0/2538900480 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0012430 con 0x7f85b8139280 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.437+0000 7f85be480700 1 -- 172.21.15.146:0/2538900480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85b8139280 msgr2=0x7f85b813b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.437+0000 7f85be480700 1 --2- 172.21.15.146:0/2538900480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85b8139280 0x7f85b813b660 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f85b0009d90 tx=0x7f85b000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.437+0000 7f85be480700 1 -- 172.21.15.146:0/2538900480 shutdown_connections 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.437+0000 7f85be480700 1 --2- 172.21.15.146:0/2538900480 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85b8139280 0x7f85b813b660 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.437+0000 7f85be480700 1 --2- 172.21.15.146:0/2538900480 >> v2:172.21.15.146:3300/0 conn(0x7f85b8136960 0x7f85b8138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.437+0000 7f85be480700 1 -- 172.21.15.146:0/2538900480 >> 172.21.15.146:0/2538900480 conn(0x7f85b8099c40 msgr2=0x7f85b80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.438+0000 7f85be480700 1 -- 172.21.15.146:0/2538900480 shutdown_connections 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.438+0000 7f85be480700 1 -- 172.21.15.146:0/2538900480 wait complete. 2023-10-03T10:18:23.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.438+0000 7f85be480700 1 Processor -- start 2023-10-03T10:18:23.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.439+0000 7f85be480700 1 -- start start 2023-10-03T10:18:23.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.439+0000 7f85be480700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85b8133ad0 0x7f85b812cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.439+0000 7f85be480700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85b8136960 0x7f85b812d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.439+0000 7f85be480700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85b8139280 0x7f85b812d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.439+0000 7f85be480700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b806fe90 con 0x7f85b8136960 2023-10-03T10:18:23.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.439+0000 7f85be480700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b8072720 con 0x7f85b8139280 2023-10-03T10:18:23.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.439+0000 7f85be480700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85b809f390 con 0x7f85b8133ad0 2023-10-03T10:18:23.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.439+0000 7f85b7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85b8133ad0 0x7f85b812cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.439+0000 7f85b7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85b8133ad0 0x7f85b812cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54934/0 (socket says 172.21.15.146:54934) 2023-10-03T10:18:23.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.439+0000 7f85b7fff700 1 -- 172.21.15.146:0/3555097543 learned_addr learned my addr 172.21.15.146:0/3555097543 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:23.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.439+0000 7f85bca1d700 1 --2- 172.21.15.146:0/3555097543 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85b8139280 0x7f85b812d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.439+0000 7f85b77fe700 1 --2- 172.21.15.146:0/3555097543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85b8136960 0x7f85b812d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.439+0000 7f85b7fff700 1 -- 172.21.15.146:0/3555097543 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85b8139280 msgr2=0x7f85b812d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.439+0000 7f85b7fff700 1 --2- 172.21.15.146:0/3555097543 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85b8139280 0x7f85b812d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.439+0000 7f85b7fff700 1 -- 172.21.15.146:0/3555097543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85b8136960 msgr2=0x7f85b812d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.439+0000 7f85b7fff700 1 --2- 172.21.15.146:0/3555097543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85b8136960 0x7f85b812d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.439+0000 7f85b7fff700 1 -- 172.21.15.146:0/3555097543 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac0094a0 con 0x7f85b8133ad0 2023-10-03T10:18:23.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.440+0000 7f85b7fff700 1 --2- 172.21.15.146:0/3555097543 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85b8133ad0 0x7f85b812cb30 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f85a800c520 tx=0x7f85a800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.440+0000 7f85b4ff9700 1 -- 172.21.15.146:0/3555097543 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a8004c80 con 0x7f85b8133ad0 2023-10-03T10:18:23.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.440+0000 7f85b4ff9700 1 -- 172.21.15.146:0/3555097543 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a8004de0 con 0x7f85b8133ad0 2023-10-03T10:18:23.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.440+0000 7f85be480700 1 -- 172.21.15.146:0/3555097543 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b0009a70 con 0x7f85b8133ad0 2023-10-03T10:18:23.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.440+0000 7f85b4ff9700 1 -- 172.21.15.146:0/3555097543 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a8007310 con 0x7f85b8133ad0 2023-10-03T10:18:23.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.440+0000 7f85be480700 1 -- 172.21.15.146:0/3555097543 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b8070bc0 con 0x7f85b8133ad0 2023-10-03T10:18:23.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.440+0000 7f85b4ff9700 1 -- 172.21.15.146:0/3555097543 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f85a8007470 con 0x7f85b8133ad0 2023-10-03T10:18:23.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.441+0000 7f85b4ff9700 1 -- 172.21.15.146:0/3555097543 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f85a803f290 con 0x7f85b8133ad0 2023-10-03T10:18:23.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.441+0000 7f85be480700 1 -- 172.21.15.146:0/3555097543 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b806be10 con 0x7f85b8133ad0 2023-10-03T10:18:23.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.445+0000 7f85b4ff9700 1 -- 172.21.15.146:0/3555097543 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f85a80123b0 con 0x7f85b8133ad0 2023-10-03T10:18:23.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.627+0000 7f85be480700 1 -- 172.21.15.146:0/3555097543 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f85b8070040 con 0x7f85b8133ad0 2023-10-03T10:18:23.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.628+0000 7f85b4ff9700 1 -- 172.21.15.146:0/3555097543 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f85a8011360 con 0x7f85b8133ad0 2023-10-03T10:18:23.628 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:23.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.630+0000 7f85be480700 1 -- 172.21.15.146:0/3555097543 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85b8133ad0 msgr2=0x7f85b812cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.630+0000 7f85be480700 1 --2- 172.21.15.146:0/3555097543 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85b8133ad0 0x7f85b812cb30 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f85a800c520 tx=0x7f85a800c830 comp rx=0 tx=0).stop 2023-10-03T10:18:23.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.630+0000 7f85be480700 1 -- 172.21.15.146:0/3555097543 shutdown_connections 2023-10-03T10:18:23.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.630+0000 7f85be480700 1 --2- 172.21.15.146:0/3555097543 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85b8139280 0x7f85b812d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.630+0000 7f85be480700 1 --2- 172.21.15.146:0/3555097543 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f85b8133ad0 0x7f85b812cb30 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.630+0000 7f85be480700 1 --2- 172.21.15.146:0/3555097543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85b8136960 0x7f85b812d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.630+0000 7f85be480700 1 -- 172.21.15.146:0/3555097543 >> 172.21.15.146:0/3555097543 conn(0x7f85b8099c40 msgr2=0x7f85b8132980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.630+0000 7f85be480700 1 -- 172.21.15.146:0/3555097543 shutdown_connections 2023-10-03T10:18:23.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.630+0000 7f85be480700 1 -- 172.21.15.146:0/3555097543 wait complete. 2023-10-03T10:18:23.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:23.866 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:23.934 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:23.958 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:23.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.997+0000 7fcb2604c700 1 Processor -- start 2023-10-03T10:18:23.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.997+0000 7fcb2604c700 1 -- start start 2023-10-03T10:18:23.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.998+0000 7fcb2604c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb20136960 0x7fcb20138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.998+0000 7fcb2604c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcb20139280 0x7fcb2013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.998+0000 7fcb2604c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb2006b2d0 con 0x7fcb20133ad0 2023-10-03T10:18:23.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.998+0000 7fcb2604c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb201345b0 con 0x7fcb20139280 2023-10-03T10:18:23.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.998+0000 7fcb2604c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb20133610 con 0x7fcb20136960 2023-10-03T10:18:23.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.998+0000 7fcb1effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb20136960 0x7fcb20138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.998+0000 7fcb1effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb20136960 0x7fcb20138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54946/0 (socket says 172.21.15.146:54946) 2023-10-03T10:18:24.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.998+0000 7fcb1effd700 1 -- 172.21.15.146:0/1285839115 learned_addr learned my addr 172.21.15.146:0/1285839115 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:24.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.998+0000 7fcb1ffff700 1 --2- 172.21.15.146:0/1285839115 >> v2:172.21.15.146:3300/0 conn(0x7fcb20139280 0x7fcb2013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.998+0000 7fcb1ffff700 1 -- 172.21.15.146:0/1285839115 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb20136960 msgr2=0x7fcb20138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:24.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.998+0000 7fcb1ffff700 1 --2- 172.21.15.146:0/1285839115 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb20136960 0x7fcb20138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.998+0000 7fcb1ffff700 1 -- 172.21.15.146:0/1285839115 >> v1:172.21.15.146:6789/0 conn(0x7fcb20133ad0 legacy=0x7fcb20133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.998+0000 7fcb1ffff700 1 -- 172.21.15.146:0/1285839115 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2009a500 con 0x7fcb20139280 2023-10-03T10:18:24.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.998+0000 7fcb1e7fc700 1 -- 172.21.15.146:0/1285839115 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2645391461 0 0) 0x7fcb2006b2d0 con 0x7fcb20133ad0 2023-10-03T10:18:24.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.998+0000 7fcb1effd700 1 --2- 172.21.15.146:0/1285839115 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb20136960 0x7fcb20138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.998+0000 7fcb1ffff700 1 --2- 172.21.15.146:0/1285839115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb20139280 0x7fcb2013b660 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fcb18009dc0 tx=0x7fcb1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e945a52a145774 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.998+0000 7fcb1e7fc700 1 -- 172.21.15.146:0/1285839115 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1800e070 con 0x7fcb20139280 2023-10-03T10:18:24.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.999+0000 7fcb1e7fc700 1 -- 172.21.15.146:0/1285839115 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1800bae0 con 0x7fcb20139280 2023-10-03T10:18:24.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.999+0000 7fcb1e7fc700 1 -- 172.21.15.146:0/1285839115 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1800be90 con 0x7fcb20139280 2023-10-03T10:18:24.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.999+0000 7fcb2604c700 1 -- 172.21.15.146:0/1285839115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb20139280 msgr2=0x7fcb2013b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.999+0000 7fcb2604c700 1 --2- 172.21.15.146:0/1285839115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb20139280 0x7fcb2013b660 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fcb18009dc0 tx=0x7fcb1800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:24.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.999+0000 7fcb2604c700 1 -- 172.21.15.146:0/1285839115 shutdown_connections 2023-10-03T10:18:24.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.999+0000 7fcb2604c700 1 --2- 172.21.15.146:0/1285839115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb20139280 0x7fcb2013b660 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.999+0000 7fcb2604c700 1 --2- 172.21.15.146:0/1285839115 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb20136960 0x7fcb20138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.999+0000 7fcb2604c700 1 -- 172.21.15.146:0/1285839115 >> 172.21.15.146:0/1285839115 conn(0x7fcb20099c40 msgr2=0x7fcb200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:24.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.999+0000 7fcb2604c700 1 -- 172.21.15.146:0/1285839115 shutdown_connections 2023-10-03T10:18:24.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:23.999+0000 7fcb2604c700 1 -- 172.21.15.146:0/1285839115 wait complete. 2023-10-03T10:18:24.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.000+0000 7fcb2604c700 1 Processor -- start 2023-10-03T10:18:24.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.001+0000 7fcb2604c700 1 -- start start 2023-10-03T10:18:24.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.001+0000 7fcb2604c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb20133ad0 0x7fcb200717e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.001+0000 7fcb2604c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb20136960 0x7fcb20071d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.001+0000 7fcb2604c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb20139280 0x7fcb201c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.001+0000 7fcb2604c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb201317a0 con 0x7fcb20136960 2023-10-03T10:18:24.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.001+0000 7fcb2604c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2009f390 con 0x7fcb20139280 2023-10-03T10:18:24.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.001+0000 7fcb2604c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2006f2d0 con 0x7fcb20133ad0 2023-10-03T10:18:24.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.001+0000 7fcb1f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb20133ad0 0x7fcb200717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.001+0000 7fcb1ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb20139280 0x7fcb201c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.001+0000 7fcb1f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb20133ad0 0x7fcb200717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54958/0 (socket says 172.21.15.146:54958) 2023-10-03T10:18:24.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.001+0000 7fcb1f7fe700 1 -- 172.21.15.146:0/1055089055 learned_addr learned my addr 172.21.15.146:0/1055089055 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:24.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.001+0000 7fcb1effd700 1 --2- 172.21.15.146:0/1055089055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb20136960 0x7fcb20071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.001+0000 7fcb1ffff700 1 -- 172.21.15.146:0/1055089055 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb20133ad0 msgr2=0x7fcb200717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.001+0000 7fcb1ffff700 1 --2- 172.21.15.146:0/1055089055 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb20133ad0 0x7fcb200717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.001+0000 7fcb1ffff700 1 -- 172.21.15.146:0/1055089055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb20136960 msgr2=0x7fcb20071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.001+0000 7fcb1ffff700 1 --2- 172.21.15.146:0/1055089055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb20136960 0x7fcb20071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.001+0000 7fcb1ffff700 1 -- 172.21.15.146:0/1055089055 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb14009550 con 0x7fcb20139280 2023-10-03T10:18:24.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.002+0000 7fcb1ffff700 1 --2- 172.21.15.146:0/1055089055 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb20139280 0x7fcb201c8470 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fcb18016000 tx=0x7fcb18004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.002+0000 7fcb07fff700 1 -- 172.21.15.146:0/1055089055 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18004680 con 0x7fcb20139280 2023-10-03T10:18:24.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.002+0000 7fcb07fff700 1 -- 172.21.15.146:0/1055089055 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb18020070 con 0x7fcb20139280 2023-10-03T10:18:24.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.002+0000 7fcb2604c700 1 -- 172.21.15.146:0/1055089055 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb18009a70 con 0x7fcb20139280 2023-10-03T10:18:24.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.002+0000 7fcb07fff700 1 -- 172.21.15.146:0/1055089055 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18027480 con 0x7fcb20139280 2023-10-03T10:18:24.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.002+0000 7fcb2604c700 1 -- 172.21.15.146:0/1055089055 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb20130a60 con 0x7fcb20139280 2023-10-03T10:18:24.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.003+0000 7fcb2604c700 1 -- 172.21.15.146:0/1055089055 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2004f2a0 con 0x7fcb20139280 2023-10-03T10:18:24.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.003+0000 7fcb07fff700 1 -- 172.21.15.146:0/1055089055 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb18012430 con 0x7fcb20139280 2023-10-03T10:18:24.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.004+0000 7fcb07fff700 1 -- 172.21.15.146:0/1055089055 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcb18022070 con 0x7fcb20139280 2023-10-03T10:18:24.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.008+0000 7fcb07fff700 1 -- 172.21.15.146:0/1055089055 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb1801a740 con 0x7fcb20139280 2023-10-03T10:18:24.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.063+0000 7ff160517700 1 Processor -- start 2023-10-03T10:18:24.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.063+0000 7ff160517700 1 -- start start 2023-10-03T10:18:24.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.064+0000 7ff160517700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff1581368e0 0x7ff158138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.064+0000 7ff160517700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff158139200 0x7ff15813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.064+0000 7ff160517700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1581336e0 con 0x7ff158133b10 2023-10-03T10:18:24.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.064+0000 7ff160517700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15809a080 con 0x7ff1581368e0 2023-10-03T10:18:24.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.064+0000 7ff160517700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff15809a760 con 0x7ff158139200 2023-10-03T10:18:24.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.064+0000 7ff15dab2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff1581368e0 0x7ff158138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.064+0000 7ff15eab4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff158139200 0x7ff15813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.064+0000 7ff15dab2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff1581368e0 0x7ff158138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40000/0 (socket says 172.21.15.146:40000) 2023-10-03T10:18:24.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.064+0000 7ff15dab2700 1 -- 172.21.15.146:0/344619635 learned_addr learned my addr 172.21.15.146:0/344619635 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:24.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.065+0000 7ff15eab4700 1 -- 172.21.15.146:0/344619635 >> v2:172.21.15.146:3300/0 conn(0x7ff1581368e0 msgr2=0x7ff158138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:24.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.065+0000 7ff15eab4700 1 --2- 172.21.15.146:0/344619635 >> v2:172.21.15.146:3300/0 conn(0x7ff1581368e0 0x7ff158138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.065+0000 7ff15eab4700 1 -- 172.21.15.146:0/344619635 >> v1:172.21.15.146:6789/0 conn(0x7ff158133b10 legacy=0x7ff158133ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.065+0000 7ff15eab4700 1 -- 172.21.15.146:0/344619635 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15809b5c0 con 0x7ff158139200 2023-10-03T10:18:24.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.065+0000 7ff15d2b1700 1 -- 172.21.15.146:0/344619635 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1169132077 0 0) 0x7ff1581336e0 con 0x7ff158133b10 2023-10-03T10:18:24.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.065+0000 7ff15dab2700 1 --2- 172.21.15.146:0/344619635 >> v2:172.21.15.146:3300/0 conn(0x7ff1581368e0 0x7ff158138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.065+0000 7ff15eab4700 1 --2- 172.21.15.146:0/344619635 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff158139200 0x7ff15813b5e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff150009dc0 tx=0x7ff15000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72eb93c4c4b84412 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.065+0000 7ff15d2b1700 1 -- 172.21.15.146:0/344619635 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15000e070 con 0x7ff158139200 2023-10-03T10:18:24.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.065+0000 7ff15d2b1700 1 -- 172.21.15.146:0/344619635 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15000bae0 con 0x7ff158139200 2023-10-03T10:18:24.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.065+0000 7ff15d2b1700 1 -- 172.21.15.146:0/344619635 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15000be90 con 0x7ff158139200 2023-10-03T10:18:24.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.066+0000 7ff160517700 1 -- 172.21.15.146:0/344619635 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff158139200 msgr2=0x7ff15813b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.066+0000 7ff160517700 1 --2- 172.21.15.146:0/344619635 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff158139200 0x7ff15813b5e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff150009dc0 tx=0x7ff15000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:24.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.066+0000 7ff160517700 1 -- 172.21.15.146:0/344619635 shutdown_connections 2023-10-03T10:18:24.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.066+0000 7ff160517700 1 --2- 172.21.15.146:0/344619635 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff158139200 0x7ff15813b5e0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.066+0000 7ff160517700 1 --2- 172.21.15.146:0/344619635 >> v2:172.21.15.146:3300/0 conn(0x7ff1581368e0 0x7ff158138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.066+0000 7ff160517700 1 -- 172.21.15.146:0/344619635 >> 172.21.15.146:0/344619635 conn(0x7ff1580a2980 msgr2=0x7ff1580a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:24.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.066+0000 7ff160517700 1 -- 172.21.15.146:0/344619635 shutdown_connections 2023-10-03T10:18:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.066+0000 7ff160517700 1 -- 172.21.15.146:0/344619635 wait complete. 2023-10-03T10:18:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.067+0000 7ff160517700 1 Processor -- start 2023-10-03T10:18:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.067+0000 7ff160517700 1 -- start start 2023-10-03T10:18:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.068+0000 7ff160517700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff158133b10 0x7ff158119c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.068+0000 7ff160517700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1581368e0 0x7ff15811a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.068+0000 7ff160517700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff158139200 0x7ff15811a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.068+0000 7ff160517700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15811d800 con 0x7ff158133b10 2023-10-03T10:18:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.068+0000 7ff160517700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff158138e80 con 0x7ff158139200 2023-10-03T10:18:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.068+0000 7ff160517700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff15809a2c0 con 0x7ff1581368e0 2023-10-03T10:18:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.068+0000 7ff15dab2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1581368e0 0x7ff15811a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.068+0000 7ff15dab2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1581368e0 0x7ff15811a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54968/0 (socket says 172.21.15.146:54968) 2023-10-03T10:18:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.068+0000 7ff15dab2700 1 -- 172.21.15.146:0/3255672320 learned_addr learned my addr 172.21.15.146:0/3255672320 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.068+0000 7ff15eab4700 1 --2- 172.21.15.146:0/3255672320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff158139200 0x7ff15811a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.068+0000 7ff15e2b3700 1 --2- 172.21.15.146:0/3255672320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff158133b10 0x7ff158119c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.069+0000 7ff15eab4700 1 -- 172.21.15.146:0/3255672320 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1581368e0 msgr2=0x7ff15811a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.069+0000 7ff15eab4700 1 --2- 172.21.15.146:0/3255672320 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1581368e0 0x7ff15811a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.069+0000 7ff15eab4700 1 -- 172.21.15.146:0/3255672320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff158133b10 msgr2=0x7ff158119c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.069+0000 7ff15eab4700 1 --2- 172.21.15.146:0/3255672320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff158133b10 0x7ff158119c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.069+0000 7ff15eab4700 1 -- 172.21.15.146:0/3255672320 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff148009550 con 0x7ff158139200 2023-10-03T10:18:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.069+0000 7ff15dab2700 1 --2- 172.21.15.146:0/3255672320 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1581368e0 0x7ff15811a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.069+0000 7ff15eab4700 1 --2- 172.21.15.146:0/3255672320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff158139200 0x7ff15811a6c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff1580a2370 tx=0x7ff150004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.069+0000 7ff14effd700 1 -- 172.21.15.146:0/3255672320 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150027480 con 0x7ff158139200 2023-10-03T10:18:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.069+0000 7ff14effd700 1 -- 172.21.15.146:0/3255672320 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff150020070 con 0x7ff158139200 2023-10-03T10:18:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.069+0000 7ff160517700 1 -- 172.21.15.146:0/3255672320 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff150009a70 con 0x7ff158139200 2023-10-03T10:18:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.069+0000 7ff14effd700 1 -- 172.21.15.146:0/3255672320 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150027820 con 0x7ff158139200 2023-10-03T10:18:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.069+0000 7ff160517700 1 -- 172.21.15.146:0/3255672320 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15811d480 con 0x7ff158139200 2023-10-03T10:18:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.070+0000 7ff160517700 1 -- 172.21.15.146:0/3255672320 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff15811d2c0 con 0x7ff158139200 2023-10-03T10:18:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.070+0000 7ff14effd700 1 -- 172.21.15.146:0/3255672320 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff15001c400 con 0x7ff158139200 2023-10-03T10:18:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.070+0000 7ff14effd700 1 -- 172.21.15.146:0/3255672320 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff150022070 con 0x7ff158139200 2023-10-03T10:18:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.075+0000 7ff14effd700 1 -- 172.21.15.146:0/3255672320 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff15001b400 con 0x7ff158139200 2023-10-03T10:18:24.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.106+0000 7fe9eedfe700 1 Processor -- start 2023-10-03T10:18:24.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.106+0000 7fe9eedfe700 1 -- start start 2023-10-03T10:18:24.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.107+0000 7fe9eedfe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9e80a0a70 0x7fe9e80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.107+0000 7fe9eedfe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe9e80a1380 0x7fe9e8133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.107+0000 7fe9eedfe700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e809dc00 con 0x7fe9e8133f50 2023-10-03T10:18:24.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.107+0000 7fe9eedfe700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e809ea60 con 0x7fe9e80a1380 2023-10-03T10:18:24.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.107+0000 7fe9eedfe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e809dec0 con 0x7fe9e80a0a70 2023-10-03T10:18:24.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.107+0000 7fe9e7fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe9e80a1380 0x7fe9e8133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.107+0000 7fe9ecb9a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9e80a0a70 0x7fe9e80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.107+0000 7fe9e7fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe9e80a1380 0x7fe9e8133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40026/0 (socket says 172.21.15.146:40026) 2023-10-03T10:18:24.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.107+0000 7fe9e7fff700 1 -- 172.21.15.146:0/1515880395 learned_addr learned my addr 172.21.15.146:0/1515880395 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:24.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.107+0000 7fe9ecb9a700 1 -- 172.21.15.146:0/1515880395 >> v2:172.21.15.146:3300/0 conn(0x7fe9e80a1380 msgr2=0x7fe9e8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:24.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.107+0000 7fe9ecb9a700 1 --2- 172.21.15.146:0/1515880395 >> v2:172.21.15.146:3300/0 conn(0x7fe9e80a1380 0x7fe9e8133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.107+0000 7fe9ecb9a700 1 -- 172.21.15.146:0/1515880395 >> v1:172.21.15.146:6789/0 conn(0x7fe9e8133f50 legacy=0x7fe9e813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.107+0000 7fe9ecb9a700 1 -- 172.21.15.146:0/1515880395 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e809e6a0 con 0x7fe9e80a0a70 2023-10-03T10:18:24.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.107+0000 7fe9e7fff700 1 --2- 172.21.15.146:0/1515880395 >> v2:172.21.15.146:3300/0 conn(0x7fe9e80a1380 0x7fe9e8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.108+0000 7fe9ecb9a700 1 --2- 172.21.15.146:0/1515880395 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9e80a0a70 0x7fe9e80a0e40 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009840 tx=0x7fe9dc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a82a4f5042d396cf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.108+0000 7fe9e77fe700 1 -- 172.21.15.146:0/1515880395 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc011830 con 0x7fe9e80a0a70 2023-10-03T10:18:24.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.108+0000 7fe9e77fe700 1 -- 172.21.15.146:0/1515880395 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc011990 con 0x7fe9e80a0a70 2023-10-03T10:18:24.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.108+0000 7fe9e77fe700 1 -- 172.21.15.146:0/1515880395 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc011d20 con 0x7fe9e80a0a70 2023-10-03T10:18:24.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.108+0000 7fe9eedfe700 1 -- 172.21.15.146:0/1515880395 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9e80a0a70 msgr2=0x7fe9e80a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.108+0000 7fe9eedfe700 1 --2- 172.21.15.146:0/1515880395 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9e80a0a70 0x7fe9e80a0e40 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009840 tx=0x7fe9dc009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:24.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.108+0000 7fe9eedfe700 1 -- 172.21.15.146:0/1515880395 shutdown_connections 2023-10-03T10:18:24.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.108+0000 7fe9eedfe700 1 --2- 172.21.15.146:0/1515880395 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9e80a0a70 0x7fe9e80a0e40 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.108+0000 7fe9eedfe700 1 --2- 172.21.15.146:0/1515880395 >> v2:172.21.15.146:3300/0 conn(0x7fe9e80a1380 0x7fe9e8133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.108+0000 7fe9eedfe700 1 -- 172.21.15.146:0/1515880395 >> 172.21.15.146:0/1515880395 conn(0x7fe9e80a6610 msgr2=0x7fe9e80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:24.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.108+0000 7fe9eedfe700 1 -- 172.21.15.146:0/1515880395 shutdown_connections 2023-10-03T10:18:24.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.108+0000 7fe9eedfe700 1 -- 172.21.15.146:0/1515880395 wait complete. 2023-10-03T10:18:24.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.109+0000 7fe9eedfe700 1 Processor -- start 2023-10-03T10:18:24.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.109+0000 7fe9eedfe700 1 -- start start 2023-10-03T10:18:24.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.110+0000 7fe9eedfe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9e80a0a70 0x7fe9e81c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.110+0000 7fe9eedfe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9e80a1380 0x7fe9e81c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.110+0000 7fe9eedfe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9e8133f50 0x7fe9e81c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.110+0000 7fe9eedfe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e81247f0 con 0x7fe9e80a1380 2023-10-03T10:18:24.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.110+0000 7fe9eedfe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e8124600 con 0x7fe9e8133f50 2023-10-03T10:18:24.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.110+0000 7fe9eedfe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e81252e0 con 0x7fe9e80a0a70 2023-10-03T10:18:24.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.110+0000 7fe9e7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9e80a1380 0x7fe9e81c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.110+0000 7fe9ecb9a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9e80a0a70 0x7fe9e81c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.110+0000 7fe9e7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9e80a1380 0x7fe9e81c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40042/0 (socket says 172.21.15.146:40042) 2023-10-03T10:18:24.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.110+0000 7fe9ecb9a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9e80a0a70 0x7fe9e81c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54992/0 (socket says 172.21.15.146:54992) 2023-10-03T10:18:24.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.110+0000 7fe9e7fff700 1 -- 172.21.15.146:0/3073002387 learned_addr learned my addr 172.21.15.146:0/3073002387 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:24.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.110+0000 7fe9ed39b700 1 --2- 172.21.15.146:0/3073002387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9e8133f50 0x7fe9e81c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.110+0000 7fe9ecb9a700 1 -- 172.21.15.146:0/3073002387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9e8133f50 msgr2=0x7fe9e81c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.110+0000 7fe9ecb9a700 1 --2- 172.21.15.146:0/3073002387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9e8133f50 0x7fe9e81c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.110+0000 7fe9ecb9a700 1 -- 172.21.15.146:0/3073002387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9e80a1380 msgr2=0x7fe9e81c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.110+0000 7fe9ecb9a700 1 --2- 172.21.15.146:0/3073002387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9e80a1380 0x7fe9e81c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.110+0000 7fe9ecb9a700 1 -- 172.21.15.146:0/3073002387 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d4009550 con 0x7fe9e80a0a70 2023-10-03T10:18:24.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.111+0000 7fe9ecb9a700 1 --2- 172.21.15.146:0/3073002387 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9e80a0a70 0x7fe9e81c8200 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc016000 tx=0x7fe9dc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.111+0000 7fe9e57fa700 1 -- 172.21.15.146:0/3073002387 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0036a0 con 0x7fe9e80a0a70 2023-10-03T10:18:24.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.111+0000 7fe9e57fa700 1 -- 172.21.15.146:0/3073002387 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc01f070 con 0x7fe9e80a0a70 2023-10-03T10:18:24.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.111+0000 7fe9e57fa700 1 -- 172.21.15.146:0/3073002387 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc003a60 con 0x7fe9e80a0a70 2023-10-03T10:18:24.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.111+0000 7fe9eedfe700 1 -- 172.21.15.146:0/3073002387 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9dc0094a0 con 0x7fe9e80a0a70 2023-10-03T10:18:24.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.111+0000 7fe9eedfe700 1 -- 172.21.15.146:0/3073002387 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e8133a10 con 0x7fe9e80a0a70 2023-10-03T10:18:24.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.112+0000 7fe9e57fa700 1 -- 172.21.15.146:0/3073002387 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe9dc003bc0 con 0x7fe9e80a0a70 2023-10-03T10:18:24.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.112+0000 7fe9e57fa700 1 -- 172.21.15.146:0/3073002387 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe9dc021070 con 0x7fe9e80a0a70 2023-10-03T10:18:24.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.112+0000 7fe9d2ffd700 1 -- 172.21.15.146:0/3073002387 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e804f2a0 con 0x7fe9e80a0a70 2023-10-03T10:18:24.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.116+0000 7fe9e57fa700 1 -- 172.21.15.146:0/3073002387 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe9dc02b070 con 0x7fe9e80a0a70 2023-10-03T10:18:24.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.206+0000 7fcb2604c700 1 -- 172.21.15.146:0/1055089055 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcb2009f0f0 con 0x7fcb20139280 2023-10-03T10:18:24.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.206+0000 7fcb07fff700 1 -- 172.21.15.146:0/1055089055 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcb1801a380 con 0x7fcb20139280 2023-10-03T10:18:24.207 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:24.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.209+0000 7fcb2604c700 1 -- 172.21.15.146:0/1055089055 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb20139280 msgr2=0x7fcb201c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.209+0000 7fcb2604c700 1 --2- 172.21.15.146:0/1055089055 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb20139280 0x7fcb201c8470 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fcb18016000 tx=0x7fcb18004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.209+0000 7fcb2604c700 1 -- 172.21.15.146:0/1055089055 shutdown_connections 2023-10-03T10:18:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.209+0000 7fcb2604c700 1 --2- 172.21.15.146:0/1055089055 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb20139280 0x7fcb201c8470 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.209+0000 7fcb2604c700 1 --2- 172.21.15.146:0/1055089055 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb20133ad0 0x7fcb200717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.209+0000 7fcb2604c700 1 --2- 172.21.15.146:0/1055089055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb20136960 0x7fcb20071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.209+0000 7fcb2604c700 1 -- 172.21.15.146:0/1055089055 >> 172.21.15.146:0/1055089055 conn(0x7fcb20099c40 msgr2=0x7fcb201385e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.209+0000 7fcb2604c700 1 -- 172.21.15.146:0/1055089055 shutdown_connections 2023-10-03T10:18:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.209+0000 7fcb2604c700 1 -- 172.21.15.146:0/1055089055 wait complete. 2023-10-03T10:18:24.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:24.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.273+0000 7ff160517700 1 -- 172.21.15.146:0/3255672320 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff1580a23a0 con 0x7ff158139200 2023-10-03T10:18:24.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.273+0000 7ff14effd700 1 -- 172.21.15.146:0/3255672320 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff15002c030 con 0x7ff158139200 2023-10-03T10:18:24.274 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:24.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.276+0000 7ff160517700 1 -- 172.21.15.146:0/3255672320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff158139200 msgr2=0x7ff15811a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.276+0000 7ff160517700 1 --2- 172.21.15.146:0/3255672320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff158139200 0x7ff15811a6c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff1580a2370 tx=0x7ff150004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.276+0000 7ff160517700 1 -- 172.21.15.146:0/3255672320 shutdown_connections 2023-10-03T10:18:24.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.276+0000 7ff160517700 1 --2- 172.21.15.146:0/3255672320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff158139200 0x7ff15811a6c0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.276+0000 7ff160517700 1 --2- 172.21.15.146:0/3255672320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff158133b10 0x7ff158119c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.276+0000 7ff160517700 1 --2- 172.21.15.146:0/3255672320 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1581368e0 0x7ff15811a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.276+0000 7ff160517700 1 -- 172.21.15.146:0/3255672320 >> 172.21.15.146:0/3255672320 conn(0x7ff1580a2980 msgr2=0x7ff158130170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:24.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.276+0000 7ff160517700 1 -- 172.21.15.146:0/3255672320 shutdown_connections 2023-10-03T10:18:24.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.276+0000 7ff160517700 1 -- 172.21.15.146:0/3255672320 wait complete. 2023-10-03T10:18:24.288 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:24.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.309+0000 7fe9d2ffd700 1 -- 172.21.15.146:0/3073002387 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe9e81262e0 con 0x7fe9e80a0a70 2023-10-03T10:18:24.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.309+0000 7fe9e57fa700 1 -- 172.21.15.146:0/3073002387 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe9dc015030 con 0x7fe9e80a0a70 2023-10-03T10:18:24.310 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:24.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.311+0000 7fe9d2ffd700 1 -- 172.21.15.146:0/3073002387 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9e80a0a70 msgr2=0x7fe9e81c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.311+0000 7fe9d2ffd700 1 --2- 172.21.15.146:0/3073002387 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9e80a0a70 0x7fe9e81c8200 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc016000 tx=0x7fe9dc004750 comp rx=0 tx=0).stop 2023-10-03T10:18:24.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.311+0000 7fe9d2ffd700 1 -- 172.21.15.146:0/3073002387 shutdown_connections 2023-10-03T10:18:24.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.311+0000 7fe9d2ffd700 1 --2- 172.21.15.146:0/3073002387 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9e8133f50 0x7fe9e81c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.311+0000 7fe9d2ffd700 1 --2- 172.21.15.146:0/3073002387 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9e80a0a70 0x7fe9e81c8200 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.311+0000 7fe9d2ffd700 1 --2- 172.21.15.146:0/3073002387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9e80a1380 0x7fe9e81c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.311+0000 7fe9d2ffd700 1 -- 172.21.15.146:0/3073002387 >> 172.21.15.146:0/3073002387 conn(0x7fe9e80a6610 msgr2=0x7fe9e80a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:24.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.311+0000 7fe9d2ffd700 1 -- 172.21.15.146:0/3073002387 shutdown_connections 2023-10-03T10:18:24.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.311+0000 7fe9d2ffd700 1 -- 172.21.15.146:0/3073002387 wait complete. 2023-10-03T10:18:24.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:24.643 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:24.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.766+0000 7fe927fbb700 1 Processor -- start 2023-10-03T10:18:24.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.766+0000 7fe927fbb700 1 -- start start 2023-10-03T10:18:24.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.766+0000 7fe927fbb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe920133ad0 0x7fe920133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.766+0000 7fe927fbb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9201300a0 0x7fe9201304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.766+0000 7fe927fbb700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe92006b2d0 con 0x7fe9201309f0 2023-10-03T10:18:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.766+0000 7fe927fbb700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe920133610 con 0x7fe920133ad0 2023-10-03T10:18:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.766+0000 7fe927fbb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe92009a500 con 0x7fe9201300a0 2023-10-03T10:18:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.766+0000 7fe925d57700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe920133ad0 0x7fe920133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.766+0000 7fe926558700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe9201309f0 0x7fe92013a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34344/0 (socket says 172.21.15.146:34344) 2023-10-03T10:18:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.766+0000 7fe926558700 1 -- 172.21.15.146:0/79445242 learned_addr learned my addr 172.21.15.146:0/79445242 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.767+0000 7fe925556700 1 --2- 172.21.15.146:0/79445242 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9201300a0 0x7fe9201304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.767+0000 7fe924d55700 1 -- 172.21.15.146:0/79445242 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1063464357 0 0) 0x7fe92006b2d0 con 0x7fe9201309f0 2023-10-03T10:18:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.767+0000 7fe924d55700 1 -- 172.21.15.146:0/79445242 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe90c0035b0 con 0x7fe9201309f0 2023-10-03T10:18:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.767+0000 7fe925d57700 1 -- 172.21.15.146:0/79445242 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9201300a0 msgr2=0x7fe9201304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.767+0000 7fe925d57700 1 --2- 172.21.15.146:0/79445242 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9201300a0 0x7fe9201304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.767+0000 7fe925d57700 1 -- 172.21.15.146:0/79445242 >> v1:172.21.15.146:6789/0 conn(0x7fe9201309f0 legacy=0x7fe92013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.767+0000 7fe925d57700 1 -- 172.21.15.146:0/79445242 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9201338b0 con 0x7fe920133ad0 2023-10-03T10:18:24.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.767+0000 7fe925556700 1 --2- 172.21.15.146:0/79445242 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9201300a0 0x7fe9201304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.767+0000 7fe925d57700 1 --2- 172.21.15.146:0/79445242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe920133ad0 0x7fe920133ea0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fe910009840 tx=0x7fe910009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ca5ac9acf55f83 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.767+0000 7fe924d55700 1 -- 172.21.15.146:0/79445242 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910011830 con 0x7fe920133ad0 2023-10-03T10:18:24.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.767+0000 7fe924d55700 1 -- 172.21.15.146:0/79445242 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe910011990 con 0x7fe920133ad0 2023-10-03T10:18:24.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.767+0000 7fe924d55700 1 -- 172.21.15.146:0/79445242 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910011d20 con 0x7fe920133ad0 2023-10-03T10:18:24.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.768+0000 7fe927fbb700 1 -- 172.21.15.146:0/79445242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe920133ad0 msgr2=0x7fe920133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.768+0000 7fe927fbb700 1 --2- 172.21.15.146:0/79445242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe920133ad0 0x7fe920133ea0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fe910009840 tx=0x7fe910009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:24.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.768+0000 7fe927fbb700 1 -- 172.21.15.146:0/79445242 shutdown_connections 2023-10-03T10:18:24.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.768+0000 7fe927fbb700 1 --2- 172.21.15.146:0/79445242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe920133ad0 0x7fe920133ea0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.768+0000 7fe927fbb700 1 --2- 172.21.15.146:0/79445242 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9201300a0 0x7fe9201304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.768+0000 7fe927fbb700 1 -- 172.21.15.146:0/79445242 >> 172.21.15.146:0/79445242 conn(0x7fe920099c40 msgr2=0x7fe9200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:24.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.768+0000 7fe927fbb700 1 -- 172.21.15.146:0/79445242 shutdown_connections 2023-10-03T10:18:24.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.768+0000 7fe927fbb700 1 -- 172.21.15.146:0/79445242 wait complete. 2023-10-03T10:18:24.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.769+0000 7fe927fbb700 1 Processor -- start 2023-10-03T10:18:24.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.769+0000 7fe927fbb700 1 -- start start 2023-10-03T10:18:24.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe927fbb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9201300a0 0x7fe92011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe927fbb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9201309f0 0x7fe92011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe927fbb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe920133ad0 0x7fe92011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe927fbb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92011fe10 con 0x7fe920133ad0 2023-10-03T10:18:24.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe927fbb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe920120010 con 0x7fe9201309f0 2023-10-03T10:18:24.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe927fbb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe92011eaf0 con 0x7fe9201300a0 2023-10-03T10:18:24.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe925556700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9201309f0 0x7fe92011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe926558700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe920133ad0 0x7fe92011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe925556700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9201309f0 0x7fe92011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50180/0 (socket says 172.21.15.146:50180) 2023-10-03T10:18:24.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe925556700 1 -- 172.21.15.146:0/1389722384 learned_addr learned my addr 172.21.15.146:0/1389722384 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:24.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe925d57700 1 --2- 172.21.15.146:0/1389722384 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9201300a0 0x7fe92011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe926558700 1 -- 172.21.15.146:0/1389722384 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9201300a0 msgr2=0x7fe92011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe926558700 1 --2- 172.21.15.146:0/1389722384 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9201300a0 0x7fe92011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe926558700 1 -- 172.21.15.146:0/1389722384 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9201309f0 msgr2=0x7fe92011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe926558700 1 --2- 172.21.15.146:0/1389722384 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9201309f0 0x7fe92011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe926558700 1 -- 172.21.15.146:0/1389722384 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91c0094a0 con 0x7fe920133ad0 2023-10-03T10:18:24.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe925556700 1 --2- 172.21.15.146:0/1389722384 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9201309f0 0x7fe92011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe926558700 1 --2- 172.21.15.146:0/1389722384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe920133ad0 0x7fe92011e4c0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fe91800caa0 tx=0x7fe91800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe9167fc700 1 -- 172.21.15.146:0/1389722384 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91800a9e0 con 0x7fe920133ad0 2023-10-03T10:18:24.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe9167fc700 1 -- 172.21.15.146:0/1389722384 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91800ab40 con 0x7fe920133ad0 2023-10-03T10:18:24.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe927fbb700 1 -- 172.21.15.146:0/1389722384 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9100094a0 con 0x7fe920133ad0 2023-10-03T10:18:24.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe9167fc700 1 -- 172.21.15.146:0/1389722384 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe918012400 con 0x7fe920133ad0 2023-10-03T10:18:24.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.770+0000 7fe927fbb700 1 -- 172.21.15.146:0/1389722384 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92011fa70 con 0x7fe920133ad0 2023-10-03T10:18:24.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.771+0000 7fe9167fc700 1 -- 172.21.15.146:0/1389722384 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe91801b3b0 con 0x7fe920133ad0 2023-10-03T10:18:24.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.771+0000 7fe9167fc700 1 -- 172.21.15.146:0/1389722384 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe91803f2b0 con 0x7fe920133ad0 2023-10-03T10:18:24.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.771+0000 7fe927fbb700 1 -- 172.21.15.146:0/1389722384 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92004f2a0 con 0x7fe920133ad0 2023-10-03T10:18:24.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.776+0000 7fe9167fc700 1 -- 172.21.15.146:0/1389722384 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe918017020 con 0x7fe920133ad0 2023-10-03T10:18:24.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.962+0000 7fe927fbb700 1 -- 172.21.15.146:0/1389722384 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe92012d950 con 0x7fe920133ad0 2023-10-03T10:18:24.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.962+0000 7fe9167fc700 1 -- 172.21.15.146:0/1389722384 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe9180192c0 con 0x7fe920133ad0 2023-10-03T10:18:24.963 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:24.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.964+0000 7fe927fbb700 1 -- 172.21.15.146:0/1389722384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe920133ad0 msgr2=0x7fe92011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.964+0000 7fe927fbb700 1 --2- 172.21.15.146:0/1389722384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe920133ad0 0x7fe92011e4c0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fe91800caa0 tx=0x7fe91800cdb0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.964+0000 7fe927fbb700 1 -- 172.21.15.146:0/1389722384 shutdown_connections 2023-10-03T10:18:24.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.964+0000 7fe927fbb700 1 --2- 172.21.15.146:0/1389722384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe920133ad0 0x7fe92011e4c0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.964+0000 7fe927fbb700 1 --2- 172.21.15.146:0/1389722384 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9201300a0 0x7fe92011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.964+0000 7fe927fbb700 1 --2- 172.21.15.146:0/1389722384 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9201309f0 0x7fe92011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.964+0000 7fe927fbb700 1 -- 172.21.15.146:0/1389722384 >> 172.21.15.146:0/1389722384 conn(0x7fe920099c40 msgr2=0x7fe92012e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:24.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.965+0000 7fe927fbb700 1 -- 172.21.15.146:0/1389722384 shutdown_connections 2023-10-03T10:18:24.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:24.965+0000 7fe927fbb700 1 -- 172.21.15.146:0/1389722384 wait complete. 2023-10-03T10:18:24.977 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:25.222 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:25.289 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:25.324 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.350+0000 7fcaf2a91700 1 Processor -- start 2023-10-03T10:18:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.350+0000 7fcaf2a91700 1 -- start start 2023-10-03T10:18:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.351+0000 7fcaf2a91700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcaec131980 0x7fcaec131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.351+0000 7fcaf2a91700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaec09bc70 0x7fcaec09c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.351+0000 7fcaf2a91700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaec0a1640 con 0x7fcaec09c5c0 2023-10-03T10:18:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.351+0000 7fcaf2a91700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaec06eb30 con 0x7fcaec131980 2023-10-03T10:18:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.351+0000 7fcaf2a91700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec0a22d0 con 0x7fcaec09bc70 2023-10-03T10:18:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.351+0000 7fcaf082d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcaec131980 0x7fcaec131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.351+0000 7fcaebfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaec09bc70 0x7fcaec09c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.351+0000 7fcaf102e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcaec09c5c0 0x7fcaec138700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34352/0 (socket says 172.21.15.146:34352) 2023-10-03T10:18:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.351+0000 7fcaf102e700 1 -- 172.21.15.146:0/280772967 learned_addr learned my addr 172.21.15.146:0/280772967 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.351+0000 7fcaf082d700 1 -- 172.21.15.146:0/280772967 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaec09bc70 msgr2=0x7fcaec09c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.351+0000 7fcaf082d700 1 --2- 172.21.15.146:0/280772967 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaec09bc70 0x7fcaec09c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.351+0000 7fcaf082d700 1 -- 172.21.15.146:0/280772967 >> v1:172.21.15.146:6789/0 conn(0x7fcaec09c5c0 legacy=0x7fcaec138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.351+0000 7fcaeb7fe700 1 -- 172.21.15.146:0/280772967 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 459010389 0 0) 0x7fcaec0a1640 con 0x7fcaec09c5c0 2023-10-03T10:18:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.351+0000 7fcaf082d700 1 -- 172.21.15.146:0/280772967 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec131550 con 0x7fcaec131980 2023-10-03T10:18:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.351+0000 7fcaf082d700 1 --2- 172.21.15.146:0/280772967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaec131980 0x7fcaec131d50 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fcae0009820 tx=0x7fcae0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790124ce902c138e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.351+0000 7fcaeb7fe700 1 -- 172.21.15.146:0/280772967 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae0005e30 con 0x7fcaec131980 2023-10-03T10:18:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.352+0000 7fcaeb7fe700 1 -- 172.21.15.146:0/280772967 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae0006030 con 0x7fcaec131980 2023-10-03T10:18:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.352+0000 7fcaeb7fe700 1 -- 172.21.15.146:0/280772967 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae00063c0 con 0x7fcaec131980 2023-10-03T10:18:25.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.352+0000 7fcaf2a91700 1 -- 172.21.15.146:0/280772967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaec131980 msgr2=0x7fcaec131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.352+0000 7fcaf2a91700 1 --2- 172.21.15.146:0/280772967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaec131980 0x7fcaec131d50 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fcae0009820 tx=0x7fcae0009b30 comp rx=0 tx=0).stop 2023-10-03T10:18:25.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.352+0000 7fcaf2a91700 1 -- 172.21.15.146:0/280772967 shutdown_connections 2023-10-03T10:18:25.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.352+0000 7fcaf2a91700 1 --2- 172.21.15.146:0/280772967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaec131980 0x7fcaec131d50 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.352+0000 7fcaf2a91700 1 --2- 172.21.15.146:0/280772967 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaec09bc70 0x7fcaec09c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.352+0000 7fcaf2a91700 1 -- 172.21.15.146:0/280772967 >> 172.21.15.146:0/280772967 conn(0x7fcaec0a2980 msgr2=0x7fcaec0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.352+0000 7fcaf2a91700 1 -- 172.21.15.146:0/280772967 shutdown_connections 2023-10-03T10:18:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.352+0000 7fcaf2a91700 1 -- 172.21.15.146:0/280772967 wait complete. 2023-10-03T10:18:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.353+0000 7fcaf2a91700 1 Processor -- start 2023-10-03T10:18:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.353+0000 7fcaf2a91700 1 -- start start 2023-10-03T10:18:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.354+0000 7fcaf2a91700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaec09bc70 0x7fcaec11b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.354+0000 7fcaf2a91700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcaec09c5c0 0x7fcaec11bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.354+0000 7fcaf2a91700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaec131980 0x7fcaec11c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.354+0000 7fcaf2a91700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec11d9d0 con 0x7fcaec09bc70 2023-10-03T10:18:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.354+0000 7fcaf2a91700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec11f290 con 0x7fcaec131980 2023-10-03T10:18:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.354+0000 7fcaf2a91700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec11e660 con 0x7fcaec09c5c0 2023-10-03T10:18:25.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.354+0000 7fcaebfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcaec09c5c0 0x7fcaec11bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.354+0000 7fcaf102e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaec131980 0x7fcaec11c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.354+0000 7fcaebfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcaec09c5c0 0x7fcaec11bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53892/0 (socket says 172.21.15.146:53892) 2023-10-03T10:18:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.354+0000 7fcaebfff700 1 -- 172.21.15.146:0/91555968 learned_addr learned my addr 172.21.15.146:0/91555968 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.354+0000 7fcaf082d700 1 --2- 172.21.15.146:0/91555968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaec09bc70 0x7fcaec11b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.355+0000 7fcaf102e700 1 -- 172.21.15.146:0/91555968 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcaec09c5c0 msgr2=0x7fcaec11bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.355+0000 7fcaf102e700 1 --2- 172.21.15.146:0/91555968 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcaec09c5c0 0x7fcaec11bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.355+0000 7fcaf102e700 1 -- 172.21.15.146:0/91555968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaec09bc70 msgr2=0x7fcaec11b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.355+0000 7fcaf102e700 1 --2- 172.21.15.146:0/91555968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaec09bc70 0x7fcaec11b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.355+0000 7fcaf102e700 1 -- 172.21.15.146:0/91555968 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae0009430 con 0x7fcaec131980 2023-10-03T10:18:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.355+0000 7fcaebfff700 1 --2- 172.21.15.146:0/91555968 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcaec09c5c0 0x7fcaec11bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.355+0000 7fcaf102e700 1 --2- 172.21.15.146:0/91555968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaec131980 0x7fcaec11c280 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fcae400cc40 tx=0x7fcae400cf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.355+0000 7fcae97fa700 1 -- 172.21.15.146:0/91555968 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae400aa20 con 0x7fcaec131980 2023-10-03T10:18:25.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.355+0000 7fcae97fa700 1 -- 172.21.15.146:0/91555968 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae400aba0 con 0x7fcaec131980 2023-10-03T10:18:25.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.355+0000 7fcaf2a91700 1 -- 172.21.15.146:0/91555968 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaec130940 con 0x7fcaec131980 2023-10-03T10:18:25.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.355+0000 7fcae97fa700 1 -- 172.21.15.146:0/91555968 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae40070d0 con 0x7fcaec131980 2023-10-03T10:18:25.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.355+0000 7fcaf2a91700 1 -- 172.21.15.146:0/91555968 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaec0a1c90 con 0x7fcaec131980 2023-10-03T10:18:25.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.356+0000 7fcae97fa700 1 -- 172.21.15.146:0/91555968 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcae4007230 con 0x7fcaec131980 2023-10-03T10:18:25.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.356+0000 7fcae97fa700 1 -- 172.21.15.146:0/91555968 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcae403f400 con 0x7fcaec131980 2023-10-03T10:18:25.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.356+0000 7fcaf2a91700 1 -- 172.21.15.146:0/91555968 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaec04f2a0 con 0x7fcaec131980 2023-10-03T10:18:25.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.361+0000 7fcae97fa700 1 -- 172.21.15.146:0/91555968 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcae4018080 con 0x7fcaec131980 2023-10-03T10:18:25.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.419+0000 7f1937f45700 1 Processor -- start 2023-10-03T10:18:25.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.419+0000 7f1937f45700 1 -- start start 2023-10-03T10:18:25.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.420+0000 7f1937f45700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f193009d860 0x7f193009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.420+0000 7f1937f45700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1930130eb0 0x7f1930138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.420+0000 7f1937f45700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193009aaa0 con 0x7f193009e170 2023-10-03T10:18:25.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.420+0000 7f1937f45700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193009f870 con 0x7f1930130eb0 2023-10-03T10:18:25.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.420+0000 7f1937f45700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f193009b360 con 0x7f193009d860 2023-10-03T10:18:25.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.420+0000 7f1935ce1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f193009d860 0x7f193009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.420+0000 7f1935ce1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f193009d860 0x7f193009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53900/0 (socket says 172.21.15.146:53900) 2023-10-03T10:18:25.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.420+0000 7f1935ce1700 1 -- 172.21.15.146:0/2909942472 learned_addr learned my addr 172.21.15.146:0/2909942472 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:25.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.420+0000 7f19364e2700 1 --2- 172.21.15.146:0/2909942472 >> v2:172.21.15.146:3300/0 conn(0x7f1930130eb0 0x7f1930138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.420+0000 7f1935ce1700 1 -- 172.21.15.146:0/2909942472 >> v2:172.21.15.146:3300/0 conn(0x7f1930130eb0 msgr2=0x7f1930138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:25.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.420+0000 7f1935ce1700 1 --2- 172.21.15.146:0/2909942472 >> v2:172.21.15.146:3300/0 conn(0x7f1930130eb0 0x7f1930138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.420+0000 7f1935ce1700 1 -- 172.21.15.146:0/2909942472 >> v1:172.21.15.146:6789/0 conn(0x7f193009e170 legacy=0x7f19301307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.420+0000 7f1935ce1700 1 -- 172.21.15.146:0/2909942472 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193009b620 con 0x7f193009d860 2023-10-03T10:18:25.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.420+0000 7f19364e2700 1 --2- 172.21.15.146:0/2909942472 >> v2:172.21.15.146:3300/0 conn(0x7f1930130eb0 0x7f1930138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:25.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.420+0000 7f1935ce1700 1 --2- 172.21.15.146:0/2909942472 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f193009d860 0x7f193009dc30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f192c0098f0 tx=0x7f192c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c332414d24198d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:25.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.421+0000 7f1934cdf700 1 -- 172.21.15.146:0/2909942472 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c011830 con 0x7f193009d860 2023-10-03T10:18:25.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.421+0000 7f1934cdf700 1 -- 172.21.15.146:0/2909942472 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c011990 con 0x7f193009d860 2023-10-03T10:18:25.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.421+0000 7f1934cdf700 1 -- 172.21.15.146:0/2909942472 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c011d20 con 0x7f193009d860 2023-10-03T10:18:25.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.421+0000 7f1937f45700 1 -- 172.21.15.146:0/2909942472 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f193009d860 msgr2=0x7f193009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.421+0000 7f1937f45700 1 --2- 172.21.15.146:0/2909942472 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f193009d860 0x7f193009dc30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f192c0098f0 tx=0x7f192c009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:25.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.421+0000 7f1937f45700 1 -- 172.21.15.146:0/2909942472 shutdown_connections 2023-10-03T10:18:25.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.421+0000 7f1937f45700 1 --2- 172.21.15.146:0/2909942472 >> v2:172.21.15.146:3300/0 conn(0x7f1930130eb0 0x7f1930138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.421+0000 7f1937f45700 1 --2- 172.21.15.146:0/2909942472 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f193009d860 0x7f193009dc30 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.421+0000 7f1937f45700 1 -- 172.21.15.146:0/2909942472 >> 172.21.15.146:0/2909942472 conn(0x7f1930099c40 msgr2=0x7f19300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.421+0000 7f1937f45700 1 -- 172.21.15.146:0/2909942472 shutdown_connections 2023-10-03T10:18:25.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.421+0000 7f1937f45700 1 -- 172.21.15.146:0/2909942472 wait complete. 2023-10-03T10:18:25.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.422+0000 7f1937f45700 1 Processor -- start 2023-10-03T10:18:25.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.422+0000 7f1937f45700 1 -- start start 2023-10-03T10:18:25.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.423+0000 7f1937f45700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f193009d860 0x7f1930138d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.423+0000 7f1937f45700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f193009e170 0x7f1930139f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.423+0000 7f1937f45700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1930130eb0 0x7f193013a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.423+0000 7f1937f45700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1930137440 con 0x7f193009e170 2023-10-03T10:18:25.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.423+0000 7f1937f45700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193013baf0 con 0x7f1930130eb0 2023-10-03T10:18:25.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.423+0000 7f1937f45700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1930137640 con 0x7f193009d860 2023-10-03T10:18:25.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.423+0000 7f19354e0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f193009e170 0x7f1930139f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.423+0000 7f19354e0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f193009e170 0x7f1930139f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37540/0 (socket says 172.21.15.146:37540) 2023-10-03T10:18:25.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.423+0000 7f19354e0700 1 -- 172.21.15.146:0/2375992927 learned_addr learned my addr 172.21.15.146:0/2375992927 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:25.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.423+0000 7f19364e2700 1 --2- 172.21.15.146:0/2375992927 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1930130eb0 0x7f193013a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.423+0000 7f1935ce1700 1 --2- 172.21.15.146:0/2375992927 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f193009d860 0x7f1930138d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.423+0000 7f19364e2700 1 -- 172.21.15.146:0/2375992927 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f193009d860 msgr2=0x7f1930138d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.423+0000 7f19364e2700 1 --2- 172.21.15.146:0/2375992927 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f193009d860 0x7f1930138d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.423+0000 7f19364e2700 1 -- 172.21.15.146:0/2375992927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f193009e170 msgr2=0x7f1930139f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.423+0000 7f19364e2700 1 --2- 172.21.15.146:0/2375992927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f193009e170 0x7f1930139f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.423+0000 7f19364e2700 1 -- 172.21.15.146:0/2375992927 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1928009a70 con 0x7f1930130eb0 2023-10-03T10:18:25.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.423+0000 7f19354e0700 1 --2- 172.21.15.146:0/2375992927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f193009e170 0x7f1930139f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:25.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.423+0000 7f1935ce1700 1 --2- 172.21.15.146:0/2375992927 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f193009d860 0x7f1930138d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:25.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.424+0000 7f19364e2700 1 --2- 172.21.15.146:0/2375992927 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1930130eb0 0x7f193013a490 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f1928009e50 tx=0x7f192800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:25.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.424+0000 7f19267fc700 1 -- 172.21.15.146:0/2375992927 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192800ca90 con 0x7f1930130eb0 2023-10-03T10:18:25.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.424+0000 7f19267fc700 1 -- 172.21.15.146:0/2375992927 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192800f040 con 0x7f1930130eb0 2023-10-03T10:18:25.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.424+0000 7f19267fc700 1 -- 172.21.15.146:0/2375992927 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192800ce50 con 0x7f1930130eb0 2023-10-03T10:18:25.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.424+0000 7f1937f45700 1 -- 172.21.15.146:0/2375992927 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f192c009550 con 0x7f1930130eb0 2023-10-03T10:18:25.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.424+0000 7f1937f45700 1 -- 172.21.15.146:0/2375992927 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19301365b0 con 0x7f1930130eb0 2023-10-03T10:18:25.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.425+0000 7f19267fc700 1 -- 172.21.15.146:0/2375992927 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1928014480 con 0x7f1930130eb0 2023-10-03T10:18:25.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.425+0000 7f19267fc700 1 -- 172.21.15.146:0/2375992927 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f192803fa30 con 0x7f1930130eb0 2023-10-03T10:18:25.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.425+0000 7f1937f45700 1 -- 172.21.15.146:0/2375992927 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1930132ac0 con 0x7f1930130eb0 2023-10-03T10:18:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.430+0000 7f19267fc700 1 -- 172.21.15.146:0/2375992927 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1928012340 con 0x7f1930130eb0 2023-10-03T10:18:25.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.460+0000 7f47a7bae700 1 Processor -- start 2023-10-03T10:18:25.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.460+0000 7f47a7bae700 1 -- start start 2023-10-03T10:18:25.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.461+0000 7f47a7bae700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f47a006a770 0x7f47a006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.461+0000 7f47a7bae700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47a006b080 0x7f47a0131e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.461+0000 7f47a7bae700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a009ec00 con 0x7f47a009da80 2023-10-03T10:18:25.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.461+0000 7f47a7bae700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a009f6a0 con 0x7f47a006a770 2023-10-03T10:18:25.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.461+0000 7f47a7bae700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a009f230 con 0x7f47a006b080 2023-10-03T10:18:25.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.461+0000 7f47a594a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f47a006a770 0x7f47a006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.461+0000 7f47a614b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47a006b080 0x7f47a0131e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.461+0000 7f47a594a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f47a006a770 0x7f47a006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37556/0 (socket says 172.21.15.146:37556) 2023-10-03T10:18:25.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.461+0000 7f47a594a700 1 -- 172.21.15.146:0/2234173484 learned_addr learned my addr 172.21.15.146:0/2234173484 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:25.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.461+0000 7f47a5149700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f47a009da80 0x7f47a0131740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34364/0 (socket says 172.21.15.146:34364) 2023-10-03T10:18:25.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.462+0000 7f47a594a700 1 -- 172.21.15.146:0/2234173484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47a006b080 msgr2=0x7f47a0131e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:25.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.462+0000 7f47a594a700 1 --2- 172.21.15.146:0/2234173484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47a006b080 0x7f47a0131e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.462+0000 7f47a594a700 1 -- 172.21.15.146:0/2234173484 >> v1:172.21.15.146:6789/0 conn(0x7f47a009da80 legacy=0x7f47a0131740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.462+0000 7f47a594a700 1 -- 172.21.15.146:0/2234173484 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a009c870 con 0x7f47a006a770 2023-10-03T10:18:25.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.462+0000 7f47a4948700 1 -- 172.21.15.146:0/2234173484 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2645884874 0 0) 0x7f47a009ec00 con 0x7f47a009da80 2023-10-03T10:18:25.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.462+0000 7f47a614b700 1 --2- 172.21.15.146:0/2234173484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47a006b080 0x7f47a0131e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:25.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.462+0000 7f47a594a700 1 --2- 172.21.15.146:0/2234173484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47a006a770 0x7f47a006ab40 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f479c006fd0 tx=0x7f479c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e13d8345960c3c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:25.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.462+0000 7f47a4948700 1 -- 172.21.15.146:0/2234173484 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c005e30 con 0x7f47a006a770 2023-10-03T10:18:25.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.462+0000 7f47a4948700 1 -- 172.21.15.146:0/2234173484 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479c004030 con 0x7f47a006a770 2023-10-03T10:18:25.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.462+0000 7f47a4948700 1 -- 172.21.15.146:0/2234173484 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c0043e0 con 0x7f47a006a770 2023-10-03T10:18:25.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.463+0000 7f47a7bae700 1 -- 172.21.15.146:0/2234173484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47a006a770 msgr2=0x7f47a006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.463+0000 7f47a7bae700 1 --2- 172.21.15.146:0/2234173484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47a006a770 0x7f47a006ab40 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f479c006fd0 tx=0x7f479c009bd0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.463+0000 7f47a7bae700 1 -- 172.21.15.146:0/2234173484 shutdown_connections 2023-10-03T10:18:25.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.463+0000 7f47a7bae700 1 --2- 172.21.15.146:0/2234173484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47a006b080 0x7f47a0131e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.463+0000 7f47a7bae700 1 --2- 172.21.15.146:0/2234173484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47a006a770 0x7f47a006ab40 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.463+0000 7f47a7bae700 1 -- 172.21.15.146:0/2234173484 >> 172.21.15.146:0/2234173484 conn(0x7f47a009f9f0 msgr2=0x7f47a009fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.463+0000 7f47a7bae700 1 -- 172.21.15.146:0/2234173484 shutdown_connections 2023-10-03T10:18:25.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.463+0000 7f47a7bae700 1 -- 172.21.15.146:0/2234173484 wait complete. 2023-10-03T10:18:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.464+0000 7f47a7bae700 1 Processor -- start 2023-10-03T10:18:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.464+0000 7f47a7bae700 1 -- start start 2023-10-03T10:18:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.465+0000 7f47a7bae700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47a006a770 0x7f47a0130b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.465+0000 7f47a7bae700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47a006b080 0x7f47a01310a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.465+0000 7f47a7bae700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f47a009da80 0x7f47a01315e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.465+0000 7f47a7bae700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a01348b0 con 0x7f47a006b080 2023-10-03T10:18:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.465+0000 7f47a7bae700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a0072230 con 0x7f47a006a770 2023-10-03T10:18:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.465+0000 7f47a594a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47a006a770 0x7f47a0130b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.465+0000 7f47a5149700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47a006b080 0x7f47a01310a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.465+0000 7f47a7bae700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47a0132bd0 con 0x7f47a009da80 2023-10-03T10:18:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.465+0000 7f47a594a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47a006a770 0x7f47a0130b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50240/0 (socket says 172.21.15.146:50240) 2023-10-03T10:18:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.465+0000 7f47a594a700 1 -- 172.21.15.146:0/1420274163 learned_addr learned my addr 172.21.15.146:0/1420274163 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.465+0000 7f47a614b700 1 --2- 172.21.15.146:0/1420274163 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f47a009da80 0x7f47a01315e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.465+0000 7f47a594a700 1 -- 172.21.15.146:0/1420274163 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f47a009da80 msgr2=0x7f47a01315e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.465+0000 7f47a594a700 1 --2- 172.21.15.146:0/1420274163 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f47a009da80 0x7f47a01315e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.465+0000 7f47a594a700 1 -- 172.21.15.146:0/1420274163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47a006b080 msgr2=0x7f47a01310a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.465+0000 7f47a594a700 1 --2- 172.21.15.146:0/1420274163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47a006b080 0x7f47a01310a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.465+0000 7f47a594a700 1 -- 172.21.15.146:0/1420274163 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4798009a70 con 0x7f47a006a770 2023-10-03T10:18:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.465+0000 7f47a5149700 1 --2- 172.21.15.146:0/1420274163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47a006b080 0x7f47a01310a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.465+0000 7f47a594a700 1 --2- 172.21.15.146:0/1420274163 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47a006a770 0x7f47a0130b60 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f479c000c00 tx=0x7f479c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.465+0000 7f47967fc700 1 -- 172.21.15.146:0/1420274163 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c01c420 con 0x7f47a006a770 2023-10-03T10:18:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.466+0000 7f47967fc700 1 -- 172.21.15.146:0/1420274163 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479c01c580 con 0x7f47a006a770 2023-10-03T10:18:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.466+0000 7f47a7bae700 1 -- 172.21.15.146:0/1420274163 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479c009500 con 0x7f47a006a770 2023-10-03T10:18:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.466+0000 7f47967fc700 1 -- 172.21.15.146:0/1420274163 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c01c930 con 0x7f47a006a770 2023-10-03T10:18:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.466+0000 7f47a7bae700 1 -- 172.21.15.146:0/1420274163 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a0133930 con 0x7f47a006a770 2023-10-03T10:18:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.466+0000 7f47967fc700 1 -- 172.21.15.146:0/1420274163 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f479c01ca90 con 0x7f47a006a770 2023-10-03T10:18:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.466+0000 7f47a7bae700 1 -- 172.21.15.146:0/1420274163 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a004f2a0 con 0x7f47a006a770 2023-10-03T10:18:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.467+0000 7f47967fc700 1 -- 172.21.15.146:0/1420274163 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f479c0406d0 con 0x7f47a006a770 2023-10-03T10:18:25.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.471+0000 7f47967fc700 1 -- 172.21.15.146:0/1420274163 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f479c01cd40 con 0x7f47a006a770 2023-10-03T10:18:25.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.557+0000 7fcaf2a91700 1 -- 172.21.15.146:0/91555968 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcaec06bce0 con 0x7fcaec131980 2023-10-03T10:18:25.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.558+0000 7fcae97fa700 1 -- 172.21.15.146:0/91555968 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcae40074e0 con 0x7fcaec131980 2023-10-03T10:18:25.559 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:25.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.560+0000 7fcaf2a91700 1 -- 172.21.15.146:0/91555968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaec131980 msgr2=0x7fcaec11c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.560+0000 7fcaf2a91700 1 --2- 172.21.15.146:0/91555968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaec131980 0x7fcaec11c280 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fcae400cc40 tx=0x7fcae400cf50 comp rx=0 tx=0).stop 2023-10-03T10:18:25.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.560+0000 7fcaf2a91700 1 -- 172.21.15.146:0/91555968 shutdown_connections 2023-10-03T10:18:25.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.560+0000 7fcaf2a91700 1 --2- 172.21.15.146:0/91555968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcaec131980 0x7fcaec11c280 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.560+0000 7fcaf2a91700 1 --2- 172.21.15.146:0/91555968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcaec09bc70 0x7fcaec11b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.560+0000 7fcaf2a91700 1 --2- 172.21.15.146:0/91555968 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcaec09c5c0 0x7fcaec11bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.560+0000 7fcaf2a91700 1 -- 172.21.15.146:0/91555968 >> 172.21.15.146:0/91555968 conn(0x7fcaec0a2980 msgr2=0x7fcaec1b8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.560+0000 7fcaf2a91700 1 -- 172.21.15.146:0/91555968 shutdown_connections 2023-10-03T10:18:25.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.560+0000 7fcaf2a91700 1 -- 172.21.15.146:0/91555968 wait complete. 2023-10-03T10:18:25.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:25.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.628+0000 7f1937f45700 1 -- 172.21.15.146:0/2375992927 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1930136550 con 0x7f1930130eb0 2023-10-03T10:18:25.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.628+0000 7f19267fc700 1 -- 172.21.15.146:0/2375992927 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f192801c3b0 con 0x7f1930130eb0 2023-10-03T10:18:25.629 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.631+0000 7f1937f45700 1 -- 172.21.15.146:0/2375992927 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1930130eb0 msgr2=0x7f193013a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.631+0000 7f1937f45700 1 --2- 172.21.15.146:0/2375992927 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1930130eb0 0x7f193013a490 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f1928009e50 tx=0x7f192800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.631+0000 7f1937f45700 1 -- 172.21.15.146:0/2375992927 shutdown_connections 2023-10-03T10:18:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.631+0000 7f1937f45700 1 --2- 172.21.15.146:0/2375992927 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1930130eb0 0x7f193013a490 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.631+0000 7f1937f45700 1 --2- 172.21.15.146:0/2375992927 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f193009d860 0x7f1930138d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.631+0000 7f1937f45700 1 --2- 172.21.15.146:0/2375992927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f193009e170 0x7f1930139f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.631+0000 7f1937f45700 1 -- 172.21.15.146:0/2375992927 >> 172.21.15.146:0/2375992927 conn(0x7f1930099c40 msgr2=0x7f19301397d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.631+0000 7f1937f45700 1 -- 172.21.15.146:0/2375992927 shutdown_connections 2023-10-03T10:18:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.631+0000 7f1937f45700 1 -- 172.21.15.146:0/2375992927 wait complete. 2023-10-03T10:18:25.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:25.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.665+0000 7f47a7bae700 1 -- 172.21.15.146:0/1420274163 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f47a0072d60 con 0x7f47a006a770 2023-10-03T10:18:25.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.665+0000 7f47967fc700 1 -- 172.21.15.146:0/1420274163 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f479c02a070 con 0x7f47a006a770 2023-10-03T10:18:25.666 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:25.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.667+0000 7f47a7bae700 1 -- 172.21.15.146:0/1420274163 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47a006a770 msgr2=0x7f47a0130b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.667+0000 7f47a7bae700 1 --2- 172.21.15.146:0/1420274163 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47a006a770 0x7f47a0130b60 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f479c000c00 tx=0x7f479c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:25.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.667+0000 7f47a7bae700 1 -- 172.21.15.146:0/1420274163 shutdown_connections 2023-10-03T10:18:25.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.667+0000 7f47a7bae700 1 --2- 172.21.15.146:0/1420274163 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f47a009da80 0x7f47a01315e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.667+0000 7f47a7bae700 1 --2- 172.21.15.146:0/1420274163 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47a006a770 0x7f47a0130b60 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.667+0000 7f47a7bae700 1 --2- 172.21.15.146:0/1420274163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47a006b080 0x7f47a01310a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.667+0000 7f47a7bae700 1 -- 172.21.15.146:0/1420274163 >> 172.21.15.146:0/1420274163 conn(0x7f47a009f9f0 msgr2=0x7f47a009b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.668+0000 7f47a7bae700 1 -- 172.21.15.146:0/1420274163 shutdown_connections 2023-10-03T10:18:25.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:25.668+0000 7f47a7bae700 1 -- 172.21.15.146:0/1420274163 wait complete. 2023-10-03T10:18:25.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:25.978 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:26.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.101+0000 7f517c005700 1 Processor -- start 2023-10-03T10:18:26.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.101+0000 7f517c005700 1 -- start start 2023-10-03T10:18:26.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.101+0000 7f517c005700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f517409a150 0x7f517409e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.101+0000 7f517c005700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f517409edb0 0x7f517409f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.101+0000 7f517c005700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5174133c20 0x7f51741340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.101+0000 7f517c005700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f517409a520 con 0x7f517409edb0 2023-10-03T10:18:26.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.101+0000 7f517c005700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517409fe00 con 0x7f5174133c20 2023-10-03T10:18:26.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.101+0000 7f517c005700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f517406bec0 con 0x7f517409a150 2023-10-03T10:18:26.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.101+0000 7f5179da1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f517409a150 0x7f517409e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.101+0000 7f517a5a2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5174133c20 0x7f51741340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.101+0000 7f51795a0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f517409edb0 0x7f517409f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.102+0000 7f51795a0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f517409edb0 0x7f517409f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37572/0 (socket says 172.21.15.146:37572) 2023-10-03T10:18:26.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.102+0000 7f5179da1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f517409a150 0x7f517409e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53934/0 (socket says 172.21.15.146:53934) 2023-10-03T10:18:26.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.102+0000 7f517a5a2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5174133c20 0x7f51741340a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50242/0 (socket says 172.21.15.146:50242) 2023-10-03T10:18:26.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.102+0000 7f51795a0700 1 -- 172.21.15.146:0/4203243645 learned_addr learned my addr 172.21.15.146:0/4203243645 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:26.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.102+0000 7f51795a0700 1 -- 172.21.15.146:0/4203243645 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f517409a150 msgr2=0x7f517409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.102+0000 7f51795a0700 1 --2- 172.21.15.146:0/4203243645 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f517409a150 0x7f517409e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.102+0000 7f51795a0700 1 -- 172.21.15.146:0/4203243645 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5174133c20 msgr2=0x7f51741340a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.102+0000 7f51795a0700 1 --2- 172.21.15.146:0/4203243645 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5174133c20 0x7f51741340a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.102+0000 7f51795a0700 1 -- 172.21.15.146:0/4203243645 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517409af80 con 0x7f517409edb0 2023-10-03T10:18:26.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.102+0000 7f5179da1700 1 --2- 172.21.15.146:0/4203243645 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f517409a150 0x7f517409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.102+0000 7f51795a0700 1 --2- 172.21.15.146:0/4203243645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f517409edb0 0x7f517409f1a0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f5164009920 tx=0x7f5164009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2e4d756d08e55e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.102+0000 7f5178d9f700 1 -- 172.21.15.146:0/4203243645 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5164011830 con 0x7f517409edb0 2023-10-03T10:18:26.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.102+0000 7f5178d9f700 1 -- 172.21.15.146:0/4203243645 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5164011990 con 0x7f517409edb0 2023-10-03T10:18:26.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.102+0000 7f5178d9f700 1 -- 172.21.15.146:0/4203243645 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5164011d20 con 0x7f517409edb0 2023-10-03T10:18:26.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.103+0000 7f517c005700 1 -- 172.21.15.146:0/4203243645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f517409edb0 msgr2=0x7f517409f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.103+0000 7f517c005700 1 --2- 172.21.15.146:0/4203243645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f517409edb0 0x7f517409f1a0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f5164009920 tx=0x7f5164009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:26.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.103+0000 7f517c005700 1 -- 172.21.15.146:0/4203243645 shutdown_connections 2023-10-03T10:18:26.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.103+0000 7f517c005700 1 --2- 172.21.15.146:0/4203243645 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5174133c20 0x7f51741340a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.103+0000 7f517c005700 1 --2- 172.21.15.146:0/4203243645 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f517409a150 0x7f517409e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.103+0000 7f517c005700 1 --2- 172.21.15.146:0/4203243645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f517409edb0 0x7f517409f1a0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.103+0000 7f517c005700 1 -- 172.21.15.146:0/4203243645 >> 172.21.15.146:0/4203243645 conn(0x7f51740a4430 msgr2=0x7f51740a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.103+0000 7f517c005700 1 -- 172.21.15.146:0/4203243645 shutdown_connections 2023-10-03T10:18:26.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.103+0000 7f517c005700 1 -- 172.21.15.146:0/4203243645 wait complete. 2023-10-03T10:18:26.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.104+0000 7f517c005700 1 Processor -- start 2023-10-03T10:18:26.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.104+0000 7f517c005700 1 -- start start 2023-10-03T10:18:26.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.104+0000 7f517c005700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f517409a150 0x7f517411ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.104+0000 7f517c005700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f517409edb0 0x7f517411f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.104+0000 7f517c005700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5174133c20 0x7f517411f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.104+0000 7f517c005700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5174121f90 con 0x7f5174133c20 2023-10-03T10:18:26.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.104+0000 7f517c005700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51740a0440 con 0x7f517409edb0 2023-10-03T10:18:26.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.104+0000 7f517c005700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5174120650 con 0x7f517409a150 2023-10-03T10:18:26.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.104+0000 7f51795a0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f517409edb0 0x7f517411f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.104+0000 7f517a5a2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5174133c20 0x7f517411f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.104+0000 7f51795a0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f517409edb0 0x7f517411f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50250/0 (socket says 172.21.15.146:50250) 2023-10-03T10:18:26.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.104+0000 7f5179da1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f517409a150 0x7f517411ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.104+0000 7f51795a0700 1 -- 172.21.15.146:0/762815427 learned_addr learned my addr 172.21.15.146:0/762815427 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:26.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.104+0000 7f51795a0700 1 -- 172.21.15.146:0/762815427 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f517409a150 msgr2=0x7f517411ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.104+0000 7f51795a0700 1 --2- 172.21.15.146:0/762815427 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f517409a150 0x7f517411ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.104+0000 7f51795a0700 1 -- 172.21.15.146:0/762815427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5174133c20 msgr2=0x7f517411f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.104+0000 7f51795a0700 1 --2- 172.21.15.146:0/762815427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5174133c20 0x7f517411f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.104+0000 7f51795a0700 1 -- 172.21.15.146:0/762815427 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51700094a0 con 0x7f517409edb0 2023-10-03T10:18:26.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.104+0000 7f517a5a2700 1 --2- 172.21.15.146:0/762815427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5174133c20 0x7f517411f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.105+0000 7f51795a0700 1 --2- 172.21.15.146:0/762815427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f517409edb0 0x7f517411f010 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f5164009870 tx=0x7f5164004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.105+0000 7f516a7fc700 1 -- 172.21.15.146:0/762815427 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5164004450 con 0x7f517409edb0 2023-10-03T10:18:26.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.105+0000 7f516a7fc700 1 -- 172.21.15.146:0/762815427 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51640045d0 con 0x7f517409edb0 2023-10-03T10:18:26.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.105+0000 7f517c005700 1 -- 172.21.15.146:0/762815427 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5164009550 con 0x7f517409edb0 2023-10-03T10:18:26.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.105+0000 7f516a7fc700 1 -- 172.21.15.146:0/762815427 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51640038e0 con 0x7f517409edb0 2023-10-03T10:18:26.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.105+0000 7f517c005700 1 -- 172.21.15.146:0/762815427 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5174120da0 con 0x7f517409edb0 2023-10-03T10:18:26.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.105+0000 7f516a7fc700 1 -- 172.21.15.146:0/762815427 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5164021070 con 0x7f517409edb0 2023-10-03T10:18:26.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.106+0000 7f516a7fc700 1 -- 172.21.15.146:0/762815427 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f51640409b0 con 0x7f517409edb0 2023-10-03T10:18:26.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.106+0000 7f517c005700 1 -- 172.21.15.146:0/762815427 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f517409fa30 con 0x7f517409edb0 2023-10-03T10:18:26.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.110+0000 7f516a7fc700 1 -- 172.21.15.146:0/762815427 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5164029020 con 0x7f517409edb0 2023-10-03T10:18:26.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.292+0000 7f517c005700 1 -- 172.21.15.146:0/762815427 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f517404f2a0 con 0x7f517409edb0 2023-10-03T10:18:26.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.293+0000 7f516a7fc700 1 -- 172.21.15.146:0/762815427 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5164032090 con 0x7f517409edb0 2023-10-03T10:18:26.293 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.294+0000 7f517c005700 1 -- 172.21.15.146:0/762815427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f517409edb0 msgr2=0x7f517411f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.294+0000 7f517c005700 1 --2- 172.21.15.146:0/762815427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f517409edb0 0x7f517411f010 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f5164009870 tx=0x7f5164004750 comp rx=0 tx=0).stop 2023-10-03T10:18:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.294+0000 7f517c005700 1 -- 172.21.15.146:0/762815427 shutdown_connections 2023-10-03T10:18:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.294+0000 7f517c005700 1 --2- 172.21.15.146:0/762815427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5174133c20 0x7f517411f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.294+0000 7f517c005700 1 --2- 172.21.15.146:0/762815427 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f517409a150 0x7f517411ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.294+0000 7f517c005700 1 --2- 172.21.15.146:0/762815427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f517409edb0 0x7f517411f010 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.294+0000 7f517c005700 1 -- 172.21.15.146:0/762815427 >> 172.21.15.146:0/762815427 conn(0x7f51740a4430 msgr2=0x7f51740a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.294+0000 7f517c005700 1 -- 172.21.15.146:0/762815427 shutdown_connections 2023-10-03T10:18:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.295+0000 7f517c005700 1 -- 172.21.15.146:0/762815427 wait complete. 2023-10-03T10:18:26.307 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:26.574 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:26.644 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:26.681 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:26.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.701+0000 7f08954d7700 1 Processor -- start 2023-10-03T10:18:26.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.701+0000 7f08954d7700 1 -- start start 2023-10-03T10:18:26.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.701+0000 7f08954d7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08900a1510 0x7f08901351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.701+0000 7f08954d7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f08901356e0 0x7f0890137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.701+0000 7f08954d7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08900a1e70 con 0x7f08900a0a30 2023-10-03T10:18:26.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.701+0000 7f08954d7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f089009a720 con 0x7f08901356e0 2023-10-03T10:18:26.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.701+0000 7f08954d7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089009b300 con 0x7f08900a1510 2023-10-03T10:18:26.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.702+0000 7f088e7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08900a1510 0x7f08901351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.702+0000 7f088e7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08900a1510 0x7f08901351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50262/0 (socket says 172.21.15.146:50262) 2023-10-03T10:18:26.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.702+0000 7f088e7fc700 1 -- 172.21.15.146:0/2495327430 learned_addr learned my addr 172.21.15.146:0/2495327430 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:26.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.702+0000 7f088f7fe700 1 --2- 172.21.15.146:0/2495327430 >> v2:172.21.15.146:3300/0 conn(0x7f08901356e0 0x7f0890137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.702+0000 7f088e7fc700 1 -- 172.21.15.146:0/2495327430 >> v2:172.21.15.146:3300/0 conn(0x7f08901356e0 msgr2=0x7f0890137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.702+0000 7f088e7fc700 1 --2- 172.21.15.146:0/2495327430 >> v2:172.21.15.146:3300/0 conn(0x7f08901356e0 0x7f0890137ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.702+0000 7f088e7fc700 1 -- 172.21.15.146:0/2495327430 >> v1:172.21.15.146:6789/0 conn(0x7f08900a0a30 legacy=0x7f08900a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.702+0000 7f088e7fc700 1 -- 172.21.15.146:0/2495327430 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089009abc0 con 0x7f08900a1510 2023-10-03T10:18:26.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.702+0000 7f088dffb700 1 -- 172.21.15.146:0/2495327430 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574983061 0 0) 0x7f08900a1e70 con 0x7f08900a0a30 2023-10-03T10:18:26.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.702+0000 7f088e7fc700 1 --2- 172.21.15.146:0/2495327430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08900a1510 0x7f08901351a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f08840098f0 tx=0x7f0884009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb2fabe0a0bef14d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.702+0000 7f088dffb700 1 -- 172.21.15.146:0/2495327430 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0884011830 con 0x7f08900a1510 2023-10-03T10:18:26.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.702+0000 7f088dffb700 1 -- 172.21.15.146:0/2495327430 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0884011990 con 0x7f08900a1510 2023-10-03T10:18:26.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.702+0000 7f088dffb700 1 -- 172.21.15.146:0/2495327430 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0884011d20 con 0x7f08900a1510 2023-10-03T10:18:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.703+0000 7f08954d7700 1 -- 172.21.15.146:0/2495327430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08900a1510 msgr2=0x7f08901351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.703+0000 7f08954d7700 1 --2- 172.21.15.146:0/2495327430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08900a1510 0x7f08901351a0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f08840098f0 tx=0x7f0884009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.703+0000 7f08954d7700 1 -- 172.21.15.146:0/2495327430 shutdown_connections 2023-10-03T10:18:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.703+0000 7f08954d7700 1 --2- 172.21.15.146:0/2495327430 >> v2:172.21.15.146:3300/0 conn(0x7f08901356e0 0x7f0890137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.703+0000 7f08954d7700 1 --2- 172.21.15.146:0/2495327430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08900a1510 0x7f08901351a0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.703+0000 7f08954d7700 1 -- 172.21.15.146:0/2495327430 >> 172.21.15.146:0/2495327430 conn(0x7f08900a2980 msgr2=0x7f08900a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.703+0000 7f08954d7700 1 -- 172.21.15.146:0/2495327430 shutdown_connections 2023-10-03T10:18:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.703+0000 7f08954d7700 1 -- 172.21.15.146:0/2495327430 wait complete. 2023-10-03T10:18:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.704+0000 7f08954d7700 1 Processor -- start 2023-10-03T10:18:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.704+0000 7f08954d7700 1 -- start start 2023-10-03T10:18:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.705+0000 7f08954d7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08900a0a30 0x7f089012d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.705+0000 7f08954d7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08900a1510 0x7f08901382a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.705+0000 7f08954d7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08901356e0 0x7f08901387e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.705+0000 7f08954d7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0890135f40 con 0x7f08900a1510 2023-10-03T10:18:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.705+0000 7f08954d7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089006f610 con 0x7f08900a0a30 2023-10-03T10:18:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.705+0000 7f08954d7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f089009ae00 con 0x7f08901356e0 2023-10-03T10:18:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.705+0000 7f088e7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08900a1510 0x7f08901382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.705+0000 7f088e7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08900a1510 0x7f08901382a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37584/0 (socket says 172.21.15.146:37584) 2023-10-03T10:18:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.705+0000 7f088e7fc700 1 -- 172.21.15.146:0/1465467859 learned_addr learned my addr 172.21.15.146:0/1465467859 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.705+0000 7f088f7fe700 1 --2- 172.21.15.146:0/1465467859 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08901356e0 0x7f08901387e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.705+0000 7f088e7fc700 1 -- 172.21.15.146:0/1465467859 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08901356e0 msgr2=0x7f08901387e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.705+0000 7f088e7fc700 1 --2- 172.21.15.146:0/1465467859 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08901356e0 0x7f08901387e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.705+0000 7f088e7fc700 1 -- 172.21.15.146:0/1465467859 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08900a0a30 msgr2=0x7f089012d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.705+0000 7f088e7fc700 1 --2- 172.21.15.146:0/1465467859 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08900a0a30 0x7f089012d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.705+0000 7f088e7fc700 1 -- 172.21.15.146:0/1465467859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0884009550 con 0x7f08900a1510 2023-10-03T10:18:26.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.705+0000 7f088e7fc700 1 --2- 172.21.15.146:0/1465467859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08900a1510 0x7f08901382a0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f0884009c40 tx=0x7f0884004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.705+0000 7f08777fe700 1 -- 172.21.15.146:0/1465467859 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08840045d0 con 0x7f08900a1510 2023-10-03T10:18:26.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.705+0000 7f08777fe700 1 -- 172.21.15.146:0/1465467859 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08840036a0 con 0x7f08900a1510 2023-10-03T10:18:26.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.705+0000 7f08954d7700 1 -- 172.21.15.146:0/1465467859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f089012de30 con 0x7f08900a1510 2023-10-03T10:18:26.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.706+0000 7f08777fe700 1 -- 172.21.15.146:0/1465467859 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0884003a30 con 0x7f08900a1510 2023-10-03T10:18:26.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.706+0000 7f08954d7700 1 -- 172.21.15.146:0/1465467859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08901376c0 con 0x7f08900a1510 2023-10-03T10:18:26.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.707+0000 7f08777fe700 1 -- 172.21.15.146:0/1465467859 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0884021070 con 0x7f08900a1510 2023-10-03T10:18:26.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.707+0000 7f08954d7700 1 -- 172.21.15.146:0/1465467859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f089004f2a0 con 0x7f08900a1510 2023-10-03T10:18:26.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.707+0000 7f08777fe700 1 -- 172.21.15.146:0/1465467859 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0884040be0 con 0x7f08900a1510 2023-10-03T10:18:26.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.711+0000 7f08777fe700 1 -- 172.21.15.146:0/1465467859 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0884019770 con 0x7f08900a1510 2023-10-03T10:18:26.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.775+0000 7f3e9a925700 1 Processor -- start 2023-10-03T10:18:26.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.775+0000 7f3e9a925700 1 -- start start 2023-10-03T10:18:26.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.775+0000 7f3e9a925700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9409ef80 0x7f3e94138e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.775+0000 7f3e9a925700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9409f370 0x7f3e9413b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.775+0000 7f3e9a925700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e9409af80 con 0x7f3e9409a150 2023-10-03T10:18:26.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.775+0000 7f3e9a925700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9409a520 con 0x7f3e9409ef80 2023-10-03T10:18:26.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.775+0000 7f3e9a925700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9409fe00 con 0x7f3e9409f370 2023-10-03T10:18:26.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.775+0000 7f3e93fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3e9409a150 0x7f3e9409e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34382/0 (socket says 172.21.15.146:34382) 2023-10-03T10:18:26.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.775+0000 7f3e93fff700 1 -- 172.21.15.146:0/2924601438 learned_addr learned my addr 172.21.15.146:0/2924601438 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:26.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.775+0000 7f3e937fe700 1 --2- 172.21.15.146:0/2924601438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9409ef80 0x7f3e94138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.775+0000 7f3e98ec2700 1 --2- 172.21.15.146:0/2924601438 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9409f370 0x7f3e9413b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.776+0000 7f3e92ffd700 1 -- 172.21.15.146:0/2924601438 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486551575 0 0) 0x7f3e9409af80 con 0x7f3e9409a150 2023-10-03T10:18:26.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.776+0000 7f3e92ffd700 1 -- 172.21.15.146:0/2924601438 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e7c0035b0 con 0x7f3e9409a150 2023-10-03T10:18:26.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.776+0000 7f3e98ec2700 1 -- 172.21.15.146:0/2924601438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9409ef80 msgr2=0x7f3e94138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.776+0000 7f3e98ec2700 1 --2- 172.21.15.146:0/2924601438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9409ef80 0x7f3e94138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.776+0000 7f3e98ec2700 1 -- 172.21.15.146:0/2924601438 >> v1:172.21.15.146:6789/0 conn(0x7f3e9409a150 legacy=0x7f3e9409e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.776+0000 7f3e98ec2700 1 -- 172.21.15.146:0/2924601438 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9406bc20 con 0x7f3e9409f370 2023-10-03T10:18:26.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.776+0000 7f3e937fe700 1 --2- 172.21.15.146:0/2924601438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9409ef80 0x7f3e94138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.776+0000 7f3e98ec2700 1 --2- 172.21.15.146:0/2924601438 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9409f370 0x7f3e9413b3b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009df0 tx=0x7f3e8c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9426733f8019325d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.776+0000 7f3e92ffd700 1 -- 172.21.15.146:0/2924601438 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c00e070 con 0x7f3e9409f370 2023-10-03T10:18:26.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.776+0000 7f3e92ffd700 1 -- 172.21.15.146:0/2924601438 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8c00bae0 con 0x7f3e9409f370 2023-10-03T10:18:26.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.776+0000 7f3e92ffd700 1 -- 172.21.15.146:0/2924601438 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c00be50 con 0x7f3e9409f370 2023-10-03T10:18:26.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.777+0000 7f3e9a925700 1 -- 172.21.15.146:0/2924601438 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9409f370 msgr2=0x7f3e9413b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.777+0000 7f3e9a925700 1 --2- 172.21.15.146:0/2924601438 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9409f370 0x7f3e9413b3b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009df0 tx=0x7f3e8c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:26.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.777+0000 7f3e9a925700 1 -- 172.21.15.146:0/2924601438 shutdown_connections 2023-10-03T10:18:26.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.777+0000 7f3e9a925700 1 --2- 172.21.15.146:0/2924601438 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9409f370 0x7f3e9413b3b0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.777+0000 7f3e9a925700 1 --2- 172.21.15.146:0/2924601438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9409ef80 0x7f3e94138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.777+0000 7f3e9a925700 1 -- 172.21.15.146:0/2924601438 >> 172.21.15.146:0/2924601438 conn(0x7f3e940a4430 msgr2=0x7f3e940a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.777+0000 7f3e9a925700 1 -- 172.21.15.146:0/2924601438 shutdown_connections 2023-10-03T10:18:26.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.777+0000 7f3e9a925700 1 -- 172.21.15.146:0/2924601438 wait complete. 2023-10-03T10:18:26.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.778+0000 7f3e9a925700 1 Processor -- start 2023-10-03T10:18:26.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.778+0000 7f3e9a925700 1 -- start start 2023-10-03T10:18:26.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.778+0000 7f3e9a925700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9409a150 0x7f3e94123540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.778+0000 7f3e9a925700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9409ef80 0x7f3e94123a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.778+0000 7f3e9a925700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e9409f370 0x7f3e94123fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.778+0000 7f3e9a925700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e94127060 con 0x7f3e9409f370 2023-10-03T10:18:26.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.778+0000 7f3e9a925700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9409b160 con 0x7f3e9409a150 2023-10-03T10:18:26.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.778+0000 7f3e9a925700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e940a0440 con 0x7f3e9409ef80 2023-10-03T10:18:26.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.779+0000 7f3e93fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9409a150 0x7f3e94123540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.779+0000 7f3e93fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9409a150 0x7f3e94123540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50288/0 (socket says 172.21.15.146:50288) 2023-10-03T10:18:26.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.779+0000 7f3e93fff700 1 -- 172.21.15.146:0/1160476436 learned_addr learned my addr 172.21.15.146:0/1160476436 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:26.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.779+0000 7f3e937fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9409ef80 0x7f3e94123a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.779+0000 7f3e98ec2700 1 --2- 172.21.15.146:0/1160476436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e9409f370 0x7f3e94123fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.779+0000 7f3e98ec2700 1 -- 172.21.15.146:0/1160476436 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9409ef80 msgr2=0x7f3e94123a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.779+0000 7f3e98ec2700 1 --2- 172.21.15.146:0/1160476436 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9409ef80 0x7f3e94123a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.779+0000 7f3e98ec2700 1 -- 172.21.15.146:0/1160476436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9409a150 msgr2=0x7f3e94123540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.779+0000 7f3e98ec2700 1 --2- 172.21.15.146:0/1160476436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9409a150 0x7f3e94123540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.779+0000 7f3e98ec2700 1 -- 172.21.15.146:0/1160476436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e880094a0 con 0x7f3e9409f370 2023-10-03T10:18:26.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.779+0000 7f3e937fe700 1 --2- 172.21.15.146:0/1160476436 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9409ef80 0x7f3e94123a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.779+0000 7f3e93fff700 1 --2- 172.21.15.146:0/1160476436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9409a150 0x7f3e94123540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.779+0000 7f3e98ec2700 1 --2- 172.21.15.146:0/1160476436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e9409f370 0x7f3e94123fc0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c016000 tx=0x7f3e8c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.779+0000 7f3e90ff9700 1 -- 172.21.15.146:0/1160476436 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c004800 con 0x7f3e9409f370 2023-10-03T10:18:26.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.779+0000 7f3e90ff9700 1 -- 172.21.15.146:0/1160476436 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8c020070 con 0x7f3e9409f370 2023-10-03T10:18:26.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.779+0000 7f3e9a925700 1 -- 172.21.15.146:0/1160476436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8c009a70 con 0x7f3e9409f370 2023-10-03T10:18:26.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.779+0000 7f3e90ff9700 1 -- 172.21.15.146:0/1160476436 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c0276c0 con 0x7f3e9409f370 2023-10-03T10:18:26.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.779+0000 7f3e9a925700 1 -- 172.21.15.146:0/1160476436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e94126b10 con 0x7f3e9409f370 2023-10-03T10:18:26.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.780+0000 7f3e90ff9700 1 -- 172.21.15.146:0/1160476436 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e8c012430 con 0x7f3e9409f370 2023-10-03T10:18:26.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.780+0000 7f3e9a925700 1 -- 172.21.15.146:0/1160476436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e9409fa30 con 0x7f3e9409f370 2023-10-03T10:18:26.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.780+0000 7f3e90ff9700 1 -- 172.21.15.146:0/1160476436 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3e8c022070 con 0x7f3e9409f370 2023-10-03T10:18:26.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.785+0000 7f3e90ff9700 1 -- 172.21.15.146:0/1160476436 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e8c012e40 con 0x7f3e9409f370 2023-10-03T10:18:26.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.815+0000 7f23da9fa700 1 Processor -- start 2023-10-03T10:18:26.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.815+0000 7f23da9fa700 1 -- start start 2023-10-03T10:18:26.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.816+0000 7f23da9fa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d4133ad0 0x7f23d4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.816+0000 7f23da9fa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d4130bc0 0x7f23d413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.816+0000 7f23da9fa700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d406b2d0 con 0x7f23d41300a0 2023-10-03T10:18:26.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.816+0000 7f23da9fa700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d4133610 con 0x7f23d4133ad0 2023-10-03T10:18:26.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.816+0000 7f23da9fa700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23d409a500 con 0x7f23d4130bc0 2023-10-03T10:18:26.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.816+0000 7f23d3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d4133ad0 0x7f23d4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.816+0000 7f23d8f97700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d4130bc0 0x7f23d413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.816+0000 7f23d3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d4133ad0 0x7f23d4133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50290/0 (socket says 172.21.15.146:50290) 2023-10-03T10:18:26.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.816+0000 7f23d8f97700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d4130bc0 0x7f23d413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53986/0 (socket says 172.21.15.146:53986) 2023-10-03T10:18:26.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.816+0000 7f23d3fff700 1 -- 172.21.15.146:0/1859721747 learned_addr learned my addr 172.21.15.146:0/1859721747 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:26.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.817+0000 7f23d8f97700 1 -- 172.21.15.146:0/1859721747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d4133ad0 msgr2=0x7f23d4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.817+0000 7f23d8f97700 1 --2- 172.21.15.146:0/1859721747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d4133ad0 0x7f23d4133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.817+0000 7f23d8f97700 1 -- 172.21.15.146:0/1859721747 >> v1:172.21.15.146:6789/0 conn(0x7f23d41300a0 legacy=0x7f23d41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.817+0000 7f23d8f97700 1 -- 172.21.15.146:0/1859721747 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d41338b0 con 0x7f23d4130bc0 2023-10-03T10:18:26.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.817+0000 7f23d8f97700 1 --2- 172.21.15.146:0/1859721747 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d4130bc0 0x7f23d413b990 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009dc0 tx=0x7f23cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fd6efcd30d8e2cf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.817+0000 7f23d2ffd700 1 -- 172.21.15.146:0/1859721747 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc00e070 con 0x7f23d4130bc0 2023-10-03T10:18:26.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.817+0000 7f23d2ffd700 1 -- 172.21.15.146:0/1859721747 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc003a20 con 0x7f23d4130bc0 2023-10-03T10:18:26.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.817+0000 7f23d2ffd700 1 -- 172.21.15.146:0/1859721747 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc003dd0 con 0x7f23d4130bc0 2023-10-03T10:18:26.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.818+0000 7f23da9fa700 1 -- 172.21.15.146:0/1859721747 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d4130bc0 msgr2=0x7f23d413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.818+0000 7f23da9fa700 1 --2- 172.21.15.146:0/1859721747 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d4130bc0 0x7f23d413b990 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009dc0 tx=0x7f23cc00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:26.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.818+0000 7f23da9fa700 1 -- 172.21.15.146:0/1859721747 shutdown_connections 2023-10-03T10:18:26.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.818+0000 7f23da9fa700 1 --2- 172.21.15.146:0/1859721747 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d4130bc0 0x7f23d413b990 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.818+0000 7f23da9fa700 1 --2- 172.21.15.146:0/1859721747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d4133ad0 0x7f23d4133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.818+0000 7f23da9fa700 1 -- 172.21.15.146:0/1859721747 >> 172.21.15.146:0/1859721747 conn(0x7f23d4099c40 msgr2=0x7f23d40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.818+0000 7f23da9fa700 1 -- 172.21.15.146:0/1859721747 shutdown_connections 2023-10-03T10:18:26.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.818+0000 7f23da9fa700 1 -- 172.21.15.146:0/1859721747 wait complete. 2023-10-03T10:18:26.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.819+0000 7f23da9fa700 1 Processor -- start 2023-10-03T10:18:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.819+0000 7f23da9fa700 1 -- start start 2023-10-03T10:18:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.819+0000 7f23da9fa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d41300a0 0x7f23d411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.819+0000 7f23da9fa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d4130bc0 0x7f23d411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.819+0000 7f23da9fa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d4133ad0 0x7f23d411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.819+0000 7f23da9fa700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d4120100 con 0x7f23d4130bc0 2023-10-03T10:18:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.819+0000 7f23da9fa700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d4072420 con 0x7f23d4133ad0 2023-10-03T10:18:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.819+0000 7f23da9fa700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23d4120300 con 0x7f23d41300a0 2023-10-03T10:18:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.819+0000 7f23d3fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d41300a0 0x7f23d411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.819+0000 7f23d3fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d41300a0 0x7f23d411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53990/0 (socket says 172.21.15.146:53990) 2023-10-03T10:18:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.819+0000 7f23d3fff700 1 -- 172.21.15.146:0/2746614088 learned_addr learned my addr 172.21.15.146:0/2746614088 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.819+0000 7f23d37fe700 1 --2- 172.21.15.146:0/2746614088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d4130bc0 0x7f23d411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.820+0000 7f23d8f97700 1 --2- 172.21.15.146:0/2746614088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d4133ad0 0x7f23d411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.820+0000 7f23d37fe700 1 -- 172.21.15.146:0/2746614088 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d41300a0 msgr2=0x7f23d411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.820+0000 7f23d37fe700 1 --2- 172.21.15.146:0/2746614088 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d41300a0 0x7f23d411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.820+0000 7f23d37fe700 1 -- 172.21.15.146:0/2746614088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d4133ad0 msgr2=0x7f23d411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.820+0000 7f23d37fe700 1 --2- 172.21.15.146:0/2746614088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d4133ad0 0x7f23d411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.820+0000 7f23d37fe700 1 -- 172.21.15.146:0/2746614088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc009a70 con 0x7f23d4130bc0 2023-10-03T10:18:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.820+0000 7f23d3fff700 1 --2- 172.21.15.146:0/2746614088 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d41300a0 0x7f23d411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.820+0000 7f23d37fe700 1 --2- 172.21.15.146:0/2746614088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d4130bc0 0x7f23d411df80 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f23d409ea20 tx=0x7f23c800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.820+0000 7f23d0ff9700 1 -- 172.21.15.146:0/2746614088 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c80054e0 con 0x7f23d4130bc0 2023-10-03T10:18:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.820+0000 7f23d0ff9700 1 -- 172.21.15.146:0/2746614088 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c8003680 con 0x7f23d4130bc0 2023-10-03T10:18:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.820+0000 7f23d0ff9700 1 -- 172.21.15.146:0/2746614088 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c80039f0 con 0x7f23d4130bc0 2023-10-03T10:18:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.820+0000 7f23da9fa700 1 -- 172.21.15.146:0/2746614088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d411f9a0 con 0x7f23d4130bc0 2023-10-03T10:18:26.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.820+0000 7f23da9fa700 1 -- 172.21.15.146:0/2746614088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d411fd60 con 0x7f23d4130bc0 2023-10-03T10:18:26.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.821+0000 7f23d0ff9700 1 -- 172.21.15.146:0/2746614088 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23c8003b50 con 0x7f23d4130bc0 2023-10-03T10:18:26.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.821+0000 7f23d0ff9700 1 -- 172.21.15.146:0/2746614088 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f23c803ea50 con 0x7f23d4130bc0 2023-10-03T10:18:26.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.821+0000 7f23da9fa700 1 -- 172.21.15.146:0/2746614088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d411ff50 con 0x7f23d4130bc0 2023-10-03T10:18:26.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.830+0000 7f23d0ff9700 1 -- 172.21.15.146:0/2746614088 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23c801b3b0 con 0x7f23d4130bc0 2023-10-03T10:18:26.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.913+0000 7f08954d7700 1 -- 172.21.15.146:0/1465467859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f089006bce0 con 0x7f08900a1510 2023-10-03T10:18:26.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.913+0000 7f08777fe700 1 -- 172.21.15.146:0/1465467859 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0884015020 con 0x7f08900a1510 2023-10-03T10:18:26.914 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:26.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.915+0000 7f08954d7700 1 -- 172.21.15.146:0/1465467859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08900a1510 msgr2=0x7f08901382a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.915+0000 7f08954d7700 1 --2- 172.21.15.146:0/1465467859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08900a1510 0x7f08901382a0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f0884009c40 tx=0x7f0884004750 comp rx=0 tx=0).stop 2023-10-03T10:18:26.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.915+0000 7f08954d7700 1 -- 172.21.15.146:0/1465467859 shutdown_connections 2023-10-03T10:18:26.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.915+0000 7f08954d7700 1 --2- 172.21.15.146:0/1465467859 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f08901356e0 0x7f08901387e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.915+0000 7f08954d7700 1 --2- 172.21.15.146:0/1465467859 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08900a0a30 0x7f089012d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.915+0000 7f08954d7700 1 --2- 172.21.15.146:0/1465467859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08900a1510 0x7f08901382a0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.915+0000 7f08954d7700 1 -- 172.21.15.146:0/1465467859 >> 172.21.15.146:0/1465467859 conn(0x7f08900a2980 msgr2=0x7f0890070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.915+0000 7f08954d7700 1 -- 172.21.15.146:0/1465467859 shutdown_connections 2023-10-03T10:18:26.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.915+0000 7f08954d7700 1 -- 172.21.15.146:0/1465467859 wait complete. 2023-10-03T10:18:26.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:26.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.984+0000 7f3e9a925700 1 -- 172.21.15.146:0/1160476436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3e941278b0 con 0x7f3e9409f370 2023-10-03T10:18:26.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.984+0000 7f3e90ff9700 1 -- 172.21.15.146:0/1160476436 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3e8c01a380 con 0x7f3e9409f370 2023-10-03T10:18:26.985 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.987+0000 7f3e9a925700 1 -- 172.21.15.146:0/1160476436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e9409f370 msgr2=0x7f3e94123fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.987+0000 7f3e9a925700 1 --2- 172.21.15.146:0/1160476436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e9409f370 0x7f3e94123fc0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c016000 tx=0x7f3e8c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.987+0000 7f3e9a925700 1 -- 172.21.15.146:0/1160476436 shutdown_connections 2023-10-03T10:18:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.987+0000 7f3e9a925700 1 --2- 172.21.15.146:0/1160476436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e9409f370 0x7f3e94123fc0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.987+0000 7f3e9a925700 1 --2- 172.21.15.146:0/1160476436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3e9409a150 0x7f3e94123540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.987+0000 7f3e9a925700 1 --2- 172.21.15.146:0/1160476436 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3e9409ef80 0x7f3e94123a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.987+0000 7f3e9a925700 1 -- 172.21.15.146:0/1160476436 >> 172.21.15.146:0/1160476436 conn(0x7f3e940a4430 msgr2=0x7f3e9409d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.987+0000 7f3e9a925700 1 -- 172.21.15.146:0/1160476436 shutdown_connections 2023-10-03T10:18:26.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:26.987+0000 7f3e9a925700 1 -- 172.21.15.146:0/1160476436 wait complete. 2023-10-03T10:18:26.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:27.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.027+0000 7f23da9fa700 1 -- 172.21.15.146:0/2746614088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f23d406aca0 con 0x7f23d4130bc0 2023-10-03T10:18:27.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.027+0000 7f23d0ff9700 1 -- 172.21.15.146:0/2746614088 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23c8017020 con 0x7f23d4130bc0 2023-10-03T10:18:27.028 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:27.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.029+0000 7f23da9fa700 1 -- 172.21.15.146:0/2746614088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d4130bc0 msgr2=0x7f23d411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.029+0000 7f23da9fa700 1 --2- 172.21.15.146:0/2746614088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d4130bc0 0x7f23d411df80 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f23d409ea20 tx=0x7f23c800c800 comp rx=0 tx=0).stop 2023-10-03T10:18:27.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.029+0000 7f23da9fa700 1 -- 172.21.15.146:0/2746614088 shutdown_connections 2023-10-03T10:18:27.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.029+0000 7f23da9fa700 1 --2- 172.21.15.146:0/2746614088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23d4133ad0 0x7f23d411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.029+0000 7f23da9fa700 1 --2- 172.21.15.146:0/2746614088 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f23d41300a0 0x7f23d411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.029+0000 7f23da9fa700 1 --2- 172.21.15.146:0/2746614088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23d4130bc0 0x7f23d411df80 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.029+0000 7f23da9fa700 1 -- 172.21.15.146:0/2746614088 >> 172.21.15.146:0/2746614088 conn(0x7f23d4099c40 msgr2=0x7f23d409e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.029+0000 7f23da9fa700 1 -- 172.21.15.146:0/2746614088 shutdown_connections 2023-10-03T10:18:27.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.029+0000 7f23da9fa700 1 -- 172.21.15.146:0/2746614088 wait complete. 2023-10-03T10:18:27.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:27.309 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:27.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.431+0000 7f0426b87700 1 Processor -- start 2023-10-03T10:18:27.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.431+0000 7f0426b87700 1 -- start start 2023-10-03T10:18:27.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.432+0000 7f0426b87700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0420136960 0x7f0420138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.432+0000 7f0426b87700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0420139280 0x7f042013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.432+0000 7f0426b87700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f042006b2d0 con 0x7f0420133ad0 2023-10-03T10:18:27.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.432+0000 7f0426b87700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04201345b0 con 0x7f0420136960 2023-10-03T10:18:27.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.432+0000 7f0426b87700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0420133610 con 0x7f0420139280 2023-10-03T10:18:27.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.432+0000 7f041ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0420136960 0x7f0420138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.432+0000 7f0425124700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0420139280 0x7f042013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.432+0000 7f0424923700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0420133ad0 0x7f0420133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34408/0 (socket says 172.21.15.146:34408) 2023-10-03T10:18:27.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.432+0000 7f0424923700 1 -- 172.21.15.146:0/2445407357 learned_addr learned my addr 172.21.15.146:0/2445407357 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:27.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.432+0000 7f041ffff700 1 -- 172.21.15.146:0/2445407357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0420139280 msgr2=0x7f042013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:27.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.432+0000 7f041ffff700 1 --2- 172.21.15.146:0/2445407357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0420139280 0x7f042013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.432+0000 7f041ffff700 1 -- 172.21.15.146:0/2445407357 >> v1:172.21.15.146:6789/0 conn(0x7f0420133ad0 legacy=0x7f0420133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.432+0000 7f041ffff700 1 -- 172.21.15.146:0/2445407357 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042009a500 con 0x7f0420136960 2023-10-03T10:18:27.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.432+0000 7f041f7fe700 1 -- 172.21.15.146:0/2445407357 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146550410 0 0) 0x7f042006b2d0 con 0x7f0420133ad0 2023-10-03T10:18:27.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.432+0000 7f0425124700 1 --2- 172.21.15.146:0/2445407357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0420139280 0x7f042013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.432+0000 7f041ffff700 1 --2- 172.21.15.146:0/2445407357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0420136960 0x7f0420138d40 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f040c009840 tx=0x7f040c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=746ad7d45355e096 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.432+0000 7f041f7fe700 1 -- 172.21.15.146:0/2445407357 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c011830 con 0x7f0420136960 2023-10-03T10:18:27.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.432+0000 7f041f7fe700 1 -- 172.21.15.146:0/2445407357 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c011990 con 0x7f0420136960 2023-10-03T10:18:27.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.432+0000 7f041f7fe700 1 -- 172.21.15.146:0/2445407357 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c011d20 con 0x7f0420136960 2023-10-03T10:18:27.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.433+0000 7f0426b87700 1 -- 172.21.15.146:0/2445407357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0420136960 msgr2=0x7f0420138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.433+0000 7f0426b87700 1 --2- 172.21.15.146:0/2445407357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0420136960 0x7f0420138d40 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f040c009840 tx=0x7f040c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.433+0000 7f0426b87700 1 -- 172.21.15.146:0/2445407357 shutdown_connections 2023-10-03T10:18:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.433+0000 7f0426b87700 1 --2- 172.21.15.146:0/2445407357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0420139280 0x7f042013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.433+0000 7f0426b87700 1 --2- 172.21.15.146:0/2445407357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0420136960 0x7f0420138d40 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.433+0000 7f0426b87700 1 -- 172.21.15.146:0/2445407357 >> 172.21.15.146:0/2445407357 conn(0x7f0420099c40 msgr2=0x7f04200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.433+0000 7f0426b87700 1 -- 172.21.15.146:0/2445407357 shutdown_connections 2023-10-03T10:18:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.433+0000 7f0426b87700 1 -- 172.21.15.146:0/2445407357 wait complete. 2023-10-03T10:18:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.434+0000 7f0426b87700 1 Processor -- start 2023-10-03T10:18:27.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.434+0000 7f0426b87700 1 -- start start 2023-10-03T10:18:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.434+0000 7f0426b87700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0420133ad0 0x7f0420071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.434+0000 7f0426b87700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0420136960 0x7f0420071690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.434+0000 7f0426b87700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0420139280 0x7f0420071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.435+0000 7f0426b87700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042006ec30 con 0x7f0420136960 2023-10-03T10:18:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.435+0000 7f0426b87700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0420072200 con 0x7f0420139280 2023-10-03T10:18:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.435+0000 7f0426b87700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04201317a0 con 0x7f0420133ad0 2023-10-03T10:18:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.435+0000 7f0424923700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0420133ad0 0x7f0420071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.435+0000 7f041ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0420136960 0x7f0420071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.435+0000 7f0424923700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0420133ad0 0x7f0420071150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53994/0 (socket says 172.21.15.146:53994) 2023-10-03T10:18:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.435+0000 7f041ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0420136960 0x7f0420071690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37616/0 (socket says 172.21.15.146:37616) 2023-10-03T10:18:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.435+0000 7f0424923700 1 -- 172.21.15.146:0/2900085854 learned_addr learned my addr 172.21.15.146:0/2900085854 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.435+0000 7f0425124700 1 --2- 172.21.15.146:0/2900085854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0420139280 0x7f0420071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.435+0000 7f041ffff700 1 -- 172.21.15.146:0/2900085854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0420133ad0 msgr2=0x7f0420071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.435+0000 7f041ffff700 1 --2- 172.21.15.146:0/2900085854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0420133ad0 0x7f0420071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.435+0000 7f041ffff700 1 -- 172.21.15.146:0/2900085854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0420139280 msgr2=0x7f0420071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.435+0000 7f041ffff700 1 --2- 172.21.15.146:0/2900085854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0420139280 0x7f0420071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.435+0000 7f041ffff700 1 -- 172.21.15.146:0/2900085854 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0418009a70 con 0x7f0420136960 2023-10-03T10:18:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.435+0000 7f0425124700 1 --2- 172.21.15.146:0/2900085854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0420139280 0x7f0420071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.435+0000 7f041ffff700 1 --2- 172.21.15.146:0/2900085854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0420136960 0x7f0420071690 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f040c016000 tx=0x7f040c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.435+0000 7f041d7fa700 1 -- 172.21.15.146:0/2900085854 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c004480 con 0x7f0420136960 2023-10-03T10:18:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.435+0000 7f041d7fa700 1 -- 172.21.15.146:0/2900085854 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c01f070 con 0x7f0420136960 2023-10-03T10:18:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.435+0000 7f0426b87700 1 -- 172.21.15.146:0/2900085854 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040c0094a0 con 0x7f0420136960 2023-10-03T10:18:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.435+0000 7f041d7fa700 1 -- 172.21.15.146:0/2900085854 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0038a0 con 0x7f0420136960 2023-10-03T10:18:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.435+0000 7f0426b87700 1 -- 172.21.15.146:0/2900085854 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f042006ee50 con 0x7f0420136960 2023-10-03T10:18:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.436+0000 7f041d7fa700 1 -- 172.21.15.146:0/2900085854 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f040c021030 con 0x7f0420136960 2023-10-03T10:18:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.436+0000 7f041d7fa700 1 -- 172.21.15.146:0/2900085854 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f040c040950 con 0x7f0420136960 2023-10-03T10:18:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.436+0000 7f0426b87700 1 -- 172.21.15.146:0/2900085854 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f042004f2a0 con 0x7f0420136960 2023-10-03T10:18:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.441+0000 7f041d7fa700 1 -- 172.21.15.146:0/2900085854 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f040c003a00 con 0x7f0420136960 2023-10-03T10:18:27.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.627+0000 7f0426b87700 1 -- 172.21.15.146:0/2900085854 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f042009f0f0 con 0x7f0420136960 2023-10-03T10:18:27.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.628+0000 7f041d7fa700 1 -- 172.21.15.146:0/2900085854 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f040c015020 con 0x7f0420136960 2023-10-03T10:18:27.629 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:27.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.630+0000 7f0426b87700 1 -- 172.21.15.146:0/2900085854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0420136960 msgr2=0x7f0420071690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.630+0000 7f0426b87700 1 --2- 172.21.15.146:0/2900085854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0420136960 0x7f0420071690 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f040c016000 tx=0x7f040c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:27.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.630+0000 7f0426b87700 1 -- 172.21.15.146:0/2900085854 shutdown_connections 2023-10-03T10:18:27.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.630+0000 7f0426b87700 1 --2- 172.21.15.146:0/2900085854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0420139280 0x7f0420071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.630+0000 7f0426b87700 1 --2- 172.21.15.146:0/2900085854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0420133ad0 0x7f0420071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.630+0000 7f0426b87700 1 --2- 172.21.15.146:0/2900085854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0420136960 0x7f0420071690 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.630+0000 7f0426b87700 1 -- 172.21.15.146:0/2900085854 >> 172.21.15.146:0/2900085854 conn(0x7f0420099c40 msgr2=0x7f04200a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.630+0000 7f0426b87700 1 -- 172.21.15.146:0/2900085854 shutdown_connections 2023-10-03T10:18:27.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:27.630+0000 7f0426b87700 1 -- 172.21.15.146:0/2900085854 wait complete. 2023-10-03T10:18:27.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:27.929 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:28.000 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:28.043 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:28.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.056+0000 7fa04afa1700 1 Processor -- start 2023-10-03T10:18:28.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.056+0000 7fa04afa1700 1 -- start start 2023-10-03T10:18:28.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.057+0000 7fa04afa1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa044133b80 0x7fa044133f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.057+0000 7fa04afa1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa044099a60 0x7fa0440a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.057+0000 7fa04afa1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04409aa00 con 0x7fa0440a0e20 2023-10-03T10:18:28.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.057+0000 7fa04afa1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04409a080 con 0x7fa044133b80 2023-10-03T10:18:28.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.057+0000 7fa04afa1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa044133750 con 0x7fa044099a60 2023-10-03T10:18:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.057+0000 7fa048d3d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa044133b80 0x7fa044133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.057+0000 7fa04953e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa0440a0e20 0x7fa04413a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34410/0 (socket says 172.21.15.146:34410) 2023-10-03T10:18:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.057+0000 7fa04953e700 1 -- 172.21.15.146:0/1214955651 learned_addr learned my addr 172.21.15.146:0/1214955651 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.057+0000 7fa043fff700 1 --2- 172.21.15.146:0/1214955651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa044099a60 0x7fa0440a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.057+0000 7fa043fff700 1 -- 172.21.15.146:0/1214955651 >> v2:172.21.15.146:3300/0 conn(0x7fa044133b80 msgr2=0x7fa044133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.057+0000 7fa043fff700 1 --2- 172.21.15.146:0/1214955651 >> v2:172.21.15.146:3300/0 conn(0x7fa044133b80 0x7fa044133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.057+0000 7fa043fff700 1 -- 172.21.15.146:0/1214955651 >> v1:172.21.15.146:6789/0 conn(0x7fa0440a0e20 legacy=0x7fa04413a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.057+0000 7fa043fff700 1 -- 172.21.15.146:0/1214955651 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04409a760 con 0x7fa044099a60 2023-10-03T10:18:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.057+0000 7fa0437fe700 1 -- 172.21.15.146:0/1214955651 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290326231 0 0) 0x7fa04409aa00 con 0x7fa0440a0e20 2023-10-03T10:18:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.057+0000 7fa048d3d700 1 --2- 172.21.15.146:0/1214955651 >> v2:172.21.15.146:3300/0 conn(0x7fa044133b80 0x7fa044133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.057+0000 7fa043fff700 1 --2- 172.21.15.146:0/1214955651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa044099a60 0x7fa0440a08e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa030009840 tx=0x7fa030009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc2a4a18c827a88d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:28.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.057+0000 7fa0437fe700 1 -- 172.21.15.146:0/1214955651 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa030011830 con 0x7fa044099a60 2023-10-03T10:18:28.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.058+0000 7fa0437fe700 1 -- 172.21.15.146:0/1214955651 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa030011990 con 0x7fa044099a60 2023-10-03T10:18:28.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.058+0000 7fa0437fe700 1 -- 172.21.15.146:0/1214955651 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa030011d20 con 0x7fa044099a60 2023-10-03T10:18:28.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.058+0000 7fa04afa1700 1 -- 172.21.15.146:0/1214955651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa044099a60 msgr2=0x7fa0440a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.058+0000 7fa04afa1700 1 --2- 172.21.15.146:0/1214955651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa044099a60 0x7fa0440a08e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa030009840 tx=0x7fa030009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:28.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.058+0000 7fa04afa1700 1 -- 172.21.15.146:0/1214955651 shutdown_connections 2023-10-03T10:18:28.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.058+0000 7fa04afa1700 1 --2- 172.21.15.146:0/1214955651 >> v2:172.21.15.146:3300/0 conn(0x7fa044133b80 0x7fa044133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.058+0000 7fa04afa1700 1 --2- 172.21.15.146:0/1214955651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa044099a60 0x7fa0440a08e0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.058+0000 7fa04afa1700 1 -- 172.21.15.146:0/1214955651 >> 172.21.15.146:0/1214955651 conn(0x7fa0440a2980 msgr2=0x7fa0440a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.058+0000 7fa04afa1700 1 -- 172.21.15.146:0/1214955651 shutdown_connections 2023-10-03T10:18:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.058+0000 7fa04afa1700 1 -- 172.21.15.146:0/1214955651 wait complete. 2023-10-03T10:18:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.059+0000 7fa04afa1700 1 Processor -- start 2023-10-03T10:18:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.059+0000 7fa04afa1700 1 -- start start 2023-10-03T10:18:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.060+0000 7fa04afa1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa044099a60 0x7fa04411a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.060+0000 7fa04afa1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0440a0e20 0x7fa04411aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.060+0000 7fa04afa1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa044133b80 0x7fa04411b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.060+0000 7fa04afa1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04411ded0 con 0x7fa0440a0e20 2023-10-03T10:18:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.060+0000 7fa04afa1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04411cfc0 con 0x7fa044099a60 2023-10-03T10:18:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.060+0000 7fa04afa1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0440a3090 con 0x7fa044133b80 2023-10-03T10:18:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.060+0000 7fa043fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0440a0e20 0x7fa04411aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.060+0000 7fa048d3d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa044099a60 0x7fa04411a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.060+0000 7fa043fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0440a0e20 0x7fa04411aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37640/0 (socket says 172.21.15.146:37640) 2023-10-03T10:18:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.060+0000 7fa043fff700 1 -- 172.21.15.146:0/1701776674 learned_addr learned my addr 172.21.15.146:0/1701776674 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.060+0000 7fa048d3d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa044099a60 0x7fa04411a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50322/0 (socket says 172.21.15.146:50322) 2023-10-03T10:18:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.060+0000 7fa04953e700 1 --2- 172.21.15.146:0/1701776674 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa044133b80 0x7fa04411b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.060+0000 7fa043fff700 1 -- 172.21.15.146:0/1701776674 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa044133b80 msgr2=0x7fa04411b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.060+0000 7fa043fff700 1 --2- 172.21.15.146:0/1701776674 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa044133b80 0x7fa04411b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.060+0000 7fa043fff700 1 -- 172.21.15.146:0/1701776674 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa044099a60 msgr2=0x7fa04411a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.060+0000 7fa043fff700 1 --2- 172.21.15.146:0/1701776674 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa044099a60 0x7fa04411a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.060+0000 7fa043fff700 1 -- 172.21.15.146:0/1701776674 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa038009430 con 0x7fa0440a0e20 2023-10-03T10:18:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.061+0000 7fa043fff700 1 --2- 172.21.15.146:0/1701776674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0440a0e20 0x7fa04411aaf0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fa030009fd0 tx=0x7fa030004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:28.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.061+0000 7fa0417fa700 1 -- 172.21.15.146:0/1701776674 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa030004550 con 0x7fa0440a0e20 2023-10-03T10:18:28.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.061+0000 7fa0417fa700 1 -- 172.21.15.146:0/1701776674 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03001f070 con 0x7fa0440a0e20 2023-10-03T10:18:28.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.061+0000 7fa04afa1700 1 -- 172.21.15.146:0/1701776674 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0300094a0 con 0x7fa0440a0e20 2023-10-03T10:18:28.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.061+0000 7fa0417fa700 1 -- 172.21.15.146:0/1701776674 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0300038e0 con 0x7fa0440a0e20 2023-10-03T10:18:28.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.061+0000 7fa04afa1700 1 -- 172.21.15.146:0/1701776674 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04409a310 con 0x7fa0440a0e20 2023-10-03T10:18:28.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.062+0000 7fa04afa1700 1 -- 172.21.15.146:0/1701776674 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04409e9b0 con 0x7fa0440a0e20 2023-10-03T10:18:28.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.062+0000 7fa0417fa700 1 -- 172.21.15.146:0/1701776674 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa030003a40 con 0x7fa0440a0e20 2023-10-03T10:18:28.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.062+0000 7fa0417fa700 1 -- 172.21.15.146:0/1701776674 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa030021070 con 0x7fa0440a0e20 2023-10-03T10:18:28.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.068+0000 7fa0417fa700 1 -- 172.21.15.146:0/1701776674 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa0300193b0 con 0x7fa0440a0e20 2023-10-03T10:18:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.128+0000 7f1189fb3700 1 Processor -- start 2023-10-03T10:18:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.128+0000 7f1189fb3700 1 -- start start 2023-10-03T10:18:28.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.129+0000 7f1189fb3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f118409e870 0x7f118409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.129+0000 7f1189fb3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1184131f40 0x7f1184139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.129+0000 7f1189fb3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118409c970 con 0x7f118409f180 2023-10-03T10:18:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.129+0000 7f1189fb3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11840a0920 con 0x7f1184131f40 2023-10-03T10:18:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.129+0000 7f1189fb3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f118409f9c0 con 0x7f118409e870 2023-10-03T10:18:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.129+0000 7f11837fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f118409e870 0x7f118409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.129+0000 7f1182ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f118409f180 0x7f1184131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34412/0 (socket says 172.21.15.146:34412) 2023-10-03T10:18:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.129+0000 7f1182ffd700 1 -- 172.21.15.146:0/1163575744 learned_addr learned my addr 172.21.15.146:0/1163575744 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.129+0000 7f1183fff700 1 --2- 172.21.15.146:0/1163575744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1184131f40 0x7f1184139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.130+0000 7f11827fc700 1 -- 172.21.15.146:0/1163575744 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717381098 0 0) 0x7f118409c970 con 0x7f118409f180 2023-10-03T10:18:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.130+0000 7f11837fe700 1 -- 172.21.15.146:0/1163575744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1184131f40 msgr2=0x7f1184139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.130+0000 7f11837fe700 1 --2- 172.21.15.146:0/1163575744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1184131f40 0x7f1184139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.130+0000 7f11837fe700 1 -- 172.21.15.146:0/1163575744 >> v1:172.21.15.146:6789/0 conn(0x7f118409f180 legacy=0x7f1184131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.130+0000 7f11837fe700 1 -- 172.21.15.146:0/1163575744 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118409bab0 con 0x7f118409e870 2023-10-03T10:18:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.130+0000 7f11837fe700 1 --2- 172.21.15.146:0/1163575744 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f118409e870 0x7f118409ec40 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1174009870 tx=0x7f1174009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=daa7da09991b95ab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.130+0000 7f11827fc700 1 -- 172.21.15.146:0/1163575744 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174011830 con 0x7f118409e870 2023-10-03T10:18:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.130+0000 7f11827fc700 1 -- 172.21.15.146:0/1163575744 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1174011990 con 0x7f118409e870 2023-10-03T10:18:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.130+0000 7f11827fc700 1 -- 172.21.15.146:0/1163575744 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174011d20 con 0x7f118409e870 2023-10-03T10:18:28.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.131+0000 7f1189fb3700 1 -- 172.21.15.146:0/1163575744 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f118409e870 msgr2=0x7f118409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.131+0000 7f1189fb3700 1 --2- 172.21.15.146:0/1163575744 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f118409e870 0x7f118409ec40 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1174009870 tx=0x7f1174009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:28.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.131+0000 7f1189fb3700 1 -- 172.21.15.146:0/1163575744 shutdown_connections 2023-10-03T10:18:28.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.131+0000 7f1189fb3700 1 --2- 172.21.15.146:0/1163575744 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1184131f40 0x7f1184139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.131+0000 7f1189fb3700 1 --2- 172.21.15.146:0/1163575744 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f118409e870 0x7f118409ec40 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.131+0000 7f1189fb3700 1 -- 172.21.15.146:0/1163575744 >> 172.21.15.146:0/1163575744 conn(0x7f11840a4430 msgr2=0x7f11840a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.131+0000 7f1189fb3700 1 -- 172.21.15.146:0/1163575744 shutdown_connections 2023-10-03T10:18:28.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.131+0000 7f1189fb3700 1 -- 172.21.15.146:0/1163575744 wait complete. 2023-10-03T10:18:28.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.132+0000 7f1189fb3700 1 Processor -- start 2023-10-03T10:18:28.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.132+0000 7f1189fb3700 1 -- start start 2023-10-03T10:18:28.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.132+0000 7f1189fb3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118409e870 0x7f118411ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.132+0000 7f1189fb3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f118409f180 0x7f118411e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.132+0000 7f1189fb3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1184131f40 0x7f118411e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.132+0000 7f1189fb3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11841223b0 con 0x7f118409e870 2023-10-03T10:18:28.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.132+0000 7f1189fb3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11841219f0 con 0x7f118409f180 2023-10-03T10:18:28.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.132+0000 7f1189fb3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1184120d30 con 0x7f1184131f40 2023-10-03T10:18:28.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.132+0000 7f11837fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118409e870 0x7f118411ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.132+0000 7f11837fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118409e870 0x7f118411ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37646/0 (socket says 172.21.15.146:37646) 2023-10-03T10:18:28.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.132+0000 7f11837fe700 1 -- 172.21.15.146:0/831918588 learned_addr learned my addr 172.21.15.146:0/831918588 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:28.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.132+0000 7f1183fff700 1 --2- 172.21.15.146:0/831918588 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1184131f40 0x7f118411e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.132+0000 7f1182ffd700 1 --2- 172.21.15.146:0/831918588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f118409f180 0x7f118411e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.133+0000 7f11837fe700 1 -- 172.21.15.146:0/831918588 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1184131f40 msgr2=0x7f118411e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.133+0000 7f11837fe700 1 --2- 172.21.15.146:0/831918588 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1184131f40 0x7f118411e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.133+0000 7f11837fe700 1 -- 172.21.15.146:0/831918588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f118409f180 msgr2=0x7f118411e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.133+0000 7f11837fe700 1 --2- 172.21.15.146:0/831918588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f118409f180 0x7f118411e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.133+0000 7f11837fe700 1 -- 172.21.15.146:0/831918588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11740094a0 con 0x7f118409e870 2023-10-03T10:18:28.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.133+0000 7f11837fe700 1 --2- 172.21.15.146:0/831918588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118409e870 0x7f118411ded0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f1174009840 tx=0x7f1174004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:28.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.133+0000 7f116bfff700 1 -- 172.21.15.146:0/831918588 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174004550 con 0x7f118409e870 2023-10-03T10:18:28.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.133+0000 7f116bfff700 1 -- 172.21.15.146:0/831918588 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117401e070 con 0x7f118409e870 2023-10-03T10:18:28.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.133+0000 7f116bfff700 1 -- 172.21.15.146:0/831918588 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11740038e0 con 0x7f118409e870 2023-10-03T10:18:28.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.133+0000 7f1189fb3700 1 -- 172.21.15.146:0/831918588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118409dba0 con 0x7f118409e870 2023-10-03T10:18:28.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.133+0000 7f1189fb3700 1 -- 172.21.15.146:0/831918588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1184121450 con 0x7f118409e870 2023-10-03T10:18:28.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.134+0000 7f116bfff700 1 -- 172.21.15.146:0/831918588 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1174003a40 con 0x7f118409e870 2023-10-03T10:18:28.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.134+0000 7f116bfff700 1 -- 172.21.15.146:0/831918588 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1174003cf0 con 0x7f118409e870 2023-10-03T10:18:28.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.134+0000 7f1189fb3700 1 -- 172.21.15.146:0/831918588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1184121640 con 0x7f118409e870 2023-10-03T10:18:28.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.139+0000 7f116bfff700 1 -- 172.21.15.146:0/831918588 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1174015070 con 0x7f118409e870 2023-10-03T10:18:28.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.171+0000 7f5c43bc8700 1 Processor -- start 2023-10-03T10:18:28.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.171+0000 7f5c43bc8700 1 -- start start 2023-10-03T10:18:28.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.171+0000 7f5c43bc8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c3c0a0a90 0x7f5c3c0a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.171+0000 7f5c43bc8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5c3c0a13a0 0x7f5c3c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.171+0000 7f5c43bc8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c3c0a1fe0 con 0x7f5c3c133f70 2023-10-03T10:18:28.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.171+0000 7f5c43bc8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c3c0a3aa0 con 0x7f5c3c0a13a0 2023-10-03T10:18:28.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.171+0000 7f5c43bc8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c09a540 con 0x7f5c3c0a0a90 2023-10-03T10:18:28.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.172+0000 7f5c41964700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c3c0a0a90 0x7f5c3c0a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.172+0000 7f5c41163700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5c3c0a13a0 0x7f5c3c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.172+0000 7f5c41163700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5c3c0a13a0 0x7f5c3c133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37658/0 (socket says 172.21.15.146:37658) 2023-10-03T10:18:28.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.172+0000 7f5c41964700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c3c0a0a90 0x7f5c3c0a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54038/0 (socket says 172.21.15.146:54038) 2023-10-03T10:18:28.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.172+0000 7f5c41163700 1 -- 172.21.15.146:0/1529581256 learned_addr learned my addr 172.21.15.146:0/1529581256 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:28.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.172+0000 7f5c41163700 1 -- 172.21.15.146:0/1529581256 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c3c0a0a90 msgr2=0x7f5c3c0a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:28.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.172+0000 7f5c41163700 1 --2- 172.21.15.146:0/1529581256 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c3c0a0a90 0x7f5c3c0a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.172+0000 7f5c41163700 1 -- 172.21.15.146:0/1529581256 >> v1:172.21.15.146:6789/0 conn(0x7f5c3c133f70 legacy=0x7f5c3c13ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.172+0000 7f5c41163700 1 -- 172.21.15.146:0/1529581256 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3c09a280 con 0x7f5c3c0a13a0 2023-10-03T10:18:28.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.172+0000 7f5c41964700 1 --2- 172.21.15.146:0/1529581256 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c3c0a0a90 0x7f5c3c0a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:28.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.172+0000 7f5c41163700 1 --2- 172.21.15.146:0/1529581256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c3c0a13a0 0x7f5c3c133a30 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c0098f0 tx=0x7f5c2c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301841ea50c110d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:28.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.172+0000 7f5c40962700 1 -- 172.21.15.146:0/1529581256 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c011830 con 0x7f5c3c0a13a0 2023-10-03T10:18:28.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.172+0000 7f5c40962700 1 -- 172.21.15.146:0/1529581256 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2c011990 con 0x7f5c3c0a13a0 2023-10-03T10:18:28.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.172+0000 7f5c40962700 1 -- 172.21.15.146:0/1529581256 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c011d20 con 0x7f5c3c0a13a0 2023-10-03T10:18:28.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.173+0000 7f5c43bc8700 1 -- 172.21.15.146:0/1529581256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c3c0a13a0 msgr2=0x7f5c3c133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.173+0000 7f5c43bc8700 1 --2- 172.21.15.146:0/1529581256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c3c0a13a0 0x7f5c3c133a30 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c0098f0 tx=0x7f5c2c009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:28.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.173+0000 7f5c43bc8700 1 -- 172.21.15.146:0/1529581256 shutdown_connections 2023-10-03T10:18:28.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.173+0000 7f5c43bc8700 1 --2- 172.21.15.146:0/1529581256 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c3c0a0a90 0x7f5c3c0a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.173+0000 7f5c43bc8700 1 --2- 172.21.15.146:0/1529581256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c3c0a13a0 0x7f5c3c133a30 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.173+0000 7f5c43bc8700 1 -- 172.21.15.146:0/1529581256 >> 172.21.15.146:0/1529581256 conn(0x7f5c3c099c40 msgr2=0x7f5c3c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.173+0000 7f5c43bc8700 1 -- 172.21.15.146:0/1529581256 shutdown_connections 2023-10-03T10:18:28.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.173+0000 7f5c43bc8700 1 -- 172.21.15.146:0/1529581256 wait complete. 2023-10-03T10:18:28.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.174+0000 7f5c43bc8700 1 Processor -- start 2023-10-03T10:18:28.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.174+0000 7f5c43bc8700 1 -- start start 2023-10-03T10:18:28.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.174+0000 7f5c43bc8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c3c0a0a90 0x7f5c3c1212c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.174+0000 7f5c43bc8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c3c0a13a0 0x7f5c3c121800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.174+0000 7f5c43bc8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c3c133f70 0x7f5c3c121d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.174+0000 7f5c43bc8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c123da0 con 0x7f5c3c0a0a90 2023-10-03T10:18:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.174+0000 7f5c43bc8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c124de0 con 0x7f5c3c133f70 2023-10-03T10:18:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.174+0000 7f5c43bc8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c1248d0 con 0x7f5c3c0a13a0 2023-10-03T10:18:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.174+0000 7f5c41163700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c3c0a13a0 0x7f5c3c121800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.174+0000 7f5c41163700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c3c0a13a0 0x7f5c3c121800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54042/0 (socket says 172.21.15.146:54042) 2023-10-03T10:18:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.174+0000 7f5c41163700 1 -- 172.21.15.146:0/3117512876 learned_addr learned my addr 172.21.15.146:0/3117512876 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.174+0000 7f5c42165700 1 --2- 172.21.15.146:0/3117512876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c3c133f70 0x7f5c3c121d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.175+0000 7f5c41964700 1 --2- 172.21.15.146:0/3117512876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c3c0a0a90 0x7f5c3c1212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.175+0000 7f5c41163700 1 -- 172.21.15.146:0/3117512876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c3c133f70 msgr2=0x7f5c3c121d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.175+0000 7f5c41163700 1 --2- 172.21.15.146:0/3117512876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c3c133f70 0x7f5c3c121d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.175+0000 7f5c41163700 1 -- 172.21.15.146:0/3117512876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c3c0a0a90 msgr2=0x7f5c3c1212c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.175+0000 7f5c41163700 1 --2- 172.21.15.146:0/3117512876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c3c0a0a90 0x7f5c3c1212c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.175+0000 7f5c41163700 1 -- 172.21.15.146:0/3117512876 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c380094a0 con 0x7f5c3c0a13a0 2023-10-03T10:18:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.175+0000 7f5c41163700 1 --2- 172.21.15.146:0/3117512876 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c3c0a13a0 0x7f5c3c121800 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c000c00 tx=0x7f5c2c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.175+0000 7f5c327fc700 1 -- 172.21.15.146:0/3117512876 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c004400 con 0x7f5c3c0a13a0 2023-10-03T10:18:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.175+0000 7f5c327fc700 1 -- 172.21.15.146:0/3117512876 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2c01f070 con 0x7f5c3c0a13a0 2023-10-03T10:18:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.175+0000 7f5c43bc8700 1 -- 172.21.15.146:0/3117512876 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c2c009550 con 0x7f5c3c0a13a0 2023-10-03T10:18:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.175+0000 7f5c327fc700 1 -- 172.21.15.146:0/3117512876 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c0038e0 con 0x7f5c3c0a13a0 2023-10-03T10:18:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.175+0000 7f5c43bc8700 1 -- 172.21.15.146:0/3117512876 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c3c0a4d20 con 0x7f5c3c0a13a0 2023-10-03T10:18:28.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.176+0000 7f5c43bc8700 1 -- 172.21.15.146:0/3117512876 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c3c09c840 con 0x7f5c3c0a13a0 2023-10-03T10:18:28.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.176+0000 7f5c327fc700 1 -- 172.21.15.146:0/3117512876 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c2c021030 con 0x7f5c3c0a13a0 2023-10-03T10:18:28.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.176+0000 7f5c327fc700 1 -- 172.21.15.146:0/3117512876 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5c2c040a10 con 0x7f5c3c0a13a0 2023-10-03T10:18:28.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.181+0000 7f5c327fc700 1 -- 172.21.15.146:0/3117512876 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c2c0199a0 con 0x7f5c3c0a13a0 2023-10-03T10:18:28.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.265+0000 7fa04afa1700 1 -- 172.21.15.146:0/1701776674 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa04404f2a0 con 0x7fa0440a0e20 2023-10-03T10:18:28.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.265+0000 7fa0417fa700 1 -- 172.21.15.146:0/1701776674 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa030015020 con 0x7fa0440a0e20 2023-10-03T10:18:28.266 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:28.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.267+0000 7fa04afa1700 1 -- 172.21.15.146:0/1701776674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0440a0e20 msgr2=0x7fa04411aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.267+0000 7fa04afa1700 1 --2- 172.21.15.146:0/1701776674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0440a0e20 0x7fa04411aaf0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fa030009fd0 tx=0x7fa030004750 comp rx=0 tx=0).stop 2023-10-03T10:18:28.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.267+0000 7fa04afa1700 1 -- 172.21.15.146:0/1701776674 shutdown_connections 2023-10-03T10:18:28.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.267+0000 7fa04afa1700 1 --2- 172.21.15.146:0/1701776674 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa044133b80 0x7fa04411b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.267+0000 7fa04afa1700 1 --2- 172.21.15.146:0/1701776674 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa044099a60 0x7fa04411a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.267+0000 7fa04afa1700 1 --2- 172.21.15.146:0/1701776674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0440a0e20 0x7fa04411aaf0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.267+0000 7fa04afa1700 1 -- 172.21.15.146:0/1701776674 >> 172.21.15.146:0/1701776674 conn(0x7fa0440a2980 msgr2=0x7fa04412f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.267+0000 7fa04afa1700 1 -- 172.21.15.146:0/1701776674 shutdown_connections 2023-10-03T10:18:28.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.267+0000 7fa04afa1700 1 -- 172.21.15.146:0/1701776674 wait complete. 2023-10-03T10:18:28.280 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:28.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.334+0000 7f1189fb3700 1 -- 172.21.15.146:0/831918588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1184121180 con 0x7f118409e870 2023-10-03T10:18:28.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.334+0000 7f116bfff700 1 -- 172.21.15.146:0/831918588 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1174015020 con 0x7f118409e870 2023-10-03T10:18:28.335 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:28.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.336+0000 7f1189fb3700 1 -- 172.21.15.146:0/831918588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118409e870 msgr2=0x7f118411ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.336+0000 7f1189fb3700 1 --2- 172.21.15.146:0/831918588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118409e870 0x7f118411ded0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f1174009840 tx=0x7f1174004750 comp rx=0 tx=0).stop 2023-10-03T10:18:28.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.336+0000 7f1189fb3700 1 -- 172.21.15.146:0/831918588 shutdown_connections 2023-10-03T10:18:28.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.336+0000 7f1189fb3700 1 --2- 172.21.15.146:0/831918588 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1184131f40 0x7f118411e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.336+0000 7f1189fb3700 1 --2- 172.21.15.146:0/831918588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118409e870 0x7f118411ded0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.336+0000 7f1189fb3700 1 --2- 172.21.15.146:0/831918588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f118409f180 0x7f118411e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.336+0000 7f1189fb3700 1 -- 172.21.15.146:0/831918588 >> 172.21.15.146:0/831918588 conn(0x7f11840a4430 msgr2=0x7f118406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.336+0000 7f1189fb3700 1 -- 172.21.15.146:0/831918588 shutdown_connections 2023-10-03T10:18:28.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.336+0000 7f1189fb3700 1 -- 172.21.15.146:0/831918588 wait complete. 2023-10-03T10:18:28.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:28.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.375+0000 7f5c43bc8700 1 -- 172.21.15.146:0/3117512876 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5c3c11e060 con 0x7f5c3c0a13a0 2023-10-03T10:18:28.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.375+0000 7f5c327fc700 1 -- 172.21.15.146:0/3117512876 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c2c015070 con 0x7f5c3c0a13a0 2023-10-03T10:18:28.376 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.377+0000 7f5c43bc8700 1 -- 172.21.15.146:0/3117512876 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c3c0a13a0 msgr2=0x7f5c3c121800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.377+0000 7f5c43bc8700 1 --2- 172.21.15.146:0/3117512876 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c3c0a13a0 0x7f5c3c121800 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c000c00 tx=0x7f5c2c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.377+0000 7f5c43bc8700 1 -- 172.21.15.146:0/3117512876 shutdown_connections 2023-10-03T10:18:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.377+0000 7f5c43bc8700 1 --2- 172.21.15.146:0/3117512876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c3c133f70 0x7f5c3c121d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.377+0000 7f5c43bc8700 1 --2- 172.21.15.146:0/3117512876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c3c0a0a90 0x7f5c3c1212c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.377+0000 7f5c43bc8700 1 --2- 172.21.15.146:0/3117512876 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5c3c0a13a0 0x7f5c3c121800 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.377+0000 7f5c43bc8700 1 -- 172.21.15.146:0/3117512876 >> 172.21.15.146:0/3117512876 conn(0x7f5c3c099c40 msgr2=0x7f5c3c133310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.377+0000 7f5c43bc8700 1 -- 172.21.15.146:0/3117512876 shutdown_connections 2023-10-03T10:18:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.377+0000 7f5c43bc8700 1 -- 172.21.15.146:0/3117512876 wait complete. 2023-10-03T10:18:28.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:28.644 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.766+0000 7f8244b56700 1 Processor -- start 2023-10-03T10:18:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.766+0000 7f8244b56700 1 -- start start 2023-10-03T10:18:28.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.767+0000 7f8244b56700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f824009ad40 0x7f8240133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.767+0000 7f8244b56700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82401343d0 0x7f82400a1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.767+0000 7f8244b56700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f824009b110 con 0x7f8240133f70 2023-10-03T10:18:28.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.767+0000 7f8244b56700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82400a3b60 con 0x7f824009ad40 2023-10-03T10:18:28.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.767+0000 7f8244b56700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8240134850 con 0x7f82401343d0 2023-10-03T10:18:28.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.767+0000 7f823e59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f824009ad40 0x7f8240133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.767+0000 7f823ed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82401343d0 0x7f82400a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.767+0000 7f823dd9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8240133f70 0x7f82400a0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34434/0 (socket says 172.21.15.146:34434) 2023-10-03T10:18:28.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.767+0000 7f823e59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f824009ad40 0x7f8240133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37674/0 (socket says 172.21.15.146:37674) 2023-10-03T10:18:28.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.767+0000 7f823dd9b700 1 -- 172.21.15.146:0/2796555566 learned_addr learned my addr 172.21.15.146:0/2796555566 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:28.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.767+0000 7f823ed9d700 1 -- 172.21.15.146:0/2796555566 >> v2:172.21.15.146:3300/0 conn(0x7f824009ad40 msgr2=0x7f8240133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:28.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.767+0000 7f823ed9d700 1 --2- 172.21.15.146:0/2796555566 >> v2:172.21.15.146:3300/0 conn(0x7f824009ad40 0x7f8240133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.767+0000 7f823ed9d700 1 -- 172.21.15.146:0/2796555566 >> v1:172.21.15.146:6789/0 conn(0x7f8240133f70 legacy=0x7f82400a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.767+0000 7f823ed9d700 1 -- 172.21.15.146:0/2796555566 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82400a2fa0 con 0x7f82401343d0 2023-10-03T10:18:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.768+0000 7f823ed9d700 1 --2- 172.21.15.146:0/2796555566 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82401343d0 0x7f82400a1180 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8238009d90 tx=0x7f823800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd9732512c781651 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.768+0000 7f823d59a700 1 -- 172.21.15.146:0/2796555566 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823800e070 con 0x7f82401343d0 2023-10-03T10:18:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.768+0000 7f823d59a700 1 -- 172.21.15.146:0/2796555566 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823800bb20 con 0x7f82401343d0 2023-10-03T10:18:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.768+0000 7f823d59a700 1 -- 172.21.15.146:0/2796555566 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8238012430 con 0x7f82401343d0 2023-10-03T10:18:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.768+0000 7f8244b56700 1 -- 172.21.15.146:0/2796555566 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82401343d0 msgr2=0x7f82400a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.768+0000 7f8244b56700 1 --2- 172.21.15.146:0/2796555566 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82401343d0 0x7f82400a1180 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8238009d90 tx=0x7f823800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.768+0000 7f8244b56700 1 -- 172.21.15.146:0/2796555566 shutdown_connections 2023-10-03T10:18:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.768+0000 7f8244b56700 1 --2- 172.21.15.146:0/2796555566 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f82401343d0 0x7f82400a1180 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.768+0000 7f8244b56700 1 --2- 172.21.15.146:0/2796555566 >> v2:172.21.15.146:3300/0 conn(0x7f824009ad40 0x7f8240133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.768+0000 7f8244b56700 1 -- 172.21.15.146:0/2796555566 >> 172.21.15.146:0/2796555566 conn(0x7f8240099c40 msgr2=0x7f824006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.768+0000 7f8244b56700 1 -- 172.21.15.146:0/2796555566 shutdown_connections 2023-10-03T10:18:28.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.768+0000 7f8244b56700 1 -- 172.21.15.146:0/2796555566 wait complete. 2023-10-03T10:18:28.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.769+0000 7f8244b56700 1 Processor -- start 2023-10-03T10:18:28.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.769+0000 7f8244b56700 1 -- start start 2023-10-03T10:18:28.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.770+0000 7f8244b56700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f824009ad40 0x7f82401c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.770+0000 7f8244b56700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8240133f70 0x7f82401c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.770+0000 7f8244b56700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82401343d0 0x7f82401c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:28.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.770+0000 7f8244b56700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8240120b00 con 0x7f824009ad40 2023-10-03T10:18:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.770+0000 7f8244b56700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8240120910 con 0x7f82401343d0 2023-10-03T10:18:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.770+0000 7f8244b56700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82401211e0 con 0x7f8240133f70 2023-10-03T10:18:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.770+0000 7f823dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8240133f70 0x7f82401c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.770+0000 7f823ed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82401343d0 0x7f82401c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.770+0000 7f823e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f824009ad40 0x7f82401c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.770+0000 7f823dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8240133f70 0x7f82401c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54066/0 (socket says 172.21.15.146:54066) 2023-10-03T10:18:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.770+0000 7f823dd9b700 1 -- 172.21.15.146:0/4235982086 learned_addr learned my addr 172.21.15.146:0/4235982086 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.770+0000 7f823e59c700 1 -- 172.21.15.146:0/4235982086 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8240133f70 msgr2=0x7f82401c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.770+0000 7f823e59c700 1 --2- 172.21.15.146:0/4235982086 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8240133f70 0x7f82401c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.770+0000 7f823e59c700 1 -- 172.21.15.146:0/4235982086 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82401343d0 msgr2=0x7f82401c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.770+0000 7f823e59c700 1 --2- 172.21.15.146:0/4235982086 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82401343d0 0x7f82401c8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.770+0000 7f823e59c700 1 -- 172.21.15.146:0/4235982086 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8238009a70 con 0x7f824009ad40 2023-10-03T10:18:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.770+0000 7f823ed9d700 1 --2- 172.21.15.146:0/4235982086 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82401343d0 0x7f82401c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.770+0000 7f823dd9b700 1 --2- 172.21.15.146:0/4235982086 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8240133f70 0x7f82401c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.770+0000 7f823e59c700 1 --2- 172.21.15.146:0/4235982086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f824009ad40 0x7f82401c8510 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f823000e870 tx=0x7f823000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.771+0000 7f822effd700 1 -- 172.21.15.146:0/4235982086 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8230013680 con 0x7f824009ad40 2023-10-03T10:18:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.771+0000 7f822effd700 1 -- 172.21.15.146:0/4235982086 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82300137e0 con 0x7f824009ad40 2023-10-03T10:18:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.771+0000 7f8244b56700 1 -- 172.21.15.146:0/4235982086 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82400a43a0 con 0x7f824009ad40 2023-10-03T10:18:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.771+0000 7f822effd700 1 -- 172.21.15.146:0/4235982086 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8230013b90 con 0x7f824009ad40 2023-10-03T10:18:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.771+0000 7f8244b56700 1 -- 172.21.15.146:0/4235982086 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8240122540 con 0x7f824009ad40 2023-10-03T10:18:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.771+0000 7f822effd700 1 -- 172.21.15.146:0/4235982086 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8230013cf0 con 0x7f824009ad40 2023-10-03T10:18:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.772+0000 7f822effd700 1 -- 172.21.15.146:0/4235982086 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f823003f500 con 0x7f824009ad40 2023-10-03T10:18:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.772+0000 7f8244b56700 1 -- 172.21.15.146:0/4235982086 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8240122730 con 0x7f824009ad40 2023-10-03T10:18:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.776+0000 7f822effd700 1 -- 172.21.15.146:0/4235982086 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8230021020 con 0x7f824009ad40 2023-10-03T10:18:28.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.963+0000 7f8244b56700 1 -- 172.21.15.146:0/4235982086 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f824004f2a0 con 0x7f824009ad40 2023-10-03T10:18:28.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.963+0000 7f822effd700 1 -- 172.21.15.146:0/4235982086 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8230017070 con 0x7f824009ad40 2023-10-03T10:18:28.964 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:28.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.965+0000 7f8244b56700 1 -- 172.21.15.146:0/4235982086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f824009ad40 msgr2=0x7f82401c8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.965+0000 7f8244b56700 1 --2- 172.21.15.146:0/4235982086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f824009ad40 0x7f82401c8510 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f823000e870 tx=0x7f823000eb80 comp rx=0 tx=0).stop 2023-10-03T10:18:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.965+0000 7f8244b56700 1 -- 172.21.15.146:0/4235982086 shutdown_connections 2023-10-03T10:18:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.966+0000 7f8244b56700 1 --2- 172.21.15.146:0/4235982086 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82401343d0 0x7f82401c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.966+0000 7f8244b56700 1 --2- 172.21.15.146:0/4235982086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f824009ad40 0x7f82401c8510 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.966+0000 7f8244b56700 1 --2- 172.21.15.146:0/4235982086 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8240133f70 0x7f82401c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.966+0000 7f8244b56700 1 -- 172.21.15.146:0/4235982086 >> 172.21.15.146:0/4235982086 conn(0x7f8240099c40 msgr2=0x7f82401bbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.966+0000 7f8244b56700 1 -- 172.21.15.146:0/4235982086 shutdown_connections 2023-10-03T10:18:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:28.966+0000 7f8244b56700 1 -- 172.21.15.146:0/4235982086 wait complete. 2023-10-03T10:18:28.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:29.281 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:29.350 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:29.390 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:29.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.407+0000 7fcc7eb54700 1 Processor -- start 2023-10-03T10:18:29.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.407+0000 7fcc7eb54700 1 -- start start 2023-10-03T10:18:29.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.407+0000 7fcc7eb54700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcc780a1510 0x7fcc781351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.408+0000 7fcc7eb54700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc781356e0 0x7fcc78137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.408+0000 7fcc7eb54700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc780a1e70 con 0x7fcc780a0a30 2023-10-03T10:18:29.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.408+0000 7fcc7eb54700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc7809a720 con 0x7fcc780a1510 2023-10-03T10:18:29.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.408+0000 7fcc7eb54700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7809b300 con 0x7fcc781356e0 2023-10-03T10:18:29.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.408+0000 7fcc7d0f1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc781356e0 0x7fcc78137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.408+0000 7fcc7d0f1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc781356e0 0x7fcc78137ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50370/0 (socket says 172.21.15.146:50370) 2023-10-03T10:18:29.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.408+0000 7fcc7d0f1700 1 -- 172.21.15.146:0/13257945 learned_addr learned my addr 172.21.15.146:0/13257945 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:29.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.408+0000 7fcc7d0f1700 1 -- 172.21.15.146:0/13257945 >> v2:172.21.15.146:3300/0 conn(0x7fcc780a1510 msgr2=0x7fcc781351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.408+0000 7fcc7d0f1700 1 --2- 172.21.15.146:0/13257945 >> v2:172.21.15.146:3300/0 conn(0x7fcc780a1510 0x7fcc781351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.408+0000 7fcc7d0f1700 1 -- 172.21.15.146:0/13257945 >> v1:172.21.15.146:6789/0 conn(0x7fcc780a0a30 legacy=0x7fcc780a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.408+0000 7fcc7d0f1700 1 -- 172.21.15.146:0/13257945 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7809abc0 con 0x7fcc781356e0 2023-10-03T10:18:29.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.408+0000 7fcc7d0f1700 1 --2- 172.21.15.146:0/13257945 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc781356e0 0x7fcc78137ac0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcc7000af60 tx=0x7fcc7000af90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=910658b3ab3bdeb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.408+0000 7fcc777fe700 1 -- 172.21.15.146:0/13257945 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7000f070 con 0x7fcc781356e0 2023-10-03T10:18:29.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.408+0000 7fcc777fe700 1 -- 172.21.15.146:0/13257945 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7000a2e0 con 0x7fcc781356e0 2023-10-03T10:18:29.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.408+0000 7fcc777fe700 1 -- 172.21.15.146:0/13257945 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7000cc70 con 0x7fcc781356e0 2023-10-03T10:18:29.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.409+0000 7fcc7eb54700 1 -- 172.21.15.146:0/13257945 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc781356e0 msgr2=0x7fcc78137ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.409+0000 7fcc7eb54700 1 --2- 172.21.15.146:0/13257945 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc781356e0 0x7fcc78137ac0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcc7000af60 tx=0x7fcc7000af90 comp rx=0 tx=0).stop 2023-10-03T10:18:29.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.409+0000 7fcc7eb54700 1 -- 172.21.15.146:0/13257945 shutdown_connections 2023-10-03T10:18:29.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.409+0000 7fcc7eb54700 1 --2- 172.21.15.146:0/13257945 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc781356e0 0x7fcc78137ac0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.409+0000 7fcc7eb54700 1 --2- 172.21.15.146:0/13257945 >> v2:172.21.15.146:3300/0 conn(0x7fcc780a1510 0x7fcc781351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.409+0000 7fcc7eb54700 1 -- 172.21.15.146:0/13257945 >> 172.21.15.146:0/13257945 conn(0x7fcc780a2980 msgr2=0x7fcc780a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.409+0000 7fcc7eb54700 1 -- 172.21.15.146:0/13257945 shutdown_connections 2023-10-03T10:18:29.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.409+0000 7fcc7eb54700 1 -- 172.21.15.146:0/13257945 wait complete. 2023-10-03T10:18:29.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.410+0000 7fcc7eb54700 1 Processor -- start 2023-10-03T10:18:29.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.410+0000 7fcc7eb54700 1 -- start start 2023-10-03T10:18:29.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.411+0000 7fcc7eb54700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc780a0a30 0x7fcc7811edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.411+0000 7fcc7eb54700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc780a1510 0x7fcc7811f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.411+0000 7fcc7eb54700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc781356e0 0x7fcc7811f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.411+0000 7fcc7eb54700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc78135510 con 0x7fcc781356e0 2023-10-03T10:18:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.411+0000 7fcc7eb54700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc78120990 con 0x7fcc780a0a30 2023-10-03T10:18:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.411+0000 7fcc7eb54700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc78122590 con 0x7fcc780a1510 2023-10-03T10:18:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.411+0000 7fcc7c8f0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc780a0a30 0x7fcc7811edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.411+0000 7fcc77fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc780a1510 0x7fcc7811f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.411+0000 7fcc77fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc780a1510 0x7fcc7811f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54074/0 (socket says 172.21.15.146:54074) 2023-10-03T10:18:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.411+0000 7fcc77fff700 1 -- 172.21.15.146:0/627405369 learned_addr learned my addr 172.21.15.146:0/627405369 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.411+0000 7fcc7c8f0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc780a0a30 0x7fcc7811edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50378/0 (socket says 172.21.15.146:50378) 2023-10-03T10:18:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.412+0000 7fcc7c8f0700 1 -- 172.21.15.146:0/627405369 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc780a1510 msgr2=0x7fcc7811f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.412+0000 7fcc7c8f0700 1 --2- 172.21.15.146:0/627405369 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc780a1510 0x7fcc7811f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.412+0000 7fcc7c8f0700 1 -- 172.21.15.146:0/627405369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc781356e0 msgr2=0x7fcc7811f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.412+0000 7fcc7c8f0700 1 --2- 172.21.15.146:0/627405369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc781356e0 0x7fcc7811f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.412+0000 7fcc7c8f0700 1 -- 172.21.15.146:0/627405369 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7000ac40 con 0x7fcc780a0a30 2023-10-03T10:18:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.412+0000 7fcc77fff700 1 --2- 172.21.15.146:0/627405369 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc780a1510 0x7fcc7811f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.412+0000 7fcc7c8f0700 1 --2- 172.21.15.146:0/627405369 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc780a0a30 0x7fcc7811edd0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00c3e0 tx=0x7fcc6c00c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.412+0000 7fcc757fa700 1 -- 172.21.15.146:0/627405369 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c00cea0 con 0x7fcc780a0a30 2023-10-03T10:18:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.412+0000 7fcc757fa700 1 -- 172.21.15.146:0/627405369 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6c005500 con 0x7fcc780a0a30 2023-10-03T10:18:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.412+0000 7fcc7eb54700 1 -- 172.21.15.146:0/627405369 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc78070fe0 con 0x7fcc780a0a30 2023-10-03T10:18:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.412+0000 7fcc757fa700 1 -- 172.21.15.146:0/627405369 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c0038c0 con 0x7fcc780a0a30 2023-10-03T10:18:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.412+0000 7fcc7eb54700 1 -- 172.21.15.146:0/627405369 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc781210e0 con 0x7fcc780a0a30 2023-10-03T10:18:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.413+0000 7fcc757fa700 1 -- 172.21.15.146:0/627405369 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcc6c003a20 con 0x7fcc780a0a30 2023-10-03T10:18:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.413+0000 7fcc7eb54700 1 -- 172.21.15.146:0/627405369 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc7804f2a0 con 0x7fcc780a0a30 2023-10-03T10:18:29.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.413+0000 7fcc757fa700 1 -- 172.21.15.146:0/627405369 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcc6c03ebb0 con 0x7fcc780a0a30 2023-10-03T10:18:29.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.418+0000 7fcc757fa700 1 -- 172.21.15.146:0/627405369 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcc6c019b40 con 0x7fcc780a0a30 2023-10-03T10:18:29.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.486+0000 7fc2e880d700 1 Processor -- start 2023-10-03T10:18:29.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.486+0000 7fc2e880d700 1 -- start start 2023-10-03T10:18:29.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.487+0000 7fc2e880d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2e40a0a70 0x7fc2e40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.487+0000 7fc2e880d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc2e40a1380 0x7fc2e4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.487+0000 7fc2e880d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e409dc00 con 0x7fc2e4133f50 2023-10-03T10:18:29.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.487+0000 7fc2e880d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e409ea60 con 0x7fc2e40a1380 2023-10-03T10:18:29.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.487+0000 7fc2e880d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e409dec0 con 0x7fc2e40a0a70 2023-10-03T10:18:29.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.488+0000 7fc2e2d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc2e4133f50 0x7fc2e413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34456/0 (socket says 172.21.15.146:34456) 2023-10-03T10:18:29.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.488+0000 7fc2e2d9d700 1 -- 172.21.15.146:0/3197079280 learned_addr learned my addr 172.21.15.146:0/3197079280 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:29.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.488+0000 7fc2e1d9b700 1 --2- 172.21.15.146:0/3197079280 >> v2:172.21.15.146:3300/0 conn(0x7fc2e40a1380 0x7fc2e4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.488+0000 7fc2e259c700 1 --2- 172.21.15.146:0/3197079280 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2e40a0a70 0x7fc2e40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.488+0000 7fc2e159a700 1 -- 172.21.15.146:0/3197079280 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875367686 0 0) 0x7fc2e409dc00 con 0x7fc2e4133f50 2023-10-03T10:18:29.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.488+0000 7fc2e159a700 1 -- 172.21.15.146:0/3197079280 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2cc0035b0 con 0x7fc2e4133f50 2023-10-03T10:18:29.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.488+0000 7fc2e1d9b700 1 -- 172.21.15.146:0/3197079280 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2e40a0a70 msgr2=0x7fc2e40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.488+0000 7fc2e1d9b700 1 --2- 172.21.15.146:0/3197079280 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2e40a0a70 0x7fc2e40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.488+0000 7fc2e1d9b700 1 -- 172.21.15.146:0/3197079280 >> v1:172.21.15.146:6789/0 conn(0x7fc2e4133f50 legacy=0x7fc2e413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.488+0000 7fc2e1d9b700 1 -- 172.21.15.146:0/3197079280 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e409e6a0 con 0x7fc2e40a1380 2023-10-03T10:18:29.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.488+0000 7fc2e259c700 1 --2- 172.21.15.146:0/3197079280 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2e40a0a70 0x7fc2e40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:29.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.488+0000 7fc2e1d9b700 1 --2- 172.21.15.146:0/3197079280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2e40a1380 0x7fc2e4133a10 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009840 tx=0x7fc2d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ff27bae517982c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.488+0000 7fc2e159a700 1 -- 172.21.15.146:0/3197079280 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8011830 con 0x7fc2e40a1380 2023-10-03T10:18:29.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.488+0000 7fc2e159a700 1 -- 172.21.15.146:0/3197079280 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d8011990 con 0x7fc2e40a1380 2023-10-03T10:18:29.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.488+0000 7fc2e159a700 1 -- 172.21.15.146:0/3197079280 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8011d20 con 0x7fc2e40a1380 2023-10-03T10:18:29.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.489+0000 7fc2e880d700 1 -- 172.21.15.146:0/3197079280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2e40a1380 msgr2=0x7fc2e4133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.489+0000 7fc2e880d700 1 --2- 172.21.15.146:0/3197079280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2e40a1380 0x7fc2e4133a10 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009840 tx=0x7fc2d8009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:29.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.489+0000 7fc2e880d700 1 -- 172.21.15.146:0/3197079280 shutdown_connections 2023-10-03T10:18:29.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.489+0000 7fc2e880d700 1 --2- 172.21.15.146:0/3197079280 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2e40a0a70 0x7fc2e40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.489+0000 7fc2e880d700 1 --2- 172.21.15.146:0/3197079280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2e40a1380 0x7fc2e4133a10 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.489+0000 7fc2e880d700 1 -- 172.21.15.146:0/3197079280 >> 172.21.15.146:0/3197079280 conn(0x7fc2e40a6610 msgr2=0x7fc2e40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.489+0000 7fc2e880d700 1 -- 172.21.15.146:0/3197079280 shutdown_connections 2023-10-03T10:18:29.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.489+0000 7fc2e880d700 1 -- 172.21.15.146:0/3197079280 wait complete. 2023-10-03T10:18:29.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.490+0000 7fc2e880d700 1 Processor -- start 2023-10-03T10:18:29.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.490+0000 7fc2e880d700 1 -- start start 2023-10-03T10:18:29.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.491+0000 7fc2e880d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2e40a0a70 0x7fc2e4122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.491+0000 7fc2e880d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2e40a1380 0x7fc2e4122e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.491+0000 7fc2e880d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2e4133f50 0x7fc2e4123390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.491+0000 7fc2e880d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e4126230 con 0x7fc2e40a1380 2023-10-03T10:18:29.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.491+0000 7fc2e880d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e4133970 con 0x7fc2e40a0a70 2023-10-03T10:18:29.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.491+0000 7fc2e880d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e4133430 con 0x7fc2e4133f50 2023-10-03T10:18:29.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.491+0000 7fc2e1d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2e40a1380 0x7fc2e4122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.491+0000 7fc2e1d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2e40a1380 0x7fc2e4122e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37740/0 (socket says 172.21.15.146:37740) 2023-10-03T10:18:29.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.491+0000 7fc2e1d9b700 1 -- 172.21.15.146:0/2487274828 learned_addr learned my addr 172.21.15.146:0/2487274828 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:29.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.491+0000 7fc2e2d9d700 1 --2- 172.21.15.146:0/2487274828 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2e4133f50 0x7fc2e4123390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.491+0000 7fc2e259c700 1 --2- 172.21.15.146:0/2487274828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2e40a0a70 0x7fc2e4122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.491+0000 7fc2e2d9d700 1 -- 172.21.15.146:0/2487274828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2e40a0a70 msgr2=0x7fc2e4122910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.491+0000 7fc2e2d9d700 1 --2- 172.21.15.146:0/2487274828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2e40a0a70 0x7fc2e4122910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.491+0000 7fc2e2d9d700 1 -- 172.21.15.146:0/2487274828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2e40a1380 msgr2=0x7fc2e4122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.491+0000 7fc2e2d9d700 1 --2- 172.21.15.146:0/2487274828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2e40a1380 0x7fc2e4122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.491+0000 7fc2e2d9d700 1 -- 172.21.15.146:0/2487274828 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d40094a0 con 0x7fc2e4133f50 2023-10-03T10:18:29.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.491+0000 7fc2e2d9d700 1 --2- 172.21.15.146:0/2487274828 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2e4133f50 0x7fc2e4123390 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00cab0 tx=0x7fc2dc00cdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.492+0000 7fc2d2ffd700 1 -- 172.21.15.146:0/2487274828 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc00a9a0 con 0x7fc2e4133f50 2023-10-03T10:18:29.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.492+0000 7fc2d2ffd700 1 -- 172.21.15.146:0/2487274828 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc00ab00 con 0x7fc2e4133f50 2023-10-03T10:18:29.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.492+0000 7fc2d2ffd700 1 -- 172.21.15.146:0/2487274828 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc00ae70 con 0x7fc2e4133f50 2023-10-03T10:18:29.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.492+0000 7fc2e880d700 1 -- 172.21.15.146:0/2487274828 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d80094a0 con 0x7fc2e4133f50 2023-10-03T10:18:29.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.492+0000 7fc2e880d700 1 -- 172.21.15.146:0/2487274828 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e4126bc0 con 0x7fc2e4133f50 2023-10-03T10:18:29.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.492+0000 7fc2d2ffd700 1 -- 172.21.15.146:0/2487274828 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2dc01b3b0 con 0x7fc2e4133f50 2023-10-03T10:18:29.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.493+0000 7fc2d2ffd700 1 -- 172.21.15.146:0/2487274828 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc2dc03f390 con 0x7fc2e4133f50 2023-10-03T10:18:29.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.493+0000 7fc2e880d700 1 -- 172.21.15.146:0/2487274828 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e404f2a0 con 0x7fc2e4133f50 2023-10-03T10:18:29.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.497+0000 7fc2d2ffd700 1 -- 172.21.15.146:0/2487274828 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2dc017080 con 0x7fc2e4133f50 2023-10-03T10:18:29.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.529+0000 7f679c718700 1 Processor -- start 2023-10-03T10:18:29.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.529+0000 7f679c718700 1 -- start start 2023-10-03T10:18:29.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.529+0000 7f679c718700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f679409e870 0x7f679409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.529+0000 7f679c718700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6794134330 0x7f679413be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.529+0000 7f679c718700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f679409fa00 con 0x7f679409f180 2023-10-03T10:18:29.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.529+0000 7f679c718700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67940a0370 con 0x7f679409e870 2023-10-03T10:18:29.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.529+0000 7f679c718700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f679406bec0 con 0x7f6794134330 2023-10-03T10:18:29.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.530+0000 7f679a4b4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f679409e870 0x7f679409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.530+0000 7f6799cb3700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f679409f180 0x7f6794133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34458/0 (socket says 172.21.15.146:34458) 2023-10-03T10:18:29.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.530+0000 7f679a4b4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f679409e870 0x7f679409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37752/0 (socket says 172.21.15.146:37752) 2023-10-03T10:18:29.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.530+0000 7f679acb5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6794134330 0x7f679413be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.530+0000 7f6799cb3700 1 -- 172.21.15.146:0/536386693 learned_addr learned my addr 172.21.15.146:0/536386693 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:29.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.530+0000 7f679a4b4700 1 -- 172.21.15.146:0/536386693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6794134330 msgr2=0x7f679413be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.530+0000 7f679a4b4700 1 --2- 172.21.15.146:0/536386693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6794134330 0x7f679413be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.530+0000 7f679a4b4700 1 -- 172.21.15.146:0/536386693 >> v1:172.21.15.146:6789/0 conn(0x7f679409f180 legacy=0x7f6794133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.530+0000 7f679a4b4700 1 -- 172.21.15.146:0/536386693 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679409ada0 con 0x7f679409e870 2023-10-03T10:18:29.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.530+0000 7f679acb5700 1 --2- 172.21.15.146:0/536386693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6794134330 0x7f679413be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:29.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.530+0000 7f679a4b4700 1 --2- 172.21.15.146:0/536386693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f679409e870 0x7f679409ec40 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f6790009840 tx=0x7f6790009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb896b0d2783fa06 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.530+0000 7f67994b2700 1 -- 172.21.15.146:0/536386693 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6790011830 con 0x7f679409e870 2023-10-03T10:18:29.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.530+0000 7f67994b2700 1 -- 172.21.15.146:0/536386693 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6790011990 con 0x7f679409e870 2023-10-03T10:18:29.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.530+0000 7f67994b2700 1 -- 172.21.15.146:0/536386693 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6790011d20 con 0x7f679409e870 2023-10-03T10:18:29.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.531+0000 7f679c718700 1 -- 172.21.15.146:0/536386693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f679409e870 msgr2=0x7f679409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.531+0000 7f679c718700 1 --2- 172.21.15.146:0/536386693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f679409e870 0x7f679409ec40 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f6790009840 tx=0x7f6790009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:29.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.531+0000 7f679c718700 1 -- 172.21.15.146:0/536386693 shutdown_connections 2023-10-03T10:18:29.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.531+0000 7f679c718700 1 --2- 172.21.15.146:0/536386693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6794134330 0x7f679413be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.531+0000 7f679c718700 1 --2- 172.21.15.146:0/536386693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f679409e870 0x7f679409ec40 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.531+0000 7f679c718700 1 -- 172.21.15.146:0/536386693 >> 172.21.15.146:0/536386693 conn(0x7f67940a4430 msgr2=0x7f67940a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.531+0000 7f679c718700 1 -- 172.21.15.146:0/536386693 shutdown_connections 2023-10-03T10:18:29.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.531+0000 7f679c718700 1 -- 172.21.15.146:0/536386693 wait complete. 2023-10-03T10:18:29.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.532+0000 7f679c718700 1 Processor -- start 2023-10-03T10:18:29.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.532+0000 7f679c718700 1 -- start start 2023-10-03T10:18:29.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.532+0000 7f679c718700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f679409e870 0x7f67941c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.532+0000 7f679c718700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f679409f180 0x7f67941c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.532+0000 7f679c718700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6794134330 0x7f6794122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.532+0000 7f679c718700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679406fc40 con 0x7f679409f180 2023-10-03T10:18:29.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.532+0000 7f679c718700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67941261c0 con 0x7f6794134330 2023-10-03T10:18:29.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.532+0000 7f679c718700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6794126860 con 0x7f679409e870 2023-10-03T10:18:29.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.533+0000 7f6799cb3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f679409f180 0x7f67941c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.533+0000 7f6799cb3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f679409f180 0x7f67941c8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37764/0 (socket says 172.21.15.146:37764) 2023-10-03T10:18:29.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.533+0000 7f6799cb3700 1 -- 172.21.15.146:0/2762924454 learned_addr learned my addr 172.21.15.146:0/2762924454 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:29.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.533+0000 7f679a4b4700 1 --2- 172.21.15.146:0/2762924454 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f679409e870 0x7f67941c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.533+0000 7f679acb5700 1 --2- 172.21.15.146:0/2762924454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6794134330 0x7f6794122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.533+0000 7f6799cb3700 1 -- 172.21.15.146:0/2762924454 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f679409e870 msgr2=0x7f67941c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.533+0000 7f6799cb3700 1 --2- 172.21.15.146:0/2762924454 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f679409e870 0x7f67941c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.533+0000 7f6799cb3700 1 -- 172.21.15.146:0/2762924454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6794134330 msgr2=0x7f6794122cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.533+0000 7f6799cb3700 1 --2- 172.21.15.146:0/2762924454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6794134330 0x7f6794122cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.533+0000 7f6799cb3700 1 -- 172.21.15.146:0/2762924454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678c009a70 con 0x7f679409f180 2023-10-03T10:18:29.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.533+0000 7f679acb5700 1 --2- 172.21.15.146:0/2762924454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6794134330 0x7f6794122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:29.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.533+0000 7f6799cb3700 1 --2- 172.21.15.146:0/2762924454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f679409f180 0x7f67941c8eb0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f678400c520 tx=0x7f678400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.533+0000 7f678affd700 1 -- 172.21.15.146:0/2762924454 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6784005d70 con 0x7f679409f180 2023-10-03T10:18:29.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.533+0000 7f678affd700 1 -- 172.21.15.146:0/2762924454 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67840070d0 con 0x7f679409f180 2023-10-03T10:18:29.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.533+0000 7f679c718700 1 -- 172.21.15.146:0/2762924454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67900094a0 con 0x7f679409f180 2023-10-03T10:18:29.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.533+0000 7f678affd700 1 -- 172.21.15.146:0/2762924454 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6784007440 con 0x7f679409f180 2023-10-03T10:18:29.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.533+0000 7f679c718700 1 -- 172.21.15.146:0/2762924454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67941274c0 con 0x7f679409f180 2023-10-03T10:18:29.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.534+0000 7f678affd700 1 -- 172.21.15.146:0/2762924454 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f67840075a0 con 0x7f679409f180 2023-10-03T10:18:29.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.534+0000 7f678affd700 1 -- 172.21.15.146:0/2762924454 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f678403eb10 con 0x7f679409f180 2023-10-03T10:18:29.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.534+0000 7f679c718700 1 -- 172.21.15.146:0/2762924454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67941c94b0 con 0x7f679409f180 2023-10-03T10:18:29.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.539+0000 7f678affd700 1 -- 172.21.15.146:0/2762924454 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6784019b40 con 0x7f679409f180 2023-10-03T10:18:29.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.618+0000 7fcc7eb54700 1 -- 172.21.15.146:0/627405369 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcc781228d0 con 0x7fcc780a0a30 2023-10-03T10:18:29.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.619+0000 7fcc757fa700 1 -- 172.21.15.146:0/627405369 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcc6c017020 con 0x7fcc780a0a30 2023-10-03T10:18:29.619 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:29.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.621+0000 7fcc7eb54700 1 -- 172.21.15.146:0/627405369 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc780a0a30 msgr2=0x7fcc7811edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.621+0000 7fcc7eb54700 1 --2- 172.21.15.146:0/627405369 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc780a0a30 0x7fcc7811edd0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00c3e0 tx=0x7fcc6c00c6f0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.621+0000 7fcc7eb54700 1 -- 172.21.15.146:0/627405369 shutdown_connections 2023-10-03T10:18:29.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.621+0000 7fcc7eb54700 1 --2- 172.21.15.146:0/627405369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc781356e0 0x7fcc7811f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.621+0000 7fcc7eb54700 1 --2- 172.21.15.146:0/627405369 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc780a0a30 0x7fcc7811edd0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.621+0000 7fcc7eb54700 1 --2- 172.21.15.146:0/627405369 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc780a1510 0x7fcc7811f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.621+0000 7fcc7eb54700 1 -- 172.21.15.146:0/627405369 >> 172.21.15.146:0/627405369 conn(0x7fcc780a2980 msgr2=0x7fcc7809e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.621+0000 7fcc7eb54700 1 -- 172.21.15.146:0/627405369 shutdown_connections 2023-10-03T10:18:29.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.621+0000 7fcc7eb54700 1 -- 172.21.15.146:0/627405369 wait complete. 2023-10-03T10:18:29.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:29.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.703+0000 7fc2e880d700 1 -- 172.21.15.146:0/2487274828 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc2e4072980 con 0x7fc2e4133f50 2023-10-03T10:18:29.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.703+0000 7fc2d2ffd700 1 -- 172.21.15.146:0/2487274828 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc2dc0192c0 con 0x7fc2e4133f50 2023-10-03T10:18:29.704 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:29.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.705+0000 7fc2e880d700 1 -- 172.21.15.146:0/2487274828 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2e4133f50 msgr2=0x7fc2e4123390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.705+0000 7fc2e880d700 1 --2- 172.21.15.146:0/2487274828 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2e4133f50 0x7fc2e4123390 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00cab0 tx=0x7fc2dc00cdc0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.705+0000 7fc2e880d700 1 -- 172.21.15.146:0/2487274828 shutdown_connections 2023-10-03T10:18:29.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.705+0000 7fc2e880d700 1 --2- 172.21.15.146:0/2487274828 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc2e4133f50 0x7fc2e4123390 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.705+0000 7fc2e880d700 1 --2- 172.21.15.146:0/2487274828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2e40a0a70 0x7fc2e4122910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.705+0000 7fc2e880d700 1 --2- 172.21.15.146:0/2487274828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2e40a1380 0x7fc2e4122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.705+0000 7fc2e880d700 1 -- 172.21.15.146:0/2487274828 >> 172.21.15.146:0/2487274828 conn(0x7fc2e40a6610 msgr2=0x7fc2e40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.705+0000 7fc2e880d700 1 -- 172.21.15.146:0/2487274828 shutdown_connections 2023-10-03T10:18:29.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.705+0000 7fc2e880d700 1 -- 172.21.15.146:0/2487274828 wait complete. 2023-10-03T10:18:29.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:29.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.744+0000 7f679c718700 1 -- 172.21.15.146:0/2762924454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f679404f2a0 con 0x7f679409f180 2023-10-03T10:18:29.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.744+0000 7f678affd700 1 -- 172.21.15.146:0/2762924454 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6784017020 con 0x7f679409f180 2023-10-03T10:18:29.745 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:29.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.747+0000 7f679c718700 1 -- 172.21.15.146:0/2762924454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f679409f180 msgr2=0x7f67941c8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.747+0000 7f679c718700 1 --2- 172.21.15.146:0/2762924454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f679409f180 0x7f67941c8eb0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f678400c520 tx=0x7f678400c830 comp rx=0 tx=0).stop 2023-10-03T10:18:29.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.747+0000 7f679c718700 1 -- 172.21.15.146:0/2762924454 shutdown_connections 2023-10-03T10:18:29.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.747+0000 7f679c718700 1 --2- 172.21.15.146:0/2762924454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6794134330 0x7f6794122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.747+0000 7f679c718700 1 --2- 172.21.15.146:0/2762924454 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f679409e870 0x7f67941c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.747+0000 7f679c718700 1 --2- 172.21.15.146:0/2762924454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f679409f180 0x7f67941c8eb0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.747+0000 7f679c718700 1 -- 172.21.15.146:0/2762924454 >> 172.21.15.146:0/2762924454 conn(0x7f67940a4430 msgr2=0x7f6794071030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.747+0000 7f679c718700 1 -- 172.21.15.146:0/2762924454 shutdown_connections 2023-10-03T10:18:29.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:29.747+0000 7f679c718700 1 -- 172.21.15.146:0/2762924454 wait complete. 2023-10-03T10:18:29.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:29.979 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.101+0000 7f91eef0a700 1 Processor -- start 2023-10-03T10:18:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.101+0000 7f91eef0a700 1 -- start start 2023-10-03T10:18:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.101+0000 7f91eef0a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f91e8133ad0 0x7f91e8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.101+0000 7f91eef0a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e81300a0 0x7f91e81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.101+0000 7f91eef0a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e806b2d0 con 0x7f91e81309f0 2023-10-03T10:18:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.101+0000 7f91eef0a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e8133610 con 0x7f91e8133ad0 2023-10-03T10:18:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.101+0000 7f91eef0a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e809a500 con 0x7f91e81300a0 2023-10-03T10:18:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.102+0000 7f91ecca6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f91e8133ad0 0x7f91e8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.102+0000 7f91e7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e81300a0 0x7f91e81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.102+0000 7f91ed4a7700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f91e81309f0 0x7f91e813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34470/0 (socket says 172.21.15.146:34470) 2023-10-03T10:18:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.102+0000 7f91ed4a7700 1 -- 172.21.15.146:0/1988035133 learned_addr learned my addr 172.21.15.146:0/1988035133 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:30.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.102+0000 7f91e7fff700 1 -- 172.21.15.146:0/1988035133 >> v2:172.21.15.146:3300/0 conn(0x7f91e8133ad0 msgr2=0x7f91e8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.102+0000 7f91e7fff700 1 --2- 172.21.15.146:0/1988035133 >> v2:172.21.15.146:3300/0 conn(0x7f91e8133ad0 0x7f91e8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.102+0000 7f91e7fff700 1 -- 172.21.15.146:0/1988035133 >> v1:172.21.15.146:6789/0 conn(0x7f91e81309f0 legacy=0x7f91e813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.102+0000 7f91e7fff700 1 -- 172.21.15.146:0/1988035133 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e81338b0 con 0x7f91e81300a0 2023-10-03T10:18:30.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.102+0000 7f91ecca6700 1 --2- 172.21.15.146:0/1988035133 >> v2:172.21.15.146:3300/0 conn(0x7f91e8133ad0 0x7f91e8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.102+0000 7f91e77fe700 1 -- 172.21.15.146:0/1988035133 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 944832012 0 0) 0x7f91e806b2d0 con 0x7f91e81309f0 2023-10-03T10:18:30.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.102+0000 7f91e7fff700 1 --2- 172.21.15.146:0/1988035133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e81300a0 0x7f91e81304b0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009840 tx=0x7f91d4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a67255ba1eedadb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.102+0000 7f91e77fe700 1 -- 172.21.15.146:0/1988035133 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d4011830 con 0x7f91e81300a0 2023-10-03T10:18:30.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.102+0000 7f91e77fe700 1 -- 172.21.15.146:0/1988035133 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d4011990 con 0x7f91e81300a0 2023-10-03T10:18:30.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.102+0000 7f91e77fe700 1 -- 172.21.15.146:0/1988035133 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d4011d20 con 0x7f91e81300a0 2023-10-03T10:18:30.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.103+0000 7f91eef0a700 1 -- 172.21.15.146:0/1988035133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e81300a0 msgr2=0x7f91e81304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.103+0000 7f91eef0a700 1 --2- 172.21.15.146:0/1988035133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e81300a0 0x7f91e81304b0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009840 tx=0x7f91d4009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:30.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.103+0000 7f91eef0a700 1 -- 172.21.15.146:0/1988035133 shutdown_connections 2023-10-03T10:18:30.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.103+0000 7f91eef0a700 1 --2- 172.21.15.146:0/1988035133 >> v2:172.21.15.146:3300/0 conn(0x7f91e8133ad0 0x7f91e8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.103+0000 7f91eef0a700 1 --2- 172.21.15.146:0/1988035133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e81300a0 0x7f91e81304b0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.103+0000 7f91eef0a700 1 -- 172.21.15.146:0/1988035133 >> 172.21.15.146:0/1988035133 conn(0x7f91e8099c40 msgr2=0x7f91e80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.103+0000 7f91eef0a700 1 -- 172.21.15.146:0/1988035133 shutdown_connections 2023-10-03T10:18:30.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.103+0000 7f91eef0a700 1 -- 172.21.15.146:0/1988035133 wait complete. 2023-10-03T10:18:30.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.104+0000 7f91eef0a700 1 Processor -- start 2023-10-03T10:18:30.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.104+0000 7f91eef0a700 1 -- start start 2023-10-03T10:18:30.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.104+0000 7f91eef0a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f91e81300a0 0x7f91e811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.104+0000 7f91eef0a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e81309f0 0x7f91e811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.104+0000 7f91eef0a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91e8133ad0 0x7f91e811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.104+0000 7f91eef0a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e811fe30 con 0x7f91e8133ad0 2023-10-03T10:18:30.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.104+0000 7f91eef0a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e8120010 con 0x7f91e81309f0 2023-10-03T10:18:30.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.104+0000 7f91eef0a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91e811eb60 con 0x7f91e81300a0 2023-10-03T10:18:30.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.104+0000 7f91e7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e81309f0 0x7f91e811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.104+0000 7f91ed4a7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91e8133ad0 0x7f91e811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.104+0000 7f91ecca6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f91e81300a0 0x7f91e811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.104+0000 7f91e7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e81309f0 0x7f91e811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50412/0 (socket says 172.21.15.146:50412) 2023-10-03T10:18:30.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.104+0000 7f91e7fff700 1 -- 172.21.15.146:0/3542183045 learned_addr learned my addr 172.21.15.146:0/3542183045 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:30.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.104+0000 7f91ecca6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f91e81300a0 0x7f91e811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54132/0 (socket says 172.21.15.146:54132) 2023-10-03T10:18:30.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.104+0000 7f91ed4a7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91e8133ad0 0x7f91e811e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37778/0 (socket says 172.21.15.146:37778) 2023-10-03T10:18:30.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.105+0000 7f91e7fff700 1 -- 172.21.15.146:0/3542183045 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f91e81300a0 msgr2=0x7f91e811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.105+0000 7f91e7fff700 1 --2- 172.21.15.146:0/3542183045 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f91e81300a0 0x7f91e811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.105+0000 7f91e7fff700 1 -- 172.21.15.146:0/3542183045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91e8133ad0 msgr2=0x7f91e811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.105+0000 7f91e7fff700 1 --2- 172.21.15.146:0/3542183045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91e8133ad0 0x7f91e811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.105+0000 7f91e7fff700 1 -- 172.21.15.146:0/3542183045 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc0094a0 con 0x7f91e81309f0 2023-10-03T10:18:30.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.105+0000 7f91ecca6700 1 --2- 172.21.15.146:0/3542183045 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f91e81300a0 0x7f91e811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.105+0000 7f91ed4a7700 1 --2- 172.21.15.146:0/3542183045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91e8133ad0 0x7f91e811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.105+0000 7f91e7fff700 1 --2- 172.21.15.146:0/3542183045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e81309f0 0x7f91e811df80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f91d40090b0 tx=0x7f91d4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.105+0000 7f91e57fa700 1 -- 172.21.15.146:0/3542183045 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d40036a0 con 0x7f91e81309f0 2023-10-03T10:18:30.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.105+0000 7f91e57fa700 1 -- 172.21.15.146:0/3542183045 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d401e070 con 0x7f91e81309f0 2023-10-03T10:18:30.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.105+0000 7f91eef0a700 1 -- 172.21.15.146:0/3542183045 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d40094a0 con 0x7f91e81309f0 2023-10-03T10:18:30.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.105+0000 7f91e57fa700 1 -- 172.21.15.146:0/3542183045 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d4003a60 con 0x7f91e81309f0 2023-10-03T10:18:30.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.105+0000 7f91eef0a700 1 -- 172.21.15.146:0/3542183045 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e812dd60 con 0x7f91e81309f0 2023-10-03T10:18:30.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.106+0000 7f91e57fa700 1 -- 172.21.15.146:0/3542183045 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f91d4003bc0 con 0x7f91e81309f0 2023-10-03T10:18:30.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.106+0000 7f91eef0a700 1 -- 172.21.15.146:0/3542183045 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e804f2a0 con 0x7f91e81309f0 2023-10-03T10:18:30.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.106+0000 7f91e57fa700 1 -- 172.21.15.146:0/3542183045 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f91d4040640 con 0x7f91e81309f0 2023-10-03T10:18:30.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.111+0000 7f91e57fa700 1 -- 172.21.15.146:0/3542183045 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91d4015070 con 0x7f91e81309f0 2023-10-03T10:18:30.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.295+0000 7f91eef0a700 1 -- 172.21.15.146:0/3542183045 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f91e812d950 con 0x7f91e81309f0 2023-10-03T10:18:30.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.296+0000 7f91e57fa700 1 -- 172.21.15.146:0/3542183045 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91d401a420 con 0x7f91e81309f0 2023-10-03T10:18:30.297 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:30.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.298+0000 7f91eef0a700 1 -- 172.21.15.146:0/3542183045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e81309f0 msgr2=0x7f91e811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.298+0000 7f91eef0a700 1 --2- 172.21.15.146:0/3542183045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e81309f0 0x7f91e811df80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f91d40090b0 tx=0x7f91d4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:30.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.298+0000 7f91eef0a700 1 -- 172.21.15.146:0/3542183045 shutdown_connections 2023-10-03T10:18:30.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.298+0000 7f91eef0a700 1 --2- 172.21.15.146:0/3542183045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91e8133ad0 0x7f91e811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.298+0000 7f91eef0a700 1 --2- 172.21.15.146:0/3542183045 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f91e81300a0 0x7f91e811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.298+0000 7f91eef0a700 1 --2- 172.21.15.146:0/3542183045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91e81309f0 0x7f91e811df80 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.298+0000 7f91eef0a700 1 -- 172.21.15.146:0/3542183045 >> 172.21.15.146:0/3542183045 conn(0x7f91e8099c40 msgr2=0x7f91e812e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.298+0000 7f91eef0a700 1 -- 172.21.15.146:0/3542183045 shutdown_connections 2023-10-03T10:18:30.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.298+0000 7f91eef0a700 1 -- 172.21.15.146:0/3542183045 wait complete. 2023-10-03T10:18:30.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:30.635 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:30.719 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:30.760 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:30.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.762+0000 7f772f118700 1 Processor -- start 2023-10-03T10:18:30.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.762+0000 7f772f118700 1 -- start start 2023-10-03T10:18:30.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.763+0000 7f772f118700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f772809e870 0x7f772809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.763+0000 7f772f118700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772809f180 0x7f7728131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.763+0000 7f772f118700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7728131d70 0x7f7728132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.763+0000 7f772f118700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77280a0920 con 0x7f7728131d70 2023-10-03T10:18:30.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.763+0000 7f772f118700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772809c970 con 0x7f772809f180 2023-10-03T10:18:30.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.763+0000 7f772f118700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f772809bab0 con 0x7f772809e870 2023-10-03T10:18:30.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.763+0000 7f772d6b5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7728131d70 0x7f7728132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.763+0000 7f772ceb4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f772809e870 0x7f772809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.763+0000 7f772d6b5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7728131d70 0x7f7728132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37780/0 (socket says 172.21.15.146:37780) 2023-10-03T10:18:30.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.763+0000 7f772d6b5700 1 -- 172.21.15.146:0/3654623837 learned_addr learned my addr 172.21.15.146:0/3654623837 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:30.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.763+0000 7f7727fff700 1 --2- 172.21.15.146:0/3654623837 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772809f180 0x7f7728131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.763+0000 7f772ceb4700 1 -- 172.21.15.146:0/3654623837 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772809f180 msgr2=0x7f7728131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.763+0000 7f772ceb4700 1 --2- 172.21.15.146:0/3654623837 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772809f180 0x7f7728131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.763+0000 7f772ceb4700 1 -- 172.21.15.146:0/3654623837 >> v2:172.21.15.146:3300/0 conn(0x7f7728131d70 msgr2=0x7f7728132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.763+0000 7f772ceb4700 1 --2- 172.21.15.146:0/3654623837 >> v2:172.21.15.146:3300/0 conn(0x7f7728131d70 0x7f7728132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.763+0000 7f772ceb4700 1 -- 172.21.15.146:0/3654623837 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772809f9c0 con 0x7f772809e870 2023-10-03T10:18:30.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.763+0000 7f772d6b5700 1 --2- 172.21.15.146:0/3654623837 >> v2:172.21.15.146:3300/0 conn(0x7f7728131d70 0x7f7728132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.763+0000 7f772ceb4700 1 --2- 172.21.15.146:0/3654623837 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f772809e870 0x7f772809ec40 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f771c009840 tx=0x7f771c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb2f33f1e33d3adc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.763+0000 7f77277fe700 1 -- 172.21.15.146:0/3654623837 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c011830 con 0x7f772809e870 2023-10-03T10:18:30.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.764+0000 7f77277fe700 1 -- 172.21.15.146:0/3654623837 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771c011990 con 0x7f772809e870 2023-10-03T10:18:30.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.764+0000 7f77277fe700 1 -- 172.21.15.146:0/3654623837 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c011d20 con 0x7f772809e870 2023-10-03T10:18:30.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.764+0000 7f772f118700 1 -- 172.21.15.146:0/3654623837 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f772809e870 msgr2=0x7f772809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.764+0000 7f772f118700 1 --2- 172.21.15.146:0/3654623837 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f772809e870 0x7f772809ec40 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f771c009840 tx=0x7f771c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:30.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.764+0000 7f772f118700 1 -- 172.21.15.146:0/3654623837 shutdown_connections 2023-10-03T10:18:30.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.764+0000 7f772f118700 1 --2- 172.21.15.146:0/3654623837 >> v2:172.21.15.146:3300/0 conn(0x7f7728131d70 0x7f7728132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.764+0000 7f772f118700 1 --2- 172.21.15.146:0/3654623837 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f772809e870 0x7f772809ec40 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.764+0000 7f772f118700 1 --2- 172.21.15.146:0/3654623837 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772809f180 0x7f7728131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.764+0000 7f772f118700 1 -- 172.21.15.146:0/3654623837 >> 172.21.15.146:0/3654623837 conn(0x7f77280a4430 msgr2=0x7f77280a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.764+0000 7f772f118700 1 -- 172.21.15.146:0/3654623837 shutdown_connections 2023-10-03T10:18:30.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.764+0000 7f772f118700 1 -- 172.21.15.146:0/3654623837 wait complete. 2023-10-03T10:18:30.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.765+0000 7f772f118700 1 Processor -- start 2023-10-03T10:18:30.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.765+0000 7f772f118700 1 -- start start 2023-10-03T10:18:30.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.766+0000 7f772f118700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772809e870 0x7f772811f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.766+0000 7f772f118700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f772809f180 0x7f772811f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.766+0000 7f772f118700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7728131d70 0x7f772811fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.766+0000 7f772f118700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7728120c90 con 0x7f772809f180 2023-10-03T10:18:30.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.766+0000 7f772f118700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7728122960 con 0x7f772809e870 2023-10-03T10:18:30.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.766+0000 7f772f118700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7728121b20 con 0x7f7728131d70 2023-10-03T10:18:30.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.766+0000 7f7727fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f772809f180 0x7f772811f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.766+0000 7f772ceb4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772809e870 0x7f772811f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.766+0000 7f7727fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f772809f180 0x7f772811f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37796/0 (socket says 172.21.15.146:37796) 2023-10-03T10:18:30.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.766+0000 7f772ceb4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772809e870 0x7f772811f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50430/0 (socket says 172.21.15.146:50430) 2023-10-03T10:18:30.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.766+0000 7f7727fff700 1 -- 172.21.15.146:0/3320815138 learned_addr learned my addr 172.21.15.146:0/3320815138 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:30.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.766+0000 7f772d6b5700 1 --2- 172.21.15.146:0/3320815138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7728131d70 0x7f772811fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.766+0000 7f7727fff700 1 -- 172.21.15.146:0/3320815138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7728131d70 msgr2=0x7f772811fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.766+0000 7f7727fff700 1 --2- 172.21.15.146:0/3320815138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7728131d70 0x7f772811fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.766+0000 7f7727fff700 1 -- 172.21.15.146:0/3320815138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772809e870 msgr2=0x7f772811f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.766+0000 7f7727fff700 1 --2- 172.21.15.146:0/3320815138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772809e870 0x7f772811f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.766+0000 7f7727fff700 1 -- 172.21.15.146:0/3320815138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7720009b30 con 0x7f772809f180 2023-10-03T10:18:30.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.766+0000 7f772ceb4700 1 --2- 172.21.15.146:0/3320815138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772809e870 0x7f772811f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.766+0000 7f7727fff700 1 --2- 172.21.15.146:0/3320815138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f772809f180 0x7f772811f660 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f771400e930 tx=0x7f771400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.767+0000 7f77257fa700 1 -- 172.21.15.146:0/3320815138 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7714013680 con 0x7f772809f180 2023-10-03T10:18:30.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.767+0000 7f77257fa700 1 -- 172.21.15.146:0/3320815138 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77140137e0 con 0x7f772809f180 2023-10-03T10:18:30.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.767+0000 7f772f118700 1 -- 172.21.15.146:0/3320815138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771c0094a0 con 0x7f772809f180 2023-10-03T10:18:30.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.767+0000 7f77257fa700 1 -- 172.21.15.146:0/3320815138 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7714013b70 con 0x7f772809f180 2023-10-03T10:18:30.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.767+0000 7f772f118700 1 -- 172.21.15.146:0/3320815138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77280a2bf0 con 0x7f772809f180 2023-10-03T10:18:30.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.768+0000 7f77257fa700 1 -- 172.21.15.146:0/3320815138 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7714013cd0 con 0x7f772809f180 2023-10-03T10:18:30.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.768+0000 7f772f118700 1 -- 172.21.15.146:0/3320815138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772811be60 con 0x7f772809f180 2023-10-03T10:18:30.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.768+0000 7f77257fa700 1 -- 172.21.15.146:0/3320815138 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f771403f630 con 0x7f772809f180 2023-10-03T10:18:30.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.773+0000 7f77257fa700 1 -- 172.21.15.146:0/3320815138 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f771401bc30 con 0x7f772809f180 2023-10-03T10:18:30.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.849+0000 7f79c5f03700 1 Processor -- start 2023-10-03T10:18:30.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.849+0000 7f79c5f03700 1 -- start start 2023-10-03T10:18:30.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.850+0000 7f79c5f03700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79c009e950 0x7f79c009ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.850+0000 7f79c5f03700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f79c009f260 0x7f79c0131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.850+0000 7f79c5f03700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c0131dd0 0x7f79c0132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.850+0000 7f79c5f03700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c0132750 con 0x7f79c009f260 2023-10-03T10:18:30.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.850+0000 7f79c5f03700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c009b6d0 con 0x7f79c0131dd0 2023-10-03T10:18:30.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.850+0000 7f79c5f03700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79c009afb0 con 0x7f79c009e950 2023-10-03T10:18:30.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.850+0000 7f79beffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f79c009f260 0x7f79c0131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.850+0000 7f79beffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f79c009f260 0x7f79c0131890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37808/0 (socket says 172.21.15.146:37808) 2023-10-03T10:18:30.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.850+0000 7f79bffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c0131dd0 0x7f79c0132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.850+0000 7f79beffd700 1 -- 172.21.15.146:0/2316222903 learned_addr learned my addr 172.21.15.146:0/2316222903 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:30.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.850+0000 7f79bf7fe700 1 --2- 172.21.15.146:0/2316222903 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79c009e950 0x7f79c009ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.850+0000 7f79beffd700 1 -- 172.21.15.146:0/2316222903 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79c009e950 msgr2=0x7f79c009ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.850+0000 7f79beffd700 1 --2- 172.21.15.146:0/2316222903 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79c009e950 0x7f79c009ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.850+0000 7f79beffd700 1 -- 172.21.15.146:0/2316222903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c0131dd0 msgr2=0x7f79c0132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.850+0000 7f79beffd700 1 --2- 172.21.15.146:0/2316222903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c0131dd0 0x7f79c0132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.850+0000 7f79beffd700 1 -- 172.21.15.146:0/2316222903 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c00a0970 con 0x7f79c009f260 2023-10-03T10:18:30.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.850+0000 7f79bffff700 1 --2- 172.21.15.146:0/2316222903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c0131dd0 0x7f79c0132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.850+0000 7f79beffd700 1 --2- 172.21.15.146:0/2316222903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79c009f260 0x7f79c0131890 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f79b40098f0 tx=0x7f79b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c4068e4406e4d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.851+0000 7f79be7fc700 1 -- 172.21.15.146:0/2316222903 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b4011830 con 0x7f79c009f260 2023-10-03T10:18:30.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.851+0000 7f79be7fc700 1 -- 172.21.15.146:0/2316222903 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b4011990 con 0x7f79c009f260 2023-10-03T10:18:30.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.851+0000 7f79be7fc700 1 -- 172.21.15.146:0/2316222903 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b4011d20 con 0x7f79c009f260 2023-10-03T10:18:30.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.851+0000 7f79c5f03700 1 -- 172.21.15.146:0/2316222903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79c009f260 msgr2=0x7f79c0131890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.851+0000 7f79c5f03700 1 --2- 172.21.15.146:0/2316222903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79c009f260 0x7f79c0131890 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f79b40098f0 tx=0x7f79b4009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:30.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.851+0000 7f79c5f03700 1 -- 172.21.15.146:0/2316222903 shutdown_connections 2023-10-03T10:18:30.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.851+0000 7f79c5f03700 1 --2- 172.21.15.146:0/2316222903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c0131dd0 0x7f79c0132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.851+0000 7f79c5f03700 1 --2- 172.21.15.146:0/2316222903 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79c009e950 0x7f79c009ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.851+0000 7f79c5f03700 1 --2- 172.21.15.146:0/2316222903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79c009f260 0x7f79c0131890 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.851+0000 7f79c5f03700 1 -- 172.21.15.146:0/2316222903 >> 172.21.15.146:0/2316222903 conn(0x7f79c00a0f70 msgr2=0x7f79c00a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.851+0000 7f79c5f03700 1 -- 172.21.15.146:0/2316222903 shutdown_connections 2023-10-03T10:18:30.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.851+0000 7f79c5f03700 1 -- 172.21.15.146:0/2316222903 wait complete. 2023-10-03T10:18:30.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.852+0000 7f79c5f03700 1 Processor -- start 2023-10-03T10:18:30.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.852+0000 7f79c5f03700 1 -- start start 2023-10-03T10:18:30.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.853+0000 7f79c5f03700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79c009e950 0x7f79c0136f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.853+0000 7f79c5f03700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c009f260 0x7f79c0137480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.853+0000 7f79c5f03700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79c0131dd0 0x7f79c01c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.853+0000 7f79c5f03700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c009d280 con 0x7f79c0131dd0 2023-10-03T10:18:30.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.853+0000 7f79c5f03700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c01379c0 con 0x7f79c009f260 2023-10-03T10:18:30.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.853+0000 7f79c5f03700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0136b30 con 0x7f79c009e950 2023-10-03T10:18:30.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.853+0000 7f79beffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c009f260 0x7f79c0137480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.853+0000 7f79beffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c009f260 0x7f79c0137480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50454/0 (socket says 172.21.15.146:50454) 2023-10-03T10:18:30.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.853+0000 7f79beffd700 1 -- 172.21.15.146:0/1256646554 learned_addr learned my addr 172.21.15.146:0/1256646554 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:30.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.853+0000 7f79bffff700 1 --2- 172.21.15.146:0/1256646554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79c0131dd0 0x7f79c01c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.853+0000 7f79bf7fe700 1 --2- 172.21.15.146:0/1256646554 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79c009e950 0x7f79c0136f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.853+0000 7f79bffff700 1 -- 172.21.15.146:0/1256646554 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79c009e950 msgr2=0x7f79c0136f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.853+0000 7f79bffff700 1 --2- 172.21.15.146:0/1256646554 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79c009e950 0x7f79c0136f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.853+0000 7f79bffff700 1 -- 172.21.15.146:0/1256646554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c009f260 msgr2=0x7f79c0137480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.853+0000 7f79bffff700 1 --2- 172.21.15.146:0/1256646554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c009f260 0x7f79c0137480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.853+0000 7f79bffff700 1 -- 172.21.15.146:0/1256646554 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b8009a70 con 0x7f79c0131dd0 2023-10-03T10:18:30.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.853+0000 7f79beffd700 1 --2- 172.21.15.146:0/1256646554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c009f260 0x7f79c0137480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.854+0000 7f79bffff700 1 --2- 172.21.15.146:0/1256646554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79c0131dd0 0x7f79c01c80c0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f79b800efc0 tx=0x7f79b800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.854+0000 7f79a7fff700 1 -- 172.21.15.146:0/1256646554 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b800ca90 con 0x7f79c0131dd0 2023-10-03T10:18:30.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.854+0000 7f79a7fff700 1 -- 172.21.15.146:0/1256646554 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b800f040 con 0x7f79c0131dd0 2023-10-03T10:18:30.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.854+0000 7f79c5f03700 1 -- 172.21.15.146:0/1256646554 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b4009550 con 0x7f79c0131dd0 2023-10-03T10:18:30.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.854+0000 7f79a7fff700 1 -- 172.21.15.146:0/1256646554 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b800ce30 con 0x7f79c0131dd0 2023-10-03T10:18:30.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.854+0000 7f79c5f03700 1 -- 172.21.15.146:0/1256646554 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c01381b0 con 0x7f79c0131dd0 2023-10-03T10:18:30.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.855+0000 7f79a7fff700 1 -- 172.21.15.146:0/1256646554 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79b8014480 con 0x7f79c0131dd0 2023-10-03T10:18:30.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.855+0000 7f79c5f03700 1 -- 172.21.15.146:0/1256646554 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c004f2a0 con 0x7f79c0131dd0 2023-10-03T10:18:30.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.855+0000 7f79a7fff700 1 -- 172.21.15.146:0/1256646554 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f79b803fcb0 con 0x7f79c0131dd0 2023-10-03T10:18:30.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.863+0000 7f79a7fff700 1 -- 172.21.15.146:0/1256646554 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79b8012930 con 0x7f79c0131dd0 2023-10-03T10:18:30.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.893+0000 7f89695f5700 1 Processor -- start 2023-10-03T10:18:30.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.893+0000 7f89695f5700 1 -- start start 2023-10-03T10:18:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.893+0000 7f89695f5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f896409e870 0x7f896409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.893+0000 7f89695f5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f896409f180 0x7f8964131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.893+0000 7f89695f5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8964131d70 0x7f8964132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.893+0000 7f89695f5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89640a0920 con 0x7f896409f180 2023-10-03T10:18:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.893+0000 7f89695f5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896409c970 con 0x7f8964131d70 2023-10-03T10:18:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.893+0000 7f89695f5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f896409bab0 con 0x7f896409e870 2023-10-03T10:18:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.893+0000 7f89627fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f896409f180 0x7f8964131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.894+0000 7f89627fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f896409f180 0x7f8964131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37816/0 (socket says 172.21.15.146:37816) 2023-10-03T10:18:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.894+0000 7f89637fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8964131d70 0x7f8964132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.894+0000 7f89627fc700 1 -- 172.21.15.146:0/2081375594 learned_addr learned my addr 172.21.15.146:0/2081375594 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.894+0000 7f8962ffd700 1 --2- 172.21.15.146:0/2081375594 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f896409e870 0x7f896409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.894+0000 7f89627fc700 1 -- 172.21.15.146:0/2081375594 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f896409e870 msgr2=0x7f896409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.894+0000 7f89627fc700 1 --2- 172.21.15.146:0/2081375594 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f896409e870 0x7f896409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.894+0000 7f89627fc700 1 -- 172.21.15.146:0/2081375594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8964131d70 msgr2=0x7f8964132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.894+0000 7f89627fc700 1 --2- 172.21.15.146:0/2081375594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8964131d70 0x7f8964132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.894+0000 7f89627fc700 1 -- 172.21.15.146:0/2081375594 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896409f9c0 con 0x7f896409f180 2023-10-03T10:18:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.894+0000 7f89627fc700 1 --2- 172.21.15.146:0/2081375594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f896409f180 0x7f8964131830 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f8958009920 tx=0x7f8958009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6add40209bc6e0c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.894+0000 7f8961ffb700 1 -- 172.21.15.146:0/2081375594 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8958010a90 con 0x7f896409f180 2023-10-03T10:18:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.894+0000 7f8961ffb700 1 -- 172.21.15.146:0/2081375594 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8958010bf0 con 0x7f896409f180 2023-10-03T10:18:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.894+0000 7f8961ffb700 1 -- 172.21.15.146:0/2081375594 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8958018440 con 0x7f896409f180 2023-10-03T10:18:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.895+0000 7f89695f5700 1 -- 172.21.15.146:0/2081375594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f896409f180 msgr2=0x7f8964131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.895+0000 7f89695f5700 1 --2- 172.21.15.146:0/2081375594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f896409f180 0x7f8964131830 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f8958009920 tx=0x7f8958009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.895+0000 7f89695f5700 1 -- 172.21.15.146:0/2081375594 shutdown_connections 2023-10-03T10:18:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.895+0000 7f89695f5700 1 --2- 172.21.15.146:0/2081375594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8964131d70 0x7f8964132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.895+0000 7f89695f5700 1 --2- 172.21.15.146:0/2081375594 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f896409e870 0x7f896409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.895+0000 7f89695f5700 1 --2- 172.21.15.146:0/2081375594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f896409f180 0x7f8964131830 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.895+0000 7f89695f5700 1 -- 172.21.15.146:0/2081375594 >> 172.21.15.146:0/2081375594 conn(0x7f89640a4430 msgr2=0x7f89640a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.895+0000 7f89695f5700 1 -- 172.21.15.146:0/2081375594 shutdown_connections 2023-10-03T10:18:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.895+0000 7f89695f5700 1 -- 172.21.15.146:0/2081375594 wait complete. 2023-10-03T10:18:30.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.896+0000 7f89695f5700 1 Processor -- start 2023-10-03T10:18:30.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.896+0000 7f89695f5700 1 -- start start 2023-10-03T10:18:30.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.896+0000 7f89695f5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f896409e870 0x7f896411c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.896+0000 7f89695f5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f896409f180 0x7f896411c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.896+0000 7f89695f5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8964131d70 0x7f896411cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.896+0000 7f89695f5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896411f9c0 con 0x7f8964131d70 2023-10-03T10:18:30.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.896+0000 7f89695f5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896412f4d0 con 0x7f896409f180 2023-10-03T10:18:30.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.896+0000 7f89695f5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f896411ef40 con 0x7f896409e870 2023-10-03T10:18:30.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.897+0000 7f89627fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f896409f180 0x7f896411c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.897+0000 7f8962ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f896409e870 0x7f896411c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.897+0000 7f89627fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f896409f180 0x7f896411c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50476/0 (socket says 172.21.15.146:50476) 2023-10-03T10:18:30.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.897+0000 7f89627fc700 1 -- 172.21.15.146:0/1577915487 learned_addr learned my addr 172.21.15.146:0/1577915487 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:30.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.897+0000 7f89637fe700 1 --2- 172.21.15.146:0/1577915487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8964131d70 0x7f896411cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.897+0000 7f8962ffd700 1 -- 172.21.15.146:0/1577915487 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f896409f180 msgr2=0x7f896411c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.897+0000 7f8962ffd700 1 --2- 172.21.15.146:0/1577915487 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f896409f180 0x7f896411c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.897+0000 7f8962ffd700 1 -- 172.21.15.146:0/1577915487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8964131d70 msgr2=0x7f896411cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.897+0000 7f8962ffd700 1 --2- 172.21.15.146:0/1577915487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8964131d70 0x7f896411cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.897+0000 7f8962ffd700 1 -- 172.21.15.146:0/1577915487 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8958009550 con 0x7f896409e870 2023-10-03T10:18:30.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.897+0000 7f89627fc700 1 --2- 172.21.15.146:0/1577915487 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f896409f180 0x7f896411c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.897+0000 7f8962ffd700 1 --2- 172.21.15.146:0/1577915487 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f896409e870 0x7f896411c0e0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f895400e8a0 tx=0x7f895400ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.897+0000 7f894b7fe700 1 -- 172.21.15.146:0/1577915487 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954013680 con 0x7f896409e870 2023-10-03T10:18:30.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.897+0000 7f894b7fe700 1 -- 172.21.15.146:0/1577915487 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89540137e0 con 0x7f896409e870 2023-10-03T10:18:30.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.897+0000 7f89695f5700 1 -- 172.21.15.146:0/1577915487 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f896411f390 con 0x7f896409e870 2023-10-03T10:18:30.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.897+0000 7f894b7fe700 1 -- 172.21.15.146:0/1577915487 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954013b50 con 0x7f896409e870 2023-10-03T10:18:30.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.897+0000 7f89695f5700 1 -- 172.21.15.146:0/1577915487 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896409dba0 con 0x7f896409e870 2023-10-03T10:18:30.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.898+0000 7f894b7fe700 1 -- 172.21.15.146:0/1577915487 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8954013cb0 con 0x7f896409e870 2023-10-03T10:18:30.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.898+0000 7f894b7fe700 1 -- 172.21.15.146:0/1577915487 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f895403f5c0 con 0x7f896409e870 2023-10-03T10:18:30.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.898+0000 7f89695f5700 1 -- 172.21.15.146:0/1577915487 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f896404f2a0 con 0x7f896409e870 2023-10-03T10:18:30.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.903+0000 7f894b7fe700 1 -- 172.21.15.146:0/1577915487 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f895401bde0 con 0x7f896409e870 2023-10-03T10:18:30.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.973+0000 7f772f118700 1 -- 172.21.15.146:0/3320815138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f772804f2a0 con 0x7f772809f180 2023-10-03T10:18:30.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.974+0000 7f77257fa700 1 -- 172.21.15.146:0/3320815138 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7714021020 con 0x7f772809f180 2023-10-03T10:18:30.974 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.976+0000 7f772f118700 1 -- 172.21.15.146:0/3320815138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f772809f180 msgr2=0x7f772811f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.976+0000 7f772f118700 1 --2- 172.21.15.146:0/3320815138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f772809f180 0x7f772811f660 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f771400e930 tx=0x7f771400ec40 comp rx=0 tx=0).stop 2023-10-03T10:18:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.976+0000 7f772f118700 1 -- 172.21.15.146:0/3320815138 shutdown_connections 2023-10-03T10:18:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.976+0000 7f772f118700 1 --2- 172.21.15.146:0/3320815138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7728131d70 0x7f772811fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.976+0000 7f772f118700 1 --2- 172.21.15.146:0/3320815138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f772809e870 0x7f772811f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.976+0000 7f772f118700 1 --2- 172.21.15.146:0/3320815138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f772809f180 0x7f772811f660 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.976+0000 7f772f118700 1 -- 172.21.15.146:0/3320815138 >> 172.21.15.146:0/3320815138 conn(0x7f77280a4430 msgr2=0x7f77281310d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.976+0000 7f772f118700 1 -- 172.21.15.146:0/3320815138 shutdown_connections 2023-10-03T10:18:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:30.976+0000 7f772f118700 1 -- 172.21.15.146:0/3320815138 wait complete. 2023-10-03T10:18:30.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:31.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.061+0000 7f79c5f03700 1 -- 172.21.15.146:0/1256646554 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f79c009b8b0 con 0x7f79c0131dd0 2023-10-03T10:18:31.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.062+0000 7f79a7fff700 1 -- 172.21.15.146:0/1256646554 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f79b8012340 con 0x7f79c0131dd0 2023-10-03T10:18:31.063 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:31.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.064+0000 7f79c5f03700 1 -- 172.21.15.146:0/1256646554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79c0131dd0 msgr2=0x7f79c01c80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.064+0000 7f79c5f03700 1 --2- 172.21.15.146:0/1256646554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79c0131dd0 0x7f79c01c80c0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f79b800efc0 tx=0x7f79b800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.064+0000 7f79c5f03700 1 -- 172.21.15.146:0/1256646554 shutdown_connections 2023-10-03T10:18:31.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.064+0000 7f79c5f03700 1 --2- 172.21.15.146:0/1256646554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79c0131dd0 0x7f79c01c80c0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.064+0000 7f79c5f03700 1 --2- 172.21.15.146:0/1256646554 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79c009e950 0x7f79c0136f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.064+0000 7f79c5f03700 1 --2- 172.21.15.146:0/1256646554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79c009f260 0x7f79c0137480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.064+0000 7f79c5f03700 1 -- 172.21.15.146:0/1256646554 >> 172.21.15.146:0/1256646554 conn(0x7f79c00a0f70 msgr2=0x7f79c00a3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:31.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.064+0000 7f79c5f03700 1 -- 172.21.15.146:0/1256646554 shutdown_connections 2023-10-03T10:18:31.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.064+0000 7f79c5f03700 1 -- 172.21.15.146:0/1256646554 wait complete. 2023-10-03T10:18:31.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:31.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.098+0000 7f89695f5700 1 -- 172.21.15.146:0/1577915487 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f89640a2650 con 0x7f896409e870 2023-10-03T10:18:31.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.098+0000 7f894b7fe700 1 -- 172.21.15.146:0/1577915487 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8954021030 con 0x7f896409e870 2023-10-03T10:18:31.099 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:31.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.100+0000 7f89695f5700 1 -- 172.21.15.146:0/1577915487 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f896409e870 msgr2=0x7f896411c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.100+0000 7f89695f5700 1 --2- 172.21.15.146:0/1577915487 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f896409e870 0x7f896411c0e0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f895400e8a0 tx=0x7f895400ebb0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.100+0000 7f89695f5700 1 -- 172.21.15.146:0/1577915487 shutdown_connections 2023-10-03T10:18:31.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.100+0000 7f89695f5700 1 --2- 172.21.15.146:0/1577915487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8964131d70 0x7f896411cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.100+0000 7f89695f5700 1 --2- 172.21.15.146:0/1577915487 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f896409e870 0x7f896411c0e0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.100+0000 7f89695f5700 1 --2- 172.21.15.146:0/1577915487 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f896409f180 0x7f896411c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.100+0000 7f89695f5700 1 -- 172.21.15.146:0/1577915487 >> 172.21.15.146:0/1577915487 conn(0x7f89640a4430 msgr2=0x7f8964130f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:31.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.100+0000 7f89695f5700 1 -- 172.21.15.146:0/1577915487 shutdown_connections 2023-10-03T10:18:31.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.100+0000 7f89695f5700 1 -- 172.21.15.146:0/1577915487 wait complete. 2023-10-03T10:18:31.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:31.312 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:31.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.433+0000 7fb6465b9700 1 Processor -- start 2023-10-03T10:18:31.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.433+0000 7fb6465b9700 1 -- start start 2023-10-03T10:18:31.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.434+0000 7fb6465b9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb640133ad0 0x7fb640133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.434+0000 7fb6465b9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb640130bc0 0x7fb64013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.434+0000 7fb6465b9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb64006b2d0 con 0x7fb6401300a0 2023-10-03T10:18:31.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.434+0000 7fb6465b9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb640133610 con 0x7fb640130bc0 2023-10-03T10:18:31.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.434+0000 7fb6465b9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64009a500 con 0x7fb640133ad0 2023-10-03T10:18:31.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.434+0000 7fb63ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb640133ad0 0x7fb640133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.434+0000 7fb644b56700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb640130bc0 0x7fb64013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.434+0000 7fb644b56700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb640130bc0 0x7fb64013b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37824/0 (socket says 172.21.15.146:37824) 2023-10-03T10:18:31.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.434+0000 7fb63f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb6401300a0 0x7fb6401304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34482/0 (socket says 172.21.15.146:34482) 2023-10-03T10:18:31.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.434+0000 7fb63ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb640133ad0 0x7fb640133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50484/0 (socket says 172.21.15.146:50484) 2023-10-03T10:18:31.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.434+0000 7fb644b56700 1 -- 172.21.15.146:0/1244569272 learned_addr learned my addr 172.21.15.146:0/1244569272 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:31.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.434+0000 7fb644b56700 1 -- 172.21.15.146:0/1244569272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb640133ad0 msgr2=0x7fb640133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:31.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.434+0000 7fb644b56700 1 --2- 172.21.15.146:0/1244569272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb640133ad0 0x7fb640133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.434+0000 7fb644b56700 1 -- 172.21.15.146:0/1244569272 >> v1:172.21.15.146:6789/0 conn(0x7fb6401300a0 legacy=0x7fb6401304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.434+0000 7fb644b56700 1 -- 172.21.15.146:0/1244569272 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6401338b0 con 0x7fb640130bc0 2023-10-03T10:18:31.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.434+0000 7fb63effd700 1 -- 172.21.15.146:0/1244569272 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710401955 0 0) 0x7fb64006b2d0 con 0x7fb6401300a0 2023-10-03T10:18:31.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.435+0000 7fb644b56700 1 --2- 172.21.15.146:0/1244569272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb640130bc0 0x7fb64013b990 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fb638009e50 tx=0x7fb63800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7f1d40d4b93238 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:31.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.435+0000 7fb63effd700 1 -- 172.21.15.146:0/1244569272 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63800e070 con 0x7fb640130bc0 2023-10-03T10:18:31.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.435+0000 7fb63effd700 1 -- 172.21.15.146:0/1244569272 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63800b910 con 0x7fb640130bc0 2023-10-03T10:18:31.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.435+0000 7fb63effd700 1 -- 172.21.15.146:0/1244569272 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63800bcc0 con 0x7fb640130bc0 2023-10-03T10:18:31.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.435+0000 7fb6465b9700 1 -- 172.21.15.146:0/1244569272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb640130bc0 msgr2=0x7fb64013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.435+0000 7fb6465b9700 1 --2- 172.21.15.146:0/1244569272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb640130bc0 0x7fb64013b990 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fb638009e50 tx=0x7fb63800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:31.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.435+0000 7fb6465b9700 1 -- 172.21.15.146:0/1244569272 shutdown_connections 2023-10-03T10:18:31.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.435+0000 7fb6465b9700 1 --2- 172.21.15.146:0/1244569272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb640130bc0 0x7fb64013b990 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.435+0000 7fb6465b9700 1 --2- 172.21.15.146:0/1244569272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb640133ad0 0x7fb640133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.435+0000 7fb6465b9700 1 -- 172.21.15.146:0/1244569272 >> 172.21.15.146:0/1244569272 conn(0x7fb640099c40 msgr2=0x7fb6400a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:31.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.435+0000 7fb6465b9700 1 -- 172.21.15.146:0/1244569272 shutdown_connections 2023-10-03T10:18:31.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.435+0000 7fb6465b9700 1 -- 172.21.15.146:0/1244569272 wait complete. 2023-10-03T10:18:31.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.436+0000 7fb6465b9700 1 Processor -- start 2023-10-03T10:18:31.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.436+0000 7fb6465b9700 1 -- start start 2023-10-03T10:18:31.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.437+0000 7fb6465b9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb6401300a0 0x7fb640071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.437+0000 7fb6465b9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb640130bc0 0x7fb6400718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.437+0000 7fb6465b9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb640133ad0 0x7fb640071df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.437+0000 7fb6465b9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64011fcc0 con 0x7fb640133ad0 2023-10-03T10:18:31.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.437+0000 7fb6465b9700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64011fec0 con 0x7fb640130bc0 2023-10-03T10:18:31.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.437+0000 7fb6465b9700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb640072740 con 0x7fb6401300a0 2023-10-03T10:18:31.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.437+0000 7fb63f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb640130bc0 0x7fb6400718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.437+0000 7fb644b56700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb640133ad0 0x7fb640071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.437+0000 7fb63f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb640130bc0 0x7fb6400718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50488/0 (socket says 172.21.15.146:50488) 2023-10-03T10:18:31.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.437+0000 7fb644b56700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb640133ad0 0x7fb640071df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37830/0 (socket says 172.21.15.146:37830) 2023-10-03T10:18:31.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.437+0000 7fb63f7fe700 1 -- 172.21.15.146:0/2746089084 learned_addr learned my addr 172.21.15.146:0/2746089084 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:31.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.437+0000 7fb63ffff700 1 --2- 172.21.15.146:0/2746089084 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb6401300a0 0x7fb640071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.437+0000 7fb644b56700 1 -- 172.21.15.146:0/2746089084 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb6401300a0 msgr2=0x7fb640071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.437+0000 7fb644b56700 1 --2- 172.21.15.146:0/2746089084 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb6401300a0 0x7fb640071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.437+0000 7fb644b56700 1 -- 172.21.15.146:0/2746089084 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb640130bc0 msgr2=0x7fb6400718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.437+0000 7fb644b56700 1 --2- 172.21.15.146:0/2746089084 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb640130bc0 0x7fb6400718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.437+0000 7fb644b56700 1 -- 172.21.15.146:0/2746089084 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb638009b30 con 0x7fb640133ad0 2023-10-03T10:18:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.437+0000 7fb63f7fe700 1 --2- 172.21.15.146:0/2746089084 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb640130bc0 0x7fb6400718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.437+0000 7fb644b56700 1 --2- 172.21.15.146:0/2746089084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb640133ad0 0x7fb640071df0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fb638015000 tx=0x7fb638004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.438+0000 7fb63cff9700 1 -- 172.21.15.146:0/2746089084 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb638004880 con 0x7fb640133ad0 2023-10-03T10:18:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.438+0000 7fb63cff9700 1 -- 172.21.15.146:0/2746089084 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6380092e0 con 0x7fb640133ad0 2023-10-03T10:18:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.438+0000 7fb6465b9700 1 -- 172.21.15.146:0/2746089084 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb64011edb0 con 0x7fb640133ad0 2023-10-03T10:18:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.438+0000 7fb63cff9700 1 -- 172.21.15.146:0/2746089084 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63801c660 con 0x7fb640133ad0 2023-10-03T10:18:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.438+0000 7fb6465b9700 1 -- 172.21.15.146:0/2746089084 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb64012f6b0 con 0x7fb640133ad0 2023-10-03T10:18:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.438+0000 7fb63cff9700 1 -- 172.21.15.146:0/2746089084 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb63801c7c0 con 0x7fb640133ad0 2023-10-03T10:18:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.438+0000 7fb63cff9700 1 -- 172.21.15.146:0/2746089084 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb638040df0 con 0x7fb640133ad0 2023-10-03T10:18:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.438+0000 7fb6465b9700 1 -- 172.21.15.146:0/2746089084 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64009cb20 con 0x7fb640133ad0 2023-10-03T10:18:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.443+0000 7fb63cff9700 1 -- 172.21.15.146:0/2746089084 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6380123f0 con 0x7fb640133ad0 2023-10-03T10:18:31.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.626+0000 7fb6465b9700 1 -- 172.21.15.146:0/2746089084 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb64012dd00 con 0x7fb640133ad0 2023-10-03T10:18:31.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.627+0000 7fb63cff9700 1 -- 172.21.15.146:0/2746089084 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb638024760 con 0x7fb640133ad0 2023-10-03T10:18:31.627 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:31.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.629+0000 7fb6465b9700 1 -- 172.21.15.146:0/2746089084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb640133ad0 msgr2=0x7fb640071df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.629+0000 7fb6465b9700 1 --2- 172.21.15.146:0/2746089084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb640133ad0 0x7fb640071df0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fb638015000 tx=0x7fb638004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.629+0000 7fb6465b9700 1 -- 172.21.15.146:0/2746089084 shutdown_connections 2023-10-03T10:18:31.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.629+0000 7fb6465b9700 1 --2- 172.21.15.146:0/2746089084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb640133ad0 0x7fb640071df0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.629+0000 7fb6465b9700 1 --2- 172.21.15.146:0/2746089084 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb6401300a0 0x7fb640071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.629+0000 7fb6465b9700 1 --2- 172.21.15.146:0/2746089084 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb640130bc0 0x7fb6400718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.629+0000 7fb6465b9700 1 -- 172.21.15.146:0/2746089084 >> 172.21.15.146:0/2746089084 conn(0x7fb640099c40 msgr2=0x7fb640132a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:31.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.629+0000 7fb6465b9700 1 -- 172.21.15.146:0/2746089084 shutdown_connections 2023-10-03T10:18:31.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:31.629+0000 7fb6465b9700 1 -- 172.21.15.146:0/2746089084 wait complete. 2023-10-03T10:18:31.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:31.990 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:32.077 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:32.114 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.116+0000 7fe95a9a1700 1 Processor -- start 2023-10-03T10:18:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.116+0000 7fe95a9a1700 1 -- start start 2023-10-03T10:18:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.117+0000 7fe95a9a1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9540a0970 0x7fe9540a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.117+0000 7fe95a9a1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe9540a1280 0x7fe9541338a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.117+0000 7fe95a9a1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe954133de0 0x7fe954134280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.117+0000 7fe95a9a1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9540a2640 con 0x7fe9540a1280 2023-10-03T10:18:32.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.117+0000 7fe95a9a1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95409dde0 con 0x7fe9540a0970 2023-10-03T10:18:32.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.117+0000 7fe95a9a1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9540a2820 con 0x7fe954133de0 2023-10-03T10:18:32.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.117+0000 7fe95999f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9540a0970 0x7fe9540a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.117+0000 7fe95919e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe9540a1280 0x7fe9541338a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.117+0000 7fe95999f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9540a0970 0x7fe9540a0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50500/0 (socket says 172.21.15.146:50500) 2023-10-03T10:18:32.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.117+0000 7fe95999f700 1 -- 172.21.15.146:0/1888367561 learned_addr learned my addr 172.21.15.146:0/1888367561 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:32.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.117+0000 7fe95a1a0700 1 --2- 172.21.15.146:0/1888367561 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe954133de0 0x7fe954134280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.117+0000 7fe95a1a0700 1 -- 172.21.15.146:0/1888367561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9540a0970 msgr2=0x7fe9540a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:32.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.117+0000 7fe95a1a0700 1 --2- 172.21.15.146:0/1888367561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9540a0970 0x7fe9540a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.117+0000 7fe95a1a0700 1 -- 172.21.15.146:0/1888367561 >> v2:172.21.15.146:3300/0 conn(0x7fe9540a1280 msgr2=0x7fe9541338a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:32.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.117+0000 7fe95a1a0700 1 --2- 172.21.15.146:0/1888367561 >> v2:172.21.15.146:3300/0 conn(0x7fe9540a1280 0x7fe9541338a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.117+0000 7fe95a1a0700 1 -- 172.21.15.146:0/1888367561 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9540a2330 con 0x7fe954133de0 2023-10-03T10:18:32.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.117+0000 7fe95999f700 1 --2- 172.21.15.146:0/1888367561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9540a0970 0x7fe9540a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:32.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.117+0000 7fe95919e700 1 --2- 172.21.15.146:0/1888367561 >> v2:172.21.15.146:3300/0 conn(0x7fe9540a1280 0x7fe9541338a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:32.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.118+0000 7fe95a1a0700 1 --2- 172.21.15.146:0/1888367561 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe954133de0 0x7fe954134280 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe94c014a00 tx=0x7fe94c014d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbf85c012ce2cf0f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.118+0000 7fe95899d700 1 -- 172.21.15.146:0/1888367561 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c014ea0 con 0x7fe954133de0 2023-10-03T10:18:32.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.118+0000 7fe95899d700 1 -- 172.21.15.146:0/1888367561 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c00fd50 con 0x7fe954133de0 2023-10-03T10:18:32.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.118+0000 7fe95899d700 1 -- 172.21.15.146:0/1888367561 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c013b20 con 0x7fe954133de0 2023-10-03T10:18:32.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.118+0000 7fe95a9a1700 1 -- 172.21.15.146:0/1888367561 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe954133de0 msgr2=0x7fe954134280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.118+0000 7fe95a9a1700 1 --2- 172.21.15.146:0/1888367561 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe954133de0 0x7fe954134280 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe94c014a00 tx=0x7fe94c014d10 comp rx=0 tx=0).stop 2023-10-03T10:18:32.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.118+0000 7fe95a9a1700 1 -- 172.21.15.146:0/1888367561 shutdown_connections 2023-10-03T10:18:32.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.118+0000 7fe95a9a1700 1 --2- 172.21.15.146:0/1888367561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9540a0970 0x7fe9540a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.118+0000 7fe95a9a1700 1 --2- 172.21.15.146:0/1888367561 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe954133de0 0x7fe954134280 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.118+0000 7fe95a9a1700 1 --2- 172.21.15.146:0/1888367561 >> v2:172.21.15.146:3300/0 conn(0x7fe9540a1280 0x7fe9541338a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.118+0000 7fe95a9a1700 1 -- 172.21.15.146:0/1888367561 >> 172.21.15.146:0/1888367561 conn(0x7fe9540a6070 msgr2=0x7fe9540a6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.119+0000 7fe95a9a1700 1 -- 172.21.15.146:0/1888367561 shutdown_connections 2023-10-03T10:18:32.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.119+0000 7fe95a9a1700 1 -- 172.21.15.146:0/1888367561 wait complete. 2023-10-03T10:18:32.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.119+0000 7fe95a9a1700 1 Processor -- start 2023-10-03T10:18:32.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.120+0000 7fe95a9a1700 1 -- start start 2023-10-03T10:18:32.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.120+0000 7fe95a9a1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9540a0970 0x7fe9541329d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.120+0000 7fe95a9a1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9540a1280 0x7fe954132f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.120+0000 7fe95a9a1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe954133de0 0x7fe9541c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.120+0000 7fe95a9a1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9541200c0 con 0x7fe954133de0 2023-10-03T10:18:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.120+0000 7fe95a9a1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95411f970 con 0x7fe9540a0970 2023-10-03T10:18:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.120+0000 7fe95a9a1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9540a33e0 con 0x7fe9540a1280 2023-10-03T10:18:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.120+0000 7fe95999f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9540a0970 0x7fe9541329d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.120+0000 7fe95a1a0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe954133de0 0x7fe9541c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.120+0000 7fe95a1a0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe954133de0 0x7fe9541c39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37846/0 (socket says 172.21.15.146:37846) 2023-10-03T10:18:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.120+0000 7fe95a1a0700 1 -- 172.21.15.146:0/3808733088 learned_addr learned my addr 172.21.15.146:0/3808733088 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.120+0000 7fe95999f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9540a0970 0x7fe9541329d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50510/0 (socket says 172.21.15.146:50510) 2023-10-03T10:18:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.120+0000 7fe95919e700 1 --2- 172.21.15.146:0/3808733088 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9540a1280 0x7fe954132f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.120+0000 7fe95a1a0700 1 -- 172.21.15.146:0/3808733088 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9540a1280 msgr2=0x7fe954132f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.120+0000 7fe95a1a0700 1 --2- 172.21.15.146:0/3808733088 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9540a1280 0x7fe954132f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.120+0000 7fe95a1a0700 1 -- 172.21.15.146:0/3808733088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9540a0970 msgr2=0x7fe9541329d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.120+0000 7fe95a1a0700 1 --2- 172.21.15.146:0/3808733088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9540a0970 0x7fe9541329d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.120+0000 7fe95a1a0700 1 -- 172.21.15.146:0/3808733088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe950009550 con 0x7fe954133de0 2023-10-03T10:18:32.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.120+0000 7fe95999f700 1 --2- 172.21.15.146:0/3808733088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9540a0970 0x7fe9541329d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:32.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.121+0000 7fe95a1a0700 1 --2- 172.21.15.146:0/3808733088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe954133de0 0x7fe9541c39b0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fe94c014d50 tx=0x7fe94c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.121+0000 7fe94a7fc700 1 -- 172.21.15.146:0/3808733088 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c014ea0 con 0x7fe954133de0 2023-10-03T10:18:32.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.121+0000 7fe94a7fc700 1 -- 172.21.15.146:0/3808733088 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c004240 con 0x7fe954133de0 2023-10-03T10:18:32.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.121+0000 7fe94a7fc700 1 -- 172.21.15.146:0/3808733088 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c0045f0 con 0x7fe954133de0 2023-10-03T10:18:32.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.121+0000 7fe95a9a1700 1 -- 172.21.15.146:0/3808733088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9440094a0 con 0x7fe954133de0 2023-10-03T10:18:32.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.121+0000 7fe95a9a1700 1 -- 172.21.15.146:0/3808733088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94c014660 con 0x7fe954133de0 2023-10-03T10:18:32.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.122+0000 7fe94a7fc700 1 -- 172.21.15.146:0/3808733088 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe94c004750 con 0x7fe954133de0 2023-10-03T10:18:32.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.122+0000 7fe95a9a1700 1 -- 172.21.15.146:0/3808733088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe95404f2a0 con 0x7fe954133de0 2023-10-03T10:18:32.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.122+0000 7fe94a7fc700 1 -- 172.21.15.146:0/3808733088 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe94c049560 con 0x7fe954133de0 2023-10-03T10:18:32.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.131+0000 7fe94a7fc700 1 -- 172.21.15.146:0/3808733088 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe94c003e10 con 0x7fe954133de0 2023-10-03T10:18:32.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.215+0000 7f8e81a97700 1 Processor -- start 2023-10-03T10:18:32.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.215+0000 7f8e81a97700 1 -- start start 2023-10-03T10:18:32.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.215+0000 7f8e81a97700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8e7c099e20 0x7f8e7c09a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.215+0000 7f8e81a97700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8e7c09a730 0x7f8e7c130350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.215+0000 7f8e81a97700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8e7c130890 0x7f8e7c130ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.215+0000 7f8e81a97700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e7c09bf50 con 0x7f8e7c099e20 2023-10-03T10:18:32.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.215+0000 7f8e81a97700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c131220 con 0x7f8e7c130890 2023-10-03T10:18:32.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.216+0000 7f8e81a97700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c099a60 con 0x7f8e7c09a730 2023-10-03T10:18:32.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.216+0000 7f8e7b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8e7c099e20 0x7f8e7c09a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.216+0000 7f8e7bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8e7c130890 0x7f8e7c130ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.216+0000 7f8e7b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8e7c099e20 0x7f8e7c09a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37854/0 (socket says 172.21.15.146:37854) 2023-10-03T10:18:32.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.216+0000 7f8e7bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8e7c130890 0x7f8e7c130ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50514/0 (socket says 172.21.15.146:50514) 2023-10-03T10:18:32.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.216+0000 7f8e7b7fe700 1 -- 172.21.15.146:0/2490849439 learned_addr learned my addr 172.21.15.146:0/2490849439 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:32.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.216+0000 7f8e7affd700 1 --2- 172.21.15.146:0/2490849439 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8e7c09a730 0x7f8e7c130350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.216+0000 7f8e7b7fe700 1 -- 172.21.15.146:0/2490849439 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8e7c09a730 msgr2=0x7f8e7c130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:32.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.216+0000 7f8e7b7fe700 1 --2- 172.21.15.146:0/2490849439 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8e7c09a730 0x7f8e7c130350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.216+0000 7f8e7b7fe700 1 -- 172.21.15.146:0/2490849439 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8e7c130890 msgr2=0x7f8e7c130ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:32.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.216+0000 7f8e7b7fe700 1 --2- 172.21.15.146:0/2490849439 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8e7c130890 0x7f8e7c130ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.216+0000 7f8e7b7fe700 1 -- 172.21.15.146:0/2490849439 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7c09b230 con 0x7f8e7c099e20 2023-10-03T10:18:32.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.216+0000 7f8e7b7fe700 1 --2- 172.21.15.146:0/2490849439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e7c099e20 0x7f8e7c09a1f0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00bbc0 tx=0x7f8e6c00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eddf7f2320ad6f40 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.216+0000 7f8e7a7fc700 1 -- 172.21.15.146:0/2490849439 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c005e30 con 0x7f8e7c099e20 2023-10-03T10:18:32.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.216+0000 7f8e7a7fc700 1 -- 172.21.15.146:0/2490849439 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c004030 con 0x7f8e7c099e20 2023-10-03T10:18:32.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.216+0000 7f8e7a7fc700 1 -- 172.21.15.146:0/2490849439 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c0043e0 con 0x7f8e7c099e20 2023-10-03T10:18:32.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.217+0000 7f8e81a97700 1 -- 172.21.15.146:0/2490849439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e7c099e20 msgr2=0x7f8e7c09a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.217+0000 7f8e81a97700 1 --2- 172.21.15.146:0/2490849439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e7c099e20 0x7f8e7c09a1f0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00bbc0 tx=0x7f8e6c00bed0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.217+0000 7f8e81a97700 1 -- 172.21.15.146:0/2490849439 shutdown_connections 2023-10-03T10:18:32.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.217+0000 7f8e81a97700 1 --2- 172.21.15.146:0/2490849439 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8e7c130890 0x7f8e7c130ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.217+0000 7f8e81a97700 1 --2- 172.21.15.146:0/2490849439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e7c099e20 0x7f8e7c09a1f0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.217+0000 7f8e81a97700 1 --2- 172.21.15.146:0/2490849439 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8e7c09a730 0x7f8e7c130350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.217+0000 7f8e81a97700 1 -- 172.21.15.146:0/2490849439 >> 172.21.15.146:0/2490849439 conn(0x7f8e7c0a2980 msgr2=0x7f8e7c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.217+0000 7f8e81a97700 1 -- 172.21.15.146:0/2490849439 shutdown_connections 2023-10-03T10:18:32.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.217+0000 7f8e81a97700 1 -- 172.21.15.146:0/2490849439 wait complete. 2023-10-03T10:18:32.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.218+0000 7f8e81a97700 1 Processor -- start 2023-10-03T10:18:32.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.219+0000 7f8e81a97700 1 -- start start 2023-10-03T10:18:32.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.219+0000 7f8e81a97700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e7c099e20 0x7f8e7c11a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.219+0000 7f8e81a97700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8e7c09a730 0x7f8e7c11ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.219+0000 7f8e81a97700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8e7c130890 0x7f8e7c11b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.219+0000 7f8e81a97700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c11c350 con 0x7f8e7c099e20 2023-10-03T10:18:32.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.219+0000 7f8e81a97700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c11d5a0 con 0x7f8e7c09a730 2023-10-03T10:18:32.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.219+0000 7f8e81a97700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c11c930 con 0x7f8e7c130890 2023-10-03T10:18:32.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.220+0000 7f8e7affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8e7c09a730 0x7f8e7c11ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.220+0000 7f8e7affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8e7c09a730 0x7f8e7c11ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50528/0 (socket says 172.21.15.146:50528) 2023-10-03T10:18:32.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.220+0000 7f8e7affd700 1 -- 172.21.15.146:0/1238047424 learned_addr learned my addr 172.21.15.146:0/1238047424 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:32.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.220+0000 7f8e7bfff700 1 --2- 172.21.15.146:0/1238047424 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8e7c130890 0x7f8e7c11b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.220+0000 7f8e7b7fe700 1 --2- 172.21.15.146:0/1238047424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e7c099e20 0x7f8e7c11a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.220+0000 7f8e7affd700 1 -- 172.21.15.146:0/1238047424 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8e7c130890 msgr2=0x7f8e7c11b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.220+0000 7f8e7affd700 1 --2- 172.21.15.146:0/1238047424 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8e7c130890 0x7f8e7c11b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.220+0000 7f8e7affd700 1 -- 172.21.15.146:0/1238047424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e7c099e20 msgr2=0x7f8e7c11a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.220+0000 7f8e7affd700 1 --2- 172.21.15.146:0/1238047424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e7c099e20 0x7f8e7c11a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.220+0000 7f8e7affd700 1 -- 172.21.15.146:0/1238047424 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c00b7a0 con 0x7f8e7c09a730 2023-10-03T10:18:32.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.220+0000 7f8e7bfff700 1 --2- 172.21.15.146:0/1238047424 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8e7c130890 0x7f8e7c11b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:32.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.220+0000 7f8e7affd700 1 --2- 172.21.15.146:0/1238047424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8e7c09a730 0x7f8e7c11ac80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f8e7000e9e0 tx=0x7f8e7000ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.220+0000 7f8e63fff700 1 -- 172.21.15.146:0/1238047424 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70009710 con 0x7f8e7c09a730 2023-10-03T10:18:32.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.220+0000 7f8e63fff700 1 -- 172.21.15.146:0/1238047424 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7000c850 con 0x7f8e7c09a730 2023-10-03T10:18:32.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.220+0000 7f8e81a97700 1 -- 172.21.15.146:0/1238047424 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e7c11df80 con 0x7f8e7c09a730 2023-10-03T10:18:32.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.220+0000 7f8e63fff700 1 -- 172.21.15.146:0/1238047424 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7000cbc0 con 0x7f8e7c09a730 2023-10-03T10:18:32.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.220+0000 7f8e81a97700 1 -- 172.21.15.146:0/1238047424 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e7c09b470 con 0x7f8e7c09a730 2023-10-03T10:18:32.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.221+0000 7f8e63fff700 1 -- 172.21.15.146:0/1238047424 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e7000cd20 con 0x7f8e7c09a730 2023-10-03T10:18:32.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.221+0000 7f8e63fff700 1 -- 172.21.15.146:0/1238047424 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8e7003f7a0 con 0x7f8e7c09a730 2023-10-03T10:18:32.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.222+0000 7f8e81a97700 1 -- 172.21.15.146:0/1238047424 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e7c070740 con 0x7f8e7c09a730 2023-10-03T10:18:32.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.226+0000 7f8e63fff700 1 -- 172.21.15.146:0/1238047424 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e700232f0 con 0x7f8e7c09a730 2023-10-03T10:18:32.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.261+0000 7f0b349fb700 1 Processor -- start 2023-10-03T10:18:32.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.261+0000 7f0b349fb700 1 -- start start 2023-10-03T10:18:32.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.262+0000 7f0b349fb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b3009e870 0x7f0b3009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.262+0000 7f0b349fb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b30131f40 0x7f0b30139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.262+0000 7f0b349fb700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3009c970 con 0x7f0b3009f180 2023-10-03T10:18:32.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.262+0000 7f0b349fb700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b300a0920 con 0x7f0b3009e870 2023-10-03T10:18:32.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.262+0000 7f0b349fb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3009f9c0 con 0x7f0b30131f40 2023-10-03T10:18:32.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.262+0000 7f0b2ed9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b30131f40 0x7f0b30139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.262+0000 7f0b2e59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b3009e870 0x7f0b3009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.262+0000 7f0b2dd9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0b3009f180 0x7f0b30131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34486/0 (socket says 172.21.15.146:34486) 2023-10-03T10:18:32.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.262+0000 7f0b2dd9b700 1 -- 172.21.15.146:0/917525779 learned_addr learned my addr 172.21.15.146:0/917525779 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:32.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.263+0000 7f0b2e59c700 1 -- 172.21.15.146:0/917525779 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b30131f40 msgr2=0x7f0b30139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:32.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.263+0000 7f0b2e59c700 1 --2- 172.21.15.146:0/917525779 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b30131f40 0x7f0b30139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.263+0000 7f0b2e59c700 1 -- 172.21.15.146:0/917525779 >> v1:172.21.15.146:6789/0 conn(0x7f0b3009f180 legacy=0x7f0b30131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.263+0000 7f0b2e59c700 1 -- 172.21.15.146:0/917525779 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3009bab0 con 0x7f0b3009e870 2023-10-03T10:18:32.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.263+0000 7f0b2d59a700 1 -- 172.21.15.146:0/917525779 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353786893 0 0) 0x7f0b3009c970 con 0x7f0b3009f180 2023-10-03T10:18:32.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.263+0000 7f0b2ed9d700 1 --2- 172.21.15.146:0/917525779 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b30131f40 0x7f0b30139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:32.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.263+0000 7f0b2e59c700 1 --2- 172.21.15.146:0/917525779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b3009e870 0x7f0b3009ec40 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f0b20009840 tx=0x7f0b20009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac3b916044a7186 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.263+0000 7f0b2d59a700 1 -- 172.21.15.146:0/917525779 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b20011830 con 0x7f0b3009e870 2023-10-03T10:18:32.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.263+0000 7f0b2d59a700 1 -- 172.21.15.146:0/917525779 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b20011990 con 0x7f0b3009e870 2023-10-03T10:18:32.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.263+0000 7f0b2d59a700 1 -- 172.21.15.146:0/917525779 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b20011d20 con 0x7f0b3009e870 2023-10-03T10:18:32.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.264+0000 7f0b349fb700 1 -- 172.21.15.146:0/917525779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b3009e870 msgr2=0x7f0b3009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.264+0000 7f0b349fb700 1 --2- 172.21.15.146:0/917525779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b3009e870 0x7f0b3009ec40 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f0b20009840 tx=0x7f0b20009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.264+0000 7f0b349fb700 1 -- 172.21.15.146:0/917525779 shutdown_connections 2023-10-03T10:18:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.264+0000 7f0b349fb700 1 --2- 172.21.15.146:0/917525779 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b30131f40 0x7f0b30139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.264+0000 7f0b349fb700 1 --2- 172.21.15.146:0/917525779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b3009e870 0x7f0b3009ec40 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.264+0000 7f0b349fb700 1 -- 172.21.15.146:0/917525779 >> 172.21.15.146:0/917525779 conn(0x7f0b300a4430 msgr2=0x7f0b300a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.264+0000 7f0b349fb700 1 -- 172.21.15.146:0/917525779 shutdown_connections 2023-10-03T10:18:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.264+0000 7f0b349fb700 1 -- 172.21.15.146:0/917525779 wait complete. 2023-10-03T10:18:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.265+0000 7f0b349fb700 1 Processor -- start 2023-10-03T10:18:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.265+0000 7f0b349fb700 1 -- start start 2023-10-03T10:18:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.265+0000 7f0b349fb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b3009e870 0x7f0b3006c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.265+0000 7f0b349fb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b3009f180 0x7f0b3006c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.265+0000 7f0b349fb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b30131f40 0x7f0b301c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.265+0000 7f0b349fb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b30131440 con 0x7f0b3009e870 2023-10-03T10:18:32.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.265+0000 7f0b349fb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b301223a0 con 0x7f0b3009f180 2023-10-03T10:18:32.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.265+0000 7f0b349fb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3006bd70 con 0x7f0b30131f40 2023-10-03T10:18:32.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.265+0000 7f0b2dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b3009f180 0x7f0b3006c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.265+0000 7f0b2dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b3009f180 0x7f0b3006c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50538/0 (socket says 172.21.15.146:50538) 2023-10-03T10:18:32.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.265+0000 7f0b2dd9b700 1 -- 172.21.15.146:0/3332648322 learned_addr learned my addr 172.21.15.146:0/3332648322 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:32.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.265+0000 7f0b2e59c700 1 --2- 172.21.15.146:0/3332648322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b3009e870 0x7f0b3006c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.265+0000 7f0b2ed9d700 1 --2- 172.21.15.146:0/3332648322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b30131f40 0x7f0b301c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.266+0000 7f0b2dd9b700 1 -- 172.21.15.146:0/3332648322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b30131f40 msgr2=0x7f0b301c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.266+0000 7f0b2dd9b700 1 --2- 172.21.15.146:0/3332648322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b30131f40 0x7f0b301c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.266+0000 7f0b2dd9b700 1 -- 172.21.15.146:0/3332648322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b3009e870 msgr2=0x7f0b3006c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.266+0000 7f0b2dd9b700 1 --2- 172.21.15.146:0/3332648322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b3009e870 0x7f0b3006c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.266+0000 7f0b2dd9b700 1 -- 172.21.15.146:0/3332648322 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b28009a70 con 0x7f0b3009f180 2023-10-03T10:18:32.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.266+0000 7f0b2dd9b700 1 --2- 172.21.15.146:0/3332648322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b3009f180 0x7f0b3006c850 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f0b2400c550 tx=0x7f0b2400c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.266+0000 7f0b1effd700 1 -- 172.21.15.146:0/3332648322 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b24004c80 con 0x7f0b3009f180 2023-10-03T10:18:32.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.266+0000 7f0b1effd700 1 -- 172.21.15.146:0/3332648322 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b24004e00 con 0x7f0b3009f180 2023-10-03T10:18:32.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.266+0000 7f0b349fb700 1 -- 172.21.15.146:0/3332648322 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b200094a0 con 0x7f0b3009f180 2023-10-03T10:18:32.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.266+0000 7f0b1effd700 1 -- 172.21.15.146:0/3332648322 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b24007310 con 0x7f0b3009f180 2023-10-03T10:18:32.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.266+0000 7f0b349fb700 1 -- 172.21.15.146:0/3332648322 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3006d430 con 0x7f0b3009f180 2023-10-03T10:18:32.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.267+0000 7f0b1effd700 1 -- 172.21.15.146:0/3332648322 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b24007470 con 0x7f0b3009f180 2023-10-03T10:18:32.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.267+0000 7f0b1effd700 1 -- 172.21.15.146:0/3332648322 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0b2403f260 con 0x7f0b3009f180 2023-10-03T10:18:32.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.268+0000 7f0b349fb700 1 -- 172.21.15.146:0/3332648322 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b30122200 con 0x7f0b3009f180 2023-10-03T10:18:32.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.272+0000 7f0b1effd700 1 -- 172.21.15.146:0/3332648322 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b30122200 con 0x7f0b3009f180 2023-10-03T10:18:32.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.330+0000 7fe95a9a1700 1 -- 172.21.15.146:0/3808733088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe954133450 con 0x7fe954133de0 2023-10-03T10:18:32.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.330+0000 7fe94a7fc700 1 -- 172.21.15.146:0/3808733088 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe94c021030 con 0x7fe954133de0 2023-10-03T10:18:32.331 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:32.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.332+0000 7fe95a9a1700 1 -- 172.21.15.146:0/3808733088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe954133de0 msgr2=0x7fe9541c39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.332+0000 7fe95a9a1700 1 --2- 172.21.15.146:0/3808733088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe954133de0 0x7fe9541c39b0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fe94c014d50 tx=0x7fe94c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.332+0000 7fe95a9a1700 1 -- 172.21.15.146:0/3808733088 shutdown_connections 2023-10-03T10:18:32.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.332+0000 7fe95a9a1700 1 --2- 172.21.15.146:0/3808733088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe954133de0 0x7fe9541c39b0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.332+0000 7fe95a9a1700 1 --2- 172.21.15.146:0/3808733088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9540a0970 0x7fe9541329d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.332+0000 7fe95a9a1700 1 --2- 172.21.15.146:0/3808733088 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe9540a1280 0x7fe954132f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.332+0000 7fe95a9a1700 1 -- 172.21.15.146:0/3808733088 >> 172.21.15.146:0/3808733088 conn(0x7fe9540a6070 msgr2=0x7fe95409c590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.332+0000 7fe95a9a1700 1 -- 172.21.15.146:0/3808733088 shutdown_connections 2023-10-03T10:18:32.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.332+0000 7fe95a9a1700 1 -- 172.21.15.146:0/3808733088 wait complete. 2023-10-03T10:18:32.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:32.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.451+0000 7f8e81a97700 1 -- 172.21.15.146:0/1238047424 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e7c04f2a0 con 0x7f8e7c09a730 2023-10-03T10:18:32.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.452+0000 7f8e63fff700 1 -- 172.21.15.146:0/1238047424 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8e7001ae80 con 0x7f8e7c09a730 2023-10-03T10:18:32.453 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:32.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.454+0000 7f8e81a97700 1 -- 172.21.15.146:0/1238047424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8e7c09a730 msgr2=0x7f8e7c11ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.454+0000 7f8e81a97700 1 --2- 172.21.15.146:0/1238047424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8e7c09a730 0x7f8e7c11ac80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f8e7000e9e0 tx=0x7f8e7000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.454+0000 7f8e81a97700 1 -- 172.21.15.146:0/1238047424 shutdown_connections 2023-10-03T10:18:32.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.454+0000 7f8e81a97700 1 --2- 172.21.15.146:0/1238047424 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8e7c130890 0x7f8e7c11b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.454+0000 7f8e81a97700 1 --2- 172.21.15.146:0/1238047424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e7c099e20 0x7f8e7c11a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.454+0000 7f8e81a97700 1 --2- 172.21.15.146:0/1238047424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8e7c09a730 0x7f8e7c11ac80 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.454+0000 7f8e81a97700 1 -- 172.21.15.146:0/1238047424 >> 172.21.15.146:0/1238047424 conn(0x7f8e7c0a2980 msgr2=0x7f8e7c12d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.454+0000 7f8e81a97700 1 -- 172.21.15.146:0/1238047424 shutdown_connections 2023-10-03T10:18:32.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.454+0000 7f8e81a97700 1 -- 172.21.15.146:0/1238047424 wait complete. 2023-10-03T10:18:32.466 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:32.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.483+0000 7f0b349fb700 1 -- 172.21.15.146:0/3332648322 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0b30122200 con 0x7f0b3009f180 2023-10-03T10:18:32.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.484+0000 7f0b1effd700 1 -- 172.21.15.146:0/3332648322 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b30122200 con 0x7f0b3009f180 2023-10-03T10:18:32.484 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:32.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.486+0000 7f0b349fb700 1 -- 172.21.15.146:0/3332648322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b3009f180 msgr2=0x7f0b3006c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.486+0000 7f0b349fb700 1 --2- 172.21.15.146:0/3332648322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b3009f180 0x7f0b3006c850 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f0b2400c550 tx=0x7f0b2400c860 comp rx=0 tx=0).stop 2023-10-03T10:18:32.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.486+0000 7f0b349fb700 1 -- 172.21.15.146:0/3332648322 shutdown_connections 2023-10-03T10:18:32.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.486+0000 7f0b349fb700 1 --2- 172.21.15.146:0/3332648322 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0b30131f40 0x7f0b301c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.486+0000 7f0b349fb700 1 --2- 172.21.15.146:0/3332648322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b3009e870 0x7f0b3006c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.486+0000 7f0b349fb700 1 --2- 172.21.15.146:0/3332648322 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b3009f180 0x7f0b3006c850 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.486+0000 7f0b349fb700 1 -- 172.21.15.146:0/3332648322 >> 172.21.15.146:0/3332648322 conn(0x7f0b300a4430 msgr2=0x7f0b3009c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.486+0000 7f0b349fb700 1 -- 172.21.15.146:0/3332648322 shutdown_connections 2023-10-03T10:18:32.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.486+0000 7f0b349fb700 1 -- 172.21.15.146:0/3332648322 wait complete. 2023-10-03T10:18:32.498 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:32.642 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:32.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.764+0000 7f24b6cf6700 1 Processor -- start 2023-10-03T10:18:32.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.764+0000 7f24b6cf6700 1 -- start start 2023-10-03T10:18:32.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.764+0000 7f24b6cf6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f24b009d860 0x7f24b009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.764+0000 7f24b6cf6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24b0130eb0 0x7f24b0138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.764+0000 7f24b6cf6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b009aaa0 con 0x7f24b009e170 2023-10-03T10:18:32.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.764+0000 7f24b6cf6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b009f870 con 0x7f24b009d860 2023-10-03T10:18:32.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.764+0000 7f24b6cf6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24b009b360 con 0x7f24b0130eb0 2023-10-03T10:18:32.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.764+0000 7f24b4a92700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f24b009d860 0x7f24b009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.764+0000 7f24b5293700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24b0130eb0 0x7f24b0138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.764+0000 7f24affff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f24b009e170 0x7f24b01307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34500/0 (socket says 172.21.15.146:34500) 2023-10-03T10:18:32.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.764+0000 7f24affff700 1 -- 172.21.15.146:0/3301274027 learned_addr learned my addr 172.21.15.146:0/3301274027 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:32.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.765+0000 7f24b4a92700 1 -- 172.21.15.146:0/3301274027 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24b0130eb0 msgr2=0x7f24b0138a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:32.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.765+0000 7f24b4a92700 1 --2- 172.21.15.146:0/3301274027 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24b0130eb0 0x7f24b0138a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.765+0000 7f24b4a92700 1 -- 172.21.15.146:0/3301274027 >> v1:172.21.15.146:6789/0 conn(0x7f24b009e170 legacy=0x7f24b01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.765+0000 7f24b4a92700 1 -- 172.21.15.146:0/3301274027 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b009b620 con 0x7f24b009d860 2023-10-03T10:18:32.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.765+0000 7f24b5293700 1 --2- 172.21.15.146:0/3301274027 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24b0130eb0 0x7f24b0138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:32.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.765+0000 7f24af7fe700 1 -- 172.21.15.146:0/3301274027 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015813734 0 0) 0x7f24b009aaa0 con 0x7f24b009e170 2023-10-03T10:18:32.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.765+0000 7f24b4a92700 1 --2- 172.21.15.146:0/3301274027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24b009d860 0x7f24b009dc30 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009840 tx=0x7f24a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97bd6967c9edd0c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.765+0000 7f24af7fe700 1 -- 172.21.15.146:0/3301274027 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a4011830 con 0x7f24b009d860 2023-10-03T10:18:32.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.765+0000 7f24af7fe700 1 -- 172.21.15.146:0/3301274027 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a4011990 con 0x7f24b009d860 2023-10-03T10:18:32.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.765+0000 7f24af7fe700 1 -- 172.21.15.146:0/3301274027 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a4011d20 con 0x7f24b009d860 2023-10-03T10:18:32.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.765+0000 7f24b6cf6700 1 -- 172.21.15.146:0/3301274027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24b009d860 msgr2=0x7f24b009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.765+0000 7f24b6cf6700 1 --2- 172.21.15.146:0/3301274027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24b009d860 0x7f24b009dc30 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009840 tx=0x7f24a4009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:32.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.765+0000 7f24b6cf6700 1 -- 172.21.15.146:0/3301274027 shutdown_connections 2023-10-03T10:18:32.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.765+0000 7f24b6cf6700 1 --2- 172.21.15.146:0/3301274027 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24b0130eb0 0x7f24b0138a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.765+0000 7f24b6cf6700 1 --2- 172.21.15.146:0/3301274027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24b009d860 0x7f24b009dc30 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.765+0000 7f24b6cf6700 1 -- 172.21.15.146:0/3301274027 >> 172.21.15.146:0/3301274027 conn(0x7f24b0099c40 msgr2=0x7f24b00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.766+0000 7f24b6cf6700 1 -- 172.21.15.146:0/3301274027 shutdown_connections 2023-10-03T10:18:32.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.766+0000 7f24b6cf6700 1 -- 172.21.15.146:0/3301274027 wait complete. 2023-10-03T10:18:32.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.766+0000 7f24b6cf6700 1 Processor -- start 2023-10-03T10:18:32.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.766+0000 7f24b6cf6700 1 -- start start 2023-10-03T10:18:32.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.767+0000 7f24b6cf6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24b009d860 0x7f24b011e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.767+0000 7f24b6cf6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24b009e170 0x7f24b011e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.767+0000 7f24b6cf6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24b0130eb0 0x7f24b011ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.767+0000 7f24b6cf6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b011fee0 con 0x7f24b009d860 2023-10-03T10:18:32.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.767+0000 7f24b6cf6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b0121f60 con 0x7f24b0130eb0 2023-10-03T10:18:32.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.767+0000 7f24b6cf6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24b0071fc0 con 0x7f24b009e170 2023-10-03T10:18:32.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.767+0000 7f24b4a92700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24b009d860 0x7f24b011e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.767+0000 7f24b4a92700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24b009d860 0x7f24b011e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37912/0 (socket says 172.21.15.146:37912) 2023-10-03T10:18:32.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.767+0000 7f24b5293700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24b0130eb0 0x7f24b011ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.767+0000 7f24affff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24b009e170 0x7f24b011e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.767+0000 7f24b4a92700 1 -- 172.21.15.146:0/1676298351 learned_addr learned my addr 172.21.15.146:0/1676298351 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:32.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.767+0000 7f24affff700 1 -- 172.21.15.146:0/1676298351 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24b0130eb0 msgr2=0x7f24b011ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.767+0000 7f24affff700 1 --2- 172.21.15.146:0/1676298351 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24b0130eb0 0x7f24b011ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.767+0000 7f24affff700 1 -- 172.21.15.146:0/1676298351 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24b009d860 msgr2=0x7f24b011e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.767+0000 7f24affff700 1 --2- 172.21.15.146:0/1676298351 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24b009d860 0x7f24b011e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.767+0000 7f24affff700 1 -- 172.21.15.146:0/1676298351 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a8009a70 con 0x7f24b009e170 2023-10-03T10:18:32.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.767+0000 7f24b4a92700 1 --2- 172.21.15.146:0/1676298351 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24b009d860 0x7f24b011e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:32.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.768+0000 7f24affff700 1 --2- 172.21.15.146:0/1676298351 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24b009e170 0x7f24b011e900 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f249c00c470 tx=0x7f249c00c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.768+0000 7f24ad7fa700 1 -- 172.21.15.146:0/1676298351 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c004c80 con 0x7f24b009e170 2023-10-03T10:18:32.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.768+0000 7f24ad7fa700 1 -- 172.21.15.146:0/1676298351 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c004de0 con 0x7f24b009e170 2023-10-03T10:18:32.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.768+0000 7f24b6cf6700 1 -- 172.21.15.146:0/1676298351 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a40094a0 con 0x7f24b009e170 2023-10-03T10:18:32.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.768+0000 7f24ad7fa700 1 -- 172.21.15.146:0/1676298351 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c007310 con 0x7f24b009e170 2023-10-03T10:18:32.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.768+0000 7f24b6cf6700 1 -- 172.21.15.146:0/1676298351 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b009c900 con 0x7f24b009e170 2023-10-03T10:18:32.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.768+0000 7f24ad7fa700 1 -- 172.21.15.146:0/1676298351 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f249c007470 con 0x7f24b009e170 2023-10-03T10:18:32.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.769+0000 7f24ad7fa700 1 -- 172.21.15.146:0/1676298351 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f249c03f210 con 0x7f24b009e170 2023-10-03T10:18:32.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.769+0000 7f24b6cf6700 1 -- 172.21.15.146:0/1676298351 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b004f2a0 con 0x7f24b009e170 2023-10-03T10:18:32.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.773+0000 7f24ad7fa700 1 -- 172.21.15.146:0/1676298351 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f249c007720 con 0x7f24b009e170 2023-10-03T10:18:32.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.957+0000 7f24b6cf6700 1 -- 172.21.15.146:0/1676298351 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f24b006c3b0 con 0x7f24b009e170 2023-10-03T10:18:32.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.957+0000 7f24ad7fa700 1 -- 172.21.15.146:0/1676298351 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f249c01b340 con 0x7f24b009e170 2023-10-03T10:18:32.958 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:32.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.959+0000 7f24b6cf6700 1 -- 172.21.15.146:0/1676298351 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24b009e170 msgr2=0x7f24b011e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.959+0000 7f24b6cf6700 1 --2- 172.21.15.146:0/1676298351 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24b009e170 0x7f24b011e900 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f249c00c470 tx=0x7f249c00c780 comp rx=0 tx=0).stop 2023-10-03T10:18:32.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.959+0000 7f24b6cf6700 1 -- 172.21.15.146:0/1676298351 shutdown_connections 2023-10-03T10:18:32.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.959+0000 7f24b6cf6700 1 --2- 172.21.15.146:0/1676298351 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24b0130eb0 0x7f24b011ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.959+0000 7f24b6cf6700 1 --2- 172.21.15.146:0/1676298351 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24b009d860 0x7f24b011e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.959+0000 7f24b6cf6700 1 --2- 172.21.15.146:0/1676298351 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24b009e170 0x7f24b011e900 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.959+0000 7f24b6cf6700 1 -- 172.21.15.146:0/1676298351 >> 172.21.15.146:0/1676298351 conn(0x7f24b0099c40 msgr2=0x7f24b00a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.959+0000 7f24b6cf6700 1 -- 172.21.15.146:0/1676298351 shutdown_connections 2023-10-03T10:18:32.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:32.959+0000 7f24b6cf6700 1 -- 172.21.15.146:0/1676298351 wait complete. 2023-10-03T10:18:32.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:33.346 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:33.468 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:33.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.471+0000 7f1072534700 1 Processor -- start 2023-10-03T10:18:33.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.471+0000 7f1072534700 1 -- start start 2023-10-03T10:18:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.472+0000 7f1072534700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f106c133a70 0x7f106c133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.472+0000 7f1072534700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f106c0a08e0 0x7f106c0a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.472+0000 7f1072534700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106c133640 con 0x7f106c0a1290 2023-10-03T10:18:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.472+0000 7f1072534700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106c0a1d50 con 0x7f106c133a70 2023-10-03T10:18:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.472+0000 7f1072534700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f106c0a1710 con 0x7f106c0a08e0 2023-10-03T10:18:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.472+0000 7f106b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f106c0a08e0 0x7f106c0a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.472+0000 7f106bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f106c133a70 0x7f106c133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.472+0000 7f106bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f106c133a70 0x7f106c133e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37920/0 (socket says 172.21.15.146:37920) 2023-10-03T10:18:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.472+0000 7f106b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f106c0a08e0 0x7f106c0a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54284/0 (socket says 172.21.15.146:54284) 2023-10-03T10:18:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.472+0000 7f1070ad1700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f106c0a1290 0x7f106c13a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34504/0 (socket says 172.21.15.146:34504) 2023-10-03T10:18:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.472+0000 7f106bfff700 1 -- 172.21.15.146:0/4155100278 learned_addr learned my addr 172.21.15.146:0/4155100278 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:33.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.472+0000 7f106bfff700 1 -- 172.21.15.146:0/4155100278 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f106c0a08e0 msgr2=0x7f106c0a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:33.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.472+0000 7f106bfff700 1 --2- 172.21.15.146:0/4155100278 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f106c0a08e0 0x7f106c0a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.472+0000 7f106bfff700 1 -- 172.21.15.146:0/4155100278 >> v1:172.21.15.146:6789/0 conn(0x7f106c0a1290 legacy=0x7f106c13a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.472+0000 7f106bfff700 1 -- 172.21.15.146:0/4155100278 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c09b620 con 0x7f106c133a70 2023-10-03T10:18:33.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.472+0000 7f106affd700 1 -- 172.21.15.146:0/4155100278 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2040792452 0 0) 0x7f106c133640 con 0x7f106c0a1290 2023-10-03T10:18:33.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.472+0000 7f106b7fe700 1 --2- 172.21.15.146:0/4155100278 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f106c0a08e0 0x7f106c0a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.472+0000 7f106bfff700 1 --2- 172.21.15.146:0/4155100278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f106c133a70 0x7f106c133e40 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f105c006fd0 tx=0x7f105c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76261a17265f1115 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.473+0000 7f106affd700 1 -- 172.21.15.146:0/4155100278 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c005e30 con 0x7f106c133a70 2023-10-03T10:18:33.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.473+0000 7f106affd700 1 -- 172.21.15.146:0/4155100278 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c004030 con 0x7f106c133a70 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.473+0000 7f106affd700 1 -- 172.21.15.146:0/4155100278 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c0043e0 con 0x7f106c133a70 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.473+0000 7f1072534700 1 -- 172.21.15.146:0/4155100278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f106c133a70 msgr2=0x7f106c133e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.473+0000 7f1072534700 1 --2- 172.21.15.146:0/4155100278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f106c133a70 0x7f106c133e40 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f105c006fd0 tx=0x7f105c009bd0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.473+0000 7f1072534700 1 -- 172.21.15.146:0/4155100278 shutdown_connections 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.473+0000 7f1072534700 1 --2- 172.21.15.146:0/4155100278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f106c133a70 0x7f106c133e40 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.473+0000 7f1072534700 1 --2- 172.21.15.146:0/4155100278 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f106c0a08e0 0x7f106c0a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.473+0000 7f1072534700 1 -- 172.21.15.146:0/4155100278 >> 172.21.15.146:0/4155100278 conn(0x7f106c0a2980 msgr2=0x7f106c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.473+0000 7f1072534700 1 -- 172.21.15.146:0/4155100278 shutdown_connections 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.473+0000 7f1072534700 1 -- 172.21.15.146:0/4155100278 wait complete. 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.474+0000 7f1072534700 1 Processor -- start 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.474+0000 7f1072534700 1 -- start start 2023-10-03T10:18:33.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.475+0000 7f1072534700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f106c0a08e0 0x7f106c11ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.475+0000 7f1072534700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f106c0a1290 0x7f106c11ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.475+0000 7f1072534700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f106c133a70 0x7f106c11f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.475+0000 7f1072534700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c09a3c0 con 0x7f106c0a08e0 2023-10-03T10:18:33.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.475+0000 7f1072534700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106c072720 con 0x7f106c0a1290 2023-10-03T10:18:33.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.475+0000 7f1072534700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f106c120e60 con 0x7f106c133a70 2023-10-03T10:18:33.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.475+0000 7f106bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f106c0a08e0 0x7f106c11ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.475+0000 7f106b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f106c0a1290 0x7f106c11ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.475+0000 7f106b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f106c0a1290 0x7f106c11ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50564/0 (socket says 172.21.15.146:50564) 2023-10-03T10:18:33.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.475+0000 7f1070ad1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f106c133a70 0x7f106c11f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.475+0000 7f106b7fe700 1 -- 172.21.15.146:0/2193922719 learned_addr learned my addr 172.21.15.146:0/2193922719 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:33.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.475+0000 7f106bfff700 1 --2- 172.21.15.146:0/2193922719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f106c0a08e0 0x7f106c11ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37934/0 (socket says 172.21.15.146:37934) 2023-10-03T10:18:33.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.475+0000 7f106b7fe700 1 -- 172.21.15.146:0/2193922719 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f106c133a70 msgr2=0x7f106c11f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.475+0000 7f106b7fe700 1 --2- 172.21.15.146:0/2193922719 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f106c133a70 0x7f106c11f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.476+0000 7f106b7fe700 1 -- 172.21.15.146:0/2193922719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f106c0a08e0 msgr2=0x7f106c11ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.476+0000 7f106b7fe700 1 --2- 172.21.15.146:0/2193922719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f106c0a08e0 0x7f106c11ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.476+0000 7f106b7fe700 1 -- 172.21.15.146:0/2193922719 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10600094a0 con 0x7f106c0a1290 2023-10-03T10:18:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.476+0000 7f1070ad1700 1 --2- 172.21.15.146:0/2193922719 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f106c133a70 0x7f106c11f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.476+0000 7f106b7fe700 1 --2- 172.21.15.146:0/2193922719 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f106c0a1290 0x7f106c11ef70 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f106000ebe0 tx=0x7f106000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.476+0000 7f1068ff9700 1 -- 172.21.15.146:0/2193922719 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106000c850 con 0x7f106c0a1290 2023-10-03T10:18:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.476+0000 7f1068ff9700 1 -- 172.21.15.146:0/2193922719 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106000c9b0 con 0x7f106c0a1290 2023-10-03T10:18:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.476+0000 7f1068ff9700 1 -- 172.21.15.146:0/2193922719 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106000cd40 con 0x7f106c0a1290 2023-10-03T10:18:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.476+0000 7f1072534700 1 -- 172.21.15.146:0/2193922719 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105c009500 con 0x7f106c0a1290 2023-10-03T10:18:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.476+0000 7f1072534700 1 -- 172.21.15.146:0/2193922719 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106c121460 con 0x7f106c0a1290 2023-10-03T10:18:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.477+0000 7f1068ff9700 1 -- 172.21.15.146:0/2193922719 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1060013470 con 0x7f106c0a1290 2023-10-03T10:18:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.477+0000 7f1072534700 1 -- 172.21.15.146:0/2193922719 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f106c04f2a0 con 0x7f106c0a1290 2023-10-03T10:18:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.477+0000 7f1068ff9700 1 -- 172.21.15.146:0/2193922719 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f106003fb50 con 0x7f106c0a1290 2023-10-03T10:18:33.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.482+0000 7f1068ff9700 1 -- 172.21.15.146:0/2193922719 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1060017020 con 0x7f106c0a1290 2023-10-03T10:18:33.499 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:33.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.595+0000 7f1c2984d700 1 Processor -- start 2023-10-03T10:18:33.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.596+0000 7f1c2984d700 1 -- start start 2023-10-03T10:18:33.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.596+0000 7f1c2984d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c2409e870 0x7f1c2409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.596+0000 7f1c2984d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1c2409f180 0x7f1c24131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.596+0000 7f1c2984d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c24131d70 0x7f1c24132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.596+0000 7f1c2984d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c240a0920 con 0x7f1c2409f180 2023-10-03T10:18:33.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.596+0000 7f1c2984d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2409c970 con 0x7f1c2409e870 2023-10-03T10:18:33.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.596+0000 7f1c2984d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2409bab0 con 0x7f1c24131d70 2023-10-03T10:18:33.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.596+0000 7f1c22ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c2409e870 0x7f1c2409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.596+0000 7f1c237fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c24131d70 0x7f1c24132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.597+0000 7f1c22ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c2409e870 0x7f1c2409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50578/0 (socket says 172.21.15.146:50578) 2023-10-03T10:18:33.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.597+0000 7f1c22ffd700 1 -- 172.21.15.146:0/3003284160 learned_addr learned my addr 172.21.15.146:0/3003284160 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:33.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.597+0000 7f1c227fc700 1 --2- 172.21.15.146:0/3003284160 >> v2:172.21.15.146:3300/0 conn(0x7f1c2409f180 0x7f1c24131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.597+0000 7f1c22ffd700 1 -- 172.21.15.146:0/3003284160 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c24131d70 msgr2=0x7f1c24132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:33.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.597+0000 7f1c22ffd700 1 --2- 172.21.15.146:0/3003284160 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c24131d70 0x7f1c24132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.597+0000 7f1c22ffd700 1 -- 172.21.15.146:0/3003284160 >> v2:172.21.15.146:3300/0 conn(0x7f1c2409f180 msgr2=0x7f1c24131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:33.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.597+0000 7f1c22ffd700 1 --2- 172.21.15.146:0/3003284160 >> v2:172.21.15.146:3300/0 conn(0x7f1c2409f180 0x7f1c24131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.597+0000 7f1c22ffd700 1 -- 172.21.15.146:0/3003284160 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2409f9c0 con 0x7f1c2409e870 2023-10-03T10:18:33.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.597+0000 7f1c237fe700 1 --2- 172.21.15.146:0/3003284160 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c24131d70 0x7f1c24132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.597+0000 7f1c22ffd700 1 --2- 172.21.15.146:0/3003284160 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c2409e870 0x7f1c2409ec40 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009920 tx=0x7f1c14009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73bf80f4745a2326 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.597+0000 7f1c21ffb700 1 -- 172.21.15.146:0/3003284160 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14010a90 con 0x7f1c2409e870 2023-10-03T10:18:33.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.597+0000 7f1c21ffb700 1 -- 172.21.15.146:0/3003284160 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c14010bf0 con 0x7f1c2409e870 2023-10-03T10:18:33.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.597+0000 7f1c21ffb700 1 -- 172.21.15.146:0/3003284160 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14018440 con 0x7f1c2409e870 2023-10-03T10:18:33.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.598+0000 7f1c2984d700 1 -- 172.21.15.146:0/3003284160 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c2409e870 msgr2=0x7f1c2409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.598+0000 7f1c2984d700 1 --2- 172.21.15.146:0/3003284160 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c2409e870 0x7f1c2409ec40 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009920 tx=0x7f1c14009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:33.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.598+0000 7f1c2984d700 1 -- 172.21.15.146:0/3003284160 shutdown_connections 2023-10-03T10:18:33.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.598+0000 7f1c2984d700 1 --2- 172.21.15.146:0/3003284160 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c2409e870 0x7f1c2409ec40 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.598+0000 7f1c2984d700 1 --2- 172.21.15.146:0/3003284160 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c24131d70 0x7f1c24132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.598+0000 7f1c2984d700 1 --2- 172.21.15.146:0/3003284160 >> v2:172.21.15.146:3300/0 conn(0x7f1c2409f180 0x7f1c24131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.598+0000 7f1c2984d700 1 -- 172.21.15.146:0/3003284160 >> 172.21.15.146:0/3003284160 conn(0x7f1c240a4430 msgr2=0x7f1c240a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.598+0000 7f1c2984d700 1 -- 172.21.15.146:0/3003284160 shutdown_connections 2023-10-03T10:18:33.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.598+0000 7f1c2984d700 1 -- 172.21.15.146:0/3003284160 wait complete. 2023-10-03T10:18:33.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.599+0000 7f1c2984d700 1 Processor -- start 2023-10-03T10:18:33.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.599+0000 7f1c2984d700 1 -- start start 2023-10-03T10:18:33.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.600+0000 7f1c2984d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c2409e870 0x7f1c2411b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.600+0000 7f1c2984d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c2409f180 0x7f1c2411b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.600+0000 7f1c2984d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c24131d70 0x7f1c2411bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.600+0000 7f1c2984d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2411cc70 con 0x7f1c2409e870 2023-10-03T10:18:33.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.600+0000 7f1c2984d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2411d290 con 0x7f1c24131d70 2023-10-03T10:18:33.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.600+0000 7f1c2984d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2411dec0 con 0x7f1c2409f180 2023-10-03T10:18:33.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.600+0000 7f1c22ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c2409e870 0x7f1c2411b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.600+0000 7f1c227fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c2409f180 0x7f1c2411b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.600+0000 7f1c22ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c2409e870 0x7f1c2411b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37948/0 (socket says 172.21.15.146:37948) 2023-10-03T10:18:33.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.600+0000 7f1c227fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c2409f180 0x7f1c2411b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54322/0 (socket says 172.21.15.146:54322) 2023-10-03T10:18:33.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.600+0000 7f1c22ffd700 1 -- 172.21.15.146:0/2203232098 learned_addr learned my addr 172.21.15.146:0/2203232098 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:33.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.600+0000 7f1c237fe700 1 --2- 172.21.15.146:0/2203232098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c24131d70 0x7f1c2411bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.601+0000 7f1c22ffd700 1 -- 172.21.15.146:0/2203232098 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c2409f180 msgr2=0x7f1c2411b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.601+0000 7f1c22ffd700 1 --2- 172.21.15.146:0/2203232098 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c2409f180 0x7f1c2411b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.601+0000 7f1c22ffd700 1 -- 172.21.15.146:0/2203232098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c24131d70 msgr2=0x7f1c2411bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.601+0000 7f1c22ffd700 1 --2- 172.21.15.146:0/2203232098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c24131d70 0x7f1c2411bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.601+0000 7f1c22ffd700 1 -- 172.21.15.146:0/2203232098 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c009a70 con 0x7f1c2409e870 2023-10-03T10:18:33.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.601+0000 7f1c22ffd700 1 --2- 172.21.15.146:0/2203232098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c2409e870 0x7f1c2411b060 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009c70 tx=0x7f1c14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.601+0000 7f1c0bfff700 1 -- 172.21.15.146:0/2203232098 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14003ab0 con 0x7f1c2409e870 2023-10-03T10:18:33.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.601+0000 7f1c0bfff700 1 -- 172.21.15.146:0/2203232098 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c14003c30 con 0x7f1c2409e870 2023-10-03T10:18:33.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.601+0000 7f1c2984d700 1 -- 172.21.15.146:0/2203232098 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c14009550 con 0x7f1c2409e870 2023-10-03T10:18:33.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.601+0000 7f1c0bfff700 1 -- 172.21.15.146:0/2203232098 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14010a10 con 0x7f1c2409e870 2023-10-03T10:18:33.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.601+0000 7f1c2984d700 1 -- 172.21.15.146:0/2203232098 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c240a2bd0 con 0x7f1c2409e870 2023-10-03T10:18:33.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.602+0000 7f1c0bfff700 1 -- 172.21.15.146:0/2203232098 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1c1401f070 con 0x7f1c2409e870 2023-10-03T10:18:33.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.602+0000 7f1c0bfff700 1 -- 172.21.15.146:0/2203232098 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1c14044f80 con 0x7f1c2409e870 2023-10-03T10:18:33.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.602+0000 7f1c09ffb700 1 -- 172.21.15.146:0/2203232098 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bfc0052e0 con 0x7f1c2409e870 2023-10-03T10:18:33.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.607+0000 7f1c0bfff700 1 -- 172.21.15.146:0/2203232098 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1c14027080 con 0x7f1c2409e870 2023-10-03T10:18:33.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.624+0000 7ffa1116e700 1 Processor -- start 2023-10-03T10:18:33.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.625+0000 7ffa1116e700 1 -- start start 2023-10-03T10:18:33.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.625+0000 7ffa1116e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffa0c09e870 0x7ffa0c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.625+0000 7ffa1116e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa0c09f180 0x7ffa0c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.625+0000 7ffa1116e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffa0c131d70 0x7ffa0c132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.625+0000 7ffa1116e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0c0a0920 con 0x7ffa0c131d70 2023-10-03T10:18:33.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.625+0000 7ffa1116e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c09c970 con 0x7ffa0c09f180 2023-10-03T10:18:33.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.625+0000 7ffa1116e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c09bab0 con 0x7ffa0c09e870 2023-10-03T10:18:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.625+0000 7ffa0a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa0c09f180 0x7ffa0c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.625+0000 7ffa0a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa0c09f180 0x7ffa0c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50596/0 (socket says 172.21.15.146:50596) 2023-10-03T10:18:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.625+0000 7ffa0a59c700 1 -- 172.21.15.146:0/1125111203 learned_addr learned my addr 172.21.15.146:0/1125111203 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.625+0000 7ffa0b59e700 1 --2- 172.21.15.146:0/1125111203 >> v2:172.21.15.146:3300/0 conn(0x7ffa0c131d70 0x7ffa0c132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.625+0000 7ffa0ad9d700 1 --2- 172.21.15.146:0/1125111203 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffa0c09e870 0x7ffa0c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.625+0000 7ffa0a59c700 1 -- 172.21.15.146:0/1125111203 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffa0c09e870 msgr2=0x7ffa0c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.626+0000 7ffa0a59c700 1 --2- 172.21.15.146:0/1125111203 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffa0c09e870 0x7ffa0c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.626+0000 7ffa0a59c700 1 -- 172.21.15.146:0/1125111203 >> v2:172.21.15.146:3300/0 conn(0x7ffa0c131d70 msgr2=0x7ffa0c132210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.626+0000 7ffa0a59c700 1 --2- 172.21.15.146:0/1125111203 >> v2:172.21.15.146:3300/0 conn(0x7ffa0c131d70 0x7ffa0c132210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.626+0000 7ffa0a59c700 1 -- 172.21.15.146:0/1125111203 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c09f9c0 con 0x7ffa0c09f180 2023-10-03T10:18:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.626+0000 7ffa0b59e700 1 --2- 172.21.15.146:0/1125111203 >> v2:172.21.15.146:3300/0 conn(0x7ffa0c131d70 0x7ffa0c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.626+0000 7ffa0a59c700 1 --2- 172.21.15.146:0/1125111203 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa0c09f180 0x7ffa0c131830 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ffa000098f0 tx=0x7ffa00009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b4ffef35496aa8e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.626+0000 7ffa09d9b700 1 -- 172.21.15.146:0/1125111203 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa00011830 con 0x7ffa0c09f180 2023-10-03T10:18:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.626+0000 7ffa09d9b700 1 -- 172.21.15.146:0/1125111203 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa00011990 con 0x7ffa0c09f180 2023-10-03T10:18:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.626+0000 7ffa09d9b700 1 -- 172.21.15.146:0/1125111203 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa00011d20 con 0x7ffa0c09f180 2023-10-03T10:18:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.626+0000 7ffa1116e700 1 -- 172.21.15.146:0/1125111203 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa0c09f180 msgr2=0x7ffa0c131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.626+0000 7ffa1116e700 1 --2- 172.21.15.146:0/1125111203 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa0c09f180 0x7ffa0c131830 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ffa000098f0 tx=0x7ffa00009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.626+0000 7ffa1116e700 1 -- 172.21.15.146:0/1125111203 shutdown_connections 2023-10-03T10:18:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.626+0000 7ffa1116e700 1 --2- 172.21.15.146:0/1125111203 >> v2:172.21.15.146:3300/0 conn(0x7ffa0c131d70 0x7ffa0c132210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.626+0000 7ffa1116e700 1 --2- 172.21.15.146:0/1125111203 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffa0c09e870 0x7ffa0c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.626+0000 7ffa1116e700 1 --2- 172.21.15.146:0/1125111203 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa0c09f180 0x7ffa0c131830 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.626+0000 7ffa1116e700 1 -- 172.21.15.146:0/1125111203 >> 172.21.15.146:0/1125111203 conn(0x7ffa0c0a4430 msgr2=0x7ffa0c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.626+0000 7ffa1116e700 1 -- 172.21.15.146:0/1125111203 shutdown_connections 2023-10-03T10:18:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.627+0000 7ffa1116e700 1 -- 172.21.15.146:0/1125111203 wait complete. 2023-10-03T10:18:33.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.628+0000 7ffa1116e700 1 Processor -- start 2023-10-03T10:18:33.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.628+0000 7ffa1116e700 1 -- start start 2023-10-03T10:18:33.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.629+0000 7ffa1116e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffa0c09e870 0x7ffa0c11be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.629+0000 7ffa1116e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa0c09f180 0x7ffa0c11c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.629+0000 7ffa1116e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa0c131d70 0x7ffa0c11c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.629+0000 7ffa1116e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c120370 con 0x7ffa0c09f180 2023-10-03T10:18:33.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.629+0000 7ffa1116e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c11daa0 con 0x7ffa0c131d70 2023-10-03T10:18:33.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.629+0000 7ffa1116e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c11e0c0 con 0x7ffa0c09e870 2023-10-03T10:18:33.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.629+0000 7ffa0ad9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffa0c09e870 0x7ffa0c11be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.629+0000 7ffa0ad9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffa0c09e870 0x7ffa0c11be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:54338/0 (socket says 172.21.15.146:54338) 2023-10-03T10:18:33.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.629+0000 7ffa0ad9d700 1 -- 172.21.15.146:0/1152867562 learned_addr learned my addr 172.21.15.146:0/1152867562 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.629+0000 7ffa0a59c700 1 --2- 172.21.15.146:0/1152867562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa0c09f180 0x7ffa0c11c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.629+0000 7ffa0b59e700 1 --2- 172.21.15.146:0/1152867562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa0c131d70 0x7ffa0c11c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.629+0000 7ffa0ad9d700 1 -- 172.21.15.146:0/1152867562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa0c131d70 msgr2=0x7ffa0c11c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.629+0000 7ffa0ad9d700 1 --2- 172.21.15.146:0/1152867562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa0c131d70 0x7ffa0c11c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.629+0000 7ffa0ad9d700 1 -- 172.21.15.146:0/1152867562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa0c09f180 msgr2=0x7ffa0c11c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.629+0000 7ffa0ad9d700 1 --2- 172.21.15.146:0/1152867562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa0c09f180 0x7ffa0c11c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.629+0000 7ffa0ad9d700 1 -- 172.21.15.146:0/1152867562 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa04009a70 con 0x7ffa0c09e870 2023-10-03T10:18:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.629+0000 7ffa0b59e700 1 --2- 172.21.15.146:0/1152867562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa0c131d70 0x7ffa0c11c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.629+0000 7ffa0a59c700 1 --2- 172.21.15.146:0/1152867562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa0c09f180 0x7ffa0c11c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.630+0000 7ffa0ad9d700 1 --2- 172.21.15.146:0/1152867562 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffa0c09e870 0x7ffa0c11be90 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc013ec0 tx=0x7ff9fc0094c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.630+0000 7ff9f37fe700 1 -- 172.21.15.146:0/1152867562 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc018040 con 0x7ffa0c09e870 2023-10-03T10:18:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.630+0000 7ffa1116e700 1 -- 172.21.15.146:0/1152867562 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa00009550 con 0x7ffa0c09e870 2023-10-03T10:18:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.630+0000 7ff9f37fe700 1 -- 172.21.15.146:0/1152867562 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9fc009ad0 con 0x7ffa0c09e870 2023-10-03T10:18:33.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.630+0000 7ff9f37fe700 1 -- 172.21.15.146:0/1152867562 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc009e40 con 0x7ffa0c09e870 2023-10-03T10:18:33.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.630+0000 7ffa1116e700 1 -- 172.21.15.146:0/1152867562 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0c0a2c20 con 0x7ffa0c09e870 2023-10-03T10:18:33.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.631+0000 7ffa1116e700 1 -- 172.21.15.146:0/1152867562 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa0c0a0210 con 0x7ffa0c09e870 2023-10-03T10:18:33.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.631+0000 7ff9f37fe700 1 -- 172.21.15.146:0/1152867562 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff9fc007070 con 0x7ffa0c09e870 2023-10-03T10:18:33.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.631+0000 7ff9f37fe700 1 -- 172.21.15.146:0/1152867562 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff9fc047750 con 0x7ffa0c09e870 2023-10-03T10:18:33.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.635+0000 7ff9f37fe700 1 -- 172.21.15.146:0/1152867562 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff9fc025770 con 0x7ffa0c09e870 2023-10-03T10:18:33.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.682+0000 7f1072534700 1 -- 172.21.15.146:0/2193922719 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f106c1320e0 con 0x7f106c0a1290 2023-10-03T10:18:33.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.682+0000 7f1068ff9700 1 -- 172.21.15.146:0/2193922719 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f106000cea0 con 0x7f106c0a1290 2023-10-03T10:18:33.683 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:33.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.685+0000 7f1072534700 1 -- 172.21.15.146:0/2193922719 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f106c0a1290 msgr2=0x7f106c11ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.685+0000 7f1072534700 1 --2- 172.21.15.146:0/2193922719 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f106c0a1290 0x7f106c11ef70 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f106000ebe0 tx=0x7f106000eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.685+0000 7f1072534700 1 -- 172.21.15.146:0/2193922719 shutdown_connections 2023-10-03T10:18:33.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.685+0000 7f1072534700 1 --2- 172.21.15.146:0/2193922719 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f106c133a70 0x7f106c11f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.685+0000 7f1072534700 1 --2- 172.21.15.146:0/2193922719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f106c0a08e0 0x7f106c11ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.685+0000 7f1072534700 1 --2- 172.21.15.146:0/2193922719 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f106c0a1290 0x7f106c11ef70 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.685+0000 7f1072534700 1 -- 172.21.15.146:0/2193922719 >> 172.21.15.146:0/2193922719 conn(0x7f106c0a2980 msgr2=0x7f106c09d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.685+0000 7f1072534700 1 -- 172.21.15.146:0/2193922719 shutdown_connections 2023-10-03T10:18:33.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.685+0000 7f1072534700 1 -- 172.21.15.146:0/2193922719 wait complete. 2023-10-03T10:18:33.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:33.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.801+0000 7f1c09ffb700 1 -- 172.21.15.146:0/2203232098 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1bfc005590 con 0x7f1c2409e870 2023-10-03T10:18:33.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.802+0000 7f1c0bfff700 1 -- 172.21.15.146:0/2203232098 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1c1401d020 con 0x7f1c2409e870 2023-10-03T10:18:33.802 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:33.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.804+0000 7f1c09ffb700 1 -- 172.21.15.146:0/2203232098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c2409e870 msgr2=0x7f1c2411b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.804+0000 7f1c09ffb700 1 --2- 172.21.15.146:0/2203232098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c2409e870 0x7f1c2411b060 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009c70 tx=0x7f1c14004750 comp rx=0 tx=0).stop 2023-10-03T10:18:33.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.804+0000 7f1c09ffb700 1 -- 172.21.15.146:0/2203232098 shutdown_connections 2023-10-03T10:18:33.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.804+0000 7f1c09ffb700 1 --2- 172.21.15.146:0/2203232098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c24131d70 0x7f1c2411bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.804+0000 7f1c09ffb700 1 --2- 172.21.15.146:0/2203232098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c2409e870 0x7f1c2411b060 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.804+0000 7f1c09ffb700 1 --2- 172.21.15.146:0/2203232098 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1c2409f180 0x7f1c2411b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.804+0000 7f1c09ffb700 1 -- 172.21.15.146:0/2203232098 >> 172.21.15.146:0/2203232098 conn(0x7f1c240a4430 msgr2=0x7f1c2412ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.804+0000 7f1c09ffb700 1 -- 172.21.15.146:0/2203232098 shutdown_connections 2023-10-03T10:18:33.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.804+0000 7f1c09ffb700 1 -- 172.21.15.146:0/2203232098 wait complete. 2023-10-03T10:18:33.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:33.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.829+0000 7ffa1116e700 1 -- 172.21.15.146:0/1152867562 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffa0c04f2a0 con 0x7ffa0c09e870 2023-10-03T10:18:33.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.830+0000 7ff9f37fe700 1 -- 172.21.15.146:0/1152867562 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff9fc022020 con 0x7ffa0c09e870 2023-10-03T10:18:33.830 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:33.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.832+0000 7ffa1116e700 1 -- 172.21.15.146:0/1152867562 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffa0c09e870 msgr2=0x7ffa0c11be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.832+0000 7ffa1116e700 1 --2- 172.21.15.146:0/1152867562 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffa0c09e870 0x7ffa0c11be90 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc013ec0 tx=0x7ff9fc0094c0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.832+0000 7ffa1116e700 1 -- 172.21.15.146:0/1152867562 shutdown_connections 2023-10-03T10:18:33.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.832+0000 7ffa1116e700 1 --2- 172.21.15.146:0/1152867562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffa0c131d70 0x7ffa0c11c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.832+0000 7ffa1116e700 1 --2- 172.21.15.146:0/1152867562 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffa0c09e870 0x7ffa0c11be90 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.832+0000 7ffa1116e700 1 --2- 172.21.15.146:0/1152867562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa0c09f180 0x7ffa0c11c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.832+0000 7ffa1116e700 1 -- 172.21.15.146:0/1152867562 >> 172.21.15.146:0/1152867562 conn(0x7ffa0c0a4430 msgr2=0x7ffa0c130df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.832+0000 7ffa1116e700 1 -- 172.21.15.146:0/1152867562 shutdown_connections 2023-10-03T10:18:33.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:33.832+0000 7ffa1116e700 1 -- 172.21.15.146:0/1152867562 wait complete. 2023-10-03T10:18:33.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:33.973 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:34.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.095+0000 7fe38cae1700 1 Processor -- start 2023-10-03T10:18:34.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.095+0000 7fe38cae1700 1 -- start start 2023-10-03T10:18:34.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.095+0000 7fe38cae1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38809ad40 0x7fe388133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.095+0000 7fe38cae1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe388133f70 0x7fe3881343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.095+0000 7fe38cae1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe3880a0a70 0x7fe3880a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.095+0000 7fe38cae1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3880a3b60 con 0x7fe388133f70 2023-10-03T10:18:34.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.095+0000 7fe38cae1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3881348e0 con 0x7fe38809ad40 2023-10-03T10:18:34.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.095+0000 7fe38cae1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe38809b110 con 0x7fe3880a0a70 2023-10-03T10:18:34.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.096+0000 7fe38659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38809ad40 0x7fe388133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.096+0000 7fe385d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe388133f70 0x7fe3881343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.096+0000 7fe386d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe3880a0a70 0x7fe3880a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.096+0000 7fe38659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38809ad40 0x7fe388133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50612/0 (socket says 172.21.15.146:50612) 2023-10-03T10:18:34.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.096+0000 7fe38659c700 1 -- 172.21.15.146:0/774195747 learned_addr learned my addr 172.21.15.146:0/774195747 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:34.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.096+0000 7fe385d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe388133f70 0x7fe3881343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37980/0 (socket says 172.21.15.146:37980) 2023-10-03T10:18:34.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.096+0000 7fe386d9d700 1 -- 172.21.15.146:0/774195747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38809ad40 msgr2=0x7fe388133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.096+0000 7fe386d9d700 1 --2- 172.21.15.146:0/774195747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38809ad40 0x7fe388133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.096+0000 7fe386d9d700 1 -- 172.21.15.146:0/774195747 >> v2:172.21.15.146:3300/0 conn(0x7fe388133f70 msgr2=0x7fe3881343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.096+0000 7fe386d9d700 1 --2- 172.21.15.146:0/774195747 >> v2:172.21.15.146:3300/0 conn(0x7fe388133f70 0x7fe3881343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.096+0000 7fe386d9d700 1 -- 172.21.15.146:0/774195747 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3880a2fa0 con 0x7fe3880a0a70 2023-10-03T10:18:34.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.096+0000 7fe385d9b700 1 --2- 172.21.15.146:0/774195747 >> v2:172.21.15.146:3300/0 conn(0x7fe388133f70 0x7fe3881343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.096+0000 7fe38659c700 1 --2- 172.21.15.146:0/774195747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38809ad40 0x7fe388133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.096+0000 7fe386d9d700 1 --2- 172.21.15.146:0/774195747 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe3880a0a70 0x7fe3880a0ed0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe380009dc0 tx=0x7fe38000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52c7306d5b5d63a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.096+0000 7fe38559a700 1 -- 172.21.15.146:0/774195747 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38000e070 con 0x7fe3880a0a70 2023-10-03T10:18:34.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.096+0000 7fe38559a700 1 -- 172.21.15.146:0/774195747 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38000bae0 con 0x7fe3880a0a70 2023-10-03T10:18:34.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.096+0000 7fe38559a700 1 -- 172.21.15.146:0/774195747 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38000be90 con 0x7fe3880a0a70 2023-10-03T10:18:34.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.097+0000 7fe38cae1700 1 -- 172.21.15.146:0/774195747 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe3880a0a70 msgr2=0x7fe3880a0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.097+0000 7fe38cae1700 1 --2- 172.21.15.146:0/774195747 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe3880a0a70 0x7fe3880a0ed0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe380009dc0 tx=0x7fe38000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:34.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.097+0000 7fe38cae1700 1 -- 172.21.15.146:0/774195747 shutdown_connections 2023-10-03T10:18:34.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.097+0000 7fe38cae1700 1 --2- 172.21.15.146:0/774195747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe38809ad40 0x7fe388133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.097+0000 7fe38cae1700 1 --2- 172.21.15.146:0/774195747 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe3880a0a70 0x7fe3880a0ed0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.097+0000 7fe38cae1700 1 --2- 172.21.15.146:0/774195747 >> v2:172.21.15.146:3300/0 conn(0x7fe388133f70 0x7fe3881343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.097+0000 7fe38cae1700 1 -- 172.21.15.146:0/774195747 >> 172.21.15.146:0/774195747 conn(0x7fe388099c40 msgr2=0x7fe38806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.097+0000 7fe38cae1700 1 -- 172.21.15.146:0/774195747 shutdown_connections 2023-10-03T10:18:34.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.097+0000 7fe38cae1700 1 -- 172.21.15.146:0/774195747 wait complete. 2023-10-03T10:18:34.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.098+0000 7fe38cae1700 1 Processor -- start 2023-10-03T10:18:34.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.098+0000 7fe38cae1700 1 -- start start 2023-10-03T10:18:34.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.098+0000 7fe38cae1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe38809ad40 0x7fe388121270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.098+0000 7fe38cae1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3880a0a70 0x7fe3881217b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.098+0000 7fe38cae1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe388133f70 0x7fe388121cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.098+0000 7fe38cae1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe388122e30 con 0x7fe38809ad40 2023-10-03T10:18:34.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.098+0000 7fe38cae1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe388124b00 con 0x7fe3880a0a70 2023-10-03T10:18:34.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.098+0000 7fe38cae1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe388123cc0 con 0x7fe388133f70 2023-10-03T10:18:34.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.098+0000 7fe38659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe38809ad40 0x7fe388121270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.098+0000 7fe385d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3880a0a70 0x7fe3881217b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.098+0000 7fe38659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe38809ad40 0x7fe388121270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37996/0 (socket says 172.21.15.146:37996) 2023-10-03T10:18:34.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.098+0000 7fe38659c700 1 -- 172.21.15.146:0/114915135 learned_addr learned my addr 172.21.15.146:0/114915135 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:34.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.098+0000 7fe386d9d700 1 --2- 172.21.15.146:0/114915135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe388133f70 0x7fe388121cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.099+0000 7fe38659c700 1 -- 172.21.15.146:0/114915135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe388133f70 msgr2=0x7fe388121cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.099+0000 7fe38659c700 1 --2- 172.21.15.146:0/114915135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe388133f70 0x7fe388121cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.099+0000 7fe38659c700 1 -- 172.21.15.146:0/114915135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3880a0a70 msgr2=0x7fe3881217b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.099+0000 7fe38659c700 1 --2- 172.21.15.146:0/114915135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3880a0a70 0x7fe3881217b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.099+0000 7fe38659c700 1 -- 172.21.15.146:0/114915135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe378009550 con 0x7fe38809ad40 2023-10-03T10:18:34.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.099+0000 7fe385d9b700 1 --2- 172.21.15.146:0/114915135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3880a0a70 0x7fe3881217b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.099+0000 7fe38659c700 1 --2- 172.21.15.146:0/114915135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe38809ad40 0x7fe388121270 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fe37800e960 tx=0x7fe37800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.099+0000 7fe376ffd700 1 -- 172.21.15.146:0/114915135 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe378004030 con 0x7fe38809ad40 2023-10-03T10:18:34.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.099+0000 7fe376ffd700 1 -- 172.21.15.146:0/114915135 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe378004190 con 0x7fe38809ad40 2023-10-03T10:18:34.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.099+0000 7fe38cae1700 1 -- 172.21.15.146:0/114915135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe37c0094a0 con 0x7fe38809ad40 2023-10-03T10:18:34.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.099+0000 7fe376ffd700 1 -- 172.21.15.146:0/114915135 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe378004520 con 0x7fe38809ad40 2023-10-03T10:18:34.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.099+0000 7fe38cae1700 1 -- 172.21.15.146:0/114915135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe380009a70 con 0x7fe38809ad40 2023-10-03T10:18:34.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.100+0000 7fe376ffd700 1 -- 172.21.15.146:0/114915135 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe3780036a0 con 0x7fe38809ad40 2023-10-03T10:18:34.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.100+0000 7fe376ffd700 1 -- 172.21.15.146:0/114915135 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe37803f840 con 0x7fe38809ad40 2023-10-03T10:18:34.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.100+0000 7fe38cae1700 1 -- 172.21.15.146:0/114915135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe38811e060 con 0x7fe38809ad40 2023-10-03T10:18:34.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.105+0000 7fe376ffd700 1 -- 172.21.15.146:0/114915135 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe378020080 con 0x7fe38809ad40 2023-10-03T10:18:34.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.289+0000 7fe38cae1700 1 -- 172.21.15.146:0/114915135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe38809c7e0 con 0x7fe38809ad40 2023-10-03T10:18:34.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.289+0000 7fe376ffd700 1 -- 172.21.15.146:0/114915135 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe378011bd0 con 0x7fe38809ad40 2023-10-03T10:18:34.290 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:34.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.291+0000 7fe38cae1700 1 -- 172.21.15.146:0/114915135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe38809ad40 msgr2=0x7fe388121270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.291+0000 7fe38cae1700 1 --2- 172.21.15.146:0/114915135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe38809ad40 0x7fe388121270 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fe37800e960 tx=0x7fe37800ec70 comp rx=0 tx=0).stop 2023-10-03T10:18:34.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.291+0000 7fe38cae1700 1 -- 172.21.15.146:0/114915135 shutdown_connections 2023-10-03T10:18:34.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.291+0000 7fe38cae1700 1 --2- 172.21.15.146:0/114915135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe388133f70 0x7fe388121cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.291+0000 7fe38cae1700 1 --2- 172.21.15.146:0/114915135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe38809ad40 0x7fe388121270 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.291+0000 7fe38cae1700 1 --2- 172.21.15.146:0/114915135 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3880a0a70 0x7fe3881217b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.291+0000 7fe38cae1700 1 -- 172.21.15.146:0/114915135 >> 172.21.15.146:0/114915135 conn(0x7fe388099c40 msgr2=0x7fe3881332d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.291+0000 7fe38cae1700 1 -- 172.21.15.146:0/114915135 shutdown_connections 2023-10-03T10:18:34.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.291+0000 7fe38cae1700 1 -- 172.21.15.146:0/114915135 wait complete. 2023-10-03T10:18:34.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:34.699 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:34.817 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:34.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.822+0000 7f7c20652700 1 Processor -- start 2023-10-03T10:18:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.822+0000 7f7c20652700 1 -- start start 2023-10-03T10:18:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.823+0000 7f7c20652700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7c180a0a30 0x7f7c180a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.823+0000 7f7c20652700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c180a1340 0x7f7c1812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.823+0000 7f7c20652700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c180a1e70 con 0x7f7c181304a0 2023-10-03T10:18:34.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.823+0000 7f7c20652700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c1809a720 con 0x7f7c180a0a30 2023-10-03T10:18:34.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.823+0000 7f7c20652700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1809b300 con 0x7f7c180a1340 2023-10-03T10:18:34.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.823+0000 7f7c1e3ee700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7c180a0a30 0x7f7c180a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.823+0000 7f7c1dbed700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c180a1340 0x7f7c1812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.823+0000 7f7c1ebef700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7c181304a0 0x7f7c181371b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44736/0 (socket says 172.21.15.146:44736) 2023-10-03T10:18:34.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.823+0000 7f7c1ebef700 1 -- 172.21.15.146:0/2014821558 learned_addr learned my addr 172.21.15.146:0/2014821558 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:34.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.823+0000 7f7c1e3ee700 1 -- 172.21.15.146:0/2014821558 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c180a1340 msgr2=0x7f7c1812ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.823+0000 7f7c1e3ee700 1 --2- 172.21.15.146:0/2014821558 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c180a1340 0x7f7c1812ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.823+0000 7f7c1e3ee700 1 -- 172.21.15.146:0/2014821558 >> v1:172.21.15.146:6789/0 conn(0x7f7c181304a0 legacy=0x7f7c181371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.823+0000 7f7c1e3ee700 1 -- 172.21.15.146:0/2014821558 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1809abc0 con 0x7f7c180a0a30 2023-10-03T10:18:34.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.823+0000 7f7c1dbed700 1 --2- 172.21.15.146:0/2014821558 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c180a1340 0x7f7c1812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.823+0000 7f7c1d3ec700 1 -- 172.21.15.146:0/2014821558 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136481664 0 0) 0x7f7c180a1e70 con 0x7f7c181304a0 2023-10-03T10:18:34.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.823+0000 7f7c1e3ee700 1 --2- 172.21.15.146:0/2014821558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c180a0a30 0x7f7c180a0e00 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009820 tx=0x7f7c14009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b4229291c5c07f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.823+0000 7f7c1d3ec700 1 -- 172.21.15.146:0/2014821558 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14005e30 con 0x7f7c180a0a30 2023-10-03T10:18:34.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.824+0000 7f7c1d3ec700 1 -- 172.21.15.146:0/2014821558 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c14006030 con 0x7f7c180a0a30 2023-10-03T10:18:34.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.824+0000 7f7c1d3ec700 1 -- 172.21.15.146:0/2014821558 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c140063c0 con 0x7f7c180a0a30 2023-10-03T10:18:34.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.824+0000 7f7c20652700 1 -- 172.21.15.146:0/2014821558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c180a0a30 msgr2=0x7f7c180a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.824+0000 7f7c20652700 1 --2- 172.21.15.146:0/2014821558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c180a0a30 0x7f7c180a0e00 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009820 tx=0x7f7c14009b30 comp rx=0 tx=0).stop 2023-10-03T10:18:34.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.824+0000 7f7c20652700 1 -- 172.21.15.146:0/2014821558 shutdown_connections 2023-10-03T10:18:34.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.824+0000 7f7c20652700 1 --2- 172.21.15.146:0/2014821558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c180a0a30 0x7f7c180a0e00 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.824+0000 7f7c20652700 1 --2- 172.21.15.146:0/2014821558 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c180a1340 0x7f7c1812ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.824+0000 7f7c20652700 1 -- 172.21.15.146:0/2014821558 >> 172.21.15.146:0/2014821558 conn(0x7f7c180a2980 msgr2=0x7f7c180a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.824+0000 7f7c20652700 1 -- 172.21.15.146:0/2014821558 shutdown_connections 2023-10-03T10:18:34.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.824+0000 7f7c20652700 1 -- 172.21.15.146:0/2014821558 wait complete. 2023-10-03T10:18:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.825+0000 7f7c20652700 1 Processor -- start 2023-10-03T10:18:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.825+0000 7f7c20652700 1 -- start start 2023-10-03T10:18:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.826+0000 7f7c20652700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c180a0a30 0x7f7c1812eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.826+0000 7f7c20652700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c180a1340 0x7f7c1812f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.826+0000 7f7c20652700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c181304a0 0x7f7c181c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.826+0000 7f7c20652700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1811b560 con 0x7f7c181304a0 2023-10-03T10:18:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.826+0000 7f7c20652700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1811e980 con 0x7f7c180a0a30 2023-10-03T10:18:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.826+0000 7f7c20652700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1811cc70 con 0x7f7c180a1340 2023-10-03T10:18:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.826+0000 7f7c1dbed700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c180a1340 0x7f7c1812f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.826+0000 7f7c1dbed700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c180a1340 0x7f7c1812f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34558/0 (socket says 172.21.15.146:34558) 2023-10-03T10:18:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.826+0000 7f7c1dbed700 1 -- 172.21.15.146:0/352206638 learned_addr learned my addr 172.21.15.146:0/352206638 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.826+0000 7f7c1ebef700 1 --2- 172.21.15.146:0/352206638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c181304a0 0x7f7c181c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.826+0000 7f7c1e3ee700 1 --2- 172.21.15.146:0/352206638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c180a0a30 0x7f7c1812eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.826+0000 7f7c1dbed700 1 -- 172.21.15.146:0/352206638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c180a0a30 msgr2=0x7f7c1812eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.826+0000 7f7c1dbed700 1 --2- 172.21.15.146:0/352206638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c180a0a30 0x7f7c1812eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.826+0000 7f7c1dbed700 1 -- 172.21.15.146:0/352206638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c181304a0 msgr2=0x7f7c181c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.826+0000 7f7c1dbed700 1 --2- 172.21.15.146:0/352206638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c181304a0 0x7f7c181c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.826+0000 7f7c1dbed700 1 -- 172.21.15.146:0/352206638 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0800a640 con 0x7f7c180a1340 2023-10-03T10:18:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.826+0000 7f7c1dbed700 1 --2- 172.21.15.146:0/352206638 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c180a1340 0x7f7c1812f410 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800e9a0 tx=0x7f7c0800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.827+0000 7f7c0effd700 1 -- 172.21.15.146:0/352206638 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800c990 con 0x7f7c180a1340 2023-10-03T10:18:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.827+0000 7f7c0effd700 1 -- 172.21.15.146:0/352206638 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0800caf0 con 0x7f7c180a1340 2023-10-03T10:18:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.827+0000 7f7c20652700 1 -- 172.21.15.146:0/352206638 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c14009430 con 0x7f7c180a1340 2023-10-03T10:18:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.827+0000 7f7c0effd700 1 -- 172.21.15.146:0/352206638 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800ce80 con 0x7f7c180a1340 2023-10-03T10:18:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.827+0000 7f7c20652700 1 -- 172.21.15.146:0/352206638 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1811d460 con 0x7f7c180a1340 2023-10-03T10:18:34.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.827+0000 7f7c0effd700 1 -- 172.21.15.146:0/352206638 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c080113f0 con 0x7f7c180a1340 2023-10-03T10:18:34.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.828+0000 7f7c0effd700 1 -- 172.21.15.146:0/352206638 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7c0803f3c0 con 0x7f7c180a1340 2023-10-03T10:18:34.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.828+0000 7f7c20652700 1 -- 172.21.15.146:0/352206638 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c1812f9b0 con 0x7f7c180a1340 2023-10-03T10:18:34.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.833+0000 7f7c0effd700 1 -- 172.21.15.146:0/352206638 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c080116a0 con 0x7f7c180a1340 2023-10-03T10:18:34.846 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:34.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.944+0000 7f79b97d6700 1 Processor -- start 2023-10-03T10:18:34.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.944+0000 7f79b97d6700 1 -- start start 2023-10-03T10:18:34.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.945+0000 7f79b97d6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79b406a770 0x7f79b41349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.945+0000 7f79b97d6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f79b4134f00 0x7f79b409d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.945+0000 7f79b97d6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b409eca0 con 0x7f79b409dea0 2023-10-03T10:18:34.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.945+0000 7f79b97d6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b409f720 con 0x7f79b4134f00 2023-10-03T10:18:34.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.945+0000 7f79b97d6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b406b480 con 0x7f79b406a770 2023-10-03T10:18:34.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.945+0000 7f79b2ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79b406a770 0x7f79b41349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.945+0000 7f79b2ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79b406a770 0x7f79b41349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35204/0 (socket says 172.21.15.146:35204) 2023-10-03T10:18:34.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.945+0000 7f79b37fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f79b409dea0 0x7f79b413ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44740/0 (socket says 172.21.15.146:44740) 2023-10-03T10:18:34.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.945+0000 7f79b2ffd700 1 -- 172.21.15.146:0/2027104239 learned_addr learned my addr 172.21.15.146:0/2027104239 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:34.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.945+0000 7f79b27fc700 1 --2- 172.21.15.146:0/2027104239 >> v2:172.21.15.146:3300/0 conn(0x7f79b4134f00 0x7f79b409d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.945+0000 7f79b27fc700 1 -- 172.21.15.146:0/2027104239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79b406a770 msgr2=0x7f79b41349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.945+0000 7f79b27fc700 1 --2- 172.21.15.146:0/2027104239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79b406a770 0x7f79b41349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.945+0000 7f79b27fc700 1 -- 172.21.15.146:0/2027104239 >> v1:172.21.15.146:6789/0 conn(0x7f79b409dea0 legacy=0x7f79b413ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.945+0000 7f79b27fc700 1 -- 172.21.15.146:0/2027104239 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b41352d0 con 0x7f79b4134f00 2023-10-03T10:18:34.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.946+0000 7f79b27fc700 1 --2- 172.21.15.146:0/2027104239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79b4134f00 0x7f79b409d960 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f79a8009840 tx=0x7f79a8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c5fb2d3cc545c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.948+0000 7f79b1ffb700 1 -- 172.21.15.146:0/2027104239 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a8011830 con 0x7f79b4134f00 2023-10-03T10:18:34.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.948+0000 7f79b1ffb700 1 -- 172.21.15.146:0/2027104239 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a8011990 con 0x7f79b4134f00 2023-10-03T10:18:34.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.948+0000 7f79b1ffb700 1 -- 172.21.15.146:0/2027104239 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a8011d20 con 0x7f79b4134f00 2023-10-03T10:18:34.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.949+0000 7f79b97d6700 1 -- 172.21.15.146:0/2027104239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79b4134f00 msgr2=0x7f79b409d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.949+0000 7f79b97d6700 1 --2- 172.21.15.146:0/2027104239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79b4134f00 0x7f79b409d960 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f79a8009840 tx=0x7f79a8009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:34.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.949+0000 7f79b97d6700 1 -- 172.21.15.146:0/2027104239 shutdown_connections 2023-10-03T10:18:34.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.949+0000 7f79b97d6700 1 --2- 172.21.15.146:0/2027104239 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79b406a770 0x7f79b41349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.949+0000 7f79b97d6700 1 --2- 172.21.15.146:0/2027104239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79b4134f00 0x7f79b409d960 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.949+0000 7f79b97d6700 1 -- 172.21.15.146:0/2027104239 >> 172.21.15.146:0/2027104239 conn(0x7f79b4099c40 msgr2=0x7f79b40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.949+0000 7f79b97d6700 1 -- 172.21.15.146:0/2027104239 shutdown_connections 2023-10-03T10:18:34.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.949+0000 7f79b97d6700 1 -- 172.21.15.146:0/2027104239 wait complete. 2023-10-03T10:18:34.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.951+0000 7f79b97d6700 1 Processor -- start 2023-10-03T10:18:34.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.951+0000 7f79b97d6700 1 -- start start 2023-10-03T10:18:34.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.951+0000 7f79b97d6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79b406a770 0x7f79b406fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.951+0000 7f79b97d6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79b409dea0 0x7f79b40702d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.951+0000 7f79b97d6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79b4134f00 0x7f79b4070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.951+0000 7f79b97d6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b4126ac0 con 0x7f79b406a770 2023-10-03T10:18:34.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.951+0000 7f79b97d6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b4127670 con 0x7f79b409dea0 2023-10-03T10:18:34.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.951+0000 7f79b97d6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79b4072820 con 0x7f79b4134f00 2023-10-03T10:18:34.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.952+0000 7f79b2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79b406a770 0x7f79b406fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.952+0000 7f79b2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79b406a770 0x7f79b406fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38918/0 (socket says 172.21.15.146:38918) 2023-10-03T10:18:34.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.952+0000 7f79b2ffd700 1 -- 172.21.15.146:0/4079760006 learned_addr learned my addr 172.21.15.146:0/4079760006 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:34.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.952+0000 7f79b37fe700 1 --2- 172.21.15.146:0/4079760006 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79b4134f00 0x7f79b4070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.952+0000 7f79b27fc700 1 --2- 172.21.15.146:0/4079760006 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79b409dea0 0x7f79b40702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.952+0000 7f79b2ffd700 1 -- 172.21.15.146:0/4079760006 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79b4134f00 msgr2=0x7f79b4070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.952+0000 7f79b2ffd700 1 --2- 172.21.15.146:0/4079760006 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79b4134f00 0x7f79b4070810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.952+0000 7f79b2ffd700 1 -- 172.21.15.146:0/4079760006 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79b409dea0 msgr2=0x7f79b40702d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.952+0000 7f79b2ffd700 1 --2- 172.21.15.146:0/4079760006 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79b409dea0 0x7f79b40702d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.952+0000 7f79b2ffd700 1 -- 172.21.15.146:0/4079760006 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a80094a0 con 0x7f79b406a770 2023-10-03T10:18:34.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.952+0000 7f79b2ffd700 1 --2- 172.21.15.146:0/4079760006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79b406a770 0x7f79b406fd90 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f79a400e7e0 tx=0x7f79a400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.952+0000 7f799b7fe700 1 -- 172.21.15.146:0/4079760006 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a4013610 con 0x7f79b406a770 2023-10-03T10:18:34.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.952+0000 7f799b7fe700 1 -- 172.21.15.146:0/4079760006 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a4013770 con 0x7f79b406a770 2023-10-03T10:18:34.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.952+0000 7f79b97d6700 1 -- 172.21.15.146:0/4079760006 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b4126800 con 0x7f79b406a770 2023-10-03T10:18:34.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.952+0000 7f799b7fe700 1 -- 172.21.15.146:0/4079760006 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a4013b20 con 0x7f79b406a770 2023-10-03T10:18:34.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.952+0000 7f79b97d6700 1 -- 172.21.15.146:0/4079760006 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b4071980 con 0x7f79b406a770 2023-10-03T10:18:34.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.954+0000 7f79b97d6700 1 -- 172.21.15.146:0/4079760006 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b409afd0 con 0x7f79b406a770 2023-10-03T10:18:34.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.954+0000 7f799b7fe700 1 -- 172.21.15.146:0/4079760006 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79a4013c80 con 0x7f79b406a770 2023-10-03T10:18:34.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.954+0000 7f799b7fe700 1 -- 172.21.15.146:0/4079760006 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f79a403f250 con 0x7f79b406a770 2023-10-03T10:18:34.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.958+0000 7f799b7fe700 1 -- 172.21.15.146:0/4079760006 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79a4012370 con 0x7f79b406a770 2023-10-03T10:18:34.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.975+0000 7f80b50fe700 1 Processor -- start 2023-10-03T10:18:34.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.975+0000 7f80b50fe700 1 -- start start 2023-10-03T10:18:34.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.975+0000 7f80b50fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80b00a0a70 0x7f80b00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.975+0000 7f80b50fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80b00a1380 0x7f80b0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.975+0000 7f80b50fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f80b0133f50 0x7f80b01343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.975+0000 7f80b50fe700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b009e9d0 con 0x7f80b0133f50 2023-10-03T10:18:34.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.975+0000 7f80b50fe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b009dc00 con 0x7f80b00a0a70 2023-10-03T10:18:34.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.975+0000 7f80b50fe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80b009dec0 con 0x7f80b00a1380 2023-10-03T10:18:34.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.975+0000 7f80aed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80b00a0a70 0x7f80b00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.975+0000 7f80aed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80b00a0a70 0x7f80b00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35212/0 (socket says 172.21.15.146:35212) 2023-10-03T10:18:34.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.975+0000 7f80aed9d700 1 -- 172.21.15.146:0/3932309497 learned_addr learned my addr 172.21.15.146:0/3932309497 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:34.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.975+0000 7f80ae59c700 1 --2- 172.21.15.146:0/3932309497 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80b00a1380 0x7f80b0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.975+0000 7f80af59e700 1 --2- 172.21.15.146:0/3932309497 >> v2:172.21.15.146:3300/0 conn(0x7f80b0133f50 0x7f80b01343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.976+0000 7f80ae59c700 1 -- 172.21.15.146:0/3932309497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80b00a0a70 msgr2=0x7f80b00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.976+0000 7f80ae59c700 1 --2- 172.21.15.146:0/3932309497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80b00a0a70 0x7f80b00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.976+0000 7f80ae59c700 1 -- 172.21.15.146:0/3932309497 >> v2:172.21.15.146:3300/0 conn(0x7f80b0133f50 msgr2=0x7f80b01343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.976+0000 7f80ae59c700 1 --2- 172.21.15.146:0/3932309497 >> v2:172.21.15.146:3300/0 conn(0x7f80b0133f50 0x7f80b01343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.976+0000 7f80ae59c700 1 -- 172.21.15.146:0/3932309497 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b009e6a0 con 0x7f80b00a1380 2023-10-03T10:18:34.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.976+0000 7f80af59e700 1 --2- 172.21.15.146:0/3932309497 >> v2:172.21.15.146:3300/0 conn(0x7f80b0133f50 0x7f80b01343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.976+0000 7f80ae59c700 1 --2- 172.21.15.146:0/3932309497 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80b00a1380 0x7f80b0133a10 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f80a4009840 tx=0x7f80a4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60e6db46a4f22185 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.976+0000 7f80add9b700 1 -- 172.21.15.146:0/3932309497 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a4011830 con 0x7f80b00a1380 2023-10-03T10:18:34.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.976+0000 7f80add9b700 1 -- 172.21.15.146:0/3932309497 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a4011990 con 0x7f80b00a1380 2023-10-03T10:18:34.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.976+0000 7f80add9b700 1 -- 172.21.15.146:0/3932309497 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a4011d20 con 0x7f80b00a1380 2023-10-03T10:18:34.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.977+0000 7f80b50fe700 1 -- 172.21.15.146:0/3932309497 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80b00a1380 msgr2=0x7f80b0133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.977+0000 7f80b50fe700 1 --2- 172.21.15.146:0/3932309497 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80b00a1380 0x7f80b0133a10 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f80a4009840 tx=0x7f80a4009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:34.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.977+0000 7f80b50fe700 1 -- 172.21.15.146:0/3932309497 shutdown_connections 2023-10-03T10:18:34.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.977+0000 7f80b50fe700 1 --2- 172.21.15.146:0/3932309497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80b00a0a70 0x7f80b00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.977+0000 7f80b50fe700 1 --2- 172.21.15.146:0/3932309497 >> v2:172.21.15.146:3300/0 conn(0x7f80b0133f50 0x7f80b01343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.977+0000 7f80b50fe700 1 --2- 172.21.15.146:0/3932309497 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80b00a1380 0x7f80b0133a10 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.977+0000 7f80b50fe700 1 -- 172.21.15.146:0/3932309497 >> 172.21.15.146:0/3932309497 conn(0x7f80b00a6610 msgr2=0x7f80b00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.977+0000 7f80b50fe700 1 -- 172.21.15.146:0/3932309497 shutdown_connections 2023-10-03T10:18:34.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.977+0000 7f80b50fe700 1 -- 172.21.15.146:0/3932309497 wait complete. 2023-10-03T10:18:34.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.978+0000 7f80b50fe700 1 Processor -- start 2023-10-03T10:18:34.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.978+0000 7f80b50fe700 1 -- start start 2023-10-03T10:18:34.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.978+0000 7f80b50fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80b00a0a70 0x7f80b0122640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.978+0000 7f80b50fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80b00a1380 0x7f80b0122b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.978+0000 7f80b50fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80b0133f50 0x7f80b01230c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.979+0000 7f80b50fe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b0125df0 con 0x7f80b00a1380 2023-10-03T10:18:34.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.979+0000 7f80b50fe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b0123aa0 con 0x7f80b00a0a70 2023-10-03T10:18:34.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.979+0000 7f80b50fe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80b01242d0 con 0x7f80b0133f50 2023-10-03T10:18:34.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.979+0000 7f80aed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80b00a0a70 0x7f80b0122640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.979+0000 7f80aed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80b00a0a70 0x7f80b0122640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35222/0 (socket says 172.21.15.146:35222) 2023-10-03T10:18:34.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.979+0000 7f80aed9d700 1 -- 172.21.15.146:0/251672669 learned_addr learned my addr 172.21.15.146:0/251672669 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:34.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.979+0000 7f80af59e700 1 --2- 172.21.15.146:0/251672669 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80b0133f50 0x7f80b01230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.979+0000 7f80ae59c700 1 --2- 172.21.15.146:0/251672669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80b00a1380 0x7f80b0122b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.979+0000 7f80aed9d700 1 -- 172.21.15.146:0/251672669 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80b0133f50 msgr2=0x7f80b01230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.979+0000 7f80aed9d700 1 --2- 172.21.15.146:0/251672669 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80b0133f50 0x7f80b01230c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.979+0000 7f80aed9d700 1 -- 172.21.15.146:0/251672669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80b00a1380 msgr2=0x7f80b0122b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.979+0000 7f80aed9d700 1 --2- 172.21.15.146:0/251672669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80b00a1380 0x7f80b0122b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.979+0000 7f80aed9d700 1 -- 172.21.15.146:0/251672669 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a8009a70 con 0x7f80b00a0a70 2023-10-03T10:18:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.979+0000 7f80af59e700 1 --2- 172.21.15.146:0/251672669 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80b0133f50 0x7f80b01230c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.979+0000 7f80aed9d700 1 --2- 172.21.15.146:0/251672669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80b00a0a70 0x7f80b0122640 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f80a000e9c0 tx=0x7f80a000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.979+0000 7f80977fe700 1 -- 172.21.15.146:0/251672669 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a000ee50 con 0x7f80b00a0a70 2023-10-03T10:18:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.979+0000 7f80977fe700 1 -- 172.21.15.146:0/251672669 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a000c850 con 0x7f80b00a0a70 2023-10-03T10:18:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.979+0000 7f80b50fe700 1 -- 172.21.15.146:0/251672669 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a40094a0 con 0x7f80b00a0a70 2023-10-03T10:18:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.979+0000 7f80977fe700 1 -- 172.21.15.146:0/251672669 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a000cbc0 con 0x7f80b00a0a70 2023-10-03T10:18:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.979+0000 7f80b50fe700 1 -- 172.21.15.146:0/251672669 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b01330d0 con 0x7f80b00a0a70 2023-10-03T10:18:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.980+0000 7f80977fe700 1 -- 172.21.15.146:0/251672669 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f80a000cd20 con 0x7f80b00a0a70 2023-10-03T10:18:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.980+0000 7f80b50fe700 1 -- 172.21.15.146:0/251672669 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b00a4600 con 0x7f80b00a0a70 2023-10-03T10:18:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.981+0000 7f80977fe700 1 -- 172.21.15.146:0/251672669 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f80a003f9c0 con 0x7f80b00a0a70 2023-10-03T10:18:34.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:34.985+0000 7f80977fe700 1 -- 172.21.15.146:0/251672669 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f80a001b3b0 con 0x7f80b00a0a70 2023-10-03T10:18:35.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.061+0000 7f7c20652700 1 -- 172.21.15.146:0/352206638 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7c1804f2a0 con 0x7f7c180a1340 2023-10-03T10:18:35.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.062+0000 7f7c0effd700 1 -- 172.21.15.146:0/352206638 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7c08020020 con 0x7f7c180a1340 2023-10-03T10:18:35.062 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:35.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.065+0000 7f7c20652700 1 -- 172.21.15.146:0/352206638 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c180a1340 msgr2=0x7f7c1812f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.065+0000 7f7c20652700 1 --2- 172.21.15.146:0/352206638 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c180a1340 0x7f7c1812f410 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800e9a0 tx=0x7f7c0800ecb0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.065+0000 7f7c20652700 1 -- 172.21.15.146:0/352206638 shutdown_connections 2023-10-03T10:18:35.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.065+0000 7f7c20652700 1 --2- 172.21.15.146:0/352206638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c181304a0 0x7f7c181c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.065+0000 7f7c20652700 1 --2- 172.21.15.146:0/352206638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c180a0a30 0x7f7c1812eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.065+0000 7f7c20652700 1 --2- 172.21.15.146:0/352206638 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c180a1340 0x7f7c1812f410 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.065+0000 7f7c20652700 1 -- 172.21.15.146:0/352206638 >> 172.21.15.146:0/352206638 conn(0x7f7c180a2980 msgr2=0x7f7c181b7940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:35.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.065+0000 7f7c20652700 1 -- 172.21.15.146:0/352206638 shutdown_connections 2023-10-03T10:18:35.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.065+0000 7f7c20652700 1 -- 172.21.15.146:0/352206638 wait complete. 2023-10-03T10:18:35.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:35.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.178+0000 7f79b97d6700 1 -- 172.21.15.146:0/4079760006 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f79b409c650 con 0x7f79b406a770 2023-10-03T10:18:35.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.178+0000 7f799b7fe700 1 -- 172.21.15.146:0/4079760006 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f79a4021070 con 0x7f79b406a770 2023-10-03T10:18:35.181 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:35.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.180+0000 7f80b50fe700 1 -- 172.21.15.146:0/251672669 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f80b004f2a0 con 0x7f80b00a0a70 2023-10-03T10:18:35.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.180+0000 7f80977fe700 1 -- 172.21.15.146:0/251672669 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f80a0017030 con 0x7f80b00a0a70 2023-10-03T10:18:35.182 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:35.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.180+0000 7f79b97d6700 1 -- 172.21.15.146:0/4079760006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79b406a770 msgr2=0x7f79b406fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.180+0000 7f79b97d6700 1 --2- 172.21.15.146:0/4079760006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79b406a770 0x7f79b406fd90 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f79a400e7e0 tx=0x7f79a400eaf0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.181+0000 7f79b97d6700 1 -- 172.21.15.146:0/4079760006 shutdown_connections 2023-10-03T10:18:35.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.181+0000 7f79b97d6700 1 --2- 172.21.15.146:0/4079760006 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f79b4134f00 0x7f79b4070810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.181+0000 7f79b97d6700 1 --2- 172.21.15.146:0/4079760006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79b406a770 0x7f79b406fd90 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.181+0000 7f79b97d6700 1 --2- 172.21.15.146:0/4079760006 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79b409dea0 0x7f79b40702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.181+0000 7f79b97d6700 1 -- 172.21.15.146:0/4079760006 >> 172.21.15.146:0/4079760006 conn(0x7f79b4099c40 msgr2=0x7f79b40a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:35.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.181+0000 7f79b97d6700 1 -- 172.21.15.146:0/4079760006 shutdown_connections 2023-10-03T10:18:35.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.181+0000 7f79b97d6700 1 -- 172.21.15.146:0/4079760006 wait complete. 2023-10-03T10:18:35.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.183+0000 7f80b50fe700 1 -- 172.21.15.146:0/251672669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80b00a0a70 msgr2=0x7f80b0122640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.183+0000 7f80b50fe700 1 --2- 172.21.15.146:0/251672669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80b00a0a70 0x7f80b0122640 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f80a000e9c0 tx=0x7f80a000ecd0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.183+0000 7f80b50fe700 1 -- 172.21.15.146:0/251672669 shutdown_connections 2023-10-03T10:18:35.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.183+0000 7f80b50fe700 1 --2- 172.21.15.146:0/251672669 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f80b0133f50 0x7f80b01230c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.183+0000 7f80b50fe700 1 --2- 172.21.15.146:0/251672669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f80b00a0a70 0x7f80b0122640 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.183+0000 7f80b50fe700 1 --2- 172.21.15.146:0/251672669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80b00a1380 0x7f80b0122b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.183+0000 7f80b50fe700 1 -- 172.21.15.146:0/251672669 >> 172.21.15.146:0/251672669 conn(0x7f80b00a6610 msgr2=0x7f80b009f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:35.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.183+0000 7f80b50fe700 1 -- 172.21.15.146:0/251672669 shutdown_connections 2023-10-03T10:18:35.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.183+0000 7f80b50fe700 1 -- 172.21.15.146:0/251672669 wait complete. 2023-10-03T10:18:35.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:35.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:35.305 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:35.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.426+0000 7fd89fc1d700 1 Processor -- start 2023-10-03T10:18:35.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.426+0000 7fd89fc1d700 1 -- start start 2023-10-03T10:18:35.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.427+0000 7fd89fc1d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd89809d860 0x7fd89809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.427+0000 7fd89fc1d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd89809e170 0x7fd8981307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.427+0000 7fd89fc1d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd898130ce0 0x7fd898131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.427+0000 7fd89fc1d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89809aaa0 con 0x7fd89809e170 2023-10-03T10:18:35.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.427+0000 7fd89fc1d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89809f870 con 0x7fd89809d860 2023-10-03T10:18:35.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.427+0000 7fd89fc1d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd89809b360 con 0x7fd898130ce0 2023-10-03T10:18:35.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.427+0000 7fd89d9b9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd89809d860 0x7fd89809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.427+0000 7fd89e1ba700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd898130ce0 0x7fd898131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.427+0000 7fd89d1b8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd89809e170 0x7fd8981307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.427+0000 7fd89d9b9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd89809d860 0x7fd89809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35228/0 (socket says 172.21.15.146:35228) 2023-10-03T10:18:35.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.427+0000 7fd89e1ba700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd898130ce0 0x7fd898131180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34592/0 (socket says 172.21.15.146:34592) 2023-10-03T10:18:35.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.427+0000 7fd89d1b8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd89809e170 0x7fd8981307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38952/0 (socket says 172.21.15.146:38952) 2023-10-03T10:18:35.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.427+0000 7fd89d9b9700 1 -- 172.21.15.146:0/2512188733 learned_addr learned my addr 172.21.15.146:0/2512188733 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:35.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.427+0000 7fd89e1ba700 1 -- 172.21.15.146:0/2512188733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd89809d860 msgr2=0x7fd89809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:35.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.427+0000 7fd89e1ba700 1 --2- 172.21.15.146:0/2512188733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd89809d860 0x7fd89809dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.427+0000 7fd89e1ba700 1 -- 172.21.15.146:0/2512188733 >> v2:172.21.15.146:3300/0 conn(0x7fd89809e170 msgr2=0x7fd8981307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:35.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.427+0000 7fd89e1ba700 1 --2- 172.21.15.146:0/2512188733 >> v2:172.21.15.146:3300/0 conn(0x7fd89809e170 0x7fd8981307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.427+0000 7fd89e1ba700 1 -- 172.21.15.146:0/2512188733 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89809b620 con 0x7fd898130ce0 2023-10-03T10:18:35.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.427+0000 7fd89d1b8700 1 --2- 172.21.15.146:0/2512188733 >> v2:172.21.15.146:3300/0 conn(0x7fd89809e170 0x7fd8981307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:35.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.427+0000 7fd89d9b9700 1 --2- 172.21.15.146:0/2512188733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd89809d860 0x7fd89809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:35.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.427+0000 7fd89e1ba700 1 --2- 172.21.15.146:0/2512188733 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd898130ce0 0x7fd898131180 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fd890009dc0 tx=0x7fd89000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c257b5788f3a762b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:35.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.428+0000 7fd89c9b7700 1 -- 172.21.15.146:0/2512188733 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89000e070 con 0x7fd898130ce0 2023-10-03T10:18:35.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.428+0000 7fd89c9b7700 1 -- 172.21.15.146:0/2512188733 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89000bae0 con 0x7fd898130ce0 2023-10-03T10:18:35.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.428+0000 7fd89c9b7700 1 -- 172.21.15.146:0/2512188733 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89000be90 con 0x7fd898130ce0 2023-10-03T10:18:35.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.428+0000 7fd89fc1d700 1 -- 172.21.15.146:0/2512188733 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd898130ce0 msgr2=0x7fd898131180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.428+0000 7fd89fc1d700 1 --2- 172.21.15.146:0/2512188733 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd898130ce0 0x7fd898131180 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fd890009dc0 tx=0x7fd89000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:35.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.428+0000 7fd89fc1d700 1 -- 172.21.15.146:0/2512188733 shutdown_connections 2023-10-03T10:18:35.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.428+0000 7fd89fc1d700 1 --2- 172.21.15.146:0/2512188733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd89809d860 0x7fd89809dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.428+0000 7fd89fc1d700 1 --2- 172.21.15.146:0/2512188733 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd898130ce0 0x7fd898131180 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.428+0000 7fd89fc1d700 1 --2- 172.21.15.146:0/2512188733 >> v2:172.21.15.146:3300/0 conn(0x7fd89809e170 0x7fd8981307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.428+0000 7fd89fc1d700 1 -- 172.21.15.146:0/2512188733 >> 172.21.15.146:0/2512188733 conn(0x7fd898099c40 msgr2=0x7fd8980a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:35.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.428+0000 7fd89fc1d700 1 -- 172.21.15.146:0/2512188733 shutdown_connections 2023-10-03T10:18:35.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.428+0000 7fd89fc1d700 1 -- 172.21.15.146:0/2512188733 wait complete. 2023-10-03T10:18:35.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.429+0000 7fd89fc1d700 1 Processor -- start 2023-10-03T10:18:35.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.429+0000 7fd89fc1d700 1 -- start start 2023-10-03T10:18:35.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.429+0000 7fd89fc1d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd89809d860 0x7fd89811f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.429+0000 7fd89fc1d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd89809e170 0x7fd89811f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.429+0000 7fd89fc1d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd898130ce0 0x7fd89811fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:35.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.429+0000 7fd89fc1d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8981304f0 con 0x7fd89809e170 2023-10-03T10:18:35.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.429+0000 7fd89fc1d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89809a150 con 0x7fd898130ce0 2023-10-03T10:18:35.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.429+0000 7fd89fc1d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd898125960 con 0x7fd89809d860 2023-10-03T10:18:35.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.430+0000 7fd89d9b9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd89809d860 0x7fd89811f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.430+0000 7fd89d1b8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd89809e170 0x7fd89811f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.430+0000 7fd89d9b9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd89809d860 0x7fd89811f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34598/0 (socket says 172.21.15.146:34598) 2023-10-03T10:18:35.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.430+0000 7fd89d9b9700 1 -- 172.21.15.146:0/1554692376 learned_addr learned my addr 172.21.15.146:0/1554692376 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:35.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.430+0000 7fd89e1ba700 1 --2- 172.21.15.146:0/1554692376 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd898130ce0 0x7fd89811fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:35.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.430+0000 7fd89d9b9700 1 -- 172.21.15.146:0/1554692376 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd898130ce0 msgr2=0x7fd89811fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.430+0000 7fd89d9b9700 1 --2- 172.21.15.146:0/1554692376 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd898130ce0 0x7fd89811fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.430+0000 7fd89d9b9700 1 -- 172.21.15.146:0/1554692376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd89809e170 msgr2=0x7fd89811f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.430+0000 7fd89d9b9700 1 --2- 172.21.15.146:0/1554692376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd89809e170 0x7fd89811f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.430+0000 7fd89d9b9700 1 -- 172.21.15.146:0/1554692376 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd888009550 con 0x7fd89809d860 2023-10-03T10:18:35.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.430+0000 7fd89d1b8700 1 --2- 172.21.15.146:0/1554692376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd89809e170 0x7fd89811f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:35.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.430+0000 7fd89d9b9700 1 --2- 172.21.15.146:0/1554692376 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd89809d860 0x7fd89811f370 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd88800e930 tx=0x7fd88800ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:35.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.430+0000 7fd88e7fc700 1 -- 172.21.15.146:0/1554692376 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd888004030 con 0x7fd89809d860 2023-10-03T10:18:35.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.430+0000 7fd88e7fc700 1 -- 172.21.15.146:0/1554692376 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd888004190 con 0x7fd89809d860 2023-10-03T10:18:35.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.430+0000 7fd89fc1d700 1 -- 172.21.15.146:0/1554692376 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8940094a0 con 0x7fd89809d860 2023-10-03T10:18:35.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.430+0000 7fd88e7fc700 1 -- 172.21.15.146:0/1554692376 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd888004520 con 0x7fd89809d860 2023-10-03T10:18:35.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.430+0000 7fd89fc1d700 1 -- 172.21.15.146:0/1554692376 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd890009a70 con 0x7fd89809d860 2023-10-03T10:18:35.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.431+0000 7fd88e7fc700 1 -- 172.21.15.146:0/1554692376 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd8880036a0 con 0x7fd89809d860 2023-10-03T10:18:35.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.431+0000 7fd88e7fc700 1 -- 172.21.15.146:0/1554692376 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd88803f4a0 con 0x7fd89809d860 2023-10-03T10:18:35.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.431+0000 7fd89fc1d700 1 -- 172.21.15.146:0/1554692376 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd898125b20 con 0x7fd89809d860 2023-10-03T10:18:35.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.436+0000 7fd88e7fc700 1 -- 172.21.15.146:0/1554692376 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd888019d60 con 0x7fd89809d860 2023-10-03T10:18:35.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.622+0000 7fd89fc1d700 1 -- 172.21.15.146:0/1554692376 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd89804f2a0 con 0x7fd89809d860 2023-10-03T10:18:35.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.622+0000 7fd88e7fc700 1 -- 172.21.15.146:0/1554692376 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd888019300 con 0x7fd89809d860 2023-10-03T10:18:35.623 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:35.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.624+0000 7fd89fc1d700 1 -- 172.21.15.146:0/1554692376 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd89809d860 msgr2=0x7fd89811f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.624+0000 7fd89fc1d700 1 --2- 172.21.15.146:0/1554692376 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd89809d860 0x7fd89811f370 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd88800e930 tx=0x7fd88800ec40 comp rx=0 tx=0).stop 2023-10-03T10:18:35.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.624+0000 7fd89fc1d700 1 -- 172.21.15.146:0/1554692376 shutdown_connections 2023-10-03T10:18:35.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.624+0000 7fd89fc1d700 1 --2- 172.21.15.146:0/1554692376 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd898130ce0 0x7fd89811fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.624+0000 7fd89fc1d700 1 --2- 172.21.15.146:0/1554692376 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd89809d860 0x7fd89811f370 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.624+0000 7fd89fc1d700 1 --2- 172.21.15.146:0/1554692376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd89809e170 0x7fd89811f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.624+0000 7fd89fc1d700 1 -- 172.21.15.146:0/1554692376 >> 172.21.15.146:0/1554692376 conn(0x7fd898099c40 msgr2=0x7fd898119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:35.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.624+0000 7fd89fc1d700 1 -- 172.21.15.146:0/1554692376 shutdown_connections 2023-10-03T10:18:35.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:35.624+0000 7fd89fc1d700 1 -- 172.21.15.146:0/1554692376 wait complete. 2023-10-03T10:18:35.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:36.079 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:36.196 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:36.197 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:36.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.205+0000 7f199c01a700 1 Processor -- start 2023-10-03T10:18:36.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.205+0000 7f199c01a700 1 -- start start 2023-10-03T10:18:36.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.206+0000 7f199c01a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19940a0a70 0x7f19940a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.206+0000 7f199c01a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19940a1380 0x7f1994133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.206+0000 7f199c01a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199409dc00 con 0x7f1994133f50 2023-10-03T10:18:36.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.206+0000 7f199c01a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199409ea60 con 0x7f19940a0a70 2023-10-03T10:18:36.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.206+0000 7f199c01a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f199409dec0 con 0x7f19940a1380 2023-10-03T10:18:36.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.206+0000 7f19995b5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19940a1380 0x7f1994133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.206+0000 7f199a5b7700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1994133f50 0x7f199413acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44742/0 (socket says 172.21.15.146:44742) 2023-10-03T10:18:36.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.206+0000 7f199a5b7700 1 -- 172.21.15.146:0/3202487507 learned_addr learned my addr 172.21.15.146:0/3202487507 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:36.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.206+0000 7f1999db6700 1 --2- 172.21.15.146:0/3202487507 >> v2:172.21.15.146:3300/0 conn(0x7f19940a0a70 0x7f19940a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.206+0000 7f19995b5700 1 -- 172.21.15.146:0/3202487507 >> v2:172.21.15.146:3300/0 conn(0x7f19940a0a70 msgr2=0x7f19940a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:36.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.206+0000 7f19995b5700 1 --2- 172.21.15.146:0/3202487507 >> v2:172.21.15.146:3300/0 conn(0x7f19940a0a70 0x7f19940a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.206+0000 7f19995b5700 1 -- 172.21.15.146:0/3202487507 >> v1:172.21.15.146:6789/0 conn(0x7f1994133f50 legacy=0x7f199413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.206+0000 7f19995b5700 1 -- 172.21.15.146:0/3202487507 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199409e6a0 con 0x7f19940a1380 2023-10-03T10:18:36.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.206+0000 7f19995b5700 1 --2- 172.21.15.146:0/3202487507 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19940a1380 0x7f1994133a10 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f1984009840 tx=0x7f1984009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60308fcca7a0e186 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.207+0000 7f1998db4700 1 -- 172.21.15.146:0/3202487507 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984011830 con 0x7f19940a1380 2023-10-03T10:18:36.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.207+0000 7f1998db4700 1 -- 172.21.15.146:0/3202487507 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1984011990 con 0x7f19940a1380 2023-10-03T10:18:36.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.207+0000 7f1998db4700 1 -- 172.21.15.146:0/3202487507 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984011d20 con 0x7f19940a1380 2023-10-03T10:18:36.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.207+0000 7f199c01a700 1 -- 172.21.15.146:0/3202487507 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19940a1380 msgr2=0x7f1994133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.207+0000 7f199c01a700 1 --2- 172.21.15.146:0/3202487507 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19940a1380 0x7f1994133a10 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f1984009840 tx=0x7f1984009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:36.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.207+0000 7f199c01a700 1 -- 172.21.15.146:0/3202487507 shutdown_connections 2023-10-03T10:18:36.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.207+0000 7f199c01a700 1 --2- 172.21.15.146:0/3202487507 >> v2:172.21.15.146:3300/0 conn(0x7f19940a0a70 0x7f19940a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.207+0000 7f199c01a700 1 --2- 172.21.15.146:0/3202487507 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19940a1380 0x7f1994133a10 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.207+0000 7f199c01a700 1 -- 172.21.15.146:0/3202487507 >> 172.21.15.146:0/3202487507 conn(0x7f19940a6610 msgr2=0x7f19940a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.207+0000 7f199c01a700 1 -- 172.21.15.146:0/3202487507 shutdown_connections 2023-10-03T10:18:36.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.208+0000 7f199c01a700 1 -- 172.21.15.146:0/3202487507 wait complete. 2023-10-03T10:18:36.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.209+0000 7f199c01a700 1 Processor -- start 2023-10-03T10:18:36.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.209+0000 7f199c01a700 1 -- start start 2023-10-03T10:18:36.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.209+0000 7f199c01a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19940a0a70 0x7f19941c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.209+0000 7f199c01a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19940a1380 0x7f19941c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.209+0000 7f199c01a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1994133f50 0x7f19941c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.209+0000 7f199c01a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1994123ee0 con 0x7f1994133f50 2023-10-03T10:18:36.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.209+0000 7f199c01a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1994125330 con 0x7f19940a1380 2023-10-03T10:18:36.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.209+0000 7f199c01a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19941247d0 con 0x7f19940a0a70 2023-10-03T10:18:36.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.209+0000 7f1999db6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19940a0a70 0x7f19941c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.209+0000 7f1999db6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19940a0a70 0x7f19941c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34606/0 (socket says 172.21.15.146:34606) 2023-10-03T10:18:36.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.209+0000 7f1999db6700 1 -- 172.21.15.146:0/2091282333 learned_addr learned my addr 172.21.15.146:0/2091282333 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:36.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.209+0000 7f19995b5700 1 --2- 172.21.15.146:0/2091282333 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19940a1380 0x7f19941c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.209+0000 7f199a5b7700 1 --2- 172.21.15.146:0/2091282333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1994133f50 0x7f19941c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.210+0000 7f1999db6700 1 -- 172.21.15.146:0/2091282333 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19940a1380 msgr2=0x7f19941c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.210+0000 7f1999db6700 1 --2- 172.21.15.146:0/2091282333 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19940a1380 0x7f19941c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.210+0000 7f1999db6700 1 -- 172.21.15.146:0/2091282333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1994133f50 msgr2=0x7f19941c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.210+0000 7f1999db6700 1 --2- 172.21.15.146:0/2091282333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1994133f50 0x7f19941c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.210+0000 7f1999db6700 1 -- 172.21.15.146:0/2091282333 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19840094a0 con 0x7f19940a0a70 2023-10-03T10:18:36.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.210+0000 7f1999db6700 1 --2- 172.21.15.146:0/2091282333 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19940a0a70 0x7f19941c8250 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f199000e9b0 tx=0x7f199000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.210+0000 7f198a7fc700 1 -- 172.21.15.146:0/2091282333 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199000c850 con 0x7f19940a0a70 2023-10-03T10:18:36.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.210+0000 7f198a7fc700 1 -- 172.21.15.146:0/2091282333 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199000c9b0 con 0x7f19940a0a70 2023-10-03T10:18:36.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.210+0000 7f199c01a700 1 -- 172.21.15.146:0/2091282333 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1994124c00 con 0x7f19940a0a70 2023-10-03T10:18:36.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.210+0000 7f198a7fc700 1 -- 172.21.15.146:0/2091282333 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199000cd20 con 0x7f19940a0a70 2023-10-03T10:18:36.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.210+0000 7f199c01a700 1 -- 172.21.15.146:0/2091282333 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19940a0430 con 0x7f19940a0a70 2023-10-03T10:18:36.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.211+0000 7f198a7fc700 1 -- 172.21.15.146:0/2091282333 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1990013470 con 0x7f19940a0a70 2023-10-03T10:18:36.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.211+0000 7f199c01a700 1 -- 172.21.15.146:0/2091282333 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199404f2a0 con 0x7f19940a0a70 2023-10-03T10:18:36.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.211+0000 7f198a7fc700 1 -- 172.21.15.146:0/2091282333 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f199003fb50 con 0x7f19940a0a70 2023-10-03T10:18:36.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.216+0000 7f198a7fc700 1 -- 172.21.15.146:0/2091282333 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f199001b3b0 con 0x7f19940a0a70 2023-10-03T10:18:36.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.323+0000 7fe5756d5700 1 Processor -- start 2023-10-03T10:18:36.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.323+0000 7f85a2322700 1 Processor -- start 2023-10-03T10:18:36.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.323+0000 7fe5756d5700 1 -- start start 2023-10-03T10:18:36.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.323+0000 7f85a2322700 1 -- start start 2023-10-03T10:18:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.323+0000 7f85a2322700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859c136960 0x7f859c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.323+0000 7fe5756d5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe5701368e0 0x7fe570138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.323+0000 7fe5756d5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe570139200 0x7fe57013b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.323+0000 7fe5756d5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57009a760 con 0x7fe570133900 2023-10-03T10:18:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.323+0000 7fe5756d5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5701336e0 con 0x7fe5701368e0 2023-10-03T10:18:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.323+0000 7fe5756d5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe57009a080 con 0x7fe570139200 2023-10-03T10:18:36.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.324+0000 7fe56e7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe5701368e0 0x7fe570138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.324+0000 7fe56e7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe5701368e0 0x7fe570138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39006/0 (socket says 172.21.15.146:39006) 2023-10-03T10:18:36.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.324+0000 7fe56e7fc700 1 -- 172.21.15.146:0/3256811731 learned_addr learned my addr 172.21.15.146:0/3256811731 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:36.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.324+0000 7fe56f7fe700 1 --2- 172.21.15.146:0/3256811731 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe570139200 0x7fe57013b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.323+0000 7f85a2322700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f859c139280 0x7f859c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.323+0000 7f85a2322700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f859c06b2d0 con 0x7f859c133ad0 2023-10-03T10:18:36.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.323+0000 7f85a2322700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f859c1345b0 con 0x7f859c139280 2023-10-03T10:18:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.323+0000 7f85a2322700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859c133610 con 0x7f859c136960 2023-10-03T10:18:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.324+0000 7f859bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f859c133ad0 0x7f859c133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44758/0 (socket says 172.21.15.146:44758) 2023-10-03T10:18:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.324+0000 7f859bfff700 1 -- 172.21.15.146:0/609470512 learned_addr learned my addr 172.21.15.146:0/609470512 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.324+0000 7f859b7fe700 1 --2- 172.21.15.146:0/609470512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859c136960 0x7f859c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.324+0000 7f85a08bf700 1 --2- 172.21.15.146:0/609470512 >> v2:172.21.15.146:3300/0 conn(0x7f859c139280 0x7f859c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.324+0000 7fe56e7fc700 1 -- 172.21.15.146:0/3256811731 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe570139200 msgr2=0x7fe57013b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.324+0000 7fe56e7fc700 1 --2- 172.21.15.146:0/3256811731 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe570139200 0x7fe57013b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.324+0000 7fe56e7fc700 1 -- 172.21.15.146:0/3256811731 >> v1:172.21.15.146:6789/0 conn(0x7fe570133900 legacy=0x7fe570133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.324+0000 7f859b7fe700 1 -- 172.21.15.146:0/609470512 >> v2:172.21.15.146:3300/0 conn(0x7f859c139280 msgr2=0x7f859c13b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.324+0000 7f859b7fe700 1 --2- 172.21.15.146:0/609470512 >> v2:172.21.15.146:3300/0 conn(0x7f859c139280 0x7f859c13b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.324+0000 7f859b7fe700 1 -- 172.21.15.146:0/609470512 >> v1:172.21.15.146:6789/0 conn(0x7f859c133ad0 legacy=0x7f859c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.324+0000 7f859b7fe700 1 -- 172.21.15.146:0/609470512 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859c09a500 con 0x7f859c136960 2023-10-03T10:18:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.324+0000 7fe56e7fc700 1 -- 172.21.15.146:0/3256811731 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5700a23e0 con 0x7fe5701368e0 2023-10-03T10:18:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.324+0000 7fe56f7fe700 1 --2- 172.21.15.146:0/3256811731 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe570139200 0x7fe57013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.324+0000 7f859b7fe700 1 --2- 172.21.15.146:0/609470512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859c136960 0x7f859c138d40 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f8590013180 tx=0x7f8590013490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d3f9bfb613725a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.324+0000 7fe56e7fc700 1 --2- 172.21.15.146:0/3256811731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5701368e0 0x7fe570138cc0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fe5640098f0 tx=0x7fe564009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa47f5ef2baa7898 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.324+0000 7f859affd700 1 -- 172.21.15.146:0/609470512 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8590016070 con 0x7f859c136960 2023-10-03T10:18:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.325+0000 7f859affd700 1 -- 172.21.15.146:0/609470512 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8590013d00 con 0x7f859c136960 2023-10-03T10:18:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.325+0000 7f859affd700 1 -- 172.21.15.146:0/609470512 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85900112f0 con 0x7f859c136960 2023-10-03T10:18:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.325+0000 7f85a2322700 1 -- 172.21.15.146:0/609470512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859c136960 msgr2=0x7f859c138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.325+0000 7f85a2322700 1 --2- 172.21.15.146:0/609470512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859c136960 0x7f859c138d40 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f8590013180 tx=0x7f8590013490 comp rx=0 tx=0).stop 2023-10-03T10:18:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.325+0000 7fe56dffb700 1 -- 172.21.15.146:0/3256811731 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe564011830 con 0x7fe5701368e0 2023-10-03T10:18:36.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.325+0000 7f85a2322700 1 -- 172.21.15.146:0/609470512 shutdown_connections 2023-10-03T10:18:36.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.325+0000 7f85a2322700 1 --2- 172.21.15.146:0/609470512 >> v2:172.21.15.146:3300/0 conn(0x7f859c139280 0x7f859c13b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.325+0000 7f85a2322700 1 --2- 172.21.15.146:0/609470512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859c136960 0x7f859c138d40 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.325+0000 7f85a2322700 1 -- 172.21.15.146:0/609470512 >> 172.21.15.146:0/609470512 conn(0x7f859c099c40 msgr2=0x7f859c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.325+0000 7fe56dffb700 1 -- 172.21.15.146:0/3256811731 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe564011990 con 0x7fe5701368e0 2023-10-03T10:18:36.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.325+0000 7fe56dffb700 1 -- 172.21.15.146:0/3256811731 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe564011d20 con 0x7fe5701368e0 2023-10-03T10:18:36.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.325+0000 7f85a2322700 1 -- 172.21.15.146:0/609470512 shutdown_connections 2023-10-03T10:18:36.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.325+0000 7f85a2322700 1 -- 172.21.15.146:0/609470512 wait complete. 2023-10-03T10:18:36.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.326+0000 7fe5756d5700 1 -- 172.21.15.146:0/3256811731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5701368e0 msgr2=0x7fe570138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.326+0000 7fe5756d5700 1 --2- 172.21.15.146:0/3256811731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5701368e0 0x7fe570138cc0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fe5640098f0 tx=0x7fe564009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:36.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.326+0000 7fe5756d5700 1 -- 172.21.15.146:0/3256811731 shutdown_connections 2023-10-03T10:18:36.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.326+0000 7fe5756d5700 1 --2- 172.21.15.146:0/3256811731 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe570139200 0x7fe57013b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.326+0000 7fe5756d5700 1 --2- 172.21.15.146:0/3256811731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5701368e0 0x7fe570138cc0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.326+0000 7fe5756d5700 1 -- 172.21.15.146:0/3256811731 >> 172.21.15.146:0/3256811731 conn(0x7fe5700a2980 msgr2=0x7fe5700a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.326+0000 7f85a2322700 1 Processor -- start 2023-10-03T10:18:36.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.326+0000 7fe5756d5700 1 -- 172.21.15.146:0/3256811731 shutdown_connections 2023-10-03T10:18:36.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.327+0000 7fe5756d5700 1 -- 172.21.15.146:0/3256811731 wait complete. 2023-10-03T10:18:36.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.327+0000 7f85a2322700 1 -- start start 2023-10-03T10:18:36.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.327+0000 7f85a2322700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f859c133ad0 0x7f859c12c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.327+0000 7f85a2322700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859c136960 0x7f859c12cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.327+0000 7f85a2322700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f859c139280 0x7f859c12d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.327+0000 7f85a2322700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859c070950 con 0x7f859c133ad0 2023-10-03T10:18:36.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.327+0000 7f85a2322700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859c06eb70 con 0x7f859c136960 2023-10-03T10:18:36.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.327+0000 7f85a2322700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f859c06e900 con 0x7f859c139280 2023-10-03T10:18:36.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.327+0000 7f859bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f859c133ad0 0x7f859c12c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.327+0000 7f859b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859c136960 0x7f859c12cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.327+0000 7f859bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f859c133ad0 0x7f859c12c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39022/0 (socket says 172.21.15.146:39022) 2023-10-03T10:18:36.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.327+0000 7f859bfff700 1 -- 172.21.15.146:0/1787837145 learned_addr learned my addr 172.21.15.146:0/1787837145 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:36.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.328+0000 7f859b7fe700 1 -- 172.21.15.146:0/1787837145 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f859c139280 msgr2=0x7f859c12d1e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:18:36.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.328+0000 7f859b7fe700 1 --2- 172.21.15.146:0/1787837145 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f859c139280 0x7f859c12d1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.328+0000 7f859b7fe700 1 -- 172.21.15.146:0/1787837145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f859c133ad0 msgr2=0x7f859c12c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.328+0000 7f859b7fe700 1 --2- 172.21.15.146:0/1787837145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f859c133ad0 0x7f859c12c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.328+0000 7f859b7fe700 1 -- 172.21.15.146:0/1787837145 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8590011d40 con 0x7f859c136960 2023-10-03T10:18:36.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.328+0000 7f859bfff700 1 --2- 172.21.15.146:0/1787837145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f859c133ad0 0x7f859c12c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.328+0000 7fe5756d5700 1 Processor -- start 2023-10-03T10:18:36.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.328+0000 7fe5756d5700 1 -- start start 2023-10-03T10:18:36.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.328+0000 7f859b7fe700 1 --2- 172.21.15.146:0/1787837145 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859c136960 0x7f859c12cca0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f859001d000 tx=0x7f8590004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.328+0000 7f8598ff9700 1 -- 172.21.15.146:0/1787837145 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859000fc60 con 0x7f859c136960 2023-10-03T10:18:36.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.328+0000 7f8598ff9700 1 -- 172.21.15.146:0/1787837145 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85900045e0 con 0x7f859c136960 2023-10-03T10:18:36.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.328+0000 7f8598ff9700 1 -- 172.21.15.146:0/1787837145 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85900036a0 con 0x7f859c136960 2023-10-03T10:18:36.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.328+0000 7f85a2322700 1 -- 172.21.15.146:0/1787837145 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f859c06edd0 con 0x7f859c136960 2023-10-03T10:18:36.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.328+0000 7f85a2322700 1 -- 172.21.15.146:0/1787837145 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f859c06f010 con 0x7f859c136960 2023-10-03T10:18:36.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.329+0000 7fe5756d5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe570133900 0x7fe570070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.329+0000 7fe5756d5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5701368e0 0x7fe570071430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.329+0000 7fe5756d5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe570139200 0x7fe5701cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.329+0000 7fe5756d5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe570072200 con 0x7fe570139200 2023-10-03T10:18:36.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.329+0000 7fe5756d5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe570131120 con 0x7fe570133900 2023-10-03T10:18:36.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.329+0000 7fe5756d5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe570122d40 con 0x7fe5701368e0 2023-10-03T10:18:36.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.329+0000 7fe56effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe570133900 0x7fe570070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.329+0000 7fe56f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe570139200 0x7fe5701cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.329+0000 7fe56effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe570133900 0x7fe570070ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35276/0 (socket says 172.21.15.146:35276) 2023-10-03T10:18:36.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.329+0000 7fe56effd700 1 -- 172.21.15.146:0/1615647254 learned_addr learned my addr 172.21.15.146:0/1615647254 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:36.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.329+0000 7fe56f7fe700 1 -- 172.21.15.146:0/1615647254 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5701368e0 msgr2=0x7fe570071430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:18:36.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.329+0000 7fe56f7fe700 1 --2- 172.21.15.146:0/1615647254 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5701368e0 0x7fe570071430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.329+0000 7fe56f7fe700 1 -- 172.21.15.146:0/1615647254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe570133900 msgr2=0x7fe570070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.329+0000 7fe56f7fe700 1 --2- 172.21.15.146:0/1615647254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe570133900 0x7fe570070ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.329+0000 7fe56f7fe700 1 -- 172.21.15.146:0/1615647254 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe568009a70 con 0x7fe570139200 2023-10-03T10:18:36.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.329+0000 7fe56effd700 1 --2- 172.21.15.146:0/1615647254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe570133900 0x7fe570070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.329+0000 7fe56f7fe700 1 --2- 172.21.15.146:0/1615647254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe570139200 0x7fe5701cc820 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fe56800efc0 tx=0x7fe56800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.329+0000 7fe5577fe700 1 -- 172.21.15.146:0/1615647254 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56800cb40 con 0x7fe570139200 2023-10-03T10:18:36.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.329+0000 7fe5577fe700 1 -- 172.21.15.146:0/1615647254 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56800f040 con 0x7fe570139200 2023-10-03T10:18:36.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.329+0000 7fe5756d5700 1 -- 172.21.15.146:0/1615647254 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe564009550 con 0x7fe570139200 2023-10-03T10:18:36.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.329+0000 7fe5756d5700 1 -- 172.21.15.146:0/1615647254 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe570138f60 con 0x7fe570139200 2023-10-03T10:18:36.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.330+0000 7fe5577fe700 1 -- 172.21.15.146:0/1615647254 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe568003a20 con 0x7fe570139200 2023-10-03T10:18:36.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.330+0000 7fe5577fe700 1 -- 172.21.15.146:0/1615647254 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe568014480 con 0x7fe570139200 2023-10-03T10:18:36.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.330+0000 7fe5577fe700 1 -- 172.21.15.146:0/1615647254 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe568040080 con 0x7fe570139200 2023-10-03T10:18:36.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.331+0000 7fe5756d5700 1 -- 172.21.15.146:0/1615647254 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5500052e0 con 0x7fe570139200 2023-10-03T10:18:36.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.330+0000 7f85a2322700 1 -- 172.21.15.146:0/1787837145 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f859c04f2a0 con 0x7f859c136960 2023-10-03T10:18:36.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.330+0000 7f8598ff9700 1 -- 172.21.15.146:0/1787837145 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8590003820 con 0x7f859c136960 2023-10-03T10:18:36.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.330+0000 7f8598ff9700 1 -- 172.21.15.146:0/1787837145 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8590049540 con 0x7f859c136960 2023-10-03T10:18:36.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.335+0000 7fe5577fe700 1 -- 172.21.15.146:0/1615647254 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe568012930 con 0x7fe570139200 2023-10-03T10:18:36.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.339+0000 7f8598ff9700 1 -- 172.21.15.146:0/1787837145 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f859002a360 con 0x7f859c136960 2023-10-03T10:18:36.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.416+0000 7f199c01a700 1 -- 172.21.15.146:0/2091282333 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f19940a2710 con 0x7f19940a0a70 2023-10-03T10:18:36.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.417+0000 7f198a7fc700 1 -- 172.21.15.146:0/2091282333 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1990021030 con 0x7f19940a0a70 2023-10-03T10:18:36.419 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:36.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.419+0000 7f199c01a700 1 -- 172.21.15.146:0/2091282333 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19940a0a70 msgr2=0x7f19941c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.419+0000 7f199c01a700 1 --2- 172.21.15.146:0/2091282333 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19940a0a70 0x7f19941c8250 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f199000e9b0 tx=0x7f199000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.419+0000 7f199c01a700 1 -- 172.21.15.146:0/2091282333 shutdown_connections 2023-10-03T10:18:36.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.419+0000 7f199c01a700 1 --2- 172.21.15.146:0/2091282333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1994133f50 0x7f19941c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.419+0000 7f199c01a700 1 --2- 172.21.15.146:0/2091282333 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19940a0a70 0x7f19941c8250 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.419+0000 7f199c01a700 1 --2- 172.21.15.146:0/2091282333 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19940a1380 0x7f19941c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.419+0000 7f199c01a700 1 -- 172.21.15.146:0/2091282333 >> 172.21.15.146:0/2091282333 conn(0x7f19940a6610 msgr2=0x7f19940a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.419+0000 7f199c01a700 1 -- 172.21.15.146:0/2091282333 shutdown_connections 2023-10-03T10:18:36.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.419+0000 7f199c01a700 1 -- 172.21.15.146:0/2091282333 wait complete. 2023-10-03T10:18:36.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:36.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.531+0000 7fe5756d5700 1 -- 172.21.15.146:0/1615647254 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe550005590 con 0x7fe570139200 2023-10-03T10:18:36.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.531+0000 7fe5577fe700 1 -- 172.21.15.146:0/1615647254 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe56802b090 con 0x7fe570139200 2023-10-03T10:18:36.532 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:36.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.533+0000 7f85a2322700 1 -- 172.21.15.146:0/1787837145 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f859c09f0f0 con 0x7f859c136960 2023-10-03T10:18:36.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.534+0000 7f8598ff9700 1 -- 172.21.15.146:0/1787837145 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f859003a090 con 0x7f859c136960 2023-10-03T10:18:36.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.534+0000 7fe5756d5700 1 -- 172.21.15.146:0/1615647254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe570139200 msgr2=0x7fe5701cc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.534+0000 7fe5756d5700 1 --2- 172.21.15.146:0/1615647254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe570139200 0x7fe5701cc820 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fe56800efc0 tx=0x7fe56800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.535 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:36.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.534+0000 7fe5756d5700 1 -- 172.21.15.146:0/1615647254 shutdown_connections 2023-10-03T10:18:36.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.534+0000 7fe5756d5700 1 --2- 172.21.15.146:0/1615647254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe570139200 0x7fe5701cc820 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.534+0000 7fe5756d5700 1 --2- 172.21.15.146:0/1615647254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe570133900 0x7fe570070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.534+0000 7fe5756d5700 1 --2- 172.21.15.146:0/1615647254 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5701368e0 0x7fe570071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.534+0000 7fe5756d5700 1 -- 172.21.15.146:0/1615647254 >> 172.21.15.146:0/1615647254 conn(0x7fe5700a2980 msgr2=0x7fe570131b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.534+0000 7fe5756d5700 1 -- 172.21.15.146:0/1615647254 shutdown_connections 2023-10-03T10:18:36.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.534+0000 7fe5756d5700 1 -- 172.21.15.146:0/1615647254 wait complete. 2023-10-03T10:18:36.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.536+0000 7f85a2322700 1 -- 172.21.15.146:0/1787837145 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859c136960 msgr2=0x7f859c12cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.536+0000 7f85a2322700 1 --2- 172.21.15.146:0/1787837145 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859c136960 0x7f859c12cca0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f859001d000 tx=0x7f8590004750 comp rx=0 tx=0).stop 2023-10-03T10:18:36.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.536+0000 7f85a2322700 1 -- 172.21.15.146:0/1787837145 shutdown_connections 2023-10-03T10:18:36.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.536+0000 7f85a2322700 1 --2- 172.21.15.146:0/1787837145 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f859c139280 0x7f859c12d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.536+0000 7f85a2322700 1 --2- 172.21.15.146:0/1787837145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f859c133ad0 0x7f859c12c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.536+0000 7f85a2322700 1 --2- 172.21.15.146:0/1787837145 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f859c136960 0x7f859c12cca0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.536+0000 7f85a2322700 1 -- 172.21.15.146:0/1787837145 >> 172.21.15.146:0/1787837145 conn(0x7f859c099c40 msgr2=0x7f859c1386e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.536+0000 7f85a2322700 1 -- 172.21.15.146:0/1787837145 shutdown_connections 2023-10-03T10:18:36.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.536+0000 7f85a2322700 1 -- 172.21.15.146:0/1787837145 wait complete. 2023-10-03T10:18:36.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:36.549 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:36.638 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:36.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.761+0000 7f54d55fa700 1 Processor -- start 2023-10-03T10:18:36.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.761+0000 7f54d55fa700 1 -- start start 2023-10-03T10:18:36.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.761+0000 7f54d55fa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54d00a0a70 0x7f54d00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.762+0000 7f54d55fa700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f54d00a1380 0x7f54d0133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.762+0000 7f54d55fa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54d0133f50 0x7f54d0134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.762+0000 7f54d55fa700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d009e9d0 con 0x7f54d00a1380 2023-10-03T10:18:36.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.762+0000 7f54d55fa700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d009dc00 con 0x7f54d0133f50 2023-10-03T10:18:36.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.762+0000 7f54d55fa700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54d009dec0 con 0x7f54d00a0a70 2023-10-03T10:18:36.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.762+0000 7f54cf7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54d0133f50 0x7f54d0134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.762+0000 7f54ceffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54d00a0a70 0x7f54d00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.762+0000 7f54ce7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f54d00a1380 0x7f54d0133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.762+0000 7f54cf7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54d0133f50 0x7f54d0134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35284/0 (socket says 172.21.15.146:35284) 2023-10-03T10:18:36.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.762+0000 7f54ceffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54d00a0a70 0x7f54d00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34620/0 (socket says 172.21.15.146:34620) 2023-10-03T10:18:36.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.762+0000 7f54ce7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f54d00a1380 0x7f54d0133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39032/0 (socket says 172.21.15.146:39032) 2023-10-03T10:18:36.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.762+0000 7f54cf7fe700 1 -- 172.21.15.146:0/2840681169 learned_addr learned my addr 172.21.15.146:0/2840681169 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:36.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.762+0000 7f54cf7fe700 1 -- 172.21.15.146:0/2840681169 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54d00a0a70 msgr2=0x7f54d00a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:36.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.762+0000 7f54cf7fe700 1 --2- 172.21.15.146:0/2840681169 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54d00a0a70 0x7f54d00a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.762+0000 7f54cf7fe700 1 -- 172.21.15.146:0/2840681169 >> v2:172.21.15.146:3300/0 conn(0x7f54d00a1380 msgr2=0x7f54d0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:36.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.762+0000 7f54cf7fe700 1 --2- 172.21.15.146:0/2840681169 >> v2:172.21.15.146:3300/0 conn(0x7f54d00a1380 0x7f54d0133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.762+0000 7f54cf7fe700 1 -- 172.21.15.146:0/2840681169 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d009e6a0 con 0x7f54d0133f50 2023-10-03T10:18:36.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.762+0000 7f54ce7fc700 1 --2- 172.21.15.146:0/2840681169 >> v2:172.21.15.146:3300/0 conn(0x7f54d00a1380 0x7f54d0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.762+0000 7f54cf7fe700 1 --2- 172.21.15.146:0/2840681169 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54d0133f50 0x7f54d0134380 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f54c8009e50 tx=0x7f54c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d52794d2dec25d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.762+0000 7f54cdffb700 1 -- 172.21.15.146:0/2840681169 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c800e070 con 0x7f54d0133f50 2023-10-03T10:18:36.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.762+0000 7f54cdffb700 1 -- 172.21.15.146:0/2840681169 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c800b910 con 0x7f54d0133f50 2023-10-03T10:18:36.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.762+0000 7f54cdffb700 1 -- 172.21.15.146:0/2840681169 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c800bcc0 con 0x7f54d0133f50 2023-10-03T10:18:36.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.763+0000 7f54d55fa700 1 -- 172.21.15.146:0/2840681169 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54d0133f50 msgr2=0x7f54d0134380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.763+0000 7f54d55fa700 1 --2- 172.21.15.146:0/2840681169 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54d0133f50 0x7f54d0134380 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f54c8009e50 tx=0x7f54c800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:36.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.763+0000 7f54d55fa700 1 -- 172.21.15.146:0/2840681169 shutdown_connections 2023-10-03T10:18:36.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.763+0000 7f54d55fa700 1 --2- 172.21.15.146:0/2840681169 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54d0133f50 0x7f54d0134380 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.763+0000 7f54d55fa700 1 --2- 172.21.15.146:0/2840681169 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54d00a0a70 0x7f54d00a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.763+0000 7f54d55fa700 1 --2- 172.21.15.146:0/2840681169 >> v2:172.21.15.146:3300/0 conn(0x7f54d00a1380 0x7f54d0133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.763+0000 7f54d55fa700 1 -- 172.21.15.146:0/2840681169 >> 172.21.15.146:0/2840681169 conn(0x7f54d00a6610 msgr2=0x7f54d00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.763+0000 7f54d55fa700 1 -- 172.21.15.146:0/2840681169 shutdown_connections 2023-10-03T10:18:36.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.763+0000 7f54d55fa700 1 -- 172.21.15.146:0/2840681169 wait complete. 2023-10-03T10:18:36.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.764+0000 7f54d55fa700 1 Processor -- start 2023-10-03T10:18:36.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.764+0000 7f54d55fa700 1 -- start start 2023-10-03T10:18:36.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.765+0000 7f54d55fa700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54d00a0a70 0x7f54d0122330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.765+0000 7f54d55fa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54d00a1380 0x7f54d0122870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.765+0000 7f54d55fa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54d0133f50 0x7f54d0122db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.765+0000 7f54d55fa700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d0123800 con 0x7f54d0133f50 2023-10-03T10:18:36.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.765+0000 7f54d55fa700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d0125bb0 con 0x7f54d00a1380 2023-10-03T10:18:36.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.765+0000 7f54d55fa700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54d0126300 con 0x7f54d00a0a70 2023-10-03T10:18:36.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.765+0000 7f54ceffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54d00a0a70 0x7f54d0122330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.765+0000 7f54ceffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54d00a0a70 0x7f54d0122330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34634/0 (socket says 172.21.15.146:34634) 2023-10-03T10:18:36.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.765+0000 7f54ceffd700 1 -- 172.21.15.146:0/3005522363 learned_addr learned my addr 172.21.15.146:0/3005522363 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:36.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.765+0000 7f54ce7fc700 1 --2- 172.21.15.146:0/3005522363 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54d00a1380 0x7f54d0122870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.765+0000 7f54cf7fe700 1 --2- 172.21.15.146:0/3005522363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54d0133f50 0x7f54d0122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.765+0000 7f54ceffd700 1 -- 172.21.15.146:0/3005522363 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54d00a1380 msgr2=0x7f54d0122870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.765+0000 7f54ceffd700 1 --2- 172.21.15.146:0/3005522363 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54d00a1380 0x7f54d0122870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.765+0000 7f54ceffd700 1 -- 172.21.15.146:0/3005522363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54d0133f50 msgr2=0x7f54d0122db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.765+0000 7f54ceffd700 1 --2- 172.21.15.146:0/3005522363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54d0133f50 0x7f54d0122db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.765+0000 7f54ceffd700 1 -- 172.21.15.146:0/3005522363 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c00094a0 con 0x7f54d00a0a70 2023-10-03T10:18:36.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.765+0000 7f54cf7fe700 1 --2- 172.21.15.146:0/3005522363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54d0133f50 0x7f54d0122db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.766+0000 7f54ceffd700 1 --2- 172.21.15.146:0/3005522363 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54d00a0a70 0x7f54d0122330 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f54c400e870 tx=0x7f54c400eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.766+0000 7f54b77fe700 1 -- 172.21.15.146:0/3005522363 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4013680 con 0x7f54d00a0a70 2023-10-03T10:18:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.766+0000 7f54b77fe700 1 -- 172.21.15.146:0/3005522363 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c40137e0 con 0x7f54d00a0a70 2023-10-03T10:18:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.766+0000 7f54d55fa700 1 -- 172.21.15.146:0/3005522363 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c8009b30 con 0x7f54d00a0a70 2023-10-03T10:18:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.766+0000 7f54b77fe700 1 -- 172.21.15.146:0/3005522363 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4013b90 con 0x7f54d00a0a70 2023-10-03T10:18:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.766+0000 7f54d55fa700 1 -- 172.21.15.146:0/3005522363 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d00a03e0 con 0x7f54d00a0a70 2023-10-03T10:18:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.766+0000 7f54b77fe700 1 -- 172.21.15.146:0/3005522363 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f54c4013cf0 con 0x7f54d00a0a70 2023-10-03T10:18:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.767+0000 7f54b77fe700 1 -- 172.21.15.146:0/3005522363 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f54c403f500 con 0x7f54d00a0a70 2023-10-03T10:18:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.767+0000 7f54d55fa700 1 -- 172.21.15.146:0/3005522363 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d0123ef0 con 0x7f54d00a0a70 2023-10-03T10:18:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.771+0000 7f54b77fe700 1 -- 172.21.15.146:0/3005522363 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f54c4017080 con 0x7f54d00a0a70 2023-10-03T10:18:36.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.959+0000 7f54d55fa700 1 -- 172.21.15.146:0/3005522363 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f54d004f2a0 con 0x7f54d00a0a70 2023-10-03T10:18:36.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.960+0000 7f54b77fe700 1 -- 172.21.15.146:0/3005522363 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f54c4021020 con 0x7f54d00a0a70 2023-10-03T10:18:36.961 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:36.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.962+0000 7f54d55fa700 1 -- 172.21.15.146:0/3005522363 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54d00a0a70 msgr2=0x7f54d0122330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.962+0000 7f54d55fa700 1 --2- 172.21.15.146:0/3005522363 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54d00a0a70 0x7f54d0122330 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f54c400e870 tx=0x7f54c400eb80 comp rx=0 tx=0).stop 2023-10-03T10:18:36.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.962+0000 7f54d55fa700 1 -- 172.21.15.146:0/3005522363 shutdown_connections 2023-10-03T10:18:36.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.962+0000 7f54d55fa700 1 --2- 172.21.15.146:0/3005522363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54d0133f50 0x7f54d0122db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.962+0000 7f54d55fa700 1 --2- 172.21.15.146:0/3005522363 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f54d00a0a70 0x7f54d0122330 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.962+0000 7f54d55fa700 1 --2- 172.21.15.146:0/3005522363 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f54d00a1380 0x7f54d0122870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.962+0000 7f54d55fa700 1 -- 172.21.15.146:0/3005522363 >> 172.21.15.146:0/3005522363 conn(0x7f54d00a6610 msgr2=0x7f54d009b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.962+0000 7f54d55fa700 1 -- 172.21.15.146:0/3005522363 shutdown_connections 2023-10-03T10:18:36.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:36.962+0000 7f54d55fa700 1 -- 172.21.15.146:0/3005522363 wait complete. 2023-10-03T10:18:36.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:37.433 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:37.549 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:37.549 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:37.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.558+0000 7f03e1565700 1 Processor -- start 2023-10-03T10:18:37.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.559+0000 7f03e1565700 1 -- start start 2023-10-03T10:18:37.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.559+0000 7f03e1565700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03dc1368e0 0x7f03dc138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.559+0000 7f03e1565700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f03dc139200 0x7f03dc13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.559+0000 7f03e1565700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03dc09a760 con 0x7f03dc133900 2023-10-03T10:18:37.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.559+0000 7f03e1565700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03dc1336e0 con 0x7f03dc139200 2023-10-03T10:18:37.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.559+0000 7f03e1565700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc09a080 con 0x7f03dc1368e0 2023-10-03T10:18:37.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.559+0000 7f03daffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f03dc133900 0x7f03dc133cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44774/0 (socket says 172.21.15.146:44774) 2023-10-03T10:18:37.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.559+0000 7f03daffd700 1 -- 172.21.15.146:0/2670829648 learned_addr learned my addr 172.21.15.146:0/2670829648 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:37.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.559+0000 7f03db7fe700 1 --2- 172.21.15.146:0/2670829648 >> v2:172.21.15.146:3300/0 conn(0x7f03dc139200 0x7f03dc13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.559+0000 7f03da7fc700 1 --2- 172.21.15.146:0/2670829648 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03dc1368e0 0x7f03dc138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.560+0000 7f03db7fe700 1 -- 172.21.15.146:0/2670829648 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03dc1368e0 msgr2=0x7f03dc138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:37.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.560+0000 7f03db7fe700 1 --2- 172.21.15.146:0/2670829648 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03dc1368e0 0x7f03dc138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.560+0000 7f03db7fe700 1 -- 172.21.15.146:0/2670829648 >> v1:172.21.15.146:6789/0 conn(0x7f03dc133900 legacy=0x7f03dc133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.560+0000 7f03db7fe700 1 -- 172.21.15.146:0/2670829648 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc0a23e0 con 0x7f03dc139200 2023-10-03T10:18:37.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.560+0000 7f03db7fe700 1 --2- 172.21.15.146:0/2670829648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03dc139200 0x7f03dc13b5e0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f03d4009d90 tx=0x7f03d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf62b446d4de3d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.560+0000 7f03d9ffb700 1 -- 172.21.15.146:0/2670829648 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d400e070 con 0x7f03dc139200 2023-10-03T10:18:37.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.560+0000 7f03d9ffb700 1 -- 172.21.15.146:0/2670829648 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d400bb20 con 0x7f03dc139200 2023-10-03T10:18:37.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.560+0000 7f03d9ffb700 1 -- 172.21.15.146:0/2670829648 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d4012430 con 0x7f03dc139200 2023-10-03T10:18:37.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.561+0000 7f03e1565700 1 -- 172.21.15.146:0/2670829648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03dc139200 msgr2=0x7f03dc13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.561+0000 7f03e1565700 1 --2- 172.21.15.146:0/2670829648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03dc139200 0x7f03dc13b5e0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f03d4009d90 tx=0x7f03d400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:37.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.561+0000 7f03e1565700 1 -- 172.21.15.146:0/2670829648 shutdown_connections 2023-10-03T10:18:37.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.561+0000 7f03e1565700 1 --2- 172.21.15.146:0/2670829648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03dc139200 0x7f03dc13b5e0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.561+0000 7f03e1565700 1 --2- 172.21.15.146:0/2670829648 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03dc1368e0 0x7f03dc138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.561+0000 7f03e1565700 1 -- 172.21.15.146:0/2670829648 >> 172.21.15.146:0/2670829648 conn(0x7f03dc0a2980 msgr2=0x7f03dc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.561+0000 7f03e1565700 1 -- 172.21.15.146:0/2670829648 shutdown_connections 2023-10-03T10:18:37.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.561+0000 7f03e1565700 1 -- 172.21.15.146:0/2670829648 wait complete. 2023-10-03T10:18:37.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.562+0000 7f03e1565700 1 Processor -- start 2023-10-03T10:18:37.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.562+0000 7f03e1565700 1 -- start start 2023-10-03T10:18:37.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.562+0000 7f03e1565700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03dc133900 0x7f03dc11aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.562+0000 7f03e1565700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03dc1368e0 0x7f03dc11b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.562+0000 7f03e1565700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03dc139200 0x7f03dc11b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.562+0000 7f03e1565700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc130820 con 0x7f03dc1368e0 2023-10-03T10:18:37.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.562+0000 7f03e1565700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc11d130 con 0x7f03dc133900 2023-10-03T10:18:37.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.562+0000 7f03e1565700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc11cc10 con 0x7f03dc139200 2023-10-03T10:18:37.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.563+0000 7f03da7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03dc1368e0 0x7f03dc11b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.563+0000 7f03db7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03dc139200 0x7f03dc11b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.563+0000 7f03db7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03dc139200 0x7f03dc11b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34664/0 (socket says 172.21.15.146:34664) 2023-10-03T10:18:37.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.563+0000 7f03db7fe700 1 -- 172.21.15.146:0/3565348143 learned_addr learned my addr 172.21.15.146:0/3565348143 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:37.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.563+0000 7f03daffd700 1 --2- 172.21.15.146:0/3565348143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03dc133900 0x7f03dc11aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.563+0000 7f03db7fe700 1 -- 172.21.15.146:0/3565348143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03dc133900 msgr2=0x7f03dc11aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.563+0000 7f03db7fe700 1 --2- 172.21.15.146:0/3565348143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03dc133900 0x7f03dc11aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.563+0000 7f03db7fe700 1 -- 172.21.15.146:0/3565348143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03dc1368e0 msgr2=0x7f03dc11b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.563+0000 7f03db7fe700 1 --2- 172.21.15.146:0/3565348143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03dc1368e0 0x7f03dc11b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.563+0000 7f03db7fe700 1 -- 172.21.15.146:0/3565348143 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d4009a70 con 0x7f03dc139200 2023-10-03T10:18:37.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.563+0000 7f03db7fe700 1 --2- 172.21.15.146:0/3565348143 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03dc139200 0x7f03dc11b970 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f03dc133820 tx=0x7f03d4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.563+0000 7f03c37fe700 1 -- 172.21.15.146:0/3565348143 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d4012430 con 0x7f03dc139200 2023-10-03T10:18:37.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.563+0000 7f03c37fe700 1 -- 172.21.15.146:0/3565348143 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d4020070 con 0x7f03dc139200 2023-10-03T10:18:37.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.563+0000 7f03c37fe700 1 -- 172.21.15.146:0/3565348143 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d4003ea0 con 0x7f03dc139200 2023-10-03T10:18:37.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.563+0000 7f03e1565700 1 -- 172.21.15.146:0/3565348143 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03dc11e730 con 0x7f03dc139200 2023-10-03T10:18:37.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.563+0000 7f03e1565700 1 -- 172.21.15.146:0/3565348143 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03dc11f1a0 con 0x7f03dc139200 2023-10-03T10:18:37.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.564+0000 7f03c37fe700 1 -- 172.21.15.146:0/3565348143 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f03d4004040 con 0x7f03dc139200 2023-10-03T10:18:37.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.564+0000 7f03c37fe700 1 -- 172.21.15.146:0/3565348143 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f03d4022070 con 0x7f03dc139200 2023-10-03T10:18:37.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.565+0000 7f03e1565700 1 -- 172.21.15.146:0/3565348143 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03dc04f2a0 con 0x7f03dc139200 2023-10-03T10:18:37.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.570+0000 7f03c37fe700 1 -- 172.21.15.146:0/3565348143 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f03d401a970 con 0x7f03dc139200 2023-10-03T10:18:37.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.682+0000 7f2b56c4d700 1 Processor -- start 2023-10-03T10:18:37.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.682+0000 7f7402dfe700 1 Processor -- start 2023-10-03T10:18:37.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.682+0000 7f2b56c4d700 1 -- start start 2023-10-03T10:18:37.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.682+0000 7f7402dfe700 1 -- start start 2023-10-03T10:18:37.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.683+0000 7f2b56c4d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5009bd20 0x7f2b5009c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.683+0000 7f2b56c4d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2b50134330 0x7f2b5013bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.683+0000 7f2b56c4d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b5009a8e0 con 0x7f2b501337d0 2023-10-03T10:18:37.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.683+0000 7f2b56c4d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5009ad30 con 0x7f2b50134330 2023-10-03T10:18:37.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.683+0000 7f2b56c4d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5009a620 con 0x7f2b5009bd20 2023-10-03T10:18:37.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.683+0000 7f7402dfe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73fc133660 0x7f73fc135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.683+0000 7f7402dfe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73fc135f80 0x7f73fc138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.683+0000 7f2b549e9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5009bd20 0x7f2b5009c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.683+0000 7f2b549e9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5009bd20 0x7f2b5009c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35300/0 (socket says 172.21.15.146:35300) 2023-10-03T10:18:37.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.683+0000 7f2b549e9700 1 -- 172.21.15.146:0/2987833650 learned_addr learned my addr 172.21.15.146:0/2987833650 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:37.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.683+0000 7f2b551ea700 1 --2- 172.21.15.146:0/2987833650 >> v2:172.21.15.146:3300/0 conn(0x7f2b50134330 0x7f2b5013bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.683+0000 7f7402dfe700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73fc09ae40 con 0x7f73fc12d280 2023-10-03T10:18:37.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.683+0000 7f7402dfe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73fc09b9a0 con 0x7f73fc133660 2023-10-03T10:18:37.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.683+0000 7f7402dfe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73fc12dd60 con 0x7f73fc135f80 2023-10-03T10:18:37.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.683+0000 7f740139b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73fc135f80 0x7f73fc138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.683+0000 7f740139b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73fc135f80 0x7f73fc138360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34676/0 (socket says 172.21.15.146:34676) 2023-10-03T10:18:37.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.683+0000 7f740139b700 1 -- 172.21.15.146:0/1614348813 learned_addr learned my addr 172.21.15.146:0/1614348813 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:37.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.683+0000 7f73fbfff700 1 --2- 172.21.15.146:0/1614348813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73fc133660 0x7f73fc135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.684+0000 7f2b551ea700 1 -- 172.21.15.146:0/2987833650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5009bd20 msgr2=0x7f2b5009c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:37.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.684+0000 7f2b551ea700 1 --2- 172.21.15.146:0/2987833650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5009bd20 0x7f2b5009c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.684+0000 7f2b551ea700 1 -- 172.21.15.146:0/2987833650 >> v1:172.21.15.146:6789/0 conn(0x7f2b501337d0 legacy=0x7f2b50133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:37.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.684+0000 7f2b551ea700 1 -- 172.21.15.146:0/2987833650 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5009b840 con 0x7f2b50134330 2023-10-03T10:18:37.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.684+0000 7f2b549e9700 1 --2- 172.21.15.146:0/2987833650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5009bd20 0x7f2b5009c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:37.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.684+0000 7f740139b700 1 -- 172.21.15.146:0/1614348813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73fc133660 msgr2=0x7f73fc135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:37.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.684+0000 7f740139b700 1 --2- 172.21.15.146:0/1614348813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73fc133660 0x7f73fc135a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.684+0000 7f740139b700 1 -- 172.21.15.146:0/1614348813 >> v1:172.21.15.146:6789/0 conn(0x7f73fc12d280 legacy=0x7f73fc12d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.684+0000 7f740139b700 1 -- 172.21.15.146:0/1614348813 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc09bbb0 con 0x7f73fc135f80 2023-10-03T10:18:37.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.684+0000 7f73fbfff700 1 --2- 172.21.15.146:0/1614348813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73fc133660 0x7f73fc135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:37.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.684+0000 7f740139b700 1 --2- 172.21.15.146:0/1614348813 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73fc135f80 0x7f73fc138360 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f73f400d180 tx=0x7f73f400d490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26dbf087c7a988d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.684+0000 7f2b551ea700 1 --2- 172.21.15.146:0/2987833650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b50134330 0x7f2b5013bb10 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009d90 tx=0x7f2b4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bbda1afee8f212a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.684+0000 7f2b4f7fe700 1 -- 172.21.15.146:0/2987833650 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4800e070 con 0x7f2b50134330 2023-10-03T10:18:37.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.684+0000 7f2b4f7fe700 1 -- 172.21.15.146:0/2987833650 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4800bae0 con 0x7f2b50134330 2023-10-03T10:18:37.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.684+0000 7f2b4f7fe700 1 -- 172.21.15.146:0/2987833650 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4800be90 con 0x7f2b50134330 2023-10-03T10:18:37.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.684+0000 7f73fb7fe700 1 -- 172.21.15.146:0/1614348813 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f4010070 con 0x7f73fc135f80 2023-10-03T10:18:37.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.684+0000 7f73fb7fe700 1 -- 172.21.15.146:0/1614348813 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f400ddf0 con 0x7f73fc135f80 2023-10-03T10:18:37.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.684+0000 7f73fb7fe700 1 -- 172.21.15.146:0/1614348813 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f400b310 con 0x7f73fc135f80 2023-10-03T10:18:37.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.685+0000 7f7402dfe700 1 -- 172.21.15.146:0/1614348813 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73fc135f80 msgr2=0x7f73fc138360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.685+0000 7f7402dfe700 1 --2- 172.21.15.146:0/1614348813 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73fc135f80 0x7f73fc138360 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f73f400d180 tx=0x7f73f400d490 comp rx=0 tx=0).stop 2023-10-03T10:18:37.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.685+0000 7f7402dfe700 1 -- 172.21.15.146:0/1614348813 shutdown_connections 2023-10-03T10:18:37.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.685+0000 7f7402dfe700 1 --2- 172.21.15.146:0/1614348813 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73fc135f80 0x7f73fc138360 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.685+0000 7f7402dfe700 1 --2- 172.21.15.146:0/1614348813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73fc133660 0x7f73fc135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.685+0000 7f7402dfe700 1 -- 172.21.15.146:0/1614348813 >> 172.21.15.146:0/1614348813 conn(0x7f73fc0a2980 msgr2=0x7f73fc0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.685+0000 7f7402dfe700 1 -- 172.21.15.146:0/1614348813 shutdown_connections 2023-10-03T10:18:37.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.685+0000 7f7402dfe700 1 -- 172.21.15.146:0/1614348813 wait complete. 2023-10-03T10:18:37.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.685+0000 7f2b56c4d700 1 -- 172.21.15.146:0/2987833650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b50134330 msgr2=0x7f2b5013bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.685+0000 7f2b56c4d700 1 --2- 172.21.15.146:0/2987833650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b50134330 0x7f2b5013bb10 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009d90 tx=0x7f2b4800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:37.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.685+0000 7f2b56c4d700 1 -- 172.21.15.146:0/2987833650 shutdown_connections 2023-10-03T10:18:37.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.685+0000 7f2b56c4d700 1 --2- 172.21.15.146:0/2987833650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b50134330 0x7f2b5013bb10 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.685+0000 7f2b56c4d700 1 --2- 172.21.15.146:0/2987833650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5009bd20 0x7f2b5009c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.685+0000 7f2b56c4d700 1 -- 172.21.15.146:0/2987833650 >> 172.21.15.146:0/2987833650 conn(0x7f2b5009f9f0 msgr2=0x7f2b5009fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.685+0000 7f2b56c4d700 1 -- 172.21.15.146:0/2987833650 shutdown_connections 2023-10-03T10:18:37.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.685+0000 7f2b56c4d700 1 -- 172.21.15.146:0/2987833650 wait complete. 2023-10-03T10:18:37.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.686+0000 7f7402dfe700 1 Processor -- start 2023-10-03T10:18:37.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.686+0000 7f7402dfe700 1 -- start start 2023-10-03T10:18:37.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.686+0000 7f2b56c4d700 1 Processor -- start 2023-10-03T10:18:37.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f7402dfe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73fc12d280 0x7f73fc06fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f2b56c4d700 1 -- start start 2023-10-03T10:18:37.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f7402dfe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73fc133660 0x7f73fc070080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f7402dfe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73fc135f80 0x7f73fc1c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f7402dfe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73fc06f780 con 0x7f73fc12d280 2023-10-03T10:18:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f7402dfe700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73fc12cda0 con 0x7f73fc135f80 2023-10-03T10:18:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f7402dfe700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73fc135ce0 con 0x7f73fc133660 2023-10-03T10:18:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f740139b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73fc135f80 0x7f73fc1c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f7400b9a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73fc12d280 0x7f73fc06fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f740139b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73fc135f80 0x7f73fc1c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35316/0 (socket says 172.21.15.146:35316) 2023-10-03T10:18:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f740139b700 1 -- 172.21.15.146:0/2415964522 learned_addr learned my addr 172.21.15.146:0/2415964522 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f7400b9a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73fc12d280 0x7f73fc06fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39084/0 (socket says 172.21.15.146:39084) 2023-10-03T10:18:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f73fbfff700 1 --2- 172.21.15.146:0/2415964522 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73fc133660 0x7f73fc070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f740139b700 1 -- 172.21.15.146:0/2415964522 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73fc133660 msgr2=0x7f73fc070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f740139b700 1 --2- 172.21.15.146:0/2415964522 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73fc133660 0x7f73fc070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f740139b700 1 -- 172.21.15.146:0/2415964522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73fc12d280 msgr2=0x7f73fc06fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f740139b700 1 --2- 172.21.15.146:0/2415964522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73fc12d280 0x7f73fc06fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f740139b700 1 -- 172.21.15.146:0/2415964522 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f400bd40 con 0x7f73fc135f80 2023-10-03T10:18:37.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f7400b9a700 1 --2- 172.21.15.146:0/2415964522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73fc12d280 0x7f73fc06fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:37.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f740139b700 1 --2- 172.21.15.146:0/2415964522 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73fc135f80 0x7f73fc1c8520 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f73f4014000 tx=0x7f73f4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f2b56c4d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5009bd20 0x7f2b5011cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f2b56c4d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b501337d0 0x7f2b5011d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f2b56c4d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b50134330 0x7f2b5011da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f2b56c4d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5011e470 con 0x7f2b50134330 2023-10-03T10:18:37.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f2b56c4d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5011f200 con 0x7f2b5009bd20 2023-10-03T10:18:37.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.687+0000 7f2b56c4d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b50120ac0 con 0x7f2b501337d0 2023-10-03T10:18:37.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.688+0000 7f2b4ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b501337d0 0x7f2b5011d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.688+0000 7f2b549e9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5009bd20 0x7f2b5011cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.688+0000 7f2b4ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b501337d0 0x7f2b5011d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34692/0 (socket says 172.21.15.146:34692) 2023-10-03T10:18:37.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.688+0000 7f2b4ffff700 1 -- 172.21.15.146:0/3090942597 learned_addr learned my addr 172.21.15.146:0/3090942597 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:37.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.688+0000 7f2b551ea700 1 --2- 172.21.15.146:0/3090942597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b50134330 0x7f2b5011da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.688+0000 7f2b549e9700 1 -- 172.21.15.146:0/3090942597 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b501337d0 msgr2=0x7f2b5011d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.688+0000 7f2b549e9700 1 --2- 172.21.15.146:0/3090942597 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b501337d0 0x7f2b5011d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.688+0000 7f2b549e9700 1 -- 172.21.15.146:0/3090942597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b50134330 msgr2=0x7f2b5011da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.688+0000 7f2b549e9700 1 --2- 172.21.15.146:0/3090942597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b50134330 0x7f2b5011da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.688+0000 7f2b549e9700 1 -- 172.21.15.146:0/3090942597 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b40009500 con 0x7f2b5009bd20 2023-10-03T10:18:37.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.688+0000 7f73f97fa700 1 -- 172.21.15.146:0/2415964522 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f4003e30 con 0x7f73fc135f80 2023-10-03T10:18:37.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.688+0000 7f73f97fa700 1 -- 172.21.15.146:0/2415964522 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f4009810 con 0x7f73fc135f80 2023-10-03T10:18:37.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.688+0000 7f73f97fa700 1 -- 172.21.15.146:0/2415964522 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f4009bc0 con 0x7f73fc135f80 2023-10-03T10:18:37.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.688+0000 7f7402dfe700 1 -- 172.21.15.146:0/2415964522 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73fc09b490 con 0x7f73fc135f80 2023-10-03T10:18:37.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.688+0000 7f7402dfe700 1 -- 172.21.15.146:0/2415964522 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73fc11e6e0 con 0x7f73fc135f80 2023-10-03T10:18:37.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.688+0000 7f2b549e9700 1 --2- 172.21.15.146:0/3090942597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5009bd20 0x7f2b5011cfa0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000ebb0 tx=0x7f2b4000eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.689+0000 7f2b4d7fa700 1 -- 172.21.15.146:0/3090942597 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40005a20 con 0x7f2b5009bd20 2023-10-03T10:18:37.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.689+0000 7f2b4d7fa700 1 -- 172.21.15.146:0/3090942597 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b40005b80 con 0x7f2b5009bd20 2023-10-03T10:18:37.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.689+0000 7f2b56c4d700 1 -- 172.21.15.146:0/3090942597 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b48009a70 con 0x7f2b5009bd20 2023-10-03T10:18:37.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.689+0000 7f2b4d7fa700 1 -- 172.21.15.146:0/3090942597 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4000c850 con 0x7f2b5009bd20 2023-10-03T10:18:37.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.689+0000 7f7402dfe700 1 -- 172.21.15.146:0/2415964522 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73fc04f2a0 con 0x7f73fc135f80 2023-10-03T10:18:37.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.689+0000 7f73f97fa700 1 -- 172.21.15.146:0/2415964522 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f73f4009d20 con 0x7f73fc135f80 2023-10-03T10:18:37.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.690+0000 7f73f97fa700 1 -- 172.21.15.146:0/2415964522 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f73f4040bc0 con 0x7f73fc135f80 2023-10-03T10:18:37.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.689+0000 7f2b56c4d700 1 -- 172.21.15.146:0/3090942597 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b5009cc90 con 0x7f2b5009bd20 2023-10-03T10:18:37.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.690+0000 7f2b4d7fa700 1 -- 172.21.15.146:0/3090942597 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b4000c9b0 con 0x7f2b5009bd20 2023-10-03T10:18:37.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.690+0000 7f2b56c4d700 1 -- 172.21.15.146:0/3090942597 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b5011ec10 con 0x7f2b5009bd20 2023-10-03T10:18:37.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.698+0000 7f2b4d7fa700 1 -- 172.21.15.146:0/3090942597 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2b40011ce0 con 0x7f2b5009bd20 2023-10-03T10:18:37.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.698+0000 7f73f97fa700 1 -- 172.21.15.146:0/2415964522 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73f40137a0 con 0x7f73fc135f80 2023-10-03T10:18:37.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.707+0000 7f2b4d7fa700 1 -- 172.21.15.146:0/3090942597 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b40022300 con 0x7f2b5009bd20 2023-10-03T10:18:37.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.774+0000 7f03e1565700 1 -- 172.21.15.146:0/3565348143 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f03dc11e3d0 con 0x7f03dc139200 2023-10-03T10:18:37.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.774+0000 7f03c37fe700 1 -- 172.21.15.146:0/3565348143 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f03dc11e3d0 con 0x7f03dc139200 2023-10-03T10:18:37.775 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:37.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.776+0000 7f03e1565700 1 -- 172.21.15.146:0/3565348143 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03dc139200 msgr2=0x7f03dc11b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.776+0000 7f03e1565700 1 --2- 172.21.15.146:0/3565348143 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03dc139200 0x7f03dc11b970 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f03dc133820 tx=0x7f03d4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.777+0000 7f03e1565700 1 -- 172.21.15.146:0/3565348143 shutdown_connections 2023-10-03T10:18:37.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.777+0000 7f03e1565700 1 --2- 172.21.15.146:0/3565348143 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03dc139200 0x7f03dc11b970 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.777+0000 7f03e1565700 1 --2- 172.21.15.146:0/3565348143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03dc133900 0x7f03dc11aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.777+0000 7f03e1565700 1 --2- 172.21.15.146:0/3565348143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03dc1368e0 0x7f03dc11b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.777+0000 7f03e1565700 1 -- 172.21.15.146:0/3565348143 >> 172.21.15.146:0/3565348143 conn(0x7f03dc0a2980 msgr2=0x7f03dc131b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.777+0000 7f03e1565700 1 -- 172.21.15.146:0/3565348143 shutdown_connections 2023-10-03T10:18:37.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.777+0000 7f03e1565700 1 -- 172.21.15.146:0/3565348143 wait complete. 2023-10-03T10:18:37.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:37.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.892+0000 7f7402dfe700 1 -- 172.21.15.146:0/2415964522 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f73fc132ee0 con 0x7f73fc135f80 2023-10-03T10:18:37.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.893+0000 7f73f97fa700 1 -- 172.21.15.146:0/2415964522 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f73f4040e60 con 0x7f73fc135f80 2023-10-03T10:18:37.894 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:37.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.895+0000 7f7402dfe700 1 -- 172.21.15.146:0/2415964522 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73fc135f80 msgr2=0x7f73fc1c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.895+0000 7f7402dfe700 1 --2- 172.21.15.146:0/2415964522 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73fc135f80 0x7f73fc1c8520 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f73f4014000 tx=0x7f73f4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.895+0000 7f7402dfe700 1 -- 172.21.15.146:0/2415964522 shutdown_connections 2023-10-03T10:18:37.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.895+0000 7f7402dfe700 1 --2- 172.21.15.146:0/2415964522 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73fc135f80 0x7f73fc1c8520 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.895+0000 7f7402dfe700 1 --2- 172.21.15.146:0/2415964522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73fc12d280 0x7f73fc06fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.895+0000 7f7402dfe700 1 --2- 172.21.15.146:0/2415964522 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f73fc133660 0x7f73fc070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.895+0000 7f7402dfe700 1 -- 172.21.15.146:0/2415964522 >> 172.21.15.146:0/2415964522 conn(0x7f73fc0a2980 msgr2=0x7f73fc131350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.895+0000 7f7402dfe700 1 -- 172.21.15.146:0/2415964522 shutdown_connections 2023-10-03T10:18:37.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.895+0000 7f7402dfe700 1 -- 172.21.15.146:0/2415964522 wait complete. 2023-10-03T10:18:37.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.902+0000 7f2b56c4d700 1 -- 172.21.15.146:0/3090942597 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2b50120640 con 0x7f2b5009bd20 2023-10-03T10:18:37.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.903+0000 7f2b4d7fa700 1 -- 172.21.15.146:0/3090942597 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b50120640 con 0x7f2b5009bd20 2023-10-03T10:18:37.903 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:37.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.905+0000 7f2b56c4d700 1 -- 172.21.15.146:0/3090942597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5009bd20 msgr2=0x7f2b5011cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.905+0000 7f2b56c4d700 1 --2- 172.21.15.146:0/3090942597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5009bd20 0x7f2b5011cfa0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000ebb0 tx=0x7f2b4000eec0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.905+0000 7f2b56c4d700 1 -- 172.21.15.146:0/3090942597 shutdown_connections 2023-10-03T10:18:37.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.905+0000 7f2b56c4d700 1 --2- 172.21.15.146:0/3090942597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b50134330 0x7f2b5011da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.905+0000 7f2b56c4d700 1 --2- 172.21.15.146:0/3090942597 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b5009bd20 0x7f2b5011cfa0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.905+0000 7f2b56c4d700 1 --2- 172.21.15.146:0/3090942597 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b501337d0 0x7f2b5011d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.905+0000 7f2b56c4d700 1 -- 172.21.15.146:0/3090942597 >> 172.21.15.146:0/3090942597 conn(0x7f2b5009f9f0 msgr2=0x7f2b50133020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.905+0000 7f2b56c4d700 1 -- 172.21.15.146:0/3090942597 shutdown_connections 2023-10-03T10:18:37.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:37.905+0000 7f2b56c4d700 1 -- 172.21.15.146:0/3090942597 wait complete. 2023-10-03T10:18:37.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:37.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:37.976 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:38.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.098+0000 7f2f5b929700 1 Processor -- start 2023-10-03T10:18:38.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.098+0000 7f2f5b929700 1 -- start start 2023-10-03T10:18:38.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.099+0000 7f2f5b929700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f54133ad0 0x7f2f54133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.099+0000 7f2f5b929700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f54130bc0 0x7f2f5413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.099+0000 7f2f5b929700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5406b2d0 con 0x7f2f541300a0 2023-10-03T10:18:38.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.099+0000 7f2f5b929700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f54133610 con 0x7f2f54133ad0 2023-10-03T10:18:38.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.099+0000 7f2f5b929700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5409a500 con 0x7f2f54130bc0 2023-10-03T10:18:38.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.099+0000 7f2f596c5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f54133ad0 0x7f2f54133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.099+0000 7f2f59ec6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f54130bc0 0x7f2f5413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.099+0000 7f2f596c5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f54133ad0 0x7f2f54133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35336/0 (socket says 172.21.15.146:35336) 2023-10-03T10:18:38.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.099+0000 7f2f59ec6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f54130bc0 0x7f2f5413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34698/0 (socket says 172.21.15.146:34698) 2023-10-03T10:18:38.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.099+0000 7f2f596c5700 1 -- 172.21.15.146:0/3325381175 learned_addr learned my addr 172.21.15.146:0/3325381175 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:38.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.099+0000 7f2f4bfff700 1 -- 172.21.15.146:0/3325381175 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369652334 0 0) 0x7f2f5406b2d0 con 0x7f2f541300a0 2023-10-03T10:18:38.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.099+0000 7f2f4bfff700 1 -- 172.21.15.146:0/3325381175 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f400035b0 con 0x7f2f541300a0 2023-10-03T10:18:38.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.099+0000 7f2f59ec6700 1 -- 172.21.15.146:0/3325381175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f54133ad0 msgr2=0x7f2f54133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:38.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.099+0000 7f2f59ec6700 1 --2- 172.21.15.146:0/3325381175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f54133ad0 0x7f2f54133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.099+0000 7f2f59ec6700 1 -- 172.21.15.146:0/3325381175 >> v1:172.21.15.146:6789/0 conn(0x7f2f541300a0 legacy=0x7f2f541304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.099+0000 7f2f59ec6700 1 -- 172.21.15.146:0/3325381175 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f541338b0 con 0x7f2f54130bc0 2023-10-03T10:18:38.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.099+0000 7f2f596c5700 1 --2- 172.21.15.146:0/3325381175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f54133ad0 0x7f2f54133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.100+0000 7f2f59ec6700 1 --2- 172.21.15.146:0/3325381175 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f54130bc0 0x7f2f5413b990 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c009dc0 tx=0x7f2f4c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f5bf5757f32730f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.100+0000 7f2f4bfff700 1 -- 172.21.15.146:0/3325381175 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c00e070 con 0x7f2f54130bc0 2023-10-03T10:18:38.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.100+0000 7f2f4bfff700 1 -- 172.21.15.146:0/3325381175 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4c00bb20 con 0x7f2f54130bc0 2023-10-03T10:18:38.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.100+0000 7f2f4bfff700 1 -- 172.21.15.146:0/3325381175 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c012430 con 0x7f2f54130bc0 2023-10-03T10:18:38.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.100+0000 7f2f5b929700 1 -- 172.21.15.146:0/3325381175 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f54130bc0 msgr2=0x7f2f5413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.100+0000 7f2f5b929700 1 --2- 172.21.15.146:0/3325381175 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f54130bc0 0x7f2f5413b990 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c009dc0 tx=0x7f2f4c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:38.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.100+0000 7f2f5b929700 1 -- 172.21.15.146:0/3325381175 shutdown_connections 2023-10-03T10:18:38.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.100+0000 7f2f5b929700 1 --2- 172.21.15.146:0/3325381175 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f54130bc0 0x7f2f5413b990 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.100+0000 7f2f5b929700 1 --2- 172.21.15.146:0/3325381175 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f54133ad0 0x7f2f54133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.100+0000 7f2f5b929700 1 -- 172.21.15.146:0/3325381175 >> 172.21.15.146:0/3325381175 conn(0x7f2f54099c40 msgr2=0x7f2f540a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.100+0000 7f2f5b929700 1 -- 172.21.15.146:0/3325381175 shutdown_connections 2023-10-03T10:18:38.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.100+0000 7f2f5b929700 1 -- 172.21.15.146:0/3325381175 wait complete. 2023-10-03T10:18:38.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.101+0000 7f2f5b929700 1 Processor -- start 2023-10-03T10:18:38.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.101+0000 7f2f5b929700 1 -- start start 2023-10-03T10:18:38.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f5b929700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f541300a0 0x7f2f5411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f5b929700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f54130bc0 0x7f2f5411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f5b929700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f54133ad0 0x7f2f5411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f5b929700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f54072450 con 0x7f2f541300a0 2023-10-03T10:18:38.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f5b929700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5411fc80 con 0x7f2f54133ad0 2023-10-03T10:18:38.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f5b929700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5412dd00 con 0x7f2f54130bc0 2023-10-03T10:18:38.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f58ec4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f54130bc0 0x7f2f5411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f59ec6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f54133ad0 0x7f2f5411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f58ec4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f54130bc0 0x7f2f5411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34708/0 (socket says 172.21.15.146:34708) 2023-10-03T10:18:38.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f59ec6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f54133ad0 0x7f2f5411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35346/0 (socket says 172.21.15.146:35346) 2023-10-03T10:18:38.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f58ec4700 1 -- 172.21.15.146:0/3486528268 learned_addr learned my addr 172.21.15.146:0/3486528268 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:38.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f596c5700 1 --2- 172.21.15.146:0/3486528268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f541300a0 0x7f2f5411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f59ec6700 1 -- 172.21.15.146:0/3486528268 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f54130bc0 msgr2=0x7f2f5411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f59ec6700 1 --2- 172.21.15.146:0/3486528268 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f54130bc0 0x7f2f5411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f59ec6700 1 -- 172.21.15.146:0/3486528268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f541300a0 msgr2=0x7f2f5411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f59ec6700 1 --2- 172.21.15.146:0/3486528268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f541300a0 0x7f2f5411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f59ec6700 1 -- 172.21.15.146:0/3486528268 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f44009550 con 0x7f2f54133ad0 2023-10-03T10:18:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f58ec4700 1 --2- 172.21.15.146:0/3486528268 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f54130bc0 0x7f2f5411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f59ec6700 1 --2- 172.21.15.146:0/3486528268 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f54133ad0 0x7f2f5411e4c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c016000 tx=0x7f2f4c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f49ffb700 1 -- 172.21.15.146:0/3486528268 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c012430 con 0x7f2f54133ad0 2023-10-03T10:18:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f49ffb700 1 -- 172.21.15.146:0/3486528268 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4c020070 con 0x7f2f54133ad0 2023-10-03T10:18:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f49ffb700 1 -- 172.21.15.146:0/3486528268 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c004280 con 0x7f2f54133ad0 2023-10-03T10:18:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.102+0000 7f2f5b929700 1 -- 172.21.15.146:0/3486528268 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4c009a70 con 0x7f2f54133ad0 2023-10-03T10:18:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.103+0000 7f2f5b929700 1 -- 172.21.15.146:0/3486528268 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5411f970 con 0x7f2f54133ad0 2023-10-03T10:18:38.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.103+0000 7f2f5b929700 1 -- 172.21.15.146:0/3486528268 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5411fea0 con 0x7f2f54133ad0 2023-10-03T10:18:38.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.104+0000 7f2f49ffb700 1 -- 172.21.15.146:0/3486528268 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f4c0043e0 con 0x7f2f54133ad0 2023-10-03T10:18:38.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.104+0000 7f2f49ffb700 1 -- 172.21.15.146:0/3486528268 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2f4c022070 con 0x7f2f54133ad0 2023-10-03T10:18:38.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.108+0000 7f2f49ffb700 1 -- 172.21.15.146:0/3486528268 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f4c004690 con 0x7f2f54133ad0 2023-10-03T10:18:38.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.293+0000 7f2f5b929700 1 -- 172.21.15.146:0/3486528268 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2f5404f2a0 con 0x7f2f54133ad0 2023-10-03T10:18:38.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.293+0000 7f2f49ffb700 1 -- 172.21.15.146:0/3486528268 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f4c02c020 con 0x7f2f54133ad0 2023-10-03T10:18:38.294 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:38.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.295+0000 7f2f5b929700 1 -- 172.21.15.146:0/3486528268 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f54133ad0 msgr2=0x7f2f5411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.295+0000 7f2f5b929700 1 --2- 172.21.15.146:0/3486528268 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f54133ad0 0x7f2f5411e4c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c016000 tx=0x7f2f4c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.295+0000 7f2f5b929700 1 -- 172.21.15.146:0/3486528268 shutdown_connections 2023-10-03T10:18:38.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.295+0000 7f2f5b929700 1 --2- 172.21.15.146:0/3486528268 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f54133ad0 0x7f2f5411e4c0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.295+0000 7f2f5b929700 1 --2- 172.21.15.146:0/3486528268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f541300a0 0x7f2f5411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.295+0000 7f2f5b929700 1 --2- 172.21.15.146:0/3486528268 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2f54130bc0 0x7f2f5411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.295+0000 7f2f5b929700 1 -- 172.21.15.146:0/3486528268 >> 172.21.15.146:0/3486528268 conn(0x7f2f54099c40 msgr2=0x7f2f5412e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.296+0000 7f2f5b929700 1 -- 172.21.15.146:0/3486528268 shutdown_connections 2023-10-03T10:18:38.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.296+0000 7f2f5b929700 1 -- 172.21.15.146:0/3486528268 wait complete. 2023-10-03T10:18:38.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:38.791 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:38.908 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:38.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.915+0000 7fde8ea01700 1 Processor -- start 2023-10-03T10:18:38.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.916+0000 7fde8ea01700 1 -- start start 2023-10-03T10:18:38.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.916+0000 7fde8ea01700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fde88133ad0 0x7fde88133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.916+0000 7fde8ea01700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde88130bc0 0x7fde8813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.916+0000 7fde8ea01700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde8806b2d0 con 0x7fde881300a0 2023-10-03T10:18:38.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.916+0000 7fde8ea01700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde88133610 con 0x7fde88133ad0 2023-10-03T10:18:38.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.916+0000 7fde8ea01700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde8809a500 con 0x7fde88130bc0 2023-10-03T10:18:38.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.916+0000 7fde87fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fde88133ad0 0x7fde88133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.916+0000 7fde877fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fde881300a0 0x7fde881304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44806/0 (socket says 172.21.15.146:44806) 2023-10-03T10:18:38.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.916+0000 7fde8cf9e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde88130bc0 0x7fde8813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.916+0000 7fde877fe700 1 -- 172.21.15.146:0/2201206138 learned_addr learned my addr 172.21.15.146:0/2201206138 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:38.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.916+0000 7fde8cf9e700 1 -- 172.21.15.146:0/2201206138 >> v2:172.21.15.146:3300/0 conn(0x7fde88133ad0 msgr2=0x7fde88133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:38.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.916+0000 7fde8cf9e700 1 --2- 172.21.15.146:0/2201206138 >> v2:172.21.15.146:3300/0 conn(0x7fde88133ad0 0x7fde88133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.916+0000 7fde8cf9e700 1 -- 172.21.15.146:0/2201206138 >> v1:172.21.15.146:6789/0 conn(0x7fde881300a0 legacy=0x7fde881304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.917+0000 7fde8cf9e700 1 -- 172.21.15.146:0/2201206138 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde881338b0 con 0x7fde88130bc0 2023-10-03T10:18:38.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.917+0000 7fde87fff700 1 --2- 172.21.15.146:0/2201206138 >> v2:172.21.15.146:3300/0 conn(0x7fde88133ad0 0x7fde88133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.917+0000 7fde8cf9e700 1 --2- 172.21.15.146:0/2201206138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde88130bc0 0x7fde8813b990 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fde80009d90 tx=0x7fde8000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab62c4ed95553224 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.917+0000 7fde86ffd700 1 -- 172.21.15.146:0/2201206138 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8000e070 con 0x7fde88130bc0 2023-10-03T10:18:38.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.917+0000 7fde86ffd700 1 -- 172.21.15.146:0/2201206138 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8000bb20 con 0x7fde88130bc0 2023-10-03T10:18:38.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.917+0000 7fde86ffd700 1 -- 172.21.15.146:0/2201206138 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde80012430 con 0x7fde88130bc0 2023-10-03T10:18:38.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.917+0000 7fde8ea01700 1 -- 172.21.15.146:0/2201206138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde88130bc0 msgr2=0x7fde8813b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.917+0000 7fde8ea01700 1 --2- 172.21.15.146:0/2201206138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde88130bc0 0x7fde8813b990 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fde80009d90 tx=0x7fde8000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:38.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.917+0000 7fde8ea01700 1 -- 172.21.15.146:0/2201206138 shutdown_connections 2023-10-03T10:18:38.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.918+0000 7fde8ea01700 1 --2- 172.21.15.146:0/2201206138 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde88130bc0 0x7fde8813b990 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.918+0000 7fde8ea01700 1 --2- 172.21.15.146:0/2201206138 >> v2:172.21.15.146:3300/0 conn(0x7fde88133ad0 0x7fde88133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.918+0000 7fde8ea01700 1 -- 172.21.15.146:0/2201206138 >> 172.21.15.146:0/2201206138 conn(0x7fde88099c40 msgr2=0x7fde880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.920 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:38.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.918+0000 7fde8ea01700 1 -- 172.21.15.146:0/2201206138 shutdown_connections 2023-10-03T10:18:38.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.918+0000 7fde8ea01700 1 -- 172.21.15.146:0/2201206138 wait complete. 2023-10-03T10:18:38.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.919+0000 7fde8ea01700 1 Processor -- start 2023-10-03T10:18:38.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.919+0000 7fde8ea01700 1 -- start start 2023-10-03T10:18:38.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.920+0000 7fde8ea01700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde881300a0 0x7fde8811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.920+0000 7fde8ea01700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde88130bc0 0x7fde8811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.920+0000 7fde8ea01700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fde88133ad0 0x7fde8811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.920+0000 7fde8ea01700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8812d8f0 con 0x7fde88130bc0 2023-10-03T10:18:38.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.920+0000 7fde8ea01700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8811ffa0 con 0x7fde88133ad0 2023-10-03T10:18:38.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.920+0000 7fde8ea01700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde8812dd00 con 0x7fde881300a0 2023-10-03T10:18:38.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.920+0000 7fde87fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde881300a0 0x7fde8811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.920+0000 7fde8cf9e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fde88133ad0 0x7fde8811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.920+0000 7fde87fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde881300a0 0x7fde8811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34720/0 (socket says 172.21.15.146:34720) 2023-10-03T10:18:38.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.920+0000 7fde8cf9e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fde88133ad0 0x7fde8811e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35356/0 (socket says 172.21.15.146:35356) 2023-10-03T10:18:38.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.920+0000 7fde87fff700 1 -- 172.21.15.146:0/1834721572 learned_addr learned my addr 172.21.15.146:0/1834721572 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:38.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.920+0000 7fde877fe700 1 --2- 172.21.15.146:0/1834721572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde88130bc0 0x7fde8811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.920+0000 7fde877fe700 1 -- 172.21.15.146:0/1834721572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde881300a0 msgr2=0x7fde8811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.920+0000 7fde877fe700 1 --2- 172.21.15.146:0/1834721572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde881300a0 0x7fde8811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.920+0000 7fde877fe700 1 -- 172.21.15.146:0/1834721572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fde88133ad0 msgr2=0x7fde8811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.920+0000 7fde877fe700 1 --2- 172.21.15.146:0/1834721572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fde88133ad0 0x7fde8811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.920+0000 7fde877fe700 1 -- 172.21.15.146:0/1834721572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde780094a0 con 0x7fde88130bc0 2023-10-03T10:18:38.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.920+0000 7fde8cf9e700 1 --2- 172.21.15.146:0/1834721572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fde88133ad0 0x7fde8811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.920+0000 7fde87fff700 1 --2- 172.21.15.146:0/1834721572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde881300a0 0x7fde8811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.921+0000 7fde877fe700 1 --2- 172.21.15.146:0/1834721572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde88130bc0 0x7fde8811df80 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00c3c0 tx=0x7fde7c00c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.921+0000 7fde84ff9700 1 -- 172.21.15.146:0/1834721572 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c005b40 con 0x7fde88130bc0 2023-10-03T10:18:38.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.921+0000 7fde84ff9700 1 -- 172.21.15.146:0/1834721572 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7c005ca0 con 0x7fde88130bc0 2023-10-03T10:18:38.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.921+0000 7fde8ea01700 1 -- 172.21.15.146:0/1834721572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde80009a70 con 0x7fde88130bc0 2023-10-03T10:18:38.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.921+0000 7fde84ff9700 1 -- 172.21.15.146:0/1834721572 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0072d0 con 0x7fde88130bc0 2023-10-03T10:18:38.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.921+0000 7fde8ea01700 1 -- 172.21.15.146:0/1834721572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8811f2e0 con 0x7fde88130bc0 2023-10-03T10:18:38.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.922+0000 7fde8ea01700 1 -- 172.21.15.146:0/1834721572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde8804f2a0 con 0x7fde88130bc0 2023-10-03T10:18:38.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.922+0000 7fde84ff9700 1 -- 172.21.15.146:0/1834721572 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde7c007430 con 0x7fde88130bc0 2023-10-03T10:18:38.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.922+0000 7fde84ff9700 1 -- 172.21.15.146:0/1834721572 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fde7c03e970 con 0x7fde88130bc0 2023-10-03T10:18:38.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:38.927+0000 7fde84ff9700 1 -- 172.21.15.146:0/1834721572 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde7c0076e0 con 0x7fde88130bc0 2023-10-03T10:18:39.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.037+0000 7ff7b0eb0700 1 Processor -- start 2023-10-03T10:18:39.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.037+0000 7ff7b0eb0700 1 -- start start 2023-10-03T10:18:39.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.038+0000 7ff7b0eb0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff7ac09ad40 0x7ff7ac133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.038+0000 7ff7b0eb0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7ac133f70 0x7ff7ac1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.038+0000 7ff7b0eb0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7ac0a0a70 0x7ff7ac0a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.038+0000 7ff7b0eb0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7ac0a3b60 con 0x7ff7ac09ad40 2023-10-03T10:18:39.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.038+0000 7ff7b0eb0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac1348e0 con 0x7ff7ac0a0a70 2023-10-03T10:18:39.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.038+0000 7ff7b0eb0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac09b110 con 0x7ff7ac133f70 2023-10-03T10:18:39.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.038+0000 7ff7aa59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff7ac09ad40 0x7ff7ac133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.038+0000 7ff7aad9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7ac0a0a70 0x7ff7ac0a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.038+0000 7ff7aa59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff7ac09ad40 0x7ff7ac133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39118/0 (socket says 172.21.15.146:39118) 2023-10-03T10:18:39.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.038+0000 7ff7aa59c700 1 -- 172.21.15.146:0/4095251618 learned_addr learned my addr 172.21.15.146:0/4095251618 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:39.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.038+0000 7ff7a9d9b700 1 --2- 172.21.15.146:0/4095251618 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7ac133f70 0x7ff7ac1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.038+0000 7ff7aad9d700 1 -- 172.21.15.146:0/4095251618 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7ac133f70 msgr2=0x7ff7ac1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:39.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.038+0000 7ff7aad9d700 1 --2- 172.21.15.146:0/4095251618 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7ac133f70 0x7ff7ac1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.038+0000 7ff7aad9d700 1 -- 172.21.15.146:0/4095251618 >> v2:172.21.15.146:3300/0 conn(0x7ff7ac09ad40 msgr2=0x7ff7ac133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:39.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.038+0000 7ff7aad9d700 1 --2- 172.21.15.146:0/4095251618 >> v2:172.21.15.146:3300/0 conn(0x7ff7ac09ad40 0x7ff7ac133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.038+0000 7ff7aad9d700 1 -- 172.21.15.146:0/4095251618 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac0a2fa0 con 0x7ff7ac0a0a70 2023-10-03T10:18:39.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.038+0000 7ff7aa59c700 1 --2- 172.21.15.146:0/4095251618 >> v2:172.21.15.146:3300/0 conn(0x7ff7ac09ad40 0x7ff7ac133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.039+0000 7ff7aad9d700 1 --2- 172.21.15.146:0/4095251618 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7ac0a0a70 0x7ff7ac0a0f10 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009d90 tx=0x7ff7a400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f63aeefdd558de21 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.039+0000 7ff7a959a700 1 -- 172.21.15.146:0/4095251618 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a400e070 con 0x7ff7ac0a0a70 2023-10-03T10:18:39.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.039+0000 7ff7a959a700 1 -- 172.21.15.146:0/4095251618 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a400bb20 con 0x7ff7ac0a0a70 2023-10-03T10:18:39.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.039+0000 7ff7a959a700 1 -- 172.21.15.146:0/4095251618 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4012430 con 0x7ff7ac0a0a70 2023-10-03T10:18:39.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.039+0000 7ff7b0eb0700 1 -- 172.21.15.146:0/4095251618 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7ac0a0a70 msgr2=0x7ff7ac0a0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.039+0000 7ff7b0eb0700 1 --2- 172.21.15.146:0/4095251618 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7ac0a0a70 0x7ff7ac0a0f10 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009d90 tx=0x7ff7a400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:39.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.040+0000 7ff7b0eb0700 1 -- 172.21.15.146:0/4095251618 shutdown_connections 2023-10-03T10:18:39.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.040+0000 7ff7b0eb0700 1 --2- 172.21.15.146:0/4095251618 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7ac0a0a70 0x7ff7ac0a0f10 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.040+0000 7ff7b0eb0700 1 --2- 172.21.15.146:0/4095251618 >> v2:172.21.15.146:3300/0 conn(0x7ff7ac09ad40 0x7ff7ac133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.040+0000 7ff7b0eb0700 1 --2- 172.21.15.146:0/4095251618 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7ac133f70 0x7ff7ac1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.040+0000 7ff7b0eb0700 1 -- 172.21.15.146:0/4095251618 >> 172.21.15.146:0/4095251618 conn(0x7ff7ac099c40 msgr2=0x7ff7ac06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.040+0000 7ff7b0eb0700 1 -- 172.21.15.146:0/4095251618 shutdown_connections 2023-10-03T10:18:39.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.040+0000 7ff7b0eb0700 1 -- 172.21.15.146:0/4095251618 wait complete. 2023-10-03T10:18:39.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.041+0000 7ff7b0eb0700 1 Processor -- start 2023-10-03T10:18:39.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.041+0000 7ff7b0eb0700 1 -- start start 2023-10-03T10:18:39.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.041+0000 7ff7b0eb0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7ac09ad40 0x7ff7ac1c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.041+0000 7ff7b0eb0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7ac0a0a70 0x7ff7ac1c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.041+0000 7ff7b0eb0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7ac133f70 0x7ff7ac1c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.041+0000 7ff7b0eb0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac121330 con 0x7ff7ac09ad40 2023-10-03T10:18:39.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.041+0000 7ff7b0eb0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac11f670 con 0x7ff7ac0a0a70 2023-10-03T10:18:39.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.041+0000 7ff7b0eb0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac09c140 con 0x7ff7ac133f70 2023-10-03T10:18:39.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.041+0000 7ff7aa59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7ac09ad40 0x7ff7ac1c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.041+0000 7ff7a9d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7ac0a0a70 0x7ff7ac1c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.041+0000 7ff7aa59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7ac09ad40 0x7ff7ac1c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39130/0 (socket says 172.21.15.146:39130) 2023-10-03T10:18:39.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.041+0000 7ff7aa59c700 1 -- 172.21.15.146:0/1085124209 learned_addr learned my addr 172.21.15.146:0/1085124209 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:39.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.041+0000 7ff7aad9d700 1 --2- 172.21.15.146:0/1085124209 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7ac133f70 0x7ff7ac1c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.042+0000 7ff7aad9d700 1 -- 172.21.15.146:0/1085124209 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7ac0a0a70 msgr2=0x7ff7ac1c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.042+0000 7ff7aad9d700 1 --2- 172.21.15.146:0/1085124209 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7ac0a0a70 0x7ff7ac1c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.042+0000 7ff7aad9d700 1 -- 172.21.15.146:0/1085124209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7ac09ad40 msgr2=0x7ff7ac1c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.042+0000 7ff7aad9d700 1 --2- 172.21.15.146:0/1085124209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7ac09ad40 0x7ff7ac1c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.042+0000 7ff7aad9d700 1 -- 172.21.15.146:0/1085124209 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79c009550 con 0x7ff7ac133f70 2023-10-03T10:18:39.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.042+0000 7ff7aa59c700 1 --2- 172.21.15.146:0/1085124209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7ac09ad40 0x7ff7ac1c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.042+0000 7ff7aad9d700 1 --2- 172.21.15.146:0/1085124209 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7ac133f70 0x7ff7ac1c8c80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009d90 tx=0x7ff7a4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.042+0000 7ff79affd700 1 -- 172.21.15.146:0/1085124209 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4012430 con 0x7ff7ac133f70 2023-10-03T10:18:39.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.042+0000 7ff79affd700 1 -- 172.21.15.146:0/1085124209 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a4020070 con 0x7ff7ac133f70 2023-10-03T10:18:39.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.042+0000 7ff79affd700 1 -- 172.21.15.146:0/1085124209 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4004280 con 0x7ff7ac133f70 2023-10-03T10:18:39.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.042+0000 7ff7b0eb0700 1 -- 172.21.15.146:0/1085124209 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a4009a70 con 0x7ff7ac133f70 2023-10-03T10:18:39.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.042+0000 7ff7b0eb0700 1 -- 172.21.15.146:0/1085124209 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7ac11fe60 con 0x7ff7ac133f70 2023-10-03T10:18:39.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.043+0000 7ff79affd700 1 -- 172.21.15.146:0/1085124209 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff7a40043e0 con 0x7ff7ac133f70 2023-10-03T10:18:39.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.043+0000 7ff79affd700 1 -- 172.21.15.146:0/1085124209 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff7a4022070 con 0x7ff7ac133f70 2023-10-03T10:18:39.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.044+0000 7ff7b0eb0700 1 -- 172.21.15.146:0/1085124209 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7ac04f2a0 con 0x7ff7ac133f70 2023-10-03T10:18:39.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.050+0000 7f1dae9ec700 1 Processor -- start 2023-10-03T10:18:39.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.050+0000 7f1dae9ec700 1 -- start start 2023-10-03T10:18:39.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.051+0000 7f1dae9ec700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1da809e870 0x7f1da809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.051+0000 7f1dae9ec700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1da809f180 0x7f1da8133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.051+0000 7f1dae9ec700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da809fa00 con 0x7f1da8134160 2023-10-03T10:18:39.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.051+0000 7f1dae9ec700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da80a0370 con 0x7f1da809e870 2023-10-03T10:18:39.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.051+0000 7f1dae9ec700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da806bec0 con 0x7f1da809f180 2023-10-03T10:18:39.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.051+0000 7f1da7fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1da809e870 0x7f1da809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.051+0000 7f1da7fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1da809e870 0x7f1da809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39140/0 (socket says 172.21.15.146:39140) 2023-10-03T10:18:39.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.051+0000 7f1da7fff700 1 -- 172.21.15.146:0/792791325 learned_addr learned my addr 172.21.15.146:0/792791325 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:39.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.051+0000 7f1da77fe700 1 --2- 172.21.15.146:0/792791325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1da809f180 0x7f1da8133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.051+0000 7ff79affd700 1 -- 172.21.15.146:0/1085124209 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff7a4046060 con 0x7ff7ac133f70 2023-10-03T10:18:39.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.051+0000 7f1da7fff700 1 -- 172.21.15.146:0/792791325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1da809f180 msgr2=0x7f1da8133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:39.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.051+0000 7f1da7fff700 1 --2- 172.21.15.146:0/792791325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1da809f180 0x7f1da8133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.051+0000 7f1da7fff700 1 -- 172.21.15.146:0/792791325 >> v1:172.21.15.146:6789/0 conn(0x7f1da8134160 legacy=0x7f1da813ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.051+0000 7f1da6ffd700 1 -- 172.21.15.146:0/792791325 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548628582 0 0) 0x7f1da809fa00 con 0x7f1da8134160 2023-10-03T10:18:39.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.051+0000 7f1da7fff700 1 -- 172.21.15.146:0/792791325 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da809ada0 con 0x7f1da809e870 2023-10-03T10:18:39.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.052+0000 7f1da7fff700 1 --2- 172.21.15.146:0/792791325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da809e870 0x7f1da809ec40 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f1d980098f0 tx=0x7f1d98009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3ba7b23010364e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.052+0000 7f1da6ffd700 1 -- 172.21.15.146:0/792791325 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d98011830 con 0x7f1da809e870 2023-10-03T10:18:39.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.052+0000 7f1da6ffd700 1 -- 172.21.15.146:0/792791325 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d98011990 con 0x7f1da809e870 2023-10-03T10:18:39.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.052+0000 7f1da6ffd700 1 -- 172.21.15.146:0/792791325 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d98011d20 con 0x7f1da809e870 2023-10-03T10:18:39.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.052+0000 7f1dae9ec700 1 -- 172.21.15.146:0/792791325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da809e870 msgr2=0x7f1da809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.052+0000 7f1dae9ec700 1 --2- 172.21.15.146:0/792791325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da809e870 0x7f1da809ec40 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f1d980098f0 tx=0x7f1d98009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.052+0000 7f1dae9ec700 1 -- 172.21.15.146:0/792791325 shutdown_connections 2023-10-03T10:18:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.052+0000 7f1dae9ec700 1 --2- 172.21.15.146:0/792791325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da809e870 0x7f1da809ec40 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.052+0000 7f1dae9ec700 1 --2- 172.21.15.146:0/792791325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1da809f180 0x7f1da8133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.052+0000 7f1dae9ec700 1 -- 172.21.15.146:0/792791325 >> 172.21.15.146:0/792791325 conn(0x7f1da80a4430 msgr2=0x7f1da80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.052+0000 7f1dae9ec700 1 -- 172.21.15.146:0/792791325 shutdown_connections 2023-10-03T10:18:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.052+0000 7f1dae9ec700 1 -- 172.21.15.146:0/792791325 wait complete. 2023-10-03T10:18:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.053+0000 7f1dae9ec700 1 Processor -- start 2023-10-03T10:18:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.054+0000 7f1dae9ec700 1 -- start start 2023-10-03T10:18:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.054+0000 7f1dae9ec700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1da809e870 0x7f1da81c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.054+0000 7f1dae9ec700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1da809f180 0x7f1da81c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.054+0000 7f1dae9ec700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da8134160 0x7f1da81c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.054+0000 7f1dae9ec700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da8124950 con 0x7f1da8134160 2023-10-03T10:18:39.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.054+0000 7f1dae9ec700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da8125030 con 0x7f1da809e870 2023-10-03T10:18:39.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.054+0000 7f1dae9ec700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80a1610 con 0x7f1da809f180 2023-10-03T10:18:39.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.054+0000 7f1da77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1da809f180 0x7f1da81c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.054+0000 7f1da77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1da809f180 0x7f1da81c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34742/0 (socket says 172.21.15.146:34742) 2023-10-03T10:18:39.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.054+0000 7f1da77fe700 1 -- 172.21.15.146:0/2729054536 learned_addr learned my addr 172.21.15.146:0/2729054536 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:39.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.054+0000 7f1dacf89700 1 --2- 172.21.15.146:0/2729054536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da8134160 0x7f1da81c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.054+0000 7f1da7fff700 1 --2- 172.21.15.146:0/2729054536 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1da809e870 0x7f1da81c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.054+0000 7f1dacf89700 1 -- 172.21.15.146:0/2729054536 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1da809f180 msgr2=0x7f1da81c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.054+0000 7f1dacf89700 1 --2- 172.21.15.146:0/2729054536 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1da809f180 0x7f1da81c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.054+0000 7f1dacf89700 1 -- 172.21.15.146:0/2729054536 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1da809e870 msgr2=0x7f1da81c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.054+0000 7f1dacf89700 1 --2- 172.21.15.146:0/2729054536 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1da809e870 0x7f1da81c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.054+0000 7f1dacf89700 1 -- 172.21.15.146:0/2729054536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d98009550 con 0x7f1da8134160 2023-10-03T10:18:39.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.054+0000 7f1da77fe700 1 --2- 172.21.15.146:0/2729054536 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1da809f180 0x7f1da81c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.055+0000 7f1dacf89700 1 --2- 172.21.15.146:0/2729054536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da8134160 0x7f1da81c8eb0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f1da000c7c0 tx=0x7f1da000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.055+0000 7f1da4ff9700 1 -- 172.21.15.146:0/2729054536 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da0003e30 con 0x7f1da8134160 2023-10-03T10:18:39.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.055+0000 7f1da4ff9700 1 -- 172.21.15.146:0/2729054536 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da0005070 con 0x7f1da8134160 2023-10-03T10:18:39.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.055+0000 7f1dae9ec700 1 -- 172.21.15.146:0/2729054536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da8126400 con 0x7f1da8134160 2023-10-03T10:18:39.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.055+0000 7f1da4ff9700 1 -- 172.21.15.146:0/2729054536 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da0005420 con 0x7f1da8134160 2023-10-03T10:18:39.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.055+0000 7f1dae9ec700 1 -- 172.21.15.146:0/2729054536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da8126e70 con 0x7f1da8134160 2023-10-03T10:18:39.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.056+0000 7f1da4ff9700 1 -- 172.21.15.146:0/2729054536 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1da0005580 con 0x7f1da8134160 2023-10-03T10:18:39.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.056+0000 7f1da4ff9700 1 -- 172.21.15.146:0/2729054536 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1da003ed40 con 0x7f1da8134160 2023-10-03T10:18:39.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.056+0000 7f1dae9ec700 1 -- 172.21.15.146:0/2729054536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da8071e50 con 0x7f1da8134160 2023-10-03T10:18:39.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.065+0000 7f1da4ff9700 1 -- 172.21.15.146:0/2729054536 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1da0017070 con 0x7f1da8134160 2023-10-03T10:18:39.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.128+0000 7fde8ea01700 1 -- 172.21.15.146:0/1834721572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fde88071690 con 0x7fde88130bc0 2023-10-03T10:18:39.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.128+0000 7fde84ff9700 1 -- 172.21.15.146:0/1834721572 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fde7c017030 con 0x7fde88130bc0 2023-10-03T10:18:39.129 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:39.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.131+0000 7fde8ea01700 1 -- 172.21.15.146:0/1834721572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde88130bc0 msgr2=0x7fde8811df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.131+0000 7fde8ea01700 1 --2- 172.21.15.146:0/1834721572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde88130bc0 0x7fde8811df80 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00c3c0 tx=0x7fde7c00c6d0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.131+0000 7fde8ea01700 1 -- 172.21.15.146:0/1834721572 shutdown_connections 2023-10-03T10:18:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.131+0000 7fde8ea01700 1 --2- 172.21.15.146:0/1834721572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fde88133ad0 0x7fde8811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.131+0000 7fde8ea01700 1 --2- 172.21.15.146:0/1834721572 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fde881300a0 0x7fde8811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.131+0000 7fde8ea01700 1 --2- 172.21.15.146:0/1834721572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde88130bc0 0x7fde8811df80 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.131+0000 7fde8ea01700 1 -- 172.21.15.146:0/1834721572 >> 172.21.15.146:0/1834721572 conn(0x7fde88099c40 msgr2=0x7fde8812e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.131+0000 7fde8ea01700 1 -- 172.21.15.146:0/1834721572 shutdown_connections 2023-10-03T10:18:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.131+0000 7fde8ea01700 1 -- 172.21.15.146:0/1834721572 wait complete. 2023-10-03T10:18:39.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:39.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.257+0000 7ff7b0eb0700 1 -- 172.21.15.146:0/1085124209 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff7ac1202e0 con 0x7ff7ac133f70 2023-10-03T10:18:39.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.257+0000 7ff79affd700 1 -- 172.21.15.146:0/1085124209 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff7a401b400 con 0x7ff7ac133f70 2023-10-03T10:18:39.258 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:39.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.259+0000 7ff7b0eb0700 1 -- 172.21.15.146:0/1085124209 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7ac133f70 msgr2=0x7ff7ac1c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.259+0000 7ff7b0eb0700 1 --2- 172.21.15.146:0/1085124209 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7ac133f70 0x7ff7ac1c8c80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009d90 tx=0x7ff7a4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.259+0000 7ff7b0eb0700 1 -- 172.21.15.146:0/1085124209 shutdown_connections 2023-10-03T10:18:39.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.259+0000 7ff7b0eb0700 1 --2- 172.21.15.146:0/1085124209 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff7ac133f70 0x7ff7ac1c8c80 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.259+0000 7ff7b0eb0700 1 --2- 172.21.15.146:0/1085124209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7ac09ad40 0x7ff7ac1c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.259+0000 7ff7b0eb0700 1 --2- 172.21.15.146:0/1085124209 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7ac0a0a70 0x7ff7ac1c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.259+0000 7ff7b0eb0700 1 -- 172.21.15.146:0/1085124209 >> 172.21.15.146:0/1085124209 conn(0x7ff7ac099c40 msgr2=0x7ff7ac09e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.259+0000 7ff7b0eb0700 1 -- 172.21.15.146:0/1085124209 shutdown_connections 2023-10-03T10:18:39.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.259+0000 7ff7b0eb0700 1 -- 172.21.15.146:0/1085124209 wait complete. 2023-10-03T10:18:39.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.260+0000 7f1dae9ec700 1 -- 172.21.15.146:0/2729054536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1da806c9d0 con 0x7f1da8134160 2023-10-03T10:18:39.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.260+0000 7f1da4ff9700 1 -- 172.21.15.146:0/2729054536 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1da0010770 con 0x7f1da8134160 2023-10-03T10:18:39.262 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:39.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.262+0000 7f1dae9ec700 1 -- 172.21.15.146:0/2729054536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da8134160 msgr2=0x7f1da81c8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.262+0000 7f1dae9ec700 1 --2- 172.21.15.146:0/2729054536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da8134160 0x7f1da81c8eb0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f1da000c7c0 tx=0x7f1da000cad0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.262+0000 7f1dae9ec700 1 -- 172.21.15.146:0/2729054536 shutdown_connections 2023-10-03T10:18:39.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.262+0000 7f1dae9ec700 1 --2- 172.21.15.146:0/2729054536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da8134160 0x7f1da81c8eb0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.262+0000 7f1dae9ec700 1 --2- 172.21.15.146:0/2729054536 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1da809e870 0x7f1da81c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.262+0000 7f1dae9ec700 1 --2- 172.21.15.146:0/2729054536 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1da809f180 0x7f1da81c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.262+0000 7f1dae9ec700 1 -- 172.21.15.146:0/2729054536 >> 172.21.15.146:0/2729054536 conn(0x7f1da80a4430 msgr2=0x7f1da809d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.262+0000 7f1dae9ec700 1 -- 172.21.15.146:0/2729054536 shutdown_connections 2023-10-03T10:18:39.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.262+0000 7f1dae9ec700 1 -- 172.21.15.146:0/2729054536 wait complete. 2023-10-03T10:18:39.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:39.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:39.309 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:39.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.436+0000 7fd995c78700 1 Processor -- start 2023-10-03T10:18:39.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.437+0000 7fd995c78700 1 -- start start 2023-10-03T10:18:39.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.437+0000 7fd995c78700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd990133ad0 0x7fd990133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.437+0000 7fd995c78700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9901300a0 0x7fd9901304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.437+0000 7fd995c78700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd9901309f0 0x7fd99013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.437+0000 7fd995c78700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd99006b2d0 con 0x7fd9901309f0 2023-10-03T10:18:39.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.437+0000 7fd995c78700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd990133610 con 0x7fd9901300a0 2023-10-03T10:18:39.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.437+0000 7fd995c78700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd99009a500 con 0x7fd990133ad0 2023-10-03T10:18:39.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.437+0000 7fd98f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd990133ad0 0x7fd990133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.437+0000 7fd98ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd9901309f0 0x7fd99013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.437+0000 7fd98f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd990133ad0 0x7fd990133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34744/0 (socket says 172.21.15.146:34744) 2023-10-03T10:18:39.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.437+0000 7fd98f7fe700 1 -- 172.21.15.146:0/3236157716 learned_addr learned my addr 172.21.15.146:0/3236157716 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:39.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.437+0000 7fd98effd700 1 --2- 172.21.15.146:0/3236157716 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9901300a0 0x7fd9901304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.437+0000 7fd98ffff700 1 -- 172.21.15.146:0/3236157716 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd990133ad0 msgr2=0x7fd990133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:39.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.437+0000 7fd98ffff700 1 --2- 172.21.15.146:0/3236157716 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd990133ad0 0x7fd990133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.437+0000 7fd98ffff700 1 -- 172.21.15.146:0/3236157716 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9901300a0 msgr2=0x7fd9901304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:39.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.437+0000 7fd98ffff700 1 --2- 172.21.15.146:0/3236157716 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9901300a0 0x7fd9901304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.437+0000 7fd98ffff700 1 -- 172.21.15.146:0/3236157716 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9901338b0 con 0x7fd9901309f0 2023-10-03T10:18:39.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.437+0000 7fd98f7fe700 1 --2- 172.21.15.146:0/3236157716 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd990133ad0 0x7fd990133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.437+0000 7fd98effd700 1 --2- 172.21.15.146:0/3236157716 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9901300a0 0x7fd9901304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.438+0000 7fd98ffff700 1 --2- 172.21.15.146:0/3236157716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9901309f0 0x7fd99013a980 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fd988009d90 tx=0x7fd98800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcffba71be57ae22 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.438+0000 7fd98e7fc700 1 -- 172.21.15.146:0/3236157716 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98800e070 con 0x7fd9901309f0 2023-10-03T10:18:39.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.438+0000 7fd98e7fc700 1 -- 172.21.15.146:0/3236157716 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98800bb20 con 0x7fd9901309f0 2023-10-03T10:18:39.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.438+0000 7fd98e7fc700 1 -- 172.21.15.146:0/3236157716 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd988012430 con 0x7fd9901309f0 2023-10-03T10:18:39.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.438+0000 7fd995c78700 1 -- 172.21.15.146:0/3236157716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9901309f0 msgr2=0x7fd99013a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.438+0000 7fd995c78700 1 --2- 172.21.15.146:0/3236157716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9901309f0 0x7fd99013a980 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fd988009d90 tx=0x7fd98800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:39.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.438+0000 7fd995c78700 1 -- 172.21.15.146:0/3236157716 shutdown_connections 2023-10-03T10:18:39.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.438+0000 7fd995c78700 1 --2- 172.21.15.146:0/3236157716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9901309f0 0x7fd99013a980 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.438+0000 7fd995c78700 1 --2- 172.21.15.146:0/3236157716 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd990133ad0 0x7fd990133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.438+0000 7fd995c78700 1 --2- 172.21.15.146:0/3236157716 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9901300a0 0x7fd9901304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.438+0000 7fd995c78700 1 -- 172.21.15.146:0/3236157716 >> 172.21.15.146:0/3236157716 conn(0x7fd990099c40 msgr2=0x7fd9900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.438+0000 7fd995c78700 1 -- 172.21.15.146:0/3236157716 shutdown_connections 2023-10-03T10:18:39.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.438+0000 7fd995c78700 1 -- 172.21.15.146:0/3236157716 wait complete. 2023-10-03T10:18:39.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.440+0000 7fd995c78700 1 Processor -- start 2023-10-03T10:18:39.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.440+0000 7fd995c78700 1 -- start start 2023-10-03T10:18:39.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.440+0000 7fd995c78700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9901300a0 0x7fd99011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.440+0000 7fd995c78700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9901309f0 0x7fd99011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.440+0000 7fd995c78700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd990133ad0 0x7fd99011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.440+0000 7fd995c78700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd990120a10 con 0x7fd990133ad0 2023-10-03T10:18:39.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.440+0000 7fd995c78700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd990120030 con 0x7fd9901300a0 2023-10-03T10:18:39.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.440+0000 7fd995c78700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd99011f040 con 0x7fd9901309f0 2023-10-03T10:18:39.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.441+0000 7fd98effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9901309f0 0x7fd99011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.441+0000 7fd98effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9901309f0 0x7fd99011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34748/0 (socket says 172.21.15.146:34748) 2023-10-03T10:18:39.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.441+0000 7fd98ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd990133ad0 0x7fd99011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.441+0000 7fd98f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9901300a0 0x7fd99011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.441+0000 7fd98effd700 1 -- 172.21.15.146:0/112369986 learned_addr learned my addr 172.21.15.146:0/112369986 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:39.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.441+0000 7fd98f7fe700 1 -- 172.21.15.146:0/112369986 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9901309f0 msgr2=0x7fd99011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.441+0000 7fd98f7fe700 1 --2- 172.21.15.146:0/112369986 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9901309f0 0x7fd99011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.441+0000 7fd98f7fe700 1 -- 172.21.15.146:0/112369986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd990133ad0 msgr2=0x7fd99011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.441+0000 7fd98f7fe700 1 --2- 172.21.15.146:0/112369986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd990133ad0 0x7fd99011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.441+0000 7fd98f7fe700 1 -- 172.21.15.146:0/112369986 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9840094a0 con 0x7fd9901300a0 2023-10-03T10:18:39.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.441+0000 7fd98ffff700 1 --2- 172.21.15.146:0/112369986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd990133ad0 0x7fd99011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.441+0000 7fd98effd700 1 --2- 172.21.15.146:0/112369986 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9901309f0 0x7fd99011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.441+0000 7fd98f7fe700 1 --2- 172.21.15.146:0/112369986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9901300a0 0x7fd99011da40 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fd98000b420 tx=0x7fd98000b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.441+0000 7fd977fff700 1 -- 172.21.15.146:0/112369986 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd980019070 con 0x7fd9901300a0 2023-10-03T10:18:39.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.441+0000 7fd977fff700 1 -- 172.21.15.146:0/112369986 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd980004030 con 0x7fd9901300a0 2023-10-03T10:18:39.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.441+0000 7fd995c78700 1 -- 172.21.15.146:0/112369986 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd980009550 con 0x7fd9901300a0 2023-10-03T10:18:39.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.441+0000 7fd977fff700 1 -- 172.21.15.146:0/112369986 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98000bea0 con 0x7fd9901300a0 2023-10-03T10:18:39.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.441+0000 7fd995c78700 1 -- 172.21.15.146:0/112369986 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd988009a70 con 0x7fd9901300a0 2023-10-03T10:18:39.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.442+0000 7fd977fff700 1 -- 172.21.15.146:0/112369986 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd9800043a0 con 0x7fd9901300a0 2023-10-03T10:18:39.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.442+0000 7fd977fff700 1 -- 172.21.15.146:0/112369986 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd980047230 con 0x7fd9901300a0 2023-10-03T10:18:39.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.442+0000 7fd995c78700 1 -- 172.21.15.146:0/112369986 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd99011f970 con 0x7fd9901300a0 2023-10-03T10:18:39.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.447+0000 7fd977fff700 1 -- 172.21.15.146:0/112369986 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd98001d400 con 0x7fd9901300a0 2023-10-03T10:18:39.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.629+0000 7fd995c78700 1 -- 172.21.15.146:0/112369986 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd99012f800 con 0x7fd9901300a0 2023-10-03T10:18:39.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.630+0000 7fd977fff700 1 -- 172.21.15.146:0/112369986 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd980025360 con 0x7fd9901300a0 2023-10-03T10:18:39.630 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:39.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.632+0000 7fd995c78700 1 -- 172.21.15.146:0/112369986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9901300a0 msgr2=0x7fd99011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.632+0000 7fd995c78700 1 --2- 172.21.15.146:0/112369986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9901300a0 0x7fd99011da40 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fd98000b420 tx=0x7fd98000b730 comp rx=0 tx=0).stop 2023-10-03T10:18:39.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.632+0000 7fd995c78700 1 -- 172.21.15.146:0/112369986 shutdown_connections 2023-10-03T10:18:39.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.632+0000 7fd995c78700 1 --2- 172.21.15.146:0/112369986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd990133ad0 0x7fd99011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.632+0000 7fd995c78700 1 --2- 172.21.15.146:0/112369986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9901300a0 0x7fd99011da40 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.632+0000 7fd995c78700 1 --2- 172.21.15.146:0/112369986 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd9901309f0 0x7fd99011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.632+0000 7fd995c78700 1 -- 172.21.15.146:0/112369986 >> 172.21.15.146:0/112369986 conn(0x7fd990099c40 msgr2=0x7fd99012e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.632+0000 7fd995c78700 1 -- 172.21.15.146:0/112369986 shutdown_connections 2023-10-03T10:18:39.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:39.632+0000 7fd995c78700 1 -- 172.21.15.146:0/112369986 wait complete. 2023-10-03T10:18:39.644 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:40.148 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:40.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.272+0000 7fa061482700 1 Processor -- start 2023-10-03T10:18:40.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.272+0000 7fa061482700 1 -- start start 2023-10-03T10:18:40.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.272+0000 7fa061482700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa05c09e950 0x7fa05c09ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.272+0000 7fa061482700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa05c09f260 0x7fa05c131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.272+0000 7fa061482700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa05c09afb0 con 0x7fa05c131dd0 2023-10-03T10:18:40.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.272+0000 7fa061482700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c0a0970 con 0x7fa05c09e950 2023-10-03T10:18:40.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.272+0000 7fa061482700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c0a0320 con 0x7fa05c09f260 2023-10-03T10:18:40.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.273+0000 7fa05a7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa05c09f260 0x7fa05c131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.273+0000 7fa05b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa05c131dd0 0x7fa05c138ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44830/0 (socket says 172.21.15.146:44830) 2023-10-03T10:18:40.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.273+0000 7fa05affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa05c09e950 0x7fa05c09ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.273+0000 7fa05b7fe700 1 -- 172.21.15.146:0/3028686513 learned_addr learned my addr 172.21.15.146:0/3028686513 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:40.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.273+0000 7fa059ffb700 1 -- 172.21.15.146:0/3028686513 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 778750306 0 0) 0x7fa05c09afb0 con 0x7fa05c131dd0 2023-10-03T10:18:40.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.273+0000 7fa05a7fc700 1 -- 172.21.15.146:0/3028686513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa05c09e950 msgr2=0x7fa05c09ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:40.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.273+0000 7fa05a7fc700 1 --2- 172.21.15.146:0/3028686513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa05c09e950 0x7fa05c09ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.273+0000 7fa05a7fc700 1 -- 172.21.15.146:0/3028686513 >> v1:172.21.15.146:6789/0 conn(0x7fa05c131dd0 legacy=0x7fa05c138ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.273+0000 7fa05a7fc700 1 -- 172.21.15.146:0/3028686513 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c0a0750 con 0x7fa05c09f260 2023-10-03T10:18:40.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.273+0000 7fa05affd700 1 --2- 172.21.15.146:0/3028686513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa05c09e950 0x7fa05c09ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.273+0000 7fa05a7fc700 1 --2- 172.21.15.146:0/3028686513 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa05c09f260 0x7fa05c131890 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa04c009870 tx=0x7fa04c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7477f0c28ae0df6f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.273+0000 7fa059ffb700 1 -- 172.21.15.146:0/3028686513 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c011830 con 0x7fa05c09f260 2023-10-03T10:18:40.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.273+0000 7fa059ffb700 1 -- 172.21.15.146:0/3028686513 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04c011990 con 0x7fa05c09f260 2023-10-03T10:18:40.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.273+0000 7fa059ffb700 1 -- 172.21.15.146:0/3028686513 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c011d20 con 0x7fa05c09f260 2023-10-03T10:18:40.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.274+0000 7fa061482700 1 -- 172.21.15.146:0/3028686513 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa05c09f260 msgr2=0x7fa05c131890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.274+0000 7fa061482700 1 --2- 172.21.15.146:0/3028686513 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa05c09f260 0x7fa05c131890 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa04c009870 tx=0x7fa04c009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:40.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.274+0000 7fa061482700 1 -- 172.21.15.146:0/3028686513 shutdown_connections 2023-10-03T10:18:40.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.274+0000 7fa061482700 1 --2- 172.21.15.146:0/3028686513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa05c09e950 0x7fa05c09ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.274+0000 7fa061482700 1 --2- 172.21.15.146:0/3028686513 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa05c09f260 0x7fa05c131890 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.274+0000 7fa061482700 1 -- 172.21.15.146:0/3028686513 >> 172.21.15.146:0/3028686513 conn(0x7fa05c0a0f70 msgr2=0x7fa05c0a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.274+0000 7fa061482700 1 -- 172.21.15.146:0/3028686513 shutdown_connections 2023-10-03T10:18:40.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.274+0000 7fa061482700 1 -- 172.21.15.146:0/3028686513 wait complete. 2023-10-03T10:18:40.277 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:40.277 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:40.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.275+0000 7fa061482700 1 Processor -- start 2023-10-03T10:18:40.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.275+0000 7fa061482700 1 -- start start 2023-10-03T10:18:40.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.275+0000 7fa061482700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa05c09e950 0x7fa05c1c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.275+0000 7fa061482700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa05c09f260 0x7fa05c1c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.275+0000 7fa061482700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa05c131dd0 0x7fa05c1c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.275+0000 7fa061482700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c09dab0 con 0x7fa05c09f260 2023-10-03T10:18:40.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.275+0000 7fa061482700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c06d640 con 0x7fa05c09e950 2023-10-03T10:18:40.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.275+0000 7fa061482700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c122370 con 0x7fa05c131dd0 2023-10-03T10:18:40.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.275+0000 7fa05affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa05c09e950 0x7fa05c1c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.275+0000 7fa05affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa05c09e950 0x7fa05c1c82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35432/0 (socket says 172.21.15.146:35432) 2023-10-03T10:18:40.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.275+0000 7fa05affd700 1 -- 172.21.15.146:0/2611985930 learned_addr learned my addr 172.21.15.146:0/2611985930 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:40.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.275+0000 7fa05a7fc700 1 --2- 172.21.15.146:0/2611985930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa05c09f260 0x7fa05c1c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.275+0000 7fa05b7fe700 1 --2- 172.21.15.146:0/2611985930 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa05c131dd0 0x7fa05c1c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.276+0000 7fa05affd700 1 -- 172.21.15.146:0/2611985930 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa05c131dd0 msgr2=0x7fa05c1c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.276+0000 7fa05affd700 1 --2- 172.21.15.146:0/2611985930 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa05c131dd0 0x7fa05c1c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.276+0000 7fa05affd700 1 -- 172.21.15.146:0/2611985930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa05c09f260 msgr2=0x7fa05c1c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.276+0000 7fa05affd700 1 --2- 172.21.15.146:0/2611985930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa05c09f260 0x7fa05c1c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.276+0000 7fa05affd700 1 -- 172.21.15.146:0/2611985930 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa050009430 con 0x7fa05c09e950 2023-10-03T10:18:40.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.276+0000 7fa05b7fe700 1 --2- 172.21.15.146:0/2611985930 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa05c131dd0 0x7fa05c1c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.276+0000 7fa05affd700 1 --2- 172.21.15.146:0/2611985930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa05c09e950 0x7fa05c1c82f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fa05000ebe0 tx=0x7fa05000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.276+0000 7fa0437fe700 1 -- 172.21.15.146:0/2611985930 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa050005a20 con 0x7fa05c09e950 2023-10-03T10:18:40.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.276+0000 7fa0437fe700 1 -- 172.21.15.146:0/2611985930 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa050005b80 con 0x7fa05c09e950 2023-10-03T10:18:40.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.276+0000 7fa0437fe700 1 -- 172.21.15.146:0/2611985930 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05000c850 con 0x7fa05c09e950 2023-10-03T10:18:40.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.276+0000 7fa061482700 1 -- 172.21.15.146:0/2611985930 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa04c0094a0 con 0x7fa05c09e950 2023-10-03T10:18:40.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.276+0000 7fa061482700 1 -- 172.21.15.146:0/2611985930 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05c120c70 con 0x7fa05c09e950 2023-10-03T10:18:40.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.277+0000 7fa0437fe700 1 -- 172.21.15.146:0/2611985930 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa05000c9b0 con 0x7fa05c09e950 2023-10-03T10:18:40.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.277+0000 7fa0437fe700 1 -- 172.21.15.146:0/2611985930 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa05003f9b0 con 0x7fa05c09e950 2023-10-03T10:18:40.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.277+0000 7fa061482700 1 -- 172.21.15.146:0/2611985930 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa05c04f2a0 con 0x7fa05c09e950 2023-10-03T10:18:40.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.281+0000 7fa0437fe700 1 -- 172.21.15.146:0/2611985930 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa050022300 con 0x7fa05c09e950 2023-10-03T10:18:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.405+0000 7f9f6583b700 1 Processor -- start 2023-10-03T10:18:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.406+0000 7f9f6583b700 1 -- start start 2023-10-03T10:18:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.406+0000 7f9f6583b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f60133ad0 0x7f9f60133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.406+0000 7f9f6583b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f60130bc0 0x7f9f6013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.406+0000 7f9f6583b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f6006b2d0 con 0x7f9f601300a0 2023-10-03T10:18:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.406+0000 7f9f6583b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f60133610 con 0x7f9f60133ad0 2023-10-03T10:18:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.406+0000 7f9f6583b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6009a500 con 0x7f9f60130bc0 2023-10-03T10:18:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.406+0000 7f9f5effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f60133ad0 0x7f9f60133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.406+0000 7f9f5effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f60133ad0 0x7f9f60133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35438/0 (socket says 172.21.15.146:35438) 2023-10-03T10:18:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.406+0000 7f9f5effd700 1 -- 172.21.15.146:0/568711648 learned_addr learned my addr 172.21.15.146:0/568711648 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.406+0000 7f9f5f7fe700 1 --2- 172.21.15.146:0/568711648 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f60130bc0 0x7f9f6013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.407+0000 7f9f5effd700 1 -- 172.21.15.146:0/568711648 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f60130bc0 msgr2=0x7f9f6013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.407+0000 7f9f5effd700 1 --2- 172.21.15.146:0/568711648 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f60130bc0 0x7f9f6013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.407+0000 7f9f5effd700 1 -- 172.21.15.146:0/568711648 >> v1:172.21.15.146:6789/0 conn(0x7f9f601300a0 legacy=0x7f9f601304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.407+0000 7f9f5dffb700 1 -- 172.21.15.146:0/568711648 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3152169176 0 0) 0x7f9f6006b2d0 con 0x7f9f601300a0 2023-10-03T10:18:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.407+0000 7f9f5effd700 1 -- 172.21.15.146:0/568711648 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f601338b0 con 0x7f9f60133ad0 2023-10-03T10:18:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.407+0000 7f9f5effd700 1 --2- 172.21.15.146:0/568711648 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f60133ad0 0x7f9f60133ea0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f9f50009920 tx=0x7f9f50009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e89191cbb7d252 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.407+0000 7f9f5dffb700 1 -- 172.21.15.146:0/568711648 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f50011830 con 0x7f9f60133ad0 2023-10-03T10:18:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.407+0000 7f9f5dffb700 1 -- 172.21.15.146:0/568711648 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f50011990 con 0x7f9f60133ad0 2023-10-03T10:18:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.407+0000 7f9f5dffb700 1 -- 172.21.15.146:0/568711648 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f50011d20 con 0x7f9f60133ad0 2023-10-03T10:18:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.408+0000 7f9f6583b700 1 -- 172.21.15.146:0/568711648 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f60133ad0 msgr2=0x7f9f60133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.408+0000 7f9f6583b700 1 --2- 172.21.15.146:0/568711648 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f60133ad0 0x7f9f60133ea0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f9f50009920 tx=0x7f9f50009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.408+0000 7f9f6583b700 1 -- 172.21.15.146:0/568711648 shutdown_connections 2023-10-03T10:18:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.408+0000 7f9f6583b700 1 --2- 172.21.15.146:0/568711648 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f60130bc0 0x7f9f6013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.408+0000 7f9f6583b700 1 --2- 172.21.15.146:0/568711648 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f60133ad0 0x7f9f60133ea0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.408+0000 7f9f6583b700 1 -- 172.21.15.146:0/568711648 >> 172.21.15.146:0/568711648 conn(0x7f9f60099c40 msgr2=0x7f9f600a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.408+0000 7f9f6583b700 1 -- 172.21.15.146:0/568711648 shutdown_connections 2023-10-03T10:18:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.408+0000 7f9f6583b700 1 -- 172.21.15.146:0/568711648 wait complete. 2023-10-03T10:18:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.409+0000 7f9f6583b700 1 Processor -- start 2023-10-03T10:18:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.409+0000 7f9f6583b700 1 -- start start 2023-10-03T10:18:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.410+0000 7f9f6583b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f601300a0 0x7f9f6011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.410+0000 7f9f6583b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f60130bc0 0x7f9f6011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.410+0000 7f9f6583b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f60133ad0 0x7f9f6011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.410+0000 7f9f6583b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6012dd00 con 0x7f9f601300a0 2023-10-03T10:18:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.410+0000 7f9f6583b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f60120a30 con 0x7f9f60133ad0 2023-10-03T10:18:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.410+0000 7f9f6583b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f600720e0 con 0x7f9f60130bc0 2023-10-03T10:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.410+0000 7f9f5effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f601300a0 0x7f9f6011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.410+0000 7f9f5effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f601300a0 0x7f9f6011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39180/0 (socket says 172.21.15.146:39180) 2023-10-03T10:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.410+0000 7f9f5e7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f60130bc0 0x7f9f6011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.410+0000 7f9f5effd700 1 -- 172.21.15.146:0/2990325003 learned_addr learned my addr 172.21.15.146:0/2990325003 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.410+0000 7f9f5f7fe700 1 --2- 172.21.15.146:0/2990325003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f60133ad0 0x7f9f6011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.411+0000 7f9f5e7fc700 1 -- 172.21.15.146:0/2990325003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f60133ad0 msgr2=0x7f9f6011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.411+0000 7f9f5e7fc700 1 --2- 172.21.15.146:0/2990325003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f60133ad0 0x7f9f6011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.411+0000 7f9f5e7fc700 1 -- 172.21.15.146:0/2990325003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f601300a0 msgr2=0x7f9f6011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.411+0000 7f9f5e7fc700 1 --2- 172.21.15.146:0/2990325003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f601300a0 0x7f9f6011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.411+0000 7f9f5e7fc700 1 -- 172.21.15.146:0/2990325003 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f50009550 con 0x7f9f60130bc0 2023-10-03T10:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.411+0000 7f9f5effd700 1 --2- 172.21.15.146:0/2990325003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f601300a0 0x7f9f6011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.411+0000 7f9f5e7fc700 1 --2- 172.21.15.146:0/2990325003 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f60130bc0 0x7f9f6011df80 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f9f54000f60 tx=0x7f9f5400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.411+0000 7f9f47fff700 1 -- 172.21.15.146:0/2990325003 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f540052d0 con 0x7f9f60130bc0 2023-10-03T10:18:40.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.411+0000 7f9f47fff700 1 -- 172.21.15.146:0/2990325003 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f54005450 con 0x7f9f60130bc0 2023-10-03T10:18:40.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.411+0000 7f9f6583b700 1 -- 172.21.15.146:0/2990325003 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f6011fd70 con 0x7f9f60130bc0 2023-10-03T10:18:40.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.411+0000 7f9f47fff700 1 -- 172.21.15.146:0/2990325003 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f540038c0 con 0x7f9f60130bc0 2023-10-03T10:18:40.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.411+0000 7f9f6583b700 1 -- 172.21.15.146:0/2990325003 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f60071640 con 0x7f9f60130bc0 2023-10-03T10:18:40.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.412+0000 7f9f47fff700 1 -- 172.21.15.146:0/2990325003 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f54003a20 con 0x7f9f60130bc0 2023-10-03T10:18:40.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.412+0000 7f9f6583b700 1 -- 172.21.15.146:0/2990325003 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f6004f2a0 con 0x7f9f60130bc0 2023-10-03T10:18:40.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.412+0000 7f9f47fff700 1 -- 172.21.15.146:0/2990325003 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9f5403e970 con 0x7f9f60130bc0 2023-10-03T10:18:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.414+0000 7f2b5319f700 1 Processor -- start 2023-10-03T10:18:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.414+0000 7f2b5319f700 1 -- start start 2023-10-03T10:18:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.414+0000 7f2b5319f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b4c131980 0x7f2b4c131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.414+0000 7f2b5319f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b4c09c790 0x7f2b4c139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.414+0000 7f2b5319f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b4c0a1640 con 0x7f2b4c09bc70 2023-10-03T10:18:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.414+0000 7f2b5319f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c06eb30 con 0x7f2b4c131980 2023-10-03T10:18:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.414+0000 7f2b5319f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c0a22d0 con 0x7f2b4c09c790 2023-10-03T10:18:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.414+0000 7f2b4bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2b4c09bc70 0x7f2b4c09c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44844/0 (socket says 172.21.15.146:44844) 2023-10-03T10:18:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.414+0000 7f2b5173c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b4c09c790 0x7f2b4c139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.414+0000 7f2b4bfff700 1 -- 172.21.15.146:0/3000252849 learned_addr learned my addr 172.21.15.146:0/3000252849 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:40.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.414+0000 7f2b50f3b700 1 --2- 172.21.15.146:0/3000252849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b4c131980 0x7f2b4c131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.415+0000 7f2b4b7fe700 1 -- 172.21.15.146:0/3000252849 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076131050 0 0) 0x7f2b4c0a1640 con 0x7f2b4c09bc70 2023-10-03T10:18:40.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.415+0000 7f2b50f3b700 1 -- 172.21.15.146:0/3000252849 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b4c09c790 msgr2=0x7f2b4c139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:40.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.415+0000 7f2b50f3b700 1 --2- 172.21.15.146:0/3000252849 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b4c09c790 0x7f2b4c139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.415+0000 7f2b50f3b700 1 -- 172.21.15.146:0/3000252849 >> v1:172.21.15.146:6789/0 conn(0x7f2b4c09bc70 legacy=0x7f2b4c09c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.415+0000 7f2b50f3b700 1 -- 172.21.15.146:0/3000252849 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c131550 con 0x7f2b4c131980 2023-10-03T10:18:40.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.415+0000 7f2b50f3b700 1 --2- 172.21.15.146:0/3000252849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b4c131980 0x7f2b4c131d50 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009850 tx=0x7f2b40009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a7324d911261bb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.415+0000 7f2b4b7fe700 1 -- 172.21.15.146:0/3000252849 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40005e30 con 0x7f2b4c131980 2023-10-03T10:18:40.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.415+0000 7f2b4b7fe700 1 -- 172.21.15.146:0/3000252849 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b40006030 con 0x7f2b4c131980 2023-10-03T10:18:40.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.415+0000 7f2b4b7fe700 1 -- 172.21.15.146:0/3000252849 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b400063e0 con 0x7f2b4c131980 2023-10-03T10:18:40.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.416+0000 7f2b5319f700 1 -- 172.21.15.146:0/3000252849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b4c131980 msgr2=0x7f2b4c131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.416+0000 7f2b5319f700 1 --2- 172.21.15.146:0/3000252849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b4c131980 0x7f2b4c131d50 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009850 tx=0x7f2b40009b60 comp rx=0 tx=0).stop 2023-10-03T10:18:40.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.416+0000 7f2b5319f700 1 -- 172.21.15.146:0/3000252849 shutdown_connections 2023-10-03T10:18:40.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.416+0000 7f2b5319f700 1 --2- 172.21.15.146:0/3000252849 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b4c09c790 0x7f2b4c139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.416+0000 7f2b5319f700 1 --2- 172.21.15.146:0/3000252849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b4c131980 0x7f2b4c131d50 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.416+0000 7f2b5319f700 1 -- 172.21.15.146:0/3000252849 >> 172.21.15.146:0/3000252849 conn(0x7f2b4c0a2980 msgr2=0x7f2b4c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.416+0000 7f2b5319f700 1 -- 172.21.15.146:0/3000252849 shutdown_connections 2023-10-03T10:18:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.416+0000 7f2b5319f700 1 -- 172.21.15.146:0/3000252849 wait complete. 2023-10-03T10:18:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.417+0000 7f2b5319f700 1 Processor -- start 2023-10-03T10:18:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.417+0000 7f2b5319f700 1 -- start start 2023-10-03T10:18:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.417+0000 7f2b5319f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b4c09bc70 0x7f2b4c099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.417+0000 7f2b5319f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b4c09c790 0x7f2b4c099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.417+0000 7f2b5319f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b4c131980 0x7f2b4c09a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.417+0000 7f2b5319f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c09b6a0 con 0x7f2b4c09c790 2023-10-03T10:18:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.417+0000 7f2b5319f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c1210d0 con 0x7f2b4c131980 2023-10-03T10:18:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.417+0000 7f2b5319f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c0a1c40 con 0x7f2b4c09bc70 2023-10-03T10:18:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.417+0000 7f2b5173c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b4c131980 0x7f2b4c09a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.417+0000 7f2b5173c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b4c131980 0x7f2b4c09a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35468/0 (socket says 172.21.15.146:35468) 2023-10-03T10:18:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.417+0000 7f2b5173c700 1 -- 172.21.15.146:0/3657415199 learned_addr learned my addr 172.21.15.146:0/3657415199 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.417+0000 7f2b4bfff700 1 --2- 172.21.15.146:0/3657415199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b4c09c790 0x7f2b4c099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.418+0000 7f2b50f3b700 1 --2- 172.21.15.146:0/3657415199 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b4c09bc70 0x7f2b4c099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.418+0000 7f2b5173c700 1 -- 172.21.15.146:0/3657415199 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b4c09bc70 msgr2=0x7f2b4c099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.418+0000 7f2b5173c700 1 --2- 172.21.15.146:0/3657415199 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b4c09bc70 0x7f2b4c099a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.418+0000 7f2b5173c700 1 -- 172.21.15.146:0/3657415199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b4c09c790 msgr2=0x7f2b4c099fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.418+0000 7f2b5173c700 1 --2- 172.21.15.146:0/3657415199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b4c09c790 0x7f2b4c099fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.418+0000 7f2b5173c700 1 -- 172.21.15.146:0/3657415199 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b40009430 con 0x7f2b4c131980 2023-10-03T10:18:40.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.418+0000 7f2b50f3b700 1 --2- 172.21.15.146:0/3657415199 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b4c09bc70 0x7f2b4c099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:40.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.418+0000 7f2b4bfff700 1 --2- 172.21.15.146:0/3657415199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b4c09c790 0x7f2b4c099fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.418+0000 7f9f47fff700 1 -- 172.21.15.146:0/2990325003 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f54019b40 con 0x7f9f60130bc0 2023-10-03T10:18:40.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.418+0000 7f2b5173c700 1 --2- 172.21.15.146:0/3657415199 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b4c131980 0x7f2b4c09a510 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f2b4400efc0 tx=0x7f2b4400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.418+0000 7f2b497fa700 1 -- 172.21.15.146:0/3657415199 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b44009ea0 con 0x7f2b4c131980 2023-10-03T10:18:40.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.418+0000 7f2b497fa700 1 -- 172.21.15.146:0/3657415199 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4400f040 con 0x7f2b4c131980 2023-10-03T10:18:40.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.418+0000 7f2b5319f700 1 -- 172.21.15.146:0/3657415199 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b4c120e10 con 0x7f2b4c131980 2023-10-03T10:18:40.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.418+0000 7f2b497fa700 1 -- 172.21.15.146:0/3657415199 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b44014480 con 0x7f2b4c131980 2023-10-03T10:18:40.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.418+0000 7f2b5319f700 1 -- 172.21.15.146:0/3657415199 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4c121b40 con 0x7f2b4c131980 2023-10-03T10:18:40.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.419+0000 7f2b497fa700 1 -- 172.21.15.146:0/3657415199 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b440145e0 con 0x7f2b4c131980 2023-10-03T10:18:40.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.419+0000 7f2b497fa700 1 -- 172.21.15.146:0/3657415199 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2b4403ff50 con 0x7f2b4c131980 2023-10-03T10:18:40.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.419+0000 7f2b5319f700 1 -- 172.21.15.146:0/3657415199 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4c04f2a0 con 0x7f2b4c131980 2023-10-03T10:18:40.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.428+0000 7f2b497fa700 1 -- 172.21.15.146:0/3657415199 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b44018070 con 0x7f2b4c131980 2023-10-03T10:18:40.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.490+0000 7fa061482700 1 -- 172.21.15.146:0/2611985930 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa05c131bb0 con 0x7fa05c09e950 2023-10-03T10:18:40.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.491+0000 7fa0437fe700 1 -- 172.21.15.146:0/2611985930 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa05002a090 con 0x7fa05c09e950 2023-10-03T10:18:40.491 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:40.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.493+0000 7fa061482700 1 -- 172.21.15.146:0/2611985930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa05c09e950 msgr2=0x7fa05c1c82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.493+0000 7fa061482700 1 --2- 172.21.15.146:0/2611985930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa05c09e950 0x7fa05c1c82f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fa05000ebe0 tx=0x7fa05000eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.493+0000 7fa061482700 1 -- 172.21.15.146:0/2611985930 shutdown_connections 2023-10-03T10:18:40.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.493+0000 7fa061482700 1 --2- 172.21.15.146:0/2611985930 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa05c131dd0 0x7fa05c1c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.493+0000 7fa061482700 1 --2- 172.21.15.146:0/2611985930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa05c09e950 0x7fa05c1c82f0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.493+0000 7fa061482700 1 --2- 172.21.15.146:0/2611985930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa05c09f260 0x7fa05c1c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.493+0000 7fa061482700 1 -- 172.21.15.146:0/2611985930 >> 172.21.15.146:0/2611985930 conn(0x7fa05c0a0f70 msgr2=0x7fa05c0a2400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.493+0000 7fa061482700 1 -- 172.21.15.146:0/2611985930 shutdown_connections 2023-10-03T10:18:40.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.493+0000 7fa061482700 1 -- 172.21.15.146:0/2611985930 wait complete. 2023-10-03T10:18:40.506 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:40.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.616+0000 7f9f6583b700 1 -- 172.21.15.146:0/2990325003 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9f6006c3b0 con 0x7f9f60130bc0 2023-10-03T10:18:40.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.617+0000 7f9f47fff700 1 -- 172.21.15.146:0/2990325003 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9f54017030 con 0x7f9f60130bc0 2023-10-03T10:18:40.617 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:40.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.619+0000 7f9f6583b700 1 -- 172.21.15.146:0/2990325003 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f60130bc0 msgr2=0x7f9f6011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.619+0000 7f9f6583b700 1 --2- 172.21.15.146:0/2990325003 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f60130bc0 0x7f9f6011df80 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f9f54000f60 tx=0x7f9f5400c6a0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.619+0000 7f9f6583b700 1 -- 172.21.15.146:0/2990325003 shutdown_connections 2023-10-03T10:18:40.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.619+0000 7f9f6583b700 1 --2- 172.21.15.146:0/2990325003 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f60133ad0 0x7f9f6011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.619+0000 7f9f6583b700 1 --2- 172.21.15.146:0/2990325003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f601300a0 0x7f9f6011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.619+0000 7f9f6583b700 1 --2- 172.21.15.146:0/2990325003 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9f60130bc0 0x7f9f6011df80 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.619+0000 7f9f6583b700 1 -- 172.21.15.146:0/2990325003 >> 172.21.15.146:0/2990325003 conn(0x7f9f60099c40 msgr2=0x7f9f60132040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.619+0000 7f9f6583b700 1 -- 172.21.15.146:0/2990325003 shutdown_connections 2023-10-03T10:18:40.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.619+0000 7f9f6583b700 1 -- 172.21.15.146:0/2990325003 wait complete. 2023-10-03T10:18:40.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.622+0000 7f2b5319f700 1 -- 172.21.15.146:0/3657415199 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2b4c06bce0 con 0x7f2b4c131980 2023-10-03T10:18:40.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.623+0000 7f2b497fa700 1 -- 172.21.15.146:0/3657415199 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b4402b090 con 0x7f2b4c131980 2023-10-03T10:18:40.623 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:40.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.625+0000 7f2b5319f700 1 -- 172.21.15.146:0/3657415199 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b4c131980 msgr2=0x7f2b4c09a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.625+0000 7f2b5319f700 1 --2- 172.21.15.146:0/3657415199 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b4c131980 0x7f2b4c09a510 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f2b4400efc0 tx=0x7f2b4400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.625+0000 7f2b5319f700 1 -- 172.21.15.146:0/3657415199 shutdown_connections 2023-10-03T10:18:40.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.625+0000 7f2b5319f700 1 --2- 172.21.15.146:0/3657415199 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b4c131980 0x7f2b4c09a510 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.625+0000 7f2b5319f700 1 --2- 172.21.15.146:0/3657415199 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2b4c09bc70 0x7f2b4c099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.625+0000 7f2b5319f700 1 --2- 172.21.15.146:0/3657415199 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b4c09c790 0x7f2b4c099fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.625+0000 7f2b5319f700 1 -- 172.21.15.146:0/3657415199 >> 172.21.15.146:0/3657415199 conn(0x7f2b4c0a2980 msgr2=0x7f2b4c1b8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.625+0000 7f2b5319f700 1 -- 172.21.15.146:0/3657415199 shutdown_connections 2023-10-03T10:18:40.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.625+0000 7f2b5319f700 1 -- 172.21.15.146:0/3657415199 wait complete. 2023-10-03T10:18:40.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:40.638 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:40.646 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:40.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.801+0000 7fd792777700 1 Processor -- start 2023-10-03T10:18:40.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.801+0000 7fd792777700 1 -- start start 2023-10-03T10:18:40.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.801+0000 7fd792777700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd78c136960 0x7fd78c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.801+0000 7fd792777700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd78c139280 0x7fd78c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.801+0000 7fd792777700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd78c06b2d0 con 0x7fd78c133ad0 2023-10-03T10:18:40.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.801+0000 7fd792777700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd78c1345b0 con 0x7fd78c139280 2023-10-03T10:18:40.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.801+0000 7fd792777700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c133610 con 0x7fd78c136960 2023-10-03T10:18:40.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.801+0000 7fd78b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd78c136960 0x7fd78c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.801+0000 7fd78bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd78c133ad0 0x7fd78c133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44854/0 (socket says 172.21.15.146:44854) 2023-10-03T10:18:40.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.801+0000 7fd790d14700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd78c139280 0x7fd78c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.801+0000 7fd78bfff700 1 -- 172.21.15.146:0/976137693 learned_addr learned my addr 172.21.15.146:0/976137693 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:40.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.802+0000 7fd790d14700 1 -- 172.21.15.146:0/976137693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd78c136960 msgr2=0x7fd78c138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:40.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.802+0000 7fd790d14700 1 --2- 172.21.15.146:0/976137693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd78c136960 0x7fd78c138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.802+0000 7fd790d14700 1 -- 172.21.15.146:0/976137693 >> v1:172.21.15.146:6789/0 conn(0x7fd78c133ad0 legacy=0x7fd78c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.802+0000 7fd790d14700 1 -- 172.21.15.146:0/976137693 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c09a500 con 0x7fd78c139280 2023-10-03T10:18:40.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.802+0000 7fd78affd700 1 -- 172.21.15.146:0/976137693 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223482664 0 0) 0x7fd78c06b2d0 con 0x7fd78c133ad0 2023-10-03T10:18:40.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.802+0000 7fd78b7fe700 1 --2- 172.21.15.146:0/976137693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd78c136960 0x7fd78c138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.802+0000 7fd790d14700 1 --2- 172.21.15.146:0/976137693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd78c139280 0x7fd78c13b660 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fd784009dc0 tx=0x7fd78400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a9a082122e43be server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.802+0000 7fd78affd700 1 -- 172.21.15.146:0/976137693 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78400e070 con 0x7fd78c139280 2023-10-03T10:18:40.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.802+0000 7fd78affd700 1 -- 172.21.15.146:0/976137693 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78400bae0 con 0x7fd78c139280 2023-10-03T10:18:40.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.802+0000 7fd78affd700 1 -- 172.21.15.146:0/976137693 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78400be90 con 0x7fd78c139280 2023-10-03T10:18:40.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.802+0000 7fd792777700 1 -- 172.21.15.146:0/976137693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd78c139280 msgr2=0x7fd78c13b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.802+0000 7fd792777700 1 --2- 172.21.15.146:0/976137693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd78c139280 0x7fd78c13b660 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fd784009dc0 tx=0x7fd78400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:40.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.802+0000 7fd792777700 1 -- 172.21.15.146:0/976137693 shutdown_connections 2023-10-03T10:18:40.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.802+0000 7fd792777700 1 --2- 172.21.15.146:0/976137693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd78c139280 0x7fd78c13b660 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.802+0000 7fd792777700 1 --2- 172.21.15.146:0/976137693 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd78c136960 0x7fd78c138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.802+0000 7fd792777700 1 -- 172.21.15.146:0/976137693 >> 172.21.15.146:0/976137693 conn(0x7fd78c099c40 msgr2=0x7fd78c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.803+0000 7fd792777700 1 -- 172.21.15.146:0/976137693 shutdown_connections 2023-10-03T10:18:40.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.803+0000 7fd792777700 1 -- 172.21.15.146:0/976137693 wait complete. 2023-10-03T10:18:40.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.803+0000 7fd792777700 1 Processor -- start 2023-10-03T10:18:40.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.804+0000 7fd792777700 1 -- start start 2023-10-03T10:18:40.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.804+0000 7fd792777700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd78c133ad0 0x7fd78c12cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.804+0000 7fd792777700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd78c136960 0x7fd78c12d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.804+0000 7fd792777700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd78c139280 0x7fd78c12d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.804+0000 7fd792777700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c131830 con 0x7fd78c139280 2023-10-03T10:18:40.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.804+0000 7fd792777700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c09f390 con 0x7fd78c136960 2023-10-03T10:18:40.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.804+0000 7fd792777700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c072270 con 0x7fd78c133ad0 2023-10-03T10:18:40.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.804+0000 7fd78bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd78c133ad0 0x7fd78c12cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.804+0000 7fd78b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd78c136960 0x7fd78c12d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.804+0000 7fd78bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd78c133ad0 0x7fd78c12cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34828/0 (socket says 172.21.15.146:34828) 2023-10-03T10:18:40.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.804+0000 7fd78bfff700 1 -- 172.21.15.146:0/3777779077 learned_addr learned my addr 172.21.15.146:0/3777779077 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:40.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.804+0000 7fd78b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd78c136960 0x7fd78c12d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35478/0 (socket says 172.21.15.146:35478) 2023-10-03T10:18:40.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.804+0000 7fd790d14700 1 --2- 172.21.15.146:0/3777779077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd78c139280 0x7fd78c12d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.804+0000 7fd78bfff700 1 -- 172.21.15.146:0/3777779077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd78c136960 msgr2=0x7fd78c12d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.804+0000 7fd78bfff700 1 --2- 172.21.15.146:0/3777779077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd78c136960 0x7fd78c12d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.804+0000 7fd78bfff700 1 -- 172.21.15.146:0/3777779077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd78c139280 msgr2=0x7fd78c12d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.804+0000 7fd78bfff700 1 --2- 172.21.15.146:0/3777779077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd78c139280 0x7fd78c12d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.804+0000 7fd78bfff700 1 -- 172.21.15.146:0/3777779077 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7800094a0 con 0x7fd78c133ad0 2023-10-03T10:18:40.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.804+0000 7fd78b7fe700 1 --2- 172.21.15.146:0/3777779077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd78c136960 0x7fd78c12d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.805+0000 7fd78bfff700 1 --2- 172.21.15.146:0/3777779077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd78c133ad0 0x7fd78c12cb30 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd77c00c520 tx=0x7fd77c00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.805+0000 7fd788ff9700 1 -- 172.21.15.146:0/3777779077 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c004c80 con 0x7fd78c133ad0 2023-10-03T10:18:40.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.805+0000 7fd788ff9700 1 -- 172.21.15.146:0/3777779077 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77c004de0 con 0x7fd78c133ad0 2023-10-03T10:18:40.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.805+0000 7fd788ff9700 1 -- 172.21.15.146:0/3777779077 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c007310 con 0x7fd78c133ad0 2023-10-03T10:18:40.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.805+0000 7fd792777700 1 -- 172.21.15.146:0/3777779077 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd784009a70 con 0x7fd78c133ad0 2023-10-03T10:18:40.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.805+0000 7fd792777700 1 -- 172.21.15.146:0/3777779077 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd78c070c90 con 0x7fd78c133ad0 2023-10-03T10:18:40.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.805+0000 7fd788ff9700 1 -- 172.21.15.146:0/3777779077 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd77c007470 con 0x7fd78c133ad0 2023-10-03T10:18:40.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.806+0000 7fd792777700 1 -- 172.21.15.146:0/3777779077 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd78c04f2a0 con 0x7fd78c133ad0 2023-10-03T10:18:40.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.806+0000 7fd788ff9700 1 -- 172.21.15.146:0/3777779077 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd77c03f210 con 0x7fd78c133ad0 2023-10-03T10:18:40.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.810+0000 7fd788ff9700 1 -- 172.21.15.146:0/3777779077 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd77c0123b0 con 0x7fd78c133ad0 2023-10-03T10:18:40.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.994+0000 7fd792777700 1 -- 172.21.15.146:0/3777779077 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd78c09f0f0 con 0x7fd78c133ad0 2023-10-03T10:18:40.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.994+0000 7fd788ff9700 1 -- 172.21.15.146:0/3777779077 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd77c011360 con 0x7fd78c133ad0 2023-10-03T10:18:40.995 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:40.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.996+0000 7fd792777700 1 -- 172.21.15.146:0/3777779077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd78c133ad0 msgr2=0x7fd78c12cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.996+0000 7fd792777700 1 --2- 172.21.15.146:0/3777779077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd78c133ad0 0x7fd78c12cb30 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd77c00c520 tx=0x7fd77c00c830 comp rx=0 tx=0).stop 2023-10-03T10:18:40.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.996+0000 7fd792777700 1 -- 172.21.15.146:0/3777779077 shutdown_connections 2023-10-03T10:18:40.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.996+0000 7fd792777700 1 --2- 172.21.15.146:0/3777779077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd78c139280 0x7fd78c12d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.996+0000 7fd792777700 1 --2- 172.21.15.146:0/3777779077 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd78c133ad0 0x7fd78c12cb30 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.996+0000 7fd792777700 1 --2- 172.21.15.146:0/3777779077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd78c136960 0x7fd78c12d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.996+0000 7fd792777700 1 -- 172.21.15.146:0/3777779077 >> 172.21.15.146:0/3777779077 conn(0x7fd78c099c40 msgr2=0x7fd78c1385e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.997+0000 7fd792777700 1 -- 172.21.15.146:0/3777779077 shutdown_connections 2023-10-03T10:18:40.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:40.997+0000 7fd792777700 1 -- 172.21.15.146:0/3777779077 wait complete. 2023-10-03T10:18:41.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:41.509 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:41.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.633+0000 7fb477618700 1 Processor -- start 2023-10-03T10:18:41.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.633+0000 7fb477618700 1 -- start start 2023-10-03T10:18:41.634 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:41.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.633+0000 7fb477618700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb470136960 0x7fb470138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.633+0000 7fb477618700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb470139280 0x7fb47013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.633+0000 7fb477618700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb47006b2d0 con 0x7fb470133ad0 2023-10-03T10:18:41.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.633+0000 7fb477618700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4701345b0 con 0x7fb470139280 2023-10-03T10:18:41.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.633+0000 7fb477618700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb470133610 con 0x7fb470136960 2023-10-03T10:18:41.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.633+0000 7fb474bb3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb470136960 0x7fb470138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.633+0000 7fb4753b4700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb470133ad0 0x7fb470133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44864/0 (socket says 172.21.15.146:44864) 2023-10-03T10:18:41.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.633+0000 7fb4753b4700 1 -- 172.21.15.146:0/3675472719 learned_addr learned my addr 172.21.15.146:0/3675472719 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:41.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.633+0000 7fb475bb5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb470139280 0x7fb47013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.634+0000 7fb467fff700 1 -- 172.21.15.146:0/3675472719 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 180726596 0 0) 0x7fb47006b2d0 con 0x7fb470133ad0 2023-10-03T10:18:41.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.634+0000 7fb467fff700 1 -- 172.21.15.146:0/3675472719 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb45c0035b0 con 0x7fb470133ad0 2023-10-03T10:18:41.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.634+0000 7fb474bb3700 1 -- 172.21.15.146:0/3675472719 >> v2:172.21.15.146:3300/0 conn(0x7fb470139280 msgr2=0x7fb47013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:41.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.634+0000 7fb474bb3700 1 --2- 172.21.15.146:0/3675472719 >> v2:172.21.15.146:3300/0 conn(0x7fb470139280 0x7fb47013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.634+0000 7fb474bb3700 1 -- 172.21.15.146:0/3675472719 >> v1:172.21.15.146:6789/0 conn(0x7fb470133ad0 legacy=0x7fb470133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.634+0000 7fb474bb3700 1 -- 172.21.15.146:0/3675472719 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47009a500 con 0x7fb470136960 2023-10-03T10:18:41.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.634+0000 7fb475bb5700 1 --2- 172.21.15.146:0/3675472719 >> v2:172.21.15.146:3300/0 conn(0x7fb470139280 0x7fb47013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:41.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.634+0000 7fb474bb3700 1 --2- 172.21.15.146:0/3675472719 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb470136960 0x7fb470138d40 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fb460009870 tx=0x7fb460009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=602f20b3eb5cf94a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.634+0000 7fb467fff700 1 -- 172.21.15.146:0/3675472719 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb460011830 con 0x7fb470136960 2023-10-03T10:18:41.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.634+0000 7fb467fff700 1 -- 172.21.15.146:0/3675472719 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb460011990 con 0x7fb470136960 2023-10-03T10:18:41.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.634+0000 7fb467fff700 1 -- 172.21.15.146:0/3675472719 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb460011d20 con 0x7fb470136960 2023-10-03T10:18:41.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.635+0000 7fb477618700 1 -- 172.21.15.146:0/3675472719 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb470136960 msgr2=0x7fb470138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.635+0000 7fb477618700 1 --2- 172.21.15.146:0/3675472719 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb470136960 0x7fb470138d40 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fb460009870 tx=0x7fb460009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:41.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.635+0000 7fb477618700 1 -- 172.21.15.146:0/3675472719 shutdown_connections 2023-10-03T10:18:41.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.635+0000 7fb477618700 1 --2- 172.21.15.146:0/3675472719 >> v2:172.21.15.146:3300/0 conn(0x7fb470139280 0x7fb47013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.635+0000 7fb477618700 1 --2- 172.21.15.146:0/3675472719 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb470136960 0x7fb470138d40 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.635+0000 7fb477618700 1 -- 172.21.15.146:0/3675472719 >> 172.21.15.146:0/3675472719 conn(0x7fb470099c40 msgr2=0x7fb4700a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.635+0000 7fb477618700 1 -- 172.21.15.146:0/3675472719 shutdown_connections 2023-10-03T10:18:41.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.635+0000 7fb477618700 1 -- 172.21.15.146:0/3675472719 wait complete. 2023-10-03T10:18:41.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.635+0000 7fb477618700 1 Processor -- start 2023-10-03T10:18:41.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.636+0000 7fb477618700 1 -- start start 2023-10-03T10:18:41.640 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:41.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.636+0000 7fb477618700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb470133ad0 0x7fb470071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.636+0000 7fb477618700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb470136960 0x7fb470071690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.636+0000 7fb477618700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb470139280 0x7fb470071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.636+0000 7fb477618700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47006ffd0 con 0x7fb470139280 2023-10-03T10:18:41.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.636+0000 7fb477618700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47009f390 con 0x7fb470133ad0 2023-10-03T10:18:41.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.636+0000 7fb477618700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb470072200 con 0x7fb470136960 2023-10-03T10:18:41.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.636+0000 7fb474bb3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb470136960 0x7fb470071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.636+0000 7fb4753b4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb470133ad0 0x7fb470071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.636+0000 7fb475bb5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb470139280 0x7fb470071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.636+0000 7fb474bb3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb470136960 0x7fb470071690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34858/0 (socket says 172.21.15.146:34858) 2023-10-03T10:18:41.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.636+0000 7fb474bb3700 1 -- 172.21.15.146:0/2493547063 learned_addr learned my addr 172.21.15.146:0/2493547063 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:41.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.636+0000 7fb4753b4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb470133ad0 0x7fb470071150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35486/0 (socket says 172.21.15.146:35486) 2023-10-03T10:18:41.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.636+0000 7fb475bb5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb470139280 0x7fb470071bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39228/0 (socket says 172.21.15.146:39228) 2023-10-03T10:18:41.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.636+0000 7fb474bb3700 1 -- 172.21.15.146:0/2493547063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb470133ad0 msgr2=0x7fb470071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.636+0000 7fb474bb3700 1 --2- 172.21.15.146:0/2493547063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb470133ad0 0x7fb470071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.636+0000 7fb474bb3700 1 -- 172.21.15.146:0/2493547063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb470139280 msgr2=0x7fb470071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.636+0000 7fb474bb3700 1 --2- 172.21.15.146:0/2493547063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb470139280 0x7fb470071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.636+0000 7fb474bb3700 1 -- 172.21.15.146:0/2493547063 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb468009a70 con 0x7fb470136960 2023-10-03T10:18:41.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.637+0000 7fb474bb3700 1 --2- 172.21.15.146:0/2493547063 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb470136960 0x7fb470071690 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fb460014040 tx=0x7fb460004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.637+0000 7fb465ffb700 1 -- 172.21.15.146:0/2493547063 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb460004550 con 0x7fb470136960 2023-10-03T10:18:41.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.637+0000 7fb465ffb700 1 -- 172.21.15.146:0/2493547063 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46001e070 con 0x7fb470136960 2023-10-03T10:18:41.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.637+0000 7fb465ffb700 1 -- 172.21.15.146:0/2493547063 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4600038c0 con 0x7fb470136960 2023-10-03T10:18:41.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.637+0000 7fb477618700 1 -- 172.21.15.146:0/2493547063 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4600094a0 con 0x7fb470136960 2023-10-03T10:18:41.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.637+0000 7fb477618700 1 -- 172.21.15.146:0/2493547063 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb470131730 con 0x7fb470136960 2023-10-03T10:18:41.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.638+0000 7fb465ffb700 1 -- 172.21.15.146:0/2493547063 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb460003a20 con 0x7fb470136960 2023-10-03T10:18:41.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.638+0000 7fb465ffb700 1 -- 172.21.15.146:0/2493547063 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb460020070 con 0x7fb470136960 2023-10-03T10:18:41.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.638+0000 7fb477618700 1 -- 172.21.15.146:0/2493547063 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb47006ee50 con 0x7fb470136960 2023-10-03T10:18:41.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.643+0000 7fb465ffb700 1 -- 172.21.15.146:0/2493547063 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb460015080 con 0x7fb470136960 2023-10-03T10:18:41.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.761+0000 7f96db350700 1 Processor -- start 2023-10-03T10:18:41.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.762+0000 7f96db350700 1 -- start start 2023-10-03T10:18:41.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.762+0000 7f96db350700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f96d40a0a70 0x7f96d40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.762+0000 7f96db350700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f96d40a1380 0x7f96d4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.762+0000 7f96db350700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d409dc00 con 0x7f96d4133f50 2023-10-03T10:18:41.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.762+0000 7f96db350700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d409ea60 con 0x7f96d40a0a70 2023-10-03T10:18:41.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.762+0000 7f96db350700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96d409dec0 con 0x7f96d40a1380 2023-10-03T10:18:41.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.762+0000 7f96d90ec700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f96d40a0a70 0x7f96d40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.762+0000 7f96d90ec700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f96d40a0a70 0x7f96d40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39230/0 (socket says 172.21.15.146:39230) 2023-10-03T10:18:41.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.762+0000 7f96d90ec700 1 -- 172.21.15.146:0/1270992775 learned_addr learned my addr 172.21.15.146:0/1270992775 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:41.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.762+0000 7f96d88eb700 1 --2- 172.21.15.146:0/1270992775 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f96d40a1380 0x7f96d4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.763+0000 7f96d90ec700 1 -- 172.21.15.146:0/1270992775 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f96d40a1380 msgr2=0x7f96d4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:41.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.763+0000 7f96d90ec700 1 --2- 172.21.15.146:0/1270992775 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f96d40a1380 0x7f96d4133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.763+0000 7f96cbfff700 1 -- 172.21.15.146:0/1270992775 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940673102 0 0) 0x7f96d409dc00 con 0x7f96d4133f50 2023-10-03T10:18:41.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.763+0000 7f96d90ec700 1 -- 172.21.15.146:0/1270992775 >> v1:172.21.15.146:6789/0 conn(0x7f96d4133f50 legacy=0x7f96d413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.763+0000 7f96d90ec700 1 -- 172.21.15.146:0/1270992775 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d409e6a0 con 0x7f96d40a0a70 2023-10-03T10:18:41.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.763+0000 7f96d90ec700 1 --2- 172.21.15.146:0/1270992775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96d40a0a70 0x7f96d40a0e40 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f96d00098f0 tx=0x7f96d0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a328348cbf3f0d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.763+0000 7f96cbfff700 1 -- 172.21.15.146:0/1270992775 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0011830 con 0x7f96d40a0a70 2023-10-03T10:18:41.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.763+0000 7f96cbfff700 1 -- 172.21.15.146:0/1270992775 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d0011990 con 0x7f96d40a0a70 2023-10-03T10:18:41.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.763+0000 7f96cbfff700 1 -- 172.21.15.146:0/1270992775 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0011d20 con 0x7f96d40a0a70 2023-10-03T10:18:41.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.764+0000 7f96db350700 1 -- 172.21.15.146:0/1270992775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96d40a0a70 msgr2=0x7f96d40a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.764+0000 7f96db350700 1 --2- 172.21.15.146:0/1270992775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96d40a0a70 0x7f96d40a0e40 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f96d00098f0 tx=0x7f96d0009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:41.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.764+0000 7f96db350700 1 -- 172.21.15.146:0/1270992775 shutdown_connections 2023-10-03T10:18:41.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.764+0000 7f96db350700 1 --2- 172.21.15.146:0/1270992775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96d40a0a70 0x7f96d40a0e40 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.764+0000 7f96db350700 1 --2- 172.21.15.146:0/1270992775 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f96d40a1380 0x7f96d4133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.764+0000 7f96db350700 1 -- 172.21.15.146:0/1270992775 >> 172.21.15.146:0/1270992775 conn(0x7f96d40a6610 msgr2=0x7f96d40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.764+0000 7f96db350700 1 -- 172.21.15.146:0/1270992775 shutdown_connections 2023-10-03T10:18:41.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.764+0000 7f96db350700 1 -- 172.21.15.146:0/1270992775 wait complete. 2023-10-03T10:18:41.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.765+0000 7f96db350700 1 Processor -- start 2023-10-03T10:18:41.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.765+0000 7f96db350700 1 -- start start 2023-10-03T10:18:41.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.766+0000 7f96db350700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96d40a0a70 0x7f96d41c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.766+0000 7f96db350700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96d40a1380 0x7f96d41c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.766+0000 7f96db350700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f96d4133f50 0x7f96d41c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.766+0000 7f96db350700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d41209e0 con 0x7f96d40a1380 2023-10-03T10:18:41.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.766+0000 7f96db350700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d41207f0 con 0x7f96d40a0a70 2023-10-03T10:18:41.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.766+0000 7f96db350700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96d4122700 con 0x7f96d4133f50 2023-10-03T10:18:41.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.766+0000 7f96d88eb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96d40a1380 0x7f96d41c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.766+0000 7f96d88eb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96d40a1380 0x7f96d41c8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39244/0 (socket says 172.21.15.146:39244) 2023-10-03T10:18:41.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.766+0000 7f96d88eb700 1 -- 172.21.15.146:0/3758576838 learned_addr learned my addr 172.21.15.146:0/3758576838 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:41.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.766+0000 7f96d98ed700 1 --2- 172.21.15.146:0/3758576838 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f96d4133f50 0x7f96d41c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.766+0000 7f96d88eb700 1 -- 172.21.15.146:0/3758576838 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f96d4133f50 msgr2=0x7f96d41c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.766+0000 7f96d88eb700 1 --2- 172.21.15.146:0/3758576838 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f96d4133f50 0x7f96d41c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.766+0000 7f96d88eb700 1 -- 172.21.15.146:0/3758576838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96d40a0a70 msgr2=0x7f96d41c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.766+0000 7f96d88eb700 1 --2- 172.21.15.146:0/3758576838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96d40a0a70 0x7f96d41c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.766+0000 7f96d88eb700 1 -- 172.21.15.146:0/3758576838 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d0009550 con 0x7f96d40a1380 2023-10-03T10:18:41.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.766+0000 7f96d88eb700 1 --2- 172.21.15.146:0/3758576838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96d40a1380 0x7f96d41c8bb0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f96c400e9b0 tx=0x7f96c400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.767+0000 7f96c9ffb700 1 -- 172.21.15.146:0/3758576838 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c4009710 con 0x7f96d40a1380 2023-10-03T10:18:41.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.767+0000 7f96c9ffb700 1 -- 172.21.15.146:0/3758576838 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c400c850 con 0x7f96d40a1380 2023-10-03T10:18:41.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.767+0000 7f96db350700 1 -- 172.21.15.146:0/3758576838 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d40a17b0 con 0x7f96d40a1380 2023-10-03T10:18:41.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.767+0000 7f96c9ffb700 1 -- 172.21.15.146:0/3758576838 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c400cbc0 con 0x7f96d40a1380 2023-10-03T10:18:41.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.767+0000 7f96db350700 1 -- 172.21.15.146:0/3758576838 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d4120fe0 con 0x7f96d40a1380 2023-10-03T10:18:41.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.768+0000 7f96c9ffb700 1 -- 172.21.15.146:0/3758576838 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f96c400cd20 con 0x7f96d40a1380 2023-10-03T10:18:41.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.768+0000 7f96c9ffb700 1 -- 172.21.15.146:0/3758576838 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f96c403f7b0 con 0x7f96d40a1380 2023-10-03T10:18:41.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.768+0000 7f96db350700 1 -- 172.21.15.146:0/3758576838 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d40a4fd0 con 0x7f96d40a1380 2023-10-03T10:18:41.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.772+0000 7f35c6f67700 1 Processor -- start 2023-10-03T10:18:41.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.772+0000 7f35c6f67700 1 -- start start 2023-10-03T10:18:41.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.772+0000 7f35c6f67700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35c006a770 0x7f35c01349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.772+0000 7f35c6f67700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35c009e070 0x7f35c013fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.772+0000 7f35c6f67700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c009eca0 con 0x7f35c0134f00 2023-10-03T10:18:41.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.772+0000 7f35c6f67700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c009f720 con 0x7f35c009e070 2023-10-03T10:18:41.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.772+0000 7f35c6f67700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c006b480 con 0x7f35c006a770 2023-10-03T10:18:41.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.772+0000 7f35c4d03700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35c006a770 0x7f35c01349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.772+0000 7f35c4d03700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35c006a770 0x7f35c01349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35502/0 (socket says 172.21.15.146:35502) 2023-10-03T10:18:41.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.772+0000 7f35c4d03700 1 -- 172.21.15.146:0/3031545848 learned_addr learned my addr 172.21.15.146:0/3031545848 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:41.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.772+0000 7f35c5504700 1 --2- 172.21.15.146:0/3031545848 >> v2:172.21.15.146:3300/0 conn(0x7f35c009e070 0x7f35c013fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.772+0000 7f35c4d03700 1 -- 172.21.15.146:0/3031545848 >> v2:172.21.15.146:3300/0 conn(0x7f35c009e070 msgr2=0x7f35c013fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:41.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.773+0000 7f35c4d03700 1 --2- 172.21.15.146:0/3031545848 >> v2:172.21.15.146:3300/0 conn(0x7f35c009e070 0x7f35c013fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.773+0000 7f35c4d03700 1 -- 172.21.15.146:0/3031545848 >> v1:172.21.15.146:6789/0 conn(0x7f35c0134f00 legacy=0x7f35c009d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.773+0000 7f35c4d03700 1 -- 172.21.15.146:0/3031545848 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c01352d0 con 0x7f35c006a770 2023-10-03T10:18:41.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.773+0000 7f35c4d03700 1 --2- 172.21.15.146:0/3031545848 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35c006a770 0x7f35c01349c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f35b40098f0 tx=0x7f35b4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4386bab4767da18a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.773+0000 7f96c9ffb700 1 -- 172.21.15.146:0/3758576838 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f96c4021020 con 0x7f96d40a1380 2023-10-03T10:18:41.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.773+0000 7f35bf7fe700 1 -- 172.21.15.146:0/3031545848 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4011830 con 0x7f35c006a770 2023-10-03T10:18:41.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.773+0000 7f35bf7fe700 1 -- 172.21.15.146:0/3031545848 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b4011990 con 0x7f35c006a770 2023-10-03T10:18:41.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.773+0000 7f35bf7fe700 1 -- 172.21.15.146:0/3031545848 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4011d20 con 0x7f35c006a770 2023-10-03T10:18:41.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.773+0000 7f35c6f67700 1 -- 172.21.15.146:0/3031545848 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35c006a770 msgr2=0x7f35c01349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.774+0000 7f35c6f67700 1 --2- 172.21.15.146:0/3031545848 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35c006a770 0x7f35c01349c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f35b40098f0 tx=0x7f35b4009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:41.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.774+0000 7f35c6f67700 1 -- 172.21.15.146:0/3031545848 shutdown_connections 2023-10-03T10:18:41.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.774+0000 7f35c6f67700 1 --2- 172.21.15.146:0/3031545848 >> v2:172.21.15.146:3300/0 conn(0x7f35c009e070 0x7f35c013fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.774+0000 7f35c6f67700 1 --2- 172.21.15.146:0/3031545848 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35c006a770 0x7f35c01349c0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.774+0000 7f35c6f67700 1 -- 172.21.15.146:0/3031545848 >> 172.21.15.146:0/3031545848 conn(0x7f35c0099c40 msgr2=0x7f35c00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.774+0000 7f35c6f67700 1 -- 172.21.15.146:0/3031545848 shutdown_connections 2023-10-03T10:18:41.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.774+0000 7f35c6f67700 1 -- 172.21.15.146:0/3031545848 wait complete. 2023-10-03T10:18:41.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.775+0000 7f35c6f67700 1 Processor -- start 2023-10-03T10:18:41.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.775+0000 7f35c6f67700 1 -- start start 2023-10-03T10:18:41.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.776+0000 7f35c6f67700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35c006a770 0x7f35c0133d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.776+0000 7f35c6f67700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35c009e070 0x7f35c006f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.776+0000 7f35c6f67700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35c0134f00 0x7f35c006fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.776+0000 7f35c6f67700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c0138e60 con 0x7f35c006a770 2023-10-03T10:18:41.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.776+0000 7f35c6f67700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c0139060 con 0x7f35c009e070 2023-10-03T10:18:41.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.776+0000 7f35c6f67700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35c0072030 con 0x7f35c0134f00 2023-10-03T10:18:41.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.776+0000 7f35c4d03700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35c006a770 0x7f35c0133d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.776+0000 7f35bffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35c009e070 0x7f35c006f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.776+0000 7f35c4d03700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35c006a770 0x7f35c0133d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39264/0 (socket says 172.21.15.146:39264) 2023-10-03T10:18:41.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.776+0000 7f35c4d03700 1 -- 172.21.15.146:0/3861006385 learned_addr learned my addr 172.21.15.146:0/3861006385 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:41.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.776+0000 7f35c5504700 1 --2- 172.21.15.146:0/3861006385 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35c0134f00 0x7f35c006fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.776+0000 7f35c4d03700 1 -- 172.21.15.146:0/3861006385 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35c0134f00 msgr2=0x7f35c006fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.776+0000 7f35c4d03700 1 --2- 172.21.15.146:0/3861006385 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35c0134f00 0x7f35c006fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.776+0000 7f35c4d03700 1 -- 172.21.15.146:0/3861006385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35c009e070 msgr2=0x7f35c006f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.776+0000 7f35c4d03700 1 --2- 172.21.15.146:0/3861006385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35c009e070 0x7f35c006f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.776+0000 7f35c4d03700 1 -- 172.21.15.146:0/3861006385 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b4009550 con 0x7f35c006a770 2023-10-03T10:18:41.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.776+0000 7f35bffff700 1 --2- 172.21.15.146:0/3861006385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35c009e070 0x7f35c006f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:41.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.776+0000 7f35c5504700 1 --2- 172.21.15.146:0/3861006385 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35c0134f00 0x7f35c006fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:41.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.776+0000 7f35c4d03700 1 --2- 172.21.15.146:0/3861006385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35c006a770 0x7f35c0133d30 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009c40 tx=0x7f35b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.777+0000 7f35bd7fa700 1 -- 172.21.15.146:0/3861006385 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4004510 con 0x7f35c006a770 2023-10-03T10:18:41.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.777+0000 7f35bd7fa700 1 -- 172.21.15.146:0/3861006385 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b401e070 con 0x7f35c006a770 2023-10-03T10:18:41.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.777+0000 7f35bd7fa700 1 -- 172.21.15.146:0/3861006385 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b40038e0 con 0x7f35c006a770 2023-10-03T10:18:41.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.777+0000 7f35c6f67700 1 -- 172.21.15.146:0/3861006385 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c009f220 con 0x7f35c006a770 2023-10-03T10:18:41.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.777+0000 7f35c6f67700 1 -- 172.21.15.146:0/3861006385 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c00712d0 con 0x7f35c006a770 2023-10-03T10:18:41.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.777+0000 7f35bd7fa700 1 -- 172.21.15.146:0/3861006385 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f35b4003a40 con 0x7f35c006a770 2023-10-03T10:18:41.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.777+0000 7f35bd7fa700 1 -- 172.21.15.146:0/3861006385 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f35b4020070 con 0x7f35c006a770 2023-10-03T10:18:41.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.778+0000 7f35c6f67700 1 -- 172.21.15.146:0/3861006385 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c004f2a0 con 0x7f35c006a770 2023-10-03T10:18:41.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.782+0000 7f35bd7fa700 1 -- 172.21.15.146:0/3861006385 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f35b402a080 con 0x7f35c006a770 2023-10-03T10:18:41.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.843+0000 7fb477618700 1 -- 172.21.15.146:0/2493547063 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb470070140 con 0x7fb470136960 2023-10-03T10:18:41.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.844+0000 7fb465ffb700 1 -- 172.21.15.146:0/2493547063 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb46002a020 con 0x7fb470136960 2023-10-03T10:18:41.844 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:41.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.846+0000 7fb477618700 1 -- 172.21.15.146:0/2493547063 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb470136960 msgr2=0x7fb470071690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.846+0000 7fb477618700 1 --2- 172.21.15.146:0/2493547063 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb470136960 0x7fb470071690 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fb460014040 tx=0x7fb460004750 comp rx=0 tx=0).stop 2023-10-03T10:18:41.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.846+0000 7fb477618700 1 -- 172.21.15.146:0/2493547063 shutdown_connections 2023-10-03T10:18:41.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.846+0000 7fb477618700 1 --2- 172.21.15.146:0/2493547063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb470139280 0x7fb470071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.846+0000 7fb477618700 1 --2- 172.21.15.146:0/2493547063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb470133ad0 0x7fb470071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.846+0000 7fb477618700 1 --2- 172.21.15.146:0/2493547063 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb470136960 0x7fb470071690 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.846+0000 7fb477618700 1 -- 172.21.15.146:0/2493547063 >> 172.21.15.146:0/2493547063 conn(0x7fb470099c40 msgr2=0x7fb4700a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.846+0000 7fb477618700 1 -- 172.21.15.146:0/2493547063 shutdown_connections 2023-10-03T10:18:41.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.846+0000 7fb477618700 1 -- 172.21.15.146:0/2493547063 wait complete. 2023-10-03T10:18:41.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.968+0000 7f96db350700 1 -- 172.21.15.146:0/3758576838 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f96d404f2a0 con 0x7f96d40a1380 2023-10-03T10:18:41.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.968+0000 7f96c9ffb700 1 -- 172.21.15.146:0/3758576838 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f96c4017070 con 0x7f96d40a1380 2023-10-03T10:18:41.969 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:41.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.971+0000 7f96db350700 1 -- 172.21.15.146:0/3758576838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96d40a1380 msgr2=0x7f96d41c8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.971+0000 7f96db350700 1 --2- 172.21.15.146:0/3758576838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96d40a1380 0x7f96d41c8bb0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f96c400e9b0 tx=0x7f96c400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.971+0000 7f96db350700 1 -- 172.21.15.146:0/3758576838 shutdown_connections 2023-10-03T10:18:41.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.971+0000 7f96db350700 1 --2- 172.21.15.146:0/3758576838 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f96d4133f50 0x7f96d41c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.971+0000 7f96db350700 1 --2- 172.21.15.146:0/3758576838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96d40a0a70 0x7f96d41c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.971+0000 7f96db350700 1 --2- 172.21.15.146:0/3758576838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96d40a1380 0x7f96d41c8bb0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.971+0000 7f96db350700 1 -- 172.21.15.146:0/3758576838 >> 172.21.15.146:0/3758576838 conn(0x7f96d40a6610 msgr2=0x7f96d40a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.972+0000 7f96db350700 1 -- 172.21.15.146:0/3758576838 shutdown_connections 2023-10-03T10:18:41.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.972+0000 7f96db350700 1 -- 172.21.15.146:0/3758576838 wait complete. 2023-10-03T10:18:41.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.983+0000 7f35c6f67700 1 -- 172.21.15.146:0/3861006385 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f35c0071a20 con 0x7f35c006a770 2023-10-03T10:18:41.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.983+0000 7f35bd7fa700 1 -- 172.21.15.146:0/3861006385 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f35b4015020 con 0x7f35c006a770 2023-10-03T10:18:41.984 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:41.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.986+0000 7f35c6f67700 1 -- 172.21.15.146:0/3861006385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35c006a770 msgr2=0x7f35c0133d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.986+0000 7f35c6f67700 1 --2- 172.21.15.146:0/3861006385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35c006a770 0x7f35c0133d30 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009c40 tx=0x7f35b4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:41.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.987+0000 7f35c6f67700 1 -- 172.21.15.146:0/3861006385 shutdown_connections 2023-10-03T10:18:41.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.987+0000 7f35c6f67700 1 --2- 172.21.15.146:0/3861006385 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35c0134f00 0x7f35c006fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.987+0000 7f35c6f67700 1 --2- 172.21.15.146:0/3861006385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35c006a770 0x7f35c0133d30 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.987+0000 7f35c6f67700 1 --2- 172.21.15.146:0/3861006385 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35c009e070 0x7f35c006f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.987+0000 7f35c6f67700 1 -- 172.21.15.146:0/3861006385 >> 172.21.15.146:0/3861006385 conn(0x7f35c0099c40 msgr2=0x7f35c009c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.987+0000 7f35c6f67700 1 -- 172.21.15.146:0/3861006385 shutdown_connections 2023-10-03T10:18:41.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:41.987+0000 7f35c6f67700 1 -- 172.21.15.146:0/3861006385 wait complete. 2023-10-03T10:18:41.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:41.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:42.010 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:42.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.160+0000 7fa634fb7700 1 Processor -- start 2023-10-03T10:18:42.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.160+0000 7fa634fb7700 1 -- start start 2023-10-03T10:18:42.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.161+0000 7fa634fb7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa630133ad0 0x7fa630133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.161+0000 7fa634fb7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6301300a0 0x7fa6301304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.161+0000 7fa634fb7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa6301309f0 0x7fa63013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.161+0000 7fa634fb7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa63006b2d0 con 0x7fa6301309f0 2023-10-03T10:18:42.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.161+0000 7fa634fb7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa630133610 con 0x7fa6301300a0 2023-10-03T10:18:42.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.161+0000 7fa634fb7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa63009a500 con 0x7fa630133ad0 2023-10-03T10:18:42.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.161+0000 7fa62e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa630133ad0 0x7fa630133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.161+0000 7fa62dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6301300a0 0x7fa6301304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.161+0000 7fa62e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa630133ad0 0x7fa630133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34894/0 (socket says 172.21.15.146:34894) 2023-10-03T10:18:42.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.161+0000 7fa62dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6301300a0 0x7fa6301304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35516/0 (socket says 172.21.15.146:35516) 2023-10-03T10:18:42.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.161+0000 7fa62ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa6301309f0 0x7fa63013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.161+0000 7fa62e59c700 1 -- 172.21.15.146:0/3916667782 learned_addr learned my addr 172.21.15.146:0/3916667782 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:42.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.161+0000 7fa62e59c700 1 -- 172.21.15.146:0/3916667782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6301300a0 msgr2=0x7fa6301304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:42.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.161+0000 7fa62e59c700 1 --2- 172.21.15.146:0/3916667782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6301300a0 0x7fa6301304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.161+0000 7fa62e59c700 1 -- 172.21.15.146:0/3916667782 >> v2:172.21.15.146:3300/0 conn(0x7fa6301309f0 msgr2=0x7fa63013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:42.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.161+0000 7fa62e59c700 1 --2- 172.21.15.146:0/3916667782 >> v2:172.21.15.146:3300/0 conn(0x7fa6301309f0 0x7fa63013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.161+0000 7fa62e59c700 1 -- 172.21.15.146:0/3916667782 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6301338b0 con 0x7fa630133ad0 2023-10-03T10:18:42.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.161+0000 7fa62dd9b700 1 --2- 172.21.15.146:0/3916667782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6301300a0 0x7fa6301304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.161+0000 7fa62ed9d700 1 --2- 172.21.15.146:0/3916667782 >> v2:172.21.15.146:3300/0 conn(0x7fa6301309f0 0x7fa63013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.161+0000 7fa62e59c700 1 --2- 172.21.15.146:0/3916667782 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa630133ad0 0x7fa630133ea0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fa6240098f0 tx=0x7fa624009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=687612e99dd0a764 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:42.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.161+0000 7fa62d59a700 1 -- 172.21.15.146:0/3916667782 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa624011830 con 0x7fa630133ad0 2023-10-03T10:18:42.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.162+0000 7fa62d59a700 1 -- 172.21.15.146:0/3916667782 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa624011990 con 0x7fa630133ad0 2023-10-03T10:18:42.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.162+0000 7fa62d59a700 1 -- 172.21.15.146:0/3916667782 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa624011d20 con 0x7fa630133ad0 2023-10-03T10:18:42.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.162+0000 7fa634fb7700 1 -- 172.21.15.146:0/3916667782 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa630133ad0 msgr2=0x7fa630133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.162+0000 7fa634fb7700 1 --2- 172.21.15.146:0/3916667782 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa630133ad0 0x7fa630133ea0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fa6240098f0 tx=0x7fa624009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:42.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.162+0000 7fa634fb7700 1 -- 172.21.15.146:0/3916667782 shutdown_connections 2023-10-03T10:18:42.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.162+0000 7fa634fb7700 1 --2- 172.21.15.146:0/3916667782 >> v2:172.21.15.146:3300/0 conn(0x7fa6301309f0 0x7fa63013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.162+0000 7fa634fb7700 1 --2- 172.21.15.146:0/3916667782 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa630133ad0 0x7fa630133ea0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.162+0000 7fa634fb7700 1 --2- 172.21.15.146:0/3916667782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6301300a0 0x7fa6301304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.162+0000 7fa634fb7700 1 -- 172.21.15.146:0/3916667782 >> 172.21.15.146:0/3916667782 conn(0x7fa630099c40 msgr2=0x7fa6300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.162+0000 7fa634fb7700 1 -- 172.21.15.146:0/3916667782 shutdown_connections 2023-10-03T10:18:42.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.162+0000 7fa634fb7700 1 -- 172.21.15.146:0/3916667782 wait complete. 2023-10-03T10:18:42.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.163+0000 7fa634fb7700 1 Processor -- start 2023-10-03T10:18:42.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.163+0000 7fa634fb7700 1 -- start start 2023-10-03T10:18:42.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa634fb7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6301300a0 0x7fa6301c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa634fb7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6301309f0 0x7fa6301c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa634fb7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa630133ad0 0x7fa6301c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa634fb7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63012da50 con 0x7fa6301309f0 2023-10-03T10:18:42.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa634fb7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa630072230 con 0x7fa6301300a0 2023-10-03T10:18:42.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa634fb7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa63011fe50 con 0x7fa630133ad0 2023-10-03T10:18:42.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa62e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6301300a0 0x7fa6301c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa62dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6301309f0 0x7fa6301c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa62e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6301300a0 0x7fa6301c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35532/0 (socket says 172.21.15.146:35532) 2023-10-03T10:18:42.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa62e59c700 1 -- 172.21.15.146:0/2324007228 learned_addr learned my addr 172.21.15.146:0/2324007228 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:42.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa62ed9d700 1 --2- 172.21.15.146:0/2324007228 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa630133ad0 0x7fa6301c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa62dd9b700 1 -- 172.21.15.146:0/2324007228 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa630133ad0 msgr2=0x7fa6301c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa62dd9b700 1 --2- 172.21.15.146:0/2324007228 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa630133ad0 0x7fa6301c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa62dd9b700 1 -- 172.21.15.146:0/2324007228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6301300a0 msgr2=0x7fa6301c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa62dd9b700 1 --2- 172.21.15.146:0/2324007228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6301300a0 0x7fa6301c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa62dd9b700 1 -- 172.21.15.146:0/2324007228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6200094a0 con 0x7fa6301309f0 2023-10-03T10:18:42.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa62ed9d700 1 --2- 172.21.15.146:0/2324007228 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa630133ad0 0x7fa6301c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa62e59c700 1 --2- 172.21.15.146:0/2324007228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6301300a0 0x7fa6301c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa62dd9b700 1 --2- 172.21.15.146:0/2324007228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6301309f0 0x7fa6301c8c90 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fa62000e8d0 tx=0x7fa62000ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:42.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa61effd700 1 -- 172.21.15.146:0/2324007228 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa620013680 con 0x7fa6301309f0 2023-10-03T10:18:42.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa61effd700 1 -- 172.21.15.146:0/2324007228 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6200137e0 con 0x7fa6301309f0 2023-10-03T10:18:42.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa634fb7700 1 -- 172.21.15.146:0/2324007228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa628009a70 con 0x7fa6301309f0 2023-10-03T10:18:42.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa61effd700 1 -- 172.21.15.146:0/2324007228 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa620013b70 con 0x7fa6301309f0 2023-10-03T10:18:42.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.164+0000 7fa634fb7700 1 -- 172.21.15.146:0/2324007228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa624009550 con 0x7fa6301309f0 2023-10-03T10:18:42.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.165+0000 7fa61effd700 1 -- 172.21.15.146:0/2324007228 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa620013cd0 con 0x7fa6301309f0 2023-10-03T10:18:42.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.165+0000 7fa61effd700 1 -- 172.21.15.146:0/2324007228 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa62003f9c0 con 0x7fa6301309f0 2023-10-03T10:18:42.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.165+0000 7fa634fb7700 1 -- 172.21.15.146:0/2324007228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63011fc50 con 0x7fa6301309f0 2023-10-03T10:18:42.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.170+0000 7fa61effd700 1 -- 172.21.15.146:0/2324007228 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa620021080 con 0x7fa6301309f0 2023-10-03T10:18:42.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.354+0000 7fa634fb7700 1 -- 172.21.15.146:0/2324007228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa63004f2a0 con 0x7fa6301309f0 2023-10-03T10:18:42.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.355+0000 7fa61effd700 1 -- 172.21.15.146:0/2324007228 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa620011d90 con 0x7fa6301309f0 2023-10-03T10:18:42.356 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:42.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.357+0000 7fa634fb7700 1 -- 172.21.15.146:0/2324007228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6301309f0 msgr2=0x7fa6301c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.357+0000 7fa634fb7700 1 --2- 172.21.15.146:0/2324007228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6301309f0 0x7fa6301c8c90 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fa62000e8d0 tx=0x7fa62000ebe0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.357+0000 7fa634fb7700 1 -- 172.21.15.146:0/2324007228 shutdown_connections 2023-10-03T10:18:42.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.357+0000 7fa634fb7700 1 --2- 172.21.15.146:0/2324007228 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa630133ad0 0x7fa6301c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.357+0000 7fa634fb7700 1 --2- 172.21.15.146:0/2324007228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6301300a0 0x7fa6301c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.357+0000 7fa634fb7700 1 --2- 172.21.15.146:0/2324007228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6301309f0 0x7fa6301c8c90 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.357+0000 7fa634fb7700 1 -- 172.21.15.146:0/2324007228 >> 172.21.15.146:0/2324007228 conn(0x7fa630099c40 msgr2=0x7fa6300a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.357+0000 7fa634fb7700 1 -- 172.21.15.146:0/2324007228 shutdown_connections 2023-10-03T10:18:42.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.357+0000 7fa634fb7700 1 -- 172.21.15.146:0/2324007228 wait complete. 2023-10-03T10:18:42.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:42.860 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:42.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.986+0000 7f5f1d7e2700 1 Processor -- start 2023-10-03T10:18:42.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.986+0000 7f5f1d7e2700 1 -- start start 2023-10-03T10:18:42.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.986+0000 7f5f1d7e2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f180a0a90 0x7f5f180a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.986+0000 7f5f1d7e2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f180a13a0 0x7f5f18133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.986+0000 7f5f1d7e2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5f18133f70 0x7f5f18134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.986+0000 7f5f1d7e2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f180a3aa0 con 0x7f5f18133f70 2023-10-03T10:18:42.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.986+0000 7f5f1d7e2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1809a540 con 0x7f5f180a13a0 2023-10-03T10:18:42.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.986+0000 7f5f1d7e2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f180a1fe0 con 0x7f5f180a0a90 2023-10-03T10:18:42.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.986+0000 7f5f16ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f180a0a90 0x7f5f180a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.986+0000 7f5f167fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f180a13a0 0x7f5f18133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.986+0000 7f5f177fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5f18133f70 0x7f5f18134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.986+0000 7f5f167fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f180a13a0 0x7f5f18133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35536/0 (socket says 172.21.15.146:35536) 2023-10-03T10:18:42.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.986+0000 7f5f16ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f180a0a90 0x7f5f180a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34904/0 (socket says 172.21.15.146:34904) 2023-10-03T10:18:42.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.986+0000 7f5f167fc700 1 -- 172.21.15.146:0/1282330319 learned_addr learned my addr 172.21.15.146:0/1282330319 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:42.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.986+0000 7f5f177fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5f18133f70 0x7f5f18134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39296/0 (socket says 172.21.15.146:39296) 2023-10-03T10:18:42.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.987+0000 7f5f167fc700 1 -- 172.21.15.146:0/1282330319 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f180a0a90 msgr2=0x7f5f180a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:42.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.987+0000 7f5f167fc700 1 --2- 172.21.15.146:0/1282330319 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f180a0a90 0x7f5f180a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.987+0000 7f5f167fc700 1 -- 172.21.15.146:0/1282330319 >> v2:172.21.15.146:3300/0 conn(0x7f5f18133f70 msgr2=0x7f5f18134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:42.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.987+0000 7f5f167fc700 1 --2- 172.21.15.146:0/1282330319 >> v2:172.21.15.146:3300/0 conn(0x7f5f18133f70 0x7f5f18134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.987+0000 7f5f167fc700 1 -- 172.21.15.146:0/1282330319 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1809a280 con 0x7f5f180a13a0 2023-10-03T10:18:42.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.987+0000 7f5f177fe700 1 --2- 172.21.15.146:0/1282330319 >> v2:172.21.15.146:3300/0 conn(0x7f5f18133f70 0x7f5f18134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.987+0000 7f5f16ffd700 1 --2- 172.21.15.146:0/1282330319 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f180a0a90 0x7f5f180a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.987+0000 7f5f167fc700 1 --2- 172.21.15.146:0/1282330319 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f180a13a0 0x7f5f18133a30 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c0098f0 tx=0x7f5f0c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b87e8ab6159518e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:42.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.987+0000 7f5f15ffb700 1 -- 172.21.15.146:0/1282330319 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c011830 con 0x7f5f180a13a0 2023-10-03T10:18:42.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.987+0000 7f5f15ffb700 1 -- 172.21.15.146:0/1282330319 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0c011990 con 0x7f5f180a13a0 2023-10-03T10:18:42.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.987+0000 7f5f15ffb700 1 -- 172.21.15.146:0/1282330319 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c011d20 con 0x7f5f180a13a0 2023-10-03T10:18:42.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.987+0000 7f5f1d7e2700 1 -- 172.21.15.146:0/1282330319 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f180a13a0 msgr2=0x7f5f18133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.987+0000 7f5f1d7e2700 1 --2- 172.21.15.146:0/1282330319 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f180a13a0 0x7f5f18133a30 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c0098f0 tx=0x7f5f0c009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:42.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.987+0000 7f5f1d7e2700 1 -- 172.21.15.146:0/1282330319 shutdown_connections 2023-10-03T10:18:42.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.987+0000 7f5f1d7e2700 1 --2- 172.21.15.146:0/1282330319 >> v2:172.21.15.146:3300/0 conn(0x7f5f18133f70 0x7f5f18134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.987+0000 7f5f1d7e2700 1 --2- 172.21.15.146:0/1282330319 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f180a0a90 0x7f5f180a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.987+0000 7f5f1d7e2700 1 --2- 172.21.15.146:0/1282330319 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f180a13a0 0x7f5f18133a30 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.987+0000 7f5f1d7e2700 1 -- 172.21.15.146:0/1282330319 >> 172.21.15.146:0/1282330319 conn(0x7f5f18099c40 msgr2=0x7f5f1806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.987+0000 7f5f1d7e2700 1 -- 172.21.15.146:0/1282330319 shutdown_connections 2023-10-03T10:18:42.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.988+0000 7f5f1d7e2700 1 -- 172.21.15.146:0/1282330319 wait complete. 2023-10-03T10:18:42.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.988+0000 7f5f1d7e2700 1 Processor -- start 2023-10-03T10:18:42.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.989+0000 7f5f1d7e2700 1 -- start start 2023-10-03T10:18:42.992 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:42.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.989+0000 7f5f1d7e2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f180a0a90 0x7f5f1811f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.989+0000 7f5f1d7e2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f180a13a0 0x7f5f1811f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.989+0000 7f5f1d7e2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f18133f70 0x7f5f1811fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.989+0000 7f5f1d7e2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f18121d50 con 0x7f5f18133f70 2023-10-03T10:18:42.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.989+0000 7f5f1d7e2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f18121030 con 0x7f5f180a13a0 2023-10-03T10:18:42.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.989+0000 7f5f1d7e2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f18133a30 con 0x7f5f180a0a90 2023-10-03T10:18:42.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.989+0000 7f5f16ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f180a0a90 0x7f5f1811f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.989+0000 7f5f167fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f180a13a0 0x7f5f1811f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.989+0000 7f5f177fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f18133f70 0x7f5f1811fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.989+0000 7f5f16ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f180a0a90 0x7f5f1811f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34918/0 (socket says 172.21.15.146:34918) 2023-10-03T10:18:42.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.989+0000 7f5f167fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f180a13a0 0x7f5f1811f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35550/0 (socket says 172.21.15.146:35550) 2023-10-03T10:18:42.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.989+0000 7f5f16ffd700 1 -- 172.21.15.146:0/3486365263 learned_addr learned my addr 172.21.15.146:0/3486365263 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:42.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.989+0000 7f5f16ffd700 1 -- 172.21.15.146:0/3486365263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f180a13a0 msgr2=0x7f5f1811f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.989+0000 7f5f16ffd700 1 --2- 172.21.15.146:0/3486365263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f180a13a0 0x7f5f1811f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.989+0000 7f5f16ffd700 1 -- 172.21.15.146:0/3486365263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f18133f70 msgr2=0x7f5f1811fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.989+0000 7f5f16ffd700 1 --2- 172.21.15.146:0/3486365263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f18133f70 0x7f5f1811fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.989+0000 7f5f16ffd700 1 -- 172.21.15.146:0/3486365263 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f080094a0 con 0x7f5f180a0a90 2023-10-03T10:18:42.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.989+0000 7f5f167fc700 1 --2- 172.21.15.146:0/3486365263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f180a13a0 0x7f5f1811f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.989+0000 7f5f177fe700 1 --2- 172.21.15.146:0/3486365263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f18133f70 0x7f5f1811fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.990+0000 7f5f16ffd700 1 --2- 172.21.15.146:0/3486365263 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f180a0a90 0x7f5f1811f390 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5f0800ec10 tx=0x7f5f0800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:42.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.990+0000 7f5eff7fe700 1 -- 172.21.15.146:0/3486365263 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f08009780 con 0x7f5f180a0a90 2023-10-03T10:18:42.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.990+0000 7f5eff7fe700 1 -- 172.21.15.146:0/3486365263 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0800c850 con 0x7f5f180a0a90 2023-10-03T10:18:42.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.990+0000 7f5eff7fe700 1 -- 172.21.15.146:0/3486365263 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0800cbe0 con 0x7f5f180a0a90 2023-10-03T10:18:42.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.990+0000 7f5f1d7e2700 1 -- 172.21.15.146:0/3486365263 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f10009a70 con 0x7f5f180a0a90 2023-10-03T10:18:42.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.990+0000 7f5f1d7e2700 1 -- 172.21.15.146:0/3486365263 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f0c009550 con 0x7f5f180a0a90 2023-10-03T10:18:42.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.990+0000 7f5eff7fe700 1 -- 172.21.15.146:0/3486365263 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f0800cd40 con 0x7f5f180a0a90 2023-10-03T10:18:42.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.991+0000 7f5eff7fe700 1 -- 172.21.15.146:0/3486365263 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5f0803f760 con 0x7f5f180a0a90 2023-10-03T10:18:42.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.991+0000 7f5f1d7e2700 1 -- 172.21.15.146:0/3486365263 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1804f2a0 con 0x7f5f180a0a90 2023-10-03T10:18:42.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:42.995+0000 7f5eff7fe700 1 -- 172.21.15.146:0/3486365263 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f08021080 con 0x7f5f180a0a90 2023-10-03T10:18:43.000 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:43.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.121+0000 7fe99f16c700 1 Processor -- start 2023-10-03T10:18:43.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.122+0000 7fe99f16c700 1 -- start start 2023-10-03T10:18:43.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.122+0000 7fe99f16c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe99809e870 0x7fe99809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.122+0000 7fe99f16c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe99809f180 0x7fe998131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.122+0000 7fe99f16c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe99809c970 con 0x7fe998131d70 2023-10-03T10:18:43.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.122+0000 7fe99f16c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9980a0920 con 0x7fe99809f180 2023-10-03T10:18:43.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.122+0000 7fe99f16c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe99809f9c0 con 0x7fe99809e870 2023-10-03T10:18:43.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.122+0000 7fe99cf08700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe99809e870 0x7fe99809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.122+0000 7fe997fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe99809f180 0x7fe998131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.122+0000 7fe99cf08700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe99809e870 0x7fe99809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34928/0 (socket says 172.21.15.146:34928) 2023-10-03T10:18:43.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.122+0000 7fe99cf08700 1 -- 172.21.15.146:0/3133977363 learned_addr learned my addr 172.21.15.146:0/3133977363 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:43.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.123+0000 7fe997fff700 1 -- 172.21.15.146:0/3133977363 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe99809e870 msgr2=0x7fe99809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:43.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.123+0000 7fe997fff700 1 --2- 172.21.15.146:0/3133977363 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe99809e870 0x7fe99809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.123+0000 7fe997fff700 1 -- 172.21.15.146:0/3133977363 >> v1:172.21.15.146:6789/0 conn(0x7fe998131d70 legacy=0x7fe998138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.123+0000 7fe997fff700 1 -- 172.21.15.146:0/3133977363 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99809bab0 con 0x7fe99809f180 2023-10-03T10:18:43.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.123+0000 7fe99cf08700 1 --2- 172.21.15.146:0/3133977363 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe99809e870 0x7fe99809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:43.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.123+0000 7fe997fff700 1 --2- 172.21.15.146:0/3133977363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe99809f180 0x7fe998131830 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fe984009840 tx=0x7fe984009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e62da985ea806 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.123+0000 7fe9977fe700 1 -- 172.21.15.146:0/3133977363 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe984011830 con 0x7fe99809f180 2023-10-03T10:18:43.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.123+0000 7fe9977fe700 1 -- 172.21.15.146:0/3133977363 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe984011990 con 0x7fe99809f180 2023-10-03T10:18:43.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.123+0000 7fe9977fe700 1 -- 172.21.15.146:0/3133977363 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe984011d20 con 0x7fe99809f180 2023-10-03T10:18:43.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.124+0000 7fe99f16c700 1 -- 172.21.15.146:0/3133977363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe99809f180 msgr2=0x7fe998131830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.124+0000 7fe99f16c700 1 --2- 172.21.15.146:0/3133977363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe99809f180 0x7fe998131830 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fe984009840 tx=0x7fe984009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:43.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.124+0000 7fe99f16c700 1 -- 172.21.15.146:0/3133977363 shutdown_connections 2023-10-03T10:18:43.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.124+0000 7fe99f16c700 1 --2- 172.21.15.146:0/3133977363 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe99809e870 0x7fe99809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.124+0000 7fe99f16c700 1 --2- 172.21.15.146:0/3133977363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe99809f180 0x7fe998131830 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.124+0000 7fe99f16c700 1 -- 172.21.15.146:0/3133977363 >> 172.21.15.146:0/3133977363 conn(0x7fe9980a4430 msgr2=0x7fe9980a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.124+0000 7fe99f16c700 1 -- 172.21.15.146:0/3133977363 shutdown_connections 2023-10-03T10:18:43.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.124+0000 7fe99f16c700 1 -- 172.21.15.146:0/3133977363 wait complete. 2023-10-03T10:18:43.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.125+0000 7fe99f16c700 1 Processor -- start 2023-10-03T10:18:43.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.125+0000 7fe99f16c700 1 -- start start 2023-10-03T10:18:43.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.126+0000 7fe99f16c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe99809e870 0x7fe9981201d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.126+0000 7fe99f16c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe99809f180 0x7fe998120710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.126+0000 7fe99f16c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe998131d70 0x7fe998120c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.126+0000 7fe99f16c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9981315a0 con 0x7fe998131d70 2023-10-03T10:18:43.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.126+0000 7fe99f16c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe998122c70 con 0x7fe99809f180 2023-10-03T10:18:43.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.126+0000 7fe99f16c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe998123750 con 0x7fe99809e870 2023-10-03T10:18:43.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.126+0000 7fe997fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe99809f180 0x7fe998120710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.126+0000 7fe997fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe99809f180 0x7fe998120710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35562/0 (socket says 172.21.15.146:35562) 2023-10-03T10:18:43.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.126+0000 7fe997fff700 1 -- 172.21.15.146:0/1214407122 learned_addr learned my addr 172.21.15.146:0/1214407122 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:43.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.126+0000 7fe99d709700 1 --2- 172.21.15.146:0/1214407122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe998131d70 0x7fe998120c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.126+0000 7fe99cf08700 1 --2- 172.21.15.146:0/1214407122 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe99809e870 0x7fe9981201d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.126+0000 7fe99d709700 1 -- 172.21.15.146:0/1214407122 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe99809e870 msgr2=0x7fe9981201d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.126+0000 7fe99d709700 1 --2- 172.21.15.146:0/1214407122 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe99809e870 0x7fe9981201d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.126+0000 7fe99d709700 1 -- 172.21.15.146:0/1214407122 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe99809f180 msgr2=0x7fe998120710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.126+0000 7fe99d709700 1 --2- 172.21.15.146:0/1214407122 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe99809f180 0x7fe998120710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.126+0000 7fe99d709700 1 -- 172.21.15.146:0/1214407122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c009550 con 0x7fe998131d70 2023-10-03T10:18:43.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.126+0000 7fe997fff700 1 --2- 172.21.15.146:0/1214407122 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe99809f180 0x7fe998120710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:43.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.127+0000 7fe99d709700 1 --2- 172.21.15.146:0/1214407122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe998131d70 0x7fe998120c50 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fe99000cbc0 tx=0x7fe99000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.127+0000 7fe9957fa700 1 -- 172.21.15.146:0/1214407122 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe990003c00 con 0x7fe998131d70 2023-10-03T10:18:43.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.127+0000 7fe9957fa700 1 -- 172.21.15.146:0/1214407122 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe990003d60 con 0x7fe998131d70 2023-10-03T10:18:43.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.127+0000 7fe99f16c700 1 -- 172.21.15.146:0/1214407122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9840094a0 con 0x7fe998131d70 2023-10-03T10:18:43.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.127+0000 7fe9957fa700 1 -- 172.21.15.146:0/1214407122 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99000aa40 con 0x7fe998131d70 2023-10-03T10:18:43.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.127+0000 7fe99f16c700 1 -- 172.21.15.146:0/1214407122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9980a2df0 con 0x7fe998131d70 2023-10-03T10:18:43.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.128+0000 7fe9957fa700 1 -- 172.21.15.146:0/1214407122 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe99000aba0 con 0x7fe998131d70 2023-10-03T10:18:43.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.128+0000 7fe9957fa700 1 -- 172.21.15.146:0/1214407122 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe99003f5d0 con 0x7fe998131d70 2023-10-03T10:18:43.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.128+0000 7fe99f16c700 1 -- 172.21.15.146:0/1214407122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99811d580 con 0x7fe998131d70 2023-10-03T10:18:43.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.133+0000 7fe9957fa700 1 -- 172.21.15.146:0/1214407122 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe990012420 con 0x7fe998131d70 2023-10-03T10:18:43.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.165+0000 7f6b3d1ad700 1 Processor -- start 2023-10-03T10:18:43.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.165+0000 7f6b3d1ad700 1 -- start start 2023-10-03T10:18:43.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.165+0000 7f6b3d1ad700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6b3806a770 0x7f6b3806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.165+0000 7f6b3d1ad700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b3806b080 0x7f6b381317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.165+0000 7f6b3d1ad700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b38131cf0 0x7f6b38132170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.165+0000 7f6b3d1ad700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b3809f770 con 0x7f6b3806a770 2023-10-03T10:18:43.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.165+0000 7f6b3d1ad700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3809dce0 con 0x7f6b38131cf0 2023-10-03T10:18:43.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.165+0000 7f6b3d1ad700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3809da80 con 0x7f6b3806b080 2023-10-03T10:18:43.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.165+0000 7f6b36d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6b3806a770 0x7f6b3806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.165+0000 7f6b3759e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b38131cf0 0x7f6b38132170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.165+0000 7f6b36d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6b3806a770 0x7f6b3806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39310/0 (socket says 172.21.15.146:39310) 2023-10-03T10:18:43.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.165+0000 7f6b36d9d700 1 -- 172.21.15.146:0/262506917 learned_addr learned my addr 172.21.15.146:0/262506917 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:43.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.165+0000 7f6b3659c700 1 --2- 172.21.15.146:0/262506917 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b3806b080 0x7f6b381317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.166+0000 7f6b3759e700 1 -- 172.21.15.146:0/262506917 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b3806b080 msgr2=0x7f6b381317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:43.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.166+0000 7f6b3759e700 1 --2- 172.21.15.146:0/262506917 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b3806b080 0x7f6b381317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.166+0000 7f6b3759e700 1 -- 172.21.15.146:0/262506917 >> v2:172.21.15.146:3300/0 conn(0x7f6b3806a770 msgr2=0x7f6b3806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:43.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.166+0000 7f6b3759e700 1 --2- 172.21.15.146:0/262506917 >> v2:172.21.15.146:3300/0 conn(0x7f6b3806a770 0x7f6b3806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.166+0000 7f6b3759e700 1 -- 172.21.15.146:0/262506917 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3809eb20 con 0x7f6b38131cf0 2023-10-03T10:18:43.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.166+0000 7f6b3759e700 1 --2- 172.21.15.146:0/262506917 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b38131cf0 0x7f6b38132170 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f6b30009d90 tx=0x7f6b3000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6ea11fe06e1ec6b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.166+0000 7f6b35d9b700 1 -- 172.21.15.146:0/262506917 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3000bd20 con 0x7f6b38131cf0 2023-10-03T10:18:43.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.166+0000 7f6b35d9b700 1 -- 172.21.15.146:0/262506917 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3000be80 con 0x7f6b38131cf0 2023-10-03T10:18:43.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.166+0000 7f6b35d9b700 1 -- 172.21.15.146:0/262506917 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30010710 con 0x7f6b38131cf0 2023-10-03T10:18:43.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.166+0000 7f6b3d1ad700 1 -- 172.21.15.146:0/262506917 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b38131cf0 msgr2=0x7f6b38132170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.166+0000 7f6b3d1ad700 1 --2- 172.21.15.146:0/262506917 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b38131cf0 0x7f6b38132170 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f6b30009d90 tx=0x7f6b3000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:43.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.167+0000 7f6b3d1ad700 1 -- 172.21.15.146:0/262506917 shutdown_connections 2023-10-03T10:18:43.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.167+0000 7f6b3d1ad700 1 --2- 172.21.15.146:0/262506917 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b38131cf0 0x7f6b38132170 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.167+0000 7f6b3d1ad700 1 --2- 172.21.15.146:0/262506917 >> v2:172.21.15.146:3300/0 conn(0x7f6b3806a770 0x7f6b3806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.167+0000 7f6b3d1ad700 1 --2- 172.21.15.146:0/262506917 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b3806b080 0x7f6b381317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.167+0000 7f6b3d1ad700 1 -- 172.21.15.146:0/262506917 >> 172.21.15.146:0/262506917 conn(0x7f6b38099c40 msgr2=0x7f6b380a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.167+0000 7f6b3d1ad700 1 -- 172.21.15.146:0/262506917 shutdown_connections 2023-10-03T10:18:43.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.167+0000 7f6b3d1ad700 1 -- 172.21.15.146:0/262506917 wait complete. 2023-10-03T10:18:43.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.168+0000 7f6b3d1ad700 1 Processor -- start 2023-10-03T10:18:43.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.168+0000 7f6b3d1ad700 1 -- start start 2023-10-03T10:18:43.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.168+0000 7f6b3d1ad700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b3806a770 0x7f6b381c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.168+0000 7f6b3d1ad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b3806b080 0x7f6b381c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.168+0000 7f6b3d1ad700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b38131cf0 0x7f6b381c0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.168+0000 7f6b3d1ad700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3811f540 con 0x7f6b3806b080 2023-10-03T10:18:43.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.168+0000 7f6b3d1ad700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b380a25f0 con 0x7f6b3806a770 2023-10-03T10:18:43.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.168+0000 7f6b3d1ad700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b381c4c40 con 0x7f6b38131cf0 2023-10-03T10:18:43.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.169+0000 7f6b36d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b3806a770 0x7f6b381c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.169+0000 7f6b3759e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b38131cf0 0x7f6b381c0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.169+0000 7f6b36d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b3806a770 0x7f6b381c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35574/0 (socket says 172.21.15.146:35574) 2023-10-03T10:18:43.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.169+0000 7f6b3759e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b38131cf0 0x7f6b381c0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34962/0 (socket says 172.21.15.146:34962) 2023-10-03T10:18:43.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.169+0000 7f6b36d9d700 1 -- 172.21.15.146:0/1761330085 learned_addr learned my addr 172.21.15.146:0/1761330085 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:43.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.169+0000 7f6b3659c700 1 --2- 172.21.15.146:0/1761330085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b3806b080 0x7f6b381c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.169+0000 7f6b3759e700 1 -- 172.21.15.146:0/1761330085 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b3806a770 msgr2=0x7f6b381c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.169+0000 7f6b3759e700 1 --2- 172.21.15.146:0/1761330085 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b3806a770 0x7f6b381c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.169+0000 7f6b3759e700 1 -- 172.21.15.146:0/1761330085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b3806b080 msgr2=0x7f6b381c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.169+0000 7f6b3759e700 1 --2- 172.21.15.146:0/1761330085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b3806b080 0x7f6b381c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.169+0000 7f6b3759e700 1 -- 172.21.15.146:0/1761330085 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b30009a70 con 0x7f6b38131cf0 2023-10-03T10:18:43.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.169+0000 7f6b36d9d700 1 --2- 172.21.15.146:0/1761330085 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b3806a770 0x7f6b381c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:43.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.169+0000 7f6b3759e700 1 --2- 172.21.15.146:0/1761330085 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b38131cf0 0x7f6b381c0770 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f6b3001a000 tx=0x7f6b30004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.169+0000 7f6b1f7fe700 1 -- 172.21.15.146:0/1761330085 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30010d20 con 0x7f6b38131cf0 2023-10-03T10:18:43.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.169+0000 7f6b1f7fe700 1 -- 172.21.15.146:0/1761330085 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b30010e80 con 0x7f6b38131cf0 2023-10-03T10:18:43.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.169+0000 7f6b3d1ad700 1 -- 172.21.15.146:0/1761330085 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b3811dec0 con 0x7f6b38131cf0 2023-10-03T10:18:43.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.169+0000 7f6b1f7fe700 1 -- 172.21.15.146:0/1761330085 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30004280 con 0x7f6b38131cf0 2023-10-03T10:18:43.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.169+0000 7f6b3d1ad700 1 -- 172.21.15.146:0/1761330085 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3811d910 con 0x7f6b38131cf0 2023-10-03T10:18:43.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.170+0000 7f6b1f7fe700 1 -- 172.21.15.146:0/1761330085 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b300043e0 con 0x7f6b38131cf0 2023-10-03T10:18:43.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.170+0000 7f6b1f7fe700 1 -- 172.21.15.146:0/1761330085 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6b30045030 con 0x7f6b38131cf0 2023-10-03T10:18:43.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.171+0000 7f6b3d1ad700 1 -- 172.21.15.146:0/1761330085 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b3804f2a0 con 0x7f6b38131cf0 2023-10-03T10:18:43.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.175+0000 7f6b1f7fe700 1 -- 172.21.15.146:0/1761330085 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b3000bd70 con 0x7f6b38131cf0 2023-10-03T10:18:43.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.194+0000 7f5f1d7e2700 1 -- 172.21.15.146:0/3486365263 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5f18122a70 con 0x7f5f180a0a90 2023-10-03T10:18:43.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.194+0000 7f5eff7fe700 1 -- 172.21.15.146:0/3486365263 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5f08017020 con 0x7f5f180a0a90 2023-10-03T10:18:43.195 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:43.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.196+0000 7f5f1d7e2700 1 -- 172.21.15.146:0/3486365263 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f180a0a90 msgr2=0x7f5f1811f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.196+0000 7f5f1d7e2700 1 --2- 172.21.15.146:0/3486365263 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f180a0a90 0x7f5f1811f390 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5f0800ec10 tx=0x7f5f0800ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:43.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.196+0000 7f5f1d7e2700 1 -- 172.21.15.146:0/3486365263 shutdown_connections 2023-10-03T10:18:43.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.196+0000 7f5f1d7e2700 1 --2- 172.21.15.146:0/3486365263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f18133f70 0x7f5f1811fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.196+0000 7f5f1d7e2700 1 --2- 172.21.15.146:0/3486365263 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5f180a0a90 0x7f5f1811f390 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.196+0000 7f5f1d7e2700 1 --2- 172.21.15.146:0/3486365263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f180a13a0 0x7f5f1811f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.196+0000 7f5f1d7e2700 1 -- 172.21.15.146:0/3486365263 >> 172.21.15.146:0/3486365263 conn(0x7f5f18099c40 msgr2=0x7f5f1809d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.196+0000 7f5f1d7e2700 1 -- 172.21.15.146:0/3486365263 shutdown_connections 2023-10-03T10:18:43.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.196+0000 7f5f1d7e2700 1 -- 172.21.15.146:0/3486365263 wait complete. 2023-10-03T10:18:43.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:43.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.349+0000 7fe99f16c700 1 -- 172.21.15.146:0/1214407122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe99804f2a0 con 0x7fe998131d70 2023-10-03T10:18:43.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.349+0000 7fe9957fa700 1 -- 172.21.15.146:0/1214407122 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe990029090 con 0x7fe998131d70 2023-10-03T10:18:43.350 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:43.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.351+0000 7fe99f16c700 1 -- 172.21.15.146:0/1214407122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe998131d70 msgr2=0x7fe998120c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.351+0000 7fe99f16c700 1 --2- 172.21.15.146:0/1214407122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe998131d70 0x7fe998120c50 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fe99000cbc0 tx=0x7fe99000ced0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.351+0000 7fe99f16c700 1 -- 172.21.15.146:0/1214407122 shutdown_connections 2023-10-03T10:18:43.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.351+0000 7fe99f16c700 1 --2- 172.21.15.146:0/1214407122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe998131d70 0x7fe998120c50 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.351+0000 7fe99f16c700 1 --2- 172.21.15.146:0/1214407122 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe99809e870 0x7fe9981201d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.351+0000 7fe99f16c700 1 --2- 172.21.15.146:0/1214407122 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe99809f180 0x7fe998120710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.351+0000 7fe99f16c700 1 -- 172.21.15.146:0/1214407122 >> 172.21.15.146:0/1214407122 conn(0x7fe9980a4430 msgr2=0x7fe99811a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.351+0000 7fe99f16c700 1 -- 172.21.15.146:0/1214407122 shutdown_connections 2023-10-03T10:18:43.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.351+0000 7fe99f16c700 1 -- 172.21.15.146:0/1214407122 wait complete. 2023-10-03T10:18:43.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:43.370 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:43.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.389+0000 7f6b3d1ad700 1 -- 172.21.15.146:0/1761330085 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6b3806c3b0 con 0x7f6b38131cf0 2023-10-03T10:18:43.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.389+0000 7f6b1f7fe700 1 -- 172.21.15.146:0/1761330085 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b30026030 con 0x7f6b38131cf0 2023-10-03T10:18:43.390 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:43.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.391+0000 7f6b3d1ad700 1 -- 172.21.15.146:0/1761330085 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b38131cf0 msgr2=0x7f6b381c0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.391+0000 7f6b3d1ad700 1 --2- 172.21.15.146:0/1761330085 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b38131cf0 0x7f6b381c0770 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f6b3001a000 tx=0x7f6b30004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.391+0000 7f6b3d1ad700 1 -- 172.21.15.146:0/1761330085 shutdown_connections 2023-10-03T10:18:43.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.391+0000 7f6b3d1ad700 1 --2- 172.21.15.146:0/1761330085 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b38131cf0 0x7f6b381c0770 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.391+0000 7f6b3d1ad700 1 --2- 172.21.15.146:0/1761330085 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b3806a770 0x7f6b381c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.391+0000 7f6b3d1ad700 1 --2- 172.21.15.146:0/1761330085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b3806b080 0x7f6b381c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.391+0000 7f6b3d1ad700 1 -- 172.21.15.146:0/1761330085 >> 172.21.15.146:0/1761330085 conn(0x7f6b38099c40 msgr2=0x7f6b38130cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.391+0000 7f6b3d1ad700 1 -- 172.21.15.146:0/1761330085 shutdown_connections 2023-10-03T10:18:43.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.391+0000 7f6b3d1ad700 1 -- 172.21.15.146:0/1761330085 wait complete. 2023-10-03T10:18:43.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:43.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.493+0000 7fa434be3700 1 Processor -- start 2023-10-03T10:18:43.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.493+0000 7fa434be3700 1 -- start start 2023-10-03T10:18:43.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.494+0000 7fa434be3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa430133ad0 0x7fa430133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.494+0000 7fa434be3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4301300a0 0x7fa4301304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.494+0000 7fa434be3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa4301309f0 0x7fa43013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.494+0000 7fa434be3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43006b2d0 con 0x7fa4301309f0 2023-10-03T10:18:43.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.494+0000 7fa434be3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa430133610 con 0x7fa4301300a0 2023-10-03T10:18:43.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.494+0000 7fa434be3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa43009a500 con 0x7fa430133ad0 2023-10-03T10:18:43.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.494+0000 7fa42dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4301300a0 0x7fa4301304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.494+0000 7fa42e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa430133ad0 0x7fa430133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.494+0000 7fa42ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa4301309f0 0x7fa43013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.494+0000 7fa42dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4301300a0 0x7fa4301304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:35588/0 (socket says 172.21.15.146:35588) 2023-10-03T10:18:43.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.494+0000 7fa42ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa4301309f0 0x7fa43013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39328/0 (socket says 172.21.15.146:39328) 2023-10-03T10:18:43.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.494+0000 7fa42e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa430133ad0 0x7fa430133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34976/0 (socket says 172.21.15.146:34976) 2023-10-03T10:18:43.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.494+0000 7fa42dd9b700 1 -- 172.21.15.146:0/854664594 learned_addr learned my addr 172.21.15.146:0/854664594 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:43.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.494+0000 7fa42ed9d700 1 -- 172.21.15.146:0/854664594 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa430133ad0 msgr2=0x7fa430133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:43.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.494+0000 7fa42ed9d700 1 --2- 172.21.15.146:0/854664594 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa430133ad0 0x7fa430133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.494+0000 7fa42ed9d700 1 -- 172.21.15.146:0/854664594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4301300a0 msgr2=0x7fa4301304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:43.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.494+0000 7fa42ed9d700 1 --2- 172.21.15.146:0/854664594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4301300a0 0x7fa4301304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.494+0000 7fa42ed9d700 1 -- 172.21.15.146:0/854664594 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4301338b0 con 0x7fa4301309f0 2023-10-03T10:18:43.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.494+0000 7fa42dd9b700 1 --2- 172.21.15.146:0/854664594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4301300a0 0x7fa4301304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:43.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.494+0000 7fa42e59c700 1 --2- 172.21.15.146:0/854664594 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa430133ad0 0x7fa430133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:43.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.494+0000 7fa42ed9d700 1 --2- 172.21.15.146:0/854664594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4301309f0 0x7fa43013a980 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fa428009d90 tx=0x7fa42800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8947846b47716049 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.495+0000 7fa42d59a700 1 -- 172.21.15.146:0/854664594 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42800e070 con 0x7fa4301309f0 2023-10-03T10:18:43.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.495+0000 7fa42d59a700 1 -- 172.21.15.146:0/854664594 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42800bb20 con 0x7fa4301309f0 2023-10-03T10:18:43.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.495+0000 7fa42d59a700 1 -- 172.21.15.146:0/854664594 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa428012430 con 0x7fa4301309f0 2023-10-03T10:18:43.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.495+0000 7fa434be3700 1 -- 172.21.15.146:0/854664594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4301309f0 msgr2=0x7fa43013a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.495+0000 7fa434be3700 1 --2- 172.21.15.146:0/854664594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4301309f0 0x7fa43013a980 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fa428009d90 tx=0x7fa42800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:43.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.495+0000 7fa434be3700 1 -- 172.21.15.146:0/854664594 shutdown_connections 2023-10-03T10:18:43.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.495+0000 7fa434be3700 1 --2- 172.21.15.146:0/854664594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4301309f0 0x7fa43013a980 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.495+0000 7fa434be3700 1 --2- 172.21.15.146:0/854664594 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa430133ad0 0x7fa430133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.495+0000 7fa434be3700 1 --2- 172.21.15.146:0/854664594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4301300a0 0x7fa4301304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.495+0000 7fa434be3700 1 -- 172.21.15.146:0/854664594 >> 172.21.15.146:0/854664594 conn(0x7fa430099c40 msgr2=0x7fa4300a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.495+0000 7fa434be3700 1 -- 172.21.15.146:0/854664594 shutdown_connections 2023-10-03T10:18:43.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.495+0000 7fa434be3700 1 -- 172.21.15.146:0/854664594 wait complete. 2023-10-03T10:18:43.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.496+0000 7fa434be3700 1 Processor -- start 2023-10-03T10:18:43.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.496+0000 7fa434be3700 1 -- start start 2023-10-03T10:18:43.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.497+0000 7fa434be3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4301300a0 0x7fa43011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.497+0000 7fa434be3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4301309f0 0x7fa43011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.497+0000 7fa434be3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa430133ad0 0x7fa43011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.497+0000 7fa434be3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa430120b10 con 0x7fa4301300a0 2023-10-03T10:18:43.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.497+0000 7fa434be3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43011f530 con 0x7fa430133ad0 2023-10-03T10:18:43.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.497+0000 7fa434be3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4300a2ea0 con 0x7fa4301309f0 2023-10-03T10:18:43.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.497+0000 7fa42e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4301300a0 0x7fa43011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.497+0000 7fa42ed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa430133ad0 0x7fa43011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.497+0000 7fa42e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4301300a0 0x7fa43011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39342/0 (socket says 172.21.15.146:39342) 2023-10-03T10:18:43.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.497+0000 7fa42e59c700 1 -- 172.21.15.146:0/777397767 learned_addr learned my addr 172.21.15.146:0/777397767 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.497+0000 7fa42dd9b700 1 --2- 172.21.15.146:0/777397767 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4301309f0 0x7fa43011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.497+0000 7fa42ed9d700 1 -- 172.21.15.146:0/777397767 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4301309f0 msgr2=0x7fa43011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.497+0000 7fa42ed9d700 1 --2- 172.21.15.146:0/777397767 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4301309f0 0x7fa43011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.497+0000 7fa42ed9d700 1 -- 172.21.15.146:0/777397767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4301300a0 msgr2=0x7fa43011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.497+0000 7fa42ed9d700 1 --2- 172.21.15.146:0/777397767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4301300a0 0x7fa43011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.497+0000 7fa42ed9d700 1 -- 172.21.15.146:0/777397767 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa420009550 con 0x7fa430133ad0 2023-10-03T10:18:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.497+0000 7fa42e59c700 1 --2- 172.21.15.146:0/777397767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4301300a0 0x7fa43011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.497+0000 7fa42ed9d700 1 --2- 172.21.15.146:0/777397767 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa430133ad0 0x7fa43011e4c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa428016000 tx=0x7fa428004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.497+0000 7fa41effd700 1 -- 172.21.15.146:0/777397767 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa428004800 con 0x7fa430133ad0 2023-10-03T10:18:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.497+0000 7fa41effd700 1 -- 172.21.15.146:0/777397767 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa428020070 con 0x7fa430133ad0 2023-10-03T10:18:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.497+0000 7fa434be3700 1 -- 172.21.15.146:0/777397767 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4240094a0 con 0x7fa430133ad0 2023-10-03T10:18:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.498+0000 7fa41effd700 1 -- 172.21.15.146:0/777397767 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4280276c0 con 0x7fa430133ad0 2023-10-03T10:18:43.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.498+0000 7fa434be3700 1 -- 172.21.15.146:0/777397767 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa428009a70 con 0x7fa430133ad0 2023-10-03T10:18:43.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.498+0000 7fa41effd700 1 -- 172.21.15.146:0/777397767 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa428012430 con 0x7fa430133ad0 2023-10-03T10:18:43.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.498+0000 7fa41effd700 1 -- 172.21.15.146:0/777397767 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa428022070 con 0x7fa430133ad0 2023-10-03T10:18:43.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.498+0000 7fa434be3700 1 -- 172.21.15.146:0/777397767 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43004f2a0 con 0x7fa430133ad0 2023-10-03T10:18:43.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.503+0000 7fa41effd700 1 -- 172.21.15.146:0/777397767 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa42801c400 con 0x7fa430133ad0 2023-10-03T10:18:43.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.689+0000 7fa434be3700 1 -- 172.21.15.146:0/777397767 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa43011f020 con 0x7fa430133ad0 2023-10-03T10:18:43.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.689+0000 7fa41effd700 1 -- 172.21.15.146:0/777397767 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa428035090 con 0x7fa430133ad0 2023-10-03T10:18:43.690 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:43.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.691+0000 7fa434be3700 1 -- 172.21.15.146:0/777397767 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa430133ad0 msgr2=0x7fa43011e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.691+0000 7fa434be3700 1 --2- 172.21.15.146:0/777397767 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa430133ad0 0x7fa43011e4c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa428016000 tx=0x7fa428004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.691+0000 7fa434be3700 1 -- 172.21.15.146:0/777397767 shutdown_connections 2023-10-03T10:18:43.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.691+0000 7fa434be3700 1 --2- 172.21.15.146:0/777397767 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa430133ad0 0x7fa43011e4c0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.691+0000 7fa434be3700 1 --2- 172.21.15.146:0/777397767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4301300a0 0x7fa43011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.691+0000 7fa434be3700 1 --2- 172.21.15.146:0/777397767 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa4301309f0 0x7fa43011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.691+0000 7fa434be3700 1 -- 172.21.15.146:0/777397767 >> 172.21.15.146:0/777397767 conn(0x7fa430099c40 msgr2=0x7fa4301320c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.691+0000 7fa434be3700 1 -- 172.21.15.146:0/777397767 shutdown_connections 2023-10-03T10:18:43.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:43.691+0000 7fa434be3700 1 -- 172.21.15.146:0/777397767 wait complete. 2023-10-03T10:18:43.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:44.210 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:44.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.334+0000 7f02a00dd700 1 Processor -- start 2023-10-03T10:18:44.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.334+0000 7f02a00dd700 1 -- start start 2023-10-03T10:18:44.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.335+0000 7f02a00dd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f029806a770 0x7f029806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.335+0000 7f02a00dd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f029809dec0 0x7f029806b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.335+0000 7f02a00dd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0298131a00 0x7f0298131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.335+0000 7f02a00dd700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029806b5c0 con 0x7f029809dec0 2023-10-03T10:18:44.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.335+0000 7f02a00dd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029806e900 con 0x7f029806a770 2023-10-03T10:18:44.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.335+0000 7f02a00dd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f029809d180 con 0x7f0298131a00 2023-10-03T10:18:44.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.335+0000 7f029de79700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f029806a770 0x7f029806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.335+0000 7f029e67a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0298131a00 0x7f0298131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.335+0000 7f029d678700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f029809dec0 0x7f029806b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.335+0000 7f029d678700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f029809dec0 0x7f029806b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53746/0 (socket says 172.21.15.146:53746) 2023-10-03T10:18:44.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.335+0000 7f029e67a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0298131a00 0x7f0298131e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35006/0 (socket says 172.21.15.146:35006) 2023-10-03T10:18:44.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.335+0000 7f029de79700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f029806a770 0x7f029806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50842/0 (socket says 172.21.15.146:50842) 2023-10-03T10:18:44.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.335+0000 7f029d678700 1 -- 172.21.15.146:0/489373576 learned_addr learned my addr 172.21.15.146:0/489373576 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:44.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.335+0000 7f029d678700 1 -- 172.21.15.146:0/489373576 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0298131a00 msgr2=0x7f0298131e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.335+0000 7f029d678700 1 --2- 172.21.15.146:0/489373576 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0298131a00 0x7f0298131e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.335+0000 7f029d678700 1 -- 172.21.15.146:0/489373576 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f029806a770 msgr2=0x7f029806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.335+0000 7f029d678700 1 --2- 172.21.15.146:0/489373576 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f029806a770 0x7f029806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.335+0000 7f029d678700 1 -- 172.21.15.146:0/489373576 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029809e780 con 0x7f029809dec0 2023-10-03T10:18:44.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.335+0000 7f029de79700 1 --2- 172.21.15.146:0/489373576 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f029806a770 0x7f029806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.335+0000 7f029e67a700 1 --2- 172.21.15.146:0/489373576 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0298131a00 0x7f0298131e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.336+0000 7f029d678700 1 --2- 172.21.15.146:0/489373576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f029809dec0 0x7f029806b080 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f02940098f0 tx=0x7f0294009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b948d3d153743a4e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.336+0000 7f029ce77700 1 -- 172.21.15.146:0/489373576 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0294011830 con 0x7f029809dec0 2023-10-03T10:18:44.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.336+0000 7f029ce77700 1 -- 172.21.15.146:0/489373576 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0294011990 con 0x7f029809dec0 2023-10-03T10:18:44.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.336+0000 7f029ce77700 1 -- 172.21.15.146:0/489373576 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0294011d20 con 0x7f029809dec0 2023-10-03T10:18:44.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.336+0000 7f02a00dd700 1 -- 172.21.15.146:0/489373576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f029809dec0 msgr2=0x7f029806b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.336+0000 7f02a00dd700 1 --2- 172.21.15.146:0/489373576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f029809dec0 0x7f029806b080 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f02940098f0 tx=0x7f0294009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:44.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.336+0000 7f02a00dd700 1 -- 172.21.15.146:0/489373576 shutdown_connections 2023-10-03T10:18:44.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.336+0000 7f02a00dd700 1 --2- 172.21.15.146:0/489373576 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f029806a770 0x7f029806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.336+0000 7f02a00dd700 1 --2- 172.21.15.146:0/489373576 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0298131a00 0x7f0298131e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.336+0000 7f02a00dd700 1 --2- 172.21.15.146:0/489373576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f029809dec0 0x7f029806b080 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.336+0000 7f02a00dd700 1 -- 172.21.15.146:0/489373576 >> 172.21.15.146:0/489373576 conn(0x7f0298099c40 msgr2=0x7f02980a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.336+0000 7f02a00dd700 1 -- 172.21.15.146:0/489373576 shutdown_connections 2023-10-03T10:18:44.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.336+0000 7f02a00dd700 1 -- 172.21.15.146:0/489373576 wait complete. 2023-10-03T10:18:44.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.337+0000 7f02a00dd700 1 Processor -- start 2023-10-03T10:18:44.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.337+0000 7f02a00dd700 1 -- start start 2023-10-03T10:18:44.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f02a00dd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f029806a770 0x7f029809a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f02a00dd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f029809dec0 0x7f029809a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f02a00dd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0298131a00 0x7f029809af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f02a00dd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029812d4d0 con 0x7f0298131a00 2023-10-03T10:18:44.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f02a00dd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029811f680 con 0x7f029809dec0 2023-10-03T10:18:44.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f02a00dd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f029811eba0 con 0x7f029806a770 2023-10-03T10:18:44.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f029de79700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f029806a770 0x7f029809a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f029d678700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f029809dec0 0x7f029809a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f029de79700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f029806a770 0x7f029809a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35016/0 (socket says 172.21.15.146:35016) 2023-10-03T10:18:44.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f029de79700 1 -- 172.21.15.146:0/23970990 learned_addr learned my addr 172.21.15.146:0/23970990 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:44.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f029d678700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f029809dec0 0x7f029809a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50850/0 (socket says 172.21.15.146:50850) 2023-10-03T10:18:44.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f029e67a700 1 --2- 172.21.15.146:0/23970990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0298131a00 0x7f029809af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f029de79700 1 -- 172.21.15.146:0/23970990 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f029809dec0 msgr2=0x7f029809a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f029de79700 1 --2- 172.21.15.146:0/23970990 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f029809dec0 0x7f029809a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f029de79700 1 -- 172.21.15.146:0/23970990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0298131a00 msgr2=0x7f029809af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f029de79700 1 --2- 172.21.15.146:0/23970990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0298131a00 0x7f029809af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f029de79700 1 -- 172.21.15.146:0/23970990 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02880094a0 con 0x7f029806a770 2023-10-03T10:18:44.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f029e67a700 1 --2- 172.21.15.146:0/23970990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0298131a00 0x7f029809af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f029de79700 1 --2- 172.21.15.146:0/23970990 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f029806a770 0x7f029809a490 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f028800ebe0 tx=0x7f028800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f028e7fc700 1 -- 172.21.15.146:0/23970990 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0288009780 con 0x7f029806a770 2023-10-03T10:18:44.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f028e7fc700 1 -- 172.21.15.146:0/23970990 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028800c850 con 0x7f029806a770 2023-10-03T10:18:44.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f028e7fc700 1 -- 172.21.15.146:0/23970990 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028800cbe0 con 0x7f029806a770 2023-10-03T10:18:44.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f02a00dd700 1 -- 172.21.15.146:0/23970990 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0290009a70 con 0x7f029806a770 2023-10-03T10:18:44.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.338+0000 7f02a00dd700 1 -- 172.21.15.146:0/23970990 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0294009550 con 0x7f029806a770 2023-10-03T10:18:44.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.339+0000 7f028e7fc700 1 -- 172.21.15.146:0/23970990 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f028800cd40 con 0x7f029806a770 2023-10-03T10:18:44.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.339+0000 7f028e7fc700 1 -- 172.21.15.146:0/23970990 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f028803fbb0 con 0x7f029806a770 2023-10-03T10:18:44.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.339+0000 7f02a00dd700 1 -- 172.21.15.146:0/23970990 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0298130ec0 con 0x7f029806a770 2023-10-03T10:18:44.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.344+0000 7f028e7fc700 1 -- 172.21.15.146:0/23970990 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0288011d90 con 0x7f029806a770 2023-10-03T10:18:44.364 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:44.406 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:44.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.492+0000 7fe7da517700 1 Processor -- start 2023-10-03T10:18:44.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.492+0000 7fe7da517700 1 -- start start 2023-10-03T10:18:44.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.492+0000 7fe7da517700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d41368e0 0x7fe7d4138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.492+0000 7fe7da517700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d4139200 0x7fe7d413b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.492+0000 7fe7da517700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d409a760 con 0x7fe7d4133900 2023-10-03T10:18:44.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.492+0000 7fe7da517700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d41336e0 con 0x7fe7d41368e0 2023-10-03T10:18:44.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.492+0000 7fe7da517700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d409a080 con 0x7fe7d4139200 2023-10-03T10:18:44.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.492+0000 7fe7d3fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe7d4133900 0x7fe7d4133cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48918/0 (socket says 172.21.15.146:48918) 2023-10-03T10:18:44.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.492+0000 7fe7d3fff700 1 -- 172.21.15.146:0/1987414868 learned_addr learned my addr 172.21.15.146:0/1987414868 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:44.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.492+0000 7fe7d8ab4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d4139200 0x7fe7d413b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.493+0000 7fe7d37fe700 1 --2- 172.21.15.146:0/1987414868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d41368e0 0x7fe7d4138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.493+0000 7fe7d2ffd700 1 -- 172.21.15.146:0/1987414868 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131109043 0 0) 0x7fe7d409a760 con 0x7fe7d4133900 2023-10-03T10:18:44.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.493+0000 7fe7d2ffd700 1 -- 172.21.15.146:0/1987414868 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7bc0035b0 con 0x7fe7d4133900 2023-10-03T10:18:44.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.493+0000 7fe7d8ab4700 1 -- 172.21.15.146:0/1987414868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d41368e0 msgr2=0x7fe7d4138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.493+0000 7fe7d8ab4700 1 --2- 172.21.15.146:0/1987414868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d41368e0 0x7fe7d4138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.493+0000 7fe7d8ab4700 1 -- 172.21.15.146:0/1987414868 >> v1:172.21.15.146:6789/0 conn(0x7fe7d4133900 legacy=0x7fe7d4133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.493+0000 7fe7d8ab4700 1 -- 172.21.15.146:0/1987414868 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d40a23e0 con 0x7fe7d4139200 2023-10-03T10:18:44.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.493+0000 7fe7d8ab4700 1 --2- 172.21.15.146:0/1987414868 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d4139200 0x7fe7d413b5e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc009dc0 tx=0x7fe7cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb6fc49ffff0176a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.493+0000 7fe7d2ffd700 1 -- 172.21.15.146:0/1987414868 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc00e070 con 0x7fe7d4139200 2023-10-03T10:18:44.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.493+0000 7fe7d2ffd700 1 -- 172.21.15.146:0/1987414868 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7cc00bb20 con 0x7fe7d4139200 2023-10-03T10:18:44.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.493+0000 7fe7d2ffd700 1 -- 172.21.15.146:0/1987414868 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc00be90 con 0x7fe7d4139200 2023-10-03T10:18:44.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.494+0000 7fe7da517700 1 -- 172.21.15.146:0/1987414868 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d4139200 msgr2=0x7fe7d413b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.494+0000 7fe7da517700 1 --2- 172.21.15.146:0/1987414868 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d4139200 0x7fe7d413b5e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc009dc0 tx=0x7fe7cc00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:44.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.494+0000 7fe7da517700 1 -- 172.21.15.146:0/1987414868 shutdown_connections 2023-10-03T10:18:44.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.494+0000 7fe7da517700 1 --2- 172.21.15.146:0/1987414868 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d4139200 0x7fe7d413b5e0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.494+0000 7fe7da517700 1 --2- 172.21.15.146:0/1987414868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d41368e0 0x7fe7d4138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.494+0000 7fe7da517700 1 -- 172.21.15.146:0/1987414868 >> 172.21.15.146:0/1987414868 conn(0x7fe7d40a2980 msgr2=0x7fe7d40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.494+0000 7fe7da517700 1 -- 172.21.15.146:0/1987414868 shutdown_connections 2023-10-03T10:18:44.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.494+0000 7fe7da517700 1 -- 172.21.15.146:0/1987414868 wait complete. 2023-10-03T10:18:44.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.496+0000 7fe7da517700 1 Processor -- start 2023-10-03T10:18:44.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.496+0000 7fe7da517700 1 -- start start 2023-10-03T10:18:44.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.497+0000 7fe7da517700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d4133900 0x7fe7d4119c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.497+0000 7fe7da517700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d41368e0 0x7fe7d411a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.497+0000 7fe7da517700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d4139200 0x7fe7d411a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.497+0000 7fe7da517700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d4134b60 con 0x7fe7d4139200 2023-10-03T10:18:44.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.497+0000 7fe7da517700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d411d4b0 con 0x7fe7d41368e0 2023-10-03T10:18:44.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.497+0000 7fe7da517700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d411cad0 con 0x7fe7d4133900 2023-10-03T10:18:44.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.497+0000 7fe7d3fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d4133900 0x7fe7d4119c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.497+0000 7fe7d37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d41368e0 0x7fe7d411a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.497+0000 7fe7d3fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d4133900 0x7fe7d4119c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35030/0 (socket says 172.21.15.146:35030) 2023-10-03T10:18:44.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.497+0000 7fe7d37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d41368e0 0x7fe7d411a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50870/0 (socket says 172.21.15.146:50870) 2023-10-03T10:18:44.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.497+0000 7fe7d3fff700 1 -- 172.21.15.146:0/2615483130 learned_addr learned my addr 172.21.15.146:0/2615483130 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:44.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.497+0000 7fe7d8ab4700 1 --2- 172.21.15.146:0/2615483130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d4139200 0x7fe7d411a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.497+0000 7fe7d3fff700 1 -- 172.21.15.146:0/2615483130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d41368e0 msgr2=0x7fe7d411a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.497+0000 7fe7d3fff700 1 --2- 172.21.15.146:0/2615483130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d41368e0 0x7fe7d411a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.497+0000 7fe7d3fff700 1 -- 172.21.15.146:0/2615483130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d4139200 msgr2=0x7fe7d411a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.497+0000 7fe7d3fff700 1 --2- 172.21.15.146:0/2615483130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d4139200 0x7fe7d411a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.497+0000 7fe7d3fff700 1 -- 172.21.15.146:0/2615483130 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc009a70 con 0x7fe7d4133900 2023-10-03T10:18:44.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.497+0000 7fe7d37fe700 1 --2- 172.21.15.146:0/2615483130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d41368e0 0x7fe7d411a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.497+0000 7fe7d8ab4700 1 --2- 172.21.15.146:0/2615483130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d4139200 0x7fe7d411a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.497+0000 7fe7d3fff700 1 --2- 172.21.15.146:0/2615483130 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d4133900 0x7fe7d4119c90 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4001260 tx=0x7fe7c400c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.497+0000 7fe7d0ff9700 1 -- 172.21.15.146:0/2615483130 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c40074e0 con 0x7fe7d4133900 2023-10-03T10:18:44.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.497+0000 7fe7d0ff9700 1 -- 172.21.15.146:0/2615483130 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c4007640 con 0x7fe7d4133900 2023-10-03T10:18:44.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.498+0000 7fe7da517700 1 -- 172.21.15.146:0/2615483130 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d409a2c0 con 0x7fe7d4133900 2023-10-03T10:18:44.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.498+0000 7fe7d0ff9700 1 -- 172.21.15.146:0/2615483130 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4005a50 con 0x7fe7d4133900 2023-10-03T10:18:44.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.498+0000 7fe7da517700 1 -- 172.21.15.146:0/2615483130 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d411deb0 con 0x7fe7d4133900 2023-10-03T10:18:44.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.499+0000 7fe7da517700 1 -- 172.21.15.146:0/2615483130 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d411d0e0 con 0x7fe7d4133900 2023-10-03T10:18:44.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.500+0000 7fe7d0ff9700 1 -- 172.21.15.146:0/2615483130 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe7c4005bb0 con 0x7fe7d4133900 2023-10-03T10:18:44.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.500+0000 7fe7d0ff9700 1 -- 172.21.15.146:0/2615483130 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe7c403eff0 con 0x7fe7d4133900 2023-10-03T10:18:44.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.504+0000 7fe7d0ff9700 1 -- 172.21.15.146:0/2615483130 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe7c401b3b0 con 0x7fe7d4133900 2023-10-03T10:18:44.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.534+0000 7fc0a9fbf700 1 Processor -- start 2023-10-03T10:18:44.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.534+0000 7fc0a9fbf700 1 -- start start 2023-10-03T10:18:44.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.535+0000 7fc0a9fbf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a40a0a70 0x7fc0a40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.535+0000 7fc0a9fbf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a40a1380 0x7fc0a4133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.535+0000 7fc0a9fbf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc0a4133f50 0x7fc0a41343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.535+0000 7fc0a9fbf700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a409e9d0 con 0x7fc0a4133f50 2023-10-03T10:18:44.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.535+0000 7fc0a9fbf700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a409dc00 con 0x7fc0a40a1380 2023-10-03T10:18:44.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.535+0000 7fc0a9fbf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a409dec0 con 0x7fc0a40a0a70 2023-10-03T10:18:44.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.535+0000 7fc0a2ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a40a1380 0x7fc0a4133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.535+0000 7fc0a37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a40a0a70 0x7fc0a40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.535+0000 7fc0a2ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a40a1380 0x7fc0a4133a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50876/0 (socket says 172.21.15.146:50876) 2023-10-03T10:18:44.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.535+0000 7fc0a2ffd700 1 -- 172.21.15.146:0/4222498920 learned_addr learned my addr 172.21.15.146:0/4222498920 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:44.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.535+0000 7fc0a2ffd700 1 -- 172.21.15.146:0/4222498920 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a40a0a70 msgr2=0x7fc0a40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.535+0000 7fc0a2ffd700 1 --2- 172.21.15.146:0/4222498920 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a40a0a70 0x7fc0a40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.535+0000 7fc0a2ffd700 1 -- 172.21.15.146:0/4222498920 >> v2:172.21.15.146:3300/0 conn(0x7fc0a4133f50 msgr2=0x7fc0a41343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.535+0000 7fc0a2ffd700 1 --2- 172.21.15.146:0/4222498920 >> v2:172.21.15.146:3300/0 conn(0x7fc0a4133f50 0x7fc0a41343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.535+0000 7fc0a2ffd700 1 -- 172.21.15.146:0/4222498920 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a409e6a0 con 0x7fc0a40a1380 2023-10-03T10:18:44.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.535+0000 7fc0a37fe700 1 --2- 172.21.15.146:0/4222498920 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a40a0a70 0x7fc0a40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.535+0000 7fc0a2ffd700 1 --2- 172.21.15.146:0/4222498920 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a40a1380 0x7fc0a4133a10 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc0980098f0 tx=0x7fc098009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca9d27767ca26c13 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.535+0000 7fc0a27fc700 1 -- 172.21.15.146:0/4222498920 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098011830 con 0x7fc0a40a1380 2023-10-03T10:18:44.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.535+0000 7fc0a27fc700 1 -- 172.21.15.146:0/4222498920 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc098011990 con 0x7fc0a40a1380 2023-10-03T10:18:44.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.535+0000 7fc0a27fc700 1 -- 172.21.15.146:0/4222498920 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098011d20 con 0x7fc0a40a1380 2023-10-03T10:18:44.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.536+0000 7fc0a9fbf700 1 -- 172.21.15.146:0/4222498920 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a40a1380 msgr2=0x7fc0a4133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.536+0000 7fc0a9fbf700 1 --2- 172.21.15.146:0/4222498920 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a40a1380 0x7fc0a4133a10 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc0980098f0 tx=0x7fc098009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:44.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.536+0000 7fc0a9fbf700 1 -- 172.21.15.146:0/4222498920 shutdown_connections 2023-10-03T10:18:44.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.536+0000 7fc0a9fbf700 1 --2- 172.21.15.146:0/4222498920 >> v2:172.21.15.146:3300/0 conn(0x7fc0a4133f50 0x7fc0a41343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.536+0000 7fc0a9fbf700 1 --2- 172.21.15.146:0/4222498920 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a40a0a70 0x7fc0a40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.536+0000 7fc0a9fbf700 1 --2- 172.21.15.146:0/4222498920 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a40a1380 0x7fc0a4133a10 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.536+0000 7fc0a9fbf700 1 -- 172.21.15.146:0/4222498920 >> 172.21.15.146:0/4222498920 conn(0x7fc0a40a6610 msgr2=0x7fc0a40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.536+0000 7fc0a9fbf700 1 -- 172.21.15.146:0/4222498920 shutdown_connections 2023-10-03T10:18:44.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.536+0000 7fc0a9fbf700 1 -- 172.21.15.146:0/4222498920 wait complete. 2023-10-03T10:18:44.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.537+0000 7fc0a9fbf700 1 Processor -- start 2023-10-03T10:18:44.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.537+0000 7fc0a9fbf700 1 -- start start 2023-10-03T10:18:44.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.538+0000 7fc0a9fbf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a40a0a70 0x7fc0a4122600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.538+0000 7fc0a9fbf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a40a1380 0x7fc0a4122b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.538+0000 7fc0a9fbf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a4133f50 0x7fc0a4123080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.538+0000 7fc0a9fbf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a4125df0 con 0x7fc0a4133f50 2023-10-03T10:18:44.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.538+0000 7fc0a9fbf700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a4123a60 con 0x7fc0a40a1380 2023-10-03T10:18:44.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.538+0000 7fc0a9fbf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a41242d0 con 0x7fc0a40a0a70 2023-10-03T10:18:44.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.538+0000 7fc0a2ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a40a1380 0x7fc0a4122b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.538+0000 7fc0a3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a4133f50 0x7fc0a4123080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.538+0000 7fc0a2ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a40a1380 0x7fc0a4122b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50892/0 (socket says 172.21.15.146:50892) 2023-10-03T10:18:44.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.538+0000 7fc0a2ffd700 1 -- 172.21.15.146:0/1916325383 learned_addr learned my addr 172.21.15.146:0/1916325383 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:44.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.538+0000 7fc0a37fe700 1 --2- 172.21.15.146:0/1916325383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a40a0a70 0x7fc0a4122600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.538+0000 7fc0a2ffd700 1 -- 172.21.15.146:0/1916325383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a40a0a70 msgr2=0x7fc0a4122600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.538+0000 7fc0a2ffd700 1 --2- 172.21.15.146:0/1916325383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a40a0a70 0x7fc0a4122600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.538+0000 7fc0a2ffd700 1 -- 172.21.15.146:0/1916325383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a4133f50 msgr2=0x7fc0a4123080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.538+0000 7fc0a2ffd700 1 --2- 172.21.15.146:0/1916325383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a4133f50 0x7fc0a4123080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.538+0000 7fc0a2ffd700 1 -- 172.21.15.146:0/1916325383 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0940094a0 con 0x7fc0a40a1380 2023-10-03T10:18:44.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.538+0000 7fc0a2ffd700 1 --2- 172.21.15.146:0/1916325383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a40a1380 0x7fc0a4122b40 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fc098013000 tx=0x7fc098004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.538+0000 7fc08bfff700 1 -- 172.21.15.146:0/1916325383 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098004300 con 0x7fc0a40a1380 2023-10-03T10:18:44.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.538+0000 7fc08bfff700 1 -- 172.21.15.146:0/1916325383 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09801f070 con 0x7fc0a40a1380 2023-10-03T10:18:44.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.538+0000 7fc0a9fbf700 1 -- 172.21.15.146:0/1916325383 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc098009550 con 0x7fc0a40a1380 2023-10-03T10:18:44.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.538+0000 7fc08bfff700 1 -- 172.21.15.146:0/1916325383 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0980036a0 con 0x7fc0a40a1380 2023-10-03T10:18:44.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.538+0000 7fc0a9fbf700 1 -- 172.21.15.146:0/1916325383 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a41330d0 con 0x7fc0a40a1380 2023-10-03T10:18:44.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.539+0000 7fc08bfff700 1 -- 172.21.15.146:0/1916325383 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc098021030 con 0x7fc0a40a1380 2023-10-03T10:18:44.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.539+0000 7fc08bfff700 1 -- 172.21.15.146:0/1916325383 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc0980408f0 con 0x7fc0a40a1380 2023-10-03T10:18:44.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.539+0000 7fc0a9fbf700 1 -- 172.21.15.146:0/1916325383 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a404f2a0 con 0x7fc0a40a1380 2023-10-03T10:18:44.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.544+0000 7fc08bfff700 1 -- 172.21.15.146:0/1916325383 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc098015020 con 0x7fc0a40a1380 2023-10-03T10:18:44.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.546+0000 7f02a00dd700 1 -- 172.21.15.146:0/23970990 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0298071ce0 con 0x7f029806a770 2023-10-03T10:18:44.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.546+0000 7f028e7fc700 1 -- 172.21.15.146:0/23970990 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f028802a090 con 0x7f029806a770 2023-10-03T10:18:44.547 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:44.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.548+0000 7f02a00dd700 1 -- 172.21.15.146:0/23970990 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f029806a770 msgr2=0x7f029809a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.548+0000 7f02a00dd700 1 --2- 172.21.15.146:0/23970990 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f029806a770 0x7f029809a490 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f028800ebe0 tx=0x7f028800eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.548+0000 7f02a00dd700 1 -- 172.21.15.146:0/23970990 shutdown_connections 2023-10-03T10:18:44.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.548+0000 7f02a00dd700 1 --2- 172.21.15.146:0/23970990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0298131a00 0x7f029809af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.548+0000 7f02a00dd700 1 --2- 172.21.15.146:0/23970990 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f029806a770 0x7f029809a490 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.548+0000 7f02a00dd700 1 --2- 172.21.15.146:0/23970990 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f029809dec0 0x7f029809a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.548+0000 7f02a00dd700 1 -- 172.21.15.146:0/23970990 >> 172.21.15.146:0/23970990 conn(0x7f0298099c40 msgr2=0x7f029812eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.548+0000 7f02a00dd700 1 -- 172.21.15.146:0/23970990 shutdown_connections 2023-10-03T10:18:44.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.548+0000 7f02a00dd700 1 -- 172.21.15.146:0/23970990 wait complete. 2023-10-03T10:18:44.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:44.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.701+0000 7fe7da517700 1 -- 172.21.15.146:0/2615483130 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe7d404f2a0 con 0x7fe7d4133900 2023-10-03T10:18:44.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.701+0000 7fe7d0ff9700 1 -- 172.21.15.146:0/2615483130 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe7c4017070 con 0x7fe7d4133900 2023-10-03T10:18:44.702 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:44.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.704+0000 7fe7da517700 1 -- 172.21.15.146:0/2615483130 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d4133900 msgr2=0x7fe7d4119c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.704+0000 7fe7da517700 1 --2- 172.21.15.146:0/2615483130 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d4133900 0x7fe7d4119c90 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4001260 tx=0x7fe7c400c9e0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.704+0000 7fe7da517700 1 -- 172.21.15.146:0/2615483130 shutdown_connections 2023-10-03T10:18:44.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.704+0000 7fe7da517700 1 --2- 172.21.15.146:0/2615483130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d4139200 0x7fe7d411a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.704+0000 7fe7da517700 1 --2- 172.21.15.146:0/2615483130 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe7d4133900 0x7fe7d4119c90 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.704+0000 7fe7da517700 1 --2- 172.21.15.146:0/2615483130 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7d41368e0 0x7fe7d411a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.704+0000 7fe7da517700 1 -- 172.21.15.146:0/2615483130 >> 172.21.15.146:0/2615483130 conn(0x7fe7d40a2980 msgr2=0x7fe7d4136dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.704+0000 7fe7da517700 1 -- 172.21.15.146:0/2615483130 shutdown_connections 2023-10-03T10:18:44.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.704+0000 7fe7da517700 1 -- 172.21.15.146:0/2615483130 wait complete. 2023-10-03T10:18:44.706 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:44.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:44.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.742+0000 7fc0a9fbf700 1 -- 172.21.15.146:0/1916325383 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc0a4133d30 con 0x7fc0a40a1380 2023-10-03T10:18:44.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.742+0000 7fc08bfff700 1 -- 172.21.15.146:0/1916325383 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc0980199a0 con 0x7fc0a40a1380 2023-10-03T10:18:44.743 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:44.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.746+0000 7fc0a9fbf700 1 -- 172.21.15.146:0/1916325383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a40a1380 msgr2=0x7fc0a4122b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.746+0000 7fc0a9fbf700 1 --2- 172.21.15.146:0/1916325383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a40a1380 0x7fc0a4122b40 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fc098013000 tx=0x7fc098004750 comp rx=0 tx=0).stop 2023-10-03T10:18:44.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.746+0000 7fc0a9fbf700 1 -- 172.21.15.146:0/1916325383 shutdown_connections 2023-10-03T10:18:44.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.746+0000 7fc0a9fbf700 1 --2- 172.21.15.146:0/1916325383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a4133f50 0x7fc0a4123080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.746+0000 7fc0a9fbf700 1 --2- 172.21.15.146:0/1916325383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a40a0a70 0x7fc0a4122600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.746+0000 7fc0a9fbf700 1 --2- 172.21.15.146:0/1916325383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a40a1380 0x7fc0a4122b40 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.746+0000 7fc0a9fbf700 1 -- 172.21.15.146:0/1916325383 >> 172.21.15.146:0/1916325383 conn(0x7fc0a40a6610 msgr2=0x7fc0a409f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.746+0000 7fc0a9fbf700 1 -- 172.21.15.146:0/1916325383 shutdown_connections 2023-10-03T10:18:44.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.746+0000 7fc0a9fbf700 1 -- 172.21.15.146:0/1916325383 wait complete. 2023-10-03T10:18:44.763 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:44.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.836+0000 7fb897dad700 1 Processor -- start 2023-10-03T10:18:44.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.837+0000 7fb897dad700 1 -- start start 2023-10-03T10:18:44.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.837+0000 7fb897dad700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb890133ad0 0x7fb890133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.837+0000 7fb897dad700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8901300a0 0x7fb8901304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.837+0000 7fb897dad700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8901309f0 0x7fb89013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.837+0000 7fb897dad700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb89006b2d0 con 0x7fb8901300a0 2023-10-03T10:18:44.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.837+0000 7fb897dad700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb890133610 con 0x7fb8901309f0 2023-10-03T10:18:44.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.837+0000 7fb897dad700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb89009a500 con 0x7fb890133ad0 2023-10-03T10:18:44.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.837+0000 7fb89634a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8901309f0 0x7fb89013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.837+0000 7fb895348700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8901300a0 0x7fb8901304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.837+0000 7fb895b49700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb890133ad0 0x7fb890133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.837+0000 7fb895b49700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb890133ad0 0x7fb890133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35042/0 (socket says 172.21.15.146:35042) 2023-10-03T10:18:44.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.837+0000 7fb89634a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8901309f0 0x7fb89013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50906/0 (socket says 172.21.15.146:50906) 2023-10-03T10:18:44.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.837+0000 7fb895b49700 1 -- 172.21.15.146:0/3399334581 learned_addr learned my addr 172.21.15.146:0/3399334581 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:44.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.837+0000 7fb895348700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8901300a0 0x7fb8901304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53788/0 (socket says 172.21.15.146:53788) 2023-10-03T10:18:44.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.837+0000 7fb89634a700 1 -- 172.21.15.146:0/3399334581 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb890133ad0 msgr2=0x7fb890133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.837+0000 7fb89634a700 1 --2- 172.21.15.146:0/3399334581 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb890133ad0 0x7fb890133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.837+0000 7fb89634a700 1 -- 172.21.15.146:0/3399334581 >> v2:172.21.15.146:3300/0 conn(0x7fb8901300a0 msgr2=0x7fb8901304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.837+0000 7fb89634a700 1 --2- 172.21.15.146:0/3399334581 >> v2:172.21.15.146:3300/0 conn(0x7fb8901300a0 0x7fb8901304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.837+0000 7fb89634a700 1 -- 172.21.15.146:0/3399334581 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8901338b0 con 0x7fb8901309f0 2023-10-03T10:18:44.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.837+0000 7fb895b49700 1 --2- 172.21.15.146:0/3399334581 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb890133ad0 0x7fb890133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.838+0000 7fb895348700 1 --2- 172.21.15.146:0/3399334581 >> v2:172.21.15.146:3300/0 conn(0x7fb8901300a0 0x7fb8901304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.838+0000 7fb89634a700 1 --2- 172.21.15.146:0/3399334581 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8901309f0 0x7fb89013a980 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fb888009d90 tx=0x7fb88800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e13c4458f268c440 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.838+0000 7fb894b47700 1 -- 172.21.15.146:0/3399334581 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88800e070 con 0x7fb8901309f0 2023-10-03T10:18:44.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.838+0000 7fb894b47700 1 -- 172.21.15.146:0/3399334581 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88800bb20 con 0x7fb8901309f0 2023-10-03T10:18:44.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.838+0000 7fb894b47700 1 -- 172.21.15.146:0/3399334581 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb888012430 con 0x7fb8901309f0 2023-10-03T10:18:44.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.838+0000 7fb897dad700 1 -- 172.21.15.146:0/3399334581 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8901309f0 msgr2=0x7fb89013a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.838+0000 7fb897dad700 1 --2- 172.21.15.146:0/3399334581 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8901309f0 0x7fb89013a980 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fb888009d90 tx=0x7fb88800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:44.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.838+0000 7fb897dad700 1 -- 172.21.15.146:0/3399334581 shutdown_connections 2023-10-03T10:18:44.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.838+0000 7fb897dad700 1 --2- 172.21.15.146:0/3399334581 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8901309f0 0x7fb89013a980 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.838+0000 7fb897dad700 1 --2- 172.21.15.146:0/3399334581 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb890133ad0 0x7fb890133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.838+0000 7fb897dad700 1 --2- 172.21.15.146:0/3399334581 >> v2:172.21.15.146:3300/0 conn(0x7fb8901300a0 0x7fb8901304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.838+0000 7fb897dad700 1 -- 172.21.15.146:0/3399334581 >> 172.21.15.146:0/3399334581 conn(0x7fb890099c40 msgr2=0x7fb8900a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.838+0000 7fb897dad700 1 -- 172.21.15.146:0/3399334581 shutdown_connections 2023-10-03T10:18:44.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.838+0000 7fb897dad700 1 -- 172.21.15.146:0/3399334581 wait complete. 2023-10-03T10:18:44.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.839+0000 7fb897dad700 1 Processor -- start 2023-10-03T10:18:44.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.839+0000 7fb897dad700 1 -- start start 2023-10-03T10:18:44.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.840+0000 7fb897dad700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8901300a0 0x7fb89011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.840+0000 7fb897dad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8901309f0 0x7fb89011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.840+0000 7fb897dad700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb890133ad0 0x7fb89011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.840+0000 7fb897dad700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89011f020 con 0x7fb8901309f0 2023-10-03T10:18:44.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.840+0000 7fb897dad700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89012de80 con 0x7fb8901300a0 2023-10-03T10:18:44.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.840+0000 7fb897dad700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900a33e0 con 0x7fb890133ad0 2023-10-03T10:18:44.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.840+0000 7fb895b49700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8901300a0 0x7fb89011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.840+0000 7fb895b49700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8901300a0 0x7fb89011da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50918/0 (socket says 172.21.15.146:50918) 2023-10-03T10:18:44.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.840+0000 7fb895b49700 1 -- 172.21.15.146:0/4275947990 learned_addr learned my addr 172.21.15.146:0/4275947990 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:44.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.840+0000 7fb895348700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8901309f0 0x7fb89011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.840+0000 7fb89634a700 1 --2- 172.21.15.146:0/4275947990 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb890133ad0 0x7fb89011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.840+0000 7fb895b49700 1 -- 172.21.15.146:0/4275947990 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb890133ad0 msgr2=0x7fb89011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.840+0000 7fb895b49700 1 --2- 172.21.15.146:0/4275947990 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb890133ad0 0x7fb89011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.840+0000 7fb895b49700 1 -- 172.21.15.146:0/4275947990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8901309f0 msgr2=0x7fb89011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.840+0000 7fb895b49700 1 --2- 172.21.15.146:0/4275947990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8901309f0 0x7fb89011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.840+0000 7fb895b49700 1 -- 172.21.15.146:0/4275947990 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88c0094a0 con 0x7fb8901300a0 2023-10-03T10:18:44.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.840+0000 7fb895348700 1 --2- 172.21.15.146:0/4275947990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8901309f0 0x7fb89011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.840+0000 7fb895b49700 1 --2- 172.21.15.146:0/4275947990 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8901300a0 0x7fb89011da40 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb88000ebe0 tx=0x7fb88000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.840+0000 7fb8867fc700 1 -- 172.21.15.146:0/4275947990 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88000c850 con 0x7fb8901300a0 2023-10-03T10:18:44.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.840+0000 7fb8867fc700 1 -- 172.21.15.146:0/4275947990 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88000c9b0 con 0x7fb8901300a0 2023-10-03T10:18:44.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.840+0000 7fb897dad700 1 -- 172.21.15.146:0/4275947990 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb880009550 con 0x7fb8901300a0 2023-10-03T10:18:44.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.840+0000 7fb8867fc700 1 -- 172.21.15.146:0/4275947990 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88000cd40 con 0x7fb8901300a0 2023-10-03T10:18:44.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.841+0000 7fb897dad700 1 -- 172.21.15.146:0/4275947990 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb888009a70 con 0x7fb8901300a0 2023-10-03T10:18:44.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.841+0000 7fb8867fc700 1 -- 172.21.15.146:0/4275947990 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb880013470 con 0x7fb8901300a0 2023-10-03T10:18:44.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.841+0000 7fb8867fc700 1 -- 172.21.15.146:0/4275947990 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb88003fb80 con 0x7fb8901300a0 2023-10-03T10:18:44.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.841+0000 7fb897dad700 1 -- 172.21.15.146:0/4275947990 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb89004f2a0 con 0x7fb8901300a0 2023-10-03T10:18:44.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:44.846+0000 7fb8867fc700 1 -- 172.21.15.146:0/4275947990 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb88003fe60 con 0x7fb8901300a0 2023-10-03T10:18:45.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.031+0000 7fb897dad700 1 -- 172.21.15.146:0/4275947990 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb89011fd60 con 0x7fb8901300a0 2023-10-03T10:18:45.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.031+0000 7fb8867fc700 1 -- 172.21.15.146:0/4275947990 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb88001b3b0 con 0x7fb8901300a0 2023-10-03T10:18:45.032 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.033+0000 7fb897dad700 1 -- 172.21.15.146:0/4275947990 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8901300a0 msgr2=0x7fb89011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.033+0000 7fb897dad700 1 --2- 172.21.15.146:0/4275947990 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8901300a0 0x7fb89011da40 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb88000ebe0 tx=0x7fb88000eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.033+0000 7fb897dad700 1 -- 172.21.15.146:0/4275947990 shutdown_connections 2023-10-03T10:18:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.033+0000 7fb897dad700 1 --2- 172.21.15.146:0/4275947990 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb890133ad0 0x7fb89011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.033+0000 7fb897dad700 1 --2- 172.21.15.146:0/4275947990 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8901300a0 0x7fb89011da40 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.033+0000 7fb897dad700 1 --2- 172.21.15.146:0/4275947990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8901309f0 0x7fb89011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.033+0000 7fb897dad700 1 -- 172.21.15.146:0/4275947990 >> 172.21.15.146:0/4275947990 conn(0x7fb890099c40 msgr2=0x7fb890132b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.033+0000 7fb897dad700 1 -- 172.21.15.146:0/4275947990 shutdown_connections 2023-10-03T10:18:45.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.033+0000 7fb897dad700 1 -- 172.21.15.146:0/4275947990 wait complete. 2023-10-03T10:18:45.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:45.562 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.685+0000 7f7d5f870700 1 Processor -- start 2023-10-03T10:18:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.686+0000 7f7d5f870700 1 -- start start 2023-10-03T10:18:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.686+0000 7f7d5f870700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d58133ad0 0x7f7d58133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.686+0000 7f7d5f870700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7d581300a0 0x7f7d581304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.686+0000 7f7d5f870700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d581309f0 0x7f7d5813a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.686+0000 7f7d5f870700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5806b2d0 con 0x7f7d581300a0 2023-10-03T10:18:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.686+0000 7f7d5f870700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d58133610 con 0x7f7d58133ad0 2023-10-03T10:18:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.686+0000 7f7d5f870700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5809a500 con 0x7f7d581309f0 2023-10-03T10:18:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.686+0000 7f7d5ce0b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7d581300a0 0x7f7d581304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.686+0000 7f7d5d60c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d58133ad0 0x7f7d58133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.686+0000 7f7d5de0d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d581309f0 0x7f7d5813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.686+0000 7f7d5ce0b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7d581300a0 0x7f7d581304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53808/0 (socket says 172.21.15.146:53808) 2023-10-03T10:18:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.686+0000 7f7d5d60c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d58133ad0 0x7f7d58133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50920/0 (socket says 172.21.15.146:50920) 2023-10-03T10:18:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.686+0000 7f7d5ce0b700 1 -- 172.21.15.146:0/3264059353 learned_addr learned my addr 172.21.15.146:0/3264059353 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.686+0000 7f7d5ce0b700 1 -- 172.21.15.146:0/3264059353 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d581309f0 msgr2=0x7f7d5813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.686+0000 7f7d5ce0b700 1 --2- 172.21.15.146:0/3264059353 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d581309f0 0x7f7d5813a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.686+0000 7f7d5ce0b700 1 -- 172.21.15.146:0/3264059353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d58133ad0 msgr2=0x7f7d58133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.686+0000 7f7d5ce0b700 1 --2- 172.21.15.146:0/3264059353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d58133ad0 0x7f7d58133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.687+0000 7f7d5ce0b700 1 -- 172.21.15.146:0/3264059353 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d581338b0 con 0x7f7d581300a0 2023-10-03T10:18:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.687+0000 7f7d5d60c700 1 --2- 172.21.15.146:0/3264059353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d58133ad0 0x7f7d58133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.687+0000 7f7d5de0d700 1 --2- 172.21.15.146:0/3264059353 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d581309f0 0x7f7d5813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.687+0000 7f7d5ce0b700 1 --2- 172.21.15.146:0/3264059353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d581300a0 0x7f7d581304b0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f7d540098f0 tx=0x7f7d54009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b4ccd849166b7d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.687+0000 7f7d4ffff700 1 -- 172.21.15.146:0/3264059353 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d54011830 con 0x7f7d581300a0 2023-10-03T10:18:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.687+0000 7f7d4ffff700 1 -- 172.21.15.146:0/3264059353 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d54011990 con 0x7f7d581300a0 2023-10-03T10:18:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.687+0000 7f7d4ffff700 1 -- 172.21.15.146:0/3264059353 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d54011d20 con 0x7f7d581300a0 2023-10-03T10:18:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.687+0000 7f7d5f870700 1 -- 172.21.15.146:0/3264059353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d581300a0 msgr2=0x7f7d581304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.687+0000 7f7d5f870700 1 --2- 172.21.15.146:0/3264059353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d581300a0 0x7f7d581304b0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f7d540098f0 tx=0x7f7d54009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:45.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.687+0000 7f7d5f870700 1 -- 172.21.15.146:0/3264059353 shutdown_connections 2023-10-03T10:18:45.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.687+0000 7f7d5f870700 1 --2- 172.21.15.146:0/3264059353 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d58133ad0 0x7f7d58133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.687+0000 7f7d5f870700 1 --2- 172.21.15.146:0/3264059353 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d581309f0 0x7f7d5813a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.687+0000 7f7d5f870700 1 --2- 172.21.15.146:0/3264059353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d581300a0 0x7f7d581304b0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.687+0000 7f7d5f870700 1 -- 172.21.15.146:0/3264059353 >> 172.21.15.146:0/3264059353 conn(0x7f7d58099c40 msgr2=0x7f7d580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:45.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.688+0000 7f7d5f870700 1 -- 172.21.15.146:0/3264059353 shutdown_connections 2023-10-03T10:18:45.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.688+0000 7f7d5f870700 1 -- 172.21.15.146:0/3264059353 wait complete. 2023-10-03T10:18:45.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.689+0000 7f7d5f870700 1 Processor -- start 2023-10-03T10:18:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.689+0000 7f7d5f870700 1 -- start start 2023-10-03T10:18:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.689+0000 7f7d5f870700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d581300a0 0x7f7d5811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.689+0000 7f7d5f870700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d581309f0 0x7f7d5811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.689+0000 7f7d5f870700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d58133ad0 0x7f7d5811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.689+0000 7f7d5f870700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5811fda0 con 0x7f7d581309f0 2023-10-03T10:18:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.689+0000 7f7d5f870700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5812d8f0 con 0x7f7d581300a0 2023-10-03T10:18:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.689+0000 7f7d5f870700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5811ffa0 con 0x7f7d58133ad0 2023-10-03T10:18:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.689+0000 7f7d5d60c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d581300a0 0x7f7d5811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.689+0000 7f7d5d60c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d581300a0 0x7f7d5811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50934/0 (socket says 172.21.15.146:50934) 2023-10-03T10:18:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.690+0000 7f7d5d60c700 1 -- 172.21.15.146:0/249308930 learned_addr learned my addr 172.21.15.146:0/249308930 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.690+0000 7f7d5de0d700 1 --2- 172.21.15.146:0/249308930 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d58133ad0 0x7f7d5811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.690+0000 7f7d5ce0b700 1 --2- 172.21.15.146:0/249308930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d581309f0 0x7f7d5811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.690+0000 7f7d5d60c700 1 -- 172.21.15.146:0/249308930 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d58133ad0 msgr2=0x7f7d5811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.690+0000 7f7d5d60c700 1 --2- 172.21.15.146:0/249308930 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d58133ad0 0x7f7d5811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.690+0000 7f7d5d60c700 1 -- 172.21.15.146:0/249308930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d581309f0 msgr2=0x7f7d5811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.690+0000 7f7d5d60c700 1 --2- 172.21.15.146:0/249308930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d581309f0 0x7f7d5811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.690+0000 7f7d5d60c700 1 -- 172.21.15.146:0/249308930 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d50009a70 con 0x7f7d581300a0 2023-10-03T10:18:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.690+0000 7f7d5de0d700 1 --2- 172.21.15.146:0/249308930 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d58133ad0 0x7f7d5811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.690+0000 7f7d5d60c700 1 --2- 172.21.15.146:0/249308930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d581300a0 0x7f7d5811da40 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800ebe0 tx=0x7f7d4800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.690+0000 7f7d4dffb700 1 -- 172.21.15.146:0/249308930 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48009800 con 0x7f7d581300a0 2023-10-03T10:18:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.690+0000 7f7d4dffb700 1 -- 172.21.15.146:0/249308930 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4800c850 con 0x7f7d581300a0 2023-10-03T10:18:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.690+0000 7f7d5f870700 1 -- 172.21.15.146:0/249308930 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d480094a0 con 0x7f7d581300a0 2023-10-03T10:18:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.690+0000 7f7d4dffb700 1 -- 172.21.15.146:0/249308930 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4800cbc0 con 0x7f7d581300a0 2023-10-03T10:18:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.690+0000 7f7d5f870700 1 -- 172.21.15.146:0/249308930 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d54009550 con 0x7f7d581300a0 2023-10-03T10:18:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.691+0000 7f7d4dffb700 1 -- 172.21.15.146:0/249308930 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d4800cd20 con 0x7f7d581300a0 2023-10-03T10:18:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.691+0000 7f7d5f870700 1 -- 172.21.15.146:0/249308930 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5804f2a0 con 0x7f7d581300a0 2023-10-03T10:18:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.691+0000 7f7d4dffb700 1 -- 172.21.15.146:0/249308930 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7d4803f710 con 0x7f7d581300a0 2023-10-03T10:18:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.696+0000 7f7d4dffb700 1 -- 172.21.15.146:0/249308930 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d4801bde0 con 0x7f7d581300a0 2023-10-03T10:18:45.719 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:45.764 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:45.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.851+0000 7fd2e8b58700 1 Processor -- start 2023-10-03T10:18:45.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.851+0000 7fd2e8b58700 1 -- start start 2023-10-03T10:18:45.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.852+0000 7fd2e8b58700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd2e409e340 0x7fd2e41359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.852+0000 7fd2e8b58700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2e4135f20 0x7fd2e4138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.852+0000 7fd2e8b58700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e409aaa0 con 0x7fd2e409d860 2023-10-03T10:18:45.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.852+0000 7fd2e8b58700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e409e730 con 0x7fd2e409e340 2023-10-03T10:18:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.852+0000 7fd2e8b58700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e409f870 con 0x7fd2e4135f20 2023-10-03T10:18:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.852+0000 7fd2e1d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd2e409e340 0x7fd2e41359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.852+0000 7fd2e1d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd2e409e340 0x7fd2e41359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53822/0 (socket says 172.21.15.146:53822) 2023-10-03T10:18:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.852+0000 7fd2e259c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd2e409d860 0x7fd2e409dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48922/0 (socket says 172.21.15.146:48922) 2023-10-03T10:18:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.852+0000 7fd2e1d9b700 1 -- 172.21.15.146:0/4234570105 learned_addr learned my addr 172.21.15.146:0/4234570105 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.852+0000 7fd2e2d9d700 1 --2- 172.21.15.146:0/4234570105 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2e4135f20 0x7fd2e4138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.852+0000 7fd2e1d9b700 1 -- 172.21.15.146:0/4234570105 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2e4135f20 msgr2=0x7fd2e4138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.852+0000 7fd2e1d9b700 1 --2- 172.21.15.146:0/4234570105 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2e4135f20 0x7fd2e4138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.852+0000 7fd2e1d9b700 1 -- 172.21.15.146:0/4234570105 >> v1:172.21.15.146:6789/0 conn(0x7fd2e409d860 legacy=0x7fd2e409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.852+0000 7fd2e159a700 1 -- 172.21.15.146:0/4234570105 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355170981 0 0) 0x7fd2e409aaa0 con 0x7fd2e409d860 2023-10-03T10:18:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.853+0000 7fd2e1d9b700 1 -- 172.21.15.146:0/4234570105 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e409b360 con 0x7fd2e409e340 2023-10-03T10:18:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.853+0000 7fd2e1d9b700 1 --2- 172.21.15.146:0/4234570105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2e409e340 0x7fd2e41359e0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80098f0 tx=0x7fd2d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8b477a31d81edb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.853+0000 7fd2e159a700 1 -- 172.21.15.146:0/4234570105 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8011830 con 0x7fd2e409e340 2023-10-03T10:18:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.853+0000 7fd2e159a700 1 -- 172.21.15.146:0/4234570105 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d8011990 con 0x7fd2e409e340 2023-10-03T10:18:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.853+0000 7fd2e159a700 1 -- 172.21.15.146:0/4234570105 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8011d20 con 0x7fd2e409e340 2023-10-03T10:18:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.853+0000 7fd2e8b58700 1 -- 172.21.15.146:0/4234570105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2e409e340 msgr2=0x7fd2e41359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.853+0000 7fd2e8b58700 1 --2- 172.21.15.146:0/4234570105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2e409e340 0x7fd2e41359e0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80098f0 tx=0x7fd2d8009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.854+0000 7fd2e8b58700 1 -- 172.21.15.146:0/4234570105 shutdown_connections 2023-10-03T10:18:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.854+0000 7fd2e8b58700 1 --2- 172.21.15.146:0/4234570105 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2e4135f20 0x7fd2e4138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.854+0000 7fd2e8b58700 1 --2- 172.21.15.146:0/4234570105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2e409e340 0x7fd2e41359e0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.854+0000 7fd2e8b58700 1 -- 172.21.15.146:0/4234570105 >> 172.21.15.146:0/4234570105 conn(0x7fd2e4099c40 msgr2=0x7fd2e40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.854+0000 7fd2e8b58700 1 -- 172.21.15.146:0/4234570105 shutdown_connections 2023-10-03T10:18:45.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.854+0000 7fd2e8b58700 1 -- 172.21.15.146:0/4234570105 wait complete. 2023-10-03T10:18:45.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.855+0000 7fd2e8b58700 1 Processor -- start 2023-10-03T10:18:45.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.855+0000 7fd2e8b58700 1 -- start start 2023-10-03T10:18:45.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.856+0000 7fd2e8b58700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2e409d860 0x7fd2e411c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.856+0000 7fd2e8b58700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2e409e340 0x7fd2e411c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.856+0000 7fd2e8b58700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2e4135f20 0x7fd2e411cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.856+0000 7fd2e8b58700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e40a2050 con 0x7fd2e4135f20 2023-10-03T10:18:45.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.856+0000 7fd2e8b58700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e409c8b0 con 0x7fd2e409d860 2023-10-03T10:18:45.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.856+0000 7fd2e8b58700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e411f5d0 con 0x7fd2e409e340 2023-10-03T10:18:45.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.856+0000 7fd2e259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2e409d860 0x7fd2e411c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.856+0000 7fd2e1d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2e409e340 0x7fd2e411c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.856+0000 7fd2e1d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2e409e340 0x7fd2e411c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35082/0 (socket says 172.21.15.146:35082) 2023-10-03T10:18:45.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.856+0000 7fd2e259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2e409d860 0x7fd2e411c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50944/0 (socket says 172.21.15.146:50944) 2023-10-03T10:18:45.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.856+0000 7fd2e1d9b700 1 -- 172.21.15.146:0/3175520197 learned_addr learned my addr 172.21.15.146:0/3175520197 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:45.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.856+0000 7fd2e2d9d700 1 --2- 172.21.15.146:0/3175520197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2e4135f20 0x7fd2e411cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.856+0000 7fd2e1d9b700 1 -- 172.21.15.146:0/3175520197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2e409d860 msgr2=0x7fd2e411c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.856+0000 7fd2e1d9b700 1 --2- 172.21.15.146:0/3175520197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2e409d860 0x7fd2e411c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.856+0000 7fd2e1d9b700 1 -- 172.21.15.146:0/3175520197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2e4135f20 msgr2=0x7fd2e411cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.856+0000 7fd2e1d9b700 1 --2- 172.21.15.146:0/3175520197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2e4135f20 0x7fd2e411cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.856+0000 7fd2e1d9b700 1 -- 172.21.15.146:0/3175520197 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d8009550 con 0x7fd2e409e340 2023-10-03T10:18:45.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.856+0000 7fd2e259c700 1 --2- 172.21.15.146:0/3175520197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2e409d860 0x7fd2e411c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:45.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.856+0000 7fd2e1d9b700 1 --2- 172.21.15.146:0/3175520197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2e409e340 0x7fd2e411c8b0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8000c00 tx=0x7fd2d8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:45.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.857+0000 7fd2d2ffd700 1 -- 172.21.15.146:0/3175520197 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d801a910 con 0x7fd2e409e340 2023-10-03T10:18:45.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.857+0000 7fd2d2ffd700 1 -- 172.21.15.146:0/3175520197 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d801f070 con 0x7fd2e409e340 2023-10-03T10:18:45.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.857+0000 7fd2e8b58700 1 -- 172.21.15.146:0/3175520197 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e411fb60 con 0x7fd2e409e340 2023-10-03T10:18:45.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.857+0000 7fd2d2ffd700 1 -- 172.21.15.146:0/3175520197 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d801ac70 con 0x7fd2e409e340 2023-10-03T10:18:45.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.857+0000 7fd2e8b58700 1 -- 172.21.15.146:0/3175520197 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e41205d0 con 0x7fd2e409e340 2023-10-03T10:18:45.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.857+0000 7fd2d2ffd700 1 -- 172.21.15.146:0/3175520197 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd2d801b430 con 0x7fd2e409e340 2023-10-03T10:18:45.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.858+0000 7fd2d2ffd700 1 -- 172.21.15.146:0/3175520197 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd2d80407d0 con 0x7fd2e409e340 2023-10-03T10:18:45.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.858+0000 7fd2e8b58700 1 -- 172.21.15.146:0/3175520197 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e411f180 con 0x7fd2e409e340 2023-10-03T10:18:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.862+0000 7fd2d2ffd700 1 -- 172.21.15.146:0/3175520197 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd2d8015080 con 0x7fd2e409e340 2023-10-03T10:18:45.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.893+0000 7f7d5f870700 1 -- 172.21.15.146:0/249308930 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7d58120880 con 0x7f7d581300a0 2023-10-03T10:18:45.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.893+0000 7f7d4dffb700 1 -- 172.21.15.146:0/249308930 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7d48021070 con 0x7f7d581300a0 2023-10-03T10:18:45.894 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:45.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.895+0000 7f7d5f870700 1 -- 172.21.15.146:0/249308930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d581300a0 msgr2=0x7f7d5811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.895+0000 7f7d5f870700 1 --2- 172.21.15.146:0/249308930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d581300a0 0x7f7d5811da40 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800ebe0 tx=0x7f7d4800eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.896+0000 7f7d5f870700 1 -- 172.21.15.146:0/249308930 shutdown_connections 2023-10-03T10:18:45.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.896+0000 7f7d5f870700 1 --2- 172.21.15.146:0/249308930 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7d58133ad0 0x7f7d5811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.896+0000 7f7d5f870700 1 --2- 172.21.15.146:0/249308930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d581300a0 0x7f7d5811da40 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.896+0000 7f7d5f870700 1 --2- 172.21.15.146:0/249308930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d581309f0 0x7f7d5811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.896+0000 7f7d5f870700 1 -- 172.21.15.146:0/249308930 >> 172.21.15.146:0/249308930 conn(0x7f7d58099c40 msgr2=0x7f7d5812e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:45.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.896+0000 7f7d5f870700 1 -- 172.21.15.146:0/249308930 shutdown_connections 2023-10-03T10:18:45.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.896+0000 7f7d5f870700 1 -- 172.21.15.146:0/249308930 wait complete. 2023-10-03T10:18:45.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.906+0000 7fb827c12700 1 Processor -- start 2023-10-03T10:18:45.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.907+0000 7fb827c12700 1 -- start start 2023-10-03T10:18:45.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.907+0000 7fb827c12700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb820136960 0x7fb820138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.907+0000 7fb827c12700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb820139280 0x7fb82013b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.907+0000 7fb827c12700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb82006b2d0 con 0x7fb820133ad0 2023-10-03T10:18:45.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.907+0000 7fb827c12700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8201345b0 con 0x7fb820136960 2023-10-03T10:18:45.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.907+0000 7fb827c12700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb820133610 con 0x7fb820139280 2023-10-03T10:18:45.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.907+0000 7fb8261af700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb820139280 0x7fb82013b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.907+0000 7fb8251ad700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb820136960 0x7fb820138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.907+0000 7fb8251ad700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb820136960 0x7fb820138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50956/0 (socket says 172.21.15.146:50956) 2023-10-03T10:18:45.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.907+0000 7fb8261af700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb820139280 0x7fb82013b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35088/0 (socket says 172.21.15.146:35088) 2023-10-03T10:18:45.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.907+0000 7fb8251ad700 1 -- 172.21.15.146:0/2746540931 learned_addr learned my addr 172.21.15.146:0/2746540931 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:45.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.908+0000 7fb8251ad700 1 -- 172.21.15.146:0/2746540931 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb820139280 msgr2=0x7fb82013b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:45.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.908+0000 7fb8251ad700 1 --2- 172.21.15.146:0/2746540931 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb820139280 0x7fb82013b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.908+0000 7fb8251ad700 1 -- 172.21.15.146:0/2746540931 >> v1:172.21.15.146:6789/0 conn(0x7fb820133ad0 legacy=0x7fb820133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:45.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.908+0000 7fb8251ad700 1 -- 172.21.15.146:0/2746540931 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82009a500 con 0x7fb820136960 2023-10-03T10:18:45.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.908+0000 7fb8261af700 1 --2- 172.21.15.146:0/2746540931 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb820139280 0x7fb82013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:45.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.908+0000 7fb8251ad700 1 --2- 172.21.15.146:0/2746540931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb820136960 0x7fb820138d40 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb810009920 tx=0x7fb810009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9077014aa839dff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:45.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:45.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.908+0000 7fb8249ac700 1 -- 172.21.15.146:0/2746540931 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810004230 con 0x7fb820136960 2023-10-03T10:18:45.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.908+0000 7fb8249ac700 1 -- 172.21.15.146:0/2746540931 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb810004390 con 0x7fb820136960 2023-10-03T10:18:45.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.908+0000 7fb8249ac700 1 -- 172.21.15.146:0/2746540931 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8100036a0 con 0x7fb820136960 2023-10-03T10:18:45.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.909+0000 7fb827c12700 1 -- 172.21.15.146:0/2746540931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb820136960 msgr2=0x7fb820138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.909+0000 7fb827c12700 1 --2- 172.21.15.146:0/2746540931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb820136960 0x7fb820138d40 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb810009920 tx=0x7fb810009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:45.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.909+0000 7fb827c12700 1 -- 172.21.15.146:0/2746540931 shutdown_connections 2023-10-03T10:18:45.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.909+0000 7fb827c12700 1 --2- 172.21.15.146:0/2746540931 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb820139280 0x7fb82013b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.909+0000 7fb827c12700 1 --2- 172.21.15.146:0/2746540931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb820136960 0x7fb820138d40 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.909+0000 7fb827c12700 1 -- 172.21.15.146:0/2746540931 >> 172.21.15.146:0/2746540931 conn(0x7fb820099c40 msgr2=0x7fb8200a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:45.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.909+0000 7fb827c12700 1 -- 172.21.15.146:0/2746540931 shutdown_connections 2023-10-03T10:18:45.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.909+0000 7fb827c12700 1 -- 172.21.15.146:0/2746540931 wait complete. 2023-10-03T10:18:45.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.910+0000 7fb827c12700 1 Processor -- start 2023-10-03T10:18:45.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.910+0000 7fb827c12700 1 -- start start 2023-10-03T10:18:45.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.910+0000 7fb827c12700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb820133ad0 0x7fb8200716b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.910+0000 7fb827c12700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb820136960 0x7fb820071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.910+0000 7fb827c12700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb820139280 0x7fb8201c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.910+0000 7fb827c12700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8201316a0 con 0x7fb820133ad0 2023-10-03T10:18:45.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.910+0000 7fb827c12700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82009f390 con 0x7fb820139280 2023-10-03T10:18:45.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.910+0000 7fb827c12700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb820072540 con 0x7fb820136960 2023-10-03T10:18:45.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.910+0000 7fb8251ad700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb820136960 0x7fb820071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.910+0000 7fb8261af700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb820139280 0x7fb8201c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.910+0000 7fb8251ad700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb820136960 0x7fb820071bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35092/0 (socket says 172.21.15.146:35092) 2023-10-03T10:18:45.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.910+0000 7fb8251ad700 1 -- 172.21.15.146:0/3867326577 learned_addr learned my addr 172.21.15.146:0/3867326577 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:45.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.910+0000 7fb8259ae700 1 --2- 172.21.15.146:0/3867326577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb820133ad0 0x7fb8200716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.910+0000 7fb8261af700 1 -- 172.21.15.146:0/3867326577 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb820136960 msgr2=0x7fb820071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.910+0000 7fb8261af700 1 --2- 172.21.15.146:0/3867326577 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb820136960 0x7fb820071bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.910+0000 7fb8261af700 1 -- 172.21.15.146:0/3867326577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb820133ad0 msgr2=0x7fb8200716b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.910+0000 7fb8261af700 1 --2- 172.21.15.146:0/3867326577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb820133ad0 0x7fb8200716b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.910+0000 7fb8261af700 1 -- 172.21.15.146:0/3867326577 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb818009a70 con 0x7fb820139280 2023-10-03T10:18:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.911+0000 7fb8251ad700 1 --2- 172.21.15.146:0/3867326577 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb820136960 0x7fb820071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.911+0000 7fb8261af700 1 --2- 172.21.15.146:0/3867326577 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb820139280 0x7fb8201c84e0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fb81800efc0 tx=0x7fb81800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.911+0000 7fb8167fc700 1 -- 172.21.15.146:0/3867326577 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81800ca90 con 0x7fb820139280 2023-10-03T10:18:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.911+0000 7fb8167fc700 1 -- 172.21.15.146:0/3867326577 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81800f040 con 0x7fb820139280 2023-10-03T10:18:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.911+0000 7fb827c12700 1 -- 172.21.15.146:0/3867326577 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb810009550 con 0x7fb820139280 2023-10-03T10:18:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.911+0000 7fb8167fc700 1 -- 172.21.15.146:0/3867326577 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81800ce30 con 0x7fb820139280 2023-10-03T10:18:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.911+0000 7fb827c12700 1 -- 172.21.15.146:0/3867326577 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82006f370 con 0x7fb820139280 2023-10-03T10:18:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.912+0000 7fb8167fc700 1 -- 172.21.15.146:0/3867326577 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb818014480 con 0x7fb820139280 2023-10-03T10:18:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.912+0000 7fb827c12700 1 -- 172.21.15.146:0/3867326577 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82004f2a0 con 0x7fb820139280 2023-10-03T10:18:45.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.912+0000 7fb8167fc700 1 -- 172.21.15.146:0/3867326577 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb81803fbf0 con 0x7fb820139280 2023-10-03T10:18:45.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:45.916+0000 7fb8167fc700 1 -- 172.21.15.146:0/3867326577 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb818012930 con 0x7fb820139280 2023-10-03T10:18:46.047 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:46.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.069+0000 7fd2e8b58700 1 -- 172.21.15.146:0/3175520197 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd2e404f2a0 con 0x7fd2e409e340 2023-10-03T10:18:46.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.069+0000 7fd2d2ffd700 1 -- 172.21.15.146:0/3175520197 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd2d801add0 con 0x7fd2e409e340 2023-10-03T10:18:46.070 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:46.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.072+0000 7fd2e8b58700 1 -- 172.21.15.146:0/3175520197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2e409e340 msgr2=0x7fd2e411c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.072+0000 7fd2e8b58700 1 --2- 172.21.15.146:0/3175520197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2e409e340 0x7fd2e411c8b0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8000c00 tx=0x7fd2d8004750 comp rx=0 tx=0).stop 2023-10-03T10:18:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.072+0000 7fd2e8b58700 1 -- 172.21.15.146:0/3175520197 shutdown_connections 2023-10-03T10:18:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.072+0000 7fd2e8b58700 1 --2- 172.21.15.146:0/3175520197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2e4135f20 0x7fd2e411cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.072+0000 7fd2e8b58700 1 --2- 172.21.15.146:0/3175520197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2e409d860 0x7fd2e411c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.072+0000 7fd2e8b58700 1 --2- 172.21.15.146:0/3175520197 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd2e409e340 0x7fd2e411c8b0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.072+0000 7fd2e8b58700 1 -- 172.21.15.146:0/3175520197 >> 172.21.15.146:0/3175520197 conn(0x7fd2e4099c40 msgr2=0x7fd2e40a0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.072+0000 7fd2e8b58700 1 -- 172.21.15.146:0/3175520197 shutdown_connections 2023-10-03T10:18:46.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.072+0000 7fd2e8b58700 1 -- 172.21.15.146:0/3175520197 wait complete. 2023-10-03T10:18:46.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:46.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.111+0000 7fb827c12700 1 -- 172.21.15.146:0/3867326577 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb82009f0f0 con 0x7fb820139280 2023-10-03T10:18:46.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.111+0000 7fb8167fc700 1 -- 172.21.15.146:0/3867326577 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb818012340 con 0x7fb820139280 2023-10-03T10:18:46.112 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:46.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.115+0000 7fb827c12700 1 -- 172.21.15.146:0/3867326577 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb820139280 msgr2=0x7fb8201c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.115+0000 7fb827c12700 1 --2- 172.21.15.146:0/3867326577 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb820139280 0x7fb8201c84e0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fb81800efc0 tx=0x7fb81800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.115+0000 7fb827c12700 1 -- 172.21.15.146:0/3867326577 shutdown_connections 2023-10-03T10:18:46.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.115+0000 7fb827c12700 1 --2- 172.21.15.146:0/3867326577 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb820139280 0x7fb8201c84e0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.115+0000 7fb827c12700 1 --2- 172.21.15.146:0/3867326577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb820133ad0 0x7fb8200716b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.115+0000 7fb827c12700 1 --2- 172.21.15.146:0/3867326577 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb820136960 0x7fb820071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.115+0000 7fb827c12700 1 -- 172.21.15.146:0/3867326577 >> 172.21.15.146:0/3867326577 conn(0x7fb820099c40 msgr2=0x7fb820134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.115+0000 7fb827c12700 1 -- 172.21.15.146:0/3867326577 shutdown_connections 2023-10-03T10:18:46.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.115+0000 7fb827c12700 1 -- 172.21.15.146:0/3867326577 wait complete. 2023-10-03T10:18:46.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:46.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.179+0000 7ff1c5ac0700 1 Processor -- start 2023-10-03T10:18:46.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.179+0000 7ff1c5ac0700 1 -- start start 2023-10-03T10:18:46.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.180+0000 7ff1c5ac0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1c0133ad0 0x7ff1c0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.180+0000 7ff1c5ac0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1c0130bc0 0x7ff1c013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.180+0000 7ff1c5ac0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c006b2d0 con 0x7ff1c01300a0 2023-10-03T10:18:46.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.180+0000 7ff1c5ac0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c0133610 con 0x7ff1c0133ad0 2023-10-03T10:18:46.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.180+0000 7ff1c5ac0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c009a500 con 0x7ff1c0130bc0 2023-10-03T10:18:46.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.180+0000 7ff1bf7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1c0133ad0 0x7ff1c0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.180+0000 7ff1beffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff1c01300a0 0x7ff1c01304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48948/0 (socket says 172.21.15.146:48948) 2023-10-03T10:18:46.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.180+0000 7ff1beffd700 1 -- 172.21.15.146:0/1782063602 learned_addr learned my addr 172.21.15.146:0/1782063602 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:46.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.180+0000 7ff1bffff700 1 --2- 172.21.15.146:0/1782063602 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1c0130bc0 0x7ff1c013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.180+0000 7ff1be7fc700 1 -- 172.21.15.146:0/1782063602 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891518824 0 0) 0x7ff1c006b2d0 con 0x7ff1c01300a0 2023-10-03T10:18:46.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.180+0000 7ff1bf7fe700 1 -- 172.21.15.146:0/1782063602 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1c0130bc0 msgr2=0x7ff1c013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:46.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.180+0000 7ff1bf7fe700 1 --2- 172.21.15.146:0/1782063602 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1c0130bc0 0x7ff1c013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.180+0000 7ff1bf7fe700 1 -- 172.21.15.146:0/1782063602 >> v1:172.21.15.146:6789/0 conn(0x7ff1c01300a0 legacy=0x7ff1c01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.180+0000 7ff1bf7fe700 1 -- 172.21.15.146:0/1782063602 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c01338b0 con 0x7ff1c0133ad0 2023-10-03T10:18:46.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.180+0000 7ff1bf7fe700 1 --2- 172.21.15.146:0/1782063602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1c0133ad0 0x7ff1c0133ea0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8009870 tx=0x7ff1b8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da03c5d273555677 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.181+0000 7ff1be7fc700 1 -- 172.21.15.146:0/1782063602 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8011830 con 0x7ff1c0133ad0 2023-10-03T10:18:46.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.181+0000 7ff1be7fc700 1 -- 172.21.15.146:0/1782063602 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b8011990 con 0x7ff1c0133ad0 2023-10-03T10:18:46.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.181+0000 7ff1be7fc700 1 -- 172.21.15.146:0/1782063602 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8011d20 con 0x7ff1c0133ad0 2023-10-03T10:18:46.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.181+0000 7ff1c5ac0700 1 -- 172.21.15.146:0/1782063602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1c0133ad0 msgr2=0x7ff1c0133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.181+0000 7ff1c5ac0700 1 --2- 172.21.15.146:0/1782063602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1c0133ad0 0x7ff1c0133ea0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8009870 tx=0x7ff1b8009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:46.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.181+0000 7ff1c5ac0700 1 -- 172.21.15.146:0/1782063602 shutdown_connections 2023-10-03T10:18:46.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.181+0000 7ff1c5ac0700 1 --2- 172.21.15.146:0/1782063602 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1c0130bc0 0x7ff1c013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.181+0000 7ff1c5ac0700 1 --2- 172.21.15.146:0/1782063602 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1c0133ad0 0x7ff1c0133ea0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.181+0000 7ff1c5ac0700 1 -- 172.21.15.146:0/1782063602 >> 172.21.15.146:0/1782063602 conn(0x7ff1c0099c40 msgr2=0x7ff1c00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.181+0000 7ff1c5ac0700 1 -- 172.21.15.146:0/1782063602 shutdown_connections 2023-10-03T10:18:46.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.181+0000 7ff1c5ac0700 1 -- 172.21.15.146:0/1782063602 wait complete. 2023-10-03T10:18:46.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.182+0000 7ff1c5ac0700 1 Processor -- start 2023-10-03T10:18:46.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.182+0000 7ff1c5ac0700 1 -- start start 2023-10-03T10:18:46.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1c5ac0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1c01300a0 0x7ff1c0071310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1c5ac0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1c0130bc0 0x7ff1c0071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1c5ac0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1c0133ad0 0x7ff1c0071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1c5ac0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c00a3430 con 0x7ff1c01300a0 2023-10-03T10:18:46.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1c5ac0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c011f240 con 0x7ff1c0130bc0 2023-10-03T10:18:46.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1c5ac0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c0072770 con 0x7ff1c0133ad0 2023-10-03T10:18:46.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1bf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1c01300a0 0x7ff1c0071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1beffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1c0130bc0 0x7ff1c0071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1bf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1c01300a0 0x7ff1c0071310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53844/0 (socket says 172.21.15.146:53844) 2023-10-03T10:18:46.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1bf7fe700 1 -- 172.21.15.146:0/1776337547 learned_addr learned my addr 172.21.15.146:0/1776337547 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:46.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1bffff700 1 --2- 172.21.15.146:0/1776337547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1c0133ad0 0x7ff1c0071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1bf7fe700 1 -- 172.21.15.146:0/1776337547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1c0133ad0 msgr2=0x7ff1c0071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1bf7fe700 1 --2- 172.21.15.146:0/1776337547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1c0133ad0 0x7ff1c0071d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1bf7fe700 1 -- 172.21.15.146:0/1776337547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1c0130bc0 msgr2=0x7ff1c0071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1bf7fe700 1 --2- 172.21.15.146:0/1776337547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1c0130bc0 0x7ff1c0071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1bf7fe700 1 -- 172.21.15.146:0/1776337547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b80094a0 con 0x7ff1c01300a0 2023-10-03T10:18:46.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1beffd700 1 --2- 172.21.15.146:0/1776337547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1c0130bc0 0x7ff1c0071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:46.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1bf7fe700 1 --2- 172.21.15.146:0/1776337547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1c01300a0 0x7ff1c0071310 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7ff1b80090b0 tx=0x7ff1b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1b7fff700 1 -- 172.21.15.146:0/1776337547 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8004510 con 0x7ff1c01300a0 2023-10-03T10:18:46.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1b7fff700 1 -- 172.21.15.146:0/1776337547 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b80036a0 con 0x7ff1c01300a0 2023-10-03T10:18:46.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1c5ac0700 1 -- 172.21.15.146:0/1776337547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c011f8f0 con 0x7ff1c01300a0 2023-10-03T10:18:46.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1b7fff700 1 -- 172.21.15.146:0/1776337547 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8003a30 con 0x7ff1c01300a0 2023-10-03T10:18:46.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.183+0000 7ff1c5ac0700 1 -- 172.21.15.146:0/1776337547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c012dd50 con 0x7ff1c01300a0 2023-10-03T10:18:46.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.184+0000 7ff1c5ac0700 1 -- 172.21.15.146:0/1776337547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c00a2620 con 0x7ff1c01300a0 2023-10-03T10:18:46.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.185+0000 7ff1b7fff700 1 -- 172.21.15.146:0/1776337547 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff1b8003b90 con 0x7ff1c01300a0 2023-10-03T10:18:46.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.185+0000 7ff1b7fff700 1 -- 172.21.15.146:0/1776337547 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff1b8040a30 con 0x7ff1c01300a0 2023-10-03T10:18:46.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.189+0000 7ff1b7fff700 1 -- 172.21.15.146:0/1776337547 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1b801a420 con 0x7ff1c01300a0 2023-10-03T10:18:46.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.373+0000 7ff1c5ac0700 1 -- 172.21.15.146:0/1776337547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff1c004f2a0 con 0x7ff1c01300a0 2023-10-03T10:18:46.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.373+0000 7ff1b7fff700 1 -- 172.21.15.146:0/1776337547 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff1b8015070 con 0x7ff1c01300a0 2023-10-03T10:18:46.374 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:46.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.375+0000 7ff1c5ac0700 1 -- 172.21.15.146:0/1776337547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1c01300a0 msgr2=0x7ff1c0071310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.375+0000 7ff1c5ac0700 1 --2- 172.21.15.146:0/1776337547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1c01300a0 0x7ff1c0071310 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7ff1b80090b0 tx=0x7ff1b8004750 comp rx=0 tx=0).stop 2023-10-03T10:18:46.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.375+0000 7ff1c5ac0700 1 -- 172.21.15.146:0/1776337547 shutdown_connections 2023-10-03T10:18:46.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.375+0000 7ff1c5ac0700 1 --2- 172.21.15.146:0/1776337547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff1c0133ad0 0x7ff1c0071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.375+0000 7ff1c5ac0700 1 --2- 172.21.15.146:0/1776337547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1c01300a0 0x7ff1c0071310 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.375+0000 7ff1c5ac0700 1 --2- 172.21.15.146:0/1776337547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1c0130bc0 0x7ff1c0071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.375+0000 7ff1c5ac0700 1 -- 172.21.15.146:0/1776337547 >> 172.21.15.146:0/1776337547 conn(0x7ff1c0099c40 msgr2=0x7ff1c0132c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.376+0000 7ff1c5ac0700 1 -- 172.21.15.146:0/1776337547 shutdown_connections 2023-10-03T10:18:46.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:46.376+0000 7ff1c5ac0700 1 -- 172.21.15.146:0/1776337547 wait complete. 2023-10-03T10:18:46.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:46.911 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.043+0000 7fabba3b2700 1 Processor -- start 2023-10-03T10:18:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.043+0000 7fabba3b2700 1 -- start start 2023-10-03T10:18:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.043+0000 7fabba3b2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabb409e870 0x7fabb409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.043+0000 7fabba3b2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fabb409f180 0x7fabb4131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.043+0000 7fabba3b2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fabb4131d70 0x7fabb4132210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.043+0000 7fabba3b2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb40a0920 con 0x7fabb409f180 2023-10-03T10:18:47.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.043+0000 7fabba3b2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb409c970 con 0x7fabb409e870 2023-10-03T10:18:47.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.043+0000 7fabba3b2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabb409bab0 con 0x7fabb4131d70 2023-10-03T10:18:47.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.043+0000 7fabb894f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fabb4131d70 0x7fabb4132210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.043+0000 7fabb3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabb409e870 0x7fabb409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.043+0000 7fabb37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fabb409f180 0x7fabb4131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.043+0000 7fabb894f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fabb4131d70 0x7fabb4132210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35124/0 (socket says 172.21.15.146:35124) 2023-10-03T10:18:47.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.043+0000 7fabb37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fabb409f180 0x7fabb4131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53858/0 (socket says 172.21.15.146:53858) 2023-10-03T10:18:47.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.043+0000 7fabb3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabb409e870 0x7fabb409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50974/0 (socket says 172.21.15.146:50974) 2023-10-03T10:18:47.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.043+0000 7fabb894f700 1 -- 172.21.15.146:0/4089102156 learned_addr learned my addr 172.21.15.146:0/4089102156 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:47.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.043+0000 7fabb894f700 1 -- 172.21.15.146:0/4089102156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabb409e870 msgr2=0x7fabb409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.043+0000 7fabb894f700 1 --2- 172.21.15.146:0/4089102156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabb409e870 0x7fabb409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.043+0000 7fabb894f700 1 -- 172.21.15.146:0/4089102156 >> v2:172.21.15.146:3300/0 conn(0x7fabb409f180 msgr2=0x7fabb4131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.043+0000 7fabb894f700 1 --2- 172.21.15.146:0/4089102156 >> v2:172.21.15.146:3300/0 conn(0x7fabb409f180 0x7fabb4131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.043+0000 7fabb894f700 1 -- 172.21.15.146:0/4089102156 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb409f9c0 con 0x7fabb4131d70 2023-10-03T10:18:47.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.044+0000 7fabb37fe700 1 --2- 172.21.15.146:0/4089102156 >> v2:172.21.15.146:3300/0 conn(0x7fabb409f180 0x7fabb4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.044+0000 7fabb3fff700 1 --2- 172.21.15.146:0/4089102156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabb409e870 0x7fabb409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.044+0000 7fabb894f700 1 --2- 172.21.15.146:0/4089102156 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fabb4131d70 0x7fabb4132210 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fabac009e50 tx=0x7fabac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cc5443d42f29809 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.044+0000 7fabb2ffd700 1 -- 172.21.15.146:0/4089102156 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac00e070 con 0x7fabb4131d70 2023-10-03T10:18:47.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.044+0000 7fabb2ffd700 1 -- 172.21.15.146:0/4089102156 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac00b910 con 0x7fabb4131d70 2023-10-03T10:18:47.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.044+0000 7fabb2ffd700 1 -- 172.21.15.146:0/4089102156 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac00bcc0 con 0x7fabb4131d70 2023-10-03T10:18:47.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.044+0000 7fabba3b2700 1 -- 172.21.15.146:0/4089102156 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fabb4131d70 msgr2=0x7fabb4132210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.044+0000 7fabba3b2700 1 --2- 172.21.15.146:0/4089102156 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fabb4131d70 0x7fabb4132210 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fabac009e50 tx=0x7fabac00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:47.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.044+0000 7fabba3b2700 1 -- 172.21.15.146:0/4089102156 shutdown_connections 2023-10-03T10:18:47.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.044+0000 7fabba3b2700 1 --2- 172.21.15.146:0/4089102156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabb409e870 0x7fabb409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.044+0000 7fabba3b2700 1 --2- 172.21.15.146:0/4089102156 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fabb4131d70 0x7fabb4132210 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.044+0000 7fabba3b2700 1 --2- 172.21.15.146:0/4089102156 >> v2:172.21.15.146:3300/0 conn(0x7fabb409f180 0x7fabb4131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.044+0000 7fabba3b2700 1 -- 172.21.15.146:0/4089102156 >> 172.21.15.146:0/4089102156 conn(0x7fabb40a4430 msgr2=0x7fabb40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.044+0000 7fabba3b2700 1 -- 172.21.15.146:0/4089102156 shutdown_connections 2023-10-03T10:18:47.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.044+0000 7fabba3b2700 1 -- 172.21.15.146:0/4089102156 wait complete. 2023-10-03T10:18:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.045+0000 7fabba3b2700 1 Processor -- start 2023-10-03T10:18:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.045+0000 7fabba3b2700 1 -- start start 2023-10-03T10:18:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.046+0000 7fabba3b2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabb409e870 0x7fabb411b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.046+0000 7fabba3b2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fabb409f180 0x7fabb411bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.046+0000 7fabba3b2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabb4131d70 0x7fabb41c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.046+0000 7fabba3b2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb411e540 con 0x7fabb4131d70 2023-10-03T10:18:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.046+0000 7fabba3b2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb411da20 con 0x7fabb409e870 2023-10-03T10:18:47.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.046+0000 7fabba3b2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabb411e280 con 0x7fabb409f180 2023-10-03T10:18:47.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.046+0000 7fabb37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fabb409f180 0x7fabb411bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.046+0000 7fabb3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabb409e870 0x7fabb411b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.046+0000 7fabb894f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabb4131d70 0x7fabb41c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.046+0000 7fabb37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fabb409f180 0x7fabb411bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35138/0 (socket says 172.21.15.146:35138) 2023-10-03T10:18:47.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.046+0000 7fabb37fe700 1 -- 172.21.15.146:0/2255638951 learned_addr learned my addr 172.21.15.146:0/2255638951 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:47.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.046+0000 7fabb37fe700 1 -- 172.21.15.146:0/2255638951 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabb409e870 msgr2=0x7fabb411b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.046+0000 7fabb37fe700 1 --2- 172.21.15.146:0/2255638951 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabb409e870 0x7fabb411b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.046+0000 7fabb37fe700 1 -- 172.21.15.146:0/2255638951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabb4131d70 msgr2=0x7fabb41c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.046+0000 7fabb37fe700 1 --2- 172.21.15.146:0/2255638951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabb4131d70 0x7fabb41c3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.046+0000 7fabb37fe700 1 -- 172.21.15.146:0/2255638951 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba40094a0 con 0x7fabb409f180 2023-10-03T10:18:47.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.046+0000 7fabb3fff700 1 --2- 172.21.15.146:0/2255638951 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabb409e870 0x7fabb411b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.046+0000 7fabb37fe700 1 --2- 172.21.15.146:0/2255638951 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fabb409f180 0x7fabb411bb60 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7faba8012f90 tx=0x7faba80103a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.047+0000 7fabb0ff9700 1 -- 172.21.15.146:0/2255638951 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba8010b00 con 0x7fabb409f180 2023-10-03T10:18:47.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.047+0000 7fabb0ff9700 1 -- 172.21.15.146:0/2255638951 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba8013040 con 0x7fabb409f180 2023-10-03T10:18:47.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.047+0000 7fabba3b2700 1 -- 172.21.15.146:0/2255638951 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba800d940 con 0x7fabb409f180 2023-10-03T10:18:47.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.047+0000 7fabb0ff9700 1 -- 172.21.15.146:0/2255638951 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba8010e80 con 0x7fabb409f180 2023-10-03T10:18:47.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.047+0000 7fabba3b2700 1 -- 172.21.15.146:0/2255638951 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabac009b30 con 0x7fabb409f180 2023-10-03T10:18:47.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.047+0000 7fabb0ff9700 1 -- 172.21.15.146:0/2255638951 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faba8018480 con 0x7fabb409f180 2023-10-03T10:18:47.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.047+0000 7fabb0ff9700 1 -- 172.21.15.146:0/2255638951 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faba8043660 con 0x7fabb409f180 2023-10-03T10:18:47.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.048+0000 7fabba3b2700 1 -- 172.21.15.146:0/2255638951 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb411d640 con 0x7fabb409f180 2023-10-03T10:18:47.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.052+0000 7fabb0ff9700 1 -- 172.21.15.146:0/2255638951 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faba8016910 con 0x7fabb409f180 2023-10-03T10:18:47.086 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:47.134 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:47.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.213+0000 7f81e8a75700 1 Processor -- start 2023-10-03T10:18:47.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.213+0000 7f81e8a75700 1 -- start start 2023-10-03T10:18:47.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.214+0000 7f81e8a75700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81e409e870 0x7f81e409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.214+0000 7f81e8a75700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e409f180 0x7f81e4133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.214+0000 7f81e8a75700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e409fa00 con 0x7f81e4134160 2023-10-03T10:18:47.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.214+0000 7f81e8a75700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e40a0370 con 0x7f81e409e870 2023-10-03T10:18:47.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.214+0000 7f81e8a75700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81e406bec0 con 0x7f81e409f180 2023-10-03T10:18:47.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.214+0000 7f81e1d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e409f180 0x7f81e4133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.214+0000 7f81e1d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e409f180 0x7f81e4133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35148/0 (socket says 172.21.15.146:35148) 2023-10-03T10:18:47.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.214+0000 7f81e1d9b700 1 -- 172.21.15.146:0/1132266247 learned_addr learned my addr 172.21.15.146:0/1132266247 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:47.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.214+0000 7f81e259c700 1 --2- 172.21.15.146:0/1132266247 >> v2:172.21.15.146:3300/0 conn(0x7f81e409e870 0x7f81e409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.215+0000 7f81e1d9b700 1 -- 172.21.15.146:0/1132266247 >> v2:172.21.15.146:3300/0 conn(0x7f81e409e870 msgr2=0x7f81e409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.215+0000 7f81e1d9b700 1 --2- 172.21.15.146:0/1132266247 >> v2:172.21.15.146:3300/0 conn(0x7f81e409e870 0x7f81e409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.215+0000 7f81e1d9b700 1 -- 172.21.15.146:0/1132266247 >> v1:172.21.15.146:6789/0 conn(0x7f81e4134160 legacy=0x7f81e413ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.215+0000 7f81e1d9b700 1 -- 172.21.15.146:0/1132266247 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e409ada0 con 0x7f81e409f180 2023-10-03T10:18:47.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.215+0000 7f81e1d9b700 1 --2- 172.21.15.146:0/1132266247 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e409f180 0x7f81e4133c20 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f81d80098f0 tx=0x7f81d8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1945e1711090593d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.215+0000 7f81e159a700 1 -- 172.21.15.146:0/1132266247 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d8011830 con 0x7f81e409f180 2023-10-03T10:18:47.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.215+0000 7f81e159a700 1 -- 172.21.15.146:0/1132266247 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d8011990 con 0x7f81e409f180 2023-10-03T10:18:47.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.215+0000 7f81e159a700 1 -- 172.21.15.146:0/1132266247 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d8011d20 con 0x7f81e409f180 2023-10-03T10:18:47.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.216+0000 7f81e8a75700 1 -- 172.21.15.146:0/1132266247 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e409f180 msgr2=0x7f81e4133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.216+0000 7f81e8a75700 1 --2- 172.21.15.146:0/1132266247 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e409f180 0x7f81e4133c20 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f81d80098f0 tx=0x7f81d8009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:47.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.216+0000 7f81e8a75700 1 -- 172.21.15.146:0/1132266247 shutdown_connections 2023-10-03T10:18:47.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.216+0000 7f81e8a75700 1 --2- 172.21.15.146:0/1132266247 >> v2:172.21.15.146:3300/0 conn(0x7f81e409e870 0x7f81e409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.216+0000 7f81e8a75700 1 --2- 172.21.15.146:0/1132266247 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e409f180 0x7f81e4133c20 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.216+0000 7f81e8a75700 1 -- 172.21.15.146:0/1132266247 >> 172.21.15.146:0/1132266247 conn(0x7f81e40a4430 msgr2=0x7f81e40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.216+0000 7f81e8a75700 1 -- 172.21.15.146:0/1132266247 shutdown_connections 2023-10-03T10:18:47.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.216+0000 7f81e8a75700 1 -- 172.21.15.146:0/1132266247 wait complete. 2023-10-03T10:18:47.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.217+0000 7f81e8a75700 1 Processor -- start 2023-10-03T10:18:47.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.217+0000 7f81e8a75700 1 -- start start 2023-10-03T10:18:47.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.217+0000 7f81e8a75700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e409e870 0x7f81e4122b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.217+0000 7f81e8a75700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e409f180 0x7f81e4123070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.217+0000 7f81e8a75700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81e4134160 0x7f81e41235b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.217+0000 7f81e8a75700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e4133600 con 0x7f81e4134160 2023-10-03T10:18:47.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.217+0000 7f81e8a75700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e4123fe0 con 0x7f81e409f180 2023-10-03T10:18:47.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.217+0000 7f81e8a75700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81e4126320 con 0x7f81e409e870 2023-10-03T10:18:47.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.217+0000 7f81e1d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e409f180 0x7f81e4123070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.217+0000 7f81e1d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e409f180 0x7f81e4123070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50990/0 (socket says 172.21.15.146:50990) 2023-10-03T10:18:47.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.217+0000 7f81e1d9b700 1 -- 172.21.15.146:0/1854965100 learned_addr learned my addr 172.21.15.146:0/1854965100 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:47.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.217+0000 7f81e2d9d700 1 --2- 172.21.15.146:0/1854965100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81e4134160 0x7f81e41235b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.217+0000 7f81e259c700 1 --2- 172.21.15.146:0/1854965100 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e409e870 0x7f81e4122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.218+0000 7f81e1d9b700 1 -- 172.21.15.146:0/1854965100 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e409e870 msgr2=0x7f81e4122b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.218+0000 7f81e1d9b700 1 --2- 172.21.15.146:0/1854965100 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e409e870 0x7f81e4122b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.218+0000 7f81e1d9b700 1 -- 172.21.15.146:0/1854965100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81e4134160 msgr2=0x7f81e41235b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.218+0000 7f81e1d9b700 1 --2- 172.21.15.146:0/1854965100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81e4134160 0x7f81e41235b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.218+0000 7f81e1d9b700 1 -- 172.21.15.146:0/1854965100 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d8009550 con 0x7f81e409f180 2023-10-03T10:18:47.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.218+0000 7f81e2d9d700 1 --2- 172.21.15.146:0/1854965100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81e4134160 0x7f81e41235b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.218+0000 7f81e259c700 1 --2- 172.21.15.146:0/1854965100 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e409e870 0x7f81e4122b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.218+0000 7f81e1d9b700 1 --2- 172.21.15.146:0/1854965100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e409f180 0x7f81e4123070 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f81d8009c40 tx=0x7f81d8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.218+0000 7f81d2ffd700 1 -- 172.21.15.146:0/1854965100 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d8004400 con 0x7f81e409f180 2023-10-03T10:18:47.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.218+0000 7f81d2ffd700 1 -- 172.21.15.146:0/1854965100 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d801f070 con 0x7f81e409f180 2023-10-03T10:18:47.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.218+0000 7f81e8a75700 1 -- 172.21.15.146:0/1854965100 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e4124800 con 0x7f81e409f180 2023-10-03T10:18:47.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.218+0000 7f81d2ffd700 1 -- 172.21.15.146:0/1854965100 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d80038e0 con 0x7f81e409f180 2023-10-03T10:18:47.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.218+0000 7f81e8a75700 1 -- 172.21.15.146:0/1854965100 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e4124ee0 con 0x7f81e409f180 2023-10-03T10:18:47.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.219+0000 7f81d2ffd700 1 -- 172.21.15.146:0/1854965100 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81d8021030 con 0x7f81e409f180 2023-10-03T10:18:47.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.219+0000 7f81d2ffd700 1 -- 172.21.15.146:0/1854965100 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f81d8040aa0 con 0x7f81e409f180 2023-10-03T10:18:47.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.219+0000 7f81e8a75700 1 -- 172.21.15.146:0/1854965100 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e404f2a0 con 0x7f81e409f180 2023-10-03T10:18:47.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.224+0000 7f81d2ffd700 1 -- 172.21.15.146:0/1854965100 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81d8015080 con 0x7f81e409f180 2023-10-03T10:18:47.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.254+0000 7fabba3b2700 1 -- 172.21.15.146:0/2255638951 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fabb404f2a0 con 0x7fabb409f180 2023-10-03T10:18:47.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.254+0000 7fabb0ff9700 1 -- 172.21.15.146:0/2255638951 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7faba8016340 con 0x7fabb409f180 2023-10-03T10:18:47.255 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:47.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.256+0000 7fabba3b2700 1 -- 172.21.15.146:0/2255638951 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fabb409f180 msgr2=0x7fabb411bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.256+0000 7fabba3b2700 1 --2- 172.21.15.146:0/2255638951 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fabb409f180 0x7fabb411bb60 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7faba8012f90 tx=0x7faba80103a0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.256+0000 7fabba3b2700 1 -- 172.21.15.146:0/2255638951 shutdown_connections 2023-10-03T10:18:47.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.256+0000 7fabba3b2700 1 --2- 172.21.15.146:0/2255638951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabb4131d70 0x7fabb41c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.256+0000 7fabba3b2700 1 --2- 172.21.15.146:0/2255638951 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabb409e870 0x7fabb411b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.256+0000 7fabba3b2700 1 --2- 172.21.15.146:0/2255638951 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fabb409f180 0x7fabb411bb60 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.256+0000 7fabba3b2700 1 -- 172.21.15.146:0/2255638951 >> 172.21.15.146:0/2255638951 conn(0x7fabb40a4430 msgr2=0x7fabb412fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.257+0000 7fabba3b2700 1 -- 172.21.15.146:0/2255638951 shutdown_connections 2023-10-03T10:18:47.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.257+0000 7fabba3b2700 1 -- 172.21.15.146:0/2255638951 wait complete. 2023-10-03T10:18:47.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.262+0000 7fdd9a6eb700 1 Processor -- start 2023-10-03T10:18:47.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.262+0000 7fdd9a6eb700 1 -- start start 2023-10-03T10:18:47.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.262+0000 7fdd9a6eb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdd9409d860 0x7fdd9409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.262+0000 7fdd9a6eb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdd9409e170 0x7fdd941307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.262+0000 7fdd9a6eb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd94130ce0 0x7fdd94131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.262+0000 7fdd9a6eb700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd9409aaa0 con 0x7fdd9409e170 2023-10-03T10:18:47.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.262+0000 7fdd9a6eb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9409f870 con 0x7fdd94130ce0 2023-10-03T10:18:47.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.262+0000 7fdd9a6eb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9409b360 con 0x7fdd9409d860 2023-10-03T10:18:47.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.262+0000 7fdd93fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdd9409d860 0x7fdd9409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.262+0000 7fdd93fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdd9409d860 0x7fdd9409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35160/0 (socket says 172.21.15.146:35160) 2023-10-03T10:18:47.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.262+0000 7fdd93fff700 1 -- 172.21.15.146:0/3041792662 learned_addr learned my addr 172.21.15.146:0/3041792662 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:47.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.262+0000 7fdd98c88700 1 --2- 172.21.15.146:0/3041792662 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd94130ce0 0x7fdd94131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.263+0000 7fdd937fe700 1 --2- 172.21.15.146:0/3041792662 >> v2:172.21.15.146:3300/0 conn(0x7fdd9409e170 0x7fdd941307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.263+0000 7fdd93fff700 1 -- 172.21.15.146:0/3041792662 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd94130ce0 msgr2=0x7fdd94131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.263+0000 7fdd93fff700 1 --2- 172.21.15.146:0/3041792662 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd94130ce0 0x7fdd94131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.263+0000 7fdd93fff700 1 -- 172.21.15.146:0/3041792662 >> v2:172.21.15.146:3300/0 conn(0x7fdd9409e170 msgr2=0x7fdd941307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.263+0000 7fdd93fff700 1 --2- 172.21.15.146:0/3041792662 >> v2:172.21.15.146:3300/0 conn(0x7fdd9409e170 0x7fdd941307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.263+0000 7fdd93fff700 1 -- 172.21.15.146:0/3041792662 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9409b620 con 0x7fdd9409d860 2023-10-03T10:18:47.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.263+0000 7fdd93fff700 1 --2- 172.21.15.146:0/3041792662 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdd9409d860 0x7fdd9409dc30 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009920 tx=0x7fdd84009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=811da93f00307932 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.263+0000 7fdd92ffd700 1 -- 172.21.15.146:0/3041792662 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84012b80 con 0x7fdd9409d860 2023-10-03T10:18:47.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.263+0000 7fdd92ffd700 1 -- 172.21.15.146:0/3041792662 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd84012ce0 con 0x7fdd9409d860 2023-10-03T10:18:47.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.263+0000 7fdd92ffd700 1 -- 172.21.15.146:0/3041792662 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8401b620 con 0x7fdd9409d860 2023-10-03T10:18:47.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.264+0000 7fdd9a6eb700 1 -- 172.21.15.146:0/3041792662 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdd9409d860 msgr2=0x7fdd9409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.264+0000 7fdd9a6eb700 1 --2- 172.21.15.146:0/3041792662 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdd9409d860 0x7fdd9409dc30 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009920 tx=0x7fdd84009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:47.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.264+0000 7fdd9a6eb700 1 -- 172.21.15.146:0/3041792662 shutdown_connections 2023-10-03T10:18:47.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.264+0000 7fdd9a6eb700 1 --2- 172.21.15.146:0/3041792662 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd94130ce0 0x7fdd94131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.264+0000 7fdd9a6eb700 1 --2- 172.21.15.146:0/3041792662 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdd9409d860 0x7fdd9409dc30 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.264+0000 7fdd9a6eb700 1 --2- 172.21.15.146:0/3041792662 >> v2:172.21.15.146:3300/0 conn(0x7fdd9409e170 0x7fdd941307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.264+0000 7fdd9a6eb700 1 -- 172.21.15.146:0/3041792662 >> 172.21.15.146:0/3041792662 conn(0x7fdd94099c40 msgr2=0x7fdd940a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.264+0000 7fdd9a6eb700 1 -- 172.21.15.146:0/3041792662 shutdown_connections 2023-10-03T10:18:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.264+0000 7fdd9a6eb700 1 -- 172.21.15.146:0/3041792662 wait complete. 2023-10-03T10:18:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.265+0000 7fdd9a6eb700 1 Processor -- start 2023-10-03T10:18:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.266+0000 7fdd9a6eb700 1 -- start start 2023-10-03T10:18:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.266+0000 7fdd9a6eb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdd9409d860 0x7fdd9411d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.266+0000 7fdd9a6eb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd9409e170 0x7fdd9411d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.266+0000 7fdd9a6eb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd94130ce0 0x7fdd9411dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.266+0000 7fdd9a6eb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9412f6a0 con 0x7fdd9409e170 2023-10-03T10:18:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.266+0000 7fdd9a6eb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd94120120 con 0x7fdd94130ce0 2023-10-03T10:18:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.266+0000 7fdd9a6eb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd94120b00 con 0x7fdd9409d860 2023-10-03T10:18:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.267+0000 7fdd93fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdd9409d860 0x7fdd9411d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.267+0000 7fdd93fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdd9409d860 0x7fdd9411d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35174/0 (socket says 172.21.15.146:35174) 2023-10-03T10:18:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.267+0000 7fdd93fff700 1 -- 172.21.15.146:0/4101236704 learned_addr learned my addr 172.21.15.146:0/4101236704 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.267+0000 7fdd98c88700 1 --2- 172.21.15.146:0/4101236704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd94130ce0 0x7fdd9411dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.267+0000 7fdd93fff700 1 -- 172.21.15.146:0/4101236704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd94130ce0 msgr2=0x7fdd9411dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.267+0000 7fdd93fff700 1 --2- 172.21.15.146:0/4101236704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd94130ce0 0x7fdd9411dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.267+0000 7fdd93fff700 1 -- 172.21.15.146:0/4101236704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd9409e170 msgr2=0x7fdd9411d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.267+0000 7fdd93fff700 1 --2- 172.21.15.146:0/4101236704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd9409e170 0x7fdd9411d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.267+0000 7fdd93fff700 1 -- 172.21.15.146:0/4101236704 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd84009550 con 0x7fdd9409d860 2023-10-03T10:18:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.267+0000 7fdd98c88700 1 --2- 172.21.15.146:0/4101236704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd94130ce0 0x7fdd9411dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.267+0000 7fdd93fff700 1 --2- 172.21.15.146:0/4101236704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdd9409d860 0x7fdd9411d2c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009c70 tx=0x7fdd84004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.267+0000 7fdd90ff9700 1 -- 172.21.15.146:0/4101236704 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84020070 con 0x7fdd9409d860 2023-10-03T10:18:47.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.267+0000 7fdd90ff9700 1 -- 172.21.15.146:0/4101236704 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd840038b0 con 0x7fdd9409d860 2023-10-03T10:18:47.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.267+0000 7fdd9a6eb700 1 -- 172.21.15.146:0/4101236704 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd9411f490 con 0x7fdd9409d860 2023-10-03T10:18:47.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.267+0000 7fdd90ff9700 1 -- 172.21.15.146:0/4101236704 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84003c40 con 0x7fdd9409d860 2023-10-03T10:18:47.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.267+0000 7fdd9a6eb700 1 -- 172.21.15.146:0/4101236704 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd940a07a0 con 0x7fdd9409d860 2023-10-03T10:18:47.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.268+0000 7fdd90ff9700 1 -- 172.21.15.146:0/4101236704 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdd8401b400 con 0x7fdd9409d860 2023-10-03T10:18:47.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.268+0000 7fdd90ff9700 1 -- 172.21.15.146:0/4101236704 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdd840443b0 con 0x7fdd9409d860 2023-10-03T10:18:47.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.268+0000 7fdd9a6eb700 1 -- 172.21.15.146:0/4101236704 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9409c910 con 0x7fdd9409d860 2023-10-03T10:18:47.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:47.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.273+0000 7fdd90ff9700 1 -- 172.21.15.146:0/4101236704 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd8402a080 con 0x7fdd9409d860 2023-10-03T10:18:47.389 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:47.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.423+0000 7f81e8a75700 1 -- 172.21.15.146:0/1854965100 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f81e406c9d0 con 0x7f81e409f180 2023-10-03T10:18:47.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.424+0000 7f81d2ffd700 1 -- 172.21.15.146:0/1854965100 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f81d8019960 con 0x7f81e409f180 2023-10-03T10:18:47.424 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:47.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.426+0000 7f81e8a75700 1 -- 172.21.15.146:0/1854965100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e409f180 msgr2=0x7f81e4123070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.426+0000 7f81e8a75700 1 --2- 172.21.15.146:0/1854965100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e409f180 0x7f81e4123070 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f81d8009c40 tx=0x7f81d8004750 comp rx=0 tx=0).stop 2023-10-03T10:18:47.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.426+0000 7f81e8a75700 1 -- 172.21.15.146:0/1854965100 shutdown_connections 2023-10-03T10:18:47.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.426+0000 7f81e8a75700 1 --2- 172.21.15.146:0/1854965100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81e4134160 0x7f81e41235b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.426+0000 7f81e8a75700 1 --2- 172.21.15.146:0/1854965100 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f81e409e870 0x7f81e4122b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.426+0000 7f81e8a75700 1 --2- 172.21.15.146:0/1854965100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81e409f180 0x7f81e4123070 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.426+0000 7f81e8a75700 1 -- 172.21.15.146:0/1854965100 >> 172.21.15.146:0/1854965100 conn(0x7f81e40a4430 msgr2=0x7f81e40a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.426+0000 7f81e8a75700 1 -- 172.21.15.146:0/1854965100 shutdown_connections 2023-10-03T10:18:47.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.426+0000 7f81e8a75700 1 -- 172.21.15.146:0/1854965100 wait complete. 2023-10-03T10:18:47.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:47.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.468+0000 7fdd9a6eb700 1 -- 172.21.15.146:0/4101236704 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdd9404f2a0 con 0x7fdd9409d860 2023-10-03T10:18:47.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.468+0000 7fdd90ff9700 1 -- 172.21.15.146:0/4101236704 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd84003da0 con 0x7fdd9409d860 2023-10-03T10:18:47.469 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:47.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.470+0000 7fdd9a6eb700 1 -- 172.21.15.146:0/4101236704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdd9409d860 msgr2=0x7fdd9411d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.470+0000 7fdd9a6eb700 1 --2- 172.21.15.146:0/4101236704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdd9409d860 0x7fdd9411d2c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009c70 tx=0x7fdd84004750 comp rx=0 tx=0).stop 2023-10-03T10:18:47.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.470+0000 7fdd9a6eb700 1 -- 172.21.15.146:0/4101236704 shutdown_connections 2023-10-03T10:18:47.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.470+0000 7fdd9a6eb700 1 --2- 172.21.15.146:0/4101236704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd94130ce0 0x7fdd9411dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.470+0000 7fdd9a6eb700 1 --2- 172.21.15.146:0/4101236704 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdd9409d860 0x7fdd9411d2c0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.470+0000 7fdd9a6eb700 1 --2- 172.21.15.146:0/4101236704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd9409e170 0x7fdd9411d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.470+0000 7fdd9a6eb700 1 -- 172.21.15.146:0/4101236704 >> 172.21.15.146:0/4101236704 conn(0x7fdd94099c40 msgr2=0x7fdd94130080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.470+0000 7fdd9a6eb700 1 -- 172.21.15.146:0/4101236704 shutdown_connections 2023-10-03T10:18:47.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.470+0000 7fdd9a6eb700 1 -- 172.21.15.146:0/4101236704 wait complete. 2023-10-03T10:18:47.483 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:47.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.514+0000 7fcc28c15700 1 Processor -- start 2023-10-03T10:18:47.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.514+0000 7fcc28c15700 1 -- start start 2023-10-03T10:18:47.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc28c15700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc2409d860 0x7fcc2409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc28c15700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcc2409e170 0x7fcc241307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc28c15700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc24130ce0 0x7fcc24131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc28c15700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2409aaa0 con 0x7fcc2409e170 2023-10-03T10:18:47.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc28c15700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2409f870 con 0x7fcc2409d860 2023-10-03T10:18:47.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc28c15700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2409b360 con 0x7fcc24130ce0 2023-10-03T10:18:47.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc21d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcc2409e170 0x7fcc241307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc22d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc24130ce0 0x7fcc24131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc22d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc24130ce0 0x7fcc24131180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35182/0 (socket says 172.21.15.146:35182) 2023-10-03T10:18:47.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc21d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcc2409e170 0x7fcc241307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53898/0 (socket says 172.21.15.146:53898) 2023-10-03T10:18:47.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc22d9d700 1 -- 172.21.15.146:0/2264342283 learned_addr learned my addr 172.21.15.146:0/2264342283 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:47.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc2259c700 1 --2- 172.21.15.146:0/2264342283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc2409d860 0x7fcc2409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc22d9d700 1 -- 172.21.15.146:0/2264342283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc2409d860 msgr2=0x7fcc2409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc22d9d700 1 --2- 172.21.15.146:0/2264342283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc2409d860 0x7fcc2409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc22d9d700 1 -- 172.21.15.146:0/2264342283 >> v2:172.21.15.146:3300/0 conn(0x7fcc2409e170 msgr2=0x7fcc241307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc22d9d700 1 --2- 172.21.15.146:0/2264342283 >> v2:172.21.15.146:3300/0 conn(0x7fcc2409e170 0x7fcc241307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc22d9d700 1 -- 172.21.15.146:0/2264342283 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2409b620 con 0x7fcc24130ce0 2023-10-03T10:18:47.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc21d9b700 1 --2- 172.21.15.146:0/2264342283 >> v2:172.21.15.146:3300/0 conn(0x7fcc2409e170 0x7fcc241307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc2259c700 1 --2- 172.21.15.146:0/2264342283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc2409d860 0x7fcc2409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc22d9d700 1 --2- 172.21.15.146:0/2264342283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc24130ce0 0x7fcc24131180 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00f3a0 tx=0x7fcc1c00f6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=891c47911ad006b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc2159a700 1 -- 172.21.15.146:0/2264342283 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c012070 con 0x7fcc24130ce0 2023-10-03T10:18:47.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc2159a700 1 -- 172.21.15.146:0/2264342283 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c00d0d0 con 0x7fcc24130ce0 2023-10-03T10:18:47.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.515+0000 7fcc2159a700 1 -- 172.21.15.146:0/2264342283 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c00d480 con 0x7fcc24130ce0 2023-10-03T10:18:47.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.516+0000 7fcc28c15700 1 -- 172.21.15.146:0/2264342283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc24130ce0 msgr2=0x7fcc24131180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.516+0000 7fcc28c15700 1 --2- 172.21.15.146:0/2264342283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc24130ce0 0x7fcc24131180 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00f3a0 tx=0x7fcc1c00f6b0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.516+0000 7fcc28c15700 1 -- 172.21.15.146:0/2264342283 shutdown_connections 2023-10-03T10:18:47.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.516+0000 7fcc28c15700 1 --2- 172.21.15.146:0/2264342283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc2409d860 0x7fcc2409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.516+0000 7fcc28c15700 1 --2- 172.21.15.146:0/2264342283 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc24130ce0 0x7fcc24131180 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.516+0000 7fcc28c15700 1 --2- 172.21.15.146:0/2264342283 >> v2:172.21.15.146:3300/0 conn(0x7fcc2409e170 0x7fcc241307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.516+0000 7fcc28c15700 1 -- 172.21.15.146:0/2264342283 >> 172.21.15.146:0/2264342283 conn(0x7fcc24099c40 msgr2=0x7fcc240a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.516+0000 7fcc28c15700 1 -- 172.21.15.146:0/2264342283 shutdown_connections 2023-10-03T10:18:47.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.516+0000 7fcc28c15700 1 -- 172.21.15.146:0/2264342283 wait complete. 2023-10-03T10:18:47.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.517+0000 7fcc28c15700 1 Processor -- start 2023-10-03T10:18:47.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.517+0000 7fcc28c15700 1 -- start start 2023-10-03T10:18:47.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.517+0000 7fcc28c15700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc2409d860 0x7fcc2411d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc28c15700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc2409e170 0x7fcc2411d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc28c15700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc24130ce0 0x7fcc2411daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc28c15700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2411ebf0 con 0x7fcc2409e170 2023-10-03T10:18:47.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc28c15700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2409c8b0 con 0x7fcc2409d860 2023-10-03T10:18:47.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc28c15700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc24120820 con 0x7fcc24130ce0 2023-10-03T10:18:47.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc2259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc2409d860 0x7fcc2411d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc21d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc2409e170 0x7fcc2411d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc22d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc24130ce0 0x7fcc2411daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc21d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc2409e170 0x7fcc2411d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53906/0 (socket says 172.21.15.146:53906) 2023-10-03T10:18:47.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc2259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc2409d860 0x7fcc2411d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51024/0 (socket says 172.21.15.146:51024) 2023-10-03T10:18:47.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc21d9b700 1 -- 172.21.15.146:0/2018857117 learned_addr learned my addr 172.21.15.146:0/2018857117 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:47.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc22d9d700 1 -- 172.21.15.146:0/2018857117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc2409d860 msgr2=0x7fcc2411d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc22d9d700 1 --2- 172.21.15.146:0/2018857117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc2409d860 0x7fcc2411d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc22d9d700 1 -- 172.21.15.146:0/2018857117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc2409e170 msgr2=0x7fcc2411d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc22d9d700 1 --2- 172.21.15.146:0/2018857117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc2409e170 0x7fcc2411d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc22d9d700 1 -- 172.21.15.146:0/2018857117 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc180094a0 con 0x7fcc24130ce0 2023-10-03T10:18:47.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc21d9b700 1 --2- 172.21.15.146:0/2018857117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc2409e170 0x7fcc2411d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc2259c700 1 --2- 172.21.15.146:0/2018857117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc2409d860 0x7fcc2411d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc22d9d700 1 --2- 172.21.15.146:0/2018857117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc24130ce0 0x7fcc2411daa0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c019000 tx=0x7fcc1c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc12ffd700 1 -- 172.21.15.146:0/2018857117 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c00ba00 con 0x7fcc24130ce0 2023-10-03T10:18:47.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc12ffd700 1 -- 172.21.15.146:0/2018857117 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c00bb80 con 0x7fcc24130ce0 2023-10-03T10:18:47.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc12ffd700 1 -- 172.21.15.146:0/2018857117 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c004040 con 0x7fcc24130ce0 2023-10-03T10:18:47.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc28c15700 1 -- 172.21.15.146:0/2018857117 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc140094a0 con 0x7fcc24130ce0 2023-10-03T10:18:47.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.518+0000 7fcc28c15700 1 -- 172.21.15.146:0/2018857117 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1c00f050 con 0x7fcc24130ce0 2023-10-03T10:18:47.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.519+0000 7fcc12ffd700 1 -- 172.21.15.146:0/2018857117 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcc1c0041a0 con 0x7fcc24130ce0 2023-10-03T10:18:47.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.519+0000 7fcc12ffd700 1 -- 172.21.15.146:0/2018857117 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcc1c0454d0 con 0x7fcc24130ce0 2023-10-03T10:18:47.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.519+0000 7fcc28c15700 1 -- 172.21.15.146:0/2018857117 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2404f2a0 con 0x7fcc24130ce0 2023-10-03T10:18:47.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.524+0000 7fcc12ffd700 1 -- 172.21.15.146:0/2018857117 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcc1c02d020 con 0x7fcc24130ce0 2023-10-03T10:18:47.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.709+0000 7fcc28c15700 1 -- 172.21.15.146:0/2018857117 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcc2411fe40 con 0x7fcc24130ce0 2023-10-03T10:18:47.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.709+0000 7fcc12ffd700 1 -- 172.21.15.146:0/2018857117 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcc1c004450 con 0x7fcc24130ce0 2023-10-03T10:18:47.710 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:47.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.711+0000 7fcc28c15700 1 -- 172.21.15.146:0/2018857117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc24130ce0 msgr2=0x7fcc2411daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.711+0000 7fcc28c15700 1 --2- 172.21.15.146:0/2018857117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc24130ce0 0x7fcc2411daa0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c019000 tx=0x7fcc1c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.712+0000 7fcc28c15700 1 -- 172.21.15.146:0/2018857117 shutdown_connections 2023-10-03T10:18:47.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.712+0000 7fcc28c15700 1 --2- 172.21.15.146:0/2018857117 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc24130ce0 0x7fcc2411daa0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.712+0000 7fcc28c15700 1 --2- 172.21.15.146:0/2018857117 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc2409d860 0x7fcc2411d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.712+0000 7fcc28c15700 1 --2- 172.21.15.146:0/2018857117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc2409e170 0x7fcc2411d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.712+0000 7fcc28c15700 1 -- 172.21.15.146:0/2018857117 >> 172.21.15.146:0/2018857117 conn(0x7fcc24099c40 msgr2=0x7fcc2412ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.712+0000 7fcc28c15700 1 -- 172.21.15.146:0/2018857117 shutdown_connections 2023-10-03T10:18:47.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:47.712+0000 7fcc28c15700 1 -- 172.21.15.146:0/2018857117 wait complete. 2023-10-03T10:18:47.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:48.273 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:48.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.400+0000 7f2123375700 1 Processor -- start 2023-10-03T10:18:48.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.400+0000 7f2123375700 1 -- start start 2023-10-03T10:18:48.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.400+0000 7f2123375700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f211c133660 0x7f211c135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.400+0000 7f2123375700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f211c135f80 0x7f211c138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.400+0000 7f2123375700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211c099a60 con 0x7f211c099e20 2023-10-03T10:18:48.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.400+0000 7f2123375700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c09bf50 con 0x7f211c135f80 2023-10-03T10:18:48.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.400+0000 7f2123375700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f211c09b230 con 0x7f211c133660 2023-10-03T10:18:48.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.401+0000 7f2120910700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f211c133660 0x7f211c135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.401+0000 7f2121912700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f211c135f80 0x7f211c138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.401+0000 7f2121111700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f211c099e20 0x7f211c09a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48968/0 (socket says 172.21.15.146:48968) 2023-10-03T10:18:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.401+0000 7f2121111700 1 -- 172.21.15.146:0/1160833208 learned_addr learned my addr 172.21.15.146:0/1160833208 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.401+0000 7f2113fff700 1 -- 172.21.15.146:0/1160833208 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 284822171 0 0) 0x7f211c099a60 con 0x7f211c099e20 2023-10-03T10:18:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.401+0000 7f2120910700 1 -- 172.21.15.146:0/1160833208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f211c135f80 msgr2=0x7f211c138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.401+0000 7f2120910700 1 --2- 172.21.15.146:0/1160833208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f211c135f80 0x7f211c138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.401+0000 7f2120910700 1 -- 172.21.15.146:0/1160833208 >> v1:172.21.15.146:6789/0 conn(0x7f211c099e20 legacy=0x7f211c09a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.401+0000 7f2120910700 1 -- 172.21.15.146:0/1160833208 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c09bb90 con 0x7f211c133660 2023-10-03T10:18:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.401+0000 7f2121912700 1 --2- 172.21.15.146:0/1160833208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f211c135f80 0x7f211c138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.401+0000 7f2120910700 1 --2- 172.21.15.146:0/1160833208 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f211c133660 0x7f211c135a40 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f2118009870 tx=0x7f2118009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8ae513115f4216 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.401+0000 7f2113fff700 1 -- 172.21.15.146:0/1160833208 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118011830 con 0x7f211c133660 2023-10-03T10:18:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.401+0000 7f2113fff700 1 -- 172.21.15.146:0/1160833208 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2118011990 con 0x7f211c133660 2023-10-03T10:18:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.401+0000 7f2113fff700 1 -- 172.21.15.146:0/1160833208 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118011d20 con 0x7f211c133660 2023-10-03T10:18:48.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.402+0000 7f2123375700 1 -- 172.21.15.146:0/1160833208 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f211c133660 msgr2=0x7f211c135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.402+0000 7f2123375700 1 --2- 172.21.15.146:0/1160833208 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f211c133660 0x7f211c135a40 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f2118009870 tx=0x7f2118009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:48.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.402+0000 7f2123375700 1 -- 172.21.15.146:0/1160833208 shutdown_connections 2023-10-03T10:18:48.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.402+0000 7f2123375700 1 --2- 172.21.15.146:0/1160833208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f211c135f80 0x7f211c138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.402+0000 7f2123375700 1 --2- 172.21.15.146:0/1160833208 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f211c133660 0x7f211c135a40 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.402+0000 7f2123375700 1 -- 172.21.15.146:0/1160833208 >> 172.21.15.146:0/1160833208 conn(0x7f211c0a2980 msgr2=0x7f211c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.402+0000 7f2123375700 1 -- 172.21.15.146:0/1160833208 shutdown_connections 2023-10-03T10:18:48.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.402+0000 7f2123375700 1 -- 172.21.15.146:0/1160833208 wait complete. 2023-10-03T10:18:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.403+0000 7f2123375700 1 Processor -- start 2023-10-03T10:18:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.403+0000 7f2123375700 1 -- start start 2023-10-03T10:18:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.403+0000 7f2123375700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f211c099e20 0x7f211c1c5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.403+0000 7f2123375700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f211c133660 0x7f211c1c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.403+0000 7f2123375700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f211c135f80 0x7f211c118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.403+0000 7f2123375700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c12dde0 con 0x7f211c099e20 2023-10-03T10:18:48.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.403+0000 7f2123375700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c11b490 con 0x7f211c133660 2023-10-03T10:18:48.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.403+0000 7f2123375700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f211c09b470 con 0x7f211c135f80 2023-10-03T10:18:48.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.403+0000 7f2121111700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f211c099e20 0x7f211c1c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.403+0000 7f2120910700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f211c133660 0x7f211c1c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.403+0000 7f2121912700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f211c135f80 0x7f211c118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.403+0000 7f2121111700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f211c099e20 0x7f211c1c5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53918/0 (socket says 172.21.15.146:53918) 2023-10-03T10:18:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.403+0000 7f2120910700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f211c133660 0x7f211c1c58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51042/0 (socket says 172.21.15.146:51042) 2023-10-03T10:18:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.403+0000 7f2121111700 1 -- 172.21.15.146:0/692917461 learned_addr learned my addr 172.21.15.146:0/692917461 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.404+0000 7f2121111700 1 -- 172.21.15.146:0/692917461 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f211c135f80 msgr2=0x7f211c118df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.404+0000 7f2121111700 1 --2- 172.21.15.146:0/692917461 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f211c135f80 0x7f211c118df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.404+0000 7f2121111700 1 -- 172.21.15.146:0/692917461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f211c133660 msgr2=0x7f211c1c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.404+0000 7f2121111700 1 --2- 172.21.15.146:0/692917461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f211c133660 0x7f211c1c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.404+0000 7f2121111700 1 -- 172.21.15.146:0/692917461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2114009a70 con 0x7f211c099e20 2023-10-03T10:18:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.404+0000 7f2121912700 1 --2- 172.21.15.146:0/692917461 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f211c135f80 0x7f211c118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.404+0000 7f2120910700 1 --2- 172.21.15.146:0/692917461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f211c133660 0x7f211c1c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.404+0000 7f2121111700 1 --2- 172.21.15.146:0/692917461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f211c099e20 0x7f211c1c5370 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f210c00c6d0 tx=0x7f210c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.404+0000 7f2111ffb700 1 -- 172.21.15.146:0/692917461 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c0074e0 con 0x7f211c099e20 2023-10-03T10:18:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.404+0000 7f2111ffb700 1 -- 172.21.15.146:0/692917461 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c007640 con 0x7f211c099e20 2023-10-03T10:18:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.404+0000 7f2123375700 1 -- 172.21.15.146:0/692917461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21180094a0 con 0x7f211c099e20 2023-10-03T10:18:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.404+0000 7f2111ffb700 1 -- 172.21.15.146:0/692917461 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c005a70 con 0x7f211c099e20 2023-10-03T10:18:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.404+0000 7f2123375700 1 -- 172.21.15.146:0/692917461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211c071460 con 0x7f211c099e20 2023-10-03T10:18:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.405+0000 7f2111ffb700 1 -- 172.21.15.146:0/692917461 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f210c005bd0 con 0x7f211c099e20 2023-10-03T10:18:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.405+0000 7f2111ffb700 1 -- 172.21.15.146:0/692917461 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f210c03ea80 con 0x7f211c099e20 2023-10-03T10:18:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.405+0000 7f2123375700 1 -- 172.21.15.146:0/692917461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211c072480 con 0x7f211c099e20 2023-10-03T10:18:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.410+0000 7f2111ffb700 1 -- 172.21.15.146:0/692917461 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f211c072480 con 0x7f211c099e20 2023-10-03T10:18:48.440 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:48.484 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:48.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.568+0000 7f3f41a39700 1 Processor -- start 2023-10-03T10:18:48.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.568+0000 7f3f41a39700 1 -- start start 2023-10-03T10:18:48.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.568+0000 7f3f41a39700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f3c12d280 0x7f3f3c12d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.568+0000 7f3f41a39700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3f3c130350 0x7f3f3c1307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.568+0000 7f3f41a39700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f3c09ae40 con 0x7f3f3c130ce0 2023-10-03T10:18:48.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.568+0000 7f3f41a39700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3c09b9a0 con 0x7f3f3c130350 2023-10-03T10:18:48.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.568+0000 7f3f41a39700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c09bbb0 con 0x7f3f3c12d280 2023-10-03T10:18:48.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.569+0000 7f3f3a7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3f3c130350 0x7f3f3c1307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.569+0000 7f3f3affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f3c12d280 0x7f3f3c12d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.569+0000 7f3f3b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3f3c130ce0 0x7f3f3c137680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48982/0 (socket says 172.21.15.146:48982) 2023-10-03T10:18:48.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.569+0000 7f3f3b7fe700 1 -- 172.21.15.146:0/714949710 learned_addr learned my addr 172.21.15.146:0/714949710 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:48.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.569+0000 7f3f3a7fc700 1 -- 172.21.15.146:0/714949710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f3c12d280 msgr2=0x7f3f3c12d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:48.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.569+0000 7f3f3a7fc700 1 --2- 172.21.15.146:0/714949710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f3c12d280 0x7f3f3c12d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.569+0000 7f3f3a7fc700 1 -- 172.21.15.146:0/714949710 >> v1:172.21.15.146:6789/0 conn(0x7f3f3c130ce0 legacy=0x7f3f3c137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.569+0000 7f3f39ffb700 1 -- 172.21.15.146:0/714949710 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677386311 0 0) 0x7f3f3c09ae40 con 0x7f3f3c130ce0 2023-10-03T10:18:48.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.569+0000 7f3f3a7fc700 1 -- 172.21.15.146:0/714949710 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c09b250 con 0x7f3f3c130350 2023-10-03T10:18:48.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.569+0000 7f3f3affd700 1 --2- 172.21.15.146:0/714949710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f3c12d280 0x7f3f3c12d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:48.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.569+0000 7f3f3a7fc700 1 --2- 172.21.15.146:0/714949710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f3c130350 0x7f3f3c1307a0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f3f30009840 tx=0x7f3f30009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9492ab600054c73 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.569+0000 7f3f39ffb700 1 -- 172.21.15.146:0/714949710 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f30011830 con 0x7f3f3c130350 2023-10-03T10:18:48.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.569+0000 7f3f39ffb700 1 -- 172.21.15.146:0/714949710 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f30011990 con 0x7f3f3c130350 2023-10-03T10:18:48.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.569+0000 7f3f39ffb700 1 -- 172.21.15.146:0/714949710 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f30011d20 con 0x7f3f3c130350 2023-10-03T10:18:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.570+0000 7f3f41a39700 1 -- 172.21.15.146:0/714949710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f3c130350 msgr2=0x7f3f3c1307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.570+0000 7f3f41a39700 1 --2- 172.21.15.146:0/714949710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f3c130350 0x7f3f3c1307a0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f3f30009840 tx=0x7f3f30009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.570+0000 7f3f41a39700 1 -- 172.21.15.146:0/714949710 shutdown_connections 2023-10-03T10:18:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.570+0000 7f3f41a39700 1 --2- 172.21.15.146:0/714949710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f3c12d280 0x7f3f3c12d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.570+0000 7f3f41a39700 1 --2- 172.21.15.146:0/714949710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f3c130350 0x7f3f3c1307a0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.570+0000 7f3f41a39700 1 -- 172.21.15.146:0/714949710 >> 172.21.15.146:0/714949710 conn(0x7f3f3c0a2980 msgr2=0x7f3f3c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.570+0000 7f3f41a39700 1 -- 172.21.15.146:0/714949710 shutdown_connections 2023-10-03T10:18:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.570+0000 7f3f41a39700 1 -- 172.21.15.146:0/714949710 wait complete. 2023-10-03T10:18:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.572+0000 7f3f41a39700 1 Processor -- start 2023-10-03T10:18:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.572+0000 7f3f41a39700 1 -- start start 2023-10-03T10:18:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.572+0000 7f3f41a39700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f3c12d280 0x7f3f3c1c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.572+0000 7f3f41a39700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f3c130350 0x7f3f3c1c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.573+0000 7f3f41a39700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f3c130ce0 0x7f3f3c139db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.573+0000 7f3f41a39700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c132220 con 0x7f3f3c12d280 2023-10-03T10:18:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.573+0000 7f3f41a39700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c1c80c0 con 0x7f3f3c130ce0 2023-10-03T10:18:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.573+0000 7f3f41a39700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c12e370 con 0x7f3f3c130350 2023-10-03T10:18:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.573+0000 7f3f3a7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f3c130350 0x7f3f3c1c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.573+0000 7f3f3affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f3c12d280 0x7f3f3c1c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.573+0000 7f3f3a7fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f3c130350 0x7f3f3c1c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35214/0 (socket says 172.21.15.146:35214) 2023-10-03T10:18:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.573+0000 7f3f3a7fc700 1 -- 172.21.15.146:0/3529852675 learned_addr learned my addr 172.21.15.146:0/3529852675 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.573+0000 7f3f3b7fe700 1 --2- 172.21.15.146:0/3529852675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f3c130ce0 0x7f3f3c139db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.573+0000 7f3f3affd700 1 -- 172.21.15.146:0/3529852675 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f3c130350 msgr2=0x7f3f3c1c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.573+0000 7f3f3affd700 1 --2- 172.21.15.146:0/3529852675 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f3c130350 0x7f3f3c1c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.573+0000 7f3f3affd700 1 -- 172.21.15.146:0/3529852675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f3c130ce0 msgr2=0x7f3f3c139db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.573+0000 7f3f3affd700 1 --2- 172.21.15.146:0/3529852675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f3c130ce0 0x7f3f3c139db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.573+0000 7f3f3affd700 1 -- 172.21.15.146:0/3529852675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c009430 con 0x7f3f3c12d280 2023-10-03T10:18:48.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.573+0000 7f3f3affd700 1 --2- 172.21.15.146:0/3529852675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f3c12d280 0x7f3f3c1c8480 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00e9b0 tx=0x7f3f2c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.573+0000 7f3f23fff700 1 -- 172.21.15.146:0/3529852675 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c00ee50 con 0x7f3f3c12d280 2023-10-03T10:18:48.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.573+0000 7f3f23fff700 1 -- 172.21.15.146:0/3529852675 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2c005a20 con 0x7f3f3c12d280 2023-10-03T10:18:48.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.573+0000 7f3f23fff700 1 -- 172.21.15.146:0/3529852675 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c005db0 con 0x7f3f3c12d280 2023-10-03T10:18:48.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.573+0000 7f3f41a39700 1 -- 172.21.15.146:0/3529852675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f300094a0 con 0x7f3f3c12d280 2023-10-03T10:18:48.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.573+0000 7f3f41a39700 1 -- 172.21.15.146:0/3529852675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3c13b090 con 0x7f3f3c12d280 2023-10-03T10:18:48.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.574+0000 7f3f41a39700 1 -- 172.21.15.146:0/3529852675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f3c04f2a0 con 0x7f3f3c12d280 2023-10-03T10:18:48.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.575+0000 7f3f23fff700 1 -- 172.21.15.146:0/3529852675 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f2c00c850 con 0x7f3f3c12d280 2023-10-03T10:18:48.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.575+0000 7f3f23fff700 1 -- 172.21.15.146:0/3529852675 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3f2c03fce0 con 0x7f3f3c12d280 2023-10-03T10:18:48.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.583+0000 7f3f23fff700 1 -- 172.21.15.146:0/3529852675 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f2c00ccf0 con 0x7f3f3c12d280 2023-10-03T10:18:48.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.610+0000 7f2123375700 1 -- 172.21.15.146:0/692917461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f211c072480 con 0x7f211c099e20 2023-10-03T10:18:48.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.610+0000 7f2111ffb700 1 -- 172.21.15.146:0/692917461 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f211c072480 con 0x7f211c099e20 2023-10-03T10:18:48.611 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:48.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.612+0000 7fdf0ef9e700 1 Processor -- start 2023-10-03T10:18:48.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.612+0000 7fdf0ef9e700 1 -- start start 2023-10-03T10:18:48.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.612+0000 7f2123375700 1 -- 172.21.15.146:0/692917461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f211c099e20 msgr2=0x7f211c1c5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.612+0000 7f2123375700 1 --2- 172.21.15.146:0/692917461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f211c099e20 0x7f211c1c5370 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f210c00c6d0 tx=0x7f210c00c9e0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.613+0000 7f2123375700 1 -- 172.21.15.146:0/692917461 shutdown_connections 2023-10-03T10:18:48.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.613+0000 7f2123375700 1 --2- 172.21.15.146:0/692917461 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f211c135f80 0x7f211c118df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.613+0000 7f2123375700 1 --2- 172.21.15.146:0/692917461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f211c099e20 0x7f211c1c5370 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.613+0000 7f2123375700 1 --2- 172.21.15.146:0/692917461 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f211c133660 0x7f211c1c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.613+0000 7f2123375700 1 -- 172.21.15.146:0/692917461 >> 172.21.15.146:0/692917461 conn(0x7f211c0a2980 msgr2=0x7f211c133a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.613+0000 7f2123375700 1 -- 172.21.15.146:0/692917461 shutdown_connections 2023-10-03T10:18:48.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.613+0000 7f2123375700 1 -- 172.21.15.146:0/692917461 wait complete. 2023-10-03T10:18:48.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.613+0000 7fdf0ef9e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdf0809bb60 0x7fdf0809e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.613+0000 7fdf0ef9e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0812cf70 0x7fdf08130010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.613+0000 7fdf0ef9e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf08130550 0x7fdf081309d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.613+0000 7fdf0ef9e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0809bf30 con 0x7fdf0809bb60 2023-10-03T10:18:48.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.613+0000 7fdf0ef9e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0809a8e0 con 0x7fdf0812cf70 2023-10-03T10:18:48.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.613+0000 7fdf0ef9e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0809b0a0 con 0x7fdf08130550 2023-10-03T10:18:48.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.613+0000 7fdf0d79b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0812cf70 0x7fdf08130010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.613+0000 7fdf0df9c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdf0809bb60 0x7fdf0809e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.613+0000 7fdf0d79b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0812cf70 0x7fdf08130010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51072/0 (socket says 172.21.15.146:51072) 2023-10-03T10:18:48.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.613+0000 7fdf0d79b700 1 -- 172.21.15.146:0/3981718510 learned_addr learned my addr 172.21.15.146:0/3981718510 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:48.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.613+0000 7fdf0e79d700 1 --2- 172.21.15.146:0/3981718510 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf08130550 0x7fdf081309d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.613+0000 7fdf0d79b700 1 -- 172.21.15.146:0/3981718510 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf08130550 msgr2=0x7fdf081309d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:48.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.613+0000 7fdf0d79b700 1 --2- 172.21.15.146:0/3981718510 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf08130550 0x7fdf081309d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.613+0000 7fdf0d79b700 1 -- 172.21.15.146:0/3981718510 >> v2:172.21.15.146:3300/0 conn(0x7fdf0809bb60 msgr2=0x7fdf0809e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:48.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.613+0000 7fdf0d79b700 1 --2- 172.21.15.146:0/3981718510 >> v2:172.21.15.146:3300/0 conn(0x7fdf0809bb60 0x7fdf0809e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.614+0000 7fdf0d79b700 1 -- 172.21.15.146:0/3981718510 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0809aaa0 con 0x7fdf0812cf70 2023-10-03T10:18:48.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.614+0000 7fdf0df9c700 1 --2- 172.21.15.146:0/3981718510 >> v2:172.21.15.146:3300/0 conn(0x7fdf0809bb60 0x7fdf0809e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:48.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.614+0000 7fdf0e79d700 1 --2- 172.21.15.146:0/3981718510 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf08130550 0x7fdf081309d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:48.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.614+0000 7fdf0d79b700 1 --2- 172.21.15.146:0/3981718510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0812cf70 0x7fdf08130010 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fdef800b9a0 tx=0x7fdef800bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=857bc0cfe9723ef1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.614+0000 7fdf0cf9a700 1 -- 172.21.15.146:0/3981718510 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef800caa0 con 0x7fdf0812cf70 2023-10-03T10:18:48.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.614+0000 7fdf0cf9a700 1 -- 172.21.15.146:0/3981718510 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef800cc00 con 0x7fdf0812cf70 2023-10-03T10:18:48.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.614+0000 7fdf0cf9a700 1 -- 172.21.15.146:0/3981718510 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef800f460 con 0x7fdf0812cf70 2023-10-03T10:18:48.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.615+0000 7fdf0ef9e700 1 -- 172.21.15.146:0/3981718510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0812cf70 msgr2=0x7fdf08130010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.615+0000 7fdf0ef9e700 1 --2- 172.21.15.146:0/3981718510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0812cf70 0x7fdf08130010 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fdef800b9a0 tx=0x7fdef800bcb0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.615+0000 7fdf0ef9e700 1 -- 172.21.15.146:0/3981718510 shutdown_connections 2023-10-03T10:18:48.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.615+0000 7fdf0ef9e700 1 --2- 172.21.15.146:0/3981718510 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf08130550 0x7fdf081309d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.615+0000 7fdf0ef9e700 1 --2- 172.21.15.146:0/3981718510 >> v2:172.21.15.146:3300/0 conn(0x7fdf0809bb60 0x7fdf0809e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.615+0000 7fdf0ef9e700 1 --2- 172.21.15.146:0/3981718510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0812cf70 0x7fdf08130010 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.615+0000 7fdf0ef9e700 1 -- 172.21.15.146:0/3981718510 >> 172.21.15.146:0/3981718510 conn(0x7fdf080a2d80 msgr2=0x7fdf080a3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.615+0000 7fdf0ef9e700 1 -- 172.21.15.146:0/3981718510 shutdown_connections 2023-10-03T10:18:48.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.615+0000 7fdf0ef9e700 1 -- 172.21.15.146:0/3981718510 wait complete. 2023-10-03T10:18:48.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.616+0000 7fdf0ef9e700 1 Processor -- start 2023-10-03T10:18:48.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.616+0000 7fdf0ef9e700 1 -- start start 2023-10-03T10:18:48.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.616+0000 7fdf0ef9e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0809bb60 0x7fdf081c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.616+0000 7fdf0ef9e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf0812cf70 0x7fdf081c4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.616+0000 7fdf0ef9e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf08130550 0x7fdf081c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.616+0000 7fdf0ef9e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0809d6f0 con 0x7fdf08130550 2023-10-03T10:18:48.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.616+0000 7fdf0ef9e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf08129f90 con 0x7fdf0809bb60 2023-10-03T10:18:48.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.616+0000 7fdf0ef9e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0811ba00 con 0x7fdf0812cf70 2023-10-03T10:18:48.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.616+0000 7fdf0df9c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0809bb60 0x7fdf081c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.616+0000 7fdf0df9c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0809bb60 0x7fdf081c41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51082/0 (socket says 172.21.15.146:51082) 2023-10-03T10:18:48.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.616+0000 7fdf0df9c700 1 -- 172.21.15.146:0/1226672224 learned_addr learned my addr 172.21.15.146:0/1226672224 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:48.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.616+0000 7fdf0d79b700 1 --2- 172.21.15.146:0/1226672224 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf0812cf70 0x7fdf081c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.617+0000 7fdf0e79d700 1 --2- 172.21.15.146:0/1226672224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf08130550 0x7fdf081c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.617+0000 7fdf0d79b700 1 -- 172.21.15.146:0/1226672224 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0809bb60 msgr2=0x7fdf081c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.617+0000 7fdf0d79b700 1 --2- 172.21.15.146:0/1226672224 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0809bb60 0x7fdf081c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.617+0000 7fdf0d79b700 1 -- 172.21.15.146:0/1226672224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf08130550 msgr2=0x7fdf081c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.617+0000 7fdf0d79b700 1 --2- 172.21.15.146:0/1226672224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf08130550 0x7fdf081c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.617+0000 7fdf0d79b700 1 -- 172.21.15.146:0/1226672224 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0400d940 con 0x7fdf0812cf70 2023-10-03T10:18:48.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.617+0000 7fdf0e79d700 1 --2- 172.21.15.146:0/1226672224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf08130550 0x7fdf081c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:48.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.617+0000 7fdf0d79b700 1 --2- 172.21.15.146:0/1226672224 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf0812cf70 0x7fdf081c4710 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fdef8016000 tx=0x7fdef8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.617+0000 7fdefe7fc700 1 -- 172.21.15.146:0/1226672224 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef801c070 con 0x7fdf0812cf70 2023-10-03T10:18:48.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.617+0000 7fdefe7fc700 1 -- 172.21.15.146:0/1226672224 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef800c8a0 con 0x7fdf0812cf70 2023-10-03T10:18:48.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.617+0000 7fdf0ef9e700 1 -- 172.21.15.146:0/1226672224 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf00009a70 con 0x7fdf0812cf70 2023-10-03T10:18:48.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.617+0000 7fdefe7fc700 1 -- 172.21.15.146:0/1226672224 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef8004270 con 0x7fdf0812cf70 2023-10-03T10:18:48.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.617+0000 7fdf0ef9e700 1 -- 172.21.15.146:0/1226672224 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef800b600 con 0x7fdf0812cf70 2023-10-03T10:18:48.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.618+0000 7fdefe7fc700 1 -- 172.21.15.146:0/1226672224 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdef80043d0 con 0x7fdf0812cf70 2023-10-03T10:18:48.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.618+0000 7fdefe7fc700 1 -- 172.21.15.146:0/1226672224 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fdef8040820 con 0x7fdf0812cf70 2023-10-03T10:18:48.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.619+0000 7fdf0ef9e700 1 -- 172.21.15.146:0/1226672224 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf08130220 con 0x7fdf0812cf70 2023-10-03T10:18:48.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.623+0000 7fdefe7fc700 1 -- 172.21.15.146:0/1226672224 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdef8025080 con 0x7fdf0812cf70 2023-10-03T10:18:48.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:48.725 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:48.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.780+0000 7f3f41a39700 1 -- 172.21.15.146:0/3529852675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3f3c132080 con 0x7f3f3c12d280 2023-10-03T10:18:48.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.780+0000 7f3f23fff700 1 -- 172.21.15.146:0/3529852675 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3f3c132080 con 0x7f3f3c12d280 2023-10-03T10:18:48.781 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:48.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.782+0000 7f3f41a39700 1 -- 172.21.15.146:0/3529852675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f3c12d280 msgr2=0x7f3f3c1c8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.782+0000 7f3f41a39700 1 --2- 172.21.15.146:0/3529852675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f3c12d280 0x7f3f3c1c8480 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00e9b0 tx=0x7f3f2c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.782+0000 7f3f41a39700 1 -- 172.21.15.146:0/3529852675 shutdown_connections 2023-10-03T10:18:48.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.782+0000 7f3f41a39700 1 --2- 172.21.15.146:0/3529852675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f3c130ce0 0x7f3f3c139db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.782+0000 7f3f41a39700 1 --2- 172.21.15.146:0/3529852675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f3c12d280 0x7f3f3c1c8480 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.782+0000 7f3f41a39700 1 --2- 172.21.15.146:0/3529852675 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3f3c130350 0x7f3f3c1c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.782+0000 7f3f41a39700 1 -- 172.21.15.146:0/3529852675 >> 172.21.15.146:0/3529852675 conn(0x7f3f3c0a2980 msgr2=0x7f3f3c0a0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.782+0000 7f3f41a39700 1 -- 172.21.15.146:0/3529852675 shutdown_connections 2023-10-03T10:18:48.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.782+0000 7f3f41a39700 1 -- 172.21.15.146:0/3529852675 wait complete. 2023-10-03T10:18:48.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:48.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.818+0000 7fdf0ef9e700 1 -- 172.21.15.146:0/1226672224 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdf0804f2a0 con 0x7fdf0812cf70 2023-10-03T10:18:48.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.819+0000 7fdefe7fc700 1 -- 172.21.15.146:0/1226672224 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdef8027310 con 0x7fdf0812cf70 2023-10-03T10:18:48.819 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:48.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.821+0000 7fdf0ef9e700 1 -- 172.21.15.146:0/1226672224 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf0812cf70 msgr2=0x7fdf081c4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.821+0000 7fdf0ef9e700 1 --2- 172.21.15.146:0/1226672224 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf0812cf70 0x7fdf081c4710 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fdef8016000 tx=0x7fdef8004750 comp rx=0 tx=0).stop 2023-10-03T10:18:48.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.821+0000 7fdf0ef9e700 1 -- 172.21.15.146:0/1226672224 shutdown_connections 2023-10-03T10:18:48.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.821+0000 7fdf0ef9e700 1 --2- 172.21.15.146:0/1226672224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf08130550 0x7fdf081c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.821+0000 7fdf0ef9e700 1 --2- 172.21.15.146:0/1226672224 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf0809bb60 0x7fdf081c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.821+0000 7fdf0ef9e700 1 --2- 172.21.15.146:0/1226672224 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fdf0812cf70 0x7fdf081c4710 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.821+0000 7fdf0ef9e700 1 -- 172.21.15.146:0/1226672224 >> 172.21.15.146:0/1226672224 conn(0x7fdf080a2d80 msgr2=0x7fdf0809f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.821+0000 7fdf0ef9e700 1 -- 172.21.15.146:0/1226672224 shutdown_connections 2023-10-03T10:18:48.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.821+0000 7fdf0ef9e700 1 -- 172.21.15.146:0/1226672224 wait complete. 2023-10-03T10:18:48.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:48.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.853+0000 7ff444e73700 1 Processor -- start 2023-10-03T10:18:48.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.853+0000 7ff444e73700 1 -- start start 2023-10-03T10:18:48.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.854+0000 7ff444e73700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4400a0a70 0x7ff4400a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.854+0000 7ff444e73700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4400a1380 0x7ff440133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.854+0000 7ff444e73700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff440133f50 0x7ff4401343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.854+0000 7ff444e73700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44009e9d0 con 0x7ff440133f50 2023-10-03T10:18:48.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.854+0000 7ff444e73700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44009dc00 con 0x7ff4400a0a70 2023-10-03T10:18:48.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.854+0000 7ff444e73700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff44009dec0 con 0x7ff4400a1380 2023-10-03T10:18:48.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.854+0000 7ff43e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4400a0a70 0x7ff4400a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.854+0000 7ff43ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff440133f50 0x7ff4401343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.854+0000 7ff43dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4400a1380 0x7ff440133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.854+0000 7ff43ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff440133f50 0x7ff4401343f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53972/0 (socket says 172.21.15.146:53972) 2023-10-03T10:18:48.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.854+0000 7ff43e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4400a0a70 0x7ff4400a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51088/0 (socket says 172.21.15.146:51088) 2023-10-03T10:18:48.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.854+0000 7ff43ed9d700 1 -- 172.21.15.146:0/1819831226 learned_addr learned my addr 172.21.15.146:0/1819831226 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:48.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.855+0000 7ff43ed9d700 1 -- 172.21.15.146:0/1819831226 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4400a1380 msgr2=0x7ff440133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:48.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.855+0000 7ff43ed9d700 1 --2- 172.21.15.146:0/1819831226 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4400a1380 0x7ff440133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.855+0000 7ff43ed9d700 1 -- 172.21.15.146:0/1819831226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4400a0a70 msgr2=0x7ff4400a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:48.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.855+0000 7ff43ed9d700 1 --2- 172.21.15.146:0/1819831226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4400a0a70 0x7ff4400a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.855+0000 7ff43ed9d700 1 -- 172.21.15.146:0/1819831226 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44009e6a0 con 0x7ff440133f50 2023-10-03T10:18:48.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.855+0000 7ff43dd9b700 1 --2- 172.21.15.146:0/1819831226 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4400a1380 0x7ff440133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:48.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.855+0000 7ff43e59c700 1 --2- 172.21.15.146:0/1819831226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4400a0a70 0x7ff4400a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:48.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.855+0000 7ff43ed9d700 1 --2- 172.21.15.146:0/1819831226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff440133f50 0x7ff4401343f0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7ff438009e50 tx=0x7ff43800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a0eeaffcabd34b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.855+0000 7ff43d59a700 1 -- 172.21.15.146:0/1819831226 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43800e070 con 0x7ff440133f50 2023-10-03T10:18:48.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.855+0000 7ff43d59a700 1 -- 172.21.15.146:0/1819831226 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43800b910 con 0x7ff440133f50 2023-10-03T10:18:48.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.855+0000 7ff43d59a700 1 -- 172.21.15.146:0/1819831226 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43800bcc0 con 0x7ff440133f50 2023-10-03T10:18:48.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.855+0000 7ff444e73700 1 -- 172.21.15.146:0/1819831226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff440133f50 msgr2=0x7ff4401343f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.855+0000 7ff444e73700 1 --2- 172.21.15.146:0/1819831226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff440133f50 0x7ff4401343f0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7ff438009e50 tx=0x7ff43800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:48.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.856+0000 7ff444e73700 1 -- 172.21.15.146:0/1819831226 shutdown_connections 2023-10-03T10:18:48.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.856+0000 7ff444e73700 1 --2- 172.21.15.146:0/1819831226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4400a0a70 0x7ff4400a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.856+0000 7ff444e73700 1 --2- 172.21.15.146:0/1819831226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff440133f50 0x7ff4401343f0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.856+0000 7ff444e73700 1 --2- 172.21.15.146:0/1819831226 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4400a1380 0x7ff440133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.856+0000 7ff444e73700 1 -- 172.21.15.146:0/1819831226 >> 172.21.15.146:0/1819831226 conn(0x7ff4400a6610 msgr2=0x7ff4400a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.856+0000 7ff444e73700 1 -- 172.21.15.146:0/1819831226 shutdown_connections 2023-10-03T10:18:48.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.856+0000 7ff444e73700 1 -- 172.21.15.146:0/1819831226 wait complete. 2023-10-03T10:18:48.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.857+0000 7ff444e73700 1 Processor -- start 2023-10-03T10:18:48.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.857+0000 7ff444e73700 1 -- start start 2023-10-03T10:18:48.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.857+0000 7ff444e73700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4400a0a70 0x7ff44011f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.857+0000 7ff444e73700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4400a1380 0x7ff44011f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.857+0000 7ff444e73700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff440133f50 0x7ff44011fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.857+0000 7ff444e73700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff440122df0 con 0x7ff4400a0a70 2023-10-03T10:18:48.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.857+0000 7ff444e73700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4401228e0 con 0x7ff440133f50 2023-10-03T10:18:48.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.857+0000 7ff444e73700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff440121d80 con 0x7ff4400a1380 2023-10-03T10:18:48.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.857+0000 7ff43dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4400a1380 0x7ff44011f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.857+0000 7ff43ed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff440133f50 0x7ff44011fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.857+0000 7ff43dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4400a1380 0x7ff44011f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35240/0 (socket says 172.21.15.146:35240) 2023-10-03T10:18:48.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.857+0000 7ff43dd9b700 1 -- 172.21.15.146:0/2853319438 learned_addr learned my addr 172.21.15.146:0/2853319438 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:48.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.857+0000 7ff43e59c700 1 --2- 172.21.15.146:0/2853319438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4400a0a70 0x7ff44011f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.857+0000 7ff43dd9b700 1 -- 172.21.15.146:0/2853319438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff440133f50 msgr2=0x7ff44011fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.857+0000 7ff43dd9b700 1 --2- 172.21.15.146:0/2853319438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff440133f50 0x7ff44011fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.857+0000 7ff43dd9b700 1 -- 172.21.15.146:0/2853319438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4400a0a70 msgr2=0x7ff44011f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.857+0000 7ff43dd9b700 1 --2- 172.21.15.146:0/2853319438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4400a0a70 0x7ff44011f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.857+0000 7ff43dd9b700 1 -- 172.21.15.146:0/2853319438 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4340094a0 con 0x7ff4400a1380 2023-10-03T10:18:48.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.858+0000 7ff43ed9d700 1 --2- 172.21.15.146:0/2853319438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff440133f50 0x7ff44011fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:48.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.858+0000 7ff43dd9b700 1 --2- 172.21.15.146:0/2853319438 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4400a1380 0x7ff44011f810 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ff43000ebb0 tx=0x7ff43000eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.858+0000 7ff42effd700 1 -- 172.21.15.146:0/2853319438 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43000c850 con 0x7ff4400a1380 2023-10-03T10:18:48.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.858+0000 7ff42effd700 1 -- 172.21.15.146:0/2853319438 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43000c9b0 con 0x7ff4400a1380 2023-10-03T10:18:48.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.858+0000 7ff444e73700 1 -- 172.21.15.146:0/2853319438 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4300094a0 con 0x7ff4400a1380 2023-10-03T10:18:48.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.858+0000 7ff42effd700 1 -- 172.21.15.146:0/2853319438 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43000cd40 con 0x7ff4400a1380 2023-10-03T10:18:48.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.858+0000 7ff444e73700 1 -- 172.21.15.146:0/2853319438 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff438009b30 con 0x7ff4400a1380 2023-10-03T10:18:48.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.859+0000 7ff42effd700 1 -- 172.21.15.146:0/2853319438 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff430013470 con 0x7ff4400a1380 2023-10-03T10:18:48.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.859+0000 7ff444e73700 1 -- 172.21.15.146:0/2853319438 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44004f2a0 con 0x7ff4400a1380 2023-10-03T10:18:48.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.859+0000 7ff42effd700 1 -- 172.21.15.146:0/2853319438 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff43003fb50 con 0x7ff4400a1380 2023-10-03T10:18:48.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:48.863+0000 7ff42effd700 1 -- 172.21.15.146:0/2853319438 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff430021020 con 0x7ff4400a1380 2023-10-03T10:18:49.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.050+0000 7ff444e73700 1 -- 172.21.15.146:0/2853319438 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff440120ee0 con 0x7ff4400a1380 2023-10-03T10:18:49.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.050+0000 7ff42effd700 1 -- 172.21.15.146:0/2853319438 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff430017070 con 0x7ff4400a1380 2023-10-03T10:18:49.051 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:49.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.052+0000 7ff444e73700 1 -- 172.21.15.146:0/2853319438 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4400a1380 msgr2=0x7ff44011f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.052+0000 7ff444e73700 1 --2- 172.21.15.146:0/2853319438 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4400a1380 0x7ff44011f810 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ff43000ebb0 tx=0x7ff43000eec0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.052+0000 7ff444e73700 1 -- 172.21.15.146:0/2853319438 shutdown_connections 2023-10-03T10:18:49.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.052+0000 7ff444e73700 1 --2- 172.21.15.146:0/2853319438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff440133f50 0x7ff44011fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.052+0000 7ff444e73700 1 --2- 172.21.15.146:0/2853319438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4400a0a70 0x7ff44011f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.052+0000 7ff444e73700 1 --2- 172.21.15.146:0/2853319438 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff4400a1380 0x7ff44011f810 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.052+0000 7ff444e73700 1 -- 172.21.15.146:0/2853319438 >> 172.21.15.146:0/2853319438 conn(0x7ff4400a6610 msgr2=0x7ff44009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.052+0000 7ff444e73700 1 -- 172.21.15.146:0/2853319438 shutdown_connections 2023-10-03T10:18:49.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.053+0000 7ff444e73700 1 -- 172.21.15.146:0/2853319438 wait complete. 2023-10-03T10:18:49.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:49.628 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:49.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.755+0000 7f9f00ce4700 1 Processor -- start 2023-10-03T10:18:49.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.755+0000 7f9f00ce4700 1 -- start start 2023-10-03T10:18:49.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.756+0000 7f9f00ce4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9efc133ad0 0x7f9efc133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.756+0000 7f9f00ce4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9efc130bc0 0x7f9efc13b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.756+0000 7f9f00ce4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9efc06b2d0 con 0x7f9efc1300a0 2023-10-03T10:18:49.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.756+0000 7f9f00ce4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9efc133610 con 0x7f9efc130bc0 2023-10-03T10:18:49.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.756+0000 7f9f00ce4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc09a500 con 0x7f9efc133ad0 2023-10-03T10:18:49.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.756+0000 7f9efa59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9efc133ad0 0x7f9efc133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.756+0000 7f9efad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9efc130bc0 0x7f9efc13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.756+0000 7f9ef9d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9efc1300a0 0x7f9efc1304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:48986/0 (socket says 172.21.15.146:48986) 2023-10-03T10:18:49.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.756+0000 7f9efad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9efc130bc0 0x7f9efc13b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54002/0 (socket says 172.21.15.146:54002) 2023-10-03T10:18:49.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.756+0000 7f9efa59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9efc133ad0 0x7f9efc133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51096/0 (socket says 172.21.15.146:51096) 2023-10-03T10:18:49.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.756+0000 7f9ef9d9b700 1 -- 172.21.15.146:0/4248960543 learned_addr learned my addr 172.21.15.146:0/4248960543 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:49.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.756+0000 7f9efa59c700 1 -- 172.21.15.146:0/4248960543 >> v2:172.21.15.146:3300/0 conn(0x7f9efc130bc0 msgr2=0x7f9efc13b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:49.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.756+0000 7f9efa59c700 1 --2- 172.21.15.146:0/4248960543 >> v2:172.21.15.146:3300/0 conn(0x7f9efc130bc0 0x7f9efc13b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.756+0000 7f9efa59c700 1 -- 172.21.15.146:0/4248960543 >> v1:172.21.15.146:6789/0 conn(0x7f9efc1300a0 legacy=0x7f9efc1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.756+0000 7f9efa59c700 1 -- 172.21.15.146:0/4248960543 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc1338b0 con 0x7f9efc133ad0 2023-10-03T10:18:49.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.756+0000 7f9ef959a700 1 -- 172.21.15.146:0/4248960543 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1386408122 0 0) 0x7f9efc06b2d0 con 0x7f9efc1300a0 2023-10-03T10:18:49.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.756+0000 7f9efad9d700 1 --2- 172.21.15.146:0/4248960543 >> v2:172.21.15.146:3300/0 conn(0x7f9efc130bc0 0x7f9efc13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:49.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.756+0000 7f9efa59c700 1 --2- 172.21.15.146:0/4248960543 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9efc133ad0 0x7f9efc133ea0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009840 tx=0x7f9ef0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17ee2efdcce6aea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.756+0000 7f9ef959a700 1 -- 172.21.15.146:0/4248960543 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0011830 con 0x7f9efc133ad0 2023-10-03T10:18:49.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.756+0000 7f9ef959a700 1 -- 172.21.15.146:0/4248960543 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef0011990 con 0x7f9efc133ad0 2023-10-03T10:18:49.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.756+0000 7f9ef959a700 1 -- 172.21.15.146:0/4248960543 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0011d20 con 0x7f9efc133ad0 2023-10-03T10:18:49.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.757+0000 7f9f00ce4700 1 -- 172.21.15.146:0/4248960543 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9efc133ad0 msgr2=0x7f9efc133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.757+0000 7f9f00ce4700 1 --2- 172.21.15.146:0/4248960543 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9efc133ad0 0x7f9efc133ea0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009840 tx=0x7f9ef0009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:49.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.757+0000 7f9f00ce4700 1 -- 172.21.15.146:0/4248960543 shutdown_connections 2023-10-03T10:18:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.757+0000 7f9f00ce4700 1 --2- 172.21.15.146:0/4248960543 >> v2:172.21.15.146:3300/0 conn(0x7f9efc130bc0 0x7f9efc13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.757+0000 7f9f00ce4700 1 --2- 172.21.15.146:0/4248960543 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9efc133ad0 0x7f9efc133ea0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.757+0000 7f9f00ce4700 1 -- 172.21.15.146:0/4248960543 >> 172.21.15.146:0/4248960543 conn(0x7f9efc099c40 msgr2=0x7f9efc0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.757+0000 7f9f00ce4700 1 -- 172.21.15.146:0/4248960543 shutdown_connections 2023-10-03T10:18:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.757+0000 7f9f00ce4700 1 -- 172.21.15.146:0/4248960543 wait complete. 2023-10-03T10:18:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.758+0000 7f9f00ce4700 1 Processor -- start 2023-10-03T10:18:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.758+0000 7f9f00ce4700 1 -- start start 2023-10-03T10:18:49.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9f00ce4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9efc1300a0 0x7f9efc11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9f00ce4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9efc130bc0 0x7f9efc11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9f00ce4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9efc133ad0 0x7f9efc11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9f00ce4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc120050 con 0x7f9efc133ad0 2023-10-03T10:18:49.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9f00ce4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc1209c0 con 0x7f9efc1300a0 2023-10-03T10:18:49.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9f00ce4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc071fd0 con 0x7f9efc130bc0 2023-10-03T10:18:49.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9efa59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9efc1300a0 0x7f9efc11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9ef9d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9efc130bc0 0x7f9efc11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9efad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9efc133ad0 0x7f9efc11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9efa59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9efc1300a0 0x7f9efc11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51104/0 (socket says 172.21.15.146:51104) 2023-10-03T10:18:49.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9efa59c700 1 -- 172.21.15.146:0/4010964975 learned_addr learned my addr 172.21.15.146:0/4010964975 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:49.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9ef9d9b700 1 -- 172.21.15.146:0/4010964975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9efc1300a0 msgr2=0x7f9efc11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9ef9d9b700 1 --2- 172.21.15.146:0/4010964975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9efc1300a0 0x7f9efc11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9ef9d9b700 1 -- 172.21.15.146:0/4010964975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9efc133ad0 msgr2=0x7f9efc11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9ef9d9b700 1 --2- 172.21.15.146:0/4010964975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9efc133ad0 0x7f9efc11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9ef9d9b700 1 -- 172.21.15.146:0/4010964975 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef4009a70 con 0x7f9efc130bc0 2023-10-03T10:18:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9efa59c700 1 --2- 172.21.15.146:0/4010964975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9efc1300a0 0x7f9efc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9efad9d700 1 --2- 172.21.15.146:0/4010964975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9efc133ad0 0x7f9efc11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9ef9d9b700 1 --2- 172.21.15.146:0/4010964975 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9efc130bc0 0x7f9efc11df80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9efc09ea20 tx=0x7f9eec00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9eeaffd700 1 -- 172.21.15.146:0/4010964975 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec004a70 con 0x7f9efc130bc0 2023-10-03T10:18:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9eeaffd700 1 -- 172.21.15.146:0/4010964975 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eec004bd0 con 0x7f9efc130bc0 2023-10-03T10:18:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9f00ce4700 1 -- 172.21.15.146:0/4010964975 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef00094a0 con 0x7f9efc130bc0 2023-10-03T10:18:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9eeaffd700 1 -- 172.21.15.146:0/4010964975 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec0070d0 con 0x7f9efc130bc0 2023-10-03T10:18:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.759+0000 7f9f00ce4700 1 -- 172.21.15.146:0/4010964975 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9efc11f2e0 con 0x7f9efc130bc0 2023-10-03T10:18:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.760+0000 7f9eeaffd700 1 -- 172.21.15.146:0/4010964975 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9eec007230 con 0x7f9efc130bc0 2023-10-03T10:18:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.760+0000 7f9eeaffd700 1 -- 172.21.15.146:0/4010964975 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f9eec03f170 con 0x7f9efc130bc0 2023-10-03T10:18:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.760+0000 7f9f00ce4700 1 -- 172.21.15.146:0/4010964975 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9efc11fa10 con 0x7f9efc130bc0 2023-10-03T10:18:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.765+0000 7f9eeaffd700 1 -- 172.21.15.146:0/4010964975 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9efc11fa10 con 0x7f9efc130bc0 2023-10-03T10:18:49.796 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:49.835 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:49.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.924+0000 7f43f3fde700 1 Processor -- start 2023-10-03T10:18:49.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.924+0000 7f43f3fde700 1 -- start start 2023-10-03T10:18:49.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.925+0000 7f43f3fde700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ec131980 0x7f43ec131d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.925+0000 7f43f3fde700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43ec09c790 0x7f43ec139710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.925+0000 7f43f3fde700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ec0a1640 con 0x7f43ec09bc70 2023-10-03T10:18:49.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.925+0000 7f43f3fde700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec06eb30 con 0x7f43ec09c790 2023-10-03T10:18:49.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.925+0000 7f43f3fde700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec0a22d0 con 0x7f43ec131980 2023-10-03T10:18:49.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.925+0000 7f43f1d7a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ec131980 0x7f43ec131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.925+0000 7f43f1579700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f43ec09bc70 0x7f43ec09c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49002/0 (socket says 172.21.15.146:49002) 2023-10-03T10:18:49.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.925+0000 7f43f1579700 1 -- 172.21.15.146:0/3076560331 learned_addr learned my addr 172.21.15.146:0/3076560331 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:49.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.925+0000 7f43f257b700 1 --2- 172.21.15.146:0/3076560331 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43ec09c790 0x7f43ec139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.925+0000 7f43f1d7a700 1 -- 172.21.15.146:0/3076560331 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43ec09c790 msgr2=0x7f43ec139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:49.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.925+0000 7f43f1d7a700 1 --2- 172.21.15.146:0/3076560331 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43ec09c790 0x7f43ec139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.925+0000 7f43f1d7a700 1 -- 172.21.15.146:0/3076560331 >> v1:172.21.15.146:6789/0 conn(0x7f43ec09bc70 legacy=0x7f43ec09c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.925+0000 7f43f1d7a700 1 -- 172.21.15.146:0/3076560331 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec131550 con 0x7f43ec131980 2023-10-03T10:18:49.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.925+0000 7f43f257b700 1 --2- 172.21.15.146:0/3076560331 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43ec09c790 0x7f43ec139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:49.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.925+0000 7f43f1d7a700 1 --2- 172.21.15.146:0/3076560331 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ec131980 0x7f43ec131d50 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009850 tx=0x7f43e8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39643481ddd671bf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.925+0000 7f43f0d78700 1 -- 172.21.15.146:0/3076560331 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e8005e30 con 0x7f43ec131980 2023-10-03T10:18:49.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.926+0000 7f43f0d78700 1 -- 172.21.15.146:0/3076560331 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e8004030 con 0x7f43ec131980 2023-10-03T10:18:49.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.926+0000 7f43f0d78700 1 -- 172.21.15.146:0/3076560331 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e80043e0 con 0x7f43ec131980 2023-10-03T10:18:49.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.926+0000 7f43f3fde700 1 -- 172.21.15.146:0/3076560331 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ec131980 msgr2=0x7f43ec131d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.926+0000 7f43f3fde700 1 --2- 172.21.15.146:0/3076560331 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ec131980 0x7f43ec131d50 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009850 tx=0x7f43e8009b60 comp rx=0 tx=0).stop 2023-10-03T10:18:49.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.926+0000 7f43f3fde700 1 -- 172.21.15.146:0/3076560331 shutdown_connections 2023-10-03T10:18:49.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.926+0000 7f43f3fde700 1 --2- 172.21.15.146:0/3076560331 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43ec09c790 0x7f43ec139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.926+0000 7f43f3fde700 1 --2- 172.21.15.146:0/3076560331 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ec131980 0x7f43ec131d50 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.926+0000 7f43f3fde700 1 -- 172.21.15.146:0/3076560331 >> 172.21.15.146:0/3076560331 conn(0x7f43ec0a2980 msgr2=0x7f43ec0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.926+0000 7f43f3fde700 1 -- 172.21.15.146:0/3076560331 shutdown_connections 2023-10-03T10:18:49.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.926+0000 7f43f3fde700 1 -- 172.21.15.146:0/3076560331 wait complete. 2023-10-03T10:18:49.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.927+0000 7f43f3fde700 1 Processor -- start 2023-10-03T10:18:49.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.927+0000 7f43f3fde700 1 -- start start 2023-10-03T10:18:49.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.928+0000 7f43f3fde700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ec09bc70 0x7f43ec099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.928+0000 7f43f3fde700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43ec09c790 0x7f43ec099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.928+0000 7f43f3fde700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ec131980 0x7f43ec09a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.928+0000 7f43f3fde700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec121460 con 0x7f43ec131980 2023-10-03T10:18:49.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.928+0000 7f43f3fde700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec120400 con 0x7f43ec09c790 2023-10-03T10:18:49.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.928+0000 7f43f3fde700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec120bf0 con 0x7f43ec09bc70 2023-10-03T10:18:49.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.928+0000 7f43f257b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ec131980 0x7f43ec09a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.928+0000 7f43f257b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ec131980 0x7f43ec09a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54026/0 (socket says 172.21.15.146:54026) 2023-10-03T10:18:49.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.928+0000 7f43f257b700 1 -- 172.21.15.146:0/898290941 learned_addr learned my addr 172.21.15.146:0/898290941 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:49.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.928+0000 7f43f1d7a700 1 --2- 172.21.15.146:0/898290941 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ec09bc70 0x7f43ec099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.928+0000 7f43f1579700 1 --2- 172.21.15.146:0/898290941 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43ec09c790 0x7f43ec099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.928+0000 7f43f257b700 1 -- 172.21.15.146:0/898290941 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ec09bc70 msgr2=0x7f43ec099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.928+0000 7f43f257b700 1 --2- 172.21.15.146:0/898290941 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ec09bc70 0x7f43ec099a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.928+0000 7f43f257b700 1 -- 172.21.15.146:0/898290941 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43ec09c790 msgr2=0x7f43ec099fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.928+0000 7f43f257b700 1 --2- 172.21.15.146:0/898290941 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43ec09c790 0x7f43ec099fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.928+0000 7f43f257b700 1 -- 172.21.15.146:0/898290941 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e4009a70 con 0x7f43ec131980 2023-10-03T10:18:49.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.928+0000 7f43f1d7a700 1 --2- 172.21.15.146:0/898290941 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ec09bc70 0x7f43ec099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:49.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.928+0000 7f43f257b700 1 --2- 172.21.15.146:0/898290941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ec131980 0x7f43ec09a510 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f43e400efc0 tx=0x7f43e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.928+0000 7f43e27fc700 1 -- 172.21.15.146:0/898290941 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e400cb40 con 0x7f43ec131980 2023-10-03T10:18:49.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.928+0000 7f43e27fc700 1 -- 172.21.15.146:0/898290941 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e400f040 con 0x7f43ec131980 2023-10-03T10:18:49.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.928+0000 7f43f3fde700 1 -- 172.21.15.146:0/898290941 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e8009430 con 0x7f43ec131980 2023-10-03T10:18:49.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.928+0000 7f43e27fc700 1 -- 172.21.15.146:0/898290941 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4003a20 con 0x7f43ec131980 2023-10-03T10:18:49.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.929+0000 7f43f3fde700 1 -- 172.21.15.146:0/898290941 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ec0a1c40 con 0x7f43ec131980 2023-10-03T10:18:49.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.929+0000 7f43f3fde700 1 -- 172.21.15.146:0/898290941 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ec04f2a0 con 0x7f43ec131980 2023-10-03T10:18:49.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.930+0000 7f43e27fc700 1 -- 172.21.15.146:0/898290941 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f43e4014480 con 0x7f43ec131980 2023-10-03T10:18:49.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.930+0000 7f43e27fc700 1 -- 172.21.15.146:0/898290941 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f43e4040160 con 0x7f43ec131980 2023-10-03T10:18:49.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.939+0000 7f43e27fc700 1 -- 172.21.15.146:0/898290941 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f43e4012930 con 0x7f43ec131980 2023-10-03T10:18:49.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.968+0000 7ff2facdd700 1 Processor -- start 2023-10-03T10:18:49.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.968+0000 7ff2facdd700 1 -- start start 2023-10-03T10:18:49.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.968+0000 7ff2facdd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff2f4133a70 0x7ff2f4133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.968+0000 7ff2facdd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2f40a08e0 0x7ff2f40a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.968+0000 7ff2facdd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f4133640 con 0x7ff2f40a1290 2023-10-03T10:18:49.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.968+0000 7ff2facdd700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f40a1d50 con 0x7ff2f4133a70 2023-10-03T10:18:49.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.968+0000 7ff2facdd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f40a1710 con 0x7ff2f40a08e0 2023-10-03T10:18:49.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.968+0000 7ff2f3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2f40a08e0 0x7ff2f40a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.968+0000 7ff2f3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2f40a08e0 0x7ff2f40a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51130/0 (socket says 172.21.15.146:51130) 2023-10-03T10:18:49.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.968+0000 7ff2f3fff700 1 -- 172.21.15.146:0/3398970978 learned_addr learned my addr 172.21.15.146:0/3398970978 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:49.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.968+0000 7ff2f8a79700 1 --2- 172.21.15.146:0/3398970978 >> v2:172.21.15.146:3300/0 conn(0x7ff2f4133a70 0x7ff2f4133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.969+0000 7ff2f3fff700 1 -- 172.21.15.146:0/3398970978 >> v2:172.21.15.146:3300/0 conn(0x7ff2f4133a70 msgr2=0x7ff2f4133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:49.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.969+0000 7ff2f3fff700 1 --2- 172.21.15.146:0/3398970978 >> v2:172.21.15.146:3300/0 conn(0x7ff2f4133a70 0x7ff2f4133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.969+0000 7ff2f3fff700 1 -- 172.21.15.146:0/3398970978 >> v1:172.21.15.146:6789/0 conn(0x7ff2f40a1290 legacy=0x7ff2f413a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.969+0000 7ff2f3fff700 1 -- 172.21.15.146:0/3398970978 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f409b620 con 0x7ff2f40a08e0 2023-10-03T10:18:49.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.969+0000 7ff2f3fff700 1 --2- 172.21.15.146:0/3398970978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2f40a08e0 0x7ff2f40a0d50 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00098f0 tx=0x7ff2e0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abd20a5ba6068e62 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.969+0000 7ff2f37fe700 1 -- 172.21.15.146:0/3398970978 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0011830 con 0x7ff2f40a08e0 2023-10-03T10:18:49.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.969+0000 7ff2f37fe700 1 -- 172.21.15.146:0/3398970978 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e0011990 con 0x7ff2f40a08e0 2023-10-03T10:18:49.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.969+0000 7ff2f37fe700 1 -- 172.21.15.146:0/3398970978 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0011d20 con 0x7ff2f40a08e0 2023-10-03T10:18:49.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.970+0000 7ff2facdd700 1 -- 172.21.15.146:0/3398970978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2f40a08e0 msgr2=0x7ff2f40a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.970+0000 7ff2facdd700 1 --2- 172.21.15.146:0/3398970978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2f40a08e0 0x7ff2f40a0d50 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00098f0 tx=0x7ff2e0009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:49.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.970+0000 7ff2facdd700 1 -- 172.21.15.146:0/3398970978 shutdown_connections 2023-10-03T10:18:49.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.970+0000 7ff2facdd700 1 --2- 172.21.15.146:0/3398970978 >> v2:172.21.15.146:3300/0 conn(0x7ff2f4133a70 0x7ff2f4133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.970+0000 7ff2facdd700 1 --2- 172.21.15.146:0/3398970978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2f40a08e0 0x7ff2f40a0d50 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.970+0000 7ff2facdd700 1 -- 172.21.15.146:0/3398970978 >> 172.21.15.146:0/3398970978 conn(0x7ff2f40a2980 msgr2=0x7ff2f40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.970+0000 7ff2facdd700 1 -- 172.21.15.146:0/3398970978 shutdown_connections 2023-10-03T10:18:49.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.970+0000 7ff2facdd700 1 -- 172.21.15.146:0/3398970978 wait complete. 2023-10-03T10:18:49.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.971+0000 7ff2facdd700 1 Processor -- start 2023-10-03T10:18:49.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.971+0000 7ff2facdd700 1 -- start start 2023-10-03T10:18:49.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.971+0000 7ff2facdd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2f40a08e0 0x7ff2f411c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.971+0000 7ff2facdd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2f40a1290 0x7ff2f411cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.971+0000 7ff2facdd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff2f4133a70 0x7ff2f411d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.971+0000 7ff2facdd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f411dc30 con 0x7ff2f40a08e0 2023-10-03T10:18:49.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.971+0000 7ff2facdd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f411e970 con 0x7ff2f40a1290 2023-10-03T10:18:49.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.971+0000 7ff2facdd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f411fa30 con 0x7ff2f4133a70 2023-10-03T10:18:49.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.971+0000 7ff2f8a79700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2f40a08e0 0x7ff2f411c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.971+0000 7ff2f8a79700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2f40a08e0 0x7ff2f411c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54042/0 (socket says 172.21.15.146:54042) 2023-10-03T10:18:49.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.971+0000 7ff2f8a79700 1 -- 172.21.15.146:0/3546781109 learned_addr learned my addr 172.21.15.146:0/3546781109 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:49.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.971+0000 7ff2f3fff700 1 --2- 172.21.15.146:0/3546781109 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2f40a1290 0x7ff2f411cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.971+0000 7ff2f927a700 1 --2- 172.21.15.146:0/3546781109 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff2f4133a70 0x7ff2f411d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.972+0000 7ff2f8a79700 1 -- 172.21.15.146:0/3546781109 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff2f4133a70 msgr2=0x7ff2f411d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.972+0000 7ff2f8a79700 1 --2- 172.21.15.146:0/3546781109 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff2f4133a70 0x7ff2f411d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.972+0000 7ff2f8a79700 1 -- 172.21.15.146:0/3546781109 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2f40a1290 msgr2=0x7ff2f411cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.972+0000 7ff2f8a79700 1 --2- 172.21.15.146:0/3546781109 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2f40a1290 0x7ff2f411cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.972+0000 7ff2f8a79700 1 -- 172.21.15.146:0/3546781109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e0009550 con 0x7ff2f40a08e0 2023-10-03T10:18:49.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.972+0000 7ff2f8a79700 1 --2- 172.21.15.146:0/3546781109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2f40a08e0 0x7ff2f411c7d0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800e9c0 tx=0x7ff2e800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.972+0000 7ff2f17fa700 1 -- 172.21.15.146:0/3546781109 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e80096f0 con 0x7ff2f40a08e0 2023-10-03T10:18:49.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.972+0000 7ff2f17fa700 1 -- 172.21.15.146:0/3546781109 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e800ee60 con 0x7ff2f40a08e0 2023-10-03T10:18:49.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.972+0000 7ff2f17fa700 1 -- 172.21.15.146:0/3546781109 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e800ca50 con 0x7ff2f40a08e0 2023-10-03T10:18:49.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.972+0000 7ff2facdd700 1 -- 172.21.15.146:0/3546781109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f409a350 con 0x7ff2f40a08e0 2023-10-03T10:18:49.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.972+0000 7f9f00ce4700 1 -- 172.21.15.146:0/4010964975 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9efc11fa10 con 0x7f9efc130bc0 2023-10-03T10:18:49.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.972+0000 7ff2facdd700 1 -- 172.21.15.146:0/3546781109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f411e390 con 0x7ff2f40a08e0 2023-10-03T10:18:49.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.973+0000 7f9eeaffd700 1 -- 172.21.15.146:0/4010964975 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9efc11fa10 con 0x7f9efc130bc0 2023-10-03T10:18:49.984 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:49.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.973+0000 7ff2facdd700 1 -- 172.21.15.146:0/3546781109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f404f2a0 con 0x7ff2f40a08e0 2023-10-03T10:18:49.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.973+0000 7ff2f17fa700 1 -- 172.21.15.146:0/3546781109 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2e800cbb0 con 0x7ff2f40a08e0 2023-10-03T10:18:49.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.974+0000 7ff2f17fa700 1 -- 172.21.15.146:0/3546781109 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff2e803fb10 con 0x7ff2f40a08e0 2023-10-03T10:18:49.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.975+0000 7f9f00ce4700 1 -- 172.21.15.146:0/4010964975 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9efc130bc0 msgr2=0x7f9efc11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.975+0000 7f9f00ce4700 1 --2- 172.21.15.146:0/4010964975 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9efc130bc0 0x7f9efc11df80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9efc09ea20 tx=0x7f9eec00c6a0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.976+0000 7f9f00ce4700 1 -- 172.21.15.146:0/4010964975 shutdown_connections 2023-10-03T10:18:49.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.976+0000 7f9f00ce4700 1 --2- 172.21.15.146:0/4010964975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9efc133ad0 0x7f9efc11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.976+0000 7f9f00ce4700 1 --2- 172.21.15.146:0/4010964975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9efc1300a0 0x7f9efc11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.976+0000 7f9f00ce4700 1 --2- 172.21.15.146:0/4010964975 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f9efc130bc0 0x7f9efc11df80 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.976+0000 7f9f00ce4700 1 -- 172.21.15.146:0/4010964975 >> 172.21.15.146:0/4010964975 conn(0x7f9efc099c40 msgr2=0x7f9efc12f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.976+0000 7f9f00ce4700 1 -- 172.21.15.146:0/4010964975 shutdown_connections 2023-10-03T10:18:49.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.976+0000 7f9f00ce4700 1 -- 172.21.15.146:0/4010964975 wait complete. 2023-10-03T10:18:49.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:49.981+0000 7ff2f17fa700 1 -- 172.21.15.146:0/3546781109 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2e801b3b0 con 0x7ff2f40a08e0 2023-10-03T10:18:49.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:50.066 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:50.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.137+0000 7f43f3fde700 1 -- 172.21.15.146:0/898290941 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f43ec06bce0 con 0x7f43ec131980 2023-10-03T10:18:50.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.137+0000 7f43e27fc700 1 -- 172.21.15.146:0/898290941 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f43e4012340 con 0x7f43ec131980 2023-10-03T10:18:50.138 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.139+0000 7f43f3fde700 1 -- 172.21.15.146:0/898290941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ec131980 msgr2=0x7f43ec09a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.139+0000 7f43f3fde700 1 --2- 172.21.15.146:0/898290941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ec131980 0x7f43ec09a510 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f43e400efc0 tx=0x7f43e400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.139+0000 7f43f3fde700 1 -- 172.21.15.146:0/898290941 shutdown_connections 2023-10-03T10:18:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.139+0000 7f43f3fde700 1 --2- 172.21.15.146:0/898290941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ec131980 0x7f43ec09a510 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.139+0000 7f43f3fde700 1 --2- 172.21.15.146:0/898290941 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f43ec09bc70 0x7f43ec099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.139+0000 7f43f3fde700 1 --2- 172.21.15.146:0/898290941 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f43ec09c790 0x7f43ec099fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.139+0000 7f43f3fde700 1 -- 172.21.15.146:0/898290941 >> 172.21.15.146:0/898290941 conn(0x7f43ec0a2980 msgr2=0x7f43ec09fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.139+0000 7f43f3fde700 1 -- 172.21.15.146:0/898290941 shutdown_connections 2023-10-03T10:18:50.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.139+0000 7f43f3fde700 1 -- 172.21.15.146:0/898290941 wait complete. 2023-10-03T10:18:50.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:50.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.175+0000 7ff2facdd700 1 -- 172.21.15.146:0/3546781109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff2f411f5e0 con 0x7ff2f40a08e0 2023-10-03T10:18:50.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.176+0000 7ff2f17fa700 1 -- 172.21.15.146:0/3546781109 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2e8017030 con 0x7ff2f40a08e0 2023-10-03T10:18:50.176 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:50.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.178+0000 7ff2facdd700 1 -- 172.21.15.146:0/3546781109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2f40a08e0 msgr2=0x7ff2f411c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.178+0000 7ff2facdd700 1 --2- 172.21.15.146:0/3546781109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2f40a08e0 0x7ff2f411c7d0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800e9c0 tx=0x7ff2e800ecd0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.178+0000 7ff2facdd700 1 -- 172.21.15.146:0/3546781109 shutdown_connections 2023-10-03T10:18:50.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.178+0000 7ff2facdd700 1 --2- 172.21.15.146:0/3546781109 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff2f4133a70 0x7ff2f411d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.178+0000 7ff2facdd700 1 --2- 172.21.15.146:0/3546781109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2f40a08e0 0x7ff2f411c7d0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.178+0000 7ff2facdd700 1 --2- 172.21.15.146:0/3546781109 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2f40a1290 0x7ff2f411cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.178+0000 7ff2facdd700 1 -- 172.21.15.146:0/3546781109 >> 172.21.15.146:0/3546781109 conn(0x7ff2f40a2980 msgr2=0x7ff2f41baf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.178+0000 7ff2facdd700 1 -- 172.21.15.146:0/3546781109 shutdown_connections 2023-10-03T10:18:50.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.178+0000 7ff2facdd700 1 -- 172.21.15.146:0/3546781109 wait complete. 2023-10-03T10:18:50.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:50.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.193+0000 7fd585421700 1 Processor -- start 2023-10-03T10:18:50.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.193+0000 7fd585421700 1 -- start start 2023-10-03T10:18:50.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.193+0000 7fd585421700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd5800a0a70 0x7fd5800a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.193+0000 7fd585421700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5800a1380 0x7fd580133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.193+0000 7fd585421700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd58009dc00 con 0x7fd580133f50 2023-10-03T10:18:50.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.193+0000 7fd585421700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd58009ea60 con 0x7fd5800a0a70 2023-10-03T10:18:50.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.193+0000 7fd585421700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58009dec0 con 0x7fd5800a1380 2023-10-03T10:18:50.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.193+0000 7fd57effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd5800a0a70 0x7fd5800a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.193+0000 7fd57e7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5800a1380 0x7fd580133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.193+0000 7fd57f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd580133f50 0x7fd58013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49022/0 (socket says 172.21.15.146:49022) 2023-10-03T10:18:50.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.193+0000 7fd57f7fe700 1 -- 172.21.15.146:0/4017625966 learned_addr learned my addr 172.21.15.146:0/4017625966 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:50.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.194+0000 7fd57effd700 1 -- 172.21.15.146:0/4017625966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5800a1380 msgr2=0x7fd580133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:50.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.194+0000 7fd57effd700 1 --2- 172.21.15.146:0/4017625966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5800a1380 0x7fd580133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.194+0000 7fd57effd700 1 -- 172.21.15.146:0/4017625966 >> v1:172.21.15.146:6789/0 conn(0x7fd580133f50 legacy=0x7fd58013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.194+0000 7fd57effd700 1 -- 172.21.15.146:0/4017625966 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58009e6a0 con 0x7fd5800a0a70 2023-10-03T10:18:50.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.194+0000 7fd57dffb700 1 -- 172.21.15.146:0/4017625966 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196720426 0 0) 0x7fd58009dc00 con 0x7fd580133f50 2023-10-03T10:18:50.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.194+0000 7fd57e7fc700 1 --2- 172.21.15.146:0/4017625966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5800a1380 0x7fd580133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:50.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.194+0000 7fd57effd700 1 --2- 172.21.15.146:0/4017625966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5800a0a70 0x7fd5800a0e40 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fd570009840 tx=0x7fd570009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3bd5b747aa12c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.194+0000 7fd57dffb700 1 -- 172.21.15.146:0/4017625966 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570011830 con 0x7fd5800a0a70 2023-10-03T10:18:50.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.194+0000 7fd57dffb700 1 -- 172.21.15.146:0/4017625966 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd570011990 con 0x7fd5800a0a70 2023-10-03T10:18:50.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.194+0000 7fd57dffb700 1 -- 172.21.15.146:0/4017625966 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570011d20 con 0x7fd5800a0a70 2023-10-03T10:18:50.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.194+0000 7fd585421700 1 -- 172.21.15.146:0/4017625966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5800a0a70 msgr2=0x7fd5800a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.194+0000 7fd585421700 1 --2- 172.21.15.146:0/4017625966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5800a0a70 0x7fd5800a0e40 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fd570009840 tx=0x7fd570009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:50.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.195+0000 7fd585421700 1 -- 172.21.15.146:0/4017625966 shutdown_connections 2023-10-03T10:18:50.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.195+0000 7fd585421700 1 --2- 172.21.15.146:0/4017625966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5800a0a70 0x7fd5800a0e40 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.195+0000 7fd585421700 1 --2- 172.21.15.146:0/4017625966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5800a1380 0x7fd580133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.195+0000 7fd585421700 1 -- 172.21.15.146:0/4017625966 >> 172.21.15.146:0/4017625966 conn(0x7fd5800a6610 msgr2=0x7fd5800a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.195+0000 7fd585421700 1 -- 172.21.15.146:0/4017625966 shutdown_connections 2023-10-03T10:18:50.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.195+0000 7fd585421700 1 -- 172.21.15.146:0/4017625966 wait complete. 2023-10-03T10:18:50.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.196+0000 7fd585421700 1 Processor -- start 2023-10-03T10:18:50.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.196+0000 7fd585421700 1 -- start start 2023-10-03T10:18:50.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.196+0000 7fd585421700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5800a0a70 0x7fd580122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.196+0000 7fd585421700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5800a1380 0x7fd580122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.196+0000 7fd585421700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd580133f50 0x7fd5801232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.196+0000 7fd585421700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd580133ad0 con 0x7fd5800a1380 2023-10-03T10:18:50.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.196+0000 7fd585421700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd580125de0 con 0x7fd5800a0a70 2023-10-03T10:18:50.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.196+0000 7fd585421700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd580124510 con 0x7fd580133f50 2023-10-03T10:18:50.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.196+0000 7fd57effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5800a0a70 0x7fd580122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.196+0000 7fd57e7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5800a1380 0x7fd580122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.196+0000 7fd57effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5800a0a70 0x7fd580122860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51160/0 (socket says 172.21.15.146:51160) 2023-10-03T10:18:50.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.196+0000 7fd57effd700 1 -- 172.21.15.146:0/3073688514 learned_addr learned my addr 172.21.15.146:0/3073688514 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:50.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.196+0000 7fd57f7fe700 1 --2- 172.21.15.146:0/3073688514 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd580133f50 0x7fd5801232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.196+0000 7fd57effd700 1 -- 172.21.15.146:0/3073688514 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd580133f50 msgr2=0x7fd5801232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.196+0000 7fd57effd700 1 --2- 172.21.15.146:0/3073688514 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd580133f50 0x7fd5801232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.196+0000 7fd57effd700 1 -- 172.21.15.146:0/3073688514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5800a1380 msgr2=0x7fd580122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.196+0000 7fd57effd700 1 --2- 172.21.15.146:0/3073688514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5800a1380 0x7fd580122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.196+0000 7fd57effd700 1 -- 172.21.15.146:0/3073688514 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5740094a0 con 0x7fd5800a0a70 2023-10-03T10:18:50.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.196+0000 7fd57e7fc700 1 --2- 172.21.15.146:0/3073688514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5800a1380 0x7fd580122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:50.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.196+0000 7fd57f7fe700 1 --2- 172.21.15.146:0/3073688514 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd580133f50 0x7fd5801232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:50.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.197+0000 7fd57effd700 1 --2- 172.21.15.146:0/3073688514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5800a0a70 0x7fd580122860 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd5700090b0 tx=0x7fd570004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.197+0000 7fd5677fe700 1 -- 172.21.15.146:0/3073688514 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570004400 con 0x7fd5800a0a70 2023-10-03T10:18:50.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.197+0000 7fd5677fe700 1 -- 172.21.15.146:0/3073688514 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57001f070 con 0x7fd5800a0a70 2023-10-03T10:18:50.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.197+0000 7fd585421700 1 -- 172.21.15.146:0/3073688514 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5700094a0 con 0x7fd5800a0a70 2023-10-03T10:18:50.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.197+0000 7fd5677fe700 1 -- 172.21.15.146:0/3073688514 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5700038e0 con 0x7fd5800a0a70 2023-10-03T10:18:50.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.197+0000 7fd585421700 1 -- 172.21.15.146:0/3073688514 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd580133380 con 0x7fd5800a0a70 2023-10-03T10:18:50.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.197+0000 7fd5677fe700 1 -- 172.21.15.146:0/3073688514 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd570021030 con 0x7fd5800a0a70 2023-10-03T10:18:50.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.198+0000 7fd5677fe700 1 -- 172.21.15.146:0/3073688514 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd570040940 con 0x7fd5800a0a70 2023-10-03T10:18:50.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.198+0000 7fd585421700 1 -- 172.21.15.146:0/3073688514 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd58004f2a0 con 0x7fd5800a0a70 2023-10-03T10:18:50.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.202+0000 7fd5677fe700 1 -- 172.21.15.146:0/3073688514 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd570015020 con 0x7fd5800a0a70 2023-10-03T10:18:50.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.386+0000 7fd585421700 1 -- 172.21.15.146:0/3073688514 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd580072980 con 0x7fd5800a0a70 2023-10-03T10:18:50.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.387+0000 7fd5677fe700 1 -- 172.21.15.146:0/3073688514 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd570004560 con 0x7fd5800a0a70 2023-10-03T10:18:50.388 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:50.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.389+0000 7fd585421700 1 -- 172.21.15.146:0/3073688514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5800a0a70 msgr2=0x7fd580122860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.389+0000 7fd585421700 1 --2- 172.21.15.146:0/3073688514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5800a0a70 0x7fd580122860 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd5700090b0 tx=0x7fd570004750 comp rx=0 tx=0).stop 2023-10-03T10:18:50.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.389+0000 7fd585421700 1 -- 172.21.15.146:0/3073688514 shutdown_connections 2023-10-03T10:18:50.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.389+0000 7fd585421700 1 --2- 172.21.15.146:0/3073688514 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd580133f50 0x7fd5801232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.389+0000 7fd585421700 1 --2- 172.21.15.146:0/3073688514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5800a0a70 0x7fd580122860 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.389+0000 7fd585421700 1 --2- 172.21.15.146:0/3073688514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5800a1380 0x7fd580122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.389+0000 7fd585421700 1 -- 172.21.15.146:0/3073688514 >> 172.21.15.146:0/3073688514 conn(0x7fd5800a6610 msgr2=0x7fd58009ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.389+0000 7fd585421700 1 -- 172.21.15.146:0/3073688514 shutdown_connections 2023-10-03T10:18:50.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:50.389+0000 7fd585421700 1 -- 172.21.15.146:0/3073688514 wait complete. 2023-10-03T10:18:50.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:50.991 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:51.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.115+0000 7f389cb22700 1 Processor -- start 2023-10-03T10:18:51.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.115+0000 7f389cb22700 1 -- start start 2023-10-03T10:18:51.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.116+0000 7f389cb22700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3898136960 0x7f3898138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.116+0000 7f389cb22700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3898139280 0x7f389813b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.116+0000 7f389cb22700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f389806b2d0 con 0x7f3898133ad0 2023-10-03T10:18:51.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.116+0000 7f389cb22700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38981345b0 con 0x7f3898139280 2023-10-03T10:18:51.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.116+0000 7f389cb22700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3898133610 con 0x7f3898136960 2023-10-03T10:18:51.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.116+0000 7f3896d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3898139280 0x7f389813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.116+0000 7f3895d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3898136960 0x7f3898138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.116+0000 7f389659c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3898133ad0 0x7f3898133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49026/0 (socket says 172.21.15.146:49026) 2023-10-03T10:18:51.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.116+0000 7f389659c700 1 -- 172.21.15.146:0/81417135 learned_addr learned my addr 172.21.15.146:0/81417135 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:51.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.116+0000 7f3895d9b700 1 -- 172.21.15.146:0/81417135 >> v2:172.21.15.146:3300/0 conn(0x7f3898139280 msgr2=0x7f389813b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:51.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.116+0000 7f3895d9b700 1 --2- 172.21.15.146:0/81417135 >> v2:172.21.15.146:3300/0 conn(0x7f3898139280 0x7f389813b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.116+0000 7f3895d9b700 1 -- 172.21.15.146:0/81417135 >> v1:172.21.15.146:6789/0 conn(0x7f3898133ad0 legacy=0x7f3898133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.116+0000 7f389559a700 1 -- 172.21.15.146:0/81417135 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114278861 0 0) 0x7f389806b2d0 con 0x7f3898133ad0 2023-10-03T10:18:51.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.116+0000 7f3895d9b700 1 -- 172.21.15.146:0/81417135 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389809a500 con 0x7f3898136960 2023-10-03T10:18:51.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.116+0000 7f3896d9d700 1 --2- 172.21.15.146:0/81417135 >> v2:172.21.15.146:3300/0 conn(0x7f3898139280 0x7f389813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:51.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.116+0000 7f3895d9b700 1 --2- 172.21.15.146:0/81417135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3898136960 0x7f3898138d40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f3888009870 tx=0x7f3888009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cb5e0ca5e9d0653 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.116+0000 7f389559a700 1 -- 172.21.15.146:0/81417135 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3888011830 con 0x7f3898136960 2023-10-03T10:18:51.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.117+0000 7f389559a700 1 -- 172.21.15.146:0/81417135 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3888011990 con 0x7f3898136960 2023-10-03T10:18:51.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.117+0000 7f389559a700 1 -- 172.21.15.146:0/81417135 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3888011d20 con 0x7f3898136960 2023-10-03T10:18:51.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.117+0000 7f389cb22700 1 -- 172.21.15.146:0/81417135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3898136960 msgr2=0x7f3898138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.117+0000 7f389cb22700 1 --2- 172.21.15.146:0/81417135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3898136960 0x7f3898138d40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f3888009870 tx=0x7f3888009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:51.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.117+0000 7f389cb22700 1 -- 172.21.15.146:0/81417135 shutdown_connections 2023-10-03T10:18:51.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.117+0000 7f389cb22700 1 --2- 172.21.15.146:0/81417135 >> v2:172.21.15.146:3300/0 conn(0x7f3898139280 0x7f389813b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.117+0000 7f389cb22700 1 --2- 172.21.15.146:0/81417135 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3898136960 0x7f3898138d40 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.117+0000 7f389cb22700 1 -- 172.21.15.146:0/81417135 >> 172.21.15.146:0/81417135 conn(0x7f3898099c40 msgr2=0x7f38980a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.117+0000 7f389cb22700 1 -- 172.21.15.146:0/81417135 shutdown_connections 2023-10-03T10:18:51.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.117+0000 7f389cb22700 1 -- 172.21.15.146:0/81417135 wait complete. 2023-10-03T10:18:51.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.118+0000 7f389cb22700 1 Processor -- start 2023-10-03T10:18:51.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.118+0000 7f389cb22700 1 -- start start 2023-10-03T10:18:51.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.119+0000 7f389cb22700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3898133ad0 0x7f3898071770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.119+0000 7f389cb22700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3898136960 0x7f3898071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.119+0000 7f389cb22700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3898139280 0x7f38981c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.119+0000 7f389cb22700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3898070040 con 0x7f3898139280 2023-10-03T10:18:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.119+0000 7f389cb22700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3898130b10 con 0x7f3898133ad0 2023-10-03T10:18:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.119+0000 7f389cb22700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f389809f390 con 0x7f3898136960 2023-10-03T10:18:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.119+0000 7f389659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3898133ad0 0x7f3898071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.119+0000 7f3896d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3898139280 0x7f38981c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.119+0000 7f389659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3898133ad0 0x7f3898071770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51162/0 (socket says 172.21.15.146:51162) 2023-10-03T10:18:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.119+0000 7f389659c700 1 -- 172.21.15.146:0/27189021 learned_addr learned my addr 172.21.15.146:0/27189021 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.119+0000 7f3895d9b700 1 --2- 172.21.15.146:0/27189021 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3898136960 0x7f3898071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.119+0000 7f3896d9d700 1 -- 172.21.15.146:0/27189021 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3898136960 msgr2=0x7f3898071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.119+0000 7f3896d9d700 1 --2- 172.21.15.146:0/27189021 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3898136960 0x7f3898071cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.119+0000 7f3896d9d700 1 -- 172.21.15.146:0/27189021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3898133ad0 msgr2=0x7f3898071770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.119+0000 7f3896d9d700 1 --2- 172.21.15.146:0/27189021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3898133ad0 0x7f3898071770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.119+0000 7f3896d9d700 1 -- 172.21.15.146:0/27189021 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3890009a70 con 0x7f3898139280 2023-10-03T10:18:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.119+0000 7f3896d9d700 1 --2- 172.21.15.146:0/27189021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3898139280 0x7f38981c8470 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f389809f6c0 tx=0x7f389000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.119+0000 7f3886ffd700 1 -- 172.21.15.146:0/27189021 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890003a20 con 0x7f3898139280 2023-10-03T10:18:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.119+0000 7f3886ffd700 1 -- 172.21.15.146:0/27189021 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389000f040 con 0x7f3898139280 2023-10-03T10:18:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.119+0000 7f389cb22700 1 -- 172.21.15.146:0/27189021 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38880094a0 con 0x7f3898139280 2023-10-03T10:18:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.119+0000 7f3886ffd700 1 -- 172.21.15.146:0/27189021 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890003dc0 con 0x7f3898139280 2023-10-03T10:18:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.119+0000 7f389cb22700 1 -- 172.21.15.146:0/27189021 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38980721f0 con 0x7f3898139280 2023-10-03T10:18:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.120+0000 7f3886ffd700 1 -- 172.21.15.146:0/27189021 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f389000ca20 con 0x7f3898139280 2023-10-03T10:18:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.120+0000 7f3886ffd700 1 -- 172.21.15.146:0/27189021 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f389003ffc0 con 0x7f3898139280 2023-10-03T10:18:51.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.120+0000 7f389cb22700 1 -- 172.21.15.146:0/27189021 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38980701b0 con 0x7f3898139280 2023-10-03T10:18:51.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.126+0000 7f3886ffd700 1 -- 172.21.15.146:0/27189021 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f389001cba0 con 0x7f3898139280 2023-10-03T10:18:51.154 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:51.192 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:51.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.279+0000 7f0ce75d0700 1 Processor -- start 2023-10-03T10:18:51.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.279+0000 7f0ce75d0700 1 -- start start 2023-10-03T10:18:51.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.279+0000 7f0ce75d0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ce009f350 0x7f0ce0136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.280+0000 7f0ce75d0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ce01371c0 0x7f0ce01395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.280+0000 7f0ce75d0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce009c970 con 0x7f0ce009e870 2023-10-03T10:18:51.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.280+0000 7f0ce75d0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00a0920 con 0x7f0ce01371c0 2023-10-03T10:18:51.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.280+0000 7f0ce75d0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce009f9c0 con 0x7f0ce009f350 2023-10-03T10:18:51.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.280+0000 7f0ce4b6b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ce009f350 0x7f0ce0136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.280+0000 7f0ce4b6b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ce009f350 0x7f0ce0136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35294/0 (socket says 172.21.15.146:35294) 2023-10-03T10:18:51.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.280+0000 7f0ce4b6b700 1 -- 172.21.15.146:0/3386312123 learned_addr learned my addr 172.21.15.146:0/3386312123 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:51.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.280+0000 7f0ce536c700 1 --1- 172.21.15.146:0/3386312123 >> v1:172.21.15.146:6789/0 conn(0x7f0ce009e870 0x7f0ce009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49028/0 (socket says 172.21.15.146:49028) 2023-10-03T10:18:51.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.280+0000 7f0ce5b6d700 1 --2- 172.21.15.146:0/3386312123 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ce01371c0 0x7f0ce01395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.280+0000 7f0ce4b6b700 1 -- 172.21.15.146:0/3386312123 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ce01371c0 msgr2=0x7f0ce01395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:51.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.280+0000 7f0ce4b6b700 1 --2- 172.21.15.146:0/3386312123 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ce01371c0 0x7f0ce01395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.280+0000 7f0ce4b6b700 1 -- 172.21.15.146:0/3386312123 >> v1:172.21.15.146:6789/0 conn(0x7f0ce009e870 legacy=0x7f0ce009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.280+0000 7f0ce4b6b700 1 -- 172.21.15.146:0/3386312123 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce009bab0 con 0x7f0ce009f350 2023-10-03T10:18:51.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.280+0000 7f0ce4b6b700 1 --2- 172.21.15.146:0/3386312123 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ce009f350 0x7f0ce0136c80 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009920 tx=0x7f0cd0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fe6fdd9ecae5e94 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.280+0000 7f0cd7fff700 1 -- 172.21.15.146:0/3386312123 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0011830 con 0x7f0ce009f350 2023-10-03T10:18:51.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.280+0000 7f0cd7fff700 1 -- 172.21.15.146:0/3386312123 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd0011990 con 0x7f0ce009f350 2023-10-03T10:18:51.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.280+0000 7f0cd7fff700 1 -- 172.21.15.146:0/3386312123 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0011d20 con 0x7f0ce009f350 2023-10-03T10:18:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.281+0000 7f0ce75d0700 1 -- 172.21.15.146:0/3386312123 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ce009f350 msgr2=0x7f0ce0136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.281+0000 7f0ce75d0700 1 --2- 172.21.15.146:0/3386312123 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ce009f350 0x7f0ce0136c80 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009920 tx=0x7f0cd0009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.281+0000 7f0ce75d0700 1 -- 172.21.15.146:0/3386312123 shutdown_connections 2023-10-03T10:18:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.281+0000 7f0ce75d0700 1 --2- 172.21.15.146:0/3386312123 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ce01371c0 0x7f0ce01395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.281+0000 7f0ce75d0700 1 --2- 172.21.15.146:0/3386312123 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ce009f350 0x7f0ce0136c80 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.281+0000 7f0ce75d0700 1 -- 172.21.15.146:0/3386312123 >> 172.21.15.146:0/3386312123 conn(0x7f0ce00a4430 msgr2=0x7f0ce00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.281+0000 7f0ce75d0700 1 -- 172.21.15.146:0/3386312123 shutdown_connections 2023-10-03T10:18:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.281+0000 7f0ce75d0700 1 -- 172.21.15.146:0/3386312123 wait complete. 2023-10-03T10:18:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.282+0000 7f0ce75d0700 1 Processor -- start 2023-10-03T10:18:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.283+0000 7f0ce75d0700 1 -- start start 2023-10-03T10:18:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.283+0000 7f0ce75d0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ce009e870 0x7f0ce011f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.283+0000 7f0ce75d0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ce009f350 0x7f0ce011fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.283+0000 7f0ce75d0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ce01371c0 0x7f0ce01201a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.283+0000 7f0ce75d0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce0136db0 con 0x7f0ce01371c0 2023-10-03T10:18:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.283+0000 7f0ce75d0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce0121440 con 0x7f0ce009f350 2023-10-03T10:18:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.283+0000 7f0ce75d0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce0122ca0 con 0x7f0ce009e870 2023-10-03T10:18:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.283+0000 7f0ce4b6b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ce009f350 0x7f0ce011fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.283+0000 7f0ce4b6b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ce009f350 0x7f0ce011fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51188/0 (socket says 172.21.15.146:51188) 2023-10-03T10:18:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.283+0000 7f0ce4b6b700 1 -- 172.21.15.146:0/1987728414 learned_addr learned my addr 172.21.15.146:0/1987728414 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:51.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.283+0000 7f0ce5b6d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ce01371c0 0x7f0ce01201a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.283+0000 7f0ce536c700 1 --2- 172.21.15.146:0/1987728414 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ce009e870 0x7f0ce011f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.284+0000 7f0ce5b6d700 1 -- 172.21.15.146:0/1987728414 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ce009e870 msgr2=0x7f0ce011f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.284+0000 7f0ce5b6d700 1 --2- 172.21.15.146:0/1987728414 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ce009e870 0x7f0ce011f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.284+0000 7f0ce5b6d700 1 -- 172.21.15.146:0/1987728414 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ce009f350 msgr2=0x7f0ce011fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.284+0000 7f0ce5b6d700 1 --2- 172.21.15.146:0/1987728414 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ce009f350 0x7f0ce011fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.284+0000 7f0ce5b6d700 1 -- 172.21.15.146:0/1987728414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd0009550 con 0x7f0ce01371c0 2023-10-03T10:18:51.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.284+0000 7f0ce536c700 1 --2- 172.21.15.146:0/1987728414 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ce009e870 0x7f0ce011f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:51.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.284+0000 7f0ce5b6d700 1 --2- 172.21.15.146:0/1987728414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ce01371c0 0x7f0ce01201a0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f0ce009afe0 tx=0x7f0cd800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.284+0000 7f0cd5ffb700 1 -- 172.21.15.146:0/1987728414 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd800cc20 con 0x7f0ce01371c0 2023-10-03T10:18:51.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.284+0000 7f0cd5ffb700 1 -- 172.21.15.146:0/1987728414 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd800f040 con 0x7f0ce01371c0 2023-10-03T10:18:51.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.284+0000 7f0ce75d0700 1 -- 172.21.15.146:0/1987728414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce0122f60 con 0x7f0ce01371c0 2023-10-03T10:18:51.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.284+0000 7f0cd5ffb700 1 -- 172.21.15.146:0/1987728414 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8009e60 con 0x7f0ce01371c0 2023-10-03T10:18:51.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.284+0000 7f0ce75d0700 1 -- 172.21.15.146:0/1987728414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce0121880 con 0x7f0ce01371c0 2023-10-03T10:18:51.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.285+0000 7f0cd5ffb700 1 -- 172.21.15.146:0/1987728414 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0cd8014480 con 0x7f0ce01371c0 2023-10-03T10:18:51.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.285+0000 7f0cd5ffb700 1 -- 172.21.15.146:0/1987728414 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0cd8040140 con 0x7f0ce01371c0 2023-10-03T10:18:51.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.286+0000 7f0ce75d0700 1 -- 172.21.15.146:0/1987728414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce004f2a0 con 0x7f0ce01371c0 2023-10-03T10:18:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.291+0000 7f0cd5ffb700 1 -- 172.21.15.146:0/1987728414 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cd8018020 con 0x7f0ce01371c0 2023-10-03T10:18:51.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.322+0000 7f8b95552700 1 Processor -- start 2023-10-03T10:18:51.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.322+0000 7f8b95552700 1 -- start start 2023-10-03T10:18:51.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.323+0000 7f8b95552700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b90134140 0x7f8b90138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.323+0000 7f8b95552700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b90134570 0x7f8b9013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.323+0000 7f8b95552700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9009b110 con 0x7f8b9009ad40 2023-10-03T10:18:51.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.323+0000 7f8b95552700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b900a3b60 con 0x7f8b90134140 2023-10-03T10:18:51.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.323+0000 7f8b95552700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b900a1a80 con 0x7f8b90134570 2023-10-03T10:18:51.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.323+0000 7f389cb22700 1 -- 172.21.15.146:0/27189021 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f38980724a0 con 0x7f3898139280 2023-10-03T10:18:51.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.323+0000 7f8b8e7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b90134140 0x7f8b90138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.323+0000 7f8b8effd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8b9009ad40 0x7f8b90133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49036/0 (socket says 172.21.15.146:49036) 2023-10-03T10:18:51.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.323+0000 7f8b8effd700 1 -- 172.21.15.146:0/3640941975 learned_addr learned my addr 172.21.15.146:0/3640941975 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:51.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.323+0000 7f8b8f7fe700 1 --2- 172.21.15.146:0/3640941975 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b90134570 0x7f8b9013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.323+0000 7f8b8e7fc700 1 -- 172.21.15.146:0/3640941975 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b90134570 msgr2=0x7f8b9013b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:51.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.323+0000 7f8b8e7fc700 1 --2- 172.21.15.146:0/3640941975 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b90134570 0x7f8b9013b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.323+0000 7f8b8e7fc700 1 -- 172.21.15.146:0/3640941975 >> v1:172.21.15.146:6789/0 conn(0x7f8b9009ad40 legacy=0x7f8b90133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.323+0000 7f8b8e7fc700 1 -- 172.21.15.146:0/3640941975 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b900a2fa0 con 0x7f8b90134140 2023-10-03T10:18:51.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.323+0000 7f3886ffd700 1 -- 172.21.15.146:0/27189021 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f389002b090 con 0x7f3898139280 2023-10-03T10:18:51.326 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:51.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.323+0000 7f8b8e7fc700 1 --2- 172.21.15.146:0/3640941975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b90134140 0x7f8b90138e80 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f8b840098a0 tx=0x7f8b84009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32aadf1e9591d196 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.324+0000 7f8b8dffb700 1 -- 172.21.15.146:0/3640941975 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b84011830 con 0x7f8b90134140 2023-10-03T10:18:51.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.324+0000 7f8b8dffb700 1 -- 172.21.15.146:0/3640941975 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b84011990 con 0x7f8b90134140 2023-10-03T10:18:51.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.324+0000 7f8b8dffb700 1 -- 172.21.15.146:0/3640941975 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b84011d20 con 0x7f8b90134140 2023-10-03T10:18:51.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.324+0000 7f8b95552700 1 -- 172.21.15.146:0/3640941975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b90134140 msgr2=0x7f8b90138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.324+0000 7f8b95552700 1 --2- 172.21.15.146:0/3640941975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b90134140 0x7f8b90138e80 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f8b840098a0 tx=0x7f8b84009bb0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.324+0000 7f8b95552700 1 -- 172.21.15.146:0/3640941975 shutdown_connections 2023-10-03T10:18:51.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.324+0000 7f8b95552700 1 --2- 172.21.15.146:0/3640941975 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b90134570 0x7f8b9013b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.324+0000 7f8b95552700 1 --2- 172.21.15.146:0/3640941975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b90134140 0x7f8b90138e80 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.324+0000 7f8b95552700 1 -- 172.21.15.146:0/3640941975 >> 172.21.15.146:0/3640941975 conn(0x7f8b90099c40 msgr2=0x7f8b9006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.324+0000 7f8b95552700 1 -- 172.21.15.146:0/3640941975 shutdown_connections 2023-10-03T10:18:51.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.324+0000 7f8b95552700 1 -- 172.21.15.146:0/3640941975 wait complete. 2023-10-03T10:18:51.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.326+0000 7f8b95552700 1 Processor -- start 2023-10-03T10:18:51.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.326+0000 7f8b95552700 1 -- start start 2023-10-03T10:18:51.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.326+0000 7f389cb22700 1 -- 172.21.15.146:0/27189021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3898139280 msgr2=0x7f38981c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.326+0000 7f389cb22700 1 --2- 172.21.15.146:0/27189021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3898139280 0x7f38981c8470 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f389809f6c0 tx=0x7f389000ef90 comp rx=0 tx=0).stop 2023-10-03T10:18:51.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.326+0000 7f389cb22700 1 -- 172.21.15.146:0/27189021 shutdown_connections 2023-10-03T10:18:51.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.326+0000 7f389cb22700 1 --2- 172.21.15.146:0/27189021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3898139280 0x7f38981c8470 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.326+0000 7f389cb22700 1 --2- 172.21.15.146:0/27189021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3898133ad0 0x7f3898071770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.326+0000 7f389cb22700 1 --2- 172.21.15.146:0/27189021 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3898136960 0x7f3898071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.326+0000 7f389cb22700 1 -- 172.21.15.146:0/27189021 >> 172.21.15.146:0/27189021 conn(0x7f3898099c40 msgr2=0x7f38981371c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.326+0000 7f389cb22700 1 -- 172.21.15.146:0/27189021 shutdown_connections 2023-10-03T10:18:51.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.326+0000 7f389cb22700 1 -- 172.21.15.146:0/27189021 wait complete. 2023-10-03T10:18:51.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.326+0000 7f8b95552700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b9009ad40 0x7f8b9011c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.326+0000 7f8b95552700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b90134140 0x7f8b9011ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.326+0000 7f8b95552700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b90134570 0x7f8b9011d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.326+0000 7f8b95552700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9011efb0 con 0x7f8b90134140 2023-10-03T10:18:51.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.326+0000 7f8b95552700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9009e880 con 0x7f8b90134570 2023-10-03T10:18:51.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.326+0000 7f8b95552700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9009c7e0 con 0x7f8b9009ad40 2023-10-03T10:18:51.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.327+0000 7f8b8effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b9009ad40 0x7f8b9011c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.327+0000 7f8b8effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b9009ad40 0x7f8b9011c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35318/0 (socket says 172.21.15.146:35318) 2023-10-03T10:18:51.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.327+0000 7f8b8effd700 1 -- 172.21.15.146:0/1585525145 learned_addr learned my addr 172.21.15.146:0/1585525145 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:51.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.327+0000 7f8b8e7fc700 1 --2- 172.21.15.146:0/1585525145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b90134140 0x7f8b9011ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.327+0000 7f8b8f7fe700 1 --2- 172.21.15.146:0/1585525145 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b90134570 0x7f8b9011d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.327+0000 7f8b8effd700 1 -- 172.21.15.146:0/1585525145 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b90134570 msgr2=0x7f8b9011d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.327+0000 7f8b8effd700 1 --2- 172.21.15.146:0/1585525145 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b90134570 0x7f8b9011d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.327+0000 7f8b8effd700 1 -- 172.21.15.146:0/1585525145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b90134140 msgr2=0x7f8b9011ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.327+0000 7f8b8effd700 1 --2- 172.21.15.146:0/1585525145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b90134140 0x7f8b9011ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.327+0000 7f8b8effd700 1 -- 172.21.15.146:0/1585525145 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b840094a0 con 0x7f8b9009ad40 2023-10-03T10:18:51.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.327+0000 7f8b8effd700 1 --2- 172.21.15.146:0/1585525145 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b9009ad40 0x7f8b9011c8c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000c480 tx=0x7f8b8000c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.327+0000 7f8b777fe700 1 -- 172.21.15.146:0/1585525145 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b80005d70 con 0x7f8b9009ad40 2023-10-03T10:18:51.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.327+0000 7f8b777fe700 1 -- 172.21.15.146:0/1585525145 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b800070d0 con 0x7f8b9009ad40 2023-10-03T10:18:51.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.327+0000 7f8b95552700 1 -- 172.21.15.146:0/1585525145 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9011ea10 con 0x7f8b9009ad40 2023-10-03T10:18:51.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.327+0000 7f8b777fe700 1 -- 172.21.15.146:0/1585525145 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b80007440 con 0x7f8b9009ad40 2023-10-03T10:18:51.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.327+0000 7f8b95552700 1 -- 172.21.15.146:0/1585525145 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9013a750 con 0x7f8b9009ad40 2023-10-03T10:18:51.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.329+0000 7f8b95552700 1 -- 172.21.15.146:0/1585525145 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b9004f2a0 con 0x7f8b9009ad40 2023-10-03T10:18:51.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.329+0000 7f8b777fe700 1 -- 172.21.15.146:0/1585525145 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8b800075a0 con 0x7f8b9009ad40 2023-10-03T10:18:51.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.329+0000 7f8b777fe700 1 -- 172.21.15.146:0/1585525145 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8b8003ead0 con 0x7f8b9009ad40 2023-10-03T10:18:51.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.333+0000 7f8b777fe700 1 -- 172.21.15.146:0/1585525145 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b80019b40 con 0x7f8b9009ad40 2023-10-03T10:18:51.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:51.402 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:51.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.486+0000 7f0ce75d0700 1 -- 172.21.15.146:0/1987728414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0ce006b2a0 con 0x7f0ce01371c0 2023-10-03T10:18:51.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.486+0000 7f0cd5ffb700 1 -- 172.21.15.146:0/1987728414 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0cd802b090 con 0x7f0ce01371c0 2023-10-03T10:18:51.487 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:51.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.488+0000 7f0ce75d0700 1 -- 172.21.15.146:0/1987728414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ce01371c0 msgr2=0x7f0ce01201a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.488+0000 7f0ce75d0700 1 --2- 172.21.15.146:0/1987728414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ce01371c0 0x7f0ce01201a0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f0ce009afe0 tx=0x7f0cd800ef90 comp rx=0 tx=0).stop 2023-10-03T10:18:51.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.488+0000 7f0ce75d0700 1 -- 172.21.15.146:0/1987728414 shutdown_connections 2023-10-03T10:18:51.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.488+0000 7f0ce75d0700 1 --2- 172.21.15.146:0/1987728414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ce01371c0 0x7f0ce01201a0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.488+0000 7f0ce75d0700 1 --2- 172.21.15.146:0/1987728414 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0ce009e870 0x7f0ce011f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.488+0000 7f0ce75d0700 1 --2- 172.21.15.146:0/1987728414 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ce009f350 0x7f0ce011fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.488+0000 7f0ce75d0700 1 -- 172.21.15.146:0/1987728414 >> 172.21.15.146:0/1987728414 conn(0x7f0ce00a4430 msgr2=0x7f0ce00a37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.489+0000 7f0ce75d0700 1 -- 172.21.15.146:0/1987728414 shutdown_connections 2023-10-03T10:18:51.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.489+0000 7f0ce75d0700 1 -- 172.21.15.146:0/1987728414 wait complete. 2023-10-03T10:18:51.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:51.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.526+0000 7f97cf275700 1 Processor -- start 2023-10-03T10:18:51.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.526+0000 7f97cf275700 1 -- start start 2023-10-03T10:18:51.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.526+0000 7f97cf275700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97c809a150 0x7f97c809e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.526+0000 7f97cf275700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f97c809f1a0 0x7f97c8134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.526+0000 7f97cf275700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c809af80 con 0x7f97c809edb0 2023-10-03T10:18:51.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.526+0000 7f97cf275700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c809fe00 con 0x7f97c809f1a0 2023-10-03T10:18:51.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.526+0000 7f97cf275700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97c806bec0 con 0x7f97c809a150 2023-10-03T10:18:51.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.526+0000 7f97cd011700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97c809a150 0x7f97c809e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.526+0000 7f97cd812700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f97c809f1a0 0x7f97c8134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.526+0000 7f97cd011700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97c809a150 0x7f97c809e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35328/0 (socket says 172.21.15.146:35328) 2023-10-03T10:18:51.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.526+0000 7f97cc810700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f97c809edb0 0x7f97c8133c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49048/0 (socket says 172.21.15.146:49048) 2023-10-03T10:18:51.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.526+0000 7f97cd011700 1 -- 172.21.15.146:0/2973475944 learned_addr learned my addr 172.21.15.146:0/2973475944 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:51.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.527+0000 7f97cd812700 1 -- 172.21.15.146:0/2973475944 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97c809a150 msgr2=0x7f97c809e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:51.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.527+0000 7f97cd812700 1 --2- 172.21.15.146:0/2973475944 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97c809a150 0x7f97c809e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.527+0000 7f97cd812700 1 -- 172.21.15.146:0/2973475944 >> v1:172.21.15.146:6789/0 conn(0x7f97c809edb0 legacy=0x7f97c8133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.527+0000 7f97cd812700 1 -- 172.21.15.146:0/2973475944 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c806bc20 con 0x7f97c809f1a0 2023-10-03T10:18:51.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.527+0000 7f97bffff700 1 -- 172.21.15.146:0/2973475944 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958228983 0 0) 0x7f97c809af80 con 0x7f97c809edb0 2023-10-03T10:18:51.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.527+0000 7f97cd011700 1 --2- 172.21.15.146:0/2973475944 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97c809a150 0x7f97c809e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:51.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.527+0000 7f97cd812700 1 --2- 172.21.15.146:0/2973475944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97c809f1a0 0x7f97c8134330 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f97c0009d90 tx=0x7f97c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded3448d0529ae75 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.527+0000 7f97bffff700 1 -- 172.21.15.146:0/2973475944 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c000e070 con 0x7f97c809f1a0 2023-10-03T10:18:51.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.527+0000 7f97bffff700 1 -- 172.21.15.146:0/2973475944 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c000bb20 con 0x7f97c809f1a0 2023-10-03T10:18:51.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.527+0000 7f97bffff700 1 -- 172.21.15.146:0/2973475944 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c0012430 con 0x7f97c809f1a0 2023-10-03T10:18:51.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.528+0000 7f97cf275700 1 -- 172.21.15.146:0/2973475944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97c809f1a0 msgr2=0x7f97c8134330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.528+0000 7f97cf275700 1 --2- 172.21.15.146:0/2973475944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97c809f1a0 0x7f97c8134330 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f97c0009d90 tx=0x7f97c000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:51.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.528+0000 7f97cf275700 1 -- 172.21.15.146:0/2973475944 shutdown_connections 2023-10-03T10:18:51.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.528+0000 7f97cf275700 1 --2- 172.21.15.146:0/2973475944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97c809f1a0 0x7f97c8134330 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.528+0000 7f97cf275700 1 --2- 172.21.15.146:0/2973475944 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97c809a150 0x7f97c809e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.528+0000 7f97cf275700 1 -- 172.21.15.146:0/2973475944 >> 172.21.15.146:0/2973475944 conn(0x7f97c80a4430 msgr2=0x7f97c80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.528+0000 7f97cf275700 1 -- 172.21.15.146:0/2973475944 shutdown_connections 2023-10-03T10:18:51.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.528+0000 7f97cf275700 1 -- 172.21.15.146:0/2973475944 wait complete. 2023-10-03T10:18:51.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.529+0000 7f97cf275700 1 Processor -- start 2023-10-03T10:18:51.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.529+0000 7f97cf275700 1 -- start start 2023-10-03T10:18:51.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.529+0000 7f97cf275700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97c809a150 0x7f97c8122650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.529+0000 7f97cf275700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97c809edb0 0x7f97c8122b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.529+0000 7f97cf275700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97c809f1a0 0x7f97c81230d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.529+0000 7f97cf275700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c8125090 con 0x7f97c809f1a0 2023-10-03T10:18:51.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.529+0000 7f97cf275700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c8133950 con 0x7f97c809a150 2023-10-03T10:18:51.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.529+0000 7f97cf275700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97c8123a40 con 0x7f97c809edb0 2023-10-03T10:18:51.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.529+0000 7f97cd812700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97c809f1a0 0x7f97c81230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.529+0000 7f97cc810700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97c809edb0 0x7f97c8122b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.529+0000 7f97cd011700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97c809a150 0x7f97c8122650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.529+0000 7f97cd011700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97c809a150 0x7f97c8122650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51216/0 (socket says 172.21.15.146:51216) 2023-10-03T10:18:51.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.529+0000 7f97cd011700 1 -- 172.21.15.146:0/2992823484 learned_addr learned my addr 172.21.15.146:0/2992823484 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:51.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.529+0000 7f97cd812700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97c809f1a0 0x7f97c81230d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54116/0 (socket says 172.21.15.146:54116) 2023-10-03T10:18:51.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.529+0000 7f97cd011700 1 -- 172.21.15.146:0/2992823484 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97c809edb0 msgr2=0x7f97c8122b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.529+0000 7f97cd011700 1 --2- 172.21.15.146:0/2992823484 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97c809edb0 0x7f97c8122b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.529+0000 7f97cd011700 1 -- 172.21.15.146:0/2992823484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97c809f1a0 msgr2=0x7f97c81230d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.529+0000 7f97cd011700 1 --2- 172.21.15.146:0/2992823484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97c809f1a0 0x7f97c81230d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.530+0000 7f97cd011700 1 -- 172.21.15.146:0/2992823484 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c4009550 con 0x7f97c809a150 2023-10-03T10:18:51.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.530+0000 7f97cc810700 1 --2- 172.21.15.146:0/2992823484 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97c809edb0 0x7f97c8122b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:51.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.530+0000 7f97cd812700 1 --2- 172.21.15.146:0/2992823484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97c809f1a0 0x7f97c81230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:51.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.530+0000 7f97cd011700 1 --2- 172.21.15.146:0/2992823484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97c809a150 0x7f97c8122650 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f97c400e9b0 tx=0x7f97c400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.530+0000 7f97bdffb700 1 -- 172.21.15.146:0/2992823484 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c400ee50 con 0x7f97c809a150 2023-10-03T10:18:51.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.530+0000 7f97bdffb700 1 -- 172.21.15.146:0/2992823484 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c400c850 con 0x7f97c809a150 2023-10-03T10:18:51.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.530+0000 7f97cf275700 1 -- 172.21.15.146:0/2992823484 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c0009a70 con 0x7f97c809a150 2023-10-03T10:18:51.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.530+0000 7f97bdffb700 1 -- 172.21.15.146:0/2992823484 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c400cbc0 con 0x7f97c809a150 2023-10-03T10:18:51.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.530+0000 7f97cf275700 1 -- 172.21.15.146:0/2992823484 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c809b750 con 0x7f97c809a150 2023-10-03T10:18:51.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.531+0000 7f97bdffb700 1 -- 172.21.15.146:0/2992823484 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f97c400cd20 con 0x7f97c809a150 2023-10-03T10:18:51.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.531+0000 7f97bdffb700 1 -- 172.21.15.146:0/2992823484 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f97c403f720 con 0x7f97c809a150 2023-10-03T10:18:51.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.531+0000 7f97cf275700 1 -- 172.21.15.146:0/2992823484 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c809fa30 con 0x7f97c809a150 2023-10-03T10:18:51.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.532+0000 7f8b95552700 1 -- 172.21.15.146:0/1585525145 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8b9011e7f0 con 0x7f8b9009ad40 2023-10-03T10:18:51.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.532+0000 7f8b777fe700 1 -- 172.21.15.146:0/1585525145 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8b80017030 con 0x7f8b9009ad40 2023-10-03T10:18:51.536 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:51.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.534+0000 7f8b95552700 1 -- 172.21.15.146:0/1585525145 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b9009ad40 msgr2=0x7f8b9011c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.534+0000 7f8b95552700 1 --2- 172.21.15.146:0/1585525145 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b9009ad40 0x7f8b9011c8c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000c480 tx=0x7f8b8000c790 comp rx=0 tx=0).stop 2023-10-03T10:18:51.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.534+0000 7f8b95552700 1 -- 172.21.15.146:0/1585525145 shutdown_connections 2023-10-03T10:18:51.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.534+0000 7f8b95552700 1 --2- 172.21.15.146:0/1585525145 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b90134570 0x7f8b9011d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.534+0000 7f8b95552700 1 --2- 172.21.15.146:0/1585525145 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8b9009ad40 0x7f8b9011c8c0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.534+0000 7f8b95552700 1 --2- 172.21.15.146:0/1585525145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b90134140 0x7f8b9011ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.534+0000 7f8b95552700 1 -- 172.21.15.146:0/1585525145 >> 172.21.15.146:0/1585525145 conn(0x7f8b90099c40 msgr2=0x7f8b900a4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.534+0000 7f8b95552700 1 -- 172.21.15.146:0/1585525145 shutdown_connections 2023-10-03T10:18:51.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.534+0000 7f8b95552700 1 -- 172.21.15.146:0/1585525145 wait complete. 2023-10-03T10:18:51.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.536+0000 7f97bdffb700 1 -- 172.21.15.146:0/2992823484 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97c40232f0 con 0x7f97c809a150 2023-10-03T10:18:51.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:51.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.723+0000 7f97cf275700 1 -- 172.21.15.146:0/2992823484 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f97c8125bc0 con 0x7f97c809a150 2023-10-03T10:18:51.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.723+0000 7f97bdffb700 1 -- 172.21.15.146:0/2992823484 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f97c4021030 con 0x7f97c809a150 2023-10-03T10:18:51.724 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:51.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.725+0000 7f97cf275700 1 -- 172.21.15.146:0/2992823484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97c809a150 msgr2=0x7f97c8122650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.725+0000 7f97cf275700 1 --2- 172.21.15.146:0/2992823484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97c809a150 0x7f97c8122650 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f97c400e9b0 tx=0x7f97c400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.725+0000 7f97cf275700 1 -- 172.21.15.146:0/2992823484 shutdown_connections 2023-10-03T10:18:51.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.725+0000 7f97cf275700 1 --2- 172.21.15.146:0/2992823484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97c809f1a0 0x7f97c81230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.725+0000 7f97cf275700 1 --2- 172.21.15.146:0/2992823484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97c809a150 0x7f97c8122650 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.725+0000 7f97cf275700 1 --2- 172.21.15.146:0/2992823484 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f97c809edb0 0x7f97c8122b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.725+0000 7f97cf275700 1 -- 172.21.15.146:0/2992823484 >> 172.21.15.146:0/2992823484 conn(0x7f97c80a4430 msgr2=0x7f97c809d420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.725+0000 7f97cf275700 1 -- 172.21.15.146:0/2992823484 shutdown_connections 2023-10-03T10:18:51.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:51.726+0000 7f97cf275700 1 -- 172.21.15.146:0/2992823484 wait complete. 2023-10-03T10:18:51.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:52.343 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:52.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.466+0000 7f1531c07700 1 Processor -- start 2023-10-03T10:18:52.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.466+0000 7f1531c07700 1 -- start start 2023-10-03T10:18:52.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.467+0000 7f1531c07700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f152c12e260 0x7f152c12e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.467+0000 7f1531c07700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f152c12eb70 0x7f152c06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.467+0000 7f1531c07700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152c09d470 con 0x7f152c09f3d0 2023-10-03T10:18:52.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.467+0000 7f1531c07700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f152c12de50 con 0x7f152c12eb70 2023-10-03T10:18:52.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.467+0000 7f1531c07700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f152c09e010 con 0x7f152c12e260 2023-10-03T10:18:52.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.467+0000 7f152affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f152c12eb70 0x7f152c06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.467+0000 7f152b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f152c12e260 0x7f152c12e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.467+0000 7f152affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f152c12eb70 0x7f152c06a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54132/0 (socket says 172.21.15.146:54132) 2023-10-03T10:18:52.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.467+0000 7f152bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f152c09f3d0 0x7f152c06acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49058/0 (socket says 172.21.15.146:49058) 2023-10-03T10:18:52.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.467+0000 7f152affd700 1 -- 172.21.15.146:0/246041312 learned_addr learned my addr 172.21.15.146:0/246041312 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:52.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.467+0000 7f152b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f152c12e260 0x7f152c12e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35356/0 (socket says 172.21.15.146:35356) 2023-10-03T10:18:52.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.467+0000 7f152b7fe700 1 -- 172.21.15.146:0/246041312 >> v2:172.21.15.146:3300/0 conn(0x7f152c12eb70 msgr2=0x7f152c06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:52.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.467+0000 7f152b7fe700 1 --2- 172.21.15.146:0/246041312 >> v2:172.21.15.146:3300/0 conn(0x7f152c12eb70 0x7f152c06a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.467+0000 7f152b7fe700 1 -- 172.21.15.146:0/246041312 >> v1:172.21.15.146:6789/0 conn(0x7f152c09f3d0 legacy=0x7f152c06acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.467+0000 7f152b7fe700 1 -- 172.21.15.146:0/246041312 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c12e040 con 0x7f152c12e260 2023-10-03T10:18:52.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.467+0000 7f152a7fc700 1 -- 172.21.15.146:0/246041312 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259155304 0 0) 0x7f152c09d470 con 0x7f152c09f3d0 2023-10-03T10:18:52.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.467+0000 7f152affd700 1 --2- 172.21.15.146:0/246041312 >> v2:172.21.15.146:3300/0 conn(0x7f152c12eb70 0x7f152c06a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:52.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.467+0000 7f152b7fe700 1 --2- 172.21.15.146:0/246041312 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f152c12e260 0x7f152c12e630 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1520009840 tx=0x7f1520009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e84ce99b81c9d9de server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.468+0000 7f152a7fc700 1 -- 172.21.15.146:0/246041312 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1520011830 con 0x7f152c12e260 2023-10-03T10:18:52.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.468+0000 7f152a7fc700 1 -- 172.21.15.146:0/246041312 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1520011990 con 0x7f152c12e260 2023-10-03T10:18:52.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.468+0000 7f152a7fc700 1 -- 172.21.15.146:0/246041312 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1520011d20 con 0x7f152c12e260 2023-10-03T10:18:52.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.468+0000 7f1531c07700 1 -- 172.21.15.146:0/246041312 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f152c12e260 msgr2=0x7f152c12e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.468+0000 7f1531c07700 1 --2- 172.21.15.146:0/246041312 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f152c12e260 0x7f152c12e630 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1520009840 tx=0x7f1520009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:52.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.468+0000 7f1531c07700 1 -- 172.21.15.146:0/246041312 shutdown_connections 2023-10-03T10:18:52.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.468+0000 7f1531c07700 1 --2- 172.21.15.146:0/246041312 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f152c12e260 0x7f152c12e630 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.468+0000 7f1531c07700 1 --2- 172.21.15.146:0/246041312 >> v2:172.21.15.146:3300/0 conn(0x7f152c12eb70 0x7f152c06a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.468+0000 7f1531c07700 1 -- 172.21.15.146:0/246041312 >> 172.21.15.146:0/246041312 conn(0x7f152c099c40 msgr2=0x7f152c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:52.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.468+0000 7f1531c07700 1 -- 172.21.15.146:0/246041312 shutdown_connections 2023-10-03T10:18:52.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.468+0000 7f1531c07700 1 -- 172.21.15.146:0/246041312 wait complete. 2023-10-03T10:18:52.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.469+0000 7f1531c07700 1 Processor -- start 2023-10-03T10:18:52.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.469+0000 7f1531c07700 1 -- start start 2023-10-03T10:18:52.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.470+0000 7f1531c07700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f152c09f3d0 0x7f152c06e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.470+0000 7f1531c07700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f152c12e260 0x7f152c06ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.470+0000 7f1531c07700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f152c12eb70 0x7f152c06f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.470+0000 7f1531c07700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c071bc0 con 0x7f152c09f3d0 2023-10-03T10:18:52.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.470+0000 7f1531c07700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152c1283c0 con 0x7f152c12eb70 2023-10-03T10:18:52.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.470+0000 7f1531c07700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f152c070510 con 0x7f152c12e260 2023-10-03T10:18:52.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.470+0000 7f152b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f152c09f3d0 0x7f152c06e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.470+0000 7f152affd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f152c12e260 0x7f152c06ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.470+0000 7f152b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f152c09f3d0 0x7f152c06e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54142/0 (socket says 172.21.15.146:54142) 2023-10-03T10:18:52.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.470+0000 7f152b7fe700 1 -- 172.21.15.146:0/2729442005 learned_addr learned my addr 172.21.15.146:0/2729442005 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:52.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.470+0000 7f152bfff700 1 --2- 172.21.15.146:0/2729442005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f152c12eb70 0x7f152c06f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.470+0000 7f152b7fe700 1 -- 172.21.15.146:0/2729442005 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f152c12e260 msgr2=0x7f152c06ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.470+0000 7f152b7fe700 1 --2- 172.21.15.146:0/2729442005 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f152c12e260 0x7f152c06ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.470+0000 7f152b7fe700 1 -- 172.21.15.146:0/2729442005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f152c12eb70 msgr2=0x7f152c06f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.470+0000 7f152b7fe700 1 --2- 172.21.15.146:0/2729442005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f152c12eb70 0x7f152c06f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.470+0000 7f152b7fe700 1 -- 172.21.15.146:0/2729442005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151c009550 con 0x7f152c09f3d0 2023-10-03T10:18:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.470+0000 7f152b7fe700 1 --2- 172.21.15.146:0/2729442005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f152c09f3d0 0x7f152c06e900 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f15200090b0 tx=0x7f1520004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.470+0000 7f1513fff700 1 -- 172.21.15.146:0/2729442005 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15200036a0 con 0x7f152c09f3d0 2023-10-03T10:18:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.470+0000 7f1513fff700 1 -- 172.21.15.146:0/2729442005 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152001f070 con 0x7f152c09f3d0 2023-10-03T10:18:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.470+0000 7f1513fff700 1 -- 172.21.15.146:0/2729442005 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1520003a60 con 0x7f152c09f3d0 2023-10-03T10:18:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.470+0000 7f1531c07700 1 -- 172.21.15.146:0/2729442005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15200094a0 con 0x7f152c09f3d0 2023-10-03T10:18:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.471+0000 7f1531c07700 1 -- 172.21.15.146:0/2729442005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f152c12bab0 con 0x7f152c09f3d0 2023-10-03T10:18:52.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.471+0000 7f1531c07700 1 -- 172.21.15.146:0/2729442005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f152c0a2660 con 0x7f152c09f3d0 2023-10-03T10:18:52.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.472+0000 7f1513fff700 1 -- 172.21.15.146:0/2729442005 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1520003bc0 con 0x7f152c09f3d0 2023-10-03T10:18:52.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.472+0000 7f1513fff700 1 -- 172.21.15.146:0/2729442005 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1520021070 con 0x7f152c09f3d0 2023-10-03T10:18:52.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.476+0000 7f1513fff700 1 -- 172.21.15.146:0/2729442005 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1520010d50 con 0x7f152c09f3d0 2023-10-03T10:18:52.502 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:52.548 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.630+0000 7f1f15d70700 1 Processor -- start 2023-10-03T10:18:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.630+0000 7f1f15d70700 1 -- start start 2023-10-03T10:18:52.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.631+0000 7f1f15d70700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f100a0a70 0x7f1f100a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.631+0000 7f1f15d70700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f100a1380 0x7f1f10133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.631+0000 7f1f15d70700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f1009dc00 con 0x7f1f10133f50 2023-10-03T10:18:52.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.631+0000 7f1f15d70700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1009ea60 con 0x7f1f100a0a70 2023-10-03T10:18:52.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.631+0000 7f1f15d70700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1009dec0 con 0x7f1f100a1380 2023-10-03T10:18:52.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.631+0000 7f1f0ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1f10133f50 0x7f1f1013acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49066/0 (socket says 172.21.15.146:49066) 2023-10-03T10:18:52.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.631+0000 7f1f0ffff700 1 -- 172.21.15.146:0/2650290551 learned_addr learned my addr 172.21.15.146:0/2650290551 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:52.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.631+0000 7f1f0f7fe700 1 --2- 172.21.15.146:0/2650290551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f100a0a70 0x7f1f100a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.631+0000 7f1f0effd700 1 --2- 172.21.15.146:0/2650290551 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f100a1380 0x7f1f10133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.631+0000 7f1f0e7fc700 1 -- 172.21.15.146:0/2650290551 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117990020 0 0) 0x7f1f1009dc00 con 0x7f1f10133f50 2023-10-03T10:18:52.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.631+0000 7f1f0e7fc700 1 -- 172.21.15.146:0/2650290551 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ef80035b0 con 0x7f1f10133f50 2023-10-03T10:18:52.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.631+0000 7f1f0f7fe700 1 -- 172.21.15.146:0/2650290551 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f100a1380 msgr2=0x7f1f10133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:52.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.631+0000 7f1f0f7fe700 1 --2- 172.21.15.146:0/2650290551 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f100a1380 0x7f1f10133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.631+0000 7f1f0f7fe700 1 -- 172.21.15.146:0/2650290551 >> v1:172.21.15.146:6789/0 conn(0x7f1f10133f50 legacy=0x7f1f1013acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.631+0000 7f1f0f7fe700 1 -- 172.21.15.146:0/2650290551 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1009e6a0 con 0x7f1f100a0a70 2023-10-03T10:18:52.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.632+0000 7f1f0f7fe700 1 --2- 172.21.15.146:0/2650290551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f100a0a70 0x7f1f100a0e40 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009870 tx=0x7f1f00009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c330d69b69f2b282 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.632+0000 7f1f0e7fc700 1 -- 172.21.15.146:0/2650290551 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f00011830 con 0x7f1f100a0a70 2023-10-03T10:18:52.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.632+0000 7f1f0e7fc700 1 -- 172.21.15.146:0/2650290551 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f00011990 con 0x7f1f100a0a70 2023-10-03T10:18:52.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.632+0000 7f1f0e7fc700 1 -- 172.21.15.146:0/2650290551 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f00011d20 con 0x7f1f100a0a70 2023-10-03T10:18:52.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.632+0000 7f1f15d70700 1 -- 172.21.15.146:0/2650290551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f100a0a70 msgr2=0x7f1f100a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.632+0000 7f1f15d70700 1 --2- 172.21.15.146:0/2650290551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f100a0a70 0x7f1f100a0e40 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009870 tx=0x7f1f00009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:52.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.632+0000 7f1f15d70700 1 -- 172.21.15.146:0/2650290551 shutdown_connections 2023-10-03T10:18:52.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.632+0000 7f1f15d70700 1 --2- 172.21.15.146:0/2650290551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f100a0a70 0x7f1f100a0e40 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.632+0000 7f1f15d70700 1 --2- 172.21.15.146:0/2650290551 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f100a1380 0x7f1f10133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.632+0000 7f1f15d70700 1 -- 172.21.15.146:0/2650290551 >> 172.21.15.146:0/2650290551 conn(0x7f1f100a6610 msgr2=0x7f1f100a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:52.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.633+0000 7f1f15d70700 1 -- 172.21.15.146:0/2650290551 shutdown_connections 2023-10-03T10:18:52.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.633+0000 7f1f15d70700 1 -- 172.21.15.146:0/2650290551 wait complete. 2023-10-03T10:18:52.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.633+0000 7f1f15d70700 1 Processor -- start 2023-10-03T10:18:52.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.634+0000 7f1f15d70700 1 -- start start 2023-10-03T10:18:52.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.634+0000 7f1f15d70700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f100a0a70 0x7f1f101228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.634+0000 7f1f15d70700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f100a1380 0x7f1f10122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.634+0000 7f1f15d70700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f10133f50 0x7f1f10123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.634+0000 7f1f15d70700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f10126180 con 0x7f1f100a0a70 2023-10-03T10:18:52.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.634+0000 7f1f15d70700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f10126360 con 0x7f1f100a1380 2023-10-03T10:18:52.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.634+0000 7f1f15d70700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f101339d0 con 0x7f1f10133f50 2023-10-03T10:18:52.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.634+0000 7f1f0effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f100a1380 0x7f1f10122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.634+0000 7f1f0ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f10133f50 0x7f1f10123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.634+0000 7f1f0effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f100a1380 0x7f1f10122e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51236/0 (socket says 172.21.15.146:51236) 2023-10-03T10:18:52.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.634+0000 7f1f0effd700 1 -- 172.21.15.146:0/2502194708 learned_addr learned my addr 172.21.15.146:0/2502194708 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:52.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.634+0000 7f1f0f7fe700 1 --2- 172.21.15.146:0/2502194708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f100a0a70 0x7f1f101228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.635+0000 7f1f0effd700 1 -- 172.21.15.146:0/2502194708 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f10133f50 msgr2=0x7f1f10123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.635+0000 7f1f0effd700 1 --2- 172.21.15.146:0/2502194708 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f10133f50 0x7f1f10123350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.635+0000 7f1f0effd700 1 -- 172.21.15.146:0/2502194708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f100a0a70 msgr2=0x7f1f101228d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.635+0000 7f1f0effd700 1 --2- 172.21.15.146:0/2502194708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f100a0a70 0x7f1f101228d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.635+0000 7f1f0effd700 1 -- 172.21.15.146:0/2502194708 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f000094a0 con 0x7f1f100a1380 2023-10-03T10:18:52.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.635+0000 7f1f0ffff700 1 --2- 172.21.15.146:0/2502194708 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f10133f50 0x7f1f10123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:52.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.635+0000 7f1f0effd700 1 --2- 172.21.15.146:0/2502194708 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f100a1380 0x7f1f10122e10 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400e980 tx=0x7f1f0400ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.635+0000 7f1ef7fff700 1 -- 172.21.15.146:0/2502194708 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f04009710 con 0x7f1f100a1380 2023-10-03T10:18:52.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.635+0000 7f1ef7fff700 1 -- 172.21.15.146:0/2502194708 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0400c690 con 0x7f1f100a1380 2023-10-03T10:18:52.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.635+0000 7f1f15d70700 1 -- 172.21.15.146:0/2502194708 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f100a03e0 con 0x7f1f100a1380 2023-10-03T10:18:52.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.635+0000 7f1ef7fff700 1 -- 172.21.15.146:0/2502194708 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0400ca20 con 0x7f1f100a1380 2023-10-03T10:18:52.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.635+0000 7f1f15d70700 1 -- 172.21.15.146:0/2502194708 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f10125dc0 con 0x7f1f100a1380 2023-10-03T10:18:52.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.636+0000 7f1ef7fff700 1 -- 172.21.15.146:0/2502194708 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f0400cb80 con 0x7f1f100a1380 2023-10-03T10:18:52.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.636+0000 7f1f15d70700 1 -- 172.21.15.146:0/2502194708 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f1004f2a0 con 0x7f1f100a1380 2023-10-03T10:18:52.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.636+0000 7f1ef7fff700 1 -- 172.21.15.146:0/2502194708 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1f0403f9f0 con 0x7f1f100a1380 2023-10-03T10:18:52.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.641+0000 7f1ef7fff700 1 -- 172.21.15.146:0/2502194708 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f0401b3b0 con 0x7f1f100a1380 2023-10-03T10:18:52.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.674+0000 7fc12352f700 1 Processor -- start 2023-10-03T10:18:52.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.675+0000 7fc12352f700 1 -- start start 2023-10-03T10:18:52.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.675+0000 7fc12352f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc11c0a0a70 0x7fc11c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.675+0000 7fc12352f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc11c0a1380 0x7fc11c133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.675+0000 7fc12352f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11c09dc00 con 0x7fc11c133f50 2023-10-03T10:18:52.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.675+0000 7fc12352f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c09ea60 con 0x7fc11c0a1380 2023-10-03T10:18:52.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.675+0000 7fc12352f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c09dec0 con 0x7fc11c0a0a70 2023-10-03T10:18:52.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.675+0000 7fc121acc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc11c133f50 0x7fc11c13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49068/0 (socket says 172.21.15.146:49068) 2023-10-03T10:18:52.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.675+0000 7fc121acc700 1 -- 172.21.15.146:0/2014799706 learned_addr learned my addr 172.21.15.146:0/2014799706 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:52.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.675+0000 7fc1212cb700 1 --2- 172.21.15.146:0/2014799706 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc11c0a0a70 0x7fc11c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.675+0000 7fc120aca700 1 --2- 172.21.15.146:0/2014799706 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc11c0a1380 0x7fc11c133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.676+0000 7fc120aca700 1 -- 172.21.15.146:0/2014799706 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc11c0a0a70 msgr2=0x7fc11c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:52.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.676+0000 7fc120aca700 1 --2- 172.21.15.146:0/2014799706 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc11c0a0a70 0x7fc11c0a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.676+0000 7fc113fff700 1 -- 172.21.15.146:0/2014799706 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432911598 0 0) 0x7fc11c09dc00 con 0x7fc11c133f50 2023-10-03T10:18:52.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.676+0000 7fc120aca700 1 -- 172.21.15.146:0/2014799706 >> v1:172.21.15.146:6789/0 conn(0x7fc11c133f50 legacy=0x7fc11c13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.676+0000 7fc120aca700 1 -- 172.21.15.146:0/2014799706 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c09e6a0 con 0x7fc11c0a1380 2023-10-03T10:18:52.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.676+0000 7fc120aca700 1 --2- 172.21.15.146:0/2014799706 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc11c0a1380 0x7fc11c133a10 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009870 tx=0x7fc10c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d6104af23739635 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.676+0000 7f1531c07700 1 -- 172.21.15.146:0/2729442005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f152c04f2a0 con 0x7f152c09f3d0 2023-10-03T10:18:52.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.676+0000 7fc113fff700 1 -- 172.21.15.146:0/2014799706 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c011830 con 0x7fc11c0a1380 2023-10-03T10:18:52.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.676+0000 7fc113fff700 1 -- 172.21.15.146:0/2014799706 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c011990 con 0x7fc11c0a1380 2023-10-03T10:18:52.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.676+0000 7fc113fff700 1 -- 172.21.15.146:0/2014799706 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c011d20 con 0x7fc11c0a1380 2023-10-03T10:18:52.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.676+0000 7f1513fff700 1 -- 172.21.15.146:0/2729442005 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1520034090 con 0x7f152c09f3d0 2023-10-03T10:18:52.678 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:52.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.677+0000 7fc12352f700 1 -- 172.21.15.146:0/2014799706 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc11c0a1380 msgr2=0x7fc11c133a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.677+0000 7fc12352f700 1 --2- 172.21.15.146:0/2014799706 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc11c0a1380 0x7fc11c133a10 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009870 tx=0x7fc10c009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:52.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.677+0000 7fc12352f700 1 -- 172.21.15.146:0/2014799706 shutdown_connections 2023-10-03T10:18:52.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.677+0000 7fc12352f700 1 --2- 172.21.15.146:0/2014799706 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc11c0a0a70 0x7fc11c0a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.677+0000 7fc12352f700 1 --2- 172.21.15.146:0/2014799706 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc11c0a1380 0x7fc11c133a10 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.677+0000 7fc12352f700 1 -- 172.21.15.146:0/2014799706 >> 172.21.15.146:0/2014799706 conn(0x7fc11c0a6610 msgr2=0x7fc11c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:52.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.677+0000 7fc12352f700 1 -- 172.21.15.146:0/2014799706 shutdown_connections 2023-10-03T10:18:52.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.677+0000 7fc12352f700 1 -- 172.21.15.146:0/2014799706 wait complete. 2023-10-03T10:18:52.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.678+0000 7fc12352f700 1 Processor -- start 2023-10-03T10:18:52.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.679+0000 7fc12352f700 1 -- start start 2023-10-03T10:18:52.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.679+0000 7f1531c07700 1 -- 172.21.15.146:0/2729442005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f152c09f3d0 msgr2=0x7f152c06e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.679+0000 7f1531c07700 1 --2- 172.21.15.146:0/2729442005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f152c09f3d0 0x7f152c06e900 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f15200090b0 tx=0x7f1520004750 comp rx=0 tx=0).stop 2023-10-03T10:18:52.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.679+0000 7f1531c07700 1 -- 172.21.15.146:0/2729442005 shutdown_connections 2023-10-03T10:18:52.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.679+0000 7f1531c07700 1 --2- 172.21.15.146:0/2729442005 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f152c12eb70 0x7f152c06f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.679+0000 7f1531c07700 1 --2- 172.21.15.146:0/2729442005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f152c09f3d0 0x7f152c06e900 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.679+0000 7f1531c07700 1 --2- 172.21.15.146:0/2729442005 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f152c12e260 0x7f152c06ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.679+0000 7f1531c07700 1 -- 172.21.15.146:0/2729442005 >> 172.21.15.146:0/2729442005 conn(0x7f152c099c40 msgr2=0x7f152c1b8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:52.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.679+0000 7fc12352f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc11c0a0a70 0x7fc11c122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.679+0000 7fc12352f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc11c0a1380 0x7fc11c122d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.679+0000 7fc12352f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc11c133f50 0x7fc11c1232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.679+0000 7fc12352f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c126060 con 0x7fc11c0a1380 2023-10-03T10:18:52.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.679+0000 7fc12352f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c124540 con 0x7fc11c0a0a70 2023-10-03T10:18:52.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.679+0000 7fc12352f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c0a03e0 con 0x7fc11c133f50 2023-10-03T10:18:52.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.679+0000 7fc1212cb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc11c0a0a70 0x7fc11c122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.679+0000 7fc120aca700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc11c0a1380 0x7fc11c122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.679+0000 7fc121acc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc11c133f50 0x7fc11c1232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.679+0000 7fc120aca700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc11c0a1380 0x7fc11c122d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54152/0 (socket says 172.21.15.146:54152) 2023-10-03T10:18:52.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.679+0000 7fc1212cb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc11c0a0a70 0x7fc11c122820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51262/0 (socket says 172.21.15.146:51262) 2023-10-03T10:18:52.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.679+0000 7fc120aca700 1 -- 172.21.15.146:0/1024255837 learned_addr learned my addr 172.21.15.146:0/1024255837 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:52.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.679+0000 7f1531c07700 1 -- 172.21.15.146:0/2729442005 shutdown_connections 2023-10-03T10:18:52.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.679+0000 7f1531c07700 1 -- 172.21.15.146:0/2729442005 wait complete. 2023-10-03T10:18:52.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.680+0000 7fc120aca700 1 -- 172.21.15.146:0/1024255837 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc11c133f50 msgr2=0x7fc11c1232a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.680+0000 7fc120aca700 1 --2- 172.21.15.146:0/1024255837 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc11c133f50 0x7fc11c1232a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.680+0000 7fc120aca700 1 -- 172.21.15.146:0/1024255837 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc11c0a0a70 msgr2=0x7fc11c122820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.680+0000 7fc120aca700 1 --2- 172.21.15.146:0/1024255837 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc11c0a0a70 0x7fc11c122820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.680+0000 7fc120aca700 1 -- 172.21.15.146:0/1024255837 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c0094a0 con 0x7fc11c0a1380 2023-10-03T10:18:52.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.680+0000 7fc121acc700 1 --2- 172.21.15.146:0/1024255837 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc11c133f50 0x7fc11c1232a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:52.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.680+0000 7fc120aca700 1 --2- 172.21.15.146:0/1024255837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc11c0a1380 0x7fc11c122d60 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0090b0 tx=0x7fc10c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.680+0000 7fc111ffb700 1 -- 172.21.15.146:0/1024255837 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c004510 con 0x7fc11c0a1380 2023-10-03T10:18:52.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.680+0000 7fc111ffb700 1 -- 172.21.15.146:0/1024255837 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c01f070 con 0x7fc11c0a1380 2023-10-03T10:18:52.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.680+0000 7fc12352f700 1 -- 172.21.15.146:0/1024255837 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11c124c70 con 0x7fc11c0a1380 2023-10-03T10:18:52.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.680+0000 7fc111ffb700 1 -- 172.21.15.146:0/1024255837 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c0038e0 con 0x7fc11c0a1380 2023-10-03T10:18:52.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.680+0000 7fc12352f700 1 -- 172.21.15.146:0/1024255837 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc11c126ad0 con 0x7fc11c0a1380 2023-10-03T10:18:52.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.681+0000 7fc111ffb700 1 -- 172.21.15.146:0/1024255837 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc10c003a40 con 0x7fc11c0a1380 2023-10-03T10:18:52.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.681+0000 7fc111ffb700 1 -- 172.21.15.146:0/1024255837 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc10c021070 con 0x7fc11c0a1380 2023-10-03T10:18:52.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.682+0000 7fc12352f700 1 -- 172.21.15.146:0/1024255837 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc11c04f2a0 con 0x7fc11c0a1380 2023-10-03T10:18:52.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.686+0000 7fc111ffb700 1 -- 172.21.15.146:0/1024255837 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc10c02b080 con 0x7fc11c0a1380 2023-10-03T10:18:52.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:52.740 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:52.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.839+0000 7f1f15d70700 1 -- 172.21.15.146:0/2502194708 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1f10072980 con 0x7f1f100a1380 2023-10-03T10:18:52.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.839+0000 7f1ef7fff700 1 -- 172.21.15.146:0/2502194708 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1f04017020 con 0x7f1f100a1380 2023-10-03T10:18:52.839 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:52.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.841+0000 7f1f15d70700 1 -- 172.21.15.146:0/2502194708 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f100a1380 msgr2=0x7f1f10122e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.841+0000 7f1f15d70700 1 --2- 172.21.15.146:0/2502194708 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f100a1380 0x7f1f10122e10 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400e980 tx=0x7f1f0400ec90 comp rx=0 tx=0).stop 2023-10-03T10:18:52.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.841+0000 7f1f15d70700 1 -- 172.21.15.146:0/2502194708 shutdown_connections 2023-10-03T10:18:52.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.841+0000 7f1f15d70700 1 --2- 172.21.15.146:0/2502194708 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1f10133f50 0x7f1f10123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.841+0000 7f1f15d70700 1 --2- 172.21.15.146:0/2502194708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f100a0a70 0x7f1f101228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.841+0000 7f1f15d70700 1 --2- 172.21.15.146:0/2502194708 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f100a1380 0x7f1f10122e10 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.841+0000 7f1f15d70700 1 -- 172.21.15.146:0/2502194708 >> 172.21.15.146:0/2502194708 conn(0x7f1f100a6610 msgr2=0x7f1f100a4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:52.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.841+0000 7f1f15d70700 1 -- 172.21.15.146:0/2502194708 shutdown_connections 2023-10-03T10:18:52.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.841+0000 7f1f15d70700 1 -- 172.21.15.146:0/2502194708 wait complete. 2023-10-03T10:18:52.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:52.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.867+0000 7f023a046700 1 Processor -- start 2023-10-03T10:18:52.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.867+0000 7f023a046700 1 -- start start 2023-10-03T10:18:52.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.867+0000 7f023a046700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0234133ad0 0x7f0234133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.867+0000 7f023a046700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02341300a0 0x7f02341304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.867+0000 7f023a046700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f02341309f0 0x7f023413a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.867+0000 7f023a046700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023406b2d0 con 0x7f02341309f0 2023-10-03T10:18:52.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.867+0000 7f023a046700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0234133610 con 0x7f0234133ad0 2023-10-03T10:18:52.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.867+0000 7f023a046700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f023409a500 con 0x7f02341300a0 2023-10-03T10:18:52.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.867+0000 7f02337fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0234133ad0 0x7f0234133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.867+0000 7f0233fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f02341309f0 0x7f023413a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.867+0000 7f02337fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0234133ad0 0x7f0234133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51272/0 (socket says 172.21.15.146:51272) 2023-10-03T10:18:52.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.867+0000 7f02337fe700 1 -- 172.21.15.146:0/137369129 learned_addr learned my addr 172.21.15.146:0/137369129 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:52.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.867+0000 7f0232ffd700 1 --2- 172.21.15.146:0/137369129 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02341300a0 0x7f02341304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.867+0000 7f02337fe700 1 -- 172.21.15.146:0/137369129 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02341300a0 msgr2=0x7f02341304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:52.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.867+0000 7f02337fe700 1 --2- 172.21.15.146:0/137369129 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02341300a0 0x7f02341304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.867+0000 7f02337fe700 1 -- 172.21.15.146:0/137369129 >> v2:172.21.15.146:3300/0 conn(0x7f02341309f0 msgr2=0x7f023413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:52.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.867+0000 7f02337fe700 1 --2- 172.21.15.146:0/137369129 >> v2:172.21.15.146:3300/0 conn(0x7f02341309f0 0x7f023413a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.868+0000 7f02337fe700 1 -- 172.21.15.146:0/137369129 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02341338b0 con 0x7f0234133ad0 2023-10-03T10:18:52.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.868+0000 7f0233fff700 1 --2- 172.21.15.146:0/137369129 >> v2:172.21.15.146:3300/0 conn(0x7f02341309f0 0x7f023413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.868+0000 7f02337fe700 1 --2- 172.21.15.146:0/137369129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0234133ad0 0x7f0234133ea0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f0224009e50 tx=0x7f022400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f4d9111dda8d906 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.868+0000 7f02327fc700 1 -- 172.21.15.146:0/137369129 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022400e070 con 0x7f0234133ad0 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.868+0000 7f02327fc700 1 -- 172.21.15.146:0/137369129 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022400b910 con 0x7f0234133ad0 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.868+0000 7f02327fc700 1 -- 172.21.15.146:0/137369129 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022400bcc0 con 0x7f0234133ad0 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.868+0000 7f023a046700 1 -- 172.21.15.146:0/137369129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0234133ad0 msgr2=0x7f0234133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.868+0000 7f023a046700 1 --2- 172.21.15.146:0/137369129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0234133ad0 0x7f0234133ea0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f0224009e50 tx=0x7f022400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.868+0000 7f023a046700 1 -- 172.21.15.146:0/137369129 shutdown_connections 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.868+0000 7f023a046700 1 --2- 172.21.15.146:0/137369129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0234133ad0 0x7f0234133ea0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.868+0000 7f023a046700 1 --2- 172.21.15.146:0/137369129 >> v2:172.21.15.146:3300/0 conn(0x7f02341309f0 0x7f023413a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.868+0000 7f023a046700 1 --2- 172.21.15.146:0/137369129 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f02341300a0 0x7f02341304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.868+0000 7f023a046700 1 -- 172.21.15.146:0/137369129 >> 172.21.15.146:0/137369129 conn(0x7f0234099c40 msgr2=0x7f02340a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:52.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.869+0000 7f023a046700 1 -- 172.21.15.146:0/137369129 shutdown_connections 2023-10-03T10:18:52.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.869+0000 7f023a046700 1 -- 172.21.15.146:0/137369129 wait complete. 2023-10-03T10:18:52.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.869+0000 7f023a046700 1 Processor -- start 2023-10-03T10:18:52.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.870+0000 7f023a046700 1 -- start start 2023-10-03T10:18:52.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.870+0000 7f023a046700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02341300a0 0x7f023411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.870+0000 7f023a046700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02341309f0 0x7f023411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.870+0000 7f023a046700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0234133ad0 0x7f023411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.870+0000 7f023a046700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0234120210 con 0x7f02341309f0 2023-10-03T10:18:52.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.870+0000 7f023a046700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023412dd00 con 0x7f02341300a0 2023-10-03T10:18:52.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.870+0000 7f023a046700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f023412fe60 con 0x7f0234133ad0 2023-10-03T10:18:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.870+0000 7f0232ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02341309f0 0x7f023411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.870+0000 7f02337fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02341300a0 0x7f023411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.870+0000 7f02337fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02341300a0 0x7f023411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51282/0 (socket says 172.21.15.146:51282) 2023-10-03T10:18:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.870+0000 7f02337fe700 1 -- 172.21.15.146:0/953620509 learned_addr learned my addr 172.21.15.146:0/953620509 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.870+0000 7f0233fff700 1 --2- 172.21.15.146:0/953620509 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0234133ad0 0x7f023411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.870+0000 7f0232ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02341309f0 0x7f023411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54168/0 (socket says 172.21.15.146:54168) 2023-10-03T10:18:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.870+0000 7f02337fe700 1 -- 172.21.15.146:0/953620509 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0234133ad0 msgr2=0x7f023411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.870+0000 7f02337fe700 1 --2- 172.21.15.146:0/953620509 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0234133ad0 0x7f023411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.870+0000 7f02337fe700 1 -- 172.21.15.146:0/953620509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02341309f0 msgr2=0x7f023411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.870+0000 7f02337fe700 1 --2- 172.21.15.146:0/953620509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02341309f0 0x7f023411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.870+0000 7f02337fe700 1 -- 172.21.15.146:0/953620509 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c0094a0 con 0x7f02341300a0 2023-10-03T10:18:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.870+0000 7f0233fff700 1 --2- 172.21.15.146:0/953620509 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0234133ad0 0x7f023411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:52.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.870+0000 7f0232ffd700 1 --2- 172.21.15.146:0/953620509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02341309f0 0x7f023411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:52.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.871+0000 7f02337fe700 1 --2- 172.21.15.146:0/953620509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02341300a0 0x7f023411da40 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f022400b370 tx=0x7f0224004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.871+0000 7f022bfff700 1 -- 172.21.15.146:0/953620509 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224004450 con 0x7f02341300a0 2023-10-03T10:18:52.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.871+0000 7f023a046700 1 -- 172.21.15.146:0/953620509 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0224009b30 con 0x7f02341300a0 2023-10-03T10:18:52.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.871+0000 7f022bfff700 1 -- 172.21.15.146:0/953620509 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02240045b0 con 0x7f02341300a0 2023-10-03T10:18:52.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.871+0000 7f022bfff700 1 -- 172.21.15.146:0/953620509 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224004960 con 0x7f02341300a0 2023-10-03T10:18:52.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.871+0000 7f023a046700 1 -- 172.21.15.146:0/953620509 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023411fe90 con 0x7f02341300a0 2023-10-03T10:18:52.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.872+0000 7f022bfff700 1 -- 172.21.15.146:0/953620509 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f022401c410 con 0x7f02341300a0 2023-10-03T10:18:52.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.872+0000 7f022bfff700 1 -- 172.21.15.146:0/953620509 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0224040d70 con 0x7f02341300a0 2023-10-03T10:18:52.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.872+0000 7f023a046700 1 -- 172.21.15.146:0/953620509 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f023404f2a0 con 0x7f02341300a0 2023-10-03T10:18:52.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.881+0000 7f022bfff700 1 -- 172.21.15.146:0/953620509 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f022402a020 con 0x7f02341300a0 2023-10-03T10:18:52.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.887+0000 7fc12352f700 1 -- 172.21.15.146:0/1024255837 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc11c072980 con 0x7fc11c0a1380 2023-10-03T10:18:52.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.887+0000 7fc111ffb700 1 -- 172.21.15.146:0/1024255837 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc10c015020 con 0x7fc11c0a1380 2023-10-03T10:18:52.887 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:52.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.889+0000 7fc12352f700 1 -- 172.21.15.146:0/1024255837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc11c0a1380 msgr2=0x7fc11c122d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.889+0000 7fc12352f700 1 --2- 172.21.15.146:0/1024255837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc11c0a1380 0x7fc11c122d60 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0090b0 tx=0x7fc10c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:52.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.889+0000 7fc12352f700 1 -- 172.21.15.146:0/1024255837 shutdown_connections 2023-10-03T10:18:52.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.889+0000 7fc12352f700 1 --2- 172.21.15.146:0/1024255837 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc11c133f50 0x7fc11c1232a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.889+0000 7fc12352f700 1 --2- 172.21.15.146:0/1024255837 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc11c0a0a70 0x7fc11c122820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.889+0000 7fc12352f700 1 --2- 172.21.15.146:0/1024255837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc11c0a1380 0x7fc11c122d60 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.889+0000 7fc12352f700 1 -- 172.21.15.146:0/1024255837 >> 172.21.15.146:0/1024255837 conn(0x7fc11c0a6610 msgr2=0x7fc11c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:52.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.889+0000 7fc12352f700 1 -- 172.21.15.146:0/1024255837 shutdown_connections 2023-10-03T10:18:52.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:52.889+0000 7fc12352f700 1 -- 172.21.15.146:0/1024255837 wait complete. 2023-10-03T10:18:52.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:53.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.067+0000 7f023a046700 1 -- 172.21.15.146:0/953620509 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f02340008d0 con 0x7f02341300a0 2023-10-03T10:18:53.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.067+0000 7f022bfff700 1 -- 172.21.15.146:0/953620509 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f022401c6c0 con 0x7f02341300a0 2023-10-03T10:18:53.067 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:53.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.069+0000 7f023a046700 1 -- 172.21.15.146:0/953620509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02341300a0 msgr2=0x7f023411da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.069+0000 7f023a046700 1 --2- 172.21.15.146:0/953620509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02341300a0 0x7f023411da40 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f022400b370 tx=0x7f0224004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.069+0000 7f023a046700 1 -- 172.21.15.146:0/953620509 shutdown_connections 2023-10-03T10:18:53.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.069+0000 7f023a046700 1 --2- 172.21.15.146:0/953620509 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0234133ad0 0x7f023411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.069+0000 7f023a046700 1 --2- 172.21.15.146:0/953620509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f02341300a0 0x7f023411da40 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.069+0000 7f023a046700 1 --2- 172.21.15.146:0/953620509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02341309f0 0x7f023411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.069+0000 7f023a046700 1 -- 172.21.15.146:0/953620509 >> 172.21.15.146:0/953620509 conn(0x7f0234099c40 msgr2=0x7f02341321e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:53.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.069+0000 7f023a046700 1 -- 172.21.15.146:0/953620509 shutdown_connections 2023-10-03T10:18:53.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.069+0000 7f023a046700 1 -- 172.21.15.146:0/953620509 wait complete. 2023-10-03T10:18:53.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:53.693 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:53.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.821+0000 7fcf894dd700 1 Processor -- start 2023-10-03T10:18:53.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.821+0000 7fcf894dd700 1 -- start start 2023-10-03T10:18:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.821+0000 7fcf894dd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf8409e870 0x7fcf8409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.821+0000 7fcf894dd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf841343a0 0x7fcf8413bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.821+0000 7fcf894dd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf8406bec0 con 0x7fcf8409f180 2023-10-03T10:18:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.821+0000 7fcf894dd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8406ce60 con 0x7fcf841343a0 2023-10-03T10:18:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.821+0000 7fcf894dd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8409fa00 con 0x7fcf8409e870 2023-10-03T10:18:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.821+0000 7fcf82ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf8409e870 0x7fcf8409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.821+0000 7fcf837fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf841343a0 0x7fcf8413bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.821+0000 7fcf827fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcf8409f180 0x7fcf84133c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49072/0 (socket says 172.21.15.146:49072) 2023-10-03T10:18:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.821+0000 7fcf827fc700 1 -- 172.21.15.146:0/2155110082 learned_addr learned my addr 172.21.15.146:0/2155110082 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.822+0000 7fcf81ffb700 1 -- 172.21.15.146:0/2155110082 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561631318 0 0) 0x7fcf8406bec0 con 0x7fcf8409f180 2023-10-03T10:18:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.822+0000 7fcf81ffb700 1 -- 172.21.15.146:0/2155110082 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf6c0035b0 con 0x7fcf8409f180 2023-10-03T10:18:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.822+0000 7fcf837fe700 1 -- 172.21.15.146:0/2155110082 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf8409e870 msgr2=0x7fcf8409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.822+0000 7fcf837fe700 1 --2- 172.21.15.146:0/2155110082 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf8409e870 0x7fcf8409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.822+0000 7fcf837fe700 1 -- 172.21.15.146:0/2155110082 >> v1:172.21.15.146:6789/0 conn(0x7fcf8409f180 legacy=0x7fcf84133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.822+0000 7fcf837fe700 1 -- 172.21.15.146:0/2155110082 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8409ad80 con 0x7fcf841343a0 2023-10-03T10:18:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.822+0000 7fcf82ffd700 1 --2- 172.21.15.146:0/2155110082 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf8409e870 0x7fcf8409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.822+0000 7fcf837fe700 1 --2- 172.21.15.146:0/2155110082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf841343a0 0x7fcf8413bf60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009dc0 tx=0x7fcf7c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e180c5b2146d5e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.822+0000 7fcf81ffb700 1 -- 172.21.15.146:0/2155110082 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c00e070 con 0x7fcf841343a0 2023-10-03T10:18:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.822+0000 7fcf81ffb700 1 -- 172.21.15.146:0/2155110082 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7c00bb20 con 0x7fcf841343a0 2023-10-03T10:18:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.822+0000 7fcf81ffb700 1 -- 172.21.15.146:0/2155110082 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c012430 con 0x7fcf841343a0 2023-10-03T10:18:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.822+0000 7fcf894dd700 1 -- 172.21.15.146:0/2155110082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf841343a0 msgr2=0x7fcf8413bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.822+0000 7fcf894dd700 1 --2- 172.21.15.146:0/2155110082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf841343a0 0x7fcf8413bf60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009dc0 tx=0x7fcf7c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.822+0000 7fcf894dd700 1 -- 172.21.15.146:0/2155110082 shutdown_connections 2023-10-03T10:18:53.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.822+0000 7fcf894dd700 1 --2- 172.21.15.146:0/2155110082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf841343a0 0x7fcf8413bf60 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.822+0000 7fcf894dd700 1 --2- 172.21.15.146:0/2155110082 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf8409e870 0x7fcf8409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.822+0000 7fcf894dd700 1 -- 172.21.15.146:0/2155110082 >> 172.21.15.146:0/2155110082 conn(0x7fcf840a4430 msgr2=0x7fcf840a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:53.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.823+0000 7fcf894dd700 1 -- 172.21.15.146:0/2155110082 shutdown_connections 2023-10-03T10:18:53.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.823+0000 7fcf894dd700 1 -- 172.21.15.146:0/2155110082 wait complete. 2023-10-03T10:18:53.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.823+0000 7fcf894dd700 1 Processor -- start 2023-10-03T10:18:53.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.824+0000 7fcf894dd700 1 -- start start 2023-10-03T10:18:53.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.824+0000 7fcf894dd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf8409e870 0x7fcf84122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.824+0000 7fcf894dd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf8409f180 0x7fcf84122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.824+0000 7fcf894dd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf841343a0 0x7fcf841233b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.824+0000 7fcf894dd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf84125b00 con 0x7fcf8409f180 2023-10-03T10:18:53.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.824+0000 7fcf894dd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf841244f0 con 0x7fcf8409e870 2023-10-03T10:18:53.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.824+0000 7fcf894dd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf84133490 con 0x7fcf841343a0 2023-10-03T10:18:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.824+0000 7fcf82ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf8409e870 0x7fcf84122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.824+0000 7fcf827fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf8409f180 0x7fcf84122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.824+0000 7fcf82ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf8409e870 0x7fcf84122930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51304/0 (socket says 172.21.15.146:51304) 2023-10-03T10:18:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.824+0000 7fcf837fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf841343a0 0x7fcf841233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.824+0000 7fcf82ffd700 1 -- 172.21.15.146:0/2379308298 learned_addr learned my addr 172.21.15.146:0/2379308298 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.824+0000 7fcf827fc700 1 -- 172.21.15.146:0/2379308298 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf841343a0 msgr2=0x7fcf841233b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.824+0000 7fcf827fc700 1 --2- 172.21.15.146:0/2379308298 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf841343a0 0x7fcf841233b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.824+0000 7fcf827fc700 1 -- 172.21.15.146:0/2379308298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf8409e870 msgr2=0x7fcf84122930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.824+0000 7fcf827fc700 1 --2- 172.21.15.146:0/2379308298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf8409e870 0x7fcf84122930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.824+0000 7fcf827fc700 1 -- 172.21.15.146:0/2379308298 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf740094a0 con 0x7fcf8409f180 2023-10-03T10:18:53.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.824+0000 7fcf82ffd700 1 --2- 172.21.15.146:0/2379308298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf8409e870 0x7fcf84122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:53.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.824+0000 7fcf827fc700 1 --2- 172.21.15.146:0/2379308298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf8409f180 0x7fcf84122e70 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800c490 tx=0x7fcf7800c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:53.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.825+0000 7fcf6b7fe700 1 -- 172.21.15.146:0/2379308298 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78005d70 con 0x7fcf8409f180 2023-10-03T10:18:53.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.825+0000 7fcf6b7fe700 1 -- 172.21.15.146:0/2379308298 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf780070d0 con 0x7fcf8409f180 2023-10-03T10:18:53.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.825+0000 7fcf894dd700 1 -- 172.21.15.146:0/2379308298 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf7c009a70 con 0x7fcf8409f180 2023-10-03T10:18:53.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.825+0000 7fcf6b7fe700 1 -- 172.21.15.146:0/2379308298 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78007440 con 0x7fcf8409f180 2023-10-03T10:18:53.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.825+0000 7fcf894dd700 1 -- 172.21.15.146:0/2379308298 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf84125e60 con 0x7fcf8409f180 2023-10-03T10:18:53.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.825+0000 7fcf6b7fe700 1 -- 172.21.15.146:0/2379308298 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf780075a0 con 0x7fcf8409f180 2023-10-03T10:18:53.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.826+0000 7fcf6b7fe700 1 -- 172.21.15.146:0/2379308298 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcf7803eab0 con 0x7fcf8409f180 2023-10-03T10:18:53.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.826+0000 7fcf894dd700 1 -- 172.21.15.146:0/2379308298 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf841338c0 con 0x7fcf8409f180 2023-10-03T10:18:53.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.830+0000 7fcf6b7fe700 1 -- 172.21.15.146:0/2379308298 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf7801bb10 con 0x7fcf8409f180 2023-10-03T10:18:53.854 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:53.902 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:53.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.983+0000 7f6b7344c700 1 Processor -- start 2023-10-03T10:18:53.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.983+0000 7f6b7344c700 1 -- start start 2023-10-03T10:18:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.984+0000 7f6b7344c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b6c0a1550 0x7f6b6c138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.984+0000 7f6b7344c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b6c139200 0x7f6b6c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.984+0000 7f6b7344c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b6c09e9d0 con 0x7f6b6c0a0a70 2023-10-03T10:18:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.984+0000 7f6b7344c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c09dc00 con 0x7f6b6c0a1550 2023-10-03T10:18:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.984+0000 7f6b7344c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c09dec0 con 0x7f6b6c139200 2023-10-03T10:18:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.984+0000 7f6b711e8700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6b6c0a0a70 0x7f6b6c0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49080/0 (socket says 172.21.15.146:49080) 2023-10-03T10:18:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.984+0000 7f6b711e8700 1 -- 172.21.15.146:0/3958097519 learned_addr learned my addr 172.21.15.146:0/3958097519 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.984+0000 7f6b709e7700 1 --2- 172.21.15.146:0/3958097519 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b6c0a1550 0x7f6b6c138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.984+0000 7f6b719e9700 1 --2- 172.21.15.146:0/3958097519 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b6c139200 0x7f6b6c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.985+0000 7f6b63fff700 1 -- 172.21.15.146:0/3958097519 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1816471886 0 0) 0x7f6b6c09e9d0 con 0x7f6b6c0a0a70 2023-10-03T10:18:53.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.985+0000 7f6b63fff700 1 -- 172.21.15.146:0/3958097519 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b580035b0 con 0x7f6b6c0a0a70 2023-10-03T10:18:53.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.985+0000 7f6b719e9700 1 -- 172.21.15.146:0/3958097519 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b6c0a1550 msgr2=0x7f6b6c138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:53.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.985+0000 7f6b719e9700 1 --2- 172.21.15.146:0/3958097519 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b6c0a1550 0x7f6b6c138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.985+0000 7f6b719e9700 1 -- 172.21.15.146:0/3958097519 >> v1:172.21.15.146:6789/0 conn(0x7f6b6c0a0a70 legacy=0x7f6b6c0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.985+0000 7f6b719e9700 1 -- 172.21.15.146:0/3958097519 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c09e6a0 con 0x7f6b6c139200 2023-10-03T10:18:53.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.985+0000 7f6b709e7700 1 --2- 172.21.15.146:0/3958097519 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b6c0a1550 0x7f6b6c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:53.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.985+0000 7f6b719e9700 1 --2- 172.21.15.146:0/3958097519 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b6c139200 0x7f6b6c13b5e0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009dc0 tx=0x7f6b6400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=529129d926617f04 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:53.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.985+0000 7f6b63fff700 1 -- 172.21.15.146:0/3958097519 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6400e070 con 0x7f6b6c139200 2023-10-03T10:18:53.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.985+0000 7f6b63fff700 1 -- 172.21.15.146:0/3958097519 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6400bb20 con 0x7f6b6c139200 2023-10-03T10:18:53.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.985+0000 7f6b63fff700 1 -- 172.21.15.146:0/3958097519 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64012430 con 0x7f6b6c139200 2023-10-03T10:18:53.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.986+0000 7f6b7344c700 1 -- 172.21.15.146:0/3958097519 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b6c139200 msgr2=0x7f6b6c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.986+0000 7f6b7344c700 1 --2- 172.21.15.146:0/3958097519 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b6c139200 0x7f6b6c13b5e0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009dc0 tx=0x7f6b6400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:53.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.986+0000 7f6b7344c700 1 -- 172.21.15.146:0/3958097519 shutdown_connections 2023-10-03T10:18:53.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.986+0000 7f6b7344c700 1 --2- 172.21.15.146:0/3958097519 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b6c139200 0x7f6b6c13b5e0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.986+0000 7f6b7344c700 1 --2- 172.21.15.146:0/3958097519 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b6c0a1550 0x7f6b6c138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.986+0000 7f6b7344c700 1 -- 172.21.15.146:0/3958097519 >> 172.21.15.146:0/3958097519 conn(0x7f6b6c0a6610 msgr2=0x7f6b6c0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:53.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.986+0000 7f6b7344c700 1 -- 172.21.15.146:0/3958097519 shutdown_connections 2023-10-03T10:18:53.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.986+0000 7f6b7344c700 1 -- 172.21.15.146:0/3958097519 wait complete. 2023-10-03T10:18:53.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.987+0000 7f6b7344c700 1 Processor -- start 2023-10-03T10:18:53.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.987+0000 7f6b7344c700 1 -- start start 2023-10-03T10:18:53.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.987+0000 7f6b7344c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b6c0a0a70 0x7f6b6c11e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.987+0000 7f6b7344c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b6c0a1550 0x7f6b6c11ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.987+0000 7f6b7344c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b6c139200 0x7f6b6c11f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.987+0000 7f6b7344c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c122120 con 0x7f6b6c139200 2023-10-03T10:18:53.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.987+0000 7f6b7344c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c120600 con 0x7f6b6c0a1550 2023-10-03T10:18:53.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.987+0000 7f6b7344c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c09d340 con 0x7f6b6c0a0a70 2023-10-03T10:18:53.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.987+0000 7f6b709e7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b6c0a1550 0x7f6b6c11ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.987+0000 7f6b709e7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b6c0a1550 0x7f6b6c11ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51326/0 (socket says 172.21.15.146:51326) 2023-10-03T10:18:53.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.987+0000 7f6b709e7700 1 -- 172.21.15.146:0/3842442713 learned_addr learned my addr 172.21.15.146:0/3842442713 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:53.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.987+0000 7f6b711e8700 1 --2- 172.21.15.146:0/3842442713 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b6c0a0a70 0x7f6b6c11e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.987+0000 7f6b719e9700 1 --2- 172.21.15.146:0/3842442713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b6c139200 0x7f6b6c11f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.988+0000 7f6b719e9700 1 -- 172.21.15.146:0/3842442713 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b6c0a0a70 msgr2=0x7f6b6c11e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.988+0000 7f6b719e9700 1 --2- 172.21.15.146:0/3842442713 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b6c0a0a70 0x7f6b6c11e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.988+0000 7f6b719e9700 1 -- 172.21.15.146:0/3842442713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b6c0a1550 msgr2=0x7f6b6c11ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.988+0000 7f6b719e9700 1 --2- 172.21.15.146:0/3842442713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b6c0a1550 0x7f6b6c11ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.988+0000 7f6b719e9700 1 -- 172.21.15.146:0/3842442713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5c0094a0 con 0x7f6b6c139200 2023-10-03T10:18:53.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.988+0000 7f6b709e7700 1 --2- 172.21.15.146:0/3842442713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b6c0a1550 0x7f6b6c11ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:53.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.988+0000 7f6b711e8700 1 --2- 172.21.15.146:0/3842442713 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b6c0a0a70 0x7f6b6c11e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:53.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.988+0000 7f6b719e9700 1 --2- 172.21.15.146:0/3842442713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b6c139200 0x7f6b6c11f360 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f6b64016000 tx=0x7f6b64004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:53.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.988+0000 7f6b61ffb700 1 -- 172.21.15.146:0/3842442713 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64004800 con 0x7f6b6c139200 2023-10-03T10:18:53.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.988+0000 7f6b61ffb700 1 -- 172.21.15.146:0/3842442713 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b64020070 con 0x7f6b6c139200 2023-10-03T10:18:53.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.988+0000 7f6b7344c700 1 -- 172.21.15.146:0/3842442713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b64009a70 con 0x7f6b6c139200 2023-10-03T10:18:53.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.988+0000 7f6b61ffb700 1 -- 172.21.15.146:0/3842442713 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b640276c0 con 0x7f6b6c139200 2023-10-03T10:18:53.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.988+0000 7f6b7344c700 1 -- 172.21.15.146:0/3842442713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6c122b90 con 0x7f6b6c139200 2023-10-03T10:18:53.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.990+0000 7f6b61ffb700 1 -- 172.21.15.146:0/3842442713 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b64027820 con 0x7f6b6c139200 2023-10-03T10:18:53.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.990+0000 7f6b7344c700 1 -- 172.21.15.146:0/3842442713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6c04f2a0 con 0x7f6b6c139200 2023-10-03T10:18:53.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.990+0000 7f6b61ffb700 1 -- 172.21.15.146:0/3842442713 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6b64022070 con 0x7f6b6c139200 2023-10-03T10:18:53.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:53.994+0000 7f6b61ffb700 1 -- 172.21.15.146:0/3842442713 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b64012430 con 0x7f6b6c139200 2023-10-03T10:18:54.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.033+0000 7fd23c507700 1 Processor -- start 2023-10-03T10:18:54.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.033+0000 7fd23c507700 1 -- start start 2023-10-03T10:18:54.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.033+0000 7fd23c507700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd23406a770 0x7fd23406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.033+0000 7fd23c507700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd23406b080 0x7fd2341317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.033+0000 7fd23c507700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23409da80 con 0x7fd234131cf0 2023-10-03T10:18:54.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.033+0000 7fd23c507700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23409dce0 con 0x7fd23406a770 2023-10-03T10:18:54.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.033+0000 7fd23c507700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd23409eb20 con 0x7fd23406b080 2023-10-03T10:18:54.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.033+0000 7fd23a2a3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd23406a770 0x7fd23406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.033+0000 7fd239aa2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd23406b080 0x7fd2341317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.033+0000 7fd23a2a3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd23406a770 0x7fd23406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51342/0 (socket says 172.21.15.146:51342) 2023-10-03T10:18:54.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.033+0000 7fd23a2a3700 1 -- 172.21.15.146:0/565045576 learned_addr learned my addr 172.21.15.146:0/565045576 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:54.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.034+0000 7fd23a2a3700 1 -- 172.21.15.146:0/565045576 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd23406b080 msgr2=0x7fd2341317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:54.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.034+0000 7fd23a2a3700 1 --2- 172.21.15.146:0/565045576 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd23406b080 0x7fd2341317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.034+0000 7fd23a2a3700 1 -- 172.21.15.146:0/565045576 >> v1:172.21.15.146:6789/0 conn(0x7fd234131cf0 legacy=0x7fd234138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.034+0000 7fd2392a1700 1 -- 172.21.15.146:0/565045576 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172489193 0 0) 0x7fd23409da80 con 0x7fd234131cf0 2023-10-03T10:18:54.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.034+0000 7fd23a2a3700 1 -- 172.21.15.146:0/565045576 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23409d860 con 0x7fd23406a770 2023-10-03T10:18:54.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.034+0000 7fd239aa2700 1 --2- 172.21.15.146:0/565045576 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd23406b080 0x7fd2341317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:54.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.034+0000 7fd23a2a3700 1 --2- 172.21.15.146:0/565045576 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd23406a770 0x7fd23406ab40 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd230009950 tx=0x7fd230009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=625685c53378270f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.034+0000 7fd2392a1700 1 -- 172.21.15.146:0/565045576 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230011830 con 0x7fd23406a770 2023-10-03T10:18:54.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.034+0000 7fd2392a1700 1 -- 172.21.15.146:0/565045576 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd230011990 con 0x7fd23406a770 2023-10-03T10:18:54.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.034+0000 7fd2392a1700 1 -- 172.21.15.146:0/565045576 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230011d40 con 0x7fd23406a770 2023-10-03T10:18:54.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.035+0000 7fd23c507700 1 -- 172.21.15.146:0/565045576 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd23406a770 msgr2=0x7fd23406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.035+0000 7fd23c507700 1 --2- 172.21.15.146:0/565045576 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd23406a770 0x7fd23406ab40 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd230009950 tx=0x7fd230009c60 comp rx=0 tx=0).stop 2023-10-03T10:18:54.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.035+0000 7fd23c507700 1 -- 172.21.15.146:0/565045576 shutdown_connections 2023-10-03T10:18:54.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.035+0000 7fd23c507700 1 --2- 172.21.15.146:0/565045576 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd23406a770 0x7fd23406ab40 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.035+0000 7fd23c507700 1 --2- 172.21.15.146:0/565045576 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd23406b080 0x7fd2341317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.035+0000 7fd23c507700 1 -- 172.21.15.146:0/565045576 >> 172.21.15.146:0/565045576 conn(0x7fd234099c40 msgr2=0x7fd2340a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.035+0000 7fd23c507700 1 -- 172.21.15.146:0/565045576 shutdown_connections 2023-10-03T10:18:54.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.035+0000 7fd23c507700 1 -- 172.21.15.146:0/565045576 wait complete. 2023-10-03T10:18:54.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.036+0000 7fd23c507700 1 Processor -- start 2023-10-03T10:18:54.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.036+0000 7fd23c507700 1 -- start start 2023-10-03T10:18:54.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.036+0000 7fd23c507700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd23406a770 0x7fd2341c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.036+0000 7fd23c507700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd23406b080 0x7fd2341c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.036+0000 7fd23c507700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd234131cf0 0x7fd2341c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.036+0000 7fd23c507700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23411e350 con 0x7fd23406b080 2023-10-03T10:18:54.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.036+0000 7fd23c507700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd234131310 con 0x7fd23406a770 2023-10-03T10:18:54.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.036+0000 7fd23c507700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2340a2f90 con 0x7fd234131cf0 2023-10-03T10:18:54.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.036+0000 7fd23a2a3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd23406a770 0x7fd2341c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.036+0000 7fd239aa2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd23406b080 0x7fd2341c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.036+0000 7fd23a2a3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd23406a770 0x7fd2341c5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51346/0 (socket says 172.21.15.146:51346) 2023-10-03T10:18:54.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.036+0000 7fd23a2a3700 1 -- 172.21.15.146:0/2157621213 learned_addr learned my addr 172.21.15.146:0/2157621213 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:54.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.036+0000 7fd23aaa4700 1 --2- 172.21.15.146:0/2157621213 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd234131cf0 0x7fd2341c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.037+0000 7fd23a2a3700 1 -- 172.21.15.146:0/2157621213 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd234131cf0 msgr2=0x7fd2341c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.037+0000 7fd23a2a3700 1 --2- 172.21.15.146:0/2157621213 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd234131cf0 0x7fd2341c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.037+0000 7fd23a2a3700 1 -- 172.21.15.146:0/2157621213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd23406b080 msgr2=0x7fd2341c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.037+0000 7fd23a2a3700 1 --2- 172.21.15.146:0/2157621213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd23406b080 0x7fd2341c6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.037+0000 7fd23a2a3700 1 -- 172.21.15.146:0/2157621213 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2240094a0 con 0x7fd23406a770 2023-10-03T10:18:54.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.037+0000 7fcf894dd700 1 -- 172.21.15.146:0/2379308298 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcf8404f2a0 con 0x7fcf8409f180 2023-10-03T10:18:54.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.037+0000 7fd23a2a3700 1 --2- 172.21.15.146:0/2157621213 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd23406a770 0x7fd2341c5e10 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd230009130 tx=0x7fd230004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.037+0000 7fd22affd700 1 -- 172.21.15.146:0/2157621213 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23001a900 con 0x7fd23406a770 2023-10-03T10:18:54.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.037+0000 7fcf6b7fe700 1 -- 172.21.15.146:0/2379308298 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcf780192c0 con 0x7fcf8409f180 2023-10-03T10:18:54.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.037+0000 7fd22affd700 1 -- 172.21.15.146:0/2157621213 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23001f070 con 0x7fd23406a770 2023-10-03T10:18:54.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.037+0000 7fd23c507700 1 -- 172.21.15.146:0/2157621213 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd230009550 con 0x7fd23406a770 2023-10-03T10:18:54.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.037+0000 7fd22affd700 1 -- 172.21.15.146:0/2157621213 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23001aca0 con 0x7fd23406a770 2023-10-03T10:18:54.043 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:54.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.037+0000 7fd23c507700 1 -- 172.21.15.146:0/2157621213 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23411fcc0 con 0x7fd23406a770 2023-10-03T10:18:54.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.038+0000 7fd22affd700 1 -- 172.21.15.146:0/2157621213 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd23001b430 con 0x7fd23406a770 2023-10-03T10:18:54.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.038+0000 7fd22affd700 1 -- 172.21.15.146:0/2157621213 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fd230021070 con 0x7fd23406a770 2023-10-03T10:18:54.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.038+0000 7fd23c507700 1 -- 172.21.15.146:0/2157621213 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23406be10 con 0x7fd23406a770 2023-10-03T10:18:54.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.040+0000 7fcf894dd700 1 -- 172.21.15.146:0/2379308298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf8409f180 msgr2=0x7fcf84122e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.040+0000 7fcf894dd700 1 --2- 172.21.15.146:0/2379308298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf8409f180 0x7fcf84122e70 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800c490 tx=0x7fcf7800c7a0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.040+0000 7fcf894dd700 1 -- 172.21.15.146:0/2379308298 shutdown_connections 2023-10-03T10:18:54.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.040+0000 7fcf894dd700 1 --2- 172.21.15.146:0/2379308298 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcf841343a0 0x7fcf841233b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.040+0000 7fcf894dd700 1 --2- 172.21.15.146:0/2379308298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf8409e870 0x7fcf84122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.040+0000 7fcf894dd700 1 --2- 172.21.15.146:0/2379308298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf8409f180 0x7fcf84122e70 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.040+0000 7fcf894dd700 1 -- 172.21.15.146:0/2379308298 >> 172.21.15.146:0/2379308298 conn(0x7fcf840a4430 msgr2=0x7fcf84070eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.040+0000 7fcf894dd700 1 -- 172.21.15.146:0/2379308298 shutdown_connections 2023-10-03T10:18:54.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.040+0000 7fcf894dd700 1 -- 172.21.15.146:0/2379308298 wait complete. 2023-10-03T10:18:54.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.043+0000 7fd22affd700 1 -- 172.21.15.146:0/2157621213 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd230015070 con 0x7fd23406a770 2023-10-03T10:18:54.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:54.082 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:54.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.194+0000 7f6b7344c700 1 -- 172.21.15.146:0/3842442713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6b6c09cba0 con 0x7f6b6c139200 2023-10-03T10:18:54.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.195+0000 7f6b61ffb700 1 -- 172.21.15.146:0/3842442713 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6b64011800 con 0x7f6b6c139200 2023-10-03T10:18:54.195 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:54.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.198+0000 7f6b7344c700 1 -- 172.21.15.146:0/3842442713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b6c139200 msgr2=0x7f6b6c11f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.198+0000 7f6b7344c700 1 --2- 172.21.15.146:0/3842442713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b6c139200 0x7f6b6c11f360 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f6b64016000 tx=0x7f6b64004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.198+0000 7f6b7344c700 1 -- 172.21.15.146:0/3842442713 shutdown_connections 2023-10-03T10:18:54.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.198+0000 7f6b7344c700 1 --2- 172.21.15.146:0/3842442713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b6c139200 0x7f6b6c11f360 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.198+0000 7f6b7344c700 1 --2- 172.21.15.146:0/3842442713 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6b6c0a0a70 0x7f6b6c11e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.198+0000 7f6b7344c700 1 --2- 172.21.15.146:0/3842442713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b6c0a1550 0x7f6b6c11ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.198+0000 7f6b7344c700 1 -- 172.21.15.146:0/3842442713 >> 172.21.15.146:0/3842442713 conn(0x7f6b6c0a6610 msgr2=0x7f6b6c138240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.198+0000 7f6b7344c700 1 -- 172.21.15.146:0/3842442713 shutdown_connections 2023-10-03T10:18:54.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.198+0000 7f6b7344c700 1 -- 172.21.15.146:0/3842442713 wait complete. 2023-10-03T10:18:54.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.208+0000 7f8380e86700 1 Processor -- start 2023-10-03T10:18:54.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.208+0000 7f8380e86700 1 -- start start 2023-10-03T10:18:54.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.209+0000 7f8380e86700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f837c133a70 0x7f837c133e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.209+0000 7f8380e86700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f837c0a08e0 0x7f837c0a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.209+0000 7f8380e86700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f837c0a1290 0x7f837c13a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.209+0000 7f8380e86700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f837c133640 con 0x7f837c0a1290 2023-10-03T10:18:54.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.209+0000 7f8380e86700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837c0a1d50 con 0x7f837c0a08e0 2023-10-03T10:18:54.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.209+0000 7f8380e86700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f837c0a1730 con 0x7f837c133a70 2023-10-03T10:18:54.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.209+0000 7f837a59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f837c133a70 0x7f837c133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.209+0000 7f837ad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f837c0a1290 0x7f837c13a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.209+0000 7f837a59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f837c133a70 0x7f837c133e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35492/0 (socket says 172.21.15.146:35492) 2023-10-03T10:18:54.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.209+0000 7f8379d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f837c0a08e0 0x7f837c0a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.209+0000 7f837a59c700 1 -- 172.21.15.146:0/1207404778 learned_addr learned my addr 172.21.15.146:0/1207404778 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:54.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.209+0000 7f837a59c700 1 -- 172.21.15.146:0/1207404778 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f837c0a08e0 msgr2=0x7f837c0a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:54.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.209+0000 7f837a59c700 1 --2- 172.21.15.146:0/1207404778 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f837c0a08e0 0x7f837c0a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.209+0000 7f837a59c700 1 -- 172.21.15.146:0/1207404778 >> v2:172.21.15.146:3300/0 conn(0x7f837c0a1290 msgr2=0x7f837c13a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:54.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.209+0000 7f837a59c700 1 --2- 172.21.15.146:0/1207404778 >> v2:172.21.15.146:3300/0 conn(0x7f837c0a1290 0x7f837c13a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.209+0000 7f837a59c700 1 -- 172.21.15.146:0/1207404778 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c09b620 con 0x7f837c133a70 2023-10-03T10:18:54.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.210+0000 7f837ad9d700 1 --2- 172.21.15.146:0/1207404778 >> v2:172.21.15.146:3300/0 conn(0x7f837c0a1290 0x7f837c13a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:54.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.210+0000 7f837a59c700 1 --2- 172.21.15.146:0/1207404778 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f837c133a70 0x7f837c133e40 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f8374009ea0 tx=0x7f837400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f33e764d46b5ceb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.210+0000 7f837959a700 1 -- 172.21.15.146:0/1207404778 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837400e070 con 0x7f837c133a70 2023-10-03T10:18:54.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.210+0000 7f837959a700 1 -- 172.21.15.146:0/1207404778 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837400b910 con 0x7f837c133a70 2023-10-03T10:18:54.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.210+0000 7f837959a700 1 -- 172.21.15.146:0/1207404778 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837400bcc0 con 0x7f837c133a70 2023-10-03T10:18:54.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.211+0000 7f8380e86700 1 -- 172.21.15.146:0/1207404778 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f837c133a70 msgr2=0x7f837c133e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.211+0000 7f8380e86700 1 --2- 172.21.15.146:0/1207404778 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f837c133a70 0x7f837c133e40 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f8374009ea0 tx=0x7f837400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:54.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.211+0000 7f8380e86700 1 -- 172.21.15.146:0/1207404778 shutdown_connections 2023-10-03T10:18:54.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.211+0000 7f8380e86700 1 --2- 172.21.15.146:0/1207404778 >> v2:172.21.15.146:3300/0 conn(0x7f837c0a1290 0x7f837c13a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.211+0000 7f8380e86700 1 --2- 172.21.15.146:0/1207404778 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f837c133a70 0x7f837c133e40 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.211+0000 7f8380e86700 1 --2- 172.21.15.146:0/1207404778 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f837c0a08e0 0x7f837c0a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.211+0000 7f8380e86700 1 -- 172.21.15.146:0/1207404778 >> 172.21.15.146:0/1207404778 conn(0x7f837c0a2980 msgr2=0x7f837c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.211+0000 7f8380e86700 1 -- 172.21.15.146:0/1207404778 shutdown_connections 2023-10-03T10:18:54.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.211+0000 7f8380e86700 1 -- 172.21.15.146:0/1207404778 wait complete. 2023-10-03T10:18:54.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:54.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.212+0000 7f8380e86700 1 Processor -- start 2023-10-03T10:18:54.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.212+0000 7f8380e86700 1 -- start start 2023-10-03T10:18:54.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.213+0000 7f8380e86700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f837c0a08e0 0x7f837c06f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.213+0000 7f8380e86700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f837c0a1290 0x7f837c06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.213+0000 7f8380e86700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f837c133a70 0x7f837c0703d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.213+0000 7f8380e86700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c0716c0 con 0x7f837c0a08e0 2023-10-03T10:18:54.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.213+0000 7f8380e86700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837c0714d0 con 0x7f837c0a1290 2023-10-03T10:18:54.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.213+0000 7f8380e86700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f837c119560 con 0x7f837c133a70 2023-10-03T10:18:54.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.213+0000 7f8379d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f837c0a1290 0x7f837c06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.213+0000 7f837a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f837c0a08e0 0x7f837c06f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.213+0000 7f8379d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f837c0a1290 0x7f837c06fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:51360/0 (socket says 172.21.15.146:51360) 2023-10-03T10:18:54.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.213+0000 7f8379d9b700 1 -- 172.21.15.146:0/1025731350 learned_addr learned my addr 172.21.15.146:0/1025731350 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:54.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.213+0000 7f837ad9d700 1 --2- 172.21.15.146:0/1025731350 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f837c133a70 0x7f837c0703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.213+0000 7f8379d9b700 1 -- 172.21.15.146:0/1025731350 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f837c133a70 msgr2=0x7f837c0703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.213+0000 7f8379d9b700 1 --2- 172.21.15.146:0/1025731350 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f837c133a70 0x7f837c0703d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.213+0000 7f8379d9b700 1 -- 172.21.15.146:0/1025731350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f837c0a08e0 msgr2=0x7f837c06f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.213+0000 7f8379d9b700 1 --2- 172.21.15.146:0/1025731350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f837c0a08e0 0x7f837c06f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.213+0000 7f8379d9b700 1 -- 172.21.15.146:0/1025731350 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c0094a0 con 0x7f837c0a1290 2023-10-03T10:18:54.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.214+0000 7f8379d9b700 1 --2- 172.21.15.146:0/1025731350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f837c0a1290 0x7f837c06fe90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f8370006b20 tx=0x7f8370014640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.214+0000 7f836affd700 1 -- 172.21.15.146:0/1025731350 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370016050 con 0x7f837c0a1290 2023-10-03T10:18:54.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.214+0000 7f836affd700 1 -- 172.21.15.146:0/1025731350 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8370017040 con 0x7f837c0a1290 2023-10-03T10:18:54.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.214+0000 7f8380e86700 1 -- 172.21.15.146:0/1025731350 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8374009b30 con 0x7f837c0a1290 2023-10-03T10:18:54.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.214+0000 7f836affd700 1 -- 172.21.15.146:0/1025731350 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83700114d0 con 0x7f837c0a1290 2023-10-03T10:18:54.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.214+0000 7f8380e86700 1 -- 172.21.15.146:0/1025731350 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837c131ab0 con 0x7f837c0a1290 2023-10-03T10:18:54.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.215+0000 7f836affd700 1 -- 172.21.15.146:0/1025731350 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f837000f850 con 0x7f837c0a1290 2023-10-03T10:18:54.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.215+0000 7f8380e86700 1 -- 172.21.15.146:0/1025731350 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837c09a3b0 con 0x7f837c0a1290 2023-10-03T10:18:54.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.215+0000 7f836affd700 1 -- 172.21.15.146:0/1025731350 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8370047b80 con 0x7f837c0a1290 2023-10-03T10:18:54.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.219+0000 7f836affd700 1 -- 172.21.15.146:0/1025731350 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8370047e60 con 0x7f837c0a1290 2023-10-03T10:18:54.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.248+0000 7fd23c507700 1 -- 172.21.15.146:0/2157621213 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd23404f2a0 con 0x7fd23406a770 2023-10-03T10:18:54.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.249+0000 7fd22affd700 1 -- 172.21.15.146:0/2157621213 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd23001b6e0 con 0x7fd23406a770 2023-10-03T10:18:54.248 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:54.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.251+0000 7fd23c507700 1 -- 172.21.15.146:0/2157621213 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd23406a770 msgr2=0x7fd2341c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.251+0000 7fd23c507700 1 --2- 172.21.15.146:0/2157621213 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd23406a770 0x7fd2341c5e10 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd230009130 tx=0x7fd230004750 comp rx=0 tx=0).stop 2023-10-03T10:18:54.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.251+0000 7fd23c507700 1 -- 172.21.15.146:0/2157621213 shutdown_connections 2023-10-03T10:18:54.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.251+0000 7fd23c507700 1 --2- 172.21.15.146:0/2157621213 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fd234131cf0 0x7fd2341c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.251+0000 7fd23c507700 1 --2- 172.21.15.146:0/2157621213 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd23406a770 0x7fd2341c5e10 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.251+0000 7fd23c507700 1 --2- 172.21.15.146:0/2157621213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd23406b080 0x7fd2341c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.251+0000 7fd23c507700 1 -- 172.21.15.146:0/2157621213 >> 172.21.15.146:0/2157621213 conn(0x7fd234099c40 msgr2=0x7fd2341b99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.251+0000 7fd23c507700 1 -- 172.21.15.146:0/2157621213 shutdown_connections 2023-10-03T10:18:54.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.251+0000 7fd23c507700 1 -- 172.21.15.146:0/2157621213 wait complete. 2023-10-03T10:18:54.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:54.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.409+0000 7f8380e86700 1 -- 172.21.15.146:0/1025731350 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f837c09e870 con 0x7f837c0a1290 2023-10-03T10:18:54.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.410+0000 7f836affd700 1 -- 172.21.15.146:0/1025731350 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f837000fb00 con 0x7f837c0a1290 2023-10-03T10:18:54.410 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:54.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.412+0000 7f8380e86700 1 -- 172.21.15.146:0/1025731350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f837c0a1290 msgr2=0x7f837c06fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.412+0000 7f8380e86700 1 --2- 172.21.15.146:0/1025731350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f837c0a1290 0x7f837c06fe90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f8370006b20 tx=0x7f8370014640 comp rx=0 tx=0).stop 2023-10-03T10:18:54.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.412+0000 7f8380e86700 1 -- 172.21.15.146:0/1025731350 shutdown_connections 2023-10-03T10:18:54.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.412+0000 7f8380e86700 1 --2- 172.21.15.146:0/1025731350 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f837c133a70 0x7f837c0703d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.412+0000 7f8380e86700 1 --2- 172.21.15.146:0/1025731350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f837c0a08e0 0x7f837c06f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.412+0000 7f8380e86700 1 --2- 172.21.15.146:0/1025731350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f837c0a1290 0x7f837c06fe90 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.412+0000 7f8380e86700 1 -- 172.21.15.146:0/1025731350 >> 172.21.15.146:0/1025731350 conn(0x7f837c0a2980 msgr2=0x7f837c12f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.412+0000 7f8380e86700 1 -- 172.21.15.146:0/1025731350 shutdown_connections 2023-10-03T10:18:54.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:54.412+0000 7f8380e86700 1 -- 172.21.15.146:0/1025731350 wait complete. 2023-10-03T10:18:54.424 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:55.057 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:55.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.190+0000 7fe5a7b03700 1 Processor -- start 2023-10-03T10:18:55.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.190+0000 7fe5a7b03700 1 -- start start 2023-10-03T10:18:55.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.191+0000 7fe5a7b03700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5a0134140 0x7fe5a0138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.191+0000 7fe5a7b03700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5a0134570 0x7fe5a013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.191+0000 7fe5a7b03700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a009b110 con 0x7fe5a009ad40 2023-10-03T10:18:55.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.191+0000 7fe5a7b03700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a00a3b60 con 0x7fe5a0134570 2023-10-03T10:18:55.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.191+0000 7fe5a7b03700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a00a1a80 con 0x7fe5a0134140 2023-10-03T10:18:55.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.191+0000 7fe5a509e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5a0134140 0x7fe5a0138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.191+0000 7fe5a589f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe5a009ad40 0x7fe5a0133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55256/0 (socket says 172.21.15.146:55256) 2023-10-03T10:18:55.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.191+0000 7fe5a60a0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5a0134570 0x7fe5a013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.191+0000 7fe5a589f700 1 -- 172.21.15.146:0/3864230447 learned_addr learned my addr 172.21.15.146:0/3864230447 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:55.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.191+0000 7fe5a509e700 1 -- 172.21.15.146:0/3864230447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5a0134570 msgr2=0x7fe5a013b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:55.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.191+0000 7fe5a509e700 1 --2- 172.21.15.146:0/3864230447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5a0134570 0x7fe5a013b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.191+0000 7fe5a509e700 1 -- 172.21.15.146:0/3864230447 >> v1:172.21.15.146:6789/0 conn(0x7fe5a009ad40 legacy=0x7fe5a0133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.191+0000 7fe5a509e700 1 -- 172.21.15.146:0/3864230447 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a00a2fa0 con 0x7fe5a0134140 2023-10-03T10:18:55.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.191+0000 7fe5a489d700 1 -- 172.21.15.146:0/3864230447 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3083133324 0 0) 0x7fe5a009b110 con 0x7fe5a009ad40 2023-10-03T10:18:55.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.191+0000 7fe5a60a0700 1 --2- 172.21.15.146:0/3864230447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5a0134570 0x7fe5a013b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:55.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.191+0000 7fe5a509e700 1 --2- 172.21.15.146:0/3864230447 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5a0134140 0x7fe5a0138e80 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fe59c009870 tx=0x7fe59c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2854ca630c13d649 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.191+0000 7fe5a489d700 1 -- 172.21.15.146:0/3864230447 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c011830 con 0x7fe5a0134140 2023-10-03T10:18:55.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.192+0000 7fe5a489d700 1 -- 172.21.15.146:0/3864230447 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59c011990 con 0x7fe5a0134140 2023-10-03T10:18:55.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.192+0000 7fe5a489d700 1 -- 172.21.15.146:0/3864230447 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c011d20 con 0x7fe5a0134140 2023-10-03T10:18:55.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.192+0000 7fe5a7b03700 1 -- 172.21.15.146:0/3864230447 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5a0134140 msgr2=0x7fe5a0138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.192+0000 7fe5a7b03700 1 --2- 172.21.15.146:0/3864230447 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5a0134140 0x7fe5a0138e80 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fe59c009870 tx=0x7fe59c009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:55.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.192+0000 7fe5a7b03700 1 -- 172.21.15.146:0/3864230447 shutdown_connections 2023-10-03T10:18:55.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.192+0000 7fe5a7b03700 1 --2- 172.21.15.146:0/3864230447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5a0134570 0x7fe5a013b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.192+0000 7fe5a7b03700 1 --2- 172.21.15.146:0/3864230447 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5a0134140 0x7fe5a0138e80 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.192+0000 7fe5a7b03700 1 -- 172.21.15.146:0/3864230447 >> 172.21.15.146:0/3864230447 conn(0x7fe5a0099c40 msgr2=0x7fe5a006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.192+0000 7fe5a7b03700 1 -- 172.21.15.146:0/3864230447 shutdown_connections 2023-10-03T10:18:55.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.192+0000 7fe5a7b03700 1 -- 172.21.15.146:0/3864230447 wait complete. 2023-10-03T10:18:55.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.193+0000 7fe5a7b03700 1 Processor -- start 2023-10-03T10:18:55.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.193+0000 7fe5a7b03700 1 -- start start 2023-10-03T10:18:55.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.193+0000 7fe5a7b03700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5a009ad40 0x7fe5a0139470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.193+0000 7fe5a7b03700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5a0134140 0x7fe5a01399b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.193+0000 7fe5a7b03700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5a0134570 0x7fe5a0139ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.193+0000 7fe5a7b03700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a011eb70 con 0x7fe5a0134570 2023-10-03T10:18:55.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.193+0000 7fe5a7b03700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a01336d0 con 0x7fe5a009ad40 2023-10-03T10:18:55.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.194+0000 7fe5a7b03700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a011e0f0 con 0x7fe5a0134140 2023-10-03T10:18:55.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.194+0000 7fe5a589f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5a009ad40 0x7fe5a0139470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.194+0000 7fe5a589f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5a009ad40 0x7fe5a0139470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50384/0 (socket says 172.21.15.146:50384) 2023-10-03T10:18:55.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.194+0000 7fe5a589f700 1 -- 172.21.15.146:0/1303978782 learned_addr learned my addr 172.21.15.146:0/1303978782 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:55.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.194+0000 7fe5a60a0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5a0134570 0x7fe5a0139ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.194+0000 7fe5a509e700 1 --2- 172.21.15.146:0/1303978782 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5a0134140 0x7fe5a01399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.194+0000 7fe5a589f700 1 -- 172.21.15.146:0/1303978782 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5a0134140 msgr2=0x7fe5a01399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.194+0000 7fe5a589f700 1 --2- 172.21.15.146:0/1303978782 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5a0134140 0x7fe5a01399b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.194+0000 7fe5a589f700 1 -- 172.21.15.146:0/1303978782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5a0134570 msgr2=0x7fe5a0139ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.194+0000 7fe5a589f700 1 --2- 172.21.15.146:0/1303978782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5a0134570 0x7fe5a0139ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.194+0000 7fe5a589f700 1 -- 172.21.15.146:0/1303978782 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe598009a70 con 0x7fe5a009ad40 2023-10-03T10:18:55.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.194+0000 7fe5a509e700 1 --2- 172.21.15.146:0/1303978782 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5a0134140 0x7fe5a01399b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:55.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.194+0000 7fe5a60a0700 1 --2- 172.21.15.146:0/1303978782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5a0134570 0x7fe5a0139ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:55.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.194+0000 7fe5a589f700 1 --2- 172.21.15.146:0/1303978782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5a009ad40 0x7fe5a0139470 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fe59000c580 tx=0x7fe59000c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.194+0000 7fe5967fc700 1 -- 172.21.15.146:0/1303978782 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590004c80 con 0x7fe5a009ad40 2023-10-03T10:18:55.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.194+0000 7fe5967fc700 1 -- 172.21.15.146:0/1303978782 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe590004de0 con 0x7fe5a009ad40 2023-10-03T10:18:55.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.194+0000 7fe5967fc700 1 -- 172.21.15.146:0/1303978782 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590007310 con 0x7fe5a009ad40 2023-10-03T10:18:55.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.194+0000 7fe5a7b03700 1 -- 172.21.15.146:0/1303978782 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe59c0094a0 con 0x7fe5a009ad40 2023-10-03T10:18:55.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.194+0000 7fe5a7b03700 1 -- 172.21.15.146:0/1303978782 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a009e3c0 con 0x7fe5a009ad40 2023-10-03T10:18:55.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.195+0000 7fe5967fc700 1 -- 172.21.15.146:0/1303978782 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe590007470 con 0x7fe5a009ad40 2023-10-03T10:18:55.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.195+0000 7fe5967fc700 1 -- 172.21.15.146:0/1303978782 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe59003f240 con 0x7fe5a009ad40 2023-10-03T10:18:55.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.195+0000 7fe5a7b03700 1 -- 172.21.15.146:0/1303978782 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a009c840 con 0x7fe5a009ad40 2023-10-03T10:18:55.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.200+0000 7fe5967fc700 1 -- 172.21.15.146:0/1303978782 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5900123b0 con 0x7fe5a009ad40 2023-10-03T10:18:55.215 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:55.264 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:55.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.341+0000 7fc0a7413700 1 Processor -- start 2023-10-03T10:18:55.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.341+0000 7fc0a7413700 1 -- start start 2023-10-03T10:18:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.341+0000 7fc0a7413700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a009f350 0x7fc0a0136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.341+0000 7fc0a7413700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc0a01371c0 0x7fc0a01395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.341+0000 7fc0a7413700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a009c970 con 0x7fc0a009e870 2023-10-03T10:18:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.341+0000 7fc0a7413700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a00a0920 con 0x7fc0a01371c0 2023-10-03T10:18:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.341+0000 7fc0a7413700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a009f9c0 con 0x7fc0a009f350 2023-10-03T10:18:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.342+0000 7fc0a49ae700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a009f350 0x7fc0a0136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.342+0000 7fc0a51af700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc0a009e870 0x7fc0a009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55258/0 (socket says 172.21.15.146:55258) 2023-10-03T10:18:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.342+0000 7fc0a59b0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc0a01371c0 0x7fc0a01395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.342+0000 7fc0a51af700 1 -- 172.21.15.146:0/2657827157 learned_addr learned my addr 172.21.15.146:0/2657827157 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.342+0000 7fc0a49ae700 1 -- 172.21.15.146:0/2657827157 >> v2:172.21.15.146:3300/0 conn(0x7fc0a01371c0 msgr2=0x7fc0a01395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.342+0000 7fc0a49ae700 1 --2- 172.21.15.146:0/2657827157 >> v2:172.21.15.146:3300/0 conn(0x7fc0a01371c0 0x7fc0a01395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.342+0000 7fc0a49ae700 1 -- 172.21.15.146:0/2657827157 >> v1:172.21.15.146:6789/0 conn(0x7fc0a009e870 legacy=0x7fc0a009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.342+0000 7fc0a49ae700 1 -- 172.21.15.146:0/2657827157 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a009bab0 con 0x7fc0a009f350 2023-10-03T10:18:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.342+0000 7fc097fff700 1 -- 172.21.15.146:0/2657827157 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105589833 0 0) 0x7fc0a009c970 con 0x7fc0a009e870 2023-10-03T10:18:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.342+0000 7fc0a59b0700 1 --2- 172.21.15.146:0/2657827157 >> v2:172.21.15.146:3300/0 conn(0x7fc0a01371c0 0x7fc0a01395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.342+0000 7fc0a49ae700 1 --2- 172.21.15.146:0/2657827157 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a009f350 0x7fc0a0136c80 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fc090009840 tx=0x7fc090009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbf3a43aa17aca1a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.342+0000 7fc097fff700 1 -- 172.21.15.146:0/2657827157 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc090011830 con 0x7fc0a009f350 2023-10-03T10:18:55.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.342+0000 7fc097fff700 1 -- 172.21.15.146:0/2657827157 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc090011990 con 0x7fc0a009f350 2023-10-03T10:18:55.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.342+0000 7fc097fff700 1 -- 172.21.15.146:0/2657827157 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc090011d20 con 0x7fc0a009f350 2023-10-03T10:18:55.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.343+0000 7fc0a7413700 1 -- 172.21.15.146:0/2657827157 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a009f350 msgr2=0x7fc0a0136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.343+0000 7fc0a7413700 1 --2- 172.21.15.146:0/2657827157 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a009f350 0x7fc0a0136c80 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fc090009840 tx=0x7fc090009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:55.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.343+0000 7fc0a7413700 1 -- 172.21.15.146:0/2657827157 shutdown_connections 2023-10-03T10:18:55.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.343+0000 7fc0a7413700 1 --2- 172.21.15.146:0/2657827157 >> v2:172.21.15.146:3300/0 conn(0x7fc0a01371c0 0x7fc0a01395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.343+0000 7fc0a7413700 1 --2- 172.21.15.146:0/2657827157 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a009f350 0x7fc0a0136c80 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.343+0000 7fc0a7413700 1 -- 172.21.15.146:0/2657827157 >> 172.21.15.146:0/2657827157 conn(0x7fc0a00a4430 msgr2=0x7fc0a00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.343+0000 7fc0a7413700 1 -- 172.21.15.146:0/2657827157 shutdown_connections 2023-10-03T10:18:55.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.343+0000 7fc0a7413700 1 -- 172.21.15.146:0/2657827157 wait complete. 2023-10-03T10:18:55.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.344+0000 7fc0a7413700 1 Processor -- start 2023-10-03T10:18:55.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.344+0000 7fc0a7413700 1 -- start start 2023-10-03T10:18:55.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.345+0000 7fc0a7413700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a009e870 0x7fc0a006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.345+0000 7fc0a7413700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a009f350 0x7fc0a006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.345+0000 7fc0a7413700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a01371c0 0x7fc0a006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.345+0000 7fc0a7413700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a0136380 con 0x7fc0a009e870 2023-10-03T10:18:55.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.345+0000 7fc0a7413700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a006d600 con 0x7fc0a01371c0 2023-10-03T10:18:55.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.345+0000 7fc0a7413700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a0136530 con 0x7fc0a009f350 2023-10-03T10:18:55.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.345+0000 7fc0a51af700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a009e870 0x7fc0a006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.345+0000 7fc0a51af700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a009e870 0x7fc0a006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53490/0 (socket says 172.21.15.146:53490) 2023-10-03T10:18:55.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.345+0000 7fc0a51af700 1 -- 172.21.15.146:0/1557397355 learned_addr learned my addr 172.21.15.146:0/1557397355 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:55.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.345+0000 7fc0a49ae700 1 --2- 172.21.15.146:0/1557397355 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a009f350 0x7fc0a006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.345+0000 7fc0a59b0700 1 --2- 172.21.15.146:0/1557397355 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a01371c0 0x7fc0a006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.346+0000 7fc0a59b0700 1 -- 172.21.15.146:0/1557397355 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a009f350 msgr2=0x7fc0a006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.346+0000 7fc0a59b0700 1 --2- 172.21.15.146:0/1557397355 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a009f350 0x7fc0a006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.346+0000 7fc0a59b0700 1 -- 172.21.15.146:0/1557397355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a009e870 msgr2=0x7fc0a006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.346+0000 7fc0a59b0700 1 --2- 172.21.15.146:0/1557397355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a009e870 0x7fc0a006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.346+0000 7fc0a59b0700 1 -- 172.21.15.146:0/1557397355 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc098009a70 con 0x7fc0a01371c0 2023-10-03T10:18:55.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.346+0000 7fc0a49ae700 1 --2- 172.21.15.146:0/1557397355 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a009f350 0x7fc0a006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:55.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.346+0000 7fc0a51af700 1 --2- 172.21.15.146:0/1557397355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a009e870 0x7fc0a006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:55.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.346+0000 7fc0a59b0700 1 --2- 172.21.15.146:0/1557397355 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a01371c0 0x7fc0a006c330 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc09800efc0 tx=0x7fc09800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.346+0000 7fc095ffb700 1 -- 172.21.15.146:0/1557397355 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09800cc90 con 0x7fc0a01371c0 2023-10-03T10:18:55.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.346+0000 7fc095ffb700 1 -- 172.21.15.146:0/1557397355 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09800f040 con 0x7fc0a01371c0 2023-10-03T10:18:55.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.346+0000 7fc0a7413700 1 -- 172.21.15.146:0/1557397355 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0900094a0 con 0x7fc0a01371c0 2023-10-03T10:18:55.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.346+0000 7fc095ffb700 1 -- 172.21.15.146:0/1557397355 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098014480 con 0x7fc0a01371c0 2023-10-03T10:18:55.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.346+0000 7fc0a7413700 1 -- 172.21.15.146:0/1557397355 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a0126220 con 0x7fc0a01371c0 2023-10-03T10:18:55.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.347+0000 7fc095ffb700 1 -- 172.21.15.146:0/1557397355 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc098014600 con 0x7fc0a01371c0 2023-10-03T10:18:55.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.347+0000 7fc095ffb700 1 -- 172.21.15.146:0/1557397355 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc09803ff50 con 0x7fc0a01371c0 2023-10-03T10:18:55.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.347+0000 7fc0a7413700 1 -- 172.21.15.146:0/1557397355 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a004f2a0 con 0x7fc0a01371c0 2023-10-03T10:18:55.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.356+0000 7fc095ffb700 1 -- 172.21.15.146:0/1557397355 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc098018080 con 0x7fc0a01371c0 2023-10-03T10:18:55.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.398+0000 7effbfd65700 1 Processor -- start 2023-10-03T10:18:55.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.398+0000 7effbfd65700 1 -- start start 2023-10-03T10:18:55.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.399+0000 7effbfd65700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7effb809f430 0x7effb8136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.399+0000 7effbfd65700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7effb8137010 0x7effb81393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.399+0000 7effbfd65700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb809b6d0 con 0x7effb809e950 2023-10-03T10:18:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.399+0000 7effbfd65700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb809afb0 con 0x7effb8137010 2023-10-03T10:18:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.399+0000 7effbfd65700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effb80a0970 con 0x7effb809f430 2023-10-03T10:18:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.399+0000 7effbe302700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7effb8137010 0x7effb81393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.399+0000 7effbd300700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7effb809f430 0x7effb8136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.399+0000 7effbe302700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7effb8137010 0x7effb81393f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53494/0 (socket says 172.21.15.146:53494) 2023-10-03T10:18:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.399+0000 7effbe302700 1 -- 172.21.15.146:0/3025235575 learned_addr learned my addr 172.21.15.146:0/3025235575 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.399+0000 7effbe302700 1 -- 172.21.15.146:0/3025235575 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7effb809f430 msgr2=0x7effb8136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.399+0000 7effbe302700 1 --2- 172.21.15.146:0/3025235575 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7effb809f430 0x7effb8136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.399+0000 7effbe302700 1 -- 172.21.15.146:0/3025235575 >> v1:172.21.15.146:6789/0 conn(0x7effb809e950 legacy=0x7effb809ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.399+0000 7effbe302700 1 -- 172.21.15.146:0/3025235575 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb80a0320 con 0x7effb8137010 2023-10-03T10:18:55.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.399+0000 7effbe302700 1 --2- 172.21.15.146:0/3025235575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effb8137010 0x7effb81393f0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7effb0009e50 tx=0x7effb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd7c931b85685bb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.399+0000 7effbcaff700 1 -- 172.21.15.146:0/3025235575 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb000e070 con 0x7effb8137010 2023-10-03T10:18:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.399+0000 7effbcaff700 1 -- 172.21.15.146:0/3025235575 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb000b910 con 0x7effb8137010 2023-10-03T10:18:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.399+0000 7effbcaff700 1 -- 172.21.15.146:0/3025235575 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb000bcc0 con 0x7effb8137010 2023-10-03T10:18:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.400+0000 7effbfd65700 1 -- 172.21.15.146:0/3025235575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effb8137010 msgr2=0x7effb81393f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.400+0000 7effbfd65700 1 --2- 172.21.15.146:0/3025235575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effb8137010 0x7effb81393f0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7effb0009e50 tx=0x7effb000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.400+0000 7effbfd65700 1 -- 172.21.15.146:0/3025235575 shutdown_connections 2023-10-03T10:18:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.400+0000 7effbfd65700 1 --2- 172.21.15.146:0/3025235575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effb8137010 0x7effb81393f0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.400+0000 7effbfd65700 1 --2- 172.21.15.146:0/3025235575 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7effb809f430 0x7effb8136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.400+0000 7effbfd65700 1 -- 172.21.15.146:0/3025235575 >> 172.21.15.146:0/3025235575 conn(0x7effb80a0f70 msgr2=0x7effb80a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.400+0000 7effbfd65700 1 -- 172.21.15.146:0/3025235575 shutdown_connections 2023-10-03T10:18:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.400+0000 7effbfd65700 1 -- 172.21.15.146:0/3025235575 wait complete. 2023-10-03T10:18:55.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.401+0000 7fe5a7b03700 1 -- 172.21.15.146:0/1303978782 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe5a01361e0 con 0x7fe5a009ad40 2023-10-03T10:18:55.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.401+0000 7fe5967fc700 1 -- 172.21.15.146:0/1303978782 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe590011360 con 0x7fe5a009ad40 2023-10-03T10:18:55.403 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:55.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.401+0000 7effbfd65700 1 Processor -- start 2023-10-03T10:18:55.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.401+0000 7effbfd65700 1 -- start start 2023-10-03T10:18:55.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.402+0000 7effbfd65700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7effb809e950 0x7effb811c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.402+0000 7effbfd65700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effb809f430 0x7effb811cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.402+0000 7effbfd65700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7effb8137010 0x7effb811d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.402+0000 7effbfd65700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb80721e0 con 0x7effb809f430 2023-10-03T10:18:55.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.402+0000 7effbfd65700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb811e470 con 0x7effb8137010 2023-10-03T10:18:55.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.402+0000 7effbfd65700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effb811fcd0 con 0x7effb809e950 2023-10-03T10:18:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.402+0000 7effbd300700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effb809f430 0x7effb811cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.402+0000 7effbd300700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effb809f430 0x7effb811cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53510/0 (socket says 172.21.15.146:53510) 2023-10-03T10:18:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.402+0000 7effbd300700 1 -- 172.21.15.146:0/3472828612 learned_addr learned my addr 172.21.15.146:0/3472828612 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.402+0000 7effbe302700 1 --2- 172.21.15.146:0/3472828612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7effb8137010 0x7effb811d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.403+0000 7effbd300700 1 -- 172.21.15.146:0/3472828612 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7effb809e950 msgr2=0x7effb811c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.403+0000 7effbd300700 1 --2- 172.21.15.146:0/3472828612 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7effb809e950 0x7effb811c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.403+0000 7effbd300700 1 -- 172.21.15.146:0/3472828612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7effb8137010 msgr2=0x7effb811d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.403+0000 7effbd300700 1 --2- 172.21.15.146:0/3472828612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7effb8137010 0x7effb811d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.403+0000 7effbd300700 1 -- 172.21.15.146:0/3472828612 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb0009b30 con 0x7effb809f430 2023-10-03T10:18:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.403+0000 7effbe302700 1 --2- 172.21.15.146:0/3472828612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7effb8137010 0x7effb811d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.403+0000 7effbd300700 1 --2- 172.21.15.146:0/3472828612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effb809f430 0x7effb811cce0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7effa800e9b0 tx=0x7effa800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.403+0000 7effae7fc700 1 -- 172.21.15.146:0/3472828612 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa8009710 con 0x7effb809f430 2023-10-03T10:18:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.403+0000 7effae7fc700 1 -- 172.21.15.146:0/3472828612 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa800c850 con 0x7effb809f430 2023-10-03T10:18:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.403+0000 7effbfd65700 1 -- 172.21.15.146:0/3472828612 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb811e910 con 0x7effb809f430 2023-10-03T10:18:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.403+0000 7effae7fc700 1 -- 172.21.15.146:0/3472828612 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa800cbc0 con 0x7effb809f430 2023-10-03T10:18:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.403+0000 7effbfd65700 1 -- 172.21.15.146:0/3472828612 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb811eb50 con 0x7effb809f430 2023-10-03T10:18:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.404+0000 7fe5a7b03700 1 -- 172.21.15.146:0/1303978782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5a009ad40 msgr2=0x7fe5a0139470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.404+0000 7fe5a7b03700 1 --2- 172.21.15.146:0/1303978782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5a009ad40 0x7fe5a0139470 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fe59000c580 tx=0x7fe59000c890 comp rx=0 tx=0).stop 2023-10-03T10:18:55.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.404+0000 7effae7fc700 1 -- 172.21.15.146:0/3472828612 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7effa800cd20 con 0x7effb809f430 2023-10-03T10:18:55.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.404+0000 7effae7fc700 1 -- 172.21.15.146:0/3472828612 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7effa803fb60 con 0x7effb809f430 2023-10-03T10:18:55.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.404+0000 7effbfd65700 1 -- 172.21.15.146:0/3472828612 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb80a47e0 con 0x7effb809f430 2023-10-03T10:18:55.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.405+0000 7fe5a7b03700 1 -- 172.21.15.146:0/1303978782 shutdown_connections 2023-10-03T10:18:55.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.405+0000 7fe5a7b03700 1 --2- 172.21.15.146:0/1303978782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5a0134570 0x7fe5a0139ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.405+0000 7fe5a7b03700 1 --2- 172.21.15.146:0/1303978782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5a009ad40 0x7fe5a0139470 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.405+0000 7fe5a7b03700 1 --2- 172.21.15.146:0/1303978782 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe5a0134140 0x7fe5a01399b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.405+0000 7fe5a7b03700 1 -- 172.21.15.146:0/1303978782 >> 172.21.15.146:0/1303978782 conn(0x7fe5a0099c40 msgr2=0x7fe5a013b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.405+0000 7fe5a7b03700 1 -- 172.21.15.146:0/1303978782 shutdown_connections 2023-10-03T10:18:55.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.405+0000 7fe5a7b03700 1 -- 172.21.15.146:0/1303978782 wait complete. 2023-10-03T10:18:55.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.409+0000 7effae7fc700 1 -- 172.21.15.146:0/3472828612 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effa8017080 con 0x7effb809f430 2023-10-03T10:18:55.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:55.424 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:55.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.549+0000 7f5439957700 1 Processor -- start 2023-10-03T10:18:55.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.550+0000 7f5439957700 1 -- start start 2023-10-03T10:18:55.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.550+0000 7f5439957700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f543409e870 0x7f543409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.550+0000 7f5439957700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5434131f40 0x7f5434139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.550+0000 7f5439957700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543409c970 con 0x7f543409f180 2023-10-03T10:18:55.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.550+0000 7f5439957700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54340a0920 con 0x7f5434131f40 2023-10-03T10:18:55.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.550+0000 7f5439957700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f543409f9c0 con 0x7f543409e870 2023-10-03T10:18:55.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.550+0000 7f54327fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f543409f180 0x7f5434131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55280/0 (socket says 172.21.15.146:55280) 2023-10-03T10:18:55.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.550+0000 7f54327fc700 1 -- 172.21.15.146:0/2515977104 learned_addr learned my addr 172.21.15.146:0/2515977104 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:55.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.550+0000 7f54337fe700 1 --2- 172.21.15.146:0/2515977104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5434131f40 0x7f5434139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.550+0000 7f5432ffd700 1 --2- 172.21.15.146:0/2515977104 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f543409e870 0x7f543409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.550+0000 7f54337fe700 1 -- 172.21.15.146:0/2515977104 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f543409e870 msgr2=0x7f543409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:55.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.550+0000 7f5431ffb700 1 -- 172.21.15.146:0/2515977104 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2367389508 0 0) 0x7f543409c970 con 0x7f543409f180 2023-10-03T10:18:55.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.550+0000 7f54337fe700 1 --2- 172.21.15.146:0/2515977104 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f543409e870 0x7f543409ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.550+0000 7f54337fe700 1 -- 172.21.15.146:0/2515977104 >> v1:172.21.15.146:6789/0 conn(0x7f543409f180 legacy=0x7f5434131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.550+0000 7f54337fe700 1 -- 172.21.15.146:0/2515977104 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543409bab0 con 0x7f5434131f40 2023-10-03T10:18:55.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.551+0000 7f54337fe700 1 --2- 172.21.15.146:0/2515977104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5434131f40 0x7f5434139ca0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f542c009dc0 tx=0x7f542c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4be619682f84e483 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.551+0000 7f5431ffb700 1 -- 172.21.15.146:0/2515977104 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c00e070 con 0x7f5434131f40 2023-10-03T10:18:55.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.551+0000 7f5431ffb700 1 -- 172.21.15.146:0/2515977104 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c00bbd0 con 0x7f5434131f40 2023-10-03T10:18:55.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.551+0000 7f5431ffb700 1 -- 172.21.15.146:0/2515977104 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c012430 con 0x7f5434131f40 2023-10-03T10:18:55.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.551+0000 7f5439957700 1 -- 172.21.15.146:0/2515977104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5434131f40 msgr2=0x7f5434139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.551+0000 7f5439957700 1 --2- 172.21.15.146:0/2515977104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5434131f40 0x7f5434139ca0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f542c009dc0 tx=0x7f542c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:55.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.551+0000 7f5439957700 1 -- 172.21.15.146:0/2515977104 shutdown_connections 2023-10-03T10:18:55.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.551+0000 7f5439957700 1 --2- 172.21.15.146:0/2515977104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5434131f40 0x7f5434139ca0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.551+0000 7f5439957700 1 --2- 172.21.15.146:0/2515977104 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f543409e870 0x7f543409ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.551+0000 7f5439957700 1 -- 172.21.15.146:0/2515977104 >> 172.21.15.146:0/2515977104 conn(0x7f54340a4430 msgr2=0x7f54340a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.551+0000 7f5439957700 1 -- 172.21.15.146:0/2515977104 shutdown_connections 2023-10-03T10:18:55.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.551+0000 7f5439957700 1 -- 172.21.15.146:0/2515977104 wait complete. 2023-10-03T10:18:55.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.553+0000 7f5439957700 1 Processor -- start 2023-10-03T10:18:55.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.553+0000 7f5439957700 1 -- start start 2023-10-03T10:18:55.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.553+0000 7f5439957700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543409e870 0x7f543406c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.553+0000 7f5439957700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f543409f180 0x7f543406c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.553+0000 7f5439957700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5434131f40 0x7f54341c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.553+0000 7f5439957700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5434122300 con 0x7f543409e870 2023-10-03T10:18:55.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.553+0000 7f5439957700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5434131430 con 0x7f5434131f40 2023-10-03T10:18:55.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.553+0000 7f5439957700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5434122040 con 0x7f543409f180 2023-10-03T10:18:55.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.554+0000 7f5432ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543409e870 0x7f543406c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.554+0000 7f54327fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f543409f180 0x7f543406c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.554+0000 7f5432ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543409e870 0x7f543406c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53512/0 (socket says 172.21.15.146:53512) 2023-10-03T10:18:55.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.554+0000 7f5432ffd700 1 -- 172.21.15.146:0/2225717890 learned_addr learned my addr 172.21.15.146:0/2225717890 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:55.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.554+0000 7f54337fe700 1 --2- 172.21.15.146:0/2225717890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5434131f40 0x7f54341c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.554+0000 7f54337fe700 1 -- 172.21.15.146:0/2225717890 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f543409f180 msgr2=0x7f543406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.554+0000 7f54337fe700 1 --2- 172.21.15.146:0/2225717890 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f543409f180 0x7f543406c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.554+0000 7f54337fe700 1 -- 172.21.15.146:0/2225717890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543409e870 msgr2=0x7f543406c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.554+0000 7f54337fe700 1 --2- 172.21.15.146:0/2225717890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543409e870 0x7f543406c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.554+0000 7f54337fe700 1 -- 172.21.15.146:0/2225717890 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c009a70 con 0x7f5434131f40 2023-10-03T10:18:55.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.554+0000 7f5432ffd700 1 --2- 172.21.15.146:0/2225717890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543409e870 0x7f543406c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:55.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.554+0000 7f54337fe700 1 --2- 172.21.15.146:0/2225717890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5434131f40 0x7f54341c8230 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f542c016000 tx=0x7f542c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.554+0000 7f541bfff700 1 -- 172.21.15.146:0/2225717890 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c004880 con 0x7f5434131f40 2023-10-03T10:18:55.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.554+0000 7f541bfff700 1 -- 172.21.15.146:0/2225717890 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c020070 con 0x7f5434131f40 2023-10-03T10:18:55.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.554+0000 7f5439957700 1 -- 172.21.15.146:0/2225717890 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543406cd00 con 0x7f5434131f40 2023-10-03T10:18:55.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.554+0000 7f5439957700 1 -- 172.21.15.146:0/2225717890 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543409dba0 con 0x7f5434131f40 2023-10-03T10:18:55.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.554+0000 7f541bfff700 1 -- 172.21.15.146:0/2225717890 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c0276c0 con 0x7f5434131f40 2023-10-03T10:18:55.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.555+0000 7f541bfff700 1 -- 172.21.15.146:0/2225717890 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f542c012430 con 0x7f5434131f40 2023-10-03T10:18:55.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.555+0000 7f5439957700 1 -- 172.21.15.146:0/2225717890 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54140052e0 con 0x7f5434131f40 2023-10-03T10:18:55.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.555+0000 7f541bfff700 1 -- 172.21.15.146:0/2225717890 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f542c022070 con 0x7f5434131f40 2023-10-03T10:18:55.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.560+0000 7f541bfff700 1 -- 172.21.15.146:0/2225717890 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f542c011980 con 0x7f5434131f40 2023-10-03T10:18:55.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.561+0000 7fc0a7413700 1 -- 172.21.15.146:0/1557397355 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc0a009dba0 con 0x7fc0a01371c0 2023-10-03T10:18:55.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.562+0000 7fc095ffb700 1 -- 172.21.15.146:0/1557397355 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc0980114a0 con 0x7fc0a01371c0 2023-10-03T10:18:55.561 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:55.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.564+0000 7fc0a7413700 1 -- 172.21.15.146:0/1557397355 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a01371c0 msgr2=0x7fc0a006c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.564+0000 7fc0a7413700 1 --2- 172.21.15.146:0/1557397355 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a01371c0 0x7fc0a006c330 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc09800efc0 tx=0x7fc09800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.565+0000 7fc0a7413700 1 -- 172.21.15.146:0/1557397355 shutdown_connections 2023-10-03T10:18:55.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.565+0000 7fc0a7413700 1 --2- 172.21.15.146:0/1557397355 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0a01371c0 0x7fc0a006c330 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.565+0000 7fc0a7413700 1 --2- 172.21.15.146:0/1557397355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a009e870 0x7fc0a006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.565+0000 7fc0a7413700 1 --2- 172.21.15.146:0/1557397355 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc0a009f350 0x7fc0a006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.565+0000 7fc0a7413700 1 -- 172.21.15.146:0/1557397355 >> 172.21.15.146:0/1557397355 conn(0x7fc0a00a4430 msgr2=0x7fc0a009c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.565+0000 7fc0a7413700 1 -- 172.21.15.146:0/1557397355 shutdown_connections 2023-10-03T10:18:55.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.565+0000 7fc0a7413700 1 -- 172.21.15.146:0/1557397355 wait complete. 2023-10-03T10:18:55.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:55.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.609+0000 7effbfd65700 1 -- 172.21.15.146:0/3472828612 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7effb804f2a0 con 0x7effb809f430 2023-10-03T10:18:55.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.610+0000 7effae7fc700 1 -- 172.21.15.146:0/3472828612 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effa801b3b0 con 0x7effb809f430 2023-10-03T10:18:55.610 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:55.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.612+0000 7effbfd65700 1 -- 172.21.15.146:0/3472828612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effb809f430 msgr2=0x7effb811cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.612+0000 7effbfd65700 1 --2- 172.21.15.146:0/3472828612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effb809f430 0x7effb811cce0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7effa800e9b0 tx=0x7effa800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.612+0000 7effbfd65700 1 -- 172.21.15.146:0/3472828612 shutdown_connections 2023-10-03T10:18:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.612+0000 7effbfd65700 1 --2- 172.21.15.146:0/3472828612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7effb8137010 0x7effb811d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.612+0000 7effbfd65700 1 --2- 172.21.15.146:0/3472828612 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7effb809e950 0x7effb811c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.612+0000 7effbfd65700 1 --2- 172.21.15.146:0/3472828612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effb809f430 0x7effb811cce0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.612+0000 7effbfd65700 1 -- 172.21.15.146:0/3472828612 >> 172.21.15.146:0/3472828612 conn(0x7effb80a0f70 msgr2=0x7effb8134a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.612+0000 7effbfd65700 1 -- 172.21.15.146:0/3472828612 shutdown_connections 2023-10-03T10:18:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.612+0000 7effbfd65700 1 -- 172.21.15.146:0/3472828612 wait complete. 2023-10-03T10:18:55.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:55.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.756+0000 7f5439957700 1 -- 172.21.15.146:0/2225717890 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5414005150 con 0x7f5434131f40 2023-10-03T10:18:55.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.756+0000 7f541bfff700 1 -- 172.21.15.146:0/2225717890 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f542c035090 con 0x7f5434131f40 2023-10-03T10:18:55.756 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:55.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.758+0000 7f5439957700 1 -- 172.21.15.146:0/2225717890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5434131f40 msgr2=0x7f54341c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.758+0000 7f5439957700 1 --2- 172.21.15.146:0/2225717890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5434131f40 0x7f54341c8230 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f542c016000 tx=0x7f542c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.758+0000 7f5439957700 1 -- 172.21.15.146:0/2225717890 shutdown_connections 2023-10-03T10:18:55.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.758+0000 7f5439957700 1 --2- 172.21.15.146:0/2225717890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5434131f40 0x7f54341c8230 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.758+0000 7f5439957700 1 --2- 172.21.15.146:0/2225717890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543409e870 0x7f543406c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.758+0000 7f5439957700 1 --2- 172.21.15.146:0/2225717890 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f543409f180 0x7f543406c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.759+0000 7f5439957700 1 -- 172.21.15.146:0/2225717890 >> 172.21.15.146:0/2225717890 conn(0x7f54340a4430 msgr2=0x7f543409c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.759+0000 7f5439957700 1 -- 172.21.15.146:0/2225717890 shutdown_connections 2023-10-03T10:18:55.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:55.759+0000 7f5439957700 1 -- 172.21.15.146:0/2225717890 wait complete. 2023-10-03T10:18:55.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:56.418 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:56.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.548+0000 7f42d93fd700 1 Processor -- start 2023-10-03T10:18:56.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.548+0000 7f42d93fd700 1 -- start start 2023-10-03T10:18:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.548+0000 7f42d93fd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f42d40a0a90 0x7f42d40a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.548+0000 7f42d93fd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42d40a13a0 0x7f42d4133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.548+0000 7f42d93fd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42d4133f70 0x7f42d41343d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.548+0000 7f42d93fd700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d40a3aa0 con 0x7f42d40a0a90 2023-10-03T10:18:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.548+0000 7f42d93fd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d409a540 con 0x7f42d4133f70 2023-10-03T10:18:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.548+0000 7f42d93fd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40a1fe0 con 0x7f42d40a13a0 2023-10-03T10:18:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.548+0000 7f42d2ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f42d40a0a90 0x7f42d40a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.548+0000 7f42d37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42d4133f70 0x7f42d41343d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.548+0000 7f42d27fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42d40a13a0 0x7f42d4133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.548+0000 7f42d2ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f42d40a0a90 0x7f42d40a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53520/0 (socket says 172.21.15.146:53520) 2023-10-03T10:18:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.548+0000 7f42d2ffd700 1 -- 172.21.15.146:0/3531355984 learned_addr learned my addr 172.21.15.146:0/3531355984 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.549+0000 7f42d27fc700 1 -- 172.21.15.146:0/3531355984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42d4133f70 msgr2=0x7f42d41343d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.549+0000 7f42d27fc700 1 --2- 172.21.15.146:0/3531355984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42d4133f70 0x7f42d41343d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.549+0000 7f42d27fc700 1 -- 172.21.15.146:0/3531355984 >> v2:172.21.15.146:3300/0 conn(0x7f42d40a0a90 msgr2=0x7f42d40a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.549+0000 7f42d27fc700 1 --2- 172.21.15.146:0/3531355984 >> v2:172.21.15.146:3300/0 conn(0x7f42d40a0a90 0x7f42d40a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.549+0000 7f42d27fc700 1 -- 172.21.15.146:0/3531355984 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d409a280 con 0x7f42d40a13a0 2023-10-03T10:18:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.549+0000 7f42d37fe700 1 --2- 172.21.15.146:0/3531355984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42d4133f70 0x7f42d41343d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.549+0000 7f42d2ffd700 1 --2- 172.21.15.146:0/3531355984 >> v2:172.21.15.146:3300/0 conn(0x7f42d40a0a90 0x7f42d40a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.549+0000 7f42d27fc700 1 --2- 172.21.15.146:0/3531355984 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42d40a13a0 0x7f42d4133a30 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f42c8009870 tx=0x7f42c8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77ad0ce025ad3e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.549+0000 7f42d1ffb700 1 -- 172.21.15.146:0/3531355984 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8011830 con 0x7f42d40a13a0 2023-10-03T10:18:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.549+0000 7f42d1ffb700 1 -- 172.21.15.146:0/3531355984 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c8011990 con 0x7f42d40a13a0 2023-10-03T10:18:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.549+0000 7f42d1ffb700 1 -- 172.21.15.146:0/3531355984 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8011d20 con 0x7f42d40a13a0 2023-10-03T10:18:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.549+0000 7f42d93fd700 1 -- 172.21.15.146:0/3531355984 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42d40a13a0 msgr2=0x7f42d4133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.549+0000 7f42d93fd700 1 --2- 172.21.15.146:0/3531355984 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42d40a13a0 0x7f42d4133a30 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f42c8009870 tx=0x7f42c8009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.550+0000 7f42d93fd700 1 -- 172.21.15.146:0/3531355984 shutdown_connections 2023-10-03T10:18:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.550+0000 7f42d93fd700 1 --2- 172.21.15.146:0/3531355984 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42d4133f70 0x7f42d41343d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.550+0000 7f42d93fd700 1 --2- 172.21.15.146:0/3531355984 >> v2:172.21.15.146:3300/0 conn(0x7f42d40a0a90 0x7f42d40a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.550+0000 7f42d93fd700 1 --2- 172.21.15.146:0/3531355984 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42d40a13a0 0x7f42d4133a30 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.550+0000 7f42d93fd700 1 -- 172.21.15.146:0/3531355984 >> 172.21.15.146:0/3531355984 conn(0x7f42d4099c40 msgr2=0x7f42d406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.550+0000 7f42d93fd700 1 -- 172.21.15.146:0/3531355984 shutdown_connections 2023-10-03T10:18:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.550+0000 7f42d93fd700 1 -- 172.21.15.146:0/3531355984 wait complete. 2023-10-03T10:18:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.551+0000 7f42d93fd700 1 Processor -- start 2023-10-03T10:18:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.551+0000 7f42d93fd700 1 -- start start 2023-10-03T10:18:56.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42d93fd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42d40a0a90 0x7f42d41212c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42d93fd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42d40a13a0 0x7f42d4121800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42d93fd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42d4133f70 0x7f42d4121d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42d93fd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d4122ed0 con 0x7f42d40a0a90 2023-10-03T10:18:56.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42d93fd700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d4122720 con 0x7f42d40a13a0 2023-10-03T10:18:56.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42d93fd700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42d4123d60 con 0x7f42d4133f70 2023-10-03T10:18:56.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42d2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42d40a0a90 0x7f42d41212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42d2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42d40a0a90 0x7f42d41212c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53536/0 (socket says 172.21.15.146:53536) 2023-10-03T10:18:56.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42d2ffd700 1 -- 172.21.15.146:0/1067737665 learned_addr learned my addr 172.21.15.146:0/1067737665 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:56.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42d27fc700 1 --2- 172.21.15.146:0/1067737665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42d40a13a0 0x7f42d4121800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42d37fe700 1 --2- 172.21.15.146:0/1067737665 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42d4133f70 0x7f42d4121d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42d2ffd700 1 -- 172.21.15.146:0/1067737665 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42d4133f70 msgr2=0x7f42d4121d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42d2ffd700 1 --2- 172.21.15.146:0/1067737665 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42d4133f70 0x7f42d4121d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42d2ffd700 1 -- 172.21.15.146:0/1067737665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42d40a13a0 msgr2=0x7f42d4121800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42d2ffd700 1 --2- 172.21.15.146:0/1067737665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42d40a13a0 0x7f42d4121800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42d2ffd700 1 -- 172.21.15.146:0/1067737665 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c4009550 con 0x7f42d40a0a90 2023-10-03T10:18:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42d27fc700 1 --2- 172.21.15.146:0/1067737665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42d40a13a0 0x7f42d4121800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42d2ffd700 1 --2- 172.21.15.146:0/1067737665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42d40a0a90 0x7f42d41212c0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f42c400e960 tx=0x7f42c400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42bb7fe700 1 -- 172.21.15.146:0/1067737665 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4004030 con 0x7f42d40a0a90 2023-10-03T10:18:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42bb7fe700 1 -- 172.21.15.146:0/1067737665 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c4004190 con 0x7f42d40a0a90 2023-10-03T10:18:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42d93fd700 1 -- 172.21.15.146:0/1067737665 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42cc009a70 con 0x7f42d40a0a90 2023-10-03T10:18:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42bb7fe700 1 -- 172.21.15.146:0/1067737665 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4004520 con 0x7f42d40a0a90 2023-10-03T10:18:56.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.552+0000 7f42d93fd700 1 -- 172.21.15.146:0/1067737665 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c80094a0 con 0x7f42d40a0a90 2023-10-03T10:18:56.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.553+0000 7f42bb7fe700 1 -- 172.21.15.146:0/1067737665 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f42c40036a0 con 0x7f42d40a0a90 2023-10-03T10:18:56.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.553+0000 7f42bb7fe700 1 -- 172.21.15.146:0/1067737665 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f42c403f890 con 0x7f42d40a0a90 2023-10-03T10:18:56.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.553+0000 7f42d93fd700 1 -- 172.21.15.146:0/1067737665 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d40a6070 con 0x7f42d40a0a90 2023-10-03T10:18:56.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.558+0000 7f42bb7fe700 1 -- 172.21.15.146:0/1067737665 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f42c4020080 con 0x7f42d40a0a90 2023-10-03T10:18:56.582 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:56.624 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:56.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.707+0000 7ffbed0ca700 1 Processor -- start 2023-10-03T10:18:56.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.707+0000 7ffbed0ca700 1 -- start start 2023-10-03T10:18:56.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.708+0000 7ffbed0ca700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffbe8133ad0 0x7ffbe8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.708+0000 7ffbed0ca700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffbe8130bc0 0x7ffbe813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.708+0000 7ffbed0ca700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe806b2d0 con 0x7ffbe81300a0 2023-10-03T10:18:56.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.708+0000 7ffbed0ca700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe8133610 con 0x7ffbe8130bc0 2023-10-03T10:18:56.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.708+0000 7ffbed0ca700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe809a500 con 0x7ffbe8133ad0 2023-10-03T10:18:56.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.708+0000 7ffbe659c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ffbe81300a0 0x7ffbe81304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55288/0 (socket says 172.21.15.146:55288) 2023-10-03T10:18:56.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.708+0000 7ffbe659c700 1 -- 172.21.15.146:0/2752326750 learned_addr learned my addr 172.21.15.146:0/2752326750 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:56.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.708+0000 7ffbe6d9d700 1 --2- 172.21.15.146:0/2752326750 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffbe8133ad0 0x7ffbe8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.708+0000 7ffbe759e700 1 --2- 172.21.15.146:0/2752326750 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffbe8130bc0 0x7ffbe813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.708+0000 7ffbe5d9b700 1 -- 172.21.15.146:0/2752326750 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511209415 0 0) 0x7ffbe806b2d0 con 0x7ffbe81300a0 2023-10-03T10:18:56.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.708+0000 7ffbe5d9b700 1 -- 172.21.15.146:0/2752326750 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbd00035b0 con 0x7ffbe81300a0 2023-10-03T10:18:56.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.708+0000 7ffbe6d9d700 1 -- 172.21.15.146:0/2752326750 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffbe8130bc0 msgr2=0x7ffbe813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:56.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.708+0000 7ffbe6d9d700 1 --2- 172.21.15.146:0/2752326750 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffbe8130bc0 0x7ffbe813b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.708+0000 7ffbe6d9d700 1 -- 172.21.15.146:0/2752326750 >> v1:172.21.15.146:6789/0 conn(0x7ffbe81300a0 legacy=0x7ffbe81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.708+0000 7ffbe6d9d700 1 -- 172.21.15.146:0/2752326750 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe81338b0 con 0x7ffbe8133ad0 2023-10-03T10:18:56.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.708+0000 7ffbe759e700 1 --2- 172.21.15.146:0/2752326750 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffbe8130bc0 0x7ffbe813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:56.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.708+0000 7ffbe6d9d700 1 --2- 172.21.15.146:0/2752326750 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffbe8133ad0 0x7ffbe8133ea0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8009870 tx=0x7ffbd8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df882736c96ff0ad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:56.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.709+0000 7ffbe5d9b700 1 -- 172.21.15.146:0/2752326750 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8011830 con 0x7ffbe8133ad0 2023-10-03T10:18:56.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.709+0000 7ffbe5d9b700 1 -- 172.21.15.146:0/2752326750 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd8011990 con 0x7ffbe8133ad0 2023-10-03T10:18:56.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.709+0000 7ffbe5d9b700 1 -- 172.21.15.146:0/2752326750 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8011d20 con 0x7ffbe8133ad0 2023-10-03T10:18:56.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.709+0000 7ffbed0ca700 1 -- 172.21.15.146:0/2752326750 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffbe8133ad0 msgr2=0x7ffbe8133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.709+0000 7ffbed0ca700 1 --2- 172.21.15.146:0/2752326750 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffbe8133ad0 0x7ffbe8133ea0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8009870 tx=0x7ffbd8009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:56.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.709+0000 7ffbed0ca700 1 -- 172.21.15.146:0/2752326750 shutdown_connections 2023-10-03T10:18:56.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.709+0000 7ffbed0ca700 1 --2- 172.21.15.146:0/2752326750 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffbe8130bc0 0x7ffbe813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.709+0000 7ffbed0ca700 1 --2- 172.21.15.146:0/2752326750 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffbe8133ad0 0x7ffbe8133ea0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.709+0000 7ffbed0ca700 1 -- 172.21.15.146:0/2752326750 >> 172.21.15.146:0/2752326750 conn(0x7ffbe8099c40 msgr2=0x7ffbe80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:56.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.709+0000 7ffbed0ca700 1 -- 172.21.15.146:0/2752326750 shutdown_connections 2023-10-03T10:18:56.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.709+0000 7ffbed0ca700 1 -- 172.21.15.146:0/2752326750 wait complete. 2023-10-03T10:18:56.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.710+0000 7ffbed0ca700 1 Processor -- start 2023-10-03T10:18:56.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.710+0000 7ffbed0ca700 1 -- start start 2023-10-03T10:18:56.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.711+0000 7ffbed0ca700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffbe81300a0 0x7ffbe811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.711+0000 7ffbed0ca700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffbe8130bc0 0x7ffbe811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.711+0000 7ffbed0ca700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbe8133ad0 0x7ffbe811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.711+0000 7ffbed0ca700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe811fd70 con 0x7ffbe8133ad0 2023-10-03T10:18:56.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.711+0000 7ffbed0ca700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe8071fe0 con 0x7ffbe8130bc0 2023-10-03T10:18:56.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.711+0000 7ffbed0ca700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe81208e0 con 0x7ffbe81300a0 2023-10-03T10:18:56.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.711+0000 7ffbe6d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffbe81300a0 0x7ffbe811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.711+0000 7ffbe659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffbe8130bc0 0x7ffbe811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.711+0000 7ffbe6d9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffbe81300a0 0x7ffbe811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53248/0 (socket says 172.21.15.146:53248) 2023-10-03T10:18:56.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.711+0000 7ffbe659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffbe8130bc0 0x7ffbe811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50460/0 (socket says 172.21.15.146:50460) 2023-10-03T10:18:56.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.711+0000 7ffbe6d9d700 1 -- 172.21.15.146:0/1401221924 learned_addr learned my addr 172.21.15.146:0/1401221924 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:56.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.711+0000 7ffbe759e700 1 --2- 172.21.15.146:0/1401221924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbe8133ad0 0x7ffbe811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.711+0000 7ffbe6d9d700 1 -- 172.21.15.146:0/1401221924 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffbe8130bc0 msgr2=0x7ffbe811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.711+0000 7ffbe6d9d700 1 --2- 172.21.15.146:0/1401221924 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffbe8130bc0 0x7ffbe811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.711+0000 7ffbe6d9d700 1 -- 172.21.15.146:0/1401221924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbe8133ad0 msgr2=0x7ffbe811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.711+0000 7ffbe6d9d700 1 --2- 172.21.15.146:0/1401221924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbe8133ad0 0x7ffbe811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.711+0000 7ffbe6d9d700 1 -- 172.21.15.146:0/1401221924 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe0009a70 con 0x7ffbe81300a0 2023-10-03T10:18:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.711+0000 7ffbe659c700 1 --2- 172.21.15.146:0/1401221924 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffbe8130bc0 0x7ffbe811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.711+0000 7ffbe759e700 1 --2- 172.21.15.146:0/1401221924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbe8133ad0 0x7ffbe811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.712+0000 7ffbe6d9d700 1 --2- 172.21.15.146:0/1401221924 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffbe81300a0 0x7ffbe811da40 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8009bc0 tx=0x7ffbd8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.712+0000 7ffbcf7fe700 1 -- 172.21.15.146:0/1401221924 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8004450 con 0x7ffbe81300a0 2023-10-03T10:18:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.712+0000 7ffbcf7fe700 1 -- 172.21.15.146:0/1401221924 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd80045b0 con 0x7ffbe81300a0 2023-10-03T10:18:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.712+0000 7ffbed0ca700 1 -- 172.21.15.146:0/1401221924 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd80094a0 con 0x7ffbe81300a0 2023-10-03T10:18:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.712+0000 7ffbcf7fe700 1 -- 172.21.15.146:0/1401221924 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd80038c0 con 0x7ffbe81300a0 2023-10-03T10:18:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.712+0000 7ffbed0ca700 1 -- 172.21.15.146:0/1401221924 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe80a33e0 con 0x7ffbe81300a0 2023-10-03T10:18:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.713+0000 7ffbcf7fe700 1 -- 172.21.15.146:0/1401221924 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffbd8003a20 con 0x7ffbe81300a0 2023-10-03T10:18:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.713+0000 7ffbcf7fe700 1 -- 172.21.15.146:0/1401221924 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ffbd8040860 con 0x7ffbe81300a0 2023-10-03T10:18:56.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.713+0000 7ffbed0ca700 1 -- 172.21.15.146:0/1401221924 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe809cb20 con 0x7ffbe81300a0 2023-10-03T10:18:56.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.718+0000 7ffbcf7fe700 1 -- 172.21.15.146:0/1401221924 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffbd8015080 con 0x7ffbe81300a0 2023-10-03T10:18:56.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.755+0000 7f42d93fd700 1 -- 172.21.15.146:0/1067737665 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f42d411e060 con 0x7f42d40a0a90 2023-10-03T10:18:56.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.755+0000 7f42bb7fe700 1 -- 172.21.15.146:0/1067737665 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f42c40119a0 con 0x7f42d40a0a90 2023-10-03T10:18:56.755 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:56.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.757+0000 7f42d93fd700 1 -- 172.21.15.146:0/1067737665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42d40a0a90 msgr2=0x7f42d41212c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.757+0000 7f42d93fd700 1 --2- 172.21.15.146:0/1067737665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42d40a0a90 0x7f42d41212c0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f42c400e960 tx=0x7f42c400ec70 comp rx=0 tx=0).stop 2023-10-03T10:18:56.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.757+0000 7f42d93fd700 1 -- 172.21.15.146:0/1067737665 shutdown_connections 2023-10-03T10:18:56.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.757+0000 7f42d93fd700 1 --2- 172.21.15.146:0/1067737665 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42d4133f70 0x7f42d4121d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.757+0000 7f42d93fd700 1 --2- 172.21.15.146:0/1067737665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42d40a0a90 0x7f42d41212c0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.757+0000 7f42d93fd700 1 --2- 172.21.15.146:0/1067737665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42d40a13a0 0x7f42d4121800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.757+0000 7f42d93fd700 1 -- 172.21.15.146:0/1067737665 >> 172.21.15.146:0/1067737665 conn(0x7f42d4099c40 msgr2=0x7f42d4133310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:56.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.757+0000 7f42d93fd700 1 -- 172.21.15.146:0/1067737665 shutdown_connections 2023-10-03T10:18:56.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.757+0000 7f42d93fd700 1 -- 172.21.15.146:0/1067737665 wait complete. 2023-10-03T10:18:56.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.765+0000 7fb4bcad1700 1 Processor -- start 2023-10-03T10:18:56.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.765+0000 7fb4bcad1700 1 -- start start 2023-10-03T10:18:56.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.765+0000 7fb4bcad1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4b8133ad0 0x7fb4b8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.765+0000 7fb4bcad1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb4b81300a0 0x7fb4b81304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.765+0000 7fb4bcad1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b806b2d0 con 0x7fb4b81309f0 2023-10-03T10:18:56.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.765+0000 7fb4bcad1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4b8133610 con 0x7fb4b81300a0 2023-10-03T10:18:56.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.765+0000 7fb4bcad1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b809a500 con 0x7fb4b8133ad0 2023-10-03T10:18:56.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.766+0000 7fb4b5d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb4b81300a0 0x7fb4b81304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.766+0000 7fb4b659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4b8133ad0 0x7fb4b8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.766+0000 7fb4b6d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb4b81309f0 0x7fb4b813a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55294/0 (socket says 172.21.15.146:55294) 2023-10-03T10:18:56.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.766+0000 7fb4b6d9d700 1 -- 172.21.15.146:0/3399132842 learned_addr learned my addr 172.21.15.146:0/3399132842 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:56.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.766+0000 7fb4b659c700 1 -- 172.21.15.146:0/3399132842 >> v2:172.21.15.146:3300/0 conn(0x7fb4b81300a0 msgr2=0x7fb4b81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:56.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.766+0000 7fb4b659c700 1 --2- 172.21.15.146:0/3399132842 >> v2:172.21.15.146:3300/0 conn(0x7fb4b81300a0 0x7fb4b81304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.766+0000 7fb4b659c700 1 -- 172.21.15.146:0/3399132842 >> v1:172.21.15.146:6789/0 conn(0x7fb4b81309f0 legacy=0x7fb4b813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.766+0000 7fb4b659c700 1 -- 172.21.15.146:0/3399132842 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b81338b0 con 0x7fb4b8133ad0 2023-10-03T10:18:56.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.766+0000 7fb4b559a700 1 -- 172.21.15.146:0/3399132842 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1514549379 0 0) 0x7fb4b806b2d0 con 0x7fb4b81309f0 2023-10-03T10:18:56.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.766+0000 7fb4b659c700 1 --2- 172.21.15.146:0/3399132842 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4b8133ad0 0x7fb4b8133ea0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009840 tx=0x7fb4a8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cf55b39ac9bce98 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:56.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.766+0000 7fb4b559a700 1 -- 172.21.15.146:0/3399132842 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8011830 con 0x7fb4b8133ad0 2023-10-03T10:18:56.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.766+0000 7fb4b559a700 1 -- 172.21.15.146:0/3399132842 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a8011990 con 0x7fb4b8133ad0 2023-10-03T10:18:56.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.766+0000 7fb4b559a700 1 -- 172.21.15.146:0/3399132842 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8011d20 con 0x7fb4b8133ad0 2023-10-03T10:18:56.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.767+0000 7fb4bcad1700 1 -- 172.21.15.146:0/3399132842 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4b8133ad0 msgr2=0x7fb4b8133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.767+0000 7fb4bcad1700 1 --2- 172.21.15.146:0/3399132842 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4b8133ad0 0x7fb4b8133ea0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009840 tx=0x7fb4a8009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:56.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.768+0000 7fb4bcad1700 1 -- 172.21.15.146:0/3399132842 shutdown_connections 2023-10-03T10:18:56.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.768+0000 7fb4bcad1700 1 --2- 172.21.15.146:0/3399132842 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4b8133ad0 0x7fb4b8133ea0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.768+0000 7fb4bcad1700 1 --2- 172.21.15.146:0/3399132842 >> v2:172.21.15.146:3300/0 conn(0x7fb4b81300a0 0x7fb4b81304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.768+0000 7fb4bcad1700 1 -- 172.21.15.146:0/3399132842 >> 172.21.15.146:0/3399132842 conn(0x7fb4b8099c40 msgr2=0x7fb4b80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:56.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.768+0000 7fb4bcad1700 1 -- 172.21.15.146:0/3399132842 shutdown_connections 2023-10-03T10:18:56.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.768+0000 7fb4bcad1700 1 -- 172.21.15.146:0/3399132842 wait complete. 2023-10-03T10:18:56.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.769+0000 7fb4bcad1700 1 Processor -- start 2023-10-03T10:18:56.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.769+0000 7fb4bcad1700 1 -- start start 2023-10-03T10:18:56.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:56.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.770+0000 7fb4bcad1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4b81300a0 0x7fb4b811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.770+0000 7fb4bcad1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4b81309f0 0x7fb4b811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.770+0000 7fb4bcad1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4b8133ad0 0x7fb4b811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.770+0000 7fb4bcad1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b811fb90 con 0x7fb4b8133ad0 2023-10-03T10:18:56.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.770+0000 7fb4bcad1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b811fd70 con 0x7fb4b81309f0 2023-10-03T10:18:56.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.770+0000 7fb4bcad1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b80a3330 con 0x7fb4b81300a0 2023-10-03T10:18:56.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.770+0000 7fb4b6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4b8133ad0 0x7fb4b811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.770+0000 7fb4b659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4b81300a0 0x7fb4b811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.770+0000 7fb4b6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4b8133ad0 0x7fb4b811e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53570/0 (socket says 172.21.15.146:53570) 2023-10-03T10:18:56.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.770+0000 7fb4b6d9d700 1 -- 172.21.15.146:0/4238900194 learned_addr learned my addr 172.21.15.146:0/4238900194 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:56.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.770+0000 7fb4b5d9b700 1 --2- 172.21.15.146:0/4238900194 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4b81309f0 0x7fb4b811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.770+0000 7fb4b6d9d700 1 -- 172.21.15.146:0/4238900194 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4b81300a0 msgr2=0x7fb4b811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.770+0000 7fb4b6d9d700 1 --2- 172.21.15.146:0/4238900194 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4b81300a0 0x7fb4b811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.770+0000 7fb4b6d9d700 1 -- 172.21.15.146:0/4238900194 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4b81309f0 msgr2=0x7fb4b811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.770+0000 7fb4b6d9d700 1 --2- 172.21.15.146:0/4238900194 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4b81309f0 0x7fb4b811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.770+0000 7fb4b6d9d700 1 -- 172.21.15.146:0/4238900194 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a80094a0 con 0x7fb4b8133ad0 2023-10-03T10:18:56.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.770+0000 7fb4b659c700 1 --2- 172.21.15.146:0/4238900194 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4b81300a0 0x7fb4b811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:56.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.771+0000 7fb4b6d9d700 1 --2- 172.21.15.146:0/4238900194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4b8133ad0 0x7fb4b811e4c0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0002230 tx=0x7fb4b000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:56.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.771+0000 7fb4a6ffd700 1 -- 172.21.15.146:0/4238900194 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b000aac0 con 0x7fb4b8133ad0 2023-10-03T10:18:56.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.771+0000 7fb4a6ffd700 1 -- 172.21.15.146:0/4238900194 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b000ac40 con 0x7fb4b8133ad0 2023-10-03T10:18:56.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.771+0000 7fb4bcad1700 1 -- 172.21.15.146:0/4238900194 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b812dd00 con 0x7fb4b8133ad0 2023-10-03T10:18:56.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.771+0000 7fb4a6ffd700 1 -- 172.21.15.146:0/4238900194 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b00070d0 con 0x7fb4b8133ad0 2023-10-03T10:18:56.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.771+0000 7fb4bcad1700 1 -- 172.21.15.146:0/4238900194 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b8071690 con 0x7fb4b8133ad0 2023-10-03T10:18:56.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.772+0000 7fb4a6ffd700 1 -- 172.21.15.146:0/4238900194 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb4b0007250 con 0x7fb4b8133ad0 2023-10-03T10:18:56.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.772+0000 7fb4a6ffd700 1 -- 172.21.15.146:0/4238900194 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb4b003f4e0 con 0x7fb4b8133ad0 2023-10-03T10:18:56.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.772+0000 7fb4bcad1700 1 -- 172.21.15.146:0/4238900194 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b80a2620 con 0x7fb4b8133ad0 2023-10-03T10:18:56.776 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:56.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.777+0000 7fb4a6ffd700 1 -- 172.21.15.146:0/4238900194 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4b0007500 con 0x7fb4b8133ad0 2023-10-03T10:18:56.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.909+0000 7f03dd83e700 1 Processor -- start 2023-10-03T10:18:56.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.909+0000 7f03dd83e700 1 -- start start 2023-10-03T10:18:56.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.909+0000 7f03dd83e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03d809f430 0x7f03d8136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.909+0000 7f03dd83e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03d8137010 0x7f03d81393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.909+0000 7f03dd83e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d809b6d0 con 0x7f03d809e950 2023-10-03T10:18:56.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.910+0000 7f03dd83e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d809afb0 con 0x7f03d8137010 2023-10-03T10:18:56.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.910+0000 7f03dd83e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03d80a0970 con 0x7f03d809f430 2023-10-03T10:18:56.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.910+0000 7f03d67fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03d809f430 0x7f03d8136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.910+0000 7f03d6ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f03d809e950 0x7f03d809ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55300/0 (socket says 172.21.15.146:55300) 2023-10-03T10:18:56.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.910+0000 7f03d6ffd700 1 -- 172.21.15.146:0/3546645100 learned_addr learned my addr 172.21.15.146:0/3546645100 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:56.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.910+0000 7f03d77fe700 1 --2- 172.21.15.146:0/3546645100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03d8137010 0x7f03d81393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.910+0000 7f03d67fc700 1 -- 172.21.15.146:0/3546645100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03d8137010 msgr2=0x7f03d81393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:56.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.910+0000 7f03d67fc700 1 --2- 172.21.15.146:0/3546645100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03d8137010 0x7f03d81393f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.910+0000 7f03d67fc700 1 -- 172.21.15.146:0/3546645100 >> v1:172.21.15.146:6789/0 conn(0x7f03d809e950 legacy=0x7f03d809ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.910+0000 7f03d67fc700 1 -- 172.21.15.146:0/3546645100 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d80a0320 con 0x7f03d809f430 2023-10-03T10:18:56.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.910+0000 7f03d67fc700 1 --2- 172.21.15.146:0/3546645100 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03d809f430 0x7f03d8136ad0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f03cc0098a0 tx=0x7f03cc009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fdb51af5033c3be server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:56.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.910+0000 7f03d5ffb700 1 -- 172.21.15.146:0/3546645100 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc011830 con 0x7f03d809f430 2023-10-03T10:18:56.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.910+0000 7f03d5ffb700 1 -- 172.21.15.146:0/3546645100 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03cc011990 con 0x7f03d809f430 2023-10-03T10:18:56.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.910+0000 7f03d5ffb700 1 -- 172.21.15.146:0/3546645100 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc011d20 con 0x7f03d809f430 2023-10-03T10:18:56.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.911+0000 7f03dd83e700 1 -- 172.21.15.146:0/3546645100 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03d809f430 msgr2=0x7f03d8136ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.911+0000 7f03dd83e700 1 --2- 172.21.15.146:0/3546645100 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03d809f430 0x7f03d8136ad0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f03cc0098a0 tx=0x7f03cc009bb0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.911+0000 7f03dd83e700 1 -- 172.21.15.146:0/3546645100 shutdown_connections 2023-10-03T10:18:56.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.911+0000 7f03dd83e700 1 --2- 172.21.15.146:0/3546645100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03d8137010 0x7f03d81393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.911+0000 7f03dd83e700 1 --2- 172.21.15.146:0/3546645100 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03d809f430 0x7f03d8136ad0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.911+0000 7f03dd83e700 1 -- 172.21.15.146:0/3546645100 >> 172.21.15.146:0/3546645100 conn(0x7f03d80a0f70 msgr2=0x7f03d80a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:56.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.911+0000 7f03dd83e700 1 -- 172.21.15.146:0/3546645100 shutdown_connections 2023-10-03T10:18:56.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.911+0000 7f03dd83e700 1 -- 172.21.15.146:0/3546645100 wait complete. 2023-10-03T10:18:56.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.912+0000 7f03dd83e700 1 Processor -- start 2023-10-03T10:18:56.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.912+0000 7f03dd83e700 1 -- start start 2023-10-03T10:18:56.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.912+0000 7f03dd83e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03d809e950 0x7f03d81c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.912+0000 7f03dd83e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03d809f430 0x7f03d81c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.912+0000 7f03dd83e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03d8137010 0x7f03d81c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.913+0000 7f03dd83e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d806d4c0 con 0x7f03d809e950 2023-10-03T10:18:56.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.913+0000 7f03dd83e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d8122d30 con 0x7f03d809f430 2023-10-03T10:18:56.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.913+0000 7f03dd83e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03d81243a0 con 0x7f03d8137010 2023-10-03T10:18:56.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.913+0000 7f03d6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03d809e950 0x7f03d81c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.913+0000 7f03d67fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03d809f430 0x7f03d81c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.913+0000 7f03d6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03d809e950 0x7f03d81c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53584/0 (socket says 172.21.15.146:53584) 2023-10-03T10:18:56.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.913+0000 7f03d67fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03d809f430 0x7f03d81c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50488/0 (socket says 172.21.15.146:50488) 2023-10-03T10:18:56.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.913+0000 7f03d6ffd700 1 -- 172.21.15.146:0/2497214272 learned_addr learned my addr 172.21.15.146:0/2497214272 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:56.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.913+0000 7f03d77fe700 1 --2- 172.21.15.146:0/2497214272 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03d8137010 0x7f03d81c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.913+0000 7f03d67fc700 1 -- 172.21.15.146:0/2497214272 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03d8137010 msgr2=0x7f03d81c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.913+0000 7f03d67fc700 1 --2- 172.21.15.146:0/2497214272 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03d8137010 0x7f03d81c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.913+0000 7f03d67fc700 1 -- 172.21.15.146:0/2497214272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03d809e950 msgr2=0x7f03d81c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.913+0000 7f03d67fc700 1 --2- 172.21.15.146:0/2497214272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03d809e950 0x7f03d81c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.913+0000 7f03d67fc700 1 -- 172.21.15.146:0/2497214272 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc0094a0 con 0x7f03d809f430 2023-10-03T10:18:56.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.913+0000 7f03d67fc700 1 --2- 172.21.15.146:0/2497214272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03d809f430 0x7f03d81c8760 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f03cc016000 tx=0x7f03cc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:56.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.913+0000 7f03bffff700 1 -- 172.21.15.146:0/2497214272 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc004240 con 0x7f03d809f430 2023-10-03T10:18:56.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.913+0000 7f03bffff700 1 -- 172.21.15.146:0/2497214272 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03cc01f070 con 0x7f03d809f430 2023-10-03T10:18:56.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.913+0000 7f03dd83e700 1 -- 172.21.15.146:0/2497214272 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d8123100 con 0x7f03d809f430 2023-10-03T10:18:56.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.913+0000 7f03bffff700 1 -- 172.21.15.146:0/2497214272 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc0045a0 con 0x7f03d809f430 2023-10-03T10:18:56.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.913+0000 7f03dd83e700 1 -- 172.21.15.146:0/2497214272 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d81240c0 con 0x7f03d809f430 2023-10-03T10:18:56.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.914+0000 7f03bffff700 1 -- 172.21.15.146:0/2497214272 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f03cc021030 con 0x7f03d809f430 2023-10-03T10:18:56.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.915+0000 7f03bffff700 1 -- 172.21.15.146:0/2497214272 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f03cc040690 con 0x7f03d809f430 2023-10-03T10:18:56.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.915+0000 7f03dd83e700 1 -- 172.21.15.146:0/2497214272 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d804f2a0 con 0x7f03d809f430 2023-10-03T10:18:56.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.922+0000 7f03bffff700 1 -- 172.21.15.146:0/2497214272 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f03cc015080 con 0x7f03d809f430 2023-10-03T10:18:56.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.961+0000 7ffbed0ca700 1 -- 172.21.15.146:0/1401221924 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffbe811feb0 con 0x7ffbe81300a0 2023-10-03T10:18:56.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.962+0000 7ffbcf7fe700 1 -- 172.21.15.146:0/1401221924 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ffbd801a420 con 0x7ffbe81300a0 2023-10-03T10:18:56.961 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:56.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.963+0000 7ffbed0ca700 1 -- 172.21.15.146:0/1401221924 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffbe81300a0 msgr2=0x7ffbe811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.964+0000 7ffbed0ca700 1 --2- 172.21.15.146:0/1401221924 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffbe81300a0 0x7ffbe811da40 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8009bc0 tx=0x7ffbd8004750 comp rx=0 tx=0).stop 2023-10-03T10:18:56.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.964+0000 7ffbed0ca700 1 -- 172.21.15.146:0/1401221924 shutdown_connections 2023-10-03T10:18:56.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.964+0000 7ffbed0ca700 1 --2- 172.21.15.146:0/1401221924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbe8133ad0 0x7ffbe811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.964+0000 7ffbed0ca700 1 --2- 172.21.15.146:0/1401221924 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ffbe81300a0 0x7ffbe811da40 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.964+0000 7ffbed0ca700 1 --2- 172.21.15.146:0/1401221924 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffbe8130bc0 0x7ffbe811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.964+0000 7ffbed0ca700 1 -- 172.21.15.146:0/1401221924 >> 172.21.15.146:0/1401221924 conn(0x7ffbe8099c40 msgr2=0x7ffbe8132c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:56.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.964+0000 7ffbed0ca700 1 -- 172.21.15.146:0/1401221924 shutdown_connections 2023-10-03T10:18:56.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:56.964+0000 7ffbed0ca700 1 -- 172.21.15.146:0/1401221924 wait complete. 2023-10-03T10:18:56.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:57.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.028+0000 7fb4bcad1700 1 -- 172.21.15.146:0/4238900194 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb4b81330a0 con 0x7fb4b8133ad0 2023-10-03T10:18:57.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.028+0000 7fb4a6ffd700 1 -- 172.21.15.146:0/4238900194 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb4b0018020 con 0x7fb4b8133ad0 2023-10-03T10:18:57.028 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:57.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.030+0000 7fb4bcad1700 1 -- 172.21.15.146:0/4238900194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4b8133ad0 msgr2=0x7fb4b811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.030+0000 7fb4bcad1700 1 --2- 172.21.15.146:0/4238900194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4b8133ad0 0x7fb4b811e4c0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0002230 tx=0x7fb4b000cf50 comp rx=0 tx=0).stop 2023-10-03T10:18:57.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.030+0000 7fb4bcad1700 1 -- 172.21.15.146:0/4238900194 shutdown_connections 2023-10-03T10:18:57.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.030+0000 7fb4bcad1700 1 --2- 172.21.15.146:0/4238900194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4b8133ad0 0x7fb4b811e4c0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.030+0000 7fb4bcad1700 1 --2- 172.21.15.146:0/4238900194 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb4b81300a0 0x7fb4b811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.030+0000 7fb4bcad1700 1 --2- 172.21.15.146:0/4238900194 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4b81309f0 0x7fb4b811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.030+0000 7fb4bcad1700 1 -- 172.21.15.146:0/4238900194 >> 172.21.15.146:0/4238900194 conn(0x7fb4b8099c40 msgr2=0x7fb4b8132990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.030+0000 7fb4bcad1700 1 -- 172.21.15.146:0/4238900194 shutdown_connections 2023-10-03T10:18:57.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.030+0000 7fb4bcad1700 1 -- 172.21.15.146:0/4238900194 wait complete. 2023-10-03T10:18:57.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:57.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.137+0000 7f03dd83e700 1 -- 172.21.15.146:0/2497214272 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f03d809b8b0 con 0x7f03d809f430 2023-10-03T10:18:57.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.137+0000 7f03bffff700 1 -- 172.21.15.146:0/2497214272 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f03cc01a450 con 0x7f03d809f430 2023-10-03T10:18:57.137 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:57.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.139+0000 7f03dd83e700 1 -- 172.21.15.146:0/2497214272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03d809f430 msgr2=0x7f03d81c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.139+0000 7f03dd83e700 1 --2- 172.21.15.146:0/2497214272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03d809f430 0x7f03d81c8760 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f03cc016000 tx=0x7f03cc004750 comp rx=0 tx=0).stop 2023-10-03T10:18:57.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.139+0000 7f03dd83e700 1 -- 172.21.15.146:0/2497214272 shutdown_connections 2023-10-03T10:18:57.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.139+0000 7f03dd83e700 1 --2- 172.21.15.146:0/2497214272 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f03d8137010 0x7f03d81c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.139+0000 7f03dd83e700 1 --2- 172.21.15.146:0/2497214272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03d809e950 0x7f03d81c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.139+0000 7f03dd83e700 1 --2- 172.21.15.146:0/2497214272 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03d809f430 0x7f03d81c8760 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.139+0000 7f03dd83e700 1 -- 172.21.15.146:0/2497214272 >> 172.21.15.146:0/2497214272 conn(0x7f03d80a0f70 msgr2=0x7f03d80708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.139+0000 7f03dd83e700 1 -- 172.21.15.146:0/2497214272 shutdown_connections 2023-10-03T10:18:57.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.139+0000 7f03dd83e700 1 -- 172.21.15.146:0/2497214272 wait complete. 2023-10-03T10:18:57.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:57.772 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:57.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.897+0000 7f199d5d0700 1 Processor -- start 2023-10-03T10:18:57.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.897+0000 7f199d5d0700 1 -- start start 2023-10-03T10:18:57.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.897+0000 7f199d5d0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f199806a770 0x7f1998130610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.897+0000 7f199d5d0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1998130b50 0x7f1998133610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.897+0000 7f199d5d0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1998133b50 0x7f1998133ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.897+0000 7f199d5d0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199806ab40 con 0x7f1998133b50 2023-10-03T10:18:57.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.897+0000 7f199d5d0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199806b580 con 0x7f1998130b50 2023-10-03T10:18:57.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.897+0000 7f199d5d0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19981300a0 con 0x7f199806a770 2023-10-03T10:18:57.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.897+0000 7f1996ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f199806a770 0x7f1998130610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.897+0000 7f19967fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1998130b50 0x7f1998133610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.897+0000 7f19977fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1998133b50 0x7f1998133ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.897+0000 7f19977fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1998133b50 0x7f1998133ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53596/0 (socket says 172.21.15.146:53596) 2023-10-03T10:18:57.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.897+0000 7f1996ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f199806a770 0x7f1998130610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53294/0 (socket says 172.21.15.146:53294) 2023-10-03T10:18:57.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.897+0000 7f19967fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1998130b50 0x7f1998133610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50502/0 (socket says 172.21.15.146:50502) 2023-10-03T10:18:57.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.897+0000 7f19977fe700 1 -- 172.21.15.146:0/4197788258 learned_addr learned my addr 172.21.15.146:0/4197788258 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:57.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.897+0000 7f19977fe700 1 -- 172.21.15.146:0/4197788258 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f199806a770 msgr2=0x7f1998130610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:57.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.897+0000 7f19977fe700 1 --2- 172.21.15.146:0/4197788258 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f199806a770 0x7f1998130610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.897+0000 7f19977fe700 1 -- 172.21.15.146:0/4197788258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1998130b50 msgr2=0x7f1998133610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:57.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.897+0000 7f19977fe700 1 --2- 172.21.15.146:0/4197788258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1998130b50 0x7f1998133610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.898+0000 7f19977fe700 1 -- 172.21.15.146:0/4197788258 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199809a500 con 0x7f1998133b50 2023-10-03T10:18:57.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.898+0000 7f1996ffd700 1 --2- 172.21.15.146:0/4197788258 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f199806a770 0x7f1998130610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:57.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.898+0000 7f19977fe700 1 --2- 172.21.15.146:0/4197788258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1998133b50 0x7f1998133ff0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f1990009e50 tx=0x7f199000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77060df800e7b405 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:57.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.898+0000 7f1995ffb700 1 -- 172.21.15.146:0/4197788258 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199000e070 con 0x7f1998133b50 2023-10-03T10:18:57.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.898+0000 7f1995ffb700 1 -- 172.21.15.146:0/4197788258 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199000b910 con 0x7f1998133b50 2023-10-03T10:18:57.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.898+0000 7f1995ffb700 1 -- 172.21.15.146:0/4197788258 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199000bcc0 con 0x7f1998133b50 2023-10-03T10:18:57.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.898+0000 7f199d5d0700 1 -- 172.21.15.146:0/4197788258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1998133b50 msgr2=0x7f1998133ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.898+0000 7f199d5d0700 1 --2- 172.21.15.146:0/4197788258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1998133b50 0x7f1998133ff0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f1990009e50 tx=0x7f199000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:57.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.898+0000 7f199d5d0700 1 -- 172.21.15.146:0/4197788258 shutdown_connections 2023-10-03T10:18:57.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.898+0000 7f199d5d0700 1 --2- 172.21.15.146:0/4197788258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1998133b50 0x7f1998133ff0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.898+0000 7f199d5d0700 1 --2- 172.21.15.146:0/4197788258 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f199806a770 0x7f1998130610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.898+0000 7f199d5d0700 1 --2- 172.21.15.146:0/4197788258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1998130b50 0x7f1998133610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.898+0000 7f199d5d0700 1 -- 172.21.15.146:0/4197788258 >> 172.21.15.146:0/4197788258 conn(0x7f1998099c40 msgr2=0x7f19980a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.898+0000 7f199d5d0700 1 -- 172.21.15.146:0/4197788258 shutdown_connections 2023-10-03T10:18:57.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.898+0000 7f199d5d0700 1 -- 172.21.15.146:0/4197788258 wait complete. 2023-10-03T10:18:57.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.899+0000 7f199d5d0700 1 Processor -- start 2023-10-03T10:18:57.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.900+0000 7f199d5d0700 1 -- start start 2023-10-03T10:18:57.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.900+0000 7f199d5d0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f199806a770 0x7f199811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.900+0000 7f199d5d0700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1998130b50 0x7f199811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.900+0000 7f199d5d0700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1998133b50 0x7f199811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.900+0000 7f199d5d0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19981201f0 con 0x7f199806a770 2023-10-03T10:18:57.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.900+0000 7f199d5d0700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199812dd00 con 0x7f1998130b50 2023-10-03T10:18:57.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.900+0000 7f199d5d0700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19980a0850 con 0x7f1998133b50 2023-10-03T10:18:57.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.900+0000 7f19977fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1998133b50 0x7f199811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.900+0000 7f1996ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f199806a770 0x7f199811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.900+0000 7f19977fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1998133b50 0x7f199811e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53308/0 (socket says 172.21.15.146:53308) 2023-10-03T10:18:57.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.900+0000 7f19977fe700 1 -- 172.21.15.146:0/2563589455 learned_addr learned my addr 172.21.15.146:0/2563589455 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:57.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.900+0000 7f19967fc700 1 --2- 172.21.15.146:0/2563589455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1998130b50 0x7f199811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.900+0000 7f19977fe700 1 -- 172.21.15.146:0/2563589455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1998130b50 msgr2=0x7f199811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.900+0000 7f19977fe700 1 --2- 172.21.15.146:0/2563589455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1998130b50 0x7f199811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.900+0000 7f19977fe700 1 -- 172.21.15.146:0/2563589455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f199806a770 msgr2=0x7f199811da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.900+0000 7f19977fe700 1 --2- 172.21.15.146:0/2563589455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f199806a770 0x7f199811da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.900+0000 7f19977fe700 1 -- 172.21.15.146:0/2563589455 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19800094a0 con 0x7f1998133b50 2023-10-03T10:18:57.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.900+0000 7f19967fc700 1 --2- 172.21.15.146:0/2563589455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1998130b50 0x7f199811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:57.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.900+0000 7f1996ffd700 1 --2- 172.21.15.146:0/2563589455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f199806a770 0x7f199811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:57.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.901+0000 7f19977fe700 1 --2- 172.21.15.146:0/2563589455 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1998133b50 0x7f199811e4c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f19981345c0 tx=0x7f1990004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:57.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.901+0000 7f198f7fe700 1 -- 172.21.15.146:0/2563589455 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1990004450 con 0x7f1998133b50 2023-10-03T10:18:57.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.901+0000 7f198f7fe700 1 -- 172.21.15.146:0/2563589455 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19900045d0 con 0x7f1998133b50 2023-10-03T10:18:57.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.901+0000 7f199d5d0700 1 -- 172.21.15.146:0/2563589455 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1990009b30 con 0x7f1998133b50 2023-10-03T10:18:57.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.901+0000 7f198f7fe700 1 -- 172.21.15.146:0/2563589455 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19900092e0 con 0x7f1998133b50 2023-10-03T10:18:57.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.901+0000 7f199d5d0700 1 -- 172.21.15.146:0/2563589455 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199811eb50 con 0x7f1998133b50 2023-10-03T10:18:57.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.901+0000 7f198f7fe700 1 -- 172.21.15.146:0/2563589455 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1990025460 con 0x7f1998133b50 2023-10-03T10:18:57.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.902+0000 7f198f7fe700 1 -- 172.21.15.146:0/2563589455 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1990041090 con 0x7f1998133b50 2023-10-03T10:18:57.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.902+0000 7f199d5d0700 1 -- 172.21.15.146:0/2563589455 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199804f2a0 con 0x7f1998133b50 2023-10-03T10:18:57.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:57.906+0000 7f198f7fe700 1 -- 172.21.15.146:0/2563589455 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1990025710 con 0x7f1998133b50 2023-10-03T10:18:57.982 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:58.043 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:58.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.097+0000 7f199d5d0700 1 -- 172.21.15.146:0/2563589455 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f199809d430 con 0x7f1998133b50 2023-10-03T10:18:58.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.098+0000 7f198f7fe700 1 -- 172.21.15.146:0/2563589455 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f199001bb50 con 0x7f1998133b50 2023-10-03T10:18:58.097 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.100+0000 7f199d5d0700 1 -- 172.21.15.146:0/2563589455 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1998133b50 msgr2=0x7f199811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.100+0000 7f199d5d0700 1 --2- 172.21.15.146:0/2563589455 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1998133b50 0x7f199811e4c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f19981345c0 tx=0x7f1990004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.100+0000 7f199d5d0700 1 -- 172.21.15.146:0/2563589455 shutdown_connections 2023-10-03T10:18:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.100+0000 7f199d5d0700 1 --2- 172.21.15.146:0/2563589455 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1998133b50 0x7f199811e4c0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.100+0000 7f199d5d0700 1 --2- 172.21.15.146:0/2563589455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f199806a770 0x7f199811da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.100+0000 7f199d5d0700 1 --2- 172.21.15.146:0/2563589455 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1998130b50 0x7f199811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.100+0000 7f199d5d0700 1 -- 172.21.15.146:0/2563589455 >> 172.21.15.146:0/2563589455 conn(0x7f1998099c40 msgr2=0x7f19980a0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.100+0000 7f199d5d0700 1 -- 172.21.15.146:0/2563589455 shutdown_connections 2023-10-03T10:18:58.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.100+0000 7f199d5d0700 1 -- 172.21.15.146:0/2563589455 wait complete. 2023-10-03T10:18:58.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.111+0000 7fbc89286700 1 Processor -- start 2023-10-03T10:18:58.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.111+0000 7fbc89286700 1 -- start start 2023-10-03T10:18:58.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.112+0000 7fbc89286700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc8406a770 0x7fbc8406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.112+0000 7fbc89286700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc8406b080 0x7fbc841317b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.112+0000 7fbc89286700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc8409da80 con 0x7fbc84131cf0 2023-10-03T10:18:58.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.112+0000 7fbc89286700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8409dce0 con 0x7fbc8406a770 2023-10-03T10:18:58.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.112+0000 7fbc89286700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8409eb20 con 0x7fbc8406b080 2023-10-03T10:18:58.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.112+0000 7fbc82ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc8406a770 0x7fbc8406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.112+0000 7fbc82ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc8406a770 0x7fbc8406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50518/0 (socket says 172.21.15.146:50518) 2023-10-03T10:18:58.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.112+0000 7fbc82ffd700 1 -- 172.21.15.146:0/1979030248 learned_addr learned my addr 172.21.15.146:0/1979030248 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:58.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.112+0000 7fbc827fc700 1 --2- 172.21.15.146:0/1979030248 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc8406b080 0x7fbc841317b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.112+0000 7fbc82ffd700 1 -- 172.21.15.146:0/1979030248 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc8406b080 msgr2=0x7fbc841317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:58.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.112+0000 7fbc82ffd700 1 --2- 172.21.15.146:0/1979030248 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc8406b080 0x7fbc841317b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.112+0000 7fbc82ffd700 1 -- 172.21.15.146:0/1979030248 >> v1:172.21.15.146:6789/0 conn(0x7fbc84131cf0 legacy=0x7fbc84138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.112+0000 7fbc82ffd700 1 -- 172.21.15.146:0/1979030248 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8409d860 con 0x7fbc8406a770 2023-10-03T10:18:58.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.112+0000 7fbc82ffd700 1 --2- 172.21.15.146:0/1979030248 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc8406a770 0x7fbc8406ab40 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009950 tx=0x7fbc74009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=822fc207921a3dc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.112+0000 7fbc81ffb700 1 -- 172.21.15.146:0/1979030248 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74011830 con 0x7fbc8406a770 2023-10-03T10:18:58.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.112+0000 7fbc81ffb700 1 -- 172.21.15.146:0/1979030248 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc74011990 con 0x7fbc8406a770 2023-10-03T10:18:58.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.112+0000 7fbc81ffb700 1 -- 172.21.15.146:0/1979030248 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74011d40 con 0x7fbc8406a770 2023-10-03T10:18:58.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.113+0000 7fbc89286700 1 -- 172.21.15.146:0/1979030248 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc8406a770 msgr2=0x7fbc8406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.113+0000 7fbc89286700 1 --2- 172.21.15.146:0/1979030248 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc8406a770 0x7fbc8406ab40 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009950 tx=0x7fbc74009c60 comp rx=0 tx=0).stop 2023-10-03T10:18:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.113+0000 7fbc89286700 1 -- 172.21.15.146:0/1979030248 shutdown_connections 2023-10-03T10:18:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.113+0000 7fbc89286700 1 --2- 172.21.15.146:0/1979030248 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc8406a770 0x7fbc8406ab40 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.113+0000 7fbc89286700 1 --2- 172.21.15.146:0/1979030248 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc8406b080 0x7fbc841317b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.113+0000 7fbc89286700 1 -- 172.21.15.146:0/1979030248 >> 172.21.15.146:0/1979030248 conn(0x7fbc84099c40 msgr2=0x7fbc840a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.114+0000 7fbc89286700 1 -- 172.21.15.146:0/1979030248 shutdown_connections 2023-10-03T10:18:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.114+0000 7fbc89286700 1 -- 172.21.15.146:0/1979030248 wait complete. 2023-10-03T10:18:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.115+0000 7fbc89286700 1 Processor -- start 2023-10-03T10:18:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.115+0000 7fbc89286700 1 -- start start 2023-10-03T10:18:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.115+0000 7fbc89286700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc8406a770 0x7fbc8411f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.115+0000 7fbc89286700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8406b080 0x7fbc8411f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.115+0000 7fbc89286700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc84131cf0 0x7fbc8411fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.115+0000 7fbc89286700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc84122e80 con 0x7fbc8406b080 2023-10-03T10:18:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.115+0000 7fbc89286700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc84120f70 con 0x7fbc84131cf0 2023-10-03T10:18:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.115+0000 7fbc89286700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8409a150 con 0x7fbc8406a770 2023-10-03T10:18:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.115+0000 7fbc82ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc8406a770 0x7fbc8411f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.115+0000 7fbc82ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc8406a770 0x7fbc8411f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53324/0 (socket says 172.21.15.146:53324) 2023-10-03T10:18:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.115+0000 7fbc82ffd700 1 -- 172.21.15.146:0/3522140726 learned_addr learned my addr 172.21.15.146:0/3522140726 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.115+0000 7fbc837fe700 1 --2- 172.21.15.146:0/3522140726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc84131cf0 0x7fbc8411fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.115+0000 7fbc827fc700 1 --2- 172.21.15.146:0/3522140726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8406b080 0x7fbc8411f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.115+0000 7fbc82ffd700 1 -- 172.21.15.146:0/3522140726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc84131cf0 msgr2=0x7fbc8411fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.115+0000 7fbc82ffd700 1 --2- 172.21.15.146:0/3522140726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc84131cf0 0x7fbc8411fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.115+0000 7fbc82ffd700 1 -- 172.21.15.146:0/3522140726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8406b080 msgr2=0x7fbc8411f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.115+0000 7fbc82ffd700 1 --2- 172.21.15.146:0/3522140726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8406b080 0x7fbc8411f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.115+0000 7fbc82ffd700 1 -- 172.21.15.146:0/3522140726 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc74009550 con 0x7fbc8406a770 2023-10-03T10:18:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.116+0000 7fbc82ffd700 1 --2- 172.21.15.146:0/3522140726 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc8406a770 0x7fbc8411f400 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fbc8409dc10 tx=0x7fbc74004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.116+0000 7fbc6b7fe700 1 -- 172.21.15.146:0/3522140726 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74004240 con 0x7fbc8406a770 2023-10-03T10:18:58.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.116+0000 7fbc6b7fe700 1 -- 172.21.15.146:0/3522140726 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7401f070 con 0x7fbc8406a770 2023-10-03T10:18:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.116+0000 7fbc89286700 1 -- 172.21.15.146:0/3522140726 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc84071e10 con 0x7fbc8406a770 2023-10-03T10:18:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.116+0000 7fbc6b7fe700 1 -- 172.21.15.146:0/3522140726 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc740045e0 con 0x7fbc8406a770 2023-10-03T10:18:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.116+0000 7fbc89286700 1 -- 172.21.15.146:0/3522140726 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc84123610 con 0x7fbc8406a770 2023-10-03T10:18:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.117+0000 7fbc6b7fe700 1 -- 172.21.15.146:0/3522140726 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbc74021030 con 0x7fbc8406a770 2023-10-03T10:18:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.117+0000 7fbc6b7fe700 1 -- 172.21.15.146:0/3522140726 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fbc74040830 con 0x7fbc8406a770 2023-10-03T10:18:58.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.117+0000 7fbc89286700 1 -- 172.21.15.146:0/3522140726 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc8406be10 con 0x7fbc8406a770 2023-10-03T10:18:58.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.122+0000 7fbc6b7fe700 1 -- 172.21.15.146:0/3522140726 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbc7401a450 con 0x7fbc8406a770 2023-10-03T10:18:58.152 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.175+0000 7f337365e700 1 Processor -- start 2023-10-03T10:18:58.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.175+0000 7f337365e700 1 -- start start 2023-10-03T10:18:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.176+0000 7f337365e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f336c09ad40 0x7f336c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.176+0000 7f337365e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f336c133f70 0x7f336c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.176+0000 7f337365e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f336c0a0a70 0x7f336c0a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.176+0000 7f337365e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f336c0a3b60 con 0x7f336c0a0a70 2023-10-03T10:18:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.176+0000 7f337365e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336c1348e0 con 0x7f336c09ad40 2023-10-03T10:18:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.176+0000 7f337365e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f336c09b110 con 0x7f336c133f70 2023-10-03T10:18:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.176+0000 7f3370bf9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f336c133f70 0x7f336c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.176+0000 7f3370bf9700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f336c133f70 0x7f336c1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53326/0 (socket says 172.21.15.146:53326) 2023-10-03T10:18:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.176+0000 7f3371bfb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f336c0a0a70 0x7f336c0a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.176+0000 7f3370bf9700 1 -- 172.21.15.146:0/1127291500 learned_addr learned my addr 172.21.15.146:0/1127291500 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.176+0000 7f33713fa700 1 --2- 172.21.15.146:0/1127291500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f336c09ad40 0x7f336c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.176+0000 7f3370bf9700 1 -- 172.21.15.146:0/1127291500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f336c09ad40 msgr2=0x7f336c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.176+0000 7f3370bf9700 1 --2- 172.21.15.146:0/1127291500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f336c09ad40 0x7f336c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.176+0000 7f3370bf9700 1 -- 172.21.15.146:0/1127291500 >> v2:172.21.15.146:3300/0 conn(0x7f336c0a0a70 msgr2=0x7f336c0a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:58.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.176+0000 7f3370bf9700 1 --2- 172.21.15.146:0/1127291500 >> v2:172.21.15.146:3300/0 conn(0x7f336c0a0a70 0x7f336c0a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.176+0000 7f3370bf9700 1 -- 172.21.15.146:0/1127291500 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c0a2fa0 con 0x7f336c133f70 2023-10-03T10:18:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.177+0000 7f3370bf9700 1 --2- 172.21.15.146:0/1127291500 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f336c133f70 0x7f336c1343a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f33680098f0 tx=0x7f3368009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0df1c6bcc0d446e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.177+0000 7f3363fff700 1 -- 172.21.15.146:0/1127291500 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3368011830 con 0x7f336c133f70 2023-10-03T10:18:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.177+0000 7f3363fff700 1 -- 172.21.15.146:0/1127291500 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3368011990 con 0x7f336c133f70 2023-10-03T10:18:58.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.177+0000 7f3363fff700 1 -- 172.21.15.146:0/1127291500 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3368011d20 con 0x7f336c133f70 2023-10-03T10:18:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.177+0000 7f337365e700 1 -- 172.21.15.146:0/1127291500 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f336c133f70 msgr2=0x7f336c1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.177+0000 7f337365e700 1 --2- 172.21.15.146:0/1127291500 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f336c133f70 0x7f336c1343a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f33680098f0 tx=0x7f3368009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.177+0000 7f337365e700 1 -- 172.21.15.146:0/1127291500 shutdown_connections 2023-10-03T10:18:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.177+0000 7f337365e700 1 --2- 172.21.15.146:0/1127291500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f336c09ad40 0x7f336c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.177+0000 7f337365e700 1 --2- 172.21.15.146:0/1127291500 >> v2:172.21.15.146:3300/0 conn(0x7f336c0a0a70 0x7f336c0a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.177+0000 7f337365e700 1 --2- 172.21.15.146:0/1127291500 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f336c133f70 0x7f336c1343a0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.177+0000 7f337365e700 1 -- 172.21.15.146:0/1127291500 >> 172.21.15.146:0/1127291500 conn(0x7f336c099c40 msgr2=0x7f336c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.178+0000 7f337365e700 1 -- 172.21.15.146:0/1127291500 shutdown_connections 2023-10-03T10:18:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.178+0000 7f337365e700 1 -- 172.21.15.146:0/1127291500 wait complete. 2023-10-03T10:18:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.178+0000 7f337365e700 1 Processor -- start 2023-10-03T10:18:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.179+0000 7f337365e700 1 -- start start 2023-10-03T10:18:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.179+0000 7f337365e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f336c09ad40 0x7f336c1225c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.179+0000 7f337365e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f336c0a0a70 0x7f336c122b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.179+0000 7f337365e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f336c123040 0x7f336c1cea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.179+0000 7f337365e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c123a90 con 0x7f336c0a0a70 2023-10-03T10:18:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.179+0000 7f337365e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336c1260e0 con 0x7f336c123040 2023-10-03T10:18:58.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.179+0000 7f337365e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f336c1241d0 con 0x7f336c09ad40 2023-10-03T10:18:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.179+0000 7f3371bfb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f336c123040 0x7f336c1cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.179+0000 7f3371bfb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f336c123040 0x7f336c1cea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50556/0 (socket says 172.21.15.146:50556) 2023-10-03T10:18:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.179+0000 7f3371bfb700 1 -- 172.21.15.146:0/317153027 learned_addr learned my addr 172.21.15.146:0/317153027 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.179+0000 7f3370bf9700 1 --2- 172.21.15.146:0/317153027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f336c0a0a70 0x7f336c122b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.179+0000 7f33713fa700 1 --2- 172.21.15.146:0/317153027 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f336c09ad40 0x7f336c1225c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.180+0000 7f3370bf9700 1 -- 172.21.15.146:0/317153027 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f336c09ad40 msgr2=0x7f336c1225c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.180+0000 7f3370bf9700 1 --2- 172.21.15.146:0/317153027 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f336c09ad40 0x7f336c1225c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.180+0000 7f3370bf9700 1 -- 172.21.15.146:0/317153027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f336c123040 msgr2=0x7f336c1cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.180+0000 7f3370bf9700 1 --2- 172.21.15.146:0/317153027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f336c123040 0x7f336c1cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.180+0000 7f3370bf9700 1 -- 172.21.15.146:0/317153027 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3368009550 con 0x7f336c0a0a70 2023-10-03T10:18:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.180+0000 7f3371bfb700 1 --2- 172.21.15.146:0/317153027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f336c123040 0x7f336c1cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.180+0000 7f3370bf9700 1 --2- 172.21.15.146:0/317153027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f336c0a0a70 0x7f336c122b00 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f336c06bec0 tx=0x7f3368004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.180+0000 7f3361ffb700 1 -- 172.21.15.146:0/317153027 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3368004450 con 0x7f336c0a0a70 2023-10-03T10:18:58.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.180+0000 7f3361ffb700 1 -- 172.21.15.146:0/317153027 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33680045b0 con 0x7f336c0a0a70 2023-10-03T10:18:58.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.180+0000 7f337365e700 1 -- 172.21.15.146:0/317153027 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f336c09d360 con 0x7f336c0a0a70 2023-10-03T10:18:58.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.180+0000 7f3361ffb700 1 -- 172.21.15.146:0/317153027 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33680038e0 con 0x7f336c0a0a70 2023-10-03T10:18:58.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.181+0000 7f337365e700 1 -- 172.21.15.146:0/317153027 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336c1330e0 con 0x7f336c0a0a70 2023-10-03T10:18:58.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.182+0000 7f337365e700 1 -- 172.21.15.146:0/317153027 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f336c125aa0 con 0x7f336c0a0a70 2023-10-03T10:18:58.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.182+0000 7f3361ffb700 1 -- 172.21.15.146:0/317153027 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3368003a40 con 0x7f336c0a0a70 2023-10-03T10:18:58.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.182+0000 7f3361ffb700 1 -- 172.21.15.146:0/317153027 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3368021030 con 0x7f336c0a0a70 2023-10-03T10:18:58.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.187+0000 7f3361ffb700 1 -- 172.21.15.146:0/317153027 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f336c125aa0 con 0x7f336c0a0a70 2023-10-03T10:18:58.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.280+0000 7f8c226f6700 1 Processor -- start 2023-10-03T10:18:58.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.280+0000 7f8c226f6700 1 -- start start 2023-10-03T10:18:58.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.281+0000 7f8c226f6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c1c066410 0x7f8c1c1319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.281+0000 7f8c226f6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c1c131f30 0x7f8c1c09c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.281+0000 7f8c226f6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1c0a0f20 con 0x7f8c1c1314b0 2023-10-03T10:18:58.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.281+0000 7f8c226f6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c0667e0 con 0x7f8c1c066410 2023-10-03T10:18:58.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.281+0000 7f8c226f6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c0a23c0 con 0x7f8c1c131f30 2023-10-03T10:18:58.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.281+0000 7f8c1b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8c1c1314b0 0x7f8c1c09bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55322/0 (socket says 172.21.15.146:55322) 2023-10-03T10:18:58.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.281+0000 7f8c1b7fe700 1 -- 172.21.15.146:0/2395197027 learned_addr learned my addr 172.21.15.146:0/2395197027 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:58.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.281+0000 7f8c20c93700 1 --2- 172.21.15.146:0/2395197027 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c1c131f30 0x7f8c1c09c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.281+0000 7f8c1bfff700 1 --2- 172.21.15.146:0/2395197027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c1c066410 0x7f8c1c1319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.281+0000 7f8c1affd700 1 -- 172.21.15.146:0/2395197027 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644744609 0 0) 0x7f8c1c0a0f20 con 0x7f8c1c1314b0 2023-10-03T10:18:58.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.281+0000 7f8c1affd700 1 -- 172.21.15.146:0/2395197027 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c040035b0 con 0x7f8c1c1314b0 2023-10-03T10:18:58.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.281+0000 7f8c1bfff700 1 -- 172.21.15.146:0/2395197027 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c1c131f30 msgr2=0x7f8c1c09c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:58.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.281+0000 7f8c1bfff700 1 --2- 172.21.15.146:0/2395197027 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c1c131f30 0x7f8c1c09c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.281+0000 7f8c1bfff700 1 -- 172.21.15.146:0/2395197027 >> v1:172.21.15.146:6789/0 conn(0x7f8c1c1314b0 legacy=0x7f8c1c09bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.281+0000 7f8c1bfff700 1 -- 172.21.15.146:0/2395197027 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c1323b0 con 0x7f8c1c066410 2023-10-03T10:18:58.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.281+0000 7f8c20c93700 1 --2- 172.21.15.146:0/2395197027 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c1c131f30 0x7f8c1c09c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:58.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.281+0000 7f8c1bfff700 1 --2- 172.21.15.146:0/2395197027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c1c066410 0x7f8c1c1319f0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c009880 tx=0x7f8c0c009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95c7c0df83728449 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.282+0000 7f8c1affd700 1 -- 172.21.15.146:0/2395197027 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c005e30 con 0x7f8c1c066410 2023-10-03T10:18:58.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.282+0000 7f8c1affd700 1 -- 172.21.15.146:0/2395197027 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c006030 con 0x7f8c1c066410 2023-10-03T10:18:58.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.282+0000 7f8c1affd700 1 -- 172.21.15.146:0/2395197027 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c0063a0 con 0x7f8c1c066410 2023-10-03T10:18:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.282+0000 7f8c226f6700 1 -- 172.21.15.146:0/2395197027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c1c066410 msgr2=0x7f8c1c1319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.282+0000 7f8c226f6700 1 --2- 172.21.15.146:0/2395197027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c1c066410 0x7f8c1c1319f0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c009880 tx=0x7f8c0c009b90 comp rx=0 tx=0).stop 2023-10-03T10:18:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.282+0000 7f8c226f6700 1 -- 172.21.15.146:0/2395197027 shutdown_connections 2023-10-03T10:18:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.282+0000 7f8c226f6700 1 --2- 172.21.15.146:0/2395197027 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c1c131f30 0x7f8c1c09c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.282+0000 7f8c226f6700 1 --2- 172.21.15.146:0/2395197027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c1c066410 0x7f8c1c1319f0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.282+0000 7f8c226f6700 1 -- 172.21.15.146:0/2395197027 >> 172.21.15.146:0/2395197027 conn(0x7f8c1c0a2980 msgr2=0x7f8c1c0a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.283+0000 7f8c226f6700 1 -- 172.21.15.146:0/2395197027 shutdown_connections 2023-10-03T10:18:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.283+0000 7f8c226f6700 1 -- 172.21.15.146:0/2395197027 wait complete. 2023-10-03T10:18:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.283+0000 7f8c226f6700 1 Processor -- start 2023-10-03T10:18:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.284+0000 7f8c226f6700 1 -- start start 2023-10-03T10:18:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.284+0000 7f8c226f6700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c1c066410 0x7f8c1c1376b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.284+0000 7f8c226f6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c1c1314b0 0x7f8c1c137bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.284+0000 7f8c226f6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c1c131f30 0x7f8c1c138130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.284+0000 7f8c226f6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c12efc0 con 0x7f8c1c131f30 2023-10-03T10:18:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.284+0000 7f8c226f6700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c119230 con 0x7f8c1c1314b0 2023-10-03T10:18:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.284+0000 7f8c226f6700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c1199e0 con 0x7f8c1c066410 2023-10-03T10:18:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.284+0000 7f8c1bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c1c066410 0x7f8c1c1376b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.284+0000 7f8c1bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c1c066410 0x7f8c1c1376b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53360/0 (socket says 172.21.15.146:53360) 2023-10-03T10:18:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.284+0000 7f8c20c93700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c1c131f30 0x7f8c1c138130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.284+0000 7f8c1bfff700 1 -- 172.21.15.146:0/3711809934 learned_addr learned my addr 172.21.15.146:0/3711809934 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.284+0000 7f8c1b7fe700 1 --2- 172.21.15.146:0/3711809934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c1c1314b0 0x7f8c1c137bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.284+0000 7f8c20c93700 1 -- 172.21.15.146:0/3711809934 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c1c066410 msgr2=0x7f8c1c1376b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.284+0000 7f8c20c93700 1 --2- 172.21.15.146:0/3711809934 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c1c066410 0x7f8c1c1376b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.284+0000 7f8c20c93700 1 -- 172.21.15.146:0/3711809934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c1c1314b0 msgr2=0x7f8c1c137bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.284+0000 7f8c20c93700 1 --2- 172.21.15.146:0/3711809934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c1c1314b0 0x7f8c1c137bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.284+0000 7f8c20c93700 1 -- 172.21.15.146:0/3711809934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c14009a70 con 0x7f8c1c131f30 2023-10-03T10:18:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.284+0000 7f8c1bfff700 1 --2- 172.21.15.146:0/3711809934 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c1c066410 0x7f8c1c1376b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.285+0000 7f8c20c93700 1 --2- 172.21.15.146:0/3711809934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c1c131f30 0x7f8c1c138130 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009e50 tx=0x7f8c1400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.285+0000 7f8c18ff9700 1 -- 172.21.15.146:0/3711809934 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1400ca90 con 0x7f8c1c131f30 2023-10-03T10:18:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.285+0000 7f8c18ff9700 1 -- 172.21.15.146:0/3711809934 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1400f040 con 0x7f8c1c131f30 2023-10-03T10:18:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.285+0000 7f8c226f6700 1 -- 172.21.15.146:0/3711809934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0c009430 con 0x7f8c1c131f30 2023-10-03T10:18:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.285+0000 7f8c18ff9700 1 -- 172.21.15.146:0/3711809934 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1400ce50 con 0x7f8c1c131f30 2023-10-03T10:18:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.285+0000 7f8c226f6700 1 -- 172.21.15.146:0/3711809934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1c11a410 con 0x7f8c1c131f30 2023-10-03T10:18:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.286+0000 7f8c18ff9700 1 -- 172.21.15.146:0/3711809934 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c14014480 con 0x7f8c1c131f30 2023-10-03T10:18:58.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.286+0000 7f8c18ff9700 1 -- 172.21.15.146:0/3711809934 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8c1403fb30 con 0x7f8c1c131f30 2023-10-03T10:18:58.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.286+0000 7f8c226f6700 1 -- 172.21.15.146:0/3711809934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c1c11a410 con 0x7f8c1c131f30 2023-10-03T10:18:58.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.291+0000 7f8c18ff9700 1 -- 172.21.15.146:0/3711809934 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c1c11a410 con 0x7f8c1c131f30 2023-10-03T10:18:58.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.321+0000 7fbc89286700 1 -- 172.21.15.146:0/3522140726 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbc840a07d0 con 0x7fbc8406a770 2023-10-03T10:18:58.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.321+0000 7fbc6b7fe700 1 -- 172.21.15.146:0/3522140726 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbc74015020 con 0x7fbc8406a770 2023-10-03T10:18:58.321 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:58.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.323+0000 7fbc89286700 1 -- 172.21.15.146:0/3522140726 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc8406a770 msgr2=0x7fbc8411f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.324+0000 7fbc89286700 1 --2- 172.21.15.146:0/3522140726 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc8406a770 0x7fbc8411f400 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fbc8409dc10 tx=0x7fbc74004750 comp rx=0 tx=0).stop 2023-10-03T10:18:58.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.324+0000 7fbc89286700 1 -- 172.21.15.146:0/3522140726 shutdown_connections 2023-10-03T10:18:58.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.324+0000 7fbc89286700 1 --2- 172.21.15.146:0/3522140726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbc84131cf0 0x7fbc8411fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.324+0000 7fbc89286700 1 --2- 172.21.15.146:0/3522140726 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fbc8406a770 0x7fbc8411f400 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.324+0000 7fbc89286700 1 --2- 172.21.15.146:0/3522140726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc8406b080 0x7fbc8411f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.324+0000 7fbc89286700 1 -- 172.21.15.146:0/3522140726 >> 172.21.15.146:0/3522140726 conn(0x7fbc84099c40 msgr2=0x7fbc84071410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.324+0000 7fbc89286700 1 -- 172.21.15.146:0/3522140726 shutdown_connections 2023-10-03T10:18:58.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.324+0000 7fbc89286700 1 -- 172.21.15.146:0/3522140726 wait complete. 2023-10-03T10:18:58.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:58.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.384+0000 7f337365e700 1 -- 172.21.15.146:0/317153027 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f336c125aa0 con 0x7f336c0a0a70 2023-10-03T10:18:58.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.384+0000 7f3361ffb700 1 -- 172.21.15.146:0/317153027 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f336c125aa0 con 0x7f336c0a0a70 2023-10-03T10:18:58.384 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:58.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.386+0000 7f337365e700 1 -- 172.21.15.146:0/317153027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f336c0a0a70 msgr2=0x7f336c122b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.386+0000 7f337365e700 1 --2- 172.21.15.146:0/317153027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f336c0a0a70 0x7f336c122b00 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f336c06bec0 tx=0x7f3368004750 comp rx=0 tx=0).stop 2023-10-03T10:18:58.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.386+0000 7f337365e700 1 -- 172.21.15.146:0/317153027 shutdown_connections 2023-10-03T10:18:58.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.386+0000 7f337365e700 1 --2- 172.21.15.146:0/317153027 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f336c123040 0x7f336c1cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.386+0000 7f337365e700 1 --2- 172.21.15.146:0/317153027 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f336c09ad40 0x7f336c1225c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.386+0000 7f337365e700 1 --2- 172.21.15.146:0/317153027 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f336c0a0a70 0x7f336c122b00 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.386+0000 7f337365e700 1 -- 172.21.15.146:0/317153027 >> 172.21.15.146:0/317153027 conn(0x7f336c099c40 msgr2=0x7f336c09d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.386+0000 7f337365e700 1 -- 172.21.15.146:0/317153027 shutdown_connections 2023-10-03T10:18:58.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.386+0000 7f337365e700 1 -- 172.21.15.146:0/317153027 wait complete. 2023-10-03T10:18:58.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:58.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.481+0000 7f8c226f6700 1 -- 172.21.15.146:0/3711809934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8c1c11a410 con 0x7f8c1c131f30 2023-10-03T10:18:58.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.482+0000 7f8c18ff9700 1 -- 172.21.15.146:0/3711809934 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c1c11a410 con 0x7f8c1c131f30 2023-10-03T10:18:58.481 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:58.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.484+0000 7f8c226f6700 1 -- 172.21.15.146:0/3711809934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c1c131f30 msgr2=0x7f8c1c138130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.484+0000 7f8c226f6700 1 --2- 172.21.15.146:0/3711809934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c1c131f30 0x7f8c1c138130 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009e50 tx=0x7f8c1400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.484+0000 7f8c226f6700 1 -- 172.21.15.146:0/3711809934 shutdown_connections 2023-10-03T10:18:58.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.484+0000 7f8c226f6700 1 --2- 172.21.15.146:0/3711809934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c1c131f30 0x7f8c1c138130 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.484+0000 7f8c226f6700 1 --2- 172.21.15.146:0/3711809934 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8c1c066410 0x7f8c1c1376b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.484+0000 7f8c226f6700 1 --2- 172.21.15.146:0/3711809934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8c1c1314b0 0x7f8c1c137bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.484+0000 7f8c226f6700 1 -- 172.21.15.146:0/3711809934 >> 172.21.15.146:0/3711809934 conn(0x7f8c1c0a2980 msgr2=0x7f8c1c130240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.484+0000 7f8c226f6700 1 -- 172.21.15.146:0/3711809934 shutdown_connections 2023-10-03T10:18:58.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:58.484+0000 7f8c226f6700 1 -- 172.21.15.146:0/3711809934 wait complete. 2023-10-03T10:18:58.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:18:59.116 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:59.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.240+0000 7ff0affd3700 1 Processor -- start 2023-10-03T10:18:59.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.240+0000 7ff0affd3700 1 -- start start 2023-10-03T10:18:59.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.241+0000 7ff0affd3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0a809f350 0x7ff0a8136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.241+0000 7ff0affd3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0a81371c0 0x7ff0a81395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.241+0000 7ff0affd3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a809c970 con 0x7ff0a809e870 2023-10-03T10:18:59.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.241+0000 7ff0affd3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a80a0920 con 0x7ff0a809f350 2023-10-03T10:18:59.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.241+0000 7ff0affd3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a809f9c0 con 0x7ff0a81371c0 2023-10-03T10:18:59.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.241+0000 7ff0ad56e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0a809f350 0x7ff0a8136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.241+0000 7ff0ae570700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0a81371c0 0x7ff0a81395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.241+0000 7ff0ad56e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0a809f350 0x7ff0a8136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50592/0 (socket says 172.21.15.146:50592) 2023-10-03T10:18:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.241+0000 7ff0add6f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff0a809e870 0x7ff0a809ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55328/0 (socket says 172.21.15.146:55328) 2023-10-03T10:18:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.241+0000 7ff0ad56e700 1 -- 172.21.15.146:0/3941955298 learned_addr learned my addr 172.21.15.146:0/3941955298 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.241+0000 7ff0ae570700 1 -- 172.21.15.146:0/3941955298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0a809f350 msgr2=0x7ff0a8136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.241+0000 7ff0ae570700 1 --2- 172.21.15.146:0/3941955298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0a809f350 0x7ff0a8136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.241+0000 7ff0ae570700 1 -- 172.21.15.146:0/3941955298 >> v1:172.21.15.146:6789/0 conn(0x7ff0a809e870 legacy=0x7ff0a809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.241+0000 7ff0ae570700 1 -- 172.21.15.146:0/3941955298 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a809bab0 con 0x7ff0a81371c0 2023-10-03T10:18:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.241+0000 7ff0ad56e700 1 --2- 172.21.15.146:0/3941955298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0a809f350 0x7ff0a8136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.241+0000 7ff0ae570700 1 --2- 172.21.15.146:0/3941955298 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0a81371c0 0x7ff0a81395a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0009dc0 tx=0x7ff0a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f29138f1ee2216e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.242+0000 7ff0acd6d700 1 -- 172.21.15.146:0/3941955298 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a000e070 con 0x7ff0a81371c0 2023-10-03T10:18:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.242+0000 7ff0acd6d700 1 -- 172.21.15.146:0/3941955298 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a000bb20 con 0x7ff0a81371c0 2023-10-03T10:18:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.242+0000 7ff0acd6d700 1 -- 172.21.15.146:0/3941955298 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0012430 con 0x7ff0a81371c0 2023-10-03T10:18:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.242+0000 7ff0affd3700 1 -- 172.21.15.146:0/3941955298 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0a81371c0 msgr2=0x7ff0a81395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.242+0000 7ff0affd3700 1 --2- 172.21.15.146:0/3941955298 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0a81371c0 0x7ff0a81395a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0009dc0 tx=0x7ff0a000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.242+0000 7ff0affd3700 1 -- 172.21.15.146:0/3941955298 shutdown_connections 2023-10-03T10:18:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.242+0000 7ff0affd3700 1 --2- 172.21.15.146:0/3941955298 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0a81371c0 0x7ff0a81395a0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.242+0000 7ff0affd3700 1 --2- 172.21.15.146:0/3941955298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0a809f350 0x7ff0a8136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.242+0000 7ff0affd3700 1 -- 172.21.15.146:0/3941955298 >> 172.21.15.146:0/3941955298 conn(0x7ff0a80a4430 msgr2=0x7ff0a80a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.242+0000 7ff0affd3700 1 -- 172.21.15.146:0/3941955298 shutdown_connections 2023-10-03T10:18:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.242+0000 7ff0affd3700 1 -- 172.21.15.146:0/3941955298 wait complete. 2023-10-03T10:18:59.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.243+0000 7ff0affd3700 1 Processor -- start 2023-10-03T10:18:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.244+0000 7ff0affd3700 1 -- start start 2023-10-03T10:18:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.244+0000 7ff0affd3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0a809e870 0x7ff0a811c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.244+0000 7ff0affd3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0a809f350 0x7ff0a811cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.244+0000 7ff0affd3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0a81371c0 0x7ff0a811d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.244+0000 7ff0affd3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a81200f0 con 0x7ff0a809f350 2023-10-03T10:18:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.244+0000 7ff0affd3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a809dba0 con 0x7ff0a81371c0 2023-10-03T10:18:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.244+0000 7ff0affd3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a8072410 con 0x7ff0a809e870 2023-10-03T10:18:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.244+0000 7ff0add6f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0a809e870 0x7ff0a811c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.244+0000 7ff0add6f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0a809e870 0x7ff0a811c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53382/0 (socket says 172.21.15.146:53382) 2023-10-03T10:18:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.244+0000 7ff0add6f700 1 -- 172.21.15.146:0/2102097964 learned_addr learned my addr 172.21.15.146:0/2102097964 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.244+0000 7ff0ae570700 1 --2- 172.21.15.146:0/2102097964 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0a81371c0 0x7ff0a811d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.244+0000 7ff0ad56e700 1 --2- 172.21.15.146:0/2102097964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0a809f350 0x7ff0a811cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.245+0000 7ff0add6f700 1 -- 172.21.15.146:0/2102097964 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0a81371c0 msgr2=0x7ff0a811d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.245+0000 7ff0add6f700 1 --2- 172.21.15.146:0/2102097964 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0a81371c0 0x7ff0a811d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.245+0000 7ff0add6f700 1 -- 172.21.15.146:0/2102097964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0a809f350 msgr2=0x7ff0a811cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.245+0000 7ff0add6f700 1 --2- 172.21.15.146:0/2102097964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0a809f350 0x7ff0a811cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.245+0000 7ff0add6f700 1 -- 172.21.15.146:0/2102097964 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a4009550 con 0x7ff0a809e870 2023-10-03T10:18:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.245+0000 7ff0add6f700 1 --2- 172.21.15.146:0/2102097964 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0a809e870 0x7ff0a811c5d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7ff09800c520 tx=0x7ff09800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.245+0000 7ff09e7fc700 1 -- 172.21.15.146:0/2102097964 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff098005cb0 con 0x7ff0a809e870 2023-10-03T10:18:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.245+0000 7ff09e7fc700 1 -- 172.21.15.146:0/2102097964 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff098005e10 con 0x7ff0a809e870 2023-10-03T10:18:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.245+0000 7ff0affd3700 1 -- 172.21.15.146:0/2102097964 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a0009a70 con 0x7ff0a809e870 2023-10-03T10:18:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.245+0000 7ff09e7fc700 1 -- 172.21.15.146:0/2102097964 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0980072d0 con 0x7ff0a809e870 2023-10-03T10:18:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.245+0000 7ff0affd3700 1 -- 172.21.15.146:0/2102097964 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a811fb50 con 0x7ff0a809e870 2023-10-03T10:18:59.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.246+0000 7ff09e7fc700 1 -- 172.21.15.146:0/2102097964 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff098007430 con 0x7ff0a809e870 2023-10-03T10:18:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.246+0000 7ff0affd3700 1 -- 172.21.15.146:0/2102097964 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a8132550 con 0x7ff0a809e870 2023-10-03T10:18:59.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.246+0000 7ff09e7fc700 1 -- 172.21.15.146:0/2102097964 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7ff09803ea80 con 0x7ff0a809e870 2023-10-03T10:18:59.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.250+0000 7ff09e7fc700 1 -- 172.21.15.146:0/2102097964 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff098017070 con 0x7ff0a809e870 2023-10-03T10:18:59.336 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:59.399 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:59.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.439+0000 7ff0affd3700 1 -- 172.21.15.146:0/2102097964 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff0a804f2a0 con 0x7ff0a809e870 2023-10-03T10:18:59.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.440+0000 7ff09e7fc700 1 -- 172.21.15.146:0/2102097964 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff09801b3b0 con 0x7ff0a809e870 2023-10-03T10:18:59.439 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:59.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.442+0000 7ff0affd3700 1 -- 172.21.15.146:0/2102097964 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0a809e870 msgr2=0x7ff0a811c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.442+0000 7ff0affd3700 1 --2- 172.21.15.146:0/2102097964 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0a809e870 0x7ff0a811c5d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7ff09800c520 tx=0x7ff09800c830 comp rx=0 tx=0).stop 2023-10-03T10:18:59.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.442+0000 7ff0affd3700 1 -- 172.21.15.146:0/2102097964 shutdown_connections 2023-10-03T10:18:59.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.442+0000 7ff0affd3700 1 --2- 172.21.15.146:0/2102097964 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff0a81371c0 0x7ff0a811d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.442+0000 7ff0affd3700 1 --2- 172.21.15.146:0/2102097964 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7ff0a809e870 0x7ff0a811c5d0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.442+0000 7ff0affd3700 1 --2- 172.21.15.146:0/2102097964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0a809f350 0x7ff0a811cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.442+0000 7ff0affd3700 1 -- 172.21.15.146:0/2102097964 >> 172.21.15.146:0/2102097964 conn(0x7ff0a80a4430 msgr2=0x7ff0a809cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:59.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.442+0000 7ff0affd3700 1 -- 172.21.15.146:0/2102097964 shutdown_connections 2023-10-03T10:18:59.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.442+0000 7ff0affd3700 1 -- 172.21.15.146:0/2102097964 wait complete. 2023-10-03T10:18:59.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:18:59.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.464+0000 7f0037786700 1 Processor -- start 2023-10-03T10:18:59.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.464+0000 7f0037786700 1 -- start start 2023-10-03T10:18:59.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.464+0000 7f0037786700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0030134140 0x7f0030138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.464+0000 7f0037786700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0030134570 0x7f003013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.464+0000 7f0037786700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003009b110 con 0x7f003009ad40 2023-10-03T10:18:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.464+0000 7f0037786700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00300a3b60 con 0x7f0030134140 2023-10-03T10:18:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.465+0000 7f0037786700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00300a1a80 con 0x7f0030134570 2023-10-03T10:18:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.465+0000 7f0035d23700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0030134570 0x7f003013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.465+0000 7f0034d21700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0030134140 0x7f0030138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.465+0000 7f0035522700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f003009ad40 0x7f0030133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55330/0 (socket says 172.21.15.146:55330) 2023-10-03T10:18:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.465+0000 7f0035522700 1 -- 172.21.15.146:0/1871775800 learned_addr learned my addr 172.21.15.146:0/1871775800 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:18:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.465+0000 7f0034d21700 1 -- 172.21.15.146:0/1871775800 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0030134570 msgr2=0x7f003013b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.465+0000 7f0034d21700 1 --2- 172.21.15.146:0/1871775800 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0030134570 0x7f003013b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.465+0000 7f0034d21700 1 -- 172.21.15.146:0/1871775800 >> v1:172.21.15.146:6789/0 conn(0x7f003009ad40 legacy=0x7f0030133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.465+0000 7f0034d21700 1 -- 172.21.15.146:0/1871775800 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00300a2fa0 con 0x7f0030134140 2023-10-03T10:18:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.465+0000 7f0035d23700 1 --2- 172.21.15.146:0/1871775800 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0030134570 0x7f003013b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.465+0000 7f0034d21700 1 --2- 172.21.15.146:0/1871775800 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0030134140 0x7f0030138e80 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f00200098a0 tx=0x7f0020009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b960b4e0128eef7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.465+0000 7f0027fff700 1 -- 172.21.15.146:0/1871775800 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020011830 con 0x7f0030134140 2023-10-03T10:18:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.465+0000 7f0027fff700 1 -- 172.21.15.146:0/1871775800 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0020011990 con 0x7f0030134140 2023-10-03T10:18:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.465+0000 7f0027fff700 1 -- 172.21.15.146:0/1871775800 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020011d20 con 0x7f0030134140 2023-10-03T10:18:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.466+0000 7f0037786700 1 -- 172.21.15.146:0/1871775800 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0030134140 msgr2=0x7f0030138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.466+0000 7f0037786700 1 --2- 172.21.15.146:0/1871775800 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0030134140 0x7f0030138e80 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f00200098a0 tx=0x7f0020009bb0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.466+0000 7f0037786700 1 -- 172.21.15.146:0/1871775800 shutdown_connections 2023-10-03T10:18:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.466+0000 7f0037786700 1 --2- 172.21.15.146:0/1871775800 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0030134570 0x7f003013b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.466+0000 7f0037786700 1 --2- 172.21.15.146:0/1871775800 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0030134140 0x7f0030138e80 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.466+0000 7f0037786700 1 -- 172.21.15.146:0/1871775800 >> 172.21.15.146:0/1871775800 conn(0x7f0030099c40 msgr2=0x7f003006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:59.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.466+0000 7f0037786700 1 -- 172.21.15.146:0/1871775800 shutdown_connections 2023-10-03T10:18:59.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.466+0000 7f0037786700 1 -- 172.21.15.146:0/1871775800 wait complete. 2023-10-03T10:18:59.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.467+0000 7f0037786700 1 Processor -- start 2023-10-03T10:18:59.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.467+0000 7f0037786700 1 -- start start 2023-10-03T10:18:59.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.467+0000 7f0037786700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f003009ad40 0x7f003011c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.467+0000 7f0037786700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0030134140 0x7f003011ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.467+0000 7f0037786700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0030134570 0x7f003011d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.467+0000 7f0037786700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003011efb0 con 0x7f0030134140 2023-10-03T10:18:59.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.467+0000 7f0037786700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003009e880 con 0x7f003009ad40 2023-10-03T10:18:59.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.467+0000 7f0037786700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f003009c7e0 con 0x7f0030134570 2023-10-03T10:18:59.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.467+0000 7f0035d23700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0030134570 0x7f003011d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.467+0000 7f0035522700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f003009ad40 0x7f003011c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.467+0000 7f0035d23700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0030134570 0x7f003011d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53396/0 (socket says 172.21.15.146:53396) 2023-10-03T10:18:59.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.467+0000 7f0035d23700 1 -- 172.21.15.146:0/1985682418 learned_addr learned my addr 172.21.15.146:0/1985682418 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:59.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.467+0000 7f0034d21700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0030134140 0x7f003011ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.468+0000 7f0035d23700 1 -- 172.21.15.146:0/1985682418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f003009ad40 msgr2=0x7f003011c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.468+0000 7f0035d23700 1 --2- 172.21.15.146:0/1985682418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f003009ad40 0x7f003011c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.468+0000 7f0035d23700 1 -- 172.21.15.146:0/1985682418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0030134140 msgr2=0x7f003011ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.468+0000 7f0035d23700 1 --2- 172.21.15.146:0/1985682418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0030134140 0x7f003011ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.468+0000 7f0035d23700 1 -- 172.21.15.146:0/1985682418 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0028009a70 con 0x7f0030134570 2023-10-03T10:18:59.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.468+0000 7f0035522700 1 --2- 172.21.15.146:0/1985682418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f003009ad40 0x7f003011c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:59.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.468+0000 7f0035d23700 1 --2- 172.21.15.146:0/1985682418 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0030134570 0x7f003011d340 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f002800ef90 tx=0x7f002800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.468+0000 7f0025ffb700 1 -- 172.21.15.146:0/1985682418 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002800cc90 con 0x7f0030134570 2023-10-03T10:18:59.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.468+0000 7f0025ffb700 1 -- 172.21.15.146:0/1985682418 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002800f040 con 0x7f0030134570 2023-10-03T10:18:59.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.468+0000 7f0037786700 1 -- 172.21.15.146:0/1985682418 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00200094a0 con 0x7f0030134570 2023-10-03T10:18:59.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.468+0000 7f0025ffb700 1 -- 172.21.15.146:0/1985682418 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00280146c0 con 0x7f0030134570 2023-10-03T10:18:59.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.468+0000 7f0037786700 1 -- 172.21.15.146:0/1985682418 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003011f890 con 0x7f0030134570 2023-10-03T10:18:59.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.469+0000 7f0037786700 1 -- 172.21.15.146:0/1985682418 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f003011e380 con 0x7f0030134570 2023-10-03T10:18:59.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.469+0000 7f0025ffb700 1 -- 172.21.15.146:0/1985682418 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0028014820 con 0x7f0030134570 2023-10-03T10:18:59.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.469+0000 7f0025ffb700 1 -- 172.21.15.146:0/1985682418 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f00280402a0 con 0x7f0030134570 2023-10-03T10:18:59.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.474+0000 7f0025ffb700 1 -- 172.21.15.146:0/1985682418 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0028007920 con 0x7f0030134570 2023-10-03T10:18:59.497 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:59.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.531+0000 7fc815b50700 1 Processor -- start 2023-10-03T10:18:59.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.531+0000 7fc815b50700 1 -- start start 2023-10-03T10:18:59.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.531+0000 7fc815b50700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8100a0a30 0x7fc8100a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.531+0000 7fc815b50700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8100a1340 0x7fc81012ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.531+0000 7fc815b50700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8101304a0 0x7fc8101308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.531+0000 7fc815b50700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc810130e30 con 0x7fc8100a0a30 2023-10-03T10:18:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.531+0000 7fc815b50700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8100a1e70 con 0x7fc8101304a0 2023-10-03T10:18:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.531+0000 7fc815b50700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc81009a720 con 0x7fc8100a1340 2023-10-03T10:18:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.531+0000 7fc80effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8100a1340 0x7fc81012ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.531+0000 7fc80f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8100a0a30 0x7fc8100a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.531+0000 7fc80ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8101304a0 0x7fc8101308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.531+0000 7fc80f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8100a0a30 0x7fc8100a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53684/0 (socket says 172.21.15.146:53684) 2023-10-03T10:18:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.531+0000 7fc80ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8101304a0 0x7fc8101308f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50626/0 (socket says 172.21.15.146:50626) 2023-10-03T10:18:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.531+0000 7fc80ffff700 1 -- 172.21.15.146:0/880444619 learned_addr learned my addr 172.21.15.146:0/880444619 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.531+0000 7fc80effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8100a1340 0x7fc81012ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53398/0 (socket says 172.21.15.146:53398) 2023-10-03T10:18:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.532+0000 7fc80ffff700 1 -- 172.21.15.146:0/880444619 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8100a1340 msgr2=0x7fc81012ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.532+0000 7fc80ffff700 1 --2- 172.21.15.146:0/880444619 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8100a1340 0x7fc81012ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.532+0000 7fc80ffff700 1 -- 172.21.15.146:0/880444619 >> v2:172.21.15.146:3300/0 conn(0x7fc8100a0a30 msgr2=0x7fc8100a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.532+0000 7fc80ffff700 1 --2- 172.21.15.146:0/880444619 >> v2:172.21.15.146:3300/0 conn(0x7fc8100a0a30 0x7fc8100a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.532+0000 7fc80ffff700 1 -- 172.21.15.146:0/880444619 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81009b300 con 0x7fc8101304a0 2023-10-03T10:18:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.532+0000 7fc80effd700 1 --2- 172.21.15.146:0/880444619 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8100a1340 0x7fc81012ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.532+0000 7fc80f7fe700 1 --2- 172.21.15.146:0/880444619 >> v2:172.21.15.146:3300/0 conn(0x7fc8100a0a30 0x7fc8100a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.532+0000 7fc80ffff700 1 --2- 172.21.15.146:0/880444619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8101304a0 0x7fc8101308f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc808009e80 tx=0x7fc80800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58f2fb5a0cdd17da server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.532+0000 7fc80e7fc700 1 -- 172.21.15.146:0/880444619 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80800e070 con 0x7fc8101304a0 2023-10-03T10:18:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.532+0000 7fc80e7fc700 1 -- 172.21.15.146:0/880444619 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80800b8d0 con 0x7fc8101304a0 2023-10-03T10:18:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.532+0000 7fc80e7fc700 1 -- 172.21.15.146:0/880444619 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80800bc80 con 0x7fc8101304a0 2023-10-03T10:18:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.533+0000 7fc815b50700 1 -- 172.21.15.146:0/880444619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8101304a0 msgr2=0x7fc8101308f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.533+0000 7fc815b50700 1 --2- 172.21.15.146:0/880444619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8101304a0 0x7fc8101308f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc808009e80 tx=0x7fc80800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.533+0000 7fc815b50700 1 -- 172.21.15.146:0/880444619 shutdown_connections 2023-10-03T10:18:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.533+0000 7fc815b50700 1 --2- 172.21.15.146:0/880444619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8101304a0 0x7fc8101308f0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.533+0000 7fc815b50700 1 --2- 172.21.15.146:0/880444619 >> v2:172.21.15.146:3300/0 conn(0x7fc8100a0a30 0x7fc8100a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.533+0000 7fc815b50700 1 --2- 172.21.15.146:0/880444619 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8100a1340 0x7fc81012ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.533+0000 7fc815b50700 1 -- 172.21.15.146:0/880444619 >> 172.21.15.146:0/880444619 conn(0x7fc8100a2980 msgr2=0x7fc8100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.533+0000 7fc815b50700 1 -- 172.21.15.146:0/880444619 shutdown_connections 2023-10-03T10:18:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.533+0000 7fc815b50700 1 -- 172.21.15.146:0/880444619 wait complete. 2023-10-03T10:18:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.534+0000 7fc815b50700 1 Processor -- start 2023-10-03T10:18:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.534+0000 7fc815b50700 1 -- start start 2023-10-03T10:18:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.534+0000 7fc815b50700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8100a0a30 0x7fc81009eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.534+0000 7fc815b50700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8100a1340 0x7fc81009f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.534+0000 7fc815b50700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8101304a0 0x7fc8101c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.534+0000 7fc815b50700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8101207f0 con 0x7fc8100a0a30 2023-10-03T10:18:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.534+0000 7fc815b50700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81012ffb0 con 0x7fc8101304a0 2023-10-03T10:18:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.534+0000 7fc815b50700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc81012f920 con 0x7fc8100a1340 2023-10-03T10:18:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.535+0000 7fc80effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8100a1340 0x7fc81009f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.535+0000 7fc80effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8100a1340 0x7fc81009f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53406/0 (socket says 172.21.15.146:53406) 2023-10-03T10:18:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.535+0000 7fc80f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8100a0a30 0x7fc81009eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.535+0000 7fc80effd700 1 -- 172.21.15.146:0/1160370956 learned_addr learned my addr 172.21.15.146:0/1160370956 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.535+0000 7fc80ffff700 1 --2- 172.21.15.146:0/1160370956 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8101304a0 0x7fc8101c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.535+0000 7fc80f7fe700 1 -- 172.21.15.146:0/1160370956 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8100a1340 msgr2=0x7fc81009f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.535+0000 7fc80f7fe700 1 --2- 172.21.15.146:0/1160370956 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8100a1340 0x7fc81009f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.535+0000 7fc80f7fe700 1 -- 172.21.15.146:0/1160370956 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8101304a0 msgr2=0x7fc8101c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.535+0000 7fc80f7fe700 1 --2- 172.21.15.146:0/1160370956 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8101304a0 0x7fc8101c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.535+0000 7fc80f7fe700 1 -- 172.21.15.146:0/1160370956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc804009430 con 0x7fc8100a0a30 2023-10-03T10:18:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.535+0000 7fc80effd700 1 --2- 172.21.15.146:0/1160370956 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8100a1340 0x7fc81009f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.535+0000 7fc80f7fe700 1 --2- 172.21.15.146:0/1160370956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8100a0a30 0x7fc81009eb30 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fc80400e900 tx=0x7fc80400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.535+0000 7fc7f7fff700 1 -- 172.21.15.146:0/1160370956 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80400ee50 con 0x7fc8100a0a30 2023-10-03T10:18:59.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.535+0000 7fc7f7fff700 1 -- 172.21.15.146:0/1160370956 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc804005a20 con 0x7fc8100a0a30 2023-10-03T10:18:59.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.535+0000 7fc815b50700 1 -- 172.21.15.146:0/1160370956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc80000a640 con 0x7fc8100a0a30 2023-10-03T10:18:59.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.535+0000 7fc7f7fff700 1 -- 172.21.15.146:0/1160370956 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc804005dd0 con 0x7fc8100a0a30 2023-10-03T10:18:59.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.535+0000 7fc815b50700 1 -- 172.21.15.146:0/1160370956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc808009b30 con 0x7fc8100a0a30 2023-10-03T10:18:59.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.536+0000 7fc7f7fff700 1 -- 172.21.15.146:0/1160370956 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc804004030 con 0x7fc8100a0a30 2023-10-03T10:18:59.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.536+0000 7fc815b50700 1 -- 172.21.15.146:0/1160370956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc810120940 con 0x7fc8100a0a30 2023-10-03T10:18:59.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.537+0000 7fc7f7fff700 1 -- 172.21.15.146:0/1160370956 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc80403fc40 con 0x7fc8100a0a30 2023-10-03T10:18:59.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.541+0000 7fc7f7fff700 1 -- 172.21.15.146:0/1160370956 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc804012c00 con 0x7fc8100a0a30 2023-10-03T10:18:59.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.624+0000 7f25a80bf700 1 Processor -- start 2023-10-03T10:18:59.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.624+0000 7f25a80bf700 1 -- start start 2023-10-03T10:18:59.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.625+0000 7f25a80bf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a00a0a70 0x7f25a00a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.625+0000 7f25a80bf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f25a0134120 0x7f25a013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.625+0000 7f25a80bf700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a009dc00 con 0x7f25a00a1380 2023-10-03T10:18:59.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.625+0000 7f25a80bf700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a009ea60 con 0x7f25a0134120 2023-10-03T10:18:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.625+0000 7f25a80bf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25a009dec0 con 0x7f25a00a0a70 2023-10-03T10:18:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.625+0000 7f25a5e5b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a00a0a70 0x7f25a00a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.625+0000 7f25a5e5b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a00a0a70 0x7f25a00a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53420/0 (socket says 172.21.15.146:53420) 2023-10-03T10:18:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.625+0000 7f25a5e5b700 1 -- 172.21.15.146:0/508817394 learned_addr learned my addr 172.21.15.146:0/508817394 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.625+0000 7f25a665c700 1 --2- 172.21.15.146:0/508817394 >> v2:172.21.15.146:3300/0 conn(0x7f25a0134120 0x7f25a013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.625+0000 7f25a5e5b700 1 -- 172.21.15.146:0/508817394 >> v2:172.21.15.146:3300/0 conn(0x7f25a0134120 msgr2=0x7f25a013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.625+0000 7f25a5e5b700 1 --2- 172.21.15.146:0/508817394 >> v2:172.21.15.146:3300/0 conn(0x7f25a0134120 0x7f25a013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.625+0000 7f25a5e5b700 1 -- 172.21.15.146:0/508817394 >> v1:172.21.15.146:6789/0 conn(0x7f25a00a1380 legacy=0x7f25a0133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.625+0000 7f25a4e59700 1 -- 172.21.15.146:0/508817394 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265906363 0 0) 0x7f25a009dc00 con 0x7f25a00a1380 2023-10-03T10:18:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.625+0000 7f25a5e5b700 1 -- 172.21.15.146:0/508817394 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a009e6a0 con 0x7f25a00a0a70 2023-10-03T10:18:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.625+0000 7f25a665c700 1 --2- 172.21.15.146:0/508817394 >> v2:172.21.15.146:3300/0 conn(0x7f25a0134120 0x7f25a013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.625+0000 7f25a5e5b700 1 --2- 172.21.15.146:0/508817394 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a00a0a70 0x7f25a00a0e40 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f259c0098f0 tx=0x7f259c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb22216d0efb3da6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.625+0000 7f25a4e59700 1 -- 172.21.15.146:0/508817394 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c011830 con 0x7f25a00a0a70 2023-10-03T10:18:59.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.626+0000 7f25a4e59700 1 -- 172.21.15.146:0/508817394 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259c011990 con 0x7f25a00a0a70 2023-10-03T10:18:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.626+0000 7f25a4e59700 1 -- 172.21.15.146:0/508817394 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c011d20 con 0x7f25a00a0a70 2023-10-03T10:18:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.626+0000 7f25a80bf700 1 -- 172.21.15.146:0/508817394 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a00a0a70 msgr2=0x7f25a00a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.626+0000 7f25a80bf700 1 --2- 172.21.15.146:0/508817394 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a00a0a70 0x7f25a00a0e40 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f259c0098f0 tx=0x7f259c009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.626+0000 7f25a80bf700 1 -- 172.21.15.146:0/508817394 shutdown_connections 2023-10-03T10:18:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.626+0000 7f25a80bf700 1 --2- 172.21.15.146:0/508817394 >> v2:172.21.15.146:3300/0 conn(0x7f25a0134120 0x7f25a013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.626+0000 7f25a80bf700 1 --2- 172.21.15.146:0/508817394 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a00a0a70 0x7f25a00a0e40 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.626+0000 7f25a80bf700 1 -- 172.21.15.146:0/508817394 >> 172.21.15.146:0/508817394 conn(0x7f25a00a6610 msgr2=0x7f25a00a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.626+0000 7f25a80bf700 1 -- 172.21.15.146:0/508817394 shutdown_connections 2023-10-03T10:18:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.626+0000 7f25a80bf700 1 -- 172.21.15.146:0/508817394 wait complete. 2023-10-03T10:18:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.627+0000 7f25a80bf700 1 Processor -- start 2023-10-03T10:18:59.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.627+0000 7f25a80bf700 1 -- start start 2023-10-03T10:18:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.628+0000 7f25a80bf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a00a0a70 0x7f25a0122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.628+0000 7f25a80bf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25a00a1380 0x7f25a0122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.628+0000 7f25a80bf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a0134120 0x7f25a0123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.628+0000 7f25a80bf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a0133300 con 0x7f25a0134120 2023-10-03T10:18:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.628+0000 7f25a80bf700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a0125aa0 con 0x7f25a00a1380 2023-10-03T10:18:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.628+0000 7f25a80bf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25a0133650 con 0x7f25a00a0a70 2023-10-03T10:18:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.628+0000 7f25a5e5b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a00a0a70 0x7f25a0122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.628+0000 7f25a5e5b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a00a0a70 0x7f25a0122790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53434/0 (socket says 172.21.15.146:53434) 2023-10-03T10:18:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.628+0000 7f25a5e5b700 1 -- 172.21.15.146:0/903224155 learned_addr learned my addr 172.21.15.146:0/903224155 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:18:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.628+0000 7f25a565a700 1 --2- 172.21.15.146:0/903224155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25a00a1380 0x7f25a0122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.628+0000 7f25a665c700 1 --2- 172.21.15.146:0/903224155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a0134120 0x7f25a0123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.629+0000 7f25a5e5b700 1 -- 172.21.15.146:0/903224155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25a00a1380 msgr2=0x7f25a0122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.629+0000 7f25a5e5b700 1 --2- 172.21.15.146:0/903224155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25a00a1380 0x7f25a0122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.629+0000 7f25a5e5b700 1 -- 172.21.15.146:0/903224155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a0134120 msgr2=0x7f25a0123210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.629+0000 7f25a5e5b700 1 --2- 172.21.15.146:0/903224155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a0134120 0x7f25a0123210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.629+0000 7f25a5e5b700 1 -- 172.21.15.146:0/903224155 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2598009a70 con 0x7f25a00a0a70 2023-10-03T10:18:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.629+0000 7f25a5e5b700 1 --2- 172.21.15.146:0/903224155 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a00a0a70 0x7f25a0122790 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f259c009c40 tx=0x7f259c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.629+0000 7f25967fc700 1 -- 172.21.15.146:0/903224155 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c004340 con 0x7f25a00a0a70 2023-10-03T10:18:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.629+0000 7f25967fc700 1 -- 172.21.15.146:0/903224155 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259c01f070 con 0x7f25a00a0a70 2023-10-03T10:18:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.629+0000 7f25967fc700 1 -- 172.21.15.146:0/903224155 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c0036a0 con 0x7f25a00a0a70 2023-10-03T10:18:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.629+0000 7f25a80bf700 1 -- 172.21.15.146:0/903224155 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f259c009550 con 0x7f25a00a0a70 2023-10-03T10:18:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.629+0000 7f25a80bf700 1 -- 172.21.15.146:0/903224155 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a0133990 con 0x7f25a00a0a70 2023-10-03T10:18:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.630+0000 7f25967fc700 1 -- 172.21.15.146:0/903224155 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f259c021030 con 0x7f25a00a0a70 2023-10-03T10:18:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.630+0000 7f25967fc700 1 -- 172.21.15.146:0/903224155 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f259c040980 con 0x7f25a00a0a70 2023-10-03T10:18:59.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.630+0000 7f25a80bf700 1 -- 172.21.15.146:0/903224155 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a00a0440 con 0x7f25a00a0a70 2023-10-03T10:18:59.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.635+0000 7f25967fc700 1 -- 172.21.15.146:0/903224155 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f259c015080 con 0x7f25a00a0a70 2023-10-03T10:18:59.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.671+0000 7f0037786700 1 -- 172.21.15.146:0/1985682418 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f003011eb20 con 0x7f0030134570 2023-10-03T10:18:59.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.672+0000 7f0025ffb700 1 -- 172.21.15.146:0/1985682418 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0028018020 con 0x7f0030134570 2023-10-03T10:18:59.672 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:18:59.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.674+0000 7f0037786700 1 -- 172.21.15.146:0/1985682418 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0030134570 msgr2=0x7f003011d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.674+0000 7f0037786700 1 --2- 172.21.15.146:0/1985682418 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0030134570 0x7f003011d340 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f002800ef90 tx=0x7f002800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.674+0000 7f0037786700 1 -- 172.21.15.146:0/1985682418 shutdown_connections 2023-10-03T10:18:59.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.674+0000 7f0037786700 1 --2- 172.21.15.146:0/1985682418 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f0030134570 0x7f003011d340 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.674+0000 7f0037786700 1 --2- 172.21.15.146:0/1985682418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f003009ad40 0x7f003011c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.674+0000 7f0037786700 1 --2- 172.21.15.146:0/1985682418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0030134140 0x7f003011ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.674+0000 7f0037786700 1 -- 172.21.15.146:0/1985682418 >> 172.21.15.146:0/1985682418 conn(0x7f0030099c40 msgr2=0x7f00300a4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:59.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.674+0000 7f0037786700 1 -- 172.21.15.146:0/1985682418 shutdown_connections 2023-10-03T10:18:59.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.674+0000 7f0037786700 1 -- 172.21.15.146:0/1985682418 wait complete. 2023-10-03T10:18:59.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:18:59.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.737+0000 7fc815b50700 1 -- 172.21.15.146:0/1160370956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc81009fce0 con 0x7fc8100a0a30 2023-10-03T10:18:59.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.737+0000 7fc7f7fff700 1 -- 172.21.15.146:0/1160370956 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc804023350 con 0x7fc8100a0a30 2023-10-03T10:18:59.737 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:18:59.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.739+0000 7fc815b50700 1 -- 172.21.15.146:0/1160370956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8100a0a30 msgr2=0x7fc81009eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.739+0000 7fc815b50700 1 --2- 172.21.15.146:0/1160370956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8100a0a30 0x7fc81009eb30 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fc80400e900 tx=0x7fc80400ec10 comp rx=0 tx=0).stop 2023-10-03T10:18:59.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.739+0000 7fc815b50700 1 -- 172.21.15.146:0/1160370956 shutdown_connections 2023-10-03T10:18:59.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.739+0000 7fc815b50700 1 --2- 172.21.15.146:0/1160370956 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8101304a0 0x7fc8101c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.739+0000 7fc815b50700 1 --2- 172.21.15.146:0/1160370956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8100a0a30 0x7fc81009eb30 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.739+0000 7fc815b50700 1 --2- 172.21.15.146:0/1160370956 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc8100a1340 0x7fc81009f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.739+0000 7fc815b50700 1 -- 172.21.15.146:0/1160370956 >> 172.21.15.146:0/1160370956 conn(0x7fc8100a2980 msgr2=0x7fc81006df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:59.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.739+0000 7fc815b50700 1 -- 172.21.15.146:0/1160370956 shutdown_connections 2023-10-03T10:18:59.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.739+0000 7fc815b50700 1 -- 172.21.15.146:0/1160370956 wait complete. 2023-10-03T10:18:59.751 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:18:59.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.825+0000 7f25a80bf700 1 -- 172.21.15.146:0/903224155 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f25a0125e60 con 0x7f25a00a0a70 2023-10-03T10:18:59.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.826+0000 7f25967fc700 1 -- 172.21.15.146:0/903224155 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f259c0199a0 con 0x7f25a00a0a70 2023-10-03T10:18:59.825 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:18:59.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.828+0000 7f25a80bf700 1 -- 172.21.15.146:0/903224155 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a00a0a70 msgr2=0x7f25a0122790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.828+0000 7f25a80bf700 1 --2- 172.21.15.146:0/903224155 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a00a0a70 0x7f25a0122790 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f259c009c40 tx=0x7f259c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:59.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.828+0000 7f25a80bf700 1 -- 172.21.15.146:0/903224155 shutdown_connections 2023-10-03T10:18:59.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.828+0000 7f25a80bf700 1 --2- 172.21.15.146:0/903224155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a0134120 0x7f25a0123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.828+0000 7f25a80bf700 1 --2- 172.21.15.146:0/903224155 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f25a00a0a70 0x7f25a0122790 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.828+0000 7f25a80bf700 1 --2- 172.21.15.146:0/903224155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f25a00a1380 0x7f25a0122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.828+0000 7f25a80bf700 1 -- 172.21.15.146:0/903224155 >> 172.21.15.146:0/903224155 conn(0x7f25a00a6610 msgr2=0x7f25a00a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:59.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.828+0000 7f25a80bf700 1 -- 172.21.15.146:0/903224155 shutdown_connections 2023-10-03T10:18:59.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:18:59.828+0000 7f25a80bf700 1 -- 172.21.15.146:0/903224155 wait complete. 2023-10-03T10:18:59.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:19:00.455 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:00.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.582+0000 7fba737c5700 1 Processor -- start 2023-10-03T10:19:00.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.582+0000 7fba737c5700 1 -- start start 2023-10-03T10:19:00.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.583+0000 7fba737c5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba6c133ad0 0x7fba6c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.583+0000 7fba737c5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fba6c1300a0 0x7fba6c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.583+0000 7fba737c5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba6c1309f0 0x7fba6c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.583+0000 7fba737c5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba6c06b2d0 con 0x7fba6c1300a0 2023-10-03T10:19:00.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.583+0000 7fba737c5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c133610 con 0x7fba6c133ad0 2023-10-03T10:19:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.583+0000 7fba737c5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c09a500 con 0x7fba6c1309f0 2023-10-03T10:19:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.583+0000 7fba70d60700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fba6c1300a0 0x7fba6c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.583+0000 7fba71d62700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba6c1309f0 0x7fba6c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.583+0000 7fba71d62700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba6c1309f0 0x7fba6c13a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53436/0 (socket says 172.21.15.146:53436) 2023-10-03T10:19:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.583+0000 7fba70d60700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fba6c1300a0 0x7fba6c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53722/0 (socket says 172.21.15.146:53722) 2023-10-03T10:19:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.583+0000 7fba71d62700 1 -- 172.21.15.146:0/925137002 learned_addr learned my addr 172.21.15.146:0/925137002 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.583+0000 7fba71561700 1 --2- 172.21.15.146:0/925137002 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba6c133ad0 0x7fba6c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.583+0000 7fba71d62700 1 -- 172.21.15.146:0/925137002 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba6c133ad0 msgr2=0x7fba6c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.583+0000 7fba71d62700 1 --2- 172.21.15.146:0/925137002 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba6c133ad0 0x7fba6c133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.583+0000 7fba71d62700 1 -- 172.21.15.146:0/925137002 >> v2:172.21.15.146:3300/0 conn(0x7fba6c1300a0 msgr2=0x7fba6c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.583+0000 7fba71d62700 1 --2- 172.21.15.146:0/925137002 >> v2:172.21.15.146:3300/0 conn(0x7fba6c1300a0 0x7fba6c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.583+0000 7fba71d62700 1 -- 172.21.15.146:0/925137002 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6c1338b0 con 0x7fba6c1309f0 2023-10-03T10:19:00.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.583+0000 7fba70d60700 1 --2- 172.21.15.146:0/925137002 >> v2:172.21.15.146:3300/0 conn(0x7fba6c1300a0 0x7fba6c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:00.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.583+0000 7fba71561700 1 --2- 172.21.15.146:0/925137002 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba6c133ad0 0x7fba6c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:00.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.583+0000 7fba71d62700 1 --2- 172.21.15.146:0/925137002 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba6c1309f0 0x7fba6c13a980 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fba64009e50 tx=0x7fba6400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec3d7a623f694ac9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:00.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.583+0000 7fba63fff700 1 -- 172.21.15.146:0/925137002 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6400e070 con 0x7fba6c1309f0 2023-10-03T10:19:00.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.584+0000 7fba63fff700 1 -- 172.21.15.146:0/925137002 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6400b910 con 0x7fba6c1309f0 2023-10-03T10:19:00.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.584+0000 7fba63fff700 1 -- 172.21.15.146:0/925137002 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6400bcc0 con 0x7fba6c1309f0 2023-10-03T10:19:00.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.584+0000 7fba737c5700 1 -- 172.21.15.146:0/925137002 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba6c1309f0 msgr2=0x7fba6c13a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.584+0000 7fba737c5700 1 --2- 172.21.15.146:0/925137002 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba6c1309f0 0x7fba6c13a980 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fba64009e50 tx=0x7fba6400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:00.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.584+0000 7fba737c5700 1 -- 172.21.15.146:0/925137002 shutdown_connections 2023-10-03T10:19:00.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.584+0000 7fba737c5700 1 --2- 172.21.15.146:0/925137002 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba6c133ad0 0x7fba6c133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.584+0000 7fba737c5700 1 --2- 172.21.15.146:0/925137002 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba6c1309f0 0x7fba6c13a980 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.584+0000 7fba737c5700 1 --2- 172.21.15.146:0/925137002 >> v2:172.21.15.146:3300/0 conn(0x7fba6c1300a0 0x7fba6c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.584+0000 7fba737c5700 1 -- 172.21.15.146:0/925137002 >> 172.21.15.146:0/925137002 conn(0x7fba6c099c40 msgr2=0x7fba6c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:00.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.584+0000 7fba737c5700 1 -- 172.21.15.146:0/925137002 shutdown_connections 2023-10-03T10:19:00.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.584+0000 7fba737c5700 1 -- 172.21.15.146:0/925137002 wait complete. 2023-10-03T10:19:00.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.585+0000 7fba737c5700 1 Processor -- start 2023-10-03T10:19:00.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.585+0000 7fba737c5700 1 -- start start 2023-10-03T10:19:00.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.586+0000 7fba737c5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba6c1300a0 0x7fba6c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.586+0000 7fba737c5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba6c1309f0 0x7fba6c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.586+0000 7fba737c5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba6c133ad0 0x7fba6c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.586+0000 7fba737c5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c120eb0 con 0x7fba6c1309f0 2023-10-03T10:19:00.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.586+0000 7fba737c5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c1201d0 con 0x7fba6c133ad0 2023-10-03T10:19:00.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.586+0000 7fba737c5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c12dd00 con 0x7fba6c1300a0 2023-10-03T10:19:00.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.586+0000 7fba70d60700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba6c1309f0 0x7fba6c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.586+0000 7fba71d62700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba6c133ad0 0x7fba6c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.586+0000 7fba70d60700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba6c1309f0 0x7fba6c11df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53728/0 (socket says 172.21.15.146:53728) 2023-10-03T10:19:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.586+0000 7fba70d60700 1 -- 172.21.15.146:0/1439478055 learned_addr learned my addr 172.21.15.146:0/1439478055 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.586+0000 7fba71561700 1 --2- 172.21.15.146:0/1439478055 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba6c1300a0 0x7fba6c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.586+0000 7fba70d60700 1 -- 172.21.15.146:0/1439478055 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba6c1300a0 msgr2=0x7fba6c11da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.586+0000 7fba70d60700 1 --2- 172.21.15.146:0/1439478055 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba6c1300a0 0x7fba6c11da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.586+0000 7fba70d60700 1 -- 172.21.15.146:0/1439478055 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba6c133ad0 msgr2=0x7fba6c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.586+0000 7fba70d60700 1 --2- 172.21.15.146:0/1439478055 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba6c133ad0 0x7fba6c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.586+0000 7fba70d60700 1 -- 172.21.15.146:0/1439478055 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba680094a0 con 0x7fba6c1309f0 2023-10-03T10:19:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.586+0000 7fba71d62700 1 --2- 172.21.15.146:0/1439478055 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba6c133ad0 0x7fba6c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.587+0000 7fba70d60700 1 --2- 172.21.15.146:0/1439478055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba6c1309f0 0x7fba6c11df80 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fba6800ebb0 tx=0x7fba6800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.587+0000 7fba61ffb700 1 -- 172.21.15.146:0/1439478055 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6800c850 con 0x7fba6c1309f0 2023-10-03T10:19:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.587+0000 7fba61ffb700 1 -- 172.21.15.146:0/1439478055 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6800c9b0 con 0x7fba6c1309f0 2023-10-03T10:19:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.587+0000 7fba737c5700 1 -- 172.21.15.146:0/1439478055 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba5c0094a0 con 0x7fba6c1309f0 2023-10-03T10:19:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.587+0000 7fba61ffb700 1 -- 172.21.15.146:0/1439478055 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6800cd40 con 0x7fba6c1309f0 2023-10-03T10:19:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.587+0000 7fba737c5700 1 -- 172.21.15.146:0/1439478055 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba64009b30 con 0x7fba6c1309f0 2023-10-03T10:19:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.588+0000 7fba61ffb700 1 -- 172.21.15.146:0/1439478055 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba68013470 con 0x7fba6c1309f0 2023-10-03T10:19:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.588+0000 7fba61ffb700 1 -- 172.21.15.146:0/1439478055 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fba6803f770 con 0x7fba6c1309f0 2023-10-03T10:19:00.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.588+0000 7fba737c5700 1 -- 172.21.15.146:0/1439478055 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba6c09d270 con 0x7fba6c1309f0 2023-10-03T10:19:00.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.592+0000 7fba61ffb700 1 -- 172.21.15.146:0/1439478055 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba68017020 con 0x7fba6c1309f0 2023-10-03T10:19:00.687 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:00.751 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:00.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.782+0000 7fba737c5700 1 -- 172.21.15.146:0/1439478055 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fba6c12f500 con 0x7fba6c1309f0 2023-10-03T10:19:00.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.782+0000 7fba61ffb700 1 -- 172.21.15.146:0/1439478055 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fba680232f0 con 0x7fba6c1309f0 2023-10-03T10:19:00.782 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:00.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.785+0000 7fba737c5700 1 -- 172.21.15.146:0/1439478055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba6c1309f0 msgr2=0x7fba6c11df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.785+0000 7fba737c5700 1 --2- 172.21.15.146:0/1439478055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba6c1309f0 0x7fba6c11df80 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fba6800ebb0 tx=0x7fba6800eec0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.785+0000 7fba737c5700 1 -- 172.21.15.146:0/1439478055 shutdown_connections 2023-10-03T10:19:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.785+0000 7fba737c5700 1 --2- 172.21.15.146:0/1439478055 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba6c133ad0 0x7fba6c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.785+0000 7fba737c5700 1 --2- 172.21.15.146:0/1439478055 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fba6c1300a0 0x7fba6c11da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.785+0000 7fba737c5700 1 --2- 172.21.15.146:0/1439478055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba6c1309f0 0x7fba6c11df80 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.785+0000 7fba737c5700 1 -- 172.21.15.146:0/1439478055 >> 172.21.15.146:0/1439478055 conn(0x7fba6c099c40 msgr2=0x7fba6c132a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.785+0000 7fba737c5700 1 -- 172.21.15.146:0/1439478055 shutdown_connections 2023-10-03T10:19:00.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.785+0000 7fba737c5700 1 -- 172.21.15.146:0/1439478055 wait complete. 2023-10-03T10:19:00.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:19:00.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.814+0000 7fac1b357700 1 Processor -- start 2023-10-03T10:19:00.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.815+0000 7fac1b357700 1 -- start start 2023-10-03T10:19:00.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.815+0000 7fac1b357700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac14133ad0 0x7fac14133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.815+0000 7fac1b357700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fac14130bc0 0x7fac1413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.815+0000 7fac1b357700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac1406b2d0 con 0x7fac141300a0 2023-10-03T10:19:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.815+0000 7fac1b357700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac14133610 con 0x7fac14130bc0 2023-10-03T10:19:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.815+0000 7fac1b357700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac1409a500 con 0x7fac14133ad0 2023-10-03T10:19:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.815+0000 7fac198f4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fac14130bc0 0x7fac1413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.815+0000 7fac190f3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac14133ad0 0x7fac14133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.815+0000 7fac188f2700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fac141300a0 0x7fac141304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55346/0 (socket says 172.21.15.146:55346) 2023-10-03T10:19:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.815+0000 7fac188f2700 1 -- 172.21.15.146:0/473124797 learned_addr learned my addr 172.21.15.146:0/473124797 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.815+0000 7fac0bfff700 1 -- 172.21.15.146:0/473124797 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696755590 0 0) 0x7fac1406b2d0 con 0x7fac141300a0 2023-10-03T10:19:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.815+0000 7fac0bfff700 1 -- 172.21.15.146:0/473124797 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac000035b0 con 0x7fac141300a0 2023-10-03T10:19:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.815+0000 7fac198f4700 1 -- 172.21.15.146:0/473124797 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac14133ad0 msgr2=0x7fac14133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.815+0000 7fac198f4700 1 --2- 172.21.15.146:0/473124797 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac14133ad0 0x7fac14133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.815+0000 7fac198f4700 1 -- 172.21.15.146:0/473124797 >> v1:172.21.15.146:6789/0 conn(0x7fac141300a0 legacy=0x7fac141304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.816+0000 7fac198f4700 1 -- 172.21.15.146:0/473124797 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac141338b0 con 0x7fac14130bc0 2023-10-03T10:19:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.816+0000 7fac190f3700 1 --2- 172.21.15.146:0/473124797 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac14133ad0 0x7fac14133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.816+0000 7fac198f4700 1 --2- 172.21.15.146:0/473124797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac14130bc0 0x7fac1413b990 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fac0c009d90 tx=0x7fac0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39df4105f9015c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.816+0000 7fac0bfff700 1 -- 172.21.15.146:0/473124797 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c00e070 con 0x7fac14130bc0 2023-10-03T10:19:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.816+0000 7fac0bfff700 1 -- 172.21.15.146:0/473124797 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0c00bb20 con 0x7fac14130bc0 2023-10-03T10:19:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.816+0000 7fac0bfff700 1 -- 172.21.15.146:0/473124797 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c012430 con 0x7fac14130bc0 2023-10-03T10:19:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.816+0000 7fac1b357700 1 -- 172.21.15.146:0/473124797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac14130bc0 msgr2=0x7fac1413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.816+0000 7fac1b357700 1 --2- 172.21.15.146:0/473124797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac14130bc0 0x7fac1413b990 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fac0c009d90 tx=0x7fac0c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.816+0000 7fac1b357700 1 -- 172.21.15.146:0/473124797 shutdown_connections 2023-10-03T10:19:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.816+0000 7fac1b357700 1 --2- 172.21.15.146:0/473124797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac14130bc0 0x7fac1413b990 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.816+0000 7fac1b357700 1 --2- 172.21.15.146:0/473124797 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac14133ad0 0x7fac14133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.816+0000 7fac1b357700 1 -- 172.21.15.146:0/473124797 >> 172.21.15.146:0/473124797 conn(0x7fac14099c40 msgr2=0x7fac140a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:00.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.817+0000 7fac1b357700 1 -- 172.21.15.146:0/473124797 shutdown_connections 2023-10-03T10:19:00.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.817+0000 7fac1b357700 1 -- 172.21.15.146:0/473124797 wait complete. 2023-10-03T10:19:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.817+0000 7fac1b357700 1 Processor -- start 2023-10-03T10:19:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.817+0000 7fac1b357700 1 -- start start 2023-10-03T10:19:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.818+0000 7fac1b357700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac141300a0 0x7fac1411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.818+0000 7fac1b357700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac14130bc0 0x7fac1411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.818+0000 7fac1b357700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac14133ad0 0x7fac1411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.818+0000 7fac1b357700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac14120050 con 0x7fac14130bc0 2023-10-03T10:19:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.818+0000 7fac1b357700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac141209c0 con 0x7fac141300a0 2023-10-03T10:19:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.818+0000 7fac1b357700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac14071fd0 con 0x7fac14133ad0 2023-10-03T10:19:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.818+0000 7fac188f2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac14130bc0 0x7fac1411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.818+0000 7fac198f4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac14133ad0 0x7fac1411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.818+0000 7fac188f2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac14130bc0 0x7fac1411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53748/0 (socket says 172.21.15.146:53748) 2023-10-03T10:19:00.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.818+0000 7fac198f4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac14133ad0 0x7fac1411e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53458/0 (socket says 172.21.15.146:53458) 2023-10-03T10:19:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.818+0000 7fac188f2700 1 -- 172.21.15.146:0/256820723 learned_addr learned my addr 172.21.15.146:0/256820723 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.818+0000 7fac190f3700 1 --2- 172.21.15.146:0/256820723 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac141300a0 0x7fac1411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.818+0000 7fac188f2700 1 -- 172.21.15.146:0/256820723 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac14133ad0 msgr2=0x7fac1411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.818+0000 7fac188f2700 1 --2- 172.21.15.146:0/256820723 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac14133ad0 0x7fac1411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.818+0000 7fac188f2700 1 -- 172.21.15.146:0/256820723 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac141300a0 msgr2=0x7fac1411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.818+0000 7fac188f2700 1 --2- 172.21.15.146:0/256820723 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac141300a0 0x7fac1411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.818+0000 7fac188f2700 1 -- 172.21.15.146:0/256820723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac100094a0 con 0x7fac14130bc0 2023-10-03T10:19:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.818+0000 7fac188f2700 1 --2- 172.21.15.146:0/256820723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac14130bc0 0x7fac1411df80 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fac04005910 tx=0x7fac0400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.819+0000 7fac09ffb700 1 -- 172.21.15.146:0/256820723 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04005d70 con 0x7fac14130bc0 2023-10-03T10:19:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.819+0000 7fac09ffb700 1 -- 172.21.15.146:0/256820723 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0400ce80 con 0x7fac14130bc0 2023-10-03T10:19:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.819+0000 7fac1b357700 1 -- 172.21.15.146:0/256820723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0c009a70 con 0x7fac14130bc0 2023-10-03T10:19:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.819+0000 7fac09ffb700 1 -- 172.21.15.146:0/256820723 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac040072f0 con 0x7fac14130bc0 2023-10-03T10:19:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.819+0000 7fac1b357700 1 -- 172.21.15.146:0/256820723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac1412dd00 con 0x7fac14130bc0 2023-10-03T10:19:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.820+0000 7fac09ffb700 1 -- 172.21.15.146:0/256820723 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fac04007450 con 0x7fac14130bc0 2023-10-03T10:19:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.820+0000 7fac09ffb700 1 -- 172.21.15.146:0/256820723 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fac0403ead0 con 0x7fac14130bc0 2023-10-03T10:19:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.820+0000 7fac1b357700 1 -- 172.21.15.146:0/256820723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac1411fa10 con 0x7fac14130bc0 2023-10-03T10:19:00.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.824+0000 7fac09ffb700 1 -- 172.21.15.146:0/256820723 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac1411fa10 con 0x7fac14130bc0 2023-10-03T10:19:00.840 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.880+0000 7f0769318700 1 Processor -- start 2023-10-03T10:19:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.880+0000 7f0769318700 1 -- start start 2023-10-03T10:19:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.881+0000 7f0769318700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f076409e870 0x7f076409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.881+0000 7f0769318700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f076409f180 0x7f0764133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.881+0000 7f0769318700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f076406bec0 con 0x7f07641341d0 2023-10-03T10:19:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.881+0000 7f0769318700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076406ce60 con 0x7f076409f180 2023-10-03T10:19:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.881+0000 7f0769318700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f076409fa00 con 0x7f076409e870 2023-10-03T10:19:00.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.881+0000 7f0762ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f076409e870 0x7f076409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.881+0000 7f0762ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f076409e870 0x7f076409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53474/0 (socket says 172.21.15.146:53474) 2023-10-03T10:19:00.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.881+0000 7f0762ffd700 1 -- 172.21.15.146:0/3543820797 learned_addr learned my addr 172.21.15.146:0/3543820797 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:00.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.881+0000 7f07627fc700 1 --2- 172.21.15.146:0/3543820797 >> v2:172.21.15.146:3300/0 conn(0x7f076409f180 0x7f0764133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.881+0000 7f0762ffd700 1 -- 172.21.15.146:0/3543820797 >> v2:172.21.15.146:3300/0 conn(0x7f076409f180 msgr2=0x7f0764133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:00.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.881+0000 7f0762ffd700 1 --2- 172.21.15.146:0/3543820797 >> v2:172.21.15.146:3300/0 conn(0x7f076409f180 0x7f0764133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.881+0000 7f0762ffd700 1 -- 172.21.15.146:0/3543820797 >> v1:172.21.15.146:6789/0 conn(0x7f07641341d0 legacy=0x7f076413af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.881+0000 7f0762ffd700 1 -- 172.21.15.146:0/3543820797 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076409ad80 con 0x7f076409e870 2023-10-03T10:19:00.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.881+0000 7f0762ffd700 1 --2- 172.21.15.146:0/3543820797 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f076409e870 0x7f076409ec40 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f07540098f0 tx=0x7f0754009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61b2ff165647aad1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:00.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.881+0000 7f0761ffb700 1 -- 172.21.15.146:0/3543820797 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075400b8a0 con 0x7f076409e870 2023-10-03T10:19:00.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.881+0000 7f0761ffb700 1 -- 172.21.15.146:0/3543820797 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075400ba00 con 0x7f076409e870 2023-10-03T10:19:00.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.881+0000 7f0761ffb700 1 -- 172.21.15.146:0/3543820797 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075400bd90 con 0x7f076409e870 2023-10-03T10:19:00.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.882+0000 7f0769318700 1 -- 172.21.15.146:0/3543820797 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f076409e870 msgr2=0x7f076409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.882+0000 7f0769318700 1 --2- 172.21.15.146:0/3543820797 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f076409e870 0x7f076409ec40 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f07540098f0 tx=0x7f0754009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:00.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.882+0000 7f0769318700 1 -- 172.21.15.146:0/3543820797 shutdown_connections 2023-10-03T10:19:00.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.882+0000 7f0769318700 1 --2- 172.21.15.146:0/3543820797 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f076409e870 0x7f076409ec40 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.882+0000 7f0769318700 1 --2- 172.21.15.146:0/3543820797 >> v2:172.21.15.146:3300/0 conn(0x7f076409f180 0x7f0764133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.882+0000 7f0769318700 1 -- 172.21.15.146:0/3543820797 >> 172.21.15.146:0/3543820797 conn(0x7f07640a4430 msgr2=0x7f07640a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:00.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.882+0000 7f0769318700 1 -- 172.21.15.146:0/3543820797 shutdown_connections 2023-10-03T10:19:00.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.882+0000 7f0769318700 1 -- 172.21.15.146:0/3543820797 wait complete. 2023-10-03T10:19:00.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.883+0000 7f0769318700 1 Processor -- start 2023-10-03T10:19:00.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.883+0000 7f0769318700 1 -- start start 2023-10-03T10:19:00.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.884+0000 7f0769318700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f076409e870 0x7f076411ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.884+0000 7f0769318700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f076409f180 0x7f076411f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.884+0000 7f0769318700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07641341d0 0x7f076411f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.884+0000 7f0769318700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076406cfa0 con 0x7f076409f180 2023-10-03T10:19:00.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.884+0000 7f0769318700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07641221f0 con 0x7f076409e870 2023-10-03T10:19:00.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.884+0000 7f0769318700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0764133570 con 0x7f07641341d0 2023-10-03T10:19:00.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.884+0000 7f07627fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f076409f180 0x7f076411f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.884+0000 7f07627fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f076409f180 0x7f076411f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53766/0 (socket says 172.21.15.146:53766) 2023-10-03T10:19:00.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.884+0000 7f07627fc700 1 -- 172.21.15.146:0/1732989022 learned_addr learned my addr 172.21.15.146:0/1732989022 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:00.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.884+0000 7f07637fe700 1 --2- 172.21.15.146:0/1732989022 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07641341d0 0x7f076411f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.884+0000 7f0762ffd700 1 --2- 172.21.15.146:0/1732989022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f076409e870 0x7f076411ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.884+0000 7f07627fc700 1 -- 172.21.15.146:0/1732989022 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07641341d0 msgr2=0x7f076411f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.884+0000 7f07627fc700 1 --2- 172.21.15.146:0/1732989022 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07641341d0 0x7f076411f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.884+0000 7f07627fc700 1 -- 172.21.15.146:0/1732989022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f076409e870 msgr2=0x7f076411ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.884+0000 7f07627fc700 1 --2- 172.21.15.146:0/1732989022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f076409e870 0x7f076411ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.884+0000 7f07627fc700 1 -- 172.21.15.146:0/1732989022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0754009550 con 0x7f076409f180 2023-10-03T10:19:00.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.884+0000 7f07627fc700 1 --2- 172.21.15.146:0/1732989022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f076409f180 0x7f076411f010 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f075800e810 tx=0x7f075800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:00.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.884+0000 7f074b7fe700 1 -- 172.21.15.146:0/1732989022 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758013610 con 0x7f076409f180 2023-10-03T10:19:00.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.885+0000 7f074b7fe700 1 -- 172.21.15.146:0/1732989022 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0758013770 con 0x7f076409f180 2023-10-03T10:19:00.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.885+0000 7f0769318700 1 -- 172.21.15.146:0/1732989022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076406fcc0 con 0x7f076409f180 2023-10-03T10:19:00.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.885+0000 7f074b7fe700 1 -- 172.21.15.146:0/1732989022 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758013ae0 con 0x7f076409f180 2023-10-03T10:19:00.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.885+0000 7f0769318700 1 -- 172.21.15.146:0/1732989022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0764122c60 con 0x7f076409f180 2023-10-03T10:19:00.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.886+0000 7f074b7fe700 1 -- 172.21.15.146:0/1732989022 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0758013c40 con 0x7f076409f180 2023-10-03T10:19:00.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.886+0000 7f0769318700 1 -- 172.21.15.146:0/1732989022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076404f2a0 con 0x7f076409f180 2023-10-03T10:19:00.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.886+0000 7f074b7fe700 1 -- 172.21.15.146:0/1732989022 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f075803f3c0 con 0x7f076409f180 2023-10-03T10:19:00.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.890+0000 7f074b7fe700 1 -- 172.21.15.146:0/1732989022 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0758012370 con 0x7f076409f180 2023-10-03T10:19:00.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.968+0000 7f44c6101700 1 Processor -- start 2023-10-03T10:19:00.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.968+0000 7f44c6101700 1 -- start start 2023-10-03T10:19:00.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.969+0000 7f44c6101700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c009e950 0x7f44c009ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.969+0000 7f44c6101700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44c009f260 0x7f44c0131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.969+0000 7f44c6101700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c009afb0 con 0x7f44c0131dd0 2023-10-03T10:19:00.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.969+0000 7f44c6101700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c00a0970 con 0x7f44c009f260 2023-10-03T10:19:00.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.969+0000 7f44c6101700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44c00a0320 con 0x7f44c009e950 2023-10-03T10:19:00.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.969+0000 7f44beffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44c009f260 0x7f44c0131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.969+0000 7f44bf7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c009e950 0x7f44c009ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.969+0000 7f44beffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44c009f260 0x7f44c0131890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50682/0 (socket says 172.21.15.146:50682) 2023-10-03T10:19:00.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.969+0000 7f44bffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f44c0131dd0 0x7f44c0138ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55366/0 (socket says 172.21.15.146:55366) 2023-10-03T10:19:00.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.969+0000 7f44beffd700 1 -- 172.21.15.146:0/546606596 learned_addr learned my addr 172.21.15.146:0/546606596 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:00.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.969+0000 7f44beffd700 1 -- 172.21.15.146:0/546606596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c009e950 msgr2=0x7f44c009ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:00.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.969+0000 7f44beffd700 1 --2- 172.21.15.146:0/546606596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c009e950 0x7f44c009ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.969+0000 7f44beffd700 1 -- 172.21.15.146:0/546606596 >> v1:172.21.15.146:6789/0 conn(0x7f44c0131dd0 legacy=0x7f44c0138ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.969+0000 7f44beffd700 1 -- 172.21.15.146:0/546606596 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c00a0750 con 0x7f44c009f260 2023-10-03T10:19:00.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.969+0000 7f44be7fc700 1 -- 172.21.15.146:0/546606596 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571366115 0 0) 0x7f44c009afb0 con 0x7f44c0131dd0 2023-10-03T10:19:00.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.969+0000 7f44bf7fe700 1 --2- 172.21.15.146:0/546606596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c009e950 0x7f44c009ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:00.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.969+0000 7f44beffd700 1 --2- 172.21.15.146:0/546606596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44c009f260 0x7f44c0131890 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009920 tx=0x7f44b4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71fef8866ce2678e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:00.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.969+0000 7f44be7fc700 1 -- 172.21.15.146:0/546606596 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b4011830 con 0x7f44c009f260 2023-10-03T10:19:00.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.969+0000 7f44be7fc700 1 -- 172.21.15.146:0/546606596 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b4011990 con 0x7f44c009f260 2023-10-03T10:19:00.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.969+0000 7f44be7fc700 1 -- 172.21.15.146:0/546606596 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b4011d20 con 0x7f44c009f260 2023-10-03T10:19:00.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.970+0000 7f44c6101700 1 -- 172.21.15.146:0/546606596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44c009f260 msgr2=0x7f44c0131890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.970+0000 7f44c6101700 1 --2- 172.21.15.146:0/546606596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44c009f260 0x7f44c0131890 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009920 tx=0x7f44b4009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:00.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.970+0000 7f44c6101700 1 -- 172.21.15.146:0/546606596 shutdown_connections 2023-10-03T10:19:00.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.970+0000 7f44c6101700 1 --2- 172.21.15.146:0/546606596 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c009e950 0x7f44c009ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.970+0000 7f44c6101700 1 --2- 172.21.15.146:0/546606596 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44c009f260 0x7f44c0131890 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.970+0000 7f44c6101700 1 -- 172.21.15.146:0/546606596 >> 172.21.15.146:0/546606596 conn(0x7f44c00a0f70 msgr2=0x7f44c00a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:00.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.970+0000 7f44c6101700 1 -- 172.21.15.146:0/546606596 shutdown_connections 2023-10-03T10:19:00.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.970+0000 7f44c6101700 1 -- 172.21.15.146:0/546606596 wait complete. 2023-10-03T10:19:00.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.971+0000 7f44c6101700 1 Processor -- start 2023-10-03T10:19:00.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.971+0000 7f44c6101700 1 -- start start 2023-10-03T10:19:00.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.972+0000 7f44c6101700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c009e950 0x7f44c011e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.972+0000 7f44c6101700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44c009f260 0x7f44c011e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.972+0000 7f44c6101700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44c0131dd0 0x7f44c011ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.972+0000 7f44c6101700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c0121cf0 con 0x7f44c009f260 2023-10-03T10:19:00.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.972+0000 7f44c6101700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c01201d0 con 0x7f44c0131dd0 2023-10-03T10:19:00.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.972+0000 7f44c6101700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44c009d280 con 0x7f44c009e950 2023-10-03T10:19:00.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.972+0000 7f44bffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44c0131dd0 0x7f44c011ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.972+0000 7f44beffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44c009f260 0x7f44c011e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.972+0000 7f44bf7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c009e950 0x7f44c011e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.972+0000 7f44beffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44c009f260 0x7f44c011e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53774/0 (socket says 172.21.15.146:53774) 2023-10-03T10:19:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.972+0000 7f44bffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44c0131dd0 0x7f44c011ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50688/0 (socket says 172.21.15.146:50688) 2023-10-03T10:19:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.972+0000 7f44bf7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c009e950 0x7f44c011e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53504/0 (socket says 172.21.15.146:53504) 2023-10-03T10:19:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.972+0000 7f44beffd700 1 -- 172.21.15.146:0/658168854 learned_addr learned my addr 172.21.15.146:0/658168854 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.972+0000 7f44bf7fe700 1 -- 172.21.15.146:0/658168854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44c0131dd0 msgr2=0x7f44c011ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.972+0000 7f44bf7fe700 1 --2- 172.21.15.146:0/658168854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44c0131dd0 0x7f44c011ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.972+0000 7f44bf7fe700 1 -- 172.21.15.146:0/658168854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44c009f260 msgr2=0x7f44c011e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.972+0000 7f44bf7fe700 1 --2- 172.21.15.146:0/658168854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44c009f260 0x7f44c011e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.972+0000 7f44bf7fe700 1 -- 172.21.15.146:0/658168854 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b0009430 con 0x7f44c009e950 2023-10-03T10:19:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.972+0000 7f44bffff700 1 --2- 172.21.15.146:0/658168854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44c0131dd0 0x7f44c011ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.973+0000 7f44bf7fe700 1 --2- 172.21.15.146:0/658168854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c009e950 0x7f44c011e4b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f44b000e9b0 tx=0x7f44b000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.973+0000 7f44a7fff700 1 -- 172.21.15.146:0/658168854 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b000ee50 con 0x7f44c009e950 2023-10-03T10:19:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.973+0000 7f44a7fff700 1 -- 172.21.15.146:0/658168854 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b0005a20 con 0x7f44c009e950 2023-10-03T10:19:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.973+0000 7f44a7fff700 1 -- 172.21.15.146:0/658168854 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b0005db0 con 0x7f44c009e950 2023-10-03T10:19:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.973+0000 7f44c6101700 1 -- 172.21.15.146:0/658168854 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b4009550 con 0x7f44c009e950 2023-10-03T10:19:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.973+0000 7f44c6101700 1 -- 172.21.15.146:0/658168854 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c0120610 con 0x7f44c009e950 2023-10-03T10:19:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.974+0000 7f44a7fff700 1 -- 172.21.15.146:0/658168854 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f44b000c850 con 0x7f44c009e950 2023-10-03T10:19:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.974+0000 7f44a7fff700 1 -- 172.21.15.146:0/658168854 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f44b003fa10 con 0x7f44c009e950 2023-10-03T10:19:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.975+0000 7f44c6101700 1 -- 172.21.15.146:0/658168854 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c004f2a0 con 0x7f44c009e950 2023-10-03T10:19:00.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:00.985+0000 7f44a7fff700 1 -- 172.21.15.146:0/658168854 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44b0006030 con 0x7f44c009e950 2023-10-03T10:19:01.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.031+0000 7fac1b357700 1 -- 172.21.15.146:0/256820723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fac1411fa10 con 0x7fac14130bc0 2023-10-03T10:19:01.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.031+0000 7fac09ffb700 1 -- 172.21.15.146:0/256820723 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fac1411fa10 con 0x7fac14130bc0 2023-10-03T10:19:01.031 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:01.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.033+0000 7fac1b357700 1 -- 172.21.15.146:0/256820723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac14130bc0 msgr2=0x7fac1411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.033+0000 7fac1b357700 1 --2- 172.21.15.146:0/256820723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac14130bc0 0x7fac1411df80 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fac04005910 tx=0x7fac0400c7b0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.033+0000 7fac1b357700 1 -- 172.21.15.146:0/256820723 shutdown_connections 2023-10-03T10:19:01.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.033+0000 7fac1b357700 1 --2- 172.21.15.146:0/256820723 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fac14133ad0 0x7fac1411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.033+0000 7fac1b357700 1 --2- 172.21.15.146:0/256820723 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac141300a0 0x7fac1411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.033+0000 7fac1b357700 1 --2- 172.21.15.146:0/256820723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac14130bc0 0x7fac1411df80 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.033+0000 7fac1b357700 1 -- 172.21.15.146:0/256820723 >> 172.21.15.146:0/256820723 conn(0x7fac14099c40 msgr2=0x7fac1412e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.033+0000 7fac1b357700 1 -- 172.21.15.146:0/256820723 shutdown_connections 2023-10-03T10:19:01.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.033+0000 7fac1b357700 1 -- 172.21.15.146:0/256820723 wait complete. 2023-10-03T10:19:01.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:19:01.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.090+0000 7f0769318700 1 -- 172.21.15.146:0/1732989022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0764072d60 con 0x7f076409f180 2023-10-03T10:19:01.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.091+0000 7f074b7fe700 1 -- 172.21.15.146:0/1732989022 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0758010310 con 0x7f076409f180 2023-10-03T10:19:01.091 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:19:01.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.093+0000 7f0769318700 1 -- 172.21.15.146:0/1732989022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f076409f180 msgr2=0x7f076411f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.093+0000 7f0769318700 1 --2- 172.21.15.146:0/1732989022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f076409f180 0x7f076411f010 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f075800e810 tx=0x7f075800eb20 comp rx=0 tx=0).stop 2023-10-03T10:19:01.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.093+0000 7f0769318700 1 -- 172.21.15.146:0/1732989022 shutdown_connections 2023-10-03T10:19:01.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.093+0000 7f0769318700 1 --2- 172.21.15.146:0/1732989022 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07641341d0 0x7f076411f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.093+0000 7f0769318700 1 --2- 172.21.15.146:0/1732989022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f076409e870 0x7f076411ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.093+0000 7f0769318700 1 --2- 172.21.15.146:0/1732989022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f076409f180 0x7f076411f010 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.093+0000 7f0769318700 1 -- 172.21.15.146:0/1732989022 >> 172.21.15.146:0/1732989022 conn(0x7f07640a4430 msgr2=0x7f0764071020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.093+0000 7f0769318700 1 -- 172.21.15.146:0/1732989022 shutdown_connections 2023-10-03T10:19:01.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.093+0000 7f0769318700 1 -- 172.21.15.146:0/1732989022 wait complete. 2023-10-03T10:19:01.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:19:01.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.179+0000 7f44c6101700 1 -- 172.21.15.146:0/658168854 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f44c006b250 con 0x7f44c009e950 2023-10-03T10:19:01.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.179+0000 7f44a7fff700 1 -- 172.21.15.146:0/658168854 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f44b0011ab0 con 0x7f44c009e950 2023-10-03T10:19:01.179 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:19:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.181+0000 7f44c6101700 1 -- 172.21.15.146:0/658168854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c009e950 msgr2=0x7f44c011e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.181+0000 7f44c6101700 1 --2- 172.21.15.146:0/658168854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c009e950 0x7f44c011e4b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f44b000e9b0 tx=0x7f44b000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.181+0000 7f44c6101700 1 -- 172.21.15.146:0/658168854 shutdown_connections 2023-10-03T10:19:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.181+0000 7f44c6101700 1 --2- 172.21.15.146:0/658168854 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44c0131dd0 0x7f44c011ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.181+0000 7f44c6101700 1 --2- 172.21.15.146:0/658168854 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44c009e950 0x7f44c011e4b0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.181+0000 7f44c6101700 1 --2- 172.21.15.146:0/658168854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44c009f260 0x7f44c011e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.181+0000 7f44c6101700 1 -- 172.21.15.146:0/658168854 >> 172.21.15.146:0/658168854 conn(0x7f44c00a0f70 msgr2=0x7f44c006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.181+0000 7f44c6101700 1 -- 172.21.15.146:0/658168854 shutdown_connections 2023-10-03T10:19:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.181+0000 7f44c6101700 1 -- 172.21.15.146:0/658168854 wait complete. 2023-10-03T10:19:01.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:19:01.798 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:01.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.924+0000 7f3cba704700 1 Processor -- start 2023-10-03T10:19:01.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.924+0000 7f3cba704700 1 -- start start 2023-10-03T10:19:01.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.924+0000 7f3cba704700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406b250 0x7f3cb4136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.924+0000 7f3cba704700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb4137140 0x7f3cb4139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.924+0000 7f3cba704700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb409da80 con 0x7f3cb406a770 2023-10-03T10:19:01.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.924+0000 7f3cba704700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb409dce0 con 0x7f3cb406b250 2023-10-03T10:19:01.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.924+0000 7f3cba704700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb406b620 con 0x7f3cb4137140 2023-10-03T10:19:01.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.924+0000 7f3cb8ca1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb4137140 0x7f3cb4139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.924+0000 7f3cb37fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406b250 0x7f3cb4136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.924+0000 7f3cb3fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3cb406a770 0x7f3cb406ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55378/0 (socket says 172.21.15.146:55378) 2023-10-03T10:19:01.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.924+0000 7f3cb8ca1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb4137140 0x7f3cb4139520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53510/0 (socket says 172.21.15.146:53510) 2023-10-03T10:19:01.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.924+0000 7f3cb3fff700 1 -- 172.21.15.146:0/434917065 learned_addr learned my addr 172.21.15.146:0/434917065 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:01.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.924+0000 7f3cb2ffd700 1 -- 172.21.15.146:0/434917065 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1813435972 0 0) 0x7f3cb409da80 con 0x7f3cb406a770 2023-10-03T10:19:01.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.924+0000 7f3cb8ca1700 1 -- 172.21.15.146:0/434917065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406b250 msgr2=0x7f3cb4136c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:01.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.924+0000 7f3cb8ca1700 1 --2- 172.21.15.146:0/434917065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406b250 0x7f3cb4136c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.924+0000 7f3cb8ca1700 1 -- 172.21.15.146:0/434917065 >> v1:172.21.15.146:6789/0 conn(0x7f3cb406a770 legacy=0x7f3cb406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.925+0000 7f3cb8ca1700 1 -- 172.21.15.146:0/434917065 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb409eb20 con 0x7f3cb4137140 2023-10-03T10:19:01.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.925+0000 7f3cb37fe700 1 --2- 172.21.15.146:0/434917065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406b250 0x7f3cb4136c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:01.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.925+0000 7f3cb8ca1700 1 --2- 172.21.15.146:0/434917065 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb4137140 0x7f3cb4139520 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009dc0 tx=0x7f3cac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6da1729d4e7a6d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.925+0000 7f3cb2ffd700 1 -- 172.21.15.146:0/434917065 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac00e070 con 0x7f3cb4137140 2023-10-03T10:19:01.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.925+0000 7f3cb2ffd700 1 -- 172.21.15.146:0/434917065 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac00bb20 con 0x7f3cb4137140 2023-10-03T10:19:01.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.925+0000 7f3cb2ffd700 1 -- 172.21.15.146:0/434917065 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac012430 con 0x7f3cb4137140 2023-10-03T10:19:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.925+0000 7f3cba704700 1 -- 172.21.15.146:0/434917065 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb4137140 msgr2=0x7f3cb4139520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.925+0000 7f3cba704700 1 --2- 172.21.15.146:0/434917065 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb4137140 0x7f3cb4139520 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009dc0 tx=0x7f3cac00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.925+0000 7f3cba704700 1 -- 172.21.15.146:0/434917065 shutdown_connections 2023-10-03T10:19:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.925+0000 7f3cba704700 1 --2- 172.21.15.146:0/434917065 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb4137140 0x7f3cb4139520 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.925+0000 7f3cba704700 1 --2- 172.21.15.146:0/434917065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406b250 0x7f3cb4136c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.925+0000 7f3cba704700 1 -- 172.21.15.146:0/434917065 >> 172.21.15.146:0/434917065 conn(0x7f3cb4099c40 msgr2=0x7f3cb40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.925+0000 7f3cba704700 1 -- 172.21.15.146:0/434917065 shutdown_connections 2023-10-03T10:19:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.925+0000 7f3cba704700 1 -- 172.21.15.146:0/434917065 wait complete. 2023-10-03T10:19:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.926+0000 7f3cba704700 1 Processor -- start 2023-10-03T10:19:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.926+0000 7f3cba704700 1 -- start start 2023-10-03T10:19:01.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.927+0000 7f3cba704700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406a770 0x7f3cb4120580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.927+0000 7f3cba704700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb406b250 0x7f3cb4120ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.927+0000 7f3cba704700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb4137140 0x7f3cb4121000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.927+0000 7f3cba704700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb4122f90 con 0x7f3cb4137140 2023-10-03T10:19:01.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.927+0000 7f3cba704700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb4122190 con 0x7f3cb406a770 2023-10-03T10:19:01.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.927+0000 7f3cba704700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb41234e0 con 0x7f3cb406b250 2023-10-03T10:19:01.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.927+0000 7f3cb37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb406b250 0x7f3cb4120ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.927+0000 7f3cb3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406a770 0x7f3cb4120580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.927+0000 7f3cb37fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb406b250 0x7f3cb4120ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53518/0 (socket says 172.21.15.146:53518) 2023-10-03T10:19:01.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.927+0000 7f3cb37fe700 1 -- 172.21.15.146:0/2683101727 learned_addr learned my addr 172.21.15.146:0/2683101727 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:01.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.927+0000 7f3cb8ca1700 1 --2- 172.21.15.146:0/2683101727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb4137140 0x7f3cb4121000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.927+0000 7f3cb3fff700 1 -- 172.21.15.146:0/2683101727 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb406b250 msgr2=0x7f3cb4120ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.927+0000 7f3cb3fff700 1 --2- 172.21.15.146:0/2683101727 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb406b250 0x7f3cb4120ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.927+0000 7f3cb3fff700 1 -- 172.21.15.146:0/2683101727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb4137140 msgr2=0x7f3cb4121000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.927+0000 7f3cb3fff700 1 --2- 172.21.15.146:0/2683101727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb4137140 0x7f3cb4121000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.927+0000 7f3cb3fff700 1 -- 172.21.15.146:0/2683101727 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca80094a0 con 0x7f3cb406a770 2023-10-03T10:19:01.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.927+0000 7f3cb37fe700 1 --2- 172.21.15.146:0/2683101727 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb406b250 0x7f3cb4120ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:01.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.927+0000 7f3cb8ca1700 1 --2- 172.21.15.146:0/2683101727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb4137140 0x7f3cb4121000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:01.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.927+0000 7f3cb3fff700 1 --2- 172.21.15.146:0/2683101727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406a770 0x7f3cb4120580 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400c470 tx=0x7f3ca400c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.928+0000 7f3cb0ff9700 1 -- 172.21.15.146:0/2683101727 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4004c80 con 0x7f3cb406a770 2023-10-03T10:19:01.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.928+0000 7f3cb0ff9700 1 -- 172.21.15.146:0/2683101727 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca4004de0 con 0x7f3cb406a770 2023-10-03T10:19:01.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.928+0000 7f3cba704700 1 -- 172.21.15.146:0/2683101727 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cac009a70 con 0x7f3cb406a770 2023-10-03T10:19:01.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.928+0000 7f3cb0ff9700 1 -- 172.21.15.146:0/2683101727 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4007310 con 0x7f3cb406a770 2023-10-03T10:19:01.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.928+0000 7f3cba704700 1 -- 172.21.15.146:0/2683101727 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb4071e10 con 0x7f3cb406a770 2023-10-03T10:19:01.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.928+0000 7f3cb0ff9700 1 -- 172.21.15.146:0/2683101727 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ca4007470 con 0x7f3cb406a770 2023-10-03T10:19:01.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.928+0000 7f3cb0ff9700 1 -- 172.21.15.146:0/2683101727 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f3ca403f260 con 0x7f3cb406a770 2023-10-03T10:19:01.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.929+0000 7f3cba704700 1 -- 172.21.15.146:0/2683101727 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb404f2a0 con 0x7f3cb406a770 2023-10-03T10:19:01.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:01.933+0000 7f3cb0ff9700 1 -- 172.21.15.146:0/2683101727 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ca4007720 con 0x7f3cb406a770 2023-10-03T10:19:02.046 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:02.107 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:02.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.126+0000 7f3cba704700 1 -- 172.21.15.146:0/2683101727 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3cb40a3e00 con 0x7f3cb406a770 2023-10-03T10:19:02.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.127+0000 7f3cb0ff9700 1 -- 172.21.15.146:0/2683101727 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3ca4011360 con 0x7f3cb406a770 2023-10-03T10:19:02.126 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:02.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.129+0000 7f3cba704700 1 -- 172.21.15.146:0/2683101727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406a770 msgr2=0x7f3cb4120580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.129+0000 7f3cba704700 1 --2- 172.21.15.146:0/2683101727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406a770 0x7f3cb4120580 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400c470 tx=0x7f3ca400c780 comp rx=0 tx=0).stop 2023-10-03T10:19:02.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.130+0000 7f3cba704700 1 -- 172.21.15.146:0/2683101727 shutdown_connections 2023-10-03T10:19:02.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.130+0000 7f3cba704700 1 --2- 172.21.15.146:0/2683101727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cb4137140 0x7f3cb4121000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.130+0000 7f3cba704700 1 --2- 172.21.15.146:0/2683101727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3cb406a770 0x7f3cb4120580 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.130+0000 7f3cba704700 1 --2- 172.21.15.146:0/2683101727 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3cb406b250 0x7f3cb4120ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.130+0000 7f3cba704700 1 -- 172.21.15.146:0/2683101727 >> 172.21.15.146:0/2683101727 conn(0x7f3cb4099c40 msgr2=0x7f3cb406fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.130+0000 7f3cba704700 1 -- 172.21.15.146:0/2683101727 shutdown_connections 2023-10-03T10:19:02.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.130+0000 7f3cba704700 1 -- 172.21.15.146:0/2683101727 wait complete. 2023-10-03T10:19:02.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:19:02.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.175+0000 7f5255b9d700 1 Processor -- start 2023-10-03T10:19:02.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.175+0000 7f5255b9d700 1 -- start start 2023-10-03T10:19:02.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.176+0000 7f5255b9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52500700e0 0x7f52500704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.176+0000 7f5255b9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52500709f0 0x7f525012cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.176+0000 7f5255b9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f525012d290 0x7f525012d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.176+0000 7f5255b9d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f525009aad0 con 0x7f525012d290 2023-10-03T10:19:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.176+0000 7f5255b9d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5250099d90 con 0x7f52500709f0 2023-10-03T10:19:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.176+0000 7f5255b9d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f525006b670 con 0x7f52500700e0 2023-10-03T10:19:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.176+0000 7f524ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52500709f0 0x7f525012cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.176+0000 7f5254b9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52500700e0 0x7f52500704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.176+0000 7f524ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52500709f0 0x7f525012cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50708/0 (socket says 172.21.15.146:50708) 2023-10-03T10:19:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.176+0000 7f524ffff700 1 -- 172.21.15.146:0/1154979059 learned_addr learned my addr 172.21.15.146:0/1154979059 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.176+0000 7f525539c700 1 --2- 172.21.15.146:0/1154979059 >> v2:172.21.15.146:3300/0 conn(0x7f525012d290 0x7f525012d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.176+0000 7f524ffff700 1 -- 172.21.15.146:0/1154979059 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52500700e0 msgr2=0x7f52500704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:02.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.176+0000 7f524ffff700 1 --2- 172.21.15.146:0/1154979059 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52500700e0 0x7f52500704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.176+0000 7f524ffff700 1 -- 172.21.15.146:0/1154979059 >> v2:172.21.15.146:3300/0 conn(0x7f525012d290 msgr2=0x7f525012d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:02.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.176+0000 7f524ffff700 1 --2- 172.21.15.146:0/1154979059 >> v2:172.21.15.146:3300/0 conn(0x7f525012d290 0x7f525012d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.176+0000 7f524ffff700 1 -- 172.21.15.146:0/1154979059 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525009a4c0 con 0x7f52500709f0 2023-10-03T10:19:02.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.176+0000 7f5254b9b700 1 --2- 172.21.15.146:0/1154979059 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52500700e0 0x7f52500704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.176+0000 7f525539c700 1 --2- 172.21.15.146:0/1154979059 >> v2:172.21.15.146:3300/0 conn(0x7f525012d290 0x7f525012d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.177+0000 7f524ffff700 1 --2- 172.21.15.146:0/1154979059 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52500709f0 0x7f525012cd50 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f523c009920 tx=0x7f523c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32b5191c54338f0d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.177+0000 7f524f7fe700 1 -- 172.21.15.146:0/1154979059 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c011830 con 0x7f52500709f0 2023-10-03T10:19:02.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.177+0000 7f524f7fe700 1 -- 172.21.15.146:0/1154979059 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c011990 con 0x7f52500709f0 2023-10-03T10:19:02.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.177+0000 7f524f7fe700 1 -- 172.21.15.146:0/1154979059 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c011d20 con 0x7f52500709f0 2023-10-03T10:19:02.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.177+0000 7f5255b9d700 1 -- 172.21.15.146:0/1154979059 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52500709f0 msgr2=0x7f525012cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.177+0000 7f5255b9d700 1 --2- 172.21.15.146:0/1154979059 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52500709f0 0x7f525012cd50 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f523c009920 tx=0x7f523c009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:02.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.177+0000 7f5255b9d700 1 -- 172.21.15.146:0/1154979059 shutdown_connections 2023-10-03T10:19:02.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.177+0000 7f5255b9d700 1 --2- 172.21.15.146:0/1154979059 >> v2:172.21.15.146:3300/0 conn(0x7f525012d290 0x7f525012d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.177+0000 7f5255b9d700 1 --2- 172.21.15.146:0/1154979059 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52500700e0 0x7f52500704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.177+0000 7f5255b9d700 1 --2- 172.21.15.146:0/1154979059 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52500709f0 0x7f525012cd50 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.177+0000 7f5255b9d700 1 -- 172.21.15.146:0/1154979059 >> 172.21.15.146:0/1154979059 conn(0x7f52500a27a0 msgr2=0x7f52500a2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.178+0000 7f5255b9d700 1 -- 172.21.15.146:0/1154979059 shutdown_connections 2023-10-03T10:19:02.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.178+0000 7f5255b9d700 1 -- 172.21.15.146:0/1154979059 wait complete. 2023-10-03T10:19:02.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.178+0000 7f5255b9d700 1 Processor -- start 2023-10-03T10:19:02.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.178+0000 7f5255b9d700 1 -- start start 2023-10-03T10:19:02.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.179+0000 7f5255b9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52500700e0 0x7f525012e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.179+0000 7f5255b9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52500709f0 0x7f525012e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.179+0000 7f5255b9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f525012d290 0x7f525012eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.179+0000 7f5255b9d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525012c500 con 0x7f52500700e0 2023-10-03T10:19:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.179+0000 7f5255b9d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5250122450 con 0x7f525012d290 2023-10-03T10:19:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.179+0000 7f5255b9d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f525012fcb0 con 0x7f52500709f0 2023-10-03T10:19:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.179+0000 7f5254b9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52500700e0 0x7f525012e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.179+0000 7f524ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52500709f0 0x7f525012e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.179+0000 7f5254b9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52500700e0 0x7f525012e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53812/0 (socket says 172.21.15.146:53812) 2023-10-03T10:19:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.179+0000 7f5254b9b700 1 -- 172.21.15.146:0/1058710840 learned_addr learned my addr 172.21.15.146:0/1058710840 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.179+0000 7f525539c700 1 --2- 172.21.15.146:0/1058710840 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f525012d290 0x7f525012eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.179+0000 7f5254b9b700 1 -- 172.21.15.146:0/1058710840 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52500709f0 msgr2=0x7f525012e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.179+0000 7f5254b9b700 1 --2- 172.21.15.146:0/1058710840 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52500709f0 0x7f525012e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.179+0000 7f5254b9b700 1 -- 172.21.15.146:0/1058710840 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f525012d290 msgr2=0x7f525012eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.179+0000 7f5254b9b700 1 --2- 172.21.15.146:0/1058710840 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f525012d290 0x7f525012eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.179+0000 7f5254b9b700 1 -- 172.21.15.146:0/1058710840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52440094a0 con 0x7f52500700e0 2023-10-03T10:19:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.179+0000 7f524ffff700 1 --2- 172.21.15.146:0/1058710840 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52500709f0 0x7f525012e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.179+0000 7f525539c700 1 --2- 172.21.15.146:0/1058710840 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f525012d290 0x7f525012eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.180+0000 7f5254b9b700 1 --2- 172.21.15.146:0/1058710840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52500700e0 0x7f525012e0a0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f524400ebe0 tx=0x7f524400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.180+0000 7f524d7fa700 1 -- 172.21.15.146:0/1058710840 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5244009800 con 0x7f52500700e0 2023-10-03T10:19:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.180+0000 7f524d7fa700 1 -- 172.21.15.146:0/1058710840 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524400c850 con 0x7f52500700e0 2023-10-03T10:19:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.180+0000 7f5255b9d700 1 -- 172.21.15.146:0/1058710840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5248009a70 con 0x7f52500700e0 2023-10-03T10:19:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.180+0000 7f524d7fa700 1 -- 172.21.15.146:0/1058710840 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524400cbc0 con 0x7f52500700e0 2023-10-03T10:19:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.180+0000 7f5255b9d700 1 -- 172.21.15.146:0/1058710840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523c009550 con 0x7f52500700e0 2023-10-03T10:19:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.180+0000 7f524d7fa700 1 -- 172.21.15.146:0/1058710840 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f524400cd20 con 0x7f52500700e0 2023-10-03T10:19:02.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.181+0000 7f5255b9d700 1 -- 172.21.15.146:0/1058710840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525012c8b0 con 0x7f52500700e0 2023-10-03T10:19:02.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.181+0000 7f524d7fa700 1 -- 172.21.15.146:0/1058710840 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f524403fb50 con 0x7f52500700e0 2023-10-03T10:19:02.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.189+0000 7f524d7fa700 1 -- 172.21.15.146:0/1058710840 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5244017020 con 0x7f52500700e0 2023-10-03T10:19:02.194 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:02.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.240+0000 7f8f4bfdf700 1 Processor -- start 2023-10-03T10:19:02.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.240+0000 7f8f4bfdf700 1 -- start start 2023-10-03T10:19:02.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.240+0000 7f8f4bfdf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f44133900 0x7f8f44133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.240+0000 7f8f4bfdf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8f440a10b0 0x7f8f4413b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.240+0000 7f8f4bfdf700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4409a760 con 0x7f8f44134210 2023-10-03T10:19:02.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.240+0000 7f8f4bfdf700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f441336e0 con 0x7f8f440a10b0 2023-10-03T10:19:02.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.240+0000 7f8f4bfdf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4409a080 con 0x7f8f44133900 2023-10-03T10:19:02.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.241+0000 7f8f49d7b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f44133900 0x7f8f44133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.241+0000 7f8f4a57c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8f440a10b0 0x7f8f4413b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.241+0000 7f8f49d7b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f44133900 0x7f8f44133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53564/0 (socket says 172.21.15.146:53564) 2023-10-03T10:19:02.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.241+0000 7f8f4a57c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8f440a10b0 0x7f8f4413b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53824/0 (socket says 172.21.15.146:53824) 2023-10-03T10:19:02.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.241+0000 7f8f49d7b700 1 -- 172.21.15.146:0/1171758282 learned_addr learned my addr 172.21.15.146:0/1171758282 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:02.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.241+0000 7f8f4957a700 1 --1- 172.21.15.146:0/1171758282 >> v1:172.21.15.146:6789/0 conn(0x7f8f44134210 0x7f8f440a09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55384/0 (socket says 172.21.15.146:55384) 2023-10-03T10:19:02.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.241+0000 7f8f4a57c700 1 -- 172.21.15.146:0/1171758282 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f44133900 msgr2=0x7f8f44133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:02.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.241+0000 7f8f4a57c700 1 --2- 172.21.15.146:0/1171758282 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f44133900 0x7f8f44133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.241+0000 7f8f4a57c700 1 -- 172.21.15.146:0/1171758282 >> v1:172.21.15.146:6789/0 conn(0x7f8f44134210 legacy=0x7f8f440a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.241+0000 7f8f48d79700 1 -- 172.21.15.146:0/1171758282 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932414056 0 0) 0x7f8f4409a760 con 0x7f8f44134210 2023-10-03T10:19:02.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.241+0000 7f8f4a57c700 1 -- 172.21.15.146:0/1171758282 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f440a23e0 con 0x7f8f440a10b0 2023-10-03T10:19:02.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.241+0000 7f8f49d7b700 1 --2- 172.21.15.146:0/1171758282 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f44133900 0x7f8f44133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.241+0000 7f8f4a57c700 1 --2- 172.21.15.146:0/1171758282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f440a10b0 0x7f8f4413b910 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c009d90 tx=0x7f8f3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9eb2e4e16b01871 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.241+0000 7f8f48d79700 1 -- 172.21.15.146:0/1171758282 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c00e070 con 0x7f8f440a10b0 2023-10-03T10:19:02.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.241+0000 7f8f48d79700 1 -- 172.21.15.146:0/1171758282 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c00bb20 con 0x7f8f440a10b0 2023-10-03T10:19:02.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.241+0000 7f8f48d79700 1 -- 172.21.15.146:0/1171758282 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c012430 con 0x7f8f440a10b0 2023-10-03T10:19:02.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.242+0000 7f8f4bfdf700 1 -- 172.21.15.146:0/1171758282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f440a10b0 msgr2=0x7f8f4413b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.242+0000 7f8f4bfdf700 1 --2- 172.21.15.146:0/1171758282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f440a10b0 0x7f8f4413b910 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c009d90 tx=0x7f8f3c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:02.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.242+0000 7f8f4bfdf700 1 -- 172.21.15.146:0/1171758282 shutdown_connections 2023-10-03T10:19:02.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.242+0000 7f8f4bfdf700 1 --2- 172.21.15.146:0/1171758282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f440a10b0 0x7f8f4413b910 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.242+0000 7f8f4bfdf700 1 --2- 172.21.15.146:0/1171758282 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f44133900 0x7f8f44133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.242+0000 7f8f4bfdf700 1 -- 172.21.15.146:0/1171758282 >> 172.21.15.146:0/1171758282 conn(0x7f8f440a2980 msgr2=0x7f8f440a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.242+0000 7f8f4bfdf700 1 -- 172.21.15.146:0/1171758282 shutdown_connections 2023-10-03T10:19:02.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.242+0000 7f8f4bfdf700 1 -- 172.21.15.146:0/1171758282 wait complete. 2023-10-03T10:19:02.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.243+0000 7f8f4bfdf700 1 Processor -- start 2023-10-03T10:19:02.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.243+0000 7f8f4bfdf700 1 -- start start 2023-10-03T10:19:02.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.243+0000 7f8f4bfdf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f440a10b0 0x7f8f4411d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.243+0000 7f8f4bfdf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f44133900 0x7f8f4411dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.243+0000 7f8f4bfdf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f44134210 0x7f8f4411e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.243+0000 7f8f4bfdf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f44121be0 con 0x7f8f44134210 2023-10-03T10:19:02.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.243+0000 7f8f4bfdf700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4411f310 con 0x7f8f440a10b0 2023-10-03T10:19:02.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.243+0000 7f8f4bfdf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f44120560 con 0x7f8f44133900 2023-10-03T10:19:02.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.243+0000 7f8f4957a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f44133900 0x7f8f4411dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.244+0000 7f8f4957a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f44133900 0x7f8f4411dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53570/0 (socket says 172.21.15.146:53570) 2023-10-03T10:19:02.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.244+0000 7f8f4957a700 1 -- 172.21.15.146:0/3638047671 learned_addr learned my addr 172.21.15.146:0/3638047671 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:02.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.244+0000 7f8f4a57c700 1 --2- 172.21.15.146:0/3638047671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f44134210 0x7f8f4411e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.244+0000 7f8f49d7b700 1 --2- 172.21.15.146:0/3638047671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f440a10b0 0x7f8f4411d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.244+0000 7f8f4a57c700 1 -- 172.21.15.146:0/3638047671 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f44133900 msgr2=0x7f8f4411dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.244+0000 7f8f4a57c700 1 --2- 172.21.15.146:0/3638047671 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f44133900 0x7f8f4411dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.244+0000 7f8f4a57c700 1 -- 172.21.15.146:0/3638047671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f440a10b0 msgr2=0x7f8f4411d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.244+0000 7f8f4a57c700 1 --2- 172.21.15.146:0/3638047671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f440a10b0 0x7f8f4411d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.244+0000 7f8f4a57c700 1 -- 172.21.15.146:0/3638047671 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f40009500 con 0x7f8f44134210 2023-10-03T10:19:02.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.244+0000 7f8f4957a700 1 --2- 172.21.15.146:0/3638047671 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f44133900 0x7f8f4411dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.244+0000 7f8f4a57c700 1 --2- 172.21.15.146:0/3638047671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f44134210 0x7f8f4411e180 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f8f440724b0 tx=0x7f8f3c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.244+0000 7f8f3a7fc700 1 -- 172.21.15.146:0/3638047671 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c012430 con 0x7f8f44134210 2023-10-03T10:19:02.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.244+0000 7f8f3a7fc700 1 -- 172.21.15.146:0/3638047671 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c020070 con 0x7f8f44134210 2023-10-03T10:19:02.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.244+0000 7f8f4bfdf700 1 -- 172.21.15.146:0/3638047671 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3c009a70 con 0x7f8f44134210 2023-10-03T10:19:02.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.244+0000 7f8f3a7fc700 1 -- 172.21.15.146:0/3638047671 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c004280 con 0x7f8f44134210 2023-10-03T10:19:02.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.244+0000 7f8f4bfdf700 1 -- 172.21.15.146:0/3638047671 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f44132b60 con 0x7f8f44134210 2023-10-03T10:19:02.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.245+0000 7f8f4bfdf700 1 -- 172.21.15.146:0/3638047671 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f4411a590 con 0x7f8f44134210 2023-10-03T10:19:02.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.246+0000 7f8f3a7fc700 1 -- 172.21.15.146:0/3638047671 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f3c0043e0 con 0x7f8f44134210 2023-10-03T10:19:02.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.246+0000 7f8f3a7fc700 1 -- 172.21.15.146:0/3638047671 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8f3c022070 con 0x7f8f44134210 2023-10-03T10:19:02.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.250+0000 7f8f3a7fc700 1 -- 172.21.15.146:0/3638047671 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f3c031430 con 0x7f8f44134210 2023-10-03T10:19:02.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.322+0000 7f2d8aabf700 1 Processor -- start 2023-10-03T10:19:02.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.322+0000 7f2d8aabf700 1 -- start start 2023-10-03T10:19:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.322+0000 7f2d8aabf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d8409f430 0x7f2d84138cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.322+0000 7f2d8aabf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d841391f0 0x7f2d8413b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.322+0000 7f2d8aabf700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d8409ac20 con 0x7f2d8409e950 2023-10-03T10:19:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.322+0000 7f2d8aabf700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d840a06c0 con 0x7f2d8409f430 2023-10-03T10:19:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.323+0000 7f2d8aabf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8409ae90 con 0x7f2d841391f0 2023-10-03T10:19:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.323+0000 7f2d8885b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2d8409e950 0x7f2d8409ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55386/0 (socket says 172.21.15.146:55386) 2023-10-03T10:19:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.323+0000 7f2d8885b700 1 -- 172.21.15.146:0/757212333 learned_addr learned my addr 172.21.15.146:0/757212333 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.323+0000 7f2d8905c700 1 --2- 172.21.15.146:0/757212333 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d841391f0 0x7f2d8413b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.323+0000 7f2d83fff700 1 --2- 172.21.15.146:0/757212333 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d8409f430 0x7f2d84138cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.323+0000 7f2d837fe700 1 -- 172.21.15.146:0/757212333 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358706884 0 0) 0x7f2d8409ac20 con 0x7f2d8409e950 2023-10-03T10:19:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.323+0000 7f2d837fe700 1 -- 172.21.15.146:0/757212333 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d740035b0 con 0x7f2d8409e950 2023-10-03T10:19:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.323+0000 7f2d8905c700 1 -- 172.21.15.146:0/757212333 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d8409f430 msgr2=0x7f2d84138cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.323+0000 7f2d8905c700 1 --2- 172.21.15.146:0/757212333 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d8409f430 0x7f2d84138cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.323+0000 7f2d8905c700 1 -- 172.21.15.146:0/757212333 >> v1:172.21.15.146:6789/0 conn(0x7f2d8409e950 legacy=0x7f2d8409ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.323+0000 7f2d8905c700 1 -- 172.21.15.146:0/757212333 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8406ba00 con 0x7f2d841391f0 2023-10-03T10:19:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.323+0000 7f2d8905c700 1 --2- 172.21.15.146:0/757212333 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d841391f0 0x7f2d8413b5d0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c009dc0 tx=0x7f2d7c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5be9e4e541beffb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.323+0000 7f2d837fe700 1 -- 172.21.15.146:0/757212333 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c00e070 con 0x7f2d841391f0 2023-10-03T10:19:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.324+0000 7f2d837fe700 1 -- 172.21.15.146:0/757212333 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7c00bb20 con 0x7f2d841391f0 2023-10-03T10:19:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.324+0000 7f2d837fe700 1 -- 172.21.15.146:0/757212333 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c012430 con 0x7f2d841391f0 2023-10-03T10:19:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.324+0000 7f2d8aabf700 1 -- 172.21.15.146:0/757212333 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d841391f0 msgr2=0x7f2d8413b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.324+0000 7f2d8aabf700 1 --2- 172.21.15.146:0/757212333 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d841391f0 0x7f2d8413b5d0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c009dc0 tx=0x7f2d7c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.324+0000 7f2d8aabf700 1 -- 172.21.15.146:0/757212333 shutdown_connections 2023-10-03T10:19:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.324+0000 7f2d8aabf700 1 --2- 172.21.15.146:0/757212333 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d841391f0 0x7f2d8413b5d0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.324+0000 7f2d8aabf700 1 --2- 172.21.15.146:0/757212333 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d8409f430 0x7f2d84138cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.324+0000 7f2d8aabf700 1 -- 172.21.15.146:0/757212333 >> 172.21.15.146:0/757212333 conn(0x7f2d840a0f70 msgr2=0x7f2d840a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.324+0000 7f2d8aabf700 1 -- 172.21.15.146:0/757212333 shutdown_connections 2023-10-03T10:19:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.324+0000 7f2d8aabf700 1 -- 172.21.15.146:0/757212333 wait complete. 2023-10-03T10:19:02.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.325+0000 7f2d8aabf700 1 Processor -- start 2023-10-03T10:19:02.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.325+0000 7f2d8aabf700 1 -- start start 2023-10-03T10:19:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.326+0000 7f2d8aabf700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d8409e950 0x7f2d84121820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.326+0000 7f2d8aabf700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d8409f430 0x7f2d84121d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.326+0000 7f2d8aabf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d841391f0 0x7f2d841222a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.326+0000 7f2d8aabf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d841253e0 con 0x7f2d841391f0 2023-10-03T10:19:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.326+0000 7f2d8aabf700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d84122c80 con 0x7f2d8409e950 2023-10-03T10:19:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.326+0000 7f2d8aabf700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8409e100 con 0x7f2d8409f430 2023-10-03T10:19:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.326+0000 7f2d83fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d8409f430 0x7f2d84121d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.326+0000 7f2d83fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d8409f430 0x7f2d84121d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53578/0 (socket says 172.21.15.146:53578) 2023-10-03T10:19:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.326+0000 7f2d83fff700 1 -- 172.21.15.146:0/3247935788 learned_addr learned my addr 172.21.15.146:0/3247935788 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.326+0000 7f2d8885b700 1 --2- 172.21.15.146:0/3247935788 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d8409e950 0x7f2d84121820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.327+0000 7f2d8905c700 1 --2- 172.21.15.146:0/3247935788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d841391f0 0x7f2d841222a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.327+0000 7f2d83fff700 1 -- 172.21.15.146:0/3247935788 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d8409e950 msgr2=0x7f2d84121820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.327+0000 7f2d83fff700 1 --2- 172.21.15.146:0/3247935788 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d8409e950 0x7f2d84121820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.327+0000 7f2d83fff700 1 -- 172.21.15.146:0/3247935788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d841391f0 msgr2=0x7f2d841222a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.327+0000 7f2d83fff700 1 --2- 172.21.15.146:0/3247935788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d841391f0 0x7f2d841222a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.327+0000 7f2d83fff700 1 -- 172.21.15.146:0/3247935788 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7c009a70 con 0x7f2d8409f430 2023-10-03T10:19:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.327+0000 7f2d8885b700 1 --2- 172.21.15.146:0/3247935788 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d8409e950 0x7f2d84121820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.327+0000 7f2d83fff700 1 --2- 172.21.15.146:0/3247935788 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d8409f430 0x7f2d84121d60 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f2d7000e9e0 tx=0x7f2d7000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.327+0000 7f2d817fa700 1 -- 172.21.15.146:0/3247935788 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d70009710 con 0x7f2d8409f430 2023-10-03T10:19:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.327+0000 7f2d8aabf700 1 -- 172.21.15.146:0/3247935788 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d840a0820 con 0x7f2d8409f430 2023-10-03T10:19:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.327+0000 7f2d817fa700 1 -- 172.21.15.146:0/3247935788 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7000ee80 con 0x7f2d8409f430 2023-10-03T10:19:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.327+0000 7f2d817fa700 1 -- 172.21.15.146:0/3247935788 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7000ca50 con 0x7f2d8409f430 2023-10-03T10:19:02.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.327+0000 7f2d8aabf700 1 -- 172.21.15.146:0/3247935788 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d84125060 con 0x7f2d8409f430 2023-10-03T10:19:02.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.328+0000 7f2d817fa700 1 -- 172.21.15.146:0/3247935788 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d7000cbb0 con 0x7f2d8409f430 2023-10-03T10:19:02.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.328+0000 7f2d8aabf700 1 -- 172.21.15.146:0/3247935788 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d84123ca0 con 0x7f2d8409f430 2023-10-03T10:19:02.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.328+0000 7f2d817fa700 1 -- 172.21.15.146:0/3247935788 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2d7003f780 con 0x7f2d8409f430 2023-10-03T10:19:02.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.333+0000 7f2d817fa700 1 -- 172.21.15.146:0/3247935788 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d70013470 con 0x7f2d8409f430 2023-10-03T10:19:02.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.417+0000 7f5255b9d700 1 -- 172.21.15.146:0/1058710840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f525004f2a0 con 0x7f52500700e0 2023-10-03T10:19:02.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.417+0000 7f524d7fa700 1 -- 172.21.15.146:0/1058710840 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f524401a360 con 0x7f52500700e0 2023-10-03T10:19:02.417 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:02.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.419+0000 7f5255b9d700 1 -- 172.21.15.146:0/1058710840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52500700e0 msgr2=0x7f525012e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.419+0000 7f5255b9d700 1 --2- 172.21.15.146:0/1058710840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52500700e0 0x7f525012e0a0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f524400ebe0 tx=0x7f524400eef0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.419+0000 7f5255b9d700 1 -- 172.21.15.146:0/1058710840 shutdown_connections 2023-10-03T10:19:02.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.419+0000 7f5255b9d700 1 --2- 172.21.15.146:0/1058710840 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f525012d290 0x7f525012eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.419+0000 7f5255b9d700 1 --2- 172.21.15.146:0/1058710840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52500700e0 0x7f525012e0a0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.419+0000 7f5255b9d700 1 --2- 172.21.15.146:0/1058710840 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f52500709f0 0x7f525012e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.419+0000 7f5255b9d700 1 -- 172.21.15.146:0/1058710840 >> 172.21.15.146:0/1058710840 conn(0x7f52500a27a0 msgr2=0x7f525006efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.419+0000 7f5255b9d700 1 -- 172.21.15.146:0/1058710840 shutdown_connections 2023-10-03T10:19:02.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.420+0000 7f5255b9d700 1 -- 172.21.15.146:0/1058710840 wait complete. 2023-10-03T10:19:02.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:19:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.477+0000 7f8f4bfdf700 1 -- 172.21.15.146:0/3638047671 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8f4409a2c0 con 0x7f8f44134210 2023-10-03T10:19:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.478+0000 7f8f3a7fc700 1 -- 172.21.15.146:0/3638047671 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f3c035090 con 0x7f8f44134210 2023-10-03T10:19:02.477 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:19:02.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.480+0000 7f8f4bfdf700 1 -- 172.21.15.146:0/3638047671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f44134210 msgr2=0x7f8f4411e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.480+0000 7f8f4bfdf700 1 --2- 172.21.15.146:0/3638047671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f44134210 0x7f8f4411e180 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f8f440724b0 tx=0x7f8f3c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.480+0000 7f8f4bfdf700 1 -- 172.21.15.146:0/3638047671 shutdown_connections 2023-10-03T10:19:02.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.480+0000 7f8f4bfdf700 1 --2- 172.21.15.146:0/3638047671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f44134210 0x7f8f4411e180 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.480+0000 7f8f4bfdf700 1 --2- 172.21.15.146:0/3638047671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f440a10b0 0x7f8f4411d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.480+0000 7f8f4bfdf700 1 --2- 172.21.15.146:0/3638047671 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8f44133900 0x7f8f4411dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.480+0000 7f8f4bfdf700 1 -- 172.21.15.146:0/3638047671 >> 172.21.15.146:0/3638047671 conn(0x7f8f440a2980 msgr2=0x7f8f441baca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.480+0000 7f8f4bfdf700 1 -- 172.21.15.146:0/3638047671 shutdown_connections 2023-10-03T10:19:02.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.480+0000 7f8f4bfdf700 1 -- 172.21.15.146:0/3638047671 wait complete. 2023-10-03T10:19:02.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:19:02.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.527+0000 7f2d8aabf700 1 -- 172.21.15.146:0/3247935788 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2d84124ea0 con 0x7f2d8409f430 2023-10-03T10:19:02.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.527+0000 7f2d817fa700 1 -- 172.21.15.146:0/3247935788 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d7001ae80 con 0x7f2d8409f430 2023-10-03T10:19:02.527 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:19:02.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.530+0000 7f2d8aabf700 1 -- 172.21.15.146:0/3247935788 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d8409f430 msgr2=0x7f2d84121d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.530+0000 7f2d8aabf700 1 --2- 172.21.15.146:0/3247935788 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d8409f430 0x7f2d84121d60 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f2d7000e9e0 tx=0x7f2d7000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.530+0000 7f2d8aabf700 1 -- 172.21.15.146:0/3247935788 shutdown_connections 2023-10-03T10:19:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.530+0000 7f2d8aabf700 1 --2- 172.21.15.146:0/3247935788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d841391f0 0x7f2d841222a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.530+0000 7f2d8aabf700 1 --2- 172.21.15.146:0/3247935788 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d8409e950 0x7f2d84121820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.530+0000 7f2d8aabf700 1 --2- 172.21.15.146:0/3247935788 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2d8409f430 0x7f2d84121d60 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.530+0000 7f2d8aabf700 1 -- 172.21.15.146:0/3247935788 >> 172.21.15.146:0/3247935788 conn(0x7f2d840a0f70 msgr2=0x7f2d840a3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.530+0000 7f2d8aabf700 1 -- 172.21.15.146:0/3247935788 shutdown_connections 2023-10-03T10:19:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:02.530+0000 7f2d8aabf700 1 -- 172.21.15.146:0/3247935788 wait complete. 2023-10-03T10:19:02.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:19:03.146 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:03.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.272+0000 7f55a801d700 1 Processor -- start 2023-10-03T10:19:03.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.272+0000 7f55a801d700 1 -- start start 2023-10-03T10:19:03.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.273+0000 7f55a801d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55a0133900 0x7f55a0133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.273+0000 7f55a801d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55a00a10b0 0x7f55a013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.273+0000 7f55a801d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a009a760 con 0x7f55a0134210 2023-10-03T10:19:03.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.273+0000 7f55a801d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a01336e0 con 0x7f55a0133900 2023-10-03T10:19:03.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.273+0000 7f55a801d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55a009a080 con 0x7f55a00a10b0 2023-10-03T10:19:03.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.273+0000 7f55a65ba700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55a00a10b0 0x7f55a013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.273+0000 7f55a5db9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55a0133900 0x7f55a0133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.273+0000 7f55a55b8700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f55a0134210 0x7f55a00a09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55396/0 (socket says 172.21.15.146:55396) 2023-10-03T10:19:03.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.273+0000 7f55a55b8700 1 -- 172.21.15.146:0/2288069471 learned_addr learned my addr 172.21.15.146:0/2288069471 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:03.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.273+0000 7f55a65ba700 1 --2- 172.21.15.146:0/2288069471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55a00a10b0 0x7f55a013b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53590/0 (socket says 172.21.15.146:53590) 2023-10-03T10:19:03.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.273+0000 7f55a4db7700 1 -- 172.21.15.146:0/2288069471 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561797479 0 0) 0x7f55a009a760 con 0x7f55a0134210 2023-10-03T10:19:03.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.273+0000 7f55a4db7700 1 -- 172.21.15.146:0/2288069471 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f558c0035b0 con 0x7f55a0134210 2023-10-03T10:19:03.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.273+0000 7f55a5db9700 1 -- 172.21.15.146:0/2288069471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55a00a10b0 msgr2=0x7f55a013b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:03.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.273+0000 7f55a5db9700 1 --2- 172.21.15.146:0/2288069471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55a00a10b0 0x7f55a013b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.273+0000 7f55a5db9700 1 -- 172.21.15.146:0/2288069471 >> v1:172.21.15.146:6789/0 conn(0x7f55a0134210 legacy=0x7f55a00a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.273+0000 7f55a5db9700 1 -- 172.21.15.146:0/2288069471 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a00a23e0 con 0x7f55a0133900 2023-10-03T10:19:03.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.273+0000 7f55a65ba700 1 --2- 172.21.15.146:0/2288069471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55a00a10b0 0x7f55a013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:03.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.273+0000 7f55a5db9700 1 --2- 172.21.15.146:0/2288069471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55a0133900 0x7f55a0133cd0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f5590009850 tx=0x7f5590009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7309e8e7530d87aa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:03.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.273+0000 7f55a4db7700 1 -- 172.21.15.146:0/2288069471 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590005e30 con 0x7f55a0133900 2023-10-03T10:19:03.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.273+0000 7f55a4db7700 1 -- 172.21.15.146:0/2288069471 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5590006030 con 0x7f55a0133900 2023-10-03T10:19:03.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.274+0000 7f55a4db7700 1 -- 172.21.15.146:0/2288069471 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55900063e0 con 0x7f55a0133900 2023-10-03T10:19:03.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.274+0000 7f55a801d700 1 -- 172.21.15.146:0/2288069471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55a0133900 msgr2=0x7f55a0133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.274+0000 7f55a801d700 1 --2- 172.21.15.146:0/2288069471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55a0133900 0x7f55a0133cd0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f5590009850 tx=0x7f5590009b60 comp rx=0 tx=0).stop 2023-10-03T10:19:03.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.274+0000 7f55a801d700 1 -- 172.21.15.146:0/2288069471 shutdown_connections 2023-10-03T10:19:03.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.274+0000 7f55a801d700 1 --2- 172.21.15.146:0/2288069471 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55a00a10b0 0x7f55a013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.274+0000 7f55a801d700 1 --2- 172.21.15.146:0/2288069471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55a0133900 0x7f55a0133cd0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.274+0000 7f55a801d700 1 -- 172.21.15.146:0/2288069471 >> 172.21.15.146:0/2288069471 conn(0x7f55a00a2980 msgr2=0x7f55a00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:03.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.274+0000 7f55a801d700 1 -- 172.21.15.146:0/2288069471 shutdown_connections 2023-10-03T10:19:03.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.274+0000 7f55a801d700 1 -- 172.21.15.146:0/2288069471 wait complete. 2023-10-03T10:19:03.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.275+0000 7f55a801d700 1 Processor -- start 2023-10-03T10:19:03.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.275+0000 7f55a801d700 1 -- start start 2023-10-03T10:19:03.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.276+0000 7f55a801d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55a00a10b0 0x7f55a011d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.276+0000 7f55a801d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55a0133900 0x7f55a011dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.276+0000 7f55a801d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55a0134210 0x7f55a011e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.276+0000 7f55a801d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a011f400 con 0x7f55a00a10b0 2023-10-03T10:19:03.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.276+0000 7f55a801d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a0120650 con 0x7f55a0134210 2023-10-03T10:19:03.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.276+0000 7f55a801d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55a011f9e0 con 0x7f55a0133900 2023-10-03T10:19:03.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.276+0000 7f55a5db9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55a00a10b0 0x7f55a011d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.276+0000 7f55a5db9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55a00a10b0 0x7f55a011d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53860/0 (socket says 172.21.15.146:53860) 2023-10-03T10:19:03.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.276+0000 7f55a65ba700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55a0134210 0x7f55a011e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.276+0000 7f55a5db9700 1 -- 172.21.15.146:0/560707390 learned_addr learned my addr 172.21.15.146:0/560707390 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:03.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.276+0000 7f55a55b8700 1 --2- 172.21.15.146:0/560707390 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55a0133900 0x7f55a011dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.276+0000 7f55a5db9700 1 -- 172.21.15.146:0/560707390 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55a0133900 msgr2=0x7f55a011dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.276+0000 7f55a5db9700 1 --2- 172.21.15.146:0/560707390 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55a0133900 0x7f55a011dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.276+0000 7f55a5db9700 1 -- 172.21.15.146:0/560707390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55a0134210 msgr2=0x7f55a011e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.276+0000 7f55a5db9700 1 --2- 172.21.15.146:0/560707390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55a0134210 0x7f55a011e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.276+0000 7f55a5db9700 1 -- 172.21.15.146:0/560707390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5598009a70 con 0x7f55a00a10b0 2023-10-03T10:19:03.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.276+0000 7f55a65ba700 1 --2- 172.21.15.146:0/560707390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55a0134210 0x7f55a011e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:03.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.277+0000 7f55a5db9700 1 --2- 172.21.15.146:0/560707390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55a00a10b0 0x7f55a011d840 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f5590012000 tx=0x7f5590004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:03.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.277+0000 7f55967fc700 1 -- 172.21.15.146:0/560707390 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55900063a0 con 0x7f55a00a10b0 2023-10-03T10:19:03.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.277+0000 7f55967fc700 1 -- 172.21.15.146:0/560707390 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5590006500 con 0x7f55a00a10b0 2023-10-03T10:19:03.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.277+0000 7f55967fc700 1 -- 172.21.15.146:0/560707390 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55900068b0 con 0x7f55a00a10b0 2023-10-03T10:19:03.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.277+0000 7f55a801d700 1 -- 172.21.15.146:0/560707390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5590009430 con 0x7f55a00a10b0 2023-10-03T10:19:03.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.277+0000 7f55a801d700 1 -- 172.21.15.146:0/560707390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a0132c10 con 0x7f55a00a10b0 2023-10-03T10:19:03.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.277+0000 7f55967fc700 1 -- 172.21.15.146:0/560707390 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5590022070 con 0x7f55a00a10b0 2023-10-03T10:19:03.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.278+0000 7f55967fc700 1 -- 172.21.15.146:0/560707390 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5590040c50 con 0x7f55a00a10b0 2023-10-03T10:19:03.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.278+0000 7f55a801d700 1 -- 172.21.15.146:0/560707390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a011a590 con 0x7f55a00a10b0 2023-10-03T10:19:03.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.282+0000 7f55967fc700 1 -- 172.21.15.146:0/560707390 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f559002a070 con 0x7f55a00a10b0 2023-10-03T10:19:03.432 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:03.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.472+0000 7f55a801d700 1 -- 172.21.15.146:0/560707390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f55a0120f90 con 0x7f55a00a10b0 2023-10-03T10:19:03.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.473+0000 7f55967fc700 1 -- 172.21.15.146:0/560707390 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5590025470 con 0x7f55a00a10b0 2023-10-03T10:19:03.473 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:03.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.475+0000 7f55a801d700 1 -- 172.21.15.146:0/560707390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55a00a10b0 msgr2=0x7f55a011d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.475+0000 7f55a801d700 1 --2- 172.21.15.146:0/560707390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55a00a10b0 0x7f55a011d840 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f5590012000 tx=0x7f5590004750 comp rx=0 tx=0).stop 2023-10-03T10:19:03.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.475+0000 7f55a801d700 1 -- 172.21.15.146:0/560707390 shutdown_connections 2023-10-03T10:19:03.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.475+0000 7f55a801d700 1 --2- 172.21.15.146:0/560707390 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55a0134210 0x7f55a011e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.475+0000 7f55a801d700 1 --2- 172.21.15.146:0/560707390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55a00a10b0 0x7f55a011d840 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.475+0000 7f55a801d700 1 --2- 172.21.15.146:0/560707390 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f55a0133900 0x7f55a011dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.475+0000 7f55a801d700 1 -- 172.21.15.146:0/560707390 >> 172.21.15.146:0/560707390 conn(0x7f55a00a2980 msgr2=0x7f55a01baea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:03.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.475+0000 7f55a801d700 1 -- 172.21.15.146:0/560707390 shutdown_connections 2023-10-03T10:19:03.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.475+0000 7f55a801d700 1 -- 172.21.15.146:0/560707390 wait complete. 2023-10-03T10:19:03.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:19:03.492 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:03.542 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:03.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.562+0000 7f4abd81a700 1 Processor -- start 2023-10-03T10:19:03.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.562+0000 7f4abd81a700 1 -- start start 2023-10-03T10:19:03.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.563+0000 7f4abd81a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ab809e340 0x7f4ab81359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.563+0000 7f4abd81a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ab8135f20 0x7f4ab8138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.563+0000 7f4abd81a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab809aaa0 con 0x7f4ab809d860 2023-10-03T10:19:03.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.563+0000 7f4abd81a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab809e730 con 0x7f4ab809e340 2023-10-03T10:19:03.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.563+0000 7f4abd81a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab809f870 con 0x7f4ab8135f20 2023-10-03T10:19:03.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.563+0000 7f4ab67fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ab809e340 0x7f4ab81359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.563+0000 7f4ab77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ab8135f20 0x7f4ab8138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.563+0000 7f4ab6ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4ab809d860 0x7f4ab809dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55406/0 (socket says 172.21.15.146:55406) 2023-10-03T10:19:03.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.563+0000 7f4ab67fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ab809e340 0x7f4ab81359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50762/0 (socket says 172.21.15.146:50762) 2023-10-03T10:19:03.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.563+0000 7f4ab6ffd700 1 -- 172.21.15.146:0/2996002059 learned_addr learned my addr 172.21.15.146:0/2996002059 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:03.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.563+0000 7f4ab77fe700 1 -- 172.21.15.146:0/2996002059 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ab809e340 msgr2=0x7f4ab81359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:03.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.563+0000 7f4ab77fe700 1 --2- 172.21.15.146:0/2996002059 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ab809e340 0x7f4ab81359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.563+0000 7f4ab5ffb700 1 -- 172.21.15.146:0/2996002059 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3608515029 0 0) 0x7f4ab809aaa0 con 0x7f4ab809d860 2023-10-03T10:19:03.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.563+0000 7f4ab77fe700 1 -- 172.21.15.146:0/2996002059 >> v1:172.21.15.146:6789/0 conn(0x7f4ab809d860 legacy=0x7f4ab809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.563+0000 7f4ab77fe700 1 -- 172.21.15.146:0/2996002059 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab809b360 con 0x7f4ab8135f20 2023-10-03T10:19:03.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.563+0000 7f4ab67fc700 1 --2- 172.21.15.146:0/2996002059 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ab809e340 0x7f4ab81359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:03.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.564+0000 7f4ab77fe700 1 --2- 172.21.15.146:0/2996002059 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ab8135f20 0x7f4ab8138300 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f4ab000be90 tx=0x7f4ab00092f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea0487bbf6c83286 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:03.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.564+0000 7f4ab5ffb700 1 -- 172.21.15.146:0/2996002059 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab000c850 con 0x7f4ab8135f20 2023-10-03T10:19:03.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.564+0000 7f4ab5ffb700 1 -- 172.21.15.146:0/2996002059 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab000c9b0 con 0x7f4ab8135f20 2023-10-03T10:19:03.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.564+0000 7f4ab5ffb700 1 -- 172.21.15.146:0/2996002059 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab000cd40 con 0x7f4ab8135f20 2023-10-03T10:19:03.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.565+0000 7f4abd81a700 1 -- 172.21.15.146:0/2996002059 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ab8135f20 msgr2=0x7f4ab8138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.565+0000 7f4abd81a700 1 --2- 172.21.15.146:0/2996002059 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ab8135f20 0x7f4ab8138300 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f4ab000be90 tx=0x7f4ab00092f0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.565+0000 7f4abd81a700 1 -- 172.21.15.146:0/2996002059 shutdown_connections 2023-10-03T10:19:03.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.565+0000 7f4abd81a700 1 --2- 172.21.15.146:0/2996002059 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ab8135f20 0x7f4ab8138300 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.565+0000 7f4abd81a700 1 --2- 172.21.15.146:0/2996002059 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ab809e340 0x7f4ab81359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.565+0000 7f4abd81a700 1 -- 172.21.15.146:0/2996002059 >> 172.21.15.146:0/2996002059 conn(0x7f4ab8099c40 msgr2=0x7f4ab80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:03.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.565+0000 7f4abd81a700 1 -- 172.21.15.146:0/2996002059 shutdown_connections 2023-10-03T10:19:03.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.565+0000 7f4abd81a700 1 -- 172.21.15.146:0/2996002059 wait complete. 2023-10-03T10:19:03.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.566+0000 7f4abd81a700 1 Processor -- start 2023-10-03T10:19:03.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.566+0000 7f4abd81a700 1 -- start start 2023-10-03T10:19:03.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.567+0000 7f4abd81a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ab809d860 0x7f4ab811b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.567+0000 7f4abd81a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ab809e340 0x7f4ab811b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.567+0000 7f4abd81a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ab8135f20 0x7f4ab811bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.567+0000 7f4abd81a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab811eea0 con 0x7f4ab8135f20 2023-10-03T10:19:03.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.567+0000 7f4abd81a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab80a0700 con 0x7f4ab809d860 2023-10-03T10:19:03.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.567+0000 7f4abd81a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab809c8b0 con 0x7f4ab809e340 2023-10-03T10:19:03.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.567+0000 7f4ab67fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ab809e340 0x7f4ab811b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.567+0000 7f4ab67fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ab809e340 0x7f4ab811b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53622/0 (socket says 172.21.15.146:53622) 2023-10-03T10:19:03.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.567+0000 7f4ab67fc700 1 -- 172.21.15.146:0/3862121994 learned_addr learned my addr 172.21.15.146:0/3862121994 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:03.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.567+0000 7f4ab77fe700 1 --2- 172.21.15.146:0/3862121994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ab8135f20 0x7f4ab811bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.567+0000 7f4ab6ffd700 1 --2- 172.21.15.146:0/3862121994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ab809d860 0x7f4ab811b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.568+0000 7f4ab67fc700 1 -- 172.21.15.146:0/3862121994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ab809d860 msgr2=0x7f4ab811b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.568+0000 7f4ab67fc700 1 --2- 172.21.15.146:0/3862121994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ab809d860 0x7f4ab811b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.568+0000 7f4ab67fc700 1 -- 172.21.15.146:0/3862121994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ab8135f20 msgr2=0x7f4ab811bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.568+0000 7f4ab67fc700 1 --2- 172.21.15.146:0/3862121994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ab8135f20 0x7f4ab811bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.568+0000 7f4ab67fc700 1 -- 172.21.15.146:0/3862121994 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac00d940 con 0x7f4ab809e340 2023-10-03T10:19:03.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.568+0000 7f4ab6ffd700 1 --2- 172.21.15.146:0/3862121994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ab809d860 0x7f4ab811b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:03.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.568+0000 7f4ab77fe700 1 --2- 172.21.15.146:0/3862121994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ab8135f20 0x7f4ab811bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:03.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.568+0000 7f4ab67fc700 1 --2- 172.21.15.146:0/3862121994 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ab809e340 0x7f4ab811b890 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f4aac012fc0 tx=0x7f4aac0103a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:03.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.568+0000 7f4a9ffff700 1 -- 172.21.15.146:0/3862121994 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac010b00 con 0x7f4ab809e340 2023-10-03T10:19:03.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.568+0000 7f4a9ffff700 1 -- 172.21.15.146:0/3862121994 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aac013040 con 0x7f4ab809e340 2023-10-03T10:19:03.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.568+0000 7f4a9ffff700 1 -- 172.21.15.146:0/3862121994 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac010e80 con 0x7f4ab809e340 2023-10-03T10:19:03.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.568+0000 7f4abd81a700 1 -- 172.21.15.146:0/3862121994 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab000ba90 con 0x7f4ab809e340 2023-10-03T10:19:03.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.568+0000 7f4abd81a700 1 -- 172.21.15.146:0/3862121994 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab811c720 con 0x7f4ab809e340 2023-10-03T10:19:03.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.569+0000 7f4a9ffff700 1 -- 172.21.15.146:0/3862121994 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4aac018480 con 0x7f4ab809e340 2023-10-03T10:19:03.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.569+0000 7f4a9ffff700 1 -- 172.21.15.146:0/3862121994 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4aac043690 con 0x7f4ab809e340 2023-10-03T10:19:03.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.570+0000 7f4abd81a700 1 -- 172.21.15.146:0/3862121994 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab811e900 con 0x7f4ab809e340 2023-10-03T10:19:03.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.574+0000 7f4a9ffff700 1 -- 172.21.15.146:0/3862121994 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4aac016930 con 0x7f4ab809e340 2023-10-03T10:19:03.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.659+0000 7f53dab69700 1 Processor -- start 2023-10-03T10:19:03.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.659+0000 7f53dab69700 1 -- start start 2023-10-03T10:19:03.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.659+0000 7f53dab69700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d40a0a70 0x7f53d40a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.660+0000 7f53dab69700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f53d4134120 0x7f53d413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.660+0000 7f53dab69700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d409dc00 con 0x7f53d40a1380 2023-10-03T10:19:03.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.660+0000 7f53dab69700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d409ea60 con 0x7f53d4134120 2023-10-03T10:19:03.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.660+0000 7f53dab69700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d409dec0 con 0x7f53d40a0a70 2023-10-03T10:19:03.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.660+0000 7f53d8905700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d40a0a70 0x7f53d40a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.660+0000 7f53d9106700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f53d4134120 0x7f53d413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.660+0000 7f53d8905700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d40a0a70 0x7f53d40a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50772/0 (socket says 172.21.15.146:50772) 2023-10-03T10:19:03.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.660+0000 7f53d9106700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f53d4134120 0x7f53d413bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53870/0 (socket says 172.21.15.146:53870) 2023-10-03T10:19:03.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.660+0000 7f53d8905700 1 -- 172.21.15.146:0/2537827945 learned_addr learned my addr 172.21.15.146:0/2537827945 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:03.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.660+0000 7f53d9106700 1 -- 172.21.15.146:0/2537827945 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d40a0a70 msgr2=0x7f53d40a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:03.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.660+0000 7f53d9106700 1 --2- 172.21.15.146:0/2537827945 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d40a0a70 0x7f53d40a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.660+0000 7f53d9106700 1 -- 172.21.15.146:0/2537827945 >> v1:172.21.15.146:6789/0 conn(0x7f53d40a1380 legacy=0x7f53d4133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.660+0000 7f53d9106700 1 -- 172.21.15.146:0/2537827945 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d409e6a0 con 0x7f53d4134120 2023-10-03T10:19:03.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.660+0000 7f53d37fe700 1 -- 172.21.15.146:0/2537827945 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1991167278 0 0) 0x7f53d409dc00 con 0x7f53d40a1380 2023-10-03T10:19:03.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.660+0000 7f53d8905700 1 --2- 172.21.15.146:0/2537827945 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d40a0a70 0x7f53d40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:03.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.660+0000 7f53d9106700 1 --2- 172.21.15.146:0/2537827945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53d4134120 0x7f53d413bce0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009d90 tx=0x7f53cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165e6007c26c32e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:03.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.660+0000 7f53d37fe700 1 -- 172.21.15.146:0/2537827945 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc00e070 con 0x7f53d4134120 2023-10-03T10:19:03.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.660+0000 7f53d37fe700 1 -- 172.21.15.146:0/2537827945 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc00bb20 con 0x7f53d4134120 2023-10-03T10:19:03.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.660+0000 7f53d37fe700 1 -- 172.21.15.146:0/2537827945 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc012430 con 0x7f53d4134120 2023-10-03T10:19:03.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.661+0000 7f53dab69700 1 -- 172.21.15.146:0/2537827945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53d4134120 msgr2=0x7f53d413bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.661+0000 7f53dab69700 1 --2- 172.21.15.146:0/2537827945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53d4134120 0x7f53d413bce0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009d90 tx=0x7f53cc00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:03.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.661+0000 7f53dab69700 1 -- 172.21.15.146:0/2537827945 shutdown_connections 2023-10-03T10:19:03.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.661+0000 7f53dab69700 1 --2- 172.21.15.146:0/2537827945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53d4134120 0x7f53d413bce0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.661+0000 7f53dab69700 1 --2- 172.21.15.146:0/2537827945 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d40a0a70 0x7f53d40a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.661+0000 7f53dab69700 1 -- 172.21.15.146:0/2537827945 >> 172.21.15.146:0/2537827945 conn(0x7f53d40a6610 msgr2=0x7f53d40a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:03.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.661+0000 7f53dab69700 1 -- 172.21.15.146:0/2537827945 shutdown_connections 2023-10-03T10:19:03.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.661+0000 7f53dab69700 1 -- 172.21.15.146:0/2537827945 wait complete. 2023-10-03T10:19:03.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.662+0000 7f53dab69700 1 Processor -- start 2023-10-03T10:19:03.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.662+0000 7f53dab69700 1 -- start start 2023-10-03T10:19:03.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.663+0000 7f53dab69700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53d40a0a70 0x7f53d4122680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.663+0000 7f53dab69700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53d40a1380 0x7f53d4122bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.663+0000 7f53dab69700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d4134120 0x7f53d4123100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.663+0000 7f53dab69700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d4125ec0 con 0x7f53d40a1380 2023-10-03T10:19:03.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.663+0000 7f53dab69700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d41243a0 con 0x7f53d4134120 2023-10-03T10:19:03.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.663+0000 7f53dab69700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53d40a03e0 con 0x7f53d40a0a70 2023-10-03T10:19:03.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.663+0000 7f53d3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53d40a1380 0x7f53d4122bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.663+0000 7f53d9106700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d4134120 0x7f53d4123100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.663+0000 7f53d3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53d40a1380 0x7f53d4122bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53876/0 (socket says 172.21.15.146:53876) 2023-10-03T10:19:03.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.663+0000 7f53d3fff700 1 -- 172.21.15.146:0/630380889 learned_addr learned my addr 172.21.15.146:0/630380889 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:03.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.663+0000 7f53d8905700 1 --2- 172.21.15.146:0/630380889 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53d40a0a70 0x7f53d4122680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.663+0000 7f53d9106700 1 -- 172.21.15.146:0/630380889 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53d40a0a70 msgr2=0x7f53d4122680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.663+0000 7f53d9106700 1 --2- 172.21.15.146:0/630380889 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53d40a0a70 0x7f53d4122680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.663+0000 7f53d9106700 1 -- 172.21.15.146:0/630380889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53d40a1380 msgr2=0x7f53d4122bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.663+0000 7f53d9106700 1 --2- 172.21.15.146:0/630380889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53d40a1380 0x7f53d4122bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.663+0000 7f53d9106700 1 -- 172.21.15.146:0/630380889 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c8009550 con 0x7f53d4134120 2023-10-03T10:19:03.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.663+0000 7f53d3fff700 1 --2- 172.21.15.146:0/630380889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53d40a1380 0x7f53d4122bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:03.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.663+0000 7f53d9106700 1 --2- 172.21.15.146:0/630380889 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d4134120 0x7f53d4123100 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f53cc016000 tx=0x7f53cc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:03.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.663+0000 7f53d17fa700 1 -- 172.21.15.146:0/630380889 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc012430 con 0x7f53d4134120 2023-10-03T10:19:03.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.664+0000 7f53d17fa700 1 -- 172.21.15.146:0/630380889 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc020070 con 0x7f53d4134120 2023-10-03T10:19:03.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.664+0000 7f53d17fa700 1 -- 172.21.15.146:0/630380889 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc004280 con 0x7f53d4134120 2023-10-03T10:19:03.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.664+0000 7f53dab69700 1 -- 172.21.15.146:0/630380889 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53cc009a70 con 0x7f53d4134120 2023-10-03T10:19:03.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.664+0000 7f53dab69700 1 -- 172.21.15.146:0/630380889 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d41339a0 con 0x7f53d4134120 2023-10-03T10:19:03.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.665+0000 7f53d17fa700 1 -- 172.21.15.146:0/630380889 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f53cc0043e0 con 0x7f53d4134120 2023-10-03T10:19:03.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.665+0000 7f53dab69700 1 -- 172.21.15.146:0/630380889 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d404f2a0 con 0x7f53d4134120 2023-10-03T10:19:03.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.665+0000 7f53d17fa700 1 -- 172.21.15.146:0/630380889 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f53cc022070 con 0x7f53d4134120 2023-10-03T10:19:03.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.670+0000 7f53d17fa700 1 -- 172.21.15.146:0/630380889 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f53cc012e40 con 0x7f53d4134120 2023-10-03T10:19:03.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.689+0000 7faf209f5700 1 Processor -- start 2023-10-03T10:19:03.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.689+0000 7faf209f5700 1 -- start start 2023-10-03T10:19:03.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.690+0000 7faf209f5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faf1c09e870 0x7faf1c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.690+0000 7faf209f5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faf1c09f180 0x7faf1c131830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.690+0000 7faf209f5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf1c131d70 0x7faf1c1321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.690+0000 7faf209f5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf1c0a0920 con 0x7faf1c09e870 2023-10-03T10:19:03.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.690+0000 7faf209f5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c09c970 con 0x7faf1c131d70 2023-10-03T10:19:03.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.690+0000 7faf209f5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c09bab0 con 0x7faf1c09f180 2023-10-03T10:19:03.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.690+0000 7faf19d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faf1c09f180 0x7faf1c131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.690+0000 7faf19d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faf1c09f180 0x7faf1c131830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:53646/0 (socket says 172.21.15.146:53646) 2023-10-03T10:19:03.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.690+0000 7faf19d9b700 1 -- 172.21.15.146:0/1650902242 learned_addr learned my addr 172.21.15.146:0/1650902242 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:03.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.690+0000 7faf1a59c700 1 --2- 172.21.15.146:0/1650902242 >> v2:172.21.15.146:3300/0 conn(0x7faf1c09e870 0x7faf1c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.690+0000 7faf1ad9d700 1 --2- 172.21.15.146:0/1650902242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf1c131d70 0x7faf1c1321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.690+0000 7faf1a59c700 1 -- 172.21.15.146:0/1650902242 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faf1c09f180 msgr2=0x7faf1c131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:03.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.690+0000 7faf1a59c700 1 --2- 172.21.15.146:0/1650902242 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faf1c09f180 0x7faf1c131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.690+0000 7faf1a59c700 1 -- 172.21.15.146:0/1650902242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf1c131d70 msgr2=0x7faf1c1321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:03.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.690+0000 7faf1a59c700 1 --2- 172.21.15.146:0/1650902242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf1c131d70 0x7faf1c1321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.690+0000 7faf1a59c700 1 -- 172.21.15.146:0/1650902242 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1c09f9c0 con 0x7faf1c09e870 2023-10-03T10:19:03.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.690+0000 7faf1ad9d700 1 --2- 172.21.15.146:0/1650902242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf1c131d70 0x7faf1c1321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:03.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.691+0000 7faf1a59c700 1 --2- 172.21.15.146:0/1650902242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf1c09e870 0x7faf1c09ec40 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7faf0c009870 tx=0x7faf0c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732eb65232d033b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:03.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.691+0000 7faf1959a700 1 -- 172.21.15.146:0/1650902242 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c011830 con 0x7faf1c09e870 2023-10-03T10:19:03.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.691+0000 7faf1959a700 1 -- 172.21.15.146:0/1650902242 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c011990 con 0x7faf1c09e870 2023-10-03T10:19:03.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.691+0000 7faf1959a700 1 -- 172.21.15.146:0/1650902242 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c011d20 con 0x7faf1c09e870 2023-10-03T10:19:03.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.691+0000 7faf209f5700 1 -- 172.21.15.146:0/1650902242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf1c09e870 msgr2=0x7faf1c09ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.691+0000 7faf209f5700 1 --2- 172.21.15.146:0/1650902242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf1c09e870 0x7faf1c09ec40 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7faf0c009870 tx=0x7faf0c009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:03.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.691+0000 7faf209f5700 1 -- 172.21.15.146:0/1650902242 shutdown_connections 2023-10-03T10:19:03.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.691+0000 7faf209f5700 1 --2- 172.21.15.146:0/1650902242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf1c131d70 0x7faf1c1321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.691+0000 7faf209f5700 1 --2- 172.21.15.146:0/1650902242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf1c09e870 0x7faf1c09ec40 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.691+0000 7faf209f5700 1 --2- 172.21.15.146:0/1650902242 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faf1c09f180 0x7faf1c131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.692+0000 7faf209f5700 1 -- 172.21.15.146:0/1650902242 >> 172.21.15.146:0/1650902242 conn(0x7faf1c0a4430 msgr2=0x7faf1c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:03.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.692+0000 7faf209f5700 1 -- 172.21.15.146:0/1650902242 shutdown_connections 2023-10-03T10:19:03.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.692+0000 7faf209f5700 1 -- 172.21.15.146:0/1650902242 wait complete. 2023-10-03T10:19:03.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.693+0000 7faf209f5700 1 Processor -- start 2023-10-03T10:19:03.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.693+0000 7faf209f5700 1 -- start start 2023-10-03T10:19:03.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf209f5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf1c09e870 0x7faf1c1204e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf209f5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faf1c09f180 0x7faf1c120a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf209f5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf1c131d70 0x7faf1c120f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf209f5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c123f70 con 0x7faf1c131d70 2023-10-03T10:19:03.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf209f5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c121940 con 0x7faf1c09e870 2023-10-03T10:19:03.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf209f5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c122060 con 0x7faf1c09f180 2023-10-03T10:19:03.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf1a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf1c09e870 0x7faf1c1204e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf1a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf1c09e870 0x7faf1c1204e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:50804/0 (socket says 172.21.15.146:50804) 2023-10-03T10:19:03.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf1a59c700 1 -- 172.21.15.146:0/455474314 learned_addr learned my addr 172.21.15.146:0/455474314 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:03.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf19d9b700 1 --2- 172.21.15.146:0/455474314 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faf1c09f180 0x7faf1c120a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf1ad9d700 1 --2- 172.21.15.146:0/455474314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf1c131d70 0x7faf1c120f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf1a59c700 1 -- 172.21.15.146:0/455474314 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faf1c09f180 msgr2=0x7faf1c120a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf1a59c700 1 --2- 172.21.15.146:0/455474314 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faf1c09f180 0x7faf1c120a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf1a59c700 1 -- 172.21.15.146:0/455474314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf1c131d70 msgr2=0x7faf1c120f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf1a59c700 1 --2- 172.21.15.146:0/455474314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf1c131d70 0x7faf1c120f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf1a59c700 1 -- 172.21.15.146:0/455474314 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf14009a70 con 0x7faf1c09e870 2023-10-03T10:19:03.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf1ad9d700 1 --2- 172.21.15.146:0/455474314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf1c131d70 0x7faf1c120f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:03.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf1a59c700 1 --2- 172.21.15.146:0/455474314 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf1c09e870 0x7faf1c1204e0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7faf0c000c00 tx=0x7faf0c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:03.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf0affd700 1 -- 172.21.15.146:0/455474314 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c004510 con 0x7faf1c09e870 2023-10-03T10:19:03.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf0affd700 1 -- 172.21.15.146:0/455474314 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c01f070 con 0x7faf1c09e870 2023-10-03T10:19:03.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf0affd700 1 -- 172.21.15.146:0/455474314 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c0038e0 con 0x7faf1c09e870 2023-10-03T10:19:03.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf209f5700 1 -- 172.21.15.146:0/455474314 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0c0094a0 con 0x7faf1c09e870 2023-10-03T10:19:03.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.694+0000 7faf209f5700 1 -- 172.21.15.146:0/455474314 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf1c1313a0 con 0x7faf1c09e870 2023-10-03T10:19:03.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.695+0000 7faf0affd700 1 -- 172.21.15.146:0/455474314 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf0c003a40 con 0x7faf1c09e870 2023-10-03T10:19:03.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.696+0000 7faf0affd700 1 -- 172.21.15.146:0/455474314 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faf0c021070 con 0x7faf1c09e870 2023-10-03T10:19:03.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.696+0000 7faf08ff9700 1 -- 172.21.15.146:0/455474314 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf1c04f2a0 con 0x7faf1c09e870 2023-10-03T10:19:03.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.700+0000 7faf0affd700 1 -- 172.21.15.146:0/455474314 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf0c02b070 con 0x7faf1c09e870 2023-10-03T10:19:03.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.789+0000 7f4abd81a700 1 -- 172.21.15.146:0/3862121994 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4ab804f2a0 con 0x7f4ab809e340 2023-10-03T10:19:03.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.789+0000 7f4a9ffff700 1 -- 172.21.15.146:0/3862121994 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4aac016340 con 0x7f4ab809e340 2023-10-03T10:19:03.789 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:03.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.791+0000 7f4abd81a700 1 -- 172.21.15.146:0/3862121994 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ab809e340 msgr2=0x7f4ab811b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.791+0000 7f4abd81a700 1 --2- 172.21.15.146:0/3862121994 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ab809e340 0x7f4ab811b890 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f4aac012fc0 tx=0x7f4aac0103a0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.791+0000 7f4abd81a700 1 -- 172.21.15.146:0/3862121994 shutdown_connections 2023-10-03T10:19:03.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.791+0000 7f4abd81a700 1 --2- 172.21.15.146:0/3862121994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ab8135f20 0x7f4ab811bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.791+0000 7f4abd81a700 1 --2- 172.21.15.146:0/3862121994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ab809d860 0x7f4ab811b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.791+0000 7f4abd81a700 1 --2- 172.21.15.146:0/3862121994 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4ab809e340 0x7f4ab811b890 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.791+0000 7f4abd81a700 1 -- 172.21.15.146:0/3862121994 >> 172.21.15.146:0/3862121994 conn(0x7f4ab8099c40 msgr2=0x7f4ab81328a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:03.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.791+0000 7f4abd81a700 1 -- 172.21.15.146:0/3862121994 shutdown_connections 2023-10-03T10:19:03.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.791+0000 7f4abd81a700 1 -- 172.21.15.146:0/3862121994 wait complete. 2023-10-03T10:19:03.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:19:03.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.866+0000 7f53dab69700 1 -- 172.21.15.146:0/630380889 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f53d4072980 con 0x7f53d4134120 2023-10-03T10:19:03.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.867+0000 7f53d17fa700 1 -- 172.21.15.146:0/630380889 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f53cc02c030 con 0x7f53d4134120 2023-10-03T10:19:03.866 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:19:03.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.868+0000 7f53dab69700 1 -- 172.21.15.146:0/630380889 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d4134120 msgr2=0x7f53d4123100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.868+0000 7f53dab69700 1 --2- 172.21.15.146:0/630380889 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d4134120 0x7f53d4123100 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f53cc016000 tx=0x7f53cc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.869+0000 7f53dab69700 1 -- 172.21.15.146:0/630380889 shutdown_connections 2023-10-03T10:19:03.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.869+0000 7f53dab69700 1 --2- 172.21.15.146:0/630380889 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53d4134120 0x7f53d4123100 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.869+0000 7f53dab69700 1 --2- 172.21.15.146:0/630380889 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f53d40a0a70 0x7f53d4122680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.869+0000 7f53dab69700 1 --2- 172.21.15.146:0/630380889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53d40a1380 0x7f53d4122bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.869+0000 7f53dab69700 1 -- 172.21.15.146:0/630380889 >> 172.21.15.146:0/630380889 conn(0x7f53d40a6610 msgr2=0x7f53d40a4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:03.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.869+0000 7f53dab69700 1 -- 172.21.15.146:0/630380889 shutdown_connections 2023-10-03T10:19:03.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.869+0000 7f53dab69700 1 -- 172.21.15.146:0/630380889 wait complete. 2023-10-03T10:19:03.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:19:03.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.910+0000 7faf08ff9700 1 -- 172.21.15.146:0/455474314 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faf1c09fc00 con 0x7faf1c09e870 2023-10-03T10:19:03.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.910+0000 7faf0affd700 1 -- 172.21.15.146:0/455474314 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf1c09fc00 con 0x7faf1c09e870 2023-10-03T10:19:03.910 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:19:03.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.912+0000 7faf08ff9700 1 -- 172.21.15.146:0/455474314 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf1c09e870 msgr2=0x7faf1c1204e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.912+0000 7faf08ff9700 1 --2- 172.21.15.146:0/455474314 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf1c09e870 0x7faf1c1204e0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7faf0c000c00 tx=0x7faf0c004750 comp rx=0 tx=0).stop 2023-10-03T10:19:03.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.912+0000 7faf08ff9700 1 -- 172.21.15.146:0/455474314 shutdown_connections 2023-10-03T10:19:03.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.912+0000 7faf08ff9700 1 --2- 172.21.15.146:0/455474314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf1c131d70 0x7faf1c120f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.912+0000 7faf08ff9700 1 --2- 172.21.15.146:0/455474314 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf1c09e870 0x7faf1c1204e0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.912+0000 7faf08ff9700 1 --2- 172.21.15.146:0/455474314 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faf1c09f180 0x7faf1c120a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.912+0000 7faf08ff9700 1 -- 172.21.15.146:0/455474314 >> 172.21.15.146:0/455474314 conn(0x7faf1c0a4430 msgr2=0x7faf1c070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:03.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.912+0000 7faf08ff9700 1 -- 172.21.15.146:0/455474314 shutdown_connections 2023-10-03T10:19:03.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:03.912+0000 7faf08ff9700 1 -- 172.21.15.146:0/455474314 wait complete. 2023-10-03T10:19:03.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:19:04.489 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:04.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.615+0000 7f42eca75700 1 Processor -- start 2023-10-03T10:19:04.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.615+0000 7f42eca75700 1 -- start start 2023-10-03T10:19:04.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.615+0000 7f42eca75700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42e8133ad0 0x7f42e8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.615+0000 7f42eca75700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42e8130bc0 0x7f42e813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.616+0000 7f42eca75700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e806b2d0 con 0x7f42e81300a0 2023-10-03T10:19:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.616+0000 7f42eca75700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e8133610 con 0x7f42e8130bc0 2023-10-03T10:19:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.616+0000 7f42eca75700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42e809a500 con 0x7f42e8133ad0 2023-10-03T10:19:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.616+0000 7f42e659c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42e8133ad0 0x7f42e8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.616+0000 7f42e6d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42e8130bc0 0x7f42e813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.616+0000 7f42e5d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f42e81300a0 0x7f42e81304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36578/0 (socket says 172.21.15.146:36578) 2023-10-03T10:19:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.616+0000 7f42e5d9b700 1 -- 172.21.15.146:0/2215746373 learned_addr learned my addr 172.21.15.146:0/2215746373 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.616+0000 7f42e559a700 1 -- 172.21.15.146:0/2215746373 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 475670550 0 0) 0x7f42e806b2d0 con 0x7f42e81300a0 2023-10-03T10:19:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.616+0000 7f42e559a700 1 -- 172.21.15.146:0/2215746373 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42d00035b0 con 0x7f42e81300a0 2023-10-03T10:19:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.616+0000 7f42e6d9d700 1 -- 172.21.15.146:0/2215746373 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42e8133ad0 msgr2=0x7f42e8133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.616+0000 7f42e6d9d700 1 --2- 172.21.15.146:0/2215746373 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42e8133ad0 0x7f42e8133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.616+0000 7f42e6d9d700 1 -- 172.21.15.146:0/2215746373 >> v1:172.21.15.146:6789/0 conn(0x7f42e81300a0 legacy=0x7f42e81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.616+0000 7f42e6d9d700 1 -- 172.21.15.146:0/2215746373 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e81338b0 con 0x7f42e8130bc0 2023-10-03T10:19:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.616+0000 7f42e659c700 1 --2- 172.21.15.146:0/2215746373 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42e8133ad0 0x7f42e8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.616+0000 7f42e6d9d700 1 --2- 172.21.15.146:0/2215746373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42e8130bc0 0x7f42e813b990 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f42e0009dc0 tx=0x7f42e000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6647bc25460502da server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.616+0000 7f42e559a700 1 -- 172.21.15.146:0/2215746373 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e000e070 con 0x7f42e8130bc0 2023-10-03T10:19:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.616+0000 7f42e559a700 1 -- 172.21.15.146:0/2215746373 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e000bb20 con 0x7f42e8130bc0 2023-10-03T10:19:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.616+0000 7f42e559a700 1 -- 172.21.15.146:0/2215746373 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0012430 con 0x7f42e8130bc0 2023-10-03T10:19:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.617+0000 7f42eca75700 1 -- 172.21.15.146:0/2215746373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42e8130bc0 msgr2=0x7f42e813b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.617+0000 7f42eca75700 1 --2- 172.21.15.146:0/2215746373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42e8130bc0 0x7f42e813b990 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f42e0009dc0 tx=0x7f42e000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.617+0000 7f42eca75700 1 -- 172.21.15.146:0/2215746373 shutdown_connections 2023-10-03T10:19:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.617+0000 7f42eca75700 1 --2- 172.21.15.146:0/2215746373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42e8130bc0 0x7f42e813b990 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.617+0000 7f42eca75700 1 --2- 172.21.15.146:0/2215746373 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42e8133ad0 0x7f42e8133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.617+0000 7f42eca75700 1 -- 172.21.15.146:0/2215746373 >> 172.21.15.146:0/2215746373 conn(0x7f42e8099c40 msgr2=0x7f42e80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.617+0000 7f42eca75700 1 -- 172.21.15.146:0/2215746373 shutdown_connections 2023-10-03T10:19:04.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.617+0000 7f42eca75700 1 -- 172.21.15.146:0/2215746373 wait complete. 2023-10-03T10:19:04.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.618+0000 7f42eca75700 1 Processor -- start 2023-10-03T10:19:04.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.618+0000 7f42eca75700 1 -- start start 2023-10-03T10:19:04.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.618+0000 7f42eca75700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42e81300a0 0x7f42e811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.618+0000 7f42eca75700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42e8130bc0 0x7f42e811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.618+0000 7f42eca75700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42e8133ad0 0x7f42e811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.618+0000 7f42eca75700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e811fe10 con 0x7f42e81300a0 2023-10-03T10:19:04.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.618+0000 7f42eca75700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e8120010 con 0x7f42e8133ad0 2023-10-03T10:19:04.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.618+0000 7f42eca75700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42e811eaf0 con 0x7f42e8130bc0 2023-10-03T10:19:04.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.619+0000 7f42e659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42e81300a0 0x7f42e811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.619+0000 7f42e6d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42e8133ad0 0x7f42e811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.619+0000 7f42e659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42e81300a0 0x7f42e811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51558/0 (socket says 172.21.15.146:51558) 2023-10-03T10:19:04.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.619+0000 7f42e659c700 1 -- 172.21.15.146:0/3782755368 learned_addr learned my addr 172.21.15.146:0/3782755368 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:04.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.619+0000 7f42e5d9b700 1 --2- 172.21.15.146:0/3782755368 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42e8130bc0 0x7f42e811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.619+0000 7f42e659c700 1 -- 172.21.15.146:0/3782755368 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42e8130bc0 msgr2=0x7f42e811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.619+0000 7f42e659c700 1 --2- 172.21.15.146:0/3782755368 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42e8130bc0 0x7f42e811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.619+0000 7f42e659c700 1 -- 172.21.15.146:0/3782755368 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42e8133ad0 msgr2=0x7f42e811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.619+0000 7f42e659c700 1 --2- 172.21.15.146:0/3782755368 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42e8133ad0 0x7f42e811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.619+0000 7f42e659c700 1 -- 172.21.15.146:0/3782755368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42dc0094a0 con 0x7f42e81300a0 2023-10-03T10:19:04.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.619+0000 7f42e6d9d700 1 --2- 172.21.15.146:0/3782755368 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42e8133ad0 0x7f42e811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:04.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.619+0000 7f42e659c700 1 --2- 172.21.15.146:0/3782755368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42e81300a0 0x7f42e811da40 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00ebe0 tx=0x7f42dc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.619+0000 7f42d6ffd700 1 -- 172.21.15.146:0/3782755368 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc00c850 con 0x7f42e81300a0 2023-10-03T10:19:04.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.619+0000 7f42d6ffd700 1 -- 172.21.15.146:0/3782755368 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc00c9b0 con 0x7f42e81300a0 2023-10-03T10:19:04.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.619+0000 7f42eca75700 1 -- 172.21.15.146:0/3782755368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e0009a70 con 0x7f42e81300a0 2023-10-03T10:19:04.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.619+0000 7f42d6ffd700 1 -- 172.21.15.146:0/3782755368 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc00cd40 con 0x7f42e81300a0 2023-10-03T10:19:04.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.619+0000 7f42eca75700 1 -- 172.21.15.146:0/3782755368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e811fa70 con 0x7f42e81300a0 2023-10-03T10:19:04.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.620+0000 7f42d6ffd700 1 -- 172.21.15.146:0/3782755368 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f42dc013470 con 0x7f42e81300a0 2023-10-03T10:19:04.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.620+0000 7f42eca75700 1 -- 172.21.15.146:0/3782755368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e806be10 con 0x7f42e81300a0 2023-10-03T10:19:04.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.620+0000 7f42d6ffd700 1 -- 172.21.15.146:0/3782755368 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f42dc03fb30 con 0x7f42e81300a0 2023-10-03T10:19:04.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.625+0000 7f42d6ffd700 1 -- 172.21.15.146:0/3782755368 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f42dc013720 con 0x7f42e81300a0 2023-10-03T10:19:04.804 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:04.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.810+0000 7f42eca75700 1 -- 172.21.15.146:0/3782755368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f42e804f2a0 con 0x7f42e81300a0 2023-10-03T10:19:04.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.811+0000 7f42d6ffd700 1 -- 172.21.15.146:0/3782755368 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f42dc021030 con 0x7f42e81300a0 2023-10-03T10:19:04.810 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:04.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.813+0000 7f42eca75700 1 -- 172.21.15.146:0/3782755368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42e81300a0 msgr2=0x7f42e811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.813+0000 7f42eca75700 1 --2- 172.21.15.146:0/3782755368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42e81300a0 0x7f42e811da40 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00ebe0 tx=0x7f42dc00eef0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.813+0000 7f42eca75700 1 -- 172.21.15.146:0/3782755368 shutdown_connections 2023-10-03T10:19:04.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.813+0000 7f42eca75700 1 --2- 172.21.15.146:0/3782755368 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42e8133ad0 0x7f42e811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.813+0000 7f42eca75700 1 --2- 172.21.15.146:0/3782755368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42e81300a0 0x7f42e811da40 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.813+0000 7f42eca75700 1 --2- 172.21.15.146:0/3782755368 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42e8130bc0 0x7f42e811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.813+0000 7f42eca75700 1 -- 172.21.15.146:0/3782755368 >> 172.21.15.146:0/3782755368 conn(0x7f42e8099c40 msgr2=0x7f42e812e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.813+0000 7f42eca75700 1 -- 172.21.15.146:0/3782755368 shutdown_connections 2023-10-03T10:19:04.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.813+0000 7f42eca75700 1 -- 172.21.15.146:0/3782755368 wait complete. 2023-10-03T10:19:04.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:19:04.881 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:04.925 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:04.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.933+0000 7fb1fb7cb700 1 Processor -- start 2023-10-03T10:19:04.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.933+0000 7fb1fb7cb700 1 -- start start 2023-10-03T10:19:04.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.933+0000 7fb1fb7cb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb1f409d860 0x7fb1f409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.934+0000 7fb1fb7cb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1f4130eb0 0x7fb1f4138a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.934+0000 7fb1fb7cb700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f409aaa0 con 0x7fb1f409e170 2023-10-03T10:19:04.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.934+0000 7fb1fb7cb700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f409f870 con 0x7fb1f409d860 2023-10-03T10:19:04.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.934+0000 7fb1fb7cb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f409b360 con 0x7fb1f4130eb0 2023-10-03T10:19:04.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.934+0000 7fb1f9d68700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1f4130eb0 0x7fb1f4138a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.934+0000 7fb1f8d66700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb1f409e170 0x7fb1f41307a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36584/0 (socket says 172.21.15.146:36584) 2023-10-03T10:19:04.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.934+0000 7fb1f8d66700 1 -- 172.21.15.146:0/924338944 learned_addr learned my addr 172.21.15.146:0/924338944 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:04.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.934+0000 7fb1f9567700 1 --2- 172.21.15.146:0/924338944 >> v2:172.21.15.146:3300/0 conn(0x7fb1f409d860 0x7fb1f409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.934+0000 7fb1f9d68700 1 -- 172.21.15.146:0/924338944 >> v2:172.21.15.146:3300/0 conn(0x7fb1f409d860 msgr2=0x7fb1f409dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:04.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.934+0000 7fb1f9d68700 1 --2- 172.21.15.146:0/924338944 >> v2:172.21.15.146:3300/0 conn(0x7fb1f409d860 0x7fb1f409dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.934+0000 7fb1f9d68700 1 -- 172.21.15.146:0/924338944 >> v1:172.21.15.146:6789/0 conn(0x7fb1f409e170 legacy=0x7fb1f41307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.934+0000 7fb1f9d68700 1 -- 172.21.15.146:0/924338944 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f409b620 con 0x7fb1f4130eb0 2023-10-03T10:19:04.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.934+0000 7fb1f9567700 1 --2- 172.21.15.146:0/924338944 >> v2:172.21.15.146:3300/0 conn(0x7fb1f409d860 0x7fb1f409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:04.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.934+0000 7fb1f9d68700 1 --2- 172.21.15.146:0/924338944 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1f4130eb0 0x7fb1f4138a00 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec009d90 tx=0x7fb1ec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16ca7d4bb4a67500 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.934+0000 7fb1ebfff700 1 -- 172.21.15.146:0/924338944 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec00e070 con 0x7fb1f4130eb0 2023-10-03T10:19:04.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.934+0000 7fb1ebfff700 1 -- 172.21.15.146:0/924338944 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ec00bb20 con 0x7fb1f4130eb0 2023-10-03T10:19:04.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.934+0000 7fb1ebfff700 1 -- 172.21.15.146:0/924338944 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec012430 con 0x7fb1f4130eb0 2023-10-03T10:19:04.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.935+0000 7fb1fb7cb700 1 -- 172.21.15.146:0/924338944 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1f4130eb0 msgr2=0x7fb1f4138a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.935+0000 7fb1fb7cb700 1 --2- 172.21.15.146:0/924338944 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1f4130eb0 0x7fb1f4138a00 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec009d90 tx=0x7fb1ec00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:04.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.935+0000 7fb1fb7cb700 1 -- 172.21.15.146:0/924338944 shutdown_connections 2023-10-03T10:19:04.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.935+0000 7fb1fb7cb700 1 --2- 172.21.15.146:0/924338944 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1f4130eb0 0x7fb1f4138a00 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.935+0000 7fb1fb7cb700 1 --2- 172.21.15.146:0/924338944 >> v2:172.21.15.146:3300/0 conn(0x7fb1f409d860 0x7fb1f409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.935+0000 7fb1fb7cb700 1 -- 172.21.15.146:0/924338944 >> 172.21.15.146:0/924338944 conn(0x7fb1f4099c40 msgr2=0x7fb1f40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.935+0000 7fb1fb7cb700 1 -- 172.21.15.146:0/924338944 shutdown_connections 2023-10-03T10:19:04.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.935+0000 7fb1fb7cb700 1 -- 172.21.15.146:0/924338944 wait complete. 2023-10-03T10:19:04.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.936+0000 7fb1fb7cb700 1 Processor -- start 2023-10-03T10:19:04.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.937+0000 7fb1fb7cb700 1 -- start start 2023-10-03T10:19:04.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.937+0000 7fb1fb7cb700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1f409d860 0x7fb1f411f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.937+0000 7fb1fb7cb700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1f409e170 0x7fb1f411fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.937+0000 7fb1fb7cb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1f4130eb0 0x7fb1f411ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.937+0000 7fb1fb7cb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f4122e50 con 0x7fb1f4130eb0 2023-10-03T10:19:04.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.937+0000 7fb1fb7cb700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f4120990 con 0x7fb1f409e170 2023-10-03T10:19:04.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.937+0000 7fb1fb7cb700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f4123050 con 0x7fb1f409d860 2023-10-03T10:19:04.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.937+0000 7fb1f8d66700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1f409e170 0x7fb1f411fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.937+0000 7fb1f9d68700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1f4130eb0 0x7fb1f411ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.937+0000 7fb1f8d66700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1f409e170 0x7fb1f411fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:37474/0 (socket says 172.21.15.146:37474) 2023-10-03T10:19:04.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.937+0000 7fb1f8d66700 1 -- 172.21.15.146:0/3861366458 learned_addr learned my addr 172.21.15.146:0/3861366458 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:04.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.937+0000 7fb1f9567700 1 --2- 172.21.15.146:0/3861366458 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1f409d860 0x7fb1f411f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.938+0000 7fb1f8d66700 1 -- 172.21.15.146:0/3861366458 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1f409d860 msgr2=0x7fb1f411f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.938+0000 7fb1f8d66700 1 --2- 172.21.15.146:0/3861366458 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1f409d860 0x7fb1f411f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.938+0000 7fb1f8d66700 1 -- 172.21.15.146:0/3861366458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1f4130eb0 msgr2=0x7fb1f411ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.938+0000 7fb1f8d66700 1 --2- 172.21.15.146:0/3861366458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1f4130eb0 0x7fb1f411ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.938+0000 7fb1f8d66700 1 -- 172.21.15.146:0/3861366458 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f00094a0 con 0x7fb1f409e170 2023-10-03T10:19:04.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.938+0000 7fb1f8d66700 1 --2- 172.21.15.146:0/3861366458 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1f409e170 0x7fb1f411fa70 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fb1e400e940 tx=0x7fb1e400ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.938+0000 7fb1e9ffb700 1 -- 172.21.15.146:0/3861366458 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4005d70 con 0x7fb1f409e170 2023-10-03T10:19:04.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.938+0000 7fb1e9ffb700 1 -- 172.21.15.146:0/3861366458 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e4007070 con 0x7fb1f409e170 2023-10-03T10:19:04.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.938+0000 7fb1e9ffb700 1 -- 172.21.15.146:0/3861366458 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e40073e0 con 0x7fb1f409e170 2023-10-03T10:19:04.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.938+0000 7fb1fb7cb700 1 -- 172.21.15.146:0/3861366458 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ec009a70 con 0x7fb1f409e170 2023-10-03T10:19:04.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.938+0000 7fb1fb7cb700 1 -- 172.21.15.146:0/3861366458 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f409c8b0 con 0x7fb1f409e170 2023-10-03T10:19:04.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.939+0000 7fb1e9ffb700 1 -- 172.21.15.146:0/3861366458 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb1e4007540 con 0x7fb1f409e170 2023-10-03T10:19:04.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.939+0000 7fb1e9ffb700 1 -- 172.21.15.146:0/3861366458 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fb1e4041870 con 0x7fb1f409e170 2023-10-03T10:19:04.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.940+0000 7fb1fb7cb700 1 -- 172.21.15.146:0/3861366458 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f41300b0 con 0x7fb1f409e170 2023-10-03T10:19:04.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:04.944+0000 7fb1e9ffb700 1 -- 172.21.15.146:0/3861366458 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb1e40193b0 con 0x7fb1f409e170 2023-10-03T10:19:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.013+0000 7f8bd0e11700 1 Processor -- start 2023-10-03T10:19:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.013+0000 7f8bd0e11700 1 -- start start 2023-10-03T10:19:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.014+0000 7f8bd0e11700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bcc09ad40 0x7f8bcc133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.014+0000 7f8bd0e11700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8bcc133f70 0x7f8bcc1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.014+0000 7f8bd0e11700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8bcc0a0a70 0x7f8bcc0a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.014+0000 7f8bd0e11700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bcc0a3b60 con 0x7f8bcc0a0a70 2023-10-03T10:19:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.014+0000 7f8bd0e11700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc1348e0 con 0x7f8bcc09ad40 2023-10-03T10:19:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.014+0000 7f8bd0e11700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc09b110 con 0x7f8bcc133f70 2023-10-03T10:19:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.014+0000 7f8bcad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8bcc0a0a70 0x7f8bcc0a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.014+0000 7f8bc9d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8bcc133f70 0x7f8bcc1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.014+0000 7f8bc9d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8bcc133f70 0x7f8bcc1343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34652/0 (socket says 172.21.15.146:34652) 2023-10-03T10:19:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.014+0000 7f8bcad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8bcc0a0a70 0x7f8bcc0a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51570/0 (socket says 172.21.15.146:51570) 2023-10-03T10:19:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.014+0000 7f8bc9d9b700 1 -- 172.21.15.146:0/4189288364 learned_addr learned my addr 172.21.15.146:0/4189288364 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.014+0000 7f8bca59c700 1 --2- 172.21.15.146:0/4189288364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bcc09ad40 0x7f8bcc133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.014+0000 7f8bcad9d700 1 -- 172.21.15.146:0/4189288364 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8bcc133f70 msgr2=0x7f8bcc1343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:05.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.014+0000 7f8bcad9d700 1 --2- 172.21.15.146:0/4189288364 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8bcc133f70 0x7f8bcc1343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.014+0000 7f8bcad9d700 1 -- 172.21.15.146:0/4189288364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bcc09ad40 msgr2=0x7f8bcc133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:05.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.014+0000 7f8bcad9d700 1 --2- 172.21.15.146:0/4189288364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bcc09ad40 0x7f8bcc133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.014+0000 7f8bcad9d700 1 -- 172.21.15.146:0/4189288364 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bcc0a2fa0 con 0x7f8bcc0a0a70 2023-10-03T10:19:05.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.014+0000 7f8bc9d9b700 1 --2- 172.21.15.146:0/4189288364 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8bcc133f70 0x7f8bcc1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:05.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.014+0000 7f8bcad9d700 1 --2- 172.21.15.146:0/4189288364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bcc0a0a70 0x7f8bcc0a0ef0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4009dc0 tx=0x7f8bc400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc95d0b9ad219ab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.015+0000 7f8bc959a700 1 -- 172.21.15.146:0/4189288364 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc400e070 con 0x7f8bcc0a0a70 2023-10-03T10:19:05.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.015+0000 7f8bc959a700 1 -- 172.21.15.146:0/4189288364 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc400bae0 con 0x7f8bcc0a0a70 2023-10-03T10:19:05.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.015+0000 7f8bc959a700 1 -- 172.21.15.146:0/4189288364 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc400be70 con 0x7f8bcc0a0a70 2023-10-03T10:19:05.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.015+0000 7f8bd0e11700 1 -- 172.21.15.146:0/4189288364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bcc0a0a70 msgr2=0x7f8bcc0a0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.015+0000 7f8bd0e11700 1 --2- 172.21.15.146:0/4189288364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bcc0a0a70 0x7f8bcc0a0ef0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4009dc0 tx=0x7f8bc400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:05.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.015+0000 7f8bd0e11700 1 -- 172.21.15.146:0/4189288364 shutdown_connections 2023-10-03T10:19:05.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.015+0000 7f8bd0e11700 1 --2- 172.21.15.146:0/4189288364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bcc09ad40 0x7f8bcc133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.015+0000 7f8bd0e11700 1 --2- 172.21.15.146:0/4189288364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bcc0a0a70 0x7f8bcc0a0ef0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.015+0000 7f8bd0e11700 1 --2- 172.21.15.146:0/4189288364 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8bcc133f70 0x7f8bcc1343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.015+0000 7f8bd0e11700 1 -- 172.21.15.146:0/4189288364 >> 172.21.15.146:0/4189288364 conn(0x7f8bcc099c40 msgr2=0x7f8bcc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.015+0000 7f8bd0e11700 1 -- 172.21.15.146:0/4189288364 shutdown_connections 2023-10-03T10:19:05.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.015+0000 7f8bd0e11700 1 -- 172.21.15.146:0/4189288364 wait complete. 2023-10-03T10:19:05.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.016+0000 7f8bd0e11700 1 Processor -- start 2023-10-03T10:19:05.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.017+0000 7f8bd0e11700 1 -- start start 2023-10-03T10:19:05.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.017+0000 7f8bd0e11700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8bcc09ad40 0x7f8bcc132b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.017+0000 7f8bd0e11700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bcc0a0a70 0x7f8bcc133050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.017+0000 7f8bd0e11700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bcc133f70 0x7f8bcc1c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.017+0000 7f8bd0e11700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc1211a0 con 0x7f8bcc0a0a70 2023-10-03T10:19:05.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.017+0000 7f8bd0e11700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc121830 con 0x7f8bcc133f70 2023-10-03T10:19:05.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.017+0000 7f8bd0e11700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc1208b0 con 0x7f8bcc09ad40 2023-10-03T10:19:05.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.017+0000 7f8bc9d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bcc0a0a70 0x7f8bcc133050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.017+0000 7f8bc9d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bcc0a0a70 0x7f8bcc133050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51574/0 (socket says 172.21.15.146:51574) 2023-10-03T10:19:05.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.017+0000 7f8bc9d9b700 1 -- 172.21.15.146:0/3825329105 learned_addr learned my addr 172.21.15.146:0/3825329105 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:05.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.017+0000 7f8bca59c700 1 --2- 172.21.15.146:0/3825329105 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8bcc09ad40 0x7f8bcc132b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.017+0000 7f8bcad9d700 1 --2- 172.21.15.146:0/3825329105 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bcc133f70 0x7f8bcc1c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.017+0000 7f8bca59c700 1 -- 172.21.15.146:0/3825329105 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bcc133f70 msgr2=0x7f8bcc1c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.017+0000 7f8bca59c700 1 --2- 172.21.15.146:0/3825329105 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bcc133f70 0x7f8bcc1c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.017+0000 7f8bca59c700 1 -- 172.21.15.146:0/3825329105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bcc0a0a70 msgr2=0x7f8bcc133050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.017+0000 7f8bca59c700 1 --2- 172.21.15.146:0/3825329105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bcc0a0a70 0x7f8bcc133050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.017+0000 7f8bca59c700 1 -- 172.21.15.146:0/3825329105 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc0009550 con 0x7f8bcc09ad40 2023-10-03T10:19:05.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.017+0000 7f8bc9d9b700 1 --2- 172.21.15.146:0/3825329105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bcc0a0a70 0x7f8bcc133050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:05.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.018+0000 7f8bca59c700 1 --2- 172.21.15.146:0/3825329105 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8bcc09ad40 0x7f8bcc132b10 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00e8a0 tx=0x7f8bbc00ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.018+0000 7f8bbaffd700 1 -- 172.21.15.146:0/3825329105 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc013680 con 0x7f8bcc09ad40 2023-10-03T10:19:05.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.018+0000 7f8bd0e11700 1 -- 172.21.15.146:0/3825329105 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc4009a70 con 0x7f8bcc09ad40 2023-10-03T10:19:05.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.018+0000 7f8bbaffd700 1 -- 172.21.15.146:0/3825329105 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bbc0137e0 con 0x7f8bcc09ad40 2023-10-03T10:19:05.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.018+0000 7f8bbaffd700 1 -- 172.21.15.146:0/3825329105 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc013b70 con 0x7f8bcc09ad40 2023-10-03T10:19:05.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.018+0000 7f8bd0e11700 1 -- 172.21.15.146:0/3825329105 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bcc09c7e0 con 0x7f8bcc09ad40 2023-10-03T10:19:05.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.019+0000 7f8bbaffd700 1 -- 172.21.15.146:0/3825329105 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8bbc013cd0 con 0x7f8bcc09ad40 2023-10-03T10:19:05.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.019+0000 7f8bd0e11700 1 -- 172.21.15.146:0/3825329105 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bcc074f10 con 0x7f8bcc09ad40 2023-10-03T10:19:05.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.019+0000 7f8bbaffd700 1 -- 172.21.15.146:0/3825329105 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8bbc03f7f0 con 0x7f8bcc09ad40 2023-10-03T10:19:05.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.027+0000 7f8bbaffd700 1 -- 172.21.15.146:0/3825329105 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8bbc011ba0 con 0x7f8bcc09ad40 2023-10-03T10:19:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.058+0000 7f610f98d700 1 Processor -- start 2023-10-03T10:19:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.058+0000 7f610f98d700 1 -- start start 2023-10-03T10:19:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.058+0000 7f610f98d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f61080a1550 0x7f6108138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.058+0000 7f610f98d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6108139200 0x7f610813b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.058+0000 7f610f98d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610809e9d0 con 0x7f61080a0a70 2023-10-03T10:19:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.058+0000 7f610f98d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f610809dc00 con 0x7f61080a1550 2023-10-03T10:19:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.058+0000 7f610f98d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610809dec0 con 0x7f6108139200 2023-10-03T10:19:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.059+0000 7f610cf28700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f61080a1550 0x7f6108138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.059+0000 7f610d729700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f61080a0a70 0x7f61080a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36600/0 (socket says 172.21.15.146:36600) 2023-10-03T10:19:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.059+0000 7f610cf28700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f61080a1550 0x7f6108138cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51590/0 (socket says 172.21.15.146:51590) 2023-10-03T10:19:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.059+0000 7f610d729700 1 -- 172.21.15.146:0/2308959182 learned_addr learned my addr 172.21.15.146:0/2308959182 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.059+0000 7f610df2a700 1 --2- 172.21.15.146:0/2308959182 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6108139200 0x7f610813b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.059+0000 7f60fffff700 1 -- 172.21.15.146:0/2308959182 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754674751 0 0) 0x7f610809e9d0 con 0x7f61080a0a70 2023-10-03T10:19:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.059+0000 7f60fffff700 1 -- 172.21.15.146:0/2308959182 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60f40035b0 con 0x7f61080a0a70 2023-10-03T10:19:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.059+0000 7f610cf28700 1 -- 172.21.15.146:0/2308959182 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6108139200 msgr2=0x7f610813b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.059+0000 7f610cf28700 1 --2- 172.21.15.146:0/2308959182 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6108139200 0x7f610813b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.059+0000 7f610cf28700 1 -- 172.21.15.146:0/2308959182 >> v1:172.21.15.146:6789/0 conn(0x7f61080a0a70 legacy=0x7f61080a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.059+0000 7f610cf28700 1 -- 172.21.15.146:0/2308959182 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610809e6a0 con 0x7f61080a1550 2023-10-03T10:19:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.059+0000 7f610cf28700 1 --2- 172.21.15.146:0/2308959182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61080a1550 0x7f6108138cc0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f60f8009840 tx=0x7f60f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93d0d59097edcb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.059+0000 7f610df2a700 1 --2- 172.21.15.146:0/2308959182 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6108139200 0x7f610813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.059+0000 7f60fffff700 1 -- 172.21.15.146:0/2308959182 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f8011830 con 0x7f61080a1550 2023-10-03T10:19:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.059+0000 7f60fffff700 1 -- 172.21.15.146:0/2308959182 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f8011990 con 0x7f61080a1550 2023-10-03T10:19:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.059+0000 7f60fffff700 1 -- 172.21.15.146:0/2308959182 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f8011d00 con 0x7f61080a1550 2023-10-03T10:19:05.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.060+0000 7f610f98d700 1 -- 172.21.15.146:0/2308959182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61080a1550 msgr2=0x7f6108138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.060+0000 7f610f98d700 1 --2- 172.21.15.146:0/2308959182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61080a1550 0x7f6108138cc0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f60f8009840 tx=0x7f60f8009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:05.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.060+0000 7f610f98d700 1 -- 172.21.15.146:0/2308959182 shutdown_connections 2023-10-03T10:19:05.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.060+0000 7f610f98d700 1 --2- 172.21.15.146:0/2308959182 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6108139200 0x7f610813b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.060+0000 7f610f98d700 1 --2- 172.21.15.146:0/2308959182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61080a1550 0x7f6108138cc0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.060+0000 7f610f98d700 1 -- 172.21.15.146:0/2308959182 >> 172.21.15.146:0/2308959182 conn(0x7f61080a6610 msgr2=0x7f61080a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.060+0000 7f610f98d700 1 -- 172.21.15.146:0/2308959182 shutdown_connections 2023-10-03T10:19:05.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.060+0000 7f610f98d700 1 -- 172.21.15.146:0/2308959182 wait complete. 2023-10-03T10:19:05.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.061+0000 7f610f98d700 1 Processor -- start 2023-10-03T10:19:05.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.061+0000 7f610f98d700 1 -- start start 2023-10-03T10:19:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.062+0000 7f610f98d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61080a0a70 0x7f610811e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.062+0000 7f610f98d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61080a1550 0x7f610811ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.062+0000 7f610f98d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6108139200 0x7f610811f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.062+0000 7f610f98d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61081340b0 con 0x7f61080a0a70 2023-10-03T10:19:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.062+0000 7f610f98d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61080a0470 con 0x7f61080a1550 2023-10-03T10:19:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.062+0000 7f610f98d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61080a5100 con 0x7f6108139200 2023-10-03T10:19:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.062+0000 7f610cf28700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61080a1550 0x7f610811ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.062+0000 7f610df2a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6108139200 0x7f610811f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.062+0000 7f610df2a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6108139200 0x7f610811f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34668/0 (socket says 172.21.15.146:34668) 2023-10-03T10:19:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.062+0000 7f610cf28700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61080a1550 0x7f610811ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:37506/0 (socket says 172.21.15.146:37506) 2023-10-03T10:19:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.062+0000 7f610df2a700 1 -- 172.21.15.146:0/2398005735 learned_addr learned my addr 172.21.15.146:0/2398005735 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.062+0000 7f610d729700 1 --2- 172.21.15.146:0/2398005735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61080a0a70 0x7f610811e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.062+0000 7f610d729700 1 -- 172.21.15.146:0/2398005735 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6108139200 msgr2=0x7f610811f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.062+0000 7f610d729700 1 --2- 172.21.15.146:0/2398005735 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6108139200 0x7f610811f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.062+0000 7f610d729700 1 -- 172.21.15.146:0/2398005735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61080a1550 msgr2=0x7f610811ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.062+0000 7f610d729700 1 --2- 172.21.15.146:0/2398005735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61080a1550 0x7f610811ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.062+0000 7f610d729700 1 -- 172.21.15.146:0/2398005735 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6100009a70 con 0x7f61080a0a70 2023-10-03T10:19:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.063+0000 7f610d729700 1 --2- 172.21.15.146:0/2398005735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61080a0a70 0x7f610811e7d0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f610400c4c0 tx=0x7f610400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.063+0000 7f60fdffb700 1 -- 172.21.15.146:0/2398005735 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6104005d70 con 0x7f61080a0a70 2023-10-03T10:19:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.063+0000 7f60fdffb700 1 -- 172.21.15.146:0/2398005735 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61040070d0 con 0x7f61080a0a70 2023-10-03T10:19:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.063+0000 7f610f98d700 1 -- 172.21.15.146:0/2398005735 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f80094a0 con 0x7f61080a0a70 2023-10-03T10:19:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.063+0000 7f60fdffb700 1 -- 172.21.15.146:0/2398005735 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6104007480 con 0x7f61080a0a70 2023-10-03T10:19:05.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.063+0000 7f610f98d700 1 -- 172.21.15.146:0/2398005735 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6108121fc0 con 0x7f61080a0a70 2023-10-03T10:19:05.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.064+0000 7f60fdffb700 1 -- 172.21.15.146:0/2398005735 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f61040075e0 con 0x7f61080a0a70 2023-10-03T10:19:05.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.064+0000 7f60fdffb700 1 -- 172.21.15.146:0/2398005735 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f610403e9a0 con 0x7f61080a0a70 2023-10-03T10:19:05.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.064+0000 7f610f98d700 1 -- 172.21.15.146:0/2398005735 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610804f2a0 con 0x7f61080a0a70 2023-10-03T10:19:05.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.073+0000 7f60fdffb700 1 -- 172.21.15.146:0/2398005735 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f610400f260 con 0x7f61080a0a70 2023-10-03T10:19:05.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.146+0000 7fb1fb7cb700 1 -- 172.21.15.146:0/3861366458 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb1f404f2a0 con 0x7fb1f409e170 2023-10-03T10:19:05.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.147+0000 7fb1e9ffb700 1 -- 172.21.15.146:0/3861366458 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb1e4029090 con 0x7fb1f409e170 2023-10-03T10:19:05.146 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:05.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.150+0000 7fb1fb7cb700 1 -- 172.21.15.146:0/3861366458 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1f409e170 msgr2=0x7fb1f411fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.150+0000 7fb1fb7cb700 1 --2- 172.21.15.146:0/3861366458 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1f409e170 0x7fb1f411fa70 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fb1e400e940 tx=0x7fb1e400ec50 comp rx=0 tx=0).stop 2023-10-03T10:19:05.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.150+0000 7fb1fb7cb700 1 -- 172.21.15.146:0/3861366458 shutdown_connections 2023-10-03T10:19:05.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.150+0000 7fb1fb7cb700 1 --2- 172.21.15.146:0/3861366458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1f4130eb0 0x7fb1f411ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.150+0000 7fb1fb7cb700 1 --2- 172.21.15.146:0/3861366458 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fb1f409d860 0x7fb1f411f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.150+0000 7fb1fb7cb700 1 --2- 172.21.15.146:0/3861366458 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1f409e170 0x7fb1f411fa70 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.150+0000 7fb1fb7cb700 1 -- 172.21.15.146:0/3861366458 >> 172.21.15.146:0/3861366458 conn(0x7fb1f4099c40 msgr2=0x7fb1f4119630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.150+0000 7fb1fb7cb700 1 -- 172.21.15.146:0/3861366458 shutdown_connections 2023-10-03T10:19:05.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.150+0000 7fb1fb7cb700 1 -- 172.21.15.146:0/3861366458 wait complete. 2023-10-03T10:19:05.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:19:05.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.231+0000 7f8bd0e11700 1 -- 172.21.15.146:0/3825329105 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8bcc122180 con 0x7f8bcc09ad40 2023-10-03T10:19:05.231 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:19:05.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.231+0000 7f8bbaffd700 1 -- 172.21.15.146:0/3825329105 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8bbc017070 con 0x7f8bcc09ad40 2023-10-03T10:19:05.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.233+0000 7f8bd0e11700 1 -- 172.21.15.146:0/3825329105 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8bcc09ad40 msgr2=0x7f8bcc132b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.233+0000 7f8bd0e11700 1 --2- 172.21.15.146:0/3825329105 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8bcc09ad40 0x7f8bcc132b10 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00e8a0 tx=0x7f8bbc00ebb0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.233+0000 7f8bd0e11700 1 -- 172.21.15.146:0/3825329105 shutdown_connections 2023-10-03T10:19:05.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.233+0000 7f8bd0e11700 1 --2- 172.21.15.146:0/3825329105 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8bcc133f70 0x7f8bcc1c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.233+0000 7f8bd0e11700 1 --2- 172.21.15.146:0/3825329105 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8bcc09ad40 0x7f8bcc132b10 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.233+0000 7f8bd0e11700 1 --2- 172.21.15.146:0/3825329105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bcc0a0a70 0x7f8bcc133050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.233+0000 7f8bd0e11700 1 -- 172.21.15.146:0/3825329105 >> 172.21.15.146:0/3825329105 conn(0x7f8bcc099c40 msgr2=0x7f8bcc1bbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.233+0000 7f8bd0e11700 1 -- 172.21.15.146:0/3825329105 shutdown_connections 2023-10-03T10:19:05.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.233+0000 7f8bd0e11700 1 -- 172.21.15.146:0/3825329105 wait complete. 2023-10-03T10:19:05.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:19:05.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.268+0000 7f610f98d700 1 -- 172.21.15.146:0/2398005735 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6108072980 con 0x7f61080a0a70 2023-10-03T10:19:05.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.269+0000 7f60fdffb700 1 -- 172.21.15.146:0/2398005735 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6104019ab0 con 0x7f61080a0a70 2023-10-03T10:19:05.268 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:19:05.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.271+0000 7f610f98d700 1 -- 172.21.15.146:0/2398005735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61080a0a70 msgr2=0x7f610811e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.271+0000 7f610f98d700 1 --2- 172.21.15.146:0/2398005735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61080a0a70 0x7f610811e7d0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f610400c4c0 tx=0x7f610400c7d0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.271+0000 7f610f98d700 1 -- 172.21.15.146:0/2398005735 shutdown_connections 2023-10-03T10:19:05.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.271+0000 7f610f98d700 1 --2- 172.21.15.146:0/2398005735 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6108139200 0x7f610811f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.271+0000 7f610f98d700 1 --2- 172.21.15.146:0/2398005735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61080a0a70 0x7f610811e7d0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.271+0000 7f610f98d700 1 --2- 172.21.15.146:0/2398005735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61080a1550 0x7f610811ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.271+0000 7f610f98d700 1 -- 172.21.15.146:0/2398005735 >> 172.21.15.146:0/2398005735 conn(0x7f61080a6610 msgr2=0x7f61080a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.271+0000 7f610f98d700 1 -- 172.21.15.146:0/2398005735 shutdown_connections 2023-10-03T10:19:05.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.271+0000 7f610f98d700 1 -- 172.21.15.146:0/2398005735 wait complete. 2023-10-03T10:19:05.282 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:19:05.827 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:05.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.955+0000 7f44a682c700 1 Processor -- start 2023-10-03T10:19:05.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.955+0000 7f44a682c700 1 -- start start 2023-10-03T10:19:05.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.955+0000 7f44a682c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44a009d860 0x7f44a009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.955+0000 7f44a682c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f44a009e170 0x7f44a01307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.955+0000 7f44a682c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44a0130ce0 0x7f44a0131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.955+0000 7f44a682c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a009aaa0 con 0x7f44a009e170 2023-10-03T10:19:05.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.955+0000 7f44a682c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a009f870 con 0x7f44a0130ce0 2023-10-03T10:19:05.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.955+0000 7f44a682c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44a009b360 con 0x7f44a009d860 2023-10-03T10:19:05.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.955+0000 7f449f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f44a009e170 0x7f44a01307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.955+0000 7f449ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44a009d860 0x7f44a009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.955+0000 7f44a4dc9700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44a0130ce0 0x7f44a0131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.955+0000 7f449ffff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44a009d860 0x7f44a009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34682/0 (socket says 172.21.15.146:34682) 2023-10-03T10:19:05.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.955+0000 7f449f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f44a009e170 0x7f44a01307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51612/0 (socket says 172.21.15.146:51612) 2023-10-03T10:19:05.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.955+0000 7f449ffff700 1 -- 172.21.15.146:0/2456904968 learned_addr learned my addr 172.21.15.146:0/2456904968 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:05.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.955+0000 7f449ffff700 1 -- 172.21.15.146:0/2456904968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44a0130ce0 msgr2=0x7f44a0131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:05.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.955+0000 7f449ffff700 1 --2- 172.21.15.146:0/2456904968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44a0130ce0 0x7f44a0131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.955+0000 7f449ffff700 1 -- 172.21.15.146:0/2456904968 >> v2:172.21.15.146:3300/0 conn(0x7f44a009e170 msgr2=0x7f44a01307a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:05.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.955+0000 7f449ffff700 1 --2- 172.21.15.146:0/2456904968 >> v2:172.21.15.146:3300/0 conn(0x7f44a009e170 0x7f44a01307a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.955+0000 7f449ffff700 1 -- 172.21.15.146:0/2456904968 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a009b620 con 0x7f44a009d860 2023-10-03T10:19:05.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.956+0000 7f449f7fe700 1 --2- 172.21.15.146:0/2456904968 >> v2:172.21.15.146:3300/0 conn(0x7f44a009e170 0x7f44a01307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:05.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.956+0000 7f449ffff700 1 --2- 172.21.15.146:0/2456904968 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44a009d860 0x7f44a009dc30 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f449400b9d0 tx=0x7f449400bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f01ca61091463ab3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.956+0000 7f449effd700 1 -- 172.21.15.146:0/2456904968 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449400cc20 con 0x7f44a009d860 2023-10-03T10:19:05.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.956+0000 7f449effd700 1 -- 172.21.15.146:0/2456904968 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449400cd80 con 0x7f44a009d860 2023-10-03T10:19:05.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.956+0000 7f449effd700 1 -- 172.21.15.146:0/2456904968 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449400f680 con 0x7f44a009d860 2023-10-03T10:19:05.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.956+0000 7f44a682c700 1 -- 172.21.15.146:0/2456904968 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44a009d860 msgr2=0x7f44a009dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.956+0000 7f44a682c700 1 --2- 172.21.15.146:0/2456904968 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44a009d860 0x7f44a009dc30 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f449400b9d0 tx=0x7f449400bce0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.956+0000 7f44a682c700 1 -- 172.21.15.146:0/2456904968 shutdown_connections 2023-10-03T10:19:05.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.956+0000 7f44a682c700 1 --2- 172.21.15.146:0/2456904968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44a0130ce0 0x7f44a0131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.956+0000 7f44a682c700 1 --2- 172.21.15.146:0/2456904968 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44a009d860 0x7f44a009dc30 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.956+0000 7f44a682c700 1 --2- 172.21.15.146:0/2456904968 >> v2:172.21.15.146:3300/0 conn(0x7f44a009e170 0x7f44a01307a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.956+0000 7f44a682c700 1 -- 172.21.15.146:0/2456904968 >> 172.21.15.146:0/2456904968 conn(0x7f44a0099c40 msgr2=0x7f44a00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.956+0000 7f44a682c700 1 -- 172.21.15.146:0/2456904968 shutdown_connections 2023-10-03T10:19:05.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.956+0000 7f44a682c700 1 -- 172.21.15.146:0/2456904968 wait complete. 2023-10-03T10:19:05.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.957+0000 7f44a682c700 1 Processor -- start 2023-10-03T10:19:05.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.957+0000 7f44a682c700 1 -- start start 2023-10-03T10:19:05.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.958+0000 7f44a682c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44a009d860 0x7f44a011dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.958+0000 7f44a682c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44a009e170 0x7f44a011e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.958+0000 7f44a682c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44a0130ce0 0x7f44a011ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.958+0000 7f44a682c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a011fb30 con 0x7f44a0130ce0 2023-10-03T10:19:05.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.958+0000 7f44a682c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a009c8b0 con 0x7f44a009d860 2023-10-03T10:19:05.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.958+0000 7f44a682c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44a0121760 con 0x7f44a009e170 2023-10-03T10:19:05.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.958+0000 7f449f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44a009e170 0x7f44a011e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.958+0000 7f44a4dc9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44a0130ce0 0x7f44a011ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.958+0000 7f449f7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44a009e170 0x7f44a011e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34692/0 (socket says 172.21.15.146:34692) 2023-10-03T10:19:05.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.958+0000 7f449ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44a009d860 0x7f44a011dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.958+0000 7f449f7fe700 1 -- 172.21.15.146:0/3085949383 learned_addr learned my addr 172.21.15.146:0/3085949383 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:05.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.958+0000 7f449ffff700 1 -- 172.21.15.146:0/3085949383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44a009e170 msgr2=0x7f44a011e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.958+0000 7f449ffff700 1 --2- 172.21.15.146:0/3085949383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44a009e170 0x7f44a011e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.958+0000 7f449ffff700 1 -- 172.21.15.146:0/3085949383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44a0130ce0 msgr2=0x7f44a011ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.958+0000 7f449ffff700 1 --2- 172.21.15.146:0/3085949383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44a0130ce0 0x7f44a011ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.958+0000 7f449ffff700 1 -- 172.21.15.146:0/3085949383 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449000d940 con 0x7f44a009d860 2023-10-03T10:19:05.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.958+0000 7f449f7fe700 1 --2- 172.21.15.146:0/3085949383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44a009e170 0x7f44a011e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:05.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.958+0000 7f44a4dc9700 1 --2- 172.21.15.146:0/3085949383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44a0130ce0 0x7f44a011ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:05.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.958+0000 7f449ffff700 1 --2- 172.21.15.146:0/3085949383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44a009d860 0x7f44a011dff0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4494016000 tx=0x7f4494004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.959+0000 7f449cff9700 1 -- 172.21.15.146:0/3085949383 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449401c070 con 0x7f44a009d860 2023-10-03T10:19:05.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.959+0000 7f449cff9700 1 -- 172.21.15.146:0/3085949383 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449400be70 con 0x7f44a009d860 2023-10-03T10:19:05.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.959+0000 7f44a682c700 1 -- 172.21.15.146:0/3085949383 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449400b600 con 0x7f44a009d860 2023-10-03T10:19:05.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.959+0000 7f449cff9700 1 -- 172.21.15.146:0/3085949383 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494004250 con 0x7f44a009d860 2023-10-03T10:19:05.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.959+0000 7f44a682c700 1 -- 172.21.15.146:0/3085949383 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a0120d80 con 0x7f44a009d860 2023-10-03T10:19:05.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.959+0000 7f449cff9700 1 -- 172.21.15.146:0/3085949383 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f44940043b0 con 0x7f44a009d860 2023-10-03T10:19:05.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.960+0000 7f449cff9700 1 -- 172.21.15.146:0/3085949383 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4494040a60 con 0x7f44a009d860 2023-10-03T10:19:05.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.960+0000 7f44a682c700 1 -- 172.21.15.146:0/3085949383 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a011add0 con 0x7f44a009d860 2023-10-03T10:19:05.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:05.964+0000 7f449cff9700 1 -- 172.21.15.146:0/3085949383 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4494025080 con 0x7f44a009d860 2023-10-03T10:19:06.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.147+0000 7f44a682c700 1 -- 172.21.15.146:0/3085949383 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f44a004f2a0 con 0x7f44a009d860 2023-10-03T10:19:06.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.147+0000 7f449cff9700 1 -- 172.21.15.146:0/3085949383 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4494017400 con 0x7f44a009d860 2023-10-03T10:19:06.147 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:06.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.149+0000 7f44a682c700 1 -- 172.21.15.146:0/3085949383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44a009d860 msgr2=0x7f44a011dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.149+0000 7f44a682c700 1 --2- 172.21.15.146:0/3085949383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44a009d860 0x7f44a011dff0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4494016000 tx=0x7f4494004750 comp rx=0 tx=0).stop 2023-10-03T10:19:06.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.150+0000 7f44a682c700 1 -- 172.21.15.146:0/3085949383 shutdown_connections 2023-10-03T10:19:06.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.150+0000 7f44a682c700 1 --2- 172.21.15.146:0/3085949383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44a0130ce0 0x7f44a011ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.150+0000 7f44a682c700 1 --2- 172.21.15.146:0/3085949383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f44a009d860 0x7f44a011dff0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.150+0000 7f44a682c700 1 --2- 172.21.15.146:0/3085949383 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f44a009e170 0x7f44a011e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.150+0000 7f44a682c700 1 -- 172.21.15.146:0/3085949383 >> 172.21.15.146:0/3085949383 conn(0x7f44a0099c40 msgr2=0x7f44a0071240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:06.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.150+0000 7f44a682c700 1 -- 172.21.15.146:0/3085949383 shutdown_connections 2023-10-03T10:19:06.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.150+0000 7f44a682c700 1 -- 172.21.15.146:0/3085949383 wait complete. 2023-10-03T10:19:06.161 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:19:06.163 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:06.245 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:06.283 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:06.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.287+0000 7f46b86d4700 1 Processor -- start 2023-10-03T10:19:06.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.287+0000 7f46b86d4700 1 -- start start 2023-10-03T10:19:06.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.288+0000 7f46b86d4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f46b0134140 0x7f46b0138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.288+0000 7f46b86d4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46b0134570 0x7f46b013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.288+0000 7f46b86d4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b009b110 con 0x7f46b009ad40 2023-10-03T10:19:06.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.288+0000 7f46b86d4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b00a3b60 con 0x7f46b0134570 2023-10-03T10:19:06.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.288+0000 7f46b86d4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46b00a1a80 con 0x7f46b0134140 2023-10-03T10:19:06.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.288+0000 7f46b6c71700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46b0134570 0x7f46b013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.288+0000 7f46b5c6f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f46b0134140 0x7f46b0138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.288+0000 7f46b6c71700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46b0134570 0x7f46b013b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:37538/0 (socket says 172.21.15.146:37538) 2023-10-03T10:19:06.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.288+0000 7f46b6470700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f46b009ad40 0x7f46b0133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36612/0 (socket says 172.21.15.146:36612) 2023-10-03T10:19:06.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.288+0000 7f46b6c71700 1 -- 172.21.15.146:0/1954691124 learned_addr learned my addr 172.21.15.146:0/1954691124 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:06.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.288+0000 7f46b546e700 1 -- 172.21.15.146:0/1954691124 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346972523 0 0) 0x7f46b009b110 con 0x7f46b009ad40 2023-10-03T10:19:06.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.288+0000 7f46b6c71700 1 -- 172.21.15.146:0/1954691124 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f46b0134140 msgr2=0x7f46b0138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:06.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.288+0000 7f46b6c71700 1 --2- 172.21.15.146:0/1954691124 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f46b0134140 0x7f46b0138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.288+0000 7f46b6c71700 1 -- 172.21.15.146:0/1954691124 >> v1:172.21.15.146:6789/0 conn(0x7f46b009ad40 legacy=0x7f46b0133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.288+0000 7f46b6c71700 1 -- 172.21.15.146:0/1954691124 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b00a2fa0 con 0x7f46b0134570 2023-10-03T10:19:06.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.288+0000 7f46b5c6f700 1 --2- 172.21.15.146:0/1954691124 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f46b0134140 0x7f46b0138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:06.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.289+0000 7f46b6c71700 1 --2- 172.21.15.146:0/1954691124 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46b0134570 0x7f46b013b3d0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009eb0 tx=0x7f46a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4e7e4c7351da30c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.289+0000 7f46b546e700 1 -- 172.21.15.146:0/1954691124 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a800e070 con 0x7f46b0134570 2023-10-03T10:19:06.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.289+0000 7f46b546e700 1 -- 172.21.15.146:0/1954691124 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a800b8d0 con 0x7f46b0134570 2023-10-03T10:19:06.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.289+0000 7f46b546e700 1 -- 172.21.15.146:0/1954691124 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a800bc80 con 0x7f46b0134570 2023-10-03T10:19:06.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.290+0000 7f46b86d4700 1 -- 172.21.15.146:0/1954691124 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46b0134570 msgr2=0x7f46b013b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.290+0000 7f46b86d4700 1 --2- 172.21.15.146:0/1954691124 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46b0134570 0x7f46b013b3d0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009eb0 tx=0x7f46a800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:06.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.290+0000 7f46b86d4700 1 -- 172.21.15.146:0/1954691124 shutdown_connections 2023-10-03T10:19:06.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.290+0000 7f46b86d4700 1 --2- 172.21.15.146:0/1954691124 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46b0134570 0x7f46b013b3d0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.290+0000 7f46b86d4700 1 --2- 172.21.15.146:0/1954691124 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f46b0134140 0x7f46b0138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.290+0000 7f46b86d4700 1 -- 172.21.15.146:0/1954691124 >> 172.21.15.146:0/1954691124 conn(0x7f46b0099c40 msgr2=0x7f46b006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:06.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.290+0000 7f46b86d4700 1 -- 172.21.15.146:0/1954691124 shutdown_connections 2023-10-03T10:19:06.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.290+0000 7f46b86d4700 1 -- 172.21.15.146:0/1954691124 wait complete. 2023-10-03T10:19:06.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.291+0000 7f46b86d4700 1 Processor -- start 2023-10-03T10:19:06.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.291+0000 7f46b86d4700 1 -- start start 2023-10-03T10:19:06.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.291+0000 7f46b86d4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46b009ad40 0x7f46b0139420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.291+0000 7f46b86d4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f46b0134140 0x7f46b0139960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.291+0000 7f46b86d4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b0134570 0x7f46b0139ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.291+0000 7f46b86d4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b011cf70 con 0x7f46b0134570 2023-10-03T10:19:06.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.291+0000 7f46b86d4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b011ea90 con 0x7f46b009ad40 2023-10-03T10:19:06.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.291+0000 7f46b86d4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46b009e490 con 0x7f46b0134140 2023-10-03T10:19:06.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.291+0000 7f46b6470700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46b009ad40 0x7f46b0139420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.291+0000 7f46b6470700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46b009ad40 0x7f46b0139420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:37550/0 (socket says 172.21.15.146:37550) 2023-10-03T10:19:06.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.291+0000 7f46b6470700 1 -- 172.21.15.146:0/3548401647 learned_addr learned my addr 172.21.15.146:0/3548401647 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:06.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.291+0000 7f46b6c71700 1 --2- 172.21.15.146:0/3548401647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b0134570 0x7f46b0139ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.291+0000 7f46b5c6f700 1 --2- 172.21.15.146:0/3548401647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f46b0134140 0x7f46b0139960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.292+0000 7f46b6c71700 1 -- 172.21.15.146:0/3548401647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f46b0134140 msgr2=0x7f46b0139960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.292+0000 7f46b6c71700 1 --2- 172.21.15.146:0/3548401647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f46b0134140 0x7f46b0139960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.292+0000 7f46b6c71700 1 -- 172.21.15.146:0/3548401647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46b009ad40 msgr2=0x7f46b0139420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.292+0000 7f46b6c71700 1 --2- 172.21.15.146:0/3548401647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46b009ad40 0x7f46b0139420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.292+0000 7f46b6c71700 1 -- 172.21.15.146:0/3548401647 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a00094a0 con 0x7f46b0134570 2023-10-03T10:19:06.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.292+0000 7f46b5c6f700 1 --2- 172.21.15.146:0/3548401647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f46b0134140 0x7f46b0139960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:06.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.292+0000 7f46b6c71700 1 --2- 172.21.15.146:0/3548401647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b0134570 0x7f46b0139ea0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f46a8015000 tx=0x7f46a8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.292+0000 7f46a6ffd700 1 -- 172.21.15.146:0/3548401647 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a8004450 con 0x7f46b0134570 2023-10-03T10:19:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.292+0000 7f46a6ffd700 1 -- 172.21.15.146:0/3548401647 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a80045b0 con 0x7f46b0134570 2023-10-03T10:19:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.292+0000 7f46b86d4700 1 -- 172.21.15.146:0/3548401647 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a8009b30 con 0x7f46b0134570 2023-10-03T10:19:06.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.292+0000 7f46a6ffd700 1 -- 172.21.15.146:0/3548401647 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a8004940 con 0x7f46b0134570 2023-10-03T10:19:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.292+0000 7f46b86d4700 1 -- 172.21.15.146:0/3548401647 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b011d650 con 0x7f46b0134570 2023-10-03T10:19:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.293+0000 7f46b86d4700 1 -- 172.21.15.146:0/3548401647 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b01361e0 con 0x7f46b0134570 2023-10-03T10:19:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.293+0000 7f46a6ffd700 1 -- 172.21.15.146:0/3548401647 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f46a801c410 con 0x7f46b0134570 2023-10-03T10:19:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.293+0000 7f46a6ffd700 1 -- 172.21.15.146:0/3548401647 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f46a8041110 con 0x7f46b0134570 2023-10-03T10:19:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.298+0000 7f46a6ffd700 1 -- 172.21.15.146:0/3548401647 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f46a801c6c0 con 0x7f46b0134570 2023-10-03T10:19:06.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.375+0000 7f955bd7a700 1 Processor -- start 2023-10-03T10:19:06.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.375+0000 7f955bd7a700 1 -- start start 2023-10-03T10:19:06.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.375+0000 7f955bd7a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95540a0a70 0x7f95540a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.375+0000 7f955bd7a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9554134120 0x7f955413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.375+0000 7f955bd7a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f955409dc00 con 0x7f95540a1380 2023-10-03T10:19:06.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.375+0000 7f955bd7a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955409ea90 con 0x7f9554134120 2023-10-03T10:19:06.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.375+0000 7f955bd7a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f955409dec0 con 0x7f95540a0a70 2023-10-03T10:19:06.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.375+0000 7f9559315700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f95540a1380 0x7f9554133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36628/0 (socket says 172.21.15.146:36628) 2023-10-03T10:19:06.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.375+0000 7f9559315700 1 -- 172.21.15.146:0/783838736 learned_addr learned my addr 172.21.15.146:0/783838736 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:06.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.376+0000 7f955a317700 1 --2- 172.21.15.146:0/783838736 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9554134120 0x7f955413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.376+0000 7f9559b16700 1 --2- 172.21.15.146:0/783838736 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95540a0a70 0x7f95540a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.376+0000 7f9558b14700 1 -- 172.21.15.146:0/783838736 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3786487548 0 0) 0x7f955409dc00 con 0x7f95540a1380 2023-10-03T10:19:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.376+0000 7f9558b14700 1 -- 172.21.15.146:0/783838736 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95400035b0 con 0x7f95540a1380 2023-10-03T10:19:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.376+0000 7f9559b16700 1 -- 172.21.15.146:0/783838736 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9554134120 msgr2=0x7f955413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.376+0000 7f9559b16700 1 --2- 172.21.15.146:0/783838736 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9554134120 0x7f955413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.376+0000 7f9559b16700 1 -- 172.21.15.146:0/783838736 >> v1:172.21.15.146:6789/0 conn(0x7f95540a1380 legacy=0x7f9554133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.376+0000 7f9559b16700 1 -- 172.21.15.146:0/783838736 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955409e6a0 con 0x7f95540a0a70 2023-10-03T10:19:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.376+0000 7f955a317700 1 --2- 172.21.15.146:0/783838736 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9554134120 0x7f955413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.376+0000 7f9559b16700 1 --2- 172.21.15.146:0/783838736 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95540a0a70 0x7f95540a0e40 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f9550009870 tx=0x7f9550009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a86bd181db68f72 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.376+0000 7f9558b14700 1 -- 172.21.15.146:0/783838736 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9550011830 con 0x7f95540a0a70 2023-10-03T10:19:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.376+0000 7f9558b14700 1 -- 172.21.15.146:0/783838736 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9550011990 con 0x7f95540a0a70 2023-10-03T10:19:06.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.376+0000 7f9558b14700 1 -- 172.21.15.146:0/783838736 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9550011d20 con 0x7f95540a0a70 2023-10-03T10:19:06.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.377+0000 7f955bd7a700 1 -- 172.21.15.146:0/783838736 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95540a0a70 msgr2=0x7f95540a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.377+0000 7f955bd7a700 1 --2- 172.21.15.146:0/783838736 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95540a0a70 0x7f95540a0e40 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f9550009870 tx=0x7f9550009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:06.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.377+0000 7f955bd7a700 1 -- 172.21.15.146:0/783838736 shutdown_connections 2023-10-03T10:19:06.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.377+0000 7f955bd7a700 1 --2- 172.21.15.146:0/783838736 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9554134120 0x7f955413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.377+0000 7f955bd7a700 1 --2- 172.21.15.146:0/783838736 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95540a0a70 0x7f95540a0e40 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.377+0000 7f955bd7a700 1 -- 172.21.15.146:0/783838736 >> 172.21.15.146:0/783838736 conn(0x7f95540a6610 msgr2=0x7f95540a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:06.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.377+0000 7f955bd7a700 1 -- 172.21.15.146:0/783838736 shutdown_connections 2023-10-03T10:19:06.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.377+0000 7f955bd7a700 1 -- 172.21.15.146:0/783838736 wait complete. 2023-10-03T10:19:06.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.378+0000 7f955bd7a700 1 Processor -- start 2023-10-03T10:19:06.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.378+0000 7f955bd7a700 1 -- start start 2023-10-03T10:19:06.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.379+0000 7f955bd7a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95540a0a70 0x7f95541227b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.379+0000 7f955bd7a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95540a1380 0x7f9554122cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.379+0000 7f955bd7a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9554134120 0x7f9554123230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.379+0000 7f955bd7a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9554125d30 con 0x7f95540a0a70 2023-10-03T10:19:06.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.379+0000 7f955bd7a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9554123c10 con 0x7f9554134120 2023-10-03T10:19:06.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.379+0000 7f955bd7a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95541332b0 con 0x7f95540a1380 2023-10-03T10:19:06.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.379+0000 7f9559315700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95540a1380 0x7f9554122cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.379+0000 7f9559315700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95540a1380 0x7f9554122cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34750/0 (socket says 172.21.15.146:34750) 2023-10-03T10:19:06.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.379+0000 7f9559315700 1 -- 172.21.15.146:0/1910900019 learned_addr learned my addr 172.21.15.146:0/1910900019 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:06.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.379+0000 7f955a317700 1 --2- 172.21.15.146:0/1910900019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9554134120 0x7f9554123230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.379+0000 7f9559b16700 1 --2- 172.21.15.146:0/1910900019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95540a0a70 0x7f95541227b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.379+0000 7f9559315700 1 -- 172.21.15.146:0/1910900019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9554134120 msgr2=0x7f9554123230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.379+0000 7f9559315700 1 --2- 172.21.15.146:0/1910900019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9554134120 0x7f9554123230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.379+0000 7f9559315700 1 -- 172.21.15.146:0/1910900019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95540a0a70 msgr2=0x7f95541227b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.380+0000 7f9559315700 1 --2- 172.21.15.146:0/1910900019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95540a0a70 0x7f95541227b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.380+0000 7f9559315700 1 -- 172.21.15.146:0/1910900019 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c009a70 con 0x7f95540a1380 2023-10-03T10:19:06.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.380+0000 7f955a317700 1 --2- 172.21.15.146:0/1910900019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9554134120 0x7f9554123230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:06.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.380+0000 7f9559315700 1 --2- 172.21.15.146:0/1910900019 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95540a1380 0x7f9554122cf0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f9544005910 tx=0x7f954400c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.380+0000 7f954a7fc700 1 -- 172.21.15.146:0/1910900019 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544005d70 con 0x7f95540a1380 2023-10-03T10:19:06.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.380+0000 7f954a7fc700 1 -- 172.21.15.146:0/1910900019 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95440070d0 con 0x7f95540a1380 2023-10-03T10:19:06.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.380+0000 7f954a7fc700 1 -- 172.21.15.146:0/1910900019 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544007460 con 0x7f95540a1380 2023-10-03T10:19:06.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.380+0000 7f955bd7a700 1 -- 172.21.15.146:0/1910900019 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95500094a0 con 0x7f95540a1380 2023-10-03T10:19:06.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.380+0000 7f955bd7a700 1 -- 172.21.15.146:0/1910900019 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95540a5600 con 0x7f95540a1380 2023-10-03T10:19:06.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.381+0000 7f954a7fc700 1 -- 172.21.15.146:0/1910900019 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f95440075c0 con 0x7f95540a1380 2023-10-03T10:19:06.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.381+0000 7f955bd7a700 1 -- 172.21.15.146:0/1910900019 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f955404f2a0 con 0x7f95540a1380 2023-10-03T10:19:06.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.381+0000 7f954a7fc700 1 -- 172.21.15.146:0/1910900019 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f954403eaa0 con 0x7f95540a1380 2023-10-03T10:19:06.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.385+0000 7f954a7fc700 1 -- 172.21.15.146:0/1910900019 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9544018260 con 0x7f95540a1380 2023-10-03T10:19:06.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.415+0000 7f37d28fc700 1 Processor -- start 2023-10-03T10:19:06.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.415+0000 7f37d28fc700 1 -- start start 2023-10-03T10:19:06.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.415+0000 7f37d28fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37cc09e870 0x7f37cc09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.415+0000 7f37d28fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37cc131f40 0x7f37cc139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.415+0000 7f37d28fc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37cc09c970 con 0x7f37cc09f180 2023-10-03T10:19:06.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.415+0000 7f37d28fc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc0a0920 con 0x7f37cc131f40 2023-10-03T10:19:06.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.415+0000 7f37d28fc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc09f9c0 con 0x7f37cc09e870 2023-10-03T10:19:06.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.416+0000 7f37d0e99700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37cc131f40 0x7f37cc139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.416+0000 7f37d0e99700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37cc131f40 0x7f37cc139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:37576/0 (socket says 172.21.15.146:37576) 2023-10-03T10:19:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.416+0000 7f37d0e99700 1 -- 172.21.15.146:0/1228227535 learned_addr learned my addr 172.21.15.146:0/1228227535 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.416+0000 7f37cbfff700 1 --2- 172.21.15.146:0/1228227535 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37cc09e870 0x7f37cc09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.416+0000 7f37caffd700 1 -- 172.21.15.146:0/1228227535 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650353628 0 0) 0x7f37cc09c970 con 0x7f37cc09f180 2023-10-03T10:19:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.416+0000 7f37caffd700 1 -- 172.21.15.146:0/1228227535 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37b40035b0 con 0x7f37cc09f180 2023-10-03T10:19:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.416+0000 7f37d0e99700 1 -- 172.21.15.146:0/1228227535 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37cc09e870 msgr2=0x7f37cc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.416+0000 7f37d0e99700 1 --2- 172.21.15.146:0/1228227535 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37cc09e870 0x7f37cc09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.416+0000 7f37d0e99700 1 -- 172.21.15.146:0/1228227535 >> v1:172.21.15.146:6789/0 conn(0x7f37cc09f180 legacy=0x7f37cc131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.416+0000 7f37d0e99700 1 -- 172.21.15.146:0/1228227535 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37cc09bab0 con 0x7f37cc131f40 2023-10-03T10:19:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.416+0000 7f37d0e99700 1 --2- 172.21.15.146:0/1228227535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37cc131f40 0x7f37cc139ca0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f37c4009e80 tx=0x7f37c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b91911d7d5637b7e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.416+0000 7f37caffd700 1 -- 172.21.15.146:0/1228227535 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c400e070 con 0x7f37cc131f40 2023-10-03T10:19:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.416+0000 7f37caffd700 1 -- 172.21.15.146:0/1228227535 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c400b910 con 0x7f37cc131f40 2023-10-03T10:19:06.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.416+0000 7f37caffd700 1 -- 172.21.15.146:0/1228227535 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c400bcc0 con 0x7f37cc131f40 2023-10-03T10:19:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.417+0000 7f37d28fc700 1 -- 172.21.15.146:0/1228227535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37cc131f40 msgr2=0x7f37cc139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.417+0000 7f37d28fc700 1 --2- 172.21.15.146:0/1228227535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37cc131f40 0x7f37cc139ca0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f37c4009e80 tx=0x7f37c400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.417+0000 7f37d28fc700 1 -- 172.21.15.146:0/1228227535 shutdown_connections 2023-10-03T10:19:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.417+0000 7f37d28fc700 1 --2- 172.21.15.146:0/1228227535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37cc131f40 0x7f37cc139ca0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.417+0000 7f37d28fc700 1 --2- 172.21.15.146:0/1228227535 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37cc09e870 0x7f37cc09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.417+0000 7f37d28fc700 1 -- 172.21.15.146:0/1228227535 >> 172.21.15.146:0/1228227535 conn(0x7f37cc0a4430 msgr2=0x7f37cc0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.417+0000 7f37d28fc700 1 -- 172.21.15.146:0/1228227535 shutdown_connections 2023-10-03T10:19:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.417+0000 7f37d28fc700 1 -- 172.21.15.146:0/1228227535 wait complete. 2023-10-03T10:19:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.418+0000 7f37d28fc700 1 Processor -- start 2023-10-03T10:19:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.418+0000 7f37d28fc700 1 -- start start 2023-10-03T10:19:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.418+0000 7f37d28fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37cc09e870 0x7f37cc120070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.418+0000 7f37d28fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37cc09f180 0x7f37cc1205b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.418+0000 7f37d28fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37cc131f40 0x7f37cc120af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.418+0000 7f37d28fc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc123be0 con 0x7f37cc09e870 2023-10-03T10:19:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.419+0000 7f37d28fc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc122e80 con 0x7f37cc09f180 2023-10-03T10:19:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.419+0000 7f37d28fc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc121db0 con 0x7f37cc131f40 2023-10-03T10:19:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.419+0000 7f37cbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37cc09e870 0x7f37cc120070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.419+0000 7f37d0e99700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37cc131f40 0x7f37cc120af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.419+0000 7f37cbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37cc09e870 0x7f37cc120070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51658/0 (socket says 172.21.15.146:51658) 2023-10-03T10:19:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.419+0000 7f37cbfff700 1 -- 172.21.15.146:0/294649087 learned_addr learned my addr 172.21.15.146:0/294649087 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.419+0000 7f37cb7fe700 1 --2- 172.21.15.146:0/294649087 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37cc09f180 0x7f37cc1205b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.419+0000 7f37cbfff700 1 -- 172.21.15.146:0/294649087 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37cc131f40 msgr2=0x7f37cc120af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.419+0000 7f37cbfff700 1 --2- 172.21.15.146:0/294649087 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37cc131f40 0x7f37cc120af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.419+0000 7f37cbfff700 1 -- 172.21.15.146:0/294649087 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37cc09f180 msgr2=0x7f37cc1205b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.419+0000 7f37cbfff700 1 --2- 172.21.15.146:0/294649087 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37cc09f180 0x7f37cc1205b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.419+0000 7f37cbfff700 1 -- 172.21.15.146:0/294649087 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c4009b30 con 0x7f37cc09e870 2023-10-03T10:19:06.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.419+0000 7f37cb7fe700 1 --2- 172.21.15.146:0/294649087 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37cc09f180 0x7f37cc1205b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:06.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.419+0000 7f37cbfff700 1 --2- 172.21.15.146:0/294649087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37cc09e870 0x7f37cc120070 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f37bc00e8a0 tx=0x7f37bc00ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.419+0000 7f37c8ff9700 1 -- 172.21.15.146:0/294649087 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc009590 con 0x7f37cc09e870 2023-10-03T10:19:06.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.419+0000 7f37c8ff9700 1 -- 172.21.15.146:0/294649087 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37bc013680 con 0x7f37cc09e870 2023-10-03T10:19:06.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.419+0000 7f37c8ff9700 1 -- 172.21.15.146:0/294649087 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc0139f0 con 0x7f37cc09e870 2023-10-03T10:19:06.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.419+0000 7f37d28fc700 1 -- 172.21.15.146:0/294649087 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37cc122ac0 con 0x7f37cc09e870 2023-10-03T10:19:06.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.419+0000 7f37d28fc700 1 -- 172.21.15.146:0/294649087 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37cc123860 con 0x7f37cc09e870 2023-10-03T10:19:06.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.420+0000 7f37c8ff9700 1 -- 172.21.15.146:0/294649087 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f37bc013b50 con 0x7f37cc09e870 2023-10-03T10:19:06.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.421+0000 7f37c8ff9700 1 -- 172.21.15.146:0/294649087 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f37bc03f9c0 con 0x7f37cc09e870 2023-10-03T10:19:06.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.421+0000 7f37d28fc700 1 -- 172.21.15.146:0/294649087 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37cc1232d0 con 0x7f37cc09e870 2023-10-03T10:19:06.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.425+0000 7f37c8ff9700 1 -- 172.21.15.146:0/294649087 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f37bc017080 con 0x7f37cc09e870 2023-10-03T10:19:06.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.496+0000 7f46b86d4700 1 -- 172.21.15.146:0/3548401647 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f46b004f2a0 con 0x7f46b0134570 2023-10-03T10:19:06.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.496+0000 7f46a6ffd700 1 -- 172.21.15.146:0/3548401647 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f46a801bb90 con 0x7f46b0134570 2023-10-03T10:19:06.496 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:06.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.498+0000 7f46b86d4700 1 -- 172.21.15.146:0/3548401647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b0134570 msgr2=0x7f46b0139ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.498+0000 7f46b86d4700 1 --2- 172.21.15.146:0/3548401647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b0134570 0x7f46b0139ea0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f46a8015000 tx=0x7f46a8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.499+0000 7f46b86d4700 1 -- 172.21.15.146:0/3548401647 shutdown_connections 2023-10-03T10:19:06.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.499+0000 7f46b86d4700 1 --2- 172.21.15.146:0/3548401647 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b0134570 0x7f46b0139ea0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.499+0000 7f46b86d4700 1 --2- 172.21.15.146:0/3548401647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46b009ad40 0x7f46b0139420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.499+0000 7f46b86d4700 1 --2- 172.21.15.146:0/3548401647 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f46b0134140 0x7f46b0139960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.499+0000 7f46b86d4700 1 -- 172.21.15.146:0/3548401647 >> 172.21.15.146:0/3548401647 conn(0x7f46b0099c40 msgr2=0x7f46b013b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:06.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.499+0000 7f46b86d4700 1 -- 172.21.15.146:0/3548401647 shutdown_connections 2023-10-03T10:19:06.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.499+0000 7f46b86d4700 1 -- 172.21.15.146:0/3548401647 wait complete. 2023-10-03T10:19:06.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:19:06.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.580+0000 7f955bd7a700 1 -- 172.21.15.146:0/1910900019 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9554072980 con 0x7f95540a1380 2023-10-03T10:19:06.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.580+0000 7f954a7fc700 1 -- 172.21.15.146:0/1910900019 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9544017070 con 0x7f95540a1380 2023-10-03T10:19:06.580 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:19:06.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.582+0000 7f955bd7a700 1 -- 172.21.15.146:0/1910900019 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95540a1380 msgr2=0x7f9554122cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.582+0000 7f955bd7a700 1 --2- 172.21.15.146:0/1910900019 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95540a1380 0x7f9554122cf0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f9544005910 tx=0x7f954400c9e0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.582+0000 7f955bd7a700 1 -- 172.21.15.146:0/1910900019 shutdown_connections 2023-10-03T10:19:06.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.582+0000 7f955bd7a700 1 --2- 172.21.15.146:0/1910900019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9554134120 0x7f9554123230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.582+0000 7f955bd7a700 1 --2- 172.21.15.146:0/1910900019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95540a0a70 0x7f95541227b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.582+0000 7f955bd7a700 1 --2- 172.21.15.146:0/1910900019 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f95540a1380 0x7f9554122cf0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.582+0000 7f955bd7a700 1 -- 172.21.15.146:0/1910900019 >> 172.21.15.146:0/1910900019 conn(0x7f95540a6610 msgr2=0x7f955411c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:06.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.582+0000 7f955bd7a700 1 -- 172.21.15.146:0/1910900019 shutdown_connections 2023-10-03T10:19:06.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.582+0000 7f955bd7a700 1 -- 172.21.15.146:0/1910900019 wait complete. 2023-10-03T10:19:06.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:19:06.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.619+0000 7f37d28fc700 1 -- 172.21.15.146:0/294649087 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f37cc11ce70 con 0x7f37cc09e870 2023-10-03T10:19:06.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.620+0000 7f37c8ff9700 1 -- 172.21.15.146:0/294649087 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f37bc021020 con 0x7f37cc09e870 2023-10-03T10:19:06.620 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:19:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.622+0000 7f37d28fc700 1 -- 172.21.15.146:0/294649087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37cc09e870 msgr2=0x7f37cc120070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.622+0000 7f37d28fc700 1 --2- 172.21.15.146:0/294649087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37cc09e870 0x7f37cc120070 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f37bc00e8a0 tx=0x7f37bc00ebb0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.622+0000 7f37d28fc700 1 -- 172.21.15.146:0/294649087 shutdown_connections 2023-10-03T10:19:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.622+0000 7f37d28fc700 1 --2- 172.21.15.146:0/294649087 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37cc131f40 0x7f37cc120af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.622+0000 7f37d28fc700 1 --2- 172.21.15.146:0/294649087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37cc09e870 0x7f37cc120070 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.622+0000 7f37d28fc700 1 --2- 172.21.15.146:0/294649087 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37cc09f180 0x7f37cc1205b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.622+0000 7f37d28fc700 1 -- 172.21.15.146:0/294649087 >> 172.21.15.146:0/294649087 conn(0x7f37cc0a4430 msgr2=0x7f37cc072080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.622+0000 7f37d28fc700 1 -- 172.21.15.146:0/294649087 shutdown_connections 2023-10-03T10:19:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:06.622+0000 7f37d28fc700 1 -- 172.21.15.146:0/294649087 wait complete. 2023-10-03T10:19:06.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:19:07.162 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:07.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.287+0000 7fe607699700 1 Processor -- start 2023-10-03T10:19:07.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.287+0000 7fe607699700 1 -- start start 2023-10-03T10:19:07.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.287+0000 7fe607699700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe600133ad0 0x7fe600133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.287+0000 7fe607699700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe600130bc0 0x7fe60013b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.287+0000 7fe607699700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60006b2d0 con 0x7fe6001300a0 2023-10-03T10:19:07.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.287+0000 7fe607699700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe600133610 con 0x7fe600130bc0 2023-10-03T10:19:07.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.287+0000 7fe607699700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe60009a500 con 0x7fe600133ad0 2023-10-03T10:19:07.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.287+0000 7fe605c36700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe600130bc0 0x7fe60013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.287+0000 7fe605435700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe600133ad0 0x7fe600133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.287+0000 7fe604c34700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe6001300a0 0x7fe6001304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36634/0 (socket says 172.21.15.146:36634) 2023-10-03T10:19:07.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.287+0000 7fe604c34700 1 -- 172.21.15.146:0/1375757585 learned_addr learned my addr 172.21.15.146:0/1375757585 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:07.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.288+0000 7fe605c36700 1 -- 172.21.15.146:0/1375757585 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe600133ad0 msgr2=0x7fe600133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:07.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.288+0000 7fe605c36700 1 --2- 172.21.15.146:0/1375757585 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe600133ad0 0x7fe600133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.288+0000 7fe605c36700 1 -- 172.21.15.146:0/1375757585 >> v1:172.21.15.146:6789/0 conn(0x7fe6001300a0 legacy=0x7fe6001304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.288+0000 7fe605c36700 1 -- 172.21.15.146:0/1375757585 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6001338b0 con 0x7fe600130bc0 2023-10-03T10:19:07.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.288+0000 7fe605435700 1 --2- 172.21.15.146:0/1375757585 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe600133ad0 0x7fe600133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:07.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.288+0000 7fe605c36700 1 --2- 172.21.15.146:0/1375757585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600130bc0 0x7fe60013b990 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009d90 tx=0x7fe5f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bff8b437c238309 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:07.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.288+0000 7fe5f7fff700 1 -- 172.21.15.146:0/1375757585 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800e070 con 0x7fe600130bc0 2023-10-03T10:19:07.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.288+0000 7fe5f7fff700 1 -- 172.21.15.146:0/1375757585 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f800bb20 con 0x7fe600130bc0 2023-10-03T10:19:07.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.288+0000 7fe5f7fff700 1 -- 172.21.15.146:0/1375757585 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8012430 con 0x7fe600130bc0 2023-10-03T10:19:07.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.289+0000 7fe607699700 1 -- 172.21.15.146:0/1375757585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600130bc0 msgr2=0x7fe60013b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.289+0000 7fe607699700 1 --2- 172.21.15.146:0/1375757585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600130bc0 0x7fe60013b990 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009d90 tx=0x7fe5f800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:07.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.289+0000 7fe607699700 1 -- 172.21.15.146:0/1375757585 shutdown_connections 2023-10-03T10:19:07.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.289+0000 7fe607699700 1 --2- 172.21.15.146:0/1375757585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600130bc0 0x7fe60013b990 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.289+0000 7fe607699700 1 --2- 172.21.15.146:0/1375757585 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe600133ad0 0x7fe600133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.289+0000 7fe607699700 1 -- 172.21.15.146:0/1375757585 >> 172.21.15.146:0/1375757585 conn(0x7fe600099c40 msgr2=0x7fe6000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:07.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.289+0000 7fe607699700 1 -- 172.21.15.146:0/1375757585 shutdown_connections 2023-10-03T10:19:07.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.289+0000 7fe607699700 1 -- 172.21.15.146:0/1375757585 wait complete. 2023-10-03T10:19:07.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.290+0000 7fe607699700 1 Processor -- start 2023-10-03T10:19:07.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.290+0000 7fe607699700 1 -- start start 2023-10-03T10:19:07.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.290+0000 7fe607699700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6001300a0 0x7fe60011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.290+0000 7fe607699700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600130bc0 0x7fe60011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.290+0000 7fe607699700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe600133ad0 0x7fe60011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.290+0000 7fe607699700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60012da10 con 0x7fe600130bc0 2023-10-03T10:19:07.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.290+0000 7fe607699700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60011fe50 con 0x7fe6001300a0 2023-10-03T10:19:07.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.290+0000 7fe607699700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe600120a30 con 0x7fe600133ad0 2023-10-03T10:19:07.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.290+0000 7fe604c34700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600130bc0 0x7fe60011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.290+0000 7fe605435700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6001300a0 0x7fe60011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.290+0000 7fe604c34700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600130bc0 0x7fe60011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51688/0 (socket says 172.21.15.146:51688) 2023-10-03T10:19:07.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.290+0000 7fe604c34700 1 -- 172.21.15.146:0/1546472963 learned_addr learned my addr 172.21.15.146:0/1546472963 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:07.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.290+0000 7fe605c36700 1 --2- 172.21.15.146:0/1546472963 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe600133ad0 0x7fe60011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.290+0000 7fe604c34700 1 -- 172.21.15.146:0/1546472963 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe600133ad0 msgr2=0x7fe60011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.290+0000 7fe604c34700 1 --2- 172.21.15.146:0/1546472963 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe600133ad0 0x7fe60011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.290+0000 7fe604c34700 1 -- 172.21.15.146:0/1546472963 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6001300a0 msgr2=0x7fe60011da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.290+0000 7fe604c34700 1 --2- 172.21.15.146:0/1546472963 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6001300a0 0x7fe60011da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.290+0000 7fe604c34700 1 -- 172.21.15.146:0/1546472963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc0094a0 con 0x7fe600130bc0 2023-10-03T10:19:07.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.290+0000 7fe605435700 1 --2- 172.21.15.146:0/1546472963 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6001300a0 0x7fe60011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:07.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.291+0000 7fe604c34700 1 --2- 172.21.15.146:0/1546472963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600130bc0 0x7fe60011df80 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000c450 tx=0x7fe5f000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:07.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.291+0000 7fe5f5ffb700 1 -- 172.21.15.146:0/1546472963 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0005d70 con 0x7fe600130bc0 2023-10-03T10:19:07.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.291+0000 7fe5f5ffb700 1 -- 172.21.15.146:0/1546472963 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f000ce60 con 0x7fe600130bc0 2023-10-03T10:19:07.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.291+0000 7fe5f5ffb700 1 -- 172.21.15.146:0/1546472963 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f00072d0 con 0x7fe600130bc0 2023-10-03T10:19:07.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.291+0000 7fe607699700 1 -- 172.21.15.146:0/1546472963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f8009a70 con 0x7fe600130bc0 2023-10-03T10:19:07.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.291+0000 7fe607699700 1 -- 172.21.15.146:0/1546472963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60012dd00 con 0x7fe600130bc0 2023-10-03T10:19:07.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.291+0000 7fe5f5ffb700 1 -- 172.21.15.146:0/1546472963 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe5f0007430 con 0x7fe600130bc0 2023-10-03T10:19:07.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.292+0000 7fe5f5ffb700 1 -- 172.21.15.146:0/1546472963 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe5f003ea40 con 0x7fe600130bc0 2023-10-03T10:19:07.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.292+0000 7fe607699700 1 -- 172.21.15.146:0/1546472963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe60011eff0 con 0x7fe600130bc0 2023-10-03T10:19:07.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.297+0000 7fe5f5ffb700 1 -- 172.21.15.146:0/1546472963 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5f0017020 con 0x7fe600130bc0 2023-10-03T10:19:07.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.480+0000 7fe607699700 1 -- 172.21.15.146:0/1546472963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe60004f2a0 con 0x7fe600130bc0 2023-10-03T10:19:07.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.481+0000 7fe5f5ffb700 1 -- 172.21.15.146:0/1546472963 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe5f0024070 con 0x7fe600130bc0 2023-10-03T10:19:07.481 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:07.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.483+0000 7fe607699700 1 -- 172.21.15.146:0/1546472963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600130bc0 msgr2=0x7fe60011df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.483+0000 7fe607699700 1 --2- 172.21.15.146:0/1546472963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600130bc0 0x7fe60011df80 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000c450 tx=0x7fe5f000c760 comp rx=0 tx=0).stop 2023-10-03T10:19:07.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.483+0000 7fe607699700 1 -- 172.21.15.146:0/1546472963 shutdown_connections 2023-10-03T10:19:07.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.483+0000 7fe607699700 1 --2- 172.21.15.146:0/1546472963 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe600133ad0 0x7fe60011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.483+0000 7fe607699700 1 --2- 172.21.15.146:0/1546472963 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6001300a0 0x7fe60011da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.483+0000 7fe607699700 1 --2- 172.21.15.146:0/1546472963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600130bc0 0x7fe60011df80 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.483+0000 7fe607699700 1 -- 172.21.15.146:0/1546472963 >> 172.21.15.146:0/1546472963 conn(0x7fe600099c40 msgr2=0x7fe600132d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:07.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.483+0000 7fe607699700 1 -- 172.21.15.146:0/1546472963 shutdown_connections 2023-10-03T10:19:07.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.483+0000 7fe607699700 1 -- 172.21.15.146:0/1546472963 wait complete. 2023-10-03T10:19:07.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:19:07.511 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:07.595 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:07.634 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:07.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.638+0000 7fcc0eaed700 1 Processor -- start 2023-10-03T10:19:07.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.638+0000 7fcc0eaed700 1 -- start start 2023-10-03T10:19:07.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.638+0000 7fcc0eaed700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc0809ad40 0x7fcc08133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.638+0000 7fcc0eaed700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc08133f70 0x7fcc081343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.638+0000 7fcc0eaed700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc0809b110 con 0x7fcc080a0a70 2023-10-03T10:19:07.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.638+0000 7fcc0eaed700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc080a3b60 con 0x7fcc0809ad40 2023-10-03T10:19:07.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.638+0000 7fcc0eaed700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc081348e0 con 0x7fcc08133f70 2023-10-03T10:19:07.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.638+0000 7fcc07fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc08133f70 0x7fcc081343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.638+0000 7fcc0c889700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc0809ad40 0x7fcc08133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.638+0000 7fcc0d08a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcc080a0a70 0x7fcc080a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36642/0 (socket says 172.21.15.146:36642) 2023-10-03T10:19:07.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.638+0000 7fcc0d08a700 1 -- 172.21.15.146:0/3678744465 learned_addr learned my addr 172.21.15.146:0/3678744465 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:07.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.638+0000 7fcc0c889700 1 -- 172.21.15.146:0/3678744465 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc08133f70 msgr2=0x7fcc081343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:07.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.639+0000 7fcc0c889700 1 --2- 172.21.15.146:0/3678744465 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc08133f70 0x7fcc081343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.638+0000 7fcc077fe700 1 -- 172.21.15.146:0/3678744465 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919625868 0 0) 0x7fcc0809b110 con 0x7fcc080a0a70 2023-10-03T10:19:07.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.639+0000 7fcc0c889700 1 -- 172.21.15.146:0/3678744465 >> v1:172.21.15.146:6789/0 conn(0x7fcc080a0a70 legacy=0x7fcc080a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.639+0000 7fcc0c889700 1 -- 172.21.15.146:0/3678744465 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc080a2fa0 con 0x7fcc0809ad40 2023-10-03T10:19:07.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.639+0000 7fcc0c889700 1 --2- 172.21.15.146:0/3678744465 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc0809ad40 0x7fcc08133a30 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009870 tx=0x7fcbfc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d220e87f9487ce8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:07.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.639+0000 7fcc077fe700 1 -- 172.21.15.146:0/3678744465 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc011830 con 0x7fcc0809ad40 2023-10-03T10:19:07.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.639+0000 7fcc077fe700 1 -- 172.21.15.146:0/3678744465 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc011990 con 0x7fcc0809ad40 2023-10-03T10:19:07.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.639+0000 7fcc077fe700 1 -- 172.21.15.146:0/3678744465 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc011d20 con 0x7fcc0809ad40 2023-10-03T10:19:07.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.640+0000 7fcc0eaed700 1 -- 172.21.15.146:0/3678744465 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc0809ad40 msgr2=0x7fcc08133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.640+0000 7fcc0eaed700 1 --2- 172.21.15.146:0/3678744465 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc0809ad40 0x7fcc08133a30 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009870 tx=0x7fcbfc009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:07.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.640+0000 7fcc0eaed700 1 -- 172.21.15.146:0/3678744465 shutdown_connections 2023-10-03T10:19:07.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.640+0000 7fcc0eaed700 1 --2- 172.21.15.146:0/3678744465 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc0809ad40 0x7fcc08133a30 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.640+0000 7fcc0eaed700 1 --2- 172.21.15.146:0/3678744465 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc08133f70 0x7fcc081343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.640+0000 7fcc0eaed700 1 -- 172.21.15.146:0/3678744465 >> 172.21.15.146:0/3678744465 conn(0x7fcc08099c40 msgr2=0x7fcc0806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:07.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.640+0000 7fcc0eaed700 1 -- 172.21.15.146:0/3678744465 shutdown_connections 2023-10-03T10:19:07.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.640+0000 7fcc0eaed700 1 -- 172.21.15.146:0/3678744465 wait complete. 2023-10-03T10:19:07.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.641+0000 7fcc0eaed700 1 Processor -- start 2023-10-03T10:19:07.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.641+0000 7fcc0eaed700 1 -- start start 2023-10-03T10:19:07.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.641+0000 7fcc0eaed700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc0809ad40 0x7fcc081c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.641+0000 7fcc0eaed700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc080a0a70 0x7fcc081c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.641+0000 7fcc0eaed700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc08133f70 0x7fcc081c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.642+0000 7fcc0eaed700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc08120850 con 0x7fcc080a0a70 2023-10-03T10:19:07.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.642+0000 7fcc0eaed700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc08120660 con 0x7fcc0809ad40 2023-10-03T10:19:07.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.642+0000 7fcc0eaed700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0809e680 con 0x7fcc08133f70 2023-10-03T10:19:07.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.642+0000 7fcc07fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc080a0a70 0x7fcc081c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.642+0000 7fcc07fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc080a0a70 0x7fcc081c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51704/0 (socket says 172.21.15.146:51704) 2023-10-03T10:19:07.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.642+0000 7fcc07fff700 1 -- 172.21.15.146:0/1465134190 learned_addr learned my addr 172.21.15.146:0/1465134190 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:07.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.642+0000 7fcc0d08a700 1 --2- 172.21.15.146:0/1465134190 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc08133f70 0x7fcc081c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.642+0000 7fcc0c889700 1 --2- 172.21.15.146:0/1465134190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc0809ad40 0x7fcc081c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.642+0000 7fcc07fff700 1 -- 172.21.15.146:0/1465134190 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc08133f70 msgr2=0x7fcc081c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.642+0000 7fcc07fff700 1 --2- 172.21.15.146:0/1465134190 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc08133f70 0x7fcc081c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.642+0000 7fcc07fff700 1 -- 172.21.15.146:0/1465134190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc0809ad40 msgr2=0x7fcc081c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.642+0000 7fcc07fff700 1 --2- 172.21.15.146:0/1465134190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc0809ad40 0x7fcc081c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.642+0000 7fcc07fff700 1 -- 172.21.15.146:0/1465134190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbfc0094a0 con 0x7fcc080a0a70 2023-10-03T10:19:07.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.642+0000 7fcc0d08a700 1 --2- 172.21.15.146:0/1465134190 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc08133f70 0x7fcc081c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:07.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.642+0000 7fcc0c889700 1 --2- 172.21.15.146:0/1465134190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc0809ad40 0x7fcc081c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:07.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.642+0000 7fcc07fff700 1 --2- 172.21.15.146:0/1465134190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc080a0a70 0x7fcc081c86d0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400e9b0 tx=0x7fcbf400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:07.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.642+0000 7fcc057fa700 1 -- 172.21.15.146:0/1465134190 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4009710 con 0x7fcc080a0a70 2023-10-03T10:19:07.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.642+0000 7fcc057fa700 1 -- 172.21.15.146:0/1465134190 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf400ee50 con 0x7fcc080a0a70 2023-10-03T10:19:07.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.642+0000 7fcc057fa700 1 -- 172.21.15.146:0/1465134190 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf400ca70 con 0x7fcc080a0a70 2023-10-03T10:19:07.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.643+0000 7fcc0eaed700 1 -- 172.21.15.146:0/1465134190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc0809c7e0 con 0x7fcc080a0a70 2023-10-03T10:19:07.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.643+0000 7fcc0eaed700 1 -- 172.21.15.146:0/1465134190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc081212d0 con 0x7fcc080a0a70 2023-10-03T10:19:07.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.644+0000 7fcc0eaed700 1 -- 172.21.15.146:0/1465134190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc0804f2a0 con 0x7fcc080a0a70 2023-10-03T10:19:07.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.644+0000 7fcc057fa700 1 -- 172.21.15.146:0/1465134190 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcbf400cbd0 con 0x7fcc080a0a70 2023-10-03T10:19:07.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.644+0000 7fcc057fa700 1 -- 172.21.15.146:0/1465134190 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcbf403fa80 con 0x7fcc080a0a70 2023-10-03T10:19:07.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.649+0000 7fcc057fa700 1 -- 172.21.15.146:0/1465134190 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcbf401b3b0 con 0x7fcc080a0a70 2023-10-03T10:19:07.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.747+0000 7fe2a070d700 1 Processor -- start 2023-10-03T10:19:07.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.747+0000 7fe2a070d700 1 -- start start 2023-10-03T10:19:07.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.747+0000 7fe2a070d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe29809f350 0x7fe298136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.747+0000 7fe2a070d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe2981371c0 0x7fe2981395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.747+0000 7fe2a070d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29809c970 con 0x7fe29809e870 2023-10-03T10:19:07.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.747+0000 7fe2a070d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2980a0920 con 0x7fe2981371c0 2023-10-03T10:19:07.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.747+0000 7fe2a070d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe29809f9c0 con 0x7fe29809f350 2023-10-03T10:19:07.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.747+0000 7fe29dca8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe29809f350 0x7fe298136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.747+0000 7fe29dca8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe29809f350 0x7fe298136c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34808/0 (socket says 172.21.15.146:34808) 2023-10-03T10:19:07.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.747+0000 7fe29dca8700 1 -- 172.21.15.146:0/3228072834 learned_addr learned my addr 172.21.15.146:0/3228072834 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:07.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.747+0000 7fe29ecaa700 1 --2- 172.21.15.146:0/3228072834 >> v2:172.21.15.146:3300/0 conn(0x7fe2981371c0 0x7fe2981395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.748+0000 7fe29dca8700 1 -- 172.21.15.146:0/3228072834 >> v2:172.21.15.146:3300/0 conn(0x7fe2981371c0 msgr2=0x7fe2981395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:07.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.748+0000 7fe29dca8700 1 --2- 172.21.15.146:0/3228072834 >> v2:172.21.15.146:3300/0 conn(0x7fe2981371c0 0x7fe2981395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.748+0000 7fe29dca8700 1 -- 172.21.15.146:0/3228072834 >> v1:172.21.15.146:6789/0 conn(0x7fe29809e870 legacy=0x7fe29809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.748+0000 7fe29dca8700 1 -- 172.21.15.146:0/3228072834 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29809bab0 con 0x7fe29809f350 2023-10-03T10:19:07.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.748+0000 7fe29ecaa700 1 --2- 172.21.15.146:0/3228072834 >> v2:172.21.15.146:3300/0 conn(0x7fe2981371c0 0x7fe2981395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:07.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.748+0000 7fe29dca8700 1 --2- 172.21.15.146:0/3228072834 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe29809f350 0x7fe298136c80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fe2880098f0 tx=0x7fe288009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bad5789d3e8a296 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:07.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.748+0000 7fe29d4a7700 1 -- 172.21.15.146:0/3228072834 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe288011830 con 0x7fe29809f350 2023-10-03T10:19:07.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.748+0000 7fe29d4a7700 1 -- 172.21.15.146:0/3228072834 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe288011990 con 0x7fe29809f350 2023-10-03T10:19:07.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.748+0000 7fe29d4a7700 1 -- 172.21.15.146:0/3228072834 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe288011d20 con 0x7fe29809f350 2023-10-03T10:19:07.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.749+0000 7fe2a070d700 1 -- 172.21.15.146:0/3228072834 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe29809f350 msgr2=0x7fe298136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.749+0000 7fe2a070d700 1 --2- 172.21.15.146:0/3228072834 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe29809f350 0x7fe298136c80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fe2880098f0 tx=0x7fe288009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:07.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.749+0000 7fe2a070d700 1 -- 172.21.15.146:0/3228072834 shutdown_connections 2023-10-03T10:19:07.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.749+0000 7fe2a070d700 1 --2- 172.21.15.146:0/3228072834 >> v2:172.21.15.146:3300/0 conn(0x7fe2981371c0 0x7fe2981395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.749+0000 7fe2a070d700 1 --2- 172.21.15.146:0/3228072834 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe29809f350 0x7fe298136c80 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.749+0000 7fe2a070d700 1 -- 172.21.15.146:0/3228072834 >> 172.21.15.146:0/3228072834 conn(0x7fe2980a4430 msgr2=0x7fe2980a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:07.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.749+0000 7fe2a070d700 1 -- 172.21.15.146:0/3228072834 shutdown_connections 2023-10-03T10:19:07.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.749+0000 7fe2a070d700 1 -- 172.21.15.146:0/3228072834 wait complete. 2023-10-03T10:19:07.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.750+0000 7fe2a070d700 1 Processor -- start 2023-10-03T10:19:07.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.750+0000 7fe2a070d700 1 -- start start 2023-10-03T10:19:07.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.750+0000 7fe2a070d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe29809e870 0x7fe298120850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.750+0000 7fe2a070d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe29809f350 0x7fe298120d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.750+0000 7fe2a070d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2981371c0 0x7fe2981212d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.750+0000 7fe2a070d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29809dba0 con 0x7fe29809e870 2023-10-03T10:19:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.750+0000 7fe2a070d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe298124090 con 0x7fe2981371c0 2023-10-03T10:19:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.750+0000 7fe2a070d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe298122570 con 0x7fe29809f350 2023-10-03T10:19:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.750+0000 7fe29e4a9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe29809e870 0x7fe298120850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.750+0000 7fe29dca8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe29809f350 0x7fe298120d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.750+0000 7fe29ecaa700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2981371c0 0x7fe2981212d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.750+0000 7fe29dca8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe29809f350 0x7fe298120d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34816/0 (socket says 172.21.15.146:34816) 2023-10-03T10:19:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.750+0000 7fe29e4a9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe29809e870 0x7fe298120850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51720/0 (socket says 172.21.15.146:51720) 2023-10-03T10:19:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.750+0000 7fe29dca8700 1 -- 172.21.15.146:0/1152743547 learned_addr learned my addr 172.21.15.146:0/1152743547 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.751+0000 7fe29e4a9700 1 -- 172.21.15.146:0/1152743547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe29809f350 msgr2=0x7fe298120d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.751+0000 7fe29e4a9700 1 --2- 172.21.15.146:0/1152743547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe29809f350 0x7fe298120d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.751+0000 7fe29e4a9700 1 -- 172.21.15.146:0/1152743547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2981371c0 msgr2=0x7fe2981212d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.751+0000 7fe29e4a9700 1 --2- 172.21.15.146:0/1152743547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2981371c0 0x7fe2981212d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.751+0000 7fe29e4a9700 1 -- 172.21.15.146:0/1152743547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe290009a70 con 0x7fe29809e870 2023-10-03T10:19:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.751+0000 7fe29e4a9700 1 --2- 172.21.15.146:0/1152743547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe29809e870 0x7fe298120850 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fe294000f60 tx=0x7fe29400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.751+0000 7fe28effd700 1 -- 172.21.15.146:0/1152743547 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2940052d0 con 0x7fe29809e870 2023-10-03T10:19:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.751+0000 7fe28effd700 1 -- 172.21.15.146:0/1152743547 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe294005430 con 0x7fe29809e870 2023-10-03T10:19:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.751+0000 7fe28effd700 1 -- 172.21.15.146:0/1152743547 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2940038c0 con 0x7fe29809e870 2023-10-03T10:19:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.751+0000 7fe2a070d700 1 -- 172.21.15.146:0/1152743547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe288009550 con 0x7fe29809e870 2023-10-03T10:19:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.751+0000 7fe2a070d700 1 -- 172.21.15.146:0/1152743547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe298124b00 con 0x7fe29809e870 2023-10-03T10:19:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.752+0000 7fe28effd700 1 -- 172.21.15.146:0/1152743547 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe294003a20 con 0x7fe29809e870 2023-10-03T10:19:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.752+0000 7fe28effd700 1 -- 172.21.15.146:0/1152743547 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fe29403e9b0 con 0x7fe29809e870 2023-10-03T10:19:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.752+0000 7fe2a070d700 1 -- 172.21.15.146:0/1152743547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe298123ce0 con 0x7fe29809e870 2023-10-03T10:19:07.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.757+0000 7fe28effd700 1 -- 172.21.15.146:0/1152743547 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe294017080 con 0x7fe29809e870 2023-10-03T10:19:07.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.771+0000 7f7c522e3700 1 Processor -- start 2023-10-03T10:19:07.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.771+0000 7f7c522e3700 1 -- start start 2023-10-03T10:19:07.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.772+0000 7f7c522e3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c4c09e950 0x7f7c4c09ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.772+0000 7f7c522e3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7c4c09f260 0x7f7c4c131890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.772+0000 7f7c522e3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c4c09afb0 con 0x7f7c4c131dd0 2023-10-03T10:19:07.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.772+0000 7f7c522e3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4c0a0970 con 0x7f7c4c09f260 2023-10-03T10:19:07.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.772+0000 7f7c522e3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c0a0320 con 0x7f7c4c09e950 2023-10-03T10:19:07.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.772+0000 7f7c4b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7c4c09f260 0x7f7c4c131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.772+0000 7f7c50880700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7c4c131dd0 0x7f7c4c138ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36664/0 (socket says 172.21.15.146:36664) 2023-10-03T10:19:07.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.772+0000 7f7c4bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c4c09e950 0x7f7c4c09ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.772+0000 7f7c50880700 1 -- 172.21.15.146:0/4012460858 learned_addr learned my addr 172.21.15.146:0/4012460858 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.772+0000 7f7c4affd700 1 -- 172.21.15.146:0/4012460858 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779807651 0 0) 0x7f7c4c09afb0 con 0x7f7c4c131dd0 2023-10-03T10:19:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.772+0000 7f7c4affd700 1 -- 172.21.15.146:0/4012460858 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c340035b0 con 0x7f7c4c131dd0 2023-10-03T10:19:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.772+0000 7f7c4bfff700 1 -- 172.21.15.146:0/4012460858 >> v2:172.21.15.146:3300/0 conn(0x7f7c4c09f260 msgr2=0x7f7c4c131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.772+0000 7f7c4bfff700 1 --2- 172.21.15.146:0/4012460858 >> v2:172.21.15.146:3300/0 conn(0x7f7c4c09f260 0x7f7c4c131890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.772+0000 7f7c4bfff700 1 -- 172.21.15.146:0/4012460858 >> v1:172.21.15.146:6789/0 conn(0x7f7c4c131dd0 legacy=0x7f7c4c138ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.772+0000 7f7c4bfff700 1 -- 172.21.15.146:0/4012460858 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c0a0750 con 0x7f7c4c09e950 2023-10-03T10:19:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.772+0000 7f7c4b7fe700 1 --2- 172.21.15.146:0/4012460858 >> v2:172.21.15.146:3300/0 conn(0x7f7c4c09f260 0x7f7c4c131890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.772+0000 7f7c4bfff700 1 --2- 172.21.15.146:0/4012460858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c4c09e950 0x7f7c4c09ed20 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009820 tx=0x7f7c3c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ae2c495d025f297 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.773+0000 7f7c4affd700 1 -- 172.21.15.146:0/4012460858 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c005e30 con 0x7f7c4c09e950 2023-10-03T10:19:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.773+0000 7f7c4affd700 1 -- 172.21.15.146:0/4012460858 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3c006030 con 0x7f7c4c09e950 2023-10-03T10:19:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.773+0000 7f7c4affd700 1 -- 172.21.15.146:0/4012460858 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0063c0 con 0x7f7c4c09e950 2023-10-03T10:19:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.773+0000 7f7c522e3700 1 -- 172.21.15.146:0/4012460858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c4c09e950 msgr2=0x7f7c4c09ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.773+0000 7f7c522e3700 1 --2- 172.21.15.146:0/4012460858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c4c09e950 0x7f7c4c09ed20 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009820 tx=0x7f7c3c009b30 comp rx=0 tx=0).stop 2023-10-03T10:19:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.773+0000 7f7c522e3700 1 -- 172.21.15.146:0/4012460858 shutdown_connections 2023-10-03T10:19:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.773+0000 7f7c522e3700 1 --2- 172.21.15.146:0/4012460858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c4c09e950 0x7f7c4c09ed20 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.773+0000 7f7c522e3700 1 --2- 172.21.15.146:0/4012460858 >> v2:172.21.15.146:3300/0 conn(0x7f7c4c09f260 0x7f7c4c131890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.773+0000 7f7c522e3700 1 -- 172.21.15.146:0/4012460858 >> 172.21.15.146:0/4012460858 conn(0x7f7c4c0a0f70 msgr2=0x7f7c4c0a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.773+0000 7f7c522e3700 1 -- 172.21.15.146:0/4012460858 shutdown_connections 2023-10-03T10:19:07.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.773+0000 7f7c522e3700 1 -- 172.21.15.146:0/4012460858 wait complete. 2023-10-03T10:19:07.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.775+0000 7f7c522e3700 1 Processor -- start 2023-10-03T10:19:07.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.775+0000 7f7c522e3700 1 -- start start 2023-10-03T10:19:07.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.776+0000 7f7c522e3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c4c09e950 0x7f7c4c11c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.776+0000 7f7c522e3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c4c09f260 0x7f7c4c11cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.776+0000 7f7c522e3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c4c131dd0 0x7f7c4c11d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.776+0000 7f7c522e3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c11e9d0 con 0x7f7c4c131dd0 2023-10-03T10:19:07.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.776+0000 7f7c522e3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c1202c0 con 0x7f7c4c09e950 2023-10-03T10:19:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.776+0000 7f7c522e3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c11e530 con 0x7f7c4c09f260 2023-10-03T10:19:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.776+0000 7f7c4bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c4c09e950 0x7f7c4c11c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.776+0000 7f7c4bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c4c09e950 0x7f7c4c11c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:37640/0 (socket says 172.21.15.146:37640) 2023-10-03T10:19:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.776+0000 7f7c4bfff700 1 -- 172.21.15.146:0/2822575879 learned_addr learned my addr 172.21.15.146:0/2822575879 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.776+0000 7f7c50880700 1 --2- 172.21.15.146:0/2822575879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c4c131dd0 0x7f7c4c11d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.776+0000 7f7c4bfff700 1 -- 172.21.15.146:0/2822575879 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c4c09f260 msgr2=0x7f7c4c11cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.776+0000 7f7c4bfff700 1 --2- 172.21.15.146:0/2822575879 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c4c09f260 0x7f7c4c11cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.776+0000 7f7c4bfff700 1 -- 172.21.15.146:0/2822575879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c4c131dd0 msgr2=0x7f7c4c11d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.776+0000 7f7c4bfff700 1 --2- 172.21.15.146:0/2822575879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c4c131dd0 0x7f7c4c11d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.776+0000 7f7c4bfff700 1 -- 172.21.15.146:0/2822575879 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c400094a0 con 0x7f7c4c09e950 2023-10-03T10:19:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.776+0000 7f7c4bfff700 1 --2- 172.21.15.146:0/2822575879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c4c09e950 0x7f7c4c11c840 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c000c00 tx=0x7f7c3c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.776+0000 7f7c48ff9700 1 -- 172.21.15.146:0/2822575879 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c006940 con 0x7f7c4c09e950 2023-10-03T10:19:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.776+0000 7f7c48ff9700 1 -- 172.21.15.146:0/2822575879 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3c020070 con 0x7f7c4c09e950 2023-10-03T10:19:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.776+0000 7f7c48ff9700 1 -- 172.21.15.146:0/2822575879 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c004280 con 0x7f7c4c09e950 2023-10-03T10:19:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.776+0000 7f7c522e3700 1 -- 172.21.15.146:0/2822575879 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3c009430 con 0x7f7c4c09e950 2023-10-03T10:19:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.776+0000 7f7c522e3700 1 -- 172.21.15.146:0/2822575879 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4c09ba00 con 0x7f7c4c09e950 2023-10-03T10:19:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.777+0000 7f7c522e3700 1 -- 172.21.15.146:0/2822575879 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c4c120100 con 0x7f7c4c09e950 2023-10-03T10:19:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.778+0000 7f7c48ff9700 1 -- 172.21.15.146:0/2822575879 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c3c022030 con 0x7f7c4c09e950 2023-10-03T10:19:07.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.778+0000 7f7c48ff9700 1 -- 172.21.15.146:0/2822575879 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7c3c042500 con 0x7f7c4c09e950 2023-10-03T10:19:07.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.782+0000 7f7c48ff9700 1 -- 172.21.15.146:0/2822575879 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c3c0245b0 con 0x7f7c4c09e950 2023-10-03T10:19:07.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.880+0000 7fcc0eaed700 1 -- 172.21.15.146:0/1465134190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcc080729d0 con 0x7fcc080a0a70 2023-10-03T10:19:07.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.880+0000 7fcc057fa700 1 -- 172.21.15.146:0/1465134190 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcbf4017030 con 0x7fcc080a0a70 2023-10-03T10:19:07.880 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:07.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.882+0000 7fcc0eaed700 1 -- 172.21.15.146:0/1465134190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc080a0a70 msgr2=0x7fcc081c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.882+0000 7fcc0eaed700 1 --2- 172.21.15.146:0/1465134190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc080a0a70 0x7fcc081c86d0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400e9b0 tx=0x7fcbf400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.883+0000 7fcc0eaed700 1 -- 172.21.15.146:0/1465134190 shutdown_connections 2023-10-03T10:19:07.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.883+0000 7fcc0eaed700 1 --2- 172.21.15.146:0/1465134190 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcc08133f70 0x7fcc081c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.883+0000 7fcc0eaed700 1 --2- 172.21.15.146:0/1465134190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc0809ad40 0x7fcc081c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.883+0000 7fcc0eaed700 1 --2- 172.21.15.146:0/1465134190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc080a0a70 0x7fcc081c86d0 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.883+0000 7fcc0eaed700 1 -- 172.21.15.146:0/1465134190 >> 172.21.15.146:0/1465134190 conn(0x7fcc08099c40 msgr2=0x7fcc081bbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:07.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.883+0000 7fcc0eaed700 1 -- 172.21.15.146:0/1465134190 shutdown_connections 2023-10-03T10:19:07.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.883+0000 7fcc0eaed700 1 -- 172.21.15.146:0/1465134190 wait complete. 2023-10-03T10:19:07.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:19:07.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.952+0000 7fe2a070d700 1 -- 172.21.15.146:0/1152743547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe29804f2a0 con 0x7fe29809e870 2023-10-03T10:19:07.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.952+0000 7fe28effd700 1 -- 172.21.15.146:0/1152743547 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe294011590 con 0x7fe29809e870 2023-10-03T10:19:07.952 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:19:07.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.954+0000 7fe2a070d700 1 -- 172.21.15.146:0/1152743547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe29809e870 msgr2=0x7fe298120850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.954+0000 7fe2a070d700 1 --2- 172.21.15.146:0/1152743547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe29809e870 0x7fe298120850 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fe294000f60 tx=0x7fe29400c730 comp rx=0 tx=0).stop 2023-10-03T10:19:07.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.954+0000 7fe2a070d700 1 -- 172.21.15.146:0/1152743547 shutdown_connections 2023-10-03T10:19:07.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.954+0000 7fe2a070d700 1 --2- 172.21.15.146:0/1152743547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe2981371c0 0x7fe2981212d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.954+0000 7fe2a070d700 1 --2- 172.21.15.146:0/1152743547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe29809e870 0x7fe298120850 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.954+0000 7fe2a070d700 1 --2- 172.21.15.146:0/1152743547 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fe29809f350 0x7fe298120d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.954+0000 7fe2a070d700 1 -- 172.21.15.146:0/1152743547 >> 172.21.15.146:0/1152743547 conn(0x7fe2980a4430 msgr2=0x7fe2980a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:07.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.954+0000 7fe2a070d700 1 -- 172.21.15.146:0/1152743547 shutdown_connections 2023-10-03T10:19:07.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.954+0000 7fe2a070d700 1 -- 172.21.15.146:0/1152743547 wait complete. 2023-10-03T10:19:07.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:19:07.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.994+0000 7f7c522e3700 1 -- 172.21.15.146:0/2822575879 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7c4c04f2a0 con 0x7f7c4c09e950 2023-10-03T10:19:07.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.994+0000 7f7c48ff9700 1 -- 172.21.15.146:0/2822575879 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c3c01c410 con 0x7f7c4c09e950 2023-10-03T10:19:07.994 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:19:07.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.996+0000 7f7c522e3700 1 -- 172.21.15.146:0/2822575879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c4c09e950 msgr2=0x7f7c4c11c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.996+0000 7f7c522e3700 1 --2- 172.21.15.146:0/2822575879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c4c09e950 0x7f7c4c11c840 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c000c00 tx=0x7f7c3c004750 comp rx=0 tx=0).stop 2023-10-03T10:19:07.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.996+0000 7f7c522e3700 1 -- 172.21.15.146:0/2822575879 shutdown_connections 2023-10-03T10:19:07.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.996+0000 7f7c522e3700 1 --2- 172.21.15.146:0/2822575879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c4c131dd0 0x7f7c4c11d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.996+0000 7f7c522e3700 1 --2- 172.21.15.146:0/2822575879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c4c09e950 0x7f7c4c11c840 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.996+0000 7f7c522e3700 1 --2- 172.21.15.146:0/2822575879 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7c4c09f260 0x7f7c4c11cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.996+0000 7f7c522e3700 1 -- 172.21.15.146:0/2822575879 >> 172.21.15.146:0/2822575879 conn(0x7f7c4c0a0f70 msgr2=0x7f7c4c06ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.996+0000 7f7c522e3700 1 -- 172.21.15.146:0/2822575879 shutdown_connections 2023-10-03T10:19:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:07.996+0000 7f7c522e3700 1 -- 172.21.15.146:0/2822575879 wait complete. 2023-10-03T10:19:08.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:19:08.496 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:08.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.620+0000 7f0193493700 1 Processor -- start 2023-10-03T10:19:08.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.620+0000 7f0193493700 1 -- start start 2023-10-03T10:19:08.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.620+0000 7f0193493700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f018c133ad0 0x7f018c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.620+0000 7f0193493700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f018c1300a0 0x7f018c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.620+0000 7f0193493700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f018c1309f0 0x7f018c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.620+0000 7f0193493700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f018c06b2d0 con 0x7f018c1300a0 2023-10-03T10:19:08.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.620+0000 7f0193493700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018c133610 con 0x7f018c133ad0 2023-10-03T10:19:08.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.620+0000 7f0193493700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f018c09a500 con 0x7f018c1309f0 2023-10-03T10:19:08.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.620+0000 7f0190a2e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f018c1300a0 0x7f018c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.620+0000 7f0191a30700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f018c1309f0 0x7f018c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.620+0000 7f019122f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f018c133ad0 0x7f018c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.620+0000 7f0191a30700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f018c1309f0 0x7f018c13a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34834/0 (socket says 172.21.15.146:34834) 2023-10-03T10:19:08.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.620+0000 7f019122f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f018c133ad0 0x7f018c133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:37652/0 (socket says 172.21.15.146:37652) 2023-10-03T10:19:08.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.620+0000 7f0190a2e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f018c1300a0 0x7f018c1304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51748/0 (socket says 172.21.15.146:51748) 2023-10-03T10:19:08.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.620+0000 7f0191a30700 1 -- 172.21.15.146:0/3471614924 learned_addr learned my addr 172.21.15.146:0/3471614924 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:08.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.621+0000 7f019122f700 1 -- 172.21.15.146:0/3471614924 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f018c1309f0 msgr2=0x7f018c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:08.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.621+0000 7f019122f700 1 --2- 172.21.15.146:0/3471614924 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f018c1309f0 0x7f018c13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.621+0000 7f019122f700 1 -- 172.21.15.146:0/3471614924 >> v2:172.21.15.146:3300/0 conn(0x7f018c1300a0 msgr2=0x7f018c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:08.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.621+0000 7f019122f700 1 --2- 172.21.15.146:0/3471614924 >> v2:172.21.15.146:3300/0 conn(0x7f018c1300a0 0x7f018c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.621+0000 7f019122f700 1 -- 172.21.15.146:0/3471614924 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018c1338b0 con 0x7f018c133ad0 2023-10-03T10:19:08.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.621+0000 7f0191a30700 1 --2- 172.21.15.146:0/3471614924 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f018c1309f0 0x7f018c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:08.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.621+0000 7f0190a2e700 1 --2- 172.21.15.146:0/3471614924 >> v2:172.21.15.146:3300/0 conn(0x7f018c1300a0 0x7f018c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:08.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.621+0000 7f019122f700 1 --2- 172.21.15.146:0/3471614924 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f018c133ad0 0x7f018c133ea0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f017c009840 tx=0x7f017c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e06b5085c9470e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.621+0000 7f0183fff700 1 -- 172.21.15.146:0/3471614924 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c011830 con 0x7f018c133ad0 2023-10-03T10:19:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.621+0000 7f0183fff700 1 -- 172.21.15.146:0/3471614924 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017c011990 con 0x7f018c133ad0 2023-10-03T10:19:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.621+0000 7f0183fff700 1 -- 172.21.15.146:0/3471614924 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c011d20 con 0x7f018c133ad0 2023-10-03T10:19:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.621+0000 7f0193493700 1 -- 172.21.15.146:0/3471614924 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f018c133ad0 msgr2=0x7f018c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.621+0000 7f0193493700 1 --2- 172.21.15.146:0/3471614924 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f018c133ad0 0x7f018c133ea0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f017c009840 tx=0x7f017c009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.622+0000 7f0193493700 1 -- 172.21.15.146:0/3471614924 shutdown_connections 2023-10-03T10:19:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.622+0000 7f0193493700 1 --2- 172.21.15.146:0/3471614924 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f018c133ad0 0x7f018c133ea0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.622+0000 7f0193493700 1 --2- 172.21.15.146:0/3471614924 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f018c1309f0 0x7f018c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.622+0000 7f0193493700 1 --2- 172.21.15.146:0/3471614924 >> v2:172.21.15.146:3300/0 conn(0x7f018c1300a0 0x7f018c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.622+0000 7f0193493700 1 -- 172.21.15.146:0/3471614924 >> 172.21.15.146:0/3471614924 conn(0x7f018c099c40 msgr2=0x7f018c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.622+0000 7f0193493700 1 -- 172.21.15.146:0/3471614924 shutdown_connections 2023-10-03T10:19:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.622+0000 7f0193493700 1 -- 172.21.15.146:0/3471614924 wait complete. 2023-10-03T10:19:08.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.623+0000 7f0193493700 1 Processor -- start 2023-10-03T10:19:08.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.623+0000 7f0193493700 1 -- start start 2023-10-03T10:19:08.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.623+0000 7f0193493700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f018c1300a0 0x7f018c1c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.623+0000 7f0193493700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f018c1309f0 0x7f018c1c1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.623+0000 7f0193493700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f018c133ad0 0x7f018c1c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.623+0000 7f0193493700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018c1c16a0 con 0x7f018c1300a0 2023-10-03T10:19:08.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.623+0000 7f0193493700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018c12dd70 con 0x7f018c133ad0 2023-10-03T10:19:08.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.623+0000 7f0193493700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f018c11b4f0 con 0x7f018c1309f0 2023-10-03T10:19:08.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.623+0000 7f0190a2e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f018c1309f0 0x7f018c1c1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.623+0000 7f0190a2e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f018c1309f0 0x7f018c1c1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34850/0 (socket says 172.21.15.146:34850) 2023-10-03T10:19:08.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.623+0000 7f0190a2e700 1 -- 172.21.15.146:0/1829711813 learned_addr learned my addr 172.21.15.146:0/1829711813 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:08.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.623+0000 7f019122f700 1 --2- 172.21.15.146:0/1829711813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f018c1300a0 0x7f018c1c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.623+0000 7f0191a30700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f018c133ad0 0x7f018c1c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.623+0000 7f0190a2e700 1 -- 172.21.15.146:0/1829711813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f018c133ad0 msgr2=0x7f018c1c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.623+0000 7f0190a2e700 1 --2- 172.21.15.146:0/1829711813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f018c133ad0 0x7f018c1c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.623+0000 7f0190a2e700 1 -- 172.21.15.146:0/1829711813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f018c1300a0 msgr2=0x7f018c1c0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.623+0000 7f0190a2e700 1 --2- 172.21.15.146:0/1829711813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f018c1300a0 0x7f018c1c0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.623+0000 7f0190a2e700 1 -- 172.21.15.146:0/1829711813 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0188011d40 con 0x7f018c1309f0 2023-10-03T10:19:08.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.623+0000 7f019122f700 1 --2- 172.21.15.146:0/1829711813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f018c1300a0 0x7f018c1c0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:08.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.624+0000 7f0190a2e700 1 --2- 172.21.15.146:0/1829711813 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f018c1309f0 0x7f018c1c1160 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f0188006b20 tx=0x7f01880166a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.624+0000 7f0181ffb700 1 -- 172.21.15.146:0/1829711813 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188014170 con 0x7f018c1309f0 2023-10-03T10:19:08.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.624+0000 7f0181ffb700 1 -- 172.21.15.146:0/1829711813 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0188017040 con 0x7f018c1309f0 2023-10-03T10:19:08.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.624+0000 7f0181ffb700 1 -- 172.21.15.146:0/1829711813 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01880112f0 con 0x7f018c1309f0 2023-10-03T10:19:08.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.624+0000 7f0193493700 1 -- 172.21.15.146:0/1829711813 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0184009b30 con 0x7f018c1309f0 2023-10-03T10:19:08.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.624+0000 7f0193493700 1 -- 172.21.15.146:0/1829711813 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017c0094a0 con 0x7f018c1309f0 2023-10-03T10:19:08.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.625+0000 7f0181ffb700 1 -- 172.21.15.146:0/1829711813 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0188011450 con 0x7f018c1309f0 2023-10-03T10:19:08.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.625+0000 7f0181ffb700 1 -- 172.21.15.146:0/1829711813 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f0188047a80 con 0x7f018c1309f0 2023-10-03T10:19:08.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.625+0000 7f0193493700 1 -- 172.21.15.146:0/1829711813 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f018c04f2a0 con 0x7f018c1309f0 2023-10-03T10:19:08.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.630+0000 7f0181ffb700 1 -- 172.21.15.146:0/1829711813 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f018801c480 con 0x7f018c1309f0 2023-10-03T10:19:08.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.814+0000 7f0193493700 1 -- 172.21.15.146:0/1829711813 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f018c11b630 con 0x7f018c1309f0 2023-10-03T10:19:08.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.814+0000 7f0181ffb700 1 -- 172.21.15.146:0/1829711813 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f018801a340 con 0x7f018c1309f0 2023-10-03T10:19:08.814 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:08.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.816+0000 7f0193493700 1 -- 172.21.15.146:0/1829711813 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f018c1309f0 msgr2=0x7f018c1c1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.816+0000 7f0193493700 1 --2- 172.21.15.146:0/1829711813 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f018c1309f0 0x7f018c1c1160 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f0188006b20 tx=0x7f01880166a0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.816+0000 7f0193493700 1 -- 172.21.15.146:0/1829711813 shutdown_connections 2023-10-03T10:19:08.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.816+0000 7f0193493700 1 --2- 172.21.15.146:0/1829711813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f018c133ad0 0x7f018c1c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.816+0000 7f0193493700 1 --2- 172.21.15.146:0/1829711813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f018c1300a0 0x7f018c1c0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.816+0000 7f0193493700 1 --2- 172.21.15.146:0/1829711813 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f018c1309f0 0x7f018c1c1160 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.816+0000 7f0193493700 1 -- 172.21.15.146:0/1829711813 >> 172.21.15.146:0/1829711813 conn(0x7f018c099c40 msgr2=0x7f018c12eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.816+0000 7f0193493700 1 -- 172.21.15.146:0/1829711813 shutdown_connections 2023-10-03T10:19:08.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:08.816+0000 7f0193493700 1 -- 172.21.15.146:0/1829711813 wait complete. 2023-10-03T10:19:08.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:19:08.895 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:08.967 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:09.008 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:09.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.035+0000 7f690621d700 1 Processor -- start 2023-10-03T10:19:09.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.035+0000 7f690621d700 1 -- start start 2023-10-03T10:19:09.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.036+0000 7f690621d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f690006b250 0x7f6900136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.036+0000 7f690621d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6900137140 0x7f6900139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.036+0000 7f690621d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f690009da80 con 0x7f690006a770 2023-10-03T10:19:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.036+0000 7f690621d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690009dce0 con 0x7f6900137140 2023-10-03T10:19:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.036+0000 7f690621d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f690006b620 con 0x7f690006b250 2023-10-03T10:19:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.036+0000 7f68feffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f690006b250 0x7f6900136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.036+0000 7f68feffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f690006b250 0x7f6900136c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34852/0 (socket says 172.21.15.146:34852) 2023-10-03T10:19:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.036+0000 7f68feffd700 1 -- 172.21.15.146:0/1221919359 learned_addr learned my addr 172.21.15.146:0/1221919359 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.036+0000 7f68fffff700 1 --2- 172.21.15.146:0/1221919359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6900137140 0x7f6900139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.036+0000 7f68feffd700 1 -- 172.21.15.146:0/1221919359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6900137140 msgr2=0x7f6900139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.036+0000 7f68feffd700 1 --2- 172.21.15.146:0/1221919359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6900137140 0x7f6900139520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.036+0000 7f68feffd700 1 -- 172.21.15.146:0/1221919359 >> v1:172.21.15.146:6789/0 conn(0x7f690006a770 legacy=0x7f690006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.036+0000 7f68feffd700 1 -- 172.21.15.146:0/1221919359 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690009eb20 con 0x7f690006b250 2023-10-03T10:19:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.036+0000 7f68feffd700 1 --2- 172.21.15.146:0/1221919359 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f690006b250 0x7f6900136c00 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009920 tx=0x7f68f4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dd9bd31ccc20932 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.037+0000 7f68fe7fc700 1 -- 172.21.15.146:0/1221919359 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4004230 con 0x7f690006b250 2023-10-03T10:19:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.037+0000 7f68fe7fc700 1 -- 172.21.15.146:0/1221919359 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f4004390 con 0x7f690006b250 2023-10-03T10:19:09.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.037+0000 7f68fe7fc700 1 -- 172.21.15.146:0/1221919359 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f40036a0 con 0x7f690006b250 2023-10-03T10:19:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.037+0000 7f690621d700 1 -- 172.21.15.146:0/1221919359 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f690006b250 msgr2=0x7f6900136c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.037+0000 7f690621d700 1 --2- 172.21.15.146:0/1221919359 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f690006b250 0x7f6900136c00 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009920 tx=0x7f68f4009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.037+0000 7f690621d700 1 -- 172.21.15.146:0/1221919359 shutdown_connections 2023-10-03T10:19:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.037+0000 7f690621d700 1 --2- 172.21.15.146:0/1221919359 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6900137140 0x7f6900139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.037+0000 7f690621d700 1 --2- 172.21.15.146:0/1221919359 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f690006b250 0x7f6900136c00 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.037+0000 7f690621d700 1 -- 172.21.15.146:0/1221919359 >> 172.21.15.146:0/1221919359 conn(0x7f6900099c40 msgr2=0x7f69000a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.037+0000 7f690621d700 1 -- 172.21.15.146:0/1221919359 shutdown_connections 2023-10-03T10:19:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.038+0000 7f690621d700 1 -- 172.21.15.146:0/1221919359 wait complete. 2023-10-03T10:19:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.038+0000 7f690621d700 1 Processor -- start 2023-10-03T10:19:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.039+0000 7f690621d700 1 -- start start 2023-10-03T10:19:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.039+0000 7f690621d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f690006a770 0x7f6900135740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.039+0000 7f690621d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f690006b250 0x7f6900135c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.039+0000 7f690621d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6900137140 0x7f690009a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.039+0000 7f690621d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6900126240 con 0x7f690006b250 2023-10-03T10:19:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.039+0000 7f690621d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6900136a00 con 0x7f6900137140 2023-10-03T10:19:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.039+0000 7f690621d700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6900136450 con 0x7f690006a770 2023-10-03T10:19:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.039+0000 7f68ff7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f690006a770 0x7f6900135740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.039+0000 7f68ff7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f690006a770 0x7f6900135740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34862/0 (socket says 172.21.15.146:34862) 2023-10-03T10:19:09.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.039+0000 7f68ff7fe700 1 -- 172.21.15.146:0/3001087469 learned_addr learned my addr 172.21.15.146:0/3001087469 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:09.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.039+0000 7f68fffff700 1 --2- 172.21.15.146:0/3001087469 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6900137140 0x7f690009a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.039+0000 7f68feffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f690006b250 0x7f6900135c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.040+0000 7f68ff7fe700 1 -- 172.21.15.146:0/3001087469 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6900137140 msgr2=0x7f690009a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.040+0000 7f68ff7fe700 1 --2- 172.21.15.146:0/3001087469 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6900137140 0x7f690009a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.040+0000 7f68ff7fe700 1 -- 172.21.15.146:0/3001087469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f690006b250 msgr2=0x7f6900135c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.040+0000 7f68ff7fe700 1 --2- 172.21.15.146:0/3001087469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f690006b250 0x7f6900135c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.040+0000 7f68ff7fe700 1 -- 172.21.15.146:0/3001087469 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f4009550 con 0x7f690006a770 2023-10-03T10:19:09.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.040+0000 7f68fffff700 1 --2- 172.21.15.146:0/3001087469 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6900137140 0x7f690009a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.040+0000 7f68feffd700 1 --2- 172.21.15.146:0/3001087469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f690006b250 0x7f6900135c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.040+0000 7f68ff7fe700 1 --2- 172.21.15.146:0/3001087469 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f690006a770 0x7f6900135740 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f68f000c4a0 tx=0x7f68f000c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.040+0000 7f68e7fff700 1 -- 172.21.15.146:0/3001087469 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f00054e0 con 0x7f690006a770 2023-10-03T10:19:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.040+0000 7f68e7fff700 1 -- 172.21.15.146:0/3001087469 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f0003680 con 0x7f690006a770 2023-10-03T10:19:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.040+0000 7f690621d700 1 -- 172.21.15.146:0/3001087469 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6900071e10 con 0x7f690006a770 2023-10-03T10:19:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.040+0000 7f68e7fff700 1 -- 172.21.15.146:0/3001087469 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0003a30 con 0x7f690006a770 2023-10-03T10:19:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.040+0000 7f690621d700 1 -- 172.21.15.146:0/3001087469 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6900124cb0 con 0x7f690006a770 2023-10-03T10:19:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.041+0000 7f68e7fff700 1 -- 172.21.15.146:0/3001087469 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68f0003b90 con 0x7f690006a770 2023-10-03T10:19:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.041+0000 7f690621d700 1 -- 172.21.15.146:0/3001087469 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690004f2a0 con 0x7f690006a770 2023-10-03T10:19:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.041+0000 7f68e7fff700 1 -- 172.21.15.146:0/3001087469 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f68f003ebe0 con 0x7f690006a770 2023-10-03T10:19:09.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.046+0000 7f68e7fff700 1 -- 172.21.15.146:0/3001087469 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68f0003e40 con 0x7f690006a770 2023-10-03T10:19:09.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.118+0000 7f42a74dc700 1 Processor -- start 2023-10-03T10:19:09.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.119+0000 7f42a74dc700 1 -- start start 2023-10-03T10:19:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.119+0000 7f42a74dc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42a0066410 0x7f42a01319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.119+0000 7f42a74dc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f42a0131f30 0x7f42a009c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.119+0000 7f42a74dc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a00a0f20 con 0x7f42a01314b0 2023-10-03T10:19:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.119+0000 7f42a74dc700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a00667e0 con 0x7f42a0131f30 2023-10-03T10:19:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.119+0000 7f42a74dc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42a00a23c0 con 0x7f42a0066410 2023-10-03T10:19:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.120+0000 7f42a5278700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42a0066410 0x7f42a01319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.120+0000 7f42a5a79700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f42a0131f30 0x7f42a009c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.120+0000 7f42a4a77700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f42a01314b0 0x7f42a009bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36668/0 (socket says 172.21.15.146:36668) 2023-10-03T10:19:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.120+0000 7f42a4a77700 1 -- 172.21.15.146:0/2447368164 learned_addr learned my addr 172.21.15.146:0/2447368164 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.120+0000 7f42a5278700 1 -- 172.21.15.146:0/2447368164 >> v2:172.21.15.146:3300/0 conn(0x7f42a0131f30 msgr2=0x7f42a009c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.120+0000 7f42a5278700 1 --2- 172.21.15.146:0/2447368164 >> v2:172.21.15.146:3300/0 conn(0x7f42a0131f30 0x7f42a009c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.120+0000 7f42a5278700 1 -- 172.21.15.146:0/2447368164 >> v1:172.21.15.146:6789/0 conn(0x7f42a01314b0 legacy=0x7f42a009bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.120+0000 7f4297fff700 1 -- 172.21.15.146:0/2447368164 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763724938 0 0) 0x7f42a00a0f20 con 0x7f42a01314b0 2023-10-03T10:19:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.120+0000 7f42a5278700 1 -- 172.21.15.146:0/2447368164 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a00a16e0 con 0x7f42a0066410 2023-10-03T10:19:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.120+0000 7f42a5a79700 1 --2- 172.21.15.146:0/2447368164 >> v2:172.21.15.146:3300/0 conn(0x7f42a0131f30 0x7f42a009c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.120+0000 7f42a5278700 1 --2- 172.21.15.146:0/2447368164 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42a0066410 0x7f42a01319f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f429c009850 tx=0x7f429c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b01e1225cbfd72d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.120+0000 7f4297fff700 1 -- 172.21.15.146:0/2447368164 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c005e30 con 0x7f42a0066410 2023-10-03T10:19:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.120+0000 7f4297fff700 1 -- 172.21.15.146:0/2447368164 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429c006030 con 0x7f42a0066410 2023-10-03T10:19:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.120+0000 7f4297fff700 1 -- 172.21.15.146:0/2447368164 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c0063c0 con 0x7f42a0066410 2023-10-03T10:19:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.121+0000 7f42a74dc700 1 -- 172.21.15.146:0/2447368164 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42a0066410 msgr2=0x7f42a01319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.121+0000 7f42a74dc700 1 --2- 172.21.15.146:0/2447368164 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42a0066410 0x7f42a01319f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f429c009850 tx=0x7f429c009b60 comp rx=0 tx=0).stop 2023-10-03T10:19:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.121+0000 7f42a74dc700 1 -- 172.21.15.146:0/2447368164 shutdown_connections 2023-10-03T10:19:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.121+0000 7f42a74dc700 1 --2- 172.21.15.146:0/2447368164 >> v2:172.21.15.146:3300/0 conn(0x7f42a0131f30 0x7f42a009c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.121+0000 7f42a74dc700 1 --2- 172.21.15.146:0/2447368164 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42a0066410 0x7f42a01319f0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.121+0000 7f42a74dc700 1 -- 172.21.15.146:0/2447368164 >> 172.21.15.146:0/2447368164 conn(0x7f42a00a2980 msgr2=0x7f42a00a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.121+0000 7f42a74dc700 1 -- 172.21.15.146:0/2447368164 shutdown_connections 2023-10-03T10:19:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.121+0000 7f42a74dc700 1 -- 172.21.15.146:0/2447368164 wait complete. 2023-10-03T10:19:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.122+0000 7f42a74dc700 1 Processor -- start 2023-10-03T10:19:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.122+0000 7f42a74dc700 1 -- start start 2023-10-03T10:19:09.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.123+0000 7f42a74dc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a0066410 0x7f42a0118df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.123+0000 7f42a74dc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42a01314b0 0x7f42a0119330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.123+0000 7f42a74dc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42a0131f30 0x7f42a0119870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.123+0000 7f42a74dc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a011a800 con 0x7f42a0066410 2023-10-03T10:19:09.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.123+0000 7f42a74dc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a011bda0 con 0x7f42a0131f30 2023-10-03T10:19:09.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.123+0000 7f42a74dc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42a011abc0 con 0x7f42a01314b0 2023-10-03T10:19:09.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.123+0000 7f42a4a77700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42a01314b0 0x7f42a0119330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.123+0000 7f42a4a77700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42a01314b0 0x7f42a0119330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34874/0 (socket says 172.21.15.146:34874) 2023-10-03T10:19:09.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.123+0000 7f42a4a77700 1 -- 172.21.15.146:0/3611249798 learned_addr learned my addr 172.21.15.146:0/3611249798 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:09.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.123+0000 7f42a5278700 1 --2- 172.21.15.146:0/3611249798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a0066410 0x7f42a0118df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.123+0000 7f42a5a79700 1 --2- 172.21.15.146:0/3611249798 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42a0131f30 0x7f42a0119870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.123+0000 7f42a5278700 1 -- 172.21.15.146:0/3611249798 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42a01314b0 msgr2=0x7f42a0119330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.123+0000 7f42a5278700 1 --2- 172.21.15.146:0/3611249798 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42a01314b0 0x7f42a0119330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.123+0000 7f42a5278700 1 -- 172.21.15.146:0/3611249798 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42a0131f30 msgr2=0x7f42a0119870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.123+0000 7f42a5278700 1 --2- 172.21.15.146:0/3611249798 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42a0131f30 0x7f42a0119870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.123+0000 7f42a5278700 1 -- 172.21.15.146:0/3611249798 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4298009a70 con 0x7f42a0066410 2023-10-03T10:19:09.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.123+0000 7f42a5278700 1 --2- 172.21.15.146:0/3611249798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a0066410 0x7f42a0118df0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f429c015000 tx=0x7f429c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.124+0000 7f4295ffb700 1 -- 172.21.15.146:0/3611249798 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c0068f0 con 0x7f42a0066410 2023-10-03T10:19:09.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.124+0000 7f4295ffb700 1 -- 172.21.15.146:0/3611249798 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429c020070 con 0x7f42a0066410 2023-10-03T10:19:09.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.124+0000 7f42a74dc700 1 -- 172.21.15.146:0/3611249798 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429c009430 con 0x7f42a0066410 2023-10-03T10:19:09.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.124+0000 7f4295ffb700 1 -- 172.21.15.146:0/3611249798 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c025670 con 0x7f42a0066410 2023-10-03T10:19:09.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.124+0000 7f42a74dc700 1 -- 172.21.15.146:0/3611249798 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a011b430 con 0x7f42a0066410 2023-10-03T10:19:09.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.125+0000 7f4295ffb700 1 -- 172.21.15.146:0/3611249798 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f429c022030 con 0x7f42a0066410 2023-10-03T10:19:09.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.125+0000 7f4295ffb700 1 -- 172.21.15.146:0/3611249798 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f429c040b30 con 0x7f42a0066410 2023-10-03T10:19:09.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.125+0000 7f42a74dc700 1 -- 172.21.15.146:0/3611249798 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a011afb0 con 0x7f42a0066410 2023-10-03T10:19:09.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.130+0000 7f4295ffb700 1 -- 172.21.15.146:0/3611249798 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f42a011afb0 con 0x7f42a0066410 2023-10-03T10:19:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.138+0000 7f62902ae700 1 Processor -- start 2023-10-03T10:19:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.138+0000 7f62902ae700 1 -- start start 2023-10-03T10:19:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.139+0000 7f62902ae700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6288133ad0 0x7f6288133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.139+0000 7f62902ae700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62881300a0 0x7f62881304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.139+0000 7f62902ae700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f628806b2d0 con 0x7f62881309f0 2023-10-03T10:19:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.139+0000 7f62902ae700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6288133610 con 0x7f6288133ad0 2023-10-03T10:19:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.139+0000 7f62902ae700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f628809a500 con 0x7f62881300a0 2023-10-03T10:19:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.139+0000 7f628d849700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62881300a0 0x7f62881304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.139+0000 7f628e04a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6288133ad0 0x7f6288133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.139+0000 7f628d849700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62881300a0 0x7f62881304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34884/0 (socket says 172.21.15.146:34884) 2023-10-03T10:19:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.139+0000 7f628d849700 1 -- 172.21.15.146:0/672730798 learned_addr learned my addr 172.21.15.146:0/672730798 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.139+0000 7f628d849700 1 -- 172.21.15.146:0/672730798 >> v2:172.21.15.146:3300/0 conn(0x7f6288133ad0 msgr2=0x7f6288133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.139+0000 7f628d849700 1 --2- 172.21.15.146:0/672730798 >> v2:172.21.15.146:3300/0 conn(0x7f6288133ad0 0x7f6288133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.139+0000 7f628d849700 1 -- 172.21.15.146:0/672730798 >> v1:172.21.15.146:6789/0 conn(0x7f62881309f0 legacy=0x7f628813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.139+0000 7f628d849700 1 -- 172.21.15.146:0/672730798 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62881338b0 con 0x7f62881300a0 2023-10-03T10:19:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.139+0000 7f628e04a700 1 --2- 172.21.15.146:0/672730798 >> v2:172.21.15.146:3300/0 conn(0x7f6288133ad0 0x7f6288133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.140+0000 7f628d849700 1 --2- 172.21.15.146:0/672730798 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62881300a0 0x7f62881304b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f62780098f0 tx=0x7f6278009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57ff53b397a46d3f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.140+0000 7f628d048700 1 -- 172.21.15.146:0/672730798 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278011830 con 0x7f62881300a0 2023-10-03T10:19:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.140+0000 7f628d048700 1 -- 172.21.15.146:0/672730798 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6278011990 con 0x7f62881300a0 2023-10-03T10:19:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.140+0000 7f628d048700 1 -- 172.21.15.146:0/672730798 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278011d20 con 0x7f62881300a0 2023-10-03T10:19:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.140+0000 7f62902ae700 1 -- 172.21.15.146:0/672730798 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62881300a0 msgr2=0x7f62881304b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.140+0000 7f62902ae700 1 --2- 172.21.15.146:0/672730798 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62881300a0 0x7f62881304b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f62780098f0 tx=0x7f6278009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.140+0000 7f62902ae700 1 -- 172.21.15.146:0/672730798 shutdown_connections 2023-10-03T10:19:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.140+0000 7f62902ae700 1 --2- 172.21.15.146:0/672730798 >> v2:172.21.15.146:3300/0 conn(0x7f6288133ad0 0x7f6288133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.140+0000 7f62902ae700 1 --2- 172.21.15.146:0/672730798 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62881300a0 0x7f62881304b0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.140+0000 7f62902ae700 1 -- 172.21.15.146:0/672730798 >> 172.21.15.146:0/672730798 conn(0x7f6288099c40 msgr2=0x7f62880a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.140+0000 7f62902ae700 1 -- 172.21.15.146:0/672730798 shutdown_connections 2023-10-03T10:19:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.140+0000 7f62902ae700 1 -- 172.21.15.146:0/672730798 wait complete. 2023-10-03T10:19:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.141+0000 7f62902ae700 1 Processor -- start 2023-10-03T10:19:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.141+0000 7f62902ae700 1 -- start start 2023-10-03T10:19:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.142+0000 7f62902ae700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62881300a0 0x7f628811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.142+0000 7f62902ae700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62881309f0 0x7f628811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.142+0000 7f62902ae700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6288133ad0 0x7f628811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.142+0000 7f62902ae700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6288072210 con 0x7f62881300a0 2023-10-03T10:19:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.142+0000 7f62902ae700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f628811fc10 con 0x7f6288133ad0 2023-10-03T10:19:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.142+0000 7f62902ae700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f628812d220 con 0x7f62881309f0 2023-10-03T10:19:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.142+0000 7f628e04a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62881300a0 0x7f628811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.142+0000 7f628d849700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62881309f0 0x7f628811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.142+0000 7f628d849700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62881309f0 0x7f628811df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34892/0 (socket says 172.21.15.146:34892) 2023-10-03T10:19:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.142+0000 7f628d849700 1 -- 172.21.15.146:0/1706900122 learned_addr learned my addr 172.21.15.146:0/1706900122 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.142+0000 7f628e04a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62881300a0 0x7f628811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51788/0 (socket says 172.21.15.146:51788) 2023-10-03T10:19:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.142+0000 7f628e84b700 1 --2- 172.21.15.146:0/1706900122 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6288133ad0 0x7f628811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.142+0000 7f628e04a700 1 -- 172.21.15.146:0/1706900122 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62881309f0 msgr2=0x7f628811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.142+0000 7f628e04a700 1 --2- 172.21.15.146:0/1706900122 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62881309f0 0x7f628811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.142+0000 7f628e04a700 1 -- 172.21.15.146:0/1706900122 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6288133ad0 msgr2=0x7f628811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.142+0000 7f628e04a700 1 --2- 172.21.15.146:0/1706900122 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6288133ad0 0x7f628811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.142+0000 7f628e04a700 1 -- 172.21.15.146:0/1706900122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62840094a0 con 0x7f62881300a0 2023-10-03T10:19:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.142+0000 7f628e04a700 1 --2- 172.21.15.146:0/1706900122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62881300a0 0x7f628811da40 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f628400e9b0 tx=0x7f628400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.143+0000 7f627effd700 1 -- 172.21.15.146:0/1706900122 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628400ee50 con 0x7f62881300a0 2023-10-03T10:19:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.143+0000 7f627effd700 1 -- 172.21.15.146:0/1706900122 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628400c850 con 0x7f62881300a0 2023-10-03T10:19:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.143+0000 7f62902ae700 1 -- 172.21.15.146:0/1706900122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6278009550 con 0x7f62881300a0 2023-10-03T10:19:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.143+0000 7f627effd700 1 -- 172.21.15.146:0/1706900122 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628400cc00 con 0x7f62881300a0 2023-10-03T10:19:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.143+0000 7f62902ae700 1 -- 172.21.15.146:0/1706900122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628812fd40 con 0x7f62881300a0 2023-10-03T10:19:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.143+0000 7f627effd700 1 -- 172.21.15.146:0/1706900122 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6284013470 con 0x7f62881300a0 2023-10-03T10:19:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.144+0000 7f627effd700 1 -- 172.21.15.146:0/1706900122 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f628403f6d0 con 0x7f62881300a0 2023-10-03T10:19:09.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.144+0000 7f62902ae700 1 -- 172.21.15.146:0/1706900122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628812dd00 con 0x7f62881300a0 2023-10-03T10:19:09.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.148+0000 7f627effd700 1 -- 172.21.15.146:0/1706900122 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6284021070 con 0x7f62881300a0 2023-10-03T10:19:09.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.262+0000 7f690621d700 1 -- 172.21.15.146:0/3001087469 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f690006c3b0 con 0x7f690006a770 2023-10-03T10:19:09.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.262+0000 7f68e7fff700 1 -- 172.21.15.146:0/3001087469 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f68f0017070 con 0x7f690006a770 2023-10-03T10:19:09.262 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:09.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.264+0000 7f690621d700 1 -- 172.21.15.146:0/3001087469 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f690006a770 msgr2=0x7f6900135740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.264+0000 7f690621d700 1 --2- 172.21.15.146:0/3001087469 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f690006a770 0x7f6900135740 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f68f000c4a0 tx=0x7f68f000c7b0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.264+0000 7f690621d700 1 -- 172.21.15.146:0/3001087469 shutdown_connections 2023-10-03T10:19:09.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.264+0000 7f690621d700 1 --2- 172.21.15.146:0/3001087469 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6900137140 0x7f690009a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.264+0000 7f690621d700 1 --2- 172.21.15.146:0/3001087469 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f690006a770 0x7f6900135740 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.264+0000 7f690621d700 1 --2- 172.21.15.146:0/3001087469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f690006b250 0x7f6900135c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.264+0000 7f690621d700 1 -- 172.21.15.146:0/3001087469 >> 172.21.15.146:0/3001087469 conn(0x7f6900099c40 msgr2=0x7f690006ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.264+0000 7f690621d700 1 -- 172.21.15.146:0/3001087469 shutdown_connections 2023-10-03T10:19:09.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.264+0000 7f690621d700 1 -- 172.21.15.146:0/3001087469 wait complete. 2023-10-03T10:19:09.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:19:09.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.324+0000 7f42a74dc700 1 -- 172.21.15.146:0/3611249798 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f42a011afb0 con 0x7f42a0066410 2023-10-03T10:19:09.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.324+0000 7f4295ffb700 1 -- 172.21.15.146:0/3611249798 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f42a011afb0 con 0x7f42a0066410 2023-10-03T10:19:09.324 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:19:09.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.326+0000 7f42a74dc700 1 -- 172.21.15.146:0/3611249798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a0066410 msgr2=0x7f42a0118df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.326+0000 7f42a74dc700 1 --2- 172.21.15.146:0/3611249798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a0066410 0x7f42a0118df0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f429c015000 tx=0x7f429c004750 comp rx=0 tx=0).stop 2023-10-03T10:19:09.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.326+0000 7f42a74dc700 1 -- 172.21.15.146:0/3611249798 shutdown_connections 2023-10-03T10:19:09.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.326+0000 7f42a74dc700 1 --2- 172.21.15.146:0/3611249798 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42a0131f30 0x7f42a0119870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.326+0000 7f42a74dc700 1 --2- 172.21.15.146:0/3611249798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a0066410 0x7f42a0118df0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.326+0000 7f42a74dc700 1 --2- 172.21.15.146:0/3611249798 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f42a01314b0 0x7f42a0119330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.326+0000 7f42a74dc700 1 -- 172.21.15.146:0/3611249798 >> 172.21.15.146:0/3611249798 conn(0x7f42a00a2980 msgr2=0x7f42a012f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.327+0000 7f42a74dc700 1 -- 172.21.15.146:0/3611249798 shutdown_connections 2023-10-03T10:19:09.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.327+0000 7f42a74dc700 1 -- 172.21.15.146:0/3611249798 wait complete. 2023-10-03T10:19:09.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:19:09.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.343+0000 7f62902ae700 1 -- 172.21.15.146:0/1706900122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f628804f2a0 con 0x7f62881300a0 2023-10-03T10:19:09.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.343+0000 7f627effd700 1 -- 172.21.15.146:0/1706900122 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6284013720 con 0x7f62881300a0 2023-10-03T10:19:09.343 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:19:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.345+0000 7f62902ae700 1 -- 172.21.15.146:0/1706900122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62881300a0 msgr2=0x7f628811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.345+0000 7f62902ae700 1 --2- 172.21.15.146:0/1706900122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62881300a0 0x7f628811da40 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f628400e9b0 tx=0x7f628400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.345+0000 7f62902ae700 1 -- 172.21.15.146:0/1706900122 shutdown_connections 2023-10-03T10:19:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.345+0000 7f62902ae700 1 --2- 172.21.15.146:0/1706900122 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6288133ad0 0x7f628811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.345+0000 7f62902ae700 1 --2- 172.21.15.146:0/1706900122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62881300a0 0x7f628811da40 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.345+0000 7f62902ae700 1 --2- 172.21.15.146:0/1706900122 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f62881309f0 0x7f628811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.345+0000 7f62902ae700 1 -- 172.21.15.146:0/1706900122 >> 172.21.15.146:0/1706900122 conn(0x7f6288099c40 msgr2=0x7f6288131840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.345+0000 7f62902ae700 1 -- 172.21.15.146:0/1706900122 shutdown_connections 2023-10-03T10:19:09.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.345+0000 7f62902ae700 1 -- 172.21.15.146:0/1706900122 wait complete. 2023-10-03T10:19:09.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:19:09.829 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:09.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.956+0000 7feede5b8700 1 Processor -- start 2023-10-03T10:19:09.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.957+0000 7feede5b8700 1 -- start start 2023-10-03T10:19:09.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.957+0000 7feede5b8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feed8133ad0 0x7feed8133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.957+0000 7feede5b8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feed8130bc0 0x7feed813b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.957+0000 7feede5b8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed806b2d0 con 0x7feed81300a0 2023-10-03T10:19:09.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.957+0000 7feede5b8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed8133610 con 0x7feed8130bc0 2023-10-03T10:19:09.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.957+0000 7feede5b8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feed809a500 con 0x7feed8133ad0 2023-10-03T10:19:09.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.957+0000 7feed7fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feed8133ad0 0x7feed8133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.957+0000 7feed77fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7feed81300a0 0x7feed81304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36684/0 (socket says 172.21.15.146:36684) 2023-10-03T10:19:09.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.957+0000 7feed77fe700 1 -- 172.21.15.146:0/3767025938 learned_addr learned my addr 172.21.15.146:0/3767025938 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:09.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.957+0000 7feedcb55700 1 --2- 172.21.15.146:0/3767025938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feed8130bc0 0x7feed813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.957+0000 7feed7fff700 1 -- 172.21.15.146:0/3767025938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feed8130bc0 msgr2=0x7feed813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:09.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.957+0000 7feed7fff700 1 --2- 172.21.15.146:0/3767025938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feed8130bc0 0x7feed813b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.957+0000 7feed6ffd700 1 -- 172.21.15.146:0/3767025938 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609467376 0 0) 0x7feed806b2d0 con 0x7feed81300a0 2023-10-03T10:19:09.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.957+0000 7feed7fff700 1 -- 172.21.15.146:0/3767025938 >> v1:172.21.15.146:6789/0 conn(0x7feed81300a0 legacy=0x7feed81304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.957+0000 7feed7fff700 1 -- 172.21.15.146:0/3767025938 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed81338b0 con 0x7feed8133ad0 2023-10-03T10:19:09.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.957+0000 7feedcb55700 1 --2- 172.21.15.146:0/3767025938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feed8130bc0 0x7feed813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.958+0000 7feed7fff700 1 --2- 172.21.15.146:0/3767025938 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feed8133ad0 0x7feed8133ea0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7feecc009870 tx=0x7feecc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbbebdd36048e768 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.958+0000 7feed6ffd700 1 -- 172.21.15.146:0/3767025938 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc011830 con 0x7feed8133ad0 2023-10-03T10:19:09.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.958+0000 7feed6ffd700 1 -- 172.21.15.146:0/3767025938 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feecc011990 con 0x7feed8133ad0 2023-10-03T10:19:09.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.958+0000 7feed6ffd700 1 -- 172.21.15.146:0/3767025938 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc011d20 con 0x7feed8133ad0 2023-10-03T10:19:09.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.958+0000 7feede5b8700 1 -- 172.21.15.146:0/3767025938 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feed8133ad0 msgr2=0x7feed8133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.958+0000 7feede5b8700 1 --2- 172.21.15.146:0/3767025938 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feed8133ad0 0x7feed8133ea0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7feecc009870 tx=0x7feecc009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:09.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.958+0000 7feede5b8700 1 -- 172.21.15.146:0/3767025938 shutdown_connections 2023-10-03T10:19:09.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.958+0000 7feede5b8700 1 --2- 172.21.15.146:0/3767025938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feed8130bc0 0x7feed813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.958+0000 7feede5b8700 1 --2- 172.21.15.146:0/3767025938 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feed8133ad0 0x7feed8133ea0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.958+0000 7feede5b8700 1 -- 172.21.15.146:0/3767025938 >> 172.21.15.146:0/3767025938 conn(0x7feed8099c40 msgr2=0x7feed80a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.958+0000 7feede5b8700 1 -- 172.21.15.146:0/3767025938 shutdown_connections 2023-10-03T10:19:09.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.958+0000 7feede5b8700 1 -- 172.21.15.146:0/3767025938 wait complete. 2023-10-03T10:19:09.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.959+0000 7feede5b8700 1 Processor -- start 2023-10-03T10:19:09.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.959+0000 7feede5b8700 1 -- start start 2023-10-03T10:19:09.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.960+0000 7feede5b8700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feed81300a0 0x7feed811da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.960+0000 7feede5b8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feed8130bc0 0x7feed811df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.960+0000 7feede5b8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feed8133ad0 0x7feed811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.960+0000 7feede5b8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed8120950 con 0x7feed8133ad0 2023-10-03T10:19:09.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.960+0000 7feede5b8700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed812d930 con 0x7feed81300a0 2023-10-03T10:19:09.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.960+0000 7feede5b8700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feed811fd00 con 0x7feed8130bc0 2023-10-03T10:19:09.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.960+0000 7feed7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feed81300a0 0x7feed811da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.960+0000 7feed7fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feed81300a0 0x7feed811da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:37710/0 (socket says 172.21.15.146:37710) 2023-10-03T10:19:09.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.960+0000 7feed7fff700 1 -- 172.21.15.146:0/3702196651 learned_addr learned my addr 172.21.15.146:0/3702196651 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:09.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.960+0000 7feedcb55700 1 --2- 172.21.15.146:0/3702196651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feed8133ad0 0x7feed811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.960+0000 7feed77fe700 1 --2- 172.21.15.146:0/3702196651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feed8130bc0 0x7feed811df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.960+0000 7feed7fff700 1 -- 172.21.15.146:0/3702196651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feed8130bc0 msgr2=0x7feed811df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.960+0000 7feed7fff700 1 --2- 172.21.15.146:0/3702196651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feed8130bc0 0x7feed811df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.960+0000 7feed7fff700 1 -- 172.21.15.146:0/3702196651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feed8133ad0 msgr2=0x7feed811e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.960+0000 7feed7fff700 1 --2- 172.21.15.146:0/3702196651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feed8133ad0 0x7feed811e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.960+0000 7feed7fff700 1 -- 172.21.15.146:0/3702196651 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed0009a70 con 0x7feed81300a0 2023-10-03T10:19:09.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.960+0000 7feedcb55700 1 --2- 172.21.15.146:0/3702196651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feed8133ad0 0x7feed811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.960+0000 7feed7fff700 1 --2- 172.21.15.146:0/3702196651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feed81300a0 0x7feed811da40 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7feecc009840 tx=0x7feecc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.961+0000 7feed4ff9700 1 -- 172.21.15.146:0/3702196651 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc0044d0 con 0x7feed81300a0 2023-10-03T10:19:09.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.961+0000 7feed4ff9700 1 -- 172.21.15.146:0/3702196651 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feecc0036a0 con 0x7feed81300a0 2023-10-03T10:19:09.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.961+0000 7feed4ff9700 1 -- 172.21.15.146:0/3702196651 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc003a30 con 0x7feed81300a0 2023-10-03T10:19:09.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.961+0000 7feede5b8700 1 -- 172.21.15.146:0/3702196651 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feecc0094a0 con 0x7feed81300a0 2023-10-03T10:19:09.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.961+0000 7feede5b8700 1 -- 172.21.15.146:0/3702196651 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed812dd00 con 0x7feed81300a0 2023-10-03T10:19:09.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.961+0000 7feed4ff9700 1 -- 172.21.15.146:0/3702196651 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feecc003b90 con 0x7feed81300a0 2023-10-03T10:19:09.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.961+0000 7feed4ff9700 1 -- 172.21.15.146:0/3702196651 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7feecc040190 con 0x7feed81300a0 2023-10-03T10:19:09.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.962+0000 7feede5b8700 1 -- 172.21.15.146:0/3702196651 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed804f2a0 con 0x7feed81300a0 2023-10-03T10:19:09.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:09.966+0000 7feed4ff9700 1 -- 172.21.15.146:0/3702196651 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feecc01a420 con 0x7feed81300a0 2023-10-03T10:19:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.154+0000 7feede5b8700 1 -- 172.21.15.146:0/3702196651 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7feed806c3b0 con 0x7feed81300a0 2023-10-03T10:19:10.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.154+0000 7feed4ff9700 1 -- 172.21.15.146:0/3702196651 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7feecc028030 con 0x7feed81300a0 2023-10-03T10:19:10.154 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.156+0000 7feede5b8700 1 -- 172.21.15.146:0/3702196651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feed81300a0 msgr2=0x7feed811da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.156+0000 7feede5b8700 1 --2- 172.21.15.146:0/3702196651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feed81300a0 0x7feed811da40 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7feecc009840 tx=0x7feecc004750 comp rx=0 tx=0).stop 2023-10-03T10:19:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.156+0000 7feede5b8700 1 -- 172.21.15.146:0/3702196651 shutdown_connections 2023-10-03T10:19:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.156+0000 7feede5b8700 1 --2- 172.21.15.146:0/3702196651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feed8133ad0 0x7feed811e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.156+0000 7feede5b8700 1 --2- 172.21.15.146:0/3702196651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feed81300a0 0x7feed811da40 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.156+0000 7feede5b8700 1 --2- 172.21.15.146:0/3702196651 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7feed8130bc0 0x7feed811df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.156+0000 7feede5b8700 1 -- 172.21.15.146:0/3702196651 >> 172.21.15.146:0/3702196651 conn(0x7feed8099c40 msgr2=0x7feed812e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.156+0000 7feede5b8700 1 -- 172.21.15.146:0/3702196651 shutdown_connections 2023-10-03T10:19:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.156+0000 7feede5b8700 1 -- 172.21.15.146:0/3702196651 wait complete. 2023-10-03T10:19:10.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:19:10.277 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:10.338 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:10.357 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:10.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.403+0000 7f6d48e15700 1 Processor -- start 2023-10-03T10:19:10.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.403+0000 7f6d48e15700 1 -- start start 2023-10-03T10:19:10.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.404+0000 7f6d48e15700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d44133ad0 0x7f6d44133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.404+0000 7f6d48e15700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d441300a0 0x7f6d441304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.404+0000 7f6d48e15700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4406b2d0 con 0x7f6d441309f0 2023-10-03T10:19:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.404+0000 7f6d48e15700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d44133610 con 0x7f6d44133ad0 2023-10-03T10:19:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.404+0000 7f6d48e15700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4409a500 con 0x7f6d441300a0 2023-10-03T10:19:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.404+0000 7f6d41d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d441300a0 0x7f6d441304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.404+0000 7f6d41d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d441300a0 0x7f6d441304b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:37714/0 (socket says 172.21.15.146:37714) 2023-10-03T10:19:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.404+0000 7f6d41d9b700 1 -- 172.21.15.146:0/1838829308 learned_addr learned my addr 172.21.15.146:0/1838829308 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.404+0000 7f6d4259c700 1 --2- 172.21.15.146:0/1838829308 >> v2:172.21.15.146:3300/0 conn(0x7f6d44133ad0 0x7f6d44133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.404+0000 7f6d4259c700 1 -- 172.21.15.146:0/1838829308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d441300a0 msgr2=0x7f6d441304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.404+0000 7f6d4259c700 1 --2- 172.21.15.146:0/1838829308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d441300a0 0x7f6d441304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.404+0000 7f6d4259c700 1 -- 172.21.15.146:0/1838829308 >> v1:172.21.15.146:6789/0 conn(0x7f6d441309f0 legacy=0x7f6d4413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.404+0000 7f6d4159a700 1 -- 172.21.15.146:0/1838829308 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829748053 0 0) 0x7f6d4406b2d0 con 0x7f6d441309f0 2023-10-03T10:19:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.404+0000 7f6d4259c700 1 -- 172.21.15.146:0/1838829308 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d441338b0 con 0x7f6d44133ad0 2023-10-03T10:19:10.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.404+0000 7f6d41d9b700 1 --2- 172.21.15.146:0/1838829308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d441300a0 0x7f6d441304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:10.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.405+0000 7f6d4259c700 1 --2- 172.21.15.146:0/1838829308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d44133ad0 0x7f6d44133ea0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f6d34009840 tx=0x7f6d34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62aa2085940ac8a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:10.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.405+0000 7f6d4159a700 1 -- 172.21.15.146:0/1838829308 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d34011830 con 0x7f6d44133ad0 2023-10-03T10:19:10.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.405+0000 7f6d4159a700 1 -- 172.21.15.146:0/1838829308 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d34011990 con 0x7f6d44133ad0 2023-10-03T10:19:10.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.405+0000 7f6d4159a700 1 -- 172.21.15.146:0/1838829308 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d34011d20 con 0x7f6d44133ad0 2023-10-03T10:19:10.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.405+0000 7f6d48e15700 1 -- 172.21.15.146:0/1838829308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d44133ad0 msgr2=0x7f6d44133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.405+0000 7f6d48e15700 1 --2- 172.21.15.146:0/1838829308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d44133ad0 0x7f6d44133ea0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f6d34009840 tx=0x7f6d34009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:10.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.406+0000 7f6d48e15700 1 -- 172.21.15.146:0/1838829308 shutdown_connections 2023-10-03T10:19:10.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.406+0000 7f6d48e15700 1 --2- 172.21.15.146:0/1838829308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d44133ad0 0x7f6d44133ea0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.406+0000 7f6d48e15700 1 --2- 172.21.15.146:0/1838829308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d441300a0 0x7f6d441304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.406+0000 7f6d48e15700 1 -- 172.21.15.146:0/1838829308 >> 172.21.15.146:0/1838829308 conn(0x7f6d44099c40 msgr2=0x7f6d440a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:10.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.406+0000 7f6d48e15700 1 -- 172.21.15.146:0/1838829308 shutdown_connections 2023-10-03T10:19:10.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.406+0000 7f6d48e15700 1 -- 172.21.15.146:0/1838829308 wait complete. 2023-10-03T10:19:10.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.407+0000 7f6d48e15700 1 Processor -- start 2023-10-03T10:19:10.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.407+0000 7f6d48e15700 1 -- start start 2023-10-03T10:19:10.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.408+0000 7f6d48e15700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d441300a0 0x7f6d4411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.408+0000 7f6d48e15700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d441309f0 0x7f6d4411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.408+0000 7f6d48e15700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d44133ad0 0x7f6d4411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.408+0000 7f6d48e15700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4411fd70 con 0x7f6d44133ad0 2023-10-03T10:19:10.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.408+0000 7f6d48e15700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4411f080 con 0x7f6d441309f0 2023-10-03T10:19:10.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.408+0000 7f6d48e15700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d44120050 con 0x7f6d441300a0 2023-10-03T10:19:10.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.408+0000 7f6d41d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d441309f0 0x7f6d4411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.408+0000 7f6d41d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d441309f0 0x7f6d4411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:37716/0 (socket says 172.21.15.146:37716) 2023-10-03T10:19:10.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.408+0000 7f6d42d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d44133ad0 0x7f6d4411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.408+0000 7f6d41d9b700 1 -- 172.21.15.146:0/2575644774 learned_addr learned my addr 172.21.15.146:0/2575644774 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:10.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.408+0000 7f6d42d9d700 1 -- 172.21.15.146:0/2575644774 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d441300a0 msgr2=0x7f6d4411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.408+0000 7f6d42d9d700 1 --2- 172.21.15.146:0/2575644774 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d441300a0 0x7f6d4411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.408+0000 7f6d42d9d700 1 -- 172.21.15.146:0/2575644774 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d441309f0 msgr2=0x7f6d4411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.408+0000 7f6d42d9d700 1 --2- 172.21.15.146:0/2575644774 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d441309f0 0x7f6d4411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.408+0000 7f6d42d9d700 1 -- 172.21.15.146:0/2575644774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d38009550 con 0x7f6d44133ad0 2023-10-03T10:19:10.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.408+0000 7f6d41d9b700 1 --2- 172.21.15.146:0/2575644774 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d441309f0 0x7f6d4411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:10.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.408+0000 7f6d42d9d700 1 --2- 172.21.15.146:0/2575644774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d44133ad0 0x7f6d4411e4c0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00c780 tx=0x7f6d3c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:10.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.408+0000 7f6d32ffd700 1 -- 172.21.15.146:0/2575644774 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c003e30 con 0x7f6d44133ad0 2023-10-03T10:19:10.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.408+0000 7f6d32ffd700 1 -- 172.21.15.146:0/2575644774 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c005070 con 0x7f6d44133ad0 2023-10-03T10:19:10.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.409+0000 7f6d32ffd700 1 -- 172.21.15.146:0/2575644774 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c005420 con 0x7f6d44133ad0 2023-10-03T10:19:10.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.409+0000 7f6d48e15700 1 -- 172.21.15.146:0/2575644774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d340094a0 con 0x7f6d44133ad0 2023-10-03T10:19:10.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.409+0000 7f6d48e15700 1 -- 172.21.15.146:0/2575644774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d440a3350 con 0x7f6d44133ad0 2023-10-03T10:19:10.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.410+0000 7f6d48e15700 1 -- 172.21.15.146:0/2575644774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4412dd60 con 0x7f6d44133ad0 2023-10-03T10:19:10.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.410+0000 7f6d32ffd700 1 -- 172.21.15.146:0/2575644774 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6d3c005580 con 0x7f6d44133ad0 2023-10-03T10:19:10.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.410+0000 7f6d32ffd700 1 -- 172.21.15.146:0/2575644774 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6d3c03ec70 con 0x7f6d44133ad0 2023-10-03T10:19:10.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.414+0000 7f6d32ffd700 1 -- 172.21.15.146:0/2575644774 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d3c019b40 con 0x7f6d44133ad0 2023-10-03T10:19:10.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.468+0000 7f225e761700 1 Processor -- start 2023-10-03T10:19:10.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.468+0000 7f225e761700 1 -- start start 2023-10-03T10:19:10.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.469+0000 7f225e761700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f225809e340 0x7f22581359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.469+0000 7f225e761700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2258135f20 0x7f2258138300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.469+0000 7f225e761700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225809aaa0 con 0x7f225809d860 2023-10-03T10:19:10.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.469+0000 7f225e761700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225809e730 con 0x7f2258135f20 2023-10-03T10:19:10.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.469+0000 7f225e761700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225809f870 con 0x7f225809e340 2023-10-03T10:19:10.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.469+0000 7f22577fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f225809e340 0x7f22581359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.469+0000 7f22577fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f225809e340 0x7f22581359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:37724/0 (socket says 172.21.15.146:37724) 2023-10-03T10:19:10.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.469+0000 7f225ccfe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2258135f20 0x7f2258138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.469+0000 7f22577fe700 1 -- 172.21.15.146:0/1082373085 learned_addr learned my addr 172.21.15.146:0/1082373085 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:10.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.469+0000 7f225ccfe700 1 -- 172.21.15.146:0/1082373085 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f225809e340 msgr2=0x7f22581359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:10.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.469+0000 7f225ccfe700 1 --2- 172.21.15.146:0/1082373085 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f225809e340 0x7f22581359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.469+0000 7f225ccfe700 1 -- 172.21.15.146:0/1082373085 >> v1:172.21.15.146:6789/0 conn(0x7f225809d860 legacy=0x7f225809dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.469+0000 7f2256ffd700 1 -- 172.21.15.146:0/1082373085 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515498018 0 0) 0x7f225809aaa0 con 0x7f225809d860 2023-10-03T10:19:10.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.469+0000 7f225ccfe700 1 -- 172.21.15.146:0/1082373085 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225809b360 con 0x7f2258135f20 2023-10-03T10:19:10.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.469+0000 7f225ccfe700 1 --2- 172.21.15.146:0/1082373085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2258135f20 0x7f2258138300 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f225000f3a0 tx=0x7f225000f6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a847f01474a89d3b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:10.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.470+0000 7f2256ffd700 1 -- 172.21.15.146:0/1082373085 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2250012070 con 0x7f2258135f20 2023-10-03T10:19:10.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.470+0000 7f2256ffd700 1 -- 172.21.15.146:0/1082373085 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225000fe60 con 0x7f2258135f20 2023-10-03T10:19:10.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.470+0000 7f2256ffd700 1 -- 172.21.15.146:0/1082373085 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225000d310 con 0x7f2258135f20 2023-10-03T10:19:10.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.471+0000 7f225e761700 1 -- 172.21.15.146:0/1082373085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2258135f20 msgr2=0x7f2258138300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.471+0000 7f225e761700 1 --2- 172.21.15.146:0/1082373085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2258135f20 0x7f2258138300 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f225000f3a0 tx=0x7f225000f6b0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.471+0000 7f225e761700 1 -- 172.21.15.146:0/1082373085 shutdown_connections 2023-10-03T10:19:10.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.471+0000 7f225e761700 1 --2- 172.21.15.146:0/1082373085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2258135f20 0x7f2258138300 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.471+0000 7f225e761700 1 --2- 172.21.15.146:0/1082373085 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f225809e340 0x7f22581359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.471+0000 7f225e761700 1 -- 172.21.15.146:0/1082373085 >> 172.21.15.146:0/1082373085 conn(0x7f2258099c40 msgr2=0x7f22580a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:10.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.471+0000 7f225e761700 1 -- 172.21.15.146:0/1082373085 shutdown_connections 2023-10-03T10:19:10.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.471+0000 7f225e761700 1 -- 172.21.15.146:0/1082373085 wait complete. 2023-10-03T10:19:10.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.472+0000 7f225e761700 1 Processor -- start 2023-10-03T10:19:10.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.472+0000 7f225e761700 1 -- start start 2023-10-03T10:19:10.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.473+0000 7f225e761700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f225809d860 0x7f225811c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.473+0000 7f225e761700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f225809e340 0x7f225811c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.473+0000 7f225e761700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2258135f20 0x7f225811ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.473+0000 7f225e761700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225811e420 con 0x7f2258135f20 2023-10-03T10:19:10.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.473+0000 7f225e761700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225809c8b0 con 0x7f225809e340 2023-10-03T10:19:10.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.473+0000 7f225e761700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22580a0690 con 0x7f225809d860 2023-10-03T10:19:10.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.473+0000 7f2257fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f225809d860 0x7f225811c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.473+0000 7f22577fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f225809e340 0x7f225811c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.473+0000 7f2257fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f225809d860 0x7f225811c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34928/0 (socket says 172.21.15.146:34928) 2023-10-03T10:19:10.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.473+0000 7f2257fff700 1 -- 172.21.15.146:0/199770004 learned_addr learned my addr 172.21.15.146:0/199770004 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:10.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.473+0000 7f225ccfe700 1 --2- 172.21.15.146:0/199770004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2258135f20 0x7f225811ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.474+0000 7f225ccfe700 1 -- 172.21.15.146:0/199770004 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f225809d860 msgr2=0x7f225811c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.474+0000 7f225ccfe700 1 --2- 172.21.15.146:0/199770004 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f225809d860 0x7f225811c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.474+0000 7f225ccfe700 1 -- 172.21.15.146:0/199770004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f225809e340 msgr2=0x7f225811c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.474+0000 7f225ccfe700 1 --2- 172.21.15.146:0/199770004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f225809e340 0x7f225811c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.474+0000 7f225ccfe700 1 -- 172.21.15.146:0/199770004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225000f050 con 0x7f2258135f20 2023-10-03T10:19:10.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.474+0000 7f22577fe700 1 --2- 172.21.15.146:0/199770004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f225809e340 0x7f225811c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:10.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.474+0000 7f2257fff700 1 --2- 172.21.15.146:0/199770004 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f225809d860 0x7f225811c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:10.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.474+0000 7f225ccfe700 1 --2- 172.21.15.146:0/199770004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2258135f20 0x7f225811ccb0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f2250019000 tx=0x7f2250004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:10.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.474+0000 7f2254ff9700 1 -- 172.21.15.146:0/199770004 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2250003a20 con 0x7f2258135f20 2023-10-03T10:19:10.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.474+0000 7f2254ff9700 1 -- 172.21.15.146:0/199770004 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2250003ba0 con 0x7f2258135f20 2023-10-03T10:19:10.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.474+0000 7f225e761700 1 -- 172.21.15.146:0/199770004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225811f490 con 0x7f2258135f20 2023-10-03T10:19:10.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.474+0000 7f2254ff9700 1 -- 172.21.15.146:0/199770004 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2250004050 con 0x7f2258135f20 2023-10-03T10:19:10.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.474+0000 7f225e761700 1 -- 172.21.15.146:0/199770004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225811e5e0 con 0x7f2258135f20 2023-10-03T10:19:10.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.475+0000 7f2254ff9700 1 -- 172.21.15.146:0/199770004 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f22500041b0 con 0x7f2258135f20 2023-10-03T10:19:10.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.475+0000 7f225e761700 1 -- 172.21.15.146:0/199770004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225811f680 con 0x7f2258135f20 2023-10-03T10:19:10.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.476+0000 7f2254ff9700 1 -- 172.21.15.146:0/199770004 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2250044e20 con 0x7f2258135f20 2023-10-03T10:19:10.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.480+0000 7f2254ff9700 1 -- 172.21.15.146:0/199770004 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2250015960 con 0x7f2258135f20 2023-10-03T10:19:10.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.509+0000 7f19c7f9e700 1 Processor -- start 2023-10-03T10:19:10.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.510+0000 7f19c7f9e700 1 -- start start 2023-10-03T10:19:10.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.510+0000 7f19c7f9e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19c009e870 0x7f19c009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.510+0000 7f19c7f9e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19c009f180 0x7f19c0133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.510+0000 7f19c7f9e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f19c01341d0 0x7f19c0134670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.510+0000 7f19c7f9e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c006ce60 con 0x7f19c01341d0 2023-10-03T10:19:10.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.510+0000 7f19c7f9e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c006bec0 con 0x7f19c009e870 2023-10-03T10:19:10.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.510+0000 7f19c7f9e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19c009fa00 con 0x7f19c009f180 2023-10-03T10:19:10.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.510+0000 7f19c5d3a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19c009e870 0x7f19c009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.510+0000 7f19c5d3a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19c009e870 0x7f19c009ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:37752/0 (socket says 172.21.15.146:37752) 2023-10-03T10:19:10.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.510+0000 7f19c5d3a700 1 -- 172.21.15.146:0/278288304 learned_addr learned my addr 172.21.15.146:0/278288304 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:10.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.510+0000 7f19c653b700 1 --2- 172.21.15.146:0/278288304 >> v2:172.21.15.146:3300/0 conn(0x7f19c01341d0 0x7f19c0134670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.510+0000 7f19c5539700 1 --2- 172.21.15.146:0/278288304 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19c009f180 0x7f19c0133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.511+0000 7f19c5d3a700 1 -- 172.21.15.146:0/278288304 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19c009f180 msgr2=0x7f19c0133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.511+0000 7f19c5d3a700 1 --2- 172.21.15.146:0/278288304 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19c009f180 0x7f19c0133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.511+0000 7f19c5d3a700 1 -- 172.21.15.146:0/278288304 >> v2:172.21.15.146:3300/0 conn(0x7f19c01341d0 msgr2=0x7f19c0134670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.511+0000 7f19c5d3a700 1 --2- 172.21.15.146:0/278288304 >> v2:172.21.15.146:3300/0 conn(0x7f19c01341d0 0x7f19c0134670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.511+0000 7f19c5d3a700 1 -- 172.21.15.146:0/278288304 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c009ad80 con 0x7f19c009e870 2023-10-03T10:19:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.511+0000 7f19c5d3a700 1 --2- 172.21.15.146:0/278288304 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19c009e870 0x7f19c009ec40 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f19bc009920 tx=0x7f19bc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d71655ea9a6f4266 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.511+0000 7f19c4d38700 1 -- 172.21.15.146:0/278288304 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc011830 con 0x7f19c009e870 2023-10-03T10:19:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.511+0000 7f19c4d38700 1 -- 172.21.15.146:0/278288304 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc011990 con 0x7f19c009e870 2023-10-03T10:19:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.511+0000 7f19c4d38700 1 -- 172.21.15.146:0/278288304 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc011d20 con 0x7f19c009e870 2023-10-03T10:19:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.511+0000 7f19c7f9e700 1 -- 172.21.15.146:0/278288304 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19c009e870 msgr2=0x7f19c009ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.511+0000 7f19c7f9e700 1 --2- 172.21.15.146:0/278288304 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19c009e870 0x7f19c009ec40 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f19bc009920 tx=0x7f19bc009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.512+0000 7f19c7f9e700 1 -- 172.21.15.146:0/278288304 shutdown_connections 2023-10-03T10:19:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.512+0000 7f19c7f9e700 1 --2- 172.21.15.146:0/278288304 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19c009e870 0x7f19c009ec40 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.512+0000 7f19c7f9e700 1 --2- 172.21.15.146:0/278288304 >> v2:172.21.15.146:3300/0 conn(0x7f19c01341d0 0x7f19c0134670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.512+0000 7f19c7f9e700 1 --2- 172.21.15.146:0/278288304 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19c009f180 0x7f19c0133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.512+0000 7f19c7f9e700 1 -- 172.21.15.146:0/278288304 >> 172.21.15.146:0/278288304 conn(0x7f19c00a4430 msgr2=0x7f19c00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.512+0000 7f19c7f9e700 1 -- 172.21.15.146:0/278288304 shutdown_connections 2023-10-03T10:19:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.512+0000 7f19c7f9e700 1 -- 172.21.15.146:0/278288304 wait complete. 2023-10-03T10:19:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.512+0000 7f19c7f9e700 1 Processor -- start 2023-10-03T10:19:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.513+0000 7f19c7f9e700 1 -- start start 2023-10-03T10:19:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.513+0000 7f19c7f9e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19c009e870 0x7f19c0122530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.513+0000 7f19c7f9e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19c009f180 0x7f19c0122a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.513+0000 7f19c7f9e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19c01341d0 0x7f19c0122fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.513+0000 7f19c7f9e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c0125fc0 con 0x7f19c009f180 2023-10-03T10:19:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.513+0000 7f19c7f9e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c0124f40 con 0x7f19c01341d0 2023-10-03T10:19:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.513+0000 7f19c7f9e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19c006cfa0 con 0x7f19c009e870 2023-10-03T10:19:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.513+0000 7f19c5539700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19c009f180 0x7f19c0122a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.513+0000 7f19c5539700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19c009f180 0x7f19c0122a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51844/0 (socket says 172.21.15.146:51844) 2023-10-03T10:19:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.513+0000 7f19c5539700 1 -- 172.21.15.146:0/1780269839 learned_addr learned my addr 172.21.15.146:0/1780269839 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.513+0000 7f19c653b700 1 --2- 172.21.15.146:0/1780269839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19c01341d0 0x7f19c0122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.513+0000 7f19c5d3a700 1 --2- 172.21.15.146:0/1780269839 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19c009e870 0x7f19c0122530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.513+0000 7f19c5539700 1 -- 172.21.15.146:0/1780269839 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19c009e870 msgr2=0x7f19c0122530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.513+0000 7f19c5539700 1 --2- 172.21.15.146:0/1780269839 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19c009e870 0x7f19c0122530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.513+0000 7f19c5539700 1 -- 172.21.15.146:0/1780269839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19c01341d0 msgr2=0x7f19c0122fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.513+0000 7f19c5539700 1 --2- 172.21.15.146:0/1780269839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19c01341d0 0x7f19c0122fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.513+0000 7f19c5539700 1 -- 172.21.15.146:0/1780269839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19bc009550 con 0x7f19c009f180 2023-10-03T10:19:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.513+0000 7f19c653b700 1 --2- 172.21.15.146:0/1780269839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19c01341d0 0x7f19c0122fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.514+0000 7f19c5539700 1 --2- 172.21.15.146:0/1780269839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19c009f180 0x7f19c0122a70 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f19b000e990 tx=0x7f19b000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.514+0000 7f19b67fc700 1 -- 172.21.15.146:0/1780269839 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b00096f0 con 0x7f19c009f180 2023-10-03T10:19:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.514+0000 7f19b67fc700 1 -- 172.21.15.146:0/1780269839 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b0004020 con 0x7f19c009f180 2023-10-03T10:19:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.514+0000 7f19c7f9e700 1 -- 172.21.15.146:0/1780269839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c0125750 con 0x7f19c009f180 2023-10-03T10:19:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.514+0000 7f19b67fc700 1 -- 172.21.15.146:0/1780269839 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b00043b0 con 0x7f19c009f180 2023-10-03T10:19:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.514+0000 7f19c7f9e700 1 -- 172.21.15.146:0/1780269839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c0125a20 con 0x7f19c009f180 2023-10-03T10:19:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.515+0000 7f19c7f9e700 1 -- 172.21.15.146:0/1780269839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c004f2a0 con 0x7f19c009f180 2023-10-03T10:19:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.515+0000 7f19b67fc700 1 -- 172.21.15.146:0/1780269839 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19b00036a0 con 0x7f19c009f180 2023-10-03T10:19:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.515+0000 7f19b67fc700 1 -- 172.21.15.146:0/1780269839 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f19b003f920 con 0x7f19c009f180 2023-10-03T10:19:10.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.524+0000 7f19b67fc700 1 -- 172.21.15.146:0/1780269839 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19b0013680 con 0x7f19c009f180 2023-10-03T10:19:10.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.613+0000 7f6d48e15700 1 -- 172.21.15.146:0/2575644774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6d4404f2a0 con 0x7f6d44133ad0 2023-10-03T10:19:10.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.614+0000 7f6d32ffd700 1 -- 172.21.15.146:0/2575644774 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6d3c017020 con 0x7f6d44133ad0 2023-10-03T10:19:10.613 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:10.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.616+0000 7f6d48e15700 1 -- 172.21.15.146:0/2575644774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d44133ad0 msgr2=0x7f6d4411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.616+0000 7f6d48e15700 1 --2- 172.21.15.146:0/2575644774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d44133ad0 0x7f6d4411e4c0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00c780 tx=0x7f6d3c00ca90 comp rx=0 tx=0).stop 2023-10-03T10:19:10.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.616+0000 7f6d48e15700 1 -- 172.21.15.146:0/2575644774 shutdown_connections 2023-10-03T10:19:10.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.616+0000 7f6d48e15700 1 --2- 172.21.15.146:0/2575644774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d44133ad0 0x7f6d4411e4c0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.616+0000 7f6d48e15700 1 --2- 172.21.15.146:0/2575644774 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6d441300a0 0x7f6d4411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.616+0000 7f6d48e15700 1 --2- 172.21.15.146:0/2575644774 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d441309f0 0x7f6d4411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.616+0000 7f6d48e15700 1 -- 172.21.15.146:0/2575644774 >> 172.21.15.146:0/2575644774 conn(0x7f6d44099c40 msgr2=0x7f6d4412e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:10.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.617+0000 7f6d48e15700 1 -- 172.21.15.146:0/2575644774 shutdown_connections 2023-10-03T10:19:10.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.619+0000 7f6d48e15700 1 -- 172.21.15.146:0/2575644774 wait complete. 2023-10-03T10:19:10.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:19:10.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.682+0000 7f225e761700 1 -- 172.21.15.146:0/199770004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f225804f2a0 con 0x7f2258135f20 2023-10-03T10:19:10.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.682+0000 7f2254ff9700 1 -- 172.21.15.146:0/199770004 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2250024070 con 0x7f2258135f20 2023-10-03T10:19:10.682 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:19:10.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.684+0000 7f225e761700 1 -- 172.21.15.146:0/199770004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2258135f20 msgr2=0x7f225811ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.684+0000 7f225e761700 1 --2- 172.21.15.146:0/199770004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2258135f20 0x7f225811ccb0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f2250019000 tx=0x7f2250004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.684+0000 7f225e761700 1 -- 172.21.15.146:0/199770004 shutdown_connections 2023-10-03T10:19:10.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.684+0000 7f225e761700 1 --2- 172.21.15.146:0/199770004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2258135f20 0x7f225811ccb0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.684+0000 7f225e761700 1 --2- 172.21.15.146:0/199770004 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f225809d860 0x7f225811c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.684+0000 7f225e761700 1 --2- 172.21.15.146:0/199770004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f225809e340 0x7f225811c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.684+0000 7f225e761700 1 -- 172.21.15.146:0/199770004 >> 172.21.15.146:0/199770004 conn(0x7f2258099c40 msgr2=0x7f22580a1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:10.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.684+0000 7f225e761700 1 -- 172.21.15.146:0/199770004 shutdown_connections 2023-10-03T10:19:10.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.684+0000 7f225e761700 1 -- 172.21.15.146:0/199770004 wait complete. 2023-10-03T10:19:10.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:19:10.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.716+0000 7f19c7f9e700 1 -- 172.21.15.146:0/1780269839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f19c0072d60 con 0x7f19c009f180 2023-10-03T10:19:10.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.716+0000 7f19b67fc700 1 -- 172.21.15.146:0/1780269839 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f19b0017020 con 0x7f19c009f180 2023-10-03T10:19:10.716 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:19:10.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.719+0000 7f19c7f9e700 1 -- 172.21.15.146:0/1780269839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19c009f180 msgr2=0x7f19c0122a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.719+0000 7f19c7f9e700 1 --2- 172.21.15.146:0/1780269839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19c009f180 0x7f19c0122a70 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f19b000e990 tx=0x7f19b000eca0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.719+0000 7f19c7f9e700 1 -- 172.21.15.146:0/1780269839 shutdown_connections 2023-10-03T10:19:10.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.719+0000 7f19c7f9e700 1 --2- 172.21.15.146:0/1780269839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19c01341d0 0x7f19c0122fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.719+0000 7f19c7f9e700 1 --2- 172.21.15.146:0/1780269839 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f19c009e870 0x7f19c0122530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.719+0000 7f19c7f9e700 1 --2- 172.21.15.146:0/1780269839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19c009f180 0x7f19c0122a70 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.719+0000 7f19c7f9e700 1 -- 172.21.15.146:0/1780269839 >> 172.21.15.146:0/1780269839 conn(0x7f19c00a4430 msgr2=0x7f19c009dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:10.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.719+0000 7f19c7f9e700 1 -- 172.21.15.146:0/1780269839 shutdown_connections 2023-10-03T10:19:10.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:10.719+0000 7f19c7f9e700 1 -- 172.21.15.146:0/1780269839 wait complete. 2023-10-03T10:19:10.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:19:11.169 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:11.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.295+0000 7f8d07d26700 1 Processor -- start 2023-10-03T10:19:11.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.295+0000 7f8d07d26700 1 -- start start 2023-10-03T10:19:11.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.296+0000 7f8d07d26700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d00066410 0x7f8d001319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.296+0000 7f8d07d26700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8d00131f30 0x7f8d0009c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.296+0000 7f8d07d26700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d000a0f20 con 0x7f8d001314b0 2023-10-03T10:19:11.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.296+0000 7f8d07d26700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d000667e0 con 0x7f8d00131f30 2023-10-03T10:19:11.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.296+0000 7f8d07d26700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d000a23c0 con 0x7f8d00066410 2023-10-03T10:19:11.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.296+0000 7f8d062c3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8d00131f30 0x7f8d0009c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.296+0000 7f8d05ac2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d00066410 0x7f8d001319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.296+0000 7f8d052c1700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8d001314b0 0x7f8d0009bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36710/0 (socket says 172.21.15.146:36710) 2023-10-03T10:19:11.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.296+0000 7f8d062c3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8d00131f30 0x7f8d0009c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51850/0 (socket says 172.21.15.146:51850) 2023-10-03T10:19:11.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.296+0000 7f8d052c1700 1 -- 172.21.15.146:0/2613826736 learned_addr learned my addr 172.21.15.146:0/2613826736 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:11.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.296+0000 7f8d05ac2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d00066410 0x7f8d001319f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:37780/0 (socket says 172.21.15.146:37780) 2023-10-03T10:19:11.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.296+0000 7f8d05ac2700 1 -- 172.21.15.146:0/2613826736 >> v2:172.21.15.146:3300/0 conn(0x7f8d00131f30 msgr2=0x7f8d0009c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:11.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.296+0000 7f8d05ac2700 1 --2- 172.21.15.146:0/2613826736 >> v2:172.21.15.146:3300/0 conn(0x7f8d00131f30 0x7f8d0009c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.296+0000 7f8d05ac2700 1 -- 172.21.15.146:0/2613826736 >> v1:172.21.15.146:6789/0 conn(0x7f8d001314b0 legacy=0x7f8d0009bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.296+0000 7f8d05ac2700 1 -- 172.21.15.146:0/2613826736 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d000a16e0 con 0x7f8d00066410 2023-10-03T10:19:11.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.296+0000 7f8d062c3700 1 --2- 172.21.15.146:0/2613826736 >> v2:172.21.15.146:3300/0 conn(0x7f8d00131f30 0x7f8d0009c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:11.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.296+0000 7f8d04ac0700 1 -- 172.21.15.146:0/2613826736 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 826208246 0 0) 0x7f8d000a0f20 con 0x7f8d001314b0 2023-10-03T10:19:11.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.296+0000 7f8d05ac2700 1 --2- 172.21.15.146:0/2613826736 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d00066410 0x7f8d001319f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009850 tx=0x7f8cf0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=924b1de03a02e600 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.297+0000 7f8d04ac0700 1 -- 172.21.15.146:0/2613826736 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0005e30 con 0x7f8d00066410 2023-10-03T10:19:11.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.297+0000 7f8d04ac0700 1 -- 172.21.15.146:0/2613826736 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf0006030 con 0x7f8d00066410 2023-10-03T10:19:11.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.297+0000 7f8d04ac0700 1 -- 172.21.15.146:0/2613826736 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf00063c0 con 0x7f8d00066410 2023-10-03T10:19:11.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.297+0000 7f8d07d26700 1 -- 172.21.15.146:0/2613826736 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d00066410 msgr2=0x7f8d001319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.297+0000 7f8d07d26700 1 --2- 172.21.15.146:0/2613826736 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d00066410 0x7f8d001319f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009850 tx=0x7f8cf0009b60 comp rx=0 tx=0).stop 2023-10-03T10:19:11.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.297+0000 7f8d07d26700 1 -- 172.21.15.146:0/2613826736 shutdown_connections 2023-10-03T10:19:11.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.297+0000 7f8d07d26700 1 --2- 172.21.15.146:0/2613826736 >> v2:172.21.15.146:3300/0 conn(0x7f8d00131f30 0x7f8d0009c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.297+0000 7f8d07d26700 1 --2- 172.21.15.146:0/2613826736 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d00066410 0x7f8d001319f0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.297+0000 7f8d07d26700 1 -- 172.21.15.146:0/2613826736 >> 172.21.15.146:0/2613826736 conn(0x7f8d000a2980 msgr2=0x7f8d000a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.297+0000 7f8d07d26700 1 -- 172.21.15.146:0/2613826736 shutdown_connections 2023-10-03T10:19:11.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.297+0000 7f8d07d26700 1 -- 172.21.15.146:0/2613826736 wait complete. 2023-10-03T10:19:11.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.298+0000 7f8d07d26700 1 Processor -- start 2023-10-03T10:19:11.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.298+0000 7f8d07d26700 1 -- start start 2023-10-03T10:19:11.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.298+0000 7f8d07d26700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d00066410 0x7f8d001361d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.298+0000 7f8d07d26700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d001314b0 0x7f8d00136710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.298+0000 7f8d07d26700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d00131f30 0x7f8d00136c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.299+0000 7f8d07d26700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d00119070 con 0x7f8d00066410 2023-10-03T10:19:11.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.299+0000 7f8d07d26700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d00119270 con 0x7f8d00131f30 2023-10-03T10:19:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.299+0000 7f8d07d26700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d00138b50 con 0x7f8d001314b0 2023-10-03T10:19:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.299+0000 7f8d05ac2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d00066410 0x7f8d001361d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.299+0000 7f8d062c3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d00131f30 0x7f8d00136c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.299+0000 7f8d05ac2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d00066410 0x7f8d001361d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51860/0 (socket says 172.21.15.146:51860) 2023-10-03T10:19:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.299+0000 7f8d05ac2700 1 -- 172.21.15.146:0/1467144141 learned_addr learned my addr 172.21.15.146:0/1467144141 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.299+0000 7f8d052c1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d001314b0 0x7f8d00136710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.299+0000 7f8d05ac2700 1 -- 172.21.15.146:0/1467144141 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d001314b0 msgr2=0x7f8d00136710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.299+0000 7f8d05ac2700 1 --2- 172.21.15.146:0/1467144141 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d001314b0 0x7f8d00136710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.299+0000 7f8d05ac2700 1 -- 172.21.15.146:0/1467144141 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d00131f30 msgr2=0x7f8d00136c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.299+0000 7f8d05ac2700 1 --2- 172.21.15.146:0/1467144141 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d00131f30 0x7f8d00136c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.299+0000 7f8d05ac2700 1 -- 172.21.15.146:0/1467144141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf8009a70 con 0x7f8d00066410 2023-10-03T10:19:11.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.299+0000 7f8d062c3700 1 --2- 172.21.15.146:0/1467144141 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d00131f30 0x7f8d00136c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:11.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.299+0000 7f8d052c1700 1 --2- 172.21.15.146:0/1467144141 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d001314b0 0x7f8d00136710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:11.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.299+0000 7f8d05ac2700 1 --2- 172.21.15.146:0/1467144141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d00066410 0x7f8d001361d0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0013040 tx=0x7f8cf0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.299+0000 7f8cf67fc700 1 -- 172.21.15.146:0/1467144141 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0006930 con 0x7f8d00066410 2023-10-03T10:19:11.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.299+0000 7f8cf67fc700 1 -- 172.21.15.146:0/1467144141 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf0020070 con 0x7f8d00066410 2023-10-03T10:19:11.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.299+0000 7f8d07d26700 1 -- 172.21.15.146:0/1467144141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf0009430 con 0x7f8d00066410 2023-10-03T10:19:11.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.299+0000 7f8cf67fc700 1 -- 172.21.15.146:0/1467144141 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0025670 con 0x7f8d00066410 2023-10-03T10:19:11.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.299+0000 7f8d07d26700 1 -- 172.21.15.146:0/1467144141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d00137e40 con 0x7f8d00066410 2023-10-03T10:19:11.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.300+0000 7f8cf67fc700 1 -- 172.21.15.146:0/1467144141 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8cf0022030 con 0x7f8d00066410 2023-10-03T10:19:11.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.300+0000 7f8cf67fc700 1 -- 172.21.15.146:0/1467144141 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8cf0040ae0 con 0x7f8d00066410 2023-10-03T10:19:11.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.300+0000 7f8d07d26700 1 -- 172.21.15.146:0/1467144141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d0004f2a0 con 0x7f8d00066410 2023-10-03T10:19:11.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.305+0000 7f8cf67fc700 1 -- 172.21.15.146:0/1467144141 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8cf0011420 con 0x7f8d00066410 2023-10-03T10:19:11.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.488+0000 7f8d07d26700 1 -- 172.21.15.146:0/1467144141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8d00138540 con 0x7f8d00066410 2023-10-03T10:19:11.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.489+0000 7f8cf67fc700 1 -- 172.21.15.146:0/1467144141 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8cf00243d0 con 0x7f8d00066410 2023-10-03T10:19:11.488 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:11.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.490+0000 7f8d07d26700 1 -- 172.21.15.146:0/1467144141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d00066410 msgr2=0x7f8d001361d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.490+0000 7f8d07d26700 1 --2- 172.21.15.146:0/1467144141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d00066410 0x7f8d001361d0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0013040 tx=0x7f8cf0004750 comp rx=0 tx=0).stop 2023-10-03T10:19:11.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.490+0000 7f8d07d26700 1 -- 172.21.15.146:0/1467144141 shutdown_connections 2023-10-03T10:19:11.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.490+0000 7f8d07d26700 1 --2- 172.21.15.146:0/1467144141 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d00131f30 0x7f8d00136c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.490+0000 7f8d07d26700 1 --2- 172.21.15.146:0/1467144141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d00066410 0x7f8d001361d0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.490+0000 7f8d07d26700 1 --2- 172.21.15.146:0/1467144141 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8d001314b0 0x7f8d00136710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.490+0000 7f8d07d26700 1 -- 172.21.15.146:0/1467144141 >> 172.21.15.146:0/1467144141 conn(0x7f8d000a2980 msgr2=0x7f8d0009f810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.490+0000 7f8d07d26700 1 -- 172.21.15.146:0/1467144141 shutdown_connections 2023-10-03T10:19:11.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.491+0000 7f8d07d26700 1 -- 172.21.15.146:0/1467144141 wait complete. 2023-10-03T10:19:11.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:19:11.631 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:11.697 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:11.731 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:11.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.762+0000 7f8af8aed700 1 Processor -- start 2023-10-03T10:19:11.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.762+0000 7f8af8aed700 1 -- start start 2023-10-03T10:19:11.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.763+0000 7f8af8aed700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8af4133ad0 0x7f8af4133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.763+0000 7f8af8aed700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8af41300a0 0x7f8af41304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.763+0000 7f8af8aed700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af406b2d0 con 0x7f8af41309f0 2023-10-03T10:19:11.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.763+0000 7f8af8aed700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af4133610 con 0x7f8af41300a0 2023-10-03T10:19:11.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.763+0000 7f8af8aed700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8af409a500 con 0x7f8af4133ad0 2023-10-03T10:19:11.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.763+0000 7f8af259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8af4133ad0 0x7f8af4133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.763+0000 7f8af2d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8af41309f0 0x7f8af413a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36720/0 (socket says 172.21.15.146:36720) 2023-10-03T10:19:11.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.763+0000 7f8af2d9d700 1 -- 172.21.15.146:0/3960800915 learned_addr learned my addr 172.21.15.146:0/3960800915 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:11.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.763+0000 7f8af1d9b700 1 --2- 172.21.15.146:0/3960800915 >> v2:172.21.15.146:3300/0 conn(0x7f8af41300a0 0x7f8af41304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.763+0000 7f8af259c700 1 -- 172.21.15.146:0/3960800915 >> v2:172.21.15.146:3300/0 conn(0x7f8af41300a0 msgr2=0x7f8af41304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:11.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.763+0000 7f8af259c700 1 --2- 172.21.15.146:0/3960800915 >> v2:172.21.15.146:3300/0 conn(0x7f8af41300a0 0x7f8af41304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.763+0000 7f8af259c700 1 -- 172.21.15.146:0/3960800915 >> v1:172.21.15.146:6789/0 conn(0x7f8af41309f0 legacy=0x7f8af413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.763+0000 7f8af259c700 1 -- 172.21.15.146:0/3960800915 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af41338b0 con 0x7f8af4133ad0 2023-10-03T10:19:11.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.763+0000 7f8af259c700 1 --2- 172.21.15.146:0/3960800915 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8af4133ad0 0x7f8af4133ea0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4009840 tx=0x7f8ae4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=393b8bcc83c0cc9e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.764+0000 7f8af159a700 1 -- 172.21.15.146:0/3960800915 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4011830 con 0x7f8af4133ad0 2023-10-03T10:19:11.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.764+0000 7f8af159a700 1 -- 172.21.15.146:0/3960800915 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae4011990 con 0x7f8af4133ad0 2023-10-03T10:19:11.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.764+0000 7f8af159a700 1 -- 172.21.15.146:0/3960800915 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4011d20 con 0x7f8af4133ad0 2023-10-03T10:19:11.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.764+0000 7f8af8aed700 1 -- 172.21.15.146:0/3960800915 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8af4133ad0 msgr2=0x7f8af4133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.764+0000 7f8af8aed700 1 --2- 172.21.15.146:0/3960800915 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8af4133ad0 0x7f8af4133ea0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4009840 tx=0x7f8ae4009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:11.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.765+0000 7f8af8aed700 1 -- 172.21.15.146:0/3960800915 shutdown_connections 2023-10-03T10:19:11.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.765+0000 7f8af8aed700 1 --2- 172.21.15.146:0/3960800915 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8af4133ad0 0x7f8af4133ea0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.765+0000 7f8af8aed700 1 --2- 172.21.15.146:0/3960800915 >> v2:172.21.15.146:3300/0 conn(0x7f8af41300a0 0x7f8af41304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.765+0000 7f8af8aed700 1 -- 172.21.15.146:0/3960800915 >> 172.21.15.146:0/3960800915 conn(0x7f8af4099c40 msgr2=0x7f8af40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.765+0000 7f8af8aed700 1 -- 172.21.15.146:0/3960800915 shutdown_connections 2023-10-03T10:19:11.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.765+0000 7f8af8aed700 1 -- 172.21.15.146:0/3960800915 wait complete. 2023-10-03T10:19:11.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.766+0000 7f8af8aed700 1 Processor -- start 2023-10-03T10:19:11.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.766+0000 7f8af8aed700 1 -- start start 2023-10-03T10:19:11.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.767+0000 7f8af8aed700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8af41300a0 0x7f8af411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.767+0000 7f8af8aed700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8af41309f0 0x7f8af411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.767+0000 7f8af8aed700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8af4133ad0 0x7f8af411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.767+0000 7f8af8aed700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af411fde0 con 0x7f8af4133ad0 2023-10-03T10:19:11.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.767+0000 7f8af8aed700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af40a2ea0 con 0x7f8af41300a0 2023-10-03T10:19:11.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.767+0000 7f8af8aed700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8af412dd00 con 0x7f8af41309f0 2023-10-03T10:19:11.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.767+0000 7f8af1d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8af41309f0 0x7f8af411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.767+0000 7f8af259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8af41300a0 0x7f8af411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.767+0000 7f8af1d9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8af41309f0 0x7f8af411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:34986/0 (socket says 172.21.15.146:34986) 2023-10-03T10:19:11.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.767+0000 7f8af1d9b700 1 -- 172.21.15.146:0/3090813652 learned_addr learned my addr 172.21.15.146:0/3090813652 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:11.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.767+0000 7f8af259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8af41300a0 0x7f8af411da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:37810/0 (socket says 172.21.15.146:37810) 2023-10-03T10:19:11.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.767+0000 7f8af2d9d700 1 --2- 172.21.15.146:0/3090813652 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8af4133ad0 0x7f8af411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.767+0000 7f8af1d9b700 1 -- 172.21.15.146:0/3090813652 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8af41300a0 msgr2=0x7f8af411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.767+0000 7f8af1d9b700 1 --2- 172.21.15.146:0/3090813652 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8af41300a0 0x7f8af411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.767+0000 7f8af1d9b700 1 -- 172.21.15.146:0/3090813652 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8af4133ad0 msgr2=0x7f8af411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.767+0000 7f8af1d9b700 1 --2- 172.21.15.146:0/3090813652 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8af4133ad0 0x7f8af411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.767+0000 7f8af1d9b700 1 -- 172.21.15.146:0/3090813652 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae40094a0 con 0x7f8af41309f0 2023-10-03T10:19:11.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.767+0000 7f8af2d9d700 1 --2- 172.21.15.146:0/3090813652 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8af4133ad0 0x7f8af411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:11.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.767+0000 7f8af1d9b700 1 --2- 172.21.15.146:0/3090813652 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8af41309f0 0x7f8af411df80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800e980 tx=0x7f8ae800ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.768+0000 7f8ae2ffd700 1 -- 172.21.15.146:0/3090813652 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae800eed0 con 0x7f8af41309f0 2023-10-03T10:19:11.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.768+0000 7f8ae2ffd700 1 -- 172.21.15.146:0/3090813652 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae800c850 con 0x7f8af41309f0 2023-10-03T10:19:11.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.768+0000 7f8af8aed700 1 -- 172.21.15.146:0/3090813652 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af41200c0 con 0x7f8af41309f0 2023-10-03T10:19:11.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.768+0000 7f8ae2ffd700 1 -- 172.21.15.146:0/3090813652 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae800cbe0 con 0x7f8af41309f0 2023-10-03T10:19:11.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.768+0000 7f8af8aed700 1 -- 172.21.15.146:0/3090813652 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af411f850 con 0x7f8af41309f0 2023-10-03T10:19:11.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.769+0000 7f8ae2ffd700 1 -- 172.21.15.146:0/3090813652 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ae800cd40 con 0x7f8af41309f0 2023-10-03T10:19:11.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.769+0000 7f8ae2ffd700 1 -- 172.21.15.146:0/3090813652 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f8ae803f7a0 con 0x7f8af41309f0 2023-10-03T10:19:11.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.769+0000 7f8af8aed700 1 -- 172.21.15.146:0/3090813652 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af409cb20 con 0x7f8af41309f0 2023-10-03T10:19:11.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.774+0000 7f8ae2ffd700 1 -- 172.21.15.146:0/3090813652 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ae80232f0 con 0x7f8af41309f0 2023-10-03T10:19:11.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.830+0000 7f484aaa1700 1 Processor -- start 2023-10-03T10:19:11.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.830+0000 7f484aaa1700 1 -- start start 2023-10-03T10:19:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.830+0000 7f484aaa1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48440a0a70 0x7f48440a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.830+0000 7f484aaa1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4844134120 0x7f484413bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.830+0000 7f484aaa1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484409dc00 con 0x7f48440a1380 2023-10-03T10:19:11.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.830+0000 7f484aaa1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484409ea60 con 0x7f4844134120 2023-10-03T10:19:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.830+0000 7f484aaa1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f484409dec0 con 0x7f48440a0a70 2023-10-03T10:19:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.830+0000 7f4843fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f48440a1380 0x7f4844133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36724/0 (socket says 172.21.15.146:36724) 2023-10-03T10:19:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.830+0000 7f484903e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4844134120 0x7f484413bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.830+0000 7f4843fff700 1 -- 172.21.15.146:0/2034997983 learned_addr learned my addr 172.21.15.146:0/2034997983 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.830+0000 7f484883d700 1 --2- 172.21.15.146:0/2034997983 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48440a0a70 0x7f48440a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.831+0000 7f484883d700 1 -- 172.21.15.146:0/2034997983 >> v2:172.21.15.146:3300/0 conn(0x7f4844134120 msgr2=0x7f484413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.831+0000 7f484883d700 1 --2- 172.21.15.146:0/2034997983 >> v2:172.21.15.146:3300/0 conn(0x7f4844134120 0x7f484413bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.831+0000 7f484883d700 1 -- 172.21.15.146:0/2034997983 >> v1:172.21.15.146:6789/0 conn(0x7f48440a1380 legacy=0x7f4844133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.831+0000 7f48437fe700 1 -- 172.21.15.146:0/2034997983 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807924807 0 0) 0x7f484409dc00 con 0x7f48440a1380 2023-10-03T10:19:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.831+0000 7f484883d700 1 -- 172.21.15.146:0/2034997983 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484409e6a0 con 0x7f48440a0a70 2023-10-03T10:19:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.831+0000 7f484903e700 1 --2- 172.21.15.146:0/2034997983 >> v2:172.21.15.146:3300/0 conn(0x7f4844134120 0x7f484413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:11.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.831+0000 7f484883d700 1 --2- 172.21.15.146:0/2034997983 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48440a0a70 0x7f48440a0e40 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f4838009840 tx=0x7f4838009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd999c59696bce0b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.831+0000 7f48437fe700 1 -- 172.21.15.146:0/2034997983 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838011830 con 0x7f48440a0a70 2023-10-03T10:19:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.831+0000 7f48437fe700 1 -- 172.21.15.146:0/2034997983 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4838011990 con 0x7f48440a0a70 2023-10-03T10:19:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.831+0000 7f48437fe700 1 -- 172.21.15.146:0/2034997983 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838011d20 con 0x7f48440a0a70 2023-10-03T10:19:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.832+0000 7f484aaa1700 1 -- 172.21.15.146:0/2034997983 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48440a0a70 msgr2=0x7f48440a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.832+0000 7f484aaa1700 1 --2- 172.21.15.146:0/2034997983 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48440a0a70 0x7f48440a0e40 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f4838009840 tx=0x7f4838009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.832+0000 7f484aaa1700 1 -- 172.21.15.146:0/2034997983 shutdown_connections 2023-10-03T10:19:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.832+0000 7f484aaa1700 1 --2- 172.21.15.146:0/2034997983 >> v2:172.21.15.146:3300/0 conn(0x7f4844134120 0x7f484413bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.832+0000 7f484aaa1700 1 --2- 172.21.15.146:0/2034997983 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48440a0a70 0x7f48440a0e40 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.832+0000 7f484aaa1700 1 -- 172.21.15.146:0/2034997983 >> 172.21.15.146:0/2034997983 conn(0x7f48440a6610 msgr2=0x7f48440a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.832+0000 7f484aaa1700 1 -- 172.21.15.146:0/2034997983 shutdown_connections 2023-10-03T10:19:11.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.832+0000 7f484aaa1700 1 -- 172.21.15.146:0/2034997983 wait complete. 2023-10-03T10:19:11.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.833+0000 7f484aaa1700 1 Processor -- start 2023-10-03T10:19:11.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.833+0000 7f484aaa1700 1 -- start start 2023-10-03T10:19:11.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.834+0000 7f484aaa1700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48440a0a70 0x7f4844122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.834+0000 7f484aaa1700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48440a1380 0x7f4844122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.834+0000 7f484aaa1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4844134120 0x7f4844123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.834+0000 7f484aaa1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4844133300 con 0x7f4844134120 2023-10-03T10:19:11.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.834+0000 7f484aaa1700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4844125aa0 con 0x7f48440a0a70 2023-10-03T10:19:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.834+0000 7f484aaa1700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4844133650 con 0x7f48440a1380 2023-10-03T10:19:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.834+0000 7f4843fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48440a1380 0x7f4844122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.834+0000 7f4843fff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48440a1380 0x7f4844122cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35010/0 (socket says 172.21.15.146:35010) 2023-10-03T10:19:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.834+0000 7f4843fff700 1 -- 172.21.15.146:0/2742074452 learned_addr learned my addr 172.21.15.146:0/2742074452 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.834+0000 7f484903e700 1 --2- 172.21.15.146:0/2742074452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4844134120 0x7f4844123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.834+0000 7f4843fff700 1 -- 172.21.15.146:0/2742074452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48440a0a70 msgr2=0x7f4844122790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.834+0000 7f4843fff700 1 --2- 172.21.15.146:0/2742074452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48440a0a70 0x7f4844122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.834+0000 7f4843fff700 1 -- 172.21.15.146:0/2742074452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4844134120 msgr2=0x7f4844123210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.834+0000 7f4843fff700 1 --2- 172.21.15.146:0/2742074452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4844134120 0x7f4844123210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.834+0000 7f4843fff700 1 -- 172.21.15.146:0/2742074452 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483c009a70 con 0x7f48440a1380 2023-10-03T10:19:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.835+0000 7f4843fff700 1 --2- 172.21.15.146:0/2742074452 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48440a1380 0x7f4844122cd0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f4830001eb0 tx=0x7f483000c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.835+0000 7f48417fa700 1 -- 172.21.15.146:0/2742074452 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4830004c80 con 0x7f48440a1380 2023-10-03T10:19:11.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.835+0000 7f48417fa700 1 -- 172.21.15.146:0/2742074452 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4830004de0 con 0x7f48440a1380 2023-10-03T10:19:11.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.835+0000 7f48417fa700 1 -- 172.21.15.146:0/2742074452 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4830007310 con 0x7f48440a1380 2023-10-03T10:19:11.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.835+0000 7f484aaa1700 1 -- 172.21.15.146:0/2742074452 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48380094a0 con 0x7f48440a1380 2023-10-03T10:19:11.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.835+0000 7f484aaa1700 1 -- 172.21.15.146:0/2742074452 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4844125cd0 con 0x7f48440a1380 2023-10-03T10:19:11.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.836+0000 7f48417fa700 1 -- 172.21.15.146:0/2742074452 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4830007470 con 0x7f48440a1380 2023-10-03T10:19:11.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.836+0000 7f48417fa700 1 -- 172.21.15.146:0/2742074452 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f483003f310 con 0x7f48440a1380 2023-10-03T10:19:11.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.836+0000 7f484aaa1700 1 -- 172.21.15.146:0/2742074452 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4844125e60 con 0x7f48440a1380 2023-10-03T10:19:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.841+0000 7f48417fa700 1 -- 172.21.15.146:0/2742074452 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48300123b0 con 0x7f48440a1380 2023-10-03T10:19:11.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.886+0000 7f35d1061700 1 Processor -- start 2023-10-03T10:19:11.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.886+0000 7f35d1061700 1 -- start start 2023-10-03T10:19:11.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.886+0000 7f35d1061700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35cc0a0a70 0x7f35cc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.886+0000 7f35d1061700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35cc0a1380 0x7f35cc133a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.886+0000 7f35d1061700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35cc09dc00 con 0x7f35cc133f50 2023-10-03T10:19:11.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.886+0000 7f35d1061700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35cc09ea60 con 0x7f35cc0a0a70 2023-10-03T10:19:11.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.886+0000 7f35d1061700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc09dec0 con 0x7f35cc0a1380 2023-10-03T10:19:11.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.887+0000 7f35cad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35cc0a0a70 0x7f35cc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.887+0000 7f35cb59e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f35cc133f50 0x7f35cc13acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36726/0 (socket says 172.21.15.146:36726) 2023-10-03T10:19:11.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.887+0000 7f35cad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35cc0a0a70 0x7f35cc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51884/0 (socket says 172.21.15.146:51884) 2023-10-03T10:19:11.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.887+0000 7f35cb59e700 1 -- 172.21.15.146:0/405173249 learned_addr learned my addr 172.21.15.146:0/405173249 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:11.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.887+0000 7f35ca59c700 1 --2- 172.21.15.146:0/405173249 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35cc0a1380 0x7f35cc133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.887+0000 7f35cad9d700 1 -- 172.21.15.146:0/405173249 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35cc0a1380 msgr2=0x7f35cc133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:11.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.887+0000 7f35cad9d700 1 --2- 172.21.15.146:0/405173249 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35cc0a1380 0x7f35cc133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.887+0000 7f35cad9d700 1 -- 172.21.15.146:0/405173249 >> v1:172.21.15.146:6789/0 conn(0x7f35cc133f50 legacy=0x7f35cc13acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.887+0000 7f35cad9d700 1 -- 172.21.15.146:0/405173249 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc09e6a0 con 0x7f35cc0a0a70 2023-10-03T10:19:11.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.887+0000 7f35c9d9b700 1 -- 172.21.15.146:0/405173249 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417087313 0 0) 0x7f35cc09dc00 con 0x7f35cc133f50 2023-10-03T10:19:11.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.887+0000 7f35ca59c700 1 --2- 172.21.15.146:0/405173249 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35cc0a1380 0x7f35cc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:11.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.887+0000 7f35cad9d700 1 --2- 172.21.15.146:0/405173249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35cc0a0a70 0x7f35cc0a0e40 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f35bc009840 tx=0x7f35bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9361413762b96 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.887+0000 7f35c9d9b700 1 -- 172.21.15.146:0/405173249 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc011830 con 0x7f35cc0a0a70 2023-10-03T10:19:11.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.887+0000 7f35c9d9b700 1 -- 172.21.15.146:0/405173249 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35bc011990 con 0x7f35cc0a0a70 2023-10-03T10:19:11.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.887+0000 7f35c9d9b700 1 -- 172.21.15.146:0/405173249 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc011d20 con 0x7f35cc0a0a70 2023-10-03T10:19:11.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.888+0000 7f35d1061700 1 -- 172.21.15.146:0/405173249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35cc0a0a70 msgr2=0x7f35cc0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.888+0000 7f35d1061700 1 --2- 172.21.15.146:0/405173249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35cc0a0a70 0x7f35cc0a0e40 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f35bc009840 tx=0x7f35bc009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:11.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.888+0000 7f35d1061700 1 -- 172.21.15.146:0/405173249 shutdown_connections 2023-10-03T10:19:11.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.888+0000 7f35d1061700 1 --2- 172.21.15.146:0/405173249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35cc0a0a70 0x7f35cc0a0e40 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.888+0000 7f35d1061700 1 --2- 172.21.15.146:0/405173249 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35cc0a1380 0x7f35cc133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.888+0000 7f35d1061700 1 -- 172.21.15.146:0/405173249 >> 172.21.15.146:0/405173249 conn(0x7f35cc0a6610 msgr2=0x7f35cc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.888+0000 7f35d1061700 1 -- 172.21.15.146:0/405173249 shutdown_connections 2023-10-03T10:19:11.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.888+0000 7f35d1061700 1 -- 172.21.15.146:0/405173249 wait complete. 2023-10-03T10:19:11.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.889+0000 7f35d1061700 1 Processor -- start 2023-10-03T10:19:11.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.889+0000 7f35d1061700 1 -- start start 2023-10-03T10:19:11.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.890+0000 7f35d1061700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35cc0a0a70 0x7f35cc122920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.890+0000 7f35d1061700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35cc0a1380 0x7f35cc122e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.890+0000 7f35d1061700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35cc133f50 0x7f35cc1233a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.890+0000 7f35d1061700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc133aa0 con 0x7f35cc0a0a70 2023-10-03T10:19:11.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.890+0000 7f35d1061700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc124560 con 0x7f35cc133f50 2023-10-03T10:19:11.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.890+0000 7f35d1061700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc124c90 con 0x7f35cc0a1380 2023-10-03T10:19:11.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.890+0000 7f35cad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35cc0a0a70 0x7f35cc122920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.890+0000 7f35cad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35cc0a0a70 0x7f35cc122920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51892/0 (socket says 172.21.15.146:51892) 2023-10-03T10:19:11.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.890+0000 7f35cad9d700 1 -- 172.21.15.146:0/3172925310 learned_addr learned my addr 172.21.15.146:0/3172925310 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:11.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.890+0000 7f35ca59c700 1 --2- 172.21.15.146:0/3172925310 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35cc0a1380 0x7f35cc122e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.890+0000 7f35cb59e700 1 --2- 172.21.15.146:0/3172925310 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35cc133f50 0x7f35cc1233a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.890+0000 7f35cad9d700 1 -- 172.21.15.146:0/3172925310 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35cc0a1380 msgr2=0x7f35cc122e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.890+0000 7f35cad9d700 1 --2- 172.21.15.146:0/3172925310 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35cc0a1380 0x7f35cc122e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.890+0000 7f35cad9d700 1 -- 172.21.15.146:0/3172925310 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35cc133f50 msgr2=0x7f35cc1233a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.890+0000 7f35cad9d700 1 --2- 172.21.15.146:0/3172925310 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35cc133f50 0x7f35cc1233a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.890+0000 7f35cad9d700 1 -- 172.21.15.146:0/3172925310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c00094a0 con 0x7f35cc0a0a70 2023-10-03T10:19:11.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.890+0000 7f35cad9d700 1 --2- 172.21.15.146:0/3172925310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35cc0a0a70 0x7f35cc122920 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f35bc009fd0 tx=0x7f35bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.890+0000 7f35b37fe700 1 -- 172.21.15.146:0/3172925310 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc004550 con 0x7f35cc0a0a70 2023-10-03T10:19:11.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.890+0000 7f35b37fe700 1 -- 172.21.15.146:0/3172925310 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35bc01f070 con 0x7f35cc0a0a70 2023-10-03T10:19:11.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.890+0000 7f35b37fe700 1 -- 172.21.15.146:0/3172925310 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc0038e0 con 0x7f35cc0a0a70 2023-10-03T10:19:11.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.890+0000 7f35d1061700 1 -- 172.21.15.146:0/3172925310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35bc0094a0 con 0x7f35cc0a0a70 2023-10-03T10:19:11.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.891+0000 7f35d1061700 1 -- 172.21.15.146:0/3172925310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35cc1260e0 con 0x7f35cc0a0a70 2023-10-03T10:19:11.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.891+0000 7f35d1061700 1 -- 172.21.15.146:0/3172925310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35cc04f2a0 con 0x7f35cc0a0a70 2023-10-03T10:19:11.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.891+0000 7f35b37fe700 1 -- 172.21.15.146:0/3172925310 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f35bc003a40 con 0x7f35cc0a0a70 2023-10-03T10:19:11.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.892+0000 7f35b37fe700 1 -- 172.21.15.146:0/3172925310 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f35bc021070 con 0x7f35cc0a0a70 2023-10-03T10:19:11.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.900+0000 7f35b37fe700 1 -- 172.21.15.146:0/3172925310 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f35bc02f3a0 con 0x7f35cc0a0a70 2023-10-03T10:19:11.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.997+0000 7f8af8aed700 1 -- 172.21.15.146:0/3090813652 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8af404f2a0 con 0x7f8af41309f0 2023-10-03T10:19:11.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.997+0000 7f8ae2ffd700 1 -- 172.21.15.146:0/3090813652 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8ae801bb60 con 0x7f8af41309f0 2023-10-03T10:19:11.997 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:11.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.999+0000 7f8af8aed700 1 -- 172.21.15.146:0/3090813652 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8af41309f0 msgr2=0x7f8af411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.999+0000 7f8af8aed700 1 --2- 172.21.15.146:0/3090813652 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8af41309f0 0x7f8af411df80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800e980 tx=0x7f8ae800ec90 comp rx=0 tx=0).stop 2023-10-03T10:19:11.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.999+0000 7f8af8aed700 1 -- 172.21.15.146:0/3090813652 shutdown_connections 2023-10-03T10:19:12.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.999+0000 7f8af8aed700 1 --2- 172.21.15.146:0/3090813652 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8af4133ad0 0x7f8af411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.999+0000 7f8af8aed700 1 --2- 172.21.15.146:0/3090813652 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8af41300a0 0x7f8af411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.999+0000 7f8af8aed700 1 --2- 172.21.15.146:0/3090813652 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f8af41309f0 0x7f8af411df80 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.999+0000 7f8af8aed700 1 -- 172.21.15.146:0/3090813652 >> 172.21.15.146:0/3090813652 conn(0x7f8af4099c40 msgr2=0x7f8af412f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.999+0000 7f8af8aed700 1 -- 172.21.15.146:0/3090813652 shutdown_connections 2023-10-03T10:19:12.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:11.999+0000 7f8af8aed700 1 -- 172.21.15.146:0/3090813652 wait complete. 2023-10-03T10:19:12.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:19:12.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.037+0000 7f484aaa1700 1 -- 172.21.15.146:0/2742074452 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4844126a70 con 0x7f48440a1380 2023-10-03T10:19:12.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.038+0000 7f48417fa700 1 -- 172.21.15.146:0/2742074452 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4830011360 con 0x7f48440a1380 2023-10-03T10:19:12.037 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:19:12.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.040+0000 7f484aaa1700 1 -- 172.21.15.146:0/2742074452 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48440a1380 msgr2=0x7f4844122cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.040+0000 7f484aaa1700 1 --2- 172.21.15.146:0/2742074452 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48440a1380 0x7f4844122cd0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f4830001eb0 tx=0x7f483000c8b0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.040+0000 7f484aaa1700 1 -- 172.21.15.146:0/2742074452 shutdown_connections 2023-10-03T10:19:12.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.040+0000 7f484aaa1700 1 --2- 172.21.15.146:0/2742074452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4844134120 0x7f4844123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.040+0000 7f484aaa1700 1 --2- 172.21.15.146:0/2742074452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48440a0a70 0x7f4844122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.040+0000 7f484aaa1700 1 --2- 172.21.15.146:0/2742074452 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f48440a1380 0x7f4844122cd0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.040+0000 7f484aaa1700 1 -- 172.21.15.146:0/2742074452 >> 172.21.15.146:0/2742074452 conn(0x7f48440a6610 msgr2=0x7f48440a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.040+0000 7f484aaa1700 1 -- 172.21.15.146:0/2742074452 shutdown_connections 2023-10-03T10:19:12.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.040+0000 7f484aaa1700 1 -- 172.21.15.146:0/2742074452 wait complete. 2023-10-03T10:19:12.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:19:12.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.096+0000 7f35d1061700 1 -- 172.21.15.146:0/3172925310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f35cc072980 con 0x7f35cc0a0a70 2023-10-03T10:19:12.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.096+0000 7f35b37fe700 1 -- 172.21.15.146:0/3172925310 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f35bc02b070 con 0x7f35cc0a0a70 2023-10-03T10:19:12.096 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:19:12.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.098+0000 7f35d1061700 1 -- 172.21.15.146:0/3172925310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35cc0a0a70 msgr2=0x7f35cc122920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.098+0000 7f35d1061700 1 --2- 172.21.15.146:0/3172925310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35cc0a0a70 0x7f35cc122920 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f35bc009fd0 tx=0x7f35bc004750 comp rx=0 tx=0).stop 2023-10-03T10:19:12.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.098+0000 7f35d1061700 1 -- 172.21.15.146:0/3172925310 shutdown_connections 2023-10-03T10:19:12.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.098+0000 7f35d1061700 1 --2- 172.21.15.146:0/3172925310 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35cc133f50 0x7f35cc1233a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.098+0000 7f35d1061700 1 --2- 172.21.15.146:0/3172925310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35cc0a0a70 0x7f35cc122920 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.098+0000 7f35d1061700 1 --2- 172.21.15.146:0/3172925310 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f35cc0a1380 0x7f35cc122e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.098+0000 7f35d1061700 1 -- 172.21.15.146:0/3172925310 >> 172.21.15.146:0/3172925310 conn(0x7f35cc0a6610 msgr2=0x7f35cc09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.098+0000 7f35d1061700 1 -- 172.21.15.146:0/3172925310 shutdown_connections 2023-10-03T10:19:12.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.098+0000 7f35d1061700 1 -- 172.21.15.146:0/3172925310 wait complete. 2023-10-03T10:19:12.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:19:12.503 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:12.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.629+0000 7f50099ee700 1 Processor -- start 2023-10-03T10:19:12.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.629+0000 7f50099ee700 1 -- start start 2023-10-03T10:19:12.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.629+0000 7f50099ee700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50040a1570 0x7f5004138e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.629+0000 7f50099ee700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50041393c0 0x7f500413b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.629+0000 7f50099ee700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50040a1fe0 con 0x7f50040a0a90 2023-10-03T10:19:12.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.629+0000 7f50099ee700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50040a3aa0 con 0x7f50041393c0 2023-10-03T10:19:12.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.629+0000 7f50099ee700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f500409a540 con 0x7f50040a1570 2023-10-03T10:19:12.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.629+0000 7f50037fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50041393c0 0x7f500413b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.629+0000 7f50027fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50040a1570 0x7f5004138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.629+0000 7f50037fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50041393c0 0x7f500413b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:37830/0 (socket says 172.21.15.146:37830) 2023-10-03T10:19:12.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.629+0000 7f50037fe700 1 -- 172.21.15.146:0/2573789624 learned_addr learned my addr 172.21.15.146:0/2573789624 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:12.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.629+0000 7f50027fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50040a1570 0x7f5004138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35032/0 (socket says 172.21.15.146:35032) 2023-10-03T10:19:12.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.630+0000 7f50037fe700 1 -- 172.21.15.146:0/2573789624 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50040a1570 msgr2=0x7f5004138e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:12.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.630+0000 7f50037fe700 1 --2- 172.21.15.146:0/2573789624 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50040a1570 0x7f5004138e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.630+0000 7f50037fe700 1 -- 172.21.15.146:0/2573789624 >> v1:172.21.15.146:6789/0 conn(0x7f50040a0a90 legacy=0x7f50040a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.630+0000 7f50037fe700 1 -- 172.21.15.146:0/2573789624 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500409a280 con 0x7f50041393c0 2023-10-03T10:19:12.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.630+0000 7f5001ffb700 1 -- 172.21.15.146:0/2573789624 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106297447 0 0) 0x7f50040a1fe0 con 0x7f50040a0a90 2023-10-03T10:19:12.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.630+0000 7f50037fe700 1 --2- 172.21.15.146:0/2573789624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50041393c0 0x7f500413b7a0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009eb0 tx=0x7f4ffc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf18e9109c7a3530 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.630+0000 7f5001ffb700 1 -- 172.21.15.146:0/2573789624 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc00e070 con 0x7f50041393c0 2023-10-03T10:19:12.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.630+0000 7f5001ffb700 1 -- 172.21.15.146:0/2573789624 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc00b8d0 con 0x7f50041393c0 2023-10-03T10:19:12.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.630+0000 7f5001ffb700 1 -- 172.21.15.146:0/2573789624 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc00bc80 con 0x7f50041393c0 2023-10-03T10:19:12.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.630+0000 7f50099ee700 1 -- 172.21.15.146:0/2573789624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50041393c0 msgr2=0x7f500413b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.631+0000 7f50099ee700 1 --2- 172.21.15.146:0/2573789624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50041393c0 0x7f500413b7a0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009eb0 tx=0x7f4ffc00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:12.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.631+0000 7f50099ee700 1 -- 172.21.15.146:0/2573789624 shutdown_connections 2023-10-03T10:19:12.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.631+0000 7f50099ee700 1 --2- 172.21.15.146:0/2573789624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50041393c0 0x7f500413b7a0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.631+0000 7f50099ee700 1 --2- 172.21.15.146:0/2573789624 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50040a1570 0x7f5004138e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.631+0000 7f50099ee700 1 -- 172.21.15.146:0/2573789624 >> 172.21.15.146:0/2573789624 conn(0x7f5004099c40 msgr2=0x7f500406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.631+0000 7f50099ee700 1 -- 172.21.15.146:0/2573789624 shutdown_connections 2023-10-03T10:19:12.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.631+0000 7f50099ee700 1 -- 172.21.15.146:0/2573789624 wait complete. 2023-10-03T10:19:12.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.631+0000 7f50099ee700 1 Processor -- start 2023-10-03T10:19:12.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.632+0000 7f50099ee700 1 -- start start 2023-10-03T10:19:12.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.632+0000 7f50099ee700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50040a0a90 0x7f50041206a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.632+0000 7f50099ee700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50040a1570 0x7f5004120be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.632+0000 7f50099ee700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50041393c0 0x7f5004121120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.632+0000 7f50099ee700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50041239c0 con 0x7f50040a1570 2023-10-03T10:19:12.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.632+0000 7f50099ee700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5004123ee0 con 0x7f50041393c0 2023-10-03T10:19:12.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.632+0000 7f50099ee700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50040a6b00 con 0x7f50040a0a90 2023-10-03T10:19:12.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.632+0000 7f5002ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50040a0a90 0x7f50041206a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.632+0000 7f50027fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50040a1570 0x7f5004120be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.632+0000 7f5002ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50040a0a90 0x7f50041206a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35044/0 (socket says 172.21.15.146:35044) 2023-10-03T10:19:12.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.632+0000 7f5002ffd700 1 -- 172.21.15.146:0/3898791295 learned_addr learned my addr 172.21.15.146:0/3898791295 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:12.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.632+0000 7f50037fe700 1 --2- 172.21.15.146:0/3898791295 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50041393c0 0x7f5004121120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.633+0000 7f5002ffd700 1 -- 172.21.15.146:0/3898791295 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50041393c0 msgr2=0x7f5004121120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.633+0000 7f5002ffd700 1 --2- 172.21.15.146:0/3898791295 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50041393c0 0x7f5004121120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.633+0000 7f5002ffd700 1 -- 172.21.15.146:0/3898791295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50040a1570 msgr2=0x7f5004120be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.633+0000 7f5002ffd700 1 --2- 172.21.15.146:0/3898791295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50040a1570 0x7f5004120be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.633+0000 7f5002ffd700 1 -- 172.21.15.146:0/3898791295 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc009b30 con 0x7f50040a0a90 2023-10-03T10:19:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.633+0000 7f50037fe700 1 --2- 172.21.15.146:0/3898791295 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50041393c0 0x7f5004121120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.633+0000 7f5002ffd700 1 --2- 172.21.15.146:0/3898791295 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50040a0a90 0x7f50041206a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4001eb0 tx=0x7f4ff400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.633+0000 7f4febfff700 1 -- 172.21.15.146:0/3898791295 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff40054e0 con 0x7f50040a0a90 2023-10-03T10:19:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.633+0000 7f4febfff700 1 -- 172.21.15.146:0/3898791295 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff4003680 con 0x7f50040a0a90 2023-10-03T10:19:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.633+0000 7f50099ee700 1 -- 172.21.15.146:0/3898791295 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500409b130 con 0x7f50040a0a90 2023-10-03T10:19:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.633+0000 7f4febfff700 1 -- 172.21.15.146:0/3898791295 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff40039f0 con 0x7f50040a0a90 2023-10-03T10:19:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.633+0000 7f50099ee700 1 -- 172.21.15.146:0/3898791295 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5004122aa0 con 0x7f50040a0a90 2023-10-03T10:19:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.634+0000 7f4febfff700 1 -- 172.21.15.146:0/3898791295 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ff4003b50 con 0x7f50040a0a90 2023-10-03T10:19:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.634+0000 7f50099ee700 1 -- 172.21.15.146:0/3898791295 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5004124a10 con 0x7f50040a0a90 2023-10-03T10:19:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.634+0000 7f4febfff700 1 -- 172.21.15.146:0/3898791295 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f4ff403ead0 con 0x7f50040a0a90 2023-10-03T10:19:12.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.638+0000 7f4febfff700 1 -- 172.21.15.146:0/3898791295 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ff401b3b0 con 0x7f50040a0a90 2023-10-03T10:19:12.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.823+0000 7f50099ee700 1 -- 172.21.15.146:0/3898791295 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f500404f2a0 con 0x7f50040a0a90 2023-10-03T10:19:12.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.823+0000 7f4febfff700 1 -- 172.21.15.146:0/3898791295 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4ff4017030 con 0x7f50040a0a90 2023-10-03T10:19:12.823 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:12.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.825+0000 7f50099ee700 1 -- 172.21.15.146:0/3898791295 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50040a0a90 msgr2=0x7f50041206a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.825+0000 7f50099ee700 1 --2- 172.21.15.146:0/3898791295 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50040a0a90 0x7f50041206a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4001eb0 tx=0x7f4ff400c800 comp rx=0 tx=0).stop 2023-10-03T10:19:12.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.825+0000 7f50099ee700 1 -- 172.21.15.146:0/3898791295 shutdown_connections 2023-10-03T10:19:12.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.825+0000 7f50099ee700 1 --2- 172.21.15.146:0/3898791295 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50041393c0 0x7f5004121120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.825+0000 7f50099ee700 1 --2- 172.21.15.146:0/3898791295 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f50040a0a90 0x7f50041206a0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.825+0000 7f50099ee700 1 --2- 172.21.15.146:0/3898791295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50040a1570 0x7f5004120be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.825+0000 7f50099ee700 1 -- 172.21.15.146:0/3898791295 >> 172.21.15.146:0/3898791295 conn(0x7f5004099c40 msgr2=0x7f5004136ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.825+0000 7f50099ee700 1 -- 172.21.15.146:0/3898791295 shutdown_connections 2023-10-03T10:19:12.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:12.825+0000 7f50099ee700 1 -- 172.21.15.146:0/3898791295 wait complete. 2023-10-03T10:19:12.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:19:13.012 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:13.052 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:13.110 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:13.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.145+0000 7f6c4d87c700 1 Processor -- start 2023-10-03T10:19:13.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.145+0000 7f6c4d87c700 1 -- start start 2023-10-03T10:19:13.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.145+0000 7f6c4d87c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c48133660 0x7f6c48135a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.145+0000 7f6c4d87c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6c48135f80 0x7f6c48138360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.145+0000 7f6c4d87c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c48099a60 con 0x7f6c48099e20 2023-10-03T10:19:13.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.145+0000 7f6c4d87c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4809bf50 con 0x7f6c48135f80 2023-10-03T10:19:13.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.145+0000 7f6c4d87c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4809b230 con 0x7f6c48133660 2023-10-03T10:19:13.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.145+0000 7f6c467fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c48133660 0x7f6c48135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.145+0000 7f6c467fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c48133660 0x7f6c48135a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35056/0 (socket says 172.21.15.146:35056) 2023-10-03T10:19:13.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.145+0000 7f6c467fc700 1 -- 172.21.15.146:0/1021928108 learned_addr learned my addr 172.21.15.146:0/1021928108 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:13.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.145+0000 7f6c477fe700 1 --2- 172.21.15.146:0/1021928108 >> v2:172.21.15.146:3300/0 conn(0x7f6c48135f80 0x7f6c48138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.146+0000 7f6c477fe700 1 -- 172.21.15.146:0/1021928108 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c48133660 msgr2=0x7f6c48135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:13.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.146+0000 7f6c477fe700 1 --2- 172.21.15.146:0/1021928108 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c48133660 0x7f6c48135a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.146+0000 7f6c477fe700 1 -- 172.21.15.146:0/1021928108 >> v1:172.21.15.146:6789/0 conn(0x7f6c48099e20 legacy=0x7f6c4809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.146+0000 7f6c477fe700 1 -- 172.21.15.146:0/1021928108 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4809bb90 con 0x7f6c48135f80 2023-10-03T10:19:13.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.146+0000 7f6c45ffb700 1 -- 172.21.15.146:0/1021928108 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44593219 0 0) 0x7f6c48099a60 con 0x7f6c48099e20 2023-10-03T10:19:13.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.146+0000 7f6c467fc700 1 --2- 172.21.15.146:0/1021928108 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c48133660 0x7f6c48135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:13.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.146+0000 7f6c477fe700 1 --2- 172.21.15.146:0/1021928108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c48135f80 0x7f6c48138360 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009d90 tx=0x7f6c4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe02a2d2c618e0ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:13.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.146+0000 7f6c45ffb700 1 -- 172.21.15.146:0/1021928108 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4000e070 con 0x7f6c48135f80 2023-10-03T10:19:13.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.146+0000 7f6c45ffb700 1 -- 172.21.15.146:0/1021928108 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4000bb20 con 0x7f6c48135f80 2023-10-03T10:19:13.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.146+0000 7f6c45ffb700 1 -- 172.21.15.146:0/1021928108 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c40012430 con 0x7f6c48135f80 2023-10-03T10:19:13.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.147+0000 7f6c4d87c700 1 -- 172.21.15.146:0/1021928108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c48135f80 msgr2=0x7f6c48138360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.147+0000 7f6c4d87c700 1 --2- 172.21.15.146:0/1021928108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c48135f80 0x7f6c48138360 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009d90 tx=0x7f6c4000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:13.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.147+0000 7f6c4d87c700 1 -- 172.21.15.146:0/1021928108 shutdown_connections 2023-10-03T10:19:13.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.147+0000 7f6c4d87c700 1 --2- 172.21.15.146:0/1021928108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c48135f80 0x7f6c48138360 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.147+0000 7f6c4d87c700 1 --2- 172.21.15.146:0/1021928108 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c48133660 0x7f6c48135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.147+0000 7f6c4d87c700 1 -- 172.21.15.146:0/1021928108 >> 172.21.15.146:0/1021928108 conn(0x7f6c480a2980 msgr2=0x7f6c480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:13.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.147+0000 7f6c4d87c700 1 -- 172.21.15.146:0/1021928108 shutdown_connections 2023-10-03T10:19:13.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.147+0000 7f6c4d87c700 1 -- 172.21.15.146:0/1021928108 wait complete. 2023-10-03T10:19:13.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.148+0000 7f6c4d87c700 1 Processor -- start 2023-10-03T10:19:13.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.148+0000 7f6c4d87c700 1 -- start start 2023-10-03T10:19:13.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.148+0000 7f6c4d87c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c48099e20 0x7f6c4806ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.148+0000 7f6c4d87c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c48133660 0x7f6c480704c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.148+0000 7f6c4d87c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c48135f80 0x7f6c48070a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.148+0000 7f6c4d87c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c48119ae0 con 0x7f6c48135f80 2023-10-03T10:19:13.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.148+0000 7f6c4d87c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4811a730 con 0x7f6c48133660 2023-10-03T10:19:13.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.148+0000 7f6c4d87c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c48133a30 con 0x7f6c48099e20 2023-10-03T10:19:13.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.149+0000 7f6c467fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c48133660 0x7f6c480704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.149+0000 7f6c467fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c48133660 0x7f6c480704c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:37858/0 (socket says 172.21.15.146:37858) 2023-10-03T10:19:13.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.149+0000 7f6c467fc700 1 -- 172.21.15.146:0/4281743456 learned_addr learned my addr 172.21.15.146:0/4281743456 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:13.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.149+0000 7f6c46ffd700 1 --2- 172.21.15.146:0/4281743456 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c48099e20 0x7f6c4806ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.149+0000 7f6c477fe700 1 --2- 172.21.15.146:0/4281743456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c48135f80 0x7f6c48070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.149+0000 7f6c477fe700 1 -- 172.21.15.146:0/4281743456 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c48099e20 msgr2=0x7f6c4806ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.149+0000 7f6c477fe700 1 --2- 172.21.15.146:0/4281743456 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c48099e20 0x7f6c4806ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.149+0000 7f6c477fe700 1 -- 172.21.15.146:0/4281743456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c48133660 msgr2=0x7f6c480704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.149+0000 7f6c477fe700 1 --2- 172.21.15.146:0/4281743456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c48133660 0x7f6c480704c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.149+0000 7f6c477fe700 1 -- 172.21.15.146:0/4281743456 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3c00b7f0 con 0x7f6c48135f80 2023-10-03T10:19:13.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.149+0000 7f6c467fc700 1 --2- 172.21.15.146:0/4281743456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c48133660 0x7f6c480704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:13.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.149+0000 7f6c46ffd700 1 --2- 172.21.15.146:0/4281743456 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c48099e20 0x7f6c4806ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:13.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.149+0000 7f6c477fe700 1 --2- 172.21.15.146:0/4281743456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c48135f80 0x7f6c48070a00 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009d90 tx=0x7f6c40004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:13.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.149+0000 7f6c2ffff700 1 -- 172.21.15.146:0/4281743456 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c40012430 con 0x7f6c48135f80 2023-10-03T10:19:13.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.149+0000 7f6c2ffff700 1 -- 172.21.15.146:0/4281743456 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c40020070 con 0x7f6c48135f80 2023-10-03T10:19:13.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.149+0000 7f6c2ffff700 1 -- 172.21.15.146:0/4281743456 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4001bc80 con 0x7f6c48135f80 2023-10-03T10:19:13.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.149+0000 7f6c4d87c700 1 -- 172.21.15.146:0/4281743456 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c40009a70 con 0x7f6c48135f80 2023-10-03T10:19:13.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.149+0000 7f6c4d87c700 1 -- 172.21.15.146:0/4281743456 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4811a450 con 0x7f6c48135f80 2023-10-03T10:19:13.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.150+0000 7f6c2ffff700 1 -- 172.21.15.146:0/4281743456 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c4001c400 con 0x7f6c48135f80 2023-10-03T10:19:13.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.150+0000 7f6c2ffff700 1 -- 172.21.15.146:0/4281743456 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f6c40041120 con 0x7f6c48135f80 2023-10-03T10:19:13.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.151+0000 7f6c4d87c700 1 -- 172.21.15.146:0/4281743456 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c48072480 con 0x7f6c48135f80 2023-10-03T10:19:13.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.155+0000 7f6c2ffff700 1 -- 172.21.15.146:0/4281743456 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c48072480 con 0x7f6c48135f80 2023-10-03T10:19:13.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.187+0000 7f261f7ba700 1 Processor -- start 2023-10-03T10:19:13.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.187+0000 7f261f7ba700 1 -- start start 2023-10-03T10:19:13.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.187+0000 7f261f7ba700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2618099e20 0x7f261809a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.187+0000 7f261f7ba700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2618130a60 0x7f2618138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.187+0000 7f261f7ba700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2618099a60 con 0x7f261809a730 2023-10-03T10:19:13.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.187+0000 7f261f7ba700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261809bf50 con 0x7f2618130a60 2023-10-03T10:19:13.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.187+0000 7f261f7ba700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261809b230 con 0x7f2618099e20 2023-10-03T10:19:13.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.187+0000 7f261d556700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2618099e20 0x7f261809a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.187+0000 7f261d556700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2618099e20 0x7f261809a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:37866/0 (socket says 172.21.15.146:37866) 2023-10-03T10:19:13.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.187+0000 7f261d556700 1 -- 172.21.15.146:0/4183271437 learned_addr learned my addr 172.21.15.146:0/4183271437 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:13.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.187+0000 7f261dd57700 1 --2- 172.21.15.146:0/4183271437 >> v2:172.21.15.146:3300/0 conn(0x7f2618130a60 0x7f2618138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.188+0000 7f261dd57700 1 -- 172.21.15.146:0/4183271437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2618099e20 msgr2=0x7f261809a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:13.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.188+0000 7f261dd57700 1 --2- 172.21.15.146:0/4183271437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2618099e20 0x7f261809a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.188+0000 7f261dd57700 1 -- 172.21.15.146:0/4183271437 >> v1:172.21.15.146:6789/0 conn(0x7f261809a730 legacy=0x7f2618130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.188+0000 7f261dd57700 1 -- 172.21.15.146:0/4183271437 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261809bb90 con 0x7f2618130a60 2023-10-03T10:19:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.188+0000 7f261d556700 1 --2- 172.21.15.146:0/4183271437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2618099e20 0x7f261809a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.188+0000 7f261dd57700 1 --2- 172.21.15.146:0/4183271437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2618130a60 0x7f2618138690 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f2610009d90 tx=0x7f261000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48414a96cc0be3b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.188+0000 7f260ffff700 1 -- 172.21.15.146:0/4183271437 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261000e070 con 0x7f2618130a60 2023-10-03T10:19:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.188+0000 7f260ffff700 1 -- 172.21.15.146:0/4183271437 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261000bb20 con 0x7f2618130a60 2023-10-03T10:19:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.188+0000 7f260ffff700 1 -- 172.21.15.146:0/4183271437 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2610012430 con 0x7f2618130a60 2023-10-03T10:19:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.189+0000 7f261f7ba700 1 -- 172.21.15.146:0/4183271437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2618130a60 msgr2=0x7f2618138690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.189+0000 7f261f7ba700 1 --2- 172.21.15.146:0/4183271437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2618130a60 0x7f2618138690 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f2610009d90 tx=0x7f261000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.189+0000 7f261f7ba700 1 -- 172.21.15.146:0/4183271437 shutdown_connections 2023-10-03T10:19:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.189+0000 7f261f7ba700 1 --2- 172.21.15.146:0/4183271437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2618130a60 0x7f2618138690 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.189+0000 7f261f7ba700 1 --2- 172.21.15.146:0/4183271437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2618099e20 0x7f261809a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.189+0000 7f261f7ba700 1 -- 172.21.15.146:0/4183271437 >> 172.21.15.146:0/4183271437 conn(0x7f26180a2980 msgr2=0x7f26180a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.189+0000 7f261f7ba700 1 -- 172.21.15.146:0/4183271437 shutdown_connections 2023-10-03T10:19:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.189+0000 7f261f7ba700 1 -- 172.21.15.146:0/4183271437 wait complete. 2023-10-03T10:19:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.190+0000 7f261f7ba700 1 Processor -- start 2023-10-03T10:19:13.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.190+0000 7f261f7ba700 1 -- start start 2023-10-03T10:19:13.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.190+0000 7f261f7ba700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2618099e20 0x7f261811b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.190+0000 7f261f7ba700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f261809a730 0x7f261811be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.190+0000 7f261f7ba700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2618130a60 0x7f261811c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.190+0000 7f261f7ba700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261811f3f0 con 0x7f261809a730 2023-10-03T10:19:13.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.190+0000 7f261f7ba700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261811db00 con 0x7f2618130a60 2023-10-03T10:19:13.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.190+0000 7f261f7ba700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f261811e7c0 con 0x7f2618099e20 2023-10-03T10:19:13.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.190+0000 7f261cd55700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f261809a730 0x7f261811be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.190+0000 7f261cd55700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f261809a730 0x7f261811be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51932/0 (socket says 172.21.15.146:51932) 2023-10-03T10:19:13.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.190+0000 7f261cd55700 1 -- 172.21.15.146:0/1491271472 learned_addr learned my addr 172.21.15.146:0/1491271472 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:13.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.190+0000 7f261dd57700 1 --2- 172.21.15.146:0/1491271472 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2618130a60 0x7f261811c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.190+0000 7f261d556700 1 --2- 172.21.15.146:0/1491271472 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2618099e20 0x7f261811b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.191+0000 7f261dd57700 1 -- 172.21.15.146:0/1491271472 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2618099e20 msgr2=0x7f261811b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.191+0000 7f261dd57700 1 --2- 172.21.15.146:0/1491271472 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2618099e20 0x7f261811b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.191+0000 7f261dd57700 1 -- 172.21.15.146:0/1491271472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f261809a730 msgr2=0x7f261811be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.191+0000 7f261dd57700 1 --2- 172.21.15.146:0/1491271472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f261809a730 0x7f261811be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.191+0000 7f261dd57700 1 -- 172.21.15.146:0/1491271472 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2614011da0 con 0x7f2618130a60 2023-10-03T10:19:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.191+0000 7f261d556700 1 --2- 172.21.15.146:0/1491271472 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2618099e20 0x7f261811b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.191+0000 7f261cd55700 1 --2- 172.21.15.146:0/1491271472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f261809a730 0x7f261811be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.191+0000 7f261dd57700 1 --2- 172.21.15.146:0/1491271472 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2618130a60 0x7f261811c350 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f2610016000 tx=0x7f2610004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.191+0000 7f260dffb700 1 -- 172.21.15.146:0/1491271472 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2610012430 con 0x7f2618130a60 2023-10-03T10:19:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.191+0000 7f260dffb700 1 -- 172.21.15.146:0/1491271472 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2610020070 con 0x7f2618130a60 2023-10-03T10:19:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.191+0000 7f261f7ba700 1 -- 172.21.15.146:0/1491271472 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2610009a70 con 0x7f2618130a60 2023-10-03T10:19:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.191+0000 7f260dffb700 1 -- 172.21.15.146:0/1491271472 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2610004280 con 0x7f2618130a60 2023-10-03T10:19:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.191+0000 7f261f7ba700 1 -- 172.21.15.146:0/1491271472 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261811ebd0 con 0x7f2618130a60 2023-10-03T10:19:13.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.192+0000 7f261f7ba700 1 -- 172.21.15.146:0/1491271472 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2618072480 con 0x7f2618130a60 2023-10-03T10:19:13.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.192+0000 7f260dffb700 1 -- 172.21.15.146:0/1491271472 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f26100043e0 con 0x7f2618130a60 2023-10-03T10:19:13.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.192+0000 7f260dffb700 1 -- 172.21.15.146:0/1491271472 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f2610022070 con 0x7f2618130a60 2023-10-03T10:19:13.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.201+0000 7f260dffb700 1 -- 172.21.15.146:0/1491271472 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2618072480 con 0x7f2618130a60 2023-10-03T10:19:13.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.241+0000 7f3754f0f700 1 Processor -- start 2023-10-03T10:19:13.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.241+0000 7f3754f0f700 1 -- start start 2023-10-03T10:19:13.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.241+0000 7f3754f0f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37500a0a70 0x7f37500a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.241+0000 7f3754f0f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3750134120 0x7f375013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.241+0000 7f3754f0f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375009dc00 con 0x7f37500a1380 2023-10-03T10:19:13.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.241+0000 7f3754f0f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375009ea90 con 0x7f37500a0a70 2023-10-03T10:19:13.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.241+0000 7f3754f0f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f375009dec0 con 0x7f3750134120 2023-10-03T10:19:13.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.241+0000 7f374dd9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f37500a1380 0x7f3750133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36750/0 (socket says 172.21.15.146:36750) 2023-10-03T10:19:13.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.241+0000 7f374e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37500a0a70 0x7f37500a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.241+0000 7f374dd9b700 1 -- 172.21.15.146:0/4102659476 learned_addr learned my addr 172.21.15.146:0/4102659476 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:13.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.242+0000 7f374ed9d700 1 --2- 172.21.15.146:0/4102659476 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3750134120 0x7f375013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.242+0000 7f374d59a700 1 -- 172.21.15.146:0/4102659476 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129473477 0 0) 0x7f375009dc00 con 0x7f37500a1380 2023-10-03T10:19:13.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.242+0000 7f374e59c700 1 -- 172.21.15.146:0/4102659476 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3750134120 msgr2=0x7f375013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:13.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.242+0000 7f374e59c700 1 --2- 172.21.15.146:0/4102659476 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3750134120 0x7f375013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.242+0000 7f374e59c700 1 -- 172.21.15.146:0/4102659476 >> v1:172.21.15.146:6789/0 conn(0x7f37500a1380 legacy=0x7f3750133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.242+0000 7f374e59c700 1 -- 172.21.15.146:0/4102659476 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375009e6a0 con 0x7f37500a0a70 2023-10-03T10:19:13.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.242+0000 7f374e59c700 1 --2- 172.21.15.146:0/4102659476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37500a0a70 0x7f37500a0e40 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f3740009870 tx=0x7f3740009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4740cfc8c34c35f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:13.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.242+0000 7f374d59a700 1 -- 172.21.15.146:0/4102659476 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740011830 con 0x7f37500a0a70 2023-10-03T10:19:13.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.242+0000 7f374d59a700 1 -- 172.21.15.146:0/4102659476 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3740011990 con 0x7f37500a0a70 2023-10-03T10:19:13.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.242+0000 7f374d59a700 1 -- 172.21.15.146:0/4102659476 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740011d20 con 0x7f37500a0a70 2023-10-03T10:19:13.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.243+0000 7f3754f0f700 1 -- 172.21.15.146:0/4102659476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37500a0a70 msgr2=0x7f37500a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.243+0000 7f3754f0f700 1 --2- 172.21.15.146:0/4102659476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37500a0a70 0x7f37500a0e40 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f3740009870 tx=0x7f3740009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:13.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.243+0000 7f3754f0f700 1 -- 172.21.15.146:0/4102659476 shutdown_connections 2023-10-03T10:19:13.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.243+0000 7f3754f0f700 1 --2- 172.21.15.146:0/4102659476 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f3750134120 0x7f375013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.243+0000 7f3754f0f700 1 --2- 172.21.15.146:0/4102659476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37500a0a70 0x7f37500a0e40 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.243+0000 7f3754f0f700 1 -- 172.21.15.146:0/4102659476 >> 172.21.15.146:0/4102659476 conn(0x7f37500a6610 msgr2=0x7f37500a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:13.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.243+0000 7f3754f0f700 1 -- 172.21.15.146:0/4102659476 shutdown_connections 2023-10-03T10:19:13.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.243+0000 7f3754f0f700 1 -- 172.21.15.146:0/4102659476 wait complete. 2023-10-03T10:19:13.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.244+0000 7f3754f0f700 1 Processor -- start 2023-10-03T10:19:13.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.244+0000 7f3754f0f700 1 -- start start 2023-10-03T10:19:13.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.244+0000 7f3754f0f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37500a0a70 0x7f3750122760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.244+0000 7f3754f0f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37500a1380 0x7f3750122ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.244+0000 7f3754f0f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3750134120 0x7f37501231e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.244+0000 7f3754f0f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3750133360 con 0x7f3750134120 2023-10-03T10:19:13.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.244+0000 7f3754f0f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37501259d0 con 0x7f37500a0a70 2023-10-03T10:19:13.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.244+0000 7f3754f0f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3750124370 con 0x7f37500a1380 2023-10-03T10:19:13.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.244+0000 7f374dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37500a1380 0x7f3750122ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.244+0000 7f374dd9b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37500a1380 0x7f3750122ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35080/0 (socket says 172.21.15.146:35080) 2023-10-03T10:19:13.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.244+0000 7f374dd9b700 1 -- 172.21.15.146:0/2474378607 learned_addr learned my addr 172.21.15.146:0/2474378607 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.244+0000 7f374e59c700 1 --2- 172.21.15.146:0/2474378607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37500a0a70 0x7f3750122760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.244+0000 7f374ed9d700 1 --2- 172.21.15.146:0/2474378607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3750134120 0x7f37501231e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.245+0000 7f374dd9b700 1 -- 172.21.15.146:0/2474378607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37500a0a70 msgr2=0x7f3750122760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.245+0000 7f374dd9b700 1 --2- 172.21.15.146:0/2474378607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37500a0a70 0x7f3750122760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.245+0000 7f374dd9b700 1 -- 172.21.15.146:0/2474378607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3750134120 msgr2=0x7f37501231e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.245+0000 7f374dd9b700 1 --2- 172.21.15.146:0/2474378607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3750134120 0x7f37501231e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.245+0000 7f374dd9b700 1 -- 172.21.15.146:0/2474378607 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37400094a0 con 0x7f37500a1380 2023-10-03T10:19:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.245+0000 7f374dd9b700 1 --2- 172.21.15.146:0/2474378607 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37500a1380 0x7f3750122ca0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f374400c520 tx=0x7f374400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.245+0000 7f373effd700 1 -- 172.21.15.146:0/2474378607 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3744004c80 con 0x7f37500a1380 2023-10-03T10:19:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.245+0000 7f373effd700 1 -- 172.21.15.146:0/2474378607 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3744004de0 con 0x7f37500a1380 2023-10-03T10:19:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.245+0000 7f3754f0f700 1 -- 172.21.15.146:0/2474378607 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375009cb50 con 0x7f37500a1380 2023-10-03T10:19:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.245+0000 7f373effd700 1 -- 172.21.15.146:0/2474378607 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3744007310 con 0x7f37500a1380 2023-10-03T10:19:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.245+0000 7f3754f0f700 1 -- 172.21.15.146:0/2474378607 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37500a03e0 con 0x7f37500a1380 2023-10-03T10:19:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.246+0000 7f373effd700 1 -- 172.21.15.146:0/2474378607 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3744007470 con 0x7f37500a1380 2023-10-03T10:19:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.246+0000 7f3754f0f700 1 -- 172.21.15.146:0/2474378607 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37501336b0 con 0x7f37500a1380 2023-10-03T10:19:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.246+0000 7f373effd700 1 -- 172.21.15.146:0/2474378607 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f374403f220 con 0x7f37500a1380 2023-10-03T10:19:13.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.255+0000 7f373effd700 1 -- 172.21.15.146:0/2474378607 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f37440133c0 con 0x7f37500a1380 2023-10-03T10:19:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.358+0000 7f6c4d87c700 1 -- 172.21.15.146:0/4281743456 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6c48072480 con 0x7f6c48135f80 2023-10-03T10:19:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.358+0000 7f6c2ffff700 1 -- 172.21.15.146:0/4281743456 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6c48072480 con 0x7f6c48135f80 2023-10-03T10:19:13.358 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.360+0000 7f6c4d87c700 1 -- 172.21.15.146:0/4281743456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c48135f80 msgr2=0x7f6c48070a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.360+0000 7f6c4d87c700 1 --2- 172.21.15.146:0/4281743456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c48135f80 0x7f6c48070a00 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009d90 tx=0x7f6c40004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.360+0000 7f6c4d87c700 1 -- 172.21.15.146:0/4281743456 shutdown_connections 2023-10-03T10:19:13.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.360+0000 7f6c4d87c700 1 --2- 172.21.15.146:0/4281743456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c48135f80 0x7f6c48070a00 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.360+0000 7f6c4d87c700 1 --2- 172.21.15.146:0/4281743456 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f6c48099e20 0x7f6c4806ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.360+0000 7f6c4d87c700 1 --2- 172.21.15.146:0/4281743456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c48133660 0x7f6c480704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.360+0000 7f6c4d87c700 1 -- 172.21.15.146:0/4281743456 >> 172.21.15.146:0/4281743456 conn(0x7f6c480a2980 msgr2=0x7f6c481324e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:13.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.361+0000 7f6c4d87c700 1 -- 172.21.15.146:0/4281743456 shutdown_connections 2023-10-03T10:19:13.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.361+0000 7f6c4d87c700 1 -- 172.21.15.146:0/4281743456 wait complete. 2023-10-03T10:19:13.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:19:13.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.400+0000 7f261f7ba700 1 -- 172.21.15.146:0/1491271472 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2618072480 con 0x7f2618130a60 2023-10-03T10:19:13.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.400+0000 7f260dffb700 1 -- 172.21.15.146:0/1491271472 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2618072480 con 0x7f2618130a60 2023-10-03T10:19:13.400 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:19:13.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.402+0000 7f261f7ba700 1 -- 172.21.15.146:0/1491271472 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2618130a60 msgr2=0x7f261811c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.402+0000 7f261f7ba700 1 --2- 172.21.15.146:0/1491271472 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2618130a60 0x7f261811c350 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f2610016000 tx=0x7f2610004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.402+0000 7f261f7ba700 1 -- 172.21.15.146:0/1491271472 shutdown_connections 2023-10-03T10:19:13.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.402+0000 7f261f7ba700 1 --2- 172.21.15.146:0/1491271472 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2618130a60 0x7f261811c350 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.402+0000 7f261f7ba700 1 --2- 172.21.15.146:0/1491271472 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2618099e20 0x7f261811b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.402+0000 7f261f7ba700 1 --2- 172.21.15.146:0/1491271472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f261809a730 0x7f261811be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.402+0000 7f261f7ba700 1 -- 172.21.15.146:0/1491271472 >> 172.21.15.146:0/1491271472 conn(0x7f26180a2980 msgr2=0x7f261809e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:13.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.403+0000 7f261f7ba700 1 -- 172.21.15.146:0/1491271472 shutdown_connections 2023-10-03T10:19:13.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.403+0000 7f261f7ba700 1 -- 172.21.15.146:0/1491271472 wait complete. 2023-10-03T10:19:13.414 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:19:13.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.450+0000 7f3754f0f700 1 -- 172.21.15.146:0/2474378607 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f375004f2a0 con 0x7f37500a1380 2023-10-03T10:19:13.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.450+0000 7f373effd700 1 -- 172.21.15.146:0/2474378607 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f37440102c0 con 0x7f37500a1380 2023-10-03T10:19:13.450 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:19:13.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.452+0000 7f3754f0f700 1 -- 172.21.15.146:0/2474378607 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37500a1380 msgr2=0x7f3750122ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.452+0000 7f3754f0f700 1 --2- 172.21.15.146:0/2474378607 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37500a1380 0x7f3750122ca0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f374400c520 tx=0x7f374400c830 comp rx=0 tx=0).stop 2023-10-03T10:19:13.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.452+0000 7f3754f0f700 1 -- 172.21.15.146:0/2474378607 shutdown_connections 2023-10-03T10:19:13.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.452+0000 7f3754f0f700 1 --2- 172.21.15.146:0/2474378607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3750134120 0x7f37501231e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.452+0000 7f3754f0f700 1 --2- 172.21.15.146:0/2474378607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f37500a0a70 0x7f3750122760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.452+0000 7f3754f0f700 1 --2- 172.21.15.146:0/2474378607 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f37500a1380 0x7f3750122ca0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.452+0000 7f3754f0f700 1 -- 172.21.15.146:0/2474378607 >> 172.21.15.146:0/2474378607 conn(0x7f37500a6610 msgr2=0x7f375009a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:13.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.452+0000 7f3754f0f700 1 -- 172.21.15.146:0/2474378607 shutdown_connections 2023-10-03T10:19:13.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.452+0000 7f3754f0f700 1 -- 172.21.15.146:0/2474378607 wait complete. 2023-10-03T10:19:13.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:19:13.837 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:13.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.962+0000 7f167203f700 1 Processor -- start 2023-10-03T10:19:13.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.962+0000 7f167203f700 1 -- start start 2023-10-03T10:19:13.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.962+0000 7f167203f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f166c136960 0x7f166c138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.962+0000 7f167203f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f166c139280 0x7f166c13b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.962+0000 7f167203f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f166c06b2d0 con 0x7f166c133ad0 2023-10-03T10:19:13.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.962+0000 7f167203f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f166c1345b0 con 0x7f166c136960 2023-10-03T10:19:13.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.962+0000 7f167203f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f166c133610 con 0x7f166c139280 2023-10-03T10:19:13.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.962+0000 7f166affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f166c136960 0x7f166c138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.962+0000 7f166bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f166c139280 0x7f166c13b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.962+0000 7f166b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f166c133ad0 0x7f166c133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36762/0 (socket says 172.21.15.146:36762) 2023-10-03T10:19:13.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.962+0000 7f166affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f166c136960 0x7f166c138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51948/0 (socket says 172.21.15.146:51948) 2023-10-03T10:19:13.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.962+0000 7f166b7fe700 1 -- 172.21.15.146:0/3475085766 learned_addr learned my addr 172.21.15.146:0/3475085766 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:13.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.962+0000 7f166bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f166c139280 0x7f166c13b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:35084/0 (socket says 172.21.15.146:35084) 2023-10-03T10:19:13.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.963+0000 7f166bfff700 1 -- 172.21.15.146:0/3475085766 >> v2:172.21.15.146:3300/0 conn(0x7f166c136960 msgr2=0x7f166c138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:13.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.963+0000 7f166bfff700 1 --2- 172.21.15.146:0/3475085766 >> v2:172.21.15.146:3300/0 conn(0x7f166c136960 0x7f166c138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.963+0000 7f166bfff700 1 -- 172.21.15.146:0/3475085766 >> v1:172.21.15.146:6789/0 conn(0x7f166c133ad0 legacy=0x7f166c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.963+0000 7f166bfff700 1 -- 172.21.15.146:0/3475085766 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166c09a500 con 0x7f166c139280 2023-10-03T10:19:13.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.963+0000 7f166affd700 1 --2- 172.21.15.146:0/3475085766 >> v2:172.21.15.146:3300/0 conn(0x7f166c136960 0x7f166c138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:13.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.963+0000 7f166bfff700 1 --2- 172.21.15.146:0/3475085766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f166c139280 0x7f166c13b660 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f1664009d90 tx=0x7f166400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adc9151ea1f175c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:13.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.963+0000 7f166a7fc700 1 -- 172.21.15.146:0/3475085766 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166400e070 con 0x7f166c139280 2023-10-03T10:19:13.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.963+0000 7f166a7fc700 1 -- 172.21.15.146:0/3475085766 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166400bb20 con 0x7f166c139280 2023-10-03T10:19:13.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.963+0000 7f166a7fc700 1 -- 172.21.15.146:0/3475085766 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1664012430 con 0x7f166c139280 2023-10-03T10:19:13.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.963+0000 7f167203f700 1 -- 172.21.15.146:0/3475085766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f166c139280 msgr2=0x7f166c13b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.963+0000 7f167203f700 1 --2- 172.21.15.146:0/3475085766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f166c139280 0x7f166c13b660 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f1664009d90 tx=0x7f166400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:13.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.963+0000 7f167203f700 1 -- 172.21.15.146:0/3475085766 shutdown_connections 2023-10-03T10:19:13.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.963+0000 7f167203f700 1 --2- 172.21.15.146:0/3475085766 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f166c139280 0x7f166c13b660 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.963+0000 7f167203f700 1 --2- 172.21.15.146:0/3475085766 >> v2:172.21.15.146:3300/0 conn(0x7f166c136960 0x7f166c138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.964+0000 7f167203f700 1 -- 172.21.15.146:0/3475085766 >> 172.21.15.146:0/3475085766 conn(0x7f166c099c40 msgr2=0x7f166c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:13.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.964+0000 7f167203f700 1 -- 172.21.15.146:0/3475085766 shutdown_connections 2023-10-03T10:19:13.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.964+0000 7f167203f700 1 -- 172.21.15.146:0/3475085766 wait complete. 2023-10-03T10:19:13.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.964+0000 7f167203f700 1 Processor -- start 2023-10-03T10:19:13.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.965+0000 7f167203f700 1 -- start start 2023-10-03T10:19:13.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.965+0000 7f167203f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f166c133ad0 0x7f166c12fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.965+0000 7f167203f700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f166c136960 0x7f166c12ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.965+0000 7f167203f700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f166c139280 0x7f166c1c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.965+0000 7f167203f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c070370 con 0x7f166c133ad0 2023-10-03T10:19:13.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.965+0000 7f167203f700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f166c1316a0 con 0x7f166c139280 2023-10-03T10:19:13.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.965+0000 7f167203f700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f166c06fe40 con 0x7f166c136960 2023-10-03T10:19:13.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.965+0000 7f166b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f166c133ad0 0x7f166c12fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.965+0000 7f166bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f166c139280 0x7f166c1c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.965+0000 7f166b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f166c133ad0 0x7f166c12fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51956/0 (socket says 172.21.15.146:51956) 2023-10-03T10:19:13.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.965+0000 7f166b7fe700 1 -- 172.21.15.146:0/3139046273 learned_addr learned my addr 172.21.15.146:0/3139046273 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:13.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.965+0000 7f166affd700 1 --2- 172.21.15.146:0/3139046273 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f166c136960 0x7f166c12ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.965+0000 7f166b7fe700 1 -- 172.21.15.146:0/3139046273 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f166c136960 msgr2=0x7f166c12ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.965+0000 7f166b7fe700 1 --2- 172.21.15.146:0/3139046273 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f166c136960 0x7f166c12ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.965+0000 7f166b7fe700 1 -- 172.21.15.146:0/3139046273 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f166c139280 msgr2=0x7f166c1c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.965+0000 7f166b7fe700 1 --2- 172.21.15.146:0/3139046273 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f166c139280 0x7f166c1c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.965+0000 7f166b7fe700 1 -- 172.21.15.146:0/3139046273 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165c0094a0 con 0x7f166c133ad0 2023-10-03T10:19:13.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.965+0000 7f166bfff700 1 --2- 172.21.15.146:0/3139046273 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f166c139280 0x7f166c1c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:13.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.966+0000 7f166b7fe700 1 --2- 172.21.15.146:0/3139046273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f166c133ad0 0x7f166c12fa30 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f166000c4b0 tx=0x7f166000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:13.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.966+0000 7f1653fff700 1 -- 172.21.15.146:0/3139046273 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1660005d70 con 0x7f166c133ad0 2023-10-03T10:19:13.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.966+0000 7f1653fff700 1 -- 172.21.15.146:0/3139046273 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166000ce80 con 0x7f166c133ad0 2023-10-03T10:19:13.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.966+0000 7f1653fff700 1 -- 172.21.15.146:0/3139046273 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16600072d0 con 0x7f166c133ad0 2023-10-03T10:19:13.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.966+0000 7f167203f700 1 -- 172.21.15.146:0/3139046273 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1664009a70 con 0x7f166c133ad0 2023-10-03T10:19:13.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.966+0000 7f167203f700 1 -- 172.21.15.146:0/3139046273 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f166c12f6d0 con 0x7f166c133ad0 2023-10-03T10:19:13.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.966+0000 7f1653fff700 1 -- 172.21.15.146:0/3139046273 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1660007430 con 0x7f166c133ad0 2023-10-03T10:19:13.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.967+0000 7f1653fff700 1 -- 172.21.15.146:0/3139046273 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f166003e980 con 0x7f166c133ad0 2023-10-03T10:19:13.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.967+0000 7f167203f700 1 -- 172.21.15.146:0/3139046273 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f166c0701b0 con 0x7f166c133ad0 2023-10-03T10:19:13.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:13.972+0000 7f1653fff700 1 -- 172.21.15.146:0/3139046273 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f166001b3b0 con 0x7f166c133ad0 2023-10-03T10:19:14.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.156+0000 7f167203f700 1 -- 172.21.15.146:0/3139046273 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f166c04f2a0 con 0x7f166c133ad0 2023-10-03T10:19:14.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.156+0000 7f1653fff700 1 -- 172.21.15.146:0/3139046273 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1660017020 con 0x7f166c133ad0 2023-10-03T10:19:14.156 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:14.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.158+0000 7f167203f700 1 -- 172.21.15.146:0/3139046273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f166c133ad0 msgr2=0x7f166c12fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.158+0000 7f167203f700 1 --2- 172.21.15.146:0/3139046273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f166c133ad0 0x7f166c12fa30 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f166000c4b0 tx=0x7f166000c7c0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.158+0000 7f167203f700 1 -- 172.21.15.146:0/3139046273 shutdown_connections 2023-10-03T10:19:14.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.158+0000 7f167203f700 1 --2- 172.21.15.146:0/3139046273 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f166c139280 0x7f166c1c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.158+0000 7f167203f700 1 --2- 172.21.15.146:0/3139046273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f166c133ad0 0x7f166c12fa30 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.158+0000 7f167203f700 1 --2- 172.21.15.146:0/3139046273 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f166c136960 0x7f166c12ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.159+0000 7f167203f700 1 -- 172.21.15.146:0/3139046273 >> 172.21.15.146:0/3139046273 conn(0x7f166c099c40 msgr2=0x7f166c134740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.159+0000 7f167203f700 1 -- 172.21.15.146:0/3139046273 shutdown_connections 2023-10-03T10:19:14.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.159+0000 7f167203f700 1 -- 172.21.15.146:0/3139046273 wait complete. 2023-10-03T10:19:14.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 1 for osd.2 2023-10-03T10:19:14.374 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:14.415 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:14.465 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:14.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.505+0000 7f07b6545700 1 Processor -- start 2023-10-03T10:19:14.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.505+0000 7f07b6545700 1 -- start start 2023-10-03T10:19:14.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.505+0000 7f07b6545700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07b0133ad0 0x7f07b0133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.505+0000 7f07b6545700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07b01300a0 0x7f07b01304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.505+0000 7f07b6545700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f07b01309f0 0x7f07b013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.505+0000 7f07b6545700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b006b2d0 con 0x7f07b01309f0 2023-10-03T10:19:14.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.505+0000 7f07b6545700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b0133610 con 0x7f07b0133ad0 2023-10-03T10:19:14.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.505+0000 7f07b6545700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07b009a500 con 0x7f07b01300a0 2023-10-03T10:19:14.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.505+0000 7f07affff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07b0133ad0 0x7f07b0133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.505+0000 7f07b4ae2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f07b01309f0 0x7f07b013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.505+0000 7f07affff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07b0133ad0 0x7f07b0133ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38342/0 (socket says 172.21.15.146:38342) 2023-10-03T10:19:14.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.505+0000 7f07affff700 1 -- 172.21.15.146:0/1427017052 learned_addr learned my addr 172.21.15.146:0/1427017052 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.506+0000 7f07af7fe700 1 --2- 172.21.15.146:0/1427017052 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07b01300a0 0x7f07b01304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.506+0000 7f07b4ae2700 1 -- 172.21.15.146:0/1427017052 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07b01300a0 msgr2=0x7f07b01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.506+0000 7f07b4ae2700 1 --2- 172.21.15.146:0/1427017052 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07b01300a0 0x7f07b01304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.506+0000 7f07b4ae2700 1 -- 172.21.15.146:0/1427017052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07b0133ad0 msgr2=0x7f07b0133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.506+0000 7f07b4ae2700 1 --2- 172.21.15.146:0/1427017052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07b0133ad0 0x7f07b0133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.506+0000 7f07b4ae2700 1 -- 172.21.15.146:0/1427017052 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b01338b0 con 0x7f07b01309f0 2023-10-03T10:19:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.506+0000 7f07b4ae2700 1 --2- 172.21.15.146:0/1427017052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07b01309f0 0x7f07b013a980 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f07a8009d90 tx=0x7f07a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d084f3f74f49926c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.506+0000 7f07aeffd700 1 -- 172.21.15.146:0/1427017052 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a800e070 con 0x7f07b01309f0 2023-10-03T10:19:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.506+0000 7f07aeffd700 1 -- 172.21.15.146:0/1427017052 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a800bb20 con 0x7f07b01309f0 2023-10-03T10:19:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.506+0000 7f07aeffd700 1 -- 172.21.15.146:0/1427017052 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a8012430 con 0x7f07b01309f0 2023-10-03T10:19:14.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.507+0000 7f07b6545700 1 -- 172.21.15.146:0/1427017052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07b01309f0 msgr2=0x7f07b013a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.507+0000 7f07b6545700 1 --2- 172.21.15.146:0/1427017052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07b01309f0 0x7f07b013a980 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f07a8009d90 tx=0x7f07a800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:14.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.507+0000 7f07b6545700 1 -- 172.21.15.146:0/1427017052 shutdown_connections 2023-10-03T10:19:14.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.507+0000 7f07b6545700 1 --2- 172.21.15.146:0/1427017052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07b0133ad0 0x7f07b0133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.507+0000 7f07b6545700 1 --2- 172.21.15.146:0/1427017052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07b01309f0 0x7f07b013a980 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.507+0000 7f07b6545700 1 --2- 172.21.15.146:0/1427017052 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07b01300a0 0x7f07b01304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.507+0000 7f07b6545700 1 -- 172.21.15.146:0/1427017052 >> 172.21.15.146:0/1427017052 conn(0x7f07b0099c40 msgr2=0x7f07b00a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.507+0000 7f07b6545700 1 -- 172.21.15.146:0/1427017052 shutdown_connections 2023-10-03T10:19:14.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.507+0000 7f07b6545700 1 -- 172.21.15.146:0/1427017052 wait complete. 2023-10-03T10:19:14.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.508+0000 7f07b6545700 1 Processor -- start 2023-10-03T10:19:14.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.508+0000 7f07b6545700 1 -- start start 2023-10-03T10:19:14.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.508+0000 7f07b6545700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07b01300a0 0x7f07b011da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.508+0000 7f07b6545700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07b01309f0 0x7f07b011df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.508+0000 7f07b6545700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07b0133ad0 0x7f07b011e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.508+0000 7f07b6545700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b0120a30 con 0x7f07b01309f0 2023-10-03T10:19:14.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.508+0000 7f07b6545700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b012d900 con 0x7f07b0133ad0 2023-10-03T10:19:14.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.508+0000 7f07b6545700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07b011fab0 con 0x7f07b01300a0 2023-10-03T10:19:14.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.509+0000 7f07af7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07b01309f0 0x7f07b011df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.509+0000 7f07af7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07b01309f0 0x7f07b011df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47884/0 (socket says 172.21.15.146:47884) 2023-10-03T10:19:14.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.509+0000 7f07af7fe700 1 -- 172.21.15.146:0/91499865 learned_addr learned my addr 172.21.15.146:0/91499865 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:14.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.509+0000 7f07affff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07b01300a0 0x7f07b011da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.509+0000 7f07b4ae2700 1 --2- 172.21.15.146:0/91499865 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07b0133ad0 0x7f07b011e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.509+0000 7f07affff700 1 -- 172.21.15.146:0/91499865 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07b0133ad0 msgr2=0x7f07b011e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.509+0000 7f07affff700 1 --2- 172.21.15.146:0/91499865 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07b0133ad0 0x7f07b011e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.509+0000 7f07affff700 1 -- 172.21.15.146:0/91499865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07b01309f0 msgr2=0x7f07b011df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.509+0000 7f07affff700 1 --2- 172.21.15.146:0/91499865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07b01309f0 0x7f07b011df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.509+0000 7f07affff700 1 -- 172.21.15.146:0/91499865 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a8009a70 con 0x7f07b01300a0 2023-10-03T10:19:14.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.509+0000 7f07af7fe700 1 --2- 172.21.15.146:0/91499865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07b01309f0 0x7f07b011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:14.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.509+0000 7f07b4ae2700 1 --2- 172.21.15.146:0/91499865 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07b0133ad0 0x7f07b011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:14.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.509+0000 7f07affff700 1 --2- 172.21.15.146:0/91499865 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07b01300a0 0x7f07b011da40 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f07a000e910 tx=0x7f07a000ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.509+0000 7f07acff9700 1 -- 172.21.15.146:0/91499865 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a0013680 con 0x7f07b01300a0 2023-10-03T10:19:14.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.509+0000 7f07acff9700 1 -- 172.21.15.146:0/91499865 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a00137e0 con 0x7f07b01300a0 2023-10-03T10:19:14.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.509+0000 7f07acff9700 1 -- 172.21.15.146:0/91499865 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a0013b70 con 0x7f07b01300a0 2023-10-03T10:19:14.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.509+0000 7f07b6545700 1 -- 172.21.15.146:0/91499865 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b011efd0 con 0x7f07b01300a0 2023-10-03T10:19:14.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.509+0000 7f07b6545700 1 -- 172.21.15.146:0/91499865 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b012dd00 con 0x7f07b01300a0 2023-10-03T10:19:14.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.510+0000 7f07b6545700 1 -- 172.21.15.146:0/91499865 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b004f2a0 con 0x7f07b01300a0 2023-10-03T10:19:14.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.511+0000 7f07acff9700 1 -- 172.21.15.146:0/91499865 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07a0013cd0 con 0x7f07b01300a0 2023-10-03T10:19:14.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.511+0000 7f07acff9700 1 -- 172.21.15.146:0/91499865 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f07a003feb0 con 0x7f07b01300a0 2023-10-03T10:19:14.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.515+0000 7f07acff9700 1 -- 172.21.15.146:0/91499865 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07a0011350 con 0x7f07b01300a0 2023-10-03T10:19:14.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.548+0000 7f471450c700 1 Processor -- start 2023-10-03T10:19:14.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.548+0000 7f471450c700 1 -- start start 2023-10-03T10:19:14.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.548+0000 7f471450c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f470c09ad40 0x7f470c133a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.548+0000 7f471450c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f470c133f70 0x7f470c1343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.548+0000 7f471450c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f470c09b110 con 0x7f470c0a0a70 2023-10-03T10:19:14.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.548+0000 7f471450c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470c0a3b60 con 0x7f470c133f70 2023-10-03T10:19:14.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.548+0000 7f471450c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f470c1348e0 con 0x7f470c09ad40 2023-10-03T10:19:14.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.549+0000 7f47122a8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f470c09ad40 0x7f470c133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.549+0000 7f4712aa9700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f470c0a0a70 0x7f470c0a0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55956/0 (socket says 172.21.15.146:55956) 2023-10-03T10:19:14.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.549+0000 7f4712aa9700 1 -- 172.21.15.146:0/2837072641 learned_addr learned my addr 172.21.15.146:0/2837072641 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:14.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.549+0000 7f4711aa7700 1 --2- 172.21.15.146:0/2837072641 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f470c133f70 0x7f470c1343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.549+0000 7f4711aa7700 1 -- 172.21.15.146:0/2837072641 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f470c09ad40 msgr2=0x7f470c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:14.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.549+0000 7f4711aa7700 1 --2- 172.21.15.146:0/2837072641 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f470c09ad40 0x7f470c133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.549+0000 7f4711aa7700 1 -- 172.21.15.146:0/2837072641 >> v1:172.21.15.146:6789/0 conn(0x7f470c0a0a70 legacy=0x7f470c0a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.549+0000 7f4711aa7700 1 -- 172.21.15.146:0/2837072641 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470c0a2fa0 con 0x7f470c133f70 2023-10-03T10:19:14.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.549+0000 7f47122a8700 1 --2- 172.21.15.146:0/2837072641 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f470c09ad40 0x7f470c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:14.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.549+0000 7f4711aa7700 1 --2- 172.21.15.146:0/2837072641 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f470c133f70 0x7f470c1343a0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f46fc009870 tx=0x7f46fc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b81ddcac809097d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.549+0000 7f47112a6700 1 -- 172.21.15.146:0/2837072641 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc011830 con 0x7f470c133f70 2023-10-03T10:19:14.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.549+0000 7f47112a6700 1 -- 172.21.15.146:0/2837072641 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46fc011990 con 0x7f470c133f70 2023-10-03T10:19:14.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.549+0000 7f47112a6700 1 -- 172.21.15.146:0/2837072641 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc011d20 con 0x7f470c133f70 2023-10-03T10:19:14.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.550+0000 7f471450c700 1 -- 172.21.15.146:0/2837072641 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f470c133f70 msgr2=0x7f470c1343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.550+0000 7f471450c700 1 --2- 172.21.15.146:0/2837072641 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f470c133f70 0x7f470c1343a0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f46fc009870 tx=0x7f46fc009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:14.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.550+0000 7f471450c700 1 -- 172.21.15.146:0/2837072641 shutdown_connections 2023-10-03T10:19:14.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.550+0000 7f471450c700 1 --2- 172.21.15.146:0/2837072641 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f470c09ad40 0x7f470c133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.550+0000 7f471450c700 1 --2- 172.21.15.146:0/2837072641 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f470c133f70 0x7f470c1343a0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.550+0000 7f471450c700 1 -- 172.21.15.146:0/2837072641 >> 172.21.15.146:0/2837072641 conn(0x7f470c099c40 msgr2=0x7f470c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.550+0000 7f471450c700 1 -- 172.21.15.146:0/2837072641 shutdown_connections 2023-10-03T10:19:14.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.550+0000 7f471450c700 1 -- 172.21.15.146:0/2837072641 wait complete. 2023-10-03T10:19:14.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.551+0000 7f471450c700 1 Processor -- start 2023-10-03T10:19:14.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.551+0000 7f471450c700 1 -- start start 2023-10-03T10:19:14.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.551+0000 7f471450c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f470c09ad40 0x7f470c11e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.551+0000 7f471450c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f470c0a0a70 0x7f470c11e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.551+0000 7f471450c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f470c133f70 0x7f470c11eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.551+0000 7f471450c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c121be0 con 0x7f470c133f70 2023-10-03T10:19:14.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.551+0000 7f471450c700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470c1202f0 con 0x7f470c0a0a70 2023-10-03T10:19:14.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.551+0000 7f471450c700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f470c122580 con 0x7f470c09ad40 2023-10-03T10:19:14.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.551+0000 7f4711aa7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f470c0a0a70 0x7f470c11e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.551+0000 7f47122a8700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f470c09ad40 0x7f470c11e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.551+0000 7f4711aa7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f470c0a0a70 0x7f470c11e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38374/0 (socket says 172.21.15.146:38374) 2023-10-03T10:19:14.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.551+0000 7f4711aa7700 1 -- 172.21.15.146:0/3135083259 learned_addr learned my addr 172.21.15.146:0/3135083259 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:14.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.552+0000 7f4712aa9700 1 --2- 172.21.15.146:0/3135083259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f470c133f70 0x7f470c11eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.552+0000 7f4711aa7700 1 -- 172.21.15.146:0/3135083259 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f470c09ad40 msgr2=0x7f470c11e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.552+0000 7f4711aa7700 1 --2- 172.21.15.146:0/3135083259 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f470c09ad40 0x7f470c11e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.552+0000 7f4711aa7700 1 -- 172.21.15.146:0/3135083259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f470c133f70 msgr2=0x7f470c11eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.552+0000 7f4711aa7700 1 --2- 172.21.15.146:0/3135083259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f470c133f70 0x7f470c11eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.552+0000 7f4711aa7700 1 -- 172.21.15.146:0/3135083259 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47080094a0 con 0x7f470c0a0a70 2023-10-03T10:19:14.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.552+0000 7f47122a8700 1 --2- 172.21.15.146:0/3135083259 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f470c09ad40 0x7f470c11e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:14.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.552+0000 7f4712aa9700 1 --2- 172.21.15.146:0/3135083259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f470c133f70 0x7f470c11eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:19:14.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.552+0000 7f4711aa7700 1 --2- 172.21.15.146:0/3135083259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f470c0a0a70 0x7f470c11e600 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f46fc0090b0 tx=0x7f46fc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.552+0000 7f4702ffd700 1 -- 172.21.15.146:0/3135083259 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc004590 con 0x7f470c0a0a70 2023-10-03T10:19:14.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.552+0000 7f4702ffd700 1 -- 172.21.15.146:0/3135083259 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46fc0036a0 con 0x7f470c0a0a70 2023-10-03T10:19:14.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.552+0000 7f471450c700 1 -- 172.21.15.146:0/3135083259 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46fc0094a0 con 0x7f470c0a0a70 2023-10-03T10:19:14.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.552+0000 7f4702ffd700 1 -- 172.21.15.146:0/3135083259 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc003a30 con 0x7f470c0a0a70 2023-10-03T10:19:14.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.552+0000 7f471450c700 1 -- 172.21.15.146:0/3135083259 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470c11fcd0 con 0x7f470c0a0a70 2023-10-03T10:19:14.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.553+0000 7f471450c700 1 -- 172.21.15.146:0/3135083259 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470c0a58b0 con 0x7f470c0a0a70 2023-10-03T10:19:14.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.553+0000 7f4702ffd700 1 -- 172.21.15.146:0/3135083259 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f46fc003b90 con 0x7f470c0a0a70 2023-10-03T10:19:14.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.554+0000 7f4702ffd700 1 -- 172.21.15.146:0/3135083259 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f46fc040d90 con 0x7f470c0a0a70 2023-10-03T10:19:14.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.558+0000 7f4702ffd700 1 -- 172.21.15.146:0/3135083259 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f46fc003e40 con 0x7f470c0a0a70 2023-10-03T10:19:14.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.636+0000 7f5ca8d2b700 1 Processor -- start 2023-10-03T10:19:14.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.636+0000 7f5ca8d2b700 1 -- start start 2023-10-03T10:19:14.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.637+0000 7f5ca8d2b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ca409f350 0x7f5ca4136c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.637+0000 7f5ca8d2b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ca41371c0 0x7f5ca41395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.637+0000 7f5ca8d2b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca409c970 con 0x7f5ca409e870 2023-10-03T10:19:14.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.637+0000 7f5ca8d2b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca40a0920 con 0x7f5ca41371c0 2023-10-03T10:19:14.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.637+0000 7f5ca8d2b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca409f9c0 con 0x7f5ca409f350 2023-10-03T10:19:14.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.637+0000 7f5ca259c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5ca409e870 0x7f5ca409ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55964/0 (socket says 172.21.15.146:55964) 2023-10-03T10:19:14.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.637+0000 7f5ca259c700 1 -- 172.21.15.146:0/3209820619 learned_addr learned my addr 172.21.15.146:0/3209820619 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:14.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.637+0000 7f5ca1d9b700 1 --2- 172.21.15.146:0/3209820619 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ca409f350 0x7f5ca4136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.637+0000 7f5ca2d9d700 1 --2- 172.21.15.146:0/3209820619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ca41371c0 0x7f5ca41395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.638+0000 7f5ca159a700 1 -- 172.21.15.146:0/3209820619 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248876683 0 0) 0x7f5ca409c970 con 0x7f5ca409e870 2023-10-03T10:19:14.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.638+0000 7f5ca1d9b700 1 -- 172.21.15.146:0/3209820619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ca41371c0 msgr2=0x7f5ca41395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:14.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.638+0000 7f5ca1d9b700 1 --2- 172.21.15.146:0/3209820619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ca41371c0 0x7f5ca41395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.638+0000 7f5ca1d9b700 1 -- 172.21.15.146:0/3209820619 >> v1:172.21.15.146:6789/0 conn(0x7f5ca409e870 legacy=0x7f5ca409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.638+0000 7f5ca1d9b700 1 -- 172.21.15.146:0/3209820619 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca409bab0 con 0x7f5ca409f350 2023-10-03T10:19:14.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.638+0000 7f5ca2d9d700 1 --2- 172.21.15.146:0/3209820619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ca41371c0 0x7f5ca41395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:14.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.638+0000 7f5ca1d9b700 1 --2- 172.21.15.146:0/3209820619 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ca409f350 0x7f5ca4136c80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009870 tx=0x7f5c98009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f68da183be9f674 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.638+0000 7f5ca159a700 1 -- 172.21.15.146:0/3209820619 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c98011830 con 0x7f5ca409f350 2023-10-03T10:19:14.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.638+0000 7f5ca159a700 1 -- 172.21.15.146:0/3209820619 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c98011990 con 0x7f5ca409f350 2023-10-03T10:19:14.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.638+0000 7f5ca159a700 1 -- 172.21.15.146:0/3209820619 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c98011d20 con 0x7f5ca409f350 2023-10-03T10:19:14.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.639+0000 7f5ca8d2b700 1 -- 172.21.15.146:0/3209820619 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ca409f350 msgr2=0x7f5ca4136c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.639+0000 7f5ca8d2b700 1 --2- 172.21.15.146:0/3209820619 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ca409f350 0x7f5ca4136c80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009870 tx=0x7f5c98009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:14.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.639+0000 7f5ca8d2b700 1 -- 172.21.15.146:0/3209820619 shutdown_connections 2023-10-03T10:19:14.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.639+0000 7f5ca8d2b700 1 --2- 172.21.15.146:0/3209820619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ca41371c0 0x7f5ca41395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.639+0000 7f5ca8d2b700 1 --2- 172.21.15.146:0/3209820619 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ca409f350 0x7f5ca4136c80 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.639+0000 7f5ca8d2b700 1 -- 172.21.15.146:0/3209820619 >> 172.21.15.146:0/3209820619 conn(0x7f5ca40a4430 msgr2=0x7f5ca40a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.639+0000 7f5ca8d2b700 1 -- 172.21.15.146:0/3209820619 shutdown_connections 2023-10-03T10:19:14.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.639+0000 7f5ca8d2b700 1 -- 172.21.15.146:0/3209820619 wait complete. 2023-10-03T10:19:14.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.640+0000 7f5ca8d2b700 1 Processor -- start 2023-10-03T10:19:14.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.640+0000 7f5ca8d2b700 1 -- start start 2023-10-03T10:19:14.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.640+0000 7f5ca8d2b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca409e870 0x7f5ca4120840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.640+0000 7f5ca8d2b700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ca409f350 0x7f5ca4120d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.640+0000 7f5ca8d2b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ca41371c0 0x7f5ca41212c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.640+0000 7f5ca8d2b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca41242d0 con 0x7f5ca409e870 2023-10-03T10:19:14.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.640+0000 7f5ca8d2b700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca41366a0 con 0x7f5ca41371c0 2023-10-03T10:19:14.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.640+0000 7f5ca8d2b700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca409dba0 con 0x7f5ca409f350 2023-10-03T10:19:14.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.640+0000 7f5ca259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca409e870 0x7f5ca4120840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.640+0000 7f5ca259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca409e870 0x7f5ca4120840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47902/0 (socket says 172.21.15.146:47902) 2023-10-03T10:19:14.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.640+0000 7f5ca2d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ca41371c0 0x7f5ca41212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.640+0000 7f5ca259c700 1 -- 172.21.15.146:0/3642341536 learned_addr learned my addr 172.21.15.146:0/3642341536 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:14.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.640+0000 7f5ca1d9b700 1 --2- 172.21.15.146:0/3642341536 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ca409f350 0x7f5ca4120d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.641+0000 7f5ca259c700 1 -- 172.21.15.146:0/3642341536 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ca409f350 msgr2=0x7f5ca4120d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.641+0000 7f5ca259c700 1 --2- 172.21.15.146:0/3642341536 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ca409f350 0x7f5ca4120d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.641+0000 7f5ca259c700 1 -- 172.21.15.146:0/3642341536 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ca41371c0 msgr2=0x7f5ca41212c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.641+0000 7f5ca259c700 1 --2- 172.21.15.146:0/3642341536 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ca41371c0 0x7f5ca41212c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.641+0000 7f5ca259c700 1 -- 172.21.15.146:0/3642341536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9c009a70 con 0x7f5ca409e870 2023-10-03T10:19:14.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.641+0000 7f5ca1d9b700 1 --2- 172.21.15.146:0/3642341536 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ca409f350 0x7f5ca4120d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:14.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.641+0000 7f5ca2d9d700 1 --2- 172.21.15.146:0/3642341536 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ca41371c0 0x7f5ca41212c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:14.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.641+0000 7f5ca259c700 1 --2- 172.21.15.146:0/3642341536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca409e870 0x7f5ca4120840 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f5c9400c520 tx=0x7f5c9400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.641+0000 7f5c92ffd700 1 -- 172.21.15.146:0/3642341536 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c94004c80 con 0x7f5ca409e870 2023-10-03T10:19:14.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.641+0000 7f5c92ffd700 1 -- 172.21.15.146:0/3642341536 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c94004e00 con 0x7f5ca409e870 2023-10-03T10:19:14.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.641+0000 7f5ca8d2b700 1 -- 172.21.15.146:0/3642341536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c980094a0 con 0x7f5ca409e870 2023-10-03T10:19:14.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.641+0000 7f5c92ffd700 1 -- 172.21.15.146:0/3642341536 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c94007310 con 0x7f5ca409e870 2023-10-03T10:19:14.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.641+0000 7f5ca8d2b700 1 -- 172.21.15.146:0/3642341536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca4124a60 con 0x7f5ca409e870 2023-10-03T10:19:14.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.642+0000 7f5c92ffd700 1 -- 172.21.15.146:0/3642341536 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c94007470 con 0x7f5ca409e870 2023-10-03T10:19:14.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.642+0000 7f5ca8d2b700 1 -- 172.21.15.146:0/3642341536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca404f2a0 con 0x7f5ca409e870 2023-10-03T10:19:14.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.642+0000 7f5c92ffd700 1 -- 172.21.15.146:0/3642341536 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5c9403f320 con 0x7f5ca409e870 2023-10-03T10:19:14.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.647+0000 7f5c92ffd700 1 -- 172.21.15.146:0/3642341536 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c940123b0 con 0x7f5ca409e870 2023-10-03T10:19:14.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.751+0000 7f471450c700 1 -- 172.21.15.146:0/3135083259 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f470c04f2a0 con 0x7f470c0a0a70 2023-10-03T10:19:14.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.751+0000 7f4702ffd700 1 -- 172.21.15.146:0/3135083259 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f46fc015030 con 0x7f470c0a0a70 2023-10-03T10:19:14.751 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:19:14.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.753+0000 7f471450c700 1 -- 172.21.15.146:0/3135083259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f470c0a0a70 msgr2=0x7f470c11e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.753+0000 7f471450c700 1 --2- 172.21.15.146:0/3135083259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f470c0a0a70 0x7f470c11e600 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f46fc0090b0 tx=0x7f46fc004750 comp rx=0 tx=0).stop 2023-10-03T10:19:14.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.753+0000 7f471450c700 1 -- 172.21.15.146:0/3135083259 shutdown_connections 2023-10-03T10:19:14.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.753+0000 7f471450c700 1 --2- 172.21.15.146:0/3135083259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f470c133f70 0x7f470c11eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.753+0000 7f471450c700 1 --2- 172.21.15.146:0/3135083259 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f470c09ad40 0x7f470c11e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.753+0000 7f471450c700 1 --2- 172.21.15.146:0/3135083259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f470c0a0a70 0x7f470c11e600 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.753+0000 7f471450c700 1 -- 172.21.15.146:0/3135083259 >> 172.21.15.146:0/3135083259 conn(0x7f470c099c40 msgr2=0x7f470c1330f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.754+0000 7f471450c700 1 -- 172.21.15.146:0/3135083259 shutdown_connections 2023-10-03T10:19:14.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.754+0000 7f471450c700 1 -- 172.21.15.146:0/3135083259 wait complete. 2023-10-03T10:19:14.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.764+0000 7f07b6545700 1 -- 172.21.15.146:0/91499865 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f07b006c3b0 con 0x7f07b01300a0 2023-10-03T10:19:14.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.764+0000 7f07acff9700 1 -- 172.21.15.146:0/91499865 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f07a0021020 con 0x7f07b01300a0 2023-10-03T10:19:14.764 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:14.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:19:14.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.767+0000 7f07b6545700 1 -- 172.21.15.146:0/91499865 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07b01300a0 msgr2=0x7f07b011da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.767+0000 7f07b6545700 1 --2- 172.21.15.146:0/91499865 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07b01300a0 0x7f07b011da40 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f07a000e910 tx=0x7f07a000ec20 comp rx=0 tx=0).stop 2023-10-03T10:19:14.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.767+0000 7f07b6545700 1 -- 172.21.15.146:0/91499865 shutdown_connections 2023-10-03T10:19:14.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.767+0000 7f07b6545700 1 --2- 172.21.15.146:0/91499865 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07b0133ad0 0x7f07b011e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.767+0000 7f07b6545700 1 --2- 172.21.15.146:0/91499865 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f07b01300a0 0x7f07b011da40 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.767+0000 7f07b6545700 1 --2- 172.21.15.146:0/91499865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07b01309f0 0x7f07b011df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.767+0000 7f07b6545700 1 -- 172.21.15.146:0/91499865 >> 172.21.15.146:0/91499865 conn(0x7f07b0099c40 msgr2=0x7f07b012e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.767+0000 7f07b6545700 1 -- 172.21.15.146:0/91499865 shutdown_connections 2023-10-03T10:19:14.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.767+0000 7f07b6545700 1 -- 172.21.15.146:0/91499865 wait complete. 2023-10-03T10:19:14.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:19:14.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.843+0000 7f5ca8d2b700 1 -- 172.21.15.146:0/3642341536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5ca4123f50 con 0x7f5ca409e870 2023-10-03T10:19:14.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.844+0000 7f5c92ffd700 1 -- 172.21.15.146:0/3642341536 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c9400ce60 con 0x7f5ca409e870 2023-10-03T10:19:14.843 INFO:teuthology.orchestra.run.smithi146.stdout:124554051586 2023-10-03T10:19:14.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.846+0000 7f5ca8d2b700 1 -- 172.21.15.146:0/3642341536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca409e870 msgr2=0x7f5ca4120840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.846+0000 7f5ca8d2b700 1 --2- 172.21.15.146:0/3642341536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca409e870 0x7f5ca4120840 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f5c9400c520 tx=0x7f5c9400c830 comp rx=0 tx=0).stop 2023-10-03T10:19:14.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.846+0000 7f5ca8d2b700 1 -- 172.21.15.146:0/3642341536 shutdown_connections 2023-10-03T10:19:14.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.846+0000 7f5ca8d2b700 1 --2- 172.21.15.146:0/3642341536 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ca41371c0 0x7f5ca41212c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.846+0000 7f5ca8d2b700 1 --2- 172.21.15.146:0/3642341536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ca409e870 0x7f5ca4120840 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.846+0000 7f5ca8d2b700 1 --2- 172.21.15.146:0/3642341536 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5ca409f350 0x7f5ca4120d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.846+0000 7f5ca8d2b700 1 -- 172.21.15.146:0/3642341536 >> 172.21.15.146:0/3642341536 conn(0x7f5ca40a4430 msgr2=0x7f5ca409c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.846+0000 7f5ca8d2b700 1 -- 172.21.15.146:0/3642341536 shutdown_connections 2023-10-03T10:19:14.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:14.846+0000 7f5ca8d2b700 1 -- 172.21.15.146:0/3642341536 wait complete. 2023-10-03T10:19:14.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.1 2023-10-03T10:19:15.171 INFO:tasks.ceph:ignoring flush pg stats error, probably testing upgrade: timed out waiting for mon to be updated with osd.2: 1 < 128849018883 2023-10-03T10:19:15.172 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-03T10:19:15.172 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:19:15.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.292+0000 7faee925e700 1 Processor -- start 2023-10-03T10:19:15.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.292+0000 7faee925e700 1 -- start start 2023-10-03T10:19:15.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.293+0000 7faee925e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faee4136960 0x7faee4138d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.293+0000 7faee925e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faee4139280 0x7faee413b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.293+0000 7faee925e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee406b2d0 con 0x7faee4133ad0 2023-10-03T10:19:15.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.293+0000 7faee925e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee41345b0 con 0x7faee4139280 2023-10-03T10:19:15.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.293+0000 7faee925e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faee4133610 con 0x7faee4136960 2023-10-03T10:19:15.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.293+0000 7faee259c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faee4136960 0x7faee4138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.293+0000 7faee359e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faee4139280 0x7faee413b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.293+0000 7faee2d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7faee4133ad0 0x7faee4133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55974/0 (socket says 172.21.15.146:55974) 2023-10-03T10:19:15.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.293+0000 7faee2d9d700 1 -- 172.21.15.146:0/1308625740 learned_addr learned my addr 172.21.15.146:0/1308625740 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:15.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.293+0000 7faee1d9b700 1 -- 172.21.15.146:0/1308625740 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658525181 0 0) 0x7faee406b2d0 con 0x7faee4133ad0 2023-10-03T10:19:15.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.293+0000 7faee1d9b700 1 -- 172.21.15.146:0/1308625740 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faecc0035b0 con 0x7faee4133ad0 2023-10-03T10:19:15.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.293+0000 7faee359e700 1 -- 172.21.15.146:0/1308625740 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faee4136960 msgr2=0x7faee4138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:15.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.293+0000 7faee359e700 1 --2- 172.21.15.146:0/1308625740 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faee4136960 0x7faee4138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.293+0000 7faee359e700 1 -- 172.21.15.146:0/1308625740 >> v1:172.21.15.146:6789/0 conn(0x7faee4133ad0 legacy=0x7faee4133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.293+0000 7faee359e700 1 -- 172.21.15.146:0/1308625740 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee409a500 con 0x7faee4139280 2023-10-03T10:19:15.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.293+0000 7faee259c700 1 --2- 172.21.15.146:0/1308625740 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faee4136960 0x7faee4138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:15.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.294+0000 7faee359e700 1 --2- 172.21.15.146:0/1308625740 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faee4139280 0x7faee413b660 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7faedc009dc0 tx=0x7faedc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8caf4c4e5ebda9e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.294+0000 7faee1d9b700 1 -- 172.21.15.146:0/1308625740 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc00e070 con 0x7faee4139280 2023-10-03T10:19:15.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.294+0000 7faee1d9b700 1 -- 172.21.15.146:0/1308625740 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faedc00bb20 con 0x7faee4139280 2023-10-03T10:19:15.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.294+0000 7faee1d9b700 1 -- 172.21.15.146:0/1308625740 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc012430 con 0x7faee4139280 2023-10-03T10:19:15.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.294+0000 7faee925e700 1 -- 172.21.15.146:0/1308625740 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faee4139280 msgr2=0x7faee413b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.294+0000 7faee925e700 1 --2- 172.21.15.146:0/1308625740 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faee4139280 0x7faee413b660 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7faedc009dc0 tx=0x7faedc00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:15.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.294+0000 7faee925e700 1 -- 172.21.15.146:0/1308625740 shutdown_connections 2023-10-03T10:19:15.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.294+0000 7faee925e700 1 --2- 172.21.15.146:0/1308625740 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faee4139280 0x7faee413b660 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.294+0000 7faee925e700 1 --2- 172.21.15.146:0/1308625740 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faee4136960 0x7faee4138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.294+0000 7faee925e700 1 -- 172.21.15.146:0/1308625740 >> 172.21.15.146:0/1308625740 conn(0x7faee4099c40 msgr2=0x7faee40a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.294+0000 7faee925e700 1 -- 172.21.15.146:0/1308625740 shutdown_connections 2023-10-03T10:19:15.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.294+0000 7faee925e700 1 -- 172.21.15.146:0/1308625740 wait complete. 2023-10-03T10:19:15.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.295+0000 7faee925e700 1 Processor -- start 2023-10-03T10:19:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.295+0000 7faee925e700 1 -- start start 2023-10-03T10:19:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.296+0000 7faee925e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faee4133ad0 0x7faee412cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.296+0000 7faee925e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faee4136960 0x7faee412d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.296+0000 7faee925e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faee4139280 0x7faee412d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.296+0000 7faee925e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee41316c0 con 0x7faee4136960 2023-10-03T10:19:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.296+0000 7faee925e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee409f390 con 0x7faee4133ad0 2023-10-03T10:19:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.296+0000 7faee925e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faee41309a0 con 0x7faee4139280 2023-10-03T10:19:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.296+0000 7faee2d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faee4133ad0 0x7faee412cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.296+0000 7faee259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faee4136960 0x7faee412d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.296+0000 7faee259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faee4136960 0x7faee412d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47918/0 (socket says 172.21.15.146:47918) 2023-10-03T10:19:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.296+0000 7faee259c700 1 -- 172.21.15.146:0/1275079673 learned_addr learned my addr 172.21.15.146:0/1275079673 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.296+0000 7faee359e700 1 --2- 172.21.15.146:0/1275079673 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faee4139280 0x7faee412d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.296+0000 7faee2d9d700 1 -- 172.21.15.146:0/1275079673 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faee4139280 msgr2=0x7faee412d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.296+0000 7faee2d9d700 1 --2- 172.21.15.146:0/1275079673 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7faee4139280 0x7faee412d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.296+0000 7faee2d9d700 1 -- 172.21.15.146:0/1275079673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faee4136960 msgr2=0x7faee412d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.296+0000 7faee2d9d700 1 --2- 172.21.15.146:0/1275079673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faee4136960 0x7faee412d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.296+0000 7faee2d9d700 1 -- 172.21.15.146:0/1275079673 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed40094a0 con 0x7faee4133ad0 2023-10-03T10:19:15.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.296+0000 7faee259c700 1 --2- 172.21.15.146:0/1275079673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faee4136960 0x7faee412d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:15.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.296+0000 7faee2d9d700 1 --2- 172.21.15.146:0/1275079673 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faee4133ad0 0x7faee412cb30 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7faed800c460 tx=0x7faed800c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.297+0000 7faecb7fe700 1 -- 172.21.15.146:0/1275079673 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed8005d70 con 0x7faee4133ad0 2023-10-03T10:19:15.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.297+0000 7faecb7fe700 1 -- 172.21.15.146:0/1275079673 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed80070d0 con 0x7faee4133ad0 2023-10-03T10:19:15.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.297+0000 7faee925e700 1 -- 172.21.15.146:0/1275079673 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faedc009a70 con 0x7faee4133ad0 2023-10-03T10:19:15.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.297+0000 7faecb7fe700 1 -- 172.21.15.146:0/1275079673 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed8007460 con 0x7faee4133ad0 2023-10-03T10:19:15.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.297+0000 7faee925e700 1 -- 172.21.15.146:0/1275079673 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee4070910 con 0x7faee4133ad0 2023-10-03T10:19:15.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.297+0000 7faecb7fe700 1 -- 172.21.15.146:0/1275079673 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faed80075c0 con 0x7faee4133ad0 2023-10-03T10:19:15.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.297+0000 7faecb7fe700 1 -- 172.21.15.146:0/1275079673 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7faed803e930 con 0x7faee4133ad0 2023-10-03T10:19:15.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.298+0000 7faee925e700 1 -- 172.21.15.146:0/1275079673 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee4070250 con 0x7faee4133ad0 2023-10-03T10:19:15.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.302+0000 7faecb7fe700 1 -- 172.21.15.146:0/1275079673 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faed8017080 con 0x7faee4133ad0 2023-10-03T10:19:15.766 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:15.779 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:15.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.895+0000 7fee011c2700 1 Processor -- start 2023-10-03T10:19:15.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.895+0000 7fee011c2700 1 -- start start 2023-10-03T10:19:15.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.896+0000 7fee011c2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedfc0a1550 0x7fedfc138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.896+0000 7fee011c2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fedfc139200 0x7fedfc13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.896+0000 7fee011c2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedfc09e9d0 con 0x7fedfc0a0a70 2023-10-03T10:19:15.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.896+0000 7fee011c2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc09dc00 con 0x7fedfc0a1550 2023-10-03T10:19:15.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.896+0000 7fee011c2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc09dec0 con 0x7fedfc139200 2023-10-03T10:19:15.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.896+0000 7fedfb59e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fedfc139200 0x7fedfc13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.896+0000 7fedfad9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fedfc0a0a70 0x7fedfc0a0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55988/0 (socket says 172.21.15.146:55988) 2023-10-03T10:19:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.896+0000 7fedfad9d700 1 -- 172.21.15.146:0/908958859 learned_addr learned my addr 172.21.15.146:0/908958859 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.896+0000 7fedfa59c700 1 --2- 172.21.15.146:0/908958859 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedfc0a1550 0x7fedfc138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.896+0000 7fedfa59c700 1 -- 172.21.15.146:0/908958859 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fedfc139200 msgr2=0x7fedfc13b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.896+0000 7fedfa59c700 1 --2- 172.21.15.146:0/908958859 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fedfc139200 0x7fedfc13b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.896+0000 7fedf9d9b700 1 -- 172.21.15.146:0/908958859 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849767047 0 0) 0x7fedfc09e9d0 con 0x7fedfc0a0a70 2023-10-03T10:19:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.896+0000 7fedfa59c700 1 -- 172.21.15.146:0/908958859 >> v1:172.21.15.146:6789/0 conn(0x7fedfc0a0a70 legacy=0x7fedfc0a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.896+0000 7fedfa59c700 1 -- 172.21.15.146:0/908958859 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc09e6a0 con 0x7fedfc0a1550 2023-10-03T10:19:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.896+0000 7fedfb59e700 1 --2- 172.21.15.146:0/908958859 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fedfc139200 0x7fedfc13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.896+0000 7fedfa59c700 1 --2- 172.21.15.146:0/908958859 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedfc0a1550 0x7fedfc138cc0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fedf0009870 tx=0x7fedf0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5a3b6c0a7db12d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.896+0000 7fedf9d9b700 1 -- 172.21.15.146:0/908958859 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf0011830 con 0x7fedfc0a1550 2023-10-03T10:19:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.896+0000 7fedf9d9b700 1 -- 172.21.15.146:0/908958859 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf0011990 con 0x7fedfc0a1550 2023-10-03T10:19:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.896+0000 7fedf9d9b700 1 -- 172.21.15.146:0/908958859 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf0011d20 con 0x7fedfc0a1550 2023-10-03T10:19:15.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.897+0000 7fee011c2700 1 -- 172.21.15.146:0/908958859 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedfc0a1550 msgr2=0x7fedfc138cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.897+0000 7fee011c2700 1 --2- 172.21.15.146:0/908958859 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedfc0a1550 0x7fedfc138cc0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fedf0009870 tx=0x7fedf0009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:15.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.897+0000 7fee011c2700 1 -- 172.21.15.146:0/908958859 shutdown_connections 2023-10-03T10:19:15.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.897+0000 7fee011c2700 1 --2- 172.21.15.146:0/908958859 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fedfc139200 0x7fedfc13b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.897+0000 7fee011c2700 1 --2- 172.21.15.146:0/908958859 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedfc0a1550 0x7fedfc138cc0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.897+0000 7fee011c2700 1 -- 172.21.15.146:0/908958859 >> 172.21.15.146:0/908958859 conn(0x7fedfc0a6610 msgr2=0x7fedfc0a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.897+0000 7fee011c2700 1 -- 172.21.15.146:0/908958859 shutdown_connections 2023-10-03T10:19:15.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.897+0000 7fee011c2700 1 -- 172.21.15.146:0/908958859 wait complete. 2023-10-03T10:19:15.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.898+0000 7fee011c2700 1 Processor -- start 2023-10-03T10:19:15.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.898+0000 7fee011c2700 1 -- start start 2023-10-03T10:19:15.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.899+0000 7fee011c2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fedfc0a0a70 0x7fedfc11e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.899+0000 7fee011c2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedfc0a1550 0x7fedfc11ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.899+0000 7fee011c2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedfc139200 0x7fedfc11f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.899+0000 7fee011c2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc1222d0 con 0x7fedfc139200 2023-10-03T10:19:15.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.899+0000 7fee011c2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc0a03e0 con 0x7fedfc0a1550 2023-10-03T10:19:15.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.899+0000 7fee011c2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc0a5100 con 0x7fedfc0a0a70 2023-10-03T10:19:15.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.899+0000 7fedfad9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fedfc0a0a70 0x7fedfc11e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.899+0000 7fedfb59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedfc139200 0x7fedfc11f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.899+0000 7fedfa59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedfc0a1550 0x7fedfc11ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.899+0000 7fedfad9d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fedfc0a0a70 0x7fedfc11e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:60466/0 (socket says 172.21.15.146:60466) 2023-10-03T10:19:15.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.899+0000 7fedfad9d700 1 -- 172.21.15.146:0/3685676543 learned_addr learned my addr 172.21.15.146:0/3685676543 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:15.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.899+0000 7fedfb59e700 1 -- 172.21.15.146:0/3685676543 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fedfc0a0a70 msgr2=0x7fedfc11e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.899+0000 7fedfb59e700 1 --2- 172.21.15.146:0/3685676543 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fedfc0a0a70 0x7fedfc11e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.899+0000 7fedfb59e700 1 -- 172.21.15.146:0/3685676543 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedfc0a1550 msgr2=0x7fedfc11ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.899+0000 7fedfb59e700 1 --2- 172.21.15.146:0/3685676543 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedfc0a1550 0x7fedfc11ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.899+0000 7fedfb59e700 1 -- 172.21.15.146:0/3685676543 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf4009a70 con 0x7fedfc139200 2023-10-03T10:19:15.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.899+0000 7fedfa59c700 1 --2- 172.21.15.146:0/3685676543 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedfc0a1550 0x7fedfc11ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:15.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.899+0000 7fedfb59e700 1 --2- 172.21.15.146:0/3685676543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedfc139200 0x7fedfc11f230 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fedf400ef90 tx=0x7fedf400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.899+0000 7fede37fe700 1 -- 172.21.15.146:0/3685676543 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf400ca90 con 0x7fedfc139200 2023-10-03T10:19:15.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.900+0000 7fede37fe700 1 -- 172.21.15.146:0/3685676543 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf400f040 con 0x7fedfc139200 2023-10-03T10:19:15.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.900+0000 7fee011c2700 1 -- 172.21.15.146:0/3685676543 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf00094a0 con 0x7fedfc139200 2023-10-03T10:19:15.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.900+0000 7fede37fe700 1 -- 172.21.15.146:0/3685676543 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf400ce30 con 0x7fedfc139200 2023-10-03T10:19:15.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.900+0000 7fee011c2700 1 -- 172.21.15.146:0/3685676543 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedfc121d30 con 0x7fedfc139200 2023-10-03T10:19:15.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.900+0000 7fee011c2700 1 -- 172.21.15.146:0/3685676543 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedfc04f2a0 con 0x7fedfc139200 2023-10-03T10:19:15.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.901+0000 7fede37fe700 1 -- 172.21.15.146:0/3685676543 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fedf4003a20 con 0x7fedfc139200 2023-10-03T10:19:15.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.901+0000 7fede37fe700 1 -- 172.21.15.146:0/3685676543 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fedf4040650 con 0x7fedfc139200 2023-10-03T10:19:15.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.905+0000 7fede37fe700 1 -- 172.21.15.146:0/3685676543 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fedf401c3b0 con 0x7fedfc139200 2023-10-03T10:19:15.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.938+0000 7fa864429700 1 Processor -- start 2023-10-03T10:19:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.938+0000 7fa864429700 1 -- start start 2023-10-03T10:19:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.939+0000 7fa864429700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c133ad0 0x7fa85c133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.939+0000 7fa864429700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa85c1300a0 0x7fa85c1304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.939+0000 7fa864429700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa85c06b2d0 con 0x7fa85c1309f0 2023-10-03T10:19:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.939+0000 7fa864429700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c133610 con 0x7fa85c133ad0 2023-10-03T10:19:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.939+0000 7fa864429700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c09a500 con 0x7fa85c1300a0 2023-10-03T10:19:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.939+0000 7fa8629c6700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa85c1309f0 0x7fa85c13a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55996/0 (socket says 172.21.15.146:55996) 2023-10-03T10:19:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.939+0000 7fa8621c5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c133ad0 0x7fa85c133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.939+0000 7fa8629c6700 1 -- 172.21.15.146:0/3818397784 learned_addr learned my addr 172.21.15.146:0/3818397784 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:19:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.939+0000 7fa8619c4700 1 --2- 172.21.15.146:0/3818397784 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa85c1300a0 0x7fa85c1304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.939+0000 7fa8621c5700 1 -- 172.21.15.146:0/3818397784 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa85c1300a0 msgr2=0x7fa85c1304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:15.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.939+0000 7fa8611c3700 1 -- 172.21.15.146:0/3818397784 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895653784 0 0) 0x7fa85c06b2d0 con 0x7fa85c1309f0 2023-10-03T10:19:15.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.939+0000 7fa8621c5700 1 --2- 172.21.15.146:0/3818397784 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa85c1300a0 0x7fa85c1304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.939+0000 7fa8621c5700 1 -- 172.21.15.146:0/3818397784 >> v1:172.21.15.146:6789/0 conn(0x7fa85c1309f0 legacy=0x7fa85c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.939+0000 7fa8621c5700 1 -- 172.21.15.146:0/3818397784 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85c1338b0 con 0x7fa85c133ad0 2023-10-03T10:19:15.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.939+0000 7fa8619c4700 1 --2- 172.21.15.146:0/3818397784 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa85c1300a0 0x7fa85c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:15.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.940+0000 7fa8621c5700 1 --2- 172.21.15.146:0/3818397784 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c133ad0 0x7fa85c133ea0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fa858009870 tx=0x7fa858009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5491708cdee1157 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.940+0000 7fa8611c3700 1 -- 172.21.15.146:0/3818397784 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858011830 con 0x7fa85c133ad0 2023-10-03T10:19:15.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.940+0000 7fa8611c3700 1 -- 172.21.15.146:0/3818397784 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa858011990 con 0x7fa85c133ad0 2023-10-03T10:19:15.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.940+0000 7fa8611c3700 1 -- 172.21.15.146:0/3818397784 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858011d20 con 0x7fa85c133ad0 2023-10-03T10:19:15.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.940+0000 7fa864429700 1 -- 172.21.15.146:0/3818397784 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c133ad0 msgr2=0x7fa85c133ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.940+0000 7fa864429700 1 --2- 172.21.15.146:0/3818397784 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c133ad0 0x7fa85c133ea0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fa858009870 tx=0x7fa858009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:15.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.940+0000 7fa864429700 1 -- 172.21.15.146:0/3818397784 shutdown_connections 2023-10-03T10:19:15.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.940+0000 7fa864429700 1 --2- 172.21.15.146:0/3818397784 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c133ad0 0x7fa85c133ea0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.940+0000 7fa864429700 1 --2- 172.21.15.146:0/3818397784 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa85c1300a0 0x7fa85c1304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.940+0000 7fa864429700 1 -- 172.21.15.146:0/3818397784 >> 172.21.15.146:0/3818397784 conn(0x7fa85c099c40 msgr2=0x7fa85c0a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.940+0000 7fa864429700 1 -- 172.21.15.146:0/3818397784 shutdown_connections 2023-10-03T10:19:15.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.940+0000 7fa864429700 1 -- 172.21.15.146:0/3818397784 wait complete. 2023-10-03T10:19:15.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.942+0000 7fa864429700 1 Processor -- start 2023-10-03T10:19:15.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.942+0000 7fa864429700 1 -- start start 2023-10-03T10:19:15.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.942+0000 7fa864429700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa85c1300a0 0x7fa85c11da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.942+0000 7fa864429700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c1309f0 0x7fa85c11df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.942+0000 7fa864429700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa85c133ad0 0x7fa85c11e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.942+0000 7fa864429700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c120ad0 con 0x7fa85c133ad0 2023-10-03T10:19:15.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.942+0000 7fa864429700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c11fbe0 con 0x7fa85c1309f0 2023-10-03T10:19:15.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.942+0000 7fa864429700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c11f880 con 0x7fa85c1300a0 2023-10-03T10:19:15.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.943+0000 7fa8629c6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa85c133ad0 0x7fa85c11e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.943+0000 7fa8621c5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa85c1300a0 0x7fa85c11da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.943+0000 7fa8621c5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa85c1300a0 0x7fa85c11da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:60482/0 (socket says 172.21.15.146:60482) 2023-10-03T10:19:15.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.943+0000 7fa8621c5700 1 -- 172.21.15.146:0/3717123021 learned_addr learned my addr 172.21.15.146:0/3717123021 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:19:15.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.943+0000 7fa8629c6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa85c133ad0 0x7fa85c11e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47944/0 (socket says 172.21.15.146:47944) 2023-10-03T10:19:15.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.943+0000 7fa8619c4700 1 --2- 172.21.15.146:0/3717123021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c1309f0 0x7fa85c11df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.943+0000 7fa8621c5700 1 -- 172.21.15.146:0/3717123021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c1309f0 msgr2=0x7fa85c11df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.943+0000 7fa8621c5700 1 --2- 172.21.15.146:0/3717123021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c1309f0 0x7fa85c11df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.943+0000 7fa8621c5700 1 -- 172.21.15.146:0/3717123021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa85c133ad0 msgr2=0x7fa85c11e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.943+0000 7fa8621c5700 1 --2- 172.21.15.146:0/3717123021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa85c133ad0 0x7fa85c11e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.943+0000 7fa8621c5700 1 -- 172.21.15.146:0/3717123021 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84c0094a0 con 0x7fa85c1300a0 2023-10-03T10:19:15.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.943+0000 7fa8629c6700 1 --2- 172.21.15.146:0/3717123021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa85c133ad0 0x7fa85c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:15.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.943+0000 7fa8619c4700 1 --2- 172.21.15.146:0/3717123021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c1309f0 0x7fa85c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:15.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.943+0000 7fa8621c5700 1 --2- 172.21.15.146:0/3717123021 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa85c1300a0 0x7fa85c11da40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fa8580090b0 tx=0x7fa858004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.943+0000 7fa852ffd700 1 -- 172.21.15.146:0/3717123021 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858004510 con 0x7fa85c1300a0 2023-10-03T10:19:15.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.943+0000 7fa852ffd700 1 -- 172.21.15.146:0/3717123021 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8580036a0 con 0x7fa85c1300a0 2023-10-03T10:19:15.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.943+0000 7fa864429700 1 -- 172.21.15.146:0/3717123021 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8580094a0 con 0x7fa85c1300a0 2023-10-03T10:19:15.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.943+0000 7fa852ffd700 1 -- 172.21.15.146:0/3717123021 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858003a50 con 0x7fa85c1300a0 2023-10-03T10:19:15.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.943+0000 7fa864429700 1 -- 172.21.15.146:0/3717123021 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa85c1200f0 con 0x7fa85c1300a0 2023-10-03T10:19:15.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.944+0000 7fa852ffd700 1 -- 172.21.15.146:0/3717123021 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa858003bb0 con 0x7fa85c1300a0 2023-10-03T10:19:15.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.944+0000 7fa852ffd700 1 -- 172.21.15.146:0/3717123021 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa8580409a0 con 0x7fa85c1300a0 2023-10-03T10:19:15.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.944+0000 7fa864429700 1 -- 172.21.15.146:0/3717123021 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa85c04f2a0 con 0x7fa85c1300a0 2023-10-03T10:19:15.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:15.949+0000 7fa852ffd700 1 -- 172.21.15.146:0/3717123021 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa85801a420 con 0x7fa85c1300a0 2023-10-03T10:19:16.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:16.099+0000 7fee011c2700 1 -- 172.21.15.146:0/3685676543 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fedfc120bb0 con 0x7fedfc139200 2023-10-03T10:19:16.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:16.100+0000 7fede37fe700 1 -- 172.21.15.146:0/3685676543 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fedf402b090 con 0x7fedfc139200 2023-10-03T10:19:16.099 INFO:teuthology.orchestra.run.smithi146.stdout:120259084290 2023-10-03T10:19:16.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:16.102+0000 7fee011c2700 1 -- 172.21.15.146:0/3685676543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedfc139200 msgr2=0x7fedfc11f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:16.102+0000 7fee011c2700 1 --2- 172.21.15.146:0/3685676543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedfc139200 0x7fedfc11f230 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fedf400ef90 tx=0x7fedf400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:16.102+0000 7fee011c2700 1 -- 172.21.15.146:0/3685676543 shutdown_connections 2023-10-03T10:19:16.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:16.102+0000 7fee011c2700 1 --2- 172.21.15.146:0/3685676543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedfc139200 0x7fedfc11f230 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:16.102+0000 7fee011c2700 1 --2- 172.21.15.146:0/3685676543 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fedfc0a0a70 0x7fedfc11e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:16.102+0000 7fee011c2700 1 --2- 172.21.15.146:0/3685676543 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fedfc0a1550 0x7fedfc11ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:16.102+0000 7fee011c2700 1 -- 172.21.15.146:0/3685676543 >> 172.21.15.146:0/3685676543 conn(0x7fedfc0a6610 msgr2=0x7fedfc0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:16.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:16.102+0000 7fee011c2700 1 -- 172.21.15.146:0/3685676543 shutdown_connections 2023-10-03T10:19:16.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:16.102+0000 7fee011c2700 1 -- 172.21.15.146:0/3685676543 wait complete. 2023-10-03T10:19:16.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.0 2023-10-03T10:19:16.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:16.142+0000 7fa864429700 1 -- 172.21.15.146:0/3717123021 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa85c06c3b0 con 0x7fa85c1300a0 2023-10-03T10:19:16.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:16.142+0000 7fa852ffd700 1 -- 172.21.15.146:0/3717123021 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa858015020 con 0x7fa85c1300a0 2023-10-03T10:19:16.142 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-03T10:19:16.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:16.145+0000 7fa864429700 1 -- 172.21.15.146:0/3717123021 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa85c1300a0 msgr2=0x7fa85c11da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:16.145+0000 7fa864429700 1 --2- 172.21.15.146:0/3717123021 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa85c1300a0 0x7fa85c11da40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fa8580090b0 tx=0x7fa858004750 comp rx=0 tx=0).stop 2023-10-03T10:19:16.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:16.145+0000 7fa864429700 1 -- 172.21.15.146:0/3717123021 shutdown_connections 2023-10-03T10:19:16.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:16.145+0000 7fa864429700 1 --2- 172.21.15.146:0/3717123021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa85c133ad0 0x7fa85c11e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:16.145+0000 7fa864429700 1 --2- 172.21.15.146:0/3717123021 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa85c1300a0 0x7fa85c11da40 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:16.145+0000 7fa864429700 1 --2- 172.21.15.146:0/3717123021 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa85c1309f0 0x7fa85c11df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:16.145+0000 7fa864429700 1 -- 172.21.15.146:0/3717123021 >> 172.21.15.146:0/3717123021 conn(0x7fa85c099c40 msgr2=0x7fa85c12e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:16.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:16.145+0000 7fa864429700 1 -- 172.21.15.146:0/3717123021 shutdown_connections 2023-10-03T10:19:16.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:19:16.145+0000 7fa864429700 1 -- 172.21.15.146:0/3717123021 wait complete. 2023-10-03T10:19:16.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.3 2023-10-03T10:21:15.205 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-03T10:21:15.205 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1496, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi146 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:21:15.275 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=7c3680069d404d0da1fb634ea117a8d3 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1496, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi146 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:21:15.279 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-10-03T10:21:15.289 DEBUG:teuthology.run_tasks:Unwinding manager ceph.stop 2023-10-03T10:21:15.330 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-10-03T10:21:15.418 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-10-03T10:21:15.435 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2023-10-03T10:21:15.449 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-03T10:21:15.458 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-03T10:21:15.458 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-03T10:21:15.458 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T10:21:15.484 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-03T10:21:15.485 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T10:21:15.547 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:21:15.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.682+0000 7f5811c12700 1 Processor -- start 2023-10-03T10:21:15.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.682+0000 7f5811c12700 1 -- start start 2023-10-03T10:21:15.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f5811c12700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f580c09e870 0x7f580c09ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:15.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f5811c12700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f580c09f180 0x7f580c133c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:15.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f5811c12700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f580c134160 0x7f580c134600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:15.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f5811c12700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f580c0a0370 con 0x7f580c09f180 2023-10-03T10:21:15.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f5811c12700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580c09fa00 con 0x7f580c134160 2023-10-03T10:21:15.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f5811c12700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f580c09ada0 con 0x7f580c09e870 2023-10-03T10:21:15.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f580bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f580c134160 0x7f580c134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:15.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f580b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f580c09e870 0x7f580c09ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:15.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f580affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f580c09f180 0x7f580c133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:15.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f580bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f580c134160 0x7f580c134600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45624/0 (socket says 172.21.15.146:45624) 2023-10-03T10:21:15.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f580b7fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f580c09e870 0x7f580c09ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40344/0 (socket says 172.21.15.146:40344) 2023-10-03T10:21:15.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f580bfff700 1 -- 172.21.15.146:0/678121236 learned_addr learned my addr 172.21.15.146:0/678121236 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:21:15.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f580bfff700 1 -- 172.21.15.146:0/678121236 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f580c09e870 msgr2=0x7f580c09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:15.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f580bfff700 1 --2- 172.21.15.146:0/678121236 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f580c09e870 0x7f580c09ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:15.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f580bfff700 1 -- 172.21.15.146:0/678121236 >> v2:172.21.15.146:3300/0 conn(0x7f580c09f180 msgr2=0x7f580c133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:15.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f580bfff700 1 --2- 172.21.15.146:0/678121236 >> v2:172.21.15.146:3300/0 conn(0x7f580c09f180 0x7f580c133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:15.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f580bfff700 1 -- 172.21.15.146:0/678121236 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c06bec0 con 0x7f580c134160 2023-10-03T10:21:15.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f580b7fe700 1 --2- 172.21.15.146:0/678121236 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f580c09e870 0x7f580c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:15.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f580affd700 1 --2- 172.21.15.146:0/678121236 >> v2:172.21.15.146:3300/0 conn(0x7f580c09f180 0x7f580c133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:15.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f580bfff700 1 --2- 172.21.15.146:0/678121236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f580c134160 0x7f580c134600 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f5804009e50 tx=0x7f580400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25b703a80dc6b08c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:15.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f580a7fc700 1 -- 172.21.15.146:0/678121236 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580400e070 con 0x7f580c134160 2023-10-03T10:21:15.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f580a7fc700 1 -- 172.21.15.146:0/678121236 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580400b910 con 0x7f580c134160 2023-10-03T10:21:15.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.683+0000 7f580a7fc700 1 -- 172.21.15.146:0/678121236 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580400bcc0 con 0x7f580c134160 2023-10-03T10:21:15.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.684+0000 7f5811c12700 1 -- 172.21.15.146:0/678121236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f580c134160 msgr2=0x7f580c134600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:15.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.684+0000 7f5811c12700 1 --2- 172.21.15.146:0/678121236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f580c134160 0x7f580c134600 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f5804009e50 tx=0x7f580400b330 comp rx=0 tx=0).stop 2023-10-03T10:21:15.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.684+0000 7f5811c12700 1 -- 172.21.15.146:0/678121236 shutdown_connections 2023-10-03T10:21:15.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.684+0000 7f5811c12700 1 --2- 172.21.15.146:0/678121236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f580c134160 0x7f580c134600 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:15.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.684+0000 7f5811c12700 1 --2- 172.21.15.146:0/678121236 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f580c09e870 0x7f580c09ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:15.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.684+0000 7f5811c12700 1 --2- 172.21.15.146:0/678121236 >> v2:172.21.15.146:3300/0 conn(0x7f580c09f180 0x7f580c133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:15.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.684+0000 7f5811c12700 1 -- 172.21.15.146:0/678121236 >> 172.21.15.146:0/678121236 conn(0x7f580c0a4430 msgr2=0x7f580c0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:15.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.684+0000 7f5811c12700 1 -- 172.21.15.146:0/678121236 shutdown_connections 2023-10-03T10:21:15.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.684+0000 7f5811c12700 1 -- 172.21.15.146:0/678121236 wait complete. 2023-10-03T10:21:15.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.685+0000 7f5811c12700 1 Processor -- start 2023-10-03T10:21:15.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.685+0000 7f5811c12700 1 -- start start 2023-10-03T10:21:15.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f5811c12700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f580c09e870 0x7f580c1c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:15.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f5811c12700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f580c09f180 0x7f580c1c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:15.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f5811c12700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f580c134160 0x7f580c1c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:15.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f5811c12700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580c122720 con 0x7f580c09f180 2023-10-03T10:21:15.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f5811c12700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580c120a60 con 0x7f580c09e870 2023-10-03T10:21:15.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f5811c12700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f580c0a3ba0 con 0x7f580c134160 2023-10-03T10:21:15.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f580b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f580c09e870 0x7f580c1c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:15.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f580affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f580c09f180 0x7f580c1c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:15.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f580b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f580c09e870 0x7f580c1c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45636/0 (socket says 172.21.15.146:45636) 2023-10-03T10:21:15.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f580b7fe700 1 -- 172.21.15.146:0/3133223624 learned_addr learned my addr 172.21.15.146:0/3133223624 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:21:15.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f580affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f580c09f180 0x7f580c1c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53690/0 (socket says 172.21.15.146:53690) 2023-10-03T10:21:15.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f580bfff700 1 --2- 172.21.15.146:0/3133223624 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f580c134160 0x7f580c1c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:15.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f580b7fe700 1 -- 172.21.15.146:0/3133223624 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f580c134160 msgr2=0x7f580c1c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f580b7fe700 1 --2- 172.21.15.146:0/3133223624 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f580c134160 0x7f580c1c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f580b7fe700 1 -- 172.21.15.146:0/3133223624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f580c09f180 msgr2=0x7f580c1c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f580b7fe700 1 --2- 172.21.15.146:0/3133223624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f580c09f180 0x7f580c1c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f580b7fe700 1 -- 172.21.15.146:0/3133223624 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f40094a0 con 0x7f580c09e870 2023-10-03T10:21:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f580affd700 1 --2- 172.21.15.146:0/3133223624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f580c09f180 0x7f580c1c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f580bfff700 1 --2- 172.21.15.146:0/3133223624 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f580c134160 0x7f580c1c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f580b7fe700 1 --2- 172.21.15.146:0/3133223624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f580c09e870 0x7f580c1c8460 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f57f400ebe0 tx=0x7f57f400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f5803fff700 1 -- 172.21.15.146:0/3133223624 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f4009760 con 0x7f580c09e870 2023-10-03T10:21:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f5803fff700 1 -- 172.21.15.146:0/3133223624 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f400c850 con 0x7f580c09e870 2023-10-03T10:21:15.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f5811c12700 1 -- 172.21.15.146:0/3133223624 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57fc0094a0 con 0x7f580c09e870 2023-10-03T10:21:15.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f5803fff700 1 -- 172.21.15.146:0/3133223624 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f400cbe0 con 0x7f580c09e870 2023-10-03T10:21:15.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.686+0000 7f5811c12700 1 -- 172.21.15.146:0/3133223624 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5804009b30 con 0x7f580c09e870 2023-10-03T10:21:15.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.687+0000 7f5803fff700 1 -- 172.21.15.146:0/3133223624 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f57f400cd40 con 0x7f580c09e870 2023-10-03T10:21:15.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.687+0000 7f5811c12700 1 -- 172.21.15.146:0/3133223624 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f580c04f2a0 con 0x7f580c09e870 2023-10-03T10:21:15.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.687+0000 7f5803fff700 1 -- 172.21.15.146:0/3133223624 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f57f403fac0 con 0x7f580c09e870 2023-10-03T10:21:15.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.692+0000 7f5803fff700 1 -- 172.21.15.146:0/3133223624 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f57f401b3b0 con 0x7f580c09e870 2023-10-03T10:21:15.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.876+0000 7f5811c12700 1 -- 172.21.15.146:0/3133223624 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f580c0a3620 con 0x7f580c09e870 2023-10-03T10:21:15.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.877+0000 7f5803fff700 1 -- 172.21.15.146:0/3133223624 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+13484 (secure 0 0 0) 0x7f57f4021070 con 0x7f580c09e870 2023-10-03T10:21:15.877 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:21:15.877 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":39,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:12:46.859836+0000","last_up_change":"2023-10-03T10:12:11.453728+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":129317}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":129317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":129317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":129317}]},"public_addr":"172.21.15.146:6800/129317","cluster_addr":"172.21.15.146:6801/129317","heartbeat_back_addr":"172.21.15.146:6803/129317","heartbeat_front_addr":"172.21.15.146:6802/129317","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":129415}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":129415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":129415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":129415}]},"public_addr":"172.21.15.146:6804/129415","cluster_addr":"172.21.15.146:6805/129415","heartbeat_back_addr":"172.21.15.146:6807/129415","heartbeat_front_addr":"172.21.15.146:6806/129415","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":129525}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":129525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":129525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":129525}]},"public_addr":"172.21.15.146:6808/129525","cluster_addr":"172.21.15.146:6809/129525","heartbeat_back_addr":"172.21.15.146:6811/129525","heartbeat_front_addr":"172.21.15.146:6810/129525","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":129865}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":129865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":129865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":129865}]},"public_addr":"172.21.15.146:6812/129865","cluster_addr":"172.21.15.146:6813/129865","heartbeat_back_addr":"172.21.15.146:6815/129865","heartbeat_front_addr":"172.21.15.146:6814/129865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":25},{"osd":3,"down_stamp":"2023-10-03T10:12:05.426236+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:0/1965600138":"2023-10-04T10:12:46.859809+0000","172.21.15.146:0/1702650323":"2023-10-04T10:12:46.859809+0000","172.21.15.146:0/2857084049":"2023-10-04T10:12:46.859809+0000","172.21.15.146:0/784768892":"2023-10-04T10:12:46.859809+0000","172.21.15.146:6816/118159":"2023-10-04T10:11:52.317723+0000","172.21.15.146:0/3123391800":"2023-10-04T10:12:46.859809+0000","172.21.15.146:0/45915595":"2023-10-04T10:11:52.317723+0000","172.21.15.146:0/1896339219":"2023-10-04T10:11:52.317723+0000","172.21.15.146:6817/4164614194":"2023-10-04T10:12:13.686998+0000","172.21.15.146:0/807364756":"2023-10-04T10:12:46.859809+0000","172.21.15.146:6816/126749":"2023-10-04T10:12:46.859809+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:21:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.879+0000 7f5811c12700 1 -- 172.21.15.146:0/3133223624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f580c09e870 msgr2=0x7f580c1c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.879+0000 7f5811c12700 1 --2- 172.21.15.146:0/3133223624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f580c09e870 0x7f580c1c8460 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f57f400ebe0 tx=0x7f57f400eef0 comp rx=0 tx=0).stop 2023-10-03T10:21:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.879+0000 7f5811c12700 1 -- 172.21.15.146:0/3133223624 shutdown_connections 2023-10-03T10:21:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.879+0000 7f5811c12700 1 --2- 172.21.15.146:0/3133223624 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f580c134160 0x7f580c1c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.879+0000 7f5811c12700 1 --2- 172.21.15.146:0/3133223624 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f580c09e870 0x7f580c1c8460 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:15.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.879+0000 7f5811c12700 1 --2- 172.21.15.146:0/3133223624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f580c09f180 0x7f580c1c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:15.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.879+0000 7f5811c12700 1 -- 172.21.15.146:0/3133223624 >> 172.21.15.146:0/3133223624 conn(0x7f580c0a4430 msgr2=0x7f580c070900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:15.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.879+0000 7f5811c12700 1 -- 172.21.15.146:0/3133223624 shutdown_connections 2023-10-03T10:21:15.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:15.879+0000 7f5811c12700 1 -- 172.21.15.146:0/3133223624 wait complete. 2023-10-03T10:21:15.891 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T10:09:42.343363+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:43.224375+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:47.108480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:47.686814+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T10:21:15.892 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T10:21:16.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.017+0000 7f1d14de5700 1 Processor -- start 2023-10-03T10:21:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.017+0000 7f1d14de5700 1 -- start start 2023-10-03T10:21:16.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.018+0000 7f1d14de5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d1012f910 0x7f1d1012fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:16.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.018+0000 7f1d14de5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d10130220 0x7f1d1012c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:16.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.018+0000 7f1d14de5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1d1012c8a0 0x7f1d1012cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:16.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.018+0000 7f1d14de5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d100709c0 con 0x7f1d1012c8a0 2023-10-03T10:21:16.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.018+0000 7f1d14de5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d10099a60 con 0x7f1d10130220 2023-10-03T10:21:16.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.018+0000 7f1d14de5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d100706f0 con 0x7f1d1012f910 2023-10-03T10:21:16.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.018+0000 7f1d0e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d1012f910 0x7f1d1012fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:16.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.018+0000 7f1d0dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d10130220 0x7f1d1012c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:16.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.018+0000 7f1d0ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1d1012c8a0 0x7f1d1012cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:16.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.018+0000 7f1d0ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1d1012c8a0 0x7f1d1012cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53694/0 (socket says 172.21.15.146:53694) 2023-10-03T10:21:16.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.018+0000 7f1d0dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d10130220 0x7f1d1012c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45650/0 (socket says 172.21.15.146:45650) 2023-10-03T10:21:16.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.018+0000 7f1d0e59c700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d1012f910 0x7f1d1012fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40358/0 (socket says 172.21.15.146:40358) 2023-10-03T10:21:16.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.018+0000 7f1d0ed9d700 1 -- 172.21.15.146:0/370408777 learned_addr learned my addr 172.21.15.146:0/370408777 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:21:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.018+0000 7f1d0e59c700 1 -- 172.21.15.146:0/370408777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d10130220 msgr2=0x7f1d1012c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.018+0000 7f1d0e59c700 1 --2- 172.21.15.146:0/370408777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d10130220 0x7f1d1012c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.018+0000 7f1d0e59c700 1 -- 172.21.15.146:0/370408777 >> v2:172.21.15.146:3300/0 conn(0x7f1d1012c8a0 msgr2=0x7f1d1012cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.018+0000 7f1d0e59c700 1 --2- 172.21.15.146:0/370408777 >> v2:172.21.15.146:3300/0 conn(0x7f1d1012c8a0 0x7f1d1012cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.018+0000 7f1d0e59c700 1 -- 172.21.15.146:0/370408777 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d10072190 con 0x7f1d1012f910 2023-10-03T10:21:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.018+0000 7f1d0ed9d700 1 --2- 172.21.15.146:0/370408777 >> v2:172.21.15.146:3300/0 conn(0x7f1d1012c8a0 0x7f1d1012cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.018+0000 7f1d0dd9b700 1 --2- 172.21.15.146:0/370408777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d10130220 0x7f1d1012c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.019+0000 7f1d0e59c700 1 --2- 172.21.15.146:0/370408777 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d1012f910 0x7f1d1012fce0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f1d04009840 tx=0x7f1d04009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d43c00ff0dde30e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:16.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.019+0000 7f1d0d59a700 1 -- 172.21.15.146:0/370408777 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04011830 con 0x7f1d1012f910 2023-10-03T10:21:16.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.019+0000 7f1d0d59a700 1 -- 172.21.15.146:0/370408777 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d04011990 con 0x7f1d1012f910 2023-10-03T10:21:16.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.019+0000 7f1d0d59a700 1 -- 172.21.15.146:0/370408777 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04011d20 con 0x7f1d1012f910 2023-10-03T10:21:16.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.019+0000 7f1d14de5700 1 -- 172.21.15.146:0/370408777 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d1012f910 msgr2=0x7f1d1012fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:16.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.019+0000 7f1d14de5700 1 --2- 172.21.15.146:0/370408777 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d1012f910 0x7f1d1012fce0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f1d04009840 tx=0x7f1d04009b50 comp rx=0 tx=0).stop 2023-10-03T10:21:16.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.019+0000 7f1d14de5700 1 -- 172.21.15.146:0/370408777 shutdown_connections 2023-10-03T10:21:16.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.019+0000 7f1d14de5700 1 --2- 172.21.15.146:0/370408777 >> v2:172.21.15.146:3300/0 conn(0x7f1d1012c8a0 0x7f1d1012cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.019+0000 7f1d14de5700 1 --2- 172.21.15.146:0/370408777 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d1012f910 0x7f1d1012fce0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.019+0000 7f1d14de5700 1 --2- 172.21.15.146:0/370408777 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d10130220 0x7f1d1012c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.019+0000 7f1d14de5700 1 -- 172.21.15.146:0/370408777 >> 172.21.15.146:0/370408777 conn(0x7f1d1009f3f0 msgr2=0x7f1d1009f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:16.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.019+0000 7f1d14de5700 1 -- 172.21.15.146:0/370408777 shutdown_connections 2023-10-03T10:21:16.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.019+0000 7f1d14de5700 1 -- 172.21.15.146:0/370408777 wait complete. 2023-10-03T10:21:16.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.021+0000 7f1d14de5700 1 Processor -- start 2023-10-03T10:21:16.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.021+0000 7f1d14de5700 1 -- start start 2023-10-03T10:21:16.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.021+0000 7f1d14de5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d1012c8a0 0x7f1d101c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:16.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.021+0000 7f1d14de5700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d1012f910 0x7f1d101c4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:16.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.021+0000 7f1d14de5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d10130220 0x7f1d101c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:16.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.021+0000 7f1d14de5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1009cce0 con 0x7f1d1012c8a0 2023-10-03T10:21:16.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.021+0000 7f1d14de5700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1009caf0 con 0x7f1d1012f910 2023-10-03T10:21:16.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.021+0000 7f1d14de5700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1009e790 con 0x7f1d10130220 2023-10-03T10:21:16.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.022+0000 7f1d0e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d1012c8a0 0x7f1d101c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:16.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.022+0000 7f1d0dd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d1012f910 0x7f1d101c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:16.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.022+0000 7f1d0e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d1012c8a0 0x7f1d101c3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53700/0 (socket says 172.21.15.146:53700) 2023-10-03T10:21:16.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.022+0000 7f1d0e59c700 1 -- 172.21.15.146:0/2998500284 learned_addr learned my addr 172.21.15.146:0/2998500284 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:21:16.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.022+0000 7f1d0ed9d700 1 --2- 172.21.15.146:0/2998500284 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d10130220 0x7f1d101c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:16.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.022+0000 7f1d0dd9b700 1 -- 172.21.15.146:0/2998500284 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d10130220 msgr2=0x7f1d101c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:16.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.022+0000 7f1d0dd9b700 1 --2- 172.21.15.146:0/2998500284 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d10130220 0x7f1d101c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.022+0000 7f1d0dd9b700 1 -- 172.21.15.146:0/2998500284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d1012c8a0 msgr2=0x7f1d101c3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:16.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.022+0000 7f1d0dd9b700 1 --2- 172.21.15.146:0/2998500284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d1012c8a0 0x7f1d101c3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.022+0000 7f1d0dd9b700 1 -- 172.21.15.146:0/2998500284 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0800bd40 con 0x7f1d1012f910 2023-10-03T10:21:16.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.022+0000 7f1d0e59c700 1 --2- 172.21.15.146:0/2998500284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d1012c8a0 0x7f1d101c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:16.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.022+0000 7f1d0ed9d700 1 --2- 172.21.15.146:0/2998500284 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d10130220 0x7f1d101c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:16.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.022+0000 7f1d0dd9b700 1 --2- 172.21.15.146:0/2998500284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d1012f910 0x7f1d101c4290 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000e9e0 tx=0x7f1d0000ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:16.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.022+0000 7f1cfeffd700 1 -- 172.21.15.146:0/2998500284 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0000ee80 con 0x7f1d1012f910 2023-10-03T10:21:16.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.022+0000 7f1cfeffd700 1 -- 172.21.15.146:0/2998500284 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0000c850 con 0x7f1d1012f910 2023-10-03T10:21:16.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.022+0000 7f1d14de5700 1 -- 172.21.15.146:0/2998500284 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d000094a0 con 0x7f1d1012f910 2023-10-03T10:21:16.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.022+0000 7f1cfeffd700 1 -- 172.21.15.146:0/2998500284 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0000cbe0 con 0x7f1d1012f910 2023-10-03T10:21:16.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.022+0000 7f1d14de5700 1 -- 172.21.15.146:0/2998500284 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d040094a0 con 0x7f1d1012f910 2023-10-03T10:21:16.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.023+0000 7f1cfeffd700 1 -- 172.21.15.146:0/2998500284 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d0000cd40 con 0x7f1d1012f910 2023-10-03T10:21:16.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.023+0000 7f1cfeffd700 1 -- 172.21.15.146:0/2998500284 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f1d0003f630 con 0x7f1d1012f910 2023-10-03T10:21:16.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.023+0000 7f1d14de5700 1 -- 172.21.15.146:0/2998500284 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d1004f2a0 con 0x7f1d1012f910 2023-10-03T10:21:16.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.028+0000 7f1cfeffd700 1 -- 172.21.15.146:0/2998500284 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d000232f0 con 0x7f1d1012f910 2023-10-03T10:21:16.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.210+0000 7f1d14de5700 1 -- 172.21.15.146:0/2998500284 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1d100717e0 con 0x7f1d1012f910 2023-10-03T10:21:16.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.210+0000 7f1cfeffd700 1 -- 172.21.15.146:0/2998500284 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1d00021020 con 0x7f1d1012f910 2023-10-03T10:21:16.210 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-03T10:21:16.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.212+0000 7f1d14de5700 1 -- 172.21.15.146:0/2998500284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d1012f910 msgr2=0x7f1d101c4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:16.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.212+0000 7f1d14de5700 1 --2- 172.21.15.146:0/2998500284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d1012f910 0x7f1d101c4290 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000e9e0 tx=0x7f1d0000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.212+0000 7f1d14de5700 1 -- 172.21.15.146:0/2998500284 shutdown_connections 2023-10-03T10:21:16.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.212+0000 7f1d14de5700 1 --2- 172.21.15.146:0/2998500284 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f1d10130220 0x7f1d101c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.212+0000 7f1d14de5700 1 --2- 172.21.15.146:0/2998500284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d1012c8a0 0x7f1d101c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.212+0000 7f1d14de5700 1 --2- 172.21.15.146:0/2998500284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d1012f910 0x7f1d101c4290 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.212+0000 7f1d14de5700 1 -- 172.21.15.146:0/2998500284 >> 172.21.15.146:0/2998500284 conn(0x7f1d1009f3f0 msgr2=0x7f1d1006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.212+0000 7f1d14de5700 1 -- 172.21.15.146:0/2998500284 shutdown_connections 2023-10-03T10:21:16.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.212+0000 7f1d14de5700 1 -- 172.21.15.146:0/2998500284 wait complete. 2023-10-03T10:21:16.224 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:21:16.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.349+0000 7f270e614700 1 Processor -- start 2023-10-03T10:21:16.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.349+0000 7f270e614700 1 -- start start 2023-10-03T10:21:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.350+0000 7f270e614700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f270809d780 0x7f270809db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.350+0000 7f270e614700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2708130d90 0x7f2708138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.350+0000 7f270e614700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f270809e910 con 0x7f270809e090 2023-10-03T10:21:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.350+0000 7f270e614700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f270809d430 con 0x7f2708130d90 2023-10-03T10:21:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.350+0000 7f270e614700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270809b380 con 0x7f270809d780 2023-10-03T10:21:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.350+0000 7f2707fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f270809d780 0x7f270809db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.350+0000 7f270cbb1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2708130d90 0x7f2708138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.350+0000 7f27077fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f270809e090 0x7f2708130680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59736/0 (socket says 172.21.15.146:59736) 2023-10-03T10:21:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.350+0000 7f2707fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f270809d780 0x7f270809db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45660/0 (socket says 172.21.15.146:45660) 2023-10-03T10:21:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.350+0000 7f27077fe700 1 -- 172.21.15.146:0/2137044017 learned_addr learned my addr 172.21.15.146:0/2137044017 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:21:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.350+0000 7f270cbb1700 1 -- 172.21.15.146:0/2137044017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f270809d780 msgr2=0x7f270809db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.350+0000 7f270cbb1700 1 --2- 172.21.15.146:0/2137044017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f270809d780 0x7f270809db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.350+0000 7f270cbb1700 1 -- 172.21.15.146:0/2137044017 >> v1:172.21.15.146:6789/0 conn(0x7f270809e090 legacy=0x7f2708130680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.350+0000 7f2706ffd700 1 -- 172.21.15.146:0/2137044017 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977389444 0 0) 0x7f270809e910 con 0x7f270809e090 2023-10-03T10:21:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.350+0000 7f270cbb1700 1 -- 172.21.15.146:0/2137044017 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270809f570 con 0x7f2708130d90 2023-10-03T10:21:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.350+0000 7f2707fff700 1 --2- 172.21.15.146:0/2137044017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f270809d780 0x7f270809db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.350+0000 7f270cbb1700 1 --2- 172.21.15.146:0/2137044017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2708130d90 0x7f2708138af0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f2700009d90 tx=0x7f270000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b632b0279acde9ff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.350+0000 7f2706ffd700 1 -- 172.21.15.146:0/2137044017 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270000e070 con 0x7f2708130d90 2023-10-03T10:21:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.350+0000 7f2706ffd700 1 -- 172.21.15.146:0/2137044017 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270000bb20 con 0x7f2708130d90 2023-10-03T10:21:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.350+0000 7f2706ffd700 1 -- 172.21.15.146:0/2137044017 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2700012430 con 0x7f2708130d90 2023-10-03T10:21:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.351+0000 7f270e614700 1 -- 172.21.15.146:0/2137044017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2708130d90 msgr2=0x7f2708138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.351+0000 7f270e614700 1 --2- 172.21.15.146:0/2137044017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2708130d90 0x7f2708138af0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f2700009d90 tx=0x7f270000b330 comp rx=0 tx=0).stop 2023-10-03T10:21:16.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.351+0000 7f270e614700 1 -- 172.21.15.146:0/2137044017 shutdown_connections 2023-10-03T10:21:16.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.351+0000 7f270e614700 1 --2- 172.21.15.146:0/2137044017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2708130d90 0x7f2708138af0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.351+0000 7f270e614700 1 --2- 172.21.15.146:0/2137044017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f270809d780 0x7f270809db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.351+0000 7f270e614700 1 -- 172.21.15.146:0/2137044017 >> 172.21.15.146:0/2137044017 conn(0x7f270809f980 msgr2=0x7f270809fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:16.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.351+0000 7f270e614700 1 -- 172.21.15.146:0/2137044017 shutdown_connections 2023-10-03T10:21:16.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.351+0000 7f270e614700 1 -- 172.21.15.146:0/2137044017 wait complete. 2023-10-03T10:21:16.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.352+0000 7f270e614700 1 Processor -- start 2023-10-03T10:21:16.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.352+0000 7f270e614700 1 -- start start 2023-10-03T10:21:16.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.352+0000 7f270e614700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f270809d780 0x7f27081c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.353+0000 7f270e614700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f270809e090 0x7f27081c5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.353+0000 7f270e614700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2708130d90 0x7f27081c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.353+0000 7f270e614700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270811d7e0 con 0x7f270809e090 2023-10-03T10:21:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.353+0000 7f270e614700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2708130680 con 0x7f270809d780 2023-10-03T10:21:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.353+0000 7f270e614700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f270811d340 con 0x7f2708130d90 2023-10-03T10:21:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.353+0000 7f2707fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f270809d780 0x7f27081c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.353+0000 7f2707fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f270809d780 0x7f27081c4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45668/0 (socket says 172.21.15.146:45668) 2023-10-03T10:21:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.353+0000 7f2707fff700 1 -- 172.21.15.146:0/1023536097 learned_addr learned my addr 172.21.15.146:0/1023536097 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:21:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.353+0000 7f270cbb1700 1 --2- 172.21.15.146:0/1023536097 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2708130d90 0x7f27081c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.353+0000 7f27077fe700 1 --2- 172.21.15.146:0/1023536097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f270809e090 0x7f27081c5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.353+0000 7f2707fff700 1 -- 172.21.15.146:0/1023536097 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2708130d90 msgr2=0x7f27081c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.353+0000 7f2707fff700 1 --2- 172.21.15.146:0/1023536097 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2708130d90 0x7f27081c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.353+0000 7f2707fff700 1 -- 172.21.15.146:0/1023536097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f270809e090 msgr2=0x7f27081c5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.353+0000 7f2707fff700 1 --2- 172.21.15.146:0/1023536097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f270809e090 0x7f27081c5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.353+0000 7f2707fff700 1 -- 172.21.15.146:0/1023536097 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f80094a0 con 0x7f270809d780 2023-10-03T10:21:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.353+0000 7f270cbb1700 1 --2- 172.21.15.146:0/1023536097 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2708130d90 0x7f27081c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.353+0000 7f2707fff700 1 --2- 172.21.15.146:0/1023536097 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f270809d780 0x7f27081c4de0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f26f8010df0 tx=0x7f26f800e640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.353+0000 7f2704ff9700 1 -- 172.21.15.146:0/1023536097 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f800eda0 con 0x7f270809d780 2023-10-03T10:21:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.353+0000 7f2704ff9700 1 -- 172.21.15.146:0/1023536097 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f8011450 con 0x7f270809d780 2023-10-03T10:21:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.353+0000 7f2704ff9700 1 -- 172.21.15.146:0/1023536097 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f80117c0 con 0x7f270809d780 2023-10-03T10:21:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.353+0000 7f270e614700 1 -- 172.21.15.146:0/1023536097 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2700009a70 con 0x7f270809d780 2023-10-03T10:21:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.353+0000 7f270e614700 1 -- 172.21.15.146:0/1023536097 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270811dad0 con 0x7f270809d780 2023-10-03T10:21:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.354+0000 7f2704ff9700 1 -- 172.21.15.146:0/1023536097 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f26f8011b30 con 0x7f270809d780 2023-10-03T10:21:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.354+0000 7f270e614700 1 -- 172.21.15.146:0/1023536097 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f270811eb00 con 0x7f270809d780 2023-10-03T10:21:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.354+0000 7f2704ff9700 1 -- 172.21.15.146:0/1023536097 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f26f8041ca0 con 0x7f270809d780 2023-10-03T10:21:16.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.359+0000 7f2704ff9700 1 -- 172.21.15.146:0/1023536097 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f26f8018e00 con 0x7f270809d780 2023-10-03T10:21:16.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.543+0000 7f270e614700 1 -- 172.21.15.146:0/1023536097 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f270804f2a0 con 0x7f270809d780 2023-10-03T10:21:16.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.544+0000 7f2704ff9700 1 -- 172.21.15.146:0/1023536097 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7f26f80202c0 con 0x7f270809d780 2023-10-03T10:21:16.544 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-03T10:21:16.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.546+0000 7f270e614700 1 -- 172.21.15.146:0/1023536097 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f270809d780 msgr2=0x7f27081c4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:16.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.546+0000 7f270e614700 1 --2- 172.21.15.146:0/1023536097 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f270809d780 0x7f27081c4de0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f26f8010df0 tx=0x7f26f800e640 comp rx=0 tx=0).stop 2023-10-03T10:21:16.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.546+0000 7f270e614700 1 -- 172.21.15.146:0/1023536097 shutdown_connections 2023-10-03T10:21:16.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.546+0000 7f270e614700 1 --2- 172.21.15.146:0/1023536097 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f2708130d90 0x7f27081c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.546+0000 7f270e614700 1 --2- 172.21.15.146:0/1023536097 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f270809d780 0x7f27081c4de0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.546+0000 7f270e614700 1 --2- 172.21.15.146:0/1023536097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f270809e090 0x7f27081c5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.546+0000 7f270e614700 1 -- 172.21.15.146:0/1023536097 >> 172.21.15.146:0/1023536097 conn(0x7f270809f980 msgr2=0x7f27081b89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:16.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.546+0000 7f270e614700 1 -- 172.21.15.146:0/1023536097 shutdown_connections 2023-10-03T10:21:16.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.546+0000 7f270e614700 1 -- 172.21.15.146:0/1023536097 wait complete. 2023-10-03T10:21:16.558 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:21:16.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.682+0000 7f7acd8c7700 1 Processor -- start 2023-10-03T10:21:16.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.682+0000 7f7acd8c7700 1 -- start start 2023-10-03T10:21:16.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.682+0000 7f7acd8c7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7ac80a0ae0 0x7f7ac80a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:16.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.682+0000 7f7acd8c7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ac80a13f0 0x7f7ac8133a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:16.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.682+0000 7f7acd8c7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ac8133f60 0x7f7ac81343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:16.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.682+0000 7f7acd8c7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac81348e0 con 0x7f7ac80a0ae0 2023-10-03T10:21:16.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.682+0000 7f7acd8c7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac809e740 con 0x7f7ac80a13f0 2023-10-03T10:21:16.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.682+0000 7f7acd8c7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac80a28d0 con 0x7f7ac8133f60 2023-10-03T10:21:16.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.683+0000 7f7ac6ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7ac80a0ae0 0x7f7ac80a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:16.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.683+0000 7f7ac67fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ac80a13f0 0x7f7ac8133a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:16.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.683+0000 7f7ac77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ac8133f60 0x7f7ac81343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:16.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.683+0000 7f7ac77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ac8133f60 0x7f7ac81343a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40388/0 (socket says 172.21.15.146:40388) 2023-10-03T10:21:16.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.683+0000 7f7ac67fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ac80a13f0 0x7f7ac8133a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45674/0 (socket says 172.21.15.146:45674) 2023-10-03T10:21:16.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.683+0000 7f7ac6ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7ac80a0ae0 0x7f7ac80a0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53736/0 (socket says 172.21.15.146:53736) 2023-10-03T10:21:16.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.683+0000 7f7ac77fe700 1 -- 172.21.15.146:0/3790273571 learned_addr learned my addr 172.21.15.146:0/3790273571 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:21:16.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.683+0000 7f7ac77fe700 1 -- 172.21.15.146:0/3790273571 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ac80a13f0 msgr2=0x7f7ac8133a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:16.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.683+0000 7f7ac77fe700 1 --2- 172.21.15.146:0/3790273571 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ac80a13f0 0x7f7ac8133a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.683+0000 7f7ac77fe700 1 -- 172.21.15.146:0/3790273571 >> v2:172.21.15.146:3300/0 conn(0x7f7ac80a0ae0 msgr2=0x7f7ac80a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.683+0000 7f7ac77fe700 1 --2- 172.21.15.146:0/3790273571 >> v2:172.21.15.146:3300/0 conn(0x7f7ac80a0ae0 0x7f7ac80a0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.683+0000 7f7ac77fe700 1 -- 172.21.15.146:0/3790273571 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac809db60 con 0x7f7ac8133f60 2023-10-03T10:21:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.683+0000 7f7ac67fc700 1 --2- 172.21.15.146:0/3790273571 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ac80a13f0 0x7f7ac8133a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.683+0000 7f7ac6ffd700 1 --2- 172.21.15.146:0/3790273571 >> v2:172.21.15.146:3300/0 conn(0x7f7ac80a0ae0 0x7f7ac80a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.683+0000 7f7ac77fe700 1 --2- 172.21.15.146:0/3790273571 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ac8133f60 0x7f7ac81343a0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0009e80 tx=0x7f7ac000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab8ee5c936e70444 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.683+0000 7f7ac5ffb700 1 -- 172.21.15.146:0/3790273571 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac000e070 con 0x7f7ac8133f60 2023-10-03T10:21:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.683+0000 7f7ac5ffb700 1 -- 172.21.15.146:0/3790273571 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac000b8d0 con 0x7f7ac8133f60 2023-10-03T10:21:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.683+0000 7f7ac5ffb700 1 -- 172.21.15.146:0/3790273571 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac000bc80 con 0x7f7ac8133f60 2023-10-03T10:21:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.684+0000 7f7acd8c7700 1 -- 172.21.15.146:0/3790273571 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ac8133f60 msgr2=0x7f7ac81343a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.684+0000 7f7acd8c7700 1 --2- 172.21.15.146:0/3790273571 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ac8133f60 0x7f7ac81343a0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0009e80 tx=0x7f7ac000b330 comp rx=0 tx=0).stop 2023-10-03T10:21:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.684+0000 7f7acd8c7700 1 -- 172.21.15.146:0/3790273571 shutdown_connections 2023-10-03T10:21:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.684+0000 7f7acd8c7700 1 --2- 172.21.15.146:0/3790273571 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ac8133f60 0x7f7ac81343a0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.684+0000 7f7acd8c7700 1 --2- 172.21.15.146:0/3790273571 >> v2:172.21.15.146:3300/0 conn(0x7f7ac80a0ae0 0x7f7ac80a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.684+0000 7f7acd8c7700 1 --2- 172.21.15.146:0/3790273571 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ac80a13f0 0x7f7ac8133a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.684+0000 7f7acd8c7700 1 -- 172.21.15.146:0/3790273571 >> 172.21.15.146:0/3790273571 conn(0x7f7ac80a2ec0 msgr2=0x7f7ac80a32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:16.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.684+0000 7f7acd8c7700 1 -- 172.21.15.146:0/3790273571 shutdown_connections 2023-10-03T10:21:16.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.684+0000 7f7acd8c7700 1 -- 172.21.15.146:0/3790273571 wait complete. 2023-10-03T10:21:16.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.685+0000 7f7acd8c7700 1 Processor -- start 2023-10-03T10:21:16.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.685+0000 7f7acd8c7700 1 -- start start 2023-10-03T10:21:16.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.685+0000 7f7acd8c7700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ac80a0ae0 0x7f7ac8122530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:16.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.685+0000 7f7acd8c7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac80a13f0 0x7f7ac8122a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:16.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.685+0000 7f7acd8c7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ac8133f60 0x7f7ac8122fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:16.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.685+0000 7f7acd8c7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac809f720 con 0x7f7ac80a13f0 2023-10-03T10:21:16.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.685+0000 7f7acd8c7700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac81246e0 con 0x7f7ac8133f60 2023-10-03T10:21:16.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.685+0000 7f7acd8c7700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac809fb20 con 0x7f7ac80a0ae0 2023-10-03T10:21:16.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.685+0000 7f7ac6ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ac80a0ae0 0x7f7ac8122530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:16.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.685+0000 7f7ac67fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac80a13f0 0x7f7ac8122a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:16.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.685+0000 7f7ac6ffd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ac80a0ae0 0x7f7ac8122530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40400/0 (socket says 172.21.15.146:40400) 2023-10-03T10:21:16.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.685+0000 7f7ac6ffd700 1 -- 172.21.15.146:0/3866228336 learned_addr learned my addr 172.21.15.146:0/3866228336 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:21:16.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.685+0000 7f7ac77fe700 1 --2- 172.21.15.146:0/3866228336 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ac8133f60 0x7f7ac8122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:16.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.686+0000 7f7ac6ffd700 1 -- 172.21.15.146:0/3866228336 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ac8133f60 msgr2=0x7f7ac8122fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:16.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.686+0000 7f7ac6ffd700 1 --2- 172.21.15.146:0/3866228336 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ac8133f60 0x7f7ac8122fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.686+0000 7f7ac6ffd700 1 -- 172.21.15.146:0/3866228336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac80a13f0 msgr2=0x7f7ac8122a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.686+0000 7f7ac6ffd700 1 --2- 172.21.15.146:0/3866228336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac80a13f0 0x7f7ac8122a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.686+0000 7f7ac6ffd700 1 -- 172.21.15.146:0/3866228336 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc0094a0 con 0x7f7ac80a0ae0 2023-10-03T10:21:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.686+0000 7f7ac67fc700 1 --2- 172.21.15.146:0/3866228336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac80a13f0 0x7f7ac8122a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.686+0000 7f7ac6ffd700 1 --2- 172.21.15.146:0/3866228336 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ac80a0ae0 0x7f7ac8122530 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f7abc00e980 tx=0x7f7abc00ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.686+0000 7f7aaffff700 1 -- 172.21.15.146:0/3866228336 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc0096e0 con 0x7f7ac80a0ae0 2023-10-03T10:21:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.686+0000 7f7aaffff700 1 -- 172.21.15.146:0/3866228336 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7abc013680 con 0x7f7ac80a0ae0 2023-10-03T10:21:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.686+0000 7f7acd8c7700 1 -- 172.21.15.146:0/3866228336 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab80094a0 con 0x7f7ac80a0ae0 2023-10-03T10:21:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.686+0000 7f7aaffff700 1 -- 172.21.15.146:0/3866228336 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc013a10 con 0x7f7ac80a0ae0 2023-10-03T10:21:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.686+0000 7f7acd8c7700 1 -- 172.21.15.146:0/3866228336 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac0009b30 con 0x7f7ac80a0ae0 2023-10-03T10:21:16.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.687+0000 7f7aaffff700 1 -- 172.21.15.146:0/3866228336 <== mon.2 v2:172.21.15.146:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7abc013b70 con 0x7f7ac80a0ae0 2023-10-03T10:21:16.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.687+0000 7f7aaffff700 1 -- 172.21.15.146:0/3866228336 <== mon.2 v2:172.21.15.146:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f7abc03fa40 con 0x7f7ac80a0ae0 2023-10-03T10:21:16.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.687+0000 7f7acd8c7700 1 -- 172.21.15.146:0/3866228336 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac8125900 con 0x7f7ac80a0ae0 2023-10-03T10:21:16.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.692+0000 7f7aaffff700 1 -- 172.21.15.146:0/3866228336 <== mon.2 v2:172.21.15.146:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7abc017080 con 0x7f7ac80a0ae0 2023-10-03T10:21:16.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.875+0000 7f7acd8c7700 1 -- 172.21.15.146:0/3866228336 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7ac80a6490 con 0x7f7ac80a0ae0 2023-10-03T10:21:16.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.875+0000 7f7aaffff700 1 -- 172.21.15.146:0/3866228336 <== mon.2 v2:172.21.15.146:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7abc011db0 con 0x7f7ac80a0ae0 2023-10-03T10:21:16.875 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-03T10:21:16.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.877+0000 7f7acd8c7700 1 -- 172.21.15.146:0/3866228336 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ac80a0ae0 msgr2=0x7f7ac8122530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:16.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.877+0000 7f7acd8c7700 1 --2- 172.21.15.146:0/3866228336 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ac80a0ae0 0x7f7ac8122530 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f7abc00e980 tx=0x7f7abc00ec90 comp rx=0 tx=0).stop 2023-10-03T10:21:16.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.877+0000 7f7acd8c7700 1 -- 172.21.15.146:0/3866228336 shutdown_connections 2023-10-03T10:21:16.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.877+0000 7f7acd8c7700 1 --2- 172.21.15.146:0/3866228336 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ac8133f60 0x7f7ac8122fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.877+0000 7f7acd8c7700 1 --2- 172.21.15.146:0/3866228336 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f7ac80a0ae0 0x7f7ac8122530 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.877+0000 7f7acd8c7700 1 --2- 172.21.15.146:0/3866228336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac80a13f0 0x7f7ac8122a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:16.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.877+0000 7f7acd8c7700 1 -- 172.21.15.146:0/3866228336 >> 172.21.15.146:0/3866228336 conn(0x7f7ac80a2ec0 msgr2=0x7f7ac811c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:16.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.878+0000 7f7acd8c7700 1 -- 172.21.15.146:0/3866228336 shutdown_connections 2023-10-03T10:21:16.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:16.878+0000 7f7acd8c7700 1 -- 172.21.15.146:0/3866228336 wait complete. 2023-10-03T10:21:16.889 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:21:17.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.015+0000 7fc369efc700 1 Processor -- start 2023-10-03T10:21:17.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.015+0000 7fc369efc700 1 -- start start 2023-10-03T10:21:17.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.016+0000 7fc369efc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc36409e870 0x7fc36409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:17.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.016+0000 7fc369efc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc364134290 0x7fc36413bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:17.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.016+0000 7fc369efc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3640a0300 con 0x7fc36409f180 2023-10-03T10:21:17.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.016+0000 7fc369efc700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36409adf0 con 0x7fc364134290 2023-10-03T10:21:17.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.016+0000 7fc369efc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc36406b920 con 0x7fc36409e870 2023-10-03T10:21:17.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.016+0000 7fc3637fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc36409e870 0x7fc36409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:17.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.016+0000 7fc363fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc364134290 0x7fc36413bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:17.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.016+0000 7fc3637fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc36409e870 0x7fc36409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40402/0 (socket says 172.21.15.146:40402) 2023-10-03T10:21:17.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.016+0000 7fc3637fe700 1 -- 172.21.15.146:0/3723873820 learned_addr learned my addr 172.21.15.146:0/3723873820 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:21:17.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.016+0000 7fc3637fe700 1 -- 172.21.15.146:0/3723873820 >> v2:172.21.15.146:3300/0 conn(0x7fc364134290 msgr2=0x7fc36413bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:17.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.016+0000 7fc3637fe700 1 --2- 172.21.15.146:0/3723873820 >> v2:172.21.15.146:3300/0 conn(0x7fc364134290 0x7fc36413bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.016+0000 7fc3637fe700 1 -- 172.21.15.146:0/3723873820 >> v1:172.21.15.146:6789/0 conn(0x7fc36409f180 legacy=0x7fc364133b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:17.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.016+0000 7fc3637fe700 1 -- 172.21.15.146:0/3723873820 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36409f9c0 con 0x7fc36409e870 2023-10-03T10:21:17.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.016+0000 7fc363fff700 1 --2- 172.21.15.146:0/3723873820 >> v2:172.21.15.146:3300/0 conn(0x7fc364134290 0x7fc36413bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:17.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.016+0000 7fc3637fe700 1 --2- 172.21.15.146:0/3723873820 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc36409e870 0x7fc36409ec40 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc34c006fd0 tx=0x7fc34c009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=581ff15cd1bfbce0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:17.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.016+0000 7fc3627fc700 1 -- 172.21.15.146:0/3723873820 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c005e30 con 0x7fc36409e870 2023-10-03T10:21:17.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.016+0000 7fc3627fc700 1 -- 172.21.15.146:0/3723873820 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34c004030 con 0x7fc36409e870 2023-10-03T10:21:17.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.016+0000 7fc3627fc700 1 -- 172.21.15.146:0/3723873820 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c0043e0 con 0x7fc36409e870 2023-10-03T10:21:17.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.017+0000 7fc369efc700 1 -- 172.21.15.146:0/3723873820 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc36409e870 msgr2=0x7fc36409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:17.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.017+0000 7fc369efc700 1 --2- 172.21.15.146:0/3723873820 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc36409e870 0x7fc36409ec40 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc34c006fd0 tx=0x7fc34c009bd0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.017+0000 7fc369efc700 1 -- 172.21.15.146:0/3723873820 shutdown_connections 2023-10-03T10:21:17.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.017+0000 7fc369efc700 1 --2- 172.21.15.146:0/3723873820 >> v2:172.21.15.146:3300/0 conn(0x7fc364134290 0x7fc36413bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.017+0000 7fc369efc700 1 --2- 172.21.15.146:0/3723873820 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc36409e870 0x7fc36409ec40 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.017+0000 7fc369efc700 1 -- 172.21.15.146:0/3723873820 >> 172.21.15.146:0/3723873820 conn(0x7fc3640a4390 msgr2=0x7fc3640a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:17.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.017+0000 7fc369efc700 1 -- 172.21.15.146:0/3723873820 shutdown_connections 2023-10-03T10:21:17.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.017+0000 7fc369efc700 1 -- 172.21.15.146:0/3723873820 wait complete. 2023-10-03T10:21:17.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.018+0000 7fc369efc700 1 Processor -- start 2023-10-03T10:21:17.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.018+0000 7fc369efc700 1 -- start start 2023-10-03T10:21:17.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.018+0000 7fc369efc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc36409e870 0x7fc3641c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:17.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.018+0000 7fc369efc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc36409f180 0x7fc3641c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:17.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.018+0000 7fc369efc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc364134290 0x7fc364122a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:17.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.018+0000 7fc369efc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc364125fa0 con 0x7fc36409f180 2023-10-03T10:21:17.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.018+0000 7fc369efc700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc364126640 con 0x7fc364134290 2023-10-03T10:21:17.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.018+0000 7fc369efc700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc36406fba0 con 0x7fc36409e870 2023-10-03T10:21:17.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.018+0000 7fc3637fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc36409e870 0x7fc3641c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:17.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.018+0000 7fc362ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc36409f180 0x7fc3641c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:17.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.019+0000 7fc363fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc364134290 0x7fc364122a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:17.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.019+0000 7fc3637fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc36409e870 0x7fc3641c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40404/0 (socket says 172.21.15.146:40404) 2023-10-03T10:21:17.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.019+0000 7fc362ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc36409f180 0x7fc3641c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53760/0 (socket says 172.21.15.146:53760) 2023-10-03T10:21:17.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.019+0000 7fc3637fe700 1 -- 172.21.15.146:0/613132178 learned_addr learned my addr 172.21.15.146:0/613132178 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:21:17.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.019+0000 7fc362ffd700 1 -- 172.21.15.146:0/613132178 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc36409e870 msgr2=0x7fc3641c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.019+0000 7fc362ffd700 1 --2- 172.21.15.146:0/613132178 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc36409e870 0x7fc3641c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.019+0000 7fc362ffd700 1 -- 172.21.15.146:0/613132178 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc364134290 msgr2=0x7fc364122a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.019+0000 7fc362ffd700 1 --2- 172.21.15.146:0/613132178 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc364134290 0x7fc364122a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.019+0000 7fc362ffd700 1 -- 172.21.15.146:0/613132178 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c009a70 con 0x7fc36409f180 2023-10-03T10:21:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.019+0000 7fc3637fe700 1 --2- 172.21.15.146:0/613132178 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc36409e870 0x7fc3641c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.019+0000 7fc362ffd700 1 --2- 172.21.15.146:0/613132178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc36409f180 0x7fc3641c8dc0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fc354000f60 tx=0x7fc35400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.019+0000 7fc35bfff700 1 -- 172.21.15.146:0/613132178 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3540052d0 con 0x7fc36409f180 2023-10-03T10:21:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.019+0000 7fc35bfff700 1 -- 172.21.15.146:0/613132178 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc354005430 con 0x7fc36409f180 2023-10-03T10:21:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.019+0000 7fc369efc700 1 -- 172.21.15.146:0/613132178 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34c009500 con 0x7fc36409f180 2023-10-03T10:21:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.019+0000 7fc35bfff700 1 -- 172.21.15.146:0/613132178 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3540038c0 con 0x7fc36409f180 2023-10-03T10:21:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.019+0000 7fc369efc700 1 -- 172.21.15.146:0/613132178 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc364124630 con 0x7fc36409f180 2023-10-03T10:21:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.020+0000 7fc35bfff700 1 -- 172.21.15.146:0/613132178 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc354003a20 con 0x7fc36409f180 2023-10-03T10:21:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.020+0000 7fc35bfff700 1 -- 172.21.15.146:0/613132178 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fc35403e980 con 0x7fc36409f180 2023-10-03T10:21:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.020+0000 7fc369efc700 1 -- 172.21.15.146:0/613132178 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36404f2a0 con 0x7fc36409f180 2023-10-03T10:21:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.025+0000 7fc35bfff700 1 -- 172.21.15.146:0/613132178 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc354019b40 con 0x7fc36409f180 2023-10-03T10:21:17.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.207+0000 7fc369efc700 1 -- 172.21.15.146:0/613132178 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc36406be90 con 0x7fc36409f180 2023-10-03T10:21:17.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.208+0000 7fc35bfff700 1 -- 172.21.15.146:0/613132178 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc354017020 con 0x7fc36409f180 2023-10-03T10:21:17.207 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-03T10:21:17.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.210+0000 7fc369efc700 1 -- 172.21.15.146:0/613132178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc36409f180 msgr2=0x7fc3641c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:17.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.210+0000 7fc369efc700 1 --2- 172.21.15.146:0/613132178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc36409f180 0x7fc3641c8dc0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fc354000f60 tx=0x7fc35400c730 comp rx=0 tx=0).stop 2023-10-03T10:21:17.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.210+0000 7fc369efc700 1 -- 172.21.15.146:0/613132178 shutdown_connections 2023-10-03T10:21:17.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.210+0000 7fc369efc700 1 --2- 172.21.15.146:0/613132178 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc364134290 0x7fc364122a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.210+0000 7fc369efc700 1 --2- 172.21.15.146:0/613132178 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fc36409e870 0x7fc3641c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.210+0000 7fc369efc700 1 --2- 172.21.15.146:0/613132178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc36409f180 0x7fc3641c8dc0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.210+0000 7fc369efc700 1 -- 172.21.15.146:0/613132178 >> 172.21.15.146:0/613132178 conn(0x7fc3640a4390 msgr2=0x7fc364070fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.210+0000 7fc369efc700 1 -- 172.21.15.146:0/613132178 shutdown_connections 2023-10-03T10:21:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.210+0000 7fc369efc700 1 -- 172.21.15.146:0/613132178 wait complete. 2023-10-03T10:21:17.221 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T10:21:17.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.343+0000 7f24a83b4700 1 Processor -- start 2023-10-03T10:21:17.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.343+0000 7f24a83b4700 1 -- start start 2023-10-03T10:21:17.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.344+0000 7f24a83b4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24a009e870 0x7f24a009ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:17.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.344+0000 7f24a83b4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f24a0131f40 0x7f24a0139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:17.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.344+0000 7f24a83b4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a009c970 con 0x7f24a009f180 2023-10-03T10:21:17.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.344+0000 7f24a83b4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a00a0920 con 0x7f24a0131f40 2023-10-03T10:21:17.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.344+0000 7f24a83b4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24a009f9c0 con 0x7f24a009e870 2023-10-03T10:21:17.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.344+0000 7f24a6150700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24a009e870 0x7f24a009ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:17.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.344+0000 7f24a6951700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f24a0131f40 0x7f24a0139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:17.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.344+0000 7f24a594f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f24a009f180 0x7f24a0131830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59746/0 (socket says 172.21.15.146:59746) 2023-10-03T10:21:17.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.344+0000 7f24a594f700 1 -- 172.21.15.146:0/680509175 learned_addr learned my addr 172.21.15.146:0/680509175 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:21:17.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.345+0000 7f24a6951700 1 -- 172.21.15.146:0/680509175 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24a009e870 msgr2=0x7f24a009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:17.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.345+0000 7f24a6951700 1 --2- 172.21.15.146:0/680509175 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24a009e870 0x7f24a009ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.345+0000 7f24a6951700 1 -- 172.21.15.146:0/680509175 >> v1:172.21.15.146:6789/0 conn(0x7f24a009f180 legacy=0x7f24a0131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:17.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.345+0000 7f24a6951700 1 -- 172.21.15.146:0/680509175 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a009bab0 con 0x7f24a0131f40 2023-10-03T10:21:17.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.345+0000 7f24a514e700 1 -- 172.21.15.146:0/680509175 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028892756 0 0) 0x7f24a009c970 con 0x7f24a009f180 2023-10-03T10:21:17.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.345+0000 7f24a6150700 1 --2- 172.21.15.146:0/680509175 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24a009e870 0x7f24a009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:17.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.345+0000 7f24a6951700 1 --2- 172.21.15.146:0/680509175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a0131f40 0x7f24a0139ca0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f2498009d90 tx=0x7f249800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42aad71ab1aa16d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:17.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.345+0000 7f24a514e700 1 -- 172.21.15.146:0/680509175 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249800e070 con 0x7f24a0131f40 2023-10-03T10:21:17.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.345+0000 7f24a514e700 1 -- 172.21.15.146:0/680509175 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249800bb20 con 0x7f24a0131f40 2023-10-03T10:21:17.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.345+0000 7f24a514e700 1 -- 172.21.15.146:0/680509175 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498012430 con 0x7f24a0131f40 2023-10-03T10:21:17.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.346+0000 7f24a83b4700 1 -- 172.21.15.146:0/680509175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a0131f40 msgr2=0x7f24a0139ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:17.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.346+0000 7f24a83b4700 1 --2- 172.21.15.146:0/680509175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a0131f40 0x7f24a0139ca0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f2498009d90 tx=0x7f249800b330 comp rx=0 tx=0).stop 2023-10-03T10:21:17.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.346+0000 7f24a83b4700 1 -- 172.21.15.146:0/680509175 shutdown_connections 2023-10-03T10:21:17.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.346+0000 7f24a83b4700 1 --2- 172.21.15.146:0/680509175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a0131f40 0x7f24a0139ca0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.346+0000 7f24a83b4700 1 --2- 172.21.15.146:0/680509175 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24a009e870 0x7f24a009ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.346+0000 7f24a83b4700 1 -- 172.21.15.146:0/680509175 >> 172.21.15.146:0/680509175 conn(0x7f24a00a4430 msgr2=0x7f24a00a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:17.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.346+0000 7f24a83b4700 1 -- 172.21.15.146:0/680509175 shutdown_connections 2023-10-03T10:21:17.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.346+0000 7f24a83b4700 1 -- 172.21.15.146:0/680509175 wait complete. 2023-10-03T10:21:17.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.346+0000 7f24a83b4700 1 Processor -- start 2023-10-03T10:21:17.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.347+0000 7f24a83b4700 1 -- start start 2023-10-03T10:21:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.347+0000 7f24a83b4700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24a009e870 0x7f24a01200a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.347+0000 7f24a83b4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a009f180 0x7f24a01205e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.347+0000 7f24a83b4700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24a0131f40 0x7f24a0120b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.347+0000 7f24a83b4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a0122b20 con 0x7f24a009f180 2023-10-03T10:21:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.347+0000 7f24a83b4700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a0121c20 con 0x7f24a0131f40 2023-10-03T10:21:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.347+0000 7f24a83b4700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24a009dba0 con 0x7f24a009e870 2023-10-03T10:21:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.347+0000 7f24a6150700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24a009e870 0x7f24a01200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.347+0000 7f24a594f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a009f180 0x7f24a01205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.347+0000 7f24a6150700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24a009e870 0x7f24a01200a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40424/0 (socket says 172.21.15.146:40424) 2023-10-03T10:21:17.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.347+0000 7f24a6150700 1 -- 172.21.15.146:0/1930414540 learned_addr learned my addr 172.21.15.146:0/1930414540 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:21:17.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.347+0000 7f24a6951700 1 --2- 172.21.15.146:0/1930414540 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24a0131f40 0x7f24a0120b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:17.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.347+0000 7f24a594f700 1 -- 172.21.15.146:0/1930414540 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24a009e870 msgr2=0x7f24a01200a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:17.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.347+0000 7f24a594f700 1 --2- 172.21.15.146:0/1930414540 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24a009e870 0x7f24a01200a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.347+0000 7f24a594f700 1 -- 172.21.15.146:0/1930414540 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24a0131f40 msgr2=0x7f24a0120b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:17.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.347+0000 7f24a594f700 1 --2- 172.21.15.146:0/1930414540 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24a0131f40 0x7f24a0120b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.347+0000 7f24a594f700 1 -- 172.21.15.146:0/1930414540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24900094a0 con 0x7f24a009f180 2023-10-03T10:21:17.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.347+0000 7f24a6150700 1 --2- 172.21.15.146:0/1930414540 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24a009e870 0x7f24a01200a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:17.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.347+0000 7f24a594f700 1 --2- 172.21.15.146:0/1930414540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a009f180 0x7f24a01205e0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f24a00a1a80 tx=0x7f249c00c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:17.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.348+0000 7f2496ffd700 1 -- 172.21.15.146:0/1930414540 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c004c80 con 0x7f24a009f180 2023-10-03T10:21:17.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.348+0000 7f2496ffd700 1 -- 172.21.15.146:0/1930414540 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c004de0 con 0x7f24a009f180 2023-10-03T10:21:17.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.348+0000 7f24a83b4700 1 -- 172.21.15.146:0/1930414540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2498009a70 con 0x7f24a009f180 2023-10-03T10:21:17.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.348+0000 7f2496ffd700 1 -- 172.21.15.146:0/1930414540 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c007310 con 0x7f24a009f180 2023-10-03T10:21:17.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.348+0000 7f24a83b4700 1 -- 172.21.15.146:0/1930414540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a0123590 con 0x7f24a009f180 2023-10-03T10:21:17.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.348+0000 7f2496ffd700 1 -- 172.21.15.146:0/1930414540 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f249c007470 con 0x7f24a009f180 2023-10-03T10:21:17.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.348+0000 7f24a83b4700 1 -- 172.21.15.146:0/1930414540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a011ce70 con 0x7f24a009f180 2023-10-03T10:21:17.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.349+0000 7f2496ffd700 1 -- 172.21.15.146:0/1930414540 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f249c03f240 con 0x7f24a009f180 2023-10-03T10:21:17.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.353+0000 7f2496ffd700 1 -- 172.21.15.146:0/1930414540 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f249c01bba0 con 0x7f24a009f180 2023-10-03T10:21:17.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.550+0000 7f24a83b4700 1 -- 172.21.15.146:0/1930414540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f24a004f2a0 con 0x7f24a009f180 2023-10-03T10:21:17.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.550+0000 7f2496ffd700 1 -- 172.21.15.146:0/1930414540 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 11 entries v39) v1 ==== 81+0+646 (secure 0 0 0) 0x7f249c01b7b0 con 0x7f24a009f180 2023-10-03T10:21:17.550 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:0/1965600138 2023-10-04T10:12:46.859809+0000 2023-10-03T10:21:17.550 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:0/1702650323 2023-10-04T10:12:46.859809+0000 2023-10-03T10:21:17.550 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:0/2857084049 2023-10-04T10:12:46.859809+0000 2023-10-03T10:21:17.550 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:0/784768892 2023-10-04T10:12:46.859809+0000 2023-10-03T10:21:17.551 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:6816/118159 2023-10-04T10:11:52.317723+0000 2023-10-03T10:21:17.551 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:0/3123391800 2023-10-04T10:12:46.859809+0000 2023-10-03T10:21:17.551 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:0/45915595 2023-10-04T10:11:52.317723+0000 2023-10-03T10:21:17.551 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:0/1896339219 2023-10-04T10:11:52.317723+0000 2023-10-03T10:21:17.551 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:6817/4164614194 2023-10-04T10:12:13.686998+0000 2023-10-03T10:21:17.551 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:0/807364756 2023-10-04T10:12:46.859809+0000 2023-10-03T10:21:17.551 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:6816/126749 2023-10-04T10:12:46.859809+0000 2023-10-03T10:21:17.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.552+0000 7f24a83b4700 1 -- 172.21.15.146:0/1930414540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a009f180 msgr2=0x7f24a01205e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:17.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.552+0000 7f24a83b4700 1 --2- 172.21.15.146:0/1930414540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a009f180 0x7f24a01205e0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f24a00a1a80 tx=0x7f249c00c750 comp rx=0 tx=0).stop 2023-10-03T10:21:17.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.552+0000 7f24a83b4700 1 -- 172.21.15.146:0/1930414540 shutdown_connections 2023-10-03T10:21:17.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.552+0000 7f24a83b4700 1 --2- 172.21.15.146:0/1930414540 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24a0131f40 0x7f24a0120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.552+0000 7f24a83b4700 1 --2- 172.21.15.146:0/1930414540 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f24a009e870 0x7f24a01200a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.552+0000 7f24a83b4700 1 --2- 172.21.15.146:0/1930414540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a009f180 0x7f24a01205e0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.552+0000 7f24a83b4700 1 -- 172.21.15.146:0/1930414540 >> 172.21.15.146:0/1930414540 conn(0x7f24a00a4430 msgr2=0x7f24a0072210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:17.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.552+0000 7f24a83b4700 1 -- 172.21.15.146:0/1930414540 shutdown_connections 2023-10-03T10:21:17.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.552+0000 7f24a83b4700 1 -- 172.21.15.146:0/1930414540 wait complete. 2023-10-03T10:21:17.553 INFO:teuthology.orchestra.run.smithi146.stderr:listed 11 entries 2023-10-03T10:21:17.564 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-10-03T10:21:17.564 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T10:21:17.587 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:21:17.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.707+0000 7fa3157a3700 1 Processor -- start 2023-10-03T10:21:17.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.707+0000 7fa3157a3700 1 -- start start 2023-10-03T10:21:17.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.708+0000 7fa3157a3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa310130720 0x7fa310130af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:17.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.708+0000 7fa3157a3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3100a09a0 0x7fa3100a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:17.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.708+0000 7fa3157a3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa31009a880 con 0x7fa3100a12d0 2023-10-03T10:21:17.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.708+0000 7fa3157a3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa31009b820 con 0x7fa310130720 2023-10-03T10:21:17.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.708+0000 7fa3157a3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31009ab40 con 0x7fa3100a09a0 2023-10-03T10:21:17.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.708+0000 7fa30effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa310130720 0x7fa310130af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:17.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.708+0000 7fa30f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa3100a12d0 0x7fa31013aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59748/0 (socket says 172.21.15.146:59748) 2023-10-03T10:21:17.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.708+0000 7fa30f7fe700 1 -- 172.21.15.146:0/2840070612 learned_addr learned my addr 172.21.15.146:0/2840070612 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:21:17.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.708+0000 7fa30e7fc700 1 --2- 172.21.15.146:0/2840070612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3100a09a0 0x7fa3100a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:17.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.708+0000 7fa30effd700 1 -- 172.21.15.146:0/2840070612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3100a09a0 msgr2=0x7fa3100a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:17.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.708+0000 7fa30effd700 1 --2- 172.21.15.146:0/2840070612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3100a09a0 0x7fa3100a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.708+0000 7fa30effd700 1 -- 172.21.15.146:0/2840070612 >> v1:172.21.15.146:6789/0 conn(0x7fa3100a12d0 legacy=0x7fa31013aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:17.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.708+0000 7fa30effd700 1 -- 172.21.15.146:0/2840070612 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3101302f0 con 0x7fa310130720 2023-10-03T10:21:17.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.708+0000 7fa30dffb700 1 -- 172.21.15.146:0/2840070612 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723815931 0 0) 0x7fa31009a880 con 0x7fa3100a12d0 2023-10-03T10:21:17.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.708+0000 7fa30e7fc700 1 --2- 172.21.15.146:0/2840070612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3100a09a0 0x7fa3100a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:17.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.708+0000 7fa30effd700 1 --2- 172.21.15.146:0/2840070612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa310130720 0x7fa310130af0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fa304009870 tx=0x7fa304009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450dc05e7f6b443f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:17.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.709+0000 7fa30dffb700 1 -- 172.21.15.146:0/2840070612 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa304011830 con 0x7fa310130720 2023-10-03T10:21:17.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.709+0000 7fa30dffb700 1 -- 172.21.15.146:0/2840070612 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa304011990 con 0x7fa310130720 2023-10-03T10:21:17.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.709+0000 7fa30dffb700 1 -- 172.21.15.146:0/2840070612 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa304011d20 con 0x7fa310130720 2023-10-03T10:21:17.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.709+0000 7fa3157a3700 1 -- 172.21.15.146:0/2840070612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa310130720 msgr2=0x7fa310130af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:17.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.709+0000 7fa3157a3700 1 --2- 172.21.15.146:0/2840070612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa310130720 0x7fa310130af0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fa304009870 tx=0x7fa304009b80 comp rx=0 tx=0).stop 2023-10-03T10:21:17.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.709+0000 7fa3157a3700 1 -- 172.21.15.146:0/2840070612 shutdown_connections 2023-10-03T10:21:17.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.709+0000 7fa3157a3700 1 --2- 172.21.15.146:0/2840070612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa310130720 0x7fa310130af0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.709+0000 7fa3157a3700 1 --2- 172.21.15.146:0/2840070612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3100a09a0 0x7fa3100a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.709+0000 7fa3157a3700 1 -- 172.21.15.146:0/2840070612 >> 172.21.15.146:0/2840070612 conn(0x7fa3100a2980 msgr2=0x7fa3100a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:17.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.709+0000 7fa3157a3700 1 -- 172.21.15.146:0/2840070612 shutdown_connections 2023-10-03T10:21:17.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.709+0000 7fa3157a3700 1 -- 172.21.15.146:0/2840070612 wait complete. 2023-10-03T10:21:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.710+0000 7fa3157a3700 1 Processor -- start 2023-10-03T10:21:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.710+0000 7fa3157a3700 1 -- start start 2023-10-03T10:21:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa3157a3700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3100a09a0 0x7fa31011eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa3157a3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3100a12d0 0x7fa31011f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa3157a3700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa310130720 0x7fa31011f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:17.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa3157a3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa310120640 con 0x7fa3100a12d0 2023-10-03T10:21:17.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa3157a3700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31011ff80 con 0x7fa310130720 2023-10-03T10:21:17.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa3157a3700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3101226c0 con 0x7fa3100a09a0 2023-10-03T10:21:17.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa30effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3100a09a0 0x7fa31011eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:17.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa30e7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3100a12d0 0x7fa31011f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:17.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa30effd700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3100a09a0 0x7fa31011eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40436/0 (socket says 172.21.15.146:40436) 2023-10-03T10:21:17.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa30f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa310130720 0x7fa31011f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:17.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa30effd700 1 -- 172.21.15.146:0/1176107959 learned_addr learned my addr 172.21.15.146:0/1176107959 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:21:17.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa30e7fc700 1 -- 172.21.15.146:0/1176107959 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3100a09a0 msgr2=0x7fa31011eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:17.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa30e7fc700 1 --2- 172.21.15.146:0/1176107959 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3100a09a0 0x7fa31011eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa30e7fc700 1 -- 172.21.15.146:0/1176107959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa310130720 msgr2=0x7fa31011f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:17.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa30e7fc700 1 --2- 172.21.15.146:0/1176107959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa310130720 0x7fa31011f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa30e7fc700 1 -- 172.21.15.146:0/1176107959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3000094a0 con 0x7fa3100a12d0 2023-10-03T10:21:17.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa30f7fe700 1 --2- 172.21.15.146:0/1176107959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa310130720 0x7fa31011f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:17.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa30effd700 1 --2- 172.21.15.146:0/1176107959 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3100a09a0 0x7fa31011eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:17.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa30e7fc700 1 --2- 172.21.15.146:0/1176107959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3100a12d0 0x7fa31011f060 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fa30000e9e0 tx=0x7fa30000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:17.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa2f77fe700 1 -- 172.21.15.146:0/1176107959 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30000ee80 con 0x7fa3100a12d0 2023-10-03T10:21:17.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa2f77fe700 1 -- 172.21.15.146:0/1176107959 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30000c850 con 0x7fa3100a12d0 2023-10-03T10:21:17.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa3157a3700 1 -- 172.21.15.146:0/1176107959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3040094a0 con 0x7fa3100a12d0 2023-10-03T10:21:17.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa2f77fe700 1 -- 172.21.15.146:0/1176107959 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30000cc00 con 0x7fa3100a12d0 2023-10-03T10:21:17.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.711+0000 7fa3157a3700 1 -- 172.21.15.146:0/1176107959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31009c560 con 0x7fa3100a12d0 2023-10-03T10:21:17.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.712+0000 7fa2f77fe700 1 -- 172.21.15.146:0/1176107959 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa30000cd60 con 0x7fa3100a12d0 2023-10-03T10:21:17.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.712+0000 7fa2f77fe700 1 -- 172.21.15.146:0/1176107959 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fa30003fa40 con 0x7fa3100a12d0 2023-10-03T10:21:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.712+0000 7fa3157a3700 1 -- 172.21.15.146:0/1176107959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa310122140 con 0x7fa3100a12d0 2023-10-03T10:21:17.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.717+0000 7fa2f77fe700 1 -- 172.21.15.146:0/1176107959 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa310122140 con 0x7fa3100a12d0 2023-10-03T10:21:17.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.899+0000 7fa3157a3700 1 -- 172.21.15.146:0/1176107959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa310122140 con 0x7fa3100a12d0 2023-10-03T10:21:17.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.901+0000 7fa2f77fe700 1 -- 172.21.15.146:0/1176107959 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+13484 (secure 0 0 0) 0x7fa310122140 con 0x7fa3100a12d0 2023-10-03T10:21:17.900 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-03T10:21:17.901 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":39,"fsid":"5440411f-9bdd-4ef1-85ef-960d00aa215c","created":"2023-10-03T10:09:33.329589+0000","modified":"2023-10-03T10:12:46.859836+0000","last_up_change":"2023-10-03T10:12:11.453728+0000","last_in_change":"2023-10-03T10:09:35.344070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:42.343363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:43.224375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:47.108480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:47.686814+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc508d26-69b6-41de-a054-5e24038acb5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6800","nonce":129317}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6801","nonce":129317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6803","nonce":129317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6802","nonce":129317}]},"public_addr":"172.21.15.146:6800/129317","cluster_addr":"172.21.15.146:6801/129317","heartbeat_back_addr":"172.21.15.146:6803/129317","heartbeat_front_addr":"172.21.15.146:6802/129317","state":["exists","up"]},{"osd":1,"uuid":"31a24ed3-888a-480f-a617-3ba1d9611021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6804","nonce":129415}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6805","nonce":129415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6807","nonce":129415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6806","nonce":129415}]},"public_addr":"172.21.15.146:6804/129415","cluster_addr":"172.21.15.146:6805/129415","heartbeat_back_addr":"172.21.15.146:6807/129415","heartbeat_front_addr":"172.21.15.146:6806/129415","state":["exists","up"]},{"osd":2,"uuid":"8e8d366c-c801-4c1d-b8d7-6f27e5bc0689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6808","nonce":129525}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6809","nonce":129525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6811","nonce":129525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6810","nonce":129525}]},"public_addr":"172.21.15.146:6808/129525","cluster_addr":"172.21.15.146:6809/129525","heartbeat_back_addr":"172.21.15.146:6811/129525","heartbeat_front_addr":"172.21.15.146:6810/129525","state":["exists","up"]},{"osd":3,"uuid":"a581fc17-7f9e-41b1-b070-a1e8c17d6e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6812","nonce":129865}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6813","nonce":129865}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6815","nonce":129865}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.146:6814","nonce":129865}]},"public_addr":"172.21.15.146:6812/129865","cluster_addr":"172.21.15.146:6813/129865","heartbeat_back_addr":"172.21.15.146:6815/129865","heartbeat_front_addr":"172.21.15.146:6814/129865","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.402838+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.443261+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.532837+0000","dead_epoch":25},{"osd":3,"down_stamp":"2023-10-03T10:12:05.426236+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:40.549051+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:0/1965600138":"2023-10-04T10:12:46.859809+0000","172.21.15.146:0/1702650323":"2023-10-04T10:12:46.859809+0000","172.21.15.146:0/2857084049":"2023-10-04T10:12:46.859809+0000","172.21.15.146:0/784768892":"2023-10-04T10:12:46.859809+0000","172.21.15.146:6816/118159":"2023-10-04T10:11:52.317723+0000","172.21.15.146:0/3123391800":"2023-10-04T10:12:46.859809+0000","172.21.15.146:0/45915595":"2023-10-04T10:11:52.317723+0000","172.21.15.146:0/1896339219":"2023-10-04T10:11:52.317723+0000","172.21.15.146:6817/4164614194":"2023-10-04T10:12:13.686998+0000","172.21.15.146:0/807364756":"2023-10-04T10:12:46.859809+0000","172.21.15.146:6816/126749":"2023-10-04T10:12:46.859809+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:21:17.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.903+0000 7fa3157a3700 1 -- 172.21.15.146:0/1176107959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3100a12d0 msgr2=0x7fa31011f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:17.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.903+0000 7fa3157a3700 1 --2- 172.21.15.146:0/1176107959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3100a12d0 0x7fa31011f060 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fa30000e9e0 tx=0x7fa30000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.903+0000 7fa3157a3700 1 -- 172.21.15.146:0/1176107959 shutdown_connections 2023-10-03T10:21:17.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.903+0000 7fa3157a3700 1 --2- 172.21.15.146:0/1176107959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa310130720 0x7fa31011f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.903+0000 7fa3157a3700 1 --2- 172.21.15.146:0/1176107959 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fa3100a09a0 0x7fa31011eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.903+0000 7fa3157a3700 1 --2- 172.21.15.146:0/1176107959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3100a12d0 0x7fa31011f060 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:17.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.903+0000 7fa3157a3700 1 -- 172.21.15.146:0/1176107959 >> 172.21.15.146:0/1176107959 conn(0x7fa3100a2980 msgr2=0x7fa31009e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:17.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.903+0000 7fa3157a3700 1 -- 172.21.15.146:0/1176107959 shutdown_connections 2023-10-03T10:21:17.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:17.903+0000 7fa3157a3700 1 -- 172.21.15.146:0/1176107959 wait complete. 2023-10-03T10:21:17.914 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T10:09:42.343363+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:43.224375+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:47.108480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:47.686814+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T10:21:17.915 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T10:21:18.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.039+0000 7f5e4d49e700 1 Processor -- start 2023-10-03T10:21:18.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.039+0000 7f5e4d49e700 1 -- start start 2023-10-03T10:21:18.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.040+0000 7f5e4d49e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e4809ad70 0x7f5e48138cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:18.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.040+0000 7f5e4d49e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e4809e260 0x7f5e4813b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:18.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.040+0000 7f5e4d49e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e4809a590 con 0x7f5e4809d780 2023-10-03T10:21:18.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.040+0000 7f5e4d49e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4806b450 con 0x7f5e4809e260 2023-10-03T10:21:18.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.040+0000 7f5e4d49e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4806a9e0 con 0x7f5e4809ad70 2023-10-03T10:21:18.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.040+0000 7f5e467fc700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e4809ad70 0x7f5e48138cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:18.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.040+0000 7f5e477fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e4809e260 0x7f5e4813b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:18.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.040+0000 7f5e46ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5e4809d780 0x7f5e4809db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59752/0 (socket says 172.21.15.146:59752) 2023-10-03T10:21:18.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.040+0000 7f5e46ffd700 1 -- 172.21.15.146:0/2088311928 learned_addr learned my addr 172.21.15.146:0/2088311928 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:21:18.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.040+0000 7f5e45ffb700 1 -- 172.21.15.146:0/2088311928 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193645204 0 0) 0x7f5e4809a590 con 0x7f5e4809d780 2023-10-03T10:21:18.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.040+0000 7f5e477fe700 1 -- 172.21.15.146:0/2088311928 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e4809ad70 msgr2=0x7f5e48138cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:18.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.040+0000 7f5e477fe700 1 --2- 172.21.15.146:0/2088311928 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e4809ad70 0x7f5e48138cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.040+0000 7f5e477fe700 1 -- 172.21.15.146:0/2088311928 >> v1:172.21.15.146:6789/0 conn(0x7f5e4809d780 legacy=0x7f5e4809db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:18.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.040+0000 7f5e477fe700 1 -- 172.21.15.146:0/2088311928 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4809a870 con 0x7f5e4809e260 2023-10-03T10:21:18.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.040+0000 7f5e467fc700 1 --2- 172.21.15.146:0/2088311928 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e4809ad70 0x7f5e48138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:18.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.040+0000 7f5e477fe700 1 --2- 172.21.15.146:0/2088311928 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e4809e260 0x7f5e4813b210 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f5e40009dc0 tx=0x7f5e4000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a37df25ab585620 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:18.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.040+0000 7f5e45ffb700 1 -- 172.21.15.146:0/2088311928 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4000e070 con 0x7f5e4809e260 2023-10-03T10:21:18.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.040+0000 7f5e45ffb700 1 -- 172.21.15.146:0/2088311928 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4000bb20 con 0x7f5e4809e260 2023-10-03T10:21:18.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.040+0000 7f5e45ffb700 1 -- 172.21.15.146:0/2088311928 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e40012430 con 0x7f5e4809e260 2023-10-03T10:21:18.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.041+0000 7f5e4d49e700 1 -- 172.21.15.146:0/2088311928 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e4809e260 msgr2=0x7f5e4813b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:18.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.041+0000 7f5e4d49e700 1 --2- 172.21.15.146:0/2088311928 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e4809e260 0x7f5e4813b210 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f5e40009dc0 tx=0x7f5e4000b330 comp rx=0 tx=0).stop 2023-10-03T10:21:18.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.041+0000 7f5e4d49e700 1 -- 172.21.15.146:0/2088311928 shutdown_connections 2023-10-03T10:21:18.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.041+0000 7f5e4d49e700 1 --2- 172.21.15.146:0/2088311928 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e4809e260 0x7f5e4813b210 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.041+0000 7f5e4d49e700 1 --2- 172.21.15.146:0/2088311928 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e4809ad70 0x7f5e48138cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.041+0000 7f5e4d49e700 1 -- 172.21.15.146:0/2088311928 >> 172.21.15.146:0/2088311928 conn(0x7f5e4809f980 msgr2=0x7f5e4809fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:18.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.041+0000 7f5e4d49e700 1 -- 172.21.15.146:0/2088311928 shutdown_connections 2023-10-03T10:21:18.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.041+0000 7f5e4d49e700 1 -- 172.21.15.146:0/2088311928 wait complete. 2023-10-03T10:21:18.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.042+0000 7f5e4d49e700 1 Processor -- start 2023-10-03T10:21:18.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.042+0000 7f5e4d49e700 1 -- start start 2023-10-03T10:21:18.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.042+0000 7f5e4d49e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e4809ad70 0x7f5e4811f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:18.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.042+0000 7f5e4d49e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e4809d780 0x7f5e4811f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:18.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.042+0000 7f5e4d49e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e4809e260 0x7f5e4811fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:18.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.042+0000 7f5e4d49e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e48072140 con 0x7f5e4809e260 2023-10-03T10:21:18.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.042+0000 7f5e4d49e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e48120f00 con 0x7f5e4809ad70 2023-10-03T10:21:18.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.042+0000 7f5e4d49e700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e48122a90 con 0x7f5e4809d780 2023-10-03T10:21:18.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.043+0000 7f5e46ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e4809ad70 0x7f5e4811f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:18.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.043+0000 7f5e46ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e4809ad70 0x7f5e4811f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45760/0 (socket says 172.21.15.146:45760) 2023-10-03T10:21:18.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.043+0000 7f5e46ffd700 1 -- 172.21.15.146:0/3690337743 learned_addr learned my addr 172.21.15.146:0/3690337743 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:21:18.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.043+0000 7f5e467fc700 1 --2- 172.21.15.146:0/3690337743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e4809d780 0x7f5e4811f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:18.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.043+0000 7f5e477fe700 1 --2- 172.21.15.146:0/3690337743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e4809e260 0x7f5e4811fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:18.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.043+0000 7f5e46ffd700 1 -- 172.21.15.146:0/3690337743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e4809d780 msgr2=0x7f5e4811f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:18.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.043+0000 7f5e46ffd700 1 --2- 172.21.15.146:0/3690337743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e4809d780 0x7f5e4811f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.043+0000 7f5e46ffd700 1 -- 172.21.15.146:0/3690337743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e4809e260 msgr2=0x7f5e4811fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:18.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.043+0000 7f5e46ffd700 1 --2- 172.21.15.146:0/3690337743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e4809e260 0x7f5e4811fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.043+0000 7f5e46ffd700 1 -- 172.21.15.146:0/3690337743 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e380094a0 con 0x7f5e4809ad70 2023-10-03T10:21:18.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.043+0000 7f5e467fc700 1 --2- 172.21.15.146:0/3690337743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e4809d780 0x7f5e4811f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:18.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.043+0000 7f5e46ffd700 1 --2- 172.21.15.146:0/3690337743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e4809ad70 0x7f5e4811f2a0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c00c520 tx=0x7f5e3c00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:18.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.043+0000 7f5e2f7fe700 1 -- 172.21.15.146:0/3690337743 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c004c80 con 0x7f5e4809ad70 2023-10-03T10:21:18.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.043+0000 7f5e2f7fe700 1 -- 172.21.15.146:0/3690337743 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c004e00 con 0x7f5e4809ad70 2023-10-03T10:21:18.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.043+0000 7f5e4d49e700 1 -- 172.21.15.146:0/3690337743 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e40009a70 con 0x7f5e4809ad70 2023-10-03T10:21:18.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.043+0000 7f5e2f7fe700 1 -- 172.21.15.146:0/3690337743 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c007310 con 0x7f5e4809ad70 2023-10-03T10:21:18.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.043+0000 7f5e4d49e700 1 -- 172.21.15.146:0/3690337743 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4809c710 con 0x7f5e4809ad70 2023-10-03T10:21:18.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.044+0000 7f5e2f7fe700 1 -- 172.21.15.146:0/3690337743 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e3c007470 con 0x7f5e4809ad70 2023-10-03T10:21:18.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.044+0000 7f5e2f7fe700 1 -- 172.21.15.146:0/3690337743 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f5e3c03f320 con 0x7f5e4809ad70 2023-10-03T10:21:18.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.044+0000 7f5e4d49e700 1 -- 172.21.15.146:0/3690337743 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e4804f2a0 con 0x7f5e4809ad70 2023-10-03T10:21:18.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.049+0000 7f5e2f7fe700 1 -- 172.21.15.146:0/3690337743 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e3c0123b0 con 0x7f5e4809ad70 2023-10-03T10:21:18.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.229+0000 7f5e4d49e700 1 -- 172.21.15.146:0/3690337743 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5e48122730 con 0x7f5e4809ad70 2023-10-03T10:21:18.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.230+0000 7f5e2f7fe700 1 -- 172.21.15.146:0/3690337743 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5e3c011360 con 0x7f5e4809ad70 2023-10-03T10:21:18.229 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-03T10:21:18.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.232+0000 7f5e4d49e700 1 -- 172.21.15.146:0/3690337743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e4809ad70 msgr2=0x7f5e4811f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:18.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.232+0000 7f5e4d49e700 1 --2- 172.21.15.146:0/3690337743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e4809ad70 0x7f5e4811f2a0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c00c520 tx=0x7f5e3c00c830 comp rx=0 tx=0).stop 2023-10-03T10:21:18.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.232+0000 7f5e4d49e700 1 -- 172.21.15.146:0/3690337743 shutdown_connections 2023-10-03T10:21:18.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.232+0000 7f5e4d49e700 1 --2- 172.21.15.146:0/3690337743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e4809e260 0x7f5e4811fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.232+0000 7f5e4d49e700 1 --2- 172.21.15.146:0/3690337743 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5e4809ad70 0x7f5e4811f2a0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.232+0000 7f5e4d49e700 1 --2- 172.21.15.146:0/3690337743 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f5e4809d780 0x7f5e4811f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.232+0000 7f5e4d49e700 1 -- 172.21.15.146:0/3690337743 >> 172.21.15.146:0/3690337743 conn(0x7f5e4809f980 msgr2=0x7f5e48070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:18.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.232+0000 7f5e4d49e700 1 -- 172.21.15.146:0/3690337743 shutdown_connections 2023-10-03T10:21:18.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.232+0000 7f5e4d49e700 1 -- 172.21.15.146:0/3690337743 wait complete. 2023-10-03T10:21:18.243 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:21:18.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.367+0000 7fcb1470a700 1 Processor -- start 2023-10-03T10:21:18.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.368+0000 7fcb1470a700 1 -- start start 2023-10-03T10:21:18.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.368+0000 7fcb1470a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb0c09d780 0x7fcb0c09db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:18.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.368+0000 7fcb1470a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcb0c09e090 0x7fcb0c130680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:18.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.368+0000 7fcb1470a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb0c130bc0 0x7fcb0c131060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:18.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.368+0000 7fcb1470a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb0c09d430 con 0x7fcb0c09e090 2023-10-03T10:21:18.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.368+0000 7fcb1470a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c09e910 con 0x7fcb0c130bc0 2023-10-03T10:21:18.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.368+0000 7fcb1470a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c09b380 con 0x7fcb0c09d780 2023-10-03T10:21:18.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.368+0000 7fcb12ca7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb0c130bc0 0x7fcb0c131060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:18.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.368+0000 7fcb11ca5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcb0c09e090 0x7fcb0c130680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:18.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.368+0000 7fcb12ca7700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb0c130bc0 0x7fcb0c131060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45776/0 (socket says 172.21.15.146:45776) 2023-10-03T10:21:18.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.368+0000 7fcb11ca5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcb0c09e090 0x7fcb0c130680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53806/0 (socket says 172.21.15.146:53806) 2023-10-03T10:21:18.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.368+0000 7fcb12ca7700 1 -- 172.21.15.146:0/1964607319 learned_addr learned my addr 172.21.15.146:0/1964607319 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:21:18.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.368+0000 7fcb124a6700 1 --2- 172.21.15.146:0/1964607319 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb0c09d780 0x7fcb0c09db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:18.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.369+0000 7fcb124a6700 1 -- 172.21.15.146:0/1964607319 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb0c130bc0 msgr2=0x7fcb0c131060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:18.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.369+0000 7fcb124a6700 1 --2- 172.21.15.146:0/1964607319 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb0c130bc0 0x7fcb0c131060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.369+0000 7fcb124a6700 1 -- 172.21.15.146:0/1964607319 >> v2:172.21.15.146:3300/0 conn(0x7fcb0c09e090 msgr2=0x7fcb0c130680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:18.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.369+0000 7fcb124a6700 1 --2- 172.21.15.146:0/1964607319 >> v2:172.21.15.146:3300/0 conn(0x7fcb0c09e090 0x7fcb0c130680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.369+0000 7fcb124a6700 1 -- 172.21.15.146:0/1964607319 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0c09f570 con 0x7fcb0c09d780 2023-10-03T10:21:18.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.369+0000 7fcb12ca7700 1 --2- 172.21.15.146:0/1964607319 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb0c130bc0 0x7fcb0c131060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:18.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.369+0000 7fcb11ca5700 1 --2- 172.21.15.146:0/1964607319 >> v2:172.21.15.146:3300/0 conn(0x7fcb0c09e090 0x7fcb0c130680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:18.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.369+0000 7fcb124a6700 1 --2- 172.21.15.146:0/1964607319 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb0c09d780 0x7fcb0c09db50 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fcafc009840 tx=0x7fcafc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=881531a1ae885450 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:18.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.369+0000 7fcb114a4700 1 -- 172.21.15.146:0/1964607319 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc011830 con 0x7fcb0c09d780 2023-10-03T10:21:18.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.369+0000 7fcb114a4700 1 -- 172.21.15.146:0/1964607319 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc011990 con 0x7fcb0c09d780 2023-10-03T10:21:18.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.369+0000 7fcb114a4700 1 -- 172.21.15.146:0/1964607319 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc011d20 con 0x7fcb0c09d780 2023-10-03T10:21:18.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.369+0000 7fcb1470a700 1 -- 172.21.15.146:0/1964607319 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb0c09d780 msgr2=0x7fcb0c09db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:18.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.369+0000 7fcb1470a700 1 --2- 172.21.15.146:0/1964607319 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb0c09d780 0x7fcb0c09db50 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fcafc009840 tx=0x7fcafc009b50 comp rx=0 tx=0).stop 2023-10-03T10:21:18.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.369+0000 7fcb1470a700 1 -- 172.21.15.146:0/1964607319 shutdown_connections 2023-10-03T10:21:18.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.369+0000 7fcb1470a700 1 --2- 172.21.15.146:0/1964607319 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb0c130bc0 0x7fcb0c131060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.369+0000 7fcb1470a700 1 --2- 172.21.15.146:0/1964607319 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb0c09d780 0x7fcb0c09db50 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.369+0000 7fcb1470a700 1 --2- 172.21.15.146:0/1964607319 >> v2:172.21.15.146:3300/0 conn(0x7fcb0c09e090 0x7fcb0c130680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.369+0000 7fcb1470a700 1 -- 172.21.15.146:0/1964607319 >> 172.21.15.146:0/1964607319 conn(0x7fcb0c09f980 msgr2=0x7fcb0c09fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:18.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.370+0000 7fcb1470a700 1 -- 172.21.15.146:0/1964607319 shutdown_connections 2023-10-03T10:21:18.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.370+0000 7fcb1470a700 1 -- 172.21.15.146:0/1964607319 wait complete. 2023-10-03T10:21:18.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.371+0000 7fcb1470a700 1 Processor -- start 2023-10-03T10:21:18.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.371+0000 7fcb1470a700 1 -- start start 2023-10-03T10:21:18.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.371+0000 7fcb1470a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb0c09d780 0x7fcb0c121330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:18.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.371+0000 7fcb1470a700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb0c09e090 0x7fcb0c121870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:18.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.371+0000 7fcb1470a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb0c130bc0 0x7fcb0c121db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:18.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.371+0000 7fcb1470a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c123a00 con 0x7fcb0c130bc0 2023-10-03T10:21:18.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.371+0000 7fcb1470a700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c123ce0 con 0x7fcb0c09d780 2023-10-03T10:21:18.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.371+0000 7fcb1470a700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c09a0e0 con 0x7fcb0c09e090 2023-10-03T10:21:18.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.371+0000 7fcb124a6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb0c09d780 0x7fcb0c121330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:18.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.372+0000 7fcb12ca7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb0c130bc0 0x7fcb0c121db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:18.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.372+0000 7fcb124a6700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb0c09d780 0x7fcb0c121330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45792/0 (socket says 172.21.15.146:45792) 2023-10-03T10:21:18.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.372+0000 7fcb124a6700 1 -- 172.21.15.146:0/1559252425 learned_addr learned my addr 172.21.15.146:0/1559252425 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:21:18.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.371+0000 7fcb11ca5700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb0c09e090 0x7fcb0c121870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:18.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.372+0000 7fcb124a6700 1 -- 172.21.15.146:0/1559252425 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb0c09e090 msgr2=0x7fcb0c121870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:18.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.372+0000 7fcb124a6700 1 --2- 172.21.15.146:0/1559252425 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb0c09e090 0x7fcb0c121870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.372+0000 7fcb124a6700 1 -- 172.21.15.146:0/1559252425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb0c130bc0 msgr2=0x7fcb0c121db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:18.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.372+0000 7fcb124a6700 1 --2- 172.21.15.146:0/1559252425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb0c130bc0 0x7fcb0c121db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.372+0000 7fcb124a6700 1 -- 172.21.15.146:0/1559252425 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb080094a0 con 0x7fcb0c09d780 2023-10-03T10:21:18.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.372+0000 7fcb12ca7700 1 --2- 172.21.15.146:0/1559252425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb0c130bc0 0x7fcb0c121db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:18.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.372+0000 7fcb11ca5700 1 --2- 172.21.15.146:0/1559252425 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb0c09e090 0x7fcb0c121870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:18.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.372+0000 7fcb124a6700 1 --2- 172.21.15.146:0/1559252425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb0c09d780 0x7fcb0c121330 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fcafc009fd0 tx=0x7fcafc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:18.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.372+0000 7fcb02ffd700 1 -- 172.21.15.146:0/1559252425 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc004450 con 0x7fcb0c09d780 2023-10-03T10:21:18.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.372+0000 7fcb02ffd700 1 -- 172.21.15.146:0/1559252425 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc01e070 con 0x7fcb0c09d780 2023-10-03T10:21:18.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.372+0000 7fcb1470a700 1 -- 172.21.15.146:0/1559252425 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb04009b30 con 0x7fcb0c09d780 2023-10-03T10:21:18.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.372+0000 7fcb02ffd700 1 -- 172.21.15.146:0/1559252425 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc0038e0 con 0x7fcb0c09d780 2023-10-03T10:21:18.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.372+0000 7fcb1470a700 1 -- 172.21.15.146:0/1559252425 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcafc0094a0 con 0x7fcb0c09d780 2023-10-03T10:21:18.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.373+0000 7fcb02ffd700 1 -- 172.21.15.146:0/1559252425 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcafc003a40 con 0x7fcb0c09d780 2023-10-03T10:21:18.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.373+0000 7fcb02ffd700 1 -- 172.21.15.146:0/1559252425 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7fcafc0402b0 con 0x7fcb0c09d780 2023-10-03T10:21:18.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.373+0000 7fcb1470a700 1 -- 172.21.15.146:0/1559252425 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0c04f2a0 con 0x7fcb0c09d780 2023-10-03T10:21:18.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.378+0000 7fcb02ffd700 1 -- 172.21.15.146:0/1559252425 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcafc015070 con 0x7fcb0c09d780 2023-10-03T10:21:18.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.560+0000 7fcb1470a700 1 -- 172.21.15.146:0/1559252425 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcb0c09b5a0 con 0x7fcb0c09d780 2023-10-03T10:21:18.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.560+0000 7fcb02ffd700 1 -- 172.21.15.146:0/1559252425 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcafc003cf0 con 0x7fcb0c09d780 2023-10-03T10:21:18.560 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-03T10:21:18.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.562+0000 7fcb1470a700 1 -- 172.21.15.146:0/1559252425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb0c09d780 msgr2=0x7fcb0c121330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:18.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.562+0000 7fcb1470a700 1 --2- 172.21.15.146:0/1559252425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb0c09d780 0x7fcb0c121330 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fcafc009fd0 tx=0x7fcafc004750 comp rx=0 tx=0).stop 2023-10-03T10:21:18.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.562+0000 7fcb1470a700 1 -- 172.21.15.146:0/1559252425 shutdown_connections 2023-10-03T10:21:18.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.562+0000 7fcb1470a700 1 --2- 172.21.15.146:0/1559252425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb0c130bc0 0x7fcb0c121db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.562+0000 7fcb1470a700 1 --2- 172.21.15.146:0/1559252425 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb0c09d780 0x7fcb0c121330 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.562+0000 7fcb1470a700 1 --2- 172.21.15.146:0/1559252425 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7fcb0c09e090 0x7fcb0c121870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.562+0000 7fcb1470a700 1 -- 172.21.15.146:0/1559252425 >> 172.21.15.146:0/1559252425 conn(0x7fcb0c09f980 msgr2=0x7fcb0c072380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:18.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.562+0000 7fcb1470a700 1 -- 172.21.15.146:0/1559252425 shutdown_connections 2023-10-03T10:21:18.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.562+0000 7fcb1470a700 1 -- 172.21.15.146:0/1559252425 wait complete. 2023-10-03T10:21:18.574 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:21:18.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.699+0000 7f9283e90700 1 Processor -- start 2023-10-03T10:21:18.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.699+0000 7f9283e90700 1 -- start start 2023-10-03T10:21:18.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.699+0000 7f9283e90700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f927c09d780 0x7f927c09db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:18.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.699+0000 7f9283e90700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f927c09e090 0x7f927c130680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:18.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.699+0000 7f9283e90700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f927c130bc0 0x7f927c131040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:18.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.699+0000 7f9283e90700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927c09d430 con 0x7f927c09d780 2023-10-03T10:21:18.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.699+0000 7f9283e90700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927c09e910 con 0x7f927c09e090 2023-10-03T10:21:18.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.699+0000 7f9283e90700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f927c09b380 con 0x7f927c130bc0 2023-10-03T10:21:18.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.699+0000 7f928242d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f927c130bc0 0x7f927c131040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:18.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.699+0000 7f9281c2c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f927c09d780 0x7f927c09db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:18.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.699+0000 7f928142b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f927c09e090 0x7f927c130680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:18.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.699+0000 7f928242d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f927c130bc0 0x7f927c131040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40468/0 (socket says 172.21.15.146:40468) 2023-10-03T10:21:18.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.699+0000 7f9281c2c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f927c09d780 0x7f927c09db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53836/0 (socket says 172.21.15.146:53836) 2023-10-03T10:21:18.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.699+0000 7f928242d700 1 -- 172.21.15.146:0/1532417402 learned_addr learned my addr 172.21.15.146:0/1532417402 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:21:18.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.700+0000 7f928242d700 1 -- 172.21.15.146:0/1532417402 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f927c09e090 msgr2=0x7f927c130680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:18.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.700+0000 7f928242d700 1 --2- 172.21.15.146:0/1532417402 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f927c09e090 0x7f927c130680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.700+0000 7f928242d700 1 -- 172.21.15.146:0/1532417402 >> v2:172.21.15.146:3300/0 conn(0x7f927c09d780 msgr2=0x7f927c09db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:18.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.700+0000 7f928242d700 1 --2- 172.21.15.146:0/1532417402 >> v2:172.21.15.146:3300/0 conn(0x7f927c09d780 0x7f927c09db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.700+0000 7f928242d700 1 -- 172.21.15.146:0/1532417402 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c09f570 con 0x7f927c130bc0 2023-10-03T10:21:18.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.700+0000 7f928142b700 1 --2- 172.21.15.146:0/1532417402 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f927c09e090 0x7f927c130680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:18.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.700+0000 7f9281c2c700 1 --2- 172.21.15.146:0/1532417402 >> v2:172.21.15.146:3300/0 conn(0x7f927c09d780 0x7f927c09db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:18.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.700+0000 7f928242d700 1 --2- 172.21.15.146:0/1532417402 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f927c130bc0 0x7f927c131040 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f9274009e50 tx=0x7f927400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d437be97deaadaa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:18.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.700+0000 7f9280c2a700 1 -- 172.21.15.146:0/1532417402 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927400e070 con 0x7f927c130bc0 2023-10-03T10:21:18.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.700+0000 7f9280c2a700 1 -- 172.21.15.146:0/1532417402 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927400b910 con 0x7f927c130bc0 2023-10-03T10:21:18.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.700+0000 7f9280c2a700 1 -- 172.21.15.146:0/1532417402 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927400bcc0 con 0x7f927c130bc0 2023-10-03T10:21:18.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.700+0000 7f9283e90700 1 -- 172.21.15.146:0/1532417402 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f927c130bc0 msgr2=0x7f927c131040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:18.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.700+0000 7f9283e90700 1 --2- 172.21.15.146:0/1532417402 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f927c130bc0 0x7f927c131040 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f9274009e50 tx=0x7f927400b330 comp rx=0 tx=0).stop 2023-10-03T10:21:18.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.701+0000 7f9283e90700 1 -- 172.21.15.146:0/1532417402 shutdown_connections 2023-10-03T10:21:18.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.701+0000 7f9283e90700 1 --2- 172.21.15.146:0/1532417402 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f927c130bc0 0x7f927c131040 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.701+0000 7f9283e90700 1 --2- 172.21.15.146:0/1532417402 >> v2:172.21.15.146:3300/0 conn(0x7f927c09d780 0x7f927c09db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.701+0000 7f9283e90700 1 --2- 172.21.15.146:0/1532417402 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f927c09e090 0x7f927c130680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.701+0000 7f9283e90700 1 -- 172.21.15.146:0/1532417402 >> 172.21.15.146:0/1532417402 conn(0x7f927c09f980 msgr2=0x7f927c09fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:18.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.701+0000 7f9283e90700 1 -- 172.21.15.146:0/1532417402 shutdown_connections 2023-10-03T10:21:18.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.701+0000 7f9283e90700 1 -- 172.21.15.146:0/1532417402 wait complete. 2023-10-03T10:21:18.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.701+0000 7f9283e90700 1 Processor -- start 2023-10-03T10:21:18.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.702+0000 7f9283e90700 1 -- start start 2023-10-03T10:21:18.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.702+0000 7f9283e90700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f927c09d780 0x7f927c11c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:18.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.702+0000 7f9283e90700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f927c09e090 0x7f927c11ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:18.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.702+0000 7f9283e90700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f927c130bc0 0x7f927c11d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:18.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.702+0000 7f9283e90700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c06b5b0 con 0x7f927c09d780 2023-10-03T10:21:18.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.702+0000 7f9283e90700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927c06b3c0 con 0x7f927c09e090 2023-10-03T10:21:18.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.702+0000 7f9283e90700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f927c11f350 con 0x7f927c130bc0 2023-10-03T10:21:18.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.702+0000 7f9281c2c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f927c09d780 0x7f927c11c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:18.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.702+0000 7f928242d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f927c130bc0 0x7f927c11d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:18.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.702+0000 7f928142b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f927c09e090 0x7f927c11ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:18.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.702+0000 7f9281c2c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f927c09d780 0x7f927c11c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53852/0 (socket says 172.21.15.146:53852) 2023-10-03T10:21:18.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.702+0000 7f928242d700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f927c130bc0 0x7f927c11d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40482/0 (socket says 172.21.15.146:40482) 2023-10-03T10:21:18.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.702+0000 7f9281c2c700 1 -- 172.21.15.146:0/3191694365 learned_addr learned my addr 172.21.15.146:0/3191694365 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:21:18.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.702+0000 7f928142b700 1 -- 172.21.15.146:0/3191694365 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f927c130bc0 msgr2=0x7f927c11d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:18.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.702+0000 7f928142b700 1 --2- 172.21.15.146:0/3191694365 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f927c130bc0 0x7f927c11d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.702+0000 7f928142b700 1 -- 172.21.15.146:0/3191694365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f927c09d780 msgr2=0x7f927c11c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:18.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.702+0000 7f928142b700 1 --2- 172.21.15.146:0/3191694365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f927c09d780 0x7f927c11c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.702+0000 7f928142b700 1 -- 172.21.15.146:0/3191694365 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92780094a0 con 0x7f927c09e090 2023-10-03T10:21:18.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.702+0000 7f928142b700 1 --2- 172.21.15.146:0/3191694365 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f927c09e090 0x7f927c11ce00 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f926c00e9b0 tx=0x7f926c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:18.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.703+0000 7f92727fc700 1 -- 172.21.15.146:0/3191694365 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c00ee50 con 0x7f927c09e090 2023-10-03T10:21:18.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.703+0000 7f92727fc700 1 -- 172.21.15.146:0/3191694365 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926c00c850 con 0x7f927c09e090 2023-10-03T10:21:18.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.703+0000 7f9283e90700 1 -- 172.21.15.146:0/3191694365 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926c0094a0 con 0x7f927c09e090 2023-10-03T10:21:18.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.703+0000 7f92727fc700 1 -- 172.21.15.146:0/3191694365 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c00cc00 con 0x7f927c09e090 2023-10-03T10:21:18.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.703+0000 7f9283e90700 1 -- 172.21.15.146:0/3191694365 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9274009b30 con 0x7f927c09e090 2023-10-03T10:21:18.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.703+0000 7f9283e90700 1 -- 172.21.15.146:0/3191694365 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927c09c8d0 con 0x7f927c09e090 2023-10-03T10:21:18.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.704+0000 7f92727fc700 1 -- 172.21.15.146:0/3191694365 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f926c013470 con 0x7f927c09e090 2023-10-03T10:21:18.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.704+0000 7f92727fc700 1 -- 172.21.15.146:0/3191694365 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f926c03ffb0 con 0x7f927c09e090 2023-10-03T10:21:18.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.708+0000 7f92727fc700 1 -- 172.21.15.146:0/3191694365 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f926c013720 con 0x7f927c09e090 2023-10-03T10:21:18.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.889+0000 7f9283e90700 1 -- 172.21.15.146:0/3191694365 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f927c04f2a0 con 0x7f927c09e090 2023-10-03T10:21:18.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.890+0000 7f92727fc700 1 -- 172.21.15.146:0/3191694365 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f926c017070 con 0x7f927c09e090 2023-10-03T10:21:18.889 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-03T10:21:18.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.891+0000 7f9283e90700 1 -- 172.21.15.146:0/3191694365 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f927c09e090 msgr2=0x7f927c11ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:18.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.891+0000 7f9283e90700 1 --2- 172.21.15.146:0/3191694365 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f927c09e090 0x7f927c11ce00 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f926c00e9b0 tx=0x7f926c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.892+0000 7f9283e90700 1 -- 172.21.15.146:0/3191694365 shutdown_connections 2023-10-03T10:21:18.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.892+0000 7f9283e90700 1 --2- 172.21.15.146:0/3191694365 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f927c130bc0 0x7f927c11d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.892+0000 7f9283e90700 1 --2- 172.21.15.146:0/3191694365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f927c09d780 0x7f927c11c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.892+0000 7f9283e90700 1 --2- 172.21.15.146:0/3191694365 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f927c09e090 0x7f927c11ce00 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:18.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.892+0000 7f9283e90700 1 -- 172.21.15.146:0/3191694365 >> 172.21.15.146:0/3191694365 conn(0x7f927c09f980 msgr2=0x7f927c1b8850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:18.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.892+0000 7f9283e90700 1 -- 172.21.15.146:0/3191694365 shutdown_connections 2023-10-03T10:21:18.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:18.892+0000 7f9283e90700 1 -- 172.21.15.146:0/3191694365 wait complete. 2023-10-03T10:21:18.903 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:21:19.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.029+0000 7f9951e83700 1 Processor -- start 2023-10-03T10:21:19.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.029+0000 7f9951e83700 1 -- start start 2023-10-03T10:21:19.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.029+0000 7f9951e83700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c131ae0 0x7f994c131eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:19.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.029+0000 7f9951e83700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f994c09e870 0x7f994c09eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:19.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.029+0000 7f9951e83700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f994c09f1e0 0x7f994c1389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:19.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.029+0000 7f9951e83700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f994c09add0 con 0x7f994c09e870 2023-10-03T10:21:19.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.029+0000 7f9951e83700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994c09bd90 con 0x7f994c131ae0 2023-10-03T10:21:19.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.029+0000 7f9951e83700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f994c09b680 con 0x7f994c09f1e0 2023-10-03T10:21:19.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.029+0000 7f994bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f994c09f1e0 0x7f994c1389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:19.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.029+0000 7f994b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c131ae0 0x7f994c131eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:19.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.029+0000 7f994affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f994c09e870 0x7f994c09eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:19.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.029+0000 7f994bfff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f994c09f1e0 0x7f994c1389e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40494/0 (socket says 172.21.15.146:40494) 2023-10-03T10:21:19.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.029+0000 7f994bfff700 1 -- 172.21.15.146:0/554309277 learned_addr learned my addr 172.21.15.146:0/554309277 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:21:19.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.029+0000 7f994b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c131ae0 0x7f994c131eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45822/0 (socket says 172.21.15.146:45822) 2023-10-03T10:21:19.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.030+0000 7f994bfff700 1 -- 172.21.15.146:0/554309277 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c131ae0 msgr2=0x7f994c131eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:19.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.030+0000 7f994bfff700 1 --2- 172.21.15.146:0/554309277 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c131ae0 0x7f994c131eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:19.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.030+0000 7f994bfff700 1 -- 172.21.15.146:0/554309277 >> v2:172.21.15.146:3300/0 conn(0x7f994c09e870 msgr2=0x7f994c09eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:19.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.030+0000 7f994bfff700 1 --2- 172.21.15.146:0/554309277 >> v2:172.21.15.146:3300/0 conn(0x7f994c09e870 0x7f994c09eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:19.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.030+0000 7f994bfff700 1 -- 172.21.15.146:0/554309277 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c09c970 con 0x7f994c09f1e0 2023-10-03T10:21:19.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.030+0000 7f994affd700 1 --2- 172.21.15.146:0/554309277 >> v2:172.21.15.146:3300/0 conn(0x7f994c09e870 0x7f994c09eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:19.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.030+0000 7f994bfff700 1 --2- 172.21.15.146:0/554309277 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f994c09f1e0 0x7f994c1389e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f9944009e80 tx=0x7f994400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d50c34b8548511db server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:19.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.030+0000 7f994a7fc700 1 -- 172.21.15.146:0/554309277 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994400e070 con 0x7f994c09f1e0 2023-10-03T10:21:19.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.030+0000 7f994a7fc700 1 -- 172.21.15.146:0/554309277 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994400b8d0 con 0x7f994c09f1e0 2023-10-03T10:21:19.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.030+0000 7f994a7fc700 1 -- 172.21.15.146:0/554309277 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994400bc80 con 0x7f994c09f1e0 2023-10-03T10:21:19.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.030+0000 7f9951e83700 1 -- 172.21.15.146:0/554309277 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f994c09f1e0 msgr2=0x7f994c1389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:19.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.030+0000 7f9951e83700 1 --2- 172.21.15.146:0/554309277 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f994c09f1e0 0x7f994c1389e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f9944009e80 tx=0x7f994400b330 comp rx=0 tx=0).stop 2023-10-03T10:21:19.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.031+0000 7f9951e83700 1 -- 172.21.15.146:0/554309277 shutdown_connections 2023-10-03T10:21:19.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.031+0000 7f9951e83700 1 --2- 172.21.15.146:0/554309277 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c131ae0 0x7f994c131eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:19.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.031+0000 7f9951e83700 1 --2- 172.21.15.146:0/554309277 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f994c09f1e0 0x7f994c1389e0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:19.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.031+0000 7f9951e83700 1 --2- 172.21.15.146:0/554309277 >> v2:172.21.15.146:3300/0 conn(0x7f994c09e870 0x7f994c09eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:19.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.031+0000 7f9951e83700 1 -- 172.21.15.146:0/554309277 >> 172.21.15.146:0/554309277 conn(0x7f994c0a4390 msgr2=0x7f994c0a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:19.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.031+0000 7f9951e83700 1 -- 172.21.15.146:0/554309277 shutdown_connections 2023-10-03T10:21:19.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.031+0000 7f9951e83700 1 -- 172.21.15.146:0/554309277 wait complete. 2023-10-03T10:21:19.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.032+0000 7f9951e83700 1 Processor -- start 2023-10-03T10:21:19.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.032+0000 7f9951e83700 1 -- start start 2023-10-03T10:21:19.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f9951e83700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c09e870 0x7f994c11df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:19.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f9951e83700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f994c09f1e0 0x7f994c11e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:19.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f9951e83700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f994c131ae0 0x7f994c11e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:19.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f9951e83700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994c1223b0 con 0x7f994c131ae0 2023-10-03T10:21:19.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f9951e83700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994c11fb80 con 0x7f994c09e870 2023-10-03T10:21:19.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f9951e83700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f994c121710 con 0x7f994c09f1e0 2023-10-03T10:21:19.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f994b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c09e870 0x7f994c11df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:19.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f994b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c09e870 0x7f994c11df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45832/0 (socket says 172.21.15.146:45832) 2023-10-03T10:21:19.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f994b7fe700 1 -- 172.21.15.146:0/543856216 learned_addr learned my addr 172.21.15.146:0/543856216 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:21:19.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f994affd700 1 --2- 172.21.15.146:0/543856216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f994c09f1e0 0x7f994c11e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:19.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f994bfff700 1 --2- 172.21.15.146:0/543856216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f994c131ae0 0x7f994c11e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:19.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f994b7fe700 1 -- 172.21.15.146:0/543856216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f994c09f1e0 msgr2=0x7f994c11e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:19.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f994b7fe700 1 --2- 172.21.15.146:0/543856216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f994c09f1e0 0x7f994c11e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:19.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f994b7fe700 1 -- 172.21.15.146:0/543856216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f994c131ae0 msgr2=0x7f994c11e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:19.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f994b7fe700 1 --2- 172.21.15.146:0/543856216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f994c131ae0 0x7f994c11e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:19.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f994b7fe700 1 -- 172.21.15.146:0/543856216 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99400094a0 con 0x7f994c09e870 2023-10-03T10:21:19.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f994affd700 1 --2- 172.21.15.146:0/543856216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f994c09f1e0 0x7f994c11e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:19.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f994b7fe700 1 --2- 172.21.15.146:0/543856216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c09e870 0x7f994c11df20 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f993c00e9c0 tx=0x7f993c00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:19.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f9933fff700 1 -- 172.21.15.146:0/543856216 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c0096f0 con 0x7f994c09e870 2023-10-03T10:21:19.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f9933fff700 1 -- 172.21.15.146:0/543856216 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c00ee60 con 0x7f994c09e870 2023-10-03T10:21:19.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f9951e83700 1 -- 172.21.15.146:0/543856216 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9944009b30 con 0x7f994c09e870 2023-10-03T10:21:19.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f9933fff700 1 -- 172.21.15.146:0/543856216 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c00ca50 con 0x7f994c09e870 2023-10-03T10:21:19.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.033+0000 7f9951e83700 1 -- 172.21.15.146:0/543856216 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f994c120d30 con 0x7f994c09e870 2023-10-03T10:21:19.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.034+0000 7f9933fff700 1 -- 172.21.15.146:0/543856216 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f993c00cbb0 con 0x7f994c09e870 2023-10-03T10:21:19.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.034+0000 7f9933fff700 1 -- 172.21.15.146:0/543856216 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f993c03fa40 con 0x7f994c09e870 2023-10-03T10:21:19.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.034+0000 7f9951e83700 1 -- 172.21.15.146:0/543856216 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f994c121550 con 0x7f994c09e870 2023-10-03T10:21:19.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.039+0000 7f9933fff700 1 -- 172.21.15.146:0/543856216 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f993c017080 con 0x7f994c09e870 2023-10-03T10:21:19.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.222+0000 7f9951e83700 1 -- 172.21.15.146:0/543856216 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f994c1213b0 con 0x7f994c09e870 2023-10-03T10:21:19.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.223+0000 7f9933fff700 1 -- 172.21.15.146:0/543856216 <== mon.1 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f994c1213b0 con 0x7f994c09e870 2023-10-03T10:21:19.223 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-03T10:21:19.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.225+0000 7f9951e83700 1 -- 172.21.15.146:0/543856216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c09e870 msgr2=0x7f994c11df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:19.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.225+0000 7f9951e83700 1 --2- 172.21.15.146:0/543856216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c09e870 0x7f994c11df20 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f993c00e9c0 tx=0x7f993c00ecd0 comp rx=0 tx=0).stop 2023-10-03T10:21:19.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.225+0000 7f9951e83700 1 -- 172.21.15.146:0/543856216 shutdown_connections 2023-10-03T10:21:19.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.225+0000 7f9951e83700 1 --2- 172.21.15.146:0/543856216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f994c131ae0 0x7f994c11e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:19.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.225+0000 7f9951e83700 1 --2- 172.21.15.146:0/543856216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f994c09e870 0x7f994c11df20 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:19.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.225+0000 7f9951e83700 1 --2- 172.21.15.146:0/543856216 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f994c09f1e0 0x7f994c11e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:19.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.225+0000 7f9951e83700 1 -- 172.21.15.146:0/543856216 >> 172.21.15.146:0/543856216 conn(0x7f994c0a4390 msgr2=0x7f994c1b8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:19.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.225+0000 7f9951e83700 1 -- 172.21.15.146:0/543856216 shutdown_connections 2023-10-03T10:21:19.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.225+0000 7f9951e83700 1 -- 172.21.15.146:0/543856216 wait complete. 2023-10-03T10:21:19.237 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T10:21:19.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.359+0000 7f48651ff700 1 Processor -- start 2023-10-03T10:21:19.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.359+0000 7f48651ff700 1 -- start start 2023-10-03T10:21:19.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f48651ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f486009d860 0x7f486009dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:19.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f48651ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f486009e170 0x7f48601307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:19.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f48651ff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4860130ce0 0x7f4860131180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:19.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f48651ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f486009aaa0 con 0x7f486009e170 2023-10-03T10:21:19.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f48651ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486009f870 con 0x7f486009d860 2023-10-03T10:21:19.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f48651ff700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f486009b360 con 0x7f4860130ce0 2023-10-03T10:21:19.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f485ed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f486009d860 0x7f486009dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:19.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f485e59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f486009e170 0x7f48601307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:19.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f485f59e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4860130ce0 0x7f4860131180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:19.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f485e59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f486009e170 0x7f48601307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53882/0 (socket says 172.21.15.146:53882) 2023-10-03T10:21:19.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f485e59c700 1 -- 172.21.15.146:0/3616154538 learned_addr learned my addr 172.21.15.146:0/3616154538 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:21:19.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f485f59e700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4860130ce0 0x7f4860131180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3302/0 says I am v2:172.21.15.146:40512/0 (socket says 172.21.15.146:40512) 2023-10-03T10:21:19.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f485ed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f486009d860 0x7f486009dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45840/0 (socket says 172.21.15.146:45840) 2023-10-03T10:21:19.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f485e59c700 1 -- 172.21.15.146:0/3616154538 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4860130ce0 msgr2=0x7f4860131180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:19.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f485e59c700 1 --2- 172.21.15.146:0/3616154538 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4860130ce0 0x7f4860131180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:19.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f485e59c700 1 -- 172.21.15.146:0/3616154538 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f486009d860 msgr2=0x7f486009dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:19.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f485e59c700 1 --2- 172.21.15.146:0/3616154538 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f486009d860 0x7f486009dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:19.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f485e59c700 1 -- 172.21.15.146:0/3616154538 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486009b620 con 0x7f486009e170 2023-10-03T10:21:19.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f485f59e700 1 --2- 172.21.15.146:0/3616154538 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4860130ce0 0x7f4860131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:19.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f485ed9d700 1 --2- 172.21.15.146:0/3616154538 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f486009d860 0x7f486009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:19.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f485e59c700 1 --2- 172.21.15.146:0/3616154538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f486009e170 0x7f48601307a0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f48500098f0 tx=0x7f4850009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3347c4310c248110 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:19.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f485dd9b700 1 -- 172.21.15.146:0/3616154538 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4850011830 con 0x7f486009e170 2023-10-03T10:21:19.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f485dd9b700 1 -- 172.21.15.146:0/3616154538 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4850011990 con 0x7f486009e170 2023-10-03T10:21:19.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.360+0000 7f485dd9b700 1 -- 172.21.15.146:0/3616154538 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4850011d20 con 0x7f486009e170 2023-10-03T10:21:19.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.361+0000 7f48651ff700 1 -- 172.21.15.146:0/3616154538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f486009e170 msgr2=0x7f48601307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:19.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.361+0000 7f48651ff700 1 --2- 172.21.15.146:0/3616154538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f486009e170 0x7f48601307a0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f48500098f0 tx=0x7f4850009c00 comp rx=0 tx=0).stop 2023-10-03T10:21:19.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.361+0000 7f48651ff700 1 -- 172.21.15.146:0/3616154538 shutdown_connections 2023-10-03T10:21:19.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.361+0000 7f48651ff700 1 --2- 172.21.15.146:0/3616154538 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f486009d860 0x7f486009dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:19.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.361+0000 7f48651ff700 1 --2- 172.21.15.146:0/3616154538 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f4860130ce0 0x7f4860131180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:19.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.361+0000 7f48651ff700 1 --2- 172.21.15.146:0/3616154538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f486009e170 0x7f48601307a0 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:19.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.361+0000 7f48651ff700 1 -- 172.21.15.146:0/3616154538 >> 172.21.15.146:0/3616154538 conn(0x7f4860099c40 msgr2=0x7f48600a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:19.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.361+0000 7f48651ff700 1 -- 172.21.15.146:0/3616154538 shutdown_connections 2023-10-03T10:21:19.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.361+0000 7f48651ff700 1 -- 172.21.15.146:0/3616154538 wait complete. 2023-10-03T10:21:19.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.363+0000 7f48651ff700 1 Processor -- start 2023-10-03T10:21:19.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.363+0000 7f48651ff700 1 -- start start 2023-10-03T10:21:19.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.363+0000 7f48651ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f486009d860 0x7f48601c5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:19.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.363+0000 7f48651ff700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f486009e170 0x7f48601c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:19.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.363+0000 7f48651ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4860130ce0 0x7f48601c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:19.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.363+0000 7f48651ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48601305b0 con 0x7f4860130ce0 2023-10-03T10:21:19.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.363+0000 7f48651ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486011f290 con 0x7f486009d860 2023-10-03T10:21:19.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.363+0000 7f48651ff700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f486009c920 con 0x7f486009e170 2023-10-03T10:21:19.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.363+0000 7f485ed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f486009d860 0x7f48601c5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:19.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.363+0000 7f485f59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4860130ce0 0x7f48601c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:19.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.363+0000 7f485ed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f486009d860 0x7f48601c5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45850/0 (socket says 172.21.15.146:45850) 2023-10-03T10:21:19.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.363+0000 7f485f59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4860130ce0 0x7f48601c5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53888/0 (socket says 172.21.15.146:53888) 2023-10-03T10:21:19.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.363+0000 7f485ed9d700 1 -- 172.21.15.146:0/588905606 learned_addr learned my addr 172.21.15.146:0/588905606 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:21:19.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.363+0000 7f485e59c700 1 --2- 172.21.15.146:0/588905606 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f486009e170 0x7f48601c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:19.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.364+0000 7f485f59e700 1 -- 172.21.15.146:0/588905606 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f486009e170 msgr2=0x7f48601c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:19.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.364+0000 7f485f59e700 1 --2- 172.21.15.146:0/588905606 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f486009e170 0x7f48601c55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:19.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.364+0000 7f485f59e700 1 -- 172.21.15.146:0/588905606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f486009d860 msgr2=0x7f48601c5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:19.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.364+0000 7f485f59e700 1 --2- 172.21.15.146:0/588905606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f486009d860 0x7f48601c5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:19.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.364+0000 7f485f59e700 1 -- 172.21.15.146:0/588905606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48480094a0 con 0x7f4860130ce0 2023-10-03T10:21:19.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.364+0000 7f485ed9d700 1 --2- 172.21.15.146:0/588905606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f486009d860 0x7f48601c5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:19.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.364+0000 7f485e59c700 1 --2- 172.21.15.146:0/588905606 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f486009e170 0x7f48601c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:19.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.364+0000 7f485f59e700 1 --2- 172.21.15.146:0/588905606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4860130ce0 0x7f48601c5af0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f485800efc0 tx=0x7f485800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:19.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.364+0000 7f48577fe700 1 -- 172.21.15.146:0/588905606 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485800ca30 con 0x7f4860130ce0 2023-10-03T10:21:19.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.364+0000 7f48577fe700 1 -- 172.21.15.146:0/588905606 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485800f040 con 0x7f4860130ce0 2023-10-03T10:21:19.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.364+0000 7f48651ff700 1 -- 172.21.15.146:0/588905606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4858009a70 con 0x7f4860130ce0 2023-10-03T10:21:19.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.364+0000 7f48577fe700 1 -- 172.21.15.146:0/588905606 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485800cdd0 con 0x7f4860130ce0 2023-10-03T10:21:19.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.364+0000 7f48651ff700 1 -- 172.21.15.146:0/588905606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4850009550 con 0x7f4860130ce0 2023-10-03T10:21:19.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.365+0000 7f48577fe700 1 -- 172.21.15.146:0/588905606 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4858014480 con 0x7f4860130ce0 2023-10-03T10:21:19.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.365+0000 7f48577fe700 1 -- 172.21.15.146:0/588905606 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f485803fbf0 con 0x7f4860130ce0 2023-10-03T10:21:19.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.365+0000 7f48651ff700 1 -- 172.21.15.146:0/588905606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f486004f2a0 con 0x7f4860130ce0 2023-10-03T10:21:19.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.370+0000 7f48577fe700 1 -- 172.21.15.146:0/588905606 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4858012930 con 0x7f4860130ce0 2023-10-03T10:21:19.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.567+0000 7f48651ff700 1 -- 172.21.15.146:0/588905606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f486011f4d0 con 0x7f4860130ce0 2023-10-03T10:21:19.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.567+0000 7f48577fe700 1 -- 172.21.15.146:0/588905606 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 11 entries v39) v1 ==== 81+0+646 (secure 0 0 0) 0x7f4858012340 con 0x7f4860130ce0 2023-10-03T10:21:19.567 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:0/1965600138 2023-10-04T10:12:46.859809+0000 2023-10-03T10:21:19.567 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:0/1702650323 2023-10-04T10:12:46.859809+0000 2023-10-03T10:21:19.567 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:0/2857084049 2023-10-04T10:12:46.859809+0000 2023-10-03T10:21:19.568 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:0/784768892 2023-10-04T10:12:46.859809+0000 2023-10-03T10:21:19.568 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:6816/118159 2023-10-04T10:11:52.317723+0000 2023-10-03T10:21:19.568 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:0/3123391800 2023-10-04T10:12:46.859809+0000 2023-10-03T10:21:19.568 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:0/45915595 2023-10-04T10:11:52.317723+0000 2023-10-03T10:21:19.568 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:0/1896339219 2023-10-04T10:11:52.317723+0000 2023-10-03T10:21:19.568 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:6817/4164614194 2023-10-04T10:12:13.686998+0000 2023-10-03T10:21:19.568 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:0/807364756 2023-10-04T10:12:46.859809+0000 2023-10-03T10:21:19.569 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:6816/126749 2023-10-04T10:12:46.859809+0000 2023-10-03T10:21:19.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.569+0000 7f48651ff700 1 -- 172.21.15.146:0/588905606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4860130ce0 msgr2=0x7f48601c5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:19.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.569+0000 7f48651ff700 1 --2- 172.21.15.146:0/588905606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4860130ce0 0x7f48601c5af0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f485800efc0 tx=0x7f485800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:21:19.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.569+0000 7f48651ff700 1 -- 172.21.15.146:0/588905606 shutdown_connections 2023-10-03T10:21:19.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.569+0000 7f48651ff700 1 --2- 172.21.15.146:0/588905606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4860130ce0 0x7f48601c5af0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:19.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.569+0000 7f48651ff700 1 --2- 172.21.15.146:0/588905606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f486009d860 0x7f48601c5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:19.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.569+0000 7f48651ff700 1 --2- 172.21.15.146:0/588905606 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f486009e170 0x7f48601c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:19.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.569+0000 7f48651ff700 1 -- 172.21.15.146:0/588905606 >> 172.21.15.146:0/588905606 conn(0x7f4860099c40 msgr2=0x7f48600a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:19.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.569+0000 7f48651ff700 1 -- 172.21.15.146:0/588905606 shutdown_connections 2023-10-03T10:21:19.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:19.569+0000 7f48651ff700 1 -- 172.21.15.146:0/588905606 wait complete. 2023-10-03T10:21:19.571 INFO:teuthology.orchestra.run.smithi146.stderr:listed 11 entries 2023-10-03T10:21:19.581 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi153.front.sepia.ceph.com... 2023-10-03T10:21:19.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:21:19.581 DEBUG:teuthology.orchestra.run.smithi153:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-03T10:21:19.623 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi153.stderr:ceph-fuse[112248]: fuse finished with error 0 and tester_r 0 2023-10-03T10:21:19.625 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:21:25.726 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-10-03T10:21:25.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:21:25.727 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-03T10:21:25.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:21:25.768 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-10-03T10:21:25.828 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-03T10:21:25.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:21:25.829 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:21:25.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:21:25.911 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2023-10-03T10:21:26.011 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-03T10:21:26.023 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-03T10:21:26.023 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:21:26.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.159+0000 7f32dd8d2700 1 Processor -- start 2023-10-03T10:21:26.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.159+0000 7f32dd8d2700 1 -- start start 2023-10-03T10:21:26.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.159+0000 7f32dd8d2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d80a0a70 0x7f32d80a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:26.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.159+0000 7f32dd8d2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d8134120 0x7f32d813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:26.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.159+0000 7f32dd8d2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d809dc00 con 0x7f32d80a1380 2023-10-03T10:21:26.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.159+0000 7f32dd8d2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d809ea90 con 0x7f32d80a0a70 2023-10-03T10:21:26.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.159+0000 7f32dd8d2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32d809dec0 con 0x7f32d8134120 2023-10-03T10:21:26.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.159+0000 7f32d6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d80a0a70 0x7f32d80a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:26.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.159+0000 7f32d77fe700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d8134120 0x7f32d813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:26.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.159+0000 7f32d67fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f32d80a1380 0x7f32d8133a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35006/0 (socket says 172.21.15.146:35006) 2023-10-03T10:21:26.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.159+0000 7f32d67fc700 1 -- 172.21.15.146:0/697293942 learned_addr learned my addr 172.21.15.146:0/697293942 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-03T10:21:26.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.159+0000 7f32d6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d80a0a70 0x7f32d80a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58542/0 (socket says 172.21.15.146:58542) 2023-10-03T10:21:26.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.160+0000 7f32d5ffb700 1 -- 172.21.15.146:0/697293942 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065764486 0 0) 0x7f32d809dc00 con 0x7f32d80a1380 2023-10-03T10:21:26.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.160+0000 7f32d5ffb700 1 -- 172.21.15.146:0/697293942 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32c00035b0 con 0x7f32d80a1380 2023-10-03T10:21:26.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.160+0000 7f32d77fe700 1 -- 172.21.15.146:0/697293942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d80a0a70 msgr2=0x7f32d80a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:26.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.160+0000 7f32d77fe700 1 --2- 172.21.15.146:0/697293942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d80a0a70 0x7f32d80a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.160+0000 7f32d77fe700 1 -- 172.21.15.146:0/697293942 >> v1:172.21.15.146:6789/0 conn(0x7f32d80a1380 legacy=0x7f32d8133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:26.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.160+0000 7f32d77fe700 1 -- 172.21.15.146:0/697293942 --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d809e6a0 con 0x7f32d8134120 2023-10-03T10:21:26.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.160+0000 7f32d6ffd700 1 --2- 172.21.15.146:0/697293942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d80a0a70 0x7f32d80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:26.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.160+0000 7f32d77fe700 1 --2- 172.21.15.146:0/697293942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d8134120 0x7f32d813bce0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009dc0 tx=0x7f32d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67a03d5cf3ba482 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:26.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.160+0000 7f32d5ffb700 1 -- 172.21.15.146:0/697293942 <== mon.2 v2:172.21.15.146:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d000e070 con 0x7f32d8134120 2023-10-03T10:21:26.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.160+0000 7f32d5ffb700 1 -- 172.21.15.146:0/697293942 <== mon.2 v2:172.21.15.146:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d000bb20 con 0x7f32d8134120 2023-10-03T10:21:26.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.160+0000 7f32d5ffb700 1 -- 172.21.15.146:0/697293942 <== mon.2 v2:172.21.15.146:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0012430 con 0x7f32d8134120 2023-10-03T10:21:26.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.160+0000 7f32dd8d2700 1 -- 172.21.15.146:0/697293942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d8134120 msgr2=0x7f32d813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:26.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.160+0000 7f32dd8d2700 1 --2- 172.21.15.146:0/697293942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d8134120 0x7f32d813bce0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009dc0 tx=0x7f32d000b330 comp rx=0 tx=0).stop 2023-10-03T10:21:26.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.160+0000 7f32dd8d2700 1 -- 172.21.15.146:0/697293942 shutdown_connections 2023-10-03T10:21:26.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.160+0000 7f32dd8d2700 1 --2- 172.21.15.146:0/697293942 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d8134120 0x7f32d813bce0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.161+0000 7f32dd8d2700 1 --2- 172.21.15.146:0/697293942 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d80a0a70 0x7f32d80a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.161+0000 7f32dd8d2700 1 -- 172.21.15.146:0/697293942 >> 172.21.15.146:0/697293942 conn(0x7f32d80a6610 msgr2=0x7f32d80a6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:26.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.161+0000 7f32dd8d2700 1 -- 172.21.15.146:0/697293942 shutdown_connections 2023-10-03T10:21:26.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.161+0000 7f32dd8d2700 1 -- 172.21.15.146:0/697293942 wait complete. 2023-10-03T10:21:26.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.161+0000 7f32dd8d2700 1 Processor -- start 2023-10-03T10:21:26.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.162+0000 7f32dd8d2700 1 -- start start 2023-10-03T10:21:26.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.162+0000 7f32dd8d2700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d80a0a70 0x7f32d8122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:26.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.162+0000 7f32dd8d2700 1 --2- >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d80a1380 0x7f32d8122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:26.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.162+0000 7f32dd8d2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32d8134120 0x7f32d81232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:26.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.162+0000 7f32dd8d2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d8123c30 con 0x7f32d8134120 2023-10-03T10:21:26.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.162+0000 7f32dd8d2700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d80a55b0 con 0x7f32d80a0a70 2023-10-03T10:21:26.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.162+0000 7f32dd8d2700 1 -- --> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32d80a03e0 con 0x7f32d80a1380 2023-10-03T10:21:26.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.162+0000 7f32d6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d80a0a70 0x7f32d8122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:26.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.162+0000 7f32d6ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d80a0a70 0x7f32d8122860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:58550/0 (socket says 172.21.15.146:58550) 2023-10-03T10:21:26.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.162+0000 7f32d6ffd700 1 -- 172.21.15.146:0/329642168 learned_addr learned my addr 172.21.15.146:0/329642168 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-03T10:21:26.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.162+0000 7f32d77fe700 1 --2- 172.21.15.146:0/329642168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32d8134120 0x7f32d81232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:26.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.162+0000 7f32d67fc700 1 --2- 172.21.15.146:0/329642168 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d80a1380 0x7f32d8122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:26.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.163+0000 7f32d6ffd700 1 -- 172.21.15.146:0/329642168 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d80a1380 msgr2=0x7f32d8122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:26.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.163+0000 7f32d6ffd700 1 --2- 172.21.15.146:0/329642168 >> [v2:172.21.15.146:3302/0,v1:172.21.15.146:6791/0] conn(0x7f32d80a1380 0x7f32d8122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.163+0000 7f32d6ffd700 1 -- 172.21.15.146:0/329642168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32d8134120 msgr2=0x7f32d81232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:26.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.163+0000 7f32d6ffd700 1 --2- 172.21.15.146:0/329642168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32d8134120 0x7f32d81232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.163+0000 7f32d6ffd700 1 -- 172.21.15.146:0/329642168 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c80094a0 con 0x7f32d80a0a70 2023-10-03T10:21:26.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.163+0000 7f32d6ffd700 1 --2- 172.21.15.146:0/329642168 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32d80a0a70 0x7f32d8122860 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f32c800ebe0 tx=0x7f32c800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:26.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.163+0000 7f32bffff700 1 -- 172.21.15.146:0/329642168 <== mon.1 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c800c850 con 0x7f32d80a0a70 2023-10-03T10:21:26.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.163+0000 7f32bffff700 1 -- 172.21.15.146:0/329642168 <== mon.1 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c800c9b0 con 0x7f32d80a0a70 2023-10-03T10:21:26.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.163+0000 7f32dd8d2700 1 -- 172.21.15.146:0/329642168 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d0009a70 con 0x7f32d80a0a70 2023-10-03T10:21:26.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.163+0000 7f32bffff700 1 -- 172.21.15.146:0/329642168 <== mon.1 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c800cd40 con 0x7f32d80a0a70 2023-10-03T10:21:26.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.163+0000 7f32dd8d2700 1 -- 172.21.15.146:0/329642168 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d8133300 con 0x7f32d80a0a70 2023-10-03T10:21:26.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.164+0000 7f32bffff700 1 -- 172.21.15.146:0/329642168 <== mon.1 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f32c8013470 con 0x7f32d80a0a70 2023-10-03T10:21:26.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.164+0000 7f32bffff700 1 -- 172.21.15.146:0/329642168 <== mon.1 v2:172.21.15.146:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4393+0+0 (secure 0 0 0) 0x7f32c803f910 con 0x7f32d80a0a70 2023-10-03T10:21:26.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.164+0000 7f32dd8d2700 1 -- 172.21.15.146:0/329642168 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32d804f2a0 con 0x7f32d80a0a70 2023-10-03T10:21:26.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-03T10:21:26.169+0000 7f32bffff700 1 -- 172.21.15.146:0/329642168 <== mon.1 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f32c8013720 con 0x7f32d80a0a70 2023-10-03T10:23:26.062 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-03T10:23:26.063 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi146 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:23:26.072 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-03T10:23:26.073 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-03T10:23:26.073 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:26.087 INFO:tasks.ceph.mds.a:Stopped 2023-10-03T10:23:26.087 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-03T10:23:26.087 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-03T10:23:26.087 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:26.156 INFO:tasks.ceph.osd.0:Stopped 2023-10-03T10:23:26.156 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-03T10:23:26.156 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:26.225 INFO:tasks.ceph.osd.1:Stopped 2023-10-03T10:23:26.225 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-03T10:23:26.225 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:26.293 INFO:tasks.ceph.osd.2:Stopped 2023-10-03T10:23:26.294 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-03T10:23:26.294 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:26.371 INFO:tasks.ceph.osd.3:Stopped 2023-10-03T10:23:26.371 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-03T10:23:26.371 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-03T10:23:26.371 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:26.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:23:26.372 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi146 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi146 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2023-10-03T10:23:26.383 INFO:tasks.ceph.mgr.x:Stopped 2023-10-03T10:23:26.383 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-03T10:23:26.384 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-03T10:23:26.384 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:26.423 INFO:tasks.ceph.mon.a:Stopped 2023-10-03T10:23:26.424 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-03T10:23:26.424 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:26.476 INFO:tasks.ceph.mon.b:Stopped 2023-10-03T10:23:26.476 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-03T10:23:26.476 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:26.528 INFO:tasks.ceph.mon.c:Stopped 2023-10-03T10:23:26.528 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-03T10:23:26.529 DEBUG:teuthology.orchestra.run.smithi146:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'scrub mismatch' | egrep -v ScrubResult | egrep -v 'wrongly marked' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_MSGR2_NOT_ENABLED\)' | egrep -v 'slow request' | head -n 1 2023-10-03T10:23:26.610 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T10:23:26.611 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-03T10:23:26.796 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T10:23:26.797 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-03T10:23:26.909 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T10:23:26.909 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-03T10:23:26.983 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T10:23:26.984 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-03T10:23:27.078 INFO:tasks.ceph:Archiving mon data... 2023-10-03T10:23:27.079 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409562/data/mon.a.tgz 2023-10-03T10:23:27.079 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2023-10-03T10:23:27.097 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.msnh8qaWR6 2023-10-03T10:23:27.097 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.msnh8qaWR6 2023-10-03T10:23:27.226 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.msnh8qaWR6 2023-10-03T10:23:27.314 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.msnh8qaWR6 is 307KB 2023-10-03T10:23:27.408 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.msnh8qaWR6 2023-10-03T10:23:27.425 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409562/data/mon.b.tgz 2023-10-03T10:23:27.425 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2023-10-03T10:23:27.481 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.ZRH34l5XJd 2023-10-03T10:23:27.482 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ZRH34l5XJd 2023-10-03T10:23:27.602 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.ZRH34l5XJd 2023-10-03T10:23:27.689 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.ZRH34l5XJd is 308KB 2023-10-03T10:23:27.785 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.ZRH34l5XJd 2023-10-03T10:23:27.803 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409562/data/mon.c.tgz 2023-10-03T10:23:27.803 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2023-10-03T10:23:27.859 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.gpvkIwLdnx 2023-10-03T10:23:27.860 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.gpvkIwLdnx 2023-10-03T10:23:27.980 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.gpvkIwLdnx 2023-10-03T10:23:28.068 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.gpvkIwLdnx is 308KB 2023-10-03T10:23:28.137 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.gpvkIwLdnx 2023-10-03T10:23:28.154 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-03T10:23:28.154 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-03T10:23:28.195 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-03T10:23:28.233 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-03T10:23:28.233 DEBUG:teuthology.orchestra.run.smithi146:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-03T10:23:28.262 DEBUG:teuthology.orchestra.run.smithi153:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-03T10:23:28.288 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-03T10:23:28.305 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-03T10:23:28.312 INFO:tasks.ceph:Archiving crash dumps... 2023-10-03T10:23:28.313 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409562/remote/smithi146/crash 2023-10-03T10:23:28.314 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-03T10:23:28.361 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409562/remote/smithi153/crash 2023-10-03T10:23:28.362 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-03T10:23:28.403 INFO:tasks.ceph:Compressing logs... 2023-10-03T10:23:28.403 DEBUG:teuthology.orchestra.run.smithi146:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-03T10:23:28.405 DEBUG:teuthology.orchestra.run.smithi153:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-03T10:23:28.430 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169709.log 2023-10-03T10:23:28.481 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112248.log 2023-10-03T10:23:28.488 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.112248.log: 96.6% -- replaced with /var/log/ceph/ceph-client.0.112248.log.gz 2023-10-03T10:23:28.489 INFO:teuthology.orchestra.run.smithi153.stderr: 2023-10-03T10:23:28.489 INFO:teuthology.orchestra.run.smithi153.stderr:real 0m0.019s 2023-10-03T10:23:28.489 INFO:teuthology.orchestra.run.smithi153.stderr:user 0m0.013s 2023-10-03T10:23:28.489 INFO:teuthology.orchestra.run.smithi153.stderr:sys 0m0.014s 2023-10-03T10:23:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141238.log 2023-10-03T10:23:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:gzip /var/log/ceph/ceph-client.admin.169709.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.159014.log 2023-10-03T10:23:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.141238.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.169709.log.gz 2023-10-03T10:23:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139592.log 2023-10-03T10:23:28.514 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.141238.log.gz 2023-10-03T10:23:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123245.log 2023-10-03T10:23:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.159014.log: /var/log/ceph/ceph-client.admin.139592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172946.log 2023-10-03T10:23:28.514 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.159014.log.gz 2023-10-03T10:23:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.123245.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139592.log.gz 2023-10-03T10:23:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161839.log 2023-10-03T10:23:28.514 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123245.log.gz 2023-10-03T10:23:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189289.log 2023-10-03T10:23:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.172946.log: /var/log/ceph/ceph-client.admin.161839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178770.log 2023-10-03T10:23:28.515 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172946.log.gz 2023-10-03T10:23:28.515 INFO:teuthology.orchestra.run.smithi146.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.161839.log.gz 2023-10-03T10:23:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.189289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158648.log 2023-10-03T10:23:28.515 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0%/var/log/ceph/ceph-client.admin.178770.log: -- replaced with /var/log/ceph/ceph-client.admin.189289.log.gz 2023-10-03T10:23:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137436.log 2023-10-03T10:23:28.515 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.178770.log.gz 2023-10-03T10:23:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.158648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140846.log 2023-10-03T10:23:28.516 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158648.log.gz 2023-10-03T10:23:28.516 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.137436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160101.log 2023-10-03T10:23:28.516 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.137436.log.gz 2023-10-03T10:23:28.516 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.140846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189215.log 2023-10-03T10:23:28.516 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.160101.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.140846.log.gz 2023-10-03T10:23:28.516 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158502.log 2023-10-03T10:23:28.516 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.160101.log.gz 2023-10-03T10:23:28.516 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.189215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177324.log 2023-10-03T10:23:28.517 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189215.log.gz 2023-10-03T10:23:28.517 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.158502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148861.log 2023-10-03T10:23:28.517 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.177324.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158502.log.gz 2023-10-03T10:23:28.517 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172852.log 2023-10-03T10:23:28.517 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.177324.log.gz 2023-10-03T10:23:28.517 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.148861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178136.log 2023-10-03T10:23:28.517 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.148861.log.gz 2023-10-03T10:23:28.517 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.172852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159262.log 2023-10-03T10:23:28.518 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.178136.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172852.log.gz 2023-10-03T10:23:28.518 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147860.log 2023-10-03T10:23:28.518 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.178136.log.gz 2023-10-03T10:23:28.518 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.159262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168137.log 2023-10-03T10:23:28.518 INFO:teuthology.orchestra.run.smithi146.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.159262.log.gz 2023-10-03T10:23:28.518 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.147860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136730.log 2023-10-03T10:23:28.518 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.147860.log.gz 2023-10-03T10:23:28.518 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.168137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156715.log 2023-10-03T10:23:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.136730.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168137.log.gz 2023-10-03T10:23:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144134.log 2023-10-03T10:23:28.519 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.136730.log.gz 2023-10-03T10:23:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.156715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166744.log 2023-10-03T10:23:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.144134.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.156715.log.gz 2023-10-03T10:23:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150041.log 2023-10-03T10:23:28.519 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.144134.log.gz 2023-10-03T10:23:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.166744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164783.log 2023-10-03T10:23:28.519 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.166744.log.gz 2023-10-03T10:23:28.520 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.150041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153722.log 2023-10-03T10:23:28.520 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.164783.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150041.log.gz 2023-10-03T10:23:28.520 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151566.log 2023-10-03T10:23:28.520 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.164783.log.gz 2023-10-03T10:23:28.520 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.153722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127626.log 2023-10-03T10:23:28.520 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.153722.log.gz 2023-10-03T10:23:28.520 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.151566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141748.log 2023-10-03T10:23:28.520 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.127626.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151566.log.gz 2023-10-03T10:23:28.521 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175160.log 2023-10-03T10:23:28.521 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.141748.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127626.log.gz 2023-10-03T10:23:28.521 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125426.log 2023-10-03T10:23:28.521 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.141748.log.gz 2023-10-03T10:23:28.521 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.175160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128313.log 2023-10-03T10:23:28.521 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.125426.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175160.log.gz 2023-10-03T10:23:28.521 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190265.log 2023-10-03T10:23:28.521 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.125426.log.gz 2023-10-03T10:23:28.522 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.128313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190561.log 2023-10-03T10:23:28.522 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128313.log.gz 2023-10-03T10:23:28.522 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.190265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180312.log 2023-10-03T10:23:28.522 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.190561.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.190265.log.gz 2023-10-03T10:23:28.522 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152821.log 2023-10-03T10:23:28.522 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.190561.log.gz 2023-10-03T10:23:28.522 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.180312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189015.log 2023-10-03T10:23:28.522 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.180312.log.gz 2023-10-03T10:23:28.522 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.152821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156100.log 2023-10-03T10:23:28.523 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.189015.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.152821.log.gz 2023-10-03T10:23:28.523 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193579.log 2023-10-03T10:23:28.523 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.189015.log.gz 2023-10-03T10:23:28.523 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.156100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180581.log 2023-10-03T10:23:28.523 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156100.log.gz 2023-10-03T10:23:28.523 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.193579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123811.log 2023-10-03T10:23:28.523 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.180581.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.193579.log.gz 2023-10-03T10:23:28.523 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138220.log 2023-10-03T10:23:28.524 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.180581.log.gz 2023-10-03T10:23:28.524 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123811.log: /var/log/ceph/ceph-client.admin.151047.log 2023-10-03T10:23:28.524 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.138220.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.123811.log.gz 2023-10-03T10:23:28.524 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191833.log 2023-10-03T10:23:28.524 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.138220.log.gz 2023-10-03T10:23:28.524 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.151047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143640.log 2023-10-03T10:23:28.524 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151047.log.gz 2023-10-03T10:23:28.524 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.191833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180143.log 2023-10-03T10:23:28.525 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.191833.log.gz 2023-10-03T10:23:28.525 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194758.log 2023-10-03T10:23:28.525 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.180143.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.143640.log.gz 2023-10-03T10:23:28.525 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163216.log 2023-10-03T10:23:28.525 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.180143.log.gz 2023-10-03T10:23:28.525 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.194758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156662.log 2023-10-03T10:23:28.525 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.194758.log.gz 2023-10-03T10:23:28.525 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.163216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194094.log 2023-10-03T10:23:28.525 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.156662.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.163216.log.gz 2023-10-03T10:23:28.526 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155904.log 2023-10-03T10:23:28.526 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.156662.log.gz 2023-10-03T10:23:28.526 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.194094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147076.log 2023-10-03T10:23:28.526 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.194094.log.gz 2023-10-03T10:23:28.526 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.155904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139004.log 2023-10-03T10:23:28.526 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.147076.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.155904.log.gz 2023-10-03T10:23:28.526 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189407.log 2023-10-03T10:23:28.526 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147076.log.gz 2023-10-03T10:23:28.527 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.139004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127883.log 2023-10-03T10:23:28.527 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139004.log.gz 2023-10-03T10:23:28.527 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.189407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150212.log 2023-10-03T10:23:28.527 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.127883.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189407.log.gz 2023-10-03T10:23:28.527 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148690.log 2023-10-03T10:23:28.527 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127883.log.gz 2023-10-03T10:23:28.527 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.150212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135894.log 2023-10-03T10:23:28.527 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.150212.log.gz 2023-10-03T10:23:28.528 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.148690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162454.log 2023-10-03T10:23:28.528 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.135894.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.148690.log.gz 2023-10-03T10:23:28.528 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169125.log 2023-10-03T10:23:28.528 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.135894.log.gz 2023-10-03T10:23:28.528 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.162454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169222.log 2023-10-03T10:23:28.528 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.162454.log.gz 2023-10-03T10:23:28.528 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.169125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157695.log 2023-10-03T10:23:28.528 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.169222.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.169125.log.gz 2023-10-03T10:23:28.529 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173191.log 2023-10-03T10:23:28.529 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.169222.log.gz 2023-10-03T10:23:28.529 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.157695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138442.log 2023-10-03T10:23:28.529 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157695.log.gz 2023-10-03T10:23:28.529 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.173191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152253.log 2023-10-03T10:23:28.529 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.138442.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173191.log.gz 2023-10-03T10:23:28.529 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136164.log 2023-10-03T10:23:28.529 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.138442.log.gz 2023-10-03T10:23:28.529 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.152253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177201.log 2023-10-03T10:23:28.530 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152253.log.gz 2023-10-03T10:23:28.530 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.136164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154388.log 2023-10-03T10:23:28.530 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.177201.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.136164.log.gz 2023-10-03T10:23:28.530 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189973.log 2023-10-03T10:23:28.530 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.177201.log.gz 2023-10-03T10:23:28.530 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.154388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123637.log 2023-10-03T10:23:28.530 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.154388.log.gz 2023-10-03T10:23:28.530 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.189973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122235.log 2023-10-03T10:23:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.123637.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189973.log.gz 2023-10-03T10:23:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174710.log 2023-10-03T10:23:28.531 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.123637.log.gz 2023-10-03T10:23:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.122235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118605.log 2023-10-03T10:23:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.174710.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.122235.log.gz 2023-10-03T10:23:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168634.log 2023-10-03T10:23:28.531 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.174710.log.gz 2023-10-03T10:23:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.118605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175944.log 2023-10-03T10:23:28.532 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118605.log.gz 2023-10-03T10:23:28.532 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.168634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158503.log 2023-10-03T10:23:28.532 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.168634.log.gz 2023-10-03T10:23:28.532 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.175944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177940.log 2023-10-03T10:23:28.532 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.158503.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.175944.log.gz 2023-10-03T10:23:28.532 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185957.log 2023-10-03T10:23:28.532 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158503.log.gz 2023-10-03T10:23:28.532 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.177940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125230.log 2023-10-03T10:23:28.532 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.177940.log.gz 2023-10-03T10:23:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.185957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175503.log 2023-10-03T10:23:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.125230.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.185957.log.gz 2023-10-03T10:23:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125524.log 2023-10-03T10:23:28.533 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.125230.log.gz 2023-10-03T10:23:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.175503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158308.log 2023-10-03T10:23:28.533 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175503.log.gz 2023-10-03T10:23:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.125524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176287.log 2023-10-03T10:23:28.533 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.158308.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.125524.log.gz 2023-10-03T10:23:28.534 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153381.log 2023-10-03T10:23:28.534 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158308.log.gz 2023-10-03T10:23:28.534 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.176287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152635.log 2023-10-03T10:23:28.534 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.153381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191637.log 2023-10-03T10:23:28.534 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176287.log.gz 2023-10-03T10:23:28.534 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.152635.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.153381.log.gz 2023-10-03T10:23:28.534 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168333.log 2023-10-03T10:23:28.534 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.152635.log.gz 2023-10-03T10:23:28.534 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.191637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136064.log 2023-10-03T10:23:28.535 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191637.log.gz 2023-10-03T10:23:28.535 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.168333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141382.log 2023-10-03T10:23:28.535 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.168333.log.gz 2023-10-03T10:23:28.535 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.136064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179089.log 2023-10-03T10:23:28.535 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.141382.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.136064.log.gz 2023-10-03T10:23:28.535 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172162.log 2023-10-03T10:23:28.535 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.141382.log.gz 2023-10-03T10:23:28.535 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.179089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140062.log 2023-10-03T10:23:28.536 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.179089.log.gz 2023-10-03T10:23:28.536 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.172162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136926.log 2023-10-03T10:23:28.536 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.140062.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.172162.log.gz 2023-10-03T10:23:28.536 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167110.log 2023-10-03T10:23:28.536 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140062.log.gz 2023-10-03T10:23:28.536 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.136926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169641.log 2023-10-03T10:23:28.536 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.167110.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136926.log.gz 2023-10-03T10:23:28.536 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141381.log 2023-10-03T10:23:28.537 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.169641.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167110.log.gz 2023-10-03T10:23:28.537 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187574.log 2023-10-03T10:23:28.537 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.169641.log.gz 2023-10-03T10:23:28.537 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.141381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186079.log 2023-10-03T10:23:28.537 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141381.log.gz 2023-10-03T10:23:28.537 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.187574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148913.log 2023-10-03T10:23:28.537 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.186079.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.187574.log.gz 2023-10-03T10:23:28.537 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143248.log 2023-10-03T10:23:28.538 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.186079.log.gz 2023-10-03T10:23:28.538 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.148913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125818.log 2023-10-03T10:23:28.538 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.148913.log.gz 2023-10-03T10:23:28.538 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141944.log 2023-10-03T10:23:28.538 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.125818.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.143248.log.gz 2023-10-03T10:23:28.538 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166300.log 2023-10-03T10:23:28.538 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.141944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139493.log 2023-10-03T10:23:28.538 INFO:teuthology.orchestra.run.smithi146.stderr: 90.8% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.125818.log.gz -- replaced with /var/log/ceph/ceph-client.admin.141944.log.gz 2023-10-03T10:23:28.538 INFO:teuthology.orchestra.run.smithi146.stderr: 2023-10-03T10:23:28.539 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.166300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187843.log 2023-10-03T10:23:28.539 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.166300.log.gz 2023-10-03T10:23:28.539 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172459.log 2023-10-03T10:23:28.539 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.139493.log: /var/log/ceph/ceph-client.admin.187843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140453.log 2023-10-03T10:23:28.539 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139493.log.gz 2023-10-03T10:23:28.539 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.172459.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.187843.log.gz 2023-10-03T10:23:28.539 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164118.log 2023-10-03T10:23:28.539 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172459.log.gz 2023-10-03T10:23:28.540 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.140453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189999.log 2023-10-03T10:23:28.540 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.140453.log.gz 2023-10-03T10:23:28.540 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.164118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186228.log 2023-10-03T10:23:28.540 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164118.log.gz 2023-10-03T10:23:28.540 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.189999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158087.log 2023-10-03T10:23:28.540 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.189999.log.gz 2023-10-03T10:23:28.540 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.186228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171064.log 2023-10-03T10:23:28.540 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.158087.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.186228.log.gz 2023-10-03T10:23:28.541 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172608.log 2023-10-03T10:23:28.541 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158087.log.gz 2023-10-03T10:23:28.541 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.171064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139984.log 2023-10-03T10:23:28.541 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171064.log.gz 2023-10-03T10:23:28.541 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.172608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190757.log 2023-10-03T10:23:28.541 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172608.log.gz 2023-10-03T10:23:28.541 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.139984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192278.log 2023-10-03T10:23:28.541 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139984.log.gz 2023-10-03T10:23:28.541 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.190757.log: -- /var/log/ceph/ceph-client.admin.146726.log 2023-10-03T10:23:28.542 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.192278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168704.log 2023-10-03T10:23:28.542 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.190757.log.gz 2023-10-03T10:23:28.542 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.192278.log.gz 2023-10-03T10:23:28.542 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.146726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176091.log 2023-10-03T10:23:28.542 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.146726.log.gz 2023-10-03T10:23:28.542 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.168704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180948.log 2023-10-03T10:23:28.542 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168704.log.gz 2023-10-03T10:23:28.542 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.176091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163021.log 2023-10-03T10:23:28.543 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.176091.log.gz 2023-10-03T10:23:28.543 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.180948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144032.log 2023-10-03T10:23:28.543 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.180948.log.gz 2023-10-03T10:23:28.543 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.163021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176336.log 2023-10-03T10:23:28.543 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.163021.log.gz 2023-10-03T10:23:28.543 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.144032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127209.log 2023-10-03T10:23:28.543 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.176336.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.144032.log.gz 2023-10-03T10:23:28.543 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148056.log 2023-10-03T10:23:28.543 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176336.log.gz 2023-10-03T10:23:28.544 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.127209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171770.log 2023-10-03T10:23:28.544 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.148056.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127209.log.gz 2023-10-03T10:23:28.544 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135037.log 2023-10-03T10:23:28.544 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148056.log.gz 2023-10-03T10:23:28.544 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.171770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192011.log 2023-10-03T10:23:28.544 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.171770.log.gz 2023-10-03T10:23:28.544 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.135037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193653.log 2023-10-03T10:23:28.544 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.192011.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.135037.log.gz 2023-10-03T10:23:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161962.log 2023-10-03T10:23:28.545 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.192011.log.gz 2023-10-03T10:23:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.193653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140376.log 2023-10-03T10:23:28.545 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.193653.log.gz 2023-10-03T10:23:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.161962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145749.log 2023-10-03T10:23:28.545 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161962.log.gz 2023-10-03T10:23:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.140376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151649.log 2023-10-03T10:23:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.145749.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140376.log.gz 2023-10-03T10:23:28.545 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141465.log 2023-10-03T10:23:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.151649.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145749.log.gz 2023-10-03T10:23:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194660.log 2023-10-03T10:23:28.546 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.151649.log.gz 2023-10-03T10:23:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.141465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149794.log 2023-10-03T10:23:28.546 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141465.log.gz 2023-10-03T10:23:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.194660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150578.log 2023-10-03T10:23:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.149794.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.194660.log.gz 2023-10-03T10:23:28.546 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141676.log 2023-10-03T10:23:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.150578.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.149794.log.gz 2023-10-03T10:23:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136728.log 2023-10-03T10:23:28.547 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150578.log.gz 2023-10-03T10:23:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151192.log 2023-10-03T10:23:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.141676.log: /var/log/ceph/ceph-client.admin.136728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137512.log 2023-10-03T10:23:28.547 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141676.log.gz 2023-10-03T10:23:28.547 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.151192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140844.log 2023-10-03T10:23:28.547 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136728.log.gz 2023-10-03T10:23:28.548 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.151192.log.gz 2023-10-03T10:23:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.137512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146879.log 2023-10-03T10:23:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.140844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165907.log 2023-10-03T10:23:28.548 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137512.log.gz 2023-10-03T10:23:28.548 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140844.log.gz 2023-10-03T10:23:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.146879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172799.log 2023-10-03T10:23:28.548 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.146879.log.gz 2023-10-03T10:23:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.165907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170841.log 2023-10-03T10:23:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.172799.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.165907.log.gz 2023-10-03T10:23:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122741.log 2023-10-03T10:23:28.549 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172799.log.gz 2023-10-03T10:23:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.170841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185044.log 2023-10-03T10:23:28.549 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.170841.log.gz 2023-10-03T10:23:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190587.log 2023-10-03T10:23:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.122741.log: /var/log/ceph/ceph-client.admin.185044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137096.log 2023-10-03T10:23:28.549 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122741.log.gz 2023-10-03T10:23:28.549 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.190587.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.185044.log.gz 2023-10-03T10:23:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150433.log 2023-10-03T10:23:28.550 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.190587.log.gz 2023-10-03T10:23:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.137096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154754.log 2023-10-03T10:23:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.150433.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137096.log.gz 2023-10-03T10:23:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135553.log 2023-10-03T10:23:28.550 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150433.log.gz 2023-10-03T10:23:28.550 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.154754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182721.log 2023-10-03T10:23:28.550 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.154754.log.gz 2023-10-03T10:23:28.551 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.135553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181735.log 2023-10-03T10:23:28.551 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.182721.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135553.log.gz 2023-10-03T10:23:28.551 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166155.log 2023-10-03T10:23:28.551 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.181735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151166.log 2023-10-03T10:23:28.551 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.182721.log.gz 2023-10-03T10:23:28.551 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.166155.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.181735.log.gz 2023-10-03T10:23:28.551 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128411.log 2023-10-03T10:23:28.551 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166155.log.gz 2023-10-03T10:23:28.551 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.151166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182690.log 2023-10-03T10:23:28.552 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.128411.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.151166.log.gz 2023-10-03T10:23:28.552 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175895.log 2023-10-03T10:23:28.552 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128411.log.gz 2023-10-03T10:23:28.552 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.182690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126883.log 2023-10-03T10:23:28.552 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.182690.log.gz 2023-10-03T10:23:28.552 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.175895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173779.log 2023-10-03T10:23:28.552 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.126883.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.175895.log.gz 2023-10-03T10:23:28.552 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183448.log 2023-10-03T10:23:28.553 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.126883.log.gz 2023-10-03T10:23:28.553 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.173779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149649.log 2023-10-03T10:23:28.553 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.173779.log.gz 2023-10-03T10:23:28.553 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.183448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145776.log 2023-10-03T10:23:28.553 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.149649.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.183448.log.gz 2023-10-03T10:23:28.553 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143444.log 2023-10-03T10:23:28.553 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.149649.log.gz 2023-10-03T10:23:28.553 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.145776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159406.log 2023-10-03T10:23:28.553 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.145776.log.gz 2023-10-03T10:23:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128656.log 2023-10-03T10:23:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143444.log: /var/log/ceph/ceph-client.admin.159406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185214.log 2023-10-03T10:23:28.554 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.143444.log.gz 2023-10-03T10:23:28.554 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159406.log.gz 2023-10-03T10:23:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.128656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159094.log 2023-10-03T10:23:28.554 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128656.log.gz 2023-10-03T10:23:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.185214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149206.log 2023-10-03T10:23:28.554 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.159094.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.185214.log.gz 2023-10-03T10:23:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145384.log 2023-10-03T10:23:28.555 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.159094.log.gz 2023-10-03T10:23:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.149206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140256.log 2023-10-03T10:23:28.555 INFO:teuthology.orchestra.run.smithi146.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.149206.log.gz 2023-10-03T10:23:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.145384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160668.log 2023-10-03T10:23:28.555 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145384.log.gz 2023-10-03T10:23:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.140256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146534.log 2023-10-03T10:23:28.555 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140256.log.gz 2023-10-03T10:23:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.160668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127390.log 2023-10-03T10:23:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.146534.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.160668.log.gz 2023-10-03T10:23:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183082.log 2023-10-03T10:23:28.556 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.146534.log.gz 2023-10-03T10:23:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.127390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158895.log 2023-10-03T10:23:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.183082.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.127390.log.gz 2023-10-03T10:23:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194323.log 2023-10-03T10:23:28.556 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183082.log.gz 2023-10-03T10:23:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.158895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140964.log 2023-10-03T10:23:28.557 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158895.log.gz 2023-10-03T10:23:28.557 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.194323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146682.log 2023-10-03T10:23:28.557 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.140964.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.194323.log.gz 2023-10-03T10:23:28.557 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138416.log 2023-10-03T10:23:28.557 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.140964.log.gz 2023-10-03T10:23:28.557 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.146682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137318.log 2023-10-03T10:23:28.557 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146682.log.gz 2023-10-03T10:23:28.557 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.138416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168858.log 2023-10-03T10:23:28.558 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.137318.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.138416.log.gz 2023-10-03T10:23:28.558 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133975.log 2023-10-03T10:23:28.558 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.168858.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.137318.log.gz 2023-10-03T10:23:28.558 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156126.log 2023-10-03T10:23:28.558 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168858.log.gz 2023-10-03T10:23:28.558 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.133975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158699.log 2023-10-03T10:23:28.558 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.156126.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.133975.log.gz 2023-10-03T10:23:28.558 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160642.log 2023-10-03T10:23:28.559 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156126.log.gz 2023-10-03T10:23:28.559 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.158699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143836.log 2023-10-03T10:23:28.559 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.158699.log.gz 2023-10-03T10:23:28.559 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.160642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128509.log 2023-10-03T10:23:28.559 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143836.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160642.log.gz 2023-10-03T10:23:28.559 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180756.log 2023-10-03T10:23:28.559 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4%/var/log/ceph/ceph-client.admin.128509.log: -- replaced with /var/log/ceph/ceph-client.admin.143836.log.gz 2023-10-03T10:23:28.559 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188431.log 2023-10-03T10:23:28.559 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.128509.log.gz 2023-10-03T10:23:28.560 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192205.log 2023-10-03T10:23:28.560 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.180756.log: /var/log/ceph/ceph-client.admin.188431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150852.log 2023-10-03T10:23:28.560 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180756.log.gz 2023-10-03T10:23:28.560 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.188431.log.gz 2023-10-03T10:23:28.560 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.192205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191441.log 2023-10-03T10:23:28.560 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.150852.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.192205.log.gz 2023-10-03T10:23:28.560 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149010.log 2023-10-03T10:23:28.560 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.191441.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150852.log.gz 2023-10-03T10:23:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185436.log 2023-10-03T10:23:28.561 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.191441.log.gz 2023-10-03T10:23:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.149010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192719.log 2023-10-03T10:23:28.561 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.149010.log.gz 2023-10-03T10:23:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.185436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194120.log 2023-10-03T10:23:28.561 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.185436.log.gz 2023-10-03T10:23:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.192719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172458.log 2023-10-03T10:23:28.561 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.194120.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.192719.log.gz 2023-10-03T10:23:28.562 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158504.log 2023-10-03T10:23:28.562 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.194120.log.gz 2023-10-03T10:23:28.562 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.172458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149598.log 2023-10-03T10:23:28.562 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.172458.log.gz 2023-10-03T10:23:28.562 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.158504.log: -- /var/log/ceph/ceph-client.admin.138100.log 2023-10-03T10:23:28.562 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.149598.log: 89.1%gzip -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.158504.log.gz-- 2023-10-03T10:23:28.562 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.162407.log 2023-10-03T10:23:28.562 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.149598.log.gz 2023-10-03T10:23:28.562 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.138100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188209.log 2023-10-03T10:23:28.563 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.138100.log.gz 2023-10-03T10:23:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.162407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155782.log 2023-10-03T10:23:28.563 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.162407.log.gz 2023-10-03T10:23:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.188209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187721.log 2023-10-03T10:23:28.563 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.188209.log.gz 2023-10-03T10:23:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.155782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142754.log 2023-10-03T10:23:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.187721.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.155782.log.gz 2023-10-03T10:23:28.563 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153037.log 2023-10-03T10:23:28.563 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187721.log.gz 2023-10-03T10:23:28.564 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.142754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186032.log 2023-10-03T10:23:28.564 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.142754.log.gz 2023-10-03T10:23:28.564 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.153037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164784.log 2023-10-03T10:23:28.564 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153037.log.gz 2023-10-03T10:23:28.564 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.186032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159482.log 2023-10-03T10:23:28.564 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.186032.log.gz 2023-10-03T10:23:28.564 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.164784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180385.log 2023-10-03T10:23:28.564 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.164784.log.gz 2023-10-03T10:23:28.565 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.159482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125377.log 2023-10-03T10:23:28.565 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.159482.log.gz 2023-10-03T10:23:28.565 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.180385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147272.log 2023-10-03T10:23:28.565 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.180385.log.gz 2023-10-03T10:23:28.565 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.125377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184503.log 2023-10-03T10:23:28.565 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.125377.log.gz 2023-10-03T10:23:28.565 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.147272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127854.log 2023-10-03T10:23:28.565 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.147272.log.gz 2023-10-03T10:23:28.566 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.184503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180265.log 2023-10-03T10:23:28.566 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184503.log.gz 2023-10-03T10:23:28.566 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.127854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162550.log 2023-10-03T10:23:28.566 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.127854.log.gz 2023-10-03T10:23:28.566 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.180265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152964.log 2023-10-03T10:23:28.566 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180265.log.gz 2023-10-03T10:23:28.566 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.162550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157472.log 2023-10-03T10:23:28.566 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.162550.log.gz 2023-10-03T10:23:28.566 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.152964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185287.log 2023-10-03T10:23:28.567 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.152964.log.gz 2023-10-03T10:23:28.567 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.157472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169321.log 2023-10-03T10:23:28.567 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.157472.log.gz 2023-10-03T10:23:28.567 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.185287.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-03T10:23:28.567 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.169321.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.185287.log.gz 2023-10-03T10:23:28.567 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179162.log 2023-10-03T10:23:28.567 INFO:teuthology.orchestra.run.smithi146.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.169321.log.gz 2023-10-03T10:23:28.567 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137854.log 2023-10-03T10:23:28.568 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.179162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189875.log 2023-10-03T10:23:28.568 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.179162.log.gz 2023-10-03T10:23:28.568 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.137854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138887.log 2023-10-03T10:23:28.568 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137854.log.gz 2023-10-03T10:23:28.568 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147716.log 2023-10-03T10:23:28.568 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.189875.log: /var/log/ceph/ceph-client.admin.138887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168260.log 2023-10-03T10:23:28.568 INFO:teuthology.orchestra.run.smithi146.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.189875.log.gz 2023-10-03T10:23:28.568 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.138887.log.gz 2023-10-03T10:23:28.569 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.147716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137069.log 2023-10-03T10:23:28.569 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.147716.log.gz 2023-10-03T10:23:28.569 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170034.log 2023-10-03T10:23:28.569 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.168260.log: /var/log/ceph/ceph-client.admin.137069.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168260.log.gz 2023-10-03T10:23:28.569 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191298.log 2023-10-03T10:23:28.569 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.137069.log.gz 2023-10-03T10:23:28.569 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187797.log 2023-10-03T10:23:28.569 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.170034.log: /var/log/ceph/ceph-client.admin.191298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163974.log 2023-10-03T10:23:28.570 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.170034.log.gz 2023-10-03T10:23:28.570 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.191298.log.gz 2023-10-03T10:23:28.570 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.187797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157348.log 2023-10-03T10:23:28.570 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.187797.log.gz 2023-10-03T10:23:28.570 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.163974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169713.log 2023-10-03T10:23:28.570 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.157348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172405.log 2023-10-03T10:23:28.570 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163974.log.gz 2023-10-03T10:23:28.570 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.169713.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.157348.log.gz 2023-10-03T10:23:28.570 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193381.log 2023-10-03T10:23:28.571 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169713.log.gz 2023-10-03T10:23:28.571 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.172405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149087.log 2023-10-03T10:23:28.571 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.193381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154114.log 2023-10-03T10:23:28.571 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172405.log.gz 2023-10-03T10:23:28.571 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.149087.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.193381.log.gz 2023-10-03T10:23:28.571 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144304.log 2023-10-03T10:23:28.571 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.149087.log.gz 2023-10-03T10:23:28.571 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138297.log 2023-10-03T10:23:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.154114.log: /var/log/ceph/ceph-client.admin.144304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175403.log 2023-10-03T10:23:28.572 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.154114.log.gz 2023-10-03T10:23:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.138297.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144304.log.gz 2023-10-03T10:23:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141015.log 2023-10-03T10:23:28.572 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.138297.log.gz 2023-10-03T10:23:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162968.log 2023-10-03T10:23:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.175403.log: /var/log/ceph/ceph-client.admin.141015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169418.log 2023-10-03T10:23:28.572 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.175403.log.gz 2023-10-03T10:23:28.573 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.141015.log.gz 2023-10-03T10:23:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.162968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126737.log 2023-10-03T10:23:28.573 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.162968.log.gz 2023-10-03T10:23:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:gzip /var/log/ceph/ceph-client.admin.169418.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.158700.log 2023-10-03T10:23:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.126737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171063.log 2023-10-03T10:23:28.573 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169418.log.gz 2023-10-03T10:23:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.158700.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.126737.log.gz 2023-10-03T10:23:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187451.log 2023-10-03T10:23:28.573 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158700.log.gz 2023-10-03T10:23:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151219.log 2023-10-03T10:23:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.171063.log: /var/log/ceph/ceph-client.admin.187451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150068.log 2023-10-03T10:23:28.574 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.171063.log.gz 2023-10-03T10:23:28.574 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.187451.log.gz 2023-10-03T10:23:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.151219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153526.log 2023-10-03T10:23:28.574 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.151219.log.gz 2023-10-03T10:23:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150068.log: /var/log/ceph/ceph-client.admin.194297.log 2023-10-03T10:23:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.153526.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150068.log.gzgzip 2023-10-03T10:23:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.168830.log 2023-10-03T10:23:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.194297.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.153526.log.gz 2023-10-03T10:23:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174002.log 2023-10-03T10:23:28.575 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.194297.log.gz 2023-10-03T10:23:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178378.log 2023-10-03T10:23:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.168830.log: /var/log/ceph/ceph-client.admin.174002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173387.log 2023-10-03T10:23:28.575 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.168830.log.gz 2023-10-03T10:23:28.575 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174002.log.gz 2023-10-03T10:23:28.576 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.178378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160394.log 2023-10-03T10:23:28.576 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.178378.log.gz 2023-10-03T10:23:28.576 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.173387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189019.log 2023-10-03T10:23:28.576 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.160394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157938.log 2023-10-03T10:23:28.576 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.173387.log.gz 2023-10-03T10:23:28.576 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160394.log.gz 2023-10-03T10:23:28.576 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.189019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150629.log 2023-10-03T10:23:28.576 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.189019.log.gz 2023-10-03T10:23:28.576 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163138.log 2023-10-03T10:23:28.577 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.157938.log: /var/log/ceph/ceph-client.admin.150629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164706.log 2023-10-03T10:23:28.577 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157938.log.gz 2023-10-03T10:23:28.577 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2%/var/log/ceph/ceph-client.admin.163138.log: -- replaced with /var/log/ceph/ceph-client.admin.150629.log.gz 2023-10-03T10:23:28.577 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124718.log 2023-10-03T10:23:28.577 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163138.log.gz 2023-10-03T10:23:28.577 INFO:teuthology.orchestra.run.smithi146.stderr:gzip /var/log/ceph/ceph-client.admin.164706.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.175625.log 2023-10-03T10:23:28.577 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.124718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184773.log 2023-10-03T10:23:28.578 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164706.log.gz 2023-10-03T10:23:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.175625.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.124718.log.gz 2023-10-03T10:23:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148130.log 2023-10-03T10:23:28.578 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.175625.log.gz 2023-10-03T10:23:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172261.log 2023-10-03T10:23:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.184773.log: /var/log/ceph/ceph-client.admin.148130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145900.log 2023-10-03T10:23:28.578 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.184773.log.gz 2023-10-03T10:23:28.578 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148130.log.gz 2023-10-03T10:23:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.172261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185165.log 2023-10-03T10:23:28.579 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.172261.log.gz 2023-10-03T10:23:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:gzip /var/log/ceph/ceph-client.admin.145900.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.157105.log 2023-10-03T10:23:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.185165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185863.log 2023-10-03T10:23:28.579 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145900.log.gz 2023-10-03T10:23:28.579 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.185165.log.gz 2023-10-03T10:23:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.157105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179873.log 2023-10-03T10:23:28.579 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.157105.log.gz 2023-10-03T10:23:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140454.log 2023-10-03T10:23:28.580 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.185863.log: /var/log/ceph/ceph-client.admin.179873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136456.log 2023-10-03T10:23:28.580 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.185863.log.gz 2023-10-03T10:23:28.580 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.179873.log.gz 2023-10-03T10:23:28.580 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.140454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161008.log 2023-10-03T10:23:28.580 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140454.log.gz 2023-10-03T10:23:28.580 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171404.log 2023-10-03T10:23:28.580 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.136456.log: /var/log/ceph/ceph-client.admin.161008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124767.log 2023-10-03T10:23:28.580 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.136456.log.gz 2023-10-03T10:23:28.581 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.171404.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.161008.log.gz 2023-10-03T10:23:28.581 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152449.log 2023-10-03T10:23:28.581 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171404.log.gz 2023-10-03T10:23:28.581 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.124767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170281.log 2023-10-03T10:23:28.581 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.124767.log.gz 2023-10-03T10:23:28.581 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153211.log 2023-10-03T10:23:28.581 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.152449.log: /var/log/ceph/ceph-client.admin.170281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181736.log 2023-10-03T10:23:28.581 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.152449.log.gz 2023-10-03T10:23:28.581 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170281.log.gz 2023-10-03T10:23:28.582 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.153211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151592.log 2023-10-03T10:23:28.582 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.153211.log.gz 2023-10-03T10:23:28.582 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.181736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193111.log 2023-10-03T10:23:28.582 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.151592.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.181736.log.gz 2023-10-03T10:23:28.582 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154361.log 2023-10-03T10:23:28.582 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151592.log.gz 2023-10-03T10:23:28.582 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.193111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182029.log 2023-10-03T10:23:28.582 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.193111.log.gz 2023-10-03T10:23:28.583 INFO:teuthology.orchestra.run.smithi146.stderr:gzip /var/log/ceph/ceph-client.admin.154361.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.168127.log 2023-10-03T10:23:28.583 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.182029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144918.log 2023-10-03T10:23:28.583 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154361.log.gz 2023-10-03T10:23:28.583 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.182029.log.gz 2023-10-03T10:23:28.583 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.168127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139671.log 2023-10-03T10:23:28.583 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168127.log.gz 2023-10-03T10:23:28.583 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181906.log 2023-10-03T10:23:28.583 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.144918.log: /var/log/ceph/ceph-client.admin.139671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167549.log 2023-10-03T10:23:28.584 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.144918.log.gz 2023-10-03T10:23:28.584 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.139671.log.gz 2023-10-03T10:23:28.584 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.181906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145135.log 2023-10-03T10:23:28.584 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.181906.log.gz 2023-10-03T10:23:28.584 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170424.log 2023-10-03T10:23:28.584 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.167549.log: /var/log/ceph/ceph-client.admin.145135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124522.log 2023-10-03T10:23:28.584 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.167549.log.gz 2023-10-03T10:23:28.584 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.170424.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.145135.log.gz 2023-10-03T10:23:28.584 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156858.log 2023-10-03T10:23:28.585 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.170424.log.gz 2023-10-03T10:23:28.585 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165098.log 2023-10-03T10:23:28.585 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.124522.log: /var/log/ceph/ceph-client.admin.156858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184456.log 2023-10-03T10:23:28.585 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124522.log.gz 2023-10-03T10:23:28.585 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156858.log.gz 2023-10-03T10:23:28.585 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.165098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145553.log 2023-10-03T10:23:28.585 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.165098.log.gz 2023-10-03T10:23:28.585 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137906.log 2023-10-03T10:23:28.586 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.184456.log: /var/log/ceph/ceph-client.admin.145553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166666.log 2023-10-03T10:23:28.586 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.184456.log.gz 2023-10-03T10:23:28.586 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145553.log.gz 2023-10-03T10:23:28.586 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.137906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150285.log 2023-10-03T10:23:28.586 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.137906.log.gz 2023-10-03T10:23:28.586 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.166666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154950.log 2023-10-03T10:23:28.586 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.150285.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.166666.log.gz 2023-10-03T10:23:28.586 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157133.log 2023-10-03T10:23:28.587 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150285.log.gz 2023-10-03T10:23:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.154950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168733.log 2023-10-03T10:23:28.587 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154950.log.gz 2023-10-03T10:23:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.157133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174318.log 2023-10-03T10:23:28.587 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.157133.log.gz 2023-10-03T10:23:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.168733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143790.log 2023-10-03T10:23:28.706 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.174318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128754.log 2023-10-03T10:23:28.706 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168733.log.gz 2023-10-03T10:23:28.706 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143790.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.174318.log.gz 2023-10-03T10:23:28.706 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182468.log 2023-10-03T10:23:28.706 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143790.log.gz 2023-10-03T10:23:28.706 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.128754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164170.log 2023-10-03T10:23:28.706 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.182468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125159.log 2023-10-03T10:23:28.707 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128754.log.gz 2023-10-03T10:23:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.164170.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.182468.log.gz 2023-10-03T10:23:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122998.log 2023-10-03T10:23:28.707 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.164170.log.gz 2023-10-03T10:23:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176775.log 2023-10-03T10:23:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.125159.log: /var/log/ceph/ceph-client.admin.122998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169026.log 2023-10-03T10:23:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.176775.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122998.log.gz 2023-10-03T10:23:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163973.log 2023-10-03T10:23:28.708 INFO:teuthology.orchestra.run.smithi146.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.125159.log.gz 2023-10-03T10:23:28.708 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.176775.log.gz 2023-10-03T10:23:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.169026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156544.log 2023-10-03T10:23:28.708 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.169026.log.gz 2023-10-03T10:23:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:gzip /var/log/ceph/ceph-client.admin.163973.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.172655.log 2023-10-03T10:23:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.156544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152053.log 2023-10-03T10:23:28.708 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.163973.log.gz 2023-10-03T10:23:28.708 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156544.log.gz 2023-10-03T10:23:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.172655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193258.log 2023-10-03T10:23:28.709 INFO:teuthology.orchestra.run.smithi146.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.172655.log.gz 2023-10-03T10:23:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171871.log 2023-10-03T10:23:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.152053.log: /var/log/ceph/ceph-client.admin.193258.log: 88.5%gzip -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.152053.log.gz-- 2023-10-03T10:23:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.135084.log 2023-10-03T10:23:28.709 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.193258.log.gz 2023-10-03T10:23:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.171871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129195.log 2023-10-03T10:23:28.709 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.171871.log.gz 2023-10-03T10:23:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165542.log 2023-10-03T10:23:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.135084.log: /var/log/ceph/ceph-client.admin.129195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151861.log 2023-10-03T10:23:28.710 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.135084.log.gz 2023-10-03T10:23:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.165542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193062.log 2023-10-03T10:23:28.710 INFO:teuthology.orchestra.run.smithi146.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.129195.log.gz 2023-10-03T10:23:28.710 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.165542.log.gz 2023-10-03T10:23:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.151861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135357.log 2023-10-03T10:23:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.193062.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.151861.log.gz 2023-10-03T10:23:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142626.log 2023-10-03T10:23:28.710 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.135357.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.193062.log.gz 2023-10-03T10:23:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136848.log 2023-10-03T10:23:28.711 INFO:teuthology.orchestra.run.smithi146.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.135357.log.gz 2023-10-03T10:23:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189093.log 2023-10-03T10:23:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.142626.log: /var/log/ceph/ceph-client.admin.136848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138808.log 2023-10-03T10:23:28.711 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142626.log.gz 2023-10-03T10:23:28.711 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.136848.log.gz 2023-10-03T10:23:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.189093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147246.log 2023-10-03T10:23:28.711 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150630.log 2023-10-03T10:23:28.712 INFO:teuthology.orchestra.run.smithi146.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.189093.log.gz 2023-10-03T10:23:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.138808.log: /var/log/ceph/ceph-client.admin.147246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138024.log 2023-10-03T10:23:28.712 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.138808.log.gz 2023-10-03T10:23:28.712 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.147246.log.gz 2023-10-03T10:23:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.150630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146167.log 2023-10-03T10:23:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.138024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195003.log 2023-10-03T10:23:28.712 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150630.log.gz 2023-10-03T10:23:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.146167.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.138024.log.gz 2023-10-03T10:23:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169249.log 2023-10-03T10:23:28.713 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.146167.log.gz 2023-10-03T10:23:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144108.log 2023-10-03T10:23:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.195003.log: /var/log/ceph/ceph-client.admin.169249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123539.log 2023-10-03T10:23:28.713 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.195003.log.gz 2023-10-03T10:23:28.713 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.169249.log.gz 2023-10-03T10:23:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.144108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166547.log 2023-10-03T10:23:28.713 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.144108.log.gz 2023-10-03T10:23:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137316.log 2023-10-03T10:23:28.714 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.123539.log: /var/log/ceph/ceph-client.admin.166547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192866.log 2023-10-03T10:23:28.714 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.123539.log.gz 2023-10-03T10:23:28.714 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.166547.log.gz 2023-10-03T10:23:28.714 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.137316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153382.log 2023-10-03T10:23:28.714 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.137316.log.gz 2023-10-03T10:23:28.714 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.192866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188823.log 2023-10-03T10:23:28.714 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.153382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177128.log 2023-10-03T10:23:28.714 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.192866.log.gz 2023-10-03T10:23:28.714 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.188823.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.153382.log.gz 2023-10-03T10:23:28.715 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173414.log 2023-10-03T10:23:28.715 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.188823.log.gz 2023-10-03T10:23:28.715 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.177128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172750.log 2023-10-03T10:23:28.715 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177128.log.gz 2023-10-03T10:23:28.715 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139887.log 2023-10-03T10:23:28.715 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.173414.log: /var/log/ceph/ceph-client.admin.172750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136555.log 2023-10-03T10:23:28.715 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.173414.log.gz 2023-10-03T10:23:28.715 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.139887.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172750.log.gz 2023-10-03T10:23:28.716 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146141.log 2023-10-03T10:23:28.716 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.139887.log.gz 2023-10-03T10:23:28.716 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.136555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165589.log 2023-10-03T10:23:28.716 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.146141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160982.log 2023-10-03T10:23:28.716 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.136555.log.gz 2023-10-03T10:23:28.716 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.146141.log.gz 2023-10-03T10:23:28.716 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.165589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164589.log 2023-10-03T10:23:28.716 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165589.log.gz 2023-10-03T10:23:28.716 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163385.log 2023-10-03T10:23:28.717 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.160982.log: /var/log/ceph/ceph-client.admin.164589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153603.log 2023-10-03T10:23:28.717 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.160982.log.gz 2023-10-03T10:23:28.717 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.163385.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164589.log.gz 2023-10-03T10:23:28.717 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159093.log 2023-10-03T10:23:28.717 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.163385.log.gz 2023-10-03T10:23:28.717 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135554.log 2023-10-03T10:23:28.717 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.153603.log: /var/log/ceph/ceph-client.admin.159093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136359.log 2023-10-03T10:23:28.718 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.153603.log.gz 2023-10-03T10:23:28.718 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.159093.log.gz 2023-10-03T10:23:28.718 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.135554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169124.log 2023-10-03T10:23:28.718 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.135554.log.gz 2023-10-03T10:23:28.718 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163020.log 2023-10-03T10:23:28.718 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.136359.log: /var/log/ceph/ceph-client.admin.169124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150434.log 2023-10-03T10:23:28.718 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136359.log.gz 2023-10-03T10:23:28.718 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.169124.log.gz 2023-10-03T10:23:28.718 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.163020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184036.log 2023-10-03T10:23:28.719 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163020.log.gz 2023-10-03T10:23:28.719 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.150434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189214.log 2023-10-03T10:23:28.719 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.184036.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150434.log.gz 2023-10-03T10:23:28.719 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181148.log 2023-10-03T10:23:28.719 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.189214.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.184036.log.gzgzip 2023-10-03T10:23:28.719 INFO:teuthology.orchestra.run.smithi146.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.188554.log 2023-10-03T10:23:28.719 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.189214.log.gz 2023-10-03T10:23:28.719 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.181148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169053.log 2023-10-03T10:23:28.720 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.188554.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.181148.log.gz 2023-10-03T10:23:28.720 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167254.log 2023-10-03T10:23:28.720 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.188554.log.gz 2023-10-03T10:23:28.720 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171843.log 2023-10-03T10:23:28.720 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.169053.log: /var/log/ceph/ceph-client.admin.167254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123047.log 2023-10-03T10:23:28.720 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.169053.log.gz 2023-10-03T10:23:28.720 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167254.log.gz 2023-10-03T10:23:28.720 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171012.log 2023-10-03T10:23:28.720 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.171843.log: /var/log/ceph/ceph-client.admin.123047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170228.log 2023-10-03T10:23:28.721 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.171843.log.gz 2023-10-03T10:23:28.721 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123047.log.gz 2023-10-03T10:23:28.721 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.171012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161400.log 2023-10-03T10:23:28.721 INFO:teuthology.orchestra.run.smithi146.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.171012.log.gz 2023-10-03T10:23:28.721 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.170228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134931.log 2023-10-03T10:23:28.721 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.170228.log.gz 2023-10-03T10:23:28.721 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.161400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124865.log 2023-10-03T10:23:28.721 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.134931.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161400.log.gz 2023-10-03T10:23:28.722 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158844.log 2023-10-03T10:23:28.722 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.134931.log.gz 2023-10-03T10:23:28.722 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.124865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118866.log 2023-10-03T10:23:28.722 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.124865.log.gz 2023-10-03T10:23:28.722 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.158844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123096.log 2023-10-03T10:23:28.722 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.118866.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.158844.log.gz 2023-10-03T10:23:28.722 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159676.log 2023-10-03T10:23:28.722 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118866.log.gz 2023-10-03T10:23:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.123096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157106.log 2023-10-03T10:23:28.723 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123096.log.gz 2023-10-03T10:23:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.159676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179232.log 2023-10-03T10:23:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.157106.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.159676.log.gz 2023-10-03T10:23:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129146.log 2023-10-03T10:23:28.723 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.157106.log.gz 2023-10-03T10:23:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.179232.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-03T10:23:28.723 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.179232.log.gz 2023-10-03T10:23:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.129146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177371.log 2023-10-03T10:23:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.audit.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.129146.log.gz 2023-10-03T10:23:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189338.log 2023-10-03T10:23:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171251.log 2023-10-03T10:23:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.177371.log: /var/log/ceph/ceph-client.admin.189338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135358.log 2023-10-03T10:23:28.724 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.177371.log.gz 2023-10-03T10:23:28.724 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189338.log.gz 2023-10-03T10:23:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.171251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148717.log 2023-10-03T10:23:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:gzip 89.1%-5 -- replaced with /var/log/ceph/ceph-client.admin.171251.log.gz--verbose 2023-10-03T10:23:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:-- /var/log/ceph/ceph-client.admin.148691.log 2023-10-03T10:23:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.135358.log: /var/log/ceph/ceph-client.admin.148717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124816.log 2023-10-03T10:23:28.725 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.135358.log.gz 2023-10-03T10:23:28.725 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.148717.log.gz 2023-10-03T10:23:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.148691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122839.log 2023-10-03T10:23:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:gzip 88.5%-5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.148691.log.gz/var/log/ceph/ceph-client.admin.139422.log 2023-10-03T10:23:28.725 INFO:teuthology.orchestra.run.smithi146.stderr: 2023-10-03T10:23:28.725 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.124816.log: /var/log/ceph/ceph-client.admin.122839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136260.log 2023-10-03T10:23:28.725 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124816.log.gz 2023-10-03T10:23:28.726 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.139422.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.122839.log.gz 2023-10-03T10:23:28.726 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158060.log 2023-10-03T10:23:28.726 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.139422.log.gz 2023-10-03T10:23:28.726 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.136260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170282.log 2023-10-03T10:23:28.726 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.136260.log.gz 2023-10-03T10:23:28.726 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.158060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123196.log 2023-10-03T10:23:28.726 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.158060.log.gz 2023-10-03T10:23:28.726 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.170282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188162.log 2023-10-03T10:23:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.123196.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170282.log.gz 2023-10-03T10:23:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174806.log 2023-10-03T10:23:28.727 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123196.log.gz 2023-10-03T10:23:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.188162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177716.log 2023-10-03T10:23:28.727 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.188162.log.gz 2023-10-03T10:23:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145357.log 2023-10-03T10:23:28.727 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.174806.log: /var/log/ceph/ceph-client.admin.177716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151048.log 2023-10-03T10:23:28.727 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174806.log.gz 2023-10-03T10:23:28.728 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.177716.log.gz 2023-10-03T10:23:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.145357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193924.log 2023-10-03T10:23:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127012.log 2023-10-03T10:23:28.728 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.145357.log.gz 2023-10-03T10:23:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.151048.log: /var/log/ceph/ceph-client.admin.193924.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.151048.log.gz 2023-10-03T10:23:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185761.log 2023-10-03T10:23:28.728 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.193924.log.gz 2023-10-03T10:23:28.728 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.127012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123147.log 2023-10-03T10:23:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.185761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160223.log 2023-10-03T10:23:28.729 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.127012.log.gz 2023-10-03T10:23:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.123147.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.185761.log.gz 2023-10-03T10:23:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155290.log 2023-10-03T10:23:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.160223.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123147.log.gz 2023-10-03T10:23:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152434.log 2023-10-03T10:23:28.729 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.160223.log.gz 2023-10-03T10:23:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.155290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163778.log 2023-10-03T10:23:28.729 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.152434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140255.log 2023-10-03T10:23:28.730 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.155290.log.gz 2023-10-03T10:23:28.730 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1%/var/log/ceph/ceph-client.admin.163778.log: -- replaced with /var/log/ceph/ceph-client.admin.152434.log.gz 2023-10-03T10:23:28.730 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124571.log 2023-10-03T10:23:28.730 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.163778.log.gz 2023-10-03T10:23:28.730 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.140255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165908.log 2023-10-03T10:23:28.730 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.140255.log.gz 2023-10-03T10:23:28.730 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186275.log 2023-10-03T10:23:28.730 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.124571.log: 95.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-03T10:23:28.731 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.165908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146095.log 2023-10-03T10:23:28.731 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124571.log.gz 2023-10-03T10:23:28.731 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165908.log.gz 2023-10-03T10:23:28.731 INFO:teuthology.orchestra.run.smithi146.stderr:gzip /var/log/ceph/ceph-client.admin.186275.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.163777.log 2023-10-03T10:23:28.731 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.146095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118502.log 2023-10-03T10:23:28.731 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.186275.log.gz 2023-10-03T10:23:28.731 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.163777.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.146095.log.gz 2023-10-03T10:23:28.731 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184258.log 2023-10-03T10:23:28.732 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.163777.log.gz 2023-10-03T10:23:28.732 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.118502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145012.log 2023-10-03T10:23:28.732 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.184258.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118502.log.gz 2023-10-03T10:23:28.732 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127157.log 2023-10-03T10:23:28.732 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.184258.log.gz 2023-10-03T10:23:28.732 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.145012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153036.log 2023-10-03T10:23:28.732 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145012.log.gz 2023-10-03T10:23:28.732 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.127157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187525.log 2023-10-03T10:23:28.732 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127157.log.gz 2023-10-03T10:23:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187404.log 2023-10-03T10:23:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.153036.log: /var/log/ceph/ceph-client.admin.187525.log: gzip -5 88.5%--verbose -- replaced with /var/log/ceph/ceph-client.admin.153036.log.gz-- 2023-10-03T10:23:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.122594.log 2023-10-03T10:23:28.733 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.187525.log.gz 2023-10-03T10:23:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:gzip /var/log/ceph/ceph-client.admin.187404.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.128123.log 2023-10-03T10:23:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.122594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148618.log 2023-10-03T10:23:28.733 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.187404.log.gz 2023-10-03T10:23:28.733 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122594.log.gz 2023-10-03T10:23:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.128123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181664.log 2023-10-03T10:23:28.734 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.128123.log.gz 2023-10-03T10:23:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.148618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174244.log 2023-10-03T10:23:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.181664.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148618.log.gz 2023-10-03T10:23:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191049.log 2023-10-03T10:23:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.174244.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.181664.log.gz 2023-10-03T10:23:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171673.log 2023-10-03T10:23:28.734 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174244.log.gz 2023-10-03T10:23:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.191049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176532.log 2023-10-03T10:23:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.171673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186667.log 2023-10-03T10:23:28.735 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.191049.log.gz 2023-10-03T10:23:28.735 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.171673.log.gz 2023-10-03T10:23:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.176532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167941.log 2023-10-03T10:23:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.186667.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.176532.log.gz 2023-10-03T10:23:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161204.log 2023-10-03T10:23:28.735 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.186667.log.gz 2023-10-03T10:23:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.167941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190953.log 2023-10-03T10:23:28.736 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167941.log.gz 2023-10-03T10:23:28.736 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.161204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162158.log 2023-10-03T10:23:28.736 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.161204.log.gz 2023-10-03T10:23:28.736 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.190953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144816.log 2023-10-03T10:23:28.736 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.162158.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.190953.log.gz 2023-10-03T10:23:28.736 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150186.log 2023-10-03T10:23:28.736 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.162158.log.gz 2023-10-03T10:23:28.736 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.144816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150850.log 2023-10-03T10:23:28.736 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.144816.log.gz 2023-10-03T10:23:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.150186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173142.log 2023-10-03T10:23:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.150850.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150186.log.gz 2023-10-03T10:23:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144696.log 2023-10-03T10:23:28.737 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150850.log.gz 2023-10-03T10:23:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.173142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135768.log 2023-10-03T10:23:28.737 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173142.log.gz 2023-10-03T10:23:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.144696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143912.log 2023-10-03T10:23:28.737 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.135768.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.144696.log.gz 2023-10-03T10:23:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156296.log 2023-10-03T10:23:28.738 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135768.log.gz 2023-10-03T10:23:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153330.log 2023-10-03T10:23:28.738 INFO:teuthology.orchestra.run.smithi146.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.143912.log.gz 2023-10-03T10:23:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.156296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167158.log 2023-10-03T10:23:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.153330.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156296.log.gz 2023-10-03T10:23:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160838.log 2023-10-03T10:23:28.738 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.153330.log.gz 2023-10-03T10:23:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.167158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164000.log 2023-10-03T10:23:28.739 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.160838.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.167158.log.gz 2023-10-03T10:23:28.739 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155878.log 2023-10-03T10:23:28.739 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160838.log.gz 2023-10-03T10:23:28.739 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.164000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166496.log 2023-10-03T10:23:28.739 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.155878.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.164000.log.gz 2023-10-03T10:23:28.739 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173021.log 2023-10-03T10:23:28.739 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.155878.log.gz 2023-10-03T10:23:28.739 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.166496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144500.log 2023-10-03T10:23:28.740 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.173021.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166496.log.gz 2023-10-03T10:23:28.740 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155708.log 2023-10-03T10:23:28.740 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.173021.log.gz 2023-10-03T10:23:28.740 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.144500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175233.log 2023-10-03T10:23:28.740 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144500.log.gz 2023-10-03T10:23:28.740 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.155708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174610.log 2023-10-03T10:23:28.740 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.155708.log.gz/var/log/ceph/ceph-client.admin.175233.log: 2023-10-03T10:23:28.740 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170202.log 2023-10-03T10:23:28.740 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.175233.log.gz 2023-10-03T10:23:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.174610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178254.log 2023-10-03T10:23:28.741 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.174610.log.gz 2023-10-03T10:23:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.170202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153552.log 2023-10-03T10:23:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.178254.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.170202.log.gz 2023-10-03T10:23:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178697.log 2023-10-03T10:23:28.741 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.178254.log.gz 2023-10-03T10:23:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.153552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163530.log 2023-10-03T10:23:28.741 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.153552.log.gz 2023-10-03T10:23:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.178697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175037.log 2023-10-03T10:23:28.742 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.178697.log.gz 2023-10-03T10:23:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.163530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162646.log 2023-10-03T10:23:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.175037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168234.log 2023-10-03T10:23:28.742 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163530.log.gz 2023-10-03T10:23:28.742 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.175037.log.gz 2023-10-03T10:23:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.162646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167546.log 2023-10-03T10:23:28.742 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162646.log.gz 2023-10-03T10:23:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.168234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181271.log 2023-10-03T10:23:28.743 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168234.log.gz 2023-10-03T10:23:28.743 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.167546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164510.log 2023-10-03T10:23:28.743 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167546.log.gz 2023-10-03T10:23:28.743 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.181271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180952.log 2023-10-03T10:23:28.743 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.181271.log.gz 2023-10-03T10:23:28.743 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.164510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154310.log 2023-10-03T10:23:28.743 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164510.log.gz 2023-10-03T10:23:28.743 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.180952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139618.log 2023-10-03T10:23:28.744 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180952.log.gz 2023-10-03T10:23:28.744 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.154310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192988.log 2023-10-03T10:23:28.744 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.154310.log.gz 2023-10-03T10:23:28.744 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.139618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182421.log 2023-10-03T10:23:28.744 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.192988.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.139618.log.gz 2023-10-03T10:23:28.744 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165763.log 2023-10-03T10:23:28.744 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.192988.log.gz 2023-10-03T10:23:28.744 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.182421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162827.log 2023-10-03T10:23:28.744 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.165763.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.182421.log.gz 2023-10-03T10:23:28.745 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182617.log 2023-10-03T10:23:28.745 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165763.log.gz 2023-10-03T10:23:28.745 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.162827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142924.log 2023-10-03T10:23:28.745 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162827.log.gz 2023-10-03T10:23:28.745 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.182617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188039.log 2023-10-03T10:23:28.745 INFO:teuthology.orchestra.run.smithi146.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.182617.log.gz 2023-10-03T10:23:28.745 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.142924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138886.log 2023-10-03T10:23:28.745 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.188039.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.142924.log.gz 2023-10-03T10:23:28.746 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181049.log 2023-10-03T10:23:28.746 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.188039.log.gz 2023-10-03T10:23:28.746 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.138886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194249.log 2023-10-03T10:23:28.746 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.181049.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.138886.log.gz 2023-10-03T10:23:28.746 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142262.log 2023-10-03T10:23:28.746 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.194249.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.181049.log.gz 2023-10-03T10:23:28.746 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147664.log 2023-10-03T10:23:28.746 INFO:teuthology.orchestra.run.smithi146.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.194249.log.gz 2023-10-03T10:23:28.746 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.142262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167084.log 2023-10-03T10:23:28.747 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.142262.log.gz 2023-10-03T10:23:28.747 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.147664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161792.log 2023-10-03T10:23:28.747 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.167084.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.147664.log.gz 2023-10-03T10:23:28.747 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173048.log 2023-10-03T10:23:28.747 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.167084.log.gz 2023-10-03T10:23:28.747 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.161792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183989.log 2023-10-03T10:23:28.747 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.173048.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161792.log.gz 2023-10-03T10:23:28.747 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190318.log 2023-10-03T10:23:28.748 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.173048.log.gz 2023-10-03T10:23:28.748 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.183989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174906.log 2023-10-03T10:23:28.748 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.183989.log.gz 2023-10-03T10:23:28.748 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.190318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188505.log 2023-10-03T10:23:28.748 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.174906.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.190318.log.gz 2023-10-03T10:23:28.748 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178919.log 2023-10-03T10:23:28.748 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174906.log.gz 2023-10-03T10:23:28.748 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.188505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129048.log 2023-10-03T10:23:28.749 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.188505.log.gz 2023-10-03T10:23:28.749 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.178919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171182.log 2023-10-03T10:23:28.749 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.129048.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.178919.log.gz 2023-10-03T10:23:28.749 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124473.log 2023-10-03T10:23:28.749 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.129048.log.gz 2023-10-03T10:23:28.749 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.171182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166718.log 2023-10-03T10:23:28.749 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.171182.log.gz 2023-10-03T10:23:28.749 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.124473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161622.log 2023-10-03T10:23:28.749 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.166718.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.124473.log.gz 2023-10-03T10:23:28.750 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157276.log 2023-10-03T10:23:28.750 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166718.log.gz 2023-10-03T10:23:28.750 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.161622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167742.log 2023-10-03T10:23:28.750 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.161622.log.gz 2023-10-03T10:23:28.750 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.157276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146460.log 2023-10-03T10:23:28.750 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.167742.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157276.log.gz 2023-10-03T10:23:28.750 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179426.log 2023-10-03T10:23:28.750 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.167742.log.gz 2023-10-03T10:23:28.751 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.146460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136652.log 2023-10-03T10:23:28.751 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146460.log.gz 2023-10-03T10:23:28.751 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.179426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142066.log 2023-10-03T10:23:28.751 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.136652.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.179426.log.gz 2023-10-03T10:23:28.751 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175748.log 2023-10-03T10:23:28.751 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136652.log.gz 2023-10-03T10:23:28.751 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.142066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178646.log 2023-10-03T10:23:28.751 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142066.log.gz 2023-10-03T10:23:28.751 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.175748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148082.log 2023-10-03T10:23:28.752 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.178646.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.175748.log.gz 2023-10-03T10:23:28.752 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192155.log 2023-10-03T10:23:28.752 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.178646.log.gz 2023-10-03T10:23:28.752 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.148082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156347.log 2023-10-03T10:23:28.752 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.148082.log.gz 2023-10-03T10:23:28.752 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.192155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124009.log 2023-10-03T10:23:28.752 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.192155.log.gz 2023-10-03T10:23:28.752 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.156347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172554.log 2023-10-03T10:23:28.753 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.156347.log.gz 2023-10-03T10:23:28.753 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.124009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181078.log 2023-10-03T10:23:28.753 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124009.log.gz 2023-10-03T10:23:28.753 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163164.log 2023-10-03T10:23:28.753 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.172554.log: /var/log/ceph/ceph-client.admin.181078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137240.log 2023-10-03T10:23:28.753 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.172554.log.gz 2023-10-03T10:23:28.753 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.163164.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.181078.log.gz 2023-10-03T10:23:28.753 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144552.log 2023-10-03T10:23:28.753 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.163164.log.gz 2023-10-03T10:23:28.754 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.137240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155538.log 2023-10-03T10:23:28.754 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.144552.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.137240.log.gz 2023-10-03T10:23:28.754 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147102.log 2023-10-03T10:23:28.754 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.144552.log.gz 2023-10-03T10:23:28.754 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.155538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190514.log 2023-10-03T10:23:28.754 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.155538.log.gz 2023-10-03T10:23:28.754 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.147102.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-03T10:23:28.754 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.147102.log.gz 2023-10-03T10:23:28.755 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.190514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136163.log 2023-10-03T10:23:28.755 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3%/var/log/ceph/ceph-osd.3.log: -- replaced with /var/log/ceph/ceph-client.admin.190514.log.gz 2023-10-03T10:23:28.755 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189411.log 2023-10-03T10:23:28.755 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.136163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151860.log 2023-10-03T10:23:28.755 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.189411.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.136163.log.gz 2023-10-03T10:23:28.755 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176875.log 2023-10-03T10:23:28.755 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.189411.log.gz 2023-10-03T10:23:28.755 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123956.log 2023-10-03T10:23:28.755 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.151860.log: /var/log/ceph/ceph-client.admin.176875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169320.log 2023-10-03T10:23:28.756 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.151860.log.gz 2023-10-03T10:23:28.756 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.176875.log.gz 2023-10-03T10:23:28.756 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.123956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187012.log 2023-10-03T10:23:28.756 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176801.log 2023-10-03T10:23:28.756 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123956.log.gz 2023-10-03T10:23:28.756 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.169320.log: /var/log/ceph/ceph-client.admin.187012.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169320.log.gz 2023-10-03T10:23:28.756 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139289.log 2023-10-03T10:23:28.756 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.187012.log.gz 2023-10-03T10:23:28.757 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127208.log 2023-10-03T10:23:28.757 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.176801.log: /var/log/ceph/ceph-client.admin.139289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174367.log 2023-10-03T10:23:28.757 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.176801.log.gz 2023-10-03T10:23:28.757 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.127208.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.139289.log.gz 2023-10-03T10:23:28.757 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158622.log 2023-10-03T10:23:28.757 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.174367.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127208.log.gz 2023-10-03T10:23:28.757 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127952.log 2023-10-03T10:23:28.757 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174367.log.gz 2023-10-03T10:23:28.758 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.158622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124205.log 2023-10-03T10:23:28.758 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158622.log.gz 2023-10-03T10:23:28.758 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.127952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137070.log 2023-10-03T10:23:28.758 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127952.log.gz 2023-10-03T10:23:28.758 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129357.log 2023-10-03T10:23:28.758 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.124205.log: /var/log/ceph/ceph-client.admin.137070.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.124205.log.gz 2023-10-03T10:23:28.758 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165150.log 2023-10-03T10:23:28.758 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186545.log 2023-10-03T10:23:28.758 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.129357.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.137070.log.gz 2023-10-03T10:23:28.759 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.165150.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.129357.log.gz 2023-10-03T10:23:28.759 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164902.log 2023-10-03T10:23:28.759 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.165150.log.gz 2023-10-03T10:23:28.759 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141970.log 2023-10-03T10:23:28.759 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.186545.log: /var/log/ceph/ceph-client.admin.164902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181637.log 2023-10-03T10:23:28.759 INFO:teuthology.orchestra.run.smithi146.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.186545.log.gz 2023-10-03T10:23:28.759 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.141970.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164902.log.gz 2023-10-03T10:23:28.759 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167646.log 2023-10-03T10:23:28.760 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.141970.log.gz 2023-10-03T10:23:28.760 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.181637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183597.log 2023-10-03T10:23:28.760 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.181637.log.gz 2023-10-03T10:23:28.760 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194856.log 2023-10-03T10:23:28.760 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.167646.log: /var/log/ceph/ceph-client.admin.183597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168438.log 2023-10-03T10:23:28.760 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167646.log.gz 2023-10-03T10:23:28.760 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.194856.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183597.log.gz 2023-10-03T10:23:28.760 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148489.log 2023-10-03T10:23:28.760 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.194856.log.gz 2023-10-03T10:23:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.168438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143154.log 2023-10-03T10:23:28.761 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.168438.log.gz 2023-10-03T10:23:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148226.log 2023-10-03T10:23:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.148489.log: /var/log/ceph/ceph-client.admin.143154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139055.log 2023-10-03T10:23:28.761 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148489.log.gz 2023-10-03T10:23:28.761 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.143154.log.gz 2023-10-03T10:23:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.148226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144181.log 2023-10-03T10:23:28.761 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184428.log 2023-10-03T10:23:28.762 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.148226.log.gz 2023-10-03T10:23:28.762 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.139055.log: /var/log/ceph/ceph-client.admin.144181.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139055.log.gz 2023-10-03T10:23:28.762 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177744.log 2023-10-03T10:23:28.762 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.144181.log.gz 2023-10-03T10:23:28.762 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167933.log 2023-10-03T10:23:28.762 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.184428.log: /var/log/ceph/ceph-client.admin.177744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167353.log 2023-10-03T10:23:28.762 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.184428.log.gz 2023-10-03T10:23:28.762 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.167933.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.177744.log.gz 2023-10-03T10:23:28.763 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142822.log 2023-10-03T10:23:28.763 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.167933.log.gz 2023-10-03T10:23:28.763 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.167353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157668.log 2023-10-03T10:23:28.763 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167353.log.gz 2023-10-03T10:23:28.763 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-03T10:23:28.763 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.142822.log: /var/log/ceph/ceph-client.admin.157668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171966.log 2023-10-03T10:23:28.763 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142822.log.gz 2023-10-03T10:23:28.763 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.0.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.157668.log.gz 2023-10-03T10:23:28.763 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151646.log 2023-10-03T10:23:28.764 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.171966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173730.log 2023-10-03T10:23:28.764 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.171966.log.gz 2023-10-03T10:23:28.764 INFO:teuthology.orchestra.run.smithi146.stderr:gzip /var/log/ceph/ceph-client.admin.151646.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.170842.log 2023-10-03T10:23:28.764 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.173730.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.151646.log.gzgzip 2023-10-03T10:23:28.764 INFO:teuthology.orchestra.run.smithi146.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.174048.log 2023-10-03T10:23:28.764 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173730.log.gz 2023-10-03T10:23:28.764 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.170842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159236.log 2023-10-03T10:23:28.764 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.174048.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.170842.log.gz 2023-10-03T10:23:28.764 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174048.log.gz 2023-10-03T10:23:28.765 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.159236.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159236.log.gz 2023-10-03T10:23:28.765 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188309.log 2023-10-03T10:23:28.765 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148912.log 2023-10-03T10:23:28.765 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.188309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137905.log 2023-10-03T10:23:28.765 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.188309.log.gz 2023-10-03T10:23:28.765 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.148912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129268.log 2023-10-03T10:23:28.765 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.148912.log.gz 2023-10-03T10:23:28.765 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.137905.log: /var/log/ceph/ceph-client.admin.129268.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137905.log.gz 2023-10-03T10:23:28.766 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129268.log.gz 2023-10-03T10:23:28.766 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191763.log 2023-10-03T10:23:28.766 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159798.log 2023-10-03T10:23:28.766 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.191763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152572.log 2023-10-03T10:23:28.766 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.191763.log.gz 2023-10-03T10:23:28.766 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.159798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188897.log 2023-10-03T10:23:28.766 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135967.log 2023-10-03T10:23:28.766 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.152572.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.159798.log.gz 2023-10-03T10:23:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.188897.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.152572.log.gz 2023-10-03T10:23:28.767 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.188897.log.gz 2023-10-03T10:23:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.135967.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.135967.log.gz 2023-10-03T10:23:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123392.log 2023-10-03T10:23:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169614.log 2023-10-03T10:23:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.123392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136349.log 2023-10-03T10:23:28.767 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123392.log.gz 2023-10-03T10:23:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.169614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163215.log 2023-10-03T10:23:28.768 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179528.log 2023-10-03T10:23:28.768 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.136349.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.169614.log.gz 2023-10-03T10:23:28.768 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.163215.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136349.log.gz 2023-10-03T10:23:28.768 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.163215.log.gz 2023-10-03T10:23:28.768 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.179528.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179528.log.gz 2023-10-03T10:23:28.768 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127009.log 2023-10-03T10:23:28.768 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138834.log 2023-10-03T10:23:28.768 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.127009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165712.log 2023-10-03T10:23:28.768 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.127009.log.gz 2023-10-03T10:23:28.769 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.138834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129455.log 2023-10-03T10:23:28.769 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185565.log 2023-10-03T10:23:28.769 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.138834.log.gz 2023-10-03T10:23:28.769 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.165712.log: /var/log/ceph/ceph-client.admin.129455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160472.log 2023-10-03T10:23:28.769 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.165712.log.gz 2023-10-03T10:23:28.769 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.129455.log.gz 2023-10-03T10:23:28.769 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.185565.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.185565.log.gz 2023-10-03T10:23:28.769 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.160472.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160472.log.gz 2023-10-03T10:23:28.770 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179285.log 2023-10-03T10:23:28.770 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151462.log 2023-10-03T10:23:28.770 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.179285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138497.log 2023-10-03T10:23:28.770 INFO:teuthology.orchestra.run.smithi146.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.179285.log.gz 2023-10-03T10:23:28.770 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.151462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165962.log 2023-10-03T10:23:28.770 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.138497.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.151462.log.gz 2023-10-03T10:23:28.770 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122790.log 2023-10-03T10:23:28.770 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.138497.log.gz 2023-10-03T10:23:28.770 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.165962.log: /var/log/ceph/ceph-client.admin.122790.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.165962.log.gz 2023-10-03T10:23:28.771 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122790.log.gz 2023-10-03T10:23:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147299.log 2023-10-03T10:23:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179947.log 2023-10-03T10:23:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.147299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185473.log 2023-10-03T10:23:28.771 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.147299.log.gz 2023-10-03T10:23:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.179947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182813.log 2023-10-03T10:23:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:gzip 89.3%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.179947.log.gz-- 2023-10-03T10:23:28.771 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.169865.log 2023-10-03T10:23:28.772 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.185473.log: /var/log/ceph/ceph-client.admin.182813.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.185473.log.gz 2023-10-03T10:23:28.772 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.182813.log.gz 2023-10-03T10:23:28.772 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.169865.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169865.log.gz 2023-10-03T10:23:28.772 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158306.log 2023-10-03T10:23:28.772 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164981.log 2023-10-03T10:23:28.772 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.158306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150996.log 2023-10-03T10:23:28.772 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158306.log.gz 2023-10-03T10:23:28.772 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.164981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142558.log 2023-10-03T10:23:28.772 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164981.log.gz/var/log/ceph/ceph-client.admin.150996.log: 2023-10-03T10:23:28.773 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.142558.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.150996.log.gz 2023-10-03T10:23:28.773 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142558.log.gz 2023-10-03T10:23:28.773 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159824.log 2023-10-03T10:23:28.773 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154140.log 2023-10-03T10:23:28.773 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.159824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165294.log 2023-10-03T10:23:28.773 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.159824.log.gz 2023-10-03T10:23:28.773 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.154140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128122.log 2023-10-03T10:23:28.773 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154140.log.gz 2023-10-03T10:23:28.773 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.165294.log: /var/log/ceph/ceph-client.admin.128122.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165294.log.gz 2023-10-03T10:23:28.774 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128122.log.gz 2023-10-03T10:23:28.774 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154595.log 2023-10-03T10:23:28.774 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187917.log 2023-10-03T10:23:28.774 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.154595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187133.log 2023-10-03T10:23:28.774 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.154595.log.gz 2023-10-03T10:23:28.774 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.187917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187329.log 2023-10-03T10:23:28.774 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.187133.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.187917.log.gz 2023-10-03T10:23:28.774 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.187329.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.187133.log.gz 2023-10-03T10:23:28.775 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.187329.log.gz 2023-10-03T10:23:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175356.log 2023-10-03T10:23:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177667.log 2023-10-03T10:23:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.175356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176383.log 2023-10-03T10:23:28.775 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175356.log.gz 2023-10-03T10:23:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.177667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180069.log 2023-10-03T10:23:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165516.log 2023-10-03T10:23:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.176383.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.177667.log.gz 2023-10-03T10:23:28.775 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.180069.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.176383.log.gz 2023-10-03T10:23:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.165516.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.180069.log.gz 2023-10-03T10:23:28.776 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165516.log.gz 2023-10-03T10:23:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187647.log 2023-10-03T10:23:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153800.log 2023-10-03T10:23:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.187647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160057.log 2023-10-03T10:23:28.776 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.187647.log.gz 2023-10-03T10:23:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.153800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157742.log 2023-10-03T10:23:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157642.log 2023-10-03T10:23:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.160057.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.153800.log.gz 2023-10-03T10:23:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.157742.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.160057.log.gz-5 2023-10-03T10:23:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:--verbose -- /var/log/ceph/ceph-client.admin.177913.log 2023-10-03T10:23:28.777 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.157742.log.gz 2023-10-03T10:23:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.157642.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.157642.log.gz 2023-10-03T10:23:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.177913.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.177913.log.gz 2023-10-03T10:23:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164392.log 2023-10-03T10:23:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145872.log 2023-10-03T10:23:28.778 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.164392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144406.log 2023-10-03T10:23:28.778 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.145872.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.164392.log.gz 2023-10-03T10:23:28.778 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145872.log.gz 2023-10-03T10:23:28.778 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.144406.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.144406.log.gz 2023-10-03T10:23:28.778 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160224.log 2023-10-03T10:23:28.778 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162017.log 2023-10-03T10:23:28.778 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.160224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183699.log 2023-10-03T10:23:28.778 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160224.log.gz 2023-10-03T10:23:28.779 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.162017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191690.log 2023-10-03T10:23:28.779 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.183699.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.162017.log.gz 2023-10-03T10:23:28.779 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171647.log 2023-10-03T10:23:28.779 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.183699.log.gz 2023-10-03T10:23:28.779 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.191690.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.191690.log.gz 2023-10-03T10:23:28.779 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.171647.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.171647.log.gz 2023-10-03T10:23:28.779 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183793.log 2023-10-03T10:23:28.779 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181539.log 2023-10-03T10:23:28.779 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.183793.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.111874.log 2023-10-03T10:23:28.780 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.183793.log.gz 2023-10-03T10:23:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.181539.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.181539.log.gz 2023-10-03T10:23:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.tmp-client.admin.111874.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.111874.log.gz 2023-10-03T10:23:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190391.log 2023-10-03T10:23:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124422.log 2023-10-03T10:23:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.190391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192942.log 2023-10-03T10:23:28.780 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.190391.log.gz 2023-10-03T10:23:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.124422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156348.log 2023-10-03T10:23:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.192942.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.124422.log.gz 2023-10-03T10:23:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.156348.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.192942.log.gz 2023-10-03T10:23:28.781 INFO:teuthology.orchestra.run.smithi146.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.156348.log.gz 2023-10-03T10:23:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176579.log 2023-10-03T10:23:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153799.log 2023-10-03T10:23:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.176579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169909.log 2023-10-03T10:23:28.781 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176579.log.gz 2023-10-03T10:23:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.153799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142652.log 2023-10-03T10:23:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171378.log 2023-10-03T10:23:28.782 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153799.log.gz 2023-10-03T10:23:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.169909.log: /var/log/ceph/ceph-client.admin.142652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161427.log 2023-10-03T10:23:28.782 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.169909.log.gz 2023-10-03T10:23:28.782 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.142652.log.gz 2023-10-03T10:23:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.171378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179920.log 2023-10-03T10:23:28.782 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.171378.log.gz 2023-10-03T10:23:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.161427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122692.log 2023-10-03T10:23:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.179920.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.161427.log.gz 2023-10-03T10:23:28.783 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.179920.log.gz 2023-10-03T10:23:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.122692.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122692.log.gz 2023-10-03T10:23:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166104.log 2023-10-03T10:23:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193728.log 2023-10-03T10:23:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.166104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178527.log 2023-10-03T10:23:28.783 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.166104.log.gz 2023-10-03T10:23:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.193728.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.193728.log.gz 2023-10-03T10:23:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.178527.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.178527.log.gz 2023-10-03T10:23:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122304.log 2023-10-03T10:23:28.784 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152841.log 2023-10-03T10:23:28.784 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.122304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192353.log 2023-10-03T10:23:28.784 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.122304.log.gz 2023-10-03T10:23:28.784 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.152841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178723.log 2023-10-03T10:23:28.784 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3%/var/log/ceph/ceph-client.admin.192353.log: -- replaced with /var/log/ceph/ceph-client.admin.152841.log.gz 2023-10-03T10:23:28.784 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125671.log 2023-10-03T10:23:28.784 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.178723.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.192353.log.gz 2023-10-03T10:23:28.784 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178723.log.gz 2023-10-03T10:23:28.785 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.125671.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125671.log.gz 2023-10-03T10:23:28.785 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137122.log 2023-10-03T10:23:28.785 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134987.log 2023-10-03T10:23:28.785 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.137122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127953.log 2023-10-03T10:23:28.785 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.137122.log.gz 2023-10-03T10:23:28.785 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.134987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161596.log 2023-10-03T10:23:28.785 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.127953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183474.log 2023-10-03T10:23:28.785 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.134987.log.gz 2023-10-03T10:23:28.785 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.161596.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127953.log.gz 2023-10-03T10:23:28.786 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188627.log 2023-10-03T10:23:28.786 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161596.log.gz 2023-10-03T10:23:28.786 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.183474.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183474.log.gz 2023-10-03T10:23:28.786 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.188627.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.188627.log.gz 2023-10-03T10:23:28.786 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160250.log 2023-10-03T10:23:28.786 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156957.log 2023-10-03T10:23:28.786 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.160250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128705.log 2023-10-03T10:23:28.786 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.156957.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160250.log.gz 2023-10-03T10:23:28.787 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156957.log.gz 2023-10-03T10:23:28.787 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.128705.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128705.log.gz 2023-10-03T10:23:28.787 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144526.log 2023-10-03T10:23:28.787 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125475.log 2023-10-03T10:23:28.787 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.144526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176483.log 2023-10-03T10:23:28.787 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144526.log.gz 2023-10-03T10:23:28.787 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.125475.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.125475.log.gz 2023-10-03T10:23:28.787 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.176483.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.176483.log.gz 2023-10-03T10:23:28.788 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139670.log 2023-10-03T10:23:28.788 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193775.log 2023-10-03T10:23:28.788 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.139670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175111.log 2023-10-03T10:23:28.788 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139670.log.gz 2023-10-03T10:23:28.788 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.193775.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.193775.log.gz 2023-10-03T10:23:28.788 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.175111.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.175111.log.gz 2023-10-03T10:23:28.788 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152742.log 2023-10-03T10:23:28.788 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164732.log 2023-10-03T10:23:28.788 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.152742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184381.log 2023-10-03T10:23:28.789 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.152742.log.gz 2023-10-03T10:23:28.789 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.164732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144795.log 2023-10-03T10:23:28.789 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.164732.log.gz 2023-10-03T10:23:28.789 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.184381.log: /var/log/ceph/ceph-client.admin.144795.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.184381.log.gz 2023-10-03T10:23:28.789 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.144795.log.gz 2023-10-03T10:23:28.789 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178893.log 2023-10-03T10:23:28.789 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140648.log 2023-10-03T10:23:28.789 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.178893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154949.log 2023-10-03T10:23:28.790 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.178893.log.gz 2023-10-03T10:23:28.790 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.140648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152546.log 2023-10-03T10:23:28.790 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146853.log 2023-10-03T10:23:28.790 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.154949.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140648.log.gz 2023-10-03T10:23:28.790 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.152546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178966.log 2023-10-03T10:23:28.790 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.154949.log.gz 2023-10-03T10:23:28.790 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152546.log.gz 2023-10-03T10:23:28.790 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.146853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188701.log 2023-10-03T10:23:28.790 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.146853.log.gz 2023-10-03T10:23:28.791 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.178966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140768.log 2023-10-03T10:23:28.791 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.178966.log.gz 2023-10-03T10:23:28.791 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.188701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156492.log 2023-10-03T10:23:28.791 INFO:teuthology.orchestra.run.smithi146.stderr: 89.6%/var/log/ceph/ceph-client.admin.140768.log: -- replaced with /var/log/ceph/ceph-client.admin.188701.log.gz 2023-10-03T10:23:28.791 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125061.log 2023-10-03T10:23:28.791 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140768.log.gz 2023-10-03T10:23:28.791 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.156492.log: /var/log/ceph/ceph-client.admin.125061.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156492.log.gz 2023-10-03T10:23:28.791 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125061.log.gz 2023-10-03T10:23:28.792 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166548.log 2023-10-03T10:23:28.792 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143546.log 2023-10-03T10:23:28.792 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.166548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167280.log 2023-10-03T10:23:28.792 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.166548.log.gz 2023-10-03T10:23:28.792 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157446.log 2023-10-03T10:23:28.792 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128362.log 2023-10-03T10:23:28.792 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.143546.log.gz 2023-10-03T10:23:28.792 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.167280.log: /var/log/ceph/ceph-client.admin.157446.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.167280.log.gz 2023-10-03T10:23:28.792 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157446.log.gz 2023-10-03T10:23:28.793 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.128362.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.128362.log.gz 2023-10-03T10:23:28.793 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156545.log 2023-10-03T10:23:28.793 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183670.log 2023-10-03T10:23:28.793 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.156545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194905.log 2023-10-03T10:23:28.793 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.156545.log.gz 2023-10-03T10:23:28.793 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.183670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192670.log 2023-10-03T10:23:28.793 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184848.log 2023-10-03T10:23:28.793 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.183670.log.gz 2023-10-03T10:23:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.194905.log: /var/log/ceph/ceph-client.admin.192670.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.194905.log.gz 2023-10-03T10:23:28.794 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9%/var/log/ceph/ceph-client.admin.184848.log: -- replaced with /var/log/ceph/ceph-client.admin.192670.log.gz 2023-10-03T10:23:28.794 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.184848.log.gz 2023-10-03T10:23:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174636.log 2023-10-03T10:23:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181309.log 2023-10-03T10:23:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.174636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193457.log 2023-10-03T10:23:28.794 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174636.log.gz 2023-10-03T10:23:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.181309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184699.log 2023-10-03T10:23:28.794 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183325.log 2023-10-03T10:23:28.795 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.181309.log.gz 2023-10-03T10:23:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.193457.log: /var/log/ceph/ceph-client.admin.184699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124914.log 2023-10-03T10:23:28.795 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.193457.log.gz 2023-10-03T10:23:28.795 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.184699.log.gz 2023-10-03T10:23:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.183325.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.183325.log.gz 2023-10-03T10:23:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.124914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138246.log 2023-10-03T10:23:28.795 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124914.log.gz 2023-10-03T10:23:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168464.log 2023-10-03T10:23:28.796 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.138246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153748.log 2023-10-03T10:23:28.796 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.168464.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138246.log.gz 2023-10-03T10:23:28.796 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.153748.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.168464.log.gz 2023-10-03T10:23:28.796 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.153748.log.gz 2023-10-03T10:23:28.796 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160786.log 2023-10-03T10:23:28.796 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155341.log 2023-10-03T10:23:28.796 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.160786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139056.log 2023-10-03T10:23:28.796 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160786.log.gz 2023-10-03T10:23:28.796 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.155341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150970.log 2023-10-03T10:23:28.797 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193184.log 2023-10-03T10:23:28.797 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.155341.log.gz 2023-10-03T10:23:28.797 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.139056.log: /var/log/ceph/ceph-client.admin.150970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192129.log 2023-10-03T10:23:28.797 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.139056.log.gz 2023-10-03T10:23:28.797 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150970.log.gz 2023-10-03T10:23:28.797 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.193184.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.193184.log.gz 2023-10-03T10:23:28.797 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.192129.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.192129.log.gz 2023-10-03T10:23:28.797 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136482.log 2023-10-03T10:23:28.798 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182272.log 2023-10-03T10:23:28.798 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.136482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129565.log 2023-10-03T10:23:28.798 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2%/var/log/ceph/ceph-client.admin.182272.log: -- replaced with /var/log/ceph/ceph-client.admin.136482.log.gz 2023-10-03T10:23:28.798 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.182272.log.gz 2023-10-03T10:23:28.798 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.129565.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.129565.log.gz 2023-10-03T10:23:28.798 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162772.log 2023-10-03T10:23:28.798 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190071.log 2023-10-03T10:23:28.798 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.162772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156074.log 2023-10-03T10:23:28.799 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162772.log.gz 2023-10-03T10:23:28.799 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.190071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141212.log 2023-10-03T10:23:28.799 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.156074.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.190071.log.gz 2023-10-03T10:23:28.799 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.156074.log.gz/var/log/ceph/ceph-client.admin.141212.log: 2023-10-03T10:23:28.799 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.141212.log.gz 2023-10-03T10:23:28.799 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191245.log 2023-10-03T10:23:28.799 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172825.log 2023-10-03T10:23:28.799 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.191245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144722.log 2023-10-03T10:23:28.799 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.191245.log.gz 2023-10-03T10:23:28.800 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.172825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177005.log 2023-10-03T10:23:28.800 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176213.log 2023-10-03T10:23:28.800 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.172825.log.gz 2023-10-03T10:23:28.800 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.144722.log: /var/log/ceph/ceph-client.admin.177005.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.144722.log.gz 2023-10-03T10:23:28.800 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.177005.log.gz 2023-10-03T10:23:28.800 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.176213.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176213.log.gz 2023-10-03T10:23:28.800 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183840.log 2023-10-03T10:23:28.800 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136925.log 2023-10-03T10:23:28.801 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.183840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138101.log 2023-10-03T10:23:28.801 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.183840.log.gz 2023-10-03T10:23:28.801 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.136925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179312.log 2023-10-03T10:23:28.801 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128852.log 2023-10-03T10:23:28.801 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.138101.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.136925.log.gz 2023-10-03T10:23:28.801 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.179312.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.138101.log.gz 2023-10-03T10:23:28.801 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.179312.log.gz 2023-10-03T10:23:28.801 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.128852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178501.log 2023-10-03T10:23:28.802 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.128852.log.gz--verbose 2023-10-03T10:23:28.802 INFO:teuthology.orchestra.run.smithi146.stderr:-- /var/log/ceph/ceph-client.admin.172013.log 2023-10-03T10:23:28.802 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.178501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186471.log 2023-10-03T10:23:28.802 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.178501.log.gz 2023-10-03T10:23:28.802 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.172013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151985.log 2023-10-03T10:23:28.802 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.186471.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.172013.log.gz 2023-10-03T10:23:28.802 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.186471.log.gz 2023-10-03T10:23:28.802 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.151985.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.151985.log.gz 2023-10-03T10:23:28.802 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186398.log 2023-10-03T10:23:28.803 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161988.log 2023-10-03T10:23:28.803 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.186398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163334.log 2023-10-03T10:23:28.803 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.186398.log.gz 2023-10-03T10:23:28.803 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.161988.log: /var/log/ceph/ceph-client.admin.163334.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161988.log.gz 2023-10-03T10:23:28.803 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163334.log.gz 2023-10-03T10:23:28.803 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160280.log 2023-10-03T10:23:28.803 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165686.log 2023-10-03T10:23:28.803 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.160280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173338.log 2023-10-03T10:23:28.803 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160280.log.gz 2023-10-03T10:23:28.804 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.165686.log: /var/log/ceph/ceph-client.admin.173338.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.165686.log.gz 2023-10-03T10:23:28.804 INFO:teuthology.orchestra.run.smithi146.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.173338.log.gz 2023-10-03T10:23:28.804 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189681.log 2023-10-03T10:23:28.804 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191345.log 2023-10-03T10:23:28.804 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.189681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141042.log 2023-10-03T10:23:28.804 INFO:teuthology.orchestra.run.smithi146.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.189681.log.gz 2023-10-03T10:23:28.804 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.191345.log: /var/log/ceph/ceph-client.admin.141042.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.191345.log.gz 2023-10-03T10:23:28.804 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.141042.log.gz 2023-10-03T10:23:28.805 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127339.log 2023-10-03T10:23:28.805 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150460.log 2023-10-03T10:23:28.805 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.127339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177275.log 2023-10-03T10:23:28.805 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.127339.log.gz 2023-10-03T10:23:28.805 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.150460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155586.log 2023-10-03T10:23:28.805 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134882.log 2023-10-03T10:23:28.805 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150460.log.gz 2023-10-03T10:23:28.805 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.177275.log: /var/log/ceph/ceph-client.admin.155586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164366.log 2023-10-03T10:23:28.806 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177275.log.gz 2023-10-03T10:23:28.806 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.155586.log.gz 2023-10-03T10:23:28.806 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.134882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188405.log 2023-10-03T10:23:28.806 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.134882.log.gz 2023-10-03T10:23:28.806 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.164366.log: /var/log/ceph/ceph-client.admin.188405.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.164366.log.gz 2023-10-03T10:23:28.806 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.188405.log.gz 2023-10-03T10:23:28.806 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139288.log 2023-10-03T10:23:28.806 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177593.log 2023-10-03T10:23:28.806 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.139288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179677.log 2023-10-03T10:23:28.807 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.139288.log.gz 2023-10-03T10:23:28.807 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.177593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182664.log 2023-10-03T10:23:28.807 INFO:teuthology.orchestra.run.smithi146.stderr:gzip 88.5%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.177593.log.gz-- 2023-10-03T10:23:28.807 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.135182.log 2023-10-03T10:23:28.807 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.179677.log: /var/log/ceph/ceph-client.admin.182664.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179677.log.gz 2023-10-03T10:23:28.807 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.182664.log.gz 2023-10-03T10:23:28.807 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.135182.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.135182.log.gz 2023-10-03T10:23:28.807 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178450.log 2023-10-03T10:23:28.808 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183896.log 2023-10-03T10:23:28.808 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.178450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191494.log 2023-10-03T10:23:28.808 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.178450.log.gz 2023-10-03T10:23:28.808 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.183896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192745.log 2023-10-03T10:23:28.808 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177567.log 2023-10-03T10:23:28.808 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.183896.log.gz 2023-10-03T10:23:28.808 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.191494.log: /var/log/ceph/ceph-client.admin.192745.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.191494.log.gz 2023-10-03T10:23:28.808 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.192745.log.gz/var/log/ceph/ceph-client.admin.177567.log: 2023-10-03T10:23:28.809 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.177567.log.gz 2023-10-03T10:23:28.809 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162063.log 2023-10-03T10:23:28.809 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124204.log 2023-10-03T10:23:28.809 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.162063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143324.log 2023-10-03T10:23:28.809 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.162063.log.gz 2023-10-03T10:23:28.809 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.124204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164980.log 2023-10-03T10:23:28.809 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168929.log 2023-10-03T10:23:28.809 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143324.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.124204.log.gz 2023-10-03T10:23:28.809 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.164980.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143324.log.gz 2023-10-03T10:23:28.810 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.164980.log.gz 2023-10-03T10:23:28.810 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.168929.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.168929.log.gz 2023-10-03T10:23:28.810 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168329.log 2023-10-03T10:23:28.810 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159876.log 2023-10-03T10:23:28.810 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.168329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165373.log 2023-10-03T10:23:28.810 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.168329.log.gz 2023-10-03T10:23:28.810 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.159876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187600.log 2023-10-03T10:23:28.810 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165345.log 2023-10-03T10:23:28.811 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.165373.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.159876.log.gz 2023-10-03T10:23:28.811 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.187600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147520.log 2023-10-03T10:23:28.811 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.165373.log.gz 2023-10-03T10:23:28.811 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.187600.log.gz/var/log/ceph/ceph-client.admin.165345.log: 2023-10-03T10:23:28.811 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146290.log 2023-10-03T10:23:28.811 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.147520.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165345.log.gz 2023-10-03T10:23:28.811 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.146290.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147520.log.gz 2023-10-03T10:23:28.811 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.146290.log.gz 2023-10-03T10:23:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179602.log 2023-10-03T10:23:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153944.log 2023-10-03T10:23:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.179602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177175.log 2023-10-03T10:23:28.812 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.179602.log.gz 2023-10-03T10:23:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.153944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183205.log 2023-10-03T10:23:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123810.log 2023-10-03T10:23:28.812 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.153944.log.gz 2023-10-03T10:23:28.812 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.177175.log: /var/log/ceph/ceph-client.admin.183205.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177175.log.gz 2023-10-03T10:23:28.812 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.183205.log.gz 2023-10-03T10:23:28.813 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.123810.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.123810.log.gz 2023-10-03T10:23:28.813 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144892.log 2023-10-03T10:23:28.813 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154362.log 2023-10-03T10:23:28.813 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.144892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163582.log 2023-10-03T10:23:28.813 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.144892.log.gz 2023-10-03T10:23:28.813 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.154362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184062.log 2023-10-03T10:23:28.813 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145480.log 2023-10-03T10:23:28.813 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.154362.log.gz 2023-10-03T10:23:28.814 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.163582.log: /var/log/ceph/ceph-client.admin.184062.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.163582.log.gz 2023-10-03T10:23:28.814 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.184062.log.gz 2023-10-03T10:23:28.814 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.145480.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.145480.log.gz 2023-10-03T10:23:28.814 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179036.log 2023-10-03T10:23:28.814 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185810.log 2023-10-03T10:23:28.814 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.179036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182076.log 2023-10-03T10:23:28.814 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.179036.log.gz 2023-10-03T10:23:28.814 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.185810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160471.log 2023-10-03T10:23:28.815 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178109.log 2023-10-03T10:23:28.815 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8%/var/log/ceph/ceph-client.admin.182076.log: -- replaced with /var/log/ceph/ceph-client.admin.185810.log.gz 2023-10-03T10:23:28.815 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.160471.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.182076.log.gz 2023-10-03T10:23:28.815 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.160471.log.gz 2023-10-03T10:23:28.815 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.178109.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.178109.log.gz 2023-10-03T10:23:28.815 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190365.log 2023-10-03T10:23:28.815 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153997.log 2023-10-03T10:23:28.815 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.190365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172260.log 2023-10-03T10:23:28.816 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.190365.log.gz 2023-10-03T10:23:28.816 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.153997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145723.log 2023-10-03T10:23:28.816 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.153997.log.gz 2023-10-03T10:23:28.816 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.172260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193532.log 2023-10-03T10:23:28.816 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.145723.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.172260.log.gz 2023-10-03T10:23:28.816 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-03T10:23:28.816 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.145723.log.gz 2023-10-03T10:23:28.816 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.193532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137632.log 2023-10-03T10:23:28.817 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.193532.log.gz--verbose 2023-10-03T10:23:28.817 INFO:teuthology.orchestra.run.smithi146.stderr:-- /var/log/ceph/ceph-client.admin.187770.log 2023-10-03T10:23:28.817 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.137632.log: /var/log/ceph/ceph-client.admin.187770.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137632.log.gz 2023-10-03T10:23:28.817 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.187770.log.gz 2023-10-03T10:23:28.817 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145088.log 2023-10-03T10:23:28.817 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174563.log 2023-10-03T10:23:28.817 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.145088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173244.log 2023-10-03T10:23:28.817 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145088.log.gz 2023-10-03T10:23:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.174563.log: /var/log/ceph/ceph-client.admin.173244.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.174563.log.gz 2023-10-03T10:23:28.818 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.173244.log.gz 2023-10-03T10:23:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182102.log 2023-10-03T10:23:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139200.log 2023-10-03T10:23:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.182102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147442.log 2023-10-03T10:23:28.818 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.182102.log.gz 2023-10-03T10:23:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.139200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162211.log 2023-10-03T10:23:28.818 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.139200.log.gz 2023-10-03T10:23:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.147442.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147442.log.gz 2023-10-03T10:23:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.162211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135672.log 2023-10-03T10:23:28.819 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162211.log.gz 2023-10-03T10:23:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159877.log 2023-10-03T10:23:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194513.log 2023-10-03T10:23:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.135672.log: /var/log/ceph/ceph-client.admin.159877.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.135672.log.gz 2023-10-03T10:23:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.194513.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.159877.log.gz 2023-10-03T10:23:28.819 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.194513.log.gz 2023-10-03T10:23:28.819 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124127.log 2023-10-03T10:23:28.820 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173852.log 2023-10-03T10:23:28.820 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.124127.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124127.log.gz 2023-10-03T10:23:28.820 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.173852.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.173852.log.gz 2023-10-03T10:23:28.820 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171478.log 2023-10-03T10:23:28.820 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190979.log 2023-10-03T10:23:28.820 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.171478.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171478.log.gz 2023-10-03T10:23:28.820 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.190979.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.190979.log.gz 2023-10-03T10:23:28.820 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177986.log 2023-10-03T10:23:28.820 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193336.log 2023-10-03T10:23:28.821 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.177986.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177986.log.gz 2023-10-03T10:23:28.821 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.193336.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.193336.log.gz 2023-10-03T10:23:28.821 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167350.log 2023-10-03T10:23:28.821 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192521.log 2023-10-03T10:23:28.821 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.167350.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.167350.log.gz 2023-10-03T10:23:28.821 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.192521.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.192521.log.gz 2023-10-03T10:23:28.821 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183644.log 2023-10-03T10:23:28.821 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186153.log 2023-10-03T10:23:28.822 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.183644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141870.log 2023-10-03T10:23:28.822 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.186153.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.183644.log.gz 2023-10-03T10:23:28.822 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.141870.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.186153.log.gz 2023-10-03T10:23:28.822 INFO:teuthology.orchestra.run.smithi146.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.141870.log.gz 2023-10-03T10:23:28.822 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142458.log 2023-10-03T10:23:28.822 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194709.log 2023-10-03T10:23:28.822 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.142458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118549.log 2023-10-03T10:23:28.822 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.142458.log.gz 2023-10-03T10:23:28.822 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.194709.log: /var/log/ceph/ceph-client.admin.118549.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.194709.log.gz 2023-10-03T10:23:28.823 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118549.log.gz 2023-10-03T10:23:28.823 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176605.log 2023-10-03T10:23:28.823 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128558.log 2023-10-03T10:23:28.823 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.176605.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176605.log.gz 2023-10-03T10:23:28.823 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.128558.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128558.log.gz 2023-10-03T10:23:28.823 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186790.log 2023-10-03T10:23:28.823 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162649.log 2023-10-03T10:23:28.823 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.186790.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.186790.log.gz 2023-10-03T10:23:28.824 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.162649.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.162649.log.gz 2023-10-03T10:23:28.824 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184895.log 2023-10-03T10:23:28.824 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138612.log 2023-10-03T10:23:28.824 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.184895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128950.log 2023-10-03T10:23:28.824 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184895.log.gz 2023-10-03T10:23:28.824 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.138612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173460.log 2023-10-03T10:23:28.824 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.138612.log.gz 2023-10-03T10:23:28.824 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.128950.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128950.log.gz 2023-10-03T10:23:28.824 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.173460.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173460.log.gz 2023-10-03T10:23:28.825 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154780.log 2023-10-03T10:23:28.825 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166078.log 2023-10-03T10:23:28.825 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.154780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165124.log 2023-10-03T10:23:28.825 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.154780.log.gz 2023-10-03T10:23:28.825 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.166078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193307.log 2023-10-03T10:23:28.825 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.166078.log.gz 2023-10-03T10:23:28.825 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.165124.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165124.log.gz 2023-10-03T10:23:28.825 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.193307.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.193307.log.gz 2023-10-03T10:23:28.826 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146757.log 2023-10-03T10:23:28.826 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162380.log 2023-10-03T10:23:28.826 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.146757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155342.log 2023-10-03T10:23:28.826 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.146757.log.gz 2023-10-03T10:23:28.826 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.162380.log: /var/log/ceph/ceph-client.admin.155342.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162380.log.gz 2023-10-03T10:23:28.826 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.155342.log.gz 2023-10-03T10:23:28.826 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173656.log 2023-10-03T10:23:28.826 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146905.log 2023-10-03T10:23:28.827 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.173656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159484.log 2023-10-03T10:23:28.827 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.173656.log.gz 2023-10-03T10:23:28.827 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.146905.log: /var/log/ceph/ceph-client.admin.159484.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.146905.log.gz 2023-10-03T10:23:28.827 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.159484.log.gz 2023-10-03T10:23:28.827 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194611.log 2023-10-03T10:23:28.827 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178331.log 2023-10-03T10:23:28.827 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.194611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127625.log 2023-10-03T10:23:28.827 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.194611.log.gz 2023-10-03T10:23:28.828 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.178331.log: /var/log/ceph/ceph-client.admin.127625.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.178331.log.gz 2023-10-03T10:23:28.828 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127625.log.gz 2023-10-03T10:23:28.828 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125769.log 2023-10-03T10:23:28.828 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141211.log 2023-10-03T10:23:28.828 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.125769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185640.log 2023-10-03T10:23:28.828 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.125769.log.gz 2023-10-03T10:23:28.828 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.141211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191737.log 2023-10-03T10:23:28.828 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.141211.log.gz 2023-10-03T10:23:28.828 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.185640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167940.log 2023-10-03T10:23:28.829 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.185640.log.gz 2023-10-03T10:23:28.829 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.191737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185614.log 2023-10-03T10:23:28.829 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149086.log 2023-10-03T10:23:28.829 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.167940.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.191737.log.gz 2023-10-03T10:23:28.829 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.185614.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.167940.log.gz 2023-10-03T10:23:28.829 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.185614.log.gz 2023-10-03T10:23:28.829 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.149086.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149086.log.gz 2023-10-03T10:23:28.829 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123588.log 2023-10-03T10:23:28.830 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159310.log 2023-10-03T10:23:28.830 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.123588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137711.log 2023-10-03T10:23:28.830 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123588.log.gz 2023-10-03T10:23:28.830 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.159310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145320.log 2023-10-03T10:23:28.830 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.159310.log.gz 2023-10-03T10:23:28.830 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.137711.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137711.log.gz 2023-10-03T10:23:28.830 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.145320.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.145320.log.gz 2023-10-03T10:23:28.830 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154898.log 2023-10-03T10:23:28.830 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184092.log 2023-10-03T10:23:28.831 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.154898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180536.log 2023-10-03T10:23:28.831 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.154898.log.gz 2023-10-03T10:23:28.831 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.184092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168928.log 2023-10-03T10:23:28.831 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.184092.log.gz 2023-10-03T10:23:28.831 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.180536.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.180536.log.gz 2023-10-03T10:23:28.831 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.168928.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.168928.log.gz 2023-10-03T10:23:28.831 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194954.log 2023-10-03T10:23:28.831 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185091.log 2023-10-03T10:23:28.832 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.194954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155369.log 2023-10-03T10:23:28.832 INFO:teuthology.orchestra.run.smithi146.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.194954.log.gz 2023-10-03T10:23:28.832 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.185091.log: /var/log/ceph/ceph-client.admin.155369.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.185091.log.gz 2023-10-03T10:23:28.832 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.155369.log.gz 2023-10-03T10:23:28.832 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159210.log 2023-10-03T10:23:28.832 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163413.log 2023-10-03T10:23:28.832 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.159210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151790.log 2023-10-03T10:23:28.832 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.159210.log.gz 2023-10-03T10:23:28.832 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.163413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174832.log 2023-10-03T10:23:28.833 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.163413.log.gz 2023-10-03T10:23:28.876 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.151790.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.151790.log.gz 2023-10-03T10:23:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.174832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191541.log 2023-10-03T10:23:28.877 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174832.log.gz 2023-10-03T10:23:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157838.log 2023-10-03T10:23:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.191541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135868.log 2023-10-03T10:23:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.157838.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.191541.log.gz 2023-10-03T10:23:28.877 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.157838.log.gz 2023-10-03T10:23:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.135868.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.135868.log.gz 2023-10-03T10:23:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152376.log 2023-10-03T10:23:28.878 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146068.log 2023-10-03T10:23:28.878 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.152376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191959.log 2023-10-03T10:23:28.878 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0%/var/log/ceph/ceph-client.admin.146068.log: -- replaced with /var/log/ceph/ceph-client.admin.152376.log.gz 2023-10-03T10:23:28.878 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.146068.log.gz 2023-10-03T10:23:28.878 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.191959.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.191959.log.gz 2023-10-03T10:23:28.878 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152057.log 2023-10-03T10:23:28.878 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135968.log 2023-10-03T10:23:28.878 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.152057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191102.log 2023-10-03T10:23:28.879 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.135968.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.152057.log.gz 2023-10-03T10:23:28.879 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.135968.log.gz 2023-10-03T10:23:28.879 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.191102.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.191102.log.gz 2023-10-03T10:23:28.879 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191567.log 2023-10-03T10:23:28.879 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142430.log 2023-10-03T10:23:28.879 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.191567.log: /var/log/ceph/ceph-client.admin.142430.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.191567.log.gz 2023-10-03T10:23:28.879 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167058.log 2023-10-03T10:23:28.879 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.142430.log.gz 2023-10-03T10:23:28.880 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156173.log 2023-10-03T10:23:28.880 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181540.log 2023-10-03T10:23:28.880 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.167058.log: /var/log/ceph/ceph-client.admin.156173.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167058.log.gz 2023-10-03T10:23:28.880 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156173.log.gz 2023-10-03T10:23:28.880 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.181540.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.181540.log.gz 2023-10-03T10:23:28.880 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148521.log 2023-10-03T10:23:28.880 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128460.log 2023-10-03T10:23:28.880 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.148521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158426.log 2023-10-03T10:23:28.880 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.148521.log.gz 2023-10-03T10:23:28.881 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.128460.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.128460.log.gz 2023-10-03T10:23:28.881 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.158426.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158426.log.gz 2023-10-03T10:23:28.881 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190169.log 2023-10-03T10:23:28.881 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173610.log 2023-10-03T10:23:28.881 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.190169.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.190169.log.gz 2023-10-03T10:23:28.881 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.173610.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.173610.log.gz 2023-10-03T10:23:28.881 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170079.log 2023-10-03T10:23:28.881 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170986.log 2023-10-03T10:23:28.882 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.170079.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.170079.log.gz 2023-10-03T10:23:28.882 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.170986.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.170986.log.gz 2023-10-03T10:23:28.882 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180508.log 2023-10-03T10:23:28.882 INFO:teuthology.orchestra.run.smithi146.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-03T10:23:28.882 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165764.log 2023-10-03T10:23:28.882 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.180508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169517.log 2023-10-03T10:23:28.882 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.180508.log.gz 2023-10-03T10:23:28.882 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.165764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186986.log 2023-10-03T10:23:28.882 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165764.log.gz 2023-10-03T10:23:28.883 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.169517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189534.log 2023-10-03T10:23:28.883 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.186986.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169517.log.gz 2023-10-03T10:23:28.883 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148030.log 2023-10-03T10:23:28.883 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.189534.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.186986.log.gz 2023-10-03T10:23:28.883 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143608.log 2023-10-03T10:23:28.883 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.148030.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.189534.log.gz 2023-10-03T10:23:28.883 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143608.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.148030.log.gz 2023-10-03T10:23:28.883 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190783.log 2023-10-03T10:23:28.883 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143608.log.gz 2023-10-03T10:23:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174414.log 2023-10-03T10:23:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164928.log 2023-10-03T10:23:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.190783.log: /var/log/ceph/ceph-client.admin.174414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182886.log 2023-10-03T10:23:28.884 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.190783.log.gz 2023-10-03T10:23:28.884 INFO:teuthology.orchestra.run.smithi146.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.174414.log.gz 2023-10-03T10:23:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.164928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152350.log 2023-10-03T10:23:28.884 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.164928.log.gz 2023-10-03T10:23:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.182886.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.182886.log.gz 2023-10-03T10:23:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.152350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144210.log 2023-10-03T10:23:28.885 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.152350.log.gz 2023-10-03T10:23:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128803.log 2023-10-03T10:23:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.144210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190853.log 2023-10-03T10:23:28.885 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.144210.log.gz 2023-10-03T10:23:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.128803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118158.log 2023-10-03T10:23:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123441.log 2023-10-03T10:23:28.885 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8%/var/log/ceph/ceph-client.admin.190853.log: -- replaced with /var/log/ceph/ceph-client.admin.128803.log.gz 2023-10-03T10:23:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.118158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124372.log 2023-10-03T10:23:28.886 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.190853.log.gz 2023-10-03T10:23:28.886 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.123441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156270.log 2023-10-03T10:23:28.886 INFO:teuthology.orchestra.run.smithi146.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.118158.log.gz 2023-10-03T10:23:28.886 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.124372.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.123441.log.gz 2023-10-03T10:23:28.886 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180189.log 2023-10-03T10:23:28.886 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142166.log 2023-10-03T10:23:28.886 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.124372.log.gz 2023-10-03T10:23:28.886 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.156270.log: /var/log/ceph/ceph-client.admin.180189.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156270.log.gz 2023-10-03T10:23:28.887 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.142166.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.180189.log.gz 2023-10-03T10:23:28.887 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.142166.log.gz 2023-10-03T10:23:28.887 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148326.log 2023-10-03T10:23:28.887 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175011.log 2023-10-03T10:23:28.887 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.148326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188235.log 2023-10-03T10:23:28.887 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.148326.log.gz 2023-10-03T10:23:28.887 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.175011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122545.log 2023-10-03T10:23:28.887 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125622.log 2023-10-03T10:23:28.888 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.175011.log.gz 2023-10-03T10:23:28.888 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.188235.log: /var/log/ceph/ceph-client.admin.122545.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.188235.log.gz 2023-10-03T10:23:28.888 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.122545.log.gz 2023-10-03T10:23:28.888 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.125622.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.125622.log.gz 2023-10-03T10:23:28.888 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194464.log 2023-10-03T10:23:28.888 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182860.log 2023-10-03T10:23:28.888 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.194464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185410.log 2023-10-03T10:23:28.888 INFO:teuthology.orchestra.run.smithi146.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.194464.log.gz 2023-10-03T10:23:28.889 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.182860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191933.log 2023-10-03T10:23:28.889 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.182860.log.gz 2023-10-03T10:23:28.889 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.185410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127011.log 2023-10-03T10:23:28.889 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.191933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151362.log 2023-10-03T10:23:28.889 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.185410.log.gz 2023-10-03T10:23:28.889 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191933.log.gz 2023-10-03T10:23:28.889 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.127011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172066.log 2023-10-03T10:23:28.889 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.151362.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.127011.log.gz 2023-10-03T10:23:28.889 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149284.log 2023-10-03T10:23:28.890 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.172066.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.151362.log.gz 2023-10-03T10:23:28.890 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172066.log.gz 2023-10-03T10:23:28.890 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.149284.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.149284.log.gz 2023-10-03T10:23:28.890 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187966.log 2023-10-03T10:23:28.890 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153409.log 2023-10-03T10:23:28.890 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.187966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179798.log 2023-10-03T10:23:28.890 INFO:teuthology.orchestra.run.smithi146.stderr: 89.6%/var/log/ceph/ceph-client.admin.153409.log: -- replaced with /var/log/ceph/ceph-client.admin.187966.log.gz 2023-10-03T10:23:28.890 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170790.log 2023-10-03T10:23:28.891 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.153409.log.gz 2023-10-03T10:23:28.891 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.179798.log: /var/log/ceph/ceph-client.admin.170790.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179798.log.gz 2023-10-03T10:23:28.891 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170790.log.gz 2023-10-03T10:23:28.891 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146953.log 2023-10-03T10:23:28.891 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186594.log 2023-10-03T10:23:28.891 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.146953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186863.log 2023-10-03T10:23:28.891 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.146953.log.gz 2023-10-03T10:23:28.891 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.186594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180710.log 2023-10-03T10:23:28.891 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170105.log 2023-10-03T10:23:28.892 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.186863.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.186594.log.gz 2023-10-03T10:23:28.892 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.180710.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.186863.log.gz 2023-10-03T10:23:28.892 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3%/var/log/ceph/ceph-client.admin.170105.log: -- replaced with /var/log/ceph/ceph-client.admin.180710.log.gz 2023-10-03T10:23:28.892 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192401.log 2023-10-03T10:23:28.892 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.170105.log.gz 2023-10-03T10:23:28.892 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150656.log 2023-10-03T10:23:28.892 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.192401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162184.log 2023-10-03T10:23:28.892 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.192401.log.gz 2023-10-03T10:23:28.893 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.150656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137658.log 2023-10-03T10:23:28.893 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128901.log 2023-10-03T10:23:28.893 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.162184.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.150656.log.gz 2023-10-03T10:23:28.893 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.137658.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.162184.log.gz 2023-10-03T10:23:28.893 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.128901.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137658.log.gz 2023-10-03T10:23:28.893 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189730.log 2023-10-03T10:23:28.893 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.128901.log.gz 2023-10-03T10:23:28.893 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150238.log 2023-10-03T10:23:28.893 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.189730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160641.log 2023-10-03T10:23:28.894 INFO:teuthology.orchestra.run.smithi146.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.189730.log.gz 2023-10-03T10:23:28.894 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.150238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127391.log 2023-10-03T10:23:28.894 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135133.log 2023-10-03T10:23:28.894 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.160641.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.150238.log.gz 2023-10-03T10:23:28.894 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.127391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174959.log 2023-10-03T10:23:28.894 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.160641.log.gz 2023-10-03T10:23:28.894 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5%/var/log/ceph/ceph-client.admin.135133.log: -- replaced with /var/log/ceph/ceph-client.admin.127391.log.gz 2023-10-03T10:23:28.894 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170868.log 2023-10-03T10:23:28.895 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.174959.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.135133.log.gz 2023-10-03T10:23:28.895 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.170868.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.174959.log.gz 2023-10-03T10:23:28.895 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.170868.log.gz 2023-10-03T10:23:28.895 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124323.log 2023-10-03T10:23:28.895 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161374.log 2023-10-03T10:23:28.895 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.124323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149257.log 2023-10-03T10:23:28.895 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.124323.log.gz 2023-10-03T10:23:28.895 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.161374.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-03T10:23:28.895 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157054.log 2023-10-03T10:23:28.896 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.161374.log.gz/var/log/ceph/ceph-client.admin.149257.log: 2023-10-03T10:23:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142362.log 2023-10-03T10:23:28.896 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149257.log.gz 2023-10-03T10:23:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.157054.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157054.log.gz 2023-10-03T10:23:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.142362.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.142362.log.gz 2023-10-03T10:23:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184287.log 2023-10-03T10:23:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138691.log 2023-10-03T10:23:28.896 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.184287.log: /var/log/ceph/ceph-client.admin.138691.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.184287.log.gz 2023-10-03T10:23:28.896 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.138691.log.gz 2023-10-03T10:23:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122353.log 2023-10-03T10:23:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191886.log 2023-10-03T10:23:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.122353.log: /var/log/ceph/ceph-client.admin.191886.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.122353.log.gz 2023-10-03T10:23:28.897 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191886.log.gz 2023-10-03T10:23:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150774.log 2023-10-03T10:23:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188822.log 2023-10-03T10:23:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.150774.log: /var/log/ceph/ceph-client.admin.188822.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.150774.log.gz 2023-10-03T10:23:28.897 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.188822.log.gz 2023-10-03T10:23:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192325.log 2023-10-03T10:23:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125110.log 2023-10-03T10:23:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.192325.log: /var/log/ceph/ceph-client.admin.125110.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.192325.log.gz 2023-10-03T10:23:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123957.log 2023-10-03T10:23:28.898 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.125110.log.gz 2023-10-03T10:23:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147717.log 2023-10-03T10:23:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.123957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185669.log 2023-10-03T10:23:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.147717.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.123957.log.gz 2023-10-03T10:23:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.185669.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.147717.log.gz 2023-10-03T10:23:28.899 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.185669.log.gz 2023-10-03T10:23:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-03T10:23:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-03T10:23:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:gzip /var/log/ceph/ceph-mds.a.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.122643.log 2023-10-03T10:23:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.122643.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122643.log.gz 2023-10-03T10:23:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134963.log 2023-10-03T10:23:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.134963.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.134963.log.gz 2023-10-03T10:23:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188750.log 2023-10-03T10:23:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.188750.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.188750.log.gz 2023-10-03T10:23:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145972.log 2023-10-03T10:23:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.145972.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.145972.log.gz 2023-10-03T10:23:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172995.log 2023-10-03T10:23:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.172995.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172995.log.gz 2023-10-03T10:23:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151388.log 2023-10-03T10:23:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.151388.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.151388.log.gz 2023-10-03T10:23:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174122.log 2023-10-03T10:23:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.174122.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174122.log.gz 2023-10-03T10:23:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142336.log 2023-10-03T10:23:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.142336.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.142336.log.gz 2023-10-03T10:23:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187378.log 2023-10-03T10:23:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.187378.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.187378.log.gz 2023-10-03T10:23:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138102.log 2023-10-03T10:23:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.138102.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.138102.log.gz 2023-10-03T10:23:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141842.log 2023-10-03T10:23:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.141842.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.141842.log.gz 2023-10-03T10:23:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160590.log 2023-10-03T10:23:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.160590.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.160590.log.gz 2023-10-03T10:23:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122496.log 2023-10-03T10:23:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.122496.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.122496.log.gz 2023-10-03T10:23:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176187.log 2023-10-03T10:23:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.176187.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.176187.log.gz 2023-10-03T10:23:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173534.log 2023-10-03T10:23:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.173534.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.173534.log.gz 2023-10-03T10:23:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181932.log 2023-10-03T10:23:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.181932.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.181932.log.gz 2023-10-03T10:23:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124153.log 2023-10-03T10:23:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.124153.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124153.log.gz 2023-10-03T10:23:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180657.log 2023-10-03T10:23:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.180657.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.180657.log.gz 2023-10-03T10:23:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186741.log 2023-10-03T10:23:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155978.log 2023-10-03T10:23:28.903 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.186741.log: 87.7%/var/log/ceph/ceph-client.admin.155978.log: -- replaced with /var/log/ceph/ceph-client.admin.186741.log.gz 2023-10-03T10:23:28.904 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155978.log.gz 2023-10-03T10:23:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188358.log 2023-10-03T10:23:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.188358.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.188358.log.gz 2023-10-03T10:23:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177864.log 2023-10-03T10:23:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.177864.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.177864.log.gz 2023-10-03T10:23:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123343.log 2023-10-03T10:23:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.123343.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.123343.log.gz 2023-10-03T10:23:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172629.log 2023-10-03T10:23:28.904 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.172629.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172629.log.gz 2023-10-03T10:23:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141577.log 2023-10-03T10:23:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.141577.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.141577.log.gz 2023-10-03T10:23:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143128.log 2023-10-03T10:23:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143128.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143128.log.gz 2023-10-03T10:23:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160028.log 2023-10-03T10:23:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.160028.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.160028.log.gz 2023-10-03T10:23:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181344.log 2023-10-03T10:23:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.181344.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.181344.log.gz 2023-10-03T10:23:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145945.log 2023-10-03T10:23:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.145945.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.145945.log.gz 2023-10-03T10:23:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146486.log 2023-10-03T10:23:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.146486.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.146486.log.gz 2023-10-03T10:23:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175307.log 2023-10-03T10:23:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.175307.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.175307.log.gz 2023-10-03T10:23:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155094.log 2023-10-03T10:23:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.155094.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.155094.log.gz 2023-10-03T10:23:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161231.log 2023-10-03T10:23:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.161231.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.161231.log.gz 2023-10-03T10:23:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168530.log 2023-10-03T10:23:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.168530.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168530.log.gz 2023-10-03T10:23:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183521.log 2023-10-03T10:23:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.183521.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.183521.log.gz 2023-10-03T10:23:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122890.log 2023-10-03T10:23:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.122890.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.122890.log.gz 2023-10-03T10:23:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165197.log 2023-10-03T10:23:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.165197.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.165197.log.gz 2023-10-03T10:23:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125012.log 2023-10-03T10:23:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.125012.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.125012.log.gz 2023-10-03T10:23:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142848.log 2023-10-03T10:23:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.142848.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142848.log.gz 2023-10-03T10:23:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187208.log 2023-10-03T10:23:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.187208.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.187208.log.gz 2023-10-03T10:23:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181468.log 2023-10-03T10:23:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189926.log 2023-10-03T10:23:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.181468.log: /var/log/ceph/ceph-client.admin.189926.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181468.log.gz 2023-10-03T10:23:28.909 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.189926.log.gz 2023-10-03T10:23:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137317.log 2023-10-03T10:23:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.137317.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.137317.log.gz 2023-10-03T10:23:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172358.log 2023-10-03T10:23:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.172358.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172358.log.gz 2023-10-03T10:23:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185361.log 2023-10-03T10:23:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.185361.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.185361.log.gz 2023-10-03T10:23:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187059.log 2023-10-03T10:23:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.187059.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.187059.log.gz 2023-10-03T10:23:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157864.log 2023-10-03T10:23:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.157864.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.157864.log.gz 2023-10-03T10:23:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162746.log 2023-10-03T10:23:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.162746.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162746.log.gz 2023-10-03T10:23:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156466.log 2023-10-03T10:23:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.156466.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.156466.log.gz 2023-10-03T10:23:28.911 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141648.log 2023-10-03T10:23:28.911 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186424.log 2023-10-03T10:23:28.911 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.141648.log: /var/log/ceph/ceph-client.admin.186424.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141648.log.gz 2023-10-03T10:23:28.911 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.186424.log.gz 2023-10-03T10:23:28.911 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139396.log 2023-10-03T10:23:28.911 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.139396.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139396.log.gz 2023-10-03T10:23:28.911 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184232.log 2023-10-03T10:23:28.911 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.184232.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.184232.log.gz 2023-10-03T10:23:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157535.log 2023-10-03T10:23:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.157535.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157535.log.gz 2023-10-03T10:23:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177079.log 2023-10-03T10:23:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.177079.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.177079.log.gz 2023-10-03T10:23:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157545.log 2023-10-03T10:23:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.157545.log: 94.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-03T10:23:28.912 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.157545.log.gz 2023-10-03T10:23:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164365.log 2023-10-03T10:23:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192082.log 2023-10-03T10:23:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.164365.log: /var/log/ceph/ceph-client.admin.192082.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.164365.log.gz 2023-10-03T10:23:28.913 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.192082.log.gz 2023-10-03T10:23:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167842.log 2023-10-03T10:23:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147887.log 2023-10-03T10:23:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.167842.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167842.log.gz 2023-10-03T10:23:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.147887.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.147887.log.gz 2023-10-03T10:23:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175207.log 2023-10-03T10:23:28.913 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158034.log 2023-10-03T10:23:28.914 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.175207.log: /var/log/ceph/ceph-client.admin.158034.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.175207.log.gz 2023-10-03T10:23:28.914 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158034.log.gz 2023-10-03T10:23:28.914 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144330.log 2023-10-03T10:23:28.914 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181880.log 2023-10-03T10:23:28.914 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.144330.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.144330.log.gz 2023-10-03T10:23:28.914 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.181880.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.181880.log.gz 2023-10-03T10:23:28.914 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174440.log 2023-10-03T10:23:28.914 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173926.log 2023-10-03T10:23:28.915 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.174440.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174440.log.gz 2023-10-03T10:23:28.915 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.173926.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173926.log.gz 2023-10-03T10:23:28.915 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143986.log 2023-10-03T10:23:28.915 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-03T10:23:28.915 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143986.log: /var/log/ceph/ceph-mon.c.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.143986.log.gz 2023-10-03T10:23:28.915 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147638.log 2023-10-03T10:23:28.915 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.147638.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.147638.log.gz 2023-10-03T10:23:28.915 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171574.log 2023-10-03T10:23:28.916 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.171574.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171574.log.gz 2023-10-03T10:23:28.916 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140257.log 2023-10-03T10:23:28.916 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.140257.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.140257.log.gz 2023-10-03T10:23:28.916 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165490.log 2023-10-03T10:23:28.916 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.165490.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.165490.log.gz 2023-10-03T10:23:28.916 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123686.log 2023-10-03T10:23:28.916 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.123686.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.123686.log.gz 2023-10-03T10:23:28.916 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189142.log 2023-10-03T10:23:28.916 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.189142.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189142.log.gz 2023-10-03T10:23:28.917 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170594.log 2023-10-03T10:23:28.917 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.170594.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170594.log.gz 2023-10-03T10:23:28.917 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151414.log 2023-10-03T10:23:28.917 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.151414.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.151414.log.gz 2023-10-03T10:23:28.917 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170646.log 2023-10-03T10:23:28.917 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.170646.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170646.log.gz 2023-10-03T10:23:28.917 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189485.log 2023-10-03T10:23:28.917 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.189485.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.189485.log.gz 2023-10-03T10:23:28.918 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138298.log 2023-10-03T10:23:28.918 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.138298.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.138298.log.gz 2023-10-03T10:23:28.918 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140452.log 2023-10-03T10:23:28.918 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.140452.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140452.log.gz 2023-10-03T10:23:28.918 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144600.log 2023-10-03T10:23:28.918 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.144600.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144600.log.gz 2023-10-03T10:23:28.918 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153212.log 2023-10-03T10:23:28.918 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.153212.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153212.log.gz 2023-10-03T10:23:28.919 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143742.log 2023-10-03T10:23:28.919 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143742.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143742.log.gz 2023-10-03T10:23:28.919 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180116.log 2023-10-03T10:23:28.919 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.180116.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.180116.log.gz 2023-10-03T10:23:28.919 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143202.log 2023-10-03T10:23:28.919 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143202.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.143202.log.gz 2023-10-03T10:23:28.919 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183866.log 2023-10-03T10:23:28.919 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.183866.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.183866.log.gz 2023-10-03T10:23:28.920 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147050.log 2023-10-03T10:23:28.920 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.147050.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.147050.log.gz 2023-10-03T10:23:28.920 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170398.log 2023-10-03T10:23:28.920 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.170398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.170398.log.gz 2023-10-03T10:23:28.920 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157349.log 2023-10-03T10:23:28.920 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.157349.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157349.log.gz 2023-10-03T10:23:28.920 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152180.log 2023-10-03T10:23:28.920 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.152180.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.152180.log.gz 2023-10-03T10:23:28.920 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193849.log 2023-10-03T10:23:28.921 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.193849.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.193849.log.gz 2023-10-03T10:23:28.921 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175991.log 2023-10-03T10:23:28.921 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.175991.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175991.log.gz 2023-10-03T10:23:28.921 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157911.log 2023-10-03T10:23:28.921 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.157911.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157911.log.gz 2023-10-03T10:23:28.921 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148814.log 2023-10-03T10:23:28.921 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.148814.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148814.log.gz 2023-10-03T10:23:28.921 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175795.log 2023-10-03T10:23:28.922 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.175795.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.175795.log.gz 2023-10-03T10:23:28.922 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118757.log 2023-10-03T10:23:28.922 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.118757.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.118757.log.gz 2023-10-03T10:23:28.922 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145284.log 2023-10-03T10:23:28.922 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.145284.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.145284.log.gz 2023-10-03T10:23:28.922 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190710.log 2023-10-03T10:23:28.922 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.190710.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.190710.log.gz 2023-10-03T10:23:28.922 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123490.log 2023-10-03T10:23:28.923 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.123490.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.123490.log.gz 2023-10-03T10:23:28.923 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182325.log 2023-10-03T10:23:28.923 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.182325.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.182325.log.gz 2023-10-03T10:23:28.923 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169864.log 2023-10-03T10:23:28.923 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.169864.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169864.log.gz 2023-10-03T10:23:28.923 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155172.log 2023-10-03T10:23:28.923 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.155172.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.155172.log.gz 2023-10-03T10:23:28.923 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143044.log 2023-10-03T10:23:28.923 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143044.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.143044.log.gz 2023-10-03T10:23:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125279.log 2023-10-03T10:23:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.125279.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.125279.log.gz 2023-10-03T10:23:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141160.log 2023-10-03T10:23:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.141160.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.141160.log.gz 2023-10-03T10:23:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170645.log 2023-10-03T10:23:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.170645.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.170645.log.gz 2023-10-03T10:23:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122427.log 2023-10-03T10:23:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.122427.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.122427.log.gz 2023-10-03T10:23:28.925 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151958.log 2023-10-03T10:23:28.925 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.151958.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.151958.log.gz 2023-10-03T10:23:28.925 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166914.log 2023-10-03T10:23:28.925 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.166914.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.166914.log.gz 2023-10-03T10:23:28.925 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146656.log 2023-10-03T10:23:28.925 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.146656.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.146656.log.gz 2023-10-03T10:23:28.925 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124963.log 2023-10-03T10:23:28.925 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.124963.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124963.log.gz 2023-10-03T10:23:28.925 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154594.log 2023-10-03T10:23:28.926 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.154594.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.154594.log.gz 2023-10-03T10:23:28.926 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153134.log 2023-10-03T10:23:28.926 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.153134.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.153134.log.gz 2023-10-03T10:23:28.926 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185240.log 2023-10-03T10:23:28.926 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.185240.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.185240.log.gz 2023-10-03T10:23:28.926 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154191.log 2023-10-03T10:23:28.926 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.154191.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154191.log.gz 2023-10-03T10:23:28.926 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136286.log 2023-10-03T10:23:28.927 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.136286.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136286.log.gz 2023-10-03T10:23:28.927 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159680.log 2023-10-03T10:23:28.927 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.159680.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.159680.log.gz 2023-10-03T10:23:28.927 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179116.log 2023-10-03T10:23:28.927 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.179116.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.179116.log.gz 2023-10-03T10:23:28.927 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183278.log 2023-10-03T10:23:28.927 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.183278.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.183278.log.gz 2023-10-03T10:23:28.927 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164588.log 2023-10-03T10:23:28.927 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.164588.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.164588.log.gz 2023-10-03T10:23:28.928 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138638.log 2023-10-03T10:23:28.928 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.138638.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.138638.log.gz 2023-10-03T10:23:28.928 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128151.log 2023-10-03T10:23:28.928 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.128151.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128151.log.gz 2023-10-03T10:23:28.928 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194147.log 2023-10-03T10:23:28.928 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.194147.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.194147.log.gz 2023-10-03T10:23:28.928 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189607.log 2023-10-03T10:23:28.928 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.189607.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.189607.log.gz 2023-10-03T10:23:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170476.log 2023-10-03T10:23:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.170476.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170476.log.gz 2023-10-03T10:23:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179724.log 2023-10-03T10:23:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.179724.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179724.log.gz 2023-10-03T10:23:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190195.log 2023-10-03T10:23:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.190195.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.190195.log.gz 2023-10-03T10:23:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181441.log 2023-10-03T10:23:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.181441.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.181441.log.gz 2023-10-03T10:23:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193138.log 2023-10-03T10:23:28.930 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.193138.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.193138.log.gz 2023-10-03T10:23:28.930 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164196.log 2023-10-03T10:23:28.954 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.164196.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.164196.log.gz 2023-10-03T10:23:28.954 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175599.log 2023-10-03T10:23:28.954 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.175599.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175599.log.gz 2023-10-03T10:23:28.954 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194415.log 2023-10-03T10:23:28.954 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.194415.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.194415.log.gz 2023-10-03T10:23:28.954 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135772.log 2023-10-03T10:23:28.954 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.135772.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135772.log.gz 2023-10-03T10:23:28.954 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134684.log 2023-10-03T10:23:28.955 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.134684.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.134684.log.gz 2023-10-03T10:23:28.955 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155146.log 2023-10-03T10:23:28.955 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.155146.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.155146.log.gz 2023-10-03T10:23:28.955 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147468.log 2023-10-03T10:23:28.955 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.147468.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147468.log.gz 2023-10-03T10:23:28.955 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154702.log 2023-10-03T10:23:28.955 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.154702.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.154702.log.gz 2023-10-03T10:23:28.955 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190461.log 2023-10-03T10:23:28.956 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.190461.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.190461.log.gz 2023-10-03T10:23:28.956 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152645.log 2023-10-03T10:23:28.956 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.152645.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.152645.log.gz 2023-10-03T10:23:28.956 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178574.log 2023-10-03T10:23:28.956 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.178574.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.178574.log.gz 2023-10-03T10:23:28.956 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169513.log 2023-10-03T10:23:28.956 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.169513.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.169513.log.gz 2023-10-03T10:23:28.956 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173806.log 2023-10-03T10:23:28.957 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.173806.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173806.log.gz 2023-10-03T10:23:28.957 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142234.log 2023-10-03T10:23:28.957 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.142234.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.142234.log.gz 2023-10-03T10:23:28.957 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162354.log 2023-10-03T10:23:28.957 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.162354.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.162354.log.gz 2023-10-03T10:23:28.957 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171635.log 2023-10-03T10:23:28.957 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.171635.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171635.log.gz 2023-10-03T10:23:28.957 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-03T10:23:28.958 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.log: 94.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-03T10:23:28.958 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141578.log 2023-10-03T10:23:28.958 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.141578.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.141578.log.gz 2023-10-03T10:23:28.958 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179996.log 2023-10-03T10:23:28.958 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.179996.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.179996.log.gz 2023-10-03T10:23:28.958 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137828.log 2023-10-03T10:23:28.958 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.137828.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137828.log.gz 2023-10-03T10:23:28.958 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182298.log 2023-10-03T10:23:28.958 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.182298.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.182298.log.gz 2023-10-03T10:23:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171208.log 2023-10-03T10:23:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.171208.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.171208.log.gz 2023-10-03T10:23:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177520.log 2023-10-03T10:23:28.959 INFO:teuthology.orchestra.run.smithi146.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-03T10:23:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.177520.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.177520.log.gz 2023-10-03T10:23:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180461.log 2023-10-03T10:23:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156884.log 2023-10-03T10:23:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.180461.log: /var/log/ceph/ceph-client.admin.156884.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.180461.log.gz 2023-10-03T10:23:28.960 INFO:teuthology.orchestra.run.smithi146.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.156884.log.gz 2023-10-03T10:23:28.960 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166274.log 2023-10-03T10:23:28.960 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187993.log 2023-10-03T10:23:28.960 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.166274.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.166274.log.gz 2023-10-03T10:23:28.960 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.187993.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.187993.log.gz 2023-10-03T10:23:28.960 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192915.log 2023-10-03T10:23:28.960 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125720.log 2023-10-03T10:23:28.960 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.192915.log: /var/log/ceph/ceph-client.admin.125720.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.192915.log.gz 2023-10-03T10:23:28.960 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.125720.log.gz 2023-10-03T10:23:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184652.log 2023-10-03T10:23:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176679.log 2023-10-03T10:23:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.184652.log: /var/log/ceph/ceph-client.admin.176679.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.184652.log.gz 2023-10-03T10:23:28.961 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176679.log.gz 2023-10-03T10:23:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156913.log 2023-10-03T10:23:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149872.log 2023-10-03T10:23:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.156913.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156913.log.gz 2023-10-03T10:23:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.149872.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149872.log.gz 2023-10-03T10:23:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135013.log 2023-10-03T10:23:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149845.log 2023-10-03T10:23:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.135013.log: /var/log/ceph/ceph-client.admin.149845.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.135013.log.gz 2023-10-03T10:23:28.962 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149845.log.gz 2023-10-03T10:23:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141480.log 2023-10-03T10:23:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193952.log 2023-10-03T10:23:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.141480.log: /var/log/ceph/ceph-client.admin.193952.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.141480.log.gz 2023-10-03T10:23:28.962 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.193952.log.gz 2023-10-03T10:23:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193702.log 2023-10-03T10:23:28.963 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161473.log 2023-10-03T10:23:28.963 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.193702.log: /var/log/ceph/ceph-client.admin.161473.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.193702.log.gz 2023-10-03T10:23:28.963 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161473.log.gz 2023-10-03T10:23:28.963 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142532.log 2023-10-03T10:23:28.963 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175552.log 2023-10-03T10:23:28.963 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.142532.log: /var/log/ceph/ceph-client.admin.175552.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.142532.log.gz 2023-10-03T10:23:28.963 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175552.log.gz 2023-10-03T10:23:28.965 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166470.log 2023-10-03T10:23:28.965 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135698.log 2023-10-03T10:23:28.965 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.166470.log: /var/log/ceph/ceph-client.admin.135698.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.166470.log.gz 2023-10-03T10:23:28.965 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.135698.log.gz 2023-10-03T10:23:28.965 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143716.log 2023-10-03T10:23:28.965 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193506.log 2023-10-03T10:23:28.965 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143716.log: /var/log/ceph/ceph-client.admin.193506.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143716.log.gz 2023-10-03T10:23:28.966 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.193506.log.gz 2023-10-03T10:23:28.966 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123813.log 2023-10-03T10:23:28.966 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176140.log 2023-10-03T10:23:28.966 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.123813.log: /var/log/ceph/ceph-client.admin.176140.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.123813.log.gz 2023-10-03T10:23:28.966 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.176140.log.gz 2023-10-03T10:23:28.966 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161868.log 2023-10-03T10:23:28.966 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128050.log 2023-10-03T10:23:28.966 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.161868.log: /var/log/ceph/ceph-client.admin.128050.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.161868.log.gz 2023-10-03T10:23:28.967 INFO:teuthology.orchestra.run.smithi146.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.128050.log.gz 2023-10-03T10:23:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129097.log 2023-10-03T10:23:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179554.log 2023-10-03T10:23:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.129097.log: /var/log/ceph/ceph-client.admin.179554.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129097.log.gz 2023-10-03T10:23:28.967 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.179554.log.gz 2023-10-03T10:23:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162942.log 2023-10-03T10:23:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149479.log 2023-10-03T10:23:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.162942.log: /var/log/ceph/ceph-client.admin.149479.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.162942.log.gz 2023-10-03T10:23:28.968 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149479.log.gz 2023-10-03T10:23:28.968 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127149.log 2023-10-03T10:23:28.968 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194045.log 2023-10-03T10:23:28.968 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.127149.log: /var/log/ceph/ceph-client.admin.194045.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127149.log.gz 2023-10-03T10:23:28.968 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.194045.log.gz 2023-10-03T10:23:28.968 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163608.log 2023-10-03T10:23:28.968 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161595.log 2023-10-03T10:23:28.968 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.163608.log: /var/log/ceph/ceph-client.admin.161595.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.163608.log.gz 2023-10-03T10:23:28.968 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.161595.log.gz 2023-10-03T10:23:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164536.log 2023-10-03T10:23:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163922.log 2023-10-03T10:23:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.164536.log: /var/log/ceph/ceph-client.admin.163922.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164536.log.gz 2023-10-03T10:23:28.969 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.163922.log.gz 2023-10-03T10:23:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139487.log 2023-10-03T10:23:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186620.log 2023-10-03T10:23:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.139487.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139487.log.gz 2023-10-03T10:23:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.186620.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.186620.log.gz 2023-10-03T10:23:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170672.log 2023-10-03T10:23:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169810.log 2023-10-03T10:23:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.170672.log: /var/log/ceph/ceph-client.admin.169810.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.170672.log.gz 2023-10-03T10:23:28.970 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.169810.log.gz 2023-10-03T10:23:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173975.log 2023-10-03T10:23:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138690.log 2023-10-03T10:23:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.173975.log: /var/log/ceph/ceph-client.admin.138690.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.173975.log.gz 2023-10-03T10:23:28.970 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138690.log.gz 2023-10-03T10:23:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186816.log 2023-10-03T10:23:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140572.log 2023-10-03T10:23:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.186816.log: /var/log/ceph/ceph-client.admin.140572.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.186816.log.gz 2023-10-03T10:23:28.971 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.140572.log.gz 2023-10-03T10:23:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179358.log 2023-10-03T10:23:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180932.log 2023-10-03T10:23:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.179358.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179358.log.gz 2023-10-03T10:23:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.180932.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180932.log.gz 2023-10-03T10:23:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192474.log 2023-10-03T10:23:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140011.log 2023-10-03T10:23:28.972 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.192474.log: /var/log/ceph/ceph-client.admin.140011.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.192474.log.gz 2023-10-03T10:23:28.972 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140011.log.gz 2023-10-03T10:23:28.972 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159678.log 2023-10-03T10:23:28.972 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149480.log 2023-10-03T10:23:28.972 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.159678.log: /var/log/ceph/ceph-client.admin.149480.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159678.log.gz 2023-10-03T10:23:28.972 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.149480.log.gz 2023-10-03T10:23:28.972 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143350.log 2023-10-03T10:23:28.972 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127010.log 2023-10-03T10:23:28.973 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143350.log: /var/log/ceph/ceph-client.admin.127010.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.143350.log.gz 2023-10-03T10:23:28.973 INFO:teuthology.orchestra.run.smithi146.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.127010.log.gz 2023-10-03T10:23:28.973 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153918.log 2023-10-03T10:23:28.973 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188946.log 2023-10-03T10:23:28.973 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.153918.log: /var/log/ceph/ceph-client.admin.188946.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.153918.log.gz 2023-10-03T10:23:28.973 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.188946.log.gz 2023-10-03T10:23:28.973 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177790.log 2023-10-03T10:23:28.973 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157250.log 2023-10-03T10:23:28.974 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.177790.log: /var/log/ceph/ceph-client.admin.157250.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177790.log.gz 2023-10-03T10:23:28.974 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169447.log 2023-10-03T10:23:28.974 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.157250.log.gz 2023-10-03T10:23:28.974 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184185.log 2023-10-03T10:23:28.974 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.169447.log: /var/log/ceph/ceph-client.admin.184185.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.169447.log.gz 2023-10-03T10:23:28.974 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142140.log 2023-10-03T10:23:28.974 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184185.log.gz 2023-10-03T10:23:28.974 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148422.log 2023-10-03T10:23:28.974 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.142140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183056.log 2023-10-03T10:23:28.975 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.148422.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.142140.log.gz 2023-10-03T10:23:28.975 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148422.log.gz 2023-10-03T10:23:28.975 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.183056.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.183056.log.gz 2023-10-03T10:23:28.975 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139226.log 2023-10-03T10:23:28.975 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122941.log 2023-10-03T10:23:28.975 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.139226.log: /var/log/ceph/ceph-client.admin.122941.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139226.log.gz 2023-10-03T10:23:28.975 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122941.log.gz 2023-10-03T10:23:28.975 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137513.log 2023-10-03T10:23:28.976 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127546.log 2023-10-03T10:23:28.976 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.137513.log: /var/log/ceph/ceph-client.admin.127546.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.137513.log.gz 2023-10-03T10:23:28.976 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127546.log.gz 2023-10-03T10:23:28.976 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166862.log 2023-10-03T10:23:28.976 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149650.log 2023-10-03T10:23:28.976 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.166862.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.166862.log.gz 2023-10-03T10:23:28.976 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.149650.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149650.log.gz 2023-10-03T10:23:28.976 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158818.log 2023-10-03T10:23:28.976 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176728.log 2023-10-03T10:23:28.977 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.158818.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158818.log.gz 2023-10-03T10:23:28.977 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.176728.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.176728.log.gz 2023-10-03T10:23:28.977 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151762.log 2023-10-03T10:23:28.977 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158134.log 2023-10-03T10:23:28.977 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.151762.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151762.log.gz 2023-10-03T10:23:28.977 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.158134.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158134.log.gz 2023-10-03T10:23:28.978 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180709.log 2023-10-03T10:23:28.978 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175699.log 2023-10-03T10:23:28.978 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.180709.log: /var/log/ceph/ceph-client.admin.175699.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180709.log.gz 2023-10-03T10:23:28.978 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.175699.log.gz 2023-10-03T10:23:28.978 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150042.log 2023-10-03T10:23:28.978 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166351.log 2023-10-03T10:23:28.978 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.150042.log: /var/log/ceph/ceph-client.admin.166351.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.150042.log.gz 2023-10-03T10:23:28.978 INFO:teuthology.orchestra.run.smithi146.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.166351.log.gz 2023-10-03T10:23:28.979 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163581.log 2023-10-03T10:23:28.979 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154192.log 2023-10-03T10:23:28.979 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.163581.log: /var/log/ceph/ceph-client.admin.154192.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.163581.log.gz 2023-10-03T10:23:28.979 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154192.log.gz 2023-10-03T10:23:28.979 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145189.log 2023-10-03T10:23:28.979 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155930.log 2023-10-03T10:23:28.979 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.145189.log: /var/log/ceph/ceph-client.admin.155930.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.145189.log.gz 2023-10-03T10:23:28.979 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.155930.log.gz 2023-10-03T10:23:28.979 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194562.log 2023-10-03T10:23:28.980 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164314.log 2023-10-03T10:23:28.980 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.194562.log: /var/log/ceph/ceph-client.admin.164314.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.194562.log.gz 2023-10-03T10:23:28.980 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.164314.log.gz 2023-10-03T10:23:28.980 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139788.log 2023-10-03T10:23:28.980 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165346.log 2023-10-03T10:23:28.980 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.139788.log: /var/log/ceph/ceph-client.admin.165346.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.139788.log.gz 2023-10-03T10:23:28.994 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.165346.log.gz 2023-10-03T10:23:28.994 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148252.log 2023-10-03T10:23:28.995 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176932.log 2023-10-03T10:23:28.995 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.148252.log: /var/log/ceph/ceph-client.admin.176932.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148252.log.gz 2023-10-03T10:23:28.995 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176932.log.gz 2023-10-03T10:23:28.995 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146337.log 2023-10-03T10:23:28.995 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182129.log 2023-10-03T10:23:28.995 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.146337.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.146337.log.gz 2023-10-03T10:23:28.995 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.182129.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.182129.log.gz 2023-10-03T10:23:28.995 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154977.log 2023-10-03T10:23:28.995 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175429.log 2023-10-03T10:23:28.996 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.154977.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154977.log.gz 2023-10-03T10:23:28.996 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.175429.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.175429.log.gz 2023-10-03T10:23:28.996 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160837.log 2023-10-03T10:23:28.996 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139814.log 2023-10-03T10:23:28.996 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.160837.log: /var/log/ceph/ceph-client.admin.139814.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160837.log.gz 2023-10-03T10:23:28.996 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139814.log.gz 2023-10-03T10:23:28.996 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180853.log 2023-10-03T10:23:28.996 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174218.log 2023-10-03T10:23:28.997 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.180853.log: /var/log/ceph/ceph-client.admin.174218.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.180853.log.gz 2023-10-03T10:23:28.997 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174218.log.gz 2023-10-03T10:23:28.997 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168038.log 2023-10-03T10:23:28.997 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118453.log 2023-10-03T10:23:28.997 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.168038.log: /var/log/ceph/ceph-client.admin.118453.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.168038.log.gz 2023-10-03T10:23:28.997 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118453.log.gz 2023-10-03T10:23:28.997 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161278.log 2023-10-03T10:23:28.997 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189803.log 2023-10-03T10:23:28.998 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.161278.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.161278.log.gz 2023-10-03T10:23:28.998 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.189803.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.189803.log.gz 2023-10-03T10:23:28.998 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188626.log 2023-10-03T10:23:28.998 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161690.log 2023-10-03T10:23:28.998 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.188626.log: /var/log/ceph/ceph-client.admin.161690.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.188626.log.gz 2023-10-03T10:23:28.998 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.161690.log.gz 2023-10-03T10:23:28.998 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183009.log 2023-10-03T10:23:28.998 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127417.log 2023-10-03T10:23:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.183009.log: /var/log/ceph/ceph-client.admin.127417.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.183009.log.gz 2023-10-03T10:23:28.999 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127417.log.gz 2023-10-03T10:23:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142728.log 2023-10-03T10:23:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146264.log 2023-10-03T10:23:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.142728.log: /var/log/ceph/ceph-client.admin.146264.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142728.log.gz 2023-10-03T10:23:28.999 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.146264.log.gz 2023-10-03T10:23:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162845.log 2023-10-03T10:23:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153160.log 2023-10-03T10:23:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.162845.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162845.log.gz 2023-10-03T10:23:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.153160.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.153160.log.gz 2023-10-03T10:23:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137709.log 2023-10-03T10:23:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143938.log 2023-10-03T10:23:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.137709.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.137709.log.gz 2023-10-03T10:23:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143938.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.143938.log.gz 2023-10-03T10:23:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172209.log 2023-10-03T10:23:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190122.log 2023-10-03T10:23:29.000 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.172209.log: /var/log/ceph/ceph-client.admin.190122.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172209.log.gz 2023-10-03T10:23:29.001 INFO:teuthology.orchestra.run.smithi146.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.190122.log.gz 2023-10-03T10:23:29.001 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163726.log 2023-10-03T10:23:29.001 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168732.log 2023-10-03T10:23:29.001 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.163726.log: /var/log/ceph/ceph-client.admin.168732.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.163726.log.gz 2023-10-03T10:23:29.001 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.168732.log.gz 2023-10-03T10:23:29.001 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158307.log 2023-10-03T10:23:29.001 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173217.log 2023-10-03T10:23:29.001 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.158307.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158307.log.gz 2023-10-03T10:23:29.002 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.173217.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.173217.log.gz 2023-10-03T10:23:29.002 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123812.log 2023-10-03T10:23:29.002 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174171.log 2023-10-03T10:23:29.002 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.123812.log: /var/log/ceph/ceph-client.admin.174171.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.123812.log.gz 2023-10-03T10:23:29.002 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174171.log.gz 2023-10-03T10:23:29.002 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125328.log 2023-10-03T10:23:29.002 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182522.log 2023-10-03T10:23:29.002 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.125328.log: /var/log/ceph/ceph-client.admin.182522.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125328.log.gz 2023-10-03T10:23:29.002 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.182522.log.gz 2023-10-03T10:23:29.003 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194807.log 2023-10-03T10:23:29.003 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153604.log 2023-10-03T10:23:29.003 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.194807.log: /var/log/ceph/ceph-client.admin.153604.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.194807.log.gz 2023-10-03T10:23:29.003 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.153604.log.gz 2023-10-03T10:23:29.003 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183401.log 2023-10-03T10:23:29.003 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127572.log 2023-10-03T10:23:29.003 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.183401.log: /var/log/ceph/ceph-client.admin.127572.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.183401.log.gz 2023-10-03T10:23:29.003 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127572.log.gz 2023-10-03T10:23:29.004 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182225.log 2023-10-03T10:23:29.004 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124620.log 2023-10-03T10:23:29.004 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.182225.log: /var/log/ceph/ceph-client.admin.124620.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.182225.log.gz 2023-10-03T10:23:29.004 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124620.log.gz 2023-10-03T10:23:29.004 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185836.log 2023-10-03T10:23:29.004 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173583.log 2023-10-03T10:23:29.004 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.185836.log: /var/log/ceph/ceph-client.admin.173583.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.185836.log.gz 2023-10-03T10:23:29.004 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173583.log.gz 2023-10-03T10:23:29.004 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159602.log 2023-10-03T10:23:29.005 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140083.log 2023-10-03T10:23:29.005 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.159602.log: /var/log/ceph/ceph-client.admin.140083.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.159602.log.gz 2023-10-03T10:23:29.005 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140083.log.gz 2023-10-03T10:23:29.005 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140650.log 2023-10-03T10:23:29.005 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191149.log 2023-10-03T10:23:29.005 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.140650.log: /var/log/ceph/ceph-client.admin.191149.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.140650.log.gz 2023-10-03T10:23:29.005 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191149.log.gz 2023-10-03T10:23:29.005 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152243.log 2023-10-03T10:23:29.005 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155145.log 2023-10-03T10:23:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.152243.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152243.log.gz 2023-10-03T10:23:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.155145.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.155145.log.gz 2023-10-03T10:23:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167529.log 2023-10-03T10:23:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147346.log 2023-10-03T10:23:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.167529.log: /var/log/ceph/ceph-client.admin.147346.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.167529.log.gz 2023-10-03T10:23:29.006 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147346.log.gz 2023-10-03T10:23:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144966.log 2023-10-03T10:23:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148448.log 2023-10-03T10:23:29.007 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.144966.log: /var/log/ceph/ceph-client.admin.148448.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.144966.log.gz 2023-10-03T10:23:29.007 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.148448.log.gz 2023-10-03T10:23:29.007 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145161.log 2023-10-03T10:23:29.007 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190906.log 2023-10-03T10:23:29.007 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.145161.log: /var/log/ceph/ceph-client.admin.190906.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.145161.log.gz 2023-10-03T10:23:29.007 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.190906.log.gz 2023-10-03T10:23:29.007 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155734.log 2023-10-03T10:23:29.007 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.155734.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.155734.log.gz 2023-10-03T10:23:29.007 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123294.log 2023-10-03T10:23:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184969.log 2023-10-03T10:23:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.123294.log: /var/log/ceph/ceph-client.admin.184969.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.123294.log.gz 2023-10-03T10:23:29.008 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184969.log.gz 2023-10-03T10:23:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156688.log 2023-10-03T10:23:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154506.log 2023-10-03T10:23:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.156688.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156688.log.gz 2023-10-03T10:23:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.154506.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154506.log.gz 2023-10-03T10:23:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181833.log 2023-10-03T10:23:29.009 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147521.log 2023-10-03T10:23:29.009 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.181833.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.181833.log.gz 2023-10-03T10:23:29.017 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.147521.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.147521.log.gz 2023-10-03T10:23:29.017 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188113.log 2023-10-03T10:23:29.017 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174514.log 2023-10-03T10:23:29.017 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.188113.log: /var/log/ceph/ceph-client.admin.174514.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.188113.log.gz 2023-10-03T10:23:29.017 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.174514.log.gz 2023-10-03T10:23:29.017 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134758.log 2023-10-03T10:23:29.018 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176979.log 2023-10-03T10:23:29.018 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.134758.log: /var/log/ceph/ceph-client.admin.176979.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.134758.log.gz 2023-10-03T10:23:29.018 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.176979.log.gz 2023-10-03T10:23:29.018 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174759.log 2023-10-03T10:23:29.018 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128607.log 2023-10-03T10:23:29.018 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.174759.log: /var/log/ceph/ceph-client.admin.128607.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.174759.log.gz 2023-10-03T10:23:29.018 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128607.log.gz 2023-10-03T10:23:29.018 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155682.log 2023-10-03T10:23:29.018 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163804.log 2023-10-03T10:23:29.019 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.155682.log: /var/log/ceph/ceph-client.admin.163804.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.155682.log.gz 2023-10-03T10:23:29.019 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.163804.log.gz 2023-10-03T10:23:29.019 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158897.log 2023-10-03T10:23:29.019 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161178.log 2023-10-03T10:23:29.019 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.158897.log: /var/log/ceph/ceph-client.admin.161178.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158897.log.gz 2023-10-03T10:23:29.019 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.161178.log.gz 2023-10-03T10:23:29.019 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182494.log 2023-10-03T10:23:29.019 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158230.log 2023-10-03T10:23:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.182494.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.182494.log.gz 2023-10-03T10:23:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.158230.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.158230.log.gz 2023-10-03T10:23:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146384.log 2023-10-03T10:23:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151266.log 2023-10-03T10:23:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.146384.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146384.log.gz 2023-10-03T10:23:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.151266.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.151266.log.gz 2023-10-03T10:23:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182913.log 2023-10-03T10:23:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161081.log 2023-10-03T10:23:29.020 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.182913.log: /var/log/ceph/ceph-client.admin.161081.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.182913.log.gz 2023-10-03T10:23:29.021 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.161081.log.gz 2023-10-03T10:23:29.021 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124008.log 2023-10-03T10:23:29.021 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171283.log 2023-10-03T10:23:29.021 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.124008.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124008.log.gz 2023-10-03T10:23:29.021 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.171283.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171283.log.gz 2023-10-03T10:23:29.021 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147834.log 2023-10-03T10:23:29.021 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134835.log 2023-10-03T10:23:29.021 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.147834.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147834.log.gz 2023-10-03T10:23:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.134835.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.134835.log.gz 2023-10-03T10:23:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189777.log 2023-10-03T10:23:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159432.log 2023-10-03T10:23:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.189777.log: /var/log/ceph/ceph-client.admin.159432.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.189777.log.gz 2023-10-03T10:23:29.022 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159432.log.gz 2023-10-03T10:23:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145579.log 2023-10-03T10:23:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192596.log 2023-10-03T10:23:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.145579.log: /var/log/ceph/ceph-client.admin.192596.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.145579.log.gz 2023-10-03T10:23:29.022 INFO:teuthology.orchestra.run.smithi146.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.192596.log.gz 2023-10-03T10:23:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135231.log 2023-10-03T10:23:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176017.log 2023-10-03T10:23:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.135231.log: /var/log/ceph/ceph-client.admin.176017.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.135231.log.gz 2023-10-03T10:23:29.023 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176017.log.gz 2023-10-03T10:23:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140845.log 2023-10-03T10:23:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.140845.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140845.log.gz 2023-10-03T10:23:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181245.log 2023-10-03T10:23:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141774.log 2023-10-03T10:23:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.181245.log: /var/log/ceph/ceph-client.admin.141774.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.181245.log.gz 2023-10-03T10:23:29.024 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141774.log.gz 2023-10-03T10:23:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144377.log 2023-10-03T10:23:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149258.log 2023-10-03T10:23:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.144377.log: /var/log/ceph/ceph-client.admin.149258.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.144377.log.gz 2023-10-03T10:23:29.024 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149258.log.gz 2023-10-03T10:23:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166913.log 2023-10-03T10:23:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149402.log 2023-10-03T10:23:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.166913.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.166913.log.gz 2023-10-03T10:23:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.149402.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.149402.log.gz 2023-10-03T10:23:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179750.log 2023-10-03T10:23:29.029 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126832.log 2023-10-03T10:23:29.029 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.179750.log: 88.3%/var/log/ceph/ceph-client.admin.126832.log: -- replaced with /var/log/ceph/ceph-client.admin.179750.log.gz 2023-10-03T10:23:29.029 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.126832.log.gz 2023-10-03T10:23:29.029 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179481.log 2023-10-03T10:23:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160002.log 2023-10-03T10:23:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.179481.log: /var/log/ceph/ceph-client.admin.160002.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179481.log.gz 2023-10-03T10:23:29.030 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.160002.log.gz 2023-10-03T10:23:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139082.log 2023-10-03T10:23:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167744.log 2023-10-03T10:23:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.139082.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139082.log.gz 2023-10-03T10:23:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.167744.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.167744.log.gz 2023-10-03T10:23:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177471.log 2023-10-03T10:23:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176409.log 2023-10-03T10:23:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.177471.log: /var/log/ceph/ceph-client.admin.176409.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.177471.log.gz 2023-10-03T10:23:29.031 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.176409.log.gz 2023-10-03T10:23:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148279.log 2023-10-03T10:23:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142950.log 2023-10-03T10:23:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.148279.log: /var/log/ceph/ceph-client.admin.142950.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.148279.log.gz 2023-10-03T10:23:29.031 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142950.log.gz 2023-10-03T10:23:29.032 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171817.log 2023-10-03T10:23:29.032 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189581.log 2023-10-03T10:23:29.032 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.171817.log: /var/log/ceph/ceph-client.admin.189581.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171817.log.gz 2023-10-03T10:23:29.032 INFO:teuthology.orchestra.run.smithi146.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.189581.log.gz 2023-10-03T10:23:29.032 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155486.log 2023-10-03T10:23:29.032 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166352.log 2023-10-03T10:23:29.032 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.155486.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.155486.log.gz/var/log/ceph/ceph-client.admin.166352.log: 2023-10-03T10:23:29.032 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.166352.log.gz 2023-10-03T10:23:29.032 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183252.log 2023-10-03T10:23:29.033 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153995.log 2023-10-03T10:23:29.033 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.183252.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.183252.log.gz 2023-10-03T10:23:29.033 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.153995.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.153995.log.gz 2023-10-03T10:23:29.033 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135356.log 2023-10-03T10:23:29.033 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178182.log 2023-10-03T10:23:29.033 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.135356.log: /var/log/ceph/ceph-client.admin.178182.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135356.log.gz 2023-10-03T10:23:29.033 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.178182.log.gz 2023-10-03T10:23:29.033 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171433.log 2023-10-03T10:23:29.033 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136534.log 2023-10-03T10:23:29.036 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.171433.log: /var/log/ceph/ceph-client.admin.136534.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.171433.log.gz 2023-10-03T10:23:29.037 INFO:teuthology.orchestra.run.smithi146.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.136534.log.gz 2023-10-03T10:23:29.037 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143520.log 2023-10-03T10:23:29.037 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150382.log 2023-10-03T10:23:29.037 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143520.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143520.log.gz 2023-10-03T10:23:29.037 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.150382.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.150382.log.gz 2023-10-03T10:23:29.037 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191175.log 2023-10-03T10:23:29.037 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165934.log 2023-10-03T10:23:29.038 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.191175.log: /var/log/ceph/ceph-client.admin.165934.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.191175.log.gz 2023-10-03T10:23:29.038 INFO:teuthology.orchestra.run.smithi146.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.165934.log.gz 2023-10-03T10:23:29.038 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154753.log 2023-10-03T10:23:29.038 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154532.log 2023-10-03T10:23:29.038 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.154753.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154753.log.gz 2023-10-03T10:23:29.038 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.154532.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154532.log.gz 2023-10-03T10:23:29.038 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140649.log 2023-10-03T10:23:29.038 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146580.log 2023-10-03T10:23:29.038 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.140649.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140649.log.gz 2023-10-03T10:23:29.039 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.146580.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.146580.log.gz 2023-10-03T10:23:29.039 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184624.log 2023-10-03T10:23:29.039 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135551.log 2023-10-03T10:23:29.039 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.184624.log: /var/log/ceph/ceph-client.admin.135551.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.184624.log.gz 2023-10-03T10:23:29.039 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135551.log.gz 2023-10-03T10:23:29.039 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-03T10:23:29.042 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152154.log 2023-10-03T10:23:29.042 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.152154.log: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-03T10:23:29.042 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.152154.log.gz 2023-10-03T10:23:29.042 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178058.log 2023-10-03T10:23:29.042 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175821.log 2023-10-03T10:23:29.042 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.178058.log: /var/log/ceph/ceph-client.admin.175821.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.178058.log.gz 2023-10-03T10:23:29.042 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.175821.log.gz 2023-10-03T10:23:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135355.log 2023-10-03T10:23:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145676.log 2023-10-03T10:23:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.135355.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.135355.log.gz 2023-10-03T10:23:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.145676.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.145676.log.gz 2023-10-03T10:23:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161080.log 2023-10-03T10:23:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178840.log 2023-10-03T10:23:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.161080.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.161080.log.gz 2023-10-03T10:23:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.178840.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.178840.log.gz 2023-10-03T10:23:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160865.log 2023-10-03T10:23:29.045 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140258.log 2023-10-03T10:23:29.045 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.160865.log: /var/log/ceph/ceph-client.admin.140258.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160865.log.gz 2023-10-03T10:23:29.045 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.140258.log.gz 2023-10-03T10:23:29.046 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125573.log 2023-10-03T10:23:29.046 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147934.log 2023-10-03T10:23:29.046 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.125573.log: /var/log/ceph/ceph-client.admin.147934.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125573.log.gz 2023-10-03T10:23:29.046 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.147934.log.gz 2023-10-03T10:23:29.046 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162576.log 2023-10-03T10:23:29.046 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184577.log 2023-10-03T10:23:29.046 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.162576.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162576.log.gz 2023-10-03T10:23:29.048 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.184577.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.184577.log.gz 2023-10-03T10:23:29.048 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149088.log 2023-10-03T10:23:29.048 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170006.log 2023-10-03T10:23:29.048 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.149088.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149088.log.gz 2023-10-03T10:23:29.049 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.170006.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170006.log.gz 2023-10-03T10:23:29.049 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145527.log 2023-10-03T10:23:29.049 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187182.log 2023-10-03T10:23:29.049 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.145527.log: /var/log/ceph/ceph-client.admin.187182.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.145527.log.gz 2023-10-03T10:23:29.049 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.187182.log.gz 2023-10-03T10:23:29.049 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129864.log 2023-10-03T10:23:29.050 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190657.log 2023-10-03T10:23:29.050 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.129864.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.129864.log.gz 2023-10-03T10:23:29.051 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.190657.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.190657.log.gz 2023-10-03T10:23:29.051 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183129.log 2023-10-03T10:23:29.051 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191371.log 2023-10-03T10:23:29.051 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.183129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186202.log 2023-10-03T10:23:29.051 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.183129.log.gz 2023-10-03T10:23:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.191371.log: /var/log/ceph/ceph-client.admin.186202.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.191371.log.gz 2023-10-03T10:23:29.052 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.186202.log.gz 2023-10-03T10:23:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135552.log 2023-10-03T10:23:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168136.log 2023-10-03T10:23:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.135552.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135552.log.gz 2023-10-03T10:23:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.168136.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.168136.log.gz 2023-10-03T10:23:29.054 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168531.log 2023-10-03T10:23:29.054 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193898.log 2023-10-03T10:23:29.054 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.168531.log: /var/log/ceph/ceph-client.admin.193898.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.168531.log.gz 2023-10-03T10:23:29.054 INFO:teuthology.orchestra.run.smithi146.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.193898.log.gz 2023-10-03T10:23:29.054 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137514.log 2023-10-03T10:23:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128999.log 2023-10-03T10:23:29.056 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.137514.log: /var/log/ceph/ceph-client.admin.128999.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.137514.log.gz 2023-10-03T10:23:29.056 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.128999.log.gz 2023-10-03T10:23:29.056 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180341.log 2023-10-03T10:23:29.056 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159040.log 2023-10-03T10:23:29.056 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.180341.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180341.log.gz 2023-10-03T10:23:29.057 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.159040.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.159040.log.gz 2023-10-03T10:23:29.057 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156762.log 2023-10-03T10:23:29.058 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149478.log 2023-10-03T10:23:29.058 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.156762.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.156762.log.gz 2023-10-03T10:23:29.058 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.149478.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.149478.log.gz 2023-10-03T10:23:29.058 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163386.log 2023-10-03T10:23:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.163386.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.163386.log.gz 2023-10-03T10:23:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152938.log 2023-10-03T10:23:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166717.log 2023-10-03T10:23:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.152938.log: /var/log/ceph/ceph-client.admin.166717.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.152938.log.gz 2023-10-03T10:23:29.060 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166717.log.gz 2023-10-03T10:23:29.060 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178305.log 2023-10-03T10:23:29.060 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186349.log 2023-10-03T10:23:29.061 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.178305.log: /var/log/ceph/ceph-client.admin.186349.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178305.log.gz 2023-10-03T10:23:29.061 INFO:teuthology.orchestra.run.smithi146.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.186349.log.gz 2023-10-03T10:23:29.061 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155512.log 2023-10-03T10:23:29.062 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172039.log 2023-10-03T10:23:29.062 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.155512.log: /var/log/ceph/ceph-client.admin.172039.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.155512.log.gz 2023-10-03T10:23:29.062 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172039.log.gz 2023-10-03T10:23:29.062 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142038.log 2023-10-03T10:23:29.063 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139869.log 2023-10-03T10:23:29.063 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.142038.log: /var/log/ceph/ceph-client.admin.139869.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.142038.log.gz 2023-10-03T10:23:29.063 INFO:teuthology.orchestra.run.smithi146.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.139869.log.gz 2023-10-03T10:23:29.063 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184822.log 2023-10-03T10:23:29.064 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143418.log 2023-10-03T10:23:29.064 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.184822.log: /var/log/ceph/ceph-client.admin.143418.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.184822.log.gz 2023-10-03T10:23:29.064 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143418.log.gz 2023-10-03T10:23:29.064 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138496.log 2023-10-03T10:23:29.065 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141016.log 2023-10-03T10:23:29.065 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.138496.log: /var/log/ceph/ceph-client.admin.141016.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138496.log.gz 2023-10-03T10:23:29.065 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141016.log.gz 2023-10-03T10:23:29.065 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192551.log 2023-10-03T10:23:29.066 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186006.log 2023-10-03T10:23:29.066 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.192551.log: /var/log/ceph/ceph-client.admin.186006.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.192551.log.gz 2023-10-03T10:23:29.067 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.186006.log.gz 2023-10-03T10:23:29.067 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149846.log 2023-10-03T10:23:29.067 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149990.log 2023-10-03T10:23:29.068 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.149846.log: /var/log/ceph/ceph-client.admin.149990.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149846.log.gz 2023-10-03T10:23:29.068 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.149990.log.gz 2023-10-03T10:23:29.068 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181147.log 2023-10-03T10:23:29.069 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186937.log 2023-10-03T10:23:29.069 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.181147.log: /var/log/ceph/ceph-client.admin.186937.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.181147.log.gz 2023-10-03T10:23:29.069 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.186937.log.gz 2023-10-03T10:23:29.069 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177397.log 2023-10-03T10:23:29.069 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161766.log 2023-10-03T10:23:29.070 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.177397.log: /var/log/ceph/ceph-client.admin.161766.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.177397.log.gz 2023-10-03T10:23:29.070 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161766.log.gz 2023-10-03T10:23:29.070 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136924.log 2023-10-03T10:23:29.071 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136090.log 2023-10-03T10:23:29.071 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.136924.log: /var/log/ceph/ceph-client.admin.136090.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.136924.log.gz 2023-10-03T10:23:29.071 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.136090.log.gz 2023-10-03T10:23:29.071 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150851.log 2023-10-03T10:23:29.072 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166156.log 2023-10-03T10:23:29.072 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.150851.log: /var/log/ceph/ceph-client.admin.166156.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.150851.log.gz 2023-10-03T10:23:29.072 INFO:teuthology.orchestra.run.smithi146.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166156.log.gz 2023-10-03T10:23:29.072 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167450.log 2023-10-03T10:23:29.073 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192792.log 2023-10-03T10:23:29.073 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.167450.log: /var/log/ceph/ceph-client.admin.192792.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.167450.log.gz 2023-10-03T10:23:29.073 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.192792.log.gz 2023-10-03T10:23:29.074 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166940.log 2023-10-03T10:23:29.074 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124669.log 2023-10-03T10:23:29.074 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.166940.log: /var/log/ceph/ceph-client.admin.124669.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.166940.log.gz 2023-10-03T10:23:29.075 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124669.log.gz 2023-10-03T10:23:29.075 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136729.log 2023-10-03T10:23:29.075 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152768.log 2023-10-03T10:23:29.076 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.136729.log: /var/log/ceph/ceph-client.admin.152768.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.136729.log.gz 2023-10-03T10:23:29.076 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.152768.log.gz 2023-10-03T10:23:29.076 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187255.log 2023-10-03T10:23:29.077 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142999.log 2023-10-03T10:23:29.077 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.187255.log: /var/log/ceph/ceph-client.admin.142999.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.187255.log.gz 2023-10-03T10:23:29.077 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.142999.log.gz 2023-10-03T10:23:29.077 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162258.log 2023-10-03T10:23:29.078 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.162258.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162258.log.gz 2023-10-03T10:23:29.078 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147150.log 2023-10-03T10:23:29.079 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164169.log 2023-10-03T10:23:29.079 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.147150.log: /var/log/ceph/ceph-client.admin.164169.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147150.log.gz 2023-10-03T10:23:29.079 INFO:teuthology.orchestra.run.smithi146.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164169.log.gz 2023-10-03T10:23:29.079 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167745.log 2023-10-03T10:23:29.080 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149676.log 2023-10-03T10:23:29.080 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.167745.log: /var/log/ceph/ceph-client.admin.149676.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.167745.log.gz 2023-10-03T10:23:29.080 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149676.log.gz 2023-10-03T10:23:29.080 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170475.log 2023-10-03T10:23:29.081 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185018.log 2023-10-03T10:23:29.081 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.170475.log: /var/log/ceph/ceph-client.admin.185018.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.170475.log.gz 2023-10-03T10:23:29.081 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160470.log 2023-10-03T10:23:29.081 INFO:teuthology.orchestra.run.smithi146.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.185018.log.gz 2023-10-03T10:23:29.082 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.160470.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.160470.log.gz 2023-10-03T10:23:29.158 INFO:teuthology.orchestra.run.smithi146.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-03T10:23:29.184 INFO:teuthology.orchestra.run.smithi146.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-03T10:23:29.193 INFO:teuthology.orchestra.run.smithi146.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-03T10:23:29.310 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-03T10:23:29.475 INFO:teuthology.orchestra.run.smithi146.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-03T10:23:29.477 INFO:teuthology.orchestra.run.smithi146.stderr: 2023-10-03T10:23:29.477 INFO:teuthology.orchestra.run.smithi146.stderr:real 0m1.057s 2023-10-03T10:23:29.477 INFO:teuthology.orchestra.run.smithi146.stderr:user 0m3.825s 2023-10-03T10:23:29.477 INFO:teuthology.orchestra.run.smithi146.stderr:sys 0m0.815s 2023-10-03T10:23:29.477 INFO:tasks.ceph:Archiving logs... 2023-10-03T10:23:29.478 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409562/remote/smithi146/log 2023-10-03T10:23:29.479 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-03T10:23:31.107 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409562/remote/smithi153/log 2023-10-03T10:23:31.108 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-03T10:23:31.143 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi146 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:23:31.153 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-03T10:23:31.171 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi146 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:23:31.175 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-03T10:23:31.175 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-03T10:23:31.181 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-03T10:23:31.296 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-03T10:23:31.307 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-03T10:23:31.307 DEBUG:teuthology.orchestra.run.smithi146:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T10:23:31.310 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T10:23:31.328 INFO:teuthology.orchestra.run.smithi146.stderr:bash: ntpq: command not found 2023-10-03T10:23:31.329 INFO:teuthology.orchestra.run.smithi153.stderr:bash: ntpq: command not found 2023-10-03T10:23:31.333 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-03T10:23:31.333 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2023-10-03T10:23:31.333 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 44 +640us[ +636us] +/- 72ms 2023-10-03T10:23:31.333 INFO:teuthology.orchestra.run.smithi146.stdout:^* hv02.front.sepia.ceph.com 3 6 377 41 -184us[ -188us] +/- 59ms 2023-10-03T10:23:31.333 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 -309us[ -309us] +/- 79ms 2023-10-03T10:23:31.333 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:23:31.335 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-03T10:23:31.335 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2023-10-03T10:23:31.335 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 39 +625us[ +625us] +/- 72ms 2023-10-03T10:23:31.335 INFO:teuthology.orchestra.run.smithi153.stdout:^* hv02.front.sepia.ceph.com 3 6 377 42 -202us[ -201us] +/- 59ms 2023-10-03T10:23:31.335 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 -341us[ -341us] +/- 79ms 2023-10-03T10:23:31.335 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:23:31.336 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-03T10:23:31.350 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-03T10:23:31.351 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-03T10:23:31.373 DEBUG:teuthology.orchestra.run.smithi146:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-03T10:23:31.429 DEBUG:teuthology.orchestra.run.smithi153:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-03T10:23:31.520 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-03T10:23:31.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:23:31.551 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-03T10:23:31.583 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:23:31.583 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-03T10:23:31.595 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-03T10:23:31.676 INFO:teuthology.task.internal:Duration was 1466.642244 seconds 2023-10-03T10:23:31.677 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-03T10:23:31.762 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-03T10:23:31.762 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-03T10:23:31.765 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-03T10:23:31.812 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-03T10:23:31.815 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-03T10:23:32.106 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-03T10:23:32.107 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi146.front.sepia.ceph.com 2023-10-03T10:23:32.107 DEBUG:teuthology.orchestra.run.smithi146:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-03T10:23:32.131 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2023-10-03T10:23:32.131 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-03T10:23:32.154 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-03T10:23:32.154 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-03T10:23:32.174 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-03T10:23:32.234 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-03T10:23:32.234 DEBUG:teuthology.orchestra.run.smithi146:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T10:23:32.236 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T10:23:32.338 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-03T10:23:32.351 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-03T10:23:32.351 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-03T10:23:32.378 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-03T10:23:32.405 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-03T10:23:32.417 DEBUG:teuthology.orchestra.run.smithi146:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:23:32.420 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:23:32.447 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = core 2023-10-03T10:23:32.473 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2023-10-03T10:23:32.486 DEBUG:teuthology.orchestra.run.smithi146:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:23:32.537 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi146.front.sepia.ceph.com, flagging run as failed 2023-10-03T10:23:32.538 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:23:32.554 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:23:32.555 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-03T10:23:32.567 INFO:teuthology.task.internal:Transferring archived files... 2023-10-03T10:23:32.568 DEBUG:teuthology.misc:Transferring archived files from smithi146:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409562/remote/smithi146 2023-10-03T10:23:32.568 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-03T10:24:57.803 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2023-10-03T10:24:57.815 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409562/remote/smithi146/coredump/1696327935.126749.core.gz: gzip compressed data, was "1696327935.126749.core", last modified: Tue Oct 3 10:23:32 2023, max compression, original size modulo 2^32 1364250624 2023-10-03T10:24:57.815 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2023-10-03T10:25:03.524 INFO:teuthology.task.internal: core looks like: /tmp/tmpmwyeir6v: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mgr -f --cluster ceph -i x', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mgr', platform: 'x86_64' 2023-10-03T10:25:03.659 INFO:teuthology.task.internal: dump_program: ceph-mgr -f --cluster ceph -i x 2023-10-03T10:25:03.659 DEBUG:teuthology.orchestra.run.smithi146:> which 'ceph-mgr -f --cluster ceph -i x' 2023-10-03T10:25:03.682 INFO:teuthology.orchestra.run.smithi146.stderr:/usr/bin/which: invalid option -- 'f' 2023-10-03T10:25:03.682 INFO:teuthology.orchestra.run.smithi146.stderr:/usr/bin/which: unrecognized option '--cluster' 2023-10-03T10:25:03.683 INFO:teuthology.orchestra.run.smithi146.stderr:/usr/bin/which: no x in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin) 2023-10-03T10:25:03.683 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:25:03.684 INFO:teuthology.orchestra.run.smithi146.stdout:/usr/bin/ceph-mgr 2023-10-03T10:25:03.684 INFO:teuthology.orchestra.run.smithi146.stdout:/usr/bin/ceph 2023-10-03T10:25:03.684 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 392, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi146 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi146 with status 1: "which 'ceph-mgr -f --cluster ceph -i x'" 2023-10-03T10:25:03.702 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-03T10:25:03.715 INFO:teuthology.task.internal:Not uploading archives. 2023-10-03T10:25:03.715 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-03T10:25:03.755 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-03T10:25:03.755 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-03T10:25:03.770 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-03T10:25:03.783 INFO:teuthology.orchestra.run.smithi146.stdout: 525757 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest 2023-10-03T10:25:03.783 INFO:teuthology.orchestra.run.smithi146.stdout: 525780 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest/archive 2023-10-03T10:25:03.783 INFO:teuthology.orchestra.run.smithi146.stdout: 525797 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 3 10:12 /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:25:03.783 INFO:teuthology.orchestra.run.smithi146.stdout: 525593 361728 -rw------- 1 root root 1364250624 Oct 3 10:12 /home/ubuntu/cephtest/archive/coredump/1696327935.126749.core 2023-10-03T10:25:03.783 INFO:teuthology.orchestra.run.smithi146.stdout: 655783 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest/archive/audit 2023-10-03T10:25:03.783 INFO:teuthology.orchestra.run.smithi146.stdout: 655821 28 -rw------- 1 ubuntu ubuntu 25241 Oct 3 10:23 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-10-03T10:25:03.783 INFO:teuthology.orchestra.run.smithi146.stdout: 525813 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest/archive/syslog 2023-10-03T10:25:03.784 INFO:teuthology.orchestra.run.smithi146.stdout: 525476 4 -rw-rw-rw- 1 ubuntu ubuntu 766 Oct 3 10:23 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-10-03T10:25:03.784 INFO:teuthology.orchestra.run.smithi146.stdout: 525521 112 -rw-rw-r-- 1 ubuntu ubuntu 113433 Oct 3 10:23 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T10:25:03.784 INFO:teuthology.orchestra.run.smithi146.stdout: 525477 132 -rw-rw-rw- 1 ubuntu ubuntu 134037 Oct 3 10:23 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-10-03T10:25:03.785 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:25:03.785 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-03T10:25:03.785 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi146 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi146 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-03T10:25:03.797 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-03T10:25:03.809 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-03T10:25:03.845 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi146 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:25:03.846 INFO:teuthology.nuke:Checking targets against current locks 2023-10-03T10:25:03.853 INFO:teuthology.orchestra.run.smithi153.stdout: 525961 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest 2023-10-03T10:25:03.853 INFO:teuthology.orchestra.run.smithi153.stdout: 525974 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest/archive 2023-10-03T10:25:03.853 INFO:teuthology.orchestra.run.smithi153.stdout: 655785 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest/archive/audit 2023-10-03T10:25:03.853 INFO:teuthology.orchestra.run.smithi153.stdout: 655787 220 -rw------- 1 ubuntu ubuntu 224231 Oct 3 10:23 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-10-03T10:25:03.853 INFO:teuthology.orchestra.run.smithi153.stdout: 526002 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest/archive/syslog 2023-10-03T10:25:03.853 INFO:teuthology.orchestra.run.smithi153.stdout: 525476 4 -rw-rw-rw- 1 ubuntu ubuntu 893 Oct 3 10:21 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-10-03T10:25:03.854 INFO:teuthology.orchestra.run.smithi153.stdout: 525521 92 -rw-rw-r-- 1 ubuntu ubuntu 92479 Oct 3 10:23 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T10:25:03.854 INFO:teuthology.orchestra.run.smithi153.stdout: 525477 88 -rw-rw-rw- 1 ubuntu ubuntu 87100 Oct 3 10:23 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-10-03T10:25:03.855 INFO:teuthology.orchestra.run.smithi153.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-03T10:25:03.879 DEBUG:teuthology.nuke:shortname: smithi146 2023-10-03T10:25:03.879 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T10:25:03.905 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409562', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 09:49:44.150739', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB+K7n2yj67VdGuozLM5Nf2IsIMW4wEjE0ejV7WP7FpYH4Qrs3NXcYTQW9OnZrK0MUbEKGyWLCiWLaQCkbszNM0='} 2023-10-03T10:25:03.909 DEBUG:teuthology.nuke:shortname: smithi153 2023-10-03T10:25:03.909 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T10:25:03.932 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409562', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 09:49:44.149074', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKVmzuFyAzqWBzOUbLkKp8CcK0w64CBZjXQHqXJcmpJakqAy5zNTfpGQQIDBFlaIU3ty3UIENvK6OkneelN+AGc='} 2023-10-03T10:25:03.958 INFO:teuthology.orchestra.console.smithi146:Power off 2023-10-03T10:25:03.959 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T10:25:03.975 INFO:teuthology.orchestra.console.smithi153:Power off 2023-10-03T10:25:03.976 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T10:25:03.984 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2023-10-03T10:25:03.985 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:25:03.997 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-10-03T10:25:03.998 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:25:04.006 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-10-03T10:25:04.019 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-10-03T10:25:08.007 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:25:08.020 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:25:08.117 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-10-03T10:25:08.130 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-10-03T10:25:12.122 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:25:12.131 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:25:12.233 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-10-03T10:25:12.240 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-10-03T10:25:12.335 INFO:teuthology.orchestra.console.smithi146:Power off completed 2023-10-03T10:25:12.341 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-10-03T10:25:12.445 INFO:teuthology.run:Summary data: description: fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/fsstress}}} duration: 1466.6422436237335 failure_reason: 'Command failed on smithi146 with status 124: ''sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json''' flavor: default owner: scheduled_dparmar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=7c3680069d404d0da1fb634ea117a8d3 status: fail success: false 2023-10-03T10:25:12.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T10:25:12.528 INFO:teuthology.run:FAIL